[==========] Running 8 tests from 2 test suites.
[----------] Global test environment set-up.
[----------] 6 tests from LeaderRebalancerTest
[ RUN      ] LeaderRebalancerTest.FunctionalTestForDivided
WARNING: Logging before InitGoogleLogging() is written to STDERR
I20260709 13:17:37.268959  5625 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.5.126.126:37087
I20260709 13:17:37.270761  5625 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260709 13:17:37.271807  5625 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:17:37.291684  5631 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:17:37.291785  5632 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:17:37.295320  5625 server_base.cc:1061] running on GCE node
W20260709 13:17:37.293053  5634 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:17:38.541781  5625 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:17:38.542131  5625 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:17:38.542366  5625 hybrid_clock.cc:648] HybridClock initialized: now 1783603058542335 us; error 0 us; skew 500 ppm
I20260709 13:17:38.543309  5625 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:17:38.551295  5625 webserver.cc:533] Webserver started at http://127.5.126.126:45011/ using document root <none> and password file <none>
I20260709 13:17:38.552424  5625 fs_manager.cc:362] Metadata directory not provided
I20260709 13:17:38.552711  5625 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:17:38.553246  5625 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:17:38.560201  5625 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskWHb0CB/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783603057096655-5625-0/minicluster-data/master-0-root/instance:
uuid: "cbd54be4b5794d47a441e16f31712fdc"
format_stamp: "Formatted at 2026-07-09 13:17:38 on dist-test-slave-smzk"
I20260709 13:17:38.569698  5625 fs_manager.cc:696] Time spent creating directory manager: real 0.008s	user 0.007s	sys 0.001s
I20260709 13:17:38.576401  5640 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:17:38.578179  5625 fs_manager.cc:730] Time spent opening block manager: real 0.005s	user 0.002s	sys 0.002s
I20260709 13:17:38.578711  5625 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskWHb0CB/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783603057096655-5625-0/minicluster-data/master-0-root
uuid: "cbd54be4b5794d47a441e16f31712fdc"
format_stamp: "Formatted at 2026-07-09 13:17:38 on dist-test-slave-smzk"
I20260709 13:17:38.579169  5625 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWHb0CB/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783603057096655-5625-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskWHb0CB/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783603057096655-5625-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskWHb0CB/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783603057096655-5625-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:17:38.651621  5625 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:17:38.653625  5625 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260709 13:17:38.654176  5625 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:17:38.743055  5625 rpc_server.cc:307] RPC server started. Bound to: 127.5.126.126:37087
I20260709 13:17:38.743218  5691 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.5.126.126:37087 every 8 connection(s)
I20260709 13:17:38.752590  5692 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:38.779235  5692 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P cbd54be4b5794d47a441e16f31712fdc: Bootstrap starting.
I20260709 13:17:38.786713  5692 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P cbd54be4b5794d47a441e16f31712fdc: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:38.789165  5692 log.cc:826] T 00000000000000000000000000000000 P cbd54be4b5794d47a441e16f31712fdc: Log is configured to *not* fsync() on all Append() calls
I20260709 13:17:38.795678  5692 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P cbd54be4b5794d47a441e16f31712fdc: No bootstrap required, opened a new log
I20260709 13:17:38.821213  5692 raft_consensus.cc:359] T 00000000000000000000000000000000 P cbd54be4b5794d47a441e16f31712fdc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cbd54be4b5794d47a441e16f31712fdc" member_type: VOTER }
I20260709 13:17:38.822054  5692 raft_consensus.cc:385] T 00000000000000000000000000000000 P cbd54be4b5794d47a441e16f31712fdc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:38.822307  5692 raft_consensus.cc:740] T 00000000000000000000000000000000 P cbd54be4b5794d47a441e16f31712fdc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cbd54be4b5794d47a441e16f31712fdc, State: Initialized, Role: FOLLOWER
I20260709 13:17:38.823654  5692 consensus_queue.cc:260] T 00000000000000000000000000000000 P cbd54be4b5794d47a441e16f31712fdc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cbd54be4b5794d47a441e16f31712fdc" member_type: VOTER }
I20260709 13:17:38.824311  5692 raft_consensus.cc:399] T 00000000000000000000000000000000 P cbd54be4b5794d47a441e16f31712fdc [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:17:38.824612  5692 raft_consensus.cc:493] T 00000000000000000000000000000000 P cbd54be4b5794d47a441e16f31712fdc [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:17:38.824967  5692 raft_consensus.cc:3060] T 00000000000000000000000000000000 P cbd54be4b5794d47a441e16f31712fdc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:38.830225  5692 raft_consensus.cc:515] T 00000000000000000000000000000000 P cbd54be4b5794d47a441e16f31712fdc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cbd54be4b5794d47a441e16f31712fdc" member_type: VOTER }
I20260709 13:17:38.831176  5692 leader_election.cc:304] T 00000000000000000000000000000000 P cbd54be4b5794d47a441e16f31712fdc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: cbd54be4b5794d47a441e16f31712fdc; no voters: 
I20260709 13:17:38.833359  5692 leader_election.cc:290] T 00000000000000000000000000000000 P cbd54be4b5794d47a441e16f31712fdc [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:17:38.833891  5695 raft_consensus.cc:2804] T 00000000000000000000000000000000 P cbd54be4b5794d47a441e16f31712fdc [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:38.836907  5695 raft_consensus.cc:697] T 00000000000000000000000000000000 P cbd54be4b5794d47a441e16f31712fdc [term 1 LEADER]: Becoming Leader. State: Replica: cbd54be4b5794d47a441e16f31712fdc, State: Running, Role: LEADER
I20260709 13:17:38.838056  5695 consensus_queue.cc:237] T 00000000000000000000000000000000 P cbd54be4b5794d47a441e16f31712fdc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cbd54be4b5794d47a441e16f31712fdc" member_type: VOTER }
I20260709 13:17:38.839380  5692 sys_catalog.cc:565] T 00000000000000000000000000000000 P cbd54be4b5794d47a441e16f31712fdc [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:17:38.854236  5696 sys_catalog.cc:455] T 00000000000000000000000000000000 P cbd54be4b5794d47a441e16f31712fdc [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "cbd54be4b5794d47a441e16f31712fdc" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cbd54be4b5794d47a441e16f31712fdc" member_type: VOTER } }
I20260709 13:17:38.854116  5697 sys_catalog.cc:455] T 00000000000000000000000000000000 P cbd54be4b5794d47a441e16f31712fdc [sys.catalog]: SysCatalogTable state changed. Reason: New leader cbd54be4b5794d47a441e16f31712fdc. Latest consensus state: current_term: 1 leader_uuid: "cbd54be4b5794d47a441e16f31712fdc" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cbd54be4b5794d47a441e16f31712fdc" member_type: VOTER } }
I20260709 13:17:38.855314  5697 sys_catalog.cc:458] T 00000000000000000000000000000000 P cbd54be4b5794d47a441e16f31712fdc [sys.catalog]: This master's current role is: LEADER
I20260709 13:17:38.855423  5696 sys_catalog.cc:458] T 00000000000000000000000000000000 P cbd54be4b5794d47a441e16f31712fdc [sys.catalog]: This master's current role is: LEADER
I20260709 13:17:38.858599  5705 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:17:38.871269  5705 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:17:38.874581  5625 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:17:38.895848  5705 catalog_manager.cc:1383] Generated new cluster ID: 88ca210000ef44e9be789e1a6796df00
I20260709 13:17:38.896488  5705 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:17:38.944270  5705 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:17:38.947176  5705 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:17:38.977694  5705 catalog_manager.cc:6070] T 00000000000000000000000000000000 P cbd54be4b5794d47a441e16f31712fdc: Generated new TSK 0
I20260709 13:17:38.979058  5705 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:17:39.006695  5625 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:17:39.017673  5714 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:17:39.018844  5715 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:17:39.024184  5625 server_base.cc:1061] running on GCE node
W20260709 13:17:39.024333  5717 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:17:39.025419  5625 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:17:39.025642  5625 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:17:39.025867  5625 hybrid_clock.cc:648] HybridClock initialized: now 1783603059025845 us; error 0 us; skew 500 ppm
I20260709 13:17:39.026584  5625 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:17:39.032230  5625 webserver.cc:533] Webserver started at http://127.5.126.65:35359/ using document root <none> and password file <none>
I20260709 13:17:39.032938  5625 fs_manager.cc:362] Metadata directory not provided
I20260709 13:17:39.033185  5625 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:17:39.033537  5625 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:17:39.034848  5625 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskWHb0CB/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783603057096655-5625-0/minicluster-data/ts-0-root/instance:
uuid: "f5fa01ffe1374026ac11fcab41d7264d"
format_stamp: "Formatted at 2026-07-09 13:17:39 on dist-test-slave-smzk"
I20260709 13:17:39.041899  5625 fs_manager.cc:696] Time spent creating directory manager: real 0.006s	user 0.002s	sys 0.007s
I20260709 13:17:39.047994  5722 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:17:39.049785  5625 fs_manager.cc:730] Time spent opening block manager: real 0.005s	user 0.003s	sys 0.001s
I20260709 13:17:39.050201  5625 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskWHb0CB/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783603057096655-5625-0/minicluster-data/ts-0-root
uuid: "f5fa01ffe1374026ac11fcab41d7264d"
format_stamp: "Formatted at 2026-07-09 13:17:39 on dist-test-slave-smzk"
I20260709 13:17:39.050544  5625 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWHb0CB/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783603057096655-5625-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskWHb0CB/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783603057096655-5625-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskWHb0CB/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783603057096655-5625-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:17:39.074162  5625 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:17:39.075984  5625 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:17:39.079229  5625 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:17:39.084574  5625 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:17:39.084873  5625 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:17:39.085258  5625 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:17:39.085445  5625 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:17:39.213851  5625 rpc_server.cc:307] RPC server started. Bound to: 127.5.126.65:41321
I20260709 13:17:39.213958  5784 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.5.126.65:41321 every 8 connection(s)
I20260709 13:17:39.222364  5625 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:17:39.235280  5789 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:17:39.235743  5790 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:17:39.247584  5792 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:17:39.249238  5625 server_base.cc:1061] running on GCE node
I20260709 13:17:39.250494  5625 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:17:39.250789  5625 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:17:39.251016  5625 hybrid_clock.cc:648] HybridClock initialized: now 1783603059250994 us; error 0 us; skew 500 ppm
I20260709 13:17:39.251523  5785 heartbeater.cc:344] Connected to a master server at 127.5.126.126:37087
I20260709 13:17:39.251842  5625 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:17:39.252146  5785 heartbeater.cc:461] Registering TS with master...
I20260709 13:17:39.253518  5785 heartbeater.cc:507] Master 127.5.126.126:37087 requested a full tablet report, sending...
I20260709 13:17:39.255514  5625 webserver.cc:533] Webserver started at http://127.5.126.66:41859/ using document root <none> and password file <none>
I20260709 13:17:39.256337  5625 fs_manager.cc:362] Metadata directory not provided
I20260709 13:17:39.256615  5625 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:17:39.257004  5625 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:17:39.256946  5657 ts_manager.cc:194] Registered new tserver with Master: f5fa01ffe1374026ac11fcab41d7264d (127.5.126.65:41321)
I20260709 13:17:39.258834  5625 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskWHb0CB/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783603057096655-5625-0/minicluster-data/ts-1-root/instance:
uuid: "8f11b64b1f21462ba2ae6d247817bc5d"
format_stamp: "Formatted at 2026-07-09 13:17:39 on dist-test-slave-smzk"
I20260709 13:17:39.259428  5657 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:41382
I20260709 13:17:39.266520  5625 fs_manager.cc:696] Time spent creating directory manager: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:17:39.272440  5797 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:17:39.274196  5625 fs_manager.cc:730] Time spent opening block manager: real 0.005s	user 0.001s	sys 0.003s
I20260709 13:17:39.274624  5625 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskWHb0CB/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783603057096655-5625-0/minicluster-data/ts-1-root
uuid: "8f11b64b1f21462ba2ae6d247817bc5d"
format_stamp: "Formatted at 2026-07-09 13:17:39 on dist-test-slave-smzk"
I20260709 13:17:39.275056  5625 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWHb0CB/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783603057096655-5625-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskWHb0CB/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783603057096655-5625-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskWHb0CB/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783603057096655-5625-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:17:39.295187  5625 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:17:39.297201  5625 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:17:39.299052  5625 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:17:39.303227  5625 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:17:39.303514  5625 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:17:39.303818  5625 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:17:39.304068  5625 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:17:39.409816  5625 rpc_server.cc:307] RPC server started. Bound to: 127.5.126.66:43089
I20260709 13:17:39.409955  5859 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.5.126.66:43089 every 8 connection(s)
I20260709 13:17:39.419713  5625 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:17:39.430842  5863 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:17:39.433120  5864 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:17:39.433600  5860 heartbeater.cc:344] Connected to a master server at 127.5.126.126:37087
I20260709 13:17:39.434228  5860 heartbeater.cc:461] Registering TS with master...
I20260709 13:17:39.435458  5860 heartbeater.cc:507] Master 127.5.126.126:37087 requested a full tablet report, sending...
I20260709 13:17:39.438771  5657 ts_manager.cc:194] Registered new tserver with Master: 8f11b64b1f21462ba2ae6d247817bc5d (127.5.126.66:43089)
I20260709 13:17:39.442184  5657 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:41384
I20260709 13:17:39.443830  5625 server_base.cc:1061] running on GCE node
W20260709 13:17:39.446316  5866 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:17:39.447553  5625 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:17:39.447857  5625 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:17:39.448100  5625 hybrid_clock.cc:648] HybridClock initialized: now 1783603059448040 us; error 0 us; skew 500 ppm
I20260709 13:17:39.448702  5625 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:17:39.451598  5625 webserver.cc:533] Webserver started at http://127.5.126.67:44885/ using document root <none> and password file <none>
I20260709 13:17:39.452217  5625 fs_manager.cc:362] Metadata directory not provided
I20260709 13:17:39.452486  5625 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:17:39.452854  5625 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:17:39.454044  5625 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskWHb0CB/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783603057096655-5625-0/minicluster-data/ts-2-root/instance:
uuid: "cbbc600cb2fc4d919e1dd0b8e1299929"
format_stamp: "Formatted at 2026-07-09 13:17:39 on dist-test-slave-smzk"
I20260709 13:17:39.459937  5625 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.002s	sys 0.005s
I20260709 13:17:39.464308  5871 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:17:39.465590  5625 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.003s	sys 0.000s
I20260709 13:17:39.466001  5625 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskWHb0CB/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783603057096655-5625-0/minicluster-data/ts-2-root
uuid: "cbbc600cb2fc4d919e1dd0b8e1299929"
format_stamp: "Formatted at 2026-07-09 13:17:39 on dist-test-slave-smzk"
I20260709 13:17:39.466326  5625 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWHb0CB/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783603057096655-5625-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskWHb0CB/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783603057096655-5625-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskWHb0CB/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783603057096655-5625-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:17:39.489931  5625 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:17:39.491336  5625 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:17:39.493407  5625 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:17:39.496486  5625 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:17:39.496708  5625 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:17:39.497042  5625 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:17:39.497198  5625 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:17:39.604094  5625 rpc_server.cc:307] RPC server started. Bound to: 127.5.126.67:34181
I20260709 13:17:39.604190  5933 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.5.126.67:34181 every 8 connection(s)
I20260709 13:17:39.626056  5934 heartbeater.cc:344] Connected to a master server at 127.5.126.126:37087
I20260709 13:17:39.626466  5934 heartbeater.cc:461] Registering TS with master...
I20260709 13:17:39.627403  5934 heartbeater.cc:507] Master 127.5.126.126:37087 requested a full tablet report, sending...
I20260709 13:17:39.629745  5657 ts_manager.cc:194] Registered new tserver with Master: cbbc600cb2fc4d919e1dd0b8e1299929 (127.5.126.67:34181)
I20260709 13:17:39.630601  5625 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.021230972s
I20260709 13:17:39.631373  5657 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:42174
I20260709 13:17:39.689328  5657 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42190:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:17:39.693097  5657 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:17:39.841722  5897 tablet_service.cc:1511] Processing CreateTablet for tablet 15093a816d314d35abd1195b622ad13e (DEFAULT_TABLE table=test-workload [id=1cfa8af362eb49219953bc1ec3c2c116]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:17:39.844921  5824 tablet_service.cc:1511] Processing CreateTablet for tablet dd4693df753b48e59707726329d3b352 (DEFAULT_TABLE table=test-workload [id=1cfa8af362eb49219953bc1ec3c2c116]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:17:39.844142  5823 tablet_service.cc:1511] Processing CreateTablet for tablet 15093a816d314d35abd1195b622ad13e (DEFAULT_TABLE table=test-workload [id=1cfa8af362eb49219953bc1ec3c2c116]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:17:39.850790  5895 tablet_service.cc:1511] Processing CreateTablet for tablet 88a110b2e3174300b97eede6e4cb29a8 (DEFAULT_TABLE table=test-workload [id=1cfa8af362eb49219953bc1ec3c2c116]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:17:39.843904  5899 tablet_service.cc:1511] Processing CreateTablet for tablet df80ca53941844b3b7f6df85be38b00d (DEFAULT_TABLE table=test-workload [id=1cfa8af362eb49219953bc1ec3c2c116]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:17:39.840080  5825 tablet_service.cc:1511] Processing CreateTablet for tablet df80ca53941844b3b7f6df85be38b00d (DEFAULT_TABLE table=test-workload [id=1cfa8af362eb49219953bc1ec3c2c116]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:17:39.852205  5898 tablet_service.cc:1511] Processing CreateTablet for tablet dd4693df753b48e59707726329d3b352 (DEFAULT_TABLE table=test-workload [id=1cfa8af362eb49219953bc1ec3c2c116]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:17:39.854233  5824 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dd4693df753b48e59707726329d3b352. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:39.853884  5896 tablet_service.cc:1511] Processing CreateTablet for tablet c65d802300c64a8f97ec9fb13c6599db (DEFAULT_TABLE table=test-workload [id=1cfa8af362eb49219953bc1ec3c2c116]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:17:39.854925  5821 tablet_service.cc:1511] Processing CreateTablet for tablet 88a110b2e3174300b97eede6e4cb29a8 (DEFAULT_TABLE table=test-workload [id=1cfa8af362eb49219953bc1ec3c2c116]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:17:39.859629  5897 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 15093a816d314d35abd1195b622ad13e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:39.862274  5894 tablet_service.cc:1511] Processing CreateTablet for tablet 0a72b395bcab4a0ab35141522c307b66 (DEFAULT_TABLE table=test-workload [id=1cfa8af362eb49219953bc1ec3c2c116]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:17:39.866974  5895 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 88a110b2e3174300b97eede6e4cb29a8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:39.859457  5820 tablet_service.cc:1511] Processing CreateTablet for tablet 0a72b395bcab4a0ab35141522c307b66 (DEFAULT_TABLE table=test-workload [id=1cfa8af362eb49219953bc1ec3c2c116]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:17:39.853792  5822 tablet_service.cc:1511] Processing CreateTablet for tablet c65d802300c64a8f97ec9fb13c6599db (DEFAULT_TABLE table=test-workload [id=1cfa8af362eb49219953bc1ec3c2c116]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:17:39.867848  5819 tablet_service.cc:1511] Processing CreateTablet for tablet 075196757f21457696b5e4ca1e806556 (DEFAULT_TABLE table=test-workload [id=1cfa8af362eb49219953bc1ec3c2c116]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:17:39.872378  5823 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 15093a816d314d35abd1195b622ad13e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:39.874670  5898 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dd4693df753b48e59707726329d3b352. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:17:39.874722  5704 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:17:39.876602  5819 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 075196757f21457696b5e4ca1e806556. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:39.878659  5893 tablet_service.cc:1511] Processing CreateTablet for tablet 075196757f21457696b5e4ca1e806556 (DEFAULT_TABLE table=test-workload [id=1cfa8af362eb49219953bc1ec3c2c116]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:17:39.881608  5896 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c65d802300c64a8f97ec9fb13c6599db. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:39.883364  5825 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet df80ca53941844b3b7f6df85be38b00d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:39.891748  5818 tablet_service.cc:1511] Processing CreateTablet for tablet 8857705ce84344eb9a2b986546bb10e6 (DEFAULT_TABLE table=test-workload [id=1cfa8af362eb49219953bc1ec3c2c116]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:17:39.896456  5821 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 88a110b2e3174300b97eede6e4cb29a8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:39.896883  5894 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0a72b395bcab4a0ab35141522c307b66. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:39.910820  5818 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8857705ce84344eb9a2b986546bb10e6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:39.912757  5899 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet df80ca53941844b3b7f6df85be38b00d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:39.913458  5893 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 075196757f21457696b5e4ca1e806556. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:39.913635  5750 tablet_service.cc:1511] Processing CreateTablet for tablet df80ca53941844b3b7f6df85be38b00d (DEFAULT_TABLE table=test-workload [id=1cfa8af362eb49219953bc1ec3c2c116]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:17:39.914849  5820 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0a72b395bcab4a0ab35141522c307b66. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:39.915053  5750 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet df80ca53941844b3b7f6df85be38b00d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:39.916970  5749 tablet_service.cc:1511] Processing CreateTablet for tablet dd4693df753b48e59707726329d3b352 (DEFAULT_TABLE table=test-workload [id=1cfa8af362eb49219953bc1ec3c2c116]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:17:39.918744  5749 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dd4693df753b48e59707726329d3b352. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:39.919466  5822 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c65d802300c64a8f97ec9fb13c6599db. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:39.919541  5892 tablet_service.cc:1511] Processing CreateTablet for tablet 8857705ce84344eb9a2b986546bb10e6 (DEFAULT_TABLE table=test-workload [id=1cfa8af362eb49219953bc1ec3c2c116]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:17:39.921131  5892 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8857705ce84344eb9a2b986546bb10e6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:39.955823  5748 tablet_service.cc:1511] Processing CreateTablet for tablet 15093a816d314d35abd1195b622ad13e (DEFAULT_TABLE table=test-workload [id=1cfa8af362eb49219953bc1ec3c2c116]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:17:39.957595  5748 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 15093a816d314d35abd1195b622ad13e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:39.961122  5817 tablet_service.cc:1511] Processing CreateTablet for tablet a47b6d6930154ade882793bfdf796229 (DEFAULT_TABLE table=test-workload [id=1cfa8af362eb49219953bc1ec3c2c116]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:17:39.961249  5747 tablet_service.cc:1511] Processing CreateTablet for tablet c65d802300c64a8f97ec9fb13c6599db (DEFAULT_TABLE table=test-workload [id=1cfa8af362eb49219953bc1ec3c2c116]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:17:39.962858  5817 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a47b6d6930154ade882793bfdf796229. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:39.962949  5747 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c65d802300c64a8f97ec9fb13c6599db. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:39.965739  5891 tablet_service.cc:1511] Processing CreateTablet for tablet a47b6d6930154ade882793bfdf796229 (DEFAULT_TABLE table=test-workload [id=1cfa8af362eb49219953bc1ec3c2c116]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:17:39.967443  5891 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a47b6d6930154ade882793bfdf796229. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:39.974001  5746 tablet_service.cc:1511] Processing CreateTablet for tablet 88a110b2e3174300b97eede6e4cb29a8 (DEFAULT_TABLE table=test-workload [id=1cfa8af362eb49219953bc1ec3c2c116]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:17:39.975441  5746 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 88a110b2e3174300b97eede6e4cb29a8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:40.012647  5744 tablet_service.cc:1511] Processing CreateTablet for tablet 075196757f21457696b5e4ca1e806556 (DEFAULT_TABLE table=test-workload [id=1cfa8af362eb49219953bc1ec3c2c116]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:17:40.014900  5744 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 075196757f21457696b5e4ca1e806556. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:40.020138  5743 tablet_service.cc:1511] Processing CreateTablet for tablet 8857705ce84344eb9a2b986546bb10e6 (DEFAULT_TABLE table=test-workload [id=1cfa8af362eb49219953bc1ec3c2c116]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:17:40.005740  5745 tablet_service.cc:1511] Processing CreateTablet for tablet 0a72b395bcab4a0ab35141522c307b66 (DEFAULT_TABLE table=test-workload [id=1cfa8af362eb49219953bc1ec3c2c116]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:17:40.026710  5745 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0a72b395bcab4a0ab35141522c307b66. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:40.031911  5743 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8857705ce84344eb9a2b986546bb10e6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:40.048141  5742 tablet_service.cc:1511] Processing CreateTablet for tablet a47b6d6930154ade882793bfdf796229 (DEFAULT_TABLE table=test-workload [id=1cfa8af362eb49219953bc1ec3c2c116]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:17:40.051578  5742 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a47b6d6930154ade882793bfdf796229. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:40.122871  5952 tablet_bootstrap.cc:492] T c65d802300c64a8f97ec9fb13c6599db P f5fa01ffe1374026ac11fcab41d7264d: Bootstrap starting.
I20260709 13:17:40.163370  5953 tablet_bootstrap.cc:492] T df80ca53941844b3b7f6df85be38b00d P 8f11b64b1f21462ba2ae6d247817bc5d: Bootstrap starting.
I20260709 13:17:40.171195  5954 tablet_bootstrap.cc:492] T dd4693df753b48e59707726329d3b352 P cbbc600cb2fc4d919e1dd0b8e1299929: Bootstrap starting.
I20260709 13:17:40.209221  5952 tablet_bootstrap.cc:654] T c65d802300c64a8f97ec9fb13c6599db P f5fa01ffe1374026ac11fcab41d7264d: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:40.216339  5954 tablet_bootstrap.cc:654] T dd4693df753b48e59707726329d3b352 P cbbc600cb2fc4d919e1dd0b8e1299929: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:40.217325  5953 tablet_bootstrap.cc:654] T df80ca53941844b3b7f6df85be38b00d P 8f11b64b1f21462ba2ae6d247817bc5d: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:40.218259  5952 tablet_bootstrap.cc:492] T c65d802300c64a8f97ec9fb13c6599db P f5fa01ffe1374026ac11fcab41d7264d: No bootstrap required, opened a new log
I20260709 13:17:40.218914  5952 ts_tablet_manager.cc:1403] T c65d802300c64a8f97ec9fb13c6599db P f5fa01ffe1374026ac11fcab41d7264d: Time spent bootstrapping tablet: real 0.097s	user 0.005s	sys 0.014s
I20260709 13:17:40.223265  5952 raft_consensus.cc:359] T c65d802300c64a8f97ec9fb13c6599db P f5fa01ffe1374026ac11fcab41d7264d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5fa01ffe1374026ac11fcab41d7264d" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 41321 } } peers { permanent_uuid: "8f11b64b1f21462ba2ae6d247817bc5d" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 43089 } } peers { permanent_uuid: "cbbc600cb2fc4d919e1dd0b8e1299929" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 34181 } }
I20260709 13:17:40.224694  5952 raft_consensus.cc:385] T c65d802300c64a8f97ec9fb13c6599db P f5fa01ffe1374026ac11fcab41d7264d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:40.225206  5952 raft_consensus.cc:740] T c65d802300c64a8f97ec9fb13c6599db P f5fa01ffe1374026ac11fcab41d7264d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f5fa01ffe1374026ac11fcab41d7264d, State: Initialized, Role: FOLLOWER
I20260709 13:17:40.227011  5953 tablet_bootstrap.cc:492] T df80ca53941844b3b7f6df85be38b00d P 8f11b64b1f21462ba2ae6d247817bc5d: No bootstrap required, opened a new log
I20260709 13:17:40.226325  5952 consensus_queue.cc:260] T c65d802300c64a8f97ec9fb13c6599db P f5fa01ffe1374026ac11fcab41d7264d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5fa01ffe1374026ac11fcab41d7264d" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 41321 } } peers { permanent_uuid: "8f11b64b1f21462ba2ae6d247817bc5d" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 43089 } } peers { permanent_uuid: "cbbc600cb2fc4d919e1dd0b8e1299929" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 34181 } }
I20260709 13:17:40.227568  5953 ts_tablet_manager.cc:1403] T df80ca53941844b3b7f6df85be38b00d P 8f11b64b1f21462ba2ae6d247817bc5d: Time spent bootstrapping tablet: real 0.075s	user 0.016s	sys 0.000s
I20260709 13:17:40.230672  5953 raft_consensus.cc:359] T df80ca53941844b3b7f6df85be38b00d P 8f11b64b1f21462ba2ae6d247817bc5d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbbc600cb2fc4d919e1dd0b8e1299929" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 34181 } } peers { permanent_uuid: "f5fa01ffe1374026ac11fcab41d7264d" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 41321 } } peers { permanent_uuid: "8f11b64b1f21462ba2ae6d247817bc5d" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 43089 } }
I20260709 13:17:40.231405  5953 raft_consensus.cc:385] T df80ca53941844b3b7f6df85be38b00d P 8f11b64b1f21462ba2ae6d247817bc5d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:40.231698  5953 raft_consensus.cc:740] T df80ca53941844b3b7f6df85be38b00d P 8f11b64b1f21462ba2ae6d247817bc5d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8f11b64b1f21462ba2ae6d247817bc5d, State: Initialized, Role: FOLLOWER
I20260709 13:17:40.235121  5952 ts_tablet_manager.cc:1434] T c65d802300c64a8f97ec9fb13c6599db P f5fa01ffe1374026ac11fcab41d7264d: Time spent starting tablet: real 0.016s	user 0.008s	sys 0.006s
I20260709 13:17:40.234643  5953 consensus_queue.cc:260] T df80ca53941844b3b7f6df85be38b00d P 8f11b64b1f21462ba2ae6d247817bc5d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbbc600cb2fc4d919e1dd0b8e1299929" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 34181 } } peers { permanent_uuid: "f5fa01ffe1374026ac11fcab41d7264d" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 41321 } } peers { permanent_uuid: "8f11b64b1f21462ba2ae6d247817bc5d" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 43089 } }
I20260709 13:17:40.236310  5785 heartbeater.cc:499] Master 127.5.126.126:37087 was elected leader, sending a full tablet report...
I20260709 13:17:40.236654  5952 tablet_bootstrap.cc:492] T 88a110b2e3174300b97eede6e4cb29a8 P f5fa01ffe1374026ac11fcab41d7264d: Bootstrap starting.
I20260709 13:17:40.235931  5954 tablet_bootstrap.cc:492] T dd4693df753b48e59707726329d3b352 P cbbc600cb2fc4d919e1dd0b8e1299929: No bootstrap required, opened a new log
I20260709 13:17:40.243016  5954 ts_tablet_manager.cc:1403] T dd4693df753b48e59707726329d3b352 P cbbc600cb2fc4d919e1dd0b8e1299929: Time spent bootstrapping tablet: real 0.073s	user 0.007s	sys 0.022s
I20260709 13:17:40.244243  5860 heartbeater.cc:499] Master 127.5.126.126:37087 was elected leader, sending a full tablet report...
I20260709 13:17:40.245428  5953 ts_tablet_manager.cc:1434] T df80ca53941844b3b7f6df85be38b00d P 8f11b64b1f21462ba2ae6d247817bc5d: Time spent starting tablet: real 0.017s	user 0.004s	sys 0.011s
I20260709 13:17:40.246616  5953 tablet_bootstrap.cc:492] T a47b6d6930154ade882793bfdf796229 P 8f11b64b1f21462ba2ae6d247817bc5d: Bootstrap starting.
I20260709 13:17:40.246512  5954 raft_consensus.cc:359] T dd4693df753b48e59707726329d3b352 P cbbc600cb2fc4d919e1dd0b8e1299929 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5fa01ffe1374026ac11fcab41d7264d" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 41321 } } peers { permanent_uuid: "8f11b64b1f21462ba2ae6d247817bc5d" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 43089 } } peers { permanent_uuid: "cbbc600cb2fc4d919e1dd0b8e1299929" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 34181 } }
I20260709 13:17:40.247946  5954 raft_consensus.cc:385] T dd4693df753b48e59707726329d3b352 P cbbc600cb2fc4d919e1dd0b8e1299929 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:40.248345  5954 raft_consensus.cc:740] T dd4693df753b48e59707726329d3b352 P cbbc600cb2fc4d919e1dd0b8e1299929 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cbbc600cb2fc4d919e1dd0b8e1299929, State: Initialized, Role: FOLLOWER
I20260709 13:17:40.249078  5952 tablet_bootstrap.cc:654] T 88a110b2e3174300b97eede6e4cb29a8 P f5fa01ffe1374026ac11fcab41d7264d: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:40.249212  5954 consensus_queue.cc:260] T dd4693df753b48e59707726329d3b352 P cbbc600cb2fc4d919e1dd0b8e1299929 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5fa01ffe1374026ac11fcab41d7264d" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 41321 } } peers { permanent_uuid: "8f11b64b1f21462ba2ae6d247817bc5d" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 43089 } } peers { permanent_uuid: "cbbc600cb2fc4d919e1dd0b8e1299929" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 34181 } }
I20260709 13:17:40.259204  5934 heartbeater.cc:499] Master 127.5.126.126:37087 was elected leader, sending a full tablet report...
I20260709 13:17:40.259572  5954 ts_tablet_manager.cc:1434] T dd4693df753b48e59707726329d3b352 P cbbc600cb2fc4d919e1dd0b8e1299929: Time spent starting tablet: real 0.016s	user 0.004s	sys 0.009s
I20260709 13:17:40.261215  5954 tablet_bootstrap.cc:492] T 15093a816d314d35abd1195b622ad13e P cbbc600cb2fc4d919e1dd0b8e1299929: Bootstrap starting.
I20260709 13:17:40.270622  5953 tablet_bootstrap.cc:654] T a47b6d6930154ade882793bfdf796229 P 8f11b64b1f21462ba2ae6d247817bc5d: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:40.282083  5954 tablet_bootstrap.cc:654] T 15093a816d314d35abd1195b622ad13e P cbbc600cb2fc4d919e1dd0b8e1299929: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:40.282466  5952 tablet_bootstrap.cc:492] T 88a110b2e3174300b97eede6e4cb29a8 P f5fa01ffe1374026ac11fcab41d7264d: No bootstrap required, opened a new log
I20260709 13:17:40.283048  5952 ts_tablet_manager.cc:1403] T 88a110b2e3174300b97eede6e4cb29a8 P f5fa01ffe1374026ac11fcab41d7264d: Time spent bootstrapping tablet: real 0.047s	user 0.004s	sys 0.017s
I20260709 13:17:40.286942  5952 raft_consensus.cc:359] T 88a110b2e3174300b97eede6e4cb29a8 P f5fa01ffe1374026ac11fcab41d7264d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5fa01ffe1374026ac11fcab41d7264d" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 41321 } } peers { permanent_uuid: "8f11b64b1f21462ba2ae6d247817bc5d" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 43089 } } peers { permanent_uuid: "cbbc600cb2fc4d919e1dd0b8e1299929" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 34181 } }
I20260709 13:17:40.288146  5952 raft_consensus.cc:385] T 88a110b2e3174300b97eede6e4cb29a8 P f5fa01ffe1374026ac11fcab41d7264d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:40.288600  5952 raft_consensus.cc:740] T 88a110b2e3174300b97eede6e4cb29a8 P f5fa01ffe1374026ac11fcab41d7264d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f5fa01ffe1374026ac11fcab41d7264d, State: Initialized, Role: FOLLOWER
I20260709 13:17:40.289631  5952 consensus_queue.cc:260] T 88a110b2e3174300b97eede6e4cb29a8 P f5fa01ffe1374026ac11fcab41d7264d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5fa01ffe1374026ac11fcab41d7264d" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 41321 } } peers { permanent_uuid: "8f11b64b1f21462ba2ae6d247817bc5d" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 43089 } } peers { permanent_uuid: "cbbc600cb2fc4d919e1dd0b8e1299929" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 34181 } }
I20260709 13:17:40.292867  5952 ts_tablet_manager.cc:1434] T 88a110b2e3174300b97eede6e4cb29a8 P f5fa01ffe1374026ac11fcab41d7264d: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
I20260709 13:17:40.294166  5952 tablet_bootstrap.cc:492] T dd4693df753b48e59707726329d3b352 P f5fa01ffe1374026ac11fcab41d7264d: Bootstrap starting.
I20260709 13:17:40.303577  5952 tablet_bootstrap.cc:654] T dd4693df753b48e59707726329d3b352 P f5fa01ffe1374026ac11fcab41d7264d: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:40.324080  5952 tablet_bootstrap.cc:492] T dd4693df753b48e59707726329d3b352 P f5fa01ffe1374026ac11fcab41d7264d: No bootstrap required, opened a new log
I20260709 13:17:40.324967  5952 ts_tablet_manager.cc:1403] T dd4693df753b48e59707726329d3b352 P f5fa01ffe1374026ac11fcab41d7264d: Time spent bootstrapping tablet: real 0.031s	user 0.023s	sys 0.000s
I20260709 13:17:40.329324  5952 raft_consensus.cc:359] T dd4693df753b48e59707726329d3b352 P f5fa01ffe1374026ac11fcab41d7264d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5fa01ffe1374026ac11fcab41d7264d" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 41321 } } peers { permanent_uuid: "8f11b64b1f21462ba2ae6d247817bc5d" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 43089 } } peers { permanent_uuid: "cbbc600cb2fc4d919e1dd0b8e1299929" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 34181 } }
I20260709 13:17:40.329908  5954 tablet_bootstrap.cc:492] T 15093a816d314d35abd1195b622ad13e P cbbc600cb2fc4d919e1dd0b8e1299929: No bootstrap required, opened a new log
I20260709 13:17:40.330140  5952 raft_consensus.cc:385] T dd4693df753b48e59707726329d3b352 P f5fa01ffe1374026ac11fcab41d7264d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:40.330449  5954 ts_tablet_manager.cc:1403] T 15093a816d314d35abd1195b622ad13e P cbbc600cb2fc4d919e1dd0b8e1299929: Time spent bootstrapping tablet: real 0.070s	user 0.026s	sys 0.005s
I20260709 13:17:40.330476  5952 raft_consensus.cc:740] T dd4693df753b48e59707726329d3b352 P f5fa01ffe1374026ac11fcab41d7264d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f5fa01ffe1374026ac11fcab41d7264d, State: Initialized, Role: FOLLOWER
I20260709 13:17:40.331813  5952 consensus_queue.cc:260] T dd4693df753b48e59707726329d3b352 P f5fa01ffe1374026ac11fcab41d7264d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5fa01ffe1374026ac11fcab41d7264d" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 41321 } } peers { permanent_uuid: "8f11b64b1f21462ba2ae6d247817bc5d" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 43089 } } peers { permanent_uuid: "cbbc600cb2fc4d919e1dd0b8e1299929" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 34181 } }
I20260709 13:17:40.333302  5954 raft_consensus.cc:359] T 15093a816d314d35abd1195b622ad13e P cbbc600cb2fc4d919e1dd0b8e1299929 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5fa01ffe1374026ac11fcab41d7264d" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 41321 } } peers { permanent_uuid: "8f11b64b1f21462ba2ae6d247817bc5d" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 43089 } } peers { permanent_uuid: "cbbc600cb2fc4d919e1dd0b8e1299929" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 34181 } }
I20260709 13:17:40.334052  5954 raft_consensus.cc:385] T 15093a816d314d35abd1195b622ad13e P cbbc600cb2fc4d919e1dd0b8e1299929 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:40.334340  5954 raft_consensus.cc:740] T 15093a816d314d35abd1195b622ad13e P cbbc600cb2fc4d919e1dd0b8e1299929 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cbbc600cb2fc4d919e1dd0b8e1299929, State: Initialized, Role: FOLLOWER
I20260709 13:17:40.334869  5953 tablet_bootstrap.cc:492] T a47b6d6930154ade882793bfdf796229 P 8f11b64b1f21462ba2ae6d247817bc5d: No bootstrap required, opened a new log
I20260709 13:17:40.335373  5953 ts_tablet_manager.cc:1403] T a47b6d6930154ade882793bfdf796229 P 8f11b64b1f21462ba2ae6d247817bc5d: Time spent bootstrapping tablet: real 0.089s	user 0.014s	sys 0.022s
I20260709 13:17:40.335124  5954 consensus_queue.cc:260] T 15093a816d314d35abd1195b622ad13e P cbbc600cb2fc4d919e1dd0b8e1299929 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5fa01ffe1374026ac11fcab41d7264d" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 41321 } } peers { permanent_uuid: "8f11b64b1f21462ba2ae6d247817bc5d" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 43089 } } peers { permanent_uuid: "cbbc600cb2fc4d919e1dd0b8e1299929" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 34181 } }
I20260709 13:17:40.337575  5954 ts_tablet_manager.cc:1434] T 15093a816d314d35abd1195b622ad13e P cbbc600cb2fc4d919e1dd0b8e1299929: Time spent starting tablet: real 0.007s	user 0.009s	sys 0.000s
I20260709 13:17:40.338521  5954 tablet_bootstrap.cc:492] T df80ca53941844b3b7f6df85be38b00d P cbbc600cb2fc4d919e1dd0b8e1299929: Bootstrap starting.
I20260709 13:17:40.338753  5953 raft_consensus.cc:359] T a47b6d6930154ade882793bfdf796229 P 8f11b64b1f21462ba2ae6d247817bc5d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5fa01ffe1374026ac11fcab41d7264d" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 41321 } } peers { permanent_uuid: "8f11b64b1f21462ba2ae6d247817bc5d" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 43089 } } peers { permanent_uuid: "cbbc600cb2fc4d919e1dd0b8e1299929" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 34181 } }
I20260709 13:17:40.339416  5953 raft_consensus.cc:385] T a47b6d6930154ade882793bfdf796229 P 8f11b64b1f21462ba2ae6d247817bc5d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:40.339735  5953 raft_consensus.cc:740] T a47b6d6930154ade882793bfdf796229 P 8f11b64b1f21462ba2ae6d247817bc5d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8f11b64b1f21462ba2ae6d247817bc5d, State: Initialized, Role: FOLLOWER
I20260709 13:17:40.340553  5953 consensus_queue.cc:260] T a47b6d6930154ade882793bfdf796229 P 8f11b64b1f21462ba2ae6d247817bc5d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5fa01ffe1374026ac11fcab41d7264d" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 41321 } } peers { permanent_uuid: "8f11b64b1f21462ba2ae6d247817bc5d" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 43089 } } peers { permanent_uuid: "cbbc600cb2fc4d919e1dd0b8e1299929" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 34181 } }
I20260709 13:17:40.343473  5953 ts_tablet_manager.cc:1434] T a47b6d6930154ade882793bfdf796229 P 8f11b64b1f21462ba2ae6d247817bc5d: Time spent starting tablet: real 0.008s	user 0.004s	sys 0.004s
I20260709 13:17:40.344527  5953 tablet_bootstrap.cc:492] T 075196757f21457696b5e4ca1e806556 P 8f11b64b1f21462ba2ae6d247817bc5d: Bootstrap starting.
I20260709 13:17:40.345790  5954 tablet_bootstrap.cc:654] T df80ca53941844b3b7f6df85be38b00d P cbbc600cb2fc4d919e1dd0b8e1299929: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:40.352895  5953 tablet_bootstrap.cc:654] T 075196757f21457696b5e4ca1e806556 P 8f11b64b1f21462ba2ae6d247817bc5d: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:40.354485  5958 raft_consensus.cc:493] T 88a110b2e3174300b97eede6e4cb29a8 P f5fa01ffe1374026ac11fcab41d7264d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:40.355135  5958 raft_consensus.cc:515] T 88a110b2e3174300b97eede6e4cb29a8 P f5fa01ffe1374026ac11fcab41d7264d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5fa01ffe1374026ac11fcab41d7264d" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 41321 } } peers { permanent_uuid: "8f11b64b1f21462ba2ae6d247817bc5d" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 43089 } } peers { permanent_uuid: "cbbc600cb2fc4d919e1dd0b8e1299929" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 34181 } }
I20260709 13:17:40.358703  5958 leader_election.cc:290] T 88a110b2e3174300b97eede6e4cb29a8 P f5fa01ffe1374026ac11fcab41d7264d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8f11b64b1f21462ba2ae6d247817bc5d (127.5.126.66:43089), cbbc600cb2fc4d919e1dd0b8e1299929 (127.5.126.67:34181)
I20260709 13:17:40.364423  5954 tablet_bootstrap.cc:492] T df80ca53941844b3b7f6df85be38b00d P cbbc600cb2fc4d919e1dd0b8e1299929: No bootstrap required, opened a new log
W20260709 13:17:40.365062  5935 tablet.cc:2406] T 15093a816d314d35abd1195b622ad13e P cbbc600cb2fc4d919e1dd0b8e1299929: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 13:17:40.365074  5954 ts_tablet_manager.cc:1403] T df80ca53941844b3b7f6df85be38b00d P cbbc600cb2fc4d919e1dd0b8e1299929: Time spent bootstrapping tablet: real 0.027s	user 0.009s	sys 0.009s
I20260709 13:17:40.370869  5952 ts_tablet_manager.cc:1434] T dd4693df753b48e59707726329d3b352 P f5fa01ffe1374026ac11fcab41d7264d: Time spent starting tablet: real 0.045s	user 0.007s	sys 0.000s
I20260709 13:17:40.375680  5952 tablet_bootstrap.cc:492] T 15093a816d314d35abd1195b622ad13e P f5fa01ffe1374026ac11fcab41d7264d: Bootstrap starting.
I20260709 13:17:40.375126  5954 raft_consensus.cc:359] T df80ca53941844b3b7f6df85be38b00d P cbbc600cb2fc4d919e1dd0b8e1299929 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbbc600cb2fc4d919e1dd0b8e1299929" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 34181 } } peers { permanent_uuid: "f5fa01ffe1374026ac11fcab41d7264d" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 41321 } } peers { permanent_uuid: "8f11b64b1f21462ba2ae6d247817bc5d" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 43089 } }
I20260709 13:17:40.381536  5954 raft_consensus.cc:385] T df80ca53941844b3b7f6df85be38b00d P cbbc600cb2fc4d919e1dd0b8e1299929 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:40.388844  5954 raft_consensus.cc:740] T df80ca53941844b3b7f6df85be38b00d P cbbc600cb2fc4d919e1dd0b8e1299929 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cbbc600cb2fc4d919e1dd0b8e1299929, State: Initialized, Role: FOLLOWER
I20260709 13:17:40.392195  5954 consensus_queue.cc:260] T df80ca53941844b3b7f6df85be38b00d P cbbc600cb2fc4d919e1dd0b8e1299929 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbbc600cb2fc4d919e1dd0b8e1299929" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 34181 } } peers { permanent_uuid: "f5fa01ffe1374026ac11fcab41d7264d" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 41321 } } peers { permanent_uuid: "8f11b64b1f21462ba2ae6d247817bc5d" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 43089 } }
I20260709 13:17:40.398819  5954 ts_tablet_manager.cc:1434] T df80ca53941844b3b7f6df85be38b00d P cbbc600cb2fc4d919e1dd0b8e1299929: Time spent starting tablet: real 0.030s	user 0.006s	sys 0.002s
I20260709 13:17:40.405047  5954 tablet_bootstrap.cc:492] T c65d802300c64a8f97ec9fb13c6599db P cbbc600cb2fc4d919e1dd0b8e1299929: Bootstrap starting.
I20260709 13:17:40.406100  5953 tablet_bootstrap.cc:492] T 075196757f21457696b5e4ca1e806556 P 8f11b64b1f21462ba2ae6d247817bc5d: No bootstrap required, opened a new log
I20260709 13:17:40.406705  5953 ts_tablet_manager.cc:1403] T 075196757f21457696b5e4ca1e806556 P 8f11b64b1f21462ba2ae6d247817bc5d: Time spent bootstrapping tablet: real 0.062s	user 0.024s	sys 0.015s
I20260709 13:17:40.412596  5954 tablet_bootstrap.cc:654] T c65d802300c64a8f97ec9fb13c6599db P cbbc600cb2fc4d919e1dd0b8e1299929: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:40.413834  5953 raft_consensus.cc:359] T 075196757f21457696b5e4ca1e806556 P 8f11b64b1f21462ba2ae6d247817bc5d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5fa01ffe1374026ac11fcab41d7264d" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 41321 } } peers { permanent_uuid: "8f11b64b1f21462ba2ae6d247817bc5d" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 43089 } } peers { permanent_uuid: "cbbc600cb2fc4d919e1dd0b8e1299929" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 34181 } }
I20260709 13:17:40.414669  5953 raft_consensus.cc:385] T 075196757f21457696b5e4ca1e806556 P 8f11b64b1f21462ba2ae6d247817bc5d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:40.414973  5953 raft_consensus.cc:740] T 075196757f21457696b5e4ca1e806556 P 8f11b64b1f21462ba2ae6d247817bc5d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8f11b64b1f21462ba2ae6d247817bc5d, State: Initialized, Role: FOLLOWER
I20260709 13:17:40.415760  5953 consensus_queue.cc:260] T 075196757f21457696b5e4ca1e806556 P 8f11b64b1f21462ba2ae6d247817bc5d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5fa01ffe1374026ac11fcab41d7264d" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 41321 } } peers { permanent_uuid: "8f11b64b1f21462ba2ae6d247817bc5d" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 43089 } } peers { permanent_uuid: "cbbc600cb2fc4d919e1dd0b8e1299929" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 34181 } }
I20260709 13:17:40.418095  5953 ts_tablet_manager.cc:1434] T 075196757f21457696b5e4ca1e806556 P 8f11b64b1f21462ba2ae6d247817bc5d: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.000s
I20260709 13:17:40.419126  5953 tablet_bootstrap.cc:492] T 15093a816d314d35abd1195b622ad13e P 8f11b64b1f21462ba2ae6d247817bc5d: Bootstrap starting.
I20260709 13:17:40.417829  5835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88a110b2e3174300b97eede6e4cb29a8" candidate_uuid: "f5fa01ffe1374026ac11fcab41d7264d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f11b64b1f21462ba2ae6d247817bc5d" is_pre_election: true
I20260709 13:17:40.425832  5952 tablet_bootstrap.cc:654] T 15093a816d314d35abd1195b622ad13e P f5fa01ffe1374026ac11fcab41d7264d: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:40.426400  5909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88a110b2e3174300b97eede6e4cb29a8" candidate_uuid: "f5fa01ffe1374026ac11fcab41d7264d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cbbc600cb2fc4d919e1dd0b8e1299929" is_pre_election: true
W20260709 13:17:40.426771  5725 leader_election.cc:343] T 88a110b2e3174300b97eede6e4cb29a8 P f5fa01ffe1374026ac11fcab41d7264d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8f11b64b1f21462ba2ae6d247817bc5d (127.5.126.66:43089): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:17:40.428612  5723 leader_election.cc:343] T 88a110b2e3174300b97eede6e4cb29a8 P f5fa01ffe1374026ac11fcab41d7264d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cbbc600cb2fc4d919e1dd0b8e1299929 (127.5.126.67:34181): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:40.429126  5723 leader_election.cc:304] T 88a110b2e3174300b97eede6e4cb29a8 P f5fa01ffe1374026ac11fcab41d7264d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5fa01ffe1374026ac11fcab41d7264d; no voters: 8f11b64b1f21462ba2ae6d247817bc5d, cbbc600cb2fc4d919e1dd0b8e1299929
I20260709 13:17:40.429961  5958 raft_consensus.cc:2749] T 88a110b2e3174300b97eede6e4cb29a8 P f5fa01ffe1374026ac11fcab41d7264d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:17:40.436730  5954 tablet_bootstrap.cc:492] T c65d802300c64a8f97ec9fb13c6599db P cbbc600cb2fc4d919e1dd0b8e1299929: No bootstrap required, opened a new log
I20260709 13:17:40.436997  5953 tablet_bootstrap.cc:654] T 15093a816d314d35abd1195b622ad13e P 8f11b64b1f21462ba2ae6d247817bc5d: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:40.437297  5954 ts_tablet_manager.cc:1403] T c65d802300c64a8f97ec9fb13c6599db P cbbc600cb2fc4d919e1dd0b8e1299929: Time spent bootstrapping tablet: real 0.033s	user 0.012s	sys 0.005s
I20260709 13:17:40.440794  5954 raft_consensus.cc:359] T c65d802300c64a8f97ec9fb13c6599db P cbbc600cb2fc4d919e1dd0b8e1299929 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5fa01ffe1374026ac11fcab41d7264d" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 41321 } } peers { permanent_uuid: "8f11b64b1f21462ba2ae6d247817bc5d" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 43089 } } peers { permanent_uuid: "cbbc600cb2fc4d919e1dd0b8e1299929" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 34181 } }
I20260709 13:17:40.441673  5958 raft_consensus.cc:493] T c65d802300c64a8f97ec9fb13c6599db P f5fa01ffe1374026ac11fcab41d7264d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:40.441928  5954 raft_consensus.cc:385] T c65d802300c64a8f97ec9fb13c6599db P cbbc600cb2fc4d919e1dd0b8e1299929 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:40.442260  5954 raft_consensus.cc:740] T c65d802300c64a8f97ec9fb13c6599db P cbbc600cb2fc4d919e1dd0b8e1299929 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cbbc600cb2fc4d919e1dd0b8e1299929, State: Initialized, Role: FOLLOWER
I20260709 13:17:40.442162  5958 raft_consensus.cc:515] T c65d802300c64a8f97ec9fb13c6599db P f5fa01ffe1374026ac11fcab41d7264d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5fa01ffe1374026ac11fcab41d7264d" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 41321 } } peers { permanent_uuid: "8f11b64b1f21462ba2ae6d247817bc5d" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 43089 } } peers { permanent_uuid: "cbbc600cb2fc4d919e1dd0b8e1299929" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 34181 } }
I20260709 13:17:40.443146  5952 tablet_bootstrap.cc:492] T 15093a816d314d35abd1195b622ad13e P f5fa01ffe1374026ac11fcab41d7264d: No bootstrap required, opened a new log
I20260709 13:17:40.443107  5954 consensus_queue.cc:260] T c65d802300c64a8f97ec9fb13c6599db P cbbc600cb2fc4d919e1dd0b8e1299929 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5fa01ffe1374026ac11fcab41d7264d" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 41321 } } peers { permanent_uuid: "8f11b64b1f21462ba2ae6d247817bc5d" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 43089 } } peers { permanent_uuid: "cbbc600cb2fc4d919e1dd0b8e1299929" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 34181 } }
I20260709 13:17:40.444742  5958 leader_election.cc:290] T c65d802300c64a8f97ec9fb13c6599db P f5fa01ffe1374026ac11fcab41d7264d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8f11b64b1f21462ba2ae6d247817bc5d (127.5.126.66:43089), cbbc600cb2fc4d919e1dd0b8e1299929 (127.5.126.67:34181)
I20260709 13:17:40.444976  5952 ts_tablet_manager.cc:1403] T 15093a816d314d35abd1195b622ad13e P f5fa01ffe1374026ac11fcab41d7264d: Time spent bootstrapping tablet: real 0.070s	user 0.012s	sys 0.003s
I20260709 13:17:40.446249  5835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c65d802300c64a8f97ec9fb13c6599db" candidate_uuid: "f5fa01ffe1374026ac11fcab41d7264d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f11b64b1f21462ba2ae6d247817bc5d" is_pre_election: true
I20260709 13:17:40.448206  5952 raft_consensus.cc:359] T 15093a816d314d35abd1195b622ad13e P f5fa01ffe1374026ac11fcab41d7264d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5fa01ffe1374026ac11fcab41d7264d" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 41321 } } peers { permanent_uuid: "8f11b64b1f21462ba2ae6d247817bc5d" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 43089 } } peers { permanent_uuid: "cbbc600cb2fc4d919e1dd0b8e1299929" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 34181 } }
I20260709 13:17:40.448638  5909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c65d802300c64a8f97ec9fb13c6599db" candidate_uuid: "f5fa01ffe1374026ac11fcab41d7264d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cbbc600cb2fc4d919e1dd0b8e1299929" is_pre_election: true
I20260709 13:17:40.449627  5909 raft_consensus.cc:2468] T c65d802300c64a8f97ec9fb13c6599db P cbbc600cb2fc4d919e1dd0b8e1299929 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5fa01ffe1374026ac11fcab41d7264d in term 0.
W20260709 13:17:40.449942  5725 leader_election.cc:343] T c65d802300c64a8f97ec9fb13c6599db P f5fa01ffe1374026ac11fcab41d7264d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8f11b64b1f21462ba2ae6d247817bc5d (127.5.126.66:43089): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:40.452005  5723 leader_election.cc:304] T c65d802300c64a8f97ec9fb13c6599db P f5fa01ffe1374026ac11fcab41d7264d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cbbc600cb2fc4d919e1dd0b8e1299929, f5fa01ffe1374026ac11fcab41d7264d; no voters: 8f11b64b1f21462ba2ae6d247817bc5d
I20260709 13:17:40.453102  5958 raft_consensus.cc:2804] T c65d802300c64a8f97ec9fb13c6599db P f5fa01ffe1374026ac11fcab41d7264d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:40.453495  5958 raft_consensus.cc:493] T c65d802300c64a8f97ec9fb13c6599db P f5fa01ffe1374026ac11fcab41d7264d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:40.453727  5958 raft_consensus.cc:3060] T c65d802300c64a8f97ec9fb13c6599db P f5fa01ffe1374026ac11fcab41d7264d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:40.448959  5952 raft_consensus.cc:385] T 15093a816d314d35abd1195b622ad13e P f5fa01ffe1374026ac11fcab41d7264d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:40.454241  5952 raft_consensus.cc:740] T 15093a816d314d35abd1195b622ad13e P f5fa01ffe1374026ac11fcab41d7264d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f5fa01ffe1374026ac11fcab41d7264d, State: Initialized, Role: FOLLOWER
I20260709 13:17:40.455806  5954 ts_tablet_manager.cc:1434] T c65d802300c64a8f97ec9fb13c6599db P cbbc600cb2fc4d919e1dd0b8e1299929: Time spent starting tablet: real 0.018s	user 0.007s	sys 0.000s
I20260709 13:17:40.457237  5954 tablet_bootstrap.cc:492] T 0a72b395bcab4a0ab35141522c307b66 P cbbc600cb2fc4d919e1dd0b8e1299929: Bootstrap starting.
I20260709 13:17:40.462100  5958 raft_consensus.cc:515] T c65d802300c64a8f97ec9fb13c6599db P f5fa01ffe1374026ac11fcab41d7264d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5fa01ffe1374026ac11fcab41d7264d" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 41321 } } peers { permanent_uuid: "8f11b64b1f21462ba2ae6d247817bc5d" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 43089 } } peers { permanent_uuid: "cbbc600cb2fc4d919e1dd0b8e1299929" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 34181 } }
I20260709 13:17:40.464637  5952 consensus_queue.cc:260] T 15093a816d314d35abd1195b622ad13e P f5fa01ffe1374026ac11fcab41d7264d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5fa01ffe1374026ac11fcab41d7264d" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 41321 } } peers { permanent_uuid: "8f11b64b1f21462ba2ae6d247817bc5d" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 43089 } } peers { permanent_uuid: "cbbc600cb2fc4d919e1dd0b8e1299929" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 34181 } }
I20260709 13:17:40.467965  5958 leader_election.cc:290] T c65d802300c64a8f97ec9fb13c6599db P f5fa01ffe1374026ac11fcab41d7264d [CANDIDATE]: Term 1 election: Requested vote from peers 8f11b64b1f21462ba2ae6d247817bc5d (127.5.126.66:43089), cbbc600cb2fc4d919e1dd0b8e1299929 (127.5.126.67:34181)
I20260709 13:17:40.469298  5835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c65d802300c64a8f97ec9fb13c6599db" candidate_uuid: "f5fa01ffe1374026ac11fcab41d7264d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f11b64b1f21462ba2ae6d247817bc5d"
I20260709 13:17:40.470090  5952 ts_tablet_manager.cc:1434] T 15093a816d314d35abd1195b622ad13e P f5fa01ffe1374026ac11fcab41d7264d: Time spent starting tablet: real 0.025s	user 0.000s	sys 0.008s
I20260709 13:17:40.470677  5909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c65d802300c64a8f97ec9fb13c6599db" candidate_uuid: "f5fa01ffe1374026ac11fcab41d7264d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cbbc600cb2fc4d919e1dd0b8e1299929"
I20260709 13:17:40.471114  5952 tablet_bootstrap.cc:492] T df80ca53941844b3b7f6df85be38b00d P f5fa01ffe1374026ac11fcab41d7264d: Bootstrap starting.
I20260709 13:17:40.471225  5909 raft_consensus.cc:3060] T c65d802300c64a8f97ec9fb13c6599db P cbbc600cb2fc4d919e1dd0b8e1299929 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:40.475690  5954 tablet_bootstrap.cc:654] T 0a72b395bcab4a0ab35141522c307b66 P cbbc600cb2fc4d919e1dd0b8e1299929: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:40.476590  5953 tablet_bootstrap.cc:492] T 15093a816d314d35abd1195b622ad13e P 8f11b64b1f21462ba2ae6d247817bc5d: No bootstrap required, opened a new log
W20260709 13:17:40.476864  5725 leader_election.cc:343] T c65d802300c64a8f97ec9fb13c6599db P f5fa01ffe1374026ac11fcab41d7264d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8f11b64b1f21462ba2ae6d247817bc5d (127.5.126.66:43089): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:40.477134  5953 ts_tablet_manager.cc:1403] T 15093a816d314d35abd1195b622ad13e P 8f11b64b1f21462ba2ae6d247817bc5d: Time spent bootstrapping tablet: real 0.058s	user 0.014s	sys 0.007s
I20260709 13:17:40.480382  5953 raft_consensus.cc:359] T 15093a816d314d35abd1195b622ad13e P 8f11b64b1f21462ba2ae6d247817bc5d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5fa01ffe1374026ac11fcab41d7264d" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 41321 } } peers { permanent_uuid: "8f11b64b1f21462ba2ae6d247817bc5d" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 43089 } } peers { permanent_uuid: "cbbc600cb2fc4d919e1dd0b8e1299929" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 34181 } }
I20260709 13:17:40.481209  5953 raft_consensus.cc:385] T 15093a816d314d35abd1195b622ad13e P 8f11b64b1f21462ba2ae6d247817bc5d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:40.481529  5953 raft_consensus.cc:740] T 15093a816d314d35abd1195b622ad13e P 8f11b64b1f21462ba2ae6d247817bc5d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8f11b64b1f21462ba2ae6d247817bc5d, State: Initialized, Role: FOLLOWER
I20260709 13:17:40.482374  5953 consensus_queue.cc:260] T 15093a816d314d35abd1195b622ad13e P 8f11b64b1f21462ba2ae6d247817bc5d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5fa01ffe1374026ac11fcab41d7264d" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 41321 } } peers { permanent_uuid: "8f11b64b1f21462ba2ae6d247817bc5d" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 43089 } } peers { permanent_uuid: "cbbc600cb2fc4d919e1dd0b8e1299929" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 34181 } }
I20260709 13:17:40.487030  5909 raft_consensus.cc:2468] T c65d802300c64a8f97ec9fb13c6599db P cbbc600cb2fc4d919e1dd0b8e1299929 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5fa01ffe1374026ac11fcab41d7264d in term 1.
I20260709 13:17:40.489526  5953 ts_tablet_manager.cc:1434] T 15093a816d314d35abd1195b622ad13e P 8f11b64b1f21462ba2ae6d247817bc5d: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.001s
I20260709 13:17:40.490362  5960 raft_consensus.cc:493] T dd4693df753b48e59707726329d3b352 P cbbc600cb2fc4d919e1dd0b8e1299929 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:40.497538  5960 raft_consensus.cc:515] T dd4693df753b48e59707726329d3b352 P cbbc600cb2fc4d919e1dd0b8e1299929 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5fa01ffe1374026ac11fcab41d7264d" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 41321 } } peers { permanent_uuid: "8f11b64b1f21462ba2ae6d247817bc5d" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 43089 } } peers { permanent_uuid: "cbbc600cb2fc4d919e1dd0b8e1299929" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 34181 } }
I20260709 13:17:40.497931  5723 leader_election.cc:304] T c65d802300c64a8f97ec9fb13c6599db P f5fa01ffe1374026ac11fcab41d7264d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cbbc600cb2fc4d919e1dd0b8e1299929, f5fa01ffe1374026ac11fcab41d7264d; no voters: 8f11b64b1f21462ba2ae6d247817bc5d
I20260709 13:17:40.500106  5954 tablet_bootstrap.cc:492] T 0a72b395bcab4a0ab35141522c307b66 P cbbc600cb2fc4d919e1dd0b8e1299929: No bootstrap required, opened a new log
I20260709 13:17:40.500672  5954 ts_tablet_manager.cc:1403] T 0a72b395bcab4a0ab35141522c307b66 P cbbc600cb2fc4d919e1dd0b8e1299929: Time spent bootstrapping tablet: real 0.044s	user 0.013s	sys 0.017s
I20260709 13:17:40.500543  5960 leader_election.cc:290] T dd4693df753b48e59707726329d3b352 P cbbc600cb2fc4d919e1dd0b8e1299929 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f5fa01ffe1374026ac11fcab41d7264d (127.5.126.65:41321), 8f11b64b1f21462ba2ae6d247817bc5d (127.5.126.66:43089)
I20260709 13:17:40.502216  5953 tablet_bootstrap.cc:492] T c65d802300c64a8f97ec9fb13c6599db P 8f11b64b1f21462ba2ae6d247817bc5d: Bootstrap starting.
I20260709 13:17:40.503849  5954 raft_consensus.cc:359] T 0a72b395bcab4a0ab35141522c307b66 P cbbc600cb2fc4d919e1dd0b8e1299929 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5fa01ffe1374026ac11fcab41d7264d" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 41321 } } peers { permanent_uuid: "8f11b64b1f21462ba2ae6d247817bc5d" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 43089 } } peers { permanent_uuid: "cbbc600cb2fc4d919e1dd0b8e1299929" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 34181 } }
I20260709 13:17:40.504704  5954 raft_consensus.cc:385] T 0a72b395bcab4a0ab35141522c307b66 P cbbc600cb2fc4d919e1dd0b8e1299929 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:40.505030  5954 raft_consensus.cc:740] T 0a72b395bcab4a0ab35141522c307b66 P cbbc600cb2fc4d919e1dd0b8e1299929 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cbbc600cb2fc4d919e1dd0b8e1299929, State: Initialized, Role: FOLLOWER
I20260709 13:17:40.505913  5954 consensus_queue.cc:260] T 0a72b395bcab4a0ab35141522c307b66 P cbbc600cb2fc4d919e1dd0b8e1299929 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5fa01ffe1374026ac11fcab41d7264d" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 41321 } } peers { permanent_uuid: "8f11b64b1f21462ba2ae6d247817bc5d" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 43089 } } peers { permanent_uuid: "cbbc600cb2fc4d919e1dd0b8e1299929" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 34181 } }
I20260709 13:17:40.492375  5952 tablet_bootstrap.cc:654] T df80ca53941844b3b7f6df85be38b00d P f5fa01ffe1374026ac11fcab41d7264d: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:40.508782  5954 ts_tablet_manager.cc:1434] T 0a72b395bcab4a0ab35141522c307b66 P cbbc600cb2fc4d919e1dd0b8e1299929: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.002s
I20260709 13:17:40.509971  5954 tablet_bootstrap.cc:492] T a47b6d6930154ade882793bfdf796229 P cbbc600cb2fc4d919e1dd0b8e1299929: Bootstrap starting.
I20260709 13:17:40.513684  5974 raft_consensus.cc:2804] T c65d802300c64a8f97ec9fb13c6599db P f5fa01ffe1374026ac11fcab41d7264d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:40.515069  5974 raft_consensus.cc:697] T c65d802300c64a8f97ec9fb13c6599db P f5fa01ffe1374026ac11fcab41d7264d [term 1 LEADER]: Becoming Leader. State: Replica: f5fa01ffe1374026ac11fcab41d7264d, State: Running, Role: LEADER
I20260709 13:17:40.516095  5974 consensus_queue.cc:237] T c65d802300c64a8f97ec9fb13c6599db P f5fa01ffe1374026ac11fcab41d7264d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5fa01ffe1374026ac11fcab41d7264d" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 41321 } } peers { permanent_uuid: "8f11b64b1f21462ba2ae6d247817bc5d" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 43089 } } peers { permanent_uuid: "cbbc600cb2fc4d919e1dd0b8e1299929" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 34181 } }
I20260709 13:17:40.517304  5954 tablet_bootstrap.cc:654] T a47b6d6930154ade882793bfdf796229 P cbbc600cb2fc4d919e1dd0b8e1299929: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:40.519063  5959 raft_consensus.cc:493] T a47b6d6930154ade882793bfdf796229 P 8f11b64b1f21462ba2ae6d247817bc5d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:40.519735  5959 raft_consensus.cc:515] T a47b6d6930154ade882793bfdf796229 P 8f11b64b1f21462ba2ae6d247817bc5d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5fa01ffe1374026ac11fcab41d7264d" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 41321 } } peers { permanent_uuid: "8f11b64b1f21462ba2ae6d247817bc5d" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 43089 } } peers { permanent_uuid: "cbbc600cb2fc4d919e1dd0b8e1299929" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 34181 } }
I20260709 13:17:40.523245  5959 leader_election.cc:290] T a47b6d6930154ade882793bfdf796229 P 8f11b64b1f21462ba2ae6d247817bc5d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f5fa01ffe1374026ac11fcab41d7264d (127.5.126.65:41321), cbbc600cb2fc4d919e1dd0b8e1299929 (127.5.126.67:34181)
I20260709 13:17:40.526731  5953 tablet_bootstrap.cc:654] T c65d802300c64a8f97ec9fb13c6599db P 8f11b64b1f21462ba2ae6d247817bc5d: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:40.533682  5959 raft_consensus.cc:493] T 15093a816d314d35abd1195b622ad13e P 8f11b64b1f21462ba2ae6d247817bc5d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:40.534550  5959 raft_consensus.cc:515] T 15093a816d314d35abd1195b622ad13e P 8f11b64b1f21462ba2ae6d247817bc5d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5fa01ffe1374026ac11fcab41d7264d" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 41321 } } peers { permanent_uuid: "8f11b64b1f21462ba2ae6d247817bc5d" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 43089 } } peers { permanent_uuid: "cbbc600cb2fc4d919e1dd0b8e1299929" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 34181 } }
I20260709 13:17:40.538858  5960 raft_consensus.cc:493] T 15093a816d314d35abd1195b622ad13e P cbbc600cb2fc4d919e1dd0b8e1299929 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:40.537774  5959 leader_election.cc:290] T 15093a816d314d35abd1195b622ad13e P 8f11b64b1f21462ba2ae6d247817bc5d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f5fa01ffe1374026ac11fcab41d7264d (127.5.126.65:41321), cbbc600cb2fc4d919e1dd0b8e1299929 (127.5.126.67:34181)
I20260709 13:17:40.539489  5960 raft_consensus.cc:515] T 15093a816d314d35abd1195b622ad13e P cbbc600cb2fc4d919e1dd0b8e1299929 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5fa01ffe1374026ac11fcab41d7264d" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 41321 } } peers { permanent_uuid: "8f11b64b1f21462ba2ae6d247817bc5d" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 43089 } } peers { permanent_uuid: "cbbc600cb2fc4d919e1dd0b8e1299929" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 34181 } }
I20260709 13:17:40.541838  5960 leader_election.cc:290] T 15093a816d314d35abd1195b622ad13e P cbbc600cb2fc4d919e1dd0b8e1299929 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f5fa01ffe1374026ac11fcab41d7264d (127.5.126.65:41321), 8f11b64b1f21462ba2ae6d247817bc5d (127.5.126.66:43089)
I20260709 13:17:40.610059  5909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a47b6d6930154ade882793bfdf796229" candidate_uuid: "8f11b64b1f21462ba2ae6d247817bc5d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cbbc600cb2fc4d919e1dd0b8e1299929" is_pre_election: true
I20260709 13:17:40.611577  5908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15093a816d314d35abd1195b622ad13e" candidate_uuid: "8f11b64b1f21462ba2ae6d247817bc5d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cbbc600cb2fc4d919e1dd0b8e1299929" is_pre_election: true
I20260709 13:17:40.612994  5952 tablet_bootstrap.cc:492] T df80ca53941844b3b7f6df85be38b00d P f5fa01ffe1374026ac11fcab41d7264d: No bootstrap required, opened a new log
I20260709 13:17:40.613082  5908 raft_consensus.cc:2468] T 15093a816d314d35abd1195b622ad13e P cbbc600cb2fc4d919e1dd0b8e1299929 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8f11b64b1f21462ba2ae6d247817bc5d in term 0.
I20260709 13:17:40.614423  5952 ts_tablet_manager.cc:1403] T df80ca53941844b3b7f6df85be38b00d P f5fa01ffe1374026ac11fcab41d7264d: Time spent bootstrapping tablet: real 0.144s	user 0.020s	sys 0.016s
I20260709 13:17:40.615260  5960 raft_consensus.cc:493] T 0a72b395bcab4a0ab35141522c307b66 P cbbc600cb2fc4d919e1dd0b8e1299929 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:40.615846  5960 raft_consensus.cc:515] T 0a72b395bcab4a0ab35141522c307b66 P cbbc600cb2fc4d919e1dd0b8e1299929 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5fa01ffe1374026ac11fcab41d7264d" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 41321 } } peers { permanent_uuid: "8f11b64b1f21462ba2ae6d247817bc5d" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 43089 } } peers { permanent_uuid: "cbbc600cb2fc4d919e1dd0b8e1299929" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 34181 } }
I20260709 13:17:40.620266  5959 raft_consensus.cc:493] T df80ca53941844b3b7f6df85be38b00d P 8f11b64b1f21462ba2ae6d247817bc5d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:40.620862  5960 leader_election.cc:290] T 0a72b395bcab4a0ab35141522c307b66 P cbbc600cb2fc4d919e1dd0b8e1299929 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f5fa01ffe1374026ac11fcab41d7264d (127.5.126.65:41321), 8f11b64b1f21462ba2ae6d247817bc5d (127.5.126.66:43089)
I20260709 13:17:40.619213  5953 tablet_bootstrap.cc:492] T c65d802300c64a8f97ec9fb13c6599db P 8f11b64b1f21462ba2ae6d247817bc5d: No bootstrap required, opened a new log
I20260709 13:17:40.621050  5959 raft_consensus.cc:515] T df80ca53941844b3b7f6df85be38b00d P 8f11b64b1f21462ba2ae6d247817bc5d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbbc600cb2fc4d919e1dd0b8e1299929" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 34181 } } peers { permanent_uuid: "f5fa01ffe1374026ac11fcab41d7264d" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 41321 } } peers { permanent_uuid: "8f11b64b1f21462ba2ae6d247817bc5d" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 43089 } }
I20260709 13:17:40.621970  5953 ts_tablet_manager.cc:1403] T c65d802300c64a8f97ec9fb13c6599db P 8f11b64b1f21462ba2ae6d247817bc5d: Time spent bootstrapping tablet: real 0.120s	user 0.013s	sys 0.021s
I20260709 13:17:40.625065  5959 leader_election.cc:290] T df80ca53941844b3b7f6df85be38b00d P 8f11b64b1f21462ba2ae6d247817bc5d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cbbc600cb2fc4d919e1dd0b8e1299929 (127.5.126.67:34181), f5fa01ffe1374026ac11fcab41d7264d (127.5.126.65:41321)
I20260709 13:17:40.626296  5952 raft_consensus.cc:359] T df80ca53941844b3b7f6df85be38b00d P f5fa01ffe1374026ac11fcab41d7264d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbbc600cb2fc4d919e1dd0b8e1299929" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 34181 } } peers { permanent_uuid: "f5fa01ffe1374026ac11fcab41d7264d" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 41321 } } peers { permanent_uuid: "8f11b64b1f21462ba2ae6d247817bc5d" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 43089 } }
I20260709 13:17:40.627151  5952 raft_consensus.cc:385] T df80ca53941844b3b7f6df85be38b00d P f5fa01ffe1374026ac11fcab41d7264d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:40.627823  5952 raft_consensus.cc:740] T df80ca53941844b3b7f6df85be38b00d P f5fa01ffe1374026ac11fcab41d7264d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f5fa01ffe1374026ac11fcab41d7264d, State: Initialized, Role: FOLLOWER
I20260709 13:17:40.629256  5954 tablet_bootstrap.cc:492] T a47b6d6930154ade882793bfdf796229 P cbbc600cb2fc4d919e1dd0b8e1299929: No bootstrap required, opened a new log
I20260709 13:17:40.630012  5954 ts_tablet_manager.cc:1403] T a47b6d6930154ade882793bfdf796229 P cbbc600cb2fc4d919e1dd0b8e1299929: Time spent bootstrapping tablet: real 0.120s	user 0.030s	sys 0.049s
W20260709 13:17:40.628492  5798 leader_election.cc:343] T a47b6d6930154ade882793bfdf796229 P 8f11b64b1f21462ba2ae6d247817bc5d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cbbc600cb2fc4d919e1dd0b8e1299929 (127.5.126.67:34181): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:40.635872  5798 leader_election.cc:304] T 15093a816d314d35abd1195b622ad13e P 8f11b64b1f21462ba2ae6d247817bc5d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8f11b64b1f21462ba2ae6d247817bc5d, cbbc600cb2fc4d919e1dd0b8e1299929; no voters: 
I20260709 13:17:40.638134  5908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df80ca53941844b3b7f6df85be38b00d" candidate_uuid: "8f11b64b1f21462ba2ae6d247817bc5d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cbbc600cb2fc4d919e1dd0b8e1299929" is_pre_election: true
I20260709 13:17:40.636574  5952 consensus_queue.cc:260] T df80ca53941844b3b7f6df85be38b00d P f5fa01ffe1374026ac11fcab41d7264d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbbc600cb2fc4d919e1dd0b8e1299929" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 34181 } } peers { permanent_uuid: "f5fa01ffe1374026ac11fcab41d7264d" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 41321 } } peers { permanent_uuid: "8f11b64b1f21462ba2ae6d247817bc5d" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 43089 } }
I20260709 13:17:40.640290  5959 raft_consensus.cc:2804] T 15093a816d314d35abd1195b622ad13e P 8f11b64b1f21462ba2ae6d247817bc5d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:40.640386  5908 raft_consensus.cc:2468] T df80ca53941844b3b7f6df85be38b00d P cbbc600cb2fc4d919e1dd0b8e1299929 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8f11b64b1f21462ba2ae6d247817bc5d in term 0.
I20260709 13:17:40.640363  5760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a47b6d6930154ade882793bfdf796229" candidate_uuid: "8f11b64b1f21462ba2ae6d247817bc5d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5fa01ffe1374026ac11fcab41d7264d" is_pre_election: true
I20260709 13:17:40.641557  5959 raft_consensus.cc:493] T 15093a816d314d35abd1195b622ad13e P 8f11b64b1f21462ba2ae6d247817bc5d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:40.643922  5959 raft_consensus.cc:3060] T 15093a816d314d35abd1195b622ad13e P 8f11b64b1f21462ba2ae6d247817bc5d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:40.641355  5953 raft_consensus.cc:359] T c65d802300c64a8f97ec9fb13c6599db P 8f11b64b1f21462ba2ae6d247817bc5d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5fa01ffe1374026ac11fcab41d7264d" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 41321 } } peers { permanent_uuid: "8f11b64b1f21462ba2ae6d247817bc5d" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 43089 } } peers { permanent_uuid: "cbbc600cb2fc4d919e1dd0b8e1299929" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 34181 } }
I20260709 13:17:40.644995  5954 raft_consensus.cc:359] T a47b6d6930154ade882793bfdf796229 P cbbc600cb2fc4d919e1dd0b8e1299929 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5fa01ffe1374026ac11fcab41d7264d" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 41321 } } peers { permanent_uuid: "8f11b64b1f21462ba2ae6d247817bc5d" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 43089 } } peers { permanent_uuid: "cbbc600cb2fc4d919e1dd0b8e1299929" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 34181 } }
I20260709 13:17:40.643709  5759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15093a816d314d35abd1195b622ad13e" candidate_uuid: "8f11b64b1f21462ba2ae6d247817bc5d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5fa01ffe1374026ac11fcab41d7264d" is_pre_election: true
I20260709 13:17:40.646266  5953 raft_consensus.cc:385] T c65d802300c64a8f97ec9fb13c6599db P 8f11b64b1f21462ba2ae6d247817bc5d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:40.648417  5954 raft_consensus.cc:385] T a47b6d6930154ade882793bfdf796229 P cbbc600cb2fc4d919e1dd0b8e1299929 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:40.647209  5758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df80ca53941844b3b7f6df85be38b00d" candidate_uuid: "8f11b64b1f21462ba2ae6d247817bc5d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5fa01ffe1374026ac11fcab41d7264d" is_pre_election: true
I20260709 13:17:40.647957  5759 raft_consensus.cc:2468] T 15093a816d314d35abd1195b622ad13e P f5fa01ffe1374026ac11fcab41d7264d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8f11b64b1f21462ba2ae6d247817bc5d in term 0.
I20260709 13:17:40.650363  5954 raft_consensus.cc:740] T a47b6d6930154ade882793bfdf796229 P cbbc600cb2fc4d919e1dd0b8e1299929 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cbbc600cb2fc4d919e1dd0b8e1299929, State: Initialized, Role: FOLLOWER
I20260709 13:17:40.648519  5953 raft_consensus.cc:740] T c65d802300c64a8f97ec9fb13c6599db P 8f11b64b1f21462ba2ae6d247817bc5d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8f11b64b1f21462ba2ae6d247817bc5d, State: Initialized, Role: FOLLOWER
I20260709 13:17:40.650743  5758 raft_consensus.cc:2468] T df80ca53941844b3b7f6df85be38b00d P f5fa01ffe1374026ac11fcab41d7264d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8f11b64b1f21462ba2ae6d247817bc5d in term 0.
W20260709 13:17:40.651669  5800 leader_election.cc:343] T a47b6d6930154ade882793bfdf796229 P 8f11b64b1f21462ba2ae6d247817bc5d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f5fa01ffe1374026ac11fcab41d7264d (127.5.126.65:41321): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:40.647092  5798 leader_election.cc:304] T df80ca53941844b3b7f6df85be38b00d P 8f11b64b1f21462ba2ae6d247817bc5d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8f11b64b1f21462ba2ae6d247817bc5d, cbbc600cb2fc4d919e1dd0b8e1299929; no voters: 
I20260709 13:17:40.653254  5952 ts_tablet_manager.cc:1434] T df80ca53941844b3b7f6df85be38b00d P f5fa01ffe1374026ac11fcab41d7264d: Time spent starting tablet: real 0.038s	user 0.000s	sys 0.011s
I20260709 13:17:40.652806  5954 consensus_queue.cc:260] T a47b6d6930154ade882793bfdf796229 P cbbc600cb2fc4d919e1dd0b8e1299929 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5fa01ffe1374026ac11fcab41d7264d" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 41321 } } peers { permanent_uuid: "8f11b64b1f21462ba2ae6d247817bc5d" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 43089 } } peers { permanent_uuid: "cbbc600cb2fc4d919e1dd0b8e1299929" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 34181 } }
I20260709 13:17:40.655386  5953 consensus_queue.cc:260] T c65d802300c64a8f97ec9fb13c6599db P 8f11b64b1f21462ba2ae6d247817bc5d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5fa01ffe1374026ac11fcab41d7264d" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 41321 } } peers { permanent_uuid: "8f11b64b1f21462ba2ae6d247817bc5d" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 43089 } } peers { permanent_uuid: "cbbc600cb2fc4d919e1dd0b8e1299929" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 34181 } }
I20260709 13:17:40.653924  5800 leader_election.cc:304] T a47b6d6930154ade882793bfdf796229 P 8f11b64b1f21462ba2ae6d247817bc5d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8f11b64b1f21462ba2ae6d247817bc5d; no voters: cbbc600cb2fc4d919e1dd0b8e1299929, f5fa01ffe1374026ac11fcab41d7264d
I20260709 13:17:40.658108  5952 tablet_bootstrap.cc:492] T 0a72b395bcab4a0ab35141522c307b66 P f5fa01ffe1374026ac11fcab41d7264d: Bootstrap starting.
I20260709 13:17:40.667798  5959 raft_consensus.cc:515] T 15093a816d314d35abd1195b622ad13e P 8f11b64b1f21462ba2ae6d247817bc5d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5fa01ffe1374026ac11fcab41d7264d" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 41321 } } peers { permanent_uuid: "8f11b64b1f21462ba2ae6d247817bc5d" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 43089 } } peers { permanent_uuid: "cbbc600cb2fc4d919e1dd0b8e1299929" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 34181 } }
I20260709 13:17:40.671218  5959 leader_election.cc:290] T 15093a816d314d35abd1195b622ad13e P 8f11b64b1f21462ba2ae6d247817bc5d [CANDIDATE]: Term 1 election: Requested vote from peers f5fa01ffe1374026ac11fcab41d7264d (127.5.126.65:41321), cbbc600cb2fc4d919e1dd0b8e1299929 (127.5.126.67:34181)
I20260709 13:17:40.672077  5959 raft_consensus.cc:2804] T df80ca53941844b3b7f6df85be38b00d P 8f11b64b1f21462ba2ae6d247817bc5d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:40.672614  5959 raft_consensus.cc:493] T df80ca53941844b3b7f6df85be38b00d P 8f11b64b1f21462ba2ae6d247817bc5d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:40.673125  5959 raft_consensus.cc:3060] T df80ca53941844b3b7f6df85be38b00d P 8f11b64b1f21462ba2ae6d247817bc5d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:40.688609  5988 raft_consensus.cc:2749] T a47b6d6930154ade882793bfdf796229 P 8f11b64b1f21462ba2ae6d247817bc5d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:17:40.693709  5800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.65:41321, user_credentials={real_user=slave}} blocked reactor thread for 44526.7us
I20260709 13:17:40.695461  5954 ts_tablet_manager.cc:1434] T a47b6d6930154ade882793bfdf796229 P cbbc600cb2fc4d919e1dd0b8e1299929: Time spent starting tablet: real 0.065s	user 0.010s	sys 0.000s
I20260709 13:17:40.699278  5952 tablet_bootstrap.cc:654] T 0a72b395bcab4a0ab35141522c307b66 P f5fa01ffe1374026ac11fcab41d7264d: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:40.699733  5954 tablet_bootstrap.cc:492] T 88a110b2e3174300b97eede6e4cb29a8 P cbbc600cb2fc4d919e1dd0b8e1299929: Bootstrap starting.
I20260709 13:17:40.697844  5758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15093a816d314d35abd1195b622ad13e" candidate_uuid: "8f11b64b1f21462ba2ae6d247817bc5d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5fa01ffe1374026ac11fcab41d7264d"
I20260709 13:17:40.702718  5953 ts_tablet_manager.cc:1434] T c65d802300c64a8f97ec9fb13c6599db P 8f11b64b1f21462ba2ae6d247817bc5d: Time spent starting tablet: real 0.078s	user 0.011s	sys 0.012s
I20260709 13:17:40.705725  5758 raft_consensus.cc:3060] T 15093a816d314d35abd1195b622ad13e P f5fa01ffe1374026ac11fcab41d7264d [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:17:40.698714  5798 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:34181, user_credentials={real_user=slave}} blocked reactor thread for 52403.8us
I20260709 13:17:40.706656  5953 tablet_bootstrap.cc:492] T 88a110b2e3174300b97eede6e4cb29a8 P 8f11b64b1f21462ba2ae6d247817bc5d: Bootstrap starting.
I20260709 13:17:40.710687  5908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15093a816d314d35abd1195b622ad13e" candidate_uuid: "8f11b64b1f21462ba2ae6d247817bc5d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cbbc600cb2fc4d919e1dd0b8e1299929"
I20260709 13:17:40.711265  5908 raft_consensus.cc:3060] T 15093a816d314d35abd1195b622ad13e P cbbc600cb2fc4d919e1dd0b8e1299929 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:40.694993  5654 catalog_manager.cc:5697] T c65d802300c64a8f97ec9fb13c6599db P f5fa01ffe1374026ac11fcab41d7264d reported cstate change: term changed from 0 to 1, leader changed from <none> to f5fa01ffe1374026ac11fcab41d7264d (127.5.126.65). New cstate: current_term: 1 leader_uuid: "f5fa01ffe1374026ac11fcab41d7264d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5fa01ffe1374026ac11fcab41d7264d" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 41321 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8f11b64b1f21462ba2ae6d247817bc5d" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 43089 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cbbc600cb2fc4d919e1dd0b8e1299929" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 34181 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:40.718262  5835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd4693df753b48e59707726329d3b352" candidate_uuid: "cbbc600cb2fc4d919e1dd0b8e1299929" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f11b64b1f21462ba2ae6d247817bc5d" is_pre_election: true
I20260709 13:17:40.728864  5759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd4693df753b48e59707726329d3b352" candidate_uuid: "cbbc600cb2fc4d919e1dd0b8e1299929" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5fa01ffe1374026ac11fcab41d7264d" is_pre_election: true
I20260709 13:17:40.721079  5834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15093a816d314d35abd1195b622ad13e" candidate_uuid: "cbbc600cb2fc4d919e1dd0b8e1299929" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f11b64b1f21462ba2ae6d247817bc5d" is_pre_election: true
I20260709 13:17:40.729657  5760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15093a816d314d35abd1195b622ad13e" candidate_uuid: "cbbc600cb2fc4d919e1dd0b8e1299929" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5fa01ffe1374026ac11fcab41d7264d" is_pre_election: true
I20260709 13:17:40.734946  5834 raft_consensus.cc:2393] T 15093a816d314d35abd1195b622ad13e P 8f11b64b1f21462ba2ae6d247817bc5d [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cbbc600cb2fc4d919e1dd0b8e1299929 in current term 1: Already voted for candidate 8f11b64b1f21462ba2ae6d247817bc5d in this term.
I20260709 13:17:40.729648  5759 raft_consensus.cc:2468] T dd4693df753b48e59707726329d3b352 P f5fa01ffe1374026ac11fcab41d7264d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cbbc600cb2fc4d919e1dd0b8e1299929 in term 0.
I20260709 13:17:40.732523  5757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a72b395bcab4a0ab35141522c307b66" candidate_uuid: "cbbc600cb2fc4d919e1dd0b8e1299929" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5fa01ffe1374026ac11fcab41d7264d" is_pre_election: true
W20260709 13:17:40.739856  5874 leader_election.cc:343] T dd4693df753b48e59707726329d3b352 P cbbc600cb2fc4d919e1dd0b8e1299929 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8f11b64b1f21462ba2ae6d247817bc5d (127.5.126.66:43089): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:40.739033  5834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a72b395bcab4a0ab35141522c307b66" candidate_uuid: "cbbc600cb2fc4d919e1dd0b8e1299929" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f11b64b1f21462ba2ae6d247817bc5d" is_pre_election: true
W20260709 13:17:40.742125  5874 leader_election.cc:343] T 0a72b395bcab4a0ab35141522c307b66 P cbbc600cb2fc4d919e1dd0b8e1299929 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8f11b64b1f21462ba2ae6d247817bc5d (127.5.126.66:43089): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:40.744186  5874 leader_election.cc:304] T dd4693df753b48e59707726329d3b352 P cbbc600cb2fc4d919e1dd0b8e1299929 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cbbc600cb2fc4d919e1dd0b8e1299929, f5fa01ffe1374026ac11fcab41d7264d; no voters: 8f11b64b1f21462ba2ae6d247817bc5d
I20260709 13:17:40.745517  5960 raft_consensus.cc:2804] T dd4693df753b48e59707726329d3b352 P cbbc600cb2fc4d919e1dd0b8e1299929 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:40.745930  5960 raft_consensus.cc:493] T dd4693df753b48e59707726329d3b352 P cbbc600cb2fc4d919e1dd0b8e1299929 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:40.746326  5960 raft_consensus.cc:3060] T dd4693df753b48e59707726329d3b352 P cbbc600cb2fc4d919e1dd0b8e1299929 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:40.747279  5959 raft_consensus.cc:515] T df80ca53941844b3b7f6df85be38b00d P 8f11b64b1f21462ba2ae6d247817bc5d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbbc600cb2fc4d919e1dd0b8e1299929" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 34181 } } peers { permanent_uuid: "f5fa01ffe1374026ac11fcab41d7264d" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 41321 } } peers { permanent_uuid: "8f11b64b1f21462ba2ae6d247817bc5d" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 43089 } }
I20260709 13:17:40.748386  5952 tablet_bootstrap.cc:492] T 0a72b395bcab4a0ab35141522c307b66 P f5fa01ffe1374026ac11fcab41d7264d: No bootstrap required, opened a new log
I20260709 13:17:40.748919  5952 ts_tablet_manager.cc:1403] T 0a72b395bcab4a0ab35141522c307b66 P f5fa01ffe1374026ac11fcab41d7264d: Time spent bootstrapping tablet: real 0.091s	user 0.016s	sys 0.009s
I20260709 13:17:40.749053  5874 leader_election.cc:304] T 15093a816d314d35abd1195b622ad13e P cbbc600cb2fc4d919e1dd0b8e1299929 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cbbc600cb2fc4d919e1dd0b8e1299929; no voters: 8f11b64b1f21462ba2ae6d247817bc5d, f5fa01ffe1374026ac11fcab41d7264d
I20260709 13:17:40.753412  5908 raft_consensus.cc:2468] T 15093a816d314d35abd1195b622ad13e P cbbc600cb2fc4d919e1dd0b8e1299929 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8f11b64b1f21462ba2ae6d247817bc5d in term 1.
I20260709 13:17:40.753537  5757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df80ca53941844b3b7f6df85be38b00d" candidate_uuid: "8f11b64b1f21462ba2ae6d247817bc5d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5fa01ffe1374026ac11fcab41d7264d"
I20260709 13:17:40.753691  5909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df80ca53941844b3b7f6df85be38b00d" candidate_uuid: "8f11b64b1f21462ba2ae6d247817bc5d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cbbc600cb2fc4d919e1dd0b8e1299929"
I20260709 13:17:40.754179  5757 raft_consensus.cc:3060] T df80ca53941844b3b7f6df85be38b00d P f5fa01ffe1374026ac11fcab41d7264d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:40.754513  5959 leader_election.cc:290] T df80ca53941844b3b7f6df85be38b00d P 8f11b64b1f21462ba2ae6d247817bc5d [CANDIDATE]: Term 1 election: Requested vote from peers cbbc600cb2fc4d919e1dd0b8e1299929 (127.5.126.67:34181), f5fa01ffe1374026ac11fcab41d7264d (127.5.126.65:41321)
I20260709 13:17:40.744618  5758 raft_consensus.cc:2468] T 15093a816d314d35abd1195b622ad13e P f5fa01ffe1374026ac11fcab41d7264d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8f11b64b1f21462ba2ae6d247817bc5d in term 1.
I20260709 13:17:40.755102  5909 raft_consensus.cc:3060] T df80ca53941844b3b7f6df85be38b00d P cbbc600cb2fc4d919e1dd0b8e1299929 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:40.758922  5952 raft_consensus.cc:359] T 0a72b395bcab4a0ab35141522c307b66 P f5fa01ffe1374026ac11fcab41d7264d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5fa01ffe1374026ac11fcab41d7264d" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 41321 } } peers { permanent_uuid: "8f11b64b1f21462ba2ae6d247817bc5d" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 43089 } } peers { permanent_uuid: "cbbc600cb2fc4d919e1dd0b8e1299929" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 34181 } }
I20260709 13:17:40.768080  5952 raft_consensus.cc:385] T 0a72b395bcab4a0ab35141522c307b66 P f5fa01ffe1374026ac11fcab41d7264d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:40.768620  5952 raft_consensus.cc:740] T 0a72b395bcab4a0ab35141522c307b66 P f5fa01ffe1374026ac11fcab41d7264d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f5fa01ffe1374026ac11fcab41d7264d, State: Initialized, Role: FOLLOWER
I20260709 13:17:40.756137  5798 leader_election.cc:304] T 15093a816d314d35abd1195b622ad13e P 8f11b64b1f21462ba2ae6d247817bc5d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8f11b64b1f21462ba2ae6d247817bc5d, cbbc600cb2fc4d919e1dd0b8e1299929; no voters: 
I20260709 13:17:40.772795  5909 raft_consensus.cc:2468] T df80ca53941844b3b7f6df85be38b00d P cbbc600cb2fc4d919e1dd0b8e1299929 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8f11b64b1f21462ba2ae6d247817bc5d in term 1.
I20260709 13:17:40.771306  5952 consensus_queue.cc:260] T 0a72b395bcab4a0ab35141522c307b66 P f5fa01ffe1374026ac11fcab41d7264d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5fa01ffe1374026ac11fcab41d7264d" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 41321 } } peers { permanent_uuid: "8f11b64b1f21462ba2ae6d247817bc5d" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 43089 } } peers { permanent_uuid: "cbbc600cb2fc4d919e1dd0b8e1299929" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 34181 } }
I20260709 13:17:40.760843  5960 raft_consensus.cc:515] T dd4693df753b48e59707726329d3b352 P cbbc600cb2fc4d919e1dd0b8e1299929 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5fa01ffe1374026ac11fcab41d7264d" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 41321 } } peers { permanent_uuid: "8f11b64b1f21462ba2ae6d247817bc5d" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 43089 } } peers { permanent_uuid: "cbbc600cb2fc4d919e1dd0b8e1299929" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 34181 } }
I20260709 13:17:40.776618  5959 raft_consensus.cc:2804] T 15093a816d314d35abd1195b622ad13e P 8f11b64b1f21462ba2ae6d247817bc5d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:40.777868  5959 raft_consensus.cc:697] T 15093a816d314d35abd1195b622ad13e P 8f11b64b1f21462ba2ae6d247817bc5d [term 1 LEADER]: Becoming Leader. State: Replica: 8f11b64b1f21462ba2ae6d247817bc5d, State: Running, Role: LEADER
W20260709 13:17:40.778522  5874 leader_election.cc:343] T 0a72b395bcab4a0ab35141522c307b66 P cbbc600cb2fc4d919e1dd0b8e1299929 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f5fa01ffe1374026ac11fcab41d7264d (127.5.126.65:41321): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:40.778630  5798 leader_election.cc:304] T df80ca53941844b3b7f6df85be38b00d P 8f11b64b1f21462ba2ae6d247817bc5d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8f11b64b1f21462ba2ae6d247817bc5d, cbbc600cb2fc4d919e1dd0b8e1299929; no voters: 
I20260709 13:17:40.779081  5952 ts_tablet_manager.cc:1434] T 0a72b395bcab4a0ab35141522c307b66 P f5fa01ffe1374026ac11fcab41d7264d: Time spent starting tablet: real 0.030s	user 0.009s	sys 0.000s
I20260709 13:17:40.778838  5959 consensus_queue.cc:237] T 15093a816d314d35abd1195b622ad13e P 8f11b64b1f21462ba2ae6d247817bc5d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5fa01ffe1374026ac11fcab41d7264d" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 41321 } } peers { permanent_uuid: "8f11b64b1f21462ba2ae6d247817bc5d" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 43089 } } peers { permanent_uuid: "cbbc600cb2fc4d919e1dd0b8e1299929" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 34181 } }
I20260709 13:17:40.782092  5986 raft_consensus.cc:2804] T df80ca53941844b3b7f6df85be38b00d P 8f11b64b1f21462ba2ae6d247817bc5d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:40.783042  5986 raft_consensus.cc:697] T df80ca53941844b3b7f6df85be38b00d P 8f11b64b1f21462ba2ae6d247817bc5d [term 1 LEADER]: Becoming Leader. State: Replica: 8f11b64b1f21462ba2ae6d247817bc5d, State: Running, Role: LEADER
I20260709 13:17:40.782502  5874 leader_election.cc:304] T 0a72b395bcab4a0ab35141522c307b66 P cbbc600cb2fc4d919e1dd0b8e1299929 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cbbc600cb2fc4d919e1dd0b8e1299929; no voters: 8f11b64b1f21462ba2ae6d247817bc5d, f5fa01ffe1374026ac11fcab41d7264d
I20260709 13:17:40.783219  5952 tablet_bootstrap.cc:492] T 075196757f21457696b5e4ca1e806556 P f5fa01ffe1374026ac11fcab41d7264d: Bootstrap starting.
I20260709 13:17:40.784026  5960 leader_election.cc:290] T dd4693df753b48e59707726329d3b352 P cbbc600cb2fc4d919e1dd0b8e1299929 [CANDIDATE]: Term 1 election: Requested vote from peers f5fa01ffe1374026ac11fcab41d7264d (127.5.126.65:41321), 8f11b64b1f21462ba2ae6d247817bc5d (127.5.126.66:43089)
I20260709 13:17:40.784143  5986 consensus_queue.cc:237] T df80ca53941844b3b7f6df85be38b00d P 8f11b64b1f21462ba2ae6d247817bc5d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbbc600cb2fc4d919e1dd0b8e1299929" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 34181 } } peers { permanent_uuid: "f5fa01ffe1374026ac11fcab41d7264d" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 41321 } } peers { permanent_uuid: "8f11b64b1f21462ba2ae6d247817bc5d" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 43089 } }
I20260709 13:17:40.786296  5960 raft_consensus.cc:2749] T 0a72b395bcab4a0ab35141522c307b66 P cbbc600cb2fc4d919e1dd0b8e1299929 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:17:40.787770  5991 raft_consensus.cc:2749] T 15093a816d314d35abd1195b622ad13e P cbbc600cb2fc4d919e1dd0b8e1299929 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:17:40.789885  5757 raft_consensus.cc:2468] T df80ca53941844b3b7f6df85be38b00d P f5fa01ffe1374026ac11fcab41d7264d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8f11b64b1f21462ba2ae6d247817bc5d in term 1.
I20260709 13:17:40.791534  5954 tablet_bootstrap.cc:654] T 88a110b2e3174300b97eede6e4cb29a8 P cbbc600cb2fc4d919e1dd0b8e1299929: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:40.790009  5953 tablet_bootstrap.cc:654] T 88a110b2e3174300b97eede6e4cb29a8 P 8f11b64b1f21462ba2ae6d247817bc5d: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:40.800025  5757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd4693df753b48e59707726329d3b352" candidate_uuid: "cbbc600cb2fc4d919e1dd0b8e1299929" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5fa01ffe1374026ac11fcab41d7264d"
I20260709 13:17:40.800323  5834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd4693df753b48e59707726329d3b352" candidate_uuid: "cbbc600cb2fc4d919e1dd0b8e1299929" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f11b64b1f21462ba2ae6d247817bc5d"
I20260709 13:17:40.800972  5757 raft_consensus.cc:3060] T dd4693df753b48e59707726329d3b352 P f5fa01ffe1374026ac11fcab41d7264d [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:17:40.802050  5874 leader_election.cc:343] T dd4693df753b48e59707726329d3b352 P cbbc600cb2fc4d919e1dd0b8e1299929 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8f11b64b1f21462ba2ae6d247817bc5d (127.5.126.66:43089): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:40.815016  5986 raft_consensus.cc:493] T c65d802300c64a8f97ec9fb13c6599db P 8f11b64b1f21462ba2ae6d247817bc5d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:40.815289  5952 tablet_bootstrap.cc:654] T 075196757f21457696b5e4ca1e806556 P f5fa01ffe1374026ac11fcab41d7264d: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:40.815616  5986 raft_consensus.cc:515] T c65d802300c64a8f97ec9fb13c6599db P 8f11b64b1f21462ba2ae6d247817bc5d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5fa01ffe1374026ac11fcab41d7264d" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 41321 } } peers { permanent_uuid: "8f11b64b1f21462ba2ae6d247817bc5d" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 43089 } } peers { permanent_uuid: "cbbc600cb2fc4d919e1dd0b8e1299929" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 34181 } }
I20260709 13:17:40.831066  5986 leader_election.cc:290] T c65d802300c64a8f97ec9fb13c6599db P 8f11b64b1f21462ba2ae6d247817bc5d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f5fa01ffe1374026ac11fcab41d7264d (127.5.126.65:41321), cbbc600cb2fc4d919e1dd0b8e1299929 (127.5.126.67:34181)
I20260709 13:17:40.833714  5758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c65d802300c64a8f97ec9fb13c6599db" candidate_uuid: "8f11b64b1f21462ba2ae6d247817bc5d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5fa01ffe1374026ac11fcab41d7264d" is_pre_election: true
I20260709 13:17:40.835002  5909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c65d802300c64a8f97ec9fb13c6599db" candidate_uuid: "8f11b64b1f21462ba2ae6d247817bc5d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cbbc600cb2fc4d919e1dd0b8e1299929" is_pre_election: true
I20260709 13:17:40.835814  5757 raft_consensus.cc:2468] T dd4693df753b48e59707726329d3b352 P f5fa01ffe1374026ac11fcab41d7264d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cbbc600cb2fc4d919e1dd0b8e1299929 in term 1.
I20260709 13:17:40.836612  5909 raft_consensus.cc:2393] T c65d802300c64a8f97ec9fb13c6599db P cbbc600cb2fc4d919e1dd0b8e1299929 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8f11b64b1f21462ba2ae6d247817bc5d in current term 1: Already voted for candidate f5fa01ffe1374026ac11fcab41d7264d in this term.
I20260709 13:17:40.838018  5874 leader_election.cc:304] T dd4693df753b48e59707726329d3b352 P cbbc600cb2fc4d919e1dd0b8e1299929 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cbbc600cb2fc4d919e1dd0b8e1299929, f5fa01ffe1374026ac11fcab41d7264d; no voters: 8f11b64b1f21462ba2ae6d247817bc5d
I20260709 13:17:40.838124  5798 leader_election.cc:304] T c65d802300c64a8f97ec9fb13c6599db P 8f11b64b1f21462ba2ae6d247817bc5d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8f11b64b1f21462ba2ae6d247817bc5d; no voters: cbbc600cb2fc4d919e1dd0b8e1299929, f5fa01ffe1374026ac11fcab41d7264d
I20260709 13:17:40.839645  5993 raft_consensus.cc:2804] T dd4693df753b48e59707726329d3b352 P cbbc600cb2fc4d919e1dd0b8e1299929 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:40.840219  5993 raft_consensus.cc:697] T dd4693df753b48e59707726329d3b352 P cbbc600cb2fc4d919e1dd0b8e1299929 [term 1 LEADER]: Becoming Leader. State: Replica: cbbc600cb2fc4d919e1dd0b8e1299929, State: Running, Role: LEADER
I20260709 13:17:40.841084  5993 consensus_queue.cc:237] T dd4693df753b48e59707726329d3b352 P cbbc600cb2fc4d919e1dd0b8e1299929 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5fa01ffe1374026ac11fcab41d7264d" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 41321 } } peers { permanent_uuid: "8f11b64b1f21462ba2ae6d247817bc5d" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 43089 } } peers { permanent_uuid: "cbbc600cb2fc4d919e1dd0b8e1299929" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 34181 } }
I20260709 13:17:40.842213  5986 raft_consensus.cc:3060] T c65d802300c64a8f97ec9fb13c6599db P 8f11b64b1f21462ba2ae6d247817bc5d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:40.844065  5954 tablet_bootstrap.cc:492] T 88a110b2e3174300b97eede6e4cb29a8 P cbbc600cb2fc4d919e1dd0b8e1299929: No bootstrap required, opened a new log
I20260709 13:17:40.845430  5954 ts_tablet_manager.cc:1403] T 88a110b2e3174300b97eede6e4cb29a8 P cbbc600cb2fc4d919e1dd0b8e1299929: Time spent bootstrapping tablet: real 0.147s	user 0.028s	sys 0.016s
I20260709 13:17:40.848464  5954 raft_consensus.cc:359] T 88a110b2e3174300b97eede6e4cb29a8 P cbbc600cb2fc4d919e1dd0b8e1299929 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5fa01ffe1374026ac11fcab41d7264d" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 41321 } } peers { permanent_uuid: "8f11b64b1f21462ba2ae6d247817bc5d" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 43089 } } peers { permanent_uuid: "cbbc600cb2fc4d919e1dd0b8e1299929" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 34181 } }
I20260709 13:17:40.849424  5954 raft_consensus.cc:385] T 88a110b2e3174300b97eede6e4cb29a8 P cbbc600cb2fc4d919e1dd0b8e1299929 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:40.849735  5954 raft_consensus.cc:740] T 88a110b2e3174300b97eede6e4cb29a8 P cbbc600cb2fc4d919e1dd0b8e1299929 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cbbc600cb2fc4d919e1dd0b8e1299929, State: Initialized, Role: FOLLOWER
I20260709 13:17:40.850457  5954 consensus_queue.cc:260] T 88a110b2e3174300b97eede6e4cb29a8 P cbbc600cb2fc4d919e1dd0b8e1299929 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5fa01ffe1374026ac11fcab41d7264d" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 41321 } } peers { permanent_uuid: "8f11b64b1f21462ba2ae6d247817bc5d" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 43089 } } peers { permanent_uuid: "cbbc600cb2fc4d919e1dd0b8e1299929" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 34181 } }
I20260709 13:17:40.853565  5954 ts_tablet_manager.cc:1434] T 88a110b2e3174300b97eede6e4cb29a8 P cbbc600cb2fc4d919e1dd0b8e1299929: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.001s
I20260709 13:17:40.854809  5954 tablet_bootstrap.cc:492] T 075196757f21457696b5e4ca1e806556 P cbbc600cb2fc4d919e1dd0b8e1299929: Bootstrap starting.
I20260709 13:17:40.857185  5952 tablet_bootstrap.cc:492] T 075196757f21457696b5e4ca1e806556 P f5fa01ffe1374026ac11fcab41d7264d: No bootstrap required, opened a new log
I20260709 13:17:40.857770  5952 ts_tablet_manager.cc:1403] T 075196757f21457696b5e4ca1e806556 P f5fa01ffe1374026ac11fcab41d7264d: Time spent bootstrapping tablet: real 0.075s	user 0.018s	sys 0.012s
I20260709 13:17:40.865149  5986 raft_consensus.cc:2749] T c65d802300c64a8f97ec9fb13c6599db P 8f11b64b1f21462ba2ae6d247817bc5d [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:17:40.861171  5952 raft_consensus.cc:359] T 075196757f21457696b5e4ca1e806556 P f5fa01ffe1374026ac11fcab41d7264d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5fa01ffe1374026ac11fcab41d7264d" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 41321 } } peers { permanent_uuid: "8f11b64b1f21462ba2ae6d247817bc5d" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 43089 } } peers { permanent_uuid: "cbbc600cb2fc4d919e1dd0b8e1299929" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 34181 } }
I20260709 13:17:40.868763  5952 raft_consensus.cc:385] T 075196757f21457696b5e4ca1e806556 P f5fa01ffe1374026ac11fcab41d7264d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:40.869141  5952 raft_consensus.cc:740] T 075196757f21457696b5e4ca1e806556 P f5fa01ffe1374026ac11fcab41d7264d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f5fa01ffe1374026ac11fcab41d7264d, State: Initialized, Role: FOLLOWER
I20260709 13:17:40.870016  5952 consensus_queue.cc:260] T 075196757f21457696b5e4ca1e806556 P f5fa01ffe1374026ac11fcab41d7264d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5fa01ffe1374026ac11fcab41d7264d" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 41321 } } peers { permanent_uuid: "8f11b64b1f21462ba2ae6d247817bc5d" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 43089 } } peers { permanent_uuid: "cbbc600cb2fc4d919e1dd0b8e1299929" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 34181 } }
I20260709 13:17:40.867812  5954 tablet_bootstrap.cc:654] T 075196757f21457696b5e4ca1e806556 P cbbc600cb2fc4d919e1dd0b8e1299929: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:40.881291  5952 ts_tablet_manager.cc:1434] T 075196757f21457696b5e4ca1e806556 P f5fa01ffe1374026ac11fcab41d7264d: Time spent starting tablet: real 0.023s	user 0.009s	sys 0.000s
I20260709 13:17:40.882823  5952 tablet_bootstrap.cc:492] T 8857705ce84344eb9a2b986546bb10e6 P f5fa01ffe1374026ac11fcab41d7264d: Bootstrap starting.
W20260709 13:17:40.884351  5704 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:17:40.885370  5953 tablet_bootstrap.cc:492] T 88a110b2e3174300b97eede6e4cb29a8 P 8f11b64b1f21462ba2ae6d247817bc5d: No bootstrap required, opened a new log
I20260709 13:17:40.887234  5953 ts_tablet_manager.cc:1403] T 88a110b2e3174300b97eede6e4cb29a8 P 8f11b64b1f21462ba2ae6d247817bc5d: Time spent bootstrapping tablet: real 0.183s	user 0.006s	sys 0.032s
I20260709 13:17:40.890991  5952 tablet_bootstrap.cc:654] T 8857705ce84344eb9a2b986546bb10e6 P f5fa01ffe1374026ac11fcab41d7264d: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:40.891366  5953 raft_consensus.cc:359] T 88a110b2e3174300b97eede6e4cb29a8 P 8f11b64b1f21462ba2ae6d247817bc5d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5fa01ffe1374026ac11fcab41d7264d" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 41321 } } peers { permanent_uuid: "8f11b64b1f21462ba2ae6d247817bc5d" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 43089 } } peers { permanent_uuid: "cbbc600cb2fc4d919e1dd0b8e1299929" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 34181 } }
I20260709 13:17:40.892814  5953 raft_consensus.cc:385] T 88a110b2e3174300b97eede6e4cb29a8 P 8f11b64b1f21462ba2ae6d247817bc5d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:40.893198  5953 raft_consensus.cc:740] T 88a110b2e3174300b97eede6e4cb29a8 P 8f11b64b1f21462ba2ae6d247817bc5d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8f11b64b1f21462ba2ae6d247817bc5d, State: Initialized, Role: FOLLOWER
I20260709 13:17:40.895074  5986 raft_consensus.cc:493] T 075196757f21457696b5e4ca1e806556 P 8f11b64b1f21462ba2ae6d247817bc5d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:40.895581  5986 raft_consensus.cc:515] T 075196757f21457696b5e4ca1e806556 P 8f11b64b1f21462ba2ae6d247817bc5d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5fa01ffe1374026ac11fcab41d7264d" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 41321 } } peers { permanent_uuid: "8f11b64b1f21462ba2ae6d247817bc5d" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 43089 } } peers { permanent_uuid: "cbbc600cb2fc4d919e1dd0b8e1299929" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 34181 } }
I20260709 13:17:40.897869  5986 leader_election.cc:290] T 075196757f21457696b5e4ca1e806556 P 8f11b64b1f21462ba2ae6d247817bc5d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f5fa01ffe1374026ac11fcab41d7264d (127.5.126.65:41321), cbbc600cb2fc4d919e1dd0b8e1299929 (127.5.126.67:34181)
I20260709 13:17:40.894075  5953 consensus_queue.cc:260] T 88a110b2e3174300b97eede6e4cb29a8 P 8f11b64b1f21462ba2ae6d247817bc5d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5fa01ffe1374026ac11fcab41d7264d" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 41321 } } peers { permanent_uuid: "8f11b64b1f21462ba2ae6d247817bc5d" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 43089 } } peers { permanent_uuid: "cbbc600cb2fc4d919e1dd0b8e1299929" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 34181 } }
I20260709 13:17:40.899772  5909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "075196757f21457696b5e4ca1e806556" candidate_uuid: "8f11b64b1f21462ba2ae6d247817bc5d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cbbc600cb2fc4d919e1dd0b8e1299929" is_pre_election: true
W20260709 13:17:40.901355  5798 leader_election.cc:343] T 075196757f21457696b5e4ca1e806556 P 8f11b64b1f21462ba2ae6d247817bc5d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cbbc600cb2fc4d919e1dd0b8e1299929 (127.5.126.67:34181): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:40.901448  5757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "075196757f21457696b5e4ca1e806556" candidate_uuid: "8f11b64b1f21462ba2ae6d247817bc5d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5fa01ffe1374026ac11fcab41d7264d" is_pre_election: true
I20260709 13:17:40.901702  5953 ts_tablet_manager.cc:1434] T 88a110b2e3174300b97eede6e4cb29a8 P 8f11b64b1f21462ba2ae6d247817bc5d: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.001s
I20260709 13:17:40.902186  5757 raft_consensus.cc:2468] T 075196757f21457696b5e4ca1e806556 P f5fa01ffe1374026ac11fcab41d7264d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8f11b64b1f21462ba2ae6d247817bc5d in term 0.
I20260709 13:17:40.903091  5953 tablet_bootstrap.cc:492] T 8857705ce84344eb9a2b986546bb10e6 P 8f11b64b1f21462ba2ae6d247817bc5d: Bootstrap starting.
I20260709 13:17:40.903968  5800 leader_election.cc:304] T 075196757f21457696b5e4ca1e806556 P 8f11b64b1f21462ba2ae6d247817bc5d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8f11b64b1f21462ba2ae6d247817bc5d, f5fa01ffe1374026ac11fcab41d7264d; no voters: cbbc600cb2fc4d919e1dd0b8e1299929
I20260709 13:17:40.905939  5959 raft_consensus.cc:493] T 88a110b2e3174300b97eede6e4cb29a8 P 8f11b64b1f21462ba2ae6d247817bc5d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:40.906468  5959 raft_consensus.cc:515] T 88a110b2e3174300b97eede6e4cb29a8 P 8f11b64b1f21462ba2ae6d247817bc5d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5fa01ffe1374026ac11fcab41d7264d" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 41321 } } peers { permanent_uuid: "8f11b64b1f21462ba2ae6d247817bc5d" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 43089 } } peers { permanent_uuid: "cbbc600cb2fc4d919e1dd0b8e1299929" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 34181 } }
I20260709 13:17:40.908941  5959 leader_election.cc:290] T 88a110b2e3174300b97eede6e4cb29a8 P 8f11b64b1f21462ba2ae6d247817bc5d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f5fa01ffe1374026ac11fcab41d7264d (127.5.126.65:41321), cbbc600cb2fc4d919e1dd0b8e1299929 (127.5.126.67:34181)
I20260709 13:17:40.909466  5959 raft_consensus.cc:2804] T 075196757f21457696b5e4ca1e806556 P 8f11b64b1f21462ba2ae6d247817bc5d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:40.909818  5959 raft_consensus.cc:493] T 075196757f21457696b5e4ca1e806556 P 8f11b64b1f21462ba2ae6d247817bc5d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:40.910164  5959 raft_consensus.cc:3060] T 075196757f21457696b5e4ca1e806556 P 8f11b64b1f21462ba2ae6d247817bc5d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:40.910187  5909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88a110b2e3174300b97eede6e4cb29a8" candidate_uuid: "8f11b64b1f21462ba2ae6d247817bc5d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cbbc600cb2fc4d919e1dd0b8e1299929" is_pre_election: true
I20260709 13:17:40.910912  5909 raft_consensus.cc:2468] T 88a110b2e3174300b97eede6e4cb29a8 P cbbc600cb2fc4d919e1dd0b8e1299929 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8f11b64b1f21462ba2ae6d247817bc5d in term 0.
I20260709 13:17:40.912284  5798 leader_election.cc:304] T 88a110b2e3174300b97eede6e4cb29a8 P 8f11b64b1f21462ba2ae6d247817bc5d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8f11b64b1f21462ba2ae6d247817bc5d, cbbc600cb2fc4d919e1dd0b8e1299929; no voters: 
I20260709 13:17:40.913188  5952 tablet_bootstrap.cc:492] T 8857705ce84344eb9a2b986546bb10e6 P f5fa01ffe1374026ac11fcab41d7264d: No bootstrap required, opened a new log
I20260709 13:17:40.913322  5987 raft_consensus.cc:2804] T 88a110b2e3174300b97eede6e4cb29a8 P 8f11b64b1f21462ba2ae6d247817bc5d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:40.913697  5952 ts_tablet_manager.cc:1403] T 8857705ce84344eb9a2b986546bb10e6 P f5fa01ffe1374026ac11fcab41d7264d: Time spent bootstrapping tablet: real 0.031s	user 0.010s	sys 0.008s
I20260709 13:17:40.913825  5987 raft_consensus.cc:493] T 88a110b2e3174300b97eede6e4cb29a8 P 8f11b64b1f21462ba2ae6d247817bc5d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:40.914415  5953 tablet_bootstrap.cc:654] T 8857705ce84344eb9a2b986546bb10e6 P 8f11b64b1f21462ba2ae6d247817bc5d: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:40.914336  5987 raft_consensus.cc:3060] T 88a110b2e3174300b97eede6e4cb29a8 P 8f11b64b1f21462ba2ae6d247817bc5d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:40.915915  5757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88a110b2e3174300b97eede6e4cb29a8" candidate_uuid: "8f11b64b1f21462ba2ae6d247817bc5d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5fa01ffe1374026ac11fcab41d7264d" is_pre_election: true
I20260709 13:17:40.916551  5952 raft_consensus.cc:359] T 8857705ce84344eb9a2b986546bb10e6 P f5fa01ffe1374026ac11fcab41d7264d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5fa01ffe1374026ac11fcab41d7264d" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 41321 } } peers { permanent_uuid: "8f11b64b1f21462ba2ae6d247817bc5d" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 43089 } } peers { permanent_uuid: "cbbc600cb2fc4d919e1dd0b8e1299929" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 34181 } }
I20260709 13:17:40.917622  5952 raft_consensus.cc:385] T 8857705ce84344eb9a2b986546bb10e6 P f5fa01ffe1374026ac11fcab41d7264d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:40.917891  5952 raft_consensus.cc:740] T 8857705ce84344eb9a2b986546bb10e6 P f5fa01ffe1374026ac11fcab41d7264d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f5fa01ffe1374026ac11fcab41d7264d, State: Initialized, Role: FOLLOWER
I20260709 13:17:40.918572  5952 consensus_queue.cc:260] T 8857705ce84344eb9a2b986546bb10e6 P f5fa01ffe1374026ac11fcab41d7264d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5fa01ffe1374026ac11fcab41d7264d" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 41321 } } peers { permanent_uuid: "8f11b64b1f21462ba2ae6d247817bc5d" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 43089 } } peers { permanent_uuid: "cbbc600cb2fc4d919e1dd0b8e1299929" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 34181 } }
I20260709 13:17:40.916582  5757 raft_consensus.cc:2468] T 88a110b2e3174300b97eede6e4cb29a8 P f5fa01ffe1374026ac11fcab41d7264d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8f11b64b1f21462ba2ae6d247817bc5d in term 0.
I20260709 13:17:40.886466  5655 catalog_manager.cc:5697] T dd4693df753b48e59707726329d3b352 P cbbc600cb2fc4d919e1dd0b8e1299929 reported cstate change: term changed from 0 to 1, leader changed from <none> to cbbc600cb2fc4d919e1dd0b8e1299929 (127.5.126.67). New cstate: current_term: 1 leader_uuid: "cbbc600cb2fc4d919e1dd0b8e1299929" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5fa01ffe1374026ac11fcab41d7264d" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 41321 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8f11b64b1f21462ba2ae6d247817bc5d" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 43089 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cbbc600cb2fc4d919e1dd0b8e1299929" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 34181 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:40.924196  5952 ts_tablet_manager.cc:1434] T 8857705ce84344eb9a2b986546bb10e6 P f5fa01ffe1374026ac11fcab41d7264d: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.000s
I20260709 13:17:40.925118  5952 tablet_bootstrap.cc:492] T a47b6d6930154ade882793bfdf796229 P f5fa01ffe1374026ac11fcab41d7264d: Bootstrap starting.
I20260709 13:17:40.925470  5656 catalog_manager.cc:5697] T df80ca53941844b3b7f6df85be38b00d P 8f11b64b1f21462ba2ae6d247817bc5d reported cstate change: term changed from 0 to 1, leader changed from <none> to 8f11b64b1f21462ba2ae6d247817bc5d (127.5.126.66). New cstate: current_term: 1 leader_uuid: "8f11b64b1f21462ba2ae6d247817bc5d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbbc600cb2fc4d919e1dd0b8e1299929" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 34181 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f5fa01ffe1374026ac11fcab41d7264d" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 41321 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8f11b64b1f21462ba2ae6d247817bc5d" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 43089 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:40.922603  5987 raft_consensus.cc:515] T 88a110b2e3174300b97eede6e4cb29a8 P 8f11b64b1f21462ba2ae6d247817bc5d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5fa01ffe1374026ac11fcab41d7264d" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 41321 } } peers { permanent_uuid: "8f11b64b1f21462ba2ae6d247817bc5d" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 43089 } } peers { permanent_uuid: "cbbc600cb2fc4d919e1dd0b8e1299929" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 34181 } }
I20260709 13:17:40.930980  5952 tablet_bootstrap.cc:654] T a47b6d6930154ade882793bfdf796229 P f5fa01ffe1374026ac11fcab41d7264d: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:40.933235  5954 tablet_bootstrap.cc:492] T 075196757f21457696b5e4ca1e806556 P cbbc600cb2fc4d919e1dd0b8e1299929: No bootstrap required, opened a new log
I20260709 13:17:40.934423  5757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88a110b2e3174300b97eede6e4cb29a8" candidate_uuid: "8f11b64b1f21462ba2ae6d247817bc5d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5fa01ffe1374026ac11fcab41d7264d"
I20260709 13:17:40.935246  5909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88a110b2e3174300b97eede6e4cb29a8" candidate_uuid: "8f11b64b1f21462ba2ae6d247817bc5d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cbbc600cb2fc4d919e1dd0b8e1299929"
I20260709 13:17:40.935436  5757 raft_consensus.cc:3060] T 88a110b2e3174300b97eede6e4cb29a8 P f5fa01ffe1374026ac11fcab41d7264d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:40.935806  5909 raft_consensus.cc:3060] T 88a110b2e3174300b97eede6e4cb29a8 P cbbc600cb2fc4d919e1dd0b8e1299929 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:40.938870  5987 leader_election.cc:290] T 88a110b2e3174300b97eede6e4cb29a8 P 8f11b64b1f21462ba2ae6d247817bc5d [CANDIDATE]: Term 1 election: Requested vote from peers f5fa01ffe1374026ac11fcab41d7264d (127.5.126.65:41321), cbbc600cb2fc4d919e1dd0b8e1299929 (127.5.126.67:34181)
I20260709 13:17:40.927385  5656 catalog_manager.cc:5697] T 15093a816d314d35abd1195b622ad13e P 8f11b64b1f21462ba2ae6d247817bc5d reported cstate change: term changed from 0 to 1, leader changed from <none> to 8f11b64b1f21462ba2ae6d247817bc5d (127.5.126.66). New cstate: current_term: 1 leader_uuid: "8f11b64b1f21462ba2ae6d247817bc5d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5fa01ffe1374026ac11fcab41d7264d" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 41321 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8f11b64b1f21462ba2ae6d247817bc5d" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 43089 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cbbc600cb2fc4d919e1dd0b8e1299929" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 34181 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:40.942071  5909 raft_consensus.cc:2468] T 88a110b2e3174300b97eede6e4cb29a8 P cbbc600cb2fc4d919e1dd0b8e1299929 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8f11b64b1f21462ba2ae6d247817bc5d in term 1.
I20260709 13:17:40.945318  5798 leader_election.cc:304] T 88a110b2e3174300b97eede6e4cb29a8 P 8f11b64b1f21462ba2ae6d247817bc5d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8f11b64b1f21462ba2ae6d247817bc5d, cbbc600cb2fc4d919e1dd0b8e1299929; no voters: 
I20260709 13:17:40.946187  5987 raft_consensus.cc:2804] T 88a110b2e3174300b97eede6e4cb29a8 P 8f11b64b1f21462ba2ae6d247817bc5d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:40.946661  5987 raft_consensus.cc:697] T 88a110b2e3174300b97eede6e4cb29a8 P 8f11b64b1f21462ba2ae6d247817bc5d [term 1 LEADER]: Becoming Leader. State: Replica: 8f11b64b1f21462ba2ae6d247817bc5d, State: Running, Role: LEADER
I20260709 13:17:40.947490  5987 consensus_queue.cc:237] T 88a110b2e3174300b97eede6e4cb29a8 P 8f11b64b1f21462ba2ae6d247817bc5d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5fa01ffe1374026ac11fcab41d7264d" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 41321 } } peers { permanent_uuid: "8f11b64b1f21462ba2ae6d247817bc5d" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 43089 } } peers { permanent_uuid: "cbbc600cb2fc4d919e1dd0b8e1299929" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 34181 } }
I20260709 13:17:40.933768  5954 ts_tablet_manager.cc:1403] T 075196757f21457696b5e4ca1e806556 P cbbc600cb2fc4d919e1dd0b8e1299929: Time spent bootstrapping tablet: real 0.079s	user 0.010s	sys 0.004s
I20260709 13:17:40.961977  5757 raft_consensus.cc:2468] T 88a110b2e3174300b97eede6e4cb29a8 P f5fa01ffe1374026ac11fcab41d7264d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8f11b64b1f21462ba2ae6d247817bc5d in term 1.
I20260709 13:17:40.949731  5959 raft_consensus.cc:515] T 075196757f21457696b5e4ca1e806556 P 8f11b64b1f21462ba2ae6d247817bc5d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5fa01ffe1374026ac11fcab41d7264d" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 41321 } } peers { permanent_uuid: "8f11b64b1f21462ba2ae6d247817bc5d" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 43089 } } peers { permanent_uuid: "cbbc600cb2fc4d919e1dd0b8e1299929" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 34181 } }
I20260709 13:17:40.965692  5959 leader_election.cc:290] T 075196757f21457696b5e4ca1e806556 P 8f11b64b1f21462ba2ae6d247817bc5d [CANDIDATE]: Term 1 election: Requested vote from peers f5fa01ffe1374026ac11fcab41d7264d (127.5.126.65:41321), cbbc600cb2fc4d919e1dd0b8e1299929 (127.5.126.67:34181)
I20260709 13:17:40.966924  5909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "075196757f21457696b5e4ca1e806556" candidate_uuid: "8f11b64b1f21462ba2ae6d247817bc5d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cbbc600cb2fc4d919e1dd0b8e1299929"
I20260709 13:17:40.966811  5954 raft_consensus.cc:359] T 075196757f21457696b5e4ca1e806556 P cbbc600cb2fc4d919e1dd0b8e1299929 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5fa01ffe1374026ac11fcab41d7264d" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 41321 } } peers { permanent_uuid: "8f11b64b1f21462ba2ae6d247817bc5d" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 43089 } } peers { permanent_uuid: "cbbc600cb2fc4d919e1dd0b8e1299929" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 34181 } }
I20260709 13:17:40.969455  5953 tablet_bootstrap.cc:492] T 8857705ce84344eb9a2b986546bb10e6 P 8f11b64b1f21462ba2ae6d247817bc5d: No bootstrap required, opened a new log
I20260709 13:17:40.970465  5953 ts_tablet_manager.cc:1403] T 8857705ce84344eb9a2b986546bb10e6 P 8f11b64b1f21462ba2ae6d247817bc5d: Time spent bootstrapping tablet: real 0.068s	user 0.005s	sys 0.010s
I20260709 13:17:40.969782  5655 catalog_manager.cc:5697] T 88a110b2e3174300b97eede6e4cb29a8 P 8f11b64b1f21462ba2ae6d247817bc5d reported cstate change: term changed from 0 to 1, leader changed from <none> to 8f11b64b1f21462ba2ae6d247817bc5d (127.5.126.66). New cstate: current_term: 1 leader_uuid: "8f11b64b1f21462ba2ae6d247817bc5d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5fa01ffe1374026ac11fcab41d7264d" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 41321 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8f11b64b1f21462ba2ae6d247817bc5d" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 43089 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cbbc600cb2fc4d919e1dd0b8e1299929" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 34181 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:40.973954  5953 raft_consensus.cc:359] T 8857705ce84344eb9a2b986546bb10e6 P 8f11b64b1f21462ba2ae6d247817bc5d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5fa01ffe1374026ac11fcab41d7264d" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 41321 } } peers { permanent_uuid: "8f11b64b1f21462ba2ae6d247817bc5d" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 43089 } } peers { permanent_uuid: "cbbc600cb2fc4d919e1dd0b8e1299929" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 34181 } }
I20260709 13:17:40.975414  5953 raft_consensus.cc:385] T 8857705ce84344eb9a2b986546bb10e6 P 8f11b64b1f21462ba2ae6d247817bc5d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:40.975894  5953 raft_consensus.cc:740] T 8857705ce84344eb9a2b986546bb10e6 P 8f11b64b1f21462ba2ae6d247817bc5d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8f11b64b1f21462ba2ae6d247817bc5d, State: Initialized, Role: FOLLOWER
I20260709 13:17:40.974891  5954 raft_consensus.cc:385] T 075196757f21457696b5e4ca1e806556 P cbbc600cb2fc4d919e1dd0b8e1299929 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:40.976518  5757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "075196757f21457696b5e4ca1e806556" candidate_uuid: "8f11b64b1f21462ba2ae6d247817bc5d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5fa01ffe1374026ac11fcab41d7264d"
I20260709 13:17:40.976890  5954 raft_consensus.cc:740] T 075196757f21457696b5e4ca1e806556 P cbbc600cb2fc4d919e1dd0b8e1299929 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cbbc600cb2fc4d919e1dd0b8e1299929, State: Initialized, Role: FOLLOWER
I20260709 13:17:40.977252  5757 raft_consensus.cc:3060] T 075196757f21457696b5e4ca1e806556 P f5fa01ffe1374026ac11fcab41d7264d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:40.977885  5954 consensus_queue.cc:260] T 075196757f21457696b5e4ca1e806556 P cbbc600cb2fc4d919e1dd0b8e1299929 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5fa01ffe1374026ac11fcab41d7264d" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 41321 } } peers { permanent_uuid: "8f11b64b1f21462ba2ae6d247817bc5d" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 43089 } } peers { permanent_uuid: "cbbc600cb2fc4d919e1dd0b8e1299929" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 34181 } }
I20260709 13:17:40.978845  5909 raft_consensus.cc:3060] T 075196757f21457696b5e4ca1e806556 P cbbc600cb2fc4d919e1dd0b8e1299929 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:40.981165  5954 ts_tablet_manager.cc:1434] T 075196757f21457696b5e4ca1e806556 P cbbc600cb2fc4d919e1dd0b8e1299929: Time spent starting tablet: real 0.023s	user 0.006s	sys 0.000s
I20260709 13:17:40.981768  5953 consensus_queue.cc:260] T 8857705ce84344eb9a2b986546bb10e6 P 8f11b64b1f21462ba2ae6d247817bc5d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5fa01ffe1374026ac11fcab41d7264d" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 41321 } } peers { permanent_uuid: "8f11b64b1f21462ba2ae6d247817bc5d" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 43089 } } peers { permanent_uuid: "cbbc600cb2fc4d919e1dd0b8e1299929" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 34181 } }
I20260709 13:17:40.985101  5757 raft_consensus.cc:2468] T 075196757f21457696b5e4ca1e806556 P f5fa01ffe1374026ac11fcab41d7264d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8f11b64b1f21462ba2ae6d247817bc5d in term 1.
I20260709 13:17:40.985729  5909 raft_consensus.cc:2468] T 075196757f21457696b5e4ca1e806556 P cbbc600cb2fc4d919e1dd0b8e1299929 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8f11b64b1f21462ba2ae6d247817bc5d in term 1.
I20260709 13:17:40.986261  5954 tablet_bootstrap.cc:492] T 8857705ce84344eb9a2b986546bb10e6 P cbbc600cb2fc4d919e1dd0b8e1299929: Bootstrap starting.
I20260709 13:17:40.987361  5800 leader_election.cc:304] T 075196757f21457696b5e4ca1e806556 P 8f11b64b1f21462ba2ae6d247817bc5d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8f11b64b1f21462ba2ae6d247817bc5d, f5fa01ffe1374026ac11fcab41d7264d; no voters: 
I20260709 13:17:40.989933  5959 raft_consensus.cc:2804] T 075196757f21457696b5e4ca1e806556 P 8f11b64b1f21462ba2ae6d247817bc5d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:40.990149  5974 raft_consensus.cc:493] T 0a72b395bcab4a0ab35141522c307b66 P f5fa01ffe1374026ac11fcab41d7264d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:40.990777  5959 raft_consensus.cc:697] T 075196757f21457696b5e4ca1e806556 P 8f11b64b1f21462ba2ae6d247817bc5d [term 1 LEADER]: Becoming Leader. State: Replica: 8f11b64b1f21462ba2ae6d247817bc5d, State: Running, Role: LEADER
I20260709 13:17:40.990659  5974 raft_consensus.cc:515] T 0a72b395bcab4a0ab35141522c307b66 P f5fa01ffe1374026ac11fcab41d7264d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5fa01ffe1374026ac11fcab41d7264d" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 41321 } } peers { permanent_uuid: "8f11b64b1f21462ba2ae6d247817bc5d" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 43089 } } peers { permanent_uuid: "cbbc600cb2fc4d919e1dd0b8e1299929" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 34181 } }
I20260709 13:17:40.991868  5959 consensus_queue.cc:237] T 075196757f21457696b5e4ca1e806556 P 8f11b64b1f21462ba2ae6d247817bc5d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5fa01ffe1374026ac11fcab41d7264d" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 41321 } } peers { permanent_uuid: "8f11b64b1f21462ba2ae6d247817bc5d" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 43089 } } peers { permanent_uuid: "cbbc600cb2fc4d919e1dd0b8e1299929" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 34181 } }
I20260709 13:17:40.992965  5974 leader_election.cc:290] T 0a72b395bcab4a0ab35141522c307b66 P f5fa01ffe1374026ac11fcab41d7264d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8f11b64b1f21462ba2ae6d247817bc5d (127.5.126.66:43089), cbbc600cb2fc4d919e1dd0b8e1299929 (127.5.126.67:34181)
I20260709 13:17:40.994434  5908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a72b395bcab4a0ab35141522c307b66" candidate_uuid: "f5fa01ffe1374026ac11fcab41d7264d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cbbc600cb2fc4d919e1dd0b8e1299929" is_pre_election: true
I20260709 13:17:40.994724  5834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a72b395bcab4a0ab35141522c307b66" candidate_uuid: "f5fa01ffe1374026ac11fcab41d7264d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f11b64b1f21462ba2ae6d247817bc5d" is_pre_election: true
I20260709 13:17:40.995154  5908 raft_consensus.cc:2468] T 0a72b395bcab4a0ab35141522c307b66 P cbbc600cb2fc4d919e1dd0b8e1299929 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5fa01ffe1374026ac11fcab41d7264d in term 0.
I20260709 13:17:40.996412  5723 leader_election.cc:304] T 0a72b395bcab4a0ab35141522c307b66 P f5fa01ffe1374026ac11fcab41d7264d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cbbc600cb2fc4d919e1dd0b8e1299929, f5fa01ffe1374026ac11fcab41d7264d; no voters: 
I20260709 13:17:40.996834  5953 ts_tablet_manager.cc:1434] T 8857705ce84344eb9a2b986546bb10e6 P 8f11b64b1f21462ba2ae6d247817bc5d: Time spent starting tablet: real 0.026s	user 0.004s	sys 0.004s
I20260709 13:17:40.999800  5974 raft_consensus.cc:2804] T 0a72b395bcab4a0ab35141522c307b66 P f5fa01ffe1374026ac11fcab41d7264d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:41.002839  5974 raft_consensus.cc:493] T 0a72b395bcab4a0ab35141522c307b66 P f5fa01ffe1374026ac11fcab41d7264d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:17:40.997470  5725 leader_election.cc:343] T 0a72b395bcab4a0ab35141522c307b66 P f5fa01ffe1374026ac11fcab41d7264d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8f11b64b1f21462ba2ae6d247817bc5d (127.5.126.66:43089): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:41.003697  5953 tablet_bootstrap.cc:492] T 0a72b395bcab4a0ab35141522c307b66 P 8f11b64b1f21462ba2ae6d247817bc5d: Bootstrap starting.
I20260709 13:17:41.004400  5974 raft_consensus.cc:3060] T 0a72b395bcab4a0ab35141522c307b66 P f5fa01ffe1374026ac11fcab41d7264d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:41.008965  5952 tablet_bootstrap.cc:492] T a47b6d6930154ade882793bfdf796229 P f5fa01ffe1374026ac11fcab41d7264d: No bootstrap required, opened a new log
I20260709 13:17:41.009534  5952 ts_tablet_manager.cc:1403] T a47b6d6930154ade882793bfdf796229 P f5fa01ffe1374026ac11fcab41d7264d: Time spent bootstrapping tablet: real 0.085s	user 0.016s	sys 0.017s
I20260709 13:17:41.009855  5974 raft_consensus.cc:515] T 0a72b395bcab4a0ab35141522c307b66 P f5fa01ffe1374026ac11fcab41d7264d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5fa01ffe1374026ac11fcab41d7264d" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 41321 } } peers { permanent_uuid: "8f11b64b1f21462ba2ae6d247817bc5d" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 43089 } } peers { permanent_uuid: "cbbc600cb2fc4d919e1dd0b8e1299929" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 34181 } }
I20260709 13:17:41.012265  5974 leader_election.cc:290] T 0a72b395bcab4a0ab35141522c307b66 P f5fa01ffe1374026ac11fcab41d7264d [CANDIDATE]: Term 1 election: Requested vote from peers 8f11b64b1f21462ba2ae6d247817bc5d (127.5.126.66:43089), cbbc600cb2fc4d919e1dd0b8e1299929 (127.5.126.67:34181)
I20260709 13:17:41.012768  5954 tablet_bootstrap.cc:654] T 8857705ce84344eb9a2b986546bb10e6 P cbbc600cb2fc4d919e1dd0b8e1299929: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:41.013105  5834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a72b395bcab4a0ab35141522c307b66" candidate_uuid: "f5fa01ffe1374026ac11fcab41d7264d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f11b64b1f21462ba2ae6d247817bc5d"
I20260709 13:17:41.013662  5909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a72b395bcab4a0ab35141522c307b66" candidate_uuid: "f5fa01ffe1374026ac11fcab41d7264d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cbbc600cb2fc4d919e1dd0b8e1299929"
I20260709 13:17:41.014266  5909 raft_consensus.cc:3060] T 0a72b395bcab4a0ab35141522c307b66 P cbbc600cb2fc4d919e1dd0b8e1299929 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:17:41.014585  5725 leader_election.cc:343] T 0a72b395bcab4a0ab35141522c307b66 P f5fa01ffe1374026ac11fcab41d7264d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8f11b64b1f21462ba2ae6d247817bc5d (127.5.126.66:43089): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:41.019284  5953 tablet_bootstrap.cc:654] T 0a72b395bcab4a0ab35141522c307b66 P 8f11b64b1f21462ba2ae6d247817bc5d: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:41.021337  5909 raft_consensus.cc:2468] T 0a72b395bcab4a0ab35141522c307b66 P cbbc600cb2fc4d919e1dd0b8e1299929 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5fa01ffe1374026ac11fcab41d7264d in term 1.
I20260709 13:17:41.020727  5656 catalog_manager.cc:5697] T 075196757f21457696b5e4ca1e806556 P 8f11b64b1f21462ba2ae6d247817bc5d reported cstate change: term changed from 0 to 1, leader changed from <none> to 8f11b64b1f21462ba2ae6d247817bc5d (127.5.126.66). New cstate: current_term: 1 leader_uuid: "8f11b64b1f21462ba2ae6d247817bc5d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5fa01ffe1374026ac11fcab41d7264d" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 41321 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8f11b64b1f21462ba2ae6d247817bc5d" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 43089 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cbbc600cb2fc4d919e1dd0b8e1299929" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 34181 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:41.023067  5723 leader_election.cc:304] T 0a72b395bcab4a0ab35141522c307b66 P f5fa01ffe1374026ac11fcab41d7264d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cbbc600cb2fc4d919e1dd0b8e1299929, f5fa01ffe1374026ac11fcab41d7264d; no voters: 8f11b64b1f21462ba2ae6d247817bc5d
I20260709 13:17:41.025404  5952 raft_consensus.cc:359] T a47b6d6930154ade882793bfdf796229 P f5fa01ffe1374026ac11fcab41d7264d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5fa01ffe1374026ac11fcab41d7264d" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 41321 } } peers { permanent_uuid: "8f11b64b1f21462ba2ae6d247817bc5d" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 43089 } } peers { permanent_uuid: "cbbc600cb2fc4d919e1dd0b8e1299929" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 34181 } }
I20260709 13:17:41.026073  5952 raft_consensus.cc:385] T a47b6d6930154ade882793bfdf796229 P f5fa01ffe1374026ac11fcab41d7264d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:41.026335  5952 raft_consensus.cc:740] T a47b6d6930154ade882793bfdf796229 P f5fa01ffe1374026ac11fcab41d7264d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f5fa01ffe1374026ac11fcab41d7264d, State: Initialized, Role: FOLLOWER
I20260709 13:17:41.027107  5952 consensus_queue.cc:260] T a47b6d6930154ade882793bfdf796229 P f5fa01ffe1374026ac11fcab41d7264d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5fa01ffe1374026ac11fcab41d7264d" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 41321 } } peers { permanent_uuid: "8f11b64b1f21462ba2ae6d247817bc5d" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 43089 } } peers { permanent_uuid: "cbbc600cb2fc4d919e1dd0b8e1299929" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 34181 } }
I20260709 13:17:41.029299  5953 tablet_bootstrap.cc:492] T 0a72b395bcab4a0ab35141522c307b66 P 8f11b64b1f21462ba2ae6d247817bc5d: No bootstrap required, opened a new log
I20260709 13:17:41.029839  5953 ts_tablet_manager.cc:1403] T 0a72b395bcab4a0ab35141522c307b66 P 8f11b64b1f21462ba2ae6d247817bc5d: Time spent bootstrapping tablet: real 0.026s	user 0.006s	sys 0.006s
I20260709 13:17:41.030189  5974 raft_consensus.cc:2804] T 0a72b395bcab4a0ab35141522c307b66 P f5fa01ffe1374026ac11fcab41d7264d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:41.034437  5953 raft_consensus.cc:359] T 0a72b395bcab4a0ab35141522c307b66 P 8f11b64b1f21462ba2ae6d247817bc5d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5fa01ffe1374026ac11fcab41d7264d" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 41321 } } peers { permanent_uuid: "8f11b64b1f21462ba2ae6d247817bc5d" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 43089 } } peers { permanent_uuid: "cbbc600cb2fc4d919e1dd0b8e1299929" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 34181 } }
I20260709 13:17:41.035328  5953 raft_consensus.cc:385] T 0a72b395bcab4a0ab35141522c307b66 P 8f11b64b1f21462ba2ae6d247817bc5d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:41.035799  5953 raft_consensus.cc:740] T 0a72b395bcab4a0ab35141522c307b66 P 8f11b64b1f21462ba2ae6d247817bc5d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8f11b64b1f21462ba2ae6d247817bc5d, State: Initialized, Role: FOLLOWER
I20260709 13:17:41.038302  5954 tablet_bootstrap.cc:492] T 8857705ce84344eb9a2b986546bb10e6 P cbbc600cb2fc4d919e1dd0b8e1299929: No bootstrap required, opened a new log
I20260709 13:17:41.038784  5954 ts_tablet_manager.cc:1403] T 8857705ce84344eb9a2b986546bb10e6 P cbbc600cb2fc4d919e1dd0b8e1299929: Time spent bootstrapping tablet: real 0.056s	user 0.004s	sys 0.009s
I20260709 13:17:41.042455  5954 raft_consensus.cc:359] T 8857705ce84344eb9a2b986546bb10e6 P cbbc600cb2fc4d919e1dd0b8e1299929 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5fa01ffe1374026ac11fcab41d7264d" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 41321 } } peers { permanent_uuid: "8f11b64b1f21462ba2ae6d247817bc5d" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 43089 } } peers { permanent_uuid: "cbbc600cb2fc4d919e1dd0b8e1299929" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 34181 } }
I20260709 13:17:41.043133  5954 raft_consensus.cc:385] T 8857705ce84344eb9a2b986546bb10e6 P cbbc600cb2fc4d919e1dd0b8e1299929 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:41.043411  5954 raft_consensus.cc:740] T 8857705ce84344eb9a2b986546bb10e6 P cbbc600cb2fc4d919e1dd0b8e1299929 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cbbc600cb2fc4d919e1dd0b8e1299929, State: Initialized, Role: FOLLOWER
I20260709 13:17:41.044162  5954 consensus_queue.cc:260] T 8857705ce84344eb9a2b986546bb10e6 P cbbc600cb2fc4d919e1dd0b8e1299929 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5fa01ffe1374026ac11fcab41d7264d" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 41321 } } peers { permanent_uuid: "8f11b64b1f21462ba2ae6d247817bc5d" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 43089 } } peers { permanent_uuid: "cbbc600cb2fc4d919e1dd0b8e1299929" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 34181 } }
I20260709 13:17:41.040935  5953 consensus_queue.cc:260] T 0a72b395bcab4a0ab35141522c307b66 P 8f11b64b1f21462ba2ae6d247817bc5d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5fa01ffe1374026ac11fcab41d7264d" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 41321 } } peers { permanent_uuid: "8f11b64b1f21462ba2ae6d247817bc5d" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 43089 } } peers { permanent_uuid: "cbbc600cb2fc4d919e1dd0b8e1299929" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 34181 } }
I20260709 13:17:41.047541  5953 ts_tablet_manager.cc:1434] T 0a72b395bcab4a0ab35141522c307b66 P 8f11b64b1f21462ba2ae6d247817bc5d: Time spent starting tablet: real 0.017s	user 0.009s	sys 0.000s
I20260709 13:17:41.051363  5953 tablet_bootstrap.cc:492] T dd4693df753b48e59707726329d3b352 P 8f11b64b1f21462ba2ae6d247817bc5d: Bootstrap starting.
I20260709 13:17:41.053990  5954 ts_tablet_manager.cc:1434] T 8857705ce84344eb9a2b986546bb10e6 P cbbc600cb2fc4d919e1dd0b8e1299929: Time spent starting tablet: real 0.015s	user 0.008s	sys 0.000s
I20260709 13:17:41.060884  5953 tablet_bootstrap.cc:654] T dd4693df753b48e59707726329d3b352 P 8f11b64b1f21462ba2ae6d247817bc5d: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:41.063277  5952 ts_tablet_manager.cc:1434] T a47b6d6930154ade882793bfdf796229 P f5fa01ffe1374026ac11fcab41d7264d: Time spent starting tablet: real 0.053s	user 0.015s	sys 0.002s
I20260709 13:17:41.067906  5974 raft_consensus.cc:697] T 0a72b395bcab4a0ab35141522c307b66 P f5fa01ffe1374026ac11fcab41d7264d [term 1 LEADER]: Becoming Leader. State: Replica: f5fa01ffe1374026ac11fcab41d7264d, State: Running, Role: LEADER
I20260709 13:17:41.069075  5974 consensus_queue.cc:237] T 0a72b395bcab4a0ab35141522c307b66 P f5fa01ffe1374026ac11fcab41d7264d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5fa01ffe1374026ac11fcab41d7264d" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 41321 } } peers { permanent_uuid: "8f11b64b1f21462ba2ae6d247817bc5d" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 43089 } } peers { permanent_uuid: "cbbc600cb2fc4d919e1dd0b8e1299929" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 34181 } }
I20260709 13:17:41.073747  5953 tablet_bootstrap.cc:492] T dd4693df753b48e59707726329d3b352 P 8f11b64b1f21462ba2ae6d247817bc5d: No bootstrap required, opened a new log
I20260709 13:17:41.074267  5953 ts_tablet_manager.cc:1403] T dd4693df753b48e59707726329d3b352 P 8f11b64b1f21462ba2ae6d247817bc5d: Time spent bootstrapping tablet: real 0.023s	user 0.012s	sys 0.000s
I20260709 13:17:41.075691  5993 raft_consensus.cc:493] T a47b6d6930154ade882793bfdf796229 P cbbc600cb2fc4d919e1dd0b8e1299929 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:41.076239  5993 raft_consensus.cc:515] T a47b6d6930154ade882793bfdf796229 P cbbc600cb2fc4d919e1dd0b8e1299929 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5fa01ffe1374026ac11fcab41d7264d" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 41321 } } peers { permanent_uuid: "8f11b64b1f21462ba2ae6d247817bc5d" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 43089 } } peers { permanent_uuid: "cbbc600cb2fc4d919e1dd0b8e1299929" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 34181 } }
I20260709 13:17:41.077286  5953 raft_consensus.cc:359] T dd4693df753b48e59707726329d3b352 P 8f11b64b1f21462ba2ae6d247817bc5d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5fa01ffe1374026ac11fcab41d7264d" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 41321 } } peers { permanent_uuid: "8f11b64b1f21462ba2ae6d247817bc5d" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 43089 } } peers { permanent_uuid: "cbbc600cb2fc4d919e1dd0b8e1299929" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 34181 } }
I20260709 13:17:41.079169  5953 raft_consensus.cc:385] T dd4693df753b48e59707726329d3b352 P 8f11b64b1f21462ba2ae6d247817bc5d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:41.079592  5953 raft_consensus.cc:740] T dd4693df753b48e59707726329d3b352 P 8f11b64b1f21462ba2ae6d247817bc5d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8f11b64b1f21462ba2ae6d247817bc5d, State: Initialized, Role: FOLLOWER
I20260709 13:17:41.080139  5757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a47b6d6930154ade882793bfdf796229" candidate_uuid: "cbbc600cb2fc4d919e1dd0b8e1299929" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5fa01ffe1374026ac11fcab41d7264d" is_pre_election: true
I20260709 13:17:41.080300  5953 consensus_queue.cc:260] T dd4693df753b48e59707726329d3b352 P 8f11b64b1f21462ba2ae6d247817bc5d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5fa01ffe1374026ac11fcab41d7264d" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 41321 } } peers { permanent_uuid: "8f11b64b1f21462ba2ae6d247817bc5d" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 43089 } } peers { permanent_uuid: "cbbc600cb2fc4d919e1dd0b8e1299929" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 34181 } }
I20260709 13:17:41.080787  5757 raft_consensus.cc:2468] T a47b6d6930154ade882793bfdf796229 P f5fa01ffe1374026ac11fcab41d7264d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cbbc600cb2fc4d919e1dd0b8e1299929 in term 0.
I20260709 13:17:41.082603  5953 ts_tablet_manager.cc:1434] T dd4693df753b48e59707726329d3b352 P 8f11b64b1f21462ba2ae6d247817bc5d: Time spent starting tablet: real 0.008s	user 0.004s	sys 0.002s
I20260709 13:17:41.082015  5656 catalog_manager.cc:5697] T 0a72b395bcab4a0ab35141522c307b66 P f5fa01ffe1374026ac11fcab41d7264d reported cstate change: term changed from 0 to 1, leader changed from <none> to f5fa01ffe1374026ac11fcab41d7264d (127.5.126.65). New cstate: current_term: 1 leader_uuid: "f5fa01ffe1374026ac11fcab41d7264d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5fa01ffe1374026ac11fcab41d7264d" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 41321 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8f11b64b1f21462ba2ae6d247817bc5d" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 43089 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cbbc600cb2fc4d919e1dd0b8e1299929" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 34181 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:41.083989  5874 leader_election.cc:304] T a47b6d6930154ade882793bfdf796229 P cbbc600cb2fc4d919e1dd0b8e1299929 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cbbc600cb2fc4d919e1dd0b8e1299929, f5fa01ffe1374026ac11fcab41d7264d; no voters: 
I20260709 13:17:41.084407  5834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a47b6d6930154ade882793bfdf796229" candidate_uuid: "cbbc600cb2fc4d919e1dd0b8e1299929" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f11b64b1f21462ba2ae6d247817bc5d" is_pre_election: true
I20260709 13:17:41.084949  5991 raft_consensus.cc:2804] T a47b6d6930154ade882793bfdf796229 P cbbc600cb2fc4d919e1dd0b8e1299929 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:41.085096  5834 raft_consensus.cc:2468] T a47b6d6930154ade882793bfdf796229 P 8f11b64b1f21462ba2ae6d247817bc5d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cbbc600cb2fc4d919e1dd0b8e1299929 in term 0.
I20260709 13:17:41.085346  5991 raft_consensus.cc:493] T a47b6d6930154ade882793bfdf796229 P cbbc600cb2fc4d919e1dd0b8e1299929 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:41.085736  5991 raft_consensus.cc:3060] T a47b6d6930154ade882793bfdf796229 P cbbc600cb2fc4d919e1dd0b8e1299929 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:41.078402  5993 leader_election.cc:290] T a47b6d6930154ade882793bfdf796229 P cbbc600cb2fc4d919e1dd0b8e1299929 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f5fa01ffe1374026ac11fcab41d7264d (127.5.126.65:41321), 8f11b64b1f21462ba2ae6d247817bc5d (127.5.126.66:43089)
I20260709 13:17:41.093405  5991 raft_consensus.cc:515] T a47b6d6930154ade882793bfdf796229 P cbbc600cb2fc4d919e1dd0b8e1299929 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5fa01ffe1374026ac11fcab41d7264d" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 41321 } } peers { permanent_uuid: "8f11b64b1f21462ba2ae6d247817bc5d" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 43089 } } peers { permanent_uuid: "cbbc600cb2fc4d919e1dd0b8e1299929" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 34181 } }
I20260709 13:17:41.095670  5991 leader_election.cc:290] T a47b6d6930154ade882793bfdf796229 P cbbc600cb2fc4d919e1dd0b8e1299929 [CANDIDATE]: Term 1 election: Requested vote from peers f5fa01ffe1374026ac11fcab41d7264d (127.5.126.65:41321), 8f11b64b1f21462ba2ae6d247817bc5d (127.5.126.66:43089)
I20260709 13:17:41.098255  5834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a47b6d6930154ade882793bfdf796229" candidate_uuid: "cbbc600cb2fc4d919e1dd0b8e1299929" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f11b64b1f21462ba2ae6d247817bc5d"
I20260709 13:17:41.098973  5834 raft_consensus.cc:3060] T a47b6d6930154ade882793bfdf796229 P 8f11b64b1f21462ba2ae6d247817bc5d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:41.099249  5757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a47b6d6930154ade882793bfdf796229" candidate_uuid: "cbbc600cb2fc4d919e1dd0b8e1299929" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5fa01ffe1374026ac11fcab41d7264d"
I20260709 13:17:41.100008  5757 raft_consensus.cc:3060] T a47b6d6930154ade882793bfdf796229 P f5fa01ffe1374026ac11fcab41d7264d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:41.106436  5959 raft_consensus.cc:493] T 8857705ce84344eb9a2b986546bb10e6 P 8f11b64b1f21462ba2ae6d247817bc5d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:41.107112  5959 raft_consensus.cc:515] T 8857705ce84344eb9a2b986546bb10e6 P 8f11b64b1f21462ba2ae6d247817bc5d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5fa01ffe1374026ac11fcab41d7264d" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 41321 } } peers { permanent_uuid: "8f11b64b1f21462ba2ae6d247817bc5d" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 43089 } } peers { permanent_uuid: "cbbc600cb2fc4d919e1dd0b8e1299929" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 34181 } }
I20260709 13:17:41.108220  5834 raft_consensus.cc:2468] T a47b6d6930154ade882793bfdf796229 P 8f11b64b1f21462ba2ae6d247817bc5d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cbbc600cb2fc4d919e1dd0b8e1299929 in term 1.
I20260709 13:17:41.109365  5959 leader_election.cc:290] T 8857705ce84344eb9a2b986546bb10e6 P 8f11b64b1f21462ba2ae6d247817bc5d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f5fa01ffe1374026ac11fcab41d7264d (127.5.126.65:41321), cbbc600cb2fc4d919e1dd0b8e1299929 (127.5.126.67:34181)
I20260709 13:17:41.109406  5874 leader_election.cc:304] T a47b6d6930154ade882793bfdf796229 P cbbc600cb2fc4d919e1dd0b8e1299929 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8f11b64b1f21462ba2ae6d247817bc5d, cbbc600cb2fc4d919e1dd0b8e1299929; no voters: 
I20260709 13:17:41.111387  5908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8857705ce84344eb9a2b986546bb10e6" candidate_uuid: "8f11b64b1f21462ba2ae6d247817bc5d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cbbc600cb2fc4d919e1dd0b8e1299929" is_pre_election: true
I20260709 13:17:41.112042  5758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8857705ce84344eb9a2b986546bb10e6" candidate_uuid: "8f11b64b1f21462ba2ae6d247817bc5d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5fa01ffe1374026ac11fcab41d7264d" is_pre_election: true
I20260709 13:17:41.112193  5908 raft_consensus.cc:2468] T 8857705ce84344eb9a2b986546bb10e6 P cbbc600cb2fc4d919e1dd0b8e1299929 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8f11b64b1f21462ba2ae6d247817bc5d in term 0.
I20260709 13:17:41.112334  6011 consensus_queue.cc:1048] T c65d802300c64a8f97ec9fb13c6599db P f5fa01ffe1374026ac11fcab41d7264d [LEADER]: Connected to new peer: Peer: permanent_uuid: "cbbc600cb2fc4d919e1dd0b8e1299929" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 34181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:41.112733  5758 raft_consensus.cc:2468] T 8857705ce84344eb9a2b986546bb10e6 P f5fa01ffe1374026ac11fcab41d7264d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8f11b64b1f21462ba2ae6d247817bc5d in term 0.
I20260709 13:17:41.113564  5798 leader_election.cc:304] T 8857705ce84344eb9a2b986546bb10e6 P 8f11b64b1f21462ba2ae6d247817bc5d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8f11b64b1f21462ba2ae6d247817bc5d, cbbc600cb2fc4d919e1dd0b8e1299929; no voters: 
I20260709 13:17:41.114508  5959 raft_consensus.cc:2804] T 8857705ce84344eb9a2b986546bb10e6 P 8f11b64b1f21462ba2ae6d247817bc5d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:41.114908  5959 raft_consensus.cc:493] T 8857705ce84344eb9a2b986546bb10e6 P 8f11b64b1f21462ba2ae6d247817bc5d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:41.115314  5959 raft_consensus.cc:3060] T 8857705ce84344eb9a2b986546bb10e6 P 8f11b64b1f21462ba2ae6d247817bc5d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:41.115029  5991 raft_consensus.cc:2804] T a47b6d6930154ade882793bfdf796229 P cbbc600cb2fc4d919e1dd0b8e1299929 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:41.117089  5991 raft_consensus.cc:697] T a47b6d6930154ade882793bfdf796229 P cbbc600cb2fc4d919e1dd0b8e1299929 [term 1 LEADER]: Becoming Leader. State: Replica: cbbc600cb2fc4d919e1dd0b8e1299929, State: Running, Role: LEADER
I20260709 13:17:41.116557  6011 consensus_queue.cc:1048] T c65d802300c64a8f97ec9fb13c6599db P f5fa01ffe1374026ac11fcab41d7264d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8f11b64b1f21462ba2ae6d247817bc5d" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 43089 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:17:41.119683  5991 consensus_queue.cc:237] T a47b6d6930154ade882793bfdf796229 P cbbc600cb2fc4d919e1dd0b8e1299929 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5fa01ffe1374026ac11fcab41d7264d" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 41321 } } peers { permanent_uuid: "8f11b64b1f21462ba2ae6d247817bc5d" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 43089 } } peers { permanent_uuid: "cbbc600cb2fc4d919e1dd0b8e1299929" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 34181 } }
I20260709 13:17:41.122588  5959 raft_consensus.cc:515] T 8857705ce84344eb9a2b986546bb10e6 P 8f11b64b1f21462ba2ae6d247817bc5d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5fa01ffe1374026ac11fcab41d7264d" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 41321 } } peers { permanent_uuid: "8f11b64b1f21462ba2ae6d247817bc5d" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 43089 } } peers { permanent_uuid: "cbbc600cb2fc4d919e1dd0b8e1299929" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 34181 } }
I20260709 13:17:41.116616  5757 raft_consensus.cc:2468] T a47b6d6930154ade882793bfdf796229 P f5fa01ffe1374026ac11fcab41d7264d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cbbc600cb2fc4d919e1dd0b8e1299929 in term 1.
I20260709 13:17:41.125921  5758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8857705ce84344eb9a2b986546bb10e6" candidate_uuid: "8f11b64b1f21462ba2ae6d247817bc5d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5fa01ffe1374026ac11fcab41d7264d"
I20260709 13:17:41.126631  5758 raft_consensus.cc:3060] T 8857705ce84344eb9a2b986546bb10e6 P f5fa01ffe1374026ac11fcab41d7264d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:41.135849  5909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8857705ce84344eb9a2b986546bb10e6" candidate_uuid: "8f11b64b1f21462ba2ae6d247817bc5d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cbbc600cb2fc4d919e1dd0b8e1299929"
I20260709 13:17:41.136605  5909 raft_consensus.cc:3060] T 8857705ce84344eb9a2b986546bb10e6 P cbbc600cb2fc4d919e1dd0b8e1299929 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:41.149907  5656 catalog_manager.cc:5697] T a47b6d6930154ade882793bfdf796229 P cbbc600cb2fc4d919e1dd0b8e1299929 reported cstate change: term changed from 0 to 1, leader changed from <none> to cbbc600cb2fc4d919e1dd0b8e1299929 (127.5.126.67). New cstate: current_term: 1 leader_uuid: "cbbc600cb2fc4d919e1dd0b8e1299929" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5fa01ffe1374026ac11fcab41d7264d" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 41321 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8f11b64b1f21462ba2ae6d247817bc5d" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 43089 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cbbc600cb2fc4d919e1dd0b8e1299929" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 34181 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:41.154716  5909 raft_consensus.cc:2468] T 8857705ce84344eb9a2b986546bb10e6 P cbbc600cb2fc4d919e1dd0b8e1299929 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8f11b64b1f21462ba2ae6d247817bc5d in term 1.
I20260709 13:17:41.156111  5798 leader_election.cc:304] T 8857705ce84344eb9a2b986546bb10e6 P 8f11b64b1f21462ba2ae6d247817bc5d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8f11b64b1f21462ba2ae6d247817bc5d, cbbc600cb2fc4d919e1dd0b8e1299929; no voters: 
I20260709 13:17:41.157049  5987 raft_consensus.cc:2804] T 8857705ce84344eb9a2b986546bb10e6 P 8f11b64b1f21462ba2ae6d247817bc5d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:41.157544  5987 raft_consensus.cc:697] T 8857705ce84344eb9a2b986546bb10e6 P 8f11b64b1f21462ba2ae6d247817bc5d [term 1 LEADER]: Becoming Leader. State: Replica: 8f11b64b1f21462ba2ae6d247817bc5d, State: Running, Role: LEADER
I20260709 13:17:41.158411  5987 consensus_queue.cc:237] T 8857705ce84344eb9a2b986546bb10e6 P 8f11b64b1f21462ba2ae6d247817bc5d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5fa01ffe1374026ac11fcab41d7264d" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 41321 } } peers { permanent_uuid: "8f11b64b1f21462ba2ae6d247817bc5d" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 43089 } } peers { permanent_uuid: "cbbc600cb2fc4d919e1dd0b8e1299929" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 34181 } }
I20260709 13:17:41.165781  5758 raft_consensus.cc:2468] T 8857705ce84344eb9a2b986546bb10e6 P f5fa01ffe1374026ac11fcab41d7264d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8f11b64b1f21462ba2ae6d247817bc5d in term 1.
I20260709 13:17:41.168008  5959 leader_election.cc:290] T 8857705ce84344eb9a2b986546bb10e6 P 8f11b64b1f21462ba2ae6d247817bc5d [CANDIDATE]: Term 1 election: Requested vote from peers f5fa01ffe1374026ac11fcab41d7264d (127.5.126.65:41321), cbbc600cb2fc4d919e1dd0b8e1299929 (127.5.126.67:34181)
I20260709 13:17:41.171352  5959 raft_consensus.cc:493] T dd4693df753b48e59707726329d3b352 P 8f11b64b1f21462ba2ae6d247817bc5d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:41.171815  5959 raft_consensus.cc:515] T dd4693df753b48e59707726329d3b352 P 8f11b64b1f21462ba2ae6d247817bc5d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5fa01ffe1374026ac11fcab41d7264d" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 41321 } } peers { permanent_uuid: "8f11b64b1f21462ba2ae6d247817bc5d" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 43089 } } peers { permanent_uuid: "cbbc600cb2fc4d919e1dd0b8e1299929" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 34181 } }
I20260709 13:17:41.176806  5758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd4693df753b48e59707726329d3b352" candidate_uuid: "8f11b64b1f21462ba2ae6d247817bc5d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5fa01ffe1374026ac11fcab41d7264d" is_pre_election: true
I20260709 13:17:41.177897  5758 raft_consensus.cc:2393] T dd4693df753b48e59707726329d3b352 P f5fa01ffe1374026ac11fcab41d7264d [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8f11b64b1f21462ba2ae6d247817bc5d in current term 1: Already voted for candidate cbbc600cb2fc4d919e1dd0b8e1299929 in this term.
I20260709 13:17:41.191076  5655 catalog_manager.cc:5697] T 8857705ce84344eb9a2b986546bb10e6 P 8f11b64b1f21462ba2ae6d247817bc5d reported cstate change: term changed from 0 to 1, leader changed from <none> to 8f11b64b1f21462ba2ae6d247817bc5d (127.5.126.66). New cstate: current_term: 1 leader_uuid: "8f11b64b1f21462ba2ae6d247817bc5d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5fa01ffe1374026ac11fcab41d7264d" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 41321 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8f11b64b1f21462ba2ae6d247817bc5d" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 43089 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cbbc600cb2fc4d919e1dd0b8e1299929" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 34181 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:41.192708  5959 leader_election.cc:290] T dd4693df753b48e59707726329d3b352 P 8f11b64b1f21462ba2ae6d247817bc5d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f5fa01ffe1374026ac11fcab41d7264d (127.5.126.65:41321), cbbc600cb2fc4d919e1dd0b8e1299929 (127.5.126.67:34181)
I20260709 13:17:41.193761  5908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd4693df753b48e59707726329d3b352" candidate_uuid: "8f11b64b1f21462ba2ae6d247817bc5d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cbbc600cb2fc4d919e1dd0b8e1299929" is_pre_election: true
I20260709 13:17:41.194952  5798 leader_election.cc:304] T dd4693df753b48e59707726329d3b352 P 8f11b64b1f21462ba2ae6d247817bc5d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8f11b64b1f21462ba2ae6d247817bc5d; no voters: cbbc600cb2fc4d919e1dd0b8e1299929, f5fa01ffe1374026ac11fcab41d7264d
I20260709 13:17:41.195643  5959 raft_consensus.cc:3060] T dd4693df753b48e59707726329d3b352 P 8f11b64b1f21462ba2ae6d247817bc5d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:41.200259  5959 raft_consensus.cc:2749] T dd4693df753b48e59707726329d3b352 P 8f11b64b1f21462ba2ae6d247817bc5d [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:17:41.229660  5834 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "df80ca53941844b3b7f6df85be38b00d"
dest_uuid: "8f11b64b1f21462ba2ae6d247817bc5d"
mode: GRACEFUL
new_leader_uuid: "f5fa01ffe1374026ac11fcab41d7264d"
 from {username='slave'} at 127.0.0.1:35222
I20260709 13:17:41.230370  5834 raft_consensus.cc:606] T df80ca53941844b3b7f6df85be38b00d P 8f11b64b1f21462ba2ae6d247817bc5d [term 1 LEADER]: Received request to transfer leadership to TS f5fa01ffe1374026ac11fcab41d7264d
I20260709 13:17:41.233054  5959 consensus_queue.cc:1048] T df80ca53941844b3b7f6df85be38b00d P 8f11b64b1f21462ba2ae6d247817bc5d [LEADER]: Connected to new peer: Peer: permanent_uuid: "cbbc600cb2fc4d919e1dd0b8e1299929" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 34181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:41.245803  5991 consensus_queue.cc:1048] T dd4693df753b48e59707726329d3b352 P cbbc600cb2fc4d919e1dd0b8e1299929 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8f11b64b1f21462ba2ae6d247817bc5d" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 43089 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:17:41.260713  5987 consensus_queue.cc:1048] T df80ca53941844b3b7f6df85be38b00d P 8f11b64b1f21462ba2ae6d247817bc5d [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5fa01ffe1374026ac11fcab41d7264d" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 41321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:17:41.281195  5993 consensus_queue.cc:1048] T dd4693df753b48e59707726329d3b352 P cbbc600cb2fc4d919e1dd0b8e1299929 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5fa01ffe1374026ac11fcab41d7264d" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 41321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:41.284785  5908 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "dd4693df753b48e59707726329d3b352"
dest_uuid: "cbbc600cb2fc4d919e1dd0b8e1299929"
mode: GRACEFUL
new_leader_uuid: "f5fa01ffe1374026ac11fcab41d7264d"
 from {username='slave'} at 127.0.0.1:35328
I20260709 13:17:41.289047  5959 raft_consensus.cc:993] T df80ca53941844b3b7f6df85be38b00d P 8f11b64b1f21462ba2ae6d247817bc5d: : Instructing follower f5fa01ffe1374026ac11fcab41d7264d to start an election
I20260709 13:17:41.294387  5959 raft_consensus.cc:1081] T df80ca53941844b3b7f6df85be38b00d P 8f11b64b1f21462ba2ae6d247817bc5d [term 1 LEADER]: Signalling peer f5fa01ffe1374026ac11fcab41d7264d to start an election
I20260709 13:17:41.297281  5908 raft_consensus.cc:606] T dd4693df753b48e59707726329d3b352 P cbbc600cb2fc4d919e1dd0b8e1299929 [term 1 LEADER]: Received request to transfer leadership to TS f5fa01ffe1374026ac11fcab41d7264d
I20260709 13:17:41.297950  5758 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "df80ca53941844b3b7f6df85be38b00d"
dest_uuid: "f5fa01ffe1374026ac11fcab41d7264d"
 from {username='slave'} at 127.0.0.1:60384
I20260709 13:17:41.298801  5758 raft_consensus.cc:493] T df80ca53941844b3b7f6df85be38b00d P f5fa01ffe1374026ac11fcab41d7264d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:41.299233  5758 raft_consensus.cc:3060] T df80ca53941844b3b7f6df85be38b00d P f5fa01ffe1374026ac11fcab41d7264d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:41.301584  5987 consensus_queue.cc:1048] T 15093a816d314d35abd1195b622ad13e P 8f11b64b1f21462ba2ae6d247817bc5d [LEADER]: Connected to new peer: Peer: permanent_uuid: "cbbc600cb2fc4d919e1dd0b8e1299929" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 34181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.005s
I20260709 13:17:41.309221  5834 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "15093a816d314d35abd1195b622ad13e"
dest_uuid: "8f11b64b1f21462ba2ae6d247817bc5d"
mode: GRACEFUL
new_leader_uuid: "f5fa01ffe1374026ac11fcab41d7264d"
 from {username='slave'} at 127.0.0.1:35222
I20260709 13:17:41.309942  5834 raft_consensus.cc:606] T 15093a816d314d35abd1195b622ad13e P 8f11b64b1f21462ba2ae6d247817bc5d [term 1 LEADER]: Received request to transfer leadership to TS f5fa01ffe1374026ac11fcab41d7264d
I20260709 13:17:41.315868  5758 raft_consensus.cc:515] T df80ca53941844b3b7f6df85be38b00d P f5fa01ffe1374026ac11fcab41d7264d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbbc600cb2fc4d919e1dd0b8e1299929" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 34181 } } peers { permanent_uuid: "f5fa01ffe1374026ac11fcab41d7264d" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 41321 } } peers { permanent_uuid: "8f11b64b1f21462ba2ae6d247817bc5d" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 43089 } }
I20260709 13:17:41.318245  5758 leader_election.cc:290] T df80ca53941844b3b7f6df85be38b00d P f5fa01ffe1374026ac11fcab41d7264d [CANDIDATE]: Term 2 election: Requested vote from peers cbbc600cb2fc4d919e1dd0b8e1299929 (127.5.126.67:34181), 8f11b64b1f21462ba2ae6d247817bc5d (127.5.126.66:43089)
I20260709 13:17:41.319624  5909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df80ca53941844b3b7f6df85be38b00d" candidate_uuid: "f5fa01ffe1374026ac11fcab41d7264d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "cbbc600cb2fc4d919e1dd0b8e1299929"
I20260709 13:17:41.320367  5909 raft_consensus.cc:3060] T df80ca53941844b3b7f6df85be38b00d P cbbc600cb2fc4d919e1dd0b8e1299929 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:41.324719  5960 raft_consensus.cc:993] T dd4693df753b48e59707726329d3b352 P cbbc600cb2fc4d919e1dd0b8e1299929: : Instructing follower f5fa01ffe1374026ac11fcab41d7264d to start an election
I20260709 13:17:41.325326  5960 raft_consensus.cc:1081] T dd4693df753b48e59707726329d3b352 P cbbc600cb2fc4d919e1dd0b8e1299929 [term 1 LEADER]: Signalling peer f5fa01ffe1374026ac11fcab41d7264d to start an election
I20260709 13:17:41.328472  5834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df80ca53941844b3b7f6df85be38b00d" candidate_uuid: "f5fa01ffe1374026ac11fcab41d7264d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8f11b64b1f21462ba2ae6d247817bc5d"
I20260709 13:17:41.329228  5834 raft_consensus.cc:3055] T df80ca53941844b3b7f6df85be38b00d P 8f11b64b1f21462ba2ae6d247817bc5d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:17:41.329581  5834 raft_consensus.cc:740] T df80ca53941844b3b7f6df85be38b00d P 8f11b64b1f21462ba2ae6d247817bc5d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8f11b64b1f21462ba2ae6d247817bc5d, State: Running, Role: LEADER
I20260709 13:17:41.331763  5834 consensus_queue.cc:260] T df80ca53941844b3b7f6df85be38b00d P 8f11b64b1f21462ba2ae6d247817bc5d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbbc600cb2fc4d919e1dd0b8e1299929" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 34181 } } peers { permanent_uuid: "f5fa01ffe1374026ac11fcab41d7264d" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 41321 } } peers { permanent_uuid: "8f11b64b1f21462ba2ae6d247817bc5d" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 43089 } }
I20260709 13:17:41.338290  5758 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "dd4693df753b48e59707726329d3b352"
dest_uuid: "f5fa01ffe1374026ac11fcab41d7264d"
 from {username='slave'} at 127.0.0.1:60378
I20260709 13:17:41.339202  5758 raft_consensus.cc:493] T dd4693df753b48e59707726329d3b352 P f5fa01ffe1374026ac11fcab41d7264d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:41.339529  5834 raft_consensus.cc:3060] T df80ca53941844b3b7f6df85be38b00d P 8f11b64b1f21462ba2ae6d247817bc5d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:41.339691  5758 raft_consensus.cc:3060] T dd4693df753b48e59707726329d3b352 P f5fa01ffe1374026ac11fcab41d7264d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:41.350407  5758 raft_consensus.cc:515] T dd4693df753b48e59707726329d3b352 P f5fa01ffe1374026ac11fcab41d7264d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5fa01ffe1374026ac11fcab41d7264d" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 41321 } } peers { permanent_uuid: "8f11b64b1f21462ba2ae6d247817bc5d" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 43089 } } peers { permanent_uuid: "cbbc600cb2fc4d919e1dd0b8e1299929" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 34181 } }
I20260709 13:17:41.353811  5907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd4693df753b48e59707726329d3b352" candidate_uuid: "f5fa01ffe1374026ac11fcab41d7264d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "cbbc600cb2fc4d919e1dd0b8e1299929"
I20260709 13:17:41.354142  5835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd4693df753b48e59707726329d3b352" candidate_uuid: "f5fa01ffe1374026ac11fcab41d7264d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8f11b64b1f21462ba2ae6d247817bc5d"
I20260709 13:17:41.354413  5907 raft_consensus.cc:3055] T dd4693df753b48e59707726329d3b352 P cbbc600cb2fc4d919e1dd0b8e1299929 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:17:41.354728  5835 raft_consensus.cc:3060] T dd4693df753b48e59707726329d3b352 P 8f11b64b1f21462ba2ae6d247817bc5d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:41.354753  5907 raft_consensus.cc:740] T dd4693df753b48e59707726329d3b352 P cbbc600cb2fc4d919e1dd0b8e1299929 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: cbbc600cb2fc4d919e1dd0b8e1299929, State: Running, Role: LEADER
I20260709 13:17:41.355818  5907 consensus_queue.cc:260] T dd4693df753b48e59707726329d3b352 P cbbc600cb2fc4d919e1dd0b8e1299929 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5fa01ffe1374026ac11fcab41d7264d" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 41321 } } peers { permanent_uuid: "8f11b64b1f21462ba2ae6d247817bc5d" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 43089 } } peers { permanent_uuid: "cbbc600cb2fc4d919e1dd0b8e1299929" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 34181 } }
I20260709 13:17:41.357218  5907 raft_consensus.cc:3060] T dd4693df753b48e59707726329d3b352 P cbbc600cb2fc4d919e1dd0b8e1299929 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:41.361392  5959 consensus_queue.cc:1048] T 15093a816d314d35abd1195b622ad13e P 8f11b64b1f21462ba2ae6d247817bc5d [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5fa01ffe1374026ac11fcab41d7264d" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 41321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:41.362078  5758 leader_election.cc:290] T dd4693df753b48e59707726329d3b352 P f5fa01ffe1374026ac11fcab41d7264d [CANDIDATE]: Term 2 election: Requested vote from peers 8f11b64b1f21462ba2ae6d247817bc5d (127.5.126.66:43089), cbbc600cb2fc4d919e1dd0b8e1299929 (127.5.126.67:34181)
I20260709 13:17:41.364338  5909 raft_consensus.cc:2468] T df80ca53941844b3b7f6df85be38b00d P cbbc600cb2fc4d919e1dd0b8e1299929 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5fa01ffe1374026ac11fcab41d7264d in term 2.
I20260709 13:17:41.366052  5723 leader_election.cc:304] T df80ca53941844b3b7f6df85be38b00d P f5fa01ffe1374026ac11fcab41d7264d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cbbc600cb2fc4d919e1dd0b8e1299929, f5fa01ffe1374026ac11fcab41d7264d; no voters: 
I20260709 13:17:41.366986  6011 raft_consensus.cc:2804] T df80ca53941844b3b7f6df85be38b00d P f5fa01ffe1374026ac11fcab41d7264d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:17:41.367628  6011 raft_consensus.cc:697] T df80ca53941844b3b7f6df85be38b00d P f5fa01ffe1374026ac11fcab41d7264d [term 2 LEADER]: Becoming Leader. State: Replica: f5fa01ffe1374026ac11fcab41d7264d, State: Running, Role: LEADER
I20260709 13:17:41.366922  5835 raft_consensus.cc:2468] T dd4693df753b48e59707726329d3b352 P 8f11b64b1f21462ba2ae6d247817bc5d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5fa01ffe1374026ac11fcab41d7264d in term 2.
I20260709 13:17:41.368511  6011 consensus_queue.cc:237] T df80ca53941844b3b7f6df85be38b00d P f5fa01ffe1374026ac11fcab41d7264d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbbc600cb2fc4d919e1dd0b8e1299929" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 34181 } } peers { permanent_uuid: "f5fa01ffe1374026ac11fcab41d7264d" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 41321 } } peers { permanent_uuid: "8f11b64b1f21462ba2ae6d247817bc5d" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 43089 } }
I20260709 13:17:41.371724  5725 leader_election.cc:304] T dd4693df753b48e59707726329d3b352 P f5fa01ffe1374026ac11fcab41d7264d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8f11b64b1f21462ba2ae6d247817bc5d, f5fa01ffe1374026ac11fcab41d7264d; no voters: 
I20260709 13:17:41.372855  6010 raft_consensus.cc:2804] T dd4693df753b48e59707726329d3b352 P f5fa01ffe1374026ac11fcab41d7264d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:17:41.373451  6010 raft_consensus.cc:697] T dd4693df753b48e59707726329d3b352 P f5fa01ffe1374026ac11fcab41d7264d [term 2 LEADER]: Becoming Leader. State: Replica: f5fa01ffe1374026ac11fcab41d7264d, State: Running, Role: LEADER
I20260709 13:17:41.374366  6010 consensus_queue.cc:237] T dd4693df753b48e59707726329d3b352 P f5fa01ffe1374026ac11fcab41d7264d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5fa01ffe1374026ac11fcab41d7264d" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 41321 } } peers { permanent_uuid: "8f11b64b1f21462ba2ae6d247817bc5d" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 43089 } } peers { permanent_uuid: "cbbc600cb2fc4d919e1dd0b8e1299929" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 34181 } }
I20260709 13:17:41.382436  5834 raft_consensus.cc:2468] T df80ca53941844b3b7f6df85be38b00d P 8f11b64b1f21462ba2ae6d247817bc5d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5fa01ffe1374026ac11fcab41d7264d in term 2.
I20260709 13:17:41.390812  5907 raft_consensus.cc:2468] T dd4693df753b48e59707726329d3b352 P cbbc600cb2fc4d919e1dd0b8e1299929 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5fa01ffe1374026ac11fcab41d7264d in term 2.
I20260709 13:17:41.391084  5959 raft_consensus.cc:493] T 0a72b395bcab4a0ab35141522c307b66 P 8f11b64b1f21462ba2ae6d247817bc5d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:41.395349  5959 raft_consensus.cc:515] T 0a72b395bcab4a0ab35141522c307b66 P 8f11b64b1f21462ba2ae6d247817bc5d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5fa01ffe1374026ac11fcab41d7264d" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 41321 } } peers { permanent_uuid: "8f11b64b1f21462ba2ae6d247817bc5d" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 43089 } } peers { permanent_uuid: "cbbc600cb2fc4d919e1dd0b8e1299929" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 34181 } }
I20260709 13:17:41.395943  5758 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0a72b395bcab4a0ab35141522c307b66"
dest_uuid: "f5fa01ffe1374026ac11fcab41d7264d"
mode: GRACEFUL
new_leader_uuid: "8f11b64b1f21462ba2ae6d247817bc5d"
 from {username='slave'} at 127.0.0.1:60388
I20260709 13:17:41.396669  5758 raft_consensus.cc:606] T 0a72b395bcab4a0ab35141522c307b66 P f5fa01ffe1374026ac11fcab41d7264d [term 1 LEADER]: Received request to transfer leadership to TS 8f11b64b1f21462ba2ae6d247817bc5d
I20260709 13:17:41.397500  5959 leader_election.cc:290] T 0a72b395bcab4a0ab35141522c307b66 P 8f11b64b1f21462ba2ae6d247817bc5d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f5fa01ffe1374026ac11fcab41d7264d (127.5.126.65:41321), cbbc600cb2fc4d919e1dd0b8e1299929 (127.5.126.67:34181)
I20260709 13:17:41.399252  5986 raft_consensus.cc:993] T 15093a816d314d35abd1195b622ad13e P 8f11b64b1f21462ba2ae6d247817bc5d: : Instructing follower f5fa01ffe1374026ac11fcab41d7264d to start an election
I20260709 13:17:41.399657  5986 raft_consensus.cc:1081] T 15093a816d314d35abd1195b622ad13e P 8f11b64b1f21462ba2ae6d247817bc5d [term 1 LEADER]: Signalling peer f5fa01ffe1374026ac11fcab41d7264d to start an election
I20260709 13:17:41.401451  5760 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "15093a816d314d35abd1195b622ad13e"
dest_uuid: "f5fa01ffe1374026ac11fcab41d7264d"
 from {username='slave'} at 127.0.0.1:60384
I20260709 13:17:41.402036  5760 raft_consensus.cc:493] T 15093a816d314d35abd1195b622ad13e P f5fa01ffe1374026ac11fcab41d7264d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:41.402191  5758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a72b395bcab4a0ab35141522c307b66" candidate_uuid: "8f11b64b1f21462ba2ae6d247817bc5d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5fa01ffe1374026ac11fcab41d7264d" is_pre_election: true
I20260709 13:17:41.402441  5760 raft_consensus.cc:3060] T 15093a816d314d35abd1195b622ad13e P f5fa01ffe1374026ac11fcab41d7264d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:41.402871  5907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a72b395bcab4a0ab35141522c307b66" candidate_uuid: "8f11b64b1f21462ba2ae6d247817bc5d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cbbc600cb2fc4d919e1dd0b8e1299929" is_pre_election: true
I20260709 13:17:41.403626  5907 raft_consensus.cc:2393] T 0a72b395bcab4a0ab35141522c307b66 P cbbc600cb2fc4d919e1dd0b8e1299929 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8f11b64b1f21462ba2ae6d247817bc5d in current term 1: Already voted for candidate f5fa01ffe1374026ac11fcab41d7264d in this term.
I20260709 13:17:41.406128  5800 leader_election.cc:304] T 0a72b395bcab4a0ab35141522c307b66 P 8f11b64b1f21462ba2ae6d247817bc5d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8f11b64b1f21462ba2ae6d247817bc5d; no voters: cbbc600cb2fc4d919e1dd0b8e1299929, f5fa01ffe1374026ac11fcab41d7264d
I20260709 13:17:41.407341  5959 raft_consensus.cc:3060] T 0a72b395bcab4a0ab35141522c307b66 P 8f11b64b1f21462ba2ae6d247817bc5d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:41.409719  5760 raft_consensus.cc:515] T 15093a816d314d35abd1195b622ad13e P f5fa01ffe1374026ac11fcab41d7264d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5fa01ffe1374026ac11fcab41d7264d" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 41321 } } peers { permanent_uuid: "8f11b64b1f21462ba2ae6d247817bc5d" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 43089 } } peers { permanent_uuid: "cbbc600cb2fc4d919e1dd0b8e1299929" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 34181 } }
I20260709 13:17:41.412951  5834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15093a816d314d35abd1195b622ad13e" candidate_uuid: "f5fa01ffe1374026ac11fcab41d7264d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8f11b64b1f21462ba2ae6d247817bc5d"
I20260709 13:17:41.413558  5834 raft_consensus.cc:3055] T 15093a816d314d35abd1195b622ad13e P 8f11b64b1f21462ba2ae6d247817bc5d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:17:41.413908  5834 raft_consensus.cc:740] T 15093a816d314d35abd1195b622ad13e P 8f11b64b1f21462ba2ae6d247817bc5d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8f11b64b1f21462ba2ae6d247817bc5d, State: Running, Role: LEADER
I20260709 13:17:41.414785  5834 consensus_queue.cc:260] T 15093a816d314d35abd1195b622ad13e P 8f11b64b1f21462ba2ae6d247817bc5d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5fa01ffe1374026ac11fcab41d7264d" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 41321 } } peers { permanent_uuid: "8f11b64b1f21462ba2ae6d247817bc5d" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 43089 } } peers { permanent_uuid: "cbbc600cb2fc4d919e1dd0b8e1299929" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 34181 } }
I20260709 13:17:41.415906  5834 raft_consensus.cc:3060] T 15093a816d314d35abd1195b622ad13e P 8f11b64b1f21462ba2ae6d247817bc5d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:41.416787  5959 raft_consensus.cc:2749] T 0a72b395bcab4a0ab35141522c307b66 P 8f11b64b1f21462ba2ae6d247817bc5d [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:17:41.419565  5760 leader_election.cc:290] T 15093a816d314d35abd1195b622ad13e P f5fa01ffe1374026ac11fcab41d7264d [CANDIDATE]: Term 2 election: Requested vote from peers 8f11b64b1f21462ba2ae6d247817bc5d (127.5.126.66:43089), cbbc600cb2fc4d919e1dd0b8e1299929 (127.5.126.67:34181)
I20260709 13:17:41.420640  5907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15093a816d314d35abd1195b622ad13e" candidate_uuid: "f5fa01ffe1374026ac11fcab41d7264d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "cbbc600cb2fc4d919e1dd0b8e1299929"
I20260709 13:17:41.421429  5907 raft_consensus.cc:3060] T 15093a816d314d35abd1195b622ad13e P cbbc600cb2fc4d919e1dd0b8e1299929 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:41.422489  5656 catalog_manager.cc:5697] T dd4693df753b48e59707726329d3b352 P f5fa01ffe1374026ac11fcab41d7264d reported cstate change: term changed from 1 to 2, leader changed from cbbc600cb2fc4d919e1dd0b8e1299929 (127.5.126.67) to f5fa01ffe1374026ac11fcab41d7264d (127.5.126.65). New cstate: current_term: 2 leader_uuid: "f5fa01ffe1374026ac11fcab41d7264d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5fa01ffe1374026ac11fcab41d7264d" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 41321 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8f11b64b1f21462ba2ae6d247817bc5d" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 43089 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cbbc600cb2fc4d919e1dd0b8e1299929" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 34181 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:41.424587  5656 catalog_manager.cc:5697] T df80ca53941844b3b7f6df85be38b00d P f5fa01ffe1374026ac11fcab41d7264d reported cstate change: term changed from 1 to 2, leader changed from 8f11b64b1f21462ba2ae6d247817bc5d (127.5.126.66) to f5fa01ffe1374026ac11fcab41d7264d (127.5.126.65). New cstate: current_term: 2 leader_uuid: "f5fa01ffe1374026ac11fcab41d7264d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbbc600cb2fc4d919e1dd0b8e1299929" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 34181 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f5fa01ffe1374026ac11fcab41d7264d" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 41321 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8f11b64b1f21462ba2ae6d247817bc5d" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 43089 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:41.426824  5834 raft_consensus.cc:2468] T 15093a816d314d35abd1195b622ad13e P 8f11b64b1f21462ba2ae6d247817bc5d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5fa01ffe1374026ac11fcab41d7264d in term 2.
I20260709 13:17:41.428371  5725 leader_election.cc:304] T 15093a816d314d35abd1195b622ad13e P f5fa01ffe1374026ac11fcab41d7264d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8f11b64b1f21462ba2ae6d247817bc5d, f5fa01ffe1374026ac11fcab41d7264d; no voters: 
I20260709 13:17:41.429286  6010 raft_consensus.cc:2804] T 15093a816d314d35abd1195b622ad13e P f5fa01ffe1374026ac11fcab41d7264d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:17:41.429770  6010 raft_consensus.cc:697] T 15093a816d314d35abd1195b622ad13e P f5fa01ffe1374026ac11fcab41d7264d [term 2 LEADER]: Becoming Leader. State: Replica: f5fa01ffe1374026ac11fcab41d7264d, State: Running, Role: LEADER
I20260709 13:17:41.430667  6010 consensus_queue.cc:237] T 15093a816d314d35abd1195b622ad13e P f5fa01ffe1374026ac11fcab41d7264d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5fa01ffe1374026ac11fcab41d7264d" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 41321 } } peers { permanent_uuid: "8f11b64b1f21462ba2ae6d247817bc5d" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 43089 } } peers { permanent_uuid: "cbbc600cb2fc4d919e1dd0b8e1299929" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 34181 } }
I20260709 13:17:41.435640  5907 raft_consensus.cc:2468] T 15093a816d314d35abd1195b622ad13e P cbbc600cb2fc4d919e1dd0b8e1299929 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5fa01ffe1374026ac11fcab41d7264d in term 2.
I20260709 13:17:41.440109  5959 consensus_queue.cc:1048] T 88a110b2e3174300b97eede6e4cb29a8 P 8f11b64b1f21462ba2ae6d247817bc5d [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5fa01ffe1374026ac11fcab41d7264d" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 41321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:41.445679  5656 catalog_manager.cc:5697] T 15093a816d314d35abd1195b622ad13e P f5fa01ffe1374026ac11fcab41d7264d reported cstate change: term changed from 1 to 2, leader changed from 8f11b64b1f21462ba2ae6d247817bc5d (127.5.126.66) to f5fa01ffe1374026ac11fcab41d7264d (127.5.126.65). New cstate: current_term: 2 leader_uuid: "f5fa01ffe1374026ac11fcab41d7264d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5fa01ffe1374026ac11fcab41d7264d" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 41321 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8f11b64b1f21462ba2ae6d247817bc5d" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 43089 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cbbc600cb2fc4d919e1dd0b8e1299929" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 34181 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:41.451565  5987 consensus_queue.cc:1048] T 88a110b2e3174300b97eede6e4cb29a8 P 8f11b64b1f21462ba2ae6d247817bc5d [LEADER]: Connected to new peer: Peer: permanent_uuid: "cbbc600cb2fc4d919e1dd0b8e1299929" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 34181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:41.462096  5986 consensus_queue.cc:1048] T 075196757f21457696b5e4ca1e806556 P 8f11b64b1f21462ba2ae6d247817bc5d [LEADER]: Connected to new peer: Peer: permanent_uuid: "cbbc600cb2fc4d919e1dd0b8e1299929" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 34181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:17:41.483985  5986 consensus_queue.cc:1048] T 075196757f21457696b5e4ca1e806556 P 8f11b64b1f21462ba2ae6d247817bc5d [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5fa01ffe1374026ac11fcab41d7264d" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 41321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:17:41.552408  6010 consensus_queue.cc:1048] T 0a72b395bcab4a0ab35141522c307b66 P f5fa01ffe1374026ac11fcab41d7264d [LEADER]: Connected to new peer: Peer: permanent_uuid: "cbbc600cb2fc4d919e1dd0b8e1299929" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 34181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:17:41.563932  5974 consensus_queue.cc:1048] T 0a72b395bcab4a0ab35141522c307b66 P f5fa01ffe1374026ac11fcab41d7264d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8f11b64b1f21462ba2ae6d247817bc5d" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 43089 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:41.572059  5974 raft_consensus.cc:993] T 0a72b395bcab4a0ab35141522c307b66 P f5fa01ffe1374026ac11fcab41d7264d: : Instructing follower 8f11b64b1f21462ba2ae6d247817bc5d to start an election
I20260709 13:17:41.572935  6010 raft_consensus.cc:1081] T 0a72b395bcab4a0ab35141522c307b66 P f5fa01ffe1374026ac11fcab41d7264d [term 1 LEADER]: Signalling peer 8f11b64b1f21462ba2ae6d247817bc5d to start an election
I20260709 13:17:41.574915  5834 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0a72b395bcab4a0ab35141522c307b66"
dest_uuid: "8f11b64b1f21462ba2ae6d247817bc5d"
 from {username='slave'} at 127.0.0.1:35212
I20260709 13:17:41.575492  5834 raft_consensus.cc:493] T 0a72b395bcab4a0ab35141522c307b66 P 8f11b64b1f21462ba2ae6d247817bc5d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:41.575857  5834 raft_consensus.cc:3060] T 0a72b395bcab4a0ab35141522c307b66 P 8f11b64b1f21462ba2ae6d247817bc5d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:41.582850  5834 raft_consensus.cc:515] T 0a72b395bcab4a0ab35141522c307b66 P 8f11b64b1f21462ba2ae6d247817bc5d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5fa01ffe1374026ac11fcab41d7264d" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 41321 } } peers { permanent_uuid: "8f11b64b1f21462ba2ae6d247817bc5d" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 43089 } } peers { permanent_uuid: "cbbc600cb2fc4d919e1dd0b8e1299929" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 34181 } }
I20260709 13:17:41.584988  5834 leader_election.cc:290] T 0a72b395bcab4a0ab35141522c307b66 P 8f11b64b1f21462ba2ae6d247817bc5d [CANDIDATE]: Term 2 election: Requested vote from peers f5fa01ffe1374026ac11fcab41d7264d (127.5.126.65:41321), cbbc600cb2fc4d919e1dd0b8e1299929 (127.5.126.67:34181)
I20260709 13:17:41.585860  5760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a72b395bcab4a0ab35141522c307b66" candidate_uuid: "8f11b64b1f21462ba2ae6d247817bc5d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f5fa01ffe1374026ac11fcab41d7264d"
I20260709 13:17:41.586536  5760 raft_consensus.cc:3055] T 0a72b395bcab4a0ab35141522c307b66 P f5fa01ffe1374026ac11fcab41d7264d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:17:41.587040  5907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a72b395bcab4a0ab35141522c307b66" candidate_uuid: "8f11b64b1f21462ba2ae6d247817bc5d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "cbbc600cb2fc4d919e1dd0b8e1299929"
I20260709 13:17:41.587265  6027 consensus_queue.cc:1048] T a47b6d6930154ade882793bfdf796229 P cbbc600cb2fc4d919e1dd0b8e1299929 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8f11b64b1f21462ba2ae6d247817bc5d" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 43089 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:41.587687  5907 raft_consensus.cc:3060] T 0a72b395bcab4a0ab35141522c307b66 P cbbc600cb2fc4d919e1dd0b8e1299929 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:41.586881  5760 raft_consensus.cc:740] T 0a72b395bcab4a0ab35141522c307b66 P f5fa01ffe1374026ac11fcab41d7264d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f5fa01ffe1374026ac11fcab41d7264d, State: Running, Role: LEADER
I20260709 13:17:41.591339  5760 consensus_queue.cc:260] T 0a72b395bcab4a0ab35141522c307b66 P f5fa01ffe1374026ac11fcab41d7264d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5fa01ffe1374026ac11fcab41d7264d" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 41321 } } peers { permanent_uuid: "8f11b64b1f21462ba2ae6d247817bc5d" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 43089 } } peers { permanent_uuid: "cbbc600cb2fc4d919e1dd0b8e1299929" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 34181 } }
I20260709 13:17:41.592739  5760 raft_consensus.cc:3060] T 0a72b395bcab4a0ab35141522c307b66 P f5fa01ffe1374026ac11fcab41d7264d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:41.594838  5907 raft_consensus.cc:2468] T 0a72b395bcab4a0ab35141522c307b66 P cbbc600cb2fc4d919e1dd0b8e1299929 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8f11b64b1f21462ba2ae6d247817bc5d in term 2.
I20260709 13:17:41.596277  5798 leader_election.cc:304] T 0a72b395bcab4a0ab35141522c307b66 P 8f11b64b1f21462ba2ae6d247817bc5d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8f11b64b1f21462ba2ae6d247817bc5d, cbbc600cb2fc4d919e1dd0b8e1299929; no voters: 
I20260709 13:17:41.597525  5986 raft_consensus.cc:2804] T 0a72b395bcab4a0ab35141522c307b66 P 8f11b64b1f21462ba2ae6d247817bc5d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:17:41.598177  5986 raft_consensus.cc:697] T 0a72b395bcab4a0ab35141522c307b66 P 8f11b64b1f21462ba2ae6d247817bc5d [term 2 LEADER]: Becoming Leader. State: Replica: 8f11b64b1f21462ba2ae6d247817bc5d, State: Running, Role: LEADER
I20260709 13:17:41.599243  5986 consensus_queue.cc:237] T 0a72b395bcab4a0ab35141522c307b66 P 8f11b64b1f21462ba2ae6d247817bc5d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5fa01ffe1374026ac11fcab41d7264d" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 41321 } } peers { permanent_uuid: "8f11b64b1f21462ba2ae6d247817bc5d" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 43089 } } peers { permanent_uuid: "cbbc600cb2fc4d919e1dd0b8e1299929" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 34181 } }
I20260709 13:17:41.601559  5760 raft_consensus.cc:2468] T 0a72b395bcab4a0ab35141522c307b66 P f5fa01ffe1374026ac11fcab41d7264d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8f11b64b1f21462ba2ae6d247817bc5d in term 2.
I20260709 13:17:41.611884  5993 consensus_queue.cc:1048] T a47b6d6930154ade882793bfdf796229 P cbbc600cb2fc4d919e1dd0b8e1299929 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5fa01ffe1374026ac11fcab41d7264d" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 41321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:41.616255  5986 consensus_queue.cc:1048] T 8857705ce84344eb9a2b986546bb10e6 P 8f11b64b1f21462ba2ae6d247817bc5d [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5fa01ffe1374026ac11fcab41d7264d" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 41321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:41.619921  5654 catalog_manager.cc:5697] T 0a72b395bcab4a0ab35141522c307b66 P 8f11b64b1f21462ba2ae6d247817bc5d reported cstate change: term changed from 1 to 2, leader changed from f5fa01ffe1374026ac11fcab41d7264d (127.5.126.65) to 8f11b64b1f21462ba2ae6d247817bc5d (127.5.126.66). New cstate: current_term: 2 leader_uuid: "8f11b64b1f21462ba2ae6d247817bc5d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5fa01ffe1374026ac11fcab41d7264d" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 41321 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8f11b64b1f21462ba2ae6d247817bc5d" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 43089 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cbbc600cb2fc4d919e1dd0b8e1299929" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 34181 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:41.640456  5986 consensus_queue.cc:1048] T 8857705ce84344eb9a2b986546bb10e6 P 8f11b64b1f21462ba2ae6d247817bc5d [LEADER]: Connected to new peer: Peer: permanent_uuid: "cbbc600cb2fc4d919e1dd0b8e1299929" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 34181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:41.764585  5907 raft_consensus.cc:1275] T dd4693df753b48e59707726329d3b352 P cbbc600cb2fc4d919e1dd0b8e1299929 [term 2 FOLLOWER]: Refusing update from remote peer f5fa01ffe1374026ac11fcab41d7264d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:41.766251  6011 consensus_queue.cc:1048] T dd4693df753b48e59707726329d3b352 P f5fa01ffe1374026ac11fcab41d7264d [LEADER]: Connected to new peer: Peer: permanent_uuid: "cbbc600cb2fc4d919e1dd0b8e1299929" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 34181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:17:41.776711  5834 raft_consensus.cc:1275] T dd4693df753b48e59707726329d3b352 P 8f11b64b1f21462ba2ae6d247817bc5d [term 2 FOLLOWER]: Refusing update from remote peer f5fa01ffe1374026ac11fcab41d7264d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:41.778472  6011 consensus_queue.cc:1048] T dd4693df753b48e59707726329d3b352 P f5fa01ffe1374026ac11fcab41d7264d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8f11b64b1f21462ba2ae6d247817bc5d" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 43089 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:41.854660  5907 raft_consensus.cc:1275] T df80ca53941844b3b7f6df85be38b00d P cbbc600cb2fc4d919e1dd0b8e1299929 [term 2 FOLLOWER]: Refusing update from remote peer f5fa01ffe1374026ac11fcab41d7264d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:41.856302  6011 consensus_queue.cc:1048] T df80ca53941844b3b7f6df85be38b00d P f5fa01ffe1374026ac11fcab41d7264d [LEADER]: Connected to new peer: Peer: permanent_uuid: "cbbc600cb2fc4d919e1dd0b8e1299929" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 34181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:41.866104  5834 raft_consensus.cc:1275] T df80ca53941844b3b7f6df85be38b00d P 8f11b64b1f21462ba2ae6d247817bc5d [term 2 FOLLOWER]: Refusing update from remote peer f5fa01ffe1374026ac11fcab41d7264d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:41.868391  5974 consensus_queue.cc:1048] T df80ca53941844b3b7f6df85be38b00d P f5fa01ffe1374026ac11fcab41d7264d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8f11b64b1f21462ba2ae6d247817bc5d" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 43089 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:41.998749  5907 raft_consensus.cc:1275] T 15093a816d314d35abd1195b622ad13e P cbbc600cb2fc4d919e1dd0b8e1299929 [term 2 FOLLOWER]: Refusing update from remote peer f5fa01ffe1374026ac11fcab41d7264d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:42.000674  5974 consensus_queue.cc:1048] T 15093a816d314d35abd1195b622ad13e P f5fa01ffe1374026ac11fcab41d7264d [LEADER]: Connected to new peer: Peer: permanent_uuid: "cbbc600cb2fc4d919e1dd0b8e1299929" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 34181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:17:42.011947  5834 raft_consensus.cc:1275] T 15093a816d314d35abd1195b622ad13e P 8f11b64b1f21462ba2ae6d247817bc5d [term 2 FOLLOWER]: Refusing update from remote peer f5fa01ffe1374026ac11fcab41d7264d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:42.014581  6011 consensus_queue.cc:1048] T 15093a816d314d35abd1195b622ad13e P f5fa01ffe1374026ac11fcab41d7264d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8f11b64b1f21462ba2ae6d247817bc5d" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 43089 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:42.116714  5907 raft_consensus.cc:1275] T 0a72b395bcab4a0ab35141522c307b66 P cbbc600cb2fc4d919e1dd0b8e1299929 [term 2 FOLLOWER]: Refusing update from remote peer 8f11b64b1f21462ba2ae6d247817bc5d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:42.118470  5959 consensus_queue.cc:1048] T 0a72b395bcab4a0ab35141522c307b66 P 8f11b64b1f21462ba2ae6d247817bc5d [LEADER]: Connected to new peer: Peer: permanent_uuid: "cbbc600cb2fc4d919e1dd0b8e1299929" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 34181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:17:42.128235  5760 raft_consensus.cc:1275] T 0a72b395bcab4a0ab35141522c307b66 P f5fa01ffe1374026ac11fcab41d7264d [term 2 FOLLOWER]: Refusing update from remote peer 8f11b64b1f21462ba2ae6d247817bc5d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:42.131337  5987 consensus_queue.cc:1048] T 0a72b395bcab4a0ab35141522c307b66 P 8f11b64b1f21462ba2ae6d247817bc5d [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5fa01ffe1374026ac11fcab41d7264d" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 41321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:17:44.447980  5625 auto_leader_rebalancer-test.cc:316] The leader distribution is 
I20260709 13:17:44.449131  5625 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:17:44.478744  5835 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8857705ce84344eb9a2b986546bb10e6"
dest_uuid: "8f11b64b1f21462ba2ae6d247817bc5d"
mode: GRACEFUL
new_leader_uuid: "cbbc600cb2fc4d919e1dd0b8e1299929"
 from {username='slave'} at 127.0.0.1:35230
I20260709 13:17:44.479351  5835 raft_consensus.cc:606] T 8857705ce84344eb9a2b986546bb10e6 P 8f11b64b1f21462ba2ae6d247817bc5d [term 1 LEADER]: Received request to transfer leadership to TS cbbc600cb2fc4d919e1dd0b8e1299929
I20260709 13:17:44.491772  5760 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "dd4693df753b48e59707726329d3b352"
dest_uuid: "f5fa01ffe1374026ac11fcab41d7264d"
mode: GRACEFUL
new_leader_uuid: "cbbc600cb2fc4d919e1dd0b8e1299929"
 from {username='slave'} at 127.0.0.1:60394
I20260709 13:17:44.492491  5760 raft_consensus.cc:606] T dd4693df753b48e59707726329d3b352 P f5fa01ffe1374026ac11fcab41d7264d [term 2 LEADER]: Received request to transfer leadership to TS cbbc600cb2fc4d919e1dd0b8e1299929
I20260709 13:17:44.493795  5625 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:17:44.494418  5625 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:17:44.759312  6045 raft_consensus.cc:993] T 8857705ce84344eb9a2b986546bb10e6 P 8f11b64b1f21462ba2ae6d247817bc5d: : Instructing follower cbbc600cb2fc4d919e1dd0b8e1299929 to start an election
I20260709 13:17:44.760700  6049 raft_consensus.cc:1081] T 8857705ce84344eb9a2b986546bb10e6 P 8f11b64b1f21462ba2ae6d247817bc5d [term 1 LEADER]: Signalling peer cbbc600cb2fc4d919e1dd0b8e1299929 to start an election
I20260709 13:17:44.762511  5907 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8857705ce84344eb9a2b986546bb10e6"
dest_uuid: "cbbc600cb2fc4d919e1dd0b8e1299929"
 from {username='slave'} at 127.0.0.1:35326
I20260709 13:17:44.763121  5907 raft_consensus.cc:493] T 8857705ce84344eb9a2b986546bb10e6 P cbbc600cb2fc4d919e1dd0b8e1299929 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:44.763432  5907 raft_consensus.cc:3060] T 8857705ce84344eb9a2b986546bb10e6 P cbbc600cb2fc4d919e1dd0b8e1299929 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:44.768148  5907 raft_consensus.cc:515] T 8857705ce84344eb9a2b986546bb10e6 P cbbc600cb2fc4d919e1dd0b8e1299929 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5fa01ffe1374026ac11fcab41d7264d" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 41321 } } peers { permanent_uuid: "8f11b64b1f21462ba2ae6d247817bc5d" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 43089 } } peers { permanent_uuid: "cbbc600cb2fc4d919e1dd0b8e1299929" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 34181 } }
I20260709 13:17:44.769816  5907 leader_election.cc:290] T 8857705ce84344eb9a2b986546bb10e6 P cbbc600cb2fc4d919e1dd0b8e1299929 [CANDIDATE]: Term 2 election: Requested vote from peers f5fa01ffe1374026ac11fcab41d7264d (127.5.126.65:41321), 8f11b64b1f21462ba2ae6d247817bc5d (127.5.126.66:43089)
I20260709 13:17:44.771116  5760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8857705ce84344eb9a2b986546bb10e6" candidate_uuid: "cbbc600cb2fc4d919e1dd0b8e1299929" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f5fa01ffe1374026ac11fcab41d7264d"
I20260709 13:17:44.771204  5835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8857705ce84344eb9a2b986546bb10e6" candidate_uuid: "cbbc600cb2fc4d919e1dd0b8e1299929" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8f11b64b1f21462ba2ae6d247817bc5d"
I20260709 13:17:44.771909  5760 raft_consensus.cc:3060] T 8857705ce84344eb9a2b986546bb10e6 P f5fa01ffe1374026ac11fcab41d7264d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:44.772107  5835 raft_consensus.cc:3055] T 8857705ce84344eb9a2b986546bb10e6 P 8f11b64b1f21462ba2ae6d247817bc5d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:17:44.772503  5835 raft_consensus.cc:740] T 8857705ce84344eb9a2b986546bb10e6 P 8f11b64b1f21462ba2ae6d247817bc5d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8f11b64b1f21462ba2ae6d247817bc5d, State: Running, Role: LEADER
I20260709 13:17:44.773249  5835 consensus_queue.cc:260] T 8857705ce84344eb9a2b986546bb10e6 P 8f11b64b1f21462ba2ae6d247817bc5d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5fa01ffe1374026ac11fcab41d7264d" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 41321 } } peers { permanent_uuid: "8f11b64b1f21462ba2ae6d247817bc5d" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 43089 } } peers { permanent_uuid: "cbbc600cb2fc4d919e1dd0b8e1299929" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 34181 } }
I20260709 13:17:44.774255  5835 raft_consensus.cc:3060] T 8857705ce84344eb9a2b986546bb10e6 P 8f11b64b1f21462ba2ae6d247817bc5d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:44.777866  5760 raft_consensus.cc:2468] T 8857705ce84344eb9a2b986546bb10e6 P f5fa01ffe1374026ac11fcab41d7264d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cbbc600cb2fc4d919e1dd0b8e1299929 in term 2.
I20260709 13:17:44.779233  5874 leader_election.cc:304] T 8857705ce84344eb9a2b986546bb10e6 P cbbc600cb2fc4d919e1dd0b8e1299929 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cbbc600cb2fc4d919e1dd0b8e1299929, f5fa01ffe1374026ac11fcab41d7264d; no voters: 
I20260709 13:17:44.780175  6043 raft_consensus.cc:2804] T 8857705ce84344eb9a2b986546bb10e6 P cbbc600cb2fc4d919e1dd0b8e1299929 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:17:44.781703  6043 raft_consensus.cc:697] T 8857705ce84344eb9a2b986546bb10e6 P cbbc600cb2fc4d919e1dd0b8e1299929 [term 2 LEADER]: Becoming Leader. State: Replica: cbbc600cb2fc4d919e1dd0b8e1299929, State: Running, Role: LEADER
I20260709 13:17:44.780197  5835 raft_consensus.cc:2468] T 8857705ce84344eb9a2b986546bb10e6 P 8f11b64b1f21462ba2ae6d247817bc5d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cbbc600cb2fc4d919e1dd0b8e1299929 in term 2.
I20260709 13:17:44.782541  6043 consensus_queue.cc:237] T 8857705ce84344eb9a2b986546bb10e6 P cbbc600cb2fc4d919e1dd0b8e1299929 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5fa01ffe1374026ac11fcab41d7264d" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 41321 } } peers { permanent_uuid: "8f11b64b1f21462ba2ae6d247817bc5d" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 43089 } } peers { permanent_uuid: "cbbc600cb2fc4d919e1dd0b8e1299929" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 34181 } }
I20260709 13:17:44.791811  5654 catalog_manager.cc:5697] T 8857705ce84344eb9a2b986546bb10e6 P cbbc600cb2fc4d919e1dd0b8e1299929 reported cstate change: term changed from 1 to 2, leader changed from 8f11b64b1f21462ba2ae6d247817bc5d (127.5.126.66) to cbbc600cb2fc4d919e1dd0b8e1299929 (127.5.126.67). New cstate: current_term: 2 leader_uuid: "cbbc600cb2fc4d919e1dd0b8e1299929" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5fa01ffe1374026ac11fcab41d7264d" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 41321 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8f11b64b1f21462ba2ae6d247817bc5d" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 43089 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cbbc600cb2fc4d919e1dd0b8e1299929" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 34181 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:44.987339  5974 raft_consensus.cc:993] T dd4693df753b48e59707726329d3b352 P f5fa01ffe1374026ac11fcab41d7264d: : Instructing follower cbbc600cb2fc4d919e1dd0b8e1299929 to start an election
I20260709 13:17:44.988088  6057 raft_consensus.cc:1081] T dd4693df753b48e59707726329d3b352 P f5fa01ffe1374026ac11fcab41d7264d [term 2 LEADER]: Signalling peer cbbc600cb2fc4d919e1dd0b8e1299929 to start an election
I20260709 13:17:44.989955  5907 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "dd4693df753b48e59707726329d3b352"
dest_uuid: "cbbc600cb2fc4d919e1dd0b8e1299929"
 from {username='slave'} at 127.0.0.1:35320
I20260709 13:17:44.990686  5907 raft_consensus.cc:493] T dd4693df753b48e59707726329d3b352 P cbbc600cb2fc4d919e1dd0b8e1299929 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:44.991899  5907 raft_consensus.cc:3060] T dd4693df753b48e59707726329d3b352 P cbbc600cb2fc4d919e1dd0b8e1299929 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:44.997095  5907 raft_consensus.cc:515] T dd4693df753b48e59707726329d3b352 P cbbc600cb2fc4d919e1dd0b8e1299929 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5fa01ffe1374026ac11fcab41d7264d" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 41321 } } peers { permanent_uuid: "8f11b64b1f21462ba2ae6d247817bc5d" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 43089 } } peers { permanent_uuid: "cbbc600cb2fc4d919e1dd0b8e1299929" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 34181 } }
I20260709 13:17:44.998713  5907 leader_election.cc:290] T dd4693df753b48e59707726329d3b352 P cbbc600cb2fc4d919e1dd0b8e1299929 [CANDIDATE]: Term 3 election: Requested vote from peers f5fa01ffe1374026ac11fcab41d7264d (127.5.126.65:41321), 8f11b64b1f21462ba2ae6d247817bc5d (127.5.126.66:43089)
I20260709 13:17:44.999681  5760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd4693df753b48e59707726329d3b352" candidate_uuid: "cbbc600cb2fc4d919e1dd0b8e1299929" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "f5fa01ffe1374026ac11fcab41d7264d"
I20260709 13:17:45.000139  5834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd4693df753b48e59707726329d3b352" candidate_uuid: "cbbc600cb2fc4d919e1dd0b8e1299929" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "8f11b64b1f21462ba2ae6d247817bc5d"
I20260709 13:17:45.000365  5760 raft_consensus.cc:3055] T dd4693df753b48e59707726329d3b352 P f5fa01ffe1374026ac11fcab41d7264d [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:17:45.000679  5834 raft_consensus.cc:3060] T dd4693df753b48e59707726329d3b352 P 8f11b64b1f21462ba2ae6d247817bc5d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:45.000692  5760 raft_consensus.cc:740] T dd4693df753b48e59707726329d3b352 P f5fa01ffe1374026ac11fcab41d7264d [term 2 LEADER]: Becoming Follower/Learner. State: Replica: f5fa01ffe1374026ac11fcab41d7264d, State: Running, Role: LEADER
I20260709 13:17:45.001634  5760 consensus_queue.cc:260] T dd4693df753b48e59707726329d3b352 P f5fa01ffe1374026ac11fcab41d7264d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5fa01ffe1374026ac11fcab41d7264d" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 41321 } } peers { permanent_uuid: "8f11b64b1f21462ba2ae6d247817bc5d" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 43089 } } peers { permanent_uuid: "cbbc600cb2fc4d919e1dd0b8e1299929" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 34181 } }
I20260709 13:17:45.002818  5760 raft_consensus.cc:3060] T dd4693df753b48e59707726329d3b352 P f5fa01ffe1374026ac11fcab41d7264d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:45.007567  5834 raft_consensus.cc:2468] T dd4693df753b48e59707726329d3b352 P 8f11b64b1f21462ba2ae6d247817bc5d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cbbc600cb2fc4d919e1dd0b8e1299929 in term 3.
I20260709 13:17:45.009204  5760 raft_consensus.cc:2468] T dd4693df753b48e59707726329d3b352 P f5fa01ffe1374026ac11fcab41d7264d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cbbc600cb2fc4d919e1dd0b8e1299929 in term 3.
I20260709 13:17:45.009092  5874 leader_election.cc:304] T dd4693df753b48e59707726329d3b352 P cbbc600cb2fc4d919e1dd0b8e1299929 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8f11b64b1f21462ba2ae6d247817bc5d, cbbc600cb2fc4d919e1dd0b8e1299929; no voters: 
I20260709 13:17:45.010046  6043 raft_consensus.cc:2804] T dd4693df753b48e59707726329d3b352 P cbbc600cb2fc4d919e1dd0b8e1299929 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:17:45.010506  6043 raft_consensus.cc:697] T dd4693df753b48e59707726329d3b352 P cbbc600cb2fc4d919e1dd0b8e1299929 [term 3 LEADER]: Becoming Leader. State: Replica: cbbc600cb2fc4d919e1dd0b8e1299929, State: Running, Role: LEADER
I20260709 13:17:45.011229  6043 consensus_queue.cc:237] T dd4693df753b48e59707726329d3b352 P cbbc600cb2fc4d919e1dd0b8e1299929 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5fa01ffe1374026ac11fcab41d7264d" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 41321 } } peers { permanent_uuid: "8f11b64b1f21462ba2ae6d247817bc5d" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 43089 } } peers { permanent_uuid: "cbbc600cb2fc4d919e1dd0b8e1299929" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 34181 } }
I20260709 13:17:45.018764  5654 catalog_manager.cc:5697] T dd4693df753b48e59707726329d3b352 P cbbc600cb2fc4d919e1dd0b8e1299929 reported cstate change: term changed from 2 to 3, leader changed from f5fa01ffe1374026ac11fcab41d7264d (127.5.126.65) to cbbc600cb2fc4d919e1dd0b8e1299929 (127.5.126.67). New cstate: current_term: 3 leader_uuid: "cbbc600cb2fc4d919e1dd0b8e1299929" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5fa01ffe1374026ac11fcab41d7264d" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 41321 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8f11b64b1f21462ba2ae6d247817bc5d" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 43089 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cbbc600cb2fc4d919e1dd0b8e1299929" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 34181 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:45.225522  5834 raft_consensus.cc:1275] T 8857705ce84344eb9a2b986546bb10e6 P 8f11b64b1f21462ba2ae6d247817bc5d [term 2 FOLLOWER]: Refusing update from remote peer cbbc600cb2fc4d919e1dd0b8e1299929: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:45.227136  6043 consensus_queue.cc:1048] T 8857705ce84344eb9a2b986546bb10e6 P cbbc600cb2fc4d919e1dd0b8e1299929 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8f11b64b1f21462ba2ae6d247817bc5d" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 43089 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:17:45.239995  5760 raft_consensus.cc:1275] T 8857705ce84344eb9a2b986546bb10e6 P f5fa01ffe1374026ac11fcab41d7264d [term 2 FOLLOWER]: Refusing update from remote peer cbbc600cb2fc4d919e1dd0b8e1299929: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:45.242262  6043 consensus_queue.cc:1048] T 8857705ce84344eb9a2b986546bb10e6 P cbbc600cb2fc4d919e1dd0b8e1299929 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5fa01ffe1374026ac11fcab41d7264d" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 41321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:17:45.462129  5835 raft_consensus.cc:1275] T dd4693df753b48e59707726329d3b352 P 8f11b64b1f21462ba2ae6d247817bc5d [term 3 FOLLOWER]: Refusing update from remote peer cbbc600cb2fc4d919e1dd0b8e1299929: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:17:45.464200  6043 consensus_queue.cc:1048] T dd4693df753b48e59707726329d3b352 P cbbc600cb2fc4d919e1dd0b8e1299929 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8f11b64b1f21462ba2ae6d247817bc5d" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 43089 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:17:45.479694  5760 raft_consensus.cc:1275] T dd4693df753b48e59707726329d3b352 P f5fa01ffe1374026ac11fcab41d7264d [term 3 FOLLOWER]: Refusing update from remote peer cbbc600cb2fc4d919e1dd0b8e1299929: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:17:45.481532  6043 consensus_queue.cc:1048] T dd4693df753b48e59707726329d3b352 P cbbc600cb2fc4d919e1dd0b8e1299929 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5fa01ffe1374026ac11fcab41d7264d" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 41321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:17:45.495281  5625 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:17:45.507372  5758 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "df80ca53941844b3b7f6df85be38b00d"
dest_uuid: "f5fa01ffe1374026ac11fcab41d7264d"
mode: GRACEFUL
new_leader_uuid: "8f11b64b1f21462ba2ae6d247817bc5d"
 from {username='slave'} at 127.0.0.1:60388
I20260709 13:17:45.508268  5758 raft_consensus.cc:606] T df80ca53941844b3b7f6df85be38b00d P f5fa01ffe1374026ac11fcab41d7264d [term 2 LEADER]: Received request to transfer leadership to TS 8f11b64b1f21462ba2ae6d247817bc5d
I20260709 13:17:45.514068  5907 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "dd4693df753b48e59707726329d3b352"
dest_uuid: "cbbc600cb2fc4d919e1dd0b8e1299929"
mode: GRACEFUL
new_leader_uuid: "8f11b64b1f21462ba2ae6d247817bc5d"
 from {username='slave'} at 127.0.0.1:35328
I20260709 13:17:45.514660  5907 raft_consensus.cc:606] T dd4693df753b48e59707726329d3b352 P cbbc600cb2fc4d919e1dd0b8e1299929 [term 3 LEADER]: Received request to transfer leadership to TS 8f11b64b1f21462ba2ae6d247817bc5d
I20260709 13:17:45.520251  5758 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "15093a816d314d35abd1195b622ad13e"
dest_uuid: "f5fa01ffe1374026ac11fcab41d7264d"
mode: GRACEFUL
new_leader_uuid: "8f11b64b1f21462ba2ae6d247817bc5d"
 from {username='slave'} at 127.0.0.1:60388
I20260709 13:17:45.520820  5758 raft_consensus.cc:606] T 15093a816d314d35abd1195b622ad13e P f5fa01ffe1374026ac11fcab41d7264d [term 2 LEADER]: Received request to transfer leadership to TS 8f11b64b1f21462ba2ae6d247817bc5d
I20260709 13:17:45.526793  5758 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c65d802300c64a8f97ec9fb13c6599db"
dest_uuid: "f5fa01ffe1374026ac11fcab41d7264d"
mode: GRACEFUL
new_leader_uuid: "8f11b64b1f21462ba2ae6d247817bc5d"
 from {username='slave'} at 127.0.0.1:60388
I20260709 13:17:45.527388  5758 raft_consensus.cc:606] T c65d802300c64a8f97ec9fb13c6599db P f5fa01ffe1374026ac11fcab41d7264d [term 1 LEADER]: Received request to transfer leadership to TS 8f11b64b1f21462ba2ae6d247817bc5d
I20260709 13:17:45.542507  5907 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8857705ce84344eb9a2b986546bb10e6"
dest_uuid: "cbbc600cb2fc4d919e1dd0b8e1299929"
mode: GRACEFUL
new_leader_uuid: "8f11b64b1f21462ba2ae6d247817bc5d"
 from {username='slave'} at 127.0.0.1:35328
I20260709 13:17:45.543155  5907 raft_consensus.cc:606] T 8857705ce84344eb9a2b986546bb10e6 P cbbc600cb2fc4d919e1dd0b8e1299929 [term 2 LEADER]: Received request to transfer leadership to TS 8f11b64b1f21462ba2ae6d247817bc5d
I20260709 13:17:45.637390  6057 raft_consensus.cc:993] T df80ca53941844b3b7f6df85be38b00d P f5fa01ffe1374026ac11fcab41d7264d: : Instructing follower 8f11b64b1f21462ba2ae6d247817bc5d to start an election
I20260709 13:17:45.637890  6057 raft_consensus.cc:1081] T df80ca53941844b3b7f6df85be38b00d P f5fa01ffe1374026ac11fcab41d7264d [term 2 LEADER]: Signalling peer 8f11b64b1f21462ba2ae6d247817bc5d to start an election
I20260709 13:17:45.639642  5835 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "df80ca53941844b3b7f6df85be38b00d"
dest_uuid: "8f11b64b1f21462ba2ae6d247817bc5d"
 from {username='slave'} at 127.0.0.1:35212
I20260709 13:17:45.640266  5835 raft_consensus.cc:493] T df80ca53941844b3b7f6df85be38b00d P 8f11b64b1f21462ba2ae6d247817bc5d [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:45.640650  5835 raft_consensus.cc:3060] T df80ca53941844b3b7f6df85be38b00d P 8f11b64b1f21462ba2ae6d247817bc5d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:45.645937  5835 raft_consensus.cc:515] T df80ca53941844b3b7f6df85be38b00d P 8f11b64b1f21462ba2ae6d247817bc5d [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbbc600cb2fc4d919e1dd0b8e1299929" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 34181 } } peers { permanent_uuid: "f5fa01ffe1374026ac11fcab41d7264d" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 41321 } } peers { permanent_uuid: "8f11b64b1f21462ba2ae6d247817bc5d" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 43089 } }
I20260709 13:17:45.647826  5835 leader_election.cc:290] T df80ca53941844b3b7f6df85be38b00d P 8f11b64b1f21462ba2ae6d247817bc5d [CANDIDATE]: Term 3 election: Requested vote from peers cbbc600cb2fc4d919e1dd0b8e1299929 (127.5.126.67:34181), f5fa01ffe1374026ac11fcab41d7264d (127.5.126.65:41321)
I20260709 13:17:45.648784  5907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df80ca53941844b3b7f6df85be38b00d" candidate_uuid: "8f11b64b1f21462ba2ae6d247817bc5d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "cbbc600cb2fc4d919e1dd0b8e1299929"
I20260709 13:17:45.649115  5758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df80ca53941844b3b7f6df85be38b00d" candidate_uuid: "8f11b64b1f21462ba2ae6d247817bc5d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "f5fa01ffe1374026ac11fcab41d7264d"
I20260709 13:17:45.649384  5907 raft_consensus.cc:3060] T df80ca53941844b3b7f6df85be38b00d P cbbc600cb2fc4d919e1dd0b8e1299929 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:45.649720  5758 raft_consensus.cc:3055] T df80ca53941844b3b7f6df85be38b00d P f5fa01ffe1374026ac11fcab41d7264d [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:17:45.650030  5758 raft_consensus.cc:740] T df80ca53941844b3b7f6df85be38b00d P f5fa01ffe1374026ac11fcab41d7264d [term 2 LEADER]: Becoming Follower/Learner. State: Replica: f5fa01ffe1374026ac11fcab41d7264d, State: Running, Role: LEADER
I20260709 13:17:45.650761  5758 consensus_queue.cc:260] T df80ca53941844b3b7f6df85be38b00d P f5fa01ffe1374026ac11fcab41d7264d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbbc600cb2fc4d919e1dd0b8e1299929" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 34181 } } peers { permanent_uuid: "f5fa01ffe1374026ac11fcab41d7264d" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 41321 } } peers { permanent_uuid: "8f11b64b1f21462ba2ae6d247817bc5d" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 43089 } }
I20260709 13:17:45.651746  5758 raft_consensus.cc:3060] T df80ca53941844b3b7f6df85be38b00d P f5fa01ffe1374026ac11fcab41d7264d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:45.654510  5907 raft_consensus.cc:2468] T df80ca53941844b3b7f6df85be38b00d P cbbc600cb2fc4d919e1dd0b8e1299929 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8f11b64b1f21462ba2ae6d247817bc5d in term 3.
I20260709 13:17:45.655830  5798 leader_election.cc:304] T df80ca53941844b3b7f6df85be38b00d P 8f11b64b1f21462ba2ae6d247817bc5d [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8f11b64b1f21462ba2ae6d247817bc5d, cbbc600cb2fc4d919e1dd0b8e1299929; no voters: 
I20260709 13:17:45.656845  6049 raft_consensus.cc:2804] T df80ca53941844b3b7f6df85be38b00d P 8f11b64b1f21462ba2ae6d247817bc5d [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:17:45.657876  5758 raft_consensus.cc:2468] T df80ca53941844b3b7f6df85be38b00d P f5fa01ffe1374026ac11fcab41d7264d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8f11b64b1f21462ba2ae6d247817bc5d in term 3.
I20260709 13:17:45.658114  6049 raft_consensus.cc:697] T df80ca53941844b3b7f6df85be38b00d P 8f11b64b1f21462ba2ae6d247817bc5d [term 3 LEADER]: Becoming Leader. State: Replica: 8f11b64b1f21462ba2ae6d247817bc5d, State: Running, Role: LEADER
I20260709 13:17:45.659106  6049 consensus_queue.cc:237] T df80ca53941844b3b7f6df85be38b00d P 8f11b64b1f21462ba2ae6d247817bc5d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbbc600cb2fc4d919e1dd0b8e1299929" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 34181 } } peers { permanent_uuid: "f5fa01ffe1374026ac11fcab41d7264d" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 41321 } } peers { permanent_uuid: "8f11b64b1f21462ba2ae6d247817bc5d" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 43089 } }
I20260709 13:17:45.667094  5654 catalog_manager.cc:5697] T df80ca53941844b3b7f6df85be38b00d P 8f11b64b1f21462ba2ae6d247817bc5d reported cstate change: term changed from 2 to 3, leader changed from f5fa01ffe1374026ac11fcab41d7264d (127.5.126.65) to 8f11b64b1f21462ba2ae6d247817bc5d (127.5.126.66). New cstate: current_term: 3 leader_uuid: "8f11b64b1f21462ba2ae6d247817bc5d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbbc600cb2fc4d919e1dd0b8e1299929" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 34181 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f5fa01ffe1374026ac11fcab41d7264d" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 41321 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8f11b64b1f21462ba2ae6d247817bc5d" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 43089 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:45.685801  5974 raft_consensus.cc:993] T c65d802300c64a8f97ec9fb13c6599db P f5fa01ffe1374026ac11fcab41d7264d: : Instructing follower 8f11b64b1f21462ba2ae6d247817bc5d to start an election
I20260709 13:17:45.686311  5974 raft_consensus.cc:1081] T c65d802300c64a8f97ec9fb13c6599db P f5fa01ffe1374026ac11fcab41d7264d [term 1 LEADER]: Signalling peer 8f11b64b1f21462ba2ae6d247817bc5d to start an election
I20260709 13:17:45.687995  5835 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c65d802300c64a8f97ec9fb13c6599db"
dest_uuid: "8f11b64b1f21462ba2ae6d247817bc5d"
 from {username='slave'} at 127.0.0.1:35212
I20260709 13:17:45.688673  5835 raft_consensus.cc:493] T c65d802300c64a8f97ec9fb13c6599db P 8f11b64b1f21462ba2ae6d247817bc5d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:45.688984  5835 raft_consensus.cc:3060] T c65d802300c64a8f97ec9fb13c6599db P 8f11b64b1f21462ba2ae6d247817bc5d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:45.693719  5835 raft_consensus.cc:515] T c65d802300c64a8f97ec9fb13c6599db P 8f11b64b1f21462ba2ae6d247817bc5d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5fa01ffe1374026ac11fcab41d7264d" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 41321 } } peers { permanent_uuid: "8f11b64b1f21462ba2ae6d247817bc5d" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 43089 } } peers { permanent_uuid: "cbbc600cb2fc4d919e1dd0b8e1299929" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 34181 } }
I20260709 13:17:45.696664  5835 leader_election.cc:290] T c65d802300c64a8f97ec9fb13c6599db P 8f11b64b1f21462ba2ae6d247817bc5d [CANDIDATE]: Term 2 election: Requested vote from peers f5fa01ffe1374026ac11fcab41d7264d (127.5.126.65:41321), cbbc600cb2fc4d919e1dd0b8e1299929 (127.5.126.67:34181)
I20260709 13:17:45.697431  5758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c65d802300c64a8f97ec9fb13c6599db" candidate_uuid: "8f11b64b1f21462ba2ae6d247817bc5d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f5fa01ffe1374026ac11fcab41d7264d"
I20260709 13:17:45.697431  5907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c65d802300c64a8f97ec9fb13c6599db" candidate_uuid: "8f11b64b1f21462ba2ae6d247817bc5d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "cbbc600cb2fc4d919e1dd0b8e1299929"
I20260709 13:17:45.698398  5907 raft_consensus.cc:3060] T c65d802300c64a8f97ec9fb13c6599db P cbbc600cb2fc4d919e1dd0b8e1299929 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:45.698323  5758 raft_consensus.cc:3055] T c65d802300c64a8f97ec9fb13c6599db P f5fa01ffe1374026ac11fcab41d7264d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:17:45.698943  5758 raft_consensus.cc:740] T c65d802300c64a8f97ec9fb13c6599db P f5fa01ffe1374026ac11fcab41d7264d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f5fa01ffe1374026ac11fcab41d7264d, State: Running, Role: LEADER
I20260709 13:17:45.699890  5758 consensus_queue.cc:260] T c65d802300c64a8f97ec9fb13c6599db P f5fa01ffe1374026ac11fcab41d7264d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5fa01ffe1374026ac11fcab41d7264d" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 41321 } } peers { permanent_uuid: "8f11b64b1f21462ba2ae6d247817bc5d" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 43089 } } peers { permanent_uuid: "cbbc600cb2fc4d919e1dd0b8e1299929" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 34181 } }
I20260709 13:17:45.701303  5758 raft_consensus.cc:3060] T c65d802300c64a8f97ec9fb13c6599db P f5fa01ffe1374026ac11fcab41d7264d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:45.706305  5907 raft_consensus.cc:2468] T c65d802300c64a8f97ec9fb13c6599db P cbbc600cb2fc4d919e1dd0b8e1299929 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8f11b64b1f21462ba2ae6d247817bc5d in term 2.
I20260709 13:17:45.707885  5798 leader_election.cc:304] T c65d802300c64a8f97ec9fb13c6599db P 8f11b64b1f21462ba2ae6d247817bc5d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8f11b64b1f21462ba2ae6d247817bc5d, cbbc600cb2fc4d919e1dd0b8e1299929; no voters: 
I20260709 13:17:45.708760  6049 raft_consensus.cc:2804] T c65d802300c64a8f97ec9fb13c6599db P 8f11b64b1f21462ba2ae6d247817bc5d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:17:45.708807  5758 raft_consensus.cc:2468] T c65d802300c64a8f97ec9fb13c6599db P f5fa01ffe1374026ac11fcab41d7264d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8f11b64b1f21462ba2ae6d247817bc5d in term 2.
I20260709 13:17:45.709280  6049 raft_consensus.cc:697] T c65d802300c64a8f97ec9fb13c6599db P 8f11b64b1f21462ba2ae6d247817bc5d [term 2 LEADER]: Becoming Leader. State: Replica: 8f11b64b1f21462ba2ae6d247817bc5d, State: Running, Role: LEADER
I20260709 13:17:45.710161  6049 consensus_queue.cc:237] T c65d802300c64a8f97ec9fb13c6599db P 8f11b64b1f21462ba2ae6d247817bc5d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5fa01ffe1374026ac11fcab41d7264d" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 41321 } } peers { permanent_uuid: "8f11b64b1f21462ba2ae6d247817bc5d" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 43089 } } peers { permanent_uuid: "cbbc600cb2fc4d919e1dd0b8e1299929" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 34181 } }
I20260709 13:17:45.717883  5654 catalog_manager.cc:5697] T c65d802300c64a8f97ec9fb13c6599db P 8f11b64b1f21462ba2ae6d247817bc5d reported cstate change: term changed from 1 to 2, leader changed from f5fa01ffe1374026ac11fcab41d7264d (127.5.126.65) to 8f11b64b1f21462ba2ae6d247817bc5d (127.5.126.66). New cstate: current_term: 2 leader_uuid: "8f11b64b1f21462ba2ae6d247817bc5d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5fa01ffe1374026ac11fcab41d7264d" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 41321 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8f11b64b1f21462ba2ae6d247817bc5d" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 43089 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cbbc600cb2fc4d919e1dd0b8e1299929" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 34181 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:45.847280  6043 raft_consensus.cc:993] T 8857705ce84344eb9a2b986546bb10e6 P cbbc600cb2fc4d919e1dd0b8e1299929: : Instructing follower 8f11b64b1f21462ba2ae6d247817bc5d to start an election
I20260709 13:17:45.847918  6065 raft_consensus.cc:1081] T 8857705ce84344eb9a2b986546bb10e6 P cbbc600cb2fc4d919e1dd0b8e1299929 [term 2 LEADER]: Signalling peer 8f11b64b1f21462ba2ae6d247817bc5d to start an election
I20260709 13:17:45.850158  5835 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8857705ce84344eb9a2b986546bb10e6"
dest_uuid: "8f11b64b1f21462ba2ae6d247817bc5d"
 from {username='slave'} at 127.0.0.1:35220
I20260709 13:17:45.850703  5835 raft_consensus.cc:493] T 8857705ce84344eb9a2b986546bb10e6 P 8f11b64b1f21462ba2ae6d247817bc5d [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:45.850982  5835 raft_consensus.cc:3060] T 8857705ce84344eb9a2b986546bb10e6 P 8f11b64b1f21462ba2ae6d247817bc5d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:45.855693  5835 raft_consensus.cc:515] T 8857705ce84344eb9a2b986546bb10e6 P 8f11b64b1f21462ba2ae6d247817bc5d [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5fa01ffe1374026ac11fcab41d7264d" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 41321 } } peers { permanent_uuid: "8f11b64b1f21462ba2ae6d247817bc5d" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 43089 } } peers { permanent_uuid: "cbbc600cb2fc4d919e1dd0b8e1299929" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 34181 } }
I20260709 13:17:45.857554  5835 leader_election.cc:290] T 8857705ce84344eb9a2b986546bb10e6 P 8f11b64b1f21462ba2ae6d247817bc5d [CANDIDATE]: Term 3 election: Requested vote from peers f5fa01ffe1374026ac11fcab41d7264d (127.5.126.65:41321), cbbc600cb2fc4d919e1dd0b8e1299929 (127.5.126.67:34181)
I20260709 13:17:45.858644  5758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8857705ce84344eb9a2b986546bb10e6" candidate_uuid: "8f11b64b1f21462ba2ae6d247817bc5d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "f5fa01ffe1374026ac11fcab41d7264d"
I20260709 13:17:45.859079  5907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8857705ce84344eb9a2b986546bb10e6" candidate_uuid: "8f11b64b1f21462ba2ae6d247817bc5d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "cbbc600cb2fc4d919e1dd0b8e1299929"
I20260709 13:17:45.859257  5758 raft_consensus.cc:3060] T 8857705ce84344eb9a2b986546bb10e6 P f5fa01ffe1374026ac11fcab41d7264d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:45.859645  5907 raft_consensus.cc:3055] T 8857705ce84344eb9a2b986546bb10e6 P cbbc600cb2fc4d919e1dd0b8e1299929 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:17:45.860013  5907 raft_consensus.cc:740] T 8857705ce84344eb9a2b986546bb10e6 P cbbc600cb2fc4d919e1dd0b8e1299929 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: cbbc600cb2fc4d919e1dd0b8e1299929, State: Running, Role: LEADER
I20260709 13:17:45.860800  5907 consensus_queue.cc:260] T 8857705ce84344eb9a2b986546bb10e6 P cbbc600cb2fc4d919e1dd0b8e1299929 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5fa01ffe1374026ac11fcab41d7264d" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 41321 } } peers { permanent_uuid: "8f11b64b1f21462ba2ae6d247817bc5d" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 43089 } } peers { permanent_uuid: "cbbc600cb2fc4d919e1dd0b8e1299929" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 34181 } }
I20260709 13:17:45.861898  5907 raft_consensus.cc:3060] T 8857705ce84344eb9a2b986546bb10e6 P cbbc600cb2fc4d919e1dd0b8e1299929 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:45.866603  5758 raft_consensus.cc:2468] T 8857705ce84344eb9a2b986546bb10e6 P f5fa01ffe1374026ac11fcab41d7264d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8f11b64b1f21462ba2ae6d247817bc5d in term 3.
I20260709 13:17:45.868132  5800 leader_election.cc:304] T 8857705ce84344eb9a2b986546bb10e6 P 8f11b64b1f21462ba2ae6d247817bc5d [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8f11b64b1f21462ba2ae6d247817bc5d, f5fa01ffe1374026ac11fcab41d7264d; no voters: 
I20260709 13:17:45.868763  5907 raft_consensus.cc:2468] T 8857705ce84344eb9a2b986546bb10e6 P cbbc600cb2fc4d919e1dd0b8e1299929 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8f11b64b1f21462ba2ae6d247817bc5d in term 3.
I20260709 13:17:45.870246  6049 raft_consensus.cc:2804] T 8857705ce84344eb9a2b986546bb10e6 P 8f11b64b1f21462ba2ae6d247817bc5d [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:17:45.870995  6049 raft_consensus.cc:697] T 8857705ce84344eb9a2b986546bb10e6 P 8f11b64b1f21462ba2ae6d247817bc5d [term 3 LEADER]: Becoming Leader. State: Replica: 8f11b64b1f21462ba2ae6d247817bc5d, State: Running, Role: LEADER
I20260709 13:17:45.872104  6049 consensus_queue.cc:237] T 8857705ce84344eb9a2b986546bb10e6 P 8f11b64b1f21462ba2ae6d247817bc5d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5fa01ffe1374026ac11fcab41d7264d" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 41321 } } peers { permanent_uuid: "8f11b64b1f21462ba2ae6d247817bc5d" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 43089 } } peers { permanent_uuid: "cbbc600cb2fc4d919e1dd0b8e1299929" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 34181 } }
I20260709 13:17:45.879527  5654 catalog_manager.cc:5697] T 8857705ce84344eb9a2b986546bb10e6 P 8f11b64b1f21462ba2ae6d247817bc5d reported cstate change: term changed from 2 to 3, leader changed from cbbc600cb2fc4d919e1dd0b8e1299929 (127.5.126.67) to 8f11b64b1f21462ba2ae6d247817bc5d (127.5.126.66). New cstate: current_term: 3 leader_uuid: "8f11b64b1f21462ba2ae6d247817bc5d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5fa01ffe1374026ac11fcab41d7264d" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 41321 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8f11b64b1f21462ba2ae6d247817bc5d" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 43089 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cbbc600cb2fc4d919e1dd0b8e1299929" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 34181 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:45.907316  6043 raft_consensus.cc:993] T dd4693df753b48e59707726329d3b352 P cbbc600cb2fc4d919e1dd0b8e1299929: : Instructing follower 8f11b64b1f21462ba2ae6d247817bc5d to start an election
I20260709 13:17:45.907783  6065 raft_consensus.cc:1081] T dd4693df753b48e59707726329d3b352 P cbbc600cb2fc4d919e1dd0b8e1299929 [term 3 LEADER]: Signalling peer 8f11b64b1f21462ba2ae6d247817bc5d to start an election
I20260709 13:17:45.909716  5835 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "dd4693df753b48e59707726329d3b352"
dest_uuid: "8f11b64b1f21462ba2ae6d247817bc5d"
 from {username='slave'} at 127.0.0.1:35220
I20260709 13:17:45.910331  5835 raft_consensus.cc:493] T dd4693df753b48e59707726329d3b352 P 8f11b64b1f21462ba2ae6d247817bc5d [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:45.910750  5835 raft_consensus.cc:3060] T dd4693df753b48e59707726329d3b352 P 8f11b64b1f21462ba2ae6d247817bc5d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:17:45.918052  5835 raft_consensus.cc:515] T dd4693df753b48e59707726329d3b352 P 8f11b64b1f21462ba2ae6d247817bc5d [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5fa01ffe1374026ac11fcab41d7264d" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 41321 } } peers { permanent_uuid: "8f11b64b1f21462ba2ae6d247817bc5d" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 43089 } } peers { permanent_uuid: "cbbc600cb2fc4d919e1dd0b8e1299929" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 34181 } }
I20260709 13:17:45.920324  5835 leader_election.cc:290] T dd4693df753b48e59707726329d3b352 P 8f11b64b1f21462ba2ae6d247817bc5d [CANDIDATE]: Term 4 election: Requested vote from peers f5fa01ffe1374026ac11fcab41d7264d (127.5.126.65:41321), cbbc600cb2fc4d919e1dd0b8e1299929 (127.5.126.67:34181)
I20260709 13:17:45.921396  5758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd4693df753b48e59707726329d3b352" candidate_uuid: "8f11b64b1f21462ba2ae6d247817bc5d" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "f5fa01ffe1374026ac11fcab41d7264d"
I20260709 13:17:45.921468  5907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd4693df753b48e59707726329d3b352" candidate_uuid: "8f11b64b1f21462ba2ae6d247817bc5d" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "cbbc600cb2fc4d919e1dd0b8e1299929"
I20260709 13:17:45.922096  5758 raft_consensus.cc:3060] T dd4693df753b48e59707726329d3b352 P f5fa01ffe1374026ac11fcab41d7264d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:17:45.922245  5907 raft_consensus.cc:3055] T dd4693df753b48e59707726329d3b352 P cbbc600cb2fc4d919e1dd0b8e1299929 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:17:45.923032  5907 raft_consensus.cc:740] T dd4693df753b48e59707726329d3b352 P cbbc600cb2fc4d919e1dd0b8e1299929 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: cbbc600cb2fc4d919e1dd0b8e1299929, State: Running, Role: LEADER
I20260709 13:17:45.923923  5907 consensus_queue.cc:260] T dd4693df753b48e59707726329d3b352 P cbbc600cb2fc4d919e1dd0b8e1299929 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5fa01ffe1374026ac11fcab41d7264d" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 41321 } } peers { permanent_uuid: "8f11b64b1f21462ba2ae6d247817bc5d" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 43089 } } peers { permanent_uuid: "cbbc600cb2fc4d919e1dd0b8e1299929" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 34181 } }
I20260709 13:17:45.925231  5907 raft_consensus.cc:3060] T dd4693df753b48e59707726329d3b352 P cbbc600cb2fc4d919e1dd0b8e1299929 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:17:45.928414  5758 raft_consensus.cc:2468] T dd4693df753b48e59707726329d3b352 P f5fa01ffe1374026ac11fcab41d7264d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8f11b64b1f21462ba2ae6d247817bc5d in term 4.
I20260709 13:17:45.929687  5800 leader_election.cc:304] T dd4693df753b48e59707726329d3b352 P 8f11b64b1f21462ba2ae6d247817bc5d [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8f11b64b1f21462ba2ae6d247817bc5d, f5fa01ffe1374026ac11fcab41d7264d; no voters: 
I20260709 13:17:45.930508  6049 raft_consensus.cc:2804] T dd4693df753b48e59707726329d3b352 P 8f11b64b1f21462ba2ae6d247817bc5d [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:17:45.930924  6049 raft_consensus.cc:697] T dd4693df753b48e59707726329d3b352 P 8f11b64b1f21462ba2ae6d247817bc5d [term 4 LEADER]: Becoming Leader. State: Replica: 8f11b64b1f21462ba2ae6d247817bc5d, State: Running, Role: LEADER
I20260709 13:17:45.931320  5907 raft_consensus.cc:2468] T dd4693df753b48e59707726329d3b352 P cbbc600cb2fc4d919e1dd0b8e1299929 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8f11b64b1f21462ba2ae6d247817bc5d in term 4.
I20260709 13:17:45.931674  6049 consensus_queue.cc:237] T dd4693df753b48e59707726329d3b352 P 8f11b64b1f21462ba2ae6d247817bc5d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5fa01ffe1374026ac11fcab41d7264d" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 41321 } } peers { permanent_uuid: "8f11b64b1f21462ba2ae6d247817bc5d" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 43089 } } peers { permanent_uuid: "cbbc600cb2fc4d919e1dd0b8e1299929" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 34181 } }
I20260709 13:17:45.938613  5654 catalog_manager.cc:5697] T dd4693df753b48e59707726329d3b352 P 8f11b64b1f21462ba2ae6d247817bc5d reported cstate change: term changed from 3 to 4, leader changed from cbbc600cb2fc4d919e1dd0b8e1299929 (127.5.126.67) to 8f11b64b1f21462ba2ae6d247817bc5d (127.5.126.66). New cstate: current_term: 4 leader_uuid: "8f11b64b1f21462ba2ae6d247817bc5d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5fa01ffe1374026ac11fcab41d7264d" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 41321 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8f11b64b1f21462ba2ae6d247817bc5d" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 43089 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cbbc600cb2fc4d919e1dd0b8e1299929" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 34181 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:45.989105  6057 raft_consensus.cc:993] T 15093a816d314d35abd1195b622ad13e P f5fa01ffe1374026ac11fcab41d7264d: : Instructing follower 8f11b64b1f21462ba2ae6d247817bc5d to start an election
I20260709 13:17:45.989626  5974 raft_consensus.cc:1081] T 15093a816d314d35abd1195b622ad13e P f5fa01ffe1374026ac11fcab41d7264d [term 2 LEADER]: Signalling peer 8f11b64b1f21462ba2ae6d247817bc5d to start an election
I20260709 13:17:45.991516  5835 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "15093a816d314d35abd1195b622ad13e"
dest_uuid: "8f11b64b1f21462ba2ae6d247817bc5d"
 from {username='slave'} at 127.0.0.1:35212
I20260709 13:17:45.992134  5835 raft_consensus.cc:493] T 15093a816d314d35abd1195b622ad13e P 8f11b64b1f21462ba2ae6d247817bc5d [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:45.992508  5835 raft_consensus.cc:3060] T 15093a816d314d35abd1195b622ad13e P 8f11b64b1f21462ba2ae6d247817bc5d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:45.997643  5835 raft_consensus.cc:515] T 15093a816d314d35abd1195b622ad13e P 8f11b64b1f21462ba2ae6d247817bc5d [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5fa01ffe1374026ac11fcab41d7264d" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 41321 } } peers { permanent_uuid: "8f11b64b1f21462ba2ae6d247817bc5d" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 43089 } } peers { permanent_uuid: "cbbc600cb2fc4d919e1dd0b8e1299929" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 34181 } }
I20260709 13:17:45.999382  5835 leader_election.cc:290] T 15093a816d314d35abd1195b622ad13e P 8f11b64b1f21462ba2ae6d247817bc5d [CANDIDATE]: Term 3 election: Requested vote from peers f5fa01ffe1374026ac11fcab41d7264d (127.5.126.65:41321), cbbc600cb2fc4d919e1dd0b8e1299929 (127.5.126.67:34181)
I20260709 13:17:46.000615  5907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15093a816d314d35abd1195b622ad13e" candidate_uuid: "8f11b64b1f21462ba2ae6d247817bc5d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "cbbc600cb2fc4d919e1dd0b8e1299929"
I20260709 13:17:46.000890  5758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15093a816d314d35abd1195b622ad13e" candidate_uuid: "8f11b64b1f21462ba2ae6d247817bc5d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "f5fa01ffe1374026ac11fcab41d7264d"
I20260709 13:17:46.001216  5907 raft_consensus.cc:3060] T 15093a816d314d35abd1195b622ad13e P cbbc600cb2fc4d919e1dd0b8e1299929 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:46.001394  5758 raft_consensus.cc:3055] T 15093a816d314d35abd1195b622ad13e P f5fa01ffe1374026ac11fcab41d7264d [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:17:46.001736  5758 raft_consensus.cc:740] T 15093a816d314d35abd1195b622ad13e P f5fa01ffe1374026ac11fcab41d7264d [term 2 LEADER]: Becoming Follower/Learner. State: Replica: f5fa01ffe1374026ac11fcab41d7264d, State: Running, Role: LEADER
I20260709 13:17:46.002527  5758 consensus_queue.cc:260] T 15093a816d314d35abd1195b622ad13e P f5fa01ffe1374026ac11fcab41d7264d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5fa01ffe1374026ac11fcab41d7264d" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 41321 } } peers { permanent_uuid: "8f11b64b1f21462ba2ae6d247817bc5d" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 43089 } } peers { permanent_uuid: "cbbc600cb2fc4d919e1dd0b8e1299929" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 34181 } }
I20260709 13:17:46.004086  5758 raft_consensus.cc:3060] T 15093a816d314d35abd1195b622ad13e P f5fa01ffe1374026ac11fcab41d7264d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:46.008633  5907 raft_consensus.cc:2468] T 15093a816d314d35abd1195b622ad13e P cbbc600cb2fc4d919e1dd0b8e1299929 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8f11b64b1f21462ba2ae6d247817bc5d in term 3.
I20260709 13:17:46.010149  5798 leader_election.cc:304] T 15093a816d314d35abd1195b622ad13e P 8f11b64b1f21462ba2ae6d247817bc5d [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8f11b64b1f21462ba2ae6d247817bc5d, cbbc600cb2fc4d919e1dd0b8e1299929; no voters: 
I20260709 13:17:46.010982  5758 raft_consensus.cc:2468] T 15093a816d314d35abd1195b622ad13e P f5fa01ffe1374026ac11fcab41d7264d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8f11b64b1f21462ba2ae6d247817bc5d in term 3.
I20260709 13:17:46.011251  6049 raft_consensus.cc:2804] T 15093a816d314d35abd1195b622ad13e P 8f11b64b1f21462ba2ae6d247817bc5d [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:17:46.012024  6049 raft_consensus.cc:697] T 15093a816d314d35abd1195b622ad13e P 8f11b64b1f21462ba2ae6d247817bc5d [term 3 LEADER]: Becoming Leader. State: Replica: 8f11b64b1f21462ba2ae6d247817bc5d, State: Running, Role: LEADER
I20260709 13:17:46.013109  6049 consensus_queue.cc:237] T 15093a816d314d35abd1195b622ad13e P 8f11b64b1f21462ba2ae6d247817bc5d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5fa01ffe1374026ac11fcab41d7264d" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 41321 } } peers { permanent_uuid: "8f11b64b1f21462ba2ae6d247817bc5d" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 43089 } } peers { permanent_uuid: "cbbc600cb2fc4d919e1dd0b8e1299929" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 34181 } }
I20260709 13:17:46.021194  5654 catalog_manager.cc:5697] T 15093a816d314d35abd1195b622ad13e P 8f11b64b1f21462ba2ae6d247817bc5d reported cstate change: term changed from 2 to 3, leader changed from f5fa01ffe1374026ac11fcab41d7264d (127.5.126.65) to 8f11b64b1f21462ba2ae6d247817bc5d (127.5.126.66). New cstate: current_term: 3 leader_uuid: "8f11b64b1f21462ba2ae6d247817bc5d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5fa01ffe1374026ac11fcab41d7264d" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 41321 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8f11b64b1f21462ba2ae6d247817bc5d" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 43089 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cbbc600cb2fc4d919e1dd0b8e1299929" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 34181 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:46.066890  5758 raft_consensus.cc:1275] T df80ca53941844b3b7f6df85be38b00d P f5fa01ffe1374026ac11fcab41d7264d [term 3 FOLLOWER]: Refusing update from remote peer 8f11b64b1f21462ba2ae6d247817bc5d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:17:46.068547  6049 consensus_queue.cc:1048] T df80ca53941844b3b7f6df85be38b00d P 8f11b64b1f21462ba2ae6d247817bc5d [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5fa01ffe1374026ac11fcab41d7264d" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 41321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:17:46.080829  5907 raft_consensus.cc:1275] T df80ca53941844b3b7f6df85be38b00d P cbbc600cb2fc4d919e1dd0b8e1299929 [term 3 FOLLOWER]: Refusing update from remote peer 8f11b64b1f21462ba2ae6d247817bc5d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:17:46.082327  6049 consensus_queue.cc:1048] T df80ca53941844b3b7f6df85be38b00d P 8f11b64b1f21462ba2ae6d247817bc5d [LEADER]: Connected to new peer: Peer: permanent_uuid: "cbbc600cb2fc4d919e1dd0b8e1299929" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 34181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:17:46.097455  5907 raft_consensus.cc:1275] T c65d802300c64a8f97ec9fb13c6599db P cbbc600cb2fc4d919e1dd0b8e1299929 [term 2 FOLLOWER]: Refusing update from remote peer 8f11b64b1f21462ba2ae6d247817bc5d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:46.098862  6076 consensus_queue.cc:1048] T c65d802300c64a8f97ec9fb13c6599db P 8f11b64b1f21462ba2ae6d247817bc5d [LEADER]: Connected to new peer: Peer: permanent_uuid: "cbbc600cb2fc4d919e1dd0b8e1299929" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 34181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:46.109894  5758 raft_consensus.cc:1275] T c65d802300c64a8f97ec9fb13c6599db P f5fa01ffe1374026ac11fcab41d7264d [term 2 FOLLOWER]: Refusing update from remote peer 8f11b64b1f21462ba2ae6d247817bc5d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:46.112756  6049 consensus_queue.cc:1048] T c65d802300c64a8f97ec9fb13c6599db P 8f11b64b1f21462ba2ae6d247817bc5d [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5fa01ffe1374026ac11fcab41d7264d" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 41321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:46.383585  5907 raft_consensus.cc:1275] T 8857705ce84344eb9a2b986546bb10e6 P cbbc600cb2fc4d919e1dd0b8e1299929 [term 3 FOLLOWER]: Refusing update from remote peer 8f11b64b1f21462ba2ae6d247817bc5d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:17:46.384881  6049 consensus_queue.cc:1048] T 8857705ce84344eb9a2b986546bb10e6 P 8f11b64b1f21462ba2ae6d247817bc5d [LEADER]: Connected to new peer: Peer: permanent_uuid: "cbbc600cb2fc4d919e1dd0b8e1299929" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 34181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:17:46.393536  5758 raft_consensus.cc:1275] T 8857705ce84344eb9a2b986546bb10e6 P f5fa01ffe1374026ac11fcab41d7264d [term 3 FOLLOWER]: Refusing update from remote peer 8f11b64b1f21462ba2ae6d247817bc5d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:17:46.395761  6049 consensus_queue.cc:1048] T 8857705ce84344eb9a2b986546bb10e6 P 8f11b64b1f21462ba2ae6d247817bc5d [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5fa01ffe1374026ac11fcab41d7264d" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 41321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:17:46.424947  5907 raft_consensus.cc:1275] T 15093a816d314d35abd1195b622ad13e P cbbc600cb2fc4d919e1dd0b8e1299929 [term 3 FOLLOWER]: Refusing update from remote peer 8f11b64b1f21462ba2ae6d247817bc5d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:17:46.426187  6049 consensus_queue.cc:1048] T 15093a816d314d35abd1195b622ad13e P 8f11b64b1f21462ba2ae6d247817bc5d [LEADER]: Connected to new peer: Peer: permanent_uuid: "cbbc600cb2fc4d919e1dd0b8e1299929" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 34181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:17:46.436193  5758 raft_consensus.cc:1275] T 15093a816d314d35abd1195b622ad13e P f5fa01ffe1374026ac11fcab41d7264d [term 3 FOLLOWER]: Refusing update from remote peer 8f11b64b1f21462ba2ae6d247817bc5d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:17:46.437994  6076 consensus_queue.cc:1048] T 15093a816d314d35abd1195b622ad13e P 8f11b64b1f21462ba2ae6d247817bc5d [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5fa01ffe1374026ac11fcab41d7264d" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 41321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:17:46.504737  5907 raft_consensus.cc:1275] T dd4693df753b48e59707726329d3b352 P cbbc600cb2fc4d919e1dd0b8e1299929 [term 4 FOLLOWER]: Refusing update from remote peer 8f11b64b1f21462ba2ae6d247817bc5d: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:17:46.505999  6076 consensus_queue.cc:1048] T dd4693df753b48e59707726329d3b352 P 8f11b64b1f21462ba2ae6d247817bc5d [LEADER]: Connected to new peer: Peer: permanent_uuid: "cbbc600cb2fc4d919e1dd0b8e1299929" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 34181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:17:46.516072  5758 raft_consensus.cc:1275] T dd4693df753b48e59707726329d3b352 P f5fa01ffe1374026ac11fcab41d7264d [term 4 FOLLOWER]: Refusing update from remote peer 8f11b64b1f21462ba2ae6d247817bc5d: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:17:46.518051  6067 consensus_queue.cc:1048] T dd4693df753b48e59707726329d3b352 P 8f11b64b1f21462ba2ae6d247817bc5d [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5fa01ffe1374026ac11fcab41d7264d" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 41321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:17:48.548909  5625 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:17:48.558055  5835 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "075196757f21457696b5e4ca1e806556"
dest_uuid: "8f11b64b1f21462ba2ae6d247817bc5d"
mode: GRACEFUL
new_leader_uuid: "cbbc600cb2fc4d919e1dd0b8e1299929"
 from {username='slave'} at 127.0.0.1:35230
I20260709 13:17:48.558748  5835 raft_consensus.cc:606] T 075196757f21457696b5e4ca1e806556 P 8f11b64b1f21462ba2ae6d247817bc5d [term 1 LEADER]: Received request to transfer leadership to TS cbbc600cb2fc4d919e1dd0b8e1299929
I20260709 13:17:48.561668  5835 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "15093a816d314d35abd1195b622ad13e"
dest_uuid: "8f11b64b1f21462ba2ae6d247817bc5d"
mode: GRACEFUL
new_leader_uuid: "f5fa01ffe1374026ac11fcab41d7264d"
 from {username='slave'} at 127.0.0.1:35230
I20260709 13:17:48.562150  5835 raft_consensus.cc:606] T 15093a816d314d35abd1195b622ad13e P 8f11b64b1f21462ba2ae6d247817bc5d [term 3 LEADER]: Received request to transfer leadership to TS f5fa01ffe1374026ac11fcab41d7264d
I20260709 13:17:48.564639  5835 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c65d802300c64a8f97ec9fb13c6599db"
dest_uuid: "8f11b64b1f21462ba2ae6d247817bc5d"
mode: GRACEFUL
new_leader_uuid: "f5fa01ffe1374026ac11fcab41d7264d"
 from {username='slave'} at 127.0.0.1:35230
I20260709 13:17:48.565100  5835 raft_consensus.cc:606] T c65d802300c64a8f97ec9fb13c6599db P 8f11b64b1f21462ba2ae6d247817bc5d [term 2 LEADER]: Received request to transfer leadership to TS f5fa01ffe1374026ac11fcab41d7264d
I20260709 13:17:48.567513  5835 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "dd4693df753b48e59707726329d3b352"
dest_uuid: "8f11b64b1f21462ba2ae6d247817bc5d"
mode: GRACEFUL
new_leader_uuid: "f5fa01ffe1374026ac11fcab41d7264d"
 from {username='slave'} at 127.0.0.1:35230
I20260709 13:17:48.568096  5835 raft_consensus.cc:606] T dd4693df753b48e59707726329d3b352 P 8f11b64b1f21462ba2ae6d247817bc5d [term 4 LEADER]: Received request to transfer leadership to TS f5fa01ffe1374026ac11fcab41d7264d
I20260709 13:17:48.571679  5835 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "df80ca53941844b3b7f6df85be38b00d"
dest_uuid: "8f11b64b1f21462ba2ae6d247817bc5d"
mode: GRACEFUL
new_leader_uuid: "cbbc600cb2fc4d919e1dd0b8e1299929"
 from {username='slave'} at 127.0.0.1:35230
I20260709 13:17:48.572351  5835 raft_consensus.cc:606] T df80ca53941844b3b7f6df85be38b00d P 8f11b64b1f21462ba2ae6d247817bc5d [term 3 LEADER]: Received request to transfer leadership to TS cbbc600cb2fc4d919e1dd0b8e1299929
I20260709 13:17:48.573514  5625 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:17:48.573943  5625 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:17:48.593711  6091 raft_consensus.cc:993] T dd4693df753b48e59707726329d3b352 P 8f11b64b1f21462ba2ae6d247817bc5d: : Instructing follower f5fa01ffe1374026ac11fcab41d7264d to start an election
I20260709 13:17:48.594165  6091 raft_consensus.cc:1081] T dd4693df753b48e59707726329d3b352 P 8f11b64b1f21462ba2ae6d247817bc5d [term 4 LEADER]: Signalling peer f5fa01ffe1374026ac11fcab41d7264d to start an election
I20260709 13:17:48.595793  5758 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "dd4693df753b48e59707726329d3b352"
dest_uuid: "f5fa01ffe1374026ac11fcab41d7264d"
 from {username='slave'} at 127.0.0.1:60384
I20260709 13:17:48.596388  5758 raft_consensus.cc:493] T dd4693df753b48e59707726329d3b352 P f5fa01ffe1374026ac11fcab41d7264d [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:48.596704  5758 raft_consensus.cc:3060] T dd4693df753b48e59707726329d3b352 P f5fa01ffe1374026ac11fcab41d7264d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:17:48.601646  5758 raft_consensus.cc:515] T dd4693df753b48e59707726329d3b352 P f5fa01ffe1374026ac11fcab41d7264d [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5fa01ffe1374026ac11fcab41d7264d" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 41321 } } peers { permanent_uuid: "8f11b64b1f21462ba2ae6d247817bc5d" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 43089 } } peers { permanent_uuid: "cbbc600cb2fc4d919e1dd0b8e1299929" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 34181 } }
I20260709 13:17:48.603361  5758 leader_election.cc:290] T dd4693df753b48e59707726329d3b352 P f5fa01ffe1374026ac11fcab41d7264d [CANDIDATE]: Term 5 election: Requested vote from peers 8f11b64b1f21462ba2ae6d247817bc5d (127.5.126.66:43089), cbbc600cb2fc4d919e1dd0b8e1299929 (127.5.126.67:34181)
I20260709 13:17:48.604743  5835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd4693df753b48e59707726329d3b352" candidate_uuid: "f5fa01ffe1374026ac11fcab41d7264d" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "8f11b64b1f21462ba2ae6d247817bc5d"
I20260709 13:17:48.605057  5907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd4693df753b48e59707726329d3b352" candidate_uuid: "f5fa01ffe1374026ac11fcab41d7264d" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "cbbc600cb2fc4d919e1dd0b8e1299929"
I20260709 13:17:48.605403  5835 raft_consensus.cc:3055] T dd4693df753b48e59707726329d3b352 P 8f11b64b1f21462ba2ae6d247817bc5d [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:17:48.605715  5907 raft_consensus.cc:3060] T dd4693df753b48e59707726329d3b352 P cbbc600cb2fc4d919e1dd0b8e1299929 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:17:48.605764  5835 raft_consensus.cc:740] T dd4693df753b48e59707726329d3b352 P 8f11b64b1f21462ba2ae6d247817bc5d [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 8f11b64b1f21462ba2ae6d247817bc5d, State: Running, Role: LEADER
I20260709 13:17:48.606727  5835 consensus_queue.cc:260] T dd4693df753b48e59707726329d3b352 P 8f11b64b1f21462ba2ae6d247817bc5d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5fa01ffe1374026ac11fcab41d7264d" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 41321 } } peers { permanent_uuid: "8f11b64b1f21462ba2ae6d247817bc5d" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 43089 } } peers { permanent_uuid: "cbbc600cb2fc4d919e1dd0b8e1299929" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 34181 } }
I20260709 13:17:48.607786  5835 raft_consensus.cc:3060] T dd4693df753b48e59707726329d3b352 P 8f11b64b1f21462ba2ae6d247817bc5d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:17:48.611160  5907 raft_consensus.cc:2468] T dd4693df753b48e59707726329d3b352 P cbbc600cb2fc4d919e1dd0b8e1299929 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5fa01ffe1374026ac11fcab41d7264d in term 5.
I20260709 13:17:48.612711  5723 leader_election.cc:304] T dd4693df753b48e59707726329d3b352 P f5fa01ffe1374026ac11fcab41d7264d [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cbbc600cb2fc4d919e1dd0b8e1299929, f5fa01ffe1374026ac11fcab41d7264d; no voters: 
I20260709 13:17:48.613111  5835 raft_consensus.cc:2468] T dd4693df753b48e59707726329d3b352 P 8f11b64b1f21462ba2ae6d247817bc5d [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5fa01ffe1374026ac11fcab41d7264d in term 5.
I20260709 13:17:48.614686  6093 raft_consensus.cc:2804] T dd4693df753b48e59707726329d3b352 P f5fa01ffe1374026ac11fcab41d7264d [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:17:48.615583  6093 raft_consensus.cc:697] T dd4693df753b48e59707726329d3b352 P f5fa01ffe1374026ac11fcab41d7264d [term 5 LEADER]: Becoming Leader. State: Replica: f5fa01ffe1374026ac11fcab41d7264d, State: Running, Role: LEADER
I20260709 13:17:48.616730  6093 consensus_queue.cc:237] T dd4693df753b48e59707726329d3b352 P f5fa01ffe1374026ac11fcab41d7264d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5fa01ffe1374026ac11fcab41d7264d" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 41321 } } peers { permanent_uuid: "8f11b64b1f21462ba2ae6d247817bc5d" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 43089 } } peers { permanent_uuid: "cbbc600cb2fc4d919e1dd0b8e1299929" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 34181 } }
I20260709 13:17:48.624663  5655 catalog_manager.cc:5697] T dd4693df753b48e59707726329d3b352 P f5fa01ffe1374026ac11fcab41d7264d reported cstate change: term changed from 4 to 5, leader changed from 8f11b64b1f21462ba2ae6d247817bc5d (127.5.126.66) to f5fa01ffe1374026ac11fcab41d7264d (127.5.126.65). New cstate: current_term: 5 leader_uuid: "f5fa01ffe1374026ac11fcab41d7264d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5fa01ffe1374026ac11fcab41d7264d" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 41321 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8f11b64b1f21462ba2ae6d247817bc5d" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 43089 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cbbc600cb2fc4d919e1dd0b8e1299929" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 34181 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:48.700628  6092 raft_consensus.cc:993] T c65d802300c64a8f97ec9fb13c6599db P 8f11b64b1f21462ba2ae6d247817bc5d: : Instructing follower f5fa01ffe1374026ac11fcab41d7264d to start an election
I20260709 13:17:48.701197  6092 raft_consensus.cc:1081] T c65d802300c64a8f97ec9fb13c6599db P 8f11b64b1f21462ba2ae6d247817bc5d [term 2 LEADER]: Signalling peer f5fa01ffe1374026ac11fcab41d7264d to start an election
I20260709 13:17:48.702988  5758 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c65d802300c64a8f97ec9fb13c6599db"
dest_uuid: "f5fa01ffe1374026ac11fcab41d7264d"
 from {username='slave'} at 127.0.0.1:60384
I20260709 13:17:48.703532  5758 raft_consensus.cc:493] T c65d802300c64a8f97ec9fb13c6599db P f5fa01ffe1374026ac11fcab41d7264d [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:48.703817  5758 raft_consensus.cc:3060] T c65d802300c64a8f97ec9fb13c6599db P f5fa01ffe1374026ac11fcab41d7264d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:48.708375  5758 raft_consensus.cc:515] T c65d802300c64a8f97ec9fb13c6599db P f5fa01ffe1374026ac11fcab41d7264d [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5fa01ffe1374026ac11fcab41d7264d" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 41321 } } peers { permanent_uuid: "8f11b64b1f21462ba2ae6d247817bc5d" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 43089 } } peers { permanent_uuid: "cbbc600cb2fc4d919e1dd0b8e1299929" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 34181 } }
I20260709 13:17:48.709841  5758 leader_election.cc:290] T c65d802300c64a8f97ec9fb13c6599db P f5fa01ffe1374026ac11fcab41d7264d [CANDIDATE]: Term 3 election: Requested vote from peers 8f11b64b1f21462ba2ae6d247817bc5d (127.5.126.66:43089), cbbc600cb2fc4d919e1dd0b8e1299929 (127.5.126.67:34181)
I20260709 13:17:48.711063  5835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c65d802300c64a8f97ec9fb13c6599db" candidate_uuid: "f5fa01ffe1374026ac11fcab41d7264d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "8f11b64b1f21462ba2ae6d247817bc5d"
I20260709 13:17:48.711063  5907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c65d802300c64a8f97ec9fb13c6599db" candidate_uuid: "f5fa01ffe1374026ac11fcab41d7264d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "cbbc600cb2fc4d919e1dd0b8e1299929"
I20260709 13:17:48.711946  5907 raft_consensus.cc:3060] T c65d802300c64a8f97ec9fb13c6599db P cbbc600cb2fc4d919e1dd0b8e1299929 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:48.711918  5835 raft_consensus.cc:3055] T c65d802300c64a8f97ec9fb13c6599db P 8f11b64b1f21462ba2ae6d247817bc5d [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:17:48.712518  5835 raft_consensus.cc:740] T c65d802300c64a8f97ec9fb13c6599db P 8f11b64b1f21462ba2ae6d247817bc5d [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 8f11b64b1f21462ba2ae6d247817bc5d, State: Running, Role: LEADER
I20260709 13:17:48.713431  5835 consensus_queue.cc:260] T c65d802300c64a8f97ec9fb13c6599db P 8f11b64b1f21462ba2ae6d247817bc5d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5fa01ffe1374026ac11fcab41d7264d" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 41321 } } peers { permanent_uuid: "8f11b64b1f21462ba2ae6d247817bc5d" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 43089 } } peers { permanent_uuid: "cbbc600cb2fc4d919e1dd0b8e1299929" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 34181 } }
I20260709 13:17:48.714708  5835 raft_consensus.cc:3060] T c65d802300c64a8f97ec9fb13c6599db P 8f11b64b1f21462ba2ae6d247817bc5d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:48.719691  5907 raft_consensus.cc:2468] T c65d802300c64a8f97ec9fb13c6599db P cbbc600cb2fc4d919e1dd0b8e1299929 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5fa01ffe1374026ac11fcab41d7264d in term 3.
I20260709 13:17:48.721341  5723 leader_election.cc:304] T c65d802300c64a8f97ec9fb13c6599db P f5fa01ffe1374026ac11fcab41d7264d [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cbbc600cb2fc4d919e1dd0b8e1299929, f5fa01ffe1374026ac11fcab41d7264d; no voters: 
I20260709 13:17:48.722321  5835 raft_consensus.cc:2468] T c65d802300c64a8f97ec9fb13c6599db P 8f11b64b1f21462ba2ae6d247817bc5d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5fa01ffe1374026ac11fcab41d7264d in term 3.
I20260709 13:17:48.722440  6093 raft_consensus.cc:2804] T c65d802300c64a8f97ec9fb13c6599db P f5fa01ffe1374026ac11fcab41d7264d [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:17:48.723057  6093 raft_consensus.cc:697] T c65d802300c64a8f97ec9fb13c6599db P f5fa01ffe1374026ac11fcab41d7264d [term 3 LEADER]: Becoming Leader. State: Replica: f5fa01ffe1374026ac11fcab41d7264d, State: Running, Role: LEADER
I20260709 13:17:48.723888  6093 consensus_queue.cc:237] T c65d802300c64a8f97ec9fb13c6599db P f5fa01ffe1374026ac11fcab41d7264d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5fa01ffe1374026ac11fcab41d7264d" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 41321 } } peers { permanent_uuid: "8f11b64b1f21462ba2ae6d247817bc5d" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 43089 } } peers { permanent_uuid: "cbbc600cb2fc4d919e1dd0b8e1299929" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 34181 } }
I20260709 13:17:48.731083  5655 catalog_manager.cc:5697] T c65d802300c64a8f97ec9fb13c6599db P f5fa01ffe1374026ac11fcab41d7264d reported cstate change: term changed from 2 to 3, leader changed from 8f11b64b1f21462ba2ae6d247817bc5d (127.5.126.66) to f5fa01ffe1374026ac11fcab41d7264d (127.5.126.65). New cstate: current_term: 3 leader_uuid: "f5fa01ffe1374026ac11fcab41d7264d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5fa01ffe1374026ac11fcab41d7264d" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 41321 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8f11b64b1f21462ba2ae6d247817bc5d" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 43089 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cbbc600cb2fc4d919e1dd0b8e1299929" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 34181 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:48.749080  6091 raft_consensus.cc:993] T 075196757f21457696b5e4ca1e806556 P 8f11b64b1f21462ba2ae6d247817bc5d: : Instructing follower cbbc600cb2fc4d919e1dd0b8e1299929 to start an election
I20260709 13:17:48.749598  6092 raft_consensus.cc:1081] T 075196757f21457696b5e4ca1e806556 P 8f11b64b1f21462ba2ae6d247817bc5d [term 1 LEADER]: Signalling peer cbbc600cb2fc4d919e1dd0b8e1299929 to start an election
I20260709 13:17:48.751271  5907 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "075196757f21457696b5e4ca1e806556"
dest_uuid: "cbbc600cb2fc4d919e1dd0b8e1299929"
 from {username='slave'} at 127.0.0.1:35326
I20260709 13:17:48.751739  5907 raft_consensus.cc:493] T 075196757f21457696b5e4ca1e806556 P cbbc600cb2fc4d919e1dd0b8e1299929 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:48.751991  5907 raft_consensus.cc:3060] T 075196757f21457696b5e4ca1e806556 P cbbc600cb2fc4d919e1dd0b8e1299929 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:48.756516  5907 raft_consensus.cc:515] T 075196757f21457696b5e4ca1e806556 P cbbc600cb2fc4d919e1dd0b8e1299929 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5fa01ffe1374026ac11fcab41d7264d" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 41321 } } peers { permanent_uuid: "8f11b64b1f21462ba2ae6d247817bc5d" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 43089 } } peers { permanent_uuid: "cbbc600cb2fc4d919e1dd0b8e1299929" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 34181 } }
I20260709 13:17:48.758358  5907 leader_election.cc:290] T 075196757f21457696b5e4ca1e806556 P cbbc600cb2fc4d919e1dd0b8e1299929 [CANDIDATE]: Term 2 election: Requested vote from peers f5fa01ffe1374026ac11fcab41d7264d (127.5.126.65:41321), 8f11b64b1f21462ba2ae6d247817bc5d (127.5.126.66:43089)
I20260709 13:17:48.759399  5758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "075196757f21457696b5e4ca1e806556" candidate_uuid: "cbbc600cb2fc4d919e1dd0b8e1299929" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f5fa01ffe1374026ac11fcab41d7264d"
I20260709 13:17:48.759905  5758 raft_consensus.cc:3060] T 075196757f21457696b5e4ca1e806556 P f5fa01ffe1374026ac11fcab41d7264d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:48.759968  5835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "075196757f21457696b5e4ca1e806556" candidate_uuid: "cbbc600cb2fc4d919e1dd0b8e1299929" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8f11b64b1f21462ba2ae6d247817bc5d"
I20260709 13:17:48.760682  5835 raft_consensus.cc:3055] T 075196757f21457696b5e4ca1e806556 P 8f11b64b1f21462ba2ae6d247817bc5d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:17:48.760962  5835 raft_consensus.cc:740] T 075196757f21457696b5e4ca1e806556 P 8f11b64b1f21462ba2ae6d247817bc5d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8f11b64b1f21462ba2ae6d247817bc5d, State: Running, Role: LEADER
I20260709 13:17:48.761682  5835 consensus_queue.cc:260] T 075196757f21457696b5e4ca1e806556 P 8f11b64b1f21462ba2ae6d247817bc5d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5fa01ffe1374026ac11fcab41d7264d" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 41321 } } peers { permanent_uuid: "8f11b64b1f21462ba2ae6d247817bc5d" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 43089 } } peers { permanent_uuid: "cbbc600cb2fc4d919e1dd0b8e1299929" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 34181 } }
I20260709 13:17:48.762663  5835 raft_consensus.cc:3060] T 075196757f21457696b5e4ca1e806556 P 8f11b64b1f21462ba2ae6d247817bc5d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:48.765280  5758 raft_consensus.cc:2468] T 075196757f21457696b5e4ca1e806556 P f5fa01ffe1374026ac11fcab41d7264d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cbbc600cb2fc4d919e1dd0b8e1299929 in term 2.
I20260709 13:17:48.766782  5874 leader_election.cc:304] T 075196757f21457696b5e4ca1e806556 P cbbc600cb2fc4d919e1dd0b8e1299929 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cbbc600cb2fc4d919e1dd0b8e1299929, f5fa01ffe1374026ac11fcab41d7264d; no voters: 
I20260709 13:17:48.767848  6065 raft_consensus.cc:2804] T 075196757f21457696b5e4ca1e806556 P cbbc600cb2fc4d919e1dd0b8e1299929 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:17:48.768481  5835 raft_consensus.cc:2468] T 075196757f21457696b5e4ca1e806556 P 8f11b64b1f21462ba2ae6d247817bc5d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cbbc600cb2fc4d919e1dd0b8e1299929 in term 2.
I20260709 13:17:48.769922  6065 raft_consensus.cc:697] T 075196757f21457696b5e4ca1e806556 P cbbc600cb2fc4d919e1dd0b8e1299929 [term 2 LEADER]: Becoming Leader. State: Replica: cbbc600cb2fc4d919e1dd0b8e1299929, State: Running, Role: LEADER
I20260709 13:17:48.771087  6065 consensus_queue.cc:237] T 075196757f21457696b5e4ca1e806556 P cbbc600cb2fc4d919e1dd0b8e1299929 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5fa01ffe1374026ac11fcab41d7264d" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 41321 } } peers { permanent_uuid: "8f11b64b1f21462ba2ae6d247817bc5d" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 43089 } } peers { permanent_uuid: "cbbc600cb2fc4d919e1dd0b8e1299929" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 34181 } }
I20260709 13:17:48.772516  6091 raft_consensus.cc:993] T df80ca53941844b3b7f6df85be38b00d P 8f11b64b1f21462ba2ae6d247817bc5d: : Instructing follower cbbc600cb2fc4d919e1dd0b8e1299929 to start an election
I20260709 13:17:48.773010  6091 raft_consensus.cc:1081] T df80ca53941844b3b7f6df85be38b00d P 8f11b64b1f21462ba2ae6d247817bc5d [term 3 LEADER]: Signalling peer cbbc600cb2fc4d919e1dd0b8e1299929 to start an election
I20260709 13:17:48.774657  5907 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "df80ca53941844b3b7f6df85be38b00d"
dest_uuid: "cbbc600cb2fc4d919e1dd0b8e1299929"
 from {username='slave'} at 127.0.0.1:35326
I20260709 13:17:48.775656  5907 raft_consensus.cc:493] T df80ca53941844b3b7f6df85be38b00d P cbbc600cb2fc4d919e1dd0b8e1299929 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:48.776364  5907 raft_consensus.cc:3060] T df80ca53941844b3b7f6df85be38b00d P cbbc600cb2fc4d919e1dd0b8e1299929 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:17:48.781124  5655 catalog_manager.cc:5697] T 075196757f21457696b5e4ca1e806556 P cbbc600cb2fc4d919e1dd0b8e1299929 reported cstate change: term changed from 1 to 2, leader changed from 8f11b64b1f21462ba2ae6d247817bc5d (127.5.126.66) to cbbc600cb2fc4d919e1dd0b8e1299929 (127.5.126.67). New cstate: current_term: 2 leader_uuid: "cbbc600cb2fc4d919e1dd0b8e1299929" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5fa01ffe1374026ac11fcab41d7264d" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 41321 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8f11b64b1f21462ba2ae6d247817bc5d" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 43089 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cbbc600cb2fc4d919e1dd0b8e1299929" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 34181 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:48.782474  5907 raft_consensus.cc:515] T df80ca53941844b3b7f6df85be38b00d P cbbc600cb2fc4d919e1dd0b8e1299929 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbbc600cb2fc4d919e1dd0b8e1299929" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 34181 } } peers { permanent_uuid: "f5fa01ffe1374026ac11fcab41d7264d" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 41321 } } peers { permanent_uuid: "8f11b64b1f21462ba2ae6d247817bc5d" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 43089 } }
I20260709 13:17:48.784250  5907 leader_election.cc:290] T df80ca53941844b3b7f6df85be38b00d P cbbc600cb2fc4d919e1dd0b8e1299929 [CANDIDATE]: Term 4 election: Requested vote from peers f5fa01ffe1374026ac11fcab41d7264d (127.5.126.65:41321), 8f11b64b1f21462ba2ae6d247817bc5d (127.5.126.66:43089)
I20260709 13:17:48.785742  5758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df80ca53941844b3b7f6df85be38b00d" candidate_uuid: "cbbc600cb2fc4d919e1dd0b8e1299929" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "f5fa01ffe1374026ac11fcab41d7264d"
I20260709 13:17:48.786175  5758 raft_consensus.cc:3060] T df80ca53941844b3b7f6df85be38b00d P f5fa01ffe1374026ac11fcab41d7264d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:17:48.785915  5835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df80ca53941844b3b7f6df85be38b00d" candidate_uuid: "cbbc600cb2fc4d919e1dd0b8e1299929" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "8f11b64b1f21462ba2ae6d247817bc5d"
I20260709 13:17:48.786695  5835 raft_consensus.cc:3055] T df80ca53941844b3b7f6df85be38b00d P 8f11b64b1f21462ba2ae6d247817bc5d [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:17:48.787055  5835 raft_consensus.cc:740] T df80ca53941844b3b7f6df85be38b00d P 8f11b64b1f21462ba2ae6d247817bc5d [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 8f11b64b1f21462ba2ae6d247817bc5d, State: Running, Role: LEADER
I20260709 13:17:48.787954  5835 consensus_queue.cc:260] T df80ca53941844b3b7f6df85be38b00d P 8f11b64b1f21462ba2ae6d247817bc5d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbbc600cb2fc4d919e1dd0b8e1299929" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 34181 } } peers { permanent_uuid: "f5fa01ffe1374026ac11fcab41d7264d" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 41321 } } peers { permanent_uuid: "8f11b64b1f21462ba2ae6d247817bc5d" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 43089 } }
I20260709 13:17:48.789263  5835 raft_consensus.cc:3060] T df80ca53941844b3b7f6df85be38b00d P 8f11b64b1f21462ba2ae6d247817bc5d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:17:48.791460  5758 raft_consensus.cc:2468] T df80ca53941844b3b7f6df85be38b00d P f5fa01ffe1374026ac11fcab41d7264d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cbbc600cb2fc4d919e1dd0b8e1299929 in term 4.
I20260709 13:17:48.792603  5874 leader_election.cc:304] T df80ca53941844b3b7f6df85be38b00d P cbbc600cb2fc4d919e1dd0b8e1299929 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cbbc600cb2fc4d919e1dd0b8e1299929, f5fa01ffe1374026ac11fcab41d7264d; no voters: 
I20260709 13:17:48.793320  6065 raft_consensus.cc:2804] T df80ca53941844b3b7f6df85be38b00d P cbbc600cb2fc4d919e1dd0b8e1299929 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:17:48.793829  6065 raft_consensus.cc:697] T df80ca53941844b3b7f6df85be38b00d P cbbc600cb2fc4d919e1dd0b8e1299929 [term 4 LEADER]: Becoming Leader. State: Replica: cbbc600cb2fc4d919e1dd0b8e1299929, State: Running, Role: LEADER
I20260709 13:17:48.795246  6065 consensus_queue.cc:237] T df80ca53941844b3b7f6df85be38b00d P cbbc600cb2fc4d919e1dd0b8e1299929 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbbc600cb2fc4d919e1dd0b8e1299929" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 34181 } } peers { permanent_uuid: "f5fa01ffe1374026ac11fcab41d7264d" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 41321 } } peers { permanent_uuid: "8f11b64b1f21462ba2ae6d247817bc5d" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 43089 } }
I20260709 13:17:48.796121  5835 raft_consensus.cc:2468] T df80ca53941844b3b7f6df85be38b00d P 8f11b64b1f21462ba2ae6d247817bc5d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cbbc600cb2fc4d919e1dd0b8e1299929 in term 4.
I20260709 13:17:48.803617  5655 catalog_manager.cc:5697] T df80ca53941844b3b7f6df85be38b00d P cbbc600cb2fc4d919e1dd0b8e1299929 reported cstate change: term changed from 3 to 4, leader changed from 8f11b64b1f21462ba2ae6d247817bc5d (127.5.126.66) to cbbc600cb2fc4d919e1dd0b8e1299929 (127.5.126.67). New cstate: current_term: 4 leader_uuid: "cbbc600cb2fc4d919e1dd0b8e1299929" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbbc600cb2fc4d919e1dd0b8e1299929" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 34181 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f5fa01ffe1374026ac11fcab41d7264d" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 41321 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8f11b64b1f21462ba2ae6d247817bc5d" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 43089 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:49.014463  5907 raft_consensus.cc:1275] T dd4693df753b48e59707726329d3b352 P cbbc600cb2fc4d919e1dd0b8e1299929 [term 5 FOLLOWER]: Refusing update from remote peer f5fa01ffe1374026ac11fcab41d7264d: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:17:49.016232  6093 consensus_queue.cc:1048] T dd4693df753b48e59707726329d3b352 P f5fa01ffe1374026ac11fcab41d7264d [LEADER]: Connected to new peer: Peer: permanent_uuid: "cbbc600cb2fc4d919e1dd0b8e1299929" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 34181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:17:49.020362  5835 raft_consensus.cc:1275] T dd4693df753b48e59707726329d3b352 P 8f11b64b1f21462ba2ae6d247817bc5d [term 5 FOLLOWER]: Refusing update from remote peer f5fa01ffe1374026ac11fcab41d7264d: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:17:49.022135  6093 consensus_queue.cc:1048] T dd4693df753b48e59707726329d3b352 P f5fa01ffe1374026ac11fcab41d7264d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8f11b64b1f21462ba2ae6d247817bc5d" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 43089 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:17:49.056030  6092 raft_consensus.cc:993] T 15093a816d314d35abd1195b622ad13e P 8f11b64b1f21462ba2ae6d247817bc5d: : Instructing follower f5fa01ffe1374026ac11fcab41d7264d to start an election
I20260709 13:17:49.056737  6091 raft_consensus.cc:1081] T 15093a816d314d35abd1195b622ad13e P 8f11b64b1f21462ba2ae6d247817bc5d [term 3 LEADER]: Signalling peer f5fa01ffe1374026ac11fcab41d7264d to start an election
I20260709 13:17:49.058487  5758 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "15093a816d314d35abd1195b622ad13e"
dest_uuid: "f5fa01ffe1374026ac11fcab41d7264d"
 from {username='slave'} at 127.0.0.1:60384
I20260709 13:17:49.059047  5758 raft_consensus.cc:493] T 15093a816d314d35abd1195b622ad13e P f5fa01ffe1374026ac11fcab41d7264d [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:49.059415  5758 raft_consensus.cc:3060] T 15093a816d314d35abd1195b622ad13e P f5fa01ffe1374026ac11fcab41d7264d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:17:49.063829  5758 raft_consensus.cc:515] T 15093a816d314d35abd1195b622ad13e P f5fa01ffe1374026ac11fcab41d7264d [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5fa01ffe1374026ac11fcab41d7264d" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 41321 } } peers { permanent_uuid: "8f11b64b1f21462ba2ae6d247817bc5d" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 43089 } } peers { permanent_uuid: "cbbc600cb2fc4d919e1dd0b8e1299929" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 34181 } }
I20260709 13:17:49.065299  5758 leader_election.cc:290] T 15093a816d314d35abd1195b622ad13e P f5fa01ffe1374026ac11fcab41d7264d [CANDIDATE]: Term 4 election: Requested vote from peers 8f11b64b1f21462ba2ae6d247817bc5d (127.5.126.66:43089), cbbc600cb2fc4d919e1dd0b8e1299929 (127.5.126.67:34181)
I20260709 13:17:49.066285  5835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15093a816d314d35abd1195b622ad13e" candidate_uuid: "f5fa01ffe1374026ac11fcab41d7264d" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "8f11b64b1f21462ba2ae6d247817bc5d"
I20260709 13:17:49.066496  5907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15093a816d314d35abd1195b622ad13e" candidate_uuid: "f5fa01ffe1374026ac11fcab41d7264d" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "cbbc600cb2fc4d919e1dd0b8e1299929"
I20260709 13:17:49.066833  5835 raft_consensus.cc:3055] T 15093a816d314d35abd1195b622ad13e P 8f11b64b1f21462ba2ae6d247817bc5d [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:17:49.067131  5907 raft_consensus.cc:3060] T 15093a816d314d35abd1195b622ad13e P cbbc600cb2fc4d919e1dd0b8e1299929 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:17:49.067217  5835 raft_consensus.cc:740] T 15093a816d314d35abd1195b622ad13e P 8f11b64b1f21462ba2ae6d247817bc5d [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 8f11b64b1f21462ba2ae6d247817bc5d, State: Running, Role: LEADER
I20260709 13:17:49.068302  5835 consensus_queue.cc:260] T 15093a816d314d35abd1195b622ad13e P 8f11b64b1f21462ba2ae6d247817bc5d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5fa01ffe1374026ac11fcab41d7264d" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 41321 } } peers { permanent_uuid: "8f11b64b1f21462ba2ae6d247817bc5d" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 43089 } } peers { permanent_uuid: "cbbc600cb2fc4d919e1dd0b8e1299929" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 34181 } }
I20260709 13:17:49.069283  5835 raft_consensus.cc:3060] T 15093a816d314d35abd1195b622ad13e P 8f11b64b1f21462ba2ae6d247817bc5d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:17:49.072662  5907 raft_consensus.cc:2468] T 15093a816d314d35abd1195b622ad13e P cbbc600cb2fc4d919e1dd0b8e1299929 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5fa01ffe1374026ac11fcab41d7264d in term 4.
I20260709 13:17:49.073781  5723 leader_election.cc:304] T 15093a816d314d35abd1195b622ad13e P f5fa01ffe1374026ac11fcab41d7264d [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cbbc600cb2fc4d919e1dd0b8e1299929, f5fa01ffe1374026ac11fcab41d7264d; no voters: 
I20260709 13:17:49.074654  6093 raft_consensus.cc:2804] T 15093a816d314d35abd1195b622ad13e P f5fa01ffe1374026ac11fcab41d7264d [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:17:49.074808  5835 raft_consensus.cc:2468] T 15093a816d314d35abd1195b622ad13e P 8f11b64b1f21462ba2ae6d247817bc5d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5fa01ffe1374026ac11fcab41d7264d in term 4.
I20260709 13:17:49.075459  6093 raft_consensus.cc:697] T 15093a816d314d35abd1195b622ad13e P f5fa01ffe1374026ac11fcab41d7264d [term 4 LEADER]: Becoming Leader. State: Replica: f5fa01ffe1374026ac11fcab41d7264d, State: Running, Role: LEADER
I20260709 13:17:49.076400  6093 consensus_queue.cc:237] T 15093a816d314d35abd1195b622ad13e P f5fa01ffe1374026ac11fcab41d7264d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5fa01ffe1374026ac11fcab41d7264d" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 41321 } } peers { permanent_uuid: "8f11b64b1f21462ba2ae6d247817bc5d" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 43089 } } peers { permanent_uuid: "cbbc600cb2fc4d919e1dd0b8e1299929" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 34181 } }
I20260709 13:17:49.085011  5656 catalog_manager.cc:5697] T 15093a816d314d35abd1195b622ad13e P f5fa01ffe1374026ac11fcab41d7264d reported cstate change: term changed from 3 to 4, leader changed from 8f11b64b1f21462ba2ae6d247817bc5d (127.5.126.66) to f5fa01ffe1374026ac11fcab41d7264d (127.5.126.65). New cstate: current_term: 4 leader_uuid: "f5fa01ffe1374026ac11fcab41d7264d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5fa01ffe1374026ac11fcab41d7264d" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 41321 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8f11b64b1f21462ba2ae6d247817bc5d" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 43089 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cbbc600cb2fc4d919e1dd0b8e1299929" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 34181 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:49.155786  5835 raft_consensus.cc:1275] T 075196757f21457696b5e4ca1e806556 P 8f11b64b1f21462ba2ae6d247817bc5d [term 2 FOLLOWER]: Refusing update from remote peer cbbc600cb2fc4d919e1dd0b8e1299929: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:49.157155  6065 consensus_queue.cc:1048] T 075196757f21457696b5e4ca1e806556 P cbbc600cb2fc4d919e1dd0b8e1299929 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8f11b64b1f21462ba2ae6d247817bc5d" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 43089 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:49.167315  5758 raft_consensus.cc:1275] T 075196757f21457696b5e4ca1e806556 P f5fa01ffe1374026ac11fcab41d7264d [term 2 FOLLOWER]: Refusing update from remote peer cbbc600cb2fc4d919e1dd0b8e1299929: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:49.168973  6113 consensus_queue.cc:1048] T 075196757f21457696b5e4ca1e806556 P cbbc600cb2fc4d919e1dd0b8e1299929 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5fa01ffe1374026ac11fcab41d7264d" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 41321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:17:49.197060  5835 raft_consensus.cc:1275] T c65d802300c64a8f97ec9fb13c6599db P 8f11b64b1f21462ba2ae6d247817bc5d [term 3 FOLLOWER]: Refusing update from remote peer f5fa01ffe1374026ac11fcab41d7264d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:17:49.198310  6093 consensus_queue.cc:1048] T c65d802300c64a8f97ec9fb13c6599db P f5fa01ffe1374026ac11fcab41d7264d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8f11b64b1f21462ba2ae6d247817bc5d" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 43089 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:17:49.200181  5758 raft_consensus.cc:1275] T df80ca53941844b3b7f6df85be38b00d P f5fa01ffe1374026ac11fcab41d7264d [term 4 FOLLOWER]: Refusing update from remote peer cbbc600cb2fc4d919e1dd0b8e1299929: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:17:49.201385  6113 consensus_queue.cc:1048] T df80ca53941844b3b7f6df85be38b00d P cbbc600cb2fc4d919e1dd0b8e1299929 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5fa01ffe1374026ac11fcab41d7264d" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 41321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:17:49.206099  5834 raft_consensus.cc:1275] T df80ca53941844b3b7f6df85be38b00d P 8f11b64b1f21462ba2ae6d247817bc5d [term 4 FOLLOWER]: Refusing update from remote peer cbbc600cb2fc4d919e1dd0b8e1299929: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:17:49.207858  6065 consensus_queue.cc:1048] T df80ca53941844b3b7f6df85be38b00d P cbbc600cb2fc4d919e1dd0b8e1299929 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8f11b64b1f21462ba2ae6d247817bc5d" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 43089 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:17:49.209838  5907 raft_consensus.cc:1275] T c65d802300c64a8f97ec9fb13c6599db P cbbc600cb2fc4d919e1dd0b8e1299929 [term 3 FOLLOWER]: Refusing update from remote peer f5fa01ffe1374026ac11fcab41d7264d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:17:49.212569  6107 consensus_queue.cc:1048] T c65d802300c64a8f97ec9fb13c6599db P f5fa01ffe1374026ac11fcab41d7264d [LEADER]: Connected to new peer: Peer: permanent_uuid: "cbbc600cb2fc4d919e1dd0b8e1299929" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 34181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:17:49.574771  5625 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:17:49.580778  5625 tablet_server.cc:179] TabletServer@127.5.126.65:0 shutting down...
I20260709 13:17:49.613152  5625 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:17:49.614154  5625 tablet_replica.cc:333] T a47b6d6930154ade882793bfdf796229 P f5fa01ffe1374026ac11fcab41d7264d: stopping tablet replica
I20260709 13:17:49.614987  5625 raft_consensus.cc:2243] T a47b6d6930154ade882793bfdf796229 P f5fa01ffe1374026ac11fcab41d7264d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:49.615602  5625 raft_consensus.cc:2272] T a47b6d6930154ade882793bfdf796229 P f5fa01ffe1374026ac11fcab41d7264d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:49.618882  5625 tablet_replica.cc:333] T 075196757f21457696b5e4ca1e806556 P f5fa01ffe1374026ac11fcab41d7264d: stopping tablet replica
I20260709 13:17:49.619536  5625 raft_consensus.cc:2243] T 075196757f21457696b5e4ca1e806556 P f5fa01ffe1374026ac11fcab41d7264d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:49.620011  5625 raft_consensus.cc:2272] T 075196757f21457696b5e4ca1e806556 P f5fa01ffe1374026ac11fcab41d7264d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:49.622579  5625 tablet_replica.cc:333] T 0a72b395bcab4a0ab35141522c307b66 P f5fa01ffe1374026ac11fcab41d7264d: stopping tablet replica
I20260709 13:17:49.623245  5625 raft_consensus.cc:2243] T 0a72b395bcab4a0ab35141522c307b66 P f5fa01ffe1374026ac11fcab41d7264d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:49.623749  5625 raft_consensus.cc:2272] T 0a72b395bcab4a0ab35141522c307b66 P f5fa01ffe1374026ac11fcab41d7264d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:49.626173  5625 tablet_replica.cc:333] T 15093a816d314d35abd1195b622ad13e P f5fa01ffe1374026ac11fcab41d7264d: stopping tablet replica
I20260709 13:17:49.626747  5625 raft_consensus.cc:2243] T 15093a816d314d35abd1195b622ad13e P f5fa01ffe1374026ac11fcab41d7264d [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:17:49.627360  5625 pending_rounds.cc:70] T 15093a816d314d35abd1195b622ad13e P f5fa01ffe1374026ac11fcab41d7264d: Trying to abort 1 pending ops.
I20260709 13:17:49.627605  5625 pending_rounds.cc:77] T 15093a816d314d35abd1195b622ad13e P f5fa01ffe1374026ac11fcab41d7264d: Aborting op as it isn't in flight: id { term: 4 index: 4 } timestamp: 7305638170944516096 op_type: NO_OP noop_request { }
I20260709 13:17:49.627969  5625 raft_consensus.cc:2889] T 15093a816d314d35abd1195b622ad13e P f5fa01ffe1374026ac11fcab41d7264d [term 4 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:17:49.628309  5625 raft_consensus.cc:2272] T 15093a816d314d35abd1195b622ad13e P f5fa01ffe1374026ac11fcab41d7264d [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:49.630626  5625 tablet_replica.cc:333] T 8857705ce84344eb9a2b986546bb10e6 P f5fa01ffe1374026ac11fcab41d7264d: stopping tablet replica
I20260709 13:17:49.631191  5625 raft_consensus.cc:2243] T 8857705ce84344eb9a2b986546bb10e6 P f5fa01ffe1374026ac11fcab41d7264d [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:49.631609  5625 raft_consensus.cc:2272] T 8857705ce84344eb9a2b986546bb10e6 P f5fa01ffe1374026ac11fcab41d7264d [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 13:17:49.632393  5800 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:17:49.633646  5625 tablet_replica.cc:333] T dd4693df753b48e59707726329d3b352 P f5fa01ffe1374026ac11fcab41d7264d: stopping tablet replica
I20260709 13:17:49.634248  5625 raft_consensus.cc:2243] T dd4693df753b48e59707726329d3b352 P f5fa01ffe1374026ac11fcab41d7264d [term 5 LEADER]: Raft consensus shutting down.
I20260709 13:17:49.635049  5625 raft_consensus.cc:2272] T dd4693df753b48e59707726329d3b352 P f5fa01ffe1374026ac11fcab41d7264d [term 5 FOLLOWER]: Raft consensus is shut down!
W20260709 13:17:49.636634  5800 consensus_peers.cc:597] T 8857705ce84344eb9a2b986546bb10e6 P 8f11b64b1f21462ba2ae6d247817bc5d -> Peer f5fa01ffe1374026ac11fcab41d7264d (127.5.126.65:41321): Couldn't send request to peer f5fa01ffe1374026ac11fcab41d7264d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:49.638002  5625 tablet_replica.cc:333] T 88a110b2e3174300b97eede6e4cb29a8 P f5fa01ffe1374026ac11fcab41d7264d: stopping tablet replica
I20260709 13:17:49.638586  5625 raft_consensus.cc:2243] T 88a110b2e3174300b97eede6e4cb29a8 P f5fa01ffe1374026ac11fcab41d7264d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:49.638976  5625 raft_consensus.cc:2272] T 88a110b2e3174300b97eede6e4cb29a8 P f5fa01ffe1374026ac11fcab41d7264d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:49.641109  5625 tablet_replica.cc:333] T df80ca53941844b3b7f6df85be38b00d P f5fa01ffe1374026ac11fcab41d7264d: stopping tablet replica
I20260709 13:17:49.641829  5625 raft_consensus.cc:2243] T df80ca53941844b3b7f6df85be38b00d P f5fa01ffe1374026ac11fcab41d7264d [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:49.642333  5625 raft_consensus.cc:2272] T df80ca53941844b3b7f6df85be38b00d P f5fa01ffe1374026ac11fcab41d7264d [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:49.644907  5625 tablet_replica.cc:333] T c65d802300c64a8f97ec9fb13c6599db P f5fa01ffe1374026ac11fcab41d7264d: stopping tablet replica
I20260709 13:17:49.645642  5625 raft_consensus.cc:2243] T c65d802300c64a8f97ec9fb13c6599db P f5fa01ffe1374026ac11fcab41d7264d [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:17:49.646523  5625 raft_consensus.cc:2272] T c65d802300c64a8f97ec9fb13c6599db P f5fa01ffe1374026ac11fcab41d7264d [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 13:17:49.647382  5874 consensus_peers.cc:597] T 075196757f21457696b5e4ca1e806556 P cbbc600cb2fc4d919e1dd0b8e1299929 -> Peer f5fa01ffe1374026ac11fcab41d7264d (127.5.126.65:41321): Couldn't send request to peer f5fa01ffe1374026ac11fcab41d7264d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:17:49.649070  5874 consensus_peers.cc:597] T df80ca53941844b3b7f6df85be38b00d P cbbc600cb2fc4d919e1dd0b8e1299929 -> Peer f5fa01ffe1374026ac11fcab41d7264d (127.5.126.65:41321): Couldn't send request to peer f5fa01ffe1374026ac11fcab41d7264d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:49.770483  5625 tablet_server.cc:196] TabletServer@127.5.126.65:0 shutdown complete.
W20260709 13:17:49.771334  5800 consensus_peers.cc:597] T 0a72b395bcab4a0ab35141522c307b66 P 8f11b64b1f21462ba2ae6d247817bc5d -> Peer f5fa01ffe1374026ac11fcab41d7264d (127.5.126.65:41321): Couldn't send request to peer f5fa01ffe1374026ac11fcab41d7264d. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:41321: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:49.793016  5625 tablet_server.cc:179] TabletServer@127.5.126.66:0 shutting down...
I20260709 13:17:49.824959  5625 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:17:49.825778  5625 tablet_replica.cc:333] T dd4693df753b48e59707726329d3b352 P 8f11b64b1f21462ba2ae6d247817bc5d: stopping tablet replica
W20260709 13:17:49.826004  5874 consensus_peers.cc:597] T a47b6d6930154ade882793bfdf796229 P cbbc600cb2fc4d919e1dd0b8e1299929 -> Peer f5fa01ffe1374026ac11fcab41d7264d (127.5.126.65:41321): Couldn't send request to peer f5fa01ffe1374026ac11fcab41d7264d. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:41321: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:49.826541  5625 raft_consensus.cc:2243] T dd4693df753b48e59707726329d3b352 P 8f11b64b1f21462ba2ae6d247817bc5d [term 5 FOLLOWER]: Raft consensus shutting down.
W20260709 13:17:49.826721  5874 consensus_peers.cc:597] T df80ca53941844b3b7f6df85be38b00d P cbbc600cb2fc4d919e1dd0b8e1299929 -> Peer 8f11b64b1f21462ba2ae6d247817bc5d (127.5.126.66:43089): Couldn't send request to peer 8f11b64b1f21462ba2ae6d247817bc5d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:49.827085  5625 raft_consensus.cc:2272] T dd4693df753b48e59707726329d3b352 P 8f11b64b1f21462ba2ae6d247817bc5d [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:49.829737  5625 tablet_replica.cc:333] T 8857705ce84344eb9a2b986546bb10e6 P 8f11b64b1f21462ba2ae6d247817bc5d: stopping tablet replica
I20260709 13:17:49.830257  5625 raft_consensus.cc:2243] T 8857705ce84344eb9a2b986546bb10e6 P 8f11b64b1f21462ba2ae6d247817bc5d [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:17:49.831048  5625 raft_consensus.cc:2272] T 8857705ce84344eb9a2b986546bb10e6 P 8f11b64b1f21462ba2ae6d247817bc5d [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:49.832752  5625 tablet_replica.cc:333] T 15093a816d314d35abd1195b622ad13e P 8f11b64b1f21462ba2ae6d247817bc5d: stopping tablet replica
I20260709 13:17:49.833246  5625 raft_consensus.cc:2243] T 15093a816d314d35abd1195b622ad13e P 8f11b64b1f21462ba2ae6d247817bc5d [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:49.833611  5625 raft_consensus.cc:2272] T 15093a816d314d35abd1195b622ad13e P 8f11b64b1f21462ba2ae6d247817bc5d [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:49.835502  5625 tablet_replica.cc:333] T 0a72b395bcab4a0ab35141522c307b66 P 8f11b64b1f21462ba2ae6d247817bc5d: stopping tablet replica
I20260709 13:17:49.836018  5625 raft_consensus.cc:2243] T 0a72b395bcab4a0ab35141522c307b66 P 8f11b64b1f21462ba2ae6d247817bc5d [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:17:49.836877  5625 raft_consensus.cc:2272] T 0a72b395bcab4a0ab35141522c307b66 P 8f11b64b1f21462ba2ae6d247817bc5d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:49.838492  5625 tablet_replica.cc:333] T 075196757f21457696b5e4ca1e806556 P 8f11b64b1f21462ba2ae6d247817bc5d: stopping tablet replica
I20260709 13:17:49.838968  5625 raft_consensus.cc:2243] T 075196757f21457696b5e4ca1e806556 P 8f11b64b1f21462ba2ae6d247817bc5d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:49.839398  5625 raft_consensus.cc:2272] T 075196757f21457696b5e4ca1e806556 P 8f11b64b1f21462ba2ae6d247817bc5d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:49.841753  5625 tablet_replica.cc:333] T a47b6d6930154ade882793bfdf796229 P 8f11b64b1f21462ba2ae6d247817bc5d: stopping tablet replica
I20260709 13:17:49.842309  5625 raft_consensus.cc:2243] T a47b6d6930154ade882793bfdf796229 P 8f11b64b1f21462ba2ae6d247817bc5d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:49.842712  5625 raft_consensus.cc:2272] T a47b6d6930154ade882793bfdf796229 P 8f11b64b1f21462ba2ae6d247817bc5d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:49.844452  5625 tablet_replica.cc:333] T c65d802300c64a8f97ec9fb13c6599db P 8f11b64b1f21462ba2ae6d247817bc5d: stopping tablet replica
I20260709 13:17:49.844929  5625 raft_consensus.cc:2243] T c65d802300c64a8f97ec9fb13c6599db P 8f11b64b1f21462ba2ae6d247817bc5d [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:49.845320  5625 raft_consensus.cc:2272] T c65d802300c64a8f97ec9fb13c6599db P 8f11b64b1f21462ba2ae6d247817bc5d [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:49.847496  5625 tablet_replica.cc:333] T 88a110b2e3174300b97eede6e4cb29a8 P 8f11b64b1f21462ba2ae6d247817bc5d: stopping tablet replica
I20260709 13:17:49.848122  5625 raft_consensus.cc:2243] T 88a110b2e3174300b97eede6e4cb29a8 P 8f11b64b1f21462ba2ae6d247817bc5d [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:17:49.848953  5625 raft_consensus.cc:2272] T 88a110b2e3174300b97eede6e4cb29a8 P 8f11b64b1f21462ba2ae6d247817bc5d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:49.850700  5625 tablet_replica.cc:333] T df80ca53941844b3b7f6df85be38b00d P 8f11b64b1f21462ba2ae6d247817bc5d: stopping tablet replica
I20260709 13:17:49.851315  5625 raft_consensus.cc:2243] T df80ca53941844b3b7f6df85be38b00d P 8f11b64b1f21462ba2ae6d247817bc5d [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:49.851788  5625 raft_consensus.cc:2272] T df80ca53941844b3b7f6df85be38b00d P 8f11b64b1f21462ba2ae6d247817bc5d [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:49.882694  5625 tablet_server.cc:196] TabletServer@127.5.126.66:0 shutdown complete.
I20260709 13:17:49.899595  5625 tablet_server.cc:179] TabletServer@127.5.126.67:0 shutting down...
I20260709 13:17:49.934523  5625 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:17:49.935398  5625 tablet_replica.cc:333] T a47b6d6930154ade882793bfdf796229 P cbbc600cb2fc4d919e1dd0b8e1299929: stopping tablet replica
I20260709 13:17:49.936417  5625 raft_consensus.cc:2243] T a47b6d6930154ade882793bfdf796229 P cbbc600cb2fc4d919e1dd0b8e1299929 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:17:49.937726  5625 raft_consensus.cc:2272] T a47b6d6930154ade882793bfdf796229 P cbbc600cb2fc4d919e1dd0b8e1299929 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:49.939770  5625 tablet_replica.cc:333] T 075196757f21457696b5e4ca1e806556 P cbbc600cb2fc4d919e1dd0b8e1299929: stopping tablet replica
I20260709 13:17:49.940385  5625 raft_consensus.cc:2243] T 075196757f21457696b5e4ca1e806556 P cbbc600cb2fc4d919e1dd0b8e1299929 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:17:49.941133  5625 raft_consensus.cc:2272] T 075196757f21457696b5e4ca1e806556 P cbbc600cb2fc4d919e1dd0b8e1299929 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:49.943382  5625 tablet_replica.cc:333] T 0a72b395bcab4a0ab35141522c307b66 P cbbc600cb2fc4d919e1dd0b8e1299929: stopping tablet replica
I20260709 13:17:49.943892  5625 raft_consensus.cc:2243] T 0a72b395bcab4a0ab35141522c307b66 P cbbc600cb2fc4d919e1dd0b8e1299929 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:49.944355  5625 raft_consensus.cc:2272] T 0a72b395bcab4a0ab35141522c307b66 P cbbc600cb2fc4d919e1dd0b8e1299929 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:49.946043  5625 tablet_replica.cc:333] T c65d802300c64a8f97ec9fb13c6599db P cbbc600cb2fc4d919e1dd0b8e1299929: stopping tablet replica
I20260709 13:17:49.946519  5625 raft_consensus.cc:2243] T c65d802300c64a8f97ec9fb13c6599db P cbbc600cb2fc4d919e1dd0b8e1299929 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:49.946913  5625 raft_consensus.cc:2272] T c65d802300c64a8f97ec9fb13c6599db P cbbc600cb2fc4d919e1dd0b8e1299929 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:49.949443  5625 tablet_replica.cc:333] T 88a110b2e3174300b97eede6e4cb29a8 P cbbc600cb2fc4d919e1dd0b8e1299929: stopping tablet replica
I20260709 13:17:49.949950  5625 raft_consensus.cc:2243] T 88a110b2e3174300b97eede6e4cb29a8 P cbbc600cb2fc4d919e1dd0b8e1299929 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:49.950310  5625 raft_consensus.cc:2272] T 88a110b2e3174300b97eede6e4cb29a8 P cbbc600cb2fc4d919e1dd0b8e1299929 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:49.951965  5625 tablet_replica.cc:333] T df80ca53941844b3b7f6df85be38b00d P cbbc600cb2fc4d919e1dd0b8e1299929: stopping tablet replica
I20260709 13:17:49.952524  5625 raft_consensus.cc:2243] T df80ca53941844b3b7f6df85be38b00d P cbbc600cb2fc4d919e1dd0b8e1299929 [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:17:49.953274  5625 raft_consensus.cc:2272] T df80ca53941844b3b7f6df85be38b00d P cbbc600cb2fc4d919e1dd0b8e1299929 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:49.955273  5625 tablet_replica.cc:333] T 15093a816d314d35abd1195b622ad13e P cbbc600cb2fc4d919e1dd0b8e1299929: stopping tablet replica
I20260709 13:17:49.955704  5625 raft_consensus.cc:2243] T 15093a816d314d35abd1195b622ad13e P cbbc600cb2fc4d919e1dd0b8e1299929 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:49.956156  5625 raft_consensus.cc:2272] T 15093a816d314d35abd1195b622ad13e P cbbc600cb2fc4d919e1dd0b8e1299929 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:49.958016  5625 tablet_replica.cc:333] T 8857705ce84344eb9a2b986546bb10e6 P cbbc600cb2fc4d919e1dd0b8e1299929: stopping tablet replica
I20260709 13:17:49.958433  5625 raft_consensus.cc:2243] T 8857705ce84344eb9a2b986546bb10e6 P cbbc600cb2fc4d919e1dd0b8e1299929 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:49.958792  5625 raft_consensus.cc:2272] T 8857705ce84344eb9a2b986546bb10e6 P cbbc600cb2fc4d919e1dd0b8e1299929 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:49.960501  5625 tablet_replica.cc:333] T dd4693df753b48e59707726329d3b352 P cbbc600cb2fc4d919e1dd0b8e1299929: stopping tablet replica
I20260709 13:17:49.960958  5625 raft_consensus.cc:2243] T dd4693df753b48e59707726329d3b352 P cbbc600cb2fc4d919e1dd0b8e1299929 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:49.961340  5625 raft_consensus.cc:2272] T dd4693df753b48e59707726329d3b352 P cbbc600cb2fc4d919e1dd0b8e1299929 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:49.991473  5625 tablet_server.cc:196] TabletServer@127.5.126.67:0 shutdown complete.
I20260709 13:17:50.014170  5625 master.cc:562] Master@127.5.126.126:37087 shutting down...
I20260709 13:17:50.229585  5625 raft_consensus.cc:2243] T 00000000000000000000000000000000 P cbd54be4b5794d47a441e16f31712fdc [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:17:50.230240  5625 raft_consensus.cc:2272] T 00000000000000000000000000000000 P cbd54be4b5794d47a441e16f31712fdc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:50.230607  5625 tablet_replica.cc:333] T 00000000000000000000000000000000 P cbd54be4b5794d47a441e16f31712fdc: stopping tablet replica
I20260709 13:17:50.252115  5625 master.cc:584] Master@127.5.126.126:37087 shutdown complete.
8f11b64b1f21462ba2ae6d247817bc5d  4
cbbc600cb2fc4d919e1dd0b8e1299929  1
f5fa01ffe1374026ac11fcab41d7264d  4
[       OK ] LeaderRebalancerTest.FunctionalTestForDivided (13028 ms)
[ RUN      ] LeaderRebalancerTest.FunctionalTestForNotDivided
I20260709 13:17:50.293869  5625 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.5.126.126:40217
I20260709 13:17:50.294997  5625 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:17:50.301791  6124 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:17:50.302062  6123 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:17:50.302114  6126 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:17:50.303632  5625 server_base.cc:1061] running on GCE node
I20260709 13:17:50.304694  5625 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:17:50.304934  5625 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:17:50.305130  5625 hybrid_clock.cc:648] HybridClock initialized: now 1783603070305096 us; error 0 us; skew 500 ppm
I20260709 13:17:50.305644  5625 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:17:50.308524  5625 webserver.cc:533] Webserver started at http://127.5.126.126:37895/ using document root <none> and password file <none>
I20260709 13:17:50.309051  5625 fs_manager.cc:362] Metadata directory not provided
I20260709 13:17:50.309226  5625 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:17:50.309468  5625 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:17:50.310662  5625 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskWHb0CB/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783603057096655-5625-0/minicluster-data/master-0-root/instance:
uuid: "cf082d3633e541b0a009b7d385b8b005"
format_stamp: "Formatted at 2026-07-09 13:17:50 on dist-test-slave-smzk"
I20260709 13:17:50.315623  5625 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.003s	sys 0.003s
I20260709 13:17:50.319576  6131 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:17:50.320642  5625 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20260709 13:17:50.321048  5625 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskWHb0CB/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783603057096655-5625-0/minicluster-data/master-0-root
uuid: "cf082d3633e541b0a009b7d385b8b005"
format_stamp: "Formatted at 2026-07-09 13:17:50 on dist-test-slave-smzk"
I20260709 13:17:50.321374  5625 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWHb0CB/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783603057096655-5625-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskWHb0CB/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783603057096655-5625-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskWHb0CB/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783603057096655-5625-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:17:50.336889  5625 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:17:50.338323  5625 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:17:50.386219  5625 rpc_server.cc:307] RPC server started. Bound to: 127.5.126.126:40217
I20260709 13:17:50.386353  6182 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.5.126.126:40217 every 8 connection(s)
I20260709 13:17:50.390859  6183 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:50.400522  6183 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P cf082d3633e541b0a009b7d385b8b005: Bootstrap starting.
I20260709 13:17:50.405486  6183 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P cf082d3633e541b0a009b7d385b8b005: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:50.410383  6183 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P cf082d3633e541b0a009b7d385b8b005: No bootstrap required, opened a new log
I20260709 13:17:50.412556  6183 raft_consensus.cc:359] T 00000000000000000000000000000000 P cf082d3633e541b0a009b7d385b8b005 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cf082d3633e541b0a009b7d385b8b005" member_type: VOTER }
I20260709 13:17:50.412948  6183 raft_consensus.cc:385] T 00000000000000000000000000000000 P cf082d3633e541b0a009b7d385b8b005 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:50.413218  6183 raft_consensus.cc:740] T 00000000000000000000000000000000 P cf082d3633e541b0a009b7d385b8b005 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cf082d3633e541b0a009b7d385b8b005, State: Initialized, Role: FOLLOWER
I20260709 13:17:50.413815  6183 consensus_queue.cc:260] T 00000000000000000000000000000000 P cf082d3633e541b0a009b7d385b8b005 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cf082d3633e541b0a009b7d385b8b005" member_type: VOTER }
I20260709 13:17:50.414305  6183 raft_consensus.cc:399] T 00000000000000000000000000000000 P cf082d3633e541b0a009b7d385b8b005 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:17:50.414517  6183 raft_consensus.cc:493] T 00000000000000000000000000000000 P cf082d3633e541b0a009b7d385b8b005 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:17:50.414799  6183 raft_consensus.cc:3060] T 00000000000000000000000000000000 P cf082d3633e541b0a009b7d385b8b005 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:50.418959  6183 raft_consensus.cc:515] T 00000000000000000000000000000000 P cf082d3633e541b0a009b7d385b8b005 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cf082d3633e541b0a009b7d385b8b005" member_type: VOTER }
I20260709 13:17:50.419651  6183 leader_election.cc:304] T 00000000000000000000000000000000 P cf082d3633e541b0a009b7d385b8b005 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: cf082d3633e541b0a009b7d385b8b005; no voters: 
I20260709 13:17:50.421214  6183 leader_election.cc:290] T 00000000000000000000000000000000 P cf082d3633e541b0a009b7d385b8b005 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:17:50.421564  6186 raft_consensus.cc:2804] T 00000000000000000000000000000000 P cf082d3633e541b0a009b7d385b8b005 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:50.423544  6186 raft_consensus.cc:697] T 00000000000000000000000000000000 P cf082d3633e541b0a009b7d385b8b005 [term 1 LEADER]: Becoming Leader. State: Replica: cf082d3633e541b0a009b7d385b8b005, State: Running, Role: LEADER
I20260709 13:17:50.424554  6186 consensus_queue.cc:237] T 00000000000000000000000000000000 P cf082d3633e541b0a009b7d385b8b005 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cf082d3633e541b0a009b7d385b8b005" member_type: VOTER }
I20260709 13:17:50.425596  6183 sys_catalog.cc:565] T 00000000000000000000000000000000 P cf082d3633e541b0a009b7d385b8b005 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:17:50.430392  6187 sys_catalog.cc:455] T 00000000000000000000000000000000 P cf082d3633e541b0a009b7d385b8b005 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "cf082d3633e541b0a009b7d385b8b005" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cf082d3633e541b0a009b7d385b8b005" member_type: VOTER } }
I20260709 13:17:50.431241  6187 sys_catalog.cc:458] T 00000000000000000000000000000000 P cf082d3633e541b0a009b7d385b8b005 [sys.catalog]: This master's current role is: LEADER
I20260709 13:17:50.432982  6188 sys_catalog.cc:455] T 00000000000000000000000000000000 P cf082d3633e541b0a009b7d385b8b005 [sys.catalog]: SysCatalogTable state changed. Reason: New leader cf082d3633e541b0a009b7d385b8b005. Latest consensus state: current_term: 1 leader_uuid: "cf082d3633e541b0a009b7d385b8b005" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cf082d3633e541b0a009b7d385b8b005" member_type: VOTER } }
I20260709 13:17:50.433676  6188 sys_catalog.cc:458] T 00000000000000000000000000000000 P cf082d3633e541b0a009b7d385b8b005 [sys.catalog]: This master's current role is: LEADER
I20260709 13:17:50.434513  6193 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:17:50.441226  6193 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:17:50.443457  5625 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:17:50.452590  6193 catalog_manager.cc:1383] Generated new cluster ID: 167af1d72dc9451ebbbd025158b516d4
I20260709 13:17:50.452878  6193 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:17:50.479005  6193 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:17:50.480306  6193 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:17:50.492473  6193 catalog_manager.cc:6070] T 00000000000000000000000000000000 P cf082d3633e541b0a009b7d385b8b005: Generated new TSK 0
I20260709 13:17:50.493091  6193 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:17:50.510812  5625 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:17:50.518903  6204 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:17:50.520437  6205 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:17:50.521490  6207 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:17:50.521919  5625 server_base.cc:1061] running on GCE node
I20260709 13:17:50.523010  5625 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:17:50.523213  5625 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:17:50.523447  5625 hybrid_clock.cc:648] HybridClock initialized: now 1783603070523423 us; error 0 us; skew 500 ppm
I20260709 13:17:50.523952  5625 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:17:50.526614  5625 webserver.cc:533] Webserver started at http://127.5.126.65:44673/ using document root <none> and password file <none>
I20260709 13:17:50.527076  5625 fs_manager.cc:362] Metadata directory not provided
I20260709 13:17:50.527253  5625 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:17:50.527483  5625 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:17:50.528784  5625 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskWHb0CB/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783603057096655-5625-0/minicluster-data/ts-0-root/instance:
uuid: "215a40d9cebb42d9906c6e4616e2950a"
format_stamp: "Formatted at 2026-07-09 13:17:50 on dist-test-slave-smzk"
I20260709 13:17:50.533741  5625 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.001s
I20260709 13:17:50.537756  6212 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:17:50.539096  5625 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.001s
I20260709 13:17:50.539458  5625 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskWHb0CB/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783603057096655-5625-0/minicluster-data/ts-0-root
uuid: "215a40d9cebb42d9906c6e4616e2950a"
format_stamp: "Formatted at 2026-07-09 13:17:50 on dist-test-slave-smzk"
I20260709 13:17:50.539778  5625 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWHb0CB/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783603057096655-5625-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskWHb0CB/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783603057096655-5625-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskWHb0CB/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783603057096655-5625-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:17:50.561837  5625 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:17:50.563141  5625 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:17:50.564708  5625 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:17:50.567196  5625 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:17:50.567431  5625 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:17:50.567680  5625 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:17:50.567863  5625 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:17:50.616179  5625 rpc_server.cc:307] RPC server started. Bound to: 127.5.126.65:40171
I20260709 13:17:50.616441  6274 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.5.126.65:40171 every 8 connection(s)
I20260709 13:17:50.621217  5625 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:17:50.628666  6279 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:17:50.629662  6280 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:17:50.632529  6282 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:17:50.634176  5625 server_base.cc:1061] running on GCE node
I20260709 13:17:50.635691  5625 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:17:50.635926  5625 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:17:50.636215  5625 hybrid_clock.cc:648] HybridClock initialized: now 1783603070636191 us; error 0 us; skew 500 ppm
I20260709 13:17:50.636773  5625 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:17:50.640008  5625 webserver.cc:533] Webserver started at http://127.5.126.66:45395/ using document root <none> and password file <none>
I20260709 13:17:50.640580  5625 fs_manager.cc:362] Metadata directory not provided
I20260709 13:17:50.640795  5625 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:17:50.641170  5625 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:17:50.642079  6275 heartbeater.cc:344] Connected to a master server at 127.5.126.126:40217
I20260709 13:17:50.642485  6275 heartbeater.cc:461] Registering TS with master...
I20260709 13:17:50.642743  5625 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskWHb0CB/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783603057096655-5625-0/minicluster-data/ts-1-root/instance:
uuid: "b7aed7f4e45b499992f30b4cf32b8961"
format_stamp: "Formatted at 2026-07-09 13:17:50 on dist-test-slave-smzk"
I20260709 13:17:50.643402  6275 heartbeater.cc:507] Master 127.5.126.126:40217 requested a full tablet report, sending...
I20260709 13:17:50.646082  6148 ts_manager.cc:194] Registered new tserver with Master: 215a40d9cebb42d9906c6e4616e2950a (127.5.126.65:40171)
I20260709 13:17:50.648640  6148 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:58534
I20260709 13:17:50.648667  5625 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.001s	sys 0.006s
I20260709 13:17:50.653367  6287 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:17:50.654217  5625 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.004s	sys 0.000s
I20260709 13:17:50.654538  5625 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskWHb0CB/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783603057096655-5625-0/minicluster-data/ts-1-root
uuid: "b7aed7f4e45b499992f30b4cf32b8961"
format_stamp: "Formatted at 2026-07-09 13:17:50 on dist-test-slave-smzk"
I20260709 13:17:50.654798  5625 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWHb0CB/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783603057096655-5625-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskWHb0CB/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783603057096655-5625-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskWHb0CB/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783603057096655-5625-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:17:50.669499  5625 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:17:50.670812  5625 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:17:50.672665  5625 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:17:50.674947  5625 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:17:50.675171  5625 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:17:50.675417  5625 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:17:50.675591  5625 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:17:50.732960  5625 rpc_server.cc:307] RPC server started. Bound to: 127.5.126.66:33867
I20260709 13:17:50.733206  6349 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.5.126.66:33867 every 8 connection(s)
I20260709 13:17:50.738979  5625 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:17:50.746594  6353 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:17:50.747490  6354 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:17:50.750727  5625 server_base.cc:1061] running on GCE node
W20260709 13:17:50.751528  6357 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:17:50.752939  5625 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:17:50.753345  5625 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:17:50.753590  5625 hybrid_clock.cc:648] HybridClock initialized: now 1783603070753566 us; error 0 us; skew 500 ppm
I20260709 13:17:50.754396  5625 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:17:50.754369  6350 heartbeater.cc:344] Connected to a master server at 127.5.126.126:40217
I20260709 13:17:50.755084  6350 heartbeater.cc:461] Registering TS with master...
I20260709 13:17:50.756132  6350 heartbeater.cc:507] Master 127.5.126.126:40217 requested a full tablet report, sending...
I20260709 13:17:50.758008  5625 webserver.cc:533] Webserver started at http://127.5.126.67:45615/ using document root <none> and password file <none>
I20260709 13:17:50.758543  5625 fs_manager.cc:362] Metadata directory not provided
I20260709 13:17:50.758602  6148 ts_manager.cc:194] Registered new tserver with Master: b7aed7f4e45b499992f30b4cf32b8961 (127.5.126.66:33867)
I20260709 13:17:50.758776  5625 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:17:50.759235  5625 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:17:50.760380  6148 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:58538
I20260709 13:17:50.760591  5625 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskWHb0CB/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783603057096655-5625-0/minicluster-data/ts-2-root/instance:
uuid: "4efd9e6155f94224952be95c3785290e"
format_stamp: "Formatted at 2026-07-09 13:17:50 on dist-test-slave-smzk"
I20260709 13:17:50.765686  5625 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 13:17:50.769440  6361 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:17:50.770344  5625 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20260709 13:17:50.770720  5625 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskWHb0CB/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783603057096655-5625-0/minicluster-data/ts-2-root
uuid: "4efd9e6155f94224952be95c3785290e"
format_stamp: "Formatted at 2026-07-09 13:17:50 on dist-test-slave-smzk"
I20260709 13:17:50.770998  5625 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWHb0CB/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783603057096655-5625-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskWHb0CB/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783603057096655-5625-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskWHb0CB/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783603057096655-5625-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:17:50.793845  5625 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:17:50.795346  5625 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:17:50.797148  5625 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:17:50.799774  5625 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:17:50.799968  5625 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:17:50.800295  5625 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:17:50.800441  5625 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:17:50.847856  5625 rpc_server.cc:307] RPC server started. Bound to: 127.5.126.67:46051
I20260709 13:17:50.848106  6423 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.5.126.67:46051 every 8 connection(s)
I20260709 13:17:50.862777  6424 heartbeater.cc:344] Connected to a master server at 127.5.126.126:40217
I20260709 13:17:50.863281  6424 heartbeater.cc:461] Registering TS with master...
I20260709 13:17:50.864216  6424 heartbeater.cc:507] Master 127.5.126.126:40217 requested a full tablet report, sending...
I20260709 13:17:50.866532  6148 ts_manager.cc:194] Registered new tserver with Master: 4efd9e6155f94224952be95c3785290e (127.5.126.67:46051)
I20260709 13:17:50.867444  5625 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.016229737s
I20260709 13:17:50.868222  6148 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:58554
I20260709 13:17:50.897367  6148 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:58568:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s""\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:17:50.900728  6148 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:17:50.977742  6240 tablet_service.cc:1511] Processing CreateTablet for tablet ec94c2acba4a4333a9db46ab77cd9781 (DEFAULT_TABLE table=test-workload [id=088441f8a0ac4a86bf5afd18c1d422d8]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 13:17:50.977517  6239 tablet_service.cc:1511] Processing CreateTablet for tablet ee893b0b66474d44baaeba294d249e32 (DEFAULT_TABLE table=test-workload [id=088441f8a0ac4a86bf5afd18c1d422d8]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 13:17:50.981567  6238 tablet_service.cc:1511] Processing CreateTablet for tablet 199b09cd4e0d433fafb2e8d5006d113d (DEFAULT_TABLE table=test-workload [id=088441f8a0ac4a86bf5afd18c1d422d8]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 13:17:50.983176  6237 tablet_service.cc:1511] Processing CreateTablet for tablet 879fa203410744a9a1a63d33e0801f07 (DEFAULT_TABLE table=test-workload [id=088441f8a0ac4a86bf5afd18c1d422d8]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 13:17:50.983428  6240 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ec94c2acba4a4333a9db46ab77cd9781. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:50.989360  6315 tablet_service.cc:1511] Processing CreateTablet for tablet ec94c2acba4a4333a9db46ab77cd9781 (DEFAULT_TABLE table=test-workload [id=088441f8a0ac4a86bf5afd18c1d422d8]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 13:17:50.989465  6236 tablet_service.cc:1511] Processing CreateTablet for tablet 82ccb3ed51b2453381692135f3179a54 (DEFAULT_TABLE table=test-workload [id=088441f8a0ac4a86bf5afd18c1d422d8]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 13:17:50.991178  6315 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ec94c2acba4a4333a9db46ab77cd9781. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:50.992779  6311 tablet_service.cc:1511] Processing CreateTablet for tablet 82ccb3ed51b2453381692135f3179a54 (DEFAULT_TABLE table=test-workload [id=088441f8a0ac4a86bf5afd18c1d422d8]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 13:17:50.997632  6311 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 82ccb3ed51b2453381692135f3179a54. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:50.997745  6235 tablet_service.cc:1511] Processing CreateTablet for tablet de207f715322422ba6c06aa6b5ade0fa (DEFAULT_TABLE table=test-workload [id=088441f8a0ac4a86bf5afd18c1d422d8]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 13:17:50.991189  6236 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 82ccb3ed51b2453381692135f3179a54. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:50.999980  6235 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet de207f715322422ba6c06aa6b5ade0fa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:50.996019  6312 tablet_service.cc:1511] Processing CreateTablet for tablet 879fa203410744a9a1a63d33e0801f07 (DEFAULT_TABLE table=test-workload [id=088441f8a0ac4a86bf5afd18c1d422d8]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 13:17:51.001768  6312 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 879fa203410744a9a1a63d33e0801f07. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:50.992779  6314 tablet_service.cc:1511] Processing CreateTablet for tablet ee893b0b66474d44baaeba294d249e32 (DEFAULT_TABLE table=test-workload [id=088441f8a0ac4a86bf5afd18c1d422d8]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 13:17:51.006145  6314 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ee893b0b66474d44baaeba294d249e32. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:51.005896  6310 tablet_service.cc:1511] Processing CreateTablet for tablet de207f715322422ba6c06aa6b5ade0fa (DEFAULT_TABLE table=test-workload [id=088441f8a0ac4a86bf5afd18c1d422d8]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 13:17:51.004494  6237 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 879fa203410744a9a1a63d33e0801f07. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:51.007512  6310 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet de207f715322422ba6c06aa6b5ade0fa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:51.012830  6233 tablet_service.cc:1511] Processing CreateTablet for tablet c7cfe05c9c2f47f487fbf3b81a0a47ca (DEFAULT_TABLE table=test-workload [id=088441f8a0ac4a86bf5afd18c1d422d8]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 13:17:51.014402  6233 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c7cfe05c9c2f47f487fbf3b81a0a47ca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:51.013999  6308 tablet_service.cc:1511] Processing CreateTablet for tablet c7cfe05c9c2f47f487fbf3b81a0a47ca (DEFAULT_TABLE table=test-workload [id=088441f8a0ac4a86bf5afd18c1d422d8]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 13:17:51.015432  6308 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c7cfe05c9c2f47f487fbf3b81a0a47ca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:51.007205  6234 tablet_service.cc:1511] Processing CreateTablet for tablet d51e67b3ea6a458c818b4c7cf67ceef5 (DEFAULT_TABLE table=test-workload [id=088441f8a0ac4a86bf5afd18c1d422d8]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 13:17:51.016394  6239 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ee893b0b66474d44baaeba294d249e32. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:51.008972  6309 tablet_service.cc:1511] Processing CreateTablet for tablet d51e67b3ea6a458c818b4c7cf67ceef5 (DEFAULT_TABLE table=test-workload [id=088441f8a0ac4a86bf5afd18c1d422d8]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 13:17:51.020933  6309 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d51e67b3ea6a458c818b4c7cf67ceef5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:50.994362  6313 tablet_service.cc:1511] Processing CreateTablet for tablet 199b09cd4e0d433fafb2e8d5006d113d (DEFAULT_TABLE table=test-workload [id=088441f8a0ac4a86bf5afd18c1d422d8]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 13:17:51.023967  6234 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d51e67b3ea6a458c818b4c7cf67ceef5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:51.024973  6313 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 199b09cd4e0d433fafb2e8d5006d113d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:51.029647  6232 tablet_service.cc:1511] Processing CreateTablet for tablet e17475c1ea464d1f84e7f36957761cd9 (DEFAULT_TABLE table=test-workload [id=088441f8a0ac4a86bf5afd18c1d422d8]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 13:17:51.031280  6232 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e17475c1ea464d1f84e7f36957761cd9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:51.032430  6238 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 199b09cd4e0d433fafb2e8d5006d113d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:51.061921  6231 tablet_service.cc:1511] Processing CreateTablet for tablet 87b6f7d6ab0742c0a8247c7bc6cbe4eb (DEFAULT_TABLE table=test-workload [id=088441f8a0ac4a86bf5afd18c1d422d8]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 13:17:51.063683  6231 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 87b6f7d6ab0742c0a8247c7bc6cbe4eb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:51.070928  6386 tablet_service.cc:1511] Processing CreateTablet for tablet 879fa203410744a9a1a63d33e0801f07 (DEFAULT_TABLE table=test-workload [id=088441f8a0ac4a86bf5afd18c1d422d8]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 13:17:51.071391  6385 tablet_service.cc:1511] Processing CreateTablet for tablet 82ccb3ed51b2453381692135f3179a54 (DEFAULT_TABLE table=test-workload [id=088441f8a0ac4a86bf5afd18c1d422d8]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 13:17:51.073078  6385 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 82ccb3ed51b2453381692135f3179a54. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:51.073241  6384 tablet_service.cc:1511] Processing CreateTablet for tablet de207f715322422ba6c06aa6b5ade0fa (DEFAULT_TABLE table=test-workload [id=088441f8a0ac4a86bf5afd18c1d422d8]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 13:17:51.074671  6384 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet de207f715322422ba6c06aa6b5ade0fa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:51.077281  6383 tablet_service.cc:1511] Processing CreateTablet for tablet d51e67b3ea6a458c818b4c7cf67ceef5 (DEFAULT_TABLE table=test-workload [id=088441f8a0ac4a86bf5afd18c1d422d8]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 13:17:51.078673  6383 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d51e67b3ea6a458c818b4c7cf67ceef5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:51.081332  6382 tablet_service.cc:1511] Processing CreateTablet for tablet c7cfe05c9c2f47f487fbf3b81a0a47ca (DEFAULT_TABLE table=test-workload [id=088441f8a0ac4a86bf5afd18c1d422d8]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 13:17:51.082688  6382 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c7cfe05c9c2f47f487fbf3b81a0a47ca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:51.085474  6381 tablet_service.cc:1511] Processing CreateTablet for tablet e17475c1ea464d1f84e7f36957761cd9 (DEFAULT_TABLE table=test-workload [id=088441f8a0ac4a86bf5afd18c1d422d8]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 13:17:51.087142  6381 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e17475c1ea464d1f84e7f36957761cd9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:51.089190  6388 tablet_service.cc:1511] Processing CreateTablet for tablet ee893b0b66474d44baaeba294d249e32 (DEFAULT_TABLE table=test-workload [id=088441f8a0ac4a86bf5afd18c1d422d8]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 13:17:51.090586  6388 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ee893b0b66474d44baaeba294d249e32. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:51.093151  6387 tablet_service.cc:1511] Processing CreateTablet for tablet 199b09cd4e0d433fafb2e8d5006d113d (DEFAULT_TABLE table=test-workload [id=088441f8a0ac4a86bf5afd18c1d422d8]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 13:17:51.094523  6387 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 199b09cd4e0d433fafb2e8d5006d113d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:51.096516  6389 tablet_service.cc:1511] Processing CreateTablet for tablet ec94c2acba4a4333a9db46ab77cd9781 (DEFAULT_TABLE table=test-workload [id=088441f8a0ac4a86bf5afd18c1d422d8]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 13:17:51.098058  6389 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ec94c2acba4a4333a9db46ab77cd9781. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:51.100533  6386 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 879fa203410744a9a1a63d33e0801f07. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:51.128451  6310 tablet_service.cc:1511] Processing CreateTablet for tablet e17475c1ea464d1f84e7f36957761cd9 (DEFAULT_TABLE table=test-workload [id=088441f8a0ac4a86bf5afd18c1d422d8]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 13:17:51.137001  6310 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e17475c1ea464d1f84e7f36957761cd9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:51.160924  6440 tablet_bootstrap.cc:492] T 82ccb3ed51b2453381692135f3179a54 P b7aed7f4e45b499992f30b4cf32b8961: Bootstrap starting.
I20260709 13:17:51.173671  6439 tablet_bootstrap.cc:492] T de207f715322422ba6c06aa6b5ade0fa P 215a40d9cebb42d9906c6e4616e2950a: Bootstrap starting.
I20260709 13:17:51.174045  6313 tablet_service.cc:1511] Processing CreateTablet for tablet 87b6f7d6ab0742c0a8247c7bc6cbe4eb (DEFAULT_TABLE table=test-workload [id=088441f8a0ac4a86bf5afd18c1d422d8]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 13:17:51.175595  6313 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 87b6f7d6ab0742c0a8247c7bc6cbe4eb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:51.179968  6440 tablet_bootstrap.cc:654] T 82ccb3ed51b2453381692135f3179a54 P b7aed7f4e45b499992f30b4cf32b8961: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:51.187417  6386 tablet_service.cc:1511] Processing CreateTablet for tablet 87b6f7d6ab0742c0a8247c7bc6cbe4eb (DEFAULT_TABLE table=test-workload [id=088441f8a0ac4a86bf5afd18c1d422d8]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 13:17:51.188774  6386 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 87b6f7d6ab0742c0a8247c7bc6cbe4eb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:51.191732  6439 tablet_bootstrap.cc:654] T de207f715322422ba6c06aa6b5ade0fa P 215a40d9cebb42d9906c6e4616e2950a: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:51.211529  6442 tablet_bootstrap.cc:492] T de207f715322422ba6c06aa6b5ade0fa P 4efd9e6155f94224952be95c3785290e: Bootstrap starting.
I20260709 13:17:51.222755  6442 tablet_bootstrap.cc:654] T de207f715322422ba6c06aa6b5ade0fa P 4efd9e6155f94224952be95c3785290e: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:51.226994  6440 tablet_bootstrap.cc:492] T 82ccb3ed51b2453381692135f3179a54 P b7aed7f4e45b499992f30b4cf32b8961: No bootstrap required, opened a new log
I20260709 13:17:51.228055  6440 ts_tablet_manager.cc:1403] T 82ccb3ed51b2453381692135f3179a54 P b7aed7f4e45b499992f30b4cf32b8961: Time spent bootstrapping tablet: real 0.067s	user 0.020s	sys 0.004s
I20260709 13:17:51.228922  6439 tablet_bootstrap.cc:492] T de207f715322422ba6c06aa6b5ade0fa P 215a40d9cebb42d9906c6e4616e2950a: No bootstrap required, opened a new log
I20260709 13:17:51.229490  6439 ts_tablet_manager.cc:1403] T de207f715322422ba6c06aa6b5ade0fa P 215a40d9cebb42d9906c6e4616e2950a: Time spent bootstrapping tablet: real 0.056s	user 0.009s	sys 0.013s
I20260709 13:17:51.233103  6439 raft_consensus.cc:359] T de207f715322422ba6c06aa6b5ade0fa P 215a40d9cebb42d9906c6e4616e2950a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "215a40d9cebb42d9906c6e4616e2950a" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 40171 } } peers { permanent_uuid: "b7aed7f4e45b499992f30b4cf32b8961" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 33867 } } peers { permanent_uuid: "4efd9e6155f94224952be95c3785290e" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 46051 } }
I20260709 13:17:51.233144  6440 raft_consensus.cc:359] T 82ccb3ed51b2453381692135f3179a54 P b7aed7f4e45b499992f30b4cf32b8961 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "215a40d9cebb42d9906c6e4616e2950a" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 40171 } } peers { permanent_uuid: "b7aed7f4e45b499992f30b4cf32b8961" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 33867 } } peers { permanent_uuid: "4efd9e6155f94224952be95c3785290e" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 46051 } }
I20260709 13:17:51.234153  6439 raft_consensus.cc:385] T de207f715322422ba6c06aa6b5ade0fa P 215a40d9cebb42d9906c6e4616e2950a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:51.234333  6440 raft_consensus.cc:385] T 82ccb3ed51b2453381692135f3179a54 P b7aed7f4e45b499992f30b4cf32b8961 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:51.234592  6439 raft_consensus.cc:740] T de207f715322422ba6c06aa6b5ade0fa P 215a40d9cebb42d9906c6e4616e2950a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 215a40d9cebb42d9906c6e4616e2950a, State: Initialized, Role: FOLLOWER
I20260709 13:17:51.234716  6440 raft_consensus.cc:740] T 82ccb3ed51b2453381692135f3179a54 P b7aed7f4e45b499992f30b4cf32b8961 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b7aed7f4e45b499992f30b4cf32b8961, State: Initialized, Role: FOLLOWER
I20260709 13:17:51.235620  6439 consensus_queue.cc:260] T de207f715322422ba6c06aa6b5ade0fa P 215a40d9cebb42d9906c6e4616e2950a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "215a40d9cebb42d9906c6e4616e2950a" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 40171 } } peers { permanent_uuid: "b7aed7f4e45b499992f30b4cf32b8961" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 33867 } } peers { permanent_uuid: "4efd9e6155f94224952be95c3785290e" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 46051 } }
I20260709 13:17:51.235661  6440 consensus_queue.cc:260] T 82ccb3ed51b2453381692135f3179a54 P b7aed7f4e45b499992f30b4cf32b8961 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "215a40d9cebb42d9906c6e4616e2950a" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 40171 } } peers { permanent_uuid: "b7aed7f4e45b499992f30b4cf32b8961" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 33867 } } peers { permanent_uuid: "4efd9e6155f94224952be95c3785290e" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 46051 } }
I20260709 13:17:51.236670  6442 tablet_bootstrap.cc:492] T de207f715322422ba6c06aa6b5ade0fa P 4efd9e6155f94224952be95c3785290e: No bootstrap required, opened a new log
I20260709 13:17:51.237200  6442 ts_tablet_manager.cc:1403] T de207f715322422ba6c06aa6b5ade0fa P 4efd9e6155f94224952be95c3785290e: Time spent bootstrapping tablet: real 0.026s	user 0.013s	sys 0.009s
I20260709 13:17:51.238999  6439 ts_tablet_manager.cc:1434] T de207f715322422ba6c06aa6b5ade0fa P 215a40d9cebb42d9906c6e4616e2950a: Time spent starting tablet: real 0.009s	user 0.009s	sys 0.000s
I20260709 13:17:51.239008  6275 heartbeater.cc:499] Master 127.5.126.126:40217 was elected leader, sending a full tablet report...
I20260709 13:17:51.240082  6439 tablet_bootstrap.cc:492] T 879fa203410744a9a1a63d33e0801f07 P 215a40d9cebb42d9906c6e4616e2950a: Bootstrap starting.
I20260709 13:17:51.242810  6442 raft_consensus.cc:359] T de207f715322422ba6c06aa6b5ade0fa P 4efd9e6155f94224952be95c3785290e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "215a40d9cebb42d9906c6e4616e2950a" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 40171 } } peers { permanent_uuid: "b7aed7f4e45b499992f30b4cf32b8961" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 33867 } } peers { permanent_uuid: "4efd9e6155f94224952be95c3785290e" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 46051 } }
I20260709 13:17:51.243706  6442 raft_consensus.cc:385] T de207f715322422ba6c06aa6b5ade0fa P 4efd9e6155f94224952be95c3785290e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:51.244131  6442 raft_consensus.cc:740] T de207f715322422ba6c06aa6b5ade0fa P 4efd9e6155f94224952be95c3785290e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4efd9e6155f94224952be95c3785290e, State: Initialized, Role: FOLLOWER
I20260709 13:17:51.245146  6442 consensus_queue.cc:260] T de207f715322422ba6c06aa6b5ade0fa P 4efd9e6155f94224952be95c3785290e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "215a40d9cebb42d9906c6e4616e2950a" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 40171 } } peers { permanent_uuid: "b7aed7f4e45b499992f30b4cf32b8961" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 33867 } } peers { permanent_uuid: "4efd9e6155f94224952be95c3785290e" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 46051 } }
I20260709 13:17:51.247167  6439 tablet_bootstrap.cc:654] T 879fa203410744a9a1a63d33e0801f07 P 215a40d9cebb42d9906c6e4616e2950a: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:51.248024  6350 heartbeater.cc:499] Master 127.5.126.126:40217 was elected leader, sending a full tablet report...
I20260709 13:17:51.248415  6440 ts_tablet_manager.cc:1434] T 82ccb3ed51b2453381692135f3179a54 P b7aed7f4e45b499992f30b4cf32b8961: Time spent starting tablet: real 0.020s	user 0.008s	sys 0.011s
I20260709 13:17:51.249586  6440 tablet_bootstrap.cc:492] T de207f715322422ba6c06aa6b5ade0fa P b7aed7f4e45b499992f30b4cf32b8961: Bootstrap starting.
I20260709 13:17:51.256986  6440 tablet_bootstrap.cc:654] T de207f715322422ba6c06aa6b5ade0fa P b7aed7f4e45b499992f30b4cf32b8961: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:51.278177  6424 heartbeater.cc:499] Master 127.5.126.126:40217 was elected leader, sending a full tablet report...
I20260709 13:17:51.278692  6442 ts_tablet_manager.cc:1434] T de207f715322422ba6c06aa6b5ade0fa P 4efd9e6155f94224952be95c3785290e: Time spent starting tablet: real 0.041s	user 0.012s	sys 0.020s
I20260709 13:17:51.280555  6442 tablet_bootstrap.cc:492] T 199b09cd4e0d433fafb2e8d5006d113d P 4efd9e6155f94224952be95c3785290e: Bootstrap starting.
I20260709 13:17:51.289724  6442 tablet_bootstrap.cc:654] T 199b09cd4e0d433fafb2e8d5006d113d P 4efd9e6155f94224952be95c3785290e: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:51.305060  6442 tablet_bootstrap.cc:492] T 199b09cd4e0d433fafb2e8d5006d113d P 4efd9e6155f94224952be95c3785290e: No bootstrap required, opened a new log
I20260709 13:17:51.305881  6442 ts_tablet_manager.cc:1403] T 199b09cd4e0d433fafb2e8d5006d113d P 4efd9e6155f94224952be95c3785290e: Time spent bootstrapping tablet: real 0.026s	user 0.022s	sys 0.000s
I20260709 13:17:51.310323  6442 raft_consensus.cc:359] T 199b09cd4e0d433fafb2e8d5006d113d P 4efd9e6155f94224952be95c3785290e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "215a40d9cebb42d9906c6e4616e2950a" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 40171 } } peers { permanent_uuid: "b7aed7f4e45b499992f30b4cf32b8961" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 33867 } } peers { permanent_uuid: "4efd9e6155f94224952be95c3785290e" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 46051 } }
I20260709 13:17:51.311429  6442 raft_consensus.cc:385] T 199b09cd4e0d433fafb2e8d5006d113d P 4efd9e6155f94224952be95c3785290e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:51.311892  6442 raft_consensus.cc:740] T 199b09cd4e0d433fafb2e8d5006d113d P 4efd9e6155f94224952be95c3785290e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4efd9e6155f94224952be95c3785290e, State: Initialized, Role: FOLLOWER
I20260709 13:17:51.313264  6442 consensus_queue.cc:260] T 199b09cd4e0d433fafb2e8d5006d113d P 4efd9e6155f94224952be95c3785290e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "215a40d9cebb42d9906c6e4616e2950a" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 40171 } } peers { permanent_uuid: "b7aed7f4e45b499992f30b4cf32b8961" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 33867 } } peers { permanent_uuid: "4efd9e6155f94224952be95c3785290e" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 46051 } }
I20260709 13:17:51.316255  6442 ts_tablet_manager.cc:1434] T 199b09cd4e0d433fafb2e8d5006d113d P 4efd9e6155f94224952be95c3785290e: Time spent starting tablet: real 0.010s	user 0.009s	sys 0.000s
I20260709 13:17:51.317456  6442 tablet_bootstrap.cc:492] T ec94c2acba4a4333a9db46ab77cd9781 P 4efd9e6155f94224952be95c3785290e: Bootstrap starting.
I20260709 13:17:51.320230  6439 tablet_bootstrap.cc:492] T 879fa203410744a9a1a63d33e0801f07 P 215a40d9cebb42d9906c6e4616e2950a: No bootstrap required, opened a new log
I20260709 13:17:51.320896  6439 ts_tablet_manager.cc:1403] T 879fa203410744a9a1a63d33e0801f07 P 215a40d9cebb42d9906c6e4616e2950a: Time spent bootstrapping tablet: real 0.081s	user 0.050s	sys 0.026s
I20260709 13:17:51.322135  6440 tablet_bootstrap.cc:492] T de207f715322422ba6c06aa6b5ade0fa P b7aed7f4e45b499992f30b4cf32b8961: No bootstrap required, opened a new log
I20260709 13:17:51.322824  6440 ts_tablet_manager.cc:1403] T de207f715322422ba6c06aa6b5ade0fa P b7aed7f4e45b499992f30b4cf32b8961: Time spent bootstrapping tablet: real 0.074s	user 0.031s	sys 0.040s
I20260709 13:17:51.323751  6442 tablet_bootstrap.cc:654] T ec94c2acba4a4333a9db46ab77cd9781 P 4efd9e6155f94224952be95c3785290e: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:51.324194  6439 raft_consensus.cc:359] T 879fa203410744a9a1a63d33e0801f07 P 215a40d9cebb42d9906c6e4616e2950a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "215a40d9cebb42d9906c6e4616e2950a" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 40171 } } peers { permanent_uuid: "b7aed7f4e45b499992f30b4cf32b8961" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 33867 } } peers { permanent_uuid: "4efd9e6155f94224952be95c3785290e" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 46051 } }
I20260709 13:17:51.325047  6439 raft_consensus.cc:385] T 879fa203410744a9a1a63d33e0801f07 P 215a40d9cebb42d9906c6e4616e2950a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:51.325398  6439 raft_consensus.cc:740] T 879fa203410744a9a1a63d33e0801f07 P 215a40d9cebb42d9906c6e4616e2950a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 215a40d9cebb42d9906c6e4616e2950a, State: Initialized, Role: FOLLOWER
I20260709 13:17:51.326227  6440 raft_consensus.cc:359] T de207f715322422ba6c06aa6b5ade0fa P b7aed7f4e45b499992f30b4cf32b8961 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "215a40d9cebb42d9906c6e4616e2950a" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 40171 } } peers { permanent_uuid: "b7aed7f4e45b499992f30b4cf32b8961" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 33867 } } peers { permanent_uuid: "4efd9e6155f94224952be95c3785290e" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 46051 } }
I20260709 13:17:51.327225  6440 raft_consensus.cc:385] T de207f715322422ba6c06aa6b5ade0fa P b7aed7f4e45b499992f30b4cf32b8961 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:51.326385  6439 consensus_queue.cc:260] T 879fa203410744a9a1a63d33e0801f07 P 215a40d9cebb42d9906c6e4616e2950a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "215a40d9cebb42d9906c6e4616e2950a" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 40171 } } peers { permanent_uuid: "b7aed7f4e45b499992f30b4cf32b8961" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 33867 } } peers { permanent_uuid: "4efd9e6155f94224952be95c3785290e" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 46051 } }
I20260709 13:17:51.327572  6440 raft_consensus.cc:740] T de207f715322422ba6c06aa6b5ade0fa P b7aed7f4e45b499992f30b4cf32b8961 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b7aed7f4e45b499992f30b4cf32b8961, State: Initialized, Role: FOLLOWER
I20260709 13:17:51.328788  6440 consensus_queue.cc:260] T de207f715322422ba6c06aa6b5ade0fa P b7aed7f4e45b499992f30b4cf32b8961 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "215a40d9cebb42d9906c6e4616e2950a" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 40171 } } peers { permanent_uuid: "b7aed7f4e45b499992f30b4cf32b8961" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 33867 } } peers { permanent_uuid: "4efd9e6155f94224952be95c3785290e" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 46051 } }
I20260709 13:17:51.330461  6439 ts_tablet_manager.cc:1434] T 879fa203410744a9a1a63d33e0801f07 P 215a40d9cebb42d9906c6e4616e2950a: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 13:17:51.331113  6440 ts_tablet_manager.cc:1434] T de207f715322422ba6c06aa6b5ade0fa P b7aed7f4e45b499992f30b4cf32b8961: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.000s
I20260709 13:17:51.332257  6440 tablet_bootstrap.cc:492] T ee893b0b66474d44baaeba294d249e32 P b7aed7f4e45b499992f30b4cf32b8961: Bootstrap starting.
I20260709 13:17:51.332284  6439 tablet_bootstrap.cc:492] T c7cfe05c9c2f47f487fbf3b81a0a47ca P 215a40d9cebb42d9906c6e4616e2950a: Bootstrap starting.
I20260709 13:17:51.342630  6440 tablet_bootstrap.cc:654] T ee893b0b66474d44baaeba294d249e32 P b7aed7f4e45b499992f30b4cf32b8961: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:51.344696  6439 tablet_bootstrap.cc:654] T c7cfe05c9c2f47f487fbf3b81a0a47ca P 215a40d9cebb42d9906c6e4616e2950a: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:51.344950  6442 tablet_bootstrap.cc:492] T ec94c2acba4a4333a9db46ab77cd9781 P 4efd9e6155f94224952be95c3785290e: No bootstrap required, opened a new log
I20260709 13:17:51.345589  6442 ts_tablet_manager.cc:1403] T ec94c2acba4a4333a9db46ab77cd9781 P 4efd9e6155f94224952be95c3785290e: Time spent bootstrapping tablet: real 0.028s	user 0.009s	sys 0.017s
I20260709 13:17:51.349184  6442 raft_consensus.cc:359] T ec94c2acba4a4333a9db46ab77cd9781 P 4efd9e6155f94224952be95c3785290e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "215a40d9cebb42d9906c6e4616e2950a" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 40171 } } peers { permanent_uuid: "b7aed7f4e45b499992f30b4cf32b8961" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 33867 } } peers { permanent_uuid: "4efd9e6155f94224952be95c3785290e" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 46051 } }
I20260709 13:17:51.350323  6442 raft_consensus.cc:385] T ec94c2acba4a4333a9db46ab77cd9781 P 4efd9e6155f94224952be95c3785290e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:51.350770  6442 raft_consensus.cc:740] T ec94c2acba4a4333a9db46ab77cd9781 P 4efd9e6155f94224952be95c3785290e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4efd9e6155f94224952be95c3785290e, State: Initialized, Role: FOLLOWER
I20260709 13:17:51.352159  6442 consensus_queue.cc:260] T ec94c2acba4a4333a9db46ab77cd9781 P 4efd9e6155f94224952be95c3785290e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "215a40d9cebb42d9906c6e4616e2950a" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 40171 } } peers { permanent_uuid: "b7aed7f4e45b499992f30b4cf32b8961" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 33867 } } peers { permanent_uuid: "4efd9e6155f94224952be95c3785290e" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 46051 } }
I20260709 13:17:51.355324  6442 ts_tablet_manager.cc:1434] T ec94c2acba4a4333a9db46ab77cd9781 P 4efd9e6155f94224952be95c3785290e: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.001s
I20260709 13:17:51.356408  6442 tablet_bootstrap.cc:492] T 879fa203410744a9a1a63d33e0801f07 P 4efd9e6155f94224952be95c3785290e: Bootstrap starting.
I20260709 13:17:51.356703  6440 tablet_bootstrap.cc:492] T ee893b0b66474d44baaeba294d249e32 P b7aed7f4e45b499992f30b4cf32b8961: No bootstrap required, opened a new log
I20260709 13:17:51.356884  6439 tablet_bootstrap.cc:492] T c7cfe05c9c2f47f487fbf3b81a0a47ca P 215a40d9cebb42d9906c6e4616e2950a: No bootstrap required, opened a new log
I20260709 13:17:51.357493  6439 ts_tablet_manager.cc:1403] T c7cfe05c9c2f47f487fbf3b81a0a47ca P 215a40d9cebb42d9906c6e4616e2950a: Time spent bootstrapping tablet: real 0.026s	user 0.014s	sys 0.007s
I20260709 13:17:51.357412  6440 ts_tablet_manager.cc:1403] T ee893b0b66474d44baaeba294d249e32 P b7aed7f4e45b499992f30b4cf32b8961: Time spent bootstrapping tablet: real 0.025s	user 0.006s	sys 0.016s
I20260709 13:17:51.360754  6439 raft_consensus.cc:359] T c7cfe05c9c2f47f487fbf3b81a0a47ca P 215a40d9cebb42d9906c6e4616e2950a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "215a40d9cebb42d9906c6e4616e2950a" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 40171 } } peers { permanent_uuid: "b7aed7f4e45b499992f30b4cf32b8961" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 33867 } } peers { permanent_uuid: "4efd9e6155f94224952be95c3785290e" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 46051 } }
I20260709 13:17:51.361531  6439 raft_consensus.cc:385] T c7cfe05c9c2f47f487fbf3b81a0a47ca P 215a40d9cebb42d9906c6e4616e2950a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:51.361953  6439 raft_consensus.cc:740] T c7cfe05c9c2f47f487fbf3b81a0a47ca P 215a40d9cebb42d9906c6e4616e2950a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 215a40d9cebb42d9906c6e4616e2950a, State: Initialized, Role: FOLLOWER
I20260709 13:17:51.361075  6440 raft_consensus.cc:359] T ee893b0b66474d44baaeba294d249e32 P b7aed7f4e45b499992f30b4cf32b8961 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "215a40d9cebb42d9906c6e4616e2950a" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 40171 } } peers { permanent_uuid: "b7aed7f4e45b499992f30b4cf32b8961" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 33867 } } peers { permanent_uuid: "4efd9e6155f94224952be95c3785290e" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 46051 } }
I20260709 13:17:51.362603  6440 raft_consensus.cc:385] T ee893b0b66474d44baaeba294d249e32 P b7aed7f4e45b499992f30b4cf32b8961 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:51.362969  6440 raft_consensus.cc:740] T ee893b0b66474d44baaeba294d249e32 P b7aed7f4e45b499992f30b4cf32b8961 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b7aed7f4e45b499992f30b4cf32b8961, State: Initialized, Role: FOLLOWER
I20260709 13:17:51.363513  6442 tablet_bootstrap.cc:654] T 879fa203410744a9a1a63d33e0801f07 P 4efd9e6155f94224952be95c3785290e: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:51.363015  6439 consensus_queue.cc:260] T c7cfe05c9c2f47f487fbf3b81a0a47ca P 215a40d9cebb42d9906c6e4616e2950a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "215a40d9cebb42d9906c6e4616e2950a" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 40171 } } peers { permanent_uuid: "b7aed7f4e45b499992f30b4cf32b8961" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 33867 } } peers { permanent_uuid: "4efd9e6155f94224952be95c3785290e" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 46051 } }
I20260709 13:17:51.364138  6440 consensus_queue.cc:260] T ee893b0b66474d44baaeba294d249e32 P b7aed7f4e45b499992f30b4cf32b8961 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "215a40d9cebb42d9906c6e4616e2950a" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 40171 } } peers { permanent_uuid: "b7aed7f4e45b499992f30b4cf32b8961" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 33867 } } peers { permanent_uuid: "4efd9e6155f94224952be95c3785290e" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 46051 } }
I20260709 13:17:51.369076  6439 ts_tablet_manager.cc:1434] T c7cfe05c9c2f47f487fbf3b81a0a47ca P 215a40d9cebb42d9906c6e4616e2950a: Time spent starting tablet: real 0.011s	user 0.008s	sys 0.001s
I20260709 13:17:51.370479  6440 ts_tablet_manager.cc:1434] T ee893b0b66474d44baaeba294d249e32 P b7aed7f4e45b499992f30b4cf32b8961: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.000s
I20260709 13:17:51.371870  6440 tablet_bootstrap.cc:492] T 199b09cd4e0d433fafb2e8d5006d113d P b7aed7f4e45b499992f30b4cf32b8961: Bootstrap starting.
I20260709 13:17:51.370468  6439 tablet_bootstrap.cc:492] T e17475c1ea464d1f84e7f36957761cd9 P 215a40d9cebb42d9906c6e4616e2950a: Bootstrap starting.
I20260709 13:17:51.376175  6442 tablet_bootstrap.cc:492] T 879fa203410744a9a1a63d33e0801f07 P 4efd9e6155f94224952be95c3785290e: No bootstrap required, opened a new log
I20260709 13:17:51.376806  6442 ts_tablet_manager.cc:1403] T 879fa203410744a9a1a63d33e0801f07 P 4efd9e6155f94224952be95c3785290e: Time spent bootstrapping tablet: real 0.021s	user 0.010s	sys 0.007s
I20260709 13:17:51.379913  6440 tablet_bootstrap.cc:654] T 199b09cd4e0d433fafb2e8d5006d113d P b7aed7f4e45b499992f30b4cf32b8961: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:51.380085  6439 tablet_bootstrap.cc:654] T e17475c1ea464d1f84e7f36957761cd9 P 215a40d9cebb42d9906c6e4616e2950a: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:51.379799  6442 raft_consensus.cc:359] T 879fa203410744a9a1a63d33e0801f07 P 4efd9e6155f94224952be95c3785290e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "215a40d9cebb42d9906c6e4616e2950a" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 40171 } } peers { permanent_uuid: "b7aed7f4e45b499992f30b4cf32b8961" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 33867 } } peers { permanent_uuid: "4efd9e6155f94224952be95c3785290e" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 46051 } }
I20260709 13:17:51.380923  6442 raft_consensus.cc:385] T 879fa203410744a9a1a63d33e0801f07 P 4efd9e6155f94224952be95c3785290e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:51.381332  6442 raft_consensus.cc:740] T 879fa203410744a9a1a63d33e0801f07 P 4efd9e6155f94224952be95c3785290e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4efd9e6155f94224952be95c3785290e, State: Initialized, Role: FOLLOWER
I20260709 13:17:51.384482  6442 consensus_queue.cc:260] T 879fa203410744a9a1a63d33e0801f07 P 4efd9e6155f94224952be95c3785290e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "215a40d9cebb42d9906c6e4616e2950a" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 40171 } } peers { permanent_uuid: "b7aed7f4e45b499992f30b4cf32b8961" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 33867 } } peers { permanent_uuid: "4efd9e6155f94224952be95c3785290e" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 46051 } }
I20260709 13:17:51.385244  6446 raft_consensus.cc:493] T de207f715322422ba6c06aa6b5ade0fa P b7aed7f4e45b499992f30b4cf32b8961 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:51.385811  6446 raft_consensus.cc:515] T de207f715322422ba6c06aa6b5ade0fa P b7aed7f4e45b499992f30b4cf32b8961 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "215a40d9cebb42d9906c6e4616e2950a" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 40171 } } peers { permanent_uuid: "b7aed7f4e45b499992f30b4cf32b8961" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 33867 } } peers { permanent_uuid: "4efd9e6155f94224952be95c3785290e" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 46051 } }
I20260709 13:17:51.387645  6447 raft_consensus.cc:493] T 879fa203410744a9a1a63d33e0801f07 P 4efd9e6155f94224952be95c3785290e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:51.388353  6447 raft_consensus.cc:515] T 879fa203410744a9a1a63d33e0801f07 P 4efd9e6155f94224952be95c3785290e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "215a40d9cebb42d9906c6e4616e2950a" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 40171 } } peers { permanent_uuid: "b7aed7f4e45b499992f30b4cf32b8961" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 33867 } } peers { permanent_uuid: "4efd9e6155f94224952be95c3785290e" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 46051 } }
I20260709 13:17:51.397878  6447 leader_election.cc:290] T 879fa203410744a9a1a63d33e0801f07 P 4efd9e6155f94224952be95c3785290e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 215a40d9cebb42d9906c6e4616e2950a (127.5.126.65:40171), b7aed7f4e45b499992f30b4cf32b8961 (127.5.126.66:33867)
I20260709 13:17:51.398165  6446 leader_election.cc:290] T de207f715322422ba6c06aa6b5ade0fa P b7aed7f4e45b499992f30b4cf32b8961 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 215a40d9cebb42d9906c6e4616e2950a (127.5.126.65:40171), 4efd9e6155f94224952be95c3785290e (127.5.126.67:46051)
I20260709 13:17:51.404125  6442 ts_tablet_manager.cc:1434] T 879fa203410744a9a1a63d33e0801f07 P 4efd9e6155f94224952be95c3785290e: Time spent starting tablet: real 0.027s	user 0.006s	sys 0.003s
I20260709 13:17:51.407225  6442 tablet_bootstrap.cc:492] T 82ccb3ed51b2453381692135f3179a54 P 4efd9e6155f94224952be95c3785290e: Bootstrap starting.
I20260709 13:17:51.421186  6442 tablet_bootstrap.cc:654] T 82ccb3ed51b2453381692135f3179a54 P 4efd9e6155f94224952be95c3785290e: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:51.424597  6439 tablet_bootstrap.cc:492] T e17475c1ea464d1f84e7f36957761cd9 P 215a40d9cebb42d9906c6e4616e2950a: No bootstrap required, opened a new log
I20260709 13:17:51.425135  6439 ts_tablet_manager.cc:1403] T e17475c1ea464d1f84e7f36957761cd9 P 215a40d9cebb42d9906c6e4616e2950a: Time spent bootstrapping tablet: real 0.055s	user 0.034s	sys 0.016s
I20260709 13:17:51.428889  6439 raft_consensus.cc:359] T e17475c1ea464d1f84e7f36957761cd9 P 215a40d9cebb42d9906c6e4616e2950a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "215a40d9cebb42d9906c6e4616e2950a" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 40171 } } peers { permanent_uuid: "b7aed7f4e45b499992f30b4cf32b8961" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 33867 } } peers { permanent_uuid: "4efd9e6155f94224952be95c3785290e" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 46051 } }
I20260709 13:17:51.429639  6439 raft_consensus.cc:385] T e17475c1ea464d1f84e7f36957761cd9 P 215a40d9cebb42d9906c6e4616e2950a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:51.429916  6439 raft_consensus.cc:740] T e17475c1ea464d1f84e7f36957761cd9 P 215a40d9cebb42d9906c6e4616e2950a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 215a40d9cebb42d9906c6e4616e2950a, State: Initialized, Role: FOLLOWER
I20260709 13:17:51.430872  6439 consensus_queue.cc:260] T e17475c1ea464d1f84e7f36957761cd9 P 215a40d9cebb42d9906c6e4616e2950a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "215a40d9cebb42d9906c6e4616e2950a" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 40171 } } peers { permanent_uuid: "b7aed7f4e45b499992f30b4cf32b8961" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 33867 } } peers { permanent_uuid: "4efd9e6155f94224952be95c3785290e" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 46051 } }
I20260709 13:17:51.436350  6439 ts_tablet_manager.cc:1434] T e17475c1ea464d1f84e7f36957761cd9 P 215a40d9cebb42d9906c6e4616e2950a: Time spent starting tablet: real 0.011s	user 0.008s	sys 0.001s
I20260709 13:17:51.437429  6439 tablet_bootstrap.cc:492] T d51e67b3ea6a458c818b4c7cf67ceef5 P 215a40d9cebb42d9906c6e4616e2950a: Bootstrap starting.
W20260709 13:17:51.438657  6196 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:17:51.443743  6442 tablet_bootstrap.cc:492] T 82ccb3ed51b2453381692135f3179a54 P 4efd9e6155f94224952be95c3785290e: No bootstrap required, opened a new log
I20260709 13:17:51.444396  6442 ts_tablet_manager.cc:1403] T 82ccb3ed51b2453381692135f3179a54 P 4efd9e6155f94224952be95c3785290e: Time spent bootstrapping tablet: real 0.038s	user 0.020s	sys 0.002s
I20260709 13:17:51.445779  6439 tablet_bootstrap.cc:654] T d51e67b3ea6a458c818b4c7cf67ceef5 P 215a40d9cebb42d9906c6e4616e2950a: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:51.447552  6442 raft_consensus.cc:359] T 82ccb3ed51b2453381692135f3179a54 P 4efd9e6155f94224952be95c3785290e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "215a40d9cebb42d9906c6e4616e2950a" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 40171 } } peers { permanent_uuid: "b7aed7f4e45b499992f30b4cf32b8961" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 33867 } } peers { permanent_uuid: "4efd9e6155f94224952be95c3785290e" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 46051 } }
I20260709 13:17:51.448426  6442 raft_consensus.cc:385] T 82ccb3ed51b2453381692135f3179a54 P 4efd9e6155f94224952be95c3785290e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:51.448838  6442 raft_consensus.cc:740] T 82ccb3ed51b2453381692135f3179a54 P 4efd9e6155f94224952be95c3785290e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4efd9e6155f94224952be95c3785290e, State: Initialized, Role: FOLLOWER
I20260709 13:17:51.450322  6442 consensus_queue.cc:260] T 82ccb3ed51b2453381692135f3179a54 P 4efd9e6155f94224952be95c3785290e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "215a40d9cebb42d9906c6e4616e2950a" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 40171 } } peers { permanent_uuid: "b7aed7f4e45b499992f30b4cf32b8961" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 33867 } } peers { permanent_uuid: "4efd9e6155f94224952be95c3785290e" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 46051 } }
I20260709 13:17:51.453984  6442 ts_tablet_manager.cc:1434] T 82ccb3ed51b2453381692135f3179a54 P 4efd9e6155f94224952be95c3785290e: Time spent starting tablet: real 0.009s	user 0.003s	sys 0.003s
I20260709 13:17:51.455495  6442 tablet_bootstrap.cc:492] T ee893b0b66474d44baaeba294d249e32 P 4efd9e6155f94224952be95c3785290e: Bootstrap starting.
I20260709 13:17:51.457973  6447 raft_consensus.cc:493] T de207f715322422ba6c06aa6b5ade0fa P 4efd9e6155f94224952be95c3785290e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:51.458585  6447 raft_consensus.cc:515] T de207f715322422ba6c06aa6b5ade0fa P 4efd9e6155f94224952be95c3785290e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "215a40d9cebb42d9906c6e4616e2950a" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 40171 } } peers { permanent_uuid: "b7aed7f4e45b499992f30b4cf32b8961" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 33867 } } peers { permanent_uuid: "4efd9e6155f94224952be95c3785290e" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 46051 } }
I20260709 13:17:51.460942  6447 leader_election.cc:290] T de207f715322422ba6c06aa6b5ade0fa P 4efd9e6155f94224952be95c3785290e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 215a40d9cebb42d9906c6e4616e2950a (127.5.126.65:40171), b7aed7f4e45b499992f30b4cf32b8961 (127.5.126.66:33867)
I20260709 13:17:51.461747  6445 raft_consensus.cc:493] T 879fa203410744a9a1a63d33e0801f07 P 215a40d9cebb42d9906c6e4616e2950a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:51.462319  6445 raft_consensus.cc:515] T 879fa203410744a9a1a63d33e0801f07 P 215a40d9cebb42d9906c6e4616e2950a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "215a40d9cebb42d9906c6e4616e2950a" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 40171 } } peers { permanent_uuid: "b7aed7f4e45b499992f30b4cf32b8961" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 33867 } } peers { permanent_uuid: "4efd9e6155f94224952be95c3785290e" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 46051 } }
I20260709 13:17:51.464484  6442 tablet_bootstrap.cc:654] T ee893b0b66474d44baaeba294d249e32 P 4efd9e6155f94224952be95c3785290e: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:51.471829  6445 leader_election.cc:290] T 879fa203410744a9a1a63d33e0801f07 P 215a40d9cebb42d9906c6e4616e2950a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b7aed7f4e45b499992f30b4cf32b8961 (127.5.126.66:33867), 4efd9e6155f94224952be95c3785290e (127.5.126.67:46051)
I20260709 13:17:51.475615  6399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de207f715322422ba6c06aa6b5ade0fa" candidate_uuid: "b7aed7f4e45b499992f30b4cf32b8961" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4efd9e6155f94224952be95c3785290e" is_pre_election: true
I20260709 13:17:51.476619  6399 raft_consensus.cc:2468] T de207f715322422ba6c06aa6b5ade0fa P 4efd9e6155f94224952be95c3785290e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7aed7f4e45b499992f30b4cf32b8961 in term 0.
I20260709 13:17:51.479548  6288 leader_election.cc:304] T de207f715322422ba6c06aa6b5ade0fa P b7aed7f4e45b499992f30b4cf32b8961 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4efd9e6155f94224952be95c3785290e, b7aed7f4e45b499992f30b4cf32b8961; no voters: 
I20260709 13:17:51.480517  6440 tablet_bootstrap.cc:492] T 199b09cd4e0d433fafb2e8d5006d113d P b7aed7f4e45b499992f30b4cf32b8961: No bootstrap required, opened a new log
I20260709 13:17:51.480703  6446 raft_consensus.cc:2804] T de207f715322422ba6c06aa6b5ade0fa P b7aed7f4e45b499992f30b4cf32b8961 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:51.481166  6446 raft_consensus.cc:493] T de207f715322422ba6c06aa6b5ade0fa P b7aed7f4e45b499992f30b4cf32b8961 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:51.481343  6440 ts_tablet_manager.cc:1403] T 199b09cd4e0d433fafb2e8d5006d113d P b7aed7f4e45b499992f30b4cf32b8961: Time spent bootstrapping tablet: real 0.110s	user 0.022s	sys 0.009s
I20260709 13:17:51.481578  6446 raft_consensus.cc:3060] T de207f715322422ba6c06aa6b5ade0fa P b7aed7f4e45b499992f30b4cf32b8961 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:51.489683  6250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "879fa203410744a9a1a63d33e0801f07" candidate_uuid: "4efd9e6155f94224952be95c3785290e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "215a40d9cebb42d9906c6e4616e2950a" is_pre_election: true
I20260709 13:17:51.491155  6250 raft_consensus.cc:2468] T 879fa203410744a9a1a63d33e0801f07 P 215a40d9cebb42d9906c6e4616e2950a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4efd9e6155f94224952be95c3785290e in term 0.
I20260709 13:17:51.492800  6249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de207f715322422ba6c06aa6b5ade0fa" candidate_uuid: "4efd9e6155f94224952be95c3785290e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "215a40d9cebb42d9906c6e4616e2950a" is_pre_election: true
I20260709 13:17:51.493502  6446 raft_consensus.cc:515] T de207f715322422ba6c06aa6b5ade0fa P b7aed7f4e45b499992f30b4cf32b8961 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "215a40d9cebb42d9906c6e4616e2950a" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 40171 } } peers { permanent_uuid: "b7aed7f4e45b499992f30b4cf32b8961" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 33867 } } peers { permanent_uuid: "4efd9e6155f94224952be95c3785290e" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 46051 } }
I20260709 13:17:51.493546  6249 raft_consensus.cc:2468] T de207f715322422ba6c06aa6b5ade0fa P 215a40d9cebb42d9906c6e4616e2950a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4efd9e6155f94224952be95c3785290e in term 0.
I20260709 13:17:51.495543  6365 leader_election.cc:304] T 879fa203410744a9a1a63d33e0801f07 P 4efd9e6155f94224952be95c3785290e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 215a40d9cebb42d9906c6e4616e2950a, 4efd9e6155f94224952be95c3785290e; no voters: 
I20260709 13:17:51.496346  6442 tablet_bootstrap.cc:492] T ee893b0b66474d44baaeba294d249e32 P 4efd9e6155f94224952be95c3785290e: No bootstrap required, opened a new log
I20260709 13:17:51.496944  6442 ts_tablet_manager.cc:1403] T ee893b0b66474d44baaeba294d249e32 P 4efd9e6155f94224952be95c3785290e: Time spent bootstrapping tablet: real 0.042s	user 0.018s	sys 0.002s
I20260709 13:17:51.497264  6439 tablet_bootstrap.cc:492] T d51e67b3ea6a458c818b4c7cf67ceef5 P 215a40d9cebb42d9906c6e4616e2950a: No bootstrap required, opened a new log
I20260709 13:17:51.497848  6439 ts_tablet_manager.cc:1403] T d51e67b3ea6a458c818b4c7cf67ceef5 P 215a40d9cebb42d9906c6e4616e2950a: Time spent bootstrapping tablet: real 0.061s	user 0.016s	sys 0.010s
I20260709 13:17:51.499464  6325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "879fa203410744a9a1a63d33e0801f07" candidate_uuid: "4efd9e6155f94224952be95c3785290e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b7aed7f4e45b499992f30b4cf32b8961" is_pre_election: true
W20260709 13:17:51.504693  6362 leader_election.cc:343] T 879fa203410744a9a1a63d33e0801f07 P 4efd9e6155f94224952be95c3785290e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b7aed7f4e45b499992f30b4cf32b8961 (127.5.126.66:33867): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:51.506095  6440 raft_consensus.cc:359] T 199b09cd4e0d433fafb2e8d5006d113d P b7aed7f4e45b499992f30b4cf32b8961 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "215a40d9cebb42d9906c6e4616e2950a" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 40171 } } peers { permanent_uuid: "b7aed7f4e45b499992f30b4cf32b8961" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 33867 } } peers { permanent_uuid: "4efd9e6155f94224952be95c3785290e" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 46051 } }
I20260709 13:17:51.499975  6399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de207f715322422ba6c06aa6b5ade0fa" candidate_uuid: "b7aed7f4e45b499992f30b4cf32b8961" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4efd9e6155f94224952be95c3785290e"
I20260709 13:17:51.509696  6440 raft_consensus.cc:385] T 199b09cd4e0d433fafb2e8d5006d113d P b7aed7f4e45b499992f30b4cf32b8961 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:51.500936  6324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de207f715322422ba6c06aa6b5ade0fa" candidate_uuid: "4efd9e6155f94224952be95c3785290e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b7aed7f4e45b499992f30b4cf32b8961" is_pre_election: true
I20260709 13:17:51.501046  6365 leader_election.cc:304] T de207f715322422ba6c06aa6b5ade0fa P 4efd9e6155f94224952be95c3785290e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 215a40d9cebb42d9906c6e4616e2950a, 4efd9e6155f94224952be95c3785290e; no voters: 
I20260709 13:17:51.501364  6447 raft_consensus.cc:2804] T 879fa203410744a9a1a63d33e0801f07 P 4efd9e6155f94224952be95c3785290e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:51.510073  6440 raft_consensus.cc:740] T 199b09cd4e0d433fafb2e8d5006d113d P b7aed7f4e45b499992f30b4cf32b8961 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b7aed7f4e45b499992f30b4cf32b8961, State: Initialized, Role: FOLLOWER
I20260709 13:17:51.510406  6447 raft_consensus.cc:493] T 879fa203410744a9a1a63d33e0801f07 P 4efd9e6155f94224952be95c3785290e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:51.510576  6324 raft_consensus.cc:2393] T de207f715322422ba6c06aa6b5ade0fa P b7aed7f4e45b499992f30b4cf32b8961 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4efd9e6155f94224952be95c3785290e in current term 1: Already voted for candidate b7aed7f4e45b499992f30b4cf32b8961 in this term.
I20260709 13:17:51.510809  6447 raft_consensus.cc:3060] T 879fa203410744a9a1a63d33e0801f07 P 4efd9e6155f94224952be95c3785290e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:51.509841  6399 raft_consensus.cc:3060] T de207f715322422ba6c06aa6b5ade0fa P 4efd9e6155f94224952be95c3785290e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:51.510913  6440 consensus_queue.cc:260] T 199b09cd4e0d433fafb2e8d5006d113d P b7aed7f4e45b499992f30b4cf32b8961 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "215a40d9cebb42d9906c6e4616e2950a" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 40171 } } peers { permanent_uuid: "b7aed7f4e45b499992f30b4cf32b8961" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 33867 } } peers { permanent_uuid: "4efd9e6155f94224952be95c3785290e" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 46051 } }
I20260709 13:17:51.506774  6250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de207f715322422ba6c06aa6b5ade0fa" candidate_uuid: "b7aed7f4e45b499992f30b4cf32b8961" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "215a40d9cebb42d9906c6e4616e2950a"
I20260709 13:17:51.516485  6250 raft_consensus.cc:3060] T de207f715322422ba6c06aa6b5ade0fa P 215a40d9cebb42d9906c6e4616e2950a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:51.519316  6399 raft_consensus.cc:2468] T de207f715322422ba6c06aa6b5ade0fa P 4efd9e6155f94224952be95c3785290e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7aed7f4e45b499992f30b4cf32b8961 in term 1.
I20260709 13:17:51.507611  6249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de207f715322422ba6c06aa6b5ade0fa" candidate_uuid: "b7aed7f4e45b499992f30b4cf32b8961" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "215a40d9cebb42d9906c6e4616e2950a" is_pre_election: true
I20260709 13:17:51.499712  6446 leader_election.cc:290] T de207f715322422ba6c06aa6b5ade0fa P b7aed7f4e45b499992f30b4cf32b8961 [CANDIDATE]: Term 1 election: Requested vote from peers 215a40d9cebb42d9906c6e4616e2950a (127.5.126.65:40171), 4efd9e6155f94224952be95c3785290e (127.5.126.67:46051)
I20260709 13:17:51.520676  6288 leader_election.cc:304] T de207f715322422ba6c06aa6b5ade0fa P b7aed7f4e45b499992f30b4cf32b8961 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4efd9e6155f94224952be95c3785290e, b7aed7f4e45b499992f30b4cf32b8961; no voters: 
I20260709 13:17:51.521625  6446 raft_consensus.cc:2804] T de207f715322422ba6c06aa6b5ade0fa P b7aed7f4e45b499992f30b4cf32b8961 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:51.522126  6446 raft_consensus.cc:697] T de207f715322422ba6c06aa6b5ade0fa P b7aed7f4e45b499992f30b4cf32b8961 [term 1 LEADER]: Becoming Leader. State: Replica: b7aed7f4e45b499992f30b4cf32b8961, State: Running, Role: LEADER
I20260709 13:17:51.523044  6446 consensus_queue.cc:237] T de207f715322422ba6c06aa6b5ade0fa P b7aed7f4e45b499992f30b4cf32b8961 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "215a40d9cebb42d9906c6e4616e2950a" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 40171 } } peers { permanent_uuid: "b7aed7f4e45b499992f30b4cf32b8961" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 33867 } } peers { permanent_uuid: "4efd9e6155f94224952be95c3785290e" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 46051 } }
I20260709 13:17:51.508314  6442 raft_consensus.cc:359] T ee893b0b66474d44baaeba294d249e32 P 4efd9e6155f94224952be95c3785290e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "215a40d9cebb42d9906c6e4616e2950a" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 40171 } } peers { permanent_uuid: "b7aed7f4e45b499992f30b4cf32b8961" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 33867 } } peers { permanent_uuid: "4efd9e6155f94224952be95c3785290e" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 46051 } }
I20260709 13:17:51.508597  6439 raft_consensus.cc:359] T d51e67b3ea6a458c818b4c7cf67ceef5 P 215a40d9cebb42d9906c6e4616e2950a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "215a40d9cebb42d9906c6e4616e2950a" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 40171 } } peers { permanent_uuid: "b7aed7f4e45b499992f30b4cf32b8961" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 33867 } } peers { permanent_uuid: "4efd9e6155f94224952be95c3785290e" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 46051 } }
I20260709 13:17:51.533079  6442 raft_consensus.cc:385] T ee893b0b66474d44baaeba294d249e32 P 4efd9e6155f94224952be95c3785290e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:51.533192  6439 raft_consensus.cc:385] T d51e67b3ea6a458c818b4c7cf67ceef5 P 215a40d9cebb42d9906c6e4616e2950a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:51.533648  6442 raft_consensus.cc:740] T ee893b0b66474d44baaeba294d249e32 P 4efd9e6155f94224952be95c3785290e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4efd9e6155f94224952be95c3785290e, State: Initialized, Role: FOLLOWER
I20260709 13:17:51.533736  6439 raft_consensus.cc:740] T d51e67b3ea6a458c818b4c7cf67ceef5 P 215a40d9cebb42d9906c6e4616e2950a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 215a40d9cebb42d9906c6e4616e2950a, State: Initialized, Role: FOLLOWER
I20260709 13:17:51.532552  6250 raft_consensus.cc:2468] T de207f715322422ba6c06aa6b5ade0fa P 215a40d9cebb42d9906c6e4616e2950a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7aed7f4e45b499992f30b4cf32b8961 in term 1.
I20260709 13:17:51.534796  6439 consensus_queue.cc:260] T d51e67b3ea6a458c818b4c7cf67ceef5 P 215a40d9cebb42d9906c6e4616e2950a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "215a40d9cebb42d9906c6e4616e2950a" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 40171 } } peers { permanent_uuid: "b7aed7f4e45b499992f30b4cf32b8961" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 33867 } } peers { permanent_uuid: "4efd9e6155f94224952be95c3785290e" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 46051 } }
I20260709 13:17:51.534862  6442 consensus_queue.cc:260] T ee893b0b66474d44baaeba294d249e32 P 4efd9e6155f94224952be95c3785290e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "215a40d9cebb42d9906c6e4616e2950a" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 40171 } } peers { permanent_uuid: "b7aed7f4e45b499992f30b4cf32b8961" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 33867 } } peers { permanent_uuid: "4efd9e6155f94224952be95c3785290e" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 46051 } }
I20260709 13:17:51.535869  6470 raft_consensus.cc:493] T 82ccb3ed51b2453381692135f3179a54 P b7aed7f4e45b499992f30b4cf32b8961 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:51.537549  6470 raft_consensus.cc:515] T 82ccb3ed51b2453381692135f3179a54 P b7aed7f4e45b499992f30b4cf32b8961 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "215a40d9cebb42d9906c6e4616e2950a" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 40171 } } peers { permanent_uuid: "b7aed7f4e45b499992f30b4cf32b8961" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 33867 } } peers { permanent_uuid: "4efd9e6155f94224952be95c3785290e" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 46051 } }
I20260709 13:17:51.538094  6439 ts_tablet_manager.cc:1434] T d51e67b3ea6a458c818b4c7cf67ceef5 P 215a40d9cebb42d9906c6e4616e2950a: Time spent starting tablet: real 0.035s	user 0.007s	sys 0.000s
I20260709 13:17:51.539417  6439 tablet_bootstrap.cc:492] T 199b09cd4e0d433fafb2e8d5006d113d P 215a40d9cebb42d9906c6e4616e2950a: Bootstrap starting.
I20260709 13:17:51.542913  6445 raft_consensus.cc:493] T c7cfe05c9c2f47f487fbf3b81a0a47ca P 215a40d9cebb42d9906c6e4616e2950a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:51.543601  6445 raft_consensus.cc:515] T c7cfe05c9c2f47f487fbf3b81a0a47ca P 215a40d9cebb42d9906c6e4616e2950a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "215a40d9cebb42d9906c6e4616e2950a" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 40171 } } peers { permanent_uuid: "b7aed7f4e45b499992f30b4cf32b8961" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 33867 } } peers { permanent_uuid: "4efd9e6155f94224952be95c3785290e" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 46051 } }
I20260709 13:17:51.546595  6445 leader_election.cc:290] T c7cfe05c9c2f47f487fbf3b81a0a47ca P 215a40d9cebb42d9906c6e4616e2950a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b7aed7f4e45b499992f30b4cf32b8961 (127.5.126.66:33867), 4efd9e6155f94224952be95c3785290e (127.5.126.67:46051)
I20260709 13:17:51.547144  6439 tablet_bootstrap.cc:654] T 199b09cd4e0d433fafb2e8d5006d113d P 215a40d9cebb42d9906c6e4616e2950a: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:51.548169  6447 raft_consensus.cc:515] T 879fa203410744a9a1a63d33e0801f07 P 4efd9e6155f94224952be95c3785290e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "215a40d9cebb42d9906c6e4616e2950a" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 40171 } } peers { permanent_uuid: "b7aed7f4e45b499992f30b4cf32b8961" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 33867 } } peers { permanent_uuid: "4efd9e6155f94224952be95c3785290e" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 46051 } }
I20260709 13:17:51.555397  6470 leader_election.cc:290] T 82ccb3ed51b2453381692135f3179a54 P b7aed7f4e45b499992f30b4cf32b8961 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 215a40d9cebb42d9906c6e4616e2950a (127.5.126.65:40171), 4efd9e6155f94224952be95c3785290e (127.5.126.67:46051)
I20260709 13:17:51.552533  6399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82ccb3ed51b2453381692135f3179a54" candidate_uuid: "b7aed7f4e45b499992f30b4cf32b8961" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4efd9e6155f94224952be95c3785290e" is_pre_election: true
I20260709 13:17:51.552641  6249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82ccb3ed51b2453381692135f3179a54" candidate_uuid: "b7aed7f4e45b499992f30b4cf32b8961" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "215a40d9cebb42d9906c6e4616e2950a" is_pre_election: true
I20260709 13:17:51.555713  6398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "879fa203410744a9a1a63d33e0801f07" candidate_uuid: "215a40d9cebb42d9906c6e4616e2950a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4efd9e6155f94224952be95c3785290e" is_pre_election: true
I20260709 13:17:51.553467  6469 raft_consensus.cc:2764] T de207f715322422ba6c06aa6b5ade0fa P 4efd9e6155f94224952be95c3785290e [term 1 FOLLOWER]: Leader pre-election decision vote started in defunct term 0: won
I20260709 13:17:51.557679  6399 raft_consensus.cc:2468] T 82ccb3ed51b2453381692135f3179a54 P 4efd9e6155f94224952be95c3785290e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7aed7f4e45b499992f30b4cf32b8961 in term 0.
W20260709 13:17:51.557353  6291 leader_election.cc:343] T 82ccb3ed51b2453381692135f3179a54 P b7aed7f4e45b499992f30b4cf32b8961 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 215a40d9cebb42d9906c6e4616e2950a (127.5.126.65:40171): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:51.559515  6288 leader_election.cc:304] T 82ccb3ed51b2453381692135f3179a54 P b7aed7f4e45b499992f30b4cf32b8961 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4efd9e6155f94224952be95c3785290e, b7aed7f4e45b499992f30b4cf32b8961; no voters: 215a40d9cebb42d9906c6e4616e2950a
I20260709 13:17:51.556027  6470 raft_consensus.cc:493] T ee893b0b66474d44baaeba294d249e32 P b7aed7f4e45b499992f30b4cf32b8961 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:51.560474  6470 raft_consensus.cc:515] T ee893b0b66474d44baaeba294d249e32 P b7aed7f4e45b499992f30b4cf32b8961 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "215a40d9cebb42d9906c6e4616e2950a" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 40171 } } peers { permanent_uuid: "b7aed7f4e45b499992f30b4cf32b8961" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 33867 } } peers { permanent_uuid: "4efd9e6155f94224952be95c3785290e" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 46051 } }
I20260709 13:17:51.556830  6398 raft_consensus.cc:2393] T 879fa203410744a9a1a63d33e0801f07 P 4efd9e6155f94224952be95c3785290e [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 215a40d9cebb42d9906c6e4616e2950a in current term 1: Already voted for candidate 4efd9e6155f94224952be95c3785290e in this term.
I20260709 13:17:51.562636  6447 leader_election.cc:290] T 879fa203410744a9a1a63d33e0801f07 P 4efd9e6155f94224952be95c3785290e [CANDIDATE]: Term 1 election: Requested vote from peers 215a40d9cebb42d9906c6e4616e2950a (127.5.126.65:40171), b7aed7f4e45b499992f30b4cf32b8961 (127.5.126.66:33867)
I20260709 13:17:51.564591  6249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee893b0b66474d44baaeba294d249e32" candidate_uuid: "b7aed7f4e45b499992f30b4cf32b8961" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "215a40d9cebb42d9906c6e4616e2950a" is_pre_election: true
W20260709 13:17:51.566619  6291 leader_election.cc:343] T ee893b0b66474d44baaeba294d249e32 P b7aed7f4e45b499992f30b4cf32b8961 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 215a40d9cebb42d9906c6e4616e2950a (127.5.126.65:40171): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:51.567767  6398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee893b0b66474d44baaeba294d249e32" candidate_uuid: "b7aed7f4e45b499992f30b4cf32b8961" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4efd9e6155f94224952be95c3785290e" is_pre_election: true
I20260709 13:17:51.568816  6398 raft_consensus.cc:2468] T ee893b0b66474d44baaeba294d249e32 P 4efd9e6155f94224952be95c3785290e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7aed7f4e45b499992f30b4cf32b8961 in term 0.
I20260709 13:17:51.570607  6397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7cfe05c9c2f47f487fbf3b81a0a47ca" candidate_uuid: "215a40d9cebb42d9906c6e4616e2950a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4efd9e6155f94224952be95c3785290e" is_pre_election: true
I20260709 13:17:51.571206  6470 leader_election.cc:290] T ee893b0b66474d44baaeba294d249e32 P b7aed7f4e45b499992f30b4cf32b8961 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 215a40d9cebb42d9906c6e4616e2950a (127.5.126.65:40171), 4efd9e6155f94224952be95c3785290e (127.5.126.67:46051)
I20260709 13:17:51.572085  6288 leader_election.cc:304] T ee893b0b66474d44baaeba294d249e32 P b7aed7f4e45b499992f30b4cf32b8961 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4efd9e6155f94224952be95c3785290e, b7aed7f4e45b499992f30b4cf32b8961; no voters: 215a40d9cebb42d9906c6e4616e2950a
I20260709 13:17:51.567750  6442 ts_tablet_manager.cc:1434] T ee893b0b66474d44baaeba294d249e32 P 4efd9e6155f94224952be95c3785290e: Time spent starting tablet: real 0.070s	user 0.007s	sys 0.007s
I20260709 13:17:51.573155  6440 ts_tablet_manager.cc:1434] T 199b09cd4e0d433fafb2e8d5006d113d P b7aed7f4e45b499992f30b4cf32b8961: Time spent starting tablet: real 0.091s	user 0.032s	sys 0.023s
I20260709 13:17:51.574069  6468 raft_consensus.cc:2804] T ee893b0b66474d44baaeba294d249e32 P b7aed7f4e45b499992f30b4cf32b8961 [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260709 13:17:51.579876  6213 leader_election.cc:343] T c7cfe05c9c2f47f487fbf3b81a0a47ca P 215a40d9cebb42d9906c6e4616e2950a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4efd9e6155f94224952be95c3785290e (127.5.126.67:46051): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:51.580363  6468 raft_consensus.cc:493] T ee893b0b66474d44baaeba294d249e32 P b7aed7f4e45b499992f30b4cf32b8961 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:51.580854  6468 raft_consensus.cc:3060] T ee893b0b66474d44baaeba294d249e32 P b7aed7f4e45b499992f30b4cf32b8961 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:51.581884  6439 tablet_bootstrap.cc:492] T 199b09cd4e0d433fafb2e8d5006d113d P 215a40d9cebb42d9906c6e4616e2950a: No bootstrap required, opened a new log
I20260709 13:17:51.582432  6439 ts_tablet_manager.cc:1403] T 199b09cd4e0d433fafb2e8d5006d113d P 215a40d9cebb42d9906c6e4616e2950a: Time spent bootstrapping tablet: real 0.043s	user 0.006s	sys 0.006s
I20260709 13:17:51.574270  6442 tablet_bootstrap.cc:492] T d51e67b3ea6a458c818b4c7cf67ceef5 P 4efd9e6155f94224952be95c3785290e: Bootstrap starting.
I20260709 13:17:51.584442  6473 raft_consensus.cc:493] T ec94c2acba4a4333a9db46ab77cd9781 P 4efd9e6155f94224952be95c3785290e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:51.584921  6473 raft_consensus.cc:515] T ec94c2acba4a4333a9db46ab77cd9781 P 4efd9e6155f94224952be95c3785290e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "215a40d9cebb42d9906c6e4616e2950a" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 40171 } } peers { permanent_uuid: "b7aed7f4e45b499992f30b4cf32b8961" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 33867 } } peers { permanent_uuid: "4efd9e6155f94224952be95c3785290e" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 46051 } }
I20260709 13:17:51.587309  6473 leader_election.cc:290] T ec94c2acba4a4333a9db46ab77cd9781 P 4efd9e6155f94224952be95c3785290e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 215a40d9cebb42d9906c6e4616e2950a (127.5.126.65:40171), b7aed7f4e45b499992f30b4cf32b8961 (127.5.126.66:33867)
I20260709 13:17:51.571975  6470 raft_consensus.cc:2804] T 82ccb3ed51b2453381692135f3179a54 P b7aed7f4e45b499992f30b4cf32b8961 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:51.575982  6324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "879fa203410744a9a1a63d33e0801f07" candidate_uuid: "215a40d9cebb42d9906c6e4616e2950a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b7aed7f4e45b499992f30b4cf32b8961" is_pre_election: true
I20260709 13:17:51.588279  6250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec94c2acba4a4333a9db46ab77cd9781" candidate_uuid: "4efd9e6155f94224952be95c3785290e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "215a40d9cebb42d9906c6e4616e2950a" is_pre_election: true
I20260709 13:17:51.577875  6440 tablet_bootstrap.cc:492] T ec94c2acba4a4333a9db46ab77cd9781 P b7aed7f4e45b499992f30b4cf32b8961: Bootstrap starting.
I20260709 13:17:51.577649  6325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7cfe05c9c2f47f487fbf3b81a0a47ca" candidate_uuid: "215a40d9cebb42d9906c6e4616e2950a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b7aed7f4e45b499992f30b4cf32b8961" is_pre_election: true
I20260709 13:17:51.588883  6470 raft_consensus.cc:493] T 82ccb3ed51b2453381692135f3179a54 P b7aed7f4e45b499992f30b4cf32b8961 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:51.579247  6323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "879fa203410744a9a1a63d33e0801f07" candidate_uuid: "4efd9e6155f94224952be95c3785290e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b7aed7f4e45b499992f30b4cf32b8961"
I20260709 13:17:51.589304  6470 raft_consensus.cc:3060] T 82ccb3ed51b2453381692135f3179a54 P b7aed7f4e45b499992f30b4cf32b8961 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:17:51.590001  6213 leader_election.cc:343] T 879fa203410744a9a1a63d33e0801f07 P 215a40d9cebb42d9906c6e4616e2950a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b7aed7f4e45b499992f30b4cf32b8961 (127.5.126.66:33867): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:51.590220  6325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec94c2acba4a4333a9db46ab77cd9781" candidate_uuid: "4efd9e6155f94224952be95c3785290e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b7aed7f4e45b499992f30b4cf32b8961" is_pre_election: true
I20260709 13:17:51.590516  6213 leader_election.cc:304] T 879fa203410744a9a1a63d33e0801f07 P 215a40d9cebb42d9906c6e4616e2950a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 215a40d9cebb42d9906c6e4616e2950a; no voters: 4efd9e6155f94224952be95c3785290e, b7aed7f4e45b499992f30b4cf32b8961
I20260709 13:17:51.576166  6249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "879fa203410744a9a1a63d33e0801f07" candidate_uuid: "4efd9e6155f94224952be95c3785290e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "215a40d9cebb42d9906c6e4616e2950a"
I20260709 13:17:51.591239  6249 raft_consensus.cc:3060] T 879fa203410744a9a1a63d33e0801f07 P 215a40d9cebb42d9906c6e4616e2950a [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:17:51.591918  6213 leader_election.cc:343] T c7cfe05c9c2f47f487fbf3b81a0a47ca P 215a40d9cebb42d9906c6e4616e2950a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b7aed7f4e45b499992f30b4cf32b8961 (127.5.126.66:33867): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:51.592389  6213 leader_election.cc:304] T c7cfe05c9c2f47f487fbf3b81a0a47ca P 215a40d9cebb42d9906c6e4616e2950a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 215a40d9cebb42d9906c6e4616e2950a; no voters: 4efd9e6155f94224952be95c3785290e, b7aed7f4e45b499992f30b4cf32b8961
I20260709 13:17:51.594543  6468 raft_consensus.cc:515] T ee893b0b66474d44baaeba294d249e32 P b7aed7f4e45b499992f30b4cf32b8961 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "215a40d9cebb42d9906c6e4616e2950a" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 40171 } } peers { permanent_uuid: "b7aed7f4e45b499992f30b4cf32b8961" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 33867 } } peers { permanent_uuid: "4efd9e6155f94224952be95c3785290e" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 46051 } }
W20260709 13:17:51.595603  6362 leader_election.cc:343] T 879fa203410744a9a1a63d33e0801f07 P 4efd9e6155f94224952be95c3785290e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b7aed7f4e45b499992f30b4cf32b8961 (127.5.126.66:33867): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:17:51.597043  6362 leader_election.cc:343] T ec94c2acba4a4333a9db46ab77cd9781 P 4efd9e6155f94224952be95c3785290e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b7aed7f4e45b499992f30b4cf32b8961 (127.5.126.66:33867): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:51.598256  6248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee893b0b66474d44baaeba294d249e32" candidate_uuid: "b7aed7f4e45b499992f30b4cf32b8961" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "215a40d9cebb42d9906c6e4616e2950a"
I20260709 13:17:51.598665  6439 raft_consensus.cc:359] T 199b09cd4e0d433fafb2e8d5006d113d P 215a40d9cebb42d9906c6e4616e2950a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "215a40d9cebb42d9906c6e4616e2950a" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 40171 } } peers { permanent_uuid: "b7aed7f4e45b499992f30b4cf32b8961" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 33867 } } peers { permanent_uuid: "4efd9e6155f94224952be95c3785290e" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 46051 } }
I20260709 13:17:51.599407  6439 raft_consensus.cc:385] T 199b09cd4e0d433fafb2e8d5006d113d P 215a40d9cebb42d9906c6e4616e2950a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:51.599717  6439 raft_consensus.cc:740] T 199b09cd4e0d433fafb2e8d5006d113d P 215a40d9cebb42d9906c6e4616e2950a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 215a40d9cebb42d9906c6e4616e2950a, State: Initialized, Role: FOLLOWER
W20260709 13:17:51.600214  6291 leader_election.cc:343] T ee893b0b66474d44baaeba294d249e32 P b7aed7f4e45b499992f30b4cf32b8961 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 215a40d9cebb42d9906c6e4616e2950a (127.5.126.65:40171): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:51.602803  6398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee893b0b66474d44baaeba294d249e32" candidate_uuid: "b7aed7f4e45b499992f30b4cf32b8961" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4efd9e6155f94224952be95c3785290e"
I20260709 13:17:51.603426  6398 raft_consensus.cc:3060] T ee893b0b66474d44baaeba294d249e32 P 4efd9e6155f94224952be95c3785290e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:51.610867  6442 tablet_bootstrap.cc:654] T d51e67b3ea6a458c818b4c7cf67ceef5 P 4efd9e6155f94224952be95c3785290e: Neither blocks nor log segments found. Creating new log.
W20260709 13:17:51.613474  6365 leader_election.cc:343] T ec94c2acba4a4333a9db46ab77cd9781 P 4efd9e6155f94224952be95c3785290e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 215a40d9cebb42d9906c6e4616e2950a (127.5.126.65:40171): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:51.613422  6249 raft_consensus.cc:2468] T 879fa203410744a9a1a63d33e0801f07 P 215a40d9cebb42d9906c6e4616e2950a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4efd9e6155f94224952be95c3785290e in term 1.
I20260709 13:17:51.614262  6365 leader_election.cc:304] T ec94c2acba4a4333a9db46ab77cd9781 P 4efd9e6155f94224952be95c3785290e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4efd9e6155f94224952be95c3785290e; no voters: 215a40d9cebb42d9906c6e4616e2950a, b7aed7f4e45b499992f30b4cf32b8961
I20260709 13:17:51.614465  6445 raft_consensus.cc:2749] T 879fa203410744a9a1a63d33e0801f07 P 215a40d9cebb42d9906c6e4616e2950a [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:17:51.615186  6473 raft_consensus.cc:2749] T ec94c2acba4a4333a9db46ab77cd9781 P 4efd9e6155f94224952be95c3785290e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:17:51.615280  6440 tablet_bootstrap.cc:654] T ec94c2acba4a4333a9db46ab77cd9781 P b7aed7f4e45b499992f30b4cf32b8961: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:51.614415  6146 catalog_manager.cc:5697] T de207f715322422ba6c06aa6b5ade0fa P b7aed7f4e45b499992f30b4cf32b8961 reported cstate change: term changed from 0 to 1, leader changed from <none> to b7aed7f4e45b499992f30b4cf32b8961 (127.5.126.66). New cstate: current_term: 1 leader_uuid: "b7aed7f4e45b499992f30b4cf32b8961" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "215a40d9cebb42d9906c6e4616e2950a" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 40171 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b7aed7f4e45b499992f30b4cf32b8961" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 33867 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4efd9e6155f94224952be95c3785290e" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 46051 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:51.616765  6365 leader_election.cc:304] T 879fa203410744a9a1a63d33e0801f07 P 4efd9e6155f94224952be95c3785290e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 215a40d9cebb42d9906c6e4616e2950a, 4efd9e6155f94224952be95c3785290e; no voters: b7aed7f4e45b499992f30b4cf32b8961
I20260709 13:17:51.620630  6473 raft_consensus.cc:2804] T 879fa203410744a9a1a63d33e0801f07 P 4efd9e6155f94224952be95c3785290e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:51.621136  6473 raft_consensus.cc:697] T 879fa203410744a9a1a63d33e0801f07 P 4efd9e6155f94224952be95c3785290e [term 1 LEADER]: Becoming Leader. State: Replica: 4efd9e6155f94224952be95c3785290e, State: Running, Role: LEADER
I20260709 13:17:51.622005  6473 consensus_queue.cc:237] T 879fa203410744a9a1a63d33e0801f07 P 4efd9e6155f94224952be95c3785290e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "215a40d9cebb42d9906c6e4616e2950a" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 40171 } } peers { permanent_uuid: "b7aed7f4e45b499992f30b4cf32b8961" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 33867 } } peers { permanent_uuid: "4efd9e6155f94224952be95c3785290e" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 46051 } }
I20260709 13:17:51.617523  6439 consensus_queue.cc:260] T 199b09cd4e0d433fafb2e8d5006d113d P 215a40d9cebb42d9906c6e4616e2950a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "215a40d9cebb42d9906c6e4616e2950a" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 40171 } } peers { permanent_uuid: "b7aed7f4e45b499992f30b4cf32b8961" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 33867 } } peers { permanent_uuid: "4efd9e6155f94224952be95c3785290e" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 46051 } }
I20260709 13:17:51.618089  6445 raft_consensus.cc:2749] T c7cfe05c9c2f47f487fbf3b81a0a47ca P 215a40d9cebb42d9906c6e4616e2950a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:17:51.625219  6398 raft_consensus.cc:2468] T ee893b0b66474d44baaeba294d249e32 P 4efd9e6155f94224952be95c3785290e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7aed7f4e45b499992f30b4cf32b8961 in term 1.
I20260709 13:17:51.627228  6288 leader_election.cc:304] T ee893b0b66474d44baaeba294d249e32 P b7aed7f4e45b499992f30b4cf32b8961 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4efd9e6155f94224952be95c3785290e, b7aed7f4e45b499992f30b4cf32b8961; no voters: 215a40d9cebb42d9906c6e4616e2950a
I20260709 13:17:51.628443  6439 ts_tablet_manager.cc:1434] T 199b09cd4e0d433fafb2e8d5006d113d P 215a40d9cebb42d9906c6e4616e2950a: Time spent starting tablet: real 0.046s	user 0.010s	sys 0.000s
I20260709 13:17:51.629541  6439 tablet_bootstrap.cc:492] T 82ccb3ed51b2453381692135f3179a54 P 215a40d9cebb42d9906c6e4616e2950a: Bootstrap starting.
I20260709 13:17:51.619963  6470 raft_consensus.cc:515] T 82ccb3ed51b2453381692135f3179a54 P b7aed7f4e45b499992f30b4cf32b8961 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "215a40d9cebb42d9906c6e4616e2950a" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 40171 } } peers { permanent_uuid: "b7aed7f4e45b499992f30b4cf32b8961" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 33867 } } peers { permanent_uuid: "4efd9e6155f94224952be95c3785290e" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 46051 } }
I20260709 13:17:51.632369  6446 raft_consensus.cc:2804] T ee893b0b66474d44baaeba294d249e32 P b7aed7f4e45b499992f30b4cf32b8961 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:51.632897  6446 raft_consensus.cc:697] T ee893b0b66474d44baaeba294d249e32 P b7aed7f4e45b499992f30b4cf32b8961 [term 1 LEADER]: Becoming Leader. State: Replica: b7aed7f4e45b499992f30b4cf32b8961, State: Running, Role: LEADER
I20260709 13:17:51.634321  6470 leader_election.cc:290] T 82ccb3ed51b2453381692135f3179a54 P b7aed7f4e45b499992f30b4cf32b8961 [CANDIDATE]: Term 1 election: Requested vote from peers 215a40d9cebb42d9906c6e4616e2950a (127.5.126.65:40171), 4efd9e6155f94224952be95c3785290e (127.5.126.67:46051)
I20260709 13:17:51.635656  6249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82ccb3ed51b2453381692135f3179a54" candidate_uuid: "b7aed7f4e45b499992f30b4cf32b8961" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "215a40d9cebb42d9906c6e4616e2950a"
W20260709 13:17:51.637238  6213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.66:33867, user_credentials={real_user=slave}} blocked reactor thread for 45333.7us
W20260709 13:17:51.637573  6291 leader_election.cc:343] T 82ccb3ed51b2453381692135f3179a54 P b7aed7f4e45b499992f30b4cf32b8961 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 215a40d9cebb42d9906c6e4616e2950a (127.5.126.65:40171): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:51.639405  6397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82ccb3ed51b2453381692135f3179a54" candidate_uuid: "b7aed7f4e45b499992f30b4cf32b8961" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4efd9e6155f94224952be95c3785290e"
I20260709 13:17:51.641415  6397 raft_consensus.cc:3060] T 82ccb3ed51b2453381692135f3179a54 P 4efd9e6155f94224952be95c3785290e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:51.641819  6439 tablet_bootstrap.cc:654] T 82ccb3ed51b2453381692135f3179a54 P 215a40d9cebb42d9906c6e4616e2950a: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:51.633744  6446 consensus_queue.cc:237] T ee893b0b66474d44baaeba294d249e32 P b7aed7f4e45b499992f30b4cf32b8961 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "215a40d9cebb42d9906c6e4616e2950a" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 40171 } } peers { permanent_uuid: "b7aed7f4e45b499992f30b4cf32b8961" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 33867 } } peers { permanent_uuid: "4efd9e6155f94224952be95c3785290e" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 46051 } }
I20260709 13:17:51.648221  6440 tablet_bootstrap.cc:492] T ec94c2acba4a4333a9db46ab77cd9781 P b7aed7f4e45b499992f30b4cf32b8961: No bootstrap required, opened a new log
I20260709 13:17:51.648877  6440 ts_tablet_manager.cc:1403] T ec94c2acba4a4333a9db46ab77cd9781 P b7aed7f4e45b499992f30b4cf32b8961: Time spent bootstrapping tablet: real 0.075s	user 0.015s	sys 0.026s
I20260709 13:17:51.625779  6468 leader_election.cc:290] T ee893b0b66474d44baaeba294d249e32 P b7aed7f4e45b499992f30b4cf32b8961 [CANDIDATE]: Term 1 election: Requested vote from peers 215a40d9cebb42d9906c6e4616e2950a (127.5.126.65:40171), 4efd9e6155f94224952be95c3785290e (127.5.126.67:46051)
I20260709 13:17:51.650523  6397 raft_consensus.cc:2468] T 82ccb3ed51b2453381692135f3179a54 P 4efd9e6155f94224952be95c3785290e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7aed7f4e45b499992f30b4cf32b8961 in term 1.
I20260709 13:17:51.651747  6288 leader_election.cc:304] T 82ccb3ed51b2453381692135f3179a54 P b7aed7f4e45b499992f30b4cf32b8961 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4efd9e6155f94224952be95c3785290e, b7aed7f4e45b499992f30b4cf32b8961; no voters: 215a40d9cebb42d9906c6e4616e2950a
I20260709 13:17:51.651902  6440 raft_consensus.cc:359] T ec94c2acba4a4333a9db46ab77cd9781 P b7aed7f4e45b499992f30b4cf32b8961 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "215a40d9cebb42d9906c6e4616e2950a" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 40171 } } peers { permanent_uuid: "b7aed7f4e45b499992f30b4cf32b8961" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 33867 } } peers { permanent_uuid: "4efd9e6155f94224952be95c3785290e" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 46051 } }
I20260709 13:17:51.652768  6440 raft_consensus.cc:385] T ec94c2acba4a4333a9db46ab77cd9781 P b7aed7f4e45b499992f30b4cf32b8961 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:51.653299  6442 tablet_bootstrap.cc:492] T d51e67b3ea6a458c818b4c7cf67ceef5 P 4efd9e6155f94224952be95c3785290e: No bootstrap required, opened a new log
I20260709 13:17:51.653147  6468 raft_consensus.cc:2804] T 82ccb3ed51b2453381692135f3179a54 P b7aed7f4e45b499992f30b4cf32b8961 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:51.653322  6440 raft_consensus.cc:740] T ec94c2acba4a4333a9db46ab77cd9781 P b7aed7f4e45b499992f30b4cf32b8961 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b7aed7f4e45b499992f30b4cf32b8961, State: Initialized, Role: FOLLOWER
I20260709 13:17:51.653977  6442 ts_tablet_manager.cc:1403] T d51e67b3ea6a458c818b4c7cf67ceef5 P 4efd9e6155f94224952be95c3785290e: Time spent bootstrapping tablet: real 0.080s	user 0.007s	sys 0.006s
I20260709 13:17:51.654359  6468 raft_consensus.cc:697] T 82ccb3ed51b2453381692135f3179a54 P b7aed7f4e45b499992f30b4cf32b8961 [term 1 LEADER]: Becoming Leader. State: Replica: b7aed7f4e45b499992f30b4cf32b8961, State: Running, Role: LEADER
I20260709 13:17:51.659758  6442 raft_consensus.cc:359] T d51e67b3ea6a458c818b4c7cf67ceef5 P 4efd9e6155f94224952be95c3785290e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "215a40d9cebb42d9906c6e4616e2950a" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 40171 } } peers { permanent_uuid: "b7aed7f4e45b499992f30b4cf32b8961" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 33867 } } peers { permanent_uuid: "4efd9e6155f94224952be95c3785290e" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 46051 } }
I20260709 13:17:51.658623  6440 consensus_queue.cc:260] T ec94c2acba4a4333a9db46ab77cd9781 P b7aed7f4e45b499992f30b4cf32b8961 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "215a40d9cebb42d9906c6e4616e2950a" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 40171 } } peers { permanent_uuid: "b7aed7f4e45b499992f30b4cf32b8961" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 33867 } } peers { permanent_uuid: "4efd9e6155f94224952be95c3785290e" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 46051 } }
I20260709 13:17:51.660619  6442 raft_consensus.cc:385] T d51e67b3ea6a458c818b4c7cf67ceef5 P 4efd9e6155f94224952be95c3785290e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:51.661064  6442 raft_consensus.cc:740] T d51e67b3ea6a458c818b4c7cf67ceef5 P 4efd9e6155f94224952be95c3785290e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4efd9e6155f94224952be95c3785290e, State: Initialized, Role: FOLLOWER
I20260709 13:17:51.662014  6442 consensus_queue.cc:260] T d51e67b3ea6a458c818b4c7cf67ceef5 P 4efd9e6155f94224952be95c3785290e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "215a40d9cebb42d9906c6e4616e2950a" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 40171 } } peers { permanent_uuid: "b7aed7f4e45b499992f30b4cf32b8961" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 33867 } } peers { permanent_uuid: "4efd9e6155f94224952be95c3785290e" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 46051 } }
I20260709 13:17:51.662669  6440 ts_tablet_manager.cc:1434] T ec94c2acba4a4333a9db46ab77cd9781 P b7aed7f4e45b499992f30b4cf32b8961: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.001s
I20260709 13:17:51.663708  6440 tablet_bootstrap.cc:492] T 879fa203410744a9a1a63d33e0801f07 P b7aed7f4e45b499992f30b4cf32b8961: Bootstrap starting.
I20260709 13:17:51.664776  6442 ts_tablet_manager.cc:1434] T d51e67b3ea6a458c818b4c7cf67ceef5 P 4efd9e6155f94224952be95c3785290e: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.002s
I20260709 13:17:51.665962  6442 tablet_bootstrap.cc:492] T c7cfe05c9c2f47f487fbf3b81a0a47ca P 4efd9e6155f94224952be95c3785290e: Bootstrap starting.
I20260709 13:17:51.655712  6468 consensus_queue.cc:237] T 82ccb3ed51b2453381692135f3179a54 P b7aed7f4e45b499992f30b4cf32b8961 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "215a40d9cebb42d9906c6e4616e2950a" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 40171 } } peers { permanent_uuid: "b7aed7f4e45b499992f30b4cf32b8961" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 33867 } } peers { permanent_uuid: "4efd9e6155f94224952be95c3785290e" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 46051 } }
I20260709 13:17:51.673274  6440 tablet_bootstrap.cc:654] T 879fa203410744a9a1a63d33e0801f07 P b7aed7f4e45b499992f30b4cf32b8961: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:51.674639  6147 catalog_manager.cc:5697] T 879fa203410744a9a1a63d33e0801f07 P 4efd9e6155f94224952be95c3785290e reported cstate change: term changed from 0 to 1, leader changed from <none> to 4efd9e6155f94224952be95c3785290e (127.5.126.67). New cstate: current_term: 1 leader_uuid: "4efd9e6155f94224952be95c3785290e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "215a40d9cebb42d9906c6e4616e2950a" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 40171 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b7aed7f4e45b499992f30b4cf32b8961" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 33867 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4efd9e6155f94224952be95c3785290e" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 46051 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:51.677259  6446 raft_consensus.cc:493] T ec94c2acba4a4333a9db46ab77cd9781 P b7aed7f4e45b499992f30b4cf32b8961 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:51.677749  6446 raft_consensus.cc:515] T ec94c2acba4a4333a9db46ab77cd9781 P b7aed7f4e45b499992f30b4cf32b8961 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "215a40d9cebb42d9906c6e4616e2950a" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 40171 } } peers { permanent_uuid: "b7aed7f4e45b499992f30b4cf32b8961" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 33867 } } peers { permanent_uuid: "4efd9e6155f94224952be95c3785290e" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 46051 } }
I20260709 13:17:51.678398  6442 tablet_bootstrap.cc:654] T c7cfe05c9c2f47f487fbf3b81a0a47ca P 4efd9e6155f94224952be95c3785290e: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:51.678398  6439 tablet_bootstrap.cc:492] T 82ccb3ed51b2453381692135f3179a54 P 215a40d9cebb42d9906c6e4616e2950a: No bootstrap required, opened a new log
I20260709 13:17:51.679309  6439 ts_tablet_manager.cc:1403] T 82ccb3ed51b2453381692135f3179a54 P 215a40d9cebb42d9906c6e4616e2950a: Time spent bootstrapping tablet: real 0.050s	user 0.015s	sys 0.010s
I20260709 13:17:51.679914  6446 leader_election.cc:290] T ec94c2acba4a4333a9db46ab77cd9781 P b7aed7f4e45b499992f30b4cf32b8961 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 215a40d9cebb42d9906c6e4616e2950a (127.5.126.65:40171), 4efd9e6155f94224952be95c3785290e (127.5.126.67:46051)
I20260709 13:17:51.683212  6397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec94c2acba4a4333a9db46ab77cd9781" candidate_uuid: "b7aed7f4e45b499992f30b4cf32b8961" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4efd9e6155f94224952be95c3785290e" is_pre_election: true
I20260709 13:17:51.684234  6397 raft_consensus.cc:2468] T ec94c2acba4a4333a9db46ab77cd9781 P 4efd9e6155f94224952be95c3785290e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7aed7f4e45b499992f30b4cf32b8961 in term 0.
I20260709 13:17:51.686436  6249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec94c2acba4a4333a9db46ab77cd9781" candidate_uuid: "b7aed7f4e45b499992f30b4cf32b8961" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "215a40d9cebb42d9906c6e4616e2950a" is_pre_election: true
I20260709 13:17:51.687536  6288 leader_election.cc:304] T ec94c2acba4a4333a9db46ab77cd9781 P b7aed7f4e45b499992f30b4cf32b8961 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4efd9e6155f94224952be95c3785290e, b7aed7f4e45b499992f30b4cf32b8961; no voters: 
I20260709 13:17:51.685076  6473 raft_consensus.cc:493] T 199b09cd4e0d433fafb2e8d5006d113d P 4efd9e6155f94224952be95c3785290e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:51.688855  6446 raft_consensus.cc:2804] T ec94c2acba4a4333a9db46ab77cd9781 P b7aed7f4e45b499992f30b4cf32b8961 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:51.688753  6473 raft_consensus.cc:515] T 199b09cd4e0d433fafb2e8d5006d113d P 4efd9e6155f94224952be95c3785290e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "215a40d9cebb42d9906c6e4616e2950a" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 40171 } } peers { permanent_uuid: "b7aed7f4e45b499992f30b4cf32b8961" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 33867 } } peers { permanent_uuid: "4efd9e6155f94224952be95c3785290e" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 46051 } }
I20260709 13:17:51.689483  6446 raft_consensus.cc:493] T ec94c2acba4a4333a9db46ab77cd9781 P b7aed7f4e45b499992f30b4cf32b8961 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:51.689996  6446 raft_consensus.cc:3060] T ec94c2acba4a4333a9db46ab77cd9781 P b7aed7f4e45b499992f30b4cf32b8961 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:51.683614  6439 raft_consensus.cc:359] T 82ccb3ed51b2453381692135f3179a54 P 215a40d9cebb42d9906c6e4616e2950a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "215a40d9cebb42d9906c6e4616e2950a" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 40171 } } peers { permanent_uuid: "b7aed7f4e45b499992f30b4cf32b8961" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 33867 } } peers { permanent_uuid: "4efd9e6155f94224952be95c3785290e" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 46051 } }
I20260709 13:17:51.692723  6250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "199b09cd4e0d433fafb2e8d5006d113d" candidate_uuid: "4efd9e6155f94224952be95c3785290e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "215a40d9cebb42d9906c6e4616e2950a" is_pre_election: true
W20260709 13:17:51.694396  6291 leader_election.cc:343] T ec94c2acba4a4333a9db46ab77cd9781 P b7aed7f4e45b499992f30b4cf32b8961 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 215a40d9cebb42d9906c6e4616e2950a (127.5.126.65:40171): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:51.695773  6250 raft_consensus.cc:2468] T 199b09cd4e0d433fafb2e8d5006d113d P 215a40d9cebb42d9906c6e4616e2950a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4efd9e6155f94224952be95c3785290e in term 0.
I20260709 13:17:51.696251  6325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "199b09cd4e0d433fafb2e8d5006d113d" candidate_uuid: "4efd9e6155f94224952be95c3785290e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b7aed7f4e45b499992f30b4cf32b8961" is_pre_election: true
I20260709 13:17:51.693215  6473 leader_election.cc:290] T 199b09cd4e0d433fafb2e8d5006d113d P 4efd9e6155f94224952be95c3785290e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 215a40d9cebb42d9906c6e4616e2950a (127.5.126.65:40171), b7aed7f4e45b499992f30b4cf32b8961 (127.5.126.66:33867)
I20260709 13:17:51.696900  6325 raft_consensus.cc:2468] T 199b09cd4e0d433fafb2e8d5006d113d P b7aed7f4e45b499992f30b4cf32b8961 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4efd9e6155f94224952be95c3785290e in term 0.
I20260709 13:17:51.694872  6439 raft_consensus.cc:385] T 82ccb3ed51b2453381692135f3179a54 P 215a40d9cebb42d9906c6e4616e2950a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:51.701822  6442 tablet_bootstrap.cc:492] T c7cfe05c9c2f47f487fbf3b81a0a47ca P 4efd9e6155f94224952be95c3785290e: No bootstrap required, opened a new log
I20260709 13:17:51.698343  6439 raft_consensus.cc:740] T 82ccb3ed51b2453381692135f3179a54 P 215a40d9cebb42d9906c6e4616e2950a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 215a40d9cebb42d9906c6e4616e2950a, State: Initialized, Role: FOLLOWER
I20260709 13:17:51.697414  6365 leader_election.cc:304] T 199b09cd4e0d433fafb2e8d5006d113d P 4efd9e6155f94224952be95c3785290e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 215a40d9cebb42d9906c6e4616e2950a, 4efd9e6155f94224952be95c3785290e; no voters: 
I20260709 13:17:51.707456  6442 ts_tablet_manager.cc:1403] T c7cfe05c9c2f47f487fbf3b81a0a47ca P 4efd9e6155f94224952be95c3785290e: Time spent bootstrapping tablet: real 0.042s	user 0.017s	sys 0.008s
I20260709 13:17:51.707875  6439 consensus_queue.cc:260] T 82ccb3ed51b2453381692135f3179a54 P 215a40d9cebb42d9906c6e4616e2950a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "215a40d9cebb42d9906c6e4616e2950a" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 40171 } } peers { permanent_uuid: "b7aed7f4e45b499992f30b4cf32b8961" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 33867 } } peers { permanent_uuid: "4efd9e6155f94224952be95c3785290e" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 46051 } }
I20260709 13:17:51.708247  6473 raft_consensus.cc:2804] T 199b09cd4e0d433fafb2e8d5006d113d P 4efd9e6155f94224952be95c3785290e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:51.708985  6473 raft_consensus.cc:493] T 199b09cd4e0d433fafb2e8d5006d113d P 4efd9e6155f94224952be95c3785290e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:51.709367  6473 raft_consensus.cc:3060] T 199b09cd4e0d433fafb2e8d5006d113d P 4efd9e6155f94224952be95c3785290e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:51.710529  6442 raft_consensus.cc:359] T c7cfe05c9c2f47f487fbf3b81a0a47ca P 4efd9e6155f94224952be95c3785290e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "215a40d9cebb42d9906c6e4616e2950a" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 40171 } } peers { permanent_uuid: "b7aed7f4e45b499992f30b4cf32b8961" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 33867 } } peers { permanent_uuid: "4efd9e6155f94224952be95c3785290e" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 46051 } }
I20260709 13:17:51.711231  6442 raft_consensus.cc:385] T c7cfe05c9c2f47f487fbf3b81a0a47ca P 4efd9e6155f94224952be95c3785290e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:51.711505  6442 raft_consensus.cc:740] T c7cfe05c9c2f47f487fbf3b81a0a47ca P 4efd9e6155f94224952be95c3785290e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4efd9e6155f94224952be95c3785290e, State: Initialized, Role: FOLLOWER
I20260709 13:17:51.712342  6442 consensus_queue.cc:260] T c7cfe05c9c2f47f487fbf3b81a0a47ca P 4efd9e6155f94224952be95c3785290e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "215a40d9cebb42d9906c6e4616e2950a" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 40171 } } peers { permanent_uuid: "b7aed7f4e45b499992f30b4cf32b8961" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 33867 } } peers { permanent_uuid: "4efd9e6155f94224952be95c3785290e" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 46051 } }
I20260709 13:17:51.705057  6446 raft_consensus.cc:515] T ec94c2acba4a4333a9db46ab77cd9781 P b7aed7f4e45b499992f30b4cf32b8961 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "215a40d9cebb42d9906c6e4616e2950a" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 40171 } } peers { permanent_uuid: "b7aed7f4e45b499992f30b4cf32b8961" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 33867 } } peers { permanent_uuid: "4efd9e6155f94224952be95c3785290e" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 46051 } }
I20260709 13:17:51.714726  6442 ts_tablet_manager.cc:1434] T c7cfe05c9c2f47f487fbf3b81a0a47ca P 4efd9e6155f94224952be95c3785290e: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.001s
I20260709 13:17:51.715765  6442 tablet_bootstrap.cc:492] T e17475c1ea464d1f84e7f36957761cd9 P 4efd9e6155f94224952be95c3785290e: Bootstrap starting.
I20260709 13:17:51.716929  6250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec94c2acba4a4333a9db46ab77cd9781" candidate_uuid: "b7aed7f4e45b499992f30b4cf32b8961" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "215a40d9cebb42d9906c6e4616e2950a"
I20260709 13:17:51.717588  6473 raft_consensus.cc:515] T 199b09cd4e0d433fafb2e8d5006d113d P 4efd9e6155f94224952be95c3785290e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "215a40d9cebb42d9906c6e4616e2950a" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 40171 } } peers { permanent_uuid: "b7aed7f4e45b499992f30b4cf32b8961" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 33867 } } peers { permanent_uuid: "4efd9e6155f94224952be95c3785290e" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 46051 } }
W20260709 13:17:51.718968  6291 leader_election.cc:343] T ec94c2acba4a4333a9db46ab77cd9781 P b7aed7f4e45b499992f30b4cf32b8961 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 215a40d9cebb42d9906c6e4616e2950a (127.5.126.65:40171): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:51.725229  6325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "199b09cd4e0d433fafb2e8d5006d113d" candidate_uuid: "4efd9e6155f94224952be95c3785290e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b7aed7f4e45b499992f30b4cf32b8961"
I20260709 13:17:51.725863  6325 raft_consensus.cc:3060] T 199b09cd4e0d433fafb2e8d5006d113d P b7aed7f4e45b499992f30b4cf32b8961 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:51.719219  6440 tablet_bootstrap.cc:492] T 879fa203410744a9a1a63d33e0801f07 P b7aed7f4e45b499992f30b4cf32b8961: No bootstrap required, opened a new log
I20260709 13:17:51.722226  6439 ts_tablet_manager.cc:1434] T 82ccb3ed51b2453381692135f3179a54 P 215a40d9cebb42d9906c6e4616e2950a: Time spent starting tablet: real 0.043s	user 0.006s	sys 0.006s
I20260709 13:17:51.727603  6250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "199b09cd4e0d433fafb2e8d5006d113d" candidate_uuid: "4efd9e6155f94224952be95c3785290e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "215a40d9cebb42d9906c6e4616e2950a"
I20260709 13:17:51.726225  6397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec94c2acba4a4333a9db46ab77cd9781" candidate_uuid: "b7aed7f4e45b499992f30b4cf32b8961" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4efd9e6155f94224952be95c3785290e"
I20260709 13:17:51.726881  6446 leader_election.cc:290] T ec94c2acba4a4333a9db46ab77cd9781 P b7aed7f4e45b499992f30b4cf32b8961 [CANDIDATE]: Term 1 election: Requested vote from peers 215a40d9cebb42d9906c6e4616e2950a (127.5.126.65:40171), 4efd9e6155f94224952be95c3785290e (127.5.126.67:46051)
I20260709 13:17:51.727121  6473 leader_election.cc:290] T 199b09cd4e0d433fafb2e8d5006d113d P 4efd9e6155f94224952be95c3785290e [CANDIDATE]: Term 1 election: Requested vote from peers 215a40d9cebb42d9906c6e4616e2950a (127.5.126.65:40171), b7aed7f4e45b499992f30b4cf32b8961 (127.5.126.66:33867)
I20260709 13:17:51.738837  6442 tablet_bootstrap.cc:654] T e17475c1ea464d1f84e7f36957761cd9 P 4efd9e6155f94224952be95c3785290e: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:51.754550  6475 raft_consensus.cc:493] T d51e67b3ea6a458c818b4c7cf67ceef5 P 215a40d9cebb42d9906c6e4616e2950a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:51.755189  6475 raft_consensus.cc:515] T d51e67b3ea6a458c818b4c7cf67ceef5 P 215a40d9cebb42d9906c6e4616e2950a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "215a40d9cebb42d9906c6e4616e2950a" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 40171 } } peers { permanent_uuid: "b7aed7f4e45b499992f30b4cf32b8961" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 33867 } } peers { permanent_uuid: "4efd9e6155f94224952be95c3785290e" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 46051 } }
I20260709 13:17:51.756337  6325 raft_consensus.cc:2468] T 199b09cd4e0d433fafb2e8d5006d113d P b7aed7f4e45b499992f30b4cf32b8961 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4efd9e6155f94224952be95c3785290e in term 1.
I20260709 13:17:51.741464  6440 ts_tablet_manager.cc:1403] T 879fa203410744a9a1a63d33e0801f07 P b7aed7f4e45b499992f30b4cf32b8961: Time spent bootstrapping tablet: real 0.078s	user 0.010s	sys 0.007s
I20260709 13:17:51.757898  6362 leader_election.cc:304] T 199b09cd4e0d433fafb2e8d5006d113d P 4efd9e6155f94224952be95c3785290e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4efd9e6155f94224952be95c3785290e, b7aed7f4e45b499992f30b4cf32b8961; no voters: 
I20260709 13:17:51.750406  6145 catalog_manager.cc:5697] T ee893b0b66474d44baaeba294d249e32 P b7aed7f4e45b499992f30b4cf32b8961 reported cstate change: term changed from 0 to 1, leader changed from <none> to b7aed7f4e45b499992f30b4cf32b8961 (127.5.126.66). New cstate: current_term: 1 leader_uuid: "b7aed7f4e45b499992f30b4cf32b8961" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "215a40d9cebb42d9906c6e4616e2950a" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 40171 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b7aed7f4e45b499992f30b4cf32b8961" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 33867 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4efd9e6155f94224952be95c3785290e" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 46051 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:51.759336  6473 raft_consensus.cc:2804] T 199b09cd4e0d433fafb2e8d5006d113d P 4efd9e6155f94224952be95c3785290e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:51.759471  6398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d51e67b3ea6a458c818b4c7cf67ceef5" candidate_uuid: "215a40d9cebb42d9906c6e4616e2950a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4efd9e6155f94224952be95c3785290e" is_pre_election: true
I20260709 13:17:51.760300  6398 raft_consensus.cc:2468] T d51e67b3ea6a458c818b4c7cf67ceef5 P 4efd9e6155f94224952be95c3785290e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 215a40d9cebb42d9906c6e4616e2950a in term 0.
I20260709 13:17:51.761027  6473 raft_consensus.cc:697] T 199b09cd4e0d433fafb2e8d5006d113d P 4efd9e6155f94224952be95c3785290e [term 1 LEADER]: Becoming Leader. State: Replica: 4efd9e6155f94224952be95c3785290e, State: Running, Role: LEADER
I20260709 13:17:51.758289  6475 leader_election.cc:290] T d51e67b3ea6a458c818b4c7cf67ceef5 P 215a40d9cebb42d9906c6e4616e2950a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b7aed7f4e45b499992f30b4cf32b8961 (127.5.126.66:33867), 4efd9e6155f94224952be95c3785290e (127.5.126.67:46051)
I20260709 13:17:51.761838  6325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d51e67b3ea6a458c818b4c7cf67ceef5" candidate_uuid: "215a40d9cebb42d9906c6e4616e2950a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b7aed7f4e45b499992f30b4cf32b8961" is_pre_election: true
I20260709 13:17:51.761767  6213 leader_election.cc:304] T d51e67b3ea6a458c818b4c7cf67ceef5 P 215a40d9cebb42d9906c6e4616e2950a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 215a40d9cebb42d9906c6e4616e2950a, 4efd9e6155f94224952be95c3785290e; no voters: 
I20260709 13:17:51.754104  6250 raft_consensus.cc:3060] T 199b09cd4e0d433fafb2e8d5006d113d P 215a40d9cebb42d9906c6e4616e2950a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:51.763255  6475 raft_consensus.cc:2804] T d51e67b3ea6a458c818b4c7cf67ceef5 P 215a40d9cebb42d9906c6e4616e2950a [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260709 13:17:51.763717  6213 leader_election.cc:343] T d51e67b3ea6a458c818b4c7cf67ceef5 P 215a40d9cebb42d9906c6e4616e2950a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b7aed7f4e45b499992f30b4cf32b8961 (127.5.126.66:33867): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:51.763257  6473 consensus_queue.cc:237] T 199b09cd4e0d433fafb2e8d5006d113d P 4efd9e6155f94224952be95c3785290e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "215a40d9cebb42d9906c6e4616e2950a" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 40171 } } peers { permanent_uuid: "b7aed7f4e45b499992f30b4cf32b8961" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 33867 } } peers { permanent_uuid: "4efd9e6155f94224952be95c3785290e" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 46051 } }
I20260709 13:17:51.763793  6475 raft_consensus.cc:493] T d51e67b3ea6a458c818b4c7cf67ceef5 P 215a40d9cebb42d9906c6e4616e2950a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:51.764572  6475 raft_consensus.cc:3060] T d51e67b3ea6a458c818b4c7cf67ceef5 P 215a40d9cebb42d9906c6e4616e2950a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:51.764987  6397 raft_consensus.cc:3060] T ec94c2acba4a4333a9db46ab77cd9781 P 4efd9e6155f94224952be95c3785290e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:51.761790  6440 raft_consensus.cc:359] T 879fa203410744a9a1a63d33e0801f07 P b7aed7f4e45b499992f30b4cf32b8961 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "215a40d9cebb42d9906c6e4616e2950a" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 40171 } } peers { permanent_uuid: "b7aed7f4e45b499992f30b4cf32b8961" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 33867 } } peers { permanent_uuid: "4efd9e6155f94224952be95c3785290e" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 46051 } }
I20260709 13:17:51.766163  6440 raft_consensus.cc:385] T 879fa203410744a9a1a63d33e0801f07 P b7aed7f4e45b499992f30b4cf32b8961 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:51.766490  6440 raft_consensus.cc:740] T 879fa203410744a9a1a63d33e0801f07 P b7aed7f4e45b499992f30b4cf32b8961 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b7aed7f4e45b499992f30b4cf32b8961, State: Initialized, Role: FOLLOWER
I20260709 13:17:51.767872  6145 catalog_manager.cc:5697] T 82ccb3ed51b2453381692135f3179a54 P b7aed7f4e45b499992f30b4cf32b8961 reported cstate change: term changed from 0 to 1, leader changed from <none> to b7aed7f4e45b499992f30b4cf32b8961 (127.5.126.66). New cstate: current_term: 1 leader_uuid: "b7aed7f4e45b499992f30b4cf32b8961" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "215a40d9cebb42d9906c6e4616e2950a" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 40171 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b7aed7f4e45b499992f30b4cf32b8961" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 33867 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4efd9e6155f94224952be95c3785290e" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 46051 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:51.769500  6445 raft_consensus.cc:493] T e17475c1ea464d1f84e7f36957761cd9 P 215a40d9cebb42d9906c6e4616e2950a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:51.769906  6250 raft_consensus.cc:2468] T 199b09cd4e0d433fafb2e8d5006d113d P 215a40d9cebb42d9906c6e4616e2950a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4efd9e6155f94224952be95c3785290e in term 1.
I20260709 13:17:51.770067  6445 raft_consensus.cc:515] T e17475c1ea464d1f84e7f36957761cd9 P 215a40d9cebb42d9906c6e4616e2950a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "215a40d9cebb42d9906c6e4616e2950a" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 40171 } } peers { permanent_uuid: "b7aed7f4e45b499992f30b4cf32b8961" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 33867 } } peers { permanent_uuid: "4efd9e6155f94224952be95c3785290e" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 46051 } }
I20260709 13:17:51.772303  6445 leader_election.cc:290] T e17475c1ea464d1f84e7f36957761cd9 P 215a40d9cebb42d9906c6e4616e2950a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b7aed7f4e45b499992f30b4cf32b8961 (127.5.126.66:33867), 4efd9e6155f94224952be95c3785290e (127.5.126.67:46051)
I20260709 13:17:51.773272  6442 tablet_bootstrap.cc:492] T e17475c1ea464d1f84e7f36957761cd9 P 4efd9e6155f94224952be95c3785290e: No bootstrap required, opened a new log
I20260709 13:17:51.773765  6442 ts_tablet_manager.cc:1403] T e17475c1ea464d1f84e7f36957761cd9 P 4efd9e6155f94224952be95c3785290e: Time spent bootstrapping tablet: real 0.058s	user 0.018s	sys 0.000s
I20260709 13:17:51.774559  6325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e17475c1ea464d1f84e7f36957761cd9" candidate_uuid: "215a40d9cebb42d9906c6e4616e2950a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b7aed7f4e45b499992f30b4cf32b8961" is_pre_election: true
I20260709 13:17:51.774587  6398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e17475c1ea464d1f84e7f36957761cd9" candidate_uuid: "215a40d9cebb42d9906c6e4616e2950a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4efd9e6155f94224952be95c3785290e" is_pre_election: true
W20260709 13:17:51.776018  6213 leader_election.cc:343] T e17475c1ea464d1f84e7f36957761cd9 P 215a40d9cebb42d9906c6e4616e2950a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b7aed7f4e45b499992f30b4cf32b8961 (127.5.126.66:33867): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:51.776467  6442 raft_consensus.cc:359] T e17475c1ea464d1f84e7f36957761cd9 P 4efd9e6155f94224952be95c3785290e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "215a40d9cebb42d9906c6e4616e2950a" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 40171 } } peers { permanent_uuid: "b7aed7f4e45b499992f30b4cf32b8961" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 33867 } } peers { permanent_uuid: "4efd9e6155f94224952be95c3785290e" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 46051 } }
W20260709 13:17:51.776793  6213 leader_election.cc:343] T e17475c1ea464d1f84e7f36957761cd9 P 215a40d9cebb42d9906c6e4616e2950a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4efd9e6155f94224952be95c3785290e (127.5.126.67:46051): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:51.771788  6440 consensus_queue.cc:260] T 879fa203410744a9a1a63d33e0801f07 P b7aed7f4e45b499992f30b4cf32b8961 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "215a40d9cebb42d9906c6e4616e2950a" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 40171 } } peers { permanent_uuid: "b7aed7f4e45b499992f30b4cf32b8961" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 33867 } } peers { permanent_uuid: "4efd9e6155f94224952be95c3785290e" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 46051 } }
I20260709 13:17:51.777246  6213 leader_election.cc:304] T e17475c1ea464d1f84e7f36957761cd9 P 215a40d9cebb42d9906c6e4616e2950a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 215a40d9cebb42d9906c6e4616e2950a; no voters: 4efd9e6155f94224952be95c3785290e, b7aed7f4e45b499992f30b4cf32b8961
I20260709 13:17:51.778296  6445 raft_consensus.cc:2749] T e17475c1ea464d1f84e7f36957761cd9 P 215a40d9cebb42d9906c6e4616e2950a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:17:51.762260  6439 tablet_bootstrap.cc:492] T ee893b0b66474d44baaeba294d249e32 P 215a40d9cebb42d9906c6e4616e2950a: Bootstrap starting.
I20260709 13:17:51.779119  6440 ts_tablet_manager.cc:1434] T 879fa203410744a9a1a63d33e0801f07 P b7aed7f4e45b499992f30b4cf32b8961: Time spent starting tablet: real 0.021s	user 0.006s	sys 0.000s
I20260709 13:17:51.778518  6475 raft_consensus.cc:515] T d51e67b3ea6a458c818b4c7cf67ceef5 P 215a40d9cebb42d9906c6e4616e2950a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "215a40d9cebb42d9906c6e4616e2950a" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 40171 } } peers { permanent_uuid: "b7aed7f4e45b499992f30b4cf32b8961" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 33867 } } peers { permanent_uuid: "4efd9e6155f94224952be95c3785290e" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 46051 } }
I20260709 13:17:51.780175  6440 tablet_bootstrap.cc:492] T d51e67b3ea6a458c818b4c7cf67ceef5 P b7aed7f4e45b499992f30b4cf32b8961: Bootstrap starting.
I20260709 13:17:51.783457  6325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d51e67b3ea6a458c818b4c7cf67ceef5" candidate_uuid: "215a40d9cebb42d9906c6e4616e2950a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b7aed7f4e45b499992f30b4cf32b8961"
W20260709 13:17:51.785089  6213 leader_election.cc:343] T d51e67b3ea6a458c818b4c7cf67ceef5 P 215a40d9cebb42d9906c6e4616e2950a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b7aed7f4e45b499992f30b4cf32b8961 (127.5.126.66:33867): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:51.785912  6439 tablet_bootstrap.cc:654] T ee893b0b66474d44baaeba294d249e32 P 215a40d9cebb42d9906c6e4616e2950a: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:51.787622  6397 raft_consensus.cc:2468] T ec94c2acba4a4333a9db46ab77cd9781 P 4efd9e6155f94224952be95c3785290e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7aed7f4e45b499992f30b4cf32b8961 in term 1.
I20260709 13:17:51.788162  6442 raft_consensus.cc:385] T e17475c1ea464d1f84e7f36957761cd9 P 4efd9e6155f94224952be95c3785290e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:51.788460  6442 raft_consensus.cc:740] T e17475c1ea464d1f84e7f36957761cd9 P 4efd9e6155f94224952be95c3785290e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4efd9e6155f94224952be95c3785290e, State: Initialized, Role: FOLLOWER
I20260709 13:17:51.789058  6398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d51e67b3ea6a458c818b4c7cf67ceef5" candidate_uuid: "215a40d9cebb42d9906c6e4616e2950a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4efd9e6155f94224952be95c3785290e"
I20260709 13:17:51.789456  6288 leader_election.cc:304] T ec94c2acba4a4333a9db46ab77cd9781 P b7aed7f4e45b499992f30b4cf32b8961 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4efd9e6155f94224952be95c3785290e, b7aed7f4e45b499992f30b4cf32b8961; no voters: 215a40d9cebb42d9906c6e4616e2950a
I20260709 13:17:51.789903  6398 raft_consensus.cc:3060] T d51e67b3ea6a458c818b4c7cf67ceef5 P 4efd9e6155f94224952be95c3785290e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:51.790616  6446 raft_consensus.cc:2804] T ec94c2acba4a4333a9db46ab77cd9781 P b7aed7f4e45b499992f30b4cf32b8961 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:51.790463  6442 consensus_queue.cc:260] T e17475c1ea464d1f84e7f36957761cd9 P 4efd9e6155f94224952be95c3785290e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "215a40d9cebb42d9906c6e4616e2950a" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 40171 } } peers { permanent_uuid: "b7aed7f4e45b499992f30b4cf32b8961" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 33867 } } peers { permanent_uuid: "4efd9e6155f94224952be95c3785290e" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 46051 } }
I20260709 13:17:51.791076  6446 raft_consensus.cc:697] T ec94c2acba4a4333a9db46ab77cd9781 P b7aed7f4e45b499992f30b4cf32b8961 [term 1 LEADER]: Becoming Leader. State: Replica: b7aed7f4e45b499992f30b4cf32b8961, State: Running, Role: LEADER
I20260709 13:17:51.791939  6446 consensus_queue.cc:237] T ec94c2acba4a4333a9db46ab77cd9781 P b7aed7f4e45b499992f30b4cf32b8961 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "215a40d9cebb42d9906c6e4616e2950a" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 40171 } } peers { permanent_uuid: "b7aed7f4e45b499992f30b4cf32b8961" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 33867 } } peers { permanent_uuid: "4efd9e6155f94224952be95c3785290e" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 46051 } }
I20260709 13:17:51.794081  6440 tablet_bootstrap.cc:654] T d51e67b3ea6a458c818b4c7cf67ceef5 P b7aed7f4e45b499992f30b4cf32b8961: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:51.792428  6445 raft_consensus.cc:493] T 82ccb3ed51b2453381692135f3179a54 P 215a40d9cebb42d9906c6e4616e2950a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:51.794875  6445 raft_consensus.cc:515] T 82ccb3ed51b2453381692135f3179a54 P 215a40d9cebb42d9906c6e4616e2950a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "215a40d9cebb42d9906c6e4616e2950a" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 40171 } } peers { permanent_uuid: "b7aed7f4e45b499992f30b4cf32b8961" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 33867 } } peers { permanent_uuid: "4efd9e6155f94224952be95c3785290e" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 46051 } }
I20260709 13:17:51.797528  6442 ts_tablet_manager.cc:1434] T e17475c1ea464d1f84e7f36957761cd9 P 4efd9e6155f94224952be95c3785290e: Time spent starting tablet: real 0.023s	user 0.007s	sys 0.000s
I20260709 13:17:51.798106  6325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82ccb3ed51b2453381692135f3179a54" candidate_uuid: "215a40d9cebb42d9906c6e4616e2950a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b7aed7f4e45b499992f30b4cf32b8961" is_pre_election: true
I20260709 13:17:51.798468  6442 tablet_bootstrap.cc:492] T 87b6f7d6ab0742c0a8247c7bc6cbe4eb P 4efd9e6155f94224952be95c3785290e: Bootstrap starting.
I20260709 13:17:51.800289  6445 leader_election.cc:290] T 82ccb3ed51b2453381692135f3179a54 P 215a40d9cebb42d9906c6e4616e2950a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b7aed7f4e45b499992f30b4cf32b8961 (127.5.126.66:33867), 4efd9e6155f94224952be95c3785290e (127.5.126.67:46051)
I20260709 13:17:51.800336  6399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82ccb3ed51b2453381692135f3179a54" candidate_uuid: "215a40d9cebb42d9906c6e4616e2950a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4efd9e6155f94224952be95c3785290e" is_pre_election: true
I20260709 13:17:51.801438  6399 raft_consensus.cc:2393] T 82ccb3ed51b2453381692135f3179a54 P 4efd9e6155f94224952be95c3785290e [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 215a40d9cebb42d9906c6e4616e2950a in current term 1: Already voted for candidate b7aed7f4e45b499992f30b4cf32b8961 in this term.
I20260709 13:17:51.803086  6213 leader_election.cc:304] T 82ccb3ed51b2453381692135f3179a54 P 215a40d9cebb42d9906c6e4616e2950a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 215a40d9cebb42d9906c6e4616e2950a; no voters: 4efd9e6155f94224952be95c3785290e, b7aed7f4e45b499992f30b4cf32b8961
I20260709 13:17:51.805024  6445 raft_consensus.cc:3060] T 82ccb3ed51b2453381692135f3179a54 P 215a40d9cebb42d9906c6e4616e2950a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:51.787678  6475 leader_election.cc:290] T d51e67b3ea6a458c818b4c7cf67ceef5 P 215a40d9cebb42d9906c6e4616e2950a [CANDIDATE]: Term 1 election: Requested vote from peers b7aed7f4e45b499992f30b4cf32b8961 (127.5.126.66:33867), 4efd9e6155f94224952be95c3785290e (127.5.126.67:46051)
I20260709 13:17:51.812440  6398 raft_consensus.cc:2468] T d51e67b3ea6a458c818b4c7cf67ceef5 P 4efd9e6155f94224952be95c3785290e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 215a40d9cebb42d9906c6e4616e2950a in term 1.
I20260709 13:17:51.814244  6213 leader_election.cc:304] T d51e67b3ea6a458c818b4c7cf67ceef5 P 215a40d9cebb42d9906c6e4616e2950a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 215a40d9cebb42d9906c6e4616e2950a, 4efd9e6155f94224952be95c3785290e; no voters: b7aed7f4e45b499992f30b4cf32b8961
I20260709 13:17:51.815342  6475 raft_consensus.cc:2804] T d51e67b3ea6a458c818b4c7cf67ceef5 P 215a40d9cebb42d9906c6e4616e2950a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:51.820969  6442 tablet_bootstrap.cc:654] T 87b6f7d6ab0742c0a8247c7bc6cbe4eb P 4efd9e6155f94224952be95c3785290e: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:51.825367  6445 raft_consensus.cc:2749] T 82ccb3ed51b2453381692135f3179a54 P 215a40d9cebb42d9906c6e4616e2950a [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:17:51.833005  6440 tablet_bootstrap.cc:492] T d51e67b3ea6a458c818b4c7cf67ceef5 P b7aed7f4e45b499992f30b4cf32b8961: No bootstrap required, opened a new log
I20260709 13:17:51.832433  6145 catalog_manager.cc:5697] T 199b09cd4e0d433fafb2e8d5006d113d P 4efd9e6155f94224952be95c3785290e reported cstate change: term changed from 0 to 1, leader changed from <none> to 4efd9e6155f94224952be95c3785290e (127.5.126.67). New cstate: current_term: 1 leader_uuid: "4efd9e6155f94224952be95c3785290e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "215a40d9cebb42d9906c6e4616e2950a" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 40171 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b7aed7f4e45b499992f30b4cf32b8961" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 33867 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4efd9e6155f94224952be95c3785290e" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 46051 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:51.833949  6440 ts_tablet_manager.cc:1403] T d51e67b3ea6a458c818b4c7cf67ceef5 P b7aed7f4e45b499992f30b4cf32b8961: Time spent bootstrapping tablet: real 0.054s	user 0.017s	sys 0.003s
I20260709 13:17:51.836278  6147 catalog_manager.cc:5697] T ec94c2acba4a4333a9db46ab77cd9781 P b7aed7f4e45b499992f30b4cf32b8961 reported cstate change: term changed from 0 to 1, leader changed from <none> to b7aed7f4e45b499992f30b4cf32b8961 (127.5.126.66). New cstate: current_term: 1 leader_uuid: "b7aed7f4e45b499992f30b4cf32b8961" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "215a40d9cebb42d9906c6e4616e2950a" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 40171 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b7aed7f4e45b499992f30b4cf32b8961" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 33867 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4efd9e6155f94224952be95c3785290e" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 46051 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:51.849929  6446 raft_consensus.cc:493] T 879fa203410744a9a1a63d33e0801f07 P b7aed7f4e45b499992f30b4cf32b8961 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:51.851811  6475 raft_consensus.cc:697] T d51e67b3ea6a458c818b4c7cf67ceef5 P 215a40d9cebb42d9906c6e4616e2950a [term 1 LEADER]: Becoming Leader. State: Replica: 215a40d9cebb42d9906c6e4616e2950a, State: Running, Role: LEADER
I20260709 13:17:51.852197  6446 raft_consensus.cc:515] T 879fa203410744a9a1a63d33e0801f07 P b7aed7f4e45b499992f30b4cf32b8961 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "215a40d9cebb42d9906c6e4616e2950a" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 40171 } } peers { permanent_uuid: "b7aed7f4e45b499992f30b4cf32b8961" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 33867 } } peers { permanent_uuid: "4efd9e6155f94224952be95c3785290e" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 46051 } }
I20260709 13:17:51.855073  6475 consensus_queue.cc:237] T d51e67b3ea6a458c818b4c7cf67ceef5 P 215a40d9cebb42d9906c6e4616e2950a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "215a40d9cebb42d9906c6e4616e2950a" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 40171 } } peers { permanent_uuid: "b7aed7f4e45b499992f30b4cf32b8961" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 33867 } } peers { permanent_uuid: "4efd9e6155f94224952be95c3785290e" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 46051 } }
I20260709 13:17:51.858009  6446 leader_election.cc:290] T 879fa203410744a9a1a63d33e0801f07 P b7aed7f4e45b499992f30b4cf32b8961 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 215a40d9cebb42d9906c6e4616e2950a (127.5.126.65:40171), 4efd9e6155f94224952be95c3785290e (127.5.126.67:46051)
I20260709 13:17:51.858147  6250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "879fa203410744a9a1a63d33e0801f07" candidate_uuid: "b7aed7f4e45b499992f30b4cf32b8961" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "215a40d9cebb42d9906c6e4616e2950a" is_pre_election: true
I20260709 13:17:51.859320  6250 raft_consensus.cc:2393] T 879fa203410744a9a1a63d33e0801f07 P 215a40d9cebb42d9906c6e4616e2950a [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7aed7f4e45b499992f30b4cf32b8961 in current term 1: Already voted for candidate 4efd9e6155f94224952be95c3785290e in this term.
I20260709 13:17:51.859119  6398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "879fa203410744a9a1a63d33e0801f07" candidate_uuid: "b7aed7f4e45b499992f30b4cf32b8961" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4efd9e6155f94224952be95c3785290e" is_pre_election: true
I20260709 13:17:51.860773  6288 leader_election.cc:304] T 879fa203410744a9a1a63d33e0801f07 P b7aed7f4e45b499992f30b4cf32b8961 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7aed7f4e45b499992f30b4cf32b8961; no voters: 215a40d9cebb42d9906c6e4616e2950a, 4efd9e6155f94224952be95c3785290e
I20260709 13:17:51.862084  6446 raft_consensus.cc:3060] T 879fa203410744a9a1a63d33e0801f07 P b7aed7f4e45b499992f30b4cf32b8961 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:51.864755  6439 tablet_bootstrap.cc:492] T ee893b0b66474d44baaeba294d249e32 P 215a40d9cebb42d9906c6e4616e2950a: No bootstrap required, opened a new log
I20260709 13:17:51.865248  6439 ts_tablet_manager.cc:1403] T ee893b0b66474d44baaeba294d249e32 P 215a40d9cebb42d9906c6e4616e2950a: Time spent bootstrapping tablet: real 0.103s	user 0.021s	sys 0.024s
I20260709 13:17:51.868625  6446 raft_consensus.cc:2749] T 879fa203410744a9a1a63d33e0801f07 P b7aed7f4e45b499992f30b4cf32b8961 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:17:51.860723  6440 raft_consensus.cc:359] T d51e67b3ea6a458c818b4c7cf67ceef5 P b7aed7f4e45b499992f30b4cf32b8961 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "215a40d9cebb42d9906c6e4616e2950a" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 40171 } } peers { permanent_uuid: "b7aed7f4e45b499992f30b4cf32b8961" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 33867 } } peers { permanent_uuid: "4efd9e6155f94224952be95c3785290e" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 46051 } }
I20260709 13:17:51.869412  6440 raft_consensus.cc:385] T d51e67b3ea6a458c818b4c7cf67ceef5 P b7aed7f4e45b499992f30b4cf32b8961 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:51.869866  6440 raft_consensus.cc:740] T d51e67b3ea6a458c818b4c7cf67ceef5 P b7aed7f4e45b499992f30b4cf32b8961 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b7aed7f4e45b499992f30b4cf32b8961, State: Initialized, Role: FOLLOWER
I20260709 13:17:51.869441  6439 raft_consensus.cc:359] T ee893b0b66474d44baaeba294d249e32 P 215a40d9cebb42d9906c6e4616e2950a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "215a40d9cebb42d9906c6e4616e2950a" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 40171 } } peers { permanent_uuid: "b7aed7f4e45b499992f30b4cf32b8961" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 33867 } } peers { permanent_uuid: "4efd9e6155f94224952be95c3785290e" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 46051 } }
I20260709 13:17:51.870332  6439 raft_consensus.cc:385] T ee893b0b66474d44baaeba294d249e32 P 215a40d9cebb42d9906c6e4616e2950a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:51.870628  6439 raft_consensus.cc:740] T ee893b0b66474d44baaeba294d249e32 P 215a40d9cebb42d9906c6e4616e2950a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 215a40d9cebb42d9906c6e4616e2950a, State: Initialized, Role: FOLLOWER
I20260709 13:17:51.870678  6440 consensus_queue.cc:260] T d51e67b3ea6a458c818b4c7cf67ceef5 P b7aed7f4e45b499992f30b4cf32b8961 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "215a40d9cebb42d9906c6e4616e2950a" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 40171 } } peers { permanent_uuid: "b7aed7f4e45b499992f30b4cf32b8961" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 33867 } } peers { permanent_uuid: "4efd9e6155f94224952be95c3785290e" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 46051 } }
I20260709 13:17:51.871502  6439 consensus_queue.cc:260] T ee893b0b66474d44baaeba294d249e32 P 215a40d9cebb42d9906c6e4616e2950a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "215a40d9cebb42d9906c6e4616e2950a" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 40171 } } peers { permanent_uuid: "b7aed7f4e45b499992f30b4cf32b8961" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 33867 } } peers { permanent_uuid: "4efd9e6155f94224952be95c3785290e" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 46051 } }
I20260709 13:17:51.872802  6442 tablet_bootstrap.cc:492] T 87b6f7d6ab0742c0a8247c7bc6cbe4eb P 4efd9e6155f94224952be95c3785290e: No bootstrap required, opened a new log
I20260709 13:17:51.873349  6442 ts_tablet_manager.cc:1403] T 87b6f7d6ab0742c0a8247c7bc6cbe4eb P 4efd9e6155f94224952be95c3785290e: Time spent bootstrapping tablet: real 0.075s	user 0.011s	sys 0.010s
I20260709 13:17:51.873596  6440 ts_tablet_manager.cc:1434] T d51e67b3ea6a458c818b4c7cf67ceef5 P b7aed7f4e45b499992f30b4cf32b8961: Time spent starting tablet: real 0.039s	user 0.009s	sys 0.000s
I20260709 13:17:51.874606  6440 tablet_bootstrap.cc:492] T c7cfe05c9c2f47f487fbf3b81a0a47ca P b7aed7f4e45b499992f30b4cf32b8961: Bootstrap starting.
I20260709 13:17:51.875959  6442 raft_consensus.cc:359] T 87b6f7d6ab0742c0a8247c7bc6cbe4eb P 4efd9e6155f94224952be95c3785290e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "215a40d9cebb42d9906c6e4616e2950a" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 40171 } } peers { permanent_uuid: "b7aed7f4e45b499992f30b4cf32b8961" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 33867 } } peers { permanent_uuid: "4efd9e6155f94224952be95c3785290e" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 46051 } }
I20260709 13:17:51.876670  6442 raft_consensus.cc:385] T 87b6f7d6ab0742c0a8247c7bc6cbe4eb P 4efd9e6155f94224952be95c3785290e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:51.876921  6442 raft_consensus.cc:740] T 87b6f7d6ab0742c0a8247c7bc6cbe4eb P 4efd9e6155f94224952be95c3785290e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4efd9e6155f94224952be95c3785290e, State: Initialized, Role: FOLLOWER
I20260709 13:17:51.877672  6442 consensus_queue.cc:260] T 87b6f7d6ab0742c0a8247c7bc6cbe4eb P 4efd9e6155f94224952be95c3785290e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "215a40d9cebb42d9906c6e4616e2950a" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 40171 } } peers { permanent_uuid: "b7aed7f4e45b499992f30b4cf32b8961" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 33867 } } peers { permanent_uuid: "4efd9e6155f94224952be95c3785290e" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 46051 } }
I20260709 13:17:51.881049  6439 ts_tablet_manager.cc:1434] T ee893b0b66474d44baaeba294d249e32 P 215a40d9cebb42d9906c6e4616e2950a: Time spent starting tablet: real 0.015s	user 0.006s	sys 0.000s
I20260709 13:17:51.880507  6147 catalog_manager.cc:5697] T d51e67b3ea6a458c818b4c7cf67ceef5 P 215a40d9cebb42d9906c6e4616e2950a reported cstate change: term changed from 0 to 1, leader changed from <none> to 215a40d9cebb42d9906c6e4616e2950a (127.5.126.65). New cstate: current_term: 1 leader_uuid: "215a40d9cebb42d9906c6e4616e2950a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "215a40d9cebb42d9906c6e4616e2950a" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 40171 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b7aed7f4e45b499992f30b4cf32b8961" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 33867 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4efd9e6155f94224952be95c3785290e" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 46051 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:51.881906  6439 tablet_bootstrap.cc:492] T ec94c2acba4a4333a9db46ab77cd9781 P 215a40d9cebb42d9906c6e4616e2950a: Bootstrap starting.
I20260709 13:17:51.882277  6440 tablet_bootstrap.cc:654] T c7cfe05c9c2f47f487fbf3b81a0a47ca P b7aed7f4e45b499992f30b4cf32b8961: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:51.888477  6439 tablet_bootstrap.cc:654] T ec94c2acba4a4333a9db46ab77cd9781 P 215a40d9cebb42d9906c6e4616e2950a: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:51.887568  6442 ts_tablet_manager.cc:1434] T 87b6f7d6ab0742c0a8247c7bc6cbe4eb P 4efd9e6155f94224952be95c3785290e: Time spent starting tablet: real 0.014s	user 0.003s	sys 0.003s
I20260709 13:17:51.895617  6440 tablet_bootstrap.cc:492] T c7cfe05c9c2f47f487fbf3b81a0a47ca P b7aed7f4e45b499992f30b4cf32b8961: No bootstrap required, opened a new log
I20260709 13:17:51.896201  6440 ts_tablet_manager.cc:1403] T c7cfe05c9c2f47f487fbf3b81a0a47ca P b7aed7f4e45b499992f30b4cf32b8961: Time spent bootstrapping tablet: real 0.022s	user 0.015s	sys 0.004s
I20260709 13:17:51.898747  6440 raft_consensus.cc:359] T c7cfe05c9c2f47f487fbf3b81a0a47ca P b7aed7f4e45b499992f30b4cf32b8961 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "215a40d9cebb42d9906c6e4616e2950a" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 40171 } } peers { permanent_uuid: "b7aed7f4e45b499992f30b4cf32b8961" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 33867 } } peers { permanent_uuid: "4efd9e6155f94224952be95c3785290e" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 46051 } }
I20260709 13:17:51.899384  6440 raft_consensus.cc:385] T c7cfe05c9c2f47f487fbf3b81a0a47ca P b7aed7f4e45b499992f30b4cf32b8961 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:51.899643  6440 raft_consensus.cc:740] T c7cfe05c9c2f47f487fbf3b81a0a47ca P b7aed7f4e45b499992f30b4cf32b8961 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b7aed7f4e45b499992f30b4cf32b8961, State: Initialized, Role: FOLLOWER
I20260709 13:17:51.900671  6440 consensus_queue.cc:260] T c7cfe05c9c2f47f487fbf3b81a0a47ca P b7aed7f4e45b499992f30b4cf32b8961 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "215a40d9cebb42d9906c6e4616e2950a" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 40171 } } peers { permanent_uuid: "b7aed7f4e45b499992f30b4cf32b8961" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 33867 } } peers { permanent_uuid: "4efd9e6155f94224952be95c3785290e" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 46051 } }
I20260709 13:17:51.902765  6439 tablet_bootstrap.cc:492] T ec94c2acba4a4333a9db46ab77cd9781 P 215a40d9cebb42d9906c6e4616e2950a: No bootstrap required, opened a new log
I20260709 13:17:51.903049  6440 ts_tablet_manager.cc:1434] T c7cfe05c9c2f47f487fbf3b81a0a47ca P b7aed7f4e45b499992f30b4cf32b8961: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 13:17:51.903273  6439 ts_tablet_manager.cc:1403] T ec94c2acba4a4333a9db46ab77cd9781 P 215a40d9cebb42d9906c6e4616e2950a: Time spent bootstrapping tablet: real 0.022s	user 0.008s	sys 0.007s
I20260709 13:17:51.903986  6440 tablet_bootstrap.cc:492] T 87b6f7d6ab0742c0a8247c7bc6cbe4eb P b7aed7f4e45b499992f30b4cf32b8961: Bootstrap starting.
I20260709 13:17:51.905742  6439 raft_consensus.cc:359] T ec94c2acba4a4333a9db46ab77cd9781 P 215a40d9cebb42d9906c6e4616e2950a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "215a40d9cebb42d9906c6e4616e2950a" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 40171 } } peers { permanent_uuid: "b7aed7f4e45b499992f30b4cf32b8961" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 33867 } } peers { permanent_uuid: "4efd9e6155f94224952be95c3785290e" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 46051 } }
I20260709 13:17:51.906276  6439 raft_consensus.cc:385] T ec94c2acba4a4333a9db46ab77cd9781 P 215a40d9cebb42d9906c6e4616e2950a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:51.906509  6439 raft_consensus.cc:740] T ec94c2acba4a4333a9db46ab77cd9781 P 215a40d9cebb42d9906c6e4616e2950a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 215a40d9cebb42d9906c6e4616e2950a, State: Initialized, Role: FOLLOWER
I20260709 13:17:51.907297  6439 consensus_queue.cc:260] T ec94c2acba4a4333a9db46ab77cd9781 P 215a40d9cebb42d9906c6e4616e2950a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "215a40d9cebb42d9906c6e4616e2950a" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 40171 } } peers { permanent_uuid: "b7aed7f4e45b499992f30b4cf32b8961" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 33867 } } peers { permanent_uuid: "4efd9e6155f94224952be95c3785290e" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 46051 } }
I20260709 13:17:51.909226  6439 ts_tablet_manager.cc:1434] T ec94c2acba4a4333a9db46ab77cd9781 P 215a40d9cebb42d9906c6e4616e2950a: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 13:17:51.910151  6439 tablet_bootstrap.cc:492] T 87b6f7d6ab0742c0a8247c7bc6cbe4eb P 215a40d9cebb42d9906c6e4616e2950a: Bootstrap starting.
I20260709 13:17:51.911162  6440 tablet_bootstrap.cc:654] T 87b6f7d6ab0742c0a8247c7bc6cbe4eb P b7aed7f4e45b499992f30b4cf32b8961: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:51.912998  6446 raft_consensus.cc:493] T c7cfe05c9c2f47f487fbf3b81a0a47ca P b7aed7f4e45b499992f30b4cf32b8961 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:51.913493  6446 raft_consensus.cc:515] T c7cfe05c9c2f47f487fbf3b81a0a47ca P b7aed7f4e45b499992f30b4cf32b8961 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "215a40d9cebb42d9906c6e4616e2950a" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 40171 } } peers { permanent_uuid: "b7aed7f4e45b499992f30b4cf32b8961" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 33867 } } peers { permanent_uuid: "4efd9e6155f94224952be95c3785290e" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 46051 } }
I20260709 13:17:51.916602  6250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7cfe05c9c2f47f487fbf3b81a0a47ca" candidate_uuid: "b7aed7f4e45b499992f30b4cf32b8961" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "215a40d9cebb42d9906c6e4616e2950a" is_pre_election: true
I20260709 13:17:51.917207  6446 leader_election.cc:290] T c7cfe05c9c2f47f487fbf3b81a0a47ca P b7aed7f4e45b499992f30b4cf32b8961 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 215a40d9cebb42d9906c6e4616e2950a (127.5.126.65:40171), 4efd9e6155f94224952be95c3785290e (127.5.126.67:46051)
I20260709 13:17:51.917318  6250 raft_consensus.cc:2468] T c7cfe05c9c2f47f487fbf3b81a0a47ca P 215a40d9cebb42d9906c6e4616e2950a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7aed7f4e45b499992f30b4cf32b8961 in term 0.
I20260709 13:17:51.917866  6398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7cfe05c9c2f47f487fbf3b81a0a47ca" candidate_uuid: "b7aed7f4e45b499992f30b4cf32b8961" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4efd9e6155f94224952be95c3785290e" is_pre_election: true
I20260709 13:17:51.916194  6439 tablet_bootstrap.cc:654] T 87b6f7d6ab0742c0a8247c7bc6cbe4eb P 215a40d9cebb42d9906c6e4616e2950a: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:51.918426  6398 raft_consensus.cc:2468] T c7cfe05c9c2f47f487fbf3b81a0a47ca P 4efd9e6155f94224952be95c3785290e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7aed7f4e45b499992f30b4cf32b8961 in term 0.
I20260709 13:17:51.918941  6291 leader_election.cc:304] T c7cfe05c9c2f47f487fbf3b81a0a47ca P b7aed7f4e45b499992f30b4cf32b8961 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 215a40d9cebb42d9906c6e4616e2950a, b7aed7f4e45b499992f30b4cf32b8961; no voters: 
I20260709 13:17:51.919793  6446 raft_consensus.cc:2804] T c7cfe05c9c2f47f487fbf3b81a0a47ca P b7aed7f4e45b499992f30b4cf32b8961 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:51.920228  6446 raft_consensus.cc:493] T c7cfe05c9c2f47f487fbf3b81a0a47ca P b7aed7f4e45b499992f30b4cf32b8961 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:51.920554  6446 raft_consensus.cc:3060] T c7cfe05c9c2f47f487fbf3b81a0a47ca P b7aed7f4e45b499992f30b4cf32b8961 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:51.926985  6446 raft_consensus.cc:515] T c7cfe05c9c2f47f487fbf3b81a0a47ca P b7aed7f4e45b499992f30b4cf32b8961 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "215a40d9cebb42d9906c6e4616e2950a" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 40171 } } peers { permanent_uuid: "b7aed7f4e45b499992f30b4cf32b8961" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 33867 } } peers { permanent_uuid: "4efd9e6155f94224952be95c3785290e" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 46051 } }
I20260709 13:17:51.929826  6250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7cfe05c9c2f47f487fbf3b81a0a47ca" candidate_uuid: "b7aed7f4e45b499992f30b4cf32b8961" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "215a40d9cebb42d9906c6e4616e2950a"
I20260709 13:17:51.930116  6440 tablet_bootstrap.cc:492] T 87b6f7d6ab0742c0a8247c7bc6cbe4eb P b7aed7f4e45b499992f30b4cf32b8961: No bootstrap required, opened a new log
I20260709 13:17:51.930469  6439 tablet_bootstrap.cc:492] T 87b6f7d6ab0742c0a8247c7bc6cbe4eb P 215a40d9cebb42d9906c6e4616e2950a: No bootstrap required, opened a new log
I20260709 13:17:51.930076  6398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7cfe05c9c2f47f487fbf3b81a0a47ca" candidate_uuid: "b7aed7f4e45b499992f30b4cf32b8961" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4efd9e6155f94224952be95c3785290e"
I20260709 13:17:51.930562  6250 raft_consensus.cc:3060] T c7cfe05c9c2f47f487fbf3b81a0a47ca P 215a40d9cebb42d9906c6e4616e2950a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:51.930938  6439 ts_tablet_manager.cc:1403] T 87b6f7d6ab0742c0a8247c7bc6cbe4eb P 215a40d9cebb42d9906c6e4616e2950a: Time spent bootstrapping tablet: real 0.021s	user 0.014s	sys 0.002s
I20260709 13:17:51.930927  6440 ts_tablet_manager.cc:1403] T 87b6f7d6ab0742c0a8247c7bc6cbe4eb P b7aed7f4e45b499992f30b4cf32b8961: Time spent bootstrapping tablet: real 0.027s	user 0.008s	sys 0.004s
I20260709 13:17:51.930929  6398 raft_consensus.cc:3060] T c7cfe05c9c2f47f487fbf3b81a0a47ca P 4efd9e6155f94224952be95c3785290e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:51.933892  6439 raft_consensus.cc:359] T 87b6f7d6ab0742c0a8247c7bc6cbe4eb P 215a40d9cebb42d9906c6e4616e2950a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "215a40d9cebb42d9906c6e4616e2950a" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 40171 } } peers { permanent_uuid: "b7aed7f4e45b499992f30b4cf32b8961" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 33867 } } peers { permanent_uuid: "4efd9e6155f94224952be95c3785290e" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 46051 } }
I20260709 13:17:51.934046  6440 raft_consensus.cc:359] T 87b6f7d6ab0742c0a8247c7bc6cbe4eb P b7aed7f4e45b499992f30b4cf32b8961 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "215a40d9cebb42d9906c6e4616e2950a" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 40171 } } peers { permanent_uuid: "b7aed7f4e45b499992f30b4cf32b8961" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 33867 } } peers { permanent_uuid: "4efd9e6155f94224952be95c3785290e" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 46051 } }
I20260709 13:17:51.934603  6439 raft_consensus.cc:385] T 87b6f7d6ab0742c0a8247c7bc6cbe4eb P 215a40d9cebb42d9906c6e4616e2950a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:51.934743  6440 raft_consensus.cc:385] T 87b6f7d6ab0742c0a8247c7bc6cbe4eb P b7aed7f4e45b499992f30b4cf32b8961 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:51.934902  6439 raft_consensus.cc:740] T 87b6f7d6ab0742c0a8247c7bc6cbe4eb P 215a40d9cebb42d9906c6e4616e2950a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 215a40d9cebb42d9906c6e4616e2950a, State: Initialized, Role: FOLLOWER
I20260709 13:17:51.935125  6440 raft_consensus.cc:740] T 87b6f7d6ab0742c0a8247c7bc6cbe4eb P b7aed7f4e45b499992f30b4cf32b8961 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b7aed7f4e45b499992f30b4cf32b8961, State: Initialized, Role: FOLLOWER
I20260709 13:17:51.935762  6439 consensus_queue.cc:260] T 87b6f7d6ab0742c0a8247c7bc6cbe4eb P 215a40d9cebb42d9906c6e4616e2950a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "215a40d9cebb42d9906c6e4616e2950a" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 40171 } } peers { permanent_uuid: "b7aed7f4e45b499992f30b4cf32b8961" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 33867 } } peers { permanent_uuid: "4efd9e6155f94224952be95c3785290e" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 46051 } }
I20260709 13:17:51.935947  6440 consensus_queue.cc:260] T 87b6f7d6ab0742c0a8247c7bc6cbe4eb P b7aed7f4e45b499992f30b4cf32b8961 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "215a40d9cebb42d9906c6e4616e2950a" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 40171 } } peers { permanent_uuid: "b7aed7f4e45b499992f30b4cf32b8961" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 33867 } } peers { permanent_uuid: "4efd9e6155f94224952be95c3785290e" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 46051 } }
I20260709 13:17:51.938972  6250 raft_consensus.cc:2468] T c7cfe05c9c2f47f487fbf3b81a0a47ca P 215a40d9cebb42d9906c6e4616e2950a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7aed7f4e45b499992f30b4cf32b8961 in term 1.
I20260709 13:17:51.939579  6398 raft_consensus.cc:2468] T c7cfe05c9c2f47f487fbf3b81a0a47ca P 4efd9e6155f94224952be95c3785290e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7aed7f4e45b499992f30b4cf32b8961 in term 1.
I20260709 13:17:51.940589  6439 ts_tablet_manager.cc:1434] T 87b6f7d6ab0742c0a8247c7bc6cbe4eb P 215a40d9cebb42d9906c6e4616e2950a: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 13:17:51.940490  6291 leader_election.cc:304] T c7cfe05c9c2f47f487fbf3b81a0a47ca P b7aed7f4e45b499992f30b4cf32b8961 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 215a40d9cebb42d9906c6e4616e2950a, b7aed7f4e45b499992f30b4cf32b8961; no voters: 
I20260709 13:17:51.939142  6440 ts_tablet_manager.cc:1434] T 87b6f7d6ab0742c0a8247c7bc6cbe4eb P b7aed7f4e45b499992f30b4cf32b8961: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:17:51.941447  6468 raft_consensus.cc:2804] T c7cfe05c9c2f47f487fbf3b81a0a47ca P b7aed7f4e45b499992f30b4cf32b8961 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:51.942000  6468 raft_consensus.cc:697] T c7cfe05c9c2f47f487fbf3b81a0a47ca P b7aed7f4e45b499992f30b4cf32b8961 [term 1 LEADER]: Becoming Leader. State: Replica: b7aed7f4e45b499992f30b4cf32b8961, State: Running, Role: LEADER
I20260709 13:17:51.942579  6440 tablet_bootstrap.cc:492] T e17475c1ea464d1f84e7f36957761cd9 P b7aed7f4e45b499992f30b4cf32b8961: Bootstrap starting.
I20260709 13:17:51.942894  6468 consensus_queue.cc:237] T c7cfe05c9c2f47f487fbf3b81a0a47ca P b7aed7f4e45b499992f30b4cf32b8961 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "215a40d9cebb42d9906c6e4616e2950a" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 40171 } } peers { permanent_uuid: "b7aed7f4e45b499992f30b4cf32b8961" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 33867 } } peers { permanent_uuid: "4efd9e6155f94224952be95c3785290e" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 46051 } }
I20260709 13:17:51.948604  6440 tablet_bootstrap.cc:654] T e17475c1ea464d1f84e7f36957761cd9 P b7aed7f4e45b499992f30b4cf32b8961: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:51.929807  6446 leader_election.cc:290] T c7cfe05c9c2f47f487fbf3b81a0a47ca P b7aed7f4e45b499992f30b4cf32b8961 [CANDIDATE]: Term 1 election: Requested vote from peers 215a40d9cebb42d9906c6e4616e2950a (127.5.126.65:40171), 4efd9e6155f94224952be95c3785290e (127.5.126.67:46051)
I20260709 13:17:51.953838  6440 tablet_bootstrap.cc:492] T e17475c1ea464d1f84e7f36957761cd9 P b7aed7f4e45b499992f30b4cf32b8961: No bootstrap required, opened a new log
I20260709 13:17:51.954377  6440 ts_tablet_manager.cc:1403] T e17475c1ea464d1f84e7f36957761cd9 P b7aed7f4e45b499992f30b4cf32b8961: Time spent bootstrapping tablet: real 0.012s	user 0.009s	sys 0.000s
I20260709 13:17:51.957144  6440 raft_consensus.cc:359] T e17475c1ea464d1f84e7f36957761cd9 P b7aed7f4e45b499992f30b4cf32b8961 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "215a40d9cebb42d9906c6e4616e2950a" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 40171 } } peers { permanent_uuid: "b7aed7f4e45b499992f30b4cf32b8961" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 33867 } } peers { permanent_uuid: "4efd9e6155f94224952be95c3785290e" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 46051 } }
I20260709 13:17:51.957906  6440 raft_consensus.cc:385] T e17475c1ea464d1f84e7f36957761cd9 P b7aed7f4e45b499992f30b4cf32b8961 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:51.958197  6440 raft_consensus.cc:740] T e17475c1ea464d1f84e7f36957761cd9 P b7aed7f4e45b499992f30b4cf32b8961 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b7aed7f4e45b499992f30b4cf32b8961, State: Initialized, Role: FOLLOWER
I20260709 13:17:51.958338  6147 catalog_manager.cc:5697] T c7cfe05c9c2f47f487fbf3b81a0a47ca P b7aed7f4e45b499992f30b4cf32b8961 reported cstate change: term changed from 0 to 1, leader changed from <none> to b7aed7f4e45b499992f30b4cf32b8961 (127.5.126.66). New cstate: current_term: 1 leader_uuid: "b7aed7f4e45b499992f30b4cf32b8961" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "215a40d9cebb42d9906c6e4616e2950a" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 40171 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b7aed7f4e45b499992f30b4cf32b8961" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 33867 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4efd9e6155f94224952be95c3785290e" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 46051 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:51.958990  6440 consensus_queue.cc:260] T e17475c1ea464d1f84e7f36957761cd9 P b7aed7f4e45b499992f30b4cf32b8961 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "215a40d9cebb42d9906c6e4616e2950a" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 40171 } } peers { permanent_uuid: "b7aed7f4e45b499992f30b4cf32b8961" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 33867 } } peers { permanent_uuid: "4efd9e6155f94224952be95c3785290e" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 46051 } }
I20260709 13:17:51.961095  6440 ts_tablet_manager.cc:1434] T e17475c1ea464d1f84e7f36957761cd9 P b7aed7f4e45b499992f30b4cf32b8961: Time spent starting tablet: real 0.006s	user 0.008s	sys 0.000s
I20260709 13:17:52.006035  6473 consensus_queue.cc:1048] T 879fa203410744a9a1a63d33e0801f07 P 4efd9e6155f94224952be95c3785290e [LEADER]: Connected to new peer: Peer: permanent_uuid: "215a40d9cebb42d9906c6e4616e2950a" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 40171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:52.019340  6473 consensus_queue.cc:1048] T 879fa203410744a9a1a63d33e0801f07 P 4efd9e6155f94224952be95c3785290e [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7aed7f4e45b499992f30b4cf32b8961" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 33867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:17:52.029398  6446 consensus_queue.cc:1048] T de207f715322422ba6c06aa6b5ade0fa P b7aed7f4e45b499992f30b4cf32b8961 [LEADER]: Connected to new peer: Peer: permanent_uuid: "215a40d9cebb42d9906c6e4616e2950a" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 40171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:52.035185  6446 raft_consensus.cc:493] T d51e67b3ea6a458c818b4c7cf67ceef5 P b7aed7f4e45b499992f30b4cf32b8961 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:52.035707  6446 raft_consensus.cc:515] T d51e67b3ea6a458c818b4c7cf67ceef5 P b7aed7f4e45b499992f30b4cf32b8961 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "215a40d9cebb42d9906c6e4616e2950a" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 40171 } } peers { permanent_uuid: "b7aed7f4e45b499992f30b4cf32b8961" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 33867 } } peers { permanent_uuid: "4efd9e6155f94224952be95c3785290e" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 46051 } }
I20260709 13:17:52.039431  6446 leader_election.cc:290] T d51e67b3ea6a458c818b4c7cf67ceef5 P b7aed7f4e45b499992f30b4cf32b8961 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 215a40d9cebb42d9906c6e4616e2950a (127.5.126.65:40171), 4efd9e6155f94224952be95c3785290e (127.5.126.67:46051)
I20260709 13:17:52.039301  6250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d51e67b3ea6a458c818b4c7cf67ceef5" candidate_uuid: "b7aed7f4e45b499992f30b4cf32b8961" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "215a40d9cebb42d9906c6e4616e2950a" is_pre_election: true
I20260709 13:17:52.040714  6397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d51e67b3ea6a458c818b4c7cf67ceef5" candidate_uuid: "b7aed7f4e45b499992f30b4cf32b8961" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4efd9e6155f94224952be95c3785290e" is_pre_election: true
I20260709 13:17:52.041483  6397 raft_consensus.cc:2393] T d51e67b3ea6a458c818b4c7cf67ceef5 P 4efd9e6155f94224952be95c3785290e [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7aed7f4e45b499992f30b4cf32b8961 in current term 1: Already voted for candidate 215a40d9cebb42d9906c6e4616e2950a in this term.
I20260709 13:17:52.042649  6471 consensus_queue.cc:1048] T de207f715322422ba6c06aa6b5ade0fa P b7aed7f4e45b499992f30b4cf32b8961 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4efd9e6155f94224952be95c3785290e" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 46051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:17:52.042891  6288 leader_election.cc:304] T d51e67b3ea6a458c818b4c7cf67ceef5 P b7aed7f4e45b499992f30b4cf32b8961 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7aed7f4e45b499992f30b4cf32b8961; no voters: 215a40d9cebb42d9906c6e4616e2950a, 4efd9e6155f94224952be95c3785290e
I20260709 13:17:52.044113  6468 raft_consensus.cc:3060] T d51e67b3ea6a458c818b4c7cf67ceef5 P b7aed7f4e45b499992f30b4cf32b8961 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:52.053462  6468 raft_consensus.cc:2749] T d51e67b3ea6a458c818b4c7cf67ceef5 P b7aed7f4e45b499992f30b4cf32b8961 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:17:52.078389  6473 raft_consensus.cc:493] T e17475c1ea464d1f84e7f36957761cd9 P 4efd9e6155f94224952be95c3785290e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:52.078881  6473 raft_consensus.cc:515] T e17475c1ea464d1f84e7f36957761cd9 P 4efd9e6155f94224952be95c3785290e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "215a40d9cebb42d9906c6e4616e2950a" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 40171 } } peers { permanent_uuid: "b7aed7f4e45b499992f30b4cf32b8961" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 33867 } } peers { permanent_uuid: "4efd9e6155f94224952be95c3785290e" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 46051 } }
I20260709 13:17:52.080781  6473 leader_election.cc:290] T e17475c1ea464d1f84e7f36957761cd9 P 4efd9e6155f94224952be95c3785290e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 215a40d9cebb42d9906c6e4616e2950a (127.5.126.65:40171), b7aed7f4e45b499992f30b4cf32b8961 (127.5.126.66:33867)
I20260709 13:17:52.081940  6325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e17475c1ea464d1f84e7f36957761cd9" candidate_uuid: "4efd9e6155f94224952be95c3785290e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b7aed7f4e45b499992f30b4cf32b8961" is_pre_election: true
I20260709 13:17:52.081825  6250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e17475c1ea464d1f84e7f36957761cd9" candidate_uuid: "4efd9e6155f94224952be95c3785290e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "215a40d9cebb42d9906c6e4616e2950a" is_pre_election: true
I20260709 13:17:52.082818  6250 raft_consensus.cc:2468] T e17475c1ea464d1f84e7f36957761cd9 P 215a40d9cebb42d9906c6e4616e2950a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4efd9e6155f94224952be95c3785290e in term 0.
I20260709 13:17:52.082818  6325 raft_consensus.cc:2468] T e17475c1ea464d1f84e7f36957761cd9 P b7aed7f4e45b499992f30b4cf32b8961 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4efd9e6155f94224952be95c3785290e in term 0.
I20260709 13:17:52.084278  6365 leader_election.cc:304] T e17475c1ea464d1f84e7f36957761cd9 P 4efd9e6155f94224952be95c3785290e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 215a40d9cebb42d9906c6e4616e2950a, 4efd9e6155f94224952be95c3785290e; no voters: 
I20260709 13:17:52.085144  6473 raft_consensus.cc:2804] T e17475c1ea464d1f84e7f36957761cd9 P 4efd9e6155f94224952be95c3785290e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:52.085515  6473 raft_consensus.cc:493] T e17475c1ea464d1f84e7f36957761cd9 P 4efd9e6155f94224952be95c3785290e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:52.085783  6473 raft_consensus.cc:3060] T e17475c1ea464d1f84e7f36957761cd9 P 4efd9e6155f94224952be95c3785290e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:52.090387  6473 raft_consensus.cc:515] T e17475c1ea464d1f84e7f36957761cd9 P 4efd9e6155f94224952be95c3785290e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "215a40d9cebb42d9906c6e4616e2950a" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 40171 } } peers { permanent_uuid: "b7aed7f4e45b499992f30b4cf32b8961" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 33867 } } peers { permanent_uuid: "4efd9e6155f94224952be95c3785290e" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 46051 } }
I20260709 13:17:52.091974  6473 leader_election.cc:290] T e17475c1ea464d1f84e7f36957761cd9 P 4efd9e6155f94224952be95c3785290e [CANDIDATE]: Term 1 election: Requested vote from peers 215a40d9cebb42d9906c6e4616e2950a (127.5.126.65:40171), b7aed7f4e45b499992f30b4cf32b8961 (127.5.126.66:33867)
I20260709 13:17:52.093314  6325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e17475c1ea464d1f84e7f36957761cd9" candidate_uuid: "4efd9e6155f94224952be95c3785290e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b7aed7f4e45b499992f30b4cf32b8961"
I20260709 13:17:52.093246  6250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e17475c1ea464d1f84e7f36957761cd9" candidate_uuid: "4efd9e6155f94224952be95c3785290e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "215a40d9cebb42d9906c6e4616e2950a"
I20260709 13:17:52.094184  6325 raft_consensus.cc:3060] T e17475c1ea464d1f84e7f36957761cd9 P b7aed7f4e45b499992f30b4cf32b8961 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:52.094236  6250 raft_consensus.cc:3060] T e17475c1ea464d1f84e7f36957761cd9 P 215a40d9cebb42d9906c6e4616e2950a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:52.097257  6473 raft_consensus.cc:493] T 87b6f7d6ab0742c0a8247c7bc6cbe4eb P 4efd9e6155f94224952be95c3785290e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:52.097798  6473 raft_consensus.cc:515] T 87b6f7d6ab0742c0a8247c7bc6cbe4eb P 4efd9e6155f94224952be95c3785290e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "215a40d9cebb42d9906c6e4616e2950a" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 40171 } } peers { permanent_uuid: "b7aed7f4e45b499992f30b4cf32b8961" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 33867 } } peers { permanent_uuid: "4efd9e6155f94224952be95c3785290e" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 46051 } }
I20260709 13:17:52.100440  6325 raft_consensus.cc:2468] T e17475c1ea464d1f84e7f36957761cd9 P b7aed7f4e45b499992f30b4cf32b8961 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4efd9e6155f94224952be95c3785290e in term 1.
I20260709 13:17:52.100911  6248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87b6f7d6ab0742c0a8247c7bc6cbe4eb" candidate_uuid: "4efd9e6155f94224952be95c3785290e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "215a40d9cebb42d9906c6e4616e2950a" is_pre_election: true
I20260709 13:17:52.101528  6248 raft_consensus.cc:2468] T 87b6f7d6ab0742c0a8247c7bc6cbe4eb P 215a40d9cebb42d9906c6e4616e2950a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4efd9e6155f94224952be95c3785290e in term 0.
I20260709 13:17:52.101679  6250 raft_consensus.cc:2468] T e17475c1ea464d1f84e7f36957761cd9 P 215a40d9cebb42d9906c6e4616e2950a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4efd9e6155f94224952be95c3785290e in term 1.
I20260709 13:17:52.101683  6473 leader_election.cc:290] T 87b6f7d6ab0742c0a8247c7bc6cbe4eb P 4efd9e6155f94224952be95c3785290e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 215a40d9cebb42d9906c6e4616e2950a (127.5.126.65:40171), b7aed7f4e45b499992f30b4cf32b8961 (127.5.126.66:33867)
I20260709 13:17:52.103070  6365 leader_election.cc:304] T 87b6f7d6ab0742c0a8247c7bc6cbe4eb P 4efd9e6155f94224952be95c3785290e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 215a40d9cebb42d9906c6e4616e2950a, 4efd9e6155f94224952be95c3785290e; no voters: 
I20260709 13:17:52.103381  6362 leader_election.cc:304] T e17475c1ea464d1f84e7f36957761cd9 P 4efd9e6155f94224952be95c3785290e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4efd9e6155f94224952be95c3785290e, b7aed7f4e45b499992f30b4cf32b8961; no voters: 
I20260709 13:17:52.103427  6325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87b6f7d6ab0742c0a8247c7bc6cbe4eb" candidate_uuid: "4efd9e6155f94224952be95c3785290e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b7aed7f4e45b499992f30b4cf32b8961" is_pre_election: true
I20260709 13:17:52.103410  6468 consensus_queue.cc:1048] T 82ccb3ed51b2453381692135f3179a54 P b7aed7f4e45b499992f30b4cf32b8961 [LEADER]: Connected to new peer: Peer: permanent_uuid: "215a40d9cebb42d9906c6e4616e2950a" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 40171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:17:52.104571  6469 raft_consensus.cc:2804] T e17475c1ea464d1f84e7f36957761cd9 P 4efd9e6155f94224952be95c3785290e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:52.104501  6325 raft_consensus.cc:2468] T 87b6f7d6ab0742c0a8247c7bc6cbe4eb P b7aed7f4e45b499992f30b4cf32b8961 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4efd9e6155f94224952be95c3785290e in term 0.
I20260709 13:17:52.104809  6473 raft_consensus.cc:2804] T 87b6f7d6ab0742c0a8247c7bc6cbe4eb P 4efd9e6155f94224952be95c3785290e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:52.105131  6469 raft_consensus.cc:697] T e17475c1ea464d1f84e7f36957761cd9 P 4efd9e6155f94224952be95c3785290e [term 1 LEADER]: Becoming Leader. State: Replica: 4efd9e6155f94224952be95c3785290e, State: Running, Role: LEADER
I20260709 13:17:52.105315  6473 raft_consensus.cc:493] T 87b6f7d6ab0742c0a8247c7bc6cbe4eb P 4efd9e6155f94224952be95c3785290e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:52.105744  6473 raft_consensus.cc:3060] T 87b6f7d6ab0742c0a8247c7bc6cbe4eb P 4efd9e6155f94224952be95c3785290e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:52.106093  6469 consensus_queue.cc:237] T e17475c1ea464d1f84e7f36957761cd9 P 4efd9e6155f94224952be95c3785290e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "215a40d9cebb42d9906c6e4616e2950a" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 40171 } } peers { permanent_uuid: "b7aed7f4e45b499992f30b4cf32b8961" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 33867 } } peers { permanent_uuid: "4efd9e6155f94224952be95c3785290e" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 46051 } }
I20260709 13:17:52.121973  6470 consensus_queue.cc:1048] T 82ccb3ed51b2453381692135f3179a54 P b7aed7f4e45b499992f30b4cf32b8961 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4efd9e6155f94224952be95c3785290e" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 46051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:17:52.125882  6147 catalog_manager.cc:5697] T e17475c1ea464d1f84e7f36957761cd9 P 4efd9e6155f94224952be95c3785290e reported cstate change: term changed from 0 to 1, leader changed from <none> to 4efd9e6155f94224952be95c3785290e (127.5.126.67). New cstate: current_term: 1 leader_uuid: "4efd9e6155f94224952be95c3785290e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "215a40d9cebb42d9906c6e4616e2950a" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 40171 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b7aed7f4e45b499992f30b4cf32b8961" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 33867 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4efd9e6155f94224952be95c3785290e" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 46051 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:52.130753  6473 raft_consensus.cc:515] T 87b6f7d6ab0742c0a8247c7bc6cbe4eb P 4efd9e6155f94224952be95c3785290e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "215a40d9cebb42d9906c6e4616e2950a" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 40171 } } peers { permanent_uuid: "b7aed7f4e45b499992f30b4cf32b8961" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 33867 } } peers { permanent_uuid: "4efd9e6155f94224952be95c3785290e" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 46051 } }
I20260709 13:17:52.133628  6473 leader_election.cc:290] T 87b6f7d6ab0742c0a8247c7bc6cbe4eb P 4efd9e6155f94224952be95c3785290e [CANDIDATE]: Term 1 election: Requested vote from peers 215a40d9cebb42d9906c6e4616e2950a (127.5.126.65:40171), b7aed7f4e45b499992f30b4cf32b8961 (127.5.126.66:33867)
I20260709 13:17:52.134809  6325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87b6f7d6ab0742c0a8247c7bc6cbe4eb" candidate_uuid: "4efd9e6155f94224952be95c3785290e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b7aed7f4e45b499992f30b4cf32b8961"
I20260709 13:17:52.135430  6325 raft_consensus.cc:3060] T 87b6f7d6ab0742c0a8247c7bc6cbe4eb P b7aed7f4e45b499992f30b4cf32b8961 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:52.135522  6250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87b6f7d6ab0742c0a8247c7bc6cbe4eb" candidate_uuid: "4efd9e6155f94224952be95c3785290e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "215a40d9cebb42d9906c6e4616e2950a"
I20260709 13:17:52.136248  6250 raft_consensus.cc:3060] T 87b6f7d6ab0742c0a8247c7bc6cbe4eb P 215a40d9cebb42d9906c6e4616e2950a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:52.143419  6325 raft_consensus.cc:2468] T 87b6f7d6ab0742c0a8247c7bc6cbe4eb P b7aed7f4e45b499992f30b4cf32b8961 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4efd9e6155f94224952be95c3785290e in term 1.
I20260709 13:17:52.144364  6250 raft_consensus.cc:2468] T 87b6f7d6ab0742c0a8247c7bc6cbe4eb P 215a40d9cebb42d9906c6e4616e2950a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4efd9e6155f94224952be95c3785290e in term 1.
I20260709 13:17:52.145187  6362 leader_election.cc:304] T 87b6f7d6ab0742c0a8247c7bc6cbe4eb P 4efd9e6155f94224952be95c3785290e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4efd9e6155f94224952be95c3785290e, b7aed7f4e45b499992f30b4cf32b8961; no voters: 
I20260709 13:17:52.146109  6473 raft_consensus.cc:2804] T 87b6f7d6ab0742c0a8247c7bc6cbe4eb P 4efd9e6155f94224952be95c3785290e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:52.146672  6473 raft_consensus.cc:697] T 87b6f7d6ab0742c0a8247c7bc6cbe4eb P 4efd9e6155f94224952be95c3785290e [term 1 LEADER]: Becoming Leader. State: Replica: 4efd9e6155f94224952be95c3785290e, State: Running, Role: LEADER
I20260709 13:17:52.147466  6473 consensus_queue.cc:237] T 87b6f7d6ab0742c0a8247c7bc6cbe4eb P 4efd9e6155f94224952be95c3785290e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "215a40d9cebb42d9906c6e4616e2950a" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 40171 } } peers { permanent_uuid: "b7aed7f4e45b499992f30b4cf32b8961" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 33867 } } peers { permanent_uuid: "4efd9e6155f94224952be95c3785290e" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 46051 } }
I20260709 13:17:52.155412  6147 catalog_manager.cc:5697] T 87b6f7d6ab0742c0a8247c7bc6cbe4eb P 4efd9e6155f94224952be95c3785290e reported cstate change: term changed from 0 to 1, leader changed from <none> to 4efd9e6155f94224952be95c3785290e (127.5.126.67). New cstate: current_term: 1 leader_uuid: "4efd9e6155f94224952be95c3785290e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "215a40d9cebb42d9906c6e4616e2950a" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 40171 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b7aed7f4e45b499992f30b4cf32b8961" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 33867 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4efd9e6155f94224952be95c3785290e" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 46051 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:52.163769  6475 raft_consensus.cc:493] T ee893b0b66474d44baaeba294d249e32 P 215a40d9cebb42d9906c6e4616e2950a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:52.164383  6475 raft_consensus.cc:515] T ee893b0b66474d44baaeba294d249e32 P 215a40d9cebb42d9906c6e4616e2950a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "215a40d9cebb42d9906c6e4616e2950a" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 40171 } } peers { permanent_uuid: "b7aed7f4e45b499992f30b4cf32b8961" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 33867 } } peers { permanent_uuid: "4efd9e6155f94224952be95c3785290e" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 46051 } }
I20260709 13:17:52.166067  6475 leader_election.cc:290] T ee893b0b66474d44baaeba294d249e32 P 215a40d9cebb42d9906c6e4616e2950a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b7aed7f4e45b499992f30b4cf32b8961 (127.5.126.66:33867), 4efd9e6155f94224952be95c3785290e (127.5.126.67:46051)
I20260709 13:17:52.166966  6325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee893b0b66474d44baaeba294d249e32" candidate_uuid: "215a40d9cebb42d9906c6e4616e2950a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b7aed7f4e45b499992f30b4cf32b8961" is_pre_election: true
I20260709 13:17:52.167205  6397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee893b0b66474d44baaeba294d249e32" candidate_uuid: "215a40d9cebb42d9906c6e4616e2950a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4efd9e6155f94224952be95c3785290e" is_pre_election: true
I20260709 13:17:52.167973  6397 raft_consensus.cc:2393] T ee893b0b66474d44baaeba294d249e32 P 4efd9e6155f94224952be95c3785290e [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 215a40d9cebb42d9906c6e4616e2950a in current term 1: Already voted for candidate b7aed7f4e45b499992f30b4cf32b8961 in this term.
I20260709 13:17:52.168910  6213 leader_election.cc:304] T ee893b0b66474d44baaeba294d249e32 P 215a40d9cebb42d9906c6e4616e2950a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 215a40d9cebb42d9906c6e4616e2950a; no voters: 4efd9e6155f94224952be95c3785290e, b7aed7f4e45b499992f30b4cf32b8961
I20260709 13:17:52.169500  6475 raft_consensus.cc:3060] T ee893b0b66474d44baaeba294d249e32 P 215a40d9cebb42d9906c6e4616e2950a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:52.174938  6475 raft_consensus.cc:2749] T ee893b0b66474d44baaeba294d249e32 P 215a40d9cebb42d9906c6e4616e2950a [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:17:52.182006  6470 consensus_queue.cc:1048] T ee893b0b66474d44baaeba294d249e32 P b7aed7f4e45b499992f30b4cf32b8961 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4efd9e6155f94224952be95c3785290e" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 46051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:52.194156  6468 consensus_queue.cc:1048] T ee893b0b66474d44baaeba294d249e32 P b7aed7f4e45b499992f30b4cf32b8961 [LEADER]: Connected to new peer: Peer: permanent_uuid: "215a40d9cebb42d9906c6e4616e2950a" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 40171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:17:52.212510  6250 raft_consensus.cc:3060] T ec94c2acba4a4333a9db46ab77cd9781 P 215a40d9cebb42d9906c6e4616e2950a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:52.219027  6468 consensus_queue.cc:1048] T ec94c2acba4a4333a9db46ab77cd9781 P b7aed7f4e45b499992f30b4cf32b8961 [LEADER]: Connected to new peer: Peer: permanent_uuid: "215a40d9cebb42d9906c6e4616e2950a" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 40171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:52.230330  6446 consensus_queue.cc:1048] T ec94c2acba4a4333a9db46ab77cd9781 P b7aed7f4e45b499992f30b4cf32b8961 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4efd9e6155f94224952be95c3785290e" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 46051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:52.255119  6473 consensus_queue.cc:1048] T 199b09cd4e0d433fafb2e8d5006d113d P 4efd9e6155f94224952be95c3785290e [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7aed7f4e45b499992f30b4cf32b8961" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 33867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:52.262699  6475 consensus_queue.cc:1048] T d51e67b3ea6a458c818b4c7cf67ceef5 P 215a40d9cebb42d9906c6e4616e2950a [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7aed7f4e45b499992f30b4cf32b8961" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 33867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:52.267719  6447 consensus_queue.cc:1048] T 199b09cd4e0d433fafb2e8d5006d113d P 4efd9e6155f94224952be95c3785290e [LEADER]: Connected to new peer: Peer: permanent_uuid: "215a40d9cebb42d9906c6e4616e2950a" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 40171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:17:52.279984  6445 consensus_queue.cc:1048] T d51e67b3ea6a458c818b4c7cf67ceef5 P 215a40d9cebb42d9906c6e4616e2950a [LEADER]: Connected to new peer: Peer: permanent_uuid: "4efd9e6155f94224952be95c3785290e" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 46051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:17:52.423448  6325 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ec94c2acba4a4333a9db46ab77cd9781"
dest_uuid: "b7aed7f4e45b499992f30b4cf32b8961"
mode: GRACEFUL
new_leader_uuid: "215a40d9cebb42d9906c6e4616e2950a"
 from {username='slave'} at 127.0.0.1:58368
I20260709 13:17:52.424150  6325 raft_consensus.cc:606] T ec94c2acba4a4333a9db46ab77cd9781 P b7aed7f4e45b499992f30b4cf32b8961 [term 1 LEADER]: Received request to transfer leadership to TS 215a40d9cebb42d9906c6e4616e2950a
I20260709 13:17:52.430397  6325 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ee893b0b66474d44baaeba294d249e32"
dest_uuid: "b7aed7f4e45b499992f30b4cf32b8961"
mode: GRACEFUL
new_leader_uuid: "215a40d9cebb42d9906c6e4616e2950a"
 from {username='slave'} at 127.0.0.1:58368
I20260709 13:17:52.431106  6325 raft_consensus.cc:606] T ee893b0b66474d44baaeba294d249e32 P b7aed7f4e45b499992f30b4cf32b8961 [term 1 LEADER]: Received request to transfer leadership to TS 215a40d9cebb42d9906c6e4616e2950a
I20260709 13:17:52.446729  6446 consensus_queue.cc:1048] T c7cfe05c9c2f47f487fbf3b81a0a47ca P b7aed7f4e45b499992f30b4cf32b8961 [LEADER]: Connected to new peer: Peer: permanent_uuid: "215a40d9cebb42d9906c6e4616e2950a" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 40171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:52.449209  6397 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "199b09cd4e0d433fafb2e8d5006d113d"
dest_uuid: "4efd9e6155f94224952be95c3785290e"
mode: GRACEFUL
new_leader_uuid: "215a40d9cebb42d9906c6e4616e2950a"
 from {username='slave'} at 127.0.0.1:33270
I20260709 13:17:52.449818  6397 raft_consensus.cc:606] T 199b09cd4e0d433fafb2e8d5006d113d P 4efd9e6155f94224952be95c3785290e [term 1 LEADER]: Received request to transfer leadership to TS 215a40d9cebb42d9906c6e4616e2950a
I20260709 13:17:52.455631  6397 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "879fa203410744a9a1a63d33e0801f07"
dest_uuid: "4efd9e6155f94224952be95c3785290e"
mode: GRACEFUL
new_leader_uuid: "215a40d9cebb42d9906c6e4616e2950a"
 from {username='slave'} at 127.0.0.1:33270
I20260709 13:17:52.456286  6397 raft_consensus.cc:606] T 879fa203410744a9a1a63d33e0801f07 P 4efd9e6155f94224952be95c3785290e [term 1 LEADER]: Received request to transfer leadership to TS 215a40d9cebb42d9906c6e4616e2950a
I20260709 13:17:52.461405  6325 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "82ccb3ed51b2453381692135f3179a54"
dest_uuid: "b7aed7f4e45b499992f30b4cf32b8961"
mode: GRACEFUL
new_leader_uuid: "215a40d9cebb42d9906c6e4616e2950a"
 from {username='slave'} at 127.0.0.1:58368
I20260709 13:17:52.461943  6325 raft_consensus.cc:606] T 82ccb3ed51b2453381692135f3179a54 P b7aed7f4e45b499992f30b4cf32b8961 [term 1 LEADER]: Received request to transfer leadership to TS 215a40d9cebb42d9906c6e4616e2950a
I20260709 13:17:52.476492  6447 raft_consensus.cc:993] T 879fa203410744a9a1a63d33e0801f07 P 4efd9e6155f94224952be95c3785290e: : Instructing follower 215a40d9cebb42d9906c6e4616e2950a to start an election
I20260709 13:17:52.476960  6473 raft_consensus.cc:1081] T 879fa203410744a9a1a63d33e0801f07 P 4efd9e6155f94224952be95c3785290e [term 1 LEADER]: Signalling peer 215a40d9cebb42d9906c6e4616e2950a to start an election
I20260709 13:17:52.478626  6250 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "879fa203410744a9a1a63d33e0801f07"
dest_uuid: "215a40d9cebb42d9906c6e4616e2950a"
 from {username='slave'} at 127.0.0.1:56964
I20260709 13:17:52.479236  6250 raft_consensus.cc:493] T 879fa203410744a9a1a63d33e0801f07 P 215a40d9cebb42d9906c6e4616e2950a [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:52.479611  6446 consensus_queue.cc:1048] T c7cfe05c9c2f47f487fbf3b81a0a47ca P b7aed7f4e45b499992f30b4cf32b8961 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4efd9e6155f94224952be95c3785290e" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 46051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:52.479612  6250 raft_consensus.cc:3060] T 879fa203410744a9a1a63d33e0801f07 P 215a40d9cebb42d9906c6e4616e2950a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:52.490569  6250 raft_consensus.cc:515] T 879fa203410744a9a1a63d33e0801f07 P 215a40d9cebb42d9906c6e4616e2950a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "215a40d9cebb42d9906c6e4616e2950a" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 40171 } } peers { permanent_uuid: "b7aed7f4e45b499992f30b4cf32b8961" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 33867 } } peers { permanent_uuid: "4efd9e6155f94224952be95c3785290e" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 46051 } }
I20260709 13:17:52.491477  6248 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d51e67b3ea6a458c818b4c7cf67ceef5"
dest_uuid: "215a40d9cebb42d9906c6e4616e2950a"
mode: GRACEFUL
new_leader_uuid: "b7aed7f4e45b499992f30b4cf32b8961"
 from {username='slave'} at 127.0.0.1:56968
I20260709 13:17:52.492014  6248 raft_consensus.cc:606] T d51e67b3ea6a458c818b4c7cf67ceef5 P 215a40d9cebb42d9906c6e4616e2950a [term 1 LEADER]: Received request to transfer leadership to TS b7aed7f4e45b499992f30b4cf32b8961
I20260709 13:17:52.493551  6325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "879fa203410744a9a1a63d33e0801f07" candidate_uuid: "215a40d9cebb42d9906c6e4616e2950a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b7aed7f4e45b499992f30b4cf32b8961"
I20260709 13:17:52.494205  6325 raft_consensus.cc:3060] T 879fa203410744a9a1a63d33e0801f07 P b7aed7f4e45b499992f30b4cf32b8961 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:52.501168  6325 raft_consensus.cc:2468] T 879fa203410744a9a1a63d33e0801f07 P b7aed7f4e45b499992f30b4cf32b8961 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 215a40d9cebb42d9906c6e4616e2950a in term 2.
I20260709 13:17:52.502242  6213 leader_election.cc:304] T 879fa203410744a9a1a63d33e0801f07 P 215a40d9cebb42d9906c6e4616e2950a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 215a40d9cebb42d9906c6e4616e2950a, b7aed7f4e45b499992f30b4cf32b8961; no voters: 
I20260709 13:17:52.502388  6250 leader_election.cc:290] T 879fa203410744a9a1a63d33e0801f07 P 215a40d9cebb42d9906c6e4616e2950a [CANDIDATE]: Term 2 election: Requested vote from peers b7aed7f4e45b499992f30b4cf32b8961 (127.5.126.66:33867), 4efd9e6155f94224952be95c3785290e (127.5.126.67:46051)
I20260709 13:17:52.504029  6397 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e17475c1ea464d1f84e7f36957761cd9"
dest_uuid: "4efd9e6155f94224952be95c3785290e"
mode: GRACEFUL
new_leader_uuid: "b7aed7f4e45b499992f30b4cf32b8961"
 from {username='slave'} at 127.0.0.1:33270
I20260709 13:17:52.504340  6475 raft_consensus.cc:2804] T 879fa203410744a9a1a63d33e0801f07 P 215a40d9cebb42d9906c6e4616e2950a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:17:52.504197  6398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "879fa203410744a9a1a63d33e0801f07" candidate_uuid: "215a40d9cebb42d9906c6e4616e2950a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4efd9e6155f94224952be95c3785290e"
I20260709 13:17:52.504767  6397 raft_consensus.cc:606] T e17475c1ea464d1f84e7f36957761cd9 P 4efd9e6155f94224952be95c3785290e [term 1 LEADER]: Received request to transfer leadership to TS b7aed7f4e45b499992f30b4cf32b8961
I20260709 13:17:52.504917  6475 raft_consensus.cc:697] T 879fa203410744a9a1a63d33e0801f07 P 215a40d9cebb42d9906c6e4616e2950a [term 2 LEADER]: Becoming Leader. State: Replica: 215a40d9cebb42d9906c6e4616e2950a, State: Running, Role: LEADER
I20260709 13:17:52.506017  6475 consensus_queue.cc:237] T 879fa203410744a9a1a63d33e0801f07 P 215a40d9cebb42d9906c6e4616e2950a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "215a40d9cebb42d9906c6e4616e2950a" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 40171 } } peers { permanent_uuid: "b7aed7f4e45b499992f30b4cf32b8961" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 33867 } } peers { permanent_uuid: "4efd9e6155f94224952be95c3785290e" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 46051 } }
I20260709 13:17:52.504938  6398 raft_consensus.cc:3055] T 879fa203410744a9a1a63d33e0801f07 P 4efd9e6155f94224952be95c3785290e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:17:52.508306  6398 raft_consensus.cc:740] T 879fa203410744a9a1a63d33e0801f07 P 4efd9e6155f94224952be95c3785290e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4efd9e6155f94224952be95c3785290e, State: Running, Role: LEADER
I20260709 13:17:52.509346  6398 consensus_queue.cc:260] T 879fa203410744a9a1a63d33e0801f07 P 4efd9e6155f94224952be95c3785290e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "215a40d9cebb42d9906c6e4616e2950a" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 40171 } } peers { permanent_uuid: "b7aed7f4e45b499992f30b4cf32b8961" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 33867 } } peers { permanent_uuid: "4efd9e6155f94224952be95c3785290e" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 46051 } }
I20260709 13:17:52.510574  6398 raft_consensus.cc:3060] T 879fa203410744a9a1a63d33e0801f07 P 4efd9e6155f94224952be95c3785290e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:52.514083  6147 catalog_manager.cc:5697] T 879fa203410744a9a1a63d33e0801f07 P 215a40d9cebb42d9906c6e4616e2950a reported cstate change: term changed from 1 to 2, leader changed from 4efd9e6155f94224952be95c3785290e (127.5.126.67) to 215a40d9cebb42d9906c6e4616e2950a (127.5.126.65). New cstate: current_term: 2 leader_uuid: "215a40d9cebb42d9906c6e4616e2950a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "215a40d9cebb42d9906c6e4616e2950a" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 40171 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b7aed7f4e45b499992f30b4cf32b8961" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 33867 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4efd9e6155f94224952be95c3785290e" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 46051 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:52.516492  6398 raft_consensus.cc:2468] T 879fa203410744a9a1a63d33e0801f07 P 4efd9e6155f94224952be95c3785290e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 215a40d9cebb42d9906c6e4616e2950a in term 2.
I20260709 13:17:52.536752  6471 raft_consensus.cc:993] T 82ccb3ed51b2453381692135f3179a54 P b7aed7f4e45b499992f30b4cf32b8961: : Instructing follower 215a40d9cebb42d9906c6e4616e2950a to start an election
I20260709 13:17:52.537273  6446 raft_consensus.cc:1081] T 82ccb3ed51b2453381692135f3179a54 P b7aed7f4e45b499992f30b4cf32b8961 [term 1 LEADER]: Signalling peer 215a40d9cebb42d9906c6e4616e2950a to start an election
I20260709 13:17:52.539348  6250 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "82ccb3ed51b2453381692135f3179a54"
dest_uuid: "215a40d9cebb42d9906c6e4616e2950a"
 from {username='slave'} at 127.0.0.1:56960
I20260709 13:17:52.540488  6250 raft_consensus.cc:493] T 82ccb3ed51b2453381692135f3179a54 P 215a40d9cebb42d9906c6e4616e2950a [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:52.540850  6250 raft_consensus.cc:3060] T 82ccb3ed51b2453381692135f3179a54 P 215a40d9cebb42d9906c6e4616e2950a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:52.545111  6473 consensus_queue.cc:1048] T 87b6f7d6ab0742c0a8247c7bc6cbe4eb P 4efd9e6155f94224952be95c3785290e [LEADER]: Connected to new peer: Peer: permanent_uuid: "215a40d9cebb42d9906c6e4616e2950a" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 40171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:52.547101  6250 raft_consensus.cc:515] T 82ccb3ed51b2453381692135f3179a54 P 215a40d9cebb42d9906c6e4616e2950a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "215a40d9cebb42d9906c6e4616e2950a" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 40171 } } peers { permanent_uuid: "b7aed7f4e45b499992f30b4cf32b8961" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 33867 } } peers { permanent_uuid: "4efd9e6155f94224952be95c3785290e" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 46051 } }
I20260709 13:17:52.549468  6250 leader_election.cc:290] T 82ccb3ed51b2453381692135f3179a54 P 215a40d9cebb42d9906c6e4616e2950a [CANDIDATE]: Term 2 election: Requested vote from peers b7aed7f4e45b499992f30b4cf32b8961 (127.5.126.66:33867), 4efd9e6155f94224952be95c3785290e (127.5.126.67:46051)
I20260709 13:17:52.550843  6325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82ccb3ed51b2453381692135f3179a54" candidate_uuid: "215a40d9cebb42d9906c6e4616e2950a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b7aed7f4e45b499992f30b4cf32b8961"
I20260709 13:17:52.551616  6325 raft_consensus.cc:3055] T 82ccb3ed51b2453381692135f3179a54 P b7aed7f4e45b499992f30b4cf32b8961 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:17:52.551993  6325 raft_consensus.cc:740] T 82ccb3ed51b2453381692135f3179a54 P b7aed7f4e45b499992f30b4cf32b8961 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b7aed7f4e45b499992f30b4cf32b8961, State: Running, Role: LEADER
I20260709 13:17:52.552654  6398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82ccb3ed51b2453381692135f3179a54" candidate_uuid: "215a40d9cebb42d9906c6e4616e2950a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4efd9e6155f94224952be95c3785290e"
I20260709 13:17:52.553290  6398 raft_consensus.cc:3060] T 82ccb3ed51b2453381692135f3179a54 P 4efd9e6155f94224952be95c3785290e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:52.553021  6325 consensus_queue.cc:260] T 82ccb3ed51b2453381692135f3179a54 P b7aed7f4e45b499992f30b4cf32b8961 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "215a40d9cebb42d9906c6e4616e2950a" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 40171 } } peers { permanent_uuid: "b7aed7f4e45b499992f30b4cf32b8961" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 33867 } } peers { permanent_uuid: "4efd9e6155f94224952be95c3785290e" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 46051 } }
I20260709 13:17:52.554428  6325 raft_consensus.cc:3060] T 82ccb3ed51b2453381692135f3179a54 P b7aed7f4e45b499992f30b4cf32b8961 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:52.558079  6447 consensus_queue.cc:1048] T 87b6f7d6ab0742c0a8247c7bc6cbe4eb P 4efd9e6155f94224952be95c3785290e [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7aed7f4e45b499992f30b4cf32b8961" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 33867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:52.560501  6398 raft_consensus.cc:2468] T 82ccb3ed51b2453381692135f3179a54 P 4efd9e6155f94224952be95c3785290e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 215a40d9cebb42d9906c6e4616e2950a in term 2.
I20260709 13:17:52.562625  6213 leader_election.cc:304] T 82ccb3ed51b2453381692135f3179a54 P 215a40d9cebb42d9906c6e4616e2950a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 215a40d9cebb42d9906c6e4616e2950a, 4efd9e6155f94224952be95c3785290e; no voters: 
I20260709 13:17:52.563513  6475 raft_consensus.cc:2804] T 82ccb3ed51b2453381692135f3179a54 P 215a40d9cebb42d9906c6e4616e2950a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:17:52.564002  6475 raft_consensus.cc:697] T 82ccb3ed51b2453381692135f3179a54 P 215a40d9cebb42d9906c6e4616e2950a [term 2 LEADER]: Becoming Leader. State: Replica: 215a40d9cebb42d9906c6e4616e2950a, State: Running, Role: LEADER
I20260709 13:17:52.565074  6475 consensus_queue.cc:237] T 82ccb3ed51b2453381692135f3179a54 P 215a40d9cebb42d9906c6e4616e2950a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "215a40d9cebb42d9906c6e4616e2950a" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 40171 } } peers { permanent_uuid: "b7aed7f4e45b499992f30b4cf32b8961" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 33867 } } peers { permanent_uuid: "4efd9e6155f94224952be95c3785290e" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 46051 } }
I20260709 13:17:52.570032  6325 raft_consensus.cc:2468] T 82ccb3ed51b2453381692135f3179a54 P b7aed7f4e45b499992f30b4cf32b8961 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 215a40d9cebb42d9906c6e4616e2950a in term 2.
I20260709 13:17:52.575425  6147 catalog_manager.cc:5697] T 82ccb3ed51b2453381692135f3179a54 P 215a40d9cebb42d9906c6e4616e2950a reported cstate change: term changed from 1 to 2, leader changed from b7aed7f4e45b499992f30b4cf32b8961 (127.5.126.66) to 215a40d9cebb42d9906c6e4616e2950a (127.5.126.65). New cstate: current_term: 2 leader_uuid: "215a40d9cebb42d9906c6e4616e2950a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "215a40d9cebb42d9906c6e4616e2950a" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 40171 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b7aed7f4e45b499992f30b4cf32b8961" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 33867 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4efd9e6155f94224952be95c3785290e" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 46051 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:52.588677  6447 consensus_queue.cc:1048] T e17475c1ea464d1f84e7f36957761cd9 P 4efd9e6155f94224952be95c3785290e [LEADER]: Connected to new peer: Peer: permanent_uuid: "215a40d9cebb42d9906c6e4616e2950a" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 40171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:52.600106  6469 consensus_queue.cc:1048] T e17475c1ea464d1f84e7f36957761cd9 P 4efd9e6155f94224952be95c3785290e [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7aed7f4e45b499992f30b4cf32b8961" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 33867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:52.609592  6447 raft_consensus.cc:993] T e17475c1ea464d1f84e7f36957761cd9 P 4efd9e6155f94224952be95c3785290e: : Instructing follower b7aed7f4e45b499992f30b4cf32b8961 to start an election
I20260709 13:17:52.610102  6469 raft_consensus.cc:1081] T e17475c1ea464d1f84e7f36957761cd9 P 4efd9e6155f94224952be95c3785290e [term 1 LEADER]: Signalling peer b7aed7f4e45b499992f30b4cf32b8961 to start an election
I20260709 13:17:52.611660  6323 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e17475c1ea464d1f84e7f36957761cd9"
dest_uuid: "b7aed7f4e45b499992f30b4cf32b8961"
 from {username='slave'} at 127.0.0.1:58350
I20260709 13:17:52.612202  6323 raft_consensus.cc:493] T e17475c1ea464d1f84e7f36957761cd9 P b7aed7f4e45b499992f30b4cf32b8961 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:52.612505  6323 raft_consensus.cc:3060] T e17475c1ea464d1f84e7f36957761cd9 P b7aed7f4e45b499992f30b4cf32b8961 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:52.619091  6323 raft_consensus.cc:515] T e17475c1ea464d1f84e7f36957761cd9 P b7aed7f4e45b499992f30b4cf32b8961 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "215a40d9cebb42d9906c6e4616e2950a" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 40171 } } peers { permanent_uuid: "b7aed7f4e45b499992f30b4cf32b8961" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 33867 } } peers { permanent_uuid: "4efd9e6155f94224952be95c3785290e" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 46051 } }
I20260709 13:17:52.621431  6323 leader_election.cc:290] T e17475c1ea464d1f84e7f36957761cd9 P b7aed7f4e45b499992f30b4cf32b8961 [CANDIDATE]: Term 2 election: Requested vote from peers 215a40d9cebb42d9906c6e4616e2950a (127.5.126.65:40171), 4efd9e6155f94224952be95c3785290e (127.5.126.67:46051)
I20260709 13:17:52.622565  6248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e17475c1ea464d1f84e7f36957761cd9" candidate_uuid: "b7aed7f4e45b499992f30b4cf32b8961" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "215a40d9cebb42d9906c6e4616e2950a"
I20260709 13:17:52.622846  6398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e17475c1ea464d1f84e7f36957761cd9" candidate_uuid: "b7aed7f4e45b499992f30b4cf32b8961" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4efd9e6155f94224952be95c3785290e"
I20260709 13:17:52.623311  6248 raft_consensus.cc:3060] T e17475c1ea464d1f84e7f36957761cd9 P 215a40d9cebb42d9906c6e4616e2950a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:52.623385  6398 raft_consensus.cc:3055] T e17475c1ea464d1f84e7f36957761cd9 P 4efd9e6155f94224952be95c3785290e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:17:52.623926  6398 raft_consensus.cc:740] T e17475c1ea464d1f84e7f36957761cd9 P 4efd9e6155f94224952be95c3785290e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4efd9e6155f94224952be95c3785290e, State: Running, Role: LEADER
I20260709 13:17:52.624984  6398 consensus_queue.cc:260] T e17475c1ea464d1f84e7f36957761cd9 P 4efd9e6155f94224952be95c3785290e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "215a40d9cebb42d9906c6e4616e2950a" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 40171 } } peers { permanent_uuid: "b7aed7f4e45b499992f30b4cf32b8961" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 33867 } } peers { permanent_uuid: "4efd9e6155f94224952be95c3785290e" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 46051 } }
I20260709 13:17:52.626331  6398 raft_consensus.cc:3060] T e17475c1ea464d1f84e7f36957761cd9 P 4efd9e6155f94224952be95c3785290e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:52.631610  6248 raft_consensus.cc:2468] T e17475c1ea464d1f84e7f36957761cd9 P 215a40d9cebb42d9906c6e4616e2950a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7aed7f4e45b499992f30b4cf32b8961 in term 2.
I20260709 13:17:52.633036  6291 leader_election.cc:304] T e17475c1ea464d1f84e7f36957761cd9 P b7aed7f4e45b499992f30b4cf32b8961 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 215a40d9cebb42d9906c6e4616e2950a, b7aed7f4e45b499992f30b4cf32b8961; no voters: 
I20260709 13:17:52.633569  6398 raft_consensus.cc:2468] T e17475c1ea464d1f84e7f36957761cd9 P 4efd9e6155f94224952be95c3785290e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7aed7f4e45b499992f30b4cf32b8961 in term 2.
I20260709 13:17:52.633898  6446 raft_consensus.cc:2804] T e17475c1ea464d1f84e7f36957761cd9 P b7aed7f4e45b499992f30b4cf32b8961 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:17:52.634651  6468 raft_consensus.cc:993] T ec94c2acba4a4333a9db46ab77cd9781 P b7aed7f4e45b499992f30b4cf32b8961: : Instructing follower 215a40d9cebb42d9906c6e4616e2950a to start an election
I20260709 13:17:52.634610  6446 raft_consensus.cc:697] T e17475c1ea464d1f84e7f36957761cd9 P b7aed7f4e45b499992f30b4cf32b8961 [term 2 LEADER]: Becoming Leader. State: Replica: b7aed7f4e45b499992f30b4cf32b8961, State: Running, Role: LEADER
I20260709 13:17:52.635260  6470 raft_consensus.cc:1081] T ec94c2acba4a4333a9db46ab77cd9781 P b7aed7f4e45b499992f30b4cf32b8961 [term 1 LEADER]: Signalling peer 215a40d9cebb42d9906c6e4616e2950a to start an election
I20260709 13:17:52.635613  6446 consensus_queue.cc:237] T e17475c1ea464d1f84e7f36957761cd9 P b7aed7f4e45b499992f30b4cf32b8961 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "215a40d9cebb42d9906c6e4616e2950a" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 40171 } } peers { permanent_uuid: "b7aed7f4e45b499992f30b4cf32b8961" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 33867 } } peers { permanent_uuid: "4efd9e6155f94224952be95c3785290e" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 46051 } }
I20260709 13:17:52.637189  6248 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ec94c2acba4a4333a9db46ab77cd9781"
dest_uuid: "215a40d9cebb42d9906c6e4616e2950a"
 from {username='slave'} at 127.0.0.1:56960
I20260709 13:17:52.637809  6248 raft_consensus.cc:493] T ec94c2acba4a4333a9db46ab77cd9781 P 215a40d9cebb42d9906c6e4616e2950a [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:52.638219  6248 raft_consensus.cc:3060] T ec94c2acba4a4333a9db46ab77cd9781 P 215a40d9cebb42d9906c6e4616e2950a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:52.645582  6248 raft_consensus.cc:515] T ec94c2acba4a4333a9db46ab77cd9781 P 215a40d9cebb42d9906c6e4616e2950a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "215a40d9cebb42d9906c6e4616e2950a" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 40171 } } peers { permanent_uuid: "b7aed7f4e45b499992f30b4cf32b8961" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 33867 } } peers { permanent_uuid: "4efd9e6155f94224952be95c3785290e" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 46051 } }
I20260709 13:17:52.647428  6248 leader_election.cc:290] T ec94c2acba4a4333a9db46ab77cd9781 P 215a40d9cebb42d9906c6e4616e2950a [CANDIDATE]: Term 2 election: Requested vote from peers b7aed7f4e45b499992f30b4cf32b8961 (127.5.126.66:33867), 4efd9e6155f94224952be95c3785290e (127.5.126.67:46051)
I20260709 13:17:52.646821  6147 catalog_manager.cc:5697] T e17475c1ea464d1f84e7f36957761cd9 P b7aed7f4e45b499992f30b4cf32b8961 reported cstate change: term changed from 1 to 2, leader changed from 4efd9e6155f94224952be95c3785290e (127.5.126.67) to b7aed7f4e45b499992f30b4cf32b8961 (127.5.126.66). New cstate: current_term: 2 leader_uuid: "b7aed7f4e45b499992f30b4cf32b8961" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "215a40d9cebb42d9906c6e4616e2950a" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 40171 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b7aed7f4e45b499992f30b4cf32b8961" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 33867 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4efd9e6155f94224952be95c3785290e" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 46051 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:52.648486  6323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec94c2acba4a4333a9db46ab77cd9781" candidate_uuid: "215a40d9cebb42d9906c6e4616e2950a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b7aed7f4e45b499992f30b4cf32b8961"
I20260709 13:17:52.648767  6398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec94c2acba4a4333a9db46ab77cd9781" candidate_uuid: "215a40d9cebb42d9906c6e4616e2950a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4efd9e6155f94224952be95c3785290e"
I20260709 13:17:52.649149  6323 raft_consensus.cc:3055] T ec94c2acba4a4333a9db46ab77cd9781 P b7aed7f4e45b499992f30b4cf32b8961 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:17:52.649448  6398 raft_consensus.cc:3060] T ec94c2acba4a4333a9db46ab77cd9781 P 4efd9e6155f94224952be95c3785290e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:52.649526  6323 raft_consensus.cc:740] T ec94c2acba4a4333a9db46ab77cd9781 P b7aed7f4e45b499992f30b4cf32b8961 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b7aed7f4e45b499992f30b4cf32b8961, State: Running, Role: LEADER
I20260709 13:17:52.650626  6323 consensus_queue.cc:260] T ec94c2acba4a4333a9db46ab77cd9781 P b7aed7f4e45b499992f30b4cf32b8961 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "215a40d9cebb42d9906c6e4616e2950a" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 40171 } } peers { permanent_uuid: "b7aed7f4e45b499992f30b4cf32b8961" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 33867 } } peers { permanent_uuid: "4efd9e6155f94224952be95c3785290e" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 46051 } }
I20260709 13:17:52.652149  6323 raft_consensus.cc:3060] T ec94c2acba4a4333a9db46ab77cd9781 P b7aed7f4e45b499992f30b4cf32b8961 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:52.655683  6398 raft_consensus.cc:2468] T ec94c2acba4a4333a9db46ab77cd9781 P 4efd9e6155f94224952be95c3785290e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 215a40d9cebb42d9906c6e4616e2950a in term 2.
I20260709 13:17:52.657284  6213 leader_election.cc:304] T ec94c2acba4a4333a9db46ab77cd9781 P 215a40d9cebb42d9906c6e4616e2950a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 215a40d9cebb42d9906c6e4616e2950a, 4efd9e6155f94224952be95c3785290e; no voters: 
I20260709 13:17:52.658226  6475 raft_consensus.cc:2804] T ec94c2acba4a4333a9db46ab77cd9781 P 215a40d9cebb42d9906c6e4616e2950a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:17:52.658737  6475 raft_consensus.cc:697] T ec94c2acba4a4333a9db46ab77cd9781 P 215a40d9cebb42d9906c6e4616e2950a [term 2 LEADER]: Becoming Leader. State: Replica: 215a40d9cebb42d9906c6e4616e2950a, State: Running, Role: LEADER
I20260709 13:17:52.659359  6323 raft_consensus.cc:2468] T ec94c2acba4a4333a9db46ab77cd9781 P b7aed7f4e45b499992f30b4cf32b8961 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 215a40d9cebb42d9906c6e4616e2950a in term 2.
I20260709 13:17:52.659657  6475 consensus_queue.cc:237] T ec94c2acba4a4333a9db46ab77cd9781 P 215a40d9cebb42d9906c6e4616e2950a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "215a40d9cebb42d9906c6e4616e2950a" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 40171 } } peers { permanent_uuid: "b7aed7f4e45b499992f30b4cf32b8961" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 33867 } } peers { permanent_uuid: "4efd9e6155f94224952be95c3785290e" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 46051 } }
I20260709 13:17:52.667212  6147 catalog_manager.cc:5697] T ec94c2acba4a4333a9db46ab77cd9781 P 215a40d9cebb42d9906c6e4616e2950a reported cstate change: term changed from 1 to 2, leader changed from b7aed7f4e45b499992f30b4cf32b8961 (127.5.126.66) to 215a40d9cebb42d9906c6e4616e2950a (127.5.126.65). New cstate: current_term: 2 leader_uuid: "215a40d9cebb42d9906c6e4616e2950a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "215a40d9cebb42d9906c6e4616e2950a" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 40171 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b7aed7f4e45b499992f30b4cf32b8961" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 33867 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4efd9e6155f94224952be95c3785290e" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 46051 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:52.708649  6469 raft_consensus.cc:993] T 199b09cd4e0d433fafb2e8d5006d113d P 4efd9e6155f94224952be95c3785290e: : Instructing follower 215a40d9cebb42d9906c6e4616e2950a to start an election
I20260709 13:17:52.709198  6473 raft_consensus.cc:1081] T 199b09cd4e0d433fafb2e8d5006d113d P 4efd9e6155f94224952be95c3785290e [term 1 LEADER]: Signalling peer 215a40d9cebb42d9906c6e4616e2950a to start an election
I20260709 13:17:52.710863  6248 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "199b09cd4e0d433fafb2e8d5006d113d"
dest_uuid: "215a40d9cebb42d9906c6e4616e2950a"
 from {username='slave'} at 127.0.0.1:56964
I20260709 13:17:52.711359  6248 raft_consensus.cc:493] T 199b09cd4e0d433fafb2e8d5006d113d P 215a40d9cebb42d9906c6e4616e2950a [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:52.711715  6248 raft_consensus.cc:3060] T 199b09cd4e0d433fafb2e8d5006d113d P 215a40d9cebb42d9906c6e4616e2950a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:52.717180  6248 raft_consensus.cc:515] T 199b09cd4e0d433fafb2e8d5006d113d P 215a40d9cebb42d9906c6e4616e2950a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "215a40d9cebb42d9906c6e4616e2950a" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 40171 } } peers { permanent_uuid: "b7aed7f4e45b499992f30b4cf32b8961" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 33867 } } peers { permanent_uuid: "4efd9e6155f94224952be95c3785290e" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 46051 } }
I20260709 13:17:52.718825  6468 raft_consensus.cc:993] T ee893b0b66474d44baaeba294d249e32 P b7aed7f4e45b499992f30b4cf32b8961: : Instructing follower 215a40d9cebb42d9906c6e4616e2950a to start an election
I20260709 13:17:52.719257  6468 raft_consensus.cc:1081] T ee893b0b66474d44baaeba294d249e32 P b7aed7f4e45b499992f30b4cf32b8961 [term 1 LEADER]: Signalling peer 215a40d9cebb42d9906c6e4616e2950a to start an election
I20260709 13:17:52.719725  6323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "199b09cd4e0d433fafb2e8d5006d113d" candidate_uuid: "215a40d9cebb42d9906c6e4616e2950a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b7aed7f4e45b499992f30b4cf32b8961"
I20260709 13:17:52.720614  6398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "199b09cd4e0d433fafb2e8d5006d113d" candidate_uuid: "215a40d9cebb42d9906c6e4616e2950a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4efd9e6155f94224952be95c3785290e"
I20260709 13:17:52.720973  6323 raft_consensus.cc:3060] T 199b09cd4e0d433fafb2e8d5006d113d P b7aed7f4e45b499992f30b4cf32b8961 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:52.721231  6398 raft_consensus.cc:3055] T 199b09cd4e0d433fafb2e8d5006d113d P 4efd9e6155f94224952be95c3785290e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:17:52.721252  6250 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ee893b0b66474d44baaeba294d249e32"
dest_uuid: "215a40d9cebb42d9906c6e4616e2950a"
 from {username='slave'} at 127.0.0.1:56960
I20260709 13:17:52.721711  6398 raft_consensus.cc:740] T 199b09cd4e0d433fafb2e8d5006d113d P 4efd9e6155f94224952be95c3785290e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4efd9e6155f94224952be95c3785290e, State: Running, Role: LEADER
I20260709 13:17:52.721906  6250 raft_consensus.cc:493] T ee893b0b66474d44baaeba294d249e32 P 215a40d9cebb42d9906c6e4616e2950a [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:52.722296  6250 raft_consensus.cc:3060] T ee893b0b66474d44baaeba294d249e32 P 215a40d9cebb42d9906c6e4616e2950a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:52.719935  6248 leader_election.cc:290] T 199b09cd4e0d433fafb2e8d5006d113d P 215a40d9cebb42d9906c6e4616e2950a [CANDIDATE]: Term 2 election: Requested vote from peers b7aed7f4e45b499992f30b4cf32b8961 (127.5.126.66:33867), 4efd9e6155f94224952be95c3785290e (127.5.126.67:46051)
I20260709 13:17:52.722673  6398 consensus_queue.cc:260] T 199b09cd4e0d433fafb2e8d5006d113d P 4efd9e6155f94224952be95c3785290e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "215a40d9cebb42d9906c6e4616e2950a" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 40171 } } peers { permanent_uuid: "b7aed7f4e45b499992f30b4cf32b8961" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 33867 } } peers { permanent_uuid: "4efd9e6155f94224952be95c3785290e" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 46051 } }
I20260709 13:17:52.723928  6398 raft_consensus.cc:3060] T 199b09cd4e0d433fafb2e8d5006d113d P 4efd9e6155f94224952be95c3785290e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:52.728955  6398 raft_consensus.cc:2468] T 199b09cd4e0d433fafb2e8d5006d113d P 4efd9e6155f94224952be95c3785290e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 215a40d9cebb42d9906c6e4616e2950a in term 2.
I20260709 13:17:52.729281  6323 raft_consensus.cc:2468] T 199b09cd4e0d433fafb2e8d5006d113d P b7aed7f4e45b499992f30b4cf32b8961 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 215a40d9cebb42d9906c6e4616e2950a in term 2.
I20260709 13:17:52.729954  6213 leader_election.cc:304] T 199b09cd4e0d433fafb2e8d5006d113d P 215a40d9cebb42d9906c6e4616e2950a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 215a40d9cebb42d9906c6e4616e2950a, 4efd9e6155f94224952be95c3785290e; no voters: 
I20260709 13:17:52.730818  6475 raft_consensus.cc:2804] T 199b09cd4e0d433fafb2e8d5006d113d P 215a40d9cebb42d9906c6e4616e2950a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:17:52.730496  6250 raft_consensus.cc:515] T ee893b0b66474d44baaeba294d249e32 P 215a40d9cebb42d9906c6e4616e2950a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "215a40d9cebb42d9906c6e4616e2950a" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 40171 } } peers { permanent_uuid: "b7aed7f4e45b499992f30b4cf32b8961" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 33867 } } peers { permanent_uuid: "4efd9e6155f94224952be95c3785290e" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 46051 } }
I20260709 13:17:52.731418  6475 raft_consensus.cc:697] T 199b09cd4e0d433fafb2e8d5006d113d P 215a40d9cebb42d9906c6e4616e2950a [term 2 LEADER]: Becoming Leader. State: Replica: 215a40d9cebb42d9906c6e4616e2950a, State: Running, Role: LEADER
I20260709 13:17:52.732353  6475 consensus_queue.cc:237] T 199b09cd4e0d433fafb2e8d5006d113d P 215a40d9cebb42d9906c6e4616e2950a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "215a40d9cebb42d9906c6e4616e2950a" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 40171 } } peers { permanent_uuid: "b7aed7f4e45b499992f30b4cf32b8961" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 33867 } } peers { permanent_uuid: "4efd9e6155f94224952be95c3785290e" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 46051 } }
I20260709 13:17:52.732906  6250 leader_election.cc:290] T ee893b0b66474d44baaeba294d249e32 P 215a40d9cebb42d9906c6e4616e2950a [CANDIDATE]: Term 2 election: Requested vote from peers b7aed7f4e45b499992f30b4cf32b8961 (127.5.126.66:33867), 4efd9e6155f94224952be95c3785290e (127.5.126.67:46051)
I20260709 13:17:52.734018  6323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee893b0b66474d44baaeba294d249e32" candidate_uuid: "215a40d9cebb42d9906c6e4616e2950a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b7aed7f4e45b499992f30b4cf32b8961"
I20260709 13:17:52.734308  6398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee893b0b66474d44baaeba294d249e32" candidate_uuid: "215a40d9cebb42d9906c6e4616e2950a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4efd9e6155f94224952be95c3785290e"
I20260709 13:17:52.734755  6323 raft_consensus.cc:3055] T ee893b0b66474d44baaeba294d249e32 P b7aed7f4e45b499992f30b4cf32b8961 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:17:52.734870  6398 raft_consensus.cc:3060] T ee893b0b66474d44baaeba294d249e32 P 4efd9e6155f94224952be95c3785290e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:52.735168  6323 raft_consensus.cc:740] T ee893b0b66474d44baaeba294d249e32 P b7aed7f4e45b499992f30b4cf32b8961 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b7aed7f4e45b499992f30b4cf32b8961, State: Running, Role: LEADER
I20260709 13:17:52.736467  6323 consensus_queue.cc:260] T ee893b0b66474d44baaeba294d249e32 P b7aed7f4e45b499992f30b4cf32b8961 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "215a40d9cebb42d9906c6e4616e2950a" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 40171 } } peers { permanent_uuid: "b7aed7f4e45b499992f30b4cf32b8961" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 33867 } } peers { permanent_uuid: "4efd9e6155f94224952be95c3785290e" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 46051 } }
I20260709 13:17:52.737947  6323 raft_consensus.cc:3060] T ee893b0b66474d44baaeba294d249e32 P b7aed7f4e45b499992f30b4cf32b8961 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:52.740393  6147 catalog_manager.cc:5697] T 199b09cd4e0d433fafb2e8d5006d113d P 215a40d9cebb42d9906c6e4616e2950a reported cstate change: term changed from 1 to 2, leader changed from 4efd9e6155f94224952be95c3785290e (127.5.126.67) to 215a40d9cebb42d9906c6e4616e2950a (127.5.126.65). New cstate: current_term: 2 leader_uuid: "215a40d9cebb42d9906c6e4616e2950a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "215a40d9cebb42d9906c6e4616e2950a" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 40171 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b7aed7f4e45b499992f30b4cf32b8961" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 33867 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4efd9e6155f94224952be95c3785290e" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 46051 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:52.743304  6398 raft_consensus.cc:2468] T ee893b0b66474d44baaeba294d249e32 P 4efd9e6155f94224952be95c3785290e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 215a40d9cebb42d9906c6e4616e2950a in term 2.
I20260709 13:17:52.744707  6213 leader_election.cc:304] T ee893b0b66474d44baaeba294d249e32 P 215a40d9cebb42d9906c6e4616e2950a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 215a40d9cebb42d9906c6e4616e2950a, 4efd9e6155f94224952be95c3785290e; no voters: 
I20260709 13:17:52.745518  6323 raft_consensus.cc:2468] T ee893b0b66474d44baaeba294d249e32 P b7aed7f4e45b499992f30b4cf32b8961 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 215a40d9cebb42d9906c6e4616e2950a in term 2.
I20260709 13:17:52.745680  6475 raft_consensus.cc:2804] T ee893b0b66474d44baaeba294d249e32 P 215a40d9cebb42d9906c6e4616e2950a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:17:52.746399  6475 raft_consensus.cc:697] T ee893b0b66474d44baaeba294d249e32 P 215a40d9cebb42d9906c6e4616e2950a [term 2 LEADER]: Becoming Leader. State: Replica: 215a40d9cebb42d9906c6e4616e2950a, State: Running, Role: LEADER
I20260709 13:17:52.747321  6475 consensus_queue.cc:237] T ee893b0b66474d44baaeba294d249e32 P 215a40d9cebb42d9906c6e4616e2950a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "215a40d9cebb42d9906c6e4616e2950a" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 40171 } } peers { permanent_uuid: "b7aed7f4e45b499992f30b4cf32b8961" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 33867 } } peers { permanent_uuid: "4efd9e6155f94224952be95c3785290e" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 46051 } }
I20260709 13:17:52.753973  6147 catalog_manager.cc:5697] T ee893b0b66474d44baaeba294d249e32 P 215a40d9cebb42d9906c6e4616e2950a reported cstate change: term changed from 1 to 2, leader changed from b7aed7f4e45b499992f30b4cf32b8961 (127.5.126.66) to 215a40d9cebb42d9906c6e4616e2950a (127.5.126.65). New cstate: current_term: 2 leader_uuid: "215a40d9cebb42d9906c6e4616e2950a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "215a40d9cebb42d9906c6e4616e2950a" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 40171 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b7aed7f4e45b499992f30b4cf32b8961" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 33867 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4efd9e6155f94224952be95c3785290e" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 46051 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:52.879305  6492 raft_consensus.cc:993] T d51e67b3ea6a458c818b4c7cf67ceef5 P 215a40d9cebb42d9906c6e4616e2950a: : Instructing follower b7aed7f4e45b499992f30b4cf32b8961 to start an election
I20260709 13:17:52.879766  6475 raft_consensus.cc:1081] T d51e67b3ea6a458c818b4c7cf67ceef5 P 215a40d9cebb42d9906c6e4616e2950a [term 1 LEADER]: Signalling peer b7aed7f4e45b499992f30b4cf32b8961 to start an election
I20260709 13:17:52.881265  6323 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d51e67b3ea6a458c818b4c7cf67ceef5"
dest_uuid: "b7aed7f4e45b499992f30b4cf32b8961"
 from {username='slave'} at 127.0.0.1:58360
I20260709 13:17:52.881835  6323 raft_consensus.cc:493] T d51e67b3ea6a458c818b4c7cf67ceef5 P b7aed7f4e45b499992f30b4cf32b8961 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:52.882158  6323 raft_consensus.cc:3060] T d51e67b3ea6a458c818b4c7cf67ceef5 P b7aed7f4e45b499992f30b4cf32b8961 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:52.887873  6323 raft_consensus.cc:515] T d51e67b3ea6a458c818b4c7cf67ceef5 P b7aed7f4e45b499992f30b4cf32b8961 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "215a40d9cebb42d9906c6e4616e2950a" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 40171 } } peers { permanent_uuid: "b7aed7f4e45b499992f30b4cf32b8961" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 33867 } } peers { permanent_uuid: "4efd9e6155f94224952be95c3785290e" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 46051 } }
I20260709 13:17:52.888589  6398 raft_consensus.cc:1275] T 879fa203410744a9a1a63d33e0801f07 P 4efd9e6155f94224952be95c3785290e [term 2 FOLLOWER]: Refusing update from remote peer 215a40d9cebb42d9906c6e4616e2950a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:52.890153  6323 leader_election.cc:290] T d51e67b3ea6a458c818b4c7cf67ceef5 P b7aed7f4e45b499992f30b4cf32b8961 [CANDIDATE]: Term 2 election: Requested vote from peers 215a40d9cebb42d9906c6e4616e2950a (127.5.126.65:40171), 4efd9e6155f94224952be95c3785290e (127.5.126.67:46051)
I20260709 13:17:52.890224  6475 consensus_queue.cc:1048] T 879fa203410744a9a1a63d33e0801f07 P 215a40d9cebb42d9906c6e4616e2950a [LEADER]: Connected to new peer: Peer: permanent_uuid: "4efd9e6155f94224952be95c3785290e" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 46051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:17:52.891073  6250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d51e67b3ea6a458c818b4c7cf67ceef5" candidate_uuid: "b7aed7f4e45b499992f30b4cf32b8961" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "215a40d9cebb42d9906c6e4616e2950a"
I20260709 13:17:52.891366  6398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d51e67b3ea6a458c818b4c7cf67ceef5" candidate_uuid: "b7aed7f4e45b499992f30b4cf32b8961" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4efd9e6155f94224952be95c3785290e"
I20260709 13:17:52.891654  6250 raft_consensus.cc:3055] T d51e67b3ea6a458c818b4c7cf67ceef5 P 215a40d9cebb42d9906c6e4616e2950a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:17:52.891932  6398 raft_consensus.cc:3060] T d51e67b3ea6a458c818b4c7cf67ceef5 P 4efd9e6155f94224952be95c3785290e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:52.892026  6250 raft_consensus.cc:740] T d51e67b3ea6a458c818b4c7cf67ceef5 P 215a40d9cebb42d9906c6e4616e2950a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 215a40d9cebb42d9906c6e4616e2950a, State: Running, Role: LEADER
I20260709 13:17:52.893003  6250 consensus_queue.cc:260] T d51e67b3ea6a458c818b4c7cf67ceef5 P 215a40d9cebb42d9906c6e4616e2950a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "215a40d9cebb42d9906c6e4616e2950a" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 40171 } } peers { permanent_uuid: "b7aed7f4e45b499992f30b4cf32b8961" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 33867 } } peers { permanent_uuid: "4efd9e6155f94224952be95c3785290e" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 46051 } }
I20260709 13:17:52.894282  6250 raft_consensus.cc:3060] T d51e67b3ea6a458c818b4c7cf67ceef5 P 215a40d9cebb42d9906c6e4616e2950a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:52.900555  6398 raft_consensus.cc:2468] T d51e67b3ea6a458c818b4c7cf67ceef5 P 4efd9e6155f94224952be95c3785290e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7aed7f4e45b499992f30b4cf32b8961 in term 2.
I20260709 13:17:52.902009  6288 leader_election.cc:304] T d51e67b3ea6a458c818b4c7cf67ceef5 P b7aed7f4e45b499992f30b4cf32b8961 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4efd9e6155f94224952be95c3785290e, b7aed7f4e45b499992f30b4cf32b8961; no voters: 
I20260709 13:17:52.902168  6250 raft_consensus.cc:2468] T d51e67b3ea6a458c818b4c7cf67ceef5 P 215a40d9cebb42d9906c6e4616e2950a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7aed7f4e45b499992f30b4cf32b8961 in term 2.
I20260709 13:17:52.902976  6446 raft_consensus.cc:2804] T d51e67b3ea6a458c818b4c7cf67ceef5 P b7aed7f4e45b499992f30b4cf32b8961 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:17:52.903481  6446 raft_consensus.cc:697] T d51e67b3ea6a458c818b4c7cf67ceef5 P b7aed7f4e45b499992f30b4cf32b8961 [term 2 LEADER]: Becoming Leader. State: Replica: b7aed7f4e45b499992f30b4cf32b8961, State: Running, Role: LEADER
I20260709 13:17:52.904402  6446 consensus_queue.cc:237] T d51e67b3ea6a458c818b4c7cf67ceef5 P b7aed7f4e45b499992f30b4cf32b8961 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "215a40d9cebb42d9906c6e4616e2950a" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 40171 } } peers { permanent_uuid: "b7aed7f4e45b499992f30b4cf32b8961" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 33867 } } peers { permanent_uuid: "4efd9e6155f94224952be95c3785290e" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 46051 } }
I20260709 13:17:52.906379  6323 raft_consensus.cc:1275] T 879fa203410744a9a1a63d33e0801f07 P b7aed7f4e45b499992f30b4cf32b8961 [term 2 FOLLOWER]: Refusing update from remote peer 215a40d9cebb42d9906c6e4616e2950a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:52.909646  6492 consensus_queue.cc:1048] T 879fa203410744a9a1a63d33e0801f07 P 215a40d9cebb42d9906c6e4616e2950a [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7aed7f4e45b499992f30b4cf32b8961" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 33867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:52.914179  6146 catalog_manager.cc:5697] T d51e67b3ea6a458c818b4c7cf67ceef5 P b7aed7f4e45b499992f30b4cf32b8961 reported cstate change: term changed from 1 to 2, leader changed from 215a40d9cebb42d9906c6e4616e2950a (127.5.126.65) to b7aed7f4e45b499992f30b4cf32b8961 (127.5.126.66). New cstate: current_term: 2 leader_uuid: "b7aed7f4e45b499992f30b4cf32b8961" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "215a40d9cebb42d9906c6e4616e2950a" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 40171 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b7aed7f4e45b499992f30b4cf32b8961" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 33867 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4efd9e6155f94224952be95c3785290e" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 46051 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:53.054148  6323 raft_consensus.cc:1275] T 82ccb3ed51b2453381692135f3179a54 P b7aed7f4e45b499992f30b4cf32b8961 [term 2 FOLLOWER]: Refusing update from remote peer 215a40d9cebb42d9906c6e4616e2950a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:53.055883  6492 consensus_queue.cc:1048] T 82ccb3ed51b2453381692135f3179a54 P 215a40d9cebb42d9906c6e4616e2950a [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7aed7f4e45b499992f30b4cf32b8961" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 33867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:53.061488  6398 raft_consensus.cc:1275] T e17475c1ea464d1f84e7f36957761cd9 P 4efd9e6155f94224952be95c3785290e [term 2 FOLLOWER]: Refusing update from remote peer b7aed7f4e45b499992f30b4cf32b8961: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:53.062970  6446 consensus_queue.cc:1048] T e17475c1ea464d1f84e7f36957761cd9 P b7aed7f4e45b499992f30b4cf32b8961 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4efd9e6155f94224952be95c3785290e" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 46051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:53.066778  6397 raft_consensus.cc:1275] T 82ccb3ed51b2453381692135f3179a54 P 4efd9e6155f94224952be95c3785290e [term 2 FOLLOWER]: Refusing update from remote peer 215a40d9cebb42d9906c6e4616e2950a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:53.069015  6445 consensus_queue.cc:1048] T 82ccb3ed51b2453381692135f3179a54 P 215a40d9cebb42d9906c6e4616e2950a [LEADER]: Connected to new peer: Peer: permanent_uuid: "4efd9e6155f94224952be95c3785290e" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 46051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:17:53.075479  6250 raft_consensus.cc:1275] T e17475c1ea464d1f84e7f36957761cd9 P 215a40d9cebb42d9906c6e4616e2950a [term 2 FOLLOWER]: Refusing update from remote peer b7aed7f4e45b499992f30b4cf32b8961: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:53.077211  6446 consensus_queue.cc:1048] T e17475c1ea464d1f84e7f36957761cd9 P b7aed7f4e45b499992f30b4cf32b8961 [LEADER]: Connected to new peer: Peer: permanent_uuid: "215a40d9cebb42d9906c6e4616e2950a" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 40171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:53.126775  6398 raft_consensus.cc:1275] T 199b09cd4e0d433fafb2e8d5006d113d P 4efd9e6155f94224952be95c3785290e [term 2 FOLLOWER]: Refusing update from remote peer 215a40d9cebb42d9906c6e4616e2950a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:53.128597  6492 consensus_queue.cc:1048] T 199b09cd4e0d433fafb2e8d5006d113d P 215a40d9cebb42d9906c6e4616e2950a [LEADER]: Connected to new peer: Peer: permanent_uuid: "4efd9e6155f94224952be95c3785290e" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 46051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:53.137851  6323 raft_consensus.cc:1275] T 199b09cd4e0d433fafb2e8d5006d113d P b7aed7f4e45b499992f30b4cf32b8961 [term 2 FOLLOWER]: Refusing update from remote peer 215a40d9cebb42d9906c6e4616e2950a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:53.139709  6492 consensus_queue.cc:1048] T 199b09cd4e0d433fafb2e8d5006d113d P 215a40d9cebb42d9906c6e4616e2950a [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7aed7f4e45b499992f30b4cf32b8961" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 33867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:17:53.183732  6323 raft_consensus.cc:1275] T ee893b0b66474d44baaeba294d249e32 P b7aed7f4e45b499992f30b4cf32b8961 [term 2 FOLLOWER]: Refusing update from remote peer 215a40d9cebb42d9906c6e4616e2950a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:53.185331  6492 consensus_queue.cc:1048] T ee893b0b66474d44baaeba294d249e32 P 215a40d9cebb42d9906c6e4616e2950a [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7aed7f4e45b499992f30b4cf32b8961" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 33867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:53.194423  6398 raft_consensus.cc:1275] T ee893b0b66474d44baaeba294d249e32 P 4efd9e6155f94224952be95c3785290e [term 2 FOLLOWER]: Refusing update from remote peer 215a40d9cebb42d9906c6e4616e2950a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:53.196194  6445 consensus_queue.cc:1048] T ee893b0b66474d44baaeba294d249e32 P 215a40d9cebb42d9906c6e4616e2950a [LEADER]: Connected to new peer: Peer: permanent_uuid: "4efd9e6155f94224952be95c3785290e" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 46051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:17:53.240195  6398 raft_consensus.cc:1275] T ec94c2acba4a4333a9db46ab77cd9781 P 4efd9e6155f94224952be95c3785290e [term 2 FOLLOWER]: Refusing update from remote peer 215a40d9cebb42d9906c6e4616e2950a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:53.242594  6445 consensus_queue.cc:1048] T ec94c2acba4a4333a9db46ab77cd9781 P 215a40d9cebb42d9906c6e4616e2950a [LEADER]: Connected to new peer: Peer: permanent_uuid: "4efd9e6155f94224952be95c3785290e" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 46051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:53.252594  6323 raft_consensus.cc:1275] T ec94c2acba4a4333a9db46ab77cd9781 P b7aed7f4e45b499992f30b4cf32b8961 [term 2 FOLLOWER]: Refusing update from remote peer 215a40d9cebb42d9906c6e4616e2950a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:53.254698  6445 consensus_queue.cc:1048] T ec94c2acba4a4333a9db46ab77cd9781 P 215a40d9cebb42d9906c6e4616e2950a [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7aed7f4e45b499992f30b4cf32b8961" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 33867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:53.345525  6250 raft_consensus.cc:1275] T d51e67b3ea6a458c818b4c7cf67ceef5 P 215a40d9cebb42d9906c6e4616e2950a [term 2 FOLLOWER]: Refusing update from remote peer b7aed7f4e45b499992f30b4cf32b8961: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:53.347121  6446 consensus_queue.cc:1048] T d51e67b3ea6a458c818b4c7cf67ceef5 P b7aed7f4e45b499992f30b4cf32b8961 [LEADER]: Connected to new peer: Peer: permanent_uuid: "215a40d9cebb42d9906c6e4616e2950a" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 40171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:53.356669  6398 raft_consensus.cc:1275] T d51e67b3ea6a458c818b4c7cf67ceef5 P 4efd9e6155f94224952be95c3785290e [term 2 FOLLOWER]: Refusing update from remote peer b7aed7f4e45b499992f30b4cf32b8961: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:53.358377  6446 consensus_queue.cc:1048] T d51e67b3ea6a458c818b4c7cf67ceef5 P b7aed7f4e45b499992f30b4cf32b8961 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4efd9e6155f94224952be95c3785290e" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 46051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:55.548918  5625 auto_leader_rebalancer-test.cc:348] The leader distribution is 
I20260709 13:17:55.549863  5625 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:17:55.569355  6250 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "82ccb3ed51b2453381692135f3179a54"
dest_uuid: "215a40d9cebb42d9906c6e4616e2950a"
mode: GRACEFUL
new_leader_uuid: "4efd9e6155f94224952be95c3785290e"
 from {username='slave'} at 127.0.0.1:56984
I20260709 13:17:55.569977  6250 raft_consensus.cc:606] T 82ccb3ed51b2453381692135f3179a54 P 215a40d9cebb42d9906c6e4616e2950a [term 2 LEADER]: Received request to transfer leadership to TS 4efd9e6155f94224952be95c3785290e
I20260709 13:17:55.572772  6250 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "879fa203410744a9a1a63d33e0801f07"
dest_uuid: "215a40d9cebb42d9906c6e4616e2950a"
mode: GRACEFUL
new_leader_uuid: "4efd9e6155f94224952be95c3785290e"
 from {username='slave'} at 127.0.0.1:56984
I20260709 13:17:55.573333  6250 raft_consensus.cc:606] T 879fa203410744a9a1a63d33e0801f07 P 215a40d9cebb42d9906c6e4616e2950a [term 2 LEADER]: Received request to transfer leadership to TS 4efd9e6155f94224952be95c3785290e
I20260709 13:17:55.574406  5625 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:17:55.574977  5625 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:17:55.906847  6535 raft_consensus.cc:993] T 82ccb3ed51b2453381692135f3179a54 P 215a40d9cebb42d9906c6e4616e2950a: : Instructing follower 4efd9e6155f94224952be95c3785290e to start an election
I20260709 13:17:55.907548  6539 raft_consensus.cc:1081] T 82ccb3ed51b2453381692135f3179a54 P 215a40d9cebb42d9906c6e4616e2950a [term 2 LEADER]: Signalling peer 4efd9e6155f94224952be95c3785290e to start an election
I20260709 13:17:55.909715  6397 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "82ccb3ed51b2453381692135f3179a54"
dest_uuid: "4efd9e6155f94224952be95c3785290e"
 from {username='slave'} at 127.0.0.1:33268
I20260709 13:17:55.910329  6397 raft_consensus.cc:493] T 82ccb3ed51b2453381692135f3179a54 P 4efd9e6155f94224952be95c3785290e [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:55.910699  6397 raft_consensus.cc:3060] T 82ccb3ed51b2453381692135f3179a54 P 4efd9e6155f94224952be95c3785290e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:55.916128  6397 raft_consensus.cc:515] T 82ccb3ed51b2453381692135f3179a54 P 4efd9e6155f94224952be95c3785290e [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "215a40d9cebb42d9906c6e4616e2950a" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 40171 } } peers { permanent_uuid: "b7aed7f4e45b499992f30b4cf32b8961" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 33867 } } peers { permanent_uuid: "4efd9e6155f94224952be95c3785290e" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 46051 } }
I20260709 13:17:55.918287  6397 leader_election.cc:290] T 82ccb3ed51b2453381692135f3179a54 P 4efd9e6155f94224952be95c3785290e [CANDIDATE]: Term 3 election: Requested vote from peers 215a40d9cebb42d9906c6e4616e2950a (127.5.126.65:40171), b7aed7f4e45b499992f30b4cf32b8961 (127.5.126.66:33867)
I20260709 13:17:55.919265  6250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82ccb3ed51b2453381692135f3179a54" candidate_uuid: "4efd9e6155f94224952be95c3785290e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "215a40d9cebb42d9906c6e4616e2950a"
I20260709 13:17:55.919703  6325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82ccb3ed51b2453381692135f3179a54" candidate_uuid: "4efd9e6155f94224952be95c3785290e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "b7aed7f4e45b499992f30b4cf32b8961"
I20260709 13:17:55.919852  6250 raft_consensus.cc:3055] T 82ccb3ed51b2453381692135f3179a54 P 215a40d9cebb42d9906c6e4616e2950a [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:17:55.920430  6250 raft_consensus.cc:740] T 82ccb3ed51b2453381692135f3179a54 P 215a40d9cebb42d9906c6e4616e2950a [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 215a40d9cebb42d9906c6e4616e2950a, State: Running, Role: LEADER
I20260709 13:17:55.920485  6325 raft_consensus.cc:3060] T 82ccb3ed51b2453381692135f3179a54 P b7aed7f4e45b499992f30b4cf32b8961 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:55.921164  6250 consensus_queue.cc:260] T 82ccb3ed51b2453381692135f3179a54 P 215a40d9cebb42d9906c6e4616e2950a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "215a40d9cebb42d9906c6e4616e2950a" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 40171 } } peers { permanent_uuid: "b7aed7f4e45b499992f30b4cf32b8961" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 33867 } } peers { permanent_uuid: "4efd9e6155f94224952be95c3785290e" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 46051 } }
I20260709 13:17:55.922044  6250 raft_consensus.cc:3060] T 82ccb3ed51b2453381692135f3179a54 P 215a40d9cebb42d9906c6e4616e2950a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:55.926592  6250 raft_consensus.cc:2468] T 82ccb3ed51b2453381692135f3179a54 P 215a40d9cebb42d9906c6e4616e2950a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4efd9e6155f94224952be95c3785290e in term 3.
I20260709 13:17:55.926643  6325 raft_consensus.cc:2468] T 82ccb3ed51b2453381692135f3179a54 P b7aed7f4e45b499992f30b4cf32b8961 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4efd9e6155f94224952be95c3785290e in term 3.
I20260709 13:17:55.927902  6365 leader_election.cc:304] T 82ccb3ed51b2453381692135f3179a54 P 4efd9e6155f94224952be95c3785290e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 215a40d9cebb42d9906c6e4616e2950a, 4efd9e6155f94224952be95c3785290e; no voters: 
I20260709 13:17:55.928726  6473 raft_consensus.cc:2804] T 82ccb3ed51b2453381692135f3179a54 P 4efd9e6155f94224952be95c3785290e [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:17:55.929839  6473 raft_consensus.cc:697] T 82ccb3ed51b2453381692135f3179a54 P 4efd9e6155f94224952be95c3785290e [term 3 LEADER]: Becoming Leader. State: Replica: 4efd9e6155f94224952be95c3785290e, State: Running, Role: LEADER
I20260709 13:17:55.930527  6473 consensus_queue.cc:237] T 82ccb3ed51b2453381692135f3179a54 P 4efd9e6155f94224952be95c3785290e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "215a40d9cebb42d9906c6e4616e2950a" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 40171 } } peers { permanent_uuid: "b7aed7f4e45b499992f30b4cf32b8961" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 33867 } } peers { permanent_uuid: "4efd9e6155f94224952be95c3785290e" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 46051 } }
I20260709 13:17:55.940665  6147 catalog_manager.cc:5697] T 82ccb3ed51b2453381692135f3179a54 P 4efd9e6155f94224952be95c3785290e reported cstate change: term changed from 2 to 3, leader changed from 215a40d9cebb42d9906c6e4616e2950a (127.5.126.65) to 4efd9e6155f94224952be95c3785290e (127.5.126.67). New cstate: current_term: 3 leader_uuid: "4efd9e6155f94224952be95c3785290e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "215a40d9cebb42d9906c6e4616e2950a" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 40171 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b7aed7f4e45b499992f30b4cf32b8961" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 33867 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4efd9e6155f94224952be95c3785290e" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 46051 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:56.038604  6535 raft_consensus.cc:993] T 879fa203410744a9a1a63d33e0801f07 P 215a40d9cebb42d9906c6e4616e2950a: : Instructing follower 4efd9e6155f94224952be95c3785290e to start an election
I20260709 13:17:56.039091  6539 raft_consensus.cc:1081] T 879fa203410744a9a1a63d33e0801f07 P 215a40d9cebb42d9906c6e4616e2950a [term 2 LEADER]: Signalling peer 4efd9e6155f94224952be95c3785290e to start an election
I20260709 13:17:56.040817  6397 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "879fa203410744a9a1a63d33e0801f07"
dest_uuid: "4efd9e6155f94224952be95c3785290e"
 from {username='slave'} at 127.0.0.1:33268
I20260709 13:17:56.041358  6397 raft_consensus.cc:493] T 879fa203410744a9a1a63d33e0801f07 P 4efd9e6155f94224952be95c3785290e [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:56.041682  6397 raft_consensus.cc:3060] T 879fa203410744a9a1a63d33e0801f07 P 4efd9e6155f94224952be95c3785290e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:56.048166  6397 raft_consensus.cc:515] T 879fa203410744a9a1a63d33e0801f07 P 4efd9e6155f94224952be95c3785290e [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "215a40d9cebb42d9906c6e4616e2950a" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 40171 } } peers { permanent_uuid: "b7aed7f4e45b499992f30b4cf32b8961" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 33867 } } peers { permanent_uuid: "4efd9e6155f94224952be95c3785290e" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 46051 } }
I20260709 13:17:56.050076  6397 leader_election.cc:290] T 879fa203410744a9a1a63d33e0801f07 P 4efd9e6155f94224952be95c3785290e [CANDIDATE]: Term 3 election: Requested vote from peers 215a40d9cebb42d9906c6e4616e2950a (127.5.126.65:40171), b7aed7f4e45b499992f30b4cf32b8961 (127.5.126.66:33867)
I20260709 13:17:56.051070  6250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "879fa203410744a9a1a63d33e0801f07" candidate_uuid: "4efd9e6155f94224952be95c3785290e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "215a40d9cebb42d9906c6e4616e2950a"
I20260709 13:17:56.051210  6325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "879fa203410744a9a1a63d33e0801f07" candidate_uuid: "4efd9e6155f94224952be95c3785290e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "b7aed7f4e45b499992f30b4cf32b8961"
I20260709 13:17:56.051740  6250 raft_consensus.cc:3055] T 879fa203410744a9a1a63d33e0801f07 P 215a40d9cebb42d9906c6e4616e2950a [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:17:56.051793  6325 raft_consensus.cc:3060] T 879fa203410744a9a1a63d33e0801f07 P b7aed7f4e45b499992f30b4cf32b8961 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:56.052441  6250 raft_consensus.cc:740] T 879fa203410744a9a1a63d33e0801f07 P 215a40d9cebb42d9906c6e4616e2950a [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 215a40d9cebb42d9906c6e4616e2950a, State: Running, Role: LEADER
I20260709 13:17:56.053248  6250 consensus_queue.cc:260] T 879fa203410744a9a1a63d33e0801f07 P 215a40d9cebb42d9906c6e4616e2950a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "215a40d9cebb42d9906c6e4616e2950a" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 40171 } } peers { permanent_uuid: "b7aed7f4e45b499992f30b4cf32b8961" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 33867 } } peers { permanent_uuid: "4efd9e6155f94224952be95c3785290e" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 46051 } }
I20260709 13:17:56.054121  6250 raft_consensus.cc:3060] T 879fa203410744a9a1a63d33e0801f07 P 215a40d9cebb42d9906c6e4616e2950a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:56.057770  6325 raft_consensus.cc:2468] T 879fa203410744a9a1a63d33e0801f07 P b7aed7f4e45b499992f30b4cf32b8961 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4efd9e6155f94224952be95c3785290e in term 3.
I20260709 13:17:56.058456  6250 raft_consensus.cc:2468] T 879fa203410744a9a1a63d33e0801f07 P 215a40d9cebb42d9906c6e4616e2950a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4efd9e6155f94224952be95c3785290e in term 3.
I20260709 13:17:56.058919  6362 leader_election.cc:304] T 879fa203410744a9a1a63d33e0801f07 P 4efd9e6155f94224952be95c3785290e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4efd9e6155f94224952be95c3785290e, b7aed7f4e45b499992f30b4cf32b8961; no voters: 
I20260709 13:17:56.059674  6473 raft_consensus.cc:2804] T 879fa203410744a9a1a63d33e0801f07 P 4efd9e6155f94224952be95c3785290e [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:17:56.060143  6473 raft_consensus.cc:697] T 879fa203410744a9a1a63d33e0801f07 P 4efd9e6155f94224952be95c3785290e [term 3 LEADER]: Becoming Leader. State: Replica: 4efd9e6155f94224952be95c3785290e, State: Running, Role: LEADER
I20260709 13:17:56.060786  6473 consensus_queue.cc:237] T 879fa203410744a9a1a63d33e0801f07 P 4efd9e6155f94224952be95c3785290e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "215a40d9cebb42d9906c6e4616e2950a" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 40171 } } peers { permanent_uuid: "b7aed7f4e45b499992f30b4cf32b8961" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 33867 } } peers { permanent_uuid: "4efd9e6155f94224952be95c3785290e" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 46051 } }
I20260709 13:17:56.068295  6147 catalog_manager.cc:5697] T 879fa203410744a9a1a63d33e0801f07 P 4efd9e6155f94224952be95c3785290e reported cstate change: term changed from 2 to 3, leader changed from 215a40d9cebb42d9906c6e4616e2950a (127.5.126.65) to 4efd9e6155f94224952be95c3785290e (127.5.126.67). New cstate: current_term: 3 leader_uuid: "4efd9e6155f94224952be95c3785290e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "215a40d9cebb42d9906c6e4616e2950a" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 40171 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b7aed7f4e45b499992f30b4cf32b8961" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 33867 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4efd9e6155f94224952be95c3785290e" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 46051 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:56.471009  6325 raft_consensus.cc:1275] T 82ccb3ed51b2453381692135f3179a54 P b7aed7f4e45b499992f30b4cf32b8961 [term 3 FOLLOWER]: Refusing update from remote peer 4efd9e6155f94224952be95c3785290e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:17:56.472514  6473 consensus_queue.cc:1048] T 82ccb3ed51b2453381692135f3179a54 P 4efd9e6155f94224952be95c3785290e [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7aed7f4e45b499992f30b4cf32b8961" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 33867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:17:56.485410  6250 raft_consensus.cc:1275] T 82ccb3ed51b2453381692135f3179a54 P 215a40d9cebb42d9906c6e4616e2950a [term 3 FOLLOWER]: Refusing update from remote peer 4efd9e6155f94224952be95c3785290e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:17:56.487682  6473 consensus_queue.cc:1048] T 82ccb3ed51b2453381692135f3179a54 P 4efd9e6155f94224952be95c3785290e [LEADER]: Connected to new peer: Peer: permanent_uuid: "215a40d9cebb42d9906c6e4616e2950a" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 40171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:17:56.554809  6250 raft_consensus.cc:1275] T 879fa203410744a9a1a63d33e0801f07 P 215a40d9cebb42d9906c6e4616e2950a [term 3 FOLLOWER]: Refusing update from remote peer 4efd9e6155f94224952be95c3785290e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:17:56.556593  6549 consensus_queue.cc:1048] T 879fa203410744a9a1a63d33e0801f07 P 4efd9e6155f94224952be95c3785290e [LEADER]: Connected to new peer: Peer: permanent_uuid: "215a40d9cebb42d9906c6e4616e2950a" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 40171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:17:56.566987  6325 raft_consensus.cc:1275] T 879fa203410744a9a1a63d33e0801f07 P b7aed7f4e45b499992f30b4cf32b8961 [term 3 FOLLOWER]: Refusing update from remote peer 4efd9e6155f94224952be95c3785290e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:17:56.568872  6549 consensus_queue.cc:1048] T 879fa203410744a9a1a63d33e0801f07 P 4efd9e6155f94224952be95c3785290e [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7aed7f4e45b499992f30b4cf32b8961" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 33867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:17:56.575838  5625 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:17:56.598032  6397 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "879fa203410744a9a1a63d33e0801f07"
dest_uuid: "4efd9e6155f94224952be95c3785290e"
mode: GRACEFUL
new_leader_uuid: "215a40d9cebb42d9906c6e4616e2950a"
 from {username='slave'} at 127.0.0.1:33270
I20260709 13:17:56.598748  6397 raft_consensus.cc:606] T 879fa203410744a9a1a63d33e0801f07 P 4efd9e6155f94224952be95c3785290e [term 3 LEADER]: Received request to transfer leadership to TS 215a40d9cebb42d9906c6e4616e2950a
I20260709 13:17:56.604382  6398 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "82ccb3ed51b2453381692135f3179a54"
dest_uuid: "4efd9e6155f94224952be95c3785290e"
mode: GRACEFUL
new_leader_uuid: "215a40d9cebb42d9906c6e4616e2950a"
 from {username='slave'} at 127.0.0.1:33270
I20260709 13:17:56.605091  6398 raft_consensus.cc:606] T 82ccb3ed51b2453381692135f3179a54 P 4efd9e6155f94224952be95c3785290e [term 3 LEADER]: Received request to transfer leadership to TS 215a40d9cebb42d9906c6e4616e2950a
I20260709 13:17:56.610838  6325 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "de207f715322422ba6c06aa6b5ade0fa"
dest_uuid: "b7aed7f4e45b499992f30b4cf32b8961"
mode: GRACEFUL
new_leader_uuid: "215a40d9cebb42d9906c6e4616e2950a"
 from {username='slave'} at 127.0.0.1:58368
I20260709 13:17:56.611364  6325 raft_consensus.cc:606] T de207f715322422ba6c06aa6b5ade0fa P b7aed7f4e45b499992f30b4cf32b8961 [term 1 LEADER]: Received request to transfer leadership to TS 215a40d9cebb42d9906c6e4616e2950a
I20260709 13:17:56.616950  6325 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d51e67b3ea6a458c818b4c7cf67ceef5"
dest_uuid: "b7aed7f4e45b499992f30b4cf32b8961"
mode: GRACEFUL
new_leader_uuid: "215a40d9cebb42d9906c6e4616e2950a"
 from {username='slave'} at 127.0.0.1:58368
I20260709 13:17:56.617671  6325 raft_consensus.cc:606] T d51e67b3ea6a458c818b4c7cf67ceef5 P b7aed7f4e45b499992f30b4cf32b8961 [term 2 LEADER]: Received request to transfer leadership to TS 215a40d9cebb42d9906c6e4616e2950a
I20260709 13:17:56.623230  6325 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c7cfe05c9c2f47f487fbf3b81a0a47ca"
dest_uuid: "b7aed7f4e45b499992f30b4cf32b8961"
mode: GRACEFUL
new_leader_uuid: "215a40d9cebb42d9906c6e4616e2950a"
 from {username='slave'} at 127.0.0.1:58368
I20260709 13:17:56.623863  6325 raft_consensus.cc:606] T c7cfe05c9c2f47f487fbf3b81a0a47ca P b7aed7f4e45b499992f30b4cf32b8961 [term 1 LEADER]: Received request to transfer leadership to TS 215a40d9cebb42d9906c6e4616e2950a
I20260709 13:17:56.704145  6536 raft_consensus.cc:993] T de207f715322422ba6c06aa6b5ade0fa P b7aed7f4e45b499992f30b4cf32b8961: : Instructing follower 215a40d9cebb42d9906c6e4616e2950a to start an election
I20260709 13:17:56.704656  6555 raft_consensus.cc:1081] T de207f715322422ba6c06aa6b5ade0fa P b7aed7f4e45b499992f30b4cf32b8961 [term 1 LEADER]: Signalling peer 215a40d9cebb42d9906c6e4616e2950a to start an election
I20260709 13:17:56.706348  6250 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "de207f715322422ba6c06aa6b5ade0fa"
dest_uuid: "215a40d9cebb42d9906c6e4616e2950a"
 from {username='slave'} at 127.0.0.1:56960
I20260709 13:17:56.706964  6250 raft_consensus.cc:493] T de207f715322422ba6c06aa6b5ade0fa P 215a40d9cebb42d9906c6e4616e2950a [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:56.707299  6250 raft_consensus.cc:3060] T de207f715322422ba6c06aa6b5ade0fa P 215a40d9cebb42d9906c6e4616e2950a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:56.711653  6250 raft_consensus.cc:515] T de207f715322422ba6c06aa6b5ade0fa P 215a40d9cebb42d9906c6e4616e2950a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "215a40d9cebb42d9906c6e4616e2950a" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 40171 } } peers { permanent_uuid: "b7aed7f4e45b499992f30b4cf32b8961" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 33867 } } peers { permanent_uuid: "4efd9e6155f94224952be95c3785290e" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 46051 } }
I20260709 13:17:56.713376  6250 leader_election.cc:290] T de207f715322422ba6c06aa6b5ade0fa P 215a40d9cebb42d9906c6e4616e2950a [CANDIDATE]: Term 2 election: Requested vote from peers b7aed7f4e45b499992f30b4cf32b8961 (127.5.126.66:33867), 4efd9e6155f94224952be95c3785290e (127.5.126.67:46051)
I20260709 13:17:56.714603  6398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de207f715322422ba6c06aa6b5ade0fa" candidate_uuid: "215a40d9cebb42d9906c6e4616e2950a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4efd9e6155f94224952be95c3785290e"
I20260709 13:17:56.714603  6325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de207f715322422ba6c06aa6b5ade0fa" candidate_uuid: "215a40d9cebb42d9906c6e4616e2950a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b7aed7f4e45b499992f30b4cf32b8961"
I20260709 13:17:56.715487  6398 raft_consensus.cc:3060] T de207f715322422ba6c06aa6b5ade0fa P 4efd9e6155f94224952be95c3785290e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:56.715521  6325 raft_consensus.cc:3055] T de207f715322422ba6c06aa6b5ade0fa P b7aed7f4e45b499992f30b4cf32b8961 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:17:56.716112  6325 raft_consensus.cc:740] T de207f715322422ba6c06aa6b5ade0fa P b7aed7f4e45b499992f30b4cf32b8961 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b7aed7f4e45b499992f30b4cf32b8961, State: Running, Role: LEADER
I20260709 13:17:56.717006  6325 consensus_queue.cc:260] T de207f715322422ba6c06aa6b5ade0fa P b7aed7f4e45b499992f30b4cf32b8961 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "215a40d9cebb42d9906c6e4616e2950a" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 40171 } } peers { permanent_uuid: "b7aed7f4e45b499992f30b4cf32b8961" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 33867 } } peers { permanent_uuid: "4efd9e6155f94224952be95c3785290e" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 46051 } }
I20260709 13:17:56.718343  6325 raft_consensus.cc:3060] T de207f715322422ba6c06aa6b5ade0fa P b7aed7f4e45b499992f30b4cf32b8961 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:56.723688  6398 raft_consensus.cc:2468] T de207f715322422ba6c06aa6b5ade0fa P 4efd9e6155f94224952be95c3785290e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 215a40d9cebb42d9906c6e4616e2950a in term 2.
I20260709 13:17:56.725278  6213 leader_election.cc:304] T de207f715322422ba6c06aa6b5ade0fa P 215a40d9cebb42d9906c6e4616e2950a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 215a40d9cebb42d9906c6e4616e2950a, 4efd9e6155f94224952be95c3785290e; no voters: 
I20260709 13:17:56.725950  6536 raft_consensus.cc:993] T c7cfe05c9c2f47f487fbf3b81a0a47ca P b7aed7f4e45b499992f30b4cf32b8961: : Instructing follower 215a40d9cebb42d9906c6e4616e2950a to start an election
I20260709 13:17:56.725901  6325 raft_consensus.cc:2468] T de207f715322422ba6c06aa6b5ade0fa P b7aed7f4e45b499992f30b4cf32b8961 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 215a40d9cebb42d9906c6e4616e2950a in term 2.
I20260709 13:17:56.726388  6535 raft_consensus.cc:2804] T de207f715322422ba6c06aa6b5ade0fa P 215a40d9cebb42d9906c6e4616e2950a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:17:56.726702  6555 raft_consensus.cc:1081] T c7cfe05c9c2f47f487fbf3b81a0a47ca P b7aed7f4e45b499992f30b4cf32b8961 [term 1 LEADER]: Signalling peer 215a40d9cebb42d9906c6e4616e2950a to start an election
I20260709 13:17:56.726999  6535 raft_consensus.cc:697] T de207f715322422ba6c06aa6b5ade0fa P 215a40d9cebb42d9906c6e4616e2950a [term 2 LEADER]: Becoming Leader. State: Replica: 215a40d9cebb42d9906c6e4616e2950a, State: Running, Role: LEADER
I20260709 13:17:56.727892  6535 consensus_queue.cc:237] T de207f715322422ba6c06aa6b5ade0fa P 215a40d9cebb42d9906c6e4616e2950a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "215a40d9cebb42d9906c6e4616e2950a" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 40171 } } peers { permanent_uuid: "b7aed7f4e45b499992f30b4cf32b8961" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 33867 } } peers { permanent_uuid: "4efd9e6155f94224952be95c3785290e" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 46051 } }
I20260709 13:17:56.728754  6250 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c7cfe05c9c2f47f487fbf3b81a0a47ca"
dest_uuid: "215a40d9cebb42d9906c6e4616e2950a"
 from {username='slave'} at 127.0.0.1:56960
I20260709 13:17:56.729262  6250 raft_consensus.cc:493] T c7cfe05c9c2f47f487fbf3b81a0a47ca P 215a40d9cebb42d9906c6e4616e2950a [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:56.729554  6250 raft_consensus.cc:3060] T c7cfe05c9c2f47f487fbf3b81a0a47ca P 215a40d9cebb42d9906c6e4616e2950a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:56.734371  6250 raft_consensus.cc:515] T c7cfe05c9c2f47f487fbf3b81a0a47ca P 215a40d9cebb42d9906c6e4616e2950a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "215a40d9cebb42d9906c6e4616e2950a" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 40171 } } peers { permanent_uuid: "b7aed7f4e45b499992f30b4cf32b8961" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 33867 } } peers { permanent_uuid: "4efd9e6155f94224952be95c3785290e" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 46051 } }
I20260709 13:17:56.736542  6250 leader_election.cc:290] T c7cfe05c9c2f47f487fbf3b81a0a47ca P 215a40d9cebb42d9906c6e4616e2950a [CANDIDATE]: Term 2 election: Requested vote from peers b7aed7f4e45b499992f30b4cf32b8961 (127.5.126.66:33867), 4efd9e6155f94224952be95c3785290e (127.5.126.67:46051)
I20260709 13:17:56.738150  6398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7cfe05c9c2f47f487fbf3b81a0a47ca" candidate_uuid: "215a40d9cebb42d9906c6e4616e2950a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4efd9e6155f94224952be95c3785290e"
I20260709 13:17:56.737996  6325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7cfe05c9c2f47f487fbf3b81a0a47ca" candidate_uuid: "215a40d9cebb42d9906c6e4616e2950a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b7aed7f4e45b499992f30b4cf32b8961"
I20260709 13:17:56.738757  6398 raft_consensus.cc:3060] T c7cfe05c9c2f47f487fbf3b81a0a47ca P 4efd9e6155f94224952be95c3785290e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:56.738848  6325 raft_consensus.cc:3055] T c7cfe05c9c2f47f487fbf3b81a0a47ca P b7aed7f4e45b499992f30b4cf32b8961 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:17:56.739416  6325 raft_consensus.cc:740] T c7cfe05c9c2f47f487fbf3b81a0a47ca P b7aed7f4e45b499992f30b4cf32b8961 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b7aed7f4e45b499992f30b4cf32b8961, State: Running, Role: LEADER
I20260709 13:17:56.740245  6325 consensus_queue.cc:260] T c7cfe05c9c2f47f487fbf3b81a0a47ca P b7aed7f4e45b499992f30b4cf32b8961 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "215a40d9cebb42d9906c6e4616e2950a" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 40171 } } peers { permanent_uuid: "b7aed7f4e45b499992f30b4cf32b8961" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 33867 } } peers { permanent_uuid: "4efd9e6155f94224952be95c3785290e" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 46051 } }
I20260709 13:17:56.741381  6325 raft_consensus.cc:3060] T c7cfe05c9c2f47f487fbf3b81a0a47ca P b7aed7f4e45b499992f30b4cf32b8961 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:56.740833  6146 catalog_manager.cc:5697] T de207f715322422ba6c06aa6b5ade0fa P 215a40d9cebb42d9906c6e4616e2950a reported cstate change: term changed from 1 to 2, leader changed from b7aed7f4e45b499992f30b4cf32b8961 (127.5.126.66) to 215a40d9cebb42d9906c6e4616e2950a (127.5.126.65). New cstate: current_term: 2 leader_uuid: "215a40d9cebb42d9906c6e4616e2950a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "215a40d9cebb42d9906c6e4616e2950a" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 40171 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b7aed7f4e45b499992f30b4cf32b8961" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 33867 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4efd9e6155f94224952be95c3785290e" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 46051 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:56.745990  6398 raft_consensus.cc:2468] T c7cfe05c9c2f47f487fbf3b81a0a47ca P 4efd9e6155f94224952be95c3785290e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 215a40d9cebb42d9906c6e4616e2950a in term 2.
I20260709 13:17:56.747506  6213 leader_election.cc:304] T c7cfe05c9c2f47f487fbf3b81a0a47ca P 215a40d9cebb42d9906c6e4616e2950a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 215a40d9cebb42d9906c6e4616e2950a, 4efd9e6155f94224952be95c3785290e; no voters: 
I20260709 13:17:56.747888  6325 raft_consensus.cc:2468] T c7cfe05c9c2f47f487fbf3b81a0a47ca P b7aed7f4e45b499992f30b4cf32b8961 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 215a40d9cebb42d9906c6e4616e2950a in term 2.
I20260709 13:17:56.748413  6539 raft_consensus.cc:2804] T c7cfe05c9c2f47f487fbf3b81a0a47ca P 215a40d9cebb42d9906c6e4616e2950a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:17:56.751044  6539 raft_consensus.cc:697] T c7cfe05c9c2f47f487fbf3b81a0a47ca P 215a40d9cebb42d9906c6e4616e2950a [term 2 LEADER]: Becoming Leader. State: Replica: 215a40d9cebb42d9906c6e4616e2950a, State: Running, Role: LEADER
I20260709 13:17:56.752184  6539 consensus_queue.cc:237] T c7cfe05c9c2f47f487fbf3b81a0a47ca P 215a40d9cebb42d9906c6e4616e2950a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "215a40d9cebb42d9906c6e4616e2950a" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 40171 } } peers { permanent_uuid: "b7aed7f4e45b499992f30b4cf32b8961" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 33867 } } peers { permanent_uuid: "4efd9e6155f94224952be95c3785290e" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 46051 } }
I20260709 13:17:56.759711  6146 catalog_manager.cc:5697] T c7cfe05c9c2f47f487fbf3b81a0a47ca P 215a40d9cebb42d9906c6e4616e2950a reported cstate change: term changed from 1 to 2, leader changed from b7aed7f4e45b499992f30b4cf32b8961 (127.5.126.66) to 215a40d9cebb42d9906c6e4616e2950a (127.5.126.65). New cstate: current_term: 2 leader_uuid: "215a40d9cebb42d9906c6e4616e2950a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "215a40d9cebb42d9906c6e4616e2950a" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 40171 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b7aed7f4e45b499992f30b4cf32b8961" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 33867 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4efd9e6155f94224952be95c3785290e" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 46051 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:56.960145  6549 raft_consensus.cc:993] T 82ccb3ed51b2453381692135f3179a54 P 4efd9e6155f94224952be95c3785290e: : Instructing follower 215a40d9cebb42d9906c6e4616e2950a to start an election
I20260709 13:17:56.960649  6540 raft_consensus.cc:1081] T 82ccb3ed51b2453381692135f3179a54 P 4efd9e6155f94224952be95c3785290e [term 3 LEADER]: Signalling peer 215a40d9cebb42d9906c6e4616e2950a to start an election
I20260709 13:17:56.962312  6250 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "82ccb3ed51b2453381692135f3179a54"
dest_uuid: "215a40d9cebb42d9906c6e4616e2950a"
 from {username='slave'} at 127.0.0.1:56964
I20260709 13:17:56.962769  6250 raft_consensus.cc:493] T 82ccb3ed51b2453381692135f3179a54 P 215a40d9cebb42d9906c6e4616e2950a [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:56.963042  6250 raft_consensus.cc:3060] T 82ccb3ed51b2453381692135f3179a54 P 215a40d9cebb42d9906c6e4616e2950a [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:17:56.967382  6250 raft_consensus.cc:515] T 82ccb3ed51b2453381692135f3179a54 P 215a40d9cebb42d9906c6e4616e2950a [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "215a40d9cebb42d9906c6e4616e2950a" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 40171 } } peers { permanent_uuid: "b7aed7f4e45b499992f30b4cf32b8961" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 33867 } } peers { permanent_uuid: "4efd9e6155f94224952be95c3785290e" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 46051 } }
I20260709 13:17:56.969170  6250 leader_election.cc:290] T 82ccb3ed51b2453381692135f3179a54 P 215a40d9cebb42d9906c6e4616e2950a [CANDIDATE]: Term 4 election: Requested vote from peers b7aed7f4e45b499992f30b4cf32b8961 (127.5.126.66:33867), 4efd9e6155f94224952be95c3785290e (127.5.126.67:46051)
I20260709 13:17:56.970196  6325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82ccb3ed51b2453381692135f3179a54" candidate_uuid: "215a40d9cebb42d9906c6e4616e2950a" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "b7aed7f4e45b499992f30b4cf32b8961"
I20260709 13:17:56.970496  6398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82ccb3ed51b2453381692135f3179a54" candidate_uuid: "215a40d9cebb42d9906c6e4616e2950a" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "4efd9e6155f94224952be95c3785290e"
I20260709 13:17:56.970892  6325 raft_consensus.cc:3060] T 82ccb3ed51b2453381692135f3179a54 P b7aed7f4e45b499992f30b4cf32b8961 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:17:56.971146  6398 raft_consensus.cc:3055] T 82ccb3ed51b2453381692135f3179a54 P 4efd9e6155f94224952be95c3785290e [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:17:56.971611  6398 raft_consensus.cc:740] T 82ccb3ed51b2453381692135f3179a54 P 4efd9e6155f94224952be95c3785290e [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 4efd9e6155f94224952be95c3785290e, State: Running, Role: LEADER
I20260709 13:17:56.972626  6398 consensus_queue.cc:260] T 82ccb3ed51b2453381692135f3179a54 P 4efd9e6155f94224952be95c3785290e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "215a40d9cebb42d9906c6e4616e2950a" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 40171 } } peers { permanent_uuid: "b7aed7f4e45b499992f30b4cf32b8961" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 33867 } } peers { permanent_uuid: "4efd9e6155f94224952be95c3785290e" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 46051 } }
I20260709 13:17:56.973776  6398 raft_consensus.cc:3060] T 82ccb3ed51b2453381692135f3179a54 P 4efd9e6155f94224952be95c3785290e [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:17:56.977658  6325 raft_consensus.cc:2468] T 82ccb3ed51b2453381692135f3179a54 P b7aed7f4e45b499992f30b4cf32b8961 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 215a40d9cebb42d9906c6e4616e2950a in term 4.
I20260709 13:17:56.978950  6213 leader_election.cc:304] T 82ccb3ed51b2453381692135f3179a54 P 215a40d9cebb42d9906c6e4616e2950a [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 215a40d9cebb42d9906c6e4616e2950a, b7aed7f4e45b499992f30b4cf32b8961; no voters: 
I20260709 13:17:56.979120  6398 raft_consensus.cc:2468] T 82ccb3ed51b2453381692135f3179a54 P 4efd9e6155f94224952be95c3785290e [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 215a40d9cebb42d9906c6e4616e2950a in term 4.
I20260709 13:17:56.979887  6539 raft_consensus.cc:2804] T 82ccb3ed51b2453381692135f3179a54 P 215a40d9cebb42d9906c6e4616e2950a [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:17:56.980587  6539 raft_consensus.cc:697] T 82ccb3ed51b2453381692135f3179a54 P 215a40d9cebb42d9906c6e4616e2950a [term 4 LEADER]: Becoming Leader. State: Replica: 215a40d9cebb42d9906c6e4616e2950a, State: Running, Role: LEADER
I20260709 13:17:56.981364  6539 consensus_queue.cc:237] T 82ccb3ed51b2453381692135f3179a54 P 215a40d9cebb42d9906c6e4616e2950a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "215a40d9cebb42d9906c6e4616e2950a" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 40171 } } peers { permanent_uuid: "b7aed7f4e45b499992f30b4cf32b8961" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 33867 } } peers { permanent_uuid: "4efd9e6155f94224952be95c3785290e" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 46051 } }
I20260709 13:17:56.987676  6146 catalog_manager.cc:5697] T 82ccb3ed51b2453381692135f3179a54 P 215a40d9cebb42d9906c6e4616e2950a reported cstate change: term changed from 3 to 4, leader changed from 4efd9e6155f94224952be95c3785290e (127.5.126.67) to 215a40d9cebb42d9906c6e4616e2950a (127.5.126.65). New cstate: current_term: 4 leader_uuid: "215a40d9cebb42d9906c6e4616e2950a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "215a40d9cebb42d9906c6e4616e2950a" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 40171 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b7aed7f4e45b499992f30b4cf32b8961" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 33867 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4efd9e6155f94224952be95c3785290e" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 46051 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:57.044471  6549 raft_consensus.cc:993] T 879fa203410744a9a1a63d33e0801f07 P 4efd9e6155f94224952be95c3785290e: : Instructing follower 215a40d9cebb42d9906c6e4616e2950a to start an election
I20260709 13:17:57.044970  6540 raft_consensus.cc:1081] T 879fa203410744a9a1a63d33e0801f07 P 4efd9e6155f94224952be95c3785290e [term 3 LEADER]: Signalling peer 215a40d9cebb42d9906c6e4616e2950a to start an election
I20260709 13:17:57.046481  6250 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "879fa203410744a9a1a63d33e0801f07"
dest_uuid: "215a40d9cebb42d9906c6e4616e2950a"
 from {username='slave'} at 127.0.0.1:56964
I20260709 13:17:57.046955  6250 raft_consensus.cc:493] T 879fa203410744a9a1a63d33e0801f07 P 215a40d9cebb42d9906c6e4616e2950a [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:57.047220  6250 raft_consensus.cc:3060] T 879fa203410744a9a1a63d33e0801f07 P 215a40d9cebb42d9906c6e4616e2950a [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:17:57.051177  6250 raft_consensus.cc:515] T 879fa203410744a9a1a63d33e0801f07 P 215a40d9cebb42d9906c6e4616e2950a [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "215a40d9cebb42d9906c6e4616e2950a" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 40171 } } peers { permanent_uuid: "b7aed7f4e45b499992f30b4cf32b8961" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 33867 } } peers { permanent_uuid: "4efd9e6155f94224952be95c3785290e" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 46051 } }
I20260709 13:17:57.052606  6250 leader_election.cc:290] T 879fa203410744a9a1a63d33e0801f07 P 215a40d9cebb42d9906c6e4616e2950a [CANDIDATE]: Term 4 election: Requested vote from peers b7aed7f4e45b499992f30b4cf32b8961 (127.5.126.66:33867), 4efd9e6155f94224952be95c3785290e (127.5.126.67:46051)
I20260709 13:17:57.053809  6325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "879fa203410744a9a1a63d33e0801f07" candidate_uuid: "215a40d9cebb42d9906c6e4616e2950a" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "b7aed7f4e45b499992f30b4cf32b8961"
I20260709 13:17:57.054348  6325 raft_consensus.cc:3060] T 879fa203410744a9a1a63d33e0801f07 P b7aed7f4e45b499992f30b4cf32b8961 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:17:57.054418  6398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "879fa203410744a9a1a63d33e0801f07" candidate_uuid: "215a40d9cebb42d9906c6e4616e2950a" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "4efd9e6155f94224952be95c3785290e"
I20260709 13:17:57.055181  6398 raft_consensus.cc:3055] T 879fa203410744a9a1a63d33e0801f07 P 4efd9e6155f94224952be95c3785290e [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:17:57.055540  6398 raft_consensus.cc:740] T 879fa203410744a9a1a63d33e0801f07 P 4efd9e6155f94224952be95c3785290e [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 4efd9e6155f94224952be95c3785290e, State: Running, Role: LEADER
I20260709 13:17:57.056521  6398 consensus_queue.cc:260] T 879fa203410744a9a1a63d33e0801f07 P 4efd9e6155f94224952be95c3785290e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "215a40d9cebb42d9906c6e4616e2950a" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 40171 } } peers { permanent_uuid: "b7aed7f4e45b499992f30b4cf32b8961" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 33867 } } peers { permanent_uuid: "4efd9e6155f94224952be95c3785290e" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 46051 } }
I20260709 13:17:57.057929  6398 raft_consensus.cc:3060] T 879fa203410744a9a1a63d33e0801f07 P 4efd9e6155f94224952be95c3785290e [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:17:57.059252  6325 raft_consensus.cc:2468] T 879fa203410744a9a1a63d33e0801f07 P b7aed7f4e45b499992f30b4cf32b8961 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 215a40d9cebb42d9906c6e4616e2950a in term 4.
I20260709 13:17:57.060456  6213 leader_election.cc:304] T 879fa203410744a9a1a63d33e0801f07 P 215a40d9cebb42d9906c6e4616e2950a [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 215a40d9cebb42d9906c6e4616e2950a, b7aed7f4e45b499992f30b4cf32b8961; no voters: 
I20260709 13:17:57.061257  6539 raft_consensus.cc:2804] T 879fa203410744a9a1a63d33e0801f07 P 215a40d9cebb42d9906c6e4616e2950a [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:17:57.061843  6539 raft_consensus.cc:697] T 879fa203410744a9a1a63d33e0801f07 P 215a40d9cebb42d9906c6e4616e2950a [term 4 LEADER]: Becoming Leader. State: Replica: 215a40d9cebb42d9906c6e4616e2950a, State: Running, Role: LEADER
I20260709 13:17:57.062847  6539 consensus_queue.cc:237] T 879fa203410744a9a1a63d33e0801f07 P 215a40d9cebb42d9906c6e4616e2950a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "215a40d9cebb42d9906c6e4616e2950a" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 40171 } } peers { permanent_uuid: "b7aed7f4e45b499992f30b4cf32b8961" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 33867 } } peers { permanent_uuid: "4efd9e6155f94224952be95c3785290e" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 46051 } }
I20260709 13:17:57.065323  6398 raft_consensus.cc:2468] T 879fa203410744a9a1a63d33e0801f07 P 4efd9e6155f94224952be95c3785290e [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 215a40d9cebb42d9906c6e4616e2950a in term 4.
I20260709 13:17:57.070701  6146 catalog_manager.cc:5697] T 879fa203410744a9a1a63d33e0801f07 P 215a40d9cebb42d9906c6e4616e2950a reported cstate change: term changed from 3 to 4, leader changed from 4efd9e6155f94224952be95c3785290e (127.5.126.67) to 215a40d9cebb42d9906c6e4616e2950a (127.5.126.65). New cstate: current_term: 4 leader_uuid: "215a40d9cebb42d9906c6e4616e2950a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "215a40d9cebb42d9906c6e4616e2950a" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 40171 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b7aed7f4e45b499992f30b4cf32b8961" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 33867 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4efd9e6155f94224952be95c3785290e" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 46051 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:57.129980  6536 raft_consensus.cc:993] T d51e67b3ea6a458c818b4c7cf67ceef5 P b7aed7f4e45b499992f30b4cf32b8961: : Instructing follower 215a40d9cebb42d9906c6e4616e2950a to start an election
I20260709 13:17:57.130529  6555 raft_consensus.cc:1081] T d51e67b3ea6a458c818b4c7cf67ceef5 P b7aed7f4e45b499992f30b4cf32b8961 [term 2 LEADER]: Signalling peer 215a40d9cebb42d9906c6e4616e2950a to start an election
I20260709 13:17:57.132200  6250 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d51e67b3ea6a458c818b4c7cf67ceef5"
dest_uuid: "215a40d9cebb42d9906c6e4616e2950a"
 from {username='slave'} at 127.0.0.1:56960
I20260709 13:17:57.132663  6250 raft_consensus.cc:493] T d51e67b3ea6a458c818b4c7cf67ceef5 P 215a40d9cebb42d9906c6e4616e2950a [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:57.132928  6250 raft_consensus.cc:3060] T d51e67b3ea6a458c818b4c7cf67ceef5 P 215a40d9cebb42d9906c6e4616e2950a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:57.137471  6250 raft_consensus.cc:515] T d51e67b3ea6a458c818b4c7cf67ceef5 P 215a40d9cebb42d9906c6e4616e2950a [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "215a40d9cebb42d9906c6e4616e2950a" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 40171 } } peers { permanent_uuid: "b7aed7f4e45b499992f30b4cf32b8961" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 33867 } } peers { permanent_uuid: "4efd9e6155f94224952be95c3785290e" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 46051 } }
I20260709 13:17:57.139287  6250 leader_election.cc:290] T d51e67b3ea6a458c818b4c7cf67ceef5 P 215a40d9cebb42d9906c6e4616e2950a [CANDIDATE]: Term 3 election: Requested vote from peers b7aed7f4e45b499992f30b4cf32b8961 (127.5.126.66:33867), 4efd9e6155f94224952be95c3785290e (127.5.126.67:46051)
I20260709 13:17:57.140583  6325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d51e67b3ea6a458c818b4c7cf67ceef5" candidate_uuid: "215a40d9cebb42d9906c6e4616e2950a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "b7aed7f4e45b499992f30b4cf32b8961"
I20260709 13:17:57.140697  6398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d51e67b3ea6a458c818b4c7cf67ceef5" candidate_uuid: "215a40d9cebb42d9906c6e4616e2950a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "4efd9e6155f94224952be95c3785290e"
I20260709 13:17:57.141191  6398 raft_consensus.cc:3060] T d51e67b3ea6a458c818b4c7cf67ceef5 P 4efd9e6155f94224952be95c3785290e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:57.141211  6325 raft_consensus.cc:3055] T d51e67b3ea6a458c818b4c7cf67ceef5 P b7aed7f4e45b499992f30b4cf32b8961 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:17:57.141742  6325 raft_consensus.cc:740] T d51e67b3ea6a458c818b4c7cf67ceef5 P b7aed7f4e45b499992f30b4cf32b8961 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: b7aed7f4e45b499992f30b4cf32b8961, State: Running, Role: LEADER
I20260709 13:17:57.142490  6325 consensus_queue.cc:260] T d51e67b3ea6a458c818b4c7cf67ceef5 P b7aed7f4e45b499992f30b4cf32b8961 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "215a40d9cebb42d9906c6e4616e2950a" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 40171 } } peers { permanent_uuid: "b7aed7f4e45b499992f30b4cf32b8961" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 33867 } } peers { permanent_uuid: "4efd9e6155f94224952be95c3785290e" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 46051 } }
I20260709 13:17:57.143567  6325 raft_consensus.cc:3060] T d51e67b3ea6a458c818b4c7cf67ceef5 P b7aed7f4e45b499992f30b4cf32b8961 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:57.147517  6398 raft_consensus.cc:2468] T d51e67b3ea6a458c818b4c7cf67ceef5 P 4efd9e6155f94224952be95c3785290e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 215a40d9cebb42d9906c6e4616e2950a in term 3.
I20260709 13:17:57.148806  6213 leader_election.cc:304] T d51e67b3ea6a458c818b4c7cf67ceef5 P 215a40d9cebb42d9906c6e4616e2950a [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 215a40d9cebb42d9906c6e4616e2950a, 4efd9e6155f94224952be95c3785290e; no voters: 
I20260709 13:17:57.149267  6325 raft_consensus.cc:2468] T d51e67b3ea6a458c818b4c7cf67ceef5 P b7aed7f4e45b499992f30b4cf32b8961 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 215a40d9cebb42d9906c6e4616e2950a in term 3.
I20260709 13:17:57.149802  6539 raft_consensus.cc:2804] T d51e67b3ea6a458c818b4c7cf67ceef5 P 215a40d9cebb42d9906c6e4616e2950a [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:17:57.150404  6539 raft_consensus.cc:697] T d51e67b3ea6a458c818b4c7cf67ceef5 P 215a40d9cebb42d9906c6e4616e2950a [term 3 LEADER]: Becoming Leader. State: Replica: 215a40d9cebb42d9906c6e4616e2950a, State: Running, Role: LEADER
I20260709 13:17:57.151293  6539 consensus_queue.cc:237] T d51e67b3ea6a458c818b4c7cf67ceef5 P 215a40d9cebb42d9906c6e4616e2950a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "215a40d9cebb42d9906c6e4616e2950a" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 40171 } } peers { permanent_uuid: "b7aed7f4e45b499992f30b4cf32b8961" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 33867 } } peers { permanent_uuid: "4efd9e6155f94224952be95c3785290e" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 46051 } }
I20260709 13:17:57.156669  6398 raft_consensus.cc:1275] T c7cfe05c9c2f47f487fbf3b81a0a47ca P 4efd9e6155f94224952be95c3785290e [term 2 FOLLOWER]: Refusing update from remote peer 215a40d9cebb42d9906c6e4616e2950a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:57.157971  6535 consensus_queue.cc:1048] T c7cfe05c9c2f47f487fbf3b81a0a47ca P 215a40d9cebb42d9906c6e4616e2950a [LEADER]: Connected to new peer: Peer: permanent_uuid: "4efd9e6155f94224952be95c3785290e" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 46051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:57.159225  6146 catalog_manager.cc:5697] T d51e67b3ea6a458c818b4c7cf67ceef5 P 215a40d9cebb42d9906c6e4616e2950a reported cstate change: term changed from 2 to 3, leader changed from b7aed7f4e45b499992f30b4cf32b8961 (127.5.126.66) to 215a40d9cebb42d9906c6e4616e2950a (127.5.126.65). New cstate: current_term: 3 leader_uuid: "215a40d9cebb42d9906c6e4616e2950a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "215a40d9cebb42d9906c6e4616e2950a" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 40171 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b7aed7f4e45b499992f30b4cf32b8961" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 33867 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4efd9e6155f94224952be95c3785290e" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 46051 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:57.172276  6325 raft_consensus.cc:1275] T c7cfe05c9c2f47f487fbf3b81a0a47ca P b7aed7f4e45b499992f30b4cf32b8961 [term 2 FOLLOWER]: Refusing update from remote peer 215a40d9cebb42d9906c6e4616e2950a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:57.174675  6539 consensus_queue.cc:1048] T c7cfe05c9c2f47f487fbf3b81a0a47ca P 215a40d9cebb42d9906c6e4616e2950a [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7aed7f4e45b499992f30b4cf32b8961" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 33867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:57.273664  6325 raft_consensus.cc:1275] T de207f715322422ba6c06aa6b5ade0fa P b7aed7f4e45b499992f30b4cf32b8961 [term 2 FOLLOWER]: Refusing update from remote peer 215a40d9cebb42d9906c6e4616e2950a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:57.275081  6539 consensus_queue.cc:1048] T de207f715322422ba6c06aa6b5ade0fa P 215a40d9cebb42d9906c6e4616e2950a [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7aed7f4e45b499992f30b4cf32b8961" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 33867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:57.286198  6398 raft_consensus.cc:1275] T de207f715322422ba6c06aa6b5ade0fa P 4efd9e6155f94224952be95c3785290e [term 2 FOLLOWER]: Refusing update from remote peer 215a40d9cebb42d9906c6e4616e2950a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:57.288560  6535 consensus_queue.cc:1048] T de207f715322422ba6c06aa6b5ade0fa P 215a40d9cebb42d9906c6e4616e2950a [LEADER]: Connected to new peer: Peer: permanent_uuid: "4efd9e6155f94224952be95c3785290e" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 46051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:57.444995  6325 raft_consensus.cc:1275] T 82ccb3ed51b2453381692135f3179a54 P b7aed7f4e45b499992f30b4cf32b8961 [term 4 FOLLOWER]: Refusing update from remote peer 215a40d9cebb42d9906c6e4616e2950a: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:17:57.447083  6535 consensus_queue.cc:1048] T 82ccb3ed51b2453381692135f3179a54 P 215a40d9cebb42d9906c6e4616e2950a [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7aed7f4e45b499992f30b4cf32b8961" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 33867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:17:57.466215  6398 raft_consensus.cc:1275] T 82ccb3ed51b2453381692135f3179a54 P 4efd9e6155f94224952be95c3785290e [term 4 FOLLOWER]: Refusing update from remote peer 215a40d9cebb42d9906c6e4616e2950a: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:17:57.469653  6565 consensus_queue.cc:1048] T 82ccb3ed51b2453381692135f3179a54 P 215a40d9cebb42d9906c6e4616e2950a [LEADER]: Connected to new peer: Peer: permanent_uuid: "4efd9e6155f94224952be95c3785290e" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 46051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:17:57.590271  6398 raft_consensus.cc:1275] T d51e67b3ea6a458c818b4c7cf67ceef5 P 4efd9e6155f94224952be95c3785290e [term 3 FOLLOWER]: Refusing update from remote peer 215a40d9cebb42d9906c6e4616e2950a: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:17:57.591874  6565 consensus_queue.cc:1048] T d51e67b3ea6a458c818b4c7cf67ceef5 P 215a40d9cebb42d9906c6e4616e2950a [LEADER]: Connected to new peer: Peer: permanent_uuid: "4efd9e6155f94224952be95c3785290e" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 46051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:17:57.602756  6325 raft_consensus.cc:1275] T 879fa203410744a9a1a63d33e0801f07 P b7aed7f4e45b499992f30b4cf32b8961 [term 4 FOLLOWER]: Refusing update from remote peer 215a40d9cebb42d9906c6e4616e2950a: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:17:57.606279  6325 raft_consensus.cc:1275] T d51e67b3ea6a458c818b4c7cf67ceef5 P b7aed7f4e45b499992f30b4cf32b8961 [term 3 FOLLOWER]: Refusing update from remote peer 215a40d9cebb42d9906c6e4616e2950a: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:17:57.604878  6398 raft_consensus.cc:1275] T 879fa203410744a9a1a63d33e0801f07 P 4efd9e6155f94224952be95c3785290e [term 4 FOLLOWER]: Refusing update from remote peer 215a40d9cebb42d9906c6e4616e2950a: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:17:57.606418  6565 consensus_queue.cc:1048] T 879fa203410744a9a1a63d33e0801f07 P 215a40d9cebb42d9906c6e4616e2950a [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7aed7f4e45b499992f30b4cf32b8961" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 33867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:17:57.607901  6535 consensus_queue.cc:1048] T d51e67b3ea6a458c818b4c7cf67ceef5 P 215a40d9cebb42d9906c6e4616e2950a [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7aed7f4e45b499992f30b4cf32b8961" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 33867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:17:57.610049  6565 consensus_queue.cc:1048] T 879fa203410744a9a1a63d33e0801f07 P 215a40d9cebb42d9906c6e4616e2950a [LEADER]: Connected to new peer: Peer: permanent_uuid: "4efd9e6155f94224952be95c3785290e" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 46051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:17:59.632370  5625 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:17:59.640961  6250 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "82ccb3ed51b2453381692135f3179a54"
dest_uuid: "215a40d9cebb42d9906c6e4616e2950a"
mode: GRACEFUL
new_leader_uuid: "4efd9e6155f94224952be95c3785290e"
 from {username='slave'} at 127.0.0.1:56984
I20260709 13:17:59.641898  6250 raft_consensus.cc:606] T 82ccb3ed51b2453381692135f3179a54 P 215a40d9cebb42d9906c6e4616e2950a [term 4 LEADER]: Received request to transfer leadership to TS 4efd9e6155f94224952be95c3785290e
I20260709 13:17:59.645171  6250 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c7cfe05c9c2f47f487fbf3b81a0a47ca"
dest_uuid: "215a40d9cebb42d9906c6e4616e2950a"
mode: GRACEFUL
new_leader_uuid: "b7aed7f4e45b499992f30b4cf32b8961"
 from {username='slave'} at 127.0.0.1:56984
I20260709 13:17:59.645776  6250 raft_consensus.cc:606] T c7cfe05c9c2f47f487fbf3b81a0a47ca P 215a40d9cebb42d9906c6e4616e2950a [term 2 LEADER]: Received request to transfer leadership to TS b7aed7f4e45b499992f30b4cf32b8961
I20260709 13:17:59.648845  6250 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d51e67b3ea6a458c818b4c7cf67ceef5"
dest_uuid: "215a40d9cebb42d9906c6e4616e2950a"
mode: GRACEFUL
new_leader_uuid: "b7aed7f4e45b499992f30b4cf32b8961"
 from {username='slave'} at 127.0.0.1:56984
I20260709 13:17:59.649411  6250 raft_consensus.cc:606] T d51e67b3ea6a458c818b4c7cf67ceef5 P 215a40d9cebb42d9906c6e4616e2950a [term 3 LEADER]: Received request to transfer leadership to TS b7aed7f4e45b499992f30b4cf32b8961
I20260709 13:17:59.652189  6250 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ee893b0b66474d44baaeba294d249e32"
dest_uuid: "215a40d9cebb42d9906c6e4616e2950a"
mode: GRACEFUL
new_leader_uuid: "4efd9e6155f94224952be95c3785290e"
 from {username='slave'} at 127.0.0.1:56984
I20260709 13:17:59.652724  6250 raft_consensus.cc:606] T ee893b0b66474d44baaeba294d249e32 P 215a40d9cebb42d9906c6e4616e2950a [term 2 LEADER]: Received request to transfer leadership to TS 4efd9e6155f94224952be95c3785290e
I20260709 13:17:59.653949  5625 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 13:17:59.654469  5625 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:17:59.686133  6565 raft_consensus.cc:993] T d51e67b3ea6a458c818b4c7cf67ceef5 P 215a40d9cebb42d9906c6e4616e2950a: : Instructing follower b7aed7f4e45b499992f30b4cf32b8961 to start an election
I20260709 13:17:59.686724  6577 raft_consensus.cc:1081] T d51e67b3ea6a458c818b4c7cf67ceef5 P 215a40d9cebb42d9906c6e4616e2950a [term 3 LEADER]: Signalling peer b7aed7f4e45b499992f30b4cf32b8961 to start an election
I20260709 13:17:59.688396  6325 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d51e67b3ea6a458c818b4c7cf67ceef5"
dest_uuid: "b7aed7f4e45b499992f30b4cf32b8961"
 from {username='slave'} at 127.0.0.1:58360
I20260709 13:17:59.688874  6325 raft_consensus.cc:493] T d51e67b3ea6a458c818b4c7cf67ceef5 P b7aed7f4e45b499992f30b4cf32b8961 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:59.689112  6325 raft_consensus.cc:3060] T d51e67b3ea6a458c818b4c7cf67ceef5 P b7aed7f4e45b499992f30b4cf32b8961 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:17:59.694242  6325 raft_consensus.cc:515] T d51e67b3ea6a458c818b4c7cf67ceef5 P b7aed7f4e45b499992f30b4cf32b8961 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "215a40d9cebb42d9906c6e4616e2950a" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 40171 } } peers { permanent_uuid: "b7aed7f4e45b499992f30b4cf32b8961" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 33867 } } peers { permanent_uuid: "4efd9e6155f94224952be95c3785290e" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 46051 } }
I20260709 13:17:59.695657  6325 leader_election.cc:290] T d51e67b3ea6a458c818b4c7cf67ceef5 P b7aed7f4e45b499992f30b4cf32b8961 [CANDIDATE]: Term 4 election: Requested vote from peers 215a40d9cebb42d9906c6e4616e2950a (127.5.126.65:40171), 4efd9e6155f94224952be95c3785290e (127.5.126.67:46051)
I20260709 13:17:59.697091  6398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d51e67b3ea6a458c818b4c7cf67ceef5" candidate_uuid: "b7aed7f4e45b499992f30b4cf32b8961" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "4efd9e6155f94224952be95c3785290e"
I20260709 13:17:59.697101  6250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d51e67b3ea6a458c818b4c7cf67ceef5" candidate_uuid: "b7aed7f4e45b499992f30b4cf32b8961" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "215a40d9cebb42d9906c6e4616e2950a"
I20260709 13:17:59.698325  6398 raft_consensus.cc:3060] T d51e67b3ea6a458c818b4c7cf67ceef5 P 4efd9e6155f94224952be95c3785290e [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:17:59.698360  6250 raft_consensus.cc:3055] T d51e67b3ea6a458c818b4c7cf67ceef5 P 215a40d9cebb42d9906c6e4616e2950a [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:17:59.698982  6250 raft_consensus.cc:740] T d51e67b3ea6a458c818b4c7cf67ceef5 P 215a40d9cebb42d9906c6e4616e2950a [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 215a40d9cebb42d9906c6e4616e2950a, State: Running, Role: LEADER
I20260709 13:17:59.699924  6250 consensus_queue.cc:260] T d51e67b3ea6a458c818b4c7cf67ceef5 P 215a40d9cebb42d9906c6e4616e2950a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "215a40d9cebb42d9906c6e4616e2950a" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 40171 } } peers { permanent_uuid: "b7aed7f4e45b499992f30b4cf32b8961" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 33867 } } peers { permanent_uuid: "4efd9e6155f94224952be95c3785290e" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 46051 } }
I20260709 13:17:59.701419  6250 raft_consensus.cc:3060] T d51e67b3ea6a458c818b4c7cf67ceef5 P 215a40d9cebb42d9906c6e4616e2950a [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:17:59.706900  6398 raft_consensus.cc:2468] T d51e67b3ea6a458c818b4c7cf67ceef5 P 4efd9e6155f94224952be95c3785290e [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7aed7f4e45b499992f30b4cf32b8961 in term 4.
I20260709 13:17:59.708511  6288 leader_election.cc:304] T d51e67b3ea6a458c818b4c7cf67ceef5 P b7aed7f4e45b499992f30b4cf32b8961 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4efd9e6155f94224952be95c3785290e, b7aed7f4e45b499992f30b4cf32b8961; no voters: 
I20260709 13:17:59.708806  6250 raft_consensus.cc:2468] T d51e67b3ea6a458c818b4c7cf67ceef5 P 215a40d9cebb42d9906c6e4616e2950a [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7aed7f4e45b499992f30b4cf32b8961 in term 4.
I20260709 13:17:59.709499  6555 raft_consensus.cc:2804] T d51e67b3ea6a458c818b4c7cf67ceef5 P b7aed7f4e45b499992f30b4cf32b8961 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:17:59.710595  6555 raft_consensus.cc:697] T d51e67b3ea6a458c818b4c7cf67ceef5 P b7aed7f4e45b499992f30b4cf32b8961 [term 4 LEADER]: Becoming Leader. State: Replica: b7aed7f4e45b499992f30b4cf32b8961, State: Running, Role: LEADER
I20260709 13:17:59.711447  6555 consensus_queue.cc:237] T d51e67b3ea6a458c818b4c7cf67ceef5 P b7aed7f4e45b499992f30b4cf32b8961 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "215a40d9cebb42d9906c6e4616e2950a" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 40171 } } peers { permanent_uuid: "b7aed7f4e45b499992f30b4cf32b8961" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 33867 } } peers { permanent_uuid: "4efd9e6155f94224952be95c3785290e" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 46051 } }
I20260709 13:17:59.718822  6147 catalog_manager.cc:5697] T d51e67b3ea6a458c818b4c7cf67ceef5 P b7aed7f4e45b499992f30b4cf32b8961 reported cstate change: term changed from 3 to 4, leader changed from 215a40d9cebb42d9906c6e4616e2950a (127.5.126.65) to b7aed7f4e45b499992f30b4cf32b8961 (127.5.126.66). New cstate: current_term: 4 leader_uuid: "b7aed7f4e45b499992f30b4cf32b8961" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "215a40d9cebb42d9906c6e4616e2950a" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 40171 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b7aed7f4e45b499992f30b4cf32b8961" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 33867 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4efd9e6155f94224952be95c3785290e" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 46051 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:59.862674  6565 raft_consensus.cc:993] T 82ccb3ed51b2453381692135f3179a54 P 215a40d9cebb42d9906c6e4616e2950a: : Instructing follower 4efd9e6155f94224952be95c3785290e to start an election
I20260709 13:17:59.863330  6577 raft_consensus.cc:1081] T 82ccb3ed51b2453381692135f3179a54 P 215a40d9cebb42d9906c6e4616e2950a [term 4 LEADER]: Signalling peer 4efd9e6155f94224952be95c3785290e to start an election
I20260709 13:17:59.865023  6398 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "82ccb3ed51b2453381692135f3179a54"
dest_uuid: "4efd9e6155f94224952be95c3785290e"
 from {username='slave'} at 127.0.0.1:33268
I20260709 13:17:59.865523  6398 raft_consensus.cc:493] T 82ccb3ed51b2453381692135f3179a54 P 4efd9e6155f94224952be95c3785290e [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:59.865805  6398 raft_consensus.cc:3060] T 82ccb3ed51b2453381692135f3179a54 P 4efd9e6155f94224952be95c3785290e [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:17:59.870400  6398 raft_consensus.cc:515] T 82ccb3ed51b2453381692135f3179a54 P 4efd9e6155f94224952be95c3785290e [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "215a40d9cebb42d9906c6e4616e2950a" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 40171 } } peers { permanent_uuid: "b7aed7f4e45b499992f30b4cf32b8961" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 33867 } } peers { permanent_uuid: "4efd9e6155f94224952be95c3785290e" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 46051 } }
I20260709 13:17:59.872282  6398 leader_election.cc:290] T 82ccb3ed51b2453381692135f3179a54 P 4efd9e6155f94224952be95c3785290e [CANDIDATE]: Term 5 election: Requested vote from peers 215a40d9cebb42d9906c6e4616e2950a (127.5.126.65:40171), b7aed7f4e45b499992f30b4cf32b8961 (127.5.126.66:33867)
I20260709 13:17:59.873355  6250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82ccb3ed51b2453381692135f3179a54" candidate_uuid: "4efd9e6155f94224952be95c3785290e" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "215a40d9cebb42d9906c6e4616e2950a"
I20260709 13:17:59.873615  6325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82ccb3ed51b2453381692135f3179a54" candidate_uuid: "4efd9e6155f94224952be95c3785290e" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "b7aed7f4e45b499992f30b4cf32b8961"
I20260709 13:17:59.874006  6250 raft_consensus.cc:3055] T 82ccb3ed51b2453381692135f3179a54 P 215a40d9cebb42d9906c6e4616e2950a [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:17:59.874233  6325 raft_consensus.cc:3060] T 82ccb3ed51b2453381692135f3179a54 P b7aed7f4e45b499992f30b4cf32b8961 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:17:59.874385  6250 raft_consensus.cc:740] T 82ccb3ed51b2453381692135f3179a54 P 215a40d9cebb42d9906c6e4616e2950a [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 215a40d9cebb42d9906c6e4616e2950a, State: Running, Role: LEADER
I20260709 13:17:59.875285  6250 consensus_queue.cc:260] T 82ccb3ed51b2453381692135f3179a54 P 215a40d9cebb42d9906c6e4616e2950a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "215a40d9cebb42d9906c6e4616e2950a" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 40171 } } peers { permanent_uuid: "b7aed7f4e45b499992f30b4cf32b8961" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 33867 } } peers { permanent_uuid: "4efd9e6155f94224952be95c3785290e" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 46051 } }
I20260709 13:17:59.876507  6250 raft_consensus.cc:3060] T 82ccb3ed51b2453381692135f3179a54 P 215a40d9cebb42d9906c6e4616e2950a [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:17:59.879720  6325 raft_consensus.cc:2468] T 82ccb3ed51b2453381692135f3179a54 P b7aed7f4e45b499992f30b4cf32b8961 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4efd9e6155f94224952be95c3785290e in term 5.
I20260709 13:17:59.880968  6362 leader_election.cc:304] T 82ccb3ed51b2453381692135f3179a54 P 4efd9e6155f94224952be95c3785290e [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4efd9e6155f94224952be95c3785290e, b7aed7f4e45b499992f30b4cf32b8961; no voters: 
I20260709 13:17:59.881886  6576 raft_consensus.cc:2804] T 82ccb3ed51b2453381692135f3179a54 P 4efd9e6155f94224952be95c3785290e [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:17:59.883013  6250 raft_consensus.cc:2468] T 82ccb3ed51b2453381692135f3179a54 P 215a40d9cebb42d9906c6e4616e2950a [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4efd9e6155f94224952be95c3785290e in term 5.
I20260709 13:17:59.883361  6576 raft_consensus.cc:697] T 82ccb3ed51b2453381692135f3179a54 P 4efd9e6155f94224952be95c3785290e [term 5 LEADER]: Becoming Leader. State: Replica: 4efd9e6155f94224952be95c3785290e, State: Running, Role: LEADER
I20260709 13:17:59.884397  6576 consensus_queue.cc:237] T 82ccb3ed51b2453381692135f3179a54 P 4efd9e6155f94224952be95c3785290e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "215a40d9cebb42d9906c6e4616e2950a" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 40171 } } peers { permanent_uuid: "b7aed7f4e45b499992f30b4cf32b8961" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 33867 } } peers { permanent_uuid: "4efd9e6155f94224952be95c3785290e" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 46051 } }
I20260709 13:17:59.892482  6147 catalog_manager.cc:5697] T 82ccb3ed51b2453381692135f3179a54 P 4efd9e6155f94224952be95c3785290e reported cstate change: term changed from 4 to 5, leader changed from 215a40d9cebb42d9906c6e4616e2950a (127.5.126.65) to 4efd9e6155f94224952be95c3785290e (127.5.126.67). New cstate: current_term: 5 leader_uuid: "4efd9e6155f94224952be95c3785290e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "215a40d9cebb42d9906c6e4616e2950a" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 40171 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b7aed7f4e45b499992f30b4cf32b8961" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 33867 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4efd9e6155f94224952be95c3785290e" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 46051 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:59.951778  6577 raft_consensus.cc:993] T c7cfe05c9c2f47f487fbf3b81a0a47ca P 215a40d9cebb42d9906c6e4616e2950a: : Instructing follower b7aed7f4e45b499992f30b4cf32b8961 to start an election
I20260709 13:17:59.952319  6565 raft_consensus.cc:1081] T c7cfe05c9c2f47f487fbf3b81a0a47ca P 215a40d9cebb42d9906c6e4616e2950a [term 2 LEADER]: Signalling peer b7aed7f4e45b499992f30b4cf32b8961 to start an election
I20260709 13:17:59.953774  6325 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c7cfe05c9c2f47f487fbf3b81a0a47ca"
dest_uuid: "b7aed7f4e45b499992f30b4cf32b8961"
 from {username='slave'} at 127.0.0.1:58360
I20260709 13:17:59.954322  6325 raft_consensus.cc:493] T c7cfe05c9c2f47f487fbf3b81a0a47ca P b7aed7f4e45b499992f30b4cf32b8961 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:59.954581  6325 raft_consensus.cc:3060] T c7cfe05c9c2f47f487fbf3b81a0a47ca P b7aed7f4e45b499992f30b4cf32b8961 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:59.960000  6325 raft_consensus.cc:515] T c7cfe05c9c2f47f487fbf3b81a0a47ca P b7aed7f4e45b499992f30b4cf32b8961 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "215a40d9cebb42d9906c6e4616e2950a" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 40171 } } peers { permanent_uuid: "b7aed7f4e45b499992f30b4cf32b8961" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 33867 } } peers { permanent_uuid: "4efd9e6155f94224952be95c3785290e" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 46051 } }
I20260709 13:17:59.961671  6325 leader_election.cc:290] T c7cfe05c9c2f47f487fbf3b81a0a47ca P b7aed7f4e45b499992f30b4cf32b8961 [CANDIDATE]: Term 3 election: Requested vote from peers 215a40d9cebb42d9906c6e4616e2950a (127.5.126.65:40171), 4efd9e6155f94224952be95c3785290e (127.5.126.67:46051)
I20260709 13:17:59.962697  6250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7cfe05c9c2f47f487fbf3b81a0a47ca" candidate_uuid: "b7aed7f4e45b499992f30b4cf32b8961" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "215a40d9cebb42d9906c6e4616e2950a"
I20260709 13:17:59.962927  6397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7cfe05c9c2f47f487fbf3b81a0a47ca" candidate_uuid: "b7aed7f4e45b499992f30b4cf32b8961" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "4efd9e6155f94224952be95c3785290e"
I20260709 13:17:59.963387  6250 raft_consensus.cc:3055] T c7cfe05c9c2f47f487fbf3b81a0a47ca P 215a40d9cebb42d9906c6e4616e2950a [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:17:59.963390  6397 raft_consensus.cc:3060] T c7cfe05c9c2f47f487fbf3b81a0a47ca P 4efd9e6155f94224952be95c3785290e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:59.963886  6250 raft_consensus.cc:740] T c7cfe05c9c2f47f487fbf3b81a0a47ca P 215a40d9cebb42d9906c6e4616e2950a [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 215a40d9cebb42d9906c6e4616e2950a, State: Running, Role: LEADER
I20260709 13:17:59.964746  6250 consensus_queue.cc:260] T c7cfe05c9c2f47f487fbf3b81a0a47ca P 215a40d9cebb42d9906c6e4616e2950a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "215a40d9cebb42d9906c6e4616e2950a" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 40171 } } peers { permanent_uuid: "b7aed7f4e45b499992f30b4cf32b8961" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 33867 } } peers { permanent_uuid: "4efd9e6155f94224952be95c3785290e" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 46051 } }
I20260709 13:17:59.966120  6250 raft_consensus.cc:3060] T c7cfe05c9c2f47f487fbf3b81a0a47ca P 215a40d9cebb42d9906c6e4616e2950a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:59.971278  6397 raft_consensus.cc:2468] T c7cfe05c9c2f47f487fbf3b81a0a47ca P 4efd9e6155f94224952be95c3785290e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7aed7f4e45b499992f30b4cf32b8961 in term 3.
I20260709 13:17:59.972692  6250 raft_consensus.cc:2468] T c7cfe05c9c2f47f487fbf3b81a0a47ca P 215a40d9cebb42d9906c6e4616e2950a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7aed7f4e45b499992f30b4cf32b8961 in term 3.
I20260709 13:17:59.973038  6288 leader_election.cc:304] T c7cfe05c9c2f47f487fbf3b81a0a47ca P b7aed7f4e45b499992f30b4cf32b8961 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4efd9e6155f94224952be95c3785290e, b7aed7f4e45b499992f30b4cf32b8961; no voters: 
I20260709 13:17:59.974330  6555 raft_consensus.cc:2804] T c7cfe05c9c2f47f487fbf3b81a0a47ca P b7aed7f4e45b499992f30b4cf32b8961 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:17:59.974956  6555 raft_consensus.cc:697] T c7cfe05c9c2f47f487fbf3b81a0a47ca P b7aed7f4e45b499992f30b4cf32b8961 [term 3 LEADER]: Becoming Leader. State: Replica: b7aed7f4e45b499992f30b4cf32b8961, State: Running, Role: LEADER
I20260709 13:17:59.975886  6555 consensus_queue.cc:237] T c7cfe05c9c2f47f487fbf3b81a0a47ca P b7aed7f4e45b499992f30b4cf32b8961 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "215a40d9cebb42d9906c6e4616e2950a" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 40171 } } peers { permanent_uuid: "b7aed7f4e45b499992f30b4cf32b8961" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 33867 } } peers { permanent_uuid: "4efd9e6155f94224952be95c3785290e" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 46051 } }
I20260709 13:17:59.984599  6147 catalog_manager.cc:5697] T c7cfe05c9c2f47f487fbf3b81a0a47ca P b7aed7f4e45b499992f30b4cf32b8961 reported cstate change: term changed from 2 to 3, leader changed from 215a40d9cebb42d9906c6e4616e2950a (127.5.126.65) to b7aed7f4e45b499992f30b4cf32b8961 (127.5.126.66). New cstate: current_term: 3 leader_uuid: "b7aed7f4e45b499992f30b4cf32b8961" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "215a40d9cebb42d9906c6e4616e2950a" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 40171 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b7aed7f4e45b499992f30b4cf32b8961" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 33867 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4efd9e6155f94224952be95c3785290e" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 46051 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:00.143599  6577 raft_consensus.cc:993] T ee893b0b66474d44baaeba294d249e32 P 215a40d9cebb42d9906c6e4616e2950a: : Instructing follower 4efd9e6155f94224952be95c3785290e to start an election
I20260709 13:18:00.144264  6565 raft_consensus.cc:1081] T ee893b0b66474d44baaeba294d249e32 P 215a40d9cebb42d9906c6e4616e2950a [term 2 LEADER]: Signalling peer 4efd9e6155f94224952be95c3785290e to start an election
I20260709 13:18:00.145922  6397 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ee893b0b66474d44baaeba294d249e32"
dest_uuid: "4efd9e6155f94224952be95c3785290e"
 from {username='slave'} at 127.0.0.1:33268
I20260709 13:18:00.146647  6397 raft_consensus.cc:493] T ee893b0b66474d44baaeba294d249e32 P 4efd9e6155f94224952be95c3785290e [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:18:00.147054  6397 raft_consensus.cc:3060] T ee893b0b66474d44baaeba294d249e32 P 4efd9e6155f94224952be95c3785290e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:00.152500  6397 raft_consensus.cc:515] T ee893b0b66474d44baaeba294d249e32 P 4efd9e6155f94224952be95c3785290e [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "215a40d9cebb42d9906c6e4616e2950a" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 40171 } } peers { permanent_uuid: "b7aed7f4e45b499992f30b4cf32b8961" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 33867 } } peers { permanent_uuid: "4efd9e6155f94224952be95c3785290e" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 46051 } }
I20260709 13:18:00.154266  6397 leader_election.cc:290] T ee893b0b66474d44baaeba294d249e32 P 4efd9e6155f94224952be95c3785290e [CANDIDATE]: Term 3 election: Requested vote from peers 215a40d9cebb42d9906c6e4616e2950a (127.5.126.65:40171), b7aed7f4e45b499992f30b4cf32b8961 (127.5.126.66:33867)
I20260709 13:18:00.155468  6250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee893b0b66474d44baaeba294d249e32" candidate_uuid: "4efd9e6155f94224952be95c3785290e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "215a40d9cebb42d9906c6e4616e2950a"
I20260709 13:18:00.155489  6325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee893b0b66474d44baaeba294d249e32" candidate_uuid: "4efd9e6155f94224952be95c3785290e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "b7aed7f4e45b499992f30b4cf32b8961"
I20260709 13:18:00.156013  6250 raft_consensus.cc:3055] T ee893b0b66474d44baaeba294d249e32 P 215a40d9cebb42d9906c6e4616e2950a [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:18:00.156227  6325 raft_consensus.cc:3060] T ee893b0b66474d44baaeba294d249e32 P b7aed7f4e45b499992f30b4cf32b8961 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:00.156368  6250 raft_consensus.cc:740] T ee893b0b66474d44baaeba294d249e32 P 215a40d9cebb42d9906c6e4616e2950a [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 215a40d9cebb42d9906c6e4616e2950a, State: Running, Role: LEADER
I20260709 13:18:00.157370  6250 consensus_queue.cc:260] T ee893b0b66474d44baaeba294d249e32 P 215a40d9cebb42d9906c6e4616e2950a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "215a40d9cebb42d9906c6e4616e2950a" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 40171 } } peers { permanent_uuid: "b7aed7f4e45b499992f30b4cf32b8961" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 33867 } } peers { permanent_uuid: "4efd9e6155f94224952be95c3785290e" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 46051 } }
I20260709 13:18:00.158314  6250 raft_consensus.cc:3060] T ee893b0b66474d44baaeba294d249e32 P 215a40d9cebb42d9906c6e4616e2950a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:00.161438  6325 raft_consensus.cc:2468] T ee893b0b66474d44baaeba294d249e32 P b7aed7f4e45b499992f30b4cf32b8961 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4efd9e6155f94224952be95c3785290e in term 3.
I20260709 13:18:00.162597  6362 leader_election.cc:304] T ee893b0b66474d44baaeba294d249e32 P 4efd9e6155f94224952be95c3785290e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4efd9e6155f94224952be95c3785290e, b7aed7f4e45b499992f30b4cf32b8961; no voters: 
I20260709 13:18:00.163237  6250 raft_consensus.cc:2468] T ee893b0b66474d44baaeba294d249e32 P 215a40d9cebb42d9906c6e4616e2950a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4efd9e6155f94224952be95c3785290e in term 3.
I20260709 13:18:00.163380  6576 raft_consensus.cc:2804] T ee893b0b66474d44baaeba294d249e32 P 4efd9e6155f94224952be95c3785290e [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:18:00.163863  6576 raft_consensus.cc:697] T ee893b0b66474d44baaeba294d249e32 P 4efd9e6155f94224952be95c3785290e [term 3 LEADER]: Becoming Leader. State: Replica: 4efd9e6155f94224952be95c3785290e, State: Running, Role: LEADER
I20260709 13:18:00.164846  6576 consensus_queue.cc:237] T ee893b0b66474d44baaeba294d249e32 P 4efd9e6155f94224952be95c3785290e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "215a40d9cebb42d9906c6e4616e2950a" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 40171 } } peers { permanent_uuid: "b7aed7f4e45b499992f30b4cf32b8961" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 33867 } } peers { permanent_uuid: "4efd9e6155f94224952be95c3785290e" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 46051 } }
I20260709 13:18:00.174028  6147 catalog_manager.cc:5697] T ee893b0b66474d44baaeba294d249e32 P 4efd9e6155f94224952be95c3785290e reported cstate change: term changed from 2 to 3, leader changed from 215a40d9cebb42d9906c6e4616e2950a (127.5.126.65) to 4efd9e6155f94224952be95c3785290e (127.5.126.67). New cstate: current_term: 3 leader_uuid: "4efd9e6155f94224952be95c3785290e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "215a40d9cebb42d9906c6e4616e2950a" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 40171 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b7aed7f4e45b499992f30b4cf32b8961" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 33867 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4efd9e6155f94224952be95c3785290e" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 46051 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:00.220335  6397 raft_consensus.cc:1275] T d51e67b3ea6a458c818b4c7cf67ceef5 P 4efd9e6155f94224952be95c3785290e [term 4 FOLLOWER]: Refusing update from remote peer b7aed7f4e45b499992f30b4cf32b8961: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:18:00.221542  6555 consensus_queue.cc:1048] T d51e67b3ea6a458c818b4c7cf67ceef5 P b7aed7f4e45b499992f30b4cf32b8961 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4efd9e6155f94224952be95c3785290e" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 46051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:18:00.231647  6250 raft_consensus.cc:1275] T d51e67b3ea6a458c818b4c7cf67ceef5 P 215a40d9cebb42d9906c6e4616e2950a [term 4 FOLLOWER]: Refusing update from remote peer b7aed7f4e45b499992f30b4cf32b8961: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:18:00.233489  6555 consensus_queue.cc:1048] T d51e67b3ea6a458c818b4c7cf67ceef5 P b7aed7f4e45b499992f30b4cf32b8961 [LEADER]: Connected to new peer: Peer: permanent_uuid: "215a40d9cebb42d9906c6e4616e2950a" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 40171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:18:00.450007  6397 raft_consensus.cc:1275] T c7cfe05c9c2f47f487fbf3b81a0a47ca P 4efd9e6155f94224952be95c3785290e [term 3 FOLLOWER]: Refusing update from remote peer b7aed7f4e45b499992f30b4cf32b8961: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:18:00.451297  6555 consensus_queue.cc:1048] T c7cfe05c9c2f47f487fbf3b81a0a47ca P b7aed7f4e45b499992f30b4cf32b8961 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4efd9e6155f94224952be95c3785290e" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 46051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:18:00.460034  6325 raft_consensus.cc:1275] T 82ccb3ed51b2453381692135f3179a54 P b7aed7f4e45b499992f30b4cf32b8961 [term 5 FOLLOWER]: Refusing update from remote peer 4efd9e6155f94224952be95c3785290e: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:18:00.463308  6250 raft_consensus.cc:1275] T c7cfe05c9c2f47f487fbf3b81a0a47ca P 215a40d9cebb42d9906c6e4616e2950a [term 3 FOLLOWER]: Refusing update from remote peer b7aed7f4e45b499992f30b4cf32b8961: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:18:00.468400  6584 consensus_queue.cc:1048] T 82ccb3ed51b2453381692135f3179a54 P 4efd9e6155f94224952be95c3785290e [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7aed7f4e45b499992f30b4cf32b8961" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 33867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:18:00.470836  6250 raft_consensus.cc:1275] T 82ccb3ed51b2453381692135f3179a54 P 215a40d9cebb42d9906c6e4616e2950a [term 5 FOLLOWER]: Refusing update from remote peer 4efd9e6155f94224952be95c3785290e: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:18:00.473673  6576 consensus_queue.cc:1048] T 82ccb3ed51b2453381692135f3179a54 P 4efd9e6155f94224952be95c3785290e [LEADER]: Connected to new peer: Peer: permanent_uuid: "215a40d9cebb42d9906c6e4616e2950a" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 40171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:18:00.473963  6595 consensus_queue.cc:1048] T c7cfe05c9c2f47f487fbf3b81a0a47ca P b7aed7f4e45b499992f30b4cf32b8961 [LEADER]: Connected to new peer: Peer: permanent_uuid: "215a40d9cebb42d9906c6e4616e2950a" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 40171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:18:00.655506  5625 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:18:00.661972  5625 tablet_server.cc:179] TabletServer@127.5.126.65:0 shutting down...
W20260709 13:18:00.694670  6365 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 5 similar messages]
W20260709 13:18:00.701670  6365 consensus_peers.cc:597] T ee893b0b66474d44baaeba294d249e32 P 4efd9e6155f94224952be95c3785290e -> Peer 215a40d9cebb42d9906c6e4616e2950a (127.5.126.65:40171): Couldn't send request to peer 215a40d9cebb42d9906c6e4616e2950a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:00.701759  5625 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:18:00.702741  5625 tablet_replica.cc:333] T ec94c2acba4a4333a9db46ab77cd9781 P 215a40d9cebb42d9906c6e4616e2950a: stopping tablet replica
I20260709 13:18:00.703598  5625 raft_consensus.cc:2243] T ec94c2acba4a4333a9db46ab77cd9781 P 215a40d9cebb42d9906c6e4616e2950a [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:18:00.704548  5625 raft_consensus.cc:2272] T ec94c2acba4a4333a9db46ab77cd9781 P 215a40d9cebb42d9906c6e4616e2950a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:00.706724  5625 tablet_replica.cc:333] T ee893b0b66474d44baaeba294d249e32 P 215a40d9cebb42d9906c6e4616e2950a: stopping tablet replica
I20260709 13:18:00.707335  5625 raft_consensus.cc:2243] T ee893b0b66474d44baaeba294d249e32 P 215a40d9cebb42d9906c6e4616e2950a [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:00.707688  5625 raft_consensus.cc:2272] T ee893b0b66474d44baaeba294d249e32 P 215a40d9cebb42d9906c6e4616e2950a [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:00.709484  5625 tablet_replica.cc:333] T 87b6f7d6ab0742c0a8247c7bc6cbe4eb P 215a40d9cebb42d9906c6e4616e2950a: stopping tablet replica
I20260709 13:18:00.710026  5625 raft_consensus.cc:2243] T 87b6f7d6ab0742c0a8247c7bc6cbe4eb P 215a40d9cebb42d9906c6e4616e2950a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:00.710553  5625 raft_consensus.cc:2272] T 87b6f7d6ab0742c0a8247c7bc6cbe4eb P 215a40d9cebb42d9906c6e4616e2950a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:00.712656  5625 tablet_replica.cc:333] T e17475c1ea464d1f84e7f36957761cd9 P 215a40d9cebb42d9906c6e4616e2950a: stopping tablet replica
I20260709 13:18:00.713572  5625 raft_consensus.cc:2243] T e17475c1ea464d1f84e7f36957761cd9 P 215a40d9cebb42d9906c6e4616e2950a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:00.714038  5625 raft_consensus.cc:2272] T e17475c1ea464d1f84e7f36957761cd9 P 215a40d9cebb42d9906c6e4616e2950a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:00.715840  5625 tablet_replica.cc:333] T 199b09cd4e0d433fafb2e8d5006d113d P 215a40d9cebb42d9906c6e4616e2950a: stopping tablet replica
I20260709 13:18:00.716439  5625 raft_consensus.cc:2243] T 199b09cd4e0d433fafb2e8d5006d113d P 215a40d9cebb42d9906c6e4616e2950a [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:18:00.717296  5625 raft_consensus.cc:2272] T 199b09cd4e0d433fafb2e8d5006d113d P 215a40d9cebb42d9906c6e4616e2950a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:00.719166  5625 tablet_replica.cc:333] T 879fa203410744a9a1a63d33e0801f07 P 215a40d9cebb42d9906c6e4616e2950a: stopping tablet replica
I20260709 13:18:00.719707  5625 raft_consensus.cc:2243] T 879fa203410744a9a1a63d33e0801f07 P 215a40d9cebb42d9906c6e4616e2950a [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:18:00.720592  5625 raft_consensus.cc:2272] T 879fa203410744a9a1a63d33e0801f07 P 215a40d9cebb42d9906c6e4616e2950a [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:00.722501  5625 tablet_replica.cc:333] T d51e67b3ea6a458c818b4c7cf67ceef5 P 215a40d9cebb42d9906c6e4616e2950a: stopping tablet replica
I20260709 13:18:00.723022  5625 raft_consensus.cc:2243] T d51e67b3ea6a458c818b4c7cf67ceef5 P 215a40d9cebb42d9906c6e4616e2950a [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:00.723630  5625 raft_consensus.cc:2272] T d51e67b3ea6a458c818b4c7cf67ceef5 P 215a40d9cebb42d9906c6e4616e2950a [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:00.726238  5625 tablet_replica.cc:333] T c7cfe05c9c2f47f487fbf3b81a0a47ca P 215a40d9cebb42d9906c6e4616e2950a: stopping tablet replica
I20260709 13:18:00.726975  5625 raft_consensus.cc:2243] T c7cfe05c9c2f47f487fbf3b81a0a47ca P 215a40d9cebb42d9906c6e4616e2950a [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:00.727487  5625 raft_consensus.cc:2272] T c7cfe05c9c2f47f487fbf3b81a0a47ca P 215a40d9cebb42d9906c6e4616e2950a [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:00.730865  5625 tablet_replica.cc:333] T 82ccb3ed51b2453381692135f3179a54 P 215a40d9cebb42d9906c6e4616e2950a: stopping tablet replica
I20260709 13:18:00.731559  5625 raft_consensus.cc:2243] T 82ccb3ed51b2453381692135f3179a54 P 215a40d9cebb42d9906c6e4616e2950a [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:00.732187  5625 raft_consensus.cc:2272] T 82ccb3ed51b2453381692135f3179a54 P 215a40d9cebb42d9906c6e4616e2950a [term 5 FOLLOWER]: Raft consensus is shut down!
W20260709 13:18:00.733072  6291 consensus_peers.cc:597] T e17475c1ea464d1f84e7f36957761cd9 P b7aed7f4e45b499992f30b4cf32b8961 -> Peer 215a40d9cebb42d9906c6e4616e2950a (127.5.126.65:40171): Couldn't send request to peer 215a40d9cebb42d9906c6e4616e2950a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:00.734787  5625 tablet_replica.cc:333] T de207f715322422ba6c06aa6b5ade0fa P 215a40d9cebb42d9906c6e4616e2950a: stopping tablet replica
I20260709 13:18:00.735345  5625 raft_consensus.cc:2243] T de207f715322422ba6c06aa6b5ade0fa P 215a40d9cebb42d9906c6e4616e2950a [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:18:00.736284  5625 raft_consensus.cc:2272] T de207f715322422ba6c06aa6b5ade0fa P 215a40d9cebb42d9906c6e4616e2950a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:00.769834  6325 raft_consensus.cc:1275] T ee893b0b66474d44baaeba294d249e32 P b7aed7f4e45b499992f30b4cf32b8961 [term 3 FOLLOWER]: Refusing update from remote peer 4efd9e6155f94224952be95c3785290e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:18:00.771394  6596 consensus_queue.cc:1048] T ee893b0b66474d44baaeba294d249e32 P 4efd9e6155f94224952be95c3785290e [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7aed7f4e45b499992f30b4cf32b8961" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 33867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:18:00.772213  5625 tablet_server.cc:196] TabletServer@127.5.126.65:0 shutdown complete.
W20260709 13:18:00.794868  6365 consensus_peers.cc:597] T 87b6f7d6ab0742c0a8247c7bc6cbe4eb P 4efd9e6155f94224952be95c3785290e -> Peer 215a40d9cebb42d9906c6e4616e2950a (127.5.126.65:40171): Couldn't send request to peer 215a40d9cebb42d9906c6e4616e2950a. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:40171: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:00.805605  5625 tablet_server.cc:179] TabletServer@127.5.126.66:0 shutting down...
I20260709 13:18:00.836515  5625 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:18:00.837239  5625 tablet_replica.cc:333] T e17475c1ea464d1f84e7f36957761cd9 P b7aed7f4e45b499992f30b4cf32b8961: stopping tablet replica
I20260709 13:18:00.838126  5625 raft_consensus.cc:2243] T e17475c1ea464d1f84e7f36957761cd9 P b7aed7f4e45b499992f30b4cf32b8961 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:18:00.839061  5625 raft_consensus.cc:2272] T e17475c1ea464d1f84e7f36957761cd9 P b7aed7f4e45b499992f30b4cf32b8961 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:00.841185  5625 tablet_replica.cc:333] T 87b6f7d6ab0742c0a8247c7bc6cbe4eb P b7aed7f4e45b499992f30b4cf32b8961: stopping tablet replica
I20260709 13:18:00.841775  5625 raft_consensus.cc:2243] T 87b6f7d6ab0742c0a8247c7bc6cbe4eb P b7aed7f4e45b499992f30b4cf32b8961 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:00.842222  5625 raft_consensus.cc:2272] T 87b6f7d6ab0742c0a8247c7bc6cbe4eb P b7aed7f4e45b499992f30b4cf32b8961 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:00.844303  5625 tablet_replica.cc:333] T c7cfe05c9c2f47f487fbf3b81a0a47ca P b7aed7f4e45b499992f30b4cf32b8961: stopping tablet replica
I20260709 13:18:00.844973  5625 raft_consensus.cc:2243] T c7cfe05c9c2f47f487fbf3b81a0a47ca P b7aed7f4e45b499992f30b4cf32b8961 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:18:00.845798  5625 raft_consensus.cc:2272] T c7cfe05c9c2f47f487fbf3b81a0a47ca P b7aed7f4e45b499992f30b4cf32b8961 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:00.847954  5625 tablet_replica.cc:333] T d51e67b3ea6a458c818b4c7cf67ceef5 P b7aed7f4e45b499992f30b4cf32b8961: stopping tablet replica
I20260709 13:18:00.848587  5625 raft_consensus.cc:2243] T d51e67b3ea6a458c818b4c7cf67ceef5 P b7aed7f4e45b499992f30b4cf32b8961 [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:18:00.849334  5625 raft_consensus.cc:2272] T d51e67b3ea6a458c818b4c7cf67ceef5 P b7aed7f4e45b499992f30b4cf32b8961 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:00.851349  5625 tablet_replica.cc:333] T 879fa203410744a9a1a63d33e0801f07 P b7aed7f4e45b499992f30b4cf32b8961: stopping tablet replica
I20260709 13:18:00.851883  5625 raft_consensus.cc:2243] T 879fa203410744a9a1a63d33e0801f07 P b7aed7f4e45b499992f30b4cf32b8961 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:00.852401  5625 raft_consensus.cc:2272] T 879fa203410744a9a1a63d33e0801f07 P b7aed7f4e45b499992f30b4cf32b8961 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:00.854068  5625 tablet_replica.cc:333] T 199b09cd4e0d433fafb2e8d5006d113d P b7aed7f4e45b499992f30b4cf32b8961: stopping tablet replica
I20260709 13:18:00.854614  5625 raft_consensus.cc:2243] T 199b09cd4e0d433fafb2e8d5006d113d P b7aed7f4e45b499992f30b4cf32b8961 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:00.855005  5625 raft_consensus.cc:2272] T 199b09cd4e0d433fafb2e8d5006d113d P b7aed7f4e45b499992f30b4cf32b8961 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:00.857292  5625 tablet_replica.cc:333] T ee893b0b66474d44baaeba294d249e32 P b7aed7f4e45b499992f30b4cf32b8961: stopping tablet replica
I20260709 13:18:00.858208  5625 raft_consensus.cc:2243] T ee893b0b66474d44baaeba294d249e32 P b7aed7f4e45b499992f30b4cf32b8961 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:00.858671  5625 raft_consensus.cc:2272] T ee893b0b66474d44baaeba294d249e32 P b7aed7f4e45b499992f30b4cf32b8961 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:00.861848  5625 tablet_replica.cc:333] T 82ccb3ed51b2453381692135f3179a54 P b7aed7f4e45b499992f30b4cf32b8961: stopping tablet replica
I20260709 13:18:00.862350  5625 raft_consensus.cc:2243] T 82ccb3ed51b2453381692135f3179a54 P b7aed7f4e45b499992f30b4cf32b8961 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:00.862900  5625 raft_consensus.cc:2272] T 82ccb3ed51b2453381692135f3179a54 P b7aed7f4e45b499992f30b4cf32b8961 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:00.865659  5625 tablet_replica.cc:333] T de207f715322422ba6c06aa6b5ade0fa P b7aed7f4e45b499992f30b4cf32b8961: stopping tablet replica
I20260709 13:18:00.866415  5625 raft_consensus.cc:2243] T de207f715322422ba6c06aa6b5ade0fa P b7aed7f4e45b499992f30b4cf32b8961 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:00.867004  5625 raft_consensus.cc:2272] T de207f715322422ba6c06aa6b5ade0fa P b7aed7f4e45b499992f30b4cf32b8961 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:00.868899  5625 tablet_replica.cc:333] T ec94c2acba4a4333a9db46ab77cd9781 P b7aed7f4e45b499992f30b4cf32b8961: stopping tablet replica
I20260709 13:18:00.869417  5625 raft_consensus.cc:2243] T ec94c2acba4a4333a9db46ab77cd9781 P b7aed7f4e45b499992f30b4cf32b8961 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:00.869838  5625 raft_consensus.cc:2272] T ec94c2acba4a4333a9db46ab77cd9781 P b7aed7f4e45b499992f30b4cf32b8961 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:18:00.887204  6362 consensus_peers.cc:597] T 87b6f7d6ab0742c0a8247c7bc6cbe4eb P 4efd9e6155f94224952be95c3785290e -> Peer b7aed7f4e45b499992f30b4cf32b8961 (127.5.126.66:33867): Couldn't send request to peer b7aed7f4e45b499992f30b4cf32b8961. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.66:33867: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:00.902694  5625 tablet_server.cc:196] TabletServer@127.5.126.66:0 shutdown complete.
I20260709 13:18:00.923974  5625 tablet_server.cc:179] TabletServer@127.5.126.67:0 shutting down...
W20260709 13:18:00.937971  6365 consensus_peers.cc:597] T 82ccb3ed51b2453381692135f3179a54 P 4efd9e6155f94224952be95c3785290e -> Peer 215a40d9cebb42d9906c6e4616e2950a (127.5.126.65:40171): Couldn't send request to peer 215a40d9cebb42d9906c6e4616e2950a. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:40171: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:00.962903  5625 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:18:00.963814  5625 tablet_replica.cc:333] T 87b6f7d6ab0742c0a8247c7bc6cbe4eb P 4efd9e6155f94224952be95c3785290e: stopping tablet replica
I20260709 13:18:00.964993  5625 raft_consensus.cc:2243] T 87b6f7d6ab0742c0a8247c7bc6cbe4eb P 4efd9e6155f94224952be95c3785290e [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:18:00.966677  5625 raft_consensus.cc:2272] T 87b6f7d6ab0742c0a8247c7bc6cbe4eb P 4efd9e6155f94224952be95c3785290e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:00.969676  5625 tablet_replica.cc:333] T e17475c1ea464d1f84e7f36957761cd9 P 4efd9e6155f94224952be95c3785290e: stopping tablet replica
W20260709 13:18:00.970108  6362 consensus_peers.cc:597] T 82ccb3ed51b2453381692135f3179a54 P 4efd9e6155f94224952be95c3785290e -> Peer b7aed7f4e45b499992f30b4cf32b8961 (127.5.126.66:33867): Couldn't send request to peer b7aed7f4e45b499992f30b4cf32b8961. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.66:33867: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:00.970332  5625 raft_consensus.cc:2243] T e17475c1ea464d1f84e7f36957761cd9 P 4efd9e6155f94224952be95c3785290e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:00.970975  5625 raft_consensus.cc:2272] T e17475c1ea464d1f84e7f36957761cd9 P 4efd9e6155f94224952be95c3785290e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:00.973345  5625 tablet_replica.cc:333] T c7cfe05c9c2f47f487fbf3b81a0a47ca P 4efd9e6155f94224952be95c3785290e: stopping tablet replica
I20260709 13:18:00.973878  5625 raft_consensus.cc:2243] T c7cfe05c9c2f47f487fbf3b81a0a47ca P 4efd9e6155f94224952be95c3785290e [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:00.974331  5625 raft_consensus.cc:2272] T c7cfe05c9c2f47f487fbf3b81a0a47ca P 4efd9e6155f94224952be95c3785290e [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:00.977991  5625 tablet_replica.cc:333] T d51e67b3ea6a458c818b4c7cf67ceef5 P 4efd9e6155f94224952be95c3785290e: stopping tablet replica
I20260709 13:18:00.978576  5625 raft_consensus.cc:2243] T d51e67b3ea6a458c818b4c7cf67ceef5 P 4efd9e6155f94224952be95c3785290e [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:00.979244  5625 raft_consensus.cc:2272] T d51e67b3ea6a458c818b4c7cf67ceef5 P 4efd9e6155f94224952be95c3785290e [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:00.982702  5625 tablet_replica.cc:333] T ee893b0b66474d44baaeba294d249e32 P 4efd9e6155f94224952be95c3785290e: stopping tablet replica
I20260709 13:18:00.983299  5625 raft_consensus.cc:2243] T ee893b0b66474d44baaeba294d249e32 P 4efd9e6155f94224952be95c3785290e [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:18:00.984179  5625 raft_consensus.cc:2272] T ee893b0b66474d44baaeba294d249e32 P 4efd9e6155f94224952be95c3785290e [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:00.986418  5625 tablet_replica.cc:333] T de207f715322422ba6c06aa6b5ade0fa P 4efd9e6155f94224952be95c3785290e: stopping tablet replica
I20260709 13:18:00.987098  5625 raft_consensus.cc:2243] T de207f715322422ba6c06aa6b5ade0fa P 4efd9e6155f94224952be95c3785290e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:00.987614  5625 raft_consensus.cc:2272] T de207f715322422ba6c06aa6b5ade0fa P 4efd9e6155f94224952be95c3785290e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:00.989717  5625 tablet_replica.cc:333] T 82ccb3ed51b2453381692135f3179a54 P 4efd9e6155f94224952be95c3785290e: stopping tablet replica
I20260709 13:18:00.990417  5625 raft_consensus.cc:2243] T 82ccb3ed51b2453381692135f3179a54 P 4efd9e6155f94224952be95c3785290e [term 5 LEADER]: Raft consensus shutting down.
I20260709 13:18:00.991264  5625 raft_consensus.cc:2272] T 82ccb3ed51b2453381692135f3179a54 P 4efd9e6155f94224952be95c3785290e [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:00.994426  5625 tablet_replica.cc:333] T ec94c2acba4a4333a9db46ab77cd9781 P 4efd9e6155f94224952be95c3785290e: stopping tablet replica
I20260709 13:18:00.995342  5625 raft_consensus.cc:2243] T ec94c2acba4a4333a9db46ab77cd9781 P 4efd9e6155f94224952be95c3785290e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:00.996192  5625 raft_consensus.cc:2272] T ec94c2acba4a4333a9db46ab77cd9781 P 4efd9e6155f94224952be95c3785290e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:00.998431  5625 tablet_replica.cc:333] T 879fa203410744a9a1a63d33e0801f07 P 4efd9e6155f94224952be95c3785290e: stopping tablet replica
I20260709 13:18:00.998971  5625 raft_consensus.cc:2243] T 879fa203410744a9a1a63d33e0801f07 P 4efd9e6155f94224952be95c3785290e [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:00.999450  5625 raft_consensus.cc:2272] T 879fa203410744a9a1a63d33e0801f07 P 4efd9e6155f94224952be95c3785290e [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:01.001139  5625 tablet_replica.cc:333] T 199b09cd4e0d433fafb2e8d5006d113d P 4efd9e6155f94224952be95c3785290e: stopping tablet replica
I20260709 13:18:01.001686  5625 raft_consensus.cc:2243] T 199b09cd4e0d433fafb2e8d5006d113d P 4efd9e6155f94224952be95c3785290e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:01.002130  5625 raft_consensus.cc:2272] T 199b09cd4e0d433fafb2e8d5006d113d P 4efd9e6155f94224952be95c3785290e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:01.027072  5625 tablet_server.cc:196] TabletServer@127.5.126.67:0 shutdown complete.
I20260709 13:18:01.051164  5625 master.cc:562] Master@127.5.126.126:40217 shutting down...
I20260709 13:18:01.079612  5625 raft_consensus.cc:2243] T 00000000000000000000000000000000 P cf082d3633e541b0a009b7d385b8b005 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:18:01.080263  5625 raft_consensus.cc:2272] T 00000000000000000000000000000000 P cf082d3633e541b0a009b7d385b8b005 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:01.080642  5625 tablet_replica.cc:333] T 00000000000000000000000000000000 P cf082d3633e541b0a009b7d385b8b005: stopping tablet replica
I20260709 13:18:01.106115  5625 master.cc:584] Master@127.5.126.126:40217 shutdown complete.
215a40d9cebb42d9906c6e4616e2950a  5
4efd9e6155f94224952be95c3785290e  1
b7aed7f4e45b499992f30b4cf32b8961  4
[       OK ] LeaderRebalancerTest.FunctionalTestForNotDivided (10860 ms)
[ RUN      ] LeaderRebalancerTest.AddTserver
I20260709 13:18:01.154584  5625 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.5.126.126:34367
I20260709 13:18:01.155787  5625 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:18:01.163919  6605 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:18:01.164477  6606 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:18:01.165522  6608 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:18:01.165915  5625 server_base.cc:1061] running on GCE node
I20260709 13:18:01.166875  5625 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:18:01.167088  5625 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:18:01.167255  5625 hybrid_clock.cc:648] HybridClock initialized: now 1783603081167237 us; error 0 us; skew 500 ppm
I20260709 13:18:01.167840  5625 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:18:01.171305  5625 webserver.cc:533] Webserver started at http://127.5.126.126:34733/ using document root <none> and password file <none>
I20260709 13:18:01.172019  5625 fs_manager.cc:362] Metadata directory not provided
I20260709 13:18:01.172307  5625 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:18:01.173568  5625 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:18:01.175940  5625 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskWHb0CB/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783603057096655-5625-0/minicluster-data/master-0-root/instance:
uuid: "b3ae52d33b9a4273a42e5e2cf3b5d6b5"
format_stamp: "Formatted at 2026-07-09 13:18:01 on dist-test-slave-smzk"
I20260709 13:18:01.182054  5625 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:18:01.186873  6613 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:18:01.188131  5625 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.002s	sys 0.000s
I20260709 13:18:01.188460  5625 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskWHb0CB/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783603057096655-5625-0/minicluster-data/master-0-root
uuid: "b3ae52d33b9a4273a42e5e2cf3b5d6b5"
format_stamp: "Formatted at 2026-07-09 13:18:01 on dist-test-slave-smzk"
I20260709 13:18:01.188773  5625 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWHb0CB/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783603057096655-5625-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskWHb0CB/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783603057096655-5625-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskWHb0CB/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783603057096655-5625-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:18:01.219137  5625 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:18:01.221402  5625 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:18:01.300251  5625 rpc_server.cc:307] RPC server started. Bound to: 127.5.126.126:34367
I20260709 13:18:01.300370  6664 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.5.126.126:34367 every 8 connection(s)
I20260709 13:18:01.306066  6665 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:01.317046  6665 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b3ae52d33b9a4273a42e5e2cf3b5d6b5: Bootstrap starting.
I20260709 13:18:01.322036  6665 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P b3ae52d33b9a4273a42e5e2cf3b5d6b5: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:01.326954  6665 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b3ae52d33b9a4273a42e5e2cf3b5d6b5: No bootstrap required, opened a new log
I20260709 13:18:01.329509  6665 raft_consensus.cc:359] T 00000000000000000000000000000000 P b3ae52d33b9a4273a42e5e2cf3b5d6b5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b3ae52d33b9a4273a42e5e2cf3b5d6b5" member_type: VOTER }
I20260709 13:18:01.329937  6665 raft_consensus.cc:385] T 00000000000000000000000000000000 P b3ae52d33b9a4273a42e5e2cf3b5d6b5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:01.330438  6665 raft_consensus.cc:740] T 00000000000000000000000000000000 P b3ae52d33b9a4273a42e5e2cf3b5d6b5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b3ae52d33b9a4273a42e5e2cf3b5d6b5, State: Initialized, Role: FOLLOWER
I20260709 13:18:01.331185  6665 consensus_queue.cc:260] T 00000000000000000000000000000000 P b3ae52d33b9a4273a42e5e2cf3b5d6b5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b3ae52d33b9a4273a42e5e2cf3b5d6b5" member_type: VOTER }
I20260709 13:18:01.331750  6665 raft_consensus.cc:399] T 00000000000000000000000000000000 P b3ae52d33b9a4273a42e5e2cf3b5d6b5 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:18:01.332001  6665 raft_consensus.cc:493] T 00000000000000000000000000000000 P b3ae52d33b9a4273a42e5e2cf3b5d6b5 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:18:01.332396  6665 raft_consensus.cc:3060] T 00000000000000000000000000000000 P b3ae52d33b9a4273a42e5e2cf3b5d6b5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:01.337783  6665 raft_consensus.cc:515] T 00000000000000000000000000000000 P b3ae52d33b9a4273a42e5e2cf3b5d6b5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b3ae52d33b9a4273a42e5e2cf3b5d6b5" member_type: VOTER }
I20260709 13:18:01.338614  6665 leader_election.cc:304] T 00000000000000000000000000000000 P b3ae52d33b9a4273a42e5e2cf3b5d6b5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: b3ae52d33b9a4273a42e5e2cf3b5d6b5; no voters: 
I20260709 13:18:01.340368  6665 leader_election.cc:290] T 00000000000000000000000000000000 P b3ae52d33b9a4273a42e5e2cf3b5d6b5 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:18:01.341183  6668 raft_consensus.cc:2804] T 00000000000000000000000000000000 P b3ae52d33b9a4273a42e5e2cf3b5d6b5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:18:01.342983  6668 raft_consensus.cc:697] T 00000000000000000000000000000000 P b3ae52d33b9a4273a42e5e2cf3b5d6b5 [term 1 LEADER]: Becoming Leader. State: Replica: b3ae52d33b9a4273a42e5e2cf3b5d6b5, State: Running, Role: LEADER
I20260709 13:18:01.343765  6668 consensus_queue.cc:237] T 00000000000000000000000000000000 P b3ae52d33b9a4273a42e5e2cf3b5d6b5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b3ae52d33b9a4273a42e5e2cf3b5d6b5" member_type: VOTER }
I20260709 13:18:01.344192  6665 sys_catalog.cc:565] T 00000000000000000000000000000000 P b3ae52d33b9a4273a42e5e2cf3b5d6b5 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:18:01.350481  6669 sys_catalog.cc:455] T 00000000000000000000000000000000 P b3ae52d33b9a4273a42e5e2cf3b5d6b5 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "b3ae52d33b9a4273a42e5e2cf3b5d6b5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b3ae52d33b9a4273a42e5e2cf3b5d6b5" member_type: VOTER } }
I20260709 13:18:01.351243  6669 sys_catalog.cc:458] T 00000000000000000000000000000000 P b3ae52d33b9a4273a42e5e2cf3b5d6b5 [sys.catalog]: This master's current role is: LEADER
I20260709 13:18:01.352200  6670 sys_catalog.cc:455] T 00000000000000000000000000000000 P b3ae52d33b9a4273a42e5e2cf3b5d6b5 [sys.catalog]: SysCatalogTable state changed. Reason: New leader b3ae52d33b9a4273a42e5e2cf3b5d6b5. Latest consensus state: current_term: 1 leader_uuid: "b3ae52d33b9a4273a42e5e2cf3b5d6b5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b3ae52d33b9a4273a42e5e2cf3b5d6b5" member_type: VOTER } }
I20260709 13:18:01.353195  6670 sys_catalog.cc:458] T 00000000000000000000000000000000 P b3ae52d33b9a4273a42e5e2cf3b5d6b5 [sys.catalog]: This master's current role is: LEADER
I20260709 13:18:01.355676  6675 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:18:01.365211  6675 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:18:01.366338  5625 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:18:01.376814  6675 catalog_manager.cc:1383] Generated new cluster ID: af328b49c1da46d8a2145f18eea51f97
I20260709 13:18:01.377157  6675 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:18:01.407677  6675 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:18:01.409153  6675 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:18:01.426688  6675 catalog_manager.cc:6070] T 00000000000000000000000000000000 P b3ae52d33b9a4273a42e5e2cf3b5d6b5: Generated new TSK 0
I20260709 13:18:01.427667  6675 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:18:01.434706  5625 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:18:01.443234  6686 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:18:01.445297  6687 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:18:01.447934  5625 server_base.cc:1061] running on GCE node
W20260709 13:18:01.448000  6689 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:18:01.449235  5625 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:18:01.449541  5625 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:18:01.449684  5625 hybrid_clock.cc:648] HybridClock initialized: now 1783603081449672 us; error 0 us; skew 500 ppm
I20260709 13:18:01.450249  5625 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:18:01.452837  5625 webserver.cc:533] Webserver started at http://127.5.126.65:42185/ using document root <none> and password file <none>
I20260709 13:18:01.453294  5625 fs_manager.cc:362] Metadata directory not provided
I20260709 13:18:01.453464  5625 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:18:01.453680  5625 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:18:01.454710  5625 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskWHb0CB/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783603057096655-5625-0/minicluster-data/ts-0-root/instance:
uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
format_stamp: "Formatted at 2026-07-09 13:18:01 on dist-test-slave-smzk"
I20260709 13:18:01.459671  5625 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 13:18:01.463867  6694 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:18:01.465248  5625 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20260709 13:18:01.465659  5625 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskWHb0CB/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783603057096655-5625-0/minicluster-data/ts-0-root
uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
format_stamp: "Formatted at 2026-07-09 13:18:01 on dist-test-slave-smzk"
I20260709 13:18:01.465939  5625 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWHb0CB/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783603057096655-5625-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskWHb0CB/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783603057096655-5625-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskWHb0CB/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783603057096655-5625-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:18:01.491223  5625 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:18:01.492605  5625 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:18:01.494493  5625 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:18:01.497560  5625 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:18:01.497887  5625 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:18:01.498306  5625 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:18:01.498616  5625 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:18:01.546216  5625 rpc_server.cc:307] RPC server started. Bound to: 127.5.126.65:44391
I20260709 13:18:01.546422  6756 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.5.126.65:44391 every 8 connection(s)
I20260709 13:18:01.551067  5625 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:18:01.560190  6761 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:18:01.562501  6762 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:18:01.569213  6764 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:18:01.570152  5625 server_base.cc:1061] running on GCE node
I20260709 13:18:01.570374  6757 heartbeater.cc:344] Connected to a master server at 127.5.126.126:34367
I20260709 13:18:01.570951  6757 heartbeater.cc:461] Registering TS with master...
I20260709 13:18:01.571938  6757 heartbeater.cc:507] Master 127.5.126.126:34367 requested a full tablet report, sending...
I20260709 13:18:01.572180  5625 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:18:01.572505  5625 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:18:01.572687  5625 hybrid_clock.cc:648] HybridClock initialized: now 1783603081572672 us; error 0 us; skew 500 ppm
I20260709 13:18:01.573407  5625 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:18:01.574892  6630 ts_manager.cc:194] Registered new tserver with Master: ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391)
I20260709 13:18:01.576334  5625 webserver.cc:533] Webserver started at http://127.5.126.66:36311/ using document root <none> and password file <none>
I20260709 13:18:01.576997  5625 fs_manager.cc:362] Metadata directory not provided
I20260709 13:18:01.577230  5625 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:18:01.577302  6630 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:53214
I20260709 13:18:01.577507  5625 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:18:01.578984  5625 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskWHb0CB/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783603057096655-5625-0/minicluster-data/ts-1-root/instance:
uuid: "b7ab4784c7344b939bc36f639286f377"
format_stamp: "Formatted at 2026-07-09 13:18:01 on dist-test-slave-smzk"
I20260709 13:18:01.583963  5625 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.003s	sys 0.004s
I20260709 13:18:01.588238  6769 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:18:01.589280  5625 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20260709 13:18:01.589581  5625 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskWHb0CB/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783603057096655-5625-0/minicluster-data/ts-1-root
uuid: "b7ab4784c7344b939bc36f639286f377"
format_stamp: "Formatted at 2026-07-09 13:18:01 on dist-test-slave-smzk"
I20260709 13:18:01.589920  5625 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWHb0CB/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783603057096655-5625-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskWHb0CB/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783603057096655-5625-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskWHb0CB/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783603057096655-5625-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:18:01.603089  5625 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:18:01.604647  5625 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:18:01.606317  5625 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:18:01.609094  5625 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:18:01.609364  5625 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:18:01.609689  5625 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:18:01.609872  5625 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:18:01.665210  5625 rpc_server.cc:307] RPC server started. Bound to: 127.5.126.66:42817
I20260709 13:18:01.665325  6831 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.5.126.66:42817 every 8 connection(s)
I20260709 13:18:01.671504  5625 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:18:01.680884  6835 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:18:01.682808  6836 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:18:01.685154  6832 heartbeater.cc:344] Connected to a master server at 127.5.126.126:34367
I20260709 13:18:01.685734  6832 heartbeater.cc:461] Registering TS with master...
I20260709 13:18:01.687345  6832 heartbeater.cc:507] Master 127.5.126.126:34367 requested a full tablet report, sending...
I20260709 13:18:01.690963  6630 ts_manager.cc:194] Registered new tserver with Master: b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
W20260709 13:18:01.691717  6838 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:18:01.693434  5625 server_base.cc:1061] running on GCE node
I20260709 13:18:01.693871  6630 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:53224
I20260709 13:18:01.694784  5625 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:18:01.695150  5625 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:18:01.695369  5625 hybrid_clock.cc:648] HybridClock initialized: now 1783603081695349 us; error 0 us; skew 500 ppm
I20260709 13:18:01.696184  5625 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:18:01.703162  5625 webserver.cc:533] Webserver started at http://127.5.126.67:42003/ using document root <none> and password file <none>
I20260709 13:18:01.703979  5625 fs_manager.cc:362] Metadata directory not provided
I20260709 13:18:01.704269  5625 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:18:01.704646  5625 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:18:01.706722  5625 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskWHb0CB/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783603057096655-5625-0/minicluster-data/ts-2-root/instance:
uuid: "cd75a17ab2604397adab03bb8b5fd75c"
format_stamp: "Formatted at 2026-07-09 13:18:01 on dist-test-slave-smzk"
I20260709 13:18:01.713218  5625 fs_manager.cc:696] Time spent creating directory manager: real 0.006s	user 0.000s	sys 0.008s
I20260709 13:18:01.717247  6843 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:18:01.718226  5625 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.004s	sys 0.000s
I20260709 13:18:01.718704  5625 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskWHb0CB/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783603057096655-5625-0/minicluster-data/ts-2-root
uuid: "cd75a17ab2604397adab03bb8b5fd75c"
format_stamp: "Formatted at 2026-07-09 13:18:01 on dist-test-slave-smzk"
I20260709 13:18:01.719102  5625 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWHb0CB/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783603057096655-5625-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskWHb0CB/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783603057096655-5625-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskWHb0CB/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783603057096655-5625-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:18:01.732367  5625 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:18:01.734222  5625 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:18:01.736415  5625 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:18:01.739123  5625 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:18:01.739393  5625 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:18:01.739677  5625 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:18:01.739871  5625 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:18:01.794677  5625 rpc_server.cc:307] RPC server started. Bound to: 127.5.126.67:42931
I20260709 13:18:01.794790  6905 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.5.126.67:42931 every 8 connection(s)
I20260709 13:18:01.811928  6906 heartbeater.cc:344] Connected to a master server at 127.5.126.126:34367
I20260709 13:18:01.812412  6906 heartbeater.cc:461] Registering TS with master...
I20260709 13:18:01.813215  6906 heartbeater.cc:507] Master 127.5.126.126:34367 requested a full tablet report, sending...
I20260709 13:18:01.815675  6630 ts_manager.cc:194] Registered new tserver with Master: cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:18:01.815948  5625 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.017667005s
I20260709 13:18:01.817256  6630 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:53234
I20260709 13:18:01.849218  6630 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:53240:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}""\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:18:01.856741  6630 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:18:02.074626  6797 tablet_service.cc:1511] Processing CreateTablet for tablet e77e330a82df4b43a745d57a68f6f057 (DEFAULT_TABLE table=test-workload [id=04f4d366747e43549980077479ed75b9]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 13:18:02.076154  6797 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e77e330a82df4b43a745d57a68f6f057. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:02.081658  6871 tablet_service.cc:1511] Processing CreateTablet for tablet e77e330a82df4b43a745d57a68f6f057 (DEFAULT_TABLE table=test-workload [id=04f4d366747e43549980077479ed75b9]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 13:18:02.083026  6871 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e77e330a82df4b43a745d57a68f6f057. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:02.084779  6793 tablet_service.cc:1511] Processing CreateTablet for tablet e31b9971c15848dea59d4d4130141d9e (DEFAULT_TABLE table=test-workload [id=04f4d366747e43549980077479ed75b9]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 13:18:02.086150  6793 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e31b9971c15848dea59d4d4130141d9e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:02.086542  6792 tablet_service.cc:1511] Processing CreateTablet for tablet f3f9c2e2bf644115957398fe4c9459db (DEFAULT_TABLE table=test-workload [id=04f4d366747e43549980077479ed75b9]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 13:18:02.089251  6792 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f3f9c2e2bf644115957398fe4c9459db. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:02.089509  6795 tablet_service.cc:1511] Processing CreateTablet for tablet b3f13b31a1f84f0d89d007eadd57924c (DEFAULT_TABLE table=test-workload [id=04f4d366747e43549980077479ed75b9]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 13:18:02.090436  6870 tablet_service.cc:1511] Processing CreateTablet for tablet 404190ce4ce94cecbfcb6ea9d1dd8626 (DEFAULT_TABLE table=test-workload [id=04f4d366747e43549980077479ed75b9]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 13:18:02.091176  6795 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b3f13b31a1f84f0d89d007eadd57924c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:02.090878  6796 tablet_service.cc:1511] Processing CreateTablet for tablet 404190ce4ce94cecbfcb6ea9d1dd8626 (DEFAULT_TABLE table=test-workload [id=04f4d366747e43549980077479ed75b9]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 13:18:02.091876  6870 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 404190ce4ce94cecbfcb6ea9d1dd8626. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:02.093393  6868 tablet_service.cc:1511] Processing CreateTablet for tablet f58dc08b12a2494bb9a1372837970ca2 (DEFAULT_TABLE table=test-workload [id=04f4d366747e43549980077479ed75b9]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 13:18:02.094870  6868 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f58dc08b12a2494bb9a1372837970ca2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:02.096894  6794 tablet_service.cc:1511] Processing CreateTablet for tablet f58dc08b12a2494bb9a1372837970ca2 (DEFAULT_TABLE table=test-workload [id=04f4d366747e43549980077479ed75b9]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 13:18:02.097396  6869 tablet_service.cc:1511] Processing CreateTablet for tablet b3f13b31a1f84f0d89d007eadd57924c (DEFAULT_TABLE table=test-workload [id=04f4d366747e43549980077479ed75b9]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 13:18:02.089282  6866 tablet_service.cc:1511] Processing CreateTablet for tablet f3f9c2e2bf644115957398fe4c9459db (DEFAULT_TABLE table=test-workload [id=04f4d366747e43549980077479ed75b9]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 13:18:02.099107  6722 tablet_service.cc:1511] Processing CreateTablet for tablet e77e330a82df4b43a745d57a68f6f057 (DEFAULT_TABLE table=test-workload [id=04f4d366747e43549980077479ed75b9]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 13:18:02.099514  6869 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b3f13b31a1f84f0d89d007eadd57924c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:02.089510  6867 tablet_service.cc:1511] Processing CreateTablet for tablet e31b9971c15848dea59d4d4130141d9e (DEFAULT_TABLE table=test-workload [id=04f4d366747e43549980077479ed75b9]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 13:18:02.100541  6722 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e77e330a82df4b43a745d57a68f6f057. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:02.104655  6794 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f58dc08b12a2494bb9a1372837970ca2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:02.106664  6796 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 404190ce4ce94cecbfcb6ea9d1dd8626. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:02.104844  6866 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f3f9c2e2bf644115957398fe4c9459db. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:02.107507  6867 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e31b9971c15848dea59d4d4130141d9e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:02.112771  6720 tablet_service.cc:1511] Processing CreateTablet for tablet b3f13b31a1f84f0d89d007eadd57924c (DEFAULT_TABLE table=test-workload [id=04f4d366747e43549980077479ed75b9]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 13:18:02.114415  6720 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b3f13b31a1f84f0d89d007eadd57924c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:02.121429  6791 tablet_service.cc:1511] Processing CreateTablet for tablet bb7fa124c3bf4ef9ab65a407cb008441 (DEFAULT_TABLE table=test-workload [id=04f4d366747e43549980077479ed75b9]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 13:18:02.123139  6791 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bb7fa124c3bf4ef9ab65a407cb008441. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:02.124850  6865 tablet_service.cc:1511] Processing CreateTablet for tablet bb7fa124c3bf4ef9ab65a407cb008441 (DEFAULT_TABLE table=test-workload [id=04f4d366747e43549980077479ed75b9]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 13:18:02.126734  6865 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bb7fa124c3bf4ef9ab65a407cb008441. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:02.137301  6721 tablet_service.cc:1511] Processing CreateTablet for tablet 404190ce4ce94cecbfcb6ea9d1dd8626 (DEFAULT_TABLE table=test-workload [id=04f4d366747e43549980077479ed75b9]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 13:18:02.139194  6719 tablet_service.cc:1511] Processing CreateTablet for tablet f58dc08b12a2494bb9a1372837970ca2 (DEFAULT_TABLE table=test-workload [id=04f4d366747e43549980077479ed75b9]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 13:18:02.155454  6714 tablet_service.cc:1511] Processing CreateTablet for tablet 90d42e216d9741e190bca19a781291fd (DEFAULT_TABLE table=test-workload [id=04f4d366747e43549980077479ed75b9]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 13:18:02.141233  6864 tablet_service.cc:1511] Processing CreateTablet for tablet 20f6842e26174571996b8dea4151d4be (DEFAULT_TABLE table=test-workload [id=04f4d366747e43549980077479ed75b9]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 13:18:02.145469  6718 tablet_service.cc:1511] Processing CreateTablet for tablet e31b9971c15848dea59d4d4130141d9e (DEFAULT_TABLE table=test-workload [id=04f4d366747e43549980077479ed75b9]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 13:18:02.149459  6792 tablet_service.cc:1511] Processing CreateTablet for tablet 20f6842e26174571996b8dea4151d4be (DEFAULT_TABLE table=test-workload [id=04f4d366747e43549980077479ed75b9]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 13:18:02.144785  6717 tablet_service.cc:1511] Processing CreateTablet for tablet f3f9c2e2bf644115957398fe4c9459db (DEFAULT_TABLE table=test-workload [id=04f4d366747e43549980077479ed75b9]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 13:18:02.145336  6716 tablet_service.cc:1511] Processing CreateTablet for tablet bb7fa124c3bf4ef9ab65a407cb008441 (DEFAULT_TABLE table=test-workload [id=04f4d366747e43549980077479ed75b9]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 13:18:02.166786  6864 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 20f6842e26174571996b8dea4151d4be. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:02.189963  6922 tablet_bootstrap.cc:492] T f58dc08b12a2494bb9a1372837970ca2 P cd75a17ab2604397adab03bb8b5fd75c: Bootstrap starting.
I20260709 13:18:02.194149  6868 tablet_service.cc:1511] Processing CreateTablet for tablet a3022224cc81473690653a83d4e99470 (DEFAULT_TABLE table=test-workload [id=04f4d366747e43549980077479ed75b9]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 13:18:02.195685  6868 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a3022224cc81473690653a83d4e99470. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:02.139751  6721 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 404190ce4ce94cecbfcb6ea9d1dd8626. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:02.161245  6863 tablet_service.cc:1511] Processing CreateTablet for tablet 90d42e216d9741e190bca19a781291fd (DEFAULT_TABLE table=test-workload [id=04f4d366747e43549980077479ed75b9]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 13:18:02.197683  6719 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f58dc08b12a2494bb9a1372837970ca2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:02.198679  6863 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 90d42e216d9741e190bca19a781291fd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:02.202520  6789 tablet_service.cc:1511] Processing CreateTablet for tablet 7887766dc6784fcaa42b35c05fea7a99 (DEFAULT_TABLE table=test-workload [id=04f4d366747e43549980077479ed75b9]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 13:18:02.203751  6716 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bb7fa124c3bf4ef9ab65a407cb008441. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:02.169536  6792 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 20f6842e26174571996b8dea4151d4be. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:02.169606  6790 tablet_service.cc:1511] Processing CreateTablet for tablet 90d42e216d9741e190bca19a781291fd (DEFAULT_TABLE table=test-workload [id=04f4d366747e43549980077479ed75b9]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 13:18:02.207865  6718 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e31b9971c15848dea59d4d4130141d9e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:02.209126  6788 tablet_service.cc:1511] Processing CreateTablet for tablet a3022224cc81473690653a83d4e99470 (DEFAULT_TABLE table=test-workload [id=04f4d366747e43549980077479ed75b9]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 13:18:02.209977  6790 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 90d42e216d9741e190bca19a781291fd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:02.173525  6713 tablet_service.cc:1511] Processing CreateTablet for tablet 7887766dc6784fcaa42b35c05fea7a99 (DEFAULT_TABLE table=test-workload [id=04f4d366747e43549980077479ed75b9]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 13:18:02.182157  6862 tablet_service.cc:1511] Processing CreateTablet for tablet 7887766dc6784fcaa42b35c05fea7a99 (DEFAULT_TABLE table=test-workload [id=04f4d366747e43549980077479ed75b9]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 13:18:02.211814  6789 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7887766dc6784fcaa42b35c05fea7a99. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:02.212224  6862 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7887766dc6784fcaa42b35c05fea7a99. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:02.212503  6717 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f3f9c2e2bf644115957398fe4c9459db. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:02.142050  6715 tablet_service.cc:1511] Processing CreateTablet for tablet 20f6842e26174571996b8dea4151d4be (DEFAULT_TABLE table=test-workload [id=04f4d366747e43549980077479ed75b9]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 13:18:02.218035  6788 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a3022224cc81473690653a83d4e99470. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:02.220336  6713 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7887766dc6784fcaa42b35c05fea7a99. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:02.223527  6922 tablet_bootstrap.cc:654] T f58dc08b12a2494bb9a1372837970ca2 P cd75a17ab2604397adab03bb8b5fd75c: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:02.224221  6714 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 90d42e216d9741e190bca19a781291fd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:02.236958  6715 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 20f6842e26174571996b8dea4151d4be. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:02.246503  6795 tablet_service.cc:1511] Processing CreateTablet for tablet 4d9def8b32fd443aa94ab1420b06837b (DEFAULT_TABLE table=test-workload [id=04f4d366747e43549980077479ed75b9]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 13:18:02.248153  6795 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4d9def8b32fd443aa94ab1420b06837b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:02.271526  6871 tablet_service.cc:1511] Processing CreateTablet for tablet 4d9def8b32fd443aa94ab1420b06837b (DEFAULT_TABLE table=test-workload [id=04f4d366747e43549980077479ed75b9]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 13:18:02.273984  6871 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4d9def8b32fd443aa94ab1420b06837b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:02.300261  6870 tablet_service.cc:1511] Processing CreateTablet for tablet 1bf4668eeb70467fb3dc5a0289233b3c (DEFAULT_TABLE table=test-workload [id=04f4d366747e43549980077479ed75b9]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 13:18:02.302445  6870 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1bf4668eeb70467fb3dc5a0289233b3c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:02.336018  6720 tablet_service.cc:1511] Processing CreateTablet for tablet a3022224cc81473690653a83d4e99470 (DEFAULT_TABLE table=test-workload [id=04f4d366747e43549980077479ed75b9]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 13:18:02.343942  6719 tablet_service.cc:1511] Processing CreateTablet for tablet 4d9def8b32fd443aa94ab1420b06837b (DEFAULT_TABLE table=test-workload [id=04f4d366747e43549980077479ed75b9]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 13:18:02.360473  6921 tablet_bootstrap.cc:492] T e77e330a82df4b43a745d57a68f6f057 P b7ab4784c7344b939bc36f639286f377: Bootstrap starting.
I20260709 13:18:02.360896  6797 tablet_service.cc:1511] Processing CreateTablet for tablet 1bf4668eeb70467fb3dc5a0289233b3c (DEFAULT_TABLE table=test-workload [id=04f4d366747e43549980077479ed75b9]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
W20260709 13:18:02.362103  6678 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:18:02.358153  6720 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a3022224cc81473690653a83d4e99470. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:02.365322  6923 tablet_bootstrap.cc:492] T b3f13b31a1f84f0d89d007eadd57924c P ccd8a4c3bfe3413cb2ae219b09aea832: Bootstrap starting.
I20260709 13:18:02.367561  6791 tablet_service.cc:1511] Processing CreateTablet for tablet 4f00a2e87e56452083b759f60d461ee3 (DEFAULT_TABLE table=test-workload [id=04f4d366747e43549980077479ed75b9]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 13:18:02.362188  6797 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1bf4668eeb70467fb3dc5a0289233b3c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:02.370916  6791 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4f00a2e87e56452083b759f60d461ee3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:02.375874  6716 tablet_service.cc:1511] Processing CreateTablet for tablet 1bf4668eeb70467fb3dc5a0289233b3c (DEFAULT_TABLE table=test-workload [id=04f4d366747e43549980077479ed75b9]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 13:18:02.377331  6922 tablet_bootstrap.cc:492] T f58dc08b12a2494bb9a1372837970ca2 P cd75a17ab2604397adab03bb8b5fd75c: No bootstrap required, opened a new log
I20260709 13:18:02.377818  6922 ts_tablet_manager.cc:1403] T f58dc08b12a2494bb9a1372837970ca2 P cd75a17ab2604397adab03bb8b5fd75c: Time spent bootstrapping tablet: real 0.188s	user 0.017s	sys 0.000s
I20260709 13:18:02.387063  6921 tablet_bootstrap.cc:654] T e77e330a82df4b43a745d57a68f6f057 P b7ab4784c7344b939bc36f639286f377: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:02.393987  6718 tablet_service.cc:1511] Processing CreateTablet for tablet 4f00a2e87e56452083b759f60d461ee3 (DEFAULT_TABLE table=test-workload [id=04f4d366747e43549980077479ed75b9]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 13:18:02.404134  6716 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1bf4668eeb70467fb3dc5a0289233b3c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:02.404990  6719 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4d9def8b32fd443aa94ab1420b06837b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:02.413200  6868 tablet_service.cc:1511] Processing CreateTablet for tablet 4f00a2e87e56452083b759f60d461ee3 (DEFAULT_TABLE table=test-workload [id=04f4d366747e43549980077479ed75b9]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 13:18:02.414855  6868 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4f00a2e87e56452083b759f60d461ee3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:02.420387  6718 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4f00a2e87e56452083b759f60d461ee3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:02.430478  6922 raft_consensus.cc:359] T f58dc08b12a2494bb9a1372837970ca2 P cd75a17ab2604397adab03bb8b5fd75c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:02.431455  6922 raft_consensus.cc:385] T f58dc08b12a2494bb9a1372837970ca2 P cd75a17ab2604397adab03bb8b5fd75c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:02.431789  6922 raft_consensus.cc:740] T f58dc08b12a2494bb9a1372837970ca2 P cd75a17ab2604397adab03bb8b5fd75c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cd75a17ab2604397adab03bb8b5fd75c, State: Initialized, Role: FOLLOWER
I20260709 13:18:02.432693  6922 consensus_queue.cc:260] T f58dc08b12a2494bb9a1372837970ca2 P cd75a17ab2604397adab03bb8b5fd75c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:02.454080  6923 tablet_bootstrap.cc:654] T b3f13b31a1f84f0d89d007eadd57924c P ccd8a4c3bfe3413cb2ae219b09aea832: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:02.456135  6793 tablet_service.cc:1511] Processing CreateTablet for tablet 07a92dd554674067a83a9cb68c4773f2 (DEFAULT_TABLE table=test-workload [id=04f4d366747e43549980077479ed75b9]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 13:18:02.456344  6865 tablet_service.cc:1511] Processing CreateTablet for tablet 07a92dd554674067a83a9cb68c4773f2 (DEFAULT_TABLE table=test-workload [id=04f4d366747e43549980077479ed75b9]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 13:18:02.457916  6793 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 07a92dd554674067a83a9cb68c4773f2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:02.458482  6865 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 07a92dd554674067a83a9cb68c4773f2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:02.464778  6718 tablet_service.cc:1511] Processing CreateTablet for tablet f09c2a98de1a4decabd0ff900dd44caa (DEFAULT_TABLE table=test-workload [id=04f4d366747e43549980077479ed75b9]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 13:18:02.469470  6722 tablet_service.cc:1511] Processing CreateTablet for tablet 07a92dd554674067a83a9cb68c4773f2 (DEFAULT_TABLE table=test-workload [id=04f4d366747e43549980077479ed75b9]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 13:18:02.467043  6718 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f09c2a98de1a4decabd0ff900dd44caa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:02.472247  6797 tablet_service.cc:1511] Processing CreateTablet for tablet f09c2a98de1a4decabd0ff900dd44caa (DEFAULT_TABLE table=test-workload [id=04f4d366747e43549980077479ed75b9]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 13:18:02.475550  6722 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 07a92dd554674067a83a9cb68c4773f2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:02.476241  6797 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f09c2a98de1a4decabd0ff900dd44caa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:02.476593  6922 ts_tablet_manager.cc:1434] T f58dc08b12a2494bb9a1372837970ca2 P cd75a17ab2604397adab03bb8b5fd75c: Time spent starting tablet: real 0.098s	user 0.015s	sys 0.021s
I20260709 13:18:02.477419  6906 heartbeater.cc:499] Master 127.5.126.126:34367 was elected leader, sending a full tablet report...
I20260709 13:18:02.477847  6922 tablet_bootstrap.cc:492] T e77e330a82df4b43a745d57a68f6f057 P cd75a17ab2604397adab03bb8b5fd75c: Bootstrap starting.
I20260709 13:18:02.480989  6863 tablet_service.cc:1511] Processing CreateTablet for tablet f09c2a98de1a4decabd0ff900dd44caa (DEFAULT_TABLE table=test-workload [id=04f4d366747e43549980077479ed75b9]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 13:18:02.489205  6716 tablet_service.cc:1511] Processing CreateTablet for tablet f4b8bd455d5a47c18a1380839c6e0d61 (DEFAULT_TABLE table=test-workload [id=04f4d366747e43549980077479ed75b9]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 13:18:02.491537  6921 tablet_bootstrap.cc:492] T e77e330a82df4b43a745d57a68f6f057 P b7ab4784c7344b939bc36f639286f377: No bootstrap required, opened a new log
I20260709 13:18:02.496809  6921 ts_tablet_manager.cc:1403] T e77e330a82df4b43a745d57a68f6f057 P b7ab4784c7344b939bc36f639286f377: Time spent bootstrapping tablet: real 0.137s	user 0.013s	sys 0.031s
I20260709 13:18:02.500972  6716 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f4b8bd455d5a47c18a1380839c6e0d61. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:02.503696  6921 raft_consensus.cc:359] T e77e330a82df4b43a745d57a68f6f057 P b7ab4784c7344b939bc36f639286f377 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } }
I20260709 13:18:02.504521  6921 raft_consensus.cc:385] T e77e330a82df4b43a745d57a68f6f057 P b7ab4784c7344b939bc36f639286f377 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:02.504825  6921 raft_consensus.cc:740] T e77e330a82df4b43a745d57a68f6f057 P b7ab4784c7344b939bc36f639286f377 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Initialized, Role: FOLLOWER
I20260709 13:18:02.505836  6921 consensus_queue.cc:260] T e77e330a82df4b43a745d57a68f6f057 P b7ab4784c7344b939bc36f639286f377 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } }
I20260709 13:18:02.508487  6863 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f09c2a98de1a4decabd0ff900dd44caa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:02.515259  6795 tablet_service.cc:1511] Processing CreateTablet for tablet f4b8bd455d5a47c18a1380839c6e0d61 (DEFAULT_TABLE table=test-workload [id=04f4d366747e43549980077479ed75b9]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 13:18:02.517266  6795 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f4b8bd455d5a47c18a1380839c6e0d61. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:02.517282  6868 tablet_service.cc:1511] Processing CreateTablet for tablet f4b8bd455d5a47c18a1380839c6e0d61 (DEFAULT_TABLE table=test-workload [id=04f4d366747e43549980077479ed75b9]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 13:18:02.524590  6720 tablet_service.cc:1511] Processing CreateTablet for tablet 30e88460611e47b2ba16a46a30b5f416 (DEFAULT_TABLE table=test-workload [id=04f4d366747e43549980077479ed75b9]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 13:18:02.525996  6720 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 30e88460611e47b2ba16a46a30b5f416. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:02.525759  6864 tablet_service.cc:1511] Processing CreateTablet for tablet 30e88460611e47b2ba16a46a30b5f416 (DEFAULT_TABLE table=test-workload [id=04f4d366747e43549980077479ed75b9]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 13:18:02.527141  6864 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 30e88460611e47b2ba16a46a30b5f416. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:02.529152  6797 tablet_service.cc:1511] Processing CreateTablet for tablet 30e88460611e47b2ba16a46a30b5f416 (DEFAULT_TABLE table=test-workload [id=04f4d366747e43549980077479ed75b9]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 13:18:02.533819  6797 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 30e88460611e47b2ba16a46a30b5f416. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:02.537662  6868 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f4b8bd455d5a47c18a1380839c6e0d61. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:02.539947  6923 tablet_bootstrap.cc:492] T b3f13b31a1f84f0d89d007eadd57924c P ccd8a4c3bfe3413cb2ae219b09aea832: No bootstrap required, opened a new log
I20260709 13:18:02.540604  6923 ts_tablet_manager.cc:1403] T b3f13b31a1f84f0d89d007eadd57924c P ccd8a4c3bfe3413cb2ae219b09aea832: Time spent bootstrapping tablet: real 0.176s	user 0.017s	sys 0.014s
I20260709 13:18:02.518632  6922 tablet_bootstrap.cc:654] T e77e330a82df4b43a745d57a68f6f057 P cd75a17ab2604397adab03bb8b5fd75c: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:02.545876  6923 raft_consensus.cc:359] T b3f13b31a1f84f0d89d007eadd57924c P ccd8a4c3bfe3413cb2ae219b09aea832 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:02.556905  6923 raft_consensus.cc:385] T b3f13b31a1f84f0d89d007eadd57924c P ccd8a4c3bfe3413cb2ae219b09aea832 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:02.565095  6719 tablet_service.cc:1511] Processing CreateTablet for tablet 3a485a995abc4807b6e511e45419f737 (DEFAULT_TABLE table=test-workload [id=04f4d366747e43549980077479ed75b9]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 13:18:02.573966  6719 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3a485a995abc4807b6e511e45419f737. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:02.574456  6789 tablet_service.cc:1511] Processing CreateTablet for tablet 3a485a995abc4807b6e511e45419f737 (DEFAULT_TABLE table=test-workload [id=04f4d366747e43549980077479ed75b9]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 13:18:02.575536  6921 ts_tablet_manager.cc:1434] T e77e330a82df4b43a745d57a68f6f057 P b7ab4784c7344b939bc36f639286f377: Time spent starting tablet: real 0.078s	user 0.009s	sys 0.017s
I20260709 13:18:02.575949  6789 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3a485a995abc4807b6e511e45419f737. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:02.576367  6832 heartbeater.cc:499] Master 127.5.126.126:34367 was elected leader, sending a full tablet report...
I20260709 13:18:02.574434  6871 tablet_service.cc:1511] Processing CreateTablet for tablet 3a485a995abc4807b6e511e45419f737 (DEFAULT_TABLE table=test-workload [id=04f4d366747e43549980077479ed75b9]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 13:18:02.578401  6871 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3a485a995abc4807b6e511e45419f737. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:02.567806  6923 raft_consensus.cc:740] T b3f13b31a1f84f0d89d007eadd57924c P ccd8a4c3bfe3413cb2ae219b09aea832 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Initialized, Role: FOLLOWER
I20260709 13:18:02.586174  6757 heartbeater.cc:499] Master 127.5.126.126:34367 was elected leader, sending a full tablet report...
I20260709 13:18:02.587877  6923 consensus_queue.cc:260] T b3f13b31a1f84f0d89d007eadd57924c P ccd8a4c3bfe3413cb2ae219b09aea832 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:02.595613  6928 raft_consensus.cc:493] T e77e330a82df4b43a745d57a68f6f057 P b7ab4784c7344b939bc36f639286f377 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:02.596459  6928 raft_consensus.cc:515] T e77e330a82df4b43a745d57a68f6f057 P b7ab4784c7344b939bc36f639286f377 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } }
I20260709 13:18:02.602393  6922 tablet_bootstrap.cc:492] T e77e330a82df4b43a745d57a68f6f057 P cd75a17ab2604397adab03bb8b5fd75c: No bootstrap required, opened a new log
I20260709 13:18:02.603098  6922 ts_tablet_manager.cc:1403] T e77e330a82df4b43a745d57a68f6f057 P cd75a17ab2604397adab03bb8b5fd75c: Time spent bootstrapping tablet: real 0.126s	user 0.012s	sys 0.009s
I20260709 13:18:02.605847  6926 raft_consensus.cc:493] T f58dc08b12a2494bb9a1372837970ca2 P cd75a17ab2604397adab03bb8b5fd75c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:02.606498  6926 raft_consensus.cc:515] T f58dc08b12a2494bb9a1372837970ca2 P cd75a17ab2604397adab03bb8b5fd75c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:02.609449  6922 raft_consensus.cc:359] T e77e330a82df4b43a745d57a68f6f057 P cd75a17ab2604397adab03bb8b5fd75c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } }
I20260709 13:18:02.611439  6926 leader_election.cc:290] T f58dc08b12a2494bb9a1372837970ca2 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:18:02.611546  6922 raft_consensus.cc:385] T e77e330a82df4b43a745d57a68f6f057 P cd75a17ab2604397adab03bb8b5fd75c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:02.612748  6922 raft_consensus.cc:740] T e77e330a82df4b43a745d57a68f6f057 P cd75a17ab2604397adab03bb8b5fd75c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cd75a17ab2604397adab03bb8b5fd75c, State: Initialized, Role: FOLLOWER
I20260709 13:18:02.614531  6922 consensus_queue.cc:260] T e77e330a82df4b43a745d57a68f6f057 P cd75a17ab2604397adab03bb8b5fd75c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } }
I20260709 13:18:02.618033  6922 ts_tablet_manager.cc:1434] T e77e330a82df4b43a745d57a68f6f057 P cd75a17ab2604397adab03bb8b5fd75c: Time spent starting tablet: real 0.015s	user 0.006s	sys 0.000s
I20260709 13:18:02.623251  6922 tablet_bootstrap.cc:492] T 404190ce4ce94cecbfcb6ea9d1dd8626 P cd75a17ab2604397adab03bb8b5fd75c: Bootstrap starting.
I20260709 13:18:02.623845  6928 leader_election.cc:290] T e77e330a82df4b43a745d57a68f6f057 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931), ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391)
I20260709 13:18:02.625581  6793 tablet_service.cc:1511] Processing CreateTablet for tablet 44bde925b2e541b69890d70715b85176 (DEFAULT_TABLE table=test-workload [id=04f4d366747e43549980077479ed75b9]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 13:18:02.627126  6793 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 44bde925b2e541b69890d70715b85176. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:02.633090  6922 tablet_bootstrap.cc:654] T 404190ce4ce94cecbfcb6ea9d1dd8626 P cd75a17ab2604397adab03bb8b5fd75c: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:02.633714  6863 tablet_service.cc:1511] Processing CreateTablet for tablet 44bde925b2e541b69890d70715b85176 (DEFAULT_TABLE table=test-workload [id=04f4d366747e43549980077479ed75b9]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 13:18:02.639947  6863 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 44bde925b2e541b69890d70715b85176. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:02.636344  6921 tablet_bootstrap.cc:492] T f3f9c2e2bf644115957398fe4c9459db P b7ab4784c7344b939bc36f639286f377: Bootstrap starting.
I20260709 13:18:02.649914  6923 ts_tablet_manager.cc:1434] T b3f13b31a1f84f0d89d007eadd57924c P ccd8a4c3bfe3413cb2ae219b09aea832: Time spent starting tablet: real 0.109s	user 0.020s	sys 0.012s
I20260709 13:18:02.664779  6921 tablet_bootstrap.cc:654] T f3f9c2e2bf644115957398fe4c9459db P b7ab4784c7344b939bc36f639286f377: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:02.680801  6923 tablet_bootstrap.cc:492] T f58dc08b12a2494bb9a1372837970ca2 P ccd8a4c3bfe3413cb2ae219b09aea832: Bootstrap starting.
I20260709 13:18:02.708442  6926 raft_consensus.cc:493] T e77e330a82df4b43a745d57a68f6f057 P cd75a17ab2604397adab03bb8b5fd75c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:02.709082  6926 raft_consensus.cc:515] T e77e330a82df4b43a745d57a68f6f057 P cd75a17ab2604397adab03bb8b5fd75c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } }
I20260709 13:18:02.710491  6720 tablet_service.cc:1511] Processing CreateTablet for tablet 44bde925b2e541b69890d70715b85176 (DEFAULT_TABLE table=test-workload [id=04f4d366747e43549980077479ed75b9]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 13:18:02.711367  6926 leader_election.cc:290] T e77e330a82df4b43a745d57a68f6f057 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391)
I20260709 13:18:02.712080  6720 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 44bde925b2e541b69890d70715b85176. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:02.718717  6923 tablet_bootstrap.cc:654] T f58dc08b12a2494bb9a1372837970ca2 P ccd8a4c3bfe3413cb2ae219b09aea832: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:02.728622  6722 tablet_service.cc:1511] Processing CreateTablet for tablet ce4f062dcd314d43a63ca74067cb5ee3 (DEFAULT_TABLE table=test-workload [id=04f4d366747e43549980077479ed75b9]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 13:18:02.730391  6722 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ce4f062dcd314d43a63ca74067cb5ee3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:02.730540  6922 tablet_bootstrap.cc:492] T 404190ce4ce94cecbfcb6ea9d1dd8626 P cd75a17ab2604397adab03bb8b5fd75c: No bootstrap required, opened a new log
I20260709 13:18:02.731192  6922 ts_tablet_manager.cc:1403] T 404190ce4ce94cecbfcb6ea9d1dd8626 P cd75a17ab2604397adab03bb8b5fd75c: Time spent bootstrapping tablet: real 0.110s	user 0.010s	sys 0.012s
I20260709 13:18:02.734579  6922 raft_consensus.cc:359] T 404190ce4ce94cecbfcb6ea9d1dd8626 P cd75a17ab2604397adab03bb8b5fd75c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:02.735365  6922 raft_consensus.cc:385] T 404190ce4ce94cecbfcb6ea9d1dd8626 P cd75a17ab2604397adab03bb8b5fd75c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:02.735697  6922 raft_consensus.cc:740] T 404190ce4ce94cecbfcb6ea9d1dd8626 P cd75a17ab2604397adab03bb8b5fd75c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cd75a17ab2604397adab03bb8b5fd75c, State: Initialized, Role: FOLLOWER
I20260709 13:18:02.737303  6922 consensus_queue.cc:260] T 404190ce4ce94cecbfcb6ea9d1dd8626 P cd75a17ab2604397adab03bb8b5fd75c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:02.739741  6922 ts_tablet_manager.cc:1434] T 404190ce4ce94cecbfcb6ea9d1dd8626 P cd75a17ab2604397adab03bb8b5fd75c: Time spent starting tablet: real 0.008s	user 0.003s	sys 0.003s
I20260709 13:18:02.740921  6922 tablet_bootstrap.cc:492] T b3f13b31a1f84f0d89d007eadd57924c P cd75a17ab2604397adab03bb8b5fd75c: Bootstrap starting.
I20260709 13:18:02.745610  6868 tablet_service.cc:1511] Processing CreateTablet for tablet ce4f062dcd314d43a63ca74067cb5ee3 (DEFAULT_TABLE table=test-workload [id=04f4d366747e43549980077479ed75b9]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 13:18:02.747108  6868 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ce4f062dcd314d43a63ca74067cb5ee3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:02.751748  6716 tablet_service.cc:1511] Processing CreateTablet for tablet 4b8cacb381b746da8d0049b0a83b41dd (DEFAULT_TABLE table=test-workload [id=04f4d366747e43549980077479ed75b9]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 13:18:02.757838  6716 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4b8cacb381b746da8d0049b0a83b41dd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:02.759886  6871 tablet_service.cc:1511] Processing CreateTablet for tablet 4b8cacb381b746da8d0049b0a83b41dd (DEFAULT_TABLE table=test-workload [id=04f4d366747e43549980077479ed75b9]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 13:18:02.763144  6871 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4b8cacb381b746da8d0049b0a83b41dd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:02.764781  6789 tablet_service.cc:1511] Processing CreateTablet for tablet ce4f062dcd314d43a63ca74067cb5ee3 (DEFAULT_TABLE table=test-workload [id=04f4d366747e43549980077479ed75b9]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 13:18:02.766223  6789 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ce4f062dcd314d43a63ca74067cb5ee3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:02.770128  6718 tablet_service.cc:1511] Processing CreateTablet for tablet 1528ab62b6fe4e3099d08f141afee116 (DEFAULT_TABLE table=test-workload [id=04f4d366747e43549980077479ed75b9]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 13:18:02.771503  6718 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1528ab62b6fe4e3099d08f141afee116. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:02.781729  6797 tablet_service.cc:1511] Processing CreateTablet for tablet 4b8cacb381b746da8d0049b0a83b41dd (DEFAULT_TABLE table=test-workload [id=04f4d366747e43549980077479ed75b9]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 13:18:02.785522  6797 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4b8cacb381b746da8d0049b0a83b41dd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:02.787073  6732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f58dc08b12a2494bb9a1372837970ca2" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:18:02.788597  6731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77e330a82df4b43a745d57a68f6f057" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
W20260709 13:18:02.792026  6844 leader_election.cc:343] T e77e330a82df4b43a745d57a68f6f057 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:02.783203  6922 tablet_bootstrap.cc:654] T b3f13b31a1f84f0d89d007eadd57924c P cd75a17ab2604397adab03bb8b5fd75c: Neither blocks nor log segments found. Creating new log.
W20260709 13:18:02.792918  6844 leader_election.cc:343] T f58dc08b12a2494bb9a1372837970ca2 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:02.796873  6793 tablet_service.cc:1511] Processing CreateTablet for tablet 1528ab62b6fe4e3099d08f141afee116 (DEFAULT_TABLE table=test-workload [id=04f4d366747e43549980077479ed75b9]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 13:18:02.797751  6921 tablet_bootstrap.cc:492] T f3f9c2e2bf644115957398fe4c9459db P b7ab4784c7344b939bc36f639286f377: No bootstrap required, opened a new log
I20260709 13:18:02.798226  6793 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1528ab62b6fe4e3099d08f141afee116. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:02.801884  6732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77e330a82df4b43a745d57a68f6f057" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
W20260709 13:18:02.804224  6770 leader_election.cc:343] T e77e330a82df4b43a745d57a68f6f057 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:02.806561  6923 tablet_bootstrap.cc:492] T f58dc08b12a2494bb9a1372837970ca2 P ccd8a4c3bfe3413cb2ae219b09aea832: No bootstrap required, opened a new log
I20260709 13:18:02.807268  6923 ts_tablet_manager.cc:1403] T f58dc08b12a2494bb9a1372837970ca2 P ccd8a4c3bfe3413cb2ae219b09aea832: Time spent bootstrapping tablet: real 0.138s	user 0.014s	sys 0.003s
I20260709 13:18:02.808254  6864 tablet_service.cc:1511] Processing CreateTablet for tablet 1528ab62b6fe4e3099d08f141afee116 (DEFAULT_TABLE table=test-workload [id=04f4d366747e43549980077479ed75b9]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 13:18:02.809762  6864 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1528ab62b6fe4e3099d08f141afee116. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:02.798283  6921 ts_tablet_manager.cc:1403] T f3f9c2e2bf644115957398fe4c9459db P b7ab4784c7344b939bc36f639286f377: Time spent bootstrapping tablet: real 0.200s	user 0.013s	sys 0.005s
I20260709 13:18:02.810828  6923 raft_consensus.cc:359] T f58dc08b12a2494bb9a1372837970ca2 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:02.811758  6923 raft_consensus.cc:385] T f58dc08b12a2494bb9a1372837970ca2 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:02.812150  6923 raft_consensus.cc:740] T f58dc08b12a2494bb9a1372837970ca2 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Initialized, Role: FOLLOWER
I20260709 13:18:02.814221  6921 raft_consensus.cc:359] T f3f9c2e2bf644115957398fe4c9459db P b7ab4784c7344b939bc36f639286f377 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:02.815301  6921 raft_consensus.cc:385] T f3f9c2e2bf644115957398fe4c9459db P b7ab4784c7344b939bc36f639286f377 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:02.815663  6921 raft_consensus.cc:740] T f3f9c2e2bf644115957398fe4c9459db P b7ab4784c7344b939bc36f639286f377 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Initialized, Role: FOLLOWER
I20260709 13:18:02.832427  6923 consensus_queue.cc:260] T f58dc08b12a2494bb9a1372837970ca2 P ccd8a4c3bfe3413cb2ae219b09aea832 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:02.824699  6719 tablet_service.cc:1511] Processing CreateTablet for tablet f03d0dbf16864ca4bc1bb5e4c0334c0f (DEFAULT_TABLE table=test-workload [id=04f4d366747e43549980077479ed75b9]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 13:18:02.830603  6807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f58dc08b12a2494bb9a1372837970ca2" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:18:02.832149  6806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77e330a82df4b43a745d57a68f6f057" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:18:02.818025  6881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77e330a82df4b43a745d57a68f6f057" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:18:02.834491  6881 raft_consensus.cc:2468] T e77e330a82df4b43a745d57a68f6f057 P cd75a17ab2604397adab03bb8b5fd75c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 0.
W20260709 13:18:02.834986  6844 leader_election.cc:343] T f58dc08b12a2494bb9a1372837970ca2 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:02.835553  6844 leader_election.cc:304] T f58dc08b12a2494bb9a1372837970ca2 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:18:02.836109  6772 leader_election.cc:304] T e77e330a82df4b43a745d57a68f6f057 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:18:02.836400  6922 tablet_bootstrap.cc:492] T b3f13b31a1f84f0d89d007eadd57924c P cd75a17ab2604397adab03bb8b5fd75c: No bootstrap required, opened a new log
I20260709 13:18:02.836978  6926 raft_consensus.cc:2749] T f58dc08b12a2494bb9a1372837970ca2 P cd75a17ab2604397adab03bb8b5fd75c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:18:02.837203  6922 ts_tablet_manager.cc:1403] T b3f13b31a1f84f0d89d007eadd57924c P cd75a17ab2604397adab03bb8b5fd75c: Time spent bootstrapping tablet: real 0.097s	user 0.010s	sys 0.003s
I20260709 13:18:02.834491  6806 raft_consensus.cc:2468] T e77e330a82df4b43a745d57a68f6f057 P b7ab4784c7344b939bc36f639286f377 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 0.
I20260709 13:18:02.838734  6930 raft_consensus.cc:2804] T e77e330a82df4b43a745d57a68f6f057 P b7ab4784c7344b939bc36f639286f377 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:18:02.840149  6844 leader_election.cc:304] T e77e330a82df4b43a745d57a68f6f057 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:18:02.841092  6930 raft_consensus.cc:493] T e77e330a82df4b43a745d57a68f6f057 P b7ab4784c7344b939bc36f639286f377 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:02.840834  6795 tablet_service.cc:1511] Processing CreateTablet for tablet f03d0dbf16864ca4bc1bb5e4c0334c0f (DEFAULT_TABLE table=test-workload [id=04f4d366747e43549980077479ed75b9]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 13:18:02.841497  6930 raft_consensus.cc:3060] T e77e330a82df4b43a745d57a68f6f057 P b7ab4784c7344b939bc36f639286f377 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:02.841595  6926 raft_consensus.cc:2804] T e77e330a82df4b43a745d57a68f6f057 P cd75a17ab2604397adab03bb8b5fd75c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:18:02.842151  6926 raft_consensus.cc:493] T e77e330a82df4b43a745d57a68f6f057 P cd75a17ab2604397adab03bb8b5fd75c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:02.842551  6926 raft_consensus.cc:3060] T e77e330a82df4b43a745d57a68f6f057 P cd75a17ab2604397adab03bb8b5fd75c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:02.845595  6923 ts_tablet_manager.cc:1434] T f58dc08b12a2494bb9a1372837970ca2 P ccd8a4c3bfe3413cb2ae219b09aea832: Time spent starting tablet: real 0.038s	user 0.006s	sys 0.001s
I20260709 13:18:02.835577  6719 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f03d0dbf16864ca4bc1bb5e4c0334c0f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:02.853123  6923 tablet_bootstrap.cc:492] T bb7fa124c3bf4ef9ab65a407cb008441 P ccd8a4c3bfe3413cb2ae219b09aea832: Bootstrap starting.
I20260709 13:18:02.852859  6922 raft_consensus.cc:359] T b3f13b31a1f84f0d89d007eadd57924c P cd75a17ab2604397adab03bb8b5fd75c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:02.853812  6922 raft_consensus.cc:385] T b3f13b31a1f84f0d89d007eadd57924c P cd75a17ab2604397adab03bb8b5fd75c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:02.854216  6922 raft_consensus.cc:740] T b3f13b31a1f84f0d89d007eadd57924c P cd75a17ab2604397adab03bb8b5fd75c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cd75a17ab2604397adab03bb8b5fd75c, State: Initialized, Role: FOLLOWER
I20260709 13:18:02.833803  6921 consensus_queue.cc:260] T f3f9c2e2bf644115957398fe4c9459db P b7ab4784c7344b939bc36f639286f377 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:02.849131  6795 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f03d0dbf16864ca4bc1bb5e4c0334c0f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:02.855171  6922 consensus_queue.cc:260] T b3f13b31a1f84f0d89d007eadd57924c P cd75a17ab2604397adab03bb8b5fd75c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:02.865666  6921 ts_tablet_manager.cc:1434] T f3f9c2e2bf644115957398fe4c9459db P b7ab4784c7344b939bc36f639286f377: Time spent starting tablet: real 0.054s	user 0.006s	sys 0.000s
I20260709 13:18:02.868983  6921 tablet_bootstrap.cc:492] T b3f13b31a1f84f0d89d007eadd57924c P b7ab4784c7344b939bc36f639286f377: Bootstrap starting.
I20260709 13:18:02.869978  6923 tablet_bootstrap.cc:654] T bb7fa124c3bf4ef9ab65a407cb008441 P ccd8a4c3bfe3413cb2ae219b09aea832: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:02.871368  6922 ts_tablet_manager.cc:1434] T b3f13b31a1f84f0d89d007eadd57924c P cd75a17ab2604397adab03bb8b5fd75c: Time spent starting tablet: real 0.033s	user 0.014s	sys 0.000s
I20260709 13:18:02.850404  6930 raft_consensus.cc:515] T e77e330a82df4b43a745d57a68f6f057 P b7ab4784c7344b939bc36f639286f377 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } }
I20260709 13:18:02.881476  6930 leader_election.cc:290] T e77e330a82df4b43a745d57a68f6f057 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 1 election: Requested vote from peers cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931), ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391)
I20260709 13:18:02.881731  6718 tablet_service.cc:1511] Processing CreateTablet for tablet 853ac0a8cbd64ce99457f170216d4d0f (DEFAULT_TABLE table=test-workload [id=04f4d366747e43549980077479ed75b9]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 13:18:02.882745  6732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77e330a82df4b43a745d57a68f6f057" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:18:02.883747  6718 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 853ac0a8cbd64ce99457f170216d4d0f. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:18:02.885010  6770 leader_election.cc:343] T e77e330a82df4b43a745d57a68f6f057 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:02.885833  6881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77e330a82df4b43a745d57a68f6f057" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:18:02.886579  6922 tablet_bootstrap.cc:492] T 7887766dc6784fcaa42b35c05fea7a99 P cd75a17ab2604397adab03bb8b5fd75c: Bootstrap starting.
I20260709 13:18:02.888628  6926 raft_consensus.cc:515] T e77e330a82df4b43a745d57a68f6f057 P cd75a17ab2604397adab03bb8b5fd75c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } }
I20260709 13:18:02.896776  6881 raft_consensus.cc:2393] T e77e330a82df4b43a745d57a68f6f057 P cd75a17ab2604397adab03bb8b5fd75c [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate b7ab4784c7344b939bc36f639286f377 in current term 1: Already voted for candidate cd75a17ab2604397adab03bb8b5fd75c in this term.
I20260709 13:18:02.898624  6871 tablet_service.cc:1511] Processing CreateTablet for tablet 853ac0a8cbd64ce99457f170216d4d0f (DEFAULT_TABLE table=test-workload [id=04f4d366747e43549980077479ed75b9]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 13:18:02.899097  6863 tablet_service.cc:1511] Processing CreateTablet for tablet 8c7f33e544204fbaac4078e3e83bbf4e (DEFAULT_TABLE table=test-workload [id=04f4d366747e43549980077479ed75b9]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 13:18:02.900147  6871 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 853ac0a8cbd64ce99457f170216d4d0f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:02.900318  6868 tablet_service.cc:1511] Processing CreateTablet for tablet f03d0dbf16864ca4bc1bb5e4c0334c0f (DEFAULT_TABLE table=test-workload [id=04f4d366747e43549980077479ed75b9]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 13:18:02.900970  6863 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8c7f33e544204fbaac4078e3e83bbf4e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:02.901355  6772 leader_election.cc:304] T e77e330a82df4b43a745d57a68f6f057 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:18:02.901706  6868 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f03d0dbf16864ca4bc1bb5e4c0334c0f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:02.905450  6720 tablet_service.cc:1511] Processing CreateTablet for tablet 8c7f33e544204fbaac4078e3e83bbf4e (DEFAULT_TABLE table=test-workload [id=04f4d366747e43549980077479ed75b9]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 13:18:02.906498  6732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77e330a82df4b43a745d57a68f6f057" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
W20260709 13:18:02.909175  6844 leader_election.cc:343] T e77e330a82df4b43a745d57a68f6f057 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:02.878747  6921 tablet_bootstrap.cc:654] T b3f13b31a1f84f0d89d007eadd57924c P b7ab4784c7344b939bc36f639286f377: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:02.911026  6922 tablet_bootstrap.cc:654] T 7887766dc6784fcaa42b35c05fea7a99 P cd75a17ab2604397adab03bb8b5fd75c: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:02.912510  6806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77e330a82df4b43a745d57a68f6f057" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:18:02.913129  6789 tablet_service.cc:1511] Processing CreateTablet for tablet 8c7f33e544204fbaac4078e3e83bbf4e (DEFAULT_TABLE table=test-workload [id=04f4d366747e43549980077479ed75b9]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 13:18:02.914219  6944 raft_consensus.cc:493] T 404190ce4ce94cecbfcb6ea9d1dd8626 P cd75a17ab2604397adab03bb8b5fd75c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:02.914589  6789 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8c7f33e544204fbaac4078e3e83bbf4e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:02.914733  6926 leader_election.cc:290] T e77e330a82df4b43a745d57a68f6f057 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 1 election: Requested vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391)
I20260709 13:18:02.895450  6793 tablet_service.cc:1511] Processing CreateTablet for tablet 853ac0a8cbd64ce99457f170216d4d0f (DEFAULT_TABLE table=test-workload [id=04f4d366747e43549980077479ed75b9]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 13:18:02.922317  6793 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 853ac0a8cbd64ce99457f170216d4d0f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:02.914780  6944 raft_consensus.cc:515] T 404190ce4ce94cecbfcb6ea9d1dd8626 P cd75a17ab2604397adab03bb8b5fd75c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:02.916392  6720 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8c7f33e544204fbaac4078e3e83bbf4e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:02.913600  6806 raft_consensus.cc:2393] T e77e330a82df4b43a745d57a68f6f057 P b7ab4784c7344b939bc36f639286f377 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c in current term 1: Already voted for candidate b7ab4784c7344b939bc36f639286f377 in this term.
I20260709 13:18:02.938962  6844 leader_election.cc:304] T e77e330a82df4b43a745d57a68f6f057 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:18:02.939889  6921 tablet_bootstrap.cc:492] T b3f13b31a1f84f0d89d007eadd57924c P b7ab4784c7344b939bc36f639286f377: No bootstrap required, opened a new log
I20260709 13:18:02.940709  6921 ts_tablet_manager.cc:1403] T b3f13b31a1f84f0d89d007eadd57924c P b7ab4784c7344b939bc36f639286f377: Time spent bootstrapping tablet: real 0.072s	user 0.011s	sys 0.004s
I20260709 13:18:02.940521  6926 raft_consensus.cc:2749] T e77e330a82df4b43a745d57a68f6f057 P cd75a17ab2604397adab03bb8b5fd75c [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:18:02.940670  6716 tablet_service.cc:1511] Processing CreateTablet for tablet de3186201e1a40d0b335eeb8b4e256e0 (DEFAULT_TABLE table=test-workload [id=04f4d366747e43549980077479ed75b9]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 13:18:02.942471  6716 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet de3186201e1a40d0b335eeb8b4e256e0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:02.943475  6944 leader_election.cc:290] T 404190ce4ce94cecbfcb6ea9d1dd8626 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:18:02.946384  6797 tablet_service.cc:1511] Processing CreateTablet for tablet de3186201e1a40d0b335eeb8b4e256e0 (DEFAULT_TABLE table=test-workload [id=04f4d366747e43549980077479ed75b9]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 13:18:02.947002  6921 raft_consensus.cc:359] T b3f13b31a1f84f0d89d007eadd57924c P b7ab4784c7344b939bc36f639286f377 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:02.947836  6921 raft_consensus.cc:385] T b3f13b31a1f84f0d89d007eadd57924c P b7ab4784c7344b939bc36f639286f377 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:02.948364  6921 raft_consensus.cc:740] T b3f13b31a1f84f0d89d007eadd57924c P b7ab4784c7344b939bc36f639286f377 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Initialized, Role: FOLLOWER
I20260709 13:18:02.949172  6921 consensus_queue.cc:260] T b3f13b31a1f84f0d89d007eadd57924c P b7ab4784c7344b939bc36f639286f377 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:02.954625  6732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "404190ce4ce94cecbfcb6ea9d1dd8626" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:18:02.955296  6806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "404190ce4ce94cecbfcb6ea9d1dd8626" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:18:02.948892  6797 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet de3186201e1a40d0b335eeb8b4e256e0. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:18:02.968185  6844 leader_election.cc:343] T 404190ce4ce94cecbfcb6ea9d1dd8626 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:02.969862  6871 tablet_service.cc:1511] Processing CreateTablet for tablet de3186201e1a40d0b335eeb8b4e256e0 (DEFAULT_TABLE table=test-workload [id=04f4d366747e43549980077479ed75b9]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 13:18:02.971244  6871 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet de3186201e1a40d0b335eeb8b4e256e0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:02.977748  6718 tablet_service.cc:1511] Processing CreateTablet for tablet 7c37d41cd9164c15a6826ca62a851a69 (DEFAULT_TABLE table=test-workload [id=04f4d366747e43549980077479ed75b9]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 13:18:02.979295  6718 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7c37d41cd9164c15a6826ca62a851a69. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:02.956557  6930 raft_consensus.cc:2749] T e77e330a82df4b43a745d57a68f6f057 P b7ab4784c7344b939bc36f639286f377 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:18:02.982018  6921 ts_tablet_manager.cc:1434] T b3f13b31a1f84f0d89d007eadd57924c P b7ab4784c7344b939bc36f639286f377: Time spent starting tablet: real 0.041s	user 0.007s	sys 0.002s
I20260709 13:18:02.983109  6921 tablet_bootstrap.cc:492] T bb7fa124c3bf4ef9ab65a407cb008441 P b7ab4784c7344b939bc36f639286f377: Bootstrap starting.
I20260709 13:18:02.984750  6931 raft_consensus.cc:493] T b3f13b31a1f84f0d89d007eadd57924c P ccd8a4c3bfe3413cb2ae219b09aea832 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:02.985229  6931 raft_consensus.cc:515] T b3f13b31a1f84f0d89d007eadd57924c P ccd8a4c3bfe3413cb2ae219b09aea832 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
W20260709 13:18:02.985579  6844 leader_election.cc:343] T 404190ce4ce94cecbfcb6ea9d1dd8626 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:02.986110  6844 leader_election.cc:304] T 404190ce4ce94cecbfcb6ea9d1dd8626 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:18:02.989001  6931 leader_election.cc:290] T b3f13b31a1f84f0d89d007eadd57924c P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:18:02.997710  6944 raft_consensus.cc:2749] T 404190ce4ce94cecbfcb6ea9d1dd8626 P cd75a17ab2604397adab03bb8b5fd75c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:18:02.998286  6791 tablet_service.cc:1511] Processing CreateTablet for tablet 7c37d41cd9164c15a6826ca62a851a69 (DEFAULT_TABLE table=test-workload [id=04f4d366747e43549980077479ed75b9]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 13:18:03.009229  6791 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7c37d41cd9164c15a6826ca62a851a69. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:03.012252  6922 tablet_bootstrap.cc:492] T 7887766dc6784fcaa42b35c05fea7a99 P cd75a17ab2604397adab03bb8b5fd75c: No bootstrap required, opened a new log
I20260709 13:18:03.012749  6922 ts_tablet_manager.cc:1403] T 7887766dc6784fcaa42b35c05fea7a99 P cd75a17ab2604397adab03bb8b5fd75c: Time spent bootstrapping tablet: real 0.126s	user 0.010s	sys 0.007s
I20260709 13:18:03.014590  6864 tablet_service.cc:1511] Processing CreateTablet for tablet 7c37d41cd9164c15a6826ca62a851a69 (DEFAULT_TABLE table=test-workload [id=04f4d366747e43549980077479ed75b9]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 13:18:03.015964  6864 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7c37d41cd9164c15a6826ca62a851a69. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:03.022392  6719 tablet_service.cc:1511] Processing CreateTablet for tablet d33d5ee8ef6f415593d8df52063161ad (DEFAULT_TABLE table=test-workload [id=04f4d366747e43549980077479ed75b9]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 13:18:03.027369  6923 tablet_bootstrap.cc:492] T bb7fa124c3bf4ef9ab65a407cb008441 P ccd8a4c3bfe3413cb2ae219b09aea832: No bootstrap required, opened a new log
I20260709 13:18:03.015728  6922 raft_consensus.cc:359] T 7887766dc6784fcaa42b35c05fea7a99 P cd75a17ab2604397adab03bb8b5fd75c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:03.028468  6923 ts_tablet_manager.cc:1403] T bb7fa124c3bf4ef9ab65a407cb008441 P ccd8a4c3bfe3413cb2ae219b09aea832: Time spent bootstrapping tablet: real 0.176s	user 0.038s	sys 0.015s
I20260709 13:18:03.028647  6922 raft_consensus.cc:385] T 7887766dc6784fcaa42b35c05fea7a99 P cd75a17ab2604397adab03bb8b5fd75c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:03.029234  6922 raft_consensus.cc:740] T 7887766dc6784fcaa42b35c05fea7a99 P cd75a17ab2604397adab03bb8b5fd75c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cd75a17ab2604397adab03bb8b5fd75c, State: Initialized, Role: FOLLOWER
I20260709 13:18:03.030104  6922 consensus_queue.cc:260] T 7887766dc6784fcaa42b35c05fea7a99 P cd75a17ab2604397adab03bb8b5fd75c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:03.033095  6923 raft_consensus.cc:359] T bb7fa124c3bf4ef9ab65a407cb008441 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:03.023945  6719 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d33d5ee8ef6f415593d8df52063161ad. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:03.037371  6921 tablet_bootstrap.cc:654] T bb7fa124c3bf4ef9ab65a407cb008441 P b7ab4784c7344b939bc36f639286f377: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:03.039500  6923 raft_consensus.cc:385] T bb7fa124c3bf4ef9ab65a407cb008441 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:03.049868  6922 ts_tablet_manager.cc:1434] T 7887766dc6784fcaa42b35c05fea7a99 P cd75a17ab2604397adab03bb8b5fd75c: Time spent starting tablet: real 0.037s	user 0.006s	sys 0.001s
I20260709 13:18:03.050696  6863 tablet_service.cc:1511] Processing CreateTablet for tablet d33d5ee8ef6f415593d8df52063161ad (DEFAULT_TABLE table=test-workload [id=04f4d366747e43549980077479ed75b9]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 13:18:03.051535  6789 tablet_service.cc:1511] Processing CreateTablet for tablet 3fa34c08b205435dba97346991aa1f92 (DEFAULT_TABLE table=test-workload [id=04f4d366747e43549980077479ed75b9]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 13:18:03.052888  6865 tablet_service.cc:1511] Processing CreateTablet for tablet 3fa34c08b205435dba97346991aa1f92 (DEFAULT_TABLE table=test-workload [id=04f4d366747e43549980077479ed75b9]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 13:18:03.060909  6865 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3fa34c08b205435dba97346991aa1f92. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:03.051535  6720 tablet_service.cc:1511] Processing CreateTablet for tablet 3fa34c08b205435dba97346991aa1f92 (DEFAULT_TABLE table=test-workload [id=04f4d366747e43549980077479ed75b9]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 13:18:03.064658  6789 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3fa34c08b205435dba97346991aa1f92. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:03.064714  6795 tablet_service.cc:1511] Processing CreateTablet for tablet d33d5ee8ef6f415593d8df52063161ad (DEFAULT_TABLE table=test-workload [id=04f4d366747e43549980077479ed75b9]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 13:18:03.057900  6716 tablet_service.cc:1511] Processing CreateTablet for tablet dbdf895bba214ff68685a24fd17dfb5d (DEFAULT_TABLE table=test-workload [id=04f4d366747e43549980077479ed75b9]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 13:18:03.065948  6720 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3fa34c08b205435dba97346991aa1f92. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:03.066310  6795 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d33d5ee8ef6f415593d8df52063161ad. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:03.066957  6716 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dbdf895bba214ff68685a24fd17dfb5d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:03.075804  6922 tablet_bootstrap.cc:492] T e31b9971c15848dea59d4d4130141d9e P cd75a17ab2604397adab03bb8b5fd75c: Bootstrap starting.
I20260709 13:18:03.078099  6806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3f13b31a1f84f0d89d007eadd57924c" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:18:03.078862  6806 raft_consensus.cc:2468] T b3f13b31a1f84f0d89d007eadd57924c P b7ab4784c7344b939bc36f639286f377 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 0.
I20260709 13:18:03.078635  6791 tablet_service.cc:1511] Processing CreateTablet for tablet dbdf895bba214ff68685a24fd17dfb5d (DEFAULT_TABLE table=test-workload [id=04f4d366747e43549980077479ed75b9]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 13:18:03.080058  6791 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dbdf895bba214ff68685a24fd17dfb5d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:03.080358  6695 leader_election.cc:304] T b3f13b31a1f84f0d89d007eadd57924c P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
I20260709 13:18:03.081215  6931 raft_consensus.cc:2804] T b3f13b31a1f84f0d89d007eadd57924c P ccd8a4c3bfe3413cb2ae219b09aea832 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:18:03.081705  6931 raft_consensus.cc:493] T b3f13b31a1f84f0d89d007eadd57924c P ccd8a4c3bfe3413cb2ae219b09aea832 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:03.081302  6870 tablet_service.cc:1511] Processing CreateTablet for tablet dbdf895bba214ff68685a24fd17dfb5d (DEFAULT_TABLE table=test-workload [id=04f4d366747e43549980077479ed75b9]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 13:18:03.082121  6931 raft_consensus.cc:3060] T b3f13b31a1f84f0d89d007eadd57924c P ccd8a4c3bfe3413cb2ae219b09aea832 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:03.056535  6923 raft_consensus.cc:740] T bb7fa124c3bf4ef9ab65a407cb008441 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Initialized, Role: FOLLOWER
I20260709 13:18:03.085212  6722 tablet_service.cc:1511] Processing CreateTablet for tablet 9b3759de40694069b13c0f8bd40e5709 (DEFAULT_TABLE table=test-workload [id=04f4d366747e43549980077479ed75b9]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 13:18:03.086902  6722 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9b3759de40694069b13c0f8bd40e5709. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:03.105020  6863 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d33d5ee8ef6f415593d8df52063161ad. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:03.104530  6923 consensus_queue.cc:260] T bb7fa124c3bf4ef9ab65a407cb008441 P ccd8a4c3bfe3413cb2ae219b09aea832 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:03.106084  6870 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dbdf895bba214ff68685a24fd17dfb5d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:03.142390  6881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3f13b31a1f84f0d89d007eadd57924c" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:18:03.142802  6922 tablet_bootstrap.cc:654] T e31b9971c15848dea59d4d4130141d9e P cd75a17ab2604397adab03bb8b5fd75c: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:03.143517  6951 raft_consensus.cc:493] T bb7fa124c3bf4ef9ab65a407cb008441 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:03.144081  6951 raft_consensus.cc:515] T bb7fa124c3bf4ef9ab65a407cb008441 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:03.145588  6797 tablet_service.cc:1511] Processing CreateTablet for tablet 9b3759de40694069b13c0f8bd40e5709 (DEFAULT_TABLE table=test-workload [id=04f4d366747e43549980077479ed75b9]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 13:18:03.146607  6921 tablet_bootstrap.cc:492] T bb7fa124c3bf4ef9ab65a407cb008441 P b7ab4784c7344b939bc36f639286f377: No bootstrap required, opened a new log
I20260709 13:18:03.146239  6793 tablet_service.cc:1511] Processing CreateTablet for tablet 7a734b5ab7834e05a8c422208acc58b1 (DEFAULT_TABLE table=test-workload [id=04f4d366747e43549980077479ed75b9]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 13:18:03.146956  6797 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9b3759de40694069b13c0f8bd40e5709. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:03.147135  6921 ts_tablet_manager.cc:1403] T bb7fa124c3bf4ef9ab65a407cb008441 P b7ab4784c7344b939bc36f639286f377: Time spent bootstrapping tablet: real 0.164s	user 0.020s	sys 0.005s
I20260709 13:18:03.147346  6806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb7fa124c3bf4ef9ab65a407cb008441" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:18:03.147627  6793 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7a734b5ab7834e05a8c422208acc58b1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:03.149605  6880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb7fa124c3bf4ef9ab65a407cb008441" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
W20260709 13:18:03.151211  6697 leader_election.cc:343] T bb7fa124c3bf4ef9ab65a407cb008441 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:03.151767  6951 leader_election.cc:290] T bb7fa124c3bf4ef9ab65a407cb008441 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:18:03.154373  6868 tablet_service.cc:1511] Processing CreateTablet for tablet 9b3759de40694069b13c0f8bd40e5709 (DEFAULT_TABLE table=test-workload [id=04f4d366747e43549980077479ed75b9]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
W20260709 13:18:03.155426  6695 leader_election.cc:343] T bb7fa124c3bf4ef9ab65a407cb008441 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:03.155907  6695 leader_election.cc:304] T bb7fa124c3bf4ef9ab65a407cb008441 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:18:03.131103  6944 raft_consensus.cc:493] T b3f13b31a1f84f0d89d007eadd57924c P cd75a17ab2604397adab03bb8b5fd75c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:03.160461  6944 raft_consensus.cc:515] T b3f13b31a1f84f0d89d007eadd57924c P cd75a17ab2604397adab03bb8b5fd75c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:03.161645  6881 raft_consensus.cc:2468] T b3f13b31a1f84f0d89d007eadd57924c P cd75a17ab2604397adab03bb8b5fd75c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 0.
I20260709 13:18:03.163015  6944 leader_election.cc:290] T b3f13b31a1f84f0d89d007eadd57924c P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:18:03.161311  6951 raft_consensus.cc:2749] T bb7fa124c3bf4ef9ab65a407cb008441 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:18:03.164398  6806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3f13b31a1f84f0d89d007eadd57924c" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:18:03.165086  6806 raft_consensus.cc:2468] T b3f13b31a1f84f0d89d007eadd57924c P b7ab4784c7344b939bc36f639286f377 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 0.
I20260709 13:18:03.165452  6732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3f13b31a1f84f0d89d007eadd57924c" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:18:03.166775  6844 leader_election.cc:304] T b3f13b31a1f84f0d89d007eadd57924c P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:18:03.168001  6944 raft_consensus.cc:2804] T b3f13b31a1f84f0d89d007eadd57924c P cd75a17ab2604397adab03bb8b5fd75c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:18:03.167855  6714 tablet_service.cc:1511] Processing CreateTablet for tablet 7a734b5ab7834e05a8c422208acc58b1 (DEFAULT_TABLE table=test-workload [id=04f4d366747e43549980077479ed75b9]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 13:18:03.168498  6923 ts_tablet_manager.cc:1434] T bb7fa124c3bf4ef9ab65a407cb008441 P ccd8a4c3bfe3413cb2ae219b09aea832: Time spent starting tablet: real 0.139s	user 0.017s	sys 0.008s
I20260709 13:18:03.169454  6714 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7a734b5ab7834e05a8c422208acc58b1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:03.168567  6944 raft_consensus.cc:493] T b3f13b31a1f84f0d89d007eadd57924c P cd75a17ab2604397adab03bb8b5fd75c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:03.172509  6944 raft_consensus.cc:3060] T b3f13b31a1f84f0d89d007eadd57924c P cd75a17ab2604397adab03bb8b5fd75c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:03.178349  6923 tablet_bootstrap.cc:492] T e31b9971c15848dea59d4d4130141d9e P ccd8a4c3bfe3413cb2ae219b09aea832: Bootstrap starting.
I20260709 13:18:03.178606  6864 tablet_service.cc:1511] Processing CreateTablet for tablet 7a734b5ab7834e05a8c422208acc58b1 (DEFAULT_TABLE table=test-workload [id=04f4d366747e43549980077479ed75b9]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 13:18:03.155821  6868 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9b3759de40694069b13c0f8bd40e5709. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:03.159873  6921 raft_consensus.cc:359] T bb7fa124c3bf4ef9ab65a407cb008441 P b7ab4784c7344b939bc36f639286f377 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:03.183331  6921 raft_consensus.cc:385] T bb7fa124c3bf4ef9ab65a407cb008441 P b7ab4784c7344b939bc36f639286f377 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:03.183768  6864 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7a734b5ab7834e05a8c422208acc58b1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:03.183686  6921 raft_consensus.cc:740] T bb7fa124c3bf4ef9ab65a407cb008441 P b7ab4784c7344b939bc36f639286f377 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Initialized, Role: FOLLOWER
I20260709 13:18:03.184649  6921 consensus_queue.cc:260] T bb7fa124c3bf4ef9ab65a407cb008441 P b7ab4784c7344b939bc36f639286f377 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:03.196553  6921 ts_tablet_manager.cc:1434] T bb7fa124c3bf4ef9ab65a407cb008441 P b7ab4784c7344b939bc36f639286f377: Time spent starting tablet: real 0.049s	user 0.008s	sys 0.000s
I20260709 13:18:03.202594  6923 tablet_bootstrap.cc:654] T e31b9971c15848dea59d4d4130141d9e P ccd8a4c3bfe3413cb2ae219b09aea832: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:03.204682  6921 tablet_bootstrap.cc:492] T f58dc08b12a2494bb9a1372837970ca2 P b7ab4784c7344b939bc36f639286f377: Bootstrap starting.
I20260709 13:18:03.208273  6717 tablet_service.cc:1511] Processing CreateTablet for tablet bd6869f07b5a4885a0b99fbe60c3b175 (DEFAULT_TABLE table=test-workload [id=04f4d366747e43549980077479ed75b9]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 13:18:03.209758  6717 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bd6869f07b5a4885a0b99fbe60c3b175. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:03.211570  6952 raft_consensus.cc:493] T f58dc08b12a2494bb9a1372837970ca2 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:03.212116  6952 raft_consensus.cc:515] T f58dc08b12a2494bb9a1372837970ca2 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:03.212756  6921 tablet_bootstrap.cc:654] T f58dc08b12a2494bb9a1372837970ca2 P b7ab4784c7344b939bc36f639286f377: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:03.215078  6952 leader_election.cc:290] T f58dc08b12a2494bb9a1372837970ca2 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:18:03.216027  6806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f58dc08b12a2494bb9a1372837970ca2" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:18:03.216796  6881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f58dc08b12a2494bb9a1372837970ca2" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:18:03.217527  6881 raft_consensus.cc:2468] T f58dc08b12a2494bb9a1372837970ca2 P cd75a17ab2604397adab03bb8b5fd75c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 0.
W20260709 13:18:03.217782  6695 leader_election.cc:343] T f58dc08b12a2494bb9a1372837970ca2 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:03.218982  6697 leader_election.cc:304] T f58dc08b12a2494bb9a1372837970ca2 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377
I20260709 13:18:03.220427  6952 raft_consensus.cc:2804] T f58dc08b12a2494bb9a1372837970ca2 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:18:03.217289  6931 raft_consensus.cc:515] T b3f13b31a1f84f0d89d007eadd57924c P ccd8a4c3bfe3413cb2ae219b09aea832 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:03.220952  6952 raft_consensus.cc:493] T f58dc08b12a2494bb9a1372837970ca2 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:03.221642  6732 raft_consensus.cc:2393] T b3f13b31a1f84f0d89d007eadd57924c P ccd8a4c3bfe3413cb2ae219b09aea832 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c in current term 1: Already voted for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in this term.
I20260709 13:18:03.222718  6931 leader_election.cc:290] T b3f13b31a1f84f0d89d007eadd57924c P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 1 election: Requested vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:18:03.224148  6881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3f13b31a1f84f0d89d007eadd57924c" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:18:03.224560  6806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3f13b31a1f84f0d89d007eadd57924c" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:18:03.221336  6952 raft_consensus.cc:3060] T f58dc08b12a2494bb9a1372837970ca2 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:03.225162  6806 raft_consensus.cc:3060] T b3f13b31a1f84f0d89d007eadd57924c P b7ab4784c7344b939bc36f639286f377 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:03.221699  6797 tablet_service.cc:1511] Processing CreateTablet for tablet bd6869f07b5a4885a0b99fbe60c3b175 (DEFAULT_TABLE table=test-workload [id=04f4d366747e43549980077479ed75b9]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 13:18:03.243896  6797 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bd6869f07b5a4885a0b99fbe60c3b175. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:03.247766  6864 tablet_service.cc:1511] Processing CreateTablet for tablet bd6869f07b5a4885a0b99fbe60c3b175 (DEFAULT_TABLE table=test-workload [id=04f4d366747e43549980077479ed75b9]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 13:18:03.249456  6864 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bd6869f07b5a4885a0b99fbe60c3b175. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:03.264910  6944 raft_consensus.cc:515] T b3f13b31a1f84f0d89d007eadd57924c P cd75a17ab2604397adab03bb8b5fd75c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:03.266371  6881 raft_consensus.cc:2393] T b3f13b31a1f84f0d89d007eadd57924c P cd75a17ab2604397adab03bb8b5fd75c [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate ccd8a4c3bfe3413cb2ae219b09aea832 in current term 1: Already voted for candidate cd75a17ab2604397adab03bb8b5fd75c in this term.
I20260709 13:18:03.267386  6944 leader_election.cc:290] T b3f13b31a1f84f0d89d007eadd57924c P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 1 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:18:03.292279  6930 raft_consensus.cc:493] T f3f9c2e2bf644115957398fe4c9459db P b7ab4784c7344b939bc36f639286f377 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:03.269510  6732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3f13b31a1f84f0d89d007eadd57924c" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:18:03.293149  6930 raft_consensus.cc:515] T f3f9c2e2bf644115957398fe4c9459db P b7ab4784c7344b939bc36f639286f377 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:03.294265  6732 raft_consensus.cc:2393] T b3f13b31a1f84f0d89d007eadd57924c P ccd8a4c3bfe3413cb2ae219b09aea832 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c in current term 1: Already voted for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in this term.
I20260709 13:18:03.294730  6923 tablet_bootstrap.cc:492] T e31b9971c15848dea59d4d4130141d9e P ccd8a4c3bfe3413cb2ae219b09aea832: No bootstrap required, opened a new log
I20260709 13:18:03.295213  6923 ts_tablet_manager.cc:1403] T e31b9971c15848dea59d4d4130141d9e P ccd8a4c3bfe3413cb2ae219b09aea832: Time spent bootstrapping tablet: real 0.117s	user 0.017s	sys 0.004s
I20260709 13:18:03.297750  6807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3f13b31a1f84f0d89d007eadd57924c" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:18:03.299928  6844 leader_election.cc:304] T b3f13b31a1f84f0d89d007eadd57924c P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:18:03.301585  6944 raft_consensus.cc:2749] T b3f13b31a1f84f0d89d007eadd57924c P cd75a17ab2604397adab03bb8b5fd75c [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:18:03.248449  6806 raft_consensus.cc:2468] T b3f13b31a1f84f0d89d007eadd57924c P b7ab4784c7344b939bc36f639286f377 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 1.
I20260709 13:18:03.309757  6695 leader_election.cc:304] T b3f13b31a1f84f0d89d007eadd57924c P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:18:03.311092  6931 raft_consensus.cc:2804] T b3f13b31a1f84f0d89d007eadd57924c P ccd8a4c3bfe3413cb2ae219b09aea832 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:18:03.311643  6931 raft_consensus.cc:697] T b3f13b31a1f84f0d89d007eadd57924c P ccd8a4c3bfe3413cb2ae219b09aea832 [term 1 LEADER]: Becoming Leader. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
I20260709 13:18:03.312671  6931 consensus_queue.cc:237] T b3f13b31a1f84f0d89d007eadd57924c P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:03.323745  6928 raft_consensus.cc:493] T bb7fa124c3bf4ef9ab65a407cb008441 P b7ab4784c7344b939bc36f639286f377 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:03.324457  6928 raft_consensus.cc:515] T bb7fa124c3bf4ef9ab65a407cb008441 P b7ab4784c7344b939bc36f639286f377 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:03.358907  6732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb7fa124c3bf4ef9ab65a407cb008441" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:18:03.359592  6732 raft_consensus.cc:2468] T bb7fa124c3bf4ef9ab65a407cb008441 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 0.
I20260709 13:18:03.360431  6881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb7fa124c3bf4ef9ab65a407cb008441" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
W20260709 13:18:03.361675  6772 leader_election.cc:343] T bb7fa124c3bf4ef9ab65a407cb008441 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:18:03.358952  6614 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 102473us
I20260709 13:18:03.362447  6770 leader_election.cc:304] T bb7fa124c3bf4ef9ab65a407cb008441 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: cd75a17ab2604397adab03bb8b5fd75c
W20260709 13:18:03.353693  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 53940us
W20260709 13:18:03.364817  6678 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:18:03.365710  6923 raft_consensus.cc:359] T e31b9971c15848dea59d4d4130141d9e P ccd8a4c3bfe3413cb2ae219b09aea832 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:03.366617  6923 raft_consensus.cc:385] T e31b9971c15848dea59d4d4130141d9e P ccd8a4c3bfe3413cb2ae219b09aea832 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:03.366986  6923 raft_consensus.cc:740] T e31b9971c15848dea59d4d4130141d9e P ccd8a4c3bfe3413cb2ae219b09aea832 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Initialized, Role: FOLLOWER
I20260709 13:18:03.379681  6957 raft_consensus.cc:2804] T bb7fa124c3bf4ef9ab65a407cb008441 P b7ab4784c7344b939bc36f639286f377 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:18:03.370267  6928 leader_election.cc:290] T bb7fa124c3bf4ef9ab65a407cb008441 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:18:03.378340  6870 tablet_service.cc:1511] Processing CreateTablet for tablet a1704639a875409b9959353527b3fd68 (DEFAULT_TABLE table=test-workload [id=04f4d366747e43549980077479ed75b9]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 13:18:03.382571  6921 tablet_bootstrap.cc:492] T f58dc08b12a2494bb9a1372837970ca2 P b7ab4784c7344b939bc36f639286f377: No bootstrap required, opened a new log
I20260709 13:18:03.387722  6722 tablet_service.cc:1511] Processing CreateTablet for tablet fe20b4b48823486ca3b9c648db6ce8aa (DEFAULT_TABLE table=test-workload [id=04f4d366747e43549980077479ed75b9]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 13:18:03.390141  6722 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fe20b4b48823486ca3b9c648db6ce8aa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:03.392141  6881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f9c2e2bf644115957398fe4c9459db" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
W20260709 13:18:03.397217  6772 leader_election.cc:343] T f3f9c2e2bf644115957398fe4c9459db P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:03.364935  6720 tablet_service.cc:1511] Processing CreateTablet for tablet a1704639a875409b9959353527b3fd68 (DEFAULT_TABLE table=test-workload [id=04f4d366747e43549980077479ed75b9]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 13:18:03.397408  6871 tablet_service.cc:1511] Processing CreateTablet for tablet fe20b4b48823486ca3b9c648db6ce8aa (DEFAULT_TABLE table=test-workload [id=04f4d366747e43549980077479ed75b9]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 13:18:03.386469  6957 raft_consensus.cc:493] T bb7fa124c3bf4ef9ab65a407cb008441 P b7ab4784c7344b939bc36f639286f377 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:03.398501  6720 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a1704639a875409b9959353527b3fd68. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:03.398595  6957 raft_consensus.cc:3060] T bb7fa124c3bf4ef9ab65a407cb008441 P b7ab4784c7344b939bc36f639286f377 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:03.399315  6870 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a1704639a875409b9959353527b3fd68. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:03.367805  6923 consensus_queue.cc:260] T e31b9971c15848dea59d4d4130141d9e P ccd8a4c3bfe3413cb2ae219b09aea832 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:03.403914  6923 ts_tablet_manager.cc:1434] T e31b9971c15848dea59d4d4130141d9e P ccd8a4c3bfe3413cb2ae219b09aea832: Time spent starting tablet: real 0.108s	user 0.006s	sys 0.009s
I20260709 13:18:03.404394  6791 tablet_service.cc:1511] Processing CreateTablet for tablet a1704639a875409b9959353527b3fd68 (DEFAULT_TABLE table=test-workload [id=04f4d366747e43549980077479ed75b9]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 13:18:03.405230  6868 tablet_service.cc:1511] Processing CreateTablet for tablet 3d65025eea89441290d85dd053810e31 (DEFAULT_TABLE table=test-workload [id=04f4d366747e43549980077479ed75b9]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 13:18:03.406038  6791 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a1704639a875409b9959353527b3fd68. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:03.406611  6868 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3d65025eea89441290d85dd053810e31. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:03.408504  6871 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fe20b4b48823486ca3b9c648db6ce8aa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:03.404946  6923 tablet_bootstrap.cc:492] T f3f9c2e2bf644115957398fe4c9459db P ccd8a4c3bfe3413cb2ae219b09aea832: Bootstrap starting.
I20260709 13:18:03.411005  6864 tablet_service.cc:1511] Processing CreateTablet for tablet 24ee15416e3145beaa1b8183453729a3 (DEFAULT_TABLE table=test-workload [id=04f4d366747e43549980077479ed75b9]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 13:18:03.412490  6864 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 24ee15416e3145beaa1b8183453729a3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:03.416599  6923 tablet_bootstrap.cc:654] T f3f9c2e2bf644115957398fe4c9459db P ccd8a4c3bfe3413cb2ae219b09aea832: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:03.419845  6957 raft_consensus.cc:515] T bb7fa124c3bf4ef9ab65a407cb008441 P b7ab4784c7344b939bc36f639286f377 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:03.392422  6930 leader_election.cc:290] T f3f9c2e2bf644115957398fe4c9459db P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:18:03.427160  6922 tablet_bootstrap.cc:492] T e31b9971c15848dea59d4d4130141d9e P cd75a17ab2604397adab03bb8b5fd75c: No bootstrap required, opened a new log
I20260709 13:18:03.427809  6922 ts_tablet_manager.cc:1403] T e31b9971c15848dea59d4d4130141d9e P cd75a17ab2604397adab03bb8b5fd75c: Time spent bootstrapping tablet: real 0.352s	user 0.012s	sys 0.017s
I20260709 13:18:03.431107  6922 raft_consensus.cc:359] T e31b9971c15848dea59d4d4130141d9e P cd75a17ab2604397adab03bb8b5fd75c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:03.433341  6952 raft_consensus.cc:515] T f58dc08b12a2494bb9a1372837970ca2 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:03.434376  6868 tablet_service.cc:1511] Processing CreateTablet for tablet f5be3a11b23d4ea9b08300a2789821c7 (DEFAULT_TABLE table=test-workload [id=04f4d366747e43549980077479ed75b9]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 13:18:03.435580  6952 leader_election.cc:290] T f58dc08b12a2494bb9a1372837970ca2 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 1 election: Requested vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:18:03.394382  6921 ts_tablet_manager.cc:1403] T f58dc08b12a2494bb9a1372837970ca2 P b7ab4784c7344b939bc36f639286f377: Time spent bootstrapping tablet: real 0.190s	user 0.027s	sys 0.014s
I20260709 13:18:03.436259  6806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f58dc08b12a2494bb9a1372837970ca2" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:18:03.436182  6881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb7fa124c3bf4ef9ab65a407cb008441" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:18:03.437036  6868 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f5be3a11b23d4ea9b08300a2789821c7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:03.436868  6880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f58dc08b12a2494bb9a1372837970ca2" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:18:03.437498  6880 raft_consensus.cc:3060] T f58dc08b12a2494bb9a1372837970ca2 P cd75a17ab2604397adab03bb8b5fd75c [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:18:03.438637  6695 leader_election.cc:343] T f58dc08b12a2494bb9a1372837970ca2 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:03.439697  6921 raft_consensus.cc:359] T f58dc08b12a2494bb9a1372837970ca2 P b7ab4784c7344b939bc36f639286f377 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:03.440471  6921 raft_consensus.cc:385] T f58dc08b12a2494bb9a1372837970ca2 P b7ab4784c7344b939bc36f639286f377 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:03.440757  6921 raft_consensus.cc:740] T f58dc08b12a2494bb9a1372837970ca2 P b7ab4784c7344b939bc36f639286f377 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Initialized, Role: FOLLOWER
W20260709 13:18:03.441056  6772 leader_election.cc:343] T bb7fa124c3bf4ef9ab65a407cb008441 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:03.431947  6922 raft_consensus.cc:385] T e31b9971c15848dea59d4d4130141d9e P cd75a17ab2604397adab03bb8b5fd75c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:03.455961  6630 catalog_manager.cc:5697] T b3f13b31a1f84f0d89d007eadd57924c P ccd8a4c3bfe3413cb2ae219b09aea832 reported cstate change: term changed from 0 to 1, leader changed from <none> to ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65). New cstate: current_term: 1 leader_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:03.436841  6957 leader_election.cc:290] T bb7fa124c3bf4ef9ab65a407cb008441 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 1 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:18:03.463338  6732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f9c2e2bf644115957398fe4c9459db" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:18:03.463920  6868 tablet_service.cc:1511] Processing CreateTablet for tablet bb3d8792045a4583ae2e965b1350a5b4 (DEFAULT_TABLE table=test-workload [id=04f4d366747e43549980077479ed75b9]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 13:18:03.465384  6868 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bb3d8792045a4583ae2e965b1350a5b4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:03.468024  6720 tablet_service.cc:1511] Processing CreateTablet for tablet 24ee15416e3145beaa1b8183453729a3 (DEFAULT_TABLE table=test-workload [id=04f4d366747e43549980077479ed75b9]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 13:18:03.471392  6716 tablet_service.cc:1511] Processing CreateTablet for tablet f5be3a11b23d4ea9b08300a2789821c7 (DEFAULT_TABLE table=test-workload [id=04f4d366747e43549980077479ed75b9]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 13:18:03.474402  6714 tablet_service.cc:1511] Processing CreateTablet for tablet bb3d8792045a4583ae2e965b1350a5b4 (DEFAULT_TABLE table=test-workload [id=04f4d366747e43549980077479ed75b9]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 13:18:03.457008  6922 raft_consensus.cc:740] T e31b9971c15848dea59d4d4130141d9e P cd75a17ab2604397adab03bb8b5fd75c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cd75a17ab2604397adab03bb8b5fd75c, State: Initialized, Role: FOLLOWER
I20260709 13:18:03.476212  6944 raft_consensus.cc:493] T 7887766dc6784fcaa42b35c05fea7a99 P cd75a17ab2604397adab03bb8b5fd75c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:03.476982  6922 consensus_queue.cc:260] T e31b9971c15848dea59d4d4130141d9e P cd75a17ab2604397adab03bb8b5fd75c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:03.477810  6720 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 24ee15416e3145beaa1b8183453729a3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:03.478336  6880 raft_consensus.cc:2468] T f58dc08b12a2494bb9a1372837970ca2 P cd75a17ab2604397adab03bb8b5fd75c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 1.
I20260709 13:18:03.479817  6697 leader_election.cc:304] T f58dc08b12a2494bb9a1372837970ca2 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377
I20260709 13:18:03.481128  6931 raft_consensus.cc:2804] T f58dc08b12a2494bb9a1372837970ca2 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:18:03.481629  6931 raft_consensus.cc:697] T f58dc08b12a2494bb9a1372837970ca2 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 1 LEADER]: Becoming Leader. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
I20260709 13:18:03.477039  6944 raft_consensus.cc:515] T 7887766dc6784fcaa42b35c05fea7a99 P cd75a17ab2604397adab03bb8b5fd75c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:03.482517  6931 consensus_queue.cc:237] T f58dc08b12a2494bb9a1372837970ca2 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:03.485253  6732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7887766dc6784fcaa42b35c05fea7a99" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:18:03.441514  6921 consensus_queue.cc:260] T f58dc08b12a2494bb9a1372837970ca2 P b7ab4784c7344b939bc36f639286f377 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:03.457280  6952 raft_consensus.cc:493] T e31b9971c15848dea59d4d4130141d9e P ccd8a4c3bfe3413cb2ae219b09aea832 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:03.498598  6716 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f5be3a11b23d4ea9b08300a2789821c7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:03.496222  6731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb7fa124c3bf4ef9ab65a407cb008441" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:18:03.499756  6731 raft_consensus.cc:3060] T bb7fa124c3bf4ef9ab65a407cb008441 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:03.501339  6868 tablet_service.cc:1511] Processing CreateTablet for tablet 34f36d59d88f40fe8a2805e604fc6c0a (DEFAULT_TABLE table=test-workload [id=04f4d366747e43549980077479ed75b9]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 13:18:03.503160  6868 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 34f36d59d88f40fe8a2805e604fc6c0a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:03.494673  6952 raft_consensus.cc:515] T e31b9971c15848dea59d4d4130141d9e P ccd8a4c3bfe3413cb2ae219b09aea832 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:03.507135  6944 leader_election.cc:290] T 7887766dc6784fcaa42b35c05fea7a99 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:18:03.507273  6806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e31b9971c15848dea59d4d4130141d9e" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
W20260709 13:18:03.509023  6695 leader_election.cc:343] T e31b9971c15848dea59d4d4130141d9e P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:03.509447  6921 ts_tablet_manager.cc:1434] T f58dc08b12a2494bb9a1372837970ca2 P b7ab4784c7344b939bc36f639286f377: Time spent starting tablet: real 0.073s	user 0.007s	sys 0.000s
I20260709 13:18:03.510819  6921 tablet_bootstrap.cc:492] T a3022224cc81473690653a83d4e99470 P b7ab4784c7344b939bc36f639286f377: Bootstrap starting.
W20260709 13:18:03.511467  6844 leader_election.cc:343] T 7887766dc6784fcaa42b35c05fea7a99 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:03.514227  6731 raft_consensus.cc:2468] T bb7fa124c3bf4ef9ab65a407cb008441 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 1.
I20260709 13:18:03.515938  6880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e31b9971c15848dea59d4d4130141d9e" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:18:03.516687  6880 raft_consensus.cc:2468] T e31b9971c15848dea59d4d4130141d9e P cd75a17ab2604397adab03bb8b5fd75c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 0.
I20260709 13:18:03.517838  6697 leader_election.cc:304] T e31b9971c15848dea59d4d4130141d9e P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377
I20260709 13:18:03.518697  6951 raft_consensus.cc:2804] T e31b9971c15848dea59d4d4130141d9e P ccd8a4c3bfe3413cb2ae219b09aea832 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:18:03.519042  6951 raft_consensus.cc:493] T e31b9971c15848dea59d4d4130141d9e P ccd8a4c3bfe3413cb2ae219b09aea832 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:03.519344  6951 raft_consensus.cc:3060] T e31b9971c15848dea59d4d4130141d9e P ccd8a4c3bfe3413cb2ae219b09aea832 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:03.521658  6789 tablet_service.cc:1511] Processing CreateTablet for tablet 3d65025eea89441290d85dd053810e31 (DEFAULT_TABLE table=test-workload [id=04f4d366747e43549980077479ed75b9]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
W20260709 13:18:03.522737  6770 leader_election.cc:343] T f3f9c2e2bf644115957398fe4c9459db P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:03.522631  6795 tablet_service.cc:1511] Processing CreateTablet for tablet f5be3a11b23d4ea9b08300a2789821c7 (DEFAULT_TABLE table=test-workload [id=04f4d366747e43549980077479ed75b9]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 13:18:03.522879  6790 tablet_service.cc:1511] Processing CreateTablet for tablet bb3d8792045a4583ae2e965b1350a5b4 (DEFAULT_TABLE table=test-workload [id=04f4d366747e43549980077479ed75b9]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 13:18:03.523351  6789 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3d65025eea89441290d85dd053810e31. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:03.523247  6770 leader_election.cc:304] T f3f9c2e2bf644115957398fe4c9459db P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:18:03.524210  6957 raft_consensus.cc:2749] T f3f9c2e2bf644115957398fe4c9459db P b7ab4784c7344b939bc36f639286f377 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:18:03.524446  6806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7887766dc6784fcaa42b35c05fea7a99" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:18:03.521658  6797 tablet_service.cc:1511] Processing CreateTablet for tablet fe20b4b48823486ca3b9c648db6ce8aa (DEFAULT_TABLE table=test-workload [id=04f4d366747e43549980077479ed75b9]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 13:18:03.525050  6793 tablet_service.cc:1511] Processing CreateTablet for tablet 24ee15416e3145beaa1b8183453729a3 (DEFAULT_TABLE table=test-workload [id=04f4d366747e43549980077479ed75b9]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 13:18:03.528606  6717 tablet_service.cc:1511] Processing CreateTablet for tablet 3d65025eea89441290d85dd053810e31 (DEFAULT_TABLE table=test-workload [id=04f4d366747e43549980077479ed75b9]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 13:18:03.529883  6717 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3d65025eea89441290d85dd053810e31. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:03.529357  6863 tablet_service.cc:1511] Processing CreateTablet for tablet c4db81d9d329422bb3b4160ca4ac2d1d (DEFAULT_TABLE table=test-workload [id=04f4d366747e43549980077479ed75b9]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 13:18:03.531267  6951 raft_consensus.cc:515] T e31b9971c15848dea59d4d4130141d9e P ccd8a4c3bfe3413cb2ae219b09aea832 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:03.531644  6863 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c4db81d9d329422bb3b4160ca4ac2d1d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:03.532356  6795 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f5be3a11b23d4ea9b08300a2789821c7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:03.540158  6952 leader_election.cc:290] T e31b9971c15848dea59d4d4130141d9e P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:18:03.541308  6714 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bb3d8792045a4583ae2e965b1350a5b4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:03.542327  6865 tablet_service.cc:1511] Processing CreateTablet for tablet 7c44c4849aa54f2b94d1f1bef9ed546f (DEFAULT_TABLE table=test-workload [id=04f4d366747e43549980077479ed75b9]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 13:18:03.542704  6719 tablet_service.cc:1511] Processing CreateTablet for tablet 34f36d59d88f40fe8a2805e604fc6c0a (DEFAULT_TABLE table=test-workload [id=04f4d366747e43549980077479ed75b9]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 13:18:03.543658  6865 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7c44c4849aa54f2b94d1f1bef9ed546f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:03.544178  6719 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 34f36d59d88f40fe8a2805e604fc6c0a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:03.544727  6790 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bb3d8792045a4583ae2e965b1350a5b4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:03.556224  6793 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 24ee15416e3145beaa1b8183453729a3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:03.558610  6806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e31b9971c15848dea59d4d4130141d9e" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
W20260709 13:18:03.560362  6695 leader_election.cc:343] T e31b9971c15848dea59d4d4130141d9e P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:03.561033  6797 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fe20b4b48823486ca3b9c648db6ce8aa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:03.564446  6880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e31b9971c15848dea59d4d4130141d9e" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:18:03.565122  6880 raft_consensus.cc:3060] T e31b9971c15848dea59d4d4130141d9e P cd75a17ab2604397adab03bb8b5fd75c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:03.556466  6770 leader_election.cc:304] T bb7fa124c3bf4ef9ab65a407cb008441 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:18:03.566216  6957 raft_consensus.cc:2804] T bb7fa124c3bf4ef9ab65a407cb008441 P b7ab4784c7344b939bc36f639286f377 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:18:03.566732  6957 raft_consensus.cc:697] T bb7fa124c3bf4ef9ab65a407cb008441 P b7ab4784c7344b939bc36f639286f377 [term 1 LEADER]: Becoming Leader. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
W20260709 13:18:03.566829  6844 leader_election.cc:343] T 7887766dc6784fcaa42b35c05fea7a99 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:03.567380  6844 leader_election.cc:304] T 7887766dc6784fcaa42b35c05fea7a99 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:18:03.567165  6951 leader_election.cc:290] T e31b9971c15848dea59d4d4130141d9e P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 1 election: Requested vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:18:03.567660  6957 consensus_queue.cc:237] T bb7fa124c3bf4ef9ab65a407cb008441 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:03.568598  6944 raft_consensus.cc:2749] T 7887766dc6784fcaa42b35c05fea7a99 P cd75a17ab2604397adab03bb8b5fd75c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:18:03.570039  6923 tablet_bootstrap.cc:492] T f3f9c2e2bf644115957398fe4c9459db P ccd8a4c3bfe3413cb2ae219b09aea832: No bootstrap required, opened a new log
I20260709 13:18:03.562026  6922 ts_tablet_manager.cc:1434] T e31b9971c15848dea59d4d4130141d9e P cd75a17ab2604397adab03bb8b5fd75c: Time spent starting tablet: real 0.134s	user 0.017s	sys 0.013s
I20260709 13:18:03.574647  6718 tablet_service.cc:1511] Processing CreateTablet for tablet c4db81d9d329422bb3b4160ca4ac2d1d (DEFAULT_TABLE table=test-workload [id=04f4d366747e43549980077479ed75b9]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 13:18:03.574843  6715 tablet_service.cc:1511] Processing CreateTablet for tablet 7c44c4849aa54f2b94d1f1bef9ed546f (DEFAULT_TABLE table=test-workload [id=04f4d366747e43549980077479ed75b9]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 13:18:03.561249  6921 tablet_bootstrap.cc:654] T a3022224cc81473690653a83d4e99470 P b7ab4784c7344b939bc36f639286f377: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:03.584496  6718 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c4db81d9d329422bb3b4160ca4ac2d1d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:03.591797  6713 tablet_service.cc:1511] Processing CreateTablet for tablet 713b5728a197487c9300b310ab94e5a3 (DEFAULT_TABLE table=test-workload [id=04f4d366747e43549980077479ed75b9]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 13:18:03.585120  6923 ts_tablet_manager.cc:1403] T f3f9c2e2bf644115957398fe4c9459db P ccd8a4c3bfe3413cb2ae219b09aea832: Time spent bootstrapping tablet: real 0.180s	user 0.023s	sys 0.035s
I20260709 13:18:03.612816  6792 tablet_service.cc:1511] Processing CreateTablet for tablet 34f36d59d88f40fe8a2805e604fc6c0a (DEFAULT_TABLE table=test-workload [id=04f4d366747e43549980077479ed75b9]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 13:18:03.614732  6792 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 34f36d59d88f40fe8a2805e604fc6c0a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:03.619057  6796 tablet_service.cc:1511] Processing CreateTablet for tablet c4db81d9d329422bb3b4160ca4ac2d1d (DEFAULT_TABLE table=test-workload [id=04f4d366747e43549980077479ed75b9]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 13:18:03.621105  6788 tablet_service.cc:1511] Processing CreateTablet for tablet 7c44c4849aa54f2b94d1f1bef9ed546f (DEFAULT_TABLE table=test-workload [id=04f4d366747e43549980077479ed75b9]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 13:18:03.602664  6715 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7c44c4849aa54f2b94d1f1bef9ed546f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:03.625567  6721 tablet_service.cc:1511] Processing CreateTablet for tablet d8cee0accdb8499c86d4414b72565a38 (DEFAULT_TABLE table=test-workload [id=04f4d366747e43549980077479ed75b9]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 13:18:03.626863  6721 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d8cee0accdb8499c86d4414b72565a38. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:03.630676  6867 tablet_service.cc:1511] Processing CreateTablet for tablet d8292e16e5654be6bc408560cf256aaa (DEFAULT_TABLE table=test-workload [id=04f4d366747e43549980077479ed75b9]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 13:18:03.631943  6867 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d8292e16e5654be6bc408560cf256aaa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:03.633127  6794 tablet_service.cc:1511] Processing CreateTablet for tablet 713b5728a197487c9300b310ab94e5a3 (DEFAULT_TABLE table=test-workload [id=04f4d366747e43549980077479ed75b9]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 13:18:03.630676  6866 tablet_service.cc:1511] Processing CreateTablet for tablet 9e326172347f45e99a0d482b5d8ef768 (DEFAULT_TABLE table=test-workload [id=04f4d366747e43549980077479ed75b9]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 13:18:03.634835  6866 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9e326172347f45e99a0d482b5d8ef768. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:03.641777  6862 tablet_service.cc:1511] Processing CreateTablet for tablet 2c240553ce044eedb41541d72b9475d7 (DEFAULT_TABLE table=test-workload [id=04f4d366747e43549980077479ed75b9]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 13:18:03.641965  6869 tablet_service.cc:1511] Processing CreateTablet for tablet 95a75bfe094d4bdc963aba3f08dfcd25 (DEFAULT_TABLE table=test-workload [id=04f4d366747e43549980077479ed75b9]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 13:18:03.642180  6722 tablet_service.cc:1511] Processing CreateTablet for tablet 9e326172347f45e99a0d482b5d8ef768 (DEFAULT_TABLE table=test-workload [id=04f4d366747e43549980077479ed75b9]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 13:18:03.643443  6862 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2c240553ce044eedb41541d72b9475d7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:03.645318  6869 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 95a75bfe094d4bdc963aba3f08dfcd25. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:03.648664  6864 tablet_service.cc:1511] Processing CreateTablet for tablet d8cee0accdb8499c86d4414b72565a38 (DEFAULT_TABLE table=test-workload [id=04f4d366747e43549980077479ed75b9]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 13:18:03.650688  6880 raft_consensus.cc:2468] T e31b9971c15848dea59d4d4130141d9e P cd75a17ab2604397adab03bb8b5fd75c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 1.
I20260709 13:18:03.652136  6697 leader_election.cc:304] T e31b9971c15848dea59d4d4130141d9e P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377
I20260709 13:18:03.654111  6951 raft_consensus.cc:2804] T e31b9971c15848dea59d4d4130141d9e P ccd8a4c3bfe3413cb2ae219b09aea832 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:18:03.654604  6951 raft_consensus.cc:697] T e31b9971c15848dea59d4d4130141d9e P ccd8a4c3bfe3413cb2ae219b09aea832 [term 1 LEADER]: Becoming Leader. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
I20260709 13:18:03.655434  6951 consensus_queue.cc:237] T e31b9971c15848dea59d4d4130141d9e P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:03.659071  6923 raft_consensus.cc:359] T f3f9c2e2bf644115957398fe4c9459db P ccd8a4c3bfe3413cb2ae219b09aea832 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:03.659904  6923 raft_consensus.cc:385] T f3f9c2e2bf644115957398fe4c9459db P ccd8a4c3bfe3413cb2ae219b09aea832 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:03.660262  6923 raft_consensus.cc:740] T f3f9c2e2bf644115957398fe4c9459db P ccd8a4c3bfe3413cb2ae219b09aea832 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Initialized, Role: FOLLOWER
I20260709 13:18:03.643443  6722 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9e326172347f45e99a0d482b5d8ef768. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:03.668407  6871 tablet_service.cc:1511] Processing CreateTablet for tablet b56bf91d90824c959e21e0cee5ba1816 (DEFAULT_TABLE table=test-workload [id=04f4d366747e43549980077479ed75b9]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 13:18:03.670428  6868 tablet_service.cc:1511] Processing CreateTablet for tablet 713b5728a197487c9300b310ab94e5a3 (DEFAULT_TABLE table=test-workload [id=04f4d366747e43549980077479ed75b9]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 13:18:03.650866  6864 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d8cee0accdb8499c86d4414b72565a38. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:03.674032  6720 tablet_service.cc:1511] Processing CreateTablet for tablet d8292e16e5654be6bc408560cf256aaa (DEFAULT_TABLE table=test-workload [id=04f4d366747e43549980077479ed75b9]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 13:18:03.675191  6720 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d8292e16e5654be6bc408560cf256aaa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:03.690601  6789 tablet_service.cc:1511] Processing CreateTablet for tablet 9e326172347f45e99a0d482b5d8ef768 (DEFAULT_TABLE table=test-workload [id=04f4d366747e43549980077479ed75b9]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 13:18:03.701495  6870 tablet_service.cc:1511] Processing CreateTablet for tablet 22ccee1b570c4ad3a57bd7aec085b1b4 (DEFAULT_TABLE table=test-workload [id=04f4d366747e43549980077479ed75b9]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 13:18:03.697924  6790 tablet_service.cc:1511] Processing CreateTablet for tablet d8cee0accdb8499c86d4414b72565a38 (DEFAULT_TABLE table=test-workload [id=04f4d366747e43549980077479ed75b9]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 13:18:03.706873  6795 tablet_service.cc:1511] Processing CreateTablet for tablet d8292e16e5654be6bc408560cf256aaa (DEFAULT_TABLE table=test-workload [id=04f4d366747e43549980077479ed75b9]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 13:18:03.708360  6922 tablet_bootstrap.cc:492] T f3f9c2e2bf644115957398fe4c9459db P cd75a17ab2604397adab03bb8b5fd75c: Bootstrap starting.
I20260709 13:18:03.708231  6721 tablet_service.cc:1511] Processing CreateTablet for tablet 2c240553ce044eedb41541d72b9475d7 (DEFAULT_TABLE table=test-workload [id=04f4d366747e43549980077479ed75b9]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 13:18:03.709020  6713 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 713b5728a197487c9300b310ab94e5a3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:03.712632  6788 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7c44c4849aa54f2b94d1f1bef9ed546f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:03.720851  6868 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 713b5728a197487c9300b310ab94e5a3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:03.732477  6721 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2c240553ce044eedb41541d72b9475d7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:03.736775  6871 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b56bf91d90824c959e21e0cee5ba1816. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:03.740625  6794 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 713b5728a197487c9300b310ab94e5a3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:03.746433  6720 tablet_service.cc:1511] Processing CreateTablet for tablet 95a75bfe094d4bdc963aba3f08dfcd25 (DEFAULT_TABLE table=test-workload [id=04f4d366747e43549980077479ed75b9]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 13:18:03.747794  6720 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 95a75bfe094d4bdc963aba3f08dfcd25. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:03.752756  6923 consensus_queue.cc:260] T f3f9c2e2bf644115957398fe4c9459db P ccd8a4c3bfe3413cb2ae219b09aea832 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:03.767756  6923 ts_tablet_manager.cc:1434] T f3f9c2e2bf644115957398fe4c9459db P ccd8a4c3bfe3413cb2ae219b09aea832: Time spent starting tablet: real 0.164s	user 0.006s	sys 0.000s
I20260709 13:18:03.772111  6791 tablet_service.cc:1511] Processing CreateTablet for tablet 95a75bfe094d4bdc963aba3f08dfcd25 (DEFAULT_TABLE table=test-workload [id=04f4d366747e43549980077479ed75b9]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 13:18:03.772382  6715 tablet_service.cc:1511] Processing CreateTablet for tablet b56bf91d90824c959e21e0cee5ba1816 (DEFAULT_TABLE table=test-workload [id=04f4d366747e43549980077479ed75b9]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 13:18:03.788967  6923 tablet_bootstrap.cc:492] T 404190ce4ce94cecbfcb6ea9d1dd8626 P ccd8a4c3bfe3413cb2ae219b09aea832: Bootstrap starting.
I20260709 13:18:03.791163  6867 tablet_service.cc:1511] Processing CreateTablet for tablet ab432e62819d499eaaf3dd55481dd930 (DEFAULT_TABLE table=test-workload [id=04f4d366747e43549980077479ed75b9]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 13:18:03.762348  6796 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c4db81d9d329422bb3b4160ca4ac2d1d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:03.789508  6715 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b56bf91d90824c959e21e0cee5ba1816. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:03.796397  6951 consensus_queue.cc:1048] T b3f13b31a1f84f0d89d007eadd57924c P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:18:03.798713  6863 tablet_service.cc:1511] Processing CreateTablet for tablet 3411566abe2d4c9bb4b2adfdd05e6f17 (DEFAULT_TABLE table=test-workload [id=04f4d366747e43549980077479ed75b9]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 13:18:03.801474  6797 tablet_service.cc:1511] Processing CreateTablet for tablet 2c240553ce044eedb41541d72b9475d7 (DEFAULT_TABLE table=test-workload [id=04f4d366747e43549980077479ed75b9]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 13:18:03.806826  6921 tablet_bootstrap.cc:492] T a3022224cc81473690653a83d4e99470 P b7ab4784c7344b939bc36f639286f377: No bootstrap required, opened a new log
I20260709 13:18:03.808903  6870 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 22ccee1b570c4ad3a57bd7aec085b1b4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:03.821208  6921 ts_tablet_manager.cc:1403] T a3022224cc81473690653a83d4e99470 P b7ab4784c7344b939bc36f639286f377: Time spent bootstrapping tablet: real 0.311s	user 0.030s	sys 0.035s
I20260709 13:18:03.824203  6789 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9e326172347f45e99a0d482b5d8ef768. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:03.802233  6866 tablet_service.cc:1511] Processing CreateTablet for tablet 17587d6730594da4a56fa13a353232a1 (DEFAULT_TABLE table=test-workload [id=04f4d366747e43549980077479ed75b9]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 13:18:03.832508  6795 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d8292e16e5654be6bc408560cf256aaa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:03.832593  6628 catalog_manager.cc:5697] T bb7fa124c3bf4ef9ab65a407cb008441 P b7ab4784c7344b939bc36f639286f377 reported cstate change: term changed from 0 to 1, leader changed from <none> to b7ab4784c7344b939bc36f639286f377 (127.5.126.66). New cstate: current_term: 1 leader_uuid: "b7ab4784c7344b939bc36f639286f377" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:03.835897  6797 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2c240553ce044eedb41541d72b9475d7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:03.815954  6719 tablet_service.cc:1511] Processing CreateTablet for tablet 22ccee1b570c4ad3a57bd7aec085b1b4 (DEFAULT_TABLE table=test-workload [id=04f4d366747e43549980077479ed75b9]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 13:18:03.836421  6720 tablet_service.cc:1511] Processing CreateTablet for tablet 17587d6730594da4a56fa13a353232a1 (DEFAULT_TABLE table=test-workload [id=04f4d366747e43549980077479ed75b9]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 13:18:03.842770  6951 consensus_queue.cc:1048] T b3f13b31a1f84f0d89d007eadd57924c P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:18:03.847364  6717 tablet_service.cc:1511] Processing CreateTablet for tablet 3411566abe2d4c9bb4b2adfdd05e6f17 (DEFAULT_TABLE table=test-workload [id=04f4d366747e43549980077479ed75b9]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 13:18:03.849078  6714 tablet_service.cc:1511] Processing CreateTablet for tablet 7ba5dac66ab5497e9e336f2a3c28cda5 (DEFAULT_TABLE table=test-workload [id=04f4d366747e43549980077479ed75b9]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 13:18:03.850416  6714 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7ba5dac66ab5497e9e336f2a3c28cda5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:03.852275  6863 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3411566abe2d4c9bb4b2adfdd05e6f17. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:03.854014  6720 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 17587d6730594da4a56fa13a353232a1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:03.856062  6866 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 17587d6730594da4a56fa13a353232a1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:03.856819  6717 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3411566abe2d4c9bb4b2adfdd05e6f17. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:03.828380  6722 tablet_service.cc:1511] Processing CreateTablet for tablet ab432e62819d499eaaf3dd55481dd930 (DEFAULT_TABLE table=test-workload [id=04f4d366747e43549980077479ed75b9]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 13:18:03.858471  6722 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ab432e62819d499eaaf3dd55481dd930. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:03.858544  6867 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ab432e62819d499eaaf3dd55481dd930. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:03.874632  6957 raft_consensus.cc:493] T f58dc08b12a2494bb9a1372837970ca2 P b7ab4784c7344b939bc36f639286f377 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:03.875300  6957 raft_consensus.cc:515] T f58dc08b12a2494bb9a1372837970ca2 P b7ab4784c7344b939bc36f639286f377 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:03.879477  6807 raft_consensus.cc:3060] T f58dc08b12a2494bb9a1372837970ca2 P b7ab4784c7344b939bc36f639286f377 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:03.879424  6793 tablet_service.cc:1511] Processing CreateTablet for tablet b56bf91d90824c959e21e0cee5ba1816 (DEFAULT_TABLE table=test-workload [id=04f4d366747e43549980077479ed75b9]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 13:18:03.882251  6881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f58dc08b12a2494bb9a1372837970ca2" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:18:03.886109  6881 raft_consensus.cc:2393] T f58dc08b12a2494bb9a1372837970ca2 P cd75a17ab2604397adab03bb8b5fd75c [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7ab4784c7344b939bc36f639286f377 in current term 1: Already voted for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in this term.
I20260709 13:18:03.889119  6864 tablet_service.cc:1511] Processing CreateTablet for tablet 7ba5dac66ab5497e9e336f2a3c28cda5 (DEFAULT_TABLE table=test-workload [id=04f4d366747e43549980077479ed75b9]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 13:18:03.890463  6864 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7ba5dac66ab5497e9e336f2a3c28cda5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:03.882512  6957 leader_election.cc:290] T f58dc08b12a2494bb9a1372837970ca2 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:18:03.900632  6731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f58dc08b12a2494bb9a1372837970ca2" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:18:03.901705  6719 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 22ccee1b570c4ad3a57bd7aec085b1b4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:03.880189  6790 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d8cee0accdb8499c86d4414b72565a38. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:03.907343  6951 raft_consensus.cc:493] T f3f9c2e2bf644115957398fe4c9459db P ccd8a4c3bfe3413cb2ae219b09aea832 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:03.907720  6770 leader_election.cc:304] T f58dc08b12a2494bb9a1372837970ca2 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:18:03.907856  6951 raft_consensus.cc:515] T f3f9c2e2bf644115957398fe4c9459db P ccd8a4c3bfe3413cb2ae219b09aea832 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:03.910588  6791 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 95a75bfe094d4bdc963aba3f08dfcd25. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:03.912015  6793 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b56bf91d90824c959e21e0cee5ba1816. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:03.912823  6921 raft_consensus.cc:359] T a3022224cc81473690653a83d4e99470 P b7ab4784c7344b939bc36f639286f377 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:03.913143  6716 tablet_service.cc:1511] Processing CreateTablet for tablet 711ef6523deb4cbe8ef2ba61e1c21c98 (DEFAULT_TABLE table=test-workload [id=04f4d366747e43549980077479ed75b9]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 13:18:03.913596  6921 raft_consensus.cc:385] T a3022224cc81473690653a83d4e99470 P b7ab4784c7344b939bc36f639286f377 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:03.913926  6921 raft_consensus.cc:740] T a3022224cc81473690653a83d4e99470 P b7ab4784c7344b939bc36f639286f377 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Initialized, Role: FOLLOWER
I20260709 13:18:03.914842  6921 consensus_queue.cc:260] T a3022224cc81473690653a83d4e99470 P b7ab4784c7344b939bc36f639286f377 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:03.918190  6922 tablet_bootstrap.cc:700] T f3f9c2e2bf644115957398fe4c9459db P cd75a17ab2604397adab03bb8b5fd75c: Time spent opening tablet: real 0.116s	user 0.000s	sys 0.000s
I20260709 13:18:03.919083  6922 tablet_bootstrap.cc:654] T f3f9c2e2bf644115957398fe4c9459db P cd75a17ab2604397adab03bb8b5fd75c: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:03.941730  6716 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 711ef6523deb4cbe8ef2ba61e1c21c98. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:03.942420  6951 leader_election.cc:290] T f3f9c2e2bf644115957398fe4c9459db P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:18:03.944984  6881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f9c2e2bf644115957398fe4c9459db" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
W20260709 13:18:03.946858  6697 leader_election.cc:343] T f3f9c2e2bf644115957398fe4c9459db P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:03.948899  6805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f9c2e2bf644115957398fe4c9459db" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:18:03.949676  6805 raft_consensus.cc:2468] T f3f9c2e2bf644115957398fe4c9459db P b7ab4784c7344b939bc36f639286f377 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 0.
I20260709 13:18:03.951073  6695 leader_election.cc:304] T f3f9c2e2bf644115957398fe4c9459db P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:18:03.953007  6923 tablet_bootstrap.cc:654] T 404190ce4ce94cecbfcb6ea9d1dd8626 P ccd8a4c3bfe3413cb2ae219b09aea832: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:03.953933  6957 raft_consensus.cc:2749] T f58dc08b12a2494bb9a1372837970ca2 P b7ab4784c7344b939bc36f639286f377 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:18:03.896760  6792 tablet_service.cc:1511] Processing CreateTablet for tablet 22ccee1b570c4ad3a57bd7aec085b1b4 (DEFAULT_TABLE table=test-workload [id=04f4d366747e43549980077479ed75b9]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 13:18:03.957343  6792 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 22ccee1b570c4ad3a57bd7aec085b1b4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:03.957870  6931 raft_consensus.cc:2804] T f3f9c2e2bf644115957398fe4c9459db P ccd8a4c3bfe3413cb2ae219b09aea832 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:18:03.958062  6951 consensus_queue.cc:1048] T f58dc08b12a2494bb9a1372837970ca2 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:18:03.958369  6931 raft_consensus.cc:493] T f3f9c2e2bf644115957398fe4c9459db P ccd8a4c3bfe3413cb2ae219b09aea832 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:03.958766  6931 raft_consensus.cc:3060] T f3f9c2e2bf644115957398fe4c9459db P ccd8a4c3bfe3413cb2ae219b09aea832 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:03.999817  6923 tablet_bootstrap.cc:492] T 404190ce4ce94cecbfcb6ea9d1dd8626 P ccd8a4c3bfe3413cb2ae219b09aea832: No bootstrap required, opened a new log
I20260709 13:18:04.000651  6921 ts_tablet_manager.cc:1434] T a3022224cc81473690653a83d4e99470 P b7ab4784c7344b939bc36f639286f377: Time spent starting tablet: real 0.160s	user 0.006s	sys 0.004s
I20260709 13:18:04.000835  6923 ts_tablet_manager.cc:1403] T 404190ce4ce94cecbfcb6ea9d1dd8626 P ccd8a4c3bfe3413cb2ae219b09aea832: Time spent bootstrapping tablet: real 0.212s	user 0.023s	sys 0.002s
I20260709 13:18:04.003037  6951 consensus_queue.cc:1048] T f58dc08b12a2494bb9a1372837970ca2 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:18:04.004199  6923 raft_consensus.cc:359] T 404190ce4ce94cecbfcb6ea9d1dd8626 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:04.004902  6923 raft_consensus.cc:385] T 404190ce4ce94cecbfcb6ea9d1dd8626 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:04.005177  6923 raft_consensus.cc:740] T 404190ce4ce94cecbfcb6ea9d1dd8626 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Initialized, Role: FOLLOWER
I20260709 13:18:04.005860  6923 consensus_queue.cc:260] T 404190ce4ce94cecbfcb6ea9d1dd8626 P ccd8a4c3bfe3413cb2ae219b09aea832 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
W20260709 13:18:03.964924  6614 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 51584.3us
I20260709 13:18:04.048301  6931 raft_consensus.cc:515] T f3f9c2e2bf644115957398fe4c9459db P ccd8a4c3bfe3413cb2ae219b09aea832 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
W20260709 13:18:04.050179  6772 consensus_peers.cc:597] T bb7fa124c3bf4ef9ab65a407cb008441 P b7ab4784c7344b939bc36f639286f377 -> Peer cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931): Couldn't send request to peer cd75a17ab2604397adab03bb8b5fd75c. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:04.051012  6931 leader_election.cc:290] T f3f9c2e2bf644115957398fe4c9459db P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 1 election: Requested vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:18:04.051388  6805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f9c2e2bf644115957398fe4c9459db" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:18:04.051947  6805 raft_consensus.cc:3060] T f3f9c2e2bf644115957398fe4c9459db P b7ab4784c7344b939bc36f639286f377 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:04.057152  6797 tablet_service.cc:1511] Processing CreateTablet for tablet ab432e62819d499eaaf3dd55481dd930 (DEFAULT_TABLE table=test-workload [id=04f4d366747e43549980077479ed75b9]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 13:18:04.058669  6797 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ab432e62819d499eaaf3dd55481dd930. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:04.060969  6921 tablet_bootstrap.cc:492] T 404190ce4ce94cecbfcb6ea9d1dd8626 P b7ab4784c7344b939bc36f639286f377: Bootstrap starting.
I20260709 13:18:04.072170  6794 tablet_service.cc:1511] Processing CreateTablet for tablet 17587d6730594da4a56fa13a353232a1 (DEFAULT_TABLE table=test-workload [id=04f4d366747e43549980077479ed75b9]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 13:18:04.073360  6788 tablet_service.cc:1511] Processing CreateTablet for tablet 7ba5dac66ab5497e9e336f2a3c28cda5 (DEFAULT_TABLE table=test-workload [id=04f4d366747e43549980077479ed75b9]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 13:18:04.079095  6788 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7ba5dac66ab5497e9e336f2a3c28cda5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:04.080246  6794 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 17587d6730594da4a56fa13a353232a1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:04.082662  6879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f9c2e2bf644115957398fe4c9459db" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:18:04.087641  6805 raft_consensus.cc:2468] T f3f9c2e2bf644115957398fe4c9459db P b7ab4784c7344b939bc36f639286f377 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 1.
W20260709 13:18:04.094837  6697 leader_election.cc:343] T f3f9c2e2bf644115957398fe4c9459db P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:04.098812  6921 tablet_bootstrap.cc:654] T 404190ce4ce94cecbfcb6ea9d1dd8626 P b7ab4784c7344b939bc36f639286f377: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:04.098484  6864 tablet_service.cc:1511] Processing CreateTablet for tablet 427c124d773f483294511e80fe340075 (DEFAULT_TABLE table=test-workload [id=04f4d366747e43549980077479ed75b9]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 13:18:04.125464  6864 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 427c124d773f483294511e80fe340075. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:04.125746  6791 tablet_service.cc:1511] Processing CreateTablet for tablet 3411566abe2d4c9bb4b2adfdd05e6f17 (DEFAULT_TABLE table=test-workload [id=04f4d366747e43549980077479ed75b9]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 13:18:04.127122  6791 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3411566abe2d4c9bb4b2adfdd05e6f17. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:04.127425  6695 leader_election.cc:304] T f3f9c2e2bf644115957398fe4c9459db P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:18:04.101755  6923 ts_tablet_manager.cc:1434] T 404190ce4ce94cecbfcb6ea9d1dd8626 P ccd8a4c3bfe3413cb2ae219b09aea832: Time spent starting tablet: real 0.100s	user 0.007s	sys 0.001s
I20260709 13:18:04.048337  6863 tablet_service.cc:1511] Processing CreateTablet for tablet 711ef6523deb4cbe8ef2ba61e1c21c98 (DEFAULT_TABLE table=test-workload [id=04f4d366747e43549980077479ed75b9]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 13:18:04.112386  6721 tablet_service.cc:1511] Processing CreateTablet for tablet 427c124d773f483294511e80fe340075 (DEFAULT_TABLE table=test-workload [id=04f4d366747e43549980077479ed75b9]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 13:18:04.128926  6952 raft_consensus.cc:2804] T f3f9c2e2bf644115957398fe4c9459db P ccd8a4c3bfe3413cb2ae219b09aea832 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:18:04.129091  6923 tablet_bootstrap.cc:492] T 7887766dc6784fcaa42b35c05fea7a99 P ccd8a4c3bfe3413cb2ae219b09aea832: Bootstrap starting.
I20260709 13:18:04.129472  6952 raft_consensus.cc:697] T f3f9c2e2bf644115957398fe4c9459db P ccd8a4c3bfe3413cb2ae219b09aea832 [term 1 LEADER]: Becoming Leader. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
I20260709 13:18:04.129896  6721 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 427c124d773f483294511e80fe340075. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:04.130496  6952 consensus_queue.cc:237] T f3f9c2e2bf644115957398fe4c9459db P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:04.129130  6863 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 711ef6523deb4cbe8ef2ba61e1c21c98. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:04.149427  6797 tablet_service.cc:1511] Processing CreateTablet for tablet 427c124d773f483294511e80fe340075 (DEFAULT_TABLE table=test-workload [id=04f4d366747e43549980077479ed75b9]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 13:18:04.150775  6797 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 427c124d773f483294511e80fe340075. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:04.152449  6922 tablet_bootstrap.cc:492] T f3f9c2e2bf644115957398fe4c9459db P cd75a17ab2604397adab03bb8b5fd75c: No bootstrap required, opened a new log
I20260709 13:18:04.153016  6922 ts_tablet_manager.cc:1403] T f3f9c2e2bf644115957398fe4c9459db P cd75a17ab2604397adab03bb8b5fd75c: Time spent bootstrapping tablet: real 0.542s	user 0.016s	sys 0.005s
I20260709 13:18:04.158380  6922 raft_consensus.cc:359] T f3f9c2e2bf644115957398fe4c9459db P cd75a17ab2604397adab03bb8b5fd75c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:04.159366  6922 raft_consensus.cc:385] T f3f9c2e2bf644115957398fe4c9459db P cd75a17ab2604397adab03bb8b5fd75c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:04.159785  6922 raft_consensus.cc:740] T f3f9c2e2bf644115957398fe4c9459db P cd75a17ab2604397adab03bb8b5fd75c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cd75a17ab2604397adab03bb8b5fd75c, State: Initialized, Role: FOLLOWER
I20260709 13:18:04.161057  6922 consensus_queue.cc:260] T f3f9c2e2bf644115957398fe4c9459db P cd75a17ab2604397adab03bb8b5fd75c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:04.164702  6922 ts_tablet_manager.cc:1434] T f3f9c2e2bf644115957398fe4c9459db P cd75a17ab2604397adab03bb8b5fd75c: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.003s
I20260709 13:18:04.166036  6922 tablet_bootstrap.cc:492] T 1bf4668eeb70467fb3dc5a0289233b3c P cd75a17ab2604397adab03bb8b5fd75c: Bootstrap starting.
I20260709 13:18:04.170486  6715 tablet_service.cc:1511] Processing CreateTablet for tablet 4275cf08e63345f993bce8664eada830 (DEFAULT_TABLE table=test-workload [id=04f4d366747e43549980077479ed75b9]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 13:18:04.171870  6715 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4275cf08e63345f993bce8664eada830. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:04.174610  6793 tablet_service.cc:1511] Processing CreateTablet for tablet 711ef6523deb4cbe8ef2ba61e1c21c98 (DEFAULT_TABLE table=test-workload [id=04f4d366747e43549980077479ed75b9]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 13:18:04.180577  6795 tablet_service.cc:1511] Processing CreateTablet for tablet 4275cf08e63345f993bce8664eada830 (DEFAULT_TABLE table=test-workload [id=04f4d366747e43549980077479ed75b9]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 13:18:04.176452  6976 consensus_queue.cc:1048] T bb7fa124c3bf4ef9ab65a407cb008441 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:18:04.188458  6923 tablet_bootstrap.cc:654] T 7887766dc6784fcaa42b35c05fea7a99 P ccd8a4c3bfe3413cb2ae219b09aea832: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:04.183655  6793 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 711ef6523deb4cbe8ef2ba61e1c21c98. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:04.205387  6628 catalog_manager.cc:5697] T f58dc08b12a2494bb9a1372837970ca2 P ccd8a4c3bfe3413cb2ae219b09aea832 reported cstate change: term changed from 0 to 1, leader changed from <none> to ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65). New cstate: current_term: 1 leader_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:04.223835  6866 tablet_service.cc:1511] Processing CreateTablet for tablet 4275cf08e63345f993bce8664eada830 (DEFAULT_TABLE table=test-workload [id=04f4d366747e43549980077479ed75b9]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 13:18:04.224357  6867 tablet_service.cc:1511] Processing CreateTablet for tablet be1a92657f494cac8dd227d152f50151 (DEFAULT_TABLE table=test-workload [id=04f4d366747e43549980077479ed75b9]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 13:18:04.225325  6866 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4275cf08e63345f993bce8664eada830. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:04.226509  6867 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet be1a92657f494cac8dd227d152f50151. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:04.226897  6931 raft_consensus.cc:493] T 404190ce4ce94cecbfcb6ea9d1dd8626 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:04.227320  6695 consensus_peers.cc:597] T e31b9971c15848dea59d4d4130141d9e P ccd8a4c3bfe3413cb2ae219b09aea832 -> Peer b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817): Couldn't send request to peer b7ab4784c7344b939bc36f639286f377. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:04.227432  6931 raft_consensus.cc:515] T 404190ce4ce94cecbfcb6ea9d1dd8626 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:04.229820  6931 leader_election.cc:290] T 404190ce4ce94cecbfcb6ea9d1dd8626 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:18:04.231438  6881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "404190ce4ce94cecbfcb6ea9d1dd8626" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:18:04.232146  6881 raft_consensus.cc:2468] T 404190ce4ce94cecbfcb6ea9d1dd8626 P cd75a17ab2604397adab03bb8b5fd75c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 0.
I20260709 13:18:04.207518  6628 catalog_manager.cc:5697] T e31b9971c15848dea59d4d4130141d9e P ccd8a4c3bfe3413cb2ae219b09aea832 reported cstate change: term changed from 0 to 1, leader changed from <none> to ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65). New cstate: current_term: 1 leader_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:04.233335  6805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "404190ce4ce94cecbfcb6ea9d1dd8626" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:18:04.234853  6697 leader_election.cc:304] T 404190ce4ce94cecbfcb6ea9d1dd8626 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:18:04.236289  6795 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4275cf08e63345f993bce8664eada830. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:18:04.236367  6695 leader_election.cc:343] T 404190ce4ce94cecbfcb6ea9d1dd8626 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:04.237458  6931 raft_consensus.cc:2804] T 404190ce4ce94cecbfcb6ea9d1dd8626 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:18:04.237866  6931 raft_consensus.cc:493] T 404190ce4ce94cecbfcb6ea9d1dd8626 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:04.238209  6931 raft_consensus.cc:3060] T 404190ce4ce94cecbfcb6ea9d1dd8626 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:04.247912  6951 consensus_queue.cc:1048] T e31b9971c15848dea59d4d4130141d9e P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:18:04.274890  6719 tablet_service.cc:1511] Processing CreateTablet for tablet be1a92657f494cac8dd227d152f50151 (DEFAULT_TABLE table=test-workload [id=04f4d366747e43549980077479ed75b9]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 13:18:04.277791  6790 tablet_service.cc:1511] Processing CreateTablet for tablet be1a92657f494cac8dd227d152f50151 (DEFAULT_TABLE table=test-workload [id=04f4d366747e43549980077479ed75b9]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 13:18:04.281265  6790 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet be1a92657f494cac8dd227d152f50151. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:04.284946  6976 raft_consensus.cc:493] T a3022224cc81473690653a83d4e99470 P b7ab4784c7344b939bc36f639286f377 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:04.286127  6719 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet be1a92657f494cac8dd227d152f50151. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:04.285701  6976 raft_consensus.cc:515] T a3022224cc81473690653a83d4e99470 P b7ab4784c7344b939bc36f639286f377 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:04.290195  6732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3022224cc81473690653a83d4e99470" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
W20260709 13:18:04.292281  6770 leader_election.cc:343] T a3022224cc81473690653a83d4e99470 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:04.294498  6976 leader_election.cc:290] T a3022224cc81473690653a83d4e99470 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:18:04.298749  6931 raft_consensus.cc:515] T 404190ce4ce94cecbfcb6ea9d1dd8626 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:04.301985  6805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "404190ce4ce94cecbfcb6ea9d1dd8626" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
W20260709 13:18:04.303612  6695 leader_election.cc:343] T 404190ce4ce94cecbfcb6ea9d1dd8626 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:04.317734  6923 tablet_bootstrap.cc:492] T 7887766dc6784fcaa42b35c05fea7a99 P ccd8a4c3bfe3413cb2ae219b09aea832: No bootstrap required, opened a new log
I20260709 13:18:04.318286  6923 ts_tablet_manager.cc:1403] T 7887766dc6784fcaa42b35c05fea7a99 P ccd8a4c3bfe3413cb2ae219b09aea832: Time spent bootstrapping tablet: real 0.189s	user 0.020s	sys 0.007s
I20260709 13:18:04.324287  6923 raft_consensus.cc:359] T 7887766dc6784fcaa42b35c05fea7a99 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:04.325031  6923 raft_consensus.cc:385] T 7887766dc6784fcaa42b35c05fea7a99 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:04.325315  6923 raft_consensus.cc:740] T 7887766dc6784fcaa42b35c05fea7a99 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Initialized, Role: FOLLOWER
I20260709 13:18:04.326901  6921 tablet_bootstrap.cc:492] T 404190ce4ce94cecbfcb6ea9d1dd8626 P b7ab4784c7344b939bc36f639286f377: No bootstrap required, opened a new log
I20260709 13:18:04.329187  6879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "404190ce4ce94cecbfcb6ea9d1dd8626" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:18:04.338965  6878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3022224cc81473690653a83d4e99470" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:18:04.353411  6879 raft_consensus.cc:3060] T 404190ce4ce94cecbfcb6ea9d1dd8626 P cd75a17ab2604397adab03bb8b5fd75c [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:18:04.354934  6772 leader_election.cc:343] T a3022224cc81473690653a83d4e99470 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:04.355484  6772 leader_election.cc:304] T a3022224cc81473690653a83d4e99470 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:18:04.326167  6923 consensus_queue.cc:260] T 7887766dc6784fcaa42b35c05fea7a99 P ccd8a4c3bfe3413cb2ae219b09aea832 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:04.329469  6931 leader_election.cc:290] T 404190ce4ce94cecbfcb6ea9d1dd8626 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 1 election: Requested vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:18:04.359161  6930 raft_consensus.cc:2749] T a3022224cc81473690653a83d4e99470 P b7ab4784c7344b939bc36f639286f377 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:18:04.357545  6921 ts_tablet_manager.cc:1403] T 404190ce4ce94cecbfcb6ea9d1dd8626 P b7ab4784c7344b939bc36f639286f377: Time spent bootstrapping tablet: real 0.316s	user 0.014s	sys 0.059s
I20260709 13:18:04.360456  6922 tablet_bootstrap.cc:654] T 1bf4668eeb70467fb3dc5a0289233b3c P cd75a17ab2604397adab03bb8b5fd75c: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:04.325609  6959 raft_consensus.cc:493] T f3f9c2e2bf644115957398fe4c9459db P cd75a17ab2604397adab03bb8b5fd75c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:04.364559  6959 raft_consensus.cc:515] T f3f9c2e2bf644115957398fe4c9459db P cd75a17ab2604397adab03bb8b5fd75c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:04.372782  6921 raft_consensus.cc:359] T 404190ce4ce94cecbfcb6ea9d1dd8626 P b7ab4784c7344b939bc36f639286f377 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:04.373684  6731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f9c2e2bf644115957398fe4c9459db" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:18:04.373700  6921 raft_consensus.cc:385] T 404190ce4ce94cecbfcb6ea9d1dd8626 P b7ab4784c7344b939bc36f639286f377 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:04.375196  6921 raft_consensus.cc:740] T 404190ce4ce94cecbfcb6ea9d1dd8626 P b7ab4784c7344b939bc36f639286f377 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Initialized, Role: FOLLOWER
I20260709 13:18:04.375996  6921 consensus_queue.cc:260] T 404190ce4ce94cecbfcb6ea9d1dd8626 P b7ab4784c7344b939bc36f639286f377 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:04.378415  6921 ts_tablet_manager.cc:1434] T 404190ce4ce94cecbfcb6ea9d1dd8626 P b7ab4784c7344b939bc36f639286f377: Time spent starting tablet: real 0.017s	user 0.003s	sys 0.003s
I20260709 13:18:04.378371  6807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f9c2e2bf644115957398fe4c9459db" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:18:04.379256  6807 raft_consensus.cc:2393] T f3f9c2e2bf644115957398fe4c9459db P b7ab4784c7344b939bc36f639286f377 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c in current term 1: Already voted for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in this term.
I20260709 13:18:04.379710  6921 tablet_bootstrap.cc:492] T e31b9971c15848dea59d4d4130141d9e P b7ab4784c7344b939bc36f639286f377: Bootstrap starting.
I20260709 13:18:04.380661  6844 leader_election.cc:304] T f3f9c2e2bf644115957398fe4c9459db P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:18:04.382215  6959 leader_election.cc:290] T f3f9c2e2bf644115957398fe4c9459db P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
W20260709 13:18:04.397367  6678 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:18:04.397660  6879 raft_consensus.cc:2468] T 404190ce4ce94cecbfcb6ea9d1dd8626 P cd75a17ab2604397adab03bb8b5fd75c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 1.
I20260709 13:18:04.398960  6697 leader_election.cc:304] T 404190ce4ce94cecbfcb6ea9d1dd8626 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377
I20260709 13:18:04.400280  6931 raft_consensus.cc:2804] T 404190ce4ce94cecbfcb6ea9d1dd8626 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:18:04.400830  6931 raft_consensus.cc:697] T 404190ce4ce94cecbfcb6ea9d1dd8626 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 1 LEADER]: Becoming Leader. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
I20260709 13:18:04.401882  6931 consensus_queue.cc:237] T 404190ce4ce94cecbfcb6ea9d1dd8626 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:04.409361  6923 ts_tablet_manager.cc:1434] T 7887766dc6784fcaa42b35c05fea7a99 P ccd8a4c3bfe3413cb2ae219b09aea832: Time spent starting tablet: real 0.091s	user 0.019s	sys 0.014s
I20260709 13:18:04.420711  6984 raft_consensus.cc:493] T 7887766dc6784fcaa42b35c05fea7a99 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:04.421269  6984 raft_consensus.cc:515] T 7887766dc6784fcaa42b35c05fea7a99 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:04.423448  6984 leader_election.cc:290] T 7887766dc6784fcaa42b35c05fea7a99 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:18:04.424252  6807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7887766dc6784fcaa42b35c05fea7a99" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:18:04.394719  6959 raft_consensus.cc:3060] T f3f9c2e2bf644115957398fe4c9459db P cd75a17ab2604397adab03bb8b5fd75c [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:18:04.432161  6695 leader_election.cc:343] T 7887766dc6784fcaa42b35c05fea7a99 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:04.433955  6921 tablet_bootstrap.cc:654] T e31b9971c15848dea59d4d4130141d9e P b7ab4784c7344b939bc36f639286f377: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:04.436671  6881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7887766dc6784fcaa42b35c05fea7a99" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:18:04.437472  6881 raft_consensus.cc:2468] T 7887766dc6784fcaa42b35c05fea7a99 P cd75a17ab2604397adab03bb8b5fd75c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 0.
I20260709 13:18:04.442799  6922 tablet_bootstrap.cc:492] T 1bf4668eeb70467fb3dc5a0289233b3c P cd75a17ab2604397adab03bb8b5fd75c: No bootstrap required, opened a new log
I20260709 13:18:04.443360  6922 ts_tablet_manager.cc:1403] T 1bf4668eeb70467fb3dc5a0289233b3c P cd75a17ab2604397adab03bb8b5fd75c: Time spent bootstrapping tablet: real 0.278s	user 0.025s	sys 0.011s
I20260709 13:18:04.444132  6921 tablet_bootstrap.cc:492] T e31b9971c15848dea59d4d4130141d9e P b7ab4784c7344b939bc36f639286f377: No bootstrap required, opened a new log
I20260709 13:18:04.444638  6921 ts_tablet_manager.cc:1403] T e31b9971c15848dea59d4d4130141d9e P b7ab4784c7344b939bc36f639286f377: Time spent bootstrapping tablet: real 0.065s	user 0.008s	sys 0.009s
I20260709 13:18:04.445084  6923 tablet_bootstrap.cc:492] T e77e330a82df4b43a745d57a68f6f057 P ccd8a4c3bfe3413cb2ae219b09aea832: Bootstrap starting.
I20260709 13:18:04.447471  6921 raft_consensus.cc:359] T e31b9971c15848dea59d4d4130141d9e P b7ab4784c7344b939bc36f639286f377 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:04.448246  6921 raft_consensus.cc:385] T e31b9971c15848dea59d4d4130141d9e P b7ab4784c7344b939bc36f639286f377 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:04.448544  6921 raft_consensus.cc:740] T e31b9971c15848dea59d4d4130141d9e P b7ab4784c7344b939bc36f639286f377 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Initialized, Role: FOLLOWER
I20260709 13:18:04.448848  6959 raft_consensus.cc:2749] T f3f9c2e2bf644115957398fe4c9459db P cd75a17ab2604397adab03bb8b5fd75c [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:18:04.447633  6697 leader_election.cc:304] T 7887766dc6784fcaa42b35c05fea7a99 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377
I20260709 13:18:04.449258  6921 consensus_queue.cc:260] T e31b9971c15848dea59d4d4130141d9e P b7ab4784c7344b939bc36f639286f377 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:04.450179  6984 raft_consensus.cc:2804] T 7887766dc6784fcaa42b35c05fea7a99 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:18:04.450595  6984 raft_consensus.cc:493] T 7887766dc6784fcaa42b35c05fea7a99 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:04.450927  6984 raft_consensus.cc:3060] T 7887766dc6784fcaa42b35c05fea7a99 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:04.451614  6921 ts_tablet_manager.cc:1434] T e31b9971c15848dea59d4d4130141d9e P b7ab4784c7344b939bc36f639286f377: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:18:04.452647  6922 raft_consensus.cc:359] T 1bf4668eeb70467fb3dc5a0289233b3c P cd75a17ab2604397adab03bb8b5fd75c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:04.453505  6922 raft_consensus.cc:385] T 1bf4668eeb70467fb3dc5a0289233b3c P cd75a17ab2604397adab03bb8b5fd75c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:04.452778  6629 catalog_manager.cc:5697] T f3f9c2e2bf644115957398fe4c9459db P ccd8a4c3bfe3413cb2ae219b09aea832 reported cstate change: term changed from 0 to 1, leader changed from <none> to ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65). New cstate: current_term: 1 leader_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:04.453794  6922 raft_consensus.cc:740] T 1bf4668eeb70467fb3dc5a0289233b3c P cd75a17ab2604397adab03bb8b5fd75c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cd75a17ab2604397adab03bb8b5fd75c, State: Initialized, Role: FOLLOWER
I20260709 13:18:04.454614  6922 consensus_queue.cc:260] T 1bf4668eeb70467fb3dc5a0289233b3c P cd75a17ab2604397adab03bb8b5fd75c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:04.455996  6921 tablet_bootstrap.cc:492] T 20f6842e26174571996b8dea4151d4be P b7ab4784c7344b939bc36f639286f377: Bootstrap starting.
I20260709 13:18:04.457037  6922 ts_tablet_manager.cc:1434] T 1bf4668eeb70467fb3dc5a0289233b3c P cd75a17ab2604397adab03bb8b5fd75c: Time spent starting tablet: real 0.013s	user 0.004s	sys 0.004s
I20260709 13:18:04.457510  6923 tablet_bootstrap.cc:654] T e77e330a82df4b43a745d57a68f6f057 P ccd8a4c3bfe3413cb2ae219b09aea832: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:04.458173  6922 tablet_bootstrap.cc:492] T a3022224cc81473690653a83d4e99470 P cd75a17ab2604397adab03bb8b5fd75c: Bootstrap starting.
I20260709 13:18:04.463152  6921 tablet_bootstrap.cc:654] T 20f6842e26174571996b8dea4151d4be P b7ab4784c7344b939bc36f639286f377: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:04.465072  6922 tablet_bootstrap.cc:654] T a3022224cc81473690653a83d4e99470 P cd75a17ab2604397adab03bb8b5fd75c: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:04.473457  6923 tablet_bootstrap.cc:492] T e77e330a82df4b43a745d57a68f6f057 P ccd8a4c3bfe3413cb2ae219b09aea832: No bootstrap required, opened a new log
I20260709 13:18:04.474097  6923 ts_tablet_manager.cc:1403] T e77e330a82df4b43a745d57a68f6f057 P ccd8a4c3bfe3413cb2ae219b09aea832: Time spent bootstrapping tablet: real 0.029s	user 0.013s	sys 0.005s
I20260709 13:18:04.476575  6959 raft_consensus.cc:493] T 1bf4668eeb70467fb3dc5a0289233b3c P cd75a17ab2604397adab03bb8b5fd75c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:04.477406  6959 raft_consensus.cc:515] T 1bf4668eeb70467fb3dc5a0289233b3c P cd75a17ab2604397adab03bb8b5fd75c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:04.477738  6923 raft_consensus.cc:359] T e77e330a82df4b43a745d57a68f6f057 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } }
I20260709 13:18:04.478772  6923 raft_consensus.cc:385] T e77e330a82df4b43a745d57a68f6f057 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:04.479156  6923 raft_consensus.cc:740] T e77e330a82df4b43a745d57a68f6f057 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Initialized, Role: FOLLOWER
I20260709 13:18:04.480713  6959 leader_election.cc:290] T 1bf4668eeb70467fb3dc5a0289233b3c P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:18:04.482300  6807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bf4668eeb70467fb3dc5a0289233b3c" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:18:04.484865  6731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bf4668eeb70467fb3dc5a0289233b3c" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
W20260709 13:18:04.486905  6844 leader_election.cc:343] T 1bf4668eeb70467fb3dc5a0289233b3c P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:18:04.487656  6844 leader_election.cc:343] T 1bf4668eeb70467fb3dc5a0289233b3c P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:04.488095  6844 leader_election.cc:304] T 1bf4668eeb70467fb3dc5a0289233b3c P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:18:04.491851  6959 raft_consensus.cc:2749] T 1bf4668eeb70467fb3dc5a0289233b3c P cd75a17ab2604397adab03bb8b5fd75c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:18:04.493534  6984 raft_consensus.cc:515] T 7887766dc6784fcaa42b35c05fea7a99 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:04.493270  6923 consensus_queue.cc:260] T e77e330a82df4b43a745d57a68f6f057 P ccd8a4c3bfe3413cb2ae219b09aea832 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } }
I20260709 13:18:04.496414  6923 ts_tablet_manager.cc:1434] T e77e330a82df4b43a745d57a68f6f057 P ccd8a4c3bfe3413cb2ae219b09aea832: Time spent starting tablet: real 0.022s	user 0.010s	sys 0.001s
I20260709 13:18:04.498010  6923 tablet_bootstrap.cc:492] T 20f6842e26174571996b8dea4151d4be P ccd8a4c3bfe3413cb2ae219b09aea832: Bootstrap starting.
I20260709 13:18:04.501015  6921 tablet_bootstrap.cc:492] T 20f6842e26174571996b8dea4151d4be P b7ab4784c7344b939bc36f639286f377: No bootstrap required, opened a new log
I20260709 13:18:04.501614  6921 ts_tablet_manager.cc:1403] T 20f6842e26174571996b8dea4151d4be P b7ab4784c7344b939bc36f639286f377: Time spent bootstrapping tablet: real 0.046s	user 0.012s	sys 0.022s
I20260709 13:18:04.504315  6921 raft_consensus.cc:359] T 20f6842e26174571996b8dea4151d4be P b7ab4784c7344b939bc36f639286f377 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:04.505049  6921 raft_consensus.cc:385] T 20f6842e26174571996b8dea4151d4be P b7ab4784c7344b939bc36f639286f377 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:04.505367  6921 raft_consensus.cc:740] T 20f6842e26174571996b8dea4151d4be P b7ab4784c7344b939bc36f639286f377 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Initialized, Role: FOLLOWER
I20260709 13:18:04.506147  6921 consensus_queue.cc:260] T 20f6842e26174571996b8dea4151d4be P b7ab4784c7344b939bc36f639286f377 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:04.511528  6923 tablet_bootstrap.cc:654] T 20f6842e26174571996b8dea4151d4be P ccd8a4c3bfe3413cb2ae219b09aea832: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:04.514786  6921 ts_tablet_manager.cc:1434] T 20f6842e26174571996b8dea4151d4be P b7ab4784c7344b939bc36f639286f377: Time spent starting tablet: real 0.013s	user 0.004s	sys 0.001s
I20260709 13:18:04.515926  6921 tablet_bootstrap.cc:492] T 90d42e216d9741e190bca19a781291fd P b7ab4784c7344b939bc36f639286f377: Bootstrap starting.
I20260709 13:18:04.516680  6627 catalog_manager.cc:5697] T 404190ce4ce94cecbfcb6ea9d1dd8626 P ccd8a4c3bfe3413cb2ae219b09aea832 reported cstate change: term changed from 0 to 1, leader changed from <none> to ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65). New cstate: current_term: 1 leader_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:04.521739  6921 tablet_bootstrap.cc:654] T 90d42e216d9741e190bca19a781291fd P b7ab4784c7344b939bc36f639286f377: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:04.525408  6984 leader_election.cc:290] T 7887766dc6784fcaa42b35c05fea7a99 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 1 election: Requested vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:18:04.525501  6923 tablet_bootstrap.cc:492] T 20f6842e26174571996b8dea4151d4be P ccd8a4c3bfe3413cb2ae219b09aea832: No bootstrap required, opened a new log
I20260709 13:18:04.526343  6923 ts_tablet_manager.cc:1403] T 20f6842e26174571996b8dea4151d4be P ccd8a4c3bfe3413cb2ae219b09aea832: Time spent bootstrapping tablet: real 0.029s	user 0.018s	sys 0.003s
I20260709 13:18:04.526991  6881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7887766dc6784fcaa42b35c05fea7a99" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:18:04.533514  6881 raft_consensus.cc:3060] T 7887766dc6784fcaa42b35c05fea7a99 P cd75a17ab2604397adab03bb8b5fd75c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:04.526991  6807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7887766dc6784fcaa42b35c05fea7a99" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:18:04.536761  6923 raft_consensus.cc:359] T 20f6842e26174571996b8dea4151d4be P ccd8a4c3bfe3413cb2ae219b09aea832 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
W20260709 13:18:04.537613  6695 leader_election.cc:343] T 7887766dc6784fcaa42b35c05fea7a99 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:04.537830  6923 raft_consensus.cc:385] T 20f6842e26174571996b8dea4151d4be P ccd8a4c3bfe3413cb2ae219b09aea832 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:04.538271  6923 raft_consensus.cc:740] T 20f6842e26174571996b8dea4151d4be P ccd8a4c3bfe3413cb2ae219b09aea832 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Initialized, Role: FOLLOWER
I20260709 13:18:04.539256  6923 consensus_queue.cc:260] T 20f6842e26174571996b8dea4151d4be P ccd8a4c3bfe3413cb2ae219b09aea832 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:04.541983  6923 ts_tablet_manager.cc:1434] T 20f6842e26174571996b8dea4151d4be P ccd8a4c3bfe3413cb2ae219b09aea832: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 13:18:04.544636  6923 tablet_bootstrap.cc:492] T 90d42e216d9741e190bca19a781291fd P ccd8a4c3bfe3413cb2ae219b09aea832: Bootstrap starting.
I20260709 13:18:04.545099  6921 tablet_bootstrap.cc:492] T 90d42e216d9741e190bca19a781291fd P b7ab4784c7344b939bc36f639286f377: No bootstrap required, opened a new log
I20260709 13:18:04.545024  6881 raft_consensus.cc:2468] T 7887766dc6784fcaa42b35c05fea7a99 P cd75a17ab2604397adab03bb8b5fd75c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 1.
I20260709 13:18:04.532488  6922 tablet_bootstrap.cc:492] T a3022224cc81473690653a83d4e99470 P cd75a17ab2604397adab03bb8b5fd75c: No bootstrap required, opened a new log
I20260709 13:18:04.545964  6921 ts_tablet_manager.cc:1403] T 90d42e216d9741e190bca19a781291fd P b7ab4784c7344b939bc36f639286f377: Time spent bootstrapping tablet: real 0.030s	user 0.011s	sys 0.013s
I20260709 13:18:04.546484  6922 ts_tablet_manager.cc:1403] T a3022224cc81473690653a83d4e99470 P cd75a17ab2604397adab03bb8b5fd75c: Time spent bootstrapping tablet: real 0.089s	user 0.031s	sys 0.030s
I20260709 13:18:04.547859  6697 leader_election.cc:304] T 7887766dc6784fcaa42b35c05fea7a99 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377
I20260709 13:18:04.549062  6921 raft_consensus.cc:359] T 90d42e216d9741e190bca19a781291fd P b7ab4784c7344b939bc36f639286f377 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:04.549677  6984 raft_consensus.cc:2804] T 7887766dc6784fcaa42b35c05fea7a99 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:18:04.549850  6921 raft_consensus.cc:385] T 90d42e216d9741e190bca19a781291fd P b7ab4784c7344b939bc36f639286f377 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:04.550283  6984 raft_consensus.cc:697] T 7887766dc6784fcaa42b35c05fea7a99 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 1 LEADER]: Becoming Leader. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
I20260709 13:18:04.550387  6921 raft_consensus.cc:740] T 90d42e216d9741e190bca19a781291fd P b7ab4784c7344b939bc36f639286f377 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Initialized, Role: FOLLOWER
I20260709 13:18:04.551157  6931 raft_consensus.cc:493] T e77e330a82df4b43a745d57a68f6f057 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:04.550648  6923 tablet_bootstrap.cc:654] T 90d42e216d9741e190bca19a781291fd P ccd8a4c3bfe3413cb2ae219b09aea832: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:04.550513  6922 raft_consensus.cc:359] T a3022224cc81473690653a83d4e99470 P cd75a17ab2604397adab03bb8b5fd75c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:04.551296  6984 consensus_queue.cc:237] T 7887766dc6784fcaa42b35c05fea7a99 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:04.551815  6922 raft_consensus.cc:385] T a3022224cc81473690653a83d4e99470 P cd75a17ab2604397adab03bb8b5fd75c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:04.551657  6931 raft_consensus.cc:515] T e77e330a82df4b43a745d57a68f6f057 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } }
I20260709 13:18:04.552189  6922 raft_consensus.cc:740] T a3022224cc81473690653a83d4e99470 P cd75a17ab2604397adab03bb8b5fd75c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cd75a17ab2604397adab03bb8b5fd75c, State: Initialized, Role: FOLLOWER
I20260709 13:18:04.554104  6931 leader_election.cc:290] T e77e330a82df4b43a745d57a68f6f057 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:18:04.558809  6930 raft_consensus.cc:493] T e77e330a82df4b43a745d57a68f6f057 P b7ab4784c7344b939bc36f639286f377 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:04.552214  6921 consensus_queue.cc:260] T 90d42e216d9741e190bca19a781291fd P b7ab4784c7344b939bc36f639286f377 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:04.559350  6930 raft_consensus.cc:515] T e77e330a82df4b43a745d57a68f6f057 P b7ab4784c7344b939bc36f639286f377 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } }
I20260709 13:18:04.564448  6878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77e330a82df4b43a745d57a68f6f057" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:18:04.565163  6878 raft_consensus.cc:2468] T e77e330a82df4b43a745d57a68f6f057 P cd75a17ab2604397adab03bb8b5fd75c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 1.
I20260709 13:18:04.565802  6921 ts_tablet_manager.cc:1434] T 90d42e216d9741e190bca19a781291fd P b7ab4784c7344b939bc36f639286f377: Time spent starting tablet: real 0.019s	user 0.006s	sys 0.000s
I20260709 13:18:04.566586  6731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77e330a82df4b43a745d57a68f6f057" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:18:04.567281  6921 tablet_bootstrap.cc:492] T 1bf4668eeb70467fb3dc5a0289233b3c P b7ab4784c7344b939bc36f639286f377: Bootstrap starting.
I20260709 13:18:04.555092  6807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77e330a82df4b43a745d57a68f6f057" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:18:04.569310  6807 raft_consensus.cc:2393] T e77e330a82df4b43a745d57a68f6f057 P b7ab4784c7344b939bc36f639286f377 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ccd8a4c3bfe3413cb2ae219b09aea832 in current term 1: Already voted for candidate b7ab4784c7344b939bc36f639286f377 in this term.
I20260709 13:18:04.570931  6772 leader_election.cc:304] T e77e330a82df4b43a745d57a68f6f057 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:18:04.571890  6957 raft_consensus.cc:2804] T e77e330a82df4b43a745d57a68f6f057 P b7ab4784c7344b939bc36f639286f377 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:18:04.572314  6957 raft_consensus.cc:493] T e77e330a82df4b43a745d57a68f6f057 P b7ab4784c7344b939bc36f639286f377 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:04.572671  6957 raft_consensus.cc:3060] T e77e330a82df4b43a745d57a68f6f057 P b7ab4784c7344b939bc36f639286f377 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:04.573243  6630 catalog_manager.cc:5697] T 7887766dc6784fcaa42b35c05fea7a99 P ccd8a4c3bfe3413cb2ae219b09aea832 reported cstate change: term changed from 0 to 1, leader changed from <none> to ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65). New cstate: current_term: 1 leader_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:04.567303  6731 raft_consensus.cc:2468] T e77e330a82df4b43a745d57a68f6f057 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 0.
I20260709 13:18:04.575855  6921 tablet_bootstrap.cc:654] T 1bf4668eeb70467fb3dc5a0289233b3c P b7ab4784c7344b939bc36f639286f377: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:04.578665  6930 leader_election.cc:290] T e77e330a82df4b43a745d57a68f6f057 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931), ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391)
I20260709 13:18:04.585012  6957 raft_consensus.cc:515] T e77e330a82df4b43a745d57a68f6f057 P b7ab4784c7344b939bc36f639286f377 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } }
I20260709 13:18:04.553035  6922 consensus_queue.cc:260] T a3022224cc81473690653a83d4e99470 P cd75a17ab2604397adab03bb8b5fd75c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:04.556532  6879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77e330a82df4b43a745d57a68f6f057" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:18:04.590866  6879 raft_consensus.cc:2393] T e77e330a82df4b43a745d57a68f6f057 P cd75a17ab2604397adab03bb8b5fd75c [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ccd8a4c3bfe3413cb2ae219b09aea832 in current term 1: Already voted for candidate cd75a17ab2604397adab03bb8b5fd75c in this term.
I20260709 13:18:04.591874  6922 ts_tablet_manager.cc:1434] T a3022224cc81473690653a83d4e99470 P cd75a17ab2604397adab03bb8b5fd75c: Time spent starting tablet: real 0.045s	user 0.007s	sys 0.000s
I20260709 13:18:04.592722  6697 leader_election.cc:304] T e77e330a82df4b43a745d57a68f6f057 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:18:04.594112  6984 raft_consensus.cc:3060] T e77e330a82df4b43a745d57a68f6f057 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:04.595130  6923 tablet_bootstrap.cc:492] T 90d42e216d9741e190bca19a781291fd P ccd8a4c3bfe3413cb2ae219b09aea832: No bootstrap required, opened a new log
I20260709 13:18:04.595702  6923 ts_tablet_manager.cc:1403] T 90d42e216d9741e190bca19a781291fd P ccd8a4c3bfe3413cb2ae219b09aea832: Time spent bootstrapping tablet: real 0.051s	user 0.019s	sys 0.024s
I20260709 13:18:04.598572  6923 raft_consensus.cc:359] T 90d42e216d9741e190bca19a781291fd P ccd8a4c3bfe3413cb2ae219b09aea832 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:04.599267  6923 raft_consensus.cc:385] T 90d42e216d9741e190bca19a781291fd P ccd8a4c3bfe3413cb2ae219b09aea832 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:04.599541  6923 raft_consensus.cc:740] T 90d42e216d9741e190bca19a781291fd P ccd8a4c3bfe3413cb2ae219b09aea832 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Initialized, Role: FOLLOWER
I20260709 13:18:04.600241  6923 consensus_queue.cc:260] T 90d42e216d9741e190bca19a781291fd P ccd8a4c3bfe3413cb2ae219b09aea832 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:04.602365  6923 ts_tablet_manager.cc:1434] T 90d42e216d9741e190bca19a781291fd P ccd8a4c3bfe3413cb2ae219b09aea832: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:18:04.604390  6879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77e330a82df4b43a745d57a68f6f057" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:18:04.592945  6957 leader_election.cc:290] T e77e330a82df4b43a745d57a68f6f057 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 2 election: Requested vote from peers cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931), ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391)
I20260709 13:18:04.605173  6879 raft_consensus.cc:3060] T e77e330a82df4b43a745d57a68f6f057 P cd75a17ab2604397adab03bb8b5fd75c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:04.594108  6922 tablet_bootstrap.cc:492] T 4d9def8b32fd443aa94ab1420b06837b P cd75a17ab2604397adab03bb8b5fd75c: Bootstrap starting.
I20260709 13:18:04.605386  6957 raft_consensus.cc:493] T 404190ce4ce94cecbfcb6ea9d1dd8626 P b7ab4784c7344b939bc36f639286f377 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:04.608379  6957 raft_consensus.cc:515] T 404190ce4ce94cecbfcb6ea9d1dd8626 P b7ab4784c7344b939bc36f639286f377 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:04.609546  6731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77e330a82df4b43a745d57a68f6f057" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:18:04.606348  6923 tablet_bootstrap.cc:492] T 4f00a2e87e56452083b759f60d461ee3 P ccd8a4c3bfe3413cb2ae219b09aea832: Bootstrap starting.
I20260709 13:18:04.611716  6732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "404190ce4ce94cecbfcb6ea9d1dd8626" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:18:04.612506  6922 tablet_bootstrap.cc:654] T 4d9def8b32fd443aa94ab1420b06837b P cd75a17ab2604397adab03bb8b5fd75c: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:04.614060  6881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "404190ce4ce94cecbfcb6ea9d1dd8626" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:18:04.614885  6881 raft_consensus.cc:2393] T 404190ce4ce94cecbfcb6ea9d1dd8626 P cd75a17ab2604397adab03bb8b5fd75c [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7ab4784c7344b939bc36f639286f377 in current term 1: Already voted for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in this term.
I20260709 13:18:04.615617  6984 raft_consensus.cc:2749] T e77e330a82df4b43a745d57a68f6f057 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:18:04.616456  6931 consensus_queue.cc:1048] T f3f9c2e2bf644115957398fe4c9459db P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:18:04.617640  6921 tablet_bootstrap.cc:492] T 1bf4668eeb70467fb3dc5a0289233b3c P b7ab4784c7344b939bc36f639286f377: No bootstrap required, opened a new log
I20260709 13:18:04.618237  6921 ts_tablet_manager.cc:1403] T 1bf4668eeb70467fb3dc5a0289233b3c P b7ab4784c7344b939bc36f639286f377: Time spent bootstrapping tablet: real 0.051s	user 0.022s	sys 0.000s
I20260709 13:18:04.618559  6731 raft_consensus.cc:3060] T e77e330a82df4b43a745d57a68f6f057 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:04.618342  6770 leader_election.cc:304] T 404190ce4ce94cecbfcb6ea9d1dd8626 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:18:04.624398  6957 leader_election.cc:290] T 404190ce4ce94cecbfcb6ea9d1dd8626 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:18:04.625332  6957 raft_consensus.cc:3060] T 404190ce4ce94cecbfcb6ea9d1dd8626 P b7ab4784c7344b939bc36f639286f377 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:04.630988  6923 tablet_bootstrap.cc:654] T 4f00a2e87e56452083b759f60d461ee3 P ccd8a4c3bfe3413cb2ae219b09aea832: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:04.634102  6921 raft_consensus.cc:359] T 1bf4668eeb70467fb3dc5a0289233b3c P b7ab4784c7344b939bc36f639286f377 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:04.634832  6921 raft_consensus.cc:385] T 1bf4668eeb70467fb3dc5a0289233b3c P b7ab4784c7344b939bc36f639286f377 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:04.635103  6921 raft_consensus.cc:740] T 1bf4668eeb70467fb3dc5a0289233b3c P b7ab4784c7344b939bc36f639286f377 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Initialized, Role: FOLLOWER
I20260709 13:18:04.635795  6921 consensus_queue.cc:260] T 1bf4668eeb70467fb3dc5a0289233b3c P b7ab4784c7344b939bc36f639286f377 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:04.636027  6930 raft_consensus.cc:493] T e31b9971c15848dea59d4d4130141d9e P b7ab4784c7344b939bc36f639286f377 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:04.636850  6930 raft_consensus.cc:515] T e31b9971c15848dea59d4d4130141d9e P b7ab4784c7344b939bc36f639286f377 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:04.637780  6921 ts_tablet_manager.cc:1434] T 1bf4668eeb70467fb3dc5a0289233b3c P b7ab4784c7344b939bc36f639286f377: Time spent starting tablet: real 0.019s	user 0.011s	sys 0.002s
I20260709 13:18:04.640777  6921 tablet_bootstrap.cc:492] T 4f00a2e87e56452083b759f60d461ee3 P b7ab4784c7344b939bc36f639286f377: Bootstrap starting.
I20260709 13:18:04.641088  6732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e31b9971c15848dea59d4d4130141d9e" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:18:04.646869  6878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e31b9971c15848dea59d4d4130141d9e" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:18:04.649185  6772 leader_election.cc:304] T e31b9971c15848dea59d4d4130141d9e P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:18:04.650312  6976 raft_consensus.cc:2749] T e31b9971c15848dea59d4d4130141d9e P b7ab4784c7344b939bc36f639286f377 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:18:04.650362  6930 leader_election.cc:290] T e31b9971c15848dea59d4d4130141d9e P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:18:04.652835  6957 raft_consensus.cc:2749] T 404190ce4ce94cecbfcb6ea9d1dd8626 P b7ab4784c7344b939bc36f639286f377 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:18:04.655154  6921 tablet_bootstrap.cc:654] T 4f00a2e87e56452083b759f60d461ee3 P b7ab4784c7344b939bc36f639286f377: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:04.656487  6923 tablet_bootstrap.cc:492] T 4f00a2e87e56452083b759f60d461ee3 P ccd8a4c3bfe3413cb2ae219b09aea832: No bootstrap required, opened a new log
I20260709 13:18:04.657075  6923 ts_tablet_manager.cc:1403] T 4f00a2e87e56452083b759f60d461ee3 P ccd8a4c3bfe3413cb2ae219b09aea832: Time spent bootstrapping tablet: real 0.051s	user 0.010s	sys 0.002s
I20260709 13:18:04.660419  6923 raft_consensus.cc:359] T 4f00a2e87e56452083b759f60d461ee3 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:04.661279  6923 raft_consensus.cc:385] T 4f00a2e87e56452083b759f60d461ee3 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:04.661510  6923 raft_consensus.cc:740] T 4f00a2e87e56452083b759f60d461ee3 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Initialized, Role: FOLLOWER
I20260709 13:18:04.662114  6923 consensus_queue.cc:260] T 4f00a2e87e56452083b759f60d461ee3 P ccd8a4c3bfe3413cb2ae219b09aea832 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:04.662534  6931 raft_consensus.cc:493] T 20f6842e26174571996b8dea4151d4be P ccd8a4c3bfe3413cb2ae219b09aea832 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:04.663206  6931 raft_consensus.cc:515] T 20f6842e26174571996b8dea4151d4be P ccd8a4c3bfe3413cb2ae219b09aea832 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:04.663569  6921 tablet_bootstrap.cc:492] T 4f00a2e87e56452083b759f60d461ee3 P b7ab4784c7344b939bc36f639286f377: No bootstrap required, opened a new log
I20260709 13:18:04.664379  6921 ts_tablet_manager.cc:1403] T 4f00a2e87e56452083b759f60d461ee3 P b7ab4784c7344b939bc36f639286f377: Time spent bootstrapping tablet: real 0.024s	user 0.010s	sys 0.004s
I20260709 13:18:04.663599  6923 ts_tablet_manager.cc:1434] T 4f00a2e87e56452083b759f60d461ee3 P ccd8a4c3bfe3413cb2ae219b09aea832: Time spent starting tablet: real 0.006s	user 0.003s	sys 0.000s
I20260709 13:18:04.667577  6923 tablet_bootstrap.cc:492] T 1bf4668eeb70467fb3dc5a0289233b3c P ccd8a4c3bfe3413cb2ae219b09aea832: Bootstrap starting.
I20260709 13:18:04.668653  6878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20f6842e26174571996b8dea4151d4be" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:18:04.668841  6921 raft_consensus.cc:359] T 4f00a2e87e56452083b759f60d461ee3 P b7ab4784c7344b939bc36f639286f377 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:04.685956  6921 raft_consensus.cc:385] T 4f00a2e87e56452083b759f60d461ee3 P b7ab4784c7344b939bc36f639286f377 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 13:18:04.686269  6697 leader_election.cc:343] T 20f6842e26174571996b8dea4151d4be P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:04.686466  6921 raft_consensus.cc:740] T 4f00a2e87e56452083b759f60d461ee3 P b7ab4784c7344b939bc36f639286f377 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Initialized, Role: FOLLOWER
I20260709 13:18:04.666571  6931 leader_election.cc:290] T 20f6842e26174571996b8dea4151d4be P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:18:04.687901  6921 consensus_queue.cc:260] T 4f00a2e87e56452083b759f60d461ee3 P b7ab4784c7344b939bc36f639286f377 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:04.691188  6921 ts_tablet_manager.cc:1434] T 4f00a2e87e56452083b759f60d461ee3 P b7ab4784c7344b939bc36f639286f377: Time spent starting tablet: real 0.026s	user 0.009s	sys 0.015s
I20260709 13:18:04.668092  6807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20f6842e26174571996b8dea4151d4be" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:18:04.693145  6921 tablet_bootstrap.cc:492] T 7887766dc6784fcaa42b35c05fea7a99 P b7ab4784c7344b939bc36f639286f377: Bootstrap starting.
I20260709 13:18:04.693416  6807 raft_consensus.cc:2468] T 20f6842e26174571996b8dea4151d4be P b7ab4784c7344b939bc36f639286f377 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 0.
I20260709 13:18:04.694957  6695 leader_election.cc:304] T 20f6842e26174571996b8dea4151d4be P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:18:04.696453  6931 raft_consensus.cc:2804] T 20f6842e26174571996b8dea4151d4be P ccd8a4c3bfe3413cb2ae219b09aea832 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:18:04.696708  6923 tablet_bootstrap.cc:654] T 1bf4668eeb70467fb3dc5a0289233b3c P ccd8a4c3bfe3413cb2ae219b09aea832: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:04.696867  6931 raft_consensus.cc:493] T 20f6842e26174571996b8dea4151d4be P ccd8a4c3bfe3413cb2ae219b09aea832 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:04.697806  6931 raft_consensus.cc:3060] T 20f6842e26174571996b8dea4151d4be P ccd8a4c3bfe3413cb2ae219b09aea832 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:04.702555  6921 tablet_bootstrap.cc:654] T 7887766dc6784fcaa42b35c05fea7a99 P b7ab4784c7344b939bc36f639286f377: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:04.710646  6731 raft_consensus.cc:2468] T e77e330a82df4b43a745d57a68f6f057 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 2.
I20260709 13:18:04.711441  6923 tablet_bootstrap.cc:492] T 1bf4668eeb70467fb3dc5a0289233b3c P ccd8a4c3bfe3413cb2ae219b09aea832: No bootstrap required, opened a new log
I20260709 13:18:04.712582  6923 ts_tablet_manager.cc:1403] T 1bf4668eeb70467fb3dc5a0289233b3c P ccd8a4c3bfe3413cb2ae219b09aea832: Time spent bootstrapping tablet: real 0.045s	user 0.013s	sys 0.008s
I20260709 13:18:04.721292  6879 raft_consensus.cc:2468] T e77e330a82df4b43a745d57a68f6f057 P cd75a17ab2604397adab03bb8b5fd75c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 2.
I20260709 13:18:04.723167  6772 leader_election.cc:304] T e77e330a82df4b43a745d57a68f6f057 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:18:04.721771  6923 raft_consensus.cc:359] T 1bf4668eeb70467fb3dc5a0289233b3c P ccd8a4c3bfe3413cb2ae219b09aea832 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:04.724749  6921 tablet_bootstrap.cc:492] T 7887766dc6784fcaa42b35c05fea7a99 P b7ab4784c7344b939bc36f639286f377: No bootstrap required, opened a new log
I20260709 13:18:04.726356  6957 raft_consensus.cc:2804] T e77e330a82df4b43a745d57a68f6f057 P b7ab4784c7344b939bc36f639286f377 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:18:04.727710  6957 raft_consensus.cc:697] T e77e330a82df4b43a745d57a68f6f057 P b7ab4784c7344b939bc36f639286f377 [term 2 LEADER]: Becoming Leader. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
I20260709 13:18:04.728480  6931 raft_consensus.cc:515] T 20f6842e26174571996b8dea4151d4be P ccd8a4c3bfe3413cb2ae219b09aea832 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:04.728899  6957 consensus_queue.cc:237] T e77e330a82df4b43a745d57a68f6f057 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } }
I20260709 13:18:04.731984  6921 ts_tablet_manager.cc:1403] T 7887766dc6784fcaa42b35c05fea7a99 P b7ab4784c7344b939bc36f639286f377: Time spent bootstrapping tablet: real 0.039s	user 0.012s	sys 0.008s
I20260709 13:18:04.732743  6807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20f6842e26174571996b8dea4151d4be" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:18:04.733548  6807 raft_consensus.cc:3060] T 20f6842e26174571996b8dea4151d4be P b7ab4784c7344b939bc36f639286f377 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:04.737119  6921 raft_consensus.cc:359] T 7887766dc6784fcaa42b35c05fea7a99 P b7ab4784c7344b939bc36f639286f377 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:04.739708  6921 raft_consensus.cc:385] T 7887766dc6784fcaa42b35c05fea7a99 P b7ab4784c7344b939bc36f639286f377 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:04.740628  6921 raft_consensus.cc:740] T 7887766dc6784fcaa42b35c05fea7a99 P b7ab4784c7344b939bc36f639286f377 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Initialized, Role: FOLLOWER
I20260709 13:18:04.740247  6923 raft_consensus.cc:385] T 1bf4668eeb70467fb3dc5a0289233b3c P ccd8a4c3bfe3413cb2ae219b09aea832 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:04.741573  6923 raft_consensus.cc:740] T 1bf4668eeb70467fb3dc5a0289233b3c P ccd8a4c3bfe3413cb2ae219b09aea832 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Initialized, Role: FOLLOWER
I20260709 13:18:04.742628  6921 consensus_queue.cc:260] T 7887766dc6784fcaa42b35c05fea7a99 P b7ab4784c7344b939bc36f639286f377 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:04.743611  6923 consensus_queue.cc:260] T 1bf4668eeb70467fb3dc5a0289233b3c P ccd8a4c3bfe3413cb2ae219b09aea832 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:04.747896  6921 ts_tablet_manager.cc:1434] T 7887766dc6784fcaa42b35c05fea7a99 P b7ab4784c7344b939bc36f639286f377: Time spent starting tablet: real 0.015s	user 0.005s	sys 0.001s
I20260709 13:18:04.749532  6921 tablet_bootstrap.cc:492] T 4d9def8b32fd443aa94ab1420b06837b P b7ab4784c7344b939bc36f639286f377: Bootstrap starting.
I20260709 13:18:04.757910  6921 tablet_bootstrap.cc:654] T 4d9def8b32fd443aa94ab1420b06837b P b7ab4784c7344b939bc36f639286f377: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:04.748562  6923 ts_tablet_manager.cc:1434] T 1bf4668eeb70467fb3dc5a0289233b3c P ccd8a4c3bfe3413cb2ae219b09aea832: Time spent starting tablet: real 0.035s	user 0.010s	sys 0.001s
I20260709 13:18:04.759406  6923 tablet_bootstrap.cc:492] T 4d9def8b32fd443aa94ab1420b06837b P ccd8a4c3bfe3413cb2ae219b09aea832: Bootstrap starting.
I20260709 13:18:04.760460  6984 consensus_queue.cc:1048] T f3f9c2e2bf644115957398fe4c9459db P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:18:04.769657  6923 tablet_bootstrap.cc:654] T 4d9def8b32fd443aa94ab1420b06837b P ccd8a4c3bfe3413cb2ae219b09aea832: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:04.780370  6806 raft_consensus.cc:3060] T e31b9971c15848dea59d4d4130141d9e P b7ab4784c7344b939bc36f639286f377 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:04.786631  6921 tablet_bootstrap.cc:492] T 4d9def8b32fd443aa94ab1420b06837b P b7ab4784c7344b939bc36f639286f377: No bootstrap required, opened a new log
I20260709 13:18:04.787235  6921 ts_tablet_manager.cc:1403] T 4d9def8b32fd443aa94ab1420b06837b P b7ab4784c7344b939bc36f639286f377: Time spent bootstrapping tablet: real 0.038s	user 0.015s	sys 0.004s
I20260709 13:18:04.789853  6921 raft_consensus.cc:359] T 4d9def8b32fd443aa94ab1420b06837b P b7ab4784c7344b939bc36f639286f377 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:04.793609  6921 raft_consensus.cc:385] T 4d9def8b32fd443aa94ab1420b06837b P b7ab4784c7344b939bc36f639286f377 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:04.793226  6923 tablet_bootstrap.cc:492] T 4d9def8b32fd443aa94ab1420b06837b P ccd8a4c3bfe3413cb2ae219b09aea832: No bootstrap required, opened a new log
I20260709 13:18:04.794418  6923 ts_tablet_manager.cc:1403] T 4d9def8b32fd443aa94ab1420b06837b P ccd8a4c3bfe3413cb2ae219b09aea832: Time spent bootstrapping tablet: real 0.035s	user 0.010s	sys 0.008s
I20260709 13:18:04.797765  6923 raft_consensus.cc:359] T 4d9def8b32fd443aa94ab1420b06837b P ccd8a4c3bfe3413cb2ae219b09aea832 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:04.802614  6923 raft_consensus.cc:385] T 4d9def8b32fd443aa94ab1420b06837b P ccd8a4c3bfe3413cb2ae219b09aea832 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:04.803128  6923 raft_consensus.cc:740] T 4d9def8b32fd443aa94ab1420b06837b P ccd8a4c3bfe3413cb2ae219b09aea832 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Initialized, Role: FOLLOWER
I20260709 13:18:04.804145  6923 consensus_queue.cc:260] T 4d9def8b32fd443aa94ab1420b06837b P ccd8a4c3bfe3413cb2ae219b09aea832 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:04.798676  6921 raft_consensus.cc:740] T 4d9def8b32fd443aa94ab1420b06837b P b7ab4784c7344b939bc36f639286f377 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Initialized, Role: FOLLOWER
I20260709 13:18:04.806186  6921 consensus_queue.cc:260] T 4d9def8b32fd443aa94ab1420b06837b P b7ab4784c7344b939bc36f639286f377 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:04.808377  6921 ts_tablet_manager.cc:1434] T 4d9def8b32fd443aa94ab1420b06837b P b7ab4784c7344b939bc36f639286f377: Time spent starting tablet: real 0.021s	user 0.006s	sys 0.000s
I20260709 13:18:04.808454  6807 raft_consensus.cc:2468] T 20f6842e26174571996b8dea4151d4be P b7ab4784c7344b939bc36f639286f377 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 1.
I20260709 13:18:04.809592  6921 tablet_bootstrap.cc:492] T f09c2a98de1a4decabd0ff900dd44caa P b7ab4784c7344b939bc36f639286f377: Bootstrap starting.
I20260709 13:18:04.809863  6695 leader_election.cc:304] T 20f6842e26174571996b8dea4151d4be P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
I20260709 13:18:04.810596  6922 tablet_bootstrap.cc:492] T 4d9def8b32fd443aa94ab1420b06837b P cd75a17ab2604397adab03bb8b5fd75c: No bootstrap required, opened a new log
I20260709 13:18:04.810978  6984 raft_consensus.cc:2804] T 20f6842e26174571996b8dea4151d4be P ccd8a4c3bfe3413cb2ae219b09aea832 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:18:04.811772  6984 raft_consensus.cc:697] T 20f6842e26174571996b8dea4151d4be P ccd8a4c3bfe3413cb2ae219b09aea832 [term 1 LEADER]: Becoming Leader. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
I20260709 13:18:04.812732  6984 consensus_queue.cc:237] T 20f6842e26174571996b8dea4151d4be P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:04.812588  6627 catalog_manager.cc:5697] T e77e330a82df4b43a745d57a68f6f057 P b7ab4784c7344b939bc36f639286f377 reported cstate change: term changed from 0 to 2, leader changed from <none> to b7ab4784c7344b939bc36f639286f377 (127.5.126.66). New cstate: current_term: 2 leader_uuid: "b7ab4784c7344b939bc36f639286f377" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:04.816838  6923 ts_tablet_manager.cc:1434] T 4d9def8b32fd443aa94ab1420b06837b P ccd8a4c3bfe3413cb2ae219b09aea832: Time spent starting tablet: real 0.022s	user 0.007s	sys 0.000s
I20260709 13:18:04.811105  6922 ts_tablet_manager.cc:1403] T 4d9def8b32fd443aa94ab1420b06837b P cd75a17ab2604397adab03bb8b5fd75c: Time spent bootstrapping tablet: real 0.217s	user 0.066s	sys 0.073s
I20260709 13:18:04.819227  6923 tablet_bootstrap.cc:492] T a3022224cc81473690653a83d4e99470 P ccd8a4c3bfe3413cb2ae219b09aea832: Bootstrap starting.
I20260709 13:18:04.819993  6922 raft_consensus.cc:359] T 4d9def8b32fd443aa94ab1420b06837b P cd75a17ab2604397adab03bb8b5fd75c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:04.820681  6922 raft_consensus.cc:385] T 4d9def8b32fd443aa94ab1420b06837b P cd75a17ab2604397adab03bb8b5fd75c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:04.821622  6931 leader_election.cc:290] T 20f6842e26174571996b8dea4151d4be P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 1 election: Requested vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:18:04.820936  6922 raft_consensus.cc:740] T 4d9def8b32fd443aa94ab1420b06837b P cd75a17ab2604397adab03bb8b5fd75c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cd75a17ab2604397adab03bb8b5fd75c, State: Initialized, Role: FOLLOWER
I20260709 13:18:04.824142  6922 consensus_queue.cc:260] T 4d9def8b32fd443aa94ab1420b06837b P cd75a17ab2604397adab03bb8b5fd75c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:04.825320  6879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20f6842e26174571996b8dea4151d4be" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:18:04.826098  6922 ts_tablet_manager.cc:1434] T 4d9def8b32fd443aa94ab1420b06837b P cd75a17ab2604397adab03bb8b5fd75c: Time spent starting tablet: real 0.008s	user 0.002s	sys 0.002s
I20260709 13:18:04.827124  6922 tablet_bootstrap.cc:492] T 20f6842e26174571996b8dea4151d4be P cd75a17ab2604397adab03bb8b5fd75c: Bootstrap starting.
I20260709 13:18:04.827481  6921 tablet_bootstrap.cc:654] T f09c2a98de1a4decabd0ff900dd44caa P b7ab4784c7344b939bc36f639286f377: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:04.825601  6923 tablet_bootstrap.cc:654] T a3022224cc81473690653a83d4e99470 P ccd8a4c3bfe3413cb2ae219b09aea832: Neither blocks nor log segments found. Creating new log.
W20260709 13:18:04.832096  6697 leader_election.cc:343] T 20f6842e26174571996b8dea4151d4be P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:04.834229  6957 raft_consensus.cc:493] T 90d42e216d9741e190bca19a781291fd P b7ab4784c7344b939bc36f639286f377 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:04.834821  6957 raft_consensus.cc:515] T 90d42e216d9741e190bca19a781291fd P b7ab4784c7344b939bc36f639286f377 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:04.836859  6951 consensus_queue.cc:1048] T 404190ce4ce94cecbfcb6ea9d1dd8626 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:18:04.838450  6957 leader_election.cc:290] T 90d42e216d9741e190bca19a781291fd P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:18:04.839691  6731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90d42e216d9741e190bca19a781291fd" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:18:04.840507  6731 raft_consensus.cc:2468] T 90d42e216d9741e190bca19a781291fd P ccd8a4c3bfe3413cb2ae219b09aea832 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 0.
I20260709 13:18:04.841959  6770 leader_election.cc:304] T 90d42e216d9741e190bca19a781291fd P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
I20260709 13:18:04.839694  6881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90d42e216d9741e190bca19a781291fd" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
W20260709 13:18:04.844415  6772 leader_election.cc:343] T 90d42e216d9741e190bca19a781291fd P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:04.845631  6957 raft_consensus.cc:2804] T 90d42e216d9741e190bca19a781291fd P b7ab4784c7344b939bc36f639286f377 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:18:04.846026  6957 raft_consensus.cc:493] T 90d42e216d9741e190bca19a781291fd P b7ab4784c7344b939bc36f639286f377 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:04.846401  6957 raft_consensus.cc:3060] T 90d42e216d9741e190bca19a781291fd P b7ab4784c7344b939bc36f639286f377 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:04.847817  6922 tablet_bootstrap.cc:654] T 20f6842e26174571996b8dea4151d4be P cd75a17ab2604397adab03bb8b5fd75c: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:04.873726  6976 raft_consensus.cc:493] T 1bf4668eeb70467fb3dc5a0289233b3c P b7ab4784c7344b939bc36f639286f377 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:04.874701  6976 raft_consensus.cc:515] T 1bf4668eeb70467fb3dc5a0289233b3c P b7ab4784c7344b939bc36f639286f377 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:04.878234  6976 leader_election.cc:290] T 1bf4668eeb70467fb3dc5a0289233b3c P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:18:04.881124  6731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bf4668eeb70467fb3dc5a0289233b3c" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:18:04.881834  6731 raft_consensus.cc:2468] T 1bf4668eeb70467fb3dc5a0289233b3c P ccd8a4c3bfe3413cb2ae219b09aea832 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 0.
I20260709 13:18:04.883445  6770 leader_election.cc:304] T 1bf4668eeb70467fb3dc5a0289233b3c P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
I20260709 13:18:04.882112  6627 catalog_manager.cc:5697] T 20f6842e26174571996b8dea4151d4be P ccd8a4c3bfe3413cb2ae219b09aea832 reported cstate change: term changed from 0 to 1, leader changed from <none> to ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65). New cstate: current_term: 1 leader_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:04.884177  6881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bf4668eeb70467fb3dc5a0289233b3c" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:18:04.884472  6976 raft_consensus.cc:2804] T 1bf4668eeb70467fb3dc5a0289233b3c P b7ab4784c7344b939bc36f639286f377 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:18:04.885035  6881 raft_consensus.cc:2468] T 1bf4668eeb70467fb3dc5a0289233b3c P cd75a17ab2604397adab03bb8b5fd75c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 0.
I20260709 13:18:04.885057  6976 raft_consensus.cc:493] T 1bf4668eeb70467fb3dc5a0289233b3c P b7ab4784c7344b939bc36f639286f377 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:04.886745  6976 raft_consensus.cc:3060] T 1bf4668eeb70467fb3dc5a0289233b3c P b7ab4784c7344b939bc36f639286f377 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:04.888345  6921 tablet_bootstrap.cc:492] T f09c2a98de1a4decabd0ff900dd44caa P b7ab4784c7344b939bc36f639286f377: No bootstrap required, opened a new log
I20260709 13:18:04.889037  6921 ts_tablet_manager.cc:1403] T f09c2a98de1a4decabd0ff900dd44caa P b7ab4784c7344b939bc36f639286f377: Time spent bootstrapping tablet: real 0.080s	user 0.019s	sys 0.023s
I20260709 13:18:04.894250  6921 raft_consensus.cc:359] T f09c2a98de1a4decabd0ff900dd44caa P b7ab4784c7344b939bc36f639286f377 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:04.895370  6921 raft_consensus.cc:385] T f09c2a98de1a4decabd0ff900dd44caa P b7ab4784c7344b939bc36f639286f377 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:04.895751  6921 raft_consensus.cc:740] T f09c2a98de1a4decabd0ff900dd44caa P b7ab4784c7344b939bc36f639286f377 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Initialized, Role: FOLLOWER
I20260709 13:18:04.896744  6921 consensus_queue.cc:260] T f09c2a98de1a4decabd0ff900dd44caa P b7ab4784c7344b939bc36f639286f377 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:04.899988  6921 ts_tablet_manager.cc:1434] T f09c2a98de1a4decabd0ff900dd44caa P b7ab4784c7344b939bc36f639286f377: Time spent starting tablet: real 0.011s	user 0.009s	sys 0.000s
I20260709 13:18:04.901000  6921 tablet_bootstrap.cc:492] T 07a92dd554674067a83a9cb68c4773f2 P b7ab4784c7344b939bc36f639286f377: Bootstrap starting.
I20260709 13:18:04.906329  6957 raft_consensus.cc:515] T 90d42e216d9741e190bca19a781291fd P b7ab4784c7344b939bc36f639286f377 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:04.918443  6959 raft_consensus.cc:493] T a3022224cc81473690653a83d4e99470 P cd75a17ab2604397adab03bb8b5fd75c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:04.919279  6959 raft_consensus.cc:515] T a3022224cc81473690653a83d4e99470 P cd75a17ab2604397adab03bb8b5fd75c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:04.924943  6923 tablet_bootstrap.cc:492] T a3022224cc81473690653a83d4e99470 P ccd8a4c3bfe3413cb2ae219b09aea832: No bootstrap required, opened a new log
I20260709 13:18:04.926909  6807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3022224cc81473690653a83d4e99470" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:18:04.927119  6731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3022224cc81473690653a83d4e99470" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:18:04.927605  6807 raft_consensus.cc:2468] T a3022224cc81473690653a83d4e99470 P b7ab4784c7344b939bc36f639286f377 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 0.
I20260709 13:18:04.927762  6959 leader_election.cc:290] T a3022224cc81473690653a83d4e99470 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:18:04.928917  6844 leader_election.cc:304] T a3022224cc81473690653a83d4e99470 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:18:04.929445  6957 leader_election.cc:290] T 90d42e216d9741e190bca19a781291fd P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 1 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
W20260709 13:18:04.929894  6844 leader_election.cc:343] T a3022224cc81473690653a83d4e99470 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:04.933224  6921 tablet_bootstrap.cc:654] T 07a92dd554674067a83a9cb68c4773f2 P b7ab4784c7344b939bc36f639286f377: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:04.925426  6923 ts_tablet_manager.cc:1403] T a3022224cc81473690653a83d4e99470 P ccd8a4c3bfe3413cb2ae219b09aea832: Time spent bootstrapping tablet: real 0.108s	user 0.025s	sys 0.018s
I20260709 13:18:04.935361  6951 raft_consensus.cc:493] T 4d9def8b32fd443aa94ab1420b06837b P ccd8a4c3bfe3413cb2ae219b09aea832 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:04.935563  6731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90d42e216d9741e190bca19a781291fd" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:18:04.937419  6951 raft_consensus.cc:515] T 4d9def8b32fd443aa94ab1420b06837b P ccd8a4c3bfe3413cb2ae219b09aea832 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:04.937971  6731 raft_consensus.cc:3060] T 90d42e216d9741e190bca19a781291fd P ccd8a4c3bfe3413cb2ae219b09aea832 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:04.939845  6951 leader_election.cc:290] T 4d9def8b32fd443aa94ab1420b06837b P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:18:04.942238  6807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d9def8b32fd443aa94ab1420b06837b" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:18:04.943173  6807 raft_consensus.cc:2468] T 4d9def8b32fd443aa94ab1420b06837b P b7ab4784c7344b939bc36f639286f377 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 0.
I20260709 13:18:04.933064  6881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90d42e216d9741e190bca19a781291fd" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:18:04.929728  6959 raft_consensus.cc:2804] T a3022224cc81473690653a83d4e99470 P cd75a17ab2604397adab03bb8b5fd75c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:18:04.950196  6959 raft_consensus.cc:493] T a3022224cc81473690653a83d4e99470 P cd75a17ab2604397adab03bb8b5fd75c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:04.951930  6959 raft_consensus.cc:3060] T a3022224cc81473690653a83d4e99470 P cd75a17ab2604397adab03bb8b5fd75c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:04.951828  6695 leader_election.cc:304] T 4d9def8b32fd443aa94ab1420b06837b P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
I20260709 13:18:04.953274  6951 raft_consensus.cc:2804] T 4d9def8b32fd443aa94ab1420b06837b P ccd8a4c3bfe3413cb2ae219b09aea832 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:18:04.953685  6951 raft_consensus.cc:493] T 4d9def8b32fd443aa94ab1420b06837b P ccd8a4c3bfe3413cb2ae219b09aea832 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:04.954002  6951 raft_consensus.cc:3060] T 4d9def8b32fd443aa94ab1420b06837b P ccd8a4c3bfe3413cb2ae219b09aea832 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:18:04.961998  6772 leader_election.cc:343] T 90d42e216d9741e190bca19a781291fd P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:04.966807  6984 consensus_queue.cc:1048] T 404190ce4ce94cecbfcb6ea9d1dd8626 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:18:04.967868  6923 raft_consensus.cc:359] T a3022224cc81473690653a83d4e99470 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:04.970499  6923 raft_consensus.cc:385] T a3022224cc81473690653a83d4e99470 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:04.971094  6923 raft_consensus.cc:740] T a3022224cc81473690653a83d4e99470 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Initialized, Role: FOLLOWER
I20260709 13:18:04.969530  6976 raft_consensus.cc:515] T 1bf4668eeb70467fb3dc5a0289233b3c P b7ab4784c7344b939bc36f639286f377 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:04.952268  6878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d9def8b32fd443aa94ab1420b06837b" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:18:04.976598  6731 raft_consensus.cc:2468] T 90d42e216d9741e190bca19a781291fd P ccd8a4c3bfe3413cb2ae219b09aea832 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 1.
I20260709 13:18:04.970299  6951 raft_consensus.cc:515] T 4d9def8b32fd443aa94ab1420b06837b P ccd8a4c3bfe3413cb2ae219b09aea832 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:04.987721  6923 consensus_queue.cc:260] T a3022224cc81473690653a83d4e99470 P ccd8a4c3bfe3413cb2ae219b09aea832 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:04.989607  6770 leader_election.cc:304] T 90d42e216d9741e190bca19a781291fd P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:18:04.989925  6951 leader_election.cc:290] T 4d9def8b32fd443aa94ab1420b06837b P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 1 election: Requested vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:18:04.990567  6957 raft_consensus.cc:2804] T 90d42e216d9741e190bca19a781291fd P b7ab4784c7344b939bc36f639286f377 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:18:04.991065  6957 raft_consensus.cc:697] T 90d42e216d9741e190bca19a781291fd P b7ab4784c7344b939bc36f639286f377 [term 1 LEADER]: Becoming Leader. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
I20260709 13:18:04.993081  6922 tablet_bootstrap.cc:492] T 20f6842e26174571996b8dea4151d4be P cd75a17ab2604397adab03bb8b5fd75c: No bootstrap required, opened a new log
I20260709 13:18:04.993762  6922 ts_tablet_manager.cc:1403] T 20f6842e26174571996b8dea4151d4be P cd75a17ab2604397adab03bb8b5fd75c: Time spent bootstrapping tablet: real 0.167s	user 0.020s	sys 0.027s
I20260709 13:18:04.994529  6806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d9def8b32fd443aa94ab1420b06837b" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:18:04.996176  6806 raft_consensus.cc:3060] T 4d9def8b32fd443aa94ab1420b06837b P b7ab4784c7344b939bc36f639286f377 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:04.998159  6879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d9def8b32fd443aa94ab1420b06837b" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:18:04.984642  6878 raft_consensus.cc:2468] T 4d9def8b32fd443aa94ab1420b06837b P cd75a17ab2604397adab03bb8b5fd75c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 0.
I20260709 13:18:05.001818  6923 ts_tablet_manager.cc:1434] T a3022224cc81473690653a83d4e99470 P ccd8a4c3bfe3413cb2ae219b09aea832: Time spent starting tablet: real 0.067s	user 0.008s	sys 0.000s
I20260709 13:18:04.996876  6731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bf4668eeb70467fb3dc5a0289233b3c" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:18:05.008598  6923 tablet_bootstrap.cc:492] T f09c2a98de1a4decabd0ff900dd44caa P ccd8a4c3bfe3413cb2ae219b09aea832: Bootstrap starting.
I20260709 13:18:05.005820  6805 raft_consensus.cc:3060] T 7887766dc6784fcaa42b35c05fea7a99 P b7ab4784c7344b939bc36f639286f377 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:05.000597  6880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bf4668eeb70467fb3dc5a0289233b3c" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:18:05.010524  6930 raft_consensus.cc:493] T 4f00a2e87e56452083b759f60d461ee3 P b7ab4784c7344b939bc36f639286f377 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:05.010654  6880 raft_consensus.cc:3060] T 1bf4668eeb70467fb3dc5a0289233b3c P cd75a17ab2604397adab03bb8b5fd75c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:05.011080  6930 raft_consensus.cc:515] T 4f00a2e87e56452083b759f60d461ee3 P b7ab4784c7344b939bc36f639286f377 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:05.012521  6921 tablet_bootstrap.cc:492] T 07a92dd554674067a83a9cb68c4773f2 P b7ab4784c7344b939bc36f639286f377: No bootstrap required, opened a new log
I20260709 13:18:05.013454  6930 leader_election.cc:290] T 4f00a2e87e56452083b759f60d461ee3 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:18:05.015326  6879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f00a2e87e56452083b759f60d461ee3" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:18:05.009356  6731 raft_consensus.cc:3060] T 1bf4668eeb70467fb3dc5a0289233b3c P ccd8a4c3bfe3413cb2ae219b09aea832 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:05.016261  6957 consensus_queue.cc:237] T 90d42e216d9741e190bca19a781291fd P b7ab4784c7344b939bc36f639286f377 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
W20260709 13:18:05.016920  6772 leader_election.cc:343] T 4f00a2e87e56452083b759f60d461ee3 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:05.018190  6732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f00a2e87e56452083b759f60d461ee3" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:18:05.018906  6921 ts_tablet_manager.cc:1403] T 07a92dd554674067a83a9cb68c4773f2 P b7ab4784c7344b939bc36f639286f377: Time spent bootstrapping tablet: real 0.118s	user 0.030s	sys 0.017s
I20260709 13:18:05.020289  6931 raft_consensus.cc:493] T a3022224cc81473690653a83d4e99470 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:05.021375  6931 raft_consensus.cc:515] T a3022224cc81473690653a83d4e99470 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:05.023126  6921 raft_consensus.cc:359] T 07a92dd554674067a83a9cb68c4773f2 P b7ab4784c7344b939bc36f639286f377 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:05.023654  6931 leader_election.cc:290] T a3022224cc81473690653a83d4e99470 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:18:05.025519  6804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3022224cc81473690653a83d4e99470" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:18:05.024883  6732 raft_consensus.cc:2468] T 4f00a2e87e56452083b759f60d461ee3 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 0.
I20260709 13:18:05.003539  6976 leader_election.cc:290] T 1bf4668eeb70467fb3dc5a0289233b3c P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 1 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:18:05.023834  6921 raft_consensus.cc:385] T 07a92dd554674067a83a9cb68c4773f2 P b7ab4784c7344b939bc36f639286f377 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:05.035104  6921 raft_consensus.cc:740] T 07a92dd554674067a83a9cb68c4773f2 P b7ab4784c7344b939bc36f639286f377 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Initialized, Role: FOLLOWER
I20260709 13:18:05.020170  6806 raft_consensus.cc:2468] T 4d9def8b32fd443aa94ab1420b06837b P b7ab4784c7344b939bc36f639286f377 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 1.
I20260709 13:18:05.037859  6770 leader_election.cc:304] T 4f00a2e87e56452083b759f60d461ee3 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:18:05.034989  6804 raft_consensus.cc:2468] T a3022224cc81473690653a83d4e99470 P b7ab4784c7344b939bc36f639286f377 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 0.
I20260709 13:18:05.040573  6695 leader_election.cc:304] T a3022224cc81473690653a83d4e99470 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
I20260709 13:18:05.042232  6984 raft_consensus.cc:2804] T a3022224cc81473690653a83d4e99470 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:18:05.042615  6984 raft_consensus.cc:493] T a3022224cc81473690653a83d4e99470 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:05.042960  6984 raft_consensus.cc:3060] T a3022224cc81473690653a83d4e99470 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:05.036401  6921 consensus_queue.cc:260] T 07a92dd554674067a83a9cb68c4773f2 P b7ab4784c7344b939bc36f639286f377 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:05.043217  6880 raft_consensus.cc:2468] T 1bf4668eeb70467fb3dc5a0289233b3c P cd75a17ab2604397adab03bb8b5fd75c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 1.
I20260709 13:18:05.044885  6922 raft_consensus.cc:359] T 20f6842e26174571996b8dea4151d4be P cd75a17ab2604397adab03bb8b5fd75c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:05.045379  6922 raft_consensus.cc:385] T 20f6842e26174571996b8dea4151d4be P cd75a17ab2604397adab03bb8b5fd75c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:05.045812  6922 raft_consensus.cc:740] T 20f6842e26174571996b8dea4151d4be P cd75a17ab2604397adab03bb8b5fd75c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cd75a17ab2604397adab03bb8b5fd75c, State: Initialized, Role: FOLLOWER
I20260709 13:18:05.046505  6922 consensus_queue.cc:260] T 20f6842e26174571996b8dea4151d4be P cd75a17ab2604397adab03bb8b5fd75c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:05.049445  6921 ts_tablet_manager.cc:1434] T 07a92dd554674067a83a9cb68c4773f2 P b7ab4784c7344b939bc36f639286f377: Time spent starting tablet: real 0.030s	user 0.006s	sys 0.001s
I20260709 13:18:05.049661  6922 ts_tablet_manager.cc:1434] T 20f6842e26174571996b8dea4151d4be P cd75a17ab2604397adab03bb8b5fd75c: Time spent starting tablet: real 0.055s	user 0.007s	sys 0.001s
I20260709 13:18:05.050513  6921 tablet_bootstrap.cc:492] T 3a485a995abc4807b6e511e45419f737 P b7ab4784c7344b939bc36f639286f377: Bootstrap starting.
I20260709 13:18:05.028504  6959 raft_consensus.cc:515] T a3022224cc81473690653a83d4e99470 P cd75a17ab2604397adab03bb8b5fd75c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:05.054123  6695 leader_election.cc:304] T 4d9def8b32fd443aa94ab1420b06837b P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:18:05.056272  6772 leader_election.cc:304] T 1bf4668eeb70467fb3dc5a0289233b3c P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:18:05.044546  6930 raft_consensus.cc:2804] T 4f00a2e87e56452083b759f60d461ee3 P b7ab4784c7344b939bc36f639286f377 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:18:05.058627  6951 raft_consensus.cc:2804] T 4d9def8b32fd443aa94ab1420b06837b P ccd8a4c3bfe3413cb2ae219b09aea832 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:18:05.058943  6930 raft_consensus.cc:493] T 4f00a2e87e56452083b759f60d461ee3 P b7ab4784c7344b939bc36f639286f377 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:05.058718  6732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3022224cc81473690653a83d4e99470" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:18:05.059432  6930 raft_consensus.cc:3060] T 4f00a2e87e56452083b759f60d461ee3 P b7ab4784c7344b939bc36f639286f377 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:05.060870  6880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3022224cc81473690653a83d4e99470" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:18:05.062206  6976 raft_consensus.cc:2804] T 1bf4668eeb70467fb3dc5a0289233b3c P b7ab4784c7344b939bc36f639286f377 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:18:05.063588  6731 raft_consensus.cc:2468] T 1bf4668eeb70467fb3dc5a0289233b3c P ccd8a4c3bfe3413cb2ae219b09aea832 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 1.
I20260709 13:18:05.067988  6880 raft_consensus.cc:2393] T a3022224cc81473690653a83d4e99470 P cd75a17ab2604397adab03bb8b5fd75c [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ccd8a4c3bfe3413cb2ae219b09aea832 in current term 1: Already voted for candidate cd75a17ab2604397adab03bb8b5fd75c in this term.
I20260709 13:18:05.070246  6957 raft_consensus.cc:493] T f09c2a98de1a4decabd0ff900dd44caa P b7ab4784c7344b939bc36f639286f377 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:05.070979  6957 raft_consensus.cc:515] T f09c2a98de1a4decabd0ff900dd44caa P b7ab4784c7344b939bc36f639286f377 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:05.072132  6930 raft_consensus.cc:515] T 4f00a2e87e56452083b759f60d461ee3 P b7ab4784c7344b939bc36f639286f377 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:05.079391  6922 tablet_bootstrap.cc:492] T 90d42e216d9741e190bca19a781291fd P cd75a17ab2604397adab03bb8b5fd75c: Bootstrap starting.
I20260709 13:18:05.080456  6923 tablet_bootstrap.cc:654] T f09c2a98de1a4decabd0ff900dd44caa P ccd8a4c3bfe3413cb2ae219b09aea832: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:05.083120  6730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09c2a98de1a4decabd0ff900dd44caa" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:18:05.094491  6930 leader_election.cc:290] T 4f00a2e87e56452083b759f60d461ee3 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 1 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:18:05.094353  6880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f00a2e87e56452083b759f60d461ee3" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:18:05.089485  6959 leader_election.cc:290] T a3022224cc81473690653a83d4e99470 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 1 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:18:05.097929  6976 raft_consensus.cc:697] T 1bf4668eeb70467fb3dc5a0289233b3c P b7ab4784c7344b939bc36f639286f377 [term 1 LEADER]: Becoming Leader. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
I20260709 13:18:05.086273  6951 raft_consensus.cc:697] T 4d9def8b32fd443aa94ab1420b06837b P ccd8a4c3bfe3413cb2ae219b09aea832 [term 1 LEADER]: Becoming Leader. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
I20260709 13:18:05.098163  6730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f00a2e87e56452083b759f60d461ee3" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:18:05.101189  6730 raft_consensus.cc:3060] T 4f00a2e87e56452083b759f60d461ee3 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:05.100919  6976 consensus_queue.cc:237] T 1bf4668eeb70467fb3dc5a0289233b3c P b7ab4784c7344b939bc36f639286f377 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:05.101296  6986 consensus_queue.cc:1048] T 7887766dc6784fcaa42b35c05fea7a99 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.028s
W20260709 13:18:05.102891  6772 leader_election.cc:343] T 4f00a2e87e56452083b759f60d461ee3 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:05.106580  6957 leader_election.cc:290] T f09c2a98de1a4decabd0ff900dd44caa P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
W20260709 13:18:05.099069  6770 leader_election.cc:343] T f09c2a98de1a4decabd0ff900dd44caa P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:05.108305  6880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09c2a98de1a4decabd0ff900dd44caa" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:18:05.109230  6806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3022224cc81473690653a83d4e99470" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
W20260709 13:18:05.109601  6772 leader_election.cc:343] T f09c2a98de1a4decabd0ff900dd44caa P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:05.109812  6806 raft_consensus.cc:3060] T a3022224cc81473690653a83d4e99470 P b7ab4784c7344b939bc36f639286f377 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:05.110046  6772 leader_election.cc:304] T f09c2a98de1a4decabd0ff900dd44caa P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:18:05.114740  6957 raft_consensus.cc:2749] T f09c2a98de1a4decabd0ff900dd44caa P b7ab4784c7344b939bc36f639286f377 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:18:05.117569  6922 tablet_bootstrap.cc:654] T 90d42e216d9741e190bca19a781291fd P cd75a17ab2604397adab03bb8b5fd75c: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:05.128989  6730 raft_consensus.cc:2468] T 4f00a2e87e56452083b759f60d461ee3 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 1.
I20260709 13:18:05.134362  6984 raft_consensus.cc:515] T a3022224cc81473690653a83d4e99470 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:05.135231  6770 leader_election.cc:304] T 4f00a2e87e56452083b759f60d461ee3 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:18:05.136313  6732 raft_consensus.cc:2393] T a3022224cc81473690653a83d4e99470 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c in current term 1: Already voted for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in this term.
I20260709 13:18:05.127446  6951 consensus_queue.cc:237] T 4d9def8b32fd443aa94ab1420b06837b P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:05.140903  7020 raft_consensus.cc:2804] T 4f00a2e87e56452083b759f60d461ee3 P b7ab4784c7344b939bc36f639286f377 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:18:05.142463  7020 raft_consensus.cc:697] T 4f00a2e87e56452083b759f60d461ee3 P b7ab4784c7344b939bc36f639286f377 [term 1 LEADER]: Becoming Leader. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
I20260709 13:18:05.143436  7020 consensus_queue.cc:237] T 4f00a2e87e56452083b759f60d461ee3 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:05.144819  7019 consensus_queue.cc:1048] T 7887766dc6784fcaa42b35c05fea7a99 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 13:18:05.145756  6806 raft_consensus.cc:2468] T a3022224cc81473690653a83d4e99470 P b7ab4784c7344b939bc36f639286f377 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 1.
I20260709 13:18:05.151183  6844 leader_election.cc:304] T a3022224cc81473690653a83d4e99470 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:18:05.152832  6959 raft_consensus.cc:2804] T a3022224cc81473690653a83d4e99470 P cd75a17ab2604397adab03bb8b5fd75c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:18:05.153564  6984 leader_election.cc:290] T a3022224cc81473690653a83d4e99470 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 1 election: Requested vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:18:05.154899  6879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3022224cc81473690653a83d4e99470" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:18:05.155277  6806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3022224cc81473690653a83d4e99470" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:18:05.155968  6806 raft_consensus.cc:2393] T a3022224cc81473690653a83d4e99470 P b7ab4784c7344b939bc36f639286f377 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate ccd8a4c3bfe3413cb2ae219b09aea832 in current term 1: Already voted for candidate cd75a17ab2604397adab03bb8b5fd75c in this term.
I20260709 13:18:05.153625  6959 raft_consensus.cc:697] T a3022224cc81473690653a83d4e99470 P cd75a17ab2604397adab03bb8b5fd75c [term 1 LEADER]: Becoming Leader. State: Replica: cd75a17ab2604397adab03bb8b5fd75c, State: Running, Role: LEADER
I20260709 13:18:05.157051  6959 consensus_queue.cc:237] T a3022224cc81473690653a83d4e99470 P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:05.145294  6880 raft_consensus.cc:1275] T e77e330a82df4b43a745d57a68f6f057 P cd75a17ab2604397adab03bb8b5fd75c [term 2 FOLLOWER]: Refusing update from remote peer b7ab4784c7344b939bc36f639286f377: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 13:18:05.171705  6976 consensus_queue.cc:1048] T e77e330a82df4b43a745d57a68f6f057 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:18:05.184432  6627 catalog_manager.cc:5697] T 90d42e216d9741e190bca19a781291fd P b7ab4784c7344b939bc36f639286f377 reported cstate change: term changed from 0 to 1, leader changed from <none> to b7ab4784c7344b939bc36f639286f377 (127.5.126.66). New cstate: current_term: 1 leader_uuid: "b7ab4784c7344b939bc36f639286f377" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:05.195089  6922 tablet_bootstrap.cc:492] T 90d42e216d9741e190bca19a781291fd P cd75a17ab2604397adab03bb8b5fd75c: No bootstrap required, opened a new log
I20260709 13:18:05.195865  6922 ts_tablet_manager.cc:1403] T 90d42e216d9741e190bca19a781291fd P cd75a17ab2604397adab03bb8b5fd75c: Time spent bootstrapping tablet: real 0.117s	user 0.005s	sys 0.009s
I20260709 13:18:05.200731  6922 raft_consensus.cc:359] T 90d42e216d9741e190bca19a781291fd P cd75a17ab2604397adab03bb8b5fd75c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:05.201797  6922 raft_consensus.cc:385] T 90d42e216d9741e190bca19a781291fd P cd75a17ab2604397adab03bb8b5fd75c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:05.202189  6922 raft_consensus.cc:740] T 90d42e216d9741e190bca19a781291fd P cd75a17ab2604397adab03bb8b5fd75c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cd75a17ab2604397adab03bb8b5fd75c, State: Initialized, Role: FOLLOWER
I20260709 13:18:05.205435  6921 tablet_bootstrap.cc:654] T 3a485a995abc4807b6e511e45419f737 P b7ab4784c7344b939bc36f639286f377: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:05.204514  6922 consensus_queue.cc:260] T 90d42e216d9741e190bca19a781291fd P cd75a17ab2604397adab03bb8b5fd75c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:05.220897  6697 leader_election.cc:304] T a3022224cc81473690653a83d4e99470 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:18:05.221722  7020 raft_consensus.cc:493] T 07a92dd554674067a83a9cb68c4773f2 P b7ab4784c7344b939bc36f639286f377 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:05.222340  7020 raft_consensus.cc:515] T 07a92dd554674067a83a9cb68c4773f2 P b7ab4784c7344b939bc36f639286f377 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:05.216485  6630 catalog_manager.cc:5697] T 4d9def8b32fd443aa94ab1420b06837b P ccd8a4c3bfe3413cb2ae219b09aea832 reported cstate change: term changed from 0 to 1, leader changed from <none> to ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65). New cstate: current_term: 1 leader_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:05.222762  6951 raft_consensus.cc:2749] T a3022224cc81473690653a83d4e99470 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:18:05.227486  6732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a92dd554674067a83a9cb68c4773f2" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:18:05.187376  6627 catalog_manager.cc:5697] T 1bf4668eeb70467fb3dc5a0289233b3c P b7ab4784c7344b939bc36f639286f377 reported cstate change: term changed from 0 to 1, leader changed from <none> to b7ab4784c7344b939bc36f639286f377 (127.5.126.66). New cstate: current_term: 1 leader_uuid: "b7ab4784c7344b939bc36f639286f377" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } health_report { overall_health: UNKNOWN } } }
W20260709 13:18:05.229372  6770 leader_election.cc:343] T 07a92dd554674067a83a9cb68c4773f2 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:05.234009  6879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a92dd554674067a83a9cb68c4773f2" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:18:05.234719  6922 ts_tablet_manager.cc:1434] T 90d42e216d9741e190bca19a781291fd P cd75a17ab2604397adab03bb8b5fd75c: Time spent starting tablet: real 0.038s	user 0.008s	sys 0.002s
I20260709 13:18:05.237219  6922 tablet_bootstrap.cc:492] T bb7fa124c3bf4ef9ab65a407cb008441 P cd75a17ab2604397adab03bb8b5fd75c: Bootstrap starting.
I20260709 13:18:05.225528  7020 leader_election.cc:290] T 07a92dd554674067a83a9cb68c4773f2 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
W20260709 13:18:05.245695  6772 leader_election.cc:343] T 07a92dd554674067a83a9cb68c4773f2 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:05.248838  6772 leader_election.cc:304] T 07a92dd554674067a83a9cb68c4773f2 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:18:05.250797  7020 raft_consensus.cc:2749] T 07a92dd554674067a83a9cb68c4773f2 P b7ab4784c7344b939bc36f639286f377 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:18:05.256021  6732 raft_consensus.cc:1275] T e77e330a82df4b43a745d57a68f6f057 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 2 FOLLOWER]: Refusing update from remote peer b7ab4784c7344b939bc36f639286f377: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 13:18:05.259827  7020 consensus_queue.cc:1048] T e77e330a82df4b43a745d57a68f6f057 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:18:05.261041  6922 tablet_bootstrap.cc:654] T bb7fa124c3bf4ef9ab65a407cb008441 P cd75a17ab2604397adab03bb8b5fd75c: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:05.271106  6923 tablet_bootstrap.cc:492] T f09c2a98de1a4decabd0ff900dd44caa P ccd8a4c3bfe3413cb2ae219b09aea832: No bootstrap required, opened a new log
I20260709 13:18:05.271872  6923 ts_tablet_manager.cc:1403] T f09c2a98de1a4decabd0ff900dd44caa P ccd8a4c3bfe3413cb2ae219b09aea832: Time spent bootstrapping tablet: real 0.267s	user 0.011s	sys 0.016s
I20260709 13:18:05.272799  6628 catalog_manager.cc:5697] T a3022224cc81473690653a83d4e99470 P cd75a17ab2604397adab03bb8b5fd75c reported cstate change: term changed from 0 to 1, leader changed from <none> to cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67). New cstate: current_term: 1 leader_uuid: "cd75a17ab2604397adab03bb8b5fd75c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:05.277734  6923 raft_consensus.cc:359] T f09c2a98de1a4decabd0ff900dd44caa P ccd8a4c3bfe3413cb2ae219b09aea832 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:05.278772  6923 raft_consensus.cc:385] T f09c2a98de1a4decabd0ff900dd44caa P ccd8a4c3bfe3413cb2ae219b09aea832 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:05.279196  6921 tablet_bootstrap.cc:492] T 3a485a995abc4807b6e511e45419f737 P b7ab4784c7344b939bc36f639286f377: No bootstrap required, opened a new log
I20260709 13:18:05.279836  6921 ts_tablet_manager.cc:1403] T 3a485a995abc4807b6e511e45419f737 P b7ab4784c7344b939bc36f639286f377: Time spent bootstrapping tablet: real 0.229s	user 0.013s	sys 0.024s
I20260709 13:18:05.279121  6923 raft_consensus.cc:740] T f09c2a98de1a4decabd0ff900dd44caa P ccd8a4c3bfe3413cb2ae219b09aea832 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Initialized, Role: FOLLOWER
I20260709 13:18:05.281487  6923 consensus_queue.cc:260] T f09c2a98de1a4decabd0ff900dd44caa P ccd8a4c3bfe3413cb2ae219b09aea832 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:05.283996  6923 ts_tablet_manager.cc:1434] T f09c2a98de1a4decabd0ff900dd44caa P ccd8a4c3bfe3413cb2ae219b09aea832: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.001s
I20260709 13:18:05.286708  6959 raft_consensus.cc:493] T 20f6842e26174571996b8dea4151d4be P cd75a17ab2604397adab03bb8b5fd75c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:05.287261  6959 raft_consensus.cc:515] T 20f6842e26174571996b8dea4151d4be P cd75a17ab2604397adab03bb8b5fd75c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:05.288199  6922 tablet_bootstrap.cc:492] T bb7fa124c3bf4ef9ab65a407cb008441 P cd75a17ab2604397adab03bb8b5fd75c: No bootstrap required, opened a new log
I20260709 13:18:05.288686  6922 ts_tablet_manager.cc:1403] T bb7fa124c3bf4ef9ab65a407cb008441 P cd75a17ab2604397adab03bb8b5fd75c: Time spent bootstrapping tablet: real 0.052s	user 0.013s	sys 0.013s
I20260709 13:18:05.289459  6959 leader_election.cc:290] T 20f6842e26174571996b8dea4151d4be P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:18:05.291975  6730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20f6842e26174571996b8dea4151d4be" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:18:05.293404  6806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20f6842e26174571996b8dea4151d4be" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:18:05.294595  6806 raft_consensus.cc:2393] T 20f6842e26174571996b8dea4151d4be P b7ab4784c7344b939bc36f639286f377 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c in current term 1: Already voted for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in this term.
I20260709 13:18:05.297107  6844 leader_election.cc:304] T 20f6842e26174571996b8dea4151d4be P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:18:05.298596  7016 raft_consensus.cc:3060] T 20f6842e26174571996b8dea4151d4be P cd75a17ab2604397adab03bb8b5fd75c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:05.298357  6921 raft_consensus.cc:359] T 3a485a995abc4807b6e511e45419f737 P b7ab4784c7344b939bc36f639286f377 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:05.299788  6922 raft_consensus.cc:359] T bb7fa124c3bf4ef9ab65a407cb008441 P cd75a17ab2604397adab03bb8b5fd75c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:05.300550  6922 raft_consensus.cc:385] T bb7fa124c3bf4ef9ab65a407cb008441 P cd75a17ab2604397adab03bb8b5fd75c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:05.300221  6921 raft_consensus.cc:385] T 3a485a995abc4807b6e511e45419f737 P b7ab4784c7344b939bc36f639286f377 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:05.300853  6922 raft_consensus.cc:740] T bb7fa124c3bf4ef9ab65a407cb008441 P cd75a17ab2604397adab03bb8b5fd75c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cd75a17ab2604397adab03bb8b5fd75c, State: Initialized, Role: FOLLOWER
I20260709 13:18:05.301044  6921 raft_consensus.cc:740] T 3a485a995abc4807b6e511e45419f737 P b7ab4784c7344b939bc36f639286f377 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Initialized, Role: FOLLOWER
I20260709 13:18:05.301702  6922 consensus_queue.cc:260] T bb7fa124c3bf4ef9ab65a407cb008441 P cd75a17ab2604397adab03bb8b5fd75c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:05.304422  6922 ts_tablet_manager.cc:1434] T bb7fa124c3bf4ef9ab65a407cb008441 P cd75a17ab2604397adab03bb8b5fd75c: Time spent starting tablet: real 0.015s	user 0.010s	sys 0.005s
I20260709 13:18:05.305480  6922 tablet_bootstrap.cc:492] T 4f00a2e87e56452083b759f60d461ee3 P cd75a17ab2604397adab03bb8b5fd75c: Bootstrap starting.
I20260709 13:18:05.305317  6921 consensus_queue.cc:260] T 3a485a995abc4807b6e511e45419f737 P b7ab4784c7344b939bc36f639286f377 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:05.307269  7016 raft_consensus.cc:2749] T 20f6842e26174571996b8dea4151d4be P cd75a17ab2604397adab03bb8b5fd75c [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:18:05.307516  6921 ts_tablet_manager.cc:1434] T 3a485a995abc4807b6e511e45419f737 P b7ab4784c7344b939bc36f639286f377: Time spent starting tablet: real 0.027s	user 0.006s	sys 0.000s
I20260709 13:18:05.310137  6921 tablet_bootstrap.cc:492] T f4b8bd455d5a47c18a1380839c6e0d61 P b7ab4784c7344b939bc36f639286f377: Bootstrap starting.
I20260709 13:18:05.308462  6923 tablet_bootstrap.cc:492] T f4b8bd455d5a47c18a1380839c6e0d61 P ccd8a4c3bfe3413cb2ae219b09aea832: Bootstrap starting.
I20260709 13:18:05.316430  6922 tablet_bootstrap.cc:654] T 4f00a2e87e56452083b759f60d461ee3 P cd75a17ab2604397adab03bb8b5fd75c: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:05.318430  6921 tablet_bootstrap.cc:654] T f4b8bd455d5a47c18a1380839c6e0d61 P b7ab4784c7344b939bc36f639286f377: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:05.323908  6923 tablet_bootstrap.cc:654] T f4b8bd455d5a47c18a1380839c6e0d61 P ccd8a4c3bfe3413cb2ae219b09aea832: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:05.330047  6921 tablet_bootstrap.cc:492] T f4b8bd455d5a47c18a1380839c6e0d61 P b7ab4784c7344b939bc36f639286f377: No bootstrap required, opened a new log
I20260709 13:18:05.330633  6921 ts_tablet_manager.cc:1403] T f4b8bd455d5a47c18a1380839c6e0d61 P b7ab4784c7344b939bc36f639286f377: Time spent bootstrapping tablet: real 0.021s	user 0.012s	sys 0.005s
I20260709 13:18:05.333364  6921 raft_consensus.cc:359] T f4b8bd455d5a47c18a1380839c6e0d61 P b7ab4784c7344b939bc36f639286f377 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:05.334197  6921 raft_consensus.cc:385] T f4b8bd455d5a47c18a1380839c6e0d61 P b7ab4784c7344b939bc36f639286f377 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:05.334542  6921 raft_consensus.cc:740] T f4b8bd455d5a47c18a1380839c6e0d61 P b7ab4784c7344b939bc36f639286f377 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Initialized, Role: FOLLOWER
I20260709 13:18:05.335400  6921 consensus_queue.cc:260] T f4b8bd455d5a47c18a1380839c6e0d61 P b7ab4784c7344b939bc36f639286f377 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:05.337705  6921 ts_tablet_manager.cc:1434] T f4b8bd455d5a47c18a1380839c6e0d61 P b7ab4784c7344b939bc36f639286f377: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 13:18:05.338654  6921 tablet_bootstrap.cc:492] T 30e88460611e47b2ba16a46a30b5f416 P b7ab4784c7344b939bc36f639286f377: Bootstrap starting.
I20260709 13:18:05.342248  6923 tablet_bootstrap.cc:492] T f4b8bd455d5a47c18a1380839c6e0d61 P ccd8a4c3bfe3413cb2ae219b09aea832: No bootstrap required, opened a new log
I20260709 13:18:05.343005  6923 ts_tablet_manager.cc:1403] T f4b8bd455d5a47c18a1380839c6e0d61 P ccd8a4c3bfe3413cb2ae219b09aea832: Time spent bootstrapping tablet: real 0.035s	user 0.016s	sys 0.008s
I20260709 13:18:05.345974  6921 tablet_bootstrap.cc:654] T 30e88460611e47b2ba16a46a30b5f416 P b7ab4784c7344b939bc36f639286f377: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:05.347525  6923 raft_consensus.cc:359] T f4b8bd455d5a47c18a1380839c6e0d61 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:05.348865  6923 raft_consensus.cc:385] T f4b8bd455d5a47c18a1380839c6e0d61 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:05.349308  6923 raft_consensus.cc:740] T f4b8bd455d5a47c18a1380839c6e0d61 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Initialized, Role: FOLLOWER
I20260709 13:18:05.350641  6923 consensus_queue.cc:260] T f4b8bd455d5a47c18a1380839c6e0d61 P ccd8a4c3bfe3413cb2ae219b09aea832 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:05.354197  6923 ts_tablet_manager.cc:1434] T f4b8bd455d5a47c18a1380839c6e0d61 P ccd8a4c3bfe3413cb2ae219b09aea832: Time spent starting tablet: real 0.011s	user 0.012s	sys 0.000s
I20260709 13:18:05.356739  6922 tablet_bootstrap.cc:492] T 4f00a2e87e56452083b759f60d461ee3 P cd75a17ab2604397adab03bb8b5fd75c: No bootstrap required, opened a new log
I20260709 13:18:05.358129  6923 tablet_bootstrap.cc:492] T 30e88460611e47b2ba16a46a30b5f416 P ccd8a4c3bfe3413cb2ae219b09aea832: Bootstrap starting.
I20260709 13:18:05.360354  6922 ts_tablet_manager.cc:1403] T 4f00a2e87e56452083b759f60d461ee3 P cd75a17ab2604397adab03bb8b5fd75c: Time spent bootstrapping tablet: real 0.055s	user 0.032s	sys 0.015s
I20260709 13:18:05.362457  6921 tablet_bootstrap.cc:492] T 30e88460611e47b2ba16a46a30b5f416 P b7ab4784c7344b939bc36f639286f377: No bootstrap required, opened a new log
I20260709 13:18:05.363065  6921 ts_tablet_manager.cc:1403] T 30e88460611e47b2ba16a46a30b5f416 P b7ab4784c7344b939bc36f639286f377: Time spent bootstrapping tablet: real 0.025s	user 0.013s	sys 0.005s
I20260709 13:18:05.363945  6922 raft_consensus.cc:359] T 4f00a2e87e56452083b759f60d461ee3 P cd75a17ab2604397adab03bb8b5fd75c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:05.364787  6922 raft_consensus.cc:385] T 4f00a2e87e56452083b759f60d461ee3 P cd75a17ab2604397adab03bb8b5fd75c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:05.365084  6922 raft_consensus.cc:740] T 4f00a2e87e56452083b759f60d461ee3 P cd75a17ab2604397adab03bb8b5fd75c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cd75a17ab2604397adab03bb8b5fd75c, State: Initialized, Role: FOLLOWER
I20260709 13:18:05.365988  6923 tablet_bootstrap.cc:654] T 30e88460611e47b2ba16a46a30b5f416 P ccd8a4c3bfe3413cb2ae219b09aea832: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:05.366010  6922 consensus_queue.cc:260] T 4f00a2e87e56452083b759f60d461ee3 P cd75a17ab2604397adab03bb8b5fd75c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:05.366158  6921 raft_consensus.cc:359] T 30e88460611e47b2ba16a46a30b5f416 P b7ab4784c7344b939bc36f639286f377 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:05.367264  6921 raft_consensus.cc:385] T 30e88460611e47b2ba16a46a30b5f416 P b7ab4784c7344b939bc36f639286f377 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:05.368081  6921 raft_consensus.cc:740] T 30e88460611e47b2ba16a46a30b5f416 P b7ab4784c7344b939bc36f639286f377 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Initialized, Role: FOLLOWER
I20260709 13:18:05.368882  6921 consensus_queue.cc:260] T 30e88460611e47b2ba16a46a30b5f416 P b7ab4784c7344b939bc36f639286f377 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:05.369226  6922 ts_tablet_manager.cc:1434] T 4f00a2e87e56452083b759f60d461ee3 P cd75a17ab2604397adab03bb8b5fd75c: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:18:05.370853  6922 tablet_bootstrap.cc:492] T f09c2a98de1a4decabd0ff900dd44caa P cd75a17ab2604397adab03bb8b5fd75c: Bootstrap starting.
I20260709 13:18:05.371299  6921 ts_tablet_manager.cc:1434] T 30e88460611e47b2ba16a46a30b5f416 P b7ab4784c7344b939bc36f639286f377: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:18:05.372336  6921 tablet_bootstrap.cc:492] T 44bde925b2e541b69890d70715b85176 P b7ab4784c7344b939bc36f639286f377: Bootstrap starting.
I20260709 13:18:05.368649  6630 catalog_manager.cc:5697] T 4f00a2e87e56452083b759f60d461ee3 P b7ab4784c7344b939bc36f639286f377 reported cstate change: term changed from 0 to 1, leader changed from <none> to b7ab4784c7344b939bc36f639286f377 (127.5.126.66). New cstate: current_term: 1 leader_uuid: "b7ab4784c7344b939bc36f639286f377" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:05.378747  6930 raft_consensus.cc:493] T 3a485a995abc4807b6e511e45419f737 P b7ab4784c7344b939bc36f639286f377 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:05.379603  6923 tablet_bootstrap.cc:492] T 30e88460611e47b2ba16a46a30b5f416 P ccd8a4c3bfe3413cb2ae219b09aea832: No bootstrap required, opened a new log
I20260709 13:18:05.379287  6930 raft_consensus.cc:515] T 3a485a995abc4807b6e511e45419f737 P b7ab4784c7344b939bc36f639286f377 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:05.380226  6923 ts_tablet_manager.cc:1403] T 30e88460611e47b2ba16a46a30b5f416 P ccd8a4c3bfe3413cb2ae219b09aea832: Time spent bootstrapping tablet: real 0.022s	user 0.016s	sys 0.004s
I20260709 13:18:05.381301  6922 tablet_bootstrap.cc:654] T f09c2a98de1a4decabd0ff900dd44caa P cd75a17ab2604397adab03bb8b5fd75c: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:05.381791  6930 leader_election.cc:290] T 3a485a995abc4807b6e511e45419f737 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:18:05.378216  6921 tablet_bootstrap.cc:654] T 44bde925b2e541b69890d70715b85176 P b7ab4784c7344b939bc36f639286f377: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:05.383757  6732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a485a995abc4807b6e511e45419f737" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:18:05.385924  6880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a485a995abc4807b6e511e45419f737" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
W20260709 13:18:05.387802  6770 leader_election.cc:343] T 3a485a995abc4807b6e511e45419f737 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:18:05.389127  6772 leader_election.cc:343] T 3a485a995abc4807b6e511e45419f737 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:05.389633  6772 leader_election.cc:304] T 3a485a995abc4807b6e511e45419f737 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:18:05.390987  6930 raft_consensus.cc:2749] T 3a485a995abc4807b6e511e45419f737 P b7ab4784c7344b939bc36f639286f377 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:18:05.392685  6923 raft_consensus.cc:359] T 30e88460611e47b2ba16a46a30b5f416 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:05.393731  6923 raft_consensus.cc:385] T 30e88460611e47b2ba16a46a30b5f416 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:05.394150  6923 raft_consensus.cc:740] T 30e88460611e47b2ba16a46a30b5f416 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Initialized, Role: FOLLOWER
I20260709 13:18:05.395331  6923 consensus_queue.cc:260] T 30e88460611e47b2ba16a46a30b5f416 P ccd8a4c3bfe3413cb2ae219b09aea832 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:05.398270  6923 ts_tablet_manager.cc:1434] T 30e88460611e47b2ba16a46a30b5f416 P ccd8a4c3bfe3413cb2ae219b09aea832: Time spent starting tablet: real 0.018s	user 0.006s	sys 0.000s
I20260709 13:18:05.399801  6923 tablet_bootstrap.cc:492] T 07a92dd554674067a83a9cb68c4773f2 P ccd8a4c3bfe3413cb2ae219b09aea832: Bootstrap starting.
I20260709 13:18:05.407864  6921 tablet_bootstrap.cc:492] T 44bde925b2e541b69890d70715b85176 P b7ab4784c7344b939bc36f639286f377: No bootstrap required, opened a new log
I20260709 13:18:05.408540  6951 consensus_queue.cc:1048] T 20f6842e26174571996b8dea4151d4be P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:18:05.408986  6923 tablet_bootstrap.cc:654] T 07a92dd554674067a83a9cb68c4773f2 P ccd8a4c3bfe3413cb2ae219b09aea832: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:05.408948  6921 ts_tablet_manager.cc:1403] T 44bde925b2e541b69890d70715b85176 P b7ab4784c7344b939bc36f639286f377: Time spent bootstrapping tablet: real 0.037s	user 0.018s	sys 0.007s
I20260709 13:18:05.412110  6921 raft_consensus.cc:359] T 44bde925b2e541b69890d70715b85176 P b7ab4784c7344b939bc36f639286f377 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:05.412894  6921 raft_consensus.cc:385] T 44bde925b2e541b69890d70715b85176 P b7ab4784c7344b939bc36f639286f377 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:05.413226  6921 raft_consensus.cc:740] T 44bde925b2e541b69890d70715b85176 P b7ab4784c7344b939bc36f639286f377 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Initialized, Role: FOLLOWER
I20260709 13:18:05.414111  6921 consensus_queue.cc:260] T 44bde925b2e541b69890d70715b85176 P b7ab4784c7344b939bc36f639286f377 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:05.416536  6921 ts_tablet_manager.cc:1434] T 44bde925b2e541b69890d70715b85176 P b7ab4784c7344b939bc36f639286f377: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:18:05.419768  6921 tablet_bootstrap.cc:492] T ce4f062dcd314d43a63ca74067cb5ee3 P b7ab4784c7344b939bc36f639286f377: Bootstrap starting.
I20260709 13:18:05.425485  6923 tablet_bootstrap.cc:492] T 07a92dd554674067a83a9cb68c4773f2 P ccd8a4c3bfe3413cb2ae219b09aea832: No bootstrap required, opened a new log
I20260709 13:18:05.426110  6923 ts_tablet_manager.cc:1403] T 07a92dd554674067a83a9cb68c4773f2 P ccd8a4c3bfe3413cb2ae219b09aea832: Time spent bootstrapping tablet: real 0.027s	user 0.014s	sys 0.000s
I20260709 13:18:05.426313  6921 tablet_bootstrap.cc:654] T ce4f062dcd314d43a63ca74067cb5ee3 P b7ab4784c7344b939bc36f639286f377: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:05.427892  6951 consensus_queue.cc:1048] T 20f6842e26174571996b8dea4151d4be P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:18:05.429414  6923 raft_consensus.cc:359] T 07a92dd554674067a83a9cb68c4773f2 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:05.430244  6923 raft_consensus.cc:385] T 07a92dd554674067a83a9cb68c4773f2 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:05.430572  6923 raft_consensus.cc:740] T 07a92dd554674067a83a9cb68c4773f2 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Initialized, Role: FOLLOWER
I20260709 13:18:05.431353  6923 consensus_queue.cc:260] T 07a92dd554674067a83a9cb68c4773f2 P ccd8a4c3bfe3413cb2ae219b09aea832 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:05.438015  6923 ts_tablet_manager.cc:1434] T 07a92dd554674067a83a9cb68c4773f2 P ccd8a4c3bfe3413cb2ae219b09aea832: Time spent starting tablet: real 0.012s	user 0.008s	sys 0.000s
I20260709 13:18:05.439278  6923 tablet_bootstrap.cc:492] T ce4f062dcd314d43a63ca74067cb5ee3 P ccd8a4c3bfe3413cb2ae219b09aea832: Bootstrap starting.
I20260709 13:18:05.446940  6921 tablet_bootstrap.cc:492] T ce4f062dcd314d43a63ca74067cb5ee3 P b7ab4784c7344b939bc36f639286f377: No bootstrap required, opened a new log
I20260709 13:18:05.447502  6921 ts_tablet_manager.cc:1403] T ce4f062dcd314d43a63ca74067cb5ee3 P b7ab4784c7344b939bc36f639286f377: Time spent bootstrapping tablet: real 0.028s	user 0.013s	sys 0.011s
I20260709 13:18:05.447757  6923 tablet_bootstrap.cc:654] T ce4f062dcd314d43a63ca74067cb5ee3 P ccd8a4c3bfe3413cb2ae219b09aea832: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:05.449940  7016 raft_consensus.cc:493] T bb7fa124c3bf4ef9ab65a407cb008441 P cd75a17ab2604397adab03bb8b5fd75c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:05.450364  6921 raft_consensus.cc:359] T ce4f062dcd314d43a63ca74067cb5ee3 P b7ab4784c7344b939bc36f639286f377 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:05.451136  6921 raft_consensus.cc:385] T ce4f062dcd314d43a63ca74067cb5ee3 P b7ab4784c7344b939bc36f639286f377 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:05.451442  6921 raft_consensus.cc:740] T ce4f062dcd314d43a63ca74067cb5ee3 P b7ab4784c7344b939bc36f639286f377 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Initialized, Role: FOLLOWER
I20260709 13:18:05.452229  6921 consensus_queue.cc:260] T ce4f062dcd314d43a63ca74067cb5ee3 P b7ab4784c7344b939bc36f639286f377 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:05.450486  7016 raft_consensus.cc:515] T bb7fa124c3bf4ef9ab65a407cb008441 P cd75a17ab2604397adab03bb8b5fd75c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:05.454305  6921 ts_tablet_manager.cc:1434] T ce4f062dcd314d43a63ca74067cb5ee3 P b7ab4784c7344b939bc36f639286f377: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.003s
I20260709 13:18:05.455618  7016 leader_election.cc:290] T bb7fa124c3bf4ef9ab65a407cb008441 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:18:05.457952  6805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb7fa124c3bf4ef9ab65a407cb008441" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:18:05.458276  6881 raft_consensus.cc:3060] T bb7fa124c3bf4ef9ab65a407cb008441 P cd75a17ab2604397adab03bb8b5fd75c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:05.458328  6732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb7fa124c3bf4ef9ab65a407cb008441" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:18:05.460752  6923 tablet_bootstrap.cc:492] T ce4f062dcd314d43a63ca74067cb5ee3 P ccd8a4c3bfe3413cb2ae219b09aea832: No bootstrap required, opened a new log
I20260709 13:18:05.460575  6844 leader_election.cc:304] T bb7fa124c3bf4ef9ab65a407cb008441 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:18:05.461336  6923 ts_tablet_manager.cc:1403] T ce4f062dcd314d43a63ca74067cb5ee3 P ccd8a4c3bfe3413cb2ae219b09aea832: Time spent bootstrapping tablet: real 0.022s	user 0.011s	sys 0.007s
I20260709 13:18:05.464423  6923 raft_consensus.cc:359] T ce4f062dcd314d43a63ca74067cb5ee3 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:05.465211  6923 raft_consensus.cc:385] T ce4f062dcd314d43a63ca74067cb5ee3 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:05.465969  6923 raft_consensus.cc:740] T ce4f062dcd314d43a63ca74067cb5ee3 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Initialized, Role: FOLLOWER
I20260709 13:18:05.466722  6923 consensus_queue.cc:260] T ce4f062dcd314d43a63ca74067cb5ee3 P ccd8a4c3bfe3413cb2ae219b09aea832 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:05.469271  6923 ts_tablet_manager.cc:1434] T ce4f062dcd314d43a63ca74067cb5ee3 P ccd8a4c3bfe3413cb2ae219b09aea832: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.003s
I20260709 13:18:05.469544  6921 tablet_bootstrap.cc:492] T 4b8cacb381b746da8d0049b0a83b41dd P b7ab4784c7344b939bc36f639286f377: Bootstrap starting.
I20260709 13:18:05.470202  6923 tablet_bootstrap.cc:492] T 3a485a995abc4807b6e511e45419f737 P ccd8a4c3bfe3413cb2ae219b09aea832: Bootstrap starting.
I20260709 13:18:05.471529  7019 raft_consensus.cc:493] T f4b8bd455d5a47c18a1380839c6e0d61 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:05.497126  7019 raft_consensus.cc:515] T f4b8bd455d5a47c18a1380839c6e0d61 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:05.501060  6923 tablet_bootstrap.cc:654] T 3a485a995abc4807b6e511e45419f737 P ccd8a4c3bfe3413cb2ae219b09aea832: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:05.500897  6805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4b8bd455d5a47c18a1380839c6e0d61" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:18:05.501616  6805 raft_consensus.cc:2468] T f4b8bd455d5a47c18a1380839c6e0d61 P b7ab4784c7344b939bc36f639286f377 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 0.
I20260709 13:18:05.502554  6921 tablet_bootstrap.cc:654] T 4b8cacb381b746da8d0049b0a83b41dd P b7ab4784c7344b939bc36f639286f377: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:05.503293  6695 leader_election.cc:304] T f4b8bd455d5a47c18a1380839c6e0d61 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
I20260709 13:18:05.493577  7020 raft_consensus.cc:493] T 30e88460611e47b2ba16a46a30b5f416 P b7ab4784c7344b939bc36f639286f377 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:05.504452  6984 raft_consensus.cc:2804] T f4b8bd455d5a47c18a1380839c6e0d61 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:18:05.505117  7020 raft_consensus.cc:515] T 30e88460611e47b2ba16a46a30b5f416 P b7ab4784c7344b939bc36f639286f377 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:05.508535  6984 raft_consensus.cc:493] T f4b8bd455d5a47c18a1380839c6e0d61 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:05.515187  6984 raft_consensus.cc:3060] T f4b8bd455d5a47c18a1380839c6e0d61 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:05.518590  7020 leader_election.cc:290] T 30e88460611e47b2ba16a46a30b5f416 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:18:05.520391  6879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30e88460611e47b2ba16a46a30b5f416" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:18:05.520604  6732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30e88460611e47b2ba16a46a30b5f416" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:18:05.521620  6732 raft_consensus.cc:2468] T 30e88460611e47b2ba16a46a30b5f416 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 0.
W20260709 13:18:05.522925  6772 leader_election.cc:343] T 30e88460611e47b2ba16a46a30b5f416 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:05.524024  6770 leader_election.cc:304] T 30e88460611e47b2ba16a46a30b5f416 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:18:05.526072  6930 raft_consensus.cc:2804] T 30e88460611e47b2ba16a46a30b5f416 P b7ab4784c7344b939bc36f639286f377 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:18:05.526572  6930 raft_consensus.cc:493] T 30e88460611e47b2ba16a46a30b5f416 P b7ab4784c7344b939bc36f639286f377 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:05.527045  6930 raft_consensus.cc:3060] T 30e88460611e47b2ba16a46a30b5f416 P b7ab4784c7344b939bc36f639286f377 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:05.531387  6984 raft_consensus.cc:515] T f4b8bd455d5a47c18a1380839c6e0d61 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:05.535116  7019 leader_election.cc:290] T f4b8bd455d5a47c18a1380839c6e0d61 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:18:05.543385  6922 tablet_bootstrap.cc:492] T f09c2a98de1a4decabd0ff900dd44caa P cd75a17ab2604397adab03bb8b5fd75c: No bootstrap required, opened a new log
I20260709 13:18:05.544317  6922 ts_tablet_manager.cc:1403] T f09c2a98de1a4decabd0ff900dd44caa P cd75a17ab2604397adab03bb8b5fd75c: Time spent bootstrapping tablet: real 0.174s	user 0.015s	sys 0.007s
I20260709 13:18:05.548583  6922 raft_consensus.cc:359] T f09c2a98de1a4decabd0ff900dd44caa P cd75a17ab2604397adab03bb8b5fd75c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:05.549703  6922 raft_consensus.cc:385] T f09c2a98de1a4decabd0ff900dd44caa P cd75a17ab2604397adab03bb8b5fd75c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:05.550032  6922 raft_consensus.cc:740] T f09c2a98de1a4decabd0ff900dd44caa P cd75a17ab2604397adab03bb8b5fd75c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cd75a17ab2604397adab03bb8b5fd75c, State: Initialized, Role: FOLLOWER
I20260709 13:18:05.550169  6984 leader_election.cc:290] T f4b8bd455d5a47c18a1380839c6e0d61 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 1 election: Requested vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:18:05.551029  6922 consensus_queue.cc:260] T f09c2a98de1a4decabd0ff900dd44caa P cd75a17ab2604397adab03bb8b5fd75c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:05.554459  6805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4b8bd455d5a47c18a1380839c6e0d61" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:18:05.554488  6879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4b8bd455d5a47c18a1380839c6e0d61" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:18:05.555223  6805 raft_consensus.cc:3060] T f4b8bd455d5a47c18a1380839c6e0d61 P b7ab4784c7344b939bc36f639286f377 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:05.551396  6986 raft_consensus.cc:493] T 07a92dd554674067a83a9cb68c4773f2 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:05.556872  6986 raft_consensus.cc:515] T 07a92dd554674067a83a9cb68c4773f2 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:05.560676  7020 consensus_queue.cc:1048] T 1bf4668eeb70467fb3dc5a0289233b3c P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:18:05.562609  6807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a92dd554674067a83a9cb68c4773f2" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:18:05.563333  6807 raft_consensus.cc:2468] T 07a92dd554674067a83a9cb68c4773f2 P b7ab4784c7344b939bc36f639286f377 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 0.
I20260709 13:18:05.564636  6695 leader_election.cc:304] T 07a92dd554674067a83a9cb68c4773f2 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
I20260709 13:18:05.565573  6951 raft_consensus.cc:2804] T 07a92dd554674067a83a9cb68c4773f2 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:18:05.565932  6951 raft_consensus.cc:493] T 07a92dd554674067a83a9cb68c4773f2 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:05.566265  6951 raft_consensus.cc:3060] T 07a92dd554674067a83a9cb68c4773f2 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:18:05.568058  6697 leader_election.cc:343] T f4b8bd455d5a47c18a1380839c6e0d61 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:05.568159  6880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4b8bd455d5a47c18a1380839c6e0d61" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:18:05.568630  6878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a92dd554674067a83a9cb68c4773f2" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:18:05.569841  6976 raft_consensus.cc:493] T ce4f062dcd314d43a63ca74067cb5ee3 P b7ab4784c7344b939bc36f639286f377 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:05.560712  6986 leader_election.cc:290] T 07a92dd554674067a83a9cb68c4773f2 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:18:05.574810  6879 raft_consensus.cc:3060] T 90d42e216d9741e190bca19a781291fd P cd75a17ab2604397adab03bb8b5fd75c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:05.573690  6976 raft_consensus.cc:515] T ce4f062dcd314d43a63ca74067cb5ee3 P b7ab4784c7344b939bc36f639286f377 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:05.576471  6922 ts_tablet_manager.cc:1434] T f09c2a98de1a4decabd0ff900dd44caa P cd75a17ab2604397adab03bb8b5fd75c: Time spent starting tablet: real 0.032s	user 0.007s	sys 0.001s
I20260709 13:18:05.577343  6922 tablet_bootstrap.cc:492] T 07a92dd554674067a83a9cb68c4773f2 P cd75a17ab2604397adab03bb8b5fd75c: Bootstrap starting.
W20260709 13:18:05.578459  6697 leader_election.cc:343] T f4b8bd455d5a47c18a1380839c6e0d61 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:18:05.580454  6697 leader_election.cc:343] T 07a92dd554674067a83a9cb68c4773f2 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:05.575729  7016 raft_consensus.cc:2749] T bb7fa124c3bf4ef9ab65a407cb008441 P cd75a17ab2604397adab03bb8b5fd75c [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:18:05.583578  6730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce4f062dcd314d43a63ca74067cb5ee3" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:18:05.584240  6976 leader_election.cc:290] T ce4f062dcd314d43a63ca74067cb5ee3 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:18:05.587370  6730 raft_consensus.cc:2468] T ce4f062dcd314d43a63ca74067cb5ee3 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 0.
I20260709 13:18:05.589440  6770 leader_election.cc:304] T ce4f062dcd314d43a63ca74067cb5ee3 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
I20260709 13:18:05.590507  6976 raft_consensus.cc:2804] T ce4f062dcd314d43a63ca74067cb5ee3 P b7ab4784c7344b939bc36f639286f377 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:18:05.590875  6976 raft_consensus.cc:493] T ce4f062dcd314d43a63ca74067cb5ee3 P b7ab4784c7344b939bc36f639286f377 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:05.591207  6976 raft_consensus.cc:3060] T ce4f062dcd314d43a63ca74067cb5ee3 P b7ab4784c7344b939bc36f639286f377 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:05.591296  6878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce4f062dcd314d43a63ca74067cb5ee3" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
W20260709 13:18:05.593122  6772 leader_election.cc:343] T ce4f062dcd314d43a63ca74067cb5ee3 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:05.597631  6957 consensus_queue.cc:1048] T 90d42e216d9741e190bca19a781291fd P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:18:05.603044  7020 consensus_queue.cc:1048] T 1bf4668eeb70467fb3dc5a0289233b3c P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:18:05.603864  6878 raft_consensus.cc:3060] T 4f00a2e87e56452083b759f60d461ee3 P cd75a17ab2604397adab03bb8b5fd75c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:05.613653  6951 raft_consensus.cc:515] T 07a92dd554674067a83a9cb68c4773f2 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:05.617445  6880 raft_consensus.cc:3060] T 4d9def8b32fd443aa94ab1420b06837b P cd75a17ab2604397adab03bb8b5fd75c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:05.621899  6806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a92dd554674067a83a9cb68c4773f2" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:18:05.623783  6806 raft_consensus.cc:3060] T 07a92dd554674067a83a9cb68c4773f2 P b7ab4784c7344b939bc36f639286f377 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:05.624083  6922 tablet_bootstrap.cc:654] T 07a92dd554674067a83a9cb68c4773f2 P cd75a17ab2604397adab03bb8b5fd75c: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:05.626310  6923 tablet_bootstrap.cc:492] T 3a485a995abc4807b6e511e45419f737 P ccd8a4c3bfe3413cb2ae219b09aea832: No bootstrap required, opened a new log
I20260709 13:18:05.629877  6923 ts_tablet_manager.cc:1403] T 3a485a995abc4807b6e511e45419f737 P ccd8a4c3bfe3413cb2ae219b09aea832: Time spent bootstrapping tablet: real 0.160s	user 0.049s	sys 0.035s
I20260709 13:18:05.628839  6805 raft_consensus.cc:2468] T f4b8bd455d5a47c18a1380839c6e0d61 P b7ab4784c7344b939bc36f639286f377 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 1.
W20260709 13:18:05.627449  6678 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:18:05.638074  7020 consensus_queue.cc:1048] T 4f00a2e87e56452083b759f60d461ee3 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:18:05.639684  7016 raft_consensus.cc:493] T 90d42e216d9741e190bca19a781291fd P cd75a17ab2604397adab03bb8b5fd75c [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:05.640553  7016 raft_consensus.cc:515] T 90d42e216d9741e190bca19a781291fd P cd75a17ab2604397adab03bb8b5fd75c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:05.641125  6959 raft_consensus.cc:493] T 4f00a2e87e56452083b759f60d461ee3 P cd75a17ab2604397adab03bb8b5fd75c [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:05.641661  6959 raft_consensus.cc:515] T 4f00a2e87e56452083b759f60d461ee3 P cd75a17ab2604397adab03bb8b5fd75c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:05.648850  7016 leader_election.cc:290] T 90d42e216d9741e190bca19a781291fd P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:18:05.650911  6807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90d42e216d9741e190bca19a781291fd" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:18:05.656517  6877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a92dd554674067a83a9cb68c4773f2" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:18:05.655259  6984 consensus_queue.cc:1048] T 4d9def8b32fd443aa94ab1420b06837b P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.004s
W20260709 13:18:05.659421  6697 leader_election.cc:343] T 07a92dd554674067a83a9cb68c4773f2 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:05.665169  6731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90d42e216d9741e190bca19a781291fd" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:18:05.666713  6923 raft_consensus.cc:359] T 3a485a995abc4807b6e511e45419f737 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:05.672358  6923 raft_consensus.cc:385] T 3a485a995abc4807b6e511e45419f737 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:05.672853  6923 raft_consensus.cc:740] T 3a485a995abc4807b6e511e45419f737 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Initialized, Role: FOLLOWER
I20260709 13:18:05.621903  6951 leader_election.cc:290] T 07a92dd554674067a83a9cb68c4773f2 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 1 election: Requested vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:18:05.674014  6923 consensus_queue.cc:260] T 3a485a995abc4807b6e511e45419f737 P ccd8a4c3bfe3413cb2ae219b09aea832 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:05.668531  7020 consensus_queue.cc:1048] T 90d42e216d9741e190bca19a781291fd P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.008s
I20260709 13:18:05.678699  6976 raft_consensus.cc:515] T ce4f062dcd314d43a63ca74067cb5ee3 P b7ab4784c7344b939bc36f639286f377 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:05.689960  6959 leader_election.cc:290] T 4f00a2e87e56452083b759f60d461ee3 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:18:05.694283  6923 ts_tablet_manager.cc:1434] T 3a485a995abc4807b6e511e45419f737 P ccd8a4c3bfe3413cb2ae219b09aea832: Time spent starting tablet: real 0.063s	user 0.008s	sys 0.003s
I20260709 13:18:05.692288  6695 leader_election.cc:304] T f4b8bd455d5a47c18a1380839c6e0d61 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:18:05.698091  6923 tablet_bootstrap.cc:492] T 1528ab62b6fe4e3099d08f141afee116 P ccd8a4c3bfe3413cb2ae219b09aea832: Bootstrap starting.
I20260709 13:18:05.705647  6976 leader_election.cc:290] T ce4f062dcd314d43a63ca74067cb5ee3 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 1 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:18:05.696972  6930 raft_consensus.cc:515] T 30e88460611e47b2ba16a46a30b5f416 P b7ab4784c7344b939bc36f639286f377 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:05.709187  6930 leader_election.cc:290] T 30e88460611e47b2ba16a46a30b5f416 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 1 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:18:05.668426  6844 leader_election.cc:304] T 90d42e216d9741e190bca19a781291fd P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:18:05.712433  6877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce4f062dcd314d43a63ca74067cb5ee3" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
W20260709 13:18:05.714555  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 46253.5us
I20260709 13:18:05.718056  6876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30e88460611e47b2ba16a46a30b5f416" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:18:05.719393  6806 raft_consensus.cc:2468] T 07a92dd554674067a83a9cb68c4773f2 P b7ab4784c7344b939bc36f639286f377 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 1.
I20260709 13:18:05.719512  6731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce4f062dcd314d43a63ca74067cb5ee3" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:18:05.720242  6731 raft_consensus.cc:3060] T ce4f062dcd314d43a63ca74067cb5ee3 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:05.720744  6732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f00a2e87e56452083b759f60d461ee3" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:18:05.722816  6732 raft_consensus.cc:2468] T 4f00a2e87e56452083b759f60d461ee3 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 1.
I20260709 13:18:05.717190  6951 raft_consensus.cc:2804] T f4b8bd455d5a47c18a1380839c6e0d61 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:18:05.724781  6844 leader_election.cc:304] T 4f00a2e87e56452083b759f60d461ee3 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:18:05.725558  6951 raft_consensus.cc:697] T f4b8bd455d5a47c18a1380839c6e0d61 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 1 LEADER]: Becoming Leader. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
I20260709 13:18:05.720618  6730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30e88460611e47b2ba16a46a30b5f416" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:18:05.727305  6730 raft_consensus.cc:3060] T 30e88460611e47b2ba16a46a30b5f416 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:05.727370  6984 raft_consensus.cc:493] T f09c2a98de1a4decabd0ff900dd44caa P ccd8a4c3bfe3413cb2ae219b09aea832 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:05.728158  6984 raft_consensus.cc:515] T f09c2a98de1a4decabd0ff900dd44caa P ccd8a4c3bfe3413cb2ae219b09aea832 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:05.729609  6695 leader_election.cc:304] T 07a92dd554674067a83a9cb68c4773f2 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:18:05.730954  6984 leader_election.cc:290] T f09c2a98de1a4decabd0ff900dd44caa P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
W20260709 13:18:05.721985  6772 leader_election.cc:343] T ce4f062dcd314d43a63ca74067cb5ee3 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:05.731565  6931 raft_consensus.cc:2804] T 07a92dd554674067a83a9cb68c4773f2 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:18:05.732328  6931 raft_consensus.cc:697] T 07a92dd554674067a83a9cb68c4773f2 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 1 LEADER]: Becoming Leader. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
I20260709 13:18:05.733215  6921 tablet_bootstrap.cc:492] T 4b8cacb381b746da8d0049b0a83b41dd P b7ab4784c7344b939bc36f639286f377: No bootstrap required, opened a new log
I20260709 13:18:05.733835  6921 ts_tablet_manager.cc:1403] T 4b8cacb381b746da8d0049b0a83b41dd P b7ab4784c7344b939bc36f639286f377: Time spent bootstrapping tablet: real 0.265s	user 0.052s	sys 0.045s
I20260709 13:18:05.732772  6951 consensus_queue.cc:237] T f4b8bd455d5a47c18a1380839c6e0d61 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:05.733135  6931 consensus_queue.cc:237] T 07a92dd554674067a83a9cb68c4773f2 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
W20260709 13:18:05.732352  6772 leader_election.cc:343] T 30e88460611e47b2ba16a46a30b5f416 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:05.738313  6921 raft_consensus.cc:359] T 4b8cacb381b746da8d0049b0a83b41dd P b7ab4784c7344b939bc36f639286f377 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:05.739111  6921 raft_consensus.cc:385] T 4b8cacb381b746da8d0049b0a83b41dd P b7ab4784c7344b939bc36f639286f377 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:05.739420  6921 raft_consensus.cc:740] T 4b8cacb381b746da8d0049b0a83b41dd P b7ab4784c7344b939bc36f639286f377 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Initialized, Role: FOLLOWER
I20260709 13:18:05.739624  6807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09c2a98de1a4decabd0ff900dd44caa" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:18:05.740365  6807 raft_consensus.cc:2468] T f09c2a98de1a4decabd0ff900dd44caa P b7ab4784c7344b939bc36f639286f377 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 0.
I20260709 13:18:05.745172  6923 tablet_bootstrap.cc:654] T 1528ab62b6fe4e3099d08f141afee116 P ccd8a4c3bfe3413cb2ae219b09aea832: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:05.745960  6921 consensus_queue.cc:260] T 4b8cacb381b746da8d0049b0a83b41dd P b7ab4784c7344b939bc36f639286f377 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:05.747274  6806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f00a2e87e56452083b759f60d461ee3" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:18:05.745572  6976 raft_consensus.cc:493] T 44bde925b2e541b69890d70715b85176 P b7ab4784c7344b939bc36f639286f377 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:05.758646  6921 ts_tablet_manager.cc:1434] T 4b8cacb381b746da8d0049b0a83b41dd P b7ab4784c7344b939bc36f639286f377: Time spent starting tablet: real 0.024s	user 0.007s	sys 0.001s
I20260709 13:18:05.761157  6984 consensus_queue.cc:1048] T 4d9def8b32fd443aa94ab1420b06837b P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:18:05.763403  6730 raft_consensus.cc:2468] T 30e88460611e47b2ba16a46a30b5f416 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 1.
I20260709 13:18:05.748368  6876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09c2a98de1a4decabd0ff900dd44caa" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:18:05.764943  6876 raft_consensus.cc:2468] T f09c2a98de1a4decabd0ff900dd44caa P cd75a17ab2604397adab03bb8b5fd75c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 0.
I20260709 13:18:05.768925  6695 leader_election.cc:304] T f09c2a98de1a4decabd0ff900dd44caa P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
I20260709 13:18:05.774067  6921 tablet_bootstrap.cc:492] T 1528ab62b6fe4e3099d08f141afee116 P b7ab4784c7344b939bc36f639286f377: Bootstrap starting.
I20260709 13:18:05.791577  6770 leader_election.cc:304] T 30e88460611e47b2ba16a46a30b5f416 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:18:05.783008  6984 raft_consensus.cc:2804] T f09c2a98de1a4decabd0ff900dd44caa P ccd8a4c3bfe3413cb2ae219b09aea832 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:18:05.793197  6984 raft_consensus.cc:493] T f09c2a98de1a4decabd0ff900dd44caa P ccd8a4c3bfe3413cb2ae219b09aea832 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:05.793598  6984 raft_consensus.cc:3060] T f09c2a98de1a4decabd0ff900dd44caa P ccd8a4c3bfe3413cb2ae219b09aea832 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:05.796341  7020 raft_consensus.cc:2804] T 30e88460611e47b2ba16a46a30b5f416 P b7ab4784c7344b939bc36f639286f377 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:18:05.798753  6930 consensus_queue.cc:1048] T 4f00a2e87e56452083b759f60d461ee3 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:18:05.769225  6976 raft_consensus.cc:515] T 44bde925b2e541b69890d70715b85176 P b7ab4784c7344b939bc36f639286f377 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:05.799577  7020 raft_consensus.cc:697] T 30e88460611e47b2ba16a46a30b5f416 P b7ab4784c7344b939bc36f639286f377 [term 1 LEADER]: Becoming Leader. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
I20260709 13:18:05.801530  7016 raft_consensus.cc:2749] T 90d42e216d9741e190bca19a781291fd P cd75a17ab2604397adab03bb8b5fd75c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:05.810242  6986 raft_consensus.cc:493] T 3a485a995abc4807b6e511e45419f737 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:05.840575  6730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44bde925b2e541b69890d70715b85176" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:18:05.828291  6986 raft_consensus.cc:515] T 3a485a995abc4807b6e511e45419f737 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:05.855703  6986 leader_election.cc:290] T 3a485a995abc4807b6e511e45419f737 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:18:05.865164  6922 tablet_bootstrap.cc:492] T 07a92dd554674067a83a9cb68c4773f2 P cd75a17ab2604397adab03bb8b5fd75c: No bootstrap required, opened a new log
I20260709 13:18:05.865732  6922 ts_tablet_manager.cc:1403] T 07a92dd554674067a83a9cb68c4773f2 P cd75a17ab2604397adab03bb8b5fd75c: Time spent bootstrapping tablet: real 0.289s	user 0.027s	sys 0.008s
I20260709 13:18:05.870180  6922 raft_consensus.cc:359] T 07a92dd554674067a83a9cb68c4773f2 P cd75a17ab2604397adab03bb8b5fd75c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:05.871102  6922 raft_consensus.cc:385] T 07a92dd554674067a83a9cb68c4773f2 P cd75a17ab2604397adab03bb8b5fd75c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:05.871382  6922 raft_consensus.cc:740] T 07a92dd554674067a83a9cb68c4773f2 P cd75a17ab2604397adab03bb8b5fd75c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cd75a17ab2604397adab03bb8b5fd75c, State: Initialized, Role: FOLLOWER
W20260709 13:18:05.872788  6770 leader_election.cc:343] T 44bde925b2e541b69890d70715b85176 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:05.826534  6731 raft_consensus.cc:2468] T ce4f062dcd314d43a63ca74067cb5ee3 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 1.
I20260709 13:18:05.876869  6921 tablet_bootstrap.cc:654] T 1528ab62b6fe4e3099d08f141afee116 P b7ab4784c7344b939bc36f639286f377: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:05.877034  6770 leader_election.cc:304] T ce4f062dcd314d43a63ca74067cb5ee3 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:18:05.878475  6922 consensus_queue.cc:260] T 07a92dd554674067a83a9cb68c4773f2 P cd75a17ab2604397adab03bb8b5fd75c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:05.838685  6976 leader_election.cc:290] T 44bde925b2e541b69890d70715b85176 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:18:05.855021  6805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a485a995abc4807b6e511e45419f737" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:18:05.856524  6881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a485a995abc4807b6e511e45419f737" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:18:05.848991  7016 consensus_queue.cc:1048] T a3022224cc81473690653a83d4e99470 P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Connected to new peer: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.033s
I20260709 13:18:05.875522  6984 raft_consensus.cc:515] T f09c2a98de1a4decabd0ff900dd44caa P ccd8a4c3bfe3413cb2ae219b09aea832 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:05.856451  7020 consensus_queue.cc:237] T 30e88460611e47b2ba16a46a30b5f416 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:05.892009  6805 raft_consensus.cc:2468] T 3a485a995abc4807b6e511e45419f737 P b7ab4784c7344b939bc36f639286f377 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 0.
I20260709 13:18:05.917871  6695 leader_election.cc:304] T 3a485a995abc4807b6e511e45419f737 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
I20260709 13:18:05.918772  6986 raft_consensus.cc:2804] T 3a485a995abc4807b6e511e45419f737 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:18:05.919158  6986 raft_consensus.cc:493] T 3a485a995abc4807b6e511e45419f737 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:05.922107  6986 raft_consensus.cc:3060] T 3a485a995abc4807b6e511e45419f737 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:05.920614  6959 raft_consensus.cc:2804] T 4f00a2e87e56452083b759f60d461ee3 P cd75a17ab2604397adab03bb8b5fd75c [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 13:18:05.889684  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 163774us
I20260709 13:18:05.931842  6922 ts_tablet_manager.cc:1434] T 07a92dd554674067a83a9cb68c4773f2 P cd75a17ab2604397adab03bb8b5fd75c: Time spent starting tablet: real 0.066s	user 0.008s	sys 0.002s
I20260709 13:18:05.923054  6957 raft_consensus.cc:2804] T ce4f062dcd314d43a63ca74067cb5ee3 P b7ab4784c7344b939bc36f639286f377 [term 1 FOLLOWER]: Leader election won for term 1
W20260709 13:18:05.924345  6697 leader_election.cc:343] T 3a485a995abc4807b6e511e45419f737 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:05.944571  6922 tablet_bootstrap.cc:492] T 30e88460611e47b2ba16a46a30b5f416 P cd75a17ab2604397adab03bb8b5fd75c: Bootstrap starting.
I20260709 13:18:05.940233  6957 raft_consensus.cc:697] T ce4f062dcd314d43a63ca74067cb5ee3 P b7ab4784c7344b939bc36f639286f377 [term 1 LEADER]: Becoming Leader. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
I20260709 13:18:05.953440  6923 tablet_bootstrap.cc:492] T 1528ab62b6fe4e3099d08f141afee116 P ccd8a4c3bfe3413cb2ae219b09aea832: No bootstrap required, opened a new log
I20260709 13:18:05.953961  6923 ts_tablet_manager.cc:1403] T 1528ab62b6fe4e3099d08f141afee116 P ccd8a4c3bfe3413cb2ae219b09aea832: Time spent bootstrapping tablet: real 0.256s	user 0.026s	sys 0.011s
W20260709 13:18:05.958508  6770 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 80735.8us
I20260709 13:18:05.961692  7057 consensus_queue.cc:1048] T a3022224cc81473690653a83d4e99470 P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.004s
I20260709 13:18:05.962426  6805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09c2a98de1a4decabd0ff900dd44caa" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:18:05.963007  6805 raft_consensus.cc:3060] T f09c2a98de1a4decabd0ff900dd44caa P b7ab4784c7344b939bc36f639286f377 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:05.969480  7057 raft_consensus.cc:493] T 07a92dd554674067a83a9cb68c4773f2 P cd75a17ab2604397adab03bb8b5fd75c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:05.969691  6959 raft_consensus.cc:493] T 4f00a2e87e56452083b759f60d461ee3 P cd75a17ab2604397adab03bb8b5fd75c [term 1 FOLLOWER]: Starting leader election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:18:05.970165  6959 raft_consensus.cc:3060] T 4f00a2e87e56452083b759f60d461ee3 P cd75a17ab2604397adab03bb8b5fd75c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:05.970091  7057 raft_consensus.cc:515] T 07a92dd554674067a83a9cb68c4773f2 P cd75a17ab2604397adab03bb8b5fd75c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:05.975442  7057 leader_election.cc:290] T 07a92dd554674067a83a9cb68c4773f2 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:18:05.972908  7020 raft_consensus.cc:493] T 4b8cacb381b746da8d0049b0a83b41dd P b7ab4784c7344b939bc36f639286f377 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:05.990684  6923 raft_consensus.cc:359] T 1528ab62b6fe4e3099d08f141afee116 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:05.992992  6923 raft_consensus.cc:385] T 1528ab62b6fe4e3099d08f141afee116 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:05.993463  6923 raft_consensus.cc:740] T 1528ab62b6fe4e3099d08f141afee116 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Initialized, Role: FOLLOWER
I20260709 13:18:05.994760  6923 consensus_queue.cc:260] T 1528ab62b6fe4e3099d08f141afee116 P ccd8a4c3bfe3413cb2ae219b09aea832 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:05.983124  6984 leader_election.cc:290] T f09c2a98de1a4decabd0ff900dd44caa P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 1 election: Requested vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:18:05.993204  6879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09c2a98de1a4decabd0ff900dd44caa" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:18:06.019487  6879 raft_consensus.cc:3060] T f09c2a98de1a4decabd0ff900dd44caa P cd75a17ab2604397adab03bb8b5fd75c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:06.013543  6730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a92dd554674067a83a9cb68c4773f2" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
W20260709 13:18:06.014196  6772 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 215212us
I20260709 13:18:06.007764  6629 catalog_manager.cc:5697] T 07a92dd554674067a83a9cb68c4773f2 P ccd8a4c3bfe3413cb2ae219b09aea832 reported cstate change: term changed from 0 to 1, leader changed from <none> to ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65). New cstate: current_term: 1 leader_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:06.018914  6805 raft_consensus.cc:2468] T f09c2a98de1a4decabd0ff900dd44caa P b7ab4784c7344b939bc36f639286f377 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 1.
I20260709 13:18:05.983572  6957 consensus_queue.cc:237] T ce4f062dcd314d43a63ca74067cb5ee3 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:06.024729  6923 ts_tablet_manager.cc:1434] T 1528ab62b6fe4e3099d08f141afee116 P ccd8a4c3bfe3413cb2ae219b09aea832: Time spent starting tablet: real 0.070s	user 0.006s	sys 0.002s
I20260709 13:18:05.993959  7020 raft_consensus.cc:515] T 4b8cacb381b746da8d0049b0a83b41dd P b7ab4784c7344b939bc36f639286f377 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:06.028867  6921 tablet_bootstrap.cc:492] T 1528ab62b6fe4e3099d08f141afee116 P b7ab4784c7344b939bc36f639286f377: No bootstrap required, opened a new log
I20260709 13:18:06.030153  6629 catalog_manager.cc:5697] T f4b8bd455d5a47c18a1380839c6e0d61 P ccd8a4c3bfe3413cb2ae219b09aea832 reported cstate change: term changed from 0 to 1, leader changed from <none> to ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65). New cstate: current_term: 1 leader_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:06.033172  6921 ts_tablet_manager.cc:1403] T 1528ab62b6fe4e3099d08f141afee116 P b7ab4784c7344b939bc36f639286f377: Time spent bootstrapping tablet: real 0.259s	user 0.015s	sys 0.003s
I20260709 13:18:06.028856  6878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44bde925b2e541b69890d70715b85176" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:18:06.036106  7020 leader_election.cc:290] T 4b8cacb381b746da8d0049b0a83b41dd P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:18:06.030321  6879 raft_consensus.cc:2468] T f09c2a98de1a4decabd0ff900dd44caa P cd75a17ab2604397adab03bb8b5fd75c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 1.
I20260709 13:18:06.036298  6959 raft_consensus.cc:515] T 4f00a2e87e56452083b759f60d461ee3 P cd75a17ab2604397adab03bb8b5fd75c [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:06.037402  6697 leader_election.cc:304] T f09c2a98de1a4decabd0ff900dd44caa P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:18:06.038249  7019 raft_consensus.cc:2804] T f09c2a98de1a4decabd0ff900dd44caa P ccd8a4c3bfe3413cb2ae219b09aea832 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:18:06.038968  7019 raft_consensus.cc:697] T f09c2a98de1a4decabd0ff900dd44caa P ccd8a4c3bfe3413cb2ae219b09aea832 [term 1 LEADER]: Becoming Leader. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
I20260709 13:18:06.040133  7019 consensus_queue.cc:237] T f09c2a98de1a4decabd0ff900dd44caa P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
W20260709 13:18:06.041631  6772 leader_election.cc:343] T 44bde925b2e541b69890d70715b85176 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:06.042125  6772 leader_election.cc:304] T 44bde925b2e541b69890d70715b85176 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:18:06.031713  6923 tablet_bootstrap.cc:492] T 4b8cacb381b746da8d0049b0a83b41dd P ccd8a4c3bfe3413cb2ae219b09aea832: Bootstrap starting.
I20260709 13:18:06.050375  6959 leader_election.cc:290] T 4f00a2e87e56452083b759f60d461ee3 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 2 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:18:06.053594  6879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b8cacb381b746da8d0049b0a83b41dd" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:18:06.059204  7064 raft_consensus.cc:2749] T 44bde925b2e541b69890d70715b85176 P b7ab4784c7344b939bc36f639286f377 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:18:06.061256  6921 raft_consensus.cc:359] T 1528ab62b6fe4e3099d08f141afee116 P b7ab4784c7344b939bc36f639286f377 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:06.062036  6921 raft_consensus.cc:385] T 1528ab62b6fe4e3099d08f141afee116 P b7ab4784c7344b939bc36f639286f377 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:06.062354  6921 raft_consensus.cc:740] T 1528ab62b6fe4e3099d08f141afee116 P b7ab4784c7344b939bc36f639286f377 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Initialized, Role: FOLLOWER
I20260709 13:18:06.064023  6921 consensus_queue.cc:260] T 1528ab62b6fe4e3099d08f141afee116 P b7ab4784c7344b939bc36f639286f377 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:06.064651  6730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f00a2e87e56452083b759f60d461ee3" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:18:06.068125  6921 ts_tablet_manager.cc:1434] T 1528ab62b6fe4e3099d08f141afee116 P b7ab4784c7344b939bc36f639286f377: Time spent starting tablet: real 0.035s	user 0.004s	sys 0.004s
I20260709 13:18:06.069262  6921 tablet_bootstrap.cc:492] T f03d0dbf16864ca4bc1bb5e4c0334c0f P b7ab4784c7344b939bc36f639286f377: Bootstrap starting.
I20260709 13:18:06.064785  6805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a92dd554674067a83a9cb68c4773f2" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:18:06.072199  6876 raft_consensus.cc:1240] T 4f00a2e87e56452083b759f60d461ee3 P cd75a17ab2604397adab03bb8b5fd75c [term 2 FOLLOWER]: Rejecting Update request from peer b7ab4784c7344b939bc36f639286f377 for earlier term 1. Current term is 2. Ops: []
I20260709 13:18:06.074370  6805 raft_consensus.cc:2393] T 07a92dd554674067a83a9cb68c4773f2 P b7ab4784c7344b939bc36f639286f377 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c in current term 1: Already voted for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in this term.
I20260709 13:18:06.075105  6986 raft_consensus.cc:515] T 3a485a995abc4807b6e511e45419f737 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:06.079074  6730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b8cacb381b746da8d0049b0a83b41dd" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:18:06.081689  6807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f00a2e87e56452083b759f60d461ee3" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:18:06.084796  7020 consensus_queue.cc:1059] T 4f00a2e87e56452083b759f60d461ee3 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:18:06.085930  7020 raft_consensus.cc:3055] T 4f00a2e87e56452083b759f60d461ee3 P b7ab4784c7344b939bc36f639286f377 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:18:06.086247  7020 raft_consensus.cc:740] T 4f00a2e87e56452083b759f60d461ee3 P b7ab4784c7344b939bc36f639286f377 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
I20260709 13:18:06.086849  6844 leader_election.cc:304] T 07a92dd554674067a83a9cb68c4773f2 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
W20260709 13:18:06.087244  6770 leader_election.cc:343] T 4b8cacb381b746da8d0049b0a83b41dd P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:06.087693  6959 raft_consensus.cc:3060] T 07a92dd554674067a83a9cb68c4773f2 P cd75a17ab2604397adab03bb8b5fd75c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:06.088202  6844 leader_election.cc:304] T 4f00a2e87e56452083b759f60d461ee3 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
W20260709 13:18:06.089960  6772 leader_election.cc:343] T 4b8cacb381b746da8d0049b0a83b41dd P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:06.094167  6922 tablet_bootstrap.cc:654] T 30e88460611e47b2ba16a46a30b5f416 P cd75a17ab2604397adab03bb8b5fd75c: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:06.092895  6772 leader_election.cc:304] T 4b8cacb381b746da8d0049b0a83b41dd P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:18:06.091069  6986 leader_election.cc:290] T 3a485a995abc4807b6e511e45419f737 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 1 election: Requested vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:18:06.091020  7016 raft_consensus.cc:2749] T 4f00a2e87e56452083b759f60d461ee3 P cd75a17ab2604397adab03bb8b5fd75c [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:18:06.104305  6806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a485a995abc4807b6e511e45419f737" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:18:06.105027  6806 raft_consensus.cc:3060] T 3a485a995abc4807b6e511e45419f737 P b7ab4784c7344b939bc36f639286f377 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:06.101013  6957 raft_consensus.cc:2749] T 4b8cacb381b746da8d0049b0a83b41dd P b7ab4784c7344b939bc36f639286f377 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:18:06.087169  7020 consensus_queue.cc:260] T 4f00a2e87e56452083b759f60d461ee3 P b7ab4784c7344b939bc36f639286f377 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:06.115316  7020 raft_consensus.cc:3060] T 4f00a2e87e56452083b759f60d461ee3 P b7ab4784c7344b939bc36f639286f377 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:06.116178  6879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a485a995abc4807b6e511e45419f737" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:18:06.116508  6923 tablet_bootstrap.cc:654] T 4b8cacb381b746da8d0049b0a83b41dd P ccd8a4c3bfe3413cb2ae219b09aea832: Neither blocks nor log segments found. Creating new log.
W20260709 13:18:06.121479  6697 leader_election.cc:343] T 3a485a995abc4807b6e511e45419f737 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:06.123903  6984 raft_consensus.cc:493] T 1528ab62b6fe4e3099d08f141afee116 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:06.132863  6921 tablet_bootstrap.cc:654] T f03d0dbf16864ca4bc1bb5e4c0334c0f P b7ab4784c7344b939bc36f639286f377: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:06.130879  6959 raft_consensus.cc:2749] T 07a92dd554674067a83a9cb68c4773f2 P cd75a17ab2604397adab03bb8b5fd75c [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:18:06.136790  6806 raft_consensus.cc:2468] T 3a485a995abc4807b6e511e45419f737 P b7ab4784c7344b939bc36f639286f377 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 1.
I20260709 13:18:06.138278  6695 leader_election.cc:304] T 3a485a995abc4807b6e511e45419f737 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:18:06.140080  6986 raft_consensus.cc:2804] T 3a485a995abc4807b6e511e45419f737 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:18:06.140642  6986 raft_consensus.cc:697] T 3a485a995abc4807b6e511e45419f737 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 1 LEADER]: Becoming Leader. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
I20260709 13:18:06.141744  6986 consensus_queue.cc:237] T 3a485a995abc4807b6e511e45419f737 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:06.127775  6984 raft_consensus.cc:515] T 1528ab62b6fe4e3099d08f141afee116 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:06.157845  6922 tablet_bootstrap.cc:492] T 30e88460611e47b2ba16a46a30b5f416 P cd75a17ab2604397adab03bb8b5fd75c: No bootstrap required, opened a new log
I20260709 13:18:06.172174  6922 ts_tablet_manager.cc:1403] T 30e88460611e47b2ba16a46a30b5f416 P cd75a17ab2604397adab03bb8b5fd75c: Time spent bootstrapping tablet: real 0.228s	user 0.015s	sys 0.010s
I20260709 13:18:06.161130  6921 tablet_bootstrap.cc:492] T f03d0dbf16864ca4bc1bb5e4c0334c0f P b7ab4784c7344b939bc36f639286f377: No bootstrap required, opened a new log
I20260709 13:18:06.161875  6806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1528ab62b6fe4e3099d08f141afee116" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:18:06.174499  6921 ts_tablet_manager.cc:1403] T f03d0dbf16864ca4bc1bb5e4c0334c0f P b7ab4784c7344b939bc36f639286f377: Time spent bootstrapping tablet: real 0.105s	user 0.008s	sys 0.012s
I20260709 13:18:06.174557  6806 raft_consensus.cc:2468] T 1528ab62b6fe4e3099d08f141afee116 P b7ab4784c7344b939bc36f639286f377 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 0.
I20260709 13:18:06.175092  6879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1528ab62b6fe4e3099d08f141afee116" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:18:06.176025  6695 leader_election.cc:304] T 1528ab62b6fe4e3099d08f141afee116 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
I20260709 13:18:06.171347  6984 leader_election.cc:290] T 1528ab62b6fe4e3099d08f141afee116 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:18:06.176972  7019 raft_consensus.cc:2804] T 1528ab62b6fe4e3099d08f141afee116 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:18:06.177353  7019 raft_consensus.cc:493] T 1528ab62b6fe4e3099d08f141afee116 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:06.177696  7019 raft_consensus.cc:3060] T 1528ab62b6fe4e3099d08f141afee116 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:06.177518  6921 raft_consensus.cc:359] T f03d0dbf16864ca4bc1bb5e4c0334c0f P b7ab4784c7344b939bc36f639286f377 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:06.178231  6921 raft_consensus.cc:385] T f03d0dbf16864ca4bc1bb5e4c0334c0f P b7ab4784c7344b939bc36f639286f377 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:06.178510  6921 raft_consensus.cc:740] T f03d0dbf16864ca4bc1bb5e4c0334c0f P b7ab4784c7344b939bc36f639286f377 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Initialized, Role: FOLLOWER
I20260709 13:18:06.179239  6921 consensus_queue.cc:260] T f03d0dbf16864ca4bc1bb5e4c0334c0f P b7ab4784c7344b939bc36f639286f377 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:06.181386  6921 ts_tablet_manager.cc:1434] T f03d0dbf16864ca4bc1bb5e4c0334c0f P b7ab4784c7344b939bc36f639286f377: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.002s
I20260709 13:18:06.179909  6628 catalog_manager.cc:5697] T 30e88460611e47b2ba16a46a30b5f416 P b7ab4784c7344b939bc36f639286f377 reported cstate change: term changed from 0 to 1, leader changed from <none> to b7ab4784c7344b939bc36f639286f377 (127.5.126.66). New cstate: current_term: 1 leader_uuid: "b7ab4784c7344b939bc36f639286f377" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:06.184511  6921 tablet_bootstrap.cc:492] T 8c7f33e544204fbaac4078e3e83bbf4e P b7ab4784c7344b939bc36f639286f377: Bootstrap starting.
I20260709 13:18:06.181797  6923 tablet_bootstrap.cc:492] T 4b8cacb381b746da8d0049b0a83b41dd P ccd8a4c3bfe3413cb2ae219b09aea832: No bootstrap required, opened a new log
I20260709 13:18:06.185637  6923 ts_tablet_manager.cc:1403] T 4b8cacb381b746da8d0049b0a83b41dd P ccd8a4c3bfe3413cb2ae219b09aea832: Time spent bootstrapping tablet: real 0.154s	user 0.025s	sys 0.014s
I20260709 13:18:06.185781  6628 catalog_manager.cc:5697] T ce4f062dcd314d43a63ca74067cb5ee3 P b7ab4784c7344b939bc36f639286f377 reported cstate change: term changed from 0 to 1, leader changed from <none> to b7ab4784c7344b939bc36f639286f377 (127.5.126.66). New cstate: current_term: 1 leader_uuid: "b7ab4784c7344b939bc36f639286f377" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } health_report { overall_health: UNKNOWN } } }
W20260709 13:18:06.180995  6697 leader_election.cc:343] T 1528ab62b6fe4e3099d08f141afee116 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:18:06.188694  6697 consensus_peers.cc:597] T f4b8bd455d5a47c18a1380839c6e0d61 P ccd8a4c3bfe3413cb2ae219b09aea832 -> Peer cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931): Couldn't send request to peer cd75a17ab2604397adab03bb8b5fd75c. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:06.192257  6923 raft_consensus.cc:359] T 4b8cacb381b746da8d0049b0a83b41dd P ccd8a4c3bfe3413cb2ae219b09aea832 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:06.193248  6923 raft_consensus.cc:385] T 4b8cacb381b746da8d0049b0a83b41dd P ccd8a4c3bfe3413cb2ae219b09aea832 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:06.193598  6923 raft_consensus.cc:740] T 4b8cacb381b746da8d0049b0a83b41dd P ccd8a4c3bfe3413cb2ae219b09aea832 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Initialized, Role: FOLLOWER
I20260709 13:18:06.194446  6923 consensus_queue.cc:260] T 4b8cacb381b746da8d0049b0a83b41dd P ccd8a4c3bfe3413cb2ae219b09aea832 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:06.199105  6923 ts_tablet_manager.cc:1434] T 4b8cacb381b746da8d0049b0a83b41dd P ccd8a4c3bfe3413cb2ae219b09aea832: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.001s
I20260709 13:18:06.205530  6923 tablet_bootstrap.cc:492] T 44bde925b2e541b69890d70715b85176 P ccd8a4c3bfe3413cb2ae219b09aea832: Bootstrap starting.
I20260709 13:18:06.203696  7019 raft_consensus.cc:515] T 1528ab62b6fe4e3099d08f141afee116 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:06.210336  7019 leader_election.cc:290] T 1528ab62b6fe4e3099d08f141afee116 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 1 election: Requested vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:18:06.211019  6806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1528ab62b6fe4e3099d08f141afee116" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:18:06.207932  6921 tablet_bootstrap.cc:654] T 8c7f33e544204fbaac4078e3e83bbf4e P b7ab4784c7344b939bc36f639286f377: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:06.211644  6806 raft_consensus.cc:3060] T 1528ab62b6fe4e3099d08f141afee116 P b7ab4784c7344b939bc36f639286f377 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:06.201128  6922 raft_consensus.cc:359] T 30e88460611e47b2ba16a46a30b5f416 P cd75a17ab2604397adab03bb8b5fd75c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:06.212283  6922 raft_consensus.cc:385] T 30e88460611e47b2ba16a46a30b5f416 P cd75a17ab2604397adab03bb8b5fd75c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:06.212677  6922 raft_consensus.cc:740] T 30e88460611e47b2ba16a46a30b5f416 P cd75a17ab2604397adab03bb8b5fd75c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cd75a17ab2604397adab03bb8b5fd75c, State: Initialized, Role: FOLLOWER
I20260709 13:18:06.216689  6879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1528ab62b6fe4e3099d08f141afee116" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
W20260709 13:18:06.218362  6697 leader_election.cc:343] T 1528ab62b6fe4e3099d08f141afee116 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:06.220952  6806 raft_consensus.cc:2468] T 1528ab62b6fe4e3099d08f141afee116 P b7ab4784c7344b939bc36f639286f377 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 1.
I20260709 13:18:06.222311  6695 leader_election.cc:304] T 1528ab62b6fe4e3099d08f141afee116 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:18:06.223861  6986 raft_consensus.cc:2804] T 1528ab62b6fe4e3099d08f141afee116 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:18:06.224295  6923 tablet_bootstrap.cc:654] T 44bde925b2e541b69890d70715b85176 P ccd8a4c3bfe3413cb2ae219b09aea832: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:06.225026  6986 raft_consensus.cc:697] T 1528ab62b6fe4e3099d08f141afee116 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 1 LEADER]: Becoming Leader. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
I20260709 13:18:06.225999  6986 consensus_queue.cc:237] T 1528ab62b6fe4e3099d08f141afee116 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:06.216373  6922 consensus_queue.cc:260] T 30e88460611e47b2ba16a46a30b5f416 P cd75a17ab2604397adab03bb8b5fd75c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:06.234612  6922 ts_tablet_manager.cc:1434] T 30e88460611e47b2ba16a46a30b5f416 P cd75a17ab2604397adab03bb8b5fd75c: Time spent starting tablet: real 0.062s	user 0.007s	sys 0.000s
I20260709 13:18:06.233386  6629 catalog_manager.cc:5697] T 3a485a995abc4807b6e511e45419f737 P ccd8a4c3bfe3413cb2ae219b09aea832 reported cstate change: term changed from 0 to 1, leader changed from <none> to ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65). New cstate: current_term: 1 leader_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:06.236277  6922 tablet_bootstrap.cc:492] T f4b8bd455d5a47c18a1380839c6e0d61 P cd75a17ab2604397adab03bb8b5fd75c: Bootstrap starting.
I20260709 13:18:06.237159  6629 catalog_manager.cc:5697] T f09c2a98de1a4decabd0ff900dd44caa P ccd8a4c3bfe3413cb2ae219b09aea832 reported cstate change: term changed from 0 to 1, leader changed from <none> to ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65). New cstate: current_term: 1 leader_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:06.265960  6921 tablet_bootstrap.cc:492] T 8c7f33e544204fbaac4078e3e83bbf4e P b7ab4784c7344b939bc36f639286f377: No bootstrap required, opened a new log
I20260709 13:18:06.266487  6921 ts_tablet_manager.cc:1403] T 8c7f33e544204fbaac4078e3e83bbf4e P b7ab4784c7344b939bc36f639286f377: Time spent bootstrapping tablet: real 0.082s	user 0.011s	sys 0.003s
I20260709 13:18:06.267588  6630 catalog_manager.cc:5697] T 1528ab62b6fe4e3099d08f141afee116 P ccd8a4c3bfe3413cb2ae219b09aea832 reported cstate change: term changed from 0 to 1, leader changed from <none> to ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65). New cstate: current_term: 1 leader_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:06.284185  6921 raft_consensus.cc:359] T 8c7f33e544204fbaac4078e3e83bbf4e P b7ab4784c7344b939bc36f639286f377 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:06.284981  6921 raft_consensus.cc:385] T 8c7f33e544204fbaac4078e3e83bbf4e P b7ab4784c7344b939bc36f639286f377 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:06.285291  6921 raft_consensus.cc:740] T 8c7f33e544204fbaac4078e3e83bbf4e P b7ab4784c7344b939bc36f639286f377 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Initialized, Role: FOLLOWER
I20260709 13:18:06.286370  6922 tablet_bootstrap.cc:654] T f4b8bd455d5a47c18a1380839c6e0d61 P cd75a17ab2604397adab03bb8b5fd75c: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:06.286051  6921 consensus_queue.cc:260] T 8c7f33e544204fbaac4078e3e83bbf4e P b7ab4784c7344b939bc36f639286f377 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:06.288300  6923 tablet_bootstrap.cc:492] T 44bde925b2e541b69890d70715b85176 P ccd8a4c3bfe3413cb2ae219b09aea832: No bootstrap required, opened a new log
I20260709 13:18:06.288797  6923 ts_tablet_manager.cc:1403] T 44bde925b2e541b69890d70715b85176 P ccd8a4c3bfe3413cb2ae219b09aea832: Time spent bootstrapping tablet: real 0.083s	user 0.019s	sys 0.043s
I20260709 13:18:06.291666  6923 raft_consensus.cc:359] T 44bde925b2e541b69890d70715b85176 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:06.292582  6923 raft_consensus.cc:385] T 44bde925b2e541b69890d70715b85176 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:06.292869  6923 raft_consensus.cc:740] T 44bde925b2e541b69890d70715b85176 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Initialized, Role: FOLLOWER
I20260709 13:18:06.293639  6923 consensus_queue.cc:260] T 44bde925b2e541b69890d70715b85176 P ccd8a4c3bfe3413cb2ae219b09aea832 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:06.296066  6921 ts_tablet_manager.cc:1434] T 8c7f33e544204fbaac4078e3e83bbf4e P b7ab4784c7344b939bc36f639286f377: Time spent starting tablet: real 0.029s	user 0.004s	sys 0.004s
I20260709 13:18:06.297261  6921 tablet_bootstrap.cc:492] T 7c37d41cd9164c15a6826ca62a851a69 P b7ab4784c7344b939bc36f639286f377: Bootstrap starting.
I20260709 13:18:06.304188  6921 tablet_bootstrap.cc:654] T 7c37d41cd9164c15a6826ca62a851a69 P b7ab4784c7344b939bc36f639286f377: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:06.308638  6923 ts_tablet_manager.cc:1434] T 44bde925b2e541b69890d70715b85176 P ccd8a4c3bfe3413cb2ae219b09aea832: Time spent starting tablet: real 0.020s	user 0.006s	sys 0.001s
I20260709 13:18:06.312135  6921 tablet_bootstrap.cc:492] T 7c37d41cd9164c15a6826ca62a851a69 P b7ab4784c7344b939bc36f639286f377: No bootstrap required, opened a new log
I20260709 13:18:06.312706  6921 ts_tablet_manager.cc:1403] T 7c37d41cd9164c15a6826ca62a851a69 P b7ab4784c7344b939bc36f639286f377: Time spent bootstrapping tablet: real 0.016s	user 0.008s	sys 0.004s
I20260709 13:18:06.314344  6923 tablet_bootstrap.cc:492] T 853ac0a8cbd64ce99457f170216d4d0f P ccd8a4c3bfe3413cb2ae219b09aea832: Bootstrap starting.
I20260709 13:18:06.315915  6921 raft_consensus.cc:359] T 7c37d41cd9164c15a6826ca62a851a69 P b7ab4784c7344b939bc36f639286f377 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:06.316954  6921 raft_consensus.cc:385] T 7c37d41cd9164c15a6826ca62a851a69 P b7ab4784c7344b939bc36f639286f377 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:06.317329  6921 raft_consensus.cc:740] T 7c37d41cd9164c15a6826ca62a851a69 P b7ab4784c7344b939bc36f639286f377 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Initialized, Role: FOLLOWER
I20260709 13:18:06.318300  6921 consensus_queue.cc:260] T 7c37d41cd9164c15a6826ca62a851a69 P b7ab4784c7344b939bc36f639286f377 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:06.319087  6922 tablet_bootstrap.cc:492] T f4b8bd455d5a47c18a1380839c6e0d61 P cd75a17ab2604397adab03bb8b5fd75c: No bootstrap required, opened a new log
I20260709 13:18:06.322261  6923 tablet_bootstrap.cc:654] T 853ac0a8cbd64ce99457f170216d4d0f P ccd8a4c3bfe3413cb2ae219b09aea832: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:06.326848  6922 ts_tablet_manager.cc:1403] T f4b8bd455d5a47c18a1380839c6e0d61 P cd75a17ab2604397adab03bb8b5fd75c: Time spent bootstrapping tablet: real 0.091s	user 0.019s	sys 0.012s
I20260709 13:18:06.327430  6986 consensus_queue.cc:1048] T f4b8bd455d5a47c18a1380839c6e0d61 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:18:06.329821  6922 raft_consensus.cc:359] T f4b8bd455d5a47c18a1380839c6e0d61 P cd75a17ab2604397adab03bb8b5fd75c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:06.330622  6922 raft_consensus.cc:385] T f4b8bd455d5a47c18a1380839c6e0d61 P cd75a17ab2604397adab03bb8b5fd75c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:06.330915  6922 raft_consensus.cc:740] T f4b8bd455d5a47c18a1380839c6e0d61 P cd75a17ab2604397adab03bb8b5fd75c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cd75a17ab2604397adab03bb8b5fd75c, State: Initialized, Role: FOLLOWER
I20260709 13:18:06.334513  6922 consensus_queue.cc:260] T f4b8bd455d5a47c18a1380839c6e0d61 P cd75a17ab2604397adab03bb8b5fd75c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:06.337071  6922 ts_tablet_manager.cc:1434] T f4b8bd455d5a47c18a1380839c6e0d61 P cd75a17ab2604397adab03bb8b5fd75c: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.000s
I20260709 13:18:06.338474  6922 tablet_bootstrap.cc:492] T 3a485a995abc4807b6e511e45419f737 P cd75a17ab2604397adab03bb8b5fd75c: Bootstrap starting.
I20260709 13:18:06.338531  6923 tablet_bootstrap.cc:492] T 853ac0a8cbd64ce99457f170216d4d0f P ccd8a4c3bfe3413cb2ae219b09aea832: No bootstrap required, opened a new log
I20260709 13:18:06.339157  6923 ts_tablet_manager.cc:1403] T 853ac0a8cbd64ce99457f170216d4d0f P ccd8a4c3bfe3413cb2ae219b09aea832: Time spent bootstrapping tablet: real 0.025s	user 0.013s	sys 0.008s
I20260709 13:18:06.342104  6923 raft_consensus.cc:359] T 853ac0a8cbd64ce99457f170216d4d0f P ccd8a4c3bfe3413cb2ae219b09aea832 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:06.342821  6923 raft_consensus.cc:385] T 853ac0a8cbd64ce99457f170216d4d0f P ccd8a4c3bfe3413cb2ae219b09aea832 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:06.343098  6923 raft_consensus.cc:740] T 853ac0a8cbd64ce99457f170216d4d0f P ccd8a4c3bfe3413cb2ae219b09aea832 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Initialized, Role: FOLLOWER
I20260709 13:18:06.345660  6922 tablet_bootstrap.cc:654] T 3a485a995abc4807b6e511e45419f737 P cd75a17ab2604397adab03bb8b5fd75c: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:06.343781  6923 consensus_queue.cc:260] T 853ac0a8cbd64ce99457f170216d4d0f P ccd8a4c3bfe3413cb2ae219b09aea832 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:06.349213  6923 ts_tablet_manager.cc:1434] T 853ac0a8cbd64ce99457f170216d4d0f P ccd8a4c3bfe3413cb2ae219b09aea832: Time spent starting tablet: real 0.010s	user 0.008s	sys 0.000s
I20260709 13:18:06.350971  6923 tablet_bootstrap.cc:492] T de3186201e1a40d0b335eeb8b4e256e0 P ccd8a4c3bfe3413cb2ae219b09aea832: Bootstrap starting.
I20260709 13:18:06.357669  6923 tablet_bootstrap.cc:654] T de3186201e1a40d0b335eeb8b4e256e0 P ccd8a4c3bfe3413cb2ae219b09aea832: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:06.358583  6921 ts_tablet_manager.cc:1434] T 7c37d41cd9164c15a6826ca62a851a69 P b7ab4784c7344b939bc36f639286f377: Time spent starting tablet: real 0.046s	user 0.007s	sys 0.000s
I20260709 13:18:06.359745  6921 tablet_bootstrap.cc:492] T 853ac0a8cbd64ce99457f170216d4d0f P b7ab4784c7344b939bc36f639286f377: Bootstrap starting.
I20260709 13:18:06.360011  6986 consensus_queue.cc:1048] T 07a92dd554674067a83a9cb68c4773f2 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:18:06.385685  6951 consensus_queue.cc:1048] T 07a92dd554674067a83a9cb68c4773f2 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.015s
I20260709 13:18:06.422958  6923 tablet_bootstrap.cc:492] T de3186201e1a40d0b335eeb8b4e256e0 P ccd8a4c3bfe3413cb2ae219b09aea832: No bootstrap required, opened a new log
I20260709 13:18:06.423676  6923 ts_tablet_manager.cc:1403] T de3186201e1a40d0b335eeb8b4e256e0 P ccd8a4c3bfe3413cb2ae219b09aea832: Time spent bootstrapping tablet: real 0.073s	user 0.029s	sys 0.013s
I20260709 13:18:06.426498  6921 tablet_bootstrap.cc:654] T 853ac0a8cbd64ce99457f170216d4d0f P b7ab4784c7344b939bc36f639286f377: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:06.427222  6923 raft_consensus.cc:359] T de3186201e1a40d0b335eeb8b4e256e0 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:06.427973  6923 raft_consensus.cc:385] T de3186201e1a40d0b335eeb8b4e256e0 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:06.429378  6923 raft_consensus.cc:740] T de3186201e1a40d0b335eeb8b4e256e0 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Initialized, Role: FOLLOWER
I20260709 13:18:06.430008  6923 consensus_queue.cc:260] T de3186201e1a40d0b335eeb8b4e256e0 P ccd8a4c3bfe3413cb2ae219b09aea832 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:06.431759  6923 ts_tablet_manager.cc:1434] T de3186201e1a40d0b335eeb8b4e256e0 P ccd8a4c3bfe3413cb2ae219b09aea832: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:18:06.433842  6923 tablet_bootstrap.cc:492] T f03d0dbf16864ca4bc1bb5e4c0334c0f P ccd8a4c3bfe3413cb2ae219b09aea832: Bootstrap starting.
I20260709 13:18:06.435338  6957 raft_consensus.cc:493] T f03d0dbf16864ca4bc1bb5e4c0334c0f P b7ab4784c7344b939bc36f639286f377 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:06.435940  6957 raft_consensus.cc:515] T f03d0dbf16864ca4bc1bb5e4c0334c0f P b7ab4784c7344b939bc36f639286f377 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:06.438374  6957 leader_election.cc:290] T f03d0dbf16864ca4bc1bb5e4c0334c0f P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:18:06.438911  6957 consensus_queue.cc:1048] T 30e88460611e47b2ba16a46a30b5f416 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:18:06.440178  7064 raft_consensus.cc:493] T 7c37d41cd9164c15a6826ca62a851a69 P b7ab4784c7344b939bc36f639286f377 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:06.440706  6923 tablet_bootstrap.cc:654] T f03d0dbf16864ca4bc1bb5e4c0334c0f P ccd8a4c3bfe3413cb2ae219b09aea832: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:06.440685  7064 raft_consensus.cc:515] T 7c37d41cd9164c15a6826ca62a851a69 P b7ab4784c7344b939bc36f639286f377 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:06.443253  7064 leader_election.cc:290] T 7c37d41cd9164c15a6826ca62a851a69 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:18:06.450016  6731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f03d0dbf16864ca4bc1bb5e4c0334c0f" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:18:06.452853  6730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c37d41cd9164c15a6826ca62a851a69" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
W20260709 13:18:06.455626  6770 leader_election.cc:343] T 7c37d41cd9164c15a6826ca62a851a69 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:18:06.458321  6770 leader_election.cc:343] T f03d0dbf16864ca4bc1bb5e4c0334c0f P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:06.476830  6876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f03d0dbf16864ca4bc1bb5e4c0334c0f" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:18:06.484198  6921 tablet_bootstrap.cc:492] T 853ac0a8cbd64ce99457f170216d4d0f P b7ab4784c7344b939bc36f639286f377: No bootstrap required, opened a new log
I20260709 13:18:06.479382  6876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c37d41cd9164c15a6826ca62a851a69" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:18:06.487550  6921 ts_tablet_manager.cc:1403] T 853ac0a8cbd64ce99457f170216d4d0f P b7ab4784c7344b939bc36f639286f377: Time spent bootstrapping tablet: real 0.128s	user 0.011s	sys 0.005s
I20260709 13:18:06.493290  6921 raft_consensus.cc:359] T 853ac0a8cbd64ce99457f170216d4d0f P b7ab4784c7344b939bc36f639286f377 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:06.494199  6931 raft_consensus.cc:493] T 853ac0a8cbd64ce99457f170216d4d0f P ccd8a4c3bfe3413cb2ae219b09aea832 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:06.497534  6923 tablet_bootstrap.cc:492] T f03d0dbf16864ca4bc1bb5e4c0334c0f P ccd8a4c3bfe3413cb2ae219b09aea832: No bootstrap required, opened a new log
I20260709 13:18:06.498075  6923 ts_tablet_manager.cc:1403] T f03d0dbf16864ca4bc1bb5e4c0334c0f P ccd8a4c3bfe3413cb2ae219b09aea832: Time spent bootstrapping tablet: real 0.065s	user 0.032s	sys 0.028s
I20260709 13:18:06.497768  6931 raft_consensus.cc:515] T 853ac0a8cbd64ce99457f170216d4d0f P ccd8a4c3bfe3413cb2ae219b09aea832 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:06.500741  6931 leader_election.cc:290] T 853ac0a8cbd64ce99457f170216d4d0f P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:18:06.501308  6807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "853ac0a8cbd64ce99457f170216d4d0f" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:18:06.502094  6921 raft_consensus.cc:385] T 853ac0a8cbd64ce99457f170216d4d0f P b7ab4784c7344b939bc36f639286f377 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:06.502295  6876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "853ac0a8cbd64ce99457f170216d4d0f" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:18:06.503055  6923 raft_consensus.cc:359] T f03d0dbf16864ca4bc1bb5e4c0334c0f P ccd8a4c3bfe3413cb2ae219b09aea832 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:06.503772  6923 raft_consensus.cc:385] T f03d0dbf16864ca4bc1bb5e4c0334c0f P ccd8a4c3bfe3413cb2ae219b09aea832 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 13:18:06.503979  6697 leader_election.cc:343] T 853ac0a8cbd64ce99457f170216d4d0f P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:06.504585  6923 raft_consensus.cc:740] T f03d0dbf16864ca4bc1bb5e4c0334c0f P ccd8a4c3bfe3413cb2ae219b09aea832 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Initialized, Role: FOLLOWER
I20260709 13:18:06.503237  6878 raft_consensus.cc:3060] T 30e88460611e47b2ba16a46a30b5f416 P cd75a17ab2604397adab03bb8b5fd75c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:06.505326  6923 consensus_queue.cc:260] T f03d0dbf16864ca4bc1bb5e4c0334c0f P ccd8a4c3bfe3413cb2ae219b09aea832 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:06.507292  6923 ts_tablet_manager.cc:1434] T f03d0dbf16864ca4bc1bb5e4c0334c0f P ccd8a4c3bfe3413cb2ae219b09aea832: Time spent starting tablet: real 0.009s	user 0.004s	sys 0.004s
I20260709 13:18:06.508378  6923 tablet_bootstrap.cc:492] T 8c7f33e544204fbaac4078e3e83bbf4e P ccd8a4c3bfe3413cb2ae219b09aea832: Bootstrap starting.
I20260709 13:18:06.515350  6984 raft_consensus.cc:493] T de3186201e1a40d0b335eeb8b4e256e0 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:06.515779  6923 tablet_bootstrap.cc:654] T 8c7f33e544204fbaac4078e3e83bbf4e P ccd8a4c3bfe3413cb2ae219b09aea832: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:06.515965  6984 raft_consensus.cc:515] T de3186201e1a40d0b335eeb8b4e256e0 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:06.518399  6984 leader_election.cc:290] T de3186201e1a40d0b335eeb8b4e256e0 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:18:06.520411  6876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de3186201e1a40d0b335eeb8b4e256e0" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:18:06.521811  6805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de3186201e1a40d0b335eeb8b4e256e0" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
W20260709 13:18:06.521872  6772 leader_election.cc:343] T f03d0dbf16864ca4bc1bb5e4c0334c0f P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:06.522742  6772 leader_election.cc:304] T f03d0dbf16864ca4bc1bb5e4c0334c0f P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
W20260709 13:18:06.523758  6695 leader_election.cc:343] T de3186201e1a40d0b335eeb8b4e256e0 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:06.523787  6957 raft_consensus.cc:2749] T f03d0dbf16864ca4bc1bb5e4c0334c0f P b7ab4784c7344b939bc36f639286f377 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:18:06.525084  6984 consensus_queue.cc:1048] T f09c2a98de1a4decabd0ff900dd44caa P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:18:06.525906  6697 leader_election.cc:343] T de3186201e1a40d0b335eeb8b4e256e0 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:06.526589  6697 leader_election.cc:304] T de3186201e1a40d0b335eeb8b4e256e0 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:18:06.528519  6931 raft_consensus.cc:2749] T de3186201e1a40d0b335eeb8b4e256e0 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:18:06.530435  6772 leader_election.cc:343] T 7c37d41cd9164c15a6826ca62a851a69 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:06.530927  6772 leader_election.cc:304] T 7c37d41cd9164c15a6826ca62a851a69 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:18:06.531791  6957 raft_consensus.cc:2749] T 7c37d41cd9164c15a6826ca62a851a69 P b7ab4784c7344b939bc36f639286f377 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:18:06.533325  6923 tablet_bootstrap.cc:492] T 8c7f33e544204fbaac4078e3e83bbf4e P ccd8a4c3bfe3413cb2ae219b09aea832: No bootstrap required, opened a new log
I20260709 13:18:06.533789  6923 ts_tablet_manager.cc:1403] T 8c7f33e544204fbaac4078e3e83bbf4e P ccd8a4c3bfe3413cb2ae219b09aea832: Time spent bootstrapping tablet: real 0.026s	user 0.009s	sys 0.007s
I20260709 13:18:06.534286  6922 tablet_bootstrap.cc:492] T 3a485a995abc4807b6e511e45419f737 P cd75a17ab2604397adab03bb8b5fd75c: No bootstrap required, opened a new log
I20260709 13:18:06.534734  6922 ts_tablet_manager.cc:1403] T 3a485a995abc4807b6e511e45419f737 P cd75a17ab2604397adab03bb8b5fd75c: Time spent bootstrapping tablet: real 0.197s	user 0.011s	sys 0.000s
I20260709 13:18:06.539152  6923 raft_consensus.cc:359] T 8c7f33e544204fbaac4078e3e83bbf4e P ccd8a4c3bfe3413cb2ae219b09aea832 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:06.542695  6923 raft_consensus.cc:385] T 8c7f33e544204fbaac4078e3e83bbf4e P ccd8a4c3bfe3413cb2ae219b09aea832 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:06.543015  6923 raft_consensus.cc:740] T 8c7f33e544204fbaac4078e3e83bbf4e P ccd8a4c3bfe3413cb2ae219b09aea832 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Initialized, Role: FOLLOWER
I20260709 13:18:06.545493  6923 consensus_queue.cc:260] T 8c7f33e544204fbaac4078e3e83bbf4e P ccd8a4c3bfe3413cb2ae219b09aea832 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:06.503590  6921 raft_consensus.cc:740] T 853ac0a8cbd64ce99457f170216d4d0f P b7ab4784c7344b939bc36f639286f377 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Initialized, Role: FOLLOWER
I20260709 13:18:06.551939  6921 consensus_queue.cc:260] T 853ac0a8cbd64ce99457f170216d4d0f P b7ab4784c7344b939bc36f639286f377 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:06.553004  6807 raft_consensus.cc:2468] T 853ac0a8cbd64ce99457f170216d4d0f P b7ab4784c7344b939bc36f639286f377 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 0.
I20260709 13:18:06.553330  6922 raft_consensus.cc:359] T 3a485a995abc4807b6e511e45419f737 P cd75a17ab2604397adab03bb8b5fd75c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:06.554066  6922 raft_consensus.cc:385] T 3a485a995abc4807b6e511e45419f737 P cd75a17ab2604397adab03bb8b5fd75c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:06.554337  6922 raft_consensus.cc:740] T 3a485a995abc4807b6e511e45419f737 P cd75a17ab2604397adab03bb8b5fd75c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cd75a17ab2604397adab03bb8b5fd75c, State: Initialized, Role: FOLLOWER
W20260709 13:18:06.555159  6697 consensus_peers.cc:597] T 3a485a995abc4807b6e511e45419f737 P ccd8a4c3bfe3413cb2ae219b09aea832 -> Peer cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931): Couldn't send request to peer cd75a17ab2604397adab03bb8b5fd75c. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:06.556564  6695 leader_election.cc:304] T 853ac0a8cbd64ce99457f170216d4d0f P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:18:06.555174  6922 consensus_queue.cc:260] T 3a485a995abc4807b6e511e45419f737 P cd75a17ab2604397adab03bb8b5fd75c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:06.559396  6921 ts_tablet_manager.cc:1434] T 853ac0a8cbd64ce99457f170216d4d0f P b7ab4784c7344b939bc36f639286f377: Time spent starting tablet: real 0.070s	user 0.008s	sys 0.000s
I20260709 13:18:06.559751  6923 ts_tablet_manager.cc:1434] T 8c7f33e544204fbaac4078e3e83bbf4e P ccd8a4c3bfe3413cb2ae219b09aea832: Time spent starting tablet: real 0.026s	user 0.007s	sys 0.002s
I20260709 13:18:06.561022  6923 tablet_bootstrap.cc:492] T 7c37d41cd9164c15a6826ca62a851a69 P ccd8a4c3bfe3413cb2ae219b09aea832: Bootstrap starting.
I20260709 13:18:06.561154  6921 tablet_bootstrap.cc:492] T de3186201e1a40d0b335eeb8b4e256e0 P b7ab4784c7344b939bc36f639286f377: Bootstrap starting.
I20260709 13:18:06.558696  6986 raft_consensus.cc:2804] T 853ac0a8cbd64ce99457f170216d4d0f P ccd8a4c3bfe3413cb2ae219b09aea832 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:18:06.569906  6922 ts_tablet_manager.cc:1434] T 3a485a995abc4807b6e511e45419f737 P cd75a17ab2604397adab03bb8b5fd75c: Time spent starting tablet: real 0.035s	user 0.008s	sys 0.001s
I20260709 13:18:06.571175  6922 tablet_bootstrap.cc:492] T 44bde925b2e541b69890d70715b85176 P cd75a17ab2604397adab03bb8b5fd75c: Bootstrap starting.
I20260709 13:18:06.564967  6986 raft_consensus.cc:493] T 853ac0a8cbd64ce99457f170216d4d0f P ccd8a4c3bfe3413cb2ae219b09aea832 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:06.575795  6986 raft_consensus.cc:3060] T 853ac0a8cbd64ce99457f170216d4d0f P ccd8a4c3bfe3413cb2ae219b09aea832 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:06.573518  6959 raft_consensus.cc:493] T 30e88460611e47b2ba16a46a30b5f416 P cd75a17ab2604397adab03bb8b5fd75c [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:06.587096  6959 raft_consensus.cc:515] T 30e88460611e47b2ba16a46a30b5f416 P cd75a17ab2604397adab03bb8b5fd75c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:06.590045  6986 raft_consensus.cc:515] T 853ac0a8cbd64ce99457f170216d4d0f P ccd8a4c3bfe3413cb2ae219b09aea832 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:06.591531  6730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30e88460611e47b2ba16a46a30b5f416" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:18:06.592487  6805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30e88460611e47b2ba16a46a30b5f416" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:18:06.599881  7020 consensus_queue.cc:1048] T 30e88460611e47b2ba16a46a30b5f416 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:18:06.600582  6844 leader_election.cc:304] T 30e88460611e47b2ba16a46a30b5f416 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:18:06.601693  7073 raft_consensus.cc:2749] T 30e88460611e47b2ba16a46a30b5f416 P cd75a17ab2604397adab03bb8b5fd75c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:06.602432  6986 leader_election.cc:290] T 853ac0a8cbd64ce99457f170216d4d0f P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 1 election: Requested vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:18:06.596411  6959 leader_election.cc:290] T 30e88460611e47b2ba16a46a30b5f416 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:18:06.608011  6879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "853ac0a8cbd64ce99457f170216d4d0f" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
W20260709 13:18:06.610314  6697 leader_election.cc:343] T 853ac0a8cbd64ce99457f170216d4d0f P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:06.611263  6931 consensus_queue.cc:1048] T f09c2a98de1a4decabd0ff900dd44caa P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:18:06.613667  6922 tablet_bootstrap.cc:654] T 44bde925b2e541b69890d70715b85176 P cd75a17ab2604397adab03bb8b5fd75c: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:06.615118  6806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "853ac0a8cbd64ce99457f170216d4d0f" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:18:06.616104  6806 raft_consensus.cc:3060] T 853ac0a8cbd64ce99457f170216d4d0f P b7ab4784c7344b939bc36f639286f377 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:06.621816  6921 tablet_bootstrap.cc:654] T de3186201e1a40d0b335eeb8b4e256e0 P b7ab4784c7344b939bc36f639286f377: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:06.624748  6959 raft_consensus.cc:493] T f4b8bd455d5a47c18a1380839c6e0d61 P cd75a17ab2604397adab03bb8b5fd75c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:06.628002  6959 raft_consensus.cc:515] T f4b8bd455d5a47c18a1380839c6e0d61 P cd75a17ab2604397adab03bb8b5fd75c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:06.636791  6959 leader_election.cc:290] T f4b8bd455d5a47c18a1380839c6e0d61 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:18:06.636961  6923 tablet_bootstrap.cc:654] T 7c37d41cd9164c15a6826ca62a851a69 P ccd8a4c3bfe3413cb2ae219b09aea832: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:06.645879  6731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4b8bd455d5a47c18a1380839c6e0d61" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:18:06.653836  6805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4b8bd455d5a47c18a1380839c6e0d61" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:18:06.666807  6878 raft_consensus.cc:3060] T f4b8bd455d5a47c18a1380839c6e0d61 P cd75a17ab2604397adab03bb8b5fd75c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:06.673480  6923 tablet_bootstrap.cc:492] T 7c37d41cd9164c15a6826ca62a851a69 P ccd8a4c3bfe3413cb2ae219b09aea832: No bootstrap required, opened a new log
I20260709 13:18:06.673940  6923 ts_tablet_manager.cc:1403] T 7c37d41cd9164c15a6826ca62a851a69 P ccd8a4c3bfe3413cb2ae219b09aea832: Time spent bootstrapping tablet: real 0.113s	user 0.013s	sys 0.013s
I20260709 13:18:06.669643  6844 leader_election.cc:304] T f4b8bd455d5a47c18a1380839c6e0d61 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:18:06.677676  6806 raft_consensus.cc:2468] T 853ac0a8cbd64ce99457f170216d4d0f P b7ab4784c7344b939bc36f639286f377 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 1.
W20260709 13:18:06.687460  6772 consensus_peers.cc:597] T ce4f062dcd314d43a63ca74067cb5ee3 P b7ab4784c7344b939bc36f639286f377 -> Peer cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931): Couldn't send request to peer cd75a17ab2604397adab03bb8b5fd75c. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:06.689533  6695 leader_election.cc:304] T 853ac0a8cbd64ce99457f170216d4d0f P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:18:06.689661  7064 consensus_queue.cc:1048] T ce4f062dcd314d43a63ca74067cb5ee3 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:18:06.690593  6931 raft_consensus.cc:493] T 4b8cacb381b746da8d0049b0a83b41dd P ccd8a4c3bfe3413cb2ae219b09aea832 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:06.706584  6931 raft_consensus.cc:515] T 4b8cacb381b746da8d0049b0a83b41dd P ccd8a4c3bfe3413cb2ae219b09aea832 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:06.717724  6931 leader_election.cc:290] T 4b8cacb381b746da8d0049b0a83b41dd P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:18:06.702648  6984 raft_consensus.cc:2804] T 853ac0a8cbd64ce99457f170216d4d0f P ccd8a4c3bfe3413cb2ae219b09aea832 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:18:06.725709  6984 raft_consensus.cc:697] T 853ac0a8cbd64ce99457f170216d4d0f P ccd8a4c3bfe3413cb2ae219b09aea832 [term 1 LEADER]: Becoming Leader. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
I20260709 13:18:06.726866  6984 consensus_queue.cc:237] T 853ac0a8cbd64ce99457f170216d4d0f P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:06.727450  6876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b8cacb381b746da8d0049b0a83b41dd" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
W20260709 13:18:06.729055  6697 leader_election.cc:343] T 4b8cacb381b746da8d0049b0a83b41dd P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:06.729303  6805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b8cacb381b746da8d0049b0a83b41dd" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:18:06.729986  6805 raft_consensus.cc:2468] T 4b8cacb381b746da8d0049b0a83b41dd P b7ab4784c7344b939bc36f639286f377 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 0.
I20260709 13:18:06.731478  7019 consensus_queue.cc:1048] T 3a485a995abc4807b6e511e45419f737 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:18:06.732895  7019 consensus_queue.cc:1048] T 1528ab62b6fe4e3099d08f141afee116 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:18:06.733780  6923 raft_consensus.cc:359] T 7c37d41cd9164c15a6826ca62a851a69 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:06.734521  6931 raft_consensus.cc:493] T 44bde925b2e541b69890d70715b85176 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:06.735057  6931 raft_consensus.cc:515] T 44bde925b2e541b69890d70715b85176 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:06.735368  6695 leader_election.cc:304] T 4b8cacb381b746da8d0049b0a83b41dd P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:18:06.736385  6986 raft_consensus.cc:2804] T 4b8cacb381b746da8d0049b0a83b41dd P ccd8a4c3bfe3413cb2ae219b09aea832 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:18:06.736778  6986 raft_consensus.cc:493] T 4b8cacb381b746da8d0049b0a83b41dd P ccd8a4c3bfe3413cb2ae219b09aea832 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:06.737133  6986 raft_consensus.cc:3060] T 4b8cacb381b746da8d0049b0a83b41dd P ccd8a4c3bfe3413cb2ae219b09aea832 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:06.734562  6923 raft_consensus.cc:385] T 7c37d41cd9164c15a6826ca62a851a69 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:06.737695  6923 raft_consensus.cc:740] T 7c37d41cd9164c15a6826ca62a851a69 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Initialized, Role: FOLLOWER
I20260709 13:18:06.738509  6923 consensus_queue.cc:260] T 7c37d41cd9164c15a6826ca62a851a69 P ccd8a4c3bfe3413cb2ae219b09aea832 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:06.741827  6923 ts_tablet_manager.cc:1434] T 7c37d41cd9164c15a6826ca62a851a69 P ccd8a4c3bfe3413cb2ae219b09aea832: Time spent starting tablet: real 0.068s	user 0.006s	sys 0.001s
I20260709 13:18:06.744258  6923 tablet_bootstrap.cc:492] T d33d5ee8ef6f415593d8df52063161ad P ccd8a4c3bfe3413cb2ae219b09aea832: Bootstrap starting.
I20260709 13:18:06.757117  6923 tablet_bootstrap.cc:654] T d33d5ee8ef6f415593d8df52063161ad P ccd8a4c3bfe3413cb2ae219b09aea832: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:06.759589  6922 tablet_bootstrap.cc:492] T 44bde925b2e541b69890d70715b85176 P cd75a17ab2604397adab03bb8b5fd75c: No bootstrap required, opened a new log
I20260709 13:18:06.760108  6922 ts_tablet_manager.cc:1403] T 44bde925b2e541b69890d70715b85176 P cd75a17ab2604397adab03bb8b5fd75c: Time spent bootstrapping tablet: real 0.189s	user 0.031s	sys 0.023s
I20260709 13:18:06.760396  6931 leader_election.cc:290] T 44bde925b2e541b69890d70715b85176 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:18:06.761356  6876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44bde925b2e541b69890d70715b85176" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:18:06.763706  7064 raft_consensus.cc:493] T 8c7f33e544204fbaac4078e3e83bbf4e P b7ab4784c7344b939bc36f639286f377 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:06.764348  7064 raft_consensus.cc:515] T 8c7f33e544204fbaac4078e3e83bbf4e P b7ab4784c7344b939bc36f639286f377 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
W20260709 13:18:06.765429  6697 leader_election.cc:343] T 44bde925b2e541b69890d70715b85176 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:06.765705  6806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44bde925b2e541b69890d70715b85176" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:18:06.766901  6806 raft_consensus.cc:2468] T 44bde925b2e541b69890d70715b85176 P b7ab4784c7344b939bc36f639286f377 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 0.
I20260709 13:18:06.767148  7064 leader_election.cc:290] T 8c7f33e544204fbaac4078e3e83bbf4e P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:18:06.768584  6876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c7f33e544204fbaac4078e3e83bbf4e" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:18:06.768707  6730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c7f33e544204fbaac4078e3e83bbf4e" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:18:06.771274  6730 raft_consensus.cc:2468] T 8c7f33e544204fbaac4078e3e83bbf4e P ccd8a4c3bfe3413cb2ae219b09aea832 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 0.
I20260709 13:18:06.772660  6922 raft_consensus.cc:359] T 44bde925b2e541b69890d70715b85176 P cd75a17ab2604397adab03bb8b5fd75c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
W20260709 13:18:06.772313  6772 leader_election.cc:343] T 8c7f33e544204fbaac4078e3e83bbf4e P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:06.773355  6921 tablet_bootstrap.cc:492] T de3186201e1a40d0b335eeb8b4e256e0 P b7ab4784c7344b939bc36f639286f377: No bootstrap required, opened a new log
I20260709 13:18:06.773402  6922 raft_consensus.cc:385] T 44bde925b2e541b69890d70715b85176 P cd75a17ab2604397adab03bb8b5fd75c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:06.773947  6922 raft_consensus.cc:740] T 44bde925b2e541b69890d70715b85176 P cd75a17ab2604397adab03bb8b5fd75c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cd75a17ab2604397adab03bb8b5fd75c, State: Initialized, Role: FOLLOWER
I20260709 13:18:06.774055  6770 leader_election.cc:304] T 8c7f33e544204fbaac4078e3e83bbf4e P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:18:06.774740  6695 leader_election.cc:304] T 44bde925b2e541b69890d70715b85176 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:18:06.775436  7064 raft_consensus.cc:2804] T 8c7f33e544204fbaac4078e3e83bbf4e P b7ab4784c7344b939bc36f639286f377 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:18:06.775715  6984 raft_consensus.cc:2804] T 44bde925b2e541b69890d70715b85176 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:18:06.775918  7064 raft_consensus.cc:493] T 8c7f33e544204fbaac4078e3e83bbf4e P b7ab4784c7344b939bc36f639286f377 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:06.776374  6984 raft_consensus.cc:493] T 44bde925b2e541b69890d70715b85176 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:06.776432  7064 raft_consensus.cc:3060] T 8c7f33e544204fbaac4078e3e83bbf4e P b7ab4784c7344b939bc36f639286f377 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:06.776022  6628 catalog_manager.cc:5697] T 853ac0a8cbd64ce99457f170216d4d0f P ccd8a4c3bfe3413cb2ae219b09aea832 reported cstate change: term changed from 0 to 1, leader changed from <none> to ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65). New cstate: current_term: 1 leader_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:06.777551  6984 raft_consensus.cc:3060] T 44bde925b2e541b69890d70715b85176 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:06.765722  6986 raft_consensus.cc:515] T 4b8cacb381b746da8d0049b0a83b41dd P ccd8a4c3bfe3413cb2ae219b09aea832 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:06.774652  6922 consensus_queue.cc:260] T 44bde925b2e541b69890d70715b85176 P cd75a17ab2604397adab03bb8b5fd75c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:06.774035  6921 ts_tablet_manager.cc:1403] T de3186201e1a40d0b335eeb8b4e256e0 P b7ab4784c7344b939bc36f639286f377: Time spent bootstrapping tablet: real 0.213s	user 0.023s	sys 0.001s
I20260709 13:18:06.782670  6922 ts_tablet_manager.cc:1434] T 44bde925b2e541b69890d70715b85176 P cd75a17ab2604397adab03bb8b5fd75c: Time spent starting tablet: real 0.022s	user 0.006s	sys 0.000s
I20260709 13:18:06.783651  6922 tablet_bootstrap.cc:492] T 4b8cacb381b746da8d0049b0a83b41dd P cd75a17ab2604397adab03bb8b5fd75c: Bootstrap starting.
I20260709 13:18:06.792069  6923 tablet_bootstrap.cc:492] T d33d5ee8ef6f415593d8df52063161ad P ccd8a4c3bfe3413cb2ae219b09aea832: No bootstrap required, opened a new log
I20260709 13:18:06.792568  6923 ts_tablet_manager.cc:1403] T d33d5ee8ef6f415593d8df52063161ad P ccd8a4c3bfe3413cb2ae219b09aea832: Time spent bootstrapping tablet: real 0.049s	user 0.007s	sys 0.010s
I20260709 13:18:06.793991  6806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b8cacb381b746da8d0049b0a83b41dd" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:18:06.794571  6806 raft_consensus.cc:3060] T 4b8cacb381b746da8d0049b0a83b41dd P b7ab4784c7344b939bc36f639286f377 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:06.789783  6959 raft_consensus.cc:2749] T f4b8bd455d5a47c18a1380839c6e0d61 P cd75a17ab2604397adab03bb8b5fd75c [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:18:06.799856  6959 raft_consensus.cc:493] T 44bde925b2e541b69890d70715b85176 P cd75a17ab2604397adab03bb8b5fd75c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:06.841436  6878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b8cacb381b746da8d0049b0a83b41dd" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:18:06.800932  6921 raft_consensus.cc:359] T de3186201e1a40d0b335eeb8b4e256e0 P b7ab4784c7344b939bc36f639286f377 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:06.884130  6921 raft_consensus.cc:385] T de3186201e1a40d0b335eeb8b4e256e0 P b7ab4784c7344b939bc36f639286f377 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:06.884485  6921 raft_consensus.cc:740] T de3186201e1a40d0b335eeb8b4e256e0 P b7ab4784c7344b939bc36f639286f377 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Initialized, Role: FOLLOWER
I20260709 13:18:06.885215  6921 consensus_queue.cc:260] T de3186201e1a40d0b335eeb8b4e256e0 P b7ab4784c7344b939bc36f639286f377 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:06.886831  6921 ts_tablet_manager.cc:1434] T de3186201e1a40d0b335eeb8b4e256e0 P b7ab4784c7344b939bc36f639286f377: Time spent starting tablet: real 0.105s	user 0.005s	sys 0.000s
I20260709 13:18:06.842646  6922 tablet_bootstrap.cc:654] T 4b8cacb381b746da8d0049b0a83b41dd P cd75a17ab2604397adab03bb8b5fd75c: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:06.879097  6806 raft_consensus.cc:2468] T 4b8cacb381b746da8d0049b0a83b41dd P b7ab4784c7344b939bc36f639286f377 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 1.
I20260709 13:18:06.801298  6959 raft_consensus.cc:515] T 44bde925b2e541b69890d70715b85176 P cd75a17ab2604397adab03bb8b5fd75c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
W20260709 13:18:06.877342  6697 consensus_peers.cc:597] T 1528ab62b6fe4e3099d08f141afee116 P ccd8a4c3bfe3413cb2ae219b09aea832 -> Peer cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931): Couldn't send request to peer cd75a17ab2604397adab03bb8b5fd75c. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:18:06.806891  6678 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:18:06.811112  7064 raft_consensus.cc:515] T 8c7f33e544204fbaac4078e3e83bbf4e P b7ab4784c7344b939bc36f639286f377 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:06.881242  6923 raft_consensus.cc:359] T d33d5ee8ef6f415593d8df52063161ad P ccd8a4c3bfe3413cb2ae219b09aea832 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:06.893894  6923 raft_consensus.cc:385] T d33d5ee8ef6f415593d8df52063161ad P ccd8a4c3bfe3413cb2ae219b09aea832 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:06.894227  6923 raft_consensus.cc:740] T d33d5ee8ef6f415593d8df52063161ad P ccd8a4c3bfe3413cb2ae219b09aea832 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Initialized, Role: FOLLOWER
I20260709 13:18:06.895009  6923 consensus_queue.cc:260] T d33d5ee8ef6f415593d8df52063161ad P ccd8a4c3bfe3413cb2ae219b09aea832 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:06.895318  7064 leader_election.cc:290] T 8c7f33e544204fbaac4078e3e83bbf4e P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 1 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:18:06.896068  6729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c7f33e544204fbaac4078e3e83bbf4e" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:18:06.903227  6729 raft_consensus.cc:3060] T 8c7f33e544204fbaac4078e3e83bbf4e P ccd8a4c3bfe3413cb2ae219b09aea832 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:06.894109  6806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44bde925b2e541b69890d70715b85176" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:18:06.893561  6695 leader_election.cc:304] T 4b8cacb381b746da8d0049b0a83b41dd P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
W20260709 13:18:06.844434  7102 log.cc:927] Time spent T 1528ab62b6fe4e3099d08f141afee116 P b7ab4784c7344b939bc36f639286f377: Append to log took a long time: real 0.052s	user 0.000s	sys 0.001s
I20260709 13:18:06.872288  6984 raft_consensus.cc:515] T 44bde925b2e541b69890d70715b85176 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:06.887856  6921 tablet_bootstrap.cc:492] T 9b3759de40694069b13c0f8bd40e5709 P b7ab4784c7344b939bc36f639286f377: Bootstrap starting.
I20260709 13:18:06.913859  6729 raft_consensus.cc:2468] T 8c7f33e544204fbaac4078e3e83bbf4e P ccd8a4c3bfe3413cb2ae219b09aea832 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 1.
W20260709 13:18:06.912799  6697 leader_election.cc:343] T 4b8cacb381b746da8d0049b0a83b41dd P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:06.821929  6986 leader_election.cc:290] T 4b8cacb381b746da8d0049b0a83b41dd P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 1 election: Requested vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:18:06.900616  6923 ts_tablet_manager.cc:1434] T d33d5ee8ef6f415593d8df52063161ad P ccd8a4c3bfe3413cb2ae219b09aea832: Time spent starting tablet: real 0.108s	user 0.008s	sys 0.001s
I20260709 13:18:06.901101  6730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44bde925b2e541b69890d70715b85176" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:18:06.916465  6730 raft_consensus.cc:2393] T 44bde925b2e541b69890d70715b85176 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c in current term 1: Already voted for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in this term.
I20260709 13:18:06.916674  6923 tablet_bootstrap.cc:492] T 9b3759de40694069b13c0f8bd40e5709 P ccd8a4c3bfe3413cb2ae219b09aea832: Bootstrap starting.
I20260709 13:18:06.901197  6878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c7f33e544204fbaac4078e3e83bbf4e" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:18:06.917303  6984 leader_election.cc:290] T 44bde925b2e541b69890d70715b85176 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 1 election: Requested vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:18:06.906704  6806 raft_consensus.cc:2468] T 44bde925b2e541b69890d70715b85176 P b7ab4784c7344b939bc36f639286f377 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 0.
W20260709 13:18:06.918606  6772 leader_election.cc:343] T 8c7f33e544204fbaac4078e3e83bbf4e P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:06.919778  6844 leader_election.cc:304] T 44bde925b2e541b69890d70715b85176 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:18:06.920857  7073 raft_consensus.cc:2804] T 44bde925b2e541b69890d70715b85176 P cd75a17ab2604397adab03bb8b5fd75c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:18:06.921242  7073 raft_consensus.cc:493] T 44bde925b2e541b69890d70715b85176 P cd75a17ab2604397adab03bb8b5fd75c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:06.921307  6806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44bde925b2e541b69890d70715b85176" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:18:06.921645  7073 raft_consensus.cc:3060] T 44bde925b2e541b69890d70715b85176 P cd75a17ab2604397adab03bb8b5fd75c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:06.892874  6959 leader_election.cc:290] T 44bde925b2e541b69890d70715b85176 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:18:06.913913  6931 raft_consensus.cc:2804] T 4b8cacb381b746da8d0049b0a83b41dd P ccd8a4c3bfe3413cb2ae219b09aea832 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:18:06.923883  6922 tablet_bootstrap.cc:492] T 4b8cacb381b746da8d0049b0a83b41dd P cd75a17ab2604397adab03bb8b5fd75c: No bootstrap required, opened a new log
I20260709 13:18:06.924742  6922 ts_tablet_manager.cc:1403] T 4b8cacb381b746da8d0049b0a83b41dd P cd75a17ab2604397adab03bb8b5fd75c: Time spent bootstrapping tablet: real 0.141s	user 0.021s	sys 0.011s
I20260709 13:18:06.925393  7019 raft_consensus.cc:493] T d33d5ee8ef6f415593d8df52063161ad P ccd8a4c3bfe3413cb2ae219b09aea832 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:06.926481  6931 raft_consensus.cc:697] T 4b8cacb381b746da8d0049b0a83b41dd P ccd8a4c3bfe3413cb2ae219b09aea832 [term 1 LEADER]: Becoming Leader. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
I20260709 13:18:06.926807  7019 raft_consensus.cc:515] T d33d5ee8ef6f415593d8df52063161ad P ccd8a4c3bfe3413cb2ae219b09aea832 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:06.924894  6806 raft_consensus.cc:3060] T 44bde925b2e541b69890d70715b85176 P b7ab4784c7344b939bc36f639286f377 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:06.929737  6878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44bde925b2e541b69890d70715b85176" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:18:06.936851  6931 consensus_queue.cc:237] T 4b8cacb381b746da8d0049b0a83b41dd P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:06.940969  6984 raft_consensus.cc:493] T f03d0dbf16864ca4bc1bb5e4c0334c0f P ccd8a4c3bfe3413cb2ae219b09aea832 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:06.941526  6984 raft_consensus.cc:515] T f03d0dbf16864ca4bc1bb5e4c0334c0f P ccd8a4c3bfe3413cb2ae219b09aea832 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:06.934727  6770 leader_election.cc:304] T 8c7f33e544204fbaac4078e3e83bbf4e P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:18:06.943807  6984 leader_election.cc:290] T f03d0dbf16864ca4bc1bb5e4c0334c0f P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:18:06.947520  7064 raft_consensus.cc:2804] T 8c7f33e544204fbaac4078e3e83bbf4e P b7ab4784c7344b939bc36f639286f377 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:18:06.948119  7064 raft_consensus.cc:697] T 8c7f33e544204fbaac4078e3e83bbf4e P b7ab4784c7344b939bc36f639286f377 [term 1 LEADER]: Becoming Leader. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
I20260709 13:18:06.948357  6880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f03d0dbf16864ca4bc1bb5e4c0334c0f" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:18:06.948923  6922 raft_consensus.cc:359] T 4b8cacb381b746da8d0049b0a83b41dd P cd75a17ab2604397adab03bb8b5fd75c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:06.950974  6922 raft_consensus.cc:385] T 4b8cacb381b746da8d0049b0a83b41dd P cd75a17ab2604397adab03bb8b5fd75c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:06.951238  6922 raft_consensus.cc:740] T 4b8cacb381b746da8d0049b0a83b41dd P cd75a17ab2604397adab03bb8b5fd75c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cd75a17ab2604397adab03bb8b5fd75c, State: Initialized, Role: FOLLOWER
I20260709 13:18:06.952661  6923 tablet_bootstrap.cc:654] T 9b3759de40694069b13c0f8bd40e5709 P ccd8a4c3bfe3413cb2ae219b09aea832: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:06.952706  6805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f03d0dbf16864ca4bc1bb5e4c0334c0f" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:18:06.948921  7064 consensus_queue.cc:237] T 8c7f33e544204fbaac4078e3e83bbf4e P b7ab4784c7344b939bc36f639286f377 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:06.955111  7019 leader_election.cc:290] T d33d5ee8ef6f415593d8df52063161ad P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:18:06.955957  6807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d33d5ee8ef6f415593d8df52063161ad" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:18:06.946521  7073 raft_consensus.cc:515] T 44bde925b2e541b69890d70715b85176 P cd75a17ab2604397adab03bb8b5fd75c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:06.957298  6922 consensus_queue.cc:260] T 4b8cacb381b746da8d0049b0a83b41dd P cd75a17ab2604397adab03bb8b5fd75c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
W20260709 13:18:06.957827  6697 leader_election.cc:343] T f03d0dbf16864ca4bc1bb5e4c0334c0f P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:06.958513  6878 raft_consensus.cc:2393] T 44bde925b2e541b69890d70715b85176 P cd75a17ab2604397adab03bb8b5fd75c [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate ccd8a4c3bfe3413cb2ae219b09aea832 in current term 1: Already voted for candidate cd75a17ab2604397adab03bb8b5fd75c in this term.
I20260709 13:18:06.960335  6729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44bde925b2e541b69890d70715b85176" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:18:06.961061  6922 ts_tablet_manager.cc:1434] T 4b8cacb381b746da8d0049b0a83b41dd P cd75a17ab2604397adab03bb8b5fd75c: Time spent starting tablet: real 0.036s	user 0.007s	sys 0.000s
W20260709 13:18:06.961277  6695 leader_election.cc:343] T d33d5ee8ef6f415593d8df52063161ad P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:06.961127  6729 raft_consensus.cc:2393] T 44bde925b2e541b69890d70715b85176 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c in current term 1: Already voted for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in this term.
I20260709 13:18:06.961653  6880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d33d5ee8ef6f415593d8df52063161ad" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:18:06.962126  6922 tablet_bootstrap.cc:492] T ce4f062dcd314d43a63ca74067cb5ee3 P cd75a17ab2604397adab03bb8b5fd75c: Bootstrap starting.
I20260709 13:18:06.953424  6805 raft_consensus.cc:2468] T f03d0dbf16864ca4bc1bb5e4c0334c0f P b7ab4784c7344b939bc36f639286f377 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 0.
I20260709 13:18:06.963810  6695 leader_election.cc:304] T f03d0dbf16864ca4bc1bb5e4c0334c0f P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:18:06.964283  7073 leader_election.cc:290] T 44bde925b2e541b69890d70715b85176 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 1 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:18:06.964116  6921 tablet_bootstrap.cc:654] T 9b3759de40694069b13c0f8bd40e5709 P b7ab4784c7344b939bc36f639286f377: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:06.966151  6984 raft_consensus.cc:2804] T f03d0dbf16864ca4bc1bb5e4c0334c0f P ccd8a4c3bfe3413cb2ae219b09aea832 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:18:06.966547  6984 raft_consensus.cc:493] T f03d0dbf16864ca4bc1bb5e4c0334c0f P ccd8a4c3bfe3413cb2ae219b09aea832 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:06.966990  6984 raft_consensus.cc:3060] T f03d0dbf16864ca4bc1bb5e4c0334c0f P ccd8a4c3bfe3413cb2ae219b09aea832 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:06.979296  7073 raft_consensus.cc:493] T 3a485a995abc4807b6e511e45419f737 P cd75a17ab2604397adab03bb8b5fd75c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:06.980105  7073 raft_consensus.cc:515] T 3a485a995abc4807b6e511e45419f737 P cd75a17ab2604397adab03bb8b5fd75c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:06.978332  6805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44bde925b2e541b69890d70715b85176" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:18:07.000114  6951 raft_consensus.cc:493] T 7c37d41cd9164c15a6826ca62a851a69 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:07.005903  6844 leader_election.cc:304] T 44bde925b2e541b69890d70715b85176 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:18:07.006039  6951 raft_consensus.cc:515] T 7c37d41cd9164c15a6826ca62a851a69 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:07.007064  6959 raft_consensus.cc:2749] T 44bde925b2e541b69890d70715b85176 P cd75a17ab2604397adab03bb8b5fd75c [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:18:07.010324  6951 leader_election.cc:290] T 7c37d41cd9164c15a6826ca62a851a69 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:18:07.011075  6729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a485a995abc4807b6e511e45419f737" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:18:07.002835  7064 raft_consensus.cc:493] T de3186201e1a40d0b335eeb8b4e256e0 P b7ab4784c7344b939bc36f639286f377 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:07.012367  7064 raft_consensus.cc:515] T de3186201e1a40d0b335eeb8b4e256e0 P b7ab4784c7344b939bc36f639286f377 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
W20260709 13:18:07.028416  6697 leader_election.cc:343] T d33d5ee8ef6f415593d8df52063161ad P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:07.028941  6697 leader_election.cc:304] T d33d5ee8ef6f415593d8df52063161ad P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:18:07.030339  6922 tablet_bootstrap.cc:654] T ce4f062dcd314d43a63ca74067cb5ee3 P cd75a17ab2604397adab03bb8b5fd75c: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:07.032971  6628 catalog_manager.cc:5697] T 8c7f33e544204fbaac4078e3e83bbf4e P b7ab4784c7344b939bc36f639286f377 reported cstate change: term changed from 0 to 1, leader changed from <none> to b7ab4784c7344b939bc36f639286f377 (127.5.126.66). New cstate: current_term: 1 leader_uuid: "b7ab4784c7344b939bc36f639286f377" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:07.031095  6951 raft_consensus.cc:2749] T d33d5ee8ef6f415593d8df52063161ad P ccd8a4c3bfe3413cb2ae219b09aea832 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:18:07.031338  6984 raft_consensus.cc:515] T f03d0dbf16864ca4bc1bb5e4c0334c0f P ccd8a4c3bfe3413cb2ae219b09aea832 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:07.043175  6807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a485a995abc4807b6e511e45419f737" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:18:07.043505  6984 leader_election.cc:290] T f03d0dbf16864ca4bc1bb5e4c0334c0f P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 1 election: Requested vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:18:07.043846  6923 tablet_bootstrap.cc:492] T 9b3759de40694069b13c0f8bd40e5709 P ccd8a4c3bfe3413cb2ae219b09aea832: No bootstrap required, opened a new log
I20260709 13:18:07.044694  6923 ts_tablet_manager.cc:1403] T 9b3759de40694069b13c0f8bd40e5709 P ccd8a4c3bfe3413cb2ae219b09aea832: Time spent bootstrapping tablet: real 0.128s	user 0.013s	sys 0.008s
I20260709 13:18:07.045164  6844 leader_election.cc:304] T 3a485a995abc4807b6e511e45419f737 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:18:07.046200  6959 raft_consensus.cc:2749] T 3a485a995abc4807b6e511e45419f737 P cd75a17ab2604397adab03bb8b5fd75c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:18:07.038703  6805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c37d41cd9164c15a6826ca62a851a69" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:18:07.047273  6805 raft_consensus.cc:2468] T 7c37d41cd9164c15a6826ca62a851a69 P b7ab4784c7344b939bc36f639286f377 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 0.
I20260709 13:18:07.037812  7073 leader_election.cc:290] T 3a485a995abc4807b6e511e45419f737 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:18:07.050375  7064 leader_election.cc:290] T de3186201e1a40d0b335eeb8b4e256e0 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:18:07.029865  6806 raft_consensus.cc:2468] T 44bde925b2e541b69890d70715b85176 P b7ab4784c7344b939bc36f639286f377 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 1.
I20260709 13:18:07.052310  6878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de3186201e1a40d0b335eeb8b4e256e0" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:18:07.053145  6923 raft_consensus.cc:359] T 9b3759de40694069b13c0f8bd40e5709 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:07.053915  6923 raft_consensus.cc:385] T 9b3759de40694069b13c0f8bd40e5709 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 13:18:07.053988  6772 leader_election.cc:343] T de3186201e1a40d0b335eeb8b4e256e0 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:07.055230  6729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de3186201e1a40d0b335eeb8b4e256e0" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:18:07.055903  6729 raft_consensus.cc:2468] T de3186201e1a40d0b335eeb8b4e256e0 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 0.
I20260709 13:18:07.056397  6695 leader_election.cc:304] T 7c37d41cd9164c15a6826ca62a851a69 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
I20260709 13:18:07.057325  6770 leader_election.cc:304] T de3186201e1a40d0b335eeb8b4e256e0 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:18:07.058360  7101 raft_consensus.cc:2804] T 7c37d41cd9164c15a6826ca62a851a69 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:18:07.058696  7064 raft_consensus.cc:2804] T de3186201e1a40d0b335eeb8b4e256e0 P b7ab4784c7344b939bc36f639286f377 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:18:07.059181  7064 raft_consensus.cc:493] T de3186201e1a40d0b335eeb8b4e256e0 P b7ab4784c7344b939bc36f639286f377 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:07.059485  7064 raft_consensus.cc:3060] T de3186201e1a40d0b335eeb8b4e256e0 P b7ab4784c7344b939bc36f639286f377 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:07.060897  6921 tablet_bootstrap.cc:492] T 9b3759de40694069b13c0f8bd40e5709 P b7ab4784c7344b939bc36f639286f377: No bootstrap required, opened a new log
I20260709 13:18:07.061409  6921 ts_tablet_manager.cc:1403] T 9b3759de40694069b13c0f8bd40e5709 P b7ab4784c7344b939bc36f639286f377: Time spent bootstrapping tablet: real 0.174s	user 0.016s	sys 0.022s
I20260709 13:18:07.058737  7101 raft_consensus.cc:493] T 7c37d41cd9164c15a6826ca62a851a69 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:07.064247  7101 raft_consensus.cc:3060] T 7c37d41cd9164c15a6826ca62a851a69 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:07.064505  6695 leader_election.cc:304] T 44bde925b2e541b69890d70715b85176 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:18:07.066468  6951 raft_consensus.cc:2804] T 44bde925b2e541b69890d70715b85176 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:18:07.066984  6951 raft_consensus.cc:697] T 44bde925b2e541b69890d70715b85176 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 1 LEADER]: Becoming Leader. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
I20260709 13:18:07.068275  6951 consensus_queue.cc:237] T 44bde925b2e541b69890d70715b85176 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:07.073701  6880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c37d41cd9164c15a6826ca62a851a69" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:18:07.074098  7101 raft_consensus.cc:515] T 7c37d41cd9164c15a6826ca62a851a69 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:07.054309  6923 raft_consensus.cc:740] T 9b3759de40694069b13c0f8bd40e5709 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Initialized, Role: FOLLOWER
I20260709 13:18:07.078969  6923 consensus_queue.cc:260] T 9b3759de40694069b13c0f8bd40e5709 P ccd8a4c3bfe3413cb2ae219b09aea832 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:07.079900  6806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f03d0dbf16864ca4bc1bb5e4c0334c0f" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:18:07.080655  6806 raft_consensus.cc:3060] T f03d0dbf16864ca4bc1bb5e4c0334c0f P b7ab4784c7344b939bc36f639286f377 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:07.081645  6921 raft_consensus.cc:359] T 9b3759de40694069b13c0f8bd40e5709 P b7ab4784c7344b939bc36f639286f377 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:07.081787  7064 raft_consensus.cc:515] T de3186201e1a40d0b335eeb8b4e256e0 P b7ab4784c7344b939bc36f639286f377 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:07.082417  6921 raft_consensus.cc:385] T 9b3759de40694069b13c0f8bd40e5709 P b7ab4784c7344b939bc36f639286f377 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:07.082711  6921 raft_consensus.cc:740] T 9b3759de40694069b13c0f8bd40e5709 P b7ab4784c7344b939bc36f639286f377 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Initialized, Role: FOLLOWER
I20260709 13:18:07.083401  6921 consensus_queue.cc:260] T 9b3759de40694069b13c0f8bd40e5709 P b7ab4784c7344b939bc36f639286f377 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:07.084865  6729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de3186201e1a40d0b335eeb8b4e256e0" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:18:07.085610  6729 raft_consensus.cc:3060] T de3186201e1a40d0b335eeb8b4e256e0 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:07.085870  6921 ts_tablet_manager.cc:1434] T 9b3759de40694069b13c0f8bd40e5709 P b7ab4784c7344b939bc36f639286f377: Time spent starting tablet: real 0.024s	user 0.007s	sys 0.000s
I20260709 13:18:07.087051  6921 tablet_bootstrap.cc:492] T d33d5ee8ef6f415593d8df52063161ad P b7ab4784c7344b939bc36f639286f377: Bootstrap starting.
I20260709 13:18:07.080687  6923 ts_tablet_manager.cc:1434] T 9b3759de40694069b13c0f8bd40e5709 P ccd8a4c3bfe3413cb2ae219b09aea832: Time spent starting tablet: real 0.036s	user 0.006s	sys 0.001s
I20260709 13:18:07.089124  6923 tablet_bootstrap.cc:492] T 3fa34c08b205435dba97346991aa1f92 P ccd8a4c3bfe3413cb2ae219b09aea832: Bootstrap starting.
I20260709 13:18:07.091403  6880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f03d0dbf16864ca4bc1bb5e4c0334c0f" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:18:07.098932  6923 tablet_bootstrap.cc:654] T 3fa34c08b205435dba97346991aa1f92 P ccd8a4c3bfe3413cb2ae219b09aea832: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:07.099261  6630 catalog_manager.cc:5697] T 4b8cacb381b746da8d0049b0a83b41dd P ccd8a4c3bfe3413cb2ae219b09aea832 reported cstate change: term changed from 0 to 1, leader changed from <none> to ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65). New cstate: current_term: 1 leader_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:07.096006  6729 raft_consensus.cc:2468] T de3186201e1a40d0b335eeb8b4e256e0 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 1.
W20260709 13:18:07.106470  6697 leader_election.cc:343] T 7c37d41cd9164c15a6826ca62a851a69 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:07.113219  7064 leader_election.cc:290] T de3186201e1a40d0b335eeb8b4e256e0 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 1 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
W20260709 13:18:07.107833  6697 leader_election.cc:343] T f03d0dbf16864ca4bc1bb5e4c0334c0f P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:07.115527  6770 leader_election.cc:304] T de3186201e1a40d0b335eeb8b4e256e0 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
I20260709 13:18:07.116350  6880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de3186201e1a40d0b335eeb8b4e256e0" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:18:07.118887  6957 raft_consensus.cc:2804] T de3186201e1a40d0b335eeb8b4e256e0 P b7ab4784c7344b939bc36f639286f377 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:18:07.119665  6957 raft_consensus.cc:697] T de3186201e1a40d0b335eeb8b4e256e0 P b7ab4784c7344b939bc36f639286f377 [term 1 LEADER]: Becoming Leader. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
I20260709 13:18:07.120677  6957 consensus_queue.cc:237] T de3186201e1a40d0b335eeb8b4e256e0 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
W20260709 13:18:07.126950  6772 leader_election.cc:343] T de3186201e1a40d0b335eeb8b4e256e0 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:07.134804  7101 leader_election.cc:290] T 7c37d41cd9164c15a6826ca62a851a69 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 1 election: Requested vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:18:07.142019  6806 raft_consensus.cc:2468] T f03d0dbf16864ca4bc1bb5e4c0334c0f P b7ab4784c7344b939bc36f639286f377 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 1.
I20260709 13:18:07.150928  6880 raft_consensus.cc:3060] T 3a485a995abc4807b6e511e45419f737 P cd75a17ab2604397adab03bb8b5fd75c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:07.151225  6922 tablet_bootstrap.cc:492] T ce4f062dcd314d43a63ca74067cb5ee3 P cd75a17ab2604397adab03bb8b5fd75c: No bootstrap required, opened a new log
I20260709 13:18:07.151103  6695 leader_election.cc:304] T f03d0dbf16864ca4bc1bb5e4c0334c0f P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:18:07.152026  6922 ts_tablet_manager.cc:1403] T ce4f062dcd314d43a63ca74067cb5ee3 P cd75a17ab2604397adab03bb8b5fd75c: Time spent bootstrapping tablet: real 0.190s	user 0.040s	sys 0.032s
I20260709 13:18:07.152872  6986 raft_consensus.cc:2804] T f03d0dbf16864ca4bc1bb5e4c0334c0f P ccd8a4c3bfe3413cb2ae219b09aea832 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:18:07.155634  6806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c37d41cd9164c15a6826ca62a851a69" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:18:07.156311  6806 raft_consensus.cc:3060] T 7c37d41cd9164c15a6826ca62a851a69 P b7ab4784c7344b939bc36f639286f377 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:07.157081  6922 raft_consensus.cc:359] T ce4f062dcd314d43a63ca74067cb5ee3 P cd75a17ab2604397adab03bb8b5fd75c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:07.158195  6922 raft_consensus.cc:385] T ce4f062dcd314d43a63ca74067cb5ee3 P cd75a17ab2604397adab03bb8b5fd75c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:07.158624  6922 raft_consensus.cc:740] T ce4f062dcd314d43a63ca74067cb5ee3 P cd75a17ab2604397adab03bb8b5fd75c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cd75a17ab2604397adab03bb8b5fd75c, State: Initialized, Role: FOLLOWER
I20260709 13:18:07.159646  6922 consensus_queue.cc:260] T ce4f062dcd314d43a63ca74067cb5ee3 P cd75a17ab2604397adab03bb8b5fd75c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:07.162438  6806 raft_consensus.cc:2468] T 7c37d41cd9164c15a6826ca62a851a69 P b7ab4784c7344b939bc36f639286f377 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 1.
I20260709 13:18:07.163311  6922 ts_tablet_manager.cc:1434] T ce4f062dcd314d43a63ca74067cb5ee3 P cd75a17ab2604397adab03bb8b5fd75c: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.002s
I20260709 13:18:07.165347  6922 tablet_bootstrap.cc:492] T 1528ab62b6fe4e3099d08f141afee116 P cd75a17ab2604397adab03bb8b5fd75c: Bootstrap starting.
I20260709 13:18:07.172823  6921 tablet_bootstrap.cc:654] T d33d5ee8ef6f415593d8df52063161ad P b7ab4784c7344b939bc36f639286f377: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:07.164192  6695 leader_election.cc:304] T 7c37d41cd9164c15a6826ca62a851a69 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
I20260709 13:18:07.170012  6628 catalog_manager.cc:5697] T 44bde925b2e541b69890d70715b85176 P ccd8a4c3bfe3413cb2ae219b09aea832 reported cstate change: term changed from 0 to 1, leader changed from <none> to ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65). New cstate: current_term: 1 leader_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:07.153414  6986 raft_consensus.cc:697] T f03d0dbf16864ca4bc1bb5e4c0334c0f P ccd8a4c3bfe3413cb2ae219b09aea832 [term 1 LEADER]: Becoming Leader. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
I20260709 13:18:07.175484  6630 catalog_manager.cc:5697] T de3186201e1a40d0b335eeb8b4e256e0 P b7ab4784c7344b939bc36f639286f377 reported cstate change: term changed from 0 to 1, leader changed from <none> to b7ab4784c7344b939bc36f639286f377 (127.5.126.66). New cstate: current_term: 1 leader_uuid: "b7ab4784c7344b939bc36f639286f377" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:07.175789  7073 raft_consensus.cc:493] T 4b8cacb381b746da8d0049b0a83b41dd P cd75a17ab2604397adab03bb8b5fd75c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:07.178534  7073 raft_consensus.cc:515] T 4b8cacb381b746da8d0049b0a83b41dd P cd75a17ab2604397adab03bb8b5fd75c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:07.178547  6986 consensus_queue.cc:237] T f03d0dbf16864ca4bc1bb5e4c0334c0f P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:07.180217  6923 tablet_bootstrap.cc:492] T 3fa34c08b205435dba97346991aa1f92 P ccd8a4c3bfe3413cb2ae219b09aea832: No bootstrap required, opened a new log
I20260709 13:18:07.178529  6951 raft_consensus.cc:2804] T 7c37d41cd9164c15a6826ca62a851a69 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:18:07.180764  6923 ts_tablet_manager.cc:1403] T 3fa34c08b205435dba97346991aa1f92 P ccd8a4c3bfe3413cb2ae219b09aea832: Time spent bootstrapping tablet: real 0.092s	user 0.018s	sys 0.013s
I20260709 13:18:07.181084  6951 raft_consensus.cc:697] T 7c37d41cd9164c15a6826ca62a851a69 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 1 LEADER]: Becoming Leader. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
I20260709 13:18:07.182546  6951 consensus_queue.cc:237] T 7c37d41cd9164c15a6826ca62a851a69 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:07.186074  6729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b8cacb381b746da8d0049b0a83b41dd" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:18:07.180979  7073 leader_election.cc:290] T 4b8cacb381b746da8d0049b0a83b41dd P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:18:07.187958  6878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c37d41cd9164c15a6826ca62a851a69" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:18:07.189054  6806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b8cacb381b746da8d0049b0a83b41dd" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:18:07.189952  6806 raft_consensus.cc:2393] T 4b8cacb381b746da8d0049b0a83b41dd P b7ab4784c7344b939bc36f639286f377 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c in current term 1: Already voted for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in this term.
I20260709 13:18:07.191488  6844 leader_election.cc:304] T 4b8cacb381b746da8d0049b0a83b41dd P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:18:07.195034  6923 raft_consensus.cc:359] T 3fa34c08b205435dba97346991aa1f92 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:07.196516  6922 tablet_bootstrap.cc:654] T 1528ab62b6fe4e3099d08f141afee116 P cd75a17ab2604397adab03bb8b5fd75c: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:07.196911  7073 raft_consensus.cc:3060] T 4b8cacb381b746da8d0049b0a83b41dd P cd75a17ab2604397adab03bb8b5fd75c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:07.207773  6923 raft_consensus.cc:385] T 3fa34c08b205435dba97346991aa1f92 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:07.209053  6923 raft_consensus.cc:740] T 3fa34c08b205435dba97346991aa1f92 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Initialized, Role: FOLLOWER
I20260709 13:18:07.211826  6923 consensus_queue.cc:260] T 3fa34c08b205435dba97346991aa1f92 P ccd8a4c3bfe3413cb2ae219b09aea832 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:07.215979  6923 ts_tablet_manager.cc:1434] T 3fa34c08b205435dba97346991aa1f92 P ccd8a4c3bfe3413cb2ae219b09aea832: Time spent starting tablet: real 0.035s	user 0.007s	sys 0.000s
I20260709 13:18:07.216418  6922 tablet_bootstrap.cc:492] T 1528ab62b6fe4e3099d08f141afee116 P cd75a17ab2604397adab03bb8b5fd75c: No bootstrap required, opened a new log
I20260709 13:18:07.216567  7073 raft_consensus.cc:2749] T 4b8cacb381b746da8d0049b0a83b41dd P cd75a17ab2604397adab03bb8b5fd75c [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:18:07.216933  6922 ts_tablet_manager.cc:1403] T 1528ab62b6fe4e3099d08f141afee116 P cd75a17ab2604397adab03bb8b5fd75c: Time spent bootstrapping tablet: real 0.052s	user 0.014s	sys 0.002s
I20260709 13:18:07.217975  6923 tablet_bootstrap.cc:492] T bd6869f07b5a4885a0b99fbe60c3b175 P ccd8a4c3bfe3413cb2ae219b09aea832: Bootstrap starting.
I20260709 13:18:07.220325  6921 tablet_bootstrap.cc:492] T d33d5ee8ef6f415593d8df52063161ad P b7ab4784c7344b939bc36f639286f377: No bootstrap required, opened a new log
I20260709 13:18:07.220969  6921 ts_tablet_manager.cc:1403] T d33d5ee8ef6f415593d8df52063161ad P b7ab4784c7344b939bc36f639286f377: Time spent bootstrapping tablet: real 0.134s	user 0.012s	sys 0.009s
I20260709 13:18:07.225006  6921 raft_consensus.cc:359] T d33d5ee8ef6f415593d8df52063161ad P b7ab4784c7344b939bc36f639286f377 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:07.225750  6921 raft_consensus.cc:385] T d33d5ee8ef6f415593d8df52063161ad P b7ab4784c7344b939bc36f639286f377 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:07.226058  6921 raft_consensus.cc:740] T d33d5ee8ef6f415593d8df52063161ad P b7ab4784c7344b939bc36f639286f377 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Initialized, Role: FOLLOWER
W20260709 13:18:07.226481  6697 leader_election.cc:343] T 7c37d41cd9164c15a6826ca62a851a69 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:07.227005  6921 consensus_queue.cc:260] T d33d5ee8ef6f415593d8df52063161ad P b7ab4784c7344b939bc36f639286f377 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:07.228969  6921 ts_tablet_manager.cc:1434] T d33d5ee8ef6f415593d8df52063161ad P b7ab4784c7344b939bc36f639286f377: Time spent starting tablet: real 0.008s	user 0.004s	sys 0.003s
I20260709 13:18:07.229908  6921 tablet_bootstrap.cc:492] T 7a734b5ab7834e05a8c422208acc58b1 P b7ab4784c7344b939bc36f639286f377: Bootstrap starting.
I20260709 13:18:07.231877  6923 tablet_bootstrap.cc:654] T bd6869f07b5a4885a0b99fbe60c3b175 P ccd8a4c3bfe3413cb2ae219b09aea832: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:07.236719  6921 tablet_bootstrap.cc:654] T 7a734b5ab7834e05a8c422208acc58b1 P b7ab4784c7344b939bc36f639286f377: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:07.239171  7125 raft_consensus.cc:493] T 9b3759de40694069b13c0f8bd40e5709 P b7ab4784c7344b939bc36f639286f377 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:07.239777  7125 raft_consensus.cc:515] T 9b3759de40694069b13c0f8bd40e5709 P b7ab4784c7344b939bc36f639286f377 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:07.245553  6729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b3759de40694069b13c0f8bd40e5709" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:18:07.246338  6729 raft_consensus.cc:2468] T 9b3759de40694069b13c0f8bd40e5709 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 0.
I20260709 13:18:07.248428  7125 leader_election.cc:290] T 9b3759de40694069b13c0f8bd40e5709 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:18:07.248322  6770 leader_election.cc:304] T 9b3759de40694069b13c0f8bd40e5709 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
I20260709 13:18:07.245657  6878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b3759de40694069b13c0f8bd40e5709" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:18:07.220976  6922 raft_consensus.cc:359] T 1528ab62b6fe4e3099d08f141afee116 P cd75a17ab2604397adab03bb8b5fd75c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:07.251164  6922 raft_consensus.cc:385] T 1528ab62b6fe4e3099d08f141afee116 P cd75a17ab2604397adab03bb8b5fd75c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:07.251484  6922 raft_consensus.cc:740] T 1528ab62b6fe4e3099d08f141afee116 P cd75a17ab2604397adab03bb8b5fd75c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cd75a17ab2604397adab03bb8b5fd75c, State: Initialized, Role: FOLLOWER
I20260709 13:18:07.253661  7123 raft_consensus.cc:2804] T 9b3759de40694069b13c0f8bd40e5709 P b7ab4784c7344b939bc36f639286f377 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:18:07.254259  7123 raft_consensus.cc:493] T 9b3759de40694069b13c0f8bd40e5709 P b7ab4784c7344b939bc36f639286f377 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:07.254660  7123 raft_consensus.cc:3060] T 9b3759de40694069b13c0f8bd40e5709 P b7ab4784c7344b939bc36f639286f377 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:18:07.250602  6772 leader_election.cc:343] T 9b3759de40694069b13c0f8bd40e5709 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:07.264966  6922 consensus_queue.cc:260] T 1528ab62b6fe4e3099d08f141afee116 P cd75a17ab2604397adab03bb8b5fd75c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:07.265980  7073 raft_consensus.cc:493] T 1528ab62b6fe4e3099d08f141afee116 P cd75a17ab2604397adab03bb8b5fd75c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:07.266471  7073 raft_consensus.cc:515] T 1528ab62b6fe4e3099d08f141afee116 P cd75a17ab2604397adab03bb8b5fd75c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:07.269268  6923 tablet_bootstrap.cc:492] T bd6869f07b5a4885a0b99fbe60c3b175 P ccd8a4c3bfe3413cb2ae219b09aea832: No bootstrap required, opened a new log
I20260709 13:18:07.269435  6986 consensus_queue.cc:1048] T 853ac0a8cbd64ce99457f170216d4d0f P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:18:07.269989  6923 ts_tablet_manager.cc:1403] T bd6869f07b5a4885a0b99fbe60c3b175 P ccd8a4c3bfe3413cb2ae219b09aea832: Time spent bootstrapping tablet: real 0.052s	user 0.008s	sys 0.009s
I20260709 13:18:07.273728  6729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1528ab62b6fe4e3099d08f141afee116" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:18:07.277165  6923 raft_consensus.cc:359] T bd6869f07b5a4885a0b99fbe60c3b175 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:07.277776  6923 raft_consensus.cc:385] T bd6869f07b5a4885a0b99fbe60c3b175 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:07.278019  6923 raft_consensus.cc:740] T bd6869f07b5a4885a0b99fbe60c3b175 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Initialized, Role: FOLLOWER
I20260709 13:18:07.278616  6923 consensus_queue.cc:260] T bd6869f07b5a4885a0b99fbe60c3b175 P ccd8a4c3bfe3413cb2ae219b09aea832 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:07.280200  7123 raft_consensus.cc:515] T 9b3759de40694069b13c0f8bd40e5709 P b7ab4784c7344b939bc36f639286f377 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:07.282900  6921 tablet_bootstrap.cc:492] T 7a734b5ab7834e05a8c422208acc58b1 P b7ab4784c7344b939bc36f639286f377: No bootstrap required, opened a new log
I20260709 13:18:07.282840  7123 leader_election.cc:290] T 9b3759de40694069b13c0f8bd40e5709 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 1 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:18:07.283761  6921 ts_tablet_manager.cc:1403] T 7a734b5ab7834e05a8c422208acc58b1 P b7ab4784c7344b939bc36f639286f377: Time spent bootstrapping tablet: real 0.054s	user 0.009s	sys 0.017s
I20260709 13:18:07.283664  6807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1528ab62b6fe4e3099d08f141afee116" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:18:07.284101  6880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b3759de40694069b13c0f8bd40e5709" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:18:07.285094  7073 leader_election.cc:290] T 1528ab62b6fe4e3099d08f141afee116 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
W20260709 13:18:07.285593  6772 leader_election.cc:343] T 9b3759de40694069b13c0f8bd40e5709 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:07.285991  6844 leader_election.cc:304] T 1528ab62b6fe4e3099d08f141afee116 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:18:07.287115  6959 raft_consensus.cc:2749] T 1528ab62b6fe4e3099d08f141afee116 P cd75a17ab2604397adab03bb8b5fd75c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:18:07.286710  6921 raft_consensus.cc:359] T 7a734b5ab7834e05a8c422208acc58b1 P b7ab4784c7344b939bc36f639286f377 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:07.287645  6921 raft_consensus.cc:385] T 7a734b5ab7834e05a8c422208acc58b1 P b7ab4784c7344b939bc36f639286f377 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:07.288295  6921 raft_consensus.cc:740] T 7a734b5ab7834e05a8c422208acc58b1 P b7ab4784c7344b939bc36f639286f377 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Initialized, Role: FOLLOWER
I20260709 13:18:07.288432  6729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b3759de40694069b13c0f8bd40e5709" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:18:07.289031  6729 raft_consensus.cc:3060] T 9b3759de40694069b13c0f8bd40e5709 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:07.289204  6921 consensus_queue.cc:260] T 7a734b5ab7834e05a8c422208acc58b1 P b7ab4784c7344b939bc36f639286f377 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
W20260709 13:18:07.289811  6697 consensus_peers.cc:597] T 853ac0a8cbd64ce99457f170216d4d0f P ccd8a4c3bfe3413cb2ae219b09aea832 -> Peer cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931): Couldn't send request to peer cd75a17ab2604397adab03bb8b5fd75c. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:07.291532  6921 ts_tablet_manager.cc:1434] T 7a734b5ab7834e05a8c422208acc58b1 P b7ab4784c7344b939bc36f639286f377: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:18:07.292584  6921 tablet_bootstrap.cc:492] T 3fa34c08b205435dba97346991aa1f92 P b7ab4784c7344b939bc36f639286f377: Bootstrap starting.
I20260709 13:18:07.292851  6628 catalog_manager.cc:5697] T f03d0dbf16864ca4bc1bb5e4c0334c0f P ccd8a4c3bfe3413cb2ae219b09aea832 reported cstate change: term changed from 0 to 1, leader changed from <none> to ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65). New cstate: current_term: 1 leader_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:07.294081  6628 catalog_manager.cc:5697] T 7c37d41cd9164c15a6826ca62a851a69 P ccd8a4c3bfe3413cb2ae219b09aea832 reported cstate change: term changed from 0 to 1, leader changed from <none> to ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65). New cstate: current_term: 1 leader_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:07.296470  6729 raft_consensus.cc:2468] T 9b3759de40694069b13c0f8bd40e5709 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 1.
I20260709 13:18:07.297930  6770 leader_election.cc:304] T 9b3759de40694069b13c0f8bd40e5709 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:18:07.298815  6921 tablet_bootstrap.cc:654] T 3fa34c08b205435dba97346991aa1f92 P b7ab4784c7344b939bc36f639286f377: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:07.299324  7123 raft_consensus.cc:2804] T 9b3759de40694069b13c0f8bd40e5709 P b7ab4784c7344b939bc36f639286f377 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:18:07.299947  6922 ts_tablet_manager.cc:1434] T 1528ab62b6fe4e3099d08f141afee116 P cd75a17ab2604397adab03bb8b5fd75c: Time spent starting tablet: real 0.082s	user 0.008s	sys 0.000s
I20260709 13:18:07.300148  7123 raft_consensus.cc:697] T 9b3759de40694069b13c0f8bd40e5709 P b7ab4784c7344b939bc36f639286f377 [term 1 LEADER]: Becoming Leader. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
I20260709 13:18:07.301311  6922 tablet_bootstrap.cc:492] T 853ac0a8cbd64ce99457f170216d4d0f P cd75a17ab2604397adab03bb8b5fd75c: Bootstrap starting.
I20260709 13:18:07.301123  7123 consensus_queue.cc:237] T 9b3759de40694069b13c0f8bd40e5709 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:07.308460  6923 ts_tablet_manager.cc:1434] T bd6869f07b5a4885a0b99fbe60c3b175 P ccd8a4c3bfe3413cb2ae219b09aea832: Time spent starting tablet: real 0.038s	user 0.006s	sys 0.000s
I20260709 13:18:07.309505  6923 tablet_bootstrap.cc:492] T 7a734b5ab7834e05a8c422208acc58b1 P ccd8a4c3bfe3413cb2ae219b09aea832: Bootstrap starting.
I20260709 13:18:07.314894  6922 tablet_bootstrap.cc:654] T 853ac0a8cbd64ce99457f170216d4d0f P cd75a17ab2604397adab03bb8b5fd75c: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:07.323050  7123 raft_consensus.cc:493] T 7a734b5ab7834e05a8c422208acc58b1 P b7ab4784c7344b939bc36f639286f377 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:07.323623  7123 raft_consensus.cc:515] T 7a734b5ab7834e05a8c422208acc58b1 P b7ab4784c7344b939bc36f639286f377 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:07.331943  6922 tablet_bootstrap.cc:492] T 853ac0a8cbd64ce99457f170216d4d0f P cd75a17ab2604397adab03bb8b5fd75c: No bootstrap required, opened a new log
I20260709 13:18:07.331974  6729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a734b5ab7834e05a8c422208acc58b1" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:18:07.332669  6922 ts_tablet_manager.cc:1403] T 853ac0a8cbd64ce99457f170216d4d0f P cd75a17ab2604397adab03bb8b5fd75c: Time spent bootstrapping tablet: real 0.032s	user 0.012s	sys 0.002s
W20260709 13:18:07.333823  6770 leader_election.cc:343] T 7a734b5ab7834e05a8c422208acc58b1 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:07.334585  6629 catalog_manager.cc:5697] T 9b3759de40694069b13c0f8bd40e5709 P b7ab4784c7344b939bc36f639286f377 reported cstate change: term changed from 0 to 1, leader changed from <none> to b7ab4784c7344b939bc36f639286f377 (127.5.126.66). New cstate: current_term: 1 leader_uuid: "b7ab4784c7344b939bc36f639286f377" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:07.336015  6880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a734b5ab7834e05a8c422208acc58b1" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:18:07.336508  7123 leader_election.cc:290] T 7a734b5ab7834e05a8c422208acc58b1 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
W20260709 13:18:07.337407  6772 leader_election.cc:343] T 7a734b5ab7834e05a8c422208acc58b1 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:07.337869  6772 leader_election.cc:304] T 7a734b5ab7834e05a8c422208acc58b1 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:18:07.336026  6922 raft_consensus.cc:359] T 853ac0a8cbd64ce99457f170216d4d0f P cd75a17ab2604397adab03bb8b5fd75c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:07.338685  6923 tablet_bootstrap.cc:654] T 7a734b5ab7834e05a8c422208acc58b1 P ccd8a4c3bfe3413cb2ae219b09aea832: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:07.338781  6922 raft_consensus.cc:385] T 853ac0a8cbd64ce99457f170216d4d0f P cd75a17ab2604397adab03bb8b5fd75c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:07.339059  7123 raft_consensus.cc:2749] T 7a734b5ab7834e05a8c422208acc58b1 P b7ab4784c7344b939bc36f639286f377 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:18:07.339217  6922 raft_consensus.cc:740] T 853ac0a8cbd64ce99457f170216d4d0f P cd75a17ab2604397adab03bb8b5fd75c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cd75a17ab2604397adab03bb8b5fd75c, State: Initialized, Role: FOLLOWER
I20260709 13:18:07.340269  6922 consensus_queue.cc:260] T 853ac0a8cbd64ce99457f170216d4d0f P cd75a17ab2604397adab03bb8b5fd75c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:07.343277  6922 ts_tablet_manager.cc:1434] T 853ac0a8cbd64ce99457f170216d4d0f P cd75a17ab2604397adab03bb8b5fd75c: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.000s
I20260709 13:18:07.344808  6922 tablet_bootstrap.cc:492] T 8c7f33e544204fbaac4078e3e83bbf4e P cd75a17ab2604397adab03bb8b5fd75c: Bootstrap starting.
I20260709 13:18:07.355321  6922 tablet_bootstrap.cc:654] T 8c7f33e544204fbaac4078e3e83bbf4e P cd75a17ab2604397adab03bb8b5fd75c: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:07.359876  6880 raft_consensus.cc:3060] T 1528ab62b6fe4e3099d08f141afee116 P cd75a17ab2604397adab03bb8b5fd75c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:07.360726  6921 tablet_bootstrap.cc:492] T 3fa34c08b205435dba97346991aa1f92 P b7ab4784c7344b939bc36f639286f377: No bootstrap required, opened a new log
I20260709 13:18:07.361240  6921 ts_tablet_manager.cc:1403] T 3fa34c08b205435dba97346991aa1f92 P b7ab4784c7344b939bc36f639286f377: Time spent bootstrapping tablet: real 0.069s	user 0.015s	sys 0.003s
I20260709 13:18:07.363902  6921 raft_consensus.cc:359] T 3fa34c08b205435dba97346991aa1f92 P b7ab4784c7344b939bc36f639286f377 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:07.364598  6921 raft_consensus.cc:385] T 3fa34c08b205435dba97346991aa1f92 P b7ab4784c7344b939bc36f639286f377 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:07.364867  6921 raft_consensus.cc:740] T 3fa34c08b205435dba97346991aa1f92 P b7ab4784c7344b939bc36f639286f377 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Initialized, Role: FOLLOWER
I20260709 13:18:07.365494  6921 consensus_queue.cc:260] T 3fa34c08b205435dba97346991aa1f92 P b7ab4784c7344b939bc36f639286f377 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:07.367650  6921 ts_tablet_manager.cc:1434] T 3fa34c08b205435dba97346991aa1f92 P b7ab4784c7344b939bc36f639286f377: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:18:07.368561  6921 tablet_bootstrap.cc:492] T dbdf895bba214ff68685a24fd17dfb5d P b7ab4784c7344b939bc36f639286f377: Bootstrap starting.
I20260709 13:18:07.374500  6921 tablet_bootstrap.cc:654] T dbdf895bba214ff68685a24fd17dfb5d P b7ab4784c7344b939bc36f639286f377: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:07.382977  6931 consensus_queue.cc:1048] T 4b8cacb381b746da8d0049b0a83b41dd P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:18:07.385740  6921 tablet_bootstrap.cc:492] T dbdf895bba214ff68685a24fd17dfb5d P b7ab4784c7344b939bc36f639286f377: No bootstrap required, opened a new log
I20260709 13:18:07.386212  6921 ts_tablet_manager.cc:1403] T dbdf895bba214ff68685a24fd17dfb5d P b7ab4784c7344b939bc36f639286f377: Time spent bootstrapping tablet: real 0.018s	user 0.011s	sys 0.004s
I20260709 13:18:07.386790  6922 tablet_bootstrap.cc:492] T 8c7f33e544204fbaac4078e3e83bbf4e P cd75a17ab2604397adab03bb8b5fd75c: No bootstrap required, opened a new log
I20260709 13:18:07.387588  6922 ts_tablet_manager.cc:1403] T 8c7f33e544204fbaac4078e3e83bbf4e P cd75a17ab2604397adab03bb8b5fd75c: Time spent bootstrapping tablet: real 0.043s	user 0.029s	sys 0.009s
I20260709 13:18:07.388818  6921 raft_consensus.cc:359] T dbdf895bba214ff68685a24fd17dfb5d P b7ab4784c7344b939bc36f639286f377 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:07.389514  6921 raft_consensus.cc:385] T dbdf895bba214ff68685a24fd17dfb5d P b7ab4784c7344b939bc36f639286f377 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:07.389767  6921 raft_consensus.cc:740] T dbdf895bba214ff68685a24fd17dfb5d P b7ab4784c7344b939bc36f639286f377 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Initialized, Role: FOLLOWER
I20260709 13:18:07.390400  6921 consensus_queue.cc:260] T dbdf895bba214ff68685a24fd17dfb5d P b7ab4784c7344b939bc36f639286f377 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:07.391258  6922 raft_consensus.cc:359] T 8c7f33e544204fbaac4078e3e83bbf4e P cd75a17ab2604397adab03bb8b5fd75c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:07.392486  6922 raft_consensus.cc:385] T 8c7f33e544204fbaac4078e3e83bbf4e P cd75a17ab2604397adab03bb8b5fd75c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:07.392915  6922 raft_consensus.cc:740] T 8c7f33e544204fbaac4078e3e83bbf4e P cd75a17ab2604397adab03bb8b5fd75c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cd75a17ab2604397adab03bb8b5fd75c, State: Initialized, Role: FOLLOWER
I20260709 13:18:07.393945  6922 consensus_queue.cc:260] T 8c7f33e544204fbaac4078e3e83bbf4e P cd75a17ab2604397adab03bb8b5fd75c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:07.394922  6921 ts_tablet_manager.cc:1434] T dbdf895bba214ff68685a24fd17dfb5d P b7ab4784c7344b939bc36f639286f377: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.001s
I20260709 13:18:07.395886  6921 tablet_bootstrap.cc:492] T bd6869f07b5a4885a0b99fbe60c3b175 P b7ab4784c7344b939bc36f639286f377: Bootstrap starting.
I20260709 13:18:07.397560  6922 ts_tablet_manager.cc:1434] T 8c7f33e544204fbaac4078e3e83bbf4e P cd75a17ab2604397adab03bb8b5fd75c: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.000s
I20260709 13:18:07.399035  6922 tablet_bootstrap.cc:492] T f03d0dbf16864ca4bc1bb5e4c0334c0f P cd75a17ab2604397adab03bb8b5fd75c: Bootstrap starting.
I20260709 13:18:07.405521  6922 tablet_bootstrap.cc:654] T f03d0dbf16864ca4bc1bb5e4c0334c0f P cd75a17ab2604397adab03bb8b5fd75c: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:07.407912  6951 consensus_queue.cc:1048] T 4b8cacb381b746da8d0049b0a83b41dd P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:18:07.408507  7064 raft_consensus.cc:493] T d33d5ee8ef6f415593d8df52063161ad P b7ab4784c7344b939bc36f639286f377 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:07.409265  7064 raft_consensus.cc:515] T d33d5ee8ef6f415593d8df52063161ad P b7ab4784c7344b939bc36f639286f377 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:07.413761  6878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d33d5ee8ef6f415593d8df52063161ad" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:18:07.414703  7101 raft_consensus.cc:493] T 3fa34c08b205435dba97346991aa1f92 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:07.415395  7101 raft_consensus.cc:515] T 3fa34c08b205435dba97346991aa1f92 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:07.416776  6729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d33d5ee8ef6f415593d8df52063161ad" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:18:07.417874  6729 raft_consensus.cc:2468] T d33d5ee8ef6f415593d8df52063161ad P ccd8a4c3bfe3413cb2ae219b09aea832 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 0.
I20260709 13:18:07.418285  7101 leader_election.cc:290] T 3fa34c08b205435dba97346991aa1f92 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:18:07.419256  6770 leader_election.cc:304] T d33d5ee8ef6f415593d8df52063161ad P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
I20260709 13:18:07.420424  7125 raft_consensus.cc:2804] T d33d5ee8ef6f415593d8df52063161ad P b7ab4784c7344b939bc36f639286f377 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:18:07.419256  6921 tablet_bootstrap.cc:654] T bd6869f07b5a4885a0b99fbe60c3b175 P b7ab4784c7344b939bc36f639286f377: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:07.420943  7125 raft_consensus.cc:493] T d33d5ee8ef6f415593d8df52063161ad P b7ab4784c7344b939bc36f639286f377 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:07.421815  7125 raft_consensus.cc:3060] T d33d5ee8ef6f415593d8df52063161ad P b7ab4784c7344b939bc36f639286f377 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:07.420650  6807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fa34c08b205435dba97346991aa1f92" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:18:07.423260  6807 raft_consensus.cc:2468] T 3fa34c08b205435dba97346991aa1f92 P b7ab4784c7344b939bc36f639286f377 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 0.
I20260709 13:18:07.427042  6695 leader_election.cc:304] T 3fa34c08b205435dba97346991aa1f92 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
I20260709 13:18:07.430004  6951 raft_consensus.cc:2804] T 3fa34c08b205435dba97346991aa1f92 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:18:07.430546  6951 raft_consensus.cc:493] T 3fa34c08b205435dba97346991aa1f92 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:07.431035  6951 raft_consensus.cc:3060] T 3fa34c08b205435dba97346991aa1f92 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:07.431725  6878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fa34c08b205435dba97346991aa1f92" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:18:07.411972  7064 leader_election.cc:290] T d33d5ee8ef6f415593d8df52063161ad P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
W20260709 13:18:07.436735  6772 leader_election.cc:343] T d33d5ee8ef6f415593d8df52063161ad P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:18:07.436774  6697 leader_election.cc:343] T 3fa34c08b205435dba97346991aa1f92 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:07.443087  6921 tablet_bootstrap.cc:492] T bd6869f07b5a4885a0b99fbe60c3b175 P b7ab4784c7344b939bc36f639286f377: No bootstrap required, opened a new log
I20260709 13:18:07.443581  6921 ts_tablet_manager.cc:1403] T bd6869f07b5a4885a0b99fbe60c3b175 P b7ab4784c7344b939bc36f639286f377: Time spent bootstrapping tablet: real 0.048s	user 0.009s	sys 0.001s
I20260709 13:18:07.444955  7125 raft_consensus.cc:515] T d33d5ee8ef6f415593d8df52063161ad P b7ab4784c7344b939bc36f639286f377 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:07.446329  6921 raft_consensus.cc:359] T bd6869f07b5a4885a0b99fbe60c3b175 P b7ab4784c7344b939bc36f639286f377 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:07.447115  6921 raft_consensus.cc:385] T bd6869f07b5a4885a0b99fbe60c3b175 P b7ab4784c7344b939bc36f639286f377 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:07.447392  6921 raft_consensus.cc:740] T bd6869f07b5a4885a0b99fbe60c3b175 P b7ab4784c7344b939bc36f639286f377 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Initialized, Role: FOLLOWER
I20260709 13:18:07.448307  6729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d33d5ee8ef6f415593d8df52063161ad" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:18:07.452762  6729 raft_consensus.cc:3060] T d33d5ee8ef6f415593d8df52063161ad P ccd8a4c3bfe3413cb2ae219b09aea832 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:07.461402  7073 raft_consensus.cc:493] T 8c7f33e544204fbaac4078e3e83bbf4e P cd75a17ab2604397adab03bb8b5fd75c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:07.448112  6921 consensus_queue.cc:260] T bd6869f07b5a4885a0b99fbe60c3b175 P b7ab4784c7344b939bc36f639286f377 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:07.462059  7073 raft_consensus.cc:515] T 8c7f33e544204fbaac4078e3e83bbf4e P cd75a17ab2604397adab03bb8b5fd75c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:07.464107  6921 ts_tablet_manager.cc:1434] T bd6869f07b5a4885a0b99fbe60c3b175 P b7ab4784c7344b939bc36f639286f377: Time spent starting tablet: real 0.020s	user 0.009s	sys 0.000s
I20260709 13:18:07.464985  7073 leader_election.cc:290] T 8c7f33e544204fbaac4078e3e83bbf4e P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:18:07.465263  6921 tablet_bootstrap.cc:492] T bb3d8792045a4583ae2e965b1350a5b4 P b7ab4784c7344b939bc36f639286f377: Bootstrap starting.
I20260709 13:18:07.467514  6730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c7f33e544204fbaac4078e3e83bbf4e" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:18:07.467944  6807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c7f33e544204fbaac4078e3e83bbf4e" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:18:07.468721  6730 raft_consensus.cc:2393] T 8c7f33e544204fbaac4078e3e83bbf4e P ccd8a4c3bfe3413cb2ae219b09aea832 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c in current term 1: Already voted for candidate b7ab4784c7344b939bc36f639286f377 in this term.
I20260709 13:18:07.470399  6844 leader_election.cc:304] T 8c7f33e544204fbaac4078e3e83bbf4e P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:18:07.471513  7073 raft_consensus.cc:3060] T 8c7f33e544204fbaac4078e3e83bbf4e P cd75a17ab2604397adab03bb8b5fd75c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:07.475594  6729 raft_consensus.cc:2468] T d33d5ee8ef6f415593d8df52063161ad P ccd8a4c3bfe3413cb2ae219b09aea832 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 1.
I20260709 13:18:07.479935  7073 raft_consensus.cc:2749] T 8c7f33e544204fbaac4078e3e83bbf4e P cd75a17ab2604397adab03bb8b5fd75c [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:18:07.482882  6921 tablet_bootstrap.cc:654] T bb3d8792045a4583ae2e965b1350a5b4 P b7ab4784c7344b939bc36f639286f377: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:07.484369  6959 raft_consensus.cc:493] T ce4f062dcd314d43a63ca74067cb5ee3 P cd75a17ab2604397adab03bb8b5fd75c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:07.484967  6959 raft_consensus.cc:515] T ce4f062dcd314d43a63ca74067cb5ee3 P cd75a17ab2604397adab03bb8b5fd75c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:07.485294  6951 raft_consensus.cc:515] T 3fa34c08b205435dba97346991aa1f92 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:07.486392  7123 consensus_queue.cc:1048] T 8c7f33e544204fbaac4078e3e83bbf4e P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:18:07.487494  6959 leader_election.cc:290] T ce4f062dcd314d43a63ca74067cb5ee3 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:18:07.488945  6876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fa34c08b205435dba97346991aa1f92" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:18:07.489758  6730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce4f062dcd314d43a63ca74067cb5ee3" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
W20260709 13:18:07.491413  6697 leader_election.cc:343] T 3fa34c08b205435dba97346991aa1f92 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:07.495424  6807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce4f062dcd314d43a63ca74067cb5ee3" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:18:07.496322  6921 tablet_bootstrap.cc:492] T bb3d8792045a4583ae2e965b1350a5b4 P b7ab4784c7344b939bc36f639286f377: No bootstrap required, opened a new log
I20260709 13:18:07.496784  6921 ts_tablet_manager.cc:1403] T bb3d8792045a4583ae2e965b1350a5b4 P b7ab4784c7344b939bc36f639286f377: Time spent bootstrapping tablet: real 0.032s	user 0.006s	sys 0.006s
I20260709 13:18:07.496903  6844 leader_election.cc:304] T ce4f062dcd314d43a63ca74067cb5ee3 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:18:07.498023  6959 raft_consensus.cc:2749] T ce4f062dcd314d43a63ca74067cb5ee3 P cd75a17ab2604397adab03bb8b5fd75c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:18:07.498629  6951 leader_election.cc:290] T 3fa34c08b205435dba97346991aa1f92 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 1 election: Requested vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:18:07.499333  6921 raft_consensus.cc:359] T bb3d8792045a4583ae2e965b1350a5b4 P b7ab4784c7344b939bc36f639286f377 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:07.500012  6921 raft_consensus.cc:385] T bb3d8792045a4583ae2e965b1350a5b4 P b7ab4784c7344b939bc36f639286f377 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:07.500384  6921 raft_consensus.cc:740] T bb3d8792045a4583ae2e965b1350a5b4 P b7ab4784c7344b939bc36f639286f377 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Initialized, Role: FOLLOWER
I20260709 13:18:07.501012  6806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fa34c08b205435dba97346991aa1f92" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:18:07.501111  6921 consensus_queue.cc:260] T bb3d8792045a4583ae2e965b1350a5b4 P b7ab4784c7344b939bc36f639286f377 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:07.501734  6806 raft_consensus.cc:3060] T 3fa34c08b205435dba97346991aa1f92 P b7ab4784c7344b939bc36f639286f377 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:07.503294  6921 ts_tablet_manager.cc:1434] T bb3d8792045a4583ae2e965b1350a5b4 P b7ab4784c7344b939bc36f639286f377: Time spent starting tablet: real 0.006s	user 0.001s	sys 0.003s
I20260709 13:18:07.504479  6921 tablet_bootstrap.cc:492] T 3d65025eea89441290d85dd053810e31 P b7ab4784c7344b939bc36f639286f377: Bootstrap starting.
I20260709 13:18:07.508176  7064 consensus_queue.cc:1048] T 8c7f33e544204fbaac4078e3e83bbf4e P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:18:07.509388  7101 consensus_queue.cc:1048] T 44bde925b2e541b69890d70715b85176 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:18:07.510239  6921 tablet_bootstrap.cc:654] T 3d65025eea89441290d85dd053810e31 P b7ab4784c7344b939bc36f639286f377: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:07.510843  6986 raft_consensus.cc:493] T 4f00a2e87e56452083b759f60d461ee3 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:18:07.515653  7125 leader_election.cc:290] T d33d5ee8ef6f415593d8df52063161ad P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 1 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:18:07.511524  6986 raft_consensus.cc:515] T 4f00a2e87e56452083b759f60d461ee3 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:07.518740  6986 leader_election.cc:290] T 4f00a2e87e56452083b759f60d461ee3 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:18:07.523252  6881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d33d5ee8ef6f415593d8df52063161ad" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
W20260709 13:18:07.524935  6772 leader_election.cc:343] T d33d5ee8ef6f415593d8df52063161ad P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:07.525749  6921 tablet_bootstrap.cc:492] T 3d65025eea89441290d85dd053810e31 P b7ab4784c7344b939bc36f639286f377: No bootstrap required, opened a new log
I20260709 13:18:07.526280  6921 ts_tablet_manager.cc:1403] T 3d65025eea89441290d85dd053810e31 P b7ab4784c7344b939bc36f639286f377: Time spent bootstrapping tablet: real 0.022s	user 0.012s	sys 0.002s
I20260709 13:18:07.527312  6881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f00a2e87e56452083b759f60d461ee3" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:18:07.528339  6881 raft_consensus.cc:2393] T 4f00a2e87e56452083b759f60d461ee3 P cd75a17ab2604397adab03bb8b5fd75c [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ccd8a4c3bfe3413cb2ae219b09aea832 in current term 2: Already voted for candidate cd75a17ab2604397adab03bb8b5fd75c in this term.
I20260709 13:18:07.529145  6921 raft_consensus.cc:359] T 3d65025eea89441290d85dd053810e31 P b7ab4784c7344b939bc36f639286f377 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:07.529898  6921 raft_consensus.cc:385] T 3d65025eea89441290d85dd053810e31 P b7ab4784c7344b939bc36f639286f377 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:07.530180  6921 raft_consensus.cc:740] T 3d65025eea89441290d85dd053810e31 P b7ab4784c7344b939bc36f639286f377 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Initialized, Role: FOLLOWER
I20260709 13:18:07.530211  6770 leader_election.cc:304] T d33d5ee8ef6f415593d8df52063161ad P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:18:07.530942  6922 tablet_bootstrap.cc:492] T f03d0dbf16864ca4bc1bb5e4c0334c0f P cd75a17ab2604397adab03bb8b5fd75c: No bootstrap required, opened a new log
I20260709 13:18:07.531030  6921 consensus_queue.cc:260] T 3d65025eea89441290d85dd053810e31 P b7ab4784c7344b939bc36f639286f377 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:07.531603  6922 ts_tablet_manager.cc:1403] T f03d0dbf16864ca4bc1bb5e4c0334c0f P cd75a17ab2604397adab03bb8b5fd75c: Time spent bootstrapping tablet: real 0.133s	user 0.042s	sys 0.027s
I20260709 13:18:07.531620  7125 raft_consensus.cc:2804] T d33d5ee8ef6f415593d8df52063161ad P b7ab4784c7344b939bc36f639286f377 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:18:07.533092  6921 ts_tablet_manager.cc:1434] T 3d65025eea89441290d85dd053810e31 P b7ab4784c7344b939bc36f639286f377: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:18:07.533191  7125 raft_consensus.cc:697] T d33d5ee8ef6f415593d8df52063161ad P b7ab4784c7344b939bc36f639286f377 [term 1 LEADER]: Becoming Leader. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
I20260709 13:18:07.534188  6921 tablet_bootstrap.cc:492] T f5be3a11b23d4ea9b08300a2789821c7 P b7ab4784c7344b939bc36f639286f377: Bootstrap starting.
I20260709 13:18:07.535549  6922 raft_consensus.cc:359] T f03d0dbf16864ca4bc1bb5e4c0334c0f P cd75a17ab2604397adab03bb8b5fd75c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:07.536485  6922 raft_consensus.cc:385] T f03d0dbf16864ca4bc1bb5e4c0334c0f P cd75a17ab2604397adab03bb8b5fd75c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:07.536888  6922 raft_consensus.cc:740] T f03d0dbf16864ca4bc1bb5e4c0334c0f P cd75a17ab2604397adab03bb8b5fd75c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cd75a17ab2604397adab03bb8b5fd75c, State: Initialized, Role: FOLLOWER
I20260709 13:18:07.537395  7125 consensus_queue.cc:237] T d33d5ee8ef6f415593d8df52063161ad P b7ab4784c7344b939bc36f639286f377 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:07.537819  6922 consensus_queue.cc:260] T f03d0dbf16864ca4bc1bb5e4c0334c0f P cd75a17ab2604397adab03bb8b5fd75c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:07.541464  6921 tablet_bootstrap.cc:654] T f5be3a11b23d4ea9b08300a2789821c7 P b7ab4784c7344b939bc36f639286f377: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:07.542433  6806 raft_consensus.cc:2468] T 3fa34c08b205435dba97346991aa1f92 P b7ab4784c7344b939bc36f639286f377 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 1.
I20260709 13:18:07.543493  6923 tablet_bootstrap.cc:492] T 7a734b5ab7834e05a8c422208acc58b1 P ccd8a4c3bfe3413cb2ae219b09aea832: No bootstrap required, opened a new log
I20260709 13:18:07.545096  6923 ts_tablet_manager.cc:1403] T 7a734b5ab7834e05a8c422208acc58b1 P ccd8a4c3bfe3413cb2ae219b09aea832: Time spent bootstrapping tablet: real 0.236s	user 0.017s	sys 0.032s
I20260709 13:18:07.546756  6959 raft_consensus.cc:493] T f03d0dbf16864ca4bc1bb5e4c0334c0f P cd75a17ab2604397adab03bb8b5fd75c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:07.547456  6959 raft_consensus.cc:515] T f03d0dbf16864ca4bc1bb5e4c0334c0f P cd75a17ab2604397adab03bb8b5fd75c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:07.548249  6922 ts_tablet_manager.cc:1434] T f03d0dbf16864ca4bc1bb5e4c0334c0f P cd75a17ab2604397adab03bb8b5fd75c: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.000s
I20260709 13:18:07.550107  6959 leader_election.cc:290] T f03d0dbf16864ca4bc1bb5e4c0334c0f P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:18:07.551332  6806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f03d0dbf16864ca4bc1bb5e4c0334c0f" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:18:07.552285  6806 raft_consensus.cc:2393] T f03d0dbf16864ca4bc1bb5e4c0334c0f P b7ab4784c7344b939bc36f639286f377 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c in current term 1: Already voted for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in this term.
I20260709 13:18:07.552579  6921 tablet_bootstrap.cc:492] T f5be3a11b23d4ea9b08300a2789821c7 P b7ab4784c7344b939bc36f639286f377: No bootstrap required, opened a new log
I20260709 13:18:07.553328  6921 ts_tablet_manager.cc:1403] T f5be3a11b23d4ea9b08300a2789821c7 P b7ab4784c7344b939bc36f639286f377: Time spent bootstrapping tablet: real 0.019s	user 0.015s	sys 0.003s
I20260709 13:18:07.556562  6922 tablet_bootstrap.cc:492] T 7c37d41cd9164c15a6826ca62a851a69 P cd75a17ab2604397adab03bb8b5fd75c: Bootstrap starting.
I20260709 13:18:07.556547  6921 raft_consensus.cc:359] T f5be3a11b23d4ea9b08300a2789821c7 P b7ab4784c7344b939bc36f639286f377 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:07.561551  6921 raft_consensus.cc:385] T f5be3a11b23d4ea9b08300a2789821c7 P b7ab4784c7344b939bc36f639286f377 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:07.561920  6921 raft_consensus.cc:740] T f5be3a11b23d4ea9b08300a2789821c7 P b7ab4784c7344b939bc36f639286f377 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Initialized, Role: FOLLOWER
I20260709 13:18:07.562841  6921 consensus_queue.cc:260] T f5be3a11b23d4ea9b08300a2789821c7 P b7ab4784c7344b939bc36f639286f377 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:07.563951  6922 tablet_bootstrap.cc:654] T 7c37d41cd9164c15a6826ca62a851a69 P cd75a17ab2604397adab03bb8b5fd75c: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:07.566074  6921 ts_tablet_manager.cc:1434] T f5be3a11b23d4ea9b08300a2789821c7 P b7ab4784c7344b939bc36f639286f377: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.000s
W20260709 13:18:07.612067  6697 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 67808.8us
I20260709 13:18:07.618245  6806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f00a2e87e56452083b759f60d461ee3" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:18:07.622321  6729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f03d0dbf16864ca4bc1bb5e4c0334c0f" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:18:07.620436  6806 raft_consensus.cc:2468] T 4f00a2e87e56452083b759f60d461ee3 P b7ab4784c7344b939bc36f639286f377 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 2.
I20260709 13:18:07.624631  6921 tablet_bootstrap.cc:492] T fe20b4b48823486ca3b9c648db6ce8aa P b7ab4784c7344b939bc36f639286f377: Bootstrap starting.
I20260709 13:18:07.632299  6695 leader_election.cc:304] T 3fa34c08b205435dba97346991aa1f92 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:18:07.634974  6695 leader_election.cc:304] T 4f00a2e87e56452083b759f60d461ee3 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:18:07.636107  6844 leader_election.cc:304] T f03d0dbf16864ca4bc1bb5e4c0334c0f P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:18:07.638321  6931 raft_consensus.cc:2804] T 3fa34c08b205435dba97346991aa1f92 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:18:07.639496  6931 raft_consensus.cc:697] T 3fa34c08b205435dba97346991aa1f92 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 1 LEADER]: Becoming Leader. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
I20260709 13:18:07.639930  6959 raft_consensus.cc:3060] T f03d0dbf16864ca4bc1bb5e4c0334c0f P cd75a17ab2604397adab03bb8b5fd75c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:07.640547  6984 raft_consensus.cc:2804] T 4f00a2e87e56452083b759f60d461ee3 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:18:07.654016  6984 raft_consensus.cc:493] T 4f00a2e87e56452083b759f60d461ee3 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 1 FOLLOWER]: Starting leader election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:18:07.654701  6984 raft_consensus.cc:3060] T 4f00a2e87e56452083b759f60d461ee3 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:07.651446  6923 raft_consensus.cc:359] T 7a734b5ab7834e05a8c422208acc58b1 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:07.661031  6923 raft_consensus.cc:385] T 7a734b5ab7834e05a8c422208acc58b1 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:07.661603  6923 raft_consensus.cc:740] T 7a734b5ab7834e05a8c422208acc58b1 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Initialized, Role: FOLLOWER
I20260709 13:18:07.662827  6923 consensus_queue.cc:260] T 7a734b5ab7834e05a8c422208acc58b1 P ccd8a4c3bfe3413cb2ae219b09aea832 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:07.666541  6931 consensus_queue.cc:237] T 3fa34c08b205435dba97346991aa1f92 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:07.673470  7125 raft_consensus.cc:493] T 3d65025eea89441290d85dd053810e31 P b7ab4784c7344b939bc36f639286f377 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:07.690640  7123 raft_consensus.cc:493] T bb3d8792045a4583ae2e965b1350a5b4 P b7ab4784c7344b939bc36f639286f377 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:07.691573  7123 raft_consensus.cc:515] T bb3d8792045a4583ae2e965b1350a5b4 P b7ab4784c7344b939bc36f639286f377 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:07.696614  6951 consensus_queue.cc:1048] T 44bde925b2e541b69890d70715b85176 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:18:07.686195  7125 raft_consensus.cc:515] T 3d65025eea89441290d85dd053810e31 P b7ab4784c7344b939bc36f639286f377 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:07.707564  6984 raft_consensus.cc:515] T 4f00a2e87e56452083b759f60d461ee3 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:07.723057  6730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d65025eea89441290d85dd053810e31" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:18:07.723999  7125 leader_election.cc:290] T 3d65025eea89441290d85dd053810e31 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:18:07.731963  6984 leader_election.cc:290] T 4f00a2e87e56452083b759f60d461ee3 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 2 election: Requested vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:18:07.741096  6959 raft_consensus.cc:2749] T f03d0dbf16864ca4bc1bb5e4c0334c0f P cd75a17ab2604397adab03bb8b5fd75c [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:18:07.744807  6951 raft_consensus.cc:493] T 7a734b5ab7834e05a8c422208acc58b1 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:07.745898  6951 raft_consensus.cc:515] T 7a734b5ab7834e05a8c422208acc58b1 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
W20260709 13:18:07.751166  6697 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 98018us
I20260709 13:18:07.725572  7123 leader_election.cc:290] T bb3d8792045a4583ae2e965b1350a5b4 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
W20260709 13:18:07.768476  6770 leader_election.cc:343] T 3d65025eea89441290d85dd053810e31 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:07.769068  7020 consensus_queue.cc:1048] T 9b3759de40694069b13c0f8bd40e5709 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:18:07.750505  6951 leader_election.cc:290] T 7a734b5ab7834e05a8c422208acc58b1 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:18:07.778887  6878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d65025eea89441290d85dd053810e31" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:18:07.788904  6923 ts_tablet_manager.cc:1434] T 7a734b5ab7834e05a8c422208acc58b1 P ccd8a4c3bfe3413cb2ae219b09aea832: Time spent starting tablet: real 0.243s	user 0.009s	sys 0.004s
I20260709 13:18:07.798164  6878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f00a2e87e56452083b759f60d461ee3" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:18:07.799481  6878 raft_consensus.cc:2393] T 4f00a2e87e56452083b759f60d461ee3 P cd75a17ab2604397adab03bb8b5fd75c [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate ccd8a4c3bfe3413cb2ae219b09aea832 in current term 2: Already voted for candidate cd75a17ab2604397adab03bb8b5fd75c in this term.
I20260709 13:18:07.774705  6729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3d8792045a4583ae2e965b1350a5b4" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
W20260709 13:18:07.804143  6695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 120628us
I20260709 13:18:07.810993  6878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3d8792045a4583ae2e965b1350a5b4" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:18:07.811722  6880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a734b5ab7834e05a8c422208acc58b1" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:18:07.815307  6879 raft_consensus.cc:3060] T ce4f062dcd314d43a63ca74067cb5ee3 P cd75a17ab2604397adab03bb8b5fd75c [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:18:07.815879  6772 leader_election.cc:343] T 3d65025eea89441290d85dd053810e31 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:07.816521  6772 leader_election.cc:304] T 3d65025eea89441290d85dd053810e31 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
W20260709 13:18:07.818186  6772 leader_election.cc:343] T bb3d8792045a4583ae2e965b1350a5b4 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:07.827978  7064 raft_consensus.cc:2749] T 3d65025eea89441290d85dd053810e31 P b7ab4784c7344b939bc36f639286f377 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:18:07.830446  6921 tablet_bootstrap.cc:654] T fe20b4b48823486ca3b9c648db6ce8aa P b7ab4784c7344b939bc36f639286f377: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:07.832238  6923 tablet_bootstrap.cc:492] T dbdf895bba214ff68685a24fd17dfb5d P ccd8a4c3bfe3413cb2ae219b09aea832: Bootstrap starting.
I20260709 13:18:07.835211  6959 raft_consensus.cc:493] T 853ac0a8cbd64ce99457f170216d4d0f P cd75a17ab2604397adab03bb8b5fd75c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:07.836184  6959 raft_consensus.cc:515] T 853ac0a8cbd64ce99457f170216d4d0f P cd75a17ab2604397adab03bb8b5fd75c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:07.839095  6959 leader_election.cc:290] T 853ac0a8cbd64ce99457f170216d4d0f P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:18:07.840610  6731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "853ac0a8cbd64ce99457f170216d4d0f" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:18:07.843824  7020 consensus_queue.cc:1048] T de3186201e1a40d0b335eeb8b4e256e0 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:18:07.845830  7019 consensus_queue.cc:1048] T f03d0dbf16864ca4bc1bb5e4c0334c0f P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:18:07.845702  6629 catalog_manager.cc:5697] T d33d5ee8ef6f415593d8df52063161ad P b7ab4784c7344b939bc36f639286f377 reported cstate change: term changed from 0 to 1, leader changed from <none> to b7ab4784c7344b939bc36f639286f377 (127.5.126.66). New cstate: current_term: 1 leader_uuid: "b7ab4784c7344b939bc36f639286f377" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } health_report { overall_health: UNKNOWN } } }
W20260709 13:18:07.847519  6772 consensus_peers.cc:597] T 9b3759de40694069b13c0f8bd40e5709 P b7ab4784c7344b939bc36f639286f377 -> Peer cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931): Couldn't send request to peer cd75a17ab2604397adab03bb8b5fd75c. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:18:07.848481  6697 leader_election.cc:343] T 7a734b5ab7834e05a8c422208acc58b1 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:07.852353  6922 tablet_bootstrap.cc:492] T 7c37d41cd9164c15a6826ca62a851a69 P cd75a17ab2604397adab03bb8b5fd75c: No bootstrap required, opened a new log
W20260709 13:18:07.850049  6772 consensus_peers.cc:597] T de3186201e1a40d0b335eeb8b4e256e0 P b7ab4784c7344b939bc36f639286f377 -> Peer cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931): Couldn't send request to peer cd75a17ab2604397adab03bb8b5fd75c. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:07.853395  6922 ts_tablet_manager.cc:1403] T 7c37d41cd9164c15a6826ca62a851a69 P cd75a17ab2604397adab03bb8b5fd75c: Time spent bootstrapping tablet: real 0.297s	user 0.063s	sys 0.048s
W20260709 13:18:07.855615  6770 leader_election.cc:343] T bb3d8792045a4583ae2e965b1350a5b4 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:07.860262  6770 leader_election.cc:304] T bb3d8792045a4583ae2e965b1350a5b4 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:18:07.861727  7020 raft_consensus.cc:2749] T bb3d8792045a4583ae2e965b1350a5b4 P b7ab4784c7344b939bc36f639286f377 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:18:07.862318  6876 raft_consensus.cc:3060] T 853ac0a8cbd64ce99457f170216d4d0f P cd75a17ab2604397adab03bb8b5fd75c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:07.867815  6805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "853ac0a8cbd64ce99457f170216d4d0f" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:18:07.881158  7020 raft_consensus.cc:493] T dbdf895bba214ff68685a24fd17dfb5d P b7ab4784c7344b939bc36f639286f377 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:07.882133  7020 raft_consensus.cc:515] T dbdf895bba214ff68685a24fd17dfb5d P b7ab4784c7344b939bc36f639286f377 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:07.905893  6844 leader_election.cc:304] T 853ac0a8cbd64ce99457f170216d4d0f P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:18:07.914187  7073 raft_consensus.cc:493] T 4f00a2e87e56452083b759f60d461ee3 P cd75a17ab2604397adab03bb8b5fd75c [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:07.914942  7073 raft_consensus.cc:515] T 4f00a2e87e56452083b759f60d461ee3 P cd75a17ab2604397adab03bb8b5fd75c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
W20260709 13:18:07.918696  6697 consensus_peers.cc:597] T 7c37d41cd9164c15a6826ca62a851a69 P ccd8a4c3bfe3413cb2ae219b09aea832 -> Peer cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931): Couldn't send request to peer cd75a17ab2604397adab03bb8b5fd75c. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:07.918875  7073 leader_election.cc:290] T 4f00a2e87e56452083b759f60d461ee3 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:18:07.921427  6732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f00a2e87e56452083b759f60d461ee3" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:18:07.922469  6732 raft_consensus.cc:2468] T 4f00a2e87e56452083b759f60d461ee3 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 2.
I20260709 13:18:07.924400  6804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a734b5ab7834e05a8c422208acc58b1" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:18:07.925616  7020 leader_election.cc:290] T dbdf895bba214ff68685a24fd17dfb5d P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:18:07.925534  6804 raft_consensus.cc:2468] T 7a734b5ab7834e05a8c422208acc58b1 P b7ab4784c7344b939bc36f639286f377 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 0.
I20260709 13:18:07.930908  6844 leader_election.cc:304] T 4f00a2e87e56452083b759f60d461ee3 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:18:07.930963  6806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f00a2e87e56452083b759f60d461ee3" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:18:07.932222  7020 raft_consensus.cc:493] T bd6869f07b5a4885a0b99fbe60c3b175 P b7ab4784c7344b939bc36f639286f377 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:07.933866  7020 raft_consensus.cc:515] T bd6869f07b5a4885a0b99fbe60c3b175 P b7ab4784c7344b939bc36f639286f377 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:07.937335  7073 raft_consensus.cc:2804] T 4f00a2e87e56452083b759f60d461ee3 P cd75a17ab2604397adab03bb8b5fd75c [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:18:07.937960  7073 raft_consensus.cc:493] T 4f00a2e87e56452083b759f60d461ee3 P cd75a17ab2604397adab03bb8b5fd75c [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:07.938434  7073 raft_consensus.cc:3060] T 4f00a2e87e56452083b759f60d461ee3 P cd75a17ab2604397adab03bb8b5fd75c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:07.949322  6922 raft_consensus.cc:359] T 7c37d41cd9164c15a6826ca62a851a69 P cd75a17ab2604397adab03bb8b5fd75c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:07.950670  6922 raft_consensus.cc:385] T 7c37d41cd9164c15a6826ca62a851a69 P cd75a17ab2604397adab03bb8b5fd75c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:07.951082  6922 raft_consensus.cc:740] T 7c37d41cd9164c15a6826ca62a851a69 P cd75a17ab2604397adab03bb8b5fd75c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cd75a17ab2604397adab03bb8b5fd75c, State: Initialized, Role: FOLLOWER
I20260709 13:18:07.953140  6922 consensus_queue.cc:260] T 7c37d41cd9164c15a6826ca62a851a69 P cd75a17ab2604397adab03bb8b5fd75c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:07.958425  6729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbdf895bba214ff68685a24fd17dfb5d" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:18:07.961642  6986 raft_consensus.cc:493] T bd6869f07b5a4885a0b99fbe60c3b175 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:07.962359  6986 raft_consensus.cc:515] T bd6869f07b5a4885a0b99fbe60c3b175 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:07.972007  6806 raft_consensus.cc:2468] T 4f00a2e87e56452083b759f60d461ee3 P b7ab4784c7344b939bc36f639286f377 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 2.
I20260709 13:18:07.975975  6921 tablet_bootstrap.cc:492] T fe20b4b48823486ca3b9c648db6ce8aa P b7ab4784c7344b939bc36f639286f377: No bootstrap required, opened a new log
I20260709 13:18:07.976660  6921 ts_tablet_manager.cc:1403] T fe20b4b48823486ca3b9c648db6ce8aa P b7ab4784c7344b939bc36f639286f377: Time spent bootstrapping tablet: real 0.353s	user 0.020s	sys 0.005s
I20260709 13:18:07.984861  6878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6869f07b5a4885a0b99fbe60c3b175" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:18:07.987856  6986 leader_election.cc:290] T bd6869f07b5a4885a0b99fbe60c3b175 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:18:07.989107  6921 raft_consensus.cc:359] T fe20b4b48823486ca3b9c648db6ce8aa P b7ab4784c7344b939bc36f639286f377 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:07.990216  6878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6869f07b5a4885a0b99fbe60c3b175" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
W20260709 13:18:07.992339  6770 leader_election.cc:343] T dbdf895bba214ff68685a24fd17dfb5d P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:18:07.992352  6697 leader_election.cc:343] T bd6869f07b5a4885a0b99fbe60c3b175 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:07.990188  6880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbdf895bba214ff68685a24fd17dfb5d" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:18:07.990171  6921 raft_consensus.cc:385] T fe20b4b48823486ca3b9c648db6ce8aa P b7ab4784c7344b939bc36f639286f377 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:07.996744  6806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f00a2e87e56452083b759f60d461ee3" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:18:07.997548  6921 raft_consensus.cc:740] T fe20b4b48823486ca3b9c648db6ce8aa P b7ab4784c7344b939bc36f639286f377 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Initialized, Role: FOLLOWER
I20260709 13:18:07.998756  6957 raft_consensus.cc:493] T f5be3a11b23d4ea9b08300a2789821c7 P b7ab4784c7344b939bc36f639286f377 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:07.998670  7150 consensus_queue.cc:1048] T 7c37d41cd9164c15a6826ca62a851a69 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260709 13:18:07.999477  6957 raft_consensus.cc:515] T f5be3a11b23d4ea9b08300a2789821c7 P b7ab4784c7344b939bc36f639286f377 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
W20260709 13:18:07.985442  6772 consensus_peers.cc:597] T d33d5ee8ef6f415593d8df52063161ad P b7ab4784c7344b939bc36f639286f377 -> Peer cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931): Couldn't send request to peer cd75a17ab2604397adab03bb8b5fd75c. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:18:08.001572  6772 leader_election.cc:343] T bd6869f07b5a4885a0b99fbe60c3b175 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:18:08.002453  6772 leader_election.cc:343] T dbdf895bba214ff68685a24fd17dfb5d P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:08.003010  6772 leader_election.cc:304] T dbdf895bba214ff68685a24fd17dfb5d P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:18:08.004004  7123 raft_consensus.cc:2749] T dbdf895bba214ff68685a24fd17dfb5d P b7ab4784c7344b939bc36f639286f377 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:18:08.004320  6921 consensus_queue.cc:260] T fe20b4b48823486ca3b9c648db6ce8aa P b7ab4784c7344b939bc36f639286f377 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:07.997987  6806 raft_consensus.cc:2468] T 4f00a2e87e56452083b759f60d461ee3 P b7ab4784c7344b939bc36f639286f377 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 2.
I20260709 13:18:08.010316  6957 leader_election.cc:290] T f5be3a11b23d4ea9b08300a2789821c7 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:18:08.010931  6923 tablet_bootstrap.cc:654] T dbdf895bba214ff68685a24fd17dfb5d P ccd8a4c3bfe3413cb2ae219b09aea832: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:07.980844  7020 leader_election.cc:290] T bd6869f07b5a4885a0b99fbe60c3b175 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:18:07.995839  6695 leader_election.cc:304] T 7a734b5ab7834e05a8c422208acc58b1 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:18:08.024219  6880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5be3a11b23d4ea9b08300a2789821c7" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:18:08.025969  6729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6869f07b5a4885a0b99fbe60c3b175" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:18:08.026916  6729 raft_consensus.cc:2468] T bd6869f07b5a4885a0b99fbe60c3b175 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 0.
I20260709 13:18:08.031265  6922 ts_tablet_manager.cc:1434] T 7c37d41cd9164c15a6826ca62a851a69 P cd75a17ab2604397adab03bb8b5fd75c: Time spent starting tablet: real 0.177s	user 0.012s	sys 0.006s
I20260709 13:18:08.040776  6921 ts_tablet_manager.cc:1434] T fe20b4b48823486ca3b9c648db6ce8aa P b7ab4784c7344b939bc36f639286f377: Time spent starting tablet: real 0.064s	user 0.010s	sys 0.000s
I20260709 13:18:08.042109  6922 tablet_bootstrap.cc:492] T d33d5ee8ef6f415593d8df52063161ad P cd75a17ab2604397adab03bb8b5fd75c: Bootstrap starting.
I20260709 13:18:08.043020  6921 tablet_bootstrap.cc:492] T a1704639a875409b9959353527b3fd68 P b7ab4784c7344b939bc36f639286f377: Bootstrap starting.
I20260709 13:18:08.030885  7150 raft_consensus.cc:2804] T 7a734b5ab7834e05a8c422208acc58b1 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:18:08.047598  7150 raft_consensus.cc:493] T 7a734b5ab7834e05a8c422208acc58b1 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:08.052732  7150 raft_consensus.cc:3060] T 7a734b5ab7834e05a8c422208acc58b1 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:18:08.035743  6772 leader_election.cc:343] T f5be3a11b23d4ea9b08300a2789821c7 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:08.060227  6807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6869f07b5a4885a0b99fbe60c3b175" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:18:08.061105  6807 raft_consensus.cc:2468] T bd6869f07b5a4885a0b99fbe60c3b175 P b7ab4784c7344b939bc36f639286f377 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 0.
I20260709 13:18:08.073093  6695 leader_election.cc:304] T 4f00a2e87e56452083b759f60d461ee3 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:18:08.074172  6951 raft_consensus.cc:2804] T 4f00a2e87e56452083b759f60d461ee3 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:18:08.074887  6770 leader_election.cc:304] T bd6869f07b5a4885a0b99fbe60c3b175 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:18:08.069290  6729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5be3a11b23d4ea9b08300a2789821c7" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:18:08.077087  6951 raft_consensus.cc:697] T 4f00a2e87e56452083b759f60d461ee3 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 2 LEADER]: Becoming Leader. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
I20260709 13:18:08.078168  6957 raft_consensus.cc:2804] T bd6869f07b5a4885a0b99fbe60c3b175 P b7ab4784c7344b939bc36f639286f377 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:18:08.080654  6957 raft_consensus.cc:493] T bd6869f07b5a4885a0b99fbe60c3b175 P b7ab4784c7344b939bc36f639286f377 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:08.082777  6957 raft_consensus.cc:3060] T bd6869f07b5a4885a0b99fbe60c3b175 P b7ab4784c7344b939bc36f639286f377 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:18:08.090791  6697 consensus_peers.cc:597] T 3fa34c08b205435dba97346991aa1f92 P ccd8a4c3bfe3413cb2ae219b09aea832 -> Peer cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931): Couldn't send request to peer cd75a17ab2604397adab03bb8b5fd75c. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:08.078392  6951 consensus_queue.cc:237] T 4f00a2e87e56452083b759f60d461ee3 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:08.096747  6931 consensus_queue.cc:1048] T f03d0dbf16864ca4bc1bb5e4c0334c0f P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:18:08.099538  6957 raft_consensus.cc:515] T bd6869f07b5a4885a0b99fbe60c3b175 P b7ab4784c7344b939bc36f639286f377 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:08.084438  7073 raft_consensus.cc:515] T 4f00a2e87e56452083b759f60d461ee3 P cd75a17ab2604397adab03bb8b5fd75c [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:08.103310  6695 leader_election.cc:304] T bd6869f07b5a4885a0b99fbe60c3b175 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:18:08.107501  6931 raft_consensus.cc:2804] T bd6869f07b5a4885a0b99fbe60c3b175 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:18:08.107988  6931 raft_consensus.cc:493] T bd6869f07b5a4885a0b99fbe60c3b175 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:08.108384  6931 raft_consensus.cc:3060] T bd6869f07b5a4885a0b99fbe60c3b175 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:08.109985  7150 raft_consensus.cc:515] T 7a734b5ab7834e05a8c422208acc58b1 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:08.112022  6957 leader_election.cc:290] T bd6869f07b5a4885a0b99fbe60c3b175 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 1 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:18:08.101578  6959 raft_consensus.cc:2749] T 853ac0a8cbd64ce99457f170216d4d0f P cd75a17ab2604397adab03bb8b5fd75c [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:18:08.117530  6770 leader_election.cc:343] T f5be3a11b23d4ea9b08300a2789821c7 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:08.119966  6770 leader_election.cc:304] T f5be3a11b23d4ea9b08300a2789821c7 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:18:08.121258  7020 raft_consensus.cc:2749] T f5be3a11b23d4ea9b08300a2789821c7 P b7ab4784c7344b939bc36f639286f377 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:18:08.118285  7123 raft_consensus.cc:493] T fe20b4b48823486ca3b9c648db6ce8aa P b7ab4784c7344b939bc36f639286f377 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:08.121994  7123 raft_consensus.cc:515] T fe20b4b48823486ca3b9c648db6ce8aa P b7ab4784c7344b939bc36f639286f377 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
W20260709 13:18:08.126263  6678 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:18:08.128523  6879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6869f07b5a4885a0b99fbe60c3b175" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
W20260709 13:18:08.130367  6772 leader_election.cc:343] T bd6869f07b5a4885a0b99fbe60c3b175 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:08.147251  6877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a734b5ab7834e05a8c422208acc58b1" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:18:08.149212  7150 leader_election.cc:290] T 7a734b5ab7834e05a8c422208acc58b1 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 1 election: Requested vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
W20260709 13:18:08.149533  6697 leader_election.cc:343] T 7a734b5ab7834e05a8c422208acc58b1 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:08.152993  6729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f00a2e87e56452083b759f60d461ee3" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:18:08.153733  6931 raft_consensus.cc:515] T bd6869f07b5a4885a0b99fbe60c3b175 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
W20260709 13:18:08.154820  6695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 51601.8us
I20260709 13:18:08.156476  6877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6869f07b5a4885a0b99fbe60c3b175" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
W20260709 13:18:08.157779  6697 leader_election.cc:343] T bd6869f07b5a4885a0b99fbe60c3b175 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:08.160768  6922 tablet_bootstrap.cc:654] T d33d5ee8ef6f415593d8df52063161ad P cd75a17ab2604397adab03bb8b5fd75c: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:08.162005  6931 leader_election.cc:290] T bd6869f07b5a4885a0b99fbe60c3b175 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 1 election: Requested vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:18:08.166700  6921 tablet_bootstrap.cc:654] T a1704639a875409b9959353527b3fd68 P b7ab4784c7344b939bc36f639286f377: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:08.173230  6923 tablet_bootstrap.cc:492] T dbdf895bba214ff68685a24fd17dfb5d P ccd8a4c3bfe3413cb2ae219b09aea832: No bootstrap required, opened a new log
I20260709 13:18:08.173885  6923 ts_tablet_manager.cc:1403] T dbdf895bba214ff68685a24fd17dfb5d P ccd8a4c3bfe3413cb2ae219b09aea832: Time spent bootstrapping tablet: real 0.381s	user 0.008s	sys 0.015s
I20260709 13:18:08.174243  7073 leader_election.cc:290] T 4f00a2e87e56452083b759f60d461ee3 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 3 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:18:08.175712  6732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6869f07b5a4885a0b99fbe60c3b175" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:18:08.176606  6732 raft_consensus.cc:2393] T bd6869f07b5a4885a0b99fbe60c3b175 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate b7ab4784c7344b939bc36f639286f377 in current term 1: Already voted for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in this term.
I20260709 13:18:08.177387  6923 raft_consensus.cc:359] T dbdf895bba214ff68685a24fd17dfb5d P ccd8a4c3bfe3413cb2ae219b09aea832 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:08.178107  6923 raft_consensus.cc:385] T dbdf895bba214ff68685a24fd17dfb5d P ccd8a4c3bfe3413cb2ae219b09aea832 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:08.178361  6923 raft_consensus.cc:740] T dbdf895bba214ff68685a24fd17dfb5d P ccd8a4c3bfe3413cb2ae219b09aea832 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Initialized, Role: FOLLOWER
I20260709 13:18:08.179924  6923 consensus_queue.cc:260] T dbdf895bba214ff68685a24fd17dfb5d P ccd8a4c3bfe3413cb2ae219b09aea832 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:08.182121  6732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe20b4b48823486ca3b9c648db6ce8aa" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:18:08.185186  7123 leader_election.cc:290] T fe20b4b48823486ca3b9c648db6ce8aa P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:18:08.185061  6879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe20b4b48823486ca3b9c648db6ce8aa" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:18:08.186842  6923 ts_tablet_manager.cc:1434] T dbdf895bba214ff68685a24fd17dfb5d P ccd8a4c3bfe3413cb2ae219b09aea832: Time spent starting tablet: real 0.013s	user 0.007s	sys 0.001s
W20260709 13:18:08.186802  6772 leader_election.cc:343] T fe20b4b48823486ca3b9c648db6ce8aa P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:08.188452  6923 tablet_bootstrap.cc:492] T a1704639a875409b9959353527b3fd68 P ccd8a4c3bfe3413cb2ae219b09aea832: Bootstrap starting.
I20260709 13:18:08.189205  6770 leader_election.cc:304] T bd6869f07b5a4885a0b99fbe60c3b175 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:18:08.191721  6807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a734b5ab7834e05a8c422208acc58b1" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:18:08.193620  7123 raft_consensus.cc:2749] T bd6869f07b5a4885a0b99fbe60c3b175 P b7ab4784c7344b939bc36f639286f377 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:18:08.193840  6807 raft_consensus.cc:3060] T 7a734b5ab7834e05a8c422208acc58b1 P b7ab4784c7344b939bc36f639286f377 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:08.196699  6803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6869f07b5a4885a0b99fbe60c3b175" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:18:08.197661  6803 raft_consensus.cc:2393] T bd6869f07b5a4885a0b99fbe60c3b175 P b7ab4784c7344b939bc36f639286f377 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate ccd8a4c3bfe3413cb2ae219b09aea832 in current term 1: Already voted for candidate b7ab4784c7344b939bc36f639286f377 in this term.
I20260709 13:18:08.197139  7123 consensus_queue.cc:1048] T d33d5ee8ef6f415593d8df52063161ad P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
W20260709 13:18:08.200268  6770 leader_election.cc:343] T fe20b4b48823486ca3b9c648db6ce8aa P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:08.200747  6770 leader_election.cc:304] T fe20b4b48823486ca3b9c648db6ce8aa P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:18:08.202363  6957 raft_consensus.cc:2749] T fe20b4b48823486ca3b9c648db6ce8aa P b7ab4784c7344b939bc36f639286f377 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:18:08.203732  6630 catalog_manager.cc:5697] T 3fa34c08b205435dba97346991aa1f92 P ccd8a4c3bfe3413cb2ae219b09aea832 reported cstate change: term changed from 0 to 1, leader changed from <none> to ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65). New cstate: current_term: 1 leader_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:08.219116  6807 raft_consensus.cc:2468] T 7a734b5ab7834e05a8c422208acc58b1 P b7ab4784c7344b939bc36f639286f377 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 1.
I20260709 13:18:08.223024  6923 tablet_bootstrap.cc:654] T a1704639a875409b9959353527b3fd68 P ccd8a4c3bfe3413cb2ae219b09aea832: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:08.231412  7073 raft_consensus.cc:493] T 7c37d41cd9164c15a6826ca62a851a69 P cd75a17ab2604397adab03bb8b5fd75c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:08.232903  7073 raft_consensus.cc:515] T 7c37d41cd9164c15a6826ca62a851a69 P cd75a17ab2604397adab03bb8b5fd75c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:08.234921  6807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f00a2e87e56452083b759f60d461ee3" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:18:08.235417  7073 leader_election.cc:290] T 7c37d41cd9164c15a6826ca62a851a69 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:18:08.256567  6732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c37d41cd9164c15a6826ca62a851a69" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:18:08.256829  6922 tablet_bootstrap.cc:492] T d33d5ee8ef6f415593d8df52063161ad P cd75a17ab2604397adab03bb8b5fd75c: No bootstrap required, opened a new log
I20260709 13:18:08.257908  6922 ts_tablet_manager.cc:1403] T d33d5ee8ef6f415593d8df52063161ad P cd75a17ab2604397adab03bb8b5fd75c: Time spent bootstrapping tablet: real 0.216s	user 0.019s	sys 0.016s
I20260709 13:18:08.237694  6807 raft_consensus.cc:3060] T 4f00a2e87e56452083b759f60d461ee3 P b7ab4784c7344b939bc36f639286f377 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:08.261320  6805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c37d41cd9164c15a6826ca62a851a69" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:18:08.262987  6921 tablet_bootstrap.cc:492] T a1704639a875409b9959353527b3fd68 P b7ab4784c7344b939bc36f639286f377: No bootstrap required, opened a new log
I20260709 13:18:08.265601  6921 ts_tablet_manager.cc:1403] T a1704639a875409b9959353527b3fd68 P b7ab4784c7344b939bc36f639286f377: Time spent bootstrapping tablet: real 0.223s	user 0.011s	sys 0.013s
I20260709 13:18:08.263005  6844 leader_election.cc:304] T 7c37d41cd9164c15a6826ca62a851a69 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:18:08.267541  7073 raft_consensus.cc:2749] T 7c37d41cd9164c15a6826ca62a851a69 P cd75a17ab2604397adab03bb8b5fd75c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:18:08.269630  6695 leader_election.cc:304] T bd6869f07b5a4885a0b99fbe60c3b175 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:18:08.270537  7019 raft_consensus.cc:2749] T bd6869f07b5a4885a0b99fbe60c3b175 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:18:08.271673  6921 raft_consensus.cc:359] T a1704639a875409b9959353527b3fd68 P b7ab4784c7344b939bc36f639286f377 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:08.272730  6921 raft_consensus.cc:385] T a1704639a875409b9959353527b3fd68 P b7ab4784c7344b939bc36f639286f377 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:08.271941  6695 leader_election.cc:304] T 7a734b5ab7834e05a8c422208acc58b1 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:18:08.273186  6921 raft_consensus.cc:740] T a1704639a875409b9959353527b3fd68 P b7ab4784c7344b939bc36f639286f377 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Initialized, Role: FOLLOWER
I20260709 13:18:08.274176  7019 raft_consensus.cc:2804] T 7a734b5ab7834e05a8c422208acc58b1 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:18:08.274909  7019 raft_consensus.cc:697] T 7a734b5ab7834e05a8c422208acc58b1 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 1 LEADER]: Becoming Leader. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
I20260709 13:18:08.274344  6921 consensus_queue.cc:260] T a1704639a875409b9959353527b3fd68 P b7ab4784c7344b939bc36f639286f377 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:08.275863  7019 consensus_queue.cc:237] T 7a734b5ab7834e05a8c422208acc58b1 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:08.284548  6922 raft_consensus.cc:359] T d33d5ee8ef6f415593d8df52063161ad P cd75a17ab2604397adab03bb8b5fd75c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:08.286468  6922 raft_consensus.cc:385] T d33d5ee8ef6f415593d8df52063161ad P cd75a17ab2604397adab03bb8b5fd75c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:08.286795  6922 raft_consensus.cc:740] T d33d5ee8ef6f415593d8df52063161ad P cd75a17ab2604397adab03bb8b5fd75c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cd75a17ab2604397adab03bb8b5fd75c, State: Initialized, Role: FOLLOWER
I20260709 13:18:08.284730  6630 catalog_manager.cc:5697] T 4f00a2e87e56452083b759f60d461ee3 P ccd8a4c3bfe3413cb2ae219b09aea832 reported cstate change: term changed from 1 to 2, leader changed from b7ab4784c7344b939bc36f639286f377 (127.5.126.66) to ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65). New cstate: current_term: 2 leader_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:08.290113  6921 ts_tablet_manager.cc:1434] T a1704639a875409b9959353527b3fd68 P b7ab4784c7344b939bc36f639286f377: Time spent starting tablet: real 0.022s	user 0.006s	sys 0.001s
I20260709 13:18:08.291471  6921 tablet_bootstrap.cc:492] T 24ee15416e3145beaa1b8183453729a3 P b7ab4784c7344b939bc36f639286f377: Bootstrap starting.
I20260709 13:18:08.287523  6922 consensus_queue.cc:260] T d33d5ee8ef6f415593d8df52063161ad P cd75a17ab2604397adab03bb8b5fd75c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:08.312500  6923 tablet_bootstrap.cc:492] T a1704639a875409b9959353527b3fd68 P ccd8a4c3bfe3413cb2ae219b09aea832: No bootstrap required, opened a new log
I20260709 13:18:08.313146  6923 ts_tablet_manager.cc:1403] T a1704639a875409b9959353527b3fd68 P ccd8a4c3bfe3413cb2ae219b09aea832: Time spent bootstrapping tablet: real 0.125s	user 0.023s	sys 0.022s
I20260709 13:18:08.315390  6931 consensus_queue.cc:1048] T 3fa34c08b205435dba97346991aa1f92 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:18:08.324141  6807 raft_consensus.cc:2468] T 4f00a2e87e56452083b759f60d461ee3 P b7ab4784c7344b939bc36f639286f377 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 3.
I20260709 13:18:08.332235  6922 ts_tablet_manager.cc:1434] T d33d5ee8ef6f415593d8df52063161ad P cd75a17ab2604397adab03bb8b5fd75c: Time spent starting tablet: real 0.074s	user 0.009s	sys 0.000s
I20260709 13:18:08.330747  6844 leader_election.cc:304] T 4f00a2e87e56452083b759f60d461ee3 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:18:08.338294  7073 raft_consensus.cc:2804] T 4f00a2e87e56452083b759f60d461ee3 P cd75a17ab2604397adab03bb8b5fd75c [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:18:08.338838  6922 tablet_bootstrap.cc:492] T 3fa34c08b205435dba97346991aa1f92 P cd75a17ab2604397adab03bb8b5fd75c: Bootstrap starting.
I20260709 13:18:08.338852  7073 raft_consensus.cc:697] T 4f00a2e87e56452083b759f60d461ee3 P cd75a17ab2604397adab03bb8b5fd75c [term 3 LEADER]: Becoming Leader. State: Replica: cd75a17ab2604397adab03bb8b5fd75c, State: Running, Role: LEADER
I20260709 13:18:08.345197  7073 consensus_queue.cc:237] T 4f00a2e87e56452083b759f60d461ee3 P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:08.373355  6921 tablet_bootstrap.cc:654] T 24ee15416e3145beaa1b8183453729a3 P b7ab4784c7344b939bc36f639286f377: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:08.375180  6923 raft_consensus.cc:359] T a1704639a875409b9959353527b3fd68 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:08.375859  6923 raft_consensus.cc:385] T a1704639a875409b9959353527b3fd68 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:08.376108  6923 raft_consensus.cc:740] T a1704639a875409b9959353527b3fd68 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Initialized, Role: FOLLOWER
I20260709 13:18:08.377570  6876 raft_consensus.cc:3060] T 7c37d41cd9164c15a6826ca62a851a69 P cd75a17ab2604397adab03bb8b5fd75c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:08.377849  6923 consensus_queue.cc:260] T a1704639a875409b9959353527b3fd68 P ccd8a4c3bfe3413cb2ae219b09aea832 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:08.380702  6629 catalog_manager.cc:5697] T 7a734b5ab7834e05a8c422208acc58b1 P ccd8a4c3bfe3413cb2ae219b09aea832 reported cstate change: term changed from 0 to 1, leader changed from <none> to ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65). New cstate: current_term: 1 leader_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:08.382601  6923 ts_tablet_manager.cc:1434] T a1704639a875409b9959353527b3fd68 P ccd8a4c3bfe3413cb2ae219b09aea832: Time spent starting tablet: real 0.069s	user 0.003s	sys 0.005s
I20260709 13:18:08.383903  6923 tablet_bootstrap.cc:492] T fe20b4b48823486ca3b9c648db6ce8aa P ccd8a4c3bfe3413cb2ae219b09aea832: Bootstrap starting.
W20260709 13:18:08.374567  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 44049.7us
I20260709 13:18:08.391752  6957 raft_consensus.cc:493] T a1704639a875409b9959353527b3fd68 P b7ab4784c7344b939bc36f639286f377 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:08.392424  6957 raft_consensus.cc:515] T a1704639a875409b9959353527b3fd68 P b7ab4784c7344b939bc36f639286f377 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:08.399887  6957 leader_election.cc:290] T a1704639a875409b9959353527b3fd68 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:18:08.401038  6729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1704639a875409b9959353527b3fd68" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:18:08.401942  6729 raft_consensus.cc:2468] T a1704639a875409b9959353527b3fd68 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 0.
I20260709 13:18:08.405900  6770 leader_election.cc:304] T a1704639a875409b9959353527b3fd68 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
I20260709 13:18:08.407155  7064 raft_consensus.cc:2804] T a1704639a875409b9959353527b3fd68 P b7ab4784c7344b939bc36f639286f377 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:18:08.407603  7064 raft_consensus.cc:493] T a1704639a875409b9959353527b3fd68 P b7ab4784c7344b939bc36f639286f377 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:08.410574  7064 raft_consensus.cc:3060] T a1704639a875409b9959353527b3fd68 P b7ab4784c7344b939bc36f639286f377 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:08.419351  6923 tablet_bootstrap.cc:654] T fe20b4b48823486ca3b9c648db6ce8aa P ccd8a4c3bfe3413cb2ae219b09aea832: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:08.419299  6880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1704639a875409b9959353527b3fd68" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:18:08.427399  6629 catalog_manager.cc:5697] T 4f00a2e87e56452083b759f60d461ee3 P cd75a17ab2604397adab03bb8b5fd75c reported cstate change: term changed from 2 to 3, leader changed from ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65) to cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67). New cstate: current_term: 3 leader_uuid: "cd75a17ab2604397adab03bb8b5fd75c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } health_report { overall_health: HEALTHY } } }
W20260709 13:18:08.432879  6772 leader_election.cc:343] T a1704639a875409b9959353527b3fd68 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:08.434927  6922 tablet_bootstrap.cc:654] T 3fa34c08b205435dba97346991aa1f92 P cd75a17ab2604397adab03bb8b5fd75c: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:08.437100  7064 raft_consensus.cc:515] T a1704639a875409b9959353527b3fd68 P b7ab4784c7344b939bc36f639286f377 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:08.442281  6729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1704639a875409b9959353527b3fd68" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:18:08.443012  6729 raft_consensus.cc:3060] T a1704639a875409b9959353527b3fd68 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:08.443560  6921 tablet_bootstrap.cc:492] T 24ee15416e3145beaa1b8183453729a3 P b7ab4784c7344b939bc36f639286f377: No bootstrap required, opened a new log
I20260709 13:18:08.444146  6921 ts_tablet_manager.cc:1403] T 24ee15416e3145beaa1b8183453729a3 P b7ab4784c7344b939bc36f639286f377: Time spent bootstrapping tablet: real 0.153s	user 0.016s	sys 0.001s
I20260709 13:18:08.447278  7064 leader_election.cc:290] T a1704639a875409b9959353527b3fd68 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 1 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:18:08.449774  6876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1704639a875409b9959353527b3fd68" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
W20260709 13:18:08.451435  6772 leader_election.cc:343] T a1704639a875409b9959353527b3fd68 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:08.453478  6923 tablet_bootstrap.cc:492] T fe20b4b48823486ca3b9c648db6ce8aa P ccd8a4c3bfe3413cb2ae219b09aea832: No bootstrap required, opened a new log
I20260709 13:18:08.454028  6923 ts_tablet_manager.cc:1403] T fe20b4b48823486ca3b9c648db6ce8aa P ccd8a4c3bfe3413cb2ae219b09aea832: Time spent bootstrapping tablet: real 0.070s	user 0.015s	sys 0.003s
I20260709 13:18:08.456662  6729 raft_consensus.cc:2468] T a1704639a875409b9959353527b3fd68 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 1.
I20260709 13:18:08.458441  6770 leader_election.cc:304] T a1704639a875409b9959353527b3fd68 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:18:08.460286  6921 raft_consensus.cc:359] T 24ee15416e3145beaa1b8183453729a3 P b7ab4784c7344b939bc36f639286f377 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:08.461578  6921 raft_consensus.cc:385] T 24ee15416e3145beaa1b8183453729a3 P b7ab4784c7344b939bc36f639286f377 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:08.461899  6921 raft_consensus.cc:740] T 24ee15416e3145beaa1b8183453729a3 P b7ab4784c7344b939bc36f639286f377 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Initialized, Role: FOLLOWER
I20260709 13:18:08.462741  6921 consensus_queue.cc:260] T 24ee15416e3145beaa1b8183453729a3 P b7ab4784c7344b939bc36f639286f377 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:08.464915  6921 ts_tablet_manager.cc:1434] T 24ee15416e3145beaa1b8183453729a3 P b7ab4784c7344b939bc36f639286f377: Time spent starting tablet: real 0.020s	user 0.006s	sys 0.000s
I20260709 13:18:08.460399  6923 raft_consensus.cc:359] T fe20b4b48823486ca3b9c648db6ce8aa P ccd8a4c3bfe3413cb2ae219b09aea832 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:08.461179  7064 raft_consensus.cc:2804] T a1704639a875409b9959353527b3fd68 P b7ab4784c7344b939bc36f639286f377 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:18:08.466116  6923 raft_consensus.cc:385] T fe20b4b48823486ca3b9c648db6ce8aa P ccd8a4c3bfe3413cb2ae219b09aea832 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:08.466411  6923 raft_consensus.cc:740] T fe20b4b48823486ca3b9c648db6ce8aa P ccd8a4c3bfe3413cb2ae219b09aea832 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Initialized, Role: FOLLOWER
I20260709 13:18:08.466491  7064 raft_consensus.cc:697] T a1704639a875409b9959353527b3fd68 P b7ab4784c7344b939bc36f639286f377 [term 1 LEADER]: Becoming Leader. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
I20260709 13:18:08.467382  6923 consensus_queue.cc:260] T fe20b4b48823486ca3b9c648db6ce8aa P ccd8a4c3bfe3413cb2ae219b09aea832 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:08.467442  7064 consensus_queue.cc:237] T a1704639a875409b9959353527b3fd68 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:08.465941  6921 tablet_bootstrap.cc:492] T 34f36d59d88f40fe8a2805e604fc6c0a P b7ab4784c7344b939bc36f639286f377: Bootstrap starting.
I20260709 13:18:08.476730  6923 ts_tablet_manager.cc:1434] T fe20b4b48823486ca3b9c648db6ce8aa P ccd8a4c3bfe3413cb2ae219b09aea832: Time spent starting tablet: real 0.022s	user 0.008s	sys 0.000s
I20260709 13:18:08.477854  6923 tablet_bootstrap.cc:492] T 24ee15416e3145beaa1b8183453729a3 P ccd8a4c3bfe3413cb2ae219b09aea832: Bootstrap starting.
I20260709 13:18:08.481197  6957 raft_consensus.cc:493] T 24ee15416e3145beaa1b8183453729a3 P b7ab4784c7344b939bc36f639286f377 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:08.481714  6957 raft_consensus.cc:515] T 24ee15416e3145beaa1b8183453729a3 P b7ab4784c7344b939bc36f639286f377 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:08.483008  6922 tablet_bootstrap.cc:492] T 3fa34c08b205435dba97346991aa1f92 P cd75a17ab2604397adab03bb8b5fd75c: No bootstrap required, opened a new log
I20260709 13:18:08.483613  6922 ts_tablet_manager.cc:1403] T 3fa34c08b205435dba97346991aa1f92 P cd75a17ab2604397adab03bb8b5fd75c: Time spent bootstrapping tablet: real 0.145s	user 0.008s	sys 0.008s
I20260709 13:18:08.484582  6729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24ee15416e3145beaa1b8183453729a3" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:18:08.485877  7073 raft_consensus.cc:493] T d33d5ee8ef6f415593d8df52063161ad P cd75a17ab2604397adab03bb8b5fd75c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:08.486177  6770 leader_election.cc:343] T 24ee15416e3145beaa1b8183453729a3 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:08.486439  6922 raft_consensus.cc:359] T 3fa34c08b205435dba97346991aa1f92 P cd75a17ab2604397adab03bb8b5fd75c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:08.487176  6957 leader_election.cc:290] T 24ee15416e3145beaa1b8183453729a3 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:18:08.486444  7073 raft_consensus.cc:515] T d33d5ee8ef6f415593d8df52063161ad P cd75a17ab2604397adab03bb8b5fd75c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:08.487275  6922 raft_consensus.cc:385] T 3fa34c08b205435dba97346991aa1f92 P cd75a17ab2604397adab03bb8b5fd75c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:08.487843  6922 raft_consensus.cc:740] T 3fa34c08b205435dba97346991aa1f92 P cd75a17ab2604397adab03bb8b5fd75c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cd75a17ab2604397adab03bb8b5fd75c, State: Initialized, Role: FOLLOWER
I20260709 13:18:08.488582  6922 consensus_queue.cc:260] T 3fa34c08b205435dba97346991aa1f92 P cd75a17ab2604397adab03bb8b5fd75c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:08.489280  7073 leader_election.cc:290] T d33d5ee8ef6f415593d8df52063161ad P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:18:08.490916  6923 tablet_bootstrap.cc:654] T 24ee15416e3145beaa1b8183453729a3 P ccd8a4c3bfe3413cb2ae219b09aea832: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:08.490958  6922 ts_tablet_manager.cc:1434] T 3fa34c08b205435dba97346991aa1f92 P cd75a17ab2604397adab03bb8b5fd75c: Time spent starting tablet: real 0.007s	user 0.001s	sys 0.003s
I20260709 13:18:08.491448  6806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d33d5ee8ef6f415593d8df52063161ad" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:18:08.494000  6729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d33d5ee8ef6f415593d8df52063161ad" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:18:08.494397  6876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24ee15416e3145beaa1b8183453729a3" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:18:08.495555  6844 leader_election.cc:304] T d33d5ee8ef6f415593d8df52063161ad P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
W20260709 13:18:08.496567  6772 leader_election.cc:343] T 24ee15416e3145beaa1b8183453729a3 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:08.496737  6959 raft_consensus.cc:2749] T d33d5ee8ef6f415593d8df52063161ad P cd75a17ab2604397adab03bb8b5fd75c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:18:08.497221  6921 tablet_bootstrap.cc:654] T 34f36d59d88f40fe8a2805e604fc6c0a P b7ab4784c7344b939bc36f639286f377: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:08.497043  6772 leader_election.cc:304] T 24ee15416e3145beaa1b8183453729a3 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:18:08.502066  7064 raft_consensus.cc:2749] T 24ee15416e3145beaa1b8183453729a3 P b7ab4784c7344b939bc36f639286f377 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:18:08.504886  6628 catalog_manager.cc:5697] T a1704639a875409b9959353527b3fd68 P b7ab4784c7344b939bc36f639286f377 reported cstate change: term changed from 0 to 1, leader changed from <none> to b7ab4784c7344b939bc36f639286f377 (127.5.126.66). New cstate: current_term: 1 leader_uuid: "b7ab4784c7344b939bc36f639286f377" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:08.492990  6922 tablet_bootstrap.cc:492] T 7a734b5ab7834e05a8c422208acc58b1 P cd75a17ab2604397adab03bb8b5fd75c: Bootstrap starting.
I20260709 13:18:08.515202  6922 tablet_bootstrap.cc:654] T 7a734b5ab7834e05a8c422208acc58b1 P cd75a17ab2604397adab03bb8b5fd75c: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:08.518738  6923 tablet_bootstrap.cc:492] T 24ee15416e3145beaa1b8183453729a3 P ccd8a4c3bfe3413cb2ae219b09aea832: No bootstrap required, opened a new log
I20260709 13:18:08.519259  6923 ts_tablet_manager.cc:1403] T 24ee15416e3145beaa1b8183453729a3 P ccd8a4c3bfe3413cb2ae219b09aea832: Time spent bootstrapping tablet: real 0.042s	user 0.008s	sys 0.014s
I20260709 13:18:08.519999  6806 raft_consensus.cc:1240] T 4f00a2e87e56452083b759f60d461ee3 P b7ab4784c7344b939bc36f639286f377 [term 3 FOLLOWER]: Rejecting Update request from peer ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 2. Current term is 3. Ops: []
I20260709 13:18:08.522083  7019 consensus_queue.cc:1059] T 4f00a2e87e56452083b759f60d461ee3 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:18:08.522902  7019 raft_consensus.cc:3055] T 4f00a2e87e56452083b759f60d461ee3 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:18:08.523221  7019 raft_consensus.cc:740] T 4f00a2e87e56452083b759f60d461ee3 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
I20260709 13:18:08.524011  7019 consensus_queue.cc:260] T 4f00a2e87e56452083b759f60d461ee3 P ccd8a4c3bfe3413cb2ae219b09aea832 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:08.525151  7019 raft_consensus.cc:3060] T 4f00a2e87e56452083b759f60d461ee3 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:08.531337  6986 raft_consensus.cc:493] T fe20b4b48823486ca3b9c648db6ce8aa P ccd8a4c3bfe3413cb2ae219b09aea832 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:08.531852  6986 raft_consensus.cc:515] T fe20b4b48823486ca3b9c648db6ce8aa P ccd8a4c3bfe3413cb2ae219b09aea832 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:08.535880  6876 raft_consensus.cc:3060] T d33d5ee8ef6f415593d8df52063161ad P cd75a17ab2604397adab03bb8b5fd75c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:08.536005  6802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe20b4b48823486ca3b9c648db6ce8aa" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:18:08.536845  6802 raft_consensus.cc:2468] T fe20b4b48823486ca3b9c648db6ce8aa P b7ab4784c7344b939bc36f639286f377 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 0.
I20260709 13:18:08.537519  6986 leader_election.cc:290] T fe20b4b48823486ca3b9c648db6ce8aa P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:18:08.538676  6695 leader_election.cc:304] T fe20b4b48823486ca3b9c648db6ce8aa P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
I20260709 13:18:08.539726  6922 tablet_bootstrap.cc:492] T 7a734b5ab7834e05a8c422208acc58b1 P cd75a17ab2604397adab03bb8b5fd75c: No bootstrap required, opened a new log
I20260709 13:18:08.539814  6931 raft_consensus.cc:2804] T fe20b4b48823486ca3b9c648db6ce8aa P ccd8a4c3bfe3413cb2ae219b09aea832 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:18:08.546363  6923 raft_consensus.cc:359] T 24ee15416e3145beaa1b8183453729a3 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:08.546900  6931 raft_consensus.cc:493] T fe20b4b48823486ca3b9c648db6ce8aa P ccd8a4c3bfe3413cb2ae219b09aea832 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:08.547201  6923 raft_consensus.cc:385] T 24ee15416e3145beaa1b8183453729a3 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:08.547304  6931 raft_consensus.cc:3060] T fe20b4b48823486ca3b9c648db6ce8aa P ccd8a4c3bfe3413cb2ae219b09aea832 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:08.547678  6923 raft_consensus.cc:740] T 24ee15416e3145beaa1b8183453729a3 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Initialized, Role: FOLLOWER
I20260709 13:18:08.548702  6923 consensus_queue.cc:260] T 24ee15416e3145beaa1b8183453729a3 P ccd8a4c3bfe3413cb2ae219b09aea832 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:08.551120  6923 ts_tablet_manager.cc:1434] T 24ee15416e3145beaa1b8183453729a3 P ccd8a4c3bfe3413cb2ae219b09aea832: Time spent starting tablet: real 0.032s	user 0.008s	sys 0.000s
I20260709 13:18:08.551309  6880 raft_consensus.cc:3060] T 3fa34c08b205435dba97346991aa1f92 P cd75a17ab2604397adab03bb8b5fd75c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:08.552229  6923 tablet_bootstrap.cc:492] T d8cee0accdb8499c86d4414b72565a38 P ccd8a4c3bfe3413cb2ae219b09aea832: Bootstrap starting.
I20260709 13:18:08.552393  6879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe20b4b48823486ca3b9c648db6ce8aa" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
W20260709 13:18:08.553777  6697 leader_election.cc:343] T fe20b4b48823486ca3b9c648db6ce8aa P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:08.556203  6931 raft_consensus.cc:515] T fe20b4b48823486ca3b9c648db6ce8aa P ccd8a4c3bfe3413cb2ae219b09aea832 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:08.560328  6923 tablet_bootstrap.cc:654] T d8cee0accdb8499c86d4414b72565a38 P ccd8a4c3bfe3413cb2ae219b09aea832: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:08.557590  6922 ts_tablet_manager.cc:1403] T 7a734b5ab7834e05a8c422208acc58b1 P cd75a17ab2604397adab03bb8b5fd75c: Time spent bootstrapping tablet: real 0.065s	user 0.009s	sys 0.011s
I20260709 13:18:08.563460  6922 raft_consensus.cc:359] T 7a734b5ab7834e05a8c422208acc58b1 P cd75a17ab2604397adab03bb8b5fd75c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:08.565743  6922 raft_consensus.cc:385] T 7a734b5ab7834e05a8c422208acc58b1 P cd75a17ab2604397adab03bb8b5fd75c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:08.565670  6802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe20b4b48823486ca3b9c648db6ce8aa" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:18:08.565323  6931 leader_election.cc:290] T fe20b4b48823486ca3b9c648db6ce8aa P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 1 election: Requested vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:18:08.566840  6922 raft_consensus.cc:740] T 7a734b5ab7834e05a8c422208acc58b1 P cd75a17ab2604397adab03bb8b5fd75c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cd75a17ab2604397adab03bb8b5fd75c, State: Initialized, Role: FOLLOWER
I20260709 13:18:08.567027  6802 raft_consensus.cc:3060] T fe20b4b48823486ca3b9c648db6ce8aa P b7ab4784c7344b939bc36f639286f377 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:08.567647  6922 consensus_queue.cc:260] T 7a734b5ab7834e05a8c422208acc58b1 P cd75a17ab2604397adab03bb8b5fd75c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:08.568656  6877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe20b4b48823486ca3b9c648db6ce8aa" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:18:08.569934  6922 ts_tablet_manager.cc:1434] T 7a734b5ab7834e05a8c422208acc58b1 P cd75a17ab2604397adab03bb8b5fd75c: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.000s
I20260709 13:18:08.571084  6922 tablet_bootstrap.cc:492] T de3186201e1a40d0b335eeb8b4e256e0 P cd75a17ab2604397adab03bb8b5fd75c: Bootstrap starting.
W20260709 13:18:08.571964  6697 leader_election.cc:343] T fe20b4b48823486ca3b9c648db6ce8aa P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:08.573913  6802 raft_consensus.cc:2468] T fe20b4b48823486ca3b9c648db6ce8aa P b7ab4784c7344b939bc36f639286f377 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 1.
I20260709 13:18:08.575174  6695 leader_election.cc:304] T fe20b4b48823486ca3b9c648db6ce8aa P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:18:08.576226  6931 raft_consensus.cc:2804] T fe20b4b48823486ca3b9c648db6ce8aa P ccd8a4c3bfe3413cb2ae219b09aea832 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:18:08.576644  6931 raft_consensus.cc:697] T fe20b4b48823486ca3b9c648db6ce8aa P ccd8a4c3bfe3413cb2ae219b09aea832 [term 1 LEADER]: Becoming Leader. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
I20260709 13:18:08.577244  6922 tablet_bootstrap.cc:654] T de3186201e1a40d0b335eeb8b4e256e0 P cd75a17ab2604397adab03bb8b5fd75c: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:08.577338  6931 consensus_queue.cc:237] T fe20b4b48823486ca3b9c648db6ce8aa P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:08.586530  6951 raft_consensus.cc:493] T 24ee15416e3145beaa1b8183453729a3 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:08.587190  6951 raft_consensus.cc:515] T 24ee15416e3145beaa1b8183453729a3 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:08.588925  6923 tablet_bootstrap.cc:492] T d8cee0accdb8499c86d4414b72565a38 P ccd8a4c3bfe3413cb2ae219b09aea832: No bootstrap required, opened a new log
I20260709 13:18:08.589394  6923 ts_tablet_manager.cc:1403] T d8cee0accdb8499c86d4414b72565a38 P ccd8a4c3bfe3413cb2ae219b09aea832: Time spent bootstrapping tablet: real 0.037s	user 0.007s	sys 0.009s
I20260709 13:18:08.589890  6802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24ee15416e3145beaa1b8183453729a3" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:18:08.590691  6802 raft_consensus.cc:2468] T 24ee15416e3145beaa1b8183453729a3 P b7ab4784c7344b939bc36f639286f377 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 0.
I20260709 13:18:08.591786  6695 leader_election.cc:304] T 24ee15416e3145beaa1b8183453729a3 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
I20260709 13:18:08.592178  6923 raft_consensus.cc:359] T d8cee0accdb8499c86d4414b72565a38 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:08.592824  6923 raft_consensus.cc:385] T d8cee0accdb8499c86d4414b72565a38 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:08.592890  6986 raft_consensus.cc:2804] T 24ee15416e3145beaa1b8183453729a3 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:18:08.593170  6923 raft_consensus.cc:740] T d8cee0accdb8499c86d4414b72565a38 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Initialized, Role: FOLLOWER
I20260709 13:18:08.593614  6986 raft_consensus.cc:493] T 24ee15416e3145beaa1b8183453729a3 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:08.594049  6986 raft_consensus.cc:3060] T 24ee15416e3145beaa1b8183453729a3 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:08.595207  6922 tablet_bootstrap.cc:492] T de3186201e1a40d0b335eeb8b4e256e0 P cd75a17ab2604397adab03bb8b5fd75c: No bootstrap required, opened a new log
I20260709 13:18:08.594105  6923 consensus_queue.cc:260] T d8cee0accdb8499c86d4414b72565a38 P ccd8a4c3bfe3413cb2ae219b09aea832 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:08.594754  6921 tablet_bootstrap.cc:492] T 34f36d59d88f40fe8a2805e604fc6c0a P b7ab4784c7344b939bc36f639286f377: No bootstrap required, opened a new log
I20260709 13:18:08.595736  6922 ts_tablet_manager.cc:1403] T de3186201e1a40d0b335eeb8b4e256e0 P cd75a17ab2604397adab03bb8b5fd75c: Time spent bootstrapping tablet: real 0.025s	user 0.005s	sys 0.010s
I20260709 13:18:08.596680  6921 ts_tablet_manager.cc:1403] T 34f36d59d88f40fe8a2805e604fc6c0a P b7ab4784c7344b939bc36f639286f377: Time spent bootstrapping tablet: real 0.131s	user 0.013s	sys 0.003s
I20260709 13:18:08.597746  6876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24ee15416e3145beaa1b8183453729a3" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
W20260709 13:18:08.599359  6697 leader_election.cc:343] T 24ee15416e3145beaa1b8183453729a3 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:08.599409  6922 raft_consensus.cc:359] T de3186201e1a40d0b335eeb8b4e256e0 P cd75a17ab2604397adab03bb8b5fd75c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:08.600179  6922 raft_consensus.cc:385] T de3186201e1a40d0b335eeb8b4e256e0 P cd75a17ab2604397adab03bb8b5fd75c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:08.600495  6922 raft_consensus.cc:740] T de3186201e1a40d0b335eeb8b4e256e0 P cd75a17ab2604397adab03bb8b5fd75c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cd75a17ab2604397adab03bb8b5fd75c, State: Initialized, Role: FOLLOWER
I20260709 13:18:08.601207  6922 consensus_queue.cc:260] T de3186201e1a40d0b335eeb8b4e256e0 P cd75a17ab2604397adab03bb8b5fd75c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:08.595947  6951 leader_election.cc:290] T 24ee15416e3145beaa1b8183453729a3 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:18:08.603649  6922 ts_tablet_manager.cc:1434] T de3186201e1a40d0b335eeb8b4e256e0 P cd75a17ab2604397adab03bb8b5fd75c: Time spent starting tablet: real 0.007s	user 0.000s	sys 0.004s
I20260709 13:18:08.603654  6921 raft_consensus.cc:359] T 34f36d59d88f40fe8a2805e604fc6c0a P b7ab4784c7344b939bc36f639286f377 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:08.604573  6921 raft_consensus.cc:385] T 34f36d59d88f40fe8a2805e604fc6c0a P b7ab4784c7344b939bc36f639286f377 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:08.605082  6922 tablet_bootstrap.cc:492] T dbdf895bba214ff68685a24fd17dfb5d P cd75a17ab2604397adab03bb8b5fd75c: Bootstrap starting.
I20260709 13:18:08.607892  6921 raft_consensus.cc:740] T 34f36d59d88f40fe8a2805e604fc6c0a P b7ab4784c7344b939bc36f639286f377 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Initialized, Role: FOLLOWER
I20260709 13:18:08.608713  6921 consensus_queue.cc:260] T 34f36d59d88f40fe8a2805e604fc6c0a P b7ab4784c7344b939bc36f639286f377 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:08.605543  6923 ts_tablet_manager.cc:1434] T d8cee0accdb8499c86d4414b72565a38 P ccd8a4c3bfe3413cb2ae219b09aea832: Time spent starting tablet: real 0.016s	user 0.008s	sys 0.000s
I20260709 13:18:08.614313  6959 raft_consensus.cc:493] T de3186201e1a40d0b335eeb8b4e256e0 P cd75a17ab2604397adab03bb8b5fd75c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:08.615830  6959 raft_consensus.cc:515] T de3186201e1a40d0b335eeb8b4e256e0 P cd75a17ab2604397adab03bb8b5fd75c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:08.619807  6959 leader_election.cc:290] T de3186201e1a40d0b335eeb8b4e256e0 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:18:08.613772  6986 raft_consensus.cc:515] T 24ee15416e3145beaa1b8183453729a3 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:08.621420  6922 tablet_bootstrap.cc:654] T dbdf895bba214ff68685a24fd17dfb5d P cd75a17ab2604397adab03bb8b5fd75c: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:08.625159  6729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de3186201e1a40d0b335eeb8b4e256e0" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:18:08.625551  6806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24ee15416e3145beaa1b8183453729a3" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:18:08.624161  6923 tablet_bootstrap.cc:492] T d8292e16e5654be6bc408560cf256aaa P ccd8a4c3bfe3413cb2ae219b09aea832: Bootstrap starting.
I20260709 13:18:08.626199  6806 raft_consensus.cc:3060] T 24ee15416e3145beaa1b8183453729a3 P b7ab4784c7344b939bc36f639286f377 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:08.621848  6802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de3186201e1a40d0b335eeb8b4e256e0" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:18:08.628367  6921 ts_tablet_manager.cc:1434] T 34f36d59d88f40fe8a2805e604fc6c0a P b7ab4784c7344b939bc36f639286f377: Time spent starting tablet: real 0.031s	user 0.008s	sys 0.000s
I20260709 13:18:08.629271  6844 leader_election.cc:304] T de3186201e1a40d0b335eeb8b4e256e0 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:18:08.631004  6959 raft_consensus.cc:2749] T de3186201e1a40d0b335eeb8b4e256e0 P cd75a17ab2604397adab03bb8b5fd75c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:18:08.632012  6921 tablet_bootstrap.cc:492] T 2c240553ce044eedb41541d72b9475d7 P b7ab4784c7344b939bc36f639286f377: Bootstrap starting.
I20260709 13:18:08.632532  6986 leader_election.cc:290] T 24ee15416e3145beaa1b8183453729a3 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 1 election: Requested vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:18:08.638723  6923 tablet_bootstrap.cc:654] T d8292e16e5654be6bc408560cf256aaa P ccd8a4c3bfe3413cb2ae219b09aea832: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:08.639671  6931 raft_consensus.cc:493] T dbdf895bba214ff68685a24fd17dfb5d P ccd8a4c3bfe3413cb2ae219b09aea832 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:08.652710  6931 raft_consensus.cc:515] T dbdf895bba214ff68685a24fd17dfb5d P ccd8a4c3bfe3413cb2ae219b09aea832 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:08.654835  6931 leader_election.cc:290] T dbdf895bba214ff68685a24fd17dfb5d P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:18:08.655129  6921 tablet_bootstrap.cc:654] T 2c240553ce044eedb41541d72b9475d7 P b7ab4784c7344b939bc36f639286f377: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:08.642405  6806 raft_consensus.cc:2468] T 24ee15416e3145beaa1b8183453729a3 P b7ab4784c7344b939bc36f639286f377 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 1.
I20260709 13:18:08.658586  6807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbdf895bba214ff68685a24fd17dfb5d" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:18:08.659461  6695 leader_election.cc:304] T 24ee15416e3145beaa1b8183453729a3 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
I20260709 13:18:08.659473  6807 raft_consensus.cc:2468] T dbdf895bba214ff68685a24fd17dfb5d P b7ab4784c7344b939bc36f639286f377 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 0.
I20260709 13:18:08.654407  6630 catalog_manager.cc:5697] T fe20b4b48823486ca3b9c648db6ce8aa P ccd8a4c3bfe3413cb2ae219b09aea832 reported cstate change: term changed from 0 to 1, leader changed from <none> to ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65). New cstate: current_term: 1 leader_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:08.661671  6695 leader_election.cc:304] T dbdf895bba214ff68685a24fd17dfb5d P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
I20260709 13:18:08.662385  6951 raft_consensus.cc:2804] T 24ee15416e3145beaa1b8183453729a3 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:18:08.663807  6951 raft_consensus.cc:697] T 24ee15416e3145beaa1b8183453729a3 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 1 LEADER]: Becoming Leader. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
I20260709 13:18:08.664810  6951 consensus_queue.cc:237] T 24ee15416e3145beaa1b8183453729a3 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:08.669528  6921 tablet_bootstrap.cc:492] T 2c240553ce044eedb41541d72b9475d7 P b7ab4784c7344b939bc36f639286f377: No bootstrap required, opened a new log
I20260709 13:18:08.669737  6986 raft_consensus.cc:2804] T dbdf895bba214ff68685a24fd17dfb5d P ccd8a4c3bfe3413cb2ae219b09aea832 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:18:08.669309  6876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24ee15416e3145beaa1b8183453729a3" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:18:08.670164  6921 ts_tablet_manager.cc:1403] T 2c240553ce044eedb41541d72b9475d7 P b7ab4784c7344b939bc36f639286f377: Time spent bootstrapping tablet: real 0.038s	user 0.005s	sys 0.006s
I20260709 13:18:08.670117  6986 raft_consensus.cc:493] T dbdf895bba214ff68685a24fd17dfb5d P ccd8a4c3bfe3413cb2ae219b09aea832 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:08.670630  6986 raft_consensus.cc:3060] T dbdf895bba214ff68685a24fd17dfb5d P ccd8a4c3bfe3413cb2ae219b09aea832 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:08.674075  6921 raft_consensus.cc:359] T 2c240553ce044eedb41541d72b9475d7 P b7ab4784c7344b939bc36f639286f377 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:08.675064  6921 raft_consensus.cc:385] T 2c240553ce044eedb41541d72b9475d7 P b7ab4784c7344b939bc36f639286f377 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:08.675328  6876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbdf895bba214ff68685a24fd17dfb5d" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:18:08.678140  6880 raft_consensus.cc:3060] T 7a734b5ab7834e05a8c422208acc58b1 P cd75a17ab2604397adab03bb8b5fd75c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:08.680076  6986 raft_consensus.cc:515] T dbdf895bba214ff68685a24fd17dfb5d P ccd8a4c3bfe3413cb2ae219b09aea832 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:08.675324  6921 raft_consensus.cc:740] T 2c240553ce044eedb41541d72b9475d7 P b7ab4784c7344b939bc36f639286f377 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Initialized, Role: FOLLOWER
I20260709 13:18:08.686589  6921 consensus_queue.cc:260] T 2c240553ce044eedb41541d72b9475d7 P b7ab4784c7344b939bc36f639286f377 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:08.686970  6806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbdf895bba214ff68685a24fd17dfb5d" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:18:08.687582  6806 raft_consensus.cc:3060] T dbdf895bba214ff68685a24fd17dfb5d P b7ab4784c7344b939bc36f639286f377 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:08.688838  6921 ts_tablet_manager.cc:1434] T 2c240553ce044eedb41541d72b9475d7 P b7ab4784c7344b939bc36f639286f377: Time spent starting tablet: real 0.018s	user 0.007s	sys 0.001s
I20260709 13:18:08.685365  6986 leader_election.cc:290] T dbdf895bba214ff68685a24fd17dfb5d P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 1 election: Requested vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:18:08.696014  6921 tablet_bootstrap.cc:492] T 713b5728a197487c9300b310ab94e5a3 P b7ab4784c7344b939bc36f639286f377: Bootstrap starting.
W20260709 13:18:08.698793  6697 leader_election.cc:343] T 24ee15416e3145beaa1b8183453729a3 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:08.700286  6876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbdf895bba214ff68685a24fd17dfb5d" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:18:08.702481  6806 raft_consensus.cc:2468] T dbdf895bba214ff68685a24fd17dfb5d P b7ab4784c7344b939bc36f639286f377 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 1.
I20260709 13:18:08.704547  6923 tablet_bootstrap.cc:492] T d8292e16e5654be6bc408560cf256aaa P ccd8a4c3bfe3413cb2ae219b09aea832: No bootstrap required, opened a new log
I20260709 13:18:08.705051  6923 ts_tablet_manager.cc:1403] T d8292e16e5654be6bc408560cf256aaa P ccd8a4c3bfe3413cb2ae219b09aea832: Time spent bootstrapping tablet: real 0.081s	user 0.018s	sys 0.008s
I20260709 13:18:08.705277  6695 leader_election.cc:304] T dbdf895bba214ff68685a24fd17dfb5d P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
I20260709 13:18:08.706197  6931 raft_consensus.cc:2804] T dbdf895bba214ff68685a24fd17dfb5d P ccd8a4c3bfe3413cb2ae219b09aea832 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:18:08.706645  6931 raft_consensus.cc:697] T dbdf895bba214ff68685a24fd17dfb5d P ccd8a4c3bfe3413cb2ae219b09aea832 [term 1 LEADER]: Becoming Leader. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
I20260709 13:18:08.707406  6931 consensus_queue.cc:237] T dbdf895bba214ff68685a24fd17dfb5d P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:08.707706  6921 tablet_bootstrap.cc:654] T 713b5728a197487c9300b310ab94e5a3 P b7ab4784c7344b939bc36f639286f377: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:08.709228  6922 tablet_bootstrap.cc:492] T dbdf895bba214ff68685a24fd17dfb5d P cd75a17ab2604397adab03bb8b5fd75c: No bootstrap required, opened a new log
I20260709 13:18:08.709734  6922 ts_tablet_manager.cc:1403] T dbdf895bba214ff68685a24fd17dfb5d P cd75a17ab2604397adab03bb8b5fd75c: Time spent bootstrapping tablet: real 0.105s	user 0.026s	sys 0.009s
I20260709 13:18:08.712378  6628 catalog_manager.cc:5697] T 24ee15416e3145beaa1b8183453729a3 P ccd8a4c3bfe3413cb2ae219b09aea832 reported cstate change: term changed from 0 to 1, leader changed from <none> to ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65). New cstate: current_term: 1 leader_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:08.713624  6923 raft_consensus.cc:359] T d8292e16e5654be6bc408560cf256aaa P ccd8a4c3bfe3413cb2ae219b09aea832 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
W20260709 13:18:08.699755  6697 leader_election.cc:343] T dbdf895bba214ff68685a24fd17dfb5d P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:08.715233  6922 raft_consensus.cc:359] T dbdf895bba214ff68685a24fd17dfb5d P cd75a17ab2604397adab03bb8b5fd75c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:08.715916  6922 raft_consensus.cc:385] T dbdf895bba214ff68685a24fd17dfb5d P cd75a17ab2604397adab03bb8b5fd75c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 13:18:08.715950  6697 leader_election.cc:343] T dbdf895bba214ff68685a24fd17dfb5d P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:08.716336  6922 raft_consensus.cc:740] T dbdf895bba214ff68685a24fd17dfb5d P cd75a17ab2604397adab03bb8b5fd75c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cd75a17ab2604397adab03bb8b5fd75c, State: Initialized, Role: FOLLOWER
I20260709 13:18:08.717078  6922 consensus_queue.cc:260] T dbdf895bba214ff68685a24fd17dfb5d P cd75a17ab2604397adab03bb8b5fd75c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:08.714411  6923 raft_consensus.cc:385] T d8292e16e5654be6bc408560cf256aaa P ccd8a4c3bfe3413cb2ae219b09aea832 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:08.717819  6921 tablet_bootstrap.cc:492] T 713b5728a197487c9300b310ab94e5a3 P b7ab4784c7344b939bc36f639286f377: No bootstrap required, opened a new log
I20260709 13:18:08.717677  7019 consensus_queue.cc:1048] T 7a734b5ab7834e05a8c422208acc58b1 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:18:08.717941  6923 raft_consensus.cc:740] T d8292e16e5654be6bc408560cf256aaa P ccd8a4c3bfe3413cb2ae219b09aea832 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Initialized, Role: FOLLOWER
I20260709 13:18:08.718324  6921 ts_tablet_manager.cc:1403] T 713b5728a197487c9300b310ab94e5a3 P b7ab4784c7344b939bc36f639286f377: Time spent bootstrapping tablet: real 0.023s	user 0.009s	sys 0.004s
I20260709 13:18:08.718667  6923 consensus_queue.cc:260] T d8292e16e5654be6bc408560cf256aaa P ccd8a4c3bfe3413cb2ae219b09aea832 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:08.720866  6923 ts_tablet_manager.cc:1434] T d8292e16e5654be6bc408560cf256aaa P ccd8a4c3bfe3413cb2ae219b09aea832: Time spent starting tablet: real 0.016s	user 0.006s	sys 0.001s
I20260709 13:18:08.721921  6923 tablet_bootstrap.cc:492] T 7c44c4849aa54f2b94d1f1bef9ed546f P ccd8a4c3bfe3413cb2ae219b09aea832: Bootstrap starting.
I20260709 13:18:08.722720  6921 raft_consensus.cc:359] T 713b5728a197487c9300b310ab94e5a3 P b7ab4784c7344b939bc36f639286f377 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:08.723565  6921 raft_consensus.cc:385] T 713b5728a197487c9300b310ab94e5a3 P b7ab4784c7344b939bc36f639286f377 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:08.723841  6921 raft_consensus.cc:740] T 713b5728a197487c9300b310ab94e5a3 P b7ab4784c7344b939bc36f639286f377 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Initialized, Role: FOLLOWER
I20260709 13:18:08.724555  6921 consensus_queue.cc:260] T 713b5728a197487c9300b310ab94e5a3 P b7ab4784c7344b939bc36f639286f377 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:08.727094  6921 ts_tablet_manager.cc:1434] T 713b5728a197487c9300b310ab94e5a3 P b7ab4784c7344b939bc36f639286f377: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:18:08.728199  6921 tablet_bootstrap.cc:492] T 7c44c4849aa54f2b94d1f1bef9ed546f P b7ab4784c7344b939bc36f639286f377: Bootstrap starting.
I20260709 13:18:08.730085  6922 ts_tablet_manager.cc:1434] T dbdf895bba214ff68685a24fd17dfb5d P cd75a17ab2604397adab03bb8b5fd75c: Time spent starting tablet: real 0.020s	user 0.005s	sys 0.002s
I20260709 13:18:08.731397  6922 tablet_bootstrap.cc:492] T bd6869f07b5a4885a0b99fbe60c3b175 P cd75a17ab2604397adab03bb8b5fd75c: Bootstrap starting.
I20260709 13:18:08.734735  6921 tablet_bootstrap.cc:654] T 7c44c4849aa54f2b94d1f1bef9ed546f P b7ab4784c7344b939bc36f639286f377: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:08.736183  6923 tablet_bootstrap.cc:654] T 7c44c4849aa54f2b94d1f1bef9ed546f P ccd8a4c3bfe3413cb2ae219b09aea832: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:08.745159  6959 raft_consensus.cc:493] T dbdf895bba214ff68685a24fd17dfb5d P cd75a17ab2604397adab03bb8b5fd75c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:08.745808  6959 raft_consensus.cc:515] T dbdf895bba214ff68685a24fd17dfb5d P cd75a17ab2604397adab03bb8b5fd75c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:08.748837  6922 tablet_bootstrap.cc:654] T bd6869f07b5a4885a0b99fbe60c3b175 P cd75a17ab2604397adab03bb8b5fd75c: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:08.749195  6729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbdf895bba214ff68685a24fd17dfb5d" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:18:08.756285  6629 catalog_manager.cc:5697] T dbdf895bba214ff68685a24fd17dfb5d P ccd8a4c3bfe3413cb2ae219b09aea832 reported cstate change: term changed from 0 to 1, leader changed from <none> to ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65). New cstate: current_term: 1 leader_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:08.757499  6923 tablet_bootstrap.cc:492] T 7c44c4849aa54f2b94d1f1bef9ed546f P ccd8a4c3bfe3413cb2ae219b09aea832: No bootstrap required, opened a new log
I20260709 13:18:08.758023  6923 ts_tablet_manager.cc:1403] T 7c44c4849aa54f2b94d1f1bef9ed546f P ccd8a4c3bfe3413cb2ae219b09aea832: Time spent bootstrapping tablet: real 0.036s	user 0.010s	sys 0.000s
I20260709 13:18:08.758214  7019 consensus_queue.cc:1048] T 7a734b5ab7834e05a8c422208acc58b1 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:18:08.758865  6921 tablet_bootstrap.cc:492] T 7c44c4849aa54f2b94d1f1bef9ed546f P b7ab4784c7344b939bc36f639286f377: No bootstrap required, opened a new log
I20260709 13:18:08.759395  6921 ts_tablet_manager.cc:1403] T 7c44c4849aa54f2b94d1f1bef9ed546f P b7ab4784c7344b939bc36f639286f377: Time spent bootstrapping tablet: real 0.032s	user 0.017s	sys 0.004s
I20260709 13:18:08.760573  6923 raft_consensus.cc:359] T 7c44c4849aa54f2b94d1f1bef9ed546f P ccd8a4c3bfe3413cb2ae219b09aea832 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:08.761299  6923 raft_consensus.cc:385] T 7c44c4849aa54f2b94d1f1bef9ed546f P ccd8a4c3bfe3413cb2ae219b09aea832 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:08.761545  6923 raft_consensus.cc:740] T 7c44c4849aa54f2b94d1f1bef9ed546f P ccd8a4c3bfe3413cb2ae219b09aea832 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Initialized, Role: FOLLOWER
I20260709 13:18:08.762148  6923 consensus_queue.cc:260] T 7c44c4849aa54f2b94d1f1bef9ed546f P ccd8a4c3bfe3413cb2ae219b09aea832 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:08.762766  6921 raft_consensus.cc:359] T 7c44c4849aa54f2b94d1f1bef9ed546f P b7ab4784c7344b939bc36f639286f377 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:08.763481  6921 raft_consensus.cc:385] T 7c44c4849aa54f2b94d1f1bef9ed546f P b7ab4784c7344b939bc36f639286f377 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:08.763773  6921 raft_consensus.cc:740] T 7c44c4849aa54f2b94d1f1bef9ed546f P b7ab4784c7344b939bc36f639286f377 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Initialized, Role: FOLLOWER
I20260709 13:18:08.764144  6923 ts_tablet_manager.cc:1434] T 7c44c4849aa54f2b94d1f1bef9ed546f P ccd8a4c3bfe3413cb2ae219b09aea832: Time spent starting tablet: real 0.006s	user 0.008s	sys 0.000s
I20260709 13:18:08.764520  6921 consensus_queue.cc:260] T 7c44c4849aa54f2b94d1f1bef9ed546f P b7ab4784c7344b939bc36f639286f377 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:08.766848  6921 ts_tablet_manager.cc:1434] T 7c44c4849aa54f2b94d1f1bef9ed546f P b7ab4784c7344b939bc36f639286f377: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:18:08.766762  6807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbdf895bba214ff68685a24fd17dfb5d" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:18:08.765177  6923 tablet_bootstrap.cc:492] T 95a75bfe094d4bdc963aba3f08dfcd25 P ccd8a4c3bfe3413cb2ae219b09aea832: Bootstrap starting.
I20260709 13:18:08.767637  6807 raft_consensus.cc:2393] T dbdf895bba214ff68685a24fd17dfb5d P b7ab4784c7344b939bc36f639286f377 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c in current term 1: Already voted for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in this term.
I20260709 13:18:08.768064  6921 tablet_bootstrap.cc:492] T 95a75bfe094d4bdc963aba3f08dfcd25 P b7ab4784c7344b939bc36f639286f377: Bootstrap starting.
I20260709 13:18:08.769064  6844 leader_election.cc:304] T dbdf895bba214ff68685a24fd17dfb5d P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:18:08.770031  7073 raft_consensus.cc:3060] T dbdf895bba214ff68685a24fd17dfb5d P cd75a17ab2604397adab03bb8b5fd75c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:08.772435  6951 raft_consensus.cc:493] T d8cee0accdb8499c86d4414b72565a38 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:08.773049  6951 raft_consensus.cc:515] T d8cee0accdb8499c86d4414b72565a38 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:08.765144  6959 leader_election.cc:290] T dbdf895bba214ff68685a24fd17dfb5d P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:18:08.781124  6921 tablet_bootstrap.cc:654] T 95a75bfe094d4bdc963aba3f08dfcd25 P b7ab4784c7344b939bc36f639286f377: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:08.785167  6951 leader_election.cc:290] T d8cee0accdb8499c86d4414b72565a38 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:18:08.794323  6923 tablet_bootstrap.cc:654] T 95a75bfe094d4bdc963aba3f08dfcd25 P ccd8a4c3bfe3413cb2ae219b09aea832: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:08.786623  6876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8cee0accdb8499c86d4414b72565a38" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:18:08.789506  7073 raft_consensus.cc:2749] T dbdf895bba214ff68685a24fd17dfb5d P cd75a17ab2604397adab03bb8b5fd75c [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:18:08.808207  6923 tablet_bootstrap.cc:492] T 95a75bfe094d4bdc963aba3f08dfcd25 P ccd8a4c3bfe3413cb2ae219b09aea832: No bootstrap required, opened a new log
W20260709 13:18:08.808627  6697 leader_election.cc:343] T d8cee0accdb8499c86d4414b72565a38 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:08.808801  6923 ts_tablet_manager.cc:1403] T 95a75bfe094d4bdc963aba3f08dfcd25 P ccd8a4c3bfe3413cb2ae219b09aea832: Time spent bootstrapping tablet: real 0.044s	user 0.014s	sys 0.008s
I20260709 13:18:08.815269  6806 raft_consensus.cc:1275] T 4f00a2e87e56452083b759f60d461ee3 P b7ab4784c7344b939bc36f639286f377 [term 3 FOLLOWER]: Refusing update from remote peer cd75a17ab2604397adab03bb8b5fd75c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:18:08.818310  6876 raft_consensus.cc:3060] T de3186201e1a40d0b335eeb8b4e256e0 P cd75a17ab2604397adab03bb8b5fd75c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:08.818878  7064 raft_consensus.cc:493] T 2c240553ce044eedb41541d72b9475d7 P b7ab4784c7344b939bc36f639286f377 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:08.818933  6923 raft_consensus.cc:359] T 95a75bfe094d4bdc963aba3f08dfcd25 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:08.819764  6923 raft_consensus.cc:385] T 95a75bfe094d4bdc963aba3f08dfcd25 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:08.819403  7064 raft_consensus.cc:515] T 2c240553ce044eedb41541d72b9475d7 P b7ab4784c7344b939bc36f639286f377 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:08.820923  7073 consensus_queue.cc:1048] T 4f00a2e87e56452083b759f60d461ee3 P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:18:08.822454  6923 raft_consensus.cc:740] T 95a75bfe094d4bdc963aba3f08dfcd25 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Initialized, Role: FOLLOWER
I20260709 13:18:08.791043  6807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8cee0accdb8499c86d4414b72565a38" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:18:08.823992  6923 consensus_queue.cc:260] T 95a75bfe094d4bdc963aba3f08dfcd25 P ccd8a4c3bfe3413cb2ae219b09aea832 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
W20260709 13:18:08.825726  6695 leader_election.cc:343] T d8cee0accdb8499c86d4414b72565a38 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:08.826207  6695 leader_election.cc:304] T d8cee0accdb8499c86d4414b72565a38 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:18:08.827455  6923 ts_tablet_manager.cc:1434] T 95a75bfe094d4bdc963aba3f08dfcd25 P ccd8a4c3bfe3413cb2ae219b09aea832: Time spent starting tablet: real 0.018s	user 0.004s	sys 0.001s
I20260709 13:18:08.827402  6986 raft_consensus.cc:2749] T d8cee0accdb8499c86d4414b72565a38 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:18:08.828732  6923 tablet_bootstrap.cc:492] T 34f36d59d88f40fe8a2805e604fc6c0a P ccd8a4c3bfe3413cb2ae219b09aea832: Bootstrap starting.
I20260709 13:18:08.830448  7064 leader_election.cc:290] T 2c240553ce044eedb41541d72b9475d7 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:18:08.832849  6729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c240553ce044eedb41541d72b9475d7" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:18:08.832975  6880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c240553ce044eedb41541d72b9475d7" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
W20260709 13:18:08.834848  6770 leader_election.cc:343] T 2c240553ce044eedb41541d72b9475d7 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:08.835700  6921 tablet_bootstrap.cc:492] T 95a75bfe094d4bdc963aba3f08dfcd25 P b7ab4784c7344b939bc36f639286f377: No bootstrap required, opened a new log
I20260709 13:18:08.836241  6921 ts_tablet_manager.cc:1403] T 95a75bfe094d4bdc963aba3f08dfcd25 P b7ab4784c7344b939bc36f639286f377: Time spent bootstrapping tablet: real 0.069s	user 0.016s	sys 0.008s
W20260709 13:18:08.836779  6772 leader_election.cc:343] T 2c240553ce044eedb41541d72b9475d7 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:08.837379  6772 leader_election.cc:304] T 2c240553ce044eedb41541d72b9475d7 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:18:08.838493  7064 raft_consensus.cc:2749] T 2c240553ce044eedb41541d72b9475d7 P b7ab4784c7344b939bc36f639286f377 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:18:08.839418  6921 raft_consensus.cc:359] T 95a75bfe094d4bdc963aba3f08dfcd25 P b7ab4784c7344b939bc36f639286f377 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:08.840266  6921 raft_consensus.cc:385] T 95a75bfe094d4bdc963aba3f08dfcd25 P b7ab4784c7344b939bc36f639286f377 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:08.840519  6921 raft_consensus.cc:740] T 95a75bfe094d4bdc963aba3f08dfcd25 P b7ab4784c7344b939bc36f639286f377 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Initialized, Role: FOLLOWER
I20260709 13:18:08.841244  6921 consensus_queue.cc:260] T 95a75bfe094d4bdc963aba3f08dfcd25 P b7ab4784c7344b939bc36f639286f377 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:08.842800  6921 ts_tablet_manager.cc:1434] T 95a75bfe094d4bdc963aba3f08dfcd25 P b7ab4784c7344b939bc36f639286f377: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:18:08.843077  6922 tablet_bootstrap.cc:492] T bd6869f07b5a4885a0b99fbe60c3b175 P cd75a17ab2604397adab03bb8b5fd75c: No bootstrap required, opened a new log
I20260709 13:18:08.843583  6922 ts_tablet_manager.cc:1403] T bd6869f07b5a4885a0b99fbe60c3b175 P cd75a17ab2604397adab03bb8b5fd75c: Time spent bootstrapping tablet: real 0.113s	user 0.027s	sys 0.009s
I20260709 13:18:08.843879  6921 tablet_bootstrap.cc:492] T b56bf91d90824c959e21e0cee5ba1816 P b7ab4784c7344b939bc36f639286f377: Bootstrap starting.
I20260709 13:18:08.848176  6729 raft_consensus.cc:1275] T 4f00a2e87e56452083b759f60d461ee3 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 3 FOLLOWER]: Refusing update from remote peer cd75a17ab2604397adab03bb8b5fd75c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
I20260709 13:18:08.848016  6922 raft_consensus.cc:359] T bd6869f07b5a4885a0b99fbe60c3b175 P cd75a17ab2604397adab03bb8b5fd75c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:08.853257  6922 raft_consensus.cc:385] T bd6869f07b5a4885a0b99fbe60c3b175 P cd75a17ab2604397adab03bb8b5fd75c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:08.853534  6923 tablet_bootstrap.cc:654] T 34f36d59d88f40fe8a2805e604fc6c0a P ccd8a4c3bfe3413cb2ae219b09aea832: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:08.853381  6729 pending_rounds.cc:85] T 4f00a2e87e56452083b759f60d461ee3 P ccd8a4c3bfe3413cb2ae219b09aea832: Aborting all ops after (but not including) 1
I20260709 13:18:08.853664  6922 raft_consensus.cc:740] T bd6869f07b5a4885a0b99fbe60c3b175 P cd75a17ab2604397adab03bb8b5fd75c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cd75a17ab2604397adab03bb8b5fd75c, State: Initialized, Role: FOLLOWER
I20260709 13:18:08.854386  6729 pending_rounds.cc:107] T 4f00a2e87e56452083b759f60d461ee3 P ccd8a4c3bfe3413cb2ae219b09aea832: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 13:18:08.855307  6729 raft_consensus.cc:2889] T 4f00a2e87e56452083b759f60d461ee3 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:18:08.854789  6922 consensus_queue.cc:260] T bd6869f07b5a4885a0b99fbe60c3b175 P cd75a17ab2604397adab03bb8b5fd75c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:08.862317  6922 ts_tablet_manager.cc:1434] T bd6869f07b5a4885a0b99fbe60c3b175 P cd75a17ab2604397adab03bb8b5fd75c: Time spent starting tablet: real 0.018s	user 0.005s	sys 0.002s
I20260709 13:18:08.863268  6922 tablet_bootstrap.cc:492] T 9b3759de40694069b13c0f8bd40e5709 P cd75a17ab2604397adab03bb8b5fd75c: Bootstrap starting.
I20260709 13:18:08.857595  6921 tablet_bootstrap.cc:654] T b56bf91d90824c959e21e0cee5ba1816 P b7ab4784c7344b939bc36f639286f377: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:08.863515  7073 consensus_queue.cc:1048] T 4f00a2e87e56452083b759f60d461ee3 P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Connected to new peer: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:18:08.871924  6922 tablet_bootstrap.cc:654] T 9b3759de40694069b13c0f8bd40e5709 P cd75a17ab2604397adab03bb8b5fd75c: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:08.878046  6923 tablet_bootstrap.cc:492] T 34f36d59d88f40fe8a2805e604fc6c0a P ccd8a4c3bfe3413cb2ae219b09aea832: No bootstrap required, opened a new log
I20260709 13:18:08.878657  6923 ts_tablet_manager.cc:1403] T 34f36d59d88f40fe8a2805e604fc6c0a P ccd8a4c3bfe3413cb2ae219b09aea832: Time spent bootstrapping tablet: real 0.050s	user 0.011s	sys 0.003s
I20260709 13:18:08.880183  6921 tablet_bootstrap.cc:492] T b56bf91d90824c959e21e0cee5ba1816 P b7ab4784c7344b939bc36f639286f377: No bootstrap required, opened a new log
I20260709 13:18:08.880667  6921 ts_tablet_manager.cc:1403] T b56bf91d90824c959e21e0cee5ba1816 P b7ab4784c7344b939bc36f639286f377: Time spent bootstrapping tablet: real 0.037s	user 0.008s	sys 0.005s
I20260709 13:18:08.881821  6923 raft_consensus.cc:359] T 34f36d59d88f40fe8a2805e604fc6c0a P ccd8a4c3bfe3413cb2ae219b09aea832 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:08.882674  6923 raft_consensus.cc:385] T 34f36d59d88f40fe8a2805e604fc6c0a P ccd8a4c3bfe3413cb2ae219b09aea832 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:08.882952  6923 raft_consensus.cc:740] T 34f36d59d88f40fe8a2805e604fc6c0a P ccd8a4c3bfe3413cb2ae219b09aea832 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Initialized, Role: FOLLOWER
I20260709 13:18:08.883867  6921 raft_consensus.cc:359] T b56bf91d90824c959e21e0cee5ba1816 P b7ab4784c7344b939bc36f639286f377 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:08.884858  6921 raft_consensus.cc:385] T b56bf91d90824c959e21e0cee5ba1816 P b7ab4784c7344b939bc36f639286f377 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:08.885141  6921 raft_consensus.cc:740] T b56bf91d90824c959e21e0cee5ba1816 P b7ab4784c7344b939bc36f639286f377 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Initialized, Role: FOLLOWER
I20260709 13:18:08.885804  6921 consensus_queue.cc:260] T b56bf91d90824c959e21e0cee5ba1816 P b7ab4784c7344b939bc36f639286f377 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:08.887717  6921 ts_tablet_manager.cc:1434] T b56bf91d90824c959e21e0cee5ba1816 P b7ab4784c7344b939bc36f639286f377: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 13:18:08.889549  6921 tablet_bootstrap.cc:492] T ab432e62819d499eaaf3dd55481dd930 P b7ab4784c7344b939bc36f639286f377: Bootstrap starting.
I20260709 13:18:08.899633  6921 tablet_bootstrap.cc:654] T ab432e62819d499eaaf3dd55481dd930 P b7ab4784c7344b939bc36f639286f377: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:08.903017  6951 raft_consensus.cc:493] T 7c44c4849aa54f2b94d1f1bef9ed546f P ccd8a4c3bfe3413cb2ae219b09aea832 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:08.903618  6951 raft_consensus.cc:515] T 7c44c4849aa54f2b94d1f1bef9ed546f P ccd8a4c3bfe3413cb2ae219b09aea832 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:08.906023  6951 leader_election.cc:290] T 7c44c4849aa54f2b94d1f1bef9ed546f P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:18:08.907295  6806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c44c4849aa54f2b94d1f1bef9ed546f" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:18:08.908121  6806 raft_consensus.cc:2468] T 7c44c4849aa54f2b94d1f1bef9ed546f P b7ab4784c7344b939bc36f639286f377 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 0.
I20260709 13:18:08.883919  6923 consensus_queue.cc:260] T 34f36d59d88f40fe8a2805e604fc6c0a P ccd8a4c3bfe3413cb2ae219b09aea832 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:08.912838  6876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c44c4849aa54f2b94d1f1bef9ed546f" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:18:08.913201  6695 leader_election.cc:304] T 7c44c4849aa54f2b94d1f1bef9ed546f P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
I20260709 13:18:08.914121  6986 raft_consensus.cc:493] T 34f36d59d88f40fe8a2805e604fc6c0a P ccd8a4c3bfe3413cb2ae219b09aea832 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:08.914690  6986 raft_consensus.cc:515] T 34f36d59d88f40fe8a2805e604fc6c0a P ccd8a4c3bfe3413cb2ae219b09aea832 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:08.912851  6921 tablet_bootstrap.cc:492] T ab432e62819d499eaaf3dd55481dd930 P b7ab4784c7344b939bc36f639286f377: No bootstrap required, opened a new log
I20260709 13:18:08.918926  6921 ts_tablet_manager.cc:1403] T ab432e62819d499eaaf3dd55481dd930 P b7ab4784c7344b939bc36f639286f377: Time spent bootstrapping tablet: real 0.030s	user 0.011s	sys 0.011s
I20260709 13:18:08.919003  6986 leader_election.cc:290] T 34f36d59d88f40fe8a2805e604fc6c0a P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:18:08.922477  6921 raft_consensus.cc:359] T ab432e62819d499eaaf3dd55481dd930 P b7ab4784c7344b939bc36f639286f377 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:08.923200  6921 raft_consensus.cc:385] T ab432e62819d499eaaf3dd55481dd930 P b7ab4784c7344b939bc36f639286f377 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:08.923568  6921 raft_consensus.cc:740] T ab432e62819d499eaaf3dd55481dd930 P b7ab4784c7344b939bc36f639286f377 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Initialized, Role: FOLLOWER
I20260709 13:18:08.924520  6921 consensus_queue.cc:260] T ab432e62819d499eaaf3dd55481dd930 P b7ab4784c7344b939bc36f639286f377 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
W20260709 13:18:08.925509  6697 leader_election.cc:343] T 7c44c4849aa54f2b94d1f1bef9ed546f P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:08.926427  6921 ts_tablet_manager.cc:1434] T ab432e62819d499eaaf3dd55481dd930 P b7ab4784c7344b939bc36f639286f377: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:18:08.927856  6923 ts_tablet_manager.cc:1434] T 34f36d59d88f40fe8a2805e604fc6c0a P ccd8a4c3bfe3413cb2ae219b09aea832: Time spent starting tablet: real 0.049s	user 0.008s	sys 0.002s
I20260709 13:18:08.919785  6986 raft_consensus.cc:2804] T 7c44c4849aa54f2b94d1f1bef9ed546f P ccd8a4c3bfe3413cb2ae219b09aea832 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:18:08.935956  6986 raft_consensus.cc:493] T 7c44c4849aa54f2b94d1f1bef9ed546f P ccd8a4c3bfe3413cb2ae219b09aea832 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:08.936401  6986 raft_consensus.cc:3060] T 7c44c4849aa54f2b94d1f1bef9ed546f P ccd8a4c3bfe3413cb2ae219b09aea832 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:08.938926  6923 tablet_bootstrap.cc:492] T bb3d8792045a4583ae2e965b1350a5b4 P ccd8a4c3bfe3413cb2ae219b09aea832: Bootstrap starting.
I20260709 13:18:08.928113  6921 tablet_bootstrap.cc:492] T 427c124d773f483294511e80fe340075 P b7ab4784c7344b939bc36f639286f377: Bootstrap starting.
W20260709 13:18:08.929184  6772 consensus_peers.cc:597] T a1704639a875409b9959353527b3fd68 P b7ab4784c7344b939bc36f639286f377 -> Peer cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931): Couldn't send request to peer cd75a17ab2604397adab03bb8b5fd75c. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:08.929340  6876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34f36d59d88f40fe8a2805e604fc6c0a" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:18:08.931116  6806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34f36d59d88f40fe8a2805e604fc6c0a" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:18:08.945876  6806 raft_consensus.cc:2468] T 34f36d59d88f40fe8a2805e604fc6c0a P b7ab4784c7344b939bc36f639286f377 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 0.
I20260709 13:18:08.932557  7064 raft_consensus.cc:493] T 95a75bfe094d4bdc963aba3f08dfcd25 P b7ab4784c7344b939bc36f639286f377 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:08.946774  7064 raft_consensus.cc:515] T 95a75bfe094d4bdc963aba3f08dfcd25 P b7ab4784c7344b939bc36f639286f377 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:08.949381  7064 leader_election.cc:290] T 95a75bfe094d4bdc963aba3f08dfcd25 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:18:08.951041  6729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a75bfe094d4bdc963aba3f08dfcd25" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:18:08.951051  6876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a75bfe094d4bdc963aba3f08dfcd25" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:18:08.951666  6921 tablet_bootstrap.cc:654] T 427c124d773f483294511e80fe340075 P b7ab4784c7344b939bc36f639286f377: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:08.951949  6729 raft_consensus.cc:2468] T 95a75bfe094d4bdc963aba3f08dfcd25 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 0.
W20260709 13:18:08.952715  6772 leader_election.cc:343] T 95a75bfe094d4bdc963aba3f08dfcd25 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:08.953394  6770 leader_election.cc:304] T 95a75bfe094d4bdc963aba3f08dfcd25 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:18:08.955422  7020 raft_consensus.cc:2804] T 95a75bfe094d4bdc963aba3f08dfcd25 P b7ab4784c7344b939bc36f639286f377 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:18:08.955797  7020 raft_consensus.cc:493] T 95a75bfe094d4bdc963aba3f08dfcd25 P b7ab4784c7344b939bc36f639286f377 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:08.956180  7020 raft_consensus.cc:3060] T 95a75bfe094d4bdc963aba3f08dfcd25 P b7ab4784c7344b939bc36f639286f377 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:18:08.959594  6697 leader_election.cc:343] T 34f36d59d88f40fe8a2805e604fc6c0a P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:08.962037  6695 leader_election.cc:304] T 34f36d59d88f40fe8a2805e604fc6c0a P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:18:08.964846  6931 raft_consensus.cc:2804] T 34f36d59d88f40fe8a2805e604fc6c0a P ccd8a4c3bfe3413cb2ae219b09aea832 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:18:08.965269  6931 raft_consensus.cc:493] T 34f36d59d88f40fe8a2805e604fc6c0a P ccd8a4c3bfe3413cb2ae219b09aea832 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:08.965582  6931 raft_consensus.cc:3060] T 34f36d59d88f40fe8a2805e604fc6c0a P ccd8a4c3bfe3413cb2ae219b09aea832 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:08.973687  6922 tablet_bootstrap.cc:492] T 9b3759de40694069b13c0f8bd40e5709 P cd75a17ab2604397adab03bb8b5fd75c: No bootstrap required, opened a new log
I20260709 13:18:08.974198  6922 ts_tablet_manager.cc:1403] T 9b3759de40694069b13c0f8bd40e5709 P cd75a17ab2604397adab03bb8b5fd75c: Time spent bootstrapping tablet: real 0.111s	user 0.042s	sys 0.033s
I20260709 13:18:08.978449  6931 raft_consensus.cc:515] T 34f36d59d88f40fe8a2805e604fc6c0a P ccd8a4c3bfe3413cb2ae219b09aea832 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:08.984354  6931 leader_election.cc:290] T 34f36d59d88f40fe8a2805e604fc6c0a P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 1 election: Requested vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:18:08.988279  6807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34f36d59d88f40fe8a2805e604fc6c0a" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:18:08.989172  6807 raft_consensus.cc:3060] T 34f36d59d88f40fe8a2805e604fc6c0a P b7ab4784c7344b939bc36f639286f377 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:08.996447  7073 raft_consensus.cc:493] T bd6869f07b5a4885a0b99fbe60c3b175 P cd75a17ab2604397adab03bb8b5fd75c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:08.997145  7073 raft_consensus.cc:515] T bd6869f07b5a4885a0b99fbe60c3b175 P cd75a17ab2604397adab03bb8b5fd75c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:08.995005  6986 raft_consensus.cc:515] T 7c44c4849aa54f2b94d1f1bef9ed546f P ccd8a4c3bfe3413cb2ae219b09aea832 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:08.999366  7073 leader_election.cc:290] T bd6869f07b5a4885a0b99fbe60c3b175 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:18:09.015888  6986 leader_election.cc:290] T 7c44c4849aa54f2b94d1f1bef9ed546f P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 1 election: Requested vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:18:08.969185  7020 raft_consensus.cc:515] T 95a75bfe094d4bdc963aba3f08dfcd25 P b7ab4784c7344b939bc36f639286f377 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:09.072489  7020 leader_election.cc:290] T 95a75bfe094d4bdc963aba3f08dfcd25 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 1 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:18:09.081992  6880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34f36d59d88f40fe8a2805e604fc6c0a" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:18:09.085942  6807 raft_consensus.cc:2468] T 34f36d59d88f40fe8a2805e604fc6c0a P b7ab4784c7344b939bc36f639286f377 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 1.
I20260709 13:18:09.087445  6880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a75bfe094d4bdc963aba3f08dfcd25" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:18:09.088006  6923 tablet_bootstrap.cc:654] T bb3d8792045a4583ae2e965b1350a5b4 P ccd8a4c3bfe3413cb2ae219b09aea832: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:09.083987  6922 raft_consensus.cc:359] T 9b3759de40694069b13c0f8bd40e5709 P cd75a17ab2604397adab03bb8b5fd75c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:09.090408  6922 raft_consensus.cc:385] T 9b3759de40694069b13c0f8bd40e5709 P cd75a17ab2604397adab03bb8b5fd75c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:09.090808  6922 raft_consensus.cc:740] T 9b3759de40694069b13c0f8bd40e5709 P cd75a17ab2604397adab03bb8b5fd75c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cd75a17ab2604397adab03bb8b5fd75c, State: Initialized, Role: FOLLOWER
I20260709 13:18:09.091823  6922 consensus_queue.cc:260] T 9b3759de40694069b13c0f8bd40e5709 P cd75a17ab2604397adab03bb8b5fd75c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:09.094264  6922 ts_tablet_manager.cc:1434] T 9b3759de40694069b13c0f8bd40e5709 P cd75a17ab2604397adab03bb8b5fd75c: Time spent starting tablet: real 0.120s	user 0.009s	sys 0.000s
I20260709 13:18:09.096279  6922 tablet_bootstrap.cc:492] T 3d65025eea89441290d85dd053810e31 P cd75a17ab2604397adab03bb8b5fd75c: Bootstrap starting.
I20260709 13:18:09.097318  6695 leader_election.cc:304] T 34f36d59d88f40fe8a2805e604fc6c0a P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
I20260709 13:18:09.098205  6986 raft_consensus.cc:2804] T 34f36d59d88f40fe8a2805e604fc6c0a P ccd8a4c3bfe3413cb2ae219b09aea832 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:18:09.097522  6806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c44c4849aa54f2b94d1f1bef9ed546f" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:18:09.098971  6806 raft_consensus.cc:3060] T 7c44c4849aa54f2b94d1f1bef9ed546f P b7ab4784c7344b939bc36f639286f377 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:09.100310  6986 raft_consensus.cc:697] T 34f36d59d88f40fe8a2805e604fc6c0a P ccd8a4c3bfe3413cb2ae219b09aea832 [term 1 LEADER]: Becoming Leader. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
I20260709 13:18:09.100952  7150 consensus_queue.cc:1048] T fe20b4b48823486ca3b9c648db6ce8aa P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:18:09.101888  6986 consensus_queue.cc:237] T 34f36d59d88f40fe8a2805e604fc6c0a P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:09.103992  6923 tablet_bootstrap.cc:492] T bb3d8792045a4583ae2e965b1350a5b4 P ccd8a4c3bfe3413cb2ae219b09aea832: No bootstrap required, opened a new log
I20260709 13:18:09.104487  6923 ts_tablet_manager.cc:1403] T bb3d8792045a4583ae2e965b1350a5b4 P ccd8a4c3bfe3413cb2ae219b09aea832: Time spent bootstrapping tablet: real 0.166s	user 0.014s	sys 0.000s
I20260709 13:18:09.107740  6922 tablet_bootstrap.cc:654] T 3d65025eea89441290d85dd053810e31 P cd75a17ab2604397adab03bb8b5fd75c: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:09.107628  6923 raft_consensus.cc:359] T bb3d8792045a4583ae2e965b1350a5b4 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:09.108388  6923 raft_consensus.cc:385] T bb3d8792045a4583ae2e965b1350a5b4 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:09.108687  6923 raft_consensus.cc:740] T bb3d8792045a4583ae2e965b1350a5b4 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Initialized, Role: FOLLOWER
I20260709 13:18:09.109473  6923 consensus_queue.cc:260] T bb3d8792045a4583ae2e965b1350a5b4 P ccd8a4c3bfe3413cb2ae219b09aea832 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:09.121932  6923 ts_tablet_manager.cc:1434] T bb3d8792045a4583ae2e965b1350a5b4 P ccd8a4c3bfe3413cb2ae219b09aea832: Time spent starting tablet: real 0.017s	user 0.007s	sys 0.000s
I20260709 13:18:09.123344  6923 tablet_bootstrap.cc:492] T 9e326172347f45e99a0d482b5d8ef768 P ccd8a4c3bfe3413cb2ae219b09aea832: Bootstrap starting.
I20260709 13:18:09.123725  7150 raft_consensus.cc:493] T d8292e16e5654be6bc408560cf256aaa P ccd8a4c3bfe3413cb2ae219b09aea832 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:09.126154  7150 raft_consensus.cc:515] T d8292e16e5654be6bc408560cf256aaa P ccd8a4c3bfe3413cb2ae219b09aea832 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
W20260709 13:18:09.124562  6772 leader_election.cc:343] T 95a75bfe094d4bdc963aba3f08dfcd25 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:09.125406  6806 raft_consensus.cc:2468] T 7c44c4849aa54f2b94d1f1bef9ed546f P b7ab4784c7344b939bc36f639286f377 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 1.
I20260709 13:18:09.141510  6921 tablet_bootstrap.cc:492] T 427c124d773f483294511e80fe340075 P b7ab4784c7344b939bc36f639286f377: No bootstrap required, opened a new log
I20260709 13:18:09.142136  6921 ts_tablet_manager.cc:1403] T 427c124d773f483294511e80fe340075 P b7ab4784c7344b939bc36f639286f377: Time spent bootstrapping tablet: real 0.214s	user 0.030s	sys 0.005s
I20260709 13:18:09.144826  6922 tablet_bootstrap.cc:492] T 3d65025eea89441290d85dd053810e31 P cd75a17ab2604397adab03bb8b5fd75c: No bootstrap required, opened a new log
I20260709 13:18:09.145488  6922 ts_tablet_manager.cc:1403] T 3d65025eea89441290d85dd053810e31 P cd75a17ab2604397adab03bb8b5fd75c: Time spent bootstrapping tablet: real 0.050s	user 0.016s	sys 0.006s
I20260709 13:18:09.151876  6880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c44c4849aa54f2b94d1f1bef9ed546f" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:18:09.171103  6695 leader_election.cc:304] T 7c44c4849aa54f2b94d1f1bef9ed546f P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
I20260709 13:18:09.173022  6951 raft_consensus.cc:2804] T 7c44c4849aa54f2b94d1f1bef9ed546f P ccd8a4c3bfe3413cb2ae219b09aea832 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:18:09.151257  7150 leader_election.cc:290] T d8292e16e5654be6bc408560cf256aaa P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:18:09.173470  6951 raft_consensus.cc:697] T 7c44c4849aa54f2b94d1f1bef9ed546f P ccd8a4c3bfe3413cb2ae219b09aea832 [term 1 LEADER]: Becoming Leader. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
I20260709 13:18:09.138046  7019 consensus_queue.cc:1048] T dbdf895bba214ff68685a24fd17dfb5d P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.028s
I20260709 13:18:09.174208  6951 consensus_queue.cc:237] T 7c44c4849aa54f2b94d1f1bef9ed546f P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:09.151124  7020 raft_consensus.cc:493] T 713b5728a197487c9300b310ab94e5a3 P b7ab4784c7344b939bc36f639286f377 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:09.177712  6922 raft_consensus.cc:359] T 3d65025eea89441290d85dd053810e31 P cd75a17ab2604397adab03bb8b5fd75c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:09.178537  6922 raft_consensus.cc:385] T 3d65025eea89441290d85dd053810e31 P cd75a17ab2604397adab03bb8b5fd75c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:09.178825  6922 raft_consensus.cc:740] T 3d65025eea89441290d85dd053810e31 P cd75a17ab2604397adab03bb8b5fd75c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cd75a17ab2604397adab03bb8b5fd75c, State: Initialized, Role: FOLLOWER
I20260709 13:18:09.179384  6922 consensus_queue.cc:260] T 3d65025eea89441290d85dd053810e31 P cd75a17ab2604397adab03bb8b5fd75c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:09.180474  6921 raft_consensus.cc:359] T 427c124d773f483294511e80fe340075 P b7ab4784c7344b939bc36f639286f377 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:09.178128  7020 raft_consensus.cc:515] T 713b5728a197487c9300b310ab94e5a3 P b7ab4784c7344b939bc36f639286f377 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:09.187470  6921 raft_consensus.cc:385] T 427c124d773f483294511e80fe340075 P b7ab4784c7344b939bc36f639286f377 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:09.188220  6923 tablet_bootstrap.cc:654] T 9e326172347f45e99a0d482b5d8ef768 P ccd8a4c3bfe3413cb2ae219b09aea832: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:09.188390  6729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6869f07b5a4885a0b99fbe60c3b175" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:18:09.187836  6921 raft_consensus.cc:740] T 427c124d773f483294511e80fe340075 P b7ab4784c7344b939bc36f639286f377 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Initialized, Role: FOLLOWER
I20260709 13:18:09.196208  6922 ts_tablet_manager.cc:1434] T 3d65025eea89441290d85dd053810e31 P cd75a17ab2604397adab03bb8b5fd75c: Time spent starting tablet: real 0.050s	user 0.009s	sys 0.000s
I20260709 13:18:09.205852  6729 raft_consensus.cc:2393] T bd6869f07b5a4885a0b99fbe60c3b175 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c in current term 1: Already voted for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in this term.
I20260709 13:18:09.209614  6732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a75bfe094d4bdc963aba3f08dfcd25" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:18:09.210282  6732 raft_consensus.cc:3060] T 95a75bfe094d4bdc963aba3f08dfcd25 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:09.214607  6806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8292e16e5654be6bc408560cf256aaa" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:18:09.217213  6732 raft_consensus.cc:2468] T 95a75bfe094d4bdc963aba3f08dfcd25 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 1.
I20260709 13:18:09.218994  6922 tablet_bootstrap.cc:492] T f5be3a11b23d4ea9b08300a2789821c7 P cd75a17ab2604397adab03bb8b5fd75c: Bootstrap starting.
I20260709 13:18:09.224014  6880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "713b5728a197487c9300b310ab94e5a3" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:18:09.227150  6921 consensus_queue.cc:260] T 427c124d773f483294511e80fe340075 P b7ab4784c7344b939bc36f639286f377 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:09.232934  6921 ts_tablet_manager.cc:1434] T 427c124d773f483294511e80fe340075 P b7ab4784c7344b939bc36f639286f377: Time spent starting tablet: real 0.090s	user 0.001s	sys 0.007s
I20260709 13:18:09.234084  6921 tablet_bootstrap.cc:492] T c4db81d9d329422bb3b4160ca4ac2d1d P b7ab4784c7344b939bc36f639286f377: Bootstrap starting.
W20260709 13:18:09.236732  6772 leader_election.cc:343] T 713b5728a197487c9300b310ab94e5a3 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:09.223197  7020 leader_election.cc:290] T 713b5728a197487c9300b310ab94e5a3 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
W20260709 13:18:09.246907  6697 leader_election.cc:343] T 34f36d59d88f40fe8a2805e604fc6c0a P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:18:09.247923  6697 leader_election.cc:343] T 7c44c4849aa54f2b94d1f1bef9ed546f P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:18:09.247973  6695 leader_election.cc:343] T d8292e16e5654be6bc408560cf256aaa P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:18:09.250662  6697 consensus_peers.cc:597] T 24ee15416e3145beaa1b8183453729a3 P ccd8a4c3bfe3413cb2ae219b09aea832 -> Peer cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931): Couldn't send request to peer cd75a17ab2604397adab03bb8b5fd75c. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:18:09.251917  6697 consensus_peers.cc:597] T fe20b4b48823486ca3b9c648db6ce8aa P ccd8a4c3bfe3413cb2ae219b09aea832 -> Peer cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931): Couldn't send request to peer cd75a17ab2604397adab03bb8b5fd75c. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:09.269291  6770 leader_election.cc:304] T 95a75bfe094d4bdc963aba3f08dfcd25 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:18:09.275249  6957 raft_consensus.cc:2804] T 95a75bfe094d4bdc963aba3f08dfcd25 P b7ab4784c7344b939bc36f639286f377 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:18:09.275801  6957 raft_consensus.cc:697] T 95a75bfe094d4bdc963aba3f08dfcd25 P b7ab4784c7344b939bc36f639286f377 [term 1 LEADER]: Becoming Leader. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
I20260709 13:18:09.276435  6729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "713b5728a197487c9300b310ab94e5a3" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:18:09.294651  7220 consensus_queue.cc:1048] T a1704639a875409b9959353527b3fd68 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.036s
I20260709 13:18:09.276701  6957 consensus_queue.cc:237] T 95a75bfe094d4bdc963aba3f08dfcd25 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:09.322605  7073 raft_consensus.cc:493] T 9b3759de40694069b13c0f8bd40e5709 P cd75a17ab2604397adab03bb8b5fd75c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:09.324631  7073 raft_consensus.cc:515] T 9b3759de40694069b13c0f8bd40e5709 P cd75a17ab2604397adab03bb8b5fd75c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:09.327483  7073 leader_election.cc:290] T 9b3759de40694069b13c0f8bd40e5709 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
W20260709 13:18:09.331185  6770 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 62019.8us
I20260709 13:18:09.331178  7073 raft_consensus.cc:493] T 3d65025eea89441290d85dd053810e31 P cd75a17ab2604397adab03bb8b5fd75c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:09.336556  6806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6869f07b5a4885a0b99fbe60c3b175" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
W20260709 13:18:09.337309  6770 leader_election.cc:343] T 713b5728a197487c9300b310ab94e5a3 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:09.337404  6806 raft_consensus.cc:2393] T bd6869f07b5a4885a0b99fbe60c3b175 P b7ab4784c7344b939bc36f639286f377 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c in current term 1: Already voted for candidate b7ab4784c7344b939bc36f639286f377 in this term.
I20260709 13:18:09.337952  6770 leader_election.cc:304] T 713b5728a197487c9300b310ab94e5a3 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:18:09.342232  6923 tablet_bootstrap.cc:492] T 9e326172347f45e99a0d482b5d8ef768 P ccd8a4c3bfe3413cb2ae219b09aea832: No bootstrap required, opened a new log
I20260709 13:18:09.342727  6923 ts_tablet_manager.cc:1403] T 9e326172347f45e99a0d482b5d8ef768 P ccd8a4c3bfe3413cb2ae219b09aea832: Time spent bootstrapping tablet: real 0.220s	user 0.016s	sys 0.024s
I20260709 13:18:09.343164  7064 raft_consensus.cc:2749] T 713b5728a197487c9300b310ab94e5a3 P b7ab4784c7344b939bc36f639286f377 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:18:09.343688  6732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b3759de40694069b13c0f8bd40e5709" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:18:09.352531  6922 tablet_bootstrap.cc:654] T f5be3a11b23d4ea9b08300a2789821c7 P cd75a17ab2604397adab03bb8b5fd75c: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:09.339416  7073 raft_consensus.cc:515] T 3d65025eea89441290d85dd053810e31 P cd75a17ab2604397adab03bb8b5fd75c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:09.355096  7073 leader_election.cc:290] T 3d65025eea89441290d85dd053810e31 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:18:09.351855  6844 leader_election.cc:304] T bd6869f07b5a4885a0b99fbe60c3b175 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:18:09.364054  7020 raft_consensus.cc:493] T ab432e62819d499eaaf3dd55481dd930 P b7ab4784c7344b939bc36f639286f377 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:09.369243  7020 raft_consensus.cc:515] T ab432e62819d499eaaf3dd55481dd930 P b7ab4784c7344b939bc36f639286f377 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:09.370764  6959 raft_consensus.cc:3060] T bd6869f07b5a4885a0b99fbe60c3b175 P cd75a17ab2604397adab03bb8b5fd75c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:09.370589  6730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d65025eea89441290d85dd053810e31" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:18:09.371654  7020 leader_election.cc:290] T ab432e62819d499eaaf3dd55481dd930 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:18:09.372427  7221 raft_consensus.cc:493] T bb3d8792045a4583ae2e965b1350a5b4 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:09.374140  6951 consensus_queue.cc:1048] T dbdf895bba214ff68685a24fd17dfb5d P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
W20260709 13:18:09.380985  6844 leader_election.cc:343] T 3d65025eea89441290d85dd053810e31 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:09.379614  7221 raft_consensus.cc:515] T bb3d8792045a4583ae2e965b1350a5b4 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:09.379284  7020 raft_consensus.cc:493] T b56bf91d90824c959e21e0cee5ba1816 P b7ab4784c7344b939bc36f639286f377 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:09.395984  6877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8292e16e5654be6bc408560cf256aaa" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:18:09.396829  6921 tablet_bootstrap.cc:654] T c4db81d9d329422bb3b4160ca4ac2d1d P b7ab4784c7344b939bc36f639286f377: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:09.401126  7020 raft_consensus.cc:515] T b56bf91d90824c959e21e0cee5ba1816 P b7ab4784c7344b939bc36f639286f377 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:09.402601  6880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab432e62819d499eaaf3dd55481dd930" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:18:09.410794  6732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab432e62819d499eaaf3dd55481dd930" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
W20260709 13:18:09.416218  6770 leader_election.cc:343] T ab432e62819d499eaaf3dd55481dd930 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:09.427433  6923 raft_consensus.cc:359] T 9e326172347f45e99a0d482b5d8ef768 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:09.428572  6923 raft_consensus.cc:385] T 9e326172347f45e99a0d482b5d8ef768 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:09.428946  6923 raft_consensus.cc:740] T 9e326172347f45e99a0d482b5d8ef768 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Initialized, Role: FOLLOWER
I20260709 13:18:09.436841  7020 leader_election.cc:290] T b56bf91d90824c959e21e0cee5ba1816 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:18:09.440558  6806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d65025eea89441290d85dd053810e31" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:18:09.441511  6806 raft_consensus.cc:2468] T 3d65025eea89441290d85dd053810e31 P b7ab4784c7344b939bc36f639286f377 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 0.
I20260709 13:18:09.433589  7222 consensus_queue.cc:1048] T 24ee15416e3145beaa1b8183453729a3 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.041s
I20260709 13:18:09.449059  6732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b56bf91d90824c959e21e0cee5ba1816" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:18:09.450798  6807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b3759de40694069b13c0f8bd40e5709" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:18:09.442911  6844 leader_election.cc:304] T 3d65025eea89441290d85dd053810e31 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: ccd8a4c3bfe3413cb2ae219b09aea832
W20260709 13:18:09.462620  6697 leader_election.cc:343] T d8292e16e5654be6bc408560cf256aaa P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:09.463320  6697 leader_election.cc:304] T d8292e16e5654be6bc408560cf256aaa P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:18:09.470868  7219 raft_consensus.cc:2749] T d8292e16e5654be6bc408560cf256aaa P ccd8a4c3bfe3413cb2ae219b09aea832 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:18:09.471971  6844 leader_election.cc:304] T 9b3759de40694069b13c0f8bd40e5709 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
W20260709 13:18:09.473668  6772 leader_election.cc:343] T ab432e62819d499eaaf3dd55481dd930 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:09.473836  7073 raft_consensus.cc:2749] T 9b3759de40694069b13c0f8bd40e5709 P cd75a17ab2604397adab03bb8b5fd75c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:18:09.474431  6772 leader_election.cc:304] T ab432e62819d499eaaf3dd55481dd930 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:18:09.476250  7064 raft_consensus.cc:2749] T ab432e62819d499eaaf3dd55481dd930 P b7ab4784c7344b939bc36f639286f377 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:18:09.478296  6770 leader_election.cc:343] T b56bf91d90824c959e21e0cee5ba1816 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:09.480670  7221 leader_election.cc:290] T bb3d8792045a4583ae2e965b1350a5b4 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:18:09.482918  6922 tablet_bootstrap.cc:492] T f5be3a11b23d4ea9b08300a2789821c7 P cd75a17ab2604397adab03bb8b5fd75c: No bootstrap required, opened a new log
I20260709 13:18:09.483556  6922 ts_tablet_manager.cc:1403] T f5be3a11b23d4ea9b08300a2789821c7 P cd75a17ab2604397adab03bb8b5fd75c: Time spent bootstrapping tablet: real 0.265s	user 0.029s	sys 0.009s
I20260709 13:18:09.492111  7220 raft_consensus.cc:493] T 427c124d773f483294511e80fe340075 P b7ab4784c7344b939bc36f639286f377 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:09.495586  7220 raft_consensus.cc:515] T 427c124d773f483294511e80fe340075 P b7ab4784c7344b939bc36f639286f377 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:09.497195  6878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3d8792045a4583ae2e965b1350a5b4" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:18:09.498519  7220 leader_election.cc:290] T 427c124d773f483294511e80fe340075 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:18:09.501207  6877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b56bf91d90824c959e21e0cee5ba1816" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:18:09.501744  6921 tablet_bootstrap.cc:492] T c4db81d9d329422bb3b4160ca4ac2d1d P b7ab4784c7344b939bc36f639286f377: No bootstrap required, opened a new log
W20260709 13:18:09.505374  6697 leader_election.cc:343] T bb3d8792045a4583ae2e965b1350a5b4 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:09.506660  6921 ts_tablet_manager.cc:1403] T c4db81d9d329422bb3b4160ca4ac2d1d P b7ab4784c7344b939bc36f639286f377: Time spent bootstrapping tablet: real 0.273s	user 0.024s	sys 0.020s
I20260709 13:18:09.511168  6923 consensus_queue.cc:260] T 9e326172347f45e99a0d482b5d8ef768 P ccd8a4c3bfe3413cb2ae219b09aea832 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:09.508577  6630 catalog_manager.cc:5697] T 34f36d59d88f40fe8a2805e604fc6c0a P ccd8a4c3bfe3413cb2ae219b09aea832 reported cstate change: term changed from 0 to 1, leader changed from <none> to ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65). New cstate: current_term: 1 leader_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:09.513132  6730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "427c124d773f483294511e80fe340075" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
W20260709 13:18:09.512877  6772 leader_election.cc:343] T b56bf91d90824c959e21e0cee5ba1816 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:09.514032  6922 raft_consensus.cc:359] T f5be3a11b23d4ea9b08300a2789821c7 P cd75a17ab2604397adab03bb8b5fd75c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:09.520895  6922 raft_consensus.cc:385] T f5be3a11b23d4ea9b08300a2789821c7 P cd75a17ab2604397adab03bb8b5fd75c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:09.520787  6772 leader_election.cc:304] T b56bf91d90824c959e21e0cee5ba1816 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:18:09.521365  6922 raft_consensus.cc:740] T f5be3a11b23d4ea9b08300a2789821c7 P cd75a17ab2604397adab03bb8b5fd75c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cd75a17ab2604397adab03bb8b5fd75c, State: Initialized, Role: FOLLOWER
I20260709 13:18:09.522176  6922 consensus_queue.cc:260] T f5be3a11b23d4ea9b08300a2789821c7 P cd75a17ab2604397adab03bb8b5fd75c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:09.532107  6802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3d8792045a4583ae2e965b1350a5b4" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:18:09.532688  6922 ts_tablet_manager.cc:1434] T f5be3a11b23d4ea9b08300a2789821c7 P cd75a17ab2604397adab03bb8b5fd75c: Time spent starting tablet: real 0.049s	user 0.007s	sys 0.001s
I20260709 13:18:09.532936  6802 raft_consensus.cc:2468] T bb3d8792045a4583ae2e965b1350a5b4 P b7ab4784c7344b939bc36f639286f377 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 0.
W20260709 13:18:09.536576  6678 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:18:09.551625  6630 catalog_manager.cc:5697] T 7c44c4849aa54f2b94d1f1bef9ed546f P ccd8a4c3bfe3413cb2ae219b09aea832 reported cstate change: term changed from 0 to 1, leader changed from <none> to ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65). New cstate: current_term: 1 leader_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } health_report { overall_health: UNKNOWN } } }
W20260709 13:18:09.561282  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 89417.9us
I20260709 13:18:09.563072  6923 ts_tablet_manager.cc:1434] T 9e326172347f45e99a0d482b5d8ef768 P ccd8a4c3bfe3413cb2ae219b09aea832: Time spent starting tablet: real 0.220s	user 0.011s	sys 0.006s
I20260709 13:18:09.566166  7206 raft_consensus.cc:2804] T 3d65025eea89441290d85dd053810e31 P cd75a17ab2604397adab03bb8b5fd75c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:18:09.566839  7206 raft_consensus.cc:493] T 3d65025eea89441290d85dd053810e31 P cd75a17ab2604397adab03bb8b5fd75c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:09.567229  6922 tablet_bootstrap.cc:492] T bb3d8792045a4583ae2e965b1350a5b4 P cd75a17ab2604397adab03bb8b5fd75c: Bootstrap starting.
W20260709 13:18:09.567087  6770 leader_election.cc:343] T 427c124d773f483294511e80fe340075 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:09.567345  7206 raft_consensus.cc:3060] T 3d65025eea89441290d85dd053810e31 P cd75a17ab2604397adab03bb8b5fd75c [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:18:09.568902  6695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 53530.9us
I20260709 13:18:09.525426  6959 raft_consensus.cc:2749] T bd6869f07b5a4885a0b99fbe60c3b175 P cd75a17ab2604397adab03bb8b5fd75c [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:18:09.525126  7220 raft_consensus.cc:2749] T b56bf91d90824c959e21e0cee5ba1816 P b7ab4784c7344b939bc36f639286f377 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:18:09.575773  6921 raft_consensus.cc:359] T c4db81d9d329422bb3b4160ca4ac2d1d P b7ab4784c7344b939bc36f639286f377 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:09.579567  6921 raft_consensus.cc:385] T c4db81d9d329422bb3b4160ca4ac2d1d P b7ab4784c7344b939bc36f639286f377 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:09.580257  6921 raft_consensus.cc:740] T c4db81d9d329422bb3b4160ca4ac2d1d P b7ab4784c7344b939bc36f639286f377 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Initialized, Role: FOLLOWER
I20260709 13:18:09.582777  6921 consensus_queue.cc:260] T c4db81d9d329422bb3b4160ca4ac2d1d P b7ab4784c7344b939bc36f639286f377 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:09.585935  6921 ts_tablet_manager.cc:1434] T c4db81d9d329422bb3b4160ca4ac2d1d P b7ab4784c7344b939bc36f639286f377: Time spent starting tablet: real 0.079s	user 0.009s	sys 0.000s
I20260709 13:18:09.587136  6921 tablet_bootstrap.cc:492] T d8292e16e5654be6bc408560cf256aaa P b7ab4784c7344b939bc36f639286f377: Bootstrap starting.
I20260709 13:18:09.588060  6881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "427c124d773f483294511e80fe340075" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
W20260709 13:18:09.607507  6772 leader_election.cc:343] T 427c124d773f483294511e80fe340075 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:09.608119  6772 leader_election.cc:304] T 427c124d773f483294511e80fe340075 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:18:09.614485  6923 tablet_bootstrap.cc:492] T 3d65025eea89441290d85dd053810e31 P ccd8a4c3bfe3413cb2ae219b09aea832: Bootstrap starting.
I20260709 13:18:09.620584  6881 raft_consensus.cc:3060] T 9b3759de40694069b13c0f8bd40e5709 P cd75a17ab2604397adab03bb8b5fd75c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:09.621647  7236 raft_consensus.cc:2749] T 427c124d773f483294511e80fe340075 P b7ab4784c7344b939bc36f639286f377 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:18:09.634347  6921 tablet_bootstrap.cc:654] T d8292e16e5654be6bc408560cf256aaa P b7ab4784c7344b939bc36f639286f377: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:09.639577  6695 leader_election.cc:304] T bb3d8792045a4583ae2e965b1350a5b4 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:18:09.642616  7222 raft_consensus.cc:2804] T bb3d8792045a4583ae2e965b1350a5b4 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:18:09.650944  6951 raft_consensus.cc:493] T 9e326172347f45e99a0d482b5d8ef768 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:09.651832  7222 raft_consensus.cc:493] T bb3d8792045a4583ae2e965b1350a5b4 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:09.653923  7222 raft_consensus.cc:3060] T bb3d8792045a4583ae2e965b1350a5b4 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:09.652134  6951 raft_consensus.cc:515] T 9e326172347f45e99a0d482b5d8ef768 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:09.665247  6629 catalog_manager.cc:5697] T 95a75bfe094d4bdc963aba3f08dfcd25 P b7ab4784c7344b939bc36f639286f377 reported cstate change: term changed from 0 to 1, leader changed from <none> to b7ab4784c7344b939bc36f639286f377 (127.5.126.66). New cstate: current_term: 1 leader_uuid: "b7ab4784c7344b939bc36f639286f377" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:09.668649  7206 raft_consensus.cc:515] T 3d65025eea89441290d85dd053810e31 P cd75a17ab2604397adab03bb8b5fd75c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:09.670883  7206 leader_election.cc:290] T 3d65025eea89441290d85dd053810e31 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 1 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:18:09.670958  6951 leader_election.cc:290] T 9e326172347f45e99a0d482b5d8ef768 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:18:09.671998  6805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d65025eea89441290d85dd053810e31" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:18:09.672662  6805 raft_consensus.cc:3060] T 3d65025eea89441290d85dd053810e31 P b7ab4784c7344b939bc36f639286f377 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:09.674028  6922 tablet_bootstrap.cc:654] T bb3d8792045a4583ae2e965b1350a5b4 P cd75a17ab2604397adab03bb8b5fd75c: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:09.679457  6803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e326172347f45e99a0d482b5d8ef768" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:18:09.681129  6730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d65025eea89441290d85dd053810e31" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
W20260709 13:18:09.683003  6844 leader_election.cc:343] T 3d65025eea89441290d85dd053810e31 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:09.689409  6805 raft_consensus.cc:2468] T 3d65025eea89441290d85dd053810e31 P b7ab4784c7344b939bc36f639286f377 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 1.
I20260709 13:18:09.691679  7241 consensus_queue.cc:1048] T 34f36d59d88f40fe8a2805e604fc6c0a P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 13:18:09.694638  6697 consensus_peers.cc:597] T 34f36d59d88f40fe8a2805e604fc6c0a P ccd8a4c3bfe3413cb2ae219b09aea832 -> Peer cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931): Couldn't send request to peer cd75a17ab2604397adab03bb8b5fd75c. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:18:09.690770  6695 leader_election.cc:343] T 9e326172347f45e99a0d482b5d8ef768 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:09.697356  6878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e326172347f45e99a0d482b5d8ef768" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:18:09.705972  6844 leader_election.cc:304] T 3d65025eea89441290d85dd053810e31 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:18:09.708680  6923 tablet_bootstrap.cc:654] T 3d65025eea89441290d85dd053810e31 P ccd8a4c3bfe3413cb2ae219b09aea832: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:09.710422  6959 raft_consensus.cc:2804] T 3d65025eea89441290d85dd053810e31 P cd75a17ab2604397adab03bb8b5fd75c [term 1 FOLLOWER]: Leader election won for term 1
W20260709 13:18:09.713322  6697 leader_election.cc:343] T 9e326172347f45e99a0d482b5d8ef768 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:09.715834  6697 leader_election.cc:304] T 9e326172347f45e99a0d482b5d8ef768 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:18:09.719297  7219 raft_consensus.cc:2749] T 9e326172347f45e99a0d482b5d8ef768 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:18:09.715380  6959 raft_consensus.cc:697] T 3d65025eea89441290d85dd053810e31 P cd75a17ab2604397adab03bb8b5fd75c [term 1 LEADER]: Becoming Leader. State: Replica: cd75a17ab2604397adab03bb8b5fd75c, State: Running, Role: LEADER
I20260709 13:18:09.712225  7220 raft_consensus.cc:493] T bd6869f07b5a4885a0b99fbe60c3b175 P b7ab4784c7344b939bc36f639286f377 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:09.728415  7220 raft_consensus.cc:515] T bd6869f07b5a4885a0b99fbe60c3b175 P b7ab4784c7344b939bc36f639286f377 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:09.737583  6921 tablet_bootstrap.cc:492] T d8292e16e5654be6bc408560cf256aaa P b7ab4784c7344b939bc36f639286f377: No bootstrap required, opened a new log
I20260709 13:18:09.738101  6921 ts_tablet_manager.cc:1403] T d8292e16e5654be6bc408560cf256aaa P b7ab4784c7344b939bc36f639286f377: Time spent bootstrapping tablet: real 0.151s	user 0.016s	sys 0.010s
I20260709 13:18:09.745174  7020 consensus_queue.cc:1048] T 95a75bfe094d4bdc963aba3f08dfcd25 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:18:09.714977  7222 raft_consensus.cc:515] T bb3d8792045a4583ae2e965b1350a5b4 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:09.723753  6959 consensus_queue.cc:237] T 3d65025eea89441290d85dd053810e31 P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
W20260709 13:18:09.752813  6697 consensus_peers.cc:597] T 7c44c4849aa54f2b94d1f1bef9ed546f P ccd8a4c3bfe3413cb2ae219b09aea832 -> Peer cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931): Couldn't send request to peer cd75a17ab2604397adab03bb8b5fd75c. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:09.760726  6807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3d8792045a4583ae2e965b1350a5b4" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:18:09.776213  6878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3d8792045a4583ae2e965b1350a5b4" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:18:09.777155  7222 leader_election.cc:290] T bb3d8792045a4583ae2e965b1350a5b4 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 1 election: Requested vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:18:09.778347  7220 leader_election.cc:290] T bd6869f07b5a4885a0b99fbe60c3b175 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:18:09.779431  6878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6869f07b5a4885a0b99fbe60c3b175" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:18:09.780194  6878 raft_consensus.cc:2468] T bd6869f07b5a4885a0b99fbe60c3b175 P cd75a17ab2604397adab03bb8b5fd75c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 1.
W20260709 13:18:09.780591  6697 leader_election.cc:343] T bb3d8792045a4583ae2e965b1350a5b4 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:09.763962  6807 raft_consensus.cc:3060] T bb3d8792045a4583ae2e965b1350a5b4 P b7ab4784c7344b939bc36f639286f377 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:09.787511  6772 leader_election.cc:304] T bd6869f07b5a4885a0b99fbe60c3b175 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:18:09.800525  6922 tablet_bootstrap.cc:492] T bb3d8792045a4583ae2e965b1350a5b4 P cd75a17ab2604397adab03bb8b5fd75c: No bootstrap required, opened a new log
I20260709 13:18:09.801033  6922 ts_tablet_manager.cc:1403] T bb3d8792045a4583ae2e965b1350a5b4 P cd75a17ab2604397adab03bb8b5fd75c: Time spent bootstrapping tablet: real 0.234s	user 0.010s	sys 0.009s
I20260709 13:18:09.810726  6921 raft_consensus.cc:359] T d8292e16e5654be6bc408560cf256aaa P b7ab4784c7344b939bc36f639286f377 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:09.811318  6921 raft_consensus.cc:385] T d8292e16e5654be6bc408560cf256aaa P b7ab4784c7344b939bc36f639286f377 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:09.811628  6921 raft_consensus.cc:740] T d8292e16e5654be6bc408560cf256aaa P b7ab4784c7344b939bc36f639286f377 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Initialized, Role: FOLLOWER
I20260709 13:18:09.812606  6732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6869f07b5a4885a0b99fbe60c3b175" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:18:09.813575  6732 raft_consensus.cc:2468] T bd6869f07b5a4885a0b99fbe60c3b175 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 1.
I20260709 13:18:09.812389  6921 consensus_queue.cc:260] T d8292e16e5654be6bc408560cf256aaa P b7ab4784c7344b939bc36f639286f377 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:09.804669  7220 raft_consensus.cc:2804] T bd6869f07b5a4885a0b99fbe60c3b175 P b7ab4784c7344b939bc36f639286f377 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:18:09.817399  7220 raft_consensus.cc:493] T bd6869f07b5a4885a0b99fbe60c3b175 P b7ab4784c7344b939bc36f639286f377 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:09.820024  6923 tablet_bootstrap.cc:492] T 3d65025eea89441290d85dd053810e31 P ccd8a4c3bfe3413cb2ae219b09aea832: No bootstrap required, opened a new log
I20260709 13:18:09.821125  6923 ts_tablet_manager.cc:1403] T 3d65025eea89441290d85dd053810e31 P ccd8a4c3bfe3413cb2ae219b09aea832: Time spent bootstrapping tablet: real 0.218s	user 0.025s	sys 0.011s
I20260709 13:18:09.819952  7220 raft_consensus.cc:3060] T bd6869f07b5a4885a0b99fbe60c3b175 P b7ab4784c7344b939bc36f639286f377 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:09.823928  6923 raft_consensus.cc:359] T 3d65025eea89441290d85dd053810e31 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:09.824270  6922 raft_consensus.cc:359] T bb3d8792045a4583ae2e965b1350a5b4 P cd75a17ab2604397adab03bb8b5fd75c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:09.824730  6923 raft_consensus.cc:385] T 3d65025eea89441290d85dd053810e31 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:09.824954  6922 raft_consensus.cc:385] T bb3d8792045a4583ae2e965b1350a5b4 P cd75a17ab2604397adab03bb8b5fd75c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:09.825060  6923 raft_consensus.cc:740] T 3d65025eea89441290d85dd053810e31 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Initialized, Role: FOLLOWER
I20260709 13:18:09.825304  6922 raft_consensus.cc:740] T bb3d8792045a4583ae2e965b1350a5b4 P cd75a17ab2604397adab03bb8b5fd75c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cd75a17ab2604397adab03bb8b5fd75c, State: Initialized, Role: FOLLOWER
I20260709 13:18:09.825987  6922 consensus_queue.cc:260] T bb3d8792045a4583ae2e965b1350a5b4 P cd75a17ab2604397adab03bb8b5fd75c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:09.805069  7150 consensus_queue.cc:1048] T 7c44c4849aa54f2b94d1f1bef9ed546f P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.020s
I20260709 13:18:09.828846  6959 raft_consensus.cc:493] T f5be3a11b23d4ea9b08300a2789821c7 P cd75a17ab2604397adab03bb8b5fd75c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:09.829272  6959 raft_consensus.cc:515] T f5be3a11b23d4ea9b08300a2789821c7 P cd75a17ab2604397adab03bb8b5fd75c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:09.830667  6923 consensus_queue.cc:260] T 3d65025eea89441290d85dd053810e31 P ccd8a4c3bfe3413cb2ae219b09aea832 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:09.830976  6959 leader_election.cc:290] T f5be3a11b23d4ea9b08300a2789821c7 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:18:09.833724  6732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5be3a11b23d4ea9b08300a2789821c7" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:18:09.835084  6803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5be3a11b23d4ea9b08300a2789821c7" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:18:09.835698  6803 raft_consensus.cc:2468] T f5be3a11b23d4ea9b08300a2789821c7 P b7ab4784c7344b939bc36f639286f377 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 0.
W20260709 13:18:09.838296  6844 leader_election.cc:343] T f5be3a11b23d4ea9b08300a2789821c7 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:18:09.838869  6772 consensus_peers.cc:597] T 95a75bfe094d4bdc963aba3f08dfcd25 P b7ab4784c7344b939bc36f639286f377 -> Peer cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931): Couldn't send request to peer cd75a17ab2604397adab03bb8b5fd75c. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:09.839000  6844 leader_election.cc:304] T f5be3a11b23d4ea9b08300a2789821c7 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:18:09.840217  6923 ts_tablet_manager.cc:1434] T 3d65025eea89441290d85dd053810e31 P ccd8a4c3bfe3413cb2ae219b09aea832: Time spent starting tablet: real 0.019s	user 0.006s	sys 0.000s
I20260709 13:18:09.840416  6921 ts_tablet_manager.cc:1434] T d8292e16e5654be6bc408560cf256aaa P b7ab4784c7344b939bc36f639286f377: Time spent starting tablet: real 0.102s	user 0.007s	sys 0.000s
I20260709 13:18:09.841725  6923 tablet_bootstrap.cc:492] T f5be3a11b23d4ea9b08300a2789821c7 P ccd8a4c3bfe3413cb2ae219b09aea832: Bootstrap starting.
I20260709 13:18:09.844236  6959 raft_consensus.cc:2804] T f5be3a11b23d4ea9b08300a2789821c7 P cd75a17ab2604397adab03bb8b5fd75c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:18:09.844678  6959 raft_consensus.cc:493] T f5be3a11b23d4ea9b08300a2789821c7 P cd75a17ab2604397adab03bb8b5fd75c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:09.845033  6959 raft_consensus.cc:3060] T f5be3a11b23d4ea9b08300a2789821c7 P cd75a17ab2604397adab03bb8b5fd75c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:09.851876  6922 ts_tablet_manager.cc:1434] T bb3d8792045a4583ae2e965b1350a5b4 P cd75a17ab2604397adab03bb8b5fd75c: Time spent starting tablet: real 0.051s	user 0.007s	sys 0.002s
I20260709 13:18:09.853235  6921 tablet_bootstrap.cc:492] T 9e326172347f45e99a0d482b5d8ef768 P b7ab4784c7344b939bc36f639286f377: Bootstrap starting.
I20260709 13:18:09.874106  6922 tablet_bootstrap.cc:492] T 24ee15416e3145beaa1b8183453729a3 P cd75a17ab2604397adab03bb8b5fd75c: Bootstrap starting.
I20260709 13:18:09.873819  6807 raft_consensus.cc:2468] T bb3d8792045a4583ae2e965b1350a5b4 P b7ab4784c7344b939bc36f639286f377 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 1.
I20260709 13:18:09.887562  6695 leader_election.cc:304] T bb3d8792045a4583ae2e965b1350a5b4 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:18:09.889122  6921 tablet_bootstrap.cc:654] T 9e326172347f45e99a0d482b5d8ef768 P b7ab4784c7344b939bc36f639286f377: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:09.889936  7238 raft_consensus.cc:2804] T bb3d8792045a4583ae2e965b1350a5b4 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:18:09.894124  7238 raft_consensus.cc:697] T bb3d8792045a4583ae2e965b1350a5b4 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 1 LEADER]: Becoming Leader. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
I20260709 13:18:09.896731  7238 consensus_queue.cc:237] T bb3d8792045a4583ae2e965b1350a5b4 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:09.903733  6959 raft_consensus.cc:515] T f5be3a11b23d4ea9b08300a2789821c7 P cd75a17ab2604397adab03bb8b5fd75c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:09.907079  6730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5be3a11b23d4ea9b08300a2789821c7" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:18:09.908207  7206 raft_consensus.cc:493] T bb3d8792045a4583ae2e965b1350a5b4 P cd75a17ab2604397adab03bb8b5fd75c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:09.908682  6844 leader_election.cc:343] T f5be3a11b23d4ea9b08300a2789821c7 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:09.908802  7206 raft_consensus.cc:515] T bb3d8792045a4583ae2e965b1350a5b4 P cd75a17ab2604397adab03bb8b5fd75c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:09.908939  7220 raft_consensus.cc:515] T bd6869f07b5a4885a0b99fbe60c3b175 P b7ab4784c7344b939bc36f639286f377 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:09.911118  7206 leader_election.cc:290] T bb3d8792045a4583ae2e965b1350a5b4 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:18:09.911167  7220 leader_election.cc:290] T bd6869f07b5a4885a0b99fbe60c3b175 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 2 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:18:09.913509  6923 tablet_bootstrap.cc:654] T f5be3a11b23d4ea9b08300a2789821c7 P ccd8a4c3bfe3413cb2ae219b09aea832: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:09.913476  6878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6869f07b5a4885a0b99fbe60c3b175" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:18:09.914240  6878 raft_consensus.cc:3060] T bd6869f07b5a4885a0b99fbe60c3b175 P cd75a17ab2604397adab03bb8b5fd75c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:09.915488  6959 leader_election.cc:290] T f5be3a11b23d4ea9b08300a2789821c7 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 1 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:18:09.912943  6627 catalog_manager.cc:5697] T 3d65025eea89441290d85dd053810e31 P cd75a17ab2604397adab03bb8b5fd75c reported cstate change: term changed from 0 to 1, leader changed from <none> to cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67). New cstate: current_term: 1 leader_uuid: "cd75a17ab2604397adab03bb8b5fd75c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:09.917068  6732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3d8792045a4583ae2e965b1350a5b4" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:18:09.917688  6730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6869f07b5a4885a0b99fbe60c3b175" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:18:09.918252  6730 raft_consensus.cc:3060] T bd6869f07b5a4885a0b99fbe60c3b175 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:09.920163  6807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3d8792045a4583ae2e965b1350a5b4" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:18:09.920933  6807 raft_consensus.cc:2393] T bb3d8792045a4583ae2e965b1350a5b4 P b7ab4784c7344b939bc36f639286f377 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c in current term 1: Already voted for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in this term.
I20260709 13:18:09.922801  7020 raft_consensus.cc:493] T d8292e16e5654be6bc408560cf256aaa P b7ab4784c7344b939bc36f639286f377 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:09.923195  6807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5be3a11b23d4ea9b08300a2789821c7" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:18:09.923328  7020 raft_consensus.cc:515] T d8292e16e5654be6bc408560cf256aaa P b7ab4784c7344b939bc36f639286f377 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:09.923826  6807 raft_consensus.cc:3060] T f5be3a11b23d4ea9b08300a2789821c7 P b7ab4784c7344b939bc36f639286f377 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:09.926198  7020 leader_election.cc:290] T d8292e16e5654be6bc408560cf256aaa P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:18:09.924858  6844 leader_election.cc:304] T bb3d8792045a4583ae2e965b1350a5b4 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:18:09.927827  6881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8292e16e5654be6bc408560cf256aaa" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
W20260709 13:18:09.929316  6772 leader_election.cc:343] T d8292e16e5654be6bc408560cf256aaa P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:09.929143  6878 raft_consensus.cc:2468] T bd6869f07b5a4885a0b99fbe60c3b175 P cd75a17ab2604397adab03bb8b5fd75c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 2.
I20260709 13:18:09.930683  6772 leader_election.cc:304] T bd6869f07b5a4885a0b99fbe60c3b175 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:18:09.931046  6732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8292e16e5654be6bc408560cf256aaa" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:18:09.931753  6732 raft_consensus.cc:2468] T d8292e16e5654be6bc408560cf256aaa P ccd8a4c3bfe3413cb2ae219b09aea832 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 0.
I20260709 13:18:09.932403  7220 raft_consensus.cc:2804] T bd6869f07b5a4885a0b99fbe60c3b175 P b7ab4784c7344b939bc36f639286f377 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:18:09.933768  6959 raft_consensus.cc:3060] T bb3d8792045a4583ae2e965b1350a5b4 P cd75a17ab2604397adab03bb8b5fd75c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:09.933282  6629 catalog_manager.cc:5697] T bb3d8792045a4583ae2e965b1350a5b4 P ccd8a4c3bfe3413cb2ae219b09aea832 reported cstate change: term changed from 0 to 1, leader changed from <none> to ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65). New cstate: current_term: 1 leader_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:09.933705  6770 leader_election.cc:304] T d8292e16e5654be6bc408560cf256aaa P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:18:09.938100  7220 raft_consensus.cc:697] T bd6869f07b5a4885a0b99fbe60c3b175 P b7ab4784c7344b939bc36f639286f377 [term 2 LEADER]: Becoming Leader. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
I20260709 13:18:09.938485  7236 raft_consensus.cc:493] T c4db81d9d329422bb3b4160ca4ac2d1d P b7ab4784c7344b939bc36f639286f377 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:09.938854  6957 raft_consensus.cc:2804] T d8292e16e5654be6bc408560cf256aaa P b7ab4784c7344b939bc36f639286f377 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:18:09.939231  6957 raft_consensus.cc:493] T d8292e16e5654be6bc408560cf256aaa P b7ab4784c7344b939bc36f639286f377 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:09.939782  6957 raft_consensus.cc:3060] T d8292e16e5654be6bc408560cf256aaa P b7ab4784c7344b939bc36f639286f377 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:09.939222  7220 consensus_queue.cc:237] T bd6869f07b5a4885a0b99fbe60c3b175 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:09.942214  6959 raft_consensus.cc:2749] T bb3d8792045a4583ae2e965b1350a5b4 P cd75a17ab2604397adab03bb8b5fd75c [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:18:09.939038  7236 raft_consensus.cc:515] T c4db81d9d329422bb3b4160ca4ac2d1d P b7ab4784c7344b939bc36f639286f377 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:09.946174  7236 leader_election.cc:290] T c4db81d9d329422bb3b4160ca4ac2d1d P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:18:09.948395  6878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4db81d9d329422bb3b4160ca4ac2d1d" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
W20260709 13:18:09.949769  6772 leader_election.cc:343] T c4db81d9d329422bb3b4160ca4ac2d1d P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:09.950349  6732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4db81d9d329422bb3b4160ca4ac2d1d" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
W20260709 13:18:09.952625  6770 leader_election.cc:343] T c4db81d9d329422bb3b4160ca4ac2d1d P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:09.953037  6770 leader_election.cc:304] T c4db81d9d329422bb3b4160ca4ac2d1d P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:18:09.958050  7020 raft_consensus.cc:2749] T c4db81d9d329422bb3b4160ca4ac2d1d P b7ab4784c7344b939bc36f639286f377 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:18:09.964176  6807 raft_consensus.cc:2468] T f5be3a11b23d4ea9b08300a2789821c7 P b7ab4784c7344b939bc36f639286f377 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 1.
I20260709 13:18:09.965346  6844 leader_election.cc:304] T f5be3a11b23d4ea9b08300a2789821c7 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:18:09.967694  6959 raft_consensus.cc:2804] T f5be3a11b23d4ea9b08300a2789821c7 P cd75a17ab2604397adab03bb8b5fd75c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:18:09.967769  6730 raft_consensus.cc:2468] T bd6869f07b5a4885a0b99fbe60c3b175 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 2.
I20260709 13:18:09.970885  6922 tablet_bootstrap.cc:654] T 24ee15416e3145beaa1b8183453729a3 P cd75a17ab2604397adab03bb8b5fd75c: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:09.971231  6959 raft_consensus.cc:697] T f5be3a11b23d4ea9b08300a2789821c7 P cd75a17ab2604397adab03bb8b5fd75c [term 1 LEADER]: Becoming Leader. State: Replica: cd75a17ab2604397adab03bb8b5fd75c, State: Running, Role: LEADER
I20260709 13:18:09.972687  6959 consensus_queue.cc:237] T f5be3a11b23d4ea9b08300a2789821c7 P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:09.968129  6957 raft_consensus.cc:515] T d8292e16e5654be6bc408560cf256aaa P b7ab4784c7344b939bc36f639286f377 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:09.978639  6730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8292e16e5654be6bc408560cf256aaa" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:18:09.979573  6730 raft_consensus.cc:3060] T d8292e16e5654be6bc408560cf256aaa P ccd8a4c3bfe3413cb2ae219b09aea832 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:09.982326  6878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8292e16e5654be6bc408560cf256aaa" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
W20260709 13:18:09.988943  6772 leader_election.cc:343] T d8292e16e5654be6bc408560cf256aaa P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:09.990432  6957 leader_election.cc:290] T d8292e16e5654be6bc408560cf256aaa P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 1 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:18:10.002523  6730 raft_consensus.cc:2468] T d8292e16e5654be6bc408560cf256aaa P ccd8a4c3bfe3413cb2ae219b09aea832 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 1.
I20260709 13:18:10.009927  6770 leader_election.cc:304] T d8292e16e5654be6bc408560cf256aaa P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:18:10.011365  6957 raft_consensus.cc:2804] T d8292e16e5654be6bc408560cf256aaa P b7ab4784c7344b939bc36f639286f377 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:18:10.012008  6957 raft_consensus.cc:697] T d8292e16e5654be6bc408560cf256aaa P b7ab4784c7344b939bc36f639286f377 [term 1 LEADER]: Becoming Leader. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
I20260709 13:18:10.012833  6957 consensus_queue.cc:237] T d8292e16e5654be6bc408560cf256aaa P b7ab4784c7344b939bc36f639286f377 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:10.030926  6922 tablet_bootstrap.cc:492] T 24ee15416e3145beaa1b8183453729a3 P cd75a17ab2604397adab03bb8b5fd75c: No bootstrap required, opened a new log
I20260709 13:18:10.031677  6922 ts_tablet_manager.cc:1403] T 24ee15416e3145beaa1b8183453729a3 P cd75a17ab2604397adab03bb8b5fd75c: Time spent bootstrapping tablet: real 0.169s	user 0.009s	sys 0.007s
I20260709 13:18:10.035209  6921 tablet_bootstrap.cc:492] T 9e326172347f45e99a0d482b5d8ef768 P b7ab4784c7344b939bc36f639286f377: No bootstrap required, opened a new log
I20260709 13:18:10.043758  6921 ts_tablet_manager.cc:1403] T 9e326172347f45e99a0d482b5d8ef768 P b7ab4784c7344b939bc36f639286f377: Time spent bootstrapping tablet: real 0.194s	user 0.018s	sys 0.005s
I20260709 13:18:10.044606  6922 raft_consensus.cc:359] T 24ee15416e3145beaa1b8183453729a3 P cd75a17ab2604397adab03bb8b5fd75c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:10.045315  6922 raft_consensus.cc:385] T 24ee15416e3145beaa1b8183453729a3 P cd75a17ab2604397adab03bb8b5fd75c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:10.045578  6922 raft_consensus.cc:740] T 24ee15416e3145beaa1b8183453729a3 P cd75a17ab2604397adab03bb8b5fd75c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cd75a17ab2604397adab03bb8b5fd75c, State: Initialized, Role: FOLLOWER
I20260709 13:18:10.046839  6922 consensus_queue.cc:260] T 24ee15416e3145beaa1b8183453729a3 P cd75a17ab2604397adab03bb8b5fd75c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:10.039997  6923 tablet_bootstrap.cc:492] T f5be3a11b23d4ea9b08300a2789821c7 P ccd8a4c3bfe3413cb2ae219b09aea832: No bootstrap required, opened a new log
I20260709 13:18:10.047355  6921 raft_consensus.cc:359] T 9e326172347f45e99a0d482b5d8ef768 P b7ab4784c7344b939bc36f639286f377 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:10.048195  6923 ts_tablet_manager.cc:1403] T f5be3a11b23d4ea9b08300a2789821c7 P ccd8a4c3bfe3413cb2ae219b09aea832: Time spent bootstrapping tablet: real 0.207s	user 0.031s	sys 0.037s
I20260709 13:18:10.050087  6922 ts_tablet_manager.cc:1434] T 24ee15416e3145beaa1b8183453729a3 P cd75a17ab2604397adab03bb8b5fd75c: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.001s
I20260709 13:18:10.051064  6922 tablet_bootstrap.cc:492] T 34f36d59d88f40fe8a2805e604fc6c0a P cd75a17ab2604397adab03bb8b5fd75c: Bootstrap starting.
I20260709 13:18:10.052664  6923 raft_consensus.cc:359] T f5be3a11b23d4ea9b08300a2789821c7 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:10.053691  6923 raft_consensus.cc:385] T f5be3a11b23d4ea9b08300a2789821c7 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:10.054023  6923 raft_consensus.cc:740] T f5be3a11b23d4ea9b08300a2789821c7 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Initialized, Role: FOLLOWER
I20260709 13:18:10.055047  6923 consensus_queue.cc:260] T f5be3a11b23d4ea9b08300a2789821c7 P ccd8a4c3bfe3413cb2ae219b09aea832 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:10.057551  6923 ts_tablet_manager.cc:1434] T f5be3a11b23d4ea9b08300a2789821c7 P ccd8a4c3bfe3413cb2ae219b09aea832: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 13:18:10.058889  6923 tablet_bootstrap.cc:492] T c4db81d9d329422bb3b4160ca4ac2d1d P ccd8a4c3bfe3413cb2ae219b09aea832: Bootstrap starting.
I20260709 13:18:10.065212  6922 tablet_bootstrap.cc:654] T 34f36d59d88f40fe8a2805e604fc6c0a P cd75a17ab2604397adab03bb8b5fd75c: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:10.071117  6923 tablet_bootstrap.cc:654] T c4db81d9d329422bb3b4160ca4ac2d1d P ccd8a4c3bfe3413cb2ae219b09aea832: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:10.080920  6630 catalog_manager.cc:5697] T f5be3a11b23d4ea9b08300a2789821c7 P cd75a17ab2604397adab03bb8b5fd75c reported cstate change: term changed from 0 to 1, leader changed from <none> to cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67). New cstate: current_term: 1 leader_uuid: "cd75a17ab2604397adab03bb8b5fd75c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:10.048228  6921 raft_consensus.cc:385] T 9e326172347f45e99a0d482b5d8ef768 P b7ab4784c7344b939bc36f639286f377 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:10.104768  6921 raft_consensus.cc:740] T 9e326172347f45e99a0d482b5d8ef768 P b7ab4784c7344b939bc36f639286f377 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Initialized, Role: FOLLOWER
I20260709 13:18:10.116472  6923 tablet_bootstrap.cc:492] T c4db81d9d329422bb3b4160ca4ac2d1d P ccd8a4c3bfe3413cb2ae219b09aea832: No bootstrap required, opened a new log
I20260709 13:18:10.116959  6922 tablet_bootstrap.cc:492] T 34f36d59d88f40fe8a2805e604fc6c0a P cd75a17ab2604397adab03bb8b5fd75c: No bootstrap required, opened a new log
I20260709 13:18:10.122210  6922 ts_tablet_manager.cc:1403] T 34f36d59d88f40fe8a2805e604fc6c0a P cd75a17ab2604397adab03bb8b5fd75c: Time spent bootstrapping tablet: real 0.071s	user 0.014s	sys 0.004s
I20260709 13:18:10.123095  6923 ts_tablet_manager.cc:1403] T c4db81d9d329422bb3b4160ca4ac2d1d P ccd8a4c3bfe3413cb2ae219b09aea832: Time spent bootstrapping tablet: real 0.065s	user 0.016s	sys 0.007s
I20260709 13:18:10.123936  6921 consensus_queue.cc:260] T 9e326172347f45e99a0d482b5d8ef768 P b7ab4784c7344b939bc36f639286f377 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:10.125139  6922 raft_consensus.cc:359] T 34f36d59d88f40fe8a2805e604fc6c0a P cd75a17ab2604397adab03bb8b5fd75c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:10.125851  6922 raft_consensus.cc:385] T 34f36d59d88f40fe8a2805e604fc6c0a P cd75a17ab2604397adab03bb8b5fd75c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:10.126108  6922 raft_consensus.cc:740] T 34f36d59d88f40fe8a2805e604fc6c0a P cd75a17ab2604397adab03bb8b5fd75c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cd75a17ab2604397adab03bb8b5fd75c, State: Initialized, Role: FOLLOWER
I20260709 13:18:10.126675  6923 raft_consensus.cc:359] T c4db81d9d329422bb3b4160ca4ac2d1d P ccd8a4c3bfe3413cb2ae219b09aea832 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:10.126957  6922 consensus_queue.cc:260] T 34f36d59d88f40fe8a2805e604fc6c0a P cd75a17ab2604397adab03bb8b5fd75c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:10.127506  6923 raft_consensus.cc:385] T c4db81d9d329422bb3b4160ca4ac2d1d P ccd8a4c3bfe3413cb2ae219b09aea832 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:10.128808  6921 ts_tablet_manager.cc:1434] T 9e326172347f45e99a0d482b5d8ef768 P b7ab4784c7344b939bc36f639286f377: Time spent starting tablet: real 0.085s	user 0.001s	sys 0.006s
I20260709 13:18:10.129842  6921 tablet_bootstrap.cc:492] T 17587d6730594da4a56fa13a353232a1 P b7ab4784c7344b939bc36f639286f377: Bootstrap starting.
I20260709 13:18:10.130219  6881 raft_consensus.cc:3060] T 24ee15416e3145beaa1b8183453729a3 P cd75a17ab2604397adab03bb8b5fd75c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:10.133401  6922 ts_tablet_manager.cc:1434] T 34f36d59d88f40fe8a2805e604fc6c0a P cd75a17ab2604397adab03bb8b5fd75c: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.000s
I20260709 13:18:10.134474  6922 tablet_bootstrap.cc:492] T fe20b4b48823486ca3b9c648db6ce8aa P cd75a17ab2604397adab03bb8b5fd75c: Bootstrap starting.
I20260709 13:18:10.137692  6921 tablet_bootstrap.cc:654] T 17587d6730594da4a56fa13a353232a1 P b7ab4784c7344b939bc36f639286f377: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:10.140831  6922 tablet_bootstrap.cc:654] T fe20b4b48823486ca3b9c648db6ce8aa P cd75a17ab2604397adab03bb8b5fd75c: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:10.145213  6959 consensus_queue.cc:1048] T 3d65025eea89441290d85dd053810e31 P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:18:10.127940  6923 raft_consensus.cc:740] T c4db81d9d329422bb3b4160ca4ac2d1d P ccd8a4c3bfe3413cb2ae219b09aea832 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Initialized, Role: FOLLOWER
I20260709 13:18:10.154649  6923 consensus_queue.cc:260] T c4db81d9d329422bb3b4160ca4ac2d1d P ccd8a4c3bfe3413cb2ae219b09aea832 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:10.156958  6931 raft_consensus.cc:493] T 3d65025eea89441290d85dd053810e31 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:10.157433  6931 raft_consensus.cc:515] T 3d65025eea89441290d85dd053810e31 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:10.159371  6931 leader_election.cc:290] T 3d65025eea89441290d85dd053810e31 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:18:10.167891  6878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d65025eea89441290d85dd053810e31" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:18:10.169106  6732 raft_consensus.cc:3060] T 3d65025eea89441290d85dd053810e31 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:10.169998  6803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d65025eea89441290d85dd053810e31" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:18:10.173214  6695 leader_election.cc:304] T 3d65025eea89441290d85dd053810e31 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:18:10.175882  6922 tablet_bootstrap.cc:492] T fe20b4b48823486ca3b9c648db6ce8aa P cd75a17ab2604397adab03bb8b5fd75c: No bootstrap required, opened a new log
I20260709 13:18:10.176407  6922 ts_tablet_manager.cc:1403] T fe20b4b48823486ca3b9c648db6ce8aa P cd75a17ab2604397adab03bb8b5fd75c: Time spent bootstrapping tablet: real 0.042s	user 0.014s	sys 0.004s
I20260709 13:18:10.179291  6922 raft_consensus.cc:359] T fe20b4b48823486ca3b9c648db6ce8aa P cd75a17ab2604397adab03bb8b5fd75c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:10.180003  6922 raft_consensus.cc:385] T fe20b4b48823486ca3b9c648db6ce8aa P cd75a17ab2604397adab03bb8b5fd75c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:10.180296  6922 raft_consensus.cc:740] T fe20b4b48823486ca3b9c648db6ce8aa P cd75a17ab2604397adab03bb8b5fd75c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cd75a17ab2604397adab03bb8b5fd75c, State: Initialized, Role: FOLLOWER
I20260709 13:18:10.181188  6922 consensus_queue.cc:260] T fe20b4b48823486ca3b9c648db6ce8aa P cd75a17ab2604397adab03bb8b5fd75c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:10.182971  6922 ts_tablet_manager.cc:1434] T fe20b4b48823486ca3b9c648db6ce8aa P cd75a17ab2604397adab03bb8b5fd75c: Time spent starting tablet: real 0.006s	user 0.001s	sys 0.004s
I20260709 13:18:10.183346  6931 raft_consensus.cc:2749] T 3d65025eea89441290d85dd053810e31 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:18:10.183952  6922 tablet_bootstrap.cc:492] T a1704639a875409b9959353527b3fd68 P cd75a17ab2604397adab03bb8b5fd75c: Bootstrap starting.
I20260709 13:18:10.191828  6922 tablet_bootstrap.cc:654] T a1704639a875409b9959353527b3fd68 P cd75a17ab2604397adab03bb8b5fd75c: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:10.197857  6922 tablet_bootstrap.cc:492] T a1704639a875409b9959353527b3fd68 P cd75a17ab2604397adab03bb8b5fd75c: No bootstrap required, opened a new log
I20260709 13:18:10.198339  6922 ts_tablet_manager.cc:1403] T a1704639a875409b9959353527b3fd68 P cd75a17ab2604397adab03bb8b5fd75c: Time spent bootstrapping tablet: real 0.015s	user 0.011s	sys 0.000s
I20260709 13:18:10.202670  6922 raft_consensus.cc:359] T a1704639a875409b9959353527b3fd68 P cd75a17ab2604397adab03bb8b5fd75c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:10.203389  6922 raft_consensus.cc:385] T a1704639a875409b9959353527b3fd68 P cd75a17ab2604397adab03bb8b5fd75c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:10.203688  6922 raft_consensus.cc:740] T a1704639a875409b9959353527b3fd68 P cd75a17ab2604397adab03bb8b5fd75c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cd75a17ab2604397adab03bb8b5fd75c, State: Initialized, Role: FOLLOWER
I20260709 13:18:10.204375  6922 consensus_queue.cc:260] T a1704639a875409b9959353527b3fd68 P cd75a17ab2604397adab03bb8b5fd75c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:10.206053  6922 ts_tablet_manager.cc:1434] T a1704639a875409b9959353527b3fd68 P cd75a17ab2604397adab03bb8b5fd75c: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:18:10.206960  6922 tablet_bootstrap.cc:492] T d8292e16e5654be6bc408560cf256aaa P cd75a17ab2604397adab03bb8b5fd75c: Bootstrap starting.
I20260709 13:18:10.210009  6959 consensus_queue.cc:1048] T 3d65025eea89441290d85dd053810e31 P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Connected to new peer: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:18:10.212872  6922 tablet_bootstrap.cc:654] T d8292e16e5654be6bc408560cf256aaa P cd75a17ab2604397adab03bb8b5fd75c: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:10.223068  6923 ts_tablet_manager.cc:1434] T c4db81d9d329422bb3b4160ca4ac2d1d P ccd8a4c3bfe3413cb2ae219b09aea832: Time spent starting tablet: real 0.100s	user 0.006s	sys 0.000s
I20260709 13:18:10.229614  6628 catalog_manager.cc:5697] T d8292e16e5654be6bc408560cf256aaa P b7ab4784c7344b939bc36f639286f377 reported cstate change: term changed from 0 to 1, leader changed from <none> to b7ab4784c7344b939bc36f639286f377 (127.5.126.66). New cstate: current_term: 1 leader_uuid: "b7ab4784c7344b939bc36f639286f377" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:10.231175  6628 catalog_manager.cc:5697] T bd6869f07b5a4885a0b99fbe60c3b175 P b7ab4784c7344b939bc36f639286f377 reported cstate change: term changed from 0 to 2, leader changed from <none> to b7ab4784c7344b939bc36f639286f377 (127.5.126.66). New cstate: current_term: 2 leader_uuid: "b7ab4784c7344b939bc36f639286f377" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:10.233021  6923 tablet_bootstrap.cc:492] T 713b5728a197487c9300b310ab94e5a3 P ccd8a4c3bfe3413cb2ae219b09aea832: Bootstrap starting.
W20260709 13:18:10.306115  7266 log.cc:927] Time spent T 24ee15416e3145beaa1b8183453729a3 P cd75a17ab2604397adab03bb8b5fd75c: Append to log took a long time: real 0.077s	user 0.000s	sys 0.001s
I20260709 13:18:10.314692  6923 tablet_bootstrap.cc:654] T 713b5728a197487c9300b310ab94e5a3 P ccd8a4c3bfe3413cb2ae219b09aea832: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:10.319192  6921 tablet_bootstrap.cc:492] T 17587d6730594da4a56fa13a353232a1 P b7ab4784c7344b939bc36f639286f377: No bootstrap required, opened a new log
I20260709 13:18:10.319727  6922 tablet_bootstrap.cc:492] T d8292e16e5654be6bc408560cf256aaa P cd75a17ab2604397adab03bb8b5fd75c: No bootstrap required, opened a new log
I20260709 13:18:10.320276  6922 ts_tablet_manager.cc:1403] T d8292e16e5654be6bc408560cf256aaa P cd75a17ab2604397adab03bb8b5fd75c: Time spent bootstrapping tablet: real 0.114s	user 0.046s	sys 0.048s
I20260709 13:18:10.319876  6921 ts_tablet_manager.cc:1403] T 17587d6730594da4a56fa13a353232a1 P b7ab4784c7344b939bc36f639286f377: Time spent bootstrapping tablet: real 0.190s	user 0.070s	sys 0.061s
I20260709 13:18:10.327414  6921 raft_consensus.cc:359] T 17587d6730594da4a56fa13a353232a1 P b7ab4784c7344b939bc36f639286f377 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:10.328311  6921 raft_consensus.cc:385] T 17587d6730594da4a56fa13a353232a1 P b7ab4784c7344b939bc36f639286f377 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:10.328594  6921 raft_consensus.cc:740] T 17587d6730594da4a56fa13a353232a1 P b7ab4784c7344b939bc36f639286f377 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Initialized, Role: FOLLOWER
I20260709 13:18:10.329329  6921 consensus_queue.cc:260] T 17587d6730594da4a56fa13a353232a1 P b7ab4784c7344b939bc36f639286f377 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:10.330538  6923 tablet_bootstrap.cc:492] T 713b5728a197487c9300b310ab94e5a3 P ccd8a4c3bfe3413cb2ae219b09aea832: No bootstrap required, opened a new log
I20260709 13:18:10.330974  6923 ts_tablet_manager.cc:1403] T 713b5728a197487c9300b310ab94e5a3 P ccd8a4c3bfe3413cb2ae219b09aea832: Time spent bootstrapping tablet: real 0.107s	user 0.004s	sys 0.006s
I20260709 13:18:10.331295  6921 ts_tablet_manager.cc:1434] T 17587d6730594da4a56fa13a353232a1 P b7ab4784c7344b939bc36f639286f377: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.000s
I20260709 13:18:10.332332  6921 tablet_bootstrap.cc:492] T d8cee0accdb8499c86d4414b72565a38 P b7ab4784c7344b939bc36f639286f377: Bootstrap starting.
I20260709 13:18:10.333407  6923 raft_consensus.cc:359] T 713b5728a197487c9300b310ab94e5a3 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:10.334026  6923 raft_consensus.cc:385] T 713b5728a197487c9300b310ab94e5a3 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:10.334290  6923 raft_consensus.cc:740] T 713b5728a197487c9300b310ab94e5a3 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Initialized, Role: FOLLOWER
I20260709 13:18:10.334928  6923 consensus_queue.cc:260] T 713b5728a197487c9300b310ab94e5a3 P ccd8a4c3bfe3413cb2ae219b09aea832 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:10.337047  6923 ts_tablet_manager.cc:1434] T 713b5728a197487c9300b310ab94e5a3 P ccd8a4c3bfe3413cb2ae219b09aea832: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.001s
I20260709 13:18:10.328492  6922 raft_consensus.cc:359] T d8292e16e5654be6bc408560cf256aaa P cd75a17ab2604397adab03bb8b5fd75c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:10.337548  6922 raft_consensus.cc:385] T d8292e16e5654be6bc408560cf256aaa P cd75a17ab2604397adab03bb8b5fd75c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:10.337849  6922 raft_consensus.cc:740] T d8292e16e5654be6bc408560cf256aaa P cd75a17ab2604397adab03bb8b5fd75c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cd75a17ab2604397adab03bb8b5fd75c, State: Initialized, Role: FOLLOWER
I20260709 13:18:10.338582  6922 consensus_queue.cc:260] T d8292e16e5654be6bc408560cf256aaa P cd75a17ab2604397adab03bb8b5fd75c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:10.340448  6921 tablet_bootstrap.cc:654] T d8cee0accdb8499c86d4414b72565a38 P b7ab4784c7344b939bc36f639286f377: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:10.340795  6922 ts_tablet_manager.cc:1434] T d8292e16e5654be6bc408560cf256aaa P cd75a17ab2604397adab03bb8b5fd75c: Time spent starting tablet: real 0.016s	user 0.007s	sys 0.000s
I20260709 13:18:10.341910  6923 tablet_bootstrap.cc:492] T 17587d6730594da4a56fa13a353232a1 P ccd8a4c3bfe3413cb2ae219b09aea832: Bootstrap starting.
I20260709 13:18:10.347332  6922 tablet_bootstrap.cc:492] T 9e326172347f45e99a0d482b5d8ef768 P cd75a17ab2604397adab03bb8b5fd75c: Bootstrap starting.
I20260709 13:18:10.353576  6922 tablet_bootstrap.cc:654] T 9e326172347f45e99a0d482b5d8ef768 P cd75a17ab2604397adab03bb8b5fd75c: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:10.357798  7219 raft_consensus.cc:493] T c4db81d9d329422bb3b4160ca4ac2d1d P ccd8a4c3bfe3413cb2ae219b09aea832 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:10.360498  6923 tablet_bootstrap.cc:654] T 17587d6730594da4a56fa13a353232a1 P ccd8a4c3bfe3413cb2ae219b09aea832: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:10.363384  7219 raft_consensus.cc:515] T c4db81d9d329422bb3b4160ca4ac2d1d P ccd8a4c3bfe3413cb2ae219b09aea832 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:10.366544  6807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4db81d9d329422bb3b4160ca4ac2d1d" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:18:10.367236  6807 raft_consensus.cc:2468] T c4db81d9d329422bb3b4160ca4ac2d1d P b7ab4784c7344b939bc36f639286f377 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 0.
I20260709 13:18:10.373279  6923 tablet_bootstrap.cc:492] T 17587d6730594da4a56fa13a353232a1 P ccd8a4c3bfe3413cb2ae219b09aea832: No bootstrap required, opened a new log
I20260709 13:18:10.374634  6931 raft_consensus.cc:493] T 713b5728a197487c9300b310ab94e5a3 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:10.369480  6881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4db81d9d329422bb3b4160ca4ac2d1d" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:18:10.375238  6923 ts_tablet_manager.cc:1403] T 17587d6730594da4a56fa13a353232a1 P ccd8a4c3bfe3413cb2ae219b09aea832: Time spent bootstrapping tablet: real 0.034s	user 0.016s	sys 0.001s
I20260709 13:18:10.375180  6931 raft_consensus.cc:515] T 713b5728a197487c9300b310ab94e5a3 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:10.369765  6921 tablet_bootstrap.cc:492] T d8cee0accdb8499c86d4414b72565a38 P b7ab4784c7344b939bc36f639286f377: No bootstrap required, opened a new log
I20260709 13:18:10.376480  6921 ts_tablet_manager.cc:1403] T d8cee0accdb8499c86d4414b72565a38 P b7ab4784c7344b939bc36f639286f377: Time spent bootstrapping tablet: real 0.044s	user 0.013s	sys 0.014s
I20260709 13:18:10.369132  6695 leader_election.cc:304] T c4db81d9d329422bb3b4160ca4ac2d1d P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
I20260709 13:18:10.377589  6931 leader_election.cc:290] T 713b5728a197487c9300b310ab94e5a3 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:18:10.378134  6931 raft_consensus.cc:2804] T c4db81d9d329422bb3b4160ca4ac2d1d P ccd8a4c3bfe3413cb2ae219b09aea832 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:18:10.378464  6931 raft_consensus.cc:493] T c4db81d9d329422bb3b4160ca4ac2d1d P ccd8a4c3bfe3413cb2ae219b09aea832 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:10.378760  6931 raft_consensus.cc:3060] T c4db81d9d329422bb3b4160ca4ac2d1d P ccd8a4c3bfe3413cb2ae219b09aea832 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:10.368489  7219 leader_election.cc:290] T c4db81d9d329422bb3b4160ca4ac2d1d P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:18:10.379323  6921 raft_consensus.cc:359] T d8cee0accdb8499c86d4414b72565a38 P b7ab4784c7344b939bc36f639286f377 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:10.380079  6921 raft_consensus.cc:385] T d8cee0accdb8499c86d4414b72565a38 P b7ab4784c7344b939bc36f639286f377 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:10.380378  6921 raft_consensus.cc:740] T d8cee0accdb8499c86d4414b72565a38 P b7ab4784c7344b939bc36f639286f377 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Initialized, Role: FOLLOWER
I20260709 13:18:10.381143  6921 consensus_queue.cc:260] T d8cee0accdb8499c86d4414b72565a38 P b7ab4784c7344b939bc36f639286f377 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:10.384908  6921 ts_tablet_manager.cc:1434] T d8cee0accdb8499c86d4414b72565a38 P b7ab4784c7344b939bc36f639286f377: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.001s
I20260709 13:18:10.385325  6931 raft_consensus.cc:515] T c4db81d9d329422bb3b4160ca4ac2d1d P ccd8a4c3bfe3413cb2ae219b09aea832 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:10.387072  6931 leader_election.cc:290] T c4db81d9d329422bb3b4160ca4ac2d1d P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 1 election: Requested vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
W20260709 13:18:10.387317  6758 tablet.cc:2406] T 713b5728a197487c9300b310ab94e5a3 P ccd8a4c3bfe3413cb2ae219b09aea832: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260709 13:18:10.388294  6697 leader_election.cc:343] T c4db81d9d329422bb3b4160ca4ac2d1d P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:10.389535  6922 tablet_bootstrap.cc:492] T 9e326172347f45e99a0d482b5d8ef768 P cd75a17ab2604397adab03bb8b5fd75c: No bootstrap required, opened a new log
I20260709 13:18:10.390028  6922 ts_tablet_manager.cc:1403] T 9e326172347f45e99a0d482b5d8ef768 P cd75a17ab2604397adab03bb8b5fd75c: Time spent bootstrapping tablet: real 0.043s	user 0.014s	sys 0.001s
I20260709 13:18:10.395017  6923 raft_consensus.cc:359] T 17587d6730594da4a56fa13a353232a1 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:10.395792  6923 raft_consensus.cc:385] T 17587d6730594da4a56fa13a353232a1 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:10.396183  6923 raft_consensus.cc:740] T 17587d6730594da4a56fa13a353232a1 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Initialized, Role: FOLLOWER
I20260709 13:18:10.396829  6923 consensus_queue.cc:260] T 17587d6730594da4a56fa13a353232a1 P ccd8a4c3bfe3413cb2ae219b09aea832 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:10.398737  6922 raft_consensus.cc:359] T 9e326172347f45e99a0d482b5d8ef768 P cd75a17ab2604397adab03bb8b5fd75c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:10.399483  6922 raft_consensus.cc:385] T 9e326172347f45e99a0d482b5d8ef768 P cd75a17ab2604397adab03bb8b5fd75c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:10.399775  6922 raft_consensus.cc:740] T 9e326172347f45e99a0d482b5d8ef768 P cd75a17ab2604397adab03bb8b5fd75c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cd75a17ab2604397adab03bb8b5fd75c, State: Initialized, Role: FOLLOWER
I20260709 13:18:10.400512  6922 consensus_queue.cc:260] T 9e326172347f45e99a0d482b5d8ef768 P cd75a17ab2604397adab03bb8b5fd75c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:10.400697  6876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4db81d9d329422bb3b4160ca4ac2d1d" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:18:10.402947  6922 ts_tablet_manager.cc:1434] T 9e326172347f45e99a0d482b5d8ef768 P cd75a17ab2604397adab03bb8b5fd75c: Time spent starting tablet: real 0.013s	user 0.003s	sys 0.003s
I20260709 13:18:10.403206  6802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4db81d9d329422bb3b4160ca4ac2d1d" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:18:10.403836  6802 raft_consensus.cc:3060] T c4db81d9d329422bb3b4160ca4ac2d1d P b7ab4784c7344b939bc36f639286f377 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:10.404158  6922 tablet_bootstrap.cc:492] T 713b5728a197487c9300b310ab94e5a3 P cd75a17ab2604397adab03bb8b5fd75c: Bootstrap starting.
I20260709 13:18:10.408743  6881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "713b5728a197487c9300b310ab94e5a3" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:18:10.422896  6802 raft_consensus.cc:2468] T c4db81d9d329422bb3b4160ca4ac2d1d P b7ab4784c7344b939bc36f639286f377 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 1.
I20260709 13:18:10.424461  6732 raft_consensus.cc:1275] T bd6869f07b5a4885a0b99fbe60c3b175 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 2 FOLLOWER]: Refusing update from remote peer b7ab4784c7344b939bc36f639286f377: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
W20260709 13:18:10.425249  6697 leader_election.cc:343] T c4db81d9d329422bb3b4160ca4ac2d1d P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:10.425494  7220 raft_consensus.cc:493] T 9e326172347f45e99a0d482b5d8ef768 P b7ab4784c7344b939bc36f639286f377 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:10.426199  6803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "713b5728a197487c9300b310ab94e5a3" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:18:10.426092  7220 raft_consensus.cc:515] T 9e326172347f45e99a0d482b5d8ef768 P b7ab4784c7344b939bc36f639286f377 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:10.427105  6923 ts_tablet_manager.cc:1434] T 17587d6730594da4a56fa13a353232a1 P ccd8a4c3bfe3413cb2ae219b09aea832: Time spent starting tablet: real 0.035s	user 0.003s	sys 0.002s
I20260709 13:18:10.428288  6923 tablet_bootstrap.cc:492] T 2c240553ce044eedb41541d72b9475d7 P ccd8a4c3bfe3413cb2ae219b09aea832: Bootstrap starting.
I20260709 13:18:10.428685  7220 leader_election.cc:290] T 9e326172347f45e99a0d482b5d8ef768 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
W20260709 13:18:10.426281  6697 leader_election.cc:343] T 713b5728a197487c9300b310ab94e5a3 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:10.431352  6881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e326172347f45e99a0d482b5d8ef768" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:18:10.427029  6803 raft_consensus.cc:2468] T 713b5728a197487c9300b310ab94e5a3 P b7ab4784c7344b939bc36f639286f377 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 0.
I20260709 13:18:10.428288  6921 tablet_bootstrap.cc:492] T 711ef6523deb4cbe8ef2ba61e1c21c98 P b7ab4784c7344b939bc36f639286f377: Bootstrap starting.
I20260709 13:18:10.436813  6732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e326172347f45e99a0d482b5d8ef768" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:18:10.437654  6732 raft_consensus.cc:2468] T 9e326172347f45e99a0d482b5d8ef768 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 0.
I20260709 13:18:10.439477  6957 consensus_queue.cc:1048] T bd6869f07b5a4885a0b99fbe60c3b175 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:18:10.441865  6921 tablet_bootstrap.cc:654] T 711ef6523deb4cbe8ef2ba61e1c21c98 P b7ab4784c7344b939bc36f639286f377: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:10.442938  6770 leader_election.cc:304] T 9e326172347f45e99a0d482b5d8ef768 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
I20260709 13:18:10.441865  6922 tablet_bootstrap.cc:654] T 713b5728a197487c9300b310ab94e5a3 P cd75a17ab2604397adab03bb8b5fd75c: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:10.447427  6876 raft_consensus.cc:3060] T 34f36d59d88f40fe8a2805e604fc6c0a P cd75a17ab2604397adab03bb8b5fd75c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:10.451066  6923 tablet_bootstrap.cc:654] T 2c240553ce044eedb41541d72b9475d7 P ccd8a4c3bfe3413cb2ae219b09aea832: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:10.454010  7020 raft_consensus.cc:493] T d8cee0accdb8499c86d4414b72565a38 P b7ab4784c7344b939bc36f639286f377 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:10.454797  7220 raft_consensus.cc:2804] T 9e326172347f45e99a0d482b5d8ef768 P b7ab4784c7344b939bc36f639286f377 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:18:10.454733  7020 raft_consensus.cc:515] T d8cee0accdb8499c86d4414b72565a38 P b7ab4784c7344b939bc36f639286f377 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:10.455577  7220 raft_consensus.cc:493] T 9e326172347f45e99a0d482b5d8ef768 P b7ab4784c7344b939bc36f639286f377 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:10.456223  7220 raft_consensus.cc:3060] T 9e326172347f45e99a0d482b5d8ef768 P b7ab4784c7344b939bc36f639286f377 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:10.458628  7020 leader_election.cc:290] T d8cee0accdb8499c86d4414b72565a38 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:18:10.466405  6730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8cee0accdb8499c86d4414b72565a38" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:18:10.466794  7150 consensus_queue.cc:1048] T bb3d8792045a4583ae2e965b1350a5b4 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:18:10.467163  6730 raft_consensus.cc:2468] T d8cee0accdb8499c86d4414b72565a38 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 0.
I20260709 13:18:10.469831  6695 leader_election.cc:304] T c4db81d9d329422bb3b4160ca4ac2d1d P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:18:10.472545  6878 raft_consensus.cc:3060] T a1704639a875409b9959353527b3fd68 P cd75a17ab2604397adab03bb8b5fd75c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:10.477203  6877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8cee0accdb8499c86d4414b72565a38" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:18:10.480021  6922 tablet_bootstrap.cc:492] T 713b5728a197487c9300b310ab94e5a3 P cd75a17ab2604397adab03bb8b5fd75c: No bootstrap required, opened a new log
I20260709 13:18:10.480849  6922 ts_tablet_manager.cc:1403] T 713b5728a197487c9300b310ab94e5a3 P cd75a17ab2604397adab03bb8b5fd75c: Time spent bootstrapping tablet: real 0.077s	user 0.014s	sys 0.008s
I20260709 13:18:10.481010  6770 leader_election.cc:304] T d8cee0accdb8499c86d4414b72565a38 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
I20260709 13:18:10.484071  7020 raft_consensus.cc:2804] T d8cee0accdb8499c86d4414b72565a38 P b7ab4784c7344b939bc36f639286f377 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:18:10.484512  7020 raft_consensus.cc:493] T d8cee0accdb8499c86d4414b72565a38 P b7ab4784c7344b939bc36f639286f377 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:10.484907  7020 raft_consensus.cc:3060] T d8cee0accdb8499c86d4414b72565a38 P b7ab4784c7344b939bc36f639286f377 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:10.489465  6959 raft_consensus.cc:493] T d8292e16e5654be6bc408560cf256aaa P cd75a17ab2604397adab03bb8b5fd75c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:10.490058  6959 raft_consensus.cc:515] T d8292e16e5654be6bc408560cf256aaa P cd75a17ab2604397adab03bb8b5fd75c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:10.492291  6959 leader_election.cc:290] T d8292e16e5654be6bc408560cf256aaa P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:18:10.492969  6923 tablet_bootstrap.cc:492] T 2c240553ce044eedb41541d72b9475d7 P ccd8a4c3bfe3413cb2ae219b09aea832: No bootstrap required, opened a new log
I20260709 13:18:10.495325  6923 ts_tablet_manager.cc:1403] T 2c240553ce044eedb41541d72b9475d7 P ccd8a4c3bfe3413cb2ae219b09aea832: Time spent bootstrapping tablet: real 0.067s	user 0.015s	sys 0.002s
I20260709 13:18:10.496410  6881 raft_consensus.cc:2468] T 9e326172347f45e99a0d482b5d8ef768 P cd75a17ab2604397adab03bb8b5fd75c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 0.
I20260709 13:18:10.487228  6922 raft_consensus.cc:359] T 713b5728a197487c9300b310ab94e5a3 P cd75a17ab2604397adab03bb8b5fd75c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:10.498972  7020 raft_consensus.cc:515] T d8cee0accdb8499c86d4414b72565a38 P b7ab4784c7344b939bc36f639286f377 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:10.497738  6922 raft_consensus.cc:385] T 713b5728a197487c9300b310ab94e5a3 P cd75a17ab2604397adab03bb8b5fd75c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:10.499965  6922 raft_consensus.cc:740] T 713b5728a197487c9300b310ab94e5a3 P cd75a17ab2604397adab03bb8b5fd75c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cd75a17ab2604397adab03bb8b5fd75c, State: Initialized, Role: FOLLOWER
I20260709 13:18:10.483108  7220 raft_consensus.cc:515] T 9e326172347f45e99a0d482b5d8ef768 P b7ab4784c7344b939bc36f639286f377 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:10.500851  6922 consensus_queue.cc:260] T 713b5728a197487c9300b310ab94e5a3 P cd75a17ab2604397adab03bb8b5fd75c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:10.502409  6922 ts_tablet_manager.cc:1434] T 713b5728a197487c9300b310ab94e5a3 P cd75a17ab2604397adab03bb8b5fd75c: Time spent starting tablet: real 0.019s	user 0.006s	sys 0.000s
I20260709 13:18:10.503749  6923 raft_consensus.cc:359] T 2c240553ce044eedb41541d72b9475d7 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:10.504225  6922 tablet_bootstrap.cc:492] T c4db81d9d329422bb3b4160ca4ac2d1d P cd75a17ab2604397adab03bb8b5fd75c: Bootstrap starting.
I20260709 13:18:10.504331  6729 raft_consensus.cc:3060] T f5be3a11b23d4ea9b08300a2789821c7 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:10.504491  6923 raft_consensus.cc:385] T 2c240553ce044eedb41541d72b9475d7 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:10.505610  6923 raft_consensus.cc:740] T 2c240553ce044eedb41541d72b9475d7 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Initialized, Role: FOLLOWER
I20260709 13:18:10.506237  6923 consensus_queue.cc:260] T 2c240553ce044eedb41541d72b9475d7 P ccd8a4c3bfe3413cb2ae219b09aea832 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:10.500909  7219 raft_consensus.cc:2804] T c4db81d9d329422bb3b4160ca4ac2d1d P ccd8a4c3bfe3413cb2ae219b09aea832 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:18:10.512663  6923 ts_tablet_manager.cc:1434] T 2c240553ce044eedb41541d72b9475d7 P ccd8a4c3bfe3413cb2ae219b09aea832: Time spent starting tablet: real 0.017s	user 0.007s	sys 0.000s
I20260709 13:18:10.513000  7219 raft_consensus.cc:697] T c4db81d9d329422bb3b4160ca4ac2d1d P ccd8a4c3bfe3413cb2ae219b09aea832 [term 1 LEADER]: Becoming Leader. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
I20260709 13:18:10.513617  6923 tablet_bootstrap.cc:492] T ab432e62819d499eaaf3dd55481dd930 P ccd8a4c3bfe3413cb2ae219b09aea832: Bootstrap starting.
I20260709 13:18:10.513819  7219 consensus_queue.cc:237] T c4db81d9d329422bb3b4160ca4ac2d1d P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:10.514740  6803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8292e16e5654be6bc408560cf256aaa" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:18:10.515074  6922 tablet_bootstrap.cc:654] T c4db81d9d329422bb3b4160ca4ac2d1d P cd75a17ab2604397adab03bb8b5fd75c: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:10.516844  6730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8292e16e5654be6bc408560cf256aaa" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:18:10.517771  6730 raft_consensus.cc:2393] T d8292e16e5654be6bc408560cf256aaa P ccd8a4c3bfe3413cb2ae219b09aea832 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c in current term 1: Already voted for candidate b7ab4784c7344b939bc36f639286f377 in this term.
I20260709 13:18:10.517398  6731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e326172347f45e99a0d482b5d8ef768" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:18:10.518402  6731 raft_consensus.cc:3060] T 9e326172347f45e99a0d482b5d8ef768 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:10.519556  7220 leader_election.cc:290] T 9e326172347f45e99a0d482b5d8ef768 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 1 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:18:10.523168  7020 leader_election.cc:290] T d8cee0accdb8499c86d4414b72565a38 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 1 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:18:10.524598  6728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8cee0accdb8499c86d4414b72565a38" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:18:10.525239  6728 raft_consensus.cc:3060] T d8cee0accdb8499c86d4414b72565a38 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:18:10.533720  6695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 63964.8us
I20260709 13:18:10.539346  6695 leader_election.cc:304] T 713b5728a197487c9300b310ab94e5a3 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:18:10.539956  6931 raft_consensus.cc:2804] T 713b5728a197487c9300b310ab94e5a3 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:18:10.540405  6931 raft_consensus.cc:493] T 713b5728a197487c9300b310ab94e5a3 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:10.540911  6931 raft_consensus.cc:3060] T 713b5728a197487c9300b310ab94e5a3 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:10.534188  6844 leader_election.cc:304] T d8292e16e5654be6bc408560cf256aaa P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:18:10.559899  6922 tablet_bootstrap.cc:492] T c4db81d9d329422bb3b4160ca4ac2d1d P cd75a17ab2604397adab03bb8b5fd75c: No bootstrap required, opened a new log
I20260709 13:18:10.560461  6922 ts_tablet_manager.cc:1403] T c4db81d9d329422bb3b4160ca4ac2d1d P cd75a17ab2604397adab03bb8b5fd75c: Time spent bootstrapping tablet: real 0.057s	user 0.013s	sys 0.008s
I20260709 13:18:10.560508  6959 raft_consensus.cc:3060] T d8292e16e5654be6bc408560cf256aaa P cd75a17ab2604397adab03bb8b5fd75c [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:18:10.561736  6772 leader_election.cc:343] T d8cee0accdb8499c86d4414b72565a38 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:10.537914  6731 raft_consensus.cc:2468] T 9e326172347f45e99a0d482b5d8ef768 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 1.
I20260709 13:18:10.586238  6931 raft_consensus.cc:515] T 713b5728a197487c9300b310ab94e5a3 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:10.571326  7020 consensus_queue.cc:1048] T d8292e16e5654be6bc408560cf256aaa P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:18:10.538005  7150 raft_consensus.cc:493] T f5be3a11b23d4ea9b08300a2789821c7 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:10.606616  6931 leader_election.cc:290] T 713b5728a197487c9300b310ab94e5a3 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 1 election: Requested vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:18:10.606390  6728 raft_consensus.cc:2468] T d8cee0accdb8499c86d4414b72565a38 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 1.
I20260709 13:18:10.608134  7150 raft_consensus.cc:515] T f5be3a11b23d4ea9b08300a2789821c7 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:10.611814  6922 raft_consensus.cc:359] T c4db81d9d329422bb3b4160ca4ac2d1d P cd75a17ab2604397adab03bb8b5fd75c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:10.622152  6922 raft_consensus.cc:385] T c4db81d9d329422bb3b4160ca4ac2d1d P cd75a17ab2604397adab03bb8b5fd75c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:10.622450  6922 raft_consensus.cc:740] T c4db81d9d329422bb3b4160ca4ac2d1d P cd75a17ab2604397adab03bb8b5fd75c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cd75a17ab2604397adab03bb8b5fd75c, State: Initialized, Role: FOLLOWER
I20260709 13:18:10.611959  7228 consensus_queue.cc:1048] T f5be3a11b23d4ea9b08300a2789821c7 P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Connected to new peer: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.011s
I20260709 13:18:10.624282  6923 tablet_bootstrap.cc:654] T ab432e62819d499eaaf3dd55481dd930 P ccd8a4c3bfe3413cb2ae219b09aea832: Neither blocks nor log segments found. Creating new log.
W20260709 13:18:10.613222  6678 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:18:10.603154  6959 raft_consensus.cc:2749] T d8292e16e5654be6bc408560cf256aaa P cd75a17ab2604397adab03bb8b5fd75c [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:18:10.636761  6770 leader_election.cc:304] T 9e326172347f45e99a0d482b5d8ef768 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
I20260709 13:18:10.637919  6770 leader_election.cc:304] T d8cee0accdb8499c86d4414b72565a38 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
I20260709 13:18:10.639768  7020 raft_consensus.cc:2804] T 9e326172347f45e99a0d482b5d8ef768 P b7ab4784c7344b939bc36f639286f377 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:18:10.641371  6957 raft_consensus.cc:2804] T d8cee0accdb8499c86d4414b72565a38 P b7ab4784c7344b939bc36f639286f377 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:18:10.641384  6922 consensus_queue.cc:260] T c4db81d9d329422bb3b4160ca4ac2d1d P cd75a17ab2604397adab03bb8b5fd75c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:10.644197  6922 ts_tablet_manager.cc:1434] T c4db81d9d329422bb3b4160ca4ac2d1d P cd75a17ab2604397adab03bb8b5fd75c: Time spent starting tablet: real 0.083s	user 0.006s	sys 0.005s
I20260709 13:18:10.645186  6922 tablet_bootstrap.cc:492] T 2c240553ce044eedb41541d72b9475d7 P cd75a17ab2604397adab03bb8b5fd75c: Bootstrap starting.
I20260709 13:18:10.657088  6921 tablet_bootstrap.cc:492] T 711ef6523deb4cbe8ef2ba61e1c21c98 P b7ab4784c7344b939bc36f639286f377: No bootstrap required, opened a new log
I20260709 13:18:10.657686  6921 ts_tablet_manager.cc:1403] T 711ef6523deb4cbe8ef2ba61e1c21c98 P b7ab4784c7344b939bc36f639286f377: Time spent bootstrapping tablet: real 0.230s	user 0.076s	sys 0.068s
I20260709 13:18:10.658586  7150 leader_election.cc:290] T f5be3a11b23d4ea9b08300a2789821c7 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:18:10.661793  6881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e326172347f45e99a0d482b5d8ef768" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:18:10.662518  6881 raft_consensus.cc:3060] T 9e326172347f45e99a0d482b5d8ef768 P cd75a17ab2604397adab03bb8b5fd75c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:10.663830  6876 raft_consensus.cc:1275] T bd6869f07b5a4885a0b99fbe60c3b175 P cd75a17ab2604397adab03bb8b5fd75c [term 2 FOLLOWER]: Refusing update from remote peer b7ab4784c7344b939bc36f639286f377: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 13:18:10.664408  6880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8cee0accdb8499c86d4414b72565a38" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
W20260709 13:18:10.674434  6695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 133397us
W20260709 13:18:10.682439  6772 leader_election.cc:343] T d8cee0accdb8499c86d4414b72565a38 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:10.667562  7228 raft_consensus.cc:493] T 713b5728a197487c9300b310ab94e5a3 P cd75a17ab2604397adab03bb8b5fd75c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:10.724907  7020 raft_consensus.cc:697] T 9e326172347f45e99a0d482b5d8ef768 P b7ab4784c7344b939bc36f639286f377 [term 1 LEADER]: Becoming Leader. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
I20260709 13:18:10.727803  7020 consensus_queue.cc:237] T 9e326172347f45e99a0d482b5d8ef768 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:10.739926  6805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "713b5728a197487c9300b310ab94e5a3" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:18:10.677692  7220 consensus_queue.cc:1048] T bd6869f07b5a4885a0b99fbe60c3b175 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.046s
I20260709 13:18:10.751695  6805 raft_consensus.cc:3060] T 713b5728a197487c9300b310ab94e5a3 P b7ab4784c7344b939bc36f639286f377 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:10.791146  6957 raft_consensus.cc:697] T d8cee0accdb8499c86d4414b72565a38 P b7ab4784c7344b939bc36f639286f377 [term 1 LEADER]: Becoming Leader. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
I20260709 13:18:10.725956  7206 raft_consensus.cc:493] T fe20b4b48823486ca3b9c648db6ce8aa P cd75a17ab2604397adab03bb8b5fd75c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:10.826377  6922 tablet_bootstrap.cc:654] T 2c240553ce044eedb41541d72b9475d7 P cd75a17ab2604397adab03bb8b5fd75c: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:10.715240  7228 raft_consensus.cc:515] T 713b5728a197487c9300b310ab94e5a3 P cd75a17ab2604397adab03bb8b5fd75c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:10.828716  6959 consensus_queue.cc:1048] T f5be3a11b23d4ea9b08300a2789821c7 P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:18:10.833335  6957 consensus_queue.cc:237] T d8cee0accdb8499c86d4414b72565a38 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:10.759622  6875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "713b5728a197487c9300b310ab94e5a3" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:18:10.859105  6959 raft_consensus.cc:493] T c4db81d9d329422bb3b4160ca4ac2d1d P cd75a17ab2604397adab03bb8b5fd75c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:10.860841  6959 raft_consensus.cc:515] T c4db81d9d329422bb3b4160ca4ac2d1d P cd75a17ab2604397adab03bb8b5fd75c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:10.856283  6804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5be3a11b23d4ea9b08300a2789821c7" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:18:10.820755  7292 consensus_queue.cc:1048] T d8292e16e5654be6bc408560cf256aaa P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.048s
I20260709 13:18:10.862890  6875 raft_consensus.cc:3060] T 713b5728a197487c9300b310ab94e5a3 P cd75a17ab2604397adab03bb8b5fd75c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:10.828776  7206 raft_consensus.cc:515] T fe20b4b48823486ca3b9c648db6ce8aa P cd75a17ab2604397adab03bb8b5fd75c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:10.885859  6959 leader_election.cc:290] T c4db81d9d329422bb3b4160ca4ac2d1d P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:18:10.925649  6921 raft_consensus.cc:359] T 711ef6523deb4cbe8ef2ba61e1c21c98 P b7ab4784c7344b939bc36f639286f377 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:10.926452  6921 raft_consensus.cc:385] T 711ef6523deb4cbe8ef2ba61e1c21c98 P b7ab4784c7344b939bc36f639286f377 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:10.926774  6921 raft_consensus.cc:740] T 711ef6523deb4cbe8ef2ba61e1c21c98 P b7ab4784c7344b939bc36f639286f377 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Initialized, Role: FOLLOWER
I20260709 13:18:10.929158  6921 consensus_queue.cc:260] T 711ef6523deb4cbe8ef2ba61e1c21c98 P b7ab4784c7344b939bc36f639286f377 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
W20260709 13:18:10.938301  7279 log.cc:927] Time spent T a1704639a875409b9959353527b3fd68 P cd75a17ab2604397adab03bb8b5fd75c: Append to log took a long time: real 0.214s	user 0.001s	sys 0.000s
I20260709 13:18:10.891709  6804 raft_consensus.cc:2468] T f5be3a11b23d4ea9b08300a2789821c7 P b7ab4784c7344b939bc36f639286f377 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 1.
I20260709 13:18:10.923734  6872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5be3a11b23d4ea9b08300a2789821c7" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:18:10.949630  6880 raft_consensus.cc:3060] T fe20b4b48823486ca3b9c648db6ce8aa P cd75a17ab2604397adab03bb8b5fd75c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:10.959451  6921 ts_tablet_manager.cc:1434] T 711ef6523deb4cbe8ef2ba61e1c21c98 P b7ab4784c7344b939bc36f639286f377: Time spent starting tablet: real 0.293s	user 0.012s	sys 0.022s
I20260709 13:18:10.964399  7228 leader_election.cc:290] T 713b5728a197487c9300b310ab94e5a3 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:18:10.986002  6921 tablet_bootstrap.cc:492] T 22ccee1b570c4ad3a57bd7aec085b1b4 P b7ab4784c7344b939bc36f639286f377: Bootstrap starting.
I20260709 13:18:10.990237  6805 raft_consensus.cc:2468] T 713b5728a197487c9300b310ab94e5a3 P b7ab4784c7344b939bc36f639286f377 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 1.
I20260709 13:18:11.005997  7020 raft_consensus.cc:493] T 2c240553ce044eedb41541d72b9475d7 P b7ab4784c7344b939bc36f639286f377 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:11.006872  7020 raft_consensus.cc:515] T 2c240553ce044eedb41541d72b9475d7 P b7ab4784c7344b939bc36f639286f377 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:11.010123  7020 leader_election.cc:290] T 2c240553ce044eedb41541d72b9475d7 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:18:11.031258  6807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4db81d9d329422bb3b4160ca4ac2d1d" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:18:11.032104  6807 raft_consensus.cc:2393] T c4db81d9d329422bb3b4160ca4ac2d1d P b7ab4784c7344b939bc36f639286f377 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c in current term 1: Already voted for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in this term.
I20260709 13:18:11.033131  6923 tablet_bootstrap.cc:492] T ab432e62819d499eaaf3dd55481dd930 P ccd8a4c3bfe3413cb2ae219b09aea832: No bootstrap required, opened a new log
I20260709 13:18:11.033605  6923 ts_tablet_manager.cc:1403] T ab432e62819d499eaaf3dd55481dd930 P ccd8a4c3bfe3413cb2ae219b09aea832: Time spent bootstrapping tablet: real 0.520s	user 0.010s	sys 0.015s
I20260709 13:18:11.024993  7206 leader_election.cc:290] T fe20b4b48823486ca3b9c648db6ce8aa P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:18:11.042762  7278 raft_consensus.cc:493] T 17587d6730594da4a56fa13a353232a1 P b7ab4784c7344b939bc36f639286f377 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:11.046895  6922 tablet_bootstrap.cc:492] T 2c240553ce044eedb41541d72b9475d7 P cd75a17ab2604397adab03bb8b5fd75c: No bootstrap required, opened a new log
I20260709 13:18:11.047415  6922 ts_tablet_manager.cc:1403] T 2c240553ce044eedb41541d72b9475d7 P cd75a17ab2604397adab03bb8b5fd75c: Time spent bootstrapping tablet: real 0.402s	user 0.020s	sys 0.007s
I20260709 13:18:11.043541  7278 raft_consensus.cc:515] T 17587d6730594da4a56fa13a353232a1 P b7ab4784c7344b939bc36f639286f377 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:11.048424  6807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "713b5728a197487c9300b310ab94e5a3" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:18:11.049144  6807 raft_consensus.cc:2393] T 713b5728a197487c9300b310ab94e5a3 P b7ab4784c7344b939bc36f639286f377 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c in current term 1: Already voted for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in this term.
I20260709 13:18:11.050731  6922 raft_consensus.cc:359] T 2c240553ce044eedb41541d72b9475d7 P cd75a17ab2604397adab03bb8b5fd75c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:11.051472  6922 raft_consensus.cc:385] T 2c240553ce044eedb41541d72b9475d7 P cd75a17ab2604397adab03bb8b5fd75c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:11.051720  6922 raft_consensus.cc:740] T 2c240553ce044eedb41541d72b9475d7 P cd75a17ab2604397adab03bb8b5fd75c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cd75a17ab2604397adab03bb8b5fd75c, State: Initialized, Role: FOLLOWER
I20260709 13:18:11.052692  6922 consensus_queue.cc:260] T 2c240553ce044eedb41541d72b9475d7 P cd75a17ab2604397adab03bb8b5fd75c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:11.055110  6922 ts_tablet_manager.cc:1434] T 2c240553ce044eedb41541d72b9475d7 P cd75a17ab2604397adab03bb8b5fd75c: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:18:11.056291  6807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe20b4b48823486ca3b9c648db6ce8aa" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:18:11.061213  6921 tablet_bootstrap.cc:654] T 22ccee1b570c4ad3a57bd7aec085b1b4 P b7ab4784c7344b939bc36f639286f377: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:11.052598  6881 raft_consensus.cc:2468] T 9e326172347f45e99a0d482b5d8ef768 P cd75a17ab2604397adab03bb8b5fd75c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 1.
I20260709 13:18:11.067281  6880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c240553ce044eedb41541d72b9475d7" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:18:11.086588  6731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4db81d9d329422bb3b4160ca4ac2d1d" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:18:11.088379  6728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe20b4b48823486ca3b9c648db6ce8aa" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:18:11.052408  6875 raft_consensus.cc:2468] T 713b5728a197487c9300b310ab94e5a3 P cd75a17ab2604397adab03bb8b5fd75c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 1.
I20260709 13:18:11.096773  6880 raft_consensus.cc:2468] T 2c240553ce044eedb41541d72b9475d7 P cd75a17ab2604397adab03bb8b5fd75c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 0.
I20260709 13:18:11.102257  7150 consensus_queue.cc:1048] T bb3d8792045a4583ae2e965b1350a5b4 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:18:11.103133  6729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "713b5728a197487c9300b310ab94e5a3" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:18:11.116074  6931 raft_consensus.cc:493] T 17587d6730594da4a56fa13a353232a1 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:11.116832  6931 raft_consensus.cc:515] T 17587d6730594da4a56fa13a353232a1 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:11.108006  6923 raft_consensus.cc:359] T ab432e62819d499eaaf3dd55481dd930 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:11.118500  6923 raft_consensus.cc:385] T ab432e62819d499eaaf3dd55481dd930 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:11.118949  6923 raft_consensus.cc:740] T ab432e62819d499eaaf3dd55481dd930 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Initialized, Role: FOLLOWER
I20260709 13:18:11.119796  6923 consensus_queue.cc:260] T ab432e62819d499eaaf3dd55481dd930 P ccd8a4c3bfe3413cb2ae219b09aea832 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:11.127894  6931 leader_election.cc:290] T 17587d6730594da4a56fa13a353232a1 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:18:11.139839  6729 raft_consensus.cc:2393] T 713b5728a197487c9300b310ab94e5a3 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c in current term 1: Already voted for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in this term.
I20260709 13:18:11.152268  6879 raft_consensus.cc:3060] T c4db81d9d329422bb3b4160ca4ac2d1d P cd75a17ab2604397adab03bb8b5fd75c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:11.161026  6923 ts_tablet_manager.cc:1434] T ab432e62819d499eaaf3dd55481dd930 P ccd8a4c3bfe3413cb2ae219b09aea832: Time spent starting tablet: real 0.127s	user 0.005s	sys 0.003s
I20260709 13:18:11.170571  6629 catalog_manager.cc:5697] T 9e326172347f45e99a0d482b5d8ef768 P b7ab4784c7344b939bc36f639286f377 reported cstate change: term changed from 0 to 1, leader changed from <none> to b7ab4784c7344b939bc36f639286f377 (127.5.126.66). New cstate: current_term: 1 leader_uuid: "b7ab4784c7344b939bc36f639286f377" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:11.160004  7278 leader_election.cc:290] T 17587d6730594da4a56fa13a353232a1 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:18:11.185912  6772 leader_election.cc:304] T 2c240553ce044eedb41541d72b9475d7 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:18:11.192806  6923 tablet_bootstrap.cc:492] T b56bf91d90824c959e21e0cee5ba1816 P ccd8a4c3bfe3413cb2ae219b09aea832: Bootstrap starting.
I20260709 13:18:11.187943  6922 tablet_bootstrap.cc:492] T 95a75bfe094d4bdc963aba3f08dfcd25 P cd75a17ab2604397adab03bb8b5fd75c: Bootstrap starting.
I20260709 13:18:11.192371  7292 raft_consensus.cc:2804] T 2c240553ce044eedb41541d72b9475d7 P b7ab4784c7344b939bc36f639286f377 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:18:11.194089  7292 raft_consensus.cc:493] T 2c240553ce044eedb41541d72b9475d7 P b7ab4784c7344b939bc36f639286f377 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:11.194433  7292 raft_consensus.cc:3060] T 2c240553ce044eedb41541d72b9475d7 P b7ab4784c7344b939bc36f639286f377 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:11.214347  6880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17587d6730594da4a56fa13a353232a1" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:18:11.225013  6957 raft_consensus.cc:493] T 711ef6523deb4cbe8ef2ba61e1c21c98 P b7ab4784c7344b939bc36f639286f377 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:11.225522  6957 raft_consensus.cc:515] T 711ef6523deb4cbe8ef2ba61e1c21c98 P b7ab4784c7344b939bc36f639286f377 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:11.233631  6697 leader_election.cc:304] T 713b5728a197487c9300b310ab94e5a3 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:18:11.238747  7311 raft_consensus.cc:493] T 2c240553ce044eedb41541d72b9475d7 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:11.239401  7311 raft_consensus.cc:515] T 2c240553ce044eedb41541d72b9475d7 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:11.242861  6957 leader_election.cc:290] T 711ef6523deb4cbe8ef2ba61e1c21c98 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:18:11.244547  7284 raft_consensus.cc:2804] T 713b5728a197487c9300b310ab94e5a3 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:18:11.244621  6844 leader_election.cc:304] T fe20b4b48823486ca3b9c648db6ce8aa P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:18:11.245968  7228 raft_consensus.cc:2749] T fe20b4b48823486ca3b9c648db6ce8aa P cd75a17ab2604397adab03bb8b5fd75c [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:18:11.252184  6957 raft_consensus.cc:493] T b56bf91d90824c959e21e0cee5ba1816 P b7ab4784c7344b939bc36f639286f377 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:11.252970  6957 raft_consensus.cc:515] T b56bf91d90824c959e21e0cee5ba1816 P b7ab4784c7344b939bc36f639286f377 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:11.258325  7284 raft_consensus.cc:697] T 713b5728a197487c9300b310ab94e5a3 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 1 LEADER]: Becoming Leader. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
I20260709 13:18:11.259315  7284 consensus_queue.cc:237] T 713b5728a197487c9300b310ab94e5a3 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
W20260709 13:18:11.272735  6695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 44263.8us
I20260709 13:18:11.297804  6873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17587d6730594da4a56fa13a353232a1" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:18:11.275132  6803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17587d6730594da4a56fa13a353232a1" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
W20260709 13:18:11.321013  6695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 46994.3us
I20260709 13:18:11.286571  6844 leader_election.cc:304] T c4db81d9d329422bb3b4160ca4ac2d1d P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:18:11.311609  6803 raft_consensus.cc:2468] T 17587d6730594da4a56fa13a353232a1 P b7ab4784c7344b939bc36f639286f377 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 0.
I20260709 13:18:11.334224  7311 leader_election.cc:290] T 2c240553ce044eedb41541d72b9475d7 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:18:11.347154  7206 raft_consensus.cc:2749] T c4db81d9d329422bb3b4160ca4ac2d1d P cd75a17ab2604397adab03bb8b5fd75c [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:18:11.337821  6695 leader_election.cc:304] T f5be3a11b23d4ea9b08300a2789821c7 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:18:11.351369  6957 leader_election.cc:290] T b56bf91d90824c959e21e0cee5ba1816 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:18:11.341071  6921 tablet_bootstrap.cc:492] T 22ccee1b570c4ad3a57bd7aec085b1b4 P b7ab4784c7344b939bc36f639286f377: No bootstrap required, opened a new log
I20260709 13:18:11.352113  6921 ts_tablet_manager.cc:1403] T 22ccee1b570c4ad3a57bd7aec085b1b4 P b7ab4784c7344b939bc36f639286f377: Time spent bootstrapping tablet: real 0.368s	user 0.018s	sys 0.027s
W20260709 13:18:11.342439  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 90233.5us
I20260709 13:18:11.366710  6880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b56bf91d90824c959e21e0cee5ba1816" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
W20260709 13:18:11.367321  6772 leader_election.cc:343] T 17587d6730594da4a56fa13a353232a1 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:11.374471  6875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "711ef6523deb4cbe8ef2ba61e1c21c98" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:18:11.375614  6725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "711ef6523deb4cbe8ef2ba61e1c21c98" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:18:11.378698  7318 raft_consensus.cc:2804] T f5be3a11b23d4ea9b08300a2789821c7 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:18:11.378942  6725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b56bf91d90824c959e21e0cee5ba1816" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:18:11.379369  7318 raft_consensus.cc:493] T f5be3a11b23d4ea9b08300a2789821c7 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 1 FOLLOWER]: Starting leader election (detected failure of leader cd75a17ab2604397adab03bb8b5fd75c)
I20260709 13:18:11.379873  7318 raft_consensus.cc:3060] T f5be3a11b23d4ea9b08300a2789821c7 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:11.350768  6729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17587d6730594da4a56fa13a353232a1" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:18:11.384518  6922 tablet_bootstrap.cc:654] T 95a75bfe094d4bdc963aba3f08dfcd25 P cd75a17ab2604397adab03bb8b5fd75c: Neither blocks nor log segments found. Creating new log.
W20260709 13:18:11.384701  6770 leader_election.cc:343] T 711ef6523deb4cbe8ef2ba61e1c21c98 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:18:11.392149  6770 leader_election.cc:343] T b56bf91d90824c959e21e0cee5ba1816 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:18:11.396930  6697 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 109023us
I20260709 13:18:11.380905  6844 leader_election.cc:304] T 713b5728a197487c9300b310ab94e5a3 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:18:11.394210  6729 raft_consensus.cc:2468] T 17587d6730594da4a56fa13a353232a1 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 0.
W20260709 13:18:11.419422  6772 leader_election.cc:343] T b56bf91d90824c959e21e0cee5ba1816 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:11.420828  6772 leader_election.cc:304] T b56bf91d90824c959e21e0cee5ba1816 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
W20260709 13:18:11.427711  6697 leader_election.cc:343] T 17587d6730594da4a56fa13a353232a1 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:11.430977  6770 leader_election.cc:304] T 17587d6730594da4a56fa13a353232a1 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:18:11.432798  7219 consensus_queue.cc:1048] T c4db81d9d329422bb3b4160ca4ac2d1d P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:18:11.435500  7220 raft_consensus.cc:2804] T 17587d6730594da4a56fa13a353232a1 P b7ab4784c7344b939bc36f639286f377 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:18:11.436112  7220 raft_consensus.cc:493] T 17587d6730594da4a56fa13a353232a1 P b7ab4784c7344b939bc36f639286f377 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:11.436522  7220 raft_consensus.cc:3060] T 17587d6730594da4a56fa13a353232a1 P b7ab4784c7344b939bc36f639286f377 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:18:11.490726  7322 log.cc:927] Time spent T 713b5728a197487c9300b310ab94e5a3 P ccd8a4c3bfe3413cb2ae219b09aea832: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260709 13:18:11.429221  7301 raft_consensus.cc:2749] T b56bf91d90824c959e21e0cee5ba1816 P b7ab4784c7344b939bc36f639286f377 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:18:11.483434  7228 raft_consensus.cc:2749] T 713b5728a197487c9300b310ab94e5a3 P cd75a17ab2604397adab03bb8b5fd75c [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:18:11.512478  6957 raft_consensus.cc:493] T 427c124d773f483294511e80fe340075 P b7ab4784c7344b939bc36f639286f377 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:11.513024  6957 raft_consensus.cc:515] T 427c124d773f483294511e80fe340075 P b7ab4784c7344b939bc36f639286f377 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:11.520462  6923 tablet_bootstrap.cc:654] T b56bf91d90824c959e21e0cee5ba1816 P ccd8a4c3bfe3413cb2ae219b09aea832: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:11.522891  6957 leader_election.cc:290] T 427c124d773f483294511e80fe340075 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
W20260709 13:18:11.498541  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 117774us
W20260709 13:18:11.532264  6695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 139358us
I20260709 13:18:11.535794  6921 raft_consensus.cc:359] T 22ccee1b570c4ad3a57bd7aec085b1b4 P b7ab4784c7344b939bc36f639286f377 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:11.536516  6921 raft_consensus.cc:385] T 22ccee1b570c4ad3a57bd7aec085b1b4 P b7ab4784c7344b939bc36f639286f377 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:11.536800  6921 raft_consensus.cc:740] T 22ccee1b570c4ad3a57bd7aec085b1b4 P b7ab4784c7344b939bc36f639286f377 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Initialized, Role: FOLLOWER
I20260709 13:18:11.518441  7292 raft_consensus.cc:515] T 2c240553ce044eedb41541d72b9475d7 P b7ab4784c7344b939bc36f639286f377 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:11.552505  6921 consensus_queue.cc:260] T 22ccee1b570c4ad3a57bd7aec085b1b4 P b7ab4784c7344b939bc36f639286f377 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:11.551287  6730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "427c124d773f483294511e80fe340075" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:18:11.592734  6921 ts_tablet_manager.cc:1434] T 22ccee1b570c4ad3a57bd7aec085b1b4 P b7ab4784c7344b939bc36f639286f377: Time spent starting tablet: real 0.240s	user 0.009s	sys 0.000s
W20260709 13:18:11.596168  6772 leader_election.cc:343] T 711ef6523deb4cbe8ef2ba61e1c21c98 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:11.600212  6772 leader_election.cc:304] T 711ef6523deb4cbe8ef2ba61e1c21c98 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:18:11.607713  7290 raft_consensus.cc:2749] T 711ef6523deb4cbe8ef2ba61e1c21c98 P b7ab4784c7344b939bc36f639286f377 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:18:11.616689  6921 tablet_bootstrap.cc:492] T 3411566abe2d4c9bb4b2adfdd05e6f17 P b7ab4784c7344b939bc36f639286f377: Bootstrap starting.
I20260709 13:18:11.581087  7329 consensus_queue.cc:1048] T c4db81d9d329422bb3b4160ca4ac2d1d P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.038s
W20260709 13:18:11.628914  6695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 92212.5us
I20260709 13:18:11.639730  6695 leader_election.cc:304] T 17587d6730594da4a56fa13a353232a1 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:18:11.637905  7292 leader_election.cc:290] T 2c240553ce044eedb41541d72b9475d7 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 1 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:18:11.681269  6922 tablet_bootstrap.cc:492] T 95a75bfe094d4bdc963aba3f08dfcd25 P cd75a17ab2604397adab03bb8b5fd75c: No bootstrap required, opened a new log
I20260709 13:18:11.658313  7327 raft_consensus.cc:2804] T 17587d6730594da4a56fa13a353232a1 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260709 13:18:11.659354  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 79538.7us
I20260709 13:18:11.684301  7301 raft_consensus.cc:493] T ab432e62819d499eaaf3dd55481dd930 P b7ab4784c7344b939bc36f639286f377 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:11.719866  6922 ts_tablet_manager.cc:1403] T 95a75bfe094d4bdc963aba3f08dfcd25 P cd75a17ab2604397adab03bb8b5fd75c: Time spent bootstrapping tablet: real 0.532s	user 0.024s	sys 0.033s
I20260709 13:18:11.728945  6880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c240553ce044eedb41541d72b9475d7" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:18:11.729976  6880 raft_consensus.cc:2468] T 2c240553ce044eedb41541d72b9475d7 P cd75a17ab2604397adab03bb8b5fd75c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 0.
I20260709 13:18:11.713955  7327 raft_consensus.cc:493] T 17587d6730594da4a56fa13a353232a1 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:18:11.739576  6695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 99919.9us
I20260709 13:18:11.741457  6923 tablet_bootstrap.cc:492] T b56bf91d90824c959e21e0cee5ba1816 P ccd8a4c3bfe3413cb2ae219b09aea832: No bootstrap required, opened a new log
I20260709 13:18:11.742794  6923 ts_tablet_manager.cc:1403] T b56bf91d90824c959e21e0cee5ba1816 P ccd8a4c3bfe3413cb2ae219b09aea832: Time spent bootstrapping tablet: real 0.553s	user 0.014s	sys 0.023s
I20260709 13:18:11.748594  6874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c240553ce044eedb41541d72b9475d7" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:18:11.749411  6874 raft_consensus.cc:3060] T 2c240553ce044eedb41541d72b9475d7 P cd75a17ab2604397adab03bb8b5fd75c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:11.750151  6875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "427c124d773f483294511e80fe340075" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
W20260709 13:18:11.753244  6697 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 113720us
I20260709 13:18:11.743228  7327 raft_consensus.cc:3060] T 17587d6730594da4a56fa13a353232a1 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:11.760533  6732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c240553ce044eedb41541d72b9475d7" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:18:11.728561  7301 raft_consensus.cc:515] T ab432e62819d499eaaf3dd55481dd930 P b7ab4784c7344b939bc36f639286f377 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:11.778811  6732 raft_consensus.cc:3060] T 2c240553ce044eedb41541d72b9475d7 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:11.777694  7150 raft_consensus.cc:493] T ab432e62819d499eaaf3dd55481dd930 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:11.790964  6697 leader_election.cc:304] T 2c240553ce044eedb41541d72b9475d7 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:18:11.797070  7278 raft_consensus.cc:493] T 22ccee1b570c4ad3a57bd7aec085b1b4 P b7ab4784c7344b939bc36f639286f377 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:11.796471  7150 raft_consensus.cc:515] T ab432e62819d499eaaf3dd55481dd930 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:11.795969  6922 raft_consensus.cc:359] T 95a75bfe094d4bdc963aba3f08dfcd25 P cd75a17ab2604397adab03bb8b5fd75c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:11.798980  6922 raft_consensus.cc:385] T 95a75bfe094d4bdc963aba3f08dfcd25 P cd75a17ab2604397adab03bb8b5fd75c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:11.798734  7278 raft_consensus.cc:515] T 22ccee1b570c4ad3a57bd7aec085b1b4 P b7ab4784c7344b939bc36f639286f377 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:11.799496  6922 raft_consensus.cc:740] T 95a75bfe094d4bdc963aba3f08dfcd25 P cd75a17ab2604397adab03bb8b5fd75c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cd75a17ab2604397adab03bb8b5fd75c, State: Initialized, Role: FOLLOWER
I20260709 13:18:11.801146  6922 consensus_queue.cc:260] T 95a75bfe094d4bdc963aba3f08dfcd25 P cd75a17ab2604397adab03bb8b5fd75c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:11.803236  7150 leader_election.cc:290] T ab432e62819d499eaaf3dd55481dd930 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:18:11.803807  7278 leader_election.cc:290] T 22ccee1b570c4ad3a57bd7aec085b1b4 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:18:11.814172  6923 raft_consensus.cc:359] T b56bf91d90824c959e21e0cee5ba1816 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:11.814798  6923 raft_consensus.cc:385] T b56bf91d90824c959e21e0cee5ba1816 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:11.815099  6923 raft_consensus.cc:740] T b56bf91d90824c959e21e0cee5ba1816 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Initialized, Role: FOLLOWER
I20260709 13:18:11.815661  6923 consensus_queue.cc:260] T b56bf91d90824c959e21e0cee5ba1816 P ccd8a4c3bfe3413cb2ae219b09aea832 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:11.829061  6922 ts_tablet_manager.cc:1434] T 95a75bfe094d4bdc963aba3f08dfcd25 P cd75a17ab2604397adab03bb8b5fd75c: Time spent starting tablet: real 0.106s	user 0.008s	sys 0.000s
I20260709 13:18:11.806578  7220 raft_consensus.cc:515] T 17587d6730594da4a56fa13a353232a1 P b7ab4784c7344b939bc36f639286f377 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:11.883775  7285 consensus_queue.cc:1048] T 9e326172347f45e99a0d482b5d8ef768 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.037s
I20260709 13:18:11.916837  6922 tablet_bootstrap.cc:492] T 7c44c4849aa54f2b94d1f1bef9ed546f P cd75a17ab2604397adab03bb8b5fd75c: Bootstrap starting.
I20260709 13:18:11.890686  7228 raft_consensus.cc:493] T 95a75bfe094d4bdc963aba3f08dfcd25 P cd75a17ab2604397adab03bb8b5fd75c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:11.922411  7228 raft_consensus.cc:515] T 95a75bfe094d4bdc963aba3f08dfcd25 P cd75a17ab2604397adab03bb8b5fd75c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:11.848392  7292 consensus_queue.cc:1048] T d8cee0accdb8499c86d4414b72565a38 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.096s
I20260709 13:18:11.939829  7228 leader_election.cc:290] T 95a75bfe094d4bdc963aba3f08dfcd25 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
W20260709 13:18:11.927556  7318 consensus_meta.cc:287] T f5be3a11b23d4ea9b08300a2789821c7 P ccd8a4c3bfe3413cb2ae219b09aea832: Time spent flushing consensus metadata: real 0.546s	user 0.011s	sys 0.005s
I20260709 13:18:11.940331  7336 raft_consensus.cc:493] T e31b9971c15848dea59d4d4130141d9e P b7ab4784c7344b939bc36f639286f377 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:18:11.940874  7318 raft_consensus.cc:515] T f5be3a11b23d4ea9b08300a2789821c7 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:11.942067  6921 tablet_bootstrap.cc:654] T 3411566abe2d4c9bb4b2adfdd05e6f17 P b7ab4784c7344b939bc36f639286f377: Neither blocks nor log segments found. Creating new log.
W20260709 13:18:11.950023  7345 log.cc:927] Time spent T c4db81d9d329422bb3b4160ca4ac2d1d P cd75a17ab2604397adab03bb8b5fd75c: Append to log took a long time: real 0.156s	user 0.000s	sys 0.001s
I20260709 13:18:11.950438  6725 raft_consensus.cc:1240] T f5be3a11b23d4ea9b08300a2789821c7 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 2 FOLLOWER]: Rejecting Update request from peer cd75a17ab2604397adab03bb8b5fd75c for earlier term 1. Current term is 2. Ops: []
I20260709 13:18:11.941290  7336 raft_consensus.cc:515] T e31b9971c15848dea59d4d4130141d9e P b7ab4784c7344b939bc36f639286f377 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:11.964624  7301 leader_election.cc:290] T ab432e62819d499eaaf3dd55481dd930 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:18:11.966637  7220 leader_election.cc:290] T 17587d6730594da4a56fa13a353232a1 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 1 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:18:11.968475  7318 leader_election.cc:290] T f5be3a11b23d4ea9b08300a2789821c7 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 2 election: Requested vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:18:11.974567  6874 raft_consensus.cc:2468] T 2c240553ce044eedb41541d72b9475d7 P cd75a17ab2604397adab03bb8b5fd75c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 1.
I20260709 13:18:11.976073  7228 raft_consensus.cc:493] T 34f36d59d88f40fe8a2805e604fc6c0a P cd75a17ab2604397adab03bb8b5fd75c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
W20260709 13:18:11.976051  6697 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 185176us
I20260709 13:18:12.001539  7228 raft_consensus.cc:515] T 34f36d59d88f40fe8a2805e604fc6c0a P cd75a17ab2604397adab03bb8b5fd75c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:12.004215  7336 leader_election.cc:290] T e31b9971c15848dea59d4d4130141d9e P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:18:12.005869  7228 leader_election.cc:290] T 34f36d59d88f40fe8a2805e604fc6c0a P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:18:12.020156  6923 ts_tablet_manager.cc:1434] T b56bf91d90824c959e21e0cee5ba1816 P ccd8a4c3bfe3413cb2ae219b09aea832: Time spent starting tablet: real 0.273s	user 0.009s	sys 0.010s
W20260709 13:18:12.039685  6770 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 191257us
I20260709 13:18:12.044168  6732 raft_consensus.cc:2468] T 2c240553ce044eedb41541d72b9475d7 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 1.
W20260709 13:18:12.053145  6770 leader_election.cc:343] T 427c124d773f483294511e80fe340075 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:12.054452  7293 raft_consensus.cc:2764] T 2c240553ce044eedb41541d72b9475d7 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 1 FOLLOWER]: Leader pre-election decision vote started in defunct term 0: won
I20260709 13:18:12.059875  6802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c240553ce044eedb41541d72b9475d7" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:18:12.075577  6957 raft_consensus.cc:493] T 3fa34c08b205435dba97346991aa1f92 P b7ab4784c7344b939bc36f639286f377 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:18:12.076372  6957 raft_consensus.cc:515] T 3fa34c08b205435dba97346991aa1f92 P b7ab4784c7344b939bc36f639286f377 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:12.080499  6957 leader_election.cc:290] T 3fa34c08b205435dba97346991aa1f92 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:18:12.093930  6799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a75bfe094d4bdc963aba3f08dfcd25" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:18:12.094605  6802 raft_consensus.cc:2393] T 2c240553ce044eedb41541d72b9475d7 P b7ab4784c7344b939bc36f639286f377 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ccd8a4c3bfe3413cb2ae219b09aea832 in current term 1: Already voted for candidate b7ab4784c7344b939bc36f639286f377 in this term.
I20260709 13:18:12.088615  6805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34f36d59d88f40fe8a2805e604fc6c0a" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
W20260709 13:18:12.101140  6772 consensus_peers.cc:597] T d8cee0accdb8499c86d4414b72565a38 P b7ab4784c7344b939bc36f639286f377 -> Peer cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931): Couldn't send request to peer cd75a17ab2604397adab03bb8b5fd75c. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:12.103168  6923 tablet_bootstrap.cc:492] T 711ef6523deb4cbe8ef2ba61e1c21c98 P ccd8a4c3bfe3413cb2ae219b09aea832: Bootstrap starting.
I20260709 13:18:12.103688  7301 consensus_queue.cc:1048] T 9e326172347f45e99a0d482b5d8ef768 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:18:12.102903  6726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c240553ce044eedb41541d72b9475d7" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:18:12.091950  6876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22ccee1b570c4ad3a57bd7aec085b1b4" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
W20260709 13:18:12.106844  6772 leader_election.cc:343] T 427c124d773f483294511e80fe340075 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:12.109084  6772 leader_election.cc:304] T 427c124d773f483294511e80fe340075 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:18:12.109915  6957 raft_consensus.cc:2749] T 427c124d773f483294511e80fe340075 P b7ab4784c7344b939bc36f639286f377 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:18:12.110366  6879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab432e62819d499eaaf3dd55481dd930" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:18:12.113173  6629 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:53224 (request call id 81) took 1078 ms. Trace:
I20260709 13:18:12.113274  6877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e31b9971c15848dea59d4d4130141d9e" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:18:12.123656  6879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17587d6730594da4a56fa13a353232a1" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:18:12.123327  6732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a75bfe094d4bdc963aba3f08dfcd25" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
W20260709 13:18:12.191207  6772 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 72097.4us
I20260709 13:18:12.193269  6876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab432e62819d499eaaf3dd55481dd930" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:18:12.195504  6770 leader_election.cc:304] T 2c240553ce044eedb41541d72b9475d7 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
I20260709 13:18:12.122871  6874 raft_consensus.cc:3060] T 95a75bfe094d4bdc963aba3f08dfcd25 P cd75a17ab2604397adab03bb8b5fd75c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:12.197168  6729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22ccee1b570c4ad3a57bd7aec085b1b4" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:18:12.197741  6922 tablet_bootstrap.cc:654] T 7c44c4849aa54f2b94d1f1bef9ed546f P cd75a17ab2604397adab03bb8b5fd75c: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:12.199000  6923 tablet_bootstrap.cc:654] T 711ef6523deb4cbe8ef2ba61e1c21c98 P ccd8a4c3bfe3413cb2ae219b09aea832: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:12.202982  6880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5be3a11b23d4ea9b08300a2789821c7" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:18:12.113826  6629 rpcz_store.cc:276] 0709 13:18:11.034830 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:11.034990 (+   160us) service_pool.cc:224] Handling call
0709 13:18:12.113060 (+1078070us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:18:11.238813 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:18:11.373984 (+135171us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:18:11.374021 (+    37us) write_op.cc:435] Acquired schema lock
0709 13:18:11.374039 (+    18us) tablet.cc:662] Decoding operations
0709 13:18:11.374399 (+   360us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:18:11.374455 (+    56us) write_op.cc:641] Partition lock acquired for write op
0709 13:18:11.374487 (+    32us) tablet.cc:685] Acquiring locks for 1 operations
0709 13:18:11.374666 (+   179us) tablet.cc:701] Row locks acquired
0709 13:18:11.374684 (+    18us) write_op.cc:260] PREPARE: finished
0709 13:18:11.374822 (+   138us) write_op.cc:270] Start()
0709 13:18:11.374925 (+   103us) write_op.cc:276] Timestamp: P: 1783603091374786 usec, L: 0
0709 13:18:11.374950 (+    25us) op_driver.cc:348] REPLICATION: starting
0709 13:18:11.375570 (+   620us) log.cc:844] Serialized 537 byte log entry
0709 13:18:11.644003 (+268433us) op_driver.cc:464] REPLICATION: finished
0709 13:18:11.780619 (+136616us) write_op.cc:301] APPLY: starting
0709 13:18:11.780707 (+    88us) tablet.cc:1367] starting BulkCheckPresence
0709 13:18:11.783076 (+  2369us) tablet.cc:1370] finished BulkCheckPresence
0709 13:18:11.791856 (+  8780us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:18:11.792170 (+   314us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:18:11.792316 (+   146us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 13:18:11.792370 (+    54us) write_op.cc:312] APPLY: finished
0709 13:18:11.793525 (+  1155us) log.cc:844] Serialized 22 byte log entry
0709 13:18:11.794286 (+   761us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:18:11.794375 (+    89us) write_op.cc:454] Released schema lock
0709 13:18:11.794412 (+    37us) write_op.cc:341] FINISH: Updating metrics
0709 13:18:11.795126 (+   714us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:18:11.795259 (+   133us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":105570,"reported_tablets":1,"child_traces":[["op",{"apply.queue_time_us":125279,"apply.run_cpu_time_us":3207,"apply.run_wall_time_us":14490,"num_ops":1,"prepare.queue_time_us":51540,"prepare.run_cpu_time_us":35359,"prepare.run_wall_time_us":162703,"raft.queue_time_us":176178,"raft.run_cpu_time_us":17082,"raft.run_wall_time_us":137683,"replication_time_us":255265,"thread_start_us":221539,"threads_started":4,"wal-append.queue_time_us":61116}]]}
W20260709 13:18:12.206825  6770 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 52520.9us
I20260709 13:18:12.108649  7327 raft_consensus.cc:515] T 17587d6730594da4a56fa13a353232a1 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:12.226074  6931 raft_consensus.cc:493] T b56bf91d90824c959e21e0cee5ba1816 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:12.226713  6931 raft_consensus.cc:515] T b56bf91d90824c959e21e0cee5ba1816 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
W20260709 13:18:12.232095  6678 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
W20260709 13:18:12.234336  6770 leader_election.cc:343] T 22ccee1b570c4ad3a57bd7aec085b1b4 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:12.230921  7220 raft_consensus.cc:2804] T 2c240553ce044eedb41541d72b9475d7 P b7ab4784c7344b939bc36f639286f377 [term 1 FOLLOWER]: Leader election won for term 1
W20260709 13:18:12.294456  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 65396.5us
I20260709 13:18:12.123093  6723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34f36d59d88f40fe8a2805e604fc6c0a" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:18:12.298002  6931 leader_election.cc:290] T b56bf91d90824c959e21e0cee5ba1816 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
W20260709 13:18:12.331650  6697 leader_election.cc:343] T ab432e62819d499eaaf3dd55481dd930 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:18:12.332103  6772 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 129963us
I20260709 13:18:12.297000  7220 raft_consensus.cc:697] T 2c240553ce044eedb41541d72b9475d7 P b7ab4784c7344b939bc36f639286f377 [term 1 LEADER]: Becoming Leader. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
W20260709 13:18:12.336076  6772 leader_election.cc:343] T ab432e62819d499eaaf3dd55481dd930 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:18:12.337101  6772 leader_election.cc:343] T 22ccee1b570c4ad3a57bd7aec085b1b4 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:12.337568  6772 leader_election.cc:304] T 22ccee1b570c4ad3a57bd7aec085b1b4 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
W20260709 13:18:12.373638  6695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 43834.7us
W20260709 13:18:12.386142  6772 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 49074.1us
W20260709 13:18:12.387082  6697 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 53990.3us
I20260709 13:18:12.372593  7289 raft_consensus.cc:493] T f4b8bd455d5a47c18a1380839c6e0d61 P b7ab4784c7344b939bc36f639286f377 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:18:12.416443  6921 tablet_bootstrap.cc:492] T 3411566abe2d4c9bb4b2adfdd05e6f17 P b7ab4784c7344b939bc36f639286f377: No bootstrap required, opened a new log
I20260709 13:18:12.418520  6921 ts_tablet_manager.cc:1403] T 3411566abe2d4c9bb4b2adfdd05e6f17 P b7ab4784c7344b939bc36f639286f377: Time spent bootstrapping tablet: real 0.811s	user 0.021s	sys 0.017s
W20260709 13:18:12.387243  6772 leader_election.cc:343] T 17587d6730594da4a56fa13a353232a1 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:12.384495  6731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fa34c08b205435dba97346991aa1f92" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:18:12.420956  7327 leader_election.cc:290] T 17587d6730594da4a56fa13a353232a1 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 1 election: Requested vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:18:12.424046  7295 raft_consensus.cc:493] T c4db81d9d329422bb3b4160ca4ac2d1d P b7ab4784c7344b939bc36f639286f377 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:12.374025  7345 log.cc:927] Time spent T c4db81d9d329422bb3b4160ca4ac2d1d P cd75a17ab2604397adab03bb8b5fd75c: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
I20260709 13:18:12.426182  6957 raft_consensus.cc:493] T 7c37d41cd9164c15a6826ca62a851a69 P b7ab4784c7344b939bc36f639286f377 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:18:12.426748  6957 raft_consensus.cc:515] T 7c37d41cd9164c15a6826ca62a851a69 P b7ab4784c7344b939bc36f639286f377 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:12.424613  7295 raft_consensus.cc:515] T c4db81d9d329422bb3b4160ca4ac2d1d P b7ab4784c7344b939bc36f639286f377 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:12.418203  7285 raft_consensus.cc:2749] T 22ccee1b570c4ad3a57bd7aec085b1b4 P b7ab4784c7344b939bc36f639286f377 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:18:12.436749  7335 raft_consensus.cc:493] T 1528ab62b6fe4e3099d08f141afee116 P b7ab4784c7344b939bc36f639286f377 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:18:12.443393  6957 leader_election.cc:290] T 7c37d41cd9164c15a6826ca62a851a69 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:18:12.446827  6875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fa34c08b205435dba97346991aa1f92" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:18:12.445607  7220 consensus_queue.cc:237] T 2c240553ce044eedb41541d72b9475d7 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:12.456470  6876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c37d41cd9164c15a6826ca62a851a69" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:18:12.489817  6844 leader_election.cc:304] T 95a75bfe094d4bdc963aba3f08dfcd25 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:18:12.434582  7289 raft_consensus.cc:515] T f4b8bd455d5a47c18a1380839c6e0d61 P b7ab4784c7344b939bc36f639286f377 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:12.463553  7351 consensus_queue.cc:1048] T 713b5728a197487c9300b310ab94e5a3 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.031s
I20260709 13:18:12.498793  6844 leader_election.cc:304] T 34f36d59d88f40fe8a2805e604fc6c0a P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:18:12.473582  7285 raft_consensus.cc:493] T 7887766dc6784fcaa42b35c05fea7a99 P b7ab4784c7344b939bc36f639286f377 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:18:12.501696  7228 raft_consensus.cc:2749] T 34f36d59d88f40fe8a2805e604fc6c0a P cd75a17ab2604397adab03bb8b5fd75c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:12.503336  6805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5be3a11b23d4ea9b08300a2789821c7" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:18:12.504679  6922 tablet_bootstrap.cc:492] T 7c44c4849aa54f2b94d1f1bef9ed546f P cd75a17ab2604397adab03bb8b5fd75c: No bootstrap required, opened a new log
I20260709 13:18:12.505152  6922 ts_tablet_manager.cc:1403] T 7c44c4849aa54f2b94d1f1bef9ed546f P cd75a17ab2604397adab03bb8b5fd75c: Time spent bootstrapping tablet: real 0.614s	user 0.018s	sys 0.044s
I20260709 13:18:12.506331  6695 leader_election.cc:304] T f5be3a11b23d4ea9b08300a2789821c7 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:18:12.496443  6803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab432e62819d499eaaf3dd55481dd930" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:18:12.507283  7367 raft_consensus.cc:493] T fe20b4b48823486ca3b9c648db6ce8aa P b7ab4784c7344b939bc36f639286f377 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:18:12.461272  7335 raft_consensus.cc:515] T 1528ab62b6fe4e3099d08f141afee116 P b7ab4784c7344b939bc36f639286f377 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:12.517469  6921 raft_consensus.cc:359] T 3411566abe2d4c9bb4b2adfdd05e6f17 P b7ab4784c7344b939bc36f639286f377 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:12.518172  6921 raft_consensus.cc:385] T 3411566abe2d4c9bb4b2adfdd05e6f17 P b7ab4784c7344b939bc36f639286f377 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:12.518436  6921 raft_consensus.cc:740] T 3411566abe2d4c9bb4b2adfdd05e6f17 P b7ab4784c7344b939bc36f639286f377 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Initialized, Role: FOLLOWER
I20260709 13:18:12.518982  6921 consensus_queue.cc:260] T 3411566abe2d4c9bb4b2adfdd05e6f17 P b7ab4784c7344b939bc36f639286f377 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:12.515668  6922 raft_consensus.cc:359] T 7c44c4849aa54f2b94d1f1bef9ed546f P cd75a17ab2604397adab03bb8b5fd75c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:12.519659  6922 raft_consensus.cc:385] T 7c44c4849aa54f2b94d1f1bef9ed546f P cd75a17ab2604397adab03bb8b5fd75c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:12.519951  6922 raft_consensus.cc:740] T 7c44c4849aa54f2b94d1f1bef9ed546f P cd75a17ab2604397adab03bb8b5fd75c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cd75a17ab2604397adab03bb8b5fd75c, State: Initialized, Role: FOLLOWER
I20260709 13:18:12.521154  6922 consensus_queue.cc:260] T 7c44c4849aa54f2b94d1f1bef9ed546f P cd75a17ab2604397adab03bb8b5fd75c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:12.511848  6803 raft_consensus.cc:2468] T ab432e62819d499eaaf3dd55481dd930 P b7ab4784c7344b939bc36f639286f377 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 0.
I20260709 13:18:12.525604  6726 raft_consensus.cc:2376] T 2c240553ce044eedb41541d72b9475d7 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 1 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 1. Re-sending same reply.
I20260709 13:18:12.526199  6921 ts_tablet_manager.cc:1434] T 3411566abe2d4c9bb4b2adfdd05e6f17 P b7ab4784c7344b939bc36f639286f377: Time spent starting tablet: real 0.107s	user 0.005s	sys 0.002s
I20260709 13:18:12.528246  7325 raft_consensus.cc:2749] T f5be3a11b23d4ea9b08300a2789821c7 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:18:12.532219  7289 leader_election.cc:290] T f4b8bd455d5a47c18a1380839c6e0d61 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:18:12.507853  7285 raft_consensus.cc:515] T 7887766dc6784fcaa42b35c05fea7a99 P b7ab4784c7344b939bc36f639286f377 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:12.512569  7367 raft_consensus.cc:515] T fe20b4b48823486ca3b9c648db6ce8aa P b7ab4784c7344b939bc36f639286f377 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:12.543354  6807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b56bf91d90824c959e21e0cee5ba1816" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:18:12.544478  6807 raft_consensus.cc:2468] T b56bf91d90824c959e21e0cee5ba1816 P b7ab4784c7344b939bc36f639286f377 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 0.
I20260709 13:18:12.545120  7295 leader_election.cc:290] T c4db81d9d329422bb3b4160ca4ac2d1d P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:18:12.546844  6922 ts_tablet_manager.cc:1434] T 7c44c4849aa54f2b94d1f1bef9ed546f P cd75a17ab2604397adab03bb8b5fd75c: Time spent starting tablet: real 0.041s	user 0.017s	sys 0.002s
I20260709 13:18:12.547037  6878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4b8bd455d5a47c18a1380839c6e0d61" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:18:12.553561  6875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17587d6730594da4a56fa13a353232a1" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:18:12.553915  7367 leader_election.cc:290] T fe20b4b48823486ca3b9c648db6ce8aa P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:18:12.557513  6806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17587d6730594da4a56fa13a353232a1" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:18:12.558619  6806 raft_consensus.cc:2393] T 17587d6730594da4a56fa13a353232a1 P b7ab4784c7344b939bc36f639286f377 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate ccd8a4c3bfe3413cb2ae219b09aea832 in current term 1: Already voted for candidate b7ab4784c7344b939bc36f639286f377 in this term.
W20260709 13:18:12.565616  6697 leader_election.cc:343] T 17587d6730594da4a56fa13a353232a1 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:12.566933  6878 raft_consensus.cc:3060] T 7c44c4849aa54f2b94d1f1bef9ed546f P cd75a17ab2604397adab03bb8b5fd75c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:12.548724  7335 leader_election.cc:290] T 1528ab62b6fe4e3099d08f141afee116 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:18:12.562218  7354 consensus_queue.cc:1048] T 713b5728a197487c9300b310ab94e5a3 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.014s
I20260709 13:18:12.589599  6877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1528ab62b6fe4e3099d08f141afee116" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:18:12.596490  6873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4db81d9d329422bb3b4160ca4ac2d1d" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:18:12.597381  6923 tablet_bootstrap.cc:492] T 711ef6523deb4cbe8ef2ba61e1c21c98 P ccd8a4c3bfe3413cb2ae219b09aea832: No bootstrap required, opened a new log
I20260709 13:18:12.598004  7285 leader_election.cc:290] T 7887766dc6784fcaa42b35c05fea7a99 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:18:12.599385  6923 ts_tablet_manager.cc:1403] T 711ef6523deb4cbe8ef2ba61e1c21c98 P ccd8a4c3bfe3413cb2ae219b09aea832: Time spent bootstrapping tablet: real 0.497s	user 0.022s	sys 0.019s
I20260709 13:18:12.602960  6876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe20b4b48823486ca3b9c648db6ce8aa" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:18:12.609616  6875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7887766dc6784fcaa42b35c05fea7a99" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:18:12.614126  6695 leader_election.cc:304] T ab432e62819d499eaaf3dd55481dd930 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:18:12.615597  6695 leader_election.cc:304] T b56bf91d90824c959e21e0cee5ba1816 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
I20260709 13:18:12.599807  7368 consensus_queue.cc:1059] T f5be3a11b23d4ea9b08300a2789821c7 P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:18:12.624259  6729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e31b9971c15848dea59d4d4130141d9e" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:18:12.625731  6695 leader_election.cc:304] T 17587d6730594da4a56fa13a353232a1 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:18:12.631294  7352 raft_consensus.cc:2804] T b56bf91d90824c959e21e0cee5ba1816 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:18:12.631896  7352 raft_consensus.cc:493] T b56bf91d90824c959e21e0cee5ba1816 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:12.632450  7352 raft_consensus.cc:3060] T b56bf91d90824c959e21e0cee5ba1816 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:12.638623  6923 raft_consensus.cc:359] T 711ef6523deb4cbe8ef2ba61e1c21c98 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:12.639747  6923 raft_consensus.cc:385] T 711ef6523deb4cbe8ef2ba61e1c21c98 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:12.640911  6923 raft_consensus.cc:740] T 711ef6523deb4cbe8ef2ba61e1c21c98 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Initialized, Role: FOLLOWER
I20260709 13:18:12.642205  6923 consensus_queue.cc:260] T 711ef6523deb4cbe8ef2ba61e1c21c98 P ccd8a4c3bfe3413cb2ae219b09aea832 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:12.627271  7329 raft_consensus.cc:2804] T ab432e62819d499eaaf3dd55481dd930 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:18:12.627197  7368 raft_consensus.cc:3055] T f5be3a11b23d4ea9b08300a2789821c7 P cd75a17ab2604397adab03bb8b5fd75c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:18:12.647656  6923 ts_tablet_manager.cc:1434] T 711ef6523deb4cbe8ef2ba61e1c21c98 P ccd8a4c3bfe3413cb2ae219b09aea832: Time spent starting tablet: real 0.048s	user 0.007s	sys 0.000s
I20260709 13:18:12.647964  7329 raft_consensus.cc:493] T ab432e62819d499eaaf3dd55481dd930 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:12.659106  7329 raft_consensus.cc:3060] T ab432e62819d499eaaf3dd55481dd930 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:12.640703  7238 raft_consensus.cc:2749] T 17587d6730594da4a56fa13a353232a1 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:18:12.656440  7368 raft_consensus.cc:740] T f5be3a11b23d4ea9b08300a2789821c7 P cd75a17ab2604397adab03bb8b5fd75c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: cd75a17ab2604397adab03bb8b5fd75c, State: Running, Role: LEADER
I20260709 13:18:12.670608  6923 tablet_bootstrap.cc:492] T 3411566abe2d4c9bb4b2adfdd05e6f17 P ccd8a4c3bfe3413cb2ae219b09aea832: Bootstrap starting.
I20260709 13:18:12.673846  6872 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53416 (request call id 319) took 1032 ms. Trace:
I20260709 13:18:12.673872  6922 tablet_bootstrap.cc:492] T d8cee0accdb8499c86d4414b72565a38 P cd75a17ab2604397adab03bb8b5fd75c: Bootstrap starting.
I20260709 13:18:12.674415  6872 rpcz_store.cc:276] 0709 13:18:11.641830 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:11.661400 (+ 19570us) service_pool.cc:224] Handling call
0709 13:18:12.269942 (+608542us) spinlock_profiling.cc:243] Waited 25.6 ms on lock 0x7b5800147c98. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0c745db1 00007fcc0c885b71 00007fcc0c885a22 00007fcc1579ec09 00007fcc148f8ee0 00007fcc149c20ab 00007fcc149c2131 00007fcc14983fc0 00007fcc1496e929 00007fcc1496e3d2 00007fcc0dee5bd4
0709 13:18:12.672906 (+402964us) spinlock_profiling.cc:243] Waited 5.46 ms on lock 0x7b5800147c98. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0c745db1 00007fcc0c885e9c 00007fcc0c885a5b 00007fcc1579ec09 00007fcc148f8ee0 00007fcc149c20ab 00007fcc149c2131 00007fcc14983fc0 00007fcc1496e929 00007fcc1496e3d2 00007fcc0dee5bd4
0709 13:18:12.673128 (+   222us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:12.673337 (+   209us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:12.673374 (+    37us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:12.673517 (+   143us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:18:12.673564 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:12.673647 (+    83us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:12.673773 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":71374080}
I20260709 13:18:12.669826  7368 consensus_queue.cc:260] T f5be3a11b23d4ea9b08300a2789821c7 P cd75a17ab2604397adab03bb8b5fd75c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:12.677855  7368 raft_consensus.cc:3060] T f5be3a11b23d4ea9b08300a2789821c7 P cd75a17ab2604397adab03bb8b5fd75c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:12.732764  7298 raft_consensus.cc:2749] T 95a75bfe094d4bdc963aba3f08dfcd25 P cd75a17ab2604397adab03bb8b5fd75c [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:18:12.732575  6880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b56bf91d90824c959e21e0cee5ba1816" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
W20260709 13:18:12.734674  6697 leader_election.cc:343] T b56bf91d90824c959e21e0cee5ba1816 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:18:12.744289  7372 log.cc:927] Time spent T 95a75bfe094d4bdc963aba3f08dfcd25 P cd75a17ab2604397adab03bb8b5fd75c: Append to log took a long time: real 0.075s	user 0.000s	sys 0.002s
I20260709 13:18:12.782142  6922 tablet_bootstrap.cc:654] T d8cee0accdb8499c86d4414b72565a38 P cd75a17ab2604397adab03bb8b5fd75c: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:12.804563  6728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab432e62819d499eaaf3dd55481dd930" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
W20260709 13:18:12.812228  6726 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50004 (request call id 185) took 1540 ms (client timeout 1756 ms). Trace:
I20260709 13:18:12.814014  6724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17587d6730594da4a56fa13a353232a1" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:18:12.817042  6724 raft_consensus.cc:2393] T 17587d6730594da4a56fa13a353232a1 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate b7ab4784c7344b939bc36f639286f377 in current term 1: Already voted for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in this term.
I20260709 13:18:12.824496  6725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c37d41cd9164c15a6826ca62a851a69" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:18:12.827829  6921 tablet_bootstrap.cc:492] T 4275cf08e63345f993bce8664eada830 P b7ab4784c7344b939bc36f639286f377: Bootstrap starting.
I20260709 13:18:12.837836  6731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1528ab62b6fe4e3099d08f141afee116" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:18:12.828501  6730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4b8bd455d5a47c18a1380839c6e0d61" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
W20260709 13:18:12.813239  6726 rpcz_store.cc:269] 0709 13:18:11.272245 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:11.308335 (+ 36090us) service_pool.cc:224] Handling call
0709 13:18:11.657523 (+349188us) spinlock_profiling.cc:243] Waited 4.16 ms on lock 0x7b5800000c98. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0c745db1 00007fcc0c885b71 00007fcc0c885a22 00007fcc1579ec09 00007fcc148f8ee0 00007fcc149c20ab 00007fcc149c2131 00007fcc149700a0 00007fcc1496f984 00007fcc0deea6d4 00007fcc0deea662
0709 13:18:12.099835 (+442312us) spinlock_profiling.cc:243] Waited 1.82 ms on lock 0x7b5800000c98. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0c745db1 00007fcc0c885e9c 00007fcc0c885a5b 00007fcc1579ec09 00007fcc148f8ee0 00007fcc149c20ab 00007fcc149c2131 00007fcc149700a0 00007fcc1496f984 00007fcc0deea6d4 00007fcc0deea662
0709 13:18:12.812000 (+712165us) spinlock_profiling.cc:243] Waited 415 ms on lock 0x7b54003958d4. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f9ae2fa 00007fcc1496fb17 00007fcc0deea6d4 00007fcc0deea662 00007fcc0deea591 00007fcc0deea50c 00007fcc0dee97c2 00007fcc0dce548c 00007fcc0dce48c6 00007fcc0dce426f
0709 13:18:12.812143 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":968812032}
I20260709 13:18:12.849176  6729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe20b4b48823486ca3b9c648db6ce8aa" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:18:12.850673  6770 leader_election.cc:304] T 3fa34c08b205435dba97346991aa1f92 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:18:12.865655  7367 raft_consensus.cc:2749] T 3fa34c08b205435dba97346991aa1f92 P b7ab4784c7344b939bc36f639286f377 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:12.858564  6923 tablet_bootstrap.cc:654] T 3411566abe2d4c9bb4b2adfdd05e6f17 P ccd8a4c3bfe3413cb2ae219b09aea832: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:12.835261  7329 raft_consensus.cc:515] T ab432e62819d499eaaf3dd55481dd930 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:12.869467  6728 raft_consensus.cc:2393] T ab432e62819d499eaaf3dd55481dd930 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7ab4784c7344b939bc36f639286f377 in current term 1: Already voted for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in this term.
I20260709 13:18:12.829175  6724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4db81d9d329422bb3b4160ca4ac2d1d" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:18:12.863314  6723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7887766dc6784fcaa42b35c05fea7a99" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:18:12.846160  7352 raft_consensus.cc:515] T b56bf91d90824c959e21e0cee5ba1816 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:12.874089  7352 leader_election.cc:290] T b56bf91d90824c959e21e0cee5ba1816 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 1 election: Requested vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:18:12.876471  7351 raft_consensus.cc:493] T 711ef6523deb4cbe8ef2ba61e1c21c98 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:12.874243  6807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab432e62819d499eaaf3dd55481dd930" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:18:12.874308  7329 leader_election.cc:290] T ab432e62819d499eaaf3dd55481dd930 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 1 election: Requested vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:18:12.878549  6807 raft_consensus.cc:3060] T ab432e62819d499eaaf3dd55481dd930 P b7ab4784c7344b939bc36f639286f377 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:12.880612  6805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b56bf91d90824c959e21e0cee5ba1816" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:18:12.881224  6879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b56bf91d90824c959e21e0cee5ba1816" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:18:12.877446  7351 raft_consensus.cc:515] T 711ef6523deb4cbe8ef2ba61e1c21c98 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:12.888334  6805 raft_consensus.cc:3060] T b56bf91d90824c959e21e0cee5ba1816 P b7ab4784c7344b939bc36f639286f377 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:12.888161  6875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab432e62819d499eaaf3dd55481dd930" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
W20260709 13:18:12.898389  6697 leader_election.cc:343] T ab432e62819d499eaaf3dd55481dd930 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:18:12.899278  6697 leader_election.cc:343] T b56bf91d90824c959e21e0cee5ba1816 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:12.905730  6630 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:53234 (request call id 84) took 1510 ms. Trace:
I20260709 13:18:12.907356  6628 catalog_manager.cc:5697] T c4db81d9d329422bb3b4160ca4ac2d1d P ccd8a4c3bfe3413cb2ae219b09aea832 reported cstate change: term changed from 0 to 1, leader changed from <none> to ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65). New cstate: current_term: 1 leader_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } health_report { overall_health: UNKNOWN } } }
W20260709 13:18:12.923038  6844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:12.924867  7351 leader_election.cc:290] T 711ef6523deb4cbe8ef2ba61e1c21c98 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:18:12.929656  6922 tablet_bootstrap.cc:492] T d8cee0accdb8499c86d4414b72565a38 P cd75a17ab2604397adab03bb8b5fd75c: No bootstrap required, opened a new log
I20260709 13:18:12.931517  6922 ts_tablet_manager.cc:1403] T d8cee0accdb8499c86d4414b72565a38 P cd75a17ab2604397adab03bb8b5fd75c: Time spent bootstrapping tablet: real 0.258s	user 0.020s	sys 0.005s
I20260709 13:18:12.906324  6630 rpcz_store.cc:276] 0709 13:18:11.395265 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:11.395420 (+   155us) service_pool.cc:224] Handling call
0709 13:18:11.484268 (+ 88848us) spinlock_profiling.cc:243] Waited 2.72 ms on lock 0x7b5400156154. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f914090 00007fcc0f9b2f3a 00007fcc157691cc 00007fcc1586737e 00007fcc13d282a4 00007fcc13d28232 00007fcc13d28161 00007fcc13d280dc 00007fcc13d27392 00007fcc0dce548c 00007fcc0dce48c6
0709 13:18:12.905638 (+1421370us) inbound_call.cc:177] Queueing success response
Metrics: {"reported_tablets":8,"spinlock_wait_cycles":6260480}
W20260709 13:18:12.942929  6770 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 64906.3us
I20260709 13:18:12.943797  6770 leader_election.cc:304] T e31b9971c15848dea59d4d4130141d9e P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:18:12.970978  6807 raft_consensus.cc:2468] T ab432e62819d499eaaf3dd55481dd930 P b7ab4784c7344b939bc36f639286f377 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 1.
I20260709 13:18:12.953253  6799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "711ef6523deb4cbe8ef2ba61e1c21c98" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:18:12.964205  7285 raft_consensus.cc:2749] T e31b9971c15848dea59d4d4130141d9e P b7ab4784c7344b939bc36f639286f377 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:12.976272  6770 leader_election.cc:304] T 17587d6730594da4a56fa13a353232a1 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:18:12.951736  6875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "711ef6523deb4cbe8ef2ba61e1c21c98" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:18:12.984825  6695 leader_election.cc:304] T ab432e62819d499eaaf3dd55481dd930 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:18:12.998229  6770 leader_election.cc:304] T 7c37d41cd9164c15a6826ca62a851a69 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:18:12.982533  7285 raft_consensus.cc:2749] T 17587d6730594da4a56fa13a353232a1 P b7ab4784c7344b939bc36f639286f377 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:18:12.977334  6799 raft_consensus.cc:2468] T 711ef6523deb4cbe8ef2ba61e1c21c98 P b7ab4784c7344b939bc36f639286f377 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 0.
I20260709 13:18:13.002521  7220 raft_consensus.cc:2749] T 7c37d41cd9164c15a6826ca62a851a69 P b7ab4784c7344b939bc36f639286f377 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:13.010286  6770 leader_election.cc:304] T 1528ab62b6fe4e3099d08f141afee116 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:18:13.014863  6770 leader_election.cc:304] T f4b8bd455d5a47c18a1380839c6e0d61 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
W20260709 13:18:13.015158  6697 leader_election.cc:343] T 711ef6523deb4cbe8ef2ba61e1c21c98 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:13.016222  6770 leader_election.cc:304] T fe20b4b48823486ca3b9c648db6ce8aa P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:18:13.019382  6695 leader_election.cc:304] T 711ef6523deb4cbe8ef2ba61e1c21c98 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:18:13.019696  7349 raft_consensus.cc:2804] T ab432e62819d499eaaf3dd55481dd930 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:18:13.020619  7349 raft_consensus.cc:697] T ab432e62819d499eaaf3dd55481dd930 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 1 LEADER]: Becoming Leader. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
I20260709 13:18:13.020771  7354 raft_consensus.cc:2804] T 711ef6523deb4cbe8ef2ba61e1c21c98 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:18:13.023658  6770 leader_election.cc:304] T 7887766dc6784fcaa42b35c05fea7a99 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:18:13.006482  6805 raft_consensus.cc:2468] T b56bf91d90824c959e21e0cee5ba1816 P b7ab4784c7344b939bc36f639286f377 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 1.
I20260709 13:18:13.025532  7290 raft_consensus.cc:2749] T fe20b4b48823486ca3b9c648db6ce8aa P b7ab4784c7344b939bc36f639286f377 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:13.015520  7285 raft_consensus.cc:2749] T 1528ab62b6fe4e3099d08f141afee116 P b7ab4784c7344b939bc36f639286f377 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:13.021569  7336 raft_consensus.cc:2749] T f4b8bd455d5a47c18a1380839c6e0d61 P b7ab4784c7344b939bc36f639286f377 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:13.022756  7354 raft_consensus.cc:493] T 711ef6523deb4cbe8ef2ba61e1c21c98 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:13.035979  6922 raft_consensus.cc:359] T d8cee0accdb8499c86d4414b72565a38 P cd75a17ab2604397adab03bb8b5fd75c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:13.049655  6922 raft_consensus.cc:385] T d8cee0accdb8499c86d4414b72565a38 P cd75a17ab2604397adab03bb8b5fd75c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:13.050124  6922 raft_consensus.cc:740] T d8cee0accdb8499c86d4414b72565a38 P cd75a17ab2604397adab03bb8b5fd75c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cd75a17ab2604397adab03bb8b5fd75c, State: Initialized, Role: FOLLOWER
I20260709 13:18:13.061488  6922 consensus_queue.cc:260] T d8cee0accdb8499c86d4414b72565a38 P cd75a17ab2604397adab03bb8b5fd75c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:13.069240  6695 leader_election.cc:304] T b56bf91d90824c959e21e0cee5ba1816 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:18:13.048583  7354 raft_consensus.cc:3060] T 711ef6523deb4cbe8ef2ba61e1c21c98 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:18:13.072485  6770 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 48972.2us
I20260709 13:18:13.076398  6922 ts_tablet_manager.cc:1434] T d8cee0accdb8499c86d4414b72565a38 P cd75a17ab2604397adab03bb8b5fd75c: Time spent starting tablet: real 0.144s	user 0.009s	sys 0.004s
I20260709 13:18:13.079898  6922 tablet_bootstrap.cc:492] T b56bf91d90824c959e21e0cee5ba1816 P cd75a17ab2604397adab03bb8b5fd75c: Bootstrap starting.
I20260709 13:18:13.073217  7351 raft_consensus.cc:2804] T b56bf91d90824c959e21e0cee5ba1816 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:18:13.084491  7351 raft_consensus.cc:697] T b56bf91d90824c959e21e0cee5ba1816 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 1 LEADER]: Becoming Leader. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
I20260709 13:18:13.085631  7351 consensus_queue.cc:237] T b56bf91d90824c959e21e0cee5ba1816 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:13.090778  6770 leader_election.cc:304] T ab432e62819d499eaaf3dd55481dd930 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:18:13.093307  6770 leader_election.cc:304] T c4db81d9d329422bb3b4160ca4ac2d1d P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:18:13.074347  7335 raft_consensus.cc:2749] T 7887766dc6784fcaa42b35c05fea7a99 P b7ab4784c7344b939bc36f639286f377 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:13.031381  7349 consensus_queue.cc:237] T ab432e62819d499eaaf3dd55481dd930 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:13.100806  7292 raft_consensus.cc:2749] T c4db81d9d329422bb3b4160ca4ac2d1d P b7ab4784c7344b939bc36f639286f377 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:13.099376  7348 raft_consensus.cc:2749] T ab432e62819d499eaaf3dd55481dd930 P b7ab4784c7344b939bc36f639286f377 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:18:13.117719  6879 raft_consensus.cc:3060] T d8cee0accdb8499c86d4414b72565a38 P cd75a17ab2604397adab03bb8b5fd75c [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:18:13.133234  7379 log.cc:927] Time spent T c4db81d9d329422bb3b4160ca4ac2d1d P b7ab4784c7344b939bc36f639286f377: Append to log took a long time: real 0.118s	user 0.000s	sys 0.000s
I20260709 13:18:13.135317  6801 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:32976 (request call id 328) took 1360 ms. Trace:
I20260709 13:18:13.178320  7290 raft_consensus.cc:493] T 3411566abe2d4c9bb4b2adfdd05e6f17 P b7ab4784c7344b939bc36f639286f377 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:13.179817  7290 raft_consensus.cc:515] T 3411566abe2d4c9bb4b2adfdd05e6f17 P b7ab4784c7344b939bc36f639286f377 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:13.182070  7290 leader_election.cc:290] T 3411566abe2d4c9bb4b2adfdd05e6f17 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:18:13.183830  6881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3411566abe2d4c9bb4b2adfdd05e6f17" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
W20260709 13:18:13.192929  6772 leader_election.cc:343] T 3411566abe2d4c9bb4b2adfdd05e6f17 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:13.204674  6728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3411566abe2d4c9bb4b2adfdd05e6f17" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
W20260709 13:18:13.209864  6770 leader_election.cc:343] T 3411566abe2d4c9bb4b2adfdd05e6f17 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:13.210495  6770 leader_election.cc:304] T 3411566abe2d4c9bb4b2adfdd05e6f17 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:18:13.168716  7295 consensus_queue.cc:1048] T 2c240553ce044eedb41541d72b9475d7 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.029s
I20260709 13:18:13.234529  6921 tablet_bootstrap.cc:654] T 4275cf08e63345f993bce8664eada830 P b7ab4784c7344b939bc36f639286f377: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:13.237535  6957 consensus_queue.cc:1048] T 2c240553ce044eedb41541d72b9475d7 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:18:13.227944  7220 raft_consensus.cc:2749] T 3411566abe2d4c9bb4b2adfdd05e6f17 P b7ab4784c7344b939bc36f639286f377 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:18:13.135839  6801 rpcz_store.cc:276] 0709 13:18:11.774426 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:11.774568 (+   142us) service_pool.cc:224] Handling call
0709 13:18:12.481051 (+706483us) spinlock_profiling.cc:243] Waited 1.56 ms on lock 0x7b5800003098. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0c745db1 00007fcc0c885e9c 00007fcc0c885a5b 00007fcc1579ec09 00007fcc148f8ee0 00007fcc149c20ab 00007fcc149c2131 00007fcc14983fc0 00007fcc1496e929 00007fcc1496e3d2 00007fcc0dee5bd4
0709 13:18:12.818753 (+337702us) spinlock_profiling.cc:243] Waited 2.73 ms on lock 0x7b5800003098. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0c745db1 00007fcc0c885b71 00007fcc0c885eee 0000000000375939 00007fcc148f91e0 00007fcc149c20c4 00007fcc149c2131 00007fcc14983fc0 00007fcc1496e929 00007fcc1496e3d2 00007fcc0dee5bd4
0709 13:18:12.818930 (+   177us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:12.821510 (+  2580us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:12.821543 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:12.824480 (+  2937us) log.cc:844] Serialized 26 byte log entry
0709 13:18:12.888530 (+ 64050us) raft_consensus.cc:1645] Marking committed up to 0
0709 13:18:12.890631 (+  2101us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:12.913513 (+ 22882us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:13.134990 (+221477us) raft_consensus.cc:1685] finished
0709 13:18:13.135028 (+    38us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:13.135199 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":625,"raft.run_cpu_time_us":166,"raft.run_wall_time_us":5006,"spinlock_wait_cycles":9860736,"thread_start_us":54554,"threads_started":1,"wal-append.queue_time_us":175062}
I20260709 13:18:13.266798  7354 raft_consensus.cc:515] T 711ef6523deb4cbe8ef2ba61e1c21c98 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:13.270947  6923 tablet_bootstrap.cc:492] T 3411566abe2d4c9bb4b2adfdd05e6f17 P ccd8a4c3bfe3413cb2ae219b09aea832: No bootstrap required, opened a new log
I20260709 13:18:13.271483  6922 tablet_bootstrap.cc:654] T b56bf91d90824c959e21e0cee5ba1816 P cd75a17ab2604397adab03bb8b5fd75c: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:13.271546  6923 ts_tablet_manager.cc:1403] T 3411566abe2d4c9bb4b2adfdd05e6f17 P ccd8a4c3bfe3413cb2ae219b09aea832: Time spent bootstrapping tablet: real 0.601s	user 0.029s	sys 0.033s
W20260709 13:18:13.291915  6697 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 59595.7us
I20260709 13:18:13.305862  6923 raft_consensus.cc:359] T 3411566abe2d4c9bb4b2adfdd05e6f17 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:13.309130  6923 raft_consensus.cc:385] T 3411566abe2d4c9bb4b2adfdd05e6f17 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:13.309623  6923 raft_consensus.cc:740] T 3411566abe2d4c9bb4b2adfdd05e6f17 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Initialized, Role: FOLLOWER
I20260709 13:18:13.310675  6923 consensus_queue.cc:260] T 3411566abe2d4c9bb4b2adfdd05e6f17 P ccd8a4c3bfe3413cb2ae219b09aea832 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
W20260709 13:18:13.314980  6678 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:18:13.320106  6923 ts_tablet_manager.cc:1434] T 3411566abe2d4c9bb4b2adfdd05e6f17 P ccd8a4c3bfe3413cb2ae219b09aea832: Time spent starting tablet: real 0.048s	user 0.010s	sys 0.000s
I20260709 13:18:13.328470  7354 leader_election.cc:290] T 711ef6523deb4cbe8ef2ba61e1c21c98 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 1 election: Requested vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:18:13.336199  6881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "711ef6523deb4cbe8ef2ba61e1c21c98" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
W20260709 13:18:13.347471  6697 leader_election.cc:343] T 711ef6523deb4cbe8ef2ba61e1c21c98 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:13.349045  6807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "711ef6523deb4cbe8ef2ba61e1c21c98" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:18:13.349619  6807 raft_consensus.cc:3060] T 711ef6523deb4cbe8ef2ba61e1c21c98 P b7ab4784c7344b939bc36f639286f377 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:13.359264  6922 tablet_bootstrap.cc:492] T b56bf91d90824c959e21e0cee5ba1816 P cd75a17ab2604397adab03bb8b5fd75c: No bootstrap required, opened a new log
I20260709 13:18:13.359843  6922 ts_tablet_manager.cc:1403] T b56bf91d90824c959e21e0cee5ba1816 P cd75a17ab2604397adab03bb8b5fd75c: Time spent bootstrapping tablet: real 0.280s	user 0.022s	sys 0.007s
I20260709 13:18:13.362910  6923 tablet_bootstrap.cc:492] T 7ba5dac66ab5497e9e336f2a3c28cda5 P ccd8a4c3bfe3413cb2ae219b09aea832: Bootstrap starting.
I20260709 13:18:13.368176  6922 raft_consensus.cc:359] T b56bf91d90824c959e21e0cee5ba1816 P cd75a17ab2604397adab03bb8b5fd75c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:13.368872  6922 raft_consensus.cc:385] T b56bf91d90824c959e21e0cee5ba1816 P cd75a17ab2604397adab03bb8b5fd75c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:13.369129  6922 raft_consensus.cc:740] T b56bf91d90824c959e21e0cee5ba1816 P cd75a17ab2604397adab03bb8b5fd75c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cd75a17ab2604397adab03bb8b5fd75c, State: Initialized, Role: FOLLOWER
I20260709 13:18:13.369890  6807 raft_consensus.cc:2468] T 711ef6523deb4cbe8ef2ba61e1c21c98 P b7ab4784c7344b939bc36f639286f377 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 1.
I20260709 13:18:13.369791  6922 consensus_queue.cc:260] T b56bf91d90824c959e21e0cee5ba1816 P cd75a17ab2604397adab03bb8b5fd75c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:13.374367  6695 leader_election.cc:304] T 711ef6523deb4cbe8ef2ba61e1c21c98 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:18:13.378070  7328 raft_consensus.cc:2804] T 711ef6523deb4cbe8ef2ba61e1c21c98 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:18:13.383355  6922 ts_tablet_manager.cc:1434] T b56bf91d90824c959e21e0cee5ba1816 P cd75a17ab2604397adab03bb8b5fd75c: Time spent starting tablet: real 0.023s	user 0.006s	sys 0.000s
I20260709 13:18:13.391547  6921 tablet_bootstrap.cc:492] T 4275cf08e63345f993bce8664eada830 P b7ab4784c7344b939bc36f639286f377: No bootstrap required, opened a new log
I20260709 13:18:13.393469  6921 ts_tablet_manager.cc:1403] T 4275cf08e63345f993bce8664eada830 P b7ab4784c7344b939bc36f639286f377: Time spent bootstrapping tablet: real 0.566s	user 0.014s	sys 0.018s
I20260709 13:18:13.398953  7328 raft_consensus.cc:697] T 711ef6523deb4cbe8ef2ba61e1c21c98 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 1 LEADER]: Becoming Leader. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
I20260709 13:18:13.402693  6922 tablet_bootstrap.cc:492] T 7ba5dac66ab5497e9e336f2a3c28cda5 P cd75a17ab2604397adab03bb8b5fd75c: Bootstrap starting.
I20260709 13:18:13.404330  6921 raft_consensus.cc:359] T 4275cf08e63345f993bce8664eada830 P b7ab4784c7344b939bc36f639286f377 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:13.405210  6921 raft_consensus.cc:385] T 4275cf08e63345f993bce8664eada830 P b7ab4784c7344b939bc36f639286f377 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:13.405556  6921 raft_consensus.cc:740] T 4275cf08e63345f993bce8664eada830 P b7ab4784c7344b939bc36f639286f377 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Initialized, Role: FOLLOWER
I20260709 13:18:13.406406  6921 consensus_queue.cc:260] T 4275cf08e63345f993bce8664eada830 P b7ab4784c7344b939bc36f639286f377 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:13.409319  6921 ts_tablet_manager.cc:1434] T 4275cf08e63345f993bce8664eada830 P b7ab4784c7344b939bc36f639286f377: Time spent starting tablet: real 0.015s	user 0.009s	sys 0.000s
I20260709 13:18:13.400178  7328 consensus_queue.cc:237] T 711ef6523deb4cbe8ef2ba61e1c21c98 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:13.419694  6921 tablet_bootstrap.cc:492] T 7ba5dac66ab5497e9e336f2a3c28cda5 P b7ab4784c7344b939bc36f639286f377: Bootstrap starting.
I20260709 13:18:13.423489  6923 tablet_bootstrap.cc:654] T 7ba5dac66ab5497e9e336f2a3c28cda5 P ccd8a4c3bfe3413cb2ae219b09aea832: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:13.483402  6922 tablet_bootstrap.cc:654] T 7ba5dac66ab5497e9e336f2a3c28cda5 P cd75a17ab2604397adab03bb8b5fd75c: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:13.484732  7328 raft_consensus.cc:493] T 3411566abe2d4c9bb4b2adfdd05e6f17 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:13.485599  7328 raft_consensus.cc:515] T 3411566abe2d4c9bb4b2adfdd05e6f17 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:13.497076  7328 leader_election.cc:290] T 3411566abe2d4c9bb4b2adfdd05e6f17 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:18:13.512295  6628 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:53214 (request call id 89) took 2077 ms. Trace:
I20260709 13:18:13.513717  7298 raft_consensus.cc:493] T b56bf91d90824c959e21e0cee5ba1816 P cd75a17ab2604397adab03bb8b5fd75c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:13.514392  7298 raft_consensus.cc:515] T b56bf91d90824c959e21e0cee5ba1816 P cd75a17ab2604397adab03bb8b5fd75c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:13.518749  7298 leader_election.cc:290] T b56bf91d90824c959e21e0cee5ba1816 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:18:13.545094  6729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b56bf91d90824c959e21e0cee5ba1816" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:18:13.546092  6805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b56bf91d90824c959e21e0cee5ba1816" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:18:13.547037  6805 raft_consensus.cc:2393] T b56bf91d90824c959e21e0cee5ba1816 P b7ab4784c7344b939bc36f639286f377 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c in current term 1: Already voted for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in this term.
I20260709 13:18:13.549214  6844 leader_election.cc:304] T b56bf91d90824c959e21e0cee5ba1816 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:18:13.550693  7298 raft_consensus.cc:3060] T b56bf91d90824c959e21e0cee5ba1816 P cd75a17ab2604397adab03bb8b5fd75c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:13.552430  6801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3411566abe2d4c9bb4b2adfdd05e6f17" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:18:13.553144  6801 raft_consensus.cc:2468] T 3411566abe2d4c9bb4b2adfdd05e6f17 P b7ab4784c7344b939bc36f639286f377 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 0.
I20260709 13:18:13.554754  6695 leader_election.cc:304] T 3411566abe2d4c9bb4b2adfdd05e6f17 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
I20260709 13:18:13.558051  7293 raft_consensus.cc:2804] T 3411566abe2d4c9bb4b2adfdd05e6f17 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:18:13.558660  7293 raft_consensus.cc:493] T 3411566abe2d4c9bb4b2adfdd05e6f17 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:13.559129  7293 raft_consensus.cc:3060] T 3411566abe2d4c9bb4b2adfdd05e6f17 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:13.574501  7293 raft_consensus.cc:515] T 3411566abe2d4c9bb4b2adfdd05e6f17 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:13.580381  6879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3411566abe2d4c9bb4b2adfdd05e6f17" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:18:13.613183  7293 leader_election.cc:290] T 3411566abe2d4c9bb4b2adfdd05e6f17 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 1 election: Requested vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:18:13.613401  6923 tablet_bootstrap.cc:492] T 7ba5dac66ab5497e9e336f2a3c28cda5 P ccd8a4c3bfe3413cb2ae219b09aea832: No bootstrap required, opened a new log
I20260709 13:18:13.538666  6629 catalog_manager.cc:5697] T 713b5728a197487c9300b310ab94e5a3 P cd75a17ab2604397adab03bb8b5fd75c reported cstate change: term changed from 0 to 1, leader changed from <none> to ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65). New cstate: current_term: 1 leader_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } }
I20260709 13:18:13.614058  6923 ts_tablet_manager.cc:1403] T 7ba5dac66ab5497e9e336f2a3c28cda5 P ccd8a4c3bfe3413cb2ae219b09aea832: Time spent bootstrapping tablet: real 0.252s	user 0.064s	sys 0.091s
I20260709 13:18:13.512840  6628 rpcz_store.cc:276] 0709 13:18:11.434487 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:11.434647 (+   160us) service_pool.cc:224] Handling call
0709 13:18:13.512195 (+2077548us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:18:13.002874 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:18:13.029944 (+ 27070us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:18:13.030011 (+    67us) write_op.cc:435] Acquired schema lock
0709 13:18:13.030042 (+    31us) tablet.cc:662] Decoding operations
0709 13:18:13.030535 (+   493us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:18:13.030649 (+   114us) write_op.cc:641] Partition lock acquired for write op
0709 13:18:13.030702 (+    53us) tablet.cc:685] Acquiring locks for 1 operations
0709 13:18:13.030983 (+   281us) tablet.cc:701] Row locks acquired
0709 13:18:13.031117 (+   134us) write_op.cc:260] PREPARE: finished
0709 13:18:13.031338 (+   221us) write_op.cc:270] Start()
0709 13:18:13.031495 (+   157us) write_op.cc:276] Timestamp: P: 1783603093031271 usec, L: 0
0709 13:18:13.031525 (+    30us) op_driver.cc:348] REPLICATION: starting
0709 13:18:13.067761 (+ 36236us) log.cc:844] Serialized 537 byte log entry
0709 13:18:13.371647 (+303886us) op_driver.cc:464] REPLICATION: finished
0709 13:18:13.412951 (+ 41304us) write_op.cc:301] APPLY: starting
0709 13:18:13.413029 (+    78us) tablet.cc:1367] starting BulkCheckPresence
0709 13:18:13.413124 (+    95us) tablet.cc:1370] finished BulkCheckPresence
0709 13:18:13.413248 (+   124us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:18:13.413454 (+   206us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:18:13.421214 (+  7760us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 13:18:13.421266 (+    52us) write_op.cc:312] APPLY: finished
0709 13:18:13.447746 (+ 26480us) log.cc:844] Serialized 22 byte log entry
0709 13:18:13.451624 (+  3878us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:18:13.451747 (+   123us) write_op.cc:454] Released schema lock
0709 13:18:13.451801 (+    54us) write_op.cc:341] FINISH: Updating metrics
0709 13:18:13.452201 (+   400us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:18:13.452238 (+    37us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":10276,"reported_tablets":6,"child_traces":[["op",{"apply.queue_time_us":41080,"apply.run_cpu_time_us":2295,"apply.run_wall_time_us":39245,"num_ops":1,"prepare.queue_time_us":91997,"prepare.run_cpu_time_us":61480,"prepare.run_wall_time_us":187944,"raft.queue_time_us":69240,"raft.run_cpu_time_us":14897,"raft.run_wall_time_us":33853,"replication_time_us":339972,"thread_start_us":245551,"threads_started":4,"wal-append.queue_time_us":173189}]]}
I20260709 13:18:13.601686  6922 tablet_bootstrap.cc:492] T 7ba5dac66ab5497e9e336f2a3c28cda5 P cd75a17ab2604397adab03bb8b5fd75c: No bootstrap required, opened a new log
I20260709 13:18:13.621068  6922 ts_tablet_manager.cc:1403] T 7ba5dac66ab5497e9e336f2a3c28cda5 P cd75a17ab2604397adab03bb8b5fd75c: Time spent bootstrapping tablet: real 0.229s	user 0.015s	sys 0.003s
I20260709 13:18:13.621595  6805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3411566abe2d4c9bb4b2adfdd05e6f17" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:18:13.622217  6805 raft_consensus.cc:3060] T 3411566abe2d4c9bb4b2adfdd05e6f17 P b7ab4784c7344b939bc36f639286f377 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:13.624128  6922 raft_consensus.cc:359] T 7ba5dac66ab5497e9e336f2a3c28cda5 P cd75a17ab2604397adab03bb8b5fd75c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:13.624886  6922 raft_consensus.cc:385] T 7ba5dac66ab5497e9e336f2a3c28cda5 P cd75a17ab2604397adab03bb8b5fd75c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:13.625178  6922 raft_consensus.cc:740] T 7ba5dac66ab5497e9e336f2a3c28cda5 P cd75a17ab2604397adab03bb8b5fd75c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cd75a17ab2604397adab03bb8b5fd75c, State: Initialized, Role: FOLLOWER
I20260709 13:18:13.625880  6922 consensus_queue.cc:260] T 7ba5dac66ab5497e9e336f2a3c28cda5 P cd75a17ab2604397adab03bb8b5fd75c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:13.627455  6922 ts_tablet_manager.cc:1434] T 7ba5dac66ab5497e9e336f2a3c28cda5 P cd75a17ab2604397adab03bb8b5fd75c: Time spent starting tablet: real 0.006s	user 0.002s	sys 0.001s
I20260709 13:18:13.628481  6922 tablet_bootstrap.cc:492] T 3411566abe2d4c9bb4b2adfdd05e6f17 P cd75a17ab2604397adab03bb8b5fd75c: Bootstrap starting.
I20260709 13:18:13.628712  6805 raft_consensus.cc:2468] T 3411566abe2d4c9bb4b2adfdd05e6f17 P b7ab4784c7344b939bc36f639286f377 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 1.
I20260709 13:18:13.631698  6695 leader_election.cc:304] T 3411566abe2d4c9bb4b2adfdd05e6f17 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
I20260709 13:18:13.632524  7354 raft_consensus.cc:2804] T 3411566abe2d4c9bb4b2adfdd05e6f17 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:18:13.633040  7354 raft_consensus.cc:697] T 3411566abe2d4c9bb4b2adfdd05e6f17 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 1 LEADER]: Becoming Leader. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
I20260709 13:18:13.633061  6923 raft_consensus.cc:359] T 7ba5dac66ab5497e9e336f2a3c28cda5 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:13.633952  6923 raft_consensus.cc:385] T 7ba5dac66ab5497e9e336f2a3c28cda5 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:13.634394  6923 raft_consensus.cc:740] T 7ba5dac66ab5497e9e336f2a3c28cda5 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Initialized, Role: FOLLOWER
I20260709 13:18:13.634087  7354 consensus_queue.cc:237] T 3411566abe2d4c9bb4b2adfdd05e6f17 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:13.637512  6923 consensus_queue.cc:260] T 7ba5dac66ab5497e9e336f2a3c28cda5 P ccd8a4c3bfe3413cb2ae219b09aea832 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:13.603295  7298 raft_consensus.cc:2749] T b56bf91d90824c959e21e0cee5ba1816 P cd75a17ab2604397adab03bb8b5fd75c [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:18:13.607136  6921 tablet_bootstrap.cc:654] T 7ba5dac66ab5497e9e336f2a3c28cda5 P b7ab4784c7344b939bc36f639286f377: Neither blocks nor log segments found. Creating new log.
W20260709 13:18:13.610643  6697 consensus_peers.cc:597] T ab432e62819d499eaaf3dd55481dd930 P ccd8a4c3bfe3413cb2ae219b09aea832 -> Peer cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931): Couldn't send request to peer cd75a17ab2604397adab03bb8b5fd75c. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:18:13.641008  6697 leader_election.cc:343] T 3411566abe2d4c9bb4b2adfdd05e6f17 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:13.641639  6922 tablet_bootstrap.cc:654] T 3411566abe2d4c9bb4b2adfdd05e6f17 P cd75a17ab2604397adab03bb8b5fd75c: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:13.644070  6876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3411566abe2d4c9bb4b2adfdd05e6f17" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:18:13.639586  6630 catalog_manager.cc:5697] T d8cee0accdb8499c86d4414b72565a38 P b7ab4784c7344b939bc36f639286f377 reported cstate change: term changed from 0 to 1, leader changed from <none> to b7ab4784c7344b939bc36f639286f377 (127.5.126.66). New cstate: current_term: 1 leader_uuid: "b7ab4784c7344b939bc36f639286f377" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:13.639897  6923 ts_tablet_manager.cc:1434] T 7ba5dac66ab5497e9e336f2a3c28cda5 P ccd8a4c3bfe3413cb2ae219b09aea832: Time spent starting tablet: real 0.026s	user 0.005s	sys 0.000s
I20260709 13:18:13.646993  6923 tablet_bootstrap.cc:492] T 22ccee1b570c4ad3a57bd7aec085b1b4 P ccd8a4c3bfe3413cb2ae219b09aea832: Bootstrap starting.
W20260709 13:18:13.647217  6697 leader_election.cc:343] T 3411566abe2d4c9bb4b2adfdd05e6f17 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:13.651309  6921 tablet_bootstrap.cc:492] T 7ba5dac66ab5497e9e336f2a3c28cda5 P b7ab4784c7344b939bc36f639286f377: No bootstrap required, opened a new log
I20260709 13:18:13.651866  6921 ts_tablet_manager.cc:1403] T 7ba5dac66ab5497e9e336f2a3c28cda5 P b7ab4784c7344b939bc36f639286f377: Time spent bootstrapping tablet: real 0.232s	user 0.015s	sys 0.004s
I20260709 13:18:13.654580  6923 tablet_bootstrap.cc:654] T 22ccee1b570c4ad3a57bd7aec085b1b4 P ccd8a4c3bfe3413cb2ae219b09aea832: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:13.655277  6921 raft_consensus.cc:359] T 7ba5dac66ab5497e9e336f2a3c28cda5 P b7ab4784c7344b939bc36f639286f377 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:13.661466  6921 raft_consensus.cc:385] T 7ba5dac66ab5497e9e336f2a3c28cda5 P b7ab4784c7344b939bc36f639286f377 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:13.661783  6921 raft_consensus.cc:740] T 7ba5dac66ab5497e9e336f2a3c28cda5 P b7ab4784c7344b939bc36f639286f377 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Initialized, Role: FOLLOWER
I20260709 13:18:13.663919  6922 tablet_bootstrap.cc:492] T 3411566abe2d4c9bb4b2adfdd05e6f17 P cd75a17ab2604397adab03bb8b5fd75c: No bootstrap required, opened a new log
I20260709 13:18:13.664479  6922 ts_tablet_manager.cc:1403] T 3411566abe2d4c9bb4b2adfdd05e6f17 P cd75a17ab2604397adab03bb8b5fd75c: Time spent bootstrapping tablet: real 0.036s	user 0.006s	sys 0.009s
I20260709 13:18:13.667318  6922 raft_consensus.cc:359] T 3411566abe2d4c9bb4b2adfdd05e6f17 P cd75a17ab2604397adab03bb8b5fd75c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:13.669759  6921 consensus_queue.cc:260] T 7ba5dac66ab5497e9e336f2a3c28cda5 P b7ab4784c7344b939bc36f639286f377 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:13.667958  6922 raft_consensus.cc:385] T 3411566abe2d4c9bb4b2adfdd05e6f17 P cd75a17ab2604397adab03bb8b5fd75c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:13.671247  6922 raft_consensus.cc:740] T 3411566abe2d4c9bb4b2adfdd05e6f17 P cd75a17ab2604397adab03bb8b5fd75c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cd75a17ab2604397adab03bb8b5fd75c, State: Initialized, Role: FOLLOWER
I20260709 13:18:13.671913  6922 consensus_queue.cc:260] T 3411566abe2d4c9bb4b2adfdd05e6f17 P cd75a17ab2604397adab03bb8b5fd75c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:13.674989  6922 ts_tablet_manager.cc:1434] T 3411566abe2d4c9bb4b2adfdd05e6f17 P cd75a17ab2604397adab03bb8b5fd75c: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 13:18:13.676148  6922 tablet_bootstrap.cc:492] T 22ccee1b570c4ad3a57bd7aec085b1b4 P cd75a17ab2604397adab03bb8b5fd75c: Bootstrap starting.
I20260709 13:18:13.680950  6921 ts_tablet_manager.cc:1434] T 7ba5dac66ab5497e9e336f2a3c28cda5 P b7ab4784c7344b939bc36f639286f377: Time spent starting tablet: real 0.029s	user 0.002s	sys 0.004s
I20260709 13:18:13.682152  6921 tablet_bootstrap.cc:492] T be1a92657f494cac8dd227d152f50151 P b7ab4784c7344b939bc36f639286f377: Bootstrap starting.
I20260709 13:18:13.689589  7238 consensus_queue.cc:1048] T ab432e62819d499eaaf3dd55481dd930 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:18:13.691444  6922 tablet_bootstrap.cc:654] T 22ccee1b570c4ad3a57bd7aec085b1b4 P cd75a17ab2604397adab03bb8b5fd75c: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:13.693938  6921 tablet_bootstrap.cc:654] T be1a92657f494cac8dd227d152f50151 P b7ab4784c7344b939bc36f639286f377: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:13.719803  6922 tablet_bootstrap.cc:492] T 22ccee1b570c4ad3a57bd7aec085b1b4 P cd75a17ab2604397adab03bb8b5fd75c: No bootstrap required, opened a new log
I20260709 13:18:13.720368  6922 ts_tablet_manager.cc:1403] T 22ccee1b570c4ad3a57bd7aec085b1b4 P cd75a17ab2604397adab03bb8b5fd75c: Time spent bootstrapping tablet: real 0.045s	user 0.016s	sys 0.000s
I20260709 13:18:13.723407  6922 raft_consensus.cc:359] T 22ccee1b570c4ad3a57bd7aec085b1b4 P cd75a17ab2604397adab03bb8b5fd75c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:13.723812  6921 tablet_bootstrap.cc:492] T be1a92657f494cac8dd227d152f50151 P b7ab4784c7344b939bc36f639286f377: No bootstrap required, opened a new log
I20260709 13:18:13.724217  6922 raft_consensus.cc:385] T 22ccee1b570c4ad3a57bd7aec085b1b4 P cd75a17ab2604397adab03bb8b5fd75c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:13.724586  6922 raft_consensus.cc:740] T 22ccee1b570c4ad3a57bd7aec085b1b4 P cd75a17ab2604397adab03bb8b5fd75c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cd75a17ab2604397adab03bb8b5fd75c, State: Initialized, Role: FOLLOWER
I20260709 13:18:13.724717  6921 ts_tablet_manager.cc:1403] T be1a92657f494cac8dd227d152f50151 P b7ab4784c7344b939bc36f639286f377: Time spent bootstrapping tablet: real 0.043s	user 0.017s	sys 0.000s
I20260709 13:18:13.725371  6922 consensus_queue.cc:260] T 22ccee1b570c4ad3a57bd7aec085b1b4 P cd75a17ab2604397adab03bb8b5fd75c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:13.728404  6922 ts_tablet_manager.cc:1434] T 22ccee1b570c4ad3a57bd7aec085b1b4 P cd75a17ab2604397adab03bb8b5fd75c: Time spent starting tablet: real 0.008s	user 0.004s	sys 0.004s
I20260709 13:18:13.728185  6921 raft_consensus.cc:359] T be1a92657f494cac8dd227d152f50151 P b7ab4784c7344b939bc36f639286f377 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:13.728919  6921 raft_consensus.cc:385] T be1a92657f494cac8dd227d152f50151 P b7ab4784c7344b939bc36f639286f377 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:13.729213  6921 raft_consensus.cc:740] T be1a92657f494cac8dd227d152f50151 P b7ab4784c7344b939bc36f639286f377 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Initialized, Role: FOLLOWER
I20260709 13:18:13.729512  6922 tablet_bootstrap.cc:492] T 427c124d773f483294511e80fe340075 P cd75a17ab2604397adab03bb8b5fd75c: Bootstrap starting.
I20260709 13:18:13.730027  6921 consensus_queue.cc:260] T be1a92657f494cac8dd227d152f50151 P b7ab4784c7344b939bc36f639286f377 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:13.732975  6921 ts_tablet_manager.cc:1434] T be1a92657f494cac8dd227d152f50151 P b7ab4784c7344b939bc36f639286f377: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 13:18:13.741187  6922 tablet_bootstrap.cc:654] T 427c124d773f483294511e80fe340075 P cd75a17ab2604397adab03bb8b5fd75c: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:13.733713  6630 catalog_manager.cc:5697] T 2c240553ce044eedb41541d72b9475d7 P b7ab4784c7344b939bc36f639286f377 reported cstate change: term changed from 0 to 1, leader changed from <none> to b7ab4784c7344b939bc36f639286f377 (127.5.126.66). New cstate: current_term: 1 leader_uuid: "b7ab4784c7344b939bc36f639286f377" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:13.749580  6923 tablet_bootstrap.cc:492] T 22ccee1b570c4ad3a57bd7aec085b1b4 P ccd8a4c3bfe3413cb2ae219b09aea832: No bootstrap required, opened a new log
I20260709 13:18:13.750094  6923 ts_tablet_manager.cc:1403] T 22ccee1b570c4ad3a57bd7aec085b1b4 P ccd8a4c3bfe3413cb2ae219b09aea832: Time spent bootstrapping tablet: real 0.103s	user 0.044s	sys 0.034s
I20260709 13:18:13.750552  7328 consensus_queue.cc:1048] T b56bf91d90824c959e21e0cee5ba1816 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:18:13.752749  6923 raft_consensus.cc:359] T 22ccee1b570c4ad3a57bd7aec085b1b4 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:13.753407  6923 raft_consensus.cc:385] T 22ccee1b570c4ad3a57bd7aec085b1b4 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:13.753656  6923 raft_consensus.cc:740] T 22ccee1b570c4ad3a57bd7aec085b1b4 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Initialized, Role: FOLLOWER
I20260709 13:18:13.756405  6923 consensus_queue.cc:260] T 22ccee1b570c4ad3a57bd7aec085b1b4 P ccd8a4c3bfe3413cb2ae219b09aea832 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:13.758904  6923 ts_tablet_manager.cc:1434] T 22ccee1b570c4ad3a57bd7aec085b1b4 P ccd8a4c3bfe3413cb2ae219b09aea832: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.002s
I20260709 13:18:13.760138  6923 tablet_bootstrap.cc:492] T 4275cf08e63345f993bce8664eada830 P ccd8a4c3bfe3413cb2ae219b09aea832: Bootstrap starting.
I20260709 13:18:13.761888  6922 tablet_bootstrap.cc:492] T 427c124d773f483294511e80fe340075 P cd75a17ab2604397adab03bb8b5fd75c: No bootstrap required, opened a new log
I20260709 13:18:13.762380  6922 ts_tablet_manager.cc:1403] T 427c124d773f483294511e80fe340075 P cd75a17ab2604397adab03bb8b5fd75c: Time spent bootstrapping tablet: real 0.033s	user 0.014s	sys 0.011s
I20260709 13:18:13.768718  7342 consensus_queue.cc:1048] T b56bf91d90824c959e21e0cee5ba1816 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:18:13.767886  7298 raft_consensus.cc:493] T 7ba5dac66ab5497e9e336f2a3c28cda5 P cd75a17ab2604397adab03bb8b5fd75c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:13.771221  7298 raft_consensus.cc:515] T 7ba5dac66ab5497e9e336f2a3c28cda5 P cd75a17ab2604397adab03bb8b5fd75c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:13.772856  6923 tablet_bootstrap.cc:654] T 4275cf08e63345f993bce8664eada830 P ccd8a4c3bfe3413cb2ae219b09aea832: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:13.774343  7290 raft_consensus.cc:493] T 4275cf08e63345f993bce8664eada830 P b7ab4784c7344b939bc36f639286f377 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:13.774966  6805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ba5dac66ab5497e9e336f2a3c28cda5" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:18:13.774792  7290 raft_consensus.cc:515] T 4275cf08e63345f993bce8664eada830 P b7ab4784c7344b939bc36f639286f377 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:13.775486  6805 raft_consensus.cc:2468] T 7ba5dac66ab5497e9e336f2a3c28cda5 P b7ab4784c7344b939bc36f639286f377 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 0.
I20260709 13:18:13.775381  6729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ba5dac66ab5497e9e336f2a3c28cda5" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:18:13.776491  6729 raft_consensus.cc:2468] T 7ba5dac66ab5497e9e336f2a3c28cda5 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 0.
I20260709 13:18:13.776749  7290 leader_election.cc:290] T 4275cf08e63345f993bce8664eada830 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:18:13.778394  6844 leader_election.cc:304] T 7ba5dac66ab5497e9e336f2a3c28cda5 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:18:13.777817  6728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4275cf08e63345f993bce8664eada830" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
W20260709 13:18:13.780745  6770 leader_election.cc:343] T 4275cf08e63345f993bce8664eada830 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:13.781652  6876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4275cf08e63345f993bce8664eada830" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:18:13.782706  7343 raft_consensus.cc:2804] T 7ba5dac66ab5497e9e336f2a3c28cda5 P cd75a17ab2604397adab03bb8b5fd75c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:18:13.783123  7343 raft_consensus.cc:493] T 7ba5dac66ab5497e9e336f2a3c28cda5 P cd75a17ab2604397adab03bb8b5fd75c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:13.783442  7343 raft_consensus.cc:3060] T 7ba5dac66ab5497e9e336f2a3c28cda5 P cd75a17ab2604397adab03bb8b5fd75c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:13.773546  7298 leader_election.cc:290] T 7ba5dac66ab5497e9e336f2a3c28cda5 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
W20260709 13:18:13.785167  6772 leader_election.cc:343] T 4275cf08e63345f993bce8664eada830 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:13.785735  6772 leader_election.cc:304] T 4275cf08e63345f993bce8664eada830 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:18:13.787179  7290 raft_consensus.cc:2749] T 4275cf08e63345f993bce8664eada830 P b7ab4784c7344b939bc36f639286f377 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:18:13.778995  6922 raft_consensus.cc:359] T 427c124d773f483294511e80fe340075 P cd75a17ab2604397adab03bb8b5fd75c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:13.798728  6922 raft_consensus.cc:385] T 427c124d773f483294511e80fe340075 P cd75a17ab2604397adab03bb8b5fd75c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:13.799134  6922 raft_consensus.cc:740] T 427c124d773f483294511e80fe340075 P cd75a17ab2604397adab03bb8b5fd75c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cd75a17ab2604397adab03bb8b5fd75c, State: Initialized, Role: FOLLOWER
I20260709 13:18:13.808763  6922 consensus_queue.cc:260] T 427c124d773f483294511e80fe340075 P cd75a17ab2604397adab03bb8b5fd75c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:13.818034  6922 ts_tablet_manager.cc:1434] T 427c124d773f483294511e80fe340075 P cd75a17ab2604397adab03bb8b5fd75c: Time spent starting tablet: real 0.055s	user 0.007s	sys 0.001s
I20260709 13:18:13.808964  7343 raft_consensus.cc:515] T 7ba5dac66ab5497e9e336f2a3c28cda5 P cd75a17ab2604397adab03bb8b5fd75c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:13.829600  7343 leader_election.cc:290] T 7ba5dac66ab5497e9e336f2a3c28cda5 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 1 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:18:13.833861  6807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ba5dac66ab5497e9e336f2a3c28cda5" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:18:13.834472  6807 raft_consensus.cc:3060] T 7ba5dac66ab5497e9e336f2a3c28cda5 P b7ab4784c7344b939bc36f639286f377 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:13.849804  6728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ba5dac66ab5497e9e336f2a3c28cda5" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:18:13.850575  6728 raft_consensus.cc:3060] T 7ba5dac66ab5497e9e336f2a3c28cda5 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:13.855597  6922 tablet_bootstrap.cc:492] T ab432e62819d499eaaf3dd55481dd930 P cd75a17ab2604397adab03bb8b5fd75c: Bootstrap starting.
I20260709 13:18:13.857216  7238 consensus_queue.cc:1048] T 711ef6523deb4cbe8ef2ba61e1c21c98 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:18:13.857863  7343 raft_consensus.cc:493] T 3411566abe2d4c9bb4b2adfdd05e6f17 P cd75a17ab2604397adab03bb8b5fd75c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:13.858394  7343 raft_consensus.cc:515] T 3411566abe2d4c9bb4b2adfdd05e6f17 P cd75a17ab2604397adab03bb8b5fd75c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:13.861340  6629 catalog_manager.cc:5697] T ab432e62819d499eaaf3dd55481dd930 P ccd8a4c3bfe3413cb2ae219b09aea832 reported cstate change: term changed from 0 to 1, leader changed from <none> to ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65). New cstate: current_term: 1 leader_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:13.868755  7343 leader_election.cc:290] T 3411566abe2d4c9bb4b2adfdd05e6f17 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:18:13.871729  6729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3411566abe2d4c9bb4b2adfdd05e6f17" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:18:13.871803  6805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3411566abe2d4c9bb4b2adfdd05e6f17" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:18:13.872805  6805 raft_consensus.cc:2393] T 3411566abe2d4c9bb4b2adfdd05e6f17 P b7ab4784c7344b939bc36f639286f377 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c in current term 1: Already voted for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in this term.
I20260709 13:18:13.876647  6844 leader_election.cc:304] T 3411566abe2d4c9bb4b2adfdd05e6f17 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:18:13.880101  7343 raft_consensus.cc:3060] T 3411566abe2d4c9bb4b2adfdd05e6f17 P cd75a17ab2604397adab03bb8b5fd75c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:13.880584  6807 raft_consensus.cc:2468] T 7ba5dac66ab5497e9e336f2a3c28cda5 P b7ab4784c7344b939bc36f639286f377 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 1.
I20260709 13:18:13.887579  6844 leader_election.cc:304] T 7ba5dac66ab5497e9e336f2a3c28cda5 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:18:13.887578  6629 catalog_manager.cc:5697] T 711ef6523deb4cbe8ef2ba61e1c21c98 P ccd8a4c3bfe3413cb2ae219b09aea832 reported cstate change: term changed from 0 to 1, leader changed from <none> to ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65). New cstate: current_term: 1 leader_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:13.891290  6923 tablet_bootstrap.cc:492] T 4275cf08e63345f993bce8664eada830 P ccd8a4c3bfe3413cb2ae219b09aea832: No bootstrap required, opened a new log
I20260709 13:18:13.890789  6629 catalog_manager.cc:5697] T 3411566abe2d4c9bb4b2adfdd05e6f17 P ccd8a4c3bfe3413cb2ae219b09aea832 reported cstate change: term changed from 0 to 1, leader changed from <none> to ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65). New cstate: current_term: 1 leader_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:13.891821  6923 ts_tablet_manager.cc:1403] T 4275cf08e63345f993bce8664eada830 P ccd8a4c3bfe3413cb2ae219b09aea832: Time spent bootstrapping tablet: real 0.132s	user 0.031s	sys 0.017s
I20260709 13:18:13.897576  6629 catalog_manager.cc:5697] T b56bf91d90824c959e21e0cee5ba1816 P ccd8a4c3bfe3413cb2ae219b09aea832 reported cstate change: term changed from 0 to 1, leader changed from <none> to ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65). New cstate: current_term: 1 leader_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:13.888940  7298 raft_consensus.cc:2804] T 7ba5dac66ab5497e9e336f2a3c28cda5 P cd75a17ab2604397adab03bb8b5fd75c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:18:13.933185  7298 raft_consensus.cc:697] T 7ba5dac66ab5497e9e336f2a3c28cda5 P cd75a17ab2604397adab03bb8b5fd75c [term 1 LEADER]: Becoming Leader. State: Replica: cd75a17ab2604397adab03bb8b5fd75c, State: Running, Role: LEADER
I20260709 13:18:13.933504  7414 raft_consensus.cc:493] T f5be3a11b23d4ea9b08300a2789821c7 P cd75a17ab2604397adab03bb8b5fd75c [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:13.950623  7298 consensus_queue.cc:237] T 7ba5dac66ab5497e9e336f2a3c28cda5 P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:13.951036  6923 raft_consensus.cc:359] T 4275cf08e63345f993bce8664eada830 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:13.951630  6923 raft_consensus.cc:385] T 4275cf08e63345f993bce8664eada830 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:13.951880  6923 raft_consensus.cc:740] T 4275cf08e63345f993bce8664eada830 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Initialized, Role: FOLLOWER
I20260709 13:18:13.952505  6923 consensus_queue.cc:260] T 4275cf08e63345f993bce8664eada830 P ccd8a4c3bfe3413cb2ae219b09aea832 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:13.962594  7413 raft_consensus.cc:493] T 427c124d773f483294511e80fe340075 P cd75a17ab2604397adab03bb8b5fd75c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:13.963399  6728 raft_consensus.cc:2468] T 7ba5dac66ab5497e9e336f2a3c28cda5 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 1.
I20260709 13:18:13.963333  7413 raft_consensus.cc:515] T 427c124d773f483294511e80fe340075 P cd75a17ab2604397adab03bb8b5fd75c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:13.974151  6923 ts_tablet_manager.cc:1434] T 4275cf08e63345f993bce8664eada830 P ccd8a4c3bfe3413cb2ae219b09aea832: Time spent starting tablet: real 0.082s	user 0.007s	sys 0.000s
I20260709 13:18:13.967235  7343 raft_consensus.cc:2749] T 3411566abe2d4c9bb4b2adfdd05e6f17 P cd75a17ab2604397adab03bb8b5fd75c [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:18:13.938205  7414 raft_consensus.cc:515] T f5be3a11b23d4ea9b08300a2789821c7 P cd75a17ab2604397adab03bb8b5fd75c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:13.982563  7414 leader_election.cc:290] T f5be3a11b23d4ea9b08300a2789821c7 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:18:13.985749  6807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5be3a11b23d4ea9b08300a2789821c7" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:18:13.987763  6729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5be3a11b23d4ea9b08300a2789821c7" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:18:13.988538  6729 raft_consensus.cc:2468] T f5be3a11b23d4ea9b08300a2789821c7 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 2.
I20260709 13:18:13.990466  6844 leader_election.cc:304] T f5be3a11b23d4ea9b08300a2789821c7 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377
I20260709 13:18:13.994165  7414 raft_consensus.cc:2804] T f5be3a11b23d4ea9b08300a2789821c7 P cd75a17ab2604397adab03bb8b5fd75c [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:18:13.994626  7414 raft_consensus.cc:493] T f5be3a11b23d4ea9b08300a2789821c7 P cd75a17ab2604397adab03bb8b5fd75c [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:13.994984  7414 raft_consensus.cc:3060] T f5be3a11b23d4ea9b08300a2789821c7 P cd75a17ab2604397adab03bb8b5fd75c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:13.977787  6923 tablet_bootstrap.cc:492] T 427c124d773f483294511e80fe340075 P ccd8a4c3bfe3413cb2ae219b09aea832: Bootstrap starting.
I20260709 13:18:14.019079  6922 tablet_bootstrap.cc:654] T ab432e62819d499eaaf3dd55481dd930 P cd75a17ab2604397adab03bb8b5fd75c: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:14.024451  7413 leader_election.cc:290] T 427c124d773f483294511e80fe340075 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:18:14.025707  6728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "427c124d773f483294511e80fe340075" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
W20260709 13:18:14.028112  6844 leader_election.cc:343] T 427c124d773f483294511e80fe340075 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:18:14.029930  6697 consensus_peers.cc:597] T 711ef6523deb4cbe8ef2ba61e1c21c98 P ccd8a4c3bfe3413cb2ae219b09aea832 -> Peer cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931): Couldn't send request to peer cd75a17ab2604397adab03bb8b5fd75c. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:14.031329  6807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "427c124d773f483294511e80fe340075" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:18:14.032073  6807 raft_consensus.cc:2468] T 427c124d773f483294511e80fe340075 P b7ab4784c7344b939bc36f639286f377 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 0.
I20260709 13:18:14.032584  6923 tablet_bootstrap.cc:654] T 427c124d773f483294511e80fe340075 P ccd8a4c3bfe3413cb2ae219b09aea832: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:14.033119  6844 leader_election.cc:304] T 427c124d773f483294511e80fe340075 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:18:14.034288  7413 raft_consensus.cc:2804] T 427c124d773f483294511e80fe340075 P cd75a17ab2604397adab03bb8b5fd75c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:18:14.034695  7413 raft_consensus.cc:493] T 427c124d773f483294511e80fe340075 P cd75a17ab2604397adab03bb8b5fd75c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:14.035076  7413 raft_consensus.cc:3060] T 427c124d773f483294511e80fe340075 P cd75a17ab2604397adab03bb8b5fd75c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:14.036531  7414 raft_consensus.cc:515] T f5be3a11b23d4ea9b08300a2789821c7 P cd75a17ab2604397adab03bb8b5fd75c [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:14.038698  7414 leader_election.cc:290] T f5be3a11b23d4ea9b08300a2789821c7 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 3 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:18:14.039624  6807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5be3a11b23d4ea9b08300a2789821c7" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:18:14.045089  6728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5be3a11b23d4ea9b08300a2789821c7" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:18:14.045894  6728 raft_consensus.cc:3060] T f5be3a11b23d4ea9b08300a2789821c7 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:14.054559  7238 consensus_queue.cc:1048] T 3411566abe2d4c9bb4b2adfdd05e6f17 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:18:14.064167  6728 raft_consensus.cc:2468] T f5be3a11b23d4ea9b08300a2789821c7 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 3.
I20260709 13:18:14.065132  6922 tablet_bootstrap.cc:492] T ab432e62819d499eaaf3dd55481dd930 P cd75a17ab2604397adab03bb8b5fd75c: No bootstrap required, opened a new log
I20260709 13:18:14.065598  6844 leader_election.cc:304] T f5be3a11b23d4ea9b08300a2789821c7 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377
I20260709 13:18:14.065809  6922 ts_tablet_manager.cc:1403] T ab432e62819d499eaaf3dd55481dd930 P cd75a17ab2604397adab03bb8b5fd75c: Time spent bootstrapping tablet: real 0.219s	user 0.011s	sys 0.004s
I20260709 13:18:14.066846  7420 raft_consensus.cc:493] T be1a92657f494cac8dd227d152f50151 P b7ab4784c7344b939bc36f639286f377 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:14.067337  7420 raft_consensus.cc:515] T be1a92657f494cac8dd227d152f50151 P b7ab4784c7344b939bc36f639286f377 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:14.071065  6729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be1a92657f494cac8dd227d152f50151" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:18:14.071035  6872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be1a92657f494cac8dd227d152f50151" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:18:14.071487  6922 raft_consensus.cc:359] T ab432e62819d499eaaf3dd55481dd930 P cd75a17ab2604397adab03bb8b5fd75c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:14.072587  6922 raft_consensus.cc:385] T ab432e62819d499eaaf3dd55481dd930 P cd75a17ab2604397adab03bb8b5fd75c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 13:18:14.072837  6772 leader_election.cc:343] T be1a92657f494cac8dd227d152f50151 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:14.072988  6922 raft_consensus.cc:740] T ab432e62819d499eaaf3dd55481dd930 P cd75a17ab2604397adab03bb8b5fd75c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cd75a17ab2604397adab03bb8b5fd75c, State: Initialized, Role: FOLLOWER
I20260709 13:18:14.072204  7414 raft_consensus.cc:2804] T f5be3a11b23d4ea9b08300a2789821c7 P cd75a17ab2604397adab03bb8b5fd75c [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:18:14.074049  7414 raft_consensus.cc:697] T f5be3a11b23d4ea9b08300a2789821c7 P cd75a17ab2604397adab03bb8b5fd75c [term 3 LEADER]: Becoming Leader. State: Replica: cd75a17ab2604397adab03bb8b5fd75c, State: Running, Role: LEADER
I20260709 13:18:14.074878  7414 consensus_queue.cc:237] T f5be3a11b23d4ea9b08300a2789821c7 P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:14.076762  7420 leader_election.cc:290] T be1a92657f494cac8dd227d152f50151 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
W20260709 13:18:14.080271  6770 leader_election.cc:343] T be1a92657f494cac8dd227d152f50151 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:14.082001  6770 leader_election.cc:304] T be1a92657f494cac8dd227d152f50151 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:18:14.083038  7290 raft_consensus.cc:2749] T be1a92657f494cac8dd227d152f50151 P b7ab4784c7344b939bc36f639286f377 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:18:14.078305  7413 raft_consensus.cc:515] T 427c124d773f483294511e80fe340075 P cd75a17ab2604397adab03bb8b5fd75c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:14.099982  7293 consensus_queue.cc:1048] T 3411566abe2d4c9bb4b2adfdd05e6f17 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:18:14.104506  6922 consensus_queue.cc:260] T ab432e62819d499eaaf3dd55481dd930 P cd75a17ab2604397adab03bb8b5fd75c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:14.108572  7293 raft_consensus.cc:493] T 4275cf08e63345f993bce8664eada830 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:14.109103  7293 raft_consensus.cc:515] T 4275cf08e63345f993bce8664eada830 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:14.111076  6728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "427c124d773f483294511e80fe340075" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:18:14.112597  6801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "427c124d773f483294511e80fe340075" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:18:14.112985  7413 leader_election.cc:290] T 427c124d773f483294511e80fe340075 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 1 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:18:14.113574  6801 raft_consensus.cc:3060] T 427c124d773f483294511e80fe340075 P b7ab4784c7344b939bc36f639286f377 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:14.113742  7351 raft_consensus.cc:493] T 22ccee1b570c4ad3a57bd7aec085b1b4 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:14.114301  7351 raft_consensus.cc:515] T 22ccee1b570c4ad3a57bd7aec085b1b4 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
W20260709 13:18:14.112766  6844 leader_election.cc:343] T 427c124d773f483294511e80fe340075 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:14.117273  7351 leader_election.cc:290] T 22ccee1b570c4ad3a57bd7aec085b1b4 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:18:14.118438  6879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22ccee1b570c4ad3a57bd7aec085b1b4" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:18:14.119102  6879 raft_consensus.cc:2468] T 22ccee1b570c4ad3a57bd7aec085b1b4 P cd75a17ab2604397adab03bb8b5fd75c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 0.
I20260709 13:18:14.120168  6697 leader_election.cc:304] T 22ccee1b570c4ad3a57bd7aec085b1b4 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:18:14.120997  7351 raft_consensus.cc:2804] T 22ccee1b570c4ad3a57bd7aec085b1b4 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:18:14.121560  7351 raft_consensus.cc:493] T 22ccee1b570c4ad3a57bd7aec085b1b4 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:14.121980  7351 raft_consensus.cc:3060] T 22ccee1b570c4ad3a57bd7aec085b1b4 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:14.122829  6801 raft_consensus.cc:2468] T 427c124d773f483294511e80fe340075 P b7ab4784c7344b939bc36f639286f377 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 1.
I20260709 13:18:14.123978  6844 leader_election.cc:304] T 427c124d773f483294511e80fe340075 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:18:14.124118  6881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4275cf08e63345f993bce8664eada830" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:18:14.125023  7414 raft_consensus.cc:2804] T 427c124d773f483294511e80fe340075 P cd75a17ab2604397adab03bb8b5fd75c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:18:14.125515  7414 raft_consensus.cc:697] T 427c124d773f483294511e80fe340075 P cd75a17ab2604397adab03bb8b5fd75c [term 1 LEADER]: Becoming Leader. State: Replica: cd75a17ab2604397adab03bb8b5fd75c, State: Running, Role: LEADER
I20260709 13:18:14.121039  7293 leader_election.cc:290] T 4275cf08e63345f993bce8664eada830 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:18:14.126309  7414 consensus_queue.cc:237] T 427c124d773f483294511e80fe340075 P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
W20260709 13:18:14.126758  6697 leader_election.cc:343] T 4275cf08e63345f993bce8664eada830 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:14.116628  6630 catalog_manager.cc:5697] T 7ba5dac66ab5497e9e336f2a3c28cda5 P cd75a17ab2604397adab03bb8b5fd75c reported cstate change: term changed from 0 to 1, leader changed from <none> to cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67). New cstate: current_term: 1 leader_uuid: "cd75a17ab2604397adab03bb8b5fd75c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:14.130801  6807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22ccee1b570c4ad3a57bd7aec085b1b4" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:18:14.131505  6807 raft_consensus.cc:2468] T 22ccee1b570c4ad3a57bd7aec085b1b4 P b7ab4784c7344b939bc36f639286f377 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 0.
I20260709 13:18:14.131608  6922 ts_tablet_manager.cc:1434] T ab432e62819d499eaaf3dd55481dd930 P cd75a17ab2604397adab03bb8b5fd75c: Time spent starting tablet: real 0.065s	user 0.007s	sys 0.000s
I20260709 13:18:14.132498  6799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4275cf08e63345f993bce8664eada830" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:18:14.133147  6799 raft_consensus.cc:2468] T 4275cf08e63345f993bce8664eada830 P b7ab4784c7344b939bc36f639286f377 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 0.
I20260709 13:18:14.135972  6923 tablet_bootstrap.cc:492] T 427c124d773f483294511e80fe340075 P ccd8a4c3bfe3413cb2ae219b09aea832: No bootstrap required, opened a new log
I20260709 13:18:14.138360  6923 ts_tablet_manager.cc:1403] T 427c124d773f483294511e80fe340075 P ccd8a4c3bfe3413cb2ae219b09aea832: Time spent bootstrapping tablet: real 0.161s	user 0.007s	sys 0.008s
I20260709 13:18:14.142488  6695 leader_election.cc:304] T 4275cf08e63345f993bce8664eada830 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:18:14.143294  7293 raft_consensus.cc:2804] T 4275cf08e63345f993bce8664eada830 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:18:14.143672  7293 raft_consensus.cc:493] T 4275cf08e63345f993bce8664eada830 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:14.144120  7293 raft_consensus.cc:3060] T 4275cf08e63345f993bce8664eada830 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:14.145177  6922 tablet_bootstrap.cc:492] T 17587d6730594da4a56fa13a353232a1 P cd75a17ab2604397adab03bb8b5fd75c: Bootstrap starting.
I20260709 13:18:14.143451  6923 raft_consensus.cc:359] T 427c124d773f483294511e80fe340075 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:14.145711  6923 raft_consensus.cc:385] T 427c124d773f483294511e80fe340075 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:14.145993  6923 raft_consensus.cc:740] T 427c124d773f483294511e80fe340075 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Initialized, Role: FOLLOWER
I20260709 13:18:14.146790  6923 consensus_queue.cc:260] T 427c124d773f483294511e80fe340075 P ccd8a4c3bfe3413cb2ae219b09aea832 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:14.150319  6923 ts_tablet_manager.cc:1434] T 427c124d773f483294511e80fe340075 P ccd8a4c3bfe3413cb2ae219b09aea832: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.000s
I20260709 13:18:14.151335  6923 tablet_bootstrap.cc:492] T be1a92657f494cac8dd227d152f50151 P ccd8a4c3bfe3413cb2ae219b09aea832: Bootstrap starting.
I20260709 13:18:14.164425  7351 raft_consensus.cc:515] T 22ccee1b570c4ad3a57bd7aec085b1b4 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:14.168502  6628 catalog_manager.cc:5697] T 427c124d773f483294511e80fe340075 P cd75a17ab2604397adab03bb8b5fd75c reported cstate change: term changed from 0 to 1, leader changed from <none> to cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67). New cstate: current_term: 1 leader_uuid: "cd75a17ab2604397adab03bb8b5fd75c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:14.170356  6628 catalog_manager.cc:5697] T f5be3a11b23d4ea9b08300a2789821c7 P cd75a17ab2604397adab03bb8b5fd75c reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "cd75a17ab2604397adab03bb8b5fd75c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:14.175092  6923 tablet_bootstrap.cc:654] T be1a92657f494cac8dd227d152f50151 P ccd8a4c3bfe3413cb2ae219b09aea832: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:14.178238  7351 leader_election.cc:290] T 22ccee1b570c4ad3a57bd7aec085b1b4 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 1 election: Requested vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:18:14.178761  6805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22ccee1b570c4ad3a57bd7aec085b1b4" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:18:14.179425  6805 raft_consensus.cc:3060] T 22ccee1b570c4ad3a57bd7aec085b1b4 P b7ab4784c7344b939bc36f639286f377 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:14.184587  6879 raft_consensus.cc:3060] T ab432e62819d499eaaf3dd55481dd930 P cd75a17ab2604397adab03bb8b5fd75c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:14.184619  6872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22ccee1b570c4ad3a57bd7aec085b1b4" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:18:14.185367  6872 raft_consensus.cc:3060] T 22ccee1b570c4ad3a57bd7aec085b1b4 P cd75a17ab2604397adab03bb8b5fd75c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:14.185953  6922 tablet_bootstrap.cc:654] T 17587d6730594da4a56fa13a353232a1 P cd75a17ab2604397adab03bb8b5fd75c: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:14.178026  7293 raft_consensus.cc:515] T 4275cf08e63345f993bce8664eada830 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:14.190698  6799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4275cf08e63345f993bce8664eada830" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:18:14.191305  6799 raft_consensus.cc:3060] T 4275cf08e63345f993bce8664eada830 P b7ab4784c7344b939bc36f639286f377 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:14.196372  7293 leader_election.cc:290] T 4275cf08e63345f993bce8664eada830 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 1 election: Requested vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:18:14.198146  6799 raft_consensus.cc:2468] T 4275cf08e63345f993bce8664eada830 P b7ab4784c7344b939bc36f639286f377 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 1.
I20260709 13:18:14.199668  6881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4275cf08e63345f993bce8664eada830" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:18:14.200642  6805 raft_consensus.cc:2468] T 22ccee1b570c4ad3a57bd7aec085b1b4 P b7ab4784c7344b939bc36f639286f377 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 1.
I20260709 13:18:14.204087  6872 raft_consensus.cc:2468] T 22ccee1b570c4ad3a57bd7aec085b1b4 P cd75a17ab2604397adab03bb8b5fd75c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 1.
I20260709 13:18:14.205860  6695 leader_election.cc:304] T 22ccee1b570c4ad3a57bd7aec085b1b4 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
I20260709 13:18:14.206807  7328 raft_consensus.cc:2804] T 22ccee1b570c4ad3a57bd7aec085b1b4 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:18:14.207329  7328 raft_consensus.cc:697] T 22ccee1b570c4ad3a57bd7aec085b1b4 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 1 LEADER]: Becoming Leader. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
I20260709 13:18:14.208292  7328 consensus_queue.cc:237] T 22ccee1b570c4ad3a57bd7aec085b1b4 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
W20260709 13:18:14.209462  6697 leader_election.cc:343] T 4275cf08e63345f993bce8664eada830 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:14.227824  6922 tablet_bootstrap.cc:492] T 17587d6730594da4a56fa13a353232a1 P cd75a17ab2604397adab03bb8b5fd75c: No bootstrap required, opened a new log
I20260709 13:18:14.228374  6922 ts_tablet_manager.cc:1403] T 17587d6730594da4a56fa13a353232a1 P cd75a17ab2604397adab03bb8b5fd75c: Time spent bootstrapping tablet: real 0.083s	user 0.016s	sys 0.002s
I20260709 13:18:14.233655  6695 leader_election.cc:304] T 4275cf08e63345f993bce8664eada830 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:18:14.235086  7328 raft_consensus.cc:2804] T 4275cf08e63345f993bce8664eada830 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:18:14.235582  7328 raft_consensus.cc:697] T 4275cf08e63345f993bce8664eada830 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 1 LEADER]: Becoming Leader. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
I20260709 13:18:14.236809  7328 consensus_queue.cc:237] T 4275cf08e63345f993bce8664eada830 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:14.234879  6922 raft_consensus.cc:359] T 17587d6730594da4a56fa13a353232a1 P cd75a17ab2604397adab03bb8b5fd75c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:14.240582  6922 raft_consensus.cc:385] T 17587d6730594da4a56fa13a353232a1 P cd75a17ab2604397adab03bb8b5fd75c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:14.240864  6922 raft_consensus.cc:740] T 17587d6730594da4a56fa13a353232a1 P cd75a17ab2604397adab03bb8b5fd75c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cd75a17ab2604397adab03bb8b5fd75c, State: Initialized, Role: FOLLOWER
I20260709 13:18:14.241817  6922 consensus_queue.cc:260] T 17587d6730594da4a56fa13a353232a1 P cd75a17ab2604397adab03bb8b5fd75c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:14.242657  6630 catalog_manager.cc:5697] T 22ccee1b570c4ad3a57bd7aec085b1b4 P ccd8a4c3bfe3413cb2ae219b09aea832 reported cstate change: term changed from 0 to 1, leader changed from <none> to ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65). New cstate: current_term: 1 leader_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:14.243330  6923 tablet_bootstrap.cc:492] T be1a92657f494cac8dd227d152f50151 P ccd8a4c3bfe3413cb2ae219b09aea832: No bootstrap required, opened a new log
I20260709 13:18:14.243891  6923 ts_tablet_manager.cc:1403] T be1a92657f494cac8dd227d152f50151 P ccd8a4c3bfe3413cb2ae219b09aea832: Time spent bootstrapping tablet: real 0.093s	user 0.016s	sys 0.001s
I20260709 13:18:14.244022  6922 ts_tablet_manager.cc:1434] T 17587d6730594da4a56fa13a353232a1 P cd75a17ab2604397adab03bb8b5fd75c: Time spent starting tablet: real 0.015s	user 0.005s	sys 0.000s
I20260709 13:18:14.245165  6922 tablet_bootstrap.cc:492] T 711ef6523deb4cbe8ef2ba61e1c21c98 P cd75a17ab2604397adab03bb8b5fd75c: Bootstrap starting.
I20260709 13:18:14.246817  6923 raft_consensus.cc:359] T be1a92657f494cac8dd227d152f50151 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:14.247503  6923 raft_consensus.cc:385] T be1a92657f494cac8dd227d152f50151 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:14.247787  6923 raft_consensus.cc:740] T be1a92657f494cac8dd227d152f50151 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Initialized, Role: FOLLOWER
I20260709 13:18:14.248452  6923 consensus_queue.cc:260] T be1a92657f494cac8dd227d152f50151 P ccd8a4c3bfe3413cb2ae219b09aea832 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:14.250978  6923 ts_tablet_manager.cc:1434] T be1a92657f494cac8dd227d152f50151 P ccd8a4c3bfe3413cb2ae219b09aea832: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:18:14.253902  6922 tablet_bootstrap.cc:654] T 711ef6523deb4cbe8ef2ba61e1c21c98 P cd75a17ab2604397adab03bb8b5fd75c: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:14.259908  6922 tablet_bootstrap.cc:492] T 711ef6523deb4cbe8ef2ba61e1c21c98 P cd75a17ab2604397adab03bb8b5fd75c: No bootstrap required, opened a new log
I20260709 13:18:14.260447  6922 ts_tablet_manager.cc:1403] T 711ef6523deb4cbe8ef2ba61e1c21c98 P cd75a17ab2604397adab03bb8b5fd75c: Time spent bootstrapping tablet: real 0.015s	user 0.013s	sys 0.000s
I20260709 13:18:14.263083  6922 raft_consensus.cc:359] T 711ef6523deb4cbe8ef2ba61e1c21c98 P cd75a17ab2604397adab03bb8b5fd75c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:14.263758  6922 raft_consensus.cc:385] T 711ef6523deb4cbe8ef2ba61e1c21c98 P cd75a17ab2604397adab03bb8b5fd75c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:14.264003  6922 raft_consensus.cc:740] T 711ef6523deb4cbe8ef2ba61e1c21c98 P cd75a17ab2604397adab03bb8b5fd75c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cd75a17ab2604397adab03bb8b5fd75c, State: Initialized, Role: FOLLOWER
I20260709 13:18:14.263962  6630 catalog_manager.cc:5697] T 4275cf08e63345f993bce8664eada830 P ccd8a4c3bfe3413cb2ae219b09aea832 reported cstate change: term changed from 0 to 1, leader changed from <none> to ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65). New cstate: current_term: 1 leader_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:14.264906  6922 consensus_queue.cc:260] T 711ef6523deb4cbe8ef2ba61e1c21c98 P cd75a17ab2604397adab03bb8b5fd75c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:14.267225  6922 ts_tablet_manager.cc:1434] T 711ef6523deb4cbe8ef2ba61e1c21c98 P cd75a17ab2604397adab03bb8b5fd75c: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:18:14.268848  6922 tablet_bootstrap.cc:492] T 4275cf08e63345f993bce8664eada830 P cd75a17ab2604397adab03bb8b5fd75c: Bootstrap starting.
I20260709 13:18:14.274686  6922 tablet_bootstrap.cc:654] T 4275cf08e63345f993bce8664eada830 P cd75a17ab2604397adab03bb8b5fd75c: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:14.279356  6922 tablet_bootstrap.cc:492] T 4275cf08e63345f993bce8664eada830 P cd75a17ab2604397adab03bb8b5fd75c: No bootstrap required, opened a new log
I20260709 13:18:14.279793  6922 ts_tablet_manager.cc:1403] T 4275cf08e63345f993bce8664eada830 P cd75a17ab2604397adab03bb8b5fd75c: Time spent bootstrapping tablet: real 0.011s	user 0.009s	sys 0.000s
I20260709 13:18:14.281973  6922 raft_consensus.cc:359] T 4275cf08e63345f993bce8664eada830 P cd75a17ab2604397adab03bb8b5fd75c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:14.282667  6922 raft_consensus.cc:385] T 4275cf08e63345f993bce8664eada830 P cd75a17ab2604397adab03bb8b5fd75c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:14.282934  6922 raft_consensus.cc:740] T 4275cf08e63345f993bce8664eada830 P cd75a17ab2604397adab03bb8b5fd75c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cd75a17ab2604397adab03bb8b5fd75c, State: Initialized, Role: FOLLOWER
I20260709 13:18:14.283604  6922 consensus_queue.cc:260] T 4275cf08e63345f993bce8664eada830 P cd75a17ab2604397adab03bb8b5fd75c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:14.285652  6922 ts_tablet_manager.cc:1434] T 4275cf08e63345f993bce8664eada830 P cd75a17ab2604397adab03bb8b5fd75c: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 13:18:14.286717  6922 tablet_bootstrap.cc:492] T be1a92657f494cac8dd227d152f50151 P cd75a17ab2604397adab03bb8b5fd75c: Bootstrap starting.
I20260709 13:18:14.293202  6922 tablet_bootstrap.cc:654] T be1a92657f494cac8dd227d152f50151 P cd75a17ab2604397adab03bb8b5fd75c: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:14.298496  6922 tablet_bootstrap.cc:492] T be1a92657f494cac8dd227d152f50151 P cd75a17ab2604397adab03bb8b5fd75c: No bootstrap required, opened a new log
I20260709 13:18:14.299023  6922 ts_tablet_manager.cc:1403] T be1a92657f494cac8dd227d152f50151 P cd75a17ab2604397adab03bb8b5fd75c: Time spent bootstrapping tablet: real 0.013s	user 0.007s	sys 0.003s
I20260709 13:18:14.301779  6922 raft_consensus.cc:359] T be1a92657f494cac8dd227d152f50151 P cd75a17ab2604397adab03bb8b5fd75c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:14.302346  6922 raft_consensus.cc:385] T be1a92657f494cac8dd227d152f50151 P cd75a17ab2604397adab03bb8b5fd75c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:14.302562  6922 raft_consensus.cc:740] T be1a92657f494cac8dd227d152f50151 P cd75a17ab2604397adab03bb8b5fd75c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cd75a17ab2604397adab03bb8b5fd75c, State: Initialized, Role: FOLLOWER
I20260709 13:18:14.303161  6922 consensus_queue.cc:260] T be1a92657f494cac8dd227d152f50151 P cd75a17ab2604397adab03bb8b5fd75c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:14.305035  6922 ts_tablet_manager.cc:1434] T be1a92657f494cac8dd227d152f50151 P cd75a17ab2604397adab03bb8b5fd75c: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 13:18:14.324724  7414 raft_consensus.cc:493] T 17587d6730594da4a56fa13a353232a1 P cd75a17ab2604397adab03bb8b5fd75c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:14.325337  7414 raft_consensus.cc:515] T 17587d6730594da4a56fa13a353232a1 P cd75a17ab2604397adab03bb8b5fd75c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:14.327907  7414 leader_election.cc:290] T 17587d6730594da4a56fa13a353232a1 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:18:14.328501  6728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17587d6730594da4a56fa13a353232a1" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:18:14.329365  6728 raft_consensus.cc:2393] T 17587d6730594da4a56fa13a353232a1 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c in current term 1: Already voted for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in this term.
I20260709 13:18:14.330826  6799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17587d6730594da4a56fa13a353232a1" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:18:14.331624  6799 raft_consensus.cc:2393] T 17587d6730594da4a56fa13a353232a1 P b7ab4784c7344b939bc36f639286f377 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c in current term 1: Already voted for candidate b7ab4784c7344b939bc36f639286f377 in this term.
I20260709 13:18:14.333068  6844 leader_election.cc:304] T 17587d6730594da4a56fa13a353232a1 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:18:14.334184  7414 raft_consensus.cc:3060] T 17587d6730594da4a56fa13a353232a1 P cd75a17ab2604397adab03bb8b5fd75c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:14.344374  7414 raft_consensus.cc:2749] T 17587d6730594da4a56fa13a353232a1 P cd75a17ab2604397adab03bb8b5fd75c [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:18:14.344784  6872 raft_consensus.cc:3060] T 711ef6523deb4cbe8ef2ba61e1c21c98 P cd75a17ab2604397adab03bb8b5fd75c [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:18:14.363812  6678 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:18:14.370365  7420 raft_consensus.cc:493] T f5be3a11b23d4ea9b08300a2789821c7 P b7ab4784c7344b939bc36f639286f377 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader cd75a17ab2604397adab03bb8b5fd75c)
I20260709 13:18:14.371098  7420 raft_consensus.cc:515] T f5be3a11b23d4ea9b08300a2789821c7 P b7ab4784c7344b939bc36f639286f377 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:14.373575  7420 leader_election.cc:290] T f5be3a11b23d4ea9b08300a2789821c7 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:18:14.374743  6879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5be3a11b23d4ea9b08300a2789821c7" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:18:14.375765  6728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5be3a11b23d4ea9b08300a2789821c7" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:18:14.376700  6728 raft_consensus.cc:2368] T f5be3a11b23d4ea9b08300a2789821c7 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7ab4784c7344b939bc36f639286f377 for earlier term 2. Current term is 3.
I20260709 13:18:14.378189  6770 leader_election.cc:400] T f5be3a11b23d4ea9b08300a2789821c7 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 2 pre-election: Vote denied by peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391) with higher term. Message: Invalid argument: T f5be3a11b23d4ea9b08300a2789821c7 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7ab4784c7344b939bc36f639286f377 for earlier term 2. Current term is 3.
I20260709 13:18:14.378513  6770 leader_election.cc:403] T f5be3a11b23d4ea9b08300a2789821c7 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:18:14.379103  7290 raft_consensus.cc:3060] T f5be3a11b23d4ea9b08300a2789821c7 P b7ab4784c7344b939bc36f639286f377 [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:18:14.388620  7290 raft_consensus.cc:2749] T f5be3a11b23d4ea9b08300a2789821c7 P b7ab4784c7344b939bc36f639286f377 [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391) with higher term. Message: Invalid argument: T f5be3a11b23d4ea9b08300a2789821c7 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7ab4784c7344b939bc36f639286f377 for earlier term 2. Current term is 3.
I20260709 13:18:14.488875  7414 consensus_queue.cc:1048] T 7ba5dac66ab5497e9e336f2a3c28cda5 P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Connected to new peer: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:18:14.503515  7298 consensus_queue.cc:1048] T 7ba5dac66ab5497e9e336f2a3c28cda5 P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:18:14.551987  7328 raft_consensus.cc:493] T be1a92657f494cac8dd227d152f50151 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:14.552515  7328 raft_consensus.cc:515] T be1a92657f494cac8dd227d152f50151 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:14.554522  7328 leader_election.cc:290] T be1a92657f494cac8dd227d152f50151 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:18:14.555404  6799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be1a92657f494cac8dd227d152f50151" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:18:14.556205  6799 raft_consensus.cc:2468] T be1a92657f494cac8dd227d152f50151 P b7ab4784c7344b939bc36f639286f377 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 0.
I20260709 13:18:14.556975  7298 consensus_queue.cc:1048] T 427c124d773f483294511e80fe340075 P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:18:14.555475  6879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be1a92657f494cac8dd227d152f50151" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:18:14.557914  6879 raft_consensus.cc:2468] T be1a92657f494cac8dd227d152f50151 P cd75a17ab2604397adab03bb8b5fd75c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 0.
I20260709 13:18:14.559336  7290 raft_consensus.cc:493] T 17587d6730594da4a56fa13a353232a1 P b7ab4784c7344b939bc36f639286f377 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:14.559809  6695 leader_election.cc:304] T be1a92657f494cac8dd227d152f50151 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
I20260709 13:18:14.559873  7290 raft_consensus.cc:515] T 17587d6730594da4a56fa13a353232a1 P b7ab4784c7344b939bc36f639286f377 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:14.560806  7328 raft_consensus.cc:2804] T be1a92657f494cac8dd227d152f50151 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:18:14.561228  7328 raft_consensus.cc:493] T be1a92657f494cac8dd227d152f50151 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:14.561599  7328 raft_consensus.cc:3060] T be1a92657f494cac8dd227d152f50151 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:14.562986  6729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17587d6730594da4a56fa13a353232a1" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:18:14.563778  6729 raft_consensus.cc:2468] T 17587d6730594da4a56fa13a353232a1 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 1.
I20260709 13:18:14.565207  7290 leader_election.cc:290] T 17587d6730594da4a56fa13a353232a1 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:18:14.565373  6770 leader_election.cc:304] T 17587d6730594da4a56fa13a353232a1 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
I20260709 13:18:14.566514  7290 raft_consensus.cc:2804] T 17587d6730594da4a56fa13a353232a1 P b7ab4784c7344b939bc36f639286f377 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:18:14.567121  7290 raft_consensus.cc:493] T 17587d6730594da4a56fa13a353232a1 P b7ab4784c7344b939bc36f639286f377 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:14.567782  7290 raft_consensus.cc:3060] T 17587d6730594da4a56fa13a353232a1 P b7ab4784c7344b939bc36f639286f377 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:14.568394  6879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17587d6730594da4a56fa13a353232a1" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:18:14.569128  6879 raft_consensus.cc:2468] T 17587d6730594da4a56fa13a353232a1 P cd75a17ab2604397adab03bb8b5fd75c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 1.
I20260709 13:18:14.572180  7328 raft_consensus.cc:515] T be1a92657f494cac8dd227d152f50151 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:14.574795  7328 leader_election.cc:290] T be1a92657f494cac8dd227d152f50151 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 1 election: Requested vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:18:14.575337  6805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be1a92657f494cac8dd227d152f50151" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:18:14.575719  6879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be1a92657f494cac8dd227d152f50151" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:18:14.575990  6805 raft_consensus.cc:3060] T be1a92657f494cac8dd227d152f50151 P b7ab4784c7344b939bc36f639286f377 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:14.576227  6879 raft_consensus.cc:3060] T be1a92657f494cac8dd227d152f50151 P cd75a17ab2604397adab03bb8b5fd75c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:14.578760  7290 raft_consensus.cc:515] T 17587d6730594da4a56fa13a353232a1 P b7ab4784c7344b939bc36f639286f377 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:14.581223  7290 leader_election.cc:290] T 17587d6730594da4a56fa13a353232a1 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 2 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:18:14.581781  6872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17587d6730594da4a56fa13a353232a1" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:18:14.582252  6729 raft_consensus.cc:3060] T 427c124d773f483294511e80fe340075 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:14.582402  6872 raft_consensus.cc:3060] T 17587d6730594da4a56fa13a353232a1 P cd75a17ab2604397adab03bb8b5fd75c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:14.583786  6805 raft_consensus.cc:2468] T be1a92657f494cac8dd227d152f50151 P b7ab4784c7344b939bc36f639286f377 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 1.
I20260709 13:18:14.585556  6695 leader_election.cc:304] T be1a92657f494cac8dd227d152f50151 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
I20260709 13:18:14.586382  6723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17587d6730594da4a56fa13a353232a1" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:18:14.587036  6723 raft_consensus.cc:3060] T 17587d6730594da4a56fa13a353232a1 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:14.588778  6728 raft_consensus.cc:1275] T f5be3a11b23d4ea9b08300a2789821c7 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 3 FOLLOWER]: Refusing update from remote peer cd75a17ab2604397adab03bb8b5fd75c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:18:14.589630  7328 raft_consensus.cc:2804] T be1a92657f494cac8dd227d152f50151 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:18:14.590721  7298 consensus_queue.cc:1048] T f5be3a11b23d4ea9b08300a2789821c7 P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Connected to new peer: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:18:14.594909  6723 raft_consensus.cc:2468] T 17587d6730594da4a56fa13a353232a1 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 2.
I20260709 13:18:14.590994  7328 raft_consensus.cc:697] T be1a92657f494cac8dd227d152f50151 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 1 LEADER]: Becoming Leader. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
I20260709 13:18:14.596113  6770 leader_election.cc:304] T 17587d6730594da4a56fa13a353232a1 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
I20260709 13:18:14.596335  7328 consensus_queue.cc:237] T be1a92657f494cac8dd227d152f50151 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:14.599159  7420 raft_consensus.cc:2804] T 17587d6730594da4a56fa13a353232a1 P b7ab4784c7344b939bc36f639286f377 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:18:14.608382  6807 raft_consensus.cc:1275] T f5be3a11b23d4ea9b08300a2789821c7 P b7ab4784c7344b939bc36f639286f377 [term 3 FOLLOWER]: Refusing update from remote peer cd75a17ab2604397adab03bb8b5fd75c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:18:14.608552  6872 raft_consensus.cc:2468] T 17587d6730594da4a56fa13a353232a1 P cd75a17ab2604397adab03bb8b5fd75c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 2.
I20260709 13:18:14.609304  7354 raft_consensus.cc:493] T 427c124d773f483294511e80fe340075 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:14.609829  7354 raft_consensus.cc:515] T 427c124d773f483294511e80fe340075 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:14.610479  6879 raft_consensus.cc:2468] T be1a92657f494cac8dd227d152f50151 P cd75a17ab2604397adab03bb8b5fd75c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 1.
I20260709 13:18:14.612066  7354 leader_election.cc:290] T 427c124d773f483294511e80fe340075 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:18:14.612986  6807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "427c124d773f483294511e80fe340075" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:18:14.613448  6881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "427c124d773f483294511e80fe340075" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:18:14.610422  7298 consensus_queue.cc:1048] T f5be3a11b23d4ea9b08300a2789821c7 P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:18:14.618779  6697 leader_election.cc:304] T 427c124d773f483294511e80fe340075 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:18:14.619715  7420 raft_consensus.cc:697] T 17587d6730594da4a56fa13a353232a1 P b7ab4784c7344b939bc36f639286f377 [term 2 LEADER]: Becoming Leader. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
I20260709 13:18:14.621959  7298 consensus_queue.cc:1048] T 427c124d773f483294511e80fe340075 P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Connected to new peer: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:18:14.622339  7420 consensus_queue.cc:237] T 17587d6730594da4a56fa13a353232a1 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:14.626382  7293 raft_consensus.cc:2749] T 427c124d773f483294511e80fe340075 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:14.633950  6629 catalog_manager.cc:5697] T be1a92657f494cac8dd227d152f50151 P ccd8a4c3bfe3413cb2ae219b09aea832 reported cstate change: term changed from 0 to 1, leader changed from <none> to ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65). New cstate: current_term: 1 leader_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:14.658303  6628 catalog_manager.cc:5697] T 17587d6730594da4a56fa13a353232a1 P b7ab4784c7344b939bc36f639286f377 reported cstate change: term changed from 0 to 2, leader changed from <none> to b7ab4784c7344b939bc36f639286f377 (127.5.126.66). New cstate: current_term: 2 leader_uuid: "b7ab4784c7344b939bc36f639286f377" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:14.695663  7293 consensus_queue.cc:1048] T 22ccee1b570c4ad3a57bd7aec085b1b4 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:18:14.715631  7342 consensus_queue.cc:1048] T 22ccee1b570c4ad3a57bd7aec085b1b4 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:18:14.725879  7298 raft_consensus.cc:493] T 4275cf08e63345f993bce8664eada830 P cd75a17ab2604397adab03bb8b5fd75c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:14.726408  7298 raft_consensus.cc:515] T 4275cf08e63345f993bce8664eada830 P cd75a17ab2604397adab03bb8b5fd75c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:14.728281  7298 leader_election.cc:290] T 4275cf08e63345f993bce8664eada830 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:18:14.729220  6805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4275cf08e63345f993bce8664eada830" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:18:14.729890  6805 raft_consensus.cc:2393] T 4275cf08e63345f993bce8664eada830 P b7ab4784c7344b939bc36f639286f377 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c in current term 1: Already voted for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in this term.
I20260709 13:18:14.729838  6729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4275cf08e63345f993bce8664eada830" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:18:14.731820  6844 leader_election.cc:304] T 4275cf08e63345f993bce8664eada830 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:18:14.732575  7298 raft_consensus.cc:3060] T 4275cf08e63345f993bce8664eada830 P cd75a17ab2604397adab03bb8b5fd75c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:14.739147  7298 raft_consensus.cc:2749] T 4275cf08e63345f993bce8664eada830 P cd75a17ab2604397adab03bb8b5fd75c [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:18:14.788486  7342 consensus_queue.cc:1048] T 4275cf08e63345f993bce8664eada830 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:18:14.802589  7328 consensus_queue.cc:1048] T 4275cf08e63345f993bce8664eada830 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:18:15.050683  7293 consensus_queue.cc:1048] T be1a92657f494cac8dd227d152f50151 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:18:15.074939  7351 consensus_queue.cc:1048] T be1a92657f494cac8dd227d152f50151 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:18:15.174383  6881 raft_consensus.cc:1275] T 17587d6730594da4a56fa13a353232a1 P cd75a17ab2604397adab03bb8b5fd75c [term 2 FOLLOWER]: Refusing update from remote peer b7ab4784c7344b939bc36f639286f377: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 13:18:15.175580  7439 consensus_queue.cc:1048] T 17587d6730594da4a56fa13a353232a1 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:18:15.186484  6723 raft_consensus.cc:1275] T 17587d6730594da4a56fa13a353232a1 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 2 FOLLOWER]: Refusing update from remote peer b7ab4784c7344b939bc36f639286f377: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 13:18:15.188143  7290 consensus_queue.cc:1048] T 17587d6730594da4a56fa13a353232a1 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:18:16.394232  5625 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:18:16.427296  7456 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:18:16.427297  7455 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:18:16.428011  7458 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:18:16.429365  5625 server_base.cc:1061] running on GCE node
I20260709 13:18:16.430897  5625 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:18:16.431238  5625 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:18:16.431490  5625 hybrid_clock.cc:648] HybridClock initialized: now 1783603096431470 us; error 0 us; skew 500 ppm
I20260709 13:18:16.432305  5625 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:18:16.439769  5625 webserver.cc:533] Webserver started at http://127.5.126.68:45815/ using document root <none> and password file <none>
I20260709 13:18:16.440424  5625 fs_manager.cc:362] Metadata directory not provided
I20260709 13:18:16.440722  5625 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:18:16.441182  5625 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:18:16.442998  5625 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskWHb0CB/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783603057096655-5625-0/minicluster-data/ts-3-root/instance:
uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb"
format_stamp: "Formatted at 2026-07-09 13:18:16 on dist-test-slave-smzk"
I20260709 13:18:16.451299  5625 fs_manager.cc:696] Time spent creating directory manager: real 0.007s	user 0.009s	sys 0.000s
I20260709 13:18:16.470774  7465 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:18:16.472234  5625 fs_manager.cc:730] Time spent opening block manager: real 0.018s	user 0.002s	sys 0.003s
I20260709 13:18:16.473042  5625 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskWHb0CB/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783603057096655-5625-0/minicluster-data/ts-3-root
uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb"
format_stamp: "Formatted at 2026-07-09 13:18:16 on dist-test-slave-smzk"
I20260709 13:18:16.473570  5625 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWHb0CB/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783603057096655-5625-0/minicluster-data/ts-3-root
metadata directory: /tmp/dist-test-taskWHb0CB/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783603057096655-5625-0/minicluster-data/ts-3-root
1 data directories: /tmp/dist-test-taskWHb0CB/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783603057096655-5625-0/minicluster-data/ts-3-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:18:16.527560  5625 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:18:16.529311  5625 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:18:16.531613  5625 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:18:16.534965  5625 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:18:16.535187  5625 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:18:16.535553  5625 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:18:16.535748  5625 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:18:16.641422  5625 rpc_server.cc:307] RPC server started. Bound to: 127.5.126.68:45071
I20260709 13:18:16.641645  7527 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.5.126.68:45071 every 8 connection(s)
I20260709 13:18:16.646535  5625 auto_leader_rebalancer-test.cc:384] add a tserver: 7ba59cc884714e8aa5f3f0ecaed84cbb
I20260709 13:18:16.669332  7528 heartbeater.cc:344] Connected to a master server at 127.5.126.126:34367
I20260709 13:18:16.669950  7528 heartbeater.cc:461] Registering TS with master...
I20260709 13:18:16.670892  7528 heartbeater.cc:507] Master 127.5.126.126:34367 requested a full tablet report, sending...
I20260709 13:18:16.673578  6630 ts_manager.cc:194] Registered new tserver with Master: 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:18:16.675163  6630 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:51654
I20260709 13:18:17.599288  6728 consensus_queue.cc:237] T bb3d8792045a4583ae2e965b1350a5b4 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } attrs { replace: true } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: NON_VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: true } }
I20260709 13:18:17.609066  6881 raft_consensus.cc:1275] T bb3d8792045a4583ae2e965b1350a5b4 P cd75a17ab2604397adab03bb8b5fd75c [term 1 FOLLOWER]: Refusing update from remote peer ccd8a4c3bfe3413cb2ae219b09aea832: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:18:17.611073  7342 consensus_queue.cc:1048] T bb3d8792045a4583ae2e965b1350a5b4 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:18:17.613360  6799 raft_consensus.cc:1275] T bb3d8792045a4583ae2e965b1350a5b4 P b7ab4784c7344b939bc36f639286f377 [term 1 FOLLOWER]: Refusing update from remote peer ccd8a4c3bfe3413cb2ae219b09aea832: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:18:17.614936  7342 consensus_queue.cc:1048] T bb3d8792045a4583ae2e965b1350a5b4 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:18:17.640334  6697 consensus_peers.cc:597] T bb3d8792045a4583ae2e965b1350a5b4 P ccd8a4c3bfe3413cb2ae219b09aea832 -> Peer 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071): Couldn't send request to peer 7ba59cc884714e8aa5f3f0ecaed84cbb. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: bb3d8792045a4583ae2e965b1350a5b4. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:17.651041  7351 raft_consensus.cc:2955] T bb3d8792045a4583ae2e965b1350a5b4 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } attrs { replace: true } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: NON_VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: true } } }
I20260709 13:18:17.652554  6876 raft_consensus.cc:2955] T bb3d8792045a4583ae2e965b1350a5b4 P cd75a17ab2604397adab03bb8b5fd75c [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } attrs { replace: true } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: NON_VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: true } } }
I20260709 13:18:17.664463  6799 raft_consensus.cc:2955] T bb3d8792045a4583ae2e965b1350a5b4 P b7ab4784c7344b939bc36f639286f377 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } attrs { replace: true } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: NON_VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: true } } }
I20260709 13:18:17.668196  6728 consensus_queue.cc:237] T 404190ce4ce94cecbfcb6ea9d1dd8626 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } attrs { replace: true } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: NON_VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: true } }
I20260709 13:18:17.673563  6630 catalog_manager.cc:5697] T bb3d8792045a4583ae2e965b1350a5b4 P ccd8a4c3bfe3413cb2ae219b09aea832 reported cstate change: config changed from index -1 to 2, NON_VOTER 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68) added. New cstate: current_term: 1 leader_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: NON_VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:17.678299  7528 heartbeater.cc:499] Master 127.5.126.126:34367 was elected leader, sending a full tablet report...
W20260709 13:18:17.694919  6697 consensus_peers.cc:597] T 404190ce4ce94cecbfcb6ea9d1dd8626 P ccd8a4c3bfe3413cb2ae219b09aea832 -> Peer 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071): Couldn't send request to peer 7ba59cc884714e8aa5f3f0ecaed84cbb. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 404190ce4ce94cecbfcb6ea9d1dd8626. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:17.695422  6805 raft_consensus.cc:1275] T 404190ce4ce94cecbfcb6ea9d1dd8626 P b7ab4784c7344b939bc36f639286f377 [term 1 FOLLOWER]: Refusing update from remote peer ccd8a4c3bfe3413cb2ae219b09aea832: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:18:17.711513  7293 consensus_queue.cc:1048] T 404190ce4ce94cecbfcb6ea9d1dd8626 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:18:17.679431  6876 raft_consensus.cc:1275] T 404190ce4ce94cecbfcb6ea9d1dd8626 P cd75a17ab2604397adab03bb8b5fd75c [term 1 FOLLOWER]: Refusing update from remote peer ccd8a4c3bfe3413cb2ae219b09aea832: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:18:17.847671  6807 raft_consensus.cc:2955] T 404190ce4ce94cecbfcb6ea9d1dd8626 P b7ab4784c7344b939bc36f639286f377 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } attrs { replace: true } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: NON_VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: true } } }
W20260709 13:18:17.869540  6772 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 74222.1us
I20260709 13:18:17.866389  7351 raft_consensus.cc:2955] T 404190ce4ce94cecbfcb6ea9d1dd8626 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } attrs { replace: true } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: NON_VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: true } } }
I20260709 13:18:17.876355  7293 consensus_queue.cc:1048] T 404190ce4ce94cecbfcb6ea9d1dd8626 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:18:17.996662  6629 catalog_manager.cc:5697] T 404190ce4ce94cecbfcb6ea9d1dd8626 P ccd8a4c3bfe3413cb2ae219b09aea832 reported cstate change: config changed from index -1 to 2, NON_VOTER 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68) added. New cstate: current_term: 1 leader_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: NON_VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
W20260709 13:18:18.046684  6770 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 99871.2us
I20260709 13:18:18.048813  6874 raft_consensus.cc:2955] T 404190ce4ce94cecbfcb6ea9d1dd8626 P cd75a17ab2604397adab03bb8b5fd75c [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } attrs { replace: true } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: NON_VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: true } } }
I20260709 13:18:18.074331  6805 consensus_queue.cc:237] T d8cee0accdb8499c86d4414b72565a38 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } attrs { replace: true } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: NON_VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: true } }
I20260709 13:18:18.108688  6723 raft_consensus.cc:1275] T d8cee0accdb8499c86d4414b72565a38 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 1 FOLLOWER]: Refusing update from remote peer b7ab4784c7344b939bc36f639286f377: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:18:18.112625  7548 consensus_queue.cc:1048] T d8cee0accdb8499c86d4414b72565a38 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:18:18.132313  6872 raft_consensus.cc:1275] T d8cee0accdb8499c86d4414b72565a38 P cd75a17ab2604397adab03bb8b5fd75c [term 1 FOLLOWER]: Refusing update from remote peer b7ab4784c7344b939bc36f639286f377: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:18:18.150511  7439 consensus_queue.cc:1048] T d8cee0accdb8499c86d4414b72565a38 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:18:18.187901  7559 ts_tablet_manager.cc:933] T 404190ce4ce94cecbfcb6ea9d1dd8626 P 7ba59cc884714e8aa5f3f0ecaed84cbb: Initiating tablet copy from peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391)
I20260709 13:18:18.201694  6723 raft_consensus.cc:2955] T d8cee0accdb8499c86d4414b72565a38 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } attrs { replace: true } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: NON_VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: true } } }
I20260709 13:18:18.195899  7549 raft_consensus.cc:2955] T d8cee0accdb8499c86d4414b72565a38 P b7ab4784c7344b939bc36f639286f377 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } attrs { replace: true } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: NON_VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: true } } }
I20260709 13:18:18.242115  6630 catalog_manager.cc:5697] T d8cee0accdb8499c86d4414b72565a38 P b7ab4784c7344b939bc36f639286f377 reported cstate change: config changed from index -1 to 2, NON_VOTER 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68) added. New cstate: current_term: 1 leader_uuid: "b7ab4784c7344b939bc36f639286f377" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: NON_VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
W20260709 13:18:18.243567  6772 consensus_peers.cc:597] T d8cee0accdb8499c86d4414b72565a38 P b7ab4784c7344b939bc36f639286f377 -> Peer 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071): Couldn't send request to peer 7ba59cc884714e8aa5f3f0ecaed84cbb. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: d8cee0accdb8499c86d4414b72565a38. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:18.268392  7559 tablet_copy_client.cc:323] T 404190ce4ce94cecbfcb6ea9d1dd8626 P 7ba59cc884714e8aa5f3f0ecaed84cbb: tablet copy: Beginning tablet copy session from remote peer at address 127.5.126.65:44391
I20260709 13:18:18.318818  7565 ts_tablet_manager.cc:933] T bb3d8792045a4583ae2e965b1350a5b4 P 7ba59cc884714e8aa5f3f0ecaed84cbb: Initiating tablet copy from peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391)
I20260709 13:18:18.349066  6874 raft_consensus.cc:2955] T d8cee0accdb8499c86d4414b72565a38 P cd75a17ab2604397adab03bb8b5fd75c [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } attrs { replace: true } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: NON_VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: true } } }
I20260709 13:18:18.392099  7565 tablet_copy_client.cc:323] T bb3d8792045a4583ae2e965b1350a5b4 P 7ba59cc884714e8aa5f3f0ecaed84cbb: tablet copy: Beginning tablet copy session from remote peer at address 127.5.126.65:44391
I20260709 13:18:18.448962  6872 consensus_queue.cc:237] T 7ba5dac66ab5497e9e336f2a3c28cda5 P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } attrs { replace: true } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: NON_VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: true } }
I20260709 13:18:18.480796  6799 raft_consensus.cc:1275] T 7ba5dac66ab5497e9e336f2a3c28cda5 P b7ab4784c7344b939bc36f639286f377 [term 1 FOLLOWER]: Refusing update from remote peer cd75a17ab2604397adab03bb8b5fd75c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:18:18.484197  7417 consensus_queue.cc:1048] T 7ba5dac66ab5497e9e336f2a3c28cda5 P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:18:18.486310  6728 raft_consensus.cc:1275] T 7ba5dac66ab5497e9e336f2a3c28cda5 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 1 FOLLOWER]: Refusing update from remote peer cd75a17ab2604397adab03bb8b5fd75c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:18:18.492916  7417 consensus_queue.cc:1048] T 7ba5dac66ab5497e9e336f2a3c28cda5 P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Connected to new peer: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 13:18:18.572715  6846 consensus_peers.cc:597] T 7ba5dac66ab5497e9e336f2a3c28cda5 P cd75a17ab2604397adab03bb8b5fd75c -> Peer 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071): Couldn't send request to peer 7ba59cc884714e8aa5f3f0ecaed84cbb. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 7ba5dac66ab5497e9e336f2a3c28cda5. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:18.731782  6742 tablet_copy_service.cc:140] P ccd8a4c3bfe3413cb2ae219b09aea832: Received BeginTabletCopySession request for tablet 404190ce4ce94cecbfcb6ea9d1dd8626 from peer 7ba59cc884714e8aa5f3f0ecaed84cbb ({username='slave'} at 127.0.0.1:49744)
I20260709 13:18:18.732508  6742 tablet_copy_service.cc:161] P ccd8a4c3bfe3413cb2ae219b09aea832: Beginning new tablet copy session on tablet 404190ce4ce94cecbfcb6ea9d1dd8626 from peer 7ba59cc884714e8aa5f3f0ecaed84cbb at {username='slave'} at 127.0.0.1:49744: session id = 7ba59cc884714e8aa5f3f0ecaed84cbb-404190ce4ce94cecbfcb6ea9d1dd8626
I20260709 13:18:18.748200  6742 tablet_copy_source_session.cc:215] T 404190ce4ce94cecbfcb6ea9d1dd8626 P ccd8a4c3bfe3413cb2ae219b09aea832: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:18:18.760690  6729 raft_consensus.cc:2955] T 7ba5dac66ab5497e9e336f2a3c28cda5 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } attrs { replace: true } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: NON_VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: true } } }
I20260709 13:18:18.759174  7570 raft_consensus.cc:2955] T 7ba5dac66ab5497e9e336f2a3c28cda5 P cd75a17ab2604397adab03bb8b5fd75c [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } attrs { replace: true } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: NON_VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: true } } }
I20260709 13:18:18.770926  6741 tablet_copy_service.cc:140] P ccd8a4c3bfe3413cb2ae219b09aea832: Received BeginTabletCopySession request for tablet bb3d8792045a4583ae2e965b1350a5b4 from peer 7ba59cc884714e8aa5f3f0ecaed84cbb ({username='slave'} at 127.0.0.1:49744)
I20260709 13:18:18.771554  6741 tablet_copy_service.cc:161] P ccd8a4c3bfe3413cb2ae219b09aea832: Beginning new tablet copy session on tablet bb3d8792045a4583ae2e965b1350a5b4 from peer 7ba59cc884714e8aa5f3f0ecaed84cbb at {username='slave'} at 127.0.0.1:49744: session id = 7ba59cc884714e8aa5f3f0ecaed84cbb-bb3d8792045a4583ae2e965b1350a5b4
I20260709 13:18:18.816457  6741 tablet_copy_source_session.cc:215] T bb3d8792045a4583ae2e965b1350a5b4 P ccd8a4c3bfe3413cb2ae219b09aea832: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:18:18.853345  7559 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 404190ce4ce94cecbfcb6ea9d1dd8626. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:18.877662  7565 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bb3d8792045a4583ae2e965b1350a5b4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:18.914397  7580 ts_tablet_manager.cc:933] T d8cee0accdb8499c86d4414b72565a38 P 7ba59cc884714e8aa5f3f0ecaed84cbb: Initiating tablet copy from peer b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:18:18.913786  6628 catalog_manager.cc:5697] T 7ba5dac66ab5497e9e336f2a3c28cda5 P cd75a17ab2604397adab03bb8b5fd75c reported cstate change: config changed from index -1 to 2, NON_VOTER 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68) added. New cstate: current_term: 1 leader_uuid: "cd75a17ab2604397adab03bb8b5fd75c" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: NON_VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:18.930106  6800 raft_consensus.cc:2955] T 7ba5dac66ab5497e9e336f2a3c28cda5 P b7ab4784c7344b939bc36f639286f377 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } attrs { replace: true } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: NON_VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: true } } }
I20260709 13:18:18.937057  7580 tablet_copy_client.cc:323] T d8cee0accdb8499c86d4414b72565a38 P 7ba59cc884714e8aa5f3f0ecaed84cbb: tablet copy: Beginning tablet copy session from remote peer at address 127.5.126.66:42817
I20260709 13:18:18.993227  7583 ts_tablet_manager.cc:933] T 7ba5dac66ab5497e9e336f2a3c28cda5 P 7ba59cc884714e8aa5f3f0ecaed84cbb: Initiating tablet copy from peer cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:18:19.006445  7583 tablet_copy_client.cc:323] T 7ba5dac66ab5497e9e336f2a3c28cda5 P 7ba59cc884714e8aa5f3f0ecaed84cbb: tablet copy: Beginning tablet copy session from remote peer at address 127.5.126.67:42931
I20260709 13:18:19.121783  6817 tablet_copy_service.cc:140] P b7ab4784c7344b939bc36f639286f377: Received BeginTabletCopySession request for tablet d8cee0accdb8499c86d4414b72565a38 from peer 7ba59cc884714e8aa5f3f0ecaed84cbb ({username='slave'} at 127.0.0.1:50550)
I20260709 13:18:19.122442  6817 tablet_copy_service.cc:161] P b7ab4784c7344b939bc36f639286f377: Beginning new tablet copy session on tablet d8cee0accdb8499c86d4414b72565a38 from peer 7ba59cc884714e8aa5f3f0ecaed84cbb at {username='slave'} at 127.0.0.1:50550: session id = 7ba59cc884714e8aa5f3f0ecaed84cbb-d8cee0accdb8499c86d4414b72565a38
I20260709 13:18:19.141855  7559 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.StartTabletCopy from 127.0.0.1:50742 (request call id 2) took 1001 ms. Trace:
I20260709 13:18:19.142455  7559 rpcz_store.cc:276] 0709 13:18:18.141072 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:18.141466 (+   394us) service_pool.cc:224] Handling call
0709 13:18:18.188438 (+ 46972us) ts_tablet_manager.cc:934] T 404190ce4ce94cecbfcb6ea9d1dd8626 P 7ba59cc884714e8aa5f3f0ecaed84cbb: Initiating tablet copy from peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391)
0709 13:18:18.841221 (+652783us) tablet_copy_client.cc:368] Tablet copy session begun
0709 13:18:19.042289 (+201068us) tablet_metadata.cc:665] Metadata flushed
0709 13:18:19.042420 (+   131us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 13:18:19.140844 (+ 98424us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 13:18:19.141242 (+   398us) tablet_replica.cc:206] Creating consensus instance
0709 13:18:19.141675 (+   433us) ts_tablet_manager.cc:989] Replica registered.
0709 13:18:19.141747 (+    72us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":359,"tablet-copy.queue_time_us":44124,"thread_start_us":99401,"threads_started":2}
I20260709 13:18:19.144236  7559 tablet_copy_client.cc:806] T 404190ce4ce94cecbfcb6ea9d1dd8626 P 7ba59cc884714e8aa5f3f0ecaed84cbb: tablet copy: Starting download of 0 data blocks...
I20260709 13:18:19.144994  7559 tablet_copy_client.cc:670] T 404190ce4ce94cecbfcb6ea9d1dd8626 P 7ba59cc884714e8aa5f3f0ecaed84cbb: tablet copy: Starting download of 1 WAL segments...
I20260709 13:18:19.145161  7565 tablet_copy_client.cc:806] T bb3d8792045a4583ae2e965b1350a5b4 P 7ba59cc884714e8aa5f3f0ecaed84cbb: tablet copy: Starting download of 0 data blocks...
I20260709 13:18:19.145862  7565 tablet_copy_client.cc:670] T bb3d8792045a4583ae2e965b1350a5b4 P 7ba59cc884714e8aa5f3f0ecaed84cbb: tablet copy: Starting download of 1 WAL segments...
I20260709 13:18:19.135316  6817 tablet_copy_source_session.cc:215] T d8cee0accdb8499c86d4414b72565a38 P b7ab4784c7344b939bc36f639286f377: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:18:19.153339  7580 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d8cee0accdb8499c86d4414b72565a38. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:19.166620  6891 tablet_copy_service.cc:140] P cd75a17ab2604397adab03bb8b5fd75c: Received BeginTabletCopySession request for tablet 7ba5dac66ab5497e9e336f2a3c28cda5 from peer 7ba59cc884714e8aa5f3f0ecaed84cbb ({username='slave'} at 127.0.0.1:58592)
I20260709 13:18:19.167332  6891 tablet_copy_service.cc:161] P cd75a17ab2604397adab03bb8b5fd75c: Beginning new tablet copy session on tablet 7ba5dac66ab5497e9e336f2a3c28cda5 from peer 7ba59cc884714e8aa5f3f0ecaed84cbb at {username='slave'} at 127.0.0.1:58592: session id = 7ba59cc884714e8aa5f3f0ecaed84cbb-7ba5dac66ab5497e9e336f2a3c28cda5
I20260709 13:18:19.180490  7565 tablet_copy_client.cc:538] T bb3d8792045a4583ae2e965b1350a5b4 P 7ba59cc884714e8aa5f3f0ecaed84cbb: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:18:19.179751  7559 tablet_copy_client.cc:538] T 404190ce4ce94cecbfcb6ea9d1dd8626 P 7ba59cc884714e8aa5f3f0ecaed84cbb: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:18:19.199923  6891 tablet_copy_source_session.cc:215] T 7ba5dac66ab5497e9e336f2a3c28cda5 P cd75a17ab2604397adab03bb8b5fd75c: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:18:19.210274  7583 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7ba5dac66ab5497e9e336f2a3c28cda5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:19.211856  7565 tablet_bootstrap.cc:492] T bb3d8792045a4583ae2e965b1350a5b4 P 7ba59cc884714e8aa5f3f0ecaed84cbb: Bootstrap starting.
I20260709 13:18:19.240694  7583 tablet_copy_client.cc:806] T 7ba5dac66ab5497e9e336f2a3c28cda5 P 7ba59cc884714e8aa5f3f0ecaed84cbb: tablet copy: Starting download of 0 data blocks...
I20260709 13:18:19.241458  7583 tablet_copy_client.cc:670] T 7ba5dac66ab5497e9e336f2a3c28cda5 P 7ba59cc884714e8aa5f3f0ecaed84cbb: tablet copy: Starting download of 1 WAL segments...
I20260709 13:18:19.252820  7583 tablet_copy_client.cc:538] T 7ba5dac66ab5497e9e336f2a3c28cda5 P 7ba59cc884714e8aa5f3f0ecaed84cbb: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:18:19.270710  7583 tablet_bootstrap.cc:492] T 7ba5dac66ab5497e9e336f2a3c28cda5 P 7ba59cc884714e8aa5f3f0ecaed84cbb: Bootstrap starting.
I20260709 13:18:19.277714  7565 tablet_bootstrap.cc:492] T bb3d8792045a4583ae2e965b1350a5b4 P 7ba59cc884714e8aa5f3f0ecaed84cbb: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:18:19.280452  7559 tablet_bootstrap.cc:492] T 404190ce4ce94cecbfcb6ea9d1dd8626 P 7ba59cc884714e8aa5f3f0ecaed84cbb: Bootstrap starting.
I20260709 13:18:19.282162  7565 tablet_bootstrap.cc:492] T bb3d8792045a4583ae2e965b1350a5b4 P 7ba59cc884714e8aa5f3f0ecaed84cbb: Bootstrap complete.
I20260709 13:18:19.291215  7565 ts_tablet_manager.cc:1403] T bb3d8792045a4583ae2e965b1350a5b4 P 7ba59cc884714e8aa5f3f0ecaed84cbb: Time spent bootstrapping tablet: real 0.080s	user 0.021s	sys 0.016s
I20260709 13:18:19.306200  7580 tablet_copy_client.cc:806] T d8cee0accdb8499c86d4414b72565a38 P 7ba59cc884714e8aa5f3f0ecaed84cbb: tablet copy: Starting download of 0 data blocks...
I20260709 13:18:19.307735  7580 tablet_copy_client.cc:670] T d8cee0accdb8499c86d4414b72565a38 P 7ba59cc884714e8aa5f3f0ecaed84cbb: tablet copy: Starting download of 1 WAL segments...
I20260709 13:18:19.312537  7580 tablet_copy_client.cc:538] T d8cee0accdb8499c86d4414b72565a38 P 7ba59cc884714e8aa5f3f0ecaed84cbb: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:18:19.315645  7565 raft_consensus.cc:359] T bb3d8792045a4583ae2e965b1350a5b4 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } attrs { replace: true } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: NON_VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: true } }
I20260709 13:18:19.316706  7565 raft_consensus.cc:740] T bb3d8792045a4583ae2e965b1350a5b4 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 7ba59cc884714e8aa5f3f0ecaed84cbb, State: Initialized, Role: LEARNER
I20260709 13:18:19.317518  7565 consensus_queue.cc:260] T bb3d8792045a4583ae2e965b1350a5b4 P 7ba59cc884714e8aa5f3f0ecaed84cbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } attrs { replace: true } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: NON_VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: true } }
I20260709 13:18:19.324144  7565 ts_tablet_manager.cc:1434] T bb3d8792045a4583ae2e965b1350a5b4 P 7ba59cc884714e8aa5f3f0ecaed84cbb: Time spent starting tablet: real 0.032s	user 0.005s	sys 0.003s
I20260709 13:18:19.336163  6741 tablet_copy_service.cc:342] P ccd8a4c3bfe3413cb2ae219b09aea832: Request end of tablet copy session 7ba59cc884714e8aa5f3f0ecaed84cbb-bb3d8792045a4583ae2e965b1350a5b4 received from {username='slave'} at 127.0.0.1:49744
I20260709 13:18:19.336807  6741 tablet_copy_service.cc:434] P ccd8a4c3bfe3413cb2ae219b09aea832: ending tablet copy session 7ba59cc884714e8aa5f3f0ecaed84cbb-bb3d8792045a4583ae2e965b1350a5b4 on tablet bb3d8792045a4583ae2e965b1350a5b4 with peer 7ba59cc884714e8aa5f3f0ecaed84cbb
I20260709 13:18:19.370299  7580 tablet_bootstrap.cc:492] T d8cee0accdb8499c86d4414b72565a38 P 7ba59cc884714e8aa5f3f0ecaed84cbb: Bootstrap starting.
W20260709 13:18:19.431771  6772 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 46703.1us
I20260709 13:18:19.453148  7559 tablet_bootstrap.cc:492] T 404190ce4ce94cecbfcb6ea9d1dd8626 P 7ba59cc884714e8aa5f3f0ecaed84cbb: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:18:19.460330  7580 tablet_bootstrap.cc:492] T d8cee0accdb8499c86d4414b72565a38 P 7ba59cc884714e8aa5f3f0ecaed84cbb: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:18:19.501232  7580 tablet_bootstrap.cc:492] T d8cee0accdb8499c86d4414b72565a38 P 7ba59cc884714e8aa5f3f0ecaed84cbb: Bootstrap complete.
I20260709 13:18:19.502120  7580 ts_tablet_manager.cc:1403] T d8cee0accdb8499c86d4414b72565a38 P 7ba59cc884714e8aa5f3f0ecaed84cbb: Time spent bootstrapping tablet: real 0.132s	user 0.016s	sys 0.025s
I20260709 13:18:19.461536  7583 tablet_bootstrap.cc:492] T 7ba5dac66ab5497e9e336f2a3c28cda5 P 7ba59cc884714e8aa5f3f0ecaed84cbb: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:18:19.504570  7583 tablet_bootstrap.cc:492] T 7ba5dac66ab5497e9e336f2a3c28cda5 P 7ba59cc884714e8aa5f3f0ecaed84cbb: Bootstrap complete.
I20260709 13:18:19.505375  7583 ts_tablet_manager.cc:1403] T 7ba5dac66ab5497e9e336f2a3c28cda5 P 7ba59cc884714e8aa5f3f0ecaed84cbb: Time spent bootstrapping tablet: real 0.235s	user 0.048s	sys 0.034s
I20260709 13:18:19.505455  7580 raft_consensus.cc:359] T d8cee0accdb8499c86d4414b72565a38 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } attrs { replace: true } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: NON_VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: true } }
I20260709 13:18:19.506395  7580 raft_consensus.cc:740] T d8cee0accdb8499c86d4414b72565a38 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 7ba59cc884714e8aa5f3f0ecaed84cbb, State: Initialized, Role: LEARNER
I20260709 13:18:19.501232  7559 tablet_bootstrap.cc:492] T 404190ce4ce94cecbfcb6ea9d1dd8626 P 7ba59cc884714e8aa5f3f0ecaed84cbb: Bootstrap complete.
I20260709 13:18:19.507858  7559 ts_tablet_manager.cc:1403] T 404190ce4ce94cecbfcb6ea9d1dd8626 P 7ba59cc884714e8aa5f3f0ecaed84cbb: Time spent bootstrapping tablet: real 0.228s	user 0.043s	sys 0.036s
I20260709 13:18:19.509014  7583 raft_consensus.cc:359] T 7ba5dac66ab5497e9e336f2a3c28cda5 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } attrs { replace: true } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: NON_VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: true } }
I20260709 13:18:19.510001  7583 raft_consensus.cc:740] T 7ba5dac66ab5497e9e336f2a3c28cda5 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 7ba59cc884714e8aa5f3f0ecaed84cbb, State: Initialized, Role: LEARNER
I20260709 13:18:19.510838  7583 consensus_queue.cc:260] T 7ba5dac66ab5497e9e336f2a3c28cda5 P 7ba59cc884714e8aa5f3f0ecaed84cbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } attrs { replace: true } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: NON_VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: true } }
I20260709 13:18:19.513522  7583 ts_tablet_manager.cc:1434] T 7ba5dac66ab5497e9e336f2a3c28cda5 P 7ba59cc884714e8aa5f3f0ecaed84cbb: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.001s
I20260709 13:18:19.514287  7559 raft_consensus.cc:359] T 404190ce4ce94cecbfcb6ea9d1dd8626 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } attrs { replace: true } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: NON_VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: true } }
I20260709 13:18:19.515313  7559 raft_consensus.cc:740] T 404190ce4ce94cecbfcb6ea9d1dd8626 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 7ba59cc884714e8aa5f3f0ecaed84cbb, State: Initialized, Role: LEARNER
I20260709 13:18:19.516053  7559 consensus_queue.cc:260] T 404190ce4ce94cecbfcb6ea9d1dd8626 P 7ba59cc884714e8aa5f3f0ecaed84cbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } attrs { replace: true } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: NON_VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: true } }
I20260709 13:18:19.518002  6891 tablet_copy_service.cc:342] P cd75a17ab2604397adab03bb8b5fd75c: Request end of tablet copy session 7ba59cc884714e8aa5f3f0ecaed84cbb-7ba5dac66ab5497e9e336f2a3c28cda5 received from {username='slave'} at 127.0.0.1:58592
I20260709 13:18:19.518472  7559 ts_tablet_manager.cc:1434] T 404190ce4ce94cecbfcb6ea9d1dd8626 P 7ba59cc884714e8aa5f3f0ecaed84cbb: Time spent starting tablet: real 0.010s	user 0.004s	sys 0.002s
I20260709 13:18:19.518573  6891 tablet_copy_service.cc:434] P cd75a17ab2604397adab03bb8b5fd75c: ending tablet copy session 7ba59cc884714e8aa5f3f0ecaed84cbb-7ba5dac66ab5497e9e336f2a3c28cda5 on tablet 7ba5dac66ab5497e9e336f2a3c28cda5 with peer 7ba59cc884714e8aa5f3f0ecaed84cbb
W20260709 13:18:19.524350  6695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 86485us
I20260709 13:18:19.524410  7580 consensus_queue.cc:260] T d8cee0accdb8499c86d4414b72565a38 P 7ba59cc884714e8aa5f3f0ecaed84cbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } attrs { replace: true } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: NON_VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: true } }
I20260709 13:18:19.527626  7580 ts_tablet_manager.cc:1434] T d8cee0accdb8499c86d4414b72565a38 P 7ba59cc884714e8aa5f3f0ecaed84cbb: Time spent starting tablet: real 0.025s	user 0.006s	sys 0.001s
I20260709 13:18:19.529672  6817 tablet_copy_service.cc:342] P b7ab4784c7344b939bc36f639286f377: Request end of tablet copy session 7ba59cc884714e8aa5f3f0ecaed84cbb-d8cee0accdb8499c86d4414b72565a38 received from {username='slave'} at 127.0.0.1:50550
I20260709 13:18:19.530157  6817 tablet_copy_service.cc:434] P b7ab4784c7344b939bc36f639286f377: ending tablet copy session 7ba59cc884714e8aa5f3f0ecaed84cbb-d8cee0accdb8499c86d4414b72565a38 on tablet d8cee0accdb8499c86d4414b72565a38 with peer 7ba59cc884714e8aa5f3f0ecaed84cbb
I20260709 13:18:19.589006  6741 tablet_copy_service.cc:342] P ccd8a4c3bfe3413cb2ae219b09aea832: Request end of tablet copy session 7ba59cc884714e8aa5f3f0ecaed84cbb-404190ce4ce94cecbfcb6ea9d1dd8626 received from {username='slave'} at 127.0.0.1:49744
I20260709 13:18:19.589592  6741 tablet_copy_service.cc:434] P ccd8a4c3bfe3413cb2ae219b09aea832: ending tablet copy session 7ba59cc884714e8aa5f3f0ecaed84cbb-404190ce4ce94cecbfcb6ea9d1dd8626 on tablet 404190ce4ce94cecbfcb6ea9d1dd8626 with peer 7ba59cc884714e8aa5f3f0ecaed84cbb
W20260709 13:18:19.614837  6661 debug-util.cc:398] Leaking SignalData structure 0x7b08000f9ee0 after lost signal to thread 5628
W20260709 13:18:19.615998  6661 debug-util.cc:398] Leaking SignalData structure 0x7b0800131d80 after lost signal to thread 6664
W20260709 13:18:19.617533  6661 debug-util.cc:398] Leaking SignalData structure 0x7b08002a7320 after lost signal to thread 6756
W20260709 13:18:19.621938  6661 debug-util.cc:398] Leaking SignalData structure 0x7b0800223d20 after lost signal to thread 7527
I20260709 13:18:19.689042  7503 raft_consensus.cc:1217] T bb3d8792045a4583ae2e965b1350a5b4 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:18:19.782193  7503 raft_consensus.cc:1217] T d8cee0accdb8499c86d4414b72565a38 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:18:19.923358  7503 raft_consensus.cc:1217] T 404190ce4ce94cecbfcb6ea9d1dd8626 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:18:19.941933  7503 raft_consensus.cc:1217] T 7ba5dac66ab5497e9e336f2a3c28cda5 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:18:20.087193  7600 raft_consensus.cc:1064] T bb3d8792045a4583ae2e965b1350a5b4 P ccd8a4c3bfe3413cb2ae219b09aea832: attempting to promote NON_VOTER 7ba59cc884714e8aa5f3f0ecaed84cbb to VOTER
I20260709 13:18:20.090937  7600 consensus_queue.cc:237] T bb3d8792045a4583ae2e965b1350a5b4 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } attrs { replace: true } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:18:20.103928  7503 raft_consensus.cc:1275] T bb3d8792045a4583ae2e965b1350a5b4 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 1 LEARNER]: Refusing update from remote peer ccd8a4c3bfe3413cb2ae219b09aea832: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:18:20.105615  7586 consensus_queue.cc:1048] T bb3d8792045a4583ae2e965b1350a5b4 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:18:20.111927  6872 raft_consensus.cc:1275] T bb3d8792045a4583ae2e965b1350a5b4 P cd75a17ab2604397adab03bb8b5fd75c [term 1 FOLLOWER]: Refusing update from remote peer ccd8a4c3bfe3413cb2ae219b09aea832: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:18:20.114101  7599 consensus_queue.cc:1048] T bb3d8792045a4583ae2e965b1350a5b4 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:18:20.116978  6805 raft_consensus.cc:1275] T bb3d8792045a4583ae2e965b1350a5b4 P b7ab4784c7344b939bc36f639286f377 [term 1 FOLLOWER]: Refusing update from remote peer ccd8a4c3bfe3413cb2ae219b09aea832: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:18:20.119711  7598 consensus_queue.cc:1048] T bb3d8792045a4583ae2e965b1350a5b4 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:18:20.174626  7600 raft_consensus.cc:2955] T bb3d8792045a4583ae2e965b1350a5b4 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } attrs { replace: true } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } } }
I20260709 13:18:20.193773  7503 raft_consensus.cc:2955] T bb3d8792045a4583ae2e965b1350a5b4 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } attrs { replace: true } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } } }
I20260709 13:18:20.193956  6800 raft_consensus.cc:2955] T bb3d8792045a4583ae2e965b1350a5b4 P b7ab4784c7344b939bc36f639286f377 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } attrs { replace: true } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } } }
I20260709 13:18:20.213925  6872 raft_consensus.cc:2955] T bb3d8792045a4583ae2e965b1350a5b4 P cd75a17ab2604397adab03bb8b5fd75c [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } attrs { replace: true } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } } }
I20260709 13:18:20.232216  6628 catalog_manager.cc:5697] T bb3d8792045a4583ae2e965b1350a5b4 P ccd8a4c3bfe3413cb2ae219b09aea832 reported cstate change: config changed from index 2 to 3, 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:18:20.290266  7576 raft_consensus.cc:1064] T d8cee0accdb8499c86d4414b72565a38 P b7ab4784c7344b939bc36f639286f377: attempting to promote NON_VOTER 7ba59cc884714e8aa5f3f0ecaed84cbb to VOTER
I20260709 13:18:20.293640  7576 consensus_queue.cc:237] T d8cee0accdb8499c86d4414b72565a38 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } attrs { replace: true } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:18:20.324700  6729 consensus_queue.cc:237] T bb3d8792045a4583ae2e965b1350a5b4 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:18:20.348989  7503 raft_consensus.cc:1275] T bb3d8792045a4583ae2e965b1350a5b4 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 1 FOLLOWER]: Refusing update from remote peer ccd8a4c3bfe3413cb2ae219b09aea832: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:18:20.357496  6874 raft_consensus.cc:1275] T bb3d8792045a4583ae2e965b1350a5b4 P cd75a17ab2604397adab03bb8b5fd75c [term 1 FOLLOWER]: Refusing update from remote peer ccd8a4c3bfe3413cb2ae219b09aea832: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:18:20.357295  7598 consensus_queue.cc:1048] T bb3d8792045a4583ae2e965b1350a5b4 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:18:20.361913  7597 consensus_queue.cc:1048] T bb3d8792045a4583ae2e965b1350a5b4 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:18:20.370751  7503 raft_consensus.cc:1275] T d8cee0accdb8499c86d4414b72565a38 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 1 LEARNER]: Refusing update from remote peer b7ab4784c7344b939bc36f639286f377: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:18:20.370985  6875 raft_consensus.cc:1275] T d8cee0accdb8499c86d4414b72565a38 P cd75a17ab2604397adab03bb8b5fd75c [term 1 FOLLOWER]: Refusing update from remote peer b7ab4784c7344b939bc36f639286f377: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:18:20.374296  7561 consensus_queue.cc:1048] T d8cee0accdb8499c86d4414b72565a38 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:18:20.376739  7561 consensus_queue.cc:1048] T d8cee0accdb8499c86d4414b72565a38 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:18:20.387665  6729 raft_consensus.cc:1275] T d8cee0accdb8499c86d4414b72565a38 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 1 FOLLOWER]: Refusing update from remote peer b7ab4784c7344b939bc36f639286f377: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:18:20.397845  7601 raft_consensus.cc:1064] T 7ba5dac66ab5497e9e336f2a3c28cda5 P cd75a17ab2604397adab03bb8b5fd75c: attempting to promote NON_VOTER 7ba59cc884714e8aa5f3f0ecaed84cbb to VOTER
I20260709 13:18:20.401213  7463 consensus_queue.cc:1048] T d8cee0accdb8499c86d4414b72565a38 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:18:20.405992  7601 consensus_queue.cc:237] T 7ba5dac66ab5497e9e336f2a3c28cda5 P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } attrs { replace: true } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
W20260709 13:18:20.406893  6697 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 45439.1us
I20260709 13:18:20.534480  7502 raft_consensus.cc:2955] T bb3d8792045a4583ae2e965b1350a5b4 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b7ab4784c7344b939bc36f639286f377 (127.5.126.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } } }
I20260709 13:18:20.536338  7553 raft_consensus.cc:2955] T bb3d8792045a4583ae2e965b1350a5b4 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b7ab4784c7344b939bc36f639286f377 (127.5.126.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } } }
I20260709 13:18:20.593952  6728 raft_consensus.cc:1275] T 7ba5dac66ab5497e9e336f2a3c28cda5 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 1 FOLLOWER]: Refusing update from remote peer cd75a17ab2604397adab03bb8b5fd75c: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:18:20.596731  7577 consensus_queue.cc:1048] T 7ba5dac66ab5497e9e336f2a3c28cda5 P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Connected to new peer: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:18:20.607928  7502 raft_consensus.cc:1275] T 7ba5dac66ab5497e9e336f2a3c28cda5 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 1 LEARNER]: Refusing update from remote peer cd75a17ab2604397adab03bb8b5fd75c: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:18:20.610651  7601 consensus_queue.cc:1048] T 7ba5dac66ab5497e9e336f2a3c28cda5 P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:18:20.612367  6800 raft_consensus.cc:1275] T 7ba5dac66ab5497e9e336f2a3c28cda5 P b7ab4784c7344b939bc36f639286f377 [term 1 FOLLOWER]: Refusing update from remote peer cd75a17ab2604397adab03bb8b5fd75c: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:18:20.614375  7601 consensus_queue.cc:1048] T 7ba5dac66ab5497e9e336f2a3c28cda5 P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:18:20.629302  6630 catalog_manager.cc:5697] T bb3d8792045a4583ae2e965b1350a5b4 P 7ba59cc884714e8aa5f3f0ecaed84cbb reported cstate change: config changed from index 3 to 4, VOTER b7ab4784c7344b939bc36f639286f377 (127.5.126.66) evicted. New cstate: current_term: 1 leader_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } } }
I20260709 13:18:20.634294  7561 raft_consensus.cc:2955] T d8cee0accdb8499c86d4414b72565a38 P b7ab4784c7344b939bc36f639286f377 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } attrs { replace: true } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } } }
I20260709 13:18:20.636209  6874 raft_consensus.cc:2955] T d8cee0accdb8499c86d4414b72565a38 P cd75a17ab2604397adab03bb8b5fd75c [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } attrs { replace: true } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } } }
I20260709 13:18:20.647276  6790 tablet_service.cc:1558] Processing DeleteTablet for tablet bb3d8792045a4583ae2e965b1350a5b4 with delete_type TABLET_DATA_TOMBSTONED (TS b7ab4784c7344b939bc36f639286f377 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:32964
I20260709 13:18:20.683531  6875 raft_consensus.cc:2955] T bb3d8792045a4583ae2e965b1350a5b4 P cd75a17ab2604397adab03bb8b5fd75c [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b7ab4784c7344b939bc36f639286f377 (127.5.126.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } } }
I20260709 13:18:20.688534  7600 raft_consensus.cc:1064] T 404190ce4ce94cecbfcb6ea9d1dd8626 P ccd8a4c3bfe3413cb2ae219b09aea832: attempting to promote NON_VOTER 7ba59cc884714e8aa5f3f0ecaed84cbb to VOTER
W20260709 13:18:20.730261  6770 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 56589.6us
I20260709 13:18:20.691843  7600 consensus_queue.cc:237] T 404190ce4ce94cecbfcb6ea9d1dd8626 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } attrs { replace: true } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:18:20.744968  7502 raft_consensus.cc:2955] T d8cee0accdb8499c86d4414b72565a38 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } attrs { replace: true } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } } }
I20260709 13:18:20.752511  7626 tablet_replica.cc:333] T bb3d8792045a4583ae2e965b1350a5b4 P b7ab4784c7344b939bc36f639286f377: stopping tablet replica
I20260709 13:18:20.753798  7626 raft_consensus.cc:2243] T bb3d8792045a4583ae2e965b1350a5b4 P b7ab4784c7344b939bc36f639286f377 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:20.754678  7577 raft_consensus.cc:2955] T 7ba5dac66ab5497e9e336f2a3c28cda5 P cd75a17ab2604397adab03bb8b5fd75c [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } attrs { replace: true } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } } }
I20260709 13:18:20.747084  6728 raft_consensus.cc:2955] T d8cee0accdb8499c86d4414b72565a38 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } attrs { replace: true } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } } }
I20260709 13:18:20.754715  6630 catalog_manager.cc:5697] T d8cee0accdb8499c86d4414b72565a38 P cd75a17ab2604397adab03bb8b5fd75c reported cstate change: config changed from index 2 to 3, 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "b7ab4784c7344b939bc36f639286f377" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } attrs { replace: true } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } } }
I20260709 13:18:20.766568  7626 raft_consensus.cc:2272] T bb3d8792045a4583ae2e965b1350a5b4 P b7ab4784c7344b939bc36f639286f377 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:20.810325  7626 ts_tablet_manager.cc:1916] T bb3d8792045a4583ae2e965b1350a5b4 P b7ab4784c7344b939bc36f639286f377: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:18:20.813103  6614 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet bb3d8792045a4583ae2e965b1350a5b4 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:18:20.787469  7503 raft_consensus.cc:2955] T 7ba5dac66ab5497e9e336f2a3c28cda5 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } attrs { replace: true } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } } }
I20260709 13:18:20.842481  6723 raft_consensus.cc:2955] T 7ba5dac66ab5497e9e336f2a3c28cda5 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } attrs { replace: true } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } } }
I20260709 13:18:20.800916  6805 raft_consensus.cc:2955] T 7ba5dac66ab5497e9e336f2a3c28cda5 P b7ab4784c7344b939bc36f639286f377 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } attrs { replace: true } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } } }
I20260709 13:18:20.893891  6874 raft_consensus.cc:1275] T 404190ce4ce94cecbfcb6ea9d1dd8626 P cd75a17ab2604397adab03bb8b5fd75c [term 1 FOLLOWER]: Refusing update from remote peer ccd8a4c3bfe3413cb2ae219b09aea832: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:18:20.894297  7502 raft_consensus.cc:1275] T 404190ce4ce94cecbfcb6ea9d1dd8626 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 1 LEARNER]: Refusing update from remote peer ccd8a4c3bfe3413cb2ae219b09aea832: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:18:20.895687  6802 consensus_queue.cc:237] T d8cee0accdb8499c86d4414b72565a38 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:18:20.892177  6630 catalog_manager.cc:5697] T 7ba5dac66ab5497e9e336f2a3c28cda5 P cd75a17ab2604397adab03bb8b5fd75c reported cstate change: config changed from index 2 to 3, 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "cd75a17ab2604397adab03bb8b5fd75c" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:18:20.902335  6877 raft_consensus.cc:1275] T d8cee0accdb8499c86d4414b72565a38 P cd75a17ab2604397adab03bb8b5fd75c [term 1 FOLLOWER]: Refusing update from remote peer b7ab4784c7344b939bc36f639286f377: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:18:20.903678  7502 raft_consensus.cc:1275] T d8cee0accdb8499c86d4414b72565a38 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 1 FOLLOWER]: Refusing update from remote peer b7ab4784c7344b939bc36f639286f377: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:18:20.902338  6804 raft_consensus.cc:1275] T 404190ce4ce94cecbfcb6ea9d1dd8626 P b7ab4784c7344b939bc36f639286f377 [term 1 FOLLOWER]: Refusing update from remote peer ccd8a4c3bfe3413cb2ae219b09aea832: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:18:20.907131  7618 consensus_queue.cc:1048] T 404190ce4ce94cecbfcb6ea9d1dd8626 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:18:20.908840  7616 consensus_queue.cc:1048] T 404190ce4ce94cecbfcb6ea9d1dd8626 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:18:20.913869  7561 consensus_queue.cc:1048] T d8cee0accdb8499c86d4414b72565a38 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:18:20.915287  7627 consensus_queue.cc:1048] T d8cee0accdb8499c86d4414b72565a38 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:18:20.930809  6875 consensus_queue.cc:237] T 7ba5dac66ab5497e9e336f2a3c28cda5 P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:18:20.940657  7626 ts_tablet_manager.cc:1929] T bb3d8792045a4583ae2e965b1350a5b4 P b7ab4784c7344b939bc36f639286f377: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:18:20.943881  7626 log.cc:1199] T bb3d8792045a4583ae2e965b1350a5b4 P b7ab4784c7344b939bc36f639286f377: Deleting WAL directory at /tmp/dist-test-taskWHb0CB/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783603057096655-5625-0/minicluster-data/ts-1-root/wals/bb3d8792045a4583ae2e965b1350a5b4
I20260709 13:18:20.944022  7586 consensus_queue.cc:1048] T 404190ce4ce94cecbfcb6ea9d1dd8626 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:18:20.954766  6614 catalog_manager.cc:5028] TS b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817): tablet bb3d8792045a4583ae2e965b1350a5b4 (table test-workload [id=04f4d366747e43549980077479ed75b9]) successfully deleted
I20260709 13:18:20.955878  6805 raft_consensus.cc:1275] T 7ba5dac66ab5497e9e336f2a3c28cda5 P b7ab4784c7344b939bc36f639286f377 [term 1 FOLLOWER]: Refusing update from remote peer cd75a17ab2604397adab03bb8b5fd75c: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:18:20.958441  7577 consensus_queue.cc:1048] T 7ba5dac66ab5497e9e336f2a3c28cda5 P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:18:20.961488  7502 raft_consensus.cc:1275] T 7ba5dac66ab5497e9e336f2a3c28cda5 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 1 FOLLOWER]: Refusing update from remote peer cd75a17ab2604397adab03bb8b5fd75c: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:18:20.966791  7577 consensus_queue.cc:1048] T 7ba5dac66ab5497e9e336f2a3c28cda5 P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:18:20.971212  7601 raft_consensus.cc:2955] T 7ba5dac66ab5497e9e336f2a3c28cda5 P cd75a17ab2604397adab03bb8b5fd75c [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } } }
I20260709 13:18:20.977572  7618 raft_consensus.cc:2955] T 404190ce4ce94cecbfcb6ea9d1dd8626 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } attrs { replace: true } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } } }
I20260709 13:18:20.983371  7502 raft_consensus.cc:2955] T 7ba5dac66ab5497e9e336f2a3c28cda5 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } } }
I20260709 13:18:20.996395  6802 raft_consensus.cc:2955] T 7ba5dac66ab5497e9e336f2a3c28cda5 P b7ab4784c7344b939bc36f639286f377 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } } }
I20260709 13:18:21.005709  6804 raft_consensus.cc:2955] T 404190ce4ce94cecbfcb6ea9d1dd8626 P b7ab4784c7344b939bc36f639286f377 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } attrs { replace: true } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } } }
I20260709 13:18:21.014748  7501 raft_consensus.cc:2955] T d8cee0accdb8499c86d4414b72565a38 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } } }
I20260709 13:18:21.008400  7576 raft_consensus.cc:2955] T d8cee0accdb8499c86d4414b72565a38 P b7ab4784c7344b939bc36f639286f377 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } } }
I20260709 13:18:21.023813  6876 raft_consensus.cc:2955] T d8cee0accdb8499c86d4414b72565a38 P cd75a17ab2604397adab03bb8b5fd75c [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } } }
I20260709 13:18:20.997642  7503 raft_consensus.cc:2955] T 404190ce4ce94cecbfcb6ea9d1dd8626 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } attrs { replace: true } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } } }
I20260709 13:18:21.050854  6616 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 7ba5dac66ab5497e9e336f2a3c28cda5 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:18:21.089810  6630 catalog_manager.cc:5697] T 7ba5dac66ab5497e9e336f2a3c28cda5 P b7ab4784c7344b939bc36f639286f377 reported cstate change: config changed from index 3 to 4, VOTER ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65) evicted. New cstate: current_term: 1 leader_uuid: "cd75a17ab2604397adab03bb8b5fd75c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } } }
I20260709 13:18:21.112174  6719 tablet_service.cc:1558] Processing DeleteTablet for tablet 7ba5dac66ab5497e9e336f2a3c28cda5 with delete_type TABLET_DATA_TOMBSTONED (TS ccd8a4c3bfe3413cb2ae219b09aea832 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:49996
I20260709 13:18:21.116341  6614 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet d8cee0accdb8499c86d4414b72565a38 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:18:21.126847  7633 tablet_replica.cc:333] T 7ba5dac66ab5497e9e336f2a3c28cda5 P ccd8a4c3bfe3413cb2ae219b09aea832: stopping tablet replica
I20260709 13:18:21.127962  7633 raft_consensus.cc:2243] T 7ba5dac66ab5497e9e336f2a3c28cda5 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:21.128687  7633 raft_consensus.cc:2272] T 7ba5dac66ab5497e9e336f2a3c28cda5 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:21.130084  6630 catalog_manager.cc:5697] T d8cee0accdb8499c86d4414b72565a38 P b7ab4784c7344b939bc36f639286f377 reported cstate change: config changed from index 3 to 4, VOTER ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65) evicted. New cstate: current_term: 1 leader_uuid: "b7ab4784c7344b939bc36f639286f377" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:18:21.130632  6877 raft_consensus.cc:2955] T 404190ce4ce94cecbfcb6ea9d1dd8626 P cd75a17ab2604397adab03bb8b5fd75c [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } attrs { replace: true } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } } }
I20260709 13:18:21.139585  7633 ts_tablet_manager.cc:1916] T 7ba5dac66ab5497e9e336f2a3c28cda5 P ccd8a4c3bfe3413cb2ae219b09aea832: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:18:21.152758  6628 catalog_manager.cc:5697] T 404190ce4ce94cecbfcb6ea9d1dd8626 P 7ba59cc884714e8aa5f3f0ecaed84cbb reported cstate change: config changed from index 2 to 3, 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } attrs { replace: true } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } } }
I20260709 13:18:21.168314  6719 tablet_service.cc:1558] Processing DeleteTablet for tablet d8cee0accdb8499c86d4414b72565a38 with delete_type TABLET_DATA_TOMBSTONED (TS ccd8a4c3bfe3413cb2ae219b09aea832 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:49996
I20260709 13:18:21.192772  6723 consensus_queue.cc:237] T 404190ce4ce94cecbfcb6ea9d1dd8626 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:18:21.205749  7633 ts_tablet_manager.cc:1929] T 7ba5dac66ab5497e9e336f2a3c28cda5 P ccd8a4c3bfe3413cb2ae219b09aea832: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:18:21.219712  7503 raft_consensus.cc:1275] T 404190ce4ce94cecbfcb6ea9d1dd8626 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 1 FOLLOWER]: Refusing update from remote peer ccd8a4c3bfe3413cb2ae219b09aea832: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:18:21.225922  6804 raft_consensus.cc:1275] T 404190ce4ce94cecbfcb6ea9d1dd8626 P b7ab4784c7344b939bc36f639286f377 [term 1 FOLLOWER]: Refusing update from remote peer ccd8a4c3bfe3413cb2ae219b09aea832: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:18:21.227979  7586 consensus_queue.cc:1048] T 404190ce4ce94cecbfcb6ea9d1dd8626 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:18:21.232613  7600 consensus_queue.cc:1048] T 404190ce4ce94cecbfcb6ea9d1dd8626 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:18:21.243341  7633 log.cc:1199] T 7ba5dac66ab5497e9e336f2a3c28cda5 P ccd8a4c3bfe3413cb2ae219b09aea832: Deleting WAL directory at /tmp/dist-test-taskWHb0CB/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783603057096655-5625-0/minicluster-data/ts-0-root/wals/7ba5dac66ab5497e9e336f2a3c28cda5
I20260709 13:18:21.242811  7597 raft_consensus.cc:2955] T 404190ce4ce94cecbfcb6ea9d1dd8626 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } } }
I20260709 13:18:21.246331  6614 catalog_manager.cc:5028] TS ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): tablet 7ba5dac66ab5497e9e336f2a3c28cda5 (table test-workload [id=04f4d366747e43549980077479ed75b9]) successfully deleted
I20260709 13:18:21.248682  7633 tablet_replica.cc:333] T d8cee0accdb8499c86d4414b72565a38 P ccd8a4c3bfe3413cb2ae219b09aea832: stopping tablet replica
I20260709 13:18:21.248716  6802 raft_consensus.cc:2955] T 404190ce4ce94cecbfcb6ea9d1dd8626 P b7ab4784c7344b939bc36f639286f377 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } } }
I20260709 13:18:21.254767  7633 raft_consensus.cc:2243] T d8cee0accdb8499c86d4414b72565a38 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:21.255815  7633 raft_consensus.cc:2272] T d8cee0accdb8499c86d4414b72565a38 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:21.267511  7633 ts_tablet_manager.cc:1916] T d8cee0accdb8499c86d4414b72565a38 P ccd8a4c3bfe3413cb2ae219b09aea832: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:18:21.290268  7633 ts_tablet_manager.cc:1929] T d8cee0accdb8499c86d4414b72565a38 P ccd8a4c3bfe3413cb2ae219b09aea832: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:18:21.292266  7503 raft_consensus.cc:2955] T 404190ce4ce94cecbfcb6ea9d1dd8626 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } } }
I20260709 13:18:21.296813  6627 catalog_manager.cc:5697] T 404190ce4ce94cecbfcb6ea9d1dd8626 P b7ab4784c7344b939bc36f639286f377 reported cstate change: config changed from index 3 to 4, VOTER cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67) evicted. New cstate: current_term: 1 leader_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } } }
I20260709 13:18:21.313836  6867 tablet_service.cc:1558] Processing DeleteTablet for tablet 404190ce4ce94cecbfcb6ea9d1dd8626 with delete_type TABLET_DATA_TOMBSTONED (TS cd75a17ab2604397adab03bb8b5fd75c not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:53394
I20260709 13:18:21.323925  7633 log.cc:1199] T d8cee0accdb8499c86d4414b72565a38 P ccd8a4c3bfe3413cb2ae219b09aea832: Deleting WAL directory at /tmp/dist-test-taskWHb0CB/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783603057096655-5625-0/minicluster-data/ts-0-root/wals/d8cee0accdb8499c86d4414b72565a38
I20260709 13:18:21.337268  6614 catalog_manager.cc:5028] TS ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): tablet d8cee0accdb8499c86d4414b72565a38 (table test-workload [id=04f4d366747e43549980077479ed75b9]) successfully deleted
I20260709 13:18:21.350291  6614 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 404190ce4ce94cecbfcb6ea9d1dd8626 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:18:21.352384  7634 tablet_replica.cc:333] T 404190ce4ce94cecbfcb6ea9d1dd8626 P cd75a17ab2604397adab03bb8b5fd75c: stopping tablet replica
I20260709 13:18:21.353724  7634 raft_consensus.cc:2243] T 404190ce4ce94cecbfcb6ea9d1dd8626 P cd75a17ab2604397adab03bb8b5fd75c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:21.354682  7634 raft_consensus.cc:2272] T 404190ce4ce94cecbfcb6ea9d1dd8626 P cd75a17ab2604397adab03bb8b5fd75c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:21.368166  7634 ts_tablet_manager.cc:1916] T 404190ce4ce94cecbfcb6ea9d1dd8626 P cd75a17ab2604397adab03bb8b5fd75c: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:18:21.399573  7634 ts_tablet_manager.cc:1929] T 404190ce4ce94cecbfcb6ea9d1dd8626 P cd75a17ab2604397adab03bb8b5fd75c: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:18:21.399986  7634 log.cc:1199] T 404190ce4ce94cecbfcb6ea9d1dd8626 P cd75a17ab2604397adab03bb8b5fd75c: Deleting WAL directory at /tmp/dist-test-taskWHb0CB/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783603057096655-5625-0/minicluster-data/ts-2-root/wals/404190ce4ce94cecbfcb6ea9d1dd8626
I20260709 13:18:21.401573  6616 catalog_manager.cc:5028] TS cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931): tablet 404190ce4ce94cecbfcb6ea9d1dd8626 (table test-workload [id=04f4d366747e43549980077479ed75b9]) successfully deleted
I20260709 13:18:22.401746  6723 consensus_queue.cc:237] T 4b8cacb381b746da8d0049b0a83b41dd P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } attrs { replace: true } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: NON_VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: true } }
I20260709 13:18:22.410424  6875 raft_consensus.cc:1275] T 4b8cacb381b746da8d0049b0a83b41dd P cd75a17ab2604397adab03bb8b5fd75c [term 1 FOLLOWER]: Refusing update from remote peer ccd8a4c3bfe3413cb2ae219b09aea832: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:18:22.411212  6697 consensus_peers.cc:597] T 4b8cacb381b746da8d0049b0a83b41dd P ccd8a4c3bfe3413cb2ae219b09aea832 -> Peer 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071): Couldn't send request to peer 7ba59cc884714e8aa5f3f0ecaed84cbb. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 4b8cacb381b746da8d0049b0a83b41dd. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:22.411715  6804 raft_consensus.cc:1275] T 4b8cacb381b746da8d0049b0a83b41dd P b7ab4784c7344b939bc36f639286f377 [term 1 FOLLOWER]: Refusing update from remote peer ccd8a4c3bfe3413cb2ae219b09aea832: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:18:22.412119  7597 consensus_queue.cc:1048] T 4b8cacb381b746da8d0049b0a83b41dd P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:18:22.413443  7553 consensus_queue.cc:1048] T 4b8cacb381b746da8d0049b0a83b41dd P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:18:22.421792  7553 raft_consensus.cc:2955] T 4b8cacb381b746da8d0049b0a83b41dd P ccd8a4c3bfe3413cb2ae219b09aea832 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } attrs { replace: true } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: NON_VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: true } } }
I20260709 13:18:22.424528  6875 raft_consensus.cc:2955] T 4b8cacb381b746da8d0049b0a83b41dd P cd75a17ab2604397adab03bb8b5fd75c [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } attrs { replace: true } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: NON_VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: true } } }
I20260709 13:18:22.431051  6802 raft_consensus.cc:2955] T 4b8cacb381b746da8d0049b0a83b41dd P b7ab4784c7344b939bc36f639286f377 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } attrs { replace: true } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: NON_VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: true } } }
I20260709 13:18:22.445209  6627 catalog_manager.cc:5697] T 4b8cacb381b746da8d0049b0a83b41dd P cd75a17ab2604397adab03bb8b5fd75c reported cstate change: config changed from index -1 to 2, NON_VOTER 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68) added. New cstate: current_term: 1 leader_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } attrs { replace: true } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: NON_VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: true } } }
I20260709 13:18:22.461508  6802 consensus_queue.cc:237] T 17587d6730594da4a56fa13a353232a1 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } attrs { replace: true } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: NON_VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: true } }
I20260709 13:18:22.479592  6874 raft_consensus.cc:1275] T 17587d6730594da4a56fa13a353232a1 P cd75a17ab2604397adab03bb8b5fd75c [term 2 FOLLOWER]: Refusing update from remote peer b7ab4784c7344b939bc36f639286f377: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:18:22.482602  6723 raft_consensus.cc:1275] T 17587d6730594da4a56fa13a353232a1 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 2 FOLLOWER]: Refusing update from remote peer b7ab4784c7344b939bc36f639286f377: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:18:22.484416  7635 consensus_queue.cc:1048] T 17587d6730594da4a56fa13a353232a1 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:18:22.488919  6772 consensus_peers.cc:597] T 17587d6730594da4a56fa13a353232a1 P b7ab4784c7344b939bc36f639286f377 -> Peer 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071): Couldn't send request to peer 7ba59cc884714e8aa5f3f0ecaed84cbb. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 17587d6730594da4a56fa13a353232a1. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:22.489996  7635 consensus_queue.cc:1048] T 17587d6730594da4a56fa13a353232a1 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:18:22.515158  7576 raft_consensus.cc:2955] T 17587d6730594da4a56fa13a353232a1 P b7ab4784c7344b939bc36f639286f377 [term 2 LEADER]: Committing config change with OpId 2.2: config changed from index -1 to 2, NON_VOTER 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } attrs { replace: true } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: NON_VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: true } } }
I20260709 13:18:22.562736  6875 raft_consensus.cc:2955] T 17587d6730594da4a56fa13a353232a1 P cd75a17ab2604397adab03bb8b5fd75c [term 2 FOLLOWER]: Committing config change with OpId 2.2: config changed from index -1 to 2, NON_VOTER 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } attrs { replace: true } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: NON_VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: true } } }
I20260709 13:18:22.593990  6729 raft_consensus.cc:2955] T 17587d6730594da4a56fa13a353232a1 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 2 FOLLOWER]: Committing config change with OpId 2.2: config changed from index -1 to 2, NON_VOTER 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } attrs { replace: true } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: NON_VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: true } } }
I20260709 13:18:22.610729  6723 consensus_queue.cc:237] T be1a92657f494cac8dd227d152f50151 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } attrs { replace: true } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: NON_VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: true } }
I20260709 13:18:22.637837  6629 catalog_manager.cc:5697] T 17587d6730594da4a56fa13a353232a1 P cd75a17ab2604397adab03bb8b5fd75c reported cstate change: config changed from index -1 to 2, NON_VOTER 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68) added. New cstate: current_term: 2 leader_uuid: "b7ab4784c7344b939bc36f639286f377" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } attrs { replace: true } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: NON_VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: true } } }
W20260709 13:18:22.661111  6697 consensus_peers.cc:597] T be1a92657f494cac8dd227d152f50151 P ccd8a4c3bfe3413cb2ae219b09aea832 -> Peer 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071): Couldn't send request to peer 7ba59cc884714e8aa5f3f0ecaed84cbb. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: be1a92657f494cac8dd227d152f50151. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:22.661609  6804 raft_consensus.cc:1275] T be1a92657f494cac8dd227d152f50151 P b7ab4784c7344b939bc36f639286f377 [term 1 FOLLOWER]: Refusing update from remote peer ccd8a4c3bfe3413cb2ae219b09aea832: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:18:22.664882  7599 consensus_queue.cc:1048] T be1a92657f494cac8dd227d152f50151 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:18:22.678081  6875 raft_consensus.cc:1275] T be1a92657f494cac8dd227d152f50151 P cd75a17ab2604397adab03bb8b5fd75c [term 1 FOLLOWER]: Refusing update from remote peer ccd8a4c3bfe3413cb2ae219b09aea832: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:18:22.681962  7600 consensus_queue.cc:1048] T be1a92657f494cac8dd227d152f50151 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:18:22.698455  7597 raft_consensus.cc:2955] T be1a92657f494cac8dd227d152f50151 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } attrs { replace: true } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: NON_VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: true } } }
I20260709 13:18:22.705176  6875 raft_consensus.cc:2955] T be1a92657f494cac8dd227d152f50151 P cd75a17ab2604397adab03bb8b5fd75c [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } attrs { replace: true } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: NON_VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: true } } }
I20260709 13:18:22.736478  6802 raft_consensus.cc:2955] T be1a92657f494cac8dd227d152f50151 P b7ab4784c7344b939bc36f639286f377 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } attrs { replace: true } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: NON_VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: true } } }
I20260709 13:18:22.751060  6629 catalog_manager.cc:5697] T be1a92657f494cac8dd227d152f50151 P cd75a17ab2604397adab03bb8b5fd75c reported cstate change: config changed from index -1 to 2, NON_VOTER 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68) added. New cstate: current_term: 1 leader_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } attrs { replace: true } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: NON_VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: true } } }
I20260709 13:18:22.760977  6875 consensus_queue.cc:237] T 4f00a2e87e56452083b759f60d461ee3 P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } attrs { replace: true } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: NON_VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: true } }
I20260709 13:18:22.770776  6802 raft_consensus.cc:1275] T 4f00a2e87e56452083b759f60d461ee3 P b7ab4784c7344b939bc36f639286f377 [term 3 FOLLOWER]: Refusing update from remote peer cd75a17ab2604397adab03bb8b5fd75c: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
W20260709 13:18:22.772248  6846 consensus_peers.cc:597] T 4f00a2e87e56452083b759f60d461ee3 P cd75a17ab2604397adab03bb8b5fd75c -> Peer 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071): Couldn't send request to peer 7ba59cc884714e8aa5f3f0ecaed84cbb. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 4f00a2e87e56452083b759f60d461ee3. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:22.773721  7651 consensus_queue.cc:1048] T 4f00a2e87e56452083b759f60d461ee3 P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:18:22.778774  6729 raft_consensus.cc:1275] T 4f00a2e87e56452083b759f60d461ee3 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 3 FOLLOWER]: Refusing update from remote peer cd75a17ab2604397adab03bb8b5fd75c: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:18:22.780543  7651 consensus_queue.cc:1048] T 4f00a2e87e56452083b759f60d461ee3 P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Connected to new peer: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:18:22.802850  7577 raft_consensus.cc:2955] T 4f00a2e87e56452083b759f60d461ee3 P cd75a17ab2604397adab03bb8b5fd75c [term 3 LEADER]: Committing config change with OpId 3.3: config changed from index -1 to 3, NON_VOTER 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } attrs { replace: true } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: NON_VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: true } } }
I20260709 13:18:22.805634  6802 raft_consensus.cc:2955] T 4f00a2e87e56452083b759f60d461ee3 P b7ab4784c7344b939bc36f639286f377 [term 3 FOLLOWER]: Committing config change with OpId 3.3: config changed from index -1 to 3, NON_VOTER 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } attrs { replace: true } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: NON_VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: true } } }
I20260709 13:18:22.809497  6723 raft_consensus.cc:2955] T 4f00a2e87e56452083b759f60d461ee3 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 3 FOLLOWER]: Committing config change with OpId 3.3: config changed from index -1 to 3, NON_VOTER 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } attrs { replace: true } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: NON_VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: true } } }
I20260709 13:18:22.835311  6629 catalog_manager.cc:5697] T 4f00a2e87e56452083b759f60d461ee3 P ccd8a4c3bfe3413cb2ae219b09aea832 reported cstate change: config changed from index -1 to 3, NON_VOTER 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68) added. New cstate: current_term: 3 leader_uuid: "cd75a17ab2604397adab03bb8b5fd75c" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } attrs { replace: true } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: NON_VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: true } } }
I20260709 13:18:22.860721  7661 ts_tablet_manager.cc:933] T 4b8cacb381b746da8d0049b0a83b41dd P 7ba59cc884714e8aa5f3f0ecaed84cbb: Initiating tablet copy from peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391)
I20260709 13:18:22.885120  7661 tablet_copy_client.cc:323] T 4b8cacb381b746da8d0049b0a83b41dd P 7ba59cc884714e8aa5f3f0ecaed84cbb: tablet copy: Beginning tablet copy session from remote peer at address 127.5.126.65:44391
I20260709 13:18:22.887462  6741 tablet_copy_service.cc:140] P ccd8a4c3bfe3413cb2ae219b09aea832: Received BeginTabletCopySession request for tablet 4b8cacb381b746da8d0049b0a83b41dd from peer 7ba59cc884714e8aa5f3f0ecaed84cbb ({username='slave'} at 127.0.0.1:49744)
I20260709 13:18:22.888007  6741 tablet_copy_service.cc:161] P ccd8a4c3bfe3413cb2ae219b09aea832: Beginning new tablet copy session on tablet 4b8cacb381b746da8d0049b0a83b41dd from peer 7ba59cc884714e8aa5f3f0ecaed84cbb at {username='slave'} at 127.0.0.1:49744: session id = 7ba59cc884714e8aa5f3f0ecaed84cbb-4b8cacb381b746da8d0049b0a83b41dd
I20260709 13:18:22.896222  6741 tablet_copy_source_session.cc:215] T 4b8cacb381b746da8d0049b0a83b41dd P ccd8a4c3bfe3413cb2ae219b09aea832: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:18:22.899598  7661 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4b8cacb381b746da8d0049b0a83b41dd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:22.922284  7661 tablet_copy_client.cc:806] T 4b8cacb381b746da8d0049b0a83b41dd P 7ba59cc884714e8aa5f3f0ecaed84cbb: tablet copy: Starting download of 0 data blocks...
I20260709 13:18:22.922941  7661 tablet_copy_client.cc:670] T 4b8cacb381b746da8d0049b0a83b41dd P 7ba59cc884714e8aa5f3f0ecaed84cbb: tablet copy: Starting download of 1 WAL segments...
I20260709 13:18:22.927203  7661 tablet_copy_client.cc:538] T 4b8cacb381b746da8d0049b0a83b41dd P 7ba59cc884714e8aa5f3f0ecaed84cbb: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:18:22.938050  7661 tablet_bootstrap.cc:492] T 4b8cacb381b746da8d0049b0a83b41dd P 7ba59cc884714e8aa5f3f0ecaed84cbb: Bootstrap starting.
I20260709 13:18:22.961306  7661 tablet_bootstrap.cc:492] T 4b8cacb381b746da8d0049b0a83b41dd P 7ba59cc884714e8aa5f3f0ecaed84cbb: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:18:22.962332  7661 tablet_bootstrap.cc:492] T 4b8cacb381b746da8d0049b0a83b41dd P 7ba59cc884714e8aa5f3f0ecaed84cbb: Bootstrap complete.
I20260709 13:18:22.963069  7661 ts_tablet_manager.cc:1403] T 4b8cacb381b746da8d0049b0a83b41dd P 7ba59cc884714e8aa5f3f0ecaed84cbb: Time spent bootstrapping tablet: real 0.025s	user 0.023s	sys 0.001s
I20260709 13:18:22.966445  7661 raft_consensus.cc:359] T 4b8cacb381b746da8d0049b0a83b41dd P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } attrs { replace: true } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: NON_VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: true } }
I20260709 13:18:22.967617  7661 raft_consensus.cc:740] T 4b8cacb381b746da8d0049b0a83b41dd P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 7ba59cc884714e8aa5f3f0ecaed84cbb, State: Initialized, Role: LEARNER
I20260709 13:18:22.968538  7661 consensus_queue.cc:260] T 4b8cacb381b746da8d0049b0a83b41dd P 7ba59cc884714e8aa5f3f0ecaed84cbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } attrs { replace: true } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: NON_VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: true } }
I20260709 13:18:22.970821  7664 ts_tablet_manager.cc:933] T 17587d6730594da4a56fa13a353232a1 P 7ba59cc884714e8aa5f3f0ecaed84cbb: Initiating tablet copy from peer b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:18:22.987632  7661 ts_tablet_manager.cc:1434] T 4b8cacb381b746da8d0049b0a83b41dd P 7ba59cc884714e8aa5f3f0ecaed84cbb: Time spent starting tablet: real 0.024s	user 0.008s	sys 0.013s
I20260709 13:18:22.989739  6741 tablet_copy_service.cc:342] P ccd8a4c3bfe3413cb2ae219b09aea832: Request end of tablet copy session 7ba59cc884714e8aa5f3f0ecaed84cbb-4b8cacb381b746da8d0049b0a83b41dd received from {username='slave'} at 127.0.0.1:49744
I20260709 13:18:22.990195  6741 tablet_copy_service.cc:434] P ccd8a4c3bfe3413cb2ae219b09aea832: ending tablet copy session 7ba59cc884714e8aa5f3f0ecaed84cbb-4b8cacb381b746da8d0049b0a83b41dd on tablet 4b8cacb381b746da8d0049b0a83b41dd with peer 7ba59cc884714e8aa5f3f0ecaed84cbb
I20260709 13:18:23.007854  7664 tablet_copy_client.cc:323] T 17587d6730594da4a56fa13a353232a1 P 7ba59cc884714e8aa5f3f0ecaed84cbb: tablet copy: Beginning tablet copy session from remote peer at address 127.5.126.66:42817
I20260709 13:18:23.010002  6817 tablet_copy_service.cc:140] P b7ab4784c7344b939bc36f639286f377: Received BeginTabletCopySession request for tablet 17587d6730594da4a56fa13a353232a1 from peer 7ba59cc884714e8aa5f3f0ecaed84cbb ({username='slave'} at 127.0.0.1:50550)
I20260709 13:18:23.010613  6817 tablet_copy_service.cc:161] P b7ab4784c7344b939bc36f639286f377: Beginning new tablet copy session on tablet 17587d6730594da4a56fa13a353232a1 from peer 7ba59cc884714e8aa5f3f0ecaed84cbb at {username='slave'} at 127.0.0.1:50550: session id = 7ba59cc884714e8aa5f3f0ecaed84cbb-17587d6730594da4a56fa13a353232a1
I20260709 13:18:23.018029  6817 tablet_copy_source_session.cc:215] T 17587d6730594da4a56fa13a353232a1 P b7ab4784c7344b939bc36f639286f377: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:18:23.020983  7664 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 17587d6730594da4a56fa13a353232a1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:23.041079  7664 tablet_copy_client.cc:806] T 17587d6730594da4a56fa13a353232a1 P 7ba59cc884714e8aa5f3f0ecaed84cbb: tablet copy: Starting download of 0 data blocks...
I20260709 13:18:23.041720  7664 tablet_copy_client.cc:670] T 17587d6730594da4a56fa13a353232a1 P 7ba59cc884714e8aa5f3f0ecaed84cbb: tablet copy: Starting download of 1 WAL segments...
I20260709 13:18:23.049345  7664 tablet_copy_client.cc:538] T 17587d6730594da4a56fa13a353232a1 P 7ba59cc884714e8aa5f3f0ecaed84cbb: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:18:23.058843  7664 tablet_bootstrap.cc:492] T 17587d6730594da4a56fa13a353232a1 P 7ba59cc884714e8aa5f3f0ecaed84cbb: Bootstrap starting.
I20260709 13:18:23.098714  7661 ts_tablet_manager.cc:933] T be1a92657f494cac8dd227d152f50151 P 7ba59cc884714e8aa5f3f0ecaed84cbb: Initiating tablet copy from peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391)
I20260709 13:18:23.101032  7664 tablet_bootstrap.cc:492] T 17587d6730594da4a56fa13a353232a1 P 7ba59cc884714e8aa5f3f0ecaed84cbb: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:18:23.102123  7664 tablet_bootstrap.cc:492] T 17587d6730594da4a56fa13a353232a1 P 7ba59cc884714e8aa5f3f0ecaed84cbb: Bootstrap complete.
I20260709 13:18:23.103214  7664 ts_tablet_manager.cc:1403] T 17587d6730594da4a56fa13a353232a1 P 7ba59cc884714e8aa5f3f0ecaed84cbb: Time spent bootstrapping tablet: real 0.044s	user 0.018s	sys 0.011s
I20260709 13:18:23.105261  7661 tablet_copy_client.cc:323] T be1a92657f494cac8dd227d152f50151 P 7ba59cc884714e8aa5f3f0ecaed84cbb: tablet copy: Beginning tablet copy session from remote peer at address 127.5.126.65:44391
I20260709 13:18:23.109115  6741 tablet_copy_service.cc:140] P ccd8a4c3bfe3413cb2ae219b09aea832: Received BeginTabletCopySession request for tablet be1a92657f494cac8dd227d152f50151 from peer 7ba59cc884714e8aa5f3f0ecaed84cbb ({username='slave'} at 127.0.0.1:49744)
I20260709 13:18:23.109687  6741 tablet_copy_service.cc:161] P ccd8a4c3bfe3413cb2ae219b09aea832: Beginning new tablet copy session on tablet be1a92657f494cac8dd227d152f50151 from peer 7ba59cc884714e8aa5f3f0ecaed84cbb at {username='slave'} at 127.0.0.1:49744: session id = 7ba59cc884714e8aa5f3f0ecaed84cbb-be1a92657f494cac8dd227d152f50151
I20260709 13:18:23.118232  6741 tablet_copy_source_session.cc:215] T be1a92657f494cac8dd227d152f50151 P ccd8a4c3bfe3413cb2ae219b09aea832: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:18:23.122042  7661 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet be1a92657f494cac8dd227d152f50151. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:23.119957  7664 raft_consensus.cc:359] T 17587d6730594da4a56fa13a353232a1 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 2 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } attrs { replace: true } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: NON_VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: true } }
I20260709 13:18:23.128803  7664 raft_consensus.cc:740] T 17587d6730594da4a56fa13a353232a1 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 2 LEARNER]: Becoming Follower/Learner. State: Replica: 7ba59cc884714e8aa5f3f0ecaed84cbb, State: Initialized, Role: LEARNER
I20260709 13:18:23.129652  7664 consensus_queue.cc:260] T 17587d6730594da4a56fa13a353232a1 P 7ba59cc884714e8aa5f3f0ecaed84cbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } attrs { replace: true } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: NON_VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: true } }
I20260709 13:18:23.174194  7664 ts_tablet_manager.cc:1434] T 17587d6730594da4a56fa13a353232a1 P 7ba59cc884714e8aa5f3f0ecaed84cbb: Time spent starting tablet: real 0.070s	user 0.002s	sys 0.005s
I20260709 13:18:23.184120  6817 tablet_copy_service.cc:342] P b7ab4784c7344b939bc36f639286f377: Request end of tablet copy session 7ba59cc884714e8aa5f3f0ecaed84cbb-17587d6730594da4a56fa13a353232a1 received from {username='slave'} at 127.0.0.1:50550
I20260709 13:18:23.184909  6817 tablet_copy_service.cc:434] P b7ab4784c7344b939bc36f639286f377: ending tablet copy session 7ba59cc884714e8aa5f3f0ecaed84cbb-17587d6730594da4a56fa13a353232a1 on tablet 17587d6730594da4a56fa13a353232a1 with peer 7ba59cc884714e8aa5f3f0ecaed84cbb
I20260709 13:18:23.228819  7661 tablet_copy_client.cc:806] T be1a92657f494cac8dd227d152f50151 P 7ba59cc884714e8aa5f3f0ecaed84cbb: tablet copy: Starting download of 0 data blocks...
I20260709 13:18:23.229741  7661 tablet_copy_client.cc:670] T be1a92657f494cac8dd227d152f50151 P 7ba59cc884714e8aa5f3f0ecaed84cbb: tablet copy: Starting download of 1 WAL segments...
I20260709 13:18:23.234335  7661 tablet_copy_client.cc:538] T be1a92657f494cac8dd227d152f50151 P 7ba59cc884714e8aa5f3f0ecaed84cbb: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:18:23.240100  7664 ts_tablet_manager.cc:933] T 4f00a2e87e56452083b759f60d461ee3 P 7ba59cc884714e8aa5f3f0ecaed84cbb: Initiating tablet copy from peer cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:18:23.247998  7661 tablet_bootstrap.cc:492] T be1a92657f494cac8dd227d152f50151 P 7ba59cc884714e8aa5f3f0ecaed84cbb: Bootstrap starting.
I20260709 13:18:23.264482  7664 tablet_copy_client.cc:323] T 4f00a2e87e56452083b759f60d461ee3 P 7ba59cc884714e8aa5f3f0ecaed84cbb: tablet copy: Beginning tablet copy session from remote peer at address 127.5.126.67:42931
I20260709 13:18:23.340994  7661 tablet_bootstrap.cc:492] T be1a92657f494cac8dd227d152f50151 P 7ba59cc884714e8aa5f3f0ecaed84cbb: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:18:23.342301  7661 tablet_bootstrap.cc:492] T be1a92657f494cac8dd227d152f50151 P 7ba59cc884714e8aa5f3f0ecaed84cbb: Bootstrap complete.
I20260709 13:18:23.343204  7661 ts_tablet_manager.cc:1403] T be1a92657f494cac8dd227d152f50151 P 7ba59cc884714e8aa5f3f0ecaed84cbb: Time spent bootstrapping tablet: real 0.095s	user 0.010s	sys 0.026s
I20260709 13:18:23.347157  7661 raft_consensus.cc:359] T be1a92657f494cac8dd227d152f50151 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } attrs { replace: true } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: NON_VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: true } }
I20260709 13:18:23.348286  7661 raft_consensus.cc:740] T be1a92657f494cac8dd227d152f50151 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 7ba59cc884714e8aa5f3f0ecaed84cbb, State: Initialized, Role: LEARNER
I20260709 13:18:23.349099  7661 consensus_queue.cc:260] T be1a92657f494cac8dd227d152f50151 P 7ba59cc884714e8aa5f3f0ecaed84cbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } attrs { replace: true } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: NON_VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: true } }
I20260709 13:18:23.355603  7661 ts_tablet_manager.cc:1434] T be1a92657f494cac8dd227d152f50151 P 7ba59cc884714e8aa5f3f0ecaed84cbb: Time spent starting tablet: real 0.012s	user 0.000s	sys 0.006s
I20260709 13:18:23.357667  6741 tablet_copy_service.cc:342] P ccd8a4c3bfe3413cb2ae219b09aea832: Request end of tablet copy session 7ba59cc884714e8aa5f3f0ecaed84cbb-be1a92657f494cac8dd227d152f50151 received from {username='slave'} at 127.0.0.1:49744
I20260709 13:18:23.358152  6741 tablet_copy_service.cc:434] P ccd8a4c3bfe3413cb2ae219b09aea832: ending tablet copy session 7ba59cc884714e8aa5f3f0ecaed84cbb-be1a92657f494cac8dd227d152f50151 on tablet be1a92657f494cac8dd227d152f50151 with peer 7ba59cc884714e8aa5f3f0ecaed84cbb
W20260709 13:18:23.345320  6695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 80243.3us
I20260709 13:18:23.392647  6891 tablet_copy_service.cc:140] P cd75a17ab2604397adab03bb8b5fd75c: Received BeginTabletCopySession request for tablet 4f00a2e87e56452083b759f60d461ee3 from peer 7ba59cc884714e8aa5f3f0ecaed84cbb ({username='slave'} at 127.0.0.1:58592)
I20260709 13:18:23.393371  6891 tablet_copy_service.cc:161] P cd75a17ab2604397adab03bb8b5fd75c: Beginning new tablet copy session on tablet 4f00a2e87e56452083b759f60d461ee3 from peer 7ba59cc884714e8aa5f3f0ecaed84cbb at {username='slave'} at 127.0.0.1:58592: session id = 7ba59cc884714e8aa5f3f0ecaed84cbb-4f00a2e87e56452083b759f60d461ee3
I20260709 13:18:23.399046  7503 raft_consensus.cc:1217] T 4b8cacb381b746da8d0049b0a83b41dd P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:18:23.408876  6891 tablet_copy_source_session.cc:215] T 4f00a2e87e56452083b759f60d461ee3 P cd75a17ab2604397adab03bb8b5fd75c: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:18:23.418639  7664 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4f00a2e87e56452083b759f60d461ee3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:23.457423  7664 tablet_copy_client.cc:806] T 4f00a2e87e56452083b759f60d461ee3 P 7ba59cc884714e8aa5f3f0ecaed84cbb: tablet copy: Starting download of 0 data blocks...
I20260709 13:18:23.459326  7664 tablet_copy_client.cc:670] T 4f00a2e87e56452083b759f60d461ee3 P 7ba59cc884714e8aa5f3f0ecaed84cbb: tablet copy: Starting download of 1 WAL segments...
I20260709 13:18:23.464409  7664 tablet_copy_client.cc:538] T 4f00a2e87e56452083b759f60d461ee3 P 7ba59cc884714e8aa5f3f0ecaed84cbb: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:18:23.482398  7664 tablet_bootstrap.cc:492] T 4f00a2e87e56452083b759f60d461ee3 P 7ba59cc884714e8aa5f3f0ecaed84cbb: Bootstrap starting.
I20260709 13:18:23.542312  7664 tablet_bootstrap.cc:492] T 4f00a2e87e56452083b759f60d461ee3 P 7ba59cc884714e8aa5f3f0ecaed84cbb: Bootstrap replayed 1/1 log segments. Stats: ops{read=3 overwritten=0 applied=3 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:18:23.543355  7664 tablet_bootstrap.cc:492] T 4f00a2e87e56452083b759f60d461ee3 P 7ba59cc884714e8aa5f3f0ecaed84cbb: Bootstrap complete.
I20260709 13:18:23.544086  7664 ts_tablet_manager.cc:1403] T 4f00a2e87e56452083b759f60d461ee3 P 7ba59cc884714e8aa5f3f0ecaed84cbb: Time spent bootstrapping tablet: real 0.062s	user 0.022s	sys 0.009s
I20260709 13:18:23.547245  7664 raft_consensus.cc:359] T 4f00a2e87e56452083b759f60d461ee3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 3 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } attrs { replace: true } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: NON_VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: true } }
I20260709 13:18:23.549337  7664 raft_consensus.cc:740] T 4f00a2e87e56452083b759f60d461ee3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 3 LEARNER]: Becoming Follower/Learner. State: Replica: 7ba59cc884714e8aa5f3f0ecaed84cbb, State: Initialized, Role: LEARNER
I20260709 13:18:23.550110  7664 consensus_queue.cc:260] T 4f00a2e87e56452083b759f60d461ee3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } attrs { replace: true } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: NON_VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: true } }
I20260709 13:18:23.559314  7664 ts_tablet_manager.cc:1434] T 4f00a2e87e56452083b759f60d461ee3 P 7ba59cc884714e8aa5f3f0ecaed84cbb: Time spent starting tablet: real 0.015s	user 0.004s	sys 0.002s
I20260709 13:18:23.564922  6891 tablet_copy_service.cc:342] P cd75a17ab2604397adab03bb8b5fd75c: Request end of tablet copy session 7ba59cc884714e8aa5f3f0ecaed84cbb-4f00a2e87e56452083b759f60d461ee3 received from {username='slave'} at 127.0.0.1:58592
I20260709 13:18:23.565479  6891 tablet_copy_service.cc:434] P cd75a17ab2604397adab03bb8b5fd75c: ending tablet copy session 7ba59cc884714e8aa5f3f0ecaed84cbb-4f00a2e87e56452083b759f60d461ee3 on tablet 4f00a2e87e56452083b759f60d461ee3 with peer 7ba59cc884714e8aa5f3f0ecaed84cbb
I20260709 13:18:23.576442  7503 raft_consensus.cc:1217] T be1a92657f494cac8dd227d152f50151 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
W20260709 13:18:23.600804  6772 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 147160us
I20260709 13:18:23.610193  7503 raft_consensus.cc:1217] T 17587d6730594da4a56fa13a353232a1 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 2 LEARNER]: Deduplicated request from leader. Original: 2.1->[2.2-2.2]   Dedup: 2.2->[]
I20260709 13:18:23.626093  7503 raft_consensus.cc:1217] T 4f00a2e87e56452083b759f60d461ee3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 3 LEARNER]: Deduplicated request from leader. Original: 3.2->[3.3-3.3]   Dedup: 3.3->[]
I20260709 13:18:23.877177  7674 raft_consensus.cc:1064] T 4b8cacb381b746da8d0049b0a83b41dd P ccd8a4c3bfe3413cb2ae219b09aea832: attempting to promote NON_VOTER 7ba59cc884714e8aa5f3f0ecaed84cbb to VOTER
I20260709 13:18:23.880672  7674 consensus_queue.cc:237] T 4b8cacb381b746da8d0049b0a83b41dd P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } attrs { replace: true } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:18:24.025267  7503 raft_consensus.cc:1275] T 4b8cacb381b746da8d0049b0a83b41dd P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 1 LEARNER]: Refusing update from remote peer ccd8a4c3bfe3413cb2ae219b09aea832: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:18:24.027273  7599 consensus_queue.cc:1048] T 4b8cacb381b746da8d0049b0a83b41dd P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:18:24.037577  6874 raft_consensus.cc:1275] T 4b8cacb381b746da8d0049b0a83b41dd P cd75a17ab2604397adab03bb8b5fd75c [term 1 FOLLOWER]: Refusing update from remote peer ccd8a4c3bfe3413cb2ae219b09aea832: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:18:24.038345  6802 raft_consensus.cc:1275] T 4b8cacb381b746da8d0049b0a83b41dd P b7ab4784c7344b939bc36f639286f377 [term 1 FOLLOWER]: Refusing update from remote peer ccd8a4c3bfe3413cb2ae219b09aea832: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:18:24.039906  7655 consensus_queue.cc:1048] T 4b8cacb381b746da8d0049b0a83b41dd P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:18:24.040843  7657 consensus_queue.cc:1048] T 4b8cacb381b746da8d0049b0a83b41dd P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:18:24.053766  7647 raft_consensus.cc:1064] T 17587d6730594da4a56fa13a353232a1 P b7ab4784c7344b939bc36f639286f377: attempting to promote NON_VOTER 7ba59cc884714e8aa5f3f0ecaed84cbb to VOTER
I20260709 13:18:24.067310  7647 consensus_queue.cc:237] T 17587d6730594da4a56fa13a353232a1 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 0, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } attrs { replace: true } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:18:24.103747  7657 raft_consensus.cc:2955] T 4b8cacb381b746da8d0049b0a83b41dd P ccd8a4c3bfe3413cb2ae219b09aea832 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } attrs { replace: true } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } } }
I20260709 13:18:24.128902  6800 raft_consensus.cc:2955] T 4b8cacb381b746da8d0049b0a83b41dd P b7ab4784c7344b939bc36f639286f377 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } attrs { replace: true } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } } }
I20260709 13:18:24.141577  6874 raft_consensus.cc:2955] T 4b8cacb381b746da8d0049b0a83b41dd P cd75a17ab2604397adab03bb8b5fd75c [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } attrs { replace: true } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } } }
I20260709 13:18:24.167222  6629 catalog_manager.cc:5697] T 4b8cacb381b746da8d0049b0a83b41dd P b7ab4784c7344b939bc36f639286f377 reported cstate change: config changed from index 2 to 3, 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } attrs { replace: true } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } } }
I20260709 13:18:24.185923  7501 raft_consensus.cc:1275] T 17587d6730594da4a56fa13a353232a1 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 2 LEARNER]: Refusing update from remote peer b7ab4784c7344b939bc36f639286f377: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:18:24.187783  6877 raft_consensus.cc:1275] T 17587d6730594da4a56fa13a353232a1 P cd75a17ab2604397adab03bb8b5fd75c [term 2 FOLLOWER]: Refusing update from remote peer b7ab4784c7344b939bc36f639286f377: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:18:24.191697  7649 consensus_queue.cc:1048] T 17587d6730594da4a56fa13a353232a1 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:18:24.207015  7672 consensus_queue.cc:1048] T 17587d6730594da4a56fa13a353232a1 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:18:24.207636  6729 raft_consensus.cc:1275] T 17587d6730594da4a56fa13a353232a1 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 2 FOLLOWER]: Refusing update from remote peer b7ab4784c7344b939bc36f639286f377: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:18:24.217259  7648 consensus_queue.cc:1048] T 17587d6730594da4a56fa13a353232a1 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:18:24.259687  7500 raft_consensus.cc:2955] T 4b8cacb381b746da8d0049b0a83b41dd P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } attrs { replace: true } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } } }
I20260709 13:18:24.299741  7597 raft_consensus.cc:1064] T be1a92657f494cac8dd227d152f50151 P ccd8a4c3bfe3413cb2ae219b09aea832: attempting to promote NON_VOTER 7ba59cc884714e8aa5f3f0ecaed84cbb to VOTER
I20260709 13:18:24.303985  7597 consensus_queue.cc:237] T be1a92657f494cac8dd227d152f50151 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } attrs { replace: true } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:18:24.329105  7649 raft_consensus.cc:2955] T 17587d6730594da4a56fa13a353232a1 P b7ab4784c7344b939bc36f639286f377 [term 2 LEADER]: Committing config change with OpId 2.3: config changed from index 2 to 3, 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } attrs { replace: true } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } } }
I20260709 13:18:24.340245  6729 raft_consensus.cc:2955] T 17587d6730594da4a56fa13a353232a1 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index 2 to 3, 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } attrs { replace: true } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } } }
I20260709 13:18:24.357630  7656 raft_consensus.cc:1064] T 4f00a2e87e56452083b759f60d461ee3 P cd75a17ab2604397adab03bb8b5fd75c: attempting to promote NON_VOTER 7ba59cc884714e8aa5f3f0ecaed84cbb to VOTER
I20260709 13:18:24.361264  7656 consensus_queue.cc:237] T 4f00a2e87e56452083b759f60d461ee3 P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 1, Current term: 3, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } attrs { replace: true } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:18:24.354835  7502 raft_consensus.cc:2955] T 17587d6730594da4a56fa13a353232a1 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index 2 to 3, 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } attrs { replace: true } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } } }
I20260709 13:18:24.376664  6877 raft_consensus.cc:2955] T 17587d6730594da4a56fa13a353232a1 P cd75a17ab2604397adab03bb8b5fd75c [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index 2 to 3, 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } attrs { replace: true } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } } }
I20260709 13:18:24.399109  7501 raft_consensus.cc:1275] T be1a92657f494cac8dd227d152f50151 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 1 LEARNER]: Refusing update from remote peer ccd8a4c3bfe3413cb2ae219b09aea832: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:18:24.404121  7674 consensus_queue.cc:1048] T be1a92657f494cac8dd227d152f50151 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:18:24.489074  6800 raft_consensus.cc:1275] T be1a92657f494cac8dd227d152f50151 P b7ab4784c7344b939bc36f639286f377 [term 1 FOLLOWER]: Refusing update from remote peer ccd8a4c3bfe3413cb2ae219b09aea832: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:18:24.493273  7502 raft_consensus.cc:1275] T 4f00a2e87e56452083b759f60d461ee3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 3 LEARNER]: Refusing update from remote peer cd75a17ab2604397adab03bb8b5fd75c: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:18:24.486060  6630 catalog_manager.cc:5697] T 17587d6730594da4a56fa13a353232a1 P b7ab4784c7344b939bc36f639286f377 reported cstate change: config changed from index 2 to 3, 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68) changed from NON_VOTER to VOTER. New cstate: current_term: 2 leader_uuid: "b7ab4784c7344b939bc36f639286f377" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:18:24.494477  6802 raft_consensus.cc:1275] T 4f00a2e87e56452083b759f60d461ee3 P b7ab4784c7344b939bc36f639286f377 [term 3 FOLLOWER]: Refusing update from remote peer cd75a17ab2604397adab03bb8b5fd75c: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:18:24.502318  7657 consensus_queue.cc:1048] T be1a92657f494cac8dd227d152f50151 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:18:24.506800  6729 raft_consensus.cc:1275] T 4f00a2e87e56452083b759f60d461ee3 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 3 FOLLOWER]: Refusing update from remote peer cd75a17ab2604397adab03bb8b5fd75c: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:18:24.505131  7656 consensus_queue.cc:1048] T 4f00a2e87e56452083b759f60d461ee3 P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.006s
I20260709 13:18:24.513584  6874 raft_consensus.cc:1275] T be1a92657f494cac8dd227d152f50151 P cd75a17ab2604397adab03bb8b5fd75c [term 1 FOLLOWER]: Refusing update from remote peer ccd8a4c3bfe3413cb2ae219b09aea832: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:18:24.514390  7577 consensus_queue.cc:1048] T 4f00a2e87e56452083b759f60d461ee3 P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:18:24.516167  7686 consensus_queue.cc:1048] T 4f00a2e87e56452083b759f60d461ee3 P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Connected to new peer: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:18:24.517964  7657 consensus_queue.cc:1048] T be1a92657f494cac8dd227d152f50151 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:18:24.543061  7697 raft_consensus.cc:2955] T be1a92657f494cac8dd227d152f50151 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } attrs { replace: true } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } } }
I20260709 13:18:24.545001  6800 raft_consensus.cc:2955] T be1a92657f494cac8dd227d152f50151 P b7ab4784c7344b939bc36f639286f377 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } attrs { replace: true } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } } }
I20260709 13:18:24.557735  7577 raft_consensus.cc:2955] T 4f00a2e87e56452083b759f60d461ee3 P cd75a17ab2604397adab03bb8b5fd75c [term 3 LEADER]: Committing config change with OpId 3.4: config changed from index 3 to 4, 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } attrs { replace: true } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } } }
I20260709 13:18:24.622435  6728 consensus_queue.cc:237] T 4b8cacb381b746da8d0049b0a83b41dd P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:18:24.625742  7501 raft_consensus.cc:2955] T be1a92657f494cac8dd227d152f50151 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } attrs { replace: true } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } } }
I20260709 13:18:24.627427  6802 consensus_queue.cc:237] T 17587d6730594da4a56fa13a353232a1 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:18:24.638339  7502 raft_consensus.cc:1275] T 17587d6730594da4a56fa13a353232a1 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 2 FOLLOWER]: Refusing update from remote peer b7ab4784c7344b939bc36f639286f377: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 13:18:24.641057  6728 raft_consensus.cc:2955] T 4f00a2e87e56452083b759f60d461ee3 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 3 FOLLOWER]: Committing config change with OpId 3.4: config changed from index 3 to 4, 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } attrs { replace: true } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } } }
I20260709 13:18:24.643889  7694 consensus_queue.cc:1048] T 17587d6730594da4a56fa13a353232a1 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:18:24.649212  7502 raft_consensus.cc:2955] T 4f00a2e87e56452083b759f60d461ee3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 3 FOLLOWER]: Committing config change with OpId 3.4: config changed from index 3 to 4, 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } attrs { replace: true } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } } }
I20260709 13:18:24.657518  7500 raft_consensus.cc:1275] T 4b8cacb381b746da8d0049b0a83b41dd P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 1 FOLLOWER]: Refusing update from remote peer ccd8a4c3bfe3413cb2ae219b09aea832: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:18:24.658037  6877 raft_consensus.cc:1275] T 4b8cacb381b746da8d0049b0a83b41dd P cd75a17ab2604397adab03bb8b5fd75c [term 1 FOLLOWER]: Refusing update from remote peer ccd8a4c3bfe3413cb2ae219b09aea832: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:18:24.666118  7697 consensus_queue.cc:1048] T 4b8cacb381b746da8d0049b0a83b41dd P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:18:24.670185  6729 raft_consensus.cc:1275] T 17587d6730594da4a56fa13a353232a1 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 2 FOLLOWER]: Refusing update from remote peer b7ab4784c7344b939bc36f639286f377: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 13:18:24.669919  6627 catalog_manager.cc:5697] T be1a92657f494cac8dd227d152f50151 P 7ba59cc884714e8aa5f3f0ecaed84cbb reported cstate change: config changed from index 2 to 3, 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } attrs { replace: true } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } } }
I20260709 13:18:24.671267  7698 consensus_queue.cc:1048] T 4b8cacb381b746da8d0049b0a83b41dd P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:18:24.676997  6877 raft_consensus.cc:2955] T be1a92657f494cac8dd227d152f50151 P cd75a17ab2604397adab03bb8b5fd75c [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } attrs { replace: true } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } } }
I20260709 13:18:24.678952  7648 consensus_queue.cc:1048] T 17587d6730594da4a56fa13a353232a1 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:18:24.679260  6802 raft_consensus.cc:2955] T 4f00a2e87e56452083b759f60d461ee3 P b7ab4784c7344b939bc36f639286f377 [term 3 FOLLOWER]: Committing config change with OpId 3.4: config changed from index 3 to 4, 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } attrs { replace: true } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } } }
I20260709 13:18:24.691768  6628 catalog_manager.cc:5697] T 4f00a2e87e56452083b759f60d461ee3 P cd75a17ab2604397adab03bb8b5fd75c reported cstate change: config changed from index 3 to 4, 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68) changed from NON_VOTER to VOTER. New cstate: current_term: 3 leader_uuid: "cd75a17ab2604397adab03bb8b5fd75c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:18:24.701112  7672 raft_consensus.cc:2955] T 17587d6730594da4a56fa13a353232a1 P b7ab4784c7344b939bc36f639286f377 [term 2 LEADER]: Committing config change with OpId 2.4: config changed from index 3 to 4, VOTER cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } } }
I20260709 13:18:24.710980  6728 consensus_queue.cc:237] T be1a92657f494cac8dd227d152f50151 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:18:24.725487  7699 raft_consensus.cc:2955] T 4b8cacb381b746da8d0049b0a83b41dd P ccd8a4c3bfe3413cb2ae219b09aea832 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b7ab4784c7344b939bc36f639286f377 (127.5.126.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } } }
I20260709 13:18:24.737160  7502 raft_consensus.cc:2955] T 17587d6730594da4a56fa13a353232a1 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, VOTER cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } } }
I20260709 13:18:24.746357  6614 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 4b8cacb381b746da8d0049b0a83b41dd with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:18:24.750211  6877 consensus_queue.cc:237] T 4f00a2e87e56452083b759f60d461ee3 P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.4, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:18:24.751770  6800 raft_consensus.cc:1275] T be1a92657f494cac8dd227d152f50151 P b7ab4784c7344b939bc36f639286f377 [term 1 FOLLOWER]: Refusing update from remote peer ccd8a4c3bfe3413cb2ae219b09aea832: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:18:24.751510  6729 raft_consensus.cc:2955] T 17587d6730594da4a56fa13a353232a1 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, VOTER cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } } }
I20260709 13:18:24.770399  6630 catalog_manager.cc:5697] T 17587d6730594da4a56fa13a353232a1 P 7ba59cc884714e8aa5f3f0ecaed84cbb reported cstate change: config changed from index 3 to 4, VOTER cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67) evicted. New cstate: current_term: 2 leader_uuid: "b7ab4784c7344b939bc36f639286f377" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } } }
I20260709 13:18:24.758764  7500 raft_consensus.cc:1275] T be1a92657f494cac8dd227d152f50151 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 1 FOLLOWER]: Refusing update from remote peer ccd8a4c3bfe3413cb2ae219b09aea832: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:18:24.758752  6875 raft_consensus.cc:2955] T 4b8cacb381b746da8d0049b0a83b41dd P cd75a17ab2604397adab03bb8b5fd75c [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b7ab4784c7344b939bc36f639286f377 (127.5.126.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } } }
I20260709 13:18:24.760660  6614 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 17587d6730594da4a56fa13a353232a1 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:18:24.786864  7500 raft_consensus.cc:1275] T 4f00a2e87e56452083b759f60d461ee3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 3 FOLLOWER]: Refusing update from remote peer cd75a17ab2604397adab03bb8b5fd75c: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:18:24.788489  6867 tablet_service.cc:1558] Processing DeleteTablet for tablet 17587d6730594da4a56fa13a353232a1 with delete_type TABLET_DATA_TOMBSTONED (TS cd75a17ab2604397adab03bb8b5fd75c not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:53394
I20260709 13:18:24.790601  7688 consensus_queue.cc:1048] T 4f00a2e87e56452083b759f60d461ee3 P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:18:24.808982  7656 raft_consensus.cc:2955] T 4f00a2e87e56452083b759f60d461ee3 P cd75a17ab2604397adab03bb8b5fd75c [term 3 LEADER]: Committing config change with OpId 3.5: config changed from index 4 to 5, VOTER ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } } }
I20260709 13:18:24.815465  6800 raft_consensus.cc:1275] T 4f00a2e87e56452083b759f60d461ee3 P b7ab4784c7344b939bc36f639286f377 [term 3 FOLLOWER]: Refusing update from remote peer cd75a17ab2604397adab03bb8b5fd75c: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:18:24.818511  7502 raft_consensus.cc:2955] T 4f00a2e87e56452083b759f60d461ee3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 3 FOLLOWER]: Committing config change with OpId 3.5: config changed from index 4 to 5, VOTER ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } } }
I20260709 13:18:24.837383  7707 tablet_replica.cc:333] T 17587d6730594da4a56fa13a353232a1 P cd75a17ab2604397adab03bb8b5fd75c: stopping tablet replica
I20260709 13:18:24.840610  7686 consensus_queue.cc:1048] T 4f00a2e87e56452083b759f60d461ee3 P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:18:24.844523  7500 raft_consensus.cc:2955] T 4b8cacb381b746da8d0049b0a83b41dd P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b7ab4784c7344b939bc36f639286f377 (127.5.126.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } } }
I20260709 13:18:24.841975  6626 catalog_manager.cc:5697] T 4b8cacb381b746da8d0049b0a83b41dd P cd75a17ab2604397adab03bb8b5fd75c reported cstate change: config changed from index 3 to 4, VOTER b7ab4784c7344b939bc36f639286f377 (127.5.126.66) evicted. New cstate: current_term: 1 leader_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } } }
I20260709 13:18:24.843598  7657 consensus_queue.cc:1048] T be1a92657f494cac8dd227d152f50151 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:18:24.857972  6616 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 4f00a2e87e56452083b759f60d461ee3 with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:18:24.861654  6800 raft_consensus.cc:2955] T 4f00a2e87e56452083b759f60d461ee3 P b7ab4784c7344b939bc36f639286f377 [term 3 FOLLOWER]: Committing config change with OpId 3.5: config changed from index 4 to 5, VOTER ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } } }
I20260709 13:18:24.877147  7698 consensus_queue.cc:1048] T be1a92657f494cac8dd227d152f50151 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:18:24.877511  7707 raft_consensus.cc:2243] T 17587d6730594da4a56fa13a353232a1 P cd75a17ab2604397adab03bb8b5fd75c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:24.877401  6628 catalog_manager.cc:5697] T 4f00a2e87e56452083b759f60d461ee3 P cd75a17ab2604397adab03bb8b5fd75c reported cstate change: config changed from index 4 to 5, VOTER ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65) evicted. New cstate: current_term: 3 leader_uuid: "cd75a17ab2604397adab03bb8b5fd75c" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:18:24.878547  7707 raft_consensus.cc:2272] T 17587d6730594da4a56fa13a353232a1 P cd75a17ab2604397adab03bb8b5fd75c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:24.890895  6790 tablet_service.cc:1558] Processing DeleteTablet for tablet 4b8cacb381b746da8d0049b0a83b41dd with delete_type TABLET_DATA_TOMBSTONED (TS b7ab4784c7344b939bc36f639286f377 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:32964
I20260709 13:18:24.898187  7707 ts_tablet_manager.cc:1916] T 17587d6730594da4a56fa13a353232a1 P cd75a17ab2604397adab03bb8b5fd75c: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:18:24.900319  6719 tablet_service.cc:1558] Processing DeleteTablet for tablet 4f00a2e87e56452083b759f60d461ee3 with delete_type TABLET_DATA_TOMBSTONED (TS ccd8a4c3bfe3413cb2ae219b09aea832 not found in new config with opid_index 5) from {username='slave'} at 127.0.0.1:49996
I20260709 13:18:24.906293  7698 raft_consensus.cc:2955] T be1a92657f494cac8dd227d152f50151 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } } }
I20260709 13:18:24.912784  7708 tablet_replica.cc:333] T 4b8cacb381b746da8d0049b0a83b41dd P b7ab4784c7344b939bc36f639286f377: stopping tablet replica
I20260709 13:18:24.914239  7708 raft_consensus.cc:2243] T 4b8cacb381b746da8d0049b0a83b41dd P b7ab4784c7344b939bc36f639286f377 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:24.917091  7708 raft_consensus.cc:2272] T 4b8cacb381b746da8d0049b0a83b41dd P b7ab4784c7344b939bc36f639286f377 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:24.921867  7708 ts_tablet_manager.cc:1916] T 4b8cacb381b746da8d0049b0a83b41dd P b7ab4784c7344b939bc36f639286f377: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:18:24.925638  7709 tablet_replica.cc:333] T 4f00a2e87e56452083b759f60d461ee3 P ccd8a4c3bfe3413cb2ae219b09aea832: stopping tablet replica
I20260709 13:18:24.929128  7709 raft_consensus.cc:2243] T 4f00a2e87e56452083b759f60d461ee3 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:24.930347  7709 raft_consensus.cc:2272] T 4f00a2e87e56452083b759f60d461ee3 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:24.934796  7709 ts_tablet_manager.cc:1916] T 4f00a2e87e56452083b759f60d461ee3 P ccd8a4c3bfe3413cb2ae219b09aea832: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
W20260709 13:18:24.946072  6697 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 55679.4us
I20260709 13:18:24.945645  6800 raft_consensus.cc:2955] T be1a92657f494cac8dd227d152f50151 P b7ab4784c7344b939bc36f639286f377 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } } }
I20260709 13:18:24.964453  7707 ts_tablet_manager.cc:1929] T 17587d6730594da4a56fa13a353232a1 P cd75a17ab2604397adab03bb8b5fd75c: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 2.3
I20260709 13:18:24.965046  7707 log.cc:1199] T 17587d6730594da4a56fa13a353232a1 P cd75a17ab2604397adab03bb8b5fd75c: Deleting WAL directory at /tmp/dist-test-taskWHb0CB/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783603057096655-5625-0/minicluster-data/ts-2-root/wals/17587d6730594da4a56fa13a353232a1
I20260709 13:18:24.967900  6616 catalog_manager.cc:5028] TS cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931): tablet 17587d6730594da4a56fa13a353232a1 (table test-workload [id=04f4d366747e43549980077479ed75b9]) successfully deleted
I20260709 13:18:24.977476  6614 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet be1a92657f494cac8dd227d152f50151 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:18:24.988909  6626 catalog_manager.cc:5697] T be1a92657f494cac8dd227d152f50151 P b7ab4784c7344b939bc36f639286f377 reported cstate change: config changed from index 3 to 4, VOTER cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67) evicted. New cstate: current_term: 1 leader_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } } }
I20260709 13:18:25.002843  7709 ts_tablet_manager.cc:1929] T 4f00a2e87e56452083b759f60d461ee3 P ccd8a4c3bfe3413cb2ae219b09aea832: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 3.4
I20260709 13:18:25.003602  7709 log.cc:1199] T 4f00a2e87e56452083b759f60d461ee3 P ccd8a4c3bfe3413cb2ae219b09aea832: Deleting WAL directory at /tmp/dist-test-taskWHb0CB/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783603057096655-5625-0/minicluster-data/ts-0-root/wals/4f00a2e87e56452083b759f60d461ee3
I20260709 13:18:25.006557  6614 catalog_manager.cc:5028] TS ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): tablet 4f00a2e87e56452083b759f60d461ee3 (table test-workload [id=04f4d366747e43549980077479ed75b9]) successfully deleted
I20260709 13:18:25.006975  6867 tablet_service.cc:1558] Processing DeleteTablet for tablet be1a92657f494cac8dd227d152f50151 with delete_type TABLET_DATA_TOMBSTONED (TS cd75a17ab2604397adab03bb8b5fd75c not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:53394
I20260709 13:18:25.008225  7707 tablet_replica.cc:333] T be1a92657f494cac8dd227d152f50151 P cd75a17ab2604397adab03bb8b5fd75c: stopping tablet replica
I20260709 13:18:25.009466  7707 raft_consensus.cc:2243] T be1a92657f494cac8dd227d152f50151 P cd75a17ab2604397adab03bb8b5fd75c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:25.010264  7707 raft_consensus.cc:2272] T be1a92657f494cac8dd227d152f50151 P cd75a17ab2604397adab03bb8b5fd75c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:25.016654  7500 raft_consensus.cc:2955] T be1a92657f494cac8dd227d152f50151 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } } }
I20260709 13:18:25.029043  7707 ts_tablet_manager.cc:1916] T be1a92657f494cac8dd227d152f50151 P cd75a17ab2604397adab03bb8b5fd75c: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:18:25.054302  7708 ts_tablet_manager.cc:1929] T 4b8cacb381b746da8d0049b0a83b41dd P b7ab4784c7344b939bc36f639286f377: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:18:25.054776  7708 log.cc:1199] T 4b8cacb381b746da8d0049b0a83b41dd P b7ab4784c7344b939bc36f639286f377: Deleting WAL directory at /tmp/dist-test-taskWHb0CB/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783603057096655-5625-0/minicluster-data/ts-1-root/wals/4b8cacb381b746da8d0049b0a83b41dd
I20260709 13:18:25.058488  6614 catalog_manager.cc:5028] TS b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817): tablet 4b8cacb381b746da8d0049b0a83b41dd (table test-workload [id=04f4d366747e43549980077479ed75b9]) successfully deleted
I20260709 13:18:25.066682  7707 ts_tablet_manager.cc:1929] T be1a92657f494cac8dd227d152f50151 P cd75a17ab2604397adab03bb8b5fd75c: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:18:25.067217  7707 log.cc:1199] T be1a92657f494cac8dd227d152f50151 P cd75a17ab2604397adab03bb8b5fd75c: Deleting WAL directory at /tmp/dist-test-taskWHb0CB/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783603057096655-5625-0/minicluster-data/ts-2-root/wals/be1a92657f494cac8dd227d152f50151
I20260709 13:18:25.069343  6616 catalog_manager.cc:5028] TS cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931): tablet be1a92657f494cac8dd227d152f50151 (table test-workload [id=04f4d366747e43549980077479ed75b9]) successfully deleted
I20260709 13:18:26.111824  6728 consensus_queue.cc:237] T 3fa34c08b205435dba97346991aa1f92 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } attrs { replace: true } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: NON_VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: true } }
W20260709 13:18:26.119654  6697 consensus_peers.cc:597] T 3fa34c08b205435dba97346991aa1f92 P ccd8a4c3bfe3413cb2ae219b09aea832 -> Peer 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071): Couldn't send request to peer 7ba59cc884714e8aa5f3f0ecaed84cbb. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 3fa34c08b205435dba97346991aa1f92. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:26.122000  6804 raft_consensus.cc:1275] T 3fa34c08b205435dba97346991aa1f92 P b7ab4784c7344b939bc36f639286f377 [term 1 FOLLOWER]: Refusing update from remote peer ccd8a4c3bfe3413cb2ae219b09aea832: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:18:26.122500  6877 raft_consensus.cc:1275] T 3fa34c08b205435dba97346991aa1f92 P cd75a17ab2604397adab03bb8b5fd75c [term 1 FOLLOWER]: Refusing update from remote peer ccd8a4c3bfe3413cb2ae219b09aea832: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:18:26.123529  7690 consensus_queue.cc:1048] T 3fa34c08b205435dba97346991aa1f92 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:18:26.125273  7697 consensus_queue.cc:1048] T 3fa34c08b205435dba97346991aa1f92 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:18:26.162813  7657 raft_consensus.cc:2955] T 3fa34c08b205435dba97346991aa1f92 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } attrs { replace: true } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: NON_VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: true } } }
I20260709 13:18:26.165536  6800 raft_consensus.cc:2955] T 3fa34c08b205435dba97346991aa1f92 P b7ab4784c7344b939bc36f639286f377 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } attrs { replace: true } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: NON_VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: true } } }
I20260709 13:18:26.177431  6804 consensus_queue.cc:237] T bb7fa124c3bf4ef9ab65a407cb008441 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } attrs { replace: true } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: NON_VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: true } }
I20260709 13:18:26.174265  6877 raft_consensus.cc:2955] T 3fa34c08b205435dba97346991aa1f92 P cd75a17ab2604397adab03bb8b5fd75c [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } attrs { replace: true } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: NON_VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: true } } }
W20260709 13:18:26.188550  6772 consensus_peers.cc:597] T bb7fa124c3bf4ef9ab65a407cb008441 P b7ab4784c7344b939bc36f639286f377 -> Peer 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071): Couldn't send request to peer 7ba59cc884714e8aa5f3f0ecaed84cbb. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: bb7fa124c3bf4ef9ab65a407cb008441. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:26.189874  6729 raft_consensus.cc:1275] T bb7fa124c3bf4ef9ab65a407cb008441 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 1 FOLLOWER]: Refusing update from remote peer b7ab4784c7344b939bc36f639286f377: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:18:26.191499  6628 catalog_manager.cc:5697] T 3fa34c08b205435dba97346991aa1f92 P b7ab4784c7344b939bc36f639286f377 reported cstate change: config changed from index -1 to 2, NON_VOTER 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68) added. New cstate: current_term: 1 leader_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } attrs { replace: true } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: NON_VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: true } } }
I20260709 13:18:26.192615  7694 consensus_queue.cc:1048] T bb7fa124c3bf4ef9ab65a407cb008441 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:18:26.190151  6874 raft_consensus.cc:1275] T bb7fa124c3bf4ef9ab65a407cb008441 P cd75a17ab2604397adab03bb8b5fd75c [term 1 FOLLOWER]: Refusing update from remote peer b7ab4784c7344b939bc36f639286f377: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:18:26.213383  7694 consensus_queue.cc:1048] T bb7fa124c3bf4ef9ab65a407cb008441 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:18:26.223346  7647 raft_consensus.cc:2955] T bb7fa124c3bf4ef9ab65a407cb008441 P b7ab4784c7344b939bc36f639286f377 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } attrs { replace: true } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: NON_VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: true } } }
I20260709 13:18:26.234465  6728 raft_consensus.cc:2955] T bb7fa124c3bf4ef9ab65a407cb008441 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } attrs { replace: true } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: NON_VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: true } } }
I20260709 13:18:26.266950  6874 raft_consensus.cc:2955] T bb7fa124c3bf4ef9ab65a407cb008441 P cd75a17ab2604397adab03bb8b5fd75c [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } attrs { replace: true } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: NON_VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: true } } }
I20260709 13:18:26.266773  6729 consensus_queue.cc:237] T fe20b4b48823486ca3b9c648db6ce8aa P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } attrs { replace: true } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: NON_VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: true } }
I20260709 13:18:26.287411  6628 catalog_manager.cc:5697] T bb7fa124c3bf4ef9ab65a407cb008441 P cd75a17ab2604397adab03bb8b5fd75c reported cstate change: config changed from index -1 to 2, NON_VOTER 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68) added. New cstate: current_term: 1 leader_uuid: "b7ab4784c7344b939bc36f639286f377" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } attrs { replace: true } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: NON_VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: true } } }
W20260709 13:18:26.315322  6697 consensus_peers.cc:597] T fe20b4b48823486ca3b9c648db6ce8aa P ccd8a4c3bfe3413cb2ae219b09aea832 -> Peer 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071): Couldn't send request to peer 7ba59cc884714e8aa5f3f0ecaed84cbb. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: fe20b4b48823486ca3b9c648db6ce8aa. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:26.320603  6875 raft_consensus.cc:1275] T fe20b4b48823486ca3b9c648db6ce8aa P cd75a17ab2604397adab03bb8b5fd75c [term 1 FOLLOWER]: Refusing update from remote peer ccd8a4c3bfe3413cb2ae219b09aea832: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:18:26.326002  6804 raft_consensus.cc:1275] T fe20b4b48823486ca3b9c648db6ce8aa P b7ab4784c7344b939bc36f639286f377 [term 1 FOLLOWER]: Refusing update from remote peer ccd8a4c3bfe3413cb2ae219b09aea832: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:18:26.326853  7697 consensus_queue.cc:1048] T fe20b4b48823486ca3b9c648db6ce8aa P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:18:26.328632  7690 consensus_queue.cc:1048] T fe20b4b48823486ca3b9c648db6ce8aa P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:18:26.344635  7690 raft_consensus.cc:2955] T fe20b4b48823486ca3b9c648db6ce8aa P ccd8a4c3bfe3413cb2ae219b09aea832 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } attrs { replace: true } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: NON_VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: true } } }
I20260709 13:18:26.353761  6804 raft_consensus.cc:2955] T fe20b4b48823486ca3b9c648db6ce8aa P b7ab4784c7344b939bc36f639286f377 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } attrs { replace: true } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: NON_VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: true } } }
I20260709 13:18:26.358856  6874 raft_consensus.cc:2955] T fe20b4b48823486ca3b9c648db6ce8aa P cd75a17ab2604397adab03bb8b5fd75c [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } attrs { replace: true } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: NON_VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: true } } }
I20260709 13:18:26.369033  6728 consensus_queue.cc:237] T b3f13b31a1f84f0d89d007eadd57924c P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } attrs { replace: true } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: NON_VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: true } }
I20260709 13:18:26.373683  6630 catalog_manager.cc:5697] T fe20b4b48823486ca3b9c648db6ce8aa P ccd8a4c3bfe3413cb2ae219b09aea832 reported cstate change: config changed from index -1 to 2, NON_VOTER 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68) added. New cstate: current_term: 1 leader_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: NON_VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:26.390416  6804 raft_consensus.cc:1275] T b3f13b31a1f84f0d89d007eadd57924c P b7ab4784c7344b939bc36f639286f377 [term 1 FOLLOWER]: Refusing update from remote peer ccd8a4c3bfe3413cb2ae219b09aea832: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:18:26.391781  7690 consensus_queue.cc:1048] T b3f13b31a1f84f0d89d007eadd57924c P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:18:26.392190  6874 raft_consensus.cc:1275] T b3f13b31a1f84f0d89d007eadd57924c P cd75a17ab2604397adab03bb8b5fd75c [term 1 FOLLOWER]: Refusing update from remote peer ccd8a4c3bfe3413cb2ae219b09aea832: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:18:26.399698  7657 consensus_queue.cc:1048] T b3f13b31a1f84f0d89d007eadd57924c P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 13:18:26.402995  6697 consensus_peers.cc:597] T b3f13b31a1f84f0d89d007eadd57924c P ccd8a4c3bfe3413cb2ae219b09aea832 -> Peer 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071): Couldn't send request to peer 7ba59cc884714e8aa5f3f0ecaed84cbb. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: b3f13b31a1f84f0d89d007eadd57924c. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:26.425843  7697 raft_consensus.cc:2955] T b3f13b31a1f84f0d89d007eadd57924c P ccd8a4c3bfe3413cb2ae219b09aea832 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } attrs { replace: true } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: NON_VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: true } } }
I20260709 13:18:26.429489  6807 raft_consensus.cc:2955] T b3f13b31a1f84f0d89d007eadd57924c P b7ab4784c7344b939bc36f639286f377 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } attrs { replace: true } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: NON_VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: true } } }
I20260709 13:18:26.449430  6628 catalog_manager.cc:5697] T b3f13b31a1f84f0d89d007eadd57924c P ccd8a4c3bfe3413cb2ae219b09aea832 reported cstate change: config changed from index -1 to 2, NON_VOTER 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68) added. New cstate: current_term: 1 leader_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: NON_VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:26.469790  6874 raft_consensus.cc:2955] T b3f13b31a1f84f0d89d007eadd57924c P cd75a17ab2604397adab03bb8b5fd75c [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } attrs { replace: true } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: NON_VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: true } } }
I20260709 13:18:26.574157  7730 ts_tablet_manager.cc:933] T 3fa34c08b205435dba97346991aa1f92 P 7ba59cc884714e8aa5f3f0ecaed84cbb: Initiating tablet copy from peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391)
I20260709 13:18:26.576713  7730 tablet_copy_client.cc:323] T 3fa34c08b205435dba97346991aa1f92 P 7ba59cc884714e8aa5f3f0ecaed84cbb: tablet copy: Beginning tablet copy session from remote peer at address 127.5.126.65:44391
I20260709 13:18:26.578723  6741 tablet_copy_service.cc:140] P ccd8a4c3bfe3413cb2ae219b09aea832: Received BeginTabletCopySession request for tablet 3fa34c08b205435dba97346991aa1f92 from peer 7ba59cc884714e8aa5f3f0ecaed84cbb ({username='slave'} at 127.0.0.1:49744)
I20260709 13:18:26.579425  6741 tablet_copy_service.cc:161] P ccd8a4c3bfe3413cb2ae219b09aea832: Beginning new tablet copy session on tablet 3fa34c08b205435dba97346991aa1f92 from peer 7ba59cc884714e8aa5f3f0ecaed84cbb at {username='slave'} at 127.0.0.1:49744: session id = 7ba59cc884714e8aa5f3f0ecaed84cbb-3fa34c08b205435dba97346991aa1f92
I20260709 13:18:26.589380  6741 tablet_copy_source_session.cc:215] T 3fa34c08b205435dba97346991aa1f92 P ccd8a4c3bfe3413cb2ae219b09aea832: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:18:26.593184  7730 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3fa34c08b205435dba97346991aa1f92. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:26.621553  7730 tablet_copy_client.cc:806] T 3fa34c08b205435dba97346991aa1f92 P 7ba59cc884714e8aa5f3f0ecaed84cbb: tablet copy: Starting download of 0 data blocks...
I20260709 13:18:26.622376  7730 tablet_copy_client.cc:670] T 3fa34c08b205435dba97346991aa1f92 P 7ba59cc884714e8aa5f3f0ecaed84cbb: tablet copy: Starting download of 1 WAL segments...
I20260709 13:18:26.628988  7730 tablet_copy_client.cc:538] T 3fa34c08b205435dba97346991aa1f92 P 7ba59cc884714e8aa5f3f0ecaed84cbb: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:18:26.638875  7730 tablet_bootstrap.cc:492] T 3fa34c08b205435dba97346991aa1f92 P 7ba59cc884714e8aa5f3f0ecaed84cbb: Bootstrap starting.
I20260709 13:18:26.710142  7730 tablet_bootstrap.cc:492] T 3fa34c08b205435dba97346991aa1f92 P 7ba59cc884714e8aa5f3f0ecaed84cbb: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:18:26.711102  7730 tablet_bootstrap.cc:492] T 3fa34c08b205435dba97346991aa1f92 P 7ba59cc884714e8aa5f3f0ecaed84cbb: Bootstrap complete.
I20260709 13:18:26.711782  7730 ts_tablet_manager.cc:1403] T 3fa34c08b205435dba97346991aa1f92 P 7ba59cc884714e8aa5f3f0ecaed84cbb: Time spent bootstrapping tablet: real 0.073s	user 0.035s	sys 0.012s
I20260709 13:18:26.722003  7730 raft_consensus.cc:359] T 3fa34c08b205435dba97346991aa1f92 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } attrs { replace: true } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: NON_VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: true } }
I20260709 13:18:26.726027  7730 raft_consensus.cc:740] T 3fa34c08b205435dba97346991aa1f92 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 7ba59cc884714e8aa5f3f0ecaed84cbb, State: Initialized, Role: LEARNER
I20260709 13:18:26.729229  7730 consensus_queue.cc:260] T 3fa34c08b205435dba97346991aa1f92 P 7ba59cc884714e8aa5f3f0ecaed84cbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } attrs { replace: true } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: NON_VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: true } }
I20260709 13:18:26.739653  7733 ts_tablet_manager.cc:933] T fe20b4b48823486ca3b9c648db6ce8aa P 7ba59cc884714e8aa5f3f0ecaed84cbb: Initiating tablet copy from peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391)
I20260709 13:18:26.762771  7730 ts_tablet_manager.cc:1434] T 3fa34c08b205435dba97346991aa1f92 P 7ba59cc884714e8aa5f3f0ecaed84cbb: Time spent starting tablet: real 0.051s	user 0.007s	sys 0.000s
I20260709 13:18:26.765956  6741 tablet_copy_service.cc:342] P ccd8a4c3bfe3413cb2ae219b09aea832: Request end of tablet copy session 7ba59cc884714e8aa5f3f0ecaed84cbb-3fa34c08b205435dba97346991aa1f92 received from {username='slave'} at 127.0.0.1:49744
I20260709 13:18:26.766408  6741 tablet_copy_service.cc:434] P ccd8a4c3bfe3413cb2ae219b09aea832: ending tablet copy session 7ba59cc884714e8aa5f3f0ecaed84cbb-3fa34c08b205435dba97346991aa1f92 on tablet 3fa34c08b205435dba97346991aa1f92 with peer 7ba59cc884714e8aa5f3f0ecaed84cbb
I20260709 13:18:26.775301  7736 ts_tablet_manager.cc:933] T bb7fa124c3bf4ef9ab65a407cb008441 P 7ba59cc884714e8aa5f3f0ecaed84cbb: Initiating tablet copy from peer b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:18:26.785066  7733 tablet_copy_client.cc:323] T fe20b4b48823486ca3b9c648db6ce8aa P 7ba59cc884714e8aa5f3f0ecaed84cbb: tablet copy: Beginning tablet copy session from remote peer at address 127.5.126.65:44391
I20260709 13:18:26.786782  7736 tablet_copy_client.cc:323] T bb7fa124c3bf4ef9ab65a407cb008441 P 7ba59cc884714e8aa5f3f0ecaed84cbb: tablet copy: Beginning tablet copy session from remote peer at address 127.5.126.66:42817
I20260709 13:18:26.788761  6817 tablet_copy_service.cc:140] P b7ab4784c7344b939bc36f639286f377: Received BeginTabletCopySession request for tablet bb7fa124c3bf4ef9ab65a407cb008441 from peer 7ba59cc884714e8aa5f3f0ecaed84cbb ({username='slave'} at 127.0.0.1:50550)
I20260709 13:18:26.789299  6817 tablet_copy_service.cc:161] P b7ab4784c7344b939bc36f639286f377: Beginning new tablet copy session on tablet bb7fa124c3bf4ef9ab65a407cb008441 from peer 7ba59cc884714e8aa5f3f0ecaed84cbb at {username='slave'} at 127.0.0.1:50550: session id = 7ba59cc884714e8aa5f3f0ecaed84cbb-bb7fa124c3bf4ef9ab65a407cb008441
I20260709 13:18:26.789909  6741 tablet_copy_service.cc:140] P ccd8a4c3bfe3413cb2ae219b09aea832: Received BeginTabletCopySession request for tablet fe20b4b48823486ca3b9c648db6ce8aa from peer 7ba59cc884714e8aa5f3f0ecaed84cbb ({username='slave'} at 127.0.0.1:49744)
I20260709 13:18:26.790645  6741 tablet_copy_service.cc:161] P ccd8a4c3bfe3413cb2ae219b09aea832: Beginning new tablet copy session on tablet fe20b4b48823486ca3b9c648db6ce8aa from peer 7ba59cc884714e8aa5f3f0ecaed84cbb at {username='slave'} at 127.0.0.1:49744: session id = 7ba59cc884714e8aa5f3f0ecaed84cbb-fe20b4b48823486ca3b9c648db6ce8aa
I20260709 13:18:26.828615  6741 tablet_copy_source_session.cc:215] T fe20b4b48823486ca3b9c648db6ce8aa P ccd8a4c3bfe3413cb2ae219b09aea832: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:18:26.833577  6817 tablet_copy_source_session.cc:215] T bb7fa124c3bf4ef9ab65a407cb008441 P b7ab4784c7344b939bc36f639286f377: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:18:26.838090  7736 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bb7fa124c3bf4ef9ab65a407cb008441. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:26.846773  7733 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fe20b4b48823486ca3b9c648db6ce8aa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:26.870380  7736 tablet_copy_client.cc:806] T bb7fa124c3bf4ef9ab65a407cb008441 P 7ba59cc884714e8aa5f3f0ecaed84cbb: tablet copy: Starting download of 0 data blocks...
I20260709 13:18:26.871097  7736 tablet_copy_client.cc:670] T bb7fa124c3bf4ef9ab65a407cb008441 P 7ba59cc884714e8aa5f3f0ecaed84cbb: tablet copy: Starting download of 1 WAL segments...
I20260709 13:18:26.877156  7733 tablet_copy_client.cc:806] T fe20b4b48823486ca3b9c648db6ce8aa P 7ba59cc884714e8aa5f3f0ecaed84cbb: tablet copy: Starting download of 0 data blocks...
I20260709 13:18:26.878206  7733 tablet_copy_client.cc:670] T fe20b4b48823486ca3b9c648db6ce8aa P 7ba59cc884714e8aa5f3f0ecaed84cbb: tablet copy: Starting download of 1 WAL segments...
I20260709 13:18:26.880174  7736 tablet_copy_client.cc:538] T bb7fa124c3bf4ef9ab65a407cb008441 P 7ba59cc884714e8aa5f3f0ecaed84cbb: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:18:26.889532  7733 tablet_copy_client.cc:538] T fe20b4b48823486ca3b9c648db6ce8aa P 7ba59cc884714e8aa5f3f0ecaed84cbb: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:18:26.892736  7736 tablet_bootstrap.cc:492] T bb7fa124c3bf4ef9ab65a407cb008441 P 7ba59cc884714e8aa5f3f0ecaed84cbb: Bootstrap starting.
I20260709 13:18:26.908077  7733 tablet_bootstrap.cc:492] T fe20b4b48823486ca3b9c648db6ce8aa P 7ba59cc884714e8aa5f3f0ecaed84cbb: Bootstrap starting.
I20260709 13:18:26.972024  7733 tablet_bootstrap.cc:492] T fe20b4b48823486ca3b9c648db6ce8aa P 7ba59cc884714e8aa5f3f0ecaed84cbb: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:18:26.975001  7733 tablet_bootstrap.cc:492] T fe20b4b48823486ca3b9c648db6ce8aa P 7ba59cc884714e8aa5f3f0ecaed84cbb: Bootstrap complete.
I20260709 13:18:26.975996  7733 ts_tablet_manager.cc:1403] T fe20b4b48823486ca3b9c648db6ce8aa P 7ba59cc884714e8aa5f3f0ecaed84cbb: Time spent bootstrapping tablet: real 0.068s	user 0.021s	sys 0.011s
I20260709 13:18:26.982182  7502 raft_consensus.cc:1217] T 3fa34c08b205435dba97346991aa1f92 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:18:26.987865  7733 raft_consensus.cc:359] T fe20b4b48823486ca3b9c648db6ce8aa P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } attrs { replace: true } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: NON_VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: true } }
I20260709 13:18:26.988991  7733 raft_consensus.cc:740] T fe20b4b48823486ca3b9c648db6ce8aa P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 7ba59cc884714e8aa5f3f0ecaed84cbb, State: Initialized, Role: LEARNER
I20260709 13:18:26.989784  7733 consensus_queue.cc:260] T fe20b4b48823486ca3b9c648db6ce8aa P 7ba59cc884714e8aa5f3f0ecaed84cbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } attrs { replace: true } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: NON_VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: true } }
I20260709 13:18:26.993016  7733 ts_tablet_manager.cc:1434] T fe20b4b48823486ca3b9c648db6ce8aa P 7ba59cc884714e8aa5f3f0ecaed84cbb: Time spent starting tablet: real 0.017s	user 0.005s	sys 0.003s
I20260709 13:18:26.996206  6741 tablet_copy_service.cc:342] P ccd8a4c3bfe3413cb2ae219b09aea832: Request end of tablet copy session 7ba59cc884714e8aa5f3f0ecaed84cbb-fe20b4b48823486ca3b9c648db6ce8aa received from {username='slave'} at 127.0.0.1:49744
I20260709 13:18:26.996637  6741 tablet_copy_service.cc:434] P ccd8a4c3bfe3413cb2ae219b09aea832: ending tablet copy session 7ba59cc884714e8aa5f3f0ecaed84cbb-fe20b4b48823486ca3b9c648db6ce8aa on tablet fe20b4b48823486ca3b9c648db6ce8aa with peer 7ba59cc884714e8aa5f3f0ecaed84cbb
I20260709 13:18:27.007691  7736 tablet_bootstrap.cc:492] T bb7fa124c3bf4ef9ab65a407cb008441 P 7ba59cc884714e8aa5f3f0ecaed84cbb: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:18:27.008888  7736 tablet_bootstrap.cc:492] T bb7fa124c3bf4ef9ab65a407cb008441 P 7ba59cc884714e8aa5f3f0ecaed84cbb: Bootstrap complete.
I20260709 13:18:27.010624  7736 ts_tablet_manager.cc:1403] T bb7fa124c3bf4ef9ab65a407cb008441 P 7ba59cc884714e8aa5f3f0ecaed84cbb: Time spent bootstrapping tablet: real 0.118s	user 0.023s	sys 0.029s
I20260709 13:18:27.014091  7736 raft_consensus.cc:359] T bb7fa124c3bf4ef9ab65a407cb008441 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } attrs { replace: true } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: NON_VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: true } }
I20260709 13:18:27.015097  7736 raft_consensus.cc:740] T bb7fa124c3bf4ef9ab65a407cb008441 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 7ba59cc884714e8aa5f3f0ecaed84cbb, State: Initialized, Role: LEARNER
I20260709 13:18:27.015841  7736 consensus_queue.cc:260] T bb7fa124c3bf4ef9ab65a407cb008441 P 7ba59cc884714e8aa5f3f0ecaed84cbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } attrs { replace: true } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: NON_VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: true } }
I20260709 13:18:27.022014  7736 ts_tablet_manager.cc:1434] T bb7fa124c3bf4ef9ab65a407cb008441 P 7ba59cc884714e8aa5f3f0ecaed84cbb: Time spent starting tablet: real 0.011s	user 0.005s	sys 0.003s
I20260709 13:18:27.024185  6817 tablet_copy_service.cc:342] P b7ab4784c7344b939bc36f639286f377: Request end of tablet copy session 7ba59cc884714e8aa5f3f0ecaed84cbb-bb7fa124c3bf4ef9ab65a407cb008441 received from {username='slave'} at 127.0.0.1:50550
I20260709 13:18:27.024708  6817 tablet_copy_service.cc:434] P b7ab4784c7344b939bc36f639286f377: ending tablet copy session 7ba59cc884714e8aa5f3f0ecaed84cbb-bb7fa124c3bf4ef9ab65a407cb008441 on tablet bb7fa124c3bf4ef9ab65a407cb008441 with peer 7ba59cc884714e8aa5f3f0ecaed84cbb
I20260709 13:18:27.028844  7736 ts_tablet_manager.cc:933] T b3f13b31a1f84f0d89d007eadd57924c P 7ba59cc884714e8aa5f3f0ecaed84cbb: Initiating tablet copy from peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391)
I20260709 13:18:27.067541  7736 tablet_copy_client.cc:323] T b3f13b31a1f84f0d89d007eadd57924c P 7ba59cc884714e8aa5f3f0ecaed84cbb: tablet copy: Beginning tablet copy session from remote peer at address 127.5.126.65:44391
I20260709 13:18:27.070151  6741 tablet_copy_service.cc:140] P ccd8a4c3bfe3413cb2ae219b09aea832: Received BeginTabletCopySession request for tablet b3f13b31a1f84f0d89d007eadd57924c from peer 7ba59cc884714e8aa5f3f0ecaed84cbb ({username='slave'} at 127.0.0.1:49744)
I20260709 13:18:27.070744  6741 tablet_copy_service.cc:161] P ccd8a4c3bfe3413cb2ae219b09aea832: Beginning new tablet copy session on tablet b3f13b31a1f84f0d89d007eadd57924c from peer 7ba59cc884714e8aa5f3f0ecaed84cbb at {username='slave'} at 127.0.0.1:49744: session id = 7ba59cc884714e8aa5f3f0ecaed84cbb-b3f13b31a1f84f0d89d007eadd57924c
I20260709 13:18:27.080349  6741 tablet_copy_source_session.cc:215] T b3f13b31a1f84f0d89d007eadd57924c P ccd8a4c3bfe3413cb2ae219b09aea832: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:18:27.088481  7736 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b3f13b31a1f84f0d89d007eadd57924c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:27.123528  7736 tablet_copy_client.cc:806] T b3f13b31a1f84f0d89d007eadd57924c P 7ba59cc884714e8aa5f3f0ecaed84cbb: tablet copy: Starting download of 0 data blocks...
I20260709 13:18:27.124574  7736 tablet_copy_client.cc:670] T b3f13b31a1f84f0d89d007eadd57924c P 7ba59cc884714e8aa5f3f0ecaed84cbb: tablet copy: Starting download of 1 WAL segments...
I20260709 13:18:27.139779  7736 tablet_copy_client.cc:538] T b3f13b31a1f84f0d89d007eadd57924c P 7ba59cc884714e8aa5f3f0ecaed84cbb: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:18:27.155217  7736 tablet_bootstrap.cc:492] T b3f13b31a1f84f0d89d007eadd57924c P 7ba59cc884714e8aa5f3f0ecaed84cbb: Bootstrap starting.
I20260709 13:18:27.170557  7502 raft_consensus.cc:1217] T fe20b4b48823486ca3b9c648db6ce8aa P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:18:27.220574  7736 tablet_bootstrap.cc:492] T b3f13b31a1f84f0d89d007eadd57924c P 7ba59cc884714e8aa5f3f0ecaed84cbb: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:18:27.221419  7736 tablet_bootstrap.cc:492] T b3f13b31a1f84f0d89d007eadd57924c P 7ba59cc884714e8aa5f3f0ecaed84cbb: Bootstrap complete.
I20260709 13:18:27.222437  7736 ts_tablet_manager.cc:1403] T b3f13b31a1f84f0d89d007eadd57924c P 7ba59cc884714e8aa5f3f0ecaed84cbb: Time spent bootstrapping tablet: real 0.067s	user 0.024s	sys 0.008s
I20260709 13:18:27.227662  7736 raft_consensus.cc:359] T b3f13b31a1f84f0d89d007eadd57924c P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } attrs { replace: true } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: NON_VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: true } }
I20260709 13:18:27.228494  7736 raft_consensus.cc:740] T b3f13b31a1f84f0d89d007eadd57924c P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 7ba59cc884714e8aa5f3f0ecaed84cbb, State: Initialized, Role: LEARNER
I20260709 13:18:27.229111  7736 consensus_queue.cc:260] T b3f13b31a1f84f0d89d007eadd57924c P 7ba59cc884714e8aa5f3f0ecaed84cbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } attrs { replace: true } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: NON_VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: true } }
I20260709 13:18:27.232699  7736 ts_tablet_manager.cc:1434] T b3f13b31a1f84f0d89d007eadd57924c P 7ba59cc884714e8aa5f3f0ecaed84cbb: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.001s
I20260709 13:18:27.235144  6741 tablet_copy_service.cc:342] P ccd8a4c3bfe3413cb2ae219b09aea832: Request end of tablet copy session 7ba59cc884714e8aa5f3f0ecaed84cbb-b3f13b31a1f84f0d89d007eadd57924c received from {username='slave'} at 127.0.0.1:49744
I20260709 13:18:27.235582  6741 tablet_copy_service.cc:434] P ccd8a4c3bfe3413cb2ae219b09aea832: ending tablet copy session 7ba59cc884714e8aa5f3f0ecaed84cbb-b3f13b31a1f84f0d89d007eadd57924c on tablet b3f13b31a1f84f0d89d007eadd57924c with peer 7ba59cc884714e8aa5f3f0ecaed84cbb
I20260709 13:18:27.332301  7502 raft_consensus.cc:1217] T bb7fa124c3bf4ef9ab65a407cb008441 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:18:27.399623  7657 raft_consensus.cc:1064] T 3fa34c08b205435dba97346991aa1f92 P ccd8a4c3bfe3413cb2ae219b09aea832: attempting to promote NON_VOTER 7ba59cc884714e8aa5f3f0ecaed84cbb to VOTER
I20260709 13:18:27.402521  7657 consensus_queue.cc:237] T 3fa34c08b205435dba97346991aa1f92 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } attrs { replace: true } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:18:27.424947  7502 raft_consensus.cc:1275] T 3fa34c08b205435dba97346991aa1f92 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 1 LEARNER]: Refusing update from remote peer ccd8a4c3bfe3413cb2ae219b09aea832: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:18:27.430560  6876 raft_consensus.cc:1275] T 3fa34c08b205435dba97346991aa1f92 P cd75a17ab2604397adab03bb8b5fd75c [term 1 FOLLOWER]: Refusing update from remote peer ccd8a4c3bfe3413cb2ae219b09aea832: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:18:27.432382  6807 raft_consensus.cc:1275] T 3fa34c08b205435dba97346991aa1f92 P b7ab4784c7344b939bc36f639286f377 [term 1 FOLLOWER]: Refusing update from remote peer ccd8a4c3bfe3413cb2ae219b09aea832: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:18:27.435745  7741 consensus_queue.cc:1048] T 3fa34c08b205435dba97346991aa1f92 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:18:27.443301  7741 consensus_queue.cc:1048] T 3fa34c08b205435dba97346991aa1f92 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:18:27.446328  7740 consensus_queue.cc:1048] T 3fa34c08b205435dba97346991aa1f92 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:18:27.508105  7657 raft_consensus.cc:2955] T 3fa34c08b205435dba97346991aa1f92 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } attrs { replace: true } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } } }
I20260709 13:18:27.525599  7500 raft_consensus.cc:2955] T 3fa34c08b205435dba97346991aa1f92 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } attrs { replace: true } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } } }
I20260709 13:18:27.553771  7501 raft_consensus.cc:1217] T b3f13b31a1f84f0d89d007eadd57924c P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:18:27.595296  6630 catalog_manager.cc:5697] T 3fa34c08b205435dba97346991aa1f92 P 7ba59cc884714e8aa5f3f0ecaed84cbb reported cstate change: config changed from index 2 to 3, 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } attrs { replace: true } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } } }
I20260709 13:18:27.610316  6807 raft_consensus.cc:2955] T 3fa34c08b205435dba97346991aa1f92 P b7ab4784c7344b939bc36f639286f377 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } attrs { replace: true } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } } }
I20260709 13:18:27.614571  6872 raft_consensus.cc:2955] T 3fa34c08b205435dba97346991aa1f92 P cd75a17ab2604397adab03bb8b5fd75c [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } attrs { replace: true } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } } }
I20260709 13:18:27.652616  7657 raft_consensus.cc:1064] T fe20b4b48823486ca3b9c648db6ce8aa P ccd8a4c3bfe3413cb2ae219b09aea832: attempting to promote NON_VOTER 7ba59cc884714e8aa5f3f0ecaed84cbb to VOTER
I20260709 13:18:27.656430  7657 consensus_queue.cc:237] T fe20b4b48823486ca3b9c648db6ce8aa P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } attrs { replace: true } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:18:27.670867  7500 raft_consensus.cc:1275] T fe20b4b48823486ca3b9c648db6ce8aa P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 1 LEARNER]: Refusing update from remote peer ccd8a4c3bfe3413cb2ae219b09aea832: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:18:27.673802  6800 raft_consensus.cc:1275] T fe20b4b48823486ca3b9c648db6ce8aa P b7ab4784c7344b939bc36f639286f377 [term 1 FOLLOWER]: Refusing update from remote peer ccd8a4c3bfe3413cb2ae219b09aea832: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:18:27.673609  7741 consensus_queue.cc:1048] T fe20b4b48823486ca3b9c648db6ce8aa P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:18:27.675544  7749 consensus_queue.cc:1048] T fe20b4b48823486ca3b9c648db6ce8aa P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:18:27.701571  6872 raft_consensus.cc:1275] T fe20b4b48823486ca3b9c648db6ce8aa P cd75a17ab2604397adab03bb8b5fd75c [term 1 FOLLOWER]: Refusing update from remote peer ccd8a4c3bfe3413cb2ae219b09aea832: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:18:27.709578  7740 consensus_queue.cc:1048] T fe20b4b48823486ca3b9c648db6ce8aa P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:18:27.727185  7740 raft_consensus.cc:2955] T fe20b4b48823486ca3b9c648db6ce8aa P ccd8a4c3bfe3413cb2ae219b09aea832 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } attrs { replace: true } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } } }
I20260709 13:18:27.733914  7502 raft_consensus.cc:2955] T fe20b4b48823486ca3b9c648db6ce8aa P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } attrs { replace: true } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } } }
I20260709 13:18:27.785223  6800 raft_consensus.cc:2955] T fe20b4b48823486ca3b9c648db6ce8aa P b7ab4784c7344b939bc36f639286f377 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } attrs { replace: true } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } } }
I20260709 13:18:27.789535  6728 consensus_queue.cc:237] T 3fa34c08b205435dba97346991aa1f92 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:18:27.791698  6628 catalog_manager.cc:5697] T fe20b4b48823486ca3b9c648db6ce8aa P 7ba59cc884714e8aa5f3f0ecaed84cbb reported cstate change: config changed from index 2 to 3, 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } attrs { replace: true } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } } }
I20260709 13:18:27.797312  7500 raft_consensus.cc:1275] T 3fa34c08b205435dba97346991aa1f92 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 1 FOLLOWER]: Refusing update from remote peer ccd8a4c3bfe3413cb2ae219b09aea832: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:18:27.797634  6872 raft_consensus.cc:1275] T 3fa34c08b205435dba97346991aa1f92 P cd75a17ab2604397adab03bb8b5fd75c [term 1 FOLLOWER]: Refusing update from remote peer ccd8a4c3bfe3413cb2ae219b09aea832: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:18:27.800223  7723 consensus_queue.cc:1048] T 3fa34c08b205435dba97346991aa1f92 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:18:27.803768  7755 consensus_queue.cc:1048] T 3fa34c08b205435dba97346991aa1f92 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:18:27.801309  6872 raft_consensus.cc:2955] T fe20b4b48823486ca3b9c648db6ce8aa P cd75a17ab2604397adab03bb8b5fd75c [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } attrs { replace: true } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } } }
I20260709 13:18:27.817615  7500 raft_consensus.cc:2955] T 3fa34c08b205435dba97346991aa1f92 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b7ab4784c7344b939bc36f639286f377 (127.5.126.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } } }
I20260709 13:18:27.821103  7657 raft_consensus.cc:2955] T 3fa34c08b205435dba97346991aa1f92 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b7ab4784c7344b939bc36f639286f377 (127.5.126.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } } }
I20260709 13:18:27.832296  7706 raft_consensus.cc:1064] T bb7fa124c3bf4ef9ab65a407cb008441 P b7ab4784c7344b939bc36f639286f377: attempting to promote NON_VOTER 7ba59cc884714e8aa5f3f0ecaed84cbb to VOTER
I20260709 13:18:27.835608  7706 consensus_queue.cc:237] T bb7fa124c3bf4ef9ab65a407cb008441 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } attrs { replace: true } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:18:27.880889  6876 raft_consensus.cc:1275] T bb7fa124c3bf4ef9ab65a407cb008441 P cd75a17ab2604397adab03bb8b5fd75c [term 1 FOLLOWER]: Refusing update from remote peer b7ab4784c7344b939bc36f639286f377: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:18:27.883314  7750 consensus_queue.cc:1048] T bb7fa124c3bf4ef9ab65a407cb008441 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.003s
I20260709 13:18:27.890159  6729 raft_consensus.cc:1275] T bb7fa124c3bf4ef9ab65a407cb008441 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 1 FOLLOWER]: Refusing update from remote peer b7ab4784c7344b939bc36f639286f377: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:18:27.891708  7647 consensus_queue.cc:1048] T bb7fa124c3bf4ef9ab65a407cb008441 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:18:27.890689  7502 raft_consensus.cc:1275] T bb7fa124c3bf4ef9ab65a407cb008441 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 1 LEARNER]: Refusing update from remote peer b7ab4784c7344b939bc36f639286f377: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:18:27.900521  7694 consensus_queue.cc:1048] T bb7fa124c3bf4ef9ab65a407cb008441 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:18:27.918871  7647 raft_consensus.cc:2955] T bb7fa124c3bf4ef9ab65a407cb008441 P b7ab4784c7344b939bc36f639286f377 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } attrs { replace: true } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } } }
I20260709 13:18:27.934508  6875 raft_consensus.cc:2955] T bb7fa124c3bf4ef9ab65a407cb008441 P cd75a17ab2604397adab03bb8b5fd75c [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } attrs { replace: true } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } } }
I20260709 13:18:27.936895  7502 raft_consensus.cc:2955] T bb7fa124c3bf4ef9ab65a407cb008441 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } attrs { replace: true } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } } }
I20260709 13:18:27.984844  6614 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 3fa34c08b205435dba97346991aa1f92 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
W20260709 13:18:28.022547  6697 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 91680.3us
I20260709 13:18:28.024183  6627 catalog_manager.cc:5697] T 3fa34c08b205435dba97346991aa1f92 P 7ba59cc884714e8aa5f3f0ecaed84cbb reported cstate change: config changed from index 3 to 4, VOTER b7ab4784c7344b939bc36f639286f377 (127.5.126.66) evicted. New cstate: current_term: 1 leader_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } } }
I20260709 13:18:28.046972  6728 consensus_queue.cc:237] T fe20b4b48823486ca3b9c648db6ce8aa P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:18:28.066236  6790 tablet_service.cc:1558] Processing DeleteTablet for tablet 3fa34c08b205435dba97346991aa1f92 with delete_type TABLET_DATA_TOMBSTONED (TS b7ab4784c7344b939bc36f639286f377 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:32964
I20260709 13:18:28.078423  6627 catalog_manager.cc:5697] T bb7fa124c3bf4ef9ab65a407cb008441 P 7ba59cc884714e8aa5f3f0ecaed84cbb reported cstate change: config changed from index 2 to 3, 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "b7ab4784c7344b939bc36f639286f377" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } attrs { replace: true } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } } }
I20260709 13:18:28.118273  7502 raft_consensus.cc:1275] T fe20b4b48823486ca3b9c648db6ce8aa P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 1 FOLLOWER]: Refusing update from remote peer ccd8a4c3bfe3413cb2ae219b09aea832: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:18:28.130072  7769 tablet_replica.cc:333] T 3fa34c08b205435dba97346991aa1f92 P b7ab4784c7344b939bc36f639286f377: stopping tablet replica
I20260709 13:18:28.143097  6728 raft_consensus.cc:2955] T bb7fa124c3bf4ef9ab65a407cb008441 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } attrs { replace: true } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } } }
I20260709 13:18:28.145279  7741 consensus_queue.cc:1048] T fe20b4b48823486ca3b9c648db6ce8aa P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:18:28.127915  7755 raft_consensus.cc:1064] T b3f13b31a1f84f0d89d007eadd57924c P ccd8a4c3bfe3413cb2ae219b09aea832: attempting to promote NON_VOTER 7ba59cc884714e8aa5f3f0ecaed84cbb to VOTER
I20260709 13:18:28.162688  6877 raft_consensus.cc:1275] T fe20b4b48823486ca3b9c648db6ce8aa P cd75a17ab2604397adab03bb8b5fd75c [term 1 FOLLOWER]: Refusing update from remote peer ccd8a4c3bfe3413cb2ae219b09aea832: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:18:28.175271  6875 raft_consensus.cc:2955] T 3fa34c08b205435dba97346991aa1f92 P cd75a17ab2604397adab03bb8b5fd75c [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b7ab4784c7344b939bc36f639286f377 (127.5.126.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } } }
I20260709 13:18:28.178193  7752 raft_consensus.cc:2955] T fe20b4b48823486ca3b9c648db6ce8aa P ccd8a4c3bfe3413cb2ae219b09aea832 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b7ab4784c7344b939bc36f639286f377 (127.5.126.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } } }
I20260709 13:18:28.181324  7502 raft_consensus.cc:2955] T fe20b4b48823486ca3b9c648db6ce8aa P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b7ab4784c7344b939bc36f639286f377 (127.5.126.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } } }
I20260709 13:18:28.159639  7755 consensus_queue.cc:237] T b3f13b31a1f84f0d89d007eadd57924c P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } attrs { replace: true } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:18:28.229367  7502 raft_consensus.cc:1275] T b3f13b31a1f84f0d89d007eadd57924c P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 1 LEARNER]: Refusing update from remote peer ccd8a4c3bfe3413cb2ae219b09aea832: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:18:28.232385  6807 raft_consensus.cc:1275] T b3f13b31a1f84f0d89d007eadd57924c P b7ab4784c7344b939bc36f639286f377 [term 1 FOLLOWER]: Refusing update from remote peer ccd8a4c3bfe3413cb2ae219b09aea832: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:18:28.234926  7723 consensus_queue.cc:1048] T b3f13b31a1f84f0d89d007eadd57924c P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:18:28.240338  7767 consensus_queue.cc:1048] T b3f13b31a1f84f0d89d007eadd57924c P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:18:28.250257  6627 catalog_manager.cc:5697] T fe20b4b48823486ca3b9c648db6ce8aa P 7ba59cc884714e8aa5f3f0ecaed84cbb reported cstate change: config changed from index 3 to 4, VOTER b7ab4784c7344b939bc36f639286f377 (127.5.126.66) evicted. New cstate: current_term: 1 leader_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } } }
I20260709 13:18:28.264981  6614 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet fe20b4b48823486ca3b9c648db6ce8aa with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:18:28.288535  6790 tablet_service.cc:1558] Processing DeleteTablet for tablet fe20b4b48823486ca3b9c648db6ce8aa with delete_type TABLET_DATA_TOMBSTONED (Replica with old config index 3 (current committed config index is 4)) from {username='slave'} at 127.0.0.1:32964
I20260709 13:18:28.292382  6800 consensus_queue.cc:237] T bb7fa124c3bf4ef9ab65a407cb008441 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:18:28.258558  7723 consensus_queue.cc:1048] T fe20b4b48823486ca3b9c648db6ce8aa P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.042s
I20260709 13:18:28.330996  7502 raft_consensus.cc:1275] T bb7fa124c3bf4ef9ab65a407cb008441 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 1 FOLLOWER]: Refusing update from remote peer b7ab4784c7344b939bc36f639286f377: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:18:28.331207  6875 raft_consensus.cc:1275] T bb7fa124c3bf4ef9ab65a407cb008441 P cd75a17ab2604397adab03bb8b5fd75c [term 1 FOLLOWER]: Refusing update from remote peer b7ab4784c7344b939bc36f639286f377: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:18:28.337639  7647 consensus_queue.cc:1048] T bb7fa124c3bf4ef9ab65a407cb008441 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:18:28.358199  7769 raft_consensus.cc:2243] T 3fa34c08b205435dba97346991aa1f92 P b7ab4784c7344b939bc36f639286f377 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:28.359442  7769 raft_consensus.cc:2272] T 3fa34c08b205435dba97346991aa1f92 P b7ab4784c7344b939bc36f639286f377 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:28.362768  7647 consensus_queue.cc:1048] T bb7fa124c3bf4ef9ab65a407cb008441 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:18:28.380209  7741 raft_consensus.cc:2955] T b3f13b31a1f84f0d89d007eadd57924c P ccd8a4c3bfe3413cb2ae219b09aea832 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } attrs { replace: true } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } } }
I20260709 13:18:28.384191  7769 ts_tablet_manager.cc:1916] T 3fa34c08b205435dba97346991aa1f92 P b7ab4784c7344b939bc36f639286f377: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:18:28.389385  7694 raft_consensus.cc:2955] T bb7fa124c3bf4ef9ab65a407cb008441 P b7ab4784c7344b939bc36f639286f377 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } } }
W20260709 13:18:28.390476  6846 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.68:45071, user_credentials={real_user=slave}} blocked reactor thread for 88044.7us
I20260709 13:18:28.391054  7502 raft_consensus.cc:2955] T bb7fa124c3bf4ef9ab65a407cb008441 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } } }
I20260709 13:18:28.401214  6877 raft_consensus.cc:1275] T b3f13b31a1f84f0d89d007eadd57924c P cd75a17ab2604397adab03bb8b5fd75c [term 1 FOLLOWER]: Refusing update from remote peer ccd8a4c3bfe3413cb2ae219b09aea832: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:18:28.399298  6875 raft_consensus.cc:2955] T bb7fa124c3bf4ef9ab65a407cb008441 P cd75a17ab2604397adab03bb8b5fd75c [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } } }
I20260709 13:18:28.436386  7749 consensus_queue.cc:1048] T b3f13b31a1f84f0d89d007eadd57924c P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.009s
I20260709 13:18:28.438305  6804 raft_consensus.cc:2955] T b3f13b31a1f84f0d89d007eadd57924c P b7ab4784c7344b939bc36f639286f377 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } attrs { replace: true } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } } }
I20260709 13:18:28.441140  6626 catalog_manager.cc:5697] T bb7fa124c3bf4ef9ab65a407cb008441 P 7ba59cc884714e8aa5f3f0ecaed84cbb reported cstate change: config changed from index 3 to 4, VOTER ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65) evicted. New cstate: current_term: 1 leader_uuid: "b7ab4784c7344b939bc36f639286f377" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } } }
I20260709 13:18:28.457687  6877 raft_consensus.cc:2955] T fe20b4b48823486ca3b9c648db6ce8aa P cd75a17ab2604397adab03bb8b5fd75c [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b7ab4784c7344b939bc36f639286f377 (127.5.126.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } } }
I20260709 13:18:28.465633  6614 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet bb7fa124c3bf4ef9ab65a407cb008441 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
W20260709 13:18:28.481824  6695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 53720us
W20260709 13:18:28.487562  6697 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 59819.2us
I20260709 13:18:28.491092  6719 tablet_service.cc:1558] Processing DeleteTablet for tablet bb7fa124c3bf4ef9ab65a407cb008441 with delete_type TABLET_DATA_TOMBSTONED (TS ccd8a4c3bfe3413cb2ae219b09aea832 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:49996
I20260709 13:18:28.508232  7502 raft_consensus.cc:2955] T b3f13b31a1f84f0d89d007eadd57924c P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } attrs { replace: true } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } } }
I20260709 13:18:28.519968  6627 catalog_manager.cc:5697] T b3f13b31a1f84f0d89d007eadd57924c P ccd8a4c3bfe3413cb2ae219b09aea832 reported cstate change: config changed from index 2 to 3, 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:18:28.583284  7779 tablet_replica.cc:333] T bb7fa124c3bf4ef9ab65a407cb008441 P ccd8a4c3bfe3413cb2ae219b09aea832: stopping tablet replica
I20260709 13:18:28.585606  7779 raft_consensus.cc:2243] T bb7fa124c3bf4ef9ab65a407cb008441 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:28.593948  6877 raft_consensus.cc:2955] T b3f13b31a1f84f0d89d007eadd57924c P cd75a17ab2604397adab03bb8b5fd75c [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } attrs { replace: true } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } } }
I20260709 13:18:28.626950  7779 raft_consensus.cc:2272] T bb7fa124c3bf4ef9ab65a407cb008441 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:28.659374  6728 consensus_queue.cc:237] T b3f13b31a1f84f0d89d007eadd57924c P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:18:28.662472  7769 ts_tablet_manager.cc:1929] T 3fa34c08b205435dba97346991aa1f92 P b7ab4784c7344b939bc36f639286f377: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:18:28.663184  7769 log.cc:1199] T 3fa34c08b205435dba97346991aa1f92 P b7ab4784c7344b939bc36f639286f377: Deleting WAL directory at /tmp/dist-test-taskWHb0CB/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783603057096655-5625-0/minicluster-data/ts-1-root/wals/3fa34c08b205435dba97346991aa1f92
I20260709 13:18:28.670889  7502 raft_consensus.cc:1275] T b3f13b31a1f84f0d89d007eadd57924c P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 1 FOLLOWER]: Refusing update from remote peer ccd8a4c3bfe3413cb2ae219b09aea832: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:18:28.689766  7779 ts_tablet_manager.cc:1916] T bb7fa124c3bf4ef9ab65a407cb008441 P ccd8a4c3bfe3413cb2ae219b09aea832: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:18:28.692821  6802 raft_consensus.cc:1275] T b3f13b31a1f84f0d89d007eadd57924c P b7ab4784c7344b939bc36f639286f377 [term 1 FOLLOWER]: Refusing update from remote peer ccd8a4c3bfe3413cb2ae219b09aea832: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:18:28.695243  7766 consensus_queue.cc:1048] T b3f13b31a1f84f0d89d007eadd57924c P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.003s
I20260709 13:18:28.711172  7776 consensus_queue.cc:1048] T b3f13b31a1f84f0d89d007eadd57924c P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.006s
I20260709 13:18:28.721010  6614 catalog_manager.cc:5028] TS b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817): tablet 3fa34c08b205435dba97346991aa1f92 (table test-workload [id=04f4d366747e43549980077479ed75b9]) successfully deleted
I20260709 13:18:28.722692  7769 tablet_replica.cc:333] T fe20b4b48823486ca3b9c648db6ce8aa P b7ab4784c7344b939bc36f639286f377: stopping tablet replica
I20260709 13:18:28.724211  7769 raft_consensus.cc:2243] T fe20b4b48823486ca3b9c648db6ce8aa P b7ab4784c7344b939bc36f639286f377 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:28.725405  7769 raft_consensus.cc:2272] T fe20b4b48823486ca3b9c648db6ce8aa P b7ab4784c7344b939bc36f639286f377 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:28.730113  7769 ts_tablet_manager.cc:1916] T fe20b4b48823486ca3b9c648db6ce8aa P b7ab4784c7344b939bc36f639286f377: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:18:28.754891  7723 raft_consensus.cc:2955] T b3f13b31a1f84f0d89d007eadd57924c P ccd8a4c3bfe3413cb2ae219b09aea832 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } } }
I20260709 13:18:28.762219  7500 raft_consensus.cc:2955] T b3f13b31a1f84f0d89d007eadd57924c P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } } }
I20260709 13:18:28.784530  6800 raft_consensus.cc:2955] T b3f13b31a1f84f0d89d007eadd57924c P b7ab4784c7344b939bc36f639286f377 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } } }
I20260709 13:18:28.791812  6630 catalog_manager.cc:5697] T b3f13b31a1f84f0d89d007eadd57924c P 7ba59cc884714e8aa5f3f0ecaed84cbb reported cstate change: config changed from index 3 to 4, VOTER cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67) evicted. New cstate: current_term: 1 leader_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } } }
I20260709 13:18:28.792973  7779 ts_tablet_manager.cc:1929] T bb7fa124c3bf4ef9ab65a407cb008441 P ccd8a4c3bfe3413cb2ae219b09aea832: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:18:28.796693  7779 log.cc:1199] T bb7fa124c3bf4ef9ab65a407cb008441 P ccd8a4c3bfe3413cb2ae219b09aea832: Deleting WAL directory at /tmp/dist-test-taskWHb0CB/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783603057096655-5625-0/minicluster-data/ts-0-root/wals/bb7fa124c3bf4ef9ab65a407cb008441
I20260709 13:18:28.801226  7769 ts_tablet_manager.cc:1929] T fe20b4b48823486ca3b9c648db6ce8aa P b7ab4784c7344b939bc36f639286f377: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:18:28.801805  7769 log.cc:1199] T fe20b4b48823486ca3b9c648db6ce8aa P b7ab4784c7344b939bc36f639286f377: Deleting WAL directory at /tmp/dist-test-taskWHb0CB/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783603057096655-5625-0/minicluster-data/ts-1-root/wals/fe20b4b48823486ca3b9c648db6ce8aa
I20260709 13:18:28.803539  6614 catalog_manager.cc:5028] TS b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817): tablet fe20b4b48823486ca3b9c648db6ce8aa (table test-workload [id=04f4d366747e43549980077479ed75b9]) successfully deleted
I20260709 13:18:28.806334  6867 tablet_service.cc:1558] Processing DeleteTablet for tablet b3f13b31a1f84f0d89d007eadd57924c with delete_type TABLET_DATA_TOMBSTONED (TS cd75a17ab2604397adab03bb8b5fd75c not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:53394
I20260709 13:18:28.812656  6614 catalog_manager.cc:5028] TS ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): tablet bb7fa124c3bf4ef9ab65a407cb008441 (table test-workload [id=04f4d366747e43549980077479ed75b9]) successfully deleted
I20260709 13:18:28.816315  7781 tablet_replica.cc:333] T b3f13b31a1f84f0d89d007eadd57924c P cd75a17ab2604397adab03bb8b5fd75c: stopping tablet replica
I20260709 13:18:28.817651  7781 raft_consensus.cc:2243] T b3f13b31a1f84f0d89d007eadd57924c P cd75a17ab2604397adab03bb8b5fd75c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:28.818342  7781 raft_consensus.cc:2272] T b3f13b31a1f84f0d89d007eadd57924c P cd75a17ab2604397adab03bb8b5fd75c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:28.825517  7781 ts_tablet_manager.cc:1916] T b3f13b31a1f84f0d89d007eadd57924c P cd75a17ab2604397adab03bb8b5fd75c: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:18:28.838132  6614 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet b3f13b31a1f84f0d89d007eadd57924c with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:18:28.852727  7781 ts_tablet_manager.cc:1929] T b3f13b31a1f84f0d89d007eadd57924c P cd75a17ab2604397adab03bb8b5fd75c: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:18:28.853178  7781 log.cc:1199] T b3f13b31a1f84f0d89d007eadd57924c P cd75a17ab2604397adab03bb8b5fd75c: Deleting WAL directory at /tmp/dist-test-taskWHb0CB/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783603057096655-5625-0/minicluster-data/ts-2-root/wals/b3f13b31a1f84f0d89d007eadd57924c
I20260709 13:18:28.855091  6616 catalog_manager.cc:5028] TS cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931): tablet b3f13b31a1f84f0d89d007eadd57924c (table test-workload [id=04f4d366747e43549980077479ed75b9]) successfully deleted
I20260709 13:18:29.898116  6728 consensus_queue.cc:237] T 1528ab62b6fe4e3099d08f141afee116 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } attrs { replace: true } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: NON_VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: true } }
W20260709 13:18:29.909389  6697 consensus_peers.cc:597] T 1528ab62b6fe4e3099d08f141afee116 P ccd8a4c3bfe3413cb2ae219b09aea832 -> Peer 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071): Couldn't send request to peer 7ba59cc884714e8aa5f3f0ecaed84cbb. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 1528ab62b6fe4e3099d08f141afee116. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:29.909592  6878 raft_consensus.cc:1275] T 1528ab62b6fe4e3099d08f141afee116 P cd75a17ab2604397adab03bb8b5fd75c [term 1 FOLLOWER]: Refusing update from remote peer ccd8a4c3bfe3413cb2ae219b09aea832: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:18:29.910331  6800 raft_consensus.cc:1275] T 1528ab62b6fe4e3099d08f141afee116 P b7ab4784c7344b939bc36f639286f377 [term 1 FOLLOWER]: Refusing update from remote peer ccd8a4c3bfe3413cb2ae219b09aea832: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:18:29.912385  7784 consensus_queue.cc:1048] T 1528ab62b6fe4e3099d08f141afee116 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:18:29.913216  7723 consensus_queue.cc:1048] T 1528ab62b6fe4e3099d08f141afee116 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:18:29.926903  7740 raft_consensus.cc:2955] T 1528ab62b6fe4e3099d08f141afee116 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } attrs { replace: true } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: NON_VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: true } } }
I20260709 13:18:29.929246  6875 raft_consensus.cc:2955] T 1528ab62b6fe4e3099d08f141afee116 P cd75a17ab2604397adab03bb8b5fd75c [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } attrs { replace: true } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: NON_VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: true } } }
I20260709 13:18:29.949311  6800 raft_consensus.cc:2955] T 1528ab62b6fe4e3099d08f141afee116 P b7ab4784c7344b939bc36f639286f377 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } attrs { replace: true } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: NON_VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: true } } }
I20260709 13:18:29.950356  6627 catalog_manager.cc:5697] T 1528ab62b6fe4e3099d08f141afee116 P cd75a17ab2604397adab03bb8b5fd75c reported cstate change: config changed from index -1 to 2, NON_VOTER 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68) added. New cstate: current_term: 1 leader_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } attrs { replace: true } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: NON_VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: true } } }
I20260709 13:18:29.953687  6728 consensus_queue.cc:237] T 24ee15416e3145beaa1b8183453729a3 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } attrs { replace: true } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: NON_VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: true } }
W20260709 13:18:29.972640  6697 consensus_peers.cc:597] T 24ee15416e3145beaa1b8183453729a3 P ccd8a4c3bfe3413cb2ae219b09aea832 -> Peer 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071): Couldn't send request to peer 7ba59cc884714e8aa5f3f0ecaed84cbb. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 24ee15416e3145beaa1b8183453729a3. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:29.978546  6875 raft_consensus.cc:1275] T 24ee15416e3145beaa1b8183453729a3 P cd75a17ab2604397adab03bb8b5fd75c [term 1 FOLLOWER]: Refusing update from remote peer ccd8a4c3bfe3413cb2ae219b09aea832: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:18:29.979566  6804 raft_consensus.cc:1275] T 24ee15416e3145beaa1b8183453729a3 P b7ab4784c7344b939bc36f639286f377 [term 1 FOLLOWER]: Refusing update from remote peer ccd8a4c3bfe3413cb2ae219b09aea832: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:18:29.981153  7740 consensus_queue.cc:1048] T 24ee15416e3145beaa1b8183453729a3 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:18:29.988438  7740 consensus_queue.cc:1048] T 24ee15416e3145beaa1b8183453729a3 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:18:29.993088  7723 raft_consensus.cc:2955] T 24ee15416e3145beaa1b8183453729a3 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } attrs { replace: true } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: NON_VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: true } } }
I20260709 13:18:30.001715  6878 raft_consensus.cc:2955] T 24ee15416e3145beaa1b8183453729a3 P cd75a17ab2604397adab03bb8b5fd75c [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } attrs { replace: true } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: NON_VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: true } } }
I20260709 13:18:30.031070  6878 consensus_queue.cc:237] T 427c124d773f483294511e80fe340075 P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } attrs { replace: true } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: NON_VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: true } }
I20260709 13:18:30.033710  6802 raft_consensus.cc:2955] T 24ee15416e3145beaa1b8183453729a3 P b7ab4784c7344b939bc36f639286f377 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } attrs { replace: true } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: NON_VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: true } } }
I20260709 13:18:30.040117  6728 raft_consensus.cc:1275] T 427c124d773f483294511e80fe340075 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 1 FOLLOWER]: Refusing update from remote peer cd75a17ab2604397adab03bb8b5fd75c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:18:30.041886  7744 consensus_queue.cc:1048] T 427c124d773f483294511e80fe340075 P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Connected to new peer: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:18:30.042223  6804 raft_consensus.cc:1275] T 427c124d773f483294511e80fe340075 P b7ab4784c7344b939bc36f639286f377 [term 1 FOLLOWER]: Refusing update from remote peer cd75a17ab2604397adab03bb8b5fd75c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:18:30.043994  7744 consensus_queue.cc:1048] T 427c124d773f483294511e80fe340075 P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 13:18:30.050161  6846 consensus_peers.cc:597] T 427c124d773f483294511e80fe340075 P cd75a17ab2604397adab03bb8b5fd75c -> Peer 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071): Couldn't send request to peer 7ba59cc884714e8aa5f3f0ecaed84cbb. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 427c124d773f483294511e80fe340075. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:30.072074  6628 catalog_manager.cc:5697] T 24ee15416e3145beaa1b8183453729a3 P cd75a17ab2604397adab03bb8b5fd75c reported cstate change: config changed from index -1 to 2, NON_VOTER 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68) added. New cstate: current_term: 1 leader_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } attrs { replace: true } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: NON_VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: true } } }
I20260709 13:18:30.094463  7799 raft_consensus.cc:2955] T 427c124d773f483294511e80fe340075 P cd75a17ab2604397adab03bb8b5fd75c [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } attrs { replace: true } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: NON_VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: true } } }
I20260709 13:18:30.096509  6728 raft_consensus.cc:2955] T 427c124d773f483294511e80fe340075 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } attrs { replace: true } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: NON_VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: true } } }
I20260709 13:18:30.115356  6804 raft_consensus.cc:2955] T 427c124d773f483294511e80fe340075 P b7ab4784c7344b939bc36f639286f377 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } attrs { replace: true } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: NON_VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: true } } }
I20260709 13:18:30.123536  6802 consensus_queue.cc:237] T ce4f062dcd314d43a63ca74067cb5ee3 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } attrs { replace: true } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: NON_VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: true } }
I20260709 13:18:30.126258  6630 catalog_manager.cc:5697] T 427c124d773f483294511e80fe340075 P ccd8a4c3bfe3413cb2ae219b09aea832 reported cstate change: config changed from index -1 to 2, NON_VOTER 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68) added. New cstate: current_term: 1 leader_uuid: "cd75a17ab2604397adab03bb8b5fd75c" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } attrs { replace: true } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: NON_VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: true } } }
W20260709 13:18:30.145416  6772 consensus_peers.cc:597] T ce4f062dcd314d43a63ca74067cb5ee3 P b7ab4784c7344b939bc36f639286f377 -> Peer 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071): Couldn't send request to peer 7ba59cc884714e8aa5f3f0ecaed84cbb. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: ce4f062dcd314d43a63ca74067cb5ee3. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:30.146123  6875 raft_consensus.cc:1275] T ce4f062dcd314d43a63ca74067cb5ee3 P cd75a17ab2604397adab03bb8b5fd75c [term 1 FOLLOWER]: Refusing update from remote peer b7ab4784c7344b939bc36f639286f377: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:18:30.147507  6728 raft_consensus.cc:1275] T ce4f062dcd314d43a63ca74067cb5ee3 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 1 FOLLOWER]: Refusing update from remote peer b7ab4784c7344b939bc36f639286f377: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:18:30.149169  7774 consensus_queue.cc:1048] T ce4f062dcd314d43a63ca74067cb5ee3 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:18:30.150969  7782 consensus_queue.cc:1048] T ce4f062dcd314d43a63ca74067cb5ee3 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:18:30.166152  7785 raft_consensus.cc:2955] T ce4f062dcd314d43a63ca74067cb5ee3 P b7ab4784c7344b939bc36f639286f377 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } attrs { replace: true } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: NON_VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: true } } }
I20260709 13:18:30.168165  6728 raft_consensus.cc:2955] T ce4f062dcd314d43a63ca74067cb5ee3 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } attrs { replace: true } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: NON_VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: true } } }
I20260709 13:18:30.168148  6875 raft_consensus.cc:2955] T ce4f062dcd314d43a63ca74067cb5ee3 P cd75a17ab2604397adab03bb8b5fd75c [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } attrs { replace: true } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: NON_VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: true } } }
I20260709 13:18:30.194060  6630 catalog_manager.cc:5697] T ce4f062dcd314d43a63ca74067cb5ee3 P ccd8a4c3bfe3413cb2ae219b09aea832 reported cstate change: config changed from index -1 to 2, NON_VOTER 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68) added. New cstate: current_term: 1 leader_uuid: "b7ab4784c7344b939bc36f639286f377" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } attrs { replace: true } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: NON_VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: true } } }
I20260709 13:18:30.364378  7805 ts_tablet_manager.cc:933] T 24ee15416e3145beaa1b8183453729a3 P 7ba59cc884714e8aa5f3f0ecaed84cbb: Initiating tablet copy from peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391)
I20260709 13:18:30.366387  7805 tablet_copy_client.cc:323] T 24ee15416e3145beaa1b8183453729a3 P 7ba59cc884714e8aa5f3f0ecaed84cbb: tablet copy: Beginning tablet copy session from remote peer at address 127.5.126.65:44391
I20260709 13:18:30.368618  6741 tablet_copy_service.cc:140] P ccd8a4c3bfe3413cb2ae219b09aea832: Received BeginTabletCopySession request for tablet 24ee15416e3145beaa1b8183453729a3 from peer 7ba59cc884714e8aa5f3f0ecaed84cbb ({username='slave'} at 127.0.0.1:49744)
I20260709 13:18:30.369246  6741 tablet_copy_service.cc:161] P ccd8a4c3bfe3413cb2ae219b09aea832: Beginning new tablet copy session on tablet 24ee15416e3145beaa1b8183453729a3 from peer 7ba59cc884714e8aa5f3f0ecaed84cbb at {username='slave'} at 127.0.0.1:49744: session id = 7ba59cc884714e8aa5f3f0ecaed84cbb-24ee15416e3145beaa1b8183453729a3
I20260709 13:18:30.377995  6741 tablet_copy_source_session.cc:215] T 24ee15416e3145beaa1b8183453729a3 P ccd8a4c3bfe3413cb2ae219b09aea832: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:18:30.380404  7807 ts_tablet_manager.cc:933] T 1528ab62b6fe4e3099d08f141afee116 P 7ba59cc884714e8aa5f3f0ecaed84cbb: Initiating tablet copy from peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391)
I20260709 13:18:30.381943  7805 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 24ee15416e3145beaa1b8183453729a3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:30.400173  7805 tablet_copy_client.cc:806] T 24ee15416e3145beaa1b8183453729a3 P 7ba59cc884714e8aa5f3f0ecaed84cbb: tablet copy: Starting download of 0 data blocks...
I20260709 13:18:30.400900  7805 tablet_copy_client.cc:670] T 24ee15416e3145beaa1b8183453729a3 P 7ba59cc884714e8aa5f3f0ecaed84cbb: tablet copy: Starting download of 1 WAL segments...
I20260709 13:18:30.405584  7805 tablet_copy_client.cc:538] T 24ee15416e3145beaa1b8183453729a3 P 7ba59cc884714e8aa5f3f0ecaed84cbb: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:18:30.415056  7805 tablet_bootstrap.cc:492] T 24ee15416e3145beaa1b8183453729a3 P 7ba59cc884714e8aa5f3f0ecaed84cbb: Bootstrap starting.
I20260709 13:18:30.443468  7807 tablet_copy_client.cc:323] T 1528ab62b6fe4e3099d08f141afee116 P 7ba59cc884714e8aa5f3f0ecaed84cbb: tablet copy: Beginning tablet copy session from remote peer at address 127.5.126.65:44391
I20260709 13:18:30.445613  6741 tablet_copy_service.cc:140] P ccd8a4c3bfe3413cb2ae219b09aea832: Received BeginTabletCopySession request for tablet 1528ab62b6fe4e3099d08f141afee116 from peer 7ba59cc884714e8aa5f3f0ecaed84cbb ({username='slave'} at 127.0.0.1:49744)
I20260709 13:18:30.446202  6741 tablet_copy_service.cc:161] P ccd8a4c3bfe3413cb2ae219b09aea832: Beginning new tablet copy session on tablet 1528ab62b6fe4e3099d08f141afee116 from peer 7ba59cc884714e8aa5f3f0ecaed84cbb at {username='slave'} at 127.0.0.1:49744: session id = 7ba59cc884714e8aa5f3f0ecaed84cbb-1528ab62b6fe4e3099d08f141afee116
I20260709 13:18:30.454238  6741 tablet_copy_source_session.cc:215] T 1528ab62b6fe4e3099d08f141afee116 P ccd8a4c3bfe3413cb2ae219b09aea832: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:18:30.455463  7805 tablet_bootstrap.cc:492] T 24ee15416e3145beaa1b8183453729a3 P 7ba59cc884714e8aa5f3f0ecaed84cbb: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:18:30.456683  7805 tablet_bootstrap.cc:492] T 24ee15416e3145beaa1b8183453729a3 P 7ba59cc884714e8aa5f3f0ecaed84cbb: Bootstrap complete.
I20260709 13:18:30.457602  7805 ts_tablet_manager.cc:1403] T 24ee15416e3145beaa1b8183453729a3 P 7ba59cc884714e8aa5f3f0ecaed84cbb: Time spent bootstrapping tablet: real 0.043s	user 0.026s	sys 0.012s
I20260709 13:18:30.460773  7807 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1528ab62b6fe4e3099d08f141afee116. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:30.461297  7805 raft_consensus.cc:359] T 24ee15416e3145beaa1b8183453729a3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } attrs { replace: true } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: NON_VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: true } }
I20260709 13:18:30.462183  7805 raft_consensus.cc:740] T 24ee15416e3145beaa1b8183453729a3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 7ba59cc884714e8aa5f3f0ecaed84cbb, State: Initialized, Role: LEARNER
I20260709 13:18:30.462983  7805 consensus_queue.cc:260] T 24ee15416e3145beaa1b8183453729a3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } attrs { replace: true } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: NON_VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: true } }
I20260709 13:18:30.482124  7807 tablet_copy_client.cc:806] T 1528ab62b6fe4e3099d08f141afee116 P 7ba59cc884714e8aa5f3f0ecaed84cbb: tablet copy: Starting download of 0 data blocks...
I20260709 13:18:30.482929  7807 tablet_copy_client.cc:670] T 1528ab62b6fe4e3099d08f141afee116 P 7ba59cc884714e8aa5f3f0ecaed84cbb: tablet copy: Starting download of 1 WAL segments...
I20260709 13:18:30.487684  7807 tablet_copy_client.cc:538] T 1528ab62b6fe4e3099d08f141afee116 P 7ba59cc884714e8aa5f3f0ecaed84cbb: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:18:30.499441  7805 ts_tablet_manager.cc:1434] T 24ee15416e3145beaa1b8183453729a3 P 7ba59cc884714e8aa5f3f0ecaed84cbb: Time spent starting tablet: real 0.042s	user 0.011s	sys 0.008s
I20260709 13:18:30.501569  6741 tablet_copy_service.cc:342] P ccd8a4c3bfe3413cb2ae219b09aea832: Request end of tablet copy session 7ba59cc884714e8aa5f3f0ecaed84cbb-24ee15416e3145beaa1b8183453729a3 received from {username='slave'} at 127.0.0.1:49744
I20260709 13:18:30.502077  6741 tablet_copy_service.cc:434] P ccd8a4c3bfe3413cb2ae219b09aea832: ending tablet copy session 7ba59cc884714e8aa5f3f0ecaed84cbb-24ee15416e3145beaa1b8183453729a3 on tablet 24ee15416e3145beaa1b8183453729a3 with peer 7ba59cc884714e8aa5f3f0ecaed84cbb
I20260709 13:18:30.504300  7807 tablet_bootstrap.cc:492] T 1528ab62b6fe4e3099d08f141afee116 P 7ba59cc884714e8aa5f3f0ecaed84cbb: Bootstrap starting.
I20260709 13:18:30.532943  7807 tablet_bootstrap.cc:492] T 1528ab62b6fe4e3099d08f141afee116 P 7ba59cc884714e8aa5f3f0ecaed84cbb: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:18:30.534174  7807 tablet_bootstrap.cc:492] T 1528ab62b6fe4e3099d08f141afee116 P 7ba59cc884714e8aa5f3f0ecaed84cbb: Bootstrap complete.
I20260709 13:18:30.535034  7807 ts_tablet_manager.cc:1403] T 1528ab62b6fe4e3099d08f141afee116 P 7ba59cc884714e8aa5f3f0ecaed84cbb: Time spent bootstrapping tablet: real 0.031s	user 0.020s	sys 0.008s
I20260709 13:18:30.538833  7807 raft_consensus.cc:359] T 1528ab62b6fe4e3099d08f141afee116 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } attrs { replace: true } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: NON_VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: true } }
I20260709 13:18:30.539742  7807 raft_consensus.cc:740] T 1528ab62b6fe4e3099d08f141afee116 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 7ba59cc884714e8aa5f3f0ecaed84cbb, State: Initialized, Role: LEARNER
I20260709 13:18:30.540426  7807 consensus_queue.cc:260] T 1528ab62b6fe4e3099d08f141afee116 P 7ba59cc884714e8aa5f3f0ecaed84cbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } attrs { replace: true } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: NON_VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: true } }
I20260709 13:18:30.553712  7807 ts_tablet_manager.cc:1434] T 1528ab62b6fe4e3099d08f141afee116 P 7ba59cc884714e8aa5f3f0ecaed84cbb: Time spent starting tablet: real 0.018s	user 0.005s	sys 0.004s
I20260709 13:18:30.560179  6741 tablet_copy_service.cc:342] P ccd8a4c3bfe3413cb2ae219b09aea832: Request end of tablet copy session 7ba59cc884714e8aa5f3f0ecaed84cbb-1528ab62b6fe4e3099d08f141afee116 received from {username='slave'} at 127.0.0.1:49744
I20260709 13:18:30.560743  6741 tablet_copy_service.cc:434] P ccd8a4c3bfe3413cb2ae219b09aea832: ending tablet copy session 7ba59cc884714e8aa5f3f0ecaed84cbb-1528ab62b6fe4e3099d08f141afee116 on tablet 1528ab62b6fe4e3099d08f141afee116 with peer 7ba59cc884714e8aa5f3f0ecaed84cbb
I20260709 13:18:30.575203  7807 ts_tablet_manager.cc:933] T 427c124d773f483294511e80fe340075 P 7ba59cc884714e8aa5f3f0ecaed84cbb: Initiating tablet copy from peer cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:18:30.581205  7805 ts_tablet_manager.cc:933] T ce4f062dcd314d43a63ca74067cb5ee3 P 7ba59cc884714e8aa5f3f0ecaed84cbb: Initiating tablet copy from peer b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:18:30.590952  7807 tablet_copy_client.cc:323] T 427c124d773f483294511e80fe340075 P 7ba59cc884714e8aa5f3f0ecaed84cbb: tablet copy: Beginning tablet copy session from remote peer at address 127.5.126.67:42931
I20260709 13:18:30.593495  6891 tablet_copy_service.cc:140] P cd75a17ab2604397adab03bb8b5fd75c: Received BeginTabletCopySession request for tablet 427c124d773f483294511e80fe340075 from peer 7ba59cc884714e8aa5f3f0ecaed84cbb ({username='slave'} at 127.0.0.1:58592)
I20260709 13:18:30.594280  6891 tablet_copy_service.cc:161] P cd75a17ab2604397adab03bb8b5fd75c: Beginning new tablet copy session on tablet 427c124d773f483294511e80fe340075 from peer 7ba59cc884714e8aa5f3f0ecaed84cbb at {username='slave'} at 127.0.0.1:58592: session id = 7ba59cc884714e8aa5f3f0ecaed84cbb-427c124d773f483294511e80fe340075
I20260709 13:18:30.603046  7805 tablet_copy_client.cc:323] T ce4f062dcd314d43a63ca74067cb5ee3 P 7ba59cc884714e8aa5f3f0ecaed84cbb: tablet copy: Beginning tablet copy session from remote peer at address 127.5.126.66:42817
I20260709 13:18:30.604540  6891 tablet_copy_source_session.cc:215] T 427c124d773f483294511e80fe340075 P cd75a17ab2604397adab03bb8b5fd75c: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:18:30.605389  6817 tablet_copy_service.cc:140] P b7ab4784c7344b939bc36f639286f377: Received BeginTabletCopySession request for tablet ce4f062dcd314d43a63ca74067cb5ee3 from peer 7ba59cc884714e8aa5f3f0ecaed84cbb ({username='slave'} at 127.0.0.1:50550)
I20260709 13:18:30.606058  6817 tablet_copy_service.cc:161] P b7ab4784c7344b939bc36f639286f377: Beginning new tablet copy session on tablet ce4f062dcd314d43a63ca74067cb5ee3 from peer 7ba59cc884714e8aa5f3f0ecaed84cbb at {username='slave'} at 127.0.0.1:50550: session id = 7ba59cc884714e8aa5f3f0ecaed84cbb-ce4f062dcd314d43a63ca74067cb5ee3
I20260709 13:18:30.615707  7807 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 427c124d773f483294511e80fe340075. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:30.619686  6817 tablet_copy_source_session.cc:215] T ce4f062dcd314d43a63ca74067cb5ee3 P b7ab4784c7344b939bc36f639286f377: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:18:30.623471  7805 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ce4f062dcd314d43a63ca74067cb5ee3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:30.634409  7807 tablet_copy_client.cc:806] T 427c124d773f483294511e80fe340075 P 7ba59cc884714e8aa5f3f0ecaed84cbb: tablet copy: Starting download of 0 data blocks...
I20260709 13:18:30.635037  7807 tablet_copy_client.cc:670] T 427c124d773f483294511e80fe340075 P 7ba59cc884714e8aa5f3f0ecaed84cbb: tablet copy: Starting download of 1 WAL segments...
I20260709 13:18:30.641413  7807 tablet_copy_client.cc:538] T 427c124d773f483294511e80fe340075 P 7ba59cc884714e8aa5f3f0ecaed84cbb: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:18:30.654426  7807 tablet_bootstrap.cc:492] T 427c124d773f483294511e80fe340075 P 7ba59cc884714e8aa5f3f0ecaed84cbb: Bootstrap starting.
I20260709 13:18:30.662513  7805 tablet_copy_client.cc:806] T ce4f062dcd314d43a63ca74067cb5ee3 P 7ba59cc884714e8aa5f3f0ecaed84cbb: tablet copy: Starting download of 0 data blocks...
I20260709 13:18:30.663255  7805 tablet_copy_client.cc:670] T ce4f062dcd314d43a63ca74067cb5ee3 P 7ba59cc884714e8aa5f3f0ecaed84cbb: tablet copy: Starting download of 1 WAL segments...
I20260709 13:18:30.668241  7805 tablet_copy_client.cc:538] T ce4f062dcd314d43a63ca74067cb5ee3 P 7ba59cc884714e8aa5f3f0ecaed84cbb: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:18:30.674661  7807 tablet_bootstrap.cc:492] T 427c124d773f483294511e80fe340075 P 7ba59cc884714e8aa5f3f0ecaed84cbb: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:18:30.677652  7807 tablet_bootstrap.cc:492] T 427c124d773f483294511e80fe340075 P 7ba59cc884714e8aa5f3f0ecaed84cbb: Bootstrap complete.
I20260709 13:18:30.678385  7807 ts_tablet_manager.cc:1403] T 427c124d773f483294511e80fe340075 P 7ba59cc884714e8aa5f3f0ecaed84cbb: Time spent bootstrapping tablet: real 0.024s	user 0.021s	sys 0.001s
I20260709 13:18:30.682292  7807 raft_consensus.cc:359] T 427c124d773f483294511e80fe340075 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } attrs { replace: true } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: NON_VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: true } }
I20260709 13:18:30.683220  7807 raft_consensus.cc:740] T 427c124d773f483294511e80fe340075 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 7ba59cc884714e8aa5f3f0ecaed84cbb, State: Initialized, Role: LEARNER
I20260709 13:18:30.684958  7807 consensus_queue.cc:260] T 427c124d773f483294511e80fe340075 P 7ba59cc884714e8aa5f3f0ecaed84cbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } attrs { replace: true } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: NON_VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: true } }
I20260709 13:18:30.687974  7807 ts_tablet_manager.cc:1434] T 427c124d773f483294511e80fe340075 P 7ba59cc884714e8aa5f3f0ecaed84cbb: Time spent starting tablet: real 0.009s	user 0.002s	sys 0.005s
I20260709 13:18:30.690374  6891 tablet_copy_service.cc:342] P cd75a17ab2604397adab03bb8b5fd75c: Request end of tablet copy session 7ba59cc884714e8aa5f3f0ecaed84cbb-427c124d773f483294511e80fe340075 received from {username='slave'} at 127.0.0.1:58592
I20260709 13:18:30.690896  6891 tablet_copy_service.cc:434] P cd75a17ab2604397adab03bb8b5fd75c: ending tablet copy session 7ba59cc884714e8aa5f3f0ecaed84cbb-427c124d773f483294511e80fe340075 on tablet 427c124d773f483294511e80fe340075 with peer 7ba59cc884714e8aa5f3f0ecaed84cbb
I20260709 13:18:30.691219  7805 tablet_bootstrap.cc:492] T ce4f062dcd314d43a63ca74067cb5ee3 P 7ba59cc884714e8aa5f3f0ecaed84cbb: Bootstrap starting.
I20260709 13:18:30.726675  7805 tablet_bootstrap.cc:492] T ce4f062dcd314d43a63ca74067cb5ee3 P 7ba59cc884714e8aa5f3f0ecaed84cbb: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:18:30.727738  7805 tablet_bootstrap.cc:492] T ce4f062dcd314d43a63ca74067cb5ee3 P 7ba59cc884714e8aa5f3f0ecaed84cbb: Bootstrap complete.
I20260709 13:18:30.728586  7805 ts_tablet_manager.cc:1403] T ce4f062dcd314d43a63ca74067cb5ee3 P 7ba59cc884714e8aa5f3f0ecaed84cbb: Time spent bootstrapping tablet: real 0.038s	user 0.024s	sys 0.007s
I20260709 13:18:30.733038  7805 raft_consensus.cc:359] T ce4f062dcd314d43a63ca74067cb5ee3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } attrs { replace: true } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: NON_VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: true } }
I20260709 13:18:30.734093  7805 raft_consensus.cc:740] T ce4f062dcd314d43a63ca74067cb5ee3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 7ba59cc884714e8aa5f3f0ecaed84cbb, State: Initialized, Role: LEARNER
I20260709 13:18:30.734846  7805 consensus_queue.cc:260] T ce4f062dcd314d43a63ca74067cb5ee3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } attrs { replace: true } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: NON_VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: true } }
I20260709 13:18:30.737707  7805 ts_tablet_manager.cc:1434] T ce4f062dcd314d43a63ca74067cb5ee3 P 7ba59cc884714e8aa5f3f0ecaed84cbb: Time spent starting tablet: real 0.009s	user 0.000s	sys 0.007s
I20260709 13:18:30.739981  6817 tablet_copy_service.cc:342] P b7ab4784c7344b939bc36f639286f377: Request end of tablet copy session 7ba59cc884714e8aa5f3f0ecaed84cbb-ce4f062dcd314d43a63ca74067cb5ee3 received from {username='slave'} at 127.0.0.1:50550
I20260709 13:18:30.740509  6817 tablet_copy_service.cc:434] P b7ab4784c7344b939bc36f639286f377: ending tablet copy session 7ba59cc884714e8aa5f3f0ecaed84cbb-ce4f062dcd314d43a63ca74067cb5ee3 on tablet ce4f062dcd314d43a63ca74067cb5ee3 with peer 7ba59cc884714e8aa5f3f0ecaed84cbb
I20260709 13:18:30.865226  7500 raft_consensus.cc:1217] T 1528ab62b6fe4e3099d08f141afee116 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:18:30.913051  7500 raft_consensus.cc:1217] T 24ee15416e3145beaa1b8183453729a3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:18:31.156940  7500 raft_consensus.cc:1217] T ce4f062dcd314d43a63ca74067cb5ee3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:18:32.137850  7821 raft_consensus.cc:493] T 8c7f33e544204fbaac4078e3e83bbf4e P ccd8a4c3bfe3413cb2ae219b09aea832 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:18:32.138644  7821 raft_consensus.cc:515] T 8c7f33e544204fbaac4078e3e83bbf4e P ccd8a4c3bfe3413cb2ae219b09aea832 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:32.141563  7821 leader_election.cc:290] T 8c7f33e544204fbaac4078e3e83bbf4e P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
W20260709 13:18:32.206593  6661 debug-util.cc:398] Leaking SignalData structure 0x7b08000d8c40 after lost signal to thread 5628
I20260709 13:18:32.217274  7821 raft_consensus.cc:493] T ce4f062dcd314d43a63ca74067cb5ee3 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:18:32.218365  7821 raft_consensus.cc:515] T ce4f062dcd314d43a63ca74067cb5ee3 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } attrs { replace: true } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: NON_VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: true } }
I20260709 13:18:32.221930  7821 leader_election.cc:290] T ce4f062dcd314d43a63ca74067cb5ee3 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:18:32.246472  7821 raft_consensus.cc:493] T 90d42e216d9741e190bca19a781291fd P ccd8a4c3bfe3413cb2ae219b09aea832 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:18:32.247386  7821 raft_consensus.cc:515] T 90d42e216d9741e190bca19a781291fd P ccd8a4c3bfe3413cb2ae219b09aea832 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:32.250674  7821 leader_election.cc:290] T 90d42e216d9741e190bca19a781291fd P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:18:32.357663  7821 raft_consensus.cc:493] T f5be3a11b23d4ea9b08300a2789821c7 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader cd75a17ab2604397adab03bb8b5fd75c)
I20260709 13:18:32.358572  7821 raft_consensus.cc:515] T f5be3a11b23d4ea9b08300a2789821c7 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:32.465896  7821 leader_election.cc:290] T f5be3a11b23d4ea9b08300a2789821c7 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:18:32.466534  7821 raft_consensus.cc:493] T 2c240553ce044eedb41541d72b9475d7 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:18:32.467054  7821 raft_consensus.cc:515] T 2c240553ce044eedb41541d72b9475d7 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:32.469301  7821 leader_election.cc:290] T 2c240553ce044eedb41541d72b9475d7 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:18:32.469861  7821 raft_consensus.cc:493] T a1704639a875409b9959353527b3fd68 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:18:32.470360  7821 raft_consensus.cc:515] T a1704639a875409b9959353527b3fd68 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:32.471917  7821 leader_election.cc:290] T a1704639a875409b9959353527b3fd68 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:18:32.472491  7821 raft_consensus.cc:493] T 95a75bfe094d4bdc963aba3f08dfcd25 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:18:32.472978  7821 raft_consensus.cc:515] T 95a75bfe094d4bdc963aba3f08dfcd25 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:32.475129  7821 leader_election.cc:290] T 95a75bfe094d4bdc963aba3f08dfcd25 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:18:32.475646  7821 raft_consensus.cc:493] T 3d65025eea89441290d85dd053810e31 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader cd75a17ab2604397adab03bb8b5fd75c)
I20260709 13:18:32.476328  7821 raft_consensus.cc:515] T 3d65025eea89441290d85dd053810e31 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:32.478686  7821 leader_election.cc:290] T 3d65025eea89441290d85dd053810e31 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:18:32.479249  7821 raft_consensus.cc:493] T 30e88460611e47b2ba16a46a30b5f416 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:18:32.479754  7821 raft_consensus.cc:515] T 30e88460611e47b2ba16a46a30b5f416 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:32.482405  7821 leader_election.cc:290] T 30e88460611e47b2ba16a46a30b5f416 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:18:32.482898  7821 raft_consensus.cc:493] T d8292e16e5654be6bc408560cf256aaa P ccd8a4c3bfe3413cb2ae219b09aea832 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:18:32.483348  7821 raft_consensus.cc:515] T d8292e16e5654be6bc408560cf256aaa P ccd8a4c3bfe3413cb2ae219b09aea832 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:32.486089  7821 leader_election.cc:290] T d8292e16e5654be6bc408560cf256aaa P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:18:32.486681  7821 raft_consensus.cc:493] T de3186201e1a40d0b335eeb8b4e256e0 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:18:32.487978  7817 raft_consensus.cc:493] T ab432e62819d499eaaf3dd55481dd930 P cd75a17ab2604397adab03bb8b5fd75c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:18:32.488814  7817 raft_consensus.cc:515] T ab432e62819d499eaaf3dd55481dd930 P cd75a17ab2604397adab03bb8b5fd75c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:32.491027  7823 raft_consensus.cc:493] T 7c44c4849aa54f2b94d1f1bef9ed546f P cd75a17ab2604397adab03bb8b5fd75c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:18:32.491617  7823 raft_consensus.cc:515] T 7c44c4849aa54f2b94d1f1bef9ed546f P cd75a17ab2604397adab03bb8b5fd75c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:32.492527  7723 raft_consensus.cc:493] T 427c124d773f483294511e80fe340075 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader cd75a17ab2604397adab03bb8b5fd75c)
I20260709 13:18:32.493010  7723 raft_consensus.cc:515] T 427c124d773f483294511e80fe340075 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } attrs { replace: true } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: NON_VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: true } }
I20260709 13:18:32.494082  7823 leader_election.cc:290] T 7c44c4849aa54f2b94d1f1bef9ed546f P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:18:32.496107  7723 leader_election.cc:290] T 427c124d773f483294511e80fe340075 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:18:32.497754  7817 leader_election.cc:290] T ab432e62819d499eaaf3dd55481dd930 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:18:32.487242  7821 raft_consensus.cc:515] T de3186201e1a40d0b335eeb8b4e256e0 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:32.500248  7817 raft_consensus.cc:493] T 3a485a995abc4807b6e511e45419f737 P cd75a17ab2604397adab03bb8b5fd75c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:18:32.500466  7823 raft_consensus.cc:493] T 2c240553ce044eedb41541d72b9475d7 P cd75a17ab2604397adab03bb8b5fd75c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:18:32.500890  7817 raft_consensus.cc:515] T 3a485a995abc4807b6e511e45419f737 P cd75a17ab2604397adab03bb8b5fd75c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:32.503031  7817 leader_election.cc:290] T 3a485a995abc4807b6e511e45419f737 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:18:32.500993  7823 raft_consensus.cc:515] T 2c240553ce044eedb41541d72b9475d7 P cd75a17ab2604397adab03bb8b5fd75c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:32.506283  7823 leader_election.cc:290] T 2c240553ce044eedb41541d72b9475d7 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:18:32.503580  7824 raft_consensus.cc:493] T e31b9971c15848dea59d4d4130141d9e P cd75a17ab2604397adab03bb8b5fd75c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:18:32.507822  7824 raft_consensus.cc:515] T e31b9971c15848dea59d4d4130141d9e P cd75a17ab2604397adab03bb8b5fd75c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:32.509380  7821 leader_election.cc:290] T de3186201e1a40d0b335eeb8b4e256e0 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:18:32.519316  7824 leader_election.cc:290] T e31b9971c15848dea59d4d4130141d9e P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:18:32.520937  7823 raft_consensus.cc:493] T f09c2a98de1a4decabd0ff900dd44caa P cd75a17ab2604397adab03bb8b5fd75c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:18:32.521633  7817 raft_consensus.cc:493] T 24ee15416e3145beaa1b8183453729a3 P cd75a17ab2604397adab03bb8b5fd75c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:18:32.522123  7826 raft_consensus.cc:493] T be1a92657f494cac8dd227d152f50151 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:18:32.522287  7817 raft_consensus.cc:515] T 24ee15416e3145beaa1b8183453729a3 P cd75a17ab2604397adab03bb8b5fd75c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } attrs { replace: true } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: NON_VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: true } }
I20260709 13:18:32.522620  7826 raft_consensus.cc:515] T be1a92657f494cac8dd227d152f50151 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:18:32.524703  7817 leader_election.cc:290] T 24ee15416e3145beaa1b8183453729a3 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:18:32.525700  7817 raft_consensus.cc:493] T 4d9def8b32fd443aa94ab1420b06837b P cd75a17ab2604397adab03bb8b5fd75c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:18:32.526418  7826 leader_election.cc:290] T be1a92657f494cac8dd227d152f50151 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:18:32.520823  7824 raft_consensus.cc:493] T 3fa34c08b205435dba97346991aa1f92 P cd75a17ab2604397adab03bb8b5fd75c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:18:32.527009  7826 raft_consensus.cc:493] T d8cee0accdb8499c86d4414b72565a38 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:18:32.527091  7824 raft_consensus.cc:515] T 3fa34c08b205435dba97346991aa1f92 P cd75a17ab2604397adab03bb8b5fd75c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
W20260709 13:18:32.530526  6846 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.441s	user 0.003s	sys 0.028s
I20260709 13:18:32.527611  7817 raft_consensus.cc:515] T 4d9def8b32fd443aa94ab1420b06837b P cd75a17ab2604397adab03bb8b5fd75c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
W20260709 13:18:32.531049  6846 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.441s	user 0.003s	sys 0.028s
W20260709 13:18:32.546329  6661 debug-util.cc:398] Leaking SignalData structure 0x7b0800223de0 after lost signal to thread 6664
I20260709 13:18:32.550566  7817 leader_election.cc:290] T 4d9def8b32fd443aa94ab1420b06837b P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:18:32.551231  7817 raft_consensus.cc:493] T c4db81d9d329422bb3b4160ca4ac2d1d P cd75a17ab2604397adab03bb8b5fd75c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:18:32.551743  7817 raft_consensus.cc:515] T c4db81d9d329422bb3b4160ca4ac2d1d P cd75a17ab2604397adab03bb8b5fd75c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:32.553752  7817 leader_election.cc:290] T c4db81d9d329422bb3b4160ca4ac2d1d P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:18:32.562278  7833 raft_consensus.cc:493] T f03d0dbf16864ca4bc1bb5e4c0334c0f P cd75a17ab2604397adab03bb8b5fd75c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:18:32.564137  7833 raft_consensus.cc:515] T f03d0dbf16864ca4bc1bb5e4c0334c0f P cd75a17ab2604397adab03bb8b5fd75c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:32.530645  7824 leader_election.cc:290] T 3fa34c08b205435dba97346991aa1f92 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
W20260709 13:18:32.563450  6770 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.435s	user 0.021s	sys 0.017s
W20260709 13:18:32.566332  6770 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.438s	user 0.022s	sys 0.017s
I20260709 13:18:32.527559  7826 raft_consensus.cc:515] T d8cee0accdb8499c86d4414b72565a38 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:18:32.558863  7825 raft_consensus.cc:493] T f3f9c2e2bf644115957398fe4c9459db P cd75a17ab2604397adab03bb8b5fd75c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:18:32.564998  7810 raft_consensus.cc:493] T 4f00a2e87e56452083b759f60d461ee3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 3 FOLLOWER]: Starting pre-election (detected failure of leader cd75a17ab2604397adab03bb8b5fd75c)
I20260709 13:18:32.572422  7823 raft_consensus.cc:515] T f09c2a98de1a4decabd0ff900dd44caa P cd75a17ab2604397adab03bb8b5fd75c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:32.572840  7810 raft_consensus.cc:515] T 4f00a2e87e56452083b759f60d461ee3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:18:32.574895  7823 leader_election.cc:290] T f09c2a98de1a4decabd0ff900dd44caa P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:18:32.575049  7810 leader_election.cc:290] T 4f00a2e87e56452083b759f60d461ee3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:18:32.575635  7810 raft_consensus.cc:493] T bb7fa124c3bf4ef9ab65a407cb008441 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:18:32.576253  7810 raft_consensus.cc:515] T bb7fa124c3bf4ef9ab65a407cb008441 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:18:32.578500  7810 leader_election.cc:290] T bb7fa124c3bf4ef9ab65a407cb008441 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:18:32.579022  7810 raft_consensus.cc:493] T 7ba5dac66ab5497e9e336f2a3c28cda5 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader cd75a17ab2604397adab03bb8b5fd75c)
I20260709 13:18:32.579592  7810 raft_consensus.cc:515] T 7ba5dac66ab5497e9e336f2a3c28cda5 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:18:32.581692  7810 leader_election.cc:290] T 7ba5dac66ab5497e9e336f2a3c28cda5 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:18:32.582432  7824 raft_consensus.cc:493] T a1704639a875409b9959353527b3fd68 P cd75a17ab2604397adab03bb8b5fd75c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:18:32.582279  7825 raft_consensus.cc:515] T f3f9c2e2bf644115957398fe4c9459db P cd75a17ab2604397adab03bb8b5fd75c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:32.584133  7823 raft_consensus.cc:493] T 20f6842e26174571996b8dea4151d4be P cd75a17ab2604397adab03bb8b5fd75c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:18:32.584805  7823 raft_consensus.cc:515] T 20f6842e26174571996b8dea4151d4be P cd75a17ab2604397adab03bb8b5fd75c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:32.586468  7825 leader_election.cc:290] T f3f9c2e2bf644115957398fe4c9459db P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:18:32.587157  7823 leader_election.cc:290] T 20f6842e26174571996b8dea4151d4be P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:18:32.588531  7740 raft_consensus.cc:493] T bd6869f07b5a4885a0b99fbe60c3b175 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:18:32.672799  7740 raft_consensus.cc:515] T bd6869f07b5a4885a0b99fbe60c3b175 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:32.673874  7847 raft_consensus.cc:493] T dbdf895bba214ff68685a24fd17dfb5d P cd75a17ab2604397adab03bb8b5fd75c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:18:32.674700  7847 raft_consensus.cc:515] T dbdf895bba214ff68685a24fd17dfb5d P cd75a17ab2604397adab03bb8b5fd75c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:32.675333  7740 leader_election.cc:290] T bd6869f07b5a4885a0b99fbe60c3b175 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:18:32.588707  7817 raft_consensus.cc:493] T 44bde925b2e541b69890d70715b85176 P cd75a17ab2604397adab03bb8b5fd75c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:18:32.676297  7817 raft_consensus.cc:515] T 44bde925b2e541b69890d70715b85176 P cd75a17ab2604397adab03bb8b5fd75c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:32.677155  7847 leader_election.cc:290] T dbdf895bba214ff68685a24fd17dfb5d P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:18:32.677714  7847 raft_consensus.cc:493] T 9e326172347f45e99a0d482b5d8ef768 P cd75a17ab2604397adab03bb8b5fd75c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:18:32.678166  7847 raft_consensus.cc:515] T 9e326172347f45e99a0d482b5d8ef768 P cd75a17ab2604397adab03bb8b5fd75c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:32.679034  7817 leader_election.cc:290] T 44bde925b2e541b69890d70715b85176 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:18:32.589051  7776 raft_consensus.cc:493] T d33d5ee8ef6f415593d8df52063161ad P ccd8a4c3bfe3413cb2ae219b09aea832 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:18:32.590612  7836 raft_consensus.cc:493] T c4db81d9d329422bb3b4160ca4ac2d1d P b7ab4784c7344b939bc36f639286f377 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:18:32.591177  7826 leader_election.cc:290] T d8cee0accdb8499c86d4414b72565a38 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:18:32.594254  7832 raft_consensus.cc:493] T 3411566abe2d4c9bb4b2adfdd05e6f17 P cd75a17ab2604397adab03bb8b5fd75c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:18:32.599853  7841 raft_consensus.cc:493] T 1bf4668eeb70467fb3dc5a0289233b3c P cd75a17ab2604397adab03bb8b5fd75c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:18:32.601256  7837 raft_consensus.cc:493] T 7887766dc6784fcaa42b35c05fea7a99 P cd75a17ab2604397adab03bb8b5fd75c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:18:32.602644  7829 raft_consensus.cc:493] T fe20b4b48823486ca3b9c648db6ce8aa P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:18:32.685811  7837 raft_consensus.cc:515] T 7887766dc6784fcaa42b35c05fea7a99 P cd75a17ab2604397adab03bb8b5fd75c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:32.555475  7816 raft_consensus.cc:493] T 1bf4668eeb70467fb3dc5a0289233b3c P ccd8a4c3bfe3413cb2ae219b09aea832 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:18:32.603960  7842 raft_consensus.cc:493] T 7a734b5ab7834e05a8c422208acc58b1 P cd75a17ab2604397adab03bb8b5fd75c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:18:32.610477  7844 raft_consensus.cc:493] T 22ccee1b570c4ad3a57bd7aec085b1b4 P cd75a17ab2604397adab03bb8b5fd75c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:18:32.611546  7500 raft_consensus.cc:1217] T 427c124d773f483294511e80fe340075 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:18:32.612445  7502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fa34c08b205435dba97346991aa1f92" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:18:32.619143  6628 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:51654 (request call id 71) took 1441 ms. Trace:
I20260709 13:18:32.621057  7839 raft_consensus.cc:493] T 17587d6730594da4a56fa13a353232a1 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:18:32.689590  7502 raft_consensus.cc:2468] T 3fa34c08b205435dba97346991aa1f92 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 1.
W20260709 13:18:32.629288  6661 debug-util.cc:398] Leaking SignalData structure 0x7b080008a500 after lost signal to thread 6756
W20260709 13:18:32.691700  6661 debug-util.cc:398] Leaking SignalData structure 0x7b0800131b00 after lost signal to thread 6831
W20260709 13:18:32.692935  6661 debug-util.cc:398] Leaking SignalData structure 0x7b08001c91c0 after lost signal to thread 6905
W20260709 13:18:32.694082  6661 debug-util.cc:398] Leaking SignalData structure 0x7b0800301500 after lost signal to thread 7527
W20260709 13:18:32.694357  6661 debug-util.cc:398] Leaking SignalData structure 0x7b08003016c0 after lost signal to thread 7528
W20260709 13:18:32.694873  6661 debug-util.cc:398] Leaking SignalData structure 0x7b0800301540 after lost signal to thread 7807
I20260709 13:18:32.630002  6724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab432e62819d499eaaf3dd55481dd930" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:18:32.630699  6728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c44c4849aa54f2b94d1f1bef9ed546f" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:18:32.631875  6723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a485a995abc4807b6e511e45419f737" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:18:32.636849  7831 raft_consensus.cc:493] T 713b5728a197487c9300b310ab94e5a3 P cd75a17ab2604397adab03bb8b5fd75c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:18:32.619123  7845 raft_consensus.cc:493] T 1528ab62b6fe4e3099d08f141afee116 P cd75a17ab2604397adab03bb8b5fd75c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:18:32.638777  6730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24ee15416e3145beaa1b8183453729a3" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:18:32.639926  6727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d9def8b32fd443aa94ab1420b06837b" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:18:32.640669  6729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c240553ce044eedb41541d72b9475d7" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:18:32.641672  6732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4db81d9d329422bb3b4160ca4ac2d1d" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:18:32.654704  6731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fa34c08b205435dba97346991aa1f92" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:18:32.655333  7810 raft_consensus.cc:493] T bb3d8792045a4583ae2e965b1350a5b4 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:18:32.656318  6726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e31b9971c15848dea59d4d4130141d9e" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:18:32.584129  7824 raft_consensus.cc:515] T a1704639a875409b9959353527b3fd68 P cd75a17ab2604397adab03bb8b5fd75c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:32.660861  7723 raft_consensus.cc:493] T 17587d6730594da4a56fa13a353232a1 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:18:32.663058  6878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f00a2e87e56452083b759f60d461ee3" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:18:32.664700  6875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8cee0accdb8499c86d4414b72565a38" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:18:32.731830  6875 raft_consensus.cc:2468] T d8cee0accdb8499c86d4414b72565a38 P cd75a17ab2604397adab03bb8b5fd75c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in term 1.
I20260709 13:18:32.666265  6877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb7fa124c3bf4ef9ab65a407cb008441" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:18:32.732376  6728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f9c2e2bf644115957398fe4c9459db" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:18:32.732666  6877 raft_consensus.cc:2468] T bb7fa124c3bf4ef9ab65a407cb008441 P cd75a17ab2604397adab03bb8b5fd75c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in term 1.
I20260709 13:18:32.685125  7833 leader_election.cc:290] T f03d0dbf16864ca4bc1bb5e4c0334c0f P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:18:32.685191  6881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ba5dac66ab5497e9e336f2a3c28cda5" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:18:32.685968  7841 raft_consensus.cc:515] T 1bf4668eeb70467fb3dc5a0289233b3c P cd75a17ab2604397adab03bb8b5fd75c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:32.605573  7784 raft_consensus.cc:493] T a3022224cc81473690653a83d4e99470 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader cd75a17ab2604397adab03bb8b5fd75c)
I20260709 13:18:32.679793  7817 raft_consensus.cc:493] T 30e88460611e47b2ba16a46a30b5f416 P cd75a17ab2604397adab03bb8b5fd75c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:18:32.625140  7846 raft_consensus.cc:493] T b56bf91d90824c959e21e0cee5ba1816 P cd75a17ab2604397adab03bb8b5fd75c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:18:32.726241  6729 raft_consensus.cc:2468] T 2c240553ce044eedb41541d72b9475d7 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 1.
I20260709 13:18:32.680898  7823 raft_consensus.cc:493] T 9b3759de40694069b13c0f8bd40e5709 P cd75a17ab2604397adab03bb8b5fd75c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:18:32.686040  7829 raft_consensus.cc:515] T fe20b4b48823486ca3b9c648db6ce8aa P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:18:32.685794  7840 raft_consensus.cc:493] T 404190ce4ce94cecbfcb6ea9d1dd8626 P b7ab4784c7344b939bc36f639286f377 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:18:32.689632  7826 raft_consensus.cc:493] T 4b8cacb381b746da8d0049b0a83b41dd P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:18:32.735563  7723 raft_consensus.cc:515] T 17587d6730594da4a56fa13a353232a1 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:18:32.688304  7847 leader_election.cc:290] T 9e326172347f45e99a0d482b5d8ef768 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:18:32.688966  7776 raft_consensus.cc:515] T d33d5ee8ef6f415593d8df52063161ad P ccd8a4c3bfe3413cb2ae219b09aea832 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:32.689893  6628 rpcz_store.cc:276] 0709 13:18:31.177577 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:31.212006 (+ 34429us) service_pool.cc:224] Handling call
0709 13:18:32.619013 (+1407007us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3736,"reported_tablets":1,"spinlock_wait_cycles":20736}
I20260709 13:18:32.742424  7851 raft_consensus.cc:493] T 90d42e216d9741e190bca19a781291fd P cd75a17ab2604397adab03bb8b5fd75c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:18:32.757140  6729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20f6842e26174571996b8dea4151d4be" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:18:32.686982  7816 raft_consensus.cc:515] T 1bf4668eeb70467fb3dc5a0289233b3c P ccd8a4c3bfe3413cb2ae219b09aea832 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:32.771921  7816 leader_election.cc:290] T 1bf4668eeb70467fb3dc5a0289233b3c P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:18:32.687162  7836 raft_consensus.cc:515] T c4db81d9d329422bb3b4160ca4ac2d1d P b7ab4784c7344b939bc36f639286f377 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:32.774705  7836 leader_election.cc:290] T c4db81d9d329422bb3b4160ca4ac2d1d P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:18:32.777334  7836 raft_consensus.cc:493] T 711ef6523deb4cbe8ef2ba61e1c21c98 P b7ab4784c7344b939bc36f639286f377 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:18:32.777979  7836 raft_consensus.cc:515] T 711ef6523deb4cbe8ef2ba61e1c21c98 P b7ab4784c7344b939bc36f639286f377 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:32.735330  7831 raft_consensus.cc:515] T 713b5728a197487c9300b310ab94e5a3 P cd75a17ab2604397adab03bb8b5fd75c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:32.735666  7845 raft_consensus.cc:515] T 1528ab62b6fe4e3099d08f141afee116 P cd75a17ab2604397adab03bb8b5fd75c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } attrs { replace: true } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: NON_VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: true } }
I20260709 13:18:32.784737  7831 leader_election.cc:290] T 713b5728a197487c9300b310ab94e5a3 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:18:32.752139  7825 raft_consensus.cc:493] T 4b8cacb381b746da8d0049b0a83b41dd P cd75a17ab2604397adab03bb8b5fd75c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:18:32.784798  7845 leader_election.cc:290] T 1528ab62b6fe4e3099d08f141afee116 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:18:32.686687  7832 raft_consensus.cc:515] T 3411566abe2d4c9bb4b2adfdd05e6f17 P cd75a17ab2604397adab03bb8b5fd75c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:32.702728  7839 raft_consensus.cc:515] T 17587d6730594da4a56fa13a353232a1 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:18:32.734824  7784 raft_consensus.cc:515] T a3022224cc81473690653a83d4e99470 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:32.734908  7817 raft_consensus.cc:515] T 30e88460611e47b2ba16a46a30b5f416 P cd75a17ab2604397adab03bb8b5fd75c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:32.733819  7810 raft_consensus.cc:515] T bb3d8792045a4583ae2e965b1350a5b4 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:18:32.788403  7723 leader_election.cc:290] T 17587d6730594da4a56fa13a353232a1 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:18:32.725661  7844 raft_consensus.cc:515] T 22ccee1b570c4ad3a57bd7aec085b1b4 P cd75a17ab2604397adab03bb8b5fd75c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:32.748526  7823 raft_consensus.cc:515] T 9b3759de40694069b13c0f8bd40e5709 P cd75a17ab2604397adab03bb8b5fd75c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:32.749043  7843 raft_consensus.cc:493] T 427c124d773f483294511e80fe340075 P b7ab4784c7344b939bc36f639286f377 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader cd75a17ab2604397adab03bb8b5fd75c)
I20260709 13:18:32.760390  7833 raft_consensus.cc:493] T bd6869f07b5a4885a0b99fbe60c3b175 P cd75a17ab2604397adab03bb8b5fd75c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:18:32.797472  7848 raft_consensus.cc:493] T 3fa34c08b205435dba97346991aa1f92 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:18:32.702983  7842 raft_consensus.cc:515] T 7a734b5ab7834e05a8c422208acc58b1 P cd75a17ab2604397adab03bb8b5fd75c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:32.787686  7847 raft_consensus.cc:493] T e77e330a82df4b43a745d57a68f6f057 P cd75a17ab2604397adab03bb8b5fd75c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:18:32.799249  7776 leader_election.cc:290] T d33d5ee8ef6f415593d8df52063161ad P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:18:32.752591  7826 raft_consensus.cc:515] T 4b8cacb381b746da8d0049b0a83b41dd P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:18:32.799450  7831 raft_consensus.cc:493] T ce4f062dcd314d43a63ca74067cb5ee3 P cd75a17ab2604397adab03bb8b5fd75c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:18:32.789819  7836 leader_election.cc:290] T 711ef6523deb4cbe8ef2ba61e1c21c98 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:18:32.769037  7840 raft_consensus.cc:515] T 404190ce4ce94cecbfcb6ea9d1dd8626 P b7ab4784c7344b939bc36f639286f377 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:18:32.794353  7834 raft_consensus.cc:493] T 4275cf08e63345f993bce8664eada830 P cd75a17ab2604397adab03bb8b5fd75c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:18:32.793176  7825 raft_consensus.cc:515] T 4b8cacb381b746da8d0049b0a83b41dd P cd75a17ab2604397adab03bb8b5fd75c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:18:32.842394  7723 raft_consensus.cc:493] T e77e330a82df4b43a745d57a68f6f057 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:18:32.842940  7723 raft_consensus.cc:515] T e77e330a82df4b43a745d57a68f6f057 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } }
I20260709 13:18:32.735028  7846 raft_consensus.cc:515] T b56bf91d90824c959e21e0cee5ba1816 P cd75a17ab2604397adab03bb8b5fd75c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:32.847671  7776 raft_consensus.cc:493] T 9e326172347f45e99a0d482b5d8ef768 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:18:32.806674  7850 raft_consensus.cc:493] T bb3d8792045a4583ae2e965b1350a5b4 P cd75a17ab2604397adab03bb8b5fd75c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:18:32.838055  6731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbdf895bba214ff68685a24fd17dfb5d" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:18:32.817215  7833 raft_consensus.cc:515] T bd6869f07b5a4885a0b99fbe60c3b175 P cd75a17ab2604397adab03bb8b5fd75c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:32.856734  7776 raft_consensus.cc:515] T 9e326172347f45e99a0d482b5d8ef768 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:32.858009  7723 leader_election.cc:290] T e77e330a82df4b43a745d57a68f6f057 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:18:32.838156  7845 raft_consensus.cc:493] T 711ef6523deb4cbe8ef2ba61e1c21c98 P cd75a17ab2604397adab03bb8b5fd75c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:18:32.818312  7831 raft_consensus.cc:515] T ce4f062dcd314d43a63ca74067cb5ee3 P cd75a17ab2604397adab03bb8b5fd75c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } attrs { replace: true } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: NON_VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: true } }
I20260709 13:18:32.841668  7836 raft_consensus.cc:493] T b56bf91d90824c959e21e0cee5ba1816 P b7ab4784c7344b939bc36f639286f377 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:18:32.865188  7776 leader_election.cc:290] T 9e326172347f45e99a0d482b5d8ef768 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:18:32.806774  7838 raft_consensus.cc:493] T 44bde925b2e541b69890d70715b85176 P b7ab4784c7344b939bc36f639286f377 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:18:32.851917  7837 leader_election.cc:290] T 7887766dc6784fcaa42b35c05fea7a99 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:18:32.862655  7856 raft_consensus.cc:493] T 07a92dd554674067a83a9cb68c4773f2 P cd75a17ab2604397adab03bb8b5fd75c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:18:32.863293  7855 raft_consensus.cc:493] T 404190ce4ce94cecbfcb6ea9d1dd8626 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:18:32.864177  7833 leader_election.cc:290] T bd6869f07b5a4885a0b99fbe60c3b175 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:18:32.818670  7847 raft_consensus.cc:515] T e77e330a82df4b43a745d57a68f6f057 P cd75a17ab2604397adab03bb8b5fd75c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } }
I20260709 13:18:32.874188  7833 raft_consensus.cc:493] T d33d5ee8ef6f415593d8df52063161ad P cd75a17ab2604397adab03bb8b5fd75c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:18:32.847601  7816 raft_consensus.cc:493] T 9b3759de40694069b13c0f8bd40e5709 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:18:32.874644  7841 leader_election.cc:290] T 1bf4668eeb70467fb3dc5a0289233b3c P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:18:32.875218  7816 raft_consensus.cc:515] T 9b3759de40694069b13c0f8bd40e5709 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:32.849557  6726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44bde925b2e541b69890d70715b85176" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:18:32.794970  7851 raft_consensus.cc:515] T 90d42e216d9741e190bca19a781291fd P cd75a17ab2604397adab03bb8b5fd75c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:32.859287  7859 raft_consensus.cc:493] T 7c44c4849aa54f2b94d1f1bef9ed546f P b7ab4784c7344b939bc36f639286f377 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:18:32.875456  7829 leader_election.cc:290] T fe20b4b48823486ca3b9c648db6ce8aa P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:18:32.868790  7836 raft_consensus.cc:515] T b56bf91d90824c959e21e0cee5ba1816 P b7ab4784c7344b939bc36f639286f377 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:32.940797  7849 raft_consensus.cc:493] T f3f9c2e2bf644115957398fe4c9459db P b7ab4784c7344b939bc36f639286f377 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:18:32.946925  7859 raft_consensus.cc:515] T 7c44c4849aa54f2b94d1f1bef9ed546f P b7ab4784c7344b939bc36f639286f377 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:32.873184  7837 raft_consensus.cc:493] T 95a75bfe094d4bdc963aba3f08dfcd25 P cd75a17ab2604397adab03bb8b5fd75c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:18:32.945210  7816 leader_election.cc:290] T 9b3759de40694069b13c0f8bd40e5709 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:18:32.870663  7845 raft_consensus.cc:515] T 711ef6523deb4cbe8ef2ba61e1c21c98 P cd75a17ab2604397adab03bb8b5fd75c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:32.945847  7858 raft_consensus.cc:493] T f58dc08b12a2494bb9a1372837970ca2 P b7ab4784c7344b939bc36f639286f377 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:18:32.870172  7850 raft_consensus.cc:515] T bb3d8792045a4583ae2e965b1350a5b4 P cd75a17ab2604397adab03bb8b5fd75c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:18:32.948200  7849 raft_consensus.cc:515] T f3f9c2e2bf644115957398fe4c9459db P b7ab4784c7344b939bc36f639286f377 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:32.949136  7836 leader_election.cc:290] T b56bf91d90824c959e21e0cee5ba1816 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:18:32.847345  6725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09c2a98de1a4decabd0ff900dd44caa" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:18:32.837595  7848 raft_consensus.cc:515] T 3fa34c08b205435dba97346991aa1f92 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:18:32.949529  7859 leader_election.cc:290] T 7c44c4849aa54f2b94d1f1bef9ed546f P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:18:32.953131  7824 leader_election.cc:290] T a1704639a875409b9959353527b3fd68 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:18:32.875487  7841 raft_consensus.cc:493] T fe20b4b48823486ca3b9c648db6ce8aa P cd75a17ab2604397adab03bb8b5fd75c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:18:32.963075  6727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f03d0dbf16864ca4bc1bb5e4c0334c0f" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:18:32.959914  7817 leader_election.cc:290] T 30e88460611e47b2ba16a46a30b5f416 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:18:32.954152  7837 raft_consensus.cc:515] T 95a75bfe094d4bdc963aba3f08dfcd25 P cd75a17ab2604397adab03bb8b5fd75c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:32.874697  7833 raft_consensus.cc:515] T d33d5ee8ef6f415593d8df52063161ad P cd75a17ab2604397adab03bb8b5fd75c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:32.979561  7848 leader_election.cc:290] T 3fa34c08b205435dba97346991aa1f92 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:18:32.972506  6726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be1a92657f494cac8dd227d152f50151" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:18:32.856269  7834 raft_consensus.cc:515] T 4275cf08e63345f993bce8664eada830 P cd75a17ab2604397adab03bb8b5fd75c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:32.975759  7810 leader_election.cc:290] T bb3d8792045a4583ae2e965b1350a5b4 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:18:32.983273  7833 leader_election.cc:290] T d33d5ee8ef6f415593d8df52063161ad P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:18:32.985106  7840 leader_election.cc:290] T 404190ce4ce94cecbfcb6ea9d1dd8626 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:18:32.986533  7839 leader_election.cc:290] T 17587d6730594da4a56fa13a353232a1 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:18:32.835902  7843 raft_consensus.cc:515] T 427c124d773f483294511e80fe340075 P b7ab4784c7344b939bc36f639286f377 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } attrs { replace: true } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: NON_VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: true } }
I20260709 13:18:32.952232  7856 raft_consensus.cc:515] T 07a92dd554674067a83a9cb68c4773f2 P cd75a17ab2604397adab03bb8b5fd75c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:32.951316  7838 raft_consensus.cc:515] T 44bde925b2e541b69890d70715b85176 P b7ab4784c7344b939bc36f639286f377 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:32.993108  7831 leader_election.cc:290] T ce4f062dcd314d43a63ca74067cb5ee3 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:18:32.993860  7826 leader_election.cc:290] T 4b8cacb381b746da8d0049b0a83b41dd P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:18:32.998272  7842 leader_election.cc:290] T 7a734b5ab7834e05a8c422208acc58b1 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:18:32.999172  7852 raft_consensus.cc:493] T 7a734b5ab7834e05a8c422208acc58b1 P b7ab4784c7344b939bc36f639286f377 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:18:32.987499  6724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e326172347f45e99a0d482b5d8ef768" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:18:32.956466  7855 raft_consensus.cc:515] T 404190ce4ce94cecbfcb6ea9d1dd8626 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:18:32.964344  7858 raft_consensus.cc:515] T f58dc08b12a2494bb9a1372837970ca2 P b7ab4784c7344b939bc36f639286f377 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:32.999960  7852 raft_consensus.cc:515] T 7a734b5ab7834e05a8c422208acc58b1 P b7ab4784c7344b939bc36f639286f377 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:33.018066  6725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b8cacb381b746da8d0049b0a83b41dd" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:18:33.018301  6726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3d8792045a4583ae2e965b1350a5b4" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:18:33.015272  6727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe20b4b48823486ca3b9c648db6ce8aa" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:18:33.006457  7784 leader_election.cc:290] T a3022224cc81473690653a83d4e99470 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:18:33.010856  7825 leader_election.cc:290] T 4b8cacb381b746da8d0049b0a83b41dd P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:18:33.021924  7846 leader_election.cc:290] T b56bf91d90824c959e21e0cee5ba1816 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:18:32.983405  7860 raft_consensus.cc:493] T b3f13b31a1f84f0d89d007eadd57924c P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:18:33.025441  7843 leader_election.cc:290] T 427c124d773f483294511e80fe340075 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:18:33.011507  6724 raft_consensus.cc:2468] T 9e326172347f45e99a0d482b5d8ef768 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 1.
I20260709 13:18:33.016139  7838 leader_election.cc:290] T 44bde925b2e541b69890d70715b85176 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:18:33.031133  7821 raft_consensus.cc:1064] T 1528ab62b6fe4e3099d08f141afee116 P ccd8a4c3bfe3413cb2ae219b09aea832: attempting to promote NON_VOTER 7ba59cc884714e8aa5f3f0ecaed84cbb to VOTER
I20260709 13:18:33.037936  7499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17587d6730594da4a56fa13a353232a1" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:18:33.029723  6731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fa34c08b205435dba97346991aa1f92" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:18:32.970103  7841 raft_consensus.cc:515] T fe20b4b48823486ca3b9c648db6ce8aa P cd75a17ab2604397adab03bb8b5fd75c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:18:33.022789  7844 leader_election.cc:290] T 22ccee1b570c4ad3a57bd7aec085b1b4 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:18:33.031126  6732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17587d6730594da4a56fa13a353232a1" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:18:33.047143  7823 leader_election.cc:290] T 9b3759de40694069b13c0f8bd40e5709 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:18:32.979139  7859 raft_consensus.cc:493] T 3411566abe2d4c9bb4b2adfdd05e6f17 P b7ab4784c7344b939bc36f639286f377 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:18:33.043097  7499 raft_consensus.cc:2468] T 17587d6730594da4a56fa13a353232a1 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 2.
I20260709 13:18:33.064831  7856 leader_election.cc:290] T 07a92dd554674067a83a9cb68c4773f2 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:18:33.062155  6732 raft_consensus.cc:2468] T 17587d6730594da4a56fa13a353232a1 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in term 2.
I20260709 13:18:33.033898  7860 raft_consensus.cc:515] T b3f13b31a1f84f0d89d007eadd57924c P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:18:33.065714  7845 leader_election.cc:290] T 711ef6523deb4cbe8ef2ba61e1c21c98 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:18:33.064924  7859 raft_consensus.cc:515] T 3411566abe2d4c9bb4b2adfdd05e6f17 P b7ab4784c7344b939bc36f639286f377 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:33.063539  7834 leader_election.cc:290] T 4275cf08e63345f993bce8664eada830 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:18:33.091467  7847 leader_election.cc:290] T e77e330a82df4b43a745d57a68f6f057 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391)
I20260709 13:18:33.087072  7466 leader_election.cc:304] T 17587d6730594da4a56fa13a353232a1 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
I20260709 13:18:33.094887  6732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "404190ce4ce94cecbfcb6ea9d1dd8626" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:18:33.067324  7849 leader_election.cc:290] T f3f9c2e2bf644115957398fe4c9459db P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:18:33.067516  7855 leader_election.cc:290] T 404190ce4ce94cecbfcb6ea9d1dd8626 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:18:33.095329  7784 raft_consensus.cc:1064] T 24ee15416e3145beaa1b8183453729a3 P ccd8a4c3bfe3413cb2ae219b09aea832: attempting to promote NON_VOTER 7ba59cc884714e8aa5f3f0ecaed84cbb to VOTER
W20260709 13:18:33.160548  6697 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.68:45071, user_credentials={real_user=slave}} blocked reactor thread for 64738.1us
I20260709 13:18:33.167740  6697 leader_election.cc:304] T 17587d6730594da4a56fa13a353232a1 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
I20260709 13:18:33.169513  7837 leader_election.cc:290] T 95a75bfe094d4bdc963aba3f08dfcd25 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:18:33.106856  7826 raft_consensus.cc:2804] T 17587d6730594da4a56fa13a353232a1 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:18:33.116284  7851 leader_election.cc:290] T 90d42e216d9741e190bca19a781291fd P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:18:33.161063  7841 leader_election.cc:290] T fe20b4b48823486ca3b9c648db6ce8aa P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:18:33.168705  7858 leader_election.cc:290] T f58dc08b12a2494bb9a1372837970ca2 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:18:33.176510  7816 raft_consensus.cc:2804] T 17587d6730594da4a56fa13a353232a1 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:18:33.177675  7826 raft_consensus.cc:493] T 17587d6730594da4a56fa13a353232a1 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 2 FOLLOWER]: Starting leader election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:18:33.187125  7826 raft_consensus.cc:3060] T 17587d6730594da4a56fa13a353232a1 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:33.187763  7860 leader_election.cc:290] T b3f13b31a1f84f0d89d007eadd57924c P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:18:33.188153  7784 consensus_queue.cc:237] T 24ee15416e3145beaa1b8183453729a3 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } attrs { replace: true } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:18:33.189275  7821 consensus_queue.cc:237] T 1528ab62b6fe4e3099d08f141afee116 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } attrs { replace: true } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:18:33.112259  7850 leader_election.cc:290] T bb3d8792045a4583ae2e965b1350a5b4 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:18:33.171607  7852 leader_election.cc:290] T 7a734b5ab7834e05a8c422208acc58b1 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:18:33.186791  7816 raft_consensus.cc:493] T 17587d6730594da4a56fa13a353232a1 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 2 FOLLOWER]: Starting leader election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:18:33.204236  7816 raft_consensus.cc:3060] T 17587d6730594da4a56fa13a353232a1 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:33.203173  7858 raft_consensus.cc:493] T 1528ab62b6fe4e3099d08f141afee116 P b7ab4784c7344b939bc36f639286f377 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:18:33.210438  6732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3f13b31a1f84f0d89d007eadd57924c" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:18:33.215323  6805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c44c4849aa54f2b94d1f1bef9ed546f" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:18:33.216838  7865 raft_consensus.cc:493] T f4b8bd455d5a47c18a1380839c6e0d61 P cd75a17ab2604397adab03bb8b5fd75c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:18:33.217163  6805 raft_consensus.cc:2468] T 7c44c4849aa54f2b94d1f1bef9ed546f P b7ab4784c7344b939bc36f639286f377 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 1.
I20260709 13:18:33.217638  7865 raft_consensus.cc:515] T f4b8bd455d5a47c18a1380839c6e0d61 P cd75a17ab2604397adab03bb8b5fd75c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:33.221803  7853 raft_consensus.cc:493] T 3d65025eea89441290d85dd053810e31 P b7ab4784c7344b939bc36f639286f377 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader cd75a17ab2604397adab03bb8b5fd75c)
I20260709 13:18:33.207245  7849 raft_consensus.cc:493] T f5be3a11b23d4ea9b08300a2789821c7 P b7ab4784c7344b939bc36f639286f377 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader cd75a17ab2604397adab03bb8b5fd75c)
I20260709 13:18:33.219774  7865 leader_election.cc:290] T f4b8bd455d5a47c18a1380839c6e0d61 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:18:33.208791  7852 raft_consensus.cc:493] T e31b9971c15848dea59d4d4130141d9e P b7ab4784c7344b939bc36f639286f377 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:18:33.224800  6802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a485a995abc4807b6e511e45419f737" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:18:33.225327  6800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c240553ce044eedb41541d72b9475d7" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:18:33.227921  6802 raft_consensus.cc:2468] T 3a485a995abc4807b6e511e45419f737 P b7ab4784c7344b939bc36f639286f377 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 1.
I20260709 13:18:33.229391  7852 raft_consensus.cc:515] T e31b9971c15848dea59d4d4130141d9e P b7ab4784c7344b939bc36f639286f377 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:33.231575  7852 leader_election.cc:290] T e31b9971c15848dea59d4d4130141d9e P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:18:33.232074  6807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24ee15416e3145beaa1b8183453729a3" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:18:33.233047  6804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e31b9971c15848dea59d4d4130141d9e" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:18:33.233367  6801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d9def8b32fd443aa94ab1420b06837b" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:18:33.233762  6804 raft_consensus.cc:2468] T e31b9971c15848dea59d4d4130141d9e P b7ab4784c7344b939bc36f639286f377 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 1.
I20260709 13:18:33.233975  7832 leader_election.cc:290] T 3411566abe2d4c9bb4b2adfdd05e6f17 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:18:33.234925  6804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f9c2e2bf644115957398fe4c9459db" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:18:33.235581  6804 raft_consensus.cc:2468] T f3f9c2e2bf644115957398fe4c9459db P b7ab4784c7344b939bc36f639286f377 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 1.
I20260709 13:18:33.235845  6799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09c2a98de1a4decabd0ff900dd44caa" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:18:33.236114  7862 raft_consensus.cc:493] T 4d9def8b32fd443aa94ab1420b06837b P b7ab4784c7344b939bc36f639286f377 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:18:33.223140  7840 raft_consensus.cc:493] T 24ee15416e3145beaa1b8183453729a3 P b7ab4784c7344b939bc36f639286f377 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:18:33.236802  7862 raft_consensus.cc:515] T 4d9def8b32fd443aa94ab1420b06837b P b7ab4784c7344b939bc36f639286f377 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:33.236687  6799 raft_consensus.cc:2468] T f09c2a98de1a4decabd0ff900dd44caa P b7ab4784c7344b939bc36f639286f377 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 1.
I20260709 13:18:33.237569  6806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4db81d9d329422bb3b4160ca4ac2d1d" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:18:33.245780  6806 raft_consensus.cc:2468] T c4db81d9d329422bb3b4160ca4ac2d1d P b7ab4784c7344b939bc36f639286f377 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 1.
I20260709 13:18:33.247179  6805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab432e62819d499eaaf3dd55481dd930" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:18:33.236903  7840 raft_consensus.cc:515] T 24ee15416e3145beaa1b8183453729a3 P b7ab4784c7344b939bc36f639286f377 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } attrs { replace: true } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: NON_VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: true } }
I20260709 13:18:33.222318  7853 raft_consensus.cc:515] T 3d65025eea89441290d85dd053810e31 P b7ab4784c7344b939bc36f639286f377 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:33.247792  6805 raft_consensus.cc:2468] T ab432e62819d499eaaf3dd55481dd930 P b7ab4784c7344b939bc36f639286f377 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 1.
I20260709 13:18:33.221346  7850 raft_consensus.cc:493] T de3186201e1a40d0b335eeb8b4e256e0 P cd75a17ab2604397adab03bb8b5fd75c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:18:33.245118  7851 raft_consensus.cc:493] T 853ac0a8cbd64ce99457f170216d4d0f P cd75a17ab2604397adab03bb8b5fd75c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:18:33.254127  6806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20f6842e26174571996b8dea4151d4be" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:18:33.246884  6801 raft_consensus.cc:2468] T 4d9def8b32fd443aa94ab1420b06837b P b7ab4784c7344b939bc36f639286f377 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 1.
I20260709 13:18:33.246574  7859 leader_election.cc:290] T 3411566abe2d4c9bb4b2adfdd05e6f17 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
W20260709 13:18:33.255610  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 378854us
I20260709 13:18:33.256624  6806 raft_consensus.cc:2468] T 20f6842e26174571996b8dea4151d4be P b7ab4784c7344b939bc36f639286f377 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 1.
I20260709 13:18:33.257166  6807 raft_consensus.cc:2468] T 24ee15416e3145beaa1b8183453729a3 P b7ab4784c7344b939bc36f639286f377 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 1.
I20260709 13:18:33.236306  7849 raft_consensus.cc:515] T f5be3a11b23d4ea9b08300a2789821c7 P b7ab4784c7344b939bc36f639286f377 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:33.255226  7862 leader_election.cc:290] T 4d9def8b32fd443aa94ab1420b06837b P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:18:33.223546  7858 raft_consensus.cc:515] T 1528ab62b6fe4e3099d08f141afee116 P b7ab4784c7344b939bc36f639286f377 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } attrs { replace: true } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: NON_VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: true } }
I20260709 13:18:33.256049  7826 raft_consensus.cc:515] T 17587d6730594da4a56fa13a353232a1 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:18:33.268427  6805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbdf895bba214ff68685a24fd17dfb5d" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:18:33.269042  6805 raft_consensus.cc:2468] T dbdf895bba214ff68685a24fd17dfb5d P b7ab4784c7344b939bc36f639286f377 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 1.
I20260709 13:18:33.278828  6724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7887766dc6784fcaa42b35c05fea7a99" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:18:33.275310  7869 raft_consensus.cc:493] T 07a92dd554674067a83a9cb68c4773f2 P b7ab4784c7344b939bc36f639286f377 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:18:33.256666  7850 raft_consensus.cc:515] T de3186201e1a40d0b335eeb8b4e256e0 P cd75a17ab2604397adab03bb8b5fd75c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:33.259197  7851 raft_consensus.cc:515] T 853ac0a8cbd64ce99457f170216d4d0f P cd75a17ab2604397adab03bb8b5fd75c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:33.274957  7468 leader_election.cc:304] T bb7fa124c3bf4ef9ab65a407cb008441 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:18:33.266278  7841 raft_consensus.cc:493] T f58dc08b12a2494bb9a1372837970ca2 P cd75a17ab2604397adab03bb8b5fd75c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
W20260709 13:18:33.300631  6695 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:33.380636  6731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1528ab62b6fe4e3099d08f141afee116" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:18:33.380672  7859 raft_consensus.cc:493] T 22ccee1b570c4ad3a57bd7aec085b1b4 P b7ab4784c7344b939bc36f639286f377 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:18:33.386859  6724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90d42e216d9741e190bca19a781291fd" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:18:33.386859  7859 raft_consensus.cc:515] T 22ccee1b570c4ad3a57bd7aec085b1b4 P b7ab4784c7344b939bc36f639286f377 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:33.381635  6727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6869f07b5a4885a0b99fbe60c3b175" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:18:33.331333  7868 raft_consensus.cc:493] T 7ba5dac66ab5497e9e336f2a3c28cda5 P b7ab4784c7344b939bc36f639286f377 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader cd75a17ab2604397adab03bb8b5fd75c)
I20260709 13:18:33.388741  6727 raft_consensus.cc:2468] T bd6869f07b5a4885a0b99fbe60c3b175 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 2.
I20260709 13:18:33.389528  7859 leader_election.cc:290] T 22ccee1b570c4ad3a57bd7aec085b1b4 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:18:33.394663  6729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d33d5ee8ef6f415593d8df52063161ad" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:18:33.395361  6729 raft_consensus.cc:2468] T d33d5ee8ef6f415593d8df52063161ad P ccd8a4c3bfe3413cb2ae219b09aea832 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 1.
I20260709 13:18:33.396661  6802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be1a92657f494cac8dd227d152f50151" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:18:33.324637  7826 leader_election.cc:290] T 17587d6730594da4a56fa13a353232a1 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 3 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:18:33.401190  6799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44bde925b2e541b69890d70715b85176" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:18:33.401958  6799 raft_consensus.cc:2468] T 44bde925b2e541b69890d70715b85176 P b7ab4784c7344b939bc36f639286f377 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 1.
I20260709 13:18:33.403255  6805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17587d6730594da4a56fa13a353232a1" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:18:33.403995  7816 raft_consensus.cc:515] T 17587d6730594da4a56fa13a353232a1 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:18:33.404546  6805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3f13b31a1f84f0d89d007eadd57924c" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:18:33.405642  6800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "404190ce4ce94cecbfcb6ea9d1dd8626" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:18:33.406173  6800 raft_consensus.cc:2468] T 404190ce4ce94cecbfcb6ea9d1dd8626 P b7ab4784c7344b939bc36f639286f377 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in term 1.
I20260709 13:18:33.402593  6804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb7fa124c3bf4ef9ab65a407cb008441" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:18:33.277549  7832 raft_consensus.cc:493] T 34f36d59d88f40fe8a2805e604fc6c0a P cd75a17ab2604397adab03bb8b5fd75c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:18:33.408517  6802 raft_consensus.cc:2468] T be1a92657f494cac8dd227d152f50151 P b7ab4784c7344b939bc36f639286f377 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in term 1.
I20260709 13:18:33.287734  6732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "713b5728a197487c9300b310ab94e5a3" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:18:33.418967  6729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce4f062dcd314d43a63ca74067cb5ee3" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:18:33.420006  6729 raft_consensus.cc:2468] T ce4f062dcd314d43a63ca74067cb5ee3 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 1.
I20260709 13:18:33.380407  7870 raft_consensus.cc:493] T 34f36d59d88f40fe8a2805e604fc6c0a P b7ab4784c7344b939bc36f639286f377 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:18:33.431159  6726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1704639a875409b9959353527b3fd68" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:18:33.431583  7870 raft_consensus.cc:515] T 34f36d59d88f40fe8a2805e604fc6c0a P b7ab4784c7344b939bc36f639286f377 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:33.432533  6726 raft_consensus.cc:2468] T a1704639a875409b9959353527b3fd68 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 1.
I20260709 13:18:33.435118  7870 leader_election.cc:290] T 34f36d59d88f40fe8a2805e604fc6c0a P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:18:33.294756  7866 raft_consensus.cc:493] T 7c37d41cd9164c15a6826ca62a851a69 P cd75a17ab2604397adab03bb8b5fd75c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:18:33.436213  7866 raft_consensus.cc:515] T 7c37d41cd9164c15a6826ca62a851a69 P cd75a17ab2604397adab03bb8b5fd75c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:33.438903  7866 leader_election.cc:290] T 7c37d41cd9164c15a6826ca62a851a69 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:18:33.323195  7867 raft_consensus.cc:493] T d8292e16e5654be6bc408560cf256aaa P cd75a17ab2604397adab03bb8b5fd75c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:18:33.439739  7867 raft_consensus.cc:515] T d8292e16e5654be6bc408560cf256aaa P cd75a17ab2604397adab03bb8b5fd75c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:33.442018  7867 leader_election.cc:290] T d8292e16e5654be6bc408560cf256aaa P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:18:33.329530  7858 leader_election.cc:290] T 1528ab62b6fe4e3099d08f141afee116 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:18:33.331179  7849 leader_election.cc:290] T f5be3a11b23d4ea9b08300a2789821c7 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:18:33.443516  6799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e326172347f45e99a0d482b5d8ef768" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:18:33.369642  6725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30e88460611e47b2ba16a46a30b5f416" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:18:33.387789  6724 raft_consensus.cc:2468] T 90d42e216d9741e190bca19a781291fd P ccd8a4c3bfe3413cb2ae219b09aea832 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 1.
I20260709 13:18:33.359870  7840 leader_election.cc:290] T 24ee15416e3145beaa1b8183453729a3 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:18:33.398506  7841 raft_consensus.cc:515] T f58dc08b12a2494bb9a1372837970ca2 P cd75a17ab2604397adab03bb8b5fd75c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:33.447503  6730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bf4668eeb70467fb3dc5a0289233b3c" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:18:33.388918  7868 raft_consensus.cc:515] T 7ba5dac66ab5497e9e336f2a3c28cda5 P b7ab4784c7344b939bc36f639286f377 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:18:33.476392  6800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1528ab62b6fe4e3099d08f141afee116" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:18:33.476711  6799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6869f07b5a4885a0b99fbe60c3b175" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:18:33.486255  6881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c7f33e544204fbaac4078e3e83bbf4e" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:18:33.476392  6805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7887766dc6784fcaa42b35c05fea7a99" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:18:33.506649  6807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f00a2e87e56452083b759f60d461ee3" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:18:33.473834  6806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "713b5728a197487c9300b310ab94e5a3" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:18:33.508001  6806 raft_consensus.cc:2468] T 713b5728a197487c9300b310ab94e5a3 P b7ab4784c7344b939bc36f639286f377 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 1.
I20260709 13:18:33.508396  6728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3411566abe2d4c9bb4b2adfdd05e6f17" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:18:33.509362  6878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce4f062dcd314d43a63ca74067cb5ee3" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:18:33.509290  6729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22ccee1b570c4ad3a57bd7aec085b1b4" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:18:33.510022  6878 raft_consensus.cc:2468] T ce4f062dcd314d43a63ca74067cb5ee3 P cd75a17ab2604397adab03bb8b5fd75c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 1.
I20260709 13:18:33.512050  6723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b56bf91d90824c959e21e0cee5ba1816" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:18:33.486348  6725 raft_consensus.cc:2468] T 30e88460611e47b2ba16a46a30b5f416 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 1.
I20260709 13:18:33.519420  6799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30e88460611e47b2ba16a46a30b5f416" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:18:33.521876  6804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1704639a875409b9959353527b3fd68" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:18:33.522421  6729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4275cf08e63345f993bce8664eada830" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:18:33.522150  6802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f03d0dbf16864ca4bc1bb5e4c0334c0f" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:18:33.523553  6802 raft_consensus.cc:2468] T f03d0dbf16864ca4bc1bb5e4c0334c0f P b7ab4784c7344b939bc36f639286f377 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 1.
I20260709 13:18:33.448819  7826 raft_consensus.cc:2804] T bb7fa124c3bf4ef9ab65a407cb008441 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:18:33.529593  6877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5be3a11b23d4ea9b08300a2789821c7" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:18:33.534984  6807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bf4668eeb70467fb3dc5a0289233b3c" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:18:33.505394  6800 raft_consensus.cc:2468] T 1528ab62b6fe4e3099d08f141afee116 P b7ab4784c7344b939bc36f639286f377 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 1.
I20260709 13:18:33.450251  6727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b3759de40694069b13c0f8bd40e5709" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:18:33.505419  6805 raft_consensus.cc:2468] T 7887766dc6784fcaa42b35c05fea7a99 P b7ab4784c7344b939bc36f639286f377 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 1.
W20260709 13:18:33.443722  7468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 177563us
I20260709 13:18:33.447834  7832 raft_consensus.cc:515] T 34f36d59d88f40fe8a2805e604fc6c0a P cd75a17ab2604397adab03bb8b5fd75c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:33.540176  6723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77e330a82df4b43a745d57a68f6f057" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:18:33.537518  6874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90d42e216d9741e190bca19a781291fd" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:18:33.297637  7869 raft_consensus.cc:515] T 07a92dd554674067a83a9cb68c4773f2 P b7ab4784c7344b939bc36f639286f377 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:33.586273  6881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de3186201e1a40d0b335eeb8b4e256e0" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:18:33.588860  6877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8292e16e5654be6bc408560cf256aaa" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:18:33.517547  6730 raft_consensus.cc:2468] T 1bf4668eeb70467fb3dc5a0289233b3c P ccd8a4c3bfe3413cb2ae219b09aea832 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 1.
I20260709 13:18:33.541676  6876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a75bfe094d4bdc963aba3f08dfcd25" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:18:33.717787  6874 raft_consensus.cc:2468] T 90d42e216d9741e190bca19a781291fd P cd75a17ab2604397adab03bb8b5fd75c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 1.
I20260709 13:18:33.723151  6876 raft_consensus.cc:2468] T 95a75bfe094d4bdc963aba3f08dfcd25 P cd75a17ab2604397adab03bb8b5fd75c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 1.
I20260709 13:18:33.587471  6878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "427c124d773f483294511e80fe340075" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
W20260709 13:18:33.571235  6698 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:33.555379  6806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77e330a82df4b43a745d57a68f6f057" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:18:33.541100  6879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1704639a875409b9959353527b3fd68" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:18:33.723873  6874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6869f07b5a4885a0b99fbe60c3b175" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:18:33.726002  6879 raft_consensus.cc:2468] T a1704639a875409b9959353527b3fd68 P cd75a17ab2604397adab03bb8b5fd75c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 1.
I20260709 13:18:33.726204  6874 raft_consensus.cc:2468] T bd6869f07b5a4885a0b99fbe60c3b175 P cd75a17ab2604397adab03bb8b5fd75c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 2.
I20260709 13:18:33.717051  6877 raft_consensus.cc:2468] T d8292e16e5654be6bc408560cf256aaa P cd75a17ab2604397adab03bb8b5fd75c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 1.
I20260709 13:18:33.570627  6729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3d8792045a4583ae2e965b1350a5b4" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:18:33.569878  6728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "711ef6523deb4cbe8ef2ba61e1c21c98" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:18:33.588872  6880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30e88460611e47b2ba16a46a30b5f416" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:18:33.728159  7840 raft_consensus.cc:493] T f4b8bd455d5a47c18a1380839c6e0d61 P b7ab4784c7344b939bc36f639286f377 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:18:33.577431  7503 raft_consensus.cc:1275] T 1528ab62b6fe4e3099d08f141afee116 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 1 LEARNER]: Refusing update from remote peer ccd8a4c3bfe3413cb2ae219b09aea832: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:18:33.742244  7840 raft_consensus.cc:515] T f4b8bd455d5a47c18a1380839c6e0d61 P b7ab4784c7344b939bc36f639286f377 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:33.743355  6877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d33d5ee8ef6f415593d8df52063161ad" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:18:33.740386  6803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c7f33e544204fbaac4078e3e83bbf4e" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:18:33.728866  6804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17587d6730594da4a56fa13a353232a1" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:18:33.744992  6874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe20b4b48823486ca3b9c648db6ce8aa" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:18:33.571034  6731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b8cacb381b746da8d0049b0a83b41dd" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:18:33.746212  6807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d33d5ee8ef6f415593d8df52063161ad" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:18:33.593001  6725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a92dd554674067a83a9cb68c4773f2" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
W20260709 13:18:33.676693  6695 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:33.717731  6881 raft_consensus.cc:2468] T de3186201e1a40d0b335eeb8b4e256e0 P cd75a17ab2604397adab03bb8b5fd75c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 1.
I20260709 13:18:33.749296  7851 leader_election.cc:290] T 853ac0a8cbd64ce99457f170216d4d0f P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:18:33.744159  6877 raft_consensus.cc:2468] T d33d5ee8ef6f415593d8df52063161ad P cd75a17ab2604397adab03bb8b5fd75c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 1.
I20260709 13:18:33.744765  7840 leader_election.cc:290] T f4b8bd455d5a47c18a1380839c6e0d61 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
W20260709 13:18:33.752668  6698 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:33.728317  6728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17587d6730594da4a56fa13a353232a1" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:18:33.754011  6872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c240553ce044eedb41541d72b9475d7" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:18:33.741461  6875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b8cacb381b746da8d0049b0a83b41dd" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:18:33.754841  6875 raft_consensus.cc:2468] T 4b8cacb381b746da8d0049b0a83b41dd P cd75a17ab2604397adab03bb8b5fd75c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in term 1.
I20260709 13:18:33.536974  7826 raft_consensus.cc:493] T bb7fa124c3bf4ef9ab65a407cb008441 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 1 FOLLOWER]: Starting leader election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:18:33.541793  6724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe20b4b48823486ca3b9c648db6ce8aa" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:18:33.751864  6729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4b8bd455d5a47c18a1380839c6e0d61" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:18:33.754160  6876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fa34c08b205435dba97346991aa1f92" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:18:33.763957  6876 raft_consensus.cc:2468] T 3fa34c08b205435dba97346991aa1f92 P cd75a17ab2604397adab03bb8b5fd75c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in term 1.
I20260709 13:18:33.764189  6879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bf4668eeb70467fb3dc5a0289233b3c" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:18:33.755653  6875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "711ef6523deb4cbe8ef2ba61e1c21c98" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:18:33.756129  6728 raft_consensus.cc:2393] T 17587d6730594da4a56fa13a353232a1 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in current term 3: Already voted for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in this term.
I20260709 13:18:33.585300  6732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a75bfe094d4bdc963aba3f08dfcd25" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:18:33.580256  6801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8cee0accdb8499c86d4414b72565a38" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:18:33.596127  7816 leader_election.cc:290] T 17587d6730594da4a56fa13a353232a1 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 3 election: Requested vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:18:33.722573  7832 leader_election.cc:290] T 34f36d59d88f40fe8a2805e604fc6c0a P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:18:33.781080  6728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44bde925b2e541b69890d70715b85176" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:18:33.781348  6800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3411566abe2d4c9bb4b2adfdd05e6f17" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:18:33.725108  6878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3d8792045a4583ae2e965b1350a5b4" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:18:33.656744  7868 leader_election.cc:290] T 7ba5dac66ab5497e9e336f2a3c28cda5 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:18:33.783422  6728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b56bf91d90824c959e21e0cee5ba1816" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:18:33.783797  6800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90d42e216d9741e190bca19a781291fd" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:18:33.756295  6872 raft_consensus.cc:2468] T 2c240553ce044eedb41541d72b9475d7 P cd75a17ab2604397adab03bb8b5fd75c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 1.
I20260709 13:18:33.760568  6799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce4f062dcd314d43a63ca74067cb5ee3" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:18:33.719578  6844 leader_election.cc:304] T 2c240553ce044eedb41541d72b9475d7 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:18:33.703934  7850 leader_election.cc:290] T de3186201e1a40d0b335eeb8b4e256e0 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:18:33.785193  6872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f58dc08b12a2494bb9a1372837970ca2" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:18:33.595662  7853 leader_election.cc:290] T 3d65025eea89441290d85dd053810e31 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:18:33.756889  6880 raft_consensus.cc:2468] T 30e88460611e47b2ba16a46a30b5f416 P cd75a17ab2604397adab03bb8b5fd75c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 1.
W20260709 13:18:33.785456  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 65964us
I20260709 13:18:33.761282  7869 leader_election.cc:290] T 07a92dd554674067a83a9cb68c4773f2 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:18:33.762290  7500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "404190ce4ce94cecbfcb6ea9d1dd8626" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:18:33.703513  7841 leader_election.cc:290] T f58dc08b12a2494bb9a1372837970ca2 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:18:33.592521  6873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d65025eea89441290d85dd053810e31" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:18:33.791944  6802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b56bf91d90824c959e21e0cee5ba1816" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:18:33.764981  6876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f9c2e2bf644115957398fe4c9459db" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
W20260709 13:18:33.784478  6695 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.5.126.66:42817 timed out after 1.618s (SENT) [suppressed 5 similar messages]
I20260709 13:18:33.792857  6876 raft_consensus.cc:2468] T f3f9c2e2bf644115957398fe4c9459db P cd75a17ab2604397adab03bb8b5fd75c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 1.
I20260709 13:18:33.793735  6876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b3759de40694069b13c0f8bd40e5709" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:18:33.794333  6876 raft_consensus.cc:2468] T 9b3759de40694069b13c0f8bd40e5709 P cd75a17ab2604397adab03bb8b5fd75c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 1.
I20260709 13:18:33.761735  7826 raft_consensus.cc:3060] T bb7fa124c3bf4ef9ab65a407cb008441 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:33.791674  7850 raft_consensus.cc:2804] T 2c240553ce044eedb41541d72b9475d7 P cd75a17ab2604397adab03bb8b5fd75c [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:18:33.796492  7850 raft_consensus.cc:493] T 2c240553ce044eedb41541d72b9475d7 P cd75a17ab2604397adab03bb8b5fd75c [term 1 FOLLOWER]: Starting leader election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:18:33.796885  7850 raft_consensus.cc:3060] T 2c240553ce044eedb41541d72b9475d7 P cd75a17ab2604397adab03bb8b5fd75c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:33.764911  6879 raft_consensus.cc:2468] T 1bf4668eeb70467fb3dc5a0289233b3c P cd75a17ab2604397adab03bb8b5fd75c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 1.
I20260709 13:18:33.774785  6729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "711ef6523deb4cbe8ef2ba61e1c21c98" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:18:33.773805  7499 raft_consensus.cc:1240] T 17587d6730594da4a56fa13a353232a1 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 3 FOLLOWER]: Rejecting Update request from peer b7ab4784c7344b939bc36f639286f377 for earlier term 2. Current term is 3. Ops: []
I20260709 13:18:33.777189  6874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77e330a82df4b43a745d57a68f6f057" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:18:33.802345  6874 raft_consensus.cc:2468] T e77e330a82df4b43a745d57a68f6f057 P cd75a17ab2604397adab03bb8b5fd75c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 2.
I20260709 13:18:33.778282  6875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44bde925b2e541b69890d70715b85176" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:18:33.757081  6877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b56bf91d90824c959e21e0cee5ba1816" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:18:33.778641  6807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce4f062dcd314d43a63ca74067cb5ee3" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:18:33.803579  6875 raft_consensus.cc:2468] T 44bde925b2e541b69890d70715b85176 P cd75a17ab2604397adab03bb8b5fd75c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 1.
I20260709 13:18:33.798951  6881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e326172347f45e99a0d482b5d8ef768" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:18:33.805109  6799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5be3a11b23d4ea9b08300a2789821c7" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:18:33.805298  6881 raft_consensus.cc:2468] T 9e326172347f45e99a0d482b5d8ef768 P cd75a17ab2604397adab03bb8b5fd75c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 1.
I20260709 13:18:33.795222  6802 raft_consensus.cc:2468] T b56bf91d90824c959e21e0cee5ba1816 P b7ab4784c7344b939bc36f639286f377 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 1.
I20260709 13:18:33.807487  6801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1704639a875409b9959353527b3fd68" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:18:33.803586  6877 raft_consensus.cc:2468] T b56bf91d90824c959e21e0cee5ba1816 P cd75a17ab2604397adab03bb8b5fd75c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 1.
I20260709 13:18:33.808985  6801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c240553ce044eedb41541d72b9475d7" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:18:33.809264  6807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "711ef6523deb4cbe8ef2ba61e1c21c98" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:18:33.809908  6807 raft_consensus.cc:2468] T 711ef6523deb4cbe8ef2ba61e1c21c98 P b7ab4784c7344b939bc36f639286f377 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 1.
I20260709 13:18:33.810593  6801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4275cf08e63345f993bce8664eada830" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:18:33.812893  6802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a75bfe094d4bdc963aba3f08dfcd25" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:18:33.593304  6798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ba5dac66ab5497e9e336f2a3c28cda5" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:18:33.781848  6805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b3759de40694069b13c0f8bd40e5709" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:18:33.815168  7468 leader_election.cc:304] T d8cee0accdb8499c86d4414b72565a38 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:18:33.541260  6726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a734b5ab7834e05a8c422208acc58b1" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:18:33.622144  7870 raft_consensus.cc:493] T 853ac0a8cbd64ce99457f170216d4d0f P b7ab4784c7344b939bc36f639286f377 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:18:33.782413  6878 raft_consensus.cc:2468] T bb3d8792045a4583ae2e965b1350a5b4 P cd75a17ab2604397adab03bb8b5fd75c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in term 1.
I20260709 13:18:33.816403  7870 raft_consensus.cc:515] T 853ac0a8cbd64ce99457f170216d4d0f P b7ab4784c7344b939bc36f639286f377 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:33.816944  6878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3411566abe2d4c9bb4b2adfdd05e6f17" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:18:33.798640  6876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4db81d9d329422bb3b4160ca4ac2d1d" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:18:33.783059  6803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22ccee1b570c4ad3a57bd7aec085b1b4" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:18:33.785825  6872 raft_consensus.cc:2468] T f58dc08b12a2494bb9a1372837970ca2 P cd75a17ab2604397adab03bb8b5fd75c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 1.
I20260709 13:18:33.818481  6803 raft_consensus.cc:2468] T 22ccee1b570c4ad3a57bd7aec085b1b4 P b7ab4784c7344b939bc36f639286f377 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 1.
I20260709 13:18:33.790547  6806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90d42e216d9741e190bca19a781291fd" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:18:33.792088  6880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c44c4849aa54f2b94d1f1bef9ed546f" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:18:33.786008  6728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "404190ce4ce94cecbfcb6ea9d1dd8626" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:18:33.823544  6728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f58dc08b12a2494bb9a1372837970ca2" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:18:33.799163  6800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a92dd554674067a83a9cb68c4773f2" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:18:33.744778  7466 leader_election.cc:304] T b3f13b31a1f84f0d89d007eadd57924c P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:18:33.824348  6800 raft_consensus.cc:2468] T 07a92dd554674067a83a9cb68c4773f2 P b7ab4784c7344b939bc36f639286f377 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 1.
I20260709 13:18:33.801412  6729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f9c2e2bf644115957398fe4c9459db" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:18:33.716445  6723 raft_consensus.cc:2468] T e77e330a82df4b43a745d57a68f6f057 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 2.
I20260709 13:18:33.824858  6725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c44c4849aa54f2b94d1f1bef9ed546f" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:18:33.813696  7500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ba5dac66ab5497e9e336f2a3c28cda5" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:18:33.825541  6729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4db81d9d329422bb3b4160ca4ac2d1d" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:18:33.825682  7500 raft_consensus.cc:2468] T 7ba5dac66ab5497e9e336f2a3c28cda5 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 1.
I20260709 13:18:33.814137  6874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3022224cc81473690653a83d4e99470" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:18:33.826181  6725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a734b5ab7834e05a8c422208acc58b1" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:18:33.826624  6729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "427c124d773f483294511e80fe340075" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:18:33.779691  6804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a734b5ab7834e05a8c422208acc58b1" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:18:33.827934  6804 raft_consensus.cc:2468] T 7a734b5ab7834e05a8c422208acc58b1 P b7ab4784c7344b939bc36f639286f377 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 1.
I20260709 13:18:33.782826  6732 raft_consensus.cc:2468] T 95a75bfe094d4bdc963aba3f08dfcd25 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 1.
I20260709 13:18:33.818634  7870 leader_election.cc:290] T 853ac0a8cbd64ce99457f170216d4d0f P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:18:33.814865  6875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a734b5ab7834e05a8c422208acc58b1" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:18:33.569034  6727 raft_consensus.cc:2468] T 9b3759de40694069b13c0f8bd40e5709 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 1.
I20260709 13:18:33.835167  6874 raft_consensus.cc:1275] T 1528ab62b6fe4e3099d08f141afee116 P cd75a17ab2604397adab03bb8b5fd75c [term 1 FOLLOWER]: Refusing update from remote peer ccd8a4c3bfe3413cb2ae219b09aea832: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:18:33.849896  6879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e31b9971c15848dea59d4d4130141d9e" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:18:33.853328  6804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d65025eea89441290d85dd053810e31" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:18:33.854998  6881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "427c124d773f483294511e80fe340075" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:18:33.856606  6806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4b8bd455d5a47c18a1380839c6e0d61" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:18:33.833643  6730 raft_consensus.cc:1240] T 17587d6730594da4a56fa13a353232a1 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 3 FOLLOWER]: Rejecting Update request from peer b7ab4784c7344b939bc36f639286f377 for earlier term 2. Current term is 3. Ops: []
I20260709 13:18:33.954910  6804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30e88460611e47b2ba16a46a30b5f416" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:18:33.885038  6881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5be3a11b23d4ea9b08300a2789821c7" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:18:33.856819  7500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b8cacb381b746da8d0049b0a83b41dd" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:18:33.901206  6879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1528ab62b6fe4e3099d08f141afee116" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:18:33.875765  6802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a75bfe094d4bdc963aba3f08dfcd25" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:18:33.880007  6880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d9def8b32fd443aa94ab1420b06837b" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:18:33.953809  7875 raft_consensus.cc:2804] T d8cee0accdb8499c86d4414b72565a38 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 13:18:33.911168  6695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 126729us
I20260709 13:18:33.949064  7502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe20b4b48823486ca3b9c648db6ce8aa" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:18:33.947783  6877 raft_consensus.cc:1275] T 24ee15416e3145beaa1b8183453729a3 P cd75a17ab2604397adab03bb8b5fd75c [term 1 FOLLOWER]: Refusing update from remote peer ccd8a4c3bfe3413cb2ae219b09aea832: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:18:33.962009  6878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34f36d59d88f40fe8a2805e604fc6c0a" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:18:33.958628  6728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1528ab62b6fe4e3099d08f141afee116" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:18:33.958671  6844 leader_election.cc:304] T 9e326172347f45e99a0d482b5d8ef768 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:18:33.945916  6876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22ccee1b570c4ad3a57bd7aec085b1b4" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:18:33.856742  6772 leader_election.cc:304] T 7ba5dac66ab5497e9e336f2a3c28cda5 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, b7ab4784c7344b939bc36f639286f377; no voters: 
I20260709 13:18:33.967275  6844 leader_election.cc:304] T bd6869f07b5a4885a0b99fbe60c3b175 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:18:33.968729  6728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5be3a11b23d4ea9b08300a2789821c7" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:18:33.974164  7841 raft_consensus.cc:2804] T 9e326172347f45e99a0d482b5d8ef768 P cd75a17ab2604397adab03bb8b5fd75c [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:18:33.974694  7841 raft_consensus.cc:493] T 9e326172347f45e99a0d482b5d8ef768 P cd75a17ab2604397adab03bb8b5fd75c [term 1 FOLLOWER]: Starting leader election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:18:33.975112  7841 raft_consensus.cc:3060] T 9e326172347f45e99a0d482b5d8ef768 P cd75a17ab2604397adab03bb8b5fd75c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:33.976850  6846 leader_election.cc:304] T 3fa34c08b205435dba97346991aa1f92 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, cd75a17ab2604397adab03bb8b5fd75c; no voters: ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:18:33.978026  7832 raft_consensus.cc:2804] T 3fa34c08b205435dba97346991aa1f92 P cd75a17ab2604397adab03bb8b5fd75c [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:18:33.974653  6725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d9def8b32fd443aa94ab1420b06837b" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:18:33.978433  7832 raft_consensus.cc:493] T 3fa34c08b205435dba97346991aa1f92 P cd75a17ab2604397adab03bb8b5fd75c [term 1 FOLLOWER]: Starting leader election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:18:33.979723  7832 raft_consensus.cc:3060] T 3fa34c08b205435dba97346991aa1f92 P cd75a17ab2604397adab03bb8b5fd75c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:33.960376  7850 raft_consensus.cc:515] T 2c240553ce044eedb41541d72b9475d7 P cd75a17ab2604397adab03bb8b5fd75c [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:33.989169  6872 raft_consensus.cc:1240] T 2c240553ce044eedb41541d72b9475d7 P cd75a17ab2604397adab03bb8b5fd75c [term 2 FOLLOWER]: Rejecting Update request from peer b7ab4784c7344b939bc36f639286f377 for earlier term 1. Current term is 2. Ops: []
I20260709 13:18:33.990103  7850 leader_election.cc:290] T 2c240553ce044eedb41541d72b9475d7 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 2 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
W20260709 13:18:33.956346  7466 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 211645us
I20260709 13:18:33.991351  7466 leader_election.cc:304] T 404190ce4ce94cecbfcb6ea9d1dd8626 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, b7ab4784c7344b939bc36f639286f377; no voters: ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:18:33.992309  7832 raft_consensus.cc:515] T 3fa34c08b205435dba97346991aa1f92 P cd75a17ab2604397adab03bb8b5fd75c [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:18:33.992969  6724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e31b9971c15848dea59d4d4130141d9e" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:18:33.995157  7501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3d8792045a4583ae2e965b1350a5b4" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:18:33.997300  7841 raft_consensus.cc:515] T 9e326172347f45e99a0d482b5d8ef768 P cd75a17ab2604397adab03bb8b5fd75c [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:33.999300  7841 leader_election.cc:290] T 9e326172347f45e99a0d482b5d8ef768 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 2 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:18:33.999747  6727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3411566abe2d4c9bb4b2adfdd05e6f17" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:18:34.000676  6723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24ee15416e3145beaa1b8183453729a3" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:18:34.002179  6844 leader_election.cc:304] T d33d5ee8ef6f415593d8df52063161ad P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:18:34.002511  6806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8292e16e5654be6bc408560cf256aaa" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:18:34.003067  7850 raft_consensus.cc:2804] T bd6869f07b5a4885a0b99fbe60c3b175 P cd75a17ab2604397adab03bb8b5fd75c [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:18:34.003480  7850 raft_consensus.cc:493] T bd6869f07b5a4885a0b99fbe60c3b175 P cd75a17ab2604397adab03bb8b5fd75c [term 2 FOLLOWER]: Starting leader election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:18:34.004004  7850 raft_consensus.cc:3060] T bd6869f07b5a4885a0b99fbe60c3b175 P cd75a17ab2604397adab03bb8b5fd75c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:33.960428  7875 raft_consensus.cc:493] T d8cee0accdb8499c86d4414b72565a38 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 1 FOLLOWER]: Starting leader election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:18:34.005612  7875 raft_consensus.cc:3060] T d8cee0accdb8499c86d4414b72565a38 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:34.008612  7874 raft_consensus.cc:2749] T b3f13b31a1f84f0d89d007eadd57924c P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:34.006422  7502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fa34c08b205435dba97346991aa1f92" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb"
I20260709 13:18:34.007254  7870 raft_consensus.cc:2804] T 7ba5dac66ab5497e9e336f2a3c28cda5 P b7ab4784c7344b939bc36f639286f377 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:18:34.009809  7874 raft_consensus.cc:2804] T 404190ce4ce94cecbfcb6ea9d1dd8626 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:18:34.009954  7870 raft_consensus.cc:493] T 7ba5dac66ab5497e9e336f2a3c28cda5 P b7ab4784c7344b939bc36f639286f377 [term 1 FOLLOWER]: Starting leader election (detected failure of leader cd75a17ab2604397adab03bb8b5fd75c)
I20260709 13:18:34.010308  7874 raft_consensus.cc:493] T 404190ce4ce94cecbfcb6ea9d1dd8626 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 1 FOLLOWER]: Starting leader election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:18:34.010653  7870 raft_consensus.cc:3060] T 7ba5dac66ab5497e9e336f2a3c28cda5 P b7ab4784c7344b939bc36f639286f377 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:34.010747  7874 raft_consensus.cc:3060] T 404190ce4ce94cecbfcb6ea9d1dd8626 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:34.012316  6729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22ccee1b570c4ad3a57bd7aec085b1b4" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:18:34.012972  6873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24ee15416e3145beaa1b8183453729a3" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
W20260709 13:18:33.880756  7468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 65679.2us
I20260709 13:18:34.014834  6731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d65025eea89441290d85dd053810e31" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:18:34.015010  6726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "853ac0a8cbd64ce99457f170216d4d0f" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:18:34.004525  6844 leader_election.cc:304] T ce4f062dcd314d43a63ca74067cb5ee3 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:18:34.016350  6729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4b8bd455d5a47c18a1380839c6e0d61" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:18:34.017300  6872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ba5dac66ab5497e9e336f2a3c28cda5" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:18:34.018702  6732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a92dd554674067a83a9cb68c4773f2" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:18:34.019058  6804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de3186201e1a40d0b335eeb8b4e256e0" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:18:34.008630  7841 raft_consensus.cc:2804] T d33d5ee8ef6f415593d8df52063161ad P cd75a17ab2604397adab03bb8b5fd75c [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:18:34.020224  6724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34f36d59d88f40fe8a2805e604fc6c0a" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:18:34.020609  7841 raft_consensus.cc:493] T d33d5ee8ef6f415593d8df52063161ad P cd75a17ab2604397adab03bb8b5fd75c [term 1 FOLLOWER]: Starting leader election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:18:34.021083  7841 raft_consensus.cc:3060] T d33d5ee8ef6f415593d8df52063161ad P cd75a17ab2604397adab03bb8b5fd75c [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:18:34.007164  6772 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.68:45071, user_credentials={real_user=slave}} blocked reactor thread for 150513us
I20260709 13:18:34.024266  7851 raft_consensus.cc:2804] T ce4f062dcd314d43a63ca74067cb5ee3 P cd75a17ab2604397adab03bb8b5fd75c [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:18:34.025092  7851 raft_consensus.cc:493] T ce4f062dcd314d43a63ca74067cb5ee3 P cd75a17ab2604397adab03bb8b5fd75c [term 1 FOLLOWER]: Starting leader election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:18:34.026052  7851 raft_consensus.cc:3060] T ce4f062dcd314d43a63ca74067cb5ee3 P cd75a17ab2604397adab03bb8b5fd75c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:34.027624  7870 raft_consensus.cc:515] T 7ba5dac66ab5497e9e336f2a3c28cda5 P b7ab4784c7344b939bc36f639286f377 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:18:33.867411  7872 consensus_queue.cc:1059] T 17587d6730594da4a56fa13a353232a1 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.151s
I20260709 13:18:34.029961  7853 raft_consensus.cc:1064] T ce4f062dcd314d43a63ca74067cb5ee3 P b7ab4784c7344b939bc36f639286f377: attempting to promote NON_VOTER 7ba59cc884714e8aa5f3f0ecaed84cbb to VOTER
I20260709 13:18:34.043568  7853 consensus_queue.cc:237] T ce4f062dcd314d43a63ca74067cb5ee3 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } attrs { replace: true } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
W20260709 13:18:34.048107  6697 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 86598.6us
I20260709 13:18:34.049496  7840 raft_consensus.cc:3055] T 17587d6730594da4a56fa13a353232a1 P b7ab4784c7344b939bc36f639286f377 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:18:34.049998  7840 raft_consensus.cc:740] T 17587d6730594da4a56fa13a353232a1 P b7ab4784c7344b939bc36f639286f377 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
I20260709 13:18:34.050839  6697 leader_election.cc:304] T ce4f062dcd314d43a63ca74067cb5ee3 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:18:33.991619  7826 raft_consensus.cc:515] T bb7fa124c3bf4ef9ab65a407cb008441 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:18:34.010054  6806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "427c124d773f483294511e80fe340075" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:18:34.053337  7499 raft_consensus.cc:1240] T bb7fa124c3bf4ef9ab65a407cb008441 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 2 FOLLOWER]: Rejecting Update request from peer b7ab4784c7344b939bc36f639286f377 for earlier term 1. Current term is 2. Ops: []
I20260709 13:18:34.033994  7851 raft_consensus.cc:515] T ce4f062dcd314d43a63ca74067cb5ee3 P cd75a17ab2604397adab03bb8b5fd75c [term 2 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } attrs { replace: true } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: NON_VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: true } }
I20260709 13:18:34.051136  7840 consensus_queue.cc:260] T 17587d6730594da4a56fa13a353232a1 P b7ab4784c7344b939bc36f639286f377 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 4, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:18:34.055826  7851 leader_election.cc:290] T ce4f062dcd314d43a63ca74067cb5ee3 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 2 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:18:34.035204  6844 leader_election.cc:304] T a1704639a875409b9959353527b3fd68 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:18:34.056219  7840 raft_consensus.cc:3060] T 17587d6730594da4a56fa13a353232a1 P b7ab4784c7344b939bc36f639286f377 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:34.057081  6844 leader_election.cc:304] T 90d42e216d9741e190bca19a781291fd P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:18:34.059260  6872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4b8bd455d5a47c18a1380839c6e0d61" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:18:34.059679  6844 leader_election.cc:304] T 30e88460611e47b2ba16a46a30b5f416 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:18:34.060600  7867 raft_consensus.cc:2804] T 90d42e216d9741e190bca19a781291fd P cd75a17ab2604397adab03bb8b5fd75c [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:18:34.025312  6878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d65025eea89441290d85dd053810e31" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:18:34.061041  7867 raft_consensus.cc:493] T 90d42e216d9741e190bca19a781291fd P cd75a17ab2604397adab03bb8b5fd75c [term 1 FOLLOWER]: Starting leader election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:18:34.062469  7867 raft_consensus.cc:3060] T 90d42e216d9741e190bca19a781291fd P cd75a17ab2604397adab03bb8b5fd75c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:34.061110  7877 raft_consensus.cc:2804] T ce4f062dcd314d43a63ca74067cb5ee3 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:18:34.063352  6697 leader_election.cc:304] T 90d42e216d9741e190bca19a781291fd P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:18:34.065021  6770 leader_election.cc:304] T 711ef6523deb4cbe8ef2ba61e1c21c98 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:18:34.066256  6770 leader_election.cc:304] T 404190ce4ce94cecbfcb6ea9d1dd8626 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:18:34.069963  7850 raft_consensus.cc:515] T bd6869f07b5a4885a0b99fbe60c3b175 P cd75a17ab2604397adab03bb8b5fd75c [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:34.079051  7850 leader_election.cc:290] T bd6869f07b5a4885a0b99fbe60c3b175 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 3 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:18:34.079123  7858 raft_consensus.cc:2749] T 404190ce4ce94cecbfcb6ea9d1dd8626 P b7ab4784c7344b939bc36f639286f377 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:34.064693  7877 raft_consensus.cc:493] T ce4f062dcd314d43a63ca74067cb5ee3 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 1 FOLLOWER]: Starting leader election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:18:34.061513  7851 raft_consensus.cc:2804] T a1704639a875409b9959353527b3fd68 P cd75a17ab2604397adab03bb8b5fd75c [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:18:34.081285  6878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a92dd554674067a83a9cb68c4773f2" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:18:34.081081  7868 consensus_queue.cc:1059] T bb7fa124c3bf4ef9ab65a407cb008441 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:18:34.055846  7826 leader_election.cc:290] T bb7fa124c3bf4ef9ab65a407cb008441 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 2 election: Requested vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:18:34.084079  7872 raft_consensus.cc:2749] T 711ef6523deb4cbe8ef2ba61e1c21c98 P b7ab4784c7344b939bc36f639286f377 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:34.084304  7857 raft_consensus.cc:2804] T 90d42e216d9741e190bca19a781291fd P ccd8a4c3bfe3413cb2ae219b09aea832 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:18:34.084692  6880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "853ac0a8cbd64ce99457f170216d4d0f" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:18:34.076548  7874 raft_consensus.cc:515] T 404190ce4ce94cecbfcb6ea9d1dd8626 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:18:34.083109  6697 leader_election.cc:304] T 95a75bfe094d4bdc963aba3f08dfcd25 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:18:34.067034  7832 leader_election.cc:290] T 3fa34c08b205435dba97346991aa1f92 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 2 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:18:34.094089  7857 raft_consensus.cc:493] T 90d42e216d9741e190bca19a781291fd P ccd8a4c3bfe3413cb2ae219b09aea832 [term 1 FOLLOWER]: Starting leader election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:18:34.101866  7835 raft_consensus.cc:2804] T 95a75bfe094d4bdc963aba3f08dfcd25 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:18:34.094834  6772 leader_election.cc:304] T f3f9c2e2bf644115957398fe4c9459db P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:18:34.086800  7877 raft_consensus.cc:3060] T ce4f062dcd314d43a63ca74067cb5ee3 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:34.090636  7841 raft_consensus.cc:515] T d33d5ee8ef6f415593d8df52063161ad P cd75a17ab2604397adab03bb8b5fd75c [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:34.107327  7835 raft_consensus.cc:493] T 95a75bfe094d4bdc963aba3f08dfcd25 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 1 FOLLOWER]: Starting leader election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:18:34.109278  7835 raft_consensus.cc:3060] T 95a75bfe094d4bdc963aba3f08dfcd25 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:34.095254  6697 leader_election.cc:304] T a1704639a875409b9959353527b3fd68 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:18:34.086963  7851 raft_consensus.cc:493] T a1704639a875409b9959353527b3fd68 P cd75a17ab2604397adab03bb8b5fd75c [term 1 FOLLOWER]: Starting leader election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:18:34.111044  6872 raft_consensus.cc:1240] T d33d5ee8ef6f415593d8df52063161ad P cd75a17ab2604397adab03bb8b5fd75c [term 2 FOLLOWER]: Rejecting Update request from peer b7ab4784c7344b939bc36f639286f377 for earlier term 1. Current term is 2. Ops: []
I20260709 13:18:34.111820  6697 leader_election.cc:304] T d8292e16e5654be6bc408560cf256aaa P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:18:34.111826  6772 leader_election.cc:304] T 44bde925b2e541b69890d70715b85176 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:18:34.120599  6697 leader_election.cc:304] T bd6869f07b5a4885a0b99fbe60c3b175 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
W20260709 13:18:34.121134  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 61538.6us
I20260709 13:18:34.121146  6772 leader_election.cc:304] T b56bf91d90824c959e21e0cee5ba1816 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:18:34.085022  7867 raft_consensus.cc:515] T 90d42e216d9741e190bca19a781291fd P cd75a17ab2604397adab03bb8b5fd75c [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:34.122682  6697 leader_election.cc:304] T de3186201e1a40d0b335eeb8b4e256e0 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:18:34.107369  7850 raft_consensus.cc:2804] T 30e88460611e47b2ba16a46a30b5f416 P cd75a17ab2604397adab03bb8b5fd75c [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:18:34.107074  7857 raft_consensus.cc:3060] T 90d42e216d9741e190bca19a781291fd P ccd8a4c3bfe3413cb2ae219b09aea832 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:34.123930  7821 raft_consensus.cc:2804] T d8292e16e5654be6bc408560cf256aaa P ccd8a4c3bfe3413cb2ae219b09aea832 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:18:34.124260  7784 raft_consensus.cc:2804] T bd6869f07b5a4885a0b99fbe60c3b175 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:18:34.128450  7821 raft_consensus.cc:493] T d8292e16e5654be6bc408560cf256aaa P ccd8a4c3bfe3413cb2ae219b09aea832 [term 1 FOLLOWER]: Starting leader election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:18:34.136409  7784 raft_consensus.cc:493] T bd6869f07b5a4885a0b99fbe60c3b175 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 2 FOLLOWER]: Starting leader election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:18:34.136677  7821 raft_consensus.cc:3060] T d8292e16e5654be6bc408560cf256aaa P ccd8a4c3bfe3413cb2ae219b09aea832 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:34.129633  7776 raft_consensus.cc:2804] T de3186201e1a40d0b335eeb8b4e256e0 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:18:34.137488  7776 raft_consensus.cc:493] T de3186201e1a40d0b335eeb8b4e256e0 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 1 FOLLOWER]: Starting leader election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:18:34.137840  7776 raft_consensus.cc:3060] T de3186201e1a40d0b335eeb8b4e256e0 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:34.130052  6697 leader_election.cc:304] T d33d5ee8ef6f415593d8df52063161ad P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:18:34.136931  7784 raft_consensus.cc:3060] T bd6869f07b5a4885a0b99fbe60c3b175 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:34.122321  7849 raft_consensus.cc:2804] T f3f9c2e2bf644115957398fe4c9459db P b7ab4784c7344b939bc36f639286f377 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:18:34.139725  7723 raft_consensus.cc:2804] T d33d5ee8ef6f415593d8df52063161ad P ccd8a4c3bfe3413cb2ae219b09aea832 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:18:34.141969  7723 raft_consensus.cc:493] T d33d5ee8ef6f415593d8df52063161ad P ccd8a4c3bfe3413cb2ae219b09aea832 [term 1 FOLLOWER]: Starting leader election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:18:34.142469  7723 raft_consensus.cc:3060] T d33d5ee8ef6f415593d8df52063161ad P ccd8a4c3bfe3413cb2ae219b09aea832 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:34.141669  6844 leader_election.cc:304] T bb3d8792045a4583ae2e965b1350a5b4 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, ccd8a4c3bfe3413cb2ae219b09aea832
W20260709 13:18:34.124195  7466 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 132945us
I20260709 13:18:34.119944  7851 raft_consensus.cc:3060] T a1704639a875409b9959353527b3fd68 P cd75a17ab2604397adab03bb8b5fd75c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:34.122545  7816 raft_consensus.cc:2804] T a1704639a875409b9959353527b3fd68 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:18:34.127382  7850 raft_consensus.cc:493] T 30e88460611e47b2ba16a46a30b5f416 P cd75a17ab2604397adab03bb8b5fd75c [term 1 FOLLOWER]: Starting leader election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:18:34.157778  7857 raft_consensus.cc:515] T 90d42e216d9741e190bca19a781291fd P ccd8a4c3bfe3413cb2ae219b09aea832 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:34.162025  7868 raft_consensus.cc:2804] T 44bde925b2e541b69890d70715b85176 P b7ab4784c7344b939bc36f639286f377 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:18:34.142910  7841 leader_election.cc:290] T d33d5ee8ef6f415593d8df52063161ad P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 2 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:18:34.166692  7466 leader_election.cc:304] T be1a92657f494cac8dd227d152f50151 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, b7ab4784c7344b939bc36f639286f377; no voters: ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:18:34.167879  6697 leader_election.cc:304] T 2c240553ce044eedb41541d72b9475d7 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:18:34.143340  7849 raft_consensus.cc:493] T f3f9c2e2bf644115957398fe4c9459db P b7ab4784c7344b939bc36f639286f377 [term 1 FOLLOWER]: Starting leader election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:18:34.179049  6844 leader_election.cc:304] T 1bf4668eeb70467fb3dc5a0289233b3c P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:18:34.180397  6844 leader_election.cc:304] T 4b8cacb381b746da8d0049b0a83b41dd P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:18:34.159564  7816 raft_consensus.cc:493] T a1704639a875409b9959353527b3fd68 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 1 FOLLOWER]: Starting leader election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:18:34.168236  7832 raft_consensus.cc:2749] T bb3d8792045a4583ae2e965b1350a5b4 P cd75a17ab2604397adab03bb8b5fd75c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:34.167662  7850 raft_consensus.cc:3060] T 30e88460611e47b2ba16a46a30b5f416 P cd75a17ab2604397adab03bb8b5fd75c [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:18:34.185675  6770 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 60793.2us
I20260709 13:18:34.168849  7868 raft_consensus.cc:493] T 44bde925b2e541b69890d70715b85176 P b7ab4784c7344b939bc36f639286f377 [term 1 FOLLOWER]: Starting leader election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:18:34.174863  7849 raft_consensus.cc:3060] T f3f9c2e2bf644115957398fe4c9459db P b7ab4784c7344b939bc36f639286f377 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:34.171461  7870 leader_election.cc:290] T 7ba5dac66ab5497e9e336f2a3c28cda5 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 2 election: Requested vote from peers cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:18:34.194104  7723 raft_consensus.cc:515] T d33d5ee8ef6f415593d8df52063161ad P ccd8a4c3bfe3413cb2ae219b09aea832 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
W20260709 13:18:34.197961  6846 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.68:45071, user_credentials={real_user=slave}} blocked reactor thread for 46349us
W20260709 13:18:34.202907  6698 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:34.187705  7878 raft_consensus.cc:2804] T be1a92657f494cac8dd227d152f50151 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:18:34.184620  7881 raft_consensus.cc:2804] T b56bf91d90824c959e21e0cee5ba1816 P b7ab4784c7344b939bc36f639286f377 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:18:34.211598  6697 leader_election.cc:304] T 30e88460611e47b2ba16a46a30b5f416 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:18:34.212359  7723 leader_election.cc:290] T d33d5ee8ef6f415593d8df52063161ad P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 2 election: Requested vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:18:34.191483  7868 raft_consensus.cc:3060] T 44bde925b2e541b69890d70715b85176 P b7ab4784c7344b939bc36f639286f377 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:34.187834  7816 raft_consensus.cc:3060] T a1704639a875409b9959353527b3fd68 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:34.219416  7723 raft_consensus.cc:2804] T 2c240553ce044eedb41541d72b9475d7 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:18:34.220175  7723 raft_consensus.cc:493] T 2c240553ce044eedb41541d72b9475d7 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 1 FOLLOWER]: Starting leader election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:18:34.220757  7723 raft_consensus.cc:3060] T 2c240553ce044eedb41541d72b9475d7 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:34.224599  6697 leader_election.cc:304] T 9b3759de40694069b13c0f8bd40e5709 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:18:34.225816  6697 leader_election.cc:304] T 1bf4668eeb70467fb3dc5a0289233b3c P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
W20260709 13:18:34.264603  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 84287.6us
I20260709 13:18:34.284847  6844 leader_election.cc:304] T fe20b4b48823486ca3b9c648db6ce8aa P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:18:34.190711  7466 leader_election.cc:304] T 4f00a2e87e56452083b759f60d461ee3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:18:34.218438  7832 raft_consensus.cc:2804] T 1bf4668eeb70467fb3dc5a0289233b3c P cd75a17ab2604397adab03bb8b5fd75c [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:18:34.213131  7881 raft_consensus.cc:493] T b56bf91d90824c959e21e0cee5ba1816 P b7ab4784c7344b939bc36f639286f377 [term 1 FOLLOWER]: Starting leader election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:18:34.309433  6844 leader_election.cc:304] T e77e330a82df4b43a745d57a68f6f057 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:18:34.208191  7878 raft_consensus.cc:493] T be1a92657f494cac8dd227d152f50151 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 1 FOLLOWER]: Starting leader election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:18:34.318709  7826 raft_consensus.cc:2749] T 4f00a2e87e56452083b759f60d461ee3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:18:34.321710  7867 leader_election.cc:290] T 90d42e216d9741e190bca19a781291fd P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 2 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:18:34.322892  7875 raft_consensus.cc:515] T d8cee0accdb8499c86d4414b72565a38 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:18:34.311477  7874 leader_election.cc:290] T 404190ce4ce94cecbfcb6ea9d1dd8626 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 2 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
W20260709 13:18:34.325626  6773 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:34.325707  6802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6869f07b5a4885a0b99fbe60c3b175" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:18:34.327694  6802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bf4668eeb70467fb3dc5a0289233b3c" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:18:34.328858  7857 leader_election.cc:290] T 90d42e216d9741e190bca19a781291fd P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 2 election: Requested vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:18:34.330847  6800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17587d6730594da4a56fa13a353232a1" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:18:34.309003  7832 raft_consensus.cc:493] T 1bf4668eeb70467fb3dc5a0289233b3c P cd75a17ab2604397adab03bb8b5fd75c [term 1 FOLLOWER]: Starting leader election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:18:34.334043  6800 raft_consensus.cc:2468] T 17587d6730594da4a56fa13a353232a1 P b7ab4784c7344b939bc36f639286f377 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 3.
I20260709 13:18:34.316762  7878 raft_consensus.cc:3060] T be1a92657f494cac8dd227d152f50151 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:34.328907  6802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d33d5ee8ef6f415593d8df52063161ad" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
W20260709 13:18:34.344204  6697 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 118464us
I20260709 13:18:34.314601  7881 raft_consensus.cc:3060] T b56bf91d90824c959e21e0cee5ba1816 P b7ab4784c7344b939bc36f639286f377 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:34.346729  6697 leader_election.cc:304] T e77e330a82df4b43a745d57a68f6f057 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:18:34.331668  7857 raft_consensus.cc:2804] T 9b3759de40694069b13c0f8bd40e5709 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:18:34.359742  6697 leader_election.cc:304] T 9e326172347f45e99a0d482b5d8ef768 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:18:34.344385  7832 raft_consensus.cc:3060] T 1bf4668eeb70467fb3dc5a0289233b3c P cd75a17ab2604397adab03bb8b5fd75c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:34.338951  7889 raft_consensus.cc:2749] T fe20b4b48823486ca3b9c648db6ce8aa P cd75a17ab2604397adab03bb8b5fd75c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:34.364718  7723 raft_consensus.cc:515] T 2c240553ce044eedb41541d72b9475d7 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
W20260709 13:18:34.363991  6772 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 242919us
I20260709 13:18:34.367654  6772 leader_election.cc:304] T 3411566abe2d4c9bb4b2adfdd05e6f17 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:18:34.330413  7893 raft_consensus.cc:2804] T 30e88460611e47b2ba16a46a30b5f416 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:18:34.369407  6772 leader_election.cc:304] T f58dc08b12a2494bb9a1372837970ca2 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:18:34.371038  6772 leader_election.cc:304] T 7c44c4849aa54f2b94d1f1bef9ed546f P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:18:34.372440  6800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e326172347f45e99a0d482b5d8ef768" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
W20260709 13:18:34.334439  7466 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 143824us
I20260709 13:18:34.374330  6802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77e330a82df4b43a745d57a68f6f057" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:18:34.339082  7784 raft_consensus.cc:515] T bd6869f07b5a4885a0b99fbe60c3b175 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:34.334638  7887 raft_consensus.cc:2749] T 4b8cacb381b746da8d0049b0a83b41dd P cd75a17ab2604397adab03bb8b5fd75c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:34.363320  7857 raft_consensus.cc:493] T 9b3759de40694069b13c0f8bd40e5709 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 1 FOLLOWER]: Starting leader election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:18:34.368516  7884 raft_consensus.cc:2749] T 3411566abe2d4c9bb4b2adfdd05e6f17 P b7ab4784c7344b939bc36f639286f377 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:34.338186  7816 raft_consensus.cc:515] T a1704639a875409b9959353527b3fd68 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:34.373921  7872 raft_consensus.cc:2804] T f58dc08b12a2494bb9a1372837970ca2 P b7ab4784c7344b939bc36f639286f377 [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 13:18:34.390072  6698 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:34.392894  6802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b3759de40694069b13c0f8bd40e5709" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:18:34.371520  7893 raft_consensus.cc:493] T 30e88460611e47b2ba16a46a30b5f416 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 1 FOLLOWER]: Starting leader election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:18:34.396346  7776 raft_consensus.cc:515] T de3186201e1a40d0b335eeb8b4e256e0 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:34.358158  7891 raft_consensus.cc:2804] T e77e330a82df4b43a745d57a68f6f057 P cd75a17ab2604397adab03bb8b5fd75c [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:18:34.385479  7883 raft_consensus.cc:2749] T 7c44c4849aa54f2b94d1f1bef9ed546f P b7ab4784c7344b939bc36f639286f377 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:34.363173  7894 raft_consensus.cc:2804] T 1bf4668eeb70467fb3dc5a0289233b3c P ccd8a4c3bfe3413cb2ae219b09aea832 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:18:34.401662  6800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3022224cc81473690653a83d4e99470" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:18:34.398350  7893 raft_consensus.cc:3060] T 30e88460611e47b2ba16a46a30b5f416 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:34.390368  7857 raft_consensus.cc:3060] T 9b3759de40694069b13c0f8bd40e5709 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:34.364306  7888 raft_consensus.cc:493] T 8c7f33e544204fbaac4078e3e83bbf4e P cd75a17ab2604397adab03bb8b5fd75c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:18:34.409426  7776 leader_election.cc:290] T de3186201e1a40d0b335eeb8b4e256e0 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 2 election: Requested vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:18:34.411062  6802 raft_consensus.cc:1275] T 1528ab62b6fe4e3099d08f141afee116 P b7ab4784c7344b939bc36f639286f377 [term 1 FOLLOWER]: Refusing update from remote peer ccd8a4c3bfe3413cb2ae219b09aea832: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:18:34.412974  7875 leader_election.cc:290] T d8cee0accdb8499c86d4414b72565a38 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 2 election: Requested vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:18:34.415611  7816 leader_election.cc:290] T a1704639a875409b9959353527b3fd68 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 2 election: Requested vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:18:34.417022  7858 raft_consensus.cc:3055] T bb7fa124c3bf4ef9ab65a407cb008441 P b7ab4784c7344b939bc36f639286f377 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:18:34.417364  7784 leader_election.cc:290] T bd6869f07b5a4885a0b99fbe60c3b175 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 3 election: Requested vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:18:34.417641  7858 raft_consensus.cc:740] T bb7fa124c3bf4ef9ab65a407cb008441 P b7ab4784c7344b939bc36f639286f377 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
I20260709 13:18:34.418877  7858 consensus_queue.cc:260] T bb7fa124c3bf4ef9ab65a407cb008441 P b7ab4784c7344b939bc36f639286f377 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:18:34.407361  7885 raft_consensus.cc:2804] T 9e326172347f45e99a0d482b5d8ef768 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:18:34.420454  7885 raft_consensus.cc:493] T 9e326172347f45e99a0d482b5d8ef768 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 1 FOLLOWER]: Starting leader election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:18:34.420513  7858 raft_consensus.cc:3060] T bb7fa124c3bf4ef9ab65a407cb008441 P b7ab4784c7344b939bc36f639286f377 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:34.400936  7894 raft_consensus.cc:493] T 1bf4668eeb70467fb3dc5a0289233b3c P ccd8a4c3bfe3413cb2ae219b09aea832 [term 1 FOLLOWER]: Starting leader election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:18:34.395726  7872 raft_consensus.cc:493] T f58dc08b12a2494bb9a1372837970ca2 P b7ab4784c7344b939bc36f639286f377 [term 1 FOLLOWER]: Starting leader election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:18:34.421051  7885 raft_consensus.cc:3060] T 9e326172347f45e99a0d482b5d8ef768 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:34.407747  7896 raft_consensus.cc:2804] T e77e330a82df4b43a745d57a68f6f057 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:18:34.398018  7891 raft_consensus.cc:493] T e77e330a82df4b43a745d57a68f6f057 P cd75a17ab2604397adab03bb8b5fd75c [term 2 FOLLOWER]: Starting leader election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:18:34.442907  6800 raft_consensus.cc:1275] T 24ee15416e3145beaa1b8183453729a3 P b7ab4784c7344b939bc36f639286f377 [term 1 FOLLOWER]: Refusing update from remote peer ccd8a4c3bfe3413cb2ae219b09aea832: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:18:34.445477  7723 leader_election.cc:290] T 2c240553ce044eedb41541d72b9475d7 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 2 election: Requested vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:18:34.446242  7851 raft_consensus.cc:515] T a1704639a875409b9959353527b3fd68 P cd75a17ab2604397adab03bb8b5fd75c [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:34.448177  6806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d65025eea89441290d85dd053810e31" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:18:34.448800  6805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30e88460611e47b2ba16a46a30b5f416" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:18:34.449990  6799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d33d5ee8ef6f415593d8df52063161ad" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:18:34.450050  6805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5be3a11b23d4ea9b08300a2789821c7" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:18:34.451385  6807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a75bfe094d4bdc963aba3f08dfcd25" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:18:34.455077  6802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17587d6730594da4a56fa13a353232a1" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
W20260709 13:18:34.458818  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 149423us
I20260709 13:18:34.434868  7894 raft_consensus.cc:3060] T 1bf4668eeb70467fb3dc5a0289233b3c P ccd8a4c3bfe3413cb2ae219b09aea832 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:34.439179  7872 raft_consensus.cc:3060] T f58dc08b12a2494bb9a1372837970ca2 P b7ab4784c7344b939bc36f639286f377 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:18:34.459764  6772 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 71161.2us
I20260709 13:18:34.460457  6844 leader_election.cc:304] T 95a75bfe094d4bdc963aba3f08dfcd25 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:18:34.461777  6806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90d42e216d9741e190bca19a781291fd" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:18:34.462720  6800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "427c124d773f483294511e80fe340075" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:18:34.465677  7887 raft_consensus.cc:2804] T 95a75bfe094d4bdc963aba3f08dfcd25 P cd75a17ab2604397adab03bb8b5fd75c [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:18:34.465693  6844 leader_election.cc:304] T 9b3759de40694069b13c0f8bd40e5709 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:18:34.466500  7887 raft_consensus.cc:493] T 95a75bfe094d4bdc963aba3f08dfcd25 P cd75a17ab2604397adab03bb8b5fd75c [term 1 FOLLOWER]: Starting leader election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:18:34.467046  7887 raft_consensus.cc:3060] T 95a75bfe094d4bdc963aba3f08dfcd25 P cd75a17ab2604397adab03bb8b5fd75c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:34.469699  7841 raft_consensus.cc:2804] T 9b3759de40694069b13c0f8bd40e5709 P cd75a17ab2604397adab03bb8b5fd75c [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:18:34.470290  7841 raft_consensus.cc:493] T 9b3759de40694069b13c0f8bd40e5709 P cd75a17ab2604397adab03bb8b5fd75c [term 1 FOLLOWER]: Starting leader election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:18:34.470752  7841 raft_consensus.cc:3060] T 9b3759de40694069b13c0f8bd40e5709 P cd75a17ab2604397adab03bb8b5fd75c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:34.439167  7896 raft_consensus.cc:493] T e77e330a82df4b43a745d57a68f6f057 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 2 FOLLOWER]: Starting leader election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:18:34.472082  7896 raft_consensus.cc:3060] T e77e330a82df4b43a745d57a68f6f057 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:34.474361  7468 leader_election.cc:304] T fe20b4b48823486ca3b9c648db6ce8aa P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:18:34.475648  7875 raft_consensus.cc:2749] T fe20b4b48823486ca3b9c648db6ce8aa P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:34.476884  7468 leader_election.cc:304] T 4b8cacb381b746da8d0049b0a83b41dd P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, cd75a17ab2604397adab03bb8b5fd75c; no voters: ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:18:34.478049  6772 leader_election.cc:304] T c4db81d9d329422bb3b4160ca4ac2d1d P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:18:34.480469  6772 leader_election.cc:304] T 7a734b5ab7834e05a8c422208acc58b1 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:18:34.482810  6772 leader_election.cc:304] T 427c124d773f483294511e80fe340075 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:18:34.453789  7891 raft_consensus.cc:3060] T e77e330a82df4b43a745d57a68f6f057 P cd75a17ab2604397adab03bb8b5fd75c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:34.506331  6806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34f36d59d88f40fe8a2805e604fc6c0a" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:18:34.413341  7888 raft_consensus.cc:515] T 8c7f33e544204fbaac4078e3e83bbf4e P cd75a17ab2604397adab03bb8b5fd75c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:34.509182  7875 raft_consensus.cc:2804] T 4b8cacb381b746da8d0049b0a83b41dd P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:18:34.515278  6802 raft_consensus.cc:2468] T 17587d6730594da4a56fa13a353232a1 P b7ab4784c7344b939bc36f639286f377 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 3.
I20260709 13:18:34.529452  6806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de3186201e1a40d0b335eeb8b4e256e0" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:18:34.479796  7882 raft_consensus.cc:2749] T c4db81d9d329422bb3b4160ca4ac2d1d P b7ab4784c7344b939bc36f639286f377 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:34.533496  6802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c240553ce044eedb41541d72b9475d7" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:18:34.485021  6801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce4f062dcd314d43a63ca74067cb5ee3" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:18:34.485569  7870 raft_consensus.cc:2749] T 7a734b5ab7834e05a8c422208acc58b1 P b7ab4784c7344b939bc36f639286f377 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:18:34.531008  6697 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 171361us
I20260709 13:18:34.510162  7869 raft_consensus.cc:2749] T 427c124d773f483294511e80fe340075 P b7ab4784c7344b939bc36f639286f377 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:34.526305  7875 raft_consensus.cc:493] T 4b8cacb381b746da8d0049b0a83b41dd P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 1 FOLLOWER]: Starting leader election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:18:34.546866  6727 raft_consensus.cc:1240] T de3186201e1a40d0b335eeb8b4e256e0 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 2 FOLLOWER]: Rejecting Update request from peer b7ab4784c7344b939bc36f639286f377 for earlier term 1. Current term is 2. Ops: []
I20260709 13:18:34.477795  7466 leader_election.cc:304] T 7ba5dac66ab5497e9e336f2a3c28cda5 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:18:34.550277  7881 raft_consensus.cc:515] T b56bf91d90824c959e21e0cee5ba1816 P b7ab4784c7344b939bc36f639286f377 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:34.576587  7841 raft_consensus.cc:515] T 9b3759de40694069b13c0f8bd40e5709 P cd75a17ab2604397adab03bb8b5fd75c [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:34.555506  7875 raft_consensus.cc:3060] T 4b8cacb381b746da8d0049b0a83b41dd P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:18:34.593706  7468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 116916us
I20260709 13:18:34.579285  7874 raft_consensus.cc:2749] T 7ba5dac66ab5497e9e336f2a3c28cda5 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:18:34.613850  6772 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 131155us
I20260709 13:18:34.623823  7882 consensus_queue.cc:1059] T de3186201e1a40d0b335eeb8b4e256e0 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:18:34.625082  7882 raft_consensus.cc:3055] T de3186201e1a40d0b335eeb8b4e256e0 P b7ab4784c7344b939bc36f639286f377 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:18:34.625451  7882 raft_consensus.cc:740] T de3186201e1a40d0b335eeb8b4e256e0 P b7ab4784c7344b939bc36f639286f377 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
I20260709 13:18:34.626572  7723 consensus_queue.cc:1048] T 1528ab62b6fe4e3099d08f141afee116 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:18:34.627425  6806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "853ac0a8cbd64ce99457f170216d4d0f" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:18:34.629690  6801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e326172347f45e99a0d482b5d8ef768" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:18:34.631626  6807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f58dc08b12a2494bb9a1372837970ca2" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:18:34.633819  6807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce4f062dcd314d43a63ca74067cb5ee3" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:18:34.614660  6772 leader_election.cc:304] T e31b9971c15848dea59d4d4130141d9e P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
W20260709 13:18:34.612766  7466 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 152807us
I20260709 13:18:34.635105  7869 raft_consensus.cc:2749] T e31b9971c15848dea59d4d4130141d9e P b7ab4784c7344b939bc36f639286f377 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:34.632651  6801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d33d5ee8ef6f415593d8df52063161ad" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:18:34.636730  6801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90d42e216d9741e190bca19a781291fd" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:18:34.640115  6799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8292e16e5654be6bc408560cf256aaa" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:18:34.637255  7878 raft_consensus.cc:515] T be1a92657f494cac8dd227d152f50151 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:18:34.637737  7784 consensus_queue.cc:1048] T 24ee15416e3145beaa1b8183453729a3 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.004s
I20260709 13:18:34.642505  7878 leader_election.cc:290] T be1a92657f494cac8dd227d152f50151 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 2 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:18:34.585753  7896 raft_consensus.cc:515] T e77e330a82df4b43a745d57a68f6f057 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } }
I20260709 13:18:34.644429  6805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de3186201e1a40d0b335eeb8b4e256e0" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:18:34.645413  6800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c37d41cd9164c15a6826ca62a851a69" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:18:34.646675  7881 leader_election.cc:290] T b56bf91d90824c959e21e0cee5ba1816 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 2 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:18:34.648362  7888 leader_election.cc:290] T 8c7f33e544204fbaac4078e3e83bbf4e P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:18:34.648599  7501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17587d6730594da4a56fa13a353232a1" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb"
I20260709 13:18:34.649210  7850 raft_consensus.cc:515] T 30e88460611e47b2ba16a46a30b5f416 P cd75a17ab2604397adab03bb8b5fd75c [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:34.650092  7502 raft_consensus.cc:1275] T 24ee15416e3145beaa1b8183453729a3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 1 LEARNER]: Refusing update from remote peer ccd8a4c3bfe3413cb2ae219b09aea832: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:18:34.664520  7850 leader_election.cc:290] T 30e88460611e47b2ba16a46a30b5f416 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 2 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:18:34.573165  7832 raft_consensus.cc:515] T 1bf4668eeb70467fb3dc5a0289233b3c P cd75a17ab2604397adab03bb8b5fd75c [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
W20260709 13:18:34.640913  7877 consensus_meta.cc:287] T ce4f062dcd314d43a63ca74067cb5ee3 P ccd8a4c3bfe3413cb2ae219b09aea832: Time spent flushing consensus metadata: real 0.525s	user 0.009s	sys 0.002s
I20260709 13:18:34.653751  6727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b56bf91d90824c959e21e0cee5ba1816" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:18:34.670048  7877 raft_consensus.cc:515] T ce4f062dcd314d43a63ca74067cb5ee3 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } attrs { replace: true } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: NON_VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: true } }
I20260709 13:18:34.672212  7877 leader_election.cc:290] T ce4f062dcd314d43a63ca74067cb5ee3 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 2 election: Requested vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:18:34.672295  6723 raft_consensus.cc:1240] T ce4f062dcd314d43a63ca74067cb5ee3 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 2 FOLLOWER]: Rejecting Update request from peer b7ab4784c7344b939bc36f639286f377 for earlier term 1. Current term is 2. Ops: []
I20260709 13:18:34.672643  7466 leader_election.cc:304] T 17587d6730594da4a56fa13a353232a1 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:18:34.656693  7501 raft_consensus.cc:2393] T 17587d6730594da4a56fa13a353232a1 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate ccd8a4c3bfe3413cb2ae219b09aea832 in current term 3: Already voted for candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in this term.
I20260709 13:18:34.654004  6801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1704639a875409b9959353527b3fd68" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:18:34.669534  7832 leader_election.cc:290] T 1bf4668eeb70467fb3dc5a0289233b3c P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 2 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:18:34.679003  7857 raft_consensus.cc:515] T 9b3759de40694069b13c0f8bd40e5709 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:34.661074  6806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6869f07b5a4885a0b99fbe60c3b175" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
W20260709 13:18:34.680805  6772 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 66226us
I20260709 13:18:34.687845  6806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8cee0accdb8499c86d4414b72565a38" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:18:34.689371  6806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "404190ce4ce94cecbfcb6ea9d1dd8626" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
W20260709 13:18:34.691053  7835 consensus_meta.cc:287] T 95a75bfe094d4bdc963aba3f08dfcd25 P ccd8a4c3bfe3413cb2ae219b09aea832: Time spent flushing consensus metadata: real 0.581s	user 0.010s	sys 0.000s
I20260709 13:18:34.691129  6806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb7fa124c3bf4ef9ab65a407cb008441" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:18:34.692646  6873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1704639a875409b9959353527b3fd68" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:18:34.694229  6881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de3186201e1a40d0b335eeb8b4e256e0" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:18:34.673393  7841 leader_election.cc:290] T 9b3759de40694069b13c0f8bd40e5709 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 2 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:18:34.683863  6875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6869f07b5a4885a0b99fbe60c3b175" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:18:34.684587  6876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c240553ce044eedb41541d72b9475d7" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
W20260709 13:18:34.685088  6698 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:34.685546  6880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90d42e216d9741e190bca19a781291fd" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:18:34.701515  6876 raft_consensus.cc:2393] T 2c240553ce044eedb41541d72b9475d7 P cd75a17ab2604397adab03bb8b5fd75c [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate ccd8a4c3bfe3413cb2ae219b09aea832 in current term 2: Already voted for candidate cd75a17ab2604397adab03bb8b5fd75c in this term.
I20260709 13:18:34.685529  6800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6869f07b5a4885a0b99fbe60c3b175" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:18:34.626425  7821 raft_consensus.cc:515] T d8292e16e5654be6bc408560cf256aaa P ccd8a4c3bfe3413cb2ae219b09aea832 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:34.703408  6724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be1a92657f494cac8dd227d152f50151" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:18:34.703936  7896 leader_election.cc:290] T e77e330a82df4b43a745d57a68f6f057 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 3 election: Requested vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:18:34.704833  7821 leader_election.cc:290] T d8292e16e5654be6bc408560cf256aaa P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 2 election: Requested vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:18:34.697214  6872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d33d5ee8ef6f415593d8df52063161ad" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:18:34.705878  6872 raft_consensus.cc:2393] T d33d5ee8ef6f415593d8df52063161ad P cd75a17ab2604397adab03bb8b5fd75c [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate ccd8a4c3bfe3413cb2ae219b09aea832 in current term 2: Already voted for candidate cd75a17ab2604397adab03bb8b5fd75c in this term.
I20260709 13:18:34.706029  6724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c37d41cd9164c15a6826ca62a851a69" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:18:34.675513  6801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be1a92657f494cac8dd227d152f50151" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:18:34.699900  6727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "404190ce4ce94cecbfcb6ea9d1dd8626" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:18:34.708179  6727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8292e16e5654be6bc408560cf256aaa" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:18:34.708667  6801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c240553ce044eedb41541d72b9475d7" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:18:34.702821  6800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6869f07b5a4885a0b99fbe60c3b175" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:18:34.712693  6727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f58dc08b12a2494bb9a1372837970ca2" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:18:34.713649  6772 leader_election.cc:304] T 4d9def8b32fd443aa94ab1420b06837b P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:18:34.714453  7881 raft_consensus.cc:2749] T 4d9def8b32fd443aa94ab1420b06837b P b7ab4784c7344b939bc36f639286f377 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:34.715535  6772 leader_election.cc:304] T f5be3a11b23d4ea9b08300a2789821c7 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:18:34.634188  7882 consensus_queue.cc:260] T de3186201e1a40d0b335eeb8b4e256e0 P b7ab4784c7344b939bc36f639286f377 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:34.717540  6772 leader_election.cc:304] T 34f36d59d88f40fe8a2805e604fc6c0a P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:18:34.718261  7881 raft_consensus.cc:2749] T f5be3a11b23d4ea9b08300a2789821c7 P b7ab4784c7344b939bc36f639286f377 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:18:34.718139  7872 raft_consensus.cc:515] T f58dc08b12a2494bb9a1372837970ca2 P b7ab4784c7344b939bc36f639286f377 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:34.675427  7868 raft_consensus.cc:515] T 44bde925b2e541b69890d70715b85176 P b7ab4784c7344b939bc36f639286f377 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:34.720014  6772 leader_election.cc:304] T 22ccee1b570c4ad3a57bd7aec085b1b4 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:18:34.722792  6772 leader_election.cc:304] T 1528ab62b6fe4e3099d08f141afee116 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:18:34.720343  7881 raft_consensus.cc:2749] T 34f36d59d88f40fe8a2805e604fc6c0a P b7ab4784c7344b939bc36f639286f377 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:34.729552  6724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de3186201e1a40d0b335eeb8b4e256e0" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:18:34.731673  7869 raft_consensus.cc:2749] T 22ccee1b570c4ad3a57bd7aec085b1b4 P b7ab4784c7344b939bc36f639286f377 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:34.720515  7882 raft_consensus.cc:3060] T de3186201e1a40d0b335eeb8b4e256e0 P b7ab4784c7344b939bc36f639286f377 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:34.736119  6772 leader_election.cc:304] T 24ee15416e3145beaa1b8183453729a3 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:18:34.691650  7835 raft_consensus.cc:515] T 95a75bfe094d4bdc963aba3f08dfcd25 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:34.737031  7878 raft_consensus.cc:2749] T 17587d6730594da4a56fa13a353232a1 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:18:34.734822  7883 raft_consensus.cc:2749] T 1528ab62b6fe4e3099d08f141afee116 P b7ab4784c7344b939bc36f639286f377 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:34.738504  7881 consensus_queue.cc:1059] T 2c240553ce044eedb41541d72b9475d7 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:18:34.740504  7900 raft_consensus.cc:493] T 4f00a2e87e56452083b759f60d461ee3 P b7ab4784c7344b939bc36f639286f377 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader cd75a17ab2604397adab03bb8b5fd75c)
I20260709 13:18:34.740669  7870 raft_consensus.cc:3055] T 2c240553ce044eedb41541d72b9475d7 P b7ab4784c7344b939bc36f639286f377 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:18:34.741178  7870 raft_consensus.cc:740] T 2c240553ce044eedb41541d72b9475d7 P b7ab4784c7344b939bc36f639286f377 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
I20260709 13:18:34.741217  7900 raft_consensus.cc:515] T 4f00a2e87e56452083b759f60d461ee3 P b7ab4784c7344b939bc36f639286f377 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:18:34.742074  7870 consensus_queue.cc:260] T 2c240553ce044eedb41541d72b9475d7 P b7ab4784c7344b939bc36f639286f377 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:34.743548  7870 raft_consensus.cc:3060] T 2c240553ce044eedb41541d72b9475d7 P b7ab4784c7344b939bc36f639286f377 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:34.743755  7900 leader_election.cc:290] T 4f00a2e87e56452083b759f60d461ee3 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:18:34.746022  7872 leader_election.cc:290] T f58dc08b12a2494bb9a1372837970ca2 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 2 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
W20260709 13:18:34.736474  7849 consensus_meta.cc:287] T f3f9c2e2bf644115957398fe4c9459db P b7ab4784c7344b939bc36f639286f377: Time spent flushing consensus metadata: real 0.526s	user 0.007s	sys 0.011s
I20260709 13:18:34.686829  7885 raft_consensus.cc:515] T 9e326172347f45e99a0d482b5d8ef768 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:34.771791  6724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "853ac0a8cbd64ce99457f170216d4d0f" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:18:34.779258  6727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34f36d59d88f40fe8a2805e604fc6c0a" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:18:34.779438  6732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c240553ce044eedb41541d72b9475d7" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:18:34.780308  6802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90d42e216d9741e190bca19a781291fd" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:18:34.781534  6802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce4f062dcd314d43a63ca74067cb5ee3" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:18:34.769428  6803 raft_consensus.cc:1240] T 44bde925b2e541b69890d70715b85176 P b7ab4784c7344b939bc36f639286f377 [term 2 FOLLOWER]: Rejecting Update request from peer ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 1. Current term is 2. Ops: []
I20260709 13:18:34.782539  6802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77e330a82df4b43a745d57a68f6f057" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:18:34.783535  6802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8292e16e5654be6bc408560cf256aaa" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:18:34.785102  7868 leader_election.cc:290] T 44bde925b2e541b69890d70715b85176 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 2 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:18:34.785480  6798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c7f33e544204fbaac4078e3e83bbf4e" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:18:34.787820  7851 leader_election.cc:290] T a1704639a875409b9959353527b3fd68 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 2 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:18:34.789189  7835 leader_election.cc:290] T 95a75bfe094d4bdc963aba3f08dfcd25 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 2 election: Requested vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:18:34.779613  6800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b3759de40694069b13c0f8bd40e5709" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:18:34.789515  6727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fa34c08b205435dba97346991aa1f92" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:18:34.791782  6727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e326172347f45e99a0d482b5d8ef768" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:18:34.793637  6727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce4f062dcd314d43a63ca74067cb5ee3" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:18:34.793922  7875 raft_consensus.cc:515] T 4b8cacb381b746da8d0049b0a83b41dd P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:18:34.795243  7499 raft_consensus.cc:1240] T 4b8cacb381b746da8d0049b0a83b41dd P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 2 FOLLOWER]: Rejecting Update request from peer ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 1. Current term is 2. Ops: []
I20260709 13:18:34.796984  7857 leader_election.cc:290] T 9b3759de40694069b13c0f8bd40e5709 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 2 election: Requested vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:18:34.797549  6724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90d42e216d9741e190bca19a781291fd" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:18:34.797853  6727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6869f07b5a4885a0b99fbe60c3b175" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:18:34.799542  7885 leader_election.cc:290] T 9e326172347f45e99a0d482b5d8ef768 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 2 election: Requested vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:18:34.772282  7877 consensus_queue.cc:1048] T 1528ab62b6fe4e3099d08f141afee116 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.028s
I20260709 13:18:34.803351  7894 raft_consensus.cc:515] T 1bf4668eeb70467fb3dc5a0289233b3c P ccd8a4c3bfe3413cb2ae219b09aea832 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:34.806483  6801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e326172347f45e99a0d482b5d8ef768" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:18:34.808676  7891 raft_consensus.cc:515] T e77e330a82df4b43a745d57a68f6f057 P cd75a17ab2604397adab03bb8b5fd75c [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } }
I20260709 13:18:34.811040  7891 leader_election.cc:290] T e77e330a82df4b43a745d57a68f6f057 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 3 election: Requested vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391)
I20260709 13:18:34.761596  7869 raft_consensus.cc:2749] T 24ee15416e3145beaa1b8183453729a3 P b7ab4784c7344b939bc36f639286f377 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:18:34.814906  6697 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.68:45071, user_credentials={real_user=slave}} blocked reactor thread for 44181.9us
I20260709 13:18:34.773124  7887 raft_consensus.cc:515] T 95a75bfe094d4bdc963aba3f08dfcd25 P cd75a17ab2604397adab03bb8b5fd75c [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:34.818475  6732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d33d5ee8ef6f415593d8df52063161ad" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:18:34.821257  6844 leader_election.cc:304] T 7c44c4849aa54f2b94d1f1bef9ed546f P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: ccd8a4c3bfe3413cb2ae219b09aea832
W20260709 13:18:34.815735  6772 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 44964us
I20260709 13:18:34.805785  7894 leader_election.cc:290] T 1bf4668eeb70467fb3dc5a0289233b3c P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 2 election: Requested vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:18:34.829668  7851 raft_consensus.cc:2804] T 7c44c4849aa54f2b94d1f1bef9ed546f P cd75a17ab2604397adab03bb8b5fd75c [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:18:34.830201  7851 raft_consensus.cc:493] T 7c44c4849aa54f2b94d1f1bef9ed546f P cd75a17ab2604397adab03bb8b5fd75c [term 1 FOLLOWER]: Starting leader election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:18:34.830596  7851 raft_consensus.cc:3060] T 7c44c4849aa54f2b94d1f1bef9ed546f P cd75a17ab2604397adab03bb8b5fd75c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:34.831105  7887 leader_election.cc:290] T 95a75bfe094d4bdc963aba3f08dfcd25 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 2 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:18:34.825845  6772 leader_election.cc:304] T f4b8bd455d5a47c18a1380839c6e0d61 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
W20260709 13:18:34.748171  7466 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 75726.2us
I20260709 13:18:34.848170  6723 raft_consensus.cc:1240] T e77e330a82df4b43a745d57a68f6f057 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 3 FOLLOWER]: Rejecting Update request from peer b7ab4784c7344b939bc36f639286f377 for earlier term 2. Current term is 3. Ops: []
I20260709 13:18:34.849313  6729 raft_consensus.cc:1240] T d8292e16e5654be6bc408560cf256aaa P ccd8a4c3bfe3413cb2ae219b09aea832 [term 2 FOLLOWER]: Rejecting Update request from peer b7ab4784c7344b939bc36f639286f377 for earlier term 1. Current term is 2. Ops: []
I20260709 13:18:34.777643  7858 raft_consensus.cc:493] T 20f6842e26174571996b8dea4151d4be P b7ab4784c7344b939bc36f639286f377 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:18:34.756947  7893 raft_consensus.cc:515] T 30e88460611e47b2ba16a46a30b5f416 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:34.808738  7875 leader_election.cc:290] T 4b8cacb381b746da8d0049b0a83b41dd P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 2 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:18:34.854763  6729 raft_consensus.cc:1240] T 1bf4668eeb70467fb3dc5a0289233b3c P ccd8a4c3bfe3413cb2ae219b09aea832 [term 2 FOLLOWER]: Rejecting Update request from peer b7ab4784c7344b939bc36f639286f377 for earlier term 1. Current term is 2. Ops: []
I20260709 13:18:34.858534  6844 leader_election.cc:304] T e31b9971c15848dea59d4d4130141d9e P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:18:34.838063  6772 leader_election.cc:304] T 3d65025eea89441290d85dd053810e31 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
W20260709 13:18:34.859879  6698 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:34.862208  6772 leader_election.cc:304] T 07a92dd554674067a83a9cb68c4773f2 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:18:34.857491  6726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f58dc08b12a2494bb9a1372837970ca2" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:18:34.778821  7849 raft_consensus.cc:515] T f3f9c2e2bf644115957398fe4c9459db P b7ab4784c7344b939bc36f639286f377 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:34.865077  6772 leader_election.cc:304] T 853ac0a8cbd64ce99457f170216d4d0f P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:18:34.873001  6874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77e330a82df4b43a745d57a68f6f057" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:18:34.873263  6878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8292e16e5654be6bc408560cf256aaa" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:18:34.877395  6878 raft_consensus.cc:1240] T 3fa34c08b205435dba97346991aa1f92 P cd75a17ab2604397adab03bb8b5fd75c [term 2 FOLLOWER]: Rejecting Update request from peer ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 1. Current term is 2. Ops: []
I20260709 13:18:34.877869  6875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a75bfe094d4bdc963aba3f08dfcd25" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:18:34.839486  7869 raft_consensus.cc:2749] T f4b8bd455d5a47c18a1380839c6e0d61 P b7ab4784c7344b939bc36f639286f377 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:34.882550  6805 raft_consensus.cc:2468] T de3186201e1a40d0b335eeb8b4e256e0 P b7ab4784c7344b939bc36f639286f377 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 2.
I20260709 13:18:34.883641  6730 raft_consensus.cc:1240] T a1704639a875409b9959353527b3fd68 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 2 FOLLOWER]: Rejecting Update request from peer b7ab4784c7344b939bc36f639286f377 for earlier term 1. Current term is 2. Ops: []
I20260709 13:18:34.868855  7900 raft_consensus.cc:2749] T 07a92dd554674067a83a9cb68c4773f2 P b7ab4784c7344b939bc36f639286f377 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:34.884984  6873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e326172347f45e99a0d482b5d8ef768" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:18:34.885159  6727 raft_consensus.cc:1240] T 30e88460611e47b2ba16a46a30b5f416 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 2 FOLLOWER]: Rejecting Update request from peer b7ab4784c7344b939bc36f639286f377 for earlier term 1. Current term is 2. Ops: []
I20260709 13:18:34.902679  6872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce4f062dcd314d43a63ca74067cb5ee3" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:18:34.882310  6878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bf4668eeb70467fb3dc5a0289233b3c" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:18:34.881421  6876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b3759de40694069b13c0f8bd40e5709" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:18:34.881115  6844 leader_election.cc:304] T 3a485a995abc4807b6e511e45419f737 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:18:34.861477  7840 raft_consensus.cc:2749] T 3d65025eea89441290d85dd053810e31 P b7ab4784c7344b939bc36f639286f377 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:34.909010  6844 leader_election.cc:304] T f3f9c2e2bf644115957398fe4c9459db P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:18:34.910071  6804 raft_consensus.cc:1240] T f3f9c2e2bf644115957398fe4c9459db P b7ab4784c7344b939bc36f639286f377 [term 2 FOLLOWER]: Rejecting Update request from peer ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 1. Current term is 2. Ops: []
I20260709 13:18:34.911957  6844 leader_election.cc:304] T f09c2a98de1a4decabd0ff900dd44caa P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:18:34.913376  7887 raft_consensus.cc:2804] T f09c2a98de1a4decabd0ff900dd44caa P cd75a17ab2604397adab03bb8b5fd75c [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:18:34.913748  7887 raft_consensus.cc:493] T f09c2a98de1a4decabd0ff900dd44caa P cd75a17ab2604397adab03bb8b5fd75c [term 1 FOLLOWER]: Starting leader election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:18:34.914100  7887 raft_consensus.cc:3060] T f09c2a98de1a4decabd0ff900dd44caa P cd75a17ab2604397adab03bb8b5fd75c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:34.905478  7881 consensus_queue.cc:1059] T e77e330a82df4b43a745d57a68f6f057 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: INVALID_TERM, Last received: 2.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.012s
I20260709 13:18:34.861552  7895 consensus_queue.cc:1059] T ce4f062dcd314d43a63ca74067cb5ee3 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } attrs { replace: true }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.054s
I20260709 13:18:34.916242  7882 raft_consensus.cc:3055] T e77e330a82df4b43a745d57a68f6f057 P b7ab4784c7344b939bc36f639286f377 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:18:34.881948  7841 raft_consensus.cc:2804] T e31b9971c15848dea59d4d4130141d9e P cd75a17ab2604397adab03bb8b5fd75c [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:18:34.880646  6731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44bde925b2e541b69890d70715b85176" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:18:34.912715  7886 raft_consensus.cc:2804] T f3f9c2e2bf644115957398fe4c9459db P cd75a17ab2604397adab03bb8b5fd75c [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:18:34.916602  7882 raft_consensus.cc:740] T e77e330a82df4b43a745d57a68f6f057 P b7ab4784c7344b939bc36f639286f377 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
I20260709 13:18:34.924328  7886 raft_consensus.cc:493] T f3f9c2e2bf644115957398fe4c9459db P cd75a17ab2604397adab03bb8b5fd75c [term 1 FOLLOWER]: Starting leader election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:18:34.924870  7886 raft_consensus.cc:3060] T f3f9c2e2bf644115957398fe4c9459db P cd75a17ab2604397adab03bb8b5fd75c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:34.924999  7882 consensus_queue.cc:260] T e77e330a82df4b43a745d57a68f6f057 P b7ab4784c7344b939bc36f639286f377 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } }
I20260709 13:18:34.909696  7869 consensus_queue.cc:1059] T d8292e16e5654be6bc408560cf256aaa P b7ab4784c7344b939bc36f639286f377 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.018s
I20260709 13:18:34.926879  7882 raft_consensus.cc:3060] T e77e330a82df4b43a745d57a68f6f057 P b7ab4784c7344b939bc36f639286f377 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:34.927263  7869 raft_consensus.cc:3055] T d8292e16e5654be6bc408560cf256aaa P b7ab4784c7344b939bc36f639286f377 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:18:34.927671  7869 raft_consensus.cc:740] T d8292e16e5654be6bc408560cf256aaa P b7ab4784c7344b939bc36f639286f377 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
I20260709 13:18:34.928402  7851 raft_consensus.cc:515] T 7c44c4849aa54f2b94d1f1bef9ed546f P cd75a17ab2604397adab03bb8b5fd75c [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:34.928604  7869 consensus_queue.cc:260] T d8292e16e5654be6bc408560cf256aaa P b7ab4784c7344b939bc36f639286f377 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:34.929665  6880 raft_consensus.cc:1240] T 7c44c4849aa54f2b94d1f1bef9ed546f P cd75a17ab2604397adab03bb8b5fd75c [term 2 FOLLOWER]: Rejecting Update request from peer ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 1. Current term is 2. Ops: []
I20260709 13:18:34.930019  7869 raft_consensus.cc:3060] T d8292e16e5654be6bc408560cf256aaa P b7ab4784c7344b939bc36f639286f377 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:34.918493  6844 leader_election.cc:304] T c4db81d9d329422bb3b4160ca4ac2d1d P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:18:34.922192  6732 raft_consensus.cc:1240] T 90d42e216d9741e190bca19a781291fd P ccd8a4c3bfe3413cb2ae219b09aea832 [term 2 FOLLOWER]: Rejecting Update request from peer b7ab4784c7344b939bc36f639286f377 for earlier term 1. Current term is 2. Ops: []
W20260709 13:18:34.931124  6697 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 47829.5us
I20260709 13:18:34.932243  6844 leader_election.cc:304] T ab432e62819d499eaaf3dd55481dd930 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:18:34.861788  7858 raft_consensus.cc:515] T 20f6842e26174571996b8dea4151d4be P b7ab4784c7344b939bc36f639286f377 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:34.938918  7858 leader_election.cc:290] T 20f6842e26174571996b8dea4151d4be P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:18:34.939575  7850 raft_consensus.cc:2804] T ab432e62819d499eaaf3dd55481dd930 P cd75a17ab2604397adab03bb8b5fd75c [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:18:34.940165  7850 raft_consensus.cc:493] T ab432e62819d499eaaf3dd55481dd930 P cd75a17ab2604397adab03bb8b5fd75c [term 1 FOLLOWER]: Starting leader election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:18:34.940629  7850 raft_consensus.cc:3060] T ab432e62819d499eaaf3dd55481dd930 P cd75a17ab2604397adab03bb8b5fd75c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:34.933676  7868 consensus_queue.cc:1059] T 1bf4668eeb70467fb3dc5a0289233b3c P b7ab4784c7344b939bc36f639286f377 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.007s
I20260709 13:18:34.944190  7840 consensus_queue.cc:1059] T 30e88460611e47b2ba16a46a30b5f416 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:18:34.919587  7891 raft_consensus.cc:2804] T 3a485a995abc4807b6e511e45419f737 P cd75a17ab2604397adab03bb8b5fd75c [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:18:34.947649  7891 raft_consensus.cc:493] T 3a485a995abc4807b6e511e45419f737 P cd75a17ab2604397adab03bb8b5fd75c [term 1 FOLLOWER]: Starting leader election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:18:34.948096  7891 raft_consensus.cc:3060] T 3a485a995abc4807b6e511e45419f737 P cd75a17ab2604397adab03bb8b5fd75c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:34.949452  7850 raft_consensus.cc:515] T ab432e62819d499eaaf3dd55481dd930 P cd75a17ab2604397adab03bb8b5fd75c [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:34.916604  7895 raft_consensus.cc:3055] T ce4f062dcd314d43a63ca74067cb5ee3 P b7ab4784c7344b939bc36f639286f377 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:18:34.952853  7895 raft_consensus.cc:740] T ce4f062dcd314d43a63ca74067cb5ee3 P b7ab4784c7344b939bc36f639286f377 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
I20260709 13:18:34.936842  6844 leader_election.cc:304] T 20f6842e26174571996b8dea4151d4be P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:18:34.953919  7888 raft_consensus.cc:2804] T 20f6842e26174571996b8dea4151d4be P cd75a17ab2604397adab03bb8b5fd75c [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:18:34.954334  6844 leader_election.cc:304] T dbdf895bba214ff68685a24fd17dfb5d P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:18:34.954610  7888 raft_consensus.cc:493] T 20f6842e26174571996b8dea4151d4be P cd75a17ab2604397adab03bb8b5fd75c [term 1 FOLLOWER]: Starting leader election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:18:34.954650  7832 raft_consensus.cc:2804] T c4db81d9d329422bb3b4160ca4ac2d1d P cd75a17ab2604397adab03bb8b5fd75c [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:18:34.952521  6731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b8cacb381b746da8d0049b0a83b41dd" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:18:34.955073  7888 raft_consensus.cc:3060] T 20f6842e26174571996b8dea4151d4be P cd75a17ab2604397adab03bb8b5fd75c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:34.955235  7832 raft_consensus.cc:493] T c4db81d9d329422bb3b4160ca4ac2d1d P cd75a17ab2604397adab03bb8b5fd75c [term 1 FOLLOWER]: Starting leader election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:18:34.955720  7832 raft_consensus.cc:3060] T c4db81d9d329422bb3b4160ca4ac2d1d P cd75a17ab2604397adab03bb8b5fd75c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:34.903136  7853 consensus_queue.cc:1059] T d33d5ee8ef6f415593d8df52063161ad P b7ab4784c7344b939bc36f639286f377 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.053s
I20260709 13:18:34.881752  7884 raft_consensus.cc:2749] T 853ac0a8cbd64ce99457f170216d4d0f P b7ab4784c7344b939bc36f639286f377 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:34.965715  6806 raft_consensus.cc:2468] T bb7fa124c3bf4ef9ab65a407cb008441 P b7ab4784c7344b939bc36f639286f377 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in term 2.
I20260709 13:18:34.962337  6844 leader_election.cc:304] T 4d9def8b32fd443aa94ab1420b06837b P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: ccd8a4c3bfe3413cb2ae219b09aea832
W20260709 13:18:34.880579  7468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 285739us
I20260709 13:18:34.956240  7898 raft_consensus.cc:2804] T dbdf895bba214ff68685a24fd17dfb5d P cd75a17ab2604397adab03bb8b5fd75c [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:18:34.917433  7841 raft_consensus.cc:493] T e31b9971c15848dea59d4d4130141d9e P cd75a17ab2604397adab03bb8b5fd75c [term 1 FOLLOWER]: Starting leader election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:18:34.967322  7850 leader_election.cc:290] T ab432e62819d499eaaf3dd55481dd930 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 2 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:18:34.953904  7895 consensus_queue.cc:260] T ce4f062dcd314d43a63ca74067cb5ee3 P b7ab4784c7344b939bc36f639286f377 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.3, Last appended by leader: 3, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } attrs { replace: true } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:18:35.017668  7895 raft_consensus.cc:3060] T ce4f062dcd314d43a63ca74067cb5ee3 P b7ab4784c7344b939bc36f639286f377 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:34.984760  7499 raft_consensus.cc:1240] T 404190ce4ce94cecbfcb6ea9d1dd8626 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 2 FOLLOWER]: Rejecting Update request from peer ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 1. Current term is 2. Ops: []
I20260709 13:18:34.989272  7849 leader_election.cc:290] T f3f9c2e2bf644115957398fe4c9459db P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 2 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:18:34.990149  7881 raft_consensus.cc:3055] T 1bf4668eeb70467fb3dc5a0289233b3c P b7ab4784c7344b939bc36f639286f377 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:18:34.990540  7468 leader_election.cc:304] T bb3d8792045a4583ae2e965b1350a5b4 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, cd75a17ab2604397adab03bb8b5fd75c; no voters: ccd8a4c3bfe3413cb2ae219b09aea832
W20260709 13:18:35.023852  7468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 48404.8us
I20260709 13:18:35.021770  7881 raft_consensus.cc:740] T 1bf4668eeb70467fb3dc5a0289233b3c P b7ab4784c7344b939bc36f639286f377 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
I20260709 13:18:35.025522  7875 raft_consensus.cc:2804] T bb3d8792045a4583ae2e965b1350a5b4 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:18:35.025322  7881 consensus_queue.cc:260] T 1bf4668eeb70467fb3dc5a0289233b3c P b7ab4784c7344b939bc36f639286f377 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:35.025936  7875 raft_consensus.cc:493] T bb3d8792045a4583ae2e965b1350a5b4 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 1 FOLLOWER]: Starting leader election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:18:35.026329  7875 raft_consensus.cc:3060] T bb3d8792045a4583ae2e965b1350a5b4 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:35.026834  7881 raft_consensus.cc:3060] T 1bf4668eeb70467fb3dc5a0289233b3c P b7ab4784c7344b939bc36f639286f377 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:34.990584  7893 leader_election.cc:290] T 30e88460611e47b2ba16a46a30b5f416 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 2 election: Requested vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:18:34.996847  7840 consensus_queue.cc:1059] T a1704639a875409b9959353527b3fd68 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:18:34.998160  7883 raft_consensus.cc:3055] T 30e88460611e47b2ba16a46a30b5f416 P b7ab4784c7344b939bc36f639286f377 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:18:34.970106  7898 raft_consensus.cc:493] T dbdf895bba214ff68685a24fd17dfb5d P cd75a17ab2604397adab03bb8b5fd75c [term 1 FOLLOWER]: Starting leader election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:18:34.998759  6731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20f6842e26174571996b8dea4151d4be" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:18:34.999032  7868 consensus_queue.cc:1059] T 90d42e216d9741e190bca19a781291fd P b7ab4784c7344b939bc36f639286f377 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:18:35.028673  7883 raft_consensus.cc:740] T 30e88460611e47b2ba16a46a30b5f416 P b7ab4784c7344b939bc36f639286f377 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
I20260709 13:18:35.028894  7898 raft_consensus.cc:3060] T dbdf895bba214ff68685a24fd17dfb5d P cd75a17ab2604397adab03bb8b5fd75c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:34.999493  7858 raft_consensus.cc:3055] T d33d5ee8ef6f415593d8df52063161ad P b7ab4784c7344b939bc36f639286f377 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:18:34.999552  6732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f9c2e2bf644115957398fe4c9459db" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:18:35.001679  7890 consensus_queue.cc:1059] T 3fa34c08b205435dba97346991aa1f92 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:18:35.002318  7886 raft_consensus.cc:515] T f3f9c2e2bf644115957398fe4c9459db P cd75a17ab2604397adab03bb8b5fd75c [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:34.973366  7841 raft_consensus.cc:3060] T e31b9971c15848dea59d4d4130141d9e P cd75a17ab2604397adab03bb8b5fd75c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:34.930719  7851 leader_election.cc:290] T 7c44c4849aa54f2b94d1f1bef9ed546f P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 2 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
W20260709 13:18:35.008378  6695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 102478us
W20260709 13:18:35.011314  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 49113.4us
I20260709 13:18:35.050807  6844 leader_election.cc:304] T 24ee15416e3145beaa1b8183453729a3 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:18:35.013710  7888 raft_consensus.cc:515] T 20f6842e26174571996b8dea4151d4be P cd75a17ab2604397adab03bb8b5fd75c [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
W20260709 13:18:35.053350  6771 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:35.053807  7888 leader_election.cc:290] T 20f6842e26174571996b8dea4151d4be P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 2 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:18:35.054901  7888 raft_consensus.cc:2804] T 24ee15416e3145beaa1b8183453729a3 P cd75a17ab2604397adab03bb8b5fd75c [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:18:35.014626  7776 consensus_queue.cc:1059] T 7c44c4849aa54f2b94d1f1bef9ed546f P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:18:35.057001  7776 raft_consensus.cc:3055] T 7c44c4849aa54f2b94d1f1bef9ed546f P ccd8a4c3bfe3413cb2ae219b09aea832 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:18:35.057540  7776 raft_consensus.cc:740] T 7c44c4849aa54f2b94d1f1bef9ed546f P ccd8a4c3bfe3413cb2ae219b09aea832 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
I20260709 13:18:35.058720  7776 consensus_queue.cc:260] T 7c44c4849aa54f2b94d1f1bef9ed546f P ccd8a4c3bfe3413cb2ae219b09aea832 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:35.061540  7776 raft_consensus.cc:3060] T 7c44c4849aa54f2b94d1f1bef9ed546f P ccd8a4c3bfe3413cb2ae219b09aea832 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:18:35.016181  6846 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.68:45071, user_credentials={real_user=slave}} blocked reactor thread for 54655.9us
I20260709 13:18:35.016219  7784 consensus_queue.cc:1048] T 24ee15416e3145beaa1b8183453729a3 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:18:35.043658  7898 raft_consensus.cc:515] T dbdf895bba214ff68685a24fd17dfb5d P cd75a17ab2604397adab03bb8b5fd75c [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:35.017699  7908 raft_consensus.cc:2804] T 4d9def8b32fd443aa94ab1420b06837b P cd75a17ab2604397adab03bb8b5fd75c [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:18:34.983829  7466 leader_election.cc:304] T bb7fa124c3bf4ef9ab65a407cb008441 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, b7ab4784c7344b939bc36f639286f377; no voters: 
W20260709 13:18:35.070037  7466 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 86284.5us
I20260709 13:18:35.070191  7878 raft_consensus.cc:2804] T bb7fa124c3bf4ef9ab65a407cb008441 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:18:35.070817  7878 raft_consensus.cc:697] T bb7fa124c3bf4ef9ab65a407cb008441 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 2 LEADER]: Becoming Leader. State: Replica: 7ba59cc884714e8aa5f3f0ecaed84cbb, State: Running, Role: LEADER
I20260709 13:18:35.070866  7466 leader_election.cc:304] T be1a92657f494cac8dd227d152f50151 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
W20260709 13:18:35.020131  6772 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 149050us
I20260709 13:18:34.956269  7891 raft_consensus.cc:515] T 3a485a995abc4807b6e511e45419f737 P cd75a17ab2604397adab03bb8b5fd75c [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:35.034974  7840 raft_consensus.cc:3055] T a1704639a875409b9959353527b3fd68 P b7ab4784c7344b939bc36f639286f377 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:18:35.073228  6880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ba5dac66ab5497e9e336f2a3c28cda5" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:18:35.032194  7858 raft_consensus.cc:740] T d33d5ee8ef6f415593d8df52063161ad P b7ab4784c7344b939bc36f639286f377 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
I20260709 13:18:35.037134  7868 raft_consensus.cc:3055] T 90d42e216d9741e190bca19a781291fd P b7ab4784c7344b939bc36f639286f377 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:18:35.086740  6875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20f6842e26174571996b8dea4151d4be" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:18:35.039958  7910 raft_consensus.cc:493] T f09c2a98de1a4decabd0ff900dd44caa P b7ab4784c7344b939bc36f639286f377 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:18:35.029800  7883 consensus_queue.cc:260] T 30e88460611e47b2ba16a46a30b5f416 P b7ab4784c7344b939bc36f639286f377 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:35.044317  7832 raft_consensus.cc:515] T c4db81d9d329422bb3b4160ca4ac2d1d P cd75a17ab2604397adab03bb8b5fd75c [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:35.031620  7887 raft_consensus.cc:515] T f09c2a98de1a4decabd0ff900dd44caa P cd75a17ab2604397adab03bb8b5fd75c [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:35.039034  7893 raft_consensus.cc:3055] T 3fa34c08b205435dba97346991aa1f92 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:18:35.104557  7910 raft_consensus.cc:515] T f09c2a98de1a4decabd0ff900dd44caa P b7ab4784c7344b939bc36f639286f377 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:35.110770  7893 raft_consensus.cc:740] T 3fa34c08b205435dba97346991aa1f92 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
I20260709 13:18:35.111842  7893 consensus_queue.cc:260] T 3fa34c08b205435dba97346991aa1f92 P ccd8a4c3bfe3413cb2ae219b09aea832 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:18:35.112793  7910 leader_election.cc:290] T f09c2a98de1a4decabd0ff900dd44caa P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:18:35.113355  7893 raft_consensus.cc:3060] T 3fa34c08b205435dba97346991aa1f92 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:35.104348  6873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f58dc08b12a2494bb9a1372837970ca2" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:18:35.115406  6873 raft_consensus.cc:1240] T 9e326172347f45e99a0d482b5d8ef768 P cd75a17ab2604397adab03bb8b5fd75c [term 2 FOLLOWER]: Rejecting Update request from peer b7ab4784c7344b939bc36f639286f377 for earlier term 1. Current term is 2. Ops: []
I20260709 13:18:35.048461  7886 leader_election.cc:290] T f3f9c2e2bf644115957398fe4c9459db P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 2 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:18:35.116281  7878 consensus_queue.cc:237] T bb7fa124c3bf4ef9ab65a407cb008441 P 7ba59cc884714e8aa5f3f0ecaed84cbb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:18:35.089126  6878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44bde925b2e541b69890d70715b85176" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:18:35.118996  7887 leader_election.cc:290] T f09c2a98de1a4decabd0ff900dd44caa P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 2 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:18:35.085476  6874 raft_consensus.cc:1240] T 95a75bfe094d4bdc963aba3f08dfcd25 P cd75a17ab2604397adab03bb8b5fd75c [term 2 FOLLOWER]: Rejecting Update request from peer b7ab4784c7344b939bc36f639286f377 for earlier term 1. Current term is 2. Ops: []
I20260709 13:18:35.123099  6874 raft_consensus.cc:1240] T 90d42e216d9741e190bca19a781291fd P cd75a17ab2604397adab03bb8b5fd75c [term 2 FOLLOWER]: Rejecting Update request from peer b7ab4784c7344b939bc36f639286f377 for earlier term 1. Current term is 2. Ops: []
I20260709 13:18:35.084611  6876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f00a2e87e56452083b759f60d461ee3" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:18:35.090281  6880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30e88460611e47b2ba16a46a30b5f416" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:18:35.070405  7898 leader_election.cc:290] T dbdf895bba214ff68685a24fd17dfb5d P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 2 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:18:35.093403  7906 consensus_queue.cc:1048] T 1528ab62b6fe4e3099d08f141afee116 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.002s
I20260709 13:18:35.093850  6695 leader_election.cc:304] T 3d65025eea89441290d85dd053810e31 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:18:35.105659  6877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b56bf91d90824c959e21e0cee5ba1816" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:18:35.095805  6879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f9c2e2bf644115957398fe4c9459db" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:18:35.104745  6881 raft_consensus.cc:1240] T ce4f062dcd314d43a63ca74067cb5ee3 P cd75a17ab2604397adab03bb8b5fd75c [term 2 FOLLOWER]: Rejecting Update request from peer b7ab4784c7344b939bc36f639286f377 for earlier term 1. Current term is 2. Ops: []
I20260709 13:18:35.108711  6872 raft_consensus.cc:1240] T 9b3759de40694069b13c0f8bd40e5709 P cd75a17ab2604397adab03bb8b5fd75c [term 2 FOLLOWER]: Rejecting Update request from peer b7ab4784c7344b939bc36f639286f377 for earlier term 1. Current term is 2. Ops: []
W20260709 13:18:35.108904  6772 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:35.049793  7875 raft_consensus.cc:515] T bb3d8792045a4583ae2e965b1350a5b4 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:18:35.069766  7908 raft_consensus.cc:493] T 4d9def8b32fd443aa94ab1420b06837b P cd75a17ab2604397adab03bb8b5fd75c [term 1 FOLLOWER]: Starting leader election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:18:35.126051  6875 raft_consensus.cc:1240] T a1704639a875409b9959353527b3fd68 P cd75a17ab2604397adab03bb8b5fd75c [term 2 FOLLOWER]: Rejecting Update request from peer b7ab4784c7344b939bc36f639286f377 for earlier term 1. Current term is 2. Ops: []
I20260709 13:18:35.074190  7888 raft_consensus.cc:493] T 24ee15416e3145beaa1b8183453729a3 P cd75a17ab2604397adab03bb8b5fd75c [term 1 FOLLOWER]: Starting leader election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:18:35.132916  7888 raft_consensus.cc:3060] T 24ee15416e3145beaa1b8183453729a3 P cd75a17ab2604397adab03bb8b5fd75c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:35.133220  6731 raft_consensus.cc:1240] T 9e326172347f45e99a0d482b5d8ef768 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 2 FOLLOWER]: Rejecting Update request from peer b7ab4784c7344b939bc36f639286f377 for earlier term 1. Current term is 2. Ops: []
I20260709 13:18:35.106189  7874 raft_consensus.cc:2749] T be1a92657f494cac8dd227d152f50151 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:18:35.091665  7868 raft_consensus.cc:740] T 90d42e216d9741e190bca19a781291fd P b7ab4784c7344b939bc36f639286f377 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
I20260709 13:18:35.137127  6732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09c2a98de1a4decabd0ff900dd44caa" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:18:35.137692  7868 consensus_queue.cc:260] T 90d42e216d9741e190bca19a781291fd P b7ab4784c7344b939bc36f639286f377 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:35.139081  7868 raft_consensus.cc:3060] T 90d42e216d9741e190bca19a781291fd P b7ab4784c7344b939bc36f639286f377 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:35.139364  7891 leader_election.cc:290] T 3a485a995abc4807b6e511e45419f737 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 2 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:18:35.140545  7896 raft_consensus.cc:2749] T 3d65025eea89441290d85dd053810e31 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:35.140264  7858 consensus_queue.cc:260] T d33d5ee8ef6f415593d8df52063161ad P b7ab4784c7344b939bc36f639286f377 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:35.142834  7841 raft_consensus.cc:515] T e31b9971c15848dea59d4d4130141d9e P cd75a17ab2604397adab03bb8b5fd75c [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:35.095952  7821 consensus_queue.cc:1048] T 24ee15416e3145beaa1b8183453729a3 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.048s
W20260709 13:18:35.140580  6695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 48124.8us
I20260709 13:18:35.145778  7908 raft_consensus.cc:3060] T 4d9def8b32fd443aa94ab1420b06837b P cd75a17ab2604397adab03bb8b5fd75c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:35.146399  6695 leader_election.cc:304] T f5be3a11b23d4ea9b08300a2789821c7 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:18:35.089279  7840 raft_consensus.cc:740] T a1704639a875409b9959353527b3fd68 P b7ab4784c7344b939bc36f639286f377 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
I20260709 13:18:35.147593  6695 leader_election.cc:304] T d33d5ee8ef6f415593d8df52063161ad P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:18:35.145773  7883 raft_consensus.cc:3060] T 30e88460611e47b2ba16a46a30b5f416 P b7ab4784c7344b939bc36f639286f377 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:18:35.148797  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 96051.2us
I20260709 13:18:35.152486  6732 raft_consensus.cc:1240] T d33d5ee8ef6f415593d8df52063161ad P ccd8a4c3bfe3413cb2ae219b09aea832 [term 2 FOLLOWER]: Rejecting Update request from peer b7ab4784c7344b939bc36f639286f377 for earlier term 1. Current term is 2. Ops: []
I20260709 13:18:35.155407  7849 raft_consensus.cc:493] T b3f13b31a1f84f0d89d007eadd57924c P b7ab4784c7344b939bc36f639286f377 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:18:35.153838  7841 leader_election.cc:290] T e31b9971c15848dea59d4d4130141d9e P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 2 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:18:35.156167  7849 raft_consensus.cc:515] T b3f13b31a1f84f0d89d007eadd57924c P b7ab4784c7344b939bc36f639286f377 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:18:35.154934  6695 leader_election.cc:304] T 427c124d773f483294511e80fe340075 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:18:35.157338  7821 raft_consensus.cc:2749] T 427c124d773f483294511e80fe340075 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:35.158442  7849 leader_election.cc:290] T b3f13b31a1f84f0d89d007eadd57924c P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:18:35.158553  6695 leader_election.cc:304] T 90d42e216d9741e190bca19a781291fd P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:18:35.150626  7502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ba5dac66ab5497e9e336f2a3c28cda5" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb"
I20260709 13:18:35.151131  7816 raft_consensus.cc:2749] T f5be3a11b23d4ea9b08300a2789821c7 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:18:35.155481  6844 leader_election.cc:304] T 44bde925b2e541b69890d70715b85176 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:18:35.163879  7501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f00a2e87e56452083b759f60d461ee3" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:18:35.164389  7499 raft_consensus.cc:1240] T d8cee0accdb8499c86d4414b72565a38 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 2 FOLLOWER]: Rejecting Update request from peer b7ab4784c7344b939bc36f639286f377 for earlier term 1. Current term is 2. Ops: []
I20260709 13:18:35.164389  7776 raft_consensus.cc:2749] T d33d5ee8ef6f415593d8df52063161ad P ccd8a4c3bfe3413cb2ae219b09aea832 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:18:35.165964  6844 leader_election.cc:304] T 713b5728a197487c9300b310ab94e5a3 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:18:35.166265  7832 leader_election.cc:290] T c4db81d9d329422bb3b4160ca4ac2d1d P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 2 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:18:35.166760  7898 raft_consensus.cc:2804] T 44bde925b2e541b69890d70715b85176 P cd75a17ab2604397adab03bb8b5fd75c [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:18:35.166855  7832 raft_consensus.cc:2804] T 713b5728a197487c9300b310ab94e5a3 P cd75a17ab2604397adab03bb8b5fd75c [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:18:35.167162  7898 raft_consensus.cc:493] T 44bde925b2e541b69890d70715b85176 P cd75a17ab2604397adab03bb8b5fd75c [term 1 FOLLOWER]: Starting leader election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:18:35.167256  7832 raft_consensus.cc:493] T 713b5728a197487c9300b310ab94e5a3 P cd75a17ab2604397adab03bb8b5fd75c [term 1 FOLLOWER]: Starting leader election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:18:35.167598  7898 raft_consensus.cc:3060] T 44bde925b2e541b69890d70715b85176 P cd75a17ab2604397adab03bb8b5fd75c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:35.167647  7832 raft_consensus.cc:3060] T 713b5728a197487c9300b310ab94e5a3 P cd75a17ab2604397adab03bb8b5fd75c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:35.168855  7840 consensus_queue.cc:260] T a1704639a875409b9959353527b3fd68 P b7ab4784c7344b939bc36f639286f377 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:35.170226  7840 raft_consensus.cc:3060] T a1704639a875409b9959353527b3fd68 P b7ab4784c7344b939bc36f639286f377 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:35.173554  6844 leader_election.cc:304] T f03d0dbf16864ca4bc1bb5e4c0334c0f P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:18:35.173776  6695 leader_election.cc:304] T 17587d6730594da4a56fa13a353232a1 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb
I20260709 13:18:35.176465  7821 raft_consensus.cc:2749] T 90d42e216d9741e190bca19a781291fd P ccd8a4c3bfe3413cb2ae219b09aea832 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:18:35.176966  7502 raft_consensus.cc:1275] T ce4f062dcd314d43a63ca74067cb5ee3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 1 LEARNER]: Refusing update from remote peer b7ab4784c7344b939bc36f639286f377: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:18:35.178463  6844 leader_election.cc:304] T 1528ab62b6fe4e3099d08f141afee116 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:18:35.180758  6844 leader_election.cc:304] T 7887766dc6784fcaa42b35c05fea7a99 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:18:35.183180  6695 leader_election.cc:304] T de3186201e1a40d0b335eeb8b4e256e0 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
W20260709 13:18:35.186101  7466 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 115308us
I20260709 13:18:35.187104  6844 leader_election.cc:304] T 3411566abe2d4c9bb4b2adfdd05e6f17 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:18:35.186194  7816 raft_consensus.cc:2804] T 17587d6730594da4a56fa13a353232a1 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:18:35.188258  6732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3f13b31a1f84f0d89d007eadd57924c" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:18:35.185719  7891 raft_consensus.cc:2804] T 1528ab62b6fe4e3099d08f141afee116 P cd75a17ab2604397adab03bb8b5fd75c [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:18:35.188588  7816 raft_consensus.cc:697] T 17587d6730594da4a56fa13a353232a1 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 3 LEADER]: Becoming Leader. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
I20260709 13:18:35.188923  7891 raft_consensus.cc:493] T 1528ab62b6fe4e3099d08f141afee116 P cd75a17ab2604397adab03bb8b5fd75c [term 1 FOLLOWER]: Starting leader election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:18:35.187109  7887 raft_consensus.cc:2804] T 7887766dc6784fcaa42b35c05fea7a99 P cd75a17ab2604397adab03bb8b5fd75c [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:18:35.189955  7887 raft_consensus.cc:493] T 7887766dc6784fcaa42b35c05fea7a99 P cd75a17ab2604397adab03bb8b5fd75c [term 1 FOLLOWER]: Starting leader election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:18:35.189545  7816 consensus_queue.cc:237] T 17587d6730594da4a56fa13a353232a1 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:18:35.190295  7857 raft_consensus.cc:2749] T de3186201e1a40d0b335eeb8b4e256e0 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:18:35.185849  7910 consensus_queue.cc:1059] T d33d5ee8ef6f415593d8df52063161ad P b7ab4784c7344b939bc36f639286f377 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.005s
I20260709 13:18:35.151201  7853 consensus_queue.cc:1059] T 9e326172347f45e99a0d482b5d8ef768 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.043s
I20260709 13:18:35.190359  7887 raft_consensus.cc:3060] T 7887766dc6784fcaa42b35c05fea7a99 P cd75a17ab2604397adab03bb8b5fd75c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:35.185220  7849 raft_consensus.cc:493] T 7c37d41cd9164c15a6826ca62a851a69 P b7ab4784c7344b939bc36f639286f377 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:18:35.208926  7849 raft_consensus.cc:515] T 7c37d41cd9164c15a6826ca62a851a69 P b7ab4784c7344b939bc36f639286f377 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:35.209803  6732 raft_consensus.cc:1240] T 9b3759de40694069b13c0f8bd40e5709 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 2 FOLLOWER]: Rejecting Update request from peer b7ab4784c7344b939bc36f639286f377 for earlier term 1. Current term is 2. Ops: []
I20260709 13:18:35.212239  6875 raft_consensus.cc:1240] T 20f6842e26174571996b8dea4151d4be P cd75a17ab2604397adab03bb8b5fd75c [term 2 FOLLOWER]: Rejecting Update request from peer ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 1. Current term is 2. Ops: []
I20260709 13:18:35.178584  7841 raft_consensus.cc:2804] T f03d0dbf16864ca4bc1bb5e4c0334c0f P cd75a17ab2604397adab03bb8b5fd75c [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:18:35.213644  6879 raft_consensus.cc:1240] T ab432e62819d499eaaf3dd55481dd930 P cd75a17ab2604397adab03bb8b5fd75c [term 2 FOLLOWER]: Rejecting Update request from peer ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 1. Current term is 2. Ops: []
I20260709 13:18:35.215938  6695 leader_election.cc:304] T a1704639a875409b9959353527b3fd68 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:18:35.216181  7466 leader_election.cc:304] T 404190ce4ce94cecbfcb6ea9d1dd8626 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:18:35.174949  7875 leader_election.cc:290] T bb3d8792045a4583ae2e965b1350a5b4 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 2 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:18:35.219274  7910 raft_consensus.cc:493] T a3022224cc81473690653a83d4e99470 P b7ab4784c7344b939bc36f639286f377 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader cd75a17ab2604397adab03bb8b5fd75c)
I20260709 13:18:35.219470  7853 raft_consensus.cc:3055] T 9e326172347f45e99a0d482b5d8ef768 P b7ab4784c7344b939bc36f639286f377 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:18:35.220050  7853 raft_consensus.cc:740] T 9e326172347f45e99a0d482b5d8ef768 P b7ab4784c7344b939bc36f639286f377 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
I20260709 13:18:35.219830  7910 raft_consensus.cc:515] T a3022224cc81473690653a83d4e99470 P b7ab4784c7344b939bc36f639286f377 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:35.220616  7874 raft_consensus.cc:2749] T 404190ce4ce94cecbfcb6ea9d1dd8626 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:18:35.189311  7891 raft_consensus.cc:3060] T 1528ab62b6fe4e3099d08f141afee116 P cd75a17ab2604397adab03bb8b5fd75c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:35.222555  7870 consensus_queue.cc:1059] T 9b3759de40694069b13c0f8bd40e5709 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:18:35.223774  7900 raft_consensus.cc:3055] T 9b3759de40694069b13c0f8bd40e5709 P b7ab4784c7344b939bc36f639286f377 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:18:35.213768  7841 raft_consensus.cc:493] T f03d0dbf16864ca4bc1bb5e4c0334c0f P cd75a17ab2604397adab03bb8b5fd75c [term 1 FOLLOWER]: Starting leader election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:18:35.224737  7841 raft_consensus.cc:3060] T f03d0dbf16864ca4bc1bb5e4c0334c0f P cd75a17ab2604397adab03bb8b5fd75c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:35.224190  7900 raft_consensus.cc:740] T 9b3759de40694069b13c0f8bd40e5709 P b7ab4784c7344b939bc36f639286f377 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
I20260709 13:18:35.226408  7900 consensus_queue.cc:260] T 9b3759de40694069b13c0f8bd40e5709 P b7ab4784c7344b939bc36f639286f377 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:35.227421  7900 raft_consensus.cc:3060] T 9b3759de40694069b13c0f8bd40e5709 P b7ab4784c7344b939bc36f639286f377 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:18:35.230554  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 43604.5us
I20260709 13:18:35.233657  6844 leader_election.cc:304] T b56bf91d90824c959e21e0cee5ba1816 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:18:35.234382  6695 leader_election.cc:304] T 2c240553ce044eedb41541d72b9475d7 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:18:35.235321  6844 leader_election.cc:304] T 711ef6523deb4cbe8ef2ba61e1c21c98 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:18:35.236936  6844 leader_election.cc:304] T 4275cf08e63345f993bce8664eada830 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:18:35.237471  6695 leader_election.cc:304] T bd6869f07b5a4885a0b99fbe60c3b175 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:18:35.239511  6730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3d8792045a4583ae2e965b1350a5b4" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:18:35.240443  7857 raft_consensus.cc:2749] T 2c240553ce044eedb41541d72b9475d7 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:18:35.241086  7857 consensus_queue.cc:1059] T 20f6842e26174571996b8dea4151d4be P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:18:35.241966  7857 raft_consensus.cc:3055] T 20f6842e26174571996b8dea4151d4be P ccd8a4c3bfe3413cb2ae219b09aea832 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:18:35.242190  7857 raft_consensus.cc:740] T 20f6842e26174571996b8dea4151d4be P ccd8a4c3bfe3413cb2ae219b09aea832 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
I20260709 13:18:35.238444  7851 raft_consensus.cc:2804] T b56bf91d90824c959e21e0cee5ba1816 P cd75a17ab2604397adab03bb8b5fd75c [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:18:35.242693  7851 raft_consensus.cc:493] T b56bf91d90824c959e21e0cee5ba1816 P cd75a17ab2604397adab03bb8b5fd75c [term 1 FOLLOWER]: Starting leader election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:18:35.242774  7857 consensus_queue.cc:260] T 20f6842e26174571996b8dea4151d4be P ccd8a4c3bfe3413cb2ae219b09aea832 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:35.243299  7851 raft_consensus.cc:3060] T b56bf91d90824c959e21e0cee5ba1816 P cd75a17ab2604397adab03bb8b5fd75c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:35.243832  7857 raft_consensus.cc:3060] T 20f6842e26174571996b8dea4151d4be P ccd8a4c3bfe3413cb2ae219b09aea832 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:35.239540  6731 raft_consensus.cc:1240] T bd6869f07b5a4885a0b99fbe60c3b175 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 3 FOLLOWER]: Rejecting Update request from peer b7ab4784c7344b939bc36f639286f377 for earlier term 2. Current term is 3. Ops: []
I20260709 13:18:35.245523  7899 raft_consensus.cc:2749] T a1704639a875409b9959353527b3fd68 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:18:35.232757  7907 raft_consensus.cc:2749] T 3411566abe2d4c9bb4b2adfdd05e6f17 P cd75a17ab2604397adab03bb8b5fd75c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:35.246724  6732 raft_consensus.cc:1240] T 95a75bfe094d4bdc963aba3f08dfcd25 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 2 FOLLOWER]: Rejecting Update request from peer b7ab4784c7344b939bc36f639286f377 for earlier term 1. Current term is 2. Ops: []
I20260709 13:18:35.246896  7886 raft_consensus.cc:2804] T 711ef6523deb4cbe8ef2ba61e1c21c98 P cd75a17ab2604397adab03bb8b5fd75c [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:18:35.247522  7886 raft_consensus.cc:493] T 711ef6523deb4cbe8ef2ba61e1c21c98 P cd75a17ab2604397adab03bb8b5fd75c [term 1 FOLLOWER]: Starting leader election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:18:35.247987  7886 raft_consensus.cc:3060] T 711ef6523deb4cbe8ef2ba61e1c21c98 P cd75a17ab2604397adab03bb8b5fd75c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:35.249393  6879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09c2a98de1a4decabd0ff900dd44caa" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:18:35.250128  7881 raft_consensus.cc:493] T 4275cf08e63345f993bce8664eada830 P b7ab4784c7344b939bc36f639286f377 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:18:35.250023  7821 consensus_queue.cc:1059] T ab432e62819d499eaaf3dd55481dd930 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:18:35.250514  6772 leader_election.cc:304] T 7ba5dac66ab5497e9e336f2a3c28cda5 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:18:35.250701  7881 raft_consensus.cc:515] T 4275cf08e63345f993bce8664eada830 P b7ab4784c7344b939bc36f639286f377 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:35.251801  7884 consensus_queue.cc:1059] T d8cee0accdb8499c86d4414b72565a38 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:18:35.254115  7499 raft_consensus.cc:1240] T be1a92657f494cac8dd227d152f50151 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 2 FOLLOWER]: Rejecting Update request from peer ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 1. Current term is 2. Ops: []
I20260709 13:18:35.255786  7870 raft_consensus.cc:2749] T 7ba5dac66ab5497e9e336f2a3c28cda5 P b7ab4784c7344b939bc36f639286f377 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:18:35.259903  7821 raft_consensus.cc:3055] T ab432e62819d499eaaf3dd55481dd930 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:18:35.260358  7821 raft_consensus.cc:740] T ab432e62819d499eaaf3dd55481dd930 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
I20260709 13:18:35.261173  7821 consensus_queue.cc:260] T ab432e62819d499eaaf3dd55481dd930 P ccd8a4c3bfe3413cb2ae219b09aea832 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:35.259706  7910 leader_election.cc:290] T a3022224cc81473690653a83d4e99470 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:18:35.252856  7881 leader_election.cc:290] T 4275cf08e63345f993bce8664eada830 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:18:35.276240  7892 raft_consensus.cc:2749] T bd6869f07b5a4885a0b99fbe60c3b175 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
W20260709 13:18:35.282181  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 45316.5us
I20260709 13:18:35.283329  6695 leader_election.cc:304] T ce4f062dcd314d43a63ca74067cb5ee3 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:18:35.283602  6844 leader_election.cc:304] T 22ccee1b570c4ad3a57bd7aec085b1b4 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:18:35.284798  6844 leader_election.cc:304] T 07a92dd554674067a83a9cb68c4773f2 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:18:35.285245  6695 leader_election.cc:304] T e77e330a82df4b43a745d57a68f6f057 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:18:35.252874  6772 leader_election.cc:304] T 20f6842e26174571996b8dea4151d4be P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:18:35.288213  6772 leader_election.cc:304] T f58dc08b12a2494bb9a1372837970ca2 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:18:35.280359  7849 leader_election.cc:290] T 7c37d41cd9164c15a6826ca62a851a69 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:18:35.280840  6875 raft_consensus.cc:1240] T f3f9c2e2bf644115957398fe4c9459db P cd75a17ab2604397adab03bb8b5fd75c [term 2 FOLLOWER]: Rejecting Update request from peer ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 1. Current term is 2. Ops: []
I20260709 13:18:35.290519  7776 raft_consensus.cc:2749] T ce4f062dcd314d43a63ca74067cb5ee3 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:18:35.291627  7910 raft_consensus.cc:2749] T f58dc08b12a2494bb9a1372837970ca2 P b7ab4784c7344b939bc36f639286f377 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:18:35.292075  6772 leader_election.cc:304] T 44bde925b2e541b69890d70715b85176 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:18:35.292658  7850 raft_consensus.cc:2804] T 07a92dd554674067a83a9cb68c4773f2 P cd75a17ab2604397adab03bb8b5fd75c [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:18:35.293063  7850 raft_consensus.cc:493] T 07a92dd554674067a83a9cb68c4773f2 P cd75a17ab2604397adab03bb8b5fd75c [term 1 FOLLOWER]: Starting leader election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:18:35.293447  7850 raft_consensus.cc:3060] T 07a92dd554674067a83a9cb68c4773f2 P cd75a17ab2604397adab03bb8b5fd75c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:35.293527  6772 leader_election.cc:304] T 4f00a2e87e56452083b759f60d461ee3 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:18:35.296217  7882 raft_consensus.cc:2749] T 44bde925b2e541b69890d70715b85176 P b7ab4784c7344b939bc36f639286f377 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:18:35.297771  7776 raft_consensus.cc:2749] T e77e330a82df4b43a745d57a68f6f057 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:18:35.298408  7776 consensus_queue.cc:1059] T 4b8cacb381b746da8d0049b0a83b41dd P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:18:35.298323  6844 leader_election.cc:304] T 7a734b5ab7834e05a8c422208acc58b1 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:18:35.302757  6695 leader_election.cc:304] T 8c7f33e544204fbaac4078e3e83bbf4e P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:18:35.305656  7784 raft_consensus.cc:3055] T 4b8cacb381b746da8d0049b0a83b41dd P ccd8a4c3bfe3413cb2ae219b09aea832 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:18:35.305838  7911 raft_consensus.cc:2804] T 22ccee1b570c4ad3a57bd7aec085b1b4 P cd75a17ab2604397adab03bb8b5fd75c [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:18:35.306326  7784 raft_consensus.cc:740] T 4b8cacb381b746da8d0049b0a83b41dd P ccd8a4c3bfe3413cb2ae219b09aea832 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
I20260709 13:18:35.308166  7499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3f13b31a1f84f0d89d007eadd57924c" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:18:35.309294  6732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c37d41cd9164c15a6826ca62a851a69" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:18:35.311146  7835 consensus_queue.cc:1059] T 404190ce4ce94cecbfcb6ea9d1dd8626 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:18:35.280383  7907 raft_consensus.cc:2749] T 4275cf08e63345f993bce8664eada830 P cd75a17ab2604397adab03bb8b5fd75c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:35.312551  7907 raft_consensus.cc:2804] T 7a734b5ab7834e05a8c422208acc58b1 P cd75a17ab2604397adab03bb8b5fd75c [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:18:35.312942  7907 raft_consensus.cc:493] T 7a734b5ab7834e05a8c422208acc58b1 P cd75a17ab2604397adab03bb8b5fd75c [term 1 FOLLOWER]: Starting leader election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:18:35.313272  7907 raft_consensus.cc:3060] T 7a734b5ab7834e05a8c422208acc58b1 P cd75a17ab2604397adab03bb8b5fd75c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:35.314452  6875 raft_consensus.cc:1240] T 3a485a995abc4807b6e511e45419f737 P cd75a17ab2604397adab03bb8b5fd75c [term 2 FOLLOWER]: Rejecting Update request from peer ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 1. Current term is 2. Ops: []
I20260709 13:18:35.315105  6874 raft_consensus.cc:1240] T f09c2a98de1a4decabd0ff900dd44caa P cd75a17ab2604397adab03bb8b5fd75c [term 2 FOLLOWER]: Rejecting Update request from peer ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 1. Current term is 2. Ops: []
I20260709 13:18:35.315856  6877 raft_consensus.cc:1240] T e31b9971c15848dea59d4d4130141d9e P cd75a17ab2604397adab03bb8b5fd75c [term 2 FOLLOWER]: Rejecting Update request from peer ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 1. Current term is 2. Ops: []
I20260709 13:18:35.306479  7911 raft_consensus.cc:493] T 22ccee1b570c4ad3a57bd7aec085b1b4 P cd75a17ab2604397adab03bb8b5fd75c [term 1 FOLLOWER]: Starting leader election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:18:35.320639  7723 consensus_queue.cc:1059] T f3f9c2e2bf644115957398fe4c9459db P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:18:35.320178  6878 raft_consensus.cc:1240] T c4db81d9d329422bb3b4160ca4ac2d1d P cd75a17ab2604397adab03bb8b5fd75c [term 2 FOLLOWER]: Rejecting Update request from peer ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 1. Current term is 2. Ops: []
I20260709 13:18:35.307694  7784 consensus_queue.cc:260] T 4b8cacb381b746da8d0049b0a83b41dd P ccd8a4c3bfe3413cb2ae219b09aea832 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:18:35.313644  7835 consensus_queue.cc:1059] T be1a92657f494cac8dd227d152f50151 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.008s
W20260709 13:18:35.325780  6773 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:35.322486  7501 raft_consensus.cc:2955] T 1528ab62b6fe4e3099d08f141afee116 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } attrs { replace: true } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } } }
I20260709 13:18:35.321887  7893 raft_consensus.cc:3055] T 404190ce4ce94cecbfcb6ea9d1dd8626 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:18:35.297950  7881 raft_consensus.cc:2749] T 20f6842e26174571996b8dea4151d4be P b7ab4784c7344b939bc36f639286f377 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:35.276691  7840 consensus_queue.cc:1059] T 95a75bfe094d4bdc963aba3f08dfcd25 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.040s
I20260709 13:18:35.325912  7784 raft_consensus.cc:3060] T 4b8cacb381b746da8d0049b0a83b41dd P ccd8a4c3bfe3413cb2ae219b09aea832 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:35.328727  7723 raft_consensus.cc:3055] T f3f9c2e2bf644115957398fe4c9459db P ccd8a4c3bfe3413cb2ae219b09aea832 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:18:35.275460  7869 consensus_queue.cc:1059] T bd6869f07b5a4885a0b99fbe60c3b175 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: INVALID_TERM, Last received: 2.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.042s
I20260709 13:18:35.335939  7723 raft_consensus.cc:740] T f3f9c2e2bf644115957398fe4c9459db P ccd8a4c3bfe3413cb2ae219b09aea832 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
I20260709 13:18:35.237174  7888 raft_consensus.cc:515] T 24ee15416e3145beaa1b8183453729a3 P cd75a17ab2604397adab03bb8b5fd75c [term 2 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } attrs { replace: true } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:18:35.302994  7910 raft_consensus.cc:2749] T 4f00a2e87e56452083b759f60d461ee3 P b7ab4784c7344b939bc36f639286f377 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:18:35.331194  6695 leader_election.cc:304] T d8292e16e5654be6bc408560cf256aaa P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:18:35.325402  7887 raft_consensus.cc:515] T 7887766dc6784fcaa42b35c05fea7a99 P cd75a17ab2604397adab03bb8b5fd75c [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:35.342653  7723 consensus_queue.cc:260] T f3f9c2e2bf644115957398fe4c9459db P ccd8a4c3bfe3413cb2ae219b09aea832 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:35.328297  7893 raft_consensus.cc:740] T 404190ce4ce94cecbfcb6ea9d1dd8626 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
I20260709 13:18:35.326110  7850 raft_consensus.cc:515] T 07a92dd554674067a83a9cb68c4773f2 P cd75a17ab2604397adab03bb8b5fd75c [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:35.342221  7897 raft_consensus.cc:2955] T 1528ab62b6fe4e3099d08f141afee116 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } attrs { replace: true } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } } }
I20260709 13:18:35.304255  7849 consensus_queue.cc:1059] T 9e326172347f45e99a0d482b5d8ef768 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.032s
I20260709 13:18:35.358827  7776 consensus_queue.cc:1059] T e31b9971c15848dea59d4d4130141d9e P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:18:35.327355  7911 raft_consensus.cc:3060] T 22ccee1b570c4ad3a57bd7aec085b1b4 P cd75a17ab2604397adab03bb8b5fd75c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:35.351681  7723 raft_consensus.cc:3060] T f3f9c2e2bf644115957398fe4c9459db P ccd8a4c3bfe3413cb2ae219b09aea832 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:35.357772  7892 raft_consensus.cc:2749] T d8292e16e5654be6bc408560cf256aaa P ccd8a4c3bfe3413cb2ae219b09aea832 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:18:35.369590  7892 consensus_queue.cc:1059] T 44bde925b2e541b69890d70715b85176 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:18:35.332222  7894 raft_consensus.cc:2749] T 8c7f33e544204fbaac4078e3e83bbf4e P ccd8a4c3bfe3413cb2ae219b09aea832 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:35.358078  7877 consensus_queue.cc:1059] T 3a485a995abc4807b6e511e45419f737 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.002s
I20260709 13:18:35.360505  7901 consensus_queue.cc:1059] T f09c2a98de1a4decabd0ff900dd44caa P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.003s
I20260709 13:18:35.366756  7908 raft_consensus.cc:515] T 4d9def8b32fd443aa94ab1420b06837b P cd75a17ab2604397adab03bb8b5fd75c [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:35.368672  7906 consensus_queue.cc:1059] T c4db81d9d329422bb3b4160ca4ac2d1d P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:18:35.372738  6806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a75bfe094d4bdc963aba3f08dfcd25" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:18:35.373131  6804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b3759de40694069b13c0f8bd40e5709" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:18:35.375216  6805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bf4668eeb70467fb3dc5a0289233b3c" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:18:35.376021  6879 raft_consensus.cc:1240] T 7887766dc6784fcaa42b35c05fea7a99 P cd75a17ab2604397adab03bb8b5fd75c [term 2 FOLLOWER]: Rejecting Update request from peer ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 1. Current term is 2. Ops: []
I20260709 13:18:35.375948  6799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3022224cc81473690653a83d4e99470" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:18:35.390661  6799 raft_consensus.cc:2468] T a3022224cc81473690653a83d4e99470 P b7ab4784c7344b939bc36f639286f377 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 1.
I20260709 13:18:35.379009  6803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e326172347f45e99a0d482b5d8ef768" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
W20260709 13:18:35.392309  6772 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 96683us
I20260709 13:18:35.373646  7882 consensus_queue.cc:1059] T 95a75bfe094d4bdc963aba3f08dfcd25 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.010s
I20260709 13:18:35.380491  6802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de3186201e1a40d0b335eeb8b4e256e0" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:18:35.393392  7821 raft_consensus.cc:3060] T ab432e62819d499eaaf3dd55481dd930 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:35.394034  6802 raft_consensus.cc:2468] T de3186201e1a40d0b335eeb8b4e256e0 P b7ab4784c7344b939bc36f639286f377 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 2.
I20260709 13:18:35.380740  6801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1704639a875409b9959353527b3fd68" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:18:35.396584  6801 raft_consensus.cc:2468] T a1704639a875409b9959353527b3fd68 P b7ab4784c7344b939bc36f639286f377 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 2.
I20260709 13:18:35.381398  6798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8292e16e5654be6bc408560cf256aaa" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:18:35.398098  6798 raft_consensus.cc:2468] T d8292e16e5654be6bc408560cf256aaa P b7ab4784c7344b939bc36f639286f377 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 2.
I20260709 13:18:35.381274  7841 raft_consensus.cc:515] T f03d0dbf16864ca4bc1bb5e4c0334c0f P cd75a17ab2604397adab03bb8b5fd75c [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:35.399880  6727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4275cf08e63345f993bce8664eada830" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:18:35.381968  6800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c240553ce044eedb41541d72b9475d7" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:18:35.402245  6800 raft_consensus.cc:2468] T 2c240553ce044eedb41541d72b9475d7 P b7ab4784c7344b939bc36f639286f377 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 2.
I20260709 13:18:35.372766  7902 raft_consensus.cc:3055] T 44bde925b2e541b69890d70715b85176 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:18:35.350658  7893 consensus_queue.cc:260] T 404190ce4ce94cecbfcb6ea9d1dd8626 P ccd8a4c3bfe3413cb2ae219b09aea832 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:18:35.393469  6772 leader_election.cc:304] T f3f9c2e2bf644115957398fe4c9459db P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:18:35.405248  6807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17587d6730594da4a56fa13a353232a1" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:18:35.406054  6807 raft_consensus.cc:2376] T 17587d6730594da4a56fa13a353232a1 P b7ab4784c7344b939bc36f639286f377 [term 3 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 3. Re-sending same reply.
I20260709 13:18:35.421566  6806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30e88460611e47b2ba16a46a30b5f416" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:18:35.423753  7914 raft_consensus.cc:3055] T bd6869f07b5a4885a0b99fbe60c3b175 P b7ab4784c7344b939bc36f639286f377 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:18:35.424211  7914 raft_consensus.cc:740] T bd6869f07b5a4885a0b99fbe60c3b175 P b7ab4784c7344b939bc36f639286f377 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
I20260709 13:18:35.425249  7914 consensus_queue.cc:260] T bd6869f07b5a4885a0b99fbe60c3b175 P b7ab4784c7344b939bc36f639286f377 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:35.424257  7894 raft_consensus.cc:3055] T c4db81d9d329422bb3b4160ca4ac2d1d P ccd8a4c3bfe3413cb2ae219b09aea832 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:18:35.432066  6805 raft_consensus.cc:2468] T 1bf4668eeb70467fb3dc5a0289233b3c P b7ab4784c7344b939bc36f639286f377 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 2.
I20260709 13:18:35.420914  6772 leader_election.cc:304] T b56bf91d90824c959e21e0cee5ba1816 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:18:35.431226  7894 raft_consensus.cc:740] T c4db81d9d329422bb3b4160ca4ac2d1d P ccd8a4c3bfe3413cb2ae219b09aea832 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
I20260709 13:18:35.410596  7902 raft_consensus.cc:740] T 44bde925b2e541b69890d70715b85176 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
I20260709 13:18:35.438854  7870 raft_consensus.cc:3055] T d8cee0accdb8499c86d4414b72565a38 P b7ab4784c7344b939bc36f639286f377 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:18:35.440747  7894 consensus_queue.cc:260] T c4db81d9d329422bb3b4160ca4ac2d1d P ccd8a4c3bfe3413cb2ae219b09aea832 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:35.442154  6772 leader_election.cc:304] T f09c2a98de1a4decabd0ff900dd44caa P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:18:35.441038  7872 raft_consensus.cc:2749] T b56bf91d90824c959e21e0cee5ba1816 P b7ab4784c7344b939bc36f639286f377 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:18:35.412966  7841 leader_election.cc:290] T f03d0dbf16864ca4bc1bb5e4c0334c0f P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 2 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:18:35.413863  7850 leader_election.cc:290] T 07a92dd554674067a83a9cb68c4773f2 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 2 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:18:35.419888  7868 raft_consensus.cc:2749] T f3f9c2e2bf644115957398fe4c9459db P b7ab4784c7344b939bc36f639286f377 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:18:35.459391  6772 leader_election.cc:304] T b3f13b31a1f84f0d89d007eadd57924c P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:18:35.460582  7883 raft_consensus.cc:2749] T f09c2a98de1a4decabd0ff900dd44caa P b7ab4784c7344b939bc36f639286f377 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:35.476948  7849 raft_consensus.cc:2749] T b3f13b31a1f84f0d89d007eadd57924c P b7ab4784c7344b939bc36f639286f377 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:35.479090  7908 leader_election.cc:290] T 4d9def8b32fd443aa94ab1420b06837b P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 2 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:18:35.480376  7887 leader_election.cc:290] T 7887766dc6784fcaa42b35c05fea7a99 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 2 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:18:35.409715  7898 raft_consensus.cc:515] T 44bde925b2e541b69890d70715b85176 P cd75a17ab2604397adab03bb8b5fd75c [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:35.445940  7870 raft_consensus.cc:740] T d8cee0accdb8499c86d4414b72565a38 P b7ab4784c7344b939bc36f639286f377 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
I20260709 13:18:35.481261  7832 raft_consensus.cc:515] T 713b5728a197487c9300b310ab94e5a3 P cd75a17ab2604397adab03bb8b5fd75c [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:35.482558  7898 leader_election.cc:290] T 44bde925b2e541b69890d70715b85176 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 2 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:18:35.483059  7894 raft_consensus.cc:3060] T c4db81d9d329422bb3b4160ca4ac2d1d P ccd8a4c3bfe3413cb2ae219b09aea832 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:35.431757  7888 leader_election.cc:290] T 24ee15416e3145beaa1b8183453729a3 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 2 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:18:35.488415  6873 raft_consensus.cc:1240] T 713b5728a197487c9300b310ab94e5a3 P cd75a17ab2604397adab03bb8b5fd75c [term 2 FOLLOWER]: Rejecting Update request from peer ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 1. Current term is 2. Ops: []
I20260709 13:18:35.488763  7858 raft_consensus.cc:3060] T d33d5ee8ef6f415593d8df52063161ad P b7ab4784c7344b939bc36f639286f377 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:35.498232  6806 raft_consensus.cc:2468] T 30e88460611e47b2ba16a46a30b5f416 P b7ab4784c7344b939bc36f639286f377 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 2.
I20260709 13:18:35.343737  7891 raft_consensus.cc:515] T 1528ab62b6fe4e3099d08f141afee116 P cd75a17ab2604397adab03bb8b5fd75c [term 2 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } attrs { replace: true } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:18:35.502605  6872 raft_consensus.cc:1240] T 1528ab62b6fe4e3099d08f141afee116 P cd75a17ab2604397adab03bb8b5fd75c [term 2 FOLLOWER]: Rejecting Update request from peer ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 1. Current term is 2. Ops: []
I20260709 13:18:35.502691  7896 raft_consensus.cc:3055] T be1a92657f494cac8dd227d152f50151 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:18:35.503232  7896 raft_consensus.cc:740] T be1a92657f494cac8dd227d152f50151 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
I20260709 13:18:35.507269  7896 consensus_queue.cc:260] T be1a92657f494cac8dd227d152f50151 P ccd8a4c3bfe3413cb2ae219b09aea832 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:18:35.508765  7896 raft_consensus.cc:3060] T be1a92657f494cac8dd227d152f50151 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:35.514295  6877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3022224cc81473690653a83d4e99470" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:18:35.518846  6880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c37d41cd9164c15a6826ca62a851a69" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:18:35.526923  6772 leader_election.cc:304] T 7c37d41cd9164c15a6826ca62a851a69 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:18:35.527500  6872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4275cf08e63345f993bce8664eada830" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:18:35.528208  6799 raft_consensus.cc:1275] T bb7fa124c3bf4ef9ab65a407cb008441 P b7ab4784c7344b939bc36f639286f377 [term 2 FOLLOWER]: Refusing update from remote peer 7ba59cc884714e8aa5f3f0ecaed84cbb: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:18:35.531703  7883 raft_consensus.cc:2749] T 7c37d41cd9164c15a6826ca62a851a69 P b7ab4784c7344b939bc36f639286f377 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:35.509969  7891 leader_election.cc:290] T 1528ab62b6fe4e3099d08f141afee116 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 2 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:18:35.525427  7851 raft_consensus.cc:515] T b56bf91d90824c959e21e0cee5ba1816 P cd75a17ab2604397adab03bb8b5fd75c [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:35.523144  7832 leader_election.cc:290] T 713b5728a197487c9300b310ab94e5a3 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 2 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:18:35.549743  7907 raft_consensus.cc:515] T 7a734b5ab7834e05a8c422208acc58b1 P cd75a17ab2604397adab03bb8b5fd75c [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:35.555012  6772 leader_election.cc:304] T 4275cf08e63345f993bce8664eada830 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:18:35.567333  6878 raft_consensus.cc:1240] T 7a734b5ab7834e05a8c422208acc58b1 P cd75a17ab2604397adab03bb8b5fd75c [term 2 FOLLOWER]: Rejecting Update request from peer ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 1. Current term is 2. Ops: []
I20260709 13:18:35.559149  7895 raft_consensus.cc:2749] T 4275cf08e63345f993bce8664eada830 P b7ab4784c7344b939bc36f639286f377 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:35.575606  6731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3022224cc81473690653a83d4e99470" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:18:35.576424  6731 raft_consensus.cc:2468] T a3022224cc81473690653a83d4e99470 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 1.
I20260709 13:18:35.578595  7885 raft_consensus.cc:3055] T e31b9971c15848dea59d4d4130141d9e P ccd8a4c3bfe3413cb2ae219b09aea832 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:18:35.578985  7885 raft_consensus.cc:740] T e31b9971c15848dea59d4d4130141d9e P ccd8a4c3bfe3413cb2ae219b09aea832 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
I20260709 13:18:35.579959  7885 consensus_queue.cc:260] T e31b9971c15848dea59d4d4130141d9e P ccd8a4c3bfe3413cb2ae219b09aea832 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:35.581137  7885 raft_consensus.cc:3060] T e31b9971c15848dea59d4d4130141d9e P ccd8a4c3bfe3413cb2ae219b09aea832 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:35.582633  6770 leader_election.cc:304] T a3022224cc81473690653a83d4e99470 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:18:35.586957  6873 raft_consensus.cc:1240] T bd6869f07b5a4885a0b99fbe60c3b175 P cd75a17ab2604397adab03bb8b5fd75c [term 3 FOLLOWER]: Rejecting Update request from peer b7ab4784c7344b939bc36f639286f377 for earlier term 2. Current term is 3. Ops: []
I20260709 13:18:35.587558  7895 raft_consensus.cc:2804] T a3022224cc81473690653a83d4e99470 P b7ab4784c7344b939bc36f639286f377 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:18:35.575277  7870 consensus_queue.cc:260] T d8cee0accdb8499c86d4414b72565a38 P b7ab4784c7344b939bc36f639286f377 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:18:35.589506  7870 raft_consensus.cc:3060] T d8cee0accdb8499c86d4414b72565a38 P b7ab4784c7344b939bc36f639286f377 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:35.587971  7895 raft_consensus.cc:493] T a3022224cc81473690653a83d4e99470 P b7ab4784c7344b939bc36f639286f377 [term 1 FOLLOWER]: Starting leader election (detected failure of leader cd75a17ab2604397adab03bb8b5fd75c)
I20260709 13:18:35.592473  7895 raft_consensus.cc:3060] T a3022224cc81473690653a83d4e99470 P b7ab4784c7344b939bc36f639286f377 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:35.593122  7914 raft_consensus.cc:3060] T bd6869f07b5a4885a0b99fbe60c3b175 P b7ab4784c7344b939bc36f639286f377 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:35.593763  7784 raft_consensus.cc:3055] T 3a485a995abc4807b6e511e45419f737 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:18:35.594209  7784 raft_consensus.cc:740] T 3a485a995abc4807b6e511e45419f737 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
I20260709 13:18:35.575212  7886 raft_consensus.cc:515] T 711ef6523deb4cbe8ef2ba61e1c21c98 P cd75a17ab2604397adab03bb8b5fd75c [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:35.601866  7723 raft_consensus.cc:3055] T f09c2a98de1a4decabd0ff900dd44caa P ccd8a4c3bfe3413cb2ae219b09aea832 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:18:35.595083  7784 consensus_queue.cc:260] T 3a485a995abc4807b6e511e45419f737 P ccd8a4c3bfe3413cb2ae219b09aea832 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:35.602253  7723 raft_consensus.cc:740] T f09c2a98de1a4decabd0ff900dd44caa P ccd8a4c3bfe3413cb2ae219b09aea832 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
I20260709 13:18:35.603039  7784 raft_consensus.cc:3060] T 3a485a995abc4807b6e511e45419f737 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:35.602958  7723 consensus_queue.cc:260] T f09c2a98de1a4decabd0ff900dd44caa P ccd8a4c3bfe3413cb2ae219b09aea832 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:35.604010  7723 raft_consensus.cc:3060] T f09c2a98de1a4decabd0ff900dd44caa P ccd8a4c3bfe3413cb2ae219b09aea832 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:35.570163  7851 leader_election.cc:290] T b56bf91d90824c959e21e0cee5ba1816 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 2 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:18:35.599555  6804 raft_consensus.cc:2468] T 9b3759de40694069b13c0f8bd40e5709 P b7ab4784c7344b939bc36f639286f377 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 2.
I20260709 13:18:35.608816  6806 raft_consensus.cc:1240] T f58dc08b12a2494bb9a1372837970ca2 P b7ab4784c7344b939bc36f639286f377 [term 2 FOLLOWER]: Rejecting Update request from peer ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 1. Current term is 2. Ops: []
W20260709 13:18:35.612279  6696 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:35.612450  7853 consensus_queue.cc:260] T 9e326172347f45e99a0d482b5d8ef768 P b7ab4784c7344b939bc36f639286f377 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
W20260709 13:18:35.617871  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 319641us
I20260709 13:18:35.614310  7869 raft_consensus.cc:3055] T 95a75bfe094d4bdc963aba3f08dfcd25 P b7ab4784c7344b939bc36f639286f377 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:18:35.621803  7869 raft_consensus.cc:740] T 95a75bfe094d4bdc963aba3f08dfcd25 P b7ab4784c7344b939bc36f639286f377 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
I20260709 13:18:35.622499  6628 catalog_manager.cc:5697] T bb7fa124c3bf4ef9ab65a407cb008441 P 7ba59cc884714e8aa5f3f0ecaed84cbb reported cstate change: term changed from 1 to 2, leader changed from b7ab4784c7344b939bc36f639286f377 (127.5.126.66) to 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68). New cstate: current_term: 2 leader_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:18:35.624858  7869 consensus_queue.cc:260] T 95a75bfe094d4bdc963aba3f08dfcd25 P b7ab4784c7344b939bc36f639286f377 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:35.608819  7907 leader_election.cc:290] T 7a734b5ab7834e05a8c422208acc58b1 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 2 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:18:35.635746  6731 raft_consensus.cc:1240] T 95a75bfe094d4bdc963aba3f08dfcd25 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 2 FOLLOWER]: Rejecting Update request from peer b7ab4784c7344b939bc36f639286f377 for earlier term 1. Current term is 2. Ops: []
I20260709 13:18:35.639765  7912 consensus_queue.cc:1048] T bb7fa124c3bf4ef9ab65a407cb008441 P 7ba59cc884714e8aa5f3f0ecaed84cbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.002s
I20260709 13:18:35.644203  6844 leader_election.cc:304] T f4b8bd455d5a47c18a1380839c6e0d61 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:18:35.645048  7907 raft_consensus.cc:2749] T f4b8bd455d5a47c18a1380839c6e0d61 P cd75a17ab2604397adab03bb8b5fd75c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:35.638463  7870 raft_consensus.cc:493] T be1a92657f494cac8dd227d152f50151 P b7ab4784c7344b939bc36f639286f377 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:18:35.638661  7893 raft_consensus.cc:3060] T 404190ce4ce94cecbfcb6ea9d1dd8626 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:35.636457  7886 leader_election.cc:290] T 711ef6523deb4cbe8ef2ba61e1c21c98 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 2 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
W20260709 13:18:35.648855  6696 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:35.655055  6697 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.68:45071, user_credentials={real_user=slave}} blocked reactor thread for 269029us
I20260709 13:18:35.662595  6695 leader_election.cc:304] T 95a75bfe094d4bdc963aba3f08dfcd25 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:18:35.666776  6844 leader_election.cc:304] T de3186201e1a40d0b335eeb8b4e256e0 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:18:35.638576  7895 raft_consensus.cc:515] T a3022224cc81473690653a83d4e99470 P b7ab4784c7344b939bc36f639286f377 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:35.672587  6878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb7fa124c3bf4ef9ab65a407cb008441" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:18:35.673276  6878 raft_consensus.cc:3060] T bb7fa124c3bf4ef9ab65a407cb008441 P cd75a17ab2604397adab03bb8b5fd75c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:35.682583  6695 leader_election.cc:304] T 9e326172347f45e99a0d482b5d8ef768 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:18:35.694823  6695 leader_election.cc:304] T a3022224cc81473690653a83d4e99470 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:18:35.695950  6695 leader_election.cc:304] T 1bf4668eeb70467fb3dc5a0289233b3c P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:18:35.711643  6876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3d8792045a4583ae2e965b1350a5b4" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
W20260709 13:18:35.715512  6698 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:35.716711  7776 raft_consensus.cc:2749] T 9e326172347f45e99a0d482b5d8ef768 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:18:35.719342  6695 leader_election.cc:304] T 30e88460611e47b2ba16a46a30b5f416 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:18:35.721470  7877 raft_consensus.cc:2804] T a3022224cc81473690653a83d4e99470 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:18:35.721926  7877 raft_consensus.cc:493] T a3022224cc81473690653a83d4e99470 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 1 FOLLOWER]: Starting leader election (detected failure of leader cd75a17ab2604397adab03bb8b5fd75c)
I20260709 13:18:35.722360  7877 raft_consensus.cc:3060] T a3022224cc81473690653a83d4e99470 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:35.722469  6731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c7f33e544204fbaac4078e3e83bbf4e" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:18:35.724684  6725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c44c4849aa54f2b94d1f1bef9ed546f" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:18:35.725441  6730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b3759de40694069b13c0f8bd40e5709" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:18:35.726310  6730 raft_consensus.cc:2393] T 9b3759de40694069b13c0f8bd40e5709 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c in current term 2: Already voted for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in this term.
I20260709 13:18:35.727577  6732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30e88460611e47b2ba16a46a30b5f416" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:18:35.728456  6732 raft_consensus.cc:2393] T 30e88460611e47b2ba16a46a30b5f416 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c in current term 2: Already voted for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in this term.
I20260709 13:18:35.729465  6724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bf4668eeb70467fb3dc5a0289233b3c" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:18:35.730307  6724 raft_consensus.cc:2393] T 1bf4668eeb70467fb3dc5a0289233b3c P ccd8a4c3bfe3413cb2ae219b09aea832 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c in current term 2: Already voted for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in this term.
I20260709 13:18:35.731246  6726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77e330a82df4b43a745d57a68f6f057" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:18:35.733373  6727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1704639a875409b9959353527b3fd68" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:18:35.734257  6727 raft_consensus.cc:2393] T a1704639a875409b9959353527b3fd68 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c in current term 2: Already voted for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in this term.
I20260709 13:18:35.736702  6802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bf4668eeb70467fb3dc5a0289233b3c" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:18:35.737231  6803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1704639a875409b9959353527b3fd68" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:18:35.738408  6806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30e88460611e47b2ba16a46a30b5f416" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:18:35.739235  6806 raft_consensus.cc:2393] T 30e88460611e47b2ba16a46a30b5f416 P b7ab4784c7344b939bc36f639286f377 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c in current term 2: Already voted for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in this term.
I20260709 13:18:35.737784  6802 raft_consensus.cc:2393] T 1bf4668eeb70467fb3dc5a0289233b3c P b7ab4784c7344b939bc36f639286f377 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c in current term 2: Already voted for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in this term.
I20260709 13:18:35.636201  7902 consensus_queue.cc:260] T 44bde925b2e541b69890d70715b85176 P ccd8a4c3bfe3413cb2ae219b09aea832 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:35.667536  7853 raft_consensus.cc:3060] T 9e326172347f45e99a0d482b5d8ef768 P b7ab4784c7344b939bc36f639286f377 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:35.740006  6806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a75bfe094d4bdc963aba3f08dfcd25" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:18:35.689677  7907 raft_consensus.cc:2804] T de3186201e1a40d0b335eeb8b4e256e0 P cd75a17ab2604397adab03bb8b5fd75c [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:18:35.740447  6800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b3759de40694069b13c0f8bd40e5709" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:18:35.745515  6800 raft_consensus.cc:2393] T 9b3759de40694069b13c0f8bd40e5709 P b7ab4784c7344b939bc36f639286f377 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c in current term 2: Already voted for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in this term.
I20260709 13:18:35.740772  6805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77e330a82df4b43a745d57a68f6f057" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:18:35.689919  7899 raft_consensus.cc:2749] T 95a75bfe094d4bdc963aba3f08dfcd25 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:18:35.657114  7870 raft_consensus.cc:515] T be1a92657f494cac8dd227d152f50151 P b7ab4784c7344b939bc36f639286f377 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:18:35.756534  7776 consensus_queue.cc:1059] T 1528ab62b6fe4e3099d08f141afee116 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } attrs { replace: true }, Status: INVALID_TERM, Last received: 1.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:18:35.757193  6729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a75bfe094d4bdc963aba3f08dfcd25" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:18:35.742010  7723 raft_consensus.cc:2804] T 1bf4668eeb70467fb3dc5a0289233b3c P ccd8a4c3bfe3413cb2ae219b09aea832 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:18:35.761412  7723 raft_consensus.cc:697] T 1bf4668eeb70467fb3dc5a0289233b3c P ccd8a4c3bfe3413cb2ae219b09aea832 [term 2 LEADER]: Becoming Leader. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
I20260709 13:18:35.767527  6728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab432e62819d499eaaf3dd55481dd930" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:18:35.770270  6878 raft_consensus.cc:2468] T bb7fa124c3bf4ef9ab65a407cb008441 P cd75a17ab2604397adab03bb8b5fd75c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in term 2.
I20260709 13:18:35.773706  6877 raft_consensus.cc:1275] T bb7fa124c3bf4ef9ab65a407cb008441 P cd75a17ab2604397adab03bb8b5fd75c [term 2 FOLLOWER]: Refusing update from remote peer 7ba59cc884714e8aa5f3f0ecaed84cbb: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:18:35.780614  6804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c7f33e544204fbaac4078e3e83bbf4e" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:18:35.781827  6804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbdf895bba214ff68685a24fd17dfb5d" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:18:35.782747  6804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f9c2e2bf644115957398fe4c9459db" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:18:35.752117  6726 raft_consensus.cc:2393] T e77e330a82df4b43a745d57a68f6f057 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c in current term 3: Already voted for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in this term.
I20260709 13:18:35.788800  6844 leader_election.cc:304] T 7c37d41cd9164c15a6826ca62a851a69 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:18:35.795460  7723 consensus_queue.cc:237] T 1bf4668eeb70467fb3dc5a0289233b3c P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:35.804371  6729 raft_consensus.cc:2393] T 95a75bfe094d4bdc963aba3f08dfcd25 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c in current term 2: Already voted for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in this term.
I20260709 13:18:35.799114  6804 raft_consensus.cc:2393] T f3f9c2e2bf644115957398fe4c9459db P b7ab4784c7344b939bc36f639286f377 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c in current term 2: Already voted for candidate b7ab4784c7344b939bc36f639286f377 in this term.
I20260709 13:18:35.741473  6873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8cee0accdb8499c86d4414b72565a38" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:18:35.823973  6804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e31b9971c15848dea59d4d4130141d9e" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:18:35.817091  6805 raft_consensus.cc:2468] T e77e330a82df4b43a745d57a68f6f057 P b7ab4784c7344b939bc36f639286f377 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 3.
I20260709 13:18:35.816428  6844 leader_election.cc:304] T d8292e16e5654be6bc408560cf256aaa P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:18:35.741699  7883 raft_consensus.cc:493] T ab432e62819d499eaaf3dd55481dd930 P b7ab4784c7344b939bc36f639286f377 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:18:35.819468  6802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab432e62819d499eaaf3dd55481dd930" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:18:35.743772  7907 raft_consensus.cc:493] T de3186201e1a40d0b335eeb8b4e256e0 P cd75a17ab2604397adab03bb8b5fd75c [term 1 FOLLOWER]: Starting leader election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:18:35.824556  6800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c44c4849aa54f2b94d1f1bef9ed546f" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:18:35.825515  6805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a485a995abc4807b6e511e45419f737" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:18:35.831738  6800 raft_consensus.cc:3060] T 7c44c4849aa54f2b94d1f1bef9ed546f P b7ab4784c7344b939bc36f639286f377 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:35.831868  6805 raft_consensus.cc:3060] T 3a485a995abc4807b6e511e45419f737 P b7ab4784c7344b939bc36f639286f377 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:35.789050  7499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24ee15416e3145beaa1b8183453729a3" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb"
I20260709 13:18:35.836453  6804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20f6842e26174571996b8dea4151d4be" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
W20260709 13:18:35.843094  6695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 123838us
I20260709 13:18:35.818114  7899 raft_consensus.cc:2804] T 30e88460611e47b2ba16a46a30b5f416 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:18:35.828184  6727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f9c2e2bf644115957398fe4c9459db" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:18:35.833598  7907 raft_consensus.cc:3060] T de3186201e1a40d0b335eeb8b4e256e0 P cd75a17ab2604397adab03bb8b5fd75c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:35.819660  7900 raft_consensus.cc:493] T 404190ce4ce94cecbfcb6ea9d1dd8626 P b7ab4784c7344b939bc36f639286f377 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:18:35.876709  6881 raft_consensus.cc:1240] T dbdf895bba214ff68685a24fd17dfb5d P cd75a17ab2604397adab03bb8b5fd75c [term 2 FOLLOWER]: Rejecting Update request from peer ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 1. Current term is 2. Ops: []
I20260709 13:18:35.842940  6730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09c2a98de1a4decabd0ff900dd44caa" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:18:35.831086  7890 consensus_queue.cc:1059] T 7887766dc6784fcaa42b35c05fea7a99 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.061s
I20260709 13:18:35.914951  6803 raft_consensus.cc:2468] T a1704639a875409b9959353527b3fd68 P b7ab4784c7344b939bc36f639286f377 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 2.
W20260709 13:18:35.862668  6773 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:35.886004  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 69810.9us
I20260709 13:18:35.921468  6844 leader_election.cc:304] T f58dc08b12a2494bb9a1372837970ca2 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:18:35.923333  6844 leader_election.cc:304] T 853ac0a8cbd64ce99457f170216d4d0f P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:18:35.924342  7869 raft_consensus.cc:3060] T 95a75bfe094d4bdc963aba3f08dfcd25 P b7ab4784c7344b939bc36f639286f377 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:35.924525  7891 raft_consensus.cc:2749] T f58dc08b12a2494bb9a1372837970ca2 P cd75a17ab2604397adab03bb8b5fd75c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:35.925617  7891 raft_consensus.cc:2749] T 853ac0a8cbd64ce99457f170216d4d0f P cd75a17ab2604397adab03bb8b5fd75c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:35.928941  6731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a485a995abc4807b6e511e45419f737" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:18:35.874826  6804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4db81d9d329422bb3b4160ca4ac2d1d" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:18:35.898283  6880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fa34c08b205435dba97346991aa1f92" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:18:35.898936  6875 raft_consensus.cc:1240] T 24ee15416e3145beaa1b8183453729a3 P cd75a17ab2604397adab03bb8b5fd75c [term 2 FOLLOWER]: Rejecting Update request from peer ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 1. Current term is 2. Ops: []
I20260709 13:18:35.899150  6872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b8cacb381b746da8d0049b0a83b41dd" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:18:35.883584  6805 raft_consensus.cc:2468] T 3a485a995abc4807b6e511e45419f737 P b7ab4784c7344b939bc36f639286f377 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 2.
I20260709 13:18:35.902819  6879 raft_consensus.cc:1240] T f03d0dbf16864ca4bc1bb5e4c0334c0f P cd75a17ab2604397adab03bb8b5fd75c [term 2 FOLLOWER]: Rejecting Update request from peer ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 1. Current term is 2. Ops: []
I20260709 13:18:35.915155  6807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09c2a98de1a4decabd0ff900dd44caa" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:18:35.915628  7501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1528ab62b6fe4e3099d08f141afee116" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb"
I20260709 13:18:35.916978  6725 raft_consensus.cc:2468] T 7c44c4849aa54f2b94d1f1bef9ed546f P ccd8a4c3bfe3413cb2ae219b09aea832 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 2.
I20260709 13:18:35.917467  6726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e31b9971c15848dea59d4d4130141d9e" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:18:35.920188  6724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20f6842e26174571996b8dea4151d4be" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:18:35.954599  6729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4db81d9d329422bb3b4160ca4ac2d1d" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:18:35.888208  7922 raft_consensus.cc:2749] T d8292e16e5654be6bc408560cf256aaa P cd75a17ab2604397adab03bb8b5fd75c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:35.877213  7857 consensus_queue.cc:1059] T 713b5728a197487c9300b310ab94e5a3 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.060s
I20260709 13:18:35.941447  6880 raft_consensus.cc:2393] T 3fa34c08b205435dba97346991aa1f92 P cd75a17ab2604397adab03bb8b5fd75c [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in current term 2: Already voted for candidate cd75a17ab2604397adab03bb8b5fd75c in this term.
I20260709 13:18:35.833779  7883 raft_consensus.cc:515] T ab432e62819d499eaaf3dd55481dd930 P b7ab4784c7344b939bc36f639286f377 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:35.924363  6844 leader_election.cc:304] T 2c240553ce044eedb41541d72b9475d7 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:18:35.816826  7832 raft_consensus.cc:2749] T 7c37d41cd9164c15a6826ca62a851a69 P cd75a17ab2604397adab03bb8b5fd75c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:35.975324  7922 raft_consensus.cc:2749] T 2c240553ce044eedb41541d72b9475d7 P cd75a17ab2604397adab03bb8b5fd75c [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:18:35.978448  6799 raft_consensus.cc:1240] T 7ba5dac66ab5497e9e336f2a3c28cda5 P b7ab4784c7344b939bc36f639286f377 [term 2 FOLLOWER]: Rejecting Update request from peer cd75a17ab2604397adab03bb8b5fd75c for earlier term 1. Current term is 2. Ops: []
I20260709 13:18:35.904309  7899 raft_consensus.cc:697] T 30e88460611e47b2ba16a46a30b5f416 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 2 LEADER]: Becoming Leader. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
I20260709 13:18:35.961524  6732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbdf895bba214ff68685a24fd17dfb5d" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
W20260709 13:18:35.984549  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 60238.7us
I20260709 13:18:35.995888  6844 leader_election.cc:304] T 34f36d59d88f40fe8a2805e604fc6c0a P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:18:35.997401  6844 leader_election.cc:304] T 3fa34c08b205435dba97346991aa1f92 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:18:35.985517  6800 raft_consensus.cc:2468] T 7c44c4849aa54f2b94d1f1bef9ed546f P b7ab4784c7344b939bc36f639286f377 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 2.
I20260709 13:18:35.945879  7868 raft_consensus.cc:493] T 3a485a995abc4807b6e511e45419f737 P b7ab4784c7344b939bc36f639286f377 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:36.006198  6844 leader_election.cc:304] T 9e326172347f45e99a0d482b5d8ef768 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:18:36.010082  6802 raft_consensus.cc:3060] T ab432e62819d499eaaf3dd55481dd930 P b7ab4784c7344b939bc36f639286f377 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:36.010725  6844 leader_election.cc:304] T ce4f062dcd314d43a63ca74067cb5ee3 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:18:35.904794  7900 raft_consensus.cc:515] T 404190ce4ce94cecbfcb6ea9d1dd8626 P b7ab4784c7344b939bc36f639286f377 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:18:35.979738  7902 raft_consensus.cc:3060] T 44bde925b2e541b69890d70715b85176 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:18:36.007372  7821 consensus_meta.cc:287] T ab432e62819d499eaaf3dd55481dd930 P ccd8a4c3bfe3413cb2ae219b09aea832: Time spent flushing consensus metadata: real 0.613s	user 0.011s	sys 0.001s
I20260709 13:18:36.024950  6800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24ee15416e3145beaa1b8183453729a3" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
W20260709 13:18:36.032790  6697 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 277004us
I20260709 13:18:36.012491  7920 raft_consensus.cc:2749] T 3fa34c08b205435dba97346991aa1f92 P cd75a17ab2604397adab03bb8b5fd75c [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:18:36.009593  7887 raft_consensus.cc:2749] T 34f36d59d88f40fe8a2805e604fc6c0a P cd75a17ab2604397adab03bb8b5fd75c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:36.011754  7832 raft_consensus.cc:2749] T 9e326172347f45e99a0d482b5d8ef768 P cd75a17ab2604397adab03bb8b5fd75c [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:18:36.011987  6844 leader_election.cc:304] T 90d42e216d9741e190bca19a781291fd P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:18:36.054728  6844 leader_election.cc:304] T bd6869f07b5a4885a0b99fbe60c3b175 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:18:36.052675  6880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3022224cc81473690653a83d4e99470" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:18:36.018855  7917 raft_consensus.cc:2749] T ce4f062dcd314d43a63ca74067cb5ee3 P cd75a17ab2604397adab03bb8b5fd75c [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:18:36.032510  6725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a92dd554674067a83a9cb68c4773f2" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:18:36.058471  7891 raft_consensus.cc:2749] T 90d42e216d9741e190bca19a781291fd P cd75a17ab2604397adab03bb8b5fd75c [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:18:36.015846  7868 raft_consensus.cc:515] T 3a485a995abc4807b6e511e45419f737 P b7ab4784c7344b939bc36f639286f377 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:36.079246  6877 raft_consensus.cc:1240] T b56bf91d90824c959e21e0cee5ba1816 P cd75a17ab2604397adab03bb8b5fd75c [term 2 FOLLOWER]: Rejecting Update request from peer ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 1. Current term is 2. Ops: []
I20260709 13:18:36.076416  6875 raft_consensus.cc:1240] T 07a92dd554674067a83a9cb68c4773f2 P cd75a17ab2604397adab03bb8b5fd75c [term 2 FOLLOWER]: Rejecting Update request from peer ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 1. Current term is 2. Ops: []
I20260709 13:18:36.075455  6802 raft_consensus.cc:2468] T ab432e62819d499eaaf3dd55481dd930 P b7ab4784c7344b939bc36f639286f377 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 2.
I20260709 13:18:36.077135  6880 raft_consensus.cc:1240] T 711ef6523deb4cbe8ef2ba61e1c21c98 P cd75a17ab2604397adab03bb8b5fd75c [term 2 FOLLOWER]: Rejecting Update request from peer ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 1. Current term is 2. Ops: []
W20260709 13:18:36.073930  6695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 167567us
I20260709 13:18:36.088603  6872 raft_consensus.cc:1240] T 4d9def8b32fd443aa94ab1420b06837b P cd75a17ab2604397adab03bb8b5fd75c [term 2 FOLLOWER]: Rejecting Update request from peer ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 1. Current term is 2. Ops: []
I20260709 13:18:36.072769  6803 raft_consensus.cc:1240] T a3022224cc81473690653a83d4e99470 P b7ab4784c7344b939bc36f639286f377 [term 2 FOLLOWER]: Rejecting Update request from peer cd75a17ab2604397adab03bb8b5fd75c for earlier term 1. Current term is 2. Ops: []
I20260709 13:18:36.088752  7501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be1a92657f494cac8dd227d152f50151" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:18:36.096738  7501 raft_consensus.cc:2393] T be1a92657f494cac8dd227d152f50151 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7ab4784c7344b939bc36f639286f377 in current term 2: Already voted for candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in this term.
I20260709 13:18:36.089888  6873 raft_consensus.cc:1240] T 1528ab62b6fe4e3099d08f141afee116 P cd75a17ab2604397adab03bb8b5fd75c [term 2 FOLLOWER]: Rejecting Update request from peer ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 1. Current term is 2. Ops: []
I20260709 13:18:36.100436  6800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f03d0dbf16864ca4bc1bb5e4c0334c0f" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
W20260709 13:18:36.102344  7926 log.cc:927] Time spent T bb7fa124c3bf4ef9ab65a407cb008441 P b7ab4784c7344b939bc36f639286f377: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
W20260709 13:18:36.104750  7924 log.cc:927] Time spent T 24ee15416e3145beaa1b8183453729a3 P b7ab4784c7344b939bc36f639286f377: Append to log took a long time: real 0.085s	user 0.000s	sys 0.000s
I20260709 13:18:36.108125  6806 raft_consensus.cc:2468] T 95a75bfe094d4bdc963aba3f08dfcd25 P b7ab4784c7344b939bc36f639286f377 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 2.
W20260709 13:18:36.118036  7885 consensus_meta.cc:287] T e31b9971c15848dea59d4d4130141d9e P ccd8a4c3bfe3413cb2ae219b09aea832: Time spent flushing consensus metadata: real 0.536s	user 0.007s	sys 0.004s
I20260709 13:18:36.094131  6724 raft_consensus.cc:2468] T 20f6842e26174571996b8dea4151d4be P ccd8a4c3bfe3413cb2ae219b09aea832 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 2.
I20260709 13:18:36.094610  6728 raft_consensus.cc:2468] T ab432e62819d499eaaf3dd55481dd930 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 2.
W20260709 13:18:36.095664  7911 consensus_meta.cc:287] T 22ccee1b570c4ad3a57bd7aec085b1b4 P cd75a17ab2604397adab03bb8b5fd75c: Time spent flushing consensus metadata: real 0.710s	user 0.005s	sys 0.005s
W20260709 13:18:36.120312  7921 log.cc:927] Time spent T 24ee15416e3145beaa1b8183453729a3 P 7ba59cc884714e8aa5f3f0ecaed84cbb: Append to log took a long time: real 0.105s	user 0.001s	sys 0.000s
I20260709 13:18:36.092372  6799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a92dd554674067a83a9cb68c4773f2" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:18:36.049554  7895 leader_election.cc:290] T a3022224cc81473690653a83d4e99470 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 2 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:18:36.062988  7894 consensus_queue.cc:1059] T 24ee15416e3145beaa1b8183453729a3 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: INVALID_TERM, Last received: 1.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.059s
I20260709 13:18:36.051731  7877 raft_consensus.cc:515] T a3022224cc81473690653a83d4e99470 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:36.068557  7920 raft_consensus.cc:2749] T bd6869f07b5a4885a0b99fbe60c3b175 P cd75a17ab2604397adab03bb8b5fd75c [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:18:36.126019  7816 raft_consensus.cc:3055] T 7887766dc6784fcaa42b35c05fea7a99 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:18:36.126984  7901 raft_consensus.cc:3055] T 713b5728a197487c9300b310ab94e5a3 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:18:36.130411  6695 leader_election.cc:304] T 9b3759de40694069b13c0f8bd40e5709 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:18:36.086010  7870 leader_election.cc:290] T be1a92657f494cac8dd227d152f50151 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:18:36.085440  7896 consensus_queue.cc:1059] T f03d0dbf16864ca4bc1bb5e4c0334c0f P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.048s
I20260709 13:18:36.134363  7501 raft_consensus.cc:1240] T bb3d8792045a4583ae2e965b1350a5b4 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 2 FOLLOWER]: Rejecting Update request from peer ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 1. Current term is 2. Ops: []
I20260709 13:18:36.041004  7890 consensus_queue.cc:1059] T 7a734b5ab7834e05a8c422208acc58b1 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.046s
I20260709 13:18:36.151669  7816 raft_consensus.cc:740] T 7887766dc6784fcaa42b35c05fea7a99 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
I20260709 13:18:36.148882  7897 raft_consensus.cc:3055] T 1528ab62b6fe4e3099d08f141afee116 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:18:36.166189  6723 raft_consensus.cc:1240] T a3022224cc81473690653a83d4e99470 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 2 FOLLOWER]: Rejecting Update request from peer cd75a17ab2604397adab03bb8b5fd75c for earlier term 1. Current term is 2. Ops: []
I20260709 13:18:36.059790  7821 consensus_queue.cc:1059] T dbdf895bba214ff68685a24fd17dfb5d P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.088s
I20260709 13:18:36.143584  6732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f03d0dbf16864ca4bc1bb5e4c0334c0f" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:18:36.172816  6802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d9def8b32fd443aa94ab1420b06837b" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:18:36.156289  7901 raft_consensus.cc:740] T 713b5728a197487c9300b310ab94e5a3 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
W20260709 13:18:36.181043  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 126417us
I20260709 13:18:36.186018  6844 leader_election.cc:304] T d33d5ee8ef6f415593d8df52063161ad P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:18:36.157956  7906 raft_consensus.cc:3055] T 24ee15416e3145beaa1b8183453729a3 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:18:36.190043  6729 raft_consensus.cc:2468] T c4db81d9d329422bb3b4160ca4ac2d1d P ccd8a4c3bfe3413cb2ae219b09aea832 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 2.
I20260709 13:18:36.148998  7911 raft_consensus.cc:515] T 22ccee1b570c4ad3a57bd7aec085b1b4 P cd75a17ab2604397adab03bb8b5fd75c [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
W20260709 13:18:36.186681  7468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 85297us
I20260709 13:18:36.165881  7897 raft_consensus.cc:740] T 1528ab62b6fe4e3099d08f141afee116 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
I20260709 13:18:36.156304  7835 consensus_queue.cc:1059] T f58dc08b12a2494bb9a1372837970ca2 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.029s
I20260709 13:18:36.195653  6729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44bde925b2e541b69890d70715b85176" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:18:36.185557  6724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7887766dc6784fcaa42b35c05fea7a99" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:18:36.203169  6874 raft_consensus.cc:1240] T 22ccee1b570c4ad3a57bd7aec085b1b4 P cd75a17ab2604397adab03bb8b5fd75c [term 2 FOLLOWER]: Rejecting Update request from peer ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 1. Current term is 2. Ops: []
I20260709 13:18:36.204520  7723 raft_consensus.cc:3055] T f03d0dbf16864ca4bc1bb5e4c0334c0f P ccd8a4c3bfe3413cb2ae219b09aea832 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:18:36.204923  7723 raft_consensus.cc:740] T f03d0dbf16864ca4bc1bb5e4c0334c0f P ccd8a4c3bfe3413cb2ae219b09aea832 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
I20260709 13:18:36.206718  6873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab432e62819d499eaaf3dd55481dd930" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:18:36.207399  6732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1528ab62b6fe4e3099d08f141afee116" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:18:36.208315  7821 raft_consensus.cc:3055] T dbdf895bba214ff68685a24fd17dfb5d P ccd8a4c3bfe3413cb2ae219b09aea832 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:18:36.208701  7821 raft_consensus.cc:740] T dbdf895bba214ff68685a24fd17dfb5d P ccd8a4c3bfe3413cb2ae219b09aea832 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
I20260709 13:18:36.209725  7894 consensus_queue.cc:1059] T b56bf91d90824c959e21e0cee5ba1816 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:18:36.210383  6730 raft_consensus.cc:2468] T f09c2a98de1a4decabd0ff900dd44caa P ccd8a4c3bfe3413cb2ae219b09aea832 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 2.
I20260709 13:18:36.210602  7932 consensus_queue.cc:1059] T 711ef6523deb4cbe8ef2ba61e1c21c98 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:18:36.211678  7932 raft_consensus.cc:3055] T b56bf91d90824c959e21e0cee5ba1816 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:18:36.209527  7776 consensus_queue.cc:1059] T 07a92dd554674067a83a9cb68c4773f2 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.003s
I20260709 13:18:36.200434  7870 raft_consensus.cc:493] T 3411566abe2d4c9bb4b2adfdd05e6f17 P b7ab4784c7344b939bc36f639286f377 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:18:36.212756  7933 raft_consensus.cc:3055] T 711ef6523deb4cbe8ef2ba61e1c21c98 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:18:36.213057  7776 raft_consensus.cc:3055] T 07a92dd554674067a83a9cb68c4773f2 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:18:36.213582  7776 raft_consensus.cc:740] T 07a92dd554674067a83a9cb68c4773f2 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
I20260709 13:18:36.214296  7776 consensus_queue.cc:260] T 07a92dd554674067a83a9cb68c4773f2 P ccd8a4c3bfe3413cb2ae219b09aea832 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:36.215543  7776 raft_consensus.cc:3060] T 07a92dd554674067a83a9cb68c4773f2 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:36.215691  7911 leader_election.cc:290] T 22ccee1b570c4ad3a57bd7aec085b1b4 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 2 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
W20260709 13:18:36.211591  6695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 81262.7us
I20260709 13:18:36.192863  7917 raft_consensus.cc:2749] T d33d5ee8ef6f415593d8df52063161ad P cd75a17ab2604397adab03bb8b5fd75c [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:18:36.193178  7906 raft_consensus.cc:740] T 24ee15416e3145beaa1b8183453729a3 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
I20260709 13:18:36.211834  7930 raft_consensus.cc:2804] T 9b3759de40694069b13c0f8bd40e5709 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:18:36.217947  7877 leader_election.cc:290] T a3022224cc81473690653a83d4e99470 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 2 election: Requested vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:18:36.203833  7816 consensus_queue.cc:260] T 7887766dc6784fcaa42b35c05fea7a99 P ccd8a4c3bfe3413cb2ae219b09aea832 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:36.188025  6727 raft_consensus.cc:2468] T f3f9c2e2bf644115957398fe4c9459db P ccd8a4c3bfe3413cb2ae219b09aea832 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 2.
I20260709 13:18:36.211562  6730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a734b5ab7834e05a8c422208acc58b1" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:18:36.210747  7894 consensus_queue.cc:1059] T 4d9def8b32fd443aa94ab1420b06837b P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:18:36.212256  7932 raft_consensus.cc:740] T b56bf91d90824c959e21e0cee5ba1816 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
I20260709 13:18:36.209492  7821 consensus_queue.cc:260] T dbdf895bba214ff68685a24fd17dfb5d P ccd8a4c3bfe3413cb2ae219b09aea832 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:36.218386  7906 consensus_queue.cc:260] T 24ee15416e3145beaa1b8183453729a3 P ccd8a4c3bfe3413cb2ae219b09aea832 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.3, Last appended by leader: 3, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } attrs { replace: true } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:18:36.212944  7870 raft_consensus.cc:515] T 3411566abe2d4c9bb4b2adfdd05e6f17 P b7ab4784c7344b939bc36f639286f377 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:36.225832  7900 leader_election.cc:290] T 404190ce4ce94cecbfcb6ea9d1dd8626 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:18:36.225935  7877 raft_consensus.cc:3055] T f58dc08b12a2494bb9a1372837970ca2 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:18:36.220839  7933 raft_consensus.cc:740] T 711ef6523deb4cbe8ef2ba61e1c21c98 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
I20260709 13:18:36.261628  6803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "711ef6523deb4cbe8ef2ba61e1c21c98" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:18:36.204315  7883 leader_election.cc:290] T ab432e62819d499eaaf3dd55481dd930 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
W20260709 13:18:36.227658  7914 consensus_meta.cc:287] T bd6869f07b5a4885a0b99fbe60c3b175 P b7ab4784c7344b939bc36f639286f377: Time spent flushing consensus metadata: real 0.634s	user 0.009s	sys 0.003s
I20260709 13:18:36.152719  7899 consensus_queue.cc:237] T 30e88460611e47b2ba16a46a30b5f416 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:36.229736  7502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "404190ce4ce94cecbfcb6ea9d1dd8626" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:18:36.230422  7853 raft_consensus.cc:493] T 17587d6730594da4a56fa13a353232a1 P b7ab4784c7344b939bc36f639286f377 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:36.231243  6726 raft_consensus.cc:2468] T e31b9971c15848dea59d4d4130141d9e P ccd8a4c3bfe3413cb2ae219b09aea832 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 2.
I20260709 13:18:36.177024  7907 raft_consensus.cc:515] T de3186201e1a40d0b335eeb8b4e256e0 P cd75a17ab2604397adab03bb8b5fd75c [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:36.245098  7930 raft_consensus.cc:697] T 9b3759de40694069b13c0f8bd40e5709 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 2 LEADER]: Becoming Leader. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
I20260709 13:18:36.249122  6728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b56bf91d90824c959e21e0cee5ba1816" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
W20260709 13:18:36.231987  7784 consensus_meta.cc:287] T 3a485a995abc4807b6e511e45419f737 P ccd8a4c3bfe3413cb2ae219b09aea832: Time spent flushing consensus metadata: real 0.629s	user 0.010s	sys 0.004s
I20260709 13:18:36.253587  6723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "711ef6523deb4cbe8ef2ba61e1c21c98" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:18:36.280562  6727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "713b5728a197487c9300b310ab94e5a3" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:18:36.257679  6802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7887766dc6784fcaa42b35c05fea7a99" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:18:36.259318  7821 raft_consensus.cc:3060] T dbdf895bba214ff68685a24fd17dfb5d P ccd8a4c3bfe3413cb2ae219b09aea832 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:18:36.259907  7893 consensus_meta.cc:287] T 404190ce4ce94cecbfcb6ea9d1dd8626 P ccd8a4c3bfe3413cb2ae219b09aea832: Time spent flushing consensus metadata: real 0.602s	user 0.009s	sys 0.002s
I20260709 13:18:36.260771  6801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "713b5728a197487c9300b310ab94e5a3" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:18:36.293238  7932 consensus_queue.cc:260] T b56bf91d90824c959e21e0cee5ba1816 P ccd8a4c3bfe3413cb2ae219b09aea832 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:36.307745  7932 raft_consensus.cc:3060] T b56bf91d90824c959e21e0cee5ba1816 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:36.261297  7870 leader_election.cc:290] T 3411566abe2d4c9bb4b2adfdd05e6f17 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
W20260709 13:18:36.256585  6697 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 47566.9us
I20260709 13:18:36.257822  7877 raft_consensus.cc:740] T f58dc08b12a2494bb9a1372837970ca2 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
I20260709 13:18:36.264456  6806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44bde925b2e541b69890d70715b85176" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:18:36.311818  6806 raft_consensus.cc:2393] T 44bde925b2e541b69890d70715b85176 P b7ab4784c7344b939bc36f639286f377 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c in current term 2: Already voted for candidate b7ab4784c7344b939bc36f639286f377 in this term.
I20260709 13:18:36.270107  6800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a734b5ab7834e05a8c422208acc58b1" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:18:36.311962  7877 consensus_queue.cc:260] T f58dc08b12a2494bb9a1372837970ca2 P ccd8a4c3bfe3413cb2ae219b09aea832 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:36.270694  6799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1528ab62b6fe4e3099d08f141afee116" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:18:36.291550  7853 raft_consensus.cc:515] T 17587d6730594da4a56fa13a353232a1 P b7ab4784c7344b939bc36f639286f377 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:18:36.270745  7888 raft_consensus.cc:1064] T 427c124d773f483294511e80fe340075 P cd75a17ab2604397adab03bb8b5fd75c: attempting to promote NON_VOTER 7ba59cc884714e8aa5f3f0ecaed84cbb to VOTER
I20260709 13:18:36.313899  7877 raft_consensus.cc:3060] T f58dc08b12a2494bb9a1372837970ca2 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:36.265027  7901 consensus_queue.cc:260] T 713b5728a197487c9300b310ab94e5a3 P ccd8a4c3bfe3413cb2ae219b09aea832 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:36.315582  7853 leader_election.cc:290] T 17587d6730594da4a56fa13a353232a1 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
W20260709 13:18:36.272424  6695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 55023.2us
W20260709 13:18:36.321844  6695 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:36.258528  6844 leader_election.cc:304] T 7c44c4849aa54f2b94d1f1bef9ed546f P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
W20260709 13:18:36.322898  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 64483.4us
I20260709 13:18:36.324193  6844 leader_election.cc:304] T 20f6842e26174571996b8dea4151d4be P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:18:36.265316  7816 raft_consensus.cc:3060] T 7887766dc6784fcaa42b35c05fea7a99 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:36.288874  7502 raft_consensus.cc:2393] T 404190ce4ce94cecbfcb6ea9d1dd8626 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7ab4784c7344b939bc36f639286f377 in current term 2: Already voted for candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in this term.
I20260709 13:18:36.271508  6798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b56bf91d90824c959e21e0cee5ba1816" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:18:36.290011  7468 leader_election.cc:304] T bb3d8792045a4583ae2e965b1350a5b4 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:18:36.296248  6725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24ee15416e3145beaa1b8183453729a3" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:18:36.286706  7941 raft_consensus.cc:3055] T 4d9def8b32fd443aa94ab1420b06837b P ccd8a4c3bfe3413cb2ae219b09aea832 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:18:36.297725  7930 consensus_queue.cc:237] T 9b3759de40694069b13c0f8bd40e5709 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:36.300180  6730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d9def8b32fd443aa94ab1420b06837b" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:18:36.301856  7907 leader_election.cc:290] T de3186201e1a40d0b335eeb8b4e256e0 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 2 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:18:36.263805  6805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22ccee1b570c4ad3a57bd7aec085b1b4" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:18:36.264359  7897 consensus_queue.cc:260] T 1528ab62b6fe4e3099d08f141afee116 P ccd8a4c3bfe3413cb2ae219b09aea832 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 3, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } attrs { replace: true } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:18:36.269114  6729 raft_consensus.cc:2468] T 44bde925b2e541b69890d70715b85176 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 2.
I20260709 13:18:36.270876  6874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3411566abe2d4c9bb4b2adfdd05e6f17" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:18:36.332996  6804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3022224cc81473690653a83d4e99470" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:18:36.335381  6800 raft_consensus.cc:1240] T b56bf91d90824c959e21e0cee5ba1816 P b7ab4784c7344b939bc36f639286f377 [term 2 FOLLOWER]: Rejecting Update request from peer ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 1. Current term is 2. Ops: []
W20260709 13:18:36.337867  6695 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:36.338608  6844 leader_election.cc:304] T c4db81d9d329422bb3b4160ca4ac2d1d P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:18:36.317028  7888 consensus_queue.cc:237] T 427c124d773f483294511e80fe340075 P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } attrs { replace: true } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:18:36.340350  7920 raft_consensus.cc:2804] T 20f6842e26174571996b8dea4151d4be P cd75a17ab2604397adab03bb8b5fd75c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:18:36.351349  7502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17587d6730594da4a56fa13a353232a1" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:18:36.352670  6804 raft_consensus.cc:2393] T a3022224cc81473690653a83d4e99470 P b7ab4784c7344b939bc36f639286f377 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate ccd8a4c3bfe3413cb2ae219b09aea832 in current term 2: Already voted for candidate b7ab4784c7344b939bc36f639286f377 in this term.
I20260709 13:18:36.353869  6844 leader_election.cc:304] T f09c2a98de1a4decabd0ff900dd44caa P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:18:36.267675  7933 consensus_queue.cc:260] T 711ef6523deb4cbe8ef2ba61e1c21c98 P ccd8a4c3bfe3413cb2ae219b09aea832 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:36.343446  7853 raft_consensus.cc:493] T ce4f062dcd314d43a63ca74067cb5ee3 P b7ab4784c7344b939bc36f639286f377 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:36.340499  7917 raft_consensus.cc:2804] T 7c44c4849aa54f2b94d1f1bef9ed546f P cd75a17ab2604397adab03bb8b5fd75c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:18:36.389313  7502 raft_consensus.cc:2468] T 17587d6730594da4a56fa13a353232a1 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 3.
I20260709 13:18:36.351246  7936 raft_consensus.cc:2749] T bb3d8792045a4583ae2e965b1350a5b4 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:18:36.348367  7941 raft_consensus.cc:740] T 4d9def8b32fd443aa94ab1420b06837b P ccd8a4c3bfe3413cb2ae219b09aea832 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
I20260709 13:18:36.403537  6844 leader_election.cc:304] T ab432e62819d499eaaf3dd55481dd930 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:18:36.403517  6772 leader_election.cc:304] T 17587d6730594da4a56fa13a353232a1 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, b7ab4784c7344b939bc36f639286f377; no voters: 
I20260709 13:18:36.345713  7784 consensus_queue.cc:1059] T 22ccee1b570c4ad3a57bd7aec085b1b4 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.054s
I20260709 13:18:36.389129  7851 raft_consensus.cc:2804] T c4db81d9d329422bb3b4160ca4ac2d1d P cd75a17ab2604397adab03bb8b5fd75c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:18:36.444798  6844 leader_election.cc:304] T f3f9c2e2bf644115957398fe4c9459db P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:18:36.451552  7887 raft_consensus.cc:2804] T f3f9c2e2bf644115957398fe4c9459db P cd75a17ab2604397adab03bb8b5fd75c [term 2 FOLLOWER]: Leader election won for term 2
W20260709 13:18:36.396157  7468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 119969us
I20260709 13:18:36.402623  7922 raft_consensus.cc:2804] T f09c2a98de1a4decabd0ff900dd44caa P cd75a17ab2604397adab03bb8b5fd75c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:18:36.397082  7934 raft_consensus.cc:493] T 4b8cacb381b746da8d0049b0a83b41dd P cd75a17ab2604397adab03bb8b5fd75c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:18:36.448750  7933 raft_consensus.cc:3060] T 711ef6523deb4cbe8ef2ba61e1c21c98 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:36.443648  7911 consensus_queue.cc:1059] T a3022224cc81473690653a83d4e99470 P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.019s
I20260709 13:18:36.388480  7893 consensus_queue.cc:1059] T 1528ab62b6fe4e3099d08f141afee116 P ccd8a4c3bfe3413cb2ae219b09aea832 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } attrs { replace: true }, Status: INVALID_TERM, Last received: 1.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.054s
I20260709 13:18:36.402849  7920 raft_consensus.cc:697] T 20f6842e26174571996b8dea4151d4be P cd75a17ab2604397adab03bb8b5fd75c [term 2 LEADER]: Becoming Leader. State: Replica: cd75a17ab2604397adab03bb8b5fd75c, State: Running, Role: LEADER
I20260709 13:18:36.460600  6844 leader_election.cc:304] T 30e88460611e47b2ba16a46a30b5f416 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:18:36.474447  7896 raft_consensus.cc:3055] T 22ccee1b570c4ad3a57bd7aec085b1b4 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 1 LEADER]: Stepping down as leader of term 1
W20260709 13:18:36.475821  6695 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:36.450202  7870 raft_consensus.cc:2804] T 17587d6730594da4a56fa13a353232a1 P b7ab4784c7344b939bc36f639286f377 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:18:36.457057  7907 raft_consensus.cc:2804] T ab432e62819d499eaaf3dd55481dd930 P cd75a17ab2604397adab03bb8b5fd75c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:18:36.457548  7887 raft_consensus.cc:697] T f3f9c2e2bf644115957398fe4c9459db P cd75a17ab2604397adab03bb8b5fd75c [term 2 LEADER]: Becoming Leader. State: Replica: cd75a17ab2604397adab03bb8b5fd75c, State: Running, Role: LEADER
I20260709 13:18:36.491532  7911 raft_consensus.cc:3055] T a3022224cc81473690653a83d4e99470 P cd75a17ab2604397adab03bb8b5fd75c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:18:36.516436  7911 raft_consensus.cc:740] T a3022224cc81473690653a83d4e99470 P cd75a17ab2604397adab03bb8b5fd75c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: cd75a17ab2604397adab03bb8b5fd75c, State: Running, Role: LEADER
I20260709 13:18:36.517642  7911 consensus_queue.cc:260] T a3022224cc81473690653a83d4e99470 P cd75a17ab2604397adab03bb8b5fd75c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:36.519630  7911 raft_consensus.cc:3060] T a3022224cc81473690653a83d4e99470 P cd75a17ab2604397adab03bb8b5fd75c [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:18:36.524065  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 63585.3us
I20260709 13:18:36.525321  6844 leader_election.cc:304] T 1bf4668eeb70467fb3dc5a0289233b3c P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:18:36.439896  7917 raft_consensus.cc:697] T 7c44c4849aa54f2b94d1f1bef9ed546f P cd75a17ab2604397adab03bb8b5fd75c [term 2 LEADER]: Becoming Leader. State: Replica: cd75a17ab2604397adab03bb8b5fd75c, State: Running, Role: LEADER
I20260709 13:18:36.486143  7896 raft_consensus.cc:740] T 22ccee1b570c4ad3a57bd7aec085b1b4 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
W20260709 13:18:36.529668  6697 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.68:45071, user_credentials={real_user=slave}} blocked reactor thread for 186741us
I20260709 13:18:36.493409  6730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3022224cc81473690653a83d4e99470" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:18:36.483475  6798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de3186201e1a40d0b335eeb8b4e256e0" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:18:36.488853  7870 raft_consensus.cc:493] T 17587d6730594da4a56fa13a353232a1 P b7ab4784c7344b939bc36f639286f377 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:36.503400  6731 raft_consensus.cc:2468] T 3a485a995abc4807b6e511e45419f737 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 2.
I20260709 13:18:36.505731  7941 consensus_queue.cc:260] T 4d9def8b32fd443aa94ab1420b06837b P ccd8a4c3bfe3413cb2ae219b09aea832 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:36.507769  7468 leader_election.cc:304] T 4b8cacb381b746da8d0049b0a83b41dd P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:18:36.608814  6880 raft_consensus.cc:1240] T f03d0dbf16864ca4bc1bb5e4c0334c0f P cd75a17ab2604397adab03bb8b5fd75c [term 2 FOLLOWER]: Rejecting Update request from peer ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 1. Current term is 2. Ops: []
I20260709 13:18:36.509291  7920 consensus_queue.cc:237] T 20f6842e26174571996b8dea4151d4be P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:36.510950  7907 raft_consensus.cc:697] T ab432e62819d499eaaf3dd55481dd930 P cd75a17ab2604397adab03bb8b5fd75c [term 2 LEADER]: Becoming Leader. State: Replica: cd75a17ab2604397adab03bb8b5fd75c, State: Running, Role: LEADER
I20260709 13:18:36.513520  6873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a485a995abc4807b6e511e45419f737" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:18:36.531430  7868 leader_election.cc:290] T 3a485a995abc4807b6e511e45419f737 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:18:36.404393  7853 raft_consensus.cc:515] T ce4f062dcd314d43a63ca74067cb5ee3 P b7ab4784c7344b939bc36f639286f377 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } attrs { replace: true } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:18:36.475812  7851 raft_consensus.cc:697] T c4db81d9d329422bb3b4160ca4ac2d1d P cd75a17ab2604397adab03bb8b5fd75c [term 2 LEADER]: Becoming Leader. State: Replica: cd75a17ab2604397adab03bb8b5fd75c, State: Running, Role: LEADER
W20260709 13:18:36.603996  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 78809.3us
I20260709 13:18:36.607003  6877 raft_consensus.cc:1240] T 4d9def8b32fd443aa94ab1420b06837b P cd75a17ab2604397adab03bb8b5fd75c [term 2 FOLLOWER]: Rejecting Update request from peer ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 1. Current term is 2. Ops: []
I20260709 13:18:36.482451  7934 raft_consensus.cc:515] T 4b8cacb381b746da8d0049b0a83b41dd P cd75a17ab2604397adab03bb8b5fd75c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:18:36.648102  6874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3022224cc81473690653a83d4e99470" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:18:36.648857  6844 leader_election.cc:304] T 9b3759de40694069b13c0f8bd40e5709 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:18:36.515708  7887 consensus_queue.cc:237] T f3f9c2e2bf644115957398fe4c9459db P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:36.602138  7870 raft_consensus.cc:3060] T 17587d6730594da4a56fa13a353232a1 P b7ab4784c7344b939bc36f639286f377 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:36.619052  7943 raft_consensus.cc:493] T 3fa34c08b205435dba97346991aa1f92 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:36.657681  6697 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:36.611334  7885 raft_consensus.cc:3055] T 7a734b5ab7834e05a8c422208acc58b1 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:18:36.601370  7891 raft_consensus.cc:2749] T 1bf4668eeb70467fb3dc5a0289233b3c P cd75a17ab2604397adab03bb8b5fd75c [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:18:36.602708  7832 raft_consensus.cc:2749] T 30e88460611e47b2ba16a46a30b5f416 P cd75a17ab2604397adab03bb8b5fd75c [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:18:36.651913  6730 raft_consensus.cc:2393] T a3022224cc81473690653a83d4e99470 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate b7ab4784c7344b939bc36f639286f377 in current term 2: Already voted for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in this term.
I20260709 13:18:36.715974  6729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22ccee1b570c4ad3a57bd7aec085b1b4" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:18:36.532167  7936 consensus_queue.cc:1048] T bb7fa124c3bf4ef9ab65a407cb008441 P 7ba59cc884714e8aa5f3f0ecaed84cbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.131s
W20260709 13:18:36.719024  6696 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:36.715190  6697 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:36.651765  7941 raft_consensus.cc:3060] T 4d9def8b32fd443aa94ab1420b06837b P ccd8a4c3bfe3413cb2ae219b09aea832 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:36.728377  7901 raft_consensus.cc:3060] T 713b5728a197487c9300b310ab94e5a3 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:36.728605  7853 leader_election.cc:290] T ce4f062dcd314d43a63ca74067cb5ee3 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:18:36.731118  6877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce4f062dcd314d43a63ca74067cb5ee3" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:18:36.732179  7906 raft_consensus.cc:3060] T 24ee15416e3145beaa1b8183453729a3 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:36.733197  7502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce4f062dcd314d43a63ca74067cb5ee3" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:18:36.652890  7946 raft_consensus.cc:2749] T 4b8cacb381b746da8d0049b0a83b41dd P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
W20260709 13:18:36.736291  6697 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:36.757655  6697 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:36.703722  7868 raft_consensus.cc:493] T 9e326172347f45e99a0d482b5d8ef768 P b7ab4784c7344b939bc36f639286f377 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:36.703284  7940 raft_consensus.cc:493] T 4b8cacb381b746da8d0049b0a83b41dd P ccd8a4c3bfe3413cb2ae219b09aea832 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:36.737944  7723 consensus_queue.cc:260] T f03d0dbf16864ca4bc1bb5e4c0334c0f P ccd8a4c3bfe3413cb2ae219b09aea832 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:36.649755  7922 raft_consensus.cc:697] T f09c2a98de1a4decabd0ff900dd44caa P cd75a17ab2604397adab03bb8b5fd75c [term 2 LEADER]: Becoming Leader. State: Replica: cd75a17ab2604397adab03bb8b5fd75c, State: Running, Role: LEADER
I20260709 13:18:36.745565  6800 raft_consensus.cc:1275] T 1bf4668eeb70467fb3dc5a0289233b3c P b7ab4784c7344b939bc36f639286f377 [term 2 FOLLOWER]: Refusing update from remote peer ccd8a4c3bfe3413cb2ae219b09aea832: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:18:36.716367  7886 raft_consensus.cc:493] T d8cee0accdb8499c86d4414b72565a38 P cd75a17ab2604397adab03bb8b5fd75c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:18:36.753764  7502 raft_consensus.cc:2468] T ce4f062dcd314d43a63ca74067cb5ee3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 1 LEARNER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 1.
I20260709 13:18:36.744678  6877 raft_consensus.cc:2468] T ce4f062dcd314d43a63ca74067cb5ee3 P cd75a17ab2604397adab03bb8b5fd75c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 2.
I20260709 13:18:36.652570  6873 raft_consensus.cc:2468] T 3a485a995abc4807b6e511e45419f737 P cd75a17ab2604397adab03bb8b5fd75c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 2.
I20260709 13:18:36.771068  7922 consensus_queue.cc:237] T f09c2a98de1a4decabd0ff900dd44caa P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:36.772722  6772 leader_election.cc:304] T ce4f062dcd314d43a63ca74067cb5ee3 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:18:36.773820  6772 leader_election.cc:304] T 3a485a995abc4807b6e511e45419f737 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:18:36.716804  7943 raft_consensus.cc:515] T 3fa34c08b205435dba97346991aa1f92 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:18:36.714620  7885 raft_consensus.cc:740] T 7a734b5ab7834e05a8c422208acc58b1 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
I20260709 13:18:36.731118  6731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "404190ce4ce94cecbfcb6ea9d1dd8626" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:18:36.619282  7894 consensus_queue.cc:1059] T bb3d8792045a4583ae2e965b1350a5b4 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.123s
I20260709 13:18:36.764943  6728 raft_consensus.cc:2468] T b56bf91d90824c959e21e0cee5ba1816 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 2.
W20260709 13:18:36.656160  7468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 146493us
I20260709 13:18:36.756704  6770 leader_election.cc:304] T a3022224cc81473690653a83d4e99470 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:18:36.781490  7723 raft_consensus.cc:3060] T f03d0dbf16864ca4bc1bb5e4c0334c0f P ccd8a4c3bfe3413cb2ae219b09aea832 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:36.781484  7853 raft_consensus.cc:493] T d33d5ee8ef6f415593d8df52063161ad P b7ab4784c7344b939bc36f639286f377 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:36.756635  7832 raft_consensus.cc:2749] T 9b3759de40694069b13c0f8bd40e5709 P cd75a17ab2604397adab03bb8b5fd75c [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:18:36.653563  7896 consensus_queue.cc:260] T 22ccee1b570c4ad3a57bd7aec085b1b4 P ccd8a4c3bfe3413cb2ae219b09aea832 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:36.805224  7896 raft_consensus.cc:3060] T 22ccee1b570c4ad3a57bd7aec085b1b4 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:36.808132  7943 leader_election.cc:290] T 3fa34c08b205435dba97346991aa1f92 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
W20260709 13:18:36.809003  7916 consensus_queue.cc:1175] T 22ccee1b570c4ad3a57bd7aec085b1b4 P ccd8a4c3bfe3413cb2ae219b09aea832 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "b7ab4784c7344b939bc36f639286f377" responder_term: 1 status { last_received { term: 1 index: 1 } last_committed_idx: 1 last_received_current_leader { term: 1 index: 1 } }
I20260709 13:18:36.793756  7853 raft_consensus.cc:515] T d33d5ee8ef6f415593d8df52063161ad P b7ab4784c7344b939bc36f639286f377 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:36.814638  7853 leader_election.cc:290] T d33d5ee8ef6f415593d8df52063161ad P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:18:36.815192  7853 raft_consensus.cc:2749] T a3022224cc81473690653a83d4e99470 P b7ab4784c7344b939bc36f639286f377 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:18:36.817551  7502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fa34c08b205435dba97346991aa1f92" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:18:36.818287  7502 raft_consensus.cc:2468] T 3fa34c08b205435dba97346991aa1f92 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 1.
I20260709 13:18:36.812543  7894 raft_consensus.cc:3055] T bb3d8792045a4583ae2e965b1350a5b4 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:18:36.820007  6697 leader_election.cc:304] T 3fa34c08b205435dba97346991aa1f92 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
I20260709 13:18:36.821628  6723 raft_consensus.cc:2468] T 711ef6523deb4cbe8ef2ba61e1c21c98 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 2.
I20260709 13:18:36.781888  7914 raft_consensus.cc:2804] T ce4f062dcd314d43a63ca74067cb5ee3 P b7ab4784c7344b939bc36f639286f377 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:18:36.791225  7946 raft_consensus.cc:493] T be1a92657f494cac8dd227d152f50151 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:36.789798  7883 raft_consensus.cc:2804] T 3a485a995abc4807b6e511e45419f737 P b7ab4784c7344b939bc36f639286f377 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:18:36.823678  7468 leader_election.cc:304] T 3fa34c08b205435dba97346991aa1f92 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:18:36.828950  7936 raft_consensus.cc:3060] T 3fa34c08b205435dba97346991aa1f92 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:36.702765  7917 consensus_queue.cc:237] T 7c44c4849aa54f2b94d1f1bef9ed546f P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:36.775290  7868 raft_consensus.cc:515] T 9e326172347f45e99a0d482b5d8ef768 P b7ab4784c7344b939bc36f639286f377 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:36.836428  7857 raft_consensus.cc:493] T d33d5ee8ef6f415593d8df52063161ad P ccd8a4c3bfe3413cb2ae219b09aea832 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:36.837467  6798 raft_consensus.cc:2468] T de3186201e1a40d0b335eeb8b4e256e0 P b7ab4784c7344b939bc36f639286f377 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 2.
I20260709 13:18:36.808153  6730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a485a995abc4807b6e511e45419f737" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:18:36.800026  6731 raft_consensus.cc:2468] T 404190ce4ce94cecbfcb6ea9d1dd8626 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 2.
W20260709 13:18:36.858444  6802 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.509s	user 0.059s	sys 0.119s
W20260709 13:18:36.859390  6802 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.510s	user 0.059s	sys 0.119s
I20260709 13:18:36.790611  7886 raft_consensus.cc:515] T d8cee0accdb8499c86d4414b72565a38 P cd75a17ab2604397adab03bb8b5fd75c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:18:36.831527  7948 raft_consensus.cc:2804] T 3fa34c08b205435dba97346991aa1f92 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:18:36.825449  7914 raft_consensus.cc:493] T ce4f062dcd314d43a63ca74067cb5ee3 P b7ab4784c7344b939bc36f639286f377 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:36.821309  7894 raft_consensus.cc:740] T bb3d8792045a4583ae2e965b1350a5b4 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
I20260709 13:18:36.775132  7940 raft_consensus.cc:515] T 4b8cacb381b746da8d0049b0a83b41dd P ccd8a4c3bfe3413cb2ae219b09aea832 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:18:36.832466  7883 raft_consensus.cc:493] T 3a485a995abc4807b6e511e45419f737 P b7ab4784c7344b939bc36f639286f377 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:36.867604  6726 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49998 (request call id 354) took 1095 ms. Trace:
I20260709 13:18:36.868232  6726 rpcz_store.cc:276] 0709 13:18:35.771896 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:35.836610 (+ 64714us) service_pool.cc:224] Handling call
0709 13:18:36.867356 (+1030746us) spinlock_profiling.cc:243] Waited 201 ms on lock 0x7b54000983d4. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f9ae2fa 00007fcc1496fb17 00007fcc0deea6d4 00007fcc0deea662 00007fcc0deea591 00007fcc0deea50c 00007fcc0dee97c2 00007fcc0dce548c 00007fcc0dce48c6 00007fcc0dce426f
0709 13:18:36.867522 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":462115200}
I20260709 13:18:36.870149  6726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab432e62819d499eaaf3dd55481dd930" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:18:36.871225  6726 raft_consensus.cc:2393] T ab432e62819d499eaaf3dd55481dd930 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7ab4784c7344b939bc36f639286f377 in current term 2: Already voted for candidate cd75a17ab2604397adab03bb8b5fd75c in this term.
I20260709 13:18:36.872273  7883 raft_consensus.cc:3060] T 3a485a995abc4807b6e511e45419f737 P b7ab4784c7344b939bc36f639286f377 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:36.873350  6728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17587d6730594da4a56fa13a353232a1" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:18:36.874799  6728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be1a92657f494cac8dd227d152f50151" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:18:36.884421  7501 raft_consensus.cc:1275] T 17587d6730594da4a56fa13a353232a1 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 3 FOLLOWER]: Refusing update from remote peer ccd8a4c3bfe3413cb2ae219b09aea832: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:18:36.880810  7920 raft_consensus.cc:493] T 24ee15416e3145beaa1b8183453729a3 P cd75a17ab2604397adab03bb8b5fd75c [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:36.877656  7947 log.cc:927] Time spent T 30e88460611e47b2ba16a46a30b5f416 P ccd8a4c3bfe3413cb2ae219b09aea832: Append to log took a long time: real 0.273s	user 0.002s	sys 0.000s
I20260709 13:18:36.896239  6728 raft_consensus.cc:2468] T be1a92657f494cac8dd227d152f50151 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 2.
I20260709 13:18:36.883945  6731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce4f062dcd314d43a63ca74067cb5ee3" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:18:36.884586  6730 raft_consensus.cc:2468] T 3a485a995abc4807b6e511e45419f737 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 2.
I20260709 13:18:36.886135  7941 consensus_queue.cc:1048] T 1bf4668eeb70467fb3dc5a0289233b3c P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.011s
I20260709 13:18:36.782361  7851 consensus_queue.cc:237] T c4db81d9d329422bb3b4160ca4ac2d1d P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
W20260709 13:18:36.901371  6846 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:36.865903  7948 raft_consensus.cc:493] T 3fa34c08b205435dba97346991aa1f92 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:36.914969  6877 raft_consensus.cc:1275] T 30e88460611e47b2ba16a46a30b5f416 P cd75a17ab2604397adab03bb8b5fd75c [term 2 FOLLOWER]: Refusing update from remote peer ccd8a4c3bfe3413cb2ae219b09aea832: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:18:36.915550  6875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fa34c08b205435dba97346991aa1f92" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:18:36.864784  7914 raft_consensus.cc:3060] T ce4f062dcd314d43a63ca74067cb5ee3 P b7ab4784c7344b939bc36f639286f377 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:36.804380  7907 consensus_queue.cc:237] T ab432e62819d499eaaf3dd55481dd930 P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:36.918071  6875 raft_consensus.cc:2468] T 3fa34c08b205435dba97346991aa1f92 P cd75a17ab2604397adab03bb8b5fd75c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 2.
W20260709 13:18:36.909565  7877 consensus_meta.cc:287] T f58dc08b12a2494bb9a1372837970ca2 P ccd8a4c3bfe3413cb2ae219b09aea832: Time spent flushing consensus metadata: real 0.595s	user 0.012s	sys 0.001s
I20260709 13:18:36.929837  7502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b8cacb381b746da8d0049b0a83b41dd" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:18:36.930737  7502 raft_consensus.cc:2393] T 4b8cacb381b746da8d0049b0a83b41dd P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c in current term 2: Already voted for candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in this term.
I20260709 13:18:36.907347  6728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de3186201e1a40d0b335eeb8b4e256e0" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:18:36.859592  7857 raft_consensus.cc:515] T d33d5ee8ef6f415593d8df52063161ad P ccd8a4c3bfe3413cb2ae219b09aea832 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:36.931278  6872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b8cacb381b746da8d0049b0a83b41dd" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:18:36.938653  6872 raft_consensus.cc:2468] T 4b8cacb381b746da8d0049b0a83b41dd P cd75a17ab2604397adab03bb8b5fd75c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 1.
I20260709 13:18:36.924360  7816 consensus_queue.cc:1048] T 30e88460611e47b2ba16a46a30b5f416 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:18:36.924909  7868 leader_election.cc:290] T 9e326172347f45e99a0d482b5d8ef768 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:18:36.924435  7894 consensus_queue.cc:260] T bb3d8792045a4583ae2e965b1350a5b4 P ccd8a4c3bfe3413cb2ae219b09aea832 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:18:36.859992  7885 consensus_queue.cc:260] T 7a734b5ab7834e05a8c422208acc58b1 P ccd8a4c3bfe3413cb2ae219b09aea832 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:36.909008  7920 raft_consensus.cc:515] T 24ee15416e3145beaa1b8183453729a3 P cd75a17ab2604397adab03bb8b5fd75c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } attrs { replace: true } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:18:36.911851  7943 raft_consensus.cc:493] T bd6869f07b5a4885a0b99fbe60c3b175 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:36.934895  6728 raft_consensus.cc:2393] T de3186201e1a40d0b335eeb8b4e256e0 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c in current term 2: Already voted for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in this term.
I20260709 13:18:36.937096  6874 raft_consensus.cc:2468] T a3022224cc81473690653a83d4e99470 P cd75a17ab2604397adab03bb8b5fd75c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 2.
I20260709 13:18:36.916675  7891 raft_consensus.cc:493] T fe20b4b48823486ca3b9c648db6ce8aa P cd75a17ab2604397adab03bb8b5fd75c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:18:36.918336  7948 raft_consensus.cc:3060] T 3fa34c08b205435dba97346991aa1f92 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:36.944233  6801 raft_consensus.cc:1275] T 30e88460611e47b2ba16a46a30b5f416 P b7ab4784c7344b939bc36f639286f377 [term 2 FOLLOWER]: Refusing update from remote peer ccd8a4c3bfe3413cb2ae219b09aea832: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:18:36.857152  7946 raft_consensus.cc:515] T be1a92657f494cac8dd227d152f50151 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:18:36.947136  7857 leader_election.cc:290] T d33d5ee8ef6f415593d8df52063161ad P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:18:36.912518  6731 raft_consensus.cc:2468] T ce4f062dcd314d43a63ca74067cb5ee3 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 2.
I20260709 13:18:36.950340  6881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d33d5ee8ef6f415593d8df52063161ad" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:18:36.967020  6881 raft_consensus.cc:2468] T d33d5ee8ef6f415593d8df52063161ad P cd75a17ab2604397adab03bb8b5fd75c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 2.
W20260709 13:18:36.963451  6770 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 206875us
W20260709 13:18:36.964264  6772 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 163546us
I20260709 13:18:36.969390  6728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d33d5ee8ef6f415593d8df52063161ad" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:18:36.970244  6728 raft_consensus.cc:2468] T d33d5ee8ef6f415593d8df52063161ad P ccd8a4c3bfe3413cb2ae219b09aea832 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 2.
I20260709 13:18:36.970659  6880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e326172347f45e99a0d482b5d8ef768" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:18:36.971336  6880 raft_consensus.cc:2468] T 9e326172347f45e99a0d482b5d8ef768 P cd75a17ab2604397adab03bb8b5fd75c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 2.
I20260709 13:18:36.971825  6881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d33d5ee8ef6f415593d8df52063161ad" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:18:36.971973  6770 leader_election.cc:304] T ab432e62819d499eaaf3dd55481dd930 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:18:36.973421  6881 raft_consensus.cc:2468] T d33d5ee8ef6f415593d8df52063161ad P cd75a17ab2604397adab03bb8b5fd75c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 2.
I20260709 13:18:36.975859  6728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e326172347f45e99a0d482b5d8ef768" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:18:36.978459  6728 raft_consensus.cc:2468] T 9e326172347f45e99a0d482b5d8ef768 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 2.
I20260709 13:18:36.984314  6798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d33d5ee8ef6f415593d8df52063161ad" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:18:36.960801  6726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3411566abe2d4c9bb4b2adfdd05e6f17" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:18:36.960747  7892 raft_consensus.cc:493] T e77e330a82df4b43a745d57a68f6f057 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:36.984205  7939 raft_consensus.cc:493] T 404190ce4ce94cecbfcb6ea9d1dd8626 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:36.987239  7853 raft_consensus.cc:493] T 90d42e216d9741e190bca19a781291fd P b7ab4784c7344b939bc36f639286f377 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:37.035051  6770 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 63184.3us
I20260709 13:18:37.039492  7946 leader_election.cc:290] T be1a92657f494cac8dd227d152f50151 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:18:37.040295  6803 raft_consensus.cc:1275] T 9b3759de40694069b13c0f8bd40e5709 P b7ab4784c7344b939bc36f639286f377 [term 2 FOLLOWER]: Refusing update from remote peer ccd8a4c3bfe3413cb2ae219b09aea832: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:18:37.041213  7920 leader_election.cc:290] T 24ee15416e3145beaa1b8183453729a3 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
W20260709 13:18:37.042420  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 391541us
I20260709 13:18:37.043502  6844 leader_election.cc:304] T 8c7f33e544204fbaac4078e3e83bbf4e P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:18:36.991818  7940 leader_election.cc:290] T 4b8cacb381b746da8d0049b0a83b41dd P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:18:36.962148  7943 raft_consensus.cc:515] T bd6869f07b5a4885a0b99fbe60c3b175 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:36.963480  7891 raft_consensus.cc:515] T fe20b4b48823486ca3b9c648db6ce8aa P cd75a17ab2604397adab03bb8b5fd75c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:18:36.998721  6798 raft_consensus.cc:2468] T d33d5ee8ef6f415593d8df52063161ad P b7ab4784c7344b939bc36f639286f377 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 2.
I20260709 13:18:37.039855  6770 leader_election.cc:304] T 404190ce4ce94cecbfcb6ea9d1dd8626 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb
I20260709 13:18:37.046903  6844 leader_election.cc:304] T dbdf895bba214ff68685a24fd17dfb5d P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:18:37.042140  7938 consensus_queue.cc:1048] T 30e88460611e47b2ba16a46a30b5f416 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.063s
I20260709 13:18:37.073274  6628 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:51654 (request call id 74) took 1795 ms. Trace:
I20260709 13:18:37.053931  7920 raft_consensus.cc:2749] T 8c7f33e544204fbaac4078e3e83bbf4e P cd75a17ab2604397adab03bb8b5fd75c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:37.057122  7890 consensus_queue.cc:1048] T 9b3759de40694069b13c0f8bd40e5709 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:18:37.060328  7934 leader_election.cc:290] T 4b8cacb381b746da8d0049b0a83b41dd P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:18:37.034441  7868 raft_consensus.cc:493] T d8cee0accdb8499c86d4414b72565a38 P b7ab4784c7344b939bc36f639286f377 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:37.056502  5625 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:18:37.074699  6844 leader_election.cc:304] T e77e330a82df4b43a745d57a68f6f057 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:18:37.090476  7962 raft_consensus.cc:2749] T ab432e62819d499eaaf3dd55481dd930 P b7ab4784c7344b939bc36f639286f377 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:37.087142  6844 leader_election.cc:304] T 3a485a995abc4807b6e511e45419f737 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:18:37.096356  6844 leader_election.cc:304] T a1704639a875409b9959353527b3fd68 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:18:37.080458  7911 raft_consensus.cc:2749] T dbdf895bba214ff68685a24fd17dfb5d P cd75a17ab2604397adab03bb8b5fd75c [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:18:37.102586  7914 raft_consensus.cc:515] T ce4f062dcd314d43a63ca74067cb5ee3 P b7ab4784c7344b939bc36f639286f377 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } attrs { replace: true } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:18:37.034122  7939 raft_consensus.cc:515] T 404190ce4ce94cecbfcb6ea9d1dd8626 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:18:37.104976  6724 raft_consensus.cc:2468] T 7887766dc6784fcaa42b35c05fea7a99 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 2.
I20260709 13:18:37.105654  7922 raft_consensus.cc:2804] T 3a485a995abc4807b6e511e45419f737 P cd75a17ab2604397adab03bb8b5fd75c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:18:37.073712  6628 rpcz_store.cc:276] 0709 13:18:35.279157 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:35.279331 (+   174us) service_pool.cc:224] Handling call
0709 13:18:35.347220 (+ 67889us) spinlock_profiling.cc:243] Waited 1.65 ms on lock 0x7b5400280190. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0c745db1 00007fcc0c885b71 00007fcc0c8860b2 00007fcc157ffa89 00007fcc15797da6 00007fcc15769088 00007fcc1586737e 00007fcc13d282a4 00007fcc13d28232 00007fcc13d28161 00007fcc13d280dc
0709 13:18:37.073195 (+1725975us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:18:36.066850 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:18:36.112966 (+ 46116us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:18:36.113017 (+    51us) write_op.cc:435] Acquired schema lock
0709 13:18:36.113045 (+    28us) tablet.cc:662] Decoding operations
0709 13:18:36.113504 (+   459us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:18:36.113586 (+    82us) write_op.cc:641] Partition lock acquired for write op
0709 13:18:36.113627 (+    41us) tablet.cc:685] Acquiring locks for 1 operations
0709 13:18:36.113868 (+   241us) tablet.cc:701] Row locks acquired
0709 13:18:36.113896 (+    28us) write_op.cc:260] PREPARE: finished
0709 13:18:36.114099 (+   203us) write_op.cc:270] Start()
0709 13:18:36.114249 (+   150us) write_op.cc:276] Timestamp: P: 1783603116114033 usec, L: 0
0709 13:18:36.114280 (+    31us) op_driver.cc:348] REPLICATION: starting
0709 13:18:36.115168 (+   888us) log.cc:844] Serialized 532 byte log entry
0709 13:18:36.484604 (+369436us) op_driver.cc:464] REPLICATION: finished
0709 13:18:36.808849 (+324245us) write_op.cc:301] APPLY: starting
0709 13:18:36.820898 (+ 12049us) tablet.cc:1367] starting BulkCheckPresence
0709 13:18:36.826207 (+  5309us) tablet.cc:1370] finished BulkCheckPresence
0709 13:18:36.826401 (+   194us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:18:36.826698 (+   297us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:18:36.826908 (+   210us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 13:18:36.826973 (+    65us) write_op.cc:312] APPLY: finished
0709 13:18:36.827219 (+   246us) log.cc:844] Serialized 22 byte log entry
0709 13:18:36.827410 (+   191us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:18:36.827492 (+    82us) write_op.cc:454] Released schema lock
0709 13:18:36.827527 (+    35us) write_op.cc:341] FINISH: Updating metrics
0709 13:18:36.827887 (+   360us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:18:36.827916 (+    29us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":1,"spinlock_wait_cycles":3807360,"child_traces":[["op",{"apply.queue_time_us":290728,"apply.run_cpu_time_us":2123,"apply.run_wall_time_us":26043,"num_ops":1,"prepare.queue_time_us":376942,"prepare.run_cpu_time_us":7496,"prepare.run_wall_time_us":153313,"raft.queue_time_us":96588,"raft.run_cpu_time_us":36480,"raft.run_wall_time_us":280994,"replication_time_us":335303,"thread_start_us":398211,"threads_started":4,"wal-append.queue_time_us":142382}]]}
I20260709 13:18:37.108434  7958 raft_consensus.cc:493] T f58dc08b12a2494bb9a1372837970ca2 P b7ab4784c7344b939bc36f639286f377 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:37.109721  7870 raft_consensus.cc:515] T 17587d6730594da4a56fa13a353232a1 P b7ab4784c7344b939bc36f639286f377 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:18:37.129467  6807 raft_consensus.cc:1240] T 17587d6730594da4a56fa13a353232a1 P b7ab4784c7344b939bc36f639286f377 [term 4 FOLLOWER]: Rejecting Update request from peer ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 3. Current term is 4. Ops: []
I20260709 13:18:37.130827  7870 leader_election.cc:290] T 17587d6730594da4a56fa13a353232a1 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 4 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:18:37.098722  7868 raft_consensus.cc:515] T d8cee0accdb8499c86d4414b72565a38 P b7ab4784c7344b939bc36f639286f377 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:18:37.033813  7892 raft_consensus.cc:515] T e77e330a82df4b43a745d57a68f6f057 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } }
I20260709 13:18:37.140887  7892 leader_election.cc:290] T e77e330a82df4b43a745d57a68f6f057 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:18:37.146703  7885 raft_consensus.cc:3060] T 7a734b5ab7834e05a8c422208acc58b1 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:37.106069  7939 leader_election.cc:290] T 404190ce4ce94cecbfcb6ea9d1dd8626 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:18:37.116084  7920 raft_consensus.cc:2804] T a1704639a875409b9959353527b3fd68 P cd75a17ab2604397adab03bb8b5fd75c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:18:37.151101  7943 leader_election.cc:290] T bd6869f07b5a4885a0b99fbe60c3b175 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:18:37.153460  7891 leader_election.cc:290] T fe20b4b48823486ca3b9c648db6ce8aa P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:18:37.154461  7894 raft_consensus.cc:3060] T bb3d8792045a4583ae2e965b1350a5b4 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:37.114555  7835 raft_consensus.cc:493] T 3d65025eea89441290d85dd053810e31 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader cd75a17ab2604397adab03bb8b5fd75c)
I20260709 13:18:37.053833  7853 raft_consensus.cc:515] T 90d42e216d9741e190bca19a781291fd P b7ab4784c7344b939bc36f639286f377 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:37.098194  7934 raft_consensus.cc:2804] T e77e330a82df4b43a745d57a68f6f057 P cd75a17ab2604397adab03bb8b5fd75c [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:18:37.125502  7958 raft_consensus.cc:515] T f58dc08b12a2494bb9a1372837970ca2 P b7ab4784c7344b939bc36f639286f377 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:37.137147  7868 leader_election.cc:290] T d8cee0accdb8499c86d4414b72565a38 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
W20260709 13:18:37.137362  6697 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:37.082686  7883 raft_consensus.cc:515] T 3a485a995abc4807b6e511e45419f737 P b7ab4784c7344b939bc36f639286f377 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:37.109733  7897 raft_consensus.cc:3060] T 1528ab62b6fe4e3099d08f141afee116 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:18:37.169778  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 62096.2us
I20260709 13:18:37.170861  6844 leader_election.cc:304] T 24ee15416e3145beaa1b8183453729a3 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, b7ab4784c7344b939bc36f639286f377
I20260709 13:18:37.131790  7870 raft_consensus.cc:493] T 7ba5dac66ab5497e9e336f2a3c28cda5 P b7ab4784c7344b939bc36f639286f377 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:37.180569  7953 consensus_queue.cc:1059] T 7ba5dac66ab5497e9e336f2a3c28cda5 P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.009s
I20260709 13:18:37.186213  7961 raft_consensus.cc:493] T 24ee15416e3145beaa1b8183453729a3 P b7ab4784c7344b939bc36f639286f377 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:18:37.188671  7956 raft_consensus.cc:493] T 7887766dc6784fcaa42b35c05fea7a99 P b7ab4784c7344b939bc36f639286f377 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:18:37.197085  6695 leader_election.cc:304] T d33d5ee8ef6f415593d8df52063161ad P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
I20260709 13:18:37.197829  6844 leader_election.cc:304] T f03d0dbf16864ca4bc1bb5e4c0334c0f P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:18:37.169463  7868 raft_consensus.cc:493] T 1528ab62b6fe4e3099d08f141afee116 P b7ab4784c7344b939bc36f639286f377 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:18:37.172210  7934 raft_consensus.cc:697] T e77e330a82df4b43a745d57a68f6f057 P cd75a17ab2604397adab03bb8b5fd75c [term 3 LEADER]: Becoming Leader. State: Replica: cd75a17ab2604397adab03bb8b5fd75c, State: Running, Role: LEADER
I20260709 13:18:37.199564  6844 leader_election.cc:304] T 07a92dd554674067a83a9cb68c4773f2 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:18:37.172400  7922 raft_consensus.cc:697] T 3a485a995abc4807b6e511e45419f737 P cd75a17ab2604397adab03bb8b5fd75c [term 2 LEADER]: Becoming Leader. State: Replica: cd75a17ab2604397adab03bb8b5fd75c, State: Running, Role: LEADER
I20260709 13:18:37.165282  7835 raft_consensus.cc:515] T 3d65025eea89441290d85dd053810e31 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:37.171865  7920 raft_consensus.cc:697] T a1704639a875409b9959353527b3fd68 P cd75a17ab2604397adab03bb8b5fd75c [term 2 LEADER]: Becoming Leader. State: Replica: cd75a17ab2604397adab03bb8b5fd75c, State: Running, Role: LEADER
I20260709 13:18:37.195461  7832 raft_consensus.cc:2749] T 24ee15416e3145beaa1b8183453729a3 P cd75a17ab2604397adab03bb8b5fd75c [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:18:37.217743  6844 leader_election.cc:304] T 4d9def8b32fd443aa94ab1420b06837b P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:18:37.219337  7911 raft_consensus.cc:2749] T 07a92dd554674067a83a9cb68c4773f2 P cd75a17ab2604397adab03bb8b5fd75c [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:18:37.206287  7891 raft_consensus.cc:2749] T f03d0dbf16864ca4bc1bb5e4c0334c0f P cd75a17ab2604397adab03bb8b5fd75c [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:18:37.220273  6801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77e330a82df4b43a745d57a68f6f057" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:18:37.229179  6801 raft_consensus.cc:2468] T e77e330a82df4b43a745d57a68f6f057 P b7ab4784c7344b939bc36f639286f377 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 3.
I20260709 13:18:37.240842  6729 raft_consensus.cc:2468] T 22ccee1b570c4ad3a57bd7aec085b1b4 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 2.
I20260709 13:18:37.274283  6800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6869f07b5a4885a0b99fbe60c3b175" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:18:37.275089  6800 raft_consensus.cc:2468] T bd6869f07b5a4885a0b99fbe60c3b175 P b7ab4784c7344b939bc36f639286f377 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 3.
I20260709 13:18:37.276259  6802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be1a92657f494cac8dd227d152f50151" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:18:37.277032  6802 raft_consensus.cc:2468] T be1a92657f494cac8dd227d152f50151 P b7ab4784c7344b939bc36f639286f377 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in term 1.
I20260709 13:18:37.205302  7930 raft_consensus.cc:2804] T d33d5ee8ef6f415593d8df52063161ad P ccd8a4c3bfe3413cb2ae219b09aea832 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:18:37.279758  6802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "404190ce4ce94cecbfcb6ea9d1dd8626" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:18:37.280531  6802 raft_consensus.cc:2468] T 404190ce4ce94cecbfcb6ea9d1dd8626 P b7ab4784c7344b939bc36f639286f377 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in term 1.
I20260709 13:18:37.190495  7870 raft_consensus.cc:515] T 7ba5dac66ab5497e9e336f2a3c28cda5 P b7ab4784c7344b939bc36f639286f377 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:18:37.282374  7466 leader_election.cc:304] T be1a92657f494cac8dd227d152f50151 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, b7ab4784c7344b939bc36f639286f377; no voters: 
I20260709 13:18:37.287462  6726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "404190ce4ce94cecbfcb6ea9d1dd8626" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:18:37.287791  7922 consensus_queue.cc:237] T 3a485a995abc4807b6e511e45419f737 P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:37.288480  6726 raft_consensus.cc:2468] T 404190ce4ce94cecbfcb6ea9d1dd8626 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in term 2.
I20260709 13:18:37.290993  7883 leader_election.cc:290] T 3a485a995abc4807b6e511e45419f737 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 3 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
W20260709 13:18:37.291713  7906 consensus_meta.cc:287] T 24ee15416e3145beaa1b8183453729a3 P ccd8a4c3bfe3413cb2ae219b09aea832: Time spent flushing consensus metadata: real 0.525s	user 0.008s	sys 0.003s
I20260709 13:18:37.291620  7501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b8cacb381b746da8d0049b0a83b41dd" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:18:37.213796  7893 raft_consensus.cc:493] T 90d42e216d9741e190bca19a781291fd P ccd8a4c3bfe3413cb2ae219b09aea832 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:37.292798  7893 raft_consensus.cc:515] T 90d42e216d9741e190bca19a781291fd P ccd8a4c3bfe3413cb2ae219b09aea832 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:37.292819  7501 raft_consensus.cc:2468] T 4b8cacb381b746da8d0049b0a83b41dd P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 2.
I20260709 13:18:37.295102  7893 leader_election.cc:290] T 90d42e216d9741e190bca19a781291fd P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:18:37.295732  7946 raft_consensus.cc:2804] T be1a92657f494cac8dd227d152f50151 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:18:37.296200  7946 raft_consensus.cc:493] T be1a92657f494cac8dd227d152f50151 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:37.296327  7965 raft_consensus.cc:2804] T 404190ce4ce94cecbfcb6ea9d1dd8626 P b7ab4784c7344b939bc36f639286f377 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:18:37.296648  7946 raft_consensus.cc:3060] T be1a92657f494cac8dd227d152f50151 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:37.296809  7965 raft_consensus.cc:493] T 404190ce4ce94cecbfcb6ea9d1dd8626 P b7ab4784c7344b939bc36f639286f377 [term 1 FOLLOWER]: Starting leader election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:18:37.297235  7965 raft_consensus.cc:3060] T 404190ce4ce94cecbfcb6ea9d1dd8626 P b7ab4784c7344b939bc36f639286f377 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:37.286741  7466 leader_election.cc:304] T 404190ce4ce94cecbfcb6ea9d1dd8626 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, b7ab4784c7344b939bc36f639286f377; no voters: 
I20260709 13:18:37.297602  7835 leader_election.cc:290] T 3d65025eea89441290d85dd053810e31 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:18:37.305637  7949 raft_consensus.cc:493] T de3186201e1a40d0b335eeb8b4e256e0 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:37.300812  6695 leader_election.cc:304] T e77e330a82df4b43a745d57a68f6f057 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
I20260709 13:18:37.302630  6697 leader_election.cc:304] T 4b8cacb381b746da8d0049b0a83b41dd P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:18:37.210245  7956 raft_consensus.cc:515] T 7887766dc6784fcaa42b35c05fea7a99 P b7ab4784c7344b939bc36f639286f377 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:37.229456  7958 leader_election.cc:290] T f58dc08b12a2494bb9a1372837970ca2 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:18:37.308785  7502 raft_consensus.cc:1275] T 427c124d773f483294511e80fe340075 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 1 LEARNER]: Refusing update from remote peer cd75a17ab2604397adab03bb8b5fd75c: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:18:37.306651  7501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8cee0accdb8499c86d4414b72565a38" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:18:37.320586  7499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24ee15416e3145beaa1b8183453729a3" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:18:37.321111  7501 raft_consensus.cc:2393] T d8cee0accdb8499c86d4414b72565a38 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c in current term 2: Already voted for candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in this term.
I20260709 13:18:37.308982  7901 raft_consensus.cc:493] T 2c240553ce044eedb41541d72b9475d7 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:37.320806  7943 raft_consensus.cc:2804] T e77e330a82df4b43a745d57a68f6f057 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:18:37.321569  7870 leader_election.cc:290] T 7ba5dac66ab5497e9e336f2a3c28cda5 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:18:37.309947  6695 leader_election.cc:304] T bd6869f07b5a4885a0b99fbe60c3b175 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
I20260709 13:18:37.321544  7934 consensus_queue.cc:237] T e77e330a82df4b43a745d57a68f6f057 P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } }
I20260709 13:18:37.324442  7832 raft_consensus.cc:2749] T 4d9def8b32fd443aa94ab1420b06837b P cd75a17ab2604397adab03bb8b5fd75c [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:18:37.279381  7930 raft_consensus.cc:493] T d33d5ee8ef6f415593d8df52063161ad P ccd8a4c3bfe3413cb2ae219b09aea832 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:37.322036  7943 raft_consensus.cc:493] T e77e330a82df4b43a745d57a68f6f057 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:37.211005  7868 raft_consensus.cc:515] T 1528ab62b6fe4e3099d08f141afee116 P b7ab4784c7344b939bc36f639286f377 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } attrs { replace: true } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
W20260709 13:18:37.325626  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 107968us
I20260709 13:18:37.340961  6879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77e330a82df4b43a745d57a68f6f057" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:18:37.343530  6879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6869f07b5a4885a0b99fbe60c3b175" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:18:37.344211  6879 raft_consensus.cc:2468] T bd6869f07b5a4885a0b99fbe60c3b175 P cd75a17ab2604397adab03bb8b5fd75c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 3.
I20260709 13:18:37.334463  6804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d65025eea89441290d85dd053810e31" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:18:37.345331  6881 raft_consensus.cc:1275] T 1bf4668eeb70467fb3dc5a0289233b3c P cd75a17ab2604397adab03bb8b5fd75c [term 2 FOLLOWER]: Refusing update from remote peer ccd8a4c3bfe3413cb2ae219b09aea832: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:18:37.344265  6800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90d42e216d9741e190bca19a781291fd" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:18:37.348503  6800 raft_consensus.cc:2468] T 90d42e216d9741e190bca19a781291fd P b7ab4784c7344b939bc36f639286f377 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 2.
W20260709 13:18:37.350920  6697 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 48423.9us
I20260709 13:18:37.305686  6724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be1a92657f494cac8dd227d152f50151" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
W20260709 13:18:37.356002  6695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 46151.3us
I20260709 13:18:37.327153  7939 raft_consensus.cc:2804] T 404190ce4ce94cecbfcb6ea9d1dd8626 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:18:37.329763  7930 raft_consensus.cc:3060] T d33d5ee8ef6f415593d8df52063161ad P ccd8a4c3bfe3413cb2ae219b09aea832 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:37.279173  7816 consensus_queue.cc:1048] T 17587d6730594da4a56fa13a353232a1 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.082s
I20260709 13:18:37.365134  6881 raft_consensus.cc:1275] T 9b3759de40694069b13c0f8bd40e5709 P cd75a17ab2604397adab03bb8b5fd75c [term 2 FOLLOWER]: Refusing update from remote peer ccd8a4c3bfe3413cb2ae219b09aea832: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:18:37.360206  6844 leader_election.cc:304] T 95a75bfe094d4bdc963aba3f08dfcd25 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:18:37.368717  6879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90d42e216d9741e190bca19a781291fd" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:18:37.370553  6880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d65025eea89441290d85dd053810e31" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:18:37.343912  7943 raft_consensus.cc:3060] T e77e330a82df4b43a745d57a68f6f057 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:37.307879  7883 raft_consensus.cc:493] T 20f6842e26174571996b8dea4151d4be P b7ab4784c7344b939bc36f639286f377 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:18:37.210450  7961 raft_consensus.cc:515] T 24ee15416e3145beaa1b8183453729a3 P b7ab4784c7344b939bc36f639286f377 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } attrs { replace: true } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:18:37.378217  6630 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:53224 (request call id 154) took 1357 ms. Trace:
I20260709 13:18:37.404148  6630 rpcz_store.cc:276] 0709 13:18:36.020875 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:36.032332 (+ 11457us) service_pool.cc:224] Handling call
0709 13:18:37.378148 (+1345816us) inbound_call.cc:177] Queueing success response
Metrics: {"reported_tablets":1}
W20260709 13:18:37.404670  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 44562.5us
I20260709 13:18:37.382737  7886 leader_election.cc:290] T d8cee0accdb8499c86d4414b72565a38 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:18:37.306234  7949 raft_consensus.cc:515] T de3186201e1a40d0b335eeb8b4e256e0 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:37.353253  7835 raft_consensus.cc:2804] T 4b8cacb381b746da8d0049b0a83b41dd P ccd8a4c3bfe3413cb2ae219b09aea832 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:18:37.380018  6626 catalog_manager.cc:5697] T 20f6842e26174571996b8dea4151d4be P cd75a17ab2604397adab03bb8b5fd75c reported cstate change: term changed from 1 to 2, leader changed from ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65) to cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67). New cstate: current_term: 2 leader_uuid: "cd75a17ab2604397adab03bb8b5fd75c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:37.390745  6879 raft_consensus.cc:2468] T 90d42e216d9741e190bca19a781291fd P cd75a17ab2604397adab03bb8b5fd75c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 2.
I20260709 13:18:37.366415  7939 raft_consensus.cc:493] T 404190ce4ce94cecbfcb6ea9d1dd8626 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:37.362702  7940 raft_consensus.cc:2804] T bd6869f07b5a4885a0b99fbe60c3b175 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:18:37.326201  7901 raft_consensus.cc:515] T 2c240553ce044eedb41541d72b9475d7 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:37.412185  6695 leader_election.cc:304] T 90d42e216d9741e190bca19a781291fd P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
I20260709 13:18:37.368175  6724 raft_consensus.cc:2468] T be1a92657f494cac8dd227d152f50151 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in term 2.
W20260709 13:18:37.431535  7466 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 144859us
I20260709 13:18:37.418393  6844 leader_election.cc:304] T 7a734b5ab7834e05a8c422208acc58b1 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:18:37.416829  7907 raft_consensus.cc:2804] T 95a75bfe094d4bdc963aba3f08dfcd25 P cd75a17ab2604397adab03bb8b5fd75c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:18:37.450716  7907 raft_consensus.cc:697] T 95a75bfe094d4bdc963aba3f08dfcd25 P cd75a17ab2604397adab03bb8b5fd75c [term 2 LEADER]: Becoming Leader. State: Replica: cd75a17ab2604397adab03bb8b5fd75c, State: Running, Role: LEADER
I20260709 13:18:37.357489  7920 consensus_queue.cc:237] T a1704639a875409b9959353527b3fd68 P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:37.451598  7948 raft_consensus.cc:515] T 3fa34c08b205435dba97346991aa1f92 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:18:37.429260  7939 raft_consensus.cc:3060] T 404190ce4ce94cecbfcb6ea9d1dd8626 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:37.417511  7883 raft_consensus.cc:515] T 20f6842e26174571996b8dea4151d4be P b7ab4784c7344b939bc36f639286f377 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:37.445413  7888 raft_consensus.cc:2749] T 7a734b5ab7834e05a8c422208acc58b1 P cd75a17ab2604397adab03bb8b5fd75c [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:18:37.448686  7868 leader_election.cc:290] T 1528ab62b6fe4e3099d08f141afee116 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:18:37.419611  7914 leader_election.cc:290] T ce4f062dcd314d43a63ca74067cb5ee3 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 3 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
W20260709 13:18:37.420017  7936 consensus_meta.cc:287] T 3fa34c08b205435dba97346991aa1f92 P 7ba59cc884714e8aa5f3f0ecaed84cbb: Time spent flushing consensus metadata: real 0.590s	user 0.012s	sys 0.002s
I20260709 13:18:37.456390  7501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe20b4b48823486ca3b9c648db6ce8aa" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:18:37.470247  7936 raft_consensus.cc:2749] T 3fa34c08b205435dba97346991aa1f92 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:37.471163  7885 raft_consensus.cc:2804] T 90d42e216d9741e190bca19a781291fd P ccd8a4c3bfe3413cb2ae219b09aea832 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:18:37.471551  7883 leader_election.cc:290] T 20f6842e26174571996b8dea4151d4be P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:18:37.471701  7885 raft_consensus.cc:493] T 90d42e216d9741e190bca19a781291fd P ccd8a4c3bfe3413cb2ae219b09aea832 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:37.463701  7949 leader_election.cc:290] T de3186201e1a40d0b335eeb8b4e256e0 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:18:37.472659  7956 leader_election.cc:290] T 7887766dc6784fcaa42b35c05fea7a99 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:18:37.420298  7941 raft_consensus.cc:493] T 427c124d773f483294511e80fe340075 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader cd75a17ab2604397adab03bb8b5fd75c)
I20260709 13:18:37.468130  7816 raft_consensus.cc:493] T d8292e16e5654be6bc408560cf256aaa P ccd8a4c3bfe3413cb2ae219b09aea832 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:37.474164  7816 raft_consensus.cc:515] T d8292e16e5654be6bc408560cf256aaa P ccd8a4c3bfe3413cb2ae219b09aea832 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
W20260709 13:18:37.468490  6695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 56447.7us
I20260709 13:18:37.428809  7940 raft_consensus.cc:493] T bd6869f07b5a4885a0b99fbe60c3b175 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:37.419572  7835 raft_consensus.cc:493] T 4b8cacb381b746da8d0049b0a83b41dd P ccd8a4c3bfe3413cb2ae219b09aea832 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:37.431124  7853 leader_election.cc:290] T 90d42e216d9741e190bca19a781291fd P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:18:37.417201  7911 consensus_queue.cc:1048] T 427c124d773f483294511e80fe340075 P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.037s
I20260709 13:18:37.472136  7885 raft_consensus.cc:3060] T 90d42e216d9741e190bca19a781291fd P ccd8a4c3bfe3413cb2ae219b09aea832 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:37.451908  7907 consensus_queue.cc:237] T 95a75bfe094d4bdc963aba3f08dfcd25 P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
W20260709 13:18:37.464476  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 46232.2us
W20260709 13:18:37.504328  6770 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 464635us
I20260709 13:18:37.507475  6844 leader_election.cc:304] T 1528ab62b6fe4e3099d08f141afee116 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, b7ab4784c7344b939bc36f639286f377
I20260709 13:18:37.509241  6844 leader_election.cc:304] T de3186201e1a40d0b335eeb8b4e256e0 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:18:37.510638  7891 raft_consensus.cc:2749] T 1528ab62b6fe4e3099d08f141afee116 P cd75a17ab2604397adab03bb8b5fd75c [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:18:37.511615  7891 raft_consensus.cc:2804] T de3186201e1a40d0b335eeb8b4e256e0 P cd75a17ab2604397adab03bb8b5fd75c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:18:37.512336  7891 raft_consensus.cc:697] T de3186201e1a40d0b335eeb8b4e256e0 P cd75a17ab2604397adab03bb8b5fd75c [term 2 LEADER]: Becoming Leader. State: Replica: cd75a17ab2604397adab03bb8b5fd75c, State: Running, Role: LEADER
I20260709 13:18:37.513760  7891 consensus_queue.cc:237] T de3186201e1a40d0b335eeb8b4e256e0 P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:37.525717  6728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe20b4b48823486ca3b9c648db6ce8aa" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:18:37.454487  7948 leader_election.cc:290] T 3fa34c08b205435dba97346991aa1f92 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 3 election: Requested vote from peers cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:18:37.471092  7961 leader_election.cc:290] T 24ee15416e3145beaa1b8183453729a3 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:18:37.472743  7877 raft_consensus.cc:493] T dbdf895bba214ff68685a24fd17dfb5d P ccd8a4c3bfe3413cb2ae219b09aea832 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:37.530957  6726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b8cacb381b746da8d0049b0a83b41dd" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:18:37.486923  7940 raft_consensus.cc:3060] T bd6869f07b5a4885a0b99fbe60c3b175 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:37.565361  6723 raft_consensus.cc:1275] T 20f6842e26174571996b8dea4151d4be P ccd8a4c3bfe3413cb2ae219b09aea832 [term 2 FOLLOWER]: Refusing update from remote peer cd75a17ab2604397adab03bb8b5fd75c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:18:37.567130  6728 raft_consensus.cc:1275] T f09c2a98de1a4decabd0ff900dd44caa P ccd8a4c3bfe3413cb2ae219b09aea832 [term 2 FOLLOWER]: Refusing update from remote peer cd75a17ab2604397adab03bb8b5fd75c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:18:37.507475  6770 leader_election.cc:304] T be1a92657f494cac8dd227d152f50151 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb
W20260709 13:18:37.569440  6770 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 62064.1us
I20260709 13:18:37.571203  6770 leader_election.cc:304] T d33d5ee8ef6f415593d8df52063161ad P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
I20260709 13:18:37.551165  6879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8cee0accdb8499c86d4414b72565a38" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:18:37.472669  7949 raft_consensus.cc:493] T a1704639a875409b9959353527b3fd68 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:37.488483  7835 raft_consensus.cc:3060] T 4b8cacb381b746da8d0049b0a83b41dd P ccd8a4c3bfe3413cb2ae219b09aea832 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:37.575079  6731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24ee15416e3145beaa1b8183453729a3" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:18:37.572525  6879 raft_consensus.cc:3060] T d8cee0accdb8499c86d4414b72565a38 P cd75a17ab2604397adab03bb8b5fd75c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:37.574736  7961 raft_consensus.cc:493] T d8292e16e5654be6bc408560cf256aaa P b7ab4784c7344b939bc36f639286f377 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:37.553076  6844 leader_election.cc:304] T 44bde925b2e541b69890d70715b85176 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377
I20260709 13:18:37.578356  6770 leader_election.cc:304] T 9e326172347f45e99a0d482b5d8ef768 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
I20260709 13:18:37.600529  6770 leader_election.cc:304] T 3411566abe2d4c9bb4b2adfdd05e6f17 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:18:37.583346  6844 leader_election.cc:304] T e31b9971c15848dea59d4d4130141d9e P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377
I20260709 13:18:37.603665  6844 leader_election.cc:304] T b56bf91d90824c959e21e0cee5ba1816 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377
W20260709 13:18:37.605441  6772 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.524s	user 0.061s	sys 0.091s
I20260709 13:18:37.488233  7941 raft_consensus.cc:515] T 427c124d773f483294511e80fe340075 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } attrs { replace: true } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: NON_VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: true } }
I20260709 13:18:37.517249  7919 consensus_queue.cc:1048] T 1bf4668eeb70467fb3dc5a0289233b3c P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.077s
I20260709 13:18:37.608809  6844 leader_election.cc:304] T 711ef6523deb4cbe8ef2ba61e1c21c98 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377
W20260709 13:18:37.605958  6772 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.524s	user 0.061s	sys 0.091s
I20260709 13:18:37.624411  7920 raft_consensus.cc:2804] T 711ef6523deb4cbe8ef2ba61e1c21c98 P cd75a17ab2604397adab03bb8b5fd75c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:18:37.566618  7877 raft_consensus.cc:515] T dbdf895bba214ff68685a24fd17dfb5d P ccd8a4c3bfe3413cb2ae219b09aea832 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:37.633229  6878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ba5dac66ab5497e9e336f2a3c28cda5" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:18:37.581779  7816 leader_election.cc:290] T d8292e16e5654be6bc408560cf256aaa P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:18:37.617914  6728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f58dc08b12a2494bb9a1372837970ca2" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:18:37.618811  6723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce4f062dcd314d43a63ca74067cb5ee3" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:18:37.637027  6728 raft_consensus.cc:2468] T f58dc08b12a2494bb9a1372837970ca2 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 2.
I20260709 13:18:37.637128  6723 raft_consensus.cc:3060] T ce4f062dcd314d43a63ca74067cb5ee3 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:18:37.611428  6695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 134510us
I20260709 13:18:37.582312  7967 raft_consensus.cc:2804] T be1a92657f494cac8dd227d152f50151 P b7ab4784c7344b939bc36f639286f377 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:18:37.630970  6881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f58dc08b12a2494bb9a1372837970ca2" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:18:37.631793  6876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce4f062dcd314d43a63ca74067cb5ee3" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:18:37.673280  6876 raft_consensus.cc:3060] T ce4f062dcd314d43a63ca74067cb5ee3 P cd75a17ab2604397adab03bb8b5fd75c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:37.674329  6875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7887766dc6784fcaa42b35c05fea7a99" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:18:37.632355  6877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a485a995abc4807b6e511e45419f737" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:18:37.593693  7853 raft_consensus.cc:2804] T d33d5ee8ef6f415593d8df52063161ad P b7ab4784c7344b939bc36f639286f377 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:18:37.631843  6880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8cee0accdb8499c86d4414b72565a38" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:18:37.634438  6878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20f6842e26174571996b8dea4151d4be" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:18:37.687877  6878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1528ab62b6fe4e3099d08f141afee116" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:18:37.588527  7832 raft_consensus.cc:2804] T 44bde925b2e541b69890d70715b85176 P cd75a17ab2604397adab03bb8b5fd75c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:18:37.588295  6873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb7fa124c3bf4ef9ab65a407cb008441" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:18:37.602610  7956 raft_consensus.cc:2804] T 9e326172347f45e99a0d482b5d8ef768 P b7ab4784c7344b939bc36f639286f377 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 13:18:37.635874  6697 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 202592us
I20260709 13:18:37.622568  6724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17587d6730594da4a56fa13a353232a1" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:18:37.638010  6728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20f6842e26174571996b8dea4151d4be" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:18:37.610230  7886 raft_consensus.cc:2804] T b56bf91d90824c959e21e0cee5ba1816 P cd75a17ab2604397adab03bb8b5fd75c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:18:37.639451  7968 raft_consensus.cc:493] T 2c240553ce044eedb41541d72b9475d7 P b7ab4784c7344b939bc36f639286f377 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:37.642406  6802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8292e16e5654be6bc408560cf256aaa" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:18:37.612146  7953 raft_consensus.cc:2804] T e31b9971c15848dea59d4d4130141d9e P cd75a17ab2604397adab03bb8b5fd75c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:18:37.609889  7868 raft_consensus.cc:493] T 07a92dd554674067a83a9cb68c4773f2 P b7ab4784c7344b939bc36f639286f377 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:18:37.613672  7958 raft_consensus.cc:493] T f3f9c2e2bf644115957398fe4c9459db P b7ab4784c7344b939bc36f639286f377 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:37.609658  7914 raft_consensus.cc:2749] T 3411566abe2d4c9bb4b2adfdd05e6f17 P b7ab4784c7344b939bc36f639286f377 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:37.619478  7894 raft_consensus.cc:493] T 07a92dd554674067a83a9cb68c4773f2 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:37.582463  7949 raft_consensus.cc:515] T a1704639a875409b9959353527b3fd68 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:37.674013  7967 raft_consensus.cc:493] T be1a92657f494cac8dd227d152f50151 P b7ab4784c7344b939bc36f639286f377 [term 1 FOLLOWER]: Starting leader election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:18:37.673185  6881 raft_consensus.cc:2468] T f58dc08b12a2494bb9a1372837970ca2 P cd75a17ab2604397adab03bb8b5fd75c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 1.
I20260709 13:18:37.685590  6877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24ee15416e3145beaa1b8183453729a3" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:18:37.591151  7961 raft_consensus.cc:515] T d8292e16e5654be6bc408560cf256aaa P b7ab4784c7344b939bc36f639286f377 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:37.724473  6877 raft_consensus.cc:2393] T 24ee15416e3145beaa1b8183453729a3 P cd75a17ab2604397adab03bb8b5fd75c [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7ab4784c7344b939bc36f639286f377 in current term 2: Already voted for candidate cd75a17ab2604397adab03bb8b5fd75c in this term.
I20260709 13:18:37.684935  6725 raft_consensus.cc:2468] T 24ee15416e3145beaa1b8183453729a3 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 2.
I20260709 13:18:37.694604  6878 raft_consensus.cc:2393] T 1528ab62b6fe4e3099d08f141afee116 P cd75a17ab2604397adab03bb8b5fd75c [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7ab4784c7344b939bc36f639286f377 in current term 2: Already voted for candidate cd75a17ab2604397adab03bb8b5fd75c in this term.
I20260709 13:18:37.705345  6728 raft_consensus.cc:2393] T 20f6842e26174571996b8dea4151d4be P ccd8a4c3bfe3413cb2ae219b09aea832 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7ab4784c7344b939bc36f639286f377 in current term 2: Already voted for candidate cd75a17ab2604397adab03bb8b5fd75c in this term.
I20260709 13:18:37.733289  6728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7887766dc6784fcaa42b35c05fea7a99" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:18:37.734407  6728 raft_consensus.cc:2393] T 7887766dc6784fcaa42b35c05fea7a99 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7ab4784c7344b939bc36f639286f377 in current term 2: Already voted for candidate cd75a17ab2604397adab03bb8b5fd75c in this term.
I20260709 13:18:37.712817  7948 raft_consensus.cc:493] T 7c44c4849aa54f2b94d1f1bef9ed546f P ccd8a4c3bfe3413cb2ae219b09aea832 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:37.691831  6801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de3186201e1a40d0b335eeb8b4e256e0" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:18:37.684535  6875 raft_consensus.cc:2393] T 7887766dc6784fcaa42b35c05fea7a99 P cd75a17ab2604397adab03bb8b5fd75c [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7ab4784c7344b939bc36f639286f377 in current term 2: Already voted for candidate cd75a17ab2604397adab03bb8b5fd75c in this term.
I20260709 13:18:37.696832  7956 raft_consensus.cc:493] T 9e326172347f45e99a0d482b5d8ef768 P b7ab4784c7344b939bc36f639286f377 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:37.684804  7936 raft_consensus.cc:493] T 24ee15416e3145beaa1b8183453729a3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:18:37.713959  6697 leader_election.cc:304] T 3d65025eea89441290d85dd053810e31 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:18:37.692437  7883 raft_consensus.cc:493] T a1704639a875409b9959353527b3fd68 P b7ab4784c7344b939bc36f639286f377 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:37.715401  6723 raft_consensus.cc:2468] T ce4f062dcd314d43a63ca74067cb5ee3 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 3.
W20260709 13:18:37.740721  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 132057us
I20260709 13:18:37.706796  6880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90d42e216d9741e190bca19a781291fd" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:18:37.707062  6731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a485a995abc4807b6e511e45419f737" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:18:37.754179  6880 raft_consensus.cc:2468] T 90d42e216d9741e190bca19a781291fd P cd75a17ab2604397adab03bb8b5fd75c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 2.
I20260709 13:18:37.754321  6731 raft_consensus.cc:3060] T 3a485a995abc4807b6e511e45419f737 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:37.686197  7853 raft_consensus.cc:493] T d33d5ee8ef6f415593d8df52063161ad P b7ab4784c7344b939bc36f639286f377 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:37.743717  6804 raft_consensus.cc:1275] T 427c124d773f483294511e80fe340075 P b7ab4784c7344b939bc36f639286f377 [term 1 FOLLOWER]: Refusing update from remote peer cd75a17ab2604397adab03bb8b5fd75c: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:18:37.744184  6806 raft_consensus.cc:3060] T f09c2a98de1a4decabd0ff900dd44caa P b7ab4784c7344b939bc36f639286f377 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:37.756451  7853 raft_consensus.cc:3060] T d33d5ee8ef6f415593d8df52063161ad P b7ab4784c7344b939bc36f639286f377 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:37.742301  6728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24ee15416e3145beaa1b8183453729a3" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:18:37.744799  6802 raft_consensus.cc:2468] T d8292e16e5654be6bc408560cf256aaa P b7ab4784c7344b939bc36f639286f377 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 2.
I20260709 13:18:37.744817  6800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8cee0accdb8499c86d4414b72565a38" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:18:37.760241  6800 raft_consensus.cc:2468] T d8cee0accdb8499c86d4414b72565a38 P b7ab4784c7344b939bc36f639286f377 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 2.
I20260709 13:18:37.707413  7832 raft_consensus.cc:697] T 44bde925b2e541b69890d70715b85176 P cd75a17ab2604397adab03bb8b5fd75c [term 2 LEADER]: Becoming Leader. State: Replica: cd75a17ab2604397adab03bb8b5fd75c, State: Running, Role: LEADER
I20260709 13:18:37.755445  6844 leader_election.cc:304] T 7887766dc6784fcaa42b35c05fea7a99 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377
I20260709 13:18:37.762784  7832 consensus_queue.cc:237] T 44bde925b2e541b69890d70715b85176 P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:37.763501  6806 raft_consensus.cc:1275] T f09c2a98de1a4decabd0ff900dd44caa P b7ab4784c7344b939bc36f639286f377 [term 2 FOLLOWER]: Refusing update from remote peer cd75a17ab2604397adab03bb8b5fd75c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:18:37.763553  6844 leader_election.cc:304] T fe20b4b48823486ca3b9c648db6ce8aa P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:18:37.753744  6723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90d42e216d9741e190bca19a781291fd" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:18:37.766971  6770 leader_election.cc:304] T f58dc08b12a2494bb9a1372837970ca2 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
I20260709 13:18:37.767480  6805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24ee15416e3145beaa1b8183453729a3" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:18:37.726120  7967 raft_consensus.cc:3060] T be1a92657f494cac8dd227d152f50151 P b7ab4784c7344b939bc36f639286f377 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:37.768142  6805 raft_consensus.cc:2468] T 24ee15416e3145beaa1b8183453729a3 P b7ab4784c7344b939bc36f639286f377 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 1.
I20260709 13:18:37.736224  7914 raft_consensus.cc:493] T 30e88460611e47b2ba16a46a30b5f416 P b7ab4784c7344b939bc36f639286f377 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:37.774196  7914 raft_consensus.cc:515] T 30e88460611e47b2ba16a46a30b5f416 P b7ab4784c7344b939bc36f639286f377 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:37.776901  7914 leader_election.cc:290] T 30e88460611e47b2ba16a46a30b5f416 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:18:37.777562  7914 raft_consensus.cc:493] T f5be3a11b23d4ea9b08300a2789821c7 P b7ab4784c7344b939bc36f639286f377 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader cd75a17ab2604397adab03bb8b5fd75c)
I20260709 13:18:37.720259  7868 raft_consensus.cc:515] T 07a92dd554674067a83a9cb68c4773f2 P b7ab4784c7344b939bc36f639286f377 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:37.780759  7868 leader_election.cc:290] T 07a92dd554674067a83a9cb68c4773f2 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:18:37.781378  7868 raft_consensus.cc:493] T c4db81d9d329422bb3b4160ca4ac2d1d P b7ab4784c7344b939bc36f639286f377 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:18:37.781940  7868 raft_consensus.cc:515] T c4db81d9d329422bb3b4160ca4ac2d1d P b7ab4784c7344b939bc36f639286f377 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:37.727061  7894 raft_consensus.cc:515] T 07a92dd554674067a83a9cb68c4773f2 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:37.778117  7914 raft_consensus.cc:515] T f5be3a11b23d4ea9b08300a2789821c7 P b7ab4784c7344b939bc36f639286f377 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:37.745402  7501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17587d6730594da4a56fa13a353232a1" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb"
I20260709 13:18:37.720633  7958 raft_consensus.cc:515] T f3f9c2e2bf644115957398fe4c9459db P b7ab4784c7344b939bc36f639286f377 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:37.801904  6876 raft_consensus.cc:2468] T ce4f062dcd314d43a63ca74067cb5ee3 P cd75a17ab2604397adab03bb8b5fd75c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 3.
I20260709 13:18:37.721277  7968 raft_consensus.cc:515] T 2c240553ce044eedb41541d72b9475d7 P b7ab4784c7344b939bc36f639286f377 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
W20260709 13:18:37.793462  7972 log.cc:927] Time spent T 30e88460611e47b2ba16a46a30b5f416 P cd75a17ab2604397adab03bb8b5fd75c: Append to log took a long time: real 0.104s	user 0.000s	sys 0.000s
W20260709 13:18:37.769943  7897 consensus_meta.cc:287] T 1528ab62b6fe4e3099d08f141afee116 P ccd8a4c3bfe3413cb2ae219b09aea832: Time spent flushing consensus metadata: real 0.586s	user 0.004s	sys 0.010s
W20260709 13:18:37.792758  7966 log.cc:927] Time spent T f3f9c2e2bf644115957398fe4c9459db P cd75a17ab2604397adab03bb8b5fd75c: Append to log took a long time: real 0.105s	user 0.000s	sys 0.001s
I20260709 13:18:37.795660  6724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1528ab62b6fe4e3099d08f141afee116" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:18:37.815059  7868 leader_election.cc:290] T c4db81d9d329422bb3b4160ca4ac2d1d P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:18:37.746985  7956 raft_consensus.cc:3060] T 9e326172347f45e99a0d482b5d8ef768 P b7ab4784c7344b939bc36f639286f377 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:37.788360  7975 consensus_queue.cc:1048] T 9b3759de40694069b13c0f8bd40e5709 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.050s
I20260709 13:18:37.817111  7914 leader_election.cc:290] T f5be3a11b23d4ea9b08300a2789821c7 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:18:37.765177  6801 raft_consensus.cc:2468] T de3186201e1a40d0b335eeb8b4e256e0 P b7ab4784c7344b939bc36f639286f377 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 2.
I20260709 13:18:37.833207  7949 leader_election.cc:290] T a1704639a875409b9959353527b3fd68 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:18:37.834149  7949 raft_consensus.cc:2749] T 3d65025eea89441290d85dd053810e31 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:37.836450  7500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ba5dac66ab5497e9e336f2a3c28cda5" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
W20260709 13:18:37.838554  6727 consensus_meta.cc:287] T 713b5728a197487c9300b310ab94e5a3 P ccd8a4c3bfe3413cb2ae219b09aea832: Time spent flushing consensus metadata: real 0.540s	user 0.013s	sys 0.000s
I20260709 13:18:37.839056  6727 raft_consensus.cc:2468] T 713b5728a197487c9300b310ab94e5a3 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 2.
I20260709 13:18:37.796233  7499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8cee0accdb8499c86d4414b72565a38" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:18:37.817638  7960 raft_consensus.cc:3055] T 7ba5dac66ab5497e9e336f2a3c28cda5 P cd75a17ab2604397adab03bb8b5fd75c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:18:37.766763  7883 raft_consensus.cc:515] T a1704639a875409b9959353527b3fd68 P b7ab4784c7344b939bc36f639286f377 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:37.752446  7948 raft_consensus.cc:515] T 7c44c4849aa54f2b94d1f1bef9ed546f P ccd8a4c3bfe3413cb2ae219b09aea832 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:37.821393  7501 raft_consensus.cc:3060] T 17587d6730594da4a56fa13a353232a1 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:37.769207  7936 raft_consensus.cc:515] T 24ee15416e3145beaa1b8183453729a3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } attrs { replace: true } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:18:37.846498  7960 raft_consensus.cc:740] T 7ba5dac66ab5497e9e336f2a3c28cda5 P cd75a17ab2604397adab03bb8b5fd75c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: cd75a17ab2604397adab03bb8b5fd75c, State: Running, Role: LEADER
I20260709 13:18:37.848611  7914 raft_consensus.cc:2804] T f58dc08b12a2494bb9a1372837970ca2 P b7ab4784c7344b939bc36f639286f377 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:18:37.852735  7503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24ee15416e3145beaa1b8183453729a3" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
W20260709 13:18:37.846683  6729 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49998 (request call id 367) took 1498 ms (client timeout 1839 ms). Trace:
W20260709 13:18:37.845057  7946 consensus_meta.cc:287] T be1a92657f494cac8dd227d152f50151 P 7ba59cc884714e8aa5f3f0ecaed84cbb: Time spent flushing consensus metadata: real 0.548s	user 0.007s	sys 0.007s
I20260709 13:18:37.789640  7981 raft_consensus.cc:493] T dbdf895bba214ff68685a24fd17dfb5d P b7ab4784c7344b939bc36f639286f377 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:18:37.862519  6807 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:32976 (request call id 1748) took 1118 ms. Trace:
I20260709 13:18:37.864444  6879 raft_consensus.cc:2468] T d8cee0accdb8499c86d4414b72565a38 P cd75a17ab2604397adab03bb8b5fd75c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in term 2.
I20260709 13:18:37.866019  7500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce4f062dcd314d43a63ca74067cb5ee3" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb"
W20260709 13:18:37.864298  6729 rpcz_store.cc:269] 0709 13:18:36.343929 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:36.715709 (+371780us) service_pool.cc:224] Handling call
0709 13:18:37.841818 (+1126109us) spinlock_profiling.cc:243] Waited 456 ms on lock 0x7b540008e154. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f9ae2fa 00007fcc1496fb17 00007fcc0deea6d4 00007fcc0deea662 00007fcc0deea591 00007fcc0deea50c 00007fcc0dee97c2 00007fcc0dce548c 00007fcc0dce48c6 00007fcc0dce426f
0709 13:18:37.841948 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1049190144}
I20260709 13:18:37.872108  7500 raft_consensus.cc:3060] T ce4f062dcd314d43a63ca74067cb5ee3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 1 LEARNER]: Advancing to term 3
I20260709 13:18:37.871634  6807 rpcz_store.cc:276] 0709 13:18:36.740520 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:36.741594 (+  1074us) service_pool.cc:224] Handling call
0709 13:18:36.752884 (+ 11290us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:37.129953 (+377069us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:37.858577 (+728624us) spinlock_profiling.cc:243] Waited 376 ms on lock 0x7b54001d1fd4. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f9aae01 00007fcc0f9a983e 00007fcc1496e419 00007fcc0dee5bd4 00007fcc0dee5b62 00007fcc0dee5a91 00007fcc0dee5a0c 00007fcc0dee4cc2 00007fcc0dce548c 00007fcc0dce48c6
0709 13:18:37.858821 (+   244us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":865479552}
I20260709 13:18:37.862869  7498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1528ab62b6fe4e3099d08f141afee116" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:18:37.857124  7941 leader_election.cc:290] T 427c124d773f483294511e80fe340075 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:18:37.861155  7907 raft_consensus.cc:2804] T 7887766dc6784fcaa42b35c05fea7a99 P cd75a17ab2604397adab03bb8b5fd75c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:18:37.856585  7499 raft_consensus.cc:2468] T d8cee0accdb8499c86d4414b72565a38 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 2.
I20260709 13:18:37.888499  7503 raft_consensus.cc:2468] T 24ee15416e3145beaa1b8183453729a3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 1.
I20260709 13:18:37.867717  7911 raft_consensus.cc:2749] T fe20b4b48823486ca3b9c648db6ce8aa P cd75a17ab2604397adab03bb8b5fd75c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:37.889142  7960 consensus_queue.cc:260] T 7ba5dac66ab5497e9e336f2a3c28cda5 P cd75a17ab2604397adab03bb8b5fd75c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:18:37.906203  6732 raft_consensus.cc:2468] T 1528ab62b6fe4e3099d08f141afee116 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 2.
I20260709 13:18:37.864199  7877 leader_election.cc:290] T dbdf895bba214ff68685a24fd17dfb5d P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:18:37.894505  7500 raft_consensus.cc:2468] T ce4f062dcd314d43a63ca74067cb5ee3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 3 LEARNER]: Leader election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 3.
I20260709 13:18:37.891070  7943 raft_consensus.cc:515] T e77e330a82df4b43a745d57a68f6f057 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } }
I20260709 13:18:37.897192  7968 leader_election.cc:290] T 2c240553ce044eedb41541d72b9475d7 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:18:37.897543  7894 leader_election.cc:290] T 07a92dd554674067a83a9cb68c4773f2 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:18:37.863605  7914 raft_consensus.cc:493] T f58dc08b12a2494bb9a1372837970ca2 P b7ab4784c7344b939bc36f639286f377 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:37.883387  7981 raft_consensus.cc:515] T dbdf895bba214ff68685a24fd17dfb5d P b7ab4784c7344b939bc36f639286f377 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:37.877211  7946 raft_consensus.cc:515] T be1a92657f494cac8dd227d152f50151 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:18:37.905700  7907 raft_consensus.cc:697] T 7887766dc6784fcaa42b35c05fea7a99 P cd75a17ab2604397adab03bb8b5fd75c [term 2 LEADER]: Becoming Leader. State: Replica: cd75a17ab2604397adab03bb8b5fd75c, State: Running, Role: LEADER
I20260709 13:18:37.926205  7914 raft_consensus.cc:3060] T f58dc08b12a2494bb9a1372837970ca2 P b7ab4784c7344b939bc36f639286f377 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:37.966290  6731 raft_consensus.cc:2468] T 3a485a995abc4807b6e511e45419f737 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 3.
I20260709 13:18:37.908342  7498 raft_consensus.cc:2468] T 1528ab62b6fe4e3099d08f141afee116 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 1.
I20260709 13:18:37.937301  7961 leader_election.cc:290] T d8292e16e5654be6bc408560cf256aaa P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
W20260709 13:18:37.973109  7965 consensus_meta.cc:287] T 404190ce4ce94cecbfcb6ea9d1dd8626 P b7ab4784c7344b939bc36f639286f377: Time spent flushing consensus metadata: real 0.675s	user 0.012s	sys 0.002s
I20260709 13:18:37.972659  7960 raft_consensus.cc:3060] T 7ba5dac66ab5497e9e336f2a3c28cda5 P cd75a17ab2604397adab03bb8b5fd75c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:37.978688  7886 raft_consensus.cc:697] T b56bf91d90824c959e21e0cee5ba1816 P cd75a17ab2604397adab03bb8b5fd75c [term 2 LEADER]: Becoming Leader. State: Replica: cd75a17ab2604397adab03bb8b5fd75c, State: Running, Role: LEADER
I20260709 13:18:38.007920  7984 raft_consensus.cc:493] T d8292e16e5654be6bc408560cf256aaa P cd75a17ab2604397adab03bb8b5fd75c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:18:38.008759  7970 raft_consensus.cc:493] T bb3d8792045a4583ae2e965b1350a5b4 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:38.034150  6697 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 320293us
I20260709 13:18:38.034966  6697 leader_election.cc:304] T a3022224cc81473690653a83d4e99470 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377
I20260709 13:18:38.030470  7901 leader_election.cc:290] T 2c240553ce044eedb41541d72b9475d7 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
W20260709 13:18:38.032359  6725 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49998 (request call id 357) took 2020 ms (client timeout 1747 ms). Trace:
I20260709 13:18:37.997558  7958 leader_election.cc:290] T f3f9c2e2bf644115957398fe4c9459db P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
W20260709 13:18:38.043370  7939 consensus_meta.cc:287] T 404190ce4ce94cecbfcb6ea9d1dd8626 P 7ba59cc884714e8aa5f3f0ecaed84cbb: Time spent flushing consensus metadata: real 0.585s	user 0.013s	sys 0.000s
I20260709 13:18:38.045933  7939 raft_consensus.cc:515] T 404190ce4ce94cecbfcb6ea9d1dd8626 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
W20260709 13:18:38.040383  7885 consensus_meta.cc:287] T 90d42e216d9741e190bca19a781291fd P ccd8a4c3bfe3413cb2ae219b09aea832: Time spent flushing consensus metadata: real 0.507s	user 0.004s	sys 0.008s
I20260709 13:18:38.058871  6731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24ee15416e3145beaa1b8183453729a3" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:18:38.059733  6731 raft_consensus.cc:2393] T 24ee15416e3145beaa1b8183453729a3 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in current term 2: Already voted for candidate cd75a17ab2604397adab03bb8b5fd75c in this term.
W20260709 13:18:38.062461  6770 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 295586us
W20260709 13:18:38.071792  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 308359us
I20260709 13:18:38.057088  7932 raft_consensus.cc:2804] T a3022224cc81473690653a83d4e99470 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:18:38.049573  7948 leader_election.cc:290] T 7c44c4849aa54f2b94d1f1bef9ed546f P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:18:38.049204  7883 leader_election.cc:290] T a1704639a875409b9959353527b3fd68 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:18:38.061578  7853 raft_consensus.cc:515] T d33d5ee8ef6f415593d8df52063161ad P b7ab4784c7344b939bc36f639286f377 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:38.076545  6731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "404190ce4ce94cecbfcb6ea9d1dd8626" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:18:38.001387  7965 raft_consensus.cc:515] T 404190ce4ce94cecbfcb6ea9d1dd8626 P b7ab4784c7344b939bc36f639286f377 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
W20260709 13:18:38.104489  7964 log.cc:927] Time spent T ab432e62819d499eaaf3dd55481dd930 P cd75a17ab2604397adab03bb8b5fd75c: Append to log took a long time: real 0.749s	user 0.004s	sys 0.004s
I20260709 13:18:38.084172  6729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30e88460611e47b2ba16a46a30b5f416" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:18:38.099771  6844 leader_election.cc:304] T 24ee15416e3145beaa1b8183453729a3 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:18:38.085150  6724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a92dd554674067a83a9cb68c4773f2" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:18:38.086894  6728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4db81d9d329422bb3b4160ca4ac2d1d" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:18:38.108418  6728 raft_consensus.cc:2393] T c4db81d9d329422bb3b4160ca4ac2d1d P ccd8a4c3bfe3413cb2ae219b09aea832 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7ab4784c7344b939bc36f639286f377 in current term 2: Already voted for candidate cd75a17ab2604397adab03bb8b5fd75c in this term.
I20260709 13:18:38.088838  6627 catalog_manager.cc:5697] T 1528ab62b6fe4e3099d08f141afee116 P 7ba59cc884714e8aa5f3f0ecaed84cbb reported cstate change: config changed from index 2 to 3, 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } attrs { replace: true } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } } }
I20260709 13:18:38.102524  7857 raft_consensus.cc:493] T f03d0dbf16864ca4bc1bb5e4c0334c0f P ccd8a4c3bfe3413cb2ae219b09aea832 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:38.100137  6730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be1a92657f494cac8dd227d152f50151" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:18:38.085574  6770 leader_election.cc:304] T 3a485a995abc4807b6e511e45419f737 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
I20260709 13:18:38.102586  6731 raft_consensus.cc:3060] T 404190ce4ce94cecbfcb6ea9d1dd8626 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:38.113744  6844 leader_election.cc:304] T 22ccee1b570c4ad3a57bd7aec085b1b4 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377
I20260709 13:18:38.114807  7981 leader_election.cc:290] T dbdf895bba214ff68685a24fd17dfb5d P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:18:38.108916  6729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c240553ce044eedb41541d72b9475d7" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:18:38.116537  6729 raft_consensus.cc:2468] T 2c240553ce044eedb41541d72b9475d7 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 2.
I20260709 13:18:38.071312  7953 raft_consensus.cc:697] T e31b9971c15848dea59d4d4130141d9e P cd75a17ab2604397adab03bb8b5fd75c [term 2 LEADER]: Becoming Leader. State: Replica: cd75a17ab2604397adab03bb8b5fd75c, State: Running, Role: LEADER
I20260709 13:18:38.068980  7961 raft_consensus.cc:493] T 22ccee1b570c4ad3a57bd7aec085b1b4 P b7ab4784c7344b939bc36f639286f377 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:18:38.065515  7958 raft_consensus.cc:493] T 4f00a2e87e56452083b759f60d461ee3 P b7ab4784c7344b939bc36f639286f377 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader cd75a17ab2604397adab03bb8b5fd75c)
I20260709 13:18:38.040056  7907 consensus_queue.cc:237] T 7887766dc6784fcaa42b35c05fea7a99 P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
W20260709 13:18:38.112370  7930 consensus_meta.cc:287] T d33d5ee8ef6f415593d8df52063161ad P ccd8a4c3bfe3413cb2ae219b09aea832: Time spent flushing consensus metadata: real 0.710s	user 0.009s	sys 0.006s
I20260709 13:18:38.061501  7885 raft_consensus.cc:515] T 90d42e216d9741e190bca19a781291fd P ccd8a4c3bfe3413cb2ae219b09aea832 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:38.119089  6729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1704639a875409b9959353527b3fd68" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:18:38.098332  7897 raft_consensus.cc:493] T 95a75bfe094d4bdc963aba3f08dfcd25 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:38.198437  6729 raft_consensus.cc:2468] T a1704639a875409b9959353527b3fd68 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 2.
I20260709 13:18:38.123418  7894 raft_consensus.cc:493] T 20f6842e26174571996b8dea4151d4be P ccd8a4c3bfe3413cb2ae219b09aea832 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:38.126441  7990 raft_consensus.cc:2804] T 3a485a995abc4807b6e511e45419f737 P b7ab4784c7344b939bc36f639286f377 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:18:38.123549  7877 raft_consensus.cc:493] T ab432e62819d499eaaf3dd55481dd930 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:38.179554  7920 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.541s	user 0.008s	sys 0.023s
I20260709 13:18:38.116144  7943 leader_election.cc:290] T e77e330a82df4b43a745d57a68f6f057 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 4 election: Requested vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:18:38.122072  6770 leader_election.cc:304] T 2c240553ce044eedb41541d72b9475d7 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
I20260709 13:18:38.127946  6805 raft_consensus.cc:1240] T 7ba5dac66ab5497e9e336f2a3c28cda5 P b7ab4784c7344b939bc36f639286f377 [term 2 FOLLOWER]: Rejecting Update request from peer cd75a17ab2604397adab03bb8b5fd75c for earlier term 1. Current term is 2. Ops: []
I20260709 13:18:38.123117  7939 leader_election.cc:290] T 404190ce4ce94cecbfcb6ea9d1dd8626 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 3 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:18:38.112394  7932 raft_consensus.cc:697] T a3022224cc81473690653a83d4e99470 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 2 LEADER]: Becoming Leader. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
I20260709 13:18:38.101697  7986 consensus_queue.cc:1048] T f09c2a98de1a4decabd0ff900dd44caa P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Connected to new peer: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.156s
I20260709 13:18:38.183869  7911 raft_consensus.cc:2804] T 22ccee1b570c4ad3a57bd7aec085b1b4 P cd75a17ab2604397adab03bb8b5fd75c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:18:38.202148  7853 leader_election.cc:290] T d33d5ee8ef6f415593d8df52063161ad P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 3 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
W20260709 13:18:38.252404  6847 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:38.182483  7958 raft_consensus.cc:515] T 4f00a2e87e56452083b759f60d461ee3 P b7ab4784c7344b939bc36f639286f377 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:18:38.123760  7948 raft_consensus.cc:493] T f09c2a98de1a4decabd0ff900dd44caa P ccd8a4c3bfe3413cb2ae219b09aea832 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:38.298432  7501 raft_consensus.cc:2468] T 17587d6730594da4a56fa13a353232a1 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 4.
I20260709 13:18:38.298926  7948 raft_consensus.cc:515] T f09c2a98de1a4decabd0ff900dd44caa P ccd8a4c3bfe3413cb2ae219b09aea832 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:38.301330  7885 leader_election.cc:290] T 90d42e216d9741e190bca19a781291fd P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 3 election: Requested vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:18:38.301471  7948 leader_election.cc:290] T f09c2a98de1a4decabd0ff900dd44caa P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:18:38.122220  7934 raft_consensus.cc:493] T 34f36d59d88f40fe8a2805e604fc6c0a P cd75a17ab2604397adab03bb8b5fd75c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:18:38.129249  7892 raft_consensus.cc:493] T 7a734b5ab7834e05a8c422208acc58b1 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:38.304286  7996 raft_consensus.cc:493] T b56bf91d90824c959e21e0cee5ba1816 P b7ab4784c7344b939bc36f639286f377 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:38.304355  7892 raft_consensus.cc:515] T 7a734b5ab7834e05a8c422208acc58b1 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:38.248863  7894 raft_consensus.cc:515] T 20f6842e26174571996b8dea4151d4be P ccd8a4c3bfe3413cb2ae219b09aea832 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:38.121454  7981 raft_consensus.cc:493] T e31b9971c15848dea59d4d4130141d9e P b7ab4784c7344b939bc36f639286f377 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:18:38.305096  7996 raft_consensus.cc:515] T b56bf91d90824c959e21e0cee5ba1816 P b7ab4784c7344b939bc36f639286f377 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:38.179678  7941 raft_consensus.cc:493] T 44bde925b2e541b69890d70715b85176 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:38.138146  7883 raft_consensus.cc:493] T f09c2a98de1a4decabd0ff900dd44caa P b7ab4784c7344b939bc36f639286f377 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:38.181274  7940 consensus_meta.cc:287] T bd6869f07b5a4885a0b99fbe60c3b175 P ccd8a4c3bfe3413cb2ae219b09aea832: Time spent flushing consensus metadata: real 0.599s	user 0.008s	sys 0.006s
I20260709 13:18:38.111857  7857 raft_consensus.cc:515] T f03d0dbf16864ca4bc1bb5e4c0334c0f P ccd8a4c3bfe3413cb2ae219b09aea832 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:38.129987  7946 leader_election.cc:290] T be1a92657f494cac8dd227d152f50151 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 3 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:18:38.198228  7868 raft_consensus.cc:493] T 7a734b5ab7834e05a8c422208acc58b1 P b7ab4784c7344b939bc36f639286f377 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:18:38.100363  7922 consensus_queue.cc:1048] T 20f6842e26174571996b8dea4151d4be P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Connected to new peer: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.031s
I20260709 13:18:38.251530  7962 raft_consensus.cc:493] T 44bde925b2e541b69890d70715b85176 P b7ab4784c7344b939bc36f639286f377 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:38.199106  7968 raft_consensus.cc:493] T 4d9def8b32fd443aa94ab1420b06837b P b7ab4784c7344b939bc36f639286f377 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:18:38.102857  7886 consensus_queue.cc:237] T b56bf91d90824c959e21e0cee5ba1816 P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:38.070513  7970 raft_consensus.cc:515] T bb3d8792045a4583ae2e965b1350a5b4 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:18:38.057538  7984 raft_consensus.cc:515] T d8292e16e5654be6bc408560cf256aaa P cd75a17ab2604397adab03bb8b5fd75c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:38.264720  7920 raft_consensus.cc:697] T 711ef6523deb4cbe8ef2ba61e1c21c98 P cd75a17ab2604397adab03bb8b5fd75c [term 2 LEADER]: Becoming Leader. State: Replica: cd75a17ab2604397adab03bb8b5fd75c, State: Running, Role: LEADER
I20260709 13:18:38.271937  7936 leader_election.cc:290] T 24ee15416e3145beaa1b8183453729a3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:18:38.269315  7980 raft_consensus.cc:493] T 713b5728a197487c9300b310ab94e5a3 P b7ab4784c7344b939bc36f639286f377 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:18:38.330022  7868 raft_consensus.cc:515] T 7a734b5ab7834e05a8c422208acc58b1 P b7ab4784c7344b939bc36f639286f377 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:38.293079  7911 raft_consensus.cc:697] T 22ccee1b570c4ad3a57bd7aec085b1b4 P cd75a17ab2604397adab03bb8b5fd75c [term 2 LEADER]: Becoming Leader. State: Replica: cd75a17ab2604397adab03bb8b5fd75c, State: Running, Role: LEADER
I20260709 13:18:38.128489  7961 raft_consensus.cc:515] T 22ccee1b570c4ad3a57bd7aec085b1b4 P b7ab4784c7344b939bc36f639286f377 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:38.288360  7991 raft_consensus.cc:493] T 853ac0a8cbd64ce99457f170216d4d0f P b7ab4784c7344b939bc36f639286f377 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:18:38.288435  7932 consensus_queue.cc:237] T a3022224cc81473690653a83d4e99470 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
W20260709 13:18:38.270341  7468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 140477us
I20260709 13:18:38.298287  7958 leader_election.cc:290] T 4f00a2e87e56452083b759f60d461ee3 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:18:38.299424  7498 raft_consensus.cc:1240] T 17587d6730594da4a56fa13a353232a1 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 4 FOLLOWER]: Rejecting Update request from peer ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 3. Current term is 4. Ops: [3.5-3.5]
I20260709 13:18:38.204756  7930 raft_consensus.cc:515] T d33d5ee8ef6f415593d8df52063161ad P ccd8a4c3bfe3413cb2ae219b09aea832 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:38.121491  7982 raft_consensus.cc:2749] T 24ee15416e3145beaa1b8183453729a3 P cd75a17ab2604397adab03bb8b5fd75c [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:18:38.291484  7965 leader_election.cc:290] T 404190ce4ce94cecbfcb6ea9d1dd8626 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 2 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:18:38.292783  7953 consensus_queue.cc:237] T e31b9971c15848dea59d4d4130141d9e P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:38.314467  7981 raft_consensus.cc:515] T e31b9971c15848dea59d4d4130141d9e P b7ab4784c7344b939bc36f639286f377 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:38.353271  7965 raft_consensus.cc:2804] T 2c240553ce044eedb41541d72b9475d7 P b7ab4784c7344b939bc36f639286f377 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:18:38.353693  7965 raft_consensus.cc:493] T 2c240553ce044eedb41541d72b9475d7 P b7ab4784c7344b939bc36f639286f377 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:38.354077  7965 raft_consensus.cc:3060] T 2c240553ce044eedb41541d72b9475d7 P b7ab4784c7344b939bc36f639286f377 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:38.354400  7468 leader_election.cc:304] T d8cee0accdb8499c86d4414b72565a38 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377
I20260709 13:18:38.354722  7981 leader_election.cc:290] T e31b9971c15848dea59d4d4130141d9e P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:18:38.204672  7897 raft_consensus.cc:515] T 95a75bfe094d4bdc963aba3f08dfcd25 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:38.270723  7877 raft_consensus.cc:515] T ab432e62819d499eaaf3dd55481dd930 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:38.302315  7934 raft_consensus.cc:515] T 34f36d59d88f40fe8a2805e604fc6c0a P cd75a17ab2604397adab03bb8b5fd75c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:38.322027  7940 raft_consensus.cc:515] T bd6869f07b5a4885a0b99fbe60c3b175 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:38.321321  7941 raft_consensus.cc:515] T 44bde925b2e541b69890d70715b85176 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:38.360818  7936 raft_consensus.cc:2804] T d8cee0accdb8499c86d4414b72565a38 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:18:38.365370  7936 raft_consensus.cc:697] T d8cee0accdb8499c86d4414b72565a38 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 2 LEADER]: Becoming Leader. State: Replica: 7ba59cc884714e8aa5f3f0ecaed84cbb, State: Running, Role: LEADER
I20260709 13:18:38.333693  7857 leader_election.cc:290] T f03d0dbf16864ca4bc1bb5e4c0334c0f P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:18:38.333904  7996 leader_election.cc:290] T b56bf91d90824c959e21e0cee5ba1816 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:18:38.327375  7853 raft_consensus.cc:493] T 95a75bfe094d4bdc963aba3f08dfcd25 P b7ab4784c7344b939bc36f639286f377 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:38.320286  7883 raft_consensus.cc:515] T f09c2a98de1a4decabd0ff900dd44caa P b7ab4784c7344b939bc36f639286f377 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:38.343725  7911 consensus_queue.cc:237] T 22ccee1b570c4ad3a57bd7aec085b1b4 P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:38.340662  7892 leader_election.cc:290] T 7a734b5ab7834e05a8c422208acc58b1 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:18:38.348690  7991 raft_consensus.cc:515] T 853ac0a8cbd64ce99457f170216d4d0f P b7ab4784c7344b939bc36f639286f377 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:38.338063  7980 raft_consensus.cc:515] T 713b5728a197487c9300b310ab94e5a3 P b7ab4784c7344b939bc36f639286f377 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:38.357548  7970 leader_election.cc:290] T bb3d8792045a4583ae2e965b1350a5b4 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:18:38.341691  7962 raft_consensus.cc:515] T 44bde925b2e541b69890d70715b85176 P b7ab4784c7344b939bc36f639286f377 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:38.365489  7941 leader_election.cc:290] T 44bde925b2e541b69890d70715b85176 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:18:38.329556  7968 raft_consensus.cc:515] T 4d9def8b32fd443aa94ab1420b06837b P b7ab4784c7344b939bc36f639286f377 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:38.371937  7984 leader_election.cc:290] T d8292e16e5654be6bc408560cf256aaa P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:18:38.359899  7961 leader_election.cc:290] T 22ccee1b570c4ad3a57bd7aec085b1b4 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
W20260709 13:18:38.367295  7967 consensus_meta.cc:287] T be1a92657f494cac8dd227d152f50151 P b7ab4784c7344b939bc36f639286f377: Time spent flushing consensus metadata: real 0.569s	user 0.007s	sys 0.006s
I20260709 13:18:38.379590  7967 raft_consensus.cc:515] T be1a92657f494cac8dd227d152f50151 P b7ab4784c7344b939bc36f639286f377 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:18:38.387228  7968 leader_election.cc:290] T 4d9def8b32fd443aa94ab1420b06837b P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:18:38.389007  7991 leader_election.cc:290] T 853ac0a8cbd64ce99457f170216d4d0f P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:18:38.380201  7980 leader_election.cc:290] T 713b5728a197487c9300b310ab94e5a3 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
W20260709 13:18:38.199887  6695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 473901us
W20260709 13:18:38.179877  6697 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.68:45071, user_credentials={real_user=slave}} blocked reactor thread for 49730.5us
W20260709 13:18:38.041343  6725 rpcz_store.cc:269] 0709 13:18:36.012143 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:36.179521 (+167378us) service_pool.cc:224] Handling call
0709 13:18:36.296025 (+116504us) spinlock_profiling.cc:243] Waited 3.39 ms on lock 0x7b5800000c98. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0c745db1 00007fcc0c885b71 00007fcc0c885a22 00007fcc1579ec09 00007fcc148f8ee0 00007fcc149c20ab 00007fcc149c2131 00007fcc149700a0 00007fcc1496f984 00007fcc0deea6d4 00007fcc0deea662
0709 13:18:38.032079 (+1736054us) spinlock_profiling.cc:243] Waited 949 ms on lock 0x7b54003e6554. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f9ae2fa 00007fcc1496fb17 00007fcc0deea6d4 00007fcc0deea662 00007fcc0deea591 00007fcc0deea50c 00007fcc0dee97c2 00007fcc0dce548c 00007fcc0dce48c6 00007fcc0dce426f
0709 13:18:38.032248 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2189694976}
I20260709 13:18:38.427368  6723 raft_consensus.cc:2393] T 90d42e216d9741e190bca19a781291fd P ccd8a4c3bfe3413cb2ae219b09aea832 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7ab4784c7344b939bc36f639286f377 in current term 3: Already voted for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in this term.
I20260709 13:18:38.123162  6731 raft_consensus.cc:2468] T 404190ce4ce94cecbfcb6ea9d1dd8626 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in term 3.
I20260709 13:18:38.109866  6724 raft_consensus.cc:2468] T 07a92dd554674067a83a9cb68c4773f2 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 2.
I20260709 13:18:38.125643  6728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5be3a11b23d4ea9b08300a2789821c7" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:18:38.248863  6729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbdf895bba214ff68685a24fd17dfb5d" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:18:38.429603  6731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8292e16e5654be6bc408560cf256aaa" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:18:38.430691  6731 raft_consensus.cc:2468] T d8292e16e5654be6bc408560cf256aaa P ccd8a4c3bfe3413cb2ae219b09aea832 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 2.
I20260709 13:18:38.430284  6729 raft_consensus.cc:2468] T dbdf895bba214ff68685a24fd17dfb5d P ccd8a4c3bfe3413cb2ae219b09aea832 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 2.
I20260709 13:18:38.433913  6729 raft_consensus.cc:1240] T 3a485a995abc4807b6e511e45419f737 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 3 FOLLOWER]: Rejecting Update request from peer cd75a17ab2604397adab03bb8b5fd75c for earlier term 2. Current term is 3. Ops: []
I20260709 13:18:38.435081  6731 raft_consensus.cc:1275] T 95a75bfe094d4bdc963aba3f08dfcd25 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 2 FOLLOWER]: Refusing update from remote peer cd75a17ab2604397adab03bb8b5fd75c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:18:38.426503  6725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d33d5ee8ef6f415593d8df52063161ad" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:18:38.121606  6730 raft_consensus.cc:3060] T be1a92657f494cac8dd227d152f50151 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:38.437026  6725 raft_consensus.cc:2393] T d33d5ee8ef6f415593d8df52063161ad P ccd8a4c3bfe3413cb2ae219b09aea832 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate b7ab4784c7344b939bc36f639286f377 in current term 3: Already voted for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in this term.
I20260709 13:18:38.430550  6728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3d8792045a4583ae2e965b1350a5b4" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:18:38.440810  6728 raft_consensus.cc:2468] T bb3d8792045a4583ae2e965b1350a5b4 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in term 2.
I20260709 13:18:38.451965  7466 leader_election.cc:304] T 404190ce4ce94cecbfcb6ea9d1dd8626 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
I20260709 13:18:38.454042  7466 leader_election.cc:304] T bb3d8792045a4583ae2e965b1350a5b4 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
I20260709 13:18:38.348760  7868 leader_election.cc:290] T 7a734b5ab7834e05a8c422208acc58b1 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
W20260709 13:18:38.352891  7835 consensus_meta.cc:287] T 4b8cacb381b746da8d0049b0a83b41dd P ccd8a4c3bfe3413cb2ae219b09aea832: Time spent flushing consensus metadata: real 0.774s	user 0.012s	sys 0.002s
I20260709 13:18:38.368824  7853 raft_consensus.cc:515] T 95a75bfe094d4bdc963aba3f08dfcd25 P b7ab4784c7344b939bc36f639286f377 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:38.369491  7894 leader_election.cc:290] T 20f6842e26174571996b8dea4151d4be P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:18:38.359894  7897 leader_election.cc:290] T 95a75bfe094d4bdc963aba3f08dfcd25 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:18:38.373297  7914 raft_consensus.cc:515] T f58dc08b12a2494bb9a1372837970ca2 P b7ab4784c7344b939bc36f639286f377 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:38.558615  7982 raft_consensus.cc:493] T f4b8bd455d5a47c18a1380839c6e0d61 P cd75a17ab2604397adab03bb8b5fd75c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:18:38.459153  7936 consensus_queue.cc:237] T d8cee0accdb8499c86d4414b72565a38 P 7ba59cc884714e8aa5f3f0ecaed84cbb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:18:38.373003  7920 consensus_queue.cc:237] T 711ef6523deb4cbe8ef2ba61e1c21c98 P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
W20260709 13:18:38.541707  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 420404us
I20260709 13:18:38.545094  7499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fa34c08b205435dba97346991aa1f92" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb"
W20260709 13:18:38.549822  6695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 101440us
I20260709 13:18:38.550442  7960 raft_consensus.cc:493] T 853ac0a8cbd64ce99457f170216d4d0f P cd75a17ab2604397adab03bb8b5fd75c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:18:38.564909  7914 leader_election.cc:290] T f58dc08b12a2494bb9a1372837970ca2 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 3 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:18:38.565651  7939 raft_consensus.cc:2804] T 404190ce4ce94cecbfcb6ea9d1dd8626 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:18:38.567409  7934 leader_election.cc:290] T 34f36d59d88f40fe8a2805e604fc6c0a P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:18:38.568589  7960 raft_consensus.cc:515] T 853ac0a8cbd64ce99457f170216d4d0f P cd75a17ab2604397adab03bb8b5fd75c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:38.580246  6695 leader_election.cc:304] T de3186201e1a40d0b335eeb8b4e256e0 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
I20260709 13:18:38.582458  7499 raft_consensus.cc:3060] T 3fa34c08b205435dba97346991aa1f92 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:38.584194  7970 raft_consensus.cc:2804] T bb3d8792045a4583ae2e965b1350a5b4 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:18:38.584821  7970 raft_consensus.cc:493] T bb3d8792045a4583ae2e965b1350a5b4 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:38.585184  7970 raft_consensus.cc:3060] T bb3d8792045a4583ae2e965b1350a5b4 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:38.570307  7930 leader_election.cc:290] T d33d5ee8ef6f415593d8df52063161ad P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 3 election: Requested vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:18:38.560091  7982 raft_consensus.cc:515] T f4b8bd455d5a47c18a1380839c6e0d61 P cd75a17ab2604397adab03bb8b5fd75c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:38.571980  7835 raft_consensus.cc:515] T 4b8cacb381b746da8d0049b0a83b41dd P ccd8a4c3bfe3413cb2ae219b09aea832 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:18:38.560760  6730 raft_consensus.cc:2468] T be1a92657f494cac8dd227d152f50151 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in term 3.
I20260709 13:18:38.622895  7982 leader_election.cc:290] T f4b8bd455d5a47c18a1380839c6e0d61 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:18:38.633875  8003 raft_consensus.cc:493] T 427c124d773f483294511e80fe340075 P b7ab4784c7344b939bc36f639286f377 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader cd75a17ab2604397adab03bb8b5fd75c)
I20260709 13:18:38.635375  8003 raft_consensus.cc:515] T 427c124d773f483294511e80fe340075 P b7ab4784c7344b939bc36f639286f377 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } attrs { replace: true } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: NON_VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: true } }
I20260709 13:18:38.638691  8003 leader_election.cc:290] T 427c124d773f483294511e80fe340075 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
W20260709 13:18:38.571985  6727 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49998 (request call id 362) took 2387 ms (client timeout 2037 ms). Trace:
W20260709 13:18:38.641252  6697 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.68:45071, user_credentials={real_user=slave}} blocked reactor thread for 123941us
I20260709 13:18:38.660188  7939 raft_consensus.cc:697] T 404190ce4ce94cecbfcb6ea9d1dd8626 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 3 LEADER]: Becoming Leader. State: Replica: 7ba59cc884714e8aa5f3f0ecaed84cbb, State: Running, Role: LEADER
W20260709 13:18:38.671736  7917 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.824s	user 0.014s	sys 0.022s
W20260709 13:18:38.672241  7917 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.830s	user 0.014s	sys 0.022s
I20260709 13:18:38.672132  7960 leader_election.cc:290] T 853ac0a8cbd64ce99457f170216d4d0f P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
W20260709 13:18:38.662139  6770 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 479117us
W20260709 13:18:38.645404  6727 rpcz_store.cc:269] 0709 13:18:36.184088 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:36.257530 (+ 73442us) service_pool.cc:224] Handling call
0709 13:18:38.571257 (+2313727us) spinlock_profiling.cc:243] Waited 971 ms on lock 0x7b5400166f54. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f9ae2fa 00007fcc1496fb17 00007fcc0deea6d4 00007fcc0deea662 00007fcc0deea591 00007fcc0deea50c 00007fcc0dee97c2 00007fcc0dce548c 00007fcc0dce48c6 00007fcc0dce426f
0709 13:18:38.571639 (+   382us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2233120640}
I20260709 13:18:38.681342  7990 raft_consensus.cc:697] T 3a485a995abc4807b6e511e45419f737 P b7ab4784c7344b939bc36f639286f377 [term 3 LEADER]: Becoming Leader. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
I20260709 13:18:38.655733  7982 raft_consensus.cc:493] T 3fa34c08b205435dba97346991aa1f92 P cd75a17ab2604397adab03bb8b5fd75c [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:38.658645  7877 leader_election.cc:290] T ab432e62819d499eaaf3dd55481dd930 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:18:38.685170  6726 raft_consensus.cc:2368] T 4b8cacb381b746da8d0049b0a83b41dd P ccd8a4c3bfe3413cb2ae219b09aea832 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c for earlier term 2. Current term is 3.
I20260709 13:18:38.686906  6804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24ee15416e3145beaa1b8183453729a3" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:18:38.688522  6806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be1a92657f494cac8dd227d152f50151" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:18:38.679744  7958 raft_consensus.cc:493] T 7c44c4849aa54f2b94d1f1bef9ed546f P b7ab4784c7344b939bc36f639286f377 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader cd75a17ab2604397adab03bb8b5fd75c)
I20260709 13:18:38.687795  6805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "404190ce4ce94cecbfcb6ea9d1dd8626" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
W20260709 13:18:38.708319  6798 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.621s	user 0.004s	sys 0.013s
I20260709 13:18:38.708621  7853 leader_election.cc:290] T 95a75bfe094d4bdc963aba3f08dfcd25 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
W20260709 13:18:38.709029  6798 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.684s	user 0.005s	sys 0.013s
W20260709 13:18:38.686956  7956 consensus_meta.cc:287] T 9e326172347f45e99a0d482b5d8ef768 P b7ab4784c7344b939bc36f639286f377: Time spent flushing consensus metadata: real 0.846s	user 0.014s	sys 0.007s
I20260709 13:18:38.669701  7883 leader_election.cc:290] T f09c2a98de1a4decabd0ff900dd44caa P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:18:38.684587  7894 raft_consensus.cc:2804] T de3186201e1a40d0b335eeb8b4e256e0 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:18:38.716178  7894 raft_consensus.cc:493] T de3186201e1a40d0b335eeb8b4e256e0 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:38.716797  7894 raft_consensus.cc:3060] T de3186201e1a40d0b335eeb8b4e256e0 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:38.716262  6805 raft_consensus.cc:3060] T 404190ce4ce94cecbfcb6ea9d1dd8626 P b7ab4784c7344b939bc36f639286f377 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:38.670804  8003 raft_consensus.cc:493] T 711ef6523deb4cbe8ef2ba61e1c21c98 P b7ab4784c7344b939bc36f639286f377 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:18:38.672935  7939 consensus_queue.cc:237] T 404190ce4ce94cecbfcb6ea9d1dd8626 P 7ba59cc884714e8aa5f3f0ecaed84cbb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:18:38.678107  7897 raft_consensus.cc:493] T f5be3a11b23d4ea9b08300a2789821c7 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader cd75a17ab2604397adab03bb8b5fd75c)
I20260709 13:18:38.683986  7990 consensus_queue.cc:237] T 3a485a995abc4807b6e511e45419f737 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:38.731442  6730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "404190ce4ce94cecbfcb6ea9d1dd8626" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:18:38.732779  6730 raft_consensus.cc:2368] T 404190ce4ce94cecbfcb6ea9d1dd8626 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate b7ab4784c7344b939bc36f639286f377 for earlier term 2. Current term is 3.
I20260709 13:18:38.733251  6806 raft_consensus.cc:3060] T be1a92657f494cac8dd227d152f50151 P b7ab4784c7344b939bc36f639286f377 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:38.734329  6804 raft_consensus.cc:2468] T 24ee15416e3145beaa1b8183453729a3 P b7ab4784c7344b939bc36f639286f377 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in term 1.
I20260709 13:18:38.685968  7982 raft_consensus.cc:515] T 3fa34c08b205435dba97346991aa1f92 P cd75a17ab2604397adab03bb8b5fd75c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:18:38.736966  8004 raft_consensus.cc:493] T a3022224cc81473690653a83d4e99470 P b7ab4784c7344b939bc36f639286f377 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:38.741111  7967 leader_election.cc:290] T be1a92657f494cac8dd227d152f50151 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 2 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:18:38.741899  6872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30e88460611e47b2ba16a46a30b5f416" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:18:38.742427  7897 raft_consensus.cc:515] T f5be3a11b23d4ea9b08300a2789821c7 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:38.743510  6876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4db81d9d329422bb3b4160ca4ac2d1d" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:18:38.736985  7940 leader_election.cc:290] T bd6869f07b5a4885a0b99fbe60c3b175 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 4 election: Requested vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:18:38.744180  7958 raft_consensus.cc:515] T 7c44c4849aa54f2b94d1f1bef9ed546f P b7ab4784c7344b939bc36f639286f377 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:38.745741  6879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a92dd554674067a83a9cb68c4773f2" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:18:38.746832  6879 raft_consensus.cc:2393] T 07a92dd554674067a83a9cb68c4773f2 P cd75a17ab2604397adab03bb8b5fd75c [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7ab4784c7344b939bc36f639286f377 in current term 2: Already voted for candidate cd75a17ab2604397adab03bb8b5fd75c in this term.
I20260709 13:18:38.747162  6730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b56bf91d90824c959e21e0cee5ba1816" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:18:38.747982  6730 raft_consensus.cc:2468] T b56bf91d90824c959e21e0cee5ba1816 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 2.
I20260709 13:18:38.755125  7965 raft_consensus.cc:515] T 2c240553ce044eedb41541d72b9475d7 P b7ab4784c7344b939bc36f639286f377 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:38.756902  6800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbdf895bba214ff68685a24fd17dfb5d" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:18:38.758064  7962 leader_election.cc:290] T 44bde925b2e541b69890d70715b85176 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:18:38.758502  7970 raft_consensus.cc:515] T bb3d8792045a4583ae2e965b1350a5b4 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
W20260709 13:18:38.761864  7973 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.522s	user 0.014s	sys 0.055s
I20260709 13:18:38.762040  8006 raft_consensus.cc:493] T ab432e62819d499eaaf3dd55481dd930 P b7ab4784c7344b939bc36f639286f377 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:38.774201  6800 raft_consensus.cc:2468] T dbdf895bba214ff68685a24fd17dfb5d P b7ab4784c7344b939bc36f639286f377 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 1.
I20260709 13:18:38.774493  6730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a734b5ab7834e05a8c422208acc58b1" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:18:38.763221  6723 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50004 (request call id 942) took 1143 ms. Trace:
I20260709 13:18:38.737119  7993 consensus_queue.cc:1059] T 17587d6730594da4a56fa13a353232a1 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.095s
I20260709 13:18:38.768545  8003 raft_consensus.cc:515] T 711ef6523deb4cbe8ef2ba61e1c21c98 P b7ab4784c7344b939bc36f639286f377 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:38.769341  7502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "404190ce4ce94cecbfcb6ea9d1dd8626" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb"
I20260709 13:18:38.776031  6723 rpcz_store.cc:276] 0709 13:18:37.619755 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:37.753409 (+133654us) service_pool.cc:224] Handling call
0709 13:18:38.762963 (+1009554us) spinlock_profiling.cc:243] Waited 660 ms on lock 0x7b54000e4054. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f9ae2fa 00007fcc1496fb17 00007fcc0deea6d4 00007fcc0deea662 00007fcc0deea591 00007fcc0deea50c 00007fcc0dee97c2 00007fcc0dce548c 00007fcc0dce48c6 00007fcc0dce426f
0709 13:18:38.763153 (+   190us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1517389696}
I20260709 13:18:38.775672  6730 raft_consensus.cc:2468] T 7a734b5ab7834e05a8c422208acc58b1 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 2.
I20260709 13:18:38.785801  6806 raft_consensus.cc:2468] T be1a92657f494cac8dd227d152f50151 P b7ab4784c7344b939bc36f639286f377 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in term 3.
I20260709 13:18:38.774593  7501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f00a2e87e56452083b759f60d461ee3" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:18:38.768559  7835 leader_election.cc:290] T 4b8cacb381b746da8d0049b0a83b41dd P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 3 election: Requested vote from peers cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:18:38.795677  6799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c240553ce044eedb41541d72b9475d7" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:18:38.801856  6799 raft_consensus.cc:2393] T 2c240553ce044eedb41541d72b9475d7 P b7ab4784c7344b939bc36f639286f377 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ccd8a4c3bfe3413cb2ae219b09aea832 in current term 3: Already voted for candidate b7ab4784c7344b939bc36f639286f377 in this term.
I20260709 13:18:38.803984  6799 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:32976 (request call id 1771) took 1160 ms. Trace:
I20260709 13:18:38.793606  6728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22ccee1b570c4ad3a57bd7aec085b1b4" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:18:38.793864  7993 raft_consensus.cc:3055] T 17587d6730594da4a56fa13a353232a1 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:18:38.787413  6727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e31b9971c15848dea59d4d4130141d9e" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:18:38.805364  7993 raft_consensus.cc:740] T 17587d6730594da4a56fa13a353232a1 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
I20260709 13:18:38.805501  7975 raft_consensus.cc:493] T 4d9def8b32fd443aa94ab1420b06837b P ccd8a4c3bfe3413cb2ae219b09aea832 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:38.805922  6727 raft_consensus.cc:2393] T e31b9971c15848dea59d4d4130141d9e P ccd8a4c3bfe3413cb2ae219b09aea832 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7ab4784c7344b939bc36f639286f377 in current term 2: Already voted for candidate cd75a17ab2604397adab03bb8b5fd75c in this term.
I20260709 13:18:38.808162  6804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "427c124d773f483294511e80fe340075" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:18:38.811223  6804 raft_consensus.cc:2468] T 427c124d773f483294511e80fe340075 P b7ab4784c7344b939bc36f639286f377 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 1.
I20260709 13:18:38.812670  6800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1704639a875409b9959353527b3fd68" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:18:38.807427  6799 rpcz_store.cc:276] 0709 13:18:37.643606 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:37.643756 (+   150us) service_pool.cc:224] Handling call
0709 13:18:38.795290 (+1151534us) spinlock_profiling.cc:243] Waited 3.41 ms on lock 0x7b5800003098. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0c745db1 00007fcc0c885b71 00007fcc0c885a22 00007fcc1579ec09 00007fcc148f8ee0 00007fcc149c20ab 00007fcc149c2131 00007fcc149700a0 00007fcc1496f984 00007fcc0deea6d4 00007fcc0deea662
0709 13:18:38.803890 (+  8600us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":7850240}
W20260709 13:18:38.815523  7466 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 229681us
I20260709 13:18:38.787381  8004 raft_consensus.cc:515] T a3022224cc81473690653a83d4e99470 P b7ab4784c7344b939bc36f639286f377 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:38.839519  6727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "713b5728a197487c9300b310ab94e5a3" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:18:38.840307  6872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5be3a11b23d4ea9b08300a2789821c7" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:18:38.840924  6727 raft_consensus.cc:2393] T 713b5728a197487c9300b310ab94e5a3 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7ab4784c7344b939bc36f639286f377 in current term 2: Already voted for candidate cd75a17ab2604397adab03bb8b5fd75c in this term.
I20260709 13:18:38.774988  8006 raft_consensus.cc:515] T ab432e62819d499eaaf3dd55481dd930 P b7ab4784c7344b939bc36f639286f377 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:38.738003  7956 raft_consensus.cc:515] T 9e326172347f45e99a0d482b5d8ef768 P b7ab4784c7344b939bc36f639286f377 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:38.806464  7975 raft_consensus.cc:515] T 4d9def8b32fd443aa94ab1420b06837b P ccd8a4c3bfe3413cb2ae219b09aea832 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:38.848704  8004 leader_election.cc:290] T a3022224cc81473690653a83d4e99470 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:18:38.855315  6728 raft_consensus.cc:2393] T 22ccee1b570c4ad3a57bd7aec085b1b4 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7ab4784c7344b939bc36f639286f377 in current term 2: Already voted for candidate cd75a17ab2604397adab03bb8b5fd75c in this term.
I20260709 13:18:38.806658  7993 consensus_queue.cc:260] T 17587d6730594da4a56fa13a353232a1 P ccd8a4c3bfe3413cb2ae219b09aea832 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:18:38.857900  7993 raft_consensus.cc:3060] T 17587d6730594da4a56fa13a353232a1 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:38.831054  6798 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:32976 (request call id 1757) took 1614 ms. Trace:
I20260709 13:18:38.867944  8005 raft_consensus.cc:493] T f03d0dbf16864ca4bc1bb5e4c0334c0f P b7ab4784c7344b939bc36f639286f377 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:18:38.869031  8005 raft_consensus.cc:515] T f03d0dbf16864ca4bc1bb5e4c0334c0f P b7ab4784c7344b939bc36f639286f377 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:38.879017  6804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a92dd554674067a83a9cb68c4773f2" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:18:38.876299  6723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d9def8b32fd443aa94ab1420b06837b" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:18:38.878095  6800 raft_consensus.cc:2468] T a1704639a875409b9959353527b3fd68 P b7ab4784c7344b939bc36f639286f377 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 2.
I20260709 13:18:38.889021  6723 raft_consensus.cc:2468] T 4d9def8b32fd443aa94ab1420b06837b P ccd8a4c3bfe3413cb2ae219b09aea832 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 2.
I20260709 13:18:38.893891  6872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c240553ce044eedb41541d72b9475d7" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:18:38.894654  6806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a734b5ab7834e05a8c422208acc58b1" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:18:38.894907  6872 raft_consensus.cc:2468] T 2c240553ce044eedb41541d72b9475d7 P cd75a17ab2604397adab03bb8b5fd75c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 2.
I20260709 13:18:38.895429  6806 raft_consensus.cc:2468] T 7a734b5ab7834e05a8c422208acc58b1 P b7ab4784c7344b939bc36f639286f377 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 1.
I20260709 13:18:38.907908  6725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f58dc08b12a2494bb9a1372837970ca2" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:18:38.908596  7958 leader_election.cc:290] T 7c44c4849aa54f2b94d1f1bef9ed546f P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:18:38.908924  6725 raft_consensus.cc:3060] T f58dc08b12a2494bb9a1372837970ca2 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:38.912014  7984 raft_consensus.cc:493] T 9b3759de40694069b13c0f8bd40e5709 P cd75a17ab2604397adab03bb8b5fd75c [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:38.912434  7953 raft_consensus.cc:493] T 07a92dd554674067a83a9cb68c4773f2 P cd75a17ab2604397adab03bb8b5fd75c [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:38.912807  7886 raft_consensus.cc:493] T a3022224cc81473690653a83d4e99470 P cd75a17ab2604397adab03bb8b5fd75c [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:38.913065  7953 raft_consensus.cc:515] T 07a92dd554674067a83a9cb68c4773f2 P cd75a17ab2604397adab03bb8b5fd75c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:38.913589  7886 raft_consensus.cc:515] T a3022224cc81473690653a83d4e99470 P cd75a17ab2604397adab03bb8b5fd75c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:38.911927  7994 raft_consensus.cc:493] T 1bf4668eeb70467fb3dc5a0289233b3c P cd75a17ab2604397adab03bb8b5fd75c [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:38.915190  7994 raft_consensus.cc:515] T 1bf4668eeb70467fb3dc5a0289233b3c P cd75a17ab2604397adab03bb8b5fd75c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:38.917563  6805 raft_consensus.cc:2468] T 404190ce4ce94cecbfcb6ea9d1dd8626 P b7ab4784c7344b939bc36f639286f377 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in term 3.
I20260709 13:18:38.915769  7953 leader_election.cc:290] T 07a92dd554674067a83a9cb68c4773f2 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
W20260709 13:18:38.904078  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 94563.1us
I20260709 13:18:38.912304  7891 raft_consensus.cc:493] T dbdf895bba214ff68685a24fd17dfb5d P cd75a17ab2604397adab03bb8b5fd75c [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:38.952445  6872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8292e16e5654be6bc408560cf256aaa" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:18:38.955655  6805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c44c4849aa54f2b94d1f1bef9ed546f" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:18:38.920351  7886 leader_election.cc:290] T a3022224cc81473690653a83d4e99470 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:18:38.945541  6772 leader_election.cc:304] T d8cee0accdb8499c86d4414b72565a38 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, b7ab4784c7344b939bc36f639286f377; no voters: 
I20260709 13:18:38.961737  6731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "427c124d773f483294511e80fe340075" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:18:38.963464  6731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a75bfe094d4bdc963aba3f08dfcd25" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:18:38.964195  6804 raft_consensus.cc:2468] T 07a92dd554674067a83a9cb68c4773f2 P b7ab4784c7344b939bc36f639286f377 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 1.
I20260709 13:18:38.964695  7503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b8cacb381b746da8d0049b0a83b41dd" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb"
I20260709 13:18:38.965574  7503 raft_consensus.cc:3060] T 4b8cacb381b746da8d0049b0a83b41dd P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:38.965754  6804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09c2a98de1a4decabd0ff900dd44caa" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:18:38.966683  6804 raft_consensus.cc:2468] T f09c2a98de1a4decabd0ff900dd44caa P b7ab4784c7344b939bc36f639286f377 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 2.
I20260709 13:18:38.967155  6726 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49998 (request call id 371) took 1446 ms. Trace:
I20260709 13:18:38.959895  6800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77e330a82df4b43a745d57a68f6f057" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:18:38.967653  6804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f03d0dbf16864ca4bc1bb5e4c0334c0f" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:18:38.964562  6879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f9c2e2bf644115957398fe4c9459db" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:18:38.975931  6804 raft_consensus.cc:2468] T f03d0dbf16864ca4bc1bb5e4c0334c0f P b7ab4784c7344b939bc36f639286f377 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 1.
I20260709 13:18:38.979158  6731 raft_consensus.cc:2468] T 95a75bfe094d4bdc963aba3f08dfcd25 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 2.
I20260709 13:18:38.967607  6726 rpcz_store.cc:276] 0709 13:18:37.520939 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:37.530549 (+  9610us) service_pool.cc:224] Handling call
0709 13:18:38.966859 (+1436310us) spinlock_profiling.cc:243] Waited 1.1 s on lock 0x7b540020b2d4. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f9ae2fa 00007fcc1496fb17 00007fcc0deea6d4 00007fcc0deea662 00007fcc0deea591 00007fcc0deea50c 00007fcc0dee97c2 00007fcc0dce548c 00007fcc0dce48c6 00007fcc0dce426f
0709 13:18:38.967068 (+   209us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2532655488}
I20260709 13:18:38.971876  7897 leader_election.cc:290] T f5be3a11b23d4ea9b08300a2789821c7 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:18:38.975415  6727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "853ac0a8cbd64ce99457f170216d4d0f" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:18:38.986763  6879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fa34c08b205435dba97346991aa1f92" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:18:38.987617  6879 raft_consensus.cc:3060] T 3fa34c08b205435dba97346991aa1f92 P cd75a17ab2604397adab03bb8b5fd75c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:38.988477  6872 raft_consensus.cc:2468] T d8292e16e5654be6bc408560cf256aaa P cd75a17ab2604397adab03bb8b5fd75c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 1.
I20260709 13:18:38.988691  6880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8292e16e5654be6bc408560cf256aaa" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:18:38.989148  6724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f9c2e2bf644115957398fe4c9459db" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:18:38.989445  6880 raft_consensus.cc:2468] T d8292e16e5654be6bc408560cf256aaa P cd75a17ab2604397adab03bb8b5fd75c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 1.
I20260709 13:18:38.990356  7466 leader_election.cc:304] T be1a92657f494cac8dd227d152f50151 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
I20260709 13:18:38.990651  6801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a75bfe094d4bdc963aba3f08dfcd25" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:18:38.991525  6801 raft_consensus.cc:2468] T 95a75bfe094d4bdc963aba3f08dfcd25 P b7ab4784c7344b939bc36f639286f377 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 2.
I20260709 13:18:38.991611  6876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de3186201e1a40d0b335eeb8b4e256e0" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:18:38.992888  6801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20f6842e26174571996b8dea4151d4be" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:18:38.993652  6801 raft_consensus.cc:2468] T 20f6842e26174571996b8dea4151d4be P b7ab4784c7344b939bc36f639286f377 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 1.
I20260709 13:18:38.990392  7891 raft_consensus.cc:515] T dbdf895bba214ff68685a24fd17dfb5d P cd75a17ab2604397adab03bb8b5fd75c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:38.995033  6801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab432e62819d499eaaf3dd55481dd930" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:18:38.995512  6874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1704639a875409b9959353527b3fd68" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
W20260709 13:18:38.996809  6732 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49998 (request call id 363) took 2805 ms (client timeout 1657 ms). Trace:
I20260709 13:18:38.997330  7946 raft_consensus.cc:2804] T be1a92657f494cac8dd227d152f50151 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:18:38.989553  6800 raft_consensus.cc:3060] T e77e330a82df4b43a745d57a68f6f057 P b7ab4784c7344b939bc36f639286f377 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:38.995714  6801 raft_consensus.cc:2468] T ab432e62819d499eaaf3dd55481dd930 P b7ab4784c7344b939bc36f639286f377 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 2.
I20260709 13:18:38.950794  7965 leader_election.cc:290] T 2c240553ce044eedb41541d72b9475d7 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 3 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:18:38.974588  6770 leader_election.cc:304] T a1704639a875409b9959353527b3fd68 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
W20260709 13:18:38.997306  6732 rpcz_store.cc:269] 0709 13:18:36.191462 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:36.207106 (+ 15644us) service_pool.cc:224] Handling call
0709 13:18:38.996453 (+2789347us) spinlock_profiling.cc:243] Waited 1.62 s on lock 0x7b54000992d4. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f9ae2fa 00007fcc1496fb17 00007fcc0deea6d4 00007fcc0deea662 00007fcc0deea591 00007fcc0deea50c 00007fcc0dee97c2 00007fcc0dce548c 00007fcc0dce48c6 00007fcc0dce426f
0709 13:18:38.996617 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3723899136}
I20260709 13:18:38.946331  7934 raft_consensus.cc:493] T 3411566abe2d4c9bb4b2adfdd05e6f17 P cd75a17ab2604397adab03bb8b5fd75c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:18:39.012266  7885 raft_consensus.cc:493] T e31b9971c15848dea59d4d4130141d9e P ccd8a4c3bfe3413cb2ae219b09aea832 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:39.013242  8006 leader_election.cc:290] T ab432e62819d499eaaf3dd55481dd930 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:18:39.013041  7885 raft_consensus.cc:515] T e31b9971c15848dea59d4d4130141d9e P ccd8a4c3bfe3413cb2ae219b09aea832 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:38.908900  7951 consensus_queue.cc:1048] T 427c124d773f483294511e80fe340075 P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.090s
I20260709 13:18:39.015216  6805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44bde925b2e541b69890d70715b85176" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:18:38.913065  7984 raft_consensus.cc:515] T 9b3759de40694069b13c0f8bd40e5709 P cd75a17ab2604397adab03bb8b5fd75c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:39.026423  6731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44bde925b2e541b69890d70715b85176" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:18:39.029633  6874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1704639a875409b9959353527b3fd68" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:18:39.030934  7885 leader_election.cc:290] T e31b9971c15848dea59d4d4130141d9e P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:18:38.957437  7958 raft_consensus.cc:493] T 7c37d41cd9164c15a6826ca62a851a69 P b7ab4784c7344b939bc36f639286f377 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:18:39.001320  7970 leader_election.cc:290] T bb3d8792045a4583ae2e965b1350a5b4 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 3 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:18:39.006724  8003 leader_election.cc:290] T 711ef6523deb4cbe8ef2ba61e1c21c98 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:18:39.038285  6879 raft_consensus.cc:2468] T 3fa34c08b205435dba97346991aa1f92 P cd75a17ab2604397adab03bb8b5fd75c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 3.
I20260709 13:18:39.003518  7946 raft_consensus.cc:697] T be1a92657f494cac8dd227d152f50151 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 3 LEADER]: Becoming Leader. State: Replica: 7ba59cc884714e8aa5f3f0ecaed84cbb, State: Running, Role: LEADER
I20260709 13:18:39.043286  6876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d33d5ee8ef6f415593d8df52063161ad" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:18:39.043509  6874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbdf895bba214ff68685a24fd17dfb5d" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
W20260709 13:18:39.048763  6772 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.68:45071, user_credentials={real_user=slave}} blocked reactor thread for 174687us
W20260709 13:18:39.036989  6770 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 77520.6us
I20260709 13:18:39.023921  7891 leader_election.cc:290] T dbdf895bba214ff68685a24fd17dfb5d P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:18:39.048761  6805 raft_consensus.cc:2468] T 44bde925b2e541b69890d70715b85176 P b7ab4784c7344b939bc36f639286f377 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 2.
I20260709 13:18:39.055405  6874 raft_consensus.cc:2393] T dbdf895bba214ff68685a24fd17dfb5d P cd75a17ab2604397adab03bb8b5fd75c [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7ab4784c7344b939bc36f639286f377 in current term 2: Already voted for candidate cd75a17ab2604397adab03bb8b5fd75c in this term.
I20260709 13:18:39.057667  6879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e31b9971c15848dea59d4d4130141d9e" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:18:39.039925  6844 leader_election.cc:304] T d8cee0accdb8499c86d4414b72565a38 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb
I20260709 13:18:39.044011  6724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3d8792045a4583ae2e965b1350a5b4" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:18:39.063274  6872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "427c124d773f483294511e80fe340075" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:18:39.063858  6724 raft_consensus.cc:3060] T bb3d8792045a4583ae2e965b1350a5b4 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:39.063436  7958 raft_consensus.cc:515] T 7c37d41cd9164c15a6826ca62a851a69 P b7ab4784c7344b939bc36f639286f377 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:39.064246  6876 raft_consensus.cc:3060] T d33d5ee8ef6f415593d8df52063161ad P cd75a17ab2604397adab03bb8b5fd75c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:39.068545  6880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f00a2e87e56452083b759f60d461ee3" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:18:39.033303  7939 raft_consensus.cc:493] T 427c124d773f483294511e80fe340075 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader cd75a17ab2604397adab03bb8b5fd75c)
W20260709 13:18:39.071074  8007 log.cc:927] Time spent T 00000000000000000000000000000000 P b3ae52d33b9a4273a42e5e2cf3b5d6b5: Append to log took a long time: real 0.197s	user 0.000s	sys 0.001s
I20260709 13:18:39.079036  7984 leader_election.cc:290] T 9b3759de40694069b13c0f8bd40e5709 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:18:39.073478  6805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90d42e216d9741e190bca19a781291fd" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:18:39.071059  7939 raft_consensus.cc:515] T 427c124d773f483294511e80fe340075 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } attrs { replace: true } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:18:39.057435  8006 raft_consensus.cc:2804] T a1704639a875409b9959353527b3fd68 P b7ab4784c7344b939bc36f639286f377 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:18:39.074303  6873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b56bf91d90824c959e21e0cee5ba1816" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:18:39.077044  7934 raft_consensus.cc:515] T 3411566abe2d4c9bb4b2adfdd05e6f17 P cd75a17ab2604397adab03bb8b5fd75c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:39.081152  7946 consensus_queue.cc:237] T be1a92657f494cac8dd227d152f50151 P 7ba59cc884714e8aa5f3f0ecaed84cbb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:18:39.086042  6876 raft_consensus.cc:2468] T d33d5ee8ef6f415593d8df52063161ad P cd75a17ab2604397adab03bb8b5fd75c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 3.
I20260709 13:18:39.061944  6731 raft_consensus.cc:2468] T 44bde925b2e541b69890d70715b85176 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 2.
I20260709 13:18:39.094451  6804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d33d5ee8ef6f415593d8df52063161ad" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:18:39.022819  7897 raft_consensus.cc:493] T 711ef6523deb4cbe8ef2ba61e1c21c98 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:39.044909  7982 leader_election.cc:290] T 3fa34c08b205435dba97346991aa1f92 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:18:39.072872  6878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a734b5ab7834e05a8c422208acc58b1" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:18:39.052304  7885 raft_consensus.cc:493] T 22ccee1b570c4ad3a57bd7aec085b1b4 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:39.103611  6697 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.68:45071, user_credentials={real_user=slave}} blocked reactor thread for 59347.3us
I20260709 13:18:39.126986  7941 raft_consensus.cc:493] T c4db81d9d329422bb3b4160ca4ac2d1d P ccd8a4c3bfe3413cb2ae219b09aea832 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:39.128453  8019 log.cc:927] Time spent T a3022224cc81473690653a83d4e99470 P ccd8a4c3bfe3413cb2ae219b09aea832: Append to log took a long time: real 0.160s	user 0.001s	sys 0.000s
I20260709 13:18:39.107998  6770 leader_election.cc:304] T 07a92dd554674067a83a9cb68c4773f2 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
I20260709 13:18:39.111455  6880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbdf895bba214ff68685a24fd17dfb5d" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:18:39.132555  6880 raft_consensus.cc:2468] T dbdf895bba214ff68685a24fd17dfb5d P cd75a17ab2604397adab03bb8b5fd75c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 2.
I20260709 13:18:39.210762  6804 raft_consensus.cc:2393] T d33d5ee8ef6f415593d8df52063161ad P b7ab4784c7344b939bc36f639286f377 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate ccd8a4c3bfe3413cb2ae219b09aea832 in current term 3: Already voted for candidate b7ab4784c7344b939bc36f639286f377 in this term.
I20260709 13:18:39.135794  6872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22ccee1b570c4ad3a57bd7aec085b1b4" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:18:39.212375  6876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "713b5728a197487c9300b310ab94e5a3" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:18:39.213538  6876 raft_consensus.cc:2393] T 713b5728a197487c9300b310ab94e5a3 P cd75a17ab2604397adab03bb8b5fd75c [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7ab4784c7344b939bc36f639286f377 in current term 2: Already voted for candidate cd75a17ab2604397adab03bb8b5fd75c in this term.
I20260709 13:18:39.213902  7870 raft_consensus.cc:2804] T d8cee0accdb8499c86d4414b72565a38 P b7ab4784c7344b939bc36f639286f377 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:18:39.214522  7870 raft_consensus.cc:493] T d8cee0accdb8499c86d4414b72565a38 P b7ab4784c7344b939bc36f639286f377 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:39.101297  7956 leader_election.cc:290] T 9e326172347f45e99a0d482b5d8ef768 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 3 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:18:39.106567  8006 raft_consensus.cc:493] T a1704639a875409b9959353527b3fd68 P b7ab4784c7344b939bc36f639286f377 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:39.214838  7897 raft_consensus.cc:515] T 711ef6523deb4cbe8ef2ba61e1c21c98 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:39.210433  6873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77e330a82df4b43a745d57a68f6f057" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:18:39.224243  6878 raft_consensus.cc:2393] T 7a734b5ab7834e05a8c422208acc58b1 P cd75a17ab2604397adab03bb8b5fd75c [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7ab4784c7344b939bc36f639286f377 in current term 2: Already voted for candidate cd75a17ab2604397adab03bb8b5fd75c in this term.
I20260709 13:18:39.196709  7990 raft_consensus.cc:2804] T 07a92dd554674067a83a9cb68c4773f2 P b7ab4784c7344b939bc36f639286f377 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:18:39.225782  6877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c240553ce044eedb41541d72b9475d7" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:18:39.226616  6877 raft_consensus.cc:2468] T 2c240553ce044eedb41541d72b9475d7 P cd75a17ab2604397adab03bb8b5fd75c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 2.
W20260709 13:18:39.165737  6770 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 103378us
I20260709 13:18:39.212291  6804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e31b9971c15848dea59d4d4130141d9e" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:18:39.175624  6874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a92dd554674067a83a9cb68c4773f2" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
W20260709 13:18:39.134538  7499 consensus_meta.cc:287] T 3fa34c08b205435dba97346991aa1f92 P 7ba59cc884714e8aa5f3f0ecaed84cbb: Time spent flushing consensus metadata: real 0.551s	user 0.013s	sys 0.004s
I20260709 13:18:39.125590  7936 raft_consensus.cc:493] T 7ba5dac66ab5497e9e336f2a3c28cda5 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader cd75a17ab2604397adab03bb8b5fd75c)
I20260709 13:18:39.215659  8006 raft_consensus.cc:3060] T a1704639a875409b9959353527b3fd68 P b7ab4784c7344b939bc36f639286f377 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:39.180810  6805 raft_consensus.cc:3060] T 90d42e216d9741e190bca19a781291fd P b7ab4784c7344b939bc36f639286f377 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:39.176899  6772 leader_election.cc:304] T ce4f062dcd314d43a63ca74067cb5ee3 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
W20260709 13:18:39.249806  6772 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.68:45071, user_credentials={real_user=slave}} blocked reactor thread for 158701us
I20260709 13:18:39.251150  6772 leader_election.cc:304] T 17587d6730594da4a56fa13a353232a1 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, b7ab4784c7344b939bc36f639286f377; no voters: ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:18:39.252287  7965 raft_consensus.cc:2804] T ce4f062dcd314d43a63ca74067cb5ee3 P b7ab4784c7344b939bc36f639286f377 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:18:39.252441  8003 raft_consensus.cc:2804] T 17587d6730594da4a56fa13a353232a1 P b7ab4784c7344b939bc36f639286f377 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:18:39.253145  8003 raft_consensus.cc:697] T 17587d6730594da4a56fa13a353232a1 P b7ab4784c7344b939bc36f639286f377 [term 4 LEADER]: Becoming Leader. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
I20260709 13:18:39.253343  6772 leader_election.cc:304] T 7ba5dac66ab5497e9e336f2a3c28cda5 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:18:39.253636  6729 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49998 (request call id 380) took 1132 ms. Trace:
I20260709 13:18:39.254230  6881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c44c4849aa54f2b94d1f1bef9ed546f" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:18:39.230877  6874 raft_consensus.cc:2468] T 07a92dd554674067a83a9cb68c4773f2 P cd75a17ab2604397adab03bb8b5fd75c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 2.
I20260709 13:18:39.107481  7994 leader_election.cc:290] T 1bf4668eeb70467fb3dc5a0289233b3c P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:18:39.236759  6770 leader_election.cc:304] T d8292e16e5654be6bc408560cf256aaa P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
I20260709 13:18:39.230135  7956 raft_consensus.cc:493] T 34f36d59d88f40fe8a2805e604fc6c0a P b7ab4784c7344b939bc36f639286f377 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:18:39.166898  7982 raft_consensus.cc:2764] T d8cee0accdb8499c86d4414b72565a38 P cd75a17ab2604397adab03bb8b5fd75c [term 2 FOLLOWER]: Leader pre-election decision vote started in defunct term 1: won
I20260709 13:18:39.214905  7870 raft_consensus.cc:3060] T d8cee0accdb8499c86d4414b72565a38 P b7ab4784c7344b939bc36f639286f377 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:39.145221  7941 raft_consensus.cc:515] T c4db81d9d329422bb3b4160ca4ac2d1d P ccd8a4c3bfe3413cb2ae219b09aea832 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
W20260709 13:18:39.236706  8023 log.cc:927] Time spent T 404190ce4ce94cecbfcb6ea9d1dd8626 P 7ba59cc884714e8aa5f3f0ecaed84cbb: Append to log took a long time: real 0.141s	user 0.001s	sys 0.000s
I20260709 13:18:39.225615  7897 leader_election.cc:290] T 711ef6523deb4cbe8ef2ba61e1c21c98 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:18:38.864373  6798 rpcz_store.cc:276] 0709 13:18:37.202479 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:37.202704 (+   225us) service_pool.cc:224] Handling call
0709 13:18:38.022842 (+820138us) spinlock_profiling.cc:243] Waited 1.75 ms on lock 0x7b5800003098. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0c745db1 00007fcc0c885b71 00007fcc0c885a22 00007fcc1579ec09 00007fcc148f8ee0 00007fcc149c20ab 00007fcc149c2131 00007fcc14983fc0 00007fcc1496e929 00007fcc1496e3d2 00007fcc0dee5bd4
0709 13:18:38.023207 (+   365us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:38.023838 (+   631us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:38.023889 (+    51us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:38.024712 (+   823us) log.cc:844] Serialized 26 byte log entry
0709 13:18:38.710042 (+685330us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:18:38.710206 (+   164us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:38.710375 (+   169us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:38.738350 (+ 27975us) raft_consensus.cc:1685] finished
0709 13:18:38.738375 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:38.810324 (+ 71949us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":9890,"raft.run_cpu_time_us":194,"raft.run_wall_time_us":4187,"spinlock_wait_cycles":4023168,"thread_start_us":684387,"threads_started":1,"wal-append.queue_time_us":665793}
I20260709 13:18:39.284704  6804 raft_consensus.cc:2468] T e31b9971c15848dea59d4d4130141d9e P b7ab4784c7344b939bc36f639286f377 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 1.
I20260709 13:18:39.286242  7956 raft_consensus.cc:515] T 34f36d59d88f40fe8a2805e604fc6c0a P b7ab4784c7344b939bc36f639286f377 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:39.288887  6877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d9def8b32fd443aa94ab1420b06837b" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:18:39.289444  6803 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:32976 (request call id 1768) took 1535 ms. Trace:
I20260709 13:18:39.289494  6807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5be3a11b23d4ea9b08300a2789821c7" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:18:39.290025  7883 raft_consensus.cc:493] T b3f13b31a1f84f0d89d007eadd57924c P b7ab4784c7344b939bc36f639286f377 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:18:39.255092  7975 leader_election.cc:290] T 4d9def8b32fd443aa94ab1420b06837b P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:18:39.170331  7958 leader_election.cc:290] T 7c37d41cd9164c15a6826ca62a851a69 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:18:39.293699  6805 raft_consensus.cc:2468] T 90d42e216d9741e190bca19a781291fd P b7ab4784c7344b939bc36f639286f377 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 3.
I20260709 13:18:39.227010  7990 raft_consensus.cc:493] T 07a92dd554674067a83a9cb68c4773f2 P b7ab4784c7344b939bc36f639286f377 [term 1 FOLLOWER]: Starting leader election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:18:39.253058  7965 raft_consensus.cc:697] T ce4f062dcd314d43a63ca74067cb5ee3 P b7ab4784c7344b939bc36f639286f377 [term 3 LEADER]: Becoming Leader. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
I20260709 13:18:39.254191  6729 rpcz_store.cc:276] 0709 13:18:38.120946 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:38.434826 (+313880us) service_pool.cc:224] Handling call
0709 13:18:38.435357 (+   531us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:38.435828 (+   471us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:38.435853 (+    25us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:38.509415 (+ 73562us) log.cc:844] Serialized 26 byte log entry
0709 13:18:38.693052 (+183637us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:18:38.693096 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:38.693179 (+    83us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:39.253365 (+560186us) raft_consensus.cc:1685] finished
0709 13:18:39.253387 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:39.253544 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":182982,"threads_started":1,"wal-append.queue_time_us":581621}
I20260709 13:18:39.299728  6800 raft_consensus.cc:2468] T e77e330a82df4b43a745d57a68f6f057 P b7ab4784c7344b939bc36f639286f377 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 4.
I20260709 13:18:39.303378  7962 raft_consensus.cc:2749] T 7ba5dac66ab5497e9e336f2a3c28cda5 P b7ab4784c7344b939bc36f639286f377 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:18:39.305238  6798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6869f07b5a4885a0b99fbe60c3b175" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:18:39.306497  6877 raft_consensus.cc:2393] T 4d9def8b32fd443aa94ab1420b06837b P cd75a17ab2604397adab03bb8b5fd75c [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7ab4784c7344b939bc36f639286f377 in current term 2: Already voted for candidate cd75a17ab2604397adab03bb8b5fd75c in this term.
I20260709 13:18:39.150909  7885 raft_consensus.cc:515] T 22ccee1b570c4ad3a57bd7aec085b1b4 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:39.279497  7499 raft_consensus.cc:2468] T 3fa34c08b205435dba97346991aa1f92 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 3.
W20260709 13:18:39.313700  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 315123us
I20260709 13:18:39.316505  6804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d9def8b32fd443aa94ab1420b06837b" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:18:39.318126  6881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "853ac0a8cbd64ce99457f170216d4d0f" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:18:39.319784  7883 raft_consensus.cc:515] T b3f13b31a1f84f0d89d007eadd57924c P b7ab4784c7344b939bc36f639286f377 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:18:39.315444  7990 raft_consensus.cc:3060] T 07a92dd554674067a83a9cb68c4773f2 P b7ab4784c7344b939bc36f639286f377 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:39.332556  6725 raft_consensus.cc:2468] T f58dc08b12a2494bb9a1372837970ca2 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 3.
I20260709 13:18:39.336738  6879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f58dc08b12a2494bb9a1372837970ca2" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:18:39.337641  6879 raft_consensus.cc:3060] T f58dc08b12a2494bb9a1372837970ca2 P cd75a17ab2604397adab03bb8b5fd75c [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:18:39.337170  7965 consensus_queue.cc:237] T ce4f062dcd314d43a63ca74067cb5ee3 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.3, Last appended by leader: 3, Current term: 3, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } attrs { replace: true } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:18:39.339780  6873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "427c124d773f483294511e80fe340075" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:18:39.341586  6878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09c2a98de1a4decabd0ff900dd44caa" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
W20260709 13:18:39.324651  6772 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 71367us
I20260709 13:18:39.345252  7885 leader_election.cc:290] T 22ccee1b570c4ad3a57bd7aec085b1b4 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:18:39.345829  7982 raft_consensus.cc:493] T bb3d8792045a4583ae2e965b1350a5b4 P cd75a17ab2604397adab03bb8b5fd75c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
W20260709 13:18:39.346138  6847 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:39.346613  7982 raft_consensus.cc:515] T bb3d8792045a4583ae2e965b1350a5b4 P cd75a17ab2604397adab03bb8b5fd75c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:18:39.348338  6724 raft_consensus.cc:2468] T bb3d8792045a4583ae2e965b1350a5b4 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in term 3.
I20260709 13:18:39.254488  8003 consensus_queue.cc:237] T 17587d6730594da4a56fa13a353232a1 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 4, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:18:39.331921  6876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a75bfe094d4bdc963aba3f08dfcd25" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:18:39.345432  6772 leader_election.cc:304] T 20f6842e26174571996b8dea4151d4be P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:18:39.322976  6874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90d42e216d9741e190bca19a781291fd" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:18:39.353333  6880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09c2a98de1a4decabd0ff900dd44caa" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:18:39.297809  7936 raft_consensus.cc:515] T 7ba5dac66ab5497e9e336f2a3c28cda5 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:18:39.384640  6874 raft_consensus.cc:3060] T 90d42e216d9741e190bca19a781291fd P cd75a17ab2604397adab03bb8b5fd75c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:39.354803  7962 raft_consensus.cc:3060] T 20f6842e26174571996b8dea4151d4be P b7ab4784c7344b939bc36f639286f377 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:39.386438  6804 raft_consensus.cc:2468] T 4d9def8b32fd443aa94ab1420b06837b P b7ab4784c7344b939bc36f639286f377 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 1.
I20260709 13:18:39.390415  6878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f03d0dbf16864ca4bc1bb5e4c0334c0f" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:18:39.393746  6878 raft_consensus.cc:2468] T f03d0dbf16864ca4bc1bb5e4c0334c0f P cd75a17ab2604397adab03bb8b5fd75c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 2.
I20260709 13:18:39.355309  6798 raft_consensus.cc:3060] T bd6869f07b5a4885a0b99fbe60c3b175 P b7ab4784c7344b939bc36f639286f377 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:39.385398  7499 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50742 (request call id 197) took 1291 ms. Trace:
I20260709 13:18:39.452668  6878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a734b5ab7834e05a8c422208acc58b1" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
W20260709 13:18:39.456115  7894 consensus_meta.cc:287] T de3186201e1a40d0b335eeb8b4e256e0 P ccd8a4c3bfe3413cb2ae219b09aea832: Time spent flushing consensus metadata: real 0.739s	user 0.018s	sys 0.000s
I20260709 13:18:39.390619  8010 raft_consensus.cc:2804] T d8292e16e5654be6bc408560cf256aaa P b7ab4784c7344b939bc36f639286f377 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:18:39.465092  6878 raft_consensus.cc:2468] T 7a734b5ab7834e05a8c422208acc58b1 P cd75a17ab2604397adab03bb8b5fd75c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 2.
I20260709 13:18:39.349169  7982 leader_election.cc:290] T bb3d8792045a4583ae2e965b1350a5b4 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
W20260709 13:18:39.470551  6770 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 233877us
I20260709 13:18:39.478386  6770 leader_election.cc:304] T dbdf895bba214ff68685a24fd17dfb5d P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
I20260709 13:18:39.479079  7832 consensus_queue.cc:1048] T f09c2a98de1a4decabd0ff900dd44caa P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:18:39.488633  6800 raft_consensus.cc:1275] T 404190ce4ce94cecbfcb6ea9d1dd8626 P b7ab4784c7344b939bc36f639286f377 [term 3 FOLLOWER]: Refusing update from remote peer 7ba59cc884714e8aa5f3f0ecaed84cbb: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:18:39.480201  7934 leader_election.cc:290] T 3411566abe2d4c9bb4b2adfdd05e6f17 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:18:39.465660  8010 raft_consensus.cc:493] T d8292e16e5654be6bc408560cf256aaa P b7ab4784c7344b939bc36f639286f377 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:39.496138  6728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09c2a98de1a4decabd0ff900dd44caa" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:18:39.503247  6874 raft_consensus.cc:2468] T 90d42e216d9741e190bca19a781291fd P cd75a17ab2604397adab03bb8b5fd75c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 3.
I20260709 13:18:39.496567  7941 leader_election.cc:290] T c4db81d9d329422bb3b4160ca4ac2d1d P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
W20260709 13:18:39.505112  6772 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 117457us
I20260709 13:18:39.505498  6728 raft_consensus.cc:2468] T f09c2a98de1a4decabd0ff900dd44caa P ccd8a4c3bfe3413cb2ae219b09aea832 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 2.
W20260709 13:18:39.497218  7503 consensus_meta.cc:287] T 4b8cacb381b746da8d0049b0a83b41dd P 7ba59cc884714e8aa5f3f0ecaed84cbb: Time spent flushing consensus metadata: real 0.531s	user 0.015s	sys 0.001s
I20260709 13:18:39.451380  7886 raft_consensus.cc:493] T 8c7f33e544204fbaac4078e3e83bbf4e P cd75a17ab2604397adab03bb8b5fd75c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:18:39.506778  6879 raft_consensus.cc:2468] T f58dc08b12a2494bb9a1372837970ca2 P cd75a17ab2604397adab03bb8b5fd75c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 3.
I20260709 13:18:39.515070  6876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a75bfe094d4bdc963aba3f08dfcd25" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:18:39.519094  6772 leader_election.cc:304] T 24ee15416e3145beaa1b8183453729a3 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, b7ab4784c7344b939bc36f639286f377; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:18:39.521458  7886 raft_consensus.cc:515] T 8c7f33e544204fbaac4078e3e83bbf4e P cd75a17ab2604397adab03bb8b5fd75c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
W20260709 13:18:39.525071  7993 consensus_meta.cc:287] T 17587d6730594da4a56fa13a353232a1 P ccd8a4c3bfe3413cb2ae219b09aea832: Time spent flushing consensus metadata: real 0.666s	user 0.011s	sys 0.006s
I20260709 13:18:39.525732  6802 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:32976 (request call id 1767) took 1862 ms. Trace:
I20260709 13:18:39.526459  6802 rpcz_store.cc:276] 0709 13:18:37.640888 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:37.642078 (+  1190us) service_pool.cc:224] Handling call
0709 13:18:39.483263 (+1841185us) spinlock_profiling.cc:243] Waited 40.7 ms on lock 0x7b54002c92d4. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f9ae2fa 00007fcc1496fb17 00007fcc0deea6d4 00007fcc0deea662 00007fcc0deea591 00007fcc0deea50c 00007fcc0dee97c2 00007fcc0dce548c 00007fcc0dce48c6 00007fcc0dce426f
0709 13:18:39.502974 (+ 19711us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":93526272}
I20260709 13:18:39.507529  7503 raft_consensus.cc:2468] T 4b8cacb381b746da8d0049b0a83b41dd P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 3.
I20260709 13:18:39.503274  8010 raft_consensus.cc:3060] T d8292e16e5654be6bc408560cf256aaa P b7ab4784c7344b939bc36f639286f377 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:39.530889  6697 leader_election.cc:304] T 4b8cacb381b746da8d0049b0a83b41dd P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
I20260709 13:18:39.531883  7993 raft_consensus.cc:2804] T 4b8cacb381b746da8d0049b0a83b41dd P ccd8a4c3bfe3413cb2ae219b09aea832 [term 3 FOLLOWER]: Leader election won for term 3
W20260709 13:18:39.533085  8028 log.cc:927] Time spent T 3a485a995abc4807b6e511e45419f737 P b7ab4784c7344b939bc36f639286f377: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260709 13:18:39.533510  7993 raft_consensus.cc:697] T 4b8cacb381b746da8d0049b0a83b41dd P ccd8a4c3bfe3413cb2ae219b09aea832 [term 3 LEADER]: Becoming Leader. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
I20260709 13:18:39.534677  7993 consensus_queue.cc:237] T 4b8cacb381b746da8d0049b0a83b41dd P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:18:39.536916  7886 leader_election.cc:290] T 8c7f33e544204fbaac4078e3e83bbf4e P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:18:39.537025  8006 raft_consensus.cc:515] T a1704639a875409b9959353527b3fd68 P b7ab4784c7344b939bc36f639286f377 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:39.537914  7970 consensus_queue.cc:1048] T 404190ce4ce94cecbfcb6ea9d1dd8626 P 7ba59cc884714e8aa5f3f0ecaed84cbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:18:39.539302  8006 leader_election.cc:290] T a1704639a875409b9959353527b3fd68 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 3 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:18:39.467720  7894 raft_consensus.cc:515] T de3186201e1a40d0b335eeb8b4e256e0 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:39.457862  7499 rpcz_store.cc:276] 0709 13:18:38.066934 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:38.068486 (+  1552us) service_pool.cc:224] Handling call
0709 13:18:38.541682 (+473196us) spinlock_profiling.cc:243] Waited 4.39 ms on lock 0x7b5800123f98. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0c745db1 00007fcc0c885b71 00007fcc0c885eee 0000000000375939 00007fcc148f91e0 00007fcc149c20c4 00007fcc149c2131 00007fcc149700a0 00007fcc1496f984 00007fcc0deea6d4 00007fcc0deea662
0709 13:18:39.358029 (+816347us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":10099584}
I20260709 13:18:39.477416  7870 raft_consensus.cc:515] T d8cee0accdb8499c86d4414b72565a38 P b7ab4784c7344b939bc36f639286f377 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:18:39.554191  6799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "427c124d773f483294511e80fe340075" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:18:39.566715  6799 raft_consensus.cc:2468] T 427c124d773f483294511e80fe340075 P b7ab4784c7344b939bc36f639286f377 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in term 1.
I20260709 13:18:39.567077  6804 raft_consensus.cc:1240] T d8cee0accdb8499c86d4414b72565a38 P b7ab4784c7344b939bc36f639286f377 [term 3 FOLLOWER]: Rejecting Update request from peer 7ba59cc884714e8aa5f3f0ecaed84cbb for earlier term 2. Current term is 3. Ops: []
I20260709 13:18:39.544175  7894 leader_election.cc:290] T de3186201e1a40d0b335eeb8b4e256e0 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 3 election: Requested vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:18:39.559880  7990 raft_consensus.cc:515] T 07a92dd554674067a83a9cb68c4773f2 P b7ab4784c7344b939bc36f639286f377 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:39.584884  7936 leader_election.cc:290] T 7ba5dac66ab5497e9e336f2a3c28cda5 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:18:39.560439  6876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44bde925b2e541b69890d70715b85176" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:18:39.568751  6697 leader_election.cc:304] T 3fa34c08b205435dba97346991aa1f92 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
I20260709 13:18:39.588150  7894 raft_consensus.cc:2804] T 3fa34c08b205435dba97346991aa1f92 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:18:39.588771  7894 raft_consensus.cc:697] T 3fa34c08b205435dba97346991aa1f92 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 3 LEADER]: Becoming Leader. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
I20260709 13:18:39.589836  7894 consensus_queue.cc:237] T 3fa34c08b205435dba97346991aa1f92 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:18:39.572944  6802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ba5dac66ab5497e9e336f2a3c28cda5" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:18:39.592972  6802 raft_consensus.cc:2393] T 7ba5dac66ab5497e9e336f2a3c28cda5 P b7ab4784c7344b939bc36f639286f377 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in current term 2: Already voted for candidate b7ab4784c7344b939bc36f639286f377 in this term.
I20260709 13:18:39.593950  6881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d33d5ee8ef6f415593d8df52063161ad" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:18:39.594456  6874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6869f07b5a4885a0b99fbe60c3b175" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:18:39.595286  6874 raft_consensus.cc:3060] T bd6869f07b5a4885a0b99fbe60c3b175 P cd75a17ab2604397adab03bb8b5fd75c [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:39.595583  6877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5be3a11b23d4ea9b08300a2789821c7" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:18:39.504345  7982 raft_consensus.cc:493] T 4275cf08e63345f993bce8664eada830 P cd75a17ab2604397adab03bb8b5fd75c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:18:39.597352  6878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b8cacb381b746da8d0049b0a83b41dd" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:18:39.598071  6878 raft_consensus.cc:3060] T 4b8cacb381b746da8d0049b0a83b41dd P cd75a17ab2604397adab03bb8b5fd75c [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:18:39.597638  7982 raft_consensus.cc:515] T 4275cf08e63345f993bce8664eada830 P cd75a17ab2604397adab03bb8b5fd75c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:39.594779  6881 raft_consensus.cc:2393] T d33d5ee8ef6f415593d8df52063161ad P cd75a17ab2604397adab03bb8b5fd75c [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate ccd8a4c3bfe3413cb2ae219b09aea832 in current term 3: Already voted for candidate b7ab4784c7344b939bc36f639286f377 in this term.
I20260709 13:18:39.600615  6876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab432e62819d499eaaf3dd55481dd930" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:18:39.601075  7956 leader_election.cc:290] T 34f36d59d88f40fe8a2805e604fc6c0a P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:18:39.581554  7939 leader_election.cc:290] T 427c124d773f483294511e80fe340075 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:18:39.603741  6874 raft_consensus.cc:2468] T bd6869f07b5a4885a0b99fbe60c3b175 P cd75a17ab2604397adab03bb8b5fd75c [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 4.
I20260709 13:18:39.539951  8006 raft_consensus.cc:2804] T dbdf895bba214ff68685a24fd17dfb5d P b7ab4784c7344b939bc36f639286f377 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:18:39.606909  7466 leader_election.cc:304] T bb3d8792045a4583ae2e965b1350a5b4 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
I20260709 13:18:39.628484  6730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "427c124d773f483294511e80fe340075" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:18:39.634431  6877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e31b9971c15848dea59d4d4130141d9e" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:18:39.647537  6879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20f6842e26174571996b8dea4151d4be" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:18:39.605827  7982 leader_election.cc:290] T 4275cf08e63345f993bce8664eada830 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:18:39.629215  7956 raft_consensus.cc:3060] T 24ee15416e3145beaa1b8183453729a3 P b7ab4784c7344b939bc36f639286f377 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:39.633888  7939 raft_consensus.cc:2804] T bb3d8792045a4583ae2e965b1350a5b4 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 3 FOLLOWER]: Leader election won for term 3
W20260709 13:18:39.665465  8015 log.cc:927] Time spent T 22ccee1b570c4ad3a57bd7aec085b1b4 P cd75a17ab2604397adab03bb8b5fd75c: Append to log took a long time: real 0.675s	user 0.004s	sys 0.001s
I20260709 13:18:39.669744  6723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be1a92657f494cac8dd227d152f50151" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:18:39.622014  8006 raft_consensus.cc:493] T dbdf895bba214ff68685a24fd17dfb5d P b7ab4784c7344b939bc36f639286f377 [term 1 FOLLOWER]: Starting leader election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:18:39.674989  6730 raft_consensus.cc:2468] T 427c124d773f483294511e80fe340075 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in term 1.
I20260709 13:18:39.675522  6723 raft_consensus.cc:2368] T be1a92657f494cac8dd227d152f50151 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate b7ab4784c7344b939bc36f639286f377 for earlier term 2. Current term is 3.
W20260709 13:18:39.677301  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 199997us
I20260709 13:18:39.678754  6728 raft_consensus.cc:1275] T 404190ce4ce94cecbfcb6ea9d1dd8626 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 3 FOLLOWER]: Refusing update from remote peer 7ba59cc884714e8aa5f3f0ecaed84cbb: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:18:39.689626  7466 leader_election.cc:304] T 427c124d773f483294511e80fe340075 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
I20260709 13:18:39.661198  8031 raft_consensus.cc:493] T bb7fa124c3bf4ef9ab65a407cb008441 P b7ab4784c7344b939bc36f639286f377 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 7ba59cc884714e8aa5f3f0ecaed84cbb)
I20260709 13:18:39.676733  8006 raft_consensus.cc:3060] T dbdf895bba214ff68685a24fd17dfb5d P b7ab4784c7344b939bc36f639286f377 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:39.705344  6877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "711ef6523deb4cbe8ef2ba61e1c21c98" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:18:39.682777  7939 raft_consensus.cc:697] T bb3d8792045a4583ae2e965b1350a5b4 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 3 LEADER]: Becoming Leader. State: Replica: 7ba59cc884714e8aa5f3f0ecaed84cbb, State: Running, Role: LEADER
W20260709 13:18:39.713542  6770 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 232880us
I20260709 13:18:39.694509  7870 leader_election.cc:290] T d8cee0accdb8499c86d4414b72565a38 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 3 election: Requested vote from peers cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
W20260709 13:18:39.725368  6772 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 206436us
I20260709 13:18:39.709820  7936 raft_consensus.cc:2804] T 427c124d773f483294511e80fe340075 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:18:39.307602  6803 rpcz_store.cc:276] 0709 13:18:37.641210 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:37.644734 (+  3524us) service_pool.cc:224] Handling call
0709 13:18:38.797640 (+1152906us) spinlock_profiling.cc:243] Waited 5.76 ms on lock 0x7b5800003098. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0c745db1 00007fcc0c885b71 00007fcc0c885eee 0000000000375939 00007fcc148f91e0 00007fcc149c20c4 00007fcc149c2131 00007fcc14983fc0 00007fcc1496e929 00007fcc1496e3d2 00007fcc0dee5bd4
0709 13:18:38.798087 (+   447us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:38.798785 (+   698us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:18:38.903536 (+104751us) log.cc:844] Serialized 14 byte log entry
0709 13:18:39.106150 (+202614us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:39.125519 (+ 19369us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:18:39.129501 (+  3982us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:39.137356 (+  7855us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:39.176747 (+ 39391us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":202876,"prepare.run_cpu_time_us":68,"prepare.run_wall_time_us":83,"raft.queue_time_us":8015,"raft.run_cpu_time_us":205,"raft.run_wall_time_us":19656,"spinlock_wait_cycles":13257600,"thread_start_us":210546,"threads_started":2,"wal-append.queue_time_us":261050}
I20260709 13:18:39.749276  6772 leader_election.cc:304] T 1528ab62b6fe4e3099d08f141afee116 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, b7ab4784c7344b939bc36f639286f377; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:18:39.719024  7832 raft_consensus.cc:493] T 24ee15416e3145beaa1b8183453729a3 P cd75a17ab2604397adab03bb8b5fd75c [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:39.729598  7962 raft_consensus.cc:2749] T 20f6842e26174571996b8dea4151d4be P b7ab4784c7344b939bc36f639286f377 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:39.755721  6877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d9def8b32fd443aa94ab1420b06837b" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:18:39.758147  6877 raft_consensus.cc:2468] T 4d9def8b32fd443aa94ab1420b06837b P cd75a17ab2604397adab03bb8b5fd75c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 2.
I20260709 13:18:39.745261  7936 raft_consensus.cc:493] T 427c124d773f483294511e80fe340075 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 1 FOLLOWER]: Starting leader election (detected failure of leader cd75a17ab2604397adab03bb8b5fd75c)
I20260709 13:18:39.772367  8037 raft_consensus.cc:3060] T 1528ab62b6fe4e3099d08f141afee116 P b7ab4784c7344b939bc36f639286f377 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:39.774308  6874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4db81d9d329422bb3b4160ca4ac2d1d" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:18:39.776315  7499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fa34c08b205435dba97346991aa1f92" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:18:39.776471  6879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22ccee1b570c4ad3a57bd7aec085b1b4" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:18:39.777237  7499 raft_consensus.cc:2393] T 3fa34c08b205435dba97346991aa1f92 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c in current term 3: Already voted for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in this term.
I20260709 13:18:39.777842  6876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de3186201e1a40d0b335eeb8b4e256e0" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:18:39.779036  7993 raft_consensus.cc:493] T 404190ce4ce94cecbfcb6ea9d1dd8626 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:39.779307  8008 log.cc:927] Time spent T 7c44c4849aa54f2b94d1f1bef9ed546f P cd75a17ab2604397adab03bb8b5fd75c: Append to log took a long time: real 0.795s	user 0.002s	sys 0.006s
I20260709 13:18:39.780864  7993 raft_consensus.cc:515] T 404190ce4ce94cecbfcb6ea9d1dd8626 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
W20260709 13:18:39.758936  6697 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.5.126.67:42931 timed out after 1.682s (SENT) [suppressed 21 similar messages]
I20260709 13:18:39.716131  8031 raft_consensus.cc:515] T bb7fa124c3bf4ef9ab65a407cb008441 P b7ab4784c7344b939bc36f639286f377 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:18:39.779078  6878 raft_consensus.cc:2468] T 4b8cacb381b746da8d0049b0a83b41dd P cd75a17ab2604397adab03bb8b5fd75c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 3.
I20260709 13:18:39.788977  6772 leader_election.cc:304] T 7887766dc6784fcaa42b35c05fea7a99 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:18:39.765188  7936 raft_consensus.cc:3060] T 427c124d773f483294511e80fe340075 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:39.801162  6770 leader_election.cc:400] T 404190ce4ce94cecbfcb6ea9d1dd8626 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 2 election: Vote denied by peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391) with higher term. Message: Invalid argument: T 404190ce4ce94cecbfcb6ea9d1dd8626 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate b7ab4784c7344b939bc36f639286f377 for earlier term 2. Current term is 3.
I20260709 13:18:39.801509  6770 leader_election.cc:403] T 404190ce4ce94cecbfcb6ea9d1dd8626 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
W20260709 13:18:39.803642  8027 log.cc:927] Time spent T 30e88460611e47b2ba16a46a30b5f416 P ccd8a4c3bfe3413cb2ae219b09aea832: Append to log took a long time: real 0.590s	user 0.000s	sys 0.005s
I20260709 13:18:39.805560  8031 leader_election.cc:290] T bb7fa124c3bf4ef9ab65a407cb008441 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:18:39.806106  8031 raft_consensus.cc:3060] T 7887766dc6784fcaa42b35c05fea7a99 P b7ab4784c7344b939bc36f639286f377 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:18:39.813750  6770 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 43936.1us
I20260709 13:18:39.818351  6877 raft_consensus.cc:1275] T a3022224cc81473690653a83d4e99470 P cd75a17ab2604397adab03bb8b5fd75c [term 2 FOLLOWER]: Refusing update from remote peer ccd8a4c3bfe3413cb2ae219b09aea832: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:18:39.815573  6772 leader_election.cc:304] T 90d42e216d9741e190bca19a781291fd P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:18:39.798117  7832 raft_consensus.cc:515] T 24ee15416e3145beaa1b8183453729a3 P cd75a17ab2604397adab03bb8b5fd75c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } attrs { replace: true } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:18:39.815330  8004 raft_consensus.cc:2749] T 404190ce4ce94cecbfcb6ea9d1dd8626 P b7ab4784c7344b939bc36f639286f377 [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391) with higher term. Message: Invalid argument: T 404190ce4ce94cecbfcb6ea9d1dd8626 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate b7ab4784c7344b939bc36f639286f377 for earlier term 2. Current term is 3.
I20260709 13:18:39.833798  6770 leader_election.cc:304] T b56bf91d90824c959e21e0cee5ba1816 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
I20260709 13:18:39.837075  8003 raft_consensus.cc:2764] T 90d42e216d9741e190bca19a781291fd P b7ab4784c7344b939bc36f639286f377 [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
W20260709 13:18:39.857728  6697 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 98834.8us
I20260709 13:18:39.861490  7885 raft_consensus.cc:493] T 713b5728a197487c9300b310ab94e5a3 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:39.865036  6772 leader_election.cc:304] T c4db81d9d329422bb3b4160ca4ac2d1d P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:18:39.819393  7939 consensus_queue.cc:237] T bb3d8792045a4583ae2e965b1350a5b4 P 7ba59cc884714e8aa5f3f0ecaed84cbb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:18:39.858433  7499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3d8792045a4583ae2e965b1350a5b4" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:18:39.872803  8036 raft_consensus.cc:2804] T b56bf91d90824c959e21e0cee5ba1816 P b7ab4784c7344b939bc36f639286f377 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:18:39.884573  6728 raft_consensus.cc:1275] T be1a92657f494cac8dd227d152f50151 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 3 FOLLOWER]: Refusing update from remote peer 7ba59cc884714e8aa5f3f0ecaed84cbb: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:18:39.887954  6770 leader_election.cc:304] T 7a734b5ab7834e05a8c422208acc58b1 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
I20260709 13:18:39.887508  8036 raft_consensus.cc:493] T b56bf91d90824c959e21e0cee5ba1816 P b7ab4784c7344b939bc36f639286f377 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:39.897738  8036 raft_consensus.cc:3060] T b56bf91d90824c959e21e0cee5ba1816 P b7ab4784c7344b939bc36f639286f377 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:39.889638  8037 raft_consensus.cc:2749] T 1528ab62b6fe4e3099d08f141afee116 P b7ab4784c7344b939bc36f639286f377 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:39.900859  6729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4b8bd455d5a47c18a1380839c6e0d61" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:18:39.902469  8010 raft_consensus.cc:515] T d8292e16e5654be6bc408560cf256aaa P b7ab4784c7344b939bc36f639286f377 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:39.903494  6728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8292e16e5654be6bc408560cf256aaa" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:18:39.904446  6728 raft_consensus.cc:2393] T d8292e16e5654be6bc408560cf256aaa P ccd8a4c3bfe3413cb2ae219b09aea832 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c in current term 2: Already voted for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in this term.
I20260709 13:18:39.903733  8003 raft_consensus.cc:3060] T c4db81d9d329422bb3b4160ca4ac2d1d P b7ab4784c7344b939bc36f639286f377 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:39.905237  7832 leader_election.cc:290] T 24ee15416e3145beaa1b8183453729a3 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:18:39.905598  8010 leader_election.cc:290] T d8292e16e5654be6bc408560cf256aaa P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 3 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:18:39.905966  6725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34f36d59d88f40fe8a2805e604fc6c0a" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:18:39.907022  7993 leader_election.cc:290] T 404190ce4ce94cecbfcb6ea9d1dd8626 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:18:39.908608  6770 leader_election.cc:304] T 4d9def8b32fd443aa94ab1420b06837b P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
I20260709 13:18:39.909192  6772 leader_election.cc:304] T 30e88460611e47b2ba16a46a30b5f416 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:18:39.909577  8046 raft_consensus.cc:2804] T 7a734b5ab7834e05a8c422208acc58b1 P b7ab4784c7344b939bc36f639286f377 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:18:39.910010  8046 raft_consensus.cc:493] T 7a734b5ab7834e05a8c422208acc58b1 P b7ab4784c7344b939bc36f639286f377 [term 1 FOLLOWER]: Starting leader election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:18:39.910461  8046 raft_consensus.cc:3060] T 7a734b5ab7834e05a8c422208acc58b1 P b7ab4784c7344b939bc36f639286f377 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:39.910578  8004 raft_consensus.cc:2749] T 30e88460611e47b2ba16a46a30b5f416 P b7ab4784c7344b939bc36f639286f377 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:18:39.911361  8006 raft_consensus.cc:515] T dbdf895bba214ff68685a24fd17dfb5d P b7ab4784c7344b939bc36f639286f377 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:39.918135  8006 leader_election.cc:290] T dbdf895bba214ff68685a24fd17dfb5d P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 2 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:18:39.919850  7936 raft_consensus.cc:515] T 427c124d773f483294511e80fe340075 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 2 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } attrs { replace: true } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:18:39.890873  7885 raft_consensus.cc:515] T 713b5728a197487c9300b310ab94e5a3 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:39.860216  8018 consensus_queue.cc:1048] T 404190ce4ce94cecbfcb6ea9d1dd8626 P 7ba59cc884714e8aa5f3f0ecaed84cbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.027s
I20260709 13:18:39.919651  7956 raft_consensus.cc:2749] T 24ee15416e3145beaa1b8183453729a3 P b7ab4784c7344b939bc36f639286f377 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:39.927785  6772 leader_election.cc:304] T f5be3a11b23d4ea9b08300a2789821c7 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:18:39.929437  6770 leader_election.cc:304] T 95a75bfe094d4bdc963aba3f08dfcd25 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
W20260709 13:18:39.932422  6697 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.68:45071, user_credentials={real_user=slave}} blocked reactor thread for 43811.1us
I20260709 13:18:39.943048  6731 raft_consensus.cc:1275] T 7887766dc6784fcaa42b35c05fea7a99 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 2 FOLLOWER]: Refusing update from remote peer cd75a17ab2604397adab03bb8b5fd75c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:18:39.946787  6729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24ee15416e3145beaa1b8183453729a3" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:18:39.942195  7965 raft_consensus.cc:2804] T 4d9def8b32fd443aa94ab1420b06837b P b7ab4784c7344b939bc36f639286f377 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:18:39.949129  7965 raft_consensus.cc:493] T 4d9def8b32fd443aa94ab1420b06837b P b7ab4784c7344b939bc36f639286f377 [term 1 FOLLOWER]: Starting leader election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:18:39.949548  7965 raft_consensus.cc:3060] T 4d9def8b32fd443aa94ab1420b06837b P b7ab4784c7344b939bc36f639286f377 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:18:39.950817  8030 log.cc:927] Time spent T 1bf4668eeb70467fb3dc5a0289233b3c P cd75a17ab2604397adab03bb8b5fd75c: Append to log took a long time: real 0.495s	user 0.000s	sys 0.014s
I20260709 13:18:39.952308  6770 leader_election.cc:304] T f3f9c2e2bf644115957398fe4c9459db P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:18:39.952623  7499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24ee15416e3145beaa1b8183453729a3" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:18:39.953393  7499 raft_consensus.cc:2468] T 24ee15416e3145beaa1b8183453729a3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 1.
I20260709 13:18:39.953660  8004 raft_consensus.cc:2749] T f5be3a11b23d4ea9b08300a2789821c7 P b7ab4784c7344b939bc36f639286f377 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:18:39.954370  8004 raft_consensus.cc:2804] T 95a75bfe094d4bdc963aba3f08dfcd25 P b7ab4784c7344b939bc36f639286f377 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:18:39.954720  8004 raft_consensus.cc:493] T 95a75bfe094d4bdc963aba3f08dfcd25 P b7ab4784c7344b939bc36f639286f377 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:39.955036  8004 raft_consensus.cc:3060] T 95a75bfe094d4bdc963aba3f08dfcd25 P b7ab4784c7344b939bc36f639286f377 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:39.955533  7883 leader_election.cc:290] T b3f13b31a1f84f0d89d007eadd57924c P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:18:39.956234  7883 raft_consensus.cc:2749] T f3f9c2e2bf644115957398fe4c9459db P b7ab4784c7344b939bc36f639286f377 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:18:39.968067  6770 leader_election.cc:304] T 44bde925b2e541b69890d70715b85176 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
I20260709 13:18:39.948081  6729 raft_consensus.cc:2376] T 24ee15416e3145beaa1b8183453729a3 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 2 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 2. Re-sending same reply.
I20260709 13:18:39.970299  6728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1528ab62b6fe4e3099d08f141afee116" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:18:39.978055  6731 raft_consensus.cc:1275] T 7c44c4849aa54f2b94d1f1bef9ed546f P ccd8a4c3bfe3413cb2ae219b09aea832 [term 2 FOLLOWER]: Refusing update from remote peer cd75a17ab2604397adab03bb8b5fd75c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:18:39.977957  7501 raft_consensus.cc:1240] T 427c124d773f483294511e80fe340075 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 2 FOLLOWER]: Rejecting Update request from peer cd75a17ab2604397adab03bb8b5fd75c for earlier term 1. Current term is 2. Ops: []
I20260709 13:18:39.973480  6728 raft_consensus.cc:2376] T 1528ab62b6fe4e3099d08f141afee116 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 2 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 2. Re-sending same reply.
I20260709 13:18:39.982406  6770 leader_election.cc:304] T f58dc08b12a2494bb9a1372837970ca2 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
I20260709 13:18:39.985055  6804 raft_consensus.cc:1275] T be1a92657f494cac8dd227d152f50151 P b7ab4784c7344b939bc36f639286f377 [term 3 FOLLOWER]: Refusing update from remote peer 7ba59cc884714e8aa5f3f0ecaed84cbb: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:18:39.985766  6697 leader_election.cc:304] T d8292e16e5654be6bc408560cf256aaa P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:18:39.987327  7938 raft_consensus.cc:2804] T d8292e16e5654be6bc408560cf256aaa P ccd8a4c3bfe3413cb2ae219b09aea832 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:18:39.987901  7938 raft_consensus.cc:493] T d8292e16e5654be6bc408560cf256aaa P ccd8a4c3bfe3413cb2ae219b09aea832 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:39.987461  7946 consensus_queue.cc:1048] T be1a92657f494cac8dd227d152f50151 P 7ba59cc884714e8aa5f3f0ecaed84cbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:18:39.988562  7938 raft_consensus.cc:3060] T d8292e16e5654be6bc408560cf256aaa P ccd8a4c3bfe3413cb2ae219b09aea832 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:39.992842  7832 raft_consensus.cc:493] T bb7fa124c3bf4ef9ab65a407cb008441 P cd75a17ab2604397adab03bb8b5fd75c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 7ba59cc884714e8aa5f3f0ecaed84cbb)
I20260709 13:18:39.993567  8034 raft_consensus.cc:493] T 9e326172347f45e99a0d482b5d8ef768 P cd75a17ab2604397adab03bb8b5fd75c [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:39.994761  8035 raft_consensus.cc:493] T 7ba5dac66ab5497e9e336f2a3c28cda5 P cd75a17ab2604397adab03bb8b5fd75c [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:39.994493  8034 raft_consensus.cc:515] T 9e326172347f45e99a0d482b5d8ef768 P cd75a17ab2604397adab03bb8b5fd75c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:39.996642  7994 consensus_queue.cc:1048] T 95a75bfe094d4bdc963aba3f08dfcd25 P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Connected to new peer: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:18:39.993505  7832 raft_consensus.cc:515] T bb7fa124c3bf4ef9ab65a407cb008441 P cd75a17ab2604397adab03bb8b5fd75c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:18:39.998273  8034 leader_election.cc:290] T 9e326172347f45e99a0d482b5d8ef768 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:18:39.999205  7976 raft_consensus.cc:493] T 3d65025eea89441290d85dd053810e31 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader cd75a17ab2604397adab03bb8b5fd75c)
I20260709 13:18:40.000010  7936 leader_election.cc:290] T 427c124d773f483294511e80fe340075 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 2 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:18:39.999766  7976 raft_consensus.cc:515] T 3d65025eea89441290d85dd053810e31 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:40.001495  7990 leader_election.cc:290] T 07a92dd554674067a83a9cb68c4773f2 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 2 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:18:40.001852  7976 leader_election.cc:290] T 3d65025eea89441290d85dd053810e31 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:18:40.002099  6725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "853ac0a8cbd64ce99457f170216d4d0f" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:18:39.984961  7956 raft_consensus.cc:2804] T 44bde925b2e541b69890d70715b85176 P b7ab4784c7344b939bc36f639286f377 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:18:40.003593  7956 raft_consensus.cc:493] T 44bde925b2e541b69890d70715b85176 P b7ab4784c7344b939bc36f639286f377 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:40.003922  7956 raft_consensus.cc:3060] T 44bde925b2e541b69890d70715b85176 P b7ab4784c7344b939bc36f639286f377 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:40.006649  7965 raft_consensus.cc:515] T 4d9def8b32fd443aa94ab1420b06837b P b7ab4784c7344b939bc36f639286f377 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:40.009848  7965 leader_election.cc:290] T 4d9def8b32fd443aa94ab1420b06837b P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 2 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:18:39.995416  7934 raft_consensus.cc:493] T 1528ab62b6fe4e3099d08f141afee116 P cd75a17ab2604397adab03bb8b5fd75c [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:40.013860  7934 raft_consensus.cc:515] T 1528ab62b6fe4e3099d08f141afee116 P cd75a17ab2604397adab03bb8b5fd75c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } attrs { replace: true } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:18:39.996155  6844 leader_election.cc:400] T 4b8cacb381b746da8d0049b0a83b41dd P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 2 pre-election: Vote denied by peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391) with higher term. Message: Invalid argument: T 4b8cacb381b746da8d0049b0a83b41dd P ccd8a4c3bfe3413cb2ae219b09aea832 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c for earlier term 2. Current term is 3.
I20260709 13:18:40.016185  6844 leader_election.cc:403] T 4b8cacb381b746da8d0049b0a83b41dd P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
W20260709 13:18:40.017403  6798 consensus_meta.cc:287] T bd6869f07b5a4885a0b99fbe60c3b175 P b7ab4784c7344b939bc36f639286f377: Time spent flushing consensus metadata: real 0.517s	user 0.014s	sys 0.000s
I20260709 13:18:40.017752  6798 raft_consensus.cc:2468] T bd6869f07b5a4885a0b99fbe60c3b175 P b7ab4784c7344b939bc36f639286f377 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 4.
I20260709 13:18:40.018620  6873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3d8792045a4583ae2e965b1350a5b4" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:18:40.019268  7885 leader_election.cc:290] T 713b5728a197487c9300b310ab94e5a3 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:18:40.019483  6873 raft_consensus.cc:2468] T bb3d8792045a4583ae2e965b1350a5b4 P cd75a17ab2604397adab03bb8b5fd75c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in term 1.
I20260709 13:18:40.020396  6878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3d8792045a4583ae2e965b1350a5b4" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:18:40.029716  6878 raft_consensus.cc:3060] T bb3d8792045a4583ae2e965b1350a5b4 P cd75a17ab2604397adab03bb8b5fd75c [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:18:39.995450  8035 raft_consensus.cc:515] T 7ba5dac66ab5497e9e336f2a3c28cda5 P cd75a17ab2604397adab03bb8b5fd75c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:18:40.020859  6876 raft_consensus.cc:1275] T d8cee0accdb8499c86d4414b72565a38 P cd75a17ab2604397adab03bb8b5fd75c [term 2 FOLLOWER]: Refusing update from remote peer 7ba59cc884714e8aa5f3f0ecaed84cbb: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:18:39.995939  7992 consensus_queue.cc:1059] T 3a485a995abc4807b6e511e45419f737 P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:18:40.021341  6879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "427c124d773f483294511e80fe340075" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:18:40.022254  6873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ba5dac66ab5497e9e336f2a3c28cda5" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:18:40.038367  6874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "427c124d773f483294511e80fe340075" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:18:40.040764  6728 raft_consensus.cc:1275] T c4db81d9d329422bb3b4160ca4ac2d1d P ccd8a4c3bfe3413cb2ae219b09aea832 [term 2 FOLLOWER]: Refusing update from remote peer cd75a17ab2604397adab03bb8b5fd75c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:18:40.019903  6875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24ee15416e3145beaa1b8183453729a3" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:18:40.041556  6875 raft_consensus.cc:2393] T 24ee15416e3145beaa1b8183453729a3 P cd75a17ab2604397adab03bb8b5fd75c [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in current term 2: Already voted for candidate cd75a17ab2604397adab03bb8b5fd75c in this term.
W20260709 13:18:40.035691  6770 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 53413.4us
I20260709 13:18:40.019770  8031 raft_consensus.cc:2749] T 7887766dc6784fcaa42b35c05fea7a99 P b7ab4784c7344b939bc36f639286f377 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:40.042610  6770 leader_election.cc:304] T f09c2a98de1a4decabd0ff900dd44caa P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
W20260709 13:18:40.043853  6772 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 58318.7us
I20260709 13:18:40.045826  6695 leader_election.cc:304] T dbdf895bba214ff68685a24fd17dfb5d P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
I20260709 13:18:40.052981  6772 leader_election.cc:304] T e31b9971c15848dea59d4d4130141d9e P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
W20260709 13:18:40.055302  6697 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 59345.5us
I20260709 13:18:40.021564  8003 raft_consensus.cc:2749] T c4db81d9d329422bb3b4160ca4ac2d1d P b7ab4784c7344b939bc36f639286f377 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:40.070384  6732 raft_consensus.cc:1240] T e77e330a82df4b43a745d57a68f6f057 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 4 FOLLOWER]: Rejecting Update request from peer cd75a17ab2604397adab03bb8b5fd75c for earlier term 3. Current term is 4. Ops: []
I20260709 13:18:40.071725  8004 raft_consensus.cc:515] T 95a75bfe094d4bdc963aba3f08dfcd25 P b7ab4784c7344b939bc36f639286f377 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:40.075047  7956 raft_consensus.cc:515] T 44bde925b2e541b69890d70715b85176 P b7ab4784c7344b939bc36f639286f377 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:40.076830  8005 leader_election.cc:290] T f03d0dbf16864ca4bc1bb5e4c0334c0f P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:18:40.052457  8010 raft_consensus.cc:2804] T f58dc08b12a2494bb9a1372837970ca2 P b7ab4784c7344b939bc36f639286f377 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:18:40.085683  6873 raft_consensus.cc:2468] T 7ba5dac66ab5497e9e336f2a3c28cda5 P cd75a17ab2604397adab03bb8b5fd75c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in term 2.
I20260709 13:18:40.042445  7891 raft_consensus.cc:2749] T 4b8cacb381b746da8d0049b0a83b41dd P cd75a17ab2604397adab03bb8b5fd75c [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391) with higher term. Message: Invalid argument: T 4b8cacb381b746da8d0049b0a83b41dd P ccd8a4c3bfe3413cb2ae219b09aea832 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c for earlier term 2. Current term is 3.
I20260709 13:18:40.091003  6731 raft_consensus.cc:1275] T a1704639a875409b9959353527b3fd68 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 2 FOLLOWER]: Refusing update from remote peer cd75a17ab2604397adab03bb8b5fd75c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:18:40.094133  7992 raft_consensus.cc:3055] T 3a485a995abc4807b6e511e45419f737 P cd75a17ab2604397adab03bb8b5fd75c [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:18:40.094728  7992 raft_consensus.cc:740] T 3a485a995abc4807b6e511e45419f737 P cd75a17ab2604397adab03bb8b5fd75c [term 2 LEADER]: Becoming Follower/Learner. State: Replica: cd75a17ab2604397adab03bb8b5fd75c, State: Running, Role: LEADER
I20260709 13:18:40.066557  6695 leader_election.cc:304] T 427c124d773f483294511e80fe340075 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
I20260709 13:18:40.024668  7958 raft_consensus.cc:493] T bd6869f07b5a4885a0b99fbe60c3b175 P b7ab4784c7344b939bc36f639286f377 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:39.972332  8022 consensus_queue.cc:1059] T d8cee0accdb8499c86d4414b72565a38 P 7ba59cc884714e8aa5f3f0ecaed84cbb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.077s
I20260709 13:18:40.066871  6725 raft_consensus.cc:1275] T ab432e62819d499eaaf3dd55481dd930 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 2 FOLLOWER]: Refusing update from remote peer cd75a17ab2604397adab03bb8b5fd75c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 13:18:40.173621  6770 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 131072us
I20260709 13:18:40.174683  6770 leader_election.cc:400] T be1a92657f494cac8dd227d152f50151 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 2 election: Vote denied by peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391) with higher term. Message: Invalid argument: T be1a92657f494cac8dd227d152f50151 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate b7ab4784c7344b939bc36f639286f377 for earlier term 2. Current term is 3.
I20260709 13:18:40.175010  6770 leader_election.cc:403] T be1a92657f494cac8dd227d152f50151 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260709 13:18:40.173758  7949 raft_consensus.cc:493] T be1a92657f494cac8dd227d152f50151 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:40.085577  7885 raft_consensus.cc:2804] T dbdf895bba214ff68685a24fd17dfb5d P ccd8a4c3bfe3413cb2ae219b09aea832 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:18:40.176975  7949 raft_consensus.cc:515] T be1a92657f494cac8dd227d152f50151 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:18:40.175120  6798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "427c124d773f483294511e80fe340075" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:18:40.198130  8010 raft_consensus.cc:697] T f58dc08b12a2494bb9a1372837970ca2 P b7ab4784c7344b939bc36f639286f377 [term 3 LEADER]: Becoming Leader. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
I20260709 13:18:40.276808  7936 raft_consensus.cc:493] T 17587d6730594da4a56fa13a353232a1 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:40.257525  6728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a92dd554674067a83a9cb68c4773f2" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
W20260709 13:18:40.198690  6695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 132309us
W20260709 13:18:40.276180  6772 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 223316us
I20260709 13:18:40.287477  6772 leader_election.cc:304] T 4f00a2e87e56452083b759f60d461ee3 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:18:40.289089  6731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3022224cc81473690653a83d4e99470" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
W20260709 13:18:40.277474  8048 log.cc:927] Time spent T 30e88460611e47b2ba16a46a30b5f416 P cd75a17ab2604397adab03bb8b5fd75c: Append to log took a long time: real 0.370s	user 0.006s	sys 0.014s
I20260709 13:18:40.193384  8006 raft_consensus.cc:2804] T f09c2a98de1a4decabd0ff900dd44caa P b7ab4784c7344b939bc36f639286f377 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 13:18:40.302565  6697 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 126372us
I20260709 13:18:40.198472  8005 raft_consensus.cc:3060] T e31b9971c15848dea59d4d4130141d9e P b7ab4784c7344b939bc36f639286f377 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:40.312551  6878 raft_consensus.cc:2468] T bb3d8792045a4583ae2e965b1350a5b4 P cd75a17ab2604397adab03bb8b5fd75c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in term 3.
I20260709 13:18:40.174489  7958 raft_consensus.cc:515] T bd6869f07b5a4885a0b99fbe60c3b175 P b7ab4784c7344b939bc36f639286f377 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:40.286914  6798 raft_consensus.cc:3060] T 427c124d773f483294511e80fe340075 P b7ab4784c7344b939bc36f639286f377 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:40.304899  6728 raft_consensus.cc:2468] T 07a92dd554674067a83a9cb68c4773f2 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 2.
I20260709 13:18:40.280453  7936 raft_consensus.cc:515] T 17587d6730594da4a56fa13a353232a1 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:18:40.198195  7885 raft_consensus.cc:493] T dbdf895bba214ff68685a24fd17dfb5d P ccd8a4c3bfe3413cb2ae219b09aea832 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:40.304353  6729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c44c4849aa54f2b94d1f1bef9ed546f" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:18:40.332654  6729 raft_consensus.cc:2468] T 7c44c4849aa54f2b94d1f1bef9ed546f P ccd8a4c3bfe3413cb2ae219b09aea832 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 2.
I20260709 13:18:40.321319  7894 raft_consensus.cc:2804] T 427c124d773f483294511e80fe340075 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 13:18:40.336491  6772 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 56751.3us
I20260709 13:18:40.257608  8046 raft_consensus.cc:515] T 7a734b5ab7834e05a8c422208acc58b1 P b7ab4784c7344b939bc36f639286f377 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:40.279956  7938 raft_consensus.cc:515] T d8292e16e5654be6bc408560cf256aaa P ccd8a4c3bfe3413cb2ae219b09aea832 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:40.363178  6729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbdf895bba214ff68685a24fd17dfb5d" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:18:40.363555  8010 consensus_queue.cc:237] T f58dc08b12a2494bb9a1372837970ca2 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:40.364907  7938 leader_election.cc:290] T d8292e16e5654be6bc408560cf256aaa P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 3 election: Requested vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:18:40.321321  8006 raft_consensus.cc:493] T f09c2a98de1a4decabd0ff900dd44caa P b7ab4784c7344b939bc36f639286f377 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:40.365662  8006 raft_consensus.cc:3060] T f09c2a98de1a4decabd0ff900dd44caa P b7ab4784c7344b939bc36f639286f377 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:18:40.368193  8033 thread.cc:641] apply [worker] (thread pool) Time spent creating pthread: real 0.549s	user 0.026s	sys 0.025s
I20260709 13:18:40.325300  6727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "711ef6523deb4cbe8ef2ba61e1c21c98" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:18:40.368804  7883 raft_consensus.cc:2749] T 4f00a2e87e56452083b759f60d461ee3 P b7ab4784c7344b939bc36f639286f377 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:18:40.369295  6727 raft_consensus.cc:2393] T 711ef6523deb4cbe8ef2ba61e1c21c98 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7ab4784c7344b939bc36f639286f377 in current term 2: Already voted for candidate cd75a17ab2604397adab03bb8b5fd75c in this term.
I20260709 13:18:40.369908  7956 leader_election.cc:290] T 44bde925b2e541b69890d70715b85176 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 3 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:18:40.370280  6802 raft_consensus.cc:1275] T c4db81d9d329422bb3b4160ca4ac2d1d P b7ab4784c7344b939bc36f639286f377 [term 2 FOLLOWER]: Refusing update from remote peer cd75a17ab2604397adab03bb8b5fd75c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:18:40.370644  6727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c37d41cd9164c15a6826ca62a851a69" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
W20260709 13:18:40.372399  6695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 65317.3us
I20260709 13:18:40.335940  6726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab432e62819d499eaaf3dd55481dd930" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:18:40.373196  6695 leader_election.cc:304] T a1704639a875409b9959353527b3fd68 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
I20260709 13:18:40.374308  6695 leader_election.cc:304] T 7a734b5ab7834e05a8c422208acc58b1 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
I20260709 13:18:40.375078  7938 raft_consensus.cc:2804] T a1704639a875409b9959353527b3fd68 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:18:40.375607  7938 raft_consensus.cc:493] T a1704639a875409b9959353527b3fd68 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:40.375980  7938 raft_consensus.cc:3060] T a1704639a875409b9959353527b3fd68 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:40.376394  8036 raft_consensus.cc:515] T b56bf91d90824c959e21e0cee5ba1816 P b7ab4784c7344b939bc36f639286f377 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:40.373046  6727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1704639a875409b9959353527b3fd68" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:18:40.332448  8004 leader_election.cc:290] T 95a75bfe094d4bdc963aba3f08dfcd25 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 3 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:18:40.379428  6772 leader_election.cc:304] T d33d5ee8ef6f415593d8df52063161ad P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:18:40.373385  6726 raft_consensus.cc:2468] T ab432e62819d499eaaf3dd55481dd930 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 2.
W20260709 13:18:40.368597  8033 thread.cc:608] apply [worker] (thread pool) Time spent starting thread: real 0.597s	user 0.026s	sys 0.025s
I20260709 13:18:40.378655  8036 leader_election.cc:290] T b56bf91d90824c959e21e0cee5ba1816 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 3 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:18:40.337009  7885 raft_consensus.cc:3060] T dbdf895bba214ff68685a24fd17dfb5d P ccd8a4c3bfe3413cb2ae219b09aea832 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:40.337992  6725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3022224cc81473690653a83d4e99470" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:18:40.338337  8037 raft_consensus.cc:493] T 4275cf08e63345f993bce8664eada830 P b7ab4784c7344b939bc36f639286f377 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:18:40.393173  6695 leader_election.cc:304] T 07a92dd554674067a83a9cb68c4773f2 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
I20260709 13:18:40.385768  7990 raft_consensus.cc:2749] T be1a92657f494cac8dd227d152f50151 P b7ab4784c7344b939bc36f639286f377 [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391) with higher term. Message: Invalid argument: T be1a92657f494cac8dd227d152f50151 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate b7ab4784c7344b939bc36f639286f377 for earlier term 2. Current term is 3.
I20260709 13:18:40.397251  6807 raft_consensus.cc:1275] T ab432e62819d499eaaf3dd55481dd930 P b7ab4784c7344b939bc36f639286f377 [term 2 FOLLOWER]: Refusing update from remote peer cd75a17ab2604397adab03bb8b5fd75c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:18:40.398638  6802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8292e16e5654be6bc408560cf256aaa" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:18:40.388774  7993 raft_consensus.cc:2804] T 7a734b5ab7834e05a8c422208acc58b1 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:18:40.390117  7934 leader_election.cc:290] T 1528ab62b6fe4e3099d08f141afee116 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:18:40.399881  6802 raft_consensus.cc:2368] T d8292e16e5654be6bc408560cf256aaa P b7ab4784c7344b939bc36f639286f377 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c for earlier term 2. Current term is 3.
I20260709 13:18:40.400154  6806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34f36d59d88f40fe8a2805e604fc6c0a" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:18:40.400763  7883 raft_consensus.cc:2804] T d33d5ee8ef6f415593d8df52063161ad P b7ab4784c7344b939bc36f639286f377 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:18:40.403287  6695 leader_election.cc:304] T f09c2a98de1a4decabd0ff900dd44caa P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
I20260709 13:18:40.402243  7993 raft_consensus.cc:493] T 7a734b5ab7834e05a8c422208acc58b1 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:40.405666  7883 raft_consensus.cc:697] T d33d5ee8ef6f415593d8df52063161ad P b7ab4784c7344b939bc36f639286f377 [term 3 LEADER]: Becoming Leader. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
I20260709 13:18:40.407390  7992 consensus_queue.cc:260] T 3a485a995abc4807b6e511e45419f737 P cd75a17ab2604397adab03bb8b5fd75c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:40.418358  7992 raft_consensus.cc:3060] T 3a485a995abc4807b6e511e45419f737 P cd75a17ab2604397adab03bb8b5fd75c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:40.418939  7946 raft_consensus.cc:3055] T d8cee0accdb8499c86d4414b72565a38 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:18:40.419503  7946 raft_consensus.cc:740] T d8cee0accdb8499c86d4414b72565a38 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 7ba59cc884714e8aa5f3f0ecaed84cbb, State: Running, Role: LEADER
I20260709 13:18:40.420428  7883 consensus_queue.cc:237] T d33d5ee8ef6f415593d8df52063161ad P b7ab4784c7344b939bc36f639286f377 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:40.421154  8006 raft_consensus.cc:515] T f09c2a98de1a4decabd0ff900dd44caa P b7ab4784c7344b939bc36f639286f377 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:40.423431  8035 leader_election.cc:290] T 7ba5dac66ab5497e9e336f2a3c28cda5 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:18:40.423645  8006 leader_election.cc:290] T f09c2a98de1a4decabd0ff900dd44caa P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 3 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:18:40.407047  6803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4b8bd455d5a47c18a1380839c6e0d61" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:18:40.430310  6803 raft_consensus.cc:2468] T f4b8bd455d5a47c18a1380839c6e0d61 P b7ab4784c7344b939bc36f639286f377 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 1.
I20260709 13:18:40.408190  7976 raft_consensus.cc:2804] T 07a92dd554674067a83a9cb68c4773f2 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:18:40.431602  7976 raft_consensus.cc:493] T 07a92dd554674067a83a9cb68c4773f2 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:40.432111  7976 raft_consensus.cc:3060] T 07a92dd554674067a83a9cb68c4773f2 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:40.427829  8037 raft_consensus.cc:515] T 4275cf08e63345f993bce8664eada830 P b7ab4784c7344b939bc36f639286f377 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:40.434909  6798 raft_consensus.cc:2468] T 427c124d773f483294511e80fe340075 P b7ab4784c7344b939bc36f639286f377 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in term 2.
I20260709 13:18:40.435299  8037 leader_election.cc:290] T 4275cf08e63345f993bce8664eada830 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:18:40.404496  6723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3f13b31a1f84f0d89d007eadd57924c" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:18:40.438983  6723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a92dd554674067a83a9cb68c4773f2" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:18:40.416895  6726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34f36d59d88f40fe8a2805e604fc6c0a" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:18:40.441619  6726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3d8792045a4583ae2e965b1350a5b4" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:18:40.442770  7958 leader_election.cc:290] T bd6869f07b5a4885a0b99fbe60c3b175 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
W20260709 13:18:40.424444  6772 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 45188.3us
I20260709 13:18:40.425323  7949 leader_election.cc:290] T be1a92657f494cac8dd227d152f50151 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:18:40.400324  7936 leader_election.cc:290] T 17587d6730594da4a56fa13a353232a1 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:18:40.425243  6732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f03d0dbf16864ca4bc1bb5e4c0334c0f" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:18:40.406288  8046 leader_election.cc:290] T 7a734b5ab7834e05a8c422208acc58b1 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 2 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:18:40.428180  6804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "853ac0a8cbd64ce99457f170216d4d0f" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:18:40.447490  6807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17587d6730594da4a56fa13a353232a1" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
W20260709 13:18:40.456192  6695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 53775us
I20260709 13:18:40.442771  6726 raft_consensus.cc:2368] T bb3d8792045a4583ae2e965b1350a5b4 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c for earlier term 2. Current term is 3.
I20260709 13:18:40.443665  8035 consensus_queue.cc:1059] T 427c124d773f483294511e80fe340075 P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.005s
I20260709 13:18:40.428263  7993 raft_consensus.cc:3060] T 7a734b5ab7834e05a8c422208acc58b1 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:40.460867  8035 raft_consensus.cc:3055] T 427c124d773f483294511e80fe340075 P cd75a17ab2604397adab03bb8b5fd75c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:18:40.464363  6732 raft_consensus.cc:2468] T f03d0dbf16864ca4bc1bb5e4c0334c0f P ccd8a4c3bfe3413cb2ae219b09aea832 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 2.
I20260709 13:18:40.461828  6726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b3759de40694069b13c0f8bd40e5709" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:18:40.468117  6772 leader_election.cc:304] T 22ccee1b570c4ad3a57bd7aec085b1b4 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:18:40.469486  6802 raft_consensus.cc:1240] T 44bde925b2e541b69890d70715b85176 P b7ab4784c7344b939bc36f639286f377 [term 3 FOLLOWER]: Rejecting Update request from peer cd75a17ab2604397adab03bb8b5fd75c for earlier term 2. Current term is 3. Ops: []
I20260709 13:18:40.469779  6695 leader_election.cc:304] T 95a75bfe094d4bdc963aba3f08dfcd25 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
W20260709 13:18:40.470961  6697 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 58112.5us
I20260709 13:18:40.471820  6732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbdf895bba214ff68685a24fd17dfb5d" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:18:40.467170  7946 consensus_queue.cc:260] T d8cee0accdb8499c86d4414b72565a38 P 7ba59cc884714e8aa5f3f0ecaed84cbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:18:40.477016  7946 raft_consensus.cc:3060] T d8cee0accdb8499c86d4414b72565a38 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:40.477329  6726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "713b5728a197487c9300b310ab94e5a3" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:18:40.478412  6726 raft_consensus.cc:2376] T 713b5728a197487c9300b310ab94e5a3 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 2 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 2. Re-sending same reply.
I20260709 13:18:40.478674  6798 raft_consensus.cc:1240] T e77e330a82df4b43a745d57a68f6f057 P b7ab4784c7344b939bc36f639286f377 [term 4 FOLLOWER]: Rejecting Update request from peer cd75a17ab2604397adab03bb8b5fd75c for earlier term 3. Current term is 4. Ops: []
I20260709 13:18:40.480142  8066 raft_consensus.cc:2804] T f09c2a98de1a4decabd0ff900dd44caa P ccd8a4c3bfe3413cb2ae219b09aea832 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:18:40.480698  8066 raft_consensus.cc:493] T f09c2a98de1a4decabd0ff900dd44caa P ccd8a4c3bfe3413cb2ae219b09aea832 [term 2 FOLLOWER]: Starting leader election (detected failure of leader cd75a17ab2604397adab03bb8b5fd75c)
I20260709 13:18:40.481244  8066 raft_consensus.cc:3060] T f09c2a98de1a4decabd0ff900dd44caa P ccd8a4c3bfe3413cb2ae219b09aea832 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:40.486756  8036 raft_consensus.cc:3060] T 22ccee1b570c4ad3a57bd7aec085b1b4 P b7ab4784c7344b939bc36f639286f377 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:40.494783  6804 raft_consensus.cc:1240] T d8cee0accdb8499c86d4414b72565a38 P b7ab4784c7344b939bc36f639286f377 [term 3 FOLLOWER]: Rejecting Update request from peer 7ba59cc884714e8aa5f3f0ecaed84cbb for earlier term 2. Current term is 3. Ops: [2.5-2.5]
I20260709 13:18:40.466293  8035 raft_consensus.cc:740] T 427c124d773f483294511e80fe340075 P cd75a17ab2604397adab03bb8b5fd75c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: cd75a17ab2604397adab03bb8b5fd75c, State: Running, Role: LEADER
I20260709 13:18:40.516136  8036 raft_consensus.cc:2749] T 22ccee1b570c4ad3a57bd7aec085b1b4 P b7ab4784c7344b939bc36f639286f377 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:40.511329  8066 raft_consensus.cc:515] T f09c2a98de1a4decabd0ff900dd44caa P ccd8a4c3bfe3413cb2ae219b09aea832 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:40.519131  8066 leader_election.cc:290] T f09c2a98de1a4decabd0ff900dd44caa P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 3 election: Requested vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:18:40.500331  6772 leader_election.cc:304] T 713b5728a197487c9300b310ab94e5a3 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:18:40.501511  6725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3411566abe2d4c9bb4b2adfdd05e6f17" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:18:40.524495  8064 raft_consensus.cc:2804] T 95a75bfe094d4bdc963aba3f08dfcd25 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:18:40.524953  8064 raft_consensus.cc:493] T 95a75bfe094d4bdc963aba3f08dfcd25 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:40.502990  6807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a92dd554674067a83a9cb68c4773f2" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:18:40.525300  8064 raft_consensus.cc:3060] T 95a75bfe094d4bdc963aba3f08dfcd25 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:40.525734  6807 raft_consensus.cc:2468] T 07a92dd554674067a83a9cb68c4773f2 P b7ab4784c7344b939bc36f639286f377 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 2.
I20260709 13:18:40.503000  6802 raft_consensus.cc:1240] T 3a485a995abc4807b6e511e45419f737 P b7ab4784c7344b939bc36f639286f377 [term 3 LEADER]: Rejecting Update request from peer cd75a17ab2604397adab03bb8b5fd75c for earlier term 2. Current term is 3. Ops: []
I20260709 13:18:40.503381  6806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3022224cc81473690653a83d4e99470" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:18:40.527294  6806 raft_consensus.cc:2468] T a3022224cc81473690653a83d4e99470 P b7ab4784c7344b939bc36f639286f377 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 2.
I20260709 13:18:40.479923  6726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8292e16e5654be6bc408560cf256aaa" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:18:40.504170  7976 raft_consensus.cc:515] T 07a92dd554674067a83a9cb68c4773f2 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:40.528693  6726 raft_consensus.cc:2393] T d8292e16e5654be6bc408560cf256aaa P ccd8a4c3bfe3413cb2ae219b09aea832 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate b7ab4784c7344b939bc36f639286f377 in current term 3: Already voted for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in this term.
I20260709 13:18:40.529789  6726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e326172347f45e99a0d482b5d8ef768" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:18:40.530048  7976 leader_election.cc:290] T 07a92dd554674067a83a9cb68c4773f2 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 3 election: Requested vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:18:40.530553  6726 raft_consensus.cc:2468] T 9e326172347f45e99a0d482b5d8ef768 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 2.
I20260709 13:18:40.531001  6723 raft_consensus.cc:2368] T 07a92dd554674067a83a9cb68c4773f2 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate b7ab4784c7344b939bc36f639286f377 for earlier term 2. Current term is 3.
W20260709 13:18:40.531244  7468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 300498us
I20260709 13:18:40.533844  6723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24ee15416e3145beaa1b8183453729a3" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:18:40.505437  6801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b3759de40694069b13c0f8bd40e5709" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:18:40.506186  6800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbdf895bba214ff68685a24fd17dfb5d" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:18:40.542649  6800 raft_consensus.cc:2468] T dbdf895bba214ff68685a24fd17dfb5d P b7ab4784c7344b939bc36f639286f377 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 2.
I20260709 13:18:40.507306  7949 raft_consensus.cc:493] T 8c7f33e544204fbaac4078e3e83bbf4e P ccd8a4c3bfe3413cb2ae219b09aea832 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:18:40.543484  6723 raft_consensus.cc:2468] T 24ee15416e3145beaa1b8183453729a3 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 2.
I20260709 13:18:40.543469  7949 raft_consensus.cc:515] T 8c7f33e544204fbaac4078e3e83bbf4e P ccd8a4c3bfe3413cb2ae219b09aea832 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:40.544414  7970 raft_consensus.cc:493] T 4f00a2e87e56452083b759f60d461ee3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 3 FOLLOWER]: Starting pre-election (detected failure of leader cd75a17ab2604397adab03bb8b5fd75c)
I20260709 13:18:40.544759  6723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c7f33e544204fbaac4078e3e83bbf4e" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:18:40.545012  7970 raft_consensus.cc:515] T 4f00a2e87e56452083b759f60d461ee3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:18:40.545387  6723 raft_consensus.cc:2468] T 8c7f33e544204fbaac4078e3e83bbf4e P ccd8a4c3bfe3413cb2ae219b09aea832 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 1.
I20260709 13:18:40.546238  6723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bf4668eeb70467fb3dc5a0289233b3c" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:18:40.547281  7949 leader_election.cc:290] T 8c7f33e544204fbaac4078e3e83bbf4e P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:18:40.547580  7970 leader_election.cc:290] T 4f00a2e87e56452083b759f60d461ee3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:18:40.468241  7936 consensus_queue.cc:1048] T be1a92657f494cac8dd227d152f50151 P 7ba59cc884714e8aa5f3f0ecaed84cbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.043s
I20260709 13:18:40.549875  6800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f00a2e87e56452083b759f60d461ee3" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:18:40.550303  7832 leader_election.cc:290] T bb7fa124c3bf4ef9ab65a407cb008441 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:18:40.550814  6800 raft_consensus.cc:2468] T 4f00a2e87e56452083b759f60d461ee3 P b7ab4784c7344b939bc36f639286f377 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in term 3.
I20260709 13:18:40.552245  7501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb7fa124c3bf4ef9ab65a407cb008441" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:18:40.552605  7503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1528ab62b6fe4e3099d08f141afee116" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:18:40.553345  7503 raft_consensus.cc:2468] T 1528ab62b6fe4e3099d08f141afee116 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 1.
I20260709 13:18:40.554021  6731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fa34c08b205435dba97346991aa1f92" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:18:40.554396  7498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ba5dac66ab5497e9e336f2a3c28cda5" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:18:40.555017  7498 raft_consensus.cc:2468] T 7ba5dac66ab5497e9e336f2a3c28cda5 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 1.
I20260709 13:18:40.556843  7976 raft_consensus.cc:493] T 3a485a995abc4807b6e511e45419f737 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:40.557484  6626 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:53234 (request call id 168) took 3271 ms. Trace:
I20260709 13:18:40.557442  7976 raft_consensus.cc:515] T 3a485a995abc4807b6e511e45419f737 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:40.558147  6846 leader_election.cc:304] T 7ba5dac66ab5497e9e336f2a3c28cda5 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:18:40.514201  8005 raft_consensus.cc:2749] T e31b9971c15848dea59d4d4130141d9e P b7ab4784c7344b939bc36f639286f377 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:40.535669  6732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d9def8b32fd443aa94ab1420b06837b" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:18:40.551241  6724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c240553ce044eedb41541d72b9475d7" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:18:40.560407  6801 raft_consensus.cc:3060] T 711ef6523deb4cbe8ef2ba61e1c21c98 P b7ab4784c7344b939bc36f639286f377 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:40.572489  6724 raft_consensus.cc:3060] T 2c240553ce044eedb41541d72b9475d7 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:40.573961  6807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3411566abe2d4c9bb4b2adfdd05e6f17" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:18:40.574684  6807 raft_consensus.cc:2468] T 3411566abe2d4c9bb4b2adfdd05e6f17 P b7ab4784c7344b939bc36f639286f377 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 1.
I20260709 13:18:40.575600  6807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4275cf08e63345f993bce8664eada830" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:18:40.561197  7466 leader_election.cc:304] T 4f00a2e87e56452083b759f60d461ee3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, b7ab4784c7344b939bc36f639286f377; no voters: 
I20260709 13:18:40.561604  6805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c7f33e544204fbaac4078e3e83bbf4e" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:18:40.577770  6731 raft_consensus.cc:1275] T b56bf91d90824c959e21e0cee5ba1816 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 2 FOLLOWER]: Refusing update from remote peer cd75a17ab2604397adab03bb8b5fd75c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:18:40.577862  6805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb7fa124c3bf4ef9ab65a407cb008441" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:18:40.578913  6805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1528ab62b6fe4e3099d08f141afee116" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:18:40.579062  6731 raft_consensus.cc:1275] T 711ef6523deb4cbe8ef2ba61e1c21c98 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 2 FOLLOWER]: Refusing update from remote peer cd75a17ab2604397adab03bb8b5fd75c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:18:40.579438  6805 raft_consensus.cc:2468] T 1528ab62b6fe4e3099d08f141afee116 P b7ab4784c7344b939bc36f639286f377 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 2.
I20260709 13:18:40.561940  7832 raft_consensus.cc:2804] T 7ba5dac66ab5497e9e336f2a3c28cda5 P cd75a17ab2604397adab03bb8b5fd75c [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:18:40.580452  7832 raft_consensus.cc:493] T 7ba5dac66ab5497e9e336f2a3c28cda5 P cd75a17ab2604397adab03bb8b5fd75c [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:40.580756  7832 raft_consensus.cc:3060] T 7ba5dac66ab5497e9e336f2a3c28cda5 P cd75a17ab2604397adab03bb8b5fd75c [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:18:40.582129  8063 log.cc:927] Time spent T f58dc08b12a2494bb9a1372837970ca2 P b7ab4784c7344b939bc36f639286f377: Append to log took a long time: real 0.119s	user 0.000s	sys 0.000s
I20260709 13:18:40.525317  6725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a75bfe094d4bdc963aba3f08dfcd25" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:18:40.537284  8036 raft_consensus.cc:3060] T 713b5728a197487c9300b310ab94e5a3 P b7ab4784c7344b939bc36f639286f377 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:18:40.537539  6772 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 62110us
I20260709 13:18:40.515810  8035 consensus_queue.cc:260] T 427c124d773f483294511e80fe340075 P cd75a17ab2604397adab03bb8b5fd75c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.3, Last appended by leader: 3, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } attrs { replace: true } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:18:40.540153  6730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4275cf08e63345f993bce8664eada830" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:18:40.540988  6728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e326172347f45e99a0d482b5d8ef768" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:18:40.504769  6803 raft_consensus.cc:1240] T 95a75bfe094d4bdc963aba3f08dfcd25 P b7ab4784c7344b939bc36f639286f377 [term 3 FOLLOWER]: Rejecting Update request from peer cd75a17ab2604397adab03bb8b5fd75c for earlier term 2. Current term is 3. Ops: []
I20260709 13:18:40.506536  6798 raft_consensus.cc:1240] T a1704639a875409b9959353527b3fd68 P b7ab4784c7344b939bc36f639286f377 [term 3 FOLLOWER]: Rejecting Update request from peer cd75a17ab2604397adab03bb8b5fd75c for earlier term 2. Current term is 3. Ops: []
I20260709 13:18:40.582293  8018 raft_consensus.cc:2804] T 4f00a2e87e56452083b759f60d461ee3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:18:40.536347  7994 consensus_queue.cc:1048] T 7887766dc6784fcaa42b35c05fea7a99 P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Connected to new peer: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:18:40.583657  6805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ba5dac66ab5497e9e336f2a3c28cda5" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:18:40.632596  6728 raft_consensus.cc:3060] T 9e326172347f45e99a0d482b5d8ef768 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:40.624598  6723 raft_consensus.cc:1275] T 3a485a995abc4807b6e511e45419f737 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 3 FOLLOWER]: Refusing update from remote peer b7ab4784c7344b939bc36f639286f377: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:18:40.570412  6799 raft_consensus.cc:1275] T e31b9971c15848dea59d4d4130141d9e P b7ab4784c7344b939bc36f639286f377 [term 2 FOLLOWER]: Refusing update from remote peer cd75a17ab2604397adab03bb8b5fd75c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:18:40.576807  6806 raft_consensus.cc:1275] T 22ccee1b570c4ad3a57bd7aec085b1b4 P b7ab4784c7344b939bc36f639286f377 [term 2 FOLLOWER]: Refusing update from remote peer cd75a17ab2604397adab03bb8b5fd75c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:18:40.634799  6805 raft_consensus.cc:2468] T 7ba5dac66ab5497e9e336f2a3c28cda5 P b7ab4784c7344b939bc36f639286f377 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 2.
I20260709 13:18:40.560598  6800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bf4668eeb70467fb3dc5a0289233b3c" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
W20260709 13:18:40.568796  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 46330.3us
I20260709 13:18:40.561892  6627 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:51654 (request call id 75) took 3421 ms. Trace:
I20260709 13:18:40.606891  6807 raft_consensus.cc:2468] T 4275cf08e63345f993bce8664eada830 P b7ab4784c7344b939bc36f639286f377 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 1.
I20260709 13:18:40.605722  6732 raft_consensus.cc:2468] T 4d9def8b32fd443aa94ab1420b06837b P ccd8a4c3bfe3413cb2ae219b09aea832 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 2.
I20260709 13:18:40.571055  6802 raft_consensus.cc:1240] T b56bf91d90824c959e21e0cee5ba1816 P b7ab4784c7344b939bc36f639286f377 [term 3 FOLLOWER]: Rejecting Update request from peer cd75a17ab2604397adab03bb8b5fd75c for earlier term 2. Current term is 3. Ops: []
I20260709 13:18:40.637140  6772 leader_election.cc:304] T 427c124d773f483294511e80fe340075 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
W20260709 13:18:40.637538  6697 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 165283us
I20260709 13:18:40.640868  8005 raft_consensus.cc:2749] T 427c124d773f483294511e80fe340075 P b7ab4784c7344b939bc36f639286f377 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:40.641044  7992 consensus_queue.cc:1048] T 7c44c4849aa54f2b94d1f1bef9ed546f P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Connected to new peer: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 13:18:40.640861  7467 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:40.645495  6726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "427c124d773f483294511e80fe340075" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:18:40.597816  6804 raft_consensus.cc:1275] T 20f6842e26174571996b8dea4151d4be P b7ab4784c7344b939bc36f639286f377 [term 2 FOLLOWER]: Refusing update from remote peer cd75a17ab2604397adab03bb8b5fd75c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:18:40.649967  7993 raft_consensus.cc:515] T 7a734b5ab7834e05a8c422208acc58b1 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:40.650707  6724 raft_consensus.cc:2468] T 2c240553ce044eedb41541d72b9475d7 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 3.
I20260709 13:18:40.559646  7976 leader_election.cc:290] T 3a485a995abc4807b6e511e45419f737 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:18:40.651717  8036 raft_consensus.cc:2749] T 713b5728a197487c9300b310ab94e5a3 P b7ab4784c7344b939bc36f639286f377 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:40.650002  6772 leader_election.cc:304] T 853ac0a8cbd64ce99457f170216d4d0f P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:18:40.653769  6800 raft_consensus.cc:2410] T 1bf4668eeb70467fb3dc5a0289233b3c P b7ab4784c7344b939bc36f639286f377 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:18:40.660008  6723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a734b5ab7834e05a8c422208acc58b1" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:18:40.660817  6723 raft_consensus.cc:2368] T 7a734b5ab7834e05a8c422208acc58b1 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate b7ab4784c7344b939bc36f639286f377 for earlier term 2. Current term is 3.
I20260709 13:18:40.663829  6878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3022224cc81473690653a83d4e99470" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:18:40.664736  6878 raft_consensus.cc:2468] T a3022224cc81473690653a83d4e99470 P cd75a17ab2604397adab03bb8b5fd75c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 2.
I20260709 13:18:40.665558  6875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "711ef6523deb4cbe8ef2ba61e1c21c98" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:18:40.670212  6723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09c2a98de1a4decabd0ff900dd44caa" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:18:40.569146  7894 raft_consensus.cc:493] T 427c124d773f483294511e80fe340075 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 1 FOLLOWER]: Starting leader election (detected failure of leader cd75a17ab2604397adab03bb8b5fd75c)
I20260709 13:18:40.672716  6875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a92dd554674067a83a9cb68c4773f2" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:18:40.670435  6874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab432e62819d499eaaf3dd55481dd930" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:18:40.669678  7466 leader_election.cc:304] T 427c124d773f483294511e80fe340075 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, b7ab4784c7344b939bc36f639286f377; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:18:40.673982  6731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1528ab62b6fe4e3099d08f141afee116" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:18:40.673081  6732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4275cf08e63345f993bce8664eada830" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:18:40.674556  6731 raft_consensus.cc:2468] T 1528ab62b6fe4e3099d08f141afee116 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 2.
W20260709 13:18:40.670778  6695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 203529us
I20260709 13:18:40.633359  8018 raft_consensus.cc:493] T 4f00a2e87e56452083b759f60d461ee3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 3 FOLLOWER]: Starting leader election (detected failure of leader cd75a17ab2604397adab03bb8b5fd75c)
I20260709 13:18:40.680292  8018 raft_consensus.cc:3060] T 4f00a2e87e56452083b759f60d461ee3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:40.680337  6800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24ee15416e3145beaa1b8183453729a3" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:18:40.681097  6800 raft_consensus.cc:2468] T 24ee15416e3145beaa1b8183453729a3 P b7ab4784c7344b939bc36f639286f377 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 2.
I20260709 13:18:40.682628  6800 raft_consensus.cc:1240] T 427c124d773f483294511e80fe340075 P b7ab4784c7344b939bc36f639286f377 [term 2 FOLLOWER]: Rejecting Update request from peer cd75a17ab2604397adab03bb8b5fd75c for earlier term 1. Current term is 2. Ops: [1.3-1.3]
I20260709 13:18:40.683451  6874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbdf895bba214ff68685a24fd17dfb5d" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:18:40.604813  7885 raft_consensus.cc:515] T dbdf895bba214ff68685a24fd17dfb5d P ccd8a4c3bfe3413cb2ae219b09aea832 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:40.585165  7938 raft_consensus.cc:515] T a1704639a875409b9959353527b3fd68 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:40.678224  7502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3f13b31a1f84f0d89d007eadd57924c" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:18:40.684266  6874 raft_consensus.cc:2393] T dbdf895bba214ff68685a24fd17dfb5d P cd75a17ab2604397adab03bb8b5fd75c [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate b7ab4784c7344b939bc36f639286f377 in current term 2: Already voted for candidate cd75a17ab2604397adab03bb8b5fd75c in this term.
I20260709 13:18:40.675694  6878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8cee0accdb8499c86d4414b72565a38" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:18:40.675998  6872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1704639a875409b9959353527b3fd68" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:18:40.672026  6879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e326172347f45e99a0d482b5d8ef768" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:18:40.676534  7499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8cee0accdb8499c86d4414b72565a38" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb"
I20260709 13:18:40.676599  6877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c44c4849aa54f2b94d1f1bef9ed546f" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:18:40.677093  7503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be1a92657f494cac8dd227d152f50151" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb"
I20260709 13:18:40.677453  7501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb7fa124c3bf4ef9ab65a407cb008441" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:18:40.677672  6880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c240553ce044eedb41541d72b9475d7" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:18:40.678179  6805 raft_consensus.cc:1275] T 7887766dc6784fcaa42b35c05fea7a99 P b7ab4784c7344b939bc36f639286f377 [term 2 FOLLOWER]: Refusing update from remote peer cd75a17ab2604397adab03bb8b5fd75c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:18:40.695744  6770 leader_election.cc:304] T 7c44c4849aa54f2b94d1f1bef9ed546f P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
I20260709 13:18:40.677124  8005 raft_consensus.cc:493] T 3d65025eea89441290d85dd053810e31 P b7ab4784c7344b939bc36f639286f377 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader cd75a17ab2604397adab03bb8b5fd75c)
I20260709 13:18:40.679548  7468 leader_election.cc:304] T 7ba5dac66ab5497e9e336f2a3c28cda5 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377
I20260709 13:18:40.684005  6800 raft_consensus.cc:1275] T de3186201e1a40d0b335eeb8b4e256e0 P b7ab4784c7344b939bc36f639286f377 [term 2 FOLLOWER]: Refusing update from remote peer cd75a17ab2604397adab03bb8b5fd75c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:18:40.675725  6873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44bde925b2e541b69890d70715b85176" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:18:40.692430  7894 raft_consensus.cc:3060] T 427c124d773f483294511e80fe340075 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:40.710935  6630 catalog_manager.cc:5697] T a3022224cc81473690653a83d4e99470 P ccd8a4c3bfe3413cb2ae219b09aea832 reported cstate change: term changed from 1 to 2, leader changed from cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67) to ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65). New cstate: current_term: 2 leader_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:40.712783  6630 catalog_manager.cc:5697] T 30e88460611e47b2ba16a46a30b5f416 P ccd8a4c3bfe3413cb2ae219b09aea832 reported cstate change: term changed from 1 to 2, leader changed from b7ab4784c7344b939bc36f639286f377 (127.5.126.66) to ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65). New cstate: current_term: 2 leader_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:40.714283  6630 catalog_manager.cc:5697] T f3f9c2e2bf644115957398fe4c9459db P ccd8a4c3bfe3413cb2ae219b09aea832 reported cstate change: term changed from 1 to 2, leader changed from ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65) to cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67). New cstate: current_term: 2 leader_uuid: "cd75a17ab2604397adab03bb8b5fd75c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } }
I20260709 13:18:40.692883  6879 raft_consensus.cc:3060] T 9e326172347f45e99a0d482b5d8ef768 P cd75a17ab2604397adab03bb8b5fd75c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:40.684847  6732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17587d6730594da4a56fa13a353232a1" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:18:40.716912  6732 raft_consensus.cc:2410] T 17587d6730594da4a56fa13a353232a1 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ba59cc884714e8aa5f3f0ecaed84cbb for term 5 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 4.
I20260709 13:18:40.718298  6732 raft_consensus.cc:1240] T de3186201e1a40d0b335eeb8b4e256e0 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 3 FOLLOWER]: Rejecting Update request from peer cd75a17ab2604397adab03bb8b5fd75c for earlier term 2. Current term is 3. Ops: []
I20260709 13:18:40.718568  7832 raft_consensus.cc:515] T 7ba5dac66ab5497e9e336f2a3c28cda5 P cd75a17ab2604397adab03bb8b5fd75c [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:18:40.720062  7951 raft_consensus.cc:493] T fe20b4b48823486ca3b9c648db6ce8aa P cd75a17ab2604397adab03bb8b5fd75c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:18:40.720592  8005 raft_consensus.cc:515] T 3d65025eea89441290d85dd053810e31 P b7ab4784c7344b939bc36f639286f377 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:40.720705  7951 raft_consensus.cc:515] T fe20b4b48823486ca3b9c648db6ce8aa P cd75a17ab2604397adab03bb8b5fd75c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:18:40.685120  6729 raft_consensus.cc:2393] T dbdf895bba214ff68685a24fd17dfb5d P ccd8a4c3bfe3413cb2ae219b09aea832 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c in current term 3: Already voted for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in this term.
I20260709 13:18:40.722954  8005 leader_election.cc:290] T 3d65025eea89441290d85dd053810e31 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
W20260709 13:18:40.688565  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 51963.5us
I20260709 13:18:40.693914  6806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e326172347f45e99a0d482b5d8ef768" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:18:40.724524  6806 raft_consensus.cc:2393] T 9e326172347f45e99a0d482b5d8ef768 P b7ab4784c7344b939bc36f639286f377 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c in current term 3: Already voted for candidate b7ab4784c7344b939bc36f639286f377 in this term.
I20260709 13:18:40.725229  7992 consensus_queue.cc:1048] T c4db81d9d329422bb3b4160ca4ac2d1d P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Connected to new peer: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:18:40.725699  7951 leader_election.cc:290] T fe20b4b48823486ca3b9c648db6ce8aa P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:18:40.726009  6844 leader_election.cc:304] T 07a92dd554674067a83a9cb68c4773f2 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:18:40.727015  7891 consensus_queue.cc:1048] T a1704639a875409b9959353527b3fd68 P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Connected to new peer: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:18:40.727157  7982 consensus_queue.cc:1048] T ab432e62819d499eaaf3dd55481dd930 P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Connected to new peer: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:18:40.692428  6878 raft_consensus.cc:3060] T d8cee0accdb8499c86d4414b72565a38 P cd75a17ab2604397adab03bb8b5fd75c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:40.660491  7990 raft_consensus.cc:2749] T 853ac0a8cbd64ce99457f170216d4d0f P b7ab4784c7344b939bc36f639286f377 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:40.684156  6801 raft_consensus.cc:1275] T 711ef6523deb4cbe8ef2ba61e1c21c98 P b7ab4784c7344b939bc36f639286f377 [term 2 FOLLOWER]: Refusing update from remote peer cd75a17ab2604397adab03bb8b5fd75c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:18:40.696764  6697 leader_election.cc:304] T 2c240553ce044eedb41541d72b9475d7 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377
I20260709 13:18:40.688206  7970 raft_consensus.cc:2749] T 427c124d773f483294511e80fe340075 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
W20260709 13:18:40.729791  7468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 50335.3us
I20260709 13:18:40.731287  6844 leader_election.cc:400] T bb3d8792045a4583ae2e965b1350a5b4 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 2 pre-election: Vote denied by peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391) with higher term. Message: Invalid argument: T bb3d8792045a4583ae2e965b1350a5b4 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c for earlier term 2. Current term is 3.
I20260709 13:18:40.732764  6844 leader_election.cc:403] T bb3d8792045a4583ae2e965b1350a5b4 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:18:40.697942  6872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8292e16e5654be6bc408560cf256aaa" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:18:40.692324  6695 leader_election.cc:304] T 20f6842e26174571996b8dea4151d4be P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
I20260709 13:18:40.673624  6875 raft_consensus.cc:2393] T 07a92dd554674067a83a9cb68c4773f2 P cd75a17ab2604397adab03bb8b5fd75c [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate b7ab4784c7344b939bc36f639286f377 in current term 2: Already voted for candidate cd75a17ab2604397adab03bb8b5fd75c in this term.
I20260709 13:18:40.734437  7934 raft_consensus.cc:2749] T bb3d8792045a4583ae2e965b1350a5b4 P cd75a17ab2604397adab03bb8b5fd75c [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391) with higher term. Message: Invalid argument: T bb3d8792045a4583ae2e965b1350a5b4 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c for earlier term 2. Current term is 3.
I20260709 13:18:40.735208  7992 raft_consensus.cc:2804] T 07a92dd554674067a83a9cb68c4773f2 P cd75a17ab2604397adab03bb8b5fd75c [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:18:40.688565  6727 raft_consensus.cc:2393] T a1704639a875409b9959353527b3fd68 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate b7ab4784c7344b939bc36f639286f377 in current term 3: Already voted for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in this term.
I20260709 13:18:40.704617  6880 raft_consensus.cc:3060] T 2c240553ce044eedb41541d72b9475d7 P cd75a17ab2604397adab03bb8b5fd75c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:40.686506  7885 leader_election.cc:290] T dbdf895bba214ff68685a24fd17dfb5d P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 3 election: Requested vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:18:40.636343  6627 rpcz_store.cc:276] 0709 13:18:37.140026 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:37.140244 (+   218us) service_pool.cc:224] Handling call
0709 13:18:37.375891 (+235647us) spinlock_profiling.cc:243] Waited 15.2 ms on lock 0x7b5400156154. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f914090 00007fcc0f9b2f3a 00007fcc157691cc 00007fcc1586737e 00007fcc13d282a4 00007fcc13d28232 00007fcc13d28161 00007fcc13d280dc 00007fcc13d27392 00007fcc0dce548c 00007fcc0dce48c6
0709 13:18:40.561715 (+3185824us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:18:38.798076 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:18:38.799132 (+  1056us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:18:38.799194 (+    62us) write_op.cc:435] Acquired schema lock
0709 13:18:38.799225 (+    31us) tablet.cc:662] Decoding operations
0709 13:18:38.799720 (+   495us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:18:38.799824 (+   104us) write_op.cc:641] Partition lock acquired for write op
0709 13:18:38.799884 (+    60us) tablet.cc:685] Acquiring locks for 1 operations
0709 13:18:38.871857 (+ 71973us) tablet.cc:701] Row locks acquired
0709 13:18:38.887593 (+ 15736us) write_op.cc:260] PREPARE: finished
0709 13:18:38.898317 (+ 10724us) write_op.cc:270] Start()
0709 13:18:38.956739 (+ 58422us) write_op.cc:276] Timestamp: P: 1783603118887775 usec, L: 0
0709 13:18:38.968826 (+ 12087us) op_driver.cc:348] REPLICATION: starting
0709 13:18:39.079611 (+110785us) log.cc:844] Serialized 594 byte log entry
0709 13:18:40.403923 (+1324312us) op_driver.cc:464] REPLICATION: finished
0709 13:18:40.459235 (+ 55312us) write_op.cc:301] APPLY: starting
0709 13:18:40.459315 (+    80us) tablet.cc:1367] starting BulkCheckPresence
0709 13:18:40.459410 (+    95us) tablet.cc:1370] finished BulkCheckPresence
0709 13:18:40.460787 (+  1377us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:18:40.461066 (+   279us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:18:40.461226 (+   160us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 13:18:40.461269 (+    43us) write_op.cc:312] APPLY: finished
0709 13:18:40.461458 (+   189us) log.cc:844] Serialized 22 byte log entry
0709 13:18:40.461628 (+   170us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:18:40.461702 (+    74us) write_op.cc:454] Released schema lock
0709 13:18:40.461747 (+    45us) write_op.cc:341] FINISH: Updating metrics
0709 13:18:40.462075 (+   328us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:18:40.462102 (+    27us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":92716,"reported_tablets":2,"spinlock_wait_cycles":35050752,"child_traces":[["op",{"apply.queue_time_us":18049,"apply.run_cpu_time_us":1853,"apply.run_wall_time_us":4622,"num_ops":1,"prepare.queue_time_us":682775,"prepare.run_cpu_time_us":6247,"prepare.run_wall_time_us":282130,"replication_time_us":1426948}]]}
I20260709 13:18:40.700924  7499 raft_consensus.cc:2410] T d8cee0accdb8499c86d4414b72565a38 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate b7ab4784c7344b939bc36f639286f377 for term 3 because replica has last-logged OpId of term: 2 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 13:18:40.678704  6881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c37d41cd9164c15a6826ca62a851a69" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:18:40.706642  6723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6869f07b5a4885a0b99fbe60c3b175" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 5 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:18:40.737814  6881 raft_consensus.cc:2468] T 7c37d41cd9164c15a6826ca62a851a69 P cd75a17ab2604397adab03bb8b5fd75c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 1.
I20260709 13:18:40.738149  6729 raft_consensus.cc:1275] T 44bde925b2e541b69890d70715b85176 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 2 FOLLOWER]: Refusing update from remote peer cd75a17ab2604397adab03bb8b5fd75c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:18:40.738262  6723 raft_consensus.cc:2468] T bd6869f07b5a4885a0b99fbe60c3b175 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 4.
I20260709 13:18:40.738711  7501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe20b4b48823486ca3b9c648db6ce8aa" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:18:40.688468  7938 leader_election.cc:290] T a1704639a875409b9959353527b3fd68 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 3 election: Requested vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:18:40.720166  8035 raft_consensus.cc:3060] T 427c124d773f483294511e80fe340075 P cd75a17ab2604397adab03bb8b5fd75c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:40.703487  6799 raft_consensus.cc:1240] T f09c2a98de1a4decabd0ff900dd44caa P b7ab4784c7344b939bc36f639286f377 [term 3 FOLLOWER]: Rejecting Update request from peer cd75a17ab2604397adab03bb8b5fd75c for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 13:18:40.691306  8064 raft_consensus.cc:515] T 95a75bfe094d4bdc963aba3f08dfcd25 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:40.719594  6732 raft_consensus.cc:1275] T e31b9971c15848dea59d4d4130141d9e P ccd8a4c3bfe3413cb2ae219b09aea832 [term 2 FOLLOWER]: Refusing update from remote peer cd75a17ab2604397adab03bb8b5fd75c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:18:40.742815  6725 raft_consensus.cc:2393] T 95a75bfe094d4bdc963aba3f08dfcd25 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate b7ab4784c7344b939bc36f639286f377 in current term 3: Already voted for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in this term.
I20260709 13:18:40.725752  8034 consensus_queue.cc:1059] T e77e330a82df4b43a745d57a68f6f057 P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:18:40.744709  8034 raft_consensus.cc:3055] T e77e330a82df4b43a745d57a68f6f057 P cd75a17ab2604397adab03bb8b5fd75c [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:18:40.744720  6881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d9def8b32fd443aa94ab1420b06837b" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:18:40.745357  8034 raft_consensus.cc:740] T e77e330a82df4b43a745d57a68f6f057 P cd75a17ab2604397adab03bb8b5fd75c [term 3 LEADER]: Becoming Follower/Learner. State: Replica: cd75a17ab2604397adab03bb8b5fd75c, State: Running, Role: LEADER
I20260709 13:18:40.745765  6881 raft_consensus.cc:2393] T 4d9def8b32fd443aa94ab1420b06837b P cd75a17ab2604397adab03bb8b5fd75c [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate b7ab4784c7344b939bc36f639286f377 in current term 2: Already voted for candidate cd75a17ab2604397adab03bb8b5fd75c in this term.
I20260709 13:18:40.746769  6727 raft_consensus.cc:1240] T 95a75bfe094d4bdc963aba3f08dfcd25 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 3 FOLLOWER]: Rejecting Update request from peer cd75a17ab2604397adab03bb8b5fd75c for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 13:18:40.746470  8034 consensus_queue.cc:260] T e77e330a82df4b43a745d57a68f6f057 P cd75a17ab2604397adab03bb8b5fd75c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } }
I20260709 13:18:40.747393  6881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f03d0dbf16864ca4bc1bb5e4c0334c0f" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:18:40.729804  7970 raft_consensus.cc:2804] T 7ba5dac66ab5497e9e336f2a3c28cda5 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:18:40.748250  6881 raft_consensus.cc:2393] T f03d0dbf16864ca4bc1bb5e4c0334c0f P cd75a17ab2604397adab03bb8b5fd75c [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7ab4784c7344b939bc36f639286f377 in current term 2: Already voted for candidate cd75a17ab2604397adab03bb8b5fd75c in this term.
I20260709 13:18:40.748463  7970 raft_consensus.cc:493] T 7ba5dac66ab5497e9e336f2a3c28cda5 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 1 FOLLOWER]: Starting leader election (detected failure of leader cd75a17ab2604397adab03bb8b5fd75c)
I20260709 13:18:40.749051  7970 raft_consensus.cc:3060] T 7ba5dac66ab5497e9e336f2a3c28cda5 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:40.557916  6626 rpcz_store.cc:276] 0709 13:18:37.285847 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:37.286002 (+   155us) service_pool.cc:224] Handling call
0709 13:18:40.557278 (+3271276us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:18:37.771336 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:18:37.850256 (+ 78920us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:18:37.857902 (+  7646us) write_op.cc:435] Acquired schema lock
0709 13:18:37.859280 (+  1378us) tablet.cc:662] Decoding operations
0709 13:18:37.913524 (+ 54244us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:18:37.915906 (+  2382us) write_op.cc:641] Partition lock acquired for write op
0709 13:18:37.923435 (+  7529us) tablet.cc:685] Acquiring locks for 1 operations
0709 13:18:37.961906 (+ 38471us) tablet.cc:701] Row locks acquired
0709 13:18:37.964813 (+  2907us) write_op.cc:260] PREPARE: finished
0709 13:18:37.987659 (+ 22846us) write_op.cc:270] Start()
0709 13:18:37.997879 (+ 10220us) write_op.cc:276] Timestamp: P: 1783603117984893 usec, L: 0
0709 13:18:38.000449 (+  2570us) op_driver.cc:348] REPLICATION: starting
0709 13:18:38.115598 (+115149us) log.cc:844] Serialized 537 byte log entry
0709 13:18:39.761960 (+1646362us) op_driver.cc:464] REPLICATION: finished
0709 13:18:40.074291 (+312331us) spinlock_profiling.cc:243] Waited 11.3 ms on lock 0x7b4400022b4c. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0c745db1 00007fcc0c7e3c85 00007fcc0c7e46a2 00007fcc0f5561db 00007fcc0f551aaf 00007fcc0c8a00ac 00007fcc156faab9 00007fcc0c8bc69b 00007fcc0c8ba93f 00007fcc0c8bcc02 00007fcc133e0ef0
0709 13:18:40.407243 (+332952us) write_op.cc:301] APPLY: starting
0709 13:18:40.407394 (+   151us) tablet.cc:1367] starting BulkCheckPresence
0709 13:18:40.407551 (+   157us) tablet.cc:1370] finished BulkCheckPresence
0709 13:18:40.407590 (+    39us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:18:40.407928 (+   338us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:18:40.408265 (+   337us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 13:18:40.408334 (+    69us) write_op.cc:312] APPLY: finished
0709 13:18:40.408632 (+   298us) log.cc:844] Serialized 22 byte log entry
0709 13:18:40.408844 (+   212us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:18:40.408935 (+    91us) write_op.cc:454] Released schema lock
0709 13:18:40.409034 (+    99us) write_op.cc:341] FINISH: Updating metrics
0709 13:18:40.409583 (+   549us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:18:40.409611 (+    28us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":85443,"reported_tablets":1,"child_traces":[["op",{"apply.queue_time_us":621301,"apply.run_cpu_time_us":2318,"apply.run_wall_time_us":7238,"num_ops":1,"prepare.queue_time_us":299804,"prepare.run_cpu_time_us":76137,"prepare.run_wall_time_us":1058550,"raft.queue_time_us":1082279,"raft.run_cpu_time_us":53220,"raft.run_wall_time_us":743312,"replication_time_us":1722938,"spinlock_wait_cycles":26017024,"thread_start_us":1674436,"threads_started":4,"wal-append.queue_time_us":641101}]]}
I20260709 13:18:40.696993  6874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb7fa124c3bf4ef9ab65a407cb008441" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:18:40.688702  7993 leader_election.cc:290] T 7a734b5ab7834e05a8c422208acc58b1 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 3 election: Requested vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:18:40.684993  6876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34f36d59d88f40fe8a2805e604fc6c0a" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:18:40.733770  6872 raft_consensus.cc:3060] T d8292e16e5654be6bc408560cf256aaa P cd75a17ab2604397adab03bb8b5fd75c [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:18:40.753922  7992 raft_consensus.cc:493] T 07a92dd554674067a83a9cb68c4773f2 P cd75a17ab2604397adab03bb8b5fd75c [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:40.754499  7992 raft_consensus.cc:3060] T 07a92dd554674067a83a9cb68c4773f2 P cd75a17ab2604397adab03bb8b5fd75c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:40.747781  8034 raft_consensus.cc:3060] T e77e330a82df4b43a745d57a68f6f057 P cd75a17ab2604397adab03bb8b5fd75c [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:40.757156  7832 leader_election.cc:290] T 7ba5dac66ab5497e9e336f2a3c28cda5 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 3 election: Requested vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:18:40.760993  8064 leader_election.cc:290] T 95a75bfe094d4bdc963aba3f08dfcd25 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 3 election: Requested vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:18:40.715574  6630 catalog_manager.cc:5697] T 9b3759de40694069b13c0f8bd40e5709 P ccd8a4c3bfe3413cb2ae219b09aea832 reported cstate change: term changed from 1 to 2, leader changed from b7ab4784c7344b939bc36f639286f377 (127.5.126.66) to ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65). New cstate: current_term: 2 leader_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:40.707932  6728 raft_consensus.cc:2468] T 9e326172347f45e99a0d482b5d8ef768 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 3.
I20260709 13:18:40.749493  6878 raft_consensus.cc:2468] T d8cee0accdb8499c86d4414b72565a38 P cd75a17ab2604397adab03bb8b5fd75c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 3.
I20260709 13:18:40.778425  6723 raft_consensus.cc:1275] T 22ccee1b570c4ad3a57bd7aec085b1b4 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 2 FOLLOWER]: Refusing update from remote peer cd75a17ab2604397adab03bb8b5fd75c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:18:40.779738  6730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b56bf91d90824c959e21e0cee5ba1816" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:18:40.780541  6730 raft_consensus.cc:3060] T b56bf91d90824c959e21e0cee5ba1816 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:40.734088  6844 leader_election.cc:304] T 713b5728a197487c9300b310ab94e5a3 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377
I20260709 13:18:40.790851  6879 raft_consensus.cc:2468] T 9e326172347f45e99a0d482b5d8ef768 P cd75a17ab2604397adab03bb8b5fd75c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 3.
I20260709 13:18:40.710282  6770 leader_election.cc:304] T ab432e62819d499eaaf3dd55481dd930 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
I20260709 13:18:40.795246  6872 raft_consensus.cc:2468] T d8292e16e5654be6bc408560cf256aaa P cd75a17ab2604397adab03bb8b5fd75c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 3.
I20260709 13:18:40.795310  7466 leader_election.cc:304] T 17587d6730594da4a56fa13a353232a1 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:18:40.781473  6630 catalog_manager.cc:5697] T 1bf4668eeb70467fb3dc5a0289233b3c P ccd8a4c3bfe3413cb2ae219b09aea832 reported cstate change: term changed from 1 to 2, leader changed from b7ab4784c7344b939bc36f639286f377 (127.5.126.66) to ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65). New cstate: current_term: 2 leader_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } health_report { overall_health: UNKNOWN } } }
W20260709 13:18:40.809000  6770 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 98758us
I20260709 13:18:40.810472  6770 leader_election.cc:304] T b3f13b31a1f84f0d89d007eadd57924c P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, ccd8a4c3bfe3413cb2ae219b09aea832
W20260709 13:18:40.829069  6695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 136833us
W20260709 13:18:40.829603  6772 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.68:45071, user_credentials={real_user=slave}} blocked reactor thread for 48342.2us
I20260709 13:18:40.830123  6878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a75bfe094d4bdc963aba3f08dfcd25" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:18:40.832439  6880 raft_consensus.cc:2468] T 2c240553ce044eedb41541d72b9475d7 P cd75a17ab2604397adab03bb8b5fd75c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 3.
I20260709 13:18:40.839005  6770 leader_election.cc:304] T f03d0dbf16864ca4bc1bb5e4c0334c0f P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
W20260709 13:18:40.845809  6697 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 149176us
I20260709 13:18:40.872678  6770 leader_election.cc:400] T 07a92dd554674067a83a9cb68c4773f2 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 2 election: Vote denied by peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391) with higher term. Message: Invalid argument: T 07a92dd554674067a83a9cb68c4773f2 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate b7ab4784c7344b939bc36f639286f377 for earlier term 2. Current term is 3.
I20260709 13:18:40.875751  6770 leader_election.cc:403] T 07a92dd554674067a83a9cb68c4773f2 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260709 13:18:40.900223  7951 raft_consensus.cc:2804] T 713b5728a197487c9300b310ab94e5a3 P cd75a17ab2604397adab03bb8b5fd75c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:18:40.895610  6695 leader_election.cc:304] T f03d0dbf16864ca4bc1bb5e4c0334c0f P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
W20260709 13:18:41.042141  6697 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 117791us
W20260709 13:18:40.926501  6846 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:40.878237  7499 raft_consensus.cc:1275] T ce4f062dcd314d43a63ca74067cb5ee3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 3 LEARNER]: Refusing update from remote peer b7ab4784c7344b939bc36f639286f377: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:18:40.871472  8006 raft_consensus.cc:2804] T f03d0dbf16864ca4bc1bb5e4c0334c0f P b7ab4784c7344b939bc36f639286f377 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:18:41.037683  6878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b56bf91d90824c959e21e0cee5ba1816" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
W20260709 13:18:41.034808  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 300761us
I20260709 13:18:40.976364  6770 leader_election.cc:304] T 4d9def8b32fd443aa94ab1420b06837b P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
I20260709 13:18:40.757310  7894 raft_consensus.cc:515] T 427c124d773f483294511e80fe340075 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } attrs { replace: true } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:18:41.054241  6844 leader_election.cc:304] T 24ee15416e3145beaa1b8183453729a3 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:18:40.837460  7990 raft_consensus.cc:2804] T ab432e62819d499eaaf3dd55481dd930 P b7ab4784c7344b939bc36f639286f377 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:18:41.055898  6697 leader_election.cc:304] T 7c44c4849aa54f2b94d1f1bef9ed546f P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:18:40.901288  6880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44bde925b2e541b69890d70715b85176" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
W20260709 13:18:41.055365  6695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 225193us
I20260709 13:18:41.059285  6844 leader_election.cc:304] T 8c7f33e544204fbaac4078e3e83bbf4e P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:18:40.848009  7976 raft_consensus.cc:2764] T 2c240553ce044eedb41541d72b9475d7 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
I20260709 13:18:40.838621  8068 raft_consensus.cc:493] T f3f9c2e2bf644115957398fe4c9459db P ccd8a4c3bfe3413cb2ae219b09aea832 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader cd75a17ab2604397adab03bb8b5fd75c)
I20260709 13:18:40.866732  8046 raft_consensus.cc:2749] T b3f13b31a1f84f0d89d007eadd57924c P b7ab4784c7344b939bc36f639286f377 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:41.066244  6695 leader_election.cc:304] T ab432e62819d499eaaf3dd55481dd930 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
I20260709 13:18:41.036962  7891 raft_consensus.cc:493] T f03d0dbf16864ca4bc1bb5e4c0334c0f P cd75a17ab2604397adab03bb8b5fd75c [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:41.069414  6844 leader_election.cc:304] T 9e326172347f45e99a0d482b5d8ef768 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:18:40.923385  7958 raft_consensus.cc:3060] T 07a92dd554674067a83a9cb68c4773f2 P b7ab4784c7344b939bc36f639286f377 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:40.847787  7946 raft_consensus.cc:2749] T 17587d6730594da4a56fa13a353232a1 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:18:40.872292  8064 raft_consensus.cc:2804] T 20f6842e26174571996b8dea4151d4be P ccd8a4c3bfe3413cb2ae219b09aea832 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:18:41.074681  6730 raft_consensus.cc:2468] T b56bf91d90824c959e21e0cee5ba1816 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 3.
I20260709 13:18:40.921957  8034 raft_consensus.cc:493] T ce4f062dcd314d43a63ca74067cb5ee3 P cd75a17ab2604397adab03bb8b5fd75c [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:41.037115  7501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ba5dac66ab5497e9e336f2a3c28cda5" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb"
I20260709 13:18:41.081152  6844 leader_election.cc:304] T 3fa34c08b205435dba97346991aa1f92 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:18:41.066953  7939 raft_consensus.cc:493] T fe20b4b48823486ca3b9c648db6ce8aa P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:18:41.060981  8036 raft_consensus.cc:2804] T 7c44c4849aa54f2b94d1f1bef9ed546f P b7ab4784c7344b939bc36f639286f377 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:18:41.068398  7951 raft_consensus.cc:697] T 713b5728a197487c9300b310ab94e5a3 P cd75a17ab2604397adab03bb8b5fd75c [term 2 LEADER]: Becoming Leader. State: Replica: cd75a17ab2604397adab03bb8b5fd75c, State: Running, Role: LEADER
I20260709 13:18:41.093277  6872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4275cf08e63345f993bce8664eada830" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:18:41.104233  6872 raft_consensus.cc:2468] T 4275cf08e63345f993bce8664eada830 P cd75a17ab2604397adab03bb8b5fd75c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 1.
I20260709 13:18:41.068082  7990 raft_consensus.cc:493] T ab432e62819d499eaaf3dd55481dd930 P b7ab4784c7344b939bc36f639286f377 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:41.105120  6879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6869f07b5a4885a0b99fbe60c3b175" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 5 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:18:41.105546  6879 raft_consensus.cc:2468] T bd6869f07b5a4885a0b99fbe60c3b175 P cd75a17ab2604397adab03bb8b5fd75c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 4.
I20260709 13:18:41.091888  6878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09c2a98de1a4decabd0ff900dd44caa" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:18:41.095045  6695 leader_election.cc:304] T 44bde925b2e541b69890d70715b85176 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
I20260709 13:18:40.976666  8010 raft_consensus.cc:493] T 9b3759de40694069b13c0f8bd40e5709 P b7ab4784c7344b939bc36f639286f377 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:18:41.070293  7934 raft_consensus.cc:2804] T 24ee15416e3145beaa1b8183453729a3 P cd75a17ab2604397adab03bb8b5fd75c [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:18:41.075675  7993 raft_consensus.cc:493] T ce4f062dcd314d43a63ca74067cb5ee3 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:40.879765  8018 raft_consensus.cc:515] T 4f00a2e87e56452083b759f60d461ee3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 4 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:18:40.984414  7883 consensus_queue.cc:1048] T 3a485a995abc4807b6e511e45419f737 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.099s
I20260709 13:18:41.089166  8064 raft_consensus.cc:493] T 20f6842e26174571996b8dea4151d4be P ccd8a4c3bfe3413cb2ae219b09aea832 [term 2 FOLLOWER]: Starting leader election (detected failure of leader cd75a17ab2604397adab03bb8b5fd75c)
I20260709 13:18:40.919139  7992 raft_consensus.cc:515] T 07a92dd554674067a83a9cb68c4773f2 P cd75a17ab2604397adab03bb8b5fd75c [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
W20260709 13:18:41.102001  6697 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 58948.2us
I20260709 13:18:41.082990  7886 raft_consensus.cc:2764] T 9e326172347f45e99a0d482b5d8ef768 P cd75a17ab2604397adab03bb8b5fd75c [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
I20260709 13:18:41.101681  8046 raft_consensus.cc:2804] T 4d9def8b32fd443aa94ab1420b06837b P b7ab4784c7344b939bc36f639286f377 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:18:41.070647  6880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a734b5ab7834e05a8c422208acc58b1" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:18:41.103127  7982 raft_consensus.cc:2749] T 3fa34c08b205435dba97346991aa1f92 P cd75a17ab2604397adab03bb8b5fd75c [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:18:41.061455  8069 raft_consensus.cc:2804] T f03d0dbf16864ca4bc1bb5e4c0334c0f P ccd8a4c3bfe3413cb2ae219b09aea832 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:18:41.094324  7976 raft_consensus.cc:2749] T 7c44c4849aa54f2b94d1f1bef9ed546f P ccd8a4c3bfe3413cb2ae219b09aea832 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:18:41.111696  7934 raft_consensus.cc:493] T 24ee15416e3145beaa1b8183453729a3 P cd75a17ab2604397adab03bb8b5fd75c [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:41.097812  7885 raft_consensus.cc:2804] T ab432e62819d499eaaf3dd55481dd930 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:18:41.088822  8060 raft_consensus.cc:2804] T 8c7f33e544204fbaac4078e3e83bbf4e P cd75a17ab2604397adab03bb8b5fd75c [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:18:41.129145  6880 raft_consensus.cc:2393] T 7a734b5ab7834e05a8c422208acc58b1 P cd75a17ab2604397adab03bb8b5fd75c [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate b7ab4784c7344b939bc36f639286f377 in current term 2: Already voted for candidate cd75a17ab2604397adab03bb8b5fd75c in this term.
I20260709 13:18:41.059724  8006 raft_consensus.cc:493] T f03d0dbf16864ca4bc1bb5e4c0334c0f P b7ab4784c7344b939bc36f639286f377 [term 1 FOLLOWER]: Starting leader election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:18:41.130203  6731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44bde925b2e541b69890d70715b85176" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:18:41.083129  8068 raft_consensus.cc:515] T f3f9c2e2bf644115957398fe4c9459db P ccd8a4c3bfe3413cb2ae219b09aea832 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:41.109724  7990 raft_consensus.cc:3060] T ab432e62819d499eaaf3dd55481dd930 P b7ab4784c7344b939bc36f639286f377 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:41.089059  7891 raft_consensus.cc:515] T f03d0dbf16864ca4bc1bb5e4c0334c0f P cd75a17ab2604397adab03bb8b5fd75c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:41.122274  6695 leader_election.cc:304] T e31b9971c15848dea59d4d4130141d9e P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
I20260709 13:18:41.104169  7939 raft_consensus.cc:515] T fe20b4b48823486ca3b9c648db6ce8aa P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:18:41.103492  7832 consensus_queue.cc:1048] T b56bf91d90824c959e21e0cee5ba1816 P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Connected to new peer: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.032s
I20260709 13:18:41.125391  7938 raft_consensus.cc:2804] T 44bde925b2e541b69890d70715b85176 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:18:41.125837  8064 raft_consensus.cc:3060] T 20f6842e26174571996b8dea4151d4be P ccd8a4c3bfe3413cb2ae219b09aea832 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:41.162638  6876 raft_consensus.cc:1275] T d33d5ee8ef6f415593d8df52063161ad P cd75a17ab2604397adab03bb8b5fd75c [term 3 FOLLOWER]: Refusing update from remote peer b7ab4784c7344b939bc36f639286f377: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:18:41.140439  7886 consensus_queue.cc:1048] T 711ef6523deb4cbe8ef2ba61e1c21c98 P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Connected to new peer: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.026s
I20260709 13:18:41.164386  6878 raft_consensus.cc:1275] T 3a485a995abc4807b6e511e45419f737 P cd75a17ab2604397adab03bb8b5fd75c [term 3 FOLLOWER]: Refusing update from remote peer b7ab4784c7344b939bc36f639286f377: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
I20260709 13:18:41.165890  6872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d65025eea89441290d85dd053810e31" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:18:41.172598  6772 leader_election.cc:304] T a3022224cc81473690653a83d4e99470 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:18:41.174201  6772 leader_election.cc:304] T 711ef6523deb4cbe8ef2ba61e1c21c98 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:18:41.164997  6878 pending_rounds.cc:85] T 3a485a995abc4807b6e511e45419f737 P cd75a17ab2604397adab03bb8b5fd75c: Aborting all ops after (but not including) 1
I20260709 13:18:41.159588  7934 raft_consensus.cc:3060] T 24ee15416e3145beaa1b8183453729a3 P cd75a17ab2604397adab03bb8b5fd75c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:41.159862  8006 raft_consensus.cc:3060] T f03d0dbf16864ca4bc1bb5e4c0334c0f P b7ab4784c7344b939bc36f639286f377 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:18:41.186281  6695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 64082.9us
W20260709 13:18:41.186885  6770 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 210608us
I20260709 13:18:41.191373  6770 leader_election.cc:304] T 2c240553ce044eedb41541d72b9475d7 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
W20260709 13:18:41.189051  7466 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 111750us
I20260709 13:18:41.158825  7885 raft_consensus.cc:493] T ab432e62819d499eaaf3dd55481dd930 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:18:41.188704  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 89419.2us
I20260709 13:18:41.117972  8034 raft_consensus.cc:515] T ce4f062dcd314d43a63ca74067cb5ee3 P cd75a17ab2604397adab03bb8b5fd75c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } attrs { replace: true } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: NON_VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: true } }
I20260709 13:18:41.135098  8069 raft_consensus.cc:493] T f03d0dbf16864ca4bc1bb5e4c0334c0f P ccd8a4c3bfe3413cb2ae219b09aea832 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:41.177798  6878 pending_rounds.cc:107] T 3a485a995abc4807b6e511e45419f737 P cd75a17ab2604397adab03bb8b5fd75c: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 13:18:41.164016  7938 raft_consensus.cc:493] T 44bde925b2e541b69890d70715b85176 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:41.162040  8060 raft_consensus.cc:493] T 8c7f33e544204fbaac4078e3e83bbf4e P cd75a17ab2604397adab03bb8b5fd75c [term 1 FOLLOWER]: Starting leader election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:18:41.197059  6872 raft_consensus.cc:1275] T f58dc08b12a2494bb9a1372837970ca2 P cd75a17ab2604397adab03bb8b5fd75c [term 3 FOLLOWER]: Refusing update from remote peer b7ab4784c7344b939bc36f639286f377: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:18:41.198232  6878 raft_consensus.cc:2889] T 3a485a995abc4807b6e511e45419f737 P cd75a17ab2604397adab03bb8b5fd75c [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:18:41.198199  6770 leader_election.cc:400] T 7a734b5ab7834e05a8c422208acc58b1 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 2 election: Vote denied by peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391) with higher term. Message: Invalid argument: T 7a734b5ab7834e05a8c422208acc58b1 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate b7ab4784c7344b939bc36f639286f377 for earlier term 2. Current term is 3.
I20260709 13:18:41.178401  7498 raft_consensus.cc:1240] T 4f00a2e87e56452083b759f60d461ee3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 4 FOLLOWER]: Rejecting Update request from peer cd75a17ab2604397adab03bb8b5fd75c for earlier term 3. Current term is 4. Ops: []
I20260709 13:18:41.120153  8010 raft_consensus.cc:515] T 9b3759de40694069b13c0f8bd40e5709 P b7ab4784c7344b939bc36f639286f377 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:41.199793  6770 leader_election.cc:403] T 7a734b5ab7834e05a8c422208acc58b1 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
W20260709 13:18:41.202100  6847 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:41.142257  8046 raft_consensus.cc:697] T 4d9def8b32fd443aa94ab1420b06837b P b7ab4784c7344b939bc36f639286f377 [term 2 LEADER]: Becoming Leader. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
I20260709 13:18:41.211166  6844 leader_election.cc:304] T 1528ab62b6fe4e3099d08f141afee116 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:18:41.210325  8075 raft_consensus.cc:2749] T 711ef6523deb4cbe8ef2ba61e1c21c98 P b7ab4784c7344b939bc36f639286f377 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:41.212662  8018 leader_election.cc:290] T 4f00a2e87e56452083b759f60d461ee3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 4 election: Requested vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:18:41.213229  7499 raft_consensus.cc:1275] T 17587d6730594da4a56fa13a353232a1 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 4 FOLLOWER]: Refusing update from remote peer b7ab4784c7344b939bc36f639286f377: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 13:18:41.193452  7976 raft_consensus.cc:2804] T e31b9971c15848dea59d4d4130141d9e P ccd8a4c3bfe3413cb2ae219b09aea832 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:18:41.213857  7939 leader_election.cc:290] T fe20b4b48823486ca3b9c648db6ce8aa P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:18:41.200798  8069 raft_consensus.cc:3060] T f03d0dbf16864ca4bc1bb5e4c0334c0f P ccd8a4c3bfe3413cb2ae219b09aea832 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:41.215713  8034 leader_election.cc:290] T ce4f062dcd314d43a63ca74067cb5ee3 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:18:41.200317  7970 raft_consensus.cc:515] T 7ba5dac66ab5497e9e336f2a3c28cda5 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
W20260709 13:18:41.220822  8070 log.cc:927] Time spent T f3f9c2e2bf644115957398fe4c9459db P b7ab4784c7344b939bc36f639286f377: Append to log took a long time: real 0.092s	user 0.000s	sys 0.001s
I20260709 13:18:41.220345  7951 consensus_queue.cc:237] T 713b5728a197487c9300b310ab94e5a3 P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:41.222414  7970 leader_election.cc:290] T 7ba5dac66ab5497e9e336f2a3c28cda5 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 2 election: Requested vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:18:41.222749  8068 leader_election.cc:290] T f3f9c2e2bf644115957398fe4c9459db P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:18:41.213912  7976 raft_consensus.cc:493] T e31b9971c15848dea59d4d4130141d9e P ccd8a4c3bfe3413cb2ae219b09aea832 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:41.189276  8074 raft_consensus.cc:2804] T a3022224cc81473690653a83d4e99470 P b7ab4784c7344b939bc36f639286f377 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:18:41.226032  8074 raft_consensus.cc:493] T a3022224cc81473690653a83d4e99470 P b7ab4784c7344b939bc36f639286f377 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:41.226399  8074 raft_consensus.cc:3060] T a3022224cc81473690653a83d4e99470 P b7ab4784c7344b939bc36f639286f377 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:41.200660  8060 raft_consensus.cc:3060] T 8c7f33e544204fbaac4078e3e83bbf4e P cd75a17ab2604397adab03bb8b5fd75c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:41.162495  7993 raft_consensus.cc:515] T ce4f062dcd314d43a63ca74067cb5ee3 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } attrs { replace: true } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: NON_VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: true } }
I20260709 13:18:41.229027  6879 raft_consensus.cc:1275] T ce4f062dcd314d43a63ca74067cb5ee3 P cd75a17ab2604397adab03bb8b5fd75c [term 3 FOLLOWER]: Refusing update from remote peer b7ab4784c7344b939bc36f639286f377: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:18:41.193943  7885 raft_consensus.cc:3060] T ab432e62819d499eaaf3dd55481dd930 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:41.207974  7982 raft_consensus.cc:493] T f58dc08b12a2494bb9a1372837970ca2 P cd75a17ab2604397adab03bb8b5fd75c [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:41.230518  6697 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 49487.7us
I20260709 13:18:41.233197  7891 leader_election.cc:290] T f03d0dbf16864ca4bc1bb5e4c0334c0f P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:18:41.233407  7993 leader_election.cc:290] T ce4f062dcd314d43a63ca74067cb5ee3 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:18:41.181341  8005 consensus_queue.cc:1048] T ce4f062dcd314d43a63ca74067cb5ee3 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.043s
I20260709 13:18:41.233999  7891 consensus_queue.cc:1059] T de3186201e1a40d0b335eeb8b4e256e0 P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:18:41.235190  7891 consensus_queue.cc:1048] T 44bde925b2e541b69890d70715b85176 P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Connected to new peer: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:18:41.211426  8022 raft_consensus.cc:493] T b3f13b31a1f84f0d89d007eadd57924c P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:18:41.236188  7883 raft_consensus.cc:3060] T 7a734b5ab7834e05a8c422208acc58b1 P b7ab4784c7344b939bc36f639286f377 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:41.236341  6730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe20b4b48823486ca3b9c648db6ce8aa" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:18:41.236666  8022 raft_consensus.cc:515] T b3f13b31a1f84f0d89d007eadd57924c P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:18:41.237638  7501 raft_consensus.cc:3060] T 7ba5dac66ab5497e9e336f2a3c28cda5 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:41.202471  7938 raft_consensus.cc:3060] T 44bde925b2e541b69890d70715b85176 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:41.239342  8022 leader_election.cc:290] T b3f13b31a1f84f0d89d007eadd57924c P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:18:41.240324  7984 raft_consensus.cc:3055] T de3186201e1a40d0b335eeb8b4e256e0 P cd75a17ab2604397adab03bb8b5fd75c [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:18:41.240494  6799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ba5dac66ab5497e9e336f2a3c28cda5" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:18:41.240865  7984 raft_consensus.cc:740] T de3186201e1a40d0b335eeb8b4e256e0 P cd75a17ab2604397adab03bb8b5fd75c [term 2 LEADER]: Becoming Follower/Learner. State: Replica: cd75a17ab2604397adab03bb8b5fd75c, State: Running, Role: LEADER
I20260709 13:18:41.241398  6799 raft_consensus.cc:2393] T 7ba5dac66ab5497e9e336f2a3c28cda5 P b7ab4784c7344b939bc36f639286f377 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in current term 2: Already voted for candidate b7ab4784c7344b939bc36f639286f377 in this term.
I20260709 13:18:41.229010  8037 raft_consensus.cc:2804] T 2c240553ce044eedb41541d72b9475d7 P b7ab4784c7344b939bc36f639286f377 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:18:41.242376  8037 raft_consensus.cc:697] T 2c240553ce044eedb41541d72b9475d7 P b7ab4784c7344b939bc36f639286f377 [term 3 LEADER]: Becoming Leader. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
I20260709 13:18:41.229641  7976 raft_consensus.cc:3060] T e31b9971c15848dea59d4d4130141d9e P ccd8a4c3bfe3413cb2ae219b09aea832 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:41.249984  8064 raft_consensus.cc:515] T 20f6842e26174571996b8dea4151d4be P ccd8a4c3bfe3413cb2ae219b09aea832 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:41.253189  6772 leader_election.cc:304] T dbdf895bba214ff68685a24fd17dfb5d P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:18:41.252527  6799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3f13b31a1f84f0d89d007eadd57924c" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:18:41.258577  6799 raft_consensus.cc:2468] T b3f13b31a1f84f0d89d007eadd57924c P b7ab4784c7344b939bc36f639286f377 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in term 1.
I20260709 13:18:41.265986  8085 consensus_queue.cc:1048] T e31b9971c15848dea59d4d4130141d9e P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Connected to new peer: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:18:41.266248  8035 consensus_queue.cc:1059] T 95a75bfe094d4bdc963aba3f08dfcd25 P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:18:41.267644  7832 consensus_queue.cc:1048] T 22ccee1b570c4ad3a57bd7aec085b1b4 P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Connected to new peer: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:18:41.271987  6844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:41.274286  8078 raft_consensus.cc:493] T 30e88460611e47b2ba16a46a30b5f416 P cd75a17ab2604397adab03bb8b5fd75c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:18:41.274401  6728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe20b4b48823486ca3b9c648db6ce8aa" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:18:41.275266  8078 raft_consensus.cc:515] T 30e88460611e47b2ba16a46a30b5f416 P cd75a17ab2604397adab03bb8b5fd75c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:41.276592  6728 raft_consensus.cc:1240] T 20f6842e26174571996b8dea4151d4be P ccd8a4c3bfe3413cb2ae219b09aea832 [term 3 FOLLOWER]: Rejecting Update request from peer cd75a17ab2604397adab03bb8b5fd75c for earlier term 2. Current term is 3. Ops: []
I20260709 13:18:41.278602  8078 leader_election.cc:290] T 30e88460611e47b2ba16a46a30b5f416 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:18:41.279655  8035 raft_consensus.cc:493] T 7a734b5ab7834e05a8c422208acc58b1 P cd75a17ab2604397adab03bb8b5fd75c [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:41.280498  8035 raft_consensus.cc:515] T 7a734b5ab7834e05a8c422208acc58b1 P cd75a17ab2604397adab03bb8b5fd75c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:41.283903  6772 leader_election.cc:304] T 7c37d41cd9164c15a6826ca62a851a69 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:18:41.288535  6730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3f13b31a1f84f0d89d007eadd57924c" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:18:41.264779  6770 leader_election.cc:304] T a1704639a875409b9959353527b3fd68 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:18:41.257155  8034 raft_consensus.cc:2804] T 1528ab62b6fe4e3099d08f141afee116 P cd75a17ab2604397adab03bb8b5fd75c [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:18:41.300949  6697 leader_election.cc:304] T 90d42e216d9741e190bca19a781291fd P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:18:41.263017  8005 raft_consensus.cc:2749] T dbdf895bba214ff68685a24fd17dfb5d P b7ab4784c7344b939bc36f639286f377 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:18:41.283032  8066 raft_consensus.cc:493] T bb3d8792045a4583ae2e965b1350a5b4 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:41.305502  6730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce4f062dcd314d43a63ca74067cb5ee3" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 4 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:18:41.310551  6730 raft_consensus.cc:2468] T ce4f062dcd314d43a63ca74067cb5ee3 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 3.
I20260709 13:18:41.308637  8089 raft_consensus.cc:2804] T 7c37d41cd9164c15a6826ca62a851a69 P b7ab4784c7344b939bc36f639286f377 [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 13:18:41.305929  6695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 101503us
I20260709 13:18:41.243623  8037 consensus_queue.cc:237] T 2c240553ce044eedb41541d72b9475d7 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:41.295380  7832 raft_consensus.cc:3055] T 95a75bfe094d4bdc963aba3f08dfcd25 P cd75a17ab2604397adab03bb8b5fd75c [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:18:41.316295  6772 leader_election.cc:304] T bb7fa124c3bf4ef9ab65a407cb008441 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:18:41.298101  7992 leader_election.cc:290] T 07a92dd554674067a83a9cb68c4773f2 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 3 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:18:41.298394  8064 leader_election.cc:290] T 20f6842e26174571996b8dea4151d4be P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 3 election: Requested vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:18:41.263743  7982 raft_consensus.cc:515] T f58dc08b12a2494bb9a1372837970ca2 P cd75a17ab2604397adab03bb8b5fd75c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:41.212694  8046 consensus_queue.cc:237] T 4d9def8b32fd443aa94ab1420b06837b P b7ab4784c7344b939bc36f639286f377 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:41.304741  8034 raft_consensus.cc:493] T 1528ab62b6fe4e3099d08f141afee116 P cd75a17ab2604397adab03bb8b5fd75c [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:41.339138  6772 leader_election.cc:304] T 34f36d59d88f40fe8a2805e604fc6c0a P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:18:41.349978  6772 leader_election.cc:304] T d8cee0accdb8499c86d4414b72565a38 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb
I20260709 13:18:41.346421  6695 leader_election.cc:304] T e77e330a82df4b43a745d57a68f6f057 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:18:41.361202  6730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f03d0dbf16864ca4bc1bb5e4c0334c0f" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:18:41.313233  6798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f00a2e87e56452083b759f60d461ee3" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:18:41.337008  7832 raft_consensus.cc:740] T 95a75bfe094d4bdc963aba3f08dfcd25 P cd75a17ab2604397adab03bb8b5fd75c [term 2 LEADER]: Becoming Follower/Learner. State: Replica: cd75a17ab2604397adab03bb8b5fd75c, State: Running, Role: LEADER
I20260709 13:18:41.335119  7894 leader_election.cc:290] T 427c124d773f483294511e80fe340075 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 2 election: Requested vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:18:41.330596  8089 raft_consensus.cc:493] T 7c37d41cd9164c15a6826ca62a851a69 P b7ab4784c7344b939bc36f639286f377 [term 1 FOLLOWER]: Starting leader election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:18:41.315608  8066 raft_consensus.cc:515] T bb3d8792045a4583ae2e965b1350a5b4 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:18:41.317265  8005 raft_consensus.cc:2749] T a1704639a875409b9959353527b3fd68 P b7ab4784c7344b939bc36f639286f377 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:18:41.358155  8034 raft_consensus.cc:3060] T 1528ab62b6fe4e3099d08f141afee116 P cd75a17ab2604397adab03bb8b5fd75c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:41.377743  6695 leader_election.cc:304] T 4d9def8b32fd443aa94ab1420b06837b P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
I20260709 13:18:41.363893  8081 raft_consensus.cc:2749] T bb7fa124c3bf4ef9ab65a407cb008441 P b7ab4784c7344b939bc36f639286f377 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:18:41.372108  8064 raft_consensus.cc:2804] T 90d42e216d9741e190bca19a781291fd P ccd8a4c3bfe3413cb2ae219b09aea832 [term 3 FOLLOWER]: Leader election won for term 3
W20260709 13:18:41.390180  6697 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 96362.3us
I20260709 13:18:41.391337  6844 leader_election.cc:304] T 34f36d59d88f40fe8a2805e604fc6c0a P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:18:41.376470  6798 raft_consensus.cc:3060] T 4f00a2e87e56452083b759f60d461ee3 P b7ab4784c7344b939bc36f639286f377 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:41.394697  8085 raft_consensus.cc:2749] T 34f36d59d88f40fe8a2805e604fc6c0a P cd75a17ab2604397adab03bb8b5fd75c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:41.396257  6844 leader_election.cc:400] T d8292e16e5654be6bc408560cf256aaa P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 2 pre-election: Vote denied by peer b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817) with higher term. Message: Invalid argument: T d8292e16e5654be6bc408560cf256aaa P b7ab4784c7344b939bc36f639286f377 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c for earlier term 2. Current term is 3.
I20260709 13:18:41.396586  6844 leader_election.cc:403] T d8292e16e5654be6bc408560cf256aaa P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:18:41.397114  8085 raft_consensus.cc:2749] T d8292e16e5654be6bc408560cf256aaa P cd75a17ab2604397adab03bb8b5fd75c [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817) with higher term. Message: Invalid argument: T d8292e16e5654be6bc408560cf256aaa P b7ab4784c7344b939bc36f639286f377 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c for earlier term 2. Current term is 3.
I20260709 13:18:41.397404  7994 consensus_queue.cc:1048] T ab432e62819d499eaaf3dd55481dd930 P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:18:41.398495  6844 leader_election.cc:304] T f4b8bd455d5a47c18a1380839c6e0d61 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:18:41.399206  7994 raft_consensus.cc:2804] T f4b8bd455d5a47c18a1380839c6e0d61 P cd75a17ab2604397adab03bb8b5fd75c [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:18:41.399590  7994 raft_consensus.cc:493] T f4b8bd455d5a47c18a1380839c6e0d61 P cd75a17ab2604397adab03bb8b5fd75c [term 1 FOLLOWER]: Starting leader election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:18:41.399966  7994 raft_consensus.cc:3060] T f4b8bd455d5a47c18a1380839c6e0d61 P cd75a17ab2604397adab03bb8b5fd75c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:41.405331  6727 raft_consensus.cc:1275] T bb3d8792045a4583ae2e965b1350a5b4 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 3 FOLLOWER]: Refusing update from remote peer 7ba59cc884714e8aa5f3f0ecaed84cbb: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:18:41.405505  7982 leader_election.cc:290] T f58dc08b12a2494bb9a1372837970ca2 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:18:41.380393  7993 raft_consensus.cc:2804] T e77e330a82df4b43a745d57a68f6f057 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:18:41.407565  6844 leader_election.cc:304] T 853ac0a8cbd64ce99457f170216d4d0f P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:18:41.380475  8089 raft_consensus.cc:3060] T 7c37d41cd9164c15a6826ca62a851a69 P b7ab4784c7344b939bc36f639286f377 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:41.406867  6727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a92dd554674067a83a9cb68c4773f2" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:18:41.411705  6727 raft_consensus.cc:2393] T 07a92dd554674067a83a9cb68c4773f2 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c in current term 3: Already voted for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in this term.
I20260709 13:18:41.412089  7883 raft_consensus.cc:2749] T 7a734b5ab7834e05a8c422208acc58b1 P b7ab4784c7344b939bc36f639286f377 [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391) with higher term. Message: Invalid argument: T 7a734b5ab7834e05a8c422208acc58b1 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate b7ab4784c7344b939bc36f639286f377 for earlier term 2. Current term is 3.
I20260709 13:18:41.386250  7894 raft_consensus.cc:2804] T 4d9def8b32fd443aa94ab1420b06837b P ccd8a4c3bfe3413cb2ae219b09aea832 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:18:41.421133  8064 raft_consensus.cc:697] T 90d42e216d9741e190bca19a781291fd P ccd8a4c3bfe3413cb2ae219b09aea832 [term 3 LEADER]: Becoming Leader. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
I20260709 13:18:41.391427  8005 raft_consensus.cc:2749] T 34f36d59d88f40fe8a2805e604fc6c0a P b7ab4784c7344b939bc36f639286f377 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:41.408545  8035 leader_election.cc:290] T 7a734b5ab7834e05a8c422208acc58b1 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:18:41.391201  7992 consensus_queue.cc:1048] T c4db81d9d329422bb3b4160ca4ac2d1d P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.052s
I20260709 13:18:41.370774  7832 consensus_queue.cc:260] T 95a75bfe094d4bdc963aba3f08dfcd25 P cd75a17ab2604397adab03bb8b5fd75c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:41.413453  8010 leader_election.cc:290] T 9b3759de40694069b13c0f8bd40e5709 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:18:41.413479  8081 raft_consensus.cc:2804] T d8cee0accdb8499c86d4414b72565a38 P b7ab4784c7344b939bc36f639286f377 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:18:41.469426  6844 leader_election.cc:304] T a3022224cc81473690653a83d4e99470 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:18:41.420358  7982 raft_consensus.cc:2749] T 853ac0a8cbd64ce99457f170216d4d0f P cd75a17ab2604397adab03bb8b5fd75c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:41.447528  7894 raft_consensus.cc:493] T 4d9def8b32fd443aa94ab1420b06837b P ccd8a4c3bfe3413cb2ae219b09aea832 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:41.474329  6844 leader_election.cc:304] T 9b3759de40694069b13c0f8bd40e5709 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:18:41.498095  6844 leader_election.cc:304] T dbdf895bba214ff68685a24fd17dfb5d P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:18:41.460670  6727 raft_consensus.cc:1240] T f09c2a98de1a4decabd0ff900dd44caa P ccd8a4c3bfe3413cb2ae219b09aea832 [term 3 FOLLOWER]: Rejecting Update request from peer cd75a17ab2604397adab03bb8b5fd75c for earlier term 2. Current term is 3. Ops: []
I20260709 13:18:41.413146  7946 consensus_queue.cc:1048] T bb3d8792045a4583ae2e965b1350a5b4 P 7ba59cc884714e8aa5f3f0ecaed84cbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.056s
I20260709 13:18:41.474895  8035 raft_consensus.cc:2804] T a3022224cc81473690653a83d4e99470 P cd75a17ab2604397adab03bb8b5fd75c [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:18:41.477317  8085 raft_consensus.cc:2749] T 9b3759de40694069b13c0f8bd40e5709 P cd75a17ab2604397adab03bb8b5fd75c [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:18:41.458916  7994 raft_consensus.cc:515] T f4b8bd455d5a47c18a1380839c6e0d61 P cd75a17ab2604397adab03bb8b5fd75c [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:41.504390  6844 leader_election.cc:304] T 3411566abe2d4c9bb4b2adfdd05e6f17 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: ccd8a4c3bfe3413cb2ae219b09aea832
W20260709 13:18:41.504608  6770 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 239923us
W20260709 13:18:41.502411  6772 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 152502us
I20260709 13:18:41.476806  7894 raft_consensus.cc:3060] T 4d9def8b32fd443aa94ab1420b06837b P ccd8a4c3bfe3413cb2ae219b09aea832 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:41.480154  8081 raft_consensus.cc:697] T d8cee0accdb8499c86d4414b72565a38 P b7ab4784c7344b939bc36f639286f377 [term 3 LEADER]: Becoming Leader. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
I20260709 13:18:41.525084  8081 consensus_queue.cc:237] T d8cee0accdb8499c86d4414b72565a38 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:18:41.498261  8005 raft_consensus.cc:493] T e77e330a82df4b43a745d57a68f6f057 P b7ab4784c7344b939bc36f639286f377 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:41.527647  8034 raft_consensus.cc:515] T 1528ab62b6fe4e3099d08f141afee116 P cd75a17ab2604397adab03bb8b5fd75c [term 3 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } attrs { replace: true } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:18:41.528438  8005 raft_consensus.cc:515] T e77e330a82df4b43a745d57a68f6f057 P b7ab4784c7344b939bc36f639286f377 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } }
I20260709 13:18:41.530386  8005 leader_election.cc:290] T e77e330a82df4b43a745d57a68f6f057 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931), ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391)
I20260709 13:18:41.530812  8034 leader_election.cc:290] T 1528ab62b6fe4e3099d08f141afee116 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 3 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:18:41.532567  6772 leader_election.cc:304] T 9e326172347f45e99a0d482b5d8ef768 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:18:41.532990  7499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1528ab62b6fe4e3099d08f141afee116" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb"
I20260709 13:18:41.534180  6772 leader_election.cc:304] T d8292e16e5654be6bc408560cf256aaa P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:18:41.534407  7499 raft_consensus.cc:3060] T 1528ab62b6fe4e3099d08f141afee116 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:18:41.535176  8005 raft_consensus.cc:2804] T 9e326172347f45e99a0d482b5d8ef768 P b7ab4784c7344b939bc36f639286f377 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:18:41.536073  8005 raft_consensus.cc:697] T 9e326172347f45e99a0d482b5d8ef768 P b7ab4784c7344b939bc36f639286f377 [term 3 LEADER]: Becoming Leader. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
I20260709 13:18:41.537540  8005 consensus_queue.cc:237] T 9e326172347f45e99a0d482b5d8ef768 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:41.539228  6770 leader_election.cc:304] T bd6869f07b5a4885a0b99fbe60c3b175 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
I20260709 13:18:41.474167  8074 raft_consensus.cc:515] T a3022224cc81473690653a83d4e99470 P b7ab4784c7344b939bc36f639286f377 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:41.554278  6726 raft_consensus.cc:1240] T b56bf91d90824c959e21e0cee5ba1816 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 3 FOLLOWER]: Rejecting Update request from peer cd75a17ab2604397adab03bb8b5fd75c for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 13:18:41.555187  8074 leader_election.cc:290] T a3022224cc81473690653a83d4e99470 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 3 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:18:41.474761  8088 consensus_queue.cc:1059] T 44bde925b2e541b69890d70715b85176 P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.077s
I20260709 13:18:41.556459  6770 leader_election.cc:304] T 95a75bfe094d4bdc963aba3f08dfcd25 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:18:41.557542  8088 raft_consensus.cc:3055] T 44bde925b2e541b69890d70715b85176 P cd75a17ab2604397adab03bb8b5fd75c [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:18:41.558162  6770 leader_election.cc:304] T b56bf91d90824c959e21e0cee5ba1816 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:18:41.560351  8074 raft_consensus.cc:2804] T bd6869f07b5a4885a0b99fbe60c3b175 P b7ab4784c7344b939bc36f639286f377 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:18:41.560540  7994 leader_election.cc:290] T f4b8bd455d5a47c18a1380839c6e0d61 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 2 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:18:41.561071  8074 raft_consensus.cc:493] T bd6869f07b5a4885a0b99fbe60c3b175 P b7ab4784c7344b939bc36f639286f377 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:41.561599  8074 raft_consensus.cc:3060] T bd6869f07b5a4885a0b99fbe60c3b175 P b7ab4784c7344b939bc36f639286f377 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:41.561630  8010 raft_consensus.cc:2749] T 95a75bfe094d4bdc963aba3f08dfcd25 P b7ab4784c7344b939bc36f639286f377 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:18:41.512288  8035 raft_consensus.cc:493] T a3022224cc81473690653a83d4e99470 P cd75a17ab2604397adab03bb8b5fd75c [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:41.477761  8069 raft_consensus.cc:515] T f03d0dbf16864ca4bc1bb5e4c0334c0f P ccd8a4c3bfe3413cb2ae219b09aea832 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
W20260709 13:18:41.547888  8083 log.cc:927] Time spent T 404190ce4ce94cecbfcb6ea9d1dd8626 P ccd8a4c3bfe3413cb2ae219b09aea832: Append to log took a long time: real 0.071s	user 0.000s	sys 0.000s
I20260709 13:18:41.474843  7938 raft_consensus.cc:515] T 44bde925b2e541b69890d70715b85176 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:41.549752  8034 raft_consensus.cc:2804] T 3411566abe2d4c9bb4b2adfdd05e6f17 P cd75a17ab2604397adab03bb8b5fd75c [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:18:41.550361  6772 leader_election.cc:304] T 4275cf08e63345f993bce8664eada830 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:18:41.543278  6844 leader_election.cc:304] T bb7fa124c3bf4ef9ab65a407cb008441 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, b7ab4784c7344b939bc36f639286f377
I20260709 13:18:41.550729  6723 raft_consensus.cc:1240] T a1704639a875409b9959353527b3fd68 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 3 FOLLOWER]: Rejecting Update request from peer cd75a17ab2604397adab03bb8b5fd75c for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 13:18:41.510819  7886 raft_consensus.cc:2804] T dbdf895bba214ff68685a24fd17dfb5d P cd75a17ab2604397adab03bb8b5fd75c [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:18:41.580878  7993 raft_consensus.cc:697] T e77e330a82df4b43a745d57a68f6f057 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 4 LEADER]: Becoming Leader. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
W20260709 13:18:41.565831  6695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 110761us
W20260709 13:18:41.543740  6697 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 98249.9us
I20260709 13:18:41.542680  7832 raft_consensus.cc:3060] T 95a75bfe094d4bdc963aba3f08dfcd25 P cd75a17ab2604397adab03bb8b5fd75c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:41.564718  8046 raft_consensus.cc:2804] T d8292e16e5654be6bc408560cf256aaa P b7ab4784c7344b939bc36f639286f377 [term 3 FOLLOWER]: Leader election won for term 3
W20260709 13:18:41.598302  7958 consensus_meta.cc:287] T 07a92dd554674067a83a9cb68c4773f2 P b7ab4784c7344b939bc36f639286f377: Time spent flushing consensus metadata: real 0.505s	user 0.009s	sys 0.002s
I20260709 13:18:41.572604  8097 raft_consensus.cc:2804] T b56bf91d90824c959e21e0cee5ba1816 P b7ab4784c7344b939bc36f639286f377 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:18:41.589159  7994 consensus_queue.cc:1048] T e31b9971c15848dea59d4d4130141d9e P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:18:41.580682  8034 raft_consensus.cc:493] T 3411566abe2d4c9bb4b2adfdd05e6f17 P cd75a17ab2604397adab03bb8b5fd75c [term 1 FOLLOWER]: Starting leader election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:18:41.589797  8085 consensus_queue.cc:1048] T 22ccee1b570c4ad3a57bd7aec085b1b4 P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:18:41.626471  7885 raft_consensus.cc:515] T ab432e62819d499eaaf3dd55481dd930 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:41.588214  7992 raft_consensus.cc:2749] T bb7fa124c3bf4ef9ab65a407cb008441 P cd75a17ab2604397adab03bb8b5fd75c [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:18:41.591055  7976 raft_consensus.cc:515] T e31b9971c15848dea59d4d4130141d9e P ccd8a4c3bfe3413cb2ae219b09aea832 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:41.592729  7938 leader_election.cc:290] T 44bde925b2e541b69890d70715b85176 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 3 election: Requested vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:18:41.592525  7934 raft_consensus.cc:515] T 24ee15416e3145beaa1b8183453729a3 P cd75a17ab2604397adab03bb8b5fd75c [term 3 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } attrs { replace: true } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:18:41.593389  6731 raft_consensus.cc:2393] T 44bde925b2e541b69890d70715b85176 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate b7ab4784c7344b939bc36f639286f377 in current term 3: Already voted for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in this term.
I20260709 13:18:41.570632  8035 raft_consensus.cc:3060] T a3022224cc81473690653a83d4e99470 P cd75a17ab2604397adab03bb8b5fd75c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:41.599126  8066 leader_election.cc:290] T bb3d8792045a4583ae2e965b1350a5b4 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:18:41.587116  6697 leader_election.cc:304] T f5be3a11b23d4ea9b08300a2789821c7 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:18:41.599902  6695 leader_election.cc:304] T bd6869f07b5a4885a0b99fbe60c3b175 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
I20260709 13:18:41.600394  6727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d65025eea89441290d85dd053810e31" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:18:41.600703  7883 raft_consensus.cc:493] T 1bf4668eeb70467fb3dc5a0289233b3c P b7ab4784c7344b939bc36f639286f377 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:18:41.624183  7958 raft_consensus.cc:2749] T 07a92dd554674067a83a9cb68c4773f2 P b7ab4784c7344b939bc36f639286f377 [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391) with higher term. Message: Invalid argument: T 07a92dd554674067a83a9cb68c4773f2 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate b7ab4784c7344b939bc36f639286f377 for earlier term 2. Current term is 3.
W20260709 13:18:41.601892  6772 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 51622us
I20260709 13:18:41.661348  6772 leader_election.cc:304] T f09c2a98de1a4decabd0ff900dd44caa P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:18:41.585587  6844 leader_election.cc:304] T 4275cf08e63345f993bce8664eada830 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:18:41.602854  8037 raft_consensus.cc:2804] T 4275cf08e63345f993bce8664eada830 P b7ab4784c7344b939bc36f639286f377 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:18:41.552502  7990 raft_consensus.cc:515] T ab432e62819d499eaaf3dd55481dd930 P b7ab4784c7344b939bc36f639286f377 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:41.603979  6799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ba5dac66ab5497e9e336f2a3c28cda5" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:18:41.665489  6799 raft_consensus.cc:3060] T 7ba5dac66ab5497e9e336f2a3c28cda5 P b7ab4784c7344b939bc36f639286f377 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:41.624759  7501 raft_consensus.cc:2468] T 7ba5dac66ab5497e9e336f2a3c28cda5 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 3.
I20260709 13:18:41.605394  6807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce4f062dcd314d43a63ca74067cb5ee3" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 4 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:18:41.607368  6801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f03d0dbf16864ca4bc1bb5e4c0334c0f" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:18:41.607920  7466 leader_election.cc:304] T b3f13b31a1f84f0d89d007eadd57924c P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, b7ab4784c7344b939bc36f639286f377; no voters: ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:18:41.586758  8010 raft_consensus.cc:493] T de3186201e1a40d0b335eeb8b4e256e0 P b7ab4784c7344b939bc36f639286f377 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:41.609511  8069 leader_election.cc:290] T f03d0dbf16864ca4bc1bb5e4c0334c0f P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 3 election: Requested vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:18:41.558177  8088 raft_consensus.cc:740] T 44bde925b2e541b69890d70715b85176 P cd75a17ab2604397adab03bb8b5fd75c [term 2 LEADER]: Becoming Follower/Learner. State: Replica: cd75a17ab2604397adab03bb8b5fd75c, State: Running, Role: LEADER
I20260709 13:18:41.611480  6729 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49744 (request call id 51) took 1023 ms. Trace:
I20260709 13:18:41.613497  6730 raft_consensus.cc:2393] T f03d0dbf16864ca4bc1bb5e4c0334c0f P ccd8a4c3bfe3413cb2ae219b09aea832 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c in current term 3: Already voted for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in this term.
I20260709 13:18:41.615392  8006 raft_consensus.cc:515] T f03d0dbf16864ca4bc1bb5e4c0334c0f P b7ab4784c7344b939bc36f639286f377 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
W20260709 13:18:41.624284  6847 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:41.623438  8022 raft_consensus.cc:493] T 3fa34c08b205435dba97346991aa1f92 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:41.626938  8036 raft_consensus.cc:493] T 7c44c4849aa54f2b94d1f1bef9ed546f P b7ab4784c7344b939bc36f639286f377 [term 2 FOLLOWER]: Starting leader election (detected failure of leader cd75a17ab2604397adab03bb8b5fd75c)
I20260709 13:18:41.586010  7886 raft_consensus.cc:493] T dbdf895bba214ff68685a24fd17dfb5d P cd75a17ab2604397adab03bb8b5fd75c [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:41.629101  6728 raft_consensus.cc:1240] T ab432e62819d499eaaf3dd55481dd930 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 3 FOLLOWER]: Rejecting Update request from peer cd75a17ab2604397adab03bb8b5fd75c for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 13:18:41.618177  8060 raft_consensus.cc:515] T 8c7f33e544204fbaac4078e3e83bbf4e P cd75a17ab2604397adab03bb8b5fd75c [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:41.687750  8088 consensus_queue.cc:260] T 44bde925b2e541b69890d70715b85176 P cd75a17ab2604397adab03bb8b5fd75c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:41.689015  8088 raft_consensus.cc:3060] T 44bde925b2e541b69890d70715b85176 P cd75a17ab2604397adab03bb8b5fd75c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:41.690011  8060 leader_election.cc:290] T 8c7f33e544204fbaac4078e3e83bbf4e P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 2 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
W20260709 13:18:41.655449  6697 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 68402.4us
I20260709 13:18:41.691009  6697 leader_election.cc:304] T d33d5ee8ef6f415593d8df52063161ad P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:18:41.627731  8034 raft_consensus.cc:3060] T 3411566abe2d4c9bb4b2adfdd05e6f17 P cd75a17ab2604397adab03bb8b5fd75c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:41.692092  8077 raft_consensus.cc:2804] T b3f13b31a1f84f0d89d007eadd57924c P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:18:41.692517  8077 raft_consensus.cc:493] T b3f13b31a1f84f0d89d007eadd57924c P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 1 FOLLOWER]: Starting leader election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:18:41.692869  8077 raft_consensus.cc:3060] T b3f13b31a1f84f0d89d007eadd57924c P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:41.601135  8046 raft_consensus.cc:697] T d8292e16e5654be6bc408560cf256aaa P b7ab4784c7344b939bc36f639286f377 [term 3 LEADER]: Becoming Leader. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
I20260709 13:18:41.696739  8046 consensus_queue.cc:237] T d8292e16e5654be6bc408560cf256aaa P b7ab4784c7344b939bc36f639286f377 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
W20260709 13:18:41.662942  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 77440.8us
I20260709 13:18:41.699870  7976 leader_election.cc:290] T e31b9971c15848dea59d4d4130141d9e P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 3 election: Requested vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:18:41.700526  7886 raft_consensus.cc:3060] T dbdf895bba214ff68685a24fd17dfb5d P cd75a17ab2604397adab03bb8b5fd75c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:41.701370  6844 leader_election.cc:304] T 1bf4668eeb70467fb3dc5a0289233b3c P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
W20260709 13:18:41.654903  6695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 55086.4us
I20260709 13:18:41.575888  8064 consensus_queue.cc:237] T 90d42e216d9741e190bca19a781291fd P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:41.707984  7832 consensus_queue.cc:1059] T b56bf91d90824c959e21e0cee5ba1816 P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:18:41.708995  8085 consensus_queue.cc:1059] T a1704639a875409b9959353527b3fd68 P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:18:41.710281  8103 raft_consensus.cc:2749] T f5be3a11b23d4ea9b08300a2789821c7 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:18:41.708106  8036 raft_consensus.cc:3060] T 7c44c4849aa54f2b94d1f1bef9ed546f P b7ab4784c7344b939bc36f639286f377 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:41.654333  8075 raft_consensus.cc:493] T 7887766dc6784fcaa42b35c05fea7a99 P b7ab4784c7344b939bc36f639286f377 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:41.712896  6806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "711ef6523deb4cbe8ef2ba61e1c21c98" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:18:41.713191  8075 raft_consensus.cc:515] T 7887766dc6784fcaa42b35c05fea7a99 P b7ab4784c7344b939bc36f639286f377 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:41.714288  6806 raft_consensus.cc:2468] T 711ef6523deb4cbe8ef2ba61e1c21c98 P b7ab4784c7344b939bc36f639286f377 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 2.
I20260709 13:18:41.681013  7951 raft_consensus.cc:493] T 3a485a995abc4807b6e511e45419f737 P cd75a17ab2604397adab03bb8b5fd75c [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:41.673204  7466 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 65349.1us
I20260709 13:18:41.717198  7951 raft_consensus.cc:515] T 3a485a995abc4807b6e511e45419f737 P cd75a17ab2604397adab03bb8b5fd75c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:41.719552  6801 raft_consensus.cc:2468] T f03d0dbf16864ca4bc1bb5e4c0334c0f P b7ab4784c7344b939bc36f639286f377 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 2.
I20260709 13:18:41.720587  8006 leader_election.cc:290] T f03d0dbf16864ca4bc1bb5e4c0334c0f P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 2 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:18:41.720971  6805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22ccee1b570c4ad3a57bd7aec085b1b4" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:18:41.722555  6805 raft_consensus.cc:2468] T 22ccee1b570c4ad3a57bd7aec085b1b4 P b7ab4784c7344b939bc36f639286f377 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 2.
I20260709 13:18:41.684988  8010 raft_consensus.cc:515] T de3186201e1a40d0b335eeb8b4e256e0 P b7ab4784c7344b939bc36f639286f377 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:41.640530  8097 raft_consensus.cc:697] T b56bf91d90824c959e21e0cee5ba1816 P b7ab4784c7344b939bc36f639286f377 [term 3 LEADER]: Becoming Leader. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
I20260709 13:18:41.615392  7894 raft_consensus.cc:515] T 4d9def8b32fd443aa94ab1420b06837b P ccd8a4c3bfe3413cb2ae219b09aea832 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:41.708236  7982 consensus_queue.cc:1048] T 20f6842e26174571996b8dea4151d4be P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.014s
I20260709 13:18:41.665624  8066 raft_consensus.cc:2804] T bd6869f07b5a4885a0b99fbe60c3b175 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:18:41.686918  8022 raft_consensus.cc:515] T 3fa34c08b205435dba97346991aa1f92 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:18:41.732334  6802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "404190ce4ce94cecbfcb6ea9d1dd8626" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:18:41.733050  8078 raft_consensus.cc:3055] T b56bf91d90824c959e21e0cee5ba1816 P cd75a17ab2604397adab03bb8b5fd75c [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:18:41.733310  7990 leader_election.cc:290] T ab432e62819d499eaaf3dd55481dd930 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 3 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:18:41.733600  6727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f03d0dbf16864ca4bc1bb5e4c0334c0f" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:18:41.733716  6800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de3186201e1a40d0b335eeb8b4e256e0" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:18:41.733636  6803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d65025eea89441290d85dd053810e31" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:18:41.671193  7992 raft_consensus.cc:2804] T 4275cf08e63345f993bce8664eada830 P cd75a17ab2604397adab03bb8b5fd75c [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:18:41.736991  6804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4db81d9d329422bb3b4160ca4ac2d1d" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:18:41.665230  8037 raft_consensus.cc:493] T 4275cf08e63345f993bce8664eada830 P b7ab4784c7344b939bc36f639286f377 [term 1 FOLLOWER]: Starting leader election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:18:41.676784  6729 rpcz_store.cc:276] 0709 13:18:40.587782 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:40.739118 (+151336us) service_pool.cc:224] Handling call
0709 13:18:40.779174 (+ 40056us) spinlock_profiling.cc:243] Waited 16.6 ms on lock 0x7b5800000c98. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0c745db1 00007fcc0c885b71 00007fcc0c885a22 00007fcc1579ec09 00007fcc148f8ee0 00007fcc149c20ab 00007fcc149c2131 00007fcc14983fc0 00007fcc1496e929 00007fcc1496e3d2 00007fcc0dee5bd4
0709 13:18:41.034985 (+255811us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:41.035371 (+   386us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:41.035412 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:41.186536 (+151124us) spinlock_profiling.cc:243] Waited 2.35 ms on lock 0x7b2c00000f48. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0e2a3a11 00007fcc0e2b3372 00007fcc0f9e5a01 00007fcc0f9aa43a 00007fcc0f9a983e 00007fcc1496e419 00007fcc0dee5bd4 00007fcc0dee5b62 00007fcc0dee5a91 00007fcc0dee5a0c 00007fcc0dee4cc2
0709 13:18:41.200530 (+ 13994us) log.cc:844] Serialized 26 byte log entry
0709 13:18:41.363131 (+162601us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:18:41.387821 (+ 24690us) log.cc:844] Serialized 14 byte log entry
0709 13:18:41.591935 (+204114us) spinlock_profiling.cc:243] Waited 2.33 ms on lock 0x7b18002690e0. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc15785de1 00007fcc157925b1 00007fcc0f5524bc 00007fcc0c8a048b 00007fcc156faab9 00007fcc0c8bc69b 00007fcc0c8ba93f 00007fcc0c8ba455 00007fcc0f9a2060 00007fcc0f9b4716 00007fcc0f9c5287
0709 13:18:41.592085 (+   150us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:41.592164 (+    79us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:41.611193 (+ 19029us) raft_consensus.cc:1685] finished
0709 13:18:41.611222 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:41.611404 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":22702,"prepare.queue_time_us":93291,"prepare.run_cpu_time_us":53,"prepare.run_wall_time_us":54,"raft.queue_time_us":97551,"raft.run_cpu_time_us":262,"raft.run_wall_time_us":10295,"spinlock_wait_cycles":48994304,"thread_start_us":242531,"threads_started":3,"wal-append.queue_time_us":200425}
I20260709 13:18:41.749820  6725 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49998 (request call id 419) took 1160 ms. Trace:
W20260709 13:18:41.750173  6697 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 59235.8us
I20260709 13:18:41.751259  8069 raft_consensus.cc:2749] T d33d5ee8ef6f415593d8df52063161ad P ccd8a4c3bfe3413cb2ae219b09aea832 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:18:41.665778  7883 raft_consensus.cc:515] T 1bf4668eeb70467fb3dc5a0289233b3c P b7ab4784c7344b939bc36f639286f377 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:41.715764  8075 leader_election.cc:290] T 7887766dc6784fcaa42b35c05fea7a99 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:18:41.756381  6800 raft_consensus.cc:3060] T de3186201e1a40d0b335eeb8b4e256e0 P b7ab4784c7344b939bc36f639286f377 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:41.676409  8096 raft_consensus.cc:2749] T f09c2a98de1a4decabd0ff900dd44caa P b7ab4784c7344b939bc36f639286f377 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:18:41.764848  6804 raft_consensus.cc:2468] T c4db81d9d329422bb3b4160ca4ac2d1d P b7ab4784c7344b939bc36f639286f377 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 2.
I20260709 13:18:41.751936  8066 raft_consensus.cc:697] T bd6869f07b5a4885a0b99fbe60c3b175 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 4 LEADER]: Becoming Leader. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
I20260709 13:18:41.728663  6724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77e330a82df4b43a745d57a68f6f057" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 5 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:18:41.740330  7832 raft_consensus.cc:2749] T 1bf4668eeb70467fb3dc5a0289233b3c P cd75a17ab2604397adab03bb8b5fd75c [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:18:41.743986  8078 raft_consensus.cc:740] T b56bf91d90824c959e21e0cee5ba1816 P cd75a17ab2604397adab03bb8b5fd75c [term 2 LEADER]: Becoming Follower/Learner. State: Replica: cd75a17ab2604397adab03bb8b5fd75c, State: Running, Role: LEADER
I20260709 13:18:41.799260  6805 raft_consensus.cc:1240] T a3022224cc81473690653a83d4e99470 P b7ab4784c7344b939bc36f639286f377 [term 3 FOLLOWER]: Rejecting Update request from peer ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 2. Current term is 3. Ops: []
I20260709 13:18:41.745131  7994 raft_consensus.cc:493] T 427c124d773f483294511e80fe340075 P cd75a17ab2604397adab03bb8b5fd75c [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:41.683245  7958 consensus_queue.cc:1048] T d33d5ee8ef6f415593d8df52063161ad P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.088s
I20260709 13:18:41.737861  7886 raft_consensus.cc:515] T dbdf895bba214ff68685a24fd17dfb5d P cd75a17ab2604397adab03bb8b5fd75c [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:41.737639  7951 leader_election.cc:290] T 3a485a995abc4807b6e511e45419f737 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
W20260709 13:18:41.806242  6772 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 138380us
I20260709 13:18:41.765798  7938 raft_consensus.cc:493] T 17587d6730594da4a56fa13a353232a1 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:41.656656  7993 consensus_queue.cc:237] T e77e330a82df4b43a745d57a68f6f057 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } }
I20260709 13:18:41.810186  6729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b3759de40694069b13c0f8bd40e5709" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:18:41.832501  6772 leader_election.cc:304] T 3d65025eea89441290d85dd053810e31 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:18:41.769282  7992 raft_consensus.cc:493] T 4275cf08e63345f993bce8664eada830 P cd75a17ab2604397adab03bb8b5fd75c [term 1 FOLLOWER]: Starting leader election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:18:41.773902  8037 raft_consensus.cc:3060] T 4275cf08e63345f993bce8664eada830 P b7ab4784c7344b939bc36f639286f377 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:41.814539  7832 consensus_queue.cc:1048] T 7887766dc6784fcaa42b35c05fea7a99 P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.026s
I20260709 13:18:41.845139  6723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3022224cc81473690653a83d4e99470" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:18:41.849943  6805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "713b5728a197487c9300b310ab94e5a3" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:18:41.850838  6805 raft_consensus.cc:2468] T 713b5728a197487c9300b310ab94e5a3 P b7ab4784c7344b939bc36f639286f377 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 2.
I20260709 13:18:41.846223  6732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7887766dc6784fcaa42b35c05fea7a99" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:18:41.881106  7498 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50756 (request call id 92) took 1237 ms. Trace:
I20260709 13:18:41.797231  6800 raft_consensus.cc:2468] T de3186201e1a40d0b335eeb8b4e256e0 P b7ab4784c7344b939bc36f639286f377 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 3.
I20260709 13:18:41.836493  6731 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50004 (request call id 990) took 1204 ms. Trace:
I20260709 13:18:41.841476  7992 raft_consensus.cc:3060] T 4275cf08e63345f993bce8664eada830 P cd75a17ab2604397adab03bb8b5fd75c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:41.844432  7938 raft_consensus.cc:515] T 17587d6730594da4a56fa13a353232a1 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:18:41.825619  7994 raft_consensus.cc:515] T 427c124d773f483294511e80fe340075 P cd75a17ab2604397adab03bb8b5fd75c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } attrs { replace: true } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
W20260709 13:18:41.904989  7466 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 169108us
I20260709 13:18:41.823344  6799 raft_consensus.cc:2468] T 7ba5dac66ab5497e9e336f2a3c28cda5 P b7ab4784c7344b939bc36f639286f377 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 3.
I20260709 13:18:41.853173  7984 consensus_queue.cc:260] T de3186201e1a40d0b335eeb8b4e256e0 P cd75a17ab2604397adab03bb8b5fd75c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:41.812757  8103 consensus_queue.cc:1048] T a3022224cc81473690653a83d4e99470 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.086s
I20260709 13:18:42.067327  6723 raft_consensus.cc:1275] T ce4f062dcd314d43a63ca74067cb5ee3 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 3 FOLLOWER]: Refusing update from remote peer b7ab4784c7344b939bc36f639286f377: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:18:41.837850  8075 raft_consensus.cc:2749] T 3d65025eea89441290d85dd053810e31 P b7ab4784c7344b939bc36f639286f377 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:41.895177  8066 consensus_queue.cc:237] T bd6869f07b5a4885a0b99fbe60c3b175 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:41.844370  7990 consensus_queue.cc:1048] T f58dc08b12a2494bb9a1372837970ca2 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.053s
I20260709 13:18:41.853415  8081 consensus_queue.cc:1048] T 17587d6730594da4a56fa13a353232a1 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.038s
I20260709 13:18:41.848870  8096 consensus_queue.cc:1048] T 3a485a995abc4807b6e511e45419f737 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.046s
I20260709 13:18:41.896507  8097 consensus_queue.cc:237] T b56bf91d90824c959e21e0cee5ba1816 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:42.126729  6879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbdf895bba214ff68685a24fd17dfb5d" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:18:42.127722  6872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d65025eea89441290d85dd053810e31" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:18:42.129457  6874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8292e16e5654be6bc408560cf256aaa" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:18:42.129928  6875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a92dd554674067a83a9cb68c4773f2" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:18:42.131349  6730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab432e62819d499eaaf3dd55481dd930" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:18:41.856594  8046 consensus_queue.cc:1048] T ce4f062dcd314d43a63ca74067cb5ee3 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.214s
I20260709 13:18:42.144430  6880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "713b5728a197487c9300b310ab94e5a3" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
W20260709 13:18:42.154376  8107 log.cc:927] Time spent T bb3d8792045a4583ae2e965b1350a5b4 P ccd8a4c3bfe3413cb2ae219b09aea832: Append to log took a long time: real 0.341s	user 0.003s	sys 0.005s
I20260709 13:18:42.155937  6878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1704639a875409b9959353527b3fd68" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:18:42.156790  6877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a485a995abc4807b6e511e45419f737" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:18:42.196461  6877 raft_consensus.cc:2468] T 3a485a995abc4807b6e511e45419f737 P cd75a17ab2604397adab03bb8b5fd75c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 3.
I20260709 13:18:42.197654  6877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7887766dc6784fcaa42b35c05fea7a99" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:18:42.198256  6800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a92dd554674067a83a9cb68c4773f2" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:18:42.199219  6877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3022224cc81473690653a83d4e99470" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:18:42.200367  6804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a485a995abc4807b6e511e45419f737" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:18:42.200495  6802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c7f33e544204fbaac4078e3e83bbf4e" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:18:42.201777  6804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20f6842e26174571996b8dea4151d4be" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:18:42.202292  6802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e31b9971c15848dea59d4d4130141d9e" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:18:42.202718  6801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a734b5ab7834e05a8c422208acc58b1" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:18:42.203203  6802 raft_consensus.cc:3060] T e31b9971c15848dea59d4d4130141d9e P b7ab4784c7344b939bc36f639286f377 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:42.142830  7885 leader_election.cc:290] T ab432e62819d499eaaf3dd55481dd930 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 3 election: Requested vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:18:42.204663  8111 raft_consensus.cc:493] T 90d42e216d9741e190bca19a781291fd P b7ab4784c7344b939bc36f639286f377 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:42.205416  8111 raft_consensus.cc:515] T 90d42e216d9741e190bca19a781291fd P b7ab4784c7344b939bc36f639286f377 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:42.206476  7934 leader_election.cc:290] T 24ee15416e3145beaa1b8183453729a3 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 3 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:18:42.207479  7894 leader_election.cc:290] T 4d9def8b32fd443aa94ab1420b06837b P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 3 election: Requested vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:18:42.208477  6806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbdf895bba214ff68685a24fd17dfb5d" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:18:42.209072  6806 raft_consensus.cc:3060] T dbdf895bba214ff68685a24fd17dfb5d P b7ab4784c7344b939bc36f639286f377 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:18:42.209666  8034 consensus_meta.cc:287] T 3411566abe2d4c9bb4b2adfdd05e6f17 P cd75a17ab2604397adab03bb8b5fd75c: Time spent flushing consensus metadata: real 0.518s	user 0.010s	sys 0.006s
I20260709 13:18:42.210038  8034 raft_consensus.cc:515] T 3411566abe2d4c9bb4b2adfdd05e6f17 P cd75a17ab2604397adab03bb8b5fd75c [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:42.156471  7951 consensus_queue.cc:1048] T de3186201e1a40d0b335eeb8b4e256e0 P cd75a17ab2604397adab03bb8b5fd75c [NON_LEADER]: Connected to new peer: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.069s
W20260709 13:18:42.147249  7501 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50756 (request call id 94) took 1382 ms (client timeout 1791 ms). Trace:
I20260709 13:18:42.120718  6803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8292e16e5654be6bc408560cf256aaa" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:18:42.160887  6881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09c2a98de1a4decabd0ff900dd44caa" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:18:42.181952  6730 raft_consensus.cc:2393] T ab432e62819d499eaaf3dd55481dd930 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate b7ab4784c7344b939bc36f639286f377 in current term 3: Already voted for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in this term.
I20260709 13:18:42.195736  6878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b3759de40694069b13c0f8bd40e5709" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:18:42.232646  6800 raft_consensus.cc:2468] T 07a92dd554674067a83a9cb68c4773f2 P b7ab4784c7344b939bc36f639286f377 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 3.
I20260709 13:18:42.232980  6878 raft_consensus.cc:2468] T 9b3759de40694069b13c0f8bd40e5709 P cd75a17ab2604397adab03bb8b5fd75c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 2.
I20260709 13:18:42.202344  6804 raft_consensus.cc:3060] T 20f6842e26174571996b8dea4151d4be P b7ab4784c7344b939bc36f639286f377 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:42.182330  6879 raft_consensus.cc:2393] T dbdf895bba214ff68685a24fd17dfb5d P cd75a17ab2604397adab03bb8b5fd75c [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ccd8a4c3bfe3413cb2ae219b09aea832 in current term 3: Already voted for candidate cd75a17ab2604397adab03bb8b5fd75c in this term.
I20260709 13:18:42.182560  6875 raft_consensus.cc:2393] T 07a92dd554674067a83a9cb68c4773f2 P cd75a17ab2604397adab03bb8b5fd75c [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate ccd8a4c3bfe3413cb2ae219b09aea832 in current term 3: Already voted for candidate cd75a17ab2604397adab03bb8b5fd75c in this term.
I20260709 13:18:42.212450  6799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09c2a98de1a4decabd0ff900dd44caa" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:18:42.236693  6799 raft_consensus.cc:2393] T f09c2a98de1a4decabd0ff900dd44caa P b7ab4784c7344b939bc36f639286f377 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate ccd8a4c3bfe3413cb2ae219b09aea832 in current term 3: Already voted for candidate b7ab4784c7344b939bc36f639286f377 in this term.
I20260709 13:18:42.182633  6872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f03d0dbf16864ca4bc1bb5e4c0334c0f" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:18:42.183270  6874 raft_consensus.cc:2393] T d8292e16e5654be6bc408560cf256aaa P cd75a17ab2604397adab03bb8b5fd75c [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate ccd8a4c3bfe3413cb2ae219b09aea832 in current term 3: Already voted for candidate b7ab4784c7344b939bc36f639286f377 in this term.
I20260709 13:18:42.238005  6872 raft_consensus.cc:2393] T f03d0dbf16864ca4bc1bb5e4c0334c0f P cd75a17ab2604397adab03bb8b5fd75c [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate b7ab4784c7344b939bc36f639286f377 in current term 2: Already voted for candidate cd75a17ab2604397adab03bb8b5fd75c in this term.
I20260709 13:18:42.140075  6873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c7f33e544204fbaac4078e3e83bbf4e" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:18:42.121570  7891 raft_consensus.cc:493] T 90d42e216d9741e190bca19a781291fd P cd75a17ab2604397adab03bb8b5fd75c [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:42.170588  6805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be1a92657f494cac8dd227d152f50151" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:18:42.149237  6731 rpcz_store.cc:276] 0709 13:18:40.632329 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:40.707215 (+ 74886us) service_pool.cc:224] Handling call
0709 13:18:40.739586 (+ 32371us) spinlock_profiling.cc:243] Waited 5.19 ms on lock 0x7b5800000c98. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0c745db1 00007fcc0c885b71 00007fcc0c885a22 00007fcc1579ec09 00007fcc148f8ee0 00007fcc149c20ab 00007fcc149c2131 00007fcc149700a0 00007fcc1496f984 00007fcc0deea6d4 00007fcc0deea662
0709 13:18:41.130054 (+390468us) spinlock_profiling.cc:243] Waited 24.8 ms on lock 0x7b5800000c98. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0c745db1 00007fcc0c885e9c 00007fcc0c885a5b 00007fcc1579ec09 00007fcc148f8ee0 00007fcc149c20ab 00007fcc149c2131 00007fcc149700a0 00007fcc1496f984 00007fcc0deea6d4 00007fcc0deea662
0709 13:18:41.836172 (+706118us) spinlock_profiling.cc:243] Waited 433 ms on lock 0x7b54003b79d4. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f9ae2fa 00007fcc1496fb17 00007fcc0deea6d4 00007fcc0deea662 00007fcc0deea591 00007fcc0deea50c 00007fcc0dee97c2 00007fcc0dce548c 00007fcc0dce48c6 00007fcc0dce426f
0709 13:18:41.836395 (+   223us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1065031552}
W20260709 13:18:42.138592  6798 consensus_meta.cc:287] T 4f00a2e87e56452083b759f60d461ee3 P b7ab4784c7344b939bc36f639286f377: Time spent flushing consensus metadata: real 0.718s	user 0.004s	sys 0.017s
W20260709 13:18:42.113804  8005 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.513s	user 0.005s	sys 0.009s
I20260709 13:18:42.115639  8036 raft_consensus.cc:515] T 7c44c4849aa54f2b94d1f1bef9ed546f P b7ab4784c7344b939bc36f639286f377 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:42.245182  6732 raft_consensus.cc:1275] T 17587d6730594da4a56fa13a353232a1 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 4 FOLLOWER]: Refusing update from remote peer b7ab4784c7344b939bc36f639286f377: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 5. (term mismatch)
I20260709 13:18:42.362360  6799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f9c2e2bf644115957398fe4c9459db" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:18:42.362962  6880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77e330a82df4b43a745d57a68f6f057" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 5 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:18:42.433188  6806 raft_consensus.cc:2468] T dbdf895bba214ff68685a24fd17dfb5d P b7ab4784c7344b939bc36f639286f377 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 3.
I20260709 13:18:42.433840  6880 raft_consensus.cc:2410] T e77e330a82df4b43a745d57a68f6f057 P cd75a17ab2604397adab03bb8b5fd75c [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7ab4784c7344b939bc36f639286f377 for term 5 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 1.
I20260709 13:18:42.396456  6695 leader_election.cc:304] T 711ef6523deb4cbe8ef2ba61e1c21c98 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:18:42.308161  6800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f03d0dbf16864ca4bc1bb5e4c0334c0f" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:18:42.363546  6730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fa34c08b205435dba97346991aa1f92" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:18:42.261107  7502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be1a92657f494cac8dd227d152f50151" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:18:42.346696  6881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab432e62819d499eaaf3dd55481dd930" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:18:42.432229  6799 raft_consensus.cc:2468] T f3f9c2e2bf644115957398fe4c9459db P b7ab4784c7344b939bc36f639286f377 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 2.
I20260709 13:18:42.221928  7938 leader_election.cc:290] T 17587d6730594da4a56fa13a353232a1 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
W20260709 13:18:42.214171  8104 log.cc:927] Time spent T 2c240553ce044eedb41541d72b9475d7 P b7ab4784c7344b939bc36f639286f377: Append to log took a long time: real 0.096s	user 0.000s	sys 0.000s
I20260709 13:18:42.445654  6732 pending_rounds.cc:85] T 17587d6730594da4a56fa13a353232a1 P ccd8a4c3bfe3413cb2ae219b09aea832: Aborting all ops after (but not including) 4
I20260709 13:18:42.451195  6732 pending_rounds.cc:107] T 17587d6730594da4a56fa13a353232a1 P ccd8a4c3bfe3413cb2ae219b09aea832: Aborting uncommitted NO_OP operation due to leader change: 3.5
W20260709 13:18:42.429986  8005 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.874s	user 0.038s	sys 0.042s
W20260709 13:18:42.306418  8074 consensus_meta.cc:287] T bd6869f07b5a4885a0b99fbe60c3b175 P b7ab4784c7344b939bc36f639286f377: Time spent flushing consensus metadata: real 0.735s	user 0.010s	sys 0.002s
I20260709 13:18:42.446069  6800 raft_consensus.cc:3060] T f03d0dbf16864ca4bc1bb5e4c0334c0f P b7ab4784c7344b939bc36f639286f377 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:42.451867  6732 raft_consensus.cc:2889] T 17587d6730594da4a56fa13a353232a1 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:18:42.197700  8046 raft_consensus.cc:493] T f5be3a11b23d4ea9b08300a2789821c7 P b7ab4784c7344b939bc36f639286f377 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader cd75a17ab2604397adab03bb8b5fd75c)
W20260709 13:18:42.273142  8089 consensus_meta.cc:287] T 7c37d41cd9164c15a6826ca62a851a69 P b7ab4784c7344b939bc36f639286f377: Time spent flushing consensus metadata: real 0.862s	user 0.015s	sys 0.000s
I20260709 13:18:42.225121  6727 raft_consensus.cc:1275] T f58dc08b12a2494bb9a1372837970ca2 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 3 FOLLOWER]: Refusing update from remote peer b7ab4784c7344b939bc36f639286f377: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:18:41.797792  6725 rpcz_store.cc:276] 0709 13:18:40.588998 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:40.744957 (+155959us) service_pool.cc:224] Handling call
0709 13:18:41.604824 (+859867us) spinlock_profiling.cc:243] Waited 19.1 ms on lock 0x7b5800000c98. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0c745db1 00007fcc0c885b71 00007fcc0c885a22 00007fcc1579ec09 00007fcc148f8ee0 00007fcc149c20ab 00007fcc149c2131 00007fcc14983fc0 00007fcc1496e929 00007fcc1496e3d2 00007fcc0dee5bd4
0709 13:18:41.605105 (+   281us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:41.605325 (+   220us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:18:41.605828 (+   503us) log.cc:844] Serialized 14 byte log entry
0709 13:18:41.749171 (+143343us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:41.749380 (+   209us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:18:41.749445 (+    65us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:41.749549 (+   104us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:41.749730 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":71057,"prepare.queue_time_us":852,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":37,"raft.queue_time_us":92801,"raft.run_cpu_time_us":117,"raft.run_wall_time_us":118,"spinlock_wait_cycles":43896576,"thread_start_us":51868,"threads_started":1,"wal-append.queue_time_us":130645}
I20260709 13:18:42.465829  8046 raft_consensus.cc:515] T f5be3a11b23d4ea9b08300a2789821c7 P b7ab4784c7344b939bc36f639286f377 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:42.212002  8034 leader_election.cc:290] T 3411566abe2d4c9bb4b2adfdd05e6f17 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 2 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:18:42.215030  7886 leader_election.cc:290] T dbdf895bba214ff68685a24fd17dfb5d P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 3 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
W20260709 13:18:42.321218  8109 log.cc:927] Time spent T f3f9c2e2bf644115957398fe4c9459db P ccd8a4c3bfe3413cb2ae219b09aea832: Append to log took a long time: real 0.347s	user 0.000s	sys 0.009s
I20260709 13:18:42.217187  7994 leader_election.cc:290] T 427c124d773f483294511e80fe340075 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:18:42.304920  7934 raft_consensus.cc:493] T 4b8cacb381b746da8d0049b0a83b41dd P cd75a17ab2604397adab03bb8b5fd75c [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:42.467888  7934 raft_consensus.cc:515] T 4b8cacb381b746da8d0049b0a83b41dd P cd75a17ab2604397adab03bb8b5fd75c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:18:42.221413  8022 leader_election.cc:290] T 3fa34c08b205435dba97346991aa1f92 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:18:42.469264  8046 leader_election.cc:290] T f5be3a11b23d4ea9b08300a2789821c7 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:18:42.469980  8089 raft_consensus.cc:515] T 7c37d41cd9164c15a6826ca62a851a69 P b7ab4784c7344b939bc36f639286f377 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:42.470918  7934 leader_election.cc:290] T 4b8cacb381b746da8d0049b0a83b41dd P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
W20260709 13:18:42.456166  6695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 59844.4us
I20260709 13:18:42.378351  8111 leader_election.cc:290] T 90d42e216d9741e190bca19a781291fd P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:18:42.444535  7883 leader_election.cc:290] T 1bf4668eeb70467fb3dc5a0289233b3c P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:18:42.474107  6695 leader_election.cc:304] T 22ccee1b570c4ad3a57bd7aec085b1b4 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:18:42.321573  8010 leader_election.cc:290] T de3186201e1a40d0b335eeb8b4e256e0 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:18:42.461949  6799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce4f062dcd314d43a63ca74067cb5ee3" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 4 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:18:42.458529  7938 raft_consensus.cc:2804] T 711ef6523deb4cbe8ef2ba61e1c21c98 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:18:42.475498  7938 raft_consensus.cc:493] T 711ef6523deb4cbe8ef2ba61e1c21c98 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:42.475976  7938 raft_consensus.cc:3060] T 711ef6523deb4cbe8ef2ba61e1c21c98 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:42.477576  8089 leader_election.cc:290] T 7c37d41cd9164c15a6826ca62a851a69 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 2 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
W20260709 13:18:42.467398  7499 consensus_meta.cc:287] T 1528ab62b6fe4e3099d08f141afee116 P 7ba59cc884714e8aa5f3f0ecaed84cbb: Time spent flushing consensus metadata: real 0.932s	user 0.017s	sys 0.006s
I20260709 13:18:42.479007  7499 raft_consensus.cc:2468] T 1528ab62b6fe4e3099d08f141afee116 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 3.
I20260709 13:18:42.458626  8074 raft_consensus.cc:515] T bd6869f07b5a4885a0b99fbe60c3b175 P b7ab4784c7344b939bc36f639286f377 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:42.435812  6798 raft_consensus.cc:2468] T 4f00a2e87e56452083b759f60d461ee3 P b7ab4784c7344b939bc36f639286f377 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in term 4.
I20260709 13:18:42.480439  6798 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50550 (request call id 53) took 1249 ms. Trace:
I20260709 13:18:42.480841  6798 rpcz_store.cc:276] 0709 13:18:41.230819 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:41.262750 (+ 31931us) service_pool.cc:224] Handling call
0709 13:18:42.480358 (+1217608us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:42.481528  8074 leader_election.cc:290] T bd6869f07b5a4885a0b99fbe60c3b175 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 5 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:18:42.482101  6798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1704639a875409b9959353527b3fd68" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:18:42.482553  6800 raft_consensus.cc:2468] T f03d0dbf16864ca4bc1bb5e4c0334c0f P b7ab4784c7344b939bc36f639286f377 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 3.
I20260709 13:18:42.483091  6798 raft_consensus.cc:2393] T a1704639a875409b9959353527b3fd68 P b7ab4784c7344b939bc36f639286f377 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate ccd8a4c3bfe3413cb2ae219b09aea832 in current term 3: Already voted for candidate b7ab4784c7344b939bc36f639286f377 in this term.
I20260709 13:18:42.483573  6800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a75bfe094d4bdc963aba3f08dfcd25" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:18:42.436894  6724 raft_consensus.cc:1275] T d33d5ee8ef6f415593d8df52063161ad P ccd8a4c3bfe3413cb2ae219b09aea832 [term 3 FOLLOWER]: Refusing update from remote peer b7ab4784c7344b939bc36f639286f377: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:18:42.361790  7970 raft_consensus.cc:493] T d8cee0accdb8499c86d4414b72565a38 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:42.454476  8077 consensus_meta.cc:287] T b3f13b31a1f84f0d89d007eadd57924c P 7ba59cc884714e8aa5f3f0ecaed84cbb: Time spent flushing consensus metadata: real 0.761s	user 0.010s	sys 0.009s
I20260709 13:18:42.212600  7497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "404190ce4ce94cecbfcb6ea9d1dd8626" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:18:42.455816  6806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "427c124d773f483294511e80fe340075" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:18:42.477470  6801 raft_consensus.cc:2468] T 7a734b5ab7834e05a8c422208acc58b1 P b7ab4784c7344b939bc36f639286f377 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 3.
I20260709 13:18:42.490483  6802 raft_consensus.cc:2468] T e31b9971c15848dea59d4d4130141d9e P b7ab4784c7344b939bc36f639286f377 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 3.
I20260709 13:18:42.318642  6803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44bde925b2e541b69890d70715b85176" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:18:42.518882  6802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17587d6730594da4a56fa13a353232a1" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:18:42.492367  6804 raft_consensus.cc:2468] T 20f6842e26174571996b8dea4151d4be P b7ab4784c7344b939bc36f639286f377 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 3.
I20260709 13:18:42.492615  6800 raft_consensus.cc:2393] T 95a75bfe094d4bdc963aba3f08dfcd25 P b7ab4784c7344b939bc36f639286f377 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate ccd8a4c3bfe3413cb2ae219b09aea832 in current term 3: Already voted for candidate b7ab4784c7344b939bc36f639286f377 in this term.
I20260709 13:18:42.498602  6873 raft_consensus.cc:2393] T 8c7f33e544204fbaac4078e3e83bbf4e P cd75a17ab2604397adab03bb8b5fd75c [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ccd8a4c3bfe3413cb2ae219b09aea832 in current term 2: Already voted for candidate cd75a17ab2604397adab03bb8b5fd75c in this term.
I20260709 13:18:42.496454  6805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab432e62819d499eaaf3dd55481dd930" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:18:42.380496  8064 raft_consensus.cc:493] T 24ee15416e3145beaa1b8183453729a3 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:42.501787  6806 raft_consensus.cc:2393] T 427c124d773f483294511e80fe340075 P b7ab4784c7344b939bc36f639286f377 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate ccd8a4c3bfe3413cb2ae219b09aea832 in current term 2: Already voted for candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in this term.
I20260709 13:18:42.498044  8099 raft_consensus.cc:2804] T 22ccee1b570c4ad3a57bd7aec085b1b4 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 13:18:42.222368  7501 rpcz_store.cc:269] 0709 13:18:40.764574 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:40.847022 (+ 82448us) service_pool.cc:224] Handling call
0709 13:18:41.881427 (+1034405us) spinlock_profiling.cc:243] Waited 127 ms on lock 0x7b54004691d4. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f9ae2fa 00007fcc1496fb17 00007fcc0deea6d4 00007fcc0deea662 00007fcc0deea591 00007fcc0deea50c 00007fcc0dee97c2 00007fcc0dce548c 00007fcc0dce48c6 00007fcc0dce426f
0709 13:18:42.137164 (+255737us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":291281152}
I20260709 13:18:42.325646  8037 raft_consensus.cc:515] T 4275cf08e63345f993bce8664eada830 P b7ab4784c7344b939bc36f639286f377 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
W20260709 13:18:42.507702  6844 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.715s	user 0.023s	sys 0.023s
I20260709 13:18:42.510648  6730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5be3a11b23d4ea9b08300a2789821c7" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:18:42.444380  7891 raft_consensus.cc:515] T 90d42e216d9741e190bca19a781291fd P cd75a17ab2604397adab03bb8b5fd75c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:42.522513  6723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bf4668eeb70467fb3dc5a0289233b3c" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:18:42.523608  6802 raft_consensus.cc:1240] T 7c37d41cd9164c15a6826ca62a851a69 P b7ab4784c7344b939bc36f639286f377 [term 2 FOLLOWER]: Rejecting Update request from peer ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 1. Current term is 2. Ops: []
I20260709 13:18:42.495337  6695 leader_election.cc:304] T c4db81d9d329422bb3b4160ca4ac2d1d P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:18:42.524437  6804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d9def8b32fd443aa94ab1420b06837b" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:18:42.527252  6805 raft_consensus.cc:2393] T ab432e62819d499eaaf3dd55481dd930 P b7ab4784c7344b939bc36f639286f377 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate ccd8a4c3bfe3413cb2ae219b09aea832 in current term 3: Already voted for candidate b7ab4784c7344b939bc36f639286f377 in this term.
I20260709 13:18:42.525843  6732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c37d41cd9164c15a6826ca62a851a69" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:18:42.500485  7466 leader_election.cc:304] T 4f00a2e87e56452083b759f60d461ee3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, b7ab4784c7344b939bc36f639286f377; no voters: 
I20260709 13:18:42.132812  7498 rpcz_store.cc:276] 0709 13:18:40.643360 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:40.643576 (+   216us) service_pool.cc:224] Handling call
0709 13:18:40.643927 (+   351us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:41.210391 (+566464us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:41.844162 (+633771us) spinlock_profiling.cc:243] Waited 494 ms on lock 0x7b540046fad4. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f9aae01 00007fcc0f9a983e 00007fcc1496e419 00007fcc0dee5bd4 00007fcc0dee5b62 00007fcc0dee5a91 00007fcc0dee5a0c 00007fcc0dee4cc2 00007fcc0dce548c 00007fcc0dce48c6
0709 13:18:41.880986 (+ 36824us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1135612288}
I20260709 13:18:42.531800  6799 raft_consensus.cc:1275] T 90d42e216d9741e190bca19a781291fd P b7ab4784c7344b939bc36f639286f377 [term 3 FOLLOWER]: Refusing update from remote peer ccd8a4c3bfe3413cb2ae219b09aea832: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:18:42.500351  7970 raft_consensus.cc:515] T d8cee0accdb8499c86d4414b72565a38 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:18:42.532992  6726 raft_consensus.cc:1240] T 4d9def8b32fd443aa94ab1420b06837b P ccd8a4c3bfe3413cb2ae219b09aea832 [term 3 FOLLOWER]: Rejecting Update request from peer b7ab4784c7344b939bc36f639286f377 for earlier term 2. Current term is 3. Ops: []
W20260709 13:18:42.499794  7468 leader_election.cc:336] T 24ee15416e3145beaa1b8183453729a3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931): Timed out: RequestConsensusVote RPC to 127.5.126.67:42931 timed out after 1.715s (SENT)
W20260709 13:18:42.583691  6844 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.792s	user 0.038s	sys 0.030s
W20260709 13:18:42.584205  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 796277us
I20260709 13:18:42.536872  6731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90d42e216d9741e190bca19a781291fd" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
W20260709 13:18:42.525763  8035 consensus_meta.cc:287] T a3022224cc81473690653a83d4e99470 P cd75a17ab2604397adab03bb8b5fd75c: Time spent flushing consensus metadata: real 0.866s	user 0.016s	sys 0.002s
W20260709 13:18:42.588641  7466 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 88254.5us
I20260709 13:18:42.525539  6724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6869f07b5a4885a0b99fbe60c3b175" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 5 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:18:42.591881  8124 consensus_queue.cc:1048] T 711ef6523deb4cbe8ef2ba61e1c21c98 P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.008s
I20260709 13:18:42.596091  8102 raft_consensus.cc:493] T 1528ab62b6fe4e3099d08f141afee116 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:42.597237  8126 raft_consensus.cc:2804] T 4f00a2e87e56452083b759f60d461ee3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:18:42.597781  8010 raft_consensus.cc:493] T 24ee15416e3145beaa1b8183453729a3 P b7ab4784c7344b939bc36f639286f377 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:42.599545  6772 leader_election.cc:304] T 9b3759de40694069b13c0f8bd40e5709 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:18:42.594897  6770 leader_election.cc:304] T 7887766dc6784fcaa42b35c05fea7a99 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:18:42.601378  6803 raft_consensus.cc:2393] T 44bde925b2e541b69890d70715b85176 P b7ab4784c7344b939bc36f639286f377 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate ccd8a4c3bfe3413cb2ae219b09aea832 in current term 3: Already voted for candidate b7ab4784c7344b939bc36f639286f377 in this term.
I20260709 13:18:42.534106  8099 raft_consensus.cc:493] T 22ccee1b570c4ad3a57bd7aec085b1b4 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:18:42.585142  6695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 89887.4us
I20260709 13:18:42.607184  6807 raft_consensus.cc:1240] T 4275cf08e63345f993bce8664eada830 P b7ab4784c7344b939bc36f639286f377 [term 2 FOLLOWER]: Rejecting Update request from peer ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 1. Current term is 2. Ops: []
I20260709 13:18:42.608418  6772 leader_election.cc:304] T f03d0dbf16864ca4bc1bb5e4c0334c0f P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:18:42.619180  6772 leader_election.cc:304] T ab432e62819d499eaaf3dd55481dd930 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:18:42.617344  6875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90d42e216d9741e190bca19a781291fd" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:18:42.609263  6770 leader_election.cc:304] T 44bde925b2e541b69890d70715b85176 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:18:42.583166  8120 raft_consensus.cc:493] T 427c124d773f483294511e80fe340075 P b7ab4784c7344b939bc36f639286f377 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:42.585605  6725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de3186201e1a40d0b335eeb8b4e256e0" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:18:42.590152  8103 raft_consensus.cc:2804] T c4db81d9d329422bb3b4160ca4ac2d1d P ccd8a4c3bfe3413cb2ae219b09aea832 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:18:42.502893  8077 raft_consensus.cc:515] T b3f13b31a1f84f0d89d007eadd57924c P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:18:42.626420  6695 leader_election.cc:304] T 713b5728a197487c9300b310ab94e5a3 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
I20260709 13:18:42.601696  6844 leader_election.cc:304] T f03d0dbf16864ca4bc1bb5e4c0334c0f P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:18:42.522421  7992 raft_consensus.cc:515] T 4275cf08e63345f993bce8664eada830 P cd75a17ab2604397adab03bb8b5fd75c [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:42.621275  6772 leader_election.cc:304] T e77e330a82df4b43a745d57a68f6f057 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:18:42.620330  6875 raft_consensus.cc:2468] T 90d42e216d9741e190bca19a781291fd P cd75a17ab2604397adab03bb8b5fd75c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 3.
I20260709 13:18:42.627507  6880 raft_consensus.cc:1240] T 8c7f33e544204fbaac4078e3e83bbf4e P cd75a17ab2604397adab03bb8b5fd75c [term 2 FOLLOWER]: Rejecting Update request from peer b7ab4784c7344b939bc36f639286f377 for earlier term 1. Current term is 2. Ops: []
I20260709 13:18:42.629782  6844 leader_election.cc:304] T 7ba5dac66ab5497e9e336f2a3c28cda5 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:18:42.630578  6880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6869f07b5a4885a0b99fbe60c3b175" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 5 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:18:42.631223  6880 raft_consensus.cc:3060] T bd6869f07b5a4885a0b99fbe60c3b175 P cd75a17ab2604397adab03bb8b5fd75c [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:42.607880  8115 raft_consensus.cc:493] T d8cee0accdb8499c86d4414b72565a38 P cd75a17ab2604397adab03bb8b5fd75c [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:42.616700  8096 raft_consensus.cc:2749] T 7887766dc6784fcaa42b35c05fea7a99 P b7ab4784c7344b939bc36f639286f377 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:18:42.644088  6875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bf4668eeb70467fb3dc5a0289233b3c" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:18:42.649816  6875 raft_consensus.cc:2468] T 1bf4668eeb70467fb3dc5a0289233b3c P cd75a17ab2604397adab03bb8b5fd75c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 2.
I20260709 13:18:42.533978  8064 raft_consensus.cc:515] T 24ee15416e3145beaa1b8183453729a3 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } attrs { replace: true } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:18:42.616483  8089 raft_consensus.cc:2804] T 9b3759de40694069b13c0f8bd40e5709 P b7ab4784c7344b939bc36f639286f377 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:18:42.591910  7886 consensus_queue.cc:1059] T f09c2a98de1a4decabd0ff900dd44caa P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.036s
I20260709 13:18:42.632144  6695 leader_election.cc:304] T de3186201e1a40d0b335eeb8b4e256e0 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:18:42.619377  8099 raft_consensus.cc:3060] T 22ccee1b570c4ad3a57bd7aec085b1b4 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:42.594441  7938 raft_consensus.cc:515] T 711ef6523deb4cbe8ef2ba61e1c21c98 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
W20260709 13:18:42.651600  7466 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 62021.5us
I20260709 13:18:42.591946  7468 leader_election.cc:304] T 24ee15416e3145beaa1b8183453729a3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, b7ab4784c7344b939bc36f639286f377; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:18:42.603039  8035 raft_consensus.cc:515] T a3022224cc81473690653a83d4e99470 P cd75a17ab2604397adab03bb8b5fd75c [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:42.633358  8081 raft_consensus.cc:2749] T 44bde925b2e541b69890d70715b85176 P b7ab4784c7344b939bc36f639286f377 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:18:42.654446  6876 raft_consensus.cc:1240] T 4275cf08e63345f993bce8664eada830 P cd75a17ab2604397adab03bb8b5fd75c [term 2 FOLLOWER]: Rejecting Update request from peer ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 1. Current term is 2. Ops: []
I20260709 13:18:42.625108  7990 raft_consensus.cc:2749] T ab432e62819d499eaaf3dd55481dd930 P b7ab4784c7344b939bc36f639286f377 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:18:42.634752  8094 consensus_queue.cc:1059] T a3022224cc81473690653a83d4e99470 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.035s
W20260709 13:18:42.680627  6772 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 59442.2us
I20260709 13:18:42.628722  8103 raft_consensus.cc:493] T c4db81d9d329422bb3b4160ca4ac2d1d P ccd8a4c3bfe3413cb2ae219b09aea832 [term 2 FOLLOWER]: Starting leader election (detected failure of leader cd75a17ab2604397adab03bb8b5fd75c)
I20260709 13:18:42.625123  8046 raft_consensus.cc:2749] T f03d0dbf16864ca4bc1bb5e4c0334c0f P b7ab4784c7344b939bc36f639286f377 [term 3 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:18:42.643832  8069 raft_consensus.cc:2804] T 713b5728a197487c9300b310ab94e5a3 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:18:42.682535  8069 raft_consensus.cc:493] T 713b5728a197487c9300b310ab94e5a3 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:42.682888  8069 raft_consensus.cc:3060] T 713b5728a197487c9300b310ab94e5a3 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:42.683426  8037 leader_election.cc:290] T 4275cf08e63345f993bce8664eada830 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 2 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:18:42.684020  8036 leader_election.cc:290] T 7c44c4849aa54f2b94d1f1bef9ed546f P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 3 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:18:42.647593  8006 consensus_queue.cc:1048] T f58dc08b12a2494bb9a1372837970ca2 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.034s
I20260709 13:18:42.684906  7970 leader_election.cc:290] T d8cee0accdb8499c86d4414b72565a38 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:18:42.647063  8075 consensus_queue.cc:1048] T 17587d6730594da4a56fa13a353232a1 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.034s
I20260709 13:18:42.656718  8089 raft_consensus.cc:493] T 9b3759de40694069b13c0f8bd40e5709 P b7ab4784c7344b939bc36f639286f377 [term 2 FOLLOWER]: Starting leader election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:18:42.613700  8102 raft_consensus.cc:515] T 1528ab62b6fe4e3099d08f141afee116 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } attrs { replace: true } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:18:42.687809  8089 raft_consensus.cc:3060] T 9b3759de40694069b13c0f8bd40e5709 P b7ab4784c7344b939bc36f639286f377 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:42.675069  7500 raft_consensus.cc:1240] T b3f13b31a1f84f0d89d007eadd57924c P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 2 FOLLOWER]: Rejecting Update request from peer ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 1. Current term is 2. Ops: []
I20260709 13:18:42.690090  8102 leader_election.cc:290] T 1528ab62b6fe4e3099d08f141afee116 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:18:42.701122  6772 leader_election.cc:304] T 90d42e216d9741e190bca19a781291fd P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:18:42.666100  8034 raft_consensus.cc:2804] T 7ba5dac66ab5497e9e336f2a3c28cda5 P cd75a17ab2604397adab03bb8b5fd75c [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:18:42.618997  7958 consensus_queue.cc:1048] T ce4f062dcd314d43a63ca74067cb5ee3 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.037s
I20260709 13:18:42.677688  6875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c37d41cd9164c15a6826ca62a851a69" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:18:42.678649  8074 raft_consensus.cc:2749] T e77e330a82df4b43a745d57a68f6f057 P b7ab4784c7344b939bc36f639286f377 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:18:42.631767  8120 raft_consensus.cc:515] T 427c124d773f483294511e80fe340075 P b7ab4784c7344b939bc36f639286f377 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } attrs { replace: true } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: NON_VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: true } }
I20260709 13:18:42.681993  7502 raft_consensus.cc:1275] T 4b8cacb381b746da8d0049b0a83b41dd P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 3 FOLLOWER]: Refusing update from remote peer ccd8a4c3bfe3413cb2ae219b09aea832: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:18:42.673103  6695 leader_election.cc:304] T 07a92dd554674067a83a9cb68c4773f2 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
I20260709 13:18:42.616272  8010 raft_consensus.cc:515] T 24ee15416e3145beaa1b8183453729a3 P b7ab4784c7344b939bc36f639286f377 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } attrs { replace: true } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:18:42.723624  8130 raft_consensus.cc:3060] T 24ee15416e3145beaa1b8183453729a3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:42.725647  8010 leader_election.cc:290] T 24ee15416e3145beaa1b8183453729a3 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
W20260709 13:18:42.726878  8105 log.cc:927] Time spent T 713b5728a197487c9300b310ab94e5a3 P cd75a17ab2604397adab03bb8b5fd75c: Append to log took a long time: real 0.575s	user 0.005s	sys 0.008s
I20260709 13:18:42.728363  8112 raft_consensus.cc:2804] T f03d0dbf16864ca4bc1bb5e4c0334c0f P cd75a17ab2604397adab03bb8b5fd75c [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:18:42.728783  8112 raft_consensus.cc:493] T f03d0dbf16864ca4bc1bb5e4c0334c0f P cd75a17ab2604397adab03bb8b5fd75c [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:42.729121  8112 raft_consensus.cc:3060] T f03d0dbf16864ca4bc1bb5e4c0334c0f P cd75a17ab2604397adab03bb8b5fd75c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:42.730425  6803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8cee0accdb8499c86d4414b72565a38" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:18:42.730934  8089 raft_consensus.cc:515] T 9b3759de40694069b13c0f8bd40e5709 P b7ab4784c7344b939bc36f639286f377 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:42.731611  8118 raft_consensus.cc:493] T e77e330a82df4b43a745d57a68f6f057 P cd75a17ab2604397adab03bb8b5fd75c [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:42.673803  6725 raft_consensus.cc:2393] T de3186201e1a40d0b335eeb8b4e256e0 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7ab4784c7344b939bc36f639286f377 in current term 3: Already voted for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in this term.
I20260709 13:18:42.702273  6880 raft_consensus.cc:2468] T bd6869f07b5a4885a0b99fbe60c3b175 P cd75a17ab2604397adab03bb8b5fd75c [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 5.
W20260709 13:18:42.677522  6770 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 51038.9us
I20260709 13:18:42.732116  8118 raft_consensus.cc:515] T e77e330a82df4b43a745d57a68f6f057 P cd75a17ab2604397adab03bb8b5fd75c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } }
I20260709 13:18:42.718976  6875 raft_consensus.cc:3060] T 7c37d41cd9164c15a6826ca62a851a69 P cd75a17ab2604397adab03bb8b5fd75c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:42.733232  6880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5be3a11b23d4ea9b08300a2789821c7" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:18:42.734406  8118 leader_election.cc:290] T e77e330a82df4b43a745d57a68f6f057 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391)
I20260709 13:18:42.734483  6880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c44c4849aa54f2b94d1f1bef9ed546f" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:18:42.720132  6877 raft_consensus.cc:2393] T a3022224cc81473690653a83d4e99470 P cd75a17ab2604397adab03bb8b5fd75c [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate b7ab4784c7344b939bc36f639286f377 in current term 3: Already voted for candidate cd75a17ab2604397adab03bb8b5fd75c in this term.
I20260709 13:18:42.737528  7938 leader_election.cc:290] T 711ef6523deb4cbe8ef2ba61e1c21c98 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 3 election: Requested vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:18:42.651034  8115 raft_consensus.cc:515] T d8cee0accdb8499c86d4414b72565a38 P cd75a17ab2604397adab03bb8b5fd75c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:18:42.738772  8006 consensus_queue.cc:1059] T 8c7f33e544204fbaac4078e3e83bbf4e P b7ab4784c7344b939bc36f639286f377 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:18:42.739590  7498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "427c124d773f483294511e80fe340075" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb"
I20260709 13:18:42.740419  7498 raft_consensus.cc:2393] T 427c124d773f483294511e80fe340075 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate ccd8a4c3bfe3413cb2ae219b09aea832 in current term 2: Already voted for candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in this term.
I20260709 13:18:42.680322  7886 raft_consensus.cc:3055] T f09c2a98de1a4decabd0ff900dd44caa P cd75a17ab2604397adab03bb8b5fd75c [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:18:42.733397  8090 raft_consensus.cc:2804] T de3186201e1a40d0b335eeb8b4e256e0 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:18:42.738963  6772 leader_election.cc:304] T 1bf4668eeb70467fb3dc5a0289233b3c P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
W20260709 13:18:42.722934  7468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 225214us
I20260709 13:18:42.690802  8103 raft_consensus.cc:3060] T c4db81d9d329422bb3b4160ca4ac2d1d P ccd8a4c3bfe3413cb2ae219b09aea832 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:18:42.766145  6695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 93093.3us
W20260709 13:18:42.766855  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 137137us
I20260709 13:18:42.767509  6695 leader_election.cc:304] T dbdf895bba214ff68685a24fd17dfb5d P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
I20260709 13:18:42.768420  6772 leader_election.cc:304] T bd6869f07b5a4885a0b99fbe60c3b175 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:18:42.769381  6772 leader_election.cc:304] T f5be3a11b23d4ea9b08300a2789821c7 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:18:42.747287  6875 raft_consensus.cc:2468] T 7c37d41cd9164c15a6826ca62a851a69 P cd75a17ab2604397adab03bb8b5fd75c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 2.
I20260709 13:18:42.773579  6772 leader_election.cc:304] T 7c37d41cd9164c15a6826ca62a851a69 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:18:42.776818  6695 leader_election.cc:304] T f3f9c2e2bf644115957398fe4c9459db P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
I20260709 13:18:42.739892  8006 raft_consensus.cc:3055] T 8c7f33e544204fbaac4078e3e83bbf4e P b7ab4784c7344b939bc36f639286f377 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:18:42.741150  8115 leader_election.cc:290] T d8cee0accdb8499c86d4414b72565a38 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:18:42.717558  8075 raft_consensus.cc:2804] T 90d42e216d9741e190bca19a781291fd P b7ab4784c7344b939bc36f639286f377 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:18:42.717847  7934 raft_consensus.cc:493] T bb3d8792045a4583ae2e965b1350a5b4 P cd75a17ab2604397adab03bb8b5fd75c [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:42.746520  8034 raft_consensus.cc:697] T 7ba5dac66ab5497e9e336f2a3c28cda5 P cd75a17ab2604397adab03bb8b5fd75c [term 3 LEADER]: Becoming Leader. State: Replica: cd75a17ab2604397adab03bb8b5fd75c, State: Running, Role: LEADER
I20260709 13:18:42.763607  7886 raft_consensus.cc:740] T f09c2a98de1a4decabd0ff900dd44caa P cd75a17ab2604397adab03bb8b5fd75c [term 2 LEADER]: Becoming Follower/Learner. State: Replica: cd75a17ab2604397adab03bb8b5fd75c, State: Running, Role: LEADER
I20260709 13:18:42.782145  8010 raft_consensus.cc:2804] T 1bf4668eeb70467fb3dc5a0289233b3c P b7ab4784c7344b939bc36f639286f377 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:18:42.782481  8036 raft_consensus.cc:2804] T 7c37d41cd9164c15a6826ca62a851a69 P b7ab4784c7344b939bc36f639286f377 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:18:42.827679  6799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f58dc08b12a2494bb9a1372837970ca2" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:18:42.780623  8126 raft_consensus.cc:697] T 4f00a2e87e56452083b759f60d461ee3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 4 LEADER]: Becoming Leader. State: Replica: 7ba59cc884714e8aa5f3f0ecaed84cbb, State: Running, Role: LEADER
I20260709 13:18:42.847258  6799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbdf895bba214ff68685a24fd17dfb5d" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:18:42.848431  6799 raft_consensus.cc:2393] T dbdf895bba214ff68685a24fd17dfb5d P b7ab4784c7344b939bc36f639286f377 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c in current term 3: Already voted for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in this term.
I20260709 13:18:42.782341  8074 raft_consensus.cc:2804] T bd6869f07b5a4885a0b99fbe60c3b175 P b7ab4784c7344b939bc36f639286f377 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:18:42.769603  7499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17587d6730594da4a56fa13a353232a1" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:18:42.833305  6804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a734b5ab7834e05a8c422208acc58b1" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:18:42.820825  6875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24ee15416e3145beaa1b8183453729a3" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:18:42.871063  6805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30e88460611e47b2ba16a46a30b5f416" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:18:42.871517  6875 raft_consensus.cc:2393] T 24ee15416e3145beaa1b8183453729a3 P cd75a17ab2604397adab03bb8b5fd75c [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7ab4784c7344b939bc36f639286f377 in current term 3: Already voted for candidate cd75a17ab2604397adab03bb8b5fd75c in this term.
I20260709 13:18:42.871119  6804 raft_consensus.cc:2393] T 7a734b5ab7834e05a8c422208acc58b1 P b7ab4784c7344b939bc36f639286f377 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c in current term 3: Already voted for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in this term.
I20260709 13:18:42.839188  6844 leader_election.cc:304] T fe20b4b48823486ca3b9c648db6ce8aa P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:18:42.776830  7990 raft_consensus.cc:2749] T f5be3a11b23d4ea9b08300a2789821c7 P b7ab4784c7344b939bc36f639286f377 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:18:42.827116  6802 raft_consensus.cc:1240] T ab432e62819d499eaaf3dd55481dd930 P b7ab4784c7344b939bc36f639286f377 [term 3 FOLLOWER]: Rejecting Update request from peer cd75a17ab2604397adab03bb8b5fd75c for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 13:18:42.777583  8094 raft_consensus.cc:2804] T 07a92dd554674067a83a9cb68c4773f2 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:18:42.843827  6806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a92dd554674067a83a9cb68c4773f2" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:18:42.820299  8090 raft_consensus.cc:697] T de3186201e1a40d0b335eeb8b4e256e0 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 3 LEADER]: Becoming Leader. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
I20260709 13:18:42.890692  6806 raft_consensus.cc:2393] T 07a92dd554674067a83a9cb68c4773f2 P b7ab4784c7344b939bc36f639286f377 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c in current term 3: Already voted for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in this term.
I20260709 13:18:42.763135  8046 consensus_queue.cc:1048] T d33d5ee8ef6f415593d8df52063161ad P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.059s
I20260709 13:18:42.850916  7496 raft_consensus.cc:1275] T d8cee0accdb8499c86d4414b72565a38 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 3 FOLLOWER]: Refusing update from remote peer b7ab4784c7344b939bc36f639286f377: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 5. (term mismatch)
I20260709 13:18:42.850648  8126 consensus_queue.cc:237] T 4f00a2e87e56452083b759f60d461ee3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:18:42.851475  8060 raft_consensus.cc:3055] T a1704639a875409b9959353527b3fd68 P cd75a17ab2604397adab03bb8b5fd75c [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:18:42.853574  6872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ba5dac66ab5497e9e336f2a3c28cda5" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:18:42.830711  8066 raft_consensus.cc:2804] T f3f9c2e2bf644115957398fe4c9459db P ccd8a4c3bfe3413cb2ae219b09aea832 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:18:42.855810  6807 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:32976 (request call id 1795) took 1144 ms. Trace:
I20260709 13:18:42.856164  8122 raft_consensus.cc:493] T 30e88460611e47b2ba16a46a30b5f416 P b7ab4784c7344b939bc36f639286f377 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:18:42.857260  7498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24ee15416e3145beaa1b8183453729a3" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:18:42.858095  8036 raft_consensus.cc:697] T 7c37d41cd9164c15a6826ca62a851a69 P b7ab4784c7344b939bc36f639286f377 [term 2 LEADER]: Becoming Leader. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
I20260709 13:18:42.860090  6876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f00a2e87e56452083b759f60d461ee3" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:18:42.861780  8064 leader_election.cc:290] T 24ee15416e3145beaa1b8183453729a3 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:18:42.816145  8037 raft_consensus.cc:493] T 853ac0a8cbd64ce99457f170216d4d0f P b7ab4784c7344b939bc36f639286f377 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:18:42.821610  8075 raft_consensus.cc:493] T 90d42e216d9741e190bca19a781291fd P b7ab4784c7344b939bc36f639286f377 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:42.782156  8102 raft_consensus.cc:2804] T dbdf895bba214ff68685a24fd17dfb5d P ccd8a4c3bfe3413cb2ae219b09aea832 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:18:42.872850  6626 catalog_manager.cc:5697] T 404190ce4ce94cecbfcb6ea9d1dd8626 P 7ba59cc884714e8aa5f3f0ecaed84cbb reported cstate change: term changed from 1 to 3, leader changed from ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65) to 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68). New cstate: current_term: 3 leader_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:18:42.892978  6802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "427c124d773f483294511e80fe340075" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:18:42.818619  8006 raft_consensus.cc:740] T 8c7f33e544204fbaac4078e3e83bbf4e P b7ab4784c7344b939bc36f639286f377 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
W20260709 13:18:42.899829  6695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 123074us
I20260709 13:18:42.901456  7938 raft_consensus.cc:493] T b56bf91d90824c959e21e0cee5ba1816 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:42.903137  6879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24ee15416e3145beaa1b8183453729a3" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:18:42.833906  8114 raft_consensus.cc:493] T 427c124d773f483294511e80fe340075 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:42.869019  7886 consensus_queue.cc:260] T f09c2a98de1a4decabd0ff900dd44caa P cd75a17ab2604397adab03bb8b5fd75c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:42.841493  8010 raft_consensus.cc:493] T 1bf4668eeb70467fb3dc5a0289233b3c P b7ab4784c7344b939bc36f639286f377 [term 2 FOLLOWER]: Starting leader election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:18:42.830196  7934 raft_consensus.cc:515] T bb3d8792045a4583ae2e965b1350a5b4 P cd75a17ab2604397adab03bb8b5fd75c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:18:42.918048  8137 raft_consensus.cc:2749] T fe20b4b48823486ca3b9c648db6ce8aa P cd75a17ab2604397adab03bb8b5fd75c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:43.038458  6732 raft_consensus.cc:1240] T 711ef6523deb4cbe8ef2ba61e1c21c98 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 3 FOLLOWER]: Rejecting Update request from peer cd75a17ab2604397adab03bb8b5fd75c for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 13:18:43.120074  6731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a734b5ab7834e05a8c422208acc58b1" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:18:43.128638  6731 raft_consensus.cc:2393] T 7a734b5ab7834e05a8c422208acc58b1 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c in current term 3: Already voted for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in this term.
I20260709 13:18:42.927539  6805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c7f33e544204fbaac4078e3e83bbf4e" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:18:42.905632  7496 pending_rounds.cc:85] T d8cee0accdb8499c86d4414b72565a38 P 7ba59cc884714e8aa5f3f0ecaed84cbb: Aborting all ops after (but not including) 4
I20260709 13:18:42.918803  6806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3411566abe2d4c9bb4b2adfdd05e6f17" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:18:43.130832  6804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77e330a82df4b43a745d57a68f6f057" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:18:43.038916  6730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f58dc08b12a2494bb9a1372837970ca2" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:18:43.137900  6804 raft_consensus.cc:2468] T e77e330a82df4b43a745d57a68f6f057 P b7ab4784c7344b939bc36f639286f377 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 4.
I20260709 13:18:43.136057  6695 leader_election.cc:304] T f03d0dbf16864ca4bc1bb5e4c0334c0f P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
I20260709 13:18:43.138185  6730 raft_consensus.cc:2468] T f58dc08b12a2494bb9a1372837970ca2 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 3.
I20260709 13:18:42.927120  6875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe20b4b48823486ca3b9c648db6ce8aa" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:18:43.137826  6879 raft_consensus.cc:2368] T 24ee15416e3145beaa1b8183453729a3 P cd75a17ab2604397adab03bb8b5fd75c [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ba59cc884714e8aa5f3f0ecaed84cbb for earlier term 2. Current term is 3.
I20260709 13:18:43.140097  6730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77e330a82df4b43a745d57a68f6f057" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
W20260709 13:18:42.959964  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 120875us
I20260709 13:18:43.140172  6802 raft_consensus.cc:2468] T 427c124d773f483294511e80fe340075 P b7ab4784c7344b939bc36f639286f377 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 2.
I20260709 13:18:43.131323  6877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f00a2e87e56452083b759f60d461ee3" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:18:42.944128  6799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4b8bd455d5a47c18a1380839c6e0d61" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:18:43.147135  6876 raft_consensus.cc:1275] T 4d9def8b32fd443aa94ab1420b06837b P cd75a17ab2604397adab03bb8b5fd75c [term 2 FOLLOWER]: Refusing update from remote peer b7ab4784c7344b939bc36f639286f377: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:18:43.148892  6802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1528ab62b6fe4e3099d08f141afee116" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:18:43.149930  6877 raft_consensus.cc:1275] T 2c240553ce044eedb41541d72b9475d7 P cd75a17ab2604397adab03bb8b5fd75c [term 3 FOLLOWER]: Refusing update from remote peer b7ab4784c7344b939bc36f639286f377: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:18:42.935827  7891 leader_election.cc:290] T 90d42e216d9741e190bca19a781291fd P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:18:43.147253  6879 raft_consensus.cc:1275] T d8cee0accdb8499c86d4414b72565a38 P cd75a17ab2604397adab03bb8b5fd75c [term 3 FOLLOWER]: Refusing update from remote peer b7ab4784c7344b939bc36f639286f377: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:18:43.150695  6806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a485a995abc4807b6e511e45419f737" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
W20260709 13:18:42.934249  8107 log.cc:927] Time spent T bb3d8792045a4583ae2e965b1350a5b4 P ccd8a4c3bfe3413cb2ae219b09aea832: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
I20260709 13:18:43.136775  8122 raft_consensus.cc:515] T 30e88460611e47b2ba16a46a30b5f416 P b7ab4784c7344b939bc36f639286f377 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:43.165796  6876 raft_consensus.cc:1275] T bb3d8792045a4583ae2e965b1350a5b4 P cd75a17ab2604397adab03bb8b5fd75c [term 3 FOLLOWER]: Refusing update from remote peer 7ba59cc884714e8aa5f3f0ecaed84cbb: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:18:43.227057  6876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1704639a875409b9959353527b3fd68" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:18:43.227456  6879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a75bfe094d4bdc963aba3f08dfcd25" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:18:43.179878  6697 leader_election.cc:304] T be1a92657f494cac8dd227d152f50151 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, b7ab4784c7344b939bc36f639286f377
I20260709 13:18:43.156163  6730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c7f33e544204fbaac4078e3e83bbf4e" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:18:43.145278  6844 leader_election.cc:304] T ce4f062dcd314d43a63ca74067cb5ee3 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377
I20260709 13:18:43.229830  6730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3411566abe2d4c9bb4b2adfdd05e6f17" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:18:43.149458  6732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4b8bd455d5a47c18a1380839c6e0d61" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
W20260709 13:18:43.178022  6695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 46873.8us
W20260709 13:18:43.231379  6697 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.68:45071, user_credentials={real_user=slave}} blocked reactor thread for 51608.3us
W20260709 13:18:43.230895  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 85747.3us
I20260709 13:18:43.129962  6807 rpcz_store.cc:276] 0709 13:18:41.711320 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:41.741072 (+ 29752us) service_pool.cc:224] Handling call
0709 13:18:41.741410 (+   338us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:42.618316 (+876906us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:42.855534 (+237218us) spinlock_profiling.cc:243] Waited 865 ms on lock 0x7b54002c97d4. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f9aae01 00007fcc0f9a983e 00007fcc1496e419 00007fcc0dee5bd4 00007fcc0dee5b62 00007fcc0dee5a91 00007fcc0dee5a0c 00007fcc0dee4cc2 00007fcc0dce548c 00007fcc0dce48c6
0709 13:18:42.855740 (+   206us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1990481664}
W20260709 13:18:42.957497  8125 log.cc:927] Time spent T 3a485a995abc4807b6e511e45419f737 P ccd8a4c3bfe3413cb2ae219b09aea832: Append to log took a long time: real 0.494s	user 0.003s	sys 0.000s
I20260709 13:18:43.153721  6726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30e88460611e47b2ba16a46a30b5f416" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:18:43.153952  8036 consensus_queue.cc:237] T 7c37d41cd9164c15a6826ca62a851a69 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:43.080518  6803 raft_consensus.cc:1240] T 4f00a2e87e56452083b759f60d461ee3 P b7ab4784c7344b939bc36f639286f377 [term 4 FOLLOWER]: Rejecting Update request from peer cd75a17ab2604397adab03bb8b5fd75c for earlier term 3. Current term is 4. Ops: []
I20260709 13:18:43.003592  7885 raft_consensus.cc:3055] T a3022224cc81473690653a83d4e99470 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:18:43.136533  7496 pending_rounds.cc:107] T d8cee0accdb8499c86d4414b72565a38 P 7ba59cc884714e8aa5f3f0ecaed84cbb: Aborting uncommitted NO_OP operation due to leader change: 2.5
I20260709 13:18:43.160311  8069 raft_consensus.cc:515] T 713b5728a197487c9300b310ab94e5a3 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:43.161482  6800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24ee15416e3145beaa1b8183453729a3" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:18:43.131392  8010 raft_consensus.cc:3060] T 1bf4668eeb70467fb3dc5a0289233b3c P b7ab4784c7344b939bc36f639286f377 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:43.236065  8137 raft_consensus.cc:2804] T ce4f062dcd314d43a63ca74067cb5ee3 P cd75a17ab2604397adab03bb8b5fd75c [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:18:42.957643  8077 leader_election.cc:290] T b3f13b31a1f84f0d89d007eadd57924c P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 2 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:18:43.165002  6875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fa34c08b205435dba97346991aa1f92" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:18:43.165494  6805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3f13b31a1f84f0d89d007eadd57924c" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:18:43.248119  7496 raft_consensus.cc:2889] T d8cee0accdb8499c86d4414b72565a38 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:18:43.256968  6805 raft_consensus.cc:3060] T b3f13b31a1f84f0d89d007eadd57924c P b7ab4784c7344b939bc36f639286f377 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:43.001806  8115 raft_consensus.cc:493] T 95a75bfe094d4bdc963aba3f08dfcd25 P cd75a17ab2604397adab03bb8b5fd75c [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:43.162240  6874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbdf895bba214ff68685a24fd17dfb5d" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:18:42.919502  8094 raft_consensus.cc:697] T 07a92dd554674067a83a9cb68c4773f2 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 3 LEADER]: Becoming Leader. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
I20260709 13:18:43.263082  8094 consensus_queue.cc:237] T 07a92dd554674067a83a9cb68c4773f2 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:43.150559  6802 raft_consensus.cc:3060] T 1528ab62b6fe4e3099d08f141afee116 P b7ab4784c7344b939bc36f639286f377 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:43.127317  8060 raft_consensus.cc:740] T a1704639a875409b9959353527b3fd68 P cd75a17ab2604397adab03bb8b5fd75c [term 2 LEADER]: Becoming Follower/Learner. State: Replica: cd75a17ab2604397adab03bb8b5fd75c, State: Running, Role: LEADER
I20260709 13:18:43.130807  8066 raft_consensus.cc:493] T f3f9c2e2bf644115957398fe4c9459db P ccd8a4c3bfe3413cb2ae219b09aea832 [term 2 FOLLOWER]: Starting leader election (detected failure of leader cd75a17ab2604397adab03bb8b5fd75c)
I20260709 13:18:43.157992  8130 raft_consensus.cc:2749] T 24ee15416e3145beaa1b8183453729a3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:18:42.924678  8116 log.cc:927] Time spent T d8292e16e5654be6bc408560cf256aaa P b7ab4784c7344b939bc36f639286f377: Append to log took a long time: real 0.756s	user 0.004s	sys 0.004s
I20260709 13:18:43.232345  6732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "427c124d773f483294511e80fe340075" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:18:43.142159  6872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4275cf08e63345f993bce8664eada830" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:18:43.232722  6697 leader_election.cc:304] T 404190ce4ce94cecbfcb6ea9d1dd8626 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, b7ab4784c7344b939bc36f639286f377
I20260709 13:18:43.136971  7938 raft_consensus.cc:515] T b56bf91d90824c959e21e0cee5ba1816 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:43.246737  7885 raft_consensus.cc:740] T a3022224cc81473690653a83d4e99470 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
I20260709 13:18:43.285140  6805 raft_consensus.cc:2468] T b3f13b31a1f84f0d89d007eadd57924c P b7ab4784c7344b939bc36f639286f377 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in term 2.
I20260709 13:18:43.226114  6873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a734b5ab7834e05a8c422208acc58b1" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:18:43.141896  8075 raft_consensus.cc:3060] T 90d42e216d9741e190bca19a781291fd P b7ab4784c7344b939bc36f639286f377 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:43.106696  8074 raft_consensus.cc:697] T bd6869f07b5a4885a0b99fbe60c3b175 P b7ab4784c7344b939bc36f639286f377 [term 5 LEADER]: Becoming Leader. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
I20260709 13:18:43.168737  6804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8cee0accdb8499c86d4414b72565a38" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:18:43.237913  6807 raft_consensus.cc:1240] T 20f6842e26174571996b8dea4151d4be P b7ab4784c7344b939bc36f639286f377 [term 3 FOLLOWER]: Rejecting Update request from peer cd75a17ab2604397adab03bb8b5fd75c for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 13:18:43.295101  6873 raft_consensus.cc:3060] T 7a734b5ab7834e05a8c422208acc58b1 P cd75a17ab2604397adab03bb8b5fd75c [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:18:43.206084  8099 consensus_meta.cc:287] T 22ccee1b570c4ad3a57bd7aec085b1b4 P ccd8a4c3bfe3413cb2ae219b09aea832: Time spent flushing consensus metadata: real 0.528s	user 0.012s	sys 0.000s
W20260709 13:18:43.206247  8132 log.cc:927] Time spent T 30e88460611e47b2ba16a46a30b5f416 P b7ab4784c7344b939bc36f639286f377: Append to log took a long time: real 0.365s	user 0.002s	sys 0.000s
I20260709 13:18:43.238484  6876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f9c2e2bf644115957398fe4c9459db" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:18:42.957029  8090 consensus_queue.cc:237] T de3186201e1a40d0b335eeb8b4e256e0 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:43.239634  6726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a485a995abc4807b6e511e45419f737" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:18:43.151218  8114 raft_consensus.cc:515] T 427c124d773f483294511e80fe340075 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } attrs { replace: true } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:18:43.241605  6806 raft_consensus.cc:1240] T e31b9971c15848dea59d4d4130141d9e P b7ab4784c7344b939bc36f639286f377 [term 3 FOLLOWER]: Rejecting Update request from peer cd75a17ab2604397adab03bb8b5fd75c for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 13:18:43.303442  6802 raft_consensus.cc:2468] T 1528ab62b6fe4e3099d08f141afee116 P b7ab4784c7344b939bc36f639286f377 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 3.
I20260709 13:18:43.181428  6724 raft_consensus.cc:1240] T e31b9971c15848dea59d4d4130141d9e P ccd8a4c3bfe3413cb2ae219b09aea832 [term 3 FOLLOWER]: Rejecting Update request from peer cd75a17ab2604397adab03bb8b5fd75c for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 13:18:43.151842  8118 consensus_queue.cc:1059] T 20f6842e26174571996b8dea4151d4be P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.087s
I20260709 13:18:43.180724  8147 raft_consensus.cc:2804] T f03d0dbf16864ca4bc1bb5e4c0334c0f P ccd8a4c3bfe3413cb2ae219b09aea832 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:18:43.202764  8102 raft_consensus.cc:697] T dbdf895bba214ff68685a24fd17dfb5d P ccd8a4c3bfe3413cb2ae219b09aea832 [term 3 LEADER]: Becoming Leader. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
I20260709 13:18:43.225700  7886 raft_consensus.cc:3060] T f09c2a98de1a4decabd0ff900dd44caa P cd75a17ab2604397adab03bb8b5fd75c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:43.181249  7934 leader_election.cc:290] T bb3d8792045a4583ae2e965b1350a5b4 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:18:43.257782  6875 raft_consensus.cc:2468] T 3fa34c08b205435dba97346991aa1f92 P cd75a17ab2604397adab03bb8b5fd75c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in term 3.
I20260709 13:18:42.934054  8034 consensus_queue.cc:237] T 7ba5dac66ab5497e9e336f2a3c28cda5 P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:18:43.146674  8037 raft_consensus.cc:515] T 853ac0a8cbd64ce99457f170216d4d0f P b7ab4784c7344b939bc36f639286f377 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:43.344270  8037 leader_election.cc:290] T 853ac0a8cbd64ce99457f170216d4d0f P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:18:43.250887  6800 raft_consensus.cc:3060] T 24ee15416e3145beaa1b8183453729a3 P b7ab4784c7344b939bc36f639286f377 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:43.260344  6874 raft_consensus.cc:2393] T dbdf895bba214ff68685a24fd17dfb5d P cd75a17ab2604397adab03bb8b5fd75c [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate ccd8a4c3bfe3413cb2ae219b09aea832 in current term 3: Already voted for candidate cd75a17ab2604397adab03bb8b5fd75c in this term.
I20260709 13:18:43.248170  6730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3f13b31a1f84f0d89d007eadd57924c" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:18:43.348526  6874 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53416 (request call id 1844) took 1087 ms. Trace:
I20260709 13:18:43.253258  6728 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50004 (request call id 1001) took 1681 ms. Trace:
I20260709 13:18:43.348912  6874 rpcz_store.cc:276] 0709 13:18:42.261350 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:43.161986 (+900636us) service_pool.cc:224] Handling call
0709 13:18:43.348461 (+186475us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:43.350016  6874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce4f062dcd314d43a63ca74067cb5ee3" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 4 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
W20260709 13:18:43.231297  7468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 348007us
I20260709 13:18:43.282617  6872 raft_consensus.cc:2393] T 4275cf08e63345f993bce8664eada830 P cd75a17ab2604397adab03bb8b5fd75c [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate b7ab4784c7344b939bc36f639286f377 in current term 2: Already voted for candidate cd75a17ab2604397adab03bb8b5fd75c in this term.
W20260709 13:18:43.282925  6697 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.68:45071, user_credentials={real_user=slave}} blocked reactor thread for 50279.9us
I20260709 13:18:43.352823  8077 raft_consensus.cc:493] T 4b8cacb381b746da8d0049b0a83b41dd P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:43.352730  8151 consensus_queue.cc:1048] T 4b8cacb381b746da8d0049b0a83b41dd P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:18:43.353410  8077 raft_consensus.cc:515] T 4b8cacb381b746da8d0049b0a83b41dd P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:18:43.297334  6805 raft_consensus.cc:1275] T 713b5728a197487c9300b310ab94e5a3 P b7ab4784c7344b939bc36f639286f377 [term 2 FOLLOWER]: Refusing update from remote peer cd75a17ab2604397adab03bb8b5fd75c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:18:43.253547  8137 raft_consensus.cc:493] T ce4f062dcd314d43a63ca74067cb5ee3 P cd75a17ab2604397adab03bb8b5fd75c [term 3 FOLLOWER]: Starting leader election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:18:43.300859  6876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "427c124d773f483294511e80fe340075" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:18:43.356875  8137 raft_consensus.cc:3060] T ce4f062dcd314d43a63ca74067cb5ee3 P cd75a17ab2604397adab03bb8b5fd75c [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:43.238968  8078 consensus_queue.cc:260] T b56bf91d90824c959e21e0cee5ba1816 P cd75a17ab2604397adab03bb8b5fd75c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:43.363508  6872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3d8792045a4583ae2e965b1350a5b4" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:18:43.364192  6872 raft_consensus.cc:2468] T bb3d8792045a4583ae2e965b1350a5b4 P cd75a17ab2604397adab03bb8b5fd75c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 3.
W20260709 13:18:43.301518  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 53788.4us
I20260709 13:18:43.241470  8103 raft_consensus.cc:515] T c4db81d9d329422bb3b4160ca4ac2d1d P ccd8a4c3bfe3413cb2ae219b09aea832 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:43.268791  8066 raft_consensus.cc:3060] T f3f9c2e2bf644115957398fe4c9459db P ccd8a4c3bfe3413cb2ae219b09aea832 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:43.266753  8069 leader_election.cc:290] T 713b5728a197487c9300b310ab94e5a3 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 3 election: Requested vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:18:43.234048  8006 consensus_queue.cc:260] T 8c7f33e544204fbaac4078e3e83bbf4e P b7ab4784c7344b939bc36f639286f377 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:43.310019  8146 raft_consensus.cc:493] T 427c124d773f483294511e80fe340075 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:43.313372  6804 raft_consensus.cc:1240] T b56bf91d90824c959e21e0cee5ba1816 P b7ab4784c7344b939bc36f639286f377 [term 3 LEADER]: Rejecting Update request from peer cd75a17ab2604397adab03bb8b5fd75c for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 13:18:43.287564  8142 raft_consensus.cc:2749] T 404190ce4ce94cecbfcb6ea9d1dd8626 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:18:43.349016  6728 rpcz_store.cc:276] 0709 13:18:41.572314 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:42.146658 (+574344us) service_pool.cc:224] Handling call
0709 13:18:42.171162 (+ 24504us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:42.318021 (+146859us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:42.318067 (+    46us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:42.363503 (+ 45436us) log.cc:844] Serialized 26 byte log entry
0709 13:18:42.458426 (+ 94923us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:18:42.485165 (+ 26739us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:42.485252 (+    87us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:42.956761 (+471509us) spinlock_profiling.cc:243] Waited 22.6 ms on lock 0x7b4400022b4c. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0c745db1 00007fcc0c7e3c85 00007fcc0c7e46a2 00007fcc0f5561db 00007fcc0f551aaf 00007fcc0f54586e 00007fcc0f544bb6 00007fcc0f5447d8 00007fcc0f54e221 00007fcc0f54e1d9 00007fcc0f54e169
0709 13:18:43.252912 (+296151us) raft_consensus.cc:1685] finished
0709 13:18:43.252937 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:43.253168 (+   231us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":146562,"raft.queue_time_us":153089,"raft.run_cpu_time_us":260,"raft.run_wall_time_us":22722,"spinlock_wait_cycles":52057344,"thread_start_us":23035,"threads_started":1,"wal-append.queue_time_us":84291}
I20260709 13:18:43.266178  6695 leader_election.cc:304] T e31b9971c15848dea59d4d4130141d9e P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
I20260709 13:18:43.267191  8115 raft_consensus.cc:515] T 95a75bfe094d4bdc963aba3f08dfcd25 P cd75a17ab2604397adab03bb8b5fd75c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:43.308243  6803 raft_consensus.cc:1240] T 7c44c4849aa54f2b94d1f1bef9ed546f P b7ab4784c7344b939bc36f639286f377 [term 3 FOLLOWER]: Rejecting Update request from peer cd75a17ab2604397adab03bb8b5fd75c for earlier term 2. Current term is 3. Ops: []
I20260709 13:18:43.369753  6874 raft_consensus.cc:1240] T 7c37d41cd9164c15a6826ca62a851a69 P cd75a17ab2604397adab03bb8b5fd75c [term 2 FOLLOWER]: Rejecting Update request from peer ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 1. Current term is 2. Ops: []
I20260709 13:18:43.304978  7498 raft_consensus.cc:2468] T 24ee15416e3145beaa1b8183453729a3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 2.
I20260709 13:18:43.367385  8147 raft_consensus.cc:697] T f03d0dbf16864ca4bc1bb5e4c0334c0f P ccd8a4c3bfe3413cb2ae219b09aea832 [term 3 LEADER]: Becoming Leader. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
I20260709 13:18:43.377136  8157 consensus_queue.cc:1059] T b56bf91d90824c959e21e0cee5ba1816 P cd75a17ab2604397adab03bb8b5fd75c [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.010s
I20260709 13:18:43.377769  8143 raft_consensus.cc:2749] T be1a92657f494cac8dd227d152f50151 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:18:43.378226  8152 raft_consensus.cc:493] T 1528ab62b6fe4e3099d08f141afee116 P b7ab4784c7344b939bc36f639286f377 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:43.381656  6872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44bde925b2e541b69890d70715b85176" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:18:43.304391  8099 raft_consensus.cc:515] T 22ccee1b570c4ad3a57bd7aec085b1b4 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:43.393826  6876 raft_consensus.cc:2468] T 427c124d773f483294511e80fe340075 P cd75a17ab2604397adab03bb8b5fd75c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 2.
I20260709 13:18:43.369082  8118 raft_consensus.cc:3055] T 20f6842e26174571996b8dea4151d4be P cd75a17ab2604397adab03bb8b5fd75c [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:18:43.397531  6875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20f6842e26174571996b8dea4151d4be" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:18:43.428485  6728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4275cf08e63345f993bce8664eada830" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:18:43.462833  6800 raft_consensus.cc:2468] T 24ee15416e3145beaa1b8183453729a3 P b7ab4784c7344b939bc36f639286f377 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 3.
I20260709 13:18:43.456466  6872 raft_consensus.cc:2410] T 44bde925b2e541b69890d70715b85176 P cd75a17ab2604397adab03bb8b5fd75c [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate ccd8a4c3bfe3413cb2ae219b09aea832 for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
W20260709 13:18:43.394088  6695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 145779us
I20260709 13:18:43.455103  6874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f03d0dbf16864ca4bc1bb5e4c0334c0f" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:18:43.415772  6879 raft_consensus.cc:2410] T 95a75bfe094d4bdc963aba3f08dfcd25 P cd75a17ab2604397adab03bb8b5fd75c [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate ccd8a4c3bfe3413cb2ae219b09aea832 for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:18:43.465607  6695 leader_election.cc:304] T 20f6842e26174571996b8dea4151d4be P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
I20260709 13:18:43.468776  6695 leader_election.cc:304] T 17587d6730594da4a56fa13a353232a1 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, b7ab4784c7344b939bc36f639286f377
I20260709 13:18:43.472347  8069 raft_consensus.cc:2749] T 17587d6730594da4a56fa13a353232a1 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:18:43.423375  7984 raft_consensus.cc:3060] T de3186201e1a40d0b335eeb8b4e256e0 P cd75a17ab2604397adab03bb8b5fd75c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:43.454264  6727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90d42e216d9741e190bca19a781291fd" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:18:43.394022  6726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b3759de40694069b13c0f8bd40e5709" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
W20260709 13:18:43.541769  8112 consensus_meta.cc:287] T f03d0dbf16864ca4bc1bb5e4c0334c0f P cd75a17ab2604397adab03bb8b5fd75c: Time spent flushing consensus metadata: real 0.812s	user 0.012s	sys 0.010s
I20260709 13:18:43.372560  8077 leader_election.cc:290] T 4b8cacb381b746da8d0049b0a83b41dd P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:18:43.452207  8035 leader_election.cc:290] T a3022224cc81473690653a83d4e99470 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 3 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:18:43.458297  7992 leader_election.cc:290] T 4275cf08e63345f993bce8664eada830 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 2 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:18:43.428759  7938 leader_election.cc:290] T b56bf91d90824c959e21e0cee5ba1816 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:18:43.521978  6875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e31b9971c15848dea59d4d4130141d9e" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:18:43.426625  6873 raft_consensus.cc:2468] T 7a734b5ab7834e05a8c422208acc58b1 P cd75a17ab2604397adab03bb8b5fd75c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 3.
I20260709 13:18:43.522140  6723 raft_consensus.cc:1240] T 22ccee1b570c4ad3a57bd7aec085b1b4 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 3 FOLLOWER]: Rejecting Update request from peer cd75a17ab2604397adab03bb8b5fd75c for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 13:18:43.415702  8146 raft_consensus.cc:515] T 427c124d773f483294511e80fe340075 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } attrs { replace: true } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:18:43.459858  8118 raft_consensus.cc:740] T 20f6842e26174571996b8dea4151d4be P cd75a17ab2604397adab03bb8b5fd75c [term 2 LEADER]: Becoming Follower/Learner. State: Replica: cd75a17ab2604397adab03bb8b5fd75c, State: Running, Role: LEADER
I20260709 13:18:43.469981  7993 raft_consensus.cc:2804] T 20f6842e26174571996b8dea4151d4be P ccd8a4c3bfe3413cb2ae219b09aea832 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:18:43.543187  8099 leader_election.cc:290] T 22ccee1b570c4ad3a57bd7aec085b1b4 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 3 election: Requested vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
W20260709 13:18:43.543722  8160 log.cc:927] Time spent T 7887766dc6784fcaa42b35c05fea7a99 P cd75a17ab2604397adab03bb8b5fd75c: Append to log took a long time: real 0.070s	user 0.000s	sys 0.000s
I20260709 13:18:43.545572  6876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d9def8b32fd443aa94ab1420b06837b" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:18:43.545694  8103 leader_election.cc:290] T c4db81d9d329422bb3b4160ca4ac2d1d P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 3 election: Requested vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:18:43.546785  8147 consensus_queue.cc:237] T f03d0dbf16864ca4bc1bb5e4c0334c0f P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:43.550637  6878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de3186201e1a40d0b335eeb8b4e256e0" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
W20260709 13:18:43.552268  8119 log.cc:927] Time spent T ce4f062dcd314d43a63ca74067cb5ee3 P 7ba59cc884714e8aa5f3f0ecaed84cbb: Append to log took a long time: real 1.085s	user 0.003s	sys 0.000s
I20260709 13:18:43.394515  8074 consensus_queue.cc:237] T bd6869f07b5a4885a0b99fbe60c3b175 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:43.560328  8148 raft_consensus.cc:2804] T e31b9971c15848dea59d4d4130141d9e P ccd8a4c3bfe3413cb2ae219b09aea832 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:18:43.561102  7496 raft_consensus.cc:1275] T 3fa34c08b205435dba97346991aa1f92 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 3 FOLLOWER]: Refusing update from remote peer ccd8a4c3bfe3413cb2ae219b09aea832: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:18:43.562734  7499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1528ab62b6fe4e3099d08f141afee116" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:18:43.564064  7502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24ee15416e3145beaa1b8183453729a3" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:18:43.429069  8102 consensus_queue.cc:237] T dbdf895bba214ff68685a24fd17dfb5d P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:43.465152  8152 raft_consensus.cc:515] T 1528ab62b6fe4e3099d08f141afee116 P b7ab4784c7344b939bc36f639286f377 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } attrs { replace: true } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:18:43.565256  7501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3d8792045a4583ae2e965b1350a5b4" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:18:43.532631  6724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c44c4849aa54f2b94d1f1bef9ed546f" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:18:43.566903  7466 leader_election.cc:304] T b3f13b31a1f84f0d89d007eadd57924c P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, b7ab4784c7344b939bc36f639286f377; no voters: 
I20260709 13:18:43.567804  6872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab432e62819d499eaaf3dd55481dd930" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:18:43.609606  6872 raft_consensus.cc:1275] T 4b8cacb381b746da8d0049b0a83b41dd P cd75a17ab2604397adab03bb8b5fd75c [term 3 FOLLOWER]: Refusing update from remote peer ccd8a4c3bfe3413cb2ae219b09aea832: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:18:43.367295  7885 consensus_queue.cc:260] T a3022224cc81473690653a83d4e99470 P ccd8a4c3bfe3413cb2ae219b09aea832 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:43.473062  6695 leader_election.cc:304] T 427c124d773f483294511e80fe340075 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, b7ab4784c7344b939bc36f639286f377
I20260709 13:18:43.427143  8006 raft_consensus.cc:3060] T 8c7f33e544204fbaac4078e3e83bbf4e P b7ab4784c7344b939bc36f639286f377 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:43.394658  8060 consensus_queue.cc:260] T a1704639a875409b9959353527b3fd68 P cd75a17ab2604397adab03bb8b5fd75c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
W20260709 13:18:43.582460  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 208918us
I20260709 13:18:43.595841  6876 raft_consensus.cc:3060] T 4d9def8b32fd443aa94ab1420b06837b P cd75a17ab2604397adab03bb8b5fd75c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:43.571657  8066 raft_consensus.cc:515] T f3f9c2e2bf644115957398fe4c9459db P ccd8a4c3bfe3413cb2ae219b09aea832 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:43.594599  6726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b8cacb381b746da8d0049b0a83b41dd" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:18:43.600793  6732 raft_consensus.cc:2468] T 427c124d773f483294511e80fe340075 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 2.
I20260709 13:18:43.590268  7938 raft_consensus.cc:493] T 2c240553ce044eedb41541d72b9475d7 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:43.603729  8114 leader_election.cc:290] T 427c124d773f483294511e80fe340075 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:18:43.590996  8035 raft_consensus.cc:493] T 853ac0a8cbd64ce99457f170216d4d0f P cd75a17ab2604397adab03bb8b5fd75c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:18:43.583657  8112 raft_consensus.cc:515] T f03d0dbf16864ca4bc1bb5e4c0334c0f P cd75a17ab2604397adab03bb8b5fd75c [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
W20260709 13:18:43.610467  6695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 137503us
I20260709 13:18:43.620069  6724 raft_consensus.cc:3060] T 7c44c4849aa54f2b94d1f1bef9ed546f P ccd8a4c3bfe3413cb2ae219b09aea832 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:43.634419  6695 leader_election.cc:304] T 7a734b5ab7834e05a8c422208acc58b1 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
I20260709 13:18:43.598354  7993 raft_consensus.cc:697] T 20f6842e26174571996b8dea4151d4be P ccd8a4c3bfe3413cb2ae219b09aea832 [term 3 LEADER]: Becoming Leader. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
I20260709 13:18:43.610517  6727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b8cacb381b746da8d0049b0a83b41dd" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:18:43.639818  6799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "427c124d773f483294511e80fe340075" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:18:43.591871  8010 raft_consensus.cc:515] T 1bf4668eeb70467fb3dc5a0289233b3c P b7ab4784c7344b939bc36f639286f377 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:43.606833  8148 raft_consensus.cc:697] T e31b9971c15848dea59d4d4130141d9e P ccd8a4c3bfe3413cb2ae219b09aea832 [term 3 LEADER]: Becoming Leader. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
I20260709 13:18:43.640702  6799 raft_consensus.cc:2468] T 427c124d773f483294511e80fe340075 P b7ab4784c7344b939bc36f639286f377 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in term 2.
I20260709 13:18:43.620934  8103 raft_consensus.cc:2749] T 427c124d773f483294511e80fe340075 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:18:43.618243  6873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1528ab62b6fe4e3099d08f141afee116" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:18:43.650473  6874 raft_consensus.cc:2393] T f03d0dbf16864ca4bc1bb5e4c0334c0f P cd75a17ab2604397adab03bb8b5fd75c [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate ccd8a4c3bfe3413cb2ae219b09aea832 in current term 3: Already voted for candidate cd75a17ab2604397adab03bb8b5fd75c in this term.
I20260709 13:18:43.618407  7934 consensus_queue.cc:1059] T a1704639a875409b9959353527b3fd68 P cd75a17ab2604397adab03bb8b5fd75c [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.030s
I20260709 13:18:43.631531  7938 raft_consensus.cc:515] T 2c240553ce044eedb41541d72b9475d7 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:43.635768  8118 consensus_queue.cc:260] T 20f6842e26174571996b8dea4151d4be P cd75a17ab2604397adab03bb8b5fd75c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:43.637265  7499 raft_consensus.cc:2393] T 1528ab62b6fe4e3099d08f141afee116 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ccd8a4c3bfe3413cb2ae219b09aea832 in current term 3: Already voted for candidate cd75a17ab2604397adab03bb8b5fd75c in this term.
I20260709 13:18:43.632556  8126 raft_consensus.cc:2804] T b3f13b31a1f84f0d89d007eadd57924c P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:18:43.697427  6805 raft_consensus.cc:1240] T b3f13b31a1f84f0d89d007eadd57924c P b7ab4784c7344b939bc36f639286f377 [term 2 FOLLOWER]: Rejecting Update request from peer ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 1. Current term is 2. Ops: []
W20260709 13:18:43.737047  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 124848us
I20260709 13:18:43.644866  8068 raft_consensus.cc:2804] T 7a734b5ab7834e05a8c422208acc58b1 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:18:43.734194  6799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b56bf91d90824c959e21e0cee5ba1816" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:18:43.660089  6802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "713b5728a197487c9300b310ab94e5a3" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:18:43.735092  6730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24ee15416e3145beaa1b8183453729a3" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:18:43.637737  8115 leader_election.cc:290] T 95a75bfe094d4bdc963aba3f08dfcd25 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:18:43.738552  6730 raft_consensus.cc:2468] T 24ee15416e3145beaa1b8183453729a3 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 2.
I20260709 13:18:43.735710  6800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1528ab62b6fe4e3099d08f141afee116" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:18:43.658171  6876 raft_consensus.cc:2468] T 4d9def8b32fd443aa94ab1420b06837b P cd75a17ab2604397adab03bb8b5fd75c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 3.
I20260709 13:18:43.742409  6800 raft_consensus.cc:2393] T 1528ab62b6fe4e3099d08f141afee116 P b7ab4784c7344b939bc36f639286f377 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ccd8a4c3bfe3413cb2ae219b09aea832 in current term 3: Already voted for candidate cd75a17ab2604397adab03bb8b5fd75c in this term.
I20260709 13:18:43.742759  6876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "711ef6523deb4cbe8ef2ba61e1c21c98" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:18:43.678792  6804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24ee15416e3145beaa1b8183453729a3" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:18:43.743587  6800 raft_consensus.cc:1275] T e77e330a82df4b43a745d57a68f6f057 P b7ab4784c7344b939bc36f639286f377 [term 4 FOLLOWER]: Refusing update from remote peer ccd8a4c3bfe3413cb2ae219b09aea832: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 4 index: 2. (index mismatch)
I20260709 13:18:43.744005  6804 raft_consensus.cc:2393] T 24ee15416e3145beaa1b8183453729a3 P b7ab4784c7344b939bc36f639286f377 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ccd8a4c3bfe3413cb2ae219b09aea832 in current term 3: Already voted for candidate cd75a17ab2604397adab03bb8b5fd75c in this term.
I20260709 13:18:43.687475  6726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "427c124d773f483294511e80fe340075" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:18:43.726672  6727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1528ab62b6fe4e3099d08f141afee116" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:18:43.745147  6727 raft_consensus.cc:3060] T 1528ab62b6fe4e3099d08f141afee116 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:43.747318  6726 raft_consensus.cc:1240] T de3186201e1a40d0b335eeb8b4e256e0 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 3 LEADER]: Rejecting Update request from peer cd75a17ab2604397adab03bb8b5fd75c for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 13:18:43.749393  6726 raft_consensus.cc:1240] T 713b5728a197487c9300b310ab94e5a3 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 3 FOLLOWER]: Rejecting Update request from peer cd75a17ab2604397adab03bb8b5fd75c for earlier term 2. Current term is 3. Ops: []
I20260709 13:18:43.698408  6801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "711ef6523deb4cbe8ef2ba61e1c21c98" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:18:43.664620  8100 consensus_queue.cc:1048] T 90d42e216d9741e190bca19a781291fd P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.142s
W20260709 13:18:43.697407  8159 log.cc:927] Time spent T 711ef6523deb4cbe8ef2ba61e1c21c98 P b7ab4784c7344b939bc36f639286f377: Append to log took a long time: real 0.105s	user 0.000s	sys 0.000s
I20260709 13:18:43.779346  8126 raft_consensus.cc:697] T b3f13b31a1f84f0d89d007eadd57924c P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 2 LEADER]: Becoming Leader. State: Replica: 7ba59cc884714e8aa5f3f0ecaed84cbb, State: Running, Role: LEADER
I20260709 13:18:43.794476  8126 consensus_queue.cc:237] T b3f13b31a1f84f0d89d007eadd57924c P 7ba59cc884714e8aa5f3f0ecaed84cbb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:18:43.798556  8120 leader_election.cc:290] T 427c124d773f483294511e80fe340075 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:18:43.731664  8075 raft_consensus.cc:515] T 90d42e216d9741e190bca19a781291fd P b7ab4784c7344b939bc36f639286f377 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:43.800343  6730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24ee15416e3145beaa1b8183453729a3" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:18:43.801054  6730 raft_consensus.cc:3060] T 24ee15416e3145beaa1b8183453729a3 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:43.802250  8075 leader_election.cc:290] T 90d42e216d9741e190bca19a781291fd P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 4 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:18:43.805208  6879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "713b5728a197487c9300b310ab94e5a3" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:18:43.736549  7885 raft_consensus.cc:3060] T a3022224cc81473690653a83d4e99470 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:43.809201  8122 leader_election.cc:290] T 30e88460611e47b2ba16a46a30b5f416 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:18:43.810657  8112 leader_election.cc:290] T f03d0dbf16864ca4bc1bb5e4c0334c0f P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 3 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:18:43.811736  6725 raft_consensus.cc:1240] T 44bde925b2e541b69890d70715b85176 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 3 FOLLOWER]: Rejecting Update request from peer cd75a17ab2604397adab03bb8b5fd75c for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 13:18:43.806865  6724 raft_consensus.cc:2468] T 7c44c4849aa54f2b94d1f1bef9ed546f P ccd8a4c3bfe3413cb2ae219b09aea832 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 3.
I20260709 13:18:43.812947  6725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bf4668eeb70467fb3dc5a0289233b3c" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
W20260709 13:18:43.792695  8135 log.cc:927] Time spent T bb3d8792045a4583ae2e965b1350a5b4 P 7ba59cc884714e8aa5f3f0ecaed84cbb: Append to log took a long time: real 0.819s	user 0.001s	sys 0.001s
I20260709 13:18:43.816323  6724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "853ac0a8cbd64ce99457f170216d4d0f" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:18:43.819602  8152 leader_election.cc:290] T 1528ab62b6fe4e3099d08f141afee116 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
W20260709 13:18:43.821161  6846 connection.cc:256] RPC call timeout handler was delayed by -1.3954147499998726s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1791s for a response
I20260709 13:18:43.838471  7501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24ee15416e3145beaa1b8183453729a3" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb"
I20260709 13:18:43.738350  6802 raft_consensus.cc:3060] T 713b5728a197487c9300b310ab94e5a3 P b7ab4784c7344b939bc36f639286f377 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:18:43.697970  8110 log.cc:927] Time spent T d8cee0accdb8499c86d4414b72565a38 P b7ab4784c7344b939bc36f639286f377: Append to log took a long time: real 1.503s	user 0.000s	sys 0.011s
W20260709 13:18:43.696269  8166 log.cc:927] Time spent T 7c44c4849aa54f2b94d1f1bef9ed546f P cd75a17ab2604397adab03bb8b5fd75c: Append to log took a long time: real 0.065s	user 0.001s	sys 0.000s
I20260709 13:18:43.696650  8010 leader_election.cc:290] T 1bf4668eeb70467fb3dc5a0289233b3c P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 3 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
W20260709 13:18:43.754870  8168 log.cc:927] Time spent T f3f9c2e2bf644115957398fe4c9459db P b7ab4784c7344b939bc36f639286f377: Append to log took a long time: real 0.142s	user 0.000s	sys 0.001s
I20260709 13:18:43.755466  6876 raft_consensus.cc:1240] T 3411566abe2d4c9bb4b2adfdd05e6f17 P cd75a17ab2604397adab03bb8b5fd75c [term 2 FOLLOWER]: Rejecting Update request from peer ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 1. Current term is 2. Ops: []
I20260709 13:18:43.757890  6873 raft_consensus.cc:2393] T 1528ab62b6fe4e3099d08f141afee116 P cd75a17ab2604397adab03bb8b5fd75c [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ccd8a4c3bfe3413cb2ae219b09aea832 in current term 3: Already voted for candidate cd75a17ab2604397adab03bb8b5fd75c in this term.
I20260709 13:18:43.635195  8035 raft_consensus.cc:515] T 853ac0a8cbd64ce99457f170216d4d0f P cd75a17ab2604397adab03bb8b5fd75c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:43.753638  6872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24ee15416e3145beaa1b8183453729a3" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:18:43.758651  8115 consensus_queue.cc:1059] T ab432e62819d499eaaf3dd55481dd930 P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:18:43.864961  7495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8cee0accdb8499c86d4414b72565a38" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:18:43.877236  7495 raft_consensus.cc:2468] T d8cee0accdb8499c86d4414b72565a38 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 3.
I20260709 13:18:43.880348  8035 leader_election.cc:290] T 853ac0a8cbd64ce99457f170216d4d0f P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:18:43.783239  8068 raft_consensus.cc:697] T 7a734b5ab7834e05a8c422208acc58b1 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 3 LEADER]: Becoming Leader. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
I20260709 13:18:43.760519  8066 leader_election.cc:290] T f3f9c2e2bf644115957398fe4c9459db P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 3 election: Requested vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:18:43.761154  8085 consensus_queue.cc:1059] T 711ef6523deb4cbe8ef2ba61e1c21c98 P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:18:43.761670  8096 raft_consensus.cc:493] T f4b8bd455d5a47c18a1380839c6e0d61 P b7ab4784c7344b939bc36f639286f377 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:18:43.762118  7883 raft_consensus.cc:493] T 3411566abe2d4c9bb4b2adfdd05e6f17 P b7ab4784c7344b939bc36f639286f377 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:18:43.762192  6844 leader_election.cc:304] T f58dc08b12a2494bb9a1372837970ca2 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:18:43.762775  8134 consensus_queue.cc:1048] T d8cee0accdb8499c86d4414b72565a38 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:18:43.763108  8148 consensus_queue.cc:237] T e31b9971c15848dea59d4d4130141d9e P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:43.898550  7883 raft_consensus.cc:515] T 3411566abe2d4c9bb4b2adfdd05e6f17 P b7ab4784c7344b939bc36f639286f377 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:43.765285  7503 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50744 (request call id 100) took 1901 ms. Trace:
I20260709 13:18:43.765306  6728 raft_consensus.cc:1275] T 2c240553ce044eedb41541d72b9475d7 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 3 FOLLOWER]: Refusing update from remote peer b7ab4784c7344b939bc36f639286f377: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:18:43.737075  7993 consensus_queue.cc:237] T 20f6842e26174571996b8dea4151d4be P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:43.766121  6727 raft_consensus.cc:2468] T 1528ab62b6fe4e3099d08f141afee116 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 3.
I20260709 13:18:43.768922  8078 raft_consensus.cc:3060] T b56bf91d90824c959e21e0cee5ba1816 P cd75a17ab2604397adab03bb8b5fd75c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:43.769865  6731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbdf895bba214ff68685a24fd17dfb5d" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:18:43.839596  7502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b8cacb381b746da8d0049b0a83b41dd" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:18:43.750993  7938 leader_election.cc:290] T 2c240553ce044eedb41541d72b9475d7 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:18:43.793118  8081 raft_consensus.cc:493] T a1704639a875409b9959353527b3fd68 P b7ab4784c7344b939bc36f639286f377 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:43.786505  6770 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:43.918059  6731 raft_consensus.cc:1275] T b56bf91d90824c959e21e0cee5ba1816 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 3 FOLLOWER]: Refusing update from remote peer b7ab4784c7344b939bc36f639286f377: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:18:43.844650  6730 raft_consensus.cc:2468] T 24ee15416e3145beaa1b8183453729a3 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 3.
I20260709 13:18:43.860530  8137 raft_consensus.cc:515] T ce4f062dcd314d43a63ca74067cb5ee3 P cd75a17ab2604397adab03bb8b5fd75c [term 4 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } attrs { replace: true } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:18:43.849577  6877 raft_consensus.cc:1240] T a3022224cc81473690653a83d4e99470 P cd75a17ab2604397adab03bb8b5fd75c [term 3 FOLLOWER]: Rejecting Update request from peer ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 13:18:43.850169  6802 raft_consensus.cc:2468] T 713b5728a197487c9300b310ab94e5a3 P b7ab4784c7344b939bc36f639286f377 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 3.
I20260709 13:18:43.849963  6806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22ccee1b570c4ad3a57bd7aec085b1b4" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:18:43.670181  8151 consensus_queue.cc:1059] T 7c37d41cd9164c15a6826ca62a851a69 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.197s
I20260709 13:18:43.852488  6805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4db81d9d329422bb3b4160ca4ac2d1d" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:18:43.875526  6801 raft_consensus.cc:1275] T 4f00a2e87e56452083b759f60d461ee3 P b7ab4784c7344b939bc36f639286f377 [term 4 FOLLOWER]: Refusing update from remote peer 7ba59cc884714e8aa5f3f0ecaed84cbb: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:18:43.759253  6772 leader_election.cc:304] T a3022224cc81473690653a83d4e99470 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
W20260709 13:18:43.945890  6772 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 186719us
I20260709 13:18:43.881626  6872 raft_consensus.cc:2393] T 24ee15416e3145beaa1b8183453729a3 P cd75a17ab2604397adab03bb8b5fd75c [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ccd8a4c3bfe3413cb2ae219b09aea832 in current term 3: Already voted for candidate cd75a17ab2604397adab03bb8b5fd75c in this term.
I20260709 13:18:43.862843  7501 raft_consensus.cc:3060] T 24ee15416e3145beaa1b8183453729a3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:43.860670  8097 raft_consensus.cc:493] T f09c2a98de1a4decabd0ff900dd44caa P b7ab4784c7344b939bc36f639286f377 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:43.895300  8146 leader_election.cc:290] T 427c124d773f483294511e80fe340075 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:18:43.898751  7495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3d8792045a4583ae2e965b1350a5b4" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:18:43.764168  8118 raft_consensus.cc:3060] T 20f6842e26174571996b8dea4151d4be P cd75a17ab2604397adab03bb8b5fd75c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:43.881326  7886 raft_consensus.cc:493] T 44bde925b2e541b69890d70715b85176 P cd75a17ab2604397adab03bb8b5fd75c [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:43.924918  8081 raft_consensus.cc:515] T a1704639a875409b9959353527b3fd68 P b7ab4784c7344b939bc36f639286f377 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:43.968384  7886 raft_consensus.cc:515] T 44bde925b2e541b69890d70715b85176 P cd75a17ab2604397adab03bb8b5fd75c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:43.970149  8081 leader_election.cc:290] T a1704639a875409b9959353527b3fd68 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:18:43.970762  7886 leader_election.cc:290] T 44bde925b2e541b69890d70715b85176 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:18:43.881601  7934 raft_consensus.cc:493] T d8292e16e5654be6bc408560cf256aaa P cd75a17ab2604397adab03bb8b5fd75c [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:43.972486  7934 raft_consensus.cc:515] T d8292e16e5654be6bc408560cf256aaa P cd75a17ab2604397adab03bb8b5fd75c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:43.973965  7938 raft_consensus.cc:3055] T 7c37d41cd9164c15a6826ca62a851a69 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:18:43.974413  7938 raft_consensus.cc:740] T 7c37d41cd9164c15a6826ca62a851a69 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
I20260709 13:18:43.974706  7934 leader_election.cc:290] T d8292e16e5654be6bc408560cf256aaa P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:18:43.899561  7503 rpcz_store.cc:276] 0709 13:18:41.891028 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:42.140805 (+249777us) service_pool.cc:224] Handling call
0709 13:18:42.141413 (+   608us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:18:42.142029 (+   616us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:42.142059 (+    30us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:18:42.143361 (+  1302us) log.cc:844] Serialized 582 byte log entry
0709 13:18:42.317067 (+173706us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:18:42.317116 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:42.317192 (+    76us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:43.551477 (+1234285us) spinlock_profiling.cc:243] Waited 7.65 ms on lock 0x7b4400022b4c. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0c745db1 00007fcc0c7e3c85 00007fcc0c7e46a2 00007fcc0f5561db 00007fcc0f551aaf 00007fcc0f54586e 00007fcc0f544bb6 00007fcc0f5447d8 00007fcc0f54e221 00007fcc0f54e1d9 00007fcc0f54e169
0709 13:18:43.764916 (+213439us) raft_consensus.cc:1685] finished
0709 13:18:43.764950 (+    34us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:43.765214 (+   264us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2022,"raft.run_cpu_time_us":107,"raft.run_wall_time_us":107,"spinlock_wait_cycles":17589632,"thread_start_us":173254,"threads_started":1,"wal-append.queue_time_us":323032}
I20260709 13:18:43.976848  6873 raft_consensus.cc:1240] T bd6869f07b5a4885a0b99fbe60c3b175 P cd75a17ab2604397adab03bb8b5fd75c [term 5 FOLLOWER]: Rejecting Update request from peer ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 4. Current term is 5. Ops: []
I20260709 13:18:43.901104  6876 raft_consensus.cc:1275] T 3fa34c08b205435dba97346991aa1f92 P cd75a17ab2604397adab03bb8b5fd75c [term 3 FOLLOWER]: Refusing update from remote peer ccd8a4c3bfe3413cb2ae219b09aea832: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:18:43.920325  6730 raft_consensus.cc:1275] T d8292e16e5654be6bc408560cf256aaa P ccd8a4c3bfe3413cb2ae219b09aea832 [term 3 FOLLOWER]: Refusing update from remote peer b7ab4784c7344b939bc36f639286f377: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:18:43.844765  6879 raft_consensus.cc:1275] T 90d42e216d9741e190bca19a781291fd P cd75a17ab2604397adab03bb8b5fd75c [term 3 FOLLOWER]: Refusing update from remote peer ccd8a4c3bfe3413cb2ae219b09aea832: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:18:43.923134  6770 leader_election.cc:304] T 7c44c4849aa54f2b94d1f1bef9ed546f P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: cd75a17ab2604397adab03bb8b5fd75c
W20260709 13:18:43.950196  6846 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.68:45071, user_credentials={real_user=slave}} blocked reactor thread for 65475us
I20260709 13:18:43.960602  6877 raft_consensus.cc:1275] T e77e330a82df4b43a745d57a68f6f057 P cd75a17ab2604397adab03bb8b5fd75c [term 4 FOLLOWER]: Refusing update from remote peer ccd8a4c3bfe3413cb2ae219b09aea832: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 2. (term mismatch)
I20260709 13:18:43.981668  6877 pending_rounds.cc:85] T e77e330a82df4b43a745d57a68f6f057 P cd75a17ab2604397adab03bb8b5fd75c: Aborting all ops after (but not including) 1
I20260709 13:18:43.982023  6877 pending_rounds.cc:107] T e77e330a82df4b43a745d57a68f6f057 P cd75a17ab2604397adab03bb8b5fd75c: Aborting uncommitted NO_OP operation due to leader change: 3.2
I20260709 13:18:43.982334  6877 raft_consensus.cc:2889] T e77e330a82df4b43a745d57a68f6f057 P cd75a17ab2604397adab03bb8b5fd75c [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:18:43.975242  7938 consensus_queue.cc:260] T 7c37d41cd9164c15a6826ca62a851a69 P ccd8a4c3bfe3413cb2ae219b09aea832 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
W20260709 13:18:43.986040  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 223933us
W20260709 13:18:43.994200  6770 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 71153.7us
I20260709 13:18:43.914114  8096 raft_consensus.cc:515] T f4b8bd455d5a47c18a1380839c6e0d61 P b7ab4784c7344b939bc36f639286f377 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:43.945684  8122 raft_consensus.cc:2749] T a3022224cc81473690653a83d4e99470 P b7ab4784c7344b939bc36f639286f377 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
W20260709 13:18:44.004747  6847 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:44.015305  6879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b3759de40694069b13c0f8bd40e5709" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:18:43.994858  6772 leader_election.cc:304] T 4275cf08e63345f993bce8664eada830 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
W20260709 13:18:44.001120  6697 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 216231us
W20260709 13:18:44.017861  6697 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:44.022058  6879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bf4668eeb70467fb3dc5a0289233b3c" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:18:44.024467  6877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "853ac0a8cbd64ce99457f170216d4d0f" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:18:43.929405  8010 consensus_queue.cc:1059] T 4d9def8b32fd443aa94ab1420b06837b P b7ab4784c7344b939bc36f639286f377 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.078s
W20260709 13:18:44.028137  7466 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 164405us
I20260709 13:18:44.029726  6879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90d42e216d9741e190bca19a781291fd" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
W20260709 13:18:43.991907  6846 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:44.039129  6876 raft_consensus.cc:1240] T 8c7f33e544204fbaac4078e3e83bbf4e P cd75a17ab2604397adab03bb8b5fd75c [term 2 FOLLOWER]: Rejecting Update request from peer b7ab4784c7344b939bc36f639286f377 for earlier term 1. Current term is 2. Ops: []
I20260709 13:18:44.039696  6879 raft_consensus.cc:3060] T 90d42e216d9741e190bca19a781291fd P cd75a17ab2604397adab03bb8b5fd75c [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:44.012368  8035 raft_consensus.cc:2804] T f58dc08b12a2494bb9a1372837970ca2 P cd75a17ab2604397adab03bb8b5fd75c [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:18:44.012687  8121 raft_consensus.cc:2804] T 7c44c4849aa54f2b94d1f1bef9ed546f P b7ab4784c7344b939bc36f639286f377 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:18:44.042191  6877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "427c124d773f483294511e80fe340075" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:18:44.044728  6697 leader_election.cc:304] T 3d65025eea89441290d85dd053810e31 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:18:44.050539  6877 raft_consensus.cc:2410] T 427c124d773f483294511e80fe340075 P cd75a17ab2604397adab03bb8b5fd75c [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7ab4784c7344b939bc36f639286f377 for term 3 because replica has last-logged OpId of term: 1 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 2.
I20260709 13:18:44.044880  6772 leader_election.cc:304] T 9b3759de40694069b13c0f8bd40e5709 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:18:44.038992  6844 leader_election.cc:304] T 1528ab62b6fe4e3099d08f141afee116 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:18:44.053058  6846 leader_election.cc:304] T d8cee0accdb8499c86d4414b72565a38 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:18:44.054025  6846 leader_election.cc:304] T 4b8cacb381b746da8d0049b0a83b41dd P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:18:44.013993  7938 raft_consensus.cc:3060] T 7c37d41cd9164c15a6826ca62a851a69 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:44.057260  6727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4275cf08e63345f993bce8664eada830" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:18:44.058832  6727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3022224cc81473690653a83d4e99470" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:18:44.059765  6727 raft_consensus.cc:2410] T a3022224cc81473690653a83d4e99470 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:18:43.962775  7951 consensus_queue.cc:1059] T 4f00a2e87e56452083b759f60d461ee3 P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.065s
I20260709 13:18:43.977844  8120 consensus_queue.cc:1048] T d8cee0accdb8499c86d4414b72565a38 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.065s
I20260709 13:18:44.019481  8006 raft_consensus.cc:493] T 34f36d59d88f40fe8a2805e604fc6c0a P b7ab4784c7344b939bc36f639286f377 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:18:43.978062  8097 raft_consensus.cc:515] T f09c2a98de1a4decabd0ff900dd44caa P b7ab4784c7344b939bc36f639286f377 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:44.008025  8133 consensus_queue.cc:1048] T 2c240553ce044eedb41541d72b9475d7 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.039s
I20260709 13:18:44.088656  6877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22ccee1b570c4ad3a57bd7aec085b1b4" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:18:44.089898  6877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30e88460611e47b2ba16a46a30b5f416" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:18:44.091250  6876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1528ab62b6fe4e3099d08f141afee116" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:18:44.037983  7883 leader_election.cc:290] T 3411566abe2d4c9bb4b2adfdd05e6f17 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:18:44.092967  6697 leader_election.cc:304] T f09c2a98de1a4decabd0ff900dd44caa P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:18:44.049016  8010 raft_consensus.cc:2749] T 4275cf08e63345f993bce8664eada830 P b7ab4784c7344b939bc36f639286f377 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:18:44.100118  6877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1704639a875409b9959353527b3fd68" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:18:44.046641  8035 raft_consensus.cc:493] T f58dc08b12a2494bb9a1372837970ca2 P cd75a17ab2604397adab03bb8b5fd75c [term 3 FOLLOWER]: Starting leader election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:18:44.081103  8151 raft_consensus.cc:2749] T 3d65025eea89441290d85dd053810e31 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:44.084707  7934 raft_consensus.cc:2804] T d8cee0accdb8499c86d4414b72565a38 P cd75a17ab2604397adab03bb8b5fd75c [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:18:44.011780  8068 consensus_queue.cc:237] T 7a734b5ab7834e05a8c422208acc58b1 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:44.046859  8077 consensus_queue.cc:1048] T 4f00a2e87e56452083b759f60d461ee3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.053s
I20260709 13:18:44.047430  8085 consensus_queue.cc:1059] T 713b5728a197487c9300b310ab94e5a3 P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.053s
I20260709 13:18:44.106933  6697 leader_election.cc:304] T d8292e16e5654be6bc408560cf256aaa P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:18:44.080367  7886 raft_consensus.cc:2804] T 1528ab62b6fe4e3099d08f141afee116 P cd75a17ab2604397adab03bb8b5fd75c [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:18:44.049403  8075 consensus_queue.cc:1048] T 4d9def8b32fd443aa94ab1420b06837b P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.053s
I20260709 13:18:44.101248  6879 raft_consensus.cc:2468] T 90d42e216d9741e190bca19a781291fd P cd75a17ab2604397adab03bb8b5fd75c [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 4.
I20260709 13:18:44.102007  8094 raft_consensus.cc:2749] T f09c2a98de1a4decabd0ff900dd44caa P ccd8a4c3bfe3413cb2ae219b09aea832 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:18:44.091008  8006 raft_consensus.cc:515] T 34f36d59d88f40fe8a2805e604fc6c0a P b7ab4784c7344b939bc36f639286f377 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:44.107733  8035 raft_consensus.cc:3060] T f58dc08b12a2494bb9a1372837970ca2 P cd75a17ab2604397adab03bb8b5fd75c [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:44.137395  8167 raft_consensus.cc:2749] T 4b8cacb381b746da8d0049b0a83b41dd P cd75a17ab2604397adab03bb8b5fd75c [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:18:44.129639  6879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b56bf91d90824c959e21e0cee5ba1816" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
W20260709 13:18:44.132728  7984 consensus_meta.cc:287] T de3186201e1a40d0b335eeb8b4e256e0 P cd75a17ab2604397adab03bb8b5fd75c: Time spent flushing consensus metadata: real 0.557s	user 0.011s	sys 0.001s
I20260709 13:18:44.118448  6697 leader_election.cc:304] T a1704639a875409b9959353527b3fd68 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:18:44.118846  7503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1528ab62b6fe4e3099d08f141afee116" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:18:44.113829  7934 raft_consensus.cc:493] T d8cee0accdb8499c86d4414b72565a38 P cd75a17ab2604397adab03bb8b5fd75c [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:44.144786  8074 raft_consensus.cc:2749] T 9b3759de40694069b13c0f8bd40e5709 P b7ab4784c7344b939bc36f639286f377 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:18:44.127930  6798 raft_consensus.cc:1240] T bd6869f07b5a4885a0b99fbe60c3b175 P b7ab4784c7344b939bc36f639286f377 [term 5 LEADER]: Rejecting Update request from peer ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 4. Current term is 5. Ops: []
I20260709 13:18:44.155695  6878 raft_consensus.cc:2410] T de3186201e1a40d0b335eeb8b4e256e0 P cd75a17ab2604397adab03bb8b5fd75c [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7ab4784c7344b939bc36f639286f377 for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:18:44.155498  6626 catalog_manager.cc:5697] T be1a92657f494cac8dd227d152f50151 P 7ba59cc884714e8aa5f3f0ecaed84cbb reported cstate change: term changed from 1 to 3, leader changed from ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65) to 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68). New cstate: current_term: 3 leader_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:18:44.200188  6626 catalog_manager.cc:5697] T bb3d8792045a4583ae2e965b1350a5b4 P 7ba59cc884714e8aa5f3f0ecaed84cbb reported cstate change: term changed from 1 to 3, leader changed from ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65) to 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68). New cstate: current_term: 3 leader_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:18:44.157394  6879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f9c2e2bf644115957398fe4c9459db" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:18:44.162272  6697 leader_election.cc:304] T ce4f062dcd314d43a63ca74067cb5ee3 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:18:44.131031  7886 raft_consensus.cc:697] T 1528ab62b6fe4e3099d08f141afee116 P cd75a17ab2604397adab03bb8b5fd75c [term 3 LEADER]: Becoming Leader. State: Replica: cd75a17ab2604397adab03bb8b5fd75c, State: Running, Role: LEADER
I20260709 13:18:44.082466  6730 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1528ab62b6fe4e3099d08f141afee116"
dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
mode: GRACEFUL
new_leader_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
 from {username='slave'} at 127.0.0.1:38536
I20260709 13:18:44.119676  8143 raft_consensus.cc:2749] T d8292e16e5654be6bc408560cf256aaa P ccd8a4c3bfe3413cb2ae219b09aea832 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:18:44.197137  6630 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:53214 (request call id 175) took 4262 ms. Trace:
W20260709 13:18:44.144842  8171 log.cc:927] Time spent T de3186201e1a40d0b335eeb8b4e256e0 P ccd8a4c3bfe3413cb2ae219b09aea832: Append to log took a long time: real 0.249s	user 0.000s	sys 0.000s
I20260709 13:18:44.225744  6879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4db81d9d329422bb3b4160ca4ac2d1d" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:18:44.232586  6879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c240553ce044eedb41541d72b9475d7" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
W20260709 13:18:44.219735  6697 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 57562.8us
I20260709 13:18:44.193650  8094 raft_consensus.cc:2749] T a1704639a875409b9959353527b3fd68 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:18:44.227995  6730 raft_consensus.cc:606] T 1528ab62b6fe4e3099d08f141afee116 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 3 FOLLOWER]: Received request to transfer leadership to TS cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:18:44.132776  8155 consensus_queue.cc:1059] T e31b9971c15848dea59d4d4130141d9e P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.192s
I20260709 13:18:44.149564  8167 raft_consensus.cc:3055] T 713b5728a197487c9300b310ab94e5a3 P cd75a17ab2604397adab03bb8b5fd75c [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:18:44.193915  7934 raft_consensus.cc:3060] T d8cee0accdb8499c86d4414b72565a38 P cd75a17ab2604397adab03bb8b5fd75c [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:44.128216  6873 raft_consensus.cc:1275] T 9e326172347f45e99a0d482b5d8ef768 P cd75a17ab2604397adab03bb8b5fd75c [term 3 FOLLOWER]: Refusing update from remote peer b7ab4784c7344b939bc36f639286f377: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:18:44.197394  7501 raft_consensus.cc:2468] T 24ee15416e3145beaa1b8183453729a3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 3.
I20260709 13:18:44.218951  7984 raft_consensus.cc:493] T 2c240553ce044eedb41541d72b9475d7 P cd75a17ab2604397adab03bb8b5fd75c [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:44.238018  6730 raft_consensus.cc:614] T 1528ab62b6fe4e3099d08f141afee116 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 3 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:18:44.227038  8121 raft_consensus.cc:697] T 7c44c4849aa54f2b94d1f1bef9ed546f P b7ab4784c7344b939bc36f639286f377 [term 3 LEADER]: Becoming Leader. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
I20260709 13:18:44.147599  8130 consensus_queue.cc:1048] T bb3d8792045a4583ae2e965b1350a5b4 P 7ba59cc884714e8aa5f3f0ecaed84cbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.081s
I20260709 13:18:44.233700  6697 leader_election.cc:304] T bb3d8792045a4583ae2e965b1350a5b4 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:18:44.284015  6799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "853ac0a8cbd64ce99457f170216d4d0f" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
W20260709 13:18:44.284363  6697 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 50769.9us
I20260709 13:18:44.285385  6800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44bde925b2e541b69890d70715b85176" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:18:44.285998  6800 raft_consensus.cc:2468] T 44bde925b2e541b69890d70715b85176 P b7ab4784c7344b939bc36f639286f377 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 3.
I20260709 13:18:44.286235  6697 leader_election.cc:304] T 44bde925b2e541b69890d70715b85176 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:18:44.287701  7993 raft_consensus.cc:2804] T bb3d8792045a4583ae2e965b1350a5b4 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:18:44.288242  7993 raft_consensus.cc:493] T bb3d8792045a4583ae2e965b1350a5b4 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 7ba59cc884714e8aa5f3f0ecaed84cbb)
I20260709 13:18:44.288668  7993 raft_consensus.cc:3060] T bb3d8792045a4583ae2e965b1350a5b4 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:44.289117  6697 leader_election.cc:304] T ab432e62819d499eaaf3dd55481dd930 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:18:44.290343  8060 raft_consensus.cc:3060] T a1704639a875409b9959353527b3fd68 P cd75a17ab2604397adab03bb8b5fd75c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:44.290560  8151 raft_consensus.cc:2749] T ab432e62819d499eaaf3dd55481dd930 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:18:44.225170  8146 raft_consensus.cc:2749] T ce4f062dcd314d43a63ca74067cb5ee3 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:18:44.120163  8099 consensus_queue.cc:1059] T 4275cf08e63345f993bce8664eada830 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.112s
I20260709 13:18:44.272167  8139 raft_consensus.cc:493] T de3186201e1a40d0b335eeb8b4e256e0 P cd75a17ab2604397adab03bb8b5fd75c [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:44.230170  6630 rpcz_store.cc:276] 0709 13:18:39.897089 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:39.897451 (+   362us) service_pool.cc:224] Handling call
0709 13:18:40.535214 (+637763us) spinlock_profiling.cc:243] Waited 491 ms on lock 0x7b5400156154. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f914090 00007fcc0f9b2f3a 00007fcc157691cc 00007fcc1586737e 00007fcc13d282a4 00007fcc13d28232 00007fcc13d28161 00007fcc13d280dc 00007fcc13d27392 00007fcc0dce548c 00007fcc0dce48c6
0709 13:18:44.158831 (+3623617us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:18:41.265712 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:18:41.266346 (+   634us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:18:41.266416 (+    70us) write_op.cc:435] Acquired schema lock
0709 13:18:41.266434 (+    18us) tablet.cc:662] Decoding operations
0709 13:18:41.267399 (+   965us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:18:41.267483 (+    84us) write_op.cc:641] Partition lock acquired for write op
0709 13:18:41.267511 (+    28us) tablet.cc:685] Acquiring locks for 5 operations
0709 13:18:41.268080 (+   569us) tablet.cc:701] Row locks acquired
0709 13:18:41.268104 (+    24us) write_op.cc:260] PREPARE: finished
0709 13:18:41.268255 (+   151us) write_op.cc:270] Start()
0709 13:18:41.268378 (+   123us) write_op.cc:276] Timestamp: P: 1783603121268210 usec, L: 0
0709 13:18:41.268397 (+    19us) op_driver.cc:348] REPLICATION: starting
0709 13:18:41.269175 (+   778us) log.cc:844] Serialized 2078 byte log entry
0709 13:18:41.474669 (+205494us) op_driver.cc:464] REPLICATION: finished
0709 13:18:41.806672 (+332003us) write_op.cc:301] APPLY: starting
0709 13:18:41.817160 (+ 10488us) tablet.cc:1367] starting BulkCheckPresence
0709 13:18:41.854525 (+ 37365us) tablet.cc:1370] finished BulkCheckPresence
0709 13:18:42.155001 (+300476us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:18:42.372881 (+217880us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:18:42.373138 (+   257us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=5
0709 13:18:42.373203 (+    65us) write_op.cc:312] APPLY: finished
0709 13:18:42.373533 (+   330us) log.cc:844] Serialized 46 byte log entry
0709 13:18:42.374486 (+   953us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:18:42.374625 (+   139us) write_op.cc:454] Released schema lock
0709 13:18:42.374681 (+    56us) write_op.cc:341] FINISH: Updating metrics
0709 13:18:42.375127 (+   446us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:18:42.375165 (+    38us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":72993,"reported_tablets":8,"spinlock_wait_cycles":1129644288,"child_traces":[["op",{"apply.queue_time_us":263300,"apply.run_cpu_time_us":13604,"apply.run_wall_time_us":572140,"num_ops":5,"prepare.queue_time_us":135443,"prepare.run_cpu_time_us":3787,"prepare.run_wall_time_us":7157,"replication_time_us":183202,"thread_start_us":245198,"threads_started":2}]]}
I20260709 13:18:44.291944  8151 consensus_queue.cc:1048] T 4b8cacb381b746da8d0049b0a83b41dd P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
W20260709 13:18:44.226624  6772 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 181823us
I20260709 13:18:44.277007  6802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3022224cc81473690653a83d4e99470" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:18:44.309055  6802 raft_consensus.cc:2393] T a3022224cc81473690653a83d4e99470 P b7ab4784c7344b939bc36f639286f377 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c in current term 3: Already voted for candidate b7ab4784c7344b939bc36f639286f377 in this term.
I20260709 13:18:44.308872  6772 leader_election.cc:304] T 853ac0a8cbd64ce99457f170216d4d0f P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:18:44.277406  6807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a75bfe094d4bdc963aba3f08dfcd25" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:18:44.309950  6807 raft_consensus.cc:2468] T 95a75bfe094d4bdc963aba3f08dfcd25 P b7ab4784c7344b939bc36f639286f377 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 3.
I20260709 13:18:44.308071  8133 raft_consensus.cc:493] T f03d0dbf16864ca4bc1bb5e4c0334c0f P b7ab4784c7344b939bc36f639286f377 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:44.281009  8178 log.cc:927] Time spent T 17587d6730594da4a56fa13a353232a1 P ccd8a4c3bfe3413cb2ae219b09aea832: Append to log took a long time: real 0.132s	user 0.000s	sys 0.001s
I20260709 13:18:44.281445  6805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4275cf08e63345f993bce8664eada830" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:18:44.323832  6805 raft_consensus.cc:2393] T 4275cf08e63345f993bce8664eada830 P b7ab4784c7344b939bc36f639286f377 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c in current term 2: Already voted for candidate b7ab4784c7344b939bc36f639286f377 in this term.
I20260709 13:18:44.270759  8167 raft_consensus.cc:740] T 713b5728a197487c9300b310ab94e5a3 P cd75a17ab2604397adab03bb8b5fd75c [term 2 LEADER]: Becoming Follower/Learner. State: Replica: cd75a17ab2604397adab03bb8b5fd75c, State: Running, Role: LEADER
I20260709 13:18:44.283258  6873 raft_consensus.cc:1275] T d8292e16e5654be6bc408560cf256aaa P cd75a17ab2604397adab03bb8b5fd75c [term 3 FOLLOWER]: Refusing update from remote peer b7ab4784c7344b939bc36f639286f377: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:18:44.324743  6772 leader_election.cc:304] T 1bf4668eeb70467fb3dc5a0289233b3c P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:18:44.196797  7503 raft_consensus.cc:2468] T 1528ab62b6fe4e3099d08f141afee116 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 3.
I20260709 13:18:44.292764  6697 leader_election.cc:304] T 4d9def8b32fd443aa94ab1420b06837b P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377
I20260709 13:18:44.317564  6846 leader_election.cc:304] T 24ee15416e3145beaa1b8183453729a3 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:18:44.288236  8143 raft_consensus.cc:2749] T 44bde925b2e541b69890d70715b85176 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:18:44.272710  8006 leader_election.cc:290] T 34f36d59d88f40fe8a2805e604fc6c0a P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:18:44.280958  6801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90d42e216d9741e190bca19a781291fd" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:18:44.357059  6801 raft_consensus.cc:2393] T 90d42e216d9741e190bca19a781291fd P b7ab4784c7344b939bc36f639286f377 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c in current term 4: Already voted for candidate b7ab4784c7344b939bc36f639286f377 in this term.
I20260709 13:18:44.316658  7886 consensus_queue.cc:237] T 1528ab62b6fe4e3099d08f141afee116 P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.3, Last appended by leader: 3, Current term: 3, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } attrs { replace: true } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:18:44.283053  6803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f03d0dbf16864ca4bc1bb5e4c0334c0f" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:18:44.292583  8115 raft_consensus.cc:493] T 9e326172347f45e99a0d482b5d8ef768 P cd75a17ab2604397adab03bb8b5fd75c [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:44.326040  6802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8292e16e5654be6bc408560cf256aaa" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
W20260709 13:18:44.355804  6697 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 63139.2us
I20260709 13:18:44.288003  8186 raft_consensus.cc:493] T 3d65025eea89441290d85dd053810e31 P b7ab4784c7344b939bc36f639286f377 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader cd75a17ab2604397adab03bb8b5fd75c)
I20260709 13:18:44.316725  8155 raft_consensus.cc:3055] T e31b9971c15848dea59d4d4130141d9e P cd75a17ab2604397adab03bb8b5fd75c [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:18:44.317540  8111 raft_consensus.cc:493] T dbdf895bba214ff68685a24fd17dfb5d P b7ab4784c7344b939bc36f639286f377 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:44.368017  6772 leader_election.cc:304] T 90d42e216d9741e190bca19a781291fd P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:18:44.367866  6697 leader_election.cc:304] T 95a75bfe094d4bdc963aba3f08dfcd25 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:18:44.279414  7468 leader_election.cc:304] T 3fa34c08b205435dba97346991aa1f92 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, cd75a17ab2604397adab03bb8b5fd75c; no voters: ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:18:44.326432  8097 leader_election.cc:290] T f09c2a98de1a4decabd0ff900dd44caa P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:18:44.293062  7984 raft_consensus.cc:515] T 2c240553ce044eedb41541d72b9475d7 P cd75a17ab2604397adab03bb8b5fd75c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
W20260709 13:18:44.374197  6846 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.68:45071, user_credentials={real_user=slave}} blocked reactor thread for 56777us
I20260709 13:18:44.354051  8096 leader_election.cc:290] T f4b8bd455d5a47c18a1380839c6e0d61 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:18:44.361104  8006 raft_consensus.cc:2749] T 853ac0a8cbd64ce99457f170216d4d0f P b7ab4784c7344b939bc36f639286f377 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:44.374790  8089 leader_election.cc:290] T 9b3759de40694069b13c0f8bd40e5709 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 3 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:18:44.377315  8194 raft_consensus.cc:2749] T 1bf4668eeb70467fb3dc5a0289233b3c P b7ab4784c7344b939bc36f639286f377 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:18:44.423840  6879 raft_consensus.cc:2468] T 2c240553ce044eedb41541d72b9475d7 P cd75a17ab2604397adab03bb8b5fd75c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 3.
I20260709 13:18:44.370995  8155 raft_consensus.cc:740] T e31b9971c15848dea59d4d4130141d9e P cd75a17ab2604397adab03bb8b5fd75c [term 2 LEADER]: Becoming Follower/Learner. State: Replica: cd75a17ab2604397adab03bb8b5fd75c, State: Running, Role: LEADER
W20260709 13:18:44.430279  8175 log.cc:927] Time spent T 4b8cacb381b746da8d0049b0a83b41dd P 7ba59cc884714e8aa5f3f0ecaed84cbb: Append to log took a long time: real 0.315s	user 0.000s	sys 0.001s
I20260709 13:18:44.323789  8133 raft_consensus.cc:515] T f03d0dbf16864ca4bc1bb5e4c0334c0f P b7ab4784c7344b939bc36f639286f377 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:44.374404  8143 raft_consensus.cc:2749] T 95a75bfe094d4bdc963aba3f08dfcd25 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:18:44.376142  6726 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50004 (request call id 1021) took 1130 ms. Trace:
I20260709 13:18:44.353385  8139 raft_consensus.cc:515] T de3186201e1a40d0b335eeb8b4e256e0 P cd75a17ab2604397adab03bb8b5fd75c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:44.447233  7984 leader_election.cc:290] T 2c240553ce044eedb41541d72b9475d7 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:18:44.371171  8115 raft_consensus.cc:515] T 9e326172347f45e99a0d482b5d8ef768 P cd75a17ab2604397adab03bb8b5fd75c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:44.421113  8097 raft_consensus.cc:2804] T 90d42e216d9741e190bca19a781291fd P b7ab4784c7344b939bc36f639286f377 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:18:44.370088  8094 raft_consensus.cc:2804] T 4d9def8b32fd443aa94ab1420b06837b P ccd8a4c3bfe3413cb2ae219b09aea832 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:18:44.375149  8111 raft_consensus.cc:515] T dbdf895bba214ff68685a24fd17dfb5d P b7ab4784c7344b939bc36f639286f377 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
W20260709 13:18:44.426275  7468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 155164us
I20260709 13:18:44.415860  8187 raft_consensus.cc:2804] T 24ee15416e3145beaa1b8183453729a3 P cd75a17ab2604397adab03bb8b5fd75c [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:18:44.448369  6873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3411566abe2d4c9bb4b2adfdd05e6f17" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:18:44.503801  6873 raft_consensus.cc:2393] T 3411566abe2d4c9bb4b2adfdd05e6f17 P cd75a17ab2604397adab03bb8b5fd75c [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7ab4784c7344b939bc36f639286f377 in current term 2: Already voted for candidate cd75a17ab2604397adab03bb8b5fd75c in this term.
I20260709 13:18:44.505005  8022 raft_consensus.cc:493] T 17587d6730594da4a56fa13a353232a1 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:18:44.505182  6873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4b8bd455d5a47c18a1380839c6e0d61" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:18:44.505647  8022 raft_consensus.cc:515] T 17587d6730594da4a56fa13a353232a1 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:18:44.506227  6873 raft_consensus.cc:2393] T f4b8bd455d5a47c18a1380839c6e0d61 P cd75a17ab2604397adab03bb8b5fd75c [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7ab4784c7344b939bc36f639286f377 in current term 2: Already voted for candidate cd75a17ab2604397adab03bb8b5fd75c in this term.
W20260709 13:18:44.507333  8185 log.cc:927] Time spent T 20f6842e26174571996b8dea4151d4be P ccd8a4c3bfe3413cb2ae219b09aea832: Append to log took a long time: real 0.244s	user 0.001s	sys 0.000s
I20260709 13:18:44.507272  6873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09c2a98de1a4decabd0ff900dd44caa" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:18:44.507848  8022 leader_election.cc:290] T 17587d6730594da4a56fa13a353232a1 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:18:44.481778  6697 leader_election.cc:304] T 24ee15416e3145beaa1b8183453729a3 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:18:44.380295  8112 raft_consensus.cc:493] T b56bf91d90824c959e21e0cee5ba1816 P cd75a17ab2604397adab03bb8b5fd75c [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:44.448642  8137 leader_election.cc:290] T ce4f062dcd314d43a63ca74067cb5ee3 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 4 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:18:44.426698  8096 consensus_queue.cc:1048] T 9e326172347f45e99a0d482b5d8ef768 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.055s
I20260709 13:18:44.378048  8186 raft_consensus.cc:515] T 3d65025eea89441290d85dd053810e31 P b7ab4784c7344b939bc36f639286f377 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:44.423368  8100 consensus_queue.cc:1059] T 3411566abe2d4c9bb4b2adfdd05e6f17 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.056s
I20260709 13:18:44.501884  6874 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53416 (request call id 1855) took 1066 ms. Trace:
I20260709 13:18:44.530033  6874 rpcz_store.cc:276] 0709 13:18:43.430015 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:43.430339 (+   324us) service_pool.cc:224] Handling call
0709 13:18:44.495651 (+1065312us) spinlock_profiling.cc:243] Waited 184 ms on lock 0x7b5400218ed4. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f9ae2fa 00007fcc1496fb17 00007fcc0deea6d4 00007fcc0deea662 00007fcc0deea591 00007fcc0deea50c 00007fcc0dee97c2 00007fcc0dce548c 00007fcc0dce48c6 00007fcc0dce426f
0709 13:18:44.495801 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":424322432}
I20260709 13:18:44.511801  7500 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50742 (request call id 207) took 2274 ms. Trace:
I20260709 13:18:44.477135  8099 consensus_queue.cc:1048] T 90d42e216d9741e190bca19a781291fd P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.031s
I20260709 13:18:44.470021  8068 consensus_queue.cc:1048] T 3fa34c08b205435dba97346991aa1f92 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.027s
I20260709 13:18:44.423408  8167 consensus_queue.cc:260] T 713b5728a197487c9300b310ab94e5a3 P cd75a17ab2604397adab03bb8b5fd75c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:44.514364  6807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17587d6730594da4a56fa13a353232a1" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:18:44.479140  8151 consensus_queue.cc:1059] T bd6869f07b5a4885a0b99fbe60c3b175 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.032s
I20260709 13:18:44.489275  7938 consensus_queue.cc:1048] T e77e330a82df4b43a745d57a68f6f057 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.027s
I20260709 13:18:44.508800  8097 raft_consensus.cc:697] T 90d42e216d9741e190bca19a781291fd P b7ab4784c7344b939bc36f639286f377 [term 4 LEADER]: Becoming Leader. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
I20260709 13:18:44.421859  8121 consensus_queue.cc:237] T 7c44c4849aa54f2b94d1f1bef9ed546f P b7ab4784c7344b939bc36f639286f377 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:44.515612  8155 consensus_queue.cc:260] T e31b9971c15848dea59d4d4130141d9e P cd75a17ab2604397adab03bb8b5fd75c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:44.509184  8094 raft_consensus.cc:697] T 4d9def8b32fd443aa94ab1420b06837b P ccd8a4c3bfe3413cb2ae219b09aea832 [term 3 LEADER]: Becoming Leader. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
I20260709 13:18:44.523622  6873 raft_consensus.cc:2410] T f09c2a98de1a4decabd0ff900dd44caa P cd75a17ab2604397adab03bb8b5fd75c [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7ab4784c7344b939bc36f639286f377 for term 4 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:18:44.531925  6874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34f36d59d88f40fe8a2805e604fc6c0a" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
W20260709 13:18:44.527233  8184 log.cc:927] Time spent T bd6869f07b5a4885a0b99fbe60c3b175 P b7ab4784c7344b939bc36f639286f377: Append to log took a long time: real 0.146s	user 0.001s	sys 0.000s
I20260709 13:18:44.516927  8187 raft_consensus.cc:697] T 24ee15416e3145beaa1b8183453729a3 P cd75a17ab2604397adab03bb8b5fd75c [term 3 LEADER]: Becoming Leader. State: Replica: cd75a17ab2604397adab03bb8b5fd75c, State: Running, Role: LEADER
I20260709 13:18:44.524766  6803 raft_consensus.cc:2393] T f03d0dbf16864ca4bc1bb5e4c0334c0f P b7ab4784c7344b939bc36f639286f377 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c in current term 3: Already voted for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in this term.
I20260709 13:18:44.532820  7500 rpcz_store.cc:276] 0709 13:18:42.228479 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:42.315667 (+ 87188us) service_pool.cc:224] Handling call
0709 13:18:42.316091 (+   424us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:42.688723 (+372632us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:44.497679 (+1808956us) spinlock_profiling.cc:243] Waited 338 ms on lock 0x7b540032d2d4. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f9aae01 00007fcc0f9a983e 00007fcc1496e419 00007fcc0dee5bd4 00007fcc0dee5b62 00007fcc0dee5a91 00007fcc0dee5a0c 00007fcc0dee4cc2 00007fcc0dce548c 00007fcc0dce48c6
0709 13:18:44.502908 (+  5229us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":777188096}
I20260709 13:18:44.553854  6805 raft_consensus.cc:1275] T b3f13b31a1f84f0d89d007eadd57924c P b7ab4784c7344b939bc36f639286f377 [term 2 FOLLOWER]: Refusing update from remote peer 7ba59cc884714e8aa5f3f0ecaed84cbb: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:18:44.525579  8102 raft_consensus.cc:2749] T 24ee15416e3145beaa1b8183453729a3 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:18:44.523962  8180 raft_consensus.cc:2804] T 3fa34c08b205435dba97346991aa1f92 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:18:44.570731  8187 consensus_queue.cc:237] T 24ee15416e3145beaa1b8183453729a3 P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.3, Last appended by leader: 3, Current term: 3, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } attrs { replace: true } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:18:44.571491  8180 raft_consensus.cc:493] T 3fa34c08b205435dba97346991aa1f92 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:44.572052  8180 raft_consensus.cc:3060] T 3fa34c08b205435dba97346991aa1f92 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:18:44.576851  8197 log.cc:927] Time spent T f58dc08b12a2494bb9a1372837970ca2 P b7ab4784c7344b939bc36f639286f377: Append to log took a long time: real 0.109s	user 0.000s	sys 0.000s
I20260709 13:18:44.579021  8186 leader_election.cc:290] T 3d65025eea89441290d85dd053810e31 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:18:44.581873  8111 leader_election.cc:290] T dbdf895bba214ff68685a24fd17dfb5d P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:18:44.475131  6726 rpcz_store.cc:276] 0709 13:18:43.243156 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:43.820584 (+577428us) service_pool.cc:224] Handling call
0709 13:18:43.839159 (+ 18575us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:43.885430 (+ 46271us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:43.887963 (+  2533us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:43.895121 (+  7158us) log.cc:844] Serialized 26 byte log entry
0709 13:18:44.048357 (+153236us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:18:44.080721 (+ 32364us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:44.089991 (+  9270us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:44.360018 (+270027us) raft_consensus.cc:1685] finished
0709 13:18:44.360056 (+    38us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:44.373774 (+ 13718us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":26309,"raft.queue_time_us":39821,"raft.run_cpu_time_us":184,"raft.run_wall_time_us":5030,"spinlock_wait_cycles":910720,"thread_start_us":141635,"threads_started":1,"wal-append.queue_time_us":195691}
I20260709 13:18:44.522079  8035 raft_consensus.cc:515] T f58dc08b12a2494bb9a1372837970ca2 P cd75a17ab2604397adab03bb8b5fd75c [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
W20260709 13:18:44.584450  8192 log.cc:927] Time spent T d33d5ee8ef6f415593d8df52063161ad P ccd8a4c3bfe3413cb2ae219b09aea832: Append to log took a long time: real 0.216s	user 0.000s	sys 0.001s
I20260709 13:18:44.590549  8035 leader_election.cc:290] T f58dc08b12a2494bb9a1372837970ca2 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 4 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:18:44.590468  6725 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50004 (request call id 1024) took 1346 ms. Trace:
I20260709 13:18:44.591123  6725 rpcz_store.cc:276] 0709 13:18:43.244014 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:43.819390 (+575376us) service_pool.cc:224] Handling call
0709 13:18:43.819994 (+   604us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:43.865490 (+ 45496us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:43.873353 (+  7863us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:43.952303 (+ 78950us) log.cc:844] Serialized 26 byte log entry
0709 13:18:44.234248 (+281945us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:18:44.239670 (+  5422us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:44.270679 (+ 31009us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:44.590194 (+319515us) raft_consensus.cc:1685] finished
0709 13:18:44.590217 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:44.590395 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":36847,"raft.queue_time_us":38547,"raft.run_cpu_time_us":194,"raft.run_wall_time_us":17697,"thread_start_us":182885,"threads_started":1,"wal-append.queue_time_us":266503}
I20260709 13:18:44.592000  8097 consensus_queue.cc:237] T 90d42e216d9741e190bca19a781291fd P b7ab4784c7344b939bc36f639286f377 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
W20260709 13:18:44.594957  6878 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53406 (request call id 1034) took 1985 ms (client timeout 1877 ms). Trace:
W20260709 13:18:44.595557  6878 rpcz_store.cc:269] 0709 13:18:42.609259 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:43.550278 (+941019us) service_pool.cc:224] Handling call
0709 13:18:44.594712 (+1044434us) spinlock_profiling.cc:243] Waited 557 ms on lock 0x7b54000a73d4. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f9ae2fa 00007fcc1496fb17 00007fcc0deea6d4 00007fcc0deea662 00007fcc0deea591 00007fcc0deea50c 00007fcc0dee97c2 00007fcc0dce548c 00007fcc0dce48c6 00007fcc0dce426f
0709 13:18:44.594850 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1280321792}
I20260709 13:18:44.597551  7883 raft_consensus.cc:3055] T 4d9def8b32fd443aa94ab1420b06837b P b7ab4784c7344b939bc36f639286f377 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:18:44.598002  7883 raft_consensus.cc:740] T 4d9def8b32fd443aa94ab1420b06837b P b7ab4784c7344b939bc36f639286f377 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
I20260709 13:18:44.598220  8126 consensus_queue.cc:1048] T b3f13b31a1f84f0d89d007eadd57924c P 7ba59cc884714e8aa5f3f0ecaed84cbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:18:44.598873  7883 consensus_queue.cc:260] T 4d9def8b32fd443aa94ab1420b06837b P b7ab4784c7344b939bc36f639286f377 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:44.518726  7496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce4f062dcd314d43a63ca74067cb5ee3" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb"
I20260709 13:18:44.585902  6877 raft_consensus.cc:2410] T a1704639a875409b9959353527b3fd68 P cd75a17ab2604397adab03bb8b5fd75c [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7ab4784c7344b939bc36f639286f377 for term 4 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:18:44.530123  8112 raft_consensus.cc:515] T b56bf91d90824c959e21e0cee5ba1816 P cd75a17ab2604397adab03bb8b5fd75c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:44.619792  6874 raft_consensus.cc:1275] T 7c37d41cd9164c15a6826ca62a851a69 P cd75a17ab2604397adab03bb8b5fd75c [term 2 FOLLOWER]: Refusing update from remote peer b7ab4784c7344b939bc36f639286f377: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:18:44.599922  7883 raft_consensus.cc:3060] T 4d9def8b32fd443aa94ab1420b06837b P b7ab4784c7344b939bc36f639286f377 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:44.625576  8066 raft_consensus.cc:3055] T bd6869f07b5a4885a0b99fbe60c3b175 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:18:44.627421  8155 raft_consensus.cc:3060] T e31b9971c15848dea59d4d4130141d9e P cd75a17ab2604397adab03bb8b5fd75c [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:18:44.635526  8199 log.cc:927] Time spent T 4f00a2e87e56452083b759f60d461ee3 P b7ab4784c7344b939bc36f639286f377: Append to log took a long time: real 0.052s	user 0.001s	sys 0.000s
I20260709 13:18:44.641211  6881 raft_consensus.cc:1275] T b56bf91d90824c959e21e0cee5ba1816 P cd75a17ab2604397adab03bb8b5fd75c [term 3 FOLLOWER]: Refusing update from remote peer b7ab4784c7344b939bc36f639286f377: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
I20260709 13:18:44.665074  6881 pending_rounds.cc:85] T b56bf91d90824c959e21e0cee5ba1816 P cd75a17ab2604397adab03bb8b5fd75c: Aborting all ops after (but not including) 1
I20260709 13:18:44.665446  6881 pending_rounds.cc:107] T b56bf91d90824c959e21e0cee5ba1816 P cd75a17ab2604397adab03bb8b5fd75c: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 13:18:44.665767  6881 raft_consensus.cc:2889] T b56bf91d90824c959e21e0cee5ba1816 P cd75a17ab2604397adab03bb8b5fd75c [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:18:44.653110  8133 leader_election.cc:290] T f03d0dbf16864ca4bc1bb5e4c0334c0f P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:18:44.652617  8094 consensus_queue.cc:237] T 4d9def8b32fd443aa94ab1420b06837b P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:44.654414  8066 raft_consensus.cc:740] T bd6869f07b5a4885a0b99fbe60c3b175 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
W20260709 13:18:44.678804  6772 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 105372us
W20260709 13:18:44.693089  6697 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.68:45071, user_credentials={real_user=slave}} blocked reactor thread for 211387us
I20260709 13:18:44.695180  6697 leader_election.cc:304] T 1528ab62b6fe4e3099d08f141afee116 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:18:44.673377  8133 raft_consensus.cc:493] T 7a734b5ab7834e05a8c422208acc58b1 P b7ab4784c7344b939bc36f639286f377 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:44.708400  7496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "427c124d773f483294511e80fe340075" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:18:44.709223  7496 raft_consensus.cc:2468] T 427c124d773f483294511e80fe340075 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 2.
I20260709 13:18:44.705840  8068 consensus_queue.cc:1059] T b3f13b31a1f84f0d89d007eadd57924c P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.015s
I20260709 13:18:44.700520  7938 raft_consensus.cc:2749] T 1528ab62b6fe4e3099d08f141afee116 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:18:44.722738  8066 consensus_queue.cc:260] T bd6869f07b5a4885a0b99fbe60c3b175 P ccd8a4c3bfe3413cb2ae219b09aea832 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 4.2, Last appended by leader: 2, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:44.725592  8066 raft_consensus.cc:3060] T bd6869f07b5a4885a0b99fbe60c3b175 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:44.700227  8100 consensus_queue.cc:1048] T 3fa34c08b205435dba97346991aa1f92 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.027s
I20260709 13:18:44.718216  8157 raft_consensus.cc:3055] T 4f00a2e87e56452083b759f60d461ee3 P cd75a17ab2604397adab03bb8b5fd75c [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:18:44.728569  8157 raft_consensus.cc:740] T 4f00a2e87e56452083b759f60d461ee3 P cd75a17ab2604397adab03bb8b5fd75c [term 3 LEADER]: Becoming Follower/Learner. State: Replica: cd75a17ab2604397adab03bb8b5fd75c, State: Running, Role: LEADER
I20260709 13:18:44.724529  8068 raft_consensus.cc:3055] T b3f13b31a1f84f0d89d007eadd57924c P ccd8a4c3bfe3413cb2ae219b09aea832 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:18:44.735354  6723 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49998 (request call id 434) took 1699 ms. Trace:
I20260709 13:18:44.735730  6723 rpcz_store.cc:276] 0709 13:18:43.035973 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:43.036127 (+   154us) service_pool.cc:224] Handling call
0709 13:18:43.129339 (+ 93212us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:43.589932 (+460593us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:44.735087 (+1145155us) spinlock_profiling.cc:243] Waited 344 ms on lock 0x7b540008e154. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f9aae01 00007fcc0f9a983e 00007fcc1496e419 00007fcc0dee5bd4 00007fcc0dee5b62 00007fcc0dee5a91 00007fcc0dee5a0c 00007fcc0dee4cc2 00007fcc0dce548c 00007fcc0dce48c6
0709 13:18:44.735296 (+   209us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":791213312}
W20260709 13:18:44.711915  8173 log.cc:927] Time spent T f58dc08b12a2494bb9a1372837970ca2 P ccd8a4c3bfe3413cb2ae219b09aea832: Append to log took a long time: real 0.595s	user 0.006s	sys 0.001s
I20260709 13:18:44.715227  8146 raft_consensus.cc:3055] T 4275cf08e63345f993bce8664eada830 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:18:44.721920  6798 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:32976 (request call id 1839) took 1011 ms. Trace:
I20260709 13:18:44.719949  8143 raft_consensus.cc:3055] T 3411566abe2d4c9bb4b2adfdd05e6f17 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:18:44.760308  7500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24ee15416e3145beaa1b8183453729a3" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:18:44.765280  7500 raft_consensus.cc:2393] T 24ee15416e3145beaa1b8183453729a3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7ab4784c7344b939bc36f639286f377 in current term 3: Already voted for candidate cd75a17ab2604397adab03bb8b5fd75c in this term.
I20260709 13:18:44.732474  8068 raft_consensus.cc:740] T b3f13b31a1f84f0d89d007eadd57924c P ccd8a4c3bfe3413cb2ae219b09aea832 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
I20260709 13:18:44.735147  8111 raft_consensus.cc:493] T c4db81d9d329422bb3b4160ca4ac2d1d P b7ab4784c7344b939bc36f639286f377 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader cd75a17ab2604397adab03bb8b5fd75c)
I20260709 13:18:44.705161  8133 raft_consensus.cc:515] T 7a734b5ab7834e05a8c422208acc58b1 P b7ab4784c7344b939bc36f639286f377 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:44.734916  6725 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "711ef6523deb4cbe8ef2ba61e1c21c98"
dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
mode: GRACEFUL
new_leader_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
 from {username='slave'} at 127.0.0.1:38536
I20260709 13:18:44.758107  8075 raft_consensus.cc:493] T 22ccee1b570c4ad3a57bd7aec085b1b4 P b7ab4784c7344b939bc36f639286f377 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader cd75a17ab2604397adab03bb8b5fd75c)
I20260709 13:18:44.758368  8186 raft_consensus.cc:493] T 7887766dc6784fcaa42b35c05fea7a99 P b7ab4784c7344b939bc36f639286f377 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader cd75a17ab2604397adab03bb8b5fd75c)
I20260709 13:18:44.763556  7886 raft_consensus.cc:493] T bb7fa124c3bf4ef9ab65a407cb008441 P cd75a17ab2604397adab03bb8b5fd75c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 7ba59cc884714e8aa5f3f0ecaed84cbb)
I20260709 13:18:44.760962  8146 raft_consensus.cc:740] T 4275cf08e63345f993bce8664eada830 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
I20260709 13:18:44.732223  7934 raft_consensus.cc:515] T d8cee0accdb8499c86d4414b72565a38 P cd75a17ab2604397adab03bb8b5fd75c [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:18:44.766796  8143 raft_consensus.cc:740] T 3411566abe2d4c9bb4b2adfdd05e6f17 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
I20260709 13:18:44.797832  8157 consensus_queue.cc:260] T 4f00a2e87e56452083b759f60d461ee3 P cd75a17ab2604397adab03bb8b5fd75c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:18:44.783533  8075 raft_consensus.cc:515] T 22ccee1b570c4ad3a57bd7aec085b1b4 P b7ab4784c7344b939bc36f639286f377 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:44.791478  6725 raft_consensus.cc:606] T 711ef6523deb4cbe8ef2ba61e1c21c98 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 3 FOLLOWER]: Received request to transfer leadership to TS cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:18:44.792191  7886 raft_consensus.cc:515] T bb7fa124c3bf4ef9ab65a407cb008441 P cd75a17ab2604397adab03bb8b5fd75c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:18:44.813866  6881 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53406 (request call id 1048) took 1684 ms. Trace:
I20260709 13:18:44.775517  8111 raft_consensus.cc:515] T c4db81d9d329422bb3b4160ca4ac2d1d P b7ab4784c7344b939bc36f639286f377 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
W20260709 13:18:45.201102  6697 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:44.819151  6879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20f6842e26174571996b8dea4151d4be" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
W20260709 13:18:44.817945  8181 log.cc:927] Time spent T ce4f062dcd314d43a63ca74067cb5ee3 P ccd8a4c3bfe3413cb2ae219b09aea832: Append to log took a long time: real 0.588s	user 0.003s	sys 0.000s
I20260709 13:18:45.203256  6732 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50004 (request call id 1025) took 1959 ms. Trace:
I20260709 13:18:44.804876  6725 raft_consensus.cc:614] T 711ef6523deb4cbe8ef2ba61e1c21c98 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 3 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 13:18:44.940439  7993 consensus_meta.cc:287] T bb3d8792045a4583ae2e965b1350a5b4 P ccd8a4c3bfe3413cb2ae219b09aea832: Time spent flushing consensus metadata: real 0.651s	user 0.008s	sys 0.010s
I20260709 13:18:44.783363  8186 raft_consensus.cc:515] T 7887766dc6784fcaa42b35c05fea7a99 P b7ab4784c7344b939bc36f639286f377 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:45.203787  6732 rpcz_store.cc:276] 0709 13:18:43.244333 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:43.820896 (+576563us) service_pool.cc:224] Handling call
0709 13:18:43.839027 (+ 18131us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:18:43.858996 (+ 19969us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:43.859026 (+    30us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:18:43.873858 (+ 14832us) log.cc:844] Serialized 582 byte log entry
0709 13:18:44.045425 (+171567us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:18:44.045476 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:44.045568 (+    92us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:44.817044 (+771476us) spinlock_profiling.cc:243] Waited 34.4 ms on lock 0x7b4400022b4c. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0c745db1 00007fcc0c7e3c85 00007fcc0c7e46a2 00007fcc0f5561db 00007fcc0f551aaf 00007fcc0f54586e 00007fcc0f544bb6 00007fcc0f5447d8 00007fcc0f54e221 00007fcc0f54e1d9 00007fcc0f54e169
0709 13:18:45.202891 (+385847us) raft_consensus.cc:1685] finished
0709 13:18:45.202917 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:45.203196 (+   279us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4725,"raft.queue_time_us":21410,"raft.run_cpu_time_us":300,"raft.run_wall_time_us":6047,"spinlock_wait_cycles":79413376,"thread_start_us":126421,"threads_started":1,"wal-append.queue_time_us":239423}
I20260709 13:18:45.203233  6877 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53406 (request call id 1060) took 1168 ms. Trace:
W20260709 13:18:44.898842  6773 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:45.207543  8186 leader_election.cc:290] T 7887766dc6784fcaa42b35c05fea7a99 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:18:44.790067  8112 leader_election.cc:290] T b56bf91d90824c959e21e0cee5ba1816 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
W20260709 13:18:44.851547  6845 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:45.234211  6845 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:44.840688  6881 rpcz_store.cc:276] 0709 13:18:43.129616 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:43.247387 (+117771us) service_pool.cc:224] Handling call
0709 13:18:43.250187 (+  2800us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:44.666416 (+1416229us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:44.813468 (+147052us) spinlock_profiling.cc:243] Waited 1.39 s on lock 0x7b54000a7dd4. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f9aae01 00007fcc0f9a983e 00007fcc1496e419 00007fcc0dee5bd4 00007fcc0dee5b62 00007fcc0dee5a91 00007fcc0dee5a0c 00007fcc0dee4cc2 00007fcc0dce548c 00007fcc0dce48c6
0709 13:18:44.813748 (+   280us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3185942784}
I20260709 13:18:44.805532  8146 consensus_queue.cc:260] T 4275cf08e63345f993bce8664eada830 P ccd8a4c3bfe3413cb2ae219b09aea832 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:45.208849  7992 raft_consensus.cc:3055] T 711ef6523deb4cbe8ef2ba61e1c21c98 P cd75a17ab2604397adab03bb8b5fd75c [term 2 LEADER]: Stepping down as leader of term 2
W20260709 13:18:45.191895  8155 consensus_meta.cc:287] T e31b9971c15848dea59d4d4130141d9e P cd75a17ab2604397adab03bb8b5fd75c: Time spent flushing consensus metadata: real 0.537s	user 0.009s	sys 0.000s
I20260709 13:18:44.805696  8075 leader_election.cc:290] T 22ccee1b570c4ad3a57bd7aec085b1b4 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:18:45.206770  6877 rpcz_store.cc:276] 0709 13:18:44.034518 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:44.099823 (+ 65305us) service_pool.cc:224] Handling call
0709 13:18:45.203014 (+1103191us) spinlock_profiling.cc:243] Waited 481 ms on lock 0x7b540042ac54. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f9ae2fa 00007fcc1496fb17 00007fcc0deea6d4 00007fcc0deea662 00007fcc0deea591 00007fcc0deea50c 00007fcc0dee97c2 00007fcc0dce548c 00007fcc0dce48c6 00007fcc0dce426f
0709 13:18:45.203163 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1105968384}
I20260709 13:18:45.224831  8157 raft_consensus.cc:3060] T 4f00a2e87e56452083b759f60d461ee3 P cd75a17ab2604397adab03bb8b5fd75c [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:45.090488  6873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a485a995abc4807b6e511e45419f737" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:18:44.880352  6878 raft_consensus.cc:1240] T d8cee0accdb8499c86d4414b72565a38 P cd75a17ab2604397adab03bb8b5fd75c [term 4 FOLLOWER]: Rejecting Update request from peer b7ab4784c7344b939bc36f639286f377 for earlier term 3. Current term is 4. Ops: [3.5-3.5]
W20260709 13:18:44.802239  8122 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.691s	user 0.005s	sys 0.010s
I20260709 13:18:44.764484  6798 rpcz_store.cc:276] 0709 13:18:43.710207 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:43.712978 (+  2771us) service_pool.cc:224] Handling call
0709 13:18:43.766196 (+ 53218us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:44.218763 (+452567us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:44.721602 (+502839us) spinlock_profiling.cc:243] Waited 353 ms on lock 0x7b54001f6b54. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f9aae01 00007fcc0f9a983e 00007fcc1496e419 00007fcc0dee5bd4 00007fcc0dee5b62 00007fcc0dee5a91 00007fcc0dee5a0c 00007fcc0dee4cc2 00007fcc0dce548c 00007fcc0dce48c6
0709 13:18:44.721822 (+   220us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":811065600}
W20260709 13:18:45.063699  8210 log.cc:927] Time spent T 90d42e216d9741e190bca19a781291fd P b7ab4784c7344b939bc36f639286f377: Append to log took a long time: real 0.195s	user 0.001s	sys 0.000s
I20260709 13:18:45.258935  6881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f03d0dbf16864ca4bc1bb5e4c0334c0f" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:18:44.818095  8097 raft_consensus.cc:493] T 711ef6523deb4cbe8ef2ba61e1c21c98 P b7ab4784c7344b939bc36f639286f377 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader cd75a17ab2604397adab03bb8b5fd75c)
I20260709 13:18:45.204928  7993 raft_consensus.cc:515] T bb3d8792045a4583ae2e965b1350a5b4 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:18:45.266003  6881 raft_consensus.cc:2393] T f03d0dbf16864ca4bc1bb5e4c0334c0f P cd75a17ab2604397adab03bb8b5fd75c [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate ccd8a4c3bfe3413cb2ae219b09aea832 in current term 3: Already voted for candidate cd75a17ab2604397adab03bb8b5fd75c in this term.
W20260709 13:18:44.792361  7468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 99775.6us
I20260709 13:18:44.816107  7499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "427c124d773f483294511e80fe340075" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:18:44.792353  8180 raft_consensus.cc:515] T 3fa34c08b205435dba97346991aa1f92 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:18:44.804388  6724 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50004 (request call id 1020) took 1561 ms. Trace:
W20260709 13:18:45.186262  8206 log.cc:927] Time spent T 7ba5dac66ab5497e9e336f2a3c28cda5 P 7ba59cc884714e8aa5f3f0ecaed84cbb: Append to log took a long time: real 0.221s	user 0.001s	sys 0.000s
I20260709 13:18:45.210260  8133 leader_election.cc:290] T 7a734b5ab7834e05a8c422208acc58b1 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:18:45.249934  6879 raft_consensus.cc:2468] T 20f6842e26174571996b8dea4151d4be P cd75a17ab2604397adab03bb8b5fd75c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 3.
W20260709 13:18:45.257874  8122 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.152s	user 0.006s	sys 0.026s
I20260709 13:18:45.233568  7883 raft_consensus.cc:493] T 8c7f33e544204fbaac4078e3e83bbf4e P b7ab4784c7344b939bc36f639286f377 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:45.260406  6877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c7f33e544204fbaac4078e3e83bbf4e" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:18:44.802888  8143 consensus_queue.cc:260] T 3411566abe2d4c9bb4b2adfdd05e6f17 P ccd8a4c3bfe3413cb2ae219b09aea832 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:45.209772  8111 leader_election.cc:290] T c4db81d9d329422bb3b4160ca4ac2d1d P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:18:45.232560  7934 leader_election.cc:290] T d8cee0accdb8499c86d4414b72565a38 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 4 election: Requested vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:18:45.239274  8186 raft_consensus.cc:493] T 20f6842e26174571996b8dea4151d4be P b7ab4784c7344b939bc36f639286f377 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:45.237136  7992 raft_consensus.cc:740] T 711ef6523deb4cbe8ef2ba61e1c21c98 P cd75a17ab2604397adab03bb8b5fd75c [term 2 LEADER]: Becoming Follower/Learner. State: Replica: cd75a17ab2604397adab03bb8b5fd75c, State: Running, Role: LEADER
W20260709 13:18:45.243709  8034 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.362s	user 0.014s	sys 0.024s
I20260709 13:18:45.256356  8075 raft_consensus.cc:493] T f5be3a11b23d4ea9b08300a2789821c7 P b7ab4784c7344b939bc36f639286f377 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader cd75a17ab2604397adab03bb8b5fd75c)
I20260709 13:18:45.278827  6877 raft_consensus.cc:2393] T 8c7f33e544204fbaac4078e3e83bbf4e P cd75a17ab2604397adab03bb8b5fd75c [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ccd8a4c3bfe3413cb2ae219b09aea832 in current term 2: Already voted for candidate cd75a17ab2604397adab03bb8b5fd75c in this term.
I20260709 13:18:44.879951  8068 consensus_queue.cc:260] T b3f13b31a1f84f0d89d007eadd57924c P ccd8a4c3bfe3413cb2ae219b09aea832 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:18:45.281960  6879 raft_consensus.cc:1275] T de3186201e1a40d0b335eeb8b4e256e0 P cd75a17ab2604397adab03bb8b5fd75c [term 3 FOLLOWER]: Refusing update from remote peer ccd8a4c3bfe3413cb2ae219b09aea832: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
I20260709 13:18:45.282377  6881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "427c124d773f483294511e80fe340075" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:18:45.310168  6879 pending_rounds.cc:85] T de3186201e1a40d0b335eeb8b4e256e0 P cd75a17ab2604397adab03bb8b5fd75c: Aborting all ops after (but not including) 1
I20260709 13:18:45.265946  8097 raft_consensus.cc:515] T 711ef6523deb4cbe8ef2ba61e1c21c98 P b7ab4784c7344b939bc36f639286f377 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:45.310721  6881 raft_consensus.cc:2468] T 427c124d773f483294511e80fe340075 P cd75a17ab2604397adab03bb8b5fd75c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 2.
W20260709 13:18:45.308401  8034 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.435s	user 0.016s	sys 0.025s
I20260709 13:18:45.274508  8146 raft_consensus.cc:3060] T 4275cf08e63345f993bce8664eada830 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:45.275002  7499 raft_consensus.cc:2468] T 427c124d773f483294511e80fe340075 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 2.
I20260709 13:18:45.331422  7499 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50756 (request call id 97) took 1493 ms. Trace:
I20260709 13:18:45.331890  7499 rpcz_store.cc:276] 0709 13:18:43.838462 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:44.815658 (+977196us) service_pool.cc:224] Handling call
0709 13:18:45.331341 (+515683us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:45.282111  8111 raft_consensus.cc:493] T 404190ce4ce94cecbfcb6ea9d1dd8626 P b7ab4784c7344b939bc36f639286f377 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 7ba59cc884714e8aa5f3f0ecaed84cbb)
I20260709 13:18:45.333382  8111 raft_consensus.cc:515] T 404190ce4ce94cecbfcb6ea9d1dd8626 P b7ab4784c7344b939bc36f639286f377 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:18:45.318580  6879 pending_rounds.cc:107] T de3186201e1a40d0b335eeb8b4e256e0 P cd75a17ab2604397adab03bb8b5fd75c: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 13:18:45.339916  6879 raft_consensus.cc:2889] T de3186201e1a40d0b335eeb8b4e256e0 P cd75a17ab2604397adab03bb8b5fd75c [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:18:45.323539  7501 raft_consensus.cc:1240] T 3fa34c08b205435dba97346991aa1f92 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 4 FOLLOWER]: Rejecting Update request from peer ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 3. Current term is 4. Ops: [3.5-3.5]
I20260709 13:18:45.281204  7886 leader_election.cc:290] T bb7fa124c3bf4ef9ab65a407cb008441 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:18:45.346055  6879 raft_consensus.cc:1240] T 90d42e216d9741e190bca19a781291fd P cd75a17ab2604397adab03bb8b5fd75c [term 4 FOLLOWER]: Rejecting Update request from peer ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 13:18:45.304176  8186 raft_consensus.cc:515] T 20f6842e26174571996b8dea4151d4be P b7ab4784c7344b939bc36f639286f377 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:45.311280  8075 raft_consensus.cc:515] T f5be3a11b23d4ea9b08300a2789821c7 P b7ab4784c7344b939bc36f639286f377 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:45.340378  8143 raft_consensus.cc:3060] T 3411566abe2d4c9bb4b2adfdd05e6f17 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:45.279985  7883 raft_consensus.cc:515] T 8c7f33e544204fbaac4078e3e83bbf4e P b7ab4784c7344b939bc36f639286f377 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:45.346197  8068 raft_consensus.cc:3060] T b3f13b31a1f84f0d89d007eadd57924c P ccd8a4c3bfe3413cb2ae219b09aea832 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:45.367465  8075 leader_election.cc:290] T f5be3a11b23d4ea9b08300a2789821c7 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:18:45.374557  6732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "427c124d773f483294511e80fe340075" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:18:45.377102  6732 raft_consensus.cc:2410] T 427c124d773f483294511e80fe340075 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7ab4784c7344b939bc36f639286f377 for term 3 because replica has last-logged OpId of term: 1 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 2.
W20260709 13:18:45.385159  8172 log.cc:927] Time spent T dbdf895bba214ff68685a24fd17dfb5d P ccd8a4c3bfe3413cb2ae219b09aea832: Append to log took a long time: real 1.463s	user 0.009s	sys 0.024s
I20260709 13:18:45.364647  8111 leader_election.cc:290] T 404190ce4ce94cecbfcb6ea9d1dd8626 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:18:45.375274  8201 raft_consensus.cc:493] T be1a92657f494cac8dd227d152f50151 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 7ba59cc884714e8aa5f3f0ecaed84cbb)
I20260709 13:18:45.393262  6732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3411566abe2d4c9bb4b2adfdd05e6f17" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:18:45.396783  6723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30e88460611e47b2ba16a46a30b5f416" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:18:45.398162  6875 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53416 (request call id 1860) took 1855 ms. Trace:
I20260709 13:18:45.398732  6875 rpcz_store.cc:276] 0709 13:18:43.542949 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:43.584490 (+ 41541us) service_pool.cc:224] Handling call
0709 13:18:43.597477 (+ 12987us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:43.881065 (+283588us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:43.881104 (+    39us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:43.881147 (+    43us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:18:43.881184 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:45.397826 (+1516642us) spinlock_profiling.cc:243] Waited 283 ms on lock 0x7b54000a6ed4. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f9aae01 00007fcc0f9a983e 00007fcc1496e419 00007fcc0dee5bd4 00007fcc0dee5b62 00007fcc0dee5a91 00007fcc0dee5a0c 00007fcc0dee4cc2 00007fcc0dce548c 00007fcc0dce48c6
0709 13:18:45.397894 (+    68us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:45.398078 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":651706752}
W20260709 13:18:45.408733  8213 log.cc:927] Time spent T 3a485a995abc4807b6e511e45419f737 P b7ab4784c7344b939bc36f639286f377: Append to log took a long time: real 0.089s	user 0.000s	sys 0.001s
W20260709 13:18:45.409345  6695 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:45.412828  8215 log.cc:927] Time spent T 7ba5dac66ab5497e9e336f2a3c28cda5 P cd75a17ab2604397adab03bb8b5fd75c: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260709 13:18:45.413203  8068 raft_consensus.cc:493] T f5be3a11b23d4ea9b08300a2789821c7 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader cd75a17ab2604397adab03bb8b5fd75c)
I20260709 13:18:45.413914  8069 raft_consensus.cc:493] T d33d5ee8ef6f415593d8df52063161ad P ccd8a4c3bfe3413cb2ae219b09aea832 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:18:45.414116  8068 raft_consensus.cc:515] T f5be3a11b23d4ea9b08300a2789821c7 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:45.414573  8069 raft_consensus.cc:515] T d33d5ee8ef6f415593d8df52063161ad P ccd8a4c3bfe3413cb2ae219b09aea832 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:45.272202  6724 rpcz_store.cc:276] 0709 13:18:43.242819 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:43.817550 (+574731us) service_pool.cc:224] Handling call
0709 13:18:43.817878 (+   328us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:43.865172 (+ 47294us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:43.872232 (+  7060us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:43.875706 (+  3474us) log.cc:844] Serialized 26 byte log entry
0709 13:18:44.026790 (+151084us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:18:44.038328 (+ 11538us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:44.047637 (+  9309us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:44.711129 (+663492us) spinlock_profiling.cc:243] Waited 4.8 ms on lock 0x7b4400022b4c. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0c745db1 00007fcc0c7e3c85 00007fcc0c7e46a2 00007fcc0f5561db 00007fcc0f551aaf 00007fcc0f54586e 00007fcc0f544bb6 00007fcc0f5447d8 00007fcc0f54e221 00007fcc0f54e1d9 00007fcc0f54e169
0709 13:18:44.803916 (+ 92787us) raft_consensus.cc:1685] finished
0709 13:18:44.803943 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:44.804299 (+   356us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":33012,"raft.run_cpu_time_us":170,"raft.run_wall_time_us":6982,"spinlock_wait_cycles":11050880,"thread_start_us":135221,"threads_started":1,"wal-append.queue_time_us":204506}
I20260709 13:18:45.413164  8094 raft_consensus.cc:493] T 7887766dc6784fcaa42b35c05fea7a99 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader cd75a17ab2604397adab03bb8b5fd75c)
I20260709 13:18:45.416500  6725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90d42e216d9741e190bca19a781291fd" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:18:45.417891  8069 leader_election.cc:290] T d33d5ee8ef6f415593d8df52063161ad P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:18:45.418650  7993 leader_election.cc:290] T bb3d8792045a4583ae2e965b1350a5b4 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 4 election: Requested vote from peers cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:18:45.416684  8094 raft_consensus.cc:515] T 7887766dc6784fcaa42b35c05fea7a99 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:45.420697  8180 leader_election.cc:290] T 3fa34c08b205435dba97346991aa1f92 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 4 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:18:45.423246  8186 leader_election.cc:290] T 20f6842e26174571996b8dea4151d4be P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:18:45.426543  6723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1704639a875409b9959353527b3fd68" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:18:45.427475  6723 raft_consensus.cc:2468] T a1704639a875409b9959353527b3fd68 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 3.
I20260709 13:18:45.388283  8201 raft_consensus.cc:515] T be1a92657f494cac8dd227d152f50151 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:18:45.428578  8068 leader_election.cc:290] T f5be3a11b23d4ea9b08300a2789821c7 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
W20260709 13:18:45.429441  7466 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 221482us
I20260709 13:18:45.470906  6802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "427c124d773f483294511e80fe340075" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:18:45.471733  6802 raft_consensus.cc:2468] T 427c124d773f483294511e80fe340075 P b7ab4784c7344b939bc36f639286f377 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 2.
I20260709 13:18:45.473694  6807 raft_consensus.cc:1275] T 20f6842e26174571996b8dea4151d4be P b7ab4784c7344b939bc36f639286f377 [term 3 FOLLOWER]: Refusing update from remote peer ccd8a4c3bfe3413cb2ae219b09aea832: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:18:45.476707  6807 raft_consensus.cc:1275] T 7a734b5ab7834e05a8c422208acc58b1 P b7ab4784c7344b939bc36f639286f377 [term 3 FOLLOWER]: Refusing update from remote peer ccd8a4c3bfe3413cb2ae219b09aea832: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:18:45.480067  6730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34f36d59d88f40fe8a2805e604fc6c0a" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:18:45.423623  8094 leader_election.cc:290] T 7887766dc6784fcaa42b35c05fea7a99 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
W20260709 13:18:45.492714  6695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 59581.6us
I20260709 13:18:45.355262  7992 consensus_queue.cc:260] T 711ef6523deb4cbe8ef2ba61e1c21c98 P cd75a17ab2604397adab03bb8b5fd75c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:45.426054  8151 raft_consensus.cc:493] T a3022224cc81473690653a83d4e99470 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:45.498735  7503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3d8792045a4583ae2e965b1350a5b4" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb"
I20260709 13:18:45.428741  8100 raft_consensus.cc:493] T 17587d6730594da4a56fa13a353232a1 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:18:45.502697  6800 raft_consensus.cc:1240] T 1bf4668eeb70467fb3dc5a0289233b3c P b7ab4784c7344b939bc36f639286f377 [term 3 FOLLOWER]: Rejecting Update request from peer ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 2. Current term is 3. Ops: []
I20260709 13:18:45.507614  6695 leader_election.cc:304] T b56bf91d90824c959e21e0cee5ba1816 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:18:45.509112  6695 leader_election.cc:304] T 711ef6523deb4cbe8ef2ba61e1c21c98 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:18:45.510385  6695 leader_election.cc:304] T 713b5728a197487c9300b310ab94e5a3 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:18:45.512094  6805 raft_consensus.cc:1275] T de3186201e1a40d0b335eeb8b4e256e0 P b7ab4784c7344b939bc36f639286f377 [term 3 FOLLOWER]: Refusing update from remote peer ccd8a4c3bfe3413cb2ae219b09aea832: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
W20260709 13:18:45.491523  8208 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.579s	user 0.023s	sys 0.049s
I20260709 13:18:45.516533  6806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f9c2e2bf644115957398fe4c9459db" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:18:45.479993  8075 raft_consensus.cc:493] T ab432e62819d499eaaf3dd55481dd930 P b7ab4784c7344b939bc36f639286f377 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:45.516819  6695 leader_election.cc:304] T 22ccee1b570c4ad3a57bd7aec085b1b4 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:18:45.499445  8074 raft_consensus.cc:493] T f3f9c2e2bf644115957398fe4c9459db P b7ab4784c7344b939bc36f639286f377 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader cd75a17ab2604397adab03bb8b5fd75c)
I20260709 13:18:45.498252  8167 raft_consensus.cc:3060] T 713b5728a197487c9300b310ab94e5a3 P cd75a17ab2604397adab03bb8b5fd75c [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:18:45.521752  8208 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.621s	user 0.024s	sys 0.049s
I20260709 13:18:45.530318  6695 leader_election.cc:304] T c4db81d9d329422bb3b4160ca4ac2d1d P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:18:45.505793  7497 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50744 (request call id 101) took 2975 ms. Trace:
I20260709 13:18:45.515101  6725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09c2a98de1a4decabd0ff900dd44caa" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:18:45.519871  7992 raft_consensus.cc:3060] T 711ef6523deb4cbe8ef2ba61e1c21c98 P cd75a17ab2604397adab03bb8b5fd75c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:45.543823  6695 leader_election.cc:304] T 427c124d773f483294511e80fe340075 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
I20260709 13:18:45.523757  8068 raft_consensus.cc:2749] T 711ef6523deb4cbe8ef2ba61e1c21c98 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:18:45.523538  8147 raft_consensus.cc:2749] T b56bf91d90824c959e21e0cee5ba1816 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:18:45.547667  8066 raft_consensus.cc:2804] T 427c124d773f483294511e80fe340075 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:18:45.527818  8094 raft_consensus.cc:2804] T 713b5728a197487c9300b310ab94e5a3 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 3 FOLLOWER]: Leader election won for term 3
W20260709 13:18:45.550590  6844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:45.555583  6844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:45.531212  8069 raft_consensus.cc:2749] T 22ccee1b570c4ad3a57bd7aec085b1b4 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:18:45.557379  7503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "404190ce4ce94cecbfcb6ea9d1dd8626" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:18:45.506965  8151 raft_consensus.cc:515] T a3022224cc81473690653a83d4e99470 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:45.526981  7938 consensus_queue.cc:1048] T e77e330a82df4b43a745d57a68f6f057 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.026s
I20260709 13:18:45.521283  8100 raft_consensus.cc:515] T 17587d6730594da4a56fa13a353232a1 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:18:45.548974  7993 raft_consensus.cc:2749] T c4db81d9d329422bb3b4160ca4ac2d1d P ccd8a4c3bfe3413cb2ae219b09aea832 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:18:45.551633  6727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d65025eea89441290d85dd053810e31" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:18:45.532927  8075 raft_consensus.cc:515] T ab432e62819d499eaaf3dd55481dd930 P b7ab4784c7344b939bc36f639286f377 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:45.553897  6803 raft_consensus.cc:1240] T 90d42e216d9741e190bca19a781291fd P b7ab4784c7344b939bc36f639286f377 [term 4 LEADER]: Rejecting Update request from peer ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 13:18:45.580430  6844 leader_election.cc:304] T dbdf895bba214ff68685a24fd17dfb5d P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:18:45.578651  6872 raft_consensus.cc:1240] T f4b8bd455d5a47c18a1380839c6e0d61 P cd75a17ab2604397adab03bb8b5fd75c [term 2 FOLLOWER]: Rejecting Update request from peer ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 1. Current term is 2. Ops: []
I20260709 13:18:45.554924  8066 raft_consensus.cc:493] T 427c124d773f483294511e80fe340075 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:45.564005  8186 raft_consensus.cc:493] T 7ba5dac66ab5497e9e336f2a3c28cda5 P b7ab4784c7344b939bc36f639286f377 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:45.591475  6844 leader_election.cc:304] T 7a734b5ab7834e05a8c422208acc58b1 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:18:45.540226  8074 raft_consensus.cc:515] T f3f9c2e2bf644115957398fe4c9459db P b7ab4784c7344b939bc36f639286f377 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:45.566327  8085 raft_consensus.cc:493] T bd6869f07b5a4885a0b99fbe60c3b175 P cd75a17ab2604397adab03bb8b5fd75c [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:45.593185  6872 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53416 (request call id 1873) took 1826 ms. Trace:
I20260709 13:18:45.639708  6723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a734b5ab7834e05a8c422208acc58b1" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:18:45.567162  7934 raft_consensus.cc:493] T 9b3759de40694069b13c0f8bd40e5709 P cd75a17ab2604397adab03bb8b5fd75c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:18:45.585093  6725 raft_consensus.cc:2410] T f09c2a98de1a4decabd0ff900dd44caa P ccd8a4c3bfe3413cb2ae219b09aea832 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7ab4784c7344b939bc36f639286f377 for term 4 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:18:45.567517  8094 raft_consensus.cc:697] T 713b5728a197487c9300b310ab94e5a3 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 3 LEADER]: Becoming Leader. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
W20260709 13:18:45.635274  6695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 82471.2us
I20260709 13:18:45.566895  7886 raft_consensus.cc:493] T 34f36d59d88f40fe8a2805e604fc6c0a P cd75a17ab2604397adab03bb8b5fd75c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:18:45.581903  8155 raft_consensus.cc:493] T 7c37d41cd9164c15a6826ca62a851a69 P cd75a17ab2604397adab03bb8b5fd75c [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:45.652917  6723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22ccee1b570c4ad3a57bd7aec085b1b4" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:18:45.641324  8224 raft_consensus.cc:493] T be1a92657f494cac8dd227d152f50151 P b7ab4784c7344b939bc36f639286f377 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 7ba59cc884714e8aa5f3f0ecaed84cbb)
I20260709 13:18:45.665555  8224 raft_consensus.cc:515] T be1a92657f494cac8dd227d152f50151 P b7ab4784c7344b939bc36f639286f377 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:18:45.666960  7498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be1a92657f494cac8dd227d152f50151" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:18:45.644440  8085 raft_consensus.cc:515] T bd6869f07b5a4885a0b99fbe60c3b175 P cd75a17ab2604397adab03bb8b5fd75c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:45.670934  8085 leader_election.cc:290] T bd6869f07b5a4885a0b99fbe60c3b175 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:18:45.672499  8223 consensus_queue.cc:1048] T 2c240553ce044eedb41541d72b9475d7 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:18:45.668282  8094 consensus_queue.cc:237] T 713b5728a197487c9300b310ab94e5a3 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:45.675988  6725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbdf895bba214ff68685a24fd17dfb5d" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:18:45.677781  6725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "404190ce4ce94cecbfcb6ea9d1dd8626" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:18:45.640067  6872 rpcz_store.cc:276] 0709 13:18:43.766575 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:43.948882 (+182307us) service_pool.cc:224] Handling call
0709 13:18:45.569354 (+1620472us) spinlock_profiling.cc:243] Waited 4.95 ms on lock 0x7b5800147c98. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0c745db1 00007fcc0c885b71 00007fcc0c885a22 00007fcc1579ec09 00007fcc148f8ee0 00007fcc149c20ab 00007fcc149c2131 00007fcc14983fc0 00007fcc1496e929 00007fcc1496e3d2 00007fcc0dee5bd4
0709 13:18:45.569573 (+   219us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:45.592905 (+ 23332us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:45.593129 (+   224us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":11379072}
W20260709 13:18:45.642064  6770 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 49758.2us
W20260709 13:18:45.643930  6845 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:45.594673  7883 leader_election.cc:290] T 8c7f33e544204fbaac4078e3e83bbf4e P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:18:45.651868  6806 raft_consensus.cc:3060] T f3f9c2e2bf644115957398fe4c9459db P b7ab4784c7344b939bc36f639286f377 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:45.594861  8066 raft_consensus.cc:3060] T 427c124d773f483294511e80fe340075 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:45.653934  6723 raft_consensus.cc:2393] T 22ccee1b570c4ad3a57bd7aec085b1b4 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7ab4784c7344b939bc36f639286f377 in current term 3: Already voted for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in this term.
I20260709 13:18:45.564976  8068 consensus_queue.cc:1048] T 20f6842e26174571996b8dea4151d4be P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.030s
I20260709 13:18:45.591531  6727 raft_consensus.cc:2468] T 3d65025eea89441290d85dd053810e31 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 1.
I20260709 13:18:45.656019  7886 raft_consensus.cc:515] T 34f36d59d88f40fe8a2805e604fc6c0a P cd75a17ab2604397adab03bb8b5fd75c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
W20260709 13:18:45.656567  7468 leader_election.cc:336] T 7ba5dac66ab5497e9e336f2a3c28cda5 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931): Timed out: RequestConsensusVote RPC to 127.5.126.67:42931 timed out after 1.577s (SENT)
I20260709 13:18:45.660912  6801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c240553ce044eedb41541d72b9475d7" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:18:45.643018  8186 raft_consensus.cc:515] T 7ba5dac66ab5497e9e336f2a3c28cda5 P b7ab4784c7344b939bc36f639286f377 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:18:45.636234  8122 raft_consensus.cc:493] T e31b9971c15848dea59d4d4130141d9e P b7ab4784c7344b939bc36f639286f377 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:45.541618  7497 rpcz_store.cc:276] 0709 13:18:42.586203 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:42.595589 (+  9386us) service_pool.cc:224] Handling call
0709 13:18:42.596089 (+   500us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:42.653869 (+ 57780us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:42.657467 (+  3598us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:42.686753 (+ 29286us) log.cc:844] Serialized 26 byte log entry
0709 13:18:43.815784 (+1129031us) spinlock_profiling.cc:243] Waited 10.9 ms on lock 0x7b18002cc680. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc15785de1 00007fcc157925b1 00007fcc0c89fe07 00007fcc156faab9 00007fcc0c8bc69b 00007fcc0c8ba93f 00007fcc0c8bcc02 00007fcc0f54420b 00007fcc0f549d23 00007fcc0f54a0d1 00007fcc0f965a0f
0709 13:18:43.962085 (+146301us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:18:43.980427 (+ 18342us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:44.009603 (+ 29176us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:45.428593 (+1418990us) spinlock_profiling.cc:243] Waited 18.8 ms on lock 0x7b54004d5ba0. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f91fdbe 00007fcc0f92a930 00007fcc0f92a8d8 00007fcc0f92a858 00007fcc0f92a813 00007fcc0f929a9c 00007fcc15815626 00007fcc1580fdd8 00007fcc0f9667cb 00007fcc0f9692c0
0709 13:18:45.467458 (+ 38865us) raft_consensus.cc:1685] finished
0709 13:18:45.479189 (+ 11731us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:45.501743 (+ 22554us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":84338,"raft.run_cpu_time_us":243,"raft.run_wall_time_us":43961,"spinlock_wait_cycles":68427264,"thread_start_us":143095,"threads_started":2,"wal-append.queue_time_us":1276908}
I20260709 13:18:45.633533  8112 raft_consensus.cc:2749] T dbdf895bba214ff68685a24fd17dfb5d P cd75a17ab2604397adab03bb8b5fd75c [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:18:45.638230  8134 consensus_queue.cc:1048] T b56bf91d90824c959e21e0cee5ba1816 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.026s
I20260709 13:18:45.664839  8201 leader_election.cc:290] T be1a92657f494cac8dd227d152f50151 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
W20260709 13:18:45.682224  6845 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:45.723019  6726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1528ab62b6fe4e3099d08f141afee116" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:18:45.723803  6726 raft_consensus.cc:2468] T 1528ab62b6fe4e3099d08f141afee116 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 3.
I20260709 13:18:45.724171  8122 raft_consensus.cc:515] T e31b9971c15848dea59d4d4130141d9e P b7ab4784c7344b939bc36f639286f377 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:45.724918  6726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f03d0dbf16864ca4bc1bb5e4c0334c0f" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:18:45.726344  6726 raft_consensus.cc:3055] T 90d42e216d9741e190bca19a781291fd P ccd8a4c3bfe3413cb2ae219b09aea832 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:18:45.726450  8122 leader_election.cc:290] T e31b9971c15848dea59d4d4130141d9e P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:18:45.726838  6726 raft_consensus.cc:740] T 90d42e216d9741e190bca19a781291fd P ccd8a4c3bfe3413cb2ae219b09aea832 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
I20260709 13:18:45.648911  7934 raft_consensus.cc:515] T 9b3759de40694069b13c0f8bd40e5709 P cd75a17ab2604397adab03bb8b5fd75c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:45.693056  6807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7887766dc6784fcaa42b35c05fea7a99" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:18:45.733001  6807 raft_consensus.cc:2468] T 7887766dc6784fcaa42b35c05fea7a99 P b7ab4784c7344b939bc36f639286f377 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 2.
W20260709 13:18:45.695106  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 103714us
I20260709 13:18:45.671854  8085 raft_consensus.cc:2749] T 7a734b5ab7834e05a8c422208acc58b1 P cd75a17ab2604397adab03bb8b5fd75c [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:18:45.699019  6800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5be3a11b23d4ea9b08300a2789821c7" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:18:45.702715  6723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4db81d9d329422bb3b4160ca4ac2d1d" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:18:45.688642  8069 consensus_queue.cc:1059] T 1bf4668eeb70467fb3dc5a0289233b3c P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.013s
I20260709 13:18:45.706888  6731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5be3a11b23d4ea9b08300a2789821c7" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:18:45.714793  6799 raft_consensus.cc:1275] T 07a92dd554674067a83a9cb68c4773f2 P b7ab4784c7344b939bc36f639286f377 [term 3 FOLLOWER]: Refusing update from remote peer ccd8a4c3bfe3413cb2ae219b09aea832: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:18:45.737746  6731 raft_consensus.cc:2468] T f5be3a11b23d4ea9b08300a2789821c7 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 3.
I20260709 13:18:45.717834  6727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7887766dc6784fcaa42b35c05fea7a99" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:18:45.739310  6731 raft_consensus.cc:1275] T 7c37d41cd9164c15a6826ca62a851a69 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 2 FOLLOWER]: Refusing update from remote peer b7ab4784c7344b939bc36f639286f377: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:18:45.739640  6727 raft_consensus.cc:2468] T 7887766dc6784fcaa42b35c05fea7a99 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 2.
I20260709 13:18:45.741030  8075 leader_election.cc:290] T ab432e62819d499eaaf3dd55481dd930 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:18:45.742461  8151 leader_election.cc:290] T a3022224cc81473690653a83d4e99470 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
W20260709 13:18:45.737396  8219 log.cc:927] Time spent T 4d9def8b32fd443aa94ab1420b06837b P ccd8a4c3bfe3413cb2ae219b09aea832: Append to log took a long time: real 0.195s	user 0.000s	sys 0.001s
W20260709 13:18:45.744239  8183 log.cc:927] Time spent T 07a92dd554674067a83a9cb68c4773f2 P ccd8a4c3bfe3413cb2ae219b09aea832: Append to log took a long time: real 1.517s	user 0.009s	sys 0.005s
I20260709 13:18:45.745253  6732 raft_consensus.cc:2468] T 3411566abe2d4c9bb4b2adfdd05e6f17 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 2.
I20260709 13:18:45.684065  8155 raft_consensus.cc:515] T 7c37d41cd9164c15a6826ca62a851a69 P cd75a17ab2604397adab03bb8b5fd75c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:45.678798  7993 consensus_queue.cc:1048] T 7a734b5ab7834e05a8c422208acc58b1 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.031s
I20260709 13:18:45.721028  8169 raft_consensus.cc:3055] T ab432e62819d499eaaf3dd55481dd930 P cd75a17ab2604397adab03bb8b5fd75c [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:18:45.722067  6877 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53416 (request call id 1888) took 1008 ms. Trace:
I20260709 13:18:45.643468  8133 raft_consensus.cc:493] T e77e330a82df4b43a745d57a68f6f057 P b7ab4784c7344b939bc36f639286f377 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:45.692515  6802 raft_consensus.cc:1240] T 9b3759de40694069b13c0f8bd40e5709 P b7ab4784c7344b939bc36f639286f377 [term 3 FOLLOWER]: Rejecting Update request from peer ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 2. Current term is 3. Ops: []
I20260709 13:18:45.735401  6800 raft_consensus.cc:2468] T f5be3a11b23d4ea9b08300a2789821c7 P b7ab4784c7344b939bc36f639286f377 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 3.
I20260709 13:18:45.735589  6723 raft_consensus.cc:2393] T c4db81d9d329422bb3b4160ca4ac2d1d P ccd8a4c3bfe3413cb2ae219b09aea832 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7ab4784c7344b939bc36f639286f377 in current term 3: Already voted for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in this term.
I20260709 13:18:45.736347  6844 leader_election.cc:304] T 30e88460611e47b2ba16a46a30b5f416 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:18:45.685370  6725 raft_consensus.cc:2468] T 404190ce4ce94cecbfcb6ea9d1dd8626 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 3.
W20260709 13:18:45.741217  6847 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:45.762398  6844 leader_election.cc:304] T 07a92dd554674067a83a9cb68c4773f2 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:18:45.719283  6879 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53416 (request call id 1890) took 1004 ms. Trace:
I20260709 13:18:45.719622  8115 leader_election.cc:290] T 9e326172347f45e99a0d482b5d8ef768 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:18:45.757045  6877 rpcz_store.cc:276] 0709 13:18:44.713466 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:45.320926 (+607460us) service_pool.cc:224] Handling call
0709 13:18:45.324351 (+  3425us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:45.331651 (+  7300us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:45.331679 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:45.333979 (+  2300us) log.cc:844] Serialized 26 byte log entry
0709 13:18:45.503329 (+169350us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:18:45.503389 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:45.503484 (+    95us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:45.721774 (+218290us) raft_consensus.cc:1685] finished
0709 13:18:45.721811 (+    37us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:45.722000 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":834,"raft.run_cpu_time_us":138,"raft.run_wall_time_us":140,"thread_start_us":168891,"threads_started":1,"wal-append.queue_time_us":246579}
I20260709 13:18:45.770095  6877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a734b5ab7834e05a8c422208acc58b1" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:18:45.771056  6877 raft_consensus.cc:2468] T 7a734b5ab7834e05a8c422208acc58b1 P cd75a17ab2604397adab03bb8b5fd75c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 3.
I20260709 13:18:45.749223  8186 leader_election.cc:290] T 7ba5dac66ab5497e9e336f2a3c28cda5 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:18:45.715832  8224 leader_election.cc:290] T be1a92657f494cac8dd227d152f50151 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:18:45.700467  7468 leader_election.cc:304] T 7ba5dac66ab5497e9e336f2a3c28cda5 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:18:45.764390  6872 raft_consensus.cc:1275] T bd6869f07b5a4885a0b99fbe60c3b175 P cd75a17ab2604397adab03bb8b5fd75c [term 5 FOLLOWER]: Refusing update from remote peer b7ab4784c7344b939bc36f639286f377: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 5 index: 2. (index mismatch)
W20260709 13:18:45.772781  6845 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:45.763929  6879 rpcz_store.cc:276] 0709 13:18:44.714644 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:45.348979 (+634335us) service_pool.cc:224] Handling call
0709 13:18:45.349787 (+   808us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:45.350305 (+   518us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:45.350348 (+    43us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:45.356484 (+  6136us) log.cc:844] Serialized 26 byte log entry
0709 13:18:45.563071 (+206587us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:18:45.563157 (+    86us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:45.563273 (+   116us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:45.718919 (+155646us) raft_consensus.cc:1685] finished
0709 13:18:45.718953 (+    34us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:45.719190 (+   237us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":421,"raft.run_cpu_time_us":146,"raft.run_wall_time_us":3035,"thread_start_us":187260,"threads_started":1,"wal-append.queue_time_us":271321}
I20260709 13:18:45.779731  6877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22ccee1b570c4ad3a57bd7aec085b1b4" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:18:45.727775  6726 consensus_queue.cc:260] T 90d42e216d9741e190bca19a781291fd P ccd8a4c3bfe3413cb2ae219b09aea832 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:45.781718  6877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de3186201e1a40d0b335eeb8b4e256e0" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:18:45.814754  6875 raft_consensus.cc:1240] T f58dc08b12a2494bb9a1372837970ca2 P cd75a17ab2604397adab03bb8b5fd75c [term 4 FOLLOWER]: Rejecting Update request from peer b7ab4784c7344b939bc36f639286f377 for earlier term 3. Current term is 4. Ops: []
I20260709 13:18:45.705989  8230 consensus_queue.cc:1048] T d8292e16e5654be6bc408560cf256aaa P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.065s
I20260709 13:18:45.829447  8238 raft_consensus.cc:2749] T 7ba5dac66ab5497e9e336f2a3c28cda5 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 3 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:18:45.756440  8169 raft_consensus.cc:740] T ab432e62819d499eaaf3dd55481dd930 P cd75a17ab2604397adab03bb8b5fd75c [term 2 LEADER]: Becoming Follower/Learner. State: Replica: cd75a17ab2604397adab03bb8b5fd75c, State: Running, Role: LEADER
I20260709 13:18:45.775352  8085 raft_consensus.cc:493] T ce4f062dcd314d43a63ca74067cb5ee3 P cd75a17ab2604397adab03bb8b5fd75c [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:45.775843  8157 raft_consensus.cc:2749] T 30e88460611e47b2ba16a46a30b5f416 P cd75a17ab2604397adab03bb8b5fd75c [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:18:45.783037  8236 raft_consensus.cc:2749] T 07a92dd554674067a83a9cb68c4773f2 P cd75a17ab2604397adab03bb8b5fd75c [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:18:45.783314  6806 raft_consensus.cc:2468] T f3f9c2e2bf644115957398fe4c9459db P b7ab4784c7344b939bc36f639286f377 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 3.
I20260709 13:18:45.837304  6877 raft_consensus.cc:2468] T de3186201e1a40d0b335eeb8b4e256e0 P cd75a17ab2604397adab03bb8b5fd75c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 3.
W20260709 13:18:45.836222  6695 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:45.816134  6872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4db81d9d329422bb3b4160ca4ac2d1d" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:18:45.847942  6730 raft_consensus.cc:1240] T 4d9def8b32fd443aa94ab1420b06837b P ccd8a4c3bfe3413cb2ae219b09aea832 [term 3 LEADER]: Rejecting Update request from peer b7ab4784c7344b939bc36f639286f377 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 13:18:45.816624  6801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3022224cc81473690653a83d4e99470" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:18:45.816788  8074 leader_election.cc:290] T f3f9c2e2bf644115957398fe4c9459db P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:18:45.785571  8115 consensus_queue.cc:1059] T ab432e62819d499eaaf3dd55481dd930 P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.051s
I20260709 13:18:45.767045  8133 raft_consensus.cc:515] T e77e330a82df4b43a745d57a68f6f057 P b7ab4784c7344b939bc36f639286f377 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } }
W20260709 13:18:45.839922  7468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 183388us
I20260709 13:18:45.847100  8085 raft_consensus.cc:515] T ce4f062dcd314d43a63ca74067cb5ee3 P cd75a17ab2604397adab03bb8b5fd75c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } attrs { replace: true } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
W20260709 13:18:45.877818  8226 log.cc:927] Time spent T 4b8cacb381b746da8d0049b0a83b41dd P cd75a17ab2604397adab03bb8b5fd75c: Append to log took a long time: real 0.100s	user 0.000s	sys 0.001s
I20260709 13:18:45.879541  6881 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53416 (request call id 1887) took 1166 ms. Trace:
W20260709 13:18:45.881003  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 112540us
I20260709 13:18:45.881531  6875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7887766dc6784fcaa42b35c05fea7a99" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:18:45.884115  6844 leader_election.cc:304] T e77e330a82df4b43a745d57a68f6f057 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:18:45.880334  6881 rpcz_store.cc:276] 0709 13:18:44.712878 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:45.320727 (+607849us) service_pool.cc:224] Handling call
0709 13:18:45.332013 (+ 11286us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:45.332469 (+   456us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:45.332500 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:45.333050 (+   550us) log.cc:844] Serialized 26 byte log entry
0709 13:18:45.537769 (+204719us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:18:45.537812 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:45.541174 (+  3362us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:45.879066 (+337892us) raft_consensus.cc:1685] finished
0709 13:18:45.879092 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:45.879339 (+   247us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":85,"raft.run_cpu_time_us":83,"raft.run_wall_time_us":83,"spinlock_wait_cycles":252288,"thread_start_us":204336,"threads_started":1,"wal-append.queue_time_us":398086}
I20260709 13:18:45.887117  6844 leader_election.cc:304] T 8c7f33e544204fbaac4078e3e83bbf4e P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:18:45.890522  7501 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50742 (request call id 219) took 1131 ms. Trace:
I20260709 13:18:45.892163  8155 leader_election.cc:290] T 7c37d41cd9164c15a6826ca62a851a69 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
W20260709 13:18:45.892884  6876 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53406 (request call id 1058) took 1859 ms (client timeout 1521 ms). Trace:
W20260709 13:18:45.893363  6876 rpcz_store.cc:269] 0709 13:18:44.033919 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:44.074580 (+ 40661us) service_pool.cc:224] Handling call
0709 13:18:45.892604 (+1818024us) spinlock_profiling.cc:243] Waited 608 ms on lock 0x7b54002369d4. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f9ae2fa 00007fcc1496fb17 00007fcc0deea6d4 00007fcc0deea662 00007fcc0deea591 00007fcc0deea50c 00007fcc0dee97c2 00007fcc0dce548c 00007fcc0dce48c6 00007fcc0dce426f
0709 13:18:45.892796 (+   192us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1397682944}
I20260709 13:18:45.895397  6881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5be3a11b23d4ea9b08300a2789821c7" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
W20260709 13:18:45.879662  8176 log.cc:927] Time spent T 3a485a995abc4807b6e511e45419f737 P cd75a17ab2604397adab03bb8b5fd75c: Append to log took a long time: real 1.642s	user 0.000s	sys 0.015s
I20260709 13:18:45.901387  8100 leader_election.cc:290] T 17587d6730594da4a56fa13a353232a1 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:18:45.901624  6880 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53406 (request call id 1037) took 3291 ms. Trace:
I20260709 13:18:45.891026  7501 rpcz_store.cc:276] 0709 13:18:44.759633 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:44.762340 (+  2707us) service_pool.cc:224] Handling call
0709 13:18:44.775536 (+ 13196us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:45.341667 (+566131us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:45.889941 (+548274us) spinlock_profiling.cc:243] Waited 526 ms on lock 0x7b54001ec8d4. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f9aae01 00007fcc0f9a983e 00007fcc1496e419 00007fcc0dee5bd4 00007fcc0dee5b62 00007fcc0dee5a91 00007fcc0dee5a0c 00007fcc0dee4cc2 00007fcc0dce548c 00007fcc0dce48c6
0709 13:18:45.890383 (+   442us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1209967872}
W20260709 13:18:45.897071  8146 consensus_meta.cc:287] T 4275cf08e63345f993bce8664eada830 P ccd8a4c3bfe3413cb2ae219b09aea832: Time spent flushing consensus metadata: real 0.567s	user 0.013s	sys 0.000s
I20260709 13:18:45.871541  6801 raft_consensus.cc:2468] T a3022224cc81473690653a83d4e99470 P b7ab4784c7344b939bc36f639286f377 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 3.
I20260709 13:18:45.907624  7500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17587d6730594da4a56fa13a353232a1" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
W20260709 13:18:45.935803  6770 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 254099us
I20260709 13:18:45.909404  6844 leader_election.cc:304] T 3411566abe2d4c9bb4b2adfdd05e6f17 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:18:45.901454  6881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20f6842e26174571996b8dea4151d4be" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:18:45.902009  6880 rpcz_store.cc:276] 0709 13:18:42.610209 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:42.735481 (+125272us) service_pool.cc:224] Handling call
0709 13:18:42.735835 (+   354us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:42.743539 (+  7704us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:42.743578 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:42.746275 (+  2697us) log.cc:844] Serialized 26 byte log entry
0709 13:18:43.810495 (+1064220us) spinlock_profiling.cc:243] Waited 33.5 ms on lock 0x7b1800290800. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc15785de1 00007fcc157925b1 00007fcc0c89fe07 00007fcc156faab9 00007fcc0c8bc69b 00007fcc0c8ba93f 00007fcc0c8bcc02 00007fcc0f54420b 00007fcc0f549d23 00007fcc0f54a0d1 00007fcc0f965a0f
0709 13:18:44.009940 (+199445us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:18:44.009997 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:44.010103 (+   106us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:45.848753 (+1838650us) spinlock_profiling.cc:243] Waited 16.3 ms on lock 0x7b4400022b4c. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0c745db1 00007fcc0c7e3c85 00007fcc0c7e46a2 00007fcc0f5561db 00007fcc0f551aaf 00007fcc0f54586e 00007fcc0f544bb6 00007fcc0f5447d8 00007fcc0f54e221 00007fcc0f54e1d9 00007fcc0f54e169
0709 13:18:45.901327 (+ 52574us) raft_consensus.cc:1685] finished
0709 13:18:45.901354 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:45.901523 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":21730,"raft.run_cpu_time_us":170,"raft.run_wall_time_us":8547,"spinlock_wait_cycles":114619520,"thread_start_us":199211,"threads_started":1,"wal-append.queue_time_us":1340471}
I20260709 13:18:45.903505  8236 raft_consensus.cc:2804] T e77e330a82df4b43a745d57a68f6f057 P cd75a17ab2604397adab03bb8b5fd75c [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:18:45.914640  6724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4b8bd455d5a47c18a1380839c6e0d61" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:18:45.856652  6726 raft_consensus.cc:3060] T 90d42e216d9741e190bca19a781291fd P ccd8a4c3bfe3413cb2ae219b09aea832 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:45.926614  6697 leader_election.cc:304] T 2c240553ce044eedb41541d72b9475d7 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
W20260709 13:18:45.932644  6846 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:45.899287  6875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f03d0dbf16864ca4bc1bb5e4c0334c0f" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:18:45.946882  6875 raft_consensus.cc:2468] T f03d0dbf16864ca4bc1bb5e4c0334c0f P cd75a17ab2604397adab03bb8b5fd75c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 3.
I20260709 13:18:45.938572  6881 raft_consensus.cc:2410] T 20f6842e26174571996b8dea4151d4be P cd75a17ab2604397adab03bb8b5fd75c [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7ab4784c7344b939bc36f639286f377 for term 4 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:18:45.954208  6697 leader_election.cc:304] T 3a485a995abc4807b6e511e45419f737 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
W20260709 13:18:45.907541  7468 leader_election.cc:336] T 4f00a2e87e56452083b759f60d461ee3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931): Timed out: RequestConsensusVote RPC to 127.5.126.67:42931 timed out after 1.699s (SENT)
I20260709 13:18:45.924988  8155 raft_consensus.cc:2749] T 8c7f33e544204fbaac4078e3e83bbf4e P cd75a17ab2604397adab03bb8b5fd75c [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:18:45.939076  8034 raft_consensus.cc:493] T a1704639a875409b9959353527b3fd68 P cd75a17ab2604397adab03bb8b5fd75c [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:45.959249  6770 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.5.126.65:44391 timed out after 1.521s (SENT) [suppressed 14 similar messages]
I20260709 13:18:45.959204  6697 leader_election.cc:304] T 8c7f33e544204fbaac4078e3e83bbf4e P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:18:45.961299  8146 raft_consensus.cc:2804] T 2c240553ce044eedb41541d72b9475d7 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:18:45.968321  8146 raft_consensus.cc:493] T 2c240553ce044eedb41541d72b9475d7 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:45.968900  8151 consensus_queue.cc:1048] T de3186201e1a40d0b335eeb8b4e256e0 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:18:45.969656  8146 raft_consensus.cc:3060] T 2c240553ce044eedb41541d72b9475d7 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:18:45.924466  8148 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.606s	user 0.041s	sys 0.094s
I20260709 13:18:45.938025  7886 leader_election.cc:290] T 34f36d59d88f40fe8a2805e604fc6c0a P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:18:45.947853  8236 raft_consensus.cc:493] T e77e330a82df4b43a745d57a68f6f057 P cd75a17ab2604397adab03bb8b5fd75c [term 4 FOLLOWER]: Starting leader election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:18:45.993232  6875 raft_consensus.cc:3055] T 7c44c4849aa54f2b94d1f1bef9ed546f P cd75a17ab2604397adab03bb8b5fd75c [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:18:46.002337  6875 raft_consensus.cc:740] T 7c44c4849aa54f2b94d1f1bef9ed546f P cd75a17ab2604397adab03bb8b5fd75c [term 2 LEADER]: Becoming Follower/Learner. State: Replica: cd75a17ab2604397adab03bb8b5fd75c, State: Running, Role: LEADER
I20260709 13:18:45.968330  8235 raft_consensus.cc:3060] T 8c7f33e544204fbaac4078e3e83bbf4e P ccd8a4c3bfe3413cb2ae219b09aea832 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:45.965335  8068 raft_consensus.cc:493] T 7c44c4849aa54f2b94d1f1bef9ed546f P ccd8a4c3bfe3413cb2ae219b09aea832 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:45.996176  6696 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:46.005931  6846 leader_election.cc:304] T 427c124d773f483294511e80fe340075 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
W20260709 13:18:45.961886  8179 log.cc:927] Time spent T 9e326172347f45e99a0d482b5d8ef768 P ccd8a4c3bfe3413cb2ae219b09aea832: Append to log took a long time: real 1.817s	user 0.001s	sys 0.014s
I20260709 13:18:45.958978  6803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17587d6730594da4a56fa13a353232a1" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:18:45.976605  7934 leader_election.cc:290] T 9b3759de40694069b13c0f8bd40e5709 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:18:46.029592  6875 consensus_queue.cc:260] T 7c44c4849aa54f2b94d1f1bef9ed546f P cd75a17ab2604397adab03bb8b5fd75c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:45.965065  8147 raft_consensus.cc:2749] T 3a485a995abc4807b6e511e45419f737 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:18:45.992764  8155 raft_consensus.cc:2749] T 3411566abe2d4c9bb4b2adfdd05e6f17 P cd75a17ab2604397adab03bb8b5fd75c [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
W20260709 13:18:45.993212  8148 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.685s	user 0.041s	sys 0.095s
I20260709 13:18:46.001163  6801 raft_consensus.cc:1275] T f03d0dbf16864ca4bc1bb5e4c0334c0f P b7ab4784c7344b939bc36f639286f377 [term 3 FOLLOWER]: Refusing update from remote peer ccd8a4c3bfe3413cb2ae219b09aea832: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:18:46.069720  6729 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50004 (request call id 1026) took 2282 ms. Trace:
I20260709 13:18:45.996737  8085 leader_election.cc:290] T ce4f062dcd314d43a63ca74067cb5ee3 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
W20260709 13:18:46.035562  6770 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 76323.2us
W20260709 13:18:46.034807  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 125639us
I20260709 13:18:46.005180  8236 raft_consensus.cc:3060] T e77e330a82df4b43a745d57a68f6f057 P cd75a17ab2604397adab03bb8b5fd75c [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:45.997879  7993 consensus_queue.cc:1059] T f4b8bd455d5a47c18a1380839c6e0d61 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.044s
W20260709 13:18:46.042562  8167 consensus_meta.cc:287] T 713b5728a197487c9300b310ab94e5a3 P cd75a17ab2604397adab03bb8b5fd75c: Time spent flushing consensus metadata: real 0.503s	user 0.013s	sys 0.005s
I20260709 13:18:46.027602  7886 raft_consensus.cc:493] T 1bf4668eeb70467fb3dc5a0289233b3c P cd75a17ab2604397adab03bb8b5fd75c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:18:46.048156  8146 raft_consensus.cc:515] T 2c240553ce044eedb41541d72b9475d7 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:46.002661  8096 raft_consensus.cc:2955] T ce4f062dcd314d43a63ca74067cb5ee3 P b7ab4784c7344b939bc36f639286f377 [term 3 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } attrs { replace: true } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } } }
I20260709 13:18:46.049572  8243 raft_consensus.cc:2804] T 427c124d773f483294511e80fe340075 P cd75a17ab2604397adab03bb8b5fd75c [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:18:45.997084  7501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8cee0accdb8499c86d4414b72565a38" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb"
I20260709 13:18:45.973459  8034 raft_consensus.cc:515] T a1704639a875409b9959353527b3fd68 P cd75a17ab2604397adab03bb8b5fd75c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:46.050179  6877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c7f33e544204fbaac4078e3e83bbf4e" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:18:46.050789  6875 raft_consensus.cc:3060] T 7c44c4849aa54f2b94d1f1bef9ed546f P cd75a17ab2604397adab03bb8b5fd75c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:46.051450  7498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be1a92657f494cac8dd227d152f50151" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:18:46.053189  7502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ba5dac66ab5497e9e336f2a3c28cda5" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:18:46.001489  7497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb7fa124c3bf4ef9ab65a407cb008441" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
W20260709 13:18:46.002270  7468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 115449us
I20260709 13:18:46.101353  6730 raft_consensus.cc:1240] T bb3d8792045a4583ae2e965b1350a5b4 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 4 FOLLOWER]: Rejecting Update request from peer 7ba59cc884714e8aa5f3f0ecaed84cbb for earlier term 3. Current term is 4. Ops: []
I20260709 13:18:46.099673  6881 raft_consensus.cc:1240] T 3411566abe2d4c9bb4b2adfdd05e6f17 P cd75a17ab2604397adab03bb8b5fd75c [term 2 FOLLOWER]: Rejecting Update request from peer ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 1. Current term is 2. Ops: []
I20260709 13:18:46.103525  6731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fa34c08b205435dba97346991aa1f92" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:18:46.105338  6727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3d8792045a4583ae2e965b1350a5b4" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:18:46.105566  6728 raft_consensus.cc:1275] T b3f13b31a1f84f0d89d007eadd57924c P ccd8a4c3bfe3413cb2ae219b09aea832 [term 2 FOLLOWER]: Refusing update from remote peer 7ba59cc884714e8aa5f3f0ecaed84cbb: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
W20260709 13:18:46.097519  6697 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 122210us
I20260709 13:18:46.098845  8245 raft_consensus.cc:493] T 07a92dd554674067a83a9cb68c4773f2 P b7ab4784c7344b939bc36f639286f377 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:46.113730  7958 consensus_queue.cc:1048] T 7c37d41cd9164c15a6826ca62a851a69 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:18:46.070828  6729 rpcz_store.cc:276] 0709 13:18:43.771287 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:43.863161 (+ 91874us) service_pool.cc:224] Handling call
0709 13:18:43.863492 (+   331us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:43.863837 (+   345us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:43.863869 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:43.864387 (+   518us) log.cc:844] Serialized 26 byte log entry
0709 13:18:44.041664 (+177277us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:18:44.041689 (+    25us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:44.041736 (+    47us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:45.829097 (+1787361us) spinlock_profiling.cc:243] Waited 1.26 ms on lock 0x7b4400022b4c. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0c745db1 00007fcc0c7e3c85 00007fcc0c7e46a2 00007fcc0f5561db 00007fcc0f551aaf 00007fcc0f54586e 00007fcc0f544bb6 00007fcc0f5447d8 00007fcc0f54e221 00007fcc0f54e1d9 00007fcc0f54e169
0709 13:18:46.043784 (+214687us) raft_consensus.cc:1685] finished
0709 13:18:46.043809 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:46.053394 (+  9585us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2899328,"thread_start_us":143618,"threads_started":1,"wal-append.queue_time_us":231409}
I20260709 13:18:46.137082  8243 raft_consensus.cc:493] T 427c124d773f483294511e80fe340075 P cd75a17ab2604397adab03bb8b5fd75c [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:46.138758  6844 leader_election.cc:304] T f4b8bd455d5a47c18a1380839c6e0d61 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:18:46.160328  6844 leader_election.cc:304] T 3a485a995abc4807b6e511e45419f737 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
W20260709 13:18:46.097895  7992 consensus_meta.cc:287] T 711ef6523deb4cbe8ef2ba61e1c21c98 P cd75a17ab2604397adab03bb8b5fd75c: Time spent flushing consensus metadata: real 0.552s	user 0.008s	sys 0.004s
I20260709 13:18:46.114708  6772 leader_election.cc:304] T 7a734b5ab7834e05a8c422208acc58b1 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:18:46.141503  7503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce4f062dcd314d43a63ca74067cb5ee3" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:18:46.011253  8068 raft_consensus.cc:515] T 7c44c4849aa54f2b94d1f1bef9ed546f P ccd8a4c3bfe3413cb2ae219b09aea832 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:46.139511  6877 raft_consensus.cc:2468] T 8c7f33e544204fbaac4078e3e83bbf4e P cd75a17ab2604397adab03bb8b5fd75c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 2.
I20260709 13:18:46.098040  8230 consensus_queue.cc:1048] T d8292e16e5654be6bc408560cf256aaa P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.015s
I20260709 13:18:46.136600  8112 raft_consensus.cc:493] T 713b5728a197487c9300b310ab94e5a3 P cd75a17ab2604397adab03bb8b5fd75c [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:46.153329  6729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a75bfe094d4bdc963aba3f08dfcd25" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:18:46.175882  8112 raft_consensus.cc:515] T 713b5728a197487c9300b310ab94e5a3 P cd75a17ab2604397adab03bb8b5fd75c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:46.176461  6729 raft_consensus.cc:2468] T 95a75bfe094d4bdc963aba3f08dfcd25 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 3.
I20260709 13:18:46.177536  6729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8292e16e5654be6bc408560cf256aaa" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:18:46.178176  6729 raft_consensus.cc:2468] T d8292e16e5654be6bc408560cf256aaa P ccd8a4c3bfe3413cb2ae219b09aea832 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 3.
I20260709 13:18:46.178799  8235 raft_consensus.cc:2749] T 8c7f33e544204fbaac4078e3e83bbf4e P ccd8a4c3bfe3413cb2ae219b09aea832 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:46.178988  6729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "853ac0a8cbd64ce99457f170216d4d0f" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:18:46.156874  6873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d65025eea89441290d85dd053810e31" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:18:46.116683  6723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17587d6730594da4a56fa13a353232a1" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:18:46.180367  6723 raft_consensus.cc:2468] T 17587d6730594da4a56fa13a353232a1 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in term 4.
I20260709 13:18:46.180564  6873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3022224cc81473690653a83d4e99470" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:18:46.181258  6873 raft_consensus.cc:2468] T a3022224cc81473690653a83d4e99470 P cd75a17ab2604397adab03bb8b5fd75c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 3.
I20260709 13:18:46.154740  6728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f03d0dbf16864ca4bc1bb5e4c0334c0f" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:18:46.183255  6729 raft_consensus.cc:1240] T 7c44c4849aa54f2b94d1f1bef9ed546f P ccd8a4c3bfe3413cb2ae219b09aea832 [term 3 FOLLOWER]: Rejecting Update request from peer cd75a17ab2604397adab03bb8b5fd75c for earlier term 2. Current term is 3. Ops: []
W20260709 13:18:46.156875  8246 log.cc:927] Time spent T 713b5728a197487c9300b310ab94e5a3 P ccd8a4c3bfe3413cb2ae219b09aea832: Append to log took a long time: real 0.121s	user 0.000s	sys 0.000s
I20260709 13:18:46.142277  8223 raft_consensus.cc:493] T 4275cf08e63345f993bce8664eada830 P b7ab4784c7344b939bc36f639286f377 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:46.193591  8139 leader_election.cc:290] T de3186201e1a40d0b335eeb8b4e256e0 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:18:46.194343  8223 raft_consensus.cc:515] T 4275cf08e63345f993bce8664eada830 P b7ab4784c7344b939bc36f639286f377 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:46.196864  8146 leader_election.cc:290] T 2c240553ce044eedb41541d72b9475d7 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 4 election: Requested vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:18:46.166306  6877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f9c2e2bf644115957398fe4c9459db" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:18:46.166456  8249 raft_consensus.cc:2749] T f4b8bd455d5a47c18a1380839c6e0d61 P cd75a17ab2604397adab03bb8b5fd75c [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:18:46.169471  8250 raft_consensus.cc:2749] T 3a485a995abc4807b6e511e45419f737 P cd75a17ab2604397adab03bb8b5fd75c [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:18:46.198938  6877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7887766dc6784fcaa42b35c05fea7a99" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:18:46.200258  8034 leader_election.cc:290] T a1704639a875409b9959353527b3fd68 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:18:46.201396  8133 leader_election.cc:290] T e77e330a82df4b43a745d57a68f6f057 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931), ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391)
W20260709 13:18:46.158351  7468 leader_election.cc:336] T 4f00a2e87e56452083b759f60d461ee3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931): Timed out: RequestConsensusVote RPC to 127.5.126.67:42931 timed out after 1.961s (SENT)
W20260709 13:18:46.202663  7468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 49401.1us
I20260709 13:18:46.052004  8066 raft_consensus.cc:515] T 427c124d773f483294511e80fe340075 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } attrs { replace: true } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
W20260709 13:18:46.204639  6845 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:46.205175  6845 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:46.205638  6845 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:46.141122  8114 raft_consensus.cc:493] T ce4f062dcd314d43a63ca74067cb5ee3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:18:46.169035  8200 consensus_queue.cc:1059] T bb3d8792045a4583ae2e965b1350a5b4 P 7ba59cc884714e8aa5f3f0ecaed84cbb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.005s
I20260709 13:18:46.175117  8068 leader_election.cc:290] T 7c44c4849aa54f2b94d1f1bef9ed546f P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:18:46.114688  8074 consensus_queue.cc:1048] T b56bf91d90824c959e21e0cee5ba1816 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.039s
I20260709 13:18:46.182158  6873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ba5dac66ab5497e9e336f2a3c28cda5" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:18:46.117409  7886 raft_consensus.cc:515] T 1bf4668eeb70467fb3dc5a0289233b3c P cd75a17ab2604397adab03bb8b5fd75c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:46.192731  6728 raft_consensus.cc:1240] T c4db81d9d329422bb3b4160ca4ac2d1d P ccd8a4c3bfe3413cb2ae219b09aea832 [term 3 FOLLOWER]: Rejecting Update request from peer cd75a17ab2604397adab03bb8b5fd75c for earlier term 2. Current term is 3. Ops: []
I20260709 13:18:46.193209  8241 consensus_queue.cc:1048] T b3f13b31a1f84f0d89d007eadd57924c P 7ba59cc884714e8aa5f3f0ecaed84cbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:18:46.194947  6727 raft_consensus.cc:2393] T bb3d8792045a4583ae2e965b1350a5b4 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c in current term 4: Already voted for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in this term.
I20260709 13:18:46.200299  6877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3d8792045a4583ae2e965b1350a5b4" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:18:46.225111  6877 raft_consensus.cc:3060] T bb3d8792045a4583ae2e965b1350a5b4 P cd75a17ab2604397adab03bb8b5fd75c [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:46.235761  8201 raft_consensus.cc:3055] T 1bf4668eeb70467fb3dc5a0289233b3c P ccd8a4c3bfe3413cb2ae219b09aea832 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:18:46.237088  6873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d33d5ee8ef6f415593d8df52063161ad" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:18:46.237749  8151 raft_consensus.cc:3055] T f4b8bd455d5a47c18a1380839c6e0d61 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:18:46.238229  8151 raft_consensus.cc:740] T f4b8bd455d5a47c18a1380839c6e0d61 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
I20260709 13:18:46.237972  6873 raft_consensus.cc:2468] T d33d5ee8ef6f415593d8df52063161ad P cd75a17ab2604397adab03bb8b5fd75c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 3.
I20260709 13:18:46.208552  8075 raft_consensus.cc:2804] T 7a734b5ab7834e05a8c422208acc58b1 P b7ab4784c7344b939bc36f639286f377 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:18:46.250793  8075 raft_consensus.cc:493] T 7a734b5ab7834e05a8c422208acc58b1 P b7ab4784c7344b939bc36f639286f377 [term 3 FOLLOWER]: Starting leader election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
W20260709 13:18:46.251068  8220 log.cc:927] Time spent T 2c240553ce044eedb41541d72b9475d7 P cd75a17ab2604397adab03bb8b5fd75c: Append to log took a long time: real 0.611s	user 0.004s	sys 0.000s
I20260709 13:18:46.253710  6726 raft_consensus.cc:1275] T 90d42e216d9741e190bca19a781291fd P ccd8a4c3bfe3413cb2ae219b09aea832 [term 4 FOLLOWER]: Refusing update from remote peer b7ab4784c7344b939bc36f639286f377: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 2. (term mismatch)
I20260709 13:18:46.254168  6726 pending_rounds.cc:85] T 90d42e216d9741e190bca19a781291fd P ccd8a4c3bfe3413cb2ae219b09aea832: Aborting all ops after (but not including) 1
I20260709 13:18:46.254444  6726 pending_rounds.cc:107] T 90d42e216d9741e190bca19a781291fd P ccd8a4c3bfe3413cb2ae219b09aea832: Aborting uncommitted NO_OP operation due to leader change: 3.2
I20260709 13:18:46.254742  6726 raft_consensus.cc:2889] T 90d42e216d9741e190bca19a781291fd P ccd8a4c3bfe3413cb2ae219b09aea832 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:18:46.218149  8114 raft_consensus.cc:515] T ce4f062dcd314d43a63ca74067cb5ee3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } attrs { replace: true } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:18:46.167990  8243 raft_consensus.cc:3060] T 427c124d773f483294511e80fe340075 P cd75a17ab2604397adab03bb8b5fd75c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:46.205700  7498 raft_consensus.cc:1275] T 1528ab62b6fe4e3099d08f141afee116 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 3 FOLLOWER]: Refusing update from remote peer cd75a17ab2604397adab03bb8b5fd75c: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:18:46.239643  8151 consensus_queue.cc:260] T f4b8bd455d5a47c18a1380839c6e0d61 P ccd8a4c3bfe3413cb2ae219b09aea832 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:46.250039  7886 leader_election.cc:290] T 1bf4668eeb70467fb3dc5a0289233b3c P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:18:46.161224  8245 raft_consensus.cc:515] T 07a92dd554674067a83a9cb68c4773f2 P b7ab4784c7344b939bc36f639286f377 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:46.251329  8075 raft_consensus.cc:3060] T 7a734b5ab7834e05a8c422208acc58b1 P b7ab4784c7344b939bc36f639286f377 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:46.275555  6873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e31b9971c15848dea59d4d4130141d9e" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:18:46.276293  8238 raft_consensus.cc:493] T 1528ab62b6fe4e3099d08f141afee116 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:46.276813  6873 raft_consensus.cc:2410] T e31b9971c15848dea59d4d4130141d9e P cd75a17ab2604397adab03bb8b5fd75c [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7ab4784c7344b939bc36f639286f377 for term 4 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:18:46.277032  8238 raft_consensus.cc:515] T 1528ab62b6fe4e3099d08f141afee116 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } attrs { replace: true } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:18:46.277761  8245 leader_election.cc:290] T 07a92dd554674067a83a9cb68c4773f2 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:18:46.197655  8223 leader_election.cc:290] T 4275cf08e63345f993bce8664eada830 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:18:46.284456  7503 raft_consensus.cc:2468] T ce4f062dcd314d43a63ca74067cb5ee3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 3.
I20260709 13:18:46.277930  6873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77e330a82df4b43a745d57a68f6f057" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 5 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:18:46.285645  8180 raft_consensus.cc:3055] T bb3d8792045a4583ae2e965b1350a5b4 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:18:46.286227  8180 raft_consensus.cc:740] T bb3d8792045a4583ae2e965b1350a5b4 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 7ba59cc884714e8aa5f3f0ecaed84cbb, State: Running, Role: LEADER
I20260709 13:18:46.286298  8066 leader_election.cc:290] T 427c124d773f483294511e80fe340075 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 3 election: Requested vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:18:46.286865  6873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5be3a11b23d4ea9b08300a2789821c7" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
W20260709 13:18:46.171867  6772 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 57163.1us
I20260709 13:18:46.270875  6844 leader_election.cc:304] T 44bde925b2e541b69890d70715b85176 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:18:46.271622  6875 raft_consensus.cc:1275] T 7c44c4849aa54f2b94d1f1bef9ed546f P cd75a17ab2604397adab03bb8b5fd75c [term 3 FOLLOWER]: Refusing update from remote peer b7ab4784c7344b939bc36f639286f377: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
W20260709 13:18:46.219874  6697 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 68643us
I20260709 13:18:46.237574  8201 raft_consensus.cc:740] T 1bf4668eeb70467fb3dc5a0289233b3c P ccd8a4c3bfe3413cb2ae219b09aea832 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
I20260709 13:18:46.293035  6772 leader_election.cc:304] T de3186201e1a40d0b335eeb8b4e256e0 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:18:46.293035  6697 leader_election.cc:304] T a3022224cc81473690653a83d4e99470 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
W20260709 13:18:46.264850  7468 leader_election.cc:336] T fe20b4b48823486ca3b9c648db6ce8aa P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931): Timed out: RequestConsensusVote RPC to 127.5.126.67:42931 timed out after 1.935s (SENT)
I20260709 13:18:46.295655  6697 leader_election.cc:304] T d33d5ee8ef6f415593d8df52063161ad P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:18:46.298035  6877 raft_consensus.cc:2468] T bb3d8792045a4583ae2e965b1350a5b4 P cd75a17ab2604397adab03bb8b5fd75c [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 4.
I20260709 13:18:46.299427  7886 raft_consensus.cc:2804] T 44bde925b2e541b69890d70715b85176 P cd75a17ab2604397adab03bb8b5fd75c [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:18:46.294891  6844 leader_election.cc:304] T 95a75bfe094d4bdc963aba3f08dfcd25 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:18:46.287381  8180 consensus_queue.cc:260] T bb3d8792045a4583ae2e965b1350a5b4 P 7ba59cc884714e8aa5f3f0ecaed84cbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:18:46.286389  8114 leader_election.cc:290] T ce4f062dcd314d43a63ca74067cb5ee3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:18:46.309235  6844 leader_election.cc:304] T 90d42e216d9741e190bca19a781291fd P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:18:46.314210  6772 leader_election.cc:304] T 24ee15416e3145beaa1b8183453729a3 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:18:46.294530  8223 raft_consensus.cc:2764] T de3186201e1a40d0b335eeb8b4e256e0 P b7ab4784c7344b939bc36f639286f377 [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
I20260709 13:18:46.301427  7993 raft_consensus.cc:2804] T a3022224cc81473690653a83d4e99470 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:18:46.296277  6873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab432e62819d499eaaf3dd55481dd930" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:18:46.315377  8115 raft_consensus.cc:2804] T 95a75bfe094d4bdc963aba3f08dfcd25 P cd75a17ab2604397adab03bb8b5fd75c [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:18:46.304689  7886 raft_consensus.cc:493] T 44bde925b2e541b69890d70715b85176 P cd75a17ab2604397adab03bb8b5fd75c [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:46.312101  8151 raft_consensus.cc:3060] T f4b8bd455d5a47c18a1380839c6e0d61 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:46.294265  8167 consensus_queue.cc:1048] T 1528ab62b6fe4e3099d08f141afee116 P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.031s
I20260709 13:18:46.320453  8155 raft_consensus.cc:2749] T 90d42e216d9741e190bca19a781291fd P cd75a17ab2604397adab03bb8b5fd75c [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:18:46.307356  8146 raft_consensus.cc:2804] T d33d5ee8ef6f415593d8df52063161ad P ccd8a4c3bfe3413cb2ae219b09aea832 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:18:46.327077  7958 raft_consensus.cc:493] T b3f13b31a1f84f0d89d007eadd57924c P b7ab4784c7344b939bc36f639286f377 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 7ba59cc884714e8aa5f3f0ecaed84cbb)
I20260709 13:18:46.321934  8120 raft_consensus.cc:2749] T 24ee15416e3145beaa1b8183453729a3 P b7ab4784c7344b939bc36f639286f377 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:18:46.329671  8235 raft_consensus.cc:493] T 4275cf08e63345f993bce8664eada830 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:46.329524  8115 raft_consensus.cc:493] T 95a75bfe094d4bdc963aba3f08dfcd25 P cd75a17ab2604397adab03bb8b5fd75c [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:46.340256  8148 raft_consensus.cc:493] T f58dc08b12a2494bb9a1372837970ca2 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:18:46.341380  8169 consensus_queue.cc:260] T ab432e62819d499eaaf3dd55481dd930 P cd75a17ab2604397adab03bb8b5fd75c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:46.306031  8236 raft_consensus.cc:515] T e77e330a82df4b43a745d57a68f6f057 P cd75a17ab2604397adab03bb8b5fd75c [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } }
I20260709 13:18:46.323690  7993 raft_consensus.cc:493] T a3022224cc81473690653a83d4e99470 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:46.344247  7886 raft_consensus.cc:3060] T 44bde925b2e541b69890d70715b85176 P cd75a17ab2604397adab03bb8b5fd75c [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:46.297302  8111 consensus_queue.cc:1059] T f58dc08b12a2494bb9a1372837970ca2 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.027s
I20260709 13:18:46.295769  8074 consensus_queue.cc:1048] T bd6869f07b5a4885a0b99fbe60c3b175 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.029s
I20260709 13:18:46.346649  7500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1528ab62b6fe4e3099d08f141afee116" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:18:46.354013  6875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8cee0accdb8499c86d4414b72565a38" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:18:46.400399  7500 raft_consensus.cc:2468] T 1528ab62b6fe4e3099d08f141afee116 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 3.
I20260709 13:18:46.399981  8243 raft_consensus.cc:515] T 427c124d773f483294511e80fe340075 P cd75a17ab2604397adab03bb8b5fd75c [term 3 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } attrs { replace: true } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:18:46.401172  6875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1528ab62b6fe4e3099d08f141afee116" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:18:46.402731  6875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ba5dac66ab5497e9e336f2a3c28cda5" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:18:46.402820  8169 raft_consensus.cc:3060] T ab432e62819d499eaaf3dd55481dd930 P cd75a17ab2604397adab03bb8b5fd75c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:46.307986  7468 leader_election.cc:304] T fe20b4b48823486ca3b9c648db6ce8aa P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
W20260709 13:18:46.404395  7468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 146952us
I20260709 13:18:46.404707  8236 leader_election.cc:290] T e77e330a82df4b43a745d57a68f6f057 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 5 election: Requested vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391)
I20260709 13:18:46.409231  8114 raft_consensus.cc:2749] T fe20b4b48823486ca3b9c648db6ce8aa P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:46.412820  6798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d33d5ee8ef6f415593d8df52063161ad" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:18:46.337178  8180 raft_consensus.cc:3060] T bb3d8792045a4583ae2e965b1350a5b4 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:46.402992  8243 leader_election.cc:290] T 427c124d773f483294511e80fe340075 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 3 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
W20260709 13:18:46.378989  7467 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:46.353471  8146 raft_consensus.cc:493] T d33d5ee8ef6f415593d8df52063161ad P ccd8a4c3bfe3413cb2ae219b09aea832 [term 3 FOLLOWER]: Starting leader election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:18:46.360440  8115 raft_consensus.cc:3060] T 95a75bfe094d4bdc963aba3f08dfcd25 P cd75a17ab2604397adab03bb8b5fd75c [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:46.357563  8223 raft_consensus.cc:493] T 9b3759de40694069b13c0f8bd40e5709 P b7ab4784c7344b939bc36f639286f377 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:46.384913  7938 consensus_queue.cc:1059] T 3fa34c08b205435dba97346991aa1f92 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.050s
I20260709 13:18:46.436537  6875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f00a2e87e56452083b759f60d461ee3" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:18:46.387672  7993 raft_consensus.cc:3060] T a3022224cc81473690653a83d4e99470 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:46.382206  8133 raft_consensus.cc:493] T 853ac0a8cbd64ce99457f170216d4d0f P b7ab4784c7344b939bc36f639286f377 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:18:46.384346  8254 raft_consensus.cc:493] T 44bde925b2e541b69890d70715b85176 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:46.331188  8201 consensus_queue.cc:260] T 1bf4668eeb70467fb3dc5a0289233b3c P ccd8a4c3bfe3413cb2ae219b09aea832 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:46.379493  7958 raft_consensus.cc:515] T b3f13b31a1f84f0d89d007eadd57924c P b7ab4784c7344b939bc36f639286f377 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:18:46.445909  8133 raft_consensus.cc:515] T 853ac0a8cbd64ce99457f170216d4d0f P b7ab4784c7344b939bc36f639286f377 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:46.452797  8133 leader_election.cc:290] T 853ac0a8cbd64ce99457f170216d4d0f P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:18:46.453675  7958 leader_election.cc:290] T b3f13b31a1f84f0d89d007eadd57924c P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:18:46.455461  7497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3f13b31a1f84f0d89d007eadd57924c" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:18:46.447527  8254 raft_consensus.cc:515] T 44bde925b2e541b69890d70715b85176 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:46.455987  6875 raft_consensus.cc:2468] T 4f00a2e87e56452083b759f60d461ee3 P cd75a17ab2604397adab03bb8b5fd75c [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in term 4.
I20260709 13:18:46.380596  8235 raft_consensus.cc:515] T 4275cf08e63345f993bce8664eada830 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:46.461187  6880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a92dd554674067a83a9cb68c4773f2" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:18:46.382182  8148 raft_consensus.cc:515] T f58dc08b12a2494bb9a1372837970ca2 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:46.436618  8146 raft_consensus.cc:3060] T d33d5ee8ef6f415593d8df52063161ad P ccd8a4c3bfe3413cb2ae219b09aea832 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:46.464828  6875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4275cf08e63345f993bce8664eada830" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
W20260709 13:18:46.465688  7466 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 96253.2us
I20260709 13:18:46.479931  6875 raft_consensus.cc:2468] T 4275cf08e63345f993bce8664eada830 P cd75a17ab2604397adab03bb8b5fd75c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 2.
I20260709 13:18:46.470005  7496 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50742 (request call id 218) took 1737 ms. Trace:
I20260709 13:18:46.471494  6800 pending_rounds.cc:85] T 4d9def8b32fd443aa94ab1420b06837b P b7ab4784c7344b939bc36f639286f377: Aborting all ops after (but not including) 1
I20260709 13:18:46.486545  6880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f00a2e87e56452083b759f60d461ee3" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:18:46.484108  6872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c44c4849aa54f2b94d1f1bef9ed546f" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
W20260709 13:18:46.485208  6696 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:46.462752  8254 leader_election.cc:290] T 44bde925b2e541b69890d70715b85176 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:18:46.486898  6800 pending_rounds.cc:107] T 4d9def8b32fd443aa94ab1420b06837b P b7ab4784c7344b939bc36f639286f377: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 13:18:46.490245  6800 raft_consensus.cc:2889] T 4d9def8b32fd443aa94ab1420b06837b P b7ab4784c7344b939bc36f639286f377 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:18:46.487536  6872 raft_consensus.cc:2468] T 7c44c4849aa54f2b94d1f1bef9ed546f P cd75a17ab2604397adab03bb8b5fd75c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 3.
I20260709 13:18:46.492961  6872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "427c124d773f483294511e80fe340075" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:18:46.493758  6872 raft_consensus.cc:2393] T 427c124d773f483294511e80fe340075 P cd75a17ab2604397adab03bb8b5fd75c [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate ccd8a4c3bfe3413cb2ae219b09aea832 in current term 3: Already voted for candidate cd75a17ab2604397adab03bb8b5fd75c in this term.
I20260709 13:18:46.476739  7498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "427c124d773f483294511e80fe340075" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb"
I20260709 13:18:46.488104  6880 raft_consensus.cc:2376] T 4f00a2e87e56452083b759f60d461ee3 P cd75a17ab2604397adab03bb8b5fd75c [term 4 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in term 4. Re-sending same reply.
I20260709 13:18:46.440959  8223 raft_consensus.cc:515] T 9b3759de40694069b13c0f8bd40e5709 P b7ab4784c7344b939bc36f639286f377 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:46.478207  8235 leader_election.cc:290] T 4275cf08e63345f993bce8664eada830 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:18:46.489508  6875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe20b4b48823486ca3b9c648db6ce8aa" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:18:46.499480  6875 raft_consensus.cc:2468] T fe20b4b48823486ca3b9c648db6ce8aa P cd75a17ab2604397adab03bb8b5fd75c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in term 1.
I20260709 13:18:46.500994  6875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b8cacb381b746da8d0049b0a83b41dd" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:18:46.497365  6872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44bde925b2e541b69890d70715b85176" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:18:46.505056  6875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "427c124d773f483294511e80fe340075" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:18:46.506589  6875 raft_consensus.cc:2393] T 427c124d773f483294511e80fe340075 P cd75a17ab2604397adab03bb8b5fd75c [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in current term 3: Already voted for candidate cd75a17ab2604397adab03bb8b5fd75c in this term.
I20260709 13:18:46.508987  8148 leader_election.cc:290] T f58dc08b12a2494bb9a1372837970ca2 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:18:46.487632  8201 raft_consensus.cc:3060] T 1bf4668eeb70467fb3dc5a0289233b3c P ccd8a4c3bfe3413cb2ae219b09aea832 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:46.515988  6802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce4f062dcd314d43a63ca74067cb5ee3" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:18:46.462695  8075 raft_consensus.cc:515] T 7a734b5ab7834e05a8c422208acc58b1 P b7ab4784c7344b939bc36f639286f377 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:46.465384  7993 raft_consensus.cc:515] T a3022224cc81473690653a83d4e99470 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:46.524720  6729 raft_consensus.cc:1240] T 711ef6523deb4cbe8ef2ba61e1c21c98 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 3 FOLLOWER]: Rejecting Update request from peer cd75a17ab2604397adab03bb8b5fd75c for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 13:18:46.525871  6801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f58dc08b12a2494bb9a1372837970ca2" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:18:46.526734  6726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce4f062dcd314d43a63ca74067cb5ee3" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:18:46.527460  6880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4275cf08e63345f993bce8664eada830" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:18:46.542038  6880 raft_consensus.cc:2468] T 4275cf08e63345f993bce8664eada830 P cd75a17ab2604397adab03bb8b5fd75c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 2.
I20260709 13:18:46.527679  6728 raft_consensus.cc:1240] T ab432e62819d499eaaf3dd55481dd930 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 3 FOLLOWER]: Rejecting Update request from peer cd75a17ab2604397adab03bb8b5fd75c for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 13:18:46.539232  8152 raft_consensus.cc:493] T bb7fa124c3bf4ef9ab65a407cb008441 P b7ab4784c7344b939bc36f639286f377 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 7ba59cc884714e8aa5f3f0ecaed84cbb)
I20260709 13:18:46.544179  8152 raft_consensus.cc:515] T bb7fa124c3bf4ef9ab65a407cb008441 P b7ab4784c7344b939bc36f639286f377 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:18:46.545464  6728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b56bf91d90824c959e21e0cee5ba1816" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:18:46.546242  6728 raft_consensus.cc:2468] T b56bf91d90824c959e21e0cee5ba1816 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 3.
I20260709 13:18:46.547287  6728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c37d41cd9164c15a6826ca62a851a69" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:18:46.548517  6726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f58dc08b12a2494bb9a1372837970ca2" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:18:46.549175  6726 raft_consensus.cc:3060] T f58dc08b12a2494bb9a1372837970ca2 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:46.549816  7497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb7fa124c3bf4ef9ab65a407cb008441" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:18:46.546463  8152 leader_election.cc:290] T bb7fa124c3bf4ef9ab65a407cb008441 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:18:46.540951  6729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c240553ce044eedb41541d72b9475d7" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:18:46.487967  7496 rpcz_store.cc:276] 0709 13:18:44.732517 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:44.733334 (+   817us) service_pool.cc:224] Handling call
0709 13:18:46.222982 (+1489648us) spinlock_profiling.cc:243] Waited 1.26 ms on lock 0x7b5800123f98. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0c745db1 00007fcc0c885b71 00007fcc0c885eee 0000000000375939 00007fcc148f91e0 00007fcc149c20c4 00007fcc149c2131 00007fcc14983fc0 00007fcc1496e929 00007fcc1496e3d2 00007fcc0dee5bd4
0709 13:18:46.223179 (+   197us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:46.223412 (+   233us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:18:46.323824 (+100412us) log.cc:844] Serialized 14 byte log entry
0709 13:18:46.437751 (+113927us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:46.445727 (+  7976us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:18:46.449951 (+  4224us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:46.469569 (+ 19618us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:46.469929 (+   360us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":121998,"prepare.run_cpu_time_us":42,"prepare.run_wall_time_us":43,"raft.queue_time_us":163,"raft.run_cpu_time_us":120,"raft.run_wall_time_us":3007,"spinlock_wait_cycles":3907712,"thread_start_us":170439,"threads_started":2,"wal-append.queue_time_us":158390}
I20260709 13:18:46.552927  6729 raft_consensus.cc:2393] T 2c240553ce044eedb41541d72b9475d7 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c in current term 4: Already voted for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in this term.
I20260709 13:18:46.553864  6729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b3759de40694069b13c0f8bd40e5709" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:18:46.555433  6729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bf4668eeb70467fb3dc5a0289233b3c" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:18:46.557071  6799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c240553ce044eedb41541d72b9475d7" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:18:46.558527  6806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb7fa124c3bf4ef9ab65a407cb008441" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:18:46.559216  6806 raft_consensus.cc:2468] T bb7fa124c3bf4ef9ab65a407cb008441 P b7ab4784c7344b939bc36f639286f377 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 2.
I20260709 13:18:46.559262  8085 raft_consensus.cc:493] T f09c2a98de1a4decabd0ff900dd44caa P cd75a17ab2604397adab03bb8b5fd75c [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:46.559866  8085 raft_consensus.cc:515] T f09c2a98de1a4decabd0ff900dd44caa P cd75a17ab2604397adab03bb8b5fd75c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:46.519892  6875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f58dc08b12a2494bb9a1372837970ca2" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:18:46.562112  8085 leader_election.cc:290] T f09c2a98de1a4decabd0ff900dd44caa P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:18:46.560283  6806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c37d41cd9164c15a6826ca62a851a69" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:18:46.547971  6728 raft_consensus.cc:2468] T 7c37d41cd9164c15a6826ca62a851a69 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 2.
I20260709 13:18:46.498941  7498 raft_consensus.cc:3060] T 427c124d773f483294511e80fe340075 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:46.563962  6875 raft_consensus.cc:2393] T f58dc08b12a2494bb9a1372837970ca2 P cd75a17ab2604397adab03bb8b5fd75c [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ccd8a4c3bfe3413cb2ae219b09aea832 in current term 4: Already voted for candidate cd75a17ab2604397adab03bb8b5fd75c in this term.
I20260709 13:18:46.564670  6844 leader_election.cc:304] T 4275cf08e63345f993bce8664eada830 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:18:46.566803  6844 leader_election.cc:304] T a3022224cc81473690653a83d4e99470 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:18:46.568697  6878 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53406 (request call id 1063) took 2183 ms. Trace:
I20260709 13:18:46.564942  6875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbdf895bba214ff68685a24fd17dfb5d" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:18:46.569149  6878 rpcz_store.cc:276] 0709 13:18:44.385807 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:44.596482 (+210675us) service_pool.cc:224] Handling call
0709 13:18:44.596957 (+   475us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:45.256081 (+659124us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:46.568371 (+1312290us) spinlock_profiling.cc:243] Waited 283 ms on lock 0x7b54002382d4. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f9aae01 00007fcc0f9a983e 00007fcc1496e419 00007fcc0dee5bd4 00007fcc0dee5b62 00007fcc0dee5a91 00007fcc0dee5a0c 00007fcc0dee4cc2 00007fcc0dce548c 00007fcc0dce48c6
0709 13:18:46.568611 (+   240us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":650825472}
I20260709 13:18:46.569768  6875 raft_consensus.cc:2468] T dbdf895bba214ff68685a24fd17dfb5d P cd75a17ab2604397adab03bb8b5fd75c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 3.
I20260709 13:18:46.570674  6875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fa34c08b205435dba97346991aa1f92" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:18:46.571801  6875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce4f062dcd314d43a63ca74067cb5ee3" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:18:46.572606  6875 raft_consensus.cc:2393] T ce4f062dcd314d43a63ca74067cb5ee3 P cd75a17ab2604397adab03bb8b5fd75c [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in current term 4: Already voted for candidate cd75a17ab2604397adab03bb8b5fd75c in this term.
I20260709 13:18:46.579067  6729 raft_consensus.cc:2468] T 1bf4668eeb70467fb3dc5a0289233b3c P ccd8a4c3bfe3413cb2ae219b09aea832 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 3.
I20260709 13:18:46.580878  6880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8cee0accdb8499c86d4414b72565a38" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:18:46.581791  6880 raft_consensus.cc:2393] T d8cee0accdb8499c86d4414b72565a38 P cd75a17ab2604397adab03bb8b5fd75c [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in current term 4: Already voted for candidate cd75a17ab2604397adab03bb8b5fd75c in this term.
I20260709 13:18:46.589219  6875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c240553ce044eedb41541d72b9475d7" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:18:46.593007  6875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "853ac0a8cbd64ce99457f170216d4d0f" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:18:46.600930  6875 raft_consensus.cc:2468] T 853ac0a8cbd64ce99457f170216d4d0f P cd75a17ab2604397adab03bb8b5fd75c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 1.
I20260709 13:18:46.604122  6875 raft_consensus.cc:1275] T 90d42e216d9741e190bca19a781291fd P cd75a17ab2604397adab03bb8b5fd75c [term 4 FOLLOWER]: Refusing update from remote peer b7ab4784c7344b939bc36f639286f377: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 2. (index mismatch)
I20260709 13:18:46.608098  6875 raft_consensus.cc:1240] T ce4f062dcd314d43a63ca74067cb5ee3 P cd75a17ab2604397adab03bb8b5fd75c [term 4 FOLLOWER]: Rejecting Update request from peer b7ab4784c7344b939bc36f639286f377 for earlier term 3. Current term is 4. Ops: []
I20260709 13:18:46.624094  6875 raft_consensus.cc:1275] T dbdf895bba214ff68685a24fd17dfb5d P cd75a17ab2604397adab03bb8b5fd75c [term 3 FOLLOWER]: Refusing update from remote peer ccd8a4c3bfe3413cb2ae219b09aea832: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:18:46.629585  6875 raft_consensus.cc:1275] T 20f6842e26174571996b8dea4151d4be P cd75a17ab2604397adab03bb8b5fd75c [term 3 FOLLOWER]: Refusing update from remote peer ccd8a4c3bfe3413cb2ae219b09aea832: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:18:46.797127  6806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b3759de40694069b13c0f8bd40e5709" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:18:46.798008  6806 raft_consensus.cc:2393] T 9b3759de40694069b13c0f8bd40e5709 P b7ab4784c7344b939bc36f639286f377 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c in current term 3: Already voted for candidate b7ab4784c7344b939bc36f639286f377 in this term.
I20260709 13:18:46.804571  6878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb7fa124c3bf4ef9ab65a407cb008441" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:18:46.810878  6878 raft_consensus.cc:2468] T bb7fa124c3bf4ef9ab65a407cb008441 P cd75a17ab2604397adab03bb8b5fd75c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 2.
I20260709 13:18:46.811758  6728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77e330a82df4b43a745d57a68f6f057" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:18:46.572693  8068 raft_consensus.cc:493] T ce4f062dcd314d43a63ca74067cb5ee3 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:18:46.572501  8085 raft_consensus.cc:2749] T 4275cf08e63345f993bce8664eada830 P cd75a17ab2604397adab03bb8b5fd75c [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:18:46.583180  8243 raft_consensus.cc:2749] T a3022224cc81473690653a83d4e99470 P cd75a17ab2604397adab03bb8b5fd75c [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
W20260709 13:18:46.816854  8265 log.cc:927] Time spent T 4b8cacb381b746da8d0049b0a83b41dd P 7ba59cc884714e8aa5f3f0ecaed84cbb: Append to log took a long time: real 0.284s	user 0.000s	sys 0.000s
I20260709 13:18:46.816893  6728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "427c124d773f483294511e80fe340075" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:18:46.819731  6728 raft_consensus.cc:2393] T 427c124d773f483294511e80fe340075 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c in current term 3: Already voted for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in this term.
I20260709 13:18:46.824723  6806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de3186201e1a40d0b335eeb8b4e256e0" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:18:46.824966  7496 raft_consensus.cc:1240] T 3fa34c08b205435dba97346991aa1f92 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 4 FOLLOWER]: Rejecting Update request from peer ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 3. Current term is 4. Ops: [3.5-3.5]
I20260709 13:18:46.825452  6806 raft_consensus.cc:2468] T de3186201e1a40d0b335eeb8b4e256e0 P b7ab4784c7344b939bc36f639286f377 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 3.
I20260709 13:18:46.826479  6806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce4f062dcd314d43a63ca74067cb5ee3" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
W20260709 13:18:46.827250  8264 log.cc:927] Time spent T d8cee0accdb8499c86d4414b72565a38 P b7ab4784c7344b939bc36f639286f377: Append to log took a long time: real 0.360s	user 0.001s	sys 0.000s
I20260709 13:18:46.828593  6728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09c2a98de1a4decabd0ff900dd44caa" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:18:46.829372  6806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8cee0accdb8499c86d4414b72565a38" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:18:46.829557  6728 raft_consensus.cc:2468] T f09c2a98de1a4decabd0ff900dd44caa P ccd8a4c3bfe3413cb2ae219b09aea832 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 3.
I20260709 13:18:46.835260  6806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b56bf91d90824c959e21e0cee5ba1816" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:18:46.837507  6806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1704639a875409b9959353527b3fd68" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:18:46.798807  8167 consensus_queue.cc:1059] T 22ccee1b570c4ad3a57bd7aec085b1b4 P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.025s
I20260709 13:18:46.842231  8167 raft_consensus.cc:3055] T 22ccee1b570c4ad3a57bd7aec085b1b4 P cd75a17ab2604397adab03bb8b5fd75c [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:18:46.842643  8167 raft_consensus.cc:740] T 22ccee1b570c4ad3a57bd7aec085b1b4 P cd75a17ab2604397adab03bb8b5fd75c [term 2 LEADER]: Becoming Follower/Learner. State: Replica: cd75a17ab2604397adab03bb8b5fd75c, State: Running, Role: LEADER
I20260709 13:18:46.842679  6772 leader_election.cc:304] T f03d0dbf16864ca4bc1bb5e4c0334c0f P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:18:46.845113  8152 raft_consensus.cc:2804] T f03d0dbf16864ca4bc1bb5e4c0334c0f P b7ab4784c7344b939bc36f639286f377 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:18:46.843775  8167 consensus_queue.cc:260] T 22ccee1b570c4ad3a57bd7aec085b1b4 P cd75a17ab2604397adab03bb8b5fd75c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:46.845649  8152 raft_consensus.cc:493] T f03d0dbf16864ca4bc1bb5e4c0334c0f P b7ab4784c7344b939bc36f639286f377 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:46.846190  8152 raft_consensus.cc:3060] T f03d0dbf16864ca4bc1bb5e4c0334c0f P b7ab4784c7344b939bc36f639286f377 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:46.846568  8167 raft_consensus.cc:3060] T 22ccee1b570c4ad3a57bd7aec085b1b4 P cd75a17ab2604397adab03bb8b5fd75c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:46.846256  7886 raft_consensus.cc:515] T 44bde925b2e541b69890d70715b85176 P cd75a17ab2604397adab03bb8b5fd75c [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:46.845525  6726 raft_consensus.cc:2468] T f58dc08b12a2494bb9a1372837970ca2 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 4.
I20260709 13:18:46.855020  8075 leader_election.cc:290] T 7a734b5ab7834e05a8c422208acc58b1 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 4 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:18:46.855535  8223 leader_election.cc:290] T 9b3759de40694069b13c0f8bd40e5709 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:18:46.856899  7993 leader_election.cc:290] T a3022224cc81473690653a83d4e99470 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 4 election: Requested vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:18:46.831593  8146 raft_consensus.cc:515] T d33d5ee8ef6f415593d8df52063161ad P ccd8a4c3bfe3413cb2ae219b09aea832 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:46.839121  6806 raft_consensus.cc:2468] T a1704639a875409b9959353527b3fd68 P b7ab4784c7344b939bc36f639286f377 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 3.
I20260709 13:18:46.853235  6728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de3186201e1a40d0b335eeb8b4e256e0" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:18:46.845112  6725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce4f062dcd314d43a63ca74067cb5ee3" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:18:46.854398  6872 raft_consensus.cc:2393] T 44bde925b2e541b69890d70715b85176 P cd75a17ab2604397adab03bb8b5fd75c [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ccd8a4c3bfe3413cb2ae219b09aea832 in current term 4: Already voted for candidate cd75a17ab2604397adab03bb8b5fd75c in this term.
I20260709 13:18:46.823354  8068 raft_consensus.cc:515] T ce4f062dcd314d43a63ca74067cb5ee3 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } attrs { replace: true } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:18:46.862700  8146 leader_election.cc:290] T d33d5ee8ef6f415593d8df52063161ad P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 4 election: Requested vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
W20260709 13:18:46.863948  7467 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:46.864275  8068 leader_election.cc:290] T ce4f062dcd314d43a63ca74067cb5ee3 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:18:46.864279  6725 raft_consensus.cc:2468] T ce4f062dcd314d43a63ca74067cb5ee3 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 3.
I20260709 13:18:46.866109  6725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34f36d59d88f40fe8a2805e604fc6c0a" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:18:46.867345  6725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6869f07b5a4885a0b99fbe60c3b175" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 6 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:18:46.855463  6726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17587d6730594da4a56fa13a353232a1" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:18:46.868539  6726 raft_consensus.cc:2468] T 17587d6730594da4a56fa13a353232a1 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in term 4.
I20260709 13:18:46.870021  6726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e326172347f45e99a0d482b5d8ef768" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:18:46.870070  8115 raft_consensus.cc:515] T 95a75bfe094d4bdc963aba3f08dfcd25 P cd75a17ab2604397adab03bb8b5fd75c [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:46.869118  6725 raft_consensus.cc:2410] T bd6869f07b5a4885a0b99fbe60c3b175 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c for term 6 because replica has last-logged OpId of term: 4 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 1.
I20260709 13:18:46.871821  6726 raft_consensus.cc:1275] T 1528ab62b6fe4e3099d08f141afee116 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 3 FOLLOWER]: Refusing update from remote peer cd75a17ab2604397adab03bb8b5fd75c: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:18:46.851266  6772 leader_election.cc:304] T 8c7f33e544204fbaac4078e3e83bbf4e P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:18:46.877652  6772 leader_election.cc:304] T 7ba5dac66ab5497e9e336f2a3c28cda5 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:18:46.872331  6806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34f36d59d88f40fe8a2805e604fc6c0a" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:18:46.872798  7497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce4f062dcd314d43a63ca74067cb5ee3" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:18:46.884672  6728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1704639a875409b9959353527b3fd68" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:18:46.885411  6728 raft_consensus.cc:2468] T a1704639a875409b9959353527b3fd68 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 3.
I20260709 13:18:46.858186  7886 leader_election.cc:290] T 44bde925b2e541b69890d70715b85176 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 4 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:18:46.874680  8157 raft_consensus.cc:493] T 20f6842e26174571996b8dea4151d4be P cd75a17ab2604397adab03bb8b5fd75c [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:46.887327  6772 leader_election.cc:304] T 4275cf08e63345f993bce8664eada830 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:18:46.891482  6772 leader_election.cc:304] T dbdf895bba214ff68685a24fd17dfb5d P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:18:46.893601  6806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6869f07b5a4885a0b99fbe60c3b175" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 6 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:18:46.894834  6772 leader_election.cc:304] T 853ac0a8cbd64ce99457f170216d4d0f P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:18:46.898109  6728 raft_consensus.cc:1275] T 24ee15416e3145beaa1b8183453729a3 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 3 FOLLOWER]: Refusing update from remote peer cd75a17ab2604397adab03bb8b5fd75c: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:18:46.888166  8096 raft_consensus.cc:2804] T 8c7f33e544204fbaac4078e3e83bbf4e P b7ab4784c7344b939bc36f639286f377 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:18:47.083691  6806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e326172347f45e99a0d482b5d8ef768" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:18:46.899194  8074 raft_consensus.cc:2804] T 4275cf08e63345f993bce8664eada830 P b7ab4784c7344b939bc36f639286f377 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 13:18:47.086300  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 384605us
I20260709 13:18:46.890237  8223 raft_consensus.cc:2749] T 7ba5dac66ab5497e9e336f2a3c28cda5 P b7ab4784c7344b939bc36f639286f377 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:18:46.899634  8111 raft_consensus.cc:2804] T dbdf895bba214ff68685a24fd17dfb5d P b7ab4784c7344b939bc36f639286f377 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:18:46.899924  8120 raft_consensus.cc:2804] T 853ac0a8cbd64ce99457f170216d4d0f P b7ab4784c7344b939bc36f639286f377 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:18:47.086797  6873 raft_consensus.cc:2410] T ab432e62819d499eaaf3dd55481dd930 P cd75a17ab2604397adab03bb8b5fd75c [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7ab4784c7344b939bc36f639286f377 for term 4 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:18:46.899875  8230 consensus_queue.cc:1048] T 90d42e216d9741e190bca19a781291fd P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.210s
I20260709 13:18:47.112804  8148 raft_consensus.cc:493] T 24ee15416e3145beaa1b8183453729a3 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:47.113396  8148 raft_consensus.cc:515] T 24ee15416e3145beaa1b8183453729a3 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } attrs { replace: true } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:18:47.114512  8230 consensus_queue.cc:1059] T ce4f062dcd314d43a63ca74067cb5ee3 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: INVALID_TERM, Last received: 3.4, Next index: 5, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:18:46.898977  8245 consensus_queue.cc:1059] T d8cee0accdb8499c86d4414b72565a38 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.205s
I20260709 13:18:47.104326  8120 raft_consensus.cc:493] T 853ac0a8cbd64ce99457f170216d4d0f P b7ab4784c7344b939bc36f639286f377 [term 1 FOLLOWER]: Starting leader election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:18:46.892496  8075 consensus_queue.cc:1048] T 7c44c4849aa54f2b94d1f1bef9ed546f P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.204s
I20260709 13:18:46.897605  8157 raft_consensus.cc:515] T 20f6842e26174571996b8dea4151d4be P cd75a17ab2604397adab03bb8b5fd75c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:47.111411  8146 raft_consensus.cc:493] T 90d42e216d9741e190bca19a781291fd P ccd8a4c3bfe3413cb2ae219b09aea832 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:47.085567  8096 raft_consensus.cc:493] T 8c7f33e544204fbaac4078e3e83bbf4e P b7ab4784c7344b939bc36f639286f377 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:18:47.121694  6844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:47.116918  6723 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49998 (request call id 458) took 1010 ms. Trace:
I20260709 13:18:47.097190  8074 raft_consensus.cc:493] T 4275cf08e63345f993bce8664eada830 P b7ab4784c7344b939bc36f639286f377 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:18:47.134575  6844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:47.138022  6806 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ce4f062dcd314d43a63ca74067cb5ee3"
dest_uuid: "b7ab4784c7344b939bc36f639286f377"
mode: GRACEFUL
new_leader_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
 from {username='slave'} at 127.0.0.1:39350
I20260709 13:18:47.140221  6806 raft_consensus.cc:606] T ce4f062dcd314d43a63ca74067cb5ee3 P b7ab4784c7344b939bc36f639286f377 [term 3 LEADER]: Received request to transfer leadership to TS cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:18:47.099457  8111 raft_consensus.cc:493] T dbdf895bba214ff68685a24fd17dfb5d P b7ab4784c7344b939bc36f639286f377 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:47.134445  6723 rpcz_store.cc:276] 0709 13:18:46.106635 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:46.181026 (+ 74391us) service_pool.cc:224] Handling call
0709 13:18:46.477547 (+296521us) spinlock_profiling.cc:243] Waited 2.59 ms on lock 0x7b5800000c98. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0c745db1 00007fcc0c885b71 00007fcc0c885a22 00007fcc1579ec09 00007fcc148f8ee0 00007fcc149c20ab 00007fcc149c2131 00007fcc14983fc0 00007fcc1496e929 00007fcc1496e3d2 00007fcc0dee5bd4
0709 13:18:46.477757 (+   210us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:46.477948 (+   191us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:18:46.594148 (+116200us) log.cc:844] Serialized 14 byte log entry
0709 13:18:47.116482 (+522334us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:47.116554 (+    72us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:18:47.116613 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:47.116701 (+    88us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:47.116846 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":23339,"prepare.queue_time_us":116199,"prepare.run_cpu_time_us":50,"prepare.run_wall_time_us":52,"raft.queue_time_us":27465,"spinlock_wait_cycles":5964672,"thread_start_us":614355,"threads_started":2}
I20260709 13:18:47.127826  8120 raft_consensus.cc:3060] T 853ac0a8cbd64ce99457f170216d4d0f P b7ab4784c7344b939bc36f639286f377 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:47.117617  7498 raft_consensus.cc:2468] T 427c124d773f483294511e80fe340075 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 3.
I20260709 13:18:47.140388  8096 raft_consensus.cc:3060] T 8c7f33e544204fbaac4078e3e83bbf4e P b7ab4784c7344b939bc36f639286f377 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:47.144788  8074 raft_consensus.cc:3060] T 4275cf08e63345f993bce8664eada830 P b7ab4784c7344b939bc36f639286f377 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:18:47.136706  7468 leader_election.cc:336] T d8cee0accdb8499c86d4414b72565a38 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931): Timed out: RequestConsensusVote RPC to 127.5.126.67:42931 timed out after 1.549s (SENT)
I20260709 13:18:47.150286  8111 raft_consensus.cc:3060] T dbdf895bba214ff68685a24fd17dfb5d P b7ab4784c7344b939bc36f639286f377 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:47.157999  8137 raft_consensus.cc:493] T 4d9def8b32fd443aa94ab1420b06837b P cd75a17ab2604397adab03bb8b5fd75c [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:47.158943  6726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44bde925b2e541b69890d70715b85176" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:18:47.162066  8243 raft_consensus.cc:493] T 711ef6523deb4cbe8ef2ba61e1c21c98 P cd75a17ab2604397adab03bb8b5fd75c [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:47.139782  8146 raft_consensus.cc:515] T 90d42e216d9741e190bca19a781291fd P ccd8a4c3bfe3413cb2ae219b09aea832 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:47.131052  8152 raft_consensus.cc:515] T f03d0dbf16864ca4bc1bb5e4c0334c0f P b7ab4784c7344b939bc36f639286f377 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:47.195652  6723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20f6842e26174571996b8dea4151d4be" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:18:47.193392  6725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a75bfe094d4bdc963aba3f08dfcd25" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:18:47.175089  8148 leader_election.cc:290] T 24ee15416e3145beaa1b8183453729a3 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
W20260709 13:18:47.199625  6772 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 303065us
I20260709 13:18:47.201768  6725 raft_consensus.cc:3060] T 95a75bfe094d4bdc963aba3f08dfcd25 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:18:47.205091  8275 log.cc:927] Time spent T e77e330a82df4b43a745d57a68f6f057 P ccd8a4c3bfe3413cb2ae219b09aea832: Append to log took a long time: real 0.061s	user 0.001s	sys 0.000s
I20260709 13:18:47.206000  6727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce4f062dcd314d43a63ca74067cb5ee3" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:18:47.206755  6727 raft_consensus.cc:2468] T ce4f062dcd314d43a63ca74067cb5ee3 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in term 3.
I20260709 13:18:47.210098  6872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d33d5ee8ef6f415593d8df52063161ad" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:18:47.210744  6872 raft_consensus.cc:3060] T d33d5ee8ef6f415593d8df52063161ad P cd75a17ab2604397adab03bb8b5fd75c [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:18:47.213178  8271 log.cc:927] Time spent T 4d9def8b32fd443aa94ab1420b06837b P b7ab4784c7344b939bc36f639286f377: Append to log took a long time: real 0.091s	user 0.000s	sys 0.001s
I20260709 13:18:47.213418  6877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24ee15416e3145beaa1b8183453729a3" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:18:47.214799  6877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce4f062dcd314d43a63ca74067cb5ee3" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:18:47.215505  6877 raft_consensus.cc:2393] T ce4f062dcd314d43a63ca74067cb5ee3 P cd75a17ab2604397adab03bb8b5fd75c [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ccd8a4c3bfe3413cb2ae219b09aea832 in current term 4: Already voted for candidate cd75a17ab2604397adab03bb8b5fd75c in this term.
I20260709 13:18:47.216413  6697 leader_election.cc:304] T bb3d8792045a4583ae2e965b1350a5b4 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb
I20260709 13:18:47.217666  6697 leader_election.cc:304] T 7c44c4849aa54f2b94d1f1bef9ed546f P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:18:47.218544  7501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "427c124d773f483294511e80fe340075" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb"
I20260709 13:18:47.218745  6697 leader_election.cc:304] T 4275cf08e63345f993bce8664eada830 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:18:47.219327  7501 raft_consensus.cc:2393] T 427c124d773f483294511e80fe340075 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c in current term 3: Already voted for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in this term.
I20260709 13:18:47.220641  6878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "427c124d773f483294511e80fe340075" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:18:47.221403  6878 raft_consensus.cc:2393] T 427c124d773f483294511e80fe340075 P cd75a17ab2604397adab03bb8b5fd75c [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in current term 3: Already voted for candidate cd75a17ab2604397adab03bb8b5fd75c in this term.
I20260709 13:18:47.222676  7499 raft_consensus.cc:1275] T 24ee15416e3145beaa1b8183453729a3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 3 FOLLOWER]: Refusing update from remote peer cd75a17ab2604397adab03bb8b5fd75c: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:18:47.225474  6800 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:32976 (request call id 1864) took 1300 ms. Trace:
I20260709 13:18:47.223838  6728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c7f33e544204fbaac4078e3e83bbf4e" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:18:47.226351  6728 raft_consensus.cc:2468] T 8c7f33e544204fbaac4078e3e83bbf4e P ccd8a4c3bfe3413cb2ae219b09aea832 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 2.
I20260709 13:18:47.225848  6800 rpcz_store.cc:276] 0709 13:18:45.924860 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:45.925392 (+   532us) service_pool.cc:224] Handling call
0709 13:18:46.471122 (+545730us) spinlock_profiling.cc:243] Waited 2.17 ms on lock 0x7b5800003098. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0c745db1 00007fcc0c885b71 00007fcc0c885a22 00007fcc1579ec09 00007fcc148f8ee0 00007fcc149c20ab 00007fcc149c2131 00007fcc14983fc0 00007fcc1496e929 00007fcc1496e3d2 00007fcc0dee5bd4
0709 13:18:46.471308 (+   186us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:46.491155 (+ 19847us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:46.491208 (+    53us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:46.491837 (+   629us) log.cc:844] Serialized 26 byte log entry
0709 13:18:46.581269 (+ 89432us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:18:46.581328 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:46.581533 (+   205us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:47.225193 (+643660us) raft_consensus.cc:1685] finished
0709 13:18:47.225221 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:47.225415 (+   194us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4988160,"thread_start_us":88310,"threads_started":1,"wal-append.queue_time_us":410674}
I20260709 13:18:47.227484  6728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f9c2e2bf644115957398fe4c9459db" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:18:47.228204  6728 raft_consensus.cc:2393] T f3f9c2e2bf644115957398fe4c9459db P ccd8a4c3bfe3413cb2ae219b09aea832 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7ab4784c7344b939bc36f639286f377 in current term 3: Already voted for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in this term.
I20260709 13:18:47.228968  6728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be1a92657f494cac8dd227d152f50151" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:18:47.229508  6724 raft_consensus.cc:1240] T f3f9c2e2bf644115957398fe4c9459db P ccd8a4c3bfe3413cb2ae219b09aea832 [term 3 FOLLOWER]: Rejecting Update request from peer cd75a17ab2604397adab03bb8b5fd75c for earlier term 2. Current term is 3. Ops: []
I20260709 13:18:47.229786  8152 leader_election.cc:290] T f03d0dbf16864ca4bc1bb5e4c0334c0f P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 4 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:18:47.230510  6724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a75bfe094d4bdc963aba3f08dfcd25" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:18:47.231174  8115 leader_election.cc:290] T 95a75bfe094d4bdc963aba3f08dfcd25 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 4 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:18:47.233215  7883 raft_consensus.cc:3055] T f58dc08b12a2494bb9a1372837970ca2 P b7ab4784c7344b939bc36f639286f377 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:18:47.233656  7883 raft_consensus.cc:740] T f58dc08b12a2494bb9a1372837970ca2 P b7ab4784c7344b939bc36f639286f377 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
I20260709 13:18:47.233542  8115 consensus_queue.cc:1048] T 24ee15416e3145beaa1b8183453729a3 P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:18:47.234651  7883 consensus_queue.cc:260] T f58dc08b12a2494bb9a1372837970ca2 P b7ab4784c7344b939bc36f639286f377 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:47.231470  6728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44bde925b2e541b69890d70715b85176" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:18:47.182886  8137 raft_consensus.cc:515] T 4d9def8b32fd443aa94ab1420b06837b P cd75a17ab2604397adab03bb8b5fd75c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
W20260709 13:18:47.238044  6732 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50004 (request call id 1035) took 1845 ms (client timeout 1595 ms). Trace:
W20260709 13:18:47.238483  6732 rpcz_store.cc:269] 0709 13:18:45.392637 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:45.392920 (+   283us) service_pool.cc:224] Handling call
0709 13:18:47.237874 (+1844954us) spinlock_profiling.cc:243] Waited 351 ms on lock 0x7b540031a6d4. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f9ae2fa 00007fcc1496fb17 00007fcc0deea6d4 00007fcc0deea662 00007fcc0deea591 00007fcc0deea50c 00007fcc0dee97c2 00007fcc0dce548c 00007fcc0dce48c6 00007fcc0dce426f
0709 13:18:47.237976 (+   102us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":806913920}
I20260709 13:18:47.238924  8137 leader_election.cc:290] T 4d9def8b32fd443aa94ab1420b06837b P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:18:47.189888  8243 raft_consensus.cc:515] T 711ef6523deb4cbe8ef2ba61e1c21c98 P cd75a17ab2604397adab03bb8b5fd75c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:47.240427  6728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e31b9971c15848dea59d4d4130141d9e" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:18:47.242697  8243 leader_election.cc:290] T 711ef6523deb4cbe8ef2ba61e1c21c98 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:18:47.245054  8157 leader_election.cc:290] T 20f6842e26174571996b8dea4151d4be P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:18:47.245330  6731 raft_consensus.cc:1275] T 7c44c4849aa54f2b94d1f1bef9ed546f P ccd8a4c3bfe3413cb2ae219b09aea832 [term 3 FOLLOWER]: Refusing update from remote peer b7ab4784c7344b939bc36f639286f377: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:18:47.247205  6844 leader_election.cc:304] T d8292e16e5654be6bc408560cf256aaa P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377
W20260709 13:18:47.216508  6847 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:47.244443  6628 catalog_manager.cc:5697] T 3a485a995abc4807b6e511e45419f737 P b7ab4784c7344b939bc36f639286f377 reported cstate change: term changed from 1 to 3, leader changed from ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65) to b7ab4784c7344b939bc36f639286f377 (127.5.126.66). New cstate: current_term: 3 leader_uuid: "b7ab4784c7344b939bc36f639286f377" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:47.248862  6844 leader_election.cc:304] T 853ac0a8cbd64ce99457f170216d4d0f P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:18:47.239765  6732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f03d0dbf16864ca4bc1bb5e4c0334c0f" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:18:47.255369  6732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d9def8b32fd443aa94ab1420b06837b" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:18:47.190673  6726 raft_consensus.cc:3060] T 44bde925b2e541b69890d70715b85176 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:47.242076  6728 raft_consensus.cc:1240] T 2c240553ce044eedb41541d72b9475d7 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 4 FOLLOWER]: Rejecting Update request from peer b7ab4784c7344b939bc36f639286f377 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 13:18:47.248248  7466 leader_election.cc:304] T 3fa34c08b205435dba97346991aa1f92 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:18:47.267005  6877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b8cacb381b746da8d0049b0a83b41dd" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:18:47.268306  6877 raft_consensus.cc:2410] T 4b8cacb381b746da8d0049b0a83b41dd P cd75a17ab2604397adab03bb8b5fd75c [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ba59cc884714e8aa5f3f0ecaed84cbb for term 4 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 13:18:47.260954  6876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3022224cc81473690653a83d4e99470" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:18:47.269150  6876 raft_consensus.cc:3060] T a3022224cc81473690653a83d4e99470 P cd75a17ab2604397adab03bb8b5fd75c [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:47.192647  8075 raft_consensus.cc:3055] T ce4f062dcd314d43a63ca74067cb5ee3 P b7ab4784c7344b939bc36f639286f377 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:18:47.203469  6772 leader_election.cc:304] T bb7fa124c3bf4ef9ab65a407cb008441 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb
W20260709 13:18:47.242308  7467 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:47.231724  6724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3d8792045a4583ae2e965b1350a5b4" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:18:47.255892  6844 leader_election.cc:304] T ce4f062dcd314d43a63ca74067cb5ee3 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, ccd8a4c3bfe3413cb2ae219b09aea832
W20260709 13:18:47.277346  6772 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 74035.8us
I20260709 13:18:47.235893  7883 raft_consensus.cc:3060] T f58dc08b12a2494bb9a1372837970ca2 P b7ab4784c7344b939bc36f639286f377 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:47.284451  6732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab432e62819d499eaaf3dd55481dd930" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:18:47.200630  7498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24ee15416e3145beaa1b8183453729a3" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:18:47.305068  6732 raft_consensus.cc:2468] T ab432e62819d499eaaf3dd55481dd930 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 3.
I20260709 13:18:47.176388  7468 leader_election.cc:304] T d8cee0accdb8499c86d4414b72565a38 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:18:47.306807  6723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "711ef6523deb4cbe8ef2ba61e1c21c98" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:18:47.310293  6844 leader_election.cc:304] T b56bf91d90824c959e21e0cee5ba1816 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:18:47.316486  6874 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53406 (request call id 1064) took 2930 ms. Trace:
I20260709 13:18:47.319896  6728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20f6842e26174571996b8dea4151d4be" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:18:47.212898  6725 raft_consensus.cc:2468] T 95a75bfe094d4bdc963aba3f08dfcd25 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 4.
I20260709 13:18:47.336115  6723 raft_consensus.cc:2393] T 711ef6523deb4cbe8ef2ba61e1c21c98 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7ab4784c7344b939bc36f639286f377 in current term 3: Already voted for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in this term.
I20260709 13:18:47.270937  7993 raft_consensus.cc:2804] T bb3d8792045a4583ae2e965b1350a5b4 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:18:47.264494  8094 raft_consensus.cc:2804] T 7c44c4849aa54f2b94d1f1bef9ed546f P ccd8a4c3bfe3413cb2ae219b09aea832 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:18:47.270718  8068 raft_consensus.cc:2804] T 4275cf08e63345f993bce8664eada830 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:18:47.346799  8068 raft_consensus.cc:493] T 4275cf08e63345f993bce8664eada830 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:47.297456  8152 raft_consensus.cc:2804] T bb7fa124c3bf4ef9ab65a407cb008441 P b7ab4784c7344b939bc36f639286f377 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:18:47.303864  8085 raft_consensus.cc:2749] T ce4f062dcd314d43a63ca74067cb5ee3 P cd75a17ab2604397adab03bb8b5fd75c [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:18:47.343840  6844 leader_election.cc:304] T 7c37d41cd9164c15a6826ca62a851a69 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:18:47.283483  8148 consensus_queue.cc:1048] T dbdf895bba214ff68685a24fd17dfb5d P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.075s
I20260709 13:18:47.271661  8157 raft_consensus.cc:2749] T 853ac0a8cbd64ce99457f170216d4d0f P cd75a17ab2604397adab03bb8b5fd75c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:47.297994  8180 raft_consensus.cc:2749] T 3fa34c08b205435dba97346991aa1f92 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:18:47.347332  8068 raft_consensus.cc:3060] T 4275cf08e63345f993bce8664eada830 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:47.305868  8075 raft_consensus.cc:740] T ce4f062dcd314d43a63ca74067cb5ee3 P b7ab4784c7344b939bc36f639286f377 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
I20260709 13:18:47.350425  8152 raft_consensus.cc:493] T bb7fa124c3bf4ef9ab65a407cb008441 P b7ab4784c7344b939bc36f639286f377 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 7ba59cc884714e8aa5f3f0ecaed84cbb)
I20260709 13:18:47.342617  8094 raft_consensus.cc:493] T 7c44c4849aa54f2b94d1f1bef9ed546f P ccd8a4c3bfe3413cb2ae219b09aea832 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:47.321972  6872 raft_consensus.cc:2468] T d33d5ee8ef6f415593d8df52063161ad P cd75a17ab2604397adab03bb8b5fd75c [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 4.
I20260709 13:18:47.377859  6876 raft_consensus.cc:2468] T a3022224cc81473690653a83d4e99470 P cd75a17ab2604397adab03bb8b5fd75c [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 4.
W20260709 13:18:47.349668  8167 consensus_meta.cc:287] T 22ccee1b570c4ad3a57bd7aec085b1b4 P cd75a17ab2604397adab03bb8b5fd75c: Time spent flushing consensus metadata: real 0.503s	user 0.007s	sys 0.004s
I20260709 13:18:47.289444  8137 consensus_queue.cc:1059] T c4db81d9d329422bb3b4160ca4ac2d1d P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.067s
I20260709 13:18:47.413992  6728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77e330a82df4b43a745d57a68f6f057" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 5 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:18:47.427440  6805 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d33d5ee8ef6f415593d8df52063161ad"
dest_uuid: "b7ab4784c7344b939bc36f639286f377"
mode: GRACEFUL
new_leader_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
 from {username='slave'} at 127.0.0.1:39350
I20260709 13:18:47.428565  6805 raft_consensus.cc:606] T d33d5ee8ef6f415593d8df52063161ad P b7ab4784c7344b939bc36f639286f377 [term 3 LEADER]: Received request to transfer leadership to TS cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:18:47.399945  8152 raft_consensus.cc:3060] T bb7fa124c3bf4ef9ab65a407cb008441 P b7ab4784c7344b939bc36f639286f377 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:47.434929  6872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a734b5ab7834e05a8c422208acc58b1" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:18:47.406093  8094 raft_consensus.cc:3060] T 7c44c4849aa54f2b94d1f1bef9ed546f P ccd8a4c3bfe3413cb2ae219b09aea832 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:47.436897  6730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44bde925b2e541b69890d70715b85176" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
W20260709 13:18:47.438195  6773 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:47.442408  6872 raft_consensus.cc:3060] T 7a734b5ab7834e05a8c422208acc58b1 P cd75a17ab2604397adab03bb8b5fd75c [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:18:47.446758  6697 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 173367us
I20260709 13:18:47.451900  6728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1528ab62b6fe4e3099d08f141afee116" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:18:47.452872  6728 raft_consensus.cc:2468] T 1528ab62b6fe4e3099d08f141afee116 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 3.
I20260709 13:18:47.453931  6728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90d42e216d9741e190bca19a781291fd" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:18:47.427073  6727 raft_consensus.cc:1275] T bd6869f07b5a4885a0b99fbe60c3b175 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 5 FOLLOWER]: Refusing update from remote peer b7ab4784c7344b939bc36f639286f377: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 5 index: 2. (term mismatch)
I20260709 13:18:47.456770  6727 pending_rounds.cc:85] T bd6869f07b5a4885a0b99fbe60c3b175 P ccd8a4c3bfe3413cb2ae219b09aea832: Aborting all ops after (but not including) 1
I20260709 13:18:47.457082  6727 pending_rounds.cc:107] T bd6869f07b5a4885a0b99fbe60c3b175 P ccd8a4c3bfe3413cb2ae219b09aea832: Aborting uncommitted NO_OP operation due to leader change: 4.2
I20260709 13:18:47.457324  6727 raft_consensus.cc:2889] T bd6869f07b5a4885a0b99fbe60c3b175 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:18:47.457500  8247 log.cc:927] Time spent T e77e330a82df4b43a745d57a68f6f057 P b7ab4784c7344b939bc36f639286f377: Append to log took a long time: real 1.419s	user 0.012s	sys 0.000s
I20260709 13:18:47.458632  6807 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:32976 (request call id 1861) took 1764 ms. Trace:
I20260709 13:18:47.459014  6807 rpcz_store.cc:276] 0709 13:18:45.694692 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:45.733859 (+ 39167us) service_pool.cc:224] Handling call
0709 13:18:45.734215 (+   356us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:45.887437 (+153222us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:45.887475 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:45.888942 (+  1467us) log.cc:844] Serialized 26 byte log entry
0709 13:18:46.017139 (+128197us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:18:46.017208 (+    69us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:46.481600 (+464392us) spinlock_profiling.cc:243] Waited 153 ms on lock 0x7b54001f4854. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f9aae01 00007fcc0f9a983e 00007fcc1496e419 00007fcc0dee5bd4 00007fcc0dee5b62 00007fcc0dee5a91 00007fcc0dee5a0c 00007fcc0dee4cc2 00007fcc0dce548c 00007fcc0dce48c6
0709 13:18:46.481635 (+    35us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:47.413492 (+931857us) spinlock_profiling.cc:243] Waited 15.3 ms on lock 0x7b4400022b4c. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0c745db1 00007fcc0c7e3c85 00007fcc0c7e46a2 00007fcc0f5561db 00007fcc0f551aaf 00007fcc0f54586e 00007fcc0f544bb6 00007fcc0f5447d8 00007fcc0f54e221 00007fcc0f54e1d9 00007fcc0f54e169
0709 13:18:47.458436 (+ 44944us) raft_consensus.cc:1685] finished
0709 13:18:47.458456 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:47.458578 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":894,"raft.run_cpu_time_us":112,"raft.run_wall_time_us":113,"spinlock_wait_cycles":386416768,"thread_start_us":127615,"threads_started":1,"wal-append.queue_time_us":148673}
I20260709 13:18:47.460275  8281 raft_consensus.cc:493] T 1bf4668eeb70467fb3dc5a0289233b3c P b7ab4784c7344b939bc36f639286f377 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:47.460911  6807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce4f062dcd314d43a63ca74067cb5ee3" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:18:47.461500  8112 leader_election.cc:290] T 713b5728a197487c9300b310ab94e5a3 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:18:47.463572  6730 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49998 (request call id 464) took 1354 ms. Trace:
I20260709 13:18:47.464186  6730 rpcz_store.cc:276] 0709 13:18:46.108889 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:46.145772 (+ 36883us) service_pool.cc:224] Handling call
0709 13:18:47.436714 (+1290942us) spinlock_profiling.cc:243] Waited 5.31 ms on lock 0x7b5800000c98. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0c745db1 00007fcc0c885b71 00007fcc0c885a22 00007fcc1579ec09 00007fcc148f8ee0 00007fcc149c20ab 00007fcc149c2131 00007fcc149700a0 00007fcc1496f984 00007fcc0deea6d4 00007fcc0deea662
0709 13:18:47.463490 (+ 26776us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":12204928}
I20260709 13:18:47.458547  6727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3411566abe2d4c9bb4b2adfdd05e6f17" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:18:47.465384  6730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4b8bd455d5a47c18a1380839c6e0d61" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:18:47.466056  6730 raft_consensus.cc:2468] T f4b8bd455d5a47c18a1380839c6e0d61 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 2.
I20260709 13:18:47.466861  6730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09c2a98de1a4decabd0ff900dd44caa" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:18:47.468309  6730 raft_consensus.cc:2410] T f09c2a98de1a4decabd0ff900dd44caa P ccd8a4c3bfe3413cb2ae219b09aea832 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7ab4784c7344b939bc36f639286f377 for term 4 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:18:47.435633  8167 raft_consensus.cc:3055] T c4db81d9d329422bb3b4160ca4ac2d1d P cd75a17ab2604397adab03bb8b5fd75c [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:18:47.473026  6730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4275cf08e63345f993bce8664eada830" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:18:47.474961  6727 raft_consensus.cc:2468] T 3411566abe2d4c9bb4b2adfdd05e6f17 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 2.
W20260709 13:18:47.464197  7466 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 196009us
I20260709 13:18:47.497995  6728 raft_consensus.cc:2468] T 90d42e216d9741e190bca19a781291fd P ccd8a4c3bfe3413cb2ae219b09aea832 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 4.
I20260709 13:18:47.490854  8146 leader_election.cc:290] T 90d42e216d9741e190bca19a781291fd P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:18:47.471804  8167 raft_consensus.cc:740] T c4db81d9d329422bb3b4160ca4ac2d1d P cd75a17ab2604397adab03bb8b5fd75c [term 2 LEADER]: Becoming Follower/Learner. State: Replica: cd75a17ab2604397adab03bb8b5fd75c, State: Running, Role: LEADER
I20260709 13:18:47.504222  6728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30e88460611e47b2ba16a46a30b5f416" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:18:47.435031  6876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b3759de40694069b13c0f8bd40e5709" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:18:47.474285  8180 raft_consensus.cc:2749] T d8cee0accdb8499c86d4414b72565a38 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:18:47.513034  6728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1704639a875409b9959353527b3fd68" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:18:47.514189  6728 raft_consensus.cc:2468] T a1704639a875409b9959353527b3fd68 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 3.
W20260709 13:18:47.518265  6697 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 65736.6us
I20260709 13:18:47.511878  6872 raft_consensus.cc:2468] T 7a734b5ab7834e05a8c422208acc58b1 P cd75a17ab2604397adab03bb8b5fd75c [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 4.
I20260709 13:18:47.515146  7466 leader_election.cc:304] T 17587d6730594da4a56fa13a353232a1 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: b7ab4784c7344b939bc36f639286f377
I20260709 13:18:47.528146  6697 leader_election.cc:304] T d33d5ee8ef6f415593d8df52063161ad P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:18:47.472282  8201 consensus_queue.cc:1048] T 20f6842e26174571996b8dea4151d4be P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.032s
I20260709 13:18:47.460945  8281 raft_consensus.cc:515] T 1bf4668eeb70467fb3dc5a0289233b3c P b7ab4784c7344b939bc36f639286f377 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:47.529425  7934 raft_consensus.cc:493] T ab432e62819d499eaaf3dd55481dd930 P cd75a17ab2604397adab03bb8b5fd75c [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:47.538086  6728 raft_consensus.cc:1240] T d33d5ee8ef6f415593d8df52063161ad P ccd8a4c3bfe3413cb2ae219b09aea832 [term 4 FOLLOWER]: Rejecting Update request from peer b7ab4784c7344b939bc36f639286f377 for earlier term 3. Current term is 4. Ops: []
I20260709 13:18:47.561354  6804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be1a92657f494cac8dd227d152f50151" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:18:47.547082  6876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f03d0dbf16864ca4bc1bb5e4c0334c0f" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:18:47.573956  6804 raft_consensus.cc:2468] T be1a92657f494cac8dd227d152f50151 P b7ab4784c7344b939bc36f639286f377 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 3.
W20260709 13:18:47.575604  6804 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:32976 (request call id 1860) took 1883 ms (client timeout 1548 ms). Trace:
I20260709 13:18:47.551843  6872 raft_consensus.cc:1240] T e77e330a82df4b43a745d57a68f6f057 P cd75a17ab2604397adab03bb8b5fd75c [term 5 FOLLOWER]: Rejecting Update request from peer ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 4. Current term is 5. Ops: []
I20260709 13:18:47.577129  6872 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53416 (request call id 1913) took 1170 ms. Trace:
I20260709 13:18:47.578619  6872 rpcz_store.cc:276] 0709 13:18:46.406706 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:47.551068 (+1144362us) service_pool.cc:224] Handling call
0709 13:18:47.551628 (+   560us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:47.576770 (+ 25142us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:47.577054 (+   284us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:18:47.576442  6804 rpcz_store.cc:269] 0709 13:18:45.692640 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:45.692764 (+   124us) service_pool.cc:224] Handling call
0709 13:18:47.561201 (+1868437us) spinlock_profiling.cc:243] Waited 2.73 ms on lock 0x7b5800003098. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0c745db1 00007fcc0c885b71 00007fcc0c885a22 00007fcc1579ec09 00007fcc148f8ee0 00007fcc149c20ab 00007fcc149c2131 00007fcc149700a0 00007fcc1496f984 00007fcc0deea6d4 00007fcc0deea662
0709 13:18:47.575508 (+ 14307us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6285696}
W20260709 13:18:47.564205  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 220444us
I20260709 13:18:47.558099  6697 leader_election.cc:304] T a3022224cc81473690653a83d4e99470 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:18:47.499904  8120 raft_consensus.cc:515] T 853ac0a8cbd64ce99457f170216d4d0f P b7ab4784c7344b939bc36f639286f377 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:47.532912  6726 raft_consensus.cc:2468] T 44bde925b2e541b69890d70715b85176 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 4.
I20260709 13:18:47.467087  8075 consensus_queue.cc:260] T ce4f062dcd314d43a63ca74067cb5ee3 P b7ab4784c7344b939bc36f639286f377 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.4, Last appended by leader: 4, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } attrs { replace: true } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:18:47.553175  6806 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:32966 (request call id 506) took 1012 ms. Trace:
I20260709 13:18:47.588084  6844 leader_election.cc:304] T 427c124d773f483294511e80fe340075 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:18:47.596586  6806 rpcz_store.cc:276] 0709 13:18:46.540905 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:47.155050 (+614145us) service_pool.cc:224] Handling call
0709 13:18:47.168222 (+ 13172us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:47.168433 (+   211us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:18:47.359494 (+191061us) log.cc:844] Serialized 14 byte log entry
0709 13:18:47.552669 (+193175us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:47.552748 (+    79us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:18:47.552812 (+    64us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:47.552911 (+    99us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:47.553093 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":24285,"prepare.queue_time_us":305145,"prepare.run_cpu_time_us":44,"prepare.run_wall_time_us":47,"raft.queue_time_us":134,"raft.run_cpu_time_us":161,"raft.run_wall_time_us":10340,"thread_start_us":368336,"threads_started":2}
I20260709 13:18:47.598340  6728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3f13b31a1f84f0d89d007eadd57924c" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:18:47.571777  8243 raft_consensus.cc:2804] T 7c37d41cd9164c15a6826ca62a851a69 P cd75a17ab2604397adab03bb8b5fd75c [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:18:47.607667  6844 leader_election.cc:304] T f09c2a98de1a4decabd0ff900dd44caa P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:18:47.611430  6844 leader_election.cc:304] T f58dc08b12a2494bb9a1372837970ca2 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:18:47.618791  6844 leader_election.cc:304] T a1704639a875409b9959353527b3fd68 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:18:47.629345  8137 raft_consensus.cc:2804] T f09c2a98de1a4decabd0ff900dd44caa P cd75a17ab2604397adab03bb8b5fd75c [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:18:47.640254  8137 raft_consensus.cc:493] T f09c2a98de1a4decabd0ff900dd44caa P cd75a17ab2604397adab03bb8b5fd75c [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:47.640650  8137 raft_consensus.cc:3060] T f09c2a98de1a4decabd0ff900dd44caa P cd75a17ab2604397adab03bb8b5fd75c [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:47.600706  8138 raft_consensus.cc:2804] T 17587d6730594da4a56fa13a353232a1 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:18:47.551204  8167 consensus_queue.cc:260] T c4db81d9d329422bb3b4160ca4ac2d1d P cd75a17ab2604397adab03bb8b5fd75c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:47.594892  8289 raft_consensus.cc:2804] T d33d5ee8ef6f415593d8df52063161ad P ccd8a4c3bfe3413cb2ae219b09aea832 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:18:47.580715  7934 raft_consensus.cc:515] T ab432e62819d499eaaf3dd55481dd930 P cd75a17ab2604397adab03bb8b5fd75c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:47.593647  6727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a92dd554674067a83a9cb68c4773f2" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:18:47.616930  8112 raft_consensus.cc:2749] T 427c124d773f483294511e80fe340075 P cd75a17ab2604397adab03bb8b5fd75c [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:18:47.652261  8236 raft_consensus.cc:2804] T a1704639a875409b9959353527b3fd68 P cd75a17ab2604397adab03bb8b5fd75c [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:18:47.636889  8085 raft_consensus.cc:2804] T f58dc08b12a2494bb9a1372837970ca2 P cd75a17ab2604397adab03bb8b5fd75c [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:18:47.665254  6879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbdf895bba214ff68685a24fd17dfb5d" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:18:47.665966  6879 raft_consensus.cc:2468] T dbdf895bba214ff68685a24fd17dfb5d P cd75a17ab2604397adab03bb8b5fd75c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 3.
W20260709 13:18:47.666488  6879 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53406 (request call id 1071) took 1901 ms (client timeout 1774 ms). Trace:
W20260709 13:18:47.666829  6879 rpcz_store.cc:269] 0709 13:18:45.764967 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:45.794852 (+ 29885us) service_pool.cc:224] Handling call
0709 13:18:47.665080 (+1870228us) spinlock_profiling.cc:243] Waited 16.8 ms on lock 0x7b5800147c98. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0c745db1 00007fcc0c885b71 00007fcc0c885a22 00007fcc1579ec09 00007fcc148f8ee0 00007fcc149c20ab 00007fcc149c2131 00007fcc149700a0 00007fcc1496f984 00007fcc0deea6d4 00007fcc0deea662
0709 13:18:47.666411 (+  1331us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":38671616}
I20260709 13:18:47.661374  6728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbdf895bba214ff68685a24fd17dfb5d" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:18:47.669445  6879 raft_consensus.cc:1275] T 713b5728a197487c9300b310ab94e5a3 P cd75a17ab2604397adab03bb8b5fd75c [term 3 FOLLOWER]: Refusing update from remote peer ccd8a4c3bfe3413cb2ae219b09aea832: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
I20260709 13:18:47.677580  6879 pending_rounds.cc:85] T 713b5728a197487c9300b310ab94e5a3 P cd75a17ab2604397adab03bb8b5fd75c: Aborting all ops after (but not including) 1
I20260709 13:18:47.677892  6879 pending_rounds.cc:107] T 713b5728a197487c9300b310ab94e5a3 P cd75a17ab2604397adab03bb8b5fd75c: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 13:18:47.678189  6879 raft_consensus.cc:2889] T 713b5728a197487c9300b310ab94e5a3 P cd75a17ab2604397adab03bb8b5fd75c [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:18:47.679092  6879 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53416 (request call id 1915) took 1242 ms. Trace:
I20260709 13:18:47.679457  6879 rpcz_store.cc:276] 0709 13:18:46.436746 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:47.667803 (+1231057us) service_pool.cc:224] Handling call
0709 13:18:47.668979 (+  1176us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:47.678833 (+  9854us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:47.679037 (+   204us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:47.649052  8138 raft_consensus.cc:493] T 17587d6730594da4a56fa13a353232a1 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 4 FOLLOWER]: Starting leader election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:18:47.649746  8115 raft_consensus.cc:2804] T b56bf91d90824c959e21e0cee5ba1816 P cd75a17ab2604397adab03bb8b5fd75c [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:18:47.656258  6726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22ccee1b570c4ad3a57bd7aec085b1b4" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:18:47.680863  6879 pending_rounds.cc:85] T e31b9971c15848dea59d4d4130141d9e P cd75a17ab2604397adab03bb8b5fd75c: Aborting all ops after (but not including) 1
W20260709 13:18:47.638731  7468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 513662us
I20260709 13:18:47.668716  8289 raft_consensus.cc:697] T d33d5ee8ef6f415593d8df52063161ad P ccd8a4c3bfe3413cb2ae219b09aea832 [term 4 LEADER]: Becoming Leader. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
I20260709 13:18:47.694664  6879 pending_rounds.cc:107] T e31b9971c15848dea59d4d4130141d9e P cd75a17ab2604397adab03bb8b5fd75c: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 13:18:47.701637  6879 raft_consensus.cc:2889] T e31b9971c15848dea59d4d4130141d9e P cd75a17ab2604397adab03bb8b5fd75c [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:18:47.701853  6728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "853ac0a8cbd64ce99457f170216d4d0f" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:18:47.664710  8236 raft_consensus.cc:493] T a1704639a875409b9959353527b3fd68 P cd75a17ab2604397adab03bb8b5fd75c [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:47.680002  8167 raft_consensus.cc:3060] T c4db81d9d329422bb3b4160ca4ac2d1d P cd75a17ab2604397adab03bb8b5fd75c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:47.687796  8138 raft_consensus.cc:3060] T 17587d6730594da4a56fa13a353232a1 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:47.683885  8085 raft_consensus.cc:697] T f58dc08b12a2494bb9a1372837970ca2 P cd75a17ab2604397adab03bb8b5fd75c [term 4 LEADER]: Becoming Leader. State: Replica: cd75a17ab2604397adab03bb8b5fd75c, State: Running, Role: LEADER
I20260709 13:18:47.682981  8097 leader_election.cc:290] T 711ef6523deb4cbe8ef2ba61e1c21c98 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
W20260709 13:18:47.738519  7466 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 214046us
I20260709 13:18:47.702243  8169 raft_consensus.cc:2804] T d8292e16e5654be6bc408560cf256aaa P cd75a17ab2604397adab03bb8b5fd75c [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:18:47.686331  7993 raft_consensus.cc:697] T bb3d8792045a4583ae2e965b1350a5b4 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 4 LEADER]: Becoming Leader. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
I20260709 13:18:47.730932  8236 raft_consensus.cc:3060] T a1704639a875409b9959353527b3fd68 P cd75a17ab2604397adab03bb8b5fd75c [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:47.728971  8148 raft_consensus.cc:2804] T a3022224cc81473690653a83d4e99470 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 4 FOLLOWER]: Leader election won for term 4
W20260709 13:18:47.751704  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 121329us
I20260709 13:18:47.682608  8292 consensus_queue.cc:1048] T 24ee15416e3145beaa1b8183453729a3 P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Connected to new peer: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.075s
W20260709 13:18:47.819006  6697 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 260987us
I20260709 13:18:47.750649  6726 raft_consensus.cc:2393] T 22ccee1b570c4ad3a57bd7aec085b1b4 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7ab4784c7344b939bc36f639286f377 in current term 3: Already voted for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in this term.
I20260709 13:18:47.839056  6844 leader_election.cc:304] T f03d0dbf16864ca4bc1bb5e4c0334c0f P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:18:47.823112  8148 raft_consensus.cc:697] T a3022224cc81473690653a83d4e99470 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 4 LEADER]: Becoming Leader. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
W20260709 13:18:47.842463  7467 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:47.827102  6803 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:32966 (request call id 507) took 1279 ms. Trace:
I20260709 13:18:47.824819  8134 raft_consensus.cc:493] T 95a75bfe094d4bdc963aba3f08dfcd25 P b7ab4784c7344b939bc36f639286f377 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:47.888362  8134 raft_consensus.cc:515] T 95a75bfe094d4bdc963aba3f08dfcd25 P b7ab4784c7344b939bc36f639286f377 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:47.891426  8134 leader_election.cc:290] T 95a75bfe094d4bdc963aba3f08dfcd25 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:18:47.892546  6875 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53406 (request call id 1091) took 1562 ms. Trace:
I20260709 13:18:47.893201  8308 consensus_queue.cc:1059] T f3f9c2e2bf644115957398fe4c9459db P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:18:47.894475  8308 raft_consensus.cc:3055] T f3f9c2e2bf644115957398fe4c9459db P cd75a17ab2604397adab03bb8b5fd75c [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:18:47.894834  8308 raft_consensus.cc:740] T f3f9c2e2bf644115957398fe4c9459db P cd75a17ab2604397adab03bb8b5fd75c [term 2 LEADER]: Becoming Follower/Learner. State: Replica: cd75a17ab2604397adab03bb8b5fd75c, State: Running, Role: LEADER
I20260709 13:18:47.893126  6875 rpcz_store.cc:276] 0709 13:18:46.330581 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:47.223334 (+892753us) service_pool.cc:224] Handling call
0709 13:18:47.223788 (+   454us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:47.224301 (+   513us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:47.224330 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:47.224911 (+   581us) log.cc:844] Serialized 26 byte log entry
0709 13:18:47.562006 (+337095us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:18:47.562051 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:47.562144 (+    93us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:47.892209 (+330065us) raft_consensus.cc:1685] finished
0709 13:18:47.892241 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:47.892454 (+   213us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":93,"raft.run_cpu_time_us":87,"raft.run_wall_time_us":88,"thread_start_us":336003,"threads_started":1,"wal-append.queue_time_us":476039}
I20260709 13:18:47.878458  8120 leader_election.cc:290] T 853ac0a8cbd64ce99457f170216d4d0f P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 2 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
W20260709 13:18:47.879299  8294 log.cc:927] Time spent T c4db81d9d329422bb3b4160ca4ac2d1d P b7ab4784c7344b939bc36f639286f377: Append to log took a long time: real 0.188s	user 0.001s	sys 0.000s
I20260709 13:18:47.880410  8157 raft_consensus.cc:2749] T f03d0dbf16864ca4bc1bb5e4c0334c0f P cd75a17ab2604397adab03bb8b5fd75c [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:18:47.881008  6878 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53406 (request call id 1090) took 1553 ms. Trace:
W20260709 13:18:47.898849  8096 consensus_meta.cc:287] T 8c7f33e544204fbaac4078e3e83bbf4e P b7ab4784c7344b939bc36f639286f377: Time spent flushing consensus metadata: real 0.725s	user 0.008s	sys 0.002s
I20260709 13:18:47.883035  6876 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53406 (request call id 1096) took 1474 ms. Trace:
I20260709 13:18:47.899646  6876 rpcz_store.cc:276] 0709 13:18:46.408440 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:47.574613 (+1166173us) service_pool.cc:224] Handling call
0709 13:18:47.596202 (+ 21589us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:47.615875 (+ 19673us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:47.615928 (+    53us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:47.634714 (+ 18786us) log.cc:844] Serialized 26 byte log entry
0709 13:18:47.754641 (+119927us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:18:47.754690 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:47.754787 (+    97us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:47.882740 (+127953us) raft_consensus.cc:1685] finished
0709 13:18:47.882777 (+    37us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:47.882957 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1471,"raft.run_cpu_time_us":185,"raft.run_wall_time_us":20305,"thread_start_us":90233,"threads_started":1,"wal-append.queue_time_us":204228}
I20260709 13:18:47.885398  7934 leader_election.cc:290] T ab432e62819d499eaaf3dd55481dd930 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:18:47.885977  8138 raft_consensus.cc:515] T 17587d6730594da4a56fa13a353232a1 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:18:47.875556  6803 rpcz_store.cc:276] 0709 13:18:46.542777 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:47.224136 (+681359us) service_pool.cc:224] Handling call
0709 13:18:47.224445 (+   309us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:47.224653 (+   208us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:18:47.571174 (+346521us) log.cc:844] Serialized 14 byte log entry
0709 13:18:47.747357 (+176183us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:47.749059 (+  1702us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:18:47.749113 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:47.749203 (+    90us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:47.822215 (+ 73012us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":28605,"prepare.queue_time_us":260842,"prepare.run_cpu_time_us":56,"prepare.run_wall_time_us":58,"raft.queue_time_us":2134,"raft.run_cpu_time_us":167,"raft.run_wall_time_us":4800,"thread_start_us":480608,"threads_started":2}
I20260709 13:18:47.892174  8085 consensus_queue.cc:237] T f58dc08b12a2494bb9a1372837970ca2 P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:47.898329  6731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "711ef6523deb4cbe8ef2ba61e1c21c98" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:18:47.856163  6727 raft_consensus.cc:2955] T ce4f062dcd314d43a63ca74067cb5ee3 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 3 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } attrs { replace: true } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } } }
I20260709 13:18:47.902918  6875 raft_consensus.cc:1275] T 4f00a2e87e56452083b759f60d461ee3 P cd75a17ab2604397adab03bb8b5fd75c [term 4 FOLLOWER]: Refusing update from remote peer 7ba59cc884714e8aa5f3f0ecaed84cbb: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:18:47.929560  6875 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58592 (request call id 49) took 1463 ms. Trace:
I20260709 13:18:47.929970  6875 rpcz_store.cc:276] 0709 13:18:46.466181 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:47.895774 (+1429593us) service_pool.cc:224] Handling call
0709 13:18:47.902527 (+  6753us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:47.929218 (+ 26691us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:47.929495 (+   277us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:47.839453  8112 consensus_queue.cc:1048] T 1528ab62b6fe4e3099d08f141afee116 P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Connected to new peer: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.025s
I20260709 13:18:47.898974  6878 rpcz_store.cc:276] 0709 13:18:46.327410 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:47.222073 (+894663us) service_pool.cc:224] Handling call
0709 13:18:47.222332 (+   259us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:47.222701 (+   369us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:47.222738 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:47.223176 (+   438us) log.cc:844] Serialized 26 byte log entry
0709 13:18:47.686609 (+463433us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:18:47.686663 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:47.686763 (+   100us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:47.880786 (+194023us) raft_consensus.cc:1685] finished
0709 13:18:47.880806 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:47.880949 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":122,"raft.run_cpu_time_us":94,"raft.run_wall_time_us":95,"thread_start_us":377715,"threads_started":1,"wal-append.queue_time_us":464153}
I20260709 13:18:47.936693  6878 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58592 (request call id 51) took 1424 ms. Trace:
I20260709 13:18:47.937099  6878 rpcz_store.cc:276] 0709 13:18:46.512293 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:47.935894 (+1423601us) service_pool.cc:224] Handling call
0709 13:18:47.936222 (+   328us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:47.936376 (+   154us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:47.936401 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:47.936441 (+    40us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:18:47.936470 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:47.936523 (+    53us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:47.936637 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:18:47.908470  7466 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 163955us
I20260709 13:18:47.901712  8152 raft_consensus.cc:515] T bb7fa124c3bf4ef9ab65a407cb008441 P b7ab4784c7344b939bc36f639286f377 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:18:47.929251  6731 raft_consensus.cc:2468] T 711ef6523deb4cbe8ef2ba61e1c21c98 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 3.
I20260709 13:18:47.873071  8281 leader_election.cc:290] T 1bf4668eeb70467fb3dc5a0289233b3c P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:18:47.951512  8238 leader_election.cc:290] T 1528ab62b6fe4e3099d08f141afee116 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:18:47.952826  6875 raft_consensus.cc:1240] T bb3d8792045a4583ae2e965b1350a5b4 P cd75a17ab2604397adab03bb8b5fd75c [term 4 FOLLOWER]: Rejecting Update request from peer 7ba59cc884714e8aa5f3f0ecaed84cbb for earlier term 3. Current term is 4. Ops: [3.5-3.5]
I20260709 13:18:47.953671  6875 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58592 (request call id 50) took 1468 ms. Trace:
I20260709 13:18:47.953969  6875 rpcz_store.cc:276] 0709 13:18:46.485562 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:47.940548 (+1454986us) service_pool.cc:224] Handling call
0709 13:18:47.952512 (+ 11964us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:47.953354 (+   842us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:47.953606 (+   252us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:47.957000  8180 raft_consensus.cc:493] T bb3d8792045a4583ae2e965b1350a5b4 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:47.957541  8180 raft_consensus.cc:515] T bb3d8792045a4583ae2e965b1350a5b4 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:18:47.958211  6725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34f36d59d88f40fe8a2805e604fc6c0a" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:18:47.959556  8180 leader_election.cc:290] T bb3d8792045a4583ae2e965b1350a5b4 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
W20260709 13:18:47.960641  8285 log.cc:927] Time spent T 1528ab62b6fe4e3099d08f141afee116 P 7ba59cc884714e8aa5f3f0ecaed84cbb: Append to log took a long time: real 0.125s	user 0.000s	sys 0.000s
I20260709 13:18:47.961350  6731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b3759de40694069b13c0f8bd40e5709" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:18:47.962191  8230 raft_consensus.cc:3055] T d8cee0accdb8499c86d4414b72565a38 P b7ab4784c7344b939bc36f639286f377 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:18:47.962685  8230 raft_consensus.cc:740] T d8cee0accdb8499c86d4414b72565a38 P b7ab4784c7344b939bc36f639286f377 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
I20260709 13:18:47.963100  6726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f03d0dbf16864ca4bc1bb5e4c0334c0f" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:18:47.964310  8281 raft_consensus.cc:493] T 713b5728a197487c9300b310ab94e5a3 P b7ab4784c7344b939bc36f639286f377 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:47.964358  6725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a734b5ab7834e05a8c422208acc58b1" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:18:47.962510  6731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "853ac0a8cbd64ce99457f170216d4d0f" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:18:47.965085  8281 raft_consensus.cc:515] T 713b5728a197487c9300b310ab94e5a3 P b7ab4784c7344b939bc36f639286f377 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:47.966626  8169 raft_consensus.cc:493] T d8292e16e5654be6bc408560cf256aaa P cd75a17ab2604397adab03bb8b5fd75c [term 3 FOLLOWER]: Starting leader election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:18:47.967176  8169 raft_consensus.cc:3060] T d8292e16e5654be6bc408560cf256aaa P cd75a17ab2604397adab03bb8b5fd75c [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:47.962103  6723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bf4668eeb70467fb3dc5a0289233b3c" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:18:47.960503  6881 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53416 (request call id 1892) took 1951 ms. Trace:
W20260709 13:18:47.969100  8297 log.cc:927] Time spent T b56bf91d90824c959e21e0cee5ba1816 P cd75a17ab2604397adab03bb8b5fd75c: Append to log took a long time: real 0.093s	user 0.000s	sys 0.000s
W20260709 13:18:47.969983  8278 log.cc:927] Time spent T 07a92dd554674067a83a9cb68c4773f2 P cd75a17ab2604397adab03bb8b5fd75c: Append to log took a long time: real 0.788s	user 0.001s	sys 0.000s
I20260709 13:18:47.969182  6881 rpcz_store.cc:276] 0709 13:18:46.009195 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:46.009928 (+   733us) service_pool.cc:224] Handling call
0709 13:18:46.038405 (+ 28477us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:46.146195 (+107790us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:47.960244 (+1814049us) spinlock_profiling.cc:243] Waited 60 ms on lock 0x7b54001e91d4. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f9aae01 00007fcc0f9a983e 00007fcc1496e419 00007fcc0dee5bd4 00007fcc0dee5b62 00007fcc0dee5a91 00007fcc0dee5a0c 00007fcc0dee4cc2 00007fcc0dce548c 00007fcc0dce48c6
0709 13:18:47.960442 (+   198us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":137989888}
I20260709 13:18:47.963656  8230 consensus_queue.cc:260] T d8cee0accdb8499c86d4414b72565a38 P b7ab4784c7344b939bc36f639286f377 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:18:47.975340  6877 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53406 (request call id 1095) took 1634 ms. Trace:
I20260709 13:18:47.975953  8230 raft_consensus.cc:3060] T d8cee0accdb8499c86d4414b72565a38 P b7ab4784c7344b939bc36f639286f377 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:47.976616  6880 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53416 (request call id 1908) took 1666 ms. Trace:
I20260709 13:18:47.976215  8148 consensus_queue.cc:237] T a3022224cc81473690653a83d4e99470 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:47.976984  6880 rpcz_store.cc:276] 0709 13:18:46.310375 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:46.822773 (+512398us) service_pool.cc:224] Handling call
0709 13:18:46.823072 (+   299us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:46.823270 (+   198us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:46.823293 (+    23us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:46.831557 (+  8264us) log.cc:844] Serialized 26 byte log entry
0709 13:18:46.886315 (+ 54758us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:18:46.886389 (+    74us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:46.886482 (+    93us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:47.969383 (+1082901us) spinlock_profiling.cc:243] Waited 3.63 ms on lock 0x7b4400022b4c. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0c745db1 00007fcc0c7e3c85 00007fcc0c7e46a2 00007fcc0f5561db 00007fcc0f551aaf 00007fcc0f54586e 00007fcc0f544bb6 00007fcc0f5447d8 00007fcc0f54e221 00007fcc0f54e1d9 00007fcc0f54e169
0709 13:18:47.976326 (+  6943us) raft_consensus.cc:1685] finished
0709 13:18:47.976351 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:47.976557 (+   206us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":8352000,"thread_start_us":51636,"threads_started":1,"wal-append.queue_time_us":305875}
I20260709 13:18:47.979468  6803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c44c4849aa54f2b94d1f1bef9ed546f" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:18:47.972954  6799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c240553ce044eedb41541d72b9475d7" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:18:47.981025  6799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f58dc08b12a2494bb9a1372837970ca2" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:18:47.981387  6805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "427c124d773f483294511e80fe340075" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:18:47.981664  6799 raft_consensus.cc:2468] T f58dc08b12a2494bb9a1372837970ca2 P b7ab4784c7344b939bc36f639286f377 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 4.
I20260709 13:18:47.982115  6806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44bde925b2e541b69890d70715b85176" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:18:47.982534  6799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90d42e216d9741e190bca19a781291fd" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:18:47.982695  6806 raft_consensus.cc:2468] T 44bde925b2e541b69890d70715b85176 P b7ab4784c7344b939bc36f639286f377 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 3.
I20260709 13:18:47.973701  6804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4275cf08e63345f993bce8664eada830" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:18:47.983616  6806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24ee15416e3145beaa1b8183453729a3" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:18:47.871479  7468 leader_election.cc:304] T 427c124d773f483294511e80fe340075 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, b7ab4784c7344b939bc36f639286f377; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:18:47.941610  7993 consensus_queue.cc:237] T bb3d8792045a4583ae2e965b1350a5b4 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:18:47.336807  6874 rpcz_store.cc:276] 0709 13:18:44.386167 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:44.626442 (+240275us) service_pool.cc:224] Handling call
0709 13:18:44.818594 (+192152us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:44.819724 (+  1130us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:44.819755 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:45.205204 (+385449us) log.cc:844] Serialized 26 byte log entry
0709 13:18:45.434549 (+229345us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:18:45.434605 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:45.434714 (+   109us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:46.249780 (+815066us) spinlock_profiling.cc:243] Waited 1.57 ms on lock 0x7b4400022b4c. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0c745db1 00007fcc0c7e3c85 00007fcc0c7e46a2 00007fcc0f5561db 00007fcc0f551aaf 00007fcc0f54586e 00007fcc0f544bb6 00007fcc0f5447d8 00007fcc0f54e221 00007fcc0f54e1d9 00007fcc0f54e169
0709 13:18:46.307665 (+ 57885us) raft_consensus.cc:1685] finished
0709 13:18:46.307700 (+    35us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:47.316186 (+1008486us) spinlock_profiling.cc:243] Waited 192 ms on lock 0x7b5400348350. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f9a98ad 00007fcc1496e419 00007fcc0dee5bd4 00007fcc0dee5b62 00007fcc0dee5a91 00007fcc0dee5a0c 00007fcc0dee4cc2 00007fcc0dce548c 00007fcc0dce48c6 00007fcc0dce426f
0709 13:18:47.316390 (+   204us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":656,"raft.queue_time_us":30984,"raft.run_cpu_time_us":267,"raft.run_wall_time_us":32375,"spinlock_wait_cycles":444287744,"thread_start_us":228884,"threads_started":1,"wal-append.queue_time_us":351638,"wal-append.run_cpu_time_us":10115,"wal-append.run_wall_time_us":1771446}
W20260709 13:18:47.989308  7503 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50756 (request call id 106) took 1878 ms (client timeout 1995 ms). Trace:
I20260709 13:18:47.989462  8152 leader_election.cc:290] T bb7fa124c3bf4ef9ab65a407cb008441 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 3 election: Requested vote from peers cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
W20260709 13:18:47.989816  7503 rpcz_store.cc:269] 0709 13:18:46.140964 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:46.141199 (+   235us) service_pool.cc:224] Handling call
0709 13:18:47.989088 (+1847889us) spinlock_profiling.cc:243] Waited 119 ms on lock 0x7b5400496454. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f9ae2fa 00007fcc1496fb17 00007fcc0deea6d4 00007fcc0deea662 00007fcc0deea591 00007fcc0deea50c 00007fcc0dee97c2 00007fcc0dce548c 00007fcc0dce48c6 00007fcc0dce426f
0709 13:18:47.989228 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":274123136}
I20260709 13:18:47.990295  6800 raft_consensus.cc:1240] T bb7fa124c3bf4ef9ab65a407cb008441 P b7ab4784c7344b939bc36f639286f377 [term 3 FOLLOWER]: Rejecting Update request from peer 7ba59cc884714e8aa5f3f0ecaed84cbb for earlier term 2. Current term is 3. Ops: []
I20260709 13:18:47.992707  7500 raft_consensus.cc:2955] T ce4f062dcd314d43a63ca74067cb5ee3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 3 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } attrs { replace: true } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } } }
I20260709 13:18:47.995913  8243 raft_consensus.cc:493] T 7c37d41cd9164c15a6826ca62a851a69 P cd75a17ab2604397adab03bb8b5fd75c [term 2 FOLLOWER]: Starting leader election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:18:47.996488  8243 raft_consensus.cc:3060] T 7c37d41cd9164c15a6826ca62a851a69 P cd75a17ab2604397adab03bb8b5fd75c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:47.823978  8289 consensus_queue.cc:237] T d33d5ee8ef6f415593d8df52063161ad P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:47.999444  8169 raft_consensus.cc:515] T d8292e16e5654be6bc408560cf256aaa P cd75a17ab2604397adab03bb8b5fd75c [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:48.002132  6798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce4f062dcd314d43a63ca74067cb5ee3" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:18:48.003531  6805 raft_consensus.cc:3060] T 427c124d773f483294511e80fe340075 P b7ab4784c7344b939bc36f639286f377 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:18:48.016292  6695 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:47.975751  6877 rpcz_store.cc:276] 0709 13:18:46.340442 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:47.274384 (+933942us) service_pool.cc:224] Handling call
0709 13:18:47.274867 (+   483us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:47.275309 (+   442us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:47.275348 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:47.275937 (+   589us) log.cc:844] Serialized 26 byte log entry
0709 13:18:47.641790 (+365853us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:18:47.641835 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:47.643623 (+  1788us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:47.975089 (+331466us) raft_consensus.cc:1685] finished
0709 13:18:47.975110 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:47.975263 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":10785,"raft.queue_time_us":7884,"raft.run_cpu_time_us":153,"raft.run_wall_time_us":6717,"thread_start_us":365471,"threads_started":1,"wal-append.queue_time_us":548976}
W20260709 13:18:48.017088  6695 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:48.013561  6847 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:48.004545  6628 catalog_manager.cc:5697] T 7c44c4849aa54f2b94d1f1bef9ed546f P b7ab4784c7344b939bc36f639286f377 reported cstate change: term changed from 1 to 2, leader changed from ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65) to cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67). New cstate: current_term: 2 leader_uuid: "cd75a17ab2604397adab03bb8b5fd75c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } }
W20260709 13:18:48.020713  6770 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:47.899472  8096 raft_consensus.cc:515] T 8c7f33e544204fbaac4078e3e83bbf4e P b7ab4784c7344b939bc36f639286f377 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
W20260709 13:18:48.023823  6770 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:47.983829  8111 consensus_meta.cc:287] T dbdf895bba214ff68685a24fd17dfb5d P b7ab4784c7344b939bc36f639286f377: Time spent flushing consensus metadata: real 0.802s	user 0.008s	sys 0.003s
W20260709 13:18:48.006345  8068 consensus_meta.cc:287] T 4275cf08e63345f993bce8664eada830 P ccd8a4c3bfe3413cb2ae219b09aea832: Time spent flushing consensus metadata: real 0.602s	user 0.008s	sys 0.002s
I20260709 13:18:48.036500  6697 leader_election.cc:304] T ce4f062dcd314d43a63ca74067cb5ee3 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:18:48.037810  6728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a75bfe094d4bdc963aba3f08dfcd25" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
W20260709 13:18:48.039465  6729 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49998 (request call id 483) took 1492 ms (client timeout 1927 ms). Trace:
I20260709 13:18:48.040143  6728 raft_consensus.cc:2393] T 95a75bfe094d4bdc963aba3f08dfcd25 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7ab4784c7344b939bc36f639286f377 in current term 4: Already voted for candidate cd75a17ab2604397adab03bb8b5fd75c in this term.
W20260709 13:18:48.039959  6729 rpcz_store.cc:269] 0709 13:18:46.547188 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:46.554769 (+  7581us) service_pool.cc:224] Handling call
0709 13:18:48.039286 (+1484517us) spinlock_profiling.cc:243] Waited 21.9 ms on lock 0x7b540020a8d4. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f9ae2fa 00007fcc1496fb17 00007fcc0deea6d4 00007fcc0deea662 00007fcc0deea591 00007fcc0deea50c 00007fcc0dee97c2 00007fcc0dce548c 00007fcc0dce48c6 00007fcc0dce426f
0709 13:18:48.039405 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":50402048}
I20260709 13:18:48.038949  6695 leader_election.cc:304] T 7887766dc6784fcaa42b35c05fea7a99 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: cd75a17ab2604397adab03bb8b5fd75c
W20260709 13:18:48.042222  6846 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:48.052775  6773 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:48.030941  8074 consensus_meta.cc:287] T 4275cf08e63345f993bce8664eada830 P b7ab4784c7344b939bc36f639286f377: Time spent flushing consensus metadata: real 0.855s	user 0.006s	sys 0.006s
I20260709 13:18:48.059720  6723 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f3f9c2e2bf644115957398fe4c9459db"
dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
mode: GRACEFUL
new_leader_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
 from {username='slave'} at 127.0.0.1:38536
I20260709 13:18:48.060765  6723 raft_consensus.cc:606] T f3f9c2e2bf644115957398fe4c9459db P ccd8a4c3bfe3413cb2ae219b09aea832 [term 3 FOLLOWER]: Received request to transfer leadership to TS cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:18:48.061242  6723 raft_consensus.cc:614] T f3f9c2e2bf644115957398fe4c9459db P ccd8a4c3bfe3413cb2ae219b09aea832 [term 3 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:18:48.062031  6846 leader_election.cc:304] T ce4f062dcd314d43a63ca74067cb5ee3 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:18:47.967834  8281 leader_election.cc:290] T 713b5728a197487c9300b310ab94e5a3 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
W20260709 13:18:48.032408  6770 connection.cc:256] RPC call timeout handler was delayed by -1.1759959329999674s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.23620000000000002s for a response
W20260709 13:18:48.067086  6770 connection.cc:256] RPC call timeout handler was delayed by -1.1120887160000166s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.31570000000000004s for a response
W20260709 13:18:48.067458  6770 connection.cc:256] RPC call timeout handler was delayed by -1.0948813140000766s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1539s for a response
I20260709 13:18:48.069034  6697 leader_election.cc:304] T 24ee15416e3145beaa1b8183453729a3 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:18:48.070327  6770 leader_election.cc:304] T 427c124d773f483294511e80fe340075 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
W20260709 13:18:48.070576  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 231612us
I20260709 13:18:48.073745  6805 raft_consensus.cc:2468] T 427c124d773f483294511e80fe340075 P b7ab4784c7344b939bc36f639286f377 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 3.
I20260709 13:18:48.029477  6877 raft_consensus.cc:1240] T d8cee0accdb8499c86d4414b72565a38 P cd75a17ab2604397adab03bb8b5fd75c [term 4 FOLLOWER]: Rejecting Update request from peer b7ab4784c7344b939bc36f639286f377 for earlier term 3. Current term is 4. Ops: [3.5-3.5]
I20260709 13:18:48.008100  6806 raft_consensus.cc:2468] T 24ee15416e3145beaa1b8183453729a3 P b7ab4784c7344b939bc36f639286f377 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 3.
I20260709 13:18:48.003943  6798 raft_consensus.cc:1275] T e31b9971c15848dea59d4d4130141d9e P b7ab4784c7344b939bc36f639286f377 [term 3 FOLLOWER]: Refusing update from remote peer ccd8a4c3bfe3413cb2ae219b09aea832: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:18:48.080379  6800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1528ab62b6fe4e3099d08f141afee116" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:18:48.081234  6800 raft_consensus.cc:2468] T 1528ab62b6fe4e3099d08f141afee116 P b7ab4784c7344b939bc36f639286f377 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in term 3.
I20260709 13:18:48.077261  6770 leader_election.cc:304] T 3d65025eea89441290d85dd053810e31 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:18:48.084331  6770 leader_election.cc:304] T f5be3a11b23d4ea9b08300a2789821c7 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:18:48.037940  8306 raft_consensus.cc:493] T bd6869f07b5a4885a0b99fbe60c3b175 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:48.021433  8137 raft_consensus.cc:515] T f09c2a98de1a4decabd0ff900dd44caa P cd75a17ab2604397adab03bb8b5fd75c [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:48.104251  8146 raft_consensus.cc:2749] T 24ee15416e3145beaa1b8183453729a3 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:18:48.105386  8146 consensus_queue.cc:1048] T 07a92dd554674067a83a9cb68c4773f2 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:18:48.106231  8305 consensus_queue.cc:1059] T 9b3759de40694069b13c0f8bd40e5709 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:18:48.108534  7496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb7fa124c3bf4ef9ab65a407cb008441" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb"
W20260709 13:18:48.110510  8301 log.cc:927] Time spent T 4f00a2e87e56452083b759f60d461ee3 P b7ab4784c7344b939bc36f639286f377: Append to log took a long time: real 0.255s	user 0.000s	sys 0.001s
I20260709 13:18:48.058990  8201 consensus_queue.cc:1048] T de3186201e1a40d0b335eeb8b4e256e0 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.020s
I20260709 13:18:48.059773  8295 raft_consensus.cc:2749] T 427c124d773f483294511e80fe340075 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:18:48.057929  6874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "711ef6523deb4cbe8ef2ba61e1c21c98" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:18:47.981029  6803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3022224cc81473690653a83d4e99470" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:18:47.895696  8308 consensus_queue.cc:260] T f3f9c2e2bf644115957398fe4c9459db P cd75a17ab2604397adab03bb8b5fd75c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:47.983634  6799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d33d5ee8ef6f415593d8df52063161ad" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:18:48.022636  8290 raft_consensus.cc:493] T 9e326172347f45e99a0d482b5d8ef768 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:18:48.071856  6844 leader_election.cc:304] T 95a75bfe094d4bdc963aba3f08dfcd25 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:18:48.107501  8157 raft_consensus.cc:2804] T ce4f062dcd314d43a63ca74067cb5ee3 P cd75a17ab2604397adab03bb8b5fd75c [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:18:48.055974  6772 leader_election.cc:304] T 7a734b5ab7834e05a8c422208acc58b1 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:18:48.059535  8292 raft_consensus.cc:493] T 8c7f33e544204fbaac4078e3e83bbf4e P cd75a17ab2604397adab03bb8b5fd75c [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:48.113978  6770 leader_election.cc:304] T 7887766dc6784fcaa42b35c05fea7a99 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:18:48.102867  8281 raft_consensus.cc:2804] T 3d65025eea89441290d85dd053810e31 P b7ab4784c7344b939bc36f639286f377 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:18:48.084401  8066 raft_consensus.cc:2804] T 7887766dc6784fcaa42b35c05fea7a99 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:18:48.076848  6877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb7fa124c3bf4ef9ab65a407cb008441" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:18:48.038105  8111 raft_consensus.cc:515] T dbdf895bba214ff68685a24fd17dfb5d P b7ab4784c7344b939bc36f639286f377 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:48.104208  8169 leader_election.cc:290] T d8292e16e5654be6bc408560cf256aaa P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 4 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
W20260709 13:18:48.100746  8094 consensus_meta.cc:287] T 7c44c4849aa54f2b94d1f1bef9ed546f P ccd8a4c3bfe3413cb2ae219b09aea832: Time spent flushing consensus metadata: real 0.637s	user 0.012s	sys 0.000s
W20260709 13:18:48.128852  6772 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 72959.2us
I20260709 13:18:48.062736  8304 consensus_queue.cc:1059] T 3fa34c08b205435dba97346991aa1f92 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.054s
I20260709 13:18:48.121258  8134 raft_consensus.cc:2804] T f5be3a11b23d4ea9b08300a2789821c7 P b7ab4784c7344b939bc36f639286f377 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:18:48.148196  8094 raft_consensus.cc:515] T 7c44c4849aa54f2b94d1f1bef9ed546f P ccd8a4c3bfe3413cb2ae219b09aea832 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:48.149536  8111 leader_election.cc:290] T dbdf895bba214ff68685a24fd17dfb5d P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 4 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:18:48.150697  8094 leader_election.cc:290] T 7c44c4849aa54f2b94d1f1bef9ed546f P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 4 election: Requested vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:18:48.152400  8112 raft_consensus.cc:2804] T 95a75bfe094d4bdc963aba3f08dfcd25 P cd75a17ab2604397adab03bb8b5fd75c [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:18:48.153081  8112 raft_consensus.cc:697] T 95a75bfe094d4bdc963aba3f08dfcd25 P cd75a17ab2604397adab03bb8b5fd75c [term 4 LEADER]: Becoming Leader. State: Replica: cd75a17ab2604397adab03bb8b5fd75c, State: Running, Role: LEADER
I20260709 13:18:48.154008  8112 consensus_queue.cc:237] T 95a75bfe094d4bdc963aba3f08dfcd25 P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:48.156659  8138 leader_election.cc:290] T 17587d6730594da4a56fa13a353232a1 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 5 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:18:48.128824  6803 raft_consensus.cc:3060] T a3022224cc81473690653a83d4e99470 P b7ab4784c7344b939bc36f639286f377 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:48.128332  8157 raft_consensus.cc:493] T ce4f062dcd314d43a63ca74067cb5ee3 P cd75a17ab2604397adab03bb8b5fd75c [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:48.160785  6801 raft_consensus.cc:1240] T dbdf895bba214ff68685a24fd17dfb5d P b7ab4784c7344b939bc36f639286f377 [term 4 FOLLOWER]: Rejecting Update request from peer ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 3. Current term is 4. Ops: []
I20260709 13:18:48.161142  8157 raft_consensus.cc:3060] T ce4f062dcd314d43a63ca74067cb5ee3 P cd75a17ab2604397adab03bb8b5fd75c [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:48.165318  8137 leader_election.cc:290] T f09c2a98de1a4decabd0ff900dd44caa P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 4 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:18:48.141171  8066 raft_consensus.cc:493] T 7887766dc6784fcaa42b35c05fea7a99 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 2 FOLLOWER]: Starting leader election (detected failure of leader cd75a17ab2604397adab03bb8b5fd75c)
I20260709 13:18:48.166278  8066 raft_consensus.cc:3060] T 7887766dc6784fcaa42b35c05fea7a99 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:48.168126  8317 raft_consensus.cc:3055] T 9b3759de40694069b13c0f8bd40e5709 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:18:48.168555  8317 raft_consensus.cc:740] T 9b3759de40694069b13c0f8bd40e5709 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
I20260709 13:18:48.169358  8317 consensus_queue.cc:260] T 9b3759de40694069b13c0f8bd40e5709 P ccd8a4c3bfe3413cb2ae219b09aea832 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:48.131898  8290 raft_consensus.cc:515] T 9e326172347f45e99a0d482b5d8ef768 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:48.172482  8290 leader_election.cc:290] T 9e326172347f45e99a0d482b5d8ef768 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:18:48.172690  8134 raft_consensus.cc:493] T f5be3a11b23d4ea9b08300a2789821c7 P b7ab4784c7344b939bc36f639286f377 [term 3 FOLLOWER]: Starting leader election (detected failure of leader cd75a17ab2604397adab03bb8b5fd75c)
I20260709 13:18:48.173123  8134 raft_consensus.cc:3060] T f5be3a11b23d4ea9b08300a2789821c7 P b7ab4784c7344b939bc36f639286f377 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:48.174281  8236 raft_consensus.cc:515] T a1704639a875409b9959353527b3fd68 P cd75a17ab2604397adab03bb8b5fd75c [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:48.117654  6874 raft_consensus.cc:2468] T 711ef6523deb4cbe8ef2ba61e1c21c98 P cd75a17ab2604397adab03bb8b5fd75c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 3.
I20260709 13:18:48.062500  8068 raft_consensus.cc:515] T 4275cf08e63345f993bce8664eada830 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:48.134276  6770 leader_election.cc:304] T c4db81d9d329422bb3b4160ca4ac2d1d P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:18:48.118466  8306 raft_consensus.cc:515] T bd6869f07b5a4885a0b99fbe60c3b175 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:48.136281  6877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90d42e216d9741e190bca19a781291fd" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:18:48.079339  8280 raft_consensus.cc:2749] T 427c124d773f483294511e80fe340075 P b7ab4784c7344b939bc36f639286f377 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:18:48.069705  8074 raft_consensus.cc:515] T 4275cf08e63345f993bce8664eada830 P b7ab4784c7344b939bc36f639286f377 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:48.184368  8236 leader_election.cc:290] T a1704639a875409b9959353527b3fd68 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 4 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:18:48.186115  8074 leader_election.cc:290] T 4275cf08e63345f993bce8664eada830 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 3 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
W20260709 13:18:48.186591  8303 log.cc:927] Time spent T 17587d6730594da4a56fa13a353232a1 P ccd8a4c3bfe3413cb2ae219b09aea832: Append to log took a long time: real 0.232s	user 0.000s	sys 0.001s
W20260709 13:18:48.086596  7468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 230184us
I20260709 13:18:48.134917  8281 raft_consensus.cc:493] T 3d65025eea89441290d85dd053810e31 P b7ab4784c7344b939bc36f639286f377 [term 1 FOLLOWER]: Starting leader election (detected failure of leader cd75a17ab2604397adab03bb8b5fd75c)
I20260709 13:18:48.187382  8281 raft_consensus.cc:3060] T 3d65025eea89441290d85dd053810e31 P b7ab4784c7344b939bc36f639286f377 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:48.189211  6804 raft_consensus.cc:2393] T 4275cf08e63345f993bce8664eada830 P b7ab4784c7344b939bc36f639286f377 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ccd8a4c3bfe3413cb2ae219b09aea832 in current term 3: Already voted for candidate b7ab4784c7344b939bc36f639286f377 in this term.
I20260709 13:18:48.190485  6803 raft_consensus.cc:2468] T a3022224cc81473690653a83d4e99470 P b7ab4784c7344b939bc36f639286f377 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 4.
I20260709 13:18:48.139299  8223 raft_consensus.cc:2804] T 7887766dc6784fcaa42b35c05fea7a99 P b7ab4784c7344b939bc36f639286f377 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:18:48.180413  8111 raft_consensus.cc:3060] T c4db81d9d329422bb3b4160ca4ac2d1d P b7ab4784c7344b939bc36f639286f377 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:48.137008  8292 raft_consensus.cc:515] T 8c7f33e544204fbaac4078e3e83bbf4e P cd75a17ab2604397adab03bb8b5fd75c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:48.181960  6730 raft_consensus.cc:2393] T 4275cf08e63345f993bce8664eada830 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7ab4784c7344b939bc36f639286f377 in current term 3: Already voted for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in this term.
I20260709 13:18:48.160847  8096 leader_election.cc:290] T 8c7f33e544204fbaac4078e3e83bbf4e P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 3 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:18:48.182761  8068 leader_election.cc:290] T 4275cf08e63345f993bce8664eada830 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 3 election: Requested vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:18:48.133131  8245 raft_consensus.cc:2804] T 7a734b5ab7834e05a8c422208acc58b1 P b7ab4784c7344b939bc36f639286f377 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:18:48.107548  8146 consensus_queue.cc:1059] T e77e330a82df4b43a745d57a68f6f057 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: INVALID_TERM, Last received: 4.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.014s
I20260709 13:18:48.118191  8180 consensus_queue.cc:1059] T bb7fa124c3bf4ef9ab65a407cb008441 P 7ba59cc884714e8aa5f3f0ecaed84cbb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.059s
I20260709 13:18:48.192420  6877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a75bfe094d4bdc963aba3f08dfcd25" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:18:48.262964  6877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "713b5728a197487c9300b310ab94e5a3" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:18:48.263875  6877 raft_consensus.cc:2468] T 713b5728a197487c9300b310ab94e5a3 P cd75a17ab2604397adab03bb8b5fd75c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 3.
W20260709 13:18:48.179865  6770 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 45678.5us
W20260709 13:18:48.196429  6695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 119090us
I20260709 13:18:48.264958  6877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "853ac0a8cbd64ce99457f170216d4d0f" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:18:48.266145  6695 leader_election.cc:304] T f5be3a11b23d4ea9b08300a2789821c7 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:18:48.266747  6877 raft_consensus.cc:3060] T 853ac0a8cbd64ce99457f170216d4d0f P cd75a17ab2604397adab03bb8b5fd75c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:48.266139  6770 leader_election.cc:304] T 404190ce4ce94cecbfcb6ea9d1dd8626 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb
I20260709 13:18:48.216972  6874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bf4668eeb70467fb3dc5a0289233b3c" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:18:48.268003  6874 raft_consensus.cc:2468] T 1bf4668eeb70467fb3dc5a0289233b3c P cd75a17ab2604397adab03bb8b5fd75c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 2.
I20260709 13:18:48.269325  6874 raft_consensus.cc:1240] T d33d5ee8ef6f415593d8df52063161ad P cd75a17ab2604397adab03bb8b5fd75c [term 4 FOLLOWER]: Rejecting Update request from peer b7ab4784c7344b939bc36f639286f377 for earlier term 3. Current term is 4. Ops: []
W20260709 13:18:48.270038  6772 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 126031us
I20260709 13:18:48.272886  6772 leader_election.cc:304] T 711ef6523deb4cbe8ef2ba61e1c21c98 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
W20260709 13:18:48.275167  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 203372us
I20260709 13:18:48.276337  6844 leader_election.cc:304] T 44bde925b2e541b69890d70715b85176 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:18:48.277953  8236 raft_consensus.cc:2804] T 44bde925b2e541b69890d70715b85176 P cd75a17ab2604397adab03bb8b5fd75c [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:18:48.278468  8236 raft_consensus.cc:697] T 44bde925b2e541b69890d70715b85176 P cd75a17ab2604397adab03bb8b5fd75c [term 4 LEADER]: Becoming Leader. State: Replica: cd75a17ab2604397adab03bb8b5fd75c, State: Running, Role: LEADER
I20260709 13:18:48.278234  6772 leader_election.cc:304] T bb7fa124c3bf4ef9ab65a407cb008441 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:18:48.146266  8282 consensus_queue.cc:1048] T 7c37d41cd9164c15a6826ca62a851a69 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.054s
W20260709 13:18:48.250478  6697 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 170957us
I20260709 13:18:48.282511  6844 leader_election.cc:304] T 711ef6523deb4cbe8ef2ba61e1c21c98 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
W20260709 13:18:48.258806  7466 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 157702us
W20260709 13:18:48.288398  6846 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.68:45071, user_credentials={real_user=slave}} blocked reactor thread for 126310us
I20260709 13:18:48.193789  8223 raft_consensus.cc:493] T 7887766dc6784fcaa42b35c05fea7a99 P b7ab4784c7344b939bc36f639286f377 [term 2 FOLLOWER]: Starting leader election (detected failure of leader cd75a17ab2604397adab03bb8b5fd75c)
I20260709 13:18:48.281369  8201 raft_consensus.cc:493] T 22ccee1b570c4ad3a57bd7aec085b1b4 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:48.194222  8243 raft_consensus.cc:515] T 7c37d41cd9164c15a6826ca62a851a69 P cd75a17ab2604397adab03bb8b5fd75c [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:48.341045  5625 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:18:48.344311  6729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1528ab62b6fe4e3099d08f141afee116" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:18:48.345074  6729 raft_consensus.cc:2468] T 1528ab62b6fe4e3099d08f141afee116 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in term 3.
I20260709 13:18:48.345068  6731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3d8792045a4583ae2e965b1350a5b4" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:18:48.341194  8169 raft_consensus.cc:493] T 30e88460611e47b2ba16a46a30b5f416 P cd75a17ab2604397adab03bb8b5fd75c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:18:48.341866  8334 raft_consensus.cc:2804] T 404190ce4ce94cecbfcb6ea9d1dd8626 P b7ab4784c7344b939bc36f639286f377 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:18:48.341142  8201 raft_consensus.cc:515] T 22ccee1b570c4ad3a57bd7aec085b1b4 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:48.299398  8304 raft_consensus.cc:2804] T f5be3a11b23d4ea9b08300a2789821c7 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:18:48.331014  8074 raft_consensus.cc:2749] T bb7fa124c3bf4ef9ab65a407cb008441 P b7ab4784c7344b939bc36f639286f377 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:18:48.280409  8290 raft_consensus.cc:493] T 404190ce4ce94cecbfcb6ea9d1dd8626 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 7ba59cc884714e8aa5f3f0ecaed84cbb)
I20260709 13:18:48.344352  6695 leader_election.cc:304] T 17587d6730594da4a56fa13a353232a1 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, b7ab4784c7344b939bc36f639286f377
I20260709 13:18:48.295902  8180 raft_consensus.cc:3055] T bb7fa124c3bf4ef9ab65a407cb008441 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:18:48.305472  8167 raft_consensus.cc:2804] T 711ef6523deb4cbe8ef2ba61e1c21c98 P cd75a17ab2604397adab03bb8b5fd75c [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:18:48.301680  8096 raft_consensus.cc:2804] T 711ef6523deb4cbe8ef2ba61e1c21c98 P b7ab4784c7344b939bc36f639286f377 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:18:48.291462  8319 raft_consensus.cc:493] T 427c124d773f483294511e80fe340075 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:48.339408  6877 raft_consensus.cc:2468] T 853ac0a8cbd64ce99457f170216d4d0f P cd75a17ab2604397adab03bb8b5fd75c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 2.
I20260709 13:18:48.355387  6731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17587d6730594da4a56fa13a353232a1" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:18:48.313865  8223 raft_consensus.cc:3060] T 7887766dc6784fcaa42b35c05fea7a99 P b7ab4784c7344b939bc36f639286f377 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:48.366570  6876 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53416 (request call id 1918) took 1895 ms. Trace:
W20260709 13:18:48.391017  6695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 46777.9us
I20260709 13:18:48.397284  6730 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50004 (request call id 1067) took 1036 ms. Trace:
W20260709 13:18:48.398437  6772 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.68:45071, user_credentials={real_user=slave}} blocked reactor thread for 120325us
I20260709 13:18:48.410549  6877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c44c4849aa54f2b94d1f1bef9ed546f" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:18:48.424492  6730 rpcz_store.cc:276] 0709 13:18:47.360529 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:47.472807 (+112278us) service_pool.cc:224] Handling call
0709 13:18:48.397012 (+924205us) spinlock_profiling.cc:243] Waited 696 ms on lock 0x7b54003d5c54. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f9ae2fa 00007fcc1496fb17 00007fcc0deea6d4 00007fcc0deea662 00007fcc0deea591 00007fcc0deea50c 00007fcc0dee97c2 00007fcc0dce548c 00007fcc0dce48c6 00007fcc0dce426f
0709 13:18:48.397197 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1601750784}
I20260709 13:18:48.349810  8137 raft_consensus.cc:493] T f4b8bd455d5a47c18a1380839c6e0d61 P cd75a17ab2604397adab03bb8b5fd75c [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:48.427618  6772 leader_election.cc:304] T 713b5728a197487c9300b310ab94e5a3 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:18:48.353369  8334 raft_consensus.cc:493] T 404190ce4ce94cecbfcb6ea9d1dd8626 P b7ab4784c7344b939bc36f639286f377 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 7ba59cc884714e8aa5f3f0ecaed84cbb)
I20260709 13:18:48.465339  6772 leader_election.cc:304] T 1bf4668eeb70467fb3dc5a0289233b3c P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:18:48.348562  8146 raft_consensus.cc:493] T b3f13b31a1f84f0d89d007eadd57924c P ccd8a4c3bfe3413cb2ae219b09aea832 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 7ba59cc884714e8aa5f3f0ecaed84cbb)
I20260709 13:18:48.425588  6877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbdf895bba214ff68685a24fd17dfb5d" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:18:48.424911  6876 rpcz_store.cc:276] 0709 13:18:46.471659 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:47.901243 (+1429584us) service_pool.cc:224] Handling call
0709 13:18:47.901645 (+   402us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:47.901892 (+   247us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:18:48.194882 (+292990us) log.cc:844] Serialized 14 byte log entry
0709 13:18:48.365994 (+171112us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:48.366094 (+   100us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:18:48.366162 (+    68us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:48.366267 (+   105us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:48.366487 (+   220us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":439671,"prepare.run_cpu_time_us":40,"prepare.run_wall_time_us":42,"thread_start_us":462028,"threads_started":2}
I20260709 13:18:48.369822  8304 raft_consensus.cc:493] T f5be3a11b23d4ea9b08300a2789821c7 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 3 FOLLOWER]: Starting leader election (detected failure of leader cd75a17ab2604397adab03bb8b5fd75c)
W20260709 13:18:48.401976  8336 log.cc:927] Time spent T bd6869f07b5a4885a0b99fbe60c3b175 P b7ab4784c7344b939bc36f639286f377: Append to log took a long time: real 0.059s	user 0.001s	sys 0.000s
I20260709 13:18:48.488801  6878 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53406 (request call id 1102) took 1201 ms. Trace:
I20260709 13:18:48.398607  8085 raft_consensus.cc:493] T 22ccee1b570c4ad3a57bd7aec085b1b4 P cd75a17ab2604397adab03bb8b5fd75c [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:48.494891  6878 rpcz_store.cc:276] 0709 13:18:47.287083 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:47.937974 (+650891us) service_pool.cc:224] Handling call
0709 13:18:47.938230 (+   256us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:47.938428 (+   198us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:18:48.274025 (+335597us) log.cc:844] Serialized 14 byte log entry
0709 13:18:48.488253 (+214228us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:48.488326 (+    73us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:18:48.488390 (+    64us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:48.488489 (+    99us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:48.488699 (+   210us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4343,"prepare.queue_time_us":403403,"prepare.run_cpu_time_us":30,"prepare.run_wall_time_us":30,"thread_start_us":471935,"threads_started":3}
I20260709 13:18:48.400120  8167 raft_consensus.cc:493] T 711ef6523deb4cbe8ef2ba61e1c21c98 P cd75a17ab2604397adab03bb8b5fd75c [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:48.326866  7993 consensus_queue.cc:1048] T 713b5728a197487c9300b310ab94e5a3 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.088s
I20260709 13:18:48.391637  8180 raft_consensus.cc:740] T bb7fa124c3bf4ef9ab65a407cb008441 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 7ba59cc884714e8aa5f3f0ecaed84cbb, State: Running, Role: LEADER
I20260709 13:18:48.399344  8096 raft_consensus.cc:493] T 711ef6523deb4cbe8ef2ba61e1c21c98 P b7ab4784c7344b939bc36f639286f377 [term 2 FOLLOWER]: Starting leader election (detected failure of leader cd75a17ab2604397adab03bb8b5fd75c)
I20260709 13:18:48.301163  8236 consensus_queue.cc:237] T 44bde925b2e541b69890d70715b85176 P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:48.497440  6878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c7f33e544204fbaac4078e3e83bbf4e" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:18:48.412492  8289 raft_consensus.cc:2749] T 17587d6730594da4a56fa13a353232a1 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:18:48.492655  6877 raft_consensus.cc:3060] T dbdf895bba214ff68685a24fd17dfb5d P cd75a17ab2604397adab03bb8b5fd75c [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:48.369503  8169 raft_consensus.cc:515] T 30e88460611e47b2ba16a46a30b5f416 P cd75a17ab2604397adab03bb8b5fd75c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:48.511308  6878 raft_consensus.cc:3060] T 8c7f33e544204fbaac4078e3e83bbf4e P cd75a17ab2604397adab03bb8b5fd75c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:48.505298  8167 raft_consensus.cc:3060] T 711ef6523deb4cbe8ef2ba61e1c21c98 P cd75a17ab2604397adab03bb8b5fd75c [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:48.495388  8304 raft_consensus.cc:3060] T f5be3a11b23d4ea9b08300a2789821c7 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:18:48.500267  7467 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:48.471078  8334 raft_consensus.cc:3060] T 404190ce4ce94cecbfcb6ea9d1dd8626 P b7ab4784c7344b939bc36f639286f377 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:48.517468  8096 raft_consensus.cc:3060] T 711ef6523deb4cbe8ef2ba61e1c21c98 P b7ab4784c7344b939bc36f639286f377 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:48.470012  8319 raft_consensus.cc:515] T 427c124d773f483294511e80fe340075 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } attrs { replace: true } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:18:48.560565  8066 raft_consensus.cc:515] T 7887766dc6784fcaa42b35c05fea7a99 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:48.562714  8319 leader_election.cc:290] T 427c124d773f483294511e80fe340075 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:18:48.563079  8066 leader_election.cc:290] T 7887766dc6784fcaa42b35c05fea7a99 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 3 election: Requested vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:18:48.538811  8292 leader_election.cc:290] T 8c7f33e544204fbaac4078e3e83bbf4e P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:18:48.483300  8137 raft_consensus.cc:515] T f4b8bd455d5a47c18a1380839c6e0d61 P cd75a17ab2604397adab03bb8b5fd75c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:48.540194  8243 leader_election.cc:290] T 7c37d41cd9164c15a6826ca62a851a69 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 3 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:18:48.540599  6727 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50004 (request call id 1076) took 1049 ms. Trace:
I20260709 13:18:48.514439  7498 raft_consensus.cc:1240] T 17587d6730594da4a56fa13a353232a1 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 5 FOLLOWER]: Rejecting Update request from peer b7ab4784c7344b939bc36f639286f377 for earlier term 4. Current term is 5. Ops: []
W20260709 13:18:48.542811  8324 log.cc:927] Time spent T de3186201e1a40d0b335eeb8b4e256e0 P ccd8a4c3bfe3413cb2ae219b09aea832: Append to log took a long time: real 0.147s	user 0.000s	sys 0.001s
W20260709 13:18:48.543385  8321 log.cc:927] Time spent T b56bf91d90824c959e21e0cee5ba1816 P ccd8a4c3bfe3413cb2ae219b09aea832: Append to log took a long time: real 0.200s	user 0.001s	sys 0.000s
I20260709 13:18:48.543686  8100 raft_consensus.cc:3060] T ce4f062dcd314d43a63ca74067cb5ee3 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:48.572500  6727 rpcz_store.cc:276] 0709 13:18:47.504905 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:47.742921 (+238016us) service_pool.cc:224] Handling call
0709 13:18:47.824974 (+ 82053us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:47.853233 (+ 28259us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:18:48.261080 (+407847us) log.cc:844] Serialized 14 byte log entry
0709 13:18:48.526211 (+265131us) log.cc:844] Serialized 14 byte log entry
0709 13:18:48.540191 (+ 13980us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:48.540254 (+    63us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:18:48.540303 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:48.540385 (+    82us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:48.540536 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":75500,"prepare.queue_time_us":47426,"prepare.run_cpu_time_us":47,"prepare.run_wall_time_us":48,"raft.queue_time_us":211372,"raft.run_cpu_time_us":302,"raft.run_wall_time_us":6962,"thread_start_us":26759,"threads_started":1,"wal-append.queue_time_us":253881}
I20260709 13:18:48.544615  8180 consensus_queue.cc:260] T bb7fa124c3bf4ef9ab65a407cb008441 P 7ba59cc884714e8aa5f3f0ecaed84cbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:18:48.399873  8290 raft_consensus.cc:515] T 404190ce4ce94cecbfcb6ea9d1dd8626 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:18:48.580116  6732 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50004 (request call id 1063) took 1274 ms. Trace:
I20260709 13:18:48.581465  8290 leader_election.cc:290] T 404190ce4ce94cecbfcb6ea9d1dd8626 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:18:48.580508  6732 rpcz_store.cc:276] 0709 13:18:47.305872 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:47.319951 (+ 14079us) service_pool.cc:224] Handling call
0709 13:18:47.666452 (+346501us) spinlock_profiling.cc:243] Waited 3.39 ms on lock 0x7b5800000c98. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0c745db1 00007fcc0c885b71 00007fcc0c885a22 00007fcc1579ec09 00007fcc148f8ee0 00007fcc149c20ab 00007fcc149c2131 00007fcc14983fc0 00007fcc1496e929 00007fcc1496e3d2 00007fcc0dee5bd4
0709 13:18:47.666664 (+   212us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:47.729978 (+ 63314us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:47.730024 (+    46us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:47.730641 (+   617us) log.cc:844] Serialized 26 byte log entry
0709 13:18:48.201059 (+470418us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:18:48.201118 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:48.201218 (+   100us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:48.579796 (+378578us) raft_consensus.cc:1685] finished
0709 13:18:48.579818 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:48.580052 (+   234us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":25013,"raft.queue_time_us":84451,"raft.run_cpu_time_us":185,"raft.run_wall_time_us":70614,"spinlock_wait_cycles":7791488,"thread_start_us":449269,"threads_started":1,"wal-append.queue_time_us":599401}
I20260709 13:18:48.578912  8134 raft_consensus.cc:515] T f5be3a11b23d4ea9b08300a2789821c7 P b7ab4784c7344b939bc36f639286f377 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:48.544173  8337 raft_consensus.cc:493] T 3fa34c08b205435dba97346991aa1f92 P cd75a17ab2604397adab03bb8b5fd75c [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
W20260709 13:18:48.549252  8311 log.cc:927] Time spent T b3f13b31a1f84f0d89d007eadd57924c P b7ab4784c7344b939bc36f639286f377: Append to log took a long time: real 0.586s	user 0.000s	sys 0.005s
I20260709 13:18:48.401158  8328 consensus_queue.cc:1048] T f03d0dbf16864ca4bc1bb5e4c0334c0f P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.137s
I20260709 13:18:48.463783  8293 raft_consensus.cc:493] T 3d65025eea89441290d85dd053810e31 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader cd75a17ab2604397adab03bb8b5fd75c)
I20260709 13:18:48.479640  8245 raft_consensus.cc:697] T 7a734b5ab7834e05a8c422208acc58b1 P b7ab4784c7344b939bc36f639286f377 [term 4 LEADER]: Becoming Leader. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
I20260709 13:18:48.515991  8152 raft_consensus.cc:2804] T 713b5728a197487c9300b310ab94e5a3 P b7ab4784c7344b939bc36f639286f377 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:18:48.550278  8340 raft_consensus.cc:493] T 4f00a2e87e56452083b759f60d461ee3 P cd75a17ab2604397adab03bb8b5fd75c [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:48.560075  8280 raft_consensus.cc:2804] T 1bf4668eeb70467fb3dc5a0289233b3c P b7ab4784c7344b939bc36f639286f377 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:18:48.596191  8280 raft_consensus.cc:493] T 1bf4668eeb70467fb3dc5a0289233b3c P b7ab4784c7344b939bc36f639286f377 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:48.596627  8280 raft_consensus.cc:3060] T 1bf4668eeb70467fb3dc5a0289233b3c P b7ab4784c7344b939bc36f639286f377 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:18:48.596956  8313 log.cc:927] Time spent T e31b9971c15848dea59d4d4130141d9e P cd75a17ab2604397adab03bb8b5fd75c: Append to log took a long time: real 0.617s	user 0.003s	sys 0.002s
I20260709 13:18:48.583258  8337 raft_consensus.cc:515] T 3fa34c08b205435dba97346991aa1f92 P cd75a17ab2604397adab03bb8b5fd75c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:18:48.573153  6878 raft_consensus.cc:2468] T 8c7f33e544204fbaac4078e3e83bbf4e P cd75a17ab2604397adab03bb8b5fd75c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 3.
I20260709 13:18:48.505653  8085 raft_consensus.cc:515] T 22ccee1b570c4ad3a57bd7aec085b1b4 P cd75a17ab2604397adab03bb8b5fd75c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:48.576805  8137 leader_election.cc:290] T f4b8bd455d5a47c18a1380839c6e0d61 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:18:48.578998  8317 raft_consensus.cc:3060] T 9b3759de40694069b13c0f8bd40e5709 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:48.602377  8085 leader_election.cc:290] T 22ccee1b570c4ad3a57bd7aec085b1b4 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:18:48.502251  8146 raft_consensus.cc:515] T b3f13b31a1f84f0d89d007eadd57924c P ccd8a4c3bfe3413cb2ae219b09aea832 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:18:48.604660  8146 leader_election.cc:290] T b3f13b31a1f84f0d89d007eadd57924c P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:18:48.509856  6876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e326172347f45e99a0d482b5d8ef768" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:18:48.604976  6724 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49998 (request call id 492) took 1379 ms. Trace:
I20260709 13:18:48.605350  6724 rpcz_store.cc:276] 0709 13:18:47.225122 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:47.231461 (+  6339us) service_pool.cc:224] Handling call
0709 13:18:48.604765 (+1373304us) spinlock_profiling.cc:243] Waited 1.01 s on lock 0x7b54000e4a54. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f9ae2fa 00007fcc1496fb17 00007fcc0deea6d4 00007fcc0deea662 00007fcc0deea591 00007fcc0deea50c 00007fcc0dee97c2 00007fcc0dce548c 00007fcc0dce48c6 00007fcc0dce426f
0709 13:18:48.604913 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2313331968}
I20260709 13:18:48.605980  6876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4275cf08e63345f993bce8664eada830" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:18:48.606580  6876 raft_consensus.cc:3060] T 4275cf08e63345f993bce8664eada830 P cd75a17ab2604397adab03bb8b5fd75c [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:18:48.607200  8312 log.cc:927] Time spent T f03d0dbf16864ca4bc1bb5e4c0334c0f P cd75a17ab2604397adab03bb8b5fd75c: Append to log took a long time: real 0.653s	user 0.002s	sys 0.000s
I20260709 13:18:48.592708  8152 raft_consensus.cc:493] T 713b5728a197487c9300b310ab94e5a3 P b7ab4784c7344b939bc36f639286f377 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:48.593300  8340 raft_consensus.cc:515] T 4f00a2e87e56452083b759f60d461ee3 P cd75a17ab2604397adab03bb8b5fd75c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:18:48.598923  6878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4275cf08e63345f993bce8664eada830" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:18:48.594913  8169 leader_election.cc:290] T 30e88460611e47b2ba16a46a30b5f416 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:18:48.595552  8115 raft_consensus.cc:493] T b56bf91d90824c959e21e0cee5ba1816 P cd75a17ab2604397adab03bb8b5fd75c [term 3 FOLLOWER]: Starting leader election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:18:48.611367  6879 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53416 (request call id 1916) took 2172 ms. Trace:
I20260709 13:18:48.611896  6879 rpcz_store.cc:276] 0709 13:18:46.439256 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:47.680301 (+1241045us) service_pool.cc:224] Handling call
0709 13:18:47.680672 (+   371us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:47.702393 (+ 21721us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:47.702423 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:47.702975 (+   552us) log.cc:844] Serialized 26 byte log entry
0709 13:18:47.839144 (+136169us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:18:47.839192 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:47.839264 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:48.596339 (+757075us) spinlock_profiling.cc:243] Waited 39.3 ms on lock 0x7b4400022b4c. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0c745db1 00007fcc0c7e3c85 00007fcc0c7e46a2 00007fcc0f5561db 00007fcc0f551aaf 00007fcc0f54586e 00007fcc0f544bb6 00007fcc0f5447d8 00007fcc0f54e221 00007fcc0f54e1d9 00007fcc0f54e169
0709 13:18:48.597835 (+  1496us) raft_consensus.cc:1685] finished
0709 13:18:48.597856 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:48.611300 (+ 13444us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":90482048,"thread_start_us":135792,"threads_started":1,"wal-append.queue_time_us":276631}
I20260709 13:18:48.608605  8152 raft_consensus.cc:3060] T 713b5728a197487c9300b310ab94e5a3 P b7ab4784c7344b939bc36f639286f377 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:48.615909  6872 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53416 (request call id 1914) took 2201 ms. Trace:
I20260709 13:18:48.616797  6878 raft_consensus.cc:1240] T 853ac0a8cbd64ce99457f170216d4d0f P cd75a17ab2604397adab03bb8b5fd75c [term 2 FOLLOWER]: Rejecting Update request from peer ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 1. Current term is 2. Ops: []
I20260709 13:18:48.616324  6872 rpcz_store.cc:276] 0709 13:18:46.414879 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:47.629690 (+1214811us) service_pool.cc:224] Handling call
0709 13:18:47.648955 (+ 19265us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:47.649244 (+   289us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:47.649282 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:47.657428 (+  8146us) log.cc:844] Serialized 26 byte log entry
0709 13:18:47.841711 (+184283us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:18:47.841754 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:47.841839 (+    85us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:48.606547 (+764708us) spinlock_profiling.cc:243] Waited 64.3 ms on lock 0x7b4400022b4c. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0c745db1 00007fcc0c7e3c85 00007fcc0c7e46a2 00007fcc0f5561db 00007fcc0f551aaf 00007fcc0f54586e 00007fcc0f544bb6 00007fcc0f5447d8 00007fcc0f54e221 00007fcc0f54e1d9 00007fcc0f54e169
0709 13:18:48.608890 (+  2343us) raft_consensus.cc:1685] finished
0709 13:18:48.608910 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:48.615848 (+  6938us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":147797376,"thread_start_us":145504,"threads_started":1,"wal-append.queue_time_us":280147}
I20260709 13:18:48.593317  6873 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53406 (request call id 1087) took 2551 ms. Trace:
I20260709 13:18:48.632018  6876 raft_consensus.cc:2468] T 4275cf08e63345f993bce8664eada830 P cd75a17ab2604397adab03bb8b5fd75c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 3.
I20260709 13:18:48.607682  8306 leader_election.cc:290] T bd6869f07b5a4885a0b99fbe60c3b175 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
W20260709 13:18:48.634045  6770 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 328748us
I20260709 13:18:48.706135  6770 leader_election.cc:304] T 20f6842e26174571996b8dea4151d4be P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:18:48.640028  6876 raft_consensus.cc:1275] T 4d9def8b32fd443aa94ab1420b06837b P cd75a17ab2604397adab03bb8b5fd75c [term 3 FOLLOWER]: Refusing update from remote peer ccd8a4c3bfe3413cb2ae219b09aea832: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:18:48.614454  8115 raft_consensus.cc:3060] T b56bf91d90824c959e21e0cee5ba1816 P cd75a17ab2604397adab03bb8b5fd75c [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:48.714802  8348 raft_consensus.cc:2749] T 20f6842e26174571996b8dea4151d4be P b7ab4784c7344b939bc36f639286f377 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:18:48.630993  8134 leader_election.cc:290] T f5be3a11b23d4ea9b08300a2789821c7 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 4 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:18:48.630057  6873 rpcz_store.cc:276] 0709 13:18:46.042198 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:46.287949 (+245751us) service_pool.cc:224] Handling call
0709 13:18:48.593030 (+2305081us) spinlock_profiling.cc:243] Waited 546 ms on lock 0x7b5400065ed4. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f9ae2fa 00007fcc1496fb17 00007fcc0deea6d4 00007fcc0deea662 00007fcc0deea591 00007fcc0deea50c 00007fcc0dee97c2 00007fcc0dce548c 00007fcc0dce48c6 00007fcc0dce426f
0709 13:18:48.593226 (+   196us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1256797952}
I20260709 13:18:48.614926  8157 raft_consensus.cc:515] T ce4f062dcd314d43a63ca74067cb5ee3 P cd75a17ab2604397adab03bb8b5fd75c [term 5 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } attrs { replace: true } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:18:48.612927  8334 raft_consensus.cc:515] T 404190ce4ce94cecbfcb6ea9d1dd8626 P b7ab4784c7344b939bc36f639286f377 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:18:48.598102  8293 raft_consensus.cc:515] T 3d65025eea89441290d85dd053810e31 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:48.775372  6874 raft_consensus.cc:1240] T ce4f062dcd314d43a63ca74067cb5ee3 P cd75a17ab2604397adab03bb8b5fd75c [term 5 FOLLOWER]: Rejecting Update request from peer b7ab4784c7344b939bc36f639286f377 for earlier term 3. Current term is 5. Ops: []
I20260709 13:18:48.794480  6877 raft_consensus.cc:2468] T dbdf895bba214ff68685a24fd17dfb5d P cd75a17ab2604397adab03bb8b5fd75c [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 4.
I20260709 13:18:48.795514  6879 raft_consensus.cc:1240] T dbdf895bba214ff68685a24fd17dfb5d P cd75a17ab2604397adab03bb8b5fd75c [term 4 FOLLOWER]: Rejecting Update request from peer ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 13:18:48.764168  8100 raft_consensus.cc:2749] T ce4f062dcd314d43a63ca74067cb5ee3 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:18:48.816992  8281 consensus_meta.cc:287] T 3d65025eea89441290d85dd053810e31 P b7ab4784c7344b939bc36f639286f377: Time spent flushing consensus metadata: real 0.629s	user 0.010s	sys 0.001s
I20260709 13:18:48.817607  8281 raft_consensus.cc:515] T 3d65025eea89441290d85dd053810e31 P b7ab4784c7344b939bc36f639286f377 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:48.824415  8281 leader_election.cc:290] T 3d65025eea89441290d85dd053810e31 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 2 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:18:48.772636  8245 consensus_queue.cc:237] T 7a734b5ab7834e05a8c422208acc58b1 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:48.825433  8334 leader_election.cc:290] T 404190ce4ce94cecbfcb6ea9d1dd8626 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 4 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
W20260709 13:18:48.825676  6696 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:48.829401  8330 log.cc:927] Time spent T 90d42e216d9741e190bca19a781291fd P cd75a17ab2604397adab03bb8b5fd75c: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
I20260709 13:18:48.830678  6875 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53406 (request call id 1103) took 1542 ms. Trace:
W20260709 13:18:48.831234  8111 consensus_meta.cc:287] T c4db81d9d329422bb3b4160ca4ac2d1d P b7ab4784c7344b939bc36f639286f377: Time spent flushing consensus metadata: real 0.580s	user 0.008s	sys 0.000s
I20260709 13:18:48.831105  6875 rpcz_store.cc:276] 0709 13:18:47.288395 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:47.954772 (+666377us) service_pool.cc:224] Handling call
0709 13:18:47.955122 (+   350us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:48.014767 (+ 59645us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:48.014804 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:48.026779 (+ 11975us) log.cc:844] Serialized 26 byte log entry
0709 13:18:48.333244 (+306465us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:18:48.333388 (+   144us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:48.333943 (+   555us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:48.830477 (+496534us) raft_consensus.cc:1685] finished
0709 13:18:48.830495 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:48.830622 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":59123,"raft.queue_time_us":59892,"raft.run_cpu_time_us":181,"raft.run_wall_time_us":13633,"thread_start_us":250909,"threads_started":1,"wal-append.queue_time_us":559615}
W20260709 13:18:48.834287  8339 log.cc:927] Time spent T d8292e16e5654be6bc408560cf256aaa P b7ab4784c7344b939bc36f639286f377: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
I20260709 13:18:48.738626  8280 raft_consensus.cc:515] T 1bf4668eeb70467fb3dc5a0289233b3c P b7ab4784c7344b939bc36f639286f377 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:48.834714  8167 raft_consensus.cc:515] T 711ef6523deb4cbe8ef2ba61e1c21c98 P cd75a17ab2604397adab03bb8b5fd75c [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
W20260709 13:18:48.817989  8325 log.cc:927] Time spent T 7c44c4849aa54f2b94d1f1bef9ed546f P cd75a17ab2604397adab03bb8b5fd75c: Append to log took a long time: real 0.083s	user 0.000s	sys 0.000s
I20260709 13:18:48.837730  6881 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53406 (request call id 1104) took 1547 ms. Trace:
W20260709 13:18:48.838317  6770 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 132302us
I20260709 13:18:48.838312  6881 rpcz_store.cc:276] 0709 13:18:47.289914 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:47.970812 (+680898us) service_pool.cc:224] Handling call
0709 13:18:47.971235 (+   423us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:48.019732 (+ 48497us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:48.019763 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:48.020299 (+   536us) log.cc:844] Serialized 26 byte log entry
0709 13:18:48.401168 (+380869us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:18:48.401218 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:48.401304 (+    86us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:48.773311 (+372007us) spinlock_profiling.cc:243] Waited 1.72 ms on lock 0x7b4800210258. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc148d3aa1 00007fcc148cab37 00007fcc148ca9ca 00007fcc149c226f 00007fcc149c1f37 00007fcc149d655c 00007fcc149d6508 00007fcc149d6488 00007fcc149d6443 00007fcc149d56ec 00007fcc138ffa96
0709 13:18:48.837461 (+ 64150us) raft_consensus.cc:1685] finished
0709 13:18:48.837483 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:48.837672 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":48075,"raft.queue_time_us":51416,"raft.run_cpu_time_us":5017,"raft.run_wall_time_us":743542,"spinlock_wait_cycles":3964160,"thread_start_us":380544,"threads_started":1,"wal-append.queue_time_us":589418}
I20260709 13:18:48.840132  6770 leader_election.cc:304] T f3f9c2e2bf644115957398fe4c9459db P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:18:48.841188  8334 raft_consensus.cc:2749] T f3f9c2e2bf644115957398fe4c9459db P b7ab4784c7344b939bc36f639286f377 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:18:48.716193  8074 consensus_queue.cc:1048] T 90d42e216d9741e190bca19a781291fd P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.057s
I20260709 13:18:48.847028  6876 raft_consensus.cc:1240] T 7a734b5ab7834e05a8c422208acc58b1 P cd75a17ab2604397adab03bb8b5fd75c [term 4 FOLLOWER]: Rejecting Update request from peer ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 3. Current term is 4. Ops: []
I20260709 13:18:48.831766  8111 raft_consensus.cc:2749] T c4db81d9d329422bb3b4160ca4ac2d1d P b7ab4784c7344b939bc36f639286f377 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:18:48.912798  6698 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:48.837703  8167 leader_election.cc:290] T 711ef6523deb4cbe8ef2ba61e1c21c98 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 4 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
W20260709 13:18:48.913040  8341 log.cc:927] Time spent T 4b8cacb381b746da8d0049b0a83b41dd P cd75a17ab2604397adab03bb8b5fd75c: Append to log took a long time: real 0.147s	user 0.000s	sys 0.001s
I20260709 13:18:48.921341  6770 leader_election.cc:304] T be1a92657f494cac8dd227d152f50151 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:18:48.903169  8337 leader_election.cc:290] T 3fa34c08b205435dba97346991aa1f92 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:18:48.915762  7993 raft_consensus.cc:493] T 7c37d41cd9164c15a6826ca62a851a69 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:48.903657  8304 raft_consensus.cc:515] T f5be3a11b23d4ea9b08300a2789821c7 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:48.903332  8152 raft_consensus.cc:515] T 713b5728a197487c9300b310ab94e5a3 P b7ab4784c7344b939bc36f639286f377 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:48.918100  8157 leader_election.cc:290] T ce4f062dcd314d43a63ca74067cb5ee3 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 5 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:18:48.923527  6770 leader_election.cc:304] T e31b9971c15848dea59d4d4130141d9e P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
W20260709 13:18:48.928628  6771 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:48.957849  6880 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53406 (request call id 1106) took 1599 ms. Trace:
W20260709 13:18:48.935897  6847 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:48.962396  6772 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 497159us
W20260709 13:18:48.963708  7466 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 435171us
W20260709 13:18:48.966393  7466 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:48.959959  6880 rpcz_store.cc:276] 0709 13:18:47.358894 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:47.978463 (+619569us) service_pool.cc:224] Handling call
0709 13:18:47.978774 (+   311us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:47.978999 (+   225us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:18:48.334642 (+355643us) log.cc:844] Serialized 14 byte log entry
0709 13:18:48.957420 (+622778us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:48.957486 (+    66us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:18:48.957531 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:48.957607 (+    76us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:48.957764 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":31980,"prepare.queue_time_us":363016,"prepare.run_cpu_time_us":47,"prepare.run_wall_time_us":47,"raft.queue_time_us":70896,"raft.run_cpu_time_us":90,"raft.run_wall_time_us":90,"thread_start_us":919248,"threads_started":3,"wal-append.queue_time_us":399848}
W20260709 13:18:48.948725  8307 log.cc:927] Time spent T 7887766dc6784fcaa42b35c05fea7a99 P b7ab4784c7344b939bc36f639286f377: Append to log took a long time: real 0.984s	user 0.001s	sys 0.016s
W20260709 13:18:48.957074  8349 log.cc:927] Time spent T 2c240553ce044eedb41541d72b9475d7 P b7ab4784c7344b939bc36f639286f377: Append to log took a long time: real 0.392s	user 0.020s	sys 0.012s
I20260709 13:18:48.954550  8075 raft_consensus.cc:3060] T ce4f062dcd314d43a63ca74067cb5ee3 P b7ab4784c7344b939bc36f639286f377 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:48.929557  8306 raft_consensus.cc:493] T c4db81d9d329422bb3b4160ca4ac2d1d P ccd8a4c3bfe3413cb2ae219b09aea832 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:48.929289  8111 raft_consensus.cc:2749] T be1a92657f494cac8dd227d152f50151 P b7ab4784c7344b939bc36f639286f377 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:18:48.953847  8304 leader_election.cc:290] T f5be3a11b23d4ea9b08300a2789821c7 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 4 election: Requested vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:18:48.953825  8152 leader_election.cc:290] T 713b5728a197487c9300b310ab94e5a3 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 4 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
W20260709 13:18:48.970746  8350 log.cc:927] Time spent T 9e326172347f45e99a0d482b5d8ef768 P cd75a17ab2604397adab03bb8b5fd75c: Append to log took a long time: real 0.094s	user 0.001s	sys 0.000s
I20260709 13:18:48.952008  8096 raft_consensus.cc:515] T 711ef6523deb4cbe8ef2ba61e1c21c98 P b7ab4784c7344b939bc36f639286f377 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:48.929740  8293 leader_election.cc:290] T 3d65025eea89441290d85dd053810e31 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:18:48.952015  8115 raft_consensus.cc:515] T b56bf91d90824c959e21e0cee5ba1816 P cd75a17ab2604397adab03bb8b5fd75c [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:48.954628  8340 leader_election.cc:290] T 4f00a2e87e56452083b759f60d461ee3 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:18:49.019061  8331 raft_consensus.cc:493] T fe20b4b48823486ca3b9c648db6ce8aa P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:18:49.018697  8291 raft_consensus.cc:493] T 24ee15416e3145beaa1b8183453729a3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 3 FOLLOWER]: Starting pre-election (detected failure of leader cd75a17ab2604397adab03bb8b5fd75c)
I20260709 13:18:48.909250  5625 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
W20260709 13:18:49.081516  6695 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.657s	user 0.015s	sys 0.029s
W20260709 13:18:49.082481  6697 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.672s	user 0.010s	sys 0.011s
W20260709 13:18:49.094736  6770 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 171070us
W20260709 13:18:49.098618  6772 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 133289us
W20260709 13:18:49.099915  6846 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:49.001963  7468 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:48.946957  7993 raft_consensus.cc:515] T 7c37d41cd9164c15a6826ca62a851a69 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
W20260709 13:18:49.121366  7467 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:49.019901  8306 raft_consensus.cc:515] T c4db81d9d329422bb3b4160ca4ac2d1d P ccd8a4c3bfe3413cb2ae219b09aea832 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:49.206696  8306 leader_election.cc:290] T c4db81d9d329422bb3b4160ca4ac2d1d P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:18:49.207438  8306 raft_consensus.cc:493] T b56bf91d90824c959e21e0cee5ba1816 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:18:48.968588  8223 raft_consensus.cc:515] T 7887766dc6784fcaa42b35c05fea7a99 P b7ab4784c7344b939bc36f639286f377 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:49.030035  8331 raft_consensus.cc:515] T fe20b4b48823486ca3b9c648db6ce8aa P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:18:49.113739  7883 raft_consensus.cc:2749] T e31b9971c15848dea59d4d4130141d9e P b7ab4784c7344b939bc36f639286f377 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:18:49.171119  8317 raft_consensus.cc:493] T f4b8bd455d5a47c18a1380839c6e0d61 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:49.174715  6801 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:32976 (request call id 1869) took 1203 ms. Trace:
I20260709 13:18:49.179390  6879 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53416 (request call id 1925) took 1106 ms. Trace:
I20260709 13:18:49.159200  8134 consensus_queue.cc:1059] T d33d5ee8ef6f415593d8df52063161ad P b7ab4784c7344b939bc36f639286f377 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.024s
W20260709 13:18:49.198814  6695 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.774s	user 0.015s	sys 0.030s
I20260709 13:18:49.207522  8115 leader_election.cc:290] T b56bf91d90824c959e21e0cee5ba1816 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 4 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:18:49.027676  8280 leader_election.cc:290] T 1bf4668eeb70467fb3dc5a0289233b3c P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 4 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
W20260709 13:18:49.211048  6697 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.801s	user 0.011s	sys 0.012s
I20260709 13:18:49.214781  6801 rpcz_store.cc:276] 0709 13:18:47.971581 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:47.972147 (+   566us) service_pool.cc:224] Handling call
0709 13:18:47.972479 (+   332us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:48.161291 (+188812us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:49.173965 (+1012674us) spinlock_profiling.cc:243] Waited 188 ms on lock 0x7b5400353754. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f9aae01 00007fcc0f9a983e 00007fcc1496e419 00007fcc0dee5bd4 00007fcc0dee5b62 00007fcc0dee5a91 00007fcc0dee5a0c 00007fcc0dee4cc2 00007fcc0dce548c 00007fcc0dce48c6
0709 13:18:49.174423 (+   458us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":432581504}
I20260709 13:18:49.226162  7498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fa34c08b205435dba97346991aa1f92" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:18:49.227882  7498 raft_consensus.cc:2393] T 3fa34c08b205435dba97346991aa1f92 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c in current term 4: Already voted for candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in this term.
W20260709 13:18:49.230908  6845 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.664s	user 0.043s	sys 0.017s
I20260709 13:18:49.246937  6772 leader_election.cc:304] T 853ac0a8cbd64ce99457f170216d4d0f P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
W20260709 13:18:49.248332  8327 log.cc:927] Time spent T d33d5ee8ef6f415593d8df52063161ad P ccd8a4c3bfe3413cb2ae219b09aea832: Append to log took a long time: real 0.684s	user 0.005s	sys 0.004s
I20260709 13:18:49.249884  8096 leader_election.cc:290] T 711ef6523deb4cbe8ef2ba61e1c21c98 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 3 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:18:49.250813  6875 raft_consensus.cc:1240] T b56bf91d90824c959e21e0cee5ba1816 P cd75a17ab2604397adab03bb8b5fd75c [term 4 FOLLOWER]: Rejecting Update request from peer b7ab4784c7344b939bc36f639286f377 for earlier term 3. Current term is 4. Ops: []
I20260709 13:18:49.252272  7496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce4f062dcd314d43a63ca74067cb5ee3" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb"
I20260709 13:18:49.254499  8317 raft_consensus.cc:515] T f4b8bd455d5a47c18a1380839c6e0d61 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:49.257241  8317 leader_election.cc:290] T f4b8bd455d5a47c18a1380839c6e0d61 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
W20260709 13:18:49.234722  6695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 810148us
I20260709 13:18:49.260555  8223 leader_election.cc:290] T 7887766dc6784fcaa42b35c05fea7a99 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 3 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:18:49.262193  6695 leader_election.cc:304] T f3f9c2e2bf644115957398fe4c9459db P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:18:49.262537  6874 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53406 (request call id 1115) took 1189 ms. Trace:
I20260709 13:18:49.214979  6879 rpcz_store.cc:276] 0709 13:18:48.073068 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:48.613854 (+540786us) service_pool.cc:224] Handling call
0709 13:18:48.795213 (+181359us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:48.795967 (+   754us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:49.178465 (+382498us) spinlock_profiling.cc:243] Waited 181 ms on lock 0x7b540042a750. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f9a98ad 00007fcc1496e419 00007fcc0dee5bd4 00007fcc0dee5b62 00007fcc0dee5a91 00007fcc0dee5a0c 00007fcc0dee4cc2 00007fcc0dce548c 00007fcc0dce48c6 00007fcc0dce426f
0709 13:18:49.178940 (+   475us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":416082816}
W20260709 13:18:49.237697  6845 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.706s	user 0.044s	sys 0.018s
I20260709 13:18:49.263213  6874 rpcz_store.cc:276] 0709 13:18:48.073031 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:48.270208 (+197177us) service_pool.cc:224] Handling call
0709 13:18:48.270485 (+   277us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:48.775852 (+505367us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:49.261878 (+486026us) spinlock_profiling.cc:243] Waited 505 ms on lock 0x7b54002189d4. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f9aae01 00007fcc0f9a983e 00007fcc1496e419 00007fcc0dee5bd4 00007fcc0dee5b62 00007fcc0dee5a91 00007fcc0dee5a0c 00007fcc0dee4cc2 00007fcc0dce548c 00007fcc0dce48c6
0709 13:18:49.262329 (+   451us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1160550272}
I20260709 13:18:49.252453  8331 leader_election.cc:290] T fe20b4b48823486ca3b9c648db6ce8aa P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
W20260709 13:18:49.271090  6878 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.568s	user 0.027s	sys 0.045s
I20260709 13:18:49.281651  8317 raft_consensus.cc:2804] T f3f9c2e2bf644115957398fe4c9459db P ccd8a4c3bfe3413cb2ae219b09aea832 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:18:49.282424  8317 raft_consensus.cc:697] T f3f9c2e2bf644115957398fe4c9459db P ccd8a4c3bfe3413cb2ae219b09aea832 [term 3 LEADER]: Becoming Leader. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
I20260709 13:18:49.283062  6798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17587d6730594da4a56fa13a353232a1" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:18:49.285235  6801 raft_consensus.cc:1240] T 404190ce4ce94cecbfcb6ea9d1dd8626 P b7ab4784c7344b939bc36f639286f377 [term 4 FOLLOWER]: Rejecting Update request from peer 7ba59cc884714e8aa5f3f0ecaed84cbb for earlier term 3. Current term is 4. Ops: []
I20260709 13:18:49.286195  8347 consensus_queue.cc:1048] T 7c44c4849aa54f2b94d1f1bef9ed546f P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:18:49.289644  6729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe20b4b48823486ca3b9c648db6ce8aa" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
W20260709 13:18:49.291797  6772 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 45198.7us
I20260709 13:18:49.293479  6772 leader_election.cc:304] T 8c7f33e544204fbaac4078e3e83bbf4e P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:18:49.294333  7993 leader_election.cc:290] T 7c37d41cd9164c15a6826ca62a851a69 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
W20260709 13:18:49.294763  8343 log.cc:927] Time spent T 3a485a995abc4807b6e511e45419f737 P cd75a17ab2604397adab03bb8b5fd75c: Append to log took a long time: real 0.730s	user 0.007s	sys 0.002s
I20260709 13:18:49.297576  8134 raft_consensus.cc:2804] T 853ac0a8cbd64ce99457f170216d4d0f P b7ab4784c7344b939bc36f639286f377 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:18:49.298362  8134 raft_consensus.cc:697] T 853ac0a8cbd64ce99457f170216d4d0f P b7ab4784c7344b939bc36f639286f377 [term 2 LEADER]: Becoming Leader. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
I20260709 13:18:49.301688  8223 raft_consensus.cc:2804] T 8c7f33e544204fbaac4078e3e83bbf4e P b7ab4784c7344b939bc36f639286f377 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:18:49.302637  8223 raft_consensus.cc:697] T 8c7f33e544204fbaac4078e3e83bbf4e P b7ab4784c7344b939bc36f639286f377 [term 3 LEADER]: Becoming Leader. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
I20260709 13:18:49.304780  8317 consensus_queue.cc:237] T f3f9c2e2bf644115957398fe4c9459db P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:49.299897  8134 consensus_queue.cc:237] T 853ac0a8cbd64ce99457f170216d4d0f P b7ab4784c7344b939bc36f639286f377 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:49.309718  7466 leader_election.cc:304] T 1528ab62b6fe4e3099d08f141afee116 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
I20260709 13:18:49.215917  8291 raft_consensus.cc:515] T 24ee15416e3145beaa1b8183453729a3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } attrs { replace: true } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:18:49.311985  6803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce4f062dcd314d43a63ca74067cb5ee3" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:18:49.312222  7498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "427c124d773f483294511e80fe340075" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:18:49.313405  7498 raft_consensus.cc:2468] T 427c124d773f483294511e80fe340075 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 3.
I20260709 13:18:49.314577  7496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f00a2e87e56452083b759f60d461ee3" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:18:49.309340  6772 leader_election.cc:304] T 4275cf08e63345f993bce8664eada830 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
W20260709 13:18:49.273872  8068 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.609s	user 0.014s	sys 0.036s
W20260709 13:18:49.315739  8068 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.741s	user 0.014s	sys 0.036s
I20260709 13:18:49.315038  8238 raft_consensus.cc:2804] T 1528ab62b6fe4e3099d08f141afee116 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:18:49.316313  8238 raft_consensus.cc:493] T 1528ab62b6fe4e3099d08f141afee116 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 3 FOLLOWER]: Starting leader election (detected failure of leader cd75a17ab2604397adab03bb8b5fd75c)
I20260709 13:18:49.316841  8238 raft_consensus.cc:3060] T 1528ab62b6fe4e3099d08f141afee116 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:49.317164  6770 leader_election.cc:304] T ab432e62819d499eaaf3dd55481dd930 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
I20260709 13:18:49.320067  8331 raft_consensus.cc:493] T 7ba5dac66ab5497e9e336f2a3c28cda5 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 3 FOLLOWER]: Starting pre-election (detected failure of leader cd75a17ab2604397adab03bb8b5fd75c)
I20260709 13:18:49.320547  8230 consensus_queue.cc:1059] T 2c240553ce044eedb41541d72b9475d7 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:18:49.320892  8331 raft_consensus.cc:515] T 7ba5dac66ab5497e9e336f2a3c28cda5 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:18:49.322646  8230 raft_consensus.cc:2804] T ab432e62819d499eaaf3dd55481dd930 P b7ab4784c7344b939bc36f639286f377 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:18:49.323158  8230 raft_consensus.cc:493] T ab432e62819d499eaaf3dd55481dd930 P b7ab4784c7344b939bc36f639286f377 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:49.323576  8230 raft_consensus.cc:3060] T ab432e62819d499eaaf3dd55481dd930 P b7ab4784c7344b939bc36f639286f377 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:49.270424  8306 raft_consensus.cc:515] T b56bf91d90824c959e21e0cee5ba1816 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
W20260709 13:18:49.270849  8236 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.609s	user 0.043s	sys 0.044s
I20260709 13:18:49.324585  6626 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:51654 (request call id 76) took 7676 ms. Trace:
W20260709 13:18:49.327121  6878 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.706s	user 0.028s	sys 0.045s
I20260709 13:18:49.336098  7503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "404190ce4ce94cecbfcb6ea9d1dd8626" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:18:49.339069  6874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22ccee1b570c4ad3a57bd7aec085b1b4" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
W20260709 13:18:49.334930  8236 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.751s	user 0.044s	sys 0.045s
I20260709 13:18:49.340553  6874 raft_consensus.cc:2410] T 22ccee1b570c4ad3a57bd7aec085b1b4 P cd75a17ab2604397adab03bb8b5fd75c [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ccd8a4c3bfe3413cb2ae219b09aea832 for term 4 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:18:49.340921  6876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7887766dc6784fcaa42b35c05fea7a99" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:18:49.343263  7500 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50744 (request call id 113) took 2888 ms. Trace:
I20260709 13:18:49.343524  7883 raft_consensus.cc:2804] T 4275cf08e63345f993bce8664eada830 P b7ab4784c7344b939bc36f639286f377 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:18:49.344831  7883 raft_consensus.cc:697] T 4275cf08e63345f993bce8664eada830 P b7ab4784c7344b939bc36f639286f377 [term 3 LEADER]: Becoming Leader. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
I20260709 13:18:49.346876  6723 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49744 (request call id 76) took 1003 ms. Trace:
I20260709 13:18:49.346580  7883 consensus_queue.cc:237] T 4275cf08e63345f993bce8664eada830 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:49.350337  6772 leader_election.cc:304] T dbdf895bba214ff68685a24fd17dfb5d P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:18:49.352193  8074 raft_consensus.cc:2804] T dbdf895bba214ff68685a24fd17dfb5d P b7ab4784c7344b939bc36f639286f377 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:18:49.329732  6626 rpcz_store.cc:276] 0709 13:18:41.681925 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:41.696221 (+ 14296us) service_pool.cc:224] Handling call
0709 13:18:49.324307 (+7628086us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:18:44.563965 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:18:44.595951 (+ 31986us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:18:44.595988 (+    37us) write_op.cc:435] Acquired schema lock
0709 13:18:44.596011 (+    23us) tablet.cc:662] Decoding operations
0709 13:18:44.596627 (+   616us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:18:44.596714 (+    87us) write_op.cc:641] Partition lock acquired for write op
0709 13:18:44.596742 (+    28us) tablet.cc:685] Acquiring locks for 3 operations
0709 13:18:44.597050 (+   308us) tablet.cc:701] Row locks acquired
0709 13:18:44.597071 (+    21us) write_op.cc:260] PREPARE: finished
0709 13:18:44.597213 (+   142us) write_op.cc:270] Start()
0709 13:18:44.597327 (+   114us) write_op.cc:276] Timestamp: P: 1783603124597166 usec, L: 0
0709 13:18:44.597353 (+    26us) op_driver.cc:348] REPLICATION: starting
0709 13:18:44.598129 (+   776us) log.cc:844] Serialized 1288 byte log entry
0709 13:18:45.582677 (+984548us) op_driver.cc:464] REPLICATION: finished
0709 13:18:45.845642 (+262965us) write_op.cc:301] APPLY: starting
0709 13:18:45.848806 (+  3164us) tablet.cc:1367] starting BulkCheckPresence
0709 13:18:45.862494 (+ 13688us) tablet.cc:1370] finished BulkCheckPresence
0709 13:18:45.872283 (+  9789us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:18:45.877859 (+  5576us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:18:45.878081 (+   222us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=3
0709 13:18:45.878125 (+    44us) write_op.cc:312] APPLY: finished
0709 13:18:45.878397 (+   272us) log.cc:844] Serialized 34 byte log entry
0709 13:18:45.878587 (+   190us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:18:45.878683 (+    96us) write_op.cc:454] Released schema lock
0709 13:18:45.878722 (+    39us) write_op.cc:341] FINISH: Updating metrics
0709 13:18:45.879148 (+   426us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:18:45.879186 (+    38us) write_op.cc:454] Released schema lock
0709 13:18:46.283162 (+403976us) spinlock_profiling.cc:243] Waited 1.69 ms on lock 0x7b180004e460. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc15785de1 00007fcc157925b1 00007fcc0f5524bc 00007fcc0c8a048b 00007fcc156faab9 00007fcc0c8bc69b 00007fcc0c8ba93f 00007fcc0c8ba455 00007fcc0f927190 00007fcc0f920ae7 00007fcc0f91fdd9
Metrics: {"mutex_wait_us":1043079,"reported_tablets":5,"child_traces":[["op",{"apply.queue_time_us":259803,"apply.run_cpu_time_us":3198,"apply.run_wall_time_us":33492,"num_ops":3,"prepare.queue_time_us":303721,"prepare.run_cpu_time_us":11379,"prepare.run_wall_time_us":207254,"raft.queue_time_us":636857,"raft.run_cpu_time_us":41833,"raft.run_wall_time_us":222792,"replication_time_us":955720,"spinlock_wait_cycles":3898240,"thread_start_us":1052949,"threads_started":4,"wal-append.queue_time_us":155324,"wal-append.run_cpu_time_us":80706,"wal-append.run_wall_time_us":2517859}]]}
I20260709 13:18:49.352783  8074 raft_consensus.cc:697] T dbdf895bba214ff68685a24fd17dfb5d P b7ab4784c7344b939bc36f639286f377 [term 4 LEADER]: Becoming Leader. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
I20260709 13:18:49.310397  8223 consensus_queue.cc:237] T 8c7f33e544204fbaac4078e3e83bbf4e P b7ab4784c7344b939bc36f639286f377 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:49.354799  6880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "427c124d773f483294511e80fe340075" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:18:49.354866  8074 consensus_queue.cc:237] T dbdf895bba214ff68685a24fd17dfb5d P b7ab4784c7344b939bc36f639286f377 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:49.356020  6880 raft_consensus.cc:2468] T 427c124d773f483294511e80fe340075 P cd75a17ab2604397adab03bb8b5fd75c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 3.
W20260709 13:18:49.277827  8112 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.669s	user 0.034s	sys 0.048s
I20260709 13:18:49.347313  6723 rpcz_store.cc:276] 0709 13:18:48.343188 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:48.344125 (+   937us) service_pool.cc:224] Handling call
0709 13:18:48.344447 (+   322us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:48.582062 (+237615us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:48.582093 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:48.582139 (+    46us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:18:48.582168 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:49.346339 (+764171us) spinlock_profiling.cc:243] Waited 237 ms on lock 0x7b5400394ed4. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f9aae01 00007fcc0f9a983e 00007fcc1496e419 00007fcc0dee5bd4 00007fcc0dee5b62 00007fcc0dee5a91 00007fcc0dee5a0c 00007fcc0dee4cc2 00007fcc0dce548c 00007fcc0dce48c6
0709 13:18:49.346421 (+    82us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:49.346670 (+   249us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":546049280}
I20260709 13:18:49.323959  8331 leader_election.cc:290] T 7ba5dac66ab5497e9e336f2a3c28cda5 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:18:49.368882  7503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3f13b31a1f84f0d89d007eadd57924c" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:18:49.315119  8291 leader_election.cc:290] T 24ee15416e3145beaa1b8183453729a3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
W20260709 13:18:49.367430  8112 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.856s	user 0.034s	sys 0.048s
I20260709 13:18:49.334221  8096 raft_consensus.cc:3055] T 2c240553ce044eedb41541d72b9475d7 P b7ab4784c7344b939bc36f639286f377 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:18:49.370994  8305 raft_consensus.cc:493] T d8292e16e5654be6bc408560cf256aaa P ccd8a4c3bfe3413cb2ae219b09aea832 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:18:49.384397  6770 leader_election.cc:304] T e77e330a82df4b43a745d57a68f6f057 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:18:49.383715  8096 raft_consensus.cc:740] T 2c240553ce044eedb41541d72b9475d7 P b7ab4784c7344b939bc36f639286f377 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
I20260709 13:18:49.399767  6798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ba5dac66ab5497e9e336f2a3c28cda5" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:18:49.400615  7468 leader_election.cc:304] T 4b8cacb381b746da8d0049b0a83b41dd P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:18:49.400964  6798 raft_consensus.cc:2468] T 7ba5dac66ab5497e9e336f2a3c28cda5 P b7ab4784c7344b939bc36f639286f377 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in term 3.
I20260709 13:18:49.401836  8291 raft_consensus.cc:2749] T 4b8cacb381b746da8d0049b0a83b41dd P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:18:49.403882  6847 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:49.408190  6695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 146251us
I20260709 13:18:49.409128  8306 leader_election.cc:290] T b56bf91d90824c959e21e0cee5ba1816 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:18:49.415259  6881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5be3a11b23d4ea9b08300a2789821c7" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:18:49.416517  6878 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53416 (request call id 1928) took 1342 ms. Trace:
I20260709 13:18:49.416433  6801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24ee15416e3145beaa1b8183453729a3" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:18:49.417481  6801 raft_consensus.cc:2468] T 24ee15416e3145beaa1b8183453729a3 P b7ab4784c7344b939bc36f639286f377 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in term 3.
I20260709 13:18:49.417892  6723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24ee15416e3145beaa1b8183453729a3" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:18:49.418612  6723 raft_consensus.cc:2468] T 24ee15416e3145beaa1b8183453729a3 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in term 3.
I20260709 13:18:49.420276  8293 raft_consensus.cc:493] T 9b3759de40694069b13c0f8bd40e5709 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:49.421128  8293 raft_consensus.cc:515] T 9b3759de40694069b13c0f8bd40e5709 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:49.424532  6876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6869f07b5a4885a0b99fbe60c3b175" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 6 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:18:49.426288  6877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d65025eea89441290d85dd053810e31" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:18:49.428257  6873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4db81d9d329422bb3b4160ca4ac2d1d" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:18:49.429124  6873 raft_consensus.cc:2468] T c4db81d9d329422bb3b4160ca4ac2d1d P cd75a17ab2604397adab03bb8b5fd75c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 3.
I20260709 13:18:49.429544  6874 raft_consensus.cc:1240] T e77e330a82df4b43a745d57a68f6f057 P cd75a17ab2604397adab03bb8b5fd75c [term 5 FOLLOWER]: Rejecting Update request from peer ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 4. Current term is 5. Ops: []
I20260709 13:18:49.430087  8305 raft_consensus.cc:515] T d8292e16e5654be6bc408560cf256aaa P ccd8a4c3bfe3413cb2ae219b09aea832 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:49.423712  8293 leader_election.cc:290] T 9b3759de40694069b13c0f8bd40e5709 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:18:49.432618  8305 leader_election.cc:290] T d8292e16e5654be6bc408560cf256aaa P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:18:49.435302  8180 raft_consensus.cc:3060] T bb7fa124c3bf4ef9ab65a407cb008441 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:18:49.440747  6847 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:49.417024  6878 rpcz_store.cc:276] 0709 13:18:48.073888 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:48.617599 (+543711us) service_pool.cc:224] Handling call
0709 13:18:48.618021 (+   422us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:48.620444 (+  2423us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:48.620472 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:48.621027 (+   555us) log.cc:844] Serialized 26 byte log entry
0709 13:18:49.388889 (+767862us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:18:49.398556 (+  9667us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:49.416188 (+ 17632us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:49.416244 (+    56us) raft_consensus.cc:1685] finished
0709 13:18:49.416254 (+    10us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:49.416453 (+   199us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2017,"raft.queue_time_us":2148,"raft.run_cpu_time_us":92,"raft.run_wall_time_us":94,"thread_start_us":712833,"threads_started":1,"wal-append.queue_time_us":639077}
I20260709 13:18:49.411736  6695 leader_election.cc:304] T be1a92657f494cac8dd227d152f50151 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb
I20260709 13:18:49.343784  7500 rpcz_store.cc:276] 0709 13:18:46.454428 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:46.456821 (+  2393us) service_pool.cc:224] Handling call
0709 13:18:47.992307 (+1535486us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:47.992563 (+   256us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:18:48.111090 (+118527us) log.cc:844] Serialized 14 byte log entry
0709 13:18:48.268642 (+157552us) log.cc:844] Serialized 14 byte log entry
0709 13:18:48.270682 (+  2040us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:48.270750 (+    68us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:18:48.270811 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:48.270887 (+    76us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:49.342823 (+1071936us) spinlock_profiling.cc:243] Waited 1.54 s on lock 0x7b5400496450. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f9a98ad 00007fcc1496e419 00007fcc0dee5bd4 00007fcc0dee5b62 00007fcc0dee5a91 00007fcc0dee5a0c 00007fcc0dee4cc2 00007fcc0dce548c 00007fcc0dce48c6 00007fcc0dce426f
0709 13:18:49.343012 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2101,"prepare.queue_time_us":198,"prepare.run_cpu_time_us":63,"prepare.run_wall_time_us":66,"raft.queue_time_us":2480,"raft.run_cpu_time_us":180,"raft.run_wall_time_us":185,"spinlock_wait_cycles":3530632704,"thread_start_us":156706,"threads_started":1,"wal-append.queue_time_us":279923}
I20260709 13:18:49.453053  7466 leader_election.cc:304] T 17587d6730594da4a56fa13a353232a1 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:18:49.453584  8291 consensus_queue.cc:1059] T 404190ce4ce94cecbfcb6ea9d1dd8626 P 7ba59cc884714e8aa5f3f0ecaed84cbb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:18:49.455458  8291 raft_consensus.cc:2749] T 17587d6730594da4a56fa13a353232a1 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:18:49.457068  8096 consensus_queue.cc:260] T 2c240553ce044eedb41541d72b9475d7 P b7ab4784c7344b939bc36f639286f377 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:49.458272  8331 raft_consensus.cc:3055] T 404190ce4ce94cecbfcb6ea9d1dd8626 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:18:49.458827  8331 raft_consensus.cc:740] T 404190ce4ce94cecbfcb6ea9d1dd8626 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 7ba59cc884714e8aa5f3f0ecaed84cbb, State: Running, Role: LEADER
I20260709 13:18:49.459142  8096 raft_consensus.cc:3060] T 2c240553ce044eedb41541d72b9475d7 P b7ab4784c7344b939bc36f639286f377 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:49.460103  8331 consensus_queue.cc:260] T 404190ce4ce94cecbfcb6ea9d1dd8626 P 7ba59cc884714e8aa5f3f0ecaed84cbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:18:49.462072  8331 raft_consensus.cc:3060] T 404190ce4ce94cecbfcb6ea9d1dd8626 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:18:49.452926  6845 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:49.464391  6846 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.68:45071, user_credentials={real_user=slave}} blocked reactor thread for 48385.7us
W20260709 13:18:49.473559  6696 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:49.473187  8315 consensus_queue.cc:1048] T 4f00a2e87e56452083b759f60d461ee3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:18:49.473919  7503 raft_consensus.cc:1275] T bb3d8792045a4583ae2e965b1350a5b4 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 4 FOLLOWER]: Refusing update from remote peer ccd8a4c3bfe3413cb2ae219b09aea832: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:18:49.475394  6731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "713b5728a197487c9300b310ab94e5a3" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
W20260709 13:18:49.485304  6697 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 102200us
I20260709 13:18:49.483932  7466 leader_election.cc:304] T ce4f062dcd314d43a63ca74067cb5ee3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:18:49.507601  8134 raft_consensus.cc:2749] T e77e330a82df4b43a745d57a68f6f057 P b7ab4784c7344b939bc36f639286f377 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:18:49.504457  8257 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.331s	user 0.020s	sys 0.037s
I20260709 13:18:49.507959  8317 raft_consensus.cc:2804] T be1a92657f494cac8dd227d152f50151 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:18:49.526538  8291 raft_consensus.cc:3060] T ce4f062dcd314d43a63ca74067cb5ee3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:18:49.530251  8257 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.530s	user 0.021s	sys 0.037s
W20260709 13:18:49.505869  7468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 45478.6us
I20260709 13:18:49.567811  6872 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53416 (request call id 1929) took 1319 ms. Trace:
W20260709 13:18:49.573173  6695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 161736us
I20260709 13:18:49.545984  8317 raft_consensus.cc:493] T be1a92657f494cac8dd227d152f50151 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 7ba59cc884714e8aa5f3f0ecaed84cbb)
I20260709 13:18:49.564180  8236 raft_consensus.cc:493] T 90d42e216d9741e190bca19a781291fd P cd75a17ab2604397adab03bb8b5fd75c [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
W20260709 13:18:49.612277  8075 consensus_meta.cc:287] T ce4f062dcd314d43a63ca74067cb5ee3 P b7ab4784c7344b939bc36f639286f377: Time spent flushing consensus metadata: real 0.562s	user 0.015s	sys 0.003s
I20260709 13:18:49.573638  6872 rpcz_store.cc:276] 0709 13:18:48.074137 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:48.617988 (+543851us) service_pool.cc:224] Handling call
0709 13:18:48.848947 (+230959us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:48.849239 (+   292us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:18:48.909530 (+ 60291us) log.cc:844] Serialized 14 byte log entry
0709 13:18:48.965072 (+ 55542us) spinlock_profiling.cc:243] Waited 5.31 ms on lock 0x7b180036a300. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc15785de1 00007fcc157925b1 00007fcc0c89fe07 00007fcc156faab9 00007fcc0c8bc69b 00007fcc0c8ba93f 00007fcc0c8bcc02 00007fcc0f54420b 00007fcc0f549d23 00007fcc0f54a23a 00007fcc0f9b4a2a
0709 13:18:49.273514 (+308442us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:49.306620 (+ 33106us) spinlock_profiling.cc:243] Waited 948 us on lock 0x7b180036a300. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc15785de1 00007fcc157925b1 00007fcc0c8bd3f3 00007fcc0c8bf7c1 00007fcc0c8bf779 00007fcc0c8bf709 00007fcc0c8bf6d1 00007fcc0c8be9cd 000000000038f354 000000000038f199 00007fcc0c8a083a
0709 13:18:49.325963 (+ 19343us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:18:49.367247 (+ 41284us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:49.376216 (+  8969us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:49.393749 (+ 17533us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":27472,"prepare.queue_time_us":59069,"prepare.run_cpu_time_us":79,"prepare.run_wall_time_us":1747,"raft.queue_time_us":34513,"raft.run_cpu_time_us":318,"raft.run_wall_time_us":11540,"spinlock_wait_cycles":14383232,"thread_start_us":247498,"threads_started":1,"wal-append.queue_time_us":367224}
I20260709 13:18:49.612567  8236 raft_consensus.cc:515] T 90d42e216d9741e190bca19a781291fd P cd75a17ab2604397adab03bb8b5fd75c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:49.614553  6807 raft_consensus.cc:2468] T ce4f062dcd314d43a63ca74067cb5ee3 P b7ab4784c7344b939bc36f639286f377 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in term 4.
I20260709 13:18:49.588552  8306 consensus_queue.cc:1059] T 853ac0a8cbd64ce99457f170216d4d0f P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.027s
W20260709 13:18:49.617061  8373 log.cc:927] Time spent T 07a92dd554674067a83a9cb68c4773f2 P cd75a17ab2604397adab03bb8b5fd75c: Append to log took a long time: real 0.109s	user 0.001s	sys 0.000s
I20260709 13:18:49.587227  8230 raft_consensus.cc:515] T ab432e62819d499eaaf3dd55481dd930 P b7ab4784c7344b939bc36f639286f377 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
W20260709 13:18:49.619369  6772 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:49.620720  8230 leader_election.cc:290] T ab432e62819d499eaaf3dd55481dd930 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 4 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:18:49.616741  8111 raft_consensus.cc:493] T ce4f062dcd314d43a63ca74067cb5ee3 P b7ab4784c7344b939bc36f639286f377 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:49.625156  8111 raft_consensus.cc:515] T ce4f062dcd314d43a63ca74067cb5ee3 P b7ab4784c7344b939bc36f639286f377 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } attrs { replace: true } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
W20260709 13:18:49.611703  6771 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:49.586524  8317 raft_consensus.cc:3060] T be1a92657f494cac8dd227d152f50151 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:49.620864  8249 raft_consensus.cc:493] T 7c44c4849aa54f2b94d1f1bef9ed546f P cd75a17ab2604397adab03bb8b5fd75c [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:18:49.629344  8357 raft_consensus.cc:493] T 4b8cacb381b746da8d0049b0a83b41dd P cd75a17ab2604397adab03bb8b5fd75c [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:18:49.630220  6879 raft_consensus.cc:1240] T d8292e16e5654be6bc408560cf256aaa P cd75a17ab2604397adab03bb8b5fd75c [term 4 FOLLOWER]: Rejecting Update request from peer b7ab4784c7344b939bc36f639286f377 for earlier term 3. Current term is 4. Ops: []
I20260709 13:18:49.630308  8357 raft_consensus.cc:515] T 4b8cacb381b746da8d0049b0a83b41dd P cd75a17ab2604397adab03bb8b5fd75c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:18:49.629972  6878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5be3a11b23d4ea9b08300a2789821c7" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:18:49.633024  6873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "713b5728a197487c9300b310ab94e5a3" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:18:49.626444  7503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "404190ce4ce94cecbfcb6ea9d1dd8626" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb"
I20260709 13:18:49.630450  6874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d65025eea89441290d85dd053810e31" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
W20260709 13:18:49.636987  6770 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 310827us
I20260709 13:18:49.638113  6770 leader_election.cc:304] T 1528ab62b6fe4e3099d08f141afee116 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:18:49.638202  8357 leader_election.cc:290] T 4b8cacb381b746da8d0049b0a83b41dd P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:18:49.561580  8238 raft_consensus.cc:515] T 1528ab62b6fe4e3099d08f141afee116 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 4 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } attrs { replace: true } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:18:49.635972  8249 raft_consensus.cc:515] T 7c44c4849aa54f2b94d1f1bef9ed546f P cd75a17ab2604397adab03bb8b5fd75c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:49.641830  8238 leader_election.cc:290] T 1528ab62b6fe4e3099d08f141afee116 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 4 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:18:49.644946  8236 leader_election.cc:290] T 90d42e216d9741e190bca19a781291fd P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:18:49.646696  7500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b8cacb381b746da8d0049b0a83b41dd" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:18:49.647078  8249 leader_election.cc:290] T 7c44c4849aa54f2b94d1f1bef9ed546f P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:18:49.647562  7500 raft_consensus.cc:2468] T 4b8cacb381b746da8d0049b0a83b41dd P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 3.
I20260709 13:18:49.649070  6874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bf4668eeb70467fb3dc5a0289233b3c" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:18:49.649829  6874 raft_consensus.cc:3060] T 1bf4668eeb70467fb3dc5a0289233b3c P cd75a17ab2604397adab03bb8b5fd75c [term 2 FOLLOWER]: Advancing to term 4
W20260709 13:18:49.652338  7466 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 196294us
I20260709 13:18:49.653031  6873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "711ef6523deb4cbe8ef2ba61e1c21c98" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:18:49.654053  6873 raft_consensus.cc:2368] T 711ef6523deb4cbe8ef2ba61e1c21c98 P cd75a17ab2604397adab03bb8b5fd75c [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate b7ab4784c7344b939bc36f639286f377 for earlier term 3. Current term is 4.
I20260709 13:18:49.668206  6878 raft_consensus.cc:1240] T 7c37d41cd9164c15a6826ca62a851a69 P cd75a17ab2604397adab03bb8b5fd75c [term 3 FOLLOWER]: Rejecting Update request from peer b7ab4784c7344b939bc36f639286f377 for earlier term 2. Current term is 3. Ops: []
I20260709 13:18:49.674562  6877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe20b4b48823486ca3b9c648db6ce8aa" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:18:49.670954  8074 raft_consensus.cc:493] T d8cee0accdb8499c86d4414b72565a38 P b7ab4784c7344b939bc36f639286f377 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:49.675590  8075 consensus_queue.cc:1059] T d8292e16e5654be6bc408560cf256aaa P b7ab4784c7344b939bc36f639286f377 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:18:49.664222  8357 raft_consensus.cc:493] T 3a485a995abc4807b6e511e45419f737 P cd75a17ab2604397adab03bb8b5fd75c [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:18:49.677083  8074 raft_consensus.cc:515] T d8cee0accdb8499c86d4414b72565a38 P b7ab4784c7344b939bc36f639286f377 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:18:49.677913  8357 raft_consensus.cc:515] T 3a485a995abc4807b6e511e45419f737 P cd75a17ab2604397adab03bb8b5fd75c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:49.675092  6876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24ee15416e3145beaa1b8183453729a3" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:18:49.663944  8236 raft_consensus.cc:493] T 3411566abe2d4c9bb4b2adfdd05e6f17 P cd75a17ab2604397adab03bb8b5fd75c [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:49.673024  6880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1528ab62b6fe4e3099d08f141afee116" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:18:49.680476  8357 leader_election.cc:290] T 3a485a995abc4807b6e511e45419f737 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:18:49.680401  8236 raft_consensus.cc:515] T 3411566abe2d4c9bb4b2adfdd05e6f17 P cd75a17ab2604397adab03bb8b5fd75c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:49.682138  6879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3d8792045a4583ae2e965b1350a5b4" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:18:49.659967  6874 raft_consensus.cc:2468] T 1bf4668eeb70467fb3dc5a0289233b3c P cd75a17ab2604397adab03bb8b5fd75c [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 4.
I20260709 13:18:49.664680  6846 leader_election.cc:304] T 4b8cacb381b746da8d0049b0a83b41dd P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:18:49.684201  8357 raft_consensus.cc:2804] T 4b8cacb381b746da8d0049b0a83b41dd P cd75a17ab2604397adab03bb8b5fd75c [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:18:49.684300  8236 leader_election.cc:290] T 3411566abe2d4c9bb4b2adfdd05e6f17 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:18:49.684684  8074 leader_election.cc:290] T d8cee0accdb8499c86d4414b72565a38 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:18:49.687297  6772 leader_election.cc:400] T 711ef6523deb4cbe8ef2ba61e1c21c98 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 3 election: Vote denied by peer cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931) with higher term. Message: Invalid argument: T 711ef6523deb4cbe8ef2ba61e1c21c98 P cd75a17ab2604397adab03bb8b5fd75c [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate b7ab4784c7344b939bc36f639286f377 for earlier term 3. Current term is 4.
I20260709 13:18:49.687752  6772 leader_election.cc:403] T 711ef6523deb4cbe8ef2ba61e1c21c98 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 3 election: Cancelling election due to peer responding with higher term
I20260709 13:18:49.677677  8075 raft_consensus.cc:3055] T d8292e16e5654be6bc408560cf256aaa P b7ab4784c7344b939bc36f639286f377 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:18:49.683637  6879 raft_consensus.cc:2468] T bb3d8792045a4583ae2e965b1350a5b4 P cd75a17ab2604397adab03bb8b5fd75c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in term 4.
I20260709 13:18:49.655524  7466 leader_election.cc:304] T 7ba5dac66ab5497e9e336f2a3c28cda5 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, b7ab4784c7344b939bc36f639286f377; no voters: 
I20260709 13:18:49.668649  6873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7887766dc6784fcaa42b35c05fea7a99" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:18:49.719588  6878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1528ab62b6fe4e3099d08f141afee116" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:18:49.684713  8357 raft_consensus.cc:493] T 4b8cacb381b746da8d0049b0a83b41dd P cd75a17ab2604397adab03bb8b5fd75c [term 3 FOLLOWER]: Starting leader election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:18:49.689952  8075 raft_consensus.cc:740] T d8292e16e5654be6bc408560cf256aaa P b7ab4784c7344b939bc36f639286f377 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
I20260709 13:18:49.691979  8134 raft_consensus.cc:2804] T 1528ab62b6fe4e3099d08f141afee116 P b7ab4784c7344b939bc36f639286f377 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:18:49.723253  6879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab432e62819d499eaaf3dd55481dd930" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
W20260709 13:18:49.723590  6772 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 48512.2us
I20260709 13:18:49.665762  8316 raft_consensus.cc:493] T d33d5ee8ef6f415593d8df52063161ad P cd75a17ab2604397adab03bb8b5fd75c [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:49.709317  8238 raft_consensus.cc:2804] T 7ba5dac66ab5497e9e336f2a3c28cda5 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:18:49.732446  6878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8cee0accdb8499c86d4414b72565a38" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:18:49.731003  6881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ba5dac66ab5497e9e336f2a3c28cda5" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:18:49.737816  6879 raft_consensus.cc:3060] T ab432e62819d499eaaf3dd55481dd930 P cd75a17ab2604397adab03bb8b5fd75c [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:49.738101  8230 consensus_queue.cc:1059] T 7c37d41cd9164c15a6826ca62a851a69 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:18:49.738193  6878 raft_consensus.cc:2468] T d8cee0accdb8499c86d4414b72565a38 P cd75a17ab2604397adab03bb8b5fd75c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 4.
W20260709 13:18:49.742538  6846 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:49.671152  8223 consensus_queue.cc:1059] T 17587d6730594da4a56fa13a353232a1 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.062s
I20260709 13:18:49.743335  6772 leader_election.cc:304] T 1bf4668eeb70467fb3dc5a0289233b3c P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
W20260709 13:18:49.746739  6770 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 108825us
I20260709 13:18:49.748781  8346 raft_consensus.cc:3055] T 7c37d41cd9164c15a6826ca62a851a69 P b7ab4784c7344b939bc36f639286f377 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:18:49.749339  8346 raft_consensus.cc:740] T 7c37d41cd9164c15a6826ca62a851a69 P b7ab4784c7344b939bc36f639286f377 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
I20260709 13:18:49.750731  8346 consensus_queue.cc:260] T 7c37d41cd9164c15a6826ca62a851a69 P b7ab4784c7344b939bc36f639286f377 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:49.728581  8357 raft_consensus.cc:3060] T 4b8cacb381b746da8d0049b0a83b41dd P cd75a17ab2604397adab03bb8b5fd75c [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:49.730794  8134 raft_consensus.cc:493] T 1528ab62b6fe4e3099d08f141afee116 P b7ab4784c7344b939bc36f639286f377 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:49.759532  7466 leader_election.cc:304] T 24ee15416e3145beaa1b8183453729a3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
I20260709 13:18:49.732165  8238 raft_consensus.cc:493] T 7ba5dac66ab5497e9e336f2a3c28cda5 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 3 FOLLOWER]: Starting leader election (detected failure of leader cd75a17ab2604397adab03bb8b5fd75c)
I20260709 13:18:49.749238  6844 leader_election.cc:304] T bb7fa124c3bf4ef9ab65a407cb008441 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb
I20260709 13:18:49.765185  6772 leader_election.cc:304] T d8cee0accdb8499c86d4414b72565a38 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:18:49.760548  8134 raft_consensus.cc:3060] T 1528ab62b6fe4e3099d08f141afee116 P b7ab4784c7344b939bc36f639286f377 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:49.742237  8074 raft_consensus.cc:3060] T 711ef6523deb4cbe8ef2ba61e1c21c98 P b7ab4784c7344b939bc36f639286f377 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:49.760244  8291 raft_consensus.cc:2749] T ce4f062dcd314d43a63ca74067cb5ee3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:18:49.762840  8238 raft_consensus.cc:3060] T 7ba5dac66ab5497e9e336f2a3c28cda5 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:49.791071  6876 raft_consensus.cc:1275] T 7a734b5ab7834e05a8c422208acc58b1 P cd75a17ab2604397adab03bb8b5fd75c [term 4 FOLLOWER]: Refusing update from remote peer b7ab4784c7344b939bc36f639286f377: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:18:49.796200  8230 raft_consensus.cc:2804] T 1bf4668eeb70467fb3dc5a0289233b3c P b7ab4784c7344b939bc36f639286f377 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:18:49.752815  8316 raft_consensus.cc:515] T d33d5ee8ef6f415593d8df52063161ad P cd75a17ab2604397adab03bb8b5fd75c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:49.802640  8180 raft_consensus.cc:493] T d8cee0accdb8499c86d4414b72565a38 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:18:49.803328  8180 raft_consensus.cc:515] T d8cee0accdb8499c86d4414b72565a38 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
W20260709 13:18:49.804270  6807 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50550 (request call id 77) took 2344 ms (client timeout 2201 ms). Trace:
W20260709 13:18:49.805035  6807 rpcz_store.cc:269] 0709 13:18:47.459628 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:47.460674 (+  1046us) service_pool.cc:224] Handling call
0709 13:18:49.803774 (+2343100us) spinlock_profiling.cc:243] Waited 2.15 s on lock 0x7b54002896d4. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f9ae2fa 00007fcc1496fb17 00007fcc0deea6d4 00007fcc0deea662 00007fcc0deea591 00007fcc0deea50c 00007fcc0dee97c2 00007fcc0dce548c 00007fcc0dce48c6 00007fcc0dce426f
0709 13:18:49.804091 (+   317us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4950758656}
I20260709 13:18:49.806663  8238 raft_consensus.cc:515] T 7ba5dac66ab5497e9e336f2a3c28cda5 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:18:49.806538  8075 consensus_queue.cc:260] T d8292e16e5654be6bc408560cf256aaa P b7ab4784c7344b939bc36f639286f377 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:49.813004  8075 raft_consensus.cc:3060] T d8292e16e5654be6bc408560cf256aaa P b7ab4784c7344b939bc36f639286f377 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:49.807567  8180 leader_election.cc:290] T d8cee0accdb8499c86d4414b72565a38 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:18:49.819221  6695 leader_election.cc:304] T 2c240553ce044eedb41541d72b9475d7 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:18:49.820757  7500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8cee0accdb8499c86d4414b72565a38" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:18:49.822000  7500 raft_consensus.cc:2468] T d8cee0accdb8499c86d4414b72565a38 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 3.
I20260709 13:18:49.823562  8201 leader_election.cc:290] T 22ccee1b570c4ad3a57bd7aec085b1b4 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:18:49.828824  6770 leader_election.cc:304] T f4b8bd455d5a47c18a1380839c6e0d61 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: cd75a17ab2604397adab03bb8b5fd75c
W20260709 13:18:49.833019  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 83989.6us
I20260709 13:18:49.834092  8238 leader_election.cc:290] T 7ba5dac66ab5497e9e336f2a3c28cda5 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 4 election: Requested vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:18:49.835054  6844 leader_election.cc:304] T 2c240553ce044eedb41541d72b9475d7 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:18:49.833775  8075 raft_consensus.cc:2804] T d8cee0accdb8499c86d4414b72565a38 P b7ab4784c7344b939bc36f639286f377 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:18:49.838277  8075 raft_consensus.cc:493] T d8cee0accdb8499c86d4414b72565a38 P b7ab4784c7344b939bc36f639286f377 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:49.838689  8075 raft_consensus.cc:3060] T d8cee0accdb8499c86d4414b72565a38 P b7ab4784c7344b939bc36f639286f377 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:49.841290  6875 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53406 (request call id 1120) took 1512 ms. Trace:
I20260709 13:18:49.841566  8236 raft_consensus.cc:2804] T bb7fa124c3bf4ef9ab65a407cb008441 P cd75a17ab2604397adab03bb8b5fd75c [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:18:49.841995  8236 raft_consensus.cc:493] T bb7fa124c3bf4ef9ab65a407cb008441 P cd75a17ab2604397adab03bb8b5fd75c [term 2 FOLLOWER]: Starting leader election (detected failure of leader 7ba59cc884714e8aa5f3f0ecaed84cbb)
I20260709 13:18:49.841827  6875 rpcz_store.cc:276] 0709 13:18:48.329094 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:48.833113 (+504019us) service_pool.cc:224] Handling call
0709 13:18:48.833498 (+   385us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:49.251401 (+417903us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:49.840904 (+589503us) spinlock_profiling.cc:243] Waited 350 ms on lock 0x7b54000a7dd4. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f9aae01 00007fcc0f9a983e 00007fcc1496e419 00007fcc0dee5bd4 00007fcc0dee5b62 00007fcc0dee5a91 00007fcc0dee5a0c 00007fcc0dee4cc2 00007fcc0dce548c 00007fcc0dce48c6
0709 13:18:49.841205 (+   301us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":805987712}
I20260709 13:18:49.842514  8236 raft_consensus.cc:3060] T bb7fa124c3bf4ef9ab65a407cb008441 P cd75a17ab2604397adab03bb8b5fd75c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:49.808212  6873 raft_consensus.cc:1240] T d33d5ee8ef6f415593d8df52063161ad P cd75a17ab2604397adab03bb8b5fd75c [term 4 FOLLOWER]: Rejecting Update request from peer b7ab4784c7344b939bc36f639286f377 for earlier term 3. Current term is 4. Ops: []
I20260709 13:18:49.810837  8316 leader_election.cc:290] T d33d5ee8ef6f415593d8df52063161ad P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:18:49.843771  6770 leader_election.cc:304] T f09c2a98de1a4decabd0ff900dd44caa P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:18:49.831835  6728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8292e16e5654be6bc408560cf256aaa" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:18:49.860482  6728 raft_consensus.cc:3060] T d8292e16e5654be6bc408560cf256aaa P ccd8a4c3bfe3413cb2ae219b09aea832 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:49.856551  8316 raft_consensus.cc:3060] T 2c240553ce044eedb41541d72b9475d7 P cd75a17ab2604397adab03bb8b5fd75c [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:49.906948  6879 raft_consensus.cc:2410] T ab432e62819d499eaaf3dd55481dd930 P cd75a17ab2604397adab03bb8b5fd75c [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate b7ab4784c7344b939bc36f639286f377 for term 4 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:18:49.788303  8347 consensus_queue.cc:1048] T bd6869f07b5a4885a0b99fbe60c3b175 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.091s
W20260709 13:18:49.921743  6772 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 156702us
W20260709 13:18:50.010615  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 175985us
W20260709 13:18:50.012764  8096 consensus_meta.cc:287] T 2c240553ce044eedb41541d72b9475d7 P b7ab4784c7344b939bc36f639286f377: Time spent flushing consensus metadata: real 0.553s	user 0.019s	sys 0.000s
I20260709 13:18:49.960839  8230 raft_consensus.cc:697] T 1bf4668eeb70467fb3dc5a0289233b3c P b7ab4784c7344b939bc36f639286f377 [term 4 LEADER]: Becoming Leader. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
W20260709 13:18:50.035902  6770 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 204004us
I20260709 13:18:50.028764  8382 raft_consensus.cc:2804] T 24ee15416e3145beaa1b8183453729a3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 13:18:50.047883  6845 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:50.055469  7500 raft_consensus.cc:1240] T 7ba5dac66ab5497e9e336f2a3c28cda5 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 4 FOLLOWER]: Rejecting Update request from peer cd75a17ab2604397adab03bb8b5fd75c for earlier term 3. Current term is 4. Ops: []
I20260709 13:18:50.045933  8223 raft_consensus.cc:2749] T f09c2a98de1a4decabd0ff900dd44caa P b7ab4784c7344b939bc36f639286f377 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:18:50.045455  8382 raft_consensus.cc:493] T 24ee15416e3145beaa1b8183453729a3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 3 FOLLOWER]: Starting leader election (detected failure of leader cd75a17ab2604397adab03bb8b5fd75c)
I20260709 13:18:50.063344  8382 raft_consensus.cc:3060] T 24ee15416e3145beaa1b8183453729a3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:50.065522  8388 consensus_queue.cc:1059] T 7ba5dac66ab5497e9e336f2a3c28cda5 P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:18:50.066707  8388 raft_consensus.cc:3055] T 7ba5dac66ab5497e9e336f2a3c28cda5 P cd75a17ab2604397adab03bb8b5fd75c [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:18:50.067057  8388 raft_consensus.cc:740] T 7ba5dac66ab5497e9e336f2a3c28cda5 P cd75a17ab2604397adab03bb8b5fd75c [term 3 LEADER]: Becoming Follower/Learner. State: Replica: cd75a17ab2604397adab03bb8b5fd75c, State: Running, Role: LEADER
I20260709 13:18:50.068167  8388 consensus_queue.cc:260] T 7ba5dac66ab5497e9e336f2a3c28cda5 P cd75a17ab2604397adab03bb8b5fd75c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:18:50.070014  8388 raft_consensus.cc:3060] T 7ba5dac66ab5497e9e336f2a3c28cda5 P cd75a17ab2604397adab03bb8b5fd75c [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:50.070111  8317 raft_consensus.cc:515] T be1a92657f494cac8dd227d152f50151 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:18:50.071115  8230 consensus_queue.cc:237] T 1bf4668eeb70467fb3dc5a0289233b3c P b7ab4784c7344b939bc36f639286f377 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:50.074599  8317 leader_election.cc:290] T be1a92657f494cac8dd227d152f50151 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 4 election: Requested vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:18:50.058640  8391 raft_consensus.cc:2804] T f4b8bd455d5a47c18a1380839c6e0d61 P b7ab4784c7344b939bc36f639286f377 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:18:50.075332  8391 raft_consensus.cc:493] T f4b8bd455d5a47c18a1380839c6e0d61 P b7ab4784c7344b939bc36f639286f377 [term 1 FOLLOWER]: Starting leader election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:18:50.075747  8391 raft_consensus.cc:3060] T f4b8bd455d5a47c18a1380839c6e0d61 P b7ab4784c7344b939bc36f639286f377 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:50.080762  8075 raft_consensus.cc:515] T d8cee0accdb8499c86d4414b72565a38 P b7ab4784c7344b939bc36f639286f377 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:18:50.083782  8075 leader_election.cc:290] T d8cee0accdb8499c86d4414b72565a38 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 5 election: Requested vote from peers cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
W20260709 13:18:50.087005  6773 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:50.087248  7500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8cee0accdb8499c86d4414b72565a38" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb"
I20260709 13:18:50.085551  8134 raft_consensus.cc:515] T 1528ab62b6fe4e3099d08f141afee116 P b7ab4784c7344b939bc36f639286f377 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } attrs { replace: true } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:18:50.087949  7500 raft_consensus.cc:3060] T d8cee0accdb8499c86d4414b72565a38 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 3 FOLLOWER]: Advancing to term 5
I20260709 13:18:50.089684  8347 raft_consensus.cc:493] T f58dc08b12a2494bb9a1372837970ca2 P b7ab4784c7344b939bc36f639286f377 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:50.090507  8347 raft_consensus.cc:515] T f58dc08b12a2494bb9a1372837970ca2 P b7ab4784c7344b939bc36f639286f377 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:50.042533  8096 raft_consensus.cc:493] T 4d9def8b32fd443aa94ab1420b06837b P b7ab4784c7344b939bc36f639286f377 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:18:50.093165  6807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1528ab62b6fe4e3099d08f141afee116" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
W20260709 13:18:50.196012  6772 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:50.203779  6807 raft_consensus.cc:2393] T 1528ab62b6fe4e3099d08f141afee116 P b7ab4784c7344b939bc36f639286f377 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in current term 4: Already voted for candidate b7ab4784c7344b939bc36f639286f377 in this term.
I20260709 13:18:50.091945  8074 raft_consensus.cc:2749] T 711ef6523deb4cbe8ef2ba61e1c21c98 P b7ab4784c7344b939bc36f639286f377 [term 4 FOLLOWER]: Leader election lost for term 3. Reason: Vote denied by peer cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931) with higher term. Message: Invalid argument: T 711ef6523deb4cbe8ef2ba61e1c21c98 P cd75a17ab2604397adab03bb8b5fd75c [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate b7ab4784c7344b939bc36f639286f377 for earlier term 3. Current term is 4.
W20260709 13:18:50.216554  6773 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:50.219045  6770 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 168394us
W20260709 13:18:50.106146  7468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 152640us
I20260709 13:18:50.223412  6803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8cee0accdb8499c86d4414b72565a38" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:18:50.228986  6770 leader_election.cc:304] T 30e88460611e47b2ba16a46a30b5f416 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:18:50.233253  8134 leader_election.cc:290] T 1528ab62b6fe4e3099d08f141afee116 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 4 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:18:50.235450  6803 raft_consensus.cc:2368] T d8cee0accdb8499c86d4414b72565a38 P b7ab4784c7344b939bc36f639286f377 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ba59cc884714e8aa5f3f0ecaed84cbb for earlier term 4. Current term is 5.
W20260709 13:18:50.236766  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 209235us
I20260709 13:18:50.237761  7496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1528ab62b6fe4e3099d08f141afee116" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb"
W20260709 13:18:50.231815  8331 consensus_meta.cc:287] T 404190ce4ce94cecbfcb6ea9d1dd8626 P 7ba59cc884714e8aa5f3f0ecaed84cbb: Time spent flushing consensus metadata: real 0.769s	user 0.016s	sys 0.002s
I20260709 13:18:50.243395  8316 raft_consensus.cc:2749] T 2c240553ce044eedb41541d72b9475d7 P cd75a17ab2604397adab03bb8b5fd75c [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:18:50.244880  8331 raft_consensus.cc:493] T 3fa34c08b205435dba97346991aa1f92 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:50.237812  6844 leader_election.cc:304] T 9b3759de40694069b13c0f8bd40e5709 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:18:50.094288  8382 raft_consensus.cc:515] T 24ee15416e3145beaa1b8183453729a3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 4 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } attrs { replace: true } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:18:50.250641  7466 leader_election.cc:400] T d8cee0accdb8499c86d4414b72565a38 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 4 pre-election: Vote denied by peer b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817) with higher term. Message: Invalid argument: T d8cee0accdb8499c86d4414b72565a38 P b7ab4784c7344b939bc36f639286f377 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ba59cc884714e8aa5f3f0ecaed84cbb for earlier term 4. Current term is 5.
I20260709 13:18:50.252728  8236 raft_consensus.cc:515] T bb7fa124c3bf4ef9ab65a407cb008441 P cd75a17ab2604397adab03bb8b5fd75c [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:18:50.249328  8238 raft_consensus.cc:493] T bb7fa124c3bf4ef9ab65a407cb008441 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:50.254082  7503 raft_consensus.cc:2468] T 404190ce4ce94cecbfcb6ea9d1dd8626 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 4.
I20260709 13:18:50.245500  8347 leader_election.cc:290] T f58dc08b12a2494bb9a1372837970ca2 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:18:50.256583  7466 leader_election.cc:403] T d8cee0accdb8499c86d4414b72565a38 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 4 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:18:50.256389  8097 raft_consensus.cc:3055] T 17587d6730594da4a56fa13a353232a1 P b7ab4784c7344b939bc36f639286f377 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:18:50.227026  8096 raft_consensus.cc:515] T 4d9def8b32fd443aa94ab1420b06837b P b7ab4784c7344b939bc36f639286f377 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:50.260556  8238 raft_consensus.cc:515] T bb7fa124c3bf4ef9ab65a407cb008441 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:18:50.259611  6770 leader_election.cc:304] T a1704639a875409b9959353527b3fd68 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:18:50.264940  8096 leader_election.cc:290] T 4d9def8b32fd443aa94ab1420b06837b P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:18:50.259326  6728 raft_consensus.cc:2468] T d8292e16e5654be6bc408560cf256aaa P ccd8a4c3bfe3413cb2ae219b09aea832 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 4.
I20260709 13:18:50.261857  8388 raft_consensus.cc:3060] T 9b3759de40694069b13c0f8bd40e5709 P cd75a17ab2604397adab03bb8b5fd75c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:50.261940  8097 raft_consensus.cc:740] T 17587d6730594da4a56fa13a353232a1 P b7ab4784c7344b939bc36f639286f377 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
W20260709 13:18:50.269284  6846 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:50.265821  6770 leader_election.cc:304] T 3411566abe2d4c9bb4b2adfdd05e6f17 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:18:50.270140  7500 raft_consensus.cc:2468] T d8cee0accdb8499c86d4414b72565a38 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 5.
I20260709 13:18:50.269181  8115 raft_consensus.cc:493] T a3022224cc81473690653a83d4e99470 P cd75a17ab2604397adab03bb8b5fd75c [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:50.245703  8331 raft_consensus.cc:515] T 3fa34c08b205435dba97346991aa1f92 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:18:50.275882  8291 raft_consensus.cc:2749] T d8cee0accdb8499c86d4414b72565a38 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: Vote denied by peer b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817) with higher term. Message: Invalid argument: T d8cee0accdb8499c86d4414b72565a38 P b7ab4784c7344b939bc36f639286f377 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ba59cc884714e8aa5f3f0ecaed84cbb for earlier term 4. Current term is 5.
I20260709 13:18:50.274024  8097 consensus_queue.cc:260] T 17587d6730594da4a56fa13a353232a1 P b7ab4784c7344b939bc36f639286f377 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:18:50.278100  8097 raft_consensus.cc:3060] T 17587d6730594da4a56fa13a353232a1 P b7ab4784c7344b939bc36f639286f377 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:50.278160  8115 raft_consensus.cc:515] T a3022224cc81473690653a83d4e99470 P cd75a17ab2604397adab03bb8b5fd75c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:50.279212  8238 leader_election.cc:290] T bb7fa124c3bf4ef9ab65a407cb008441 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:18:50.266875  8347 raft_consensus.cc:2804] T a1704639a875409b9959353527b3fd68 P b7ab4784c7344b939bc36f639286f377 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:18:50.281392  8347 raft_consensus.cc:493] T a1704639a875409b9959353527b3fd68 P b7ab4784c7344b939bc36f639286f377 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:50.281785  8347 raft_consensus.cc:3060] T a1704639a875409b9959353527b3fd68 P b7ab4784c7344b939bc36f639286f377 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:50.283281  8236 leader_election.cc:290] T bb7fa124c3bf4ef9ab65a407cb008441 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 3 election: Requested vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:18:50.284406  6772 leader_election.cc:304] T d8cee0accdb8499c86d4414b72565a38 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, b7ab4784c7344b939bc36f639286f377; no voters: 
I20260709 13:18:50.284668  7496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb7fa124c3bf4ef9ab65a407cb008441" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb"
I20260709 13:18:50.285193  8120 raft_consensus.cc:2804] T 3411566abe2d4c9bb4b2adfdd05e6f17 P b7ab4784c7344b939bc36f639286f377 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:18:50.285910  8120 raft_consensus.cc:493] T 3411566abe2d4c9bb4b2adfdd05e6f17 P b7ab4784c7344b939bc36f639286f377 [term 1 FOLLOWER]: Starting leader election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:18:50.286489  8120 raft_consensus.cc:3060] T 3411566abe2d4c9bb4b2adfdd05e6f17 P b7ab4784c7344b939bc36f639286f377 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:18:50.287094  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 49432.5us
I20260709 13:18:50.288159  6844 leader_election.cc:304] T de3186201e1a40d0b335eeb8b4e256e0 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:18:50.291244  6844 leader_election.cc:304] T d8cee0accdb8499c86d4414b72565a38 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, b7ab4784c7344b939bc36f639286f377
I20260709 13:18:50.293918  6801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ba5dac66ab5497e9e336f2a3c28cda5" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:18:50.294703  6801 raft_consensus.cc:3060] T 7ba5dac66ab5497e9e336f2a3c28cda5 P b7ab4784c7344b939bc36f639286f377 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:50.285133  6770 leader_election.cc:304] T b3f13b31a1f84f0d89d007eadd57924c P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:18:50.296012  7496 raft_consensus.cc:2468] T bb7fa124c3bf4ef9ab65a407cb008441 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 3.
I20260709 13:18:50.285883  8382 leader_election.cc:290] T 24ee15416e3145beaa1b8183453729a3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 4 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:18:50.297416  8074 consensus_queue.cc:1059] T d33d5ee8ef6f415593d8df52063161ad P b7ab4784c7344b939bc36f639286f377 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:18:50.298368  8075 raft_consensus.cc:2804] T d8cee0accdb8499c86d4414b72565a38 P b7ab4784c7344b939bc36f639286f377 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:18:50.298743  6770 leader_election.cc:304] T 07a92dd554674067a83a9cb68c4773f2 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:18:50.298949  8075 raft_consensus.cc:697] T d8cee0accdb8499c86d4414b72565a38 P b7ab4784c7344b939bc36f639286f377 [term 5 LEADER]: Becoming Leader. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
I20260709 13:18:50.299626  8120 raft_consensus.cc:515] T 3411566abe2d4c9bb4b2adfdd05e6f17 P b7ab4784c7344b939bc36f639286f377 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:50.298357  8074 raft_consensus.cc:2749] T b3f13b31a1f84f0d89d007eadd57924c P b7ab4784c7344b939bc36f639286f377 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:18:50.300243  8075 consensus_queue.cc:237] T d8cee0accdb8499c86d4414b72565a38 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:18:50.301259  8392 raft_consensus.cc:2749] T 07a92dd554674067a83a9cb68c4773f2 P b7ab4784c7344b939bc36f639286f377 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:18:50.301735  8331 leader_election.cc:290] T 3fa34c08b205435dba97346991aa1f92 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:18:50.302610  6846 leader_election.cc:304] T bb7fa124c3bf4ef9ab65a407cb008441 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:18:50.303920  8115 leader_election.cc:290] T a3022224cc81473690653a83d4e99470 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:18:50.304136  6770 leader_election.cc:304] T 22ccee1b570c4ad3a57bd7aec085b1b4 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:18:50.305917  6770 leader_election.cc:304] T 34f36d59d88f40fe8a2805e604fc6c0a P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:18:50.306886  8391 raft_consensus.cc:515] T f4b8bd455d5a47c18a1380839c6e0d61 P b7ab4784c7344b939bc36f639286f377 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:50.308126  8120 leader_election.cc:290] T 3411566abe2d4c9bb4b2adfdd05e6f17 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 2 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:18:50.258203  8134 raft_consensus.cc:2749] T 30e88460611e47b2ba16a46a30b5f416 P b7ab4784c7344b939bc36f639286f377 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:18:50.274550  8357 consensus_meta.cc:287] T 4b8cacb381b746da8d0049b0a83b41dd P cd75a17ab2604397adab03bb8b5fd75c: Time spent flushing consensus metadata: real 0.510s	user 0.011s	sys 0.000s
I20260709 13:18:50.311057  8249 raft_consensus.cc:2804] T de3186201e1a40d0b335eeb8b4e256e0 P cd75a17ab2604397adab03bb8b5fd75c [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:18:50.311339  8357 raft_consensus.cc:515] T 4b8cacb381b746da8d0049b0a83b41dd P cd75a17ab2604397adab03bb8b5fd75c [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:18:50.311775  8249 raft_consensus.cc:493] T de3186201e1a40d0b335eeb8b4e256e0 P cd75a17ab2604397adab03bb8b5fd75c [term 3 FOLLOWER]: Starting leader election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:18:50.312383  8249 raft_consensus.cc:3060] T de3186201e1a40d0b335eeb8b4e256e0 P cd75a17ab2604397adab03bb8b5fd75c [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:50.312691  8115 raft_consensus.cc:2749] T d8cee0accdb8499c86d4414b72565a38 P cd75a17ab2604397adab03bb8b5fd75c [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:18:50.313494  8115 raft_consensus.cc:2804] T bb7fa124c3bf4ef9ab65a407cb008441 P cd75a17ab2604397adab03bb8b5fd75c [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:18:50.313800  8357 leader_election.cc:290] T 4b8cacb381b746da8d0049b0a83b41dd P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 4 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:18:50.313954  8115 raft_consensus.cc:697] T bb7fa124c3bf4ef9ab65a407cb008441 P cd75a17ab2604397adab03bb8b5fd75c [term 3 LEADER]: Becoming Leader. State: Replica: cd75a17ab2604397adab03bb8b5fd75c, State: Running, Role: LEADER
I20260709 13:18:50.314968  8115 consensus_queue.cc:237] T bb7fa124c3bf4ef9ab65a407cb008441 P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:18:50.299180  6732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab432e62819d499eaaf3dd55481dd930" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:18:50.308887  8074 raft_consensus.cc:3060] T 22ccee1b570c4ad3a57bd7aec085b1b4 P b7ab4784c7344b939bc36f639286f377 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:50.316599  6732 raft_consensus.cc:2468] T ab432e62819d499eaaf3dd55481dd930 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 3.
I20260709 13:18:50.317523  7496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b8cacb381b746da8d0049b0a83b41dd" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb"
I20260709 13:18:50.318301  7496 raft_consensus.cc:3060] T 4b8cacb381b746da8d0049b0a83b41dd P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:50.308904  8096 raft_consensus.cc:2749] T 34f36d59d88f40fe8a2805e604fc6c0a P b7ab4784c7344b939bc36f639286f377 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:50.315950  6770 leader_election.cc:304] T 9b3759de40694069b13c0f8bd40e5709 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:18:50.329537  6807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24ee15416e3145beaa1b8183453729a3" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:18:50.330319  6807 raft_consensus.cc:3060] T 24ee15416e3145beaa1b8183453729a3 P b7ab4784c7344b939bc36f639286f377 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:50.332959  8391 leader_election.cc:290] T f4b8bd455d5a47c18a1380839c6e0d61 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 2 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:18:50.332687  6803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb7fa124c3bf4ef9ab65a407cb008441" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:18:50.333976  6803 raft_consensus.cc:2468] T bb7fa124c3bf4ef9ab65a407cb008441 P b7ab4784c7344b939bc36f639286f377 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in term 3.
I20260709 13:18:50.335259  8388 raft_consensus.cc:2749] T 9b3759de40694069b13c0f8bd40e5709 P cd75a17ab2604397adab03bb8b5fd75c [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:18:50.336330  6770 leader_election.cc:304] T f03d0dbf16864ca4bc1bb5e4c0334c0f P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:18:50.337157  6844 leader_election.cc:304] T 34f36d59d88f40fe8a2805e604fc6c0a P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:18:50.339946  8391 raft_consensus.cc:2749] T f03d0dbf16864ca4bc1bb5e4c0334c0f P b7ab4784c7344b939bc36f639286f377 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:18:50.342013  8388 raft_consensus.cc:2749] T 34f36d59d88f40fe8a2805e604fc6c0a P cd75a17ab2604397adab03bb8b5fd75c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:50.347564  7466 leader_election.cc:304] T bb7fa124c3bf4ef9ab65a407cb008441 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, b7ab4784c7344b939bc36f639286f377; no voters: 
I20260709 13:18:50.351945  6807 raft_consensus.cc:2468] T 24ee15416e3145beaa1b8183453729a3 P b7ab4784c7344b939bc36f639286f377 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in term 4.
I20260709 13:18:50.345984  8230 raft_consensus.cc:2749] T 9b3759de40694069b13c0f8bd40e5709 P b7ab4784c7344b939bc36f639286f377 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:18:50.355583  6844 leader_election.cc:304] T bd6869f07b5a4885a0b99fbe60c3b175 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:18:50.353149  8331 raft_consensus.cc:2804] T bb7fa124c3bf4ef9ab65a407cb008441 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:18:50.362835  8111 leader_election.cc:290] T ce4f062dcd314d43a63ca74067cb5ee3 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:18:50.364079  7500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce4f062dcd314d43a63ca74067cb5ee3" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:18:50.373060  7500 raft_consensus.cc:2468] T ce4f062dcd314d43a63ca74067cb5ee3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 4.
I20260709 13:18:50.374967  8331 raft_consensus.cc:493] T bb7fa124c3bf4ef9ab65a407cb008441 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:50.375741  8331 raft_consensus.cc:3060] T bb7fa124c3bf4ef9ab65a407cb008441 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:50.363343  6770 leader_election.cc:304] T 95a75bfe094d4bdc963aba3f08dfcd25 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:18:49.605759  6730 raft_consensus.cc:1240] T f5be3a11b23d4ea9b08300a2789821c7 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 4 FOLLOWER]: Rejecting Update request from peer cd75a17ab2604397adab03bb8b5fd75c for earlier term 3. Current term is 4. Ops: []
I20260709 13:18:50.385306  8388 raft_consensus.cc:2749] T bd6869f07b5a4885a0b99fbe60c3b175 P cd75a17ab2604397adab03bb8b5fd75c [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:18:50.388415  8245 raft_consensus.cc:3060] T 95a75bfe094d4bdc963aba3f08dfcd25 P b7ab4784c7344b939bc36f639286f377 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:50.391319  8331 raft_consensus.cc:515] T bb7fa124c3bf4ef9ab65a407cb008441 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:18:50.394908  8331 leader_election.cc:290] T bb7fa124c3bf4ef9ab65a407cb008441 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 4 election: Requested vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
W20260709 13:18:50.392251  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 44354.8us
I20260709 13:18:50.395841  6807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bf4668eeb70467fb3dc5a0289233b3c" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:18:50.401283  6801 raft_consensus.cc:2468] T 7ba5dac66ab5497e9e336f2a3c28cda5 P b7ab4784c7344b939bc36f639286f377 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in term 4.
I20260709 13:18:50.404528  6799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09c2a98de1a4decabd0ff900dd44caa" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:18:50.405514  6806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44bde925b2e541b69890d70715b85176" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:18:50.406029  6800 raft_consensus.cc:1240] T f3f9c2e2bf644115957398fe4c9459db P b7ab4784c7344b939bc36f639286f377 [term 3 FOLLOWER]: Rejecting Update request from peer cd75a17ab2604397adab03bb8b5fd75c for earlier term 2. Current term is 3. Ops: []
I20260709 13:18:50.406729  6803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77e330a82df4b43a745d57a68f6f057" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:18:50.407686  6802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a75bfe094d4bdc963aba3f08dfcd25" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:18:50.406028  6805 raft_consensus.cc:1240] T 1528ab62b6fe4e3099d08f141afee116 P b7ab4784c7344b939bc36f639286f377 [term 4 FOLLOWER]: Rejecting Update request from peer cd75a17ab2604397adab03bb8b5fd75c for earlier term 3. Current term is 4. Ops: []
I20260709 13:18:50.416600  6800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c7f33e544204fbaac4078e3e83bbf4e" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:18:50.403616  6798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "427c124d773f483294511e80fe340075" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:18:50.389412  8074 raft_consensus.cc:2749] T 22ccee1b570c4ad3a57bd7aec085b1b4 P b7ab4784c7344b939bc36f639286f377 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:18:50.413976  6799 raft_consensus.cc:2468] T f09c2a98de1a4decabd0ff900dd44caa P b7ab4784c7344b939bc36f639286f377 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 3.
I20260709 13:18:50.415973  6806 raft_consensus.cc:3060] T 44bde925b2e541b69890d70715b85176 P b7ab4784c7344b939bc36f639286f377 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:50.417418  6805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1704639a875409b9959353527b3fd68" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:18:50.416066  6803 raft_consensus.cc:3060] T e77e330a82df4b43a745d57a68f6f057 P b7ab4784c7344b939bc36f639286f377 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:50.420938  6800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c37d41cd9164c15a6826ca62a851a69" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:18:50.396438  7496 raft_consensus.cc:2468] T 4b8cacb381b746da8d0049b0a83b41dd P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 4.
I20260709 13:18:50.424594  7466 leader_election.cc:304] T 7ba5dac66ab5497e9e336f2a3c28cda5 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, b7ab4784c7344b939bc36f639286f377; no voters: 
I20260709 13:18:50.427783  8382 raft_consensus.cc:2804] T 7ba5dac66ab5497e9e336f2a3c28cda5 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:18:50.428578  8382 raft_consensus.cc:697] T 7ba5dac66ab5497e9e336f2a3c28cda5 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 4 LEADER]: Becoming Leader. State: Replica: 7ba59cc884714e8aa5f3f0ecaed84cbb, State: Running, Role: LEADER
I20260709 13:18:50.429235  6804 raft_consensus.cc:1240] T 22ccee1b570c4ad3a57bd7aec085b1b4 P b7ab4784c7344b939bc36f639286f377 [term 3 FOLLOWER]: Rejecting Update request from peer cd75a17ab2604397adab03bb8b5fd75c for earlier term 2. Current term is 3. Ops: []
I20260709 13:18:50.429497  8382 consensus_queue.cc:237] T 7ba5dac66ab5497e9e336f2a3c28cda5 P 7ba59cc884714e8aa5f3f0ecaed84cbb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:18:50.431391  6804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "711ef6523deb4cbe8ef2ba61e1c21c98" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:18:50.432207  6807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab432e62819d499eaaf3dd55481dd930" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:18:50.433030  6807 raft_consensus.cc:2393] T ab432e62819d499eaaf3dd55481dd930 P b7ab4784c7344b939bc36f639286f377 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c in current term 4: Already voted for candidate b7ab4784c7344b939bc36f639286f377 in this term.
I20260709 13:18:50.434055  6807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22ccee1b570c4ad3a57bd7aec085b1b4" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:18:50.435665  6807 raft_consensus.cc:2468] T 22ccee1b570c4ad3a57bd7aec085b1b4 P b7ab4784c7344b939bc36f639286f377 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 3.
I20260709 13:18:50.436935  6798 raft_consensus.cc:2393] T 427c124d773f483294511e80fe340075 P b7ab4784c7344b939bc36f639286f377 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c in current term 3: Already voted for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in this term.
I20260709 13:18:50.437569  6799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "713b5728a197487c9300b310ab94e5a3" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:18:50.438510  6799 raft_consensus.cc:2393] T 713b5728a197487c9300b310ab94e5a3 P b7ab4784c7344b939bc36f639286f377 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c in current term 4: Already voted for candidate b7ab4784c7344b939bc36f639286f377 in this term.
I20260709 13:18:50.444404  6846 leader_election.cc:304] T 4b8cacb381b746da8d0049b0a83b41dd P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:18:50.445410  8347 raft_consensus.cc:515] T a1704639a875409b9959353527b3fd68 P b7ab4784c7344b939bc36f639286f377 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:50.443775  8249 raft_consensus.cc:515] T de3186201e1a40d0b335eeb8b4e256e0 P cd75a17ab2604397adab03bb8b5fd75c [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:50.448907  8347 leader_election.cc:290] T a1704639a875409b9959353527b3fd68 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 4 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:18:50.449729  8249 leader_election.cc:290] T de3186201e1a40d0b335eeb8b4e256e0 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 4 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:18:50.450476  8249 raft_consensus.cc:2804] T 4b8cacb381b746da8d0049b0a83b41dd P cd75a17ab2604397adab03bb8b5fd75c [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:18:50.450969  8249 raft_consensus.cc:697] T 4b8cacb381b746da8d0049b0a83b41dd P cd75a17ab2604397adab03bb8b5fd75c [term 4 LEADER]: Becoming Leader. State: Replica: cd75a17ab2604397adab03bb8b5fd75c, State: Running, Role: LEADER
I20260709 13:18:50.435276  6844 leader_election.cc:304] T 9e326172347f45e99a0d482b5d8ef768 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:18:50.451903  8249 consensus_queue.cc:237] T 4b8cacb381b746da8d0049b0a83b41dd P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:18:50.463356  8245 raft_consensus.cc:2749] T 95a75bfe094d4bdc963aba3f08dfcd25 P b7ab4784c7344b939bc36f639286f377 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:18:50.488022  8346 raft_consensus.cc:3060] T 7c37d41cd9164c15a6826ca62a851a69 P b7ab4784c7344b939bc36f639286f377 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:50.489111  6802 raft_consensus.cc:2468] T 95a75bfe094d4bdc963aba3f08dfcd25 P b7ab4784c7344b939bc36f639286f377 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 4.
I20260709 13:18:50.490394  8308 raft_consensus.cc:3060] T f3f9c2e2bf644115957398fe4c9459db P cd75a17ab2604397adab03bb8b5fd75c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:50.524863  6806 raft_consensus.cc:2468] T 44bde925b2e541b69890d70715b85176 P b7ab4784c7344b939bc36f639286f377 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 4.
I20260709 13:18:50.526302  6806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f00a2e87e56452083b759f60d461ee3" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:18:50.527783  6806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "711ef6523deb4cbe8ef2ba61e1c21c98" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:18:50.529268  6806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09c2a98de1a4decabd0ff900dd44caa" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
W20260709 13:18:50.529096  8385 log.cc:927] Time spent T 00000000000000000000000000000000 P b3ae52d33b9a4273a42e5e2cf3b5d6b5: Append to log took a long time: real 0.484s	user 0.000s	sys 0.005s
I20260709 13:18:50.530215  6806 raft_consensus.cc:3060] T f09c2a98de1a4decabd0ff900dd44caa P b7ab4784c7344b939bc36f639286f377 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:50.555873  6800 raft_consensus.cc:2468] T 7c37d41cd9164c15a6826ca62a851a69 P b7ab4784c7344b939bc36f639286f377 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 3.
I20260709 13:18:50.558908  6806 raft_consensus.cc:2468] T f09c2a98de1a4decabd0ff900dd44caa P b7ab4784c7344b939bc36f639286f377 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 4.
I20260709 13:18:50.563196  6806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb7fa124c3bf4ef9ab65a407cb008441" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:18:50.566130  6806 raft_consensus.cc:3060] T bb7fa124c3bf4ef9ab65a407cb008441 P b7ab4784c7344b939bc36f639286f377 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:50.570531  8308 raft_consensus.cc:493] T dbdf895bba214ff68685a24fd17dfb5d P cd75a17ab2604397adab03bb8b5fd75c [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:50.571169  8308 raft_consensus.cc:515] T dbdf895bba214ff68685a24fd17dfb5d P cd75a17ab2604397adab03bb8b5fd75c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:50.573729  8308 leader_election.cc:290] T dbdf895bba214ff68685a24fd17dfb5d P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:18:50.574657  6806 raft_consensus.cc:2468] T bb7fa124c3bf4ef9ab65a407cb008441 P b7ab4784c7344b939bc36f639286f377 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in term 4.
W20260709 13:18:50.566394  6845 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:50.577616  6806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce4f062dcd314d43a63ca74067cb5ee3" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:18:50.581785  6806 raft_consensus.cc:3060] T ce4f062dcd314d43a63ca74067cb5ee3 P b7ab4784c7344b939bc36f639286f377 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:50.589381  6807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30e88460611e47b2ba16a46a30b5f416" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:18:50.590440  6807 raft_consensus.cc:2468] T 30e88460611e47b2ba16a46a30b5f416 P b7ab4784c7344b939bc36f639286f377 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 2.
I20260709 13:18:50.591782  6807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4b8bd455d5a47c18a1380839c6e0d61" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:18:50.592568  6807 raft_consensus.cc:2468] T f4b8bd455d5a47c18a1380839c6e0d61 P b7ab4784c7344b939bc36f639286f377 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 2.
I20260709 13:18:50.593681  6807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d9def8b32fd443aa94ab1420b06837b" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:18:50.594576  6807 raft_consensus.cc:2410] T 4d9def8b32fd443aa94ab1420b06837b P b7ab4784c7344b939bc36f639286f377 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:18:50.594630  6806 raft_consensus.cc:2468] T ce4f062dcd314d43a63ca74067cb5ee3 P b7ab4784c7344b939bc36f639286f377 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 5.
I20260709 13:18:50.596658  6806 raft_consensus.cc:1275] T f58dc08b12a2494bb9a1372837970ca2 P b7ab4784c7344b939bc36f639286f377 [term 4 FOLLOWER]: Refusing update from remote peer cd75a17ab2604397adab03bb8b5fd75c: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:18:50.599354  6807 raft_consensus.cc:1240] T 24ee15416e3145beaa1b8183453729a3 P b7ab4784c7344b939bc36f639286f377 [term 4 FOLLOWER]: Rejecting Update request from peer cd75a17ab2604397adab03bb8b5fd75c for earlier term 3. Current term is 4. Ops: []
W20260709 13:18:50.605667  6697 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 1.03426e+06us
W20260709 13:18:50.627332  6695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 808200us
I20260709 13:18:50.629422  6695 leader_election.cc:304] T f58dc08b12a2494bb9a1372837970ca2 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:18:50.638304  6723 raft_consensus.cc:1240] T 7887766dc6784fcaa42b35c05fea7a99 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 3 FOLLOWER]: Rejecting Update request from peer cd75a17ab2604397adab03bb8b5fd75c for earlier term 2. Current term is 3. Ops: []
I20260709 13:18:50.639400  6724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c37d41cd9164c15a6826ca62a851a69" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:18:50.640219  6730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09c2a98de1a4decabd0ff900dd44caa" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:18:50.640532  6728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1704639a875409b9959353527b3fd68" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:18:50.640983  6730 raft_consensus.cc:3060] T f09c2a98de1a4decabd0ff900dd44caa P ccd8a4c3bfe3413cb2ae219b09aea832 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:50.641500  6728 raft_consensus.cc:3060] T a1704639a875409b9959353527b3fd68 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:50.646096  6732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c7f33e544204fbaac4078e3e83bbf4e" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:18:50.640337  6724 raft_consensus.cc:3060] T 7c37d41cd9164c15a6826ca62a851a69 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:50.647050  6732 raft_consensus.cc:2468] T 8c7f33e544204fbaac4078e3e83bbf4e P ccd8a4c3bfe3413cb2ae219b09aea832 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 2.
I20260709 13:18:50.649596  6727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4b8bd455d5a47c18a1380839c6e0d61" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:18:50.650215  8364 raft_consensus.cc:493] T f3f9c2e2bf644115957398fe4c9459db P cd75a17ab2604397adab03bb8b5fd75c [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:50.650451  6727 raft_consensus.cc:2468] T f4b8bd455d5a47c18a1380839c6e0d61 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 2.
I20260709 13:18:50.650794  8364 raft_consensus.cc:515] T f3f9c2e2bf644115957398fe4c9459db P cd75a17ab2604397adab03bb8b5fd75c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:50.652484  6732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30e88460611e47b2ba16a46a30b5f416" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:18:50.655701  6723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "711ef6523deb4cbe8ef2ba61e1c21c98" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:18:50.655776  6727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fa34c08b205435dba97346991aa1f92" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:18:50.656621  6723 raft_consensus.cc:3060] T 711ef6523deb4cbe8ef2ba61e1c21c98 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:50.657323  6728 raft_consensus.cc:2468] T a1704639a875409b9959353527b3fd68 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 4.
I20260709 13:18:50.657584  6732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22ccee1b570c4ad3a57bd7aec085b1b4" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:18:50.658219  6732 raft_consensus.cc:2468] T 22ccee1b570c4ad3a57bd7aec085b1b4 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 3.
I20260709 13:18:50.659147  6732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce4f062dcd314d43a63ca74067cb5ee3" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:18:50.659901  6732 raft_consensus.cc:3060] T ce4f062dcd314d43a63ca74067cb5ee3 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:50.659948  6727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b56bf91d90824c959e21e0cee5ba1816" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:18:50.660650  6727 raft_consensus.cc:3060] T b56bf91d90824c959e21e0cee5ba1816 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:50.666465  8346 raft_consensus.cc:493] T 427c124d773f483294511e80fe340075 P b7ab4784c7344b939bc36f639286f377 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:50.668383  6730 raft_consensus.cc:2468] T f09c2a98de1a4decabd0ff900dd44caa P ccd8a4c3bfe3413cb2ae219b09aea832 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 4.
I20260709 13:18:50.673676  8346 raft_consensus.cc:515] T 427c124d773f483294511e80fe340075 P b7ab4784c7344b939bc36f639286f377 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } attrs { replace: true } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: NON_VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: true } }
I20260709 13:18:50.438526  6798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8292e16e5654be6bc408560cf256aaa" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:18:50.672216  6724 raft_consensus.cc:2468] T 7c37d41cd9164c15a6826ca62a851a69 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 3.
I20260709 13:18:50.677531  6723 raft_consensus.cc:2468] T 711ef6523deb4cbe8ef2ba61e1c21c98 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 4.
I20260709 13:18:50.678052  8346 leader_election.cc:290] T 427c124d773f483294511e80fe340075 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
W20260709 13:18:50.679664  6846 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:50.681248  7503 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50744 (request call id 119) took 1057 ms. Trace:
I20260709 13:18:50.681649  7503 rpcz_store.cc:276] 0709 13:18:49.625761 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:49.626050 (+   289us) service_pool.cc:224] Handling call
0709 13:18:50.681019 (+1054969us) spinlock_profiling.cc:243] Waited 605 ms on lock 0x7b5400570154. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f9ae2fa 00007fcc1496fb17 00007fcc0deea6d4 00007fcc0deea662 00007fcc0deea591 00007fcc0deea50c 00007fcc0dee97c2 00007fcc0dce548c 00007fcc0dce48c6 00007fcc0dce426f
0709 13:18:50.681155 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1392504192}
I20260709 13:18:50.689397  6732 raft_consensus.cc:2468] T ce4f062dcd314d43a63ca74067cb5ee3 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 5.
I20260709 13:18:50.691100  6728 raft_consensus.cc:1275] T f58dc08b12a2494bb9a1372837970ca2 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 4 FOLLOWER]: Refusing update from remote peer cd75a17ab2604397adab03bb8b5fd75c: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:18:50.683431  6727 raft_consensus.cc:2468] T b56bf91d90824c959e21e0cee5ba1816 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 4.
I20260709 13:18:50.692524  6798 raft_consensus.cc:2468] T d8292e16e5654be6bc408560cf256aaa P b7ab4784c7344b939bc36f639286f377 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 4.
I20260709 13:18:50.694927  8094 raft_consensus.cc:3055] T e77e330a82df4b43a745d57a68f6f057 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:18:50.695451  8094 raft_consensus.cc:740] T e77e330a82df4b43a745d57a68f6f057 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
I20260709 13:18:50.701052  6805 raft_consensus.cc:2393] T a1704639a875409b9959353527b3fd68 P b7ab4784c7344b939bc36f639286f377 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c in current term 4: Already voted for candidate b7ab4784c7344b939bc36f639286f377 in this term.
I20260709 13:18:50.701948  8346 raft_consensus.cc:493] T 20f6842e26174571996b8dea4151d4be P b7ab4784c7344b939bc36f639286f377 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:18:50.702545  8346 raft_consensus.cc:515] T 20f6842e26174571996b8dea4151d4be P b7ab4784c7344b939bc36f639286f377 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:50.706969  8346 leader_election.cc:290] T 20f6842e26174571996b8dea4151d4be P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:18:50.726823  6803 raft_consensus.cc:2468] T e77e330a82df4b43a745d57a68f6f057 P b7ab4784c7344b939bc36f639286f377 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 5.
I20260709 13:18:50.733012  7466 leader_election.cc:304] T bb7fa124c3bf4ef9ab65a407cb008441 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, b7ab4784c7344b939bc36f639286f377; no voters: 
I20260709 13:18:50.734208  8382 raft_consensus.cc:2804] T bb7fa124c3bf4ef9ab65a407cb008441 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:18:50.734846  8382 raft_consensus.cc:697] T bb7fa124c3bf4ef9ab65a407cb008441 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 4 LEADER]: Becoming Leader. State: Replica: 7ba59cc884714e8aa5f3f0ecaed84cbb, State: Running, Role: LEADER
I20260709 13:18:50.735841  8382 consensus_queue.cc:237] T bb7fa124c3bf4ef9ab65a407cb008441 P 7ba59cc884714e8aa5f3f0ecaed84cbb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
W20260709 13:18:50.746869  6846 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:50.748090  6772 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:50.748889  8346 raft_consensus.cc:493] T 2c240553ce044eedb41541d72b9475d7 P b7ab4784c7344b939bc36f639286f377 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:50.749703  8346 raft_consensus.cc:515] T 2c240553ce044eedb41541d72b9475d7 P b7ab4784c7344b939bc36f639286f377 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:50.753369  8346 leader_election.cc:290] T 2c240553ce044eedb41541d72b9475d7 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:18:50.790357  8280 raft_consensus.cc:3055] T d33d5ee8ef6f415593d8df52063161ad P b7ab4784c7344b939bc36f639286f377 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:18:50.791225  8280 raft_consensus.cc:740] T d33d5ee8ef6f415593d8df52063161ad P b7ab4784c7344b939bc36f639286f377 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
I20260709 13:18:50.792850  8280 consensus_queue.cc:260] T d33d5ee8ef6f415593d8df52063161ad P b7ab4784c7344b939bc36f639286f377 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:50.794435  8280 raft_consensus.cc:3060] T d33d5ee8ef6f415593d8df52063161ad P b7ab4784c7344b939bc36f639286f377 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:50.802758  7503 raft_consensus.cc:1240] T bb7fa124c3bf4ef9ab65a407cb008441 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 4 LEADER]: Rejecting Update request from peer cd75a17ab2604397adab03bb8b5fd75c for earlier term 3. Current term is 4. Ops: []
I20260709 13:18:50.799947  8293 consensus_queue.cc:1048] T 4d9def8b32fd443aa94ab1420b06837b P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.006s
I20260709 13:18:50.805012  8289 raft_consensus.cc:2749] T 2c240553ce044eedb41541d72b9475d7 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:18:50.801671  8394 raft_consensus.cc:493] T f3f9c2e2bf644115957398fe4c9459db P b7ab4784c7344b939bc36f639286f377 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:50.809068  8394 raft_consensus.cc:515] T f3f9c2e2bf644115957398fe4c9459db P b7ab4784c7344b939bc36f639286f377 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:50.812183  8249 consensus_queue.cc:1059] T bb7fa124c3bf4ef9ab65a407cb008441 P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:18:50.813104  8249 consensus_queue.cc:1243] T bb7fa124c3bf4ef9ab65a407cb008441 P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Peer 7ba59cc884714e8aa5f3f0ecaed84cbb log is divergent from this leader: its last log entry 4.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 13:18:50.813752  8249 raft_consensus.cc:3055] T bb7fa124c3bf4ef9ab65a407cb008441 P cd75a17ab2604397adab03bb8b5fd75c [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:18:50.814112  8249 raft_consensus.cc:740] T bb7fa124c3bf4ef9ab65a407cb008441 P cd75a17ab2604397adab03bb8b5fd75c [term 3 LEADER]: Becoming Follower/Learner. State: Replica: cd75a17ab2604397adab03bb8b5fd75c, State: Running, Role: LEADER
I20260709 13:18:50.815208  8249 consensus_queue.cc:260] T bb7fa124c3bf4ef9ab65a407cb008441 P cd75a17ab2604397adab03bb8b5fd75c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:18:50.829816  8249 raft_consensus.cc:3060] T bb7fa124c3bf4ef9ab65a407cb008441 P cd75a17ab2604397adab03bb8b5fd75c [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:50.840026  8394 leader_election.cc:290] T f3f9c2e2bf644115957398fe4c9459db P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:18:50.852926  6801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20f6842e26174571996b8dea4151d4be" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:18:50.854213  6801 raft_consensus.cc:2410] T 20f6842e26174571996b8dea4151d4be P b7ab4784c7344b939bc36f639286f377 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c for term 4 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:18:50.857420  8308 raft_consensus.cc:2749] T 9e326172347f45e99a0d482b5d8ef768 P cd75a17ab2604397adab03bb8b5fd75c [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:18:50.857713  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 438705us
I20260709 13:18:50.874635  8394 consensus_queue.cc:1048] T 7a734b5ab7834e05a8c422208acc58b1 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.020s
I20260709 13:18:50.859571  6844 leader_election.cc:304] T 1bf4668eeb70467fb3dc5a0289233b3c P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:18:50.896991  6844 leader_election.cc:304] T bb3d8792045a4583ae2e965b1350a5b4 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:18:50.902886  7503 raft_consensus.cc:1275] T d8cee0accdb8499c86d4414b72565a38 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 5 FOLLOWER]: Refusing update from remote peer b7ab4784c7344b939bc36f639286f377: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:18:50.903210  6628 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:53224 (request call id 155) took 10224 ms. Trace:
I20260709 13:18:50.914086  8115 raft_consensus.cc:2764] T 1bf4668eeb70467fb3dc5a0289233b3c P cd75a17ab2604397adab03bb8b5fd75c [term 4 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
I20260709 13:18:50.915069  8115 raft_consensus.cc:2749] T bb3d8792045a4583ae2e965b1350a5b4 P cd75a17ab2604397adab03bb8b5fd75c [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:18:50.916555  8308 raft_consensus.cc:2955] T 24ee15416e3145beaa1b8183453729a3 P cd75a17ab2604397adab03bb8b5fd75c [term 3 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } attrs { replace: true } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } } }
I20260709 13:18:50.925478  8094 consensus_queue.cc:260] T e77e330a82df4b43a745d57a68f6f057 P ccd8a4c3bfe3413cb2ae219b09aea832 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } }
I20260709 13:18:50.927584  6844 leader_election.cc:304] T ab432e62819d499eaaf3dd55481dd930 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:18:50.930214  6844 leader_election.cc:304] T d8292e16e5654be6bc408560cf256aaa P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:18:50.931147  6803 raft_consensus.cc:1275] T 7ba5dac66ab5497e9e336f2a3c28cda5 P b7ab4784c7344b939bc36f639286f377 [term 4 FOLLOWER]: Refusing update from remote peer 7ba59cc884714e8aa5f3f0ecaed84cbb: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:18:50.935525  8094 raft_consensus.cc:3060] T e77e330a82df4b43a745d57a68f6f057 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:18:50.937039  6804 consensus_meta.cc:287] T 711ef6523deb4cbe8ef2ba61e1c21c98 P b7ab4784c7344b939bc36f639286f377: Time spent flushing consensus metadata: real 0.505s	user 0.009s	sys 0.004s
W20260709 13:18:50.875087  8401 log.cc:927] Time spent T bb7fa124c3bf4ef9ab65a407cb008441 P cd75a17ab2604397adab03bb8b5fd75c: Append to log took a long time: real 0.380s	user 0.004s	sys 0.000s
I20260709 13:18:50.937815  6804 raft_consensus.cc:2468] T 711ef6523deb4cbe8ef2ba61e1c21c98 P b7ab4784c7344b939bc36f639286f377 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 4.
I20260709 13:18:50.931555  6772 leader_election.cc:304] T 404190ce4ce94cecbfcb6ea9d1dd8626 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, b7ab4784c7344b939bc36f639286f377; no voters: 
I20260709 13:18:50.938963  8405 raft_consensus.cc:2764] T f58dc08b12a2494bb9a1372837970ca2 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 4 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
W20260709 13:18:50.939144  6695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 309842us
W20260709 13:18:50.939579  6696 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:50.940294  6695 leader_election.cc:304] T 90d42e216d9741e190bca19a781291fd P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:18:50.941269  7993 raft_consensus.cc:2749] T 90d42e216d9741e190bca19a781291fd P ccd8a4c3bfe3413cb2ae219b09aea832 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:18:50.942039  6695 leader_election.cc:304] T 44bde925b2e541b69890d70715b85176 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:18:50.940150  8360 consensus_queue.cc:1048] T d8cee0accdb8499c86d4414b72565a38 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.003s
I20260709 13:18:50.877786  6801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b56bf91d90824c959e21e0cee5ba1816" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:18:50.883553  6728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c7f33e544204fbaac4078e3e83bbf4e" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:18:50.947033  6728 raft_consensus.cc:3060] T 8c7f33e544204fbaac4078e3e83bbf4e P ccd8a4c3bfe3413cb2ae219b09aea832 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:50.884296  6723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5be3a11b23d4ea9b08300a2789821c7" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:18:50.948585  8112 raft_consensus.cc:2764] T ab432e62819d499eaaf3dd55481dd930 P cd75a17ab2604397adab03bb8b5fd75c [term 4 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
I20260709 13:18:50.949412  6723 raft_consensus.cc:2393] T f5be3a11b23d4ea9b08300a2789821c7 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate b7ab4784c7344b939bc36f639286f377 in current term 4: Already voted for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in this term.
I20260709 13:18:50.884723  6727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbdf895bba214ff68685a24fd17dfb5d" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:18:50.951049  6723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7887766dc6784fcaa42b35c05fea7a99" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:18:50.884968  6732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4275cf08e63345f993bce8664eada830" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:18:50.952733  6732 raft_consensus.cc:2393] T 4275cf08e63345f993bce8664eada830 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate b7ab4784c7344b939bc36f639286f377 in current term 3: Already voted for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in this term.
I20260709 13:18:50.954160  6732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "711ef6523deb4cbe8ef2ba61e1c21c98" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:18:50.878780  6805 raft_consensus.cc:1275] T 44bde925b2e541b69890d70715b85176 P b7ab4784c7344b939bc36f639286f377 [term 4 FOLLOWER]: Refusing update from remote peer cd75a17ab2604397adab03bb8b5fd75c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:18:50.954977  6732 raft_consensus.cc:2368] T 711ef6523deb4cbe8ef2ba61e1c21c98 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate b7ab4784c7344b939bc36f639286f377 for earlier term 3. Current term is 4.
I20260709 13:18:50.886724  6724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d65025eea89441290d85dd053810e31" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:18:50.885599  6729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "713b5728a197487c9300b310ab94e5a3" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:18:50.957680  6724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce4f062dcd314d43a63ca74067cb5ee3" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:18:50.958215  6729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f58dc08b12a2494bb9a1372837970ca2" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:18:50.958750  6724 raft_consensus.cc:2393] T ce4f062dcd314d43a63ca74067cb5ee3 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7ab4784c7344b939bc36f639286f377 in current term 5: Already voted for candidate cd75a17ab2604397adab03bb8b5fd75c in this term.
I20260709 13:18:50.959227  6729 raft_consensus.cc:2468] T f58dc08b12a2494bb9a1372837970ca2 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 4.
I20260709 13:18:50.887077  6730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "404190ce4ce94cecbfcb6ea9d1dd8626" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:18:50.893568  6726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "713b5728a197487c9300b310ab94e5a3" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:18:50.961303  6730 raft_consensus.cc:3060] T 404190ce4ce94cecbfcb6ea9d1dd8626 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:50.951261  6727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4b8bd455d5a47c18a1380839c6e0d61" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:18:50.965036  6723 raft_consensus.cc:2393] T 7887766dc6784fcaa42b35c05fea7a99 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate b7ab4784c7344b939bc36f639286f377 in current term 3: Already voted for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in this term.
I20260709 13:18:50.893589  8364 leader_election.cc:290] T f3f9c2e2bf644115957398fe4c9459db P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:18:50.937073  8389 consensus_queue.cc:1048] T 7ba5dac66ab5497e9e336f2a3c28cda5 P 7ba59cc884714e8aa5f3f0ecaed84cbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.046s
I20260709 13:18:50.939602  8394 raft_consensus.cc:2804] T 404190ce4ce94cecbfcb6ea9d1dd8626 P b7ab4784c7344b939bc36f639286f377 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:18:50.987162  8394 raft_consensus.cc:697] T 404190ce4ce94cecbfcb6ea9d1dd8626 P b7ab4784c7344b939bc36f639286f377 [term 4 LEADER]: Becoming Leader. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
I20260709 13:18:50.989147  8394 consensus_queue.cc:237] T 404190ce4ce94cecbfcb6ea9d1dd8626 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
W20260709 13:18:50.887522  6847 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:50.903574  6628 rpcz_store.cc:276] 0709 13:18:40.678271 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:40.678810 (+   539us) service_pool.cc:224] Handling call
0709 13:18:50.902983 (+10224173us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:18:49.210624 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:18:49.228323 (+ 17699us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:18:49.228395 (+    72us) write_op.cc:435] Acquired schema lock
0709 13:18:49.228443 (+    48us) tablet.cc:662] Decoding operations
0709 13:18:49.289562 (+ 61119us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:18:49.289697 (+   135us) write_op.cc:641] Partition lock acquired for write op
0709 13:18:49.289761 (+    64us) tablet.cc:685] Acquiring locks for 2 operations
0709 13:18:49.290360 (+   599us) tablet.cc:701] Row locks acquired
0709 13:18:49.290439 (+    79us) write_op.cc:260] PREPARE: finished
0709 13:18:49.290700 (+   261us) write_op.cc:270] Start()
0709 13:18:49.290902 (+   202us) write_op.cc:276] Timestamp: P: 1783603129290635 usec, L: 0
0709 13:18:49.290966 (+    64us) op_driver.cc:348] REPLICATION: starting
0709 13:18:49.502446 (+211480us) log.cc:844] Serialized 922 byte log entry
0709 13:18:50.527761 (+1025315us) spinlock_profiling.cc:243] Waited 2.27 ms on lock 0x7b4400022b4c. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0c745db1 00007fcc0c7e3c85 00007fcc0c7e46a2 00007fcc0f5561db 00007fcc0f551aaf 00007fcc0f54586e 00007fcc0f544bb6 00007fcc0f5447d8 00007fcc0f54e221 00007fcc0f54e1d9 00007fcc0f54e169
0709 13:18:50.560531 (+ 32770us) op_driver.cc:464] REPLICATION: finished
0709 13:18:50.562675 (+  2144us) write_op.cc:301] APPLY: starting
0709 13:18:50.562781 (+   106us) tablet.cc:1367] starting BulkCheckPresence
0709 13:18:50.562952 (+   171us) tablet.cc:1370] finished BulkCheckPresence
0709 13:18:50.562989 (+    37us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:18:50.563732 (+   743us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:18:50.564123 (+   391us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0709 13:18:50.564188 (+    65us) write_op.cc:312] APPLY: finished
0709 13:18:50.578106 (+ 13918us) log.cc:844] Serialized 28 byte log entry
0709 13:18:50.581671 (+  3565us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:18:50.583525 (+  1854us) write_op.cc:454] Released schema lock
0709 13:18:50.583611 (+    86us) write_op.cc:341] FINISH: Updating metrics
0709 13:18:50.584167 (+   556us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:18:50.584204 (+    37us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":2932652,"reported_tablets":7,"child_traces":[["op",{"apply.queue_time_us":1894,"apply.run_cpu_time_us":2700,"apply.run_wall_time_us":21406,"num_ops":2,"prepare.queue_time_us":293312,"prepare.run_cpu_time_us":63911,"prepare.run_wall_time_us":557899,"raft.queue_time_us":21966,"raft.run_cpu_time_us":1706,"raft.run_wall_time_us":2194,"replication_time_us":1269354,"spinlock_wait_cycles":5338112,"thread_start_us":393520,"threads_started":4,"wal-append.queue_time_us":422500}]]}
I20260709 13:18:51.030038  6876 raft_consensus.cc:1275] T dbdf895bba214ff68685a24fd17dfb5d P cd75a17ab2604397adab03bb8b5fd75c [term 4 FOLLOWER]: Refusing update from remote peer b7ab4784c7344b939bc36f639286f377: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 2. (index mismatch)
I20260709 13:18:51.030423  8112 raft_consensus.cc:493] T e31b9971c15848dea59d4d4130141d9e P cd75a17ab2604397adab03bb8b5fd75c [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:18:51.030463  6877 raft_consensus.cc:1275] T 4275cf08e63345f993bce8664eada830 P cd75a17ab2604397adab03bb8b5fd75c [term 3 FOLLOWER]: Refusing update from remote peer b7ab4784c7344b939bc36f639286f377: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
W20260709 13:18:50.998855  6697 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 363449us
I20260709 13:18:50.998422  6732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d9def8b32fd443aa94ab1420b06837b" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:18:51.004765  8257 raft_consensus.cc:3055] T 3fa34c08b205435dba97346991aa1f92 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:18:51.034261  8257 raft_consensus.cc:740] T 3fa34c08b205435dba97346991aa1f92 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
I20260709 13:18:51.034718  8112 raft_consensus.cc:515] T e31b9971c15848dea59d4d4130141d9e P cd75a17ab2604397adab03bb8b5fd75c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:51.038826  8257 consensus_queue.cc:260] T 3fa34c08b205435dba97346991aa1f92 P ccd8a4c3bfe3413cb2ae219b09aea832 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:18:51.038158  6732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fa34c08b205435dba97346991aa1f92" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:18:51.043574  7496 raft_consensus.cc:1240] T 1528ab62b6fe4e3099d08f141afee116 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 4 FOLLOWER]: Rejecting Update request from peer cd75a17ab2604397adab03bb8b5fd75c for earlier term 3. Current term is 4. Ops: []
I20260709 13:18:50.997407  6726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1528ab62b6fe4e3099d08f141afee116" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
W20260709 13:18:51.019411  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 89252.9us
I20260709 13:18:51.020484  8115 raft_consensus.cc:2804] T d8292e16e5654be6bc408560cf256aaa P cd75a17ab2604397adab03bb8b5fd75c [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:18:51.053491  6724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bf4668eeb70467fb3dc5a0289233b3c" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
W20260709 13:18:51.057838  6845 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:51.068249  6724 raft_consensus.cc:3060] T 1bf4668eeb70467fb3dc5a0289233b3c P ccd8a4c3bfe3413cb2ae219b09aea832 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:51.100957  6728 raft_consensus.cc:2468] T 8c7f33e544204fbaac4078e3e83bbf4e P ccd8a4c3bfe3413cb2ae219b09aea832 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 3.
I20260709 13:18:51.121910  6731 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49998 (request call id 501) took 1636 ms. Trace:
I20260709 13:18:51.127029  6730 raft_consensus.cc:2468] T 404190ce4ce94cecbfcb6ea9d1dd8626 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 4.
I20260709 13:18:51.128059  6728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20f6842e26174571996b8dea4151d4be" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:18:51.124747  6880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1528ab62b6fe4e3099d08f141afee116" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:18:51.059196  8364 raft_consensus.cc:493] T ce4f062dcd314d43a63ca74067cb5ee3 P cd75a17ab2604397adab03bb8b5fd75c [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:51.132093  6874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f58dc08b12a2494bb9a1372837970ca2" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:18:51.055868  8115 raft_consensus.cc:697] T d8292e16e5654be6bc408560cf256aaa P cd75a17ab2604397adab03bb8b5fd75c [term 4 LEADER]: Becoming Leader. State: Replica: cd75a17ab2604397adab03bb8b5fd75c, State: Running, Role: LEADER
I20260709 13:18:51.150552  6770 leader_election.cc:304] T f5be3a11b23d4ea9b08300a2789821c7 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:18:51.108332  8249 consensus_queue.cc:1059] T 1528ab62b6fe4e3099d08f141afee116 P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.4, Next index: 5, Last known committed idx: 2, Time since last communication: 0.027s
I20260709 13:18:50.874807  8280 consensus_queue.cc:1059] T b56bf91d90824c959e21e0cee5ba1816 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.263s
I20260709 13:18:51.147672  6877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d9def8b32fd443aa94ab1420b06837b" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
W20260709 13:18:51.156714  6846 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.68:45071, user_credentials={real_user=slave}} blocked reactor thread for 110404us
I20260709 13:18:51.160334  6876 raft_consensus.cc:1275] T 853ac0a8cbd64ce99457f170216d4d0f P cd75a17ab2604397adab03bb8b5fd75c [term 2 FOLLOWER]: Refusing update from remote peer b7ab4784c7344b939bc36f639286f377: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 13:18:51.168181  6846 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:51.170639  8289 raft_consensus.cc:3055] T 853ac0a8cbd64ce99457f170216d4d0f P ccd8a4c3bfe3413cb2ae219b09aea832 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:18:51.171480  8289 raft_consensus.cc:740] T 853ac0a8cbd64ce99457f170216d4d0f P ccd8a4c3bfe3413cb2ae219b09aea832 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
W20260709 13:18:51.171808  6695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 229994us
I20260709 13:18:51.174014  6724 raft_consensus.cc:2468] T 1bf4668eeb70467fb3dc5a0289233b3c P ccd8a4c3bfe3413cb2ae219b09aea832 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 4.
I20260709 13:18:51.182081  6874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3411566abe2d4c9bb4b2adfdd05e6f17" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:18:51.184650  6874 raft_consensus.cc:2393] T 3411566abe2d4c9bb4b2adfdd05e6f17 P cd75a17ab2604397adab03bb8b5fd75c [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate b7ab4784c7344b939bc36f639286f377 in current term 2: Already voted for candidate cd75a17ab2604397adab03bb8b5fd75c in this term.
I20260709 13:18:51.183465  6877 raft_consensus.cc:2468] T 4d9def8b32fd443aa94ab1420b06837b P cd75a17ab2604397adab03bb8b5fd75c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 3.
I20260709 13:18:51.193637  6723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24ee15416e3145beaa1b8183453729a3" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:18:51.194979  6723 raft_consensus.cc:3060] T 24ee15416e3145beaa1b8183453729a3 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:51.196789  6730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f9c2e2bf644115957398fe4c9459db" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:18:51.198499  6729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3411566abe2d4c9bb4b2adfdd05e6f17" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
W20260709 13:18:51.202525  6697 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 168246us
I20260709 13:18:51.213586  6728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c240553ce044eedb41541d72b9475d7" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:18:51.123080  6731 rpcz_store.cc:276] 0709 13:18:49.486423 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:49.504934 (+ 18511us) service_pool.cc:224] Handling call
0709 13:18:49.563607 (+ 58673us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:50.940638 (+1377031us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:50.940675 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:50.941259 (+   584us) log.cc:844] Serialized 26 byte log entry
0709 13:18:51.116016 (+174757us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:18:51.116181 (+   165us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:51.116336 (+   155us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:51.119479 (+  3143us) raft_consensus.cc:1685] finished
0709 13:18:51.119529 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:51.119940 (+   411us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":171013,"raft.queue_time_us":1328992,"raft.run_cpu_time_us":151,"raft.run_wall_time_us":151,"thread_start_us":173886,"threads_started":1,"wal-append.queue_time_us":174073}
I20260709 13:18:51.217401  6880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4b8bd455d5a47c18a1380839c6e0d61" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:18:51.221165  6724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1704639a875409b9959353527b3fd68" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:18:51.222355  6724 raft_consensus.cc:2393] T a1704639a875409b9959353527b3fd68 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate b7ab4784c7344b939bc36f639286f377 in current term 4: Already voted for candidate cd75a17ab2604397adab03bb8b5fd75c in this term.
I20260709 13:18:51.161505  6873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8cee0accdb8499c86d4414b72565a38" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:18:51.173518  8112 leader_election.cc:290] T e31b9971c15848dea59d4d4130141d9e P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:18:51.232908  6880 raft_consensus.cc:2393] T f4b8bd455d5a47c18a1380839c6e0d61 P cd75a17ab2604397adab03bb8b5fd75c [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate b7ab4784c7344b939bc36f639286f377 in current term 2: Already voted for candidate cd75a17ab2604397adab03bb8b5fd75c in this term.
W20260709 13:18:51.232802  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 186422us
I20260709 13:18:51.233916  6730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab432e62819d499eaaf3dd55481dd930" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:18:51.229744  7466 leader_election.cc:304] T 1528ab62b6fe4e3099d08f141afee116 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:18:51.242828  6730 raft_consensus.cc:3060] T ab432e62819d499eaaf3dd55481dd930 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:51.235399  6876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce4f062dcd314d43a63ca74067cb5ee3" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:18:51.186489  8306 raft_consensus.cc:2764] T 44bde925b2e541b69890d70715b85176 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 4 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
I20260709 13:18:51.192391  8347 raft_consensus.cc:2749] T f5be3a11b23d4ea9b08300a2789821c7 P b7ab4784c7344b939bc36f639286f377 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:18:51.245638  6770 leader_election.cc:400] T 711ef6523deb4cbe8ef2ba61e1c21c98 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 3 election: Vote denied by peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391) with higher term. Message: Invalid argument: T 711ef6523deb4cbe8ef2ba61e1c21c98 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate b7ab4784c7344b939bc36f639286f377 for earlier term 3. Current term is 4.
I20260709 13:18:51.238236  6874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1704639a875409b9959353527b3fd68" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:18:51.252526  6874 raft_consensus.cc:2393] T a1704639a875409b9959353527b3fd68 P cd75a17ab2604397adab03bb8b5fd75c [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate b7ab4784c7344b939bc36f639286f377 in current term 4: Already voted for candidate cd75a17ab2604397adab03bb8b5fd75c in this term.
I20260709 13:18:51.253356  6770 leader_election.cc:304] T 3d65025eea89441290d85dd053810e31 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:18:51.259302  6731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "427c124d773f483294511e80fe340075" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 4 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:18:51.261284  6877 raft_consensus.cc:1275] T 8c7f33e544204fbaac4078e3e83bbf4e P cd75a17ab2604397adab03bb8b5fd75c [term 3 FOLLOWER]: Refusing update from remote peer b7ab4784c7344b939bc36f639286f377: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:18:51.155045  8364 raft_consensus.cc:515] T ce4f062dcd314d43a63ca74067cb5ee3 P cd75a17ab2604397adab03bb8b5fd75c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } attrs { replace: true } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:18:51.254460  8331 raft_consensus.cc:2749] T 1528ab62b6fe4e3099d08f141afee116 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:18:51.250129  6873 raft_consensus.cc:3060] T d8cee0accdb8499c86d4414b72565a38 P cd75a17ab2604397adab03bb8b5fd75c [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:51.266052  6880 raft_consensus.cc:1275] T 1bf4668eeb70467fb3dc5a0289233b3c P cd75a17ab2604397adab03bb8b5fd75c [term 4 FOLLOWER]: Refusing update from remote peer b7ab4784c7344b939bc36f639286f377: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:18:51.268124  6723 raft_consensus.cc:2468] T 24ee15416e3145beaa1b8183453729a3 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in term 4.
I20260709 13:18:51.269207  6728 raft_consensus.cc:2468] T 2c240553ce044eedb41541d72b9475d7 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 4.
I20260709 13:18:51.272830  6731 raft_consensus.cc:2410] T 427c124d773f483294511e80fe340075 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7ab4784c7344b939bc36f639286f377 for term 4 because replica has last-logged OpId of term: 1 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 2.
I20260709 13:18:51.285429  6730 raft_consensus.cc:2468] T ab432e62819d499eaaf3dd55481dd930 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 4.
I20260709 13:18:51.252174  8315 raft_consensus.cc:493] T 17587d6730594da4a56fa13a353232a1 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:51.303298  6876 raft_consensus.cc:2393] T ce4f062dcd314d43a63ca74067cb5ee3 P cd75a17ab2604397adab03bb8b5fd75c [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7ab4784c7344b939bc36f639286f377 in current term 5: Already voted for candidate cd75a17ab2604397adab03bb8b5fd75c in this term.
I20260709 13:18:51.292002  7466 leader_election.cc:304] T 24ee15416e3145beaa1b8183453729a3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
W20260709 13:18:51.300251  6771 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:51.157672  8115 consensus_queue.cc:237] T d8292e16e5654be6bc408560cf256aaa P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:51.308449  6730 raft_consensus.cc:1240] T 7c44c4849aa54f2b94d1f1bef9ed546f P ccd8a4c3bfe3413cb2ae219b09aea832 [term 4 FOLLOWER]: Rejecting Update request from peer b7ab4784c7344b939bc36f639286f377 for earlier term 3. Current term is 4. Ops: [3.3-3.3]
I20260709 13:18:51.262585  6626 catalog_manager.cc:5697] T 4f00a2e87e56452083b759f60d461ee3 P 7ba59cc884714e8aa5f3f0ecaed84cbb reported cstate change: term changed from 3 to 4, leader changed from cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67) to 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68). New cstate: current_term: 4 leader_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:18:51.310846  6728 raft_consensus.cc:1240] T b56bf91d90824c959e21e0cee5ba1816 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 4 FOLLOWER]: Rejecting Update request from peer b7ab4784c7344b939bc36f639286f377 for earlier term 3. Current term is 4. Ops: []
I20260709 13:18:51.311900  6877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "427c124d773f483294511e80fe340075" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 4 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:18:51.320633  5625 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:18:51.302297  8074 raft_consensus.cc:2749] T 3d65025eea89441290d85dd053810e31 P b7ab4784c7344b939bc36f639286f377 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:18:51.324333  6730 raft_consensus.cc:1240] T 7c37d41cd9164c15a6826ca62a851a69 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 3 FOLLOWER]: Rejecting Update request from peer b7ab4784c7344b939bc36f639286f377 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 13:18:51.325498  6877 raft_consensus.cc:2410] T 427c124d773f483294511e80fe340075 P cd75a17ab2604397adab03bb8b5fd75c [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7ab4784c7344b939bc36f639286f377 for term 4 because replica has last-logged OpId of term: 1 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 2.
I20260709 13:18:51.252966  8293 consensus_queue.cc:1059] T 7a734b5ab7834e05a8c422208acc58b1 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.054s
I20260709 13:18:51.324365  8382 raft_consensus.cc:2804] T 24ee15416e3145beaa1b8183453729a3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 4 FOLLOWER]: Leader election won for term 4
W20260709 13:18:51.328383  6770 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 50032.4us
I20260709 13:18:51.329015  8382 raft_consensus.cc:697] T 24ee15416e3145beaa1b8183453729a3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 4 LEADER]: Becoming Leader. State: Replica: 7ba59cc884714e8aa5f3f0ecaed84cbb, State: Running, Role: LEADER
I20260709 13:18:51.329720  6770 leader_election.cc:304] T 713b5728a197487c9300b310ab94e5a3 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:18:51.330287  8382 consensus_queue.cc:237] T 24ee15416e3145beaa1b8183453729a3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.4, Last appended by leader: 4, Current term: 4, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } attrs { replace: true } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:18:51.331159  6770 leader_election.cc:304] T 7887766dc6784fcaa42b35c05fea7a99 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
W20260709 13:18:51.335270  6695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 161782us
I20260709 13:18:51.339198  6770 leader_election.cc:304] T f58dc08b12a2494bb9a1372837970ca2 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
I20260709 13:18:51.352552  8422 consensus_queue.cc:1059] T 7887766dc6784fcaa42b35c05fea7a99 P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:18:51.349200  6626 catalog_manager.cc:5697] T 7ba5dac66ab5497e9e336f2a3c28cda5 P 7ba59cc884714e8aa5f3f0ecaed84cbb reported cstate change: term changed from 1 to 4, leader changed from cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67) to 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68). New cstate: current_term: 4 leader_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:18:51.366902  8429 raft_consensus.cc:493] T 4275cf08e63345f993bce8664eada830 P cd75a17ab2604397adab03bb8b5fd75c [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:51.367856  8423 raft_consensus.cc:493] T c4db81d9d329422bb3b4160ca4ac2d1d P cd75a17ab2604397adab03bb8b5fd75c [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:51.368706  8423 raft_consensus.cc:515] T c4db81d9d329422bb3b4160ca4ac2d1d P cd75a17ab2604397adab03bb8b5fd75c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:51.371560  8423 leader_election.cc:290] T c4db81d9d329422bb3b4160ca4ac2d1d P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
W20260709 13:18:51.372315  6696 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:51.358124  6880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20f6842e26174571996b8dea4151d4be" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:18:51.379050  6880 raft_consensus.cc:2468] T 20f6842e26174571996b8dea4151d4be P cd75a17ab2604397adab03bb8b5fd75c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 3.
W20260709 13:18:51.312095  7468 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.5.126.67:42931 timed out after 1.989s (SENT) [suppressed 22 similar messages]
I20260709 13:18:51.379842  6695 leader_election.cc:304] T 427c124d773f483294511e80fe340075 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:18:51.382458  6626 catalog_manager.cc:5697] T b3f13b31a1f84f0d89d007eadd57924c P 7ba59cc884714e8aa5f3f0ecaed84cbb reported cstate change: term changed from 1 to 2, leader changed from ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65) to 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68). New cstate: current_term: 2 leader_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:18:51.290920  8419 consensus_queue.cc:1059] T f5be3a11b23d4ea9b08300a2789821c7 P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.076s
I20260709 13:18:51.324824  6727 raft_consensus.cc:2468] T f4b8bd455d5a47c18a1380839c6e0d61 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 2.
I20260709 13:18:51.389050  6877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c240553ce044eedb41541d72b9475d7" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:18:51.393653  6697 leader_election.cc:304] T c4db81d9d329422bb3b4160ca4ac2d1d P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:18:51.393953  6729 raft_consensus.cc:2468] T 3411566abe2d4c9bb4b2adfdd05e6f17 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 2.
I20260709 13:18:51.384766  6626 catalog_manager.cc:5697] T ce4f062dcd314d43a63ca74067cb5ee3 P 7ba59cc884714e8aa5f3f0ecaed84cbb reported cstate change: config changed from index 2 to 3, term changed from 1 to 4, leader changed from b7ab4784c7344b939bc36f639286f377 (127.5.126.66) to <none>, 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68) changed from NON_VOTER to VOTER. New cstate: current_term: 4 committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } attrs { replace: true } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } } }
I20260709 13:18:51.367647  8429 raft_consensus.cc:515] T 4275cf08e63345f993bce8664eada830 P cd75a17ab2604397adab03bb8b5fd75c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:51.348129  8245 raft_consensus.cc:2749] T 7887766dc6784fcaa42b35c05fea7a99 P b7ab4784c7344b939bc36f639286f377 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:18:51.302636  8315 raft_consensus.cc:515] T 17587d6730594da4a56fa13a353232a1 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:18:51.305927  8352 consensus_queue.cc:1059] T dbdf895bba214ff68685a24fd17dfb5d P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.078s
I20260709 13:18:51.358657  8280 raft_consensus.cc:2804] T f58dc08b12a2494bb9a1372837970ca2 P b7ab4784c7344b939bc36f639286f377 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:18:51.398187  6877 raft_consensus.cc:2468] T 2c240553ce044eedb41541d72b9475d7 P cd75a17ab2604397adab03bb8b5fd75c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 4.
I20260709 13:18:51.360723  8394 raft_consensus.cc:2749] T 713b5728a197487c9300b310ab94e5a3 P b7ab4784c7344b939bc36f639286f377 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:18:51.290310  8289 consensus_queue.cc:260] T 853ac0a8cbd64ce99457f170216d4d0f P ccd8a4c3bfe3413cb2ae219b09aea832 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:51.401885  8293 raft_consensus.cc:2804] T 427c124d773f483294511e80fe340075 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:18:51.425201  6728 raft_consensus.cc:1240] T d33d5ee8ef6f415593d8df52063161ad P ccd8a4c3bfe3413cb2ae219b09aea832 [term 4 LEADER]: Rejecting Update request from peer b7ab4784c7344b939bc36f639286f377 for earlier term 3. Current term is 4. Ops: []
I20260709 13:18:51.429783  6880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f9c2e2bf644115957398fe4c9459db" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
W20260709 13:18:51.415189  8417 log.cc:927] Time spent T 9e326172347f45e99a0d482b5d8ef768 P ccd8a4c3bfe3413cb2ae219b09aea832: Append to log took a long time: real 0.079s	user 0.001s	sys 0.000s
I20260709 13:18:51.430599  6880 raft_consensus.cc:2468] T f3f9c2e2bf644115957398fe4c9459db P cd75a17ab2604397adab03bb8b5fd75c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 3.
W20260709 13:18:51.435058  6696 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:51.433238  6770 leader_election.cc:304] T 2c240553ce044eedb41541d72b9475d7 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
I20260709 13:18:51.411743  8280 raft_consensus.cc:493] T f58dc08b12a2494bb9a1372837970ca2 P b7ab4784c7344b939bc36f639286f377 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:18:51.444427  6695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 108016us
I20260709 13:18:51.423266  7993 raft_consensus.cc:2804] T c4db81d9d329422bb3b4160ca4ac2d1d P ccd8a4c3bfe3413cb2ae219b09aea832 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:18:51.423638  6873 raft_consensus.cc:2468] T d8cee0accdb8499c86d4414b72565a38 P cd75a17ab2604397adab03bb8b5fd75c [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 5.
I20260709 13:18:51.458714  6877 raft_consensus.cc:1275] T d8cee0accdb8499c86d4414b72565a38 P cd75a17ab2604397adab03bb8b5fd75c [term 5 FOLLOWER]: Refusing update from remote peer b7ab4784c7344b939bc36f639286f377: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:18:51.442898  8419 raft_consensus.cc:3055] T f5be3a11b23d4ea9b08300a2789821c7 P cd75a17ab2604397adab03bb8b5fd75c [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:18:51.442137  8249 raft_consensus.cc:493] T 853ac0a8cbd64ce99457f170216d4d0f P cd75a17ab2604397adab03bb8b5fd75c [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:51.445111  8280 raft_consensus.cc:3060] T f58dc08b12a2494bb9a1372837970ca2 P b7ab4784c7344b939bc36f639286f377 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:51.465871  6725 raft_consensus.cc:1240] T be1a92657f494cac8dd227d152f50151 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 4 FOLLOWER]: Rejecting Update request from peer 7ba59cc884714e8aa5f3f0ecaed84cbb for earlier term 3. Current term is 4. Ops: []
I20260709 13:18:51.523010  6878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b3759de40694069b13c0f8bd40e5709" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:18:51.488081  8429 leader_election.cc:290] T 4275cf08e63345f993bce8664eada830 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:18:51.462154  8293 raft_consensus.cc:697] T 427c124d773f483294511e80fe340075 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 3 LEADER]: Becoming Leader. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
I20260709 13:18:51.466032  8360 raft_consensus.cc:3055] T b56bf91d90824c959e21e0cee5ba1816 P b7ab4784c7344b939bc36f639286f377 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:18:51.464723  8419 raft_consensus.cc:740] T f5be3a11b23d4ea9b08300a2789821c7 P cd75a17ab2604397adab03bb8b5fd75c [term 3 LEADER]: Becoming Follower/Learner. State: Replica: cd75a17ab2604397adab03bb8b5fd75c, State: Running, Role: LEADER
I20260709 13:18:51.486639  8364 leader_election.cc:290] T ce4f062dcd314d43a63ca74067cb5ee3 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:18:51.449177  7993 raft_consensus.cc:493] T c4db81d9d329422bb3b4160ca4ac2d1d P ccd8a4c3bfe3413cb2ae219b09aea832 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:51.579995  6726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1528ab62b6fe4e3099d08f141afee116" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:18:51.496026  6875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c37d41cd9164c15a6826ca62a851a69" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:18:51.495015  7503 raft_consensus.cc:1240] T 3fa34c08b205435dba97346991aa1f92 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 4 FOLLOWER]: Rejecting Update request from peer ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 3. Current term is 4. Ops: [3.5-3.5]
I20260709 13:18:51.491892  8346 raft_consensus.cc:2804] T 2c240553ce044eedb41541d72b9475d7 P b7ab4784c7344b939bc36f639286f377 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:18:51.490978  8245 consensus_queue.cc:1048] T dbdf895bba214ff68685a24fd17dfb5d P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 13:18:51.491750  6770 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 58700.4us
I20260709 13:18:51.495790  6879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4b8bd455d5a47c18a1380839c6e0d61" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:18:51.602128  6770 leader_election.cc:304] T ab432e62819d499eaaf3dd55481dd930 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:18:51.602492  6879 raft_consensus.cc:2468] T f4b8bd455d5a47c18a1380839c6e0d61 P cd75a17ab2604397adab03bb8b5fd75c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 2.
W20260709 13:18:51.490319  6772 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 69599us
W20260709 13:18:51.485924  8094 consensus_meta.cc:287] T e77e330a82df4b43a745d57a68f6f057 P ccd8a4c3bfe3413cb2ae219b09aea832: Time spent flushing consensus metadata: real 0.550s	user 0.019s	sys 0.000s
W20260709 13:18:51.582413  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 335666us
I20260709 13:18:51.579217  6872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b56bf91d90824c959e21e0cee5ba1816" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:18:51.606123  6875 raft_consensus.cc:2393] T 7c37d41cd9164c15a6826ca62a851a69 P cd75a17ab2604397adab03bb8b5fd75c [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ccd8a4c3bfe3413cb2ae219b09aea832 in current term 3: Already voted for candidate cd75a17ab2604397adab03bb8b5fd75c in this term.
W20260709 13:18:51.580372  6695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 114904us
W20260709 13:18:51.581072  6697 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:51.587373  6878 raft_consensus.cc:2468] T 9b3759de40694069b13c0f8bd40e5709 P cd75a17ab2604397adab03bb8b5fd75c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 3.
I20260709 13:18:51.591152  6880 raft_consensus.cc:1275] T a3022224cc81473690653a83d4e99470 P cd75a17ab2604397adab03bb8b5fd75c [term 4 FOLLOWER]: Refusing update from remote peer ccd8a4c3bfe3413cb2ae219b09aea832: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
W20260709 13:18:51.608201  6697 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:51.522140  7468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 215639us
I20260709 13:18:51.593214  7496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be1a92657f494cac8dd227d152f50151" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb"
I20260709 13:18:51.588673  8249 raft_consensus.cc:515] T 853ac0a8cbd64ce99457f170216d4d0f P cd75a17ab2604397adab03bb8b5fd75c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:51.593746  8360 raft_consensus.cc:740] T b56bf91d90824c959e21e0cee5ba1816 P b7ab4784c7344b939bc36f639286f377 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
I20260709 13:18:51.612293  8360 consensus_queue.cc:260] T b56bf91d90824c959e21e0cee5ba1816 P b7ab4784c7344b939bc36f639286f377 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:51.613198  8249 leader_election.cc:290] T 853ac0a8cbd64ce99457f170216d4d0f P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:18:51.613860  8394 consensus_queue.cc:1059] T 7c44c4849aa54f2b94d1f1bef9ed546f P b7ab4784c7344b939bc36f639286f377 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:18:51.610778  6872 raft_consensus.cc:2393] T b56bf91d90824c959e21e0cee5ba1816 P cd75a17ab2604397adab03bb8b5fd75c [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ccd8a4c3bfe3413cb2ae219b09aea832 in current term 4: Already voted for candidate cd75a17ab2604397adab03bb8b5fd75c in this term.
W20260709 13:18:51.615746  6845 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:51.602074  7993 raft_consensus.cc:3060] T c4db81d9d329422bb3b4160ca4ac2d1d P ccd8a4c3bfe3413cb2ae219b09aea832 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:51.602764  8346 raft_consensus.cc:493] T 2c240553ce044eedb41541d72b9475d7 P b7ab4784c7344b939bc36f639286f377 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:51.621682  6697 leader_election.cc:304] T 427c124d773f483294511e80fe340075 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:18:51.630364  6844 leader_election.cc:304] T 8c7f33e544204fbaac4078e3e83bbf4e P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:18:51.648352  8346 raft_consensus.cc:3060] T 2c240553ce044eedb41541d72b9475d7 P b7ab4784c7344b939bc36f639286f377 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:18:51.669543  6770 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 65165.7us
I20260709 13:18:51.614873  8347 consensus_queue.cc:1059] T b56bf91d90824c959e21e0cee5ba1816 P b7ab4784c7344b939bc36f639286f377 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.043s
I20260709 13:18:51.628439  8352 consensus_queue.cc:1048] T e31b9971c15848dea59d4d4130141d9e P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.035s
W20260709 13:18:51.677634  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 70949.9us
W20260709 13:18:51.677590  6772 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 62171us
W20260709 13:18:51.690291  8432 log.cc:927] Time spent T bd6869f07b5a4885a0b99fbe60c3b175 P ccd8a4c3bfe3413cb2ae219b09aea832: Append to log took a long time: real 0.095s	user 0.001s	sys 0.000s
I20260709 13:18:51.663717  8430 raft_consensus.cc:2804] T ab432e62819d499eaaf3dd55481dd930 P b7ab4784c7344b939bc36f639286f377 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:18:51.689079  6772 leader_election.cc:304] T 1528ab62b6fe4e3099d08f141afee116 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:18:51.698122  6697 leader_election.cc:304] T f4b8bd455d5a47c18a1380839c6e0d61 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:18:51.701371  6697 leader_election.cc:304] T 9b3759de40694069b13c0f8bd40e5709 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:18:51.709642  6844 leader_election.cc:304] T f4b8bd455d5a47c18a1380839c6e0d61 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:18:51.660075  8074 consensus_queue.cc:1048] T 4275cf08e63345f993bce8664eada830 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.034s
I20260709 13:18:51.713184  8440 raft_consensus.cc:493] T a3022224cc81473690653a83d4e99470 P b7ab4784c7344b939bc36f639286f377 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:51.672222  8389 consensus_queue.cc:1059] T be1a92657f494cac8dd227d152f50151 P 7ba59cc884714e8aa5f3f0ecaed84cbb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.041s
I20260709 13:18:51.691166  8308 raft_consensus.cc:2764] T 8c7f33e544204fbaac4078e3e83bbf4e P cd75a17ab2604397adab03bb8b5fd75c [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
I20260709 13:18:51.716361  8444 raft_consensus.cc:2804] T 9b3759de40694069b13c0f8bd40e5709 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 13:18:51.673537  6753 debug-util.cc:398] Leaking SignalData structure 0x7b080009e040 after lost signal to thread 5628
W20260709 13:18:51.722038  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 43520.7us
I20260709 13:18:51.708592  8094 raft_consensus.cc:2804] T f4b8bd455d5a47c18a1380839c6e0d61 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:18:51.725445  6844 leader_election.cc:304] T 3fa34c08b205435dba97346991aa1f92 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:18:51.728260  6772 leader_election.cc:304] T 4d9def8b32fd443aa94ab1420b06837b P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:18:51.679522  8317 consensus_queue.cc:1048] T bb3d8792045a4583ae2e965b1350a5b4 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.041s
I20260709 13:18:51.720971  8443 raft_consensus.cc:2749] T 1528ab62b6fe4e3099d08f141afee116 P b7ab4784c7344b939bc36f639286f377 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:18:51.747130  6844 leader_election.cc:304] T a1704639a875409b9959353527b3fd68 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:18:51.751009  8364 raft_consensus.cc:2804] T a1704639a875409b9959353527b3fd68 P cd75a17ab2604397adab03bb8b5fd75c [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:18:51.750690  8405 consensus_queue.cc:1059] T dbdf895bba214ff68685a24fd17dfb5d P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:18:51.751645  8364 raft_consensus.cc:697] T a1704639a875409b9959353527b3fd68 P cd75a17ab2604397adab03bb8b5fd75c [term 4 LEADER]: Becoming Leader. State: Replica: cd75a17ab2604397adab03bb8b5fd75c, State: Running, Role: LEADER
I20260709 13:18:51.751564  6844 leader_election.cc:304] T 22ccee1b570c4ad3a57bd7aec085b1b4 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:18:51.753111  6844 leader_election.cc:304] T f09c2a98de1a4decabd0ff900dd44caa P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:18:51.724723  8444 raft_consensus.cc:493] T 9b3759de40694069b13c0f8bd40e5709 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:51.761958  6772 leader_election.cc:304] T a1704639a875409b9959353527b3fd68 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:18:51.726388  8249 raft_consensus.cc:2804] T f4b8bd455d5a47c18a1380839c6e0d61 P cd75a17ab2604397adab03bb8b5fd75c [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 13:18:51.779170  6697 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 77795.4us
I20260709 13:18:51.781313  8405 consensus_queue.cc:1048] T a3022224cc81473690653a83d4e99470 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:18:51.727425  8094 raft_consensus.cc:493] T f4b8bd455d5a47c18a1380839c6e0d61 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:51.787088  6844 leader_election.cc:304] T 7c37d41cd9164c15a6826ca62a851a69 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:18:51.733429  8257 raft_consensus.cc:3060] T 3fa34c08b205435dba97346991aa1f92 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:51.721465  8394 consensus_queue.cc:1048] T 853ac0a8cbd64ce99457f170216d4d0f P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.043s
I20260709 13:18:51.748101  8115 raft_consensus.cc:3060] T 3fa34c08b205435dba97346991aa1f92 P cd75a17ab2604397adab03bb8b5fd75c [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:18:51.785504  6753 debug-util.cc:398] Leaking SignalData structure 0x7b0800194860 after lost signal to thread 6664
W20260709 13:18:51.792642  6847 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:51.792294  6844 leader_election.cc:304] T 711ef6523deb4cbe8ef2ba61e1c21c98 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:18:51.766371  8429 raft_consensus.cc:2804] T 22ccee1b570c4ad3a57bd7aec085b1b4 P cd75a17ab2604397adab03bb8b5fd75c [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:18:51.771294  8444 raft_consensus.cc:3060] T 9b3759de40694069b13c0f8bd40e5709 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:51.790570  8094 raft_consensus.cc:3060] T f4b8bd455d5a47c18a1380839c6e0d61 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:51.771620  8249 raft_consensus.cc:493] T f4b8bd455d5a47c18a1380839c6e0d61 P cd75a17ab2604397adab03bb8b5fd75c [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:51.718052  8293 consensus_queue.cc:237] T 427c124d773f483294511e80fe340075 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.3, Last appended by leader: 3, Current term: 3, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } attrs { replace: true } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:18:51.702374  8419 consensus_queue.cc:260] T f5be3a11b23d4ea9b08300a2789821c7 P cd75a17ab2604397adab03bb8b5fd75c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
W20260709 13:18:51.793290  8418 log.cc:927] Time spent T 404190ce4ce94cecbfcb6ea9d1dd8626 P b7ab4784c7344b939bc36f639286f377: Append to log took a long time: real 0.250s	user 0.000s	sys 0.002s
I20260709 13:18:51.800185  8443 raft_consensus.cc:2804] T 4d9def8b32fd443aa94ab1420b06837b P b7ab4784c7344b939bc36f639286f377 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:18:51.820551  6805 raft_consensus.cc:1240] T 713b5728a197487c9300b310ab94e5a3 P b7ab4784c7344b939bc36f639286f377 [term 4 FOLLOWER]: Rejecting Update request from peer ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 3. Current term is 4. Ops: []
I20260709 13:18:51.796947  8425 raft_consensus.cc:2804] T 7c37d41cd9164c15a6826ca62a851a69 P cd75a17ab2604397adab03bb8b5fd75c [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:18:51.820003  6872 raft_consensus.cc:1275] T f3f9c2e2bf644115957398fe4c9459db P cd75a17ab2604397adab03bb8b5fd75c [term 3 FOLLOWER]: Refusing update from remote peer ccd8a4c3bfe3413cb2ae219b09aea832: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:18:51.736204  8440 raft_consensus.cc:515] T a3022224cc81473690653a83d4e99470 P b7ab4784c7344b939bc36f639286f377 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:51.806133  8429 raft_consensus.cc:493] T 22ccee1b570c4ad3a57bd7aec085b1b4 P cd75a17ab2604397adab03bb8b5fd75c [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:51.828239  6844 leader_election.cc:304] T b56bf91d90824c959e21e0cee5ba1816 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:18:51.813426  8249 raft_consensus.cc:3060] T f4b8bd455d5a47c18a1380839c6e0d61 P cd75a17ab2604397adab03bb8b5fd75c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:51.838325  6772 leader_election.cc:304] T 427c124d773f483294511e80fe340075 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:18:51.823175  8443 raft_consensus.cc:493] T 4d9def8b32fd443aa94ab1420b06837b P b7ab4784c7344b939bc36f639286f377 [term 3 FOLLOWER]: Starting leader election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:18:51.819813  8433 raft_consensus.cc:2804] T f09c2a98de1a4decabd0ff900dd44caa P cd75a17ab2604397adab03bb8b5fd75c [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:18:51.794039  8364 consensus_queue.cc:237] T a1704639a875409b9959353527b3fd68 P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:51.836519  8429 raft_consensus.cc:3060] T 22ccee1b570c4ad3a57bd7aec085b1b4 P cd75a17ab2604397adab03bb8b5fd75c [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:51.830338  8430 raft_consensus.cc:697] T ab432e62819d499eaaf3dd55481dd930 P b7ab4784c7344b939bc36f639286f377 [term 4 LEADER]: Becoming Leader. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
W20260709 13:18:51.847558  6753 debug-util.cc:398] Leaking SignalData structure 0x7b08002e47a0 after lost signal to thread 6756
I20260709 13:18:51.839243  8445 raft_consensus.cc:2749] T a1704639a875409b9959353527b3fd68 P b7ab4784c7344b939bc36f639286f377 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:18:51.849053  8443 raft_consensus.cc:3060] T 4d9def8b32fd443aa94ab1420b06837b P b7ab4784c7344b939bc36f639286f377 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:51.847748  8074 raft_consensus.cc:2749] T 427c124d773f483294511e80fe340075 P b7ab4784c7344b939bc36f639286f377 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:18:51.863036  8422 consensus_queue.cc:1048] T f58dc08b12a2494bb9a1372837970ca2 P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Connected to new peer: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:18:51.864687  8440 leader_election.cc:290] T a3022224cc81473690653a83d4e99470 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:18:51.866618  6801 raft_consensus.cc:1240] T 853ac0a8cbd64ce99457f170216d4d0f P b7ab4784c7344b939bc36f639286f377 [term 2 LEADER]: Rejecting Update request from peer ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 1. Current term is 2. Ops: []
I20260709 13:18:51.844990  8245 consensus_queue.cc:1048] T 1bf4668eeb70467fb3dc5a0289233b3c P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.014s
I20260709 13:18:51.847927  8451 raft_consensus.cc:2804] T 711ef6523deb4cbe8ef2ba61e1c21c98 P cd75a17ab2604397adab03bb8b5fd75c [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:18:51.854218  8446 consensus_queue.cc:1048] T 8c7f33e544204fbaac4078e3e83bbf4e P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.047s
W20260709 13:18:51.905681  6770 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:51.907897  8460 raft_consensus.cc:2804] T b56bf91d90824c959e21e0cee5ba1816 P cd75a17ab2604397adab03bb8b5fd75c [term 4 FOLLOWER]: Leader election won for term 4
W20260709 13:18:51.911616  6696 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:51.918249  6876 raft_consensus.cc:1275] T bb3d8792045a4583ae2e965b1350a5b4 P cd75a17ab2604397adab03bb8b5fd75c [term 4 FOLLOWER]: Refusing update from remote peer ccd8a4c3bfe3413cb2ae219b09aea832: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:18:51.890355  8425 raft_consensus.cc:697] T 7c37d41cd9164c15a6826ca62a851a69 P cd75a17ab2604397adab03bb8b5fd75c [term 3 LEADER]: Becoming Leader. State: Replica: cd75a17ab2604397adab03bb8b5fd75c, State: Running, Role: LEADER
W20260709 13:18:51.911057  6753 debug-util.cc:398] Leaking SignalData structure 0x7b0800233920 after lost signal to thread 6831
I20260709 13:18:51.905355  8451 raft_consensus.cc:697] T 711ef6523deb4cbe8ef2ba61e1c21c98 P cd75a17ab2604397adab03bb8b5fd75c [term 4 LEADER]: Becoming Leader. State: Replica: cd75a17ab2604397adab03bb8b5fd75c, State: Running, Role: LEADER
I20260709 13:18:51.938917  6805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c44c4849aa54f2b94d1f1bef9ed546f" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:18:51.949719  6728 raft_consensus.cc:3055] T dbdf895bba214ff68685a24fd17dfb5d P ccd8a4c3bfe3413cb2ae219b09aea832 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:18:51.950210  6728 raft_consensus.cc:740] T dbdf895bba214ff68685a24fd17dfb5d P ccd8a4c3bfe3413cb2ae219b09aea832 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
W20260709 13:18:51.953329  6846 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:51.924103  8317 consensus_queue.cc:1048] T f3f9c2e2bf644115957398fe4c9459db P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.021s
I20260709 13:18:51.955499  6803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e326172347f45e99a0d482b5d8ef768" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:18:51.958638  8460 raft_consensus.cc:697] T b56bf91d90824c959e21e0cee5ba1816 P cd75a17ab2604397adab03bb8b5fd75c [term 4 LEADER]: Becoming Leader. State: Replica: cd75a17ab2604397adab03bb8b5fd75c, State: Running, Role: LEADER
I20260709 13:18:51.943238  8433 raft_consensus.cc:697] T f09c2a98de1a4decabd0ff900dd44caa P cd75a17ab2604397adab03bb8b5fd75c [term 4 LEADER]: Becoming Leader. State: Replica: cd75a17ab2604397adab03bb8b5fd75c, State: Running, Role: LEADER
I20260709 13:18:51.995409  8462 raft_consensus.cc:493] T de3186201e1a40d0b335eeb8b4e256e0 P b7ab4784c7344b939bc36f639286f377 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:52.001879  8346 raft_consensus.cc:515] T 2c240553ce044eedb41541d72b9475d7 P b7ab4784c7344b939bc36f639286f377 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:52.002382  8462 raft_consensus.cc:515] T de3186201e1a40d0b335eeb8b4e256e0 P b7ab4784c7344b939bc36f639286f377 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:52.004580  8445 raft_consensus.cc:493] T c4db81d9d329422bb3b4160ca4ac2d1d P b7ab4784c7344b939bc36f639286f377 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:52.005452  8450 consensus_queue.cc:1059] T 713b5728a197487c9300b310ab94e5a3 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:18:52.005398  8445 raft_consensus.cc:515] T c4db81d9d329422bb3b4160ca4ac2d1d P b7ab4784c7344b939bc36f639286f377 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:52.006994  8280 raft_consensus.cc:515] T f58dc08b12a2494bb9a1372837970ca2 P b7ab4784c7344b939bc36f639286f377 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:52.008231  6728 consensus_queue.cc:260] T dbdf895bba214ff68685a24fd17dfb5d P ccd8a4c3bfe3413cb2ae219b09aea832 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:52.006908  8450 consensus_queue.cc:1059] T 853ac0a8cbd64ce99457f170216d4d0f P ccd8a4c3bfe3413cb2ae219b09aea832 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.003s
I20260709 13:18:52.009743  6728 raft_consensus.cc:3060] T dbdf895bba214ff68685a24fd17dfb5d P ccd8a4c3bfe3413cb2ae219b09aea832 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:52.009917  8445 leader_election.cc:290] T c4db81d9d329422bb3b4160ca4ac2d1d P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:18:52.010516  8450 consensus_queue.cc:1243] T 853ac0a8cbd64ce99457f170216d4d0f P ccd8a4c3bfe3413cb2ae219b09aea832 [NON_LEADER]: Peer b7ab4784c7344b939bc36f639286f377 log is divergent from this leader: its last log entry 2.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260709 13:18:52.011914  8317 raft_consensus.cc:3055] T 713b5728a197487c9300b310ab94e5a3 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:18:52.012388  8317 raft_consensus.cc:740] T 713b5728a197487c9300b310ab94e5a3 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
I20260709 13:18:52.013382  8317 consensus_queue.cc:260] T 713b5728a197487c9300b310ab94e5a3 P ccd8a4c3bfe3413cb2ae219b09aea832 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:51.927227  8430 consensus_queue.cc:237] T ab432e62819d499eaaf3dd55481dd930 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:52.014603  8317 raft_consensus.cc:3060] T 713b5728a197487c9300b310ab94e5a3 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:51.999303  8425 consensus_queue.cc:237] T 7c37d41cd9164c15a6826ca62a851a69 P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:52.013607  6725 raft_consensus.cc:1275] T 8c7f33e544204fbaac4078e3e83bbf4e P ccd8a4c3bfe3413cb2ae219b09aea832 [term 3 FOLLOWER]: Refusing update from remote peer b7ab4784c7344b939bc36f639286f377: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:18:51.998139  8451 consensus_queue.cc:237] T 711ef6523deb4cbe8ef2ba61e1c21c98 P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
W20260709 13:18:51.965138  6753 debug-util.cc:398] Leaking SignalData structure 0x7b08002d5320 after lost signal to thread 6905
W20260709 13:18:52.018494  6697 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 97119.3us
I20260709 13:18:52.033824  6732 raft_consensus.cc:2410] T 3fa34c08b205435dba97346991aa1f92 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ba59cc884714e8aa5f3f0ecaed84cbb for term 5 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 13:18:51.960522  6727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3022224cc81473690653a83d4e99470" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:18:52.036639  6728 raft_consensus.cc:1275] T dbdf895bba214ff68685a24fd17dfb5d P ccd8a4c3bfe3413cb2ae219b09aea832 [term 4 FOLLOWER]: Refusing update from remote peer b7ab4784c7344b939bc36f639286f377: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 2. (term mismatch)
I20260709 13:18:52.038575  6799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "427c124d773f483294511e80fe340075" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:18:52.040818  6728 pending_rounds.cc:85] T dbdf895bba214ff68685a24fd17dfb5d P ccd8a4c3bfe3413cb2ae219b09aea832: Aborting all ops after (but not including) 1
I20260709 13:18:52.040309  6799 raft_consensus.cc:2468] T 427c124d773f483294511e80fe340075 P b7ab4784c7344b939bc36f639286f377 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 3.
I20260709 13:18:52.044836  6729 raft_consensus.cc:3055] T 7a734b5ab7834e05a8c422208acc58b1 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:18:52.045468  6729 raft_consensus.cc:740] T 7a734b5ab7834e05a8c422208acc58b1 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
I20260709 13:18:52.016601  6798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4275cf08e63345f993bce8664eada830" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:18:52.048545  8346 leader_election.cc:290] T 2c240553ce044eedb41541d72b9475d7 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 5 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
W20260709 13:18:52.049647  6753 debug-util.cc:398] Leaking SignalData structure 0x7b080032ca40 after lost signal to thread 7527
W20260709 13:18:52.050107  8426 log.cc:927] Time spent T 90d42e216d9741e190bca19a781291fd P ccd8a4c3bfe3413cb2ae219b09aea832: Append to log took a long time: real 0.706s	user 0.007s	sys 0.000s
I20260709 13:18:52.050325  6727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c240553ce044eedb41541d72b9475d7" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:18:52.050993  6727 raft_consensus.cc:3060] T 2c240553ce044eedb41541d72b9475d7 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:52.052588  8280 leader_election.cc:290] T f58dc08b12a2494bb9a1372837970ca2 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 5 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:18:52.052858  6725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4db81d9d329422bb3b4160ca4ac2d1d" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:18:52.054288  8360 raft_consensus.cc:3060] T b56bf91d90824c959e21e0cee5ba1816 P b7ab4784c7344b939bc36f639286f377 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:52.056547  6724 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50004 (request call id 1099) took 1155 ms. Trace:
I20260709 13:18:52.056975  6724 rpcz_store.cc:276] 0709 13:18:50.900931 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:51.258900 (+357969us) service_pool.cc:224] Handling call
0709 13:18:51.265639 (+  6739us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:51.266125 (+   486us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:51.266159 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:51.266928 (+   769us) log.cc:844] Serialized 26 byte log entry
0709 13:18:51.343301 (+ 76373us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:18:51.343345 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:51.343418 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:52.049420 (+706002us) spinlock_profiling.cc:243] Waited 13 ms on lock 0x7b4400022b4c. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0c745db1 00007fcc0c7e3c85 00007fcc0c7e46a2 00007fcc0f5561db 00007fcc0f551aaf 00007fcc0f54586e 00007fcc0f544bb6 00007fcc0f5447d8 00007fcc0f54e221 00007fcc0f54e1d9 00007fcc0f54e169
0709 13:18:52.056132 (+  6712us) raft_consensus.cc:1685] finished
0709 13:18:52.056163 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:52.056470 (+   307us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":935,"raft.run_cpu_time_us":142,"raft.run_wall_time_us":144,"spinlock_wait_cycles":29846400,"thread_start_us":75940,"threads_started":1,"wal-append.queue_time_us":76473}
I20260709 13:18:52.058844  6724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f58dc08b12a2494bb9a1372837970ca2" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:18:52.059578  6724 raft_consensus.cc:3060] T f58dc08b12a2494bb9a1372837970ca2 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:52.041281  6728 pending_rounds.cc:107] T dbdf895bba214ff68685a24fd17dfb5d P ccd8a4c3bfe3413cb2ae219b09aea832: Aborting uncommitted NO_OP operation due to leader change: 3.2
W20260709 13:18:52.064221  6846 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:52.065073  6728 raft_consensus.cc:2889] T dbdf895bba214ff68685a24fd17dfb5d P ccd8a4c3bfe3413cb2ae219b09aea832 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:18:52.067167  6727 raft_consensus.cc:2468] T 2c240553ce044eedb41541d72b9475d7 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 5.
I20260709 13:18:52.070765  8422 raft_consensus.cc:493] T 7ba5dac66ab5497e9e336f2a3c28cda5 P cd75a17ab2604397adab03bb8b5fd75c [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:52.070847  8463 raft_consensus.cc:493] T 427c124d773f483294511e80fe340075 P cd75a17ab2604397adab03bb8b5fd75c [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:52.071416  8422 raft_consensus.cc:515] T 7ba5dac66ab5497e9e336f2a3c28cda5 P cd75a17ab2604397adab03bb8b5fd75c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:18:52.071959  8463 raft_consensus.cc:515] T 427c124d773f483294511e80fe340075 P cd75a17ab2604397adab03bb8b5fd75c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } attrs { replace: true } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:18:52.073817  8422 leader_election.cc:290] T 7ba5dac66ab5497e9e336f2a3c28cda5 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:18:52.077539  8444 raft_consensus.cc:515] T 9b3759de40694069b13c0f8bd40e5709 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:52.078768  6873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8292e16e5654be6bc408560cf256aaa" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
W20260709 13:18:52.096297  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 268134us
I20260709 13:18:52.098227  6724 raft_consensus.cc:2468] T f58dc08b12a2494bb9a1372837970ca2 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 5.
W20260709 13:18:52.106535  7468 leader_election.cc:336] T 1528ab62b6fe4e3099d08f141afee116 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931): Timed out: RequestConsensusVote RPC to 127.5.126.67:42931 timed out after 1.677s (SENT)
W20260709 13:18:52.104912  6772 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 266682us
I20260709 13:18:52.110826  6772 leader_election.cc:304] T 20f6842e26174571996b8dea4151d4be P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: ccd8a4c3bfe3413cb2ae219b09aea832
W20260709 13:18:52.117033  6697 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 78393.9us
I20260709 13:18:52.120812  8463 leader_election.cc:290] T 427c124d773f483294511e80fe340075 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:18:52.121037  6729 consensus_queue.cc:260] T 7a734b5ab7834e05a8c422208acc58b1 P ccd8a4c3bfe3413cb2ae219b09aea832 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:52.122305  7500 raft_consensus.cc:1240] T 4b8cacb381b746da8d0049b0a83b41dd P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 4 FOLLOWER]: Rejecting Update request from peer ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 3. Current term is 4. Ops: []
I20260709 13:18:52.122365  6729 raft_consensus.cc:3060] T 7a734b5ab7834e05a8c422208acc58b1 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:52.051613  8443 raft_consensus.cc:515] T 4d9def8b32fd443aa94ab1420b06837b P b7ab4784c7344b939bc36f639286f377 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:52.141180  6772 leader_election.cc:304] T f3f9c2e2bf644115957398fe4c9459db P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: ccd8a4c3bfe3413cb2ae219b09aea832
W20260709 13:18:52.127874  6697 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:52.128471  6695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 123227us
I20260709 13:18:52.139041  7993 raft_consensus.cc:515] T c4db81d9d329422bb3b4160ca4ac2d1d P ccd8a4c3bfe3413cb2ae219b09aea832 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:52.148023  6729 raft_consensus.cc:1275] T 7a734b5ab7834e05a8c422208acc58b1 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 4 FOLLOWER]: Refusing update from remote peer b7ab4784c7344b939bc36f639286f377: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:18:52.154848  6772 leader_election.cc:304] T ce4f062dcd314d43a63ca74067cb5ee3 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, b7ab4784c7344b939bc36f639286f377; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:18:52.165310  6802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90d42e216d9741e190bca19a781291fd" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:18:52.166391  6800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c44c4849aa54f2b94d1f1bef9ed546f" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:18:52.106892  8444 leader_election.cc:290] T 9b3759de40694069b13c0f8bd40e5709 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 4 election: Requested vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:18:52.168272  6729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b8cacb381b746da8d0049b0a83b41dd" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:18:52.175398  6799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "404190ce4ce94cecbfcb6ea9d1dd8626" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:18:52.169027  6727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c44c4849aa54f2b94d1f1bef9ed546f" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:18:52.169437  6724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90d42e216d9741e190bca19a781291fd" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:18:52.169279  6728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a485a995abc4807b6e511e45419f737" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:18:52.120816  6798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7887766dc6784fcaa42b35c05fea7a99" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:18:52.161517  8249 raft_consensus.cc:515] T f4b8bd455d5a47c18a1380839c6e0d61 P cd75a17ab2604397adab03bb8b5fd75c [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:52.321127  6806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3411566abe2d4c9bb4b2adfdd05e6f17" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:18:52.321417  6729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3411566abe2d4c9bb4b2adfdd05e6f17" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:18:52.185592  8245 raft_consensus.cc:2749] T ce4f062dcd314d43a63ca74067cb5ee3 P b7ab4784c7344b939bc36f639286f377 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:18:52.324163  6845 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:52.341048  6806 raft_consensus.cc:2468] T 3411566abe2d4c9bb4b2adfdd05e6f17 P b7ab4784c7344b939bc36f639286f377 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 2.
I20260709 13:18:52.345080  6729 raft_consensus.cc:2468] T 3411566abe2d4c9bb4b2adfdd05e6f17 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 2.
I20260709 13:18:52.345898  6807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a485a995abc4807b6e511e45419f737" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:18:52.349149  6729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de3186201e1a40d0b335eeb8b4e256e0" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:18:52.342036  6724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e31b9971c15848dea59d4d4130141d9e" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
W20260709 13:18:52.351035  6847 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:52.323827  8429 raft_consensus.cc:515] T 22ccee1b570c4ad3a57bd7aec085b1b4 P cd75a17ab2604397adab03bb8b5fd75c [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
W20260709 13:18:52.326257  8115 consensus_meta.cc:287] T 3fa34c08b205435dba97346991aa1f92 P cd75a17ab2604397adab03bb8b5fd75c: Time spent flushing consensus metadata: real 0.528s	user 0.010s	sys 0.005s
I20260709 13:18:52.326660  6873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b3759de40694069b13c0f8bd40e5709" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:18:52.188251  8465 consensus_queue.cc:1048] T bb3d8792045a4583ae2e965b1350a5b4 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.071s
I20260709 13:18:52.331002  7993 leader_election.cc:290] T c4db81d9d329422bb3b4160ca4ac2d1d P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 4 election: Requested vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:18:51.959982  8460 consensus_queue.cc:237] T b56bf91d90824c959e21e0cee5ba1816 P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:52.331724  8289 raft_consensus.cc:3060] T 853ac0a8cbd64ce99457f170216d4d0f P ccd8a4c3bfe3413cb2ae219b09aea832 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:52.198964  8433 consensus_queue.cc:237] T f09c2a98de1a4decabd0ff900dd44caa P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:52.332564  6725 raft_consensus.cc:2393] T c4db81d9d329422bb3b4160ca4ac2d1d P ccd8a4c3bfe3413cb2ae219b09aea832 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7ab4784c7344b939bc36f639286f377 in current term 4: Already voted for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in this term.
I20260709 13:18:52.176658  8346 raft_consensus.cc:2804] T f3f9c2e2bf644115957398fe4c9459db P b7ab4784c7344b939bc36f639286f377 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:18:52.334041  6800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3f13b31a1f84f0d89d007eadd57924c" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:18:52.419013  8346 raft_consensus.cc:493] T f3f9c2e2bf644115957398fe4c9459db P b7ab4784c7344b939bc36f639286f377 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:52.419394  6800 raft_consensus.cc:2468] T b3f13b31a1f84f0d89d007eadd57924c P b7ab4784c7344b939bc36f639286f377 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 2.
W20260709 13:18:52.335312  8094 consensus_meta.cc:287] T f4b8bd455d5a47c18a1380839c6e0d61 P ccd8a4c3bfe3413cb2ae219b09aea832: Time spent flushing consensus metadata: real 0.506s	user 0.014s	sys 0.000s
I20260709 13:18:52.420459  8094 raft_consensus.cc:515] T f4b8bd455d5a47c18a1380839c6e0d61 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:52.420924  6800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4b8bd455d5a47c18a1380839c6e0d61" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:18:52.421831  6800 raft_consensus.cc:2468] T f4b8bd455d5a47c18a1380839c6e0d61 P b7ab4784c7344b939bc36f639286f377 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 2.
I20260709 13:18:52.334612  6799 raft_consensus.cc:1240] T f03d0dbf16864ca4bc1bb5e4c0334c0f P b7ab4784c7344b939bc36f639286f377 [term 4 FOLLOWER]: Rejecting Update request from peer ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 13:18:52.423110  8094 leader_election.cc:290] T f4b8bd455d5a47c18a1380839c6e0d61 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 3 election: Requested vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:18:52.424397  6799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8292e16e5654be6bc408560cf256aaa" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:18:52.425271  6799 raft_consensus.cc:2393] T d8292e16e5654be6bc408560cf256aaa P b7ab4784c7344b939bc36f639286f377 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ccd8a4c3bfe3413cb2ae219b09aea832 in current term 4: Already voted for candidate cd75a17ab2604397adab03bb8b5fd75c in this term.
I20260709 13:18:52.426285  6799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b3759de40694069b13c0f8bd40e5709" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:18:52.427070  6799 raft_consensus.cc:2468] T 9b3759de40694069b13c0f8bd40e5709 P b7ab4784c7344b939bc36f639286f377 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 3.
I20260709 13:18:52.198016  8467 raft_consensus.cc:2804] T 20f6842e26174571996b8dea4151d4be P b7ab4784c7344b939bc36f639286f377 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:18:52.428284  8467 raft_consensus.cc:493] T 20f6842e26174571996b8dea4151d4be P b7ab4784c7344b939bc36f639286f377 [term 3 FOLLOWER]: Starting leader election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:18:52.428790  8467 raft_consensus.cc:3060] T 20f6842e26174571996b8dea4151d4be P b7ab4784c7344b939bc36f639286f377 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:52.341075  6798 raft_consensus.cc:2393] T 7887766dc6784fcaa42b35c05fea7a99 P b7ab4784c7344b939bc36f639286f377 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate ccd8a4c3bfe3413cb2ae219b09aea832 in current term 3: Already voted for candidate b7ab4784c7344b939bc36f639286f377 in this term.
W20260709 13:18:52.429973  8332 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 4 current term: 4 is higher.
I20260709 13:18:52.430899  6798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be1a92657f494cac8dd227d152f50151" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:18:52.432257  6805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6869f07b5a4885a0b99fbe60c3b175" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 6 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:18:52.432785  6798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c37d41cd9164c15a6826ca62a851a69" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:18:52.368225  6727 raft_consensus.cc:2393] T 7c44c4849aa54f2b94d1f1bef9ed546f P ccd8a4c3bfe3413cb2ae219b09aea832 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c in current term 4: Already voted for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in this term.
I20260709 13:18:52.434144  6798 raft_consensus.cc:2393] T 7c37d41cd9164c15a6826ca62a851a69 P b7ab4784c7344b939bc36f639286f377 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ccd8a4c3bfe3413cb2ae219b09aea832 in current term 3: Already voted for candidate cd75a17ab2604397adab03bb8b5fd75c in this term.
I20260709 13:18:52.434602  6727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4db81d9d329422bb3b4160ca4ac2d1d" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
W20260709 13:18:52.367481  7468 leader_election.cc:336] T bb3d8792045a4583ae2e965b1350a5b4 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931): Timed out: RequestConsensusVote RPC to 127.5.126.67:42931 timed out after 1.943s (SENT)
I20260709 13:18:52.436240  6727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b8cacb381b746da8d0049b0a83b41dd" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:18:52.436713  7468 leader_election.cc:304] T bb3d8792045a4583ae2e965b1350a5b4 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
W20260709 13:18:52.437376  8480 log.cc:927] Time spent T a1704639a875409b9959353527b3fd68 P cd75a17ab2604397adab03bb8b5fd75c: Append to log took a long time: real 0.074s	user 0.000s	sys 0.000s
I20260709 13:18:52.437726  6727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d33d5ee8ef6f415593d8df52063161ad" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
W20260709 13:18:52.438223  7468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 70792.8us
I20260709 13:18:52.438995  6727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3022224cc81473690653a83d4e99470" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:18:52.377208  6873 raft_consensus.cc:3060] T 9b3759de40694069b13c0f8bd40e5709 P cd75a17ab2604397adab03bb8b5fd75c [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:52.372293  6875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4db81d9d329422bb3b4160ca4ac2d1d" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:18:52.424710  6729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f9c2e2bf644115957398fe4c9459db" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:18:52.441926  6875 raft_consensus.cc:2468] T c4db81d9d329422bb3b4160ca4ac2d1d P cd75a17ab2604397adab03bb8b5fd75c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 3.
I20260709 13:18:52.443017  6875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c240553ce044eedb41541d72b9475d7" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:18:52.443222  6729 raft_consensus.cc:1275] T 44bde925b2e541b69890d70715b85176 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 4 FOLLOWER]: Refusing update from remote peer cd75a17ab2604397adab03bb8b5fd75c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:18:52.443555  6875 raft_consensus.cc:3060] T 2c240553ce044eedb41541d72b9475d7 P cd75a17ab2604397adab03bb8b5fd75c [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:52.369974  8115 raft_consensus.cc:2749] T 3fa34c08b205435dba97346991aa1f92 P cd75a17ab2604397adab03bb8b5fd75c [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:18:52.445432  6732 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49744 (request call id 89) took 1503 ms. Trace:
I20260709 13:18:52.445936  6732 rpcz_store.cc:276] 0709 13:18:50.941859 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:51.037546 (+ 95687us) service_pool.cc:224] Handling call
0709 13:18:52.445079 (+1407533us) spinlock_profiling.cc:243] Waited 989 ms on lock 0x7b54003b83d4. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f9ae2fa 00007fcc1496fb17 00007fcc0deea6d4 00007fcc0deea662 00007fcc0deea591 00007fcc0deea50c 00007fcc0dee97c2 00007fcc0dce548c 00007fcc0dce48c6 00007fcc0dce426f
0709 13:18:52.445252 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2275322240}
I20260709 13:18:52.331818  8439 raft_consensus.cc:3055] T 7c44c4849aa54f2b94d1f1bef9ed546f P b7ab4784c7344b939bc36f639286f377 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:18:52.447543  8439 raft_consensus.cc:740] T 7c44c4849aa54f2b94d1f1bef9ed546f P b7ab4784c7344b939bc36f639286f377 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
I20260709 13:18:52.447979  8389 raft_consensus.cc:2749] T bb3d8792045a4583ae2e965b1350a5b4 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:18:52.416109  8476 log.cc:927] Time spent T a3022224cc81473690653a83d4e99470 P cd75a17ab2604397adab03bb8b5fd75c: Append to log took a long time: real 0.069s	user 0.000s	sys 0.001s
I20260709 13:18:52.419662  8346 raft_consensus.cc:3060] T f3f9c2e2bf644115957398fe4c9459db P b7ab4784c7344b939bc36f639286f377 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:52.456827  6805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d65025eea89441290d85dd053810e31" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:18:52.451387  6727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbdf895bba214ff68685a24fd17dfb5d" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:18:52.453347  6799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5be3a11b23d4ea9b08300a2789821c7" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:18:52.454289  6772 leader_election.cc:304] T c4db81d9d329422bb3b4160ca4ac2d1d P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:18:52.454474  6800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b56bf91d90824c959e21e0cee5ba1816" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:18:52.560565  6799 raft_consensus.cc:2393] T f5be3a11b23d4ea9b08300a2789821c7 P b7ab4784c7344b939bc36f639286f377 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate ccd8a4c3bfe3413cb2ae219b09aea832 in current term 4: Already voted for candidate b7ab4784c7344b939bc36f639286f377 in this term.
W20260709 13:18:52.410009  6881 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.563s	user 0.002s	sys 0.018s
I20260709 13:18:52.566161  6805 raft_consensus.cc:2393] T 3d65025eea89441290d85dd053810e31 P b7ab4784c7344b939bc36f639286f377 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ccd8a4c3bfe3413cb2ae219b09aea832 in current term 2: Already voted for candidate b7ab4784c7344b939bc36f639286f377 in this term.
W20260709 13:18:52.567348  6881 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.718s	user 0.003s	sys 0.018s
I20260709 13:18:52.448637  8439 consensus_queue.cc:260] T 7c44c4849aa54f2b94d1f1bef9ed546f P b7ab4784c7344b939bc36f639286f377 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:52.569465  8439 raft_consensus.cc:3060] T 7c44c4849aa54f2b94d1f1bef9ed546f P b7ab4784c7344b939bc36f639286f377 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:52.571467  8445 raft_consensus.cc:2804] T c4db81d9d329422bb3b4160ca4ac2d1d P b7ab4784c7344b939bc36f639286f377 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:18:52.571951  8445 raft_consensus.cc:493] T c4db81d9d329422bb3b4160ca4ac2d1d P b7ab4784c7344b939bc36f639286f377 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:52.435503  6798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4db81d9d329422bb3b4160ca4ac2d1d" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:18:52.572660  6729 raft_consensus.cc:1240] T 24ee15416e3145beaa1b8183453729a3 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 4 FOLLOWER]: Rejecting Update request from peer cd75a17ab2604397adab03bb8b5fd75c for earlier term 3. Current term is 4. Ops: []
I20260709 13:18:52.574234  7496 raft_consensus.cc:1275] T 427c124d773f483294511e80fe340075 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 3 FOLLOWER]: Refusing update from remote peer ccd8a4c3bfe3413cb2ae219b09aea832: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:18:52.575011  6695 leader_election.cc:304] T 9e326172347f45e99a0d482b5d8ef768 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:18:52.572332  8445 raft_consensus.cc:3060] T c4db81d9d329422bb3b4160ca4ac2d1d P b7ab4784c7344b939bc36f639286f377 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:52.574278  6799 raft_consensus.cc:1275] T d33d5ee8ef6f415593d8df52063161ad P b7ab4784c7344b939bc36f639286f377 [term 4 FOLLOWER]: Refusing update from remote peer ccd8a4c3bfe3413cb2ae219b09aea832: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
W20260709 13:18:52.578339  6771 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:52.566227  6772 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 112086us
I20260709 13:18:52.581440  8332 raft_consensus.cc:2749] T 9e326172347f45e99a0d482b5d8ef768 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:18:52.582376  6876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f58dc08b12a2494bb9a1372837970ca2" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:18:52.583912  6876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3022224cc81473690653a83d4e99470" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:18:52.587810  6881 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53416 (request call id 1954) took 1082 ms. Trace:
W20260709 13:18:52.578087  8305 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 4 current term: 4 is higher.
I20260709 13:18:52.596309  6695 leader_election.cc:304] T 7c44c4849aa54f2b94d1f1bef9ed546f P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:18:52.600761  8094 consensus_queue.cc:1059] T 4b8cacb381b746da8d0049b0a83b41dd P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:18:52.604604  8475 consensus_queue.cc:1048] T 427c124d773f483294511e80fe340075 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:18:52.605969  8305 raft_consensus.cc:493] T 1528ab62b6fe4e3099d08f141afee116 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader cd75a17ab2604397adab03bb8b5fd75c)
I20260709 13:18:52.606990  8305 raft_consensus.cc:515] T 1528ab62b6fe4e3099d08f141afee116 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } attrs { replace: true } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:18:52.608450  6805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b3759de40694069b13c0f8bd40e5709" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:18:52.609177  8441 raft_consensus.cc:493] T 7c37d41cd9164c15a6826ca62a851a69 P b7ab4784c7344b939bc36f639286f377 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:52.610263  8441 raft_consensus.cc:515] T 7c37d41cd9164c15a6826ca62a851a69 P b7ab4784c7344b939bc36f639286f377 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:52.611336  7496 raft_consensus.cc:1275] T 404190ce4ce94cecbfcb6ea9d1dd8626 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 4 FOLLOWER]: Refusing update from remote peer b7ab4784c7344b939bc36f639286f377: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:18:52.609301  6805 raft_consensus.cc:3060] T 9b3759de40694069b13c0f8bd40e5709 P b7ab4784c7344b939bc36f639286f377 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:52.607554  8475 raft_consensus.cc:3055] T 4b8cacb381b746da8d0049b0a83b41dd P ccd8a4c3bfe3413cb2ae219b09aea832 [term 3 LEADER]: Stepping down as leader of term 3
W20260709 13:18:52.587649  8360 consensus_meta.cc:287] T b56bf91d90824c959e21e0cee5ba1816 P b7ab4784c7344b939bc36f639286f377: Time spent flushing consensus metadata: real 0.533s	user 0.015s	sys 0.010s
I20260709 13:18:52.585806  8440 raft_consensus.cc:493] T 17587d6730594da4a56fa13a353232a1 P b7ab4784c7344b939bc36f639286f377 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:52.582373  8074 raft_consensus.cc:493] T e31b9971c15848dea59d4d4130141d9e P b7ab4784c7344b939bc36f639286f377 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:52.457612  8430 consensus_queue.cc:1048] T d8cee0accdb8499c86d4414b72565a38 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.138s
I20260709 13:18:52.588078  8446 raft_consensus.cc:493] T d8292e16e5654be6bc408560cf256aaa P b7ab4784c7344b939bc36f639286f377 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:52.623963  6799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4b8bd455d5a47c18a1380839c6e0d61" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:18:52.626991  6800 raft_consensus.cc:2468] T b56bf91d90824c959e21e0cee5ba1816 P b7ab4784c7344b939bc36f639286f377 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 4.
I20260709 13:18:52.629010  6799 raft_consensus.cc:3060] T f4b8bd455d5a47c18a1380839c6e0d61 P b7ab4784c7344b939bc36f639286f377 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:52.621126  8475 raft_consensus.cc:740] T 4b8cacb381b746da8d0049b0a83b41dd P ccd8a4c3bfe3413cb2ae219b09aea832 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
I20260709 13:18:52.645246  6695 leader_election.cc:304] T 4275cf08e63345f993bce8664eada830 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
W20260709 13:18:52.649475  6697 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:52.631455  8115 raft_consensus.cc:493] T 9e326172347f45e99a0d482b5d8ef768 P cd75a17ab2604397adab03bb8b5fd75c [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:18:52.588544  6881 rpcz_store.cc:276] 0709 13:18:51.495173 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:51.496164 (+   991us) service_pool.cc:224] Handling call
0709 13:18:51.496569 (+   405us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:51.496812 (+   243us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:18:51.587329 (+ 90517us) log.cc:844] Serialized 14 byte log entry
0709 13:18:52.577486 (+990157us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:52.577616 (+   130us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:18:52.577689 (+    73us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:52.577802 (+   113us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:52.577984 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":10800,"prepare.queue_time_us":171067,"prepare.run_cpu_time_us":64,"prepare.run_wall_time_us":65,"raft.queue_time_us":86336,"raft.run_cpu_time_us":137,"raft.run_wall_time_us":5176,"thread_start_us":1048799,"threads_started":3,"wal-append.queue_time_us":276591}
I20260709 13:18:52.626425  8332 raft_consensus.cc:2749] T 7c44c4849aa54f2b94d1f1bef9ed546f P ccd8a4c3bfe3413cb2ae219b09aea832 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:18:52.628894  8440 raft_consensus.cc:515] T 17587d6730594da4a56fa13a353232a1 P b7ab4784c7344b939bc36f639286f377 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:18:52.669169  8356 raft_consensus.cc:2749] T 4275cf08e63345f993bce8664eada830 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:18:52.638480  8360 consensus_queue.cc:1048] T 404190ce4ce94cecbfcb6ea9d1dd8626 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.033s
I20260709 13:18:52.636341  8074 raft_consensus.cc:515] T e31b9971c15848dea59d4d4130141d9e P b7ab4784c7344b939bc36f639286f377 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:52.634294  8446 raft_consensus.cc:515] T d8292e16e5654be6bc408560cf256aaa P b7ab4784c7344b939bc36f639286f377 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
W20260709 13:18:52.684649  6695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 46256.1us
I20260709 13:18:52.711805  6695 leader_election.cc:304] T 404190ce4ce94cecbfcb6ea9d1dd8626 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, b7ab4784c7344b939bc36f639286f377
W20260709 13:18:52.692736  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 277452us
I20260709 13:18:52.662683  8115 raft_consensus.cc:515] T 9e326172347f45e99a0d482b5d8ef768 P cd75a17ab2604397adab03bb8b5fd75c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:52.717480  6695 leader_election.cc:304] T b3f13b31a1f84f0d89d007eadd57924c P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb
I20260709 13:18:52.703497  8315 leader_election.cc:290] T 17587d6730594da4a56fa13a353232a1 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:18:52.719610  8332 raft_consensus.cc:2749] T 404190ce4ce94cecbfcb6ea9d1dd8626 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:18:52.726267  8317 raft_consensus.cc:2804] T b3f13b31a1f84f0d89d007eadd57924c P ccd8a4c3bfe3413cb2ae219b09aea832 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:18:52.748607  7503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce4f062dcd314d43a63ca74067cb5ee3" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 6 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:18:52.749585  7503 raft_consensus.cc:2468] T ce4f062dcd314d43a63ca74067cb5ee3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 4.
W20260709 13:18:52.752177  8428 log.cc:927] Time spent T 24ee15416e3145beaa1b8183453729a3 P 7ba59cc884714e8aa5f3f0ecaed84cbb: Append to log took a long time: real 1.387s	user 0.005s	sys 0.002s
W20260709 13:18:52.753798  6698 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:52.757591  8446 leader_election.cc:290] T d8292e16e5654be6bc408560cf256aaa P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:18:52.758371  8446 raft_consensus.cc:493] T bb7fa124c3bf4ef9ab65a407cb008441 P b7ab4784c7344b939bc36f639286f377 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:52.758939  8446 raft_consensus.cc:515] T bb7fa124c3bf4ef9ab65a407cb008441 P b7ab4784c7344b939bc36f639286f377 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:18:52.760406  8332 raft_consensus.cc:493] T e77e330a82df4b43a745d57a68f6f057 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:52.761852  8360 raft_consensus.cc:493] T d33d5ee8ef6f415593d8df52063161ad P b7ab4784c7344b939bc36f639286f377 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:52.762495  8360 raft_consensus.cc:515] T d33d5ee8ef6f415593d8df52063161ad P b7ab4784c7344b939bc36f639286f377 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:52.766671  6727 raft_consensus.cc:2468] T dbdf895bba214ff68685a24fd17dfb5d P ccd8a4c3bfe3413cb2ae219b09aea832 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 4.
I20260709 13:18:52.767962  8440 leader_election.cc:290] T 17587d6730594da4a56fa13a353232a1 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:18:52.720674  8475 consensus_queue.cc:260] T 4b8cacb381b746da8d0049b0a83b41dd P ccd8a4c3bfe3413cb2ae219b09aea832 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:18:52.770771  8475 raft_consensus.cc:3060] T 4b8cacb381b746da8d0049b0a83b41dd P ccd8a4c3bfe3413cb2ae219b09aea832 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:52.772168  8356 consensus_queue.cc:1059] T f03d0dbf16864ca4bc1bb5e4c0334c0f P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 13:18:52.772814  8483 log.cc:927] Time spent T 4275cf08e63345f993bce8664eada830 P cd75a17ab2604397adab03bb8b5fd75c: Append to log took a long time: real 0.077s	user 0.001s	sys 0.000s
I20260709 13:18:52.773671  8356 raft_consensus.cc:3055] T f03d0dbf16864ca4bc1bb5e4c0334c0f P ccd8a4c3bfe3413cb2ae219b09aea832 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:18:52.774083  8356 raft_consensus.cc:740] T f03d0dbf16864ca4bc1bb5e4c0334c0f P ccd8a4c3bfe3413cb2ae219b09aea832 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
I20260709 13:18:52.775023  8356 consensus_queue.cc:260] T f03d0dbf16864ca4bc1bb5e4c0334c0f P ccd8a4c3bfe3413cb2ae219b09aea832 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:52.744098  8441 leader_election.cc:290] T 7c37d41cd9164c15a6826ca62a851a69 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
W20260709 13:18:52.741966  6844 connection.cc:256] RPC call timeout handler was delayed by -3.5189823709999928s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17250000000000001s for a response
W20260709 13:18:52.779632  6844 connection.cc:256] RPC call timeout handler was delayed by -3.32562989999974s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1767s for a response
W20260709 13:18:52.780054  6844 connection.cc:256] RPC call timeout handler was delayed by -3.2278325969998605s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1892s for a response
I20260709 13:18:52.780129  8305 leader_election.cc:290] T 1528ab62b6fe4e3099d08f141afee116 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
W20260709 13:18:52.780670  6844 connection.cc:256] RPC call timeout handler was delayed by -3.049826130999918s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2076s for a response
W20260709 13:18:52.781185  6844 connection.cc:256] RPC call timeout handler was delayed by -2.4293320359997779s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15980000000000003s for a response
W20260709 13:18:52.781529  6844 connection.cc:256] RPC call timeout handler was delayed by -2.3825320359999296s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.165s for a response
I20260709 13:18:52.781453  8074 leader_election.cc:290] T e31b9971c15848dea59d4d4130141d9e P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
W20260709 13:18:52.782027  6844 connection.cc:256] RPC call timeout handler was delayed by -2.3645320359999005s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.167s for a response
W20260709 13:18:52.782418  6844 connection.cc:256] RPC call timeout handler was delayed by -2.3492320359998757s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16870000000000002s for a response
W20260709 13:18:52.782691  6844 connection.cc:256] RPC call timeout handler was delayed by -2.294332035999787s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1748s for a response
W20260709 13:18:52.782961  6844 connection.cc:256] RPC call timeout handler was delayed by -2.2868176340000446s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2925s for a response
W20260709 13:18:52.783248  6844 connection.cc:256] RPC call timeout handler was delayed by -2.2736320359997535s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1771s for a response
W20260709 13:18:52.783545  6844 connection.cc:256] RPC call timeout handler was delayed by -2.2610320359997331s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1785s for a response
I20260709 13:18:52.741750  8317 raft_consensus.cc:493] T b3f13b31a1f84f0d89d007eadd57924c P ccd8a4c3bfe3413cb2ae219b09aea832 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 7ba59cc884714e8aa5f3f0ecaed84cbb)
I20260709 13:18:52.784592  8317 raft_consensus.cc:3060] T b3f13b31a1f84f0d89d007eadd57924c P ccd8a4c3bfe3413cb2ae219b09aea832 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:52.730583  8315 raft_consensus.cc:493] T 404190ce4ce94cecbfcb6ea9d1dd8626 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:52.787043  6723 raft_consensus.cc:1275] T 853ac0a8cbd64ce99457f170216d4d0f P ccd8a4c3bfe3413cb2ae219b09aea832 [term 2 FOLLOWER]: Refusing update from remote peer b7ab4784c7344b939bc36f639286f377: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:18:52.786761  8315 raft_consensus.cc:515] T 404190ce4ce94cecbfcb6ea9d1dd8626 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:18:52.761348  8332 raft_consensus.cc:515] T e77e330a82df4b43a745d57a68f6f057 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } }
I20260709 13:18:52.789606  8315 leader_election.cc:290] T 404190ce4ce94cecbfcb6ea9d1dd8626 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:18:52.791414  8332 leader_election.cc:290] T e77e330a82df4b43a745d57a68f6f057 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:18:52.792372  8112 raft_consensus.cc:3055] T 1528ab62b6fe4e3099d08f141afee116 P cd75a17ab2604397adab03bb8b5fd75c [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:18:52.793044  8112 raft_consensus.cc:740] T 1528ab62b6fe4e3099d08f141afee116 P cd75a17ab2604397adab03bb8b5fd75c [term 3 LEADER]: Becoming Follower/Learner. State: Replica: cd75a17ab2604397adab03bb8b5fd75c, State: Running, Role: LEADER
I20260709 13:18:52.793749  7500 raft_consensus.cc:1240] T 1528ab62b6fe4e3099d08f141afee116 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 4 FOLLOWER]: Rejecting Update request from peer cd75a17ab2604397adab03bb8b5fd75c for earlier term 3. Current term is 4. Ops: []
I20260709 13:18:52.794001  8112 consensus_queue.cc:260] T 1528ab62b6fe4e3099d08f141afee116 P cd75a17ab2604397adab03bb8b5fd75c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.4, Last appended by leader: 4, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } attrs { replace: true } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:18:52.795078  8360 leader_election.cc:290] T d33d5ee8ef6f415593d8df52063161ad P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:18:52.767987  6731 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50004 (request call id 1106) took 1858 ms. Trace:
W20260709 13:18:52.783831  6844 connection.cc:256] RPC call timeout handler was delayed by -2.1917320359998484s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18620000000000003s for a response
I20260709 13:18:52.806141  6728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de3186201e1a40d0b335eeb8b4e256e0" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
W20260709 13:18:52.806821  6844 connection.cc:256] RPC call timeout handler was delayed by -2.14313203599977s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1916s for a response
W20260709 13:18:52.807264  6844 connection.cc:256] RPC call timeout handler was delayed by -2.131432035999751s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19290000000000002s for a response
W20260709 13:18:52.807551  6844 connection.cc:256] RPC call timeout handler was delayed by -2.0882320359999085s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19770000000000001s for a response
W20260709 13:18:52.807814  6844 connection.cc:256] RPC call timeout handler was delayed by -1.9784320359997309s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20990000000000003s for a response
I20260709 13:18:52.779945  8115 leader_election.cc:290] T 9e326172347f45e99a0d482b5d8ef768 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:18:52.808492  8445 raft_consensus.cc:515] T c4db81d9d329422bb3b4160ca4ac2d1d P b7ab4784c7344b939bc36f639286f377 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:52.810410  6798 raft_consensus.cc:2393] T c4db81d9d329422bb3b4160ca4ac2d1d P b7ab4784c7344b939bc36f639286f377 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ccd8a4c3bfe3413cb2ae219b09aea832 in current term 4: Already voted for candidate b7ab4784c7344b939bc36f639286f377 in this term.
I20260709 13:18:52.805224  6731 rpcz_store.cc:276] 0709 13:18:50.909725 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:51.322344 (+412619us) service_pool.cc:224] Handling call
0709 13:18:51.339860 (+ 17516us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:51.378684 (+ 38824us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:51.378712 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:51.379209 (+   497us) log.cc:844] Serialized 26 byte log entry
0709 13:18:51.442963 (+ 63754us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:18:51.463223 (+ 20260us) log.cc:844] Serialized 14 byte log entry
0709 13:18:51.472429 (+  9206us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:51.472507 (+    78us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:52.763446 (+1290939us) spinlock_profiling.cc:243] Waited 1.42 ms on lock 0x7b2400118b98. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0c745db1 00007fcc0c7439c4 00007fcc0c741acb 00007fcc0c8fcdc9 00007fcc0c8fca55 00007fcc0c8fbfb0 00007fcc0f572488 00007fcc0f572be8 00007fcc0f54a398 00007fcc0f54576a 00007fcc0f544bb6
0709 13:18:52.767632 (+  4186us) raft_consensus.cc:1685] finished
0709 13:18:52.767778 (+   146us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:52.767920 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2195,"prepare.queue_time_us":20534,"prepare.run_cpu_time_us":65,"prepare.run_wall_time_us":8847,"raft.queue_time_us":4357,"raft.run_cpu_time_us":231,"raft.run_wall_time_us":10979,"spinlock_wait_cycles":3268352,"thread_start_us":62448,"threads_started":1,"wal-append.queue_time_us":87481}
I20260709 13:18:52.811349  6804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4db81d9d329422bb3b4160ca4ac2d1d" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
W20260709 13:18:52.808104  6844 connection.cc:256] RPC call timeout handler was delayed by -1.5221320359999027s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2606s for a response
I20260709 13:18:52.813097  6798 raft_consensus.cc:1275] T a3022224cc81473690653a83d4e99470 P b7ab4784c7344b939bc36f639286f377 [term 4 FOLLOWER]: Refusing update from remote peer ccd8a4c3bfe3413cb2ae219b09aea832: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
W20260709 13:18:52.814209  6844 connection.cc:256] RPC call timeout handler was delayed by -1.342132035999839s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2806s for a response
I20260709 13:18:52.814806  6729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "853ac0a8cbd64ce99457f170216d4d0f" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:18:52.816391  6695 leader_election.cc:304] T 7887766dc6784fcaa42b35c05fea7a99 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:18:52.816697  6878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ba5dac66ab5497e9e336f2a3c28cda5" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:18:52.817270  7503 raft_consensus.cc:1240] T 24ee15416e3145beaa1b8183453729a3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 4 LEADER]: Rejecting Update request from peer cd75a17ab2604397adab03bb8b5fd75c for earlier term 3. Current term is 4. Ops: []
I20260709 13:18:52.817322  8094 raft_consensus.cc:2749] T 7887766dc6784fcaa42b35c05fea7a99 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:18:52.819890  6875 raft_consensus.cc:2468] T 2c240553ce044eedb41541d72b9475d7 P cd75a17ab2604397adab03bb8b5fd75c [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 5.
I20260709 13:18:52.820354  6803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22ccee1b570c4ad3a57bd7aec085b1b4" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:18:52.821285  6803 raft_consensus.cc:2410] T 22ccee1b570c4ad3a57bd7aec085b1b4 P b7ab4784c7344b939bc36f639286f377 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ccd8a4c3bfe3413cb2ae219b09aea832 for term 4 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
W20260709 13:18:52.823211  6770 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:52.796967  8446 leader_election.cc:290] T bb7fa124c3bf4ef9ab65a407cb008441 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:18:52.799181  8249 leader_election.cc:290] T f4b8bd455d5a47c18a1380839c6e0d61 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 3 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
W20260709 13:18:52.801162  6847 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:52.795791  8112 raft_consensus.cc:3060] T 1528ab62b6fe4e3099d08f141afee116 P cd75a17ab2604397adab03bb8b5fd75c [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:52.824806  6731 raft_consensus.cc:1240] T f58dc08b12a2494bb9a1372837970ca2 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 5 FOLLOWER]: Rejecting Update request from peer cd75a17ab2604397adab03bb8b5fd75c for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 13:18:52.838708  6727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4275cf08e63345f993bce8664eada830" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:18:52.839097  6880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8cee0accdb8499c86d4414b72565a38" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:18:52.828624  6804 raft_consensus.cc:1240] T 4d9def8b32fd443aa94ab1420b06837b P b7ab4784c7344b939bc36f639286f377 [term 4 FOLLOWER]: Rejecting Update request from peer ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 3. Current term is 4. Ops: []
I20260709 13:18:52.807948  6728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "427c124d773f483294511e80fe340075" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
W20260709 13:18:52.830823  6696 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:52.831655  6799 raft_consensus.cc:2468] T f4b8bd455d5a47c18a1380839c6e0d61 P b7ab4784c7344b939bc36f639286f377 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 3.
I20260709 13:18:52.797748  8356 raft_consensus.cc:3060] T f03d0dbf16864ca4bc1bb5e4c0334c0f P ccd8a4c3bfe3413cb2ae219b09aea832 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:52.777889  6873 raft_consensus.cc:2468] T 9b3759de40694069b13c0f8bd40e5709 P cd75a17ab2604397adab03bb8b5fd75c [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 4.
I20260709 13:18:52.835238  6695 leader_election.cc:304] T be1a92657f494cac8dd227d152f50151 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, b7ab4784c7344b939bc36f639286f377
I20260709 13:18:52.808538  7502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "427c124d773f483294511e80fe340075" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:18:52.844004  6877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1528ab62b6fe4e3099d08f141afee116" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:18:52.840512  6729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d9def8b32fd443aa94ab1420b06837b" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:18:52.845057  6724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce4f062dcd314d43a63ca74067cb5ee3" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 6 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:18:52.844799  6873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24ee15416e3145beaa1b8183453729a3" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:18:52.846058  6724 raft_consensus.cc:2468] T ce4f062dcd314d43a63ca74067cb5ee3 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 5.
I20260709 13:18:52.846400  6731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17587d6730594da4a56fa13a353232a1" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:18:52.844157  6880 raft_consensus.cc:2368] T d8cee0accdb8499c86d4414b72565a38 P cd75a17ab2604397adab03bb8b5fd75c [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ba59cc884714e8aa5f3f0ecaed84cbb for earlier term 4. Current term is 5.
I20260709 13:18:52.847543  6805 raft_consensus.cc:2468] T 9b3759de40694069b13c0f8bd40e5709 P b7ab4784c7344b939bc36f639286f377 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 4.
I20260709 13:18:52.848749  6727 raft_consensus.cc:2468] T 4275cf08e63345f993bce8664eada830 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 3.
I20260709 13:18:52.853813  6695 leader_election.cc:304] T bd6869f07b5a4885a0b99fbe60c3b175 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:18:52.794948  7498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ba5dac66ab5497e9e336f2a3c28cda5" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:18:52.857471  6804 raft_consensus.cc:1240] T e77e330a82df4b43a745d57a68f6f057 P b7ab4784c7344b939bc36f639286f377 [term 5 FOLLOWER]: Rejecting Update request from peer ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 4. Current term is 5. Ops: []
I20260709 13:18:52.836508  8315 raft_consensus.cc:493] T 4b8cacb381b746da8d0049b0a83b41dd P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:52.863057  6695 leader_election.cc:304] T 7c37d41cd9164c15a6826ca62a851a69 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:18:52.869179  6724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d33d5ee8ef6f415593d8df52063161ad" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:18:52.869311  6804 raft_consensus.cc:1275] T 427c124d773f483294511e80fe340075 P b7ab4784c7344b939bc36f639286f377 [term 3 FOLLOWER]: Refusing update from remote peer ccd8a4c3bfe3413cb2ae219b09aea832: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:18:52.869776  6770 leader_election.cc:304] T 3411566abe2d4c9bb4b2adfdd05e6f17 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:18:52.875027  6770 leader_election.cc:304] T f4b8bd455d5a47c18a1380839c6e0d61 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:18:52.875954  6804 raft_consensus.cc:1275] T bb7fa124c3bf4ef9ab65a407cb008441 P b7ab4784c7344b939bc36f639286f377 [term 4 FOLLOWER]: Refusing update from remote peer 7ba59cc884714e8aa5f3f0ecaed84cbb: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:18:52.871713  6731 raft_consensus.cc:2468] T 17587d6730594da4a56fa13a353232a1 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 4.
I20260709 13:18:52.864769  8360 raft_consensus.cc:493] T f5be3a11b23d4ea9b08300a2789821c7 P b7ab4784c7344b939bc36f639286f377 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:52.878515  8315 raft_consensus.cc:515] T 4b8cacb381b746da8d0049b0a83b41dd P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:18:52.879498  8445 leader_election.cc:290] T c4db81d9d329422bb3b4160ca4ac2d1d P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 4 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:18:52.879310  8360 raft_consensus.cc:515] T f5be3a11b23d4ea9b08300a2789821c7 P b7ab4784c7344b939bc36f639286f377 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:52.864735  8305 raft_consensus.cc:2749] T bd6869f07b5a4885a0b99fbe60c3b175 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:18:52.844094  8332 raft_consensus.cc:493] T 853ac0a8cbd64ce99457f170216d4d0f P ccd8a4c3bfe3413cb2ae219b09aea832 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:52.843989  8094 raft_consensus.cc:493] T 3fa34c08b205435dba97346991aa1f92 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:52.887079  6873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb7fa124c3bf4ef9ab65a407cb008441" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:18:52.888600  6873 raft_consensus.cc:2410] T bb7fa124c3bf4ef9ab65a407cb008441 P cd75a17ab2604397adab03bb8b5fd75c [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ba59cc884714e8aa5f3f0ecaed84cbb for term 4 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
W20260709 13:18:52.891557  6845 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:52.852988  8446 raft_consensus.cc:493] T f09c2a98de1a4decabd0ff900dd44caa P b7ab4784c7344b939bc36f639286f377 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:52.901275  6727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8292e16e5654be6bc408560cf256aaa" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:18:52.902109  6727 raft_consensus.cc:2468] T d8292e16e5654be6bc408560cf256aaa P ccd8a4c3bfe3413cb2ae219b09aea832 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 4.
I20260709 13:18:52.903319  6727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c37d41cd9164c15a6826ca62a851a69" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:18:52.903043  8332 raft_consensus.cc:515] T 853ac0a8cbd64ce99457f170216d4d0f P ccd8a4c3bfe3413cb2ae219b09aea832 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:52.891287  6880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fa34c08b205435dba97346991aa1f92" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:18:52.904546  6880 raft_consensus.cc:2410] T 3fa34c08b205435dba97346991aa1f92 P cd75a17ab2604397adab03bb8b5fd75c [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ba59cc884714e8aa5f3f0ecaed84cbb for term 5 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 13:18:52.905781  8332 leader_election.cc:290] T 853ac0a8cbd64ce99457f170216d4d0f P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:18:52.907531  8446 raft_consensus.cc:515] T f09c2a98de1a4decabd0ff900dd44caa P b7ab4784c7344b939bc36f639286f377 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:52.910089  8446 leader_election.cc:290] T f09c2a98de1a4decabd0ff900dd44caa P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:18:52.893738  6729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "404190ce4ce94cecbfcb6ea9d1dd8626" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
W20260709 13:18:52.911904  6847 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:52.898969  8405 raft_consensus.cc:2749] T 7c37d41cd9164c15a6826ca62a851a69 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:18:52.859527  8289 raft_consensus.cc:2749] T be1a92657f494cac8dd227d152f50151 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:18:52.905606  6880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3d8792045a4583ae2e965b1350a5b4" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:18:52.921180  6805 raft_consensus.cc:1275] T 24ee15416e3145beaa1b8183453729a3 P b7ab4784c7344b939bc36f639286f377 [term 4 FOLLOWER]: Refusing update from remote peer 7ba59cc884714e8aa5f3f0ecaed84cbb: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 13:18:52.893983  6873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb7fa124c3bf4ef9ab65a407cb008441" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:18:52.895148  6695 leader_election.cc:304] T f5be3a11b23d4ea9b08300a2789821c7 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:18:52.921739  6880 raft_consensus.cc:2468] T bb3d8792045a4583ae2e965b1350a5b4 P cd75a17ab2604397adab03bb8b5fd75c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in term 4.
I20260709 13:18:52.911793  6729 raft_consensus.cc:2468] T 404190ce4ce94cecbfcb6ea9d1dd8626 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in term 4.
I20260709 13:18:52.925707  6873 raft_consensus.cc:2410] T bb7fa124c3bf4ef9ab65a407cb008441 P cd75a17ab2604397adab03bb8b5fd75c [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 7ba59cc884714e8aa5f3f0ecaed84cbb for term 4 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:18:52.884510  8074 raft_consensus.cc:2764] T f4b8bd455d5a47c18a1380839c6e0d61 P b7ab4784c7344b939bc36f639286f377 [term 3 FOLLOWER]: Leader election decision vote started in defunct term 2: won
I20260709 13:18:52.901298  6804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17587d6730594da4a56fa13a353232a1" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:18:52.932610  6729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e31b9971c15848dea59d4d4130141d9e" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:18:52.933764  6727 raft_consensus.cc:2468] T 7c37d41cd9164c15a6826ca62a851a69 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 3.
I20260709 13:18:52.927253  6770 leader_election.cc:304] T a3022224cc81473690653a83d4e99470 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:18:52.884946  8441 raft_consensus.cc:2804] T 3411566abe2d4c9bb4b2adfdd05e6f17 P b7ab4784c7344b939bc36f639286f377 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:18:52.931650  6804 raft_consensus.cc:2468] T 17587d6730594da4a56fa13a353232a1 P b7ab4784c7344b939bc36f639286f377 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in term 5.
I20260709 13:18:52.937733  8332 raft_consensus.cc:2749] T f5be3a11b23d4ea9b08300a2789821c7 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:18:52.937861  6805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "404190ce4ce94cecbfcb6ea9d1dd8626" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:18:52.936434  8382 consensus_queue.cc:1048] T bb7fa124c3bf4ef9ab65a407cb008441 P 7ba59cc884714e8aa5f3f0ecaed84cbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.003s
I20260709 13:18:52.934636  6798 raft_consensus.cc:1240] T 7a734b5ab7834e05a8c422208acc58b1 P b7ab4784c7344b939bc36f639286f377 [term 4 LEADER]: Rejecting Update request from peer ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 3. Current term is 4. Ops: []
W20260709 13:18:52.942524  6695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 47504.9us
W20260709 13:18:52.944916  6695 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:52.946965  6730 raft_consensus.cc:1275] T 4b8cacb381b746da8d0049b0a83b41dd P ccd8a4c3bfe3413cb2ae219b09aea832 [term 4 FOLLOWER]: Refusing update from remote peer cd75a17ab2604397adab03bb8b5fd75c: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:18:52.946552  6729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fa34c08b205435dba97346991aa1f92" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:18:52.953599  6725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17587d6730594da4a56fa13a353232a1" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:18:52.954429  6725 raft_consensus.cc:2468] T 17587d6730594da4a56fa13a353232a1 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in term 4.
I20260709 13:18:52.954576  8315 leader_election.cc:290] T 4b8cacb381b746da8d0049b0a83b41dd P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
W20260709 13:18:52.955202  8467 consensus_meta.cc:287] T 20f6842e26174571996b8dea4151d4be P b7ab4784c7344b939bc36f639286f377: Time spent flushing consensus metadata: real 0.526s	user 0.000s	sys 0.012s
I20260709 13:18:52.955667  8467 raft_consensus.cc:515] T 20f6842e26174571996b8dea4151d4be P b7ab4784c7344b939bc36f639286f377 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:52.912218  8094 raft_consensus.cc:515] T 3fa34c08b205435dba97346991aa1f92 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:18:52.956852  6806 raft_consensus.cc:1240] T 20f6842e26174571996b8dea4151d4be P b7ab4784c7344b939bc36f639286f377 [term 4 FOLLOWER]: Rejecting Update request from peer ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 3. Current term is 4. Ops: []
I20260709 13:18:52.967133  8441 raft_consensus.cc:697] T 3411566abe2d4c9bb4b2adfdd05e6f17 P b7ab4784c7344b939bc36f639286f377 [term 2 LEADER]: Becoming Leader. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
I20260709 13:18:52.967386  8315 consensus_queue.cc:1048] T 24ee15416e3145beaa1b8183453729a3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:18:52.968185  8346 raft_consensus.cc:515] T f3f9c2e2bf644115957398fe4c9459db P b7ab4784c7344b939bc36f639286f377 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:52.968451  8441 consensus_queue.cc:237] T 3411566abe2d4c9bb4b2adfdd05e6f17 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:52.969705  6803 raft_consensus.cc:1240] T f3f9c2e2bf644115957398fe4c9459db P b7ab4784c7344b939bc36f639286f377 [term 4 FOLLOWER]: Rejecting Update request from peer ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 3. Current term is 4. Ops: []
I20260709 13:18:52.968621  8465 raft_consensus.cc:493] T 95a75bfe094d4bdc963aba3f08dfcd25 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:52.933044  8429 leader_election.cc:290] T 22ccee1b570c4ad3a57bd7aec085b1b4 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 4 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:18:52.964694  6695 leader_election.cc:304] T 3d65025eea89441290d85dd053810e31 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:18:52.971083  7466 leader_election.cc:304] T 17587d6730594da4a56fa13a353232a1 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, b7ab4784c7344b939bc36f639286f377; no voters: 
I20260709 13:18:52.953681  6878 raft_consensus.cc:2468] T 7ba5dac66ab5497e9e336f2a3c28cda5 P cd75a17ab2604397adab03bb8b5fd75c [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in term 4.
I20260709 13:18:52.971906  6729 raft_consensus.cc:2410] T 3fa34c08b205435dba97346991aa1f92 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ba59cc884714e8aa5f3f0ecaed84cbb for term 5 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 13:18:52.972708  6880 raft_consensus.cc:1275] T 7ba5dac66ab5497e9e336f2a3c28cda5 P cd75a17ab2604397adab03bb8b5fd75c [term 4 FOLLOWER]: Refusing update from remote peer 7ba59cc884714e8aa5f3f0ecaed84cbb: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
W20260709 13:18:52.973456  6696 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:52.910758  8317 raft_consensus.cc:515] T b3f13b31a1f84f0d89d007eadd57924c P ccd8a4c3bfe3413cb2ae219b09aea832 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:18:52.976924  6873 raft_consensus.cc:1275] T bb7fa124c3bf4ef9ab65a407cb008441 P cd75a17ab2604397adab03bb8b5fd75c [term 4 FOLLOWER]: Refusing update from remote peer 7ba59cc884714e8aa5f3f0ecaed84cbb: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 6. (term mismatch)
I20260709 13:18:52.979350  8493 consensus_queue.cc:1048] T 8c7f33e544204fbaac4078e3e83bbf4e P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:18:52.980751  8094 leader_election.cc:290] T 3fa34c08b205435dba97346991aa1f92 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:18:52.970642  8360 leader_election.cc:290] T f5be3a11b23d4ea9b08300a2789821c7 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:18:52.989248  6878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe20b4b48823486ca3b9c648db6ce8aa" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:18:52.956005  6725 raft_consensus.cc:1275] T 404190ce4ce94cecbfcb6ea9d1dd8626 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 4 FOLLOWER]: Refusing update from remote peer b7ab4784c7344b939bc36f639286f377: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:18:52.977998  8382 raft_consensus.cc:2804] T 17587d6730594da4a56fa13a353232a1 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:18:52.991338  8382 raft_consensus.cc:493] T 17587d6730594da4a56fa13a353232a1 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:52.991966  8382 raft_consensus.cc:3060] T 17587d6730594da4a56fa13a353232a1 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:52.992503  6725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b8cacb381b746da8d0049b0a83b41dd" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:18:52.970492  8458 raft_consensus.cc:2749] T a3022224cc81473690653a83d4e99470 P b7ab4784c7344b939bc36f639286f377 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:18:52.977495  6873 pending_rounds.cc:85] T bb7fa124c3bf4ef9ab65a407cb008441 P cd75a17ab2604397adab03bb8b5fd75c: Aborting all ops after (but not including) 5
I20260709 13:18:53.003232  6873 pending_rounds.cc:107] T bb7fa124c3bf4ef9ab65a407cb008441 P cd75a17ab2604397adab03bb8b5fd75c: Aborting uncommitted NO_OP operation due to leader change: 3.6
I20260709 13:18:53.003593  6873 raft_consensus.cc:2889] T bb7fa124c3bf4ef9ab65a407cb008441 P cd75a17ab2604397adab03bb8b5fd75c [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:18:52.993708  6732 raft_consensus.cc:1275] T 1bf4668eeb70467fb3dc5a0289233b3c P ccd8a4c3bfe3413cb2ae219b09aea832 [term 4 FOLLOWER]: Refusing update from remote peer b7ab4784c7344b939bc36f639286f377: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:18:53.000540  6804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77e330a82df4b43a745d57a68f6f057" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:18:53.006379  6878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ba5dac66ab5497e9e336f2a3c28cda5" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:18:53.007103  6878 raft_consensus.cc:2376] T 7ba5dac66ab5497e9e336f2a3c28cda5 P cd75a17ab2604397adab03bb8b5fd75c [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in term 4. Re-sending same reply.
I20260709 13:18:53.009227  6770 leader_election.cc:304] T 2c240553ce044eedb41541d72b9475d7 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
I20260709 13:18:52.973425  8445 raft_consensus.cc:493] T e77e330a82df4b43a745d57a68f6f057 P b7ab4784c7344b939bc36f639286f377 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:53.010460  6805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1528ab62b6fe4e3099d08f141afee116" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:18:53.010598  8445 raft_consensus.cc:515] T e77e330a82df4b43a745d57a68f6f057 P b7ab4784c7344b939bc36f639286f377 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } }
I20260709 13:18:53.011476  6805 raft_consensus.cc:2393] T 1528ab62b6fe4e3099d08f141afee116 P b7ab4784c7344b939bc36f639286f377 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ccd8a4c3bfe3413cb2ae219b09aea832 in current term 4: Already voted for candidate b7ab4784c7344b939bc36f639286f377 in this term.
I20260709 13:18:53.011303  6695 leader_election.cc:304] T 22ccee1b570c4ad3a57bd7aec085b1b4 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:18:53.012102  8462 leader_election.cc:290] T de3186201e1a40d0b335eeb8b4e256e0 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:18:53.012281  8475 consensus_queue.cc:1048] T a3022224cc81473690653a83d4e99470 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:18:53.012915  6805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "853ac0a8cbd64ce99457f170216d4d0f" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:18:53.013497  8445 leader_election.cc:290] T e77e330a82df4b43a745d57a68f6f057 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931), ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391)
I20260709 13:18:53.008307  8100 consensus_queue.cc:1048] T d33d5ee8ef6f415593d8df52063161ad P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.013s
I20260709 13:18:53.014801  8332 raft_consensus.cc:493] T f09c2a98de1a4decabd0ff900dd44caa P ccd8a4c3bfe3413cb2ae219b09aea832 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:52.988232  8406 raft_consensus.cc:3060] T 3d65025eea89441290d85dd053810e31 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:53.015637  6723 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50004 (request call id 1105) took 2106 ms. Trace:
I20260709 13:18:53.015475  8332 raft_consensus.cc:515] T f09c2a98de1a4decabd0ff900dd44caa P ccd8a4c3bfe3413cb2ae219b09aea832 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:53.016113  6723 rpcz_store.cc:276] 0709 13:18:50.909419 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:51.292896 (+383477us) service_pool.cc:224] Handling call
0709 13:18:51.293234 (+   338us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:52.787493 (+1494259us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:53.015347 (+227854us) spinlock_profiling.cc:243] Waited 1.49 s on lock 0x7b54000997d4. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f9aae01 00007fcc0f9a983e 00007fcc1496e419 00007fcc0dee5bd4 00007fcc0dee5b62 00007fcc0dee5a91 00007fcc0dee5a0c 00007fcc0dee4cc2 00007fcc0dce548c 00007fcc0dce48c6
0709 13:18:53.015570 (+   223us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3434498944}
I20260709 13:18:53.018074  8446 consensus_queue.cc:1048] T dbdf895bba214ff68685a24fd17dfb5d P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:18:53.014565  8465 raft_consensus.cc:515] T 95a75bfe094d4bdc963aba3f08dfcd25 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:53.019857  8446 raft_consensus.cc:493] T 4f00a2e87e56452083b759f60d461ee3 P b7ab4784c7344b939bc36f639286f377 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 7ba59cc884714e8aa5f3f0ecaed84cbb)
I20260709 13:18:53.018110  8332 leader_election.cc:290] T f09c2a98de1a4decabd0ff900dd44caa P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:18:53.020664  8465 leader_election.cc:290] T 95a75bfe094d4bdc963aba3f08dfcd25 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:18:53.020531  8446 raft_consensus.cc:515] T 4f00a2e87e56452083b759f60d461ee3 P b7ab4784c7344b939bc36f639286f377 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:18:53.002089  8394 raft_consensus.cc:493] T 22ccee1b570c4ad3a57bd7aec085b1b4 P b7ab4784c7344b939bc36f639286f377 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:53.021606  8394 raft_consensus.cc:515] T 22ccee1b570c4ad3a57bd7aec085b1b4 P b7ab4784c7344b939bc36f639286f377 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:53.021972  8346 leader_election.cc:290] T f3f9c2e2bf644115957398fe4c9459db P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 4 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:18:53.022992  6695 leader_election.cc:304] T f4b8bd455d5a47c18a1380839c6e0d61 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
I20260709 13:18:53.023837  8394 leader_election.cc:290] T 22ccee1b570c4ad3a57bd7aec085b1b4 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:18:53.023954  6695 leader_election.cc:304] T 9b3759de40694069b13c0f8bd40e5709 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
I20260709 13:18:53.025357  8331 raft_consensus.cc:3055] T be1a92657f494cac8dd227d152f50151 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:18:53.025914  6877 raft_consensus.cc:2410] T 1528ab62b6fe4e3099d08f141afee116 P cd75a17ab2604397adab03bb8b5fd75c [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ba59cc884714e8aa5f3f0ecaed84cbb for term 4 because replica has last-logged OpId of term: 3 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 3.
I20260709 13:18:53.026259  8405 consensus_queue.cc:1059] T 4d9def8b32fd443aa94ab1420b06837b P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:18:53.026674  8332 raft_consensus.cc:2804] T f4b8bd455d5a47c18a1380839c6e0d61 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:18:53.027272  8332 raft_consensus.cc:697] T f4b8bd455d5a47c18a1380839c6e0d61 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 3 LEADER]: Becoming Leader. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
I20260709 13:18:53.025848  8352 raft_consensus.cc:2749] T 22ccee1b570c4ad3a57bd7aec085b1b4 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:18:53.028213  8465 consensus_queue.cc:1048] T 427c124d773f483294511e80fe340075 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:18:53.029114  8352 raft_consensus.cc:3055] T 4d9def8b32fd443aa94ab1420b06837b P ccd8a4c3bfe3413cb2ae219b09aea832 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:18:53.029531  8352 raft_consensus.cc:740] T 4d9def8b32fd443aa94ab1420b06837b P ccd8a4c3bfe3413cb2ae219b09aea832 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
I20260709 13:18:53.027237  8405 raft_consensus.cc:2804] T 9b3759de40694069b13c0f8bd40e5709 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:18:53.030577  8405 raft_consensus.cc:697] T 9b3759de40694069b13c0f8bd40e5709 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 4 LEADER]: Becoming Leader. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
I20260709 13:18:53.030400  8352 consensus_queue.cc:260] T 4d9def8b32fd443aa94ab1420b06837b P ccd8a4c3bfe3413cb2ae219b09aea832 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:53.031718  8405 consensus_queue.cc:237] T 9b3759de40694069b13c0f8bd40e5709 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:53.031876  8352 raft_consensus.cc:3060] T 4d9def8b32fd443aa94ab1420b06837b P ccd8a4c3bfe3413cb2ae219b09aea832 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:53.034312  6725 raft_consensus.cc:1240] T b3f13b31a1f84f0d89d007eadd57924c P ccd8a4c3bfe3413cb2ae219b09aea832 [term 3 FOLLOWER]: Rejecting Update request from peer 7ba59cc884714e8aa5f3f0ecaed84cbb for earlier term 2. Current term is 3. Ops: []
I20260709 13:18:53.036736  8332 consensus_queue.cc:237] T f4b8bd455d5a47c18a1380839c6e0d61 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:53.041918  6872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb7fa124c3bf4ef9ab65a407cb008441" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:18:53.042742  6872 raft_consensus.cc:2468] T bb7fa124c3bf4ef9ab65a407cb008441 P cd75a17ab2604397adab03bb8b5fd75c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in term 4.
I20260709 13:18:53.043643  6872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb7fa124c3bf4ef9ab65a407cb008441" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:18:53.044283  6804 raft_consensus.cc:2468] T e77e330a82df4b43a745d57a68f6f057 P b7ab4784c7344b939bc36f639286f377 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 5.
W20260709 13:18:53.045971  6846 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:53.046068  6844 leader_election.cc:304] T 4f00a2e87e56452083b759f60d461ee3 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, b7ab4784c7344b939bc36f639286f377
W20260709 13:18:53.046741  6846 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:53.047302  6846 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:53.047219  6873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1528ab62b6fe4e3099d08f141afee116" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:18:52.982057  8467 leader_election.cc:290] T 20f6842e26174571996b8dea4151d4be P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 4 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:18:53.049336  6770 leader_election.cc:304] T f58dc08b12a2494bb9a1372837970ca2 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:18:53.052076  6873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fa34c08b205435dba97346991aa1f92" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:18:53.052400  6881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ba5dac66ab5497e9e336f2a3c28cda5" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:18:53.052991  6873 raft_consensus.cc:2410] T 3fa34c08b205435dba97346991aa1f92 P cd75a17ab2604397adab03bb8b5fd75c [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ba59cc884714e8aa5f3f0ecaed84cbb for term 5 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 13:18:53.053833  6876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24ee15416e3145beaa1b8183453729a3" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
W20260709 13:18:53.055230  6697 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:53.056329  6697 leader_election.cc:304] T d8292e16e5654be6bc408560cf256aaa P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:18:53.052945  6881 raft_consensus.cc:2376] T 7ba5dac66ab5497e9e336f2a3c28cda5 P cd75a17ab2604397adab03bb8b5fd75c [term 4 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in term 4. Re-sending same reply.
I20260709 13:18:53.059401  6626 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:51654 (request call id 77) took 2205 ms. Trace:
I20260709 13:18:53.059617  6878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24ee15416e3145beaa1b8183453729a3" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:18:53.060329  6873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8cee0accdb8499c86d4414b72565a38" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:18:53.069257  6873 raft_consensus.cc:2368] T d8cee0accdb8499c86d4414b72565a38 P cd75a17ab2604397adab03bb8b5fd75c [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ba59cc884714e8aa5f3f0ecaed84cbb for earlier term 4. Current term is 5.
I20260709 13:18:53.069738  6881 raft_consensus.cc:3055] T 24ee15416e3145beaa1b8183453729a3 P cd75a17ab2604397adab03bb8b5fd75c [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:18:53.070303  6881 raft_consensus.cc:740] T 24ee15416e3145beaa1b8183453729a3 P cd75a17ab2604397adab03bb8b5fd75c [term 3 LEADER]: Becoming Follower/Learner. State: Replica: cd75a17ab2604397adab03bb8b5fd75c, State: Running, Role: LEADER
I20260709 13:18:53.058779  6695 leader_election.cc:304] T b56bf91d90824c959e21e0cee5ba1816 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:18:53.073462  7503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fa34c08b205435dba97346991aa1f92" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:18:53.076261  7503 raft_consensus.cc:2468] T 3fa34c08b205435dba97346991aa1f92 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 4.
I20260709 13:18:53.030400  8317 leader_election.cc:290] T b3f13b31a1f84f0d89d007eadd57924c P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 3 election: Requested vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:18:53.025808  8331 raft_consensus.cc:740] T be1a92657f494cac8dd227d152f50151 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 7ba59cc884714e8aa5f3f0ecaed84cbb, State: Running, Role: LEADER
I20260709 13:18:53.082268  6770 leader_election.cc:304] T d8292e16e5654be6bc408560cf256aaa P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
I20260709 13:18:53.086480  7502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1528ab62b6fe4e3099d08f141afee116" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:18:53.092882  7502 raft_consensus.cc:2393] T 1528ab62b6fe4e3099d08f141afee116 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ccd8a4c3bfe3413cb2ae219b09aea832 in current term 4: Already voted for candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in this term.
I20260709 13:18:53.071426  6881 consensus_queue.cc:260] T 24ee15416e3145beaa1b8183453729a3 P cd75a17ab2604397adab03bb8b5fd75c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.4, Last appended by leader: 4, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } attrs { replace: true } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:18:53.099340  6881 raft_consensus.cc:3060] T 24ee15416e3145beaa1b8183453729a3 P cd75a17ab2604397adab03bb8b5fd75c [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:53.100288  8094 raft_consensus.cc:2764] T b56bf91d90824c959e21e0cee5ba1816 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 4 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
I20260709 13:18:53.101387  8094 raft_consensus.cc:493] T 1bf4668eeb70467fb3dc5a0289233b3c P ccd8a4c3bfe3413cb2ae219b09aea832 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:53.101997  8094 raft_consensus.cc:515] T 1bf4668eeb70467fb3dc5a0289233b3c P ccd8a4c3bfe3413cb2ae219b09aea832 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:53.066927  8382 raft_consensus.cc:515] T 17587d6730594da4a56fa13a353232a1 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:18:53.105129  8406 raft_consensus.cc:2749] T 3d65025eea89441290d85dd053810e31 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:18:53.106683  6697 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 50502.6us
I20260709 13:18:53.109248  6770 leader_election.cc:304] T 17587d6730594da4a56fa13a353232a1 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
I20260709 13:18:53.059233  8467 raft_consensus.cc:2804] T 2c240553ce044eedb41541d72b9475d7 P b7ab4784c7344b939bc36f639286f377 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:18:53.122807  8458 raft_consensus.cc:2804] T d8292e16e5654be6bc408560cf256aaa P b7ab4784c7344b939bc36f639286f377 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:18:53.123306  8458 raft_consensus.cc:493] T d8292e16e5654be6bc408560cf256aaa P b7ab4784c7344b939bc36f639286f377 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:53.123699  8458 raft_consensus.cc:3060] T d8292e16e5654be6bc408560cf256aaa P b7ab4784c7344b939bc36f639286f377 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:53.123497  6697 leader_election.cc:304] T 3fa34c08b205435dba97346991aa1f92 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
I20260709 13:18:53.111234  6731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17587d6730594da4a56fa13a353232a1" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:18:53.126600  6731 raft_consensus.cc:3060] T 17587d6730594da4a56fa13a353232a1 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 4 FOLLOWER]: Advancing to term 6
I20260709 13:18:53.126883  8475 raft_consensus.cc:2804] T 3fa34c08b205435dba97346991aa1f92 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:18:53.127609  8475 raft_consensus.cc:493] T 3fa34c08b205435dba97346991aa1f92 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:53.128124  8475 raft_consensus.cc:3060] T 3fa34c08b205435dba97346991aa1f92 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:53.107061  6876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b8cacb381b746da8d0049b0a83b41dd" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:18:53.132436  8382 leader_election.cc:290] T 17587d6730594da4a56fa13a353232a1 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 6 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:18:53.134145  6726 raft_consensus.cc:1275] T 4275cf08e63345f993bce8664eada830 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 3 FOLLOWER]: Refusing update from remote peer b7ab4784c7344b939bc36f639286f377: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:18:53.065014  6626 rpcz_store.cc:276] 0709 13:18:50.847692 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:50.848984 (+  1292us) service_pool.cc:224] Handling call
0709 13:18:53.052187 (+2203203us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:18:51.718872 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:18:51.821570 (+102698us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:18:51.824175 (+  2605us) write_op.cc:435] Acquired schema lock
0709 13:18:51.825664 (+  1489us) tablet.cc:662] Decoding operations
0709 13:18:51.860555 (+ 34891us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:18:51.860657 (+   102us) write_op.cc:641] Partition lock acquired for write op
0709 13:18:51.860700 (+    43us) tablet.cc:685] Acquiring locks for 4 operations
0709 13:18:51.861238 (+   538us) tablet.cc:701] Row locks acquired
0709 13:18:51.861260 (+    22us) write_op.cc:260] PREPARE: finished
0709 13:18:51.861468 (+   208us) write_op.cc:270] Start()
0709 13:18:51.861617 (+   149us) write_op.cc:276] Timestamp: P: 1783603131861418 usec, L: 0
0709 13:18:51.861641 (+    24us) op_driver.cc:348] REPLICATION: starting
0709 13:18:51.862469 (+   828us) log.cc:844] Serialized 1701 byte log entry
0709 13:18:52.379751 (+517282us) op_driver.cc:464] REPLICATION: finished
0709 13:18:52.725063 (+345312us) write_op.cc:301] APPLY: starting
0709 13:18:52.727724 (+  2661us) tablet.cc:1367] starting BulkCheckPresence
0709 13:18:52.739002 (+ 11278us) tablet.cc:1370] finished BulkCheckPresence
0709 13:18:52.764323 (+ 25321us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:18:52.765130 (+   807us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:18:52.765347 (+   217us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=4
0709 13:18:52.765403 (+    56us) write_op.cc:312] APPLY: finished
0709 13:18:52.765702 (+   299us) log.cc:844] Serialized 40 byte log entry
0709 13:18:52.765908 (+   206us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:18:52.766035 (+   127us) write_op.cc:454] Released schema lock
0709 13:18:52.766084 (+    49us) write_op.cc:341] FINISH: Updating metrics
0709 13:18:52.766600 (+   516us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:18:52.766631 (+    31us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":36189,"reported_tablets":12,"spinlock_wait_cycles":15616,"child_traces":[["op",{"apply.queue_time_us":331710,"apply.run_cpu_time_us":3279,"apply.run_wall_time_us":47922,"num_ops":4,"prepare.queue_time_us":154523,"prepare.run_cpu_time_us":8123,"prepare.run_wall_time_us":207998,"raft.queue_time_us":457969,"raft.run_cpu_time_us":24404,"raft.run_wall_time_us":313133,"replication_time_us":517904,"thread_start_us":505495,"threads_started":4,"wal-append.queue_time_us":44976}]]}
I20260709 13:18:53.114619  8094 leader_election.cc:290] T 1bf4668eeb70467fb3dc5a0289233b3c P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:18:53.115406  8425 raft_consensus.cc:2749] T 4f00a2e87e56452083b759f60d461ee3 P cd75a17ab2604397adab03bb8b5fd75c [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:18:53.120189  8360 raft_consensus.cc:2804] T 17587d6730594da4a56fa13a353232a1 P b7ab4784c7344b939bc36f639286f377 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:18:53.136859  6874 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53416 (request call id 1967) took 1017 ms. Trace:
I20260709 13:18:53.096601  8112 raft_consensus.cc:493] T ab432e62819d499eaaf3dd55481dd930 P cd75a17ab2604397adab03bb8b5fd75c [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:53.137390  8360 raft_consensus.cc:493] T 17587d6730594da4a56fa13a353232a1 P b7ab4784c7344b939bc36f639286f377 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:53.138036  8360 raft_consensus.cc:3060] T 17587d6730594da4a56fa13a353232a1 P b7ab4784c7344b939bc36f639286f377 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:53.086802  8445 raft_consensus.cc:2804] T f58dc08b12a2494bb9a1372837970ca2 P b7ab4784c7344b939bc36f639286f377 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:18:53.136806  6697 leader_election.cc:304] T 1528ab62b6fe4e3099d08f141afee116 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, b7ab4784c7344b939bc36f639286f377
I20260709 13:18:53.134941  6726 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50004 (request call id 1121) took 1197 ms. Trace:
I20260709 13:18:53.152981  8094 raft_consensus.cc:3060] T 1528ab62b6fe4e3099d08f141afee116 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:53.160353  7502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3f13b31a1f84f0d89d007eadd57924c" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb"
I20260709 13:18:53.155251  8112 raft_consensus.cc:515] T ab432e62819d499eaaf3dd55481dd930 P cd75a17ab2604397adab03bb8b5fd75c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:53.163055  8112 leader_election.cc:290] T ab432e62819d499eaaf3dd55481dd930 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:18:53.137457  6874 rpcz_store.cc:276] 0709 13:18:52.119351 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:52.119592 (+   241us) service_pool.cc:224] Handling call
0709 13:18:52.121184 (+  1592us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:52.121637 (+   453us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:52.121674 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:52.122224 (+   550us) log.cc:844] Serialized 26 byte log entry
0709 13:18:53.136224 (+1014000us) spinlock_profiling.cc:243] Waited 2.82 ms on lock 0x7b18002b7740. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc15785de1 00007fcc157925b1 00007fcc0f5524bc 00007fcc0c8a048b 00007fcc156faab9 00007fcc0c8bc69b 00007fcc0c8ba93f 00007fcc0c8bcc02 00007fcc0f54420b 00007fcc0f549d23 00007fcc0f54a0d1
0709 13:18:53.136397 (+   173us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:18:53.136438 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:53.136511 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:53.136553 (+    42us) raft_consensus.cc:1685] finished
0709 13:18:53.136564 (+    11us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:53.136783 (+   219us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":19842,"raft.queue_time_us":1195,"raft.run_cpu_time_us":143,"raft.run_wall_time_us":25705,"spinlock_wait_cycles":6486272,"thread_start_us":119869,"threads_started":1,"wal-append.queue_time_us":294404}
I20260709 13:18:53.153122  6730 raft_consensus.cc:1275] T 24ee15416e3145beaa1b8183453729a3 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 4 FOLLOWER]: Refusing update from remote peer 7ba59cc884714e8aa5f3f0ecaed84cbb: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 13:18:53.153739  8394 consensus_queue.cc:1048] T 404190ce4ce94cecbfcb6ea9d1dd8626 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.010s
I20260709 13:18:53.139614  8406 raft_consensus.cc:2749] T d8292e16e5654be6bc408560cf256aaa P ccd8a4c3bfe3413cb2ae219b09aea832 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:18:53.168503  8331 consensus_queue.cc:260] T be1a92657f494cac8dd227d152f50151 P 7ba59cc884714e8aa5f3f0ecaed84cbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:18:53.169443  8419 raft_consensus.cc:3060] T f5be3a11b23d4ea9b08300a2789821c7 P cd75a17ab2604397adab03bb8b5fd75c [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:53.169965  8331 raft_consensus.cc:3060] T be1a92657f494cac8dd227d152f50151 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:53.170953  7466 leader_election.cc:304] T 404190ce4ce94cecbfcb6ea9d1dd8626 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: b7ab4784c7344b939bc36f639286f377
I20260709 13:18:53.171854  8495 consensus_queue.cc:1048] T 853ac0a8cbd64ce99457f170216d4d0f P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:18:53.172798  8467 raft_consensus.cc:697] T 2c240553ce044eedb41541d72b9475d7 P b7ab4784c7344b939bc36f639286f377 [term 5 LEADER]: Becoming Leader. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
I20260709 13:18:53.175887  8467 consensus_queue.cc:237] T 2c240553ce044eedb41541d72b9475d7 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:53.177011  6798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a75bfe094d4bdc963aba3f08dfcd25" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:18:53.177834  6798 raft_consensus.cc:2468] T 95a75bfe094d4bdc963aba3f08dfcd25 P b7ab4784c7344b939bc36f639286f377 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 4.
I20260709 13:18:53.179304  6695 leader_election.cc:304] T 95a75bfe094d4bdc963aba3f08dfcd25 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
I20260709 13:18:53.178331  8446 leader_election.cc:290] T 4f00a2e87e56452083b759f60d461ee3 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:18:53.181304  6806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bf4668eeb70467fb3dc5a0289233b3c" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:18:53.182595  6806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3f13b31a1f84f0d89d007eadd57924c" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
W20260709 13:18:53.173652  6770 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 59429.4us
I20260709 13:18:53.172880  8445 raft_consensus.cc:697] T f58dc08b12a2494bb9a1372837970ca2 P b7ab4784c7344b939bc36f639286f377 [term 5 LEADER]: Becoming Leader. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
I20260709 13:18:53.184137  8317 raft_consensus.cc:493] T 24ee15416e3145beaa1b8183453729a3 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:53.184862  8317 raft_consensus.cc:515] T 24ee15416e3145beaa1b8183453729a3 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } attrs { replace: true } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:18:53.185283  8445 consensus_queue.cc:237] T f58dc08b12a2494bb9a1372837970ca2 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
W20260709 13:18:53.148176  6846 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.68:45071, user_credentials={real_user=slave}} blocked reactor thread for 60137.8us
I20260709 13:18:53.190522  6695 leader_election.cc:304] T b3f13b31a1f84f0d89d007eadd57924c P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, b7ab4784c7344b939bc36f639286f377
I20260709 13:18:53.183737  6806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17587d6730594da4a56fa13a353232a1" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:18:53.192361  6731 raft_consensus.cc:2468] T 17587d6730594da4a56fa13a353232a1 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in term 6.
I20260709 13:18:53.194482  6695 leader_election.cc:304] T e77e330a82df4b43a745d57a68f6f057 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
I20260709 13:18:53.179031  6798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09c2a98de1a4decabd0ff900dd44caa" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:18:53.189500  6770 leader_election.cc:304] T 7c37d41cd9164c15a6826ca62a851a69 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
W20260709 13:18:53.197343  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 151360us
I20260709 13:18:53.223028  6844 leader_election.cc:304] T 30e88460611e47b2ba16a46a30b5f416 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:18:53.224073  8429 raft_consensus.cc:2804] T 30e88460611e47b2ba16a46a30b5f416 P cd75a17ab2604397adab03bb8b5fd75c [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:18:53.224756  8429 raft_consensus.cc:493] T 30e88460611e47b2ba16a46a30b5f416 P cd75a17ab2604397adab03bb8b5fd75c [term 2 FOLLOWER]: Starting leader election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:18:53.225311  8429 raft_consensus.cc:3060] T 30e88460611e47b2ba16a46a30b5f416 P cd75a17ab2604397adab03bb8b5fd75c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:53.203006  7466 leader_election.cc:304] T 17587d6730594da4a56fa13a353232a1 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
I20260709 13:18:53.211478  8458 raft_consensus.cc:515] T d8292e16e5654be6bc408560cf256aaa P b7ab4784c7344b939bc36f639286f377 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:53.229907  6731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4db81d9d329422bb3b4160ca4ac2d1d" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:18:53.230605  6728 raft_consensus.cc:1275] T ab432e62819d499eaaf3dd55481dd930 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 4 FOLLOWER]: Refusing update from remote peer b7ab4784c7344b939bc36f639286f377: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 2. (index mismatch)
I20260709 13:18:53.230786  6731 raft_consensus.cc:2393] T c4db81d9d329422bb3b4160ca4ac2d1d P ccd8a4c3bfe3413cb2ae219b09aea832 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate b7ab4784c7344b939bc36f639286f377 in current term 4: Already voted for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in this term.
I20260709 13:18:53.234454  6730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20f6842e26174571996b8dea4151d4be" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:18:53.237304  6874 raft_consensus.cc:1240] T 4b8cacb381b746da8d0049b0a83b41dd P cd75a17ab2604397adab03bb8b5fd75c [term 4 LEADER]: Rejecting Update request from peer ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 3. Current term is 4. Ops: []
I20260709 13:18:53.237385  6879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4db81d9d329422bb3b4160ca4ac2d1d" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:18:53.238157  6879 raft_consensus.cc:3060] T c4db81d9d329422bb3b4160ca4ac2d1d P cd75a17ab2604397adab03bb8b5fd75c [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:53.238552  6731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5be3a11b23d4ea9b08300a2789821c7" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:18:53.239799  6844 leader_election.cc:304] T 4d9def8b32fd443aa94ab1420b06837b P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:18:53.239341  6731 raft_consensus.cc:2468] T f5be3a11b23d4ea9b08300a2789821c7 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 4.
I20260709 13:18:53.243856  6730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77e330a82df4b43a745d57a68f6f057" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:18:53.247076  6877 raft_consensus.cc:1275] T d33d5ee8ef6f415593d8df52063161ad P cd75a17ab2604397adab03bb8b5fd75c [term 4 FOLLOWER]: Refusing update from remote peer ccd8a4c3bfe3413cb2ae219b09aea832: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:18:53.252576  6728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09c2a98de1a4decabd0ff900dd44caa" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:18:53.253594  6728 raft_consensus.cc:2410] T f09c2a98de1a4decabd0ff900dd44caa P ccd8a4c3bfe3413cb2ae219b09aea832 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7ab4784c7344b939bc36f639286f377 for term 5 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:18:53.255635  6844 leader_election.cc:304] T ce4f062dcd314d43a63ca74067cb5ee3 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb
I20260709 13:18:53.196732  8100 raft_consensus.cc:2804] T 95a75bfe094d4bdc963aba3f08dfcd25 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:18:53.217448  8305 raft_consensus.cc:2749] T b3f13b31a1f84f0d89d007eadd57924c P ccd8a4c3bfe3413cb2ae219b09aea832 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
W20260709 13:18:53.258029  7466 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 55584us
I20260709 13:18:53.217645  8382 raft_consensus.cc:2804] T 404190ce4ce94cecbfcb6ea9d1dd8626 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:18:53.232972  8356 raft_consensus.cc:2804] T e77e330a82df4b43a745d57a68f6f057 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:18:53.261600  6878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a75bfe094d4bdc963aba3f08dfcd25" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:18:53.255195  8441 raft_consensus.cc:493] T f03d0dbf16864ca4bc1bb5e4c0334c0f P b7ab4784c7344b939bc36f639286f377 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:53.264755  6799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e31b9971c15848dea59d4d4130141d9e" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:18:53.264900  6732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22ccee1b570c4ad3a57bd7aec085b1b4" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:18:53.232461  8280 raft_consensus.cc:2804] T 7c37d41cd9164c15a6826ca62a851a69 P b7ab4784c7344b939bc36f639286f377 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:18:53.274174  8280 raft_consensus.cc:493] T 7c37d41cd9164c15a6826ca62a851a69 P b7ab4784c7344b939bc36f639286f377 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:53.274791  8280 raft_consensus.cc:3060] T 7c37d41cd9164c15a6826ca62a851a69 P b7ab4784c7344b939bc36f639286f377 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:53.196877  8495 consensus_queue.cc:1048] T 1bf4668eeb70467fb3dc5a0289233b3c P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.065s
I20260709 13:18:53.281374  6877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1528ab62b6fe4e3099d08f141afee116" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:18:53.242991  8112 raft_consensus.cc:2749] T 4d9def8b32fd443aa94ab1420b06837b P cd75a17ab2604397adab03bb8b5fd75c [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:18:53.266994  6874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77e330a82df4b43a745d57a68f6f057" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:18:53.235674  6798 raft_consensus.cc:2468] T f09c2a98de1a4decabd0ff900dd44caa P b7ab4784c7344b939bc36f639286f377 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 4.
I20260709 13:18:53.282196  6877 raft_consensus.cc:2468] T 1528ab62b6fe4e3099d08f141afee116 P cd75a17ab2604397adab03bb8b5fd75c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 4.
I20260709 13:18:53.196475  8406 consensus_queue.cc:1059] T 20f6842e26174571996b8dea4151d4be P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 1, Time since last communication: 0.067s
I20260709 13:18:53.273375  6732 raft_consensus.cc:2468] T 22ccee1b570c4ad3a57bd7aec085b1b4 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 3.
I20260709 13:18:53.107184  8440 consensus_queue.cc:1048] T 7a734b5ab7834e05a8c422208acc58b1 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.120s
I20260709 13:18:53.217752  8315 consensus_queue.cc:1059] T b3f13b31a1f84f0d89d007eadd57924c P 7ba59cc884714e8aa5f3f0ecaed84cbb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.049s
I20260709 13:18:53.268901  6876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09c2a98de1a4decabd0ff900dd44caa" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:18:53.263590  8100 raft_consensus.cc:493] T 95a75bfe094d4bdc963aba3f08dfcd25 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:53.286587  6875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fa34c08b205435dba97346991aa1f92" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:18:53.285974  6874 raft_consensus.cc:2468] T e77e330a82df4b43a745d57a68f6f057 P cd75a17ab2604397adab03bb8b5fd75c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 5.
I20260709 13:18:53.220512  8389 consensus_queue.cc:1048] T 24ee15416e3145beaa1b8183453729a3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 2, Time since last communication: 0.047s
I20260709 13:18:53.153832  6726 rpcz_store.cc:276] 0709 13:18:51.937348 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:51.942900 (+  5552us) service_pool.cc:224] Handling call
0709 13:18:53.133326 (+1190426us) spinlock_profiling.cc:243] Waited 20.3 ms on lock 0x7b5800000c98. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0c745db1 00007fcc0c885b71 00007fcc0c885a22 00007fcc1579ec09 00007fcc148f8ee0 00007fcc149c20ab 00007fcc149c2131 00007fcc14983fc0 00007fcc1496e929 00007fcc1496e3d2 00007fcc0dee5bd4
0709 13:18:53.133619 (+   293us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:53.134603 (+   984us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:53.134875 (+   272us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":46790400}
I20260709 13:18:53.267091  8382 raft_consensus.cc:493] T 404190ce4ce94cecbfcb6ea9d1dd8626 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:53.272285  8356 raft_consensus.cc:493] T e77e330a82df4b43a745d57a68f6f057 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:53.295186  6878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bf4668eeb70467fb3dc5a0289233b3c" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
W20260709 13:18:53.303256  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 47869.3us
I20260709 13:18:53.386616  6879 raft_consensus.cc:2468] T c4db81d9d329422bb3b4160ca4ac2d1d P cd75a17ab2604397adab03bb8b5fd75c [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 4.
I20260709 13:18:53.305065  6875 raft_consensus.cc:2468] T 3fa34c08b205435dba97346991aa1f92 P cd75a17ab2604397adab03bb8b5fd75c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 4.
I20260709 13:18:53.389362  6799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de3186201e1a40d0b335eeb8b4e256e0" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:18:53.286895  8249 raft_consensus.cc:2804] T ce4f062dcd314d43a63ca74067cb5ee3 P cd75a17ab2604397adab03bb8b5fd75c [term 5 FOLLOWER]: Leader election won for term 5
W20260709 13:18:53.393869  6697 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 96926.2us
I20260709 13:18:53.445133  6877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4b8bd455d5a47c18a1380839c6e0d61" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:18:53.463830  6879 raft_consensus.cc:1275] T 427c124d773f483294511e80fe340075 P cd75a17ab2604397adab03bb8b5fd75c [term 3 FOLLOWER]: Refusing update from remote peer ccd8a4c3bfe3413cb2ae219b09aea832: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:18:53.295607  6725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f9c2e2bf644115957398fe4c9459db" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:18:53.464484  6874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "853ac0a8cbd64ce99457f170216d4d0f" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:18:53.305932  8100 raft_consensus.cc:3060] T 95a75bfe094d4bdc963aba3f08dfcd25 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:53.474042  6877 raft_consensus.cc:2393] T f4b8bd455d5a47c18a1380839c6e0d61 P cd75a17ab2604397adab03bb8b5fd75c [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate ccd8a4c3bfe3413cb2ae219b09aea832 in current term 3: Already voted for candidate cd75a17ab2604397adab03bb8b5fd75c in this term.
I20260709 13:18:53.294800  8513 raft_consensus.cc:2804] T 17587d6730594da4a56fa13a353232a1 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:18:53.284494  8441 raft_consensus.cc:515] T f03d0dbf16864ca4bc1bb5e4c0334c0f P b7ab4784c7344b939bc36f639286f377 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:53.301651  8094 raft_consensus.cc:2749] T 1528ab62b6fe4e3099d08f141afee116 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:18:53.530458  6847 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:53.532378  6879 raft_consensus.cc:1240] T de3186201e1a40d0b335eeb8b4e256e0 P cd75a17ab2604397adab03bb8b5fd75c [term 4 FOLLOWER]: Rejecting Update request from peer ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 3. Current term is 4. Ops: []
I20260709 13:18:53.386721  8458 leader_election.cc:290] T d8292e16e5654be6bc408560cf256aaa P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 5 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:18:53.546257  8317 leader_election.cc:290] T 24ee15416e3145beaa1b8183453729a3 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:18:53.454895  8382 raft_consensus.cc:3060] T 404190ce4ce94cecbfcb6ea9d1dd8626 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:53.465142  8450 raft_consensus.cc:493] T 711ef6523deb4cbe8ef2ba61e1c21c98 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:53.463335  8356 raft_consensus.cc:3060] T e77e330a82df4b43a745d57a68f6f057 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:18:53.556126  6872 consensus_meta.cc:287] T bb7fa124c3bf4ef9ab65a407cb008441 P cd75a17ab2604397adab03bb8b5fd75c: Time spent flushing consensus metadata: real 0.502s	user 0.009s	sys 0.002s
I20260709 13:18:53.570587  6872 raft_consensus.cc:2468] T bb7fa124c3bf4ef9ab65a407cb008441 P cd75a17ab2604397adab03bb8b5fd75c [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in term 4.
W20260709 13:18:53.636013  8471 log.cc:927] Time spent T bb3d8792045a4583ae2e965b1350a5b4 P 7ba59cc884714e8aa5f3f0ecaed84cbb: Append to log took a long time: real 0.068s	user 0.000s	sys 0.002s
I20260709 13:18:53.607698  6798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4275cf08e63345f993bce8664eada830" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
W20260709 13:18:53.670626  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 214400us
I20260709 13:18:53.605268  8450 raft_consensus.cc:515] T 711ef6523deb4cbe8ef2ba61e1c21c98 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:53.668759  8423 raft_consensus.cc:3055] T 7887766dc6784fcaa42b35c05fea7a99 P cd75a17ab2604397adab03bb8b5fd75c [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:18:53.652062  8416 consensus_queue.cc:1048] T f58dc08b12a2494bb9a1372837970ca2 P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.029s
W20260709 13:18:53.696578  8360 consensus_meta.cc:287] T 17587d6730594da4a56fa13a353232a1 P b7ab4784c7344b939bc36f639286f377: Time spent flushing consensus metadata: real 0.554s	user 0.009s	sys 0.002s
W20260709 13:18:53.722137  6881 consensus_meta.cc:287] T 24ee15416e3145beaa1b8183453729a3 P cd75a17ab2604397adab03bb8b5fd75c: Time spent flushing consensus metadata: real 0.622s	user 0.012s	sys 0.000s
I20260709 13:18:53.689561  8423 raft_consensus.cc:740] T 7887766dc6784fcaa42b35c05fea7a99 P cd75a17ab2604397adab03bb8b5fd75c [term 2 LEADER]: Becoming Follower/Learner. State: Replica: cd75a17ab2604397adab03bb8b5fd75c, State: Running, Role: LEADER
I20260709 13:18:53.726567  6881 raft_consensus.cc:1275] T 24ee15416e3145beaa1b8183453729a3 P cd75a17ab2604397adab03bb8b5fd75c [term 4 FOLLOWER]: Refusing update from remote peer 7ba59cc884714e8aa5f3f0ecaed84cbb: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
W20260709 13:18:53.726697  6846 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:53.728705  6772 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 43825.2us
W20260709 13:18:53.734493  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 54317.1us
W20260709 13:18:53.736766  6697 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 261890us
W20260709 13:18:53.737326  6846 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:53.741784  6695 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:53.752543  6844 leader_election.cc:304] T 713b5728a197487c9300b310ab94e5a3 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:18:53.767377  6881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c37d41cd9164c15a6826ca62a851a69" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:18:53.794492  6872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8292e16e5654be6bc408560cf256aaa" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:18:53.836064  6881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d33d5ee8ef6f415593d8df52063161ad" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:18:53.838281  6877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e31b9971c15848dea59d4d4130141d9e" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:18:53.843572  6881 raft_consensus.cc:2468] T d33d5ee8ef6f415593d8df52063161ad P cd75a17ab2604397adab03bb8b5fd75c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 4.
I20260709 13:18:53.843931  6877 raft_consensus.cc:2410] T e31b9971c15848dea59d4d4130141d9e P cd75a17ab2604397adab03bb8b5fd75c [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7ab4784c7344b939bc36f639286f377 for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
W20260709 13:18:53.761785  8507 log.cc:927] Time spent T 3411566abe2d4c9bb4b2adfdd05e6f17 P b7ab4784c7344b939bc36f639286f377: Append to log took a long time: real 0.306s	user 0.002s	sys 0.000s
I20260709 13:18:53.729497  8360 raft_consensus.cc:515] T 17587d6730594da4a56fa13a353232a1 P b7ab4784c7344b939bc36f639286f377 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
W20260709 13:18:53.840952  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 75661.6us
I20260709 13:18:53.844965  6881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb7fa124c3bf4ef9ab65a407cb008441" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:18:53.842196  6872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09c2a98de1a4decabd0ff900dd44caa" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:18:53.846764  6881 raft_consensus.cc:2468] T bb7fa124c3bf4ef9ab65a407cb008441 P cd75a17ab2604397adab03bb8b5fd75c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 4.
I20260709 13:18:53.847167  6872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4db81d9d329422bb3b4160ca4ac2d1d" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:18:53.758940  6798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce4f062dcd314d43a63ca74067cb5ee3" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 6 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:18:53.860368  6877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5be3a11b23d4ea9b08300a2789821c7" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:18:53.771503  8406 raft_consensus.cc:493] T ab432e62819d499eaaf3dd55481dd930 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:53.854152  6872 raft_consensus.cc:2393] T c4db81d9d329422bb3b4160ca4ac2d1d P cd75a17ab2604397adab03bb8b5fd75c [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate b7ab4784c7344b939bc36f639286f377 in current term 4: Already voted for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in this term.
I20260709 13:18:53.861534  6729 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49744 (request call id 94) took 1013 ms. Trace:
I20260709 13:18:53.865860  6844 leader_election.cc:304] T 20f6842e26174571996b8dea4151d4be P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:18:53.874871  6872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de3186201e1a40d0b335eeb8b4e256e0" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:18:53.868333  6729 rpcz_store.cc:276] 0709 13:18:52.847887 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:52.934248 (+ 86361us) service_pool.cc:224] Handling call
0709 13:18:53.861289 (+927041us) spinlock_profiling.cc:243] Waited 23 ms on lock 0x7b54003b83d4. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f9ae2fa 00007fcc1496fb17 00007fcc0deea6d4 00007fcc0deea662 00007fcc0deea591 00007fcc0deea50c 00007fcc0dee97c2 00007fcc0dce548c 00007fcc0dce48c6 00007fcc0dce426f
0709 13:18:53.861458 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":52964224}
I20260709 13:18:53.875972  6872 raft_consensus.cc:2393] T de3186201e1a40d0b335eeb8b4e256e0 P cd75a17ab2604397adab03bb8b5fd75c [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7ab4784c7344b939bc36f639286f377 in current term 4: Already voted for candidate cd75a17ab2604397adab03bb8b5fd75c in this term.
I20260709 13:18:53.831296  8423 consensus_queue.cc:260] T 7887766dc6784fcaa42b35c05fea7a99 P cd75a17ab2604397adab03bb8b5fd75c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:53.868062  6874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20f6842e26174571996b8dea4151d4be" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:18:53.940659  6881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f9c2e2bf644115957398fe4c9459db" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:18:53.879583  6806 raft_consensus.cc:2393] T 17587d6730594da4a56fa13a353232a1 P b7ab4784c7344b939bc36f639286f377 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in current term 6: Already voted for candidate b7ab4784c7344b939bc36f639286f377 in this term.
I20260709 13:18:53.954783  6881 raft_consensus.cc:3060] T f3f9c2e2bf644115957398fe4c9459db P cd75a17ab2604397adab03bb8b5fd75c [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:18:53.902281  8475 consensus_meta.cc:287] T 3fa34c08b205435dba97346991aa1f92 P ccd8a4c3bfe3413cb2ae219b09aea832: Time spent flushing consensus metadata: real 0.773s	user 0.014s	sys 0.001s
W20260709 13:18:53.938493  8429 consensus_meta.cc:287] T 30e88460611e47b2ba16a46a30b5f416 P cd75a17ab2604397adab03bb8b5fd75c: Time spent flushing consensus metadata: real 0.713s	user 0.011s	sys 0.004s
I20260709 13:18:53.852386  8521 raft_consensus.cc:493] T d8cee0accdb8499c86d4414b72565a38 P cd75a17ab2604397adab03bb8b5fd75c [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:53.965659  7502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17587d6730594da4a56fa13a353232a1" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:18:53.966920  6874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f00a2e87e56452083b759f60d461ee3" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:18:53.834688  8519 raft_consensus.cc:493] T 3a485a995abc4807b6e511e45419f737 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
W20260709 13:18:53.858425  8331 consensus_meta.cc:287] T be1a92657f494cac8dd227d152f50151 P 7ba59cc884714e8aa5f3f0ecaed84cbb: Time spent flushing consensus metadata: real 0.687s	user 0.010s	sys 0.003s
W20260709 13:18:53.948068  6697 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 80639.7us
W20260709 13:18:53.915905  7466 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.650s	user 0.004s	sys 0.006s
W20260709 13:18:53.972327  7466 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.707s	user 0.005s	sys 0.008s
W20260709 13:18:53.972743  7466 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 707432us
W20260709 13:18:53.975149  7466 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:53.913854  6872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77e330a82df4b43a745d57a68f6f057" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:18:53.978940  6872 raft_consensus.cc:2468] T e77e330a82df4b43a745d57a68f6f057 P cd75a17ab2604397adab03bb8b5fd75c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 5.
W20260709 13:18:53.878228  8511 log.cc:927] Time spent T a3022224cc81473690653a83d4e99470 P b7ab4784c7344b939bc36f639286f377: Append to log took a long time: real 0.327s	user 0.002s	sys 0.000s
I20260709 13:18:53.985761  6872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24ee15416e3145beaa1b8183453729a3" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:18:53.968767  6874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f03d0dbf16864ca4bc1bb5e4c0334c0f" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:18:53.869611  8249 raft_consensus.cc:697] T ce4f062dcd314d43a63ca74067cb5ee3 P cd75a17ab2604397adab03bb8b5fd75c [term 5 LEADER]: Becoming Leader. State: Replica: cd75a17ab2604397adab03bb8b5fd75c, State: Running, Role: LEADER
I20260709 13:18:53.887220  8441 leader_election.cc:290] T f03d0dbf16864ca4bc1bb5e4c0334c0f P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:18:53.946009  8530 raft_consensus.cc:3060] T 713b5728a197487c9300b310ab94e5a3 P cd75a17ab2604397adab03bb8b5fd75c [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:18:53.999801  7468 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.712s	user 0.002s	sys 0.016s
I20260709 13:18:53.902644  8495 raft_consensus.cc:493] T 7887766dc6784fcaa42b35c05fea7a99 P b7ab4784c7344b939bc36f639286f377 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:54.003371  6872 raft_consensus.cc:2468] T 24ee15416e3145beaa1b8183453729a3 P cd75a17ab2604397adab03bb8b5fd75c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 4.
I20260709 13:18:53.980367  8450 leader_election.cc:290] T 711ef6523deb4cbe8ef2ba61e1c21c98 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:18:53.989905  6874 raft_consensus.cc:2410] T f03d0dbf16864ca4bc1bb5e4c0334c0f P cd75a17ab2604397adab03bb8b5fd75c [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7ab4784c7344b939bc36f639286f377 for term 5 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
W20260709 13:18:53.911633  8514 log.cc:927] Time spent T bb7fa124c3bf4ef9ab65a407cb008441 P b7ab4784c7344b939bc36f639286f377: Append to log took a long time: real 0.274s	user 0.000s	sys 0.002s
I20260709 13:18:54.022663  6801 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:32976 (request call id 1884) took 2094 ms. Trace:
I20260709 13:18:54.059602  6801 rpcz_store.cc:276] 0709 13:18:51.928082 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:51.928224 (+   142us) service_pool.cc:224] Handling call
0709 13:18:51.941890 (+ 13666us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:51.942319 (+   429us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:51.942351 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:53.731977 (+1789626us) spinlock_profiling.cc:243] Waited 3.34 ms on lock 0x7b2c00117598. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0e2a3a11 00007fcc0e2b3372 00007fcc0f9e5a01 00007fcc0f9aa43a 00007fcc0f9a983e 00007fcc1496e419 00007fcc0dee5bd4 00007fcc0dee5b62 00007fcc0dee5a91 00007fcc0dee5a0c 00007fcc0dee4cc2
0709 13:18:53.732450 (+   473us) log.cc:844] Serialized 26 byte log entry
0709 13:18:53.878239 (+145789us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:18:53.878291 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:53.878382 (+    91us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:54.022171 (+143789us) raft_consensus.cc:1685] finished
0709 13:18:54.022212 (+    41us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:54.022560 (+   348us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":127,"raft.run_cpu_time_us":219,"raft.run_wall_time_us":8864,"spinlock_wait_cycles":7681920,"thread_start_us":132655,"threads_started":1,"wal-append.queue_time_us":274775}
I20260709 13:18:53.878230  8406 raft_consensus.cc:515] T ab432e62819d499eaaf3dd55481dd930 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:54.023949  6875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8292e16e5654be6bc408560cf256aaa" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
W20260709 13:18:54.024421  7468 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.737s	user 0.003s	sys 0.016s
I20260709 13:18:54.030423  6881 raft_consensus.cc:2410] T f3f9c2e2bf644115957398fe4c9459db P cd75a17ab2604397adab03bb8b5fd75c [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate b7ab4784c7344b939bc36f639286f377 for term 4 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:18:54.052350  6872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "711ef6523deb4cbe8ef2ba61e1c21c98" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:18:53.956606  8472 consensus_queue.cc:1048] T d33d5ee8ef6f415593d8df52063161ad P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.029s
I20260709 13:18:53.987327  8423 raft_consensus.cc:3060] T 7887766dc6784fcaa42b35c05fea7a99 P cd75a17ab2604397adab03bb8b5fd75c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:54.062352  6874 raft_consensus.cc:1275] T ab432e62819d499eaaf3dd55481dd930 P cd75a17ab2604397adab03bb8b5fd75c [term 4 FOLLOWER]: Refusing update from remote peer b7ab4784c7344b939bc36f639286f377: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 2. (term mismatch)
I20260709 13:18:53.983181  8416 raft_consensus.cc:2749] T 20f6842e26174571996b8dea4151d4be P cd75a17ab2604397adab03bb8b5fd75c [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:18:54.057154  6879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22ccee1b570c4ad3a57bd7aec085b1b4" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:18:53.956805  8475 raft_consensus.cc:515] T 3fa34c08b205435dba97346991aa1f92 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:18:53.971202  8429 raft_consensus.cc:515] T 30e88460611e47b2ba16a46a30b5f416 P cd75a17ab2604397adab03bb8b5fd75c [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:54.075342  6874 pending_rounds.cc:85] T ab432e62819d499eaaf3dd55481dd930 P cd75a17ab2604397adab03bb8b5fd75c: Aborting all ops after (but not including) 1
I20260709 13:18:54.078590  6879 raft_consensus.cc:2393] T 22ccee1b570c4ad3a57bd7aec085b1b4 P cd75a17ab2604397adab03bb8b5fd75c [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7ab4784c7344b939bc36f639286f377 in current term 4: Already voted for candidate cd75a17ab2604397adab03bb8b5fd75c in this term.
W20260709 13:18:54.081002  7468 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:54.084815  6874 pending_rounds.cc:107] T ab432e62819d499eaaf3dd55481dd930 P cd75a17ab2604397adab03bb8b5fd75c: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 13:18:54.085232  6874 raft_consensus.cc:2889] T ab432e62819d499eaaf3dd55481dd930 P cd75a17ab2604397adab03bb8b5fd75c [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:18:54.082497  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 226432us
I20260709 13:18:54.087853  6881 raft_consensus.cc:1275] T 9b3759de40694069b13c0f8bd40e5709 P cd75a17ab2604397adab03bb8b5fd75c [term 4 FOLLOWER]: Refusing update from remote peer ccd8a4c3bfe3413cb2ae219b09aea832: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:18:54.088971  6872 raft_consensus.cc:1275] T f4b8bd455d5a47c18a1380839c6e0d61 P cd75a17ab2604397adab03bb8b5fd75c [term 3 FOLLOWER]: Refusing update from remote peer ccd8a4c3bfe3413cb2ae219b09aea832: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:18:53.983501  8521 raft_consensus.cc:515] T d8cee0accdb8499c86d4414b72565a38 P cd75a17ab2604397adab03bb8b5fd75c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:18:54.121440  6801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4db81d9d329422bb3b4160ca4ac2d1d" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:18:54.122710  6801 raft_consensus.cc:2393] T c4db81d9d329422bb3b4160ca4ac2d1d P b7ab4784c7344b939bc36f639286f377 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c in current term 4: Already voted for candidate b7ab4784c7344b939bc36f639286f377 in this term.
I20260709 13:18:54.085798  8440 raft_consensus.cc:493] T 7c44c4849aa54f2b94d1f1bef9ed546f P b7ab4784c7344b939bc36f639286f377 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:54.135805  6873 raft_consensus.cc:1240] T 30e88460611e47b2ba16a46a30b5f416 P cd75a17ab2604397adab03bb8b5fd75c [term 3 FOLLOWER]: Rejecting Update request from peer ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 2. Current term is 3. Ops: []
I20260709 13:18:54.114033  6770 leader_election.cc:304] T f5be3a11b23d4ea9b08300a2789821c7 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
I20260709 13:18:54.142763  7497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f00a2e87e56452083b759f60d461ee3" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:18:54.150849  8443 leader_election.cc:290] T 4d9def8b32fd443aa94ab1420b06837b P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 4 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
W20260709 13:18:54.151894  6845 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:54.152532  6847 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:54.154397  6803 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:32976 (request call id 1911) took 1814 ms. Trace:
W20260709 13:18:54.155144  8419 consensus_meta.cc:287] T f5be3a11b23d4ea9b08300a2789821c7 P cd75a17ab2604397adab03bb8b5fd75c: Time spent flushing consensus metadata: real 0.985s	user 0.010s	sys 0.002s
I20260709 13:18:54.156281  8538 raft_consensus.cc:493] T 711ef6523deb4cbe8ef2ba61e1c21c98 P b7ab4784c7344b939bc36f639286f377 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:53.991075  8519 raft_consensus.cc:515] T 3a485a995abc4807b6e511e45419f737 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:54.091096  7496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb7fa124c3bf4ef9ab65a407cb008441" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:18:54.142850  6802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d33d5ee8ef6f415593d8df52063161ad" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:18:54.098382  8331 raft_consensus.cc:493] T 1528ab62b6fe4e3099d08f141afee116 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:54.163450  6805 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50550 (request call id 113) took 1145 ms. Trace:
W20260709 13:18:54.135699  8512 log.cc:927] Time spent T 427c124d773f483294511e80fe340075 P b7ab4784c7344b939bc36f639286f377: Append to log took a long time: real 0.303s	user 0.001s	sys 0.001s
W20260709 13:18:54.140172  8515 log.cc:927] Time spent T 90d42e216d9741e190bca19a781291fd P ccd8a4c3bfe3413cb2ae219b09aea832: Append to log took a long time: real 0.287s	user 0.000s	sys 0.001s
I20260709 13:18:54.154826  6803 rpcz_store.cc:276] 0709 13:18:52.339959 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:52.838359 (+498400us) service_pool.cc:224] Handling call
0709 13:18:52.858821 (+ 20462us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:52.970312 (+111491us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:54.154076 (+1183764us) spinlock_profiling.cc:243] Waited 111 ms on lock 0x7b54001a31d4. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f9aae01 00007fcc0f9a983e 00007fcc1496e419 00007fcc0dee5bd4 00007fcc0dee5b62 00007fcc0dee5a91 00007fcc0dee5a0c 00007fcc0dee4cc2 00007fcc0dce548c 00007fcc0dce48c6
0709 13:18:54.154328 (+   252us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":254181760}
I20260709 13:18:54.172552  8443 consensus_queue.cc:1048] T ab432e62819d499eaaf3dd55481dd930 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:18:54.173062  8467 raft_consensus.cc:2804] T f5be3a11b23d4ea9b08300a2789821c7 P b7ab4784c7344b939bc36f639286f377 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:18:54.167264  6805 rpcz_store.cc:276] 0709 13:18:53.018557 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:53.054717 (+ 36160us) service_pool.cc:224] Handling call
0709 13:18:53.080461 (+ 25744us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:53.097972 (+ 17511us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:53.097998 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:53.154732 (+ 56734us) log.cc:844] Serialized 26 byte log entry
0709 13:18:53.296358 (+141626us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:18:53.296418 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:53.296514 (+    96us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:54.163074 (+866560us) raft_consensus.cc:1685] finished
0709 13:18:54.163109 (+    35us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:54.163347 (+   238us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":50572,"raft.queue_time_us":9956,"raft.run_cpu_time_us":166,"raft.run_wall_time_us":11309,"thread_start_us":56393,"threads_started":1,"wal-append.queue_time_us":268415}
I20260709 13:18:54.138902  8360 leader_election.cc:290] T 17587d6730594da4a56fa13a353232a1 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 6 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:18:54.062695  8495 raft_consensus.cc:515] T 7887766dc6784fcaa42b35c05fea7a99 P b7ab4784c7344b939bc36f639286f377 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:54.180814  8521 leader_election.cc:290] T d8cee0accdb8499c86d4414b72565a38 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:18:54.182053  6801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ba5dac66ab5497e9e336f2a3c28cda5" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:18:54.182754  6877 raft_consensus.cc:2468] T f5be3a11b23d4ea9b08300a2789821c7 P cd75a17ab2604397adab03bb8b5fd75c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 4.
W20260709 13:18:54.184957  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 85770.2us
I20260709 13:18:54.202054  6844 leader_election.cc:304] T 3411566abe2d4c9bb4b2adfdd05e6f17 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:18:54.192140  6807 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:32976 (request call id 1922) took 1150 ms. Trace:
I20260709 13:18:54.203200  6807 rpcz_store.cc:276] 0709 13:18:53.041331 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:53.184666 (+143335us) service_pool.cc:224] Handling call
0709 13:18:53.185056 (+   390us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:18:53.185498 (+   442us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:53.185532 (+    34us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:18:53.186205 (+   673us) log.cc:844] Serialized 52 byte log entry
0709 13:18:53.270988 (+ 84783us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:18:53.271061 (+    73us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:53.271163 (+   102us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:54.191787 (+920624us) raft_consensus.cc:1685] finished
0709 13:18:54.191823 (+    36us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:54.192010 (+   187us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1883,"raft.run_cpu_time_us":230,"raft.run_wall_time_us":26796,"thread_start_us":74861,"threads_started":1,"wal-append.queue_time_us":114815}
I20260709 13:18:54.115443  8441 raft_consensus.cc:493] T be1a92657f494cac8dd227d152f50151 P b7ab4784c7344b939bc36f639286f377 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 7ba59cc884714e8aa5f3f0ecaed84cbb)
I20260709 13:18:54.206760  6803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb7fa124c3bf4ef9ab65a407cb008441" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:18:54.208161  6802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "427c124d773f483294511e80fe340075" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:18:54.219769  6807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "853ac0a8cbd64ce99457f170216d4d0f" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:18:54.191174  8467 raft_consensus.cc:493] T f5be3a11b23d4ea9b08300a2789821c7 P b7ab4784c7344b939bc36f639286f377 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:54.229271  6807 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:32966 (request call id 554) took 1001 ms. Trace:
I20260709 13:18:54.243189  6807 rpcz_store.cc:276] 0709 13:18:53.227936 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:54.205366 (+977430us) service_pool.cc:224] Handling call
0709 13:18:54.229199 (+ 23833us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:54.244961  6807 raft_consensus.cc:1217] T 7ba5dac66ab5497e9e336f2a3c28cda5 P b7ab4784c7344b939bc36f639286f377 [term 4 FOLLOWER]: Deduplicated request from leader. Original: 1.4->[3.5-3.5]   Dedup: 3.5->[]
I20260709 13:18:54.245748  6807 raft_consensus.cc:1240] T 7ba5dac66ab5497e9e336f2a3c28cda5 P b7ab4784c7344b939bc36f639286f377 [term 4 FOLLOWER]: Rejecting Update request from peer cd75a17ab2604397adab03bb8b5fd75c for earlier term 3. Current term is 4. Ops: [3.5-3.5]
I20260709 13:18:54.164430  8440 raft_consensus.cc:515] T 7c44c4849aa54f2b94d1f1bef9ed546f P b7ab4784c7344b939bc36f639286f377 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:54.241837  6801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3022224cc81473690653a83d4e99470" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:18:54.258255  6801 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:32966 (request call id 546) took 1033 ms. Trace:
I20260709 13:18:54.258651  6801 rpcz_store.cc:276] 0709 13:18:53.224841 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:54.199775 (+974934us) service_pool.cc:224] Handling call
0709 13:18:54.258181 (+ 58406us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:54.254470  6803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbdf895bba214ff68685a24fd17dfb5d" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:18:54.236974  7468 leader_election.cc:304] T fe20b4b48823486ca3b9c648db6ce8aa P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:18:54.199267  8465 raft_consensus.cc:493] T f58dc08b12a2494bb9a1372837970ca2 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:54.262394  6807 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:32966 (request call id 542) took 1027 ms. Trace:
I20260709 13:18:54.270864  6807 rpcz_store.cc:276] 0709 13:18:53.219403 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:54.244259 (+1024856us) service_pool.cc:224] Handling call
0709 13:18:54.244744 (+   485us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:54.246160 (+  1416us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:54.246432 (+   272us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:54.272531  6807 raft_consensus.cc:1240] T 3d65025eea89441290d85dd053810e31 P b7ab4784c7344b939bc36f639286f377 [term 2 FOLLOWER]: Rejecting Update request from peer cd75a17ab2604397adab03bb8b5fd75c for earlier term 1. Current term is 2. Ops: []
I20260709 13:18:54.272953  6805 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50550 (request call id 115) took 1130 ms. Trace:
I20260709 13:18:54.273434  6805 rpcz_store.cc:276] 0709 13:18:53.143043 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:54.219714 (+1076671us) service_pool.cc:224] Handling call
0709 13:18:54.272351 (+ 52637us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:54.272544 (+   193us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:54.272586 (+    42us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:54.272632 (+    46us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:18:54.272676 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:54.272740 (+    64us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:54.272888 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:54.266259  6803 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:32966 (request call id 548) took 1040 ms. Trace:
I20260709 13:18:54.275760  6803 rpcz_store.cc:276] 0709 13:18:53.225334 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:54.213129 (+987795us) service_pool.cc:224] Handling call
0709 13:18:54.266166 (+ 53037us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:54.177415  8538 raft_consensus.cc:515] T 711ef6523deb4cbe8ef2ba61e1c21c98 P b7ab4784c7344b939bc36f639286f377 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:54.212942  8534 raft_consensus.cc:493] T 427c124d773f483294511e80fe340075 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:18:54.249112  6844 leader_election.cc:304] T 90d42e216d9741e190bca19a781291fd P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:18:54.278512  6807 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:32966 (request call id 544) took 1058 ms. Trace:
I20260709 13:18:54.278927  6807 rpcz_store.cc:276] 0709 13:18:53.219884 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:54.271876 (+1051992us) service_pool.cc:224] Handling call
0709 13:18:54.272308 (+   432us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:54.272968 (+   660us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:54.278441 (+  5473us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:54.228886  8521 raft_consensus.cc:2804] T 3411566abe2d4c9bb4b2adfdd05e6f17 P cd75a17ab2604397adab03bb8b5fd75c [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:18:54.183954  8331 raft_consensus.cc:515] T 1528ab62b6fe4e3099d08f141afee116 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } attrs { replace: true } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:18:54.256094  8467 raft_consensus.cc:3060] T f5be3a11b23d4ea9b08300a2789821c7 P b7ab4784c7344b939bc36f639286f377 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:54.288013  6844 leader_election.cc:304] T de3186201e1a40d0b335eeb8b4e256e0 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:18:54.294533  6803 raft_consensus.cc:1240] T d8292e16e5654be6bc408560cf256aaa P b7ab4784c7344b939bc36f639286f377 [term 5 FOLLOWER]: Rejecting Update request from peer cd75a17ab2604397adab03bb8b5fd75c for earlier term 4. Current term is 5. Ops: []
I20260709 13:18:54.163333  8249 consensus_queue.cc:237] T ce4f062dcd314d43a63ca74067cb5ee3 P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.4, Last appended by leader: 4, Current term: 5, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } attrs { replace: true } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:18:54.297290  6803 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:32966 (request call id 555) took 1069 ms. Trace:
I20260709 13:18:54.297821  6803 rpcz_store.cc:276] 0709 13:18:53.228207 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:54.276739 (+1048532us) service_pool.cc:224] Handling call
0709 13:18:54.294325 (+ 17586us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:54.296990 (+  2665us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:54.297224 (+   234us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:54.278198  8257 raft_consensus.cc:493] T 3411566abe2d4c9bb4b2adfdd05e6f17 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:54.289976  8280 consensus_meta.cc:287] T 7c37d41cd9164c15a6826ca62a851a69 P b7ab4784c7344b939bc36f639286f377: Time spent flushing consensus metadata: real 1.015s	user 0.012s	sys 0.005s
I20260709 13:18:54.293546  6726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e326172347f45e99a0d482b5d8ef768" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:18:54.328439  6726 raft_consensus.cc:2468] T 9e326172347f45e99a0d482b5d8ef768 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 3.
I20260709 13:18:54.329803  6726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab432e62819d499eaaf3dd55481dd930" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:18:54.330495  6726 raft_consensus.cc:2468] T ab432e62819d499eaaf3dd55481dd930 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 4.
I20260709 13:18:54.331138  8538 leader_election.cc:290] T 711ef6523deb4cbe8ef2ba61e1c21c98 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:18:54.331529  6726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22ccee1b570c4ad3a57bd7aec085b1b4" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:18:54.230258  8441 raft_consensus.cc:515] T be1a92657f494cac8dd227d152f50151 P b7ab4784c7344b939bc36f639286f377 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:18:54.332518  8429 leader_election.cc:290] T 30e88460611e47b2ba16a46a30b5f416 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 3 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:18:54.333176  8429 raft_consensus.cc:2749] T de3186201e1a40d0b335eeb8b4e256e0 P cd75a17ab2604397adab03bb8b5fd75c [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:18:54.333685  8441 leader_election.cc:290] T be1a92657f494cac8dd227d152f50151 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:18:54.333989  8429 raft_consensus.cc:493] T 9b3759de40694069b13c0f8bd40e5709 P cd75a17ab2604397adab03bb8b5fd75c [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:54.334475  8429 raft_consensus.cc:515] T 9b3759de40694069b13c0f8bd40e5709 P cd75a17ab2604397adab03bb8b5fd75c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:54.335481  6876 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53416 (request call id 1976) took 1111 ms. Trace:
I20260709 13:18:54.335855  6876 rpcz_store.cc:276] 0709 13:18:53.224450 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:53.452209 (+227759us) service_pool.cc:224] Handling call
0709 13:18:53.491098 (+ 38889us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:18:53.842215 (+351117us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:53.842261 (+    46us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:18:53.870550 (+ 28289us) log.cc:844] Serialized 52 byte log entry
0709 13:18:54.057810 (+187260us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:18:54.078952 (+ 21142us) log.cc:844] Serialized 14 byte log entry
0709 13:18:54.097840 (+ 18888us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:54.097924 (+    84us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:54.335224 (+237300us) raft_consensus.cc:1685] finished
0709 13:18:54.335256 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:54.335418 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":31648,"prepare.queue_time_us":25427,"prepare.run_cpu_time_us":51,"prepare.run_wall_time_us":51,"raft.queue_time_us":330457,"raft.run_cpu_time_us":624,"raft.run_wall_time_us":92241,"spinlock_wait_cycles":39559808,"thread_start_us":437449,"threads_started":2,"wal-append.queue_time_us":307806}
I20260709 13:18:54.338075  8331 leader_election.cc:290] T 1528ab62b6fe4e3099d08f141afee116 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:18:54.338640  8331 raft_consensus.cc:2749] T fe20b4b48823486ca3b9c648db6ce8aa P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:54.283325  8521 raft_consensus.cc:493] T 3411566abe2d4c9bb4b2adfdd05e6f17 P cd75a17ab2604397adab03bb8b5fd75c [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:54.280829  8419 raft_consensus.cc:2749] T 90d42e216d9741e190bca19a781291fd P cd75a17ab2604397adab03bb8b5fd75c [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:18:54.310894  7993 raft_consensus.cc:3055] T 20f6842e26174571996b8dea4151d4be P ccd8a4c3bfe3413cb2ae219b09aea832 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:18:54.313238  8257 raft_consensus.cc:515] T 3411566abe2d4c9bb4b2adfdd05e6f17 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:54.315411  8495 leader_election.cc:290] T 7887766dc6784fcaa42b35c05fea7a99 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:18:54.316118  8406 leader_election.cc:290] T ab432e62819d499eaaf3dd55481dd930 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
W20260709 13:18:54.318162  8356 consensus_meta.cc:287] T e77e330a82df4b43a745d57a68f6f057 P ccd8a4c3bfe3413cb2ae219b09aea832: Time spent flushing consensus metadata: real 0.697s	user 0.012s	sys 0.000s
I20260709 13:18:54.291503  8534 raft_consensus.cc:515] T 427c124d773f483294511e80fe340075 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } attrs { replace: true } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:18:54.286908  8465 raft_consensus.cc:515] T f58dc08b12a2494bb9a1372837970ca2 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
W20260709 13:18:54.319079  8516 log.cc:927] Time spent T d33d5ee8ef6f415593d8df52063161ad P b7ab4784c7344b939bc36f639286f377: Append to log took a long time: real 0.388s	user 0.000s	sys 0.002s
W20260709 13:18:54.319360  8524 log.cc:927] Time spent T 8c7f33e544204fbaac4078e3e83bbf4e P ccd8a4c3bfe3413cb2ae219b09aea832: Append to log took a long time: real 0.338s	user 0.000s	sys 0.002s
I20260709 13:18:54.324378  6725 raft_consensus.cc:1240] T 7887766dc6784fcaa42b35c05fea7a99 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 3 FOLLOWER]: Rejecting Update request from peer cd75a17ab2604397adab03bb8b5fd75c for earlier term 2. Current term is 3. Ops: []
I20260709 13:18:54.325139  8475 leader_election.cc:290] T 3fa34c08b205435dba97346991aa1f92 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 5 election: Requested vote from peers cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:18:54.327356  8541 raft_consensus.cc:493] T d8cee0accdb8499c86d4414b72565a38 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:18:54.280460  6798 raft_consensus.cc:2468] T ce4f062dcd314d43a63ca74067cb5ee3 P b7ab4784c7344b939bc36f639286f377 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 5.
I20260709 13:18:54.280753  8416 raft_consensus.cc:493] T bd6869f07b5a4885a0b99fbe60c3b175 P cd75a17ab2604397adab03bb8b5fd75c [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:18:54.342226  6800 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:32976 (request call id 1926) took 1286 ms. Trace:
W20260709 13:18:54.363514  8539 log.cc:927] Time spent T dbdf895bba214ff68685a24fd17dfb5d P cd75a17ab2604397adab03bb8b5fd75c: Append to log took a long time: real 0.132s	user 0.000s	sys 0.001s
I20260709 13:18:54.361330  6800 rpcz_store.cc:276] 0709 13:18:53.056261 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:53.206556 (+150295us) service_pool.cc:224] Handling call
0709 13:18:53.207141 (+   585us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:18:53.208431 (+  1290us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:53.208464 (+    33us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:18:53.209572 (+  1108us) log.cc:844] Serialized 582 byte log entry
0709 13:18:53.277995 (+ 68423us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:18:53.278040 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:53.278117 (+    77us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:54.341846 (+1063729us) raft_consensus.cc:1685] finished
0709 13:18:54.341879 (+    33us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:54.342128 (+   249us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":537,"spinlock_wait_cycles":23990656,"thread_start_us":67993,"threads_started":1,"wal-append.queue_time_us":254802}
I20260709 13:18:54.346339  6872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab432e62819d499eaaf3dd55481dd930" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:18:54.345968  6876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fa34c08b205435dba97346991aa1f92" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:18:54.393641  6872 raft_consensus.cc:2468] T ab432e62819d499eaaf3dd55481dd930 P cd75a17ab2604397adab03bb8b5fd75c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 4.
I20260709 13:18:54.354259  6804 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:32976 (request call id 1923) took 1312 ms. Trace:
I20260709 13:18:54.401932  6804 rpcz_store.cc:276] 0709 13:18:53.041607 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:53.187048 (+145441us) service_pool.cc:224] Handling call
0709 13:18:53.188715 (+  1667us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:53.189072 (+   357us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:53.189103 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:53.196605 (+  7502us) log.cc:844] Serialized 26 byte log entry
0709 13:18:53.650325 (+453720us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:18:53.650384 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:53.650488 (+   104us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:54.353976 (+703488us) raft_consensus.cc:1685] finished
0709 13:18:54.354001 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:54.354188 (+   187us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":467,"raft.run_cpu_time_us":182,"raft.run_wall_time_us":24011,"thread_start_us":387488,"threads_started":1,"wal-append.queue_time_us":486991}
I20260709 13:18:54.356990  8541 raft_consensus.cc:515] T d8cee0accdb8499c86d4414b72565a38 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:18:54.406560  8541 leader_election.cc:290] T d8cee0accdb8499c86d4414b72565a38 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:18:54.340024  8280 raft_consensus.cc:515] T 7c37d41cd9164c15a6826ca62a851a69 P b7ab4784c7344b939bc36f639286f377 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:54.411463  8280 leader_election.cc:290] T 7c37d41cd9164c15a6826ca62a851a69 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 4 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:18:54.359959  8530 raft_consensus.cc:2749] T 713b5728a197487c9300b310ab94e5a3 P cd75a17ab2604397adab03bb8b5fd75c [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:18:54.413785  8382 consensus_meta.cc:287] T 404190ce4ce94cecbfcb6ea9d1dd8626 P 7ba59cc884714e8aa5f3f0ecaed84cbb: Time spent flushing consensus metadata: real 0.806s	user 0.013s	sys 0.000s
I20260709 13:18:54.414594  8382 raft_consensus.cc:515] T 404190ce4ce94cecbfcb6ea9d1dd8626 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:18:54.365093  6726 raft_consensus.cc:3060] T 22ccee1b570c4ad3a57bd7aec085b1b4 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:54.349507  7993 raft_consensus.cc:740] T 20f6842e26174571996b8dea4151d4be P ccd8a4c3bfe3413cb2ae219b09aea832 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
I20260709 13:18:54.397351  6876 raft_consensus.cc:3060] T 3fa34c08b205435dba97346991aa1f92 P cd75a17ab2604397adab03bb8b5fd75c [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:18:54.349349  8100 consensus_meta.cc:287] T 95a75bfe094d4bdc963aba3f08dfcd25 P ccd8a4c3bfe3413cb2ae219b09aea832: Time spent flushing consensus metadata: real 0.809s	user 0.013s	sys 0.000s
I20260709 13:18:54.347198  8520 consensus_queue.cc:1048] T 44bde925b2e541b69890d70715b85176 P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.210s
I20260709 13:18:54.420758  8100 raft_consensus.cc:515] T 95a75bfe094d4bdc963aba3f08dfcd25 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:54.346928  8519 leader_election.cc:290] T 3a485a995abc4807b6e511e45419f737 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:18:54.352828  8534 leader_election.cc:290] T 427c124d773f483294511e80fe340075 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:18:54.341207  8440 leader_election.cc:290] T 7c44c4849aa54f2b94d1f1bef9ed546f P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:18:54.347438  8521 raft_consensus.cc:3060] T 3411566abe2d4c9bb4b2adfdd05e6f17 P cd75a17ab2604397adab03bb8b5fd75c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:54.355299  6727 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50004 (request call id 1144) took 1120 ms. Trace:
I20260709 13:18:54.425905  6727 rpcz_store.cc:276] 0709 13:18:53.234430 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:53.234576 (+   146us) service_pool.cc:224] Handling call
0709 13:18:53.236430 (+  1854us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:53.261751 (+ 25321us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:53.261789 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:53.283012 (+ 21223us) log.cc:844] Serialized 26 byte log entry
0709 13:18:53.658055 (+375043us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:18:53.658109 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:53.658206 (+    97us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:54.355008 (+696802us) raft_consensus.cc:1685] finished
0709 13:18:54.355038 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:54.355218 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":10832,"raft.queue_time_us":19287,"raft.run_cpu_time_us":248,"raft.run_wall_time_us":5567,"thread_start_us":206872,"threads_started":1,"wal-append.queue_time_us":436088}
I20260709 13:18:54.355521  8356 raft_consensus.cc:515] T e77e330a82df4b43a745d57a68f6f057 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } }
W20260709 13:18:54.429559  8518 log.cc:927] Time spent T 404190ce4ce94cecbfcb6ea9d1dd8626 P ccd8a4c3bfe3413cb2ae219b09aea832: Append to log took a long time: real 0.498s	user 0.004s	sys 0.000s
I20260709 13:18:54.431634  6731 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50004 (request call id 1150) took 1181 ms. Trace:
I20260709 13:18:54.432549  7498 raft_consensus.cc:1240] T 404190ce4ce94cecbfcb6ea9d1dd8626 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 5 FOLLOWER]: Rejecting Update request from peer b7ab4784c7344b939bc36f639286f377 for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 13:18:54.355480  6725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "427c124d773f483294511e80fe340075" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:18:54.432340  6731 rpcz_store.cc:276] 0709 13:18:53.249786 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:53.261921 (+ 12135us) service_pool.cc:224] Handling call
0709 13:18:53.262380 (+   459us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:53.264403 (+  2023us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:53.264435 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:53.271581 (+  7146us) log.cc:844] Serialized 26 byte log entry
0709 13:18:53.727153 (+455572us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:18:53.727192 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:53.727294 (+   102us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:54.401334 (+674040us) spinlock_profiling.cc:243] Waited 7.21 ms on lock 0x7b4400022b4c. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0c745db1 00007fcc0c7e3c85 00007fcc0c7e46a2 00007fcc0f5561db 00007fcc0f551aaf 00007fcc0f54586e 00007fcc0f544bb6 00007fcc0f5447d8 00007fcc0f54e221 00007fcc0f54e1d9 00007fcc0f54e169
0709 13:18:54.431180 (+ 29846us) raft_consensus.cc:1685] finished
0709 13:18:54.431208 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:54.431539 (+   331us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":16217,"raft.queue_time_us":4430,"raft.run_cpu_time_us":177,"raft.run_wall_time_us":13025,"spinlock_wait_cycles":16589568,"thread_start_us":280357,"threads_started":1,"wal-append.queue_time_us":539716}
I20260709 13:18:54.435452  6730 raft_consensus.cc:2393] T e77e330a82df4b43a745d57a68f6f057 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7ab4784c7344b939bc36f639286f377 in current term 6: Already voted for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in this term.
I20260709 13:18:54.435353  6725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1528ab62b6fe4e3099d08f141afee116" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:18:54.351248  8257 leader_election.cc:290] T 3411566abe2d4c9bb4b2adfdd05e6f17 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:18:54.357483  8416 raft_consensus.cc:515] T bd6869f07b5a4885a0b99fbe60c3b175 P cd75a17ab2604397adab03bb8b5fd75c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:54.441910  7503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24ee15416e3145beaa1b8183453729a3" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:18:54.442344  8416 leader_election.cc:290] T bd6869f07b5a4885a0b99fbe60c3b175 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:18:54.348765  7497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fa34c08b205435dba97346991aa1f92" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb"
I20260709 13:18:54.445312  7497 raft_consensus.cc:3060] T 3fa34c08b205435dba97346991aa1f92 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:54.449633  6728 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50004 (request call id 1149) took 1200 ms. Trace:
I20260709 13:18:54.452777  6876 raft_consensus.cc:2468] T 3fa34c08b205435dba97346991aa1f92 P cd75a17ab2604397adab03bb8b5fd75c [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 5.
I20260709 13:18:54.419277  7993 consensus_queue.cc:260] T 20f6842e26174571996b8dea4151d4be P ccd8a4c3bfe3413cb2ae219b09aea832 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:54.456800  6727 raft_consensus.cc:1240] T 95a75bfe094d4bdc963aba3f08dfcd25 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 5 FOLLOWER]: Rejecting Update request from peer cd75a17ab2604397adab03bb8b5fd75c for earlier term 4. Current term is 5. Ops: []
I20260709 13:18:54.457865  6725 raft_consensus.cc:2468] T 1528ab62b6fe4e3099d08f141afee116 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in term 4.
I20260709 13:18:54.460453  8382 leader_election.cc:290] T 404190ce4ce94cecbfcb6ea9d1dd8626 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 5 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:18:54.464215  8356 leader_election.cc:290] T e77e330a82df4b43a745d57a68f6f057 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 6 election: Requested vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:18:54.396899  6879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f58dc08b12a2494bb9a1372837970ca2" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:18:54.474138  6731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4b8bd455d5a47c18a1380839c6e0d61" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
W20260709 13:18:54.395498  7468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 158873us
I20260709 13:18:54.481581  6872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3411566abe2d4c9bb4b2adfdd05e6f17" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
W20260709 13:18:54.488792  7466 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:54.489557  6876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a485a995abc4807b6e511e45419f737" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:18:54.466509  6728 rpcz_store.cc:276] 0709 13:18:53.248886 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:53.259616 (+ 10730us) service_pool.cc:224] Handling call
0709 13:18:53.259930 (+   314us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:53.260185 (+   255us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:18:53.273637 (+ 13452us) log.cc:844] Serialized 14 byte log entry
0709 13:18:54.439163 (+1165526us) spinlock_profiling.cc:243] Waited 1.27 ms on lock 0x7b18003418c0. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc15785de1 00007fcc157925b1 00007fcc0f5524bc 00007fcc0c8a048b 00007fcc156faab9 00007fcc0c8bc69b 00007fcc0c8ba93f 00007fcc0c8ba455 00007fcc0f9a2060 00007fcc0f9b4716 00007fcc0f9c5287
0709 13:18:54.439329 (+   166us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:54.449090 (+  9761us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:18:54.449202 (+   112us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:54.449320 (+   118us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:54.449536 (+   216us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7914,"prepare.queue_time_us":21267,"prepare.run_cpu_time_us":50,"prepare.run_wall_time_us":52,"raft.queue_time_us":78267,"raft.run_cpu_time_us":185,"raft.run_wall_time_us":13938,"spinlock_wait_cycles":2915584,"thread_start_us":468496,"threads_started":2,"wal-append.queue_time_us":470565}
I20260709 13:18:54.353979  8465 leader_election.cc:290] T f58dc08b12a2494bb9a1372837970ca2 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:18:54.532994  6727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "404190ce4ce94cecbfcb6ea9d1dd8626" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:18:54.650913  6728 raft_consensus.cc:1275] T 711ef6523deb4cbe8ef2ba61e1c21c98 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 4 FOLLOWER]: Refusing update from remote peer cd75a17ab2604397adab03bb8b5fd75c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:18:54.652287  6731 raft_consensus.cc:1275] T 7c37d41cd9164c15a6826ca62a851a69 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 3 FOLLOWER]: Refusing update from remote peer cd75a17ab2604397adab03bb8b5fd75c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 13:18:54.653838  6847 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:54.480237  8100 leader_election.cc:290] T 95a75bfe094d4bdc963aba3f08dfcd25 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 5 election: Requested vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
W20260709 13:18:54.563750  6845 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:54.590025  8429 leader_election.cc:290] T 9b3759de40694069b13c0f8bd40e5709 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
W20260709 13:18:54.565006  6770 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 451065us
I20260709 13:18:54.659165  6770 leader_election.cc:304] T 22ccee1b570c4ad3a57bd7aec085b1b4 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
I20260709 13:18:54.655975  7468 leader_election.cc:304] T 3fa34c08b205435dba97346991aa1f92 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:18:54.659998  6881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d9def8b32fd443aa94ab1420b06837b" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
W20260709 13:18:54.657991  6696 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:54.668490  6804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09c2a98de1a4decabd0ff900dd44caa" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:18:54.669214  6804 raft_consensus.cc:2376] T f09c2a98de1a4decabd0ff900dd44caa P b7ab4784c7344b939bc36f639286f377 [term 4 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 4. Re-sending same reply.
I20260709 13:18:54.670327  6804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e326172347f45e99a0d482b5d8ef768" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:18:54.671514  6804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab432e62819d499eaaf3dd55481dd930" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:18:54.672405  6800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77e330a82df4b43a745d57a68f6f057" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:18:54.643389  6725 raft_consensus.cc:1275] T a1704639a875409b9959353527b3fd68 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 4 FOLLOWER]: Refusing update from remote peer cd75a17ab2604397adab03bb8b5fd75c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:18:54.673151  6800 raft_consensus.cc:2376] T e77e330a82df4b43a745d57a68f6f057 P b7ab4784c7344b939bc36f639286f377 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 5. Re-sending same reply.
I20260709 13:18:54.674093  6800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22ccee1b570c4ad3a57bd7aec085b1b4" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:18:54.674634  6800 raft_consensus.cc:3060] T 22ccee1b570c4ad3a57bd7aec085b1b4 P b7ab4784c7344b939bc36f639286f377 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:54.661586  8382 consensus_queue.cc:1048] T bb7fa124c3bf4ef9ab65a407cb008441 P 7ba59cc884714e8aa5f3f0ecaed84cbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.014s
I20260709 13:18:54.676271  8462 raft_consensus.cc:493] T 30e88460611e47b2ba16a46a30b5f416 P b7ab4784c7344b939bc36f639286f377 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:18:54.672521  6805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bf4668eeb70467fb3dc5a0289233b3c" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:18:54.677316  6881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "711ef6523deb4cbe8ef2ba61e1c21c98" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:18:54.677228  8462 raft_consensus.cc:515] T 30e88460611e47b2ba16a46a30b5f416 P b7ab4784c7344b939bc36f639286f377 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:54.677845  6805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8cee0accdb8499c86d4414b72565a38" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 6 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:18:54.679008  6805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4b8bd455d5a47c18a1380839c6e0d61" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:18:54.646945  6726 raft_consensus.cc:2468] T 22ccee1b570c4ad3a57bd7aec085b1b4 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 4.
I20260709 13:18:54.684206  6805 raft_consensus.cc:2393] T f4b8bd455d5a47c18a1380839c6e0d61 P b7ab4784c7344b939bc36f639286f377 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c in current term 3: Already voted for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in this term.
I20260709 13:18:54.683511  6876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77e330a82df4b43a745d57a68f6f057" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:18:54.685585  6876 raft_consensus.cc:3060] T e77e330a82df4b43a745d57a68f6f057 P cd75a17ab2604397adab03bb8b5fd75c [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:54.345458  8467 raft_consensus.cc:515] T f5be3a11b23d4ea9b08300a2789821c7 P b7ab4784c7344b939bc36f639286f377 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:54.661314  8465 raft_consensus.cc:493] T bd6869f07b5a4885a0b99fbe60c3b175 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:18:54.690253  6801 raft_consensus.cc:1240] T f5be3a11b23d4ea9b08300a2789821c7 P b7ab4784c7344b939bc36f639286f377 [term 5 FOLLOWER]: Rejecting Update request from peer cd75a17ab2604397adab03bb8b5fd75c for earlier term 3. Current term is 5. Ops: []
I20260709 13:18:54.513453  7993 raft_consensus.cc:3060] T 20f6842e26174571996b8dea4151d4be P ccd8a4c3bfe3413cb2ae219b09aea832 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:54.676476  6803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "427c124d773f483294511e80fe340075" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:18:54.691080  8446 raft_consensus.cc:493] T 1528ab62b6fe4e3099d08f141afee116 P b7ab4784c7344b939bc36f639286f377 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:54.692353  8552 log.cc:927] Time spent T d8cee0accdb8499c86d4414b72565a38 P cd75a17ab2604397adab03bb8b5fd75c: Append to log took a long time: real 0.075s	user 0.001s	sys 0.000s
I20260709 13:18:54.692571  6803 raft_consensus.cc:1275] T 711ef6523deb4cbe8ef2ba61e1c21c98 P b7ab4784c7344b939bc36f639286f377 [term 4 FOLLOWER]: Refusing update from remote peer cd75a17ab2604397adab03bb8b5fd75c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:18:54.687284  6881 raft_consensus.cc:1240] T f3f9c2e2bf644115957398fe4c9459db P cd75a17ab2604397adab03bb8b5fd75c [term 4 FOLLOWER]: Rejecting Update request from peer ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 3. Current term is 4. Ops: []
I20260709 13:18:54.694694  6881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c44c4849aa54f2b94d1f1bef9ed546f" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:18:54.695312  6881 raft_consensus.cc:2468] T 7c44c4849aa54f2b94d1f1bef9ed546f P cd75a17ab2604397adab03bb8b5fd75c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 3.
I20260709 13:18:54.696272  6881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c37d41cd9164c15a6826ca62a851a69" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:18:54.688247  6804 raft_consensus.cc:1240] T 7887766dc6784fcaa42b35c05fea7a99 P b7ab4784c7344b939bc36f639286f377 [term 3 FOLLOWER]: Rejecting Update request from peer cd75a17ab2604397adab03bb8b5fd75c for earlier term 2. Current term is 3. Ops: []
I20260709 13:18:54.689893  7468 leader_election.cc:400] T d8cee0accdb8499c86d4414b72565a38 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 4 pre-election: Vote denied by peer cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931) with higher term. Message: Invalid argument: T d8cee0accdb8499c86d4414b72565a38 P cd75a17ab2604397adab03bb8b5fd75c [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ba59cc884714e8aa5f3f0ecaed84cbb for earlier term 4. Current term is 5.
I20260709 13:18:54.703467  7468 leader_election.cc:304] T 4b8cacb381b746da8d0049b0a83b41dd P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:18:54.681391  8074 raft_consensus.cc:493] T 34f36d59d88f40fe8a2805e604fc6c0a P b7ab4784c7344b939bc36f639286f377 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:18:54.706869  6805 raft_consensus.cc:1275] T 95a75bfe094d4bdc963aba3f08dfcd25 P b7ab4784c7344b939bc36f639286f377 [term 4 FOLLOWER]: Refusing update from remote peer cd75a17ab2604397adab03bb8b5fd75c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
W20260709 13:18:54.707337  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 419431us
I20260709 13:18:54.708683  6844 leader_election.cc:304] T e31b9971c15848dea59d4d4130141d9e P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:18:54.709460  6875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7887766dc6784fcaa42b35c05fea7a99" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:18:54.711179  6844 leader_election.cc:304] T 3a485a995abc4807b6e511e45419f737 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:18:54.711621  7503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17587d6730594da4a56fa13a353232a1" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb"
W20260709 13:18:54.686931  8423 consensus_meta.cc:287] T 7887766dc6784fcaa42b35c05fea7a99 P cd75a17ab2604397adab03bb8b5fd75c: Time spent flushing consensus metadata: real 0.605s	user 0.003s	sys 0.010s
I20260709 13:18:54.685712  8100 raft_consensus.cc:493] T 44bde925b2e541b69890d70715b85176 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:54.717555  6844 leader_election.cc:304] T 7c44c4849aa54f2b94d1f1bef9ed546f P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
W20260709 13:18:54.725976  7468 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:54.728849  6800 raft_consensus.cc:2468] T 22ccee1b570c4ad3a57bd7aec085b1b4 P b7ab4784c7344b939bc36f639286f377 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 4.
I20260709 13:18:54.732021  6875 raft_consensus.cc:2468] T 7887766dc6784fcaa42b35c05fea7a99 P cd75a17ab2604397adab03bb8b5fd75c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 3.
I20260709 13:18:54.737011  6881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a75bfe094d4bdc963aba3f08dfcd25" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:18:54.690394  8465 raft_consensus.cc:515] T bd6869f07b5a4885a0b99fbe60c3b175 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:54.691607  8446 raft_consensus.cc:515] T 1528ab62b6fe4e3099d08f141afee116 P b7ab4784c7344b939bc36f639286f377 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } attrs { replace: true } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:18:54.737902  6772 leader_election.cc:304] T d33d5ee8ef6f415593d8df52063161ad P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:18:54.702270  8441 raft_consensus.cc:493] T b56bf91d90824c959e21e0cee5ba1816 P b7ab4784c7344b939bc36f639286f377 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:54.748581  6876 raft_consensus.cc:2468] T e77e330a82df4b43a745d57a68f6f057 P cd75a17ab2604397adab03bb8b5fd75c [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 6.
I20260709 13:18:54.714395  8416 raft_consensus.cc:2749] T e31b9971c15848dea59d4d4130141d9e P cd75a17ab2604397adab03bb8b5fd75c [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:18:54.753382  6844 leader_election.cc:304] T dbdf895bba214ff68685a24fd17dfb5d P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:18:54.708835  8429 raft_consensus.cc:493] T 4f00a2e87e56452083b759f60d461ee3 P cd75a17ab2604397adab03bb8b5fd75c [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 7ba59cc884714e8aa5f3f0ecaed84cbb)
I20260709 13:18:54.740621  8419 raft_consensus.cc:3060] T 7c44c4849aa54f2b94d1f1bef9ed546f P cd75a17ab2604397adab03bb8b5fd75c [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:54.730835  8530 raft_consensus.cc:2749] T 3a485a995abc4807b6e511e45419f737 P cd75a17ab2604397adab03bb8b5fd75c [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:18:54.727948  8541 raft_consensus.cc:493] T be1a92657f494cac8dd227d152f50151 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:54.730010  8280 raft_consensus.cc:2764] T 22ccee1b570c4ad3a57bd7aec085b1b4 P b7ab4784c7344b939bc36f639286f377 [term 4 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
I20260709 13:18:54.726606  8554 raft_consensus.cc:2749] T 4b8cacb381b746da8d0049b0a83b41dd P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:18:54.760812  6772 leader_election.cc:304] T f09c2a98de1a4decabd0ff900dd44caa P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:18:54.764930  7503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be1a92657f494cac8dd227d152f50151" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:18:54.766444  6772 leader_election.cc:304] T bb7fa124c3bf4ef9ab65a407cb008441 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb
I20260709 13:18:54.728524  8534 consensus_queue.cc:1048] T 24ee15416e3145beaa1b8183453729a3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.030s
I20260709 13:18:54.727299  8074 raft_consensus.cc:515] T 34f36d59d88f40fe8a2805e604fc6c0a P b7ab4784c7344b939bc36f639286f377 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:54.741043  8100 raft_consensus.cc:515] T 44bde925b2e541b69890d70715b85176 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:54.776531  6844 leader_election.cc:304] T ce4f062dcd314d43a63ca74067cb5ee3 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:18:54.771625  6772 leader_election.cc:304] T e31b9971c15848dea59d4d4130141d9e P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:18:54.751881  8423 consensus_queue.cc:1048] T 44bde925b2e541b69890d70715b85176 P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Connected to new peer: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.019s
I20260709 13:18:54.780939  6844 leader_election.cc:304] T 4275cf08e63345f993bce8664eada830 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377
I20260709 13:18:54.751113  8441 raft_consensus.cc:515] T b56bf91d90824c959e21e0cee5ba1816 P b7ab4784c7344b939bc36f639286f377 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:54.785411  6844 leader_election.cc:304] T 427c124d773f483294511e80fe340075 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:18:54.790025  6772 leader_election.cc:304] T c4db81d9d329422bb3b4160ca4ac2d1d P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
W20260709 13:18:54.792363  6697 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 138687us
W20260709 13:18:54.793812  6697 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:54.768985  8558 raft_consensus.cc:2804] T dbdf895bba214ff68685a24fd17dfb5d P cd75a17ab2604397adab03bb8b5fd75c [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:18:54.767962  8560 raft_consensus.cc:2804] T d33d5ee8ef6f415593d8df52063161ad P b7ab4784c7344b939bc36f639286f377 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:18:54.798717  6772 leader_election.cc:304] T de3186201e1a40d0b335eeb8b4e256e0 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:18:54.773321  8538 raft_consensus.cc:2804] T bb7fa124c3bf4ef9ab65a407cb008441 P b7ab4784c7344b939bc36f639286f377 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:18:54.762362  8429 raft_consensus.cc:515] T 4f00a2e87e56452083b759f60d461ee3 P cd75a17ab2604397adab03bb8b5fd75c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:18:54.794857  6844 leader_election.cc:304] T 9e326172347f45e99a0d482b5d8ef768 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:18:54.767598  8541 raft_consensus.cc:515] T be1a92657f494cac8dd227d152f50151 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:18:54.802769  6772 leader_election.cc:304] T 20f6842e26174571996b8dea4151d4be P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:18:54.790408  8462 leader_election.cc:290] T 30e88460611e47b2ba16a46a30b5f416 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:18:54.794230  8495 raft_consensus.cc:2749] T e31b9971c15848dea59d4d4130141d9e P b7ab4784c7344b939bc36f639286f377 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:18:54.797005  8460 raft_consensus.cc:2804] T 4275cf08e63345f993bce8664eada830 P cd75a17ab2604397adab03bb8b5fd75c [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:18:54.799321  8530 raft_consensus.cc:2749] T 427c124d773f483294511e80fe340075 P cd75a17ab2604397adab03bb8b5fd75c [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:18:54.791379  8416 consensus_queue.cc:1059] T f58dc08b12a2494bb9a1372837970ca2 P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.024s
I20260709 13:18:54.799224  8560 raft_consensus.cc:493] T d33d5ee8ef6f415593d8df52063161ad P b7ab4784c7344b939bc36f639286f377 [term 4 FOLLOWER]: Starting leader election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:18:54.826444  7503 raft_consensus.cc:2468] T be1a92657f494cac8dd227d152f50151 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 4.
I20260709 13:18:54.797534  8519 raft_consensus.cc:493] T 3d65025eea89441290d85dd053810e31 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:54.797674  8405 raft_consensus.cc:493] T 4275cf08e63345f993bce8664eada830 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:54.801795  8443 raft_consensus.cc:2749] T c4db81d9d329422bb3b4160ca4ac2d1d P b7ab4784c7344b939bc36f639286f377 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:18:54.797590  8528 consensus_queue.cc:1048] T 4b8cacb381b746da8d0049b0a83b41dd P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Connected to new peer: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.024s
I20260709 13:18:54.796435  8521 raft_consensus.cc:515] T 3411566abe2d4c9bb4b2adfdd05e6f17 P cd75a17ab2604397adab03bb8b5fd75c [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:54.800750  8558 raft_consensus.cc:493] T dbdf895bba214ff68685a24fd17dfb5d P cd75a17ab2604397adab03bb8b5fd75c [term 4 FOLLOWER]: Starting leader election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:18:54.801632  8538 raft_consensus.cc:493] T bb7fa124c3bf4ef9ab65a407cb008441 P b7ab4784c7344b939bc36f639286f377 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 7ba59cc884714e8aa5f3f0ecaed84cbb)
I20260709 13:18:54.827171  8460 raft_consensus.cc:493] T 4275cf08e63345f993bce8664eada830 P cd75a17ab2604397adab03bb8b5fd75c [term 3 FOLLOWER]: Starting leader election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:18:54.812259  8257 raft_consensus.cc:493] T f5be3a11b23d4ea9b08300a2789821c7 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:54.810621  8249 raft_consensus.cc:2804] T 9e326172347f45e99a0d482b5d8ef768 P cd75a17ab2604397adab03bb8b5fd75c [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:18:54.849274  6874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4b8bd455d5a47c18a1380839c6e0d61" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:18:54.807672  8562 raft_consensus.cc:3060] T de3186201e1a40d0b335eeb8b4e256e0 P b7ab4784c7344b939bc36f639286f377 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:54.818398  8462 raft_consensus.cc:2749] T 20f6842e26174571996b8dea4151d4be P b7ab4784c7344b939bc36f639286f377 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:18:54.837029  8565 raft_consensus.cc:3055] T f58dc08b12a2494bb9a1372837970ca2 P cd75a17ab2604397adab03bb8b5fd75c [term 4 LEADER]: Stepping down as leader of term 4
W20260709 13:18:54.847067  8556 log.cc:927] Time spent T 1bf4668eeb70467fb3dc5a0289233b3c P cd75a17ab2604397adab03bb8b5fd75c: Append to log took a long time: real 0.132s	user 0.001s	sys 0.000s
I20260709 13:18:54.838384  8558 raft_consensus.cc:3060] T dbdf895bba214ff68685a24fd17dfb5d P cd75a17ab2604397adab03bb8b5fd75c [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:54.852697  8565 raft_consensus.cc:740] T f58dc08b12a2494bb9a1372837970ca2 P cd75a17ab2604397adab03bb8b5fd75c [term 4 LEADER]: Becoming Follower/Learner. State: Replica: cd75a17ab2604397adab03bb8b5fd75c, State: Running, Role: LEADER
I20260709 13:18:54.867547  8429 leader_election.cc:290] T 4f00a2e87e56452083b759f60d461ee3 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:18:54.867806  8475 raft_consensus.cc:493] T 4b8cacb381b746da8d0049b0a83b41dd P ccd8a4c3bfe3413cb2ae219b09aea832 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:54.868453  8100 leader_election.cc:290] T 44bde925b2e541b69890d70715b85176 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:18:54.868664  8475 raft_consensus.cc:515] T 4b8cacb381b746da8d0049b0a83b41dd P ccd8a4c3bfe3413cb2ae219b09aea832 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:18:54.852363  8249 raft_consensus.cc:493] T 9e326172347f45e99a0d482b5d8ef768 P cd75a17ab2604397adab03bb8b5fd75c [term 3 FOLLOWER]: Starting leader election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:18:54.870375  8249 raft_consensus.cc:3060] T 9e326172347f45e99a0d482b5d8ef768 P cd75a17ab2604397adab03bb8b5fd75c [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:54.871102  8475 leader_election.cc:290] T 4b8cacb381b746da8d0049b0a83b41dd P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:18:54.872467  8475 raft_consensus.cc:493] T f03d0dbf16864ca4bc1bb5e4c0334c0f P ccd8a4c3bfe3413cb2ae219b09aea832 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:54.835566  8519 raft_consensus.cc:515] T 3d65025eea89441290d85dd053810e31 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:54.872819  8565 consensus_queue.cc:260] T f58dc08b12a2494bb9a1372837970ca2 P cd75a17ab2604397adab03bb8b5fd75c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:54.873991  6873 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53416 (request call id 1974) took 1650 ms. Trace:
I20260709 13:18:54.874277  8565 raft_consensus.cc:3060] T f58dc08b12a2494bb9a1372837970ca2 P cd75a17ab2604397adab03bb8b5fd75c [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:54.826646  8467 leader_election.cc:290] T f5be3a11b23d4ea9b08300a2789821c7 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 5 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:18:54.874413  6873 rpcz_store.cc:276] 0709 13:18:53.223733 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:53.232198 (+  8465us) service_pool.cc:224] Handling call
0709 13:18:53.232573 (+   375us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:54.138195 (+905622us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:54.873753 (+735558us) spinlock_profiling.cc:243] Waited 903 ms on lock 0x7b54002364d4. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f9aae01 00007fcc0f9a983e 00007fcc1496e419 00007fcc0dee5bd4 00007fcc0dee5b62 00007fcc0dee5a91 00007fcc0dee5a0c 00007fcc0dee4cc2 00007fcc0dce548c 00007fcc0dce48c6
0709 13:18:54.873931 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2076534528}
I20260709 13:18:54.835844  8542 raft_consensus.cc:2749] T f09c2a98de1a4decabd0ff900dd44caa P b7ab4784c7344b939bc36f639286f377 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:18:54.874534  8519 leader_election.cc:290] T 3d65025eea89441290d85dd053810e31 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:18:54.877434  6695 leader_election.cc:304] T f09c2a98de1a4decabd0ff900dd44caa P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
I20260709 13:18:54.878019  8541 leader_election.cc:290] T be1a92657f494cac8dd227d152f50151 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:18:54.876387  8475 raft_consensus.cc:515] T f03d0dbf16864ca4bc1bb5e4c0334c0f P ccd8a4c3bfe3413cb2ae219b09aea832 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:54.880330  8519 raft_consensus.cc:2804] T f09c2a98de1a4decabd0ff900dd44caa P ccd8a4c3bfe3413cb2ae219b09aea832 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:18:54.880797  8519 raft_consensus.cc:493] T f09c2a98de1a4decabd0ff900dd44caa P ccd8a4c3bfe3413cb2ae219b09aea832 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:54.881170  8519 raft_consensus.cc:3060] T f09c2a98de1a4decabd0ff900dd44caa P ccd8a4c3bfe3413cb2ae219b09aea832 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:54.881933  8521 leader_election.cc:290] T 3411566abe2d4c9bb4b2adfdd05e6f17 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 3 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:18:54.882212  8462 raft_consensus.cc:493] T 3d65025eea89441290d85dd053810e31 P b7ab4784c7344b939bc36f639286f377 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:54.848928  8460 raft_consensus.cc:3060] T 4275cf08e63345f993bce8664eada830 P cd75a17ab2604397adab03bb8b5fd75c [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:54.830798  8560 raft_consensus.cc:3060] T d33d5ee8ef6f415593d8df52063161ad P b7ab4784c7344b939bc36f639286f377 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:18:54.850095  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 55333.4us
I20260709 13:18:54.885304  8100 consensus_queue.cc:1059] T f3f9c2e2bf644115957398fe4c9459db P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:18:54.886319  8100 raft_consensus.cc:3055] T f3f9c2e2bf644115957398fe4c9459db P ccd8a4c3bfe3413cb2ae219b09aea832 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:18:54.886714  8100 raft_consensus.cc:740] T f3f9c2e2bf644115957398fe4c9459db P ccd8a4c3bfe3413cb2ae219b09aea832 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
I20260709 13:18:54.885470  6844 leader_election.cc:304] T ab432e62819d499eaaf3dd55481dd930 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:18:54.850821  6872 raft_consensus.cc:2393] T 3411566abe2d4c9bb4b2adfdd05e6f17 P cd75a17ab2604397adab03bb8b5fd75c [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ccd8a4c3bfe3413cb2ae219b09aea832 in current term 3: Already voted for candidate cd75a17ab2604397adab03bb8b5fd75c in this term.
I20260709 13:18:54.837116  8405 raft_consensus.cc:515] T 4275cf08e63345f993bce8664eada830 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:54.847255  8538 raft_consensus.cc:3060] T bb7fa124c3bf4ef9ab65a407cb008441 P b7ab4784c7344b939bc36f639286f377 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:54.891844  6880 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58592 (request call id 72) took 1966 ms. Trace:
I20260709 13:18:54.872368  7496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b8cacb381b746da8d0049b0a83b41dd" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:18:54.882829  8462 raft_consensus.cc:515] T 3d65025eea89441290d85dd053810e31 P b7ab4784c7344b939bc36f639286f377 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:54.893584  6801 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:32966 (request call id 543) took 1674 ms. Trace:
I20260709 13:18:54.898331  6801 rpcz_store.cc:276] 0709 13:18:53.219644 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:54.259591 (+1039947us) service_pool.cc:224] Handling call
0709 13:18:54.281884 (+ 22293us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:54.691064 (+409180us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:54.890989 (+199925us) spinlock_profiling.cc:243] Waited 408 ms on lock 0x7b54002c8dd4. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f9aae01 00007fcc0f9a983e 00007fcc1496e419 00007fcc0dee5bd4 00007fcc0dee5b62 00007fcc0dee5a91 00007fcc0dee5a0c 00007fcc0dee4cc2 00007fcc0dce548c 00007fcc0dce48c6
0709 13:18:54.893521 (+  2532us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":938674048}
I20260709 13:18:54.892298  6880 rpcz_store.cc:276] 0709 13:18:52.925933 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:52.926771 (+   838us) service_pool.cc:224] Handling call
0709 13:18:52.972326 (+ 45555us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:52.973139 (+   813us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:54.891598 (+1918459us) spinlock_profiling.cc:243] Waited 42.5 ms on lock 0x7b54002387d0. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f9a98ad 00007fcc1496e419 00007fcc0dee5bd4 00007fcc0dee5b62 00007fcc0dee5a91 00007fcc0dee5a0c 00007fcc0dee4cc2 00007fcc0dce548c 00007fcc0dce48c6 00007fcc0dce426f
0709 13:18:54.891772 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":97848192}
I20260709 13:18:54.893947  6873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77e330a82df4b43a745d57a68f6f057" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:18:54.845223  6772 leader_election.cc:304] T 4f00a2e87e56452083b759f60d461ee3 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:18:54.851897  6874 raft_consensus.cc:2393] T f4b8bd455d5a47c18a1380839c6e0d61 P cd75a17ab2604397adab03bb8b5fd75c [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate ccd8a4c3bfe3413cb2ae219b09aea832 in current term 3: Already voted for candidate cd75a17ab2604397adab03bb8b5fd75c in this term.
W20260709 13:18:54.896540  7466 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:54.879875  8537 log.cc:927] Time spent T 20f6842e26174571996b8dea4151d4be P cd75a17ab2604397adab03bb8b5fd75c: Append to log took a long time: real 0.691s	user 0.000s	sys 0.001s
I20260709 13:18:54.900908  6873 raft_consensus.cc:2376] T e77e330a82df4b43a745d57a68f6f057 P cd75a17ab2604397adab03bb8b5fd75c [term 6 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 6. Re-sending same reply.
I20260709 13:18:54.906319  6880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09c2a98de1a4decabd0ff900dd44caa" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:18:54.908303  6804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "711ef6523deb4cbe8ef2ba61e1c21c98" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
W20260709 13:18:54.908478  6772 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 63405.4us
I20260709 13:18:54.909317  6804 raft_consensus.cc:2410] T 711ef6523deb4cbe8ef2ba61e1c21c98 P b7ab4784c7344b939bc36f639286f377 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ccd8a4c3bfe3413cb2ae219b09aea832 for term 5 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:18:54.909350  6772 leader_election.cc:304] T e77e330a82df4b43a745d57a68f6f057 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:18:54.913727  6844 leader_election.cc:304] T 22ccee1b570c4ad3a57bd7aec085b1b4 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:18:54.912978  6805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f58dc08b12a2494bb9a1372837970ca2" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:18:54.915830  6874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fa34c08b205435dba97346991aa1f92" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:18:54.917215  6874 raft_consensus.cc:2376] T 3fa34c08b205435dba97346991aa1f92 P cd75a17ab2604397adab03bb8b5fd75c [term 5 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 5. Re-sending same reply.
I20260709 13:18:54.916867  6805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3411566abe2d4c9bb4b2adfdd05e6f17" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:18:54.918802  6800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24ee15416e3145beaa1b8183453729a3" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:18:54.919281  6880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44bde925b2e541b69890d70715b85176" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:18:54.919694  6800 raft_consensus.cc:2410] T 24ee15416e3145beaa1b8183453729a3 P b7ab4784c7344b939bc36f639286f377 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ccd8a4c3bfe3413cb2ae219b09aea832 for term 5 because replica has last-logged OpId of term: 4 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 4.
I20260709 13:18:54.919498  6804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a485a995abc4807b6e511e45419f737" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:18:54.918295  6873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b8cacb381b746da8d0049b0a83b41dd" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:18:54.921315  6804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d65025eea89441290d85dd053810e31" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:18:54.923051  6874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d65025eea89441290d85dd053810e31" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:18:54.905390  8542 raft_consensus.cc:493] T 07a92dd554674067a83a9cb68c4773f2 P b7ab4784c7344b939bc36f639286f377 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:18:54.932647  6800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3411566abe2d4c9bb4b2adfdd05e6f17" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:18:54.932518  8542 raft_consensus.cc:515] T 07a92dd554674067a83a9cb68c4773f2 P b7ab4784c7344b939bc36f639286f377 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:54.887769  8100 consensus_queue.cc:260] T f3f9c2e2bf644115957398fe4c9459db P ccd8a4c3bfe3413cb2ae219b09aea832 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:54.934825  8541 consensus_queue.cc:1048] T 7ba5dac66ab5497e9e336f2a3c28cda5 P 7ba59cc884714e8aa5f3f0ecaed84cbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:18:54.935387  8100 raft_consensus.cc:3060] T f3f9c2e2bf644115957398fe4c9459db P ccd8a4c3bfe3413cb2ae219b09aea832 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:54.915722  8446 leader_election.cc:290] T 1528ab62b6fe4e3099d08f141afee116 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:18:54.893234  8257 raft_consensus.cc:515] T f5be3a11b23d4ea9b08300a2789821c7 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:54.920185  8394 raft_consensus.cc:2804] T e77e330a82df4b43a745d57a68f6f057 P b7ab4784c7344b939bc36f639286f377 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:18:54.903528  8521 consensus_queue.cc:1059] T 95a75bfe094d4bdc963aba3f08dfcd25 P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.036s
I20260709 13:18:54.911252  8443 raft_consensus.cc:493] T 44bde925b2e541b69890d70715b85176 P b7ab4784c7344b939bc36f639286f377 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:54.907590  8467 raft_consensus.cc:493] T b3f13b31a1f84f0d89d007eadd57924c P b7ab4784c7344b939bc36f639286f377 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 7ba59cc884714e8aa5f3f0ecaed84cbb)
I20260709 13:18:54.940575  8433 raft_consensus.cc:3055] T 95a75bfe094d4bdc963aba3f08dfcd25 P cd75a17ab2604397adab03bb8b5fd75c [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:18:54.940728  8443 raft_consensus.cc:515] T 44bde925b2e541b69890d70715b85176 P b7ab4784c7344b939bc36f639286f377 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:54.941076  8467 raft_consensus.cc:515] T b3f13b31a1f84f0d89d007eadd57924c P b7ab4784c7344b939bc36f639286f377 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:18:54.941390  6805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30e88460611e47b2ba16a46a30b5f416" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:18:54.942639  6805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b3759de40694069b13c0f8bd40e5709" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:18:54.943332  8467 leader_election.cc:290] T b3f13b31a1f84f0d89d007eadd57924c P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:18:54.907730  8495 raft_consensus.cc:493] T 713b5728a197487c9300b310ab94e5a3 P b7ab4784c7344b939bc36f639286f377 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:54.943874  8475 leader_election.cc:290] T f03d0dbf16864ca4bc1bb5e4c0334c0f P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:18:54.941047  8433 raft_consensus.cc:740] T 95a75bfe094d4bdc963aba3f08dfcd25 P cd75a17ab2604397adab03bb8b5fd75c [term 4 LEADER]: Becoming Follower/Learner. State: Replica: cd75a17ab2604397adab03bb8b5fd75c, State: Running, Role: LEADER
I20260709 13:18:54.944522  8495 raft_consensus.cc:515] T 713b5728a197487c9300b310ab94e5a3 P b7ab4784c7344b939bc36f639286f377 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:54.939693  8394 raft_consensus.cc:493] T e77e330a82df4b43a745d57a68f6f057 P b7ab4784c7344b939bc36f639286f377 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:54.945951  8394 raft_consensus.cc:3060] T e77e330a82df4b43a745d57a68f6f057 P b7ab4784c7344b939bc36f639286f377 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:54.943270  6805 raft_consensus.cc:2468] T 9b3759de40694069b13c0f8bd40e5709 P b7ab4784c7344b939bc36f639286f377 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 4.
I20260709 13:18:54.922174  6804 raft_consensus.cc:2468] T 3d65025eea89441290d85dd053810e31 P b7ab4784c7344b939bc36f639286f377 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 2.
I20260709 13:18:54.949512  6805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6869f07b5a4885a0b99fbe60c3b175" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 6 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
W20260709 13:18:54.951069  6695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 53760.5us
I20260709 13:18:54.907750  8425 consensus_queue.cc:1048] T 7c37d41cd9164c15a6826ca62a851a69 P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Connected to new peer: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.045s
I20260709 13:18:54.939560  8558 raft_consensus.cc:515] T dbdf895bba214ff68685a24fd17dfb5d P cd75a17ab2604397adab03bb8b5fd75c [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:54.958268  6805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f00a2e87e56452083b759f60d461ee3" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:18:54.905252  7496 raft_consensus.cc:2468] T 4b8cacb381b746da8d0049b0a83b41dd P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 4.
I20260709 13:18:54.918601  8529 raft_consensus.cc:2804] T ab432e62819d499eaaf3dd55481dd930 P cd75a17ab2604397adab03bb8b5fd75c [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:18:54.947220  8495 leader_election.cc:290] T 713b5728a197487c9300b310ab94e5a3 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:18:54.960793  6805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44bde925b2e541b69890d70715b85176" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:18:54.939760  8257 leader_election.cc:290] T f5be3a11b23d4ea9b08300a2789821c7 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
W20260709 13:18:54.958586  7497 consensus_meta.cc:287] T 3fa34c08b205435dba97346991aa1f92 P 7ba59cc884714e8aa5f3f0ecaed84cbb: Time spent flushing consensus metadata: real 0.512s	user 0.012s	sys 0.002s
I20260709 13:18:54.960896  6801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77e330a82df4b43a745d57a68f6f057" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:18:54.905934  8429 consensus_queue.cc:1048] T 711ef6523deb4cbe8ef2ba61e1c21c98 P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Connected to new peer: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.050s
I20260709 13:18:54.963634  6804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab432e62819d499eaaf3dd55481dd930" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:18:54.965081  6805 raft_consensus.cc:2468] T 44bde925b2e541b69890d70715b85176 P b7ab4784c7344b939bc36f639286f377 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 4.
W20260709 13:18:54.965898  6772 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 51297us
I20260709 13:18:54.947819  8465 leader_election.cc:290] T bd6869f07b5a4885a0b99fbe60c3b175 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:18:54.943300  8443 leader_election.cc:290] T 44bde925b2e541b69890d70715b85176 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:18:54.919972  8416 consensus_queue.cc:1048] T a1704639a875409b9959353527b3fd68 P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Connected to new peer: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.046s
I20260709 13:18:54.951247  8530 raft_consensus.cc:2804] T 22ccee1b570c4ad3a57bd7aec085b1b4 P cd75a17ab2604397adab03bb8b5fd75c [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:18:54.975703  6805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a75bfe094d4bdc963aba3f08dfcd25" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:18:54.976935  6805 raft_consensus.cc:3060] T 95a75bfe094d4bdc963aba3f08dfcd25 P b7ab4784c7344b939bc36f639286f377 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:54.964576  8529 raft_consensus.cc:493] T ab432e62819d499eaaf3dd55481dd930 P cd75a17ab2604397adab03bb8b5fd75c [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:18:54.989464  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 58039.6us
I20260709 13:18:54.970480  8257 raft_consensus.cc:493] T a1704639a875409b9959353527b3fd68 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:54.959807  8249 raft_consensus.cc:515] T 9e326172347f45e99a0d482b5d8ef768 P cd75a17ab2604397adab03bb8b5fd75c [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:54.969559  7497 raft_consensus.cc:2468] T 3fa34c08b205435dba97346991aa1f92 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 5.
I20260709 13:18:54.989652  8529 raft_consensus.cc:3060] T ab432e62819d499eaaf3dd55481dd930 P cd75a17ab2604397adab03bb8b5fd75c [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:55.009351  6873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5be3a11b23d4ea9b08300a2789821c7" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:18:55.010085  8425 raft_consensus.cc:493] T f03d0dbf16864ca4bc1bb5e4c0334c0f P cd75a17ab2604397adab03bb8b5fd75c [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:18:55.005337  8555 raft_consensus.cc:2749] T 3fa34c08b205435dba97346991aa1f92 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:18:54.979298  8495 consensus_queue.cc:1048] T ab432e62819d499eaaf3dd55481dd930 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.020s
I20260709 13:18:55.015013  8419 raft_consensus.cc:2749] T 7c44c4849aa54f2b94d1f1bef9ed546f P cd75a17ab2604397adab03bb8b5fd75c [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:18:55.015542  8574 raft_consensus.cc:2749] T 4f00a2e87e56452083b759f60d461ee3 P b7ab4784c7344b939bc36f639286f377 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:18:55.048823  6845 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:54.988828  8530 raft_consensus.cc:697] T 22ccee1b570c4ad3a57bd7aec085b1b4 P cd75a17ab2604397adab03bb8b5fd75c [term 4 LEADER]: Becoming Leader. State: Replica: cd75a17ab2604397adab03bb8b5fd75c, State: Running, Role: LEADER
I20260709 13:18:54.998297  8257 raft_consensus.cc:515] T a1704639a875409b9959353527b3fd68 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:55.021862  5625 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:18:54.952353  8433 consensus_queue.cc:260] T 95a75bfe094d4bdc963aba3f08dfcd25 P cd75a17ab2604397adab03bb8b5fd75c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
W20260709 13:18:55.053109  6695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 81582.5us
I20260709 13:18:55.023419  6878 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53416 (request call id 1984) took 1796 ms. Trace:
I20260709 13:18:55.024811  6874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1528ab62b6fe4e3099d08f141afee116" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:18:55.026432  6879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8cee0accdb8499c86d4414b72565a38" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:18:55.055949  6874 raft_consensus.cc:2468] T 1528ab62b6fe4e3099d08f141afee116 P cd75a17ab2604397adab03bb8b5fd75c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in term 4.
I20260709 13:18:55.057121  6879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6869f07b5a4885a0b99fbe60c3b175" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 6 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:18:55.029726  6880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "427c124d773f483294511e80fe340075" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:18:54.998118  8558 leader_election.cc:290] T dbdf895bba214ff68685a24fd17dfb5d P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 5 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:18:55.033793  6697 leader_election.cc:304] T 4b8cacb381b746da8d0049b0a83b41dd P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
I20260709 13:18:55.041494  6844 leader_election.cc:304] T 853ac0a8cbd64ce99457f170216d4d0f P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:18:55.058558  6880 raft_consensus.cc:2468] T 427c124d773f483294511e80fe340075 P cd75a17ab2604397adab03bb8b5fd75c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in term 3.
I20260709 13:18:55.055233  6878 rpcz_store.cc:276] 0709 13:18:53.226642 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:53.474333 (+247691us) service_pool.cc:224] Handling call
0709 13:18:53.550627 (+ 76294us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:55.022437 (+1471810us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:55.022469 (+    32us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:55.022520 (+    51us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:18:55.022548 (+    28us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:55.023110 (+   562us) spinlock_profiling.cc:243] Waited 1.47 s on lock 0x7b54000a5fd4. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f9aae01 00007fcc0f9a983e 00007fcc1496e419 00007fcc0dee5bd4 00007fcc0dee5b62 00007fcc0dee5a91 00007fcc0dee5a0c 00007fcc0dee4cc2 00007fcc0dce548c 00007fcc0dce48c6
0709 13:18:55.023162 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:55.023322 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3384242944}
I20260709 13:18:55.059674  6844 leader_election.cc:304] T a3022224cc81473690653a83d4e99470 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:18:54.988929  8465 raft_consensus.cc:2955] T 427c124d773f483294511e80fe340075 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 3 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } attrs { replace: true } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } } }
I20260709 13:18:55.055578  6695 leader_election.cc:304] T 24ee15416e3145beaa1b8183453729a3 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, b7ab4784c7344b939bc36f639286f377
W20260709 13:18:55.062623  6772 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 87099.4us
I20260709 13:18:55.049189  6805 raft_consensus.cc:2468] T 95a75bfe094d4bdc963aba3f08dfcd25 P b7ab4784c7344b939bc36f639286f377 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 5.
I20260709 13:18:55.039780  6873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f03d0dbf16864ca4bc1bb5e4c0334c0f" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:18:55.066180  6805 raft_consensus.cc:1240] T 20f6842e26174571996b8dea4151d4be P b7ab4784c7344b939bc36f639286f377 [term 4 FOLLOWER]: Rejecting Update request from peer ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 3. Current term is 4. Ops: []
I20260709 13:18:55.060883  8559 raft_consensus.cc:2749] T 853ac0a8cbd64ce99457f170216d4d0f P cd75a17ab2604397adab03bb8b5fd75c [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:18:55.069078  8416 consensus_queue.cc:1059] T 3d65025eea89441290d85dd053810e31 P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:18:55.070434  8416 raft_consensus.cc:3055] T 3d65025eea89441290d85dd053810e31 P cd75a17ab2604397adab03bb8b5fd75c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:18:55.070924  8416 raft_consensus.cc:740] T 3d65025eea89441290d85dd053810e31 P cd75a17ab2604397adab03bb8b5fd75c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: cd75a17ab2604397adab03bb8b5fd75c, State: Running, Role: LEADER
I20260709 13:18:55.063104  8558 raft_consensus.cc:2749] T a3022224cc81473690653a83d4e99470 P cd75a17ab2604397adab03bb8b5fd75c [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:18:55.070287  8530 consensus_queue.cc:237] T 22ccee1b570c4ad3a57bd7aec085b1b4 P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:55.044595  8462 leader_election.cc:290] T 3d65025eea89441290d85dd053810e31 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:18:55.073422  8249 leader_election.cc:290] T 9e326172347f45e99a0d482b5d8ef768 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 4 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:18:55.077155  8460 raft_consensus.cc:515] T 4275cf08e63345f993bce8664eada830 P cd75a17ab2604397adab03bb8b5fd75c [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:55.102056  6844 leader_election.cc:304] T e77e330a82df4b43a745d57a68f6f057 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:18:55.103367  6772 leader_election.cc:304] T 4d9def8b32fd443aa94ab1420b06837b P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:18:55.104715  8586 raft_consensus.cc:2749] T 4d9def8b32fd443aa94ab1420b06837b P b7ab4784c7344b939bc36f639286f377 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:18:55.105343  6772 leader_election.cc:304] T 7c44c4849aa54f2b94d1f1bef9ed546f P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:18:55.106459  8586 raft_consensus.cc:2804] T 7c44c4849aa54f2b94d1f1bef9ed546f P b7ab4784c7344b939bc36f639286f377 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:18:55.107095  6695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 51627us
I20260709 13:18:55.107309  8586 raft_consensus.cc:493] T 7c44c4849aa54f2b94d1f1bef9ed546f P b7ab4784c7344b939bc36f639286f377 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:55.112462  6878 raft_consensus.cc:1275] T 2c240553ce044eedb41541d72b9475d7 P cd75a17ab2604397adab03bb8b5fd75c [term 5 FOLLOWER]: Refusing update from remote peer b7ab4784c7344b939bc36f639286f377: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:18:55.113811  6879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30e88460611e47b2ba16a46a30b5f416" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:18:55.046475  8394 raft_consensus.cc:515] T e77e330a82df4b43a745d57a68f6f057 P b7ab4784c7344b939bc36f639286f377 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } }
I20260709 13:18:55.114600  6878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5be3a11b23d4ea9b08300a2789821c7" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:18:55.114637  6879 raft_consensus.cc:2393] T 30e88460611e47b2ba16a46a30b5f416 P cd75a17ab2604397adab03bb8b5fd75c [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7ab4784c7344b939bc36f639286f377 in current term 3: Already voted for candidate cd75a17ab2604397adab03bb8b5fd75c in this term.
I20260709 13:18:55.041850  8425 raft_consensus.cc:515] T f03d0dbf16864ca4bc1bb5e4c0334c0f P cd75a17ab2604397adab03bb8b5fd75c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:55.071887  8416 consensus_queue.cc:260] T 3d65025eea89441290d85dd053810e31 P cd75a17ab2604397adab03bb8b5fd75c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:55.118116  8581 raft_consensus.cc:493] T 24ee15416e3145beaa1b8183453729a3 P b7ab4784c7344b939bc36f639286f377 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 7ba59cc884714e8aa5f3f0ecaed84cbb)
I20260709 13:18:55.119050  8416 raft_consensus.cc:3060] T 3d65025eea89441290d85dd053810e31 P cd75a17ab2604397adab03bb8b5fd75c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:55.118875  8581 raft_consensus.cc:515] T 24ee15416e3145beaa1b8183453729a3 P b7ab4784c7344b939bc36f639286f377 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } attrs { replace: true } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:18:55.123245  8581 leader_election.cc:290] T 24ee15416e3145beaa1b8183453729a3 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:18:55.109071  6695 leader_election.cc:304] T 3d65025eea89441290d85dd053810e31 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
I20260709 13:18:55.142457  6878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "713b5728a197487c9300b310ab94e5a3" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:18:55.143913  6878 raft_consensus.cc:2410] T 713b5728a197487c9300b310ab94e5a3 P cd75a17ab2604397adab03bb8b5fd75c [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7ab4784c7344b939bc36f639286f377 for term 5 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:18:55.145183  6878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d65025eea89441290d85dd053810e31" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:18:55.116820  6879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1528ab62b6fe4e3099d08f141afee116" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 5 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:18:55.148183  6879 raft_consensus.cc:2410] T 1528ab62b6fe4e3099d08f141afee116 P cd75a17ab2604397adab03bb8b5fd75c [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7ab4784c7344b939bc36f639286f377 for term 5 because replica has last-logged OpId of term: 3 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 3.
I20260709 13:18:55.148006  6695 leader_election.cc:304] T 44bde925b2e541b69890d70715b85176 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
W20260709 13:18:55.150669  6697 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.68:45071, user_credentials={real_user=slave}} blocked reactor thread for 117021us
I20260709 13:18:55.151389  6697 leader_election.cc:304] T 3fa34c08b205435dba97346991aa1f92 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
W20260709 13:18:55.155763  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 53793.4us
I20260709 13:18:55.156632  6801 raft_consensus.cc:2393] T e77e330a82df4b43a745d57a68f6f057 P b7ab4784c7344b939bc36f639286f377 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate ccd8a4c3bfe3413cb2ae219b09aea832 in current term 6: Already voted for candidate b7ab4784c7344b939bc36f639286f377 in this term.
I20260709 13:18:55.157440  6844 leader_election.cc:304] T f4b8bd455d5a47c18a1380839c6e0d61 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:18:55.150269  8112 raft_consensus.cc:2764] T e77e330a82df4b43a745d57a68f6f057 P cd75a17ab2604397adab03bb8b5fd75c [term 6 FOLLOWER]: Leader election decision vote started in defunct term 5: won
I20260709 13:18:55.159974  6873 raft_consensus.cc:2468] T f03d0dbf16864ca4bc1bb5e4c0334c0f P cd75a17ab2604397adab03bb8b5fd75c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 3.
I20260709 13:18:55.115986  8586 raft_consensus.cc:3060] T 7c44c4849aa54f2b94d1f1bef9ed546f P b7ab4784c7344b939bc36f639286f377 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:55.162317  6879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44bde925b2e541b69890d70715b85176" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:18:55.158182  8559 raft_consensus.cc:2749] T f4b8bd455d5a47c18a1380839c6e0d61 P cd75a17ab2604397adab03bb8b5fd75c [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:18:55.155072  7497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8cee0accdb8499c86d4414b72565a38" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 6 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:18:55.168970  8585 raft_consensus.cc:493] T 7c37d41cd9164c15a6826ca62a851a69 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:55.170931  7468 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:55.169261  7499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1528ab62b6fe4e3099d08f141afee116" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 5 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:18:55.169915  7495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3f13b31a1f84f0d89d007eadd57924c" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:18:55.171974  8582 raft_consensus.cc:2804] T 4b8cacb381b746da8d0049b0a83b41dd P ccd8a4c3bfe3413cb2ae219b09aea832 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:18:55.172257  8573 consensus_queue.cc:1059] T d8292e16e5654be6bc408560cf256aaa P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.062s
I20260709 13:18:55.180380  8573 raft_consensus.cc:3055] T d8292e16e5654be6bc408560cf256aaa P cd75a17ab2604397adab03bb8b5fd75c [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:18:55.180738  8573 raft_consensus.cc:740] T d8292e16e5654be6bc408560cf256aaa P cd75a17ab2604397adab03bb8b5fd75c [term 4 LEADER]: Becoming Follower/Learner. State: Replica: cd75a17ab2604397adab03bb8b5fd75c, State: Running, Role: LEADER
I20260709 13:18:55.174863  8580 raft_consensus.cc:2804] T 3d65025eea89441290d85dd053810e31 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:18:55.181715  8580 raft_consensus.cc:493] T 3d65025eea89441290d85dd053810e31 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:55.182173  8580 raft_consensus.cc:3060] T 3d65025eea89441290d85dd053810e31 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:55.182698  6723 raft_consensus.cc:1240] T be1a92657f494cac8dd227d152f50151 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 4 FOLLOWER]: Rejecting Update request from peer 7ba59cc884714e8aa5f3f0ecaed84cbb for earlier term 3. Current term is 4. Ops: []
I20260709 13:18:55.175386  8575 raft_consensus.cc:2749] T 24ee15416e3145beaa1b8183453729a3 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:18:55.171972  8577 raft_consensus.cc:2804] T 3fa34c08b205435dba97346991aa1f92 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:18:55.197719  8577 raft_consensus.cc:697] T 3fa34c08b205435dba97346991aa1f92 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 5 LEADER]: Becoming Leader. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
I20260709 13:18:55.198666  8577 consensus_queue.cc:237] T 3fa34c08b205435dba97346991aa1f92 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:18:55.178478  7501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f00a2e87e56452083b759f60d461ee3" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:18:55.188653  7993 raft_consensus.cc:493] T be1a92657f494cac8dd227d152f50151 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:55.179008  8257 leader_election.cc:290] T a1704639a875409b9959353527b3fd68 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:18:55.179195  8585 raft_consensus.cc:515] T 7c37d41cd9164c15a6826ca62a851a69 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:55.190153  7499 raft_consensus.cc:2410] T 1528ab62b6fe4e3099d08f141afee116 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7ab4784c7344b939bc36f639286f377 for term 5 because replica has last-logged OpId of term: 3 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 3.
I20260709 13:18:55.191840  6846 leader_election.cc:304] T d8cee0accdb8499c86d4414b72565a38 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, b7ab4784c7344b939bc36f639286f377
I20260709 13:18:55.197029  8584 raft_consensus.cc:2804] T 44bde925b2e541b69890d70715b85176 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:18:55.200600  7496 raft_consensus.cc:1275] T 4b8cacb381b746da8d0049b0a83b41dd P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 4 FOLLOWER]: Refusing update from remote peer cd75a17ab2604397adab03bb8b5fd75c: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:18:55.213431  8112 raft_consensus.cc:2749] T d8cee0accdb8499c86d4414b72565a38 P cd75a17ab2604397adab03bb8b5fd75c [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:18:55.166874  8538 raft_consensus.cc:515] T bb7fa124c3bf4ef9ab65a407cb008441 P b7ab4784c7344b939bc36f639286f377 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
W20260709 13:18:55.219666  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 54838.9us
I20260709 13:18:55.183671  8582 raft_consensus.cc:493] T 4b8cacb381b746da8d0049b0a83b41dd P ccd8a4c3bfe3413cb2ae219b09aea832 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:55.236687  8461 consensus_queue.cc:1048] T 4b8cacb381b746da8d0049b0a83b41dd P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:18:55.202323  8519 raft_consensus.cc:515] T f09c2a98de1a4decabd0ff900dd44caa P ccd8a4c3bfe3413cb2ae219b09aea832 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:55.200838  7993 raft_consensus.cc:515] T be1a92657f494cac8dd227d152f50151 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:18:55.222301  8584 raft_consensus.cc:493] T 44bde925b2e541b69890d70715b85176 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:55.246430  7468 leader_election.cc:304] T 1528ab62b6fe4e3099d08f141afee116 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:18:55.251057  8534 raft_consensus.cc:2804] T 1528ab62b6fe4e3099d08f141afee116 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:18:55.251228  8585 leader_election.cc:290] T 7c37d41cd9164c15a6826ca62a851a69 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:18:55.251621  8534 raft_consensus.cc:493] T 1528ab62b6fe4e3099d08f141afee116 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:55.252159  8534 raft_consensus.cc:3060] T 1528ab62b6fe4e3099d08f141afee116 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:55.229344  8582 raft_consensus.cc:3060] T 4b8cacb381b746da8d0049b0a83b41dd P ccd8a4c3bfe3413cb2ae219b09aea832 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:55.230998  8565 consensus_queue.cc:1048] T 711ef6523deb4cbe8ef2ba61e1c21c98 P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.029s
I20260709 13:18:55.247900  8584 raft_consensus.cc:3060] T 44bde925b2e541b69890d70715b85176 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:55.222978  8560 raft_consensus.cc:515] T d33d5ee8ef6f415593d8df52063161ad P b7ab4784c7344b939bc36f639286f377 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:55.272433  6800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbdf895bba214ff68685a24fd17dfb5d" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:18:55.275337  6800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e326172347f45e99a0d482b5d8ef768" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:18:55.280709  8394 leader_election.cc:290] T e77e330a82df4b43a745d57a68f6f057 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 6 election: Requested vote from peers cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931), ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391)
I20260709 13:18:55.282406  8538 leader_election.cc:290] T bb7fa124c3bf4ef9ab65a407cb008441 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 5 election: Requested vote from peers cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:18:55.273531  8562 raft_consensus.cc:2749] T de3186201e1a40d0b335eeb8b4e256e0 P b7ab4784c7344b939bc36f639286f377 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:18:55.271224  8460 leader_election.cc:290] T 4275cf08e63345f993bce8664eada830 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 4 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:18:55.287477  6800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f9c2e2bf644115957398fe4c9459db" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:18:55.290228  6800 raft_consensus.cc:2393] T f3f9c2e2bf644115957398fe4c9459db P b7ab4784c7344b939bc36f639286f377 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c in current term 4: Already voted for candidate b7ab4784c7344b939bc36f639286f377 in this term.
I20260709 13:18:55.301959  6804 raft_consensus.cc:1240] T de3186201e1a40d0b335eeb8b4e256e0 P b7ab4784c7344b939bc36f639286f377 [term 4 FOLLOWER]: Rejecting Update request from peer ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 3. Current term is 4. Ops: []
I20260709 13:18:55.310600  8519 leader_election.cc:290] T f09c2a98de1a4decabd0ff900dd44caa P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 5 election: Requested vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:18:55.315382  6878 raft_consensus.cc:2468] T 3d65025eea89441290d85dd053810e31 P cd75a17ab2604397adab03bb8b5fd75c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 2.
I20260709 13:18:55.315392  6800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce4f062dcd314d43a63ca74067cb5ee3" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 6 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
W20260709 13:18:55.324951  6695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 177054us
I20260709 13:18:55.325510  8586 raft_consensus.cc:515] T 7c44c4849aa54f2b94d1f1bef9ed546f P b7ab4784c7344b939bc36f639286f377 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:55.326635  6695 leader_election.cc:304] T 95a75bfe094d4bdc963aba3f08dfcd25 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
I20260709 13:18:55.328213  8533 raft_consensus.cc:2804] T 95a75bfe094d4bdc963aba3f08dfcd25 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:18:55.329388  8533 raft_consensus.cc:697] T 95a75bfe094d4bdc963aba3f08dfcd25 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 5 LEADER]: Becoming Leader. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
I20260709 13:18:55.333464  6800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4db81d9d329422bb3b4160ca4ac2d1d" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:18:55.334393  6800 raft_consensus.cc:2393] T c4db81d9d329422bb3b4160ca4ac2d1d P b7ab4784c7344b939bc36f639286f377 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c in current term 4: Already voted for candidate b7ab4784c7344b939bc36f639286f377 in this term.
I20260709 13:18:55.332458  6697 leader_election.cc:304] T c4db81d9d329422bb3b4160ca4ac2d1d P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377
I20260709 13:18:55.314646  8529 raft_consensus.cc:515] T ab432e62819d499eaaf3dd55481dd930 P cd75a17ab2604397adab03bb8b5fd75c [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:55.340549  6697 leader_election.cc:304] T 853ac0a8cbd64ce99457f170216d4d0f P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:18:55.342002  6800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d33d5ee8ef6f415593d8df52063161ad" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:18:55.337121  8538 raft_consensus.cc:493] T a3022224cc81473690653a83d4e99470 P b7ab4784c7344b939bc36f639286f377 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:18:55.343654  8538 raft_consensus.cc:515] T a3022224cc81473690653a83d4e99470 P b7ab4784c7344b939bc36f639286f377 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:55.345965  8538 leader_election.cc:290] T a3022224cc81473690653a83d4e99470 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:18:55.347613  6876 raft_consensus.cc:1240] T ab432e62819d499eaaf3dd55481dd930 P cd75a17ab2604397adab03bb8b5fd75c [term 5 FOLLOWER]: Rejecting Update request from peer b7ab4784c7344b939bc36f639286f377 for earlier term 4. Current term is 5. Ops: [4.2-4.2]
W20260709 13:18:55.339111  8315 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.883s	user 0.013s	sys 0.010s
I20260709 13:18:55.337996  8586 leader_election.cc:290] T 7c44c4849aa54f2b94d1f1bef9ed546f P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 5 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:18:55.361613  8475 consensus_queue.cc:1059] T de3186201e1a40d0b335eeb8b4e256e0 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.003s
I20260709 13:18:55.364342  8560 leader_election.cc:290] T d33d5ee8ef6f415593d8df52063161ad P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 5 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:18:55.364641  8475 raft_consensus.cc:3055] T de3186201e1a40d0b335eeb8b4e256e0 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:18:55.365018  8475 raft_consensus.cc:740] T de3186201e1a40d0b335eeb8b4e256e0 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
W20260709 13:18:55.365854  6698 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:55.366670  6770 leader_election.cc:304] T f3f9c2e2bf644115957398fe4c9459db P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:18:55.368192  8560 consensus_queue.cc:1048] T 4275cf08e63345f993bce8664eada830 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:18:55.368835  8094 raft_consensus.cc:493] T 7a734b5ab7834e05a8c422208acc58b1 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:55.369098  8562 raft_consensus.cc:2749] T f3f9c2e2bf644115957398fe4c9459db P b7ab4784c7344b939bc36f639286f377 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:18:55.369434  8094 raft_consensus.cc:515] T 7a734b5ab7834e05a8c422208acc58b1 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:55.365851  8475 consensus_queue.cc:260] T de3186201e1a40d0b335eeb8b4e256e0 P ccd8a4c3bfe3413cb2ae219b09aea832 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:55.341144  8577 raft_consensus.cc:2804] T c4db81d9d329422bb3b4160ca4ac2d1d P ccd8a4c3bfe3413cb2ae219b09aea832 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:18:55.361331  8519 raft_consensus.cc:2749] T 853ac0a8cbd64ce99457f170216d4d0f P ccd8a4c3bfe3413cb2ae219b09aea832 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:18:55.371716  8094 leader_election.cc:290] T 7a734b5ab7834e05a8c422208acc58b1 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:18:55.358462  6800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f03d0dbf16864ca4bc1bb5e4c0334c0f" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:18:55.373354  6874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24ee15416e3145beaa1b8183453729a3" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
W20260709 13:18:55.357365  8315 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.906s	user 0.013s	sys 0.010s
I20260709 13:18:55.378371  8257 raft_consensus.cc:493] T 7887766dc6784fcaa42b35c05fea7a99 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:55.378975  8352 raft_consensus.cc:493] T 4d9def8b32fd443aa94ab1420b06837b P ccd8a4c3bfe3413cb2ae219b09aea832 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:55.394086  6803 raft_consensus.cc:1240] T f58dc08b12a2494bb9a1372837970ca2 P b7ab4784c7344b939bc36f639286f377 [term 5 LEADER]: Rejecting Update request from peer cd75a17ab2604397adab03bb8b5fd75c for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 13:18:55.379549  8100 raft_consensus.cc:493] T d8292e16e5654be6bc408560cf256aaa P ccd8a4c3bfe3413cb2ae219b09aea832 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:55.379954  6879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77e330a82df4b43a745d57a68f6f057" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:18:55.380442  8575 raft_consensus.cc:493] T 7c44c4849aa54f2b94d1f1bef9ed546f P ccd8a4c3bfe3413cb2ae219b09aea832 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:55.375460  8317 raft_consensus.cc:493] T 713b5728a197487c9300b310ab94e5a3 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:55.381441  6727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8292e16e5654be6bc408560cf256aaa" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:18:55.356217  8594 consensus_queue.cc:1048] T 427c124d773f483294511e80fe340075 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.034s
I20260709 13:18:55.383771  6728 raft_consensus.cc:1275] T 3411566abe2d4c9bb4b2adfdd05e6f17 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 2 FOLLOWER]: Refusing update from remote peer b7ab4784c7344b939bc36f639286f377: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:18:55.386272  6806 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50550 (request call id 116) took 2236 ms. Trace:
I20260709 13:18:55.387243  6731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f03d0dbf16864ca4bc1bb5e4c0334c0f" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:18:55.399652  8257 raft_consensus.cc:515] T 7887766dc6784fcaa42b35c05fea7a99 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:55.399853  8575 raft_consensus.cc:515] T 7c44c4849aa54f2b94d1f1bef9ed546f P ccd8a4c3bfe3413cb2ae219b09aea832 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:55.401995  6731 raft_consensus.cc:2410] T f03d0dbf16864ca4bc1bb5e4c0334c0f P ccd8a4c3bfe3413cb2ae219b09aea832 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7ab4784c7344b939bc36f639286f377 for term 5 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:18:55.402987  6728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "711ef6523deb4cbe8ef2ba61e1c21c98" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:18:55.403155  6731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30e88460611e47b2ba16a46a30b5f416" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:18:55.403715  6728 raft_consensus.cc:2468] T 711ef6523deb4cbe8ef2ba61e1c21c98 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 4.
I20260709 13:18:55.404815  6731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c44c4849aa54f2b94d1f1bef9ed546f" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:18:55.405489  6731 raft_consensus.cc:2468] T 7c44c4849aa54f2b94d1f1bef9ed546f P ccd8a4c3bfe3413cb2ae219b09aea832 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 4.
I20260709 13:18:55.405646  6728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be1a92657f494cac8dd227d152f50151" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:18:55.406288  6731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c37d41cd9164c15a6826ca62a851a69" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:18:55.406759  6731 raft_consensus.cc:3060] T 7c37d41cd9164c15a6826ca62a851a69 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:55.390789  6800 raft_consensus.cc:2468] T f03d0dbf16864ca4bc1bb5e4c0334c0f P b7ab4784c7344b939bc36f639286f377 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 4.
W20260709 13:18:55.391333  6730 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50004 (request call id 1145) took 2145 ms (client timeout 2601 ms). Trace:
I20260709 13:18:55.337756  8596 consensus_queue.cc:1048] T 2c240553ce044eedb41541d72b9475d7 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.029s
I20260709 13:18:55.400570  6879 raft_consensus.cc:2393] T e77e330a82df4b43a745d57a68f6f057 P cd75a17ab2604397adab03bb8b5fd75c [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate b7ab4784c7344b939bc36f639286f377 in current term 6: Already voted for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in this term.
I20260709 13:18:55.401422  6806 rpcz_store.cc:276] 0709 13:18:53.149808 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:53.183494 (+ 33686us) service_pool.cc:224] Handling call
0709 13:18:55.386076 (+2202582us) spinlock_profiling.cc:243] Waited 687 ms on lock 0x7b54001d1fd4. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f9ae2fa 00007fcc1496fb17 00007fcc0deea6d4 00007fcc0deea662 00007fcc0deea591 00007fcc0deea50c 00007fcc0dee97c2 00007fcc0dce548c 00007fcc0dce48c6 00007fcc0dce426f
0709 13:18:55.386209 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1580800768}
I20260709 13:18:55.403766  8575 leader_election.cc:290] T 7c44c4849aa54f2b94d1f1bef9ed546f P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:18:55.403924  8352 raft_consensus.cc:515] T 4d9def8b32fd443aa94ab1420b06837b P ccd8a4c3bfe3413cb2ae219b09aea832 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:55.417359  6800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a734b5ab7834e05a8c422208acc58b1" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:18:55.417629  6879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb7fa124c3bf4ef9ab65a407cb008441" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:18:55.408651  6874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c44c4849aa54f2b94d1f1bef9ed546f" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:18:55.418663  6800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ba5dac66ab5497e9e336f2a3c28cda5" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:18:55.419251  6874 raft_consensus.cc:3060] T 7c44c4849aa54f2b94d1f1bef9ed546f P cd75a17ab2604397adab03bb8b5fd75c [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:55.409281  6728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b56bf91d90824c959e21e0cee5ba1816" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:18:55.392671  6697 leader_election.cc:304] T 711ef6523deb4cbe8ef2ba61e1c21c98 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:18:55.420997  6728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17587d6730594da4a56fa13a353232a1" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
W20260709 13:18:55.409668  7466 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:55.424082  6695 leader_election.cc:304] T f03d0dbf16864ca4bc1bb5e4c0334c0f P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
I20260709 13:18:55.388794  8577 raft_consensus.cc:697] T c4db81d9d329422bb3b4160ca4ac2d1d P ccd8a4c3bfe3413cb2ae219b09aea832 [term 4 LEADER]: Becoming Leader. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
I20260709 13:18:55.427553  6806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4275cf08e63345f993bce8664eada830" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:18:55.428134  6728 raft_consensus.cc:2393] T 17587d6730594da4a56fa13a353232a1 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate b7ab4784c7344b939bc36f639286f377 in current term 6: Already voted for candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in this term.
I20260709 13:18:55.428984  6728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5be3a11b23d4ea9b08300a2789821c7" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:18:55.429626  6728 raft_consensus.cc:3060] T f5be3a11b23d4ea9b08300a2789821c7 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:55.345956  8580 raft_consensus.cc:515] T 3d65025eea89441290d85dd053810e31 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
W20260709 13:18:55.407776  6730 rpcz_store.cc:269] 0709 13:18:53.243454 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:53.243615 (+   161us) service_pool.cc:224] Handling call
0709 13:18:55.388944 (+2145329us) spinlock_profiling.cc:243] Waited 1.19 s on lock 0x7b5400056c54. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f9ae2fa 00007fcc1496fb17 00007fcc0deea6d4 00007fcc0deea662 00007fcc0deea591 00007fcc0deea50c 00007fcc0dee97c2 00007fcc0dce548c 00007fcc0dce48c6 00007fcc0dce426f
0709 13:18:55.389077 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2738018048}
I20260709 13:18:55.376892  8406 raft_consensus.cc:493] T 90d42e216d9741e190bca19a781291fd P ccd8a4c3bfe3413cb2ae219b09aea832 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:18:55.434278  8406 raft_consensus.cc:515] T 90d42e216d9741e190bca19a781291fd P ccd8a4c3bfe3413cb2ae219b09aea832 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:55.434751  6730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1528ab62b6fe4e3099d08f141afee116" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 5 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:18:55.435597  6730 raft_consensus.cc:2410] T 1528ab62b6fe4e3099d08f141afee116 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7ab4784c7344b939bc36f639286f377 for term 5 because replica has last-logged OpId of term: 3 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 3.
I20260709 13:18:55.436002  8580 leader_election.cc:290] T 3d65025eea89441290d85dd053810e31 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 3 election: Requested vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
W20260709 13:18:55.387979  6696 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:55.412441  6770 leader_election.cc:304] T f03d0dbf16864ca4bc1bb5e4c0334c0f P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:18:55.403643  8257 leader_election.cc:290] T 7887766dc6784fcaa42b35c05fea7a99 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:18:55.418588  8352 leader_election.cc:290] T 4d9def8b32fd443aa94ab1420b06837b P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:18:55.436446  6730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7887766dc6784fcaa42b35c05fea7a99" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:18:55.437793  6806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb7fa124c3bf4ef9ab65a407cb008441" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:18:55.438059  6770 leader_election.cc:304] T 30e88460611e47b2ba16a46a30b5f416 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:18:55.438597  6806 raft_consensus.cc:2368] T bb7fa124c3bf4ef9ab65a407cb008441 P b7ab4784c7344b939bc36f639286f377 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c for earlier term 3. Current term is 5.
I20260709 13:18:55.437963  6730 raft_consensus.cc:2468] T 7887766dc6784fcaa42b35c05fea7a99 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 3.
I20260709 13:18:55.440711  6770 leader_election.cc:304] T 711ef6523deb4cbe8ef2ba61e1c21c98 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:18:55.443732  6879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d33d5ee8ef6f415593d8df52063161ad" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:18:55.408174  8317 raft_consensus.cc:515] T 713b5728a197487c9300b310ab94e5a3 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:55.445412  6800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "427c124d773f483294511e80fe340075" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:18:55.455260  6770 leader_election.cc:304] T 17587d6730594da4a56fa13a353232a1 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:18:55.461678  6806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7887766dc6784fcaa42b35c05fea7a99" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:18:55.462675  6806 raft_consensus.cc:2468] T 7887766dc6784fcaa42b35c05fea7a99 P b7ab4784c7344b939bc36f639286f377 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 3.
I20260709 13:18:55.463182  6770 leader_election.cc:304] T 1528ab62b6fe4e3099d08f141afee116 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:18:55.464449  6800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90d42e216d9741e190bca19a781291fd" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:18:55.404909  8100 raft_consensus.cc:515] T d8292e16e5654be6bc408560cf256aaa P ccd8a4c3bfe3413cb2ae219b09aea832 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:55.464730  6879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3022224cc81473690653a83d4e99470" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:18:55.469290  6879 raft_consensus.cc:2468] T a3022224cc81473690653a83d4e99470 P cd75a17ab2604397adab03bb8b5fd75c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 4.
I20260709 13:18:55.442840  8578 consensus_queue.cc:1048] T f4b8bd455d5a47c18a1380839c6e0d61 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.022s
I20260709 13:18:55.466004  8538 raft_consensus.cc:2749] T 1528ab62b6fe4e3099d08f141afee116 P b7ab4784c7344b939bc36f639286f377 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:18:55.415232  8448 consensus_queue.cc:1048] T 3411566abe2d4c9bb4b2adfdd05e6f17 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.051s
I20260709 13:18:55.466782  8575 raft_consensus.cc:2804] T f03d0dbf16864ca4bc1bb5e4c0334c0f P ccd8a4c3bfe3413cb2ae219b09aea832 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:18:55.458144  8315 raft_consensus.cc:493] T ce4f062dcd314d43a63ca74067cb5ee3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:55.466668  8584 raft_consensus.cc:515] T 44bde925b2e541b69890d70715b85176 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:55.426034  8419 raft_consensus.cc:493] T fe20b4b48823486ca3b9c648db6ce8aa P cd75a17ab2604397adab03bb8b5fd75c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:18:55.343678  8533 consensus_queue.cc:237] T 95a75bfe094d4bdc963aba3f08dfcd25 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:55.467926  8529 leader_election.cc:290] T ab432e62819d499eaaf3dd55481dd930 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 5 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:18:55.436578  8406 leader_election.cc:290] T 90d42e216d9741e190bca19a781291fd P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:18:55.440744  8560 raft_consensus.cc:2749] T f03d0dbf16864ca4bc1bb5e4c0334c0f P b7ab4784c7344b939bc36f639286f377 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:18:55.469201  6770 leader_election.cc:304] T 7887766dc6784fcaa42b35c05fea7a99 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
I20260709 13:18:55.473140  6806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d9def8b32fd443aa94ab1420b06837b" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:18:55.487054  6727 raft_consensus.cc:3060] T d8292e16e5654be6bc408560cf256aaa P ccd8a4c3bfe3413cb2ae219b09aea832 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:55.487520  6806 raft_consensus.cc:2468] T 4d9def8b32fd443aa94ab1420b06837b P b7ab4784c7344b939bc36f639286f377 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 4.
I20260709 13:18:55.474346  6695 leader_election.cc:304] T 7887766dc6784fcaa42b35c05fea7a99 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
W20260709 13:18:55.475020  8513 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.853s	user 0.009s	sys 0.012s
I20260709 13:18:55.452173  8519 raft_consensus.cc:2749] T 711ef6523deb4cbe8ef2ba61e1c21c98 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:18:55.458415  8586 raft_consensus.cc:3060] T 30e88460611e47b2ba16a46a30b5f416 P b7ab4784c7344b939bc36f639286f377 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:55.461622  8574 raft_consensus.cc:2804] T 711ef6523deb4cbe8ef2ba61e1c21c98 P b7ab4784c7344b939bc36f639286f377 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:18:55.468453  8346 raft_consensus.cc:2749] T 17587d6730594da4a56fa13a353232a1 P b7ab4784c7344b939bc36f639286f377 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:18:55.458005  8289 consensus_queue.cc:1048] T 9b3759de40694069b13c0f8bd40e5709 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.028s
I20260709 13:18:55.535650  6879 raft_consensus.cc:1240] T dbdf895bba214ff68685a24fd17dfb5d P cd75a17ab2604397adab03bb8b5fd75c [term 5 FOLLOWER]: Rejecting Update request from peer b7ab4784c7344b939bc36f639286f377 for earlier term 4. Current term is 5. Ops: []
I20260709 13:18:55.532141  8574 raft_consensus.cc:493] T 711ef6523deb4cbe8ef2ba61e1c21c98 P b7ab4784c7344b939bc36f639286f377 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:55.526087  8317 leader_election.cc:290] T 713b5728a197487c9300b310ab94e5a3 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:18:55.467666  8577 consensus_queue.cc:237] T c4db81d9d329422bb3b4160ca4ac2d1d P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:55.517001  8593 raft_consensus.cc:2804] T 7887766dc6784fcaa42b35c05fea7a99 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 13:18:55.552199  8595 log.cc:927] Time spent T 3fa34c08b205435dba97346991aa1f92 P ccd8a4c3bfe3413cb2ae219b09aea832: Append to log took a long time: real 0.140s	user 0.000s	sys 0.001s
I20260709 13:18:55.485117  8575 raft_consensus.cc:493] T f03d0dbf16864ca4bc1bb5e4c0334c0f P ccd8a4c3bfe3413cb2ae219b09aea832 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:55.483530  8352 raft_consensus.cc:493] T b3f13b31a1f84f0d89d007eadd57924c P ccd8a4c3bfe3413cb2ae219b09aea832 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:55.513945  8513 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.899s	user 0.009s	sys 0.012s
I20260709 13:18:55.532236  8584 leader_election.cc:290] T 44bde925b2e541b69890d70715b85176 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 5 election: Requested vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:18:55.486904  8580 raft_consensus.cc:493] T ce4f062dcd314d43a63ca74067cb5ee3 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:55.516863  8458 raft_consensus.cc:2804] T 7887766dc6784fcaa42b35c05fea7a99 P b7ab4784c7344b939bc36f639286f377 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:18:55.523711  6731 raft_consensus.cc:2468] T 7c37d41cd9164c15a6826ca62a851a69 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 4.
I20260709 13:18:55.620297  6728 raft_consensus.cc:2468] T f5be3a11b23d4ea9b08300a2789821c7 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 5.
I20260709 13:18:55.607153  8513 raft_consensus.cc:697] T 17587d6730594da4a56fa13a353232a1 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 6 LEADER]: Becoming Leader. State: Replica: 7ba59cc884714e8aa5f3f0ecaed84cbb, State: Running, Role: LEADER
I20260709 13:18:55.549503  8574 raft_consensus.cc:3060] T 711ef6523deb4cbe8ef2ba61e1c21c98 P b7ab4784c7344b939bc36f639286f377 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:55.607805  8352 raft_consensus.cc:515] T b3f13b31a1f84f0d89d007eadd57924c P ccd8a4c3bfe3413cb2ae219b09aea832 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:18:55.609390  8100 leader_election.cc:290] T d8292e16e5654be6bc408560cf256aaa P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:18:55.515094  8419 raft_consensus.cc:515] T fe20b4b48823486ca3b9c648db6ce8aa P cd75a17ab2604397adab03bb8b5fd75c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:18:55.613511  6723 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49744 (request call id 93) took 2714 ms. Trace:
I20260709 13:18:55.513044  8315 raft_consensus.cc:515] T ce4f062dcd314d43a63ca74067cb5ee3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } attrs { replace: true } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:18:55.626060  6723 rpcz_store.cc:276] 0709 13:18:52.847533 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:53.017137 (+169604us) service_pool.cc:224] Handling call
0709 13:18:53.017490 (+   353us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:55.183206 (+2165716us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:55.561837 (+378631us) spinlock_profiling.cc:243] Waited 2.16 s on lock 0x7b540008d254. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f9aae01 00007fcc0f9a983e 00007fcc1496e419 00007fcc0dee5bd4 00007fcc0dee5b62 00007fcc0dee5a91 00007fcc0dee5a0c 00007fcc0dee4cc2 00007fcc0dce548c 00007fcc0dce48c6
0709 13:18:55.562089 (+   252us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4979084160}
W20260709 13:18:55.615151  6844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:55.556262  8593 raft_consensus.cc:493] T 7887766dc6784fcaa42b35c05fea7a99 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:55.605801  8280 raft_consensus.cc:493] T f4b8bd455d5a47c18a1380839c6e0d61 P b7ab4784c7344b939bc36f639286f377 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:55.621829  6874 raft_consensus.cc:2468] T 7c44c4849aa54f2b94d1f1bef9ed546f P cd75a17ab2604397adab03bb8b5fd75c [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 5.
I20260709 13:18:55.621321  6727 raft_consensus.cc:2468] T d8292e16e5654be6bc408560cf256aaa P ccd8a4c3bfe3413cb2ae219b09aea832 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 5.
I20260709 13:18:55.621464  6770 leader_election.cc:304] T 7c37d41cd9164c15a6826ca62a851a69 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: cd75a17ab2604397adab03bb8b5fd75c
W20260709 13:18:55.624615  6845 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:55.620263  8458 raft_consensus.cc:493] T 7887766dc6784fcaa42b35c05fea7a99 P b7ab4784c7344b939bc36f639286f377 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:55.615470  8575 raft_consensus.cc:3060] T f03d0dbf16864ca4bc1bb5e4c0334c0f P ccd8a4c3bfe3413cb2ae219b09aea832 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:55.636765  6770 leader_election.cc:304] T f5be3a11b23d4ea9b08300a2789821c7 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:18:55.638761  6877 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53406 (request call id 1181) took 1787 ms. Trace:
I20260709 13:18:55.639073  8419 leader_election.cc:290] T fe20b4b48823486ca3b9c648db6ce8aa P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:18:55.639155  8352 leader_election.cc:290] T b3f13b31a1f84f0d89d007eadd57924c P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:18:55.618135  8534 raft_consensus.cc:515] T 1528ab62b6fe4e3099d08f141afee116 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 5 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } attrs { replace: true } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:18:55.639918  8346 raft_consensus.cc:2804] T 7c37d41cd9164c15a6826ca62a851a69 P b7ab4784c7344b939bc36f639286f377 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:18:55.640264  8458 raft_consensus.cc:3060] T 7887766dc6784fcaa42b35c05fea7a99 P b7ab4784c7344b939bc36f639286f377 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:18:55.637557  6697 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 197058us
I20260709 13:18:55.642827  7500 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50742 (request call id 249) took 1586 ms. Trace:
I20260709 13:18:55.624245  8580 raft_consensus.cc:515] T ce4f062dcd314d43a63ca74067cb5ee3 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } attrs { replace: true } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:18:55.654088  7500 rpcz_store.cc:276] 0709 13:18:54.056751 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:54.056904 (+   153us) service_pool.cc:224] Handling call
0709 13:18:55.642003 (+1585099us) spinlock_profiling.cc:243] Waited 1.23 ms on lock 0x7b5800123f98. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0c745db1 00007fcc0c885b71 00007fcc0c885a22 00007fcc1579ec09 00007fcc148f8ee0 00007fcc149c20ab 00007fcc149c2131 00007fcc14983fc0 00007fcc1496e929 00007fcc1496e3d2 00007fcc0dee5bd4
0709 13:18:55.642236 (+   233us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:55.642455 (+   219us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:18:55.642482 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:55.642528 (+    46us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:18:55.642559 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:55.642617 (+    58us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:55.642734 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2837248}
I20260709 13:18:55.655892  6697 leader_election.cc:304] T ab432e62819d499eaaf3dd55481dd930 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377
W20260709 13:18:55.646560  8517 log.cc:927] Time spent T dbdf895bba214ff68685a24fd17dfb5d P ccd8a4c3bfe3413cb2ae219b09aea832: Append to log took a long time: real 1.976s	user 0.006s	sys 0.009s
I20260709 13:18:55.649482  6879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce4f062dcd314d43a63ca74067cb5ee3" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:18:55.649372  6877 rpcz_store.cc:276] 0709 13:18:53.851363 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:53.852026 (+   663us) service_pool.cc:224] Handling call
0709 13:18:55.638539 (+1786513us) spinlock_profiling.cc:243] Waited 321 ms on lock 0x7b5400219dd4. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f9ae2fa 00007fcc1496fb17 00007fcc0deea6d4 00007fcc0deea662 00007fcc0deea591 00007fcc0deea50c 00007fcc0dee97c2 00007fcc0dce548c 00007fcc0dce48c6 00007fcc0dce426f
0709 13:18:55.638655 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":739427712}
W20260709 13:18:55.653651  7468 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:55.630177  8593 raft_consensus.cc:3060] T 7887766dc6784fcaa42b35c05fea7a99 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:55.663012  6697 leader_election.cc:304] T f58dc08b12a2494bb9a1372837970ca2 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:18:55.627063  8582 raft_consensus.cc:515] T 4b8cacb381b746da8d0049b0a83b41dd P ccd8a4c3bfe3413cb2ae219b09aea832 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:18:55.671399  6697 leader_election.cc:304] T 3a485a995abc4807b6e511e45419f737 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:18:55.676353  6697 leader_election.cc:304] T e77e330a82df4b43a745d57a68f6f057 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:18:55.642745  8315 leader_election.cc:290] T ce4f062dcd314d43a63ca74067cb5ee3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:18:55.681700  8100 raft_consensus.cc:2749] T 3a485a995abc4807b6e511e45419f737 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:18:55.681171  8346 raft_consensus.cc:697] T 7c37d41cd9164c15a6826ca62a851a69 P b7ab4784c7344b939bc36f639286f377 [term 4 LEADER]: Becoming Leader. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
I20260709 13:18:55.690908  8346 consensus_queue.cc:237] T 7c37d41cd9164c15a6826ca62a851a69 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:55.631914  8513 consensus_queue.cc:237] T 17587d6730594da4a56fa13a353232a1 P 7ba59cc884714e8aa5f3f0ecaed84cbb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:18:55.656920  8596 raft_consensus.cc:2804] T f5be3a11b23d4ea9b08300a2789821c7 P b7ab4784c7344b939bc36f639286f377 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:18:55.699915  6731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b3759de40694069b13c0f8bd40e5709" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:18:55.710172  6723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30e88460611e47b2ba16a46a30b5f416" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:18:55.711391  6723 raft_consensus.cc:1240] T 44bde925b2e541b69890d70715b85176 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 5 FOLLOWER]: Rejecting Update request from peer cd75a17ab2604397adab03bb8b5fd75c for earlier term 4. Current term is 5. Ops: [2.2-4.3]
I20260709 13:18:55.637429  8280 raft_consensus.cc:515] T f4b8bd455d5a47c18a1380839c6e0d61 P b7ab4784c7344b939bc36f639286f377 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:55.681448  8578 raft_consensus.cc:2749] T f58dc08b12a2494bb9a1372837970ca2 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:18:55.686021  8584 raft_consensus.cc:2804] T e77e330a82df4b43a745d57a68f6f057 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:18:55.720520  6731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3411566abe2d4c9bb4b2adfdd05e6f17" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:18:55.723294  6731 raft_consensus.cc:3060] T 3411566abe2d4c9bb4b2adfdd05e6f17 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:55.702957  8094 raft_consensus.cc:2804] T ab432e62819d499eaaf3dd55481dd930 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:18:55.730440  6724 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50004 (request call id 1146) took 2484 ms. Trace:
I20260709 13:18:55.730803  6724 rpcz_store.cc:276] 0709 13:18:53.245743 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:53.246027 (+   284us) service_pool.cc:224] Handling call
0709 13:18:53.264436 (+ 18409us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:53.267299 (+  2863us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:53.267332 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:53.267817 (+   485us) log.cc:844] Serialized 26 byte log entry
0709 13:18:53.529820 (+262003us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:18:53.614138 (+ 84318us) log.cc:844] Serialized 14 byte log entry
0709 13:18:53.798506 (+184368us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:53.798629 (+   123us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:55.645843 (+1847214us) spinlock_profiling.cc:243] Waited 12.1 ms on lock 0x7b4400022b4c. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0c745db1 00007fcc0c7e3c85 00007fcc0c7e46a2 00007fcc0f5561db 00007fcc0f551aaf 00007fcc0f54586e 00007fcc0f544bb6 00007fcc0f5447d8 00007fcc0f54e221 00007fcc0f54e1d9 00007fcc0f54e169
0709 13:18:55.724429 (+ 78586us) raft_consensus.cc:1685] finished
0709 13:18:55.730275 (+  5846us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:55.730391 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5466,"prepare.queue_time_us":84107,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":40,"raft.queue_time_us":90965,"raft.run_cpu_time_us":355,"raft.run_wall_time_us":10100,"spinlock_wait_cycles":27774336,"thread_start_us":325438,"threads_started":2,"wal-append.queue_time_us":311326}
I20260709 13:18:55.735260  7503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3f13b31a1f84f0d89d007eadd57924c" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:18:55.718652  8596 raft_consensus.cc:697] T f5be3a11b23d4ea9b08300a2789821c7 P b7ab4784c7344b939bc36f639286f377 [term 5 LEADER]: Becoming Leader. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
I20260709 13:18:55.720278  6726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6869f07b5a4885a0b99fbe60c3b175" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 6 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:18:55.711843  8352 consensus_queue.cc:1059] T 30e88460611e47b2ba16a46a30b5f416 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.021s
I20260709 13:18:55.750895  6730 raft_consensus.cc:1240] T 4b8cacb381b746da8d0049b0a83b41dd P ccd8a4c3bfe3413cb2ae219b09aea832 [term 5 FOLLOWER]: Rejecting Update request from peer cd75a17ab2604397adab03bb8b5fd75c for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 13:18:55.728138  8584 raft_consensus.cc:697] T e77e330a82df4b43a745d57a68f6f057 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 6 LEADER]: Becoming Leader. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
I20260709 13:18:55.753275  6730 raft_consensus.cc:1240] T 7c37d41cd9164c15a6826ca62a851a69 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 4 FOLLOWER]: Rejecting Update request from peer cd75a17ab2604397adab03bb8b5fd75c for earlier term 3. Current term is 4. Ops: [2.2-3.3]
I20260709 13:18:55.755600  8425 leader_election.cc:290] T f03d0dbf16864ca4bc1bb5e4c0334c0f P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:18:55.741044  8257 raft_consensus.cc:493] T 20f6842e26174571996b8dea4151d4be P ccd8a4c3bfe3413cb2ae219b09aea832 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:55.757323  8257 raft_consensus.cc:515] T 20f6842e26174571996b8dea4151d4be P ccd8a4c3bfe3413cb2ae219b09aea832 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:55.760538  6731 raft_consensus.cc:2468] T 3411566abe2d4c9bb4b2adfdd05e6f17 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 3.
W20260709 13:18:55.769133  8536 log.cc:927] Time spent T 853ac0a8cbd64ce99457f170216d4d0f P ccd8a4c3bfe3413cb2ae219b09aea832: Append to log took a long time: real 1.590s	user 0.012s	sys 0.002s
I20260709 13:18:55.770716  6732 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50004 (request call id 1151) took 2519 ms. Trace:
I20260709 13:18:55.771145  6732 rpcz_store.cc:276] 0709 13:18:53.250794 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:53.309914 (+ 59120us) service_pool.cc:224] Handling call
0709 13:18:53.457633 (+147719us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:53.716707 (+259074us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:53.716743 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:53.729491 (+ 12748us) log.cc:844] Serialized 26 byte log entry
0709 13:18:53.931474 (+201983us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:18:53.931531 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:53.931644 (+   113us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:55.768380 (+1836736us) spinlock_profiling.cc:243] Waited 39.7 ms on lock 0x7b4400022b4c. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0c745db1 00007fcc0c7e3c85 00007fcc0c7e46a2 00007fcc0f5561db 00007fcc0f551aaf 00007fcc0f54586e 00007fcc0f544bb6 00007fcc0f5447d8 00007fcc0f54e221 00007fcc0f54e1d9 00007fcc0f54e169
0709 13:18:55.770356 (+  1976us) raft_consensus.cc:1685] finished
0709 13:18:55.770382 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:55.770642 (+   260us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":19699,"raft.queue_time_us":146665,"raft.run_cpu_time_us":212,"raft.run_wall_time_us":13360,"spinlock_wait_cycles":91247872,"thread_start_us":409731,"threads_started":2,"wal-append.queue_time_us":341690}
I20260709 13:18:55.785218  6730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e326172347f45e99a0d482b5d8ef768" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:18:55.786008  6730 raft_consensus.cc:3060] T 9e326172347f45e99a0d482b5d8ef768 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:55.798180  6732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab432e62819d499eaaf3dd55481dd930" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:18:55.773022  8519 raft_consensus.cc:493] T 404190ce4ce94cecbfcb6ea9d1dd8626 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:18:55.800071  6732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f03d0dbf16864ca4bc1bb5e4c0334c0f" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
W20260709 13:18:55.808808  6799 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:32966 (request call id 549) took 2583 ms (client timeout 1630 ms). Trace:
I20260709 13:18:55.775630  8584 consensus_queue.cc:237] T e77e330a82df4b43a745d57a68f6f057 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } }
W20260709 13:18:55.809310  6799 rpcz_store.cc:269] 0709 13:18:53.225554 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:55.808570 (+2583016us) service_pool.cc:211] Skipping call since client already timed out
0709 13:18:55.808727 (+   157us) inbound_call.cc:177] Queueing failure response
Metrics: {}
I20260709 13:18:55.828610  6799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "713b5728a197487c9300b310ab94e5a3" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:18:55.829413  6799 raft_consensus.cc:2468] T 713b5728a197487c9300b310ab94e5a3 P b7ab4784c7344b939bc36f639286f377 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 4.
I20260709 13:18:55.830327  6799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "427c124d773f483294511e80fe340075" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:18:55.830946  6799 raft_consensus.cc:2468] T 427c124d773f483294511e80fe340075 P b7ab4784c7344b939bc36f639286f377 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in term 3.
I20260709 13:18:55.832783  7466 leader_election.cc:304] T 427c124d773f483294511e80fe340075 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:18:55.834475  6799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8cee0accdb8499c86d4414b72565a38" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:18:55.806473  8582 leader_election.cc:290] T 4b8cacb381b746da8d0049b0a83b41dd P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 5 election: Requested vote from peers cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:18:55.842319  7466 leader_election.cc:304] T d8cee0accdb8499c86d4414b72565a38 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:18:55.843936  7503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b8cacb381b746da8d0049b0a83b41dd" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb"
I20260709 13:18:55.816604  6725 raft_consensus.cc:1275] T ce4f062dcd314d43a63ca74067cb5ee3 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 5 FOLLOWER]: Refusing update from remote peer cd75a17ab2604397adab03bb8b5fd75c: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:18:55.846771  7500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24ee15416e3145beaa1b8183453729a3" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:18:55.848583  7503 raft_consensus.cc:3060] T 4b8cacb381b746da8d0049b0a83b41dd P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:55.848773  6799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab432e62819d499eaaf3dd55481dd930" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
W20260709 13:18:55.838862  8611 log.cc:927] Time spent T a1704639a875409b9959353527b3fd68 P ccd8a4c3bfe3413cb2ae219b09aea832: Append to log took a long time: real 0.063s	user 0.001s	sys 0.000s
I20260709 13:18:55.853421  6730 raft_consensus.cc:2468] T 9e326172347f45e99a0d482b5d8ef768 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 4.
I20260709 13:18:55.807288  8519 raft_consensus.cc:515] T 404190ce4ce94cecbfcb6ea9d1dd8626 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:18:55.866128  6844 leader_election.cc:304] T 3411566abe2d4c9bb4b2adfdd05e6f17 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:18:55.872401  8529 consensus_queue.cc:1059] T 7c37d41cd9164c15a6826ca62a851a69 P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 13:18:55.873211  8590 log.cc:927] Time spent T 853ac0a8cbd64ce99457f170216d4d0f P b7ab4784c7344b939bc36f639286f377: Append to log took a long time: real 0.659s	user 0.000s	sys 0.006s
I20260709 13:18:55.876710  8280 leader_election.cc:290] T f4b8bd455d5a47c18a1380839c6e0d61 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:18:55.878871  6726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe20b4b48823486ca3b9c648db6ce8aa" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:18:55.879729  6725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be1a92657f494cac8dd227d152f50151" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:18:55.880322  6726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce4f062dcd314d43a63ca74067cb5ee3" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:18:55.880456  6725 raft_consensus.cc:2468] T be1a92657f494cac8dd227d152f50151 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in term 4.
I20260709 13:18:55.881251  6726 raft_consensus.cc:2393] T ce4f062dcd314d43a63ca74067cb5ee3 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in current term 5: Already voted for candidate cd75a17ab2604397adab03bb8b5fd75c in this term.
I20260709 13:18:55.881821  6725 raft_consensus.cc:1240] T f09c2a98de1a4decabd0ff900dd44caa P ccd8a4c3bfe3413cb2ae219b09aea832 [term 5 FOLLOWER]: Rejecting Update request from peer cd75a17ab2604397adab03bb8b5fd75c for earlier term 4. Current term is 5. Ops: []
I20260709 13:18:55.847340  8389 raft_consensus.cc:2804] T 427c124d773f483294511e80fe340075 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:18:55.882951  8389 raft_consensus.cc:493] T 427c124d773f483294511e80fe340075 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 3 FOLLOWER]: Starting leader election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:18:55.883458  8389 raft_consensus.cc:3060] T 427c124d773f483294511e80fe340075 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:55.883759  8257 leader_election.cc:290] T 20f6842e26174571996b8dea4151d4be P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:18:55.854979  8315 raft_consensus.cc:2749] T d8cee0accdb8499c86d4414b72565a38 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:18:55.864092  8419 consensus_queue.cc:1059] T 44bde925b2e541b69890d70715b85176 P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.022s
I20260709 13:18:55.890573  7466 leader_election.cc:304] T be1a92657f494cac8dd227d152f50151 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
I20260709 13:18:55.892006  7466 leader_election.cc:304] T ce4f062dcd314d43a63ca74067cb5ee3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:18:55.900614  7503 raft_consensus.cc:2468] T 4b8cacb381b746da8d0049b0a83b41dd P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 5.
I20260709 13:18:55.865303  6799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f03d0dbf16864ca4bc1bb5e4c0334c0f" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:18:55.918365  6730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4275cf08e63345f993bce8664eada830" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:18:55.919799  8597 raft_consensus.cc:3060] T ce4f062dcd314d43a63ca74067cb5ee3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:56.002146  6730 raft_consensus.cc:3060] T 4275cf08e63345f993bce8664eada830 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:55.921231  8100 raft_consensus.cc:493] T 2c240553ce044eedb41541d72b9475d7 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:55.920766  8315 raft_consensus.cc:2804] T be1a92657f494cac8dd227d152f50151 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:18:55.868613  8559 consensus_queue.cc:1059] T 4b8cacb381b746da8d0049b0a83b41dd P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.065s
I20260709 13:18:55.844506  8596 consensus_queue.cc:237] T f5be3a11b23d4ea9b08300a2789821c7 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:55.983105  8458 raft_consensus.cc:515] T 7887766dc6784fcaa42b35c05fea7a99 P b7ab4784c7344b939bc36f639286f377 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:55.936820  7499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb7fa124c3bf4ef9ab65a407cb008441" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb"
I20260709 13:18:55.961992  8389 raft_consensus.cc:515] T 427c124d773f483294511e80fe340075 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 4 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } attrs { replace: true } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:18:55.974438  8423 raft_consensus.cc:2804] T 3411566abe2d4c9bb4b2adfdd05e6f17 P cd75a17ab2604397adab03bb8b5fd75c [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:18:55.956849  8580 leader_election.cc:290] T ce4f062dcd314d43a63ca74067cb5ee3 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:18:55.996858  6807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "404190ce4ce94cecbfcb6ea9d1dd8626" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:18:55.998109  8574 raft_consensus.cc:515] T 711ef6523deb4cbe8ef2ba61e1c21c98 P b7ab4784c7344b939bc36f639286f377 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
W20260709 13:18:55.999014  6798 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:32966 (request call id 552) took 2771 ms (client timeout 1708 ms). Trace:
I20260709 13:18:55.998939  8575 raft_consensus.cc:515] T f03d0dbf16864ca4bc1bb5e4c0334c0f P ccd8a4c3bfe3413cb2ae219b09aea832 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:56.018189  8389 leader_election.cc:290] T 427c124d773f483294511e80fe340075 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 4 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
W20260709 13:18:56.018386  6798 rpcz_store.cc:269] 0709 13:18:53.227455 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:53.717068 (+489613us) service_pool.cc:224] Handling call
0709 13:18:55.998732 (+2281664us) spinlock_profiling.cc:243] Waited 415 ms on lock 0x7b54002896d4. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f9ae2fa 00007fcc1496fb17 00007fcc0deea6d4 00007fcc0deea662 00007fcc0deea591 00007fcc0deea50c 00007fcc0dee97c2 00007fcc0dce548c 00007fcc0dce48c6 00007fcc0dce426f
0709 13:18:55.998911 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":954354560}
I20260709 13:18:56.019384  8423 raft_consensus.cc:697] T 3411566abe2d4c9bb4b2adfdd05e6f17 P cd75a17ab2604397adab03bb8b5fd75c [term 3 LEADER]: Becoming Leader. State: Replica: cd75a17ab2604397adab03bb8b5fd75c, State: Running, Role: LEADER
I20260709 13:18:56.020066  8575 leader_election.cc:290] T f03d0dbf16864ca4bc1bb5e4c0334c0f P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 5 election: Requested vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
W20260709 13:18:55.921738  8547 log.cc:927] Time spent T 24ee15416e3145beaa1b8183453729a3 P ccd8a4c3bfe3413cb2ae219b09aea832: Append to log took a long time: real 1.616s	user 0.006s	sys 0.000s
I20260709 13:18:56.020462  8423 consensus_queue.cc:237] T 3411566abe2d4c9bb4b2adfdd05e6f17 P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:56.021644  6729 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49744 (request call id 99) took 2047 ms. Trace:
I20260709 13:18:56.022050  8574 leader_election.cc:290] T 711ef6523deb4cbe8ef2ba61e1c21c98 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 5 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
W20260709 13:18:55.999353  6872 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53416 (request call id 2001) took 1636 ms (client timeout 1909 ms). Trace:
I20260709 13:18:56.007880  6730 raft_consensus.cc:2468] T 4275cf08e63345f993bce8664eada830 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 4.
I20260709 13:18:56.014753  7466 leader_election.cc:304] T 404190ce4ce94cecbfcb6ea9d1dd8626 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:18:56.022015  6729 rpcz_store.cc:276] 0709 13:18:53.974312 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:53.974598 (+   286us) service_pool.cc:224] Handling call
0709 13:18:53.991617 (+ 17019us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:54.005880 (+ 14263us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:18:54.005922 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:54.006504 (+   582us) log.cc:844] Serialized 26 byte log entry
0709 13:18:54.130170 (+123666us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:18:54.130216 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:54.130288 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:55.779919 (+1649631us) spinlock_profiling.cc:243] Waited 15.3 ms on lock 0x7b4400022b4c. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0c745db1 00007fcc0c7e3c85 00007fcc0c7e46a2 00007fcc0f5561db 00007fcc0f551aaf 00007fcc0f54586e 00007fcc0f544bb6 00007fcc0f5447d8 00007fcc0f54e221 00007fcc0f54e1d9 00007fcc0f54e169
0709 13:18:56.021280 (+241361us) raft_consensus.cc:1685] finished
0709 13:18:56.021310 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:56.021579 (+   269us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":303,"raft.queue_time_us":13892,"raft.run_cpu_time_us":254,"raft.run_wall_time_us":38515,"spinlock_wait_cycles":35250432,"thread_start_us":123311,"threads_started":1,"wal-append.queue_time_us":265894}
W20260709 13:18:56.023191  6872 rpcz_store.cc:269] 0709 13:18:54.362831 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:54.481051 (+118220us) service_pool.cc:224] Handling call
0709 13:18:55.999111 (+1518060us) spinlock_profiling.cc:243] Waited 339 ms on lock 0x7b54001e91d4. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f9ae2fa 00007fcc1496fb17 00007fcc0deea6d4 00007fcc0deea662 00007fcc0deea591 00007fcc0deea50c 00007fcc0dee97c2 00007fcc0dce548c 00007fcc0dce48c6 00007fcc0dce426f
0709 13:18:55.999286 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":778669440}
I20260709 13:18:56.024493  6732 raft_consensus.cc:2368] T f03d0dbf16864ca4bc1bb5e4c0334c0f P ccd8a4c3bfe3413cb2ae219b09aea832 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c for earlier term 4. Current term is 5.
I20260709 13:18:55.845080  8573 consensus_queue.cc:260] T d8292e16e5654be6bc408560cf256aaa P cd75a17ab2604397adab03bb8b5fd75c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:56.033124  8573 raft_consensus.cc:3060] T d8292e16e5654be6bc408560cf256aaa P cd75a17ab2604397adab03bb8b5fd75c [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:56.006409  8100 raft_consensus.cc:515] T 2c240553ce044eedb41541d72b9475d7 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:56.019879  6798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be1a92657f494cac8dd227d152f50151" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:18:56.015048  8559 raft_consensus.cc:3055] T 4b8cacb381b746da8d0049b0a83b41dd P cd75a17ab2604397adab03bb8b5fd75c [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:18:56.037550  8559 raft_consensus.cc:740] T 4b8cacb381b746da8d0049b0a83b41dd P cd75a17ab2604397adab03bb8b5fd75c [term 4 LEADER]: Becoming Follower/Learner. State: Replica: cd75a17ab2604397adab03bb8b5fd75c, State: Running, Role: LEADER
I20260709 13:18:56.005822  8315 raft_consensus.cc:493] T be1a92657f494cac8dd227d152f50151 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:56.038923  8605 raft_consensus.cc:3055] T 30e88460611e47b2ba16a46a30b5f416 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:18:56.038563  8559 consensus_queue.cc:260] T 4b8cacb381b746da8d0049b0a83b41dd P cd75a17ab2604397adab03bb8b5fd75c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:18:56.039326  8315 raft_consensus.cc:3060] T be1a92657f494cac8dd227d152f50151 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:56.016144  6807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6869f07b5a4885a0b99fbe60c3b175" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 6 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:18:56.042438  6807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8292e16e5654be6bc408560cf256aaa" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:18:56.042613  8519 leader_election.cc:290] T 404190ce4ce94cecbfcb6ea9d1dd8626 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:18:56.043371  6807 raft_consensus.cc:2393] T d8292e16e5654be6bc408560cf256aaa P b7ab4784c7344b939bc36f639286f377 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ccd8a4c3bfe3413cb2ae219b09aea832 in current term 5: Already voted for candidate b7ab4784c7344b939bc36f639286f377 in this term.
W20260709 13:18:56.043828  8609 log.cc:927] Time spent T c4db81d9d329422bb3b4160ca4ac2d1d P ccd8a4c3bfe3413cb2ae219b09aea832: Append to log took a long time: real 0.110s	user 0.000s	sys 0.001s
I20260709 13:18:55.990140  8586 raft_consensus.cc:2749] T 30e88460611e47b2ba16a46a30b5f416 P b7ab4784c7344b939bc36f639286f377 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:18:56.026074  8389 raft_consensus.cc:2749] T 404190ce4ce94cecbfcb6ea9d1dd8626 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:18:56.038093  6798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c37d41cd9164c15a6826ca62a851a69" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:18:56.048327  6798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44bde925b2e541b69890d70715b85176" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:18:56.048604  7993 leader_election.cc:290] T be1a92657f494cac8dd227d152f50151 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:18:56.050084  6798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4275cf08e63345f993bce8664eada830" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:18:56.051187  6803 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:32966 (request call id 569) took 1380 ms. Trace:
I20260709 13:18:56.052520  6728 raft_consensus.cc:1240] T d8292e16e5654be6bc408560cf256aaa P ccd8a4c3bfe3413cb2ae219b09aea832 [term 5 FOLLOWER]: Rejecting Update request from peer cd75a17ab2604397adab03bb8b5fd75c for earlier term 4. Current term is 5. Ops: []
I20260709 13:18:56.051641  6803 rpcz_store.cc:276] 0709 13:18:54.671063 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:54.693325 (+ 22262us) service_pool.cc:224] Handling call
0709 13:18:54.693701 (+   376us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:55.400580 (+706879us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:56.050815 (+650235us) spinlock_profiling.cc:243] Waited 700 ms on lock 0x7b54001d15d4. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f9aae01 00007fcc0f9a983e 00007fcc1496e419 00007fcc0dee5bd4 00007fcc0dee5b62 00007fcc0dee5a91 00007fcc0dee5a0c 00007fcc0dee4cc2 00007fcc0dce548c 00007fcc0dce48c6
0709 13:18:56.051113 (+   298us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1610038528}
I20260709 13:18:56.054492  8100 leader_election.cc:290] T 2c240553ce044eedb41541d72b9475d7 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:18:56.054926  6803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09c2a98de1a4decabd0ff900dd44caa" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:18:56.055693  6803 raft_consensus.cc:3060] T f09c2a98de1a4decabd0ff900dd44caa P b7ab4784c7344b939bc36f639286f377 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:56.060158  8559 raft_consensus.cc:3060] T 4b8cacb381b746da8d0049b0a83b41dd P cd75a17ab2604397adab03bb8b5fd75c [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:56.061360  6806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce4f062dcd314d43a63ca74067cb5ee3" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:18:56.062152  6806 raft_consensus.cc:2393] T ce4f062dcd314d43a63ca74067cb5ee3 P b7ab4784c7344b939bc36f639286f377 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in current term 5: Already voted for candidate cd75a17ab2604397adab03bb8b5fd75c in this term.
I20260709 13:18:56.041586  8602 raft_consensus.cc:2955] T 24ee15416e3145beaa1b8183453729a3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 4 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } attrs { replace: true } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } } }
I20260709 13:18:56.111980  6873 raft_consensus.cc:1240] T 4275cf08e63345f993bce8664eada830 P cd75a17ab2604397adab03bb8b5fd75c [term 4 FOLLOWER]: Rejecting Update request from peer b7ab4784c7344b939bc36f639286f377 for earlier term 3. Current term is 4. Ops: []
I20260709 13:18:56.063023  6806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3f13b31a1f84f0d89d007eadd57924c" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:18:56.067477  6878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "711ef6523deb4cbe8ef2ba61e1c21c98" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:18:56.068861  6877 raft_consensus.cc:1240] T 9e326172347f45e99a0d482b5d8ef768 P cd75a17ab2604397adab03bb8b5fd75c [term 4 FOLLOWER]: Rejecting Update request from peer b7ab4784c7344b939bc36f639286f377 for earlier term 3. Current term is 4. Ops: []
I20260709 13:18:56.115439  6806 raft_consensus.cc:2468] T b3f13b31a1f84f0d89d007eadd57924c P b7ab4784c7344b939bc36f639286f377 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 2.
I20260709 13:18:56.069594  6874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4b8bd455d5a47c18a1380839c6e0d61" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:18:56.070564  7499 raft_consensus.cc:1240] T 427c124d773f483294511e80fe340075 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 4 FOLLOWER]: Rejecting Update request from peer ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 3. Current term is 4. Ops: []
W20260709 13:18:56.033124  8592 log.cc:927] Time spent T 44bde925b2e541b69890d70715b85176 P b7ab4784c7344b939bc36f639286f377: Append to log took a long time: real 0.703s	user 0.006s	sys 0.000s
I20260709 13:18:56.072558  7500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "404190ce4ce94cecbfcb6ea9d1dd8626" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:18:56.073751  7496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be1a92657f494cac8dd227d152f50151" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:18:56.125751  6801 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:32976 (request call id 1940) took 1208 ms. Trace:
I20260709 13:18:56.126264  6801 rpcz_store.cc:276] 0709 13:18:54.905814 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:54.948687 (+ 42873us) service_pool.cc:224] Handling call
0709 13:18:56.113844 (+1165157us) spinlock_profiling.cc:243] Waited 187 ms on lock 0x7b54001f4854. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f9ae2fa 00007fcc1496fb17 00007fcc0deea6d4 00007fcc0deea662 00007fcc0deea591 00007fcc0deea50c 00007fcc0dee97c2 00007fcc0dce548c 00007fcc0dce48c6 00007fcc0dce426f
0709 13:18:56.114026 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":430972416}
I20260709 13:18:56.039369  8605 raft_consensus.cc:740] T 30e88460611e47b2ba16a46a30b5f416 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
I20260709 13:18:56.075327  8100 raft_consensus.cc:493] T 8c7f33e544204fbaac4078e3e83bbf4e P ccd8a4c3bfe3413cb2ae219b09aea832 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:18:56.051973  6807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5be3a11b23d4ea9b08300a2789821c7" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:18:56.092468  7503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce4f062dcd314d43a63ca74067cb5ee3" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 6 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:18:56.116940  6874 raft_consensus.cc:2468] T f4b8bd455d5a47c18a1380839c6e0d61 P cd75a17ab2604397adab03bb8b5fd75c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 3.
I20260709 13:18:56.117259  6806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c44c4849aa54f2b94d1f1bef9ed546f" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:18:56.076716  6772 leader_election.cc:304] T be1a92657f494cac8dd227d152f50151 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, b7ab4784c7344b939bc36f639286f377; no voters: ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:18:56.127903  6803 raft_consensus.cc:2468] T f09c2a98de1a4decabd0ff900dd44caa P b7ab4784c7344b939bc36f639286f377 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 5.
W20260709 13:18:56.137562  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 271550us
I20260709 13:18:56.147991  6803 raft_consensus.cc:1240] T 7c37d41cd9164c15a6826ca62a851a69 P b7ab4784c7344b939bc36f639286f377 [term 4 LEADER]: Rejecting Update request from peer cd75a17ab2604397adab03bb8b5fd75c for earlier term 3. Current term is 4. Ops: []
I20260709 13:18:56.148018  6844 leader_election.cc:304] T 9e326172347f45e99a0d482b5d8ef768 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:18:56.152848  6801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1528ab62b6fe4e3099d08f141afee116" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
W20260709 13:18:56.158854  6772 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.68:45071, user_credentials={real_user=slave}} blocked reactor thread for 82204.3us
I20260709 13:18:56.053036  8593 raft_consensus.cc:515] T 7887766dc6784fcaa42b35c05fea7a99 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:56.160133  6772 leader_election.cc:304] T 24ee15416e3145beaa1b8183453729a3 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:18:56.162788  6803 raft_consensus.cc:1275] T a1704639a875409b9959353527b3fd68 P b7ab4784c7344b939bc36f639286f377 [term 4 FOLLOWER]: Refusing update from remote peer cd75a17ab2604397adab03bb8b5fd75c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:18:56.162932  6772 leader_election.cc:304] T bb7fa124c3bf4ef9ab65a407cb008441 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:18:56.158835  6806 raft_consensus.cc:2393] T 7c44c4849aa54f2b94d1f1bef9ed546f P b7ab4784c7344b939bc36f639286f377 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ccd8a4c3bfe3413cb2ae219b09aea832 in current term 5: Already voted for candidate b7ab4784c7344b939bc36f639286f377 in this term.
I20260709 13:18:56.169643  6880 raft_consensus.cc:1240] T 3411566abe2d4c9bb4b2adfdd05e6f17 P cd75a17ab2604397adab03bb8b5fd75c [term 3 LEADER]: Rejecting Update request from peer b7ab4784c7344b939bc36f639286f377 for earlier term 2. Current term is 3. Ops: []
I20260709 13:18:56.147398  6798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d65025eea89441290d85dd053810e31" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:18:56.171387  6772 leader_election.cc:304] T a3022224cc81473690653a83d4e99470 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:18:56.162860  8562 raft_consensus.cc:2804] T be1a92657f494cac8dd227d152f50151 P b7ab4784c7344b939bc36f639286f377 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:18:56.180413  8441 leader_election.cc:290] T b56bf91d90824c959e21e0cee5ba1816 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:18:56.175365  6798 raft_consensus.cc:3060] T 3d65025eea89441290d85dd053810e31 P b7ab4784c7344b939bc36f639286f377 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:56.177789  8519 raft_consensus.cc:493] T f3f9c2e2bf644115957398fe4c9459db P ccd8a4c3bfe3413cb2ae219b09aea832 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:56.174787  8574 raft_consensus.cc:2749] T bb7fa124c3bf4ef9ab65a407cb008441 P b7ab4784c7344b939bc36f639286f377 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:18:56.185156  8458 leader_election.cc:290] T 7887766dc6784fcaa42b35c05fea7a99 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 4 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:18:56.186345  8315 raft_consensus.cc:515] T be1a92657f494cac8dd227d152f50151 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:18:56.219386  8315 leader_election.cc:290] T be1a92657f494cac8dd227d152f50151 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 5 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:18:56.186789  7499 raft_consensus.cc:1275] T 3fa34c08b205435dba97346991aa1f92 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 5 FOLLOWER]: Refusing update from remote peer ccd8a4c3bfe3413cb2ae219b09aea832: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:18:56.220981  7496 raft_consensus.cc:2393] T be1a92657f494cac8dd227d152f50151 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ccd8a4c3bfe3413cb2ae219b09aea832 in current term 5: Already voted for candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in this term.
I20260709 13:18:56.221632  8433 raft_consensus.cc:3060] T 95a75bfe094d4bdc963aba3f08dfcd25 P cd75a17ab2604397adab03bb8b5fd75c [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:56.222931  8475 raft_consensus.cc:3060] T de3186201e1a40d0b335eeb8b4e256e0 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:18:56.232254  6696 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:56.165921  8542 leader_election.cc:290] T 07a92dd554674067a83a9cb68c4773f2 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
W20260709 13:18:56.235796  6845 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:56.236732  8610 log.cc:927] Time spent T 17587d6730594da4a56fa13a353232a1 P 7ba59cc884714e8aa5f3f0ecaed84cbb: Append to log took a long time: real 0.225s	user 0.001s	sys 0.000s
I20260709 13:18:56.201893  8562 raft_consensus.cc:493] T be1a92657f494cac8dd227d152f50151 P b7ab4784c7344b939bc36f639286f377 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 7ba59cc884714e8aa5f3f0ecaed84cbb)
I20260709 13:18:56.240193  8562 raft_consensus.cc:3060] T be1a92657f494cac8dd227d152f50151 P b7ab4784c7344b939bc36f639286f377 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:56.245131  6800 raft_consensus.cc:1240] T d33d5ee8ef6f415593d8df52063161ad P b7ab4784c7344b939bc36f639286f377 [term 5 FOLLOWER]: Rejecting Update request from peer ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 4. Current term is 5. Ops: []
I20260709 13:18:56.247015  6800 raft_consensus.cc:1275] T 9b3759de40694069b13c0f8bd40e5709 P b7ab4784c7344b939bc36f639286f377 [term 4 FOLLOWER]: Refusing update from remote peer ccd8a4c3bfe3413cb2ae219b09aea832: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:18:56.176808  8605 consensus_queue.cc:260] T 30e88460611e47b2ba16a46a30b5f416 P ccd8a4c3bfe3413cb2ae219b09aea832 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:56.248586  8605 raft_consensus.cc:3060] T 30e88460611e47b2ba16a46a30b5f416 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:56.190351  8423 consensus_queue.cc:1048] T ce4f062dcd314d43a63ca74067cb5ee3 P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Connected to new peer: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:18:56.253978  8423 consensus_queue.cc:1059] T f09c2a98de1a4decabd0ff900dd44caa P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:18:56.192266  8448 consensus_queue.cc:1059] T dbdf895bba214ff68685a24fd17dfb5d P b7ab4784c7344b939bc36f639286f377 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: INVALID_TERM, Last received: 4.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:18:56.194329  6772 leader_election.cc:304] T 7c44c4849aa54f2b94d1f1bef9ed546f P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:18:56.197398  7500 raft_consensus.cc:1240] T 4b8cacb381b746da8d0049b0a83b41dd P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 5 FOLLOWER]: Rejecting Update request from peer cd75a17ab2604397adab03bb8b5fd75c for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 13:18:56.168803  8586 raft_consensus.cc:2749] T 24ee15416e3145beaa1b8183453729a3 P b7ab4784c7344b939bc36f639286f377 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:18:56.144857  8100 raft_consensus.cc:515] T 8c7f33e544204fbaac4078e3e83bbf4e P ccd8a4c3bfe3413cb2ae219b09aea832 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:56.168907  8573 raft_consensus.cc:2804] T 9e326172347f45e99a0d482b5d8ef768 P cd75a17ab2604397adab03bb8b5fd75c [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:18:56.209115  6697 leader_election.cc:304] T 3411566abe2d4c9bb4b2adfdd05e6f17 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:18:56.205969  7501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe20b4b48823486ca3b9c648db6ce8aa" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:18:56.210624  6805 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:32966 (request call id 572) took 1280 ms. Trace:
W20260709 13:18:56.262838  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 112940us
I20260709 13:18:56.216311  8519 raft_consensus.cc:515] T f3f9c2e2bf644115957398fe4c9459db P ccd8a4c3bfe3413cb2ae219b09aea832 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
W20260709 13:18:56.258255  6770 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 227123us
I20260709 13:18:56.262303  6805 rpcz_store.cc:276] 0709 13:18:54.930081 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:55.239194 (+309113us) service_pool.cc:224] Handling call
0709 13:18:55.260393 (+ 21199us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:18:55.260830 (+   437us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:55.260865 (+    35us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:18:55.261729 (+   864us) log.cc:844] Serialized 52 byte log entry
0709 13:18:55.272708 (+ 10979us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:18:55.272753 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:55.272826 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:56.032466 (+759640us) spinlock_profiling.cc:243] Waited 1.28 ms on lock 0x7b4400022b4c. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0c745db1 00007fcc0c7e3c85 00007fcc0c7e46a2 00007fcc0f5561db 00007fcc0f551aaf 00007fcc0f54586e 00007fcc0f544bb6 00007fcc0f5447d8 00007fcc0f54e221 00007fcc0f54e1d9 00007fcc0f54e169
0709 13:18:56.206909 (+174443us) raft_consensus.cc:1685] finished
0709 13:18:56.206945 (+    36us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:56.210524 (+  3579us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":3452,"raft.run_cpu_time_us":232,"raft.run_wall_time_us":6210,"spinlock_wait_cycles":2934016,"thread_start_us":10497,"threads_started":1,"wal-append.queue_time_us":67596}
W20260709 13:18:56.270288  6697 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 61269.9us
I20260709 13:18:56.272904  6800 raft_consensus.cc:1275] T f4b8bd455d5a47c18a1380839c6e0d61 P b7ab4784c7344b939bc36f639286f377 [term 3 FOLLOWER]: Refusing update from remote peer ccd8a4c3bfe3413cb2ae219b09aea832: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:18:56.260787  6626 catalog_manager.cc:5697] T 24ee15416e3145beaa1b8183453729a3 P 7ba59cc884714e8aa5f3f0ecaed84cbb reported cstate change: term changed from 1 to 4, leader changed from ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65) to 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68), now has a pending config: VOTER ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65), VOTER b7ab4784c7344b939bc36f639286f377 (127.5.126.66), VOTER cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67), VOTER 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68). New cstate: current_term: 4 leader_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: NON_VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: true } health_report { overall_health: HEALTHY } } } pending_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } attrs { replace: true } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } } }
I20260709 13:18:56.279798  6626 catalog_manager.cc:5697] T d8cee0accdb8499c86d4414b72565a38 P 7ba59cc884714e8aa5f3f0ecaed84cbb reported cstate change: term changed from 1 to 5. New cstate: current_term: 5 leader_uuid: "b7ab4784c7344b939bc36f639286f377" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } } }
I20260709 13:18:56.281167  6626 catalog_manager.cc:5697] T bb3d8792045a4583ae2e965b1350a5b4 P 7ba59cc884714e8aa5f3f0ecaed84cbb reported cstate change: term changed from 3 to 4, leader changed from 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68) to ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65). New cstate: current_term: 4 leader_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } } }
I20260709 13:18:56.282578  8614 raft_consensus.cc:493] T 90d42e216d9741e190bca19a781291fd P cd75a17ab2604397adab03bb8b5fd75c [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:18:56.283272  8614 raft_consensus.cc:515] T 90d42e216d9741e190bca19a781291fd P cd75a17ab2604397adab03bb8b5fd75c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:56.282527  6626 catalog_manager.cc:5697] T 427c124d773f483294511e80fe340075 P 7ba59cc884714e8aa5f3f0ecaed84cbb reported cstate change: term changed from 1 to 3, leader changed from cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67) to ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65), now has a pending config: VOTER ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65), VOTER b7ab4784c7344b939bc36f639286f377 (127.5.126.66), VOTER cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67), VOTER 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68). New cstate: current_term: 3 leader_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } attrs { replace: true } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: NON_VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: true } } } pending_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } attrs { replace: true } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } } }
W20260709 13:18:56.294137  6772 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 99890.8us
I20260709 13:18:56.295306  6772 leader_election.cc:304] T 3d65025eea89441290d85dd053810e31 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:18:56.168670  6806 raft_consensus.cc:2955] T 427c124d773f483294511e80fe340075 P b7ab4784c7344b939bc36f639286f377 [term 3 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } attrs { replace: true } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } } }
I20260709 13:18:56.303455  8576 raft_consensus.cc:2804] T 7c44c4849aa54f2b94d1f1bef9ed546f P b7ab4784c7344b939bc36f639286f377 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:18:56.304293  8574 consensus_queue.cc:1059] T ab432e62819d499eaaf3dd55481dd930 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:18:56.307694  8576 raft_consensus.cc:697] T 7c44c4849aa54f2b94d1f1bef9ed546f P b7ab4784c7344b939bc36f639286f377 [term 5 LEADER]: Becoming Leader. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
I20260709 13:18:56.290973  8529 raft_consensus.cc:3055] T f09c2a98de1a4decabd0ff900dd44caa P cd75a17ab2604397adab03bb8b5fd75c [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:18:56.317112  6772 leader_election.cc:304] T f4b8bd455d5a47c18a1380839c6e0d61 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:18:56.317783  6800 raft_consensus.cc:1240] T 30e88460611e47b2ba16a46a30b5f416 P b7ab4784c7344b939bc36f639286f377 [term 3 FOLLOWER]: Rejecting Update request from peer ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 2. Current term is 3. Ops: []
I20260709 13:18:56.289584  8603 raft_consensus.cc:2749] T 3411566abe2d4c9bb4b2adfdd05e6f17 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:18:56.290088  8573 raft_consensus.cc:697] T 9e326172347f45e99a0d482b5d8ef768 P cd75a17ab2604397adab03bb8b5fd75c [term 4 LEADER]: Becoming Leader. State: Replica: cd75a17ab2604397adab03bb8b5fd75c, State: Running, Role: LEADER
I20260709 13:18:56.296432  8542 raft_consensus.cc:3055] T dbdf895bba214ff68685a24fd17dfb5d P b7ab4784c7344b939bc36f639286f377 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:18:56.293395  6626 catalog_manager.cc:5697] T bb7fa124c3bf4ef9ab65a407cb008441 P 7ba59cc884714e8aa5f3f0ecaed84cbb reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:18:56.359640  6872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1704639a875409b9959353527b3fd68" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:18:56.361027  6874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c37d41cd9164c15a6826ca62a851a69" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:18:56.362015  6878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09c2a98de1a4decabd0ff900dd44caa" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:18:56.366915  6874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bf4668eeb70467fb3dc5a0289233b3c" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:18:56.367712  6874 raft_consensus.cc:2410] T 1bf4668eeb70467fb3dc5a0289233b3c P cd75a17ab2604397adab03bb8b5fd75c [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ccd8a4c3bfe3413cb2ae219b09aea832 for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
W20260709 13:18:56.368191  6772 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 47812.8us
I20260709 13:18:56.369015  6874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a734b5ab7834e05a8c422208acc58b1" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:18:56.370296  6878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7887766dc6784fcaa42b35c05fea7a99" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:18:56.371486  6879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c44c4849aa54f2b94d1f1bef9ed546f" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:18:56.371785  6876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b56bf91d90824c959e21e0cee5ba1816" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:18:56.372220  6879 raft_consensus.cc:2393] T 7c44c4849aa54f2b94d1f1bef9ed546f P cd75a17ab2604397adab03bb8b5fd75c [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ccd8a4c3bfe3413cb2ae219b09aea832 in current term 5: Already voted for candidate b7ab4784c7344b939bc36f639286f377 in this term.
I20260709 13:18:56.375701  6873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a92dd554674067a83a9cb68c4773f2" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:18:56.376381  6873 raft_consensus.cc:2468] T 07a92dd554674067a83a9cb68c4773f2 P cd75a17ab2604397adab03bb8b5fd75c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 3.
I20260709 13:18:56.376842  6874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "713b5728a197487c9300b310ab94e5a3" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:18:56.377202  6873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7887766dc6784fcaa42b35c05fea7a99" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:18:56.377440  6874 raft_consensus.cc:2468] T 713b5728a197487c9300b310ab94e5a3 P cd75a17ab2604397adab03bb8b5fd75c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 4.
I20260709 13:18:56.378239  6874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44bde925b2e541b69890d70715b85176" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:18:56.378249  6873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d9def8b32fd443aa94ab1420b06837b" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:18:56.318187  8529 raft_consensus.cc:740] T f09c2a98de1a4decabd0ff900dd44caa P cd75a17ab2604397adab03bb8b5fd75c [term 4 LEADER]: Becoming Follower/Learner. State: Replica: cd75a17ab2604397adab03bb8b5fd75c, State: Running, Role: LEADER
I20260709 13:18:56.380184  6800 raft_consensus.cc:1240] T bb7fa124c3bf4ef9ab65a407cb008441 P b7ab4784c7344b939bc36f639286f377 [term 5 FOLLOWER]: Rejecting Update request from peer 7ba59cc884714e8aa5f3f0ecaed84cbb for earlier term 4. Current term is 5. Ops: []
I20260709 13:18:56.376391  6879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90d42e216d9741e190bca19a781291fd" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:18:56.389204  6803 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:32976 (request call id 1949) took 1054 ms. Trace:
I20260709 13:18:56.359397  8597 raft_consensus.cc:2749] T ce4f062dcd314d43a63ca74067cb5ee3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:18:56.438951  7503 raft_consensus.cc:2468] T ce4f062dcd314d43a63ca74067cb5ee3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 5.
I20260709 13:18:56.388707  6873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d65025eea89441290d85dd053810e31" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:18:56.388890  6772 leader_election.cc:304] T b56bf91d90824c959e21e0cee5ba1816 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:18:56.389581  6879 raft_consensus.cc:2468] T 90d42e216d9741e190bca19a781291fd P cd75a17ab2604397adab03bb8b5fd75c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 4.
I20260709 13:18:56.441027  6873 raft_consensus.cc:3060] T 3d65025eea89441290d85dd053810e31 P cd75a17ab2604397adab03bb8b5fd75c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:56.356913  8443 raft_consensus.cc:2804] T f4b8bd455d5a47c18a1380839c6e0d61 P b7ab4784c7344b939bc36f639286f377 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:18:56.389865  6803 rpcz_store.cc:276] 0709 13:18:55.334507 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:56.163793 (+829286us) service_pool.cc:224] Handling call
0709 13:18:56.174451 (+ 10658us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:56.174670 (+   219us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:18:56.185680 (+ 11010us) log.cc:844] Serialized 14 byte log entry
0709 13:18:56.388469 (+202789us) log.cc:844] Serialized 14 byte log entry
0709 13:18:56.388700 (+   231us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:56.388764 (+    64us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:18:56.388839 (+    75us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:56.388942 (+   103us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:56.389116 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":54997,"prepare.queue_time_us":17336,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":39,"thread_start_us":135128,"threads_started":1}
I20260709 13:18:56.393709  8394 raft_consensus.cc:493] T 7ba5dac66ab5497e9e336f2a3c28cda5 P b7ab4784c7344b939bc36f639286f377 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 7ba59cc884714e8aa5f3f0ecaed84cbb)
I20260709 13:18:56.395314  8614 leader_election.cc:290] T 90d42e216d9741e190bca19a781291fd P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:18:56.396137  8573 consensus_queue.cc:237] T 9e326172347f45e99a0d482b5d8ef768 P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:56.363389  8542 raft_consensus.cc:740] T dbdf895bba214ff68685a24fd17dfb5d P b7ab4784c7344b939bc36f639286f377 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
I20260709 13:18:56.398983  6728 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "07a92dd554674067a83a9cb68c4773f2"
dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
mode: GRACEFUL
new_leader_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
 from {username='slave'} at 127.0.0.1:38536
I20260709 13:18:56.450634  6728 raft_consensus.cc:606] T 07a92dd554674067a83a9cb68c4773f2 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 3 LEADER]: Received request to transfer leadership to TS cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:18:56.408778  6802 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50550 (request call id 117) took 3238 ms. Trace:
I20260709 13:18:56.409821  6881 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58592 (request call id 90) took 1381 ms. Trace:
I20260709 13:18:56.452721  6881 rpcz_store.cc:276] 0709 13:18:55.028688 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:55.028823 (+   135us) service_pool.cc:224] Handling call
0709 13:18:55.029163 (+   340us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:55.034533 (+  5370us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:55.034571 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:55.035080 (+   509us) log.cc:844] Serialized 26 byte log entry
0709 13:18:55.973958 (+938878us) spinlock_profiling.cc:243] Waited 2.93 ms on lock 0x7b4800210258. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc148d3aa1 00007fcc148cab37 00007fcc148ca9ca 00007fcc149c226f 00007fcc149c1f37 00007fcc149d655c 00007fcc149d6508 00007fcc149d6488 00007fcc149d6443 00007fcc149d56ec 00007fcc138ffa96
0709 13:18:56.035280 (+ 61322us) spinlock_profiling.cc:243] Waited 5.73 ms on lock 0x7b180013c6c0. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc15785de1 00007fcc157925b1 00007fcc0c89fe07 00007fcc156faab9 00007fcc0c8bc69b 00007fcc0c8ba93f 00007fcc0c8bcc02 00007fcc0f54420b 00007fcc0f549d23 00007fcc0f54a0d1 00007fcc0f965a0f
0709 13:18:56.173731 (+138451us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:18:56.175847 (+  2116us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:56.175919 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:56.409540 (+233621us) raft_consensus.cc:1685] finished
0709 13:18:56.409565 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:56.409747 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4847,"raft.queue_time_us":5046,"raft.run_cpu_time_us":13101,"raft.run_wall_time_us":933257,"spinlock_wait_cycles":19918976,"thread_start_us":138236,"threads_started":1,"wal-append.queue_time_us":1266521}
I20260709 13:18:56.316378  8596 consensus_queue.cc:1059] T 4275cf08e63345f993bce8664eada830 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.063s
I20260709 13:18:56.410815  6878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8292e16e5654be6bc408560cf256aaa" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:18:56.414008  8467 raft_consensus.cc:2804] T a3022224cc81473690653a83d4e99470 P b7ab4784c7344b939bc36f639286f377 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:18:56.414592  8576 consensus_queue.cc:237] T 7c44c4849aa54f2b94d1f1bef9ed546f P b7ab4784c7344b939bc36f639286f377 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:56.417400  8519 leader_election.cc:290] T f3f9c2e2bf644115957398fe4c9459db P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:18:56.418956  8100 leader_election.cc:290] T 8c7f33e544204fbaac4078e3e83bbf4e P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:18:56.321266  8586 consensus_queue.cc:1059] T 9e326172347f45e99a0d482b5d8ef768 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.066s
W20260709 13:18:56.473035  6698 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:56.435456  8619 raft_consensus.cc:493] T f58dc08b12a2494bb9a1372837970ca2 P cd75a17ab2604397adab03bb8b5fd75c [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:56.437014  8529 consensus_queue.cc:260] T f09c2a98de1a4decabd0ff900dd44caa P cd75a17ab2604397adab03bb8b5fd75c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:56.445258  6872 raft_consensus.cc:3055] T 7c37d41cd9164c15a6826ca62a851a69 P cd75a17ab2604397adab03bb8b5fd75c [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:18:56.478518  6872 raft_consensus.cc:740] T 7c37d41cd9164c15a6826ca62a851a69 P cd75a17ab2604397adab03bb8b5fd75c [term 3 LEADER]: Becoming Follower/Learner. State: Replica: cd75a17ab2604397adab03bb8b5fd75c, State: Running, Role: LEADER
W20260709 13:18:56.446082  6772 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 57280.9us
I20260709 13:18:56.478940  6846 leader_election.cc:304] T fe20b4b48823486ca3b9c648db6ce8aa P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:18:56.446174  6807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1704639a875409b9959353527b3fd68" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:18:56.479573  6772 leader_election.cc:304] T 07a92dd554674067a83a9cb68c4773f2 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:18:56.448588  6800 raft_consensus.cc:1240] T f09c2a98de1a4decabd0ff900dd44caa P b7ab4784c7344b939bc36f639286f377 [term 5 FOLLOWER]: Rejecting Update request from peer cd75a17ab2604397adab03bb8b5fd75c for earlier term 4. Current term is 5. Ops: []
I20260709 13:18:56.451602  6802 rpcz_store.cc:276] 0709 13:18:53.170446 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:54.224577 (+1054131us) service_pool.cc:224] Handling call
0709 13:18:54.224878 (+   301us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:54.338249 (+113371us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:54.338286 (+    37us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:54.338329 (+    43us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:18:54.338361 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:56.408363 (+2070002us) spinlock_profiling.cc:243] Waited 113 ms on lock 0x7b54001cbbd4. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f9aae01 00007fcc0f9a983e 00007fcc1496e419 00007fcc0dee5bd4 00007fcc0dee5b62 00007fcc0dee5a91 00007fcc0dee5a0c 00007fcc0dee4cc2 00007fcc0dce548c 00007fcc0dce48c6
0709 13:18:56.408440 (+    77us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:56.408640 (+   200us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":260140800}
I20260709 13:18:56.459132  6878 raft_consensus.cc:2410] T d8292e16e5654be6bc408560cf256aaa P cd75a17ab2604397adab03bb8b5fd75c [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ccd8a4c3bfe3413cb2ae219b09aea832 for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:18:56.462829  6803 raft_consensus.cc:1240] T 711ef6523deb4cbe8ef2ba61e1c21c98 P b7ab4784c7344b939bc36f639286f377 [term 5 FOLLOWER]: Rejecting Update request from peer cd75a17ab2604397adab03bb8b5fd75c for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 13:18:56.445334  8443 raft_consensus.cc:493] T f4b8bd455d5a47c18a1380839c6e0d61 P b7ab4784c7344b939bc36f639286f377 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:56.466821  6873 raft_consensus.cc:2468] T 3d65025eea89441290d85dd053810e31 P cd75a17ab2604397adab03bb8b5fd75c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 3.
I20260709 13:18:56.455293  8458 raft_consensus.cc:2749] T b56bf91d90824c959e21e0cee5ba1816 P b7ab4784c7344b939bc36f639286f377 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:18:56.426887  8562 raft_consensus.cc:515] T be1a92657f494cac8dd227d152f50151 P b7ab4784c7344b939bc36f639286f377 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:18:56.492621  6878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f9c2e2bf644115957398fe4c9459db" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:18:56.493583  6878 raft_consensus.cc:2468] T f3f9c2e2bf644115957398fe4c9459db P cd75a17ab2604397adab03bb8b5fd75c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 4.
I20260709 13:18:56.459702  8597 consensus_queue.cc:1059] T bb7fa124c3bf4ef9ab65a407cb008441 P 7ba59cc884714e8aa5f3f0ecaed84cbb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.031s
I20260709 13:18:56.476402  6697 leader_election.cc:304] T 1bf4668eeb70467fb3dc5a0289233b3c P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:18:56.480268  6807 raft_consensus.cc:2468] T a1704639a875409b9959353527b3fd68 P b7ab4784c7344b939bc36f639286f377 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 4.
I20260709 13:18:56.483709  6873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20f6842e26174571996b8dea4151d4be" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:18:56.456082  8394 raft_consensus.cc:515] T 7ba5dac66ab5497e9e336f2a3c28cda5 P b7ab4784c7344b939bc36f639286f377 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:18:56.452855  8559 raft_consensus.cc:493] T 20f6842e26174571996b8dea4151d4be P cd75a17ab2604397adab03bb8b5fd75c [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:18:56.506721  6807 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:32976 (request call id 1951) took 1171 ms. Trace:
I20260709 13:18:56.507820  6807 rpcz_store.cc:276] 0709 13:18:55.335300 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:56.138765 (+803465us) service_pool.cc:224] Handling call
0709 13:18:56.446006 (+307241us) spinlock_profiling.cc:243] Waited 3.99 ms on lock 0x7b5800003098. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0c745db1 00007fcc0c885b71 00007fcc0c885a22 00007fcc1579ec09 00007fcc148f8ee0 00007fcc149c20ab 00007fcc149c2131 00007fcc149700a0 00007fcc1496f984 00007fcc0deea6d4 00007fcc0deea662
0709 13:18:56.506654 (+ 60648us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":9170816}
I20260709 13:18:56.487061  8443 raft_consensus.cc:3060] T f4b8bd455d5a47c18a1380839c6e0d61 P b7ab4784c7344b939bc36f639286f377 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:56.507121  6803 raft_consensus.cc:1275] T 22ccee1b570c4ad3a57bd7aec085b1b4 P b7ab4784c7344b939bc36f639286f377 [term 4 FOLLOWER]: Refusing update from remote peer cd75a17ab2604397adab03bb8b5fd75c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:18:56.509964  6697 leader_election.cc:304] T 7a734b5ab7834e05a8c422208acc58b1 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:18:56.511514  6697 leader_election.cc:304] T 713b5728a197487c9300b310ab94e5a3 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
W20260709 13:18:56.474064  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 210328us
I20260709 13:18:56.516737  6844 leader_election.cc:304] T 4275cf08e63345f993bce8664eada830 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:18:56.519007  6844 leader_election.cc:400] T f03d0dbf16864ca4bc1bb5e4c0334c0f P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 4 pre-election: Vote denied by peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391) with higher term. Message: Invalid argument: T f03d0dbf16864ca4bc1bb5e4c0334c0f P ccd8a4c3bfe3413cb2ae219b09aea832 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c for earlier term 4. Current term is 5.
I20260709 13:18:56.519516  6844 leader_election.cc:403] T f03d0dbf16864ca4bc1bb5e4c0334c0f P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 4 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:18:56.498131  8529 raft_consensus.cc:3060] T f09c2a98de1a4decabd0ff900dd44caa P cd75a17ab2604397adab03bb8b5fd75c [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:56.499821  6872 consensus_queue.cc:260] T 7c37d41cd9164c15a6826ca62a851a69 P cd75a17ab2604397adab03bb8b5fd75c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:56.526715  6872 raft_consensus.cc:3060] T 7c37d41cd9164c15a6826ca62a851a69 P cd75a17ab2604397adab03bb8b5fd75c [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:56.528291  6878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f03d0dbf16864ca4bc1bb5e4c0334c0f" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:18:56.528898  6878 raft_consensus.cc:3060] T f03d0dbf16864ca4bc1bb5e4c0334c0f P cd75a17ab2604397adab03bb8b5fd75c [term 3 FOLLOWER]: Advancing to term 5
I20260709 13:18:56.495193  6798 raft_consensus.cc:2468] T 3d65025eea89441290d85dd053810e31 P b7ab4784c7344b939bc36f639286f377 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 3.
I20260709 13:18:56.542444  6727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90d42e216d9741e190bca19a781291fd" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:18:56.543010  6697 leader_election.cc:304] T 90d42e216d9741e190bca19a781291fd P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:18:56.543467  6727 raft_consensus.cc:2468] T 90d42e216d9741e190bca19a781291fd P ccd8a4c3bfe3413cb2ae219b09aea832 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 4.
I20260709 13:18:56.524338  8605 raft_consensus.cc:2804] T 713b5728a197487c9300b310ab94e5a3 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:18:56.523276  8100 raft_consensus.cc:2749] T 7a734b5ab7834e05a8c422208acc58b1 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:18:56.522967  8519 raft_consensus.cc:2749] T 1bf4668eeb70467fb3dc5a0289233b3c P ccd8a4c3bfe3413cb2ae219b09aea832 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:18:56.550686  6800 raft_consensus.cc:1275] T b56bf91d90824c959e21e0cee5ba1816 P b7ab4784c7344b939bc36f639286f377 [term 4 FOLLOWER]: Refusing update from remote peer cd75a17ab2604397adab03bb8b5fd75c: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:18:56.556798  6727 raft_consensus.cc:1275] T 22ccee1b570c4ad3a57bd7aec085b1b4 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 4 FOLLOWER]: Refusing update from remote peer cd75a17ab2604397adab03bb8b5fd75c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:18:56.563952  6803 raft_consensus.cc:1275] T ce4f062dcd314d43a63ca74067cb5ee3 P b7ab4784c7344b939bc36f639286f377 [term 5 FOLLOWER]: Refusing update from remote peer cd75a17ab2604397adab03bb8b5fd75c: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
W20260709 13:18:56.556989  6846 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.68:45071, user_credentials={real_user=slave}} blocked reactor thread for 78125us
I20260709 13:18:56.558055  6807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90d42e216d9741e190bca19a781291fd" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:18:56.490109  8619 raft_consensus.cc:515] T f58dc08b12a2494bb9a1372837970ca2 P cd75a17ab2604397adab03bb8b5fd75c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:56.525792  6876 raft_consensus.cc:2955] T 427c124d773f483294511e80fe340075 P cd75a17ab2604397adab03bb8b5fd75c [term 3 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } attrs { replace: true } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } } }
I20260709 13:18:56.540551  8448 raft_consensus.cc:2764] T 3d65025eea89441290d85dd053810e31 P b7ab4784c7344b939bc36f639286f377 [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
I20260709 13:18:56.566337  6697 leader_election.cc:304] T 3d65025eea89441290d85dd053810e31 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:18:56.574165  6697 leader_election.cc:304] T f3f9c2e2bf644115957398fe4c9459db P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:18:56.582661  6878 raft_consensus.cc:2468] T f03d0dbf16864ca4bc1bb5e4c0334c0f P cd75a17ab2604397adab03bb8b5fd75c [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 5.
I20260709 13:18:56.501215  8542 consensus_queue.cc:260] T dbdf895bba214ff68685a24fd17dfb5d P b7ab4784c7344b939bc36f639286f377 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:56.548913  6798 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:32976 (request call id 1963) took 1095 ms. Trace:
I20260709 13:18:56.525295  8559 raft_consensus.cc:515] T 20f6842e26174571996b8dea4151d4be P cd75a17ab2604397adab03bb8b5fd75c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:56.561461  8605 raft_consensus.cc:493] T 713b5728a197487c9300b310ab94e5a3 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:56.559340  8594 raft_consensus.cc:2804] T 90d42e216d9741e190bca19a781291fd P ccd8a4c3bfe3413cb2ae219b09aea832 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:18:56.558646  8627 raft_consensus.cc:493] T 95a75bfe094d4bdc963aba3f08dfcd25 P cd75a17ab2604397adab03bb8b5fd75c [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:56.567494  8614 raft_consensus.cc:493] T e31b9971c15848dea59d4d4130141d9e P cd75a17ab2604397adab03bb8b5fd75c [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:18:56.599774  6872 raft_consensus.cc:1275] T 7c37d41cd9164c15a6826ca62a851a69 P cd75a17ab2604397adab03bb8b5fd75c [term 4 FOLLOWER]: Refusing update from remote peer b7ab4784c7344b939bc36f639286f377: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 3. (term mismatch)
I20260709 13:18:56.667721  6872 pending_rounds.cc:85] T 7c37d41cd9164c15a6826ca62a851a69 P cd75a17ab2604397adab03bb8b5fd75c: Aborting all ops after (but not including) 2
I20260709 13:18:56.668059  6872 pending_rounds.cc:107] T 7c37d41cd9164c15a6826ca62a851a69 P cd75a17ab2604397adab03bb8b5fd75c: Aborting uncommitted NO_OP operation due to leader change: 3.3
I20260709 13:18:56.583634  8575 raft_consensus.cc:2804] T 3d65025eea89441290d85dd053810e31 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:18:56.610554  8638 raft_consensus.cc:2804] T 4275cf08e63345f993bce8664eada830 P cd75a17ab2604397adab03bb8b5fd75c [term 4 FOLLOWER]: Leader election won for term 4
W20260709 13:18:56.612418  8625 log.cc:927] Time spent T a3022224cc81473690653a83d4e99470 P b7ab4784c7344b939bc36f639286f377: Append to log took a long time: real 0.112s	user 0.000s	sys 0.000s
I20260709 13:18:56.614032  8631 raft_consensus.cc:493] T bb3d8792045a4583ae2e965b1350a5b4 P cd75a17ab2604397adab03bb8b5fd75c [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:18:56.616420  8635 raft_consensus.cc:493] T de3186201e1a40d0b335eeb8b4e256e0 P cd75a17ab2604397adab03bb8b5fd75c [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:56.624187  8526 raft_consensus.cc:3055] T b3f13b31a1f84f0d89d007eadd57924c P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:18:56.602249  8637 raft_consensus.cc:2749] T fe20b4b48823486ca3b9c648db6ce8aa P cd75a17ab2604397adab03bb8b5fd75c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:56.578379  8406 raft_consensus.cc:2804] T f3f9c2e2bf644115957398fe4c9459db P ccd8a4c3bfe3413cb2ae219b09aea832 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:18:56.627660  8619 leader_election.cc:290] T f58dc08b12a2494bb9a1372837970ca2 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:18:56.640074  6697 leader_election.cc:304] T f03d0dbf16864ca4bc1bb5e4c0334c0f P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:18:56.630968  8094 raft_consensus.cc:493] T ab432e62819d499eaaf3dd55481dd930 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 4 FOLLOWER]: Starting leader election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:18:56.642138  6798 rpcz_store.cc:276] 0709 13:18:55.449894 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:56.124107 (+674213us) service_pool.cc:224] Handling call
0709 13:18:56.545106 (+420999us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:18:56.661593  6844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:56.716780  6844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:56.664333  6881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c7f33e544204fbaac4078e3e83bbf4e" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:18:56.668320  6872 raft_consensus.cc:2889] T 7c37d41cd9164c15a6826ca62a851a69 P cd75a17ab2604397adab03bb8b5fd75c [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:18:56.640365  8633 raft_consensus.cc:2749] T f03d0dbf16864ca4bc1bb5e4c0334c0f P cd75a17ab2604397adab03bb8b5fd75c [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: Vote denied by peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391) with higher term. Message: Invalid argument: T f03d0dbf16864ca4bc1bb5e4c0334c0f P ccd8a4c3bfe3413cb2ae219b09aea832 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c for earlier term 4. Current term is 5.
I20260709 13:18:56.705965  6873 raft_consensus.cc:2468] T 20f6842e26174571996b8dea4151d4be P cd75a17ab2604397adab03bb8b5fd75c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 3.
I20260709 13:18:56.671483  6878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b8cacb381b746da8d0049b0a83b41dd" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:18:56.719099  6878 raft_consensus.cc:2410] T 4b8cacb381b746da8d0049b0a83b41dd P cd75a17ab2604397adab03bb8b5fd75c [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate ccd8a4c3bfe3413cb2ae219b09aea832 for term 5 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 13:18:56.666962  8628 raft_consensus.cc:493] T f5be3a11b23d4ea9b08300a2789821c7 P cd75a17ab2604397adab03bb8b5fd75c [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:56.667291  8594 raft_consensus.cc:493] T 90d42e216d9741e190bca19a781291fd P ccd8a4c3bfe3413cb2ae219b09aea832 [term 4 FOLLOWER]: Starting leader election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:18:56.668956  8636 raft_consensus.cc:493] T d8292e16e5654be6bc408560cf256aaa P cd75a17ab2604397adab03bb8b5fd75c [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:56.717240  6844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:56.723464  6844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:56.724326  6844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:56.713784  8406 raft_consensus.cc:493] T f3f9c2e2bf644115957398fe4c9459db P ccd8a4c3bfe3413cb2ae219b09aea832 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:56.725951  8406 raft_consensus.cc:3060] T f3f9c2e2bf644115957398fe4c9459db P ccd8a4c3bfe3413cb2ae219b09aea832 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:18:56.717137  6697 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 77167.3us
I20260709 13:18:56.726894  8559 leader_election.cc:290] T 20f6842e26174571996b8dea4151d4be P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:18:56.727481  8559 raft_consensus.cc:493] T 34f36d59d88f40fe8a2805e604fc6c0a P cd75a17ab2604397adab03bb8b5fd75c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:18:56.710177  8526 raft_consensus.cc:740] T b3f13b31a1f84f0d89d007eadd57924c P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 7ba59cc884714e8aa5f3f0ecaed84cbb, State: Running, Role: LEADER
I20260709 13:18:56.708947  8542 raft_consensus.cc:3060] T dbdf895bba214ff68685a24fd17dfb5d P b7ab4784c7344b939bc36f639286f377 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:56.728353  6732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f58dc08b12a2494bb9a1372837970ca2" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:18:56.740234  6732 raft_consensus.cc:2468] T f58dc08b12a2494bb9a1372837970ca2 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 5.
I20260709 13:18:56.669549  8627 raft_consensus.cc:515] T 95a75bfe094d4bdc963aba3f08dfcd25 P cd75a17ab2604397adab03bb8b5fd75c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
W20260709 13:18:56.730525  6844 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.5.126.66:42817 timed out after 1.730s (SENT) [suppressed 28 similar messages]
I20260709 13:18:56.741986  6807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f58dc08b12a2494bb9a1372837970ca2" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:18:56.712970  8638 raft_consensus.cc:697] T 4275cf08e63345f993bce8664eada830 P cd75a17ab2604397adab03bb8b5fd75c [term 4 LEADER]: Becoming Leader. State: Replica: cd75a17ab2604397adab03bb8b5fd75c, State: Running, Role: LEADER
I20260709 13:18:56.733458  6872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c240553ce044eedb41541d72b9475d7" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:18:56.672236  8433 raft_consensus.cc:493] T 4d9def8b32fd443aa94ab1420b06837b P cd75a17ab2604397adab03bb8b5fd75c [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:18:56.718302  8094 raft_consensus.cc:3060] T ab432e62819d499eaaf3dd55481dd930 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:56.735644  6798 raft_consensus.cc:3055] T 3411566abe2d4c9bb4b2adfdd05e6f17 P b7ab4784c7344b939bc36f639286f377 [term 2 LEADER]: Stepping down as leader of term 2
W20260709 13:18:56.748127  8602 consensus_meta.cc:287] T 24ee15416e3145beaa1b8183453729a3 P 7ba59cc884714e8aa5f3f0ecaed84cbb: Time spent flushing consensus metadata: real 0.539s	user 0.010s	sys 0.003s
I20260709 13:18:56.748406  6798 raft_consensus.cc:740] T 3411566abe2d4c9bb4b2adfdd05e6f17 P b7ab4784c7344b939bc36f639286f377 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
I20260709 13:18:56.749408  6798 consensus_queue.cc:260] T 3411566abe2d4c9bb4b2adfdd05e6f17 P b7ab4784c7344b939bc36f639286f377 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:56.712517  8575 raft_consensus.cc:697] T 3d65025eea89441290d85dd053810e31 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 3 LEADER]: Becoming Leader. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
I20260709 13:18:56.750450  6798 raft_consensus.cc:3060] T 3411566abe2d4c9bb4b2adfdd05e6f17 P b7ab4784c7344b939bc36f639286f377 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:56.750918  8575 consensus_queue.cc:237] T 3d65025eea89441290d85dd053810e31 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:56.735852  6727 raft_consensus.cc:1275] T 3411566abe2d4c9bb4b2adfdd05e6f17 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 3 FOLLOWER]: Refusing update from remote peer cd75a17ab2604397adab03bb8b5fd75c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:18:56.671962  8614 raft_consensus.cc:515] T e31b9971c15848dea59d4d4130141d9e P cd75a17ab2604397adab03bb8b5fd75c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:56.754860  8614 leader_election.cc:290] T e31b9971c15848dea59d4d4130141d9e P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:18:56.711947  8635 raft_consensus.cc:515] T de3186201e1a40d0b335eeb8b4e256e0 P cd75a17ab2604397adab03bb8b5fd75c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:56.720661  7993 raft_consensus.cc:2804] T f03d0dbf16864ca4bc1bb5e4c0334c0f P ccd8a4c3bfe3413cb2ae219b09aea832 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:18:56.756862  8635 leader_election.cc:290] T de3186201e1a40d0b335eeb8b4e256e0 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:18:56.756970  7993 raft_consensus.cc:697] T f03d0dbf16864ca4bc1bb5e4c0334c0f P ccd8a4c3bfe3413cb2ae219b09aea832 [term 5 LEADER]: Becoming Leader. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
I20260709 13:18:56.757905  7993 consensus_queue.cc:237] T f03d0dbf16864ca4bc1bb5e4c0334c0f P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:56.760319  8394 leader_election.cc:290] T 7ba5dac66ab5497e9e336f2a3c28cda5 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:18:56.754947  8433 raft_consensus.cc:515] T 4d9def8b32fd443aa94ab1420b06837b P cd75a17ab2604397adab03bb8b5fd75c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:56.724469  8628 raft_consensus.cc:515] T f5be3a11b23d4ea9b08300a2789821c7 P cd75a17ab2604397adab03bb8b5fd75c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:56.749727  6879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce4f062dcd314d43a63ca74067cb5ee3" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 6 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:18:56.723249  8594 raft_consensus.cc:3060] T 90d42e216d9741e190bca19a781291fd P ccd8a4c3bfe3413cb2ae219b09aea832 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:56.762513  6879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7887766dc6784fcaa42b35c05fea7a99" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:18:56.713068  8631 raft_consensus.cc:515] T bb3d8792045a4583ae2e965b1350a5b4 P cd75a17ab2604397adab03bb8b5fd75c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:18:56.663795  8605 raft_consensus.cc:3060] T 713b5728a197487c9300b310ab94e5a3 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:56.765134  6881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "427c124d773f483294511e80fe340075" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:18:56.732656  8636 raft_consensus.cc:515] T d8292e16e5654be6bc408560cf256aaa P cd75a17ab2604397adab03bb8b5fd75c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:56.770437  8636 leader_election.cc:290] T d8292e16e5654be6bc408560cf256aaa P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
W20260709 13:18:56.772269  8630 log.cc:927] Time spent T 427c124d773f483294511e80fe340075 P b7ab4784c7344b939bc36f639286f377: Append to log took a long time: real 0.169s	user 0.001s	sys 0.000s
I20260709 13:18:56.773787  8526 consensus_queue.cc:260] T b3f13b31a1f84f0d89d007eadd57924c P 7ba59cc884714e8aa5f3f0ecaed84cbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:18:56.775008  8526 raft_consensus.cc:3060] T b3f13b31a1f84f0d89d007eadd57924c P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:56.743207  8562 leader_election.cc:290] T be1a92657f494cac8dd227d152f50151 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 4 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:18:56.780210  6799 raft_consensus.cc:2393] T f03d0dbf16864ca4bc1bb5e4c0334c0f P b7ab4784c7344b939bc36f639286f377 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c in current term 4: Already voted for candidate b7ab4784c7344b939bc36f639286f377 in this term.
I20260709 13:18:56.782663  6799 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:32966 (request call id 589) took 1017 ms. Trace:
I20260709 13:18:56.783133  6799 rpcz_store.cc:276] 0709 13:18:55.765418 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:55.850292 (+ 84874us) service_pool.cc:224] Handling call
0709 13:18:56.782399 (+932107us) spinlock_profiling.cc:243] Waited 778 ms on lock 0x7b54002c83d4. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f9ae2fa 00007fcc1496fb17 00007fcc0deea6d4 00007fcc0deea662 00007fcc0deea591 00007fcc0deea50c 00007fcc0dee97c2 00007fcc0dce548c 00007fcc0dce48c6 00007fcc0dce426f
0709 13:18:56.782586 (+   187us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1789585792}
I20260709 13:18:56.785907  8534 leader_election.cc:290] T 1528ab62b6fe4e3099d08f141afee116 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 5 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:18:56.754274  8638 consensus_queue.cc:237] T 4275cf08e63345f993bce8664eada830 P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:56.794739  6732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "427c124d773f483294511e80fe340075" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:18:56.767746  6881 raft_consensus.cc:1275] T 3fa34c08b205435dba97346991aa1f92 P cd75a17ab2604397adab03bb8b5fd75c [term 5 FOLLOWER]: Refusing update from remote peer ccd8a4c3bfe3413cb2ae219b09aea832: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:18:56.796411  6727 raft_consensus.cc:1240] T b3f13b31a1f84f0d89d007eadd57924c P ccd8a4c3bfe3413cb2ae219b09aea832 [term 3 FOLLOWER]: Rejecting Update request from peer 7ba59cc884714e8aa5f3f0ecaed84cbb for earlier term 2. Current term is 3. Ops: []
I20260709 13:18:56.797600  6728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1528ab62b6fe4e3099d08f141afee116" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:18:56.798233  6728 raft_consensus.cc:3060] T 1528ab62b6fe4e3099d08f141afee116 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:18:56.800185  6845 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:56.816601  6727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be1a92657f494cac8dd227d152f50151" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:18:56.817365  6727 raft_consensus.cc:3060] T be1a92657f494cac8dd227d152f50151 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:56.812453  6697 leader_election.cc:304] T 4b8cacb381b746da8d0049b0a83b41dd P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
I20260709 13:18:56.777976  8433 leader_election.cc:290] T 4d9def8b32fd443aa94ab1420b06837b P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
W20260709 13:18:56.830396  6696 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:56.727965  8559 raft_consensus.cc:515] T 34f36d59d88f40fe8a2805e604fc6c0a P cd75a17ab2604397adab03bb8b5fd75c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:56.844347  6728 raft_consensus.cc:2468] T 1528ab62b6fe4e3099d08f141afee116 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in term 5.
I20260709 13:18:56.785226  8406 raft_consensus.cc:515] T f3f9c2e2bf644115957398fe4c9459db P ccd8a4c3bfe3413cb2ae219b09aea832 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:56.852291  6798 raft_consensus.cc:1275] T 3411566abe2d4c9bb4b2adfdd05e6f17 P b7ab4784c7344b939bc36f639286f377 [term 3 FOLLOWER]: Refusing update from remote peer cd75a17ab2604397adab03bb8b5fd75c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
I20260709 13:18:56.872563  6798 pending_rounds.cc:85] T 3411566abe2d4c9bb4b2adfdd05e6f17 P b7ab4784c7344b939bc36f639286f377: Aborting all ops after (but not including) 1
I20260709 13:18:56.857964  8603 consensus_queue.cc:1059] T 427c124d773f483294511e80fe340075 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.4, Next index: 5, Last known committed idx: 2, Time since last communication: 0.017s
I20260709 13:18:56.876744  8631 leader_election.cc:290] T bb3d8792045a4583ae2e965b1350a5b4 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:18:56.880260  8636 raft_consensus.cc:493] T 7887766dc6784fcaa42b35c05fea7a99 P cd75a17ab2604397adab03bb8b5fd75c [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:56.883843  6727 raft_consensus.cc:2468] T be1a92657f494cac8dd227d152f50151 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in term 5.
W20260709 13:18:56.885553  7466 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:56.831708  8441 raft_consensus.cc:2804] T 07a92dd554674067a83a9cb68c4773f2 P b7ab4784c7344b939bc36f639286f377 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:18:56.894830  6798 pending_rounds.cc:107] T 3411566abe2d4c9bb4b2adfdd05e6f17 P b7ab4784c7344b939bc36f639286f377: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 13:18:56.853482  8519 raft_consensus.cc:2804] T 4b8cacb381b746da8d0049b0a83b41dd P ccd8a4c3bfe3413cb2ae219b09aea832 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:18:56.892372  8635 raft_consensus.cc:493] T 3a485a995abc4807b6e511e45419f737 P cd75a17ab2604397adab03bb8b5fd75c [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
W20260709 13:18:56.892381  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 161887us
I20260709 13:18:56.901456  6876 raft_consensus.cc:1275] T e77e330a82df4b43a745d57a68f6f057 P cd75a17ab2604397adab03bb8b5fd75c [term 6 FOLLOWER]: Refusing update from remote peer ccd8a4c3bfe3413cb2ae219b09aea832: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 6 index: 3. (index mismatch)
I20260709 13:18:56.903188  6881 raft_consensus.cc:1275] T c4db81d9d329422bb3b4160ca4ac2d1d P cd75a17ab2604397adab03bb8b5fd75c [term 4 FOLLOWER]: Refusing update from remote peer ccd8a4c3bfe3413cb2ae219b09aea832: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:18:56.882615  6730 raft_consensus.cc:2955] T 24ee15416e3145beaa1b8183453729a3 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 4 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } attrs { replace: true } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } } }
I20260709 13:18:56.917168  7498 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50744 (request call id 129) took 3044 ms. Trace:
I20260709 13:18:56.922168  7498 rpcz_store.cc:276] 0709 13:18:53.909621 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:53.926206 (+ 16585us) service_pool.cc:224] Handling call
0709 13:18:53.991481 (+ 65275us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:54.433298 (+441817us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:56.916706 (+2483408us) spinlock_profiling.cc:243] Waited 441 ms on lock 0x7b5400570154. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f9aae01 00007fcc0f9a983e 00007fcc1496e419 00007fcc0dee5bd4 00007fcc0dee5b62 00007fcc0dee5a91 00007fcc0dee5a0c 00007fcc0dee4cc2 00007fcc0dce548c 00007fcc0dce48c6
0709 13:18:56.917071 (+   365us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1013290752}
I20260709 13:18:56.909808  6798 raft_consensus.cc:2889] T 3411566abe2d4c9bb4b2adfdd05e6f17 P b7ab4784c7344b939bc36f639286f377 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:18:56.896436  6806 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:32976 (request call id 1950) took 1561 ms. Trace:
I20260709 13:18:56.936600  6806 rpcz_store.cc:276] 0709 13:18:55.334889 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:56.167765 (+832876us) service_pool.cc:224] Handling call
0709 13:18:56.168277 (+   512us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:56.168482 (+   205us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:18:56.327167 (+158685us) log.cc:844] Serialized 14 byte log entry
0709 13:18:56.486234 (+159067us) log.cc:844] Serialized 14 byte log entry
0709 13:18:56.788657 (+302423us) spinlock_profiling.cc:243] Waited 4.71 ms on lock 0x7b180006cdc0. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc15785de1 00007fcc157925b1 00007fcc0c837c0a 00007fcc15f77219 00007fcc0c8bfa40 00007fcc0c8ba4e4 00007fcc0c8ba455 00007fcc0f9a2060 00007fcc0f9b4716 00007fcc0f9c5287 00007fcc0f9c5208
0709 13:18:56.895969 (+107312us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:56.896070 (+   101us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:18:56.896128 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:56.896214 (+    86us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:56.896363 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":313683,"prepare.queue_time_us":22050,"raft.queue_time_us":324973,"raft.run_cpu_time_us":318,"raft.run_wall_time_us":41431,"spinlock_wait_cycles":28848640,"thread_start_us":216402,"threads_started":2,"wal-append.queue_time_us":207905}
I20260709 13:18:56.916883  8628 leader_election.cc:290] T f5be3a11b23d4ea9b08300a2789821c7 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:18:56.897215  8441 raft_consensus.cc:493] T 07a92dd554674067a83a9cb68c4773f2 P b7ab4784c7344b939bc36f639286f377 [term 3 FOLLOWER]: Starting leader election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:18:56.919543  6844 leader_election.cc:304] T 90d42e216d9741e190bca19a781291fd P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:18:56.939541  8441 raft_consensus.cc:3060] T 07a92dd554674067a83a9cb68c4773f2 P b7ab4784c7344b939bc36f639286f377 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:56.940868  6844 leader_election.cc:304] T f58dc08b12a2494bb9a1372837970ca2 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:18:56.944839  8631 raft_consensus.cc:2804] T 90d42e216d9741e190bca19a781291fd P cd75a17ab2604397adab03bb8b5fd75c [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:18:56.945365  8631 raft_consensus.cc:493] T 90d42e216d9741e190bca19a781291fd P cd75a17ab2604397adab03bb8b5fd75c [term 4 FOLLOWER]: Starting leader election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:18:56.946208  6806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20f6842e26174571996b8dea4151d4be" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:18:56.893079  8443 raft_consensus.cc:515] T f4b8bd455d5a47c18a1380839c6e0d61 P b7ab4784c7344b939bc36f639286f377 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:56.948362  6806 raft_consensus.cc:2393] T 20f6842e26174571996b8dea4151d4be P b7ab4784c7344b939bc36f639286f377 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c in current term 4: Already voted for candidate b7ab4784c7344b939bc36f639286f377 in this term.
I20260709 13:18:56.949579  6798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e31b9971c15848dea59d4d4130141d9e" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:18:56.900969  8636 raft_consensus.cc:515] T 7887766dc6784fcaa42b35c05fea7a99 P cd75a17ab2604397adab03bb8b5fd75c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:56.930464  8635 raft_consensus.cc:515] T 3a485a995abc4807b6e511e45419f737 P cd75a17ab2604397adab03bb8b5fd75c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:56.954784  8094 raft_consensus.cc:515] T ab432e62819d499eaaf3dd55481dd930 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:56.946859  8631 raft_consensus.cc:3060] T 90d42e216d9741e190bca19a781291fd P cd75a17ab2604397adab03bb8b5fd75c [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:56.968719  7466 leader_election.cc:304] T be1a92657f494cac8dd227d152f50151 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
I20260709 13:18:56.970376  6806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8292e16e5654be6bc408560cf256aaa" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:18:56.970832  6798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de3186201e1a40d0b335eeb8b4e256e0" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:18:56.971189  6806 raft_consensus.cc:2468] T d8292e16e5654be6bc408560cf256aaa P b7ab4784c7344b939bc36f639286f377 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 5.
W20260709 13:18:56.971995  6697 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.68:45071, user_credentials={real_user=slave}} blocked reactor thread for 138131us
I20260709 13:18:56.973759  6804 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:32976 (request call id 1933) took 2070 ms. Trace:
I20260709 13:18:56.974519  6727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20f6842e26174571996b8dea4151d4be" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:18:56.975358  6727 raft_consensus.cc:2468] T 20f6842e26174571996b8dea4151d4be P ccd8a4c3bfe3413cb2ae219b09aea832 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 4.
I20260709 13:18:56.974208  6804 rpcz_store.cc:276] 0709 13:18:54.903756 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:55.043347 (+139591us) service_pool.cc:224] Handling call
0709 13:18:55.043779 (+   432us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:55.302529 (+258750us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:56.973506 (+1670977us) spinlock_profiling.cc:243] Waited 258 ms on lock 0x7b54001f6154. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f9aae01 00007fcc0f9a983e 00007fcc1496e419 00007fcc0dee5bd4 00007fcc0dee5b62 00007fcc0dee5a91 00007fcc0dee5a0c 00007fcc0dee4cc2 00007fcc0dce548c 00007fcc0dce48c6
0709 13:18:56.973698 (+   192us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":593248512}
I20260709 13:18:56.959003  8644 raft_consensus.cc:2804] T f58dc08b12a2494bb9a1372837970ca2 P cd75a17ab2604397adab03bb8b5fd75c [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:18:56.979372  6728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de3186201e1a40d0b335eeb8b4e256e0" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:18:56.955209  8529 consensus_queue.cc:1048] T 22ccee1b570c4ad3a57bd7aec085b1b4 P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Connected to new peer: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.016s
I20260709 13:18:56.981354  6728 raft_consensus.cc:2468] T de3186201e1a40d0b335eeb8b4e256e0 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 4.
I20260709 13:18:56.989363  6732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8292e16e5654be6bc408560cf256aaa" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:18:56.982035  6806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5be3a11b23d4ea9b08300a2789821c7" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
W20260709 13:18:56.979411  6844 leader_election.cc:336] T f3f9c2e2bf644115957398fe4c9459db P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817): Timed out: RequestConsensusVote RPC to 127.5.126.66:42817 timed out after 1.630s (SENT)
I20260709 13:18:56.977403  8534 raft_consensus.cc:2804] T be1a92657f494cac8dd227d152f50151 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:18:56.990247  6732 raft_consensus.cc:2468] T d8292e16e5654be6bc408560cf256aaa P ccd8a4c3bfe3413cb2ae219b09aea832 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 5.
I20260709 13:18:56.998495  6844 leader_election.cc:304] T f3f9c2e2bf644115957398fe4c9459db P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:18:56.960700  8575 consensus_queue.cc:1048] T 3fa34c08b205435dba97346991aa1f92 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.009s
I20260709 13:18:56.999739  6727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e31b9971c15848dea59d4d4130141d9e" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:18:56.964465  8573 raft_consensus.cc:493] T 1528ab62b6fe4e3099d08f141afee116 P cd75a17ab2604397adab03bb8b5fd75c [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:56.981082  8644 raft_consensus.cc:493] T f58dc08b12a2494bb9a1372837970ca2 P cd75a17ab2604397adab03bb8b5fd75c [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:57.003259  6804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d9def8b32fd443aa94ab1420b06837b" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:18:56.961521  8614 consensus_queue.cc:1048] T 3411566abe2d4c9bb4b2adfdd05e6f17 P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Connected to new peer: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.023s
I20260709 13:18:57.008697  6804 raft_consensus.cc:2393] T 4d9def8b32fd443aa94ab1420b06837b P b7ab4784c7344b939bc36f639286f377 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c in current term 4: Already voted for candidate b7ab4784c7344b939bc36f639286f377 in this term.
I20260709 13:18:57.013314  6806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3411566abe2d4c9bb4b2adfdd05e6f17" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:18:57.016856  6728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3f13b31a1f84f0d89d007eadd57924c" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:18:57.017442  6723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "713b5728a197487c9300b310ab94e5a3" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:18:57.018370  6728 raft_consensus.cc:2393] T b3f13b31a1f84f0d89d007eadd57924c P ccd8a4c3bfe3413cb2ae219b09aea832 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7ab4784c7344b939bc36f639286f377 in current term 3: Already voted for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in this term.
I20260709 13:18:57.017159  6729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44bde925b2e541b69890d70715b85176" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:18:57.021807  6729 raft_consensus.cc:2393] T 44bde925b2e541b69890d70715b85176 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7ab4784c7344b939bc36f639286f377 in current term 5: Already voted for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in this term.
I20260709 13:18:56.980747  8433 raft_consensus.cc:493] T 24ee15416e3145beaa1b8183453729a3 P cd75a17ab2604397adab03bb8b5fd75c [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 7ba59cc884714e8aa5f3f0ecaed84cbb)
I20260709 13:18:57.027077  6729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24ee15416e3145beaa1b8183453729a3" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:18:57.027724  6727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d9def8b32fd443aa94ab1420b06837b" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:18:57.028841  6727 raft_consensus.cc:2468] T 4d9def8b32fd443aa94ab1420b06837b P ccd8a4c3bfe3413cb2ae219b09aea832 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 4.
I20260709 13:18:57.030778  6732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34f36d59d88f40fe8a2805e604fc6c0a" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:18:57.027683  6844 leader_election.cc:304] T 9b3759de40694069b13c0f8bd40e5709 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:18:57.032222  6732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c44c4849aa54f2b94d1f1bef9ed546f" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:18:57.032886  6732 raft_consensus.cc:3060] T 7c44c4849aa54f2b94d1f1bef9ed546f P ccd8a4c3bfe3413cb2ae219b09aea832 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:57.040665  6806 raft_consensus.cc:2468] T 3411566abe2d4c9bb4b2adfdd05e6f17 P b7ab4784c7344b939bc36f639286f377 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 3.
I20260709 13:18:57.005555  8628 raft_consensus.cc:2749] T f3f9c2e2bf644115957398fe4c9459db P cd75a17ab2604397adab03bb8b5fd75c [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:18:57.042534  6729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d33d5ee8ef6f415593d8df52063161ad" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:18:57.008234  8644 raft_consensus.cc:3060] T f58dc08b12a2494bb9a1372837970ca2 P cd75a17ab2604397adab03bb8b5fd75c [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:57.050045  6844 leader_election.cc:304] T bd6869f07b5a4885a0b99fbe60c3b175 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:18:57.054768  6727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77e330a82df4b43a745d57a68f6f057" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:18:57.054421  6729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3022224cc81473690653a83d4e99470" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:18:57.008917  8534 raft_consensus.cc:697] T be1a92657f494cac8dd227d152f50151 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 5 LEADER]: Becoming Leader. State: Replica: 7ba59cc884714e8aa5f3f0ecaed84cbb, State: Running, Role: LEADER
I20260709 13:18:57.016777  8619 raft_consensus.cc:493] T e77e330a82df4b43a745d57a68f6f057 P cd75a17ab2604397adab03bb8b5fd75c [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:57.064559  6875 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53406 (request call id 1200) took 2390 ms (client timeout 2572 ms). Trace:
W20260709 13:18:57.056321  6697 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.68:45071, user_credentials={real_user=slave}} blocked reactor thread for 80611.5us
W20260709 13:18:57.067039  6875 rpcz_store.cc:269] 0709 13:18:54.662778 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:54.663107 (+   329us) service_pool.cc:224] Handling call
0709 13:18:57.053107 (+2390000us) spinlock_profiling.cc:243] Waited 21.4 ms on lock 0x7b5400347e54. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f9ae2fa 00007fcc1496fb17 00007fcc0deea6d4 00007fcc0deea662 00007fcc0deea591 00007fcc0deea50c 00007fcc0dee97c2 00007fcc0dce548c 00007fcc0dce48c6 00007fcc0dce426f
0709 13:18:57.053231 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":49230208}
I20260709 13:18:57.069335  8443 leader_election.cc:290] T f4b8bd455d5a47c18a1380839c6e0d61 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 4 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:18:57.056490  6729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3d8792045a4583ae2e965b1350a5b4" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:18:57.071681  6729 raft_consensus.cc:1240] T 4275cf08e63345f993bce8664eada830 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 4 FOLLOWER]: Rejecting Update request from peer b7ab4784c7344b939bc36f639286f377 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 13:18:57.073024  6729 raft_consensus.cc:1240] T 9e326172347f45e99a0d482b5d8ef768 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 4 FOLLOWER]: Rejecting Update request from peer b7ab4784c7344b939bc36f639286f377 for earlier term 3. Current term is 4. Ops: []
I20260709 13:18:57.068488  8628 raft_consensus.cc:2804] T 9b3759de40694069b13c0f8bd40e5709 P cd75a17ab2604397adab03bb8b5fd75c [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:18:57.079917  6730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5be3a11b23d4ea9b08300a2789821c7" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:18:57.082242  6732 raft_consensus.cc:2468] T 7c44c4849aa54f2b94d1f1bef9ed546f P ccd8a4c3bfe3413cb2ae219b09aea832 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 5.
I20260709 13:18:57.084900  6727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4b8bd455d5a47c18a1380839c6e0d61" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:18:57.090608  6730 raft_consensus.cc:2393] T f5be3a11b23d4ea9b08300a2789821c7 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c in current term 5: Already voted for candidate b7ab4784c7344b939bc36f639286f377 in this term.
I20260709 13:18:57.046109  8433 raft_consensus.cc:515] T 24ee15416e3145beaa1b8183453729a3 P cd75a17ab2604397adab03bb8b5fd75c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } attrs { replace: true } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:18:57.016601  8573 raft_consensus.cc:515] T 1528ab62b6fe4e3099d08f141afee116 P cd75a17ab2604397adab03bb8b5fd75c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } attrs { replace: true } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:18:57.054098  6726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d65025eea89441290d85dd053810e31" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
W20260709 13:18:57.098496  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 48582.4us
I20260709 13:18:57.081687  8628 raft_consensus.cc:493] T 9b3759de40694069b13c0f8bd40e5709 P cd75a17ab2604397adab03bb8b5fd75c [term 4 FOLLOWER]: Starting leader election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:18:57.057935  8406 leader_election.cc:290] T f3f9c2e2bf644115957398fe4c9459db P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 5 election: Requested vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:18:57.079908  8559 leader_election.cc:290] T 34f36d59d88f40fe8a2805e604fc6c0a P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:18:57.101080  6844 leader_election.cc:304] T 4f00a2e87e56452083b759f60d461ee3 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, b7ab4784c7344b939bc36f639286f377
I20260709 13:18:57.102360  8664 raft_consensus.cc:493] T 853ac0a8cbd64ce99457f170216d4d0f P ccd8a4c3bfe3413cb2ae219b09aea832 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:18:57.103411  8094 leader_election.cc:290] T ab432e62819d499eaaf3dd55481dd930 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 5 election: Requested vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:18:57.103914  8441 raft_consensus.cc:515] T 07a92dd554674067a83a9cb68c4773f2 P b7ab4784c7344b939bc36f639286f377 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:57.104557  8636 leader_election.cc:290] T 7887766dc6784fcaa42b35c05fea7a99 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:18:57.085477  8074 leader_election.cc:290] T 34f36d59d88f40fe8a2805e604fc6c0a P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:18:57.084133  6725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a92dd554674067a83a9cb68c4773f2" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:18:57.119781  6725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8292e16e5654be6bc408560cf256aaa" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:18:57.120466  6725 raft_consensus.cc:2376] T d8292e16e5654be6bc408560cf256aaa P ccd8a4c3bfe3413cb2ae219b09aea832 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 5. Re-sending same reply.
I20260709 13:18:57.121416  6725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7887766dc6784fcaa42b35c05fea7a99" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:18:57.122149  6725 raft_consensus.cc:2393] T 7887766dc6784fcaa42b35c05fea7a99 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate b7ab4784c7344b939bc36f639286f377 in current term 4: Already voted for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in this term.
I20260709 13:18:57.122937  6725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be1a92657f494cac8dd227d152f50151" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:18:57.123597  6725 raft_consensus.cc:2368] T be1a92657f494cac8dd227d152f50151 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate b7ab4784c7344b939bc36f639286f377 for earlier term 4. Current term is 5.
I20260709 13:18:57.123699  8574 raft_consensus.cc:3055] T 4275cf08e63345f993bce8664eada830 P b7ab4784c7344b939bc36f639286f377 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:18:57.124292  8574 raft_consensus.cc:740] T 4275cf08e63345f993bce8664eada830 P b7ab4784c7344b939bc36f639286f377 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
I20260709 13:18:57.124747  6725 raft_consensus.cc:1240] T 3411566abe2d4c9bb4b2adfdd05e6f17 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 3 FOLLOWER]: Rejecting Update request from peer b7ab4784c7344b939bc36f639286f377 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 13:18:57.125205  8574 consensus_queue.cc:260] T 4275cf08e63345f993bce8664eada830 P b7ab4784c7344b939bc36f639286f377 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:57.126677  8574 raft_consensus.cc:3060] T 4275cf08e63345f993bce8664eada830 P b7ab4784c7344b939bc36f639286f377 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:57.127112  8631 raft_consensus.cc:515] T 90d42e216d9741e190bca19a781291fd P cd75a17ab2604397adab03bb8b5fd75c [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:57.108162  6727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34f36d59d88f40fe8a2805e604fc6c0a" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:18:57.091388  8638 raft_consensus.cc:2749] T bd6869f07b5a4885a0b99fbe60c3b175 P cd75a17ab2604397adab03bb8b5fd75c [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:18:57.113251  6772 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 633600us
I20260709 13:18:57.113488  6844 leader_election.cc:304] T c4db81d9d329422bb3b4160ca4ac2d1d P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:18:57.079131  8619 raft_consensus.cc:515] T e77e330a82df4b43a745d57a68f6f057 P cd75a17ab2604397adab03bb8b5fd75c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } }
W20260709 13:18:57.103503  8651 log.cc:927] Time spent T 24ee15416e3145beaa1b8183453729a3 P 7ba59cc884714e8aa5f3f0ecaed84cbb: Append to log took a long time: real 0.057s	user 0.001s	sys 0.000s
W20260709 13:18:57.129170  7502 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50744 (request call id 130) took 3198 ms (client timeout 1716 ms). Trace:
I20260709 13:18:57.130412  6731 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49998 (request call id 561) took 1368 ms. Trace:
I20260709 13:18:57.131148  8635 leader_election.cc:290] T 3a485a995abc4807b6e511e45419f737 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:18:57.108487  8628 raft_consensus.cc:3060] T 9b3759de40694069b13c0f8bd40e5709 P cd75a17ab2604397adab03bb8b5fd75c [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:18:57.106882  6698 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:57.095124  8605 raft_consensus.cc:515] T 713b5728a197487c9300b310ab94e5a3 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
W20260709 13:18:57.114981  8654 log.cc:927] Time spent T bb3d8792045a4583ae2e965b1350a5b4 P cd75a17ab2604397adab03bb8b5fd75c: Append to log took a long time: real 0.089s	user 0.001s	sys 0.000s
I20260709 13:18:57.116443  8664 raft_consensus.cc:515] T 853ac0a8cbd64ce99457f170216d4d0f P ccd8a4c3bfe3413cb2ae219b09aea832 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
W20260709 13:18:57.144712  8648 log.cc:927] Time spent T 7c44c4849aa54f2b94d1f1bef9ed546f P b7ab4784c7344b939bc36f639286f377: Append to log took a long time: real 0.246s	user 0.003s	sys 0.000s
I20260709 13:18:57.143121  7498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3d8792045a4583ae2e965b1350a5b4" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:18:57.115296  8614 raft_consensus.cc:2749] T 4f00a2e87e56452083b759f60d461ee3 P cd75a17ab2604397adab03bb8b5fd75c [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:18:57.117542  8534 consensus_queue.cc:237] T be1a92657f494cac8dd227d152f50151 P 7ba59cc884714e8aa5f3f0ecaed84cbb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:18:57.154451  6844 leader_election.cc:304] T d33d5ee8ef6f415593d8df52063161ad P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
W20260709 13:18:57.154672  6773 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:57.156543  6731 rpcz_store.cc:276] 0709 13:18:55.762116 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:55.762378 (+   262us) service_pool.cc:224] Handling call
0709 13:18:55.762866 (+   488us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:18:55.777183 (+ 14317us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:55.777229 (+    46us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:18:55.782559 (+  5330us) log.cc:844] Serialized 52 byte log entry
0709 13:18:56.908264 (+1125705us) spinlock_profiling.cc:243] Waited 3.35 ms on lock 0x7b18001f08a0. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc15785de1 00007fcc157925b1 00007fcc0c89fe07 00007fcc156faab9 00007fcc0c8bc69b 00007fcc0c8ba93f 00007fcc0c8bcc02 00007fcc0f54420b 00007fcc0f549d23 00007fcc0f54a0d1 00007fcc0f965a0f
0709 13:18:56.991091 (+ 82827us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:18:56.991149 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:56.991229 (+    80us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:57.130035 (+138806us) raft_consensus.cc:1685] finished
0709 13:18:57.130059 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:57.130348 (+   289us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":19824,"raft.queue_time_us":25811,"raft.run_cpu_time_us":167,"raft.run_wall_time_us":6841,"spinlock_wait_cycles":7698816,"thread_start_us":82595,"threads_started":1,"wal-append.queue_time_us":1234553}
I20260709 13:18:57.224267  6799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "427c124d773f483294511e80fe340075" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:18:57.225899  6807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be1a92657f494cac8dd227d152f50151" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:18:57.226722  6807 raft_consensus.cc:3060] T be1a92657f494cac8dd227d152f50151 P b7ab4784c7344b939bc36f639286f377 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:57.158805  8425 raft_consensus.cc:2749] T c4db81d9d329422bb3b4160ca4ac2d1d P cd75a17ab2604397adab03bb8b5fd75c [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:18:57.162497  6732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "711ef6523deb4cbe8ef2ba61e1c21c98" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:18:57.164135  7500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1528ab62b6fe4e3099d08f141afee116" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
W20260709 13:18:57.156443  7502 rpcz_store.cc:269] 0709 13:18:53.947069 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:53.965281 (+ 18212us) service_pool.cc:224] Handling call
0709 13:18:57.128854 (+3163573us) spinlock_profiling.cc:243] Waited 2.05 s on lock 0x7b5400537d54. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f9ae2fa 00007fcc1496fb17 00007fcc0deea6d4 00007fcc0deea662 00007fcc0deea591 00007fcc0deea50c 00007fcc0dee97c2 00007fcc0dce548c 00007fcc0dce48c6 00007fcc0dce426f
0709 13:18:57.129044 (+   190us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4703874432}
I20260709 13:18:57.181766  6879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ba5dac66ab5497e9e336f2a3c28cda5" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:18:57.184782  6876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4b8bd455d5a47c18a1380839c6e0d61" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:18:57.231827  6879 raft_consensus.cc:2468] T 7ba5dac66ab5497e9e336f2a3c28cda5 P cd75a17ab2604397adab03bb8b5fd75c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 4.
I20260709 13:18:57.185650  6881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34f36d59d88f40fe8a2805e604fc6c0a" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
W20260709 13:18:57.186964  6772 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:57.187825  8542 consensus_queue.cc:1048] T 7c37d41cd9164c15a6826ca62a851a69 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:18:57.189237  6695 leader_election.cc:304] T 4d9def8b32fd443aa94ab1420b06837b P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:18:57.190644  8665 raft_consensus.cc:493] T 17587d6730594da4a56fa13a353232a1 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:57.248399  8640 log.cc:927] Time spent T a1704639a875409b9959353527b3fd68 P cd75a17ab2604397adab03bb8b5fd75c: Append to log took a long time: real 0.512s	user 0.002s	sys 0.000s
I20260709 13:18:57.247922  8665 raft_consensus.cc:515] T 17587d6730594da4a56fa13a353232a1 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:18:57.191936  7496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17587d6730594da4a56fa13a353232a1" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:18:57.216135  8406 raft_consensus.cc:493] T dbdf895bba214ff68685a24fd17dfb5d P ccd8a4c3bfe3413cb2ae219b09aea832 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:18:57.253734  7503 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50742 (request call id 258) took 1183 ms. Trace:
I20260709 13:18:57.253952  8665 leader_election.cc:290] T 17587d6730594da4a56fa13a353232a1 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:18:57.254160  7503 rpcz_store.cc:276] 0709 13:18:56.070229 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:56.092161 (+ 21932us) service_pool.cc:224] Handling call
0709 13:18:57.253557 (+1161396us) spinlock_profiling.cc:243] Waited 299 ms on lock 0x7b5400496454. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f9ae2fa 00007fcc1496fb17 00007fcc0deea6d4 00007fcc0deea662 00007fcc0deea591 00007fcc0deea50c 00007fcc0dee97c2 00007fcc0dce548c 00007fcc0dce48c6 00007fcc0dce426f
0709 13:18:57.253676 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":688676096}
I20260709 13:18:57.192692  7495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ba5dac66ab5497e9e336f2a3c28cda5" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:18:57.192834  7499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be1a92657f494cac8dd227d152f50151" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb"
I20260709 13:18:57.195524  8644 raft_consensus.cc:515] T f58dc08b12a2494bb9a1372837970ca2 P cd75a17ab2604397adab03bb8b5fd75c [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:57.196642  6730 raft_consensus.cc:1240] T ab432e62819d499eaaf3dd55481dd930 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 5 FOLLOWER]: Rejecting Update request from peer b7ab4784c7344b939bc36f639286f377 for earlier term 4. Current term is 5. Ops: []
I20260709 13:18:57.187891  7993 consensus_queue.cc:1048] T 3fa34c08b205435dba97346991aa1f92 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.010s
I20260709 13:18:57.201850  8631 leader_election.cc:290] T 90d42e216d9741e190bca19a781291fd P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 5 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:18:57.205529  8605 leader_election.cc:290] T 713b5728a197487c9300b310ab94e5a3 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 5 election: Requested vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:18:57.205238  6801 raft_consensus.cc:2468] T 1528ab62b6fe4e3099d08f141afee116 P b7ab4784c7344b939bc36f639286f377 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in term 4.
I20260709 13:18:57.253098  6880 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53406 (request call id 1206) took 2140 ms. Trace:
I20260709 13:18:57.170933  8074 raft_consensus.cc:493] T c4db81d9d329422bb3b4160ca4ac2d1d P b7ab4784c7344b939bc36f639286f377 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:57.269362  8074 raft_consensus.cc:515] T c4db81d9d329422bb3b4160ca4ac2d1d P b7ab4784c7344b939bc36f639286f377 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:57.270435  6801 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50550 (request call id 121) took 1707 ms. Trace:
I20260709 13:18:57.270916  6801 rpcz_store.cc:276] 0709 13:18:55.563238 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:56.142168 (+578930us) service_pool.cc:224] Handling call
0709 13:18:57.270227 (+1128059us) spinlock_profiling.cc:243] Waited 1.05 s on lock 0x7b54001b4ed4. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f9ae2fa 00007fcc1496fb17 00007fcc0deea6d4 00007fcc0deea662 00007fcc0deea591 00007fcc0deea50c 00007fcc0dee97c2 00007fcc0dce548c 00007fcc0dce48c6 00007fcc0dce426f
0709 13:18:57.270374 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2417998080}
I20260709 13:18:57.272248  8074 leader_election.cc:290] T c4db81d9d329422bb3b4160ca4ac2d1d P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:18:57.210510  6727 raft_consensus.cc:1275] T 2c240553ce044eedb41541d72b9475d7 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 5 FOLLOWER]: Refusing update from remote peer b7ab4784c7344b939bc36f639286f377: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:18:57.147658  8594 raft_consensus.cc:515] T 90d42e216d9741e190bca19a781291fd P ccd8a4c3bfe3413cb2ae219b09aea832 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:57.217576  6723 raft_consensus.cc:2393] T 713b5728a197487c9300b310ab94e5a3 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7ab4784c7344b939bc36f639286f377 in current term 5: Already voted for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in this term.
I20260709 13:18:57.149672  8573 leader_election.cc:290] T 1528ab62b6fe4e3099d08f141afee116 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:18:57.232613  6881 raft_consensus.cc:2468] T 34f36d59d88f40fe8a2805e604fc6c0a P cd75a17ab2604397adab03bb8b5fd75c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 1.
I20260709 13:18:57.235831  7500 raft_consensus.cc:2393] T 1528ab62b6fe4e3099d08f141afee116 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c in current term 5: Already voted for candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in this term.
I20260709 13:18:57.238312  7466 leader_election.cc:304] T 427c124d773f483294511e80fe340075 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:18:57.242568  6803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1528ab62b6fe4e3099d08f141afee116" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:18:57.235462  6798 raft_consensus.cc:2955] T 24ee15416e3145beaa1b8183453729a3 P b7ab4784c7344b939bc36f639286f377 [term 4 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } attrs { replace: true } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } } }
W20260709 13:18:57.243188  8112 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 4 current term: 4 is higher.
I20260709 13:18:57.244532  8467 raft_consensus.cc:493] T a3022224cc81473690653a83d4e99470 P b7ab4784c7344b939bc36f639286f377 [term 4 FOLLOWER]: Starting leader election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:18:57.244876  8619 leader_election.cc:290] T e77e330a82df4b43a745d57a68f6f057 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391)
I20260709 13:18:57.246990  8441 leader_election.cc:290] T 07a92dd554674067a83a9cb68c4773f2 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 4 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:18:57.261458  6724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbdf895bba214ff68685a24fd17dfb5d" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:18:57.249629  8664 leader_election.cc:290] T 853ac0a8cbd64ce99457f170216d4d0f P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:18:57.263862  8644 leader_election.cc:290] T f58dc08b12a2494bb9a1372837970ca2 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 6 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:18:57.267030  7501 raft_consensus.cc:1275] T ce4f062dcd314d43a63ca74067cb5ee3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 5 FOLLOWER]: Refusing update from remote peer cd75a17ab2604397adab03bb8b5fd75c: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:18:57.253145  8406 raft_consensus.cc:515] T dbdf895bba214ff68685a24fd17dfb5d P ccd8a4c3bfe3413cb2ae219b09aea832 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:57.297039  8405 leader_election.cc:290] T 4275cf08e63345f993bce8664eada830 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:18:57.286371  8467 raft_consensus.cc:3060] T a3022224cc81473690653a83d4e99470 P b7ab4784c7344b939bc36f639286f377 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:57.297632  8406 leader_election.cc:290] T dbdf895bba214ff68685a24fd17dfb5d P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
W20260709 13:18:57.206634  8618 log.cc:927] Time spent T f5be3a11b23d4ea9b08300a2789821c7 P b7ab4784c7344b939bc36f639286f377: Append to log took a long time: real 0.848s	user 0.000s	sys 0.001s
I20260709 13:18:57.300684  6724 raft_consensus.cc:3060] T dbdf895bba214ff68685a24fd17dfb5d P ccd8a4c3bfe3413cb2ae219b09aea832 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:57.303112  8628 raft_consensus.cc:515] T 9b3759de40694069b13c0f8bd40e5709 P cd75a17ab2604397adab03bb8b5fd75c [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:57.274844  6803 raft_consensus.cc:3060] T 1528ab62b6fe4e3099d08f141afee116 P b7ab4784c7344b939bc36f639286f377 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:57.306269  8467 raft_consensus.cc:515] T a3022224cc81473690653a83d4e99470 P b7ab4784c7344b939bc36f639286f377 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
W20260709 13:18:57.286379  7466 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 48171.2us
W20260709 13:18:57.306573  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 152201us
I20260709 13:18:57.287542  8555 raft_consensus.cc:2749] T 427c124d773f483294511e80fe340075 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:18:57.294327  6731 raft_consensus.cc:1240] T 90d42e216d9741e190bca19a781291fd P ccd8a4c3bfe3413cb2ae219b09aea832 [term 5 FOLLOWER]: Rejecting Update request from peer b7ab4784c7344b939bc36f639286f377 for earlier term 4. Current term is 5. Ops: []
I20260709 13:18:57.295257  8594 leader_election.cc:290] T 90d42e216d9741e190bca19a781291fd P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 5 election: Requested vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:18:57.306530  8425 raft_consensus.cc:2749] T d33d5ee8ef6f415593d8df52063161ad P cd75a17ab2604397adab03bb8b5fd75c [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:18:57.307665  6844 leader_election.cc:304] T 7ba5dac66ab5497e9e336f2a3c28cda5 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, b7ab4784c7344b939bc36f639286f377
I20260709 13:18:57.311187  8614 raft_consensus.cc:2749] T 7ba5dac66ab5497e9e336f2a3c28cda5 P cd75a17ab2604397adab03bb8b5fd75c [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:18:57.311434  6844 leader_election.cc:400] T bb7fa124c3bf4ef9ab65a407cb008441 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 3 election: Vote denied by peer b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817) with higher term. Message: Invalid argument: T bb7fa124c3bf4ef9ab65a407cb008441 P b7ab4784c7344b939bc36f639286f377 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c for earlier term 3. Current term is 5.
I20260709 13:18:57.311931  8614 raft_consensus.cc:493] T bb7fa124c3bf4ef9ab65a407cb008441 P cd75a17ab2604397adab03bb8b5fd75c [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 7ba59cc884714e8aa5f3f0ecaed84cbb)
I20260709 13:18:57.312460  8614 raft_consensus.cc:515] T bb7fa124c3bf4ef9ab65a407cb008441 P cd75a17ab2604397adab03bb8b5fd75c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:18:57.313086  6844 leader_election.cc:304] T ab432e62819d499eaaf3dd55481dd930 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:18:57.313169  8441 consensus_queue.cc:1059] T 404190ce4ce94cecbfcb6ea9d1dd8626 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:18:57.314611  8614 leader_election.cc:290] T bb7fa124c3bf4ef9ab65a407cb008441 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:18:57.314708  8074 raft_consensus.cc:3055] T 404190ce4ce94cecbfcb6ea9d1dd8626 P b7ab4784c7344b939bc36f639286f377 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:18:57.315229  8074 raft_consensus.cc:740] T 404190ce4ce94cecbfcb6ea9d1dd8626 P b7ab4784c7344b939bc36f639286f377 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
I20260709 13:18:57.274142  6880 rpcz_store.cc:276] 0709 13:18:55.112581 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:55.113405 (+   824us) service_pool.cc:224] Handling call
0709 13:18:55.999772 (+886367us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:56.170251 (+170479us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:57.252022 (+1081771us) spinlock_profiling.cc:243] Waited 170 ms on lock 0x7b54001e91d4. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f9aae01 00007fcc0f9a983e 00007fcc1496e419 00007fcc0dee5bd4 00007fcc0dee5b62 00007fcc0dee5a91 00007fcc0dee5a0c 00007fcc0dee4cc2 00007fcc0dce548c 00007fcc0dce48c6
0709 13:18:57.252873 (+   851us) spinlock_profiling.cc:243] Waited 882 ms on lock 0x7b54001e91d0. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f9a98ad 00007fcc1496e419 00007fcc0dee5bd4 00007fcc0dee5b62 00007fcc0dee5a91 00007fcc0dee5a0c 00007fcc0dee4cc2 00007fcc0dce548c 00007fcc0dce48c6 00007fcc0dce426f
0709 13:18:57.253000 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2419859584}
I20260709 13:18:57.315837  7500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb7fa124c3bf4ef9ab65a407cb008441" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:18:57.287297  6807 raft_consensus.cc:2468] T be1a92657f494cac8dd227d152f50151 P b7ab4784c7344b939bc36f639286f377 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in term 5.
W20260709 13:18:57.317320  6697 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 146805us
I20260709 13:18:57.328760  6881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a92dd554674067a83a9cb68c4773f2" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
W20260709 13:18:57.330216  8634 log.cc:927] Time spent T 2c240553ce044eedb41541d72b9475d7 P b7ab4784c7344b939bc36f639286f377: Append to log took a long time: real 0.758s	user 0.000s	sys 0.002s
I20260709 13:18:57.330901  8467 leader_election.cc:290] T a3022224cc81473690653a83d4e99470 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 5 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
W20260709 13:18:57.332273  6695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 143093us
I20260709 13:18:57.333659  6695 leader_election.cc:304] T bd6869f07b5a4885a0b99fbe60c3b175 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:18:57.334698  8573 consensus_queue.cc:1048] T a1704639a875409b9959353527b3fd68 P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:18:57.335007  8619 consensus_queue.cc:1059] T 711ef6523deb4cbe8ef2ba61e1c21c98 P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:18:57.336301  8573 raft_consensus.cc:3055] T 711ef6523deb4cbe8ef2ba61e1c21c98 P cd75a17ab2604397adab03bb8b5fd75c [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:18:57.336489  6724 raft_consensus.cc:2468] T dbdf895bba214ff68685a24fd17dfb5d P ccd8a4c3bfe3413cb2ae219b09aea832 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 5.
I20260709 13:18:57.332131  6881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4db81d9d329422bb3b4160ca4ac2d1d" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:18:57.337672  6881 raft_consensus.cc:2468] T c4db81d9d329422bb3b4160ca4ac2d1d P cd75a17ab2604397adab03bb8b5fd75c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 4.
I20260709 13:18:57.336707  8573 raft_consensus.cc:740] T 711ef6523deb4cbe8ef2ba61e1c21c98 P cd75a17ab2604397adab03bb8b5fd75c [term 4 LEADER]: Becoming Follower/Learner. State: Replica: cd75a17ab2604397adab03bb8b5fd75c, State: Running, Role: LEADER
I20260709 13:18:57.338943  6803 raft_consensus.cc:2468] T 1528ab62b6fe4e3099d08f141afee116 P b7ab4784c7344b939bc36f639286f377 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in term 5.
I20260709 13:18:57.339042  8573 consensus_queue.cc:260] T 711ef6523deb4cbe8ef2ba61e1c21c98 P cd75a17ab2604397adab03bb8b5fd75c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:57.340350  8573 raft_consensus.cc:3060] T 711ef6523deb4cbe8ef2ba61e1c21c98 P cd75a17ab2604397adab03bb8b5fd75c [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:57.340544  7466 leader_election.cc:304] T 1528ab62b6fe4e3099d08f141afee116 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
I20260709 13:18:57.341558  8555 raft_consensus.cc:2804] T 1528ab62b6fe4e3099d08f141afee116 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:18:57.342037  8555 raft_consensus.cc:697] T 1528ab62b6fe4e3099d08f141afee116 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 5 LEADER]: Becoming Leader. State: Replica: 7ba59cc884714e8aa5f3f0ecaed84cbb, State: Running, Role: LEADER
I20260709 13:18:57.349771  6799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be1a92657f494cac8dd227d152f50151" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:18:57.350914  6799 raft_consensus.cc:2393] T be1a92657f494cac8dd227d152f50151 P b7ab4784c7344b939bc36f639286f377 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ccd8a4c3bfe3413cb2ae219b09aea832 in current term 5: Already voted for candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in this term.
I20260709 13:18:57.351553  6800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c240553ce044eedb41541d72b9475d7" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:18:57.359236  6800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f9c2e2bf644115957398fe4c9459db" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:18:57.343039  8555 consensus_queue.cc:237] T 1528ab62b6fe4e3099d08f141afee116 P 7ba59cc884714e8aa5f3f0ecaed84cbb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.4, Last appended by leader: 4, Current term: 5, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } attrs { replace: true } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:18:57.363277  6801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "404190ce4ce94cecbfcb6ea9d1dd8626" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:18:57.363560  6807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20f6842e26174571996b8dea4151d4be" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:18:57.364357  6807 raft_consensus.cc:2468] T 20f6842e26174571996b8dea4151d4be P b7ab4784c7344b939bc36f639286f377 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 4.
I20260709 13:18:57.365298  6807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c7f33e544204fbaac4078e3e83bbf4e" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:18:57.361439  6799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f9c2e2bf644115957398fe4c9459db" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:18:57.366379  6807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7887766dc6784fcaa42b35c05fea7a99" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:18:57.367118  6807 raft_consensus.cc:2393] T 7887766dc6784fcaa42b35c05fea7a99 P b7ab4784c7344b939bc36f639286f377 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate ccd8a4c3bfe3413cb2ae219b09aea832 in current term 4: Already voted for candidate b7ab4784c7344b939bc36f639286f377 in this term.
I20260709 13:18:57.368749  6772 leader_election.cc:304] T 7ba5dac66ab5497e9e336f2a3c28cda5 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb
I20260709 13:18:57.368003  6844 leader_election.cc:304] T d8292e16e5654be6bc408560cf256aaa P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:18:57.360155  6800 raft_consensus.cc:2468] T f3f9c2e2bf644115957398fe4c9459db P b7ab4784c7344b939bc36f639286f377 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 4.
I20260709 13:18:57.373050  6800 raft_consensus.cc:1275] T c4db81d9d329422bb3b4160ca4ac2d1d P b7ab4784c7344b939bc36f639286f377 [term 4 FOLLOWER]: Refusing update from remote peer ccd8a4c3bfe3413cb2ae219b09aea832: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:18:57.374670  6804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f03d0dbf16864ca4bc1bb5e4c0334c0f" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:18:57.376857  6804 raft_consensus.cc:3060] T f03d0dbf16864ca4bc1bb5e4c0334c0f P b7ab4784c7344b939bc36f639286f377 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:57.376704  6799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab432e62819d499eaaf3dd55481dd930" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:18:57.375845  6880 raft_consensus.cc:1240] T 9e326172347f45e99a0d482b5d8ef768 P cd75a17ab2604397adab03bb8b5fd75c [term 4 LEADER]: Rejecting Update request from peer b7ab4784c7344b939bc36f639286f377 for earlier term 3. Current term is 4. Ops: []
I20260709 13:18:57.331566  8112 raft_consensus.cc:2749] T ab432e62819d499eaaf3dd55481dd930 P cd75a17ab2604397adab03bb8b5fd75c [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:18:57.380656  6772 leader_election.cc:304] T 34f36d59d88f40fe8a2805e604fc6c0a P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:18:57.367909  8605 raft_consensus.cc:993] T 07a92dd554674067a83a9cb68c4773f2 P ccd8a4c3bfe3413cb2ae219b09aea832: : Instructing follower cd75a17ab2604397adab03bb8b5fd75c to start an election
I20260709 13:18:57.385588  6802 raft_consensus.cc:1275] T 95a75bfe094d4bdc963aba3f08dfcd25 P b7ab4784c7344b939bc36f639286f377 [term 5 FOLLOWER]: Refusing update from remote peer ccd8a4c3bfe3413cb2ae219b09aea832: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 5 index: 2. (index mismatch)
I20260709 13:18:57.374615  6803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce4f062dcd314d43a63ca74067cb5ee3" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 6 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:18:57.388164  6803 raft_consensus.cc:2468] T ce4f062dcd314d43a63ca74067cb5ee3 P b7ab4784c7344b939bc36f639286f377 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 5.
W20260709 13:18:57.394152  6697 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 65492.9us
I20260709 13:18:57.365890  8425 raft_consensus.cc:493] T 4b8cacb381b746da8d0049b0a83b41dd P cd75a17ab2604397adab03bb8b5fd75c [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:57.370878  8644 consensus_queue.cc:1048] T b56bf91d90824c959e21e0cee5ba1816 P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.020s
I20260709 13:18:57.370637  8664 raft_consensus.cc:2804] T 4d9def8b32fd443aa94ab1420b06837b P ccd8a4c3bfe3413cb2ae219b09aea832 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:18:57.383497  6772 leader_election.cc:304] T c4db81d9d329422bb3b4160ca4ac2d1d P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:18:57.408993  6807 raft_consensus.cc:1275] T e77e330a82df4b43a745d57a68f6f057 P b7ab4784c7344b939bc36f639286f377 [term 6 FOLLOWER]: Refusing update from remote peer ccd8a4c3bfe3413cb2ae219b09aea832: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 6 index: 3. (index mismatch)
I20260709 13:18:57.389308  8596 raft_consensus.cc:2804] T 7ba5dac66ab5497e9e336f2a3c28cda5 P b7ab4784c7344b939bc36f639286f377 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:18:57.414798  8596 raft_consensus.cc:493] T 7ba5dac66ab5497e9e336f2a3c28cda5 P b7ab4784c7344b939bc36f639286f377 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 7ba59cc884714e8aa5f3f0ecaed84cbb)
I20260709 13:18:57.370437  8614 consensus_queue.cc:1048] T 22ccee1b570c4ad3a57bd7aec085b1b4 P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.034s
I20260709 13:18:57.389307  8446 raft_consensus.cc:2804] T 34f36d59d88f40fe8a2805e604fc6c0a P b7ab4784c7344b939bc36f639286f377 [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 13:18:57.413468  6695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 79883.8us
I20260709 13:18:57.408545  8425 raft_consensus.cc:515] T 4b8cacb381b746da8d0049b0a83b41dd P cd75a17ab2604397adab03bb8b5fd75c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:18:57.424825  6695 leader_election.cc:304] T d8292e16e5654be6bc408560cf256aaa P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:18:57.380901  8624 consensus_queue.cc:1048] T ce4f062dcd314d43a63ca74067cb5ee3 P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.036s
I20260709 13:18:57.402629  8638 raft_consensus.cc:2804] T d8292e16e5654be6bc408560cf256aaa P cd75a17ab2604397adab03bb8b5fd75c [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:18:57.380585  8619 consensus_queue.cc:1048] T 3411566abe2d4c9bb4b2adfdd05e6f17 P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.032s
I20260709 13:18:57.334604  8074 consensus_queue.cc:260] T 404190ce4ce94cecbfcb6ea9d1dd8626 P b7ab4784c7344b939bc36f639286f377 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:18:57.406950  8664 raft_consensus.cc:493] T 4d9def8b32fd443aa94ab1420b06837b P ccd8a4c3bfe3413cb2ae219b09aea832 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:57.430968  6695 leader_election.cc:304] T 7c37d41cd9164c15a6826ca62a851a69 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:18:57.415678  8596 raft_consensus.cc:3060] T 7ba5dac66ab5497e9e336f2a3c28cda5 P b7ab4784c7344b939bc36f639286f377 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:57.408330  8538 raft_consensus.cc:2804] T c4db81d9d329422bb3b4160ca4ac2d1d P b7ab4784c7344b939bc36f639286f377 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:18:57.430323  6697 leader_election.cc:304] T 20f6842e26174571996b8dea4151d4be P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:18:57.445636  6878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f9c2e2bf644115957398fe4c9459db" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:18:57.446239  6878 raft_consensus.cc:3060] T f3f9c2e2bf644115957398fe4c9459db P cd75a17ab2604397adab03bb8b5fd75c [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:57.430873  8406 raft_consensus.cc:1081] T 07a92dd554674067a83a9cb68c4773f2 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 3 LEADER]: Signalling peer cd75a17ab2604397adab03bb8b5fd75c to start an election
I20260709 13:18:57.447587  6873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab432e62819d499eaaf3dd55481dd930" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:18:57.448920  6873 raft_consensus.cc:2393] T ab432e62819d499eaaf3dd55481dd930 P cd75a17ab2604397adab03bb8b5fd75c [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate ccd8a4c3bfe3413cb2ae219b09aea832 in current term 5: Already voted for candidate cd75a17ab2604397adab03bb8b5fd75c in this term.
I20260709 13:18:57.431578  8662 raft_consensus.cc:2749] T d8292e16e5654be6bc408560cf256aaa P ccd8a4c3bfe3413cb2ae219b09aea832 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:18:57.428087  8405 consensus_queue.cc:1048] T e77e330a82df4b43a745d57a68f6f057 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.004s
I20260709 13:18:57.452723  8660 consensus_queue.cc:1048] T c4db81d9d329422bb3b4160ca4ac2d1d P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.014s
I20260709 13:18:57.438490  6695 leader_election.cc:304] T 44bde925b2e541b69890d70715b85176 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:18:57.454526  6695 leader_election.cc:304] T b3f13b31a1f84f0d89d007eadd57924c P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb
I20260709 13:18:57.454773  8660 raft_consensus.cc:2749] T 44bde925b2e541b69890d70715b85176 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:18:57.455427  8660 raft_consensus.cc:2804] T b3f13b31a1f84f0d89d007eadd57924c P ccd8a4c3bfe3413cb2ae219b09aea832 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:18:57.455863  8660 raft_consensus.cc:493] T b3f13b31a1f84f0d89d007eadd57924c P ccd8a4c3bfe3413cb2ae219b09aea832 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:57.456530  8660 raft_consensus.cc:3060] T b3f13b31a1f84f0d89d007eadd57924c P ccd8a4c3bfe3413cb2ae219b09aea832 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:57.456413  8655 consensus_queue.cc:1059] T 9e326172347f45e99a0d482b5d8ef768 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.017s
I20260709 13:18:57.457203  8655 consensus_queue.cc:1243] T 9e326172347f45e99a0d482b5d8ef768 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Peer cd75a17ab2604397adab03bb8b5fd75c log is divergent from this leader: its last log entry 4.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260709 13:18:57.457918  6695 leader_election.cc:304] T f5be3a11b23d4ea9b08300a2789821c7 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:18:57.459034  6695 leader_election.cc:304] T f09c2a98de1a4decabd0ff900dd44caa P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:18:57.460204  6880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4275cf08e63345f993bce8664eada830" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:18:57.461043  6804 raft_consensus.cc:2468] T f03d0dbf16864ca4bc1bb5e4c0334c0f P b7ab4784c7344b939bc36f639286f377 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 5.
I20260709 13:18:57.453286  6878 raft_consensus.cc:2468] T f3f9c2e2bf644115957398fe4c9459db P cd75a17ab2604397adab03bb8b5fd75c [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 5.
I20260709 13:18:57.436813  8074 raft_consensus.cc:3060] T 404190ce4ce94cecbfcb6ea9d1dd8626 P b7ab4784c7344b939bc36f639286f377 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:57.426697  8446 raft_consensus.cc:493] T 34f36d59d88f40fe8a2805e604fc6c0a P b7ab4784c7344b939bc36f639286f377 [term 1 FOLLOWER]: Starting leader election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:18:57.464740  6695 leader_election.cc:304] T 7c44c4849aa54f2b94d1f1bef9ed546f P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:18:57.465199  6873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3022224cc81473690653a83d4e99470" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:18:57.471393  6873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "713b5728a197487c9300b310ab94e5a3" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:18:57.472141  6873 raft_consensus.cc:3060] T 713b5728a197487c9300b310ab94e5a3 P cd75a17ab2604397adab03bb8b5fd75c [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:57.438063  8638 raft_consensus.cc:493] T d8292e16e5654be6bc408560cf256aaa P cd75a17ab2604397adab03bb8b5fd75c [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:57.467990  6697 leader_election.cc:304] T f3f9c2e2bf644115957398fe4c9459db P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:18:57.480875  6880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbdf895bba214ff68685a24fd17dfb5d" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:18:57.483034  6880 raft_consensus.cc:2393] T dbdf895bba214ff68685a24fd17dfb5d P cd75a17ab2604397adab03bb8b5fd75c [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ccd8a4c3bfe3413cb2ae219b09aea832 in current term 5: Already voted for candidate cd75a17ab2604397adab03bb8b5fd75c in this term.
I20260709 13:18:57.437232  8594 raft_consensus.cc:2749] T bd6869f07b5a4885a0b99fbe60c3b175 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:18:57.486538  6878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90d42e216d9741e190bca19a781291fd" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:18:57.487651  6878 raft_consensus.cc:2393] T 90d42e216d9741e190bca19a781291fd P cd75a17ab2604397adab03bb8b5fd75c [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate ccd8a4c3bfe3413cb2ae219b09aea832 in current term 5: Already voted for candidate cd75a17ab2604397adab03bb8b5fd75c in this term.
I20260709 13:18:57.438879  8664 raft_consensus.cc:3060] T 4d9def8b32fd443aa94ab1420b06837b P ccd8a4c3bfe3413cb2ae219b09aea832 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:57.488656  6880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "853ac0a8cbd64ce99457f170216d4d0f" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:18:57.491442  6880 raft_consensus.cc:1240] T 9b3759de40694069b13c0f8bd40e5709 P cd75a17ab2604397adab03bb8b5fd75c [term 5 FOLLOWER]: Rejecting Update request from peer ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 4. Current term is 5. Ops: []
I20260709 13:18:57.455509  6844 leader_election.cc:304] T 20f6842e26174571996b8dea4151d4be P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377
I20260709 13:18:57.484854  6697 leader_election.cc:304] T 4275cf08e63345f993bce8664eada830 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
W20260709 13:18:57.497812  8668 log.cc:927] Time spent T 8c7f33e544204fbaac4078e3e83bbf4e P ccd8a4c3bfe3413cb2ae219b09aea832: Append to log took a long time: real 0.070s	user 0.000s	sys 0.001s
I20260709 13:18:57.462239  8538 raft_consensus.cc:493] T c4db81d9d329422bb3b4160ca4ac2d1d P b7ab4784c7344b939bc36f639286f377 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:57.440481  8605 raft_consensus.cc:2749] T 7c37d41cd9164c15a6826ca62a851a69 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:18:57.466574  8257 raft_consensus.cc:2804] T 20f6842e26174571996b8dea4151d4be P ccd8a4c3bfe3413cb2ae219b09aea832 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:18:57.569227  6873 raft_consensus.cc:2468] T 713b5728a197487c9300b310ab94e5a3 P cd75a17ab2604397adab03bb8b5fd75c [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 5.
W20260709 13:18:57.679199  6773 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:57.683135  6874 raft_consensus.cc:1275] T 95a75bfe094d4bdc963aba3f08dfcd25 P cd75a17ab2604397adab03bb8b5fd75c [term 5 FOLLOWER]: Refusing update from remote peer ccd8a4c3bfe3413cb2ae219b09aea832: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 2. (term mismatch)
I20260709 13:18:57.683578  6874 pending_rounds.cc:85] T 95a75bfe094d4bdc963aba3f08dfcd25 P cd75a17ab2604397adab03bb8b5fd75c: Aborting all ops after (but not including) 1
I20260709 13:18:57.683789  6874 pending_rounds.cc:107] T 95a75bfe094d4bdc963aba3f08dfcd25 P cd75a17ab2604397adab03bb8b5fd75c: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 13:18:57.684010  6874 raft_consensus.cc:2889] T 95a75bfe094d4bdc963aba3f08dfcd25 P cd75a17ab2604397adab03bb8b5fd75c [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:18:57.684379  6874 pending_rounds.cc:107] T 95a75bfe094d4bdc963aba3f08dfcd25 P cd75a17ab2604397adab03bb8b5fd75c: Aborting uncommitted NO_OP operation due to leader change: 4.3
I20260709 13:18:57.474644  8446 raft_consensus.cc:3060] T 34f36d59d88f40fe8a2805e604fc6c0a P b7ab4784c7344b939bc36f639286f377 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:57.684614  6874 raft_consensus.cc:2889] T 95a75bfe094d4bdc963aba3f08dfcd25 P cd75a17ab2604397adab03bb8b5fd75c [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:18:57.487538  8638 raft_consensus.cc:3060] T d8292e16e5654be6bc408560cf256aaa P cd75a17ab2604397adab03bb8b5fd75c [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:57.488452  8662 raft_consensus.cc:2749] T f5be3a11b23d4ea9b08300a2789821c7 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:18:57.685562  7495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17587d6730594da4a56fa13a353232a1" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:18:57.706770  8615 raft_consensus.cc:3055] T bb7fa124c3bf4ef9ab65a407cb008441 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:18:57.685228  8574 raft_consensus.cc:493] T de3186201e1a40d0b335eeb8b4e256e0 P b7ab4784c7344b939bc36f639286f377 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:57.698609  8594 raft_consensus.cc:2804] T f3f9c2e2bf644115957398fe4c9459db P ccd8a4c3bfe3413cb2ae219b09aea832 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:18:57.509801  8602 raft_consensus.cc:493] T d8cee0accdb8499c86d4414b72565a38 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:18:57.517066  8538 raft_consensus.cc:3060] T c4db81d9d329422bb3b4160ca4ac2d1d P b7ab4784c7344b939bc36f639286f377 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:18:57.731989  6729 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.636s	user 0.020s	sys 0.017s
W20260709 13:18:57.734786  6695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 270094us
I20260709 13:18:57.679001  8257 raft_consensus.cc:493] T 20f6842e26174571996b8dea4151d4be P ccd8a4c3bfe3413cb2ae219b09aea832 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:57.514940  8619 raft_consensus.cc:2804] T 20f6842e26174571996b8dea4151d4be P cd75a17ab2604397adab03bb8b5fd75c [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 13:18:57.504902  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 49544.2us
W20260709 13:18:57.743429  8603 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.835s	user 0.001s	sys 0.018s
W20260709 13:18:57.743629  8575 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.581s	user 0.031s	sys 0.041s
I20260709 13:18:57.699105  8542 raft_consensus.cc:493] T 427c124d773f483294511e80fe340075 P b7ab4784c7344b939bc36f639286f377 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:18:57.685953  8628 leader_election.cc:290] T 9b3759de40694069b13c0f8bd40e5709 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 5 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
W20260709 13:18:57.820817  6798 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.516s	user 0.019s	sys 0.029s
W20260709 13:18:57.783596  6729 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.696s	user 0.021s	sys 0.017s
W20260709 13:18:57.821266  6798 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.535s	user 0.020s	sys 0.029s
W20260709 13:18:57.735401  8419 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.849s	user 0.011s	sys 0.030s
I20260709 13:18:57.789093  6804 raft_consensus.cc:1275] T 17587d6730594da4a56fa13a353232a1 P b7ab4784c7344b939bc36f639286f377 [term 6 FOLLOWER]: Refusing update from remote peer 7ba59cc884714e8aa5f3f0ecaed84cbb: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 13:18:57.780844  8615 raft_consensus.cc:740] T bb7fa124c3bf4ef9ab65a407cb008441 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 7ba59cc884714e8aa5f3f0ecaed84cbb, State: Running, Role: LEADER
I20260709 13:18:57.804378  6844 leader_election.cc:304] T de3186201e1a40d0b335eeb8b4e256e0 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377
I20260709 13:18:57.779446  8662 raft_consensus.cc:2749] T 7c44c4849aa54f2b94d1f1bef9ed546f P ccd8a4c3bfe3413cb2ae219b09aea832 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:18:57.835062  6844 leader_election.cc:304] T e31b9971c15848dea59d4d4130141d9e P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
W20260709 13:18:57.816504  8575 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.654s	user 0.031s	sys 0.041s
I20260709 13:18:57.730485  8405 raft_consensus.cc:2749] T 4275cf08e63345f993bce8664eada830 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:18:57.801900  8257 raft_consensus.cc:3060] T 20f6842e26174571996b8dea4151d4be P ccd8a4c3bfe3413cb2ae219b09aea832 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:57.847389  6844 leader_election.cc:304] T 4d9def8b32fd443aa94ab1420b06837b P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:18:57.786201  8594 raft_consensus.cc:697] T f3f9c2e2bf644115957398fe4c9459db P ccd8a4c3bfe3413cb2ae219b09aea832 [term 5 LEADER]: Becoming Leader. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
I20260709 13:18:57.849254  8594 consensus_queue.cc:237] T f3f9c2e2bf644115957398fe4c9459db P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:57.803476  8619 raft_consensus.cc:493] T 20f6842e26174571996b8dea4151d4be P cd75a17ab2604397adab03bb8b5fd75c [term 3 FOLLOWER]: Starting leader election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
W20260709 13:18:57.820768  8626 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.249s	user 0.021s	sys 0.031s
I20260709 13:18:57.852326  8619 raft_consensus.cc:3060] T 20f6842e26174571996b8dea4151d4be P cd75a17ab2604397adab03bb8b5fd75c [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:18:57.807798  8603 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.904s	user 0.001s	sys 0.018s
I20260709 13:18:57.860984  8603 consensus_queue.cc:1048] T 9b3759de40694069b13c0f8bd40e5709 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:18:57.862147  6801 raft_consensus.cc:2468] T 404190ce4ce94cecbfcb6ea9d1dd8626 P b7ab4784c7344b939bc36f639286f377 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 5.
I20260709 13:18:57.863251  8603 consensus_queue.cc:1048] T f4b8bd455d5a47c18a1380839c6e0d61 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 13:18:57.821768  8534 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.599s	user 0.010s	sys 0.017s
I20260709 13:18:57.851709  8627 leader_election.cc:290] T 95a75bfe094d4bdc963aba3f08dfcd25 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:18:57.865406  8656 raft_consensus.cc:3055] T 427c124d773f483294511e80fe340075 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 3 LEADER]: Stepping down as leader of term 3
W20260709 13:18:57.831940  8419 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.938s	user 0.012s	sys 0.030s
I20260709 13:18:57.777913  8574 raft_consensus.cc:515] T de3186201e1a40d0b335eeb8b4e256e0 P b7ab4784c7344b939bc36f639286f377 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
W20260709 13:18:57.852469  8626 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.287s	user 0.021s	sys 0.031s
I20260709 13:18:57.866938  8425 leader_election.cc:290] T 4b8cacb381b746da8d0049b0a83b41dd P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:18:57.872874  8658 raft_consensus.cc:2804] T f09c2a98de1a4decabd0ff900dd44caa P ccd8a4c3bfe3413cb2ae219b09aea832 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:18:57.888572  8257 raft_consensus.cc:515] T 20f6842e26174571996b8dea4151d4be P ccd8a4c3bfe3413cb2ae219b09aea832 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:57.846834  8624 raft_consensus.cc:2749] T e31b9971c15848dea59d4d4130141d9e P cd75a17ab2604397adab03bb8b5fd75c [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:18:57.837253  8628 raft_consensus.cc:2804] T de3186201e1a40d0b335eeb8b4e256e0 P cd75a17ab2604397adab03bb8b5fd75c [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:18:57.820785  8542 raft_consensus.cc:515] T 427c124d773f483294511e80fe340075 P b7ab4784c7344b939bc36f639286f377 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } attrs { replace: true } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:18:57.788128  8602 raft_consensus.cc:515] T d8cee0accdb8499c86d4414b72565a38 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
W20260709 13:18:57.909861  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 62590.1us
I20260709 13:18:57.835995  8605 consensus_queue.cc:1059] T d33d5ee8ef6f415593d8df52063161ad P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 1, Time since last communication: 0.071s
W20260709 13:18:57.905747  8094 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.567s	user 0.018s	sys 0.019s
W20260709 13:18:57.906252  8534 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.684s	user 0.010s	sys 0.020s
W20260709 13:18:57.910518  8347 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.579s	user 0.011s	sys 0.019s
I20260709 13:18:57.925292  6770 leader_election.cc:304] T b3f13b31a1f84f0d89d007eadd57924c P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:18:57.908547  8656 raft_consensus.cc:740] T 427c124d773f483294511e80fe340075 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
I20260709 13:18:58.004930  6844 leader_election.cc:304] T bb3d8792045a4583ae2e965b1350a5b4 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:18:57.923040  8678 raft_consensus.cc:2804] T 4d9def8b32fd443aa94ab1420b06837b P cd75a17ab2604397adab03bb8b5fd75c [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:18:58.020766  6844 leader_election.cc:304] T f5be3a11b23d4ea9b08300a2789821c7 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
W20260709 13:18:57.924548  6697 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 439739us
W20260709 13:18:58.049064  6770 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 123882us
I20260709 13:18:58.049948  6770 leader_election.cc:304] T 44bde925b2e541b69890d70715b85176 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:18:58.051980  6729 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50004 (request call id 1184) took 1018 ms. Trace:
I20260709 13:18:58.052472  6770 leader_election.cc:304] T d33d5ee8ef6f415593d8df52063161ad P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
W20260709 13:18:58.078002  6773 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:58.013785  8094 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.682s	user 0.018s	sys 0.019s
I20260709 13:18:58.006063  8628 raft_consensus.cc:493] T de3186201e1a40d0b335eeb8b4e256e0 P cd75a17ab2604397adab03bb8b5fd75c [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:18:58.015925  8573 consensus_meta.cc:287] T 711ef6523deb4cbe8ef2ba61e1c21c98 P cd75a17ab2604397adab03bb8b5fd75c: Time spent flushing consensus metadata: real 0.675s	user 0.011s	sys 0.002s
W20260709 13:18:58.114777  6770 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 62402.7us
I20260709 13:18:58.006336  8658 raft_consensus.cc:697] T f09c2a98de1a4decabd0ff900dd44caa P ccd8a4c3bfe3413cb2ae219b09aea832 [term 5 LEADER]: Becoming Leader. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
I20260709 13:18:58.154553  6770 leader_election.cc:304] T e77e330a82df4b43a745d57a68f6f057 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
W20260709 13:18:58.019052  8347 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.688s	user 0.012s	sys 0.019s
I20260709 13:18:58.008051  8425 raft_consensus.cc:493] T f4b8bd455d5a47c18a1380839c6e0d61 P cd75a17ab2604397adab03bb8b5fd75c [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:18:58.164395  8347 raft_consensus.cc:2749] T d33d5ee8ef6f415593d8df52063161ad P b7ab4784c7344b939bc36f639286f377 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:18:58.164808  8257 leader_election.cc:290] T 20f6842e26174571996b8dea4151d4be P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 5 election: Requested vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:18:58.165314  8425 raft_consensus.cc:515] T f4b8bd455d5a47c18a1380839c6e0d61 P cd75a17ab2604397adab03bb8b5fd75c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:58.168143  8555 raft_consensus.cc:493] T bb3d8792045a4583ae2e965b1350a5b4 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
W20260709 13:18:58.169021  8664 consensus_meta.cc:287] T 4d9def8b32fd443aa94ab1420b06837b P ccd8a4c3bfe3413cb2ae219b09aea832: Time spent flushing consensus metadata: real 0.656s	user 0.011s	sys 0.000s
I20260709 13:18:58.168912  8555 raft_consensus.cc:515] T bb3d8792045a4583ae2e965b1350a5b4 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:18:58.169512  8664 raft_consensus.cc:515] T 4d9def8b32fd443aa94ab1420b06837b P ccd8a4c3bfe3413cb2ae219b09aea832 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:58.167757  8425 leader_election.cc:290] T f4b8bd455d5a47c18a1380839c6e0d61 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:18:58.172570  6727 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1bf4668eeb70467fb3dc5a0289233b3c"
dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
mode: GRACEFUL
new_leader_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
 from {username='slave'} at 127.0.0.1:38536
I20260709 13:18:58.024914  8678 raft_consensus.cc:493] T 4d9def8b32fd443aa94ab1420b06837b P cd75a17ab2604397adab03bb8b5fd75c [term 3 FOLLOWER]: Starting leader election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:18:58.039759  8624 raft_consensus.cc:2749] T bb3d8792045a4583ae2e965b1350a5b4 P cd75a17ab2604397adab03bb8b5fd75c [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:18:58.103413  8074 raft_consensus.cc:3060] T b3f13b31a1f84f0d89d007eadd57924c P b7ab4784c7344b939bc36f639286f377 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:18:58.219733  7468 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.720s	user 0.039s	sys 0.057s
I20260709 13:18:58.088796  8627 raft_consensus.cc:493] T f09c2a98de1a4decabd0ff900dd44caa P cd75a17ab2604397adab03bb8b5fd75c [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:58.088717  8443 raft_consensus.cc:3060] T 44bde925b2e541b69890d70715b85176 P b7ab4784c7344b939bc36f639286f377 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:58.088629  8419 raft_consensus.cc:3060] T f5be3a11b23d4ea9b08300a2789821c7 P cd75a17ab2604397adab03bb8b5fd75c [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:58.120254  6725 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50004 (request call id 1187) took 1053 ms. Trace:
I20260709 13:18:58.189564  8573 raft_consensus.cc:493] T 7a734b5ab7834e05a8c422208acc58b1 P cd75a17ab2604397adab03bb8b5fd75c [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:18:58.157917  8440 raft_consensus.cc:3055] T 9e326172347f45e99a0d482b5d8ef768 P b7ab4784c7344b939bc36f639286f377 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:18:58.159924  8628 raft_consensus.cc:3060] T de3186201e1a40d0b335eeb8b4e256e0 P cd75a17ab2604397adab03bb8b5fd75c [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:58.209553  8555 leader_election.cc:290] T bb3d8792045a4583ae2e965b1350a5b4 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:18:58.218532  6727 raft_consensus.cc:606] T 1bf4668eeb70467fb3dc5a0289233b3c P ccd8a4c3bfe3413cb2ae219b09aea832 [term 4 FOLLOWER]: Received request to transfer leadership to TS cd75a17ab2604397adab03bb8b5fd75c
W20260709 13:18:58.215713  8446 consensus_meta.cc:287] T 34f36d59d88f40fe8a2805e604fc6c0a P b7ab4784c7344b939bc36f639286f377: Time spent flushing consensus metadata: real 0.531s	user 0.008s	sys 0.005s
I20260709 13:18:58.236757  6727 raft_consensus.cc:614] T 1bf4668eeb70467fb3dc5a0289233b3c P ccd8a4c3bfe3413cb2ae219b09aea832 [term 4 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:18:58.114643  8614 raft_consensus.cc:493] T 7c44c4849aa54f2b94d1f1bef9ed546f P cd75a17ab2604397adab03bb8b5fd75c [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:58.157387  8534 raft_consensus.cc:493] T fe20b4b48823486ca3b9c648db6ce8aa P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
W20260709 13:18:58.221346  7468 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.722s	user 0.039s	sys 0.057s
I20260709 13:18:57.971829  8615 consensus_queue.cc:260] T bb7fa124c3bf4ef9ab65a407cb008441 P 7ba59cc884714e8aa5f3f0ecaed84cbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
W20260709 13:18:58.233666  6696 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:58.242880  7468 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:58.245878  6877 raft_consensus.cc:1240] T ab432e62819d499eaaf3dd55481dd930 P cd75a17ab2604397adab03bb8b5fd75c [term 5 FOLLOWER]: Rejecting Update request from peer b7ab4784c7344b939bc36f639286f377 for earlier term 4. Current term is 5. Ops: [4.2-4.2]
I20260709 13:18:58.218132  8678 raft_consensus.cc:3060] T 4d9def8b32fd443aa94ab1420b06837b P cd75a17ab2604397adab03bb8b5fd75c [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:58.228878  8440 raft_consensus.cc:740] T 9e326172347f45e99a0d482b5d8ef768 P b7ab4784c7344b939bc36f639286f377 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
I20260709 13:18:58.285512  6730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbdf895bba214ff68685a24fd17dfb5d" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
W20260709 13:18:58.281421  8671 log.cc:927] Time spent T b56bf91d90824c959e21e0cee5ba1816 P ccd8a4c3bfe3413cb2ae219b09aea832: Append to log took a long time: real 0.388s	user 0.001s	sys 0.000s
I20260709 13:18:58.306248  6730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1528ab62b6fe4e3099d08f141afee116" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:18:58.307372  6730 raft_consensus.cc:2393] T 1528ab62b6fe4e3099d08f141afee116 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c in current term 5: Already voted for candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in this term.
W20260709 13:18:58.297397  6695 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.509s	user 0.020s	sys 0.046s
I20260709 13:18:58.240799  8446 raft_consensus.cc:515] T 34f36d59d88f40fe8a2805e604fc6c0a P b7ab4784c7344b939bc36f639286f377 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:58.255178  8603 raft_consensus.cc:493] T 711ef6523deb4cbe8ef2ba61e1c21c98 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader cd75a17ab2604397adab03bb8b5fd75c)
W20260709 13:18:58.309870  6695 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.522s	user 0.020s	sys 0.046s
I20260709 13:18:58.235008  8573 raft_consensus.cc:515] T 7a734b5ab7834e05a8c422208acc58b1 P cd75a17ab2604397adab03bb8b5fd75c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:58.232292  8627 raft_consensus.cc:515] T f09c2a98de1a4decabd0ff900dd44caa P cd75a17ab2604397adab03bb8b5fd75c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
W20260709 13:18:58.317425  6695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 530011us
I20260709 13:18:58.292770  8690 raft_consensus.cc:2749] T e77e330a82df4b43a745d57a68f6f057 P b7ab4784c7344b939bc36f639286f377 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
W20260709 13:18:58.308657  8680 log.cc:927] Time spent T 7c37d41cd9164c15a6826ca62a851a69 P cd75a17ab2604397adab03bb8b5fd75c: Append to log took a long time: real 0.079s	user 0.000s	sys 0.001s
I20260709 13:18:58.326689  6730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f58dc08b12a2494bb9a1372837970ca2" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
W20260709 13:18:58.335704  6698 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.548s	user 0.026s	sys 0.031s
W20260709 13:18:58.338717  6698 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.551s	user 0.027s	sys 0.031s
I20260709 13:18:58.250968  8614 raft_consensus.cc:515] T 7c44c4849aa54f2b94d1f1bef9ed546f P cd75a17ab2604397adab03bb8b5fd75c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:58.255512  8534 raft_consensus.cc:515] T fe20b4b48823486ca3b9c648db6ce8aa P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:18:58.377141  8688 raft_consensus.cc:493] T 404190ce4ce94cecbfcb6ea9d1dd8626 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:58.377939  8688 raft_consensus.cc:515] T 404190ce4ce94cecbfcb6ea9d1dd8626 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:18:58.378340  8542 leader_election.cc:290] T 427c124d773f483294511e80fe340075 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
W20260709 13:18:58.380127  8660 consensus_meta.cc:287] T b3f13b31a1f84f0d89d007eadd57924c P ccd8a4c3bfe3413cb2ae219b09aea832: Time spent flushing consensus metadata: real 0.923s	user 0.009s	sys 0.004s
I20260709 13:18:58.380779  8660 raft_consensus.cc:515] T b3f13b31a1f84f0d89d007eadd57924c P ccd8a4c3bfe3413cb2ae219b09aea832 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:18:58.382489  6730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7887766dc6784fcaa42b35c05fea7a99" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:18:58.383563  6730 raft_consensus.cc:2393] T 7887766dc6784fcaa42b35c05fea7a99 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c in current term 4: Already voted for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in this term.
I20260709 13:18:58.226141  6725 rpcz_store.cc:276] 0709 13:18:57.049680 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:57.125602 (+ 75922us) service_pool.cc:224] Handling call
0709 13:18:57.125909 (+   307us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:57.126106 (+   197us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:18:57.425593 (+299487us) log.cc:844] Serialized 14 byte log entry
0709 13:18:57.977620 (+552027us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:58.001307 (+ 23687us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:18:58.007381 (+  6074us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:58.015404 (+  8023us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:58.101956 (+ 86552us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5808,"prepare.queue_time_us":20992,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":40,"raft.queue_time_us":51034,"raft.run_cpu_time_us":266,"raft.run_wall_time_us":32626,"thread_start_us":753437,"threads_started":2,"wal-append.queue_time_us":805050}
W20260709 13:18:58.385214  8672 log.cc:927] Time spent T 9b3759de40694069b13c0f8bd40e5709 P ccd8a4c3bfe3413cb2ae219b09aea832: Append to log took a long time: real 0.167s	user 0.000s	sys 0.001s
I20260709 13:18:58.386206  6725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a485a995abc4807b6e511e45419f737" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:18:58.387257  6725 raft_consensus.cc:2468] T 3a485a995abc4807b6e511e45419f737 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 3.
W20260709 13:18:58.393042  8683 log.cc:927] Time spent T 1bf4668eeb70467fb3dc5a0289233b3c P ccd8a4c3bfe3413cb2ae219b09aea832: Append to log took a long time: real 0.099s	user 0.000s	sys 0.000s
W20260709 13:18:58.394312  8681 log.cc:927] Time spent T 24ee15416e3145beaa1b8183453729a3 P b7ab4784c7344b939bc36f639286f377: Append to log took a long time: real 0.183s	user 0.000s	sys 0.001s
I20260709 13:18:58.399129  6875 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53406 (request call id 1245) took 1077 ms. Trace:
I20260709 13:18:58.399765  6875 rpcz_store.cc:276] 0709 13:18:57.321595 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:57.321744 (+   149us) service_pool.cc:224] Handling call
0709 13:18:57.322185 (+   441us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:57.334169 (+ 11984us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:18:57.334555 (+   386us) log.cc:844] Serialized 14 byte log entry
0709 13:18:57.832144 (+497589us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:57.832673 (+   529us) log.cc:844] Serialized 26 byte log entry
0709 13:18:57.832798 (+   125us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:18:57.832832 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:57.832914 (+    82us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:58.393948 (+561034us) raft_consensus.cc:1685] finished
0709 13:18:58.393983 (+    35us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:58.399048 (+  5065us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":18886,"prepare.queue_time_us":167,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":36,"raft.queue_time_us":22055,"raft.run_cpu_time_us":275,"raft.run_wall_time_us":12443,"thread_start_us":489723,"threads_started":1,"wal-append.queue_time_us":824495}
W20260709 13:18:58.368148  8677 log.cc:927] Time spent T 853ac0a8cbd64ce99457f170216d4d0f P ccd8a4c3bfe3413cb2ae219b09aea832: Append to log took a long time: real 0.383s	user 0.000s	sys 0.001s
W20260709 13:18:58.367813  8671 log.cc:927] Time spent T b56bf91d90824c959e21e0cee5ba1816 P ccd8a4c3bfe3413cb2ae219b09aea832: Append to log took a long time: real 0.055s	user 0.001s	sys 0.000s
I20260709 13:18:58.406286  6730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24ee15416e3145beaa1b8183453729a3" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:18:58.434077  6730 raft_consensus.cc:2468] T 24ee15416e3145beaa1b8183453729a3 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 4.
I20260709 13:18:58.435287  6730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a75bfe094d4bdc963aba3f08dfcd25" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:18:58.436530  6730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b8cacb381b746da8d0049b0a83b41dd" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:18:58.406395  8440 consensus_queue.cc:260] T 9e326172347f45e99a0d482b5d8ef768 P b7ab4784c7344b939bc36f639286f377 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:58.403252  8597 raft_consensus.cc:493] T 4b8cacb381b746da8d0049b0a83b41dd P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:58.417155  8538 consensus_meta.cc:287] T c4db81d9d329422bb3b4160ca4ac2d1d P b7ab4784c7344b939bc36f639286f377: Time spent flushing consensus metadata: real 0.609s	user 0.007s	sys 0.004s
W20260709 13:18:58.420126  8596 consensus_meta.cc:287] T 7ba5dac66ab5497e9e336f2a3c28cda5 P b7ab4784c7344b939bc36f639286f377: Time spent flushing consensus metadata: real 0.953s	user 0.012s	sys 0.000s
I20260709 13:18:58.420313  8446 leader_election.cc:290] T 34f36d59d88f40fe8a2805e604fc6c0a P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 2 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:18:58.345683  8574 leader_election.cc:290] T de3186201e1a40d0b335eeb8b4e256e0 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
W20260709 13:18:58.420670  8674 log.cc:927] Time spent T be1a92657f494cac8dd227d152f50151 P 7ba59cc884714e8aa5f3f0ecaed84cbb: Append to log took a long time: real 0.304s	user 0.001s	sys 0.000s
I20260709 13:18:58.421957  8602 leader_election.cc:290] T d8cee0accdb8499c86d4414b72565a38 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
W20260709 13:18:58.426216  8619 consensus_meta.cc:287] T 20f6842e26174571996b8dea4151d4be P cd75a17ab2604397adab03bb8b5fd75c: Time spent flushing consensus metadata: real 0.573s	user 0.009s	sys 0.000s
I20260709 13:18:58.425305  8628 raft_consensus.cc:515] T de3186201e1a40d0b335eeb8b4e256e0 P cd75a17ab2604397adab03bb8b5fd75c [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:58.427685  8573 leader_election.cc:290] T 7a734b5ab7834e05a8c422208acc58b1 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:18:58.321696  8603 raft_consensus.cc:515] T 711ef6523deb4cbe8ef2ba61e1c21c98 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:58.439635  6725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90d42e216d9741e190bca19a781291fd" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:18:58.296748  8658 consensus_queue.cc:237] T f09c2a98de1a4decabd0ff900dd44caa P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:58.425420  8627 leader_election.cc:290] T f09c2a98de1a4decabd0ff900dd44caa P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:18:58.429338  8614 leader_election.cc:290] T 7c44c4849aa54f2b94d1f1bef9ed546f P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:18:58.429670  8542 raft_consensus.cc:493] T 22ccee1b570c4ad3a57bd7aec085b1b4 P b7ab4784c7344b939bc36f639286f377 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:58.449069  6770 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 294598us
I20260709 13:18:58.468333  6770 leader_election.cc:304] T d8292e16e5654be6bc408560cf256aaa P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:18:58.470471  6770 leader_election.cc:304] T 7887766dc6784fcaa42b35c05fea7a99 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
W20260709 13:18:58.451221  6878 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.628s	user 0.004s	sys 0.025s
W20260709 13:18:58.437480  8657 log.cc:927] Time spent T f03d0dbf16864ca4bc1bb5e4c0334c0f P ccd8a4c3bfe3413cb2ae219b09aea832: Append to log took a long time: real 1.449s	user 0.013s	sys 0.001s
W20260709 13:18:58.472203  6878 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.649s	user 0.004s	sys 0.025s
I20260709 13:18:58.455981  8440 raft_consensus.cc:3060] T 9e326172347f45e99a0d482b5d8ef768 P b7ab4784c7344b939bc36f639286f377 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:58.457194  8574 raft_consensus.cc:493] T 30e88460611e47b2ba16a46a30b5f416 P b7ab4784c7344b939bc36f639286f377 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:58.493109  6770 leader_election.cc:400] T be1a92657f494cac8dd227d152f50151 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 4 election: Vote denied by peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391) with higher term. Message: Invalid argument: T be1a92657f494cac8dd227d152f50151 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate b7ab4784c7344b939bc36f639286f377 for earlier term 4. Current term is 5.
I20260709 13:18:58.462246  8665 raft_consensus.cc:493] T 3411566abe2d4c9bb4b2adfdd05e6f17 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:58.446419  8597 raft_consensus.cc:515] T 4b8cacb381b746da8d0049b0a83b41dd P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:18:58.467813  8688 leader_election.cc:290] T 404190ce4ce94cecbfcb6ea9d1dd8626 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:18:58.445569  8538 raft_consensus.cc:515] T c4db81d9d329422bb3b4160ca4ac2d1d P b7ab4784c7344b939bc36f639286f377 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:58.496213  6770 leader_election.cc:403] T be1a92657f494cac8dd227d152f50151 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 4 election: Cancelling election due to peer responding with higher term
I20260709 13:18:58.518412  8534 leader_election.cc:290] T fe20b4b48823486ca3b9c648db6ce8aa P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:18:58.522198  6872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8cee0accdb8499c86d4414b72565a38" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
W20260709 13:18:58.523262  8638 consensus_meta.cc:287] T d8292e16e5654be6bc408560cf256aaa P cd75a17ab2604397adab03bb8b5fd75c: Time spent flushing consensus metadata: real 0.781s	user 0.013s	sys 0.000s
I20260709 13:18:58.451799  8596 raft_consensus.cc:515] T 7ba5dac66ab5497e9e336f2a3c28cda5 P b7ab4784c7344b939bc36f639286f377 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:18:58.525665  6725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77e330a82df4b43a745d57a68f6f057" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
W20260709 13:18:58.526748  6772 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:58.473795  8446 raft_consensus.cc:3055] T ab432e62819d499eaaf3dd55481dd930 P b7ab4784c7344b939bc36f639286f377 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:18:58.515760  8656 consensus_queue.cc:260] T 427c124d773f483294511e80fe340075 P ccd8a4c3bfe3413cb2ae219b09aea832 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.4, Last appended by leader: 4, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } attrs { replace: true } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:18:58.458092  8619 raft_consensus.cc:515] T 20f6842e26174571996b8dea4151d4be P cd75a17ab2604397adab03bb8b5fd75c [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:58.502691  8689 raft_consensus.cc:493] T dbdf895bba214ff68685a24fd17dfb5d P b7ab4784c7344b939bc36f639286f377 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:58.535764  6773 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:58.503096  8614 raft_consensus.cc:493] T 07a92dd554674067a83a9cb68c4773f2 P cd75a17ab2604397adab03bb8b5fd75c [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:18:58.503306  8626 raft_consensus.cc:493] T 427c124d773f483294511e80fe340075 P cd75a17ab2604397adab03bb8b5fd75c [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:18:58.546880  6805 raft_consensus.cc:1275] T be1a92657f494cac8dd227d152f50151 P b7ab4784c7344b939bc36f639286f377 [term 5 FOLLOWER]: Refusing update from remote peer 7ba59cc884714e8aa5f3f0ecaed84cbb: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:18:58.549889  8619 leader_election.cc:290] T 20f6842e26174571996b8dea4151d4be P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 4 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:18:58.504156  8574 raft_consensus.cc:515] T 30e88460611e47b2ba16a46a30b5f416 P b7ab4784c7344b939bc36f639286f377 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:58.565275  6872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1528ab62b6fe4e3099d08f141afee116" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:18:58.567327  6799 raft_consensus.cc:1240] T 7ba5dac66ab5497e9e336f2a3c28cda5 P b7ab4784c7344b939bc36f639286f377 [term 5 FOLLOWER]: Rejecting Update request from peer 7ba59cc884714e8aa5f3f0ecaed84cbb for earlier term 4. Current term is 5. Ops: []
I20260709 13:18:58.537494  8593 leader_election.cc:290] T 7887766dc6784fcaa42b35c05fea7a99 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 4 election: Requested vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:18:58.538648  8446 raft_consensus.cc:740] T ab432e62819d499eaaf3dd55481dd930 P b7ab4784c7344b939bc36f639286f377 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
I20260709 13:18:58.576467  7500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "427c124d773f483294511e80fe340075" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:18:58.581667  7500 raft_consensus.cc:2393] T 427c124d773f483294511e80fe340075 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7ab4784c7344b939bc36f639286f377 in current term 4: Already voted for candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in this term.
I20260709 13:18:58.581880  8446 consensus_queue.cc:260] T ab432e62819d499eaaf3dd55481dd930 P b7ab4784c7344b939bc36f639286f377 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:58.582929  8446 raft_consensus.cc:3060] T ab432e62819d499eaaf3dd55481dd930 P b7ab4784c7344b939bc36f639286f377 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:58.588395  6872 raft_consensus.cc:3060] T 1528ab62b6fe4e3099d08f141afee116 P cd75a17ab2604397adab03bb8b5fd75c [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:58.579833  6725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4b8bd455d5a47c18a1380839c6e0d61" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:18:58.598204  6725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a734b5ab7834e05a8c422208acc58b1" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:18:58.475891  8542 raft_consensus.cc:515] T 22ccee1b570c4ad3a57bd7aec085b1b4 P b7ab4784c7344b939bc36f639286f377 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:58.561990  6876 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53416 (request call id 2061) took 1109 ms. Trace:
I20260709 13:18:58.528025  8665 raft_consensus.cc:515] T 3411566abe2d4c9bb4b2adfdd05e6f17 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:58.540254  8638 raft_consensus.cc:515] T d8292e16e5654be6bc408560cf256aaa P cd75a17ab2604397adab03bb8b5fd75c [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:58.566910  8694 raft_consensus.cc:493] T 30e88460611e47b2ba16a46a30b5f416 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:58.610885  6876 rpcz_store.cc:276] 0709 13:18:57.452139 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:58.243484 (+791345us) service_pool.cc:224] Handling call
0709 13:18:58.243784 (+   300us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:58.243982 (+   198us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:18:58.283545 (+ 39563us) log.cc:844] Serialized 14 byte log entry
0709 13:18:58.559731 (+276186us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:58.559800 (+    69us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:18:58.559852 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:58.559942 (+    90us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:58.561642 (+  1700us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":39377,"prepare.run_cpu_time_us":55,"prepare.run_wall_time_us":57,"raft.queue_time_us":110,"raft.run_cpu_time_us":272,"raft.run_wall_time_us":8468,"thread_start_us":275612,"threads_started":1}
W20260709 13:18:58.616572  6695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 271256us
I20260709 13:18:58.578575  8695 raft_consensus.cc:493] T 7a734b5ab7834e05a8c422208acc58b1 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:18:58.557334  8614 raft_consensus.cc:515] T 07a92dd554674067a83a9cb68c4773f2 P cd75a17ab2604397adab03bb8b5fd75c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:58.670426  6872 raft_consensus.cc:2468] T 1528ab62b6fe4e3099d08f141afee116 P cd75a17ab2604397adab03bb8b5fd75c [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in term 5.
I20260709 13:18:58.669978  6876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "427c124d773f483294511e80fe340075" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:18:58.669931  6695 leader_election.cc:304] T a1704639a875409b9959353527b3fd68 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:18:58.612797  8331 raft_consensus.cc:493] T b3f13b31a1f84f0d89d007eadd57924c P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:58.672096  6872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34f36d59d88f40fe8a2805e604fc6c0a" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:18:58.684950  6878 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53416 (request call id 2058) took 1233 ms. Trace:
I20260709 13:18:58.685506  8574 leader_election.cc:290] T 30e88460611e47b2ba16a46a30b5f416 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:18:58.685001  8703 raft_consensus.cc:2749] T 7887766dc6784fcaa42b35c05fea7a99 P b7ab4784c7344b939bc36f639286f377 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:18:58.685961  8678 raft_consensus.cc:515] T 4d9def8b32fd443aa94ab1420b06837b P cd75a17ab2604397adab03bb8b5fd75c [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:58.673877  8701 raft_consensus.cc:2804] T d8292e16e5654be6bc408560cf256aaa P b7ab4784c7344b939bc36f639286f377 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:18:58.686527  8702 raft_consensus.cc:2749] T be1a92657f494cac8dd227d152f50151 P b7ab4784c7344b939bc36f639286f377 [term 5 FOLLOWER]: Leader election lost for term 4. Reason: Vote denied by peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391) with higher term. Message: Invalid argument: T be1a92657f494cac8dd227d152f50151 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate b7ab4784c7344b939bc36f639286f377 for earlier term 4. Current term is 5.
I20260709 13:18:58.687203  8703 raft_consensus.cc:493] T b56bf91d90824c959e21e0cee5ba1816 P b7ab4784c7344b939bc36f639286f377 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:58.686275  8542 leader_election.cc:290] T 22ccee1b570c4ad3a57bd7aec085b1b4 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:18:58.692092  8665 leader_election.cc:290] T 3411566abe2d4c9bb4b2adfdd05e6f17 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:18:58.694242  8638 leader_election.cc:290] T d8292e16e5654be6bc408560cf256aaa P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 6 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:18:58.696108  8628 leader_election.cc:290] T de3186201e1a40d0b335eeb8b4e256e0 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 5 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:18:58.667905  8694 raft_consensus.cc:515] T 30e88460611e47b2ba16a46a30b5f416 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:58.697561  8695 raft_consensus.cc:515] T 7a734b5ab7834e05a8c422208acc58b1 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:58.553544  8689 raft_consensus.cc:515] T dbdf895bba214ff68685a24fd17dfb5d P b7ab4784c7344b939bc36f639286f377 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:58.705148  8331 raft_consensus.cc:515] T b3f13b31a1f84f0d89d007eadd57924c P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:18:58.706547  6872 raft_consensus.cc:3060] T 34f36d59d88f40fe8a2805e604fc6c0a P cd75a17ab2604397adab03bb8b5fd75c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:58.708622  8603 leader_election.cc:290] T 711ef6523deb4cbe8ef2ba61e1c21c98 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:18:58.560604  8626 raft_consensus.cc:515] T 427c124d773f483294511e80fe340075 P cd75a17ab2604397adab03bb8b5fd75c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } attrs { replace: true } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:18:58.611479  8656 raft_consensus.cc:3060] T 427c124d773f483294511e80fe340075 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:58.751510  8331 leader_election.cc:290] T b3f13b31a1f84f0d89d007eadd57924c P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:18:58.703873  8597 leader_election.cc:290] T 4b8cacb381b746da8d0049b0a83b41dd P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:18:58.707897  8538 leader_election.cc:290] T c4db81d9d329422bb3b4160ca4ac2d1d P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 5 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:18:58.686153  8574 raft_consensus.cc:493] T 17587d6730594da4a56fa13a353232a1 P b7ab4784c7344b939bc36f639286f377 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:58.711416  6695 leader_election.cc:304] T 2c240553ce044eedb41541d72b9475d7 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:18:58.720264  8520 raft_consensus.cc:3055] T 44bde925b2e541b69890d70715b85176 P cd75a17ab2604397adab03bb8b5fd75c [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:18:58.756996  8520 raft_consensus.cc:740] T 44bde925b2e541b69890d70715b85176 P cd75a17ab2604397adab03bb8b5fd75c [term 4 LEADER]: Becoming Follower/Learner. State: Replica: cd75a17ab2604397adab03bb8b5fd75c, State: Running, Role: LEADER
I20260709 13:18:58.756894  8574 raft_consensus.cc:515] T 17587d6730594da4a56fa13a353232a1 P b7ab4784c7344b939bc36f639286f377 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:18:58.685472  6878 rpcz_store.cc:276] 0709 13:18:57.451444 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:57.733523 (+282079us) service_pool.cc:224] Handling call
0709 13:18:57.733972 (+   449us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:57.739694 (+  5722us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:57.739779 (+    85us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:57.766808 (+ 27029us) log.cc:844] Serialized 26 byte log entry
0709 13:18:58.472866 (+706058us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:18:58.472933 (+    67us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:58.473051 (+   118us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:58.684682 (+211631us) raft_consensus.cc:1685] finished
0709 13:18:58.684710 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:58.684876 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":4994,"raft.run_cpu_time_us":190,"raft.run_wall_time_us":38571,"thread_start_us":649075,"threads_started":1,"wal-append.queue_time_us":803309}
W20260709 13:18:58.758046  6695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 46730.1us
I20260709 13:18:58.758709  6878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3d8792045a4583ae2e965b1350a5b4" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:18:58.758832  6695 leader_election.cc:304] T be1a92657f494cac8dd227d152f50151 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, b7ab4784c7344b939bc36f639286f377
I20260709 13:18:58.725311  8691 consensus_queue.cc:1048] T 17587d6730594da4a56fa13a353232a1 P 7ba59cc884714e8aa5f3f0ecaed84cbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:18:58.759320  8574 leader_election.cc:290] T 17587d6730594da4a56fa13a353232a1 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:18:58.759645  8706 raft_consensus.cc:2749] T be1a92657f494cac8dd227d152f50151 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:18:58.726715  6731 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50004 (request call id 1193) took 1634 ms. Trace:
I20260709 13:18:58.760401  8596 leader_election.cc:290] T 7ba5dac66ab5497e9e336f2a3c28cda5 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 5 election: Requested vote from peers cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
W20260709 13:18:58.729460  6770 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 188516us
I20260709 13:18:58.760696  6731 rpcz_store.cc:276] 0709 13:18:57.092379 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:57.223663 (+131284us) service_pool.cc:224] Handling call
0709 13:18:57.251627 (+ 27964us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:57.307975 (+ 56348us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:58.726429 (+1418454us) spinlock_profiling.cc:243] Waited 42.5 ms on lock 0x7b54000e4054. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f9aae01 00007fcc0f9a983e 00007fcc1496e419 00007fcc0dee5bd4 00007fcc0dee5b62 00007fcc0dee5a91 00007fcc0dee5a0c 00007fcc0dee4cc2 00007fcc0dce548c 00007fcc0dce48c6
0709 13:18:58.726644 (+   215us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":97763712}
I20260709 13:18:58.761996  6731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe20b4b48823486ca3b9c648db6ce8aa" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:18:58.762120  8626 leader_election.cc:290] T 427c124d773f483294511e80fe340075 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:18:58.727773  6728 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50004 (request call id 1190) took 1652 ms. Trace:
I20260709 13:18:58.762512  6695 leader_election.cc:304] T 8c7f33e544204fbaac4078e3e83bbf4e P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:18:58.698833  8593 raft_consensus.cc:2804] T a1704639a875409b9959353527b3fd68 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:18:58.762961  6728 rpcz_store.cc:276] 0709 13:18:57.075907 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:57.168556 (+ 92649us) service_pool.cc:224] Handling call
0709 13:18:57.168822 (+   266us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:57.250420 (+ 81598us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:18:57.256354 (+  5934us) log.cc:844] Serialized 14 byte log entry
0709 13:18:57.731525 (+475171us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:57.731594 (+    69us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:18:57.731658 (+    64us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:58.727532 (+995874us) spinlock_profiling.cc:243] Waited 81.3 ms on lock 0x7b54000997d4. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f9aae01 00007fcc0f9a983e 00007fcc1496e419 00007fcc0dee5bd4 00007fcc0dee5b62 00007fcc0dee5a91 00007fcc0dee5a0c 00007fcc0dee4cc2 00007fcc0dce548c 00007fcc0dce48c6
0709 13:18:58.727583 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:58.727716 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":6189,"prepare.run_cpu_time_us":46,"prepare.run_wall_time_us":48,"raft.queue_time_us":46997,"raft.run_cpu_time_us":150,"raft.run_wall_time_us":18665,"spinlock_wait_cycles":187015040,"thread_start_us":472880,"threads_started":1,"wal-append.queue_time_us":649811}
I20260709 13:18:58.688432  8614 leader_election.cc:290] T 07a92dd554674067a83a9cb68c4773f2 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:18:58.742280  8701 raft_consensus.cc:697] T d8292e16e5654be6bc408560cf256aaa P b7ab4784c7344b939bc36f639286f377 [term 5 LEADER]: Becoming Leader. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
W20260709 13:18:58.747239  6771 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:58.757299  8603 raft_consensus.cc:2749] T 2c240553ce044eedb41541d72b9475d7 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:18:58.735277  7501 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50756 (request call id 135) took 2243 ms. Trace:
I20260709 13:18:58.773360  8701 consensus_queue.cc:237] T d8292e16e5654be6bc408560cf256aaa P b7ab4784c7344b939bc36f639286f377 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:58.767515  8593 raft_consensus.cc:493] T a1704639a875409b9959353527b3fd68 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 4 FOLLOWER]: Starting leader election (detected failure of leader cd75a17ab2604397adab03bb8b5fd75c)
I20260709 13:18:58.773881  7501 rpcz_store.cc:276] 0709 13:18:56.503985 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:56.507197 (+  3212us) service_pool.cc:224] Handling call
0709 13:18:57.262670 (+755473us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:57.295254 (+ 32584us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:58.691841 (+1396587us) spinlock_profiling.cc:243] Waited 716 ms on lock 0x7b5400496450. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f9a98ad 00007fcc1496e419 00007fcc0dee5bd4 00007fcc0dee5b62 00007fcc0dee5a91 00007fcc0dee5a0c 00007fcc0dee4cc2 00007fcc0dce548c 00007fcc0dce48c6 00007fcc0dce426f
0709 13:18:58.729903 (+ 38062us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1647604480}
I20260709 13:18:58.774921  8593 raft_consensus.cc:3060] T a1704639a875409b9959353527b3fd68 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:58.770505  8665 consensus_queue.cc:1048] T c4db81d9d329422bb3b4160ca4ac2d1d P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.009s
I20260709 13:18:58.777462  6879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30e88460611e47b2ba16a46a30b5f416" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:18:58.778301  6879 raft_consensus.cc:2468] T 30e88460611e47b2ba16a46a30b5f416 P cd75a17ab2604397adab03bb8b5fd75c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 3.
I20260709 13:18:58.778586  8667 raft_consensus.cc:493] T 9b3759de40694069b13c0f8bd40e5709 P b7ab4784c7344b939bc36f639286f377 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:58.779155  6879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ba5dac66ab5497e9e336f2a3c28cda5" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:18:58.779058  8667 raft_consensus.cc:515] T 9b3759de40694069b13c0f8bd40e5709 P b7ab4784c7344b939bc36f639286f377 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:58.779521  8689 leader_election.cc:290] T dbdf895bba214ff68685a24fd17dfb5d P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:18:58.779712  6879 raft_consensus.cc:3060] T 7ba5dac66ab5497e9e336f2a3c28cda5 P cd75a17ab2604397adab03bb8b5fd75c [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:58.759356  6878 raft_consensus.cc:2468] T bb3d8792045a4583ae2e965b1350a5b4 P cd75a17ab2604397adab03bb8b5fd75c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in term 4.
I20260709 13:18:58.781388  8667 leader_election.cc:290] T 9b3759de40694069b13c0f8bd40e5709 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:18:58.781797  6878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22ccee1b570c4ad3a57bd7aec085b1b4" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:18:58.782393  6875 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53416 (request call id 2062) took 1318 ms. Trace:
I20260709 13:18:58.782905  6878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de3186201e1a40d0b335eeb8b4e256e0" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:18:58.783341  8662 raft_consensus.cc:3055] T d33d5ee8ef6f415593d8df52063161ad P ccd8a4c3bfe3413cb2ae219b09aea832 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:18:58.783815  6878 raft_consensus.cc:2393] T de3186201e1a40d0b335eeb8b4e256e0 P cd75a17ab2604397adab03bb8b5fd75c [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7ab4784c7344b939bc36f639286f377 in current term 5: Already voted for candidate cd75a17ab2604397adab03bb8b5fd75c in this term.
I20260709 13:18:58.784790  6878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4db81d9d329422bb3b4160ca4ac2d1d" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:18:58.786736  6878 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53406 (request call id 1253) took 1099 ms. Trace:
I20260709 13:18:58.782740  6875 rpcz_store.cc:276] 0709 13:18:57.463703 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:58.436229 (+972526us) service_pool.cc:224] Handling call
0709 13:18:58.436545 (+   316us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:58.436914 (+   369us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:58.436969 (+    55us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:58.437440 (+   471us) log.cc:844] Serialized 26 byte log entry
0709 13:18:58.734491 (+297051us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:18:58.734531 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:58.734603 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:58.782183 (+ 47580us) raft_consensus.cc:1685] finished
0709 13:18:58.782205 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:58.782342 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1322,"raft.run_cpu_time_us":148,"raft.run_wall_time_us":2469,"thread_start_us":271117,"threads_started":1,"wal-append.queue_time_us":334749}
I20260709 13:18:58.766433  6770 leader_election.cc:304] T 711ef6523deb4cbe8ef2ba61e1c21c98 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:18:58.795145  8708 raft_consensus.cc:2749] T 711ef6523deb4cbe8ef2ba61e1c21c98 P b7ab4784c7344b939bc36f639286f377 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:18:58.795369  6875 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53406 (request call id 1254) took 1107 ms. Trace:
I20260709 13:18:58.769110  6725 raft_consensus.cc:2468] T 7a734b5ab7834e05a8c422208acc58b1 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 4.
I20260709 13:18:58.771072  6728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09c2a98de1a4decabd0ff900dd44caa" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:18:58.772711  6731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3f13b31a1f84f0d89d007eadd57924c" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:18:58.797189  8689 consensus_queue.cc:1059] T 90d42e216d9741e190bca19a781291fd P b7ab4784c7344b939bc36f639286f377 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: INVALID_TERM, Last received: 4.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:18:58.797791  6731 raft_consensus.cc:2393] T b3f13b31a1f84f0d89d007eadd57924c P ccd8a4c3bfe3413cb2ae219b09aea832 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in current term 4: Already voted for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in this term.
I20260709 13:18:58.798192  6880 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53406 (request call id 1255) took 1090 ms. Trace:
I20260709 13:18:58.773239  8707 raft_consensus.cc:493] T f58dc08b12a2494bb9a1372837970ca2 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:18:58.799152  8542 raft_consensus.cc:3055] T 90d42e216d9741e190bca19a781291fd P b7ab4784c7344b939bc36f639286f377 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:18:58.799623  8542 raft_consensus.cc:740] T 90d42e216d9741e190bca19a781291fd P b7ab4784c7344b939bc36f639286f377 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
I20260709 13:18:58.779083  8660 leader_election.cc:290] T b3f13b31a1f84f0d89d007eadd57924c P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 4 election: Requested vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:18:58.795944  8708 consensus_queue.cc:1048] T 2c240553ce044eedb41541d72b9475d7 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.022s
I20260709 13:18:58.818365  8542 consensus_queue.cc:260] T 90d42e216d9741e190bca19a781291fd P b7ab4784c7344b939bc36f639286f377 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:58.821230  7503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3f13b31a1f84f0d89d007eadd57924c" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb"
I20260709 13:18:58.821419  8433 leader_election.cc:290] T 24ee15416e3145beaa1b8183453729a3 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:18:58.821945  7503 raft_consensus.cc:3060] T b3f13b31a1f84f0d89d007eadd57924c P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:58.822197  8593 raft_consensus.cc:515] T a1704639a875409b9959353527b3fd68 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:58.824620  7501 raft_consensus.cc:1240] T 427c124d773f483294511e80fe340075 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 4 FOLLOWER]: Rejecting Update request from peer ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 3. Current term is 4. Ops: []
I20260709 13:18:58.824775  8710 raft_consensus.cc:493] T 4275cf08e63345f993bce8664eada830 P b7ab4784c7344b939bc36f639286f377 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:58.764748  6876 raft_consensus.cc:2468] T 427c124d773f483294511e80fe340075 P cd75a17ab2604397adab03bb8b5fd75c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 3.
I20260709 13:18:58.746454  8711 raft_consensus.cc:493] T 3411566abe2d4c9bb4b2adfdd05e6f17 P b7ab4784c7344b939bc36f639286f377 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:58.793684  8653 log.cc:927] Time spent T 3d65025eea89441290d85dd053810e31 P ccd8a4c3bfe3413cb2ae219b09aea832: Append to log took a long time: real 1.855s	user 0.011s	sys 0.013s
I20260709 13:18:58.764963  6695 leader_election.cc:304] T 7887766dc6784fcaa42b35c05fea7a99 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:18:58.772738  7495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ba5dac66ab5497e9e336f2a3c28cda5" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb"
I20260709 13:18:58.800271  6875 rpcz_store.cc:276] 0709 13:18:57.687643 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:58.794601 (+1106958us) service_pool.cc:224] Handling call
0709 13:18:58.794929 (+   328us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:58.795087 (+   158us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:58.795110 (+    23us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:58.795144 (+    34us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:18:58.795170 (+    26us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:58.795218 (+    48us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:58.795314 (+    96us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:58.834117  7503 raft_consensus.cc:2468] T b3f13b31a1f84f0d89d007eadd57924c P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 4.
I20260709 13:18:58.787117  6878 rpcz_store.cc:276] 0709 13:18:57.687322 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:58.785797 (+1098475us) service_pool.cc:224] Handling call
0709 13:18:58.786121 (+   324us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:58.786331 (+   210us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:58.786388 (+    57us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:58.786442 (+    54us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:18:58.786486 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:58.786555 (+    69us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:58.786676 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:18:58.807111  6697 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:58.825251  8710 raft_consensus.cc:515] T 4275cf08e63345f993bce8664eada830 P b7ab4784c7344b939bc36f639286f377 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:58.836962  6878 raft_consensus.cc:1240] T 9e326172347f45e99a0d482b5d8ef768 P cd75a17ab2604397adab03bb8b5fd75c [term 4 LEADER]: Rejecting Update request from peer b7ab4784c7344b939bc36f639286f377 for earlier term 3. Current term is 4. Ops: []
W20260709 13:18:58.838313  6695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 73408.7us
I20260709 13:18:58.807579  6879 raft_consensus.cc:2468] T 7ba5dac66ab5497e9e336f2a3c28cda5 P cd75a17ab2604397adab03bb8b5fd75c [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 5.
I20260709 13:18:58.839151  6877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbdf895bba214ff68685a24fd17dfb5d" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:18:58.762461  7500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17587d6730594da4a56fa13a353232a1" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:18:58.840775  6879 raft_consensus.cc:1240] T 7ba5dac66ab5497e9e336f2a3c28cda5 P cd75a17ab2604397adab03bb8b5fd75c [term 5 FOLLOWER]: Rejecting Update request from peer 7ba59cc884714e8aa5f3f0ecaed84cbb for earlier term 4. Current term is 5. Ops: []
I20260709 13:18:58.841629  6877 raft_consensus.cc:2468] T dbdf895bba214ff68685a24fd17dfb5d P cd75a17ab2604397adab03bb8b5fd75c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 5.
I20260709 13:18:58.738786  8534 consensus_queue.cc:1048] T be1a92657f494cac8dd227d152f50151 P 7ba59cc884714e8aa5f3f0ecaed84cbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.025s
I20260709 13:18:58.798609  6731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3d8792045a4583ae2e965b1350a5b4" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:18:58.798982  8707 raft_consensus.cc:515] T f58dc08b12a2494bb9a1372837970ca2 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:58.826984  6873 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53406 (request call id 1256) took 1084 ms. Trace:
I20260709 13:18:58.847891  6873 rpcz_store.cc:276] 0709 13:18:57.742244 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:58.826075 (+1083831us) service_pool.cc:224] Handling call
0709 13:18:58.826438 (+   363us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:58.826641 (+   203us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:58.826665 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:58.826707 (+    42us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:18:58.826735 (+    28us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:58.826801 (+    66us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:58.826922 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:58.833045  6723 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50004 (request call id 1173) took 1817 ms. Trace:
W20260709 13:18:58.849422  6846 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:58.849566  6723 rpcz_store.cc:276] 0709 13:18:57.015480 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:57.017229 (+  1749us) service_pool.cc:224] Handling call
0709 13:18:58.832824 (+1815595us) spinlock_profiling.cc:243] Waited 198 ms on lock 0x7b5400166f54. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f9ae2fa 00007fcc1496fb17 00007fcc0deea6d4 00007fcc0deea662 00007fcc0deea591 00007fcc0deea50c 00007fcc0dee97c2 00007fcc0dce548c 00007fcc0dce48c6 00007fcc0dce426f
0709 13:18:58.832979 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":454409472}
I20260709 13:18:58.797139  6728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b3759de40694069b13c0f8bd40e5709" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:18:58.838732  6878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b3759de40694069b13c0f8bd40e5709" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:18:58.853812  6878 raft_consensus.cc:2393] T 9b3759de40694069b13c0f8bd40e5709 P cd75a17ab2604397adab03bb8b5fd75c [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7ab4784c7344b939bc36f639286f377 in current term 5: Already voted for candidate cd75a17ab2604397adab03bb8b5fd75c in this term.
I20260709 13:18:58.819866  8542 raft_consensus.cc:3060] T 90d42e216d9741e190bca19a781291fd P b7ab4784c7344b939bc36f639286f377 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:58.854193  6879 raft_consensus.cc:1275] T 1528ab62b6fe4e3099d08f141afee116 P cd75a17ab2604397adab03bb8b5fd75c [term 5 FOLLOWER]: Refusing update from remote peer 7ba59cc884714e8aa5f3f0ecaed84cbb: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:18:58.766113  8706 raft_consensus.cc:2749] T 8c7f33e544204fbaac4078e3e83bbf4e P ccd8a4c3bfe3413cb2ae219b09aea832 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:18:58.855376  6872 raft_consensus.cc:2468] T 34f36d59d88f40fe8a2805e604fc6c0a P cd75a17ab2604397adab03bb8b5fd75c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 2.
I20260709 13:18:58.853564  6772 leader_election.cc:304] T 30e88460611e47b2ba16a46a30b5f416 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:18:58.855746  6806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "404190ce4ce94cecbfcb6ea9d1dd8626" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:18:58.851861  6723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a92dd554674067a83a9cb68c4773f2" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:18:58.798588  6880 rpcz_store.cc:276] 0709 13:18:57.707677 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:58.797326 (+1089649us) service_pool.cc:224] Handling call
0709 13:18:58.797652 (+   326us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:58.797850 (+   198us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:58.797881 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:58.797926 (+    45us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:18:58.797960 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:58.798018 (+    58us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:58.798134 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:58.783766  8662 raft_consensus.cc:740] T d33d5ee8ef6f415593d8df52063161ad P ccd8a4c3bfe3413cb2ae219b09aea832 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
I20260709 13:18:58.881611  6695 leader_election.cc:304] T ab432e62819d499eaaf3dd55481dd930 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:18:58.884379  6723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3022224cc81473690653a83d4e99470" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:18:58.886608  6723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbdf895bba214ff68685a24fd17dfb5d" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:18:58.862179  6728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "427c124d773f483294511e80fe340075" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:18:58.893885  6695 leader_election.cc:304] T ce4f062dcd314d43a63ca74067cb5ee3 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:18:58.894088  6728 raft_consensus.cc:2468] T 427c124d773f483294511e80fe340075 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 4.
I20260709 13:18:58.863758  6878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20f6842e26174571996b8dea4151d4be" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:18:58.895421  6878 raft_consensus.cc:3060] T 20f6842e26174571996b8dea4151d4be P cd75a17ab2604397adab03bb8b5fd75c [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:58.864830  6798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3f13b31a1f84f0d89d007eadd57924c" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:18:58.887495  6875 raft_consensus.cc:1240] T 34f36d59d88f40fe8a2805e604fc6c0a P cd75a17ab2604397adab03bb8b5fd75c [term 2 FOLLOWER]: Rejecting Update request from peer ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 1. Current term is 2. Ops: []
I20260709 13:18:58.887507  6806 raft_consensus.cc:2410] T 404190ce4ce94cecbfcb6ea9d1dd8626 P b7ab4784c7344b939bc36f639286f377 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ba59cc884714e8aa5f3f0ecaed84cbb for term 6 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 13:18:58.740824  8703 raft_consensus.cc:515] T b56bf91d90824c959e21e0cee5ba1816 P b7ab4784c7344b939bc36f639286f377 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:58.904455  6695 leader_election.cc:304] T 404190ce4ce94cecbfcb6ea9d1dd8626 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb
I20260709 13:18:58.905100  6728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17587d6730594da4a56fa13a353232a1" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:18:58.905793  6728 raft_consensus.cc:2468] T 17587d6730594da4a56fa13a353232a1 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 6.
I20260709 13:18:58.907397  6880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3411566abe2d4c9bb4b2adfdd05e6f17" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:18:58.861919  6726 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49998 (request call id 580) took 1808 ms. Trace:
I20260709 13:18:58.890455  6805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8cee0accdb8499c86d4414b72565a38" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:18:58.891762  6731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4db81d9d329422bb3b4160ca4ac2d1d" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:18:58.899434  6803 raft_consensus.cc:1275] T 1528ab62b6fe4e3099d08f141afee116 P b7ab4784c7344b939bc36f639286f377 [term 5 FOLLOWER]: Refusing update from remote peer 7ba59cc884714e8aa5f3f0ecaed84cbb: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:18:58.861192  8614 raft_consensus.cc:493] T a3022224cc81473690653a83d4e99470 P cd75a17ab2604397adab03bb8b5fd75c [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:18:58.914953  6726 rpcz_store.cc:276] 0709 13:18:57.053444 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:57.148297 (+ 94853us) service_pool.cc:224] Handling call
0709 13:18:57.148681 (+   384us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:57.148934 (+   253us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:18:57.149409 (+   475us) log.cc:844] Serialized 14 byte log entry
0709 13:18:57.494034 (+344625us) log.cc:844] Serialized 14 byte log entry
0709 13:18:58.775576 (+1281542us) spinlock_profiling.cc:243] Waited 9.27 ms on lock 0x7b1800268de0. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc15785de1 00007fcc157925b1 00007fcc0c89fe07 00007fcc156faab9 00007fcc0c8bc69b 00007fcc0c8ba93f 00007fcc0c8ba455 00007fcc0f9a2060 00007fcc0f9b4716 00007fcc0f9c5287 00007fcc0f9c5208
0709 13:18:58.861068 (+ 85492us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:58.861538 (+   470us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:18:58.861601 (+    63us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:58.861694 (+    93us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:58.861846 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3687,"prepare.queue_time_us":1031,"prepare.run_cpu_time_us":120,"prepare.run_wall_time_us":3568,"raft.queue_time_us":434266,"raft.run_cpu_time_us":159,"raft.run_wall_time_us":7092,"spinlock_wait_cycles":34838528,"thread_start_us":428846,"threads_started":2,"wal-append.queue_time_us":665022}
I20260709 13:18:58.859772  8712 raft_consensus.cc:493] T 24ee15416e3145beaa1b8183453729a3 P b7ab4784c7344b939bc36f639286f377 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 7ba59cc884714e8aa5f3f0ecaed84cbb)
I20260709 13:18:58.864521  8100 raft_consensus.cc:493] T 1bf4668eeb70467fb3dc5a0289233b3c P ccd8a4c3bfe3413cb2ae219b09aea832 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:18:58.926715  6875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "711ef6523deb4cbe8ef2ba61e1c21c98" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:18:58.939251  7500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b8cacb381b746da8d0049b0a83b41dd" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:18:58.939517  6875 raft_consensus.cc:2468] T 711ef6523deb4cbe8ef2ba61e1c21c98 P cd75a17ab2604397adab03bb8b5fd75c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 5.
I20260709 13:18:58.940215  7500 raft_consensus.cc:2468] T 4b8cacb381b746da8d0049b0a83b41dd P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 5.
I20260709 13:18:58.890470  6732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34f36d59d88f40fe8a2805e604fc6c0a" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:18:58.929502  6726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4b8bd455d5a47c18a1380839c6e0d61" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:18:58.930405  6880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d9def8b32fd443aa94ab1420b06837b" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:18:58.942736  6880 raft_consensus.cc:3060] T 4d9def8b32fd443aa94ab1420b06837b P cd75a17ab2604397adab03bb8b5fd75c [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:58.888085  8405 raft_consensus.cc:493] T b56bf91d90824c959e21e0cee5ba1816 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader cd75a17ab2604397adab03bb8b5fd75c)
I20260709 13:18:58.930342  6878 raft_consensus.cc:2468] T 20f6842e26174571996b8dea4151d4be P cd75a17ab2604397adab03bb8b5fd75c [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 5.
I20260709 13:18:58.866628  6879 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "07a92dd554674067a83a9cb68c4773f2"
dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
 from {username='slave'} at 127.0.0.1:53416
I20260709 13:18:58.880860  8665 raft_consensus.cc:493] T de3186201e1a40d0b335eeb8b4e256e0 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:58.891666  8074 consensus_meta.cc:287] T b3f13b31a1f84f0d89d007eadd57924c P b7ab4784c7344b939bc36f639286f377: Time spent flushing consensus metadata: real 0.665s	user 0.010s	sys 0.003s
W20260709 13:18:58.893738  8443 consensus_meta.cc:287] T 44bde925b2e541b69890d70715b85176 P b7ab4784c7344b939bc36f639286f377: Time spent flushing consensus metadata: real 0.662s	user 0.009s	sys 0.004s
I20260709 13:18:58.860711  8656 raft_consensus.cc:2749] T 7887766dc6784fcaa42b35c05fea7a99 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:18:58.936800  6728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30e88460611e47b2ba16a46a30b5f416" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
W20260709 13:18:58.930475  8519 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.983s	user 0.006s	sys 0.018s
I20260709 13:18:58.892072  8593 leader_election.cc:290] T a1704639a875409b9959353527b3fd68 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 5 election: Requested vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:18:58.968427  6728 raft_consensus.cc:2468] T 30e88460611e47b2ba16a46a30b5f416 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 3.
I20260709 13:18:58.967236  6726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "404190ce4ce94cecbfcb6ea9d1dd8626" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:18:58.968986  6879 raft_consensus.cc:493] T 07a92dd554674067a83a9cb68c4773f2 P cd75a17ab2604397adab03bb8b5fd75c [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:18:58.969404  6879 raft_consensus.cc:3060] T 07a92dd554674067a83a9cb68c4773f2 P cd75a17ab2604397adab03bb8b5fd75c [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:58.969687  6726 raft_consensus.cc:2410] T 404190ce4ce94cecbfcb6ea9d1dd8626 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ba59cc884714e8aa5f3f0ecaed84cbb for term 6 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 13:18:58.971918  6726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c44c4849aa54f2b94d1f1bef9ed546f" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:18:58.972945  6726 raft_consensus.cc:2468] T 7c44c4849aa54f2b94d1f1bef9ed546f P ccd8a4c3bfe3413cb2ae219b09aea832 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 5.
I20260709 13:18:58.898707  8638 raft_consensus.cc:493] T 4f00a2e87e56452083b759f60d461ee3 P cd75a17ab2604397adab03bb8b5fd75c [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 7ba59cc884714e8aa5f3f0ecaed84cbb)
W20260709 13:18:58.965646  6695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 61304.1us
I20260709 13:18:58.975049  6726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b3759de40694069b13c0f8bd40e5709" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:18:58.758080  8520 consensus_queue.cc:260] T 44bde925b2e541b69890d70715b85176 P cd75a17ab2604397adab03bb8b5fd75c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:58.892954  8658 consensus_queue.cc:1048] T 95a75bfe094d4bdc963aba3f08dfcd25 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.073s
I20260709 13:18:58.989316  6728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22ccee1b570c4ad3a57bd7aec085b1b4" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:18:58.942468  8594 raft_consensus.cc:2804] T ce4f062dcd314d43a63ca74067cb5ee3 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:18:58.925117  8578 raft_consensus.cc:2749] T ab432e62819d499eaaf3dd55481dd930 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:18:58.999053  6726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de3186201e1a40d0b335eeb8b4e256e0" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
W20260709 13:18:58.941736  8705 log.cc:927] Time spent T 22ccee1b570c4ad3a57bd7aec085b1b4 P ccd8a4c3bfe3413cb2ae219b09aea832: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 13:18:58.988842  8074 raft_consensus.cc:2749] T b3f13b31a1f84f0d89d007eadd57924c P b7ab4784c7344b939bc36f639286f377 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:18:58.867782  8425 consensus_queue.cc:1048] T ce4f062dcd314d43a63ca74067cb5ee3 P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.071s
I20260709 13:18:58.998642  6879 raft_consensus.cc:515] T 07a92dd554674067a83a9cb68c4773f2 P cd75a17ab2604397adab03bb8b5fd75c [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:58.935114  8706 raft_consensus.cc:493] T 9e326172347f45e99a0d482b5d8ef768 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:58.987797  8519 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 2.050s	user 0.006s	sys 0.018s
W20260709 13:18:58.987504  8419 consensus_meta.cc:287] T f5be3a11b23d4ea9b08300a2789821c7 P cd75a17ab2604397adab03bb8b5fd75c: Time spent flushing consensus metadata: real 0.739s	user 0.012s	sys 0.001s
I20260709 13:18:58.853477  8711 raft_consensus.cc:515] T 3411566abe2d4c9bb4b2adfdd05e6f17 P b7ab4784c7344b939bc36f639286f377 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
W20260709 13:18:58.996013  8698 log.cc:927] Time spent T b56bf91d90824c959e21e0cee5ba1816 P cd75a17ab2604397adab03bb8b5fd75c: Append to log took a long time: real 0.334s	user 0.001s	sys 0.001s
I20260709 13:18:59.017390  6728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4db81d9d329422bb3b4160ca4ac2d1d" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:18:58.967967  8555 raft_consensus.cc:493] T 427c124d773f483294511e80fe340075 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:58.938110  8603 consensus_queue.cc:1048] T e77e330a82df4b43a745d57a68f6f057 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.071s
I20260709 13:18:59.147302  6802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a485a995abc4807b6e511e45419f737" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:18:59.020637  8702 raft_consensus.cc:493] T 95a75bfe094d4bdc963aba3f08dfcd25 P b7ab4784c7344b939bc36f639286f377 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:58.988511  8443 raft_consensus.cc:2749] T 44bde925b2e541b69890d70715b85176 P b7ab4784c7344b939bc36f639286f377 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:18:59.001722  8707 leader_election.cc:290] T f58dc08b12a2494bb9a1372837970ca2 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:18:59.024432  6804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34f36d59d88f40fe8a2805e604fc6c0a" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:18:59.034343  8596 raft_consensus.cc:493] T 4d9def8b32fd443aa94ab1420b06837b P b7ab4784c7344b939bc36f639286f377 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:59.035432  6878 raft_consensus.cc:1240] T 07a92dd554674067a83a9cb68c4773f2 P cd75a17ab2604397adab03bb8b5fd75c [term 4 FOLLOWER]: Rejecting Update request from peer ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 3. Current term is 4. Ops: []
I20260709 13:18:58.997082  8720 raft_consensus.cc:493] T e31b9971c15848dea59d4d4130141d9e P b7ab4784c7344b939bc36f639286f377 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:18:59.037976  6879 leader_election.cc:290] T 07a92dd554674067a83a9cb68c4773f2 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 4 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:18:59.038128  6798 raft_consensus.cc:2468] T b3f13b31a1f84f0d89d007eadd57924c P b7ab4784c7344b939bc36f639286f377 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in term 3.
I20260709 13:18:59.009160  7993 raft_consensus.cc:2804] T 404190ce4ce94cecbfcb6ea9d1dd8626 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:18:58.943735  8614 raft_consensus.cc:515] T a3022224cc81473690653a83d4e99470 P cd75a17ab2604397adab03bb8b5fd75c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:58.948817  8100 raft_consensus.cc:515] T 1bf4668eeb70467fb3dc5a0289233b3c P ccd8a4c3bfe3413cb2ae219b09aea832 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:59.042162  6881 raft_consensus.cc:1275] T 3d65025eea89441290d85dd053810e31 P cd75a17ab2604397adab03bb8b5fd75c [term 3 FOLLOWER]: Refusing update from remote peer ccd8a4c3bfe3413cb2ae219b09aea832: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:18:59.016319  8689 raft_consensus.cc:493] T bb7fa124c3bf4ef9ab65a407cb008441 P b7ab4784c7344b939bc36f639286f377 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:58.975098  8405 raft_consensus.cc:515] T b56bf91d90824c959e21e0cee5ba1816 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:58.948194  8712 raft_consensus.cc:515] T 24ee15416e3145beaa1b8183453729a3 P b7ab4784c7344b939bc36f639286f377 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } attrs { replace: true } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:18:59.044297  6805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbdf895bba214ff68685a24fd17dfb5d" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:18:59.018121  8594 raft_consensus.cc:493] T ce4f062dcd314d43a63ca74067cb5ee3 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 5 FOLLOWER]: Starting leader election (detected failure of leader cd75a17ab2604397adab03bb8b5fd75c)
W20260709 13:18:59.050572  6697 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.68:45071, user_credentials={real_user=slave}} blocked reactor thread for 122610us
I20260709 13:18:59.149817  6770 leader_election.cc:304] T 713b5728a197487c9300b310ab94e5a3 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:18:58.986720  8665 raft_consensus.cc:515] T de3186201e1a40d0b335eeb8b4e256e0 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:59.151742  6807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7887766dc6784fcaa42b35c05fea7a99" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:18:59.185789  6807 raft_consensus.cc:2393] T 7887766dc6784fcaa42b35c05fea7a99 P b7ab4784c7344b939bc36f639286f377 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c in current term 4: Already voted for candidate b7ab4784c7344b939bc36f639286f377 in this term.
I20260709 13:18:59.034104  8519 raft_consensus.cc:697] T 4b8cacb381b746da8d0049b0a83b41dd P ccd8a4c3bfe3413cb2ae219b09aea832 [term 5 LEADER]: Becoming Leader. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
I20260709 13:18:59.026564  6800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e326172347f45e99a0d482b5d8ef768" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:18:59.154044  6804 raft_consensus.cc:2393] T 34f36d59d88f40fe8a2805e604fc6c0a P b7ab4784c7344b939bc36f639286f377 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c in current term 2: Already voted for candidate b7ab4784c7344b939bc36f639286f377 in this term.
I20260709 13:18:59.027469  8520 raft_consensus.cc:3060] T 44bde925b2e541b69890d70715b85176 P cd75a17ab2604397adab03bb8b5fd75c [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:59.156124  6728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b8cacb381b746da8d0049b0a83b41dd" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
W20260709 13:18:59.205958  6770 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 56237.2us
I20260709 13:18:59.157281  8702 raft_consensus.cc:515] T 95a75bfe094d4bdc963aba3f08dfcd25 P b7ab4784c7344b939bc36f639286f377 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:59.206983  6770 leader_election.cc:304] T 07a92dd554674067a83a9cb68c4773f2 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:18:59.158396  7500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24ee15416e3145beaa1b8183453729a3" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:18:59.040449  8419 raft_consensus.cc:2749] T f5be3a11b23d4ea9b08300a2789821c7 P cd75a17ab2604397adab03bb8b5fd75c [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:18:59.035187  8678 leader_election.cc:290] T 4d9def8b32fd443aa94ab1420b06837b P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 4 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:18:59.182190  6697 leader_election.cc:304] T b3f13b31a1f84f0d89d007eadd57924c P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
I20260709 13:18:59.153672  7495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "427c124d773f483294511e80fe340075" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:18:59.017396  8638 raft_consensus.cc:515] T 4f00a2e87e56452083b759f60d461ee3 P cd75a17ab2604397adab03bb8b5fd75c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:18:59.198916  6804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f58dc08b12a2494bb9a1372837970ca2" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:18:59.162640  7993 raft_consensus.cc:493] T 404190ce4ce94cecbfcb6ea9d1dd8626 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 4 FOLLOWER]: Starting leader election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:18:59.154472  8555 raft_consensus.cc:515] T 427c124d773f483294511e80fe340075 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } attrs { replace: true } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:18:59.184984  8594 raft_consensus.cc:3060] T ce4f062dcd314d43a63ca74067cb5ee3 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:59.200577  6802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4b8bd455d5a47c18a1380839c6e0d61" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:18:59.227762  6802 raft_consensus.cc:2393] T f4b8bd455d5a47c18a1380839c6e0d61 P b7ab4784c7344b939bc36f639286f377 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c in current term 4: Already voted for candidate b7ab4784c7344b939bc36f639286f377 in this term.
I20260709 13:18:59.181208  8689 raft_consensus.cc:515] T bb7fa124c3bf4ef9ab65a407cb008441 P b7ab4784c7344b939bc36f639286f377 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:18:58.986434  8662 consensus_queue.cc:260] T d33d5ee8ef6f415593d8df52063161ad P ccd8a4c3bfe3413cb2ae219b09aea832 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:59.212076  6804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a734b5ab7834e05a8c422208acc58b1" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:18:59.230258  6804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb7fa124c3bf4ef9ab65a407cb008441" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:18:59.160252  8596 raft_consensus.cc:515] T 4d9def8b32fd443aa94ab1420b06837b P b7ab4784c7344b939bc36f639286f377 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
W20260709 13:18:59.195420  8632 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 2.289s	user 0.024s	sys 0.007s
W20260709 13:18:59.213464  6772 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 359945us
I20260709 13:18:59.187918  8694 leader_election.cc:290] T 30e88460611e47b2ba16a46a30b5f416 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:18:59.214210  6807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "711ef6523deb4cbe8ef2ba61e1c21c98" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:18:59.253481  6807 raft_consensus.cc:2393] T 711ef6523deb4cbe8ef2ba61e1c21c98 P b7ab4784c7344b939bc36f639286f377 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ccd8a4c3bfe3413cb2ae219b09aea832 in current term 5: Already voted for candidate b7ab4784c7344b939bc36f639286f377 in this term.
I20260709 13:18:59.217801  6726 raft_consensus.cc:2468] T de3186201e1a40d0b335eeb8b4e256e0 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 4.
I20260709 13:18:59.223220  6800 raft_consensus.cc:2468] T 9e326172347f45e99a0d482b5d8ef768 P b7ab4784c7344b939bc36f639286f377 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 4.
I20260709 13:18:59.247922  6770 leader_election.cc:304] T a3022224cc81473690653a83d4e99470 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:18:59.255581  6800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30e88460611e47b2ba16a46a30b5f416" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:18:59.250263  6805 raft_consensus.cc:2468] T dbdf895bba214ff68685a24fd17dfb5d P b7ab4784c7344b939bc36f639286f377 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 5.
I20260709 13:18:59.200363  8691 raft_consensus.cc:493] T 3fa34c08b205435dba97346991aa1f92 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:18:59.217757  7993 raft_consensus.cc:3060] T 404190ce4ce94cecbfcb6ea9d1dd8626 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:59.039897  8706 raft_consensus.cc:515] T 9e326172347f45e99a0d482b5d8ef768 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:59.257623  6770 leader_election.cc:304] T 17587d6730594da4a56fa13a353232a1 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
I20260709 13:18:59.258363  6805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90d42e216d9741e190bca19a781291fd" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:18:59.215657  8603 raft_consensus.cc:2804] T b3f13b31a1f84f0d89d007eadd57924c P ccd8a4c3bfe3413cb2ae219b09aea832 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:18:59.163239  8720 raft_consensus.cc:515] T e31b9971c15848dea59d4d4130141d9e P b7ab4784c7344b939bc36f639286f377 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:59.270090  6804 raft_consensus.cc:2393] T bb7fa124c3bf4ef9ab65a407cb008441 P b7ab4784c7344b939bc36f639286f377 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c in current term 5: Already voted for candidate b7ab4784c7344b939bc36f639286f377 in this term.
I20260709 13:18:59.271709  6880 raft_consensus.cc:2468] T 4d9def8b32fd443aa94ab1420b06837b P cd75a17ab2604397adab03bb8b5fd75c [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 5.
I20260709 13:18:59.265129  8722 raft_consensus.cc:2804] T 30e88460611e47b2ba16a46a30b5f416 P b7ab4784c7344b939bc36f639286f377 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:18:59.272971  8722 raft_consensus.cc:493] T 30e88460611e47b2ba16a46a30b5f416 P b7ab4784c7344b939bc36f639286f377 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:59.273512  8722 raft_consensus.cc:3060] T 30e88460611e47b2ba16a46a30b5f416 P b7ab4784c7344b939bc36f639286f377 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:18:59.273782  8719 log.cc:927] Time spent T d8292e16e5654be6bc408560cf256aaa P b7ab4784c7344b939bc36f639286f377: Append to log took a long time: real 0.075s	user 0.000s	sys 0.000s
I20260709 13:18:59.216377  8695 leader_election.cc:290] T 7a734b5ab7834e05a8c422208acc58b1 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
W20260709 13:18:59.255769  8632 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 2.350s	user 0.025s	sys 0.007s
I20260709 13:18:59.254190  8467 raft_consensus.cc:2749] T 07a92dd554674067a83a9cb68c4773f2 P b7ab4784c7344b939bc36f639286f377 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260709 13:18:59.283803  7468 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:59.266099  8662 raft_consensus.cc:3060] T d33d5ee8ef6f415593d8df52063161ad P ccd8a4c3bfe3413cb2ae219b09aea832 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:59.287473  6723 raft_consensus.cc:1275] T 9e326172347f45e99a0d482b5d8ef768 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 4 FOLLOWER]: Refusing update from remote peer cd75a17ab2604397adab03bb8b5fd75c: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
W20260709 13:18:59.290885  8725 log.cc:927] Time spent T 17587d6730594da4a56fa13a353232a1 P b7ab4784c7344b939bc36f639286f377: Append to log took a long time: real 0.091s	user 0.000s	sys 0.001s
I20260709 13:18:59.295483  8638 leader_election.cc:290] T 4f00a2e87e56452083b759f60d461ee3 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:18:59.296857  8689 leader_election.cc:290] T bb7fa124c3bf4ef9ab65a407cb008441 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:18:59.278738  8074 raft_consensus.cc:2804] T 17587d6730594da4a56fa13a353232a1 P b7ab4784c7344b939bc36f639286f377 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:18:59.297461  7495 raft_consensus.cc:2393] T 427c124d773f483294511e80fe340075 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c in current term 4: Already voted for candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in this term.
I20260709 13:18:59.268685  8710 leader_election.cc:290] T 4275cf08e63345f993bce8664eada830 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:18:59.199932  8519 consensus_queue.cc:237] T 4b8cacb381b746da8d0049b0a83b41dd P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:18:59.265826  8723 raft_consensus.cc:2749] T a3022224cc81473690653a83d4e99470 P b7ab4784c7344b939bc36f639286f377 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:18:59.269542  8691 raft_consensus.cc:515] T 3fa34c08b205435dba97346991aa1f92 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:18:59.281651  8603 raft_consensus.cc:697] T b3f13b31a1f84f0d89d007eadd57924c P ccd8a4c3bfe3413cb2ae219b09aea832 [term 4 LEADER]: Becoming Leader. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
I20260709 13:18:59.301198  8727 raft_consensus.cc:3060] T 713b5728a197487c9300b310ab94e5a3 P b7ab4784c7344b939bc36f639286f377 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:59.307853  6807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b56bf91d90824c959e21e0cee5ba1816" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:18:59.310809  8074 raft_consensus.cc:493] T 17587d6730594da4a56fa13a353232a1 P b7ab4784c7344b939bc36f639286f377 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 7ba59cc884714e8aa5f3f0ecaed84cbb)
I20260709 13:18:59.280494  8664 leader_election.cc:290] T 4d9def8b32fd443aa94ab1420b06837b P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 5 election: Requested vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:18:59.313578  6772 leader_election.cc:304] T 7ba5dac66ab5497e9e336f2a3c28cda5 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
W20260709 13:18:59.326097  6772 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:59.328359  6805 raft_consensus.cc:2468] T 90d42e216d9741e190bca19a781291fd P b7ab4784c7344b939bc36f639286f377 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 5.
I20260709 13:18:59.305717  8703 leader_election.cc:290] T b56bf91d90824c959e21e0cee5ba1816 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:18:59.322407  6807 raft_consensus.cc:2468] T b56bf91d90824c959e21e0cee5ba1816 P b7ab4784c7344b939bc36f639286f377 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 4.
I20260709 13:18:59.340687  8702 leader_election.cc:290] T 95a75bfe094d4bdc963aba3f08dfcd25 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:18:59.341727  8555 leader_election.cc:290] T 427c124d773f483294511e80fe340075 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:18:59.342746  7500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb7fa124c3bf4ef9ab65a407cb008441" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:18:59.342531  8603 consensus_queue.cc:237] T b3f13b31a1f84f0d89d007eadd57924c P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:18:59.347908  6807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09c2a98de1a4decabd0ff900dd44caa" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:18:59.329627  8074 raft_consensus.cc:3060] T 17587d6730594da4a56fa13a353232a1 P b7ab4784c7344b939bc36f639286f377 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:59.351338  6801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f58dc08b12a2494bb9a1372837970ca2" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:18:59.354914  8614 leader_election.cc:290] T a3022224cc81473690653a83d4e99470 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:18:59.337342  8723 raft_consensus.cc:493] T f09c2a98de1a4decabd0ff900dd44caa P b7ab4784c7344b939bc36f639286f377 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:59.356408  8723 raft_consensus.cc:515] T f09c2a98de1a4decabd0ff900dd44caa P b7ab4784c7344b939bc36f639286f377 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:59.357060  6802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a75bfe094d4bdc963aba3f08dfcd25" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:18:59.334343  8710 raft_consensus.cc:2804] T 7ba5dac66ab5497e9e336f2a3c28cda5 P b7ab4784c7344b939bc36f639286f377 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:18:59.358086  6802 raft_consensus.cc:2468] T 95a75bfe094d4bdc963aba3f08dfcd25 P b7ab4784c7344b939bc36f639286f377 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 5.
I20260709 13:18:59.359038  6807 raft_consensus.cc:2468] T f09c2a98de1a4decabd0ff900dd44caa P b7ab4784c7344b939bc36f639286f377 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 5.
I20260709 13:18:59.363145  8665 leader_election.cc:290] T de3186201e1a40d0b335eeb8b4e256e0 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:18:59.366689  8691 leader_election.cc:290] T 3fa34c08b205435dba97346991aa1f92 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:18:59.367446  8710 raft_consensus.cc:697] T 7ba5dac66ab5497e9e336f2a3c28cda5 P b7ab4784c7344b939bc36f639286f377 [term 5 LEADER]: Becoming Leader. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
I20260709 13:18:59.368489  8710 consensus_queue.cc:237] T 7ba5dac66ab5497e9e336f2a3c28cda5 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
W20260709 13:18:59.373598  6845 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:59.382887  8715 log.cc:927] Time spent T f09c2a98de1a4decabd0ff900dd44caa P ccd8a4c3bfe3413cb2ae219b09aea832: Append to log took a long time: real 0.367s	user 0.002s	sys 0.001s
I20260709 13:18:59.378948  8706 leader_election.cc:290] T 9e326172347f45e99a0d482b5d8ef768 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:18:59.358534  8722 raft_consensus.cc:515] T 30e88460611e47b2ba16a46a30b5f416 P b7ab4784c7344b939bc36f639286f377 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:59.454391  8722 leader_election.cc:290] T 30e88460611e47b2ba16a46a30b5f416 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 4 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
W20260709 13:18:59.451560  8721 log.cc:927] Time spent T 24ee15416e3145beaa1b8183453729a3 P cd75a17ab2604397adab03bb8b5fd75c: Append to log took a long time: real 0.237s	user 0.001s	sys 0.000s
I20260709 13:18:59.478271  8594 raft_consensus.cc:515] T ce4f062dcd314d43a63ca74067cb5ee3 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } attrs { replace: true } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:18:59.482056  8594 leader_election.cc:290] T ce4f062dcd314d43a63ca74067cb5ee3 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 6 election: Requested vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:18:59.510926  8727 raft_consensus.cc:2749] T 713b5728a197487c9300b310ab94e5a3 P b7ab4784c7344b939bc36f639286f377 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:18:59.566576  6695 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:59.601143  6728 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49998 (request call id 585) took 1353 ms. Trace:
I20260709 13:18:59.601930  6728 rpcz_store.cc:276] 0709 13:18:58.247299 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:59.206877 (+959578us) service_pool.cc:224] Handling call
0709 13:18:59.207462 (+   585us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:59.207919 (+   457us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:59.207956 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:59.208579 (+   623us) log.cc:844] Serialized 26 byte log entry
0709 13:18:59.333470 (+124891us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:18:59.333531 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:59.333659 (+   128us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:59.600323 (+266664us) raft_consensus.cc:1685] finished
0709 13:18:59.600409 (+    86us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:59.600857 (+   448us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2018,"raft.run_cpu_time_us":391,"raft.run_wall_time_us":48926,"thread_start_us":124306,"threads_started":1,"wal-append.queue_time_us":144193}
I20260709 13:18:59.607033  6728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fa34c08b205435dba97346991aa1f92" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:18:59.610628  6728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "427c124d773f483294511e80fe340075" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:18:59.662422  6728 raft_consensus.cc:2468] T 427c124d773f483294511e80fe340075 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in term 4.
I20260709 13:18:59.664951  6727 raft_consensus.cc:1240] T ce4f062dcd314d43a63ca74067cb5ee3 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 6 FOLLOWER]: Rejecting Update request from peer cd75a17ab2604397adab03bb8b5fd75c for earlier term 5. Current term is 6. Ops: []
I20260709 13:18:59.666050  6727 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49998 (request call id 594) took 1351 ms. Trace:
I20260709 13:18:59.666631  6727 rpcz_store.cc:276] 0709 13:18:58.314887 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:59.647574 (+1332687us) service_pool.cc:224] Handling call
0709 13:18:59.664300 (+ 16726us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:59.665609 (+  1309us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:59.665937 (+   328us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:59.668421  6728 raft_consensus.cc:1275] T 4275cf08e63345f993bce8664eada830 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 4 FOLLOWER]: Refusing update from remote peer cd75a17ab2604397adab03bb8b5fd75c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:18:59.669021  6727 raft_consensus.cc:1240] T a1704639a875409b9959353527b3fd68 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 5 FOLLOWER]: Rejecting Update request from peer cd75a17ab2604397adab03bb8b5fd75c for earlier term 4. Current term is 5. Ops: []
I20260709 13:18:59.629726  6800 raft_consensus.cc:2368] T 30e88460611e47b2ba16a46a30b5f416 P b7ab4784c7344b939bc36f639286f377 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c for earlier term 3. Current term is 4.
I20260709 13:18:59.631229  6801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1528ab62b6fe4e3099d08f141afee116" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:18:59.632735  6802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30e88460611e47b2ba16a46a30b5f416" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
W20260709 13:18:59.660934  7468 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:59.619130  6772 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.68:45071, user_credentials={real_user=slave}} blocked reactor thread for 279628us
I20260709 13:18:59.687114  8094 raft_consensus.cc:493] T 4275cf08e63345f993bce8664eada830 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:59.700930  8094 raft_consensus.cc:515] T 4275cf08e63345f993bce8664eada830 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:59.702916  6801 raft_consensus.cc:2393] T 1528ab62b6fe4e3099d08f141afee116 P b7ab4784c7344b939bc36f639286f377 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c in current term 5: Already voted for candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in this term.
I20260709 13:18:59.691205  8405 leader_election.cc:290] T b56bf91d90824c959e21e0cee5ba1816 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:18:59.693158  7466 leader_election.cc:304] T 404190ce4ce94cecbfcb6ea9d1dd8626 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:18:59.669283  6728 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49998 (request call id 595) took 1338 ms. Trace:
I20260709 13:18:59.694747  8593 raft_consensus.cc:493] T 44bde925b2e541b69890d70715b85176 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:59.706136  8688 consensus_queue.cc:1048] T 1528ab62b6fe4e3099d08f141afee116 P 7ba59cc884714e8aa5f3f0ecaed84cbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:18:59.688561  8519 raft_consensus.cc:493] T f5be3a11b23d4ea9b08300a2789821c7 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:59.707279  8593 raft_consensus.cc:515] T 44bde925b2e541b69890d70715b85176 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:59.708454  8519 raft_consensus.cc:515] T f5be3a11b23d4ea9b08300a2789821c7 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:59.710462  6802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1704639a875409b9959353527b3fd68" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:18:59.711489  6802 raft_consensus.cc:3060] T a1704639a875409b9959353527b3fd68 P b7ab4784c7344b939bc36f639286f377 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:59.712472  8593 leader_election.cc:290] T 44bde925b2e541b69890d70715b85176 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:18:59.713084  8691 raft_consensus.cc:2749] T 404190ce4ce94cecbfcb6ea9d1dd8626 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:18:59.713896  6727 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49998 (request call id 598) took 1286 ms. Trace:
I20260709 13:18:59.714529  6727 rpcz_store.cc:276] 0709 13:18:58.417817 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:59.668027 (+1250210us) service_pool.cc:224] Handling call
0709 13:18:59.668634 (+   607us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:59.698437 (+ 29803us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:59.704021 (+  5584us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:59.717213  6801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3411566abe2d4c9bb4b2adfdd05e6f17" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:18:59.718187  6801 raft_consensus.cc:2468] T 3411566abe2d4c9bb4b2adfdd05e6f17 P b7ab4784c7344b939bc36f639286f377 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 3.
I20260709 13:18:59.711587  6728 rpcz_store.cc:276] 0709 13:18:58.331386 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:59.665132 (+1333746us) service_pool.cc:224] Handling call
0709 13:18:59.665838 (+   706us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:59.668976 (+  3138us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:59.669187 (+   211us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:59.718509  6727 raft_consensus.cc:1275] T 17587d6730594da4a56fa13a353232a1 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 6 FOLLOWER]: Refusing update from remote peer 7ba59cc884714e8aa5f3f0ecaed84cbb: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 13:18:59.721426  6727 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49744 (request call id 110) took 1303 ms. Trace:
I20260709 13:18:59.723747  6727 rpcz_store.cc:276] 0709 13:18:58.418407 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:59.716814 (+1298407us) service_pool.cc:224] Handling call
0709 13:18:59.717513 (+   699us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:59.721067 (+  3554us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:59.721345 (+   278us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:59.751757  6801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d9def8b32fd443aa94ab1420b06837b" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:18:59.756011  8520 raft_consensus.cc:493] T 3d65025eea89441290d85dd053810e31 P cd75a17ab2604397adab03bb8b5fd75c [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:59.769812  8520 raft_consensus.cc:515] T 3d65025eea89441290d85dd053810e31 P cd75a17ab2604397adab03bb8b5fd75c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:59.771517  6772 leader_election.cc:304] T dbdf895bba214ff68685a24fd17dfb5d P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:18:59.751557  8688 consensus_queue.cc:1048] T 17587d6730594da4a56fa13a353232a1 P 7ba59cc884714e8aa5f3f0ecaed84cbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.026s
I20260709 13:18:59.776824  8347 raft_consensus.cc:2804] T dbdf895bba214ff68685a24fd17dfb5d P b7ab4784c7344b939bc36f639286f377 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:18:59.777281  8347 raft_consensus.cc:493] T dbdf895bba214ff68685a24fd17dfb5d P b7ab4784c7344b939bc36f639286f377 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:59.777629  8347 raft_consensus.cc:3060] T dbdf895bba214ff68685a24fd17dfb5d P b7ab4784c7344b939bc36f639286f377 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:59.772843  6728 raft_consensus.cc:1275] T 1528ab62b6fe4e3099d08f141afee116 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 5 FOLLOWER]: Refusing update from remote peer 7ba59cc884714e8aa5f3f0ecaed84cbb: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:18:59.779307  6728 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49744 (request call id 111) took 1360 ms. Trace:
I20260709 13:18:59.779829  6728 rpcz_store.cc:276] 0709 13:18:58.418701 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:59.723763 (+1305062us) service_pool.cc:224] Handling call
0709 13:18:59.741181 (+ 17418us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:59.779022 (+ 37841us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:59.779241 (+   219us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:18:59.849126  6847 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:59.855952  6728 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49744 (request call id 113) took 1436 ms. Trace:
I20260709 13:18:59.856470  6728 rpcz_store.cc:276] 0709 13:18:58.419175 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:59.844839 (+1425664us) service_pool.cc:224] Handling call
0709 13:18:59.855135 (+ 10296us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:59.855595 (+   460us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:59.855626 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:59.855669 (+    43us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:18:59.855703 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:59.855763 (+    60us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:59.855884 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:59.858677  6727 raft_consensus.cc:1275] T be1a92657f494cac8dd227d152f50151 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 5 FOLLOWER]: Refusing update from remote peer 7ba59cc884714e8aa5f3f0ecaed84cbb: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:18:59.859285  6695 leader_election.cc:304] T b56bf91d90824c959e21e0cee5ba1816 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
I20260709 13:18:59.859378  6727 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49744 (request call id 112) took 1440 ms. Trace:
I20260709 13:18:59.860814  6727 rpcz_store.cc:276] 0709 13:18:58.418929 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:59.729509 (+1310580us) service_pool.cc:224] Handling call
0709 13:18:59.762483 (+ 32974us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:59.859097 (+ 96614us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:59.859304 (+   207us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:59.863018  6727 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50004 (request call id 1200) took 1061 ms. Trace:
W20260709 13:18:59.863895  6696 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:59.864970  6845 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:59.865015  6728 raft_consensus.cc:1240] T 44bde925b2e541b69890d70715b85176 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 5 FOLLOWER]: Rejecting Update request from peer cd75a17ab2604397adab03bb8b5fd75c for earlier term 4. Current term is 5. Ops: [2.2-4.3]
I20260709 13:18:59.863418  6727 rpcz_store.cc:276] 0709 13:18:58.801204 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:59.861705 (+1060501us) service_pool.cc:224] Handling call
0709 13:18:59.862266 (+   561us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:59.862668 (+   402us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:59.862693 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:59.862751 (+    58us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:18:59.862777 (+    26us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:59.862828 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:59.862937 (+   109us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:59.895905  6728 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49998 (request call id 601) took 1347 ms. Trace:
I20260709 13:18:59.896494  6728 rpcz_store.cc:276] 0709 13:18:58.519085 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:59.857386 (+1338301us) service_pool.cc:224] Handling call
0709 13:18:59.864671 (+  7285us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:18:59.866227 (+  1556us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:59.866722 (+   495us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:18:59.897404  7468 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:59.817514  6724 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49998 (request call id 559) took 4021 ms (client timeout 1542 ms). Trace:
W20260709 13:18:59.901448  6724 rpcz_store.cc:269] 0709 13:18:55.728526 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:55.747815 (+ 19289us) service_pool.cc:224] Handling call
0709 13:18:57.261238 (+1513423us) spinlock_profiling.cc:243] Waited 7.39 ms on lock 0x7b5800000c98. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0c745db1 00007fcc0c885b71 00007fcc0c885a22 00007fcc1579ec09 00007fcc148f8ee0 00007fcc149c20ab 00007fcc149c2131 00007fcc149700a0 00007fcc1496f984 00007fcc0deea6d4 00007fcc0deea662
0709 13:18:59.743308 (+2482070us) spinlock_profiling.cc:243] Waited 12.9 ms on lock 0x7b540020bcd4. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f9ae2fa 00007fcc1496fb17 00007fcc0deea6d4 00007fcc0deea662 00007fcc0deea591 00007fcc0deea50c 00007fcc0dee97c2 00007fcc0dce548c 00007fcc0dce48c6 00007fcc0dce426f
0709 13:18:59.750311 (+  7003us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":46748800}
I20260709 13:18:59.923617  6728 raft_consensus.cc:1275] T 7c37d41cd9164c15a6826ca62a851a69 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 4 FOLLOWER]: Refusing update from remote peer b7ab4784c7344b939bc36f639286f377: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:18:59.924885  6728 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50004 (request call id 1203) took 1123 ms. Trace:
I20260709 13:18:59.925477  6728 rpcz_store.cc:276] 0709 13:18:58.801890 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:59.921985 (+1120095us) service_pool.cc:224] Handling call
0709 13:18:59.922829 (+   844us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:59.924414 (+  1585us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:59.924787 (+   373us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:59.928212  8688 consensus_queue.cc:1048] T 1528ab62b6fe4e3099d08f141afee116 P 7ba59cc884714e8aa5f3f0ecaed84cbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:18:59.930568  8727 raft_consensus.cc:493] T 3d65025eea89441290d85dd053810e31 P b7ab4784c7344b939bc36f639286f377 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:59.931732  8727 raft_consensus.cc:515] T 3d65025eea89441290d85dd053810e31 P b7ab4784c7344b939bc36f639286f377 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:18:59.935451  8727 leader_election.cc:290] T 3d65025eea89441290d85dd053810e31 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:18:59.939558  8716 raft_consensus.cc:2804] T b56bf91d90824c959e21e0cee5ba1816 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:18:59.940321  8716 raft_consensus.cc:493] T b56bf91d90824c959e21e0cee5ba1816 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 4 FOLLOWER]: Starting leader election (detected failure of leader cd75a17ab2604397adab03bb8b5fd75c)
I20260709 13:18:59.940888  8716 raft_consensus.cc:3060] T b56bf91d90824c959e21e0cee5ba1816 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:59.941773  6874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4275cf08e63345f993bce8664eada830" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:18:59.945266  6875 raft_consensus.cc:1275] T f5be3a11b23d4ea9b08300a2789821c7 P cd75a17ab2604397adab03bb8b5fd75c [term 5 FOLLOWER]: Refusing update from remote peer b7ab4784c7344b939bc36f639286f377: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:18:59.946017  6727 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50004 (request call id 1202) took 1144 ms. Trace:
I20260709 13:18:59.946683  6727 rpcz_store.cc:276] 0709 13:18:58.801679 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:59.944308 (+1142629us) service_pool.cc:224] Handling call
0709 13:18:59.945023 (+   715us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:59.945487 (+   464us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:59.945527 (+    40us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:59.945609 (+    82us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:18:59.945695 (+    86us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:59.945776 (+    81us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:59.945933 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:59.963927  6801 raft_consensus.cc:3060] T 4d9def8b32fd443aa94ab1420b06837b P b7ab4784c7344b939bc36f639286f377 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:59.906917  6844 leader_election.cc:304] T 1528ab62b6fe4e3099d08f141afee116 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:18:59.973132  6728 raft_consensus.cc:1275] T 7c44c4849aa54f2b94d1f1bef9ed546f P ccd8a4c3bfe3413cb2ae219b09aea832 [term 5 FOLLOWER]: Refusing update from remote peer b7ab4784c7344b939bc36f639286f377: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:18:59.974354  6728 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50004 (request call id 1204) took 1172 ms. Trace:
I20260709 13:18:59.752983  8519 leader_election.cc:290] T f5be3a11b23d4ea9b08300a2789821c7 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:18:59.979373  8520 leader_election.cc:290] T 3d65025eea89441290d85dd053810e31 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:18:59.976908  6728 rpcz_store.cc:276] 0709 13:18:58.802118 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:59.926740 (+1124622us) service_pool.cc:224] Handling call
0709 13:18:59.927458 (+   718us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:59.973930 (+ 46472us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:59.974261 (+   331us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:18:59.982818  6772 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 86173.8us
I20260709 13:19:00.000509  6874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b56bf91d90824c959e21e0cee5ba1816" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:19:00.007597  6875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb7fa124c3bf4ef9ab65a407cb008441" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:19:00.016661  8094 leader_election.cc:290] T 4275cf08e63345f993bce8664eada830 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:00.019199  6880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a75bfe094d4bdc963aba3f08dfcd25" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:19:00.019647  6772 leader_election.cc:304] T 34f36d59d88f40fe8a2805e604fc6c0a P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:19:00.020284  6880 raft_consensus.cc:2468] T 95a75bfe094d4bdc963aba3f08dfcd25 P cd75a17ab2604397adab03bb8b5fd75c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 5.
I20260709 13:19:00.020610  6802 raft_consensus.cc:2468] T a1704639a875409b9959353527b3fd68 P b7ab4784c7344b939bc36f639286f377 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 5.
I20260709 13:19:00.009593  8520 raft_consensus.cc:2749] T 1528ab62b6fe4e3099d08f141afee116 P cd75a17ab2604397adab03bb8b5fd75c [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:19:00.045248  7466 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 182148us
W20260709 13:19:00.052595  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 354315us
I20260709 13:19:00.041867  8727 raft_consensus.cc:2804] T 34f36d59d88f40fe8a2805e604fc6c0a P b7ab4784c7344b939bc36f639286f377 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:19:00.046531  8710 raft_consensus.cc:493] T 4f00a2e87e56452083b759f60d461ee3 P b7ab4784c7344b939bc36f639286f377 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 7ba59cc884714e8aa5f3f0ecaed84cbb)
I20260709 13:19:00.056640  6880 raft_consensus.cc:1240] T f58dc08b12a2494bb9a1372837970ca2 P cd75a17ab2604397adab03bb8b5fd75c [term 6 FOLLOWER]: Rejecting Update request from peer b7ab4784c7344b939bc36f639286f377 for earlier term 5. Current term is 6. Ops: []
I20260709 13:19:00.056080  6802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90d42e216d9741e190bca19a781291fd" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:19:00.049206  8615 raft_consensus.cc:3060] T bb7fa124c3bf4ef9ab65a407cb008441 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:19:00.059396  6695 leader_election.cc:304] T 3411566abe2d4c9bb4b2adfdd05e6f17 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
W20260709 13:19:00.061733  7993 consensus_meta.cc:287] T 404190ce4ce94cecbfcb6ea9d1dd8626 P ccd8a4c3bfe3413cb2ae219b09aea832: Time spent flushing consensus metadata: real 0.745s	user 0.011s	sys 0.006s
I20260709 13:19:00.061874  8727 raft_consensus.cc:697] T 34f36d59d88f40fe8a2805e604fc6c0a P b7ab4784c7344b939bc36f639286f377 [term 2 LEADER]: Becoming Leader. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
I20260709 13:19:00.062230  6874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30e88460611e47b2ba16a46a30b5f416" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:19:00.063244  6874 raft_consensus.cc:3060] T 30e88460611e47b2ba16a46a30b5f416 P cd75a17ab2604397adab03bb8b5fd75c [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:19:00.062707  7993 raft_consensus.cc:515] T 404190ce4ce94cecbfcb6ea9d1dd8626 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:19:00.048344  8520 raft_consensus.cc:493] T 44bde925b2e541b69890d70715b85176 P cd75a17ab2604397adab03bb8b5fd75c [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:00.059415  8710 raft_consensus.cc:515] T 4f00a2e87e56452083b759f60d461ee3 P b7ab4784c7344b939bc36f639286f377 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:19:00.071135  6802 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:32966 (request call id 615) took 1033 ms. Trace:
I20260709 13:19:00.072275  8094 raft_consensus.cc:2804] T 3411566abe2d4c9bb4b2adfdd05e6f17 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:19:00.072872  8094 raft_consensus.cc:493] T 3411566abe2d4c9bb4b2adfdd05e6f17 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 3 FOLLOWER]: Starting leader election (detected failure of leader cd75a17ab2604397adab03bb8b5fd75c)
I20260709 13:19:00.073400  8094 raft_consensus.cc:3060] T 3411566abe2d4c9bb4b2adfdd05e6f17 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:19:00.068537  6695 leader_election.cc:304] T a1704639a875409b9959353527b3fd68 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
I20260709 13:19:00.076521  8347 raft_consensus.cc:515] T dbdf895bba214ff68685a24fd17dfb5d P b7ab4784c7344b939bc36f639286f377 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:00.077527  8257 raft_consensus.cc:2804] T a1704639a875409b9959353527b3fd68 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:19:00.078306  8257 raft_consensus.cc:697] T a1704639a875409b9959353527b3fd68 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 5 LEADER]: Becoming Leader. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
I20260709 13:19:00.079254  8347 leader_election.cc:290] T dbdf895bba214ff68685a24fd17dfb5d P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 6 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:00.071543  6802 rpcz_store.cc:276] 0709 13:18:59.035546 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:00.041304 (+1005758us) service_pool.cc:224] Handling call
0709 13:19:00.069166 (+ 27862us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:00.071220  8710 leader_election.cc:290] T 4f00a2e87e56452083b759f60d461ee3 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:19:00.079777  8257 consensus_queue.cc:237] T a1704639a875409b9959353527b3fd68 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
W20260709 13:19:00.083091  8074 consensus_meta.cc:287] T 17587d6730594da4a56fa13a353232a1 P b7ab4784c7344b939bc36f639286f377: Time spent flushing consensus metadata: real 0.725s	user 0.013s	sys 0.009s
I20260709 13:18:58.058493  6729 rpcz_store.cc:276] 0709 13:18:57.033497 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:57.076646 (+ 43149us) service_pool.cc:224] Handling call
0709 13:18:57.077205 (+   559us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:57.077424 (+   219us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:18:57.821463 (+744039us) log.cc:844] Serialized 14 byte log entry
0709 13:18:58.051651 (+230188us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:58.051707 (+    56us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:18:58.051748 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:58.051814 (+    66us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:58.051925 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":18535,"prepare.queue_time_us":9641,"prepare.run_cpu_time_us":59,"prepare.run_wall_time_us":60,"raft.queue_time_us":29080,"raft.run_cpu_time_us":175,"raft.run_wall_time_us":25674,"spinlock_wait_cycles":510848,"thread_start_us":934372,"threads_started":2}
I20260709 13:19:00.063860  8727 consensus_queue.cc:237] T 34f36d59d88f40fe8a2805e604fc6c0a P b7ab4784c7344b939bc36f639286f377 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:00.081465  6802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b3759de40694069b13c0f8bd40e5709" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:19:00.086040  6802 raft_consensus.cc:3060] T 9b3759de40694069b13c0f8bd40e5709 P b7ab4784c7344b939bc36f639286f377 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:19:00.091938  6844 leader_election.cc:304] T 3a485a995abc4807b6e511e45419f737 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:19:00.091674  8520 raft_consensus.cc:515] T 44bde925b2e541b69890d70715b85176 P cd75a17ab2604397adab03bb8b5fd75c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:00.095345  8520 leader_election.cc:290] T 44bde925b2e541b69890d70715b85176 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
W20260709 13:19:00.099668  6725 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49998 (request call id 603) took 1573 ms (client timeout 1759 ms). Trace:
W20260709 13:19:00.100725  6725 rpcz_store.cc:269] 0709 13:18:58.525987 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:58.597801 (+ 71814us) service_pool.cc:224] Handling call
0709 13:19:00.099227 (+1501426us) spinlock_profiling.cc:243] Waited 165 ms on lock 0x7b54000e4554. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f9ae2fa 00007fcc1496fb17 00007fcc0deea6d4 00007fcc0deea662 00007fcc0deea591 00007fcc0deea50c 00007fcc0dee97c2 00007fcc0dce548c 00007fcc0dce48c6 00007fcc0dce426f
0709 13:19:00.099437 (+   210us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":378721536}
I20260709 13:19:00.109534  7993 leader_election.cc:290] T 404190ce4ce94cecbfcb6ea9d1dd8626 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 5 election: Requested vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:19:00.110046  6802 raft_consensus.cc:2468] T 9b3759de40694069b13c0f8bd40e5709 P b7ab4784c7344b939bc36f639286f377 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 5.
I20260709 13:19:00.114662  8745 raft_consensus.cc:2804] T 3a485a995abc4807b6e511e45419f737 P cd75a17ab2604397adab03bb8b5fd75c [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:19:00.115237  8745 raft_consensus.cc:493] T 3a485a995abc4807b6e511e45419f737 P cd75a17ab2604397adab03bb8b5fd75c [term 3 FOLLOWER]: Starting leader election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:19:00.115646  8745 raft_consensus.cc:3060] T 3a485a995abc4807b6e511e45419f737 P cd75a17ab2604397adab03bb8b5fd75c [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:19:00.121376  6802 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:32966 (request call id 622) took 1075 ms. Trace:
I20260709 13:19:00.121507  6875 raft_consensus.cc:1275] T 7c44c4849aa54f2b94d1f1bef9ed546f P cd75a17ab2604397adab03bb8b5fd75c [term 5 FOLLOWER]: Refusing update from remote peer b7ab4784c7344b939bc36f639286f377: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:19:00.121945  6802 rpcz_store.cc:276] 0709 13:18:59.038030 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:00.081065 (+1043035us) service_pool.cc:224] Handling call
0709 13:19:00.113626 (+ 32561us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:19:00.124300  7468 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:00.123183  6874 raft_consensus.cc:2468] T 30e88460611e47b2ba16a46a30b5f416 P cd75a17ab2604397adab03bb8b5fd75c [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 4.
I20260709 13:19:00.130863  8446 raft_consensus.cc:493] T ab432e62819d499eaaf3dd55481dd930 P b7ab4784c7344b939bc36f639286f377 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:00.131889  8446 raft_consensus.cc:515] T ab432e62819d499eaaf3dd55481dd930 P b7ab4784c7344b939bc36f639286f377 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:00.122876  8744 consensus_queue.cc:1048] T be1a92657f494cac8dd227d152f50151 P 7ba59cc884714e8aa5f3f0ecaed84cbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.012s
I20260709 13:19:00.133769  7495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f00a2e87e56452083b759f60d461ee3" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:19:00.135289  8446 leader_election.cc:290] T ab432e62819d499eaaf3dd55481dd930 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:00.136117  8716 raft_consensus.cc:515] T b56bf91d90824c959e21e0cee5ba1816 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:00.138809  8716 leader_election.cc:290] T b56bf91d90824c959e21e0cee5ba1816 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 5 election: Requested vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:00.139083  6802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77e330a82df4b43a745d57a68f6f057" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:19:00.140115  6802 raft_consensus.cc:2468] T e77e330a82df4b43a745d57a68f6f057 P b7ab4784c7344b939bc36f639286f377 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 6.
I20260709 13:19:00.140477  6880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d65025eea89441290d85dd053810e31" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:19:00.141420  6880 raft_consensus.cc:2468] T 3d65025eea89441290d85dd053810e31 P cd75a17ab2604397adab03bb8b5fd75c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 3.
I20260709 13:19:00.140678  6802 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:32966 (request call id 614) took 1105 ms. Trace:
I20260709 13:19:00.142642  6802 rpcz_store.cc:276] 0709 13:18:59.035235 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:00.126950 (+1091715us) service_pool.cc:224] Handling call
0709 13:19:00.140590 (+ 13640us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:00.144191  6802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20f6842e26174571996b8dea4151d4be" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:19:00.145936  7500 raft_consensus.cc:2468] T bb7fa124c3bf4ef9ab65a407cb008441 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 5.
I20260709 13:19:00.149080  8534 raft_consensus.cc:493] T bb7fa124c3bf4ef9ab65a407cb008441 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:00.149801  6772 leader_election.cc:304] T 95a75bfe094d4bdc963aba3f08dfcd25 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:19:00.083803  8074 raft_consensus.cc:515] T 17587d6730594da4a56fa13a353232a1 P b7ab4784c7344b939bc36f639286f377 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:19:00.152143  6727 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50004 (request call id 1214) took 1332 ms. Trace:
I20260709 13:19:00.153714  7993 raft_consensus.cc:493] T 22ccee1b570c4ad3a57bd7aec085b1b4 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader cd75a17ab2604397adab03bb8b5fd75c)
I20260709 13:19:00.157459  6801 raft_consensus.cc:2468] T 4d9def8b32fd443aa94ab1420b06837b P b7ab4784c7344b939bc36f639286f377 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 5.
I20260709 13:19:00.158460  8710 raft_consensus.cc:2804] T 95a75bfe094d4bdc963aba3f08dfcd25 P b7ab4784c7344b939bc36f639286f377 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:19:00.149806  8534 raft_consensus.cc:515] T bb7fa124c3bf4ef9ab65a407cb008441 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:19:00.159025  8710 raft_consensus.cc:493] T 95a75bfe094d4bdc963aba3f08dfcd25 P b7ab4784c7344b939bc36f639286f377 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:00.158171  6801 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:32976 (request call id 1994) took 1128 ms. Trace:
I20260709 13:19:00.159437  8710 raft_consensus.cc:3060] T 95a75bfe094d4bdc963aba3f08dfcd25 P b7ab4784c7344b939bc36f639286f377 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:00.159978  6802 raft_consensus.cc:3060] T 20f6842e26174571996b8dea4151d4be P b7ab4784c7344b939bc36f639286f377 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:19:00.159716  6801 rpcz_store.cc:276] 0709 13:18:59.029671 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:59.736367 (+706696us) service_pool.cc:224] Handling call
0709 13:19:00.158093 (+421726us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:00.162015  8347 consensus_queue.cc:1048] T f5be3a11b23d4ea9b08300a2789821c7 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:19:00.162194  6695 leader_election.cc:304] T 4d9def8b32fd443aa94ab1420b06837b P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
I20260709 13:19:00.163762  8405 raft_consensus.cc:2804] T 4d9def8b32fd443aa94ab1420b06837b P ccd8a4c3bfe3413cb2ae219b09aea832 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:19:00.164362  8405 raft_consensus.cc:697] T 4d9def8b32fd443aa94ab1420b06837b P ccd8a4c3bfe3413cb2ae219b09aea832 [term 5 LEADER]: Becoming Leader. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
I20260709 13:19:00.165657  6806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "713b5728a197487c9300b310ab94e5a3" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:19:00.156706  6875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f00a2e87e56452083b759f60d461ee3" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:19:00.156502  6874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbdf895bba214ff68685a24fd17dfb5d" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:19:00.154521  7993 raft_consensus.cc:515] T 22ccee1b570c4ad3a57bd7aec085b1b4 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:00.170797  7503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f00a2e87e56452083b759f60d461ee3" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:19:00.152889  6727 rpcz_store.cc:276] 0709 13:18:58.819453 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:59.947987 (+1128534us) service_pool.cc:224] Handling call
0709 13:19:00.010614 (+ 62627us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:00.044836 (+ 34222us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:00.044863 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:00.055637 (+ 10774us) log.cc:844] Serialized 26 byte log entry
0709 13:19:00.110342 (+ 54705us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:19:00.110391 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:00.110641 (+   250us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:00.146672 (+ 36031us) raft_consensus.cc:1685] finished
0709 13:19:00.146692 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:00.152012 (+  5320us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":33355,"threads_started":1,"wal-append.queue_time_us":59390}
I20260709 13:19:00.179414  8596 leader_election.cc:290] T 4d9def8b32fd443aa94ab1420b06837b P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
W20260709 13:19:00.180912  6798 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50550 (request call id 141) took 1317 ms (client timeout 1512 ms). Trace:
W20260709 13:19:00.181361  6798 rpcz_store.cc:269] 0709 13:18:58.863838 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:58.864581 (+   743us) service_pool.cc:224] Handling call
0709 13:19:00.180484 (+1315903us) spinlock_profiling.cc:243] Waited 141 ms on lock 0x7b54002c74d4. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f9ae2fa 00007fcc1496fb17 00007fcc0deea6d4 00007fcc0deea662 00007fcc0deea591 00007fcc0deea50c 00007fcc0dee97c2 00007fcc0dce548c 00007fcc0dce48c6 00007fcc0dce426f
0709 13:19:00.180668 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":325385088}
I20260709 13:19:00.180079  6801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbdf895bba214ff68685a24fd17dfb5d" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:19:00.182461  6801 raft_consensus.cc:2368] T dbdf895bba214ff68685a24fd17dfb5d P b7ab4784c7344b939bc36f639286f377 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 5. Current term is 6.
I20260709 13:19:00.182660  6798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "853ac0a8cbd64ce99457f170216d4d0f" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:19:00.182888  6801 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:32976 (request call id 1989) took 1154 ms. Trace:
I20260709 13:19:00.183265  6801 rpcz_store.cc:276] 0709 13:18:59.028226 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:00.171340 (+1143114us) service_pool.cc:224] Handling call
0709 13:19:00.182829 (+ 11489us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:00.183485  6798 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:32976 (request call id 1986) took 1156 ms. Trace:
I20260709 13:19:00.165652  8405 consensus_queue.cc:237] T 4d9def8b32fd443aa94ab1420b06837b P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:00.184268  6875 raft_consensus.cc:2468] T 4f00a2e87e56452083b759f60d461ee3 P cd75a17ab2604397adab03bb8b5fd75c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 4.
I20260709 13:19:00.185145  8074 leader_election.cc:290] T 17587d6730594da4a56fa13a353232a1 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 7 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:19:00.185164  6695 leader_election.cc:400] T dbdf895bba214ff68685a24fd17dfb5d P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 5 pre-election: Vote denied by peer b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817) with higher term. Message: Invalid argument: T dbdf895bba214ff68685a24fd17dfb5d P b7ab4784c7344b939bc36f639286f377 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 5. Current term is 6.
I20260709 13:19:00.189577  6695 leader_election.cc:403] T dbdf895bba214ff68685a24fd17dfb5d P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 5 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:19:00.185791  7466 leader_election.cc:304] T b3f13b31a1f84f0d89d007eadd57924c P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, b7ab4784c7344b939bc36f639286f377; no voters: ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:19:00.186138  6878 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53416 (request call id 2071) took 1297 ms. Trace:
I20260709 13:19:00.187330  7993 leader_election.cc:290] T 22ccee1b570c4ad3a57bd7aec085b1b4 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:00.183950  6798 rpcz_store.cc:276] 0709 13:18:59.027395 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:00.182308 (+1154913us) service_pool.cc:224] Handling call
0709 13:19:00.183395 (+  1087us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:00.190264  6878 rpcz_store.cc:276] 0709 13:18:58.888999 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:58.968459 (+ 79460us) service_pool.cc:224] Handling call
0709 13:18:58.972577 (+  4118us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:59.157056 (+184479us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:00.185596 (+1028540us) spinlock_profiling.cc:243] Waited 62.6 ms on lock 0x7b54001423d4. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f9aae01 00007fcc0f9a983e 00007fcc1496e419 00007fcc0dee5bd4 00007fcc0dee5b62 00007fcc0dee5a91 00007fcc0dee5a0c 00007fcc0dee4cc2 00007fcc0dce548c 00007fcc0dce48c6
0709 13:19:00.185942 (+   346us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":144077568}
I20260709 13:19:00.191241  6798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3f13b31a1f84f0d89d007eadd57924c" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:19:00.192153  6798 raft_consensus.cc:3060] T b3f13b31a1f84f0d89d007eadd57924c P b7ab4784c7344b939bc36f639286f377 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:19:00.190689  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 44483.5us
I20260709 13:19:00.199782  6874 raft_consensus.cc:3060] T dbdf895bba214ff68685a24fd17dfb5d P cd75a17ab2604397adab03bb8b5fd75c [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:00.199962  6801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c44c4849aa54f2b94d1f1bef9ed546f" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:19:00.201128  6801 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:32966 (request call id 628) took 1052 ms. Trace:
I20260709 13:19:00.202826  6801 rpcz_store.cc:276] 0709 13:18:59.148653 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:00.192768 (+1044115us) service_pool.cc:224] Handling call
0709 13:19:00.201057 (+  8289us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:19:00.209978  6876 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53406 (request call id 1262) took 1662 ms (client timeout 1570 ms). Trace:
W20260709 13:19:00.210531  6876 rpcz_store.cc:269] 0709 13:18:58.547073 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:58.669670 (+122597us) service_pool.cc:224] Handling call
0709 13:19:00.209489 (+1539819us) spinlock_profiling.cc:243] Waited 92.8 ms on lock 0x7b540039add4. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f9ae2fa 00007fcc1496fb17 00007fcc0deea6d4 00007fcc0deea662 00007fcc0deea591 00007fcc0deea50c 00007fcc0dee97c2 00007fcc0dce548c 00007fcc0dce48c6 00007fcc0dce426f
0709 13:19:00.209698 (+   209us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":213423360}
W20260709 13:19:00.212742  6730 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49998 (request call id 597) took 1841 ms (client timeout 2100 ms). Trace:
W20260709 13:19:00.213342  6730 rpcz_store.cc:269] 0709 13:18:58.371027 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:58.436337 (+ 65310us) service_pool.cc:224] Handling call
0709 13:19:00.212255 (+1775918us) spinlock_profiling.cc:243] Waited 1.18 s on lock 0x7b540020b2d4. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f9ae2fa 00007fcc1496fb17 00007fcc0deea6d4 00007fcc0deea662 00007fcc0deea591 00007fcc0deea50c 00007fcc0dee97c2 00007fcc0dce548c 00007fcc0dce48c6 00007fcc0dce426f
0709 13:19:00.212449 (+   194us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2704482560}
I20260709 13:19:00.214118  8074 consensus_queue.cc:1048] T 7c44c4849aa54f2b94d1f1bef9ed546f P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:19:00.193931  8446 consensus_queue.cc:1059] T f58dc08b12a2494bb9a1372837970ca2 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.016s
I20260709 13:19:00.216598  8446 consensus_queue.cc:1243] T f58dc08b12a2494bb9a1372837970ca2 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Peer cd75a17ab2604397adab03bb8b5fd75c log is divergent from this leader: its last log entry 4.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260709 13:19:00.217366  8446 raft_consensus.cc:3055] T f58dc08b12a2494bb9a1372837970ca2 P b7ab4784c7344b939bc36f639286f377 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:19:00.217798  8446 raft_consensus.cc:740] T f58dc08b12a2494bb9a1372837970ca2 P b7ab4784c7344b939bc36f639286f377 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
I20260709 13:19:00.200075  7993 raft_consensus.cc:3060] T dbdf895bba214ff68685a24fd17dfb5d P ccd8a4c3bfe3413cb2ae219b09aea832 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:00.202813  8744 raft_consensus.cc:2764] T b3f13b31a1f84f0d89d007eadd57924c P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 4 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
I20260709 13:19:00.242447  6801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17587d6730594da4a56fa13a353232a1" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:19:00.235884  6874 raft_consensus.cc:2468] T dbdf895bba214ff68685a24fd17dfb5d P cd75a17ab2604397adab03bb8b5fd75c [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 6.
I20260709 13:19:00.227689  6772 leader_election.cc:304] T 30e88460611e47b2ba16a46a30b5f416 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:19:00.231819  6798 raft_consensus.cc:2468] T b3f13b31a1f84f0d89d007eadd57924c P b7ab4784c7344b939bc36f639286f377 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 4.
I20260709 13:19:00.244581  6798 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:32976 (request call id 1995) took 1214 ms. Trace:
I20260709 13:19:00.245153  6798 rpcz_store.cc:276] 0709 13:18:59.029945 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:00.190955 (+1161010us) service_pool.cc:224] Handling call
0709 13:19:00.244494 (+ 53539us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:00.197611  8745 raft_consensus.cc:515] T 3a485a995abc4807b6e511e45419f737 P cd75a17ab2604397adab03bb8b5fd75c [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
W20260709 13:19:00.257844  8748 log.cc:927] Time spent T 7c37d41cd9164c15a6826ca62a851a69 P cd75a17ab2604397adab03bb8b5fd75c: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
W20260709 13:19:00.258780  6845 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:00.258627  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 57012.6us
W20260709 13:19:00.260255  6772 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 59816.8us
I20260709 13:19:00.263021  6806 raft_consensus.cc:2468] T 713b5728a197487c9300b310ab94e5a3 P b7ab4784c7344b939bc36f639286f377 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 5.
I20260709 13:19:00.265232  6802 raft_consensus.cc:2468] T 20f6842e26174571996b8dea4151d4be P b7ab4784c7344b939bc36f639286f377 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 5.
I20260709 13:19:00.266561  6801 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:32976 (request call id 1987) took 1238 ms. Trace:
I20260709 13:19:00.219286  8446 consensus_queue.cc:260] T f58dc08b12a2494bb9a1372837970ca2 P b7ab4784c7344b939bc36f639286f377 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:00.269924  6806 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:32976 (request call id 1985) took 1237 ms. Trace:
I20260709 13:19:00.271150  6806 rpcz_store.cc:276] 0709 13:18:59.027126 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:00.165115 (+1137989us) service_pool.cc:224] Handling call
0709 13:19:00.263952 (+ 98837us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:00.268899  6844 leader_election.cc:304] T 7c44c4849aa54f2b94d1f1bef9ed546f P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:19:00.268007  6801 rpcz_store.cc:276] 0709 13:18:59.027640 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:00.206464 (+1178824us) service_pool.cc:224] Handling call
0709 13:19:00.266483 (+ 60019us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:00.277756  8690 raft_consensus.cc:2804] T 30e88460611e47b2ba16a46a30b5f416 P b7ab4784c7344b939bc36f639286f377 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:19:00.284742  8446 raft_consensus.cc:3060] T f58dc08b12a2494bb9a1372837970ca2 P b7ab4784c7344b939bc36f639286f377 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:00.285630  6806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a734b5ab7834e05a8c422208acc58b1" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:19:00.288321  6806 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:32976 (request call id 2006) took 1124 ms. Trace:
I20260709 13:19:00.288627  6806 rpcz_store.cc:276] 0709 13:18:59.163687 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:00.285246 (+1121559us) service_pool.cc:224] Handling call
0709 13:19:00.288272 (+  3026us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:00.285838  8745 leader_election.cc:290] T 3a485a995abc4807b6e511e45419f737 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 4 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:19:00.269094  6802 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:32976 (request call id 1992) took 1237 ms. Trace:
I20260709 13:19:00.271291  6695 leader_election.cc:304] T 853ac0a8cbd64ce99457f170216d4d0f P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:19:00.290580  6802 rpcz_store.cc:276] 0709 13:18:59.029076 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:00.143799 (+1114723us) service_pool.cc:224] Handling call
0709 13:19:00.265995 (+122196us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:00.294296  6798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "427c124d773f483294511e80fe340075" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:19:00.296290  8257 raft_consensus.cc:2749] T 853ac0a8cbd64ce99457f170216d4d0f P ccd8a4c3bfe3413cb2ae219b09aea832 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:19:00.295846  6695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 59010.5us
I20260709 13:19:00.299048  6695 leader_election.cc:304] T 713b5728a197487c9300b310ab94e5a3 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
I20260709 13:19:00.302189  8257 raft_consensus.cc:2804] T 713b5728a197487c9300b310ab94e5a3 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:19:00.283771  8094 raft_consensus.cc:515] T 3411566abe2d4c9bb4b2adfdd05e6f17 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:00.303660  6695 leader_election.cc:304] T 17587d6730594da4a56fa13a353232a1 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, b7ab4784c7344b939bc36f639286f377
I20260709 13:19:00.307060  8727 raft_consensus.cc:493] T 404190ce4ce94cecbfcb6ea9d1dd8626 P b7ab4784c7344b939bc36f639286f377 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:00.308231  6695 leader_election.cc:304] T 20f6842e26174571996b8dea4151d4be P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
I20260709 13:19:00.308491  8475 raft_consensus.cc:2749] T 17587d6730594da4a56fa13a353232a1 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:19:00.309399  8673 raft_consensus.cc:2804] T 20f6842e26174571996b8dea4151d4be P ccd8a4c3bfe3413cb2ae219b09aea832 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:19:00.310156  8673 raft_consensus.cc:697] T 20f6842e26174571996b8dea4151d4be P ccd8a4c3bfe3413cb2ae219b09aea832 [term 5 LEADER]: Becoming Leader. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
I20260709 13:19:00.305058  8257 raft_consensus.cc:697] T 713b5728a197487c9300b310ab94e5a3 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 5 LEADER]: Becoming Leader. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
I20260709 13:19:00.312754  6806 raft_consensus.cc:1240] T 9b3759de40694069b13c0f8bd40e5709 P b7ab4784c7344b939bc36f639286f377 [term 5 FOLLOWER]: Rejecting Update request from peer ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 13:19:00.292477  8690 raft_consensus.cc:697] T 30e88460611e47b2ba16a46a30b5f416 P b7ab4784c7344b939bc36f639286f377 [term 4 LEADER]: Becoming Leader. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
I20260709 13:19:00.317860  8094 leader_election.cc:290] T 3411566abe2d4c9bb4b2adfdd05e6f17 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 4 election: Requested vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:00.317746  8690 consensus_queue.cc:237] T 30e88460611e47b2ba16a46a30b5f416 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:00.319614  6801 raft_consensus.cc:1275] T f03d0dbf16864ca4bc1bb5e4c0334c0f P b7ab4784c7344b939bc36f639286f377 [term 5 FOLLOWER]: Refusing update from remote peer ccd8a4c3bfe3413cb2ae219b09aea832: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:19:00.320328  6801 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:32976 (request call id 1990) took 1291 ms. Trace:
I20260709 13:19:00.318145  6804 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:32966 (request call id 617) took 1282 ms. Trace:
I20260709 13:19:00.307646  8727 raft_consensus.cc:515] T 404190ce4ce94cecbfcb6ea9d1dd8626 P b7ab4784c7344b939bc36f639286f377 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:19:00.324440  8257 consensus_queue.cc:237] T 713b5728a197487c9300b310ab94e5a3 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:00.326390  6772 leader_election.cc:304] T 3d65025eea89441290d85dd053810e31 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:19:00.327152  6806 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:32976 (request call id 1991) took 1285 ms. Trace:
I20260709 13:19:00.327811  6806 rpcz_store.cc:276] 0709 13:18:59.028792 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:00.304382 (+1275590us) service_pool.cc:224] Handling call
0709 13:19:00.312224 (+  7842us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:00.313583 (+  1359us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:00.313938 (+   355us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:00.320709  6801 rpcz_store.cc:276] 0709 13:18:59.028516 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:00.287530 (+1259014us) service_pool.cc:224] Handling call
0709 13:19:00.291628 (+  4098us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:00.320010 (+ 28382us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:00.320237 (+   227us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:00.320760  6805 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:32976 (request call id 1988) took 1292 ms. Trace:
I20260709 13:19:00.321877  6804 rpcz_store.cc:276] 0709 13:18:59.036068 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:59.229933 (+193865us) service_pool.cc:224] Handling call
0709 13:19:00.317757 (+1087824us) spinlock_profiling.cc:243] Waited 38 ms on lock 0x7b5400331b54. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f9ae2fa 00007fcc1496fb17 00007fcc0deea6d4 00007fcc0deea662 00007fcc0deea591 00007fcc0deea50c 00007fcc0dee97c2 00007fcc0dce548c 00007fcc0dce48c6 00007fcc0dce426f
0709 13:19:00.317977 (+   220us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":87459072}
I20260709 13:19:00.339654  6807 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:32966 (request call id 626) took 1299 ms. Trace:
I20260709 13:19:00.340519  8441 raft_consensus.cc:493] T d33d5ee8ef6f415593d8df52063161ad P b7ab4784c7344b939bc36f639286f377 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:00.341827  8074 raft_consensus.cc:493] T ce4f062dcd314d43a63ca74067cb5ee3 P b7ab4784c7344b939bc36f639286f377 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:00.341614  8441 raft_consensus.cc:515] T d33d5ee8ef6f415593d8df52063161ad P b7ab4784c7344b939bc36f639286f377 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:00.343353  6799 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50550 (request call id 135) took 1802 ms. Trace:
I20260709 13:19:00.343765  6799 rpcz_store.cc:276] 0709 13:18:58.540642 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:58.540827 (+   185us) service_pool.cc:224] Handling call
0709 13:18:58.546248 (+  5421us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:58.580444 (+ 34196us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:00.338241 (+1757797us) spinlock_profiling.cc:243] Waited 16.1 ms on lock 0x7b5400185e54. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f9aae01 00007fcc0f9a983e 00007fcc1496e419 00007fcc0dee5bd4 00007fcc0dee5b62 00007fcc0dee5a91 00007fcc0dee5a0c 00007fcc0dee4cc2 00007fcc0dce548c 00007fcc0dce48c6
0709 13:19:00.343090 (+  4849us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":37020544}
I20260709 13:19:00.344463  6731 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3fa34c08b205435dba97346991aa1f92"
dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
mode: GRACEFUL
new_leader_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
 from {username='slave'} at 127.0.0.1:38536
I20260709 13:19:00.345357  6772 leader_election.cc:304] T 4f00a2e87e56452083b759f60d461ee3 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:19:00.348168  8744 consensus_queue.cc:1059] T 7ba5dac66ab5497e9e336f2a3c28cda5 P 7ba59cc884714e8aa5f3f0ecaed84cbb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:19:00.349287  6804 raft_consensus.cc:1240] T f4b8bd455d5a47c18a1380839c6e0d61 P b7ab4784c7344b939bc36f639286f377 [term 4 FOLLOWER]: Rejecting Update request from peer ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 13:19:00.349543  8744 raft_consensus.cc:3055] T 7ba5dac66ab5497e9e336f2a3c28cda5 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:19:00.345897  8347 raft_consensus.cc:2804] T 3d65025eea89441290d85dd053810e31 P b7ab4784c7344b939bc36f639286f377 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:19:00.345394  6731 raft_consensus.cc:606] T 3fa34c08b205435dba97346991aa1f92 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 5 LEADER]: Received request to transfer leadership to TS cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:19:00.349972  8744 raft_consensus.cc:740] T 7ba5dac66ab5497e9e336f2a3c28cda5 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 7ba59cc884714e8aa5f3f0ecaed84cbb, State: Running, Role: LEADER
I20260709 13:19:00.350167  8347 raft_consensus.cc:493] T 3d65025eea89441290d85dd053810e31 P b7ab4784c7344b939bc36f639286f377 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:00.350659  8347 raft_consensus.cc:3060] T 3d65025eea89441290d85dd053810e31 P b7ab4784c7344b939bc36f639286f377 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:19:00.353006  8405 consensus_queue.cc:1048] T 95a75bfe094d4bdc963aba3f08dfcd25 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:19:00.354332  8475 consensus_queue.cc:1059] T 9b3759de40694069b13c0f8bd40e5709 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:19:00.351302  8744 consensus_queue.cc:260] T 7ba5dac66ab5497e9e336f2a3c28cda5 P 7ba59cc884714e8aa5f3f0ecaed84cbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:19:00.333431  6805 rpcz_store.cc:276] 0709 13:18:59.027882 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:59.258117 (+230235us) service_pool.cc:224] Handling call
0709 13:19:00.320460 (+1062343us) spinlock_profiling.cc:243] Waited 35.7 ms on lock 0x7b54001cacd4. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f9ae2fa 00007fcc1496fb17 00007fcc0deea6d4 00007fcc0deea662 00007fcc0deea591 00007fcc0deea50c 00007fcc0dee97c2 00007fcc0dce548c 00007fcc0dce48c6 00007fcc0dce426f
0709 13:19:00.320592 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":82145024}
I20260709 13:19:00.340210  6807 rpcz_store.cc:276] 0709 13:18:59.039037 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:59.335310 (+296273us) service_pool.cc:224] Handling call
0709 13:19:00.335369 (+1000059us) spinlock_profiling.cc:243] Waited 10.2 ms on lock 0x7b54001f5254. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f9ae2fa 00007fcc1496fb17 00007fcc0deea6d4 00007fcc0deea662 00007fcc0deea591 00007fcc0deea50c 00007fcc0dee97c2 00007fcc0dce548c 00007fcc0dce48c6 00007fcc0dce426f
0709 13:19:00.338058 (+  2689us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":23484160}
I20260709 13:19:00.357218  8744 raft_consensus.cc:3060] T 7ba5dac66ab5497e9e336f2a3c28cda5 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:19:00.358836  6807 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:32976 (request call id 1997) took 1328 ms. Trace:
I20260709 13:19:00.359752  6800 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:32966 (request call id 612) took 1326 ms. Trace:
I20260709 13:19:00.360018  8574 raft_consensus.cc:2804] T 4f00a2e87e56452083b759f60d461ee3 P b7ab4784c7344b939bc36f639286f377 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:19:00.360626  8574 raft_consensus.cc:493] T 4f00a2e87e56452083b759f60d461ee3 P b7ab4784c7344b939bc36f639286f377 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 7ba59cc884714e8aa5f3f0ecaed84cbb)
I20260709 13:19:00.361073  8574 raft_consensus.cc:3060] T 4f00a2e87e56452083b759f60d461ee3 P b7ab4784c7344b939bc36f639286f377 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:19:00.364481  8757 raft_consensus.cc:2804] T 7c44c4849aa54f2b94d1f1bef9ed546f P cd75a17ab2604397adab03bb8b5fd75c [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:19:00.359220  6807 rpcz_store.cc:276] 0709 13:18:59.030527 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:00.357763 (+1327236us) service_pool.cc:224] Handling call
0709 13:19:00.358223 (+   460us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:00.358468 (+   245us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:00.358495 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:00.358566 (+    71us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:19:00.358614 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:00.358664 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:00.358764 (+   100us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:00.345623  6799 raft_consensus.cc:1240] T d33d5ee8ef6f415593d8df52063161ad P b7ab4784c7344b939bc36f639286f377 [term 5 FOLLOWER]: Rejecting Update request from peer ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 4. Current term is 5. Ops: []
W20260709 13:19:00.366338  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 97711.2us
I20260709 13:19:00.360333  6800 rpcz_store.cc:276] 0709 13:18:59.033748 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:59.255337 (+221589us) service_pool.cc:224] Handling call
0709 13:19:00.359441 (+1104104us) spinlock_profiling.cc:243] Waited 372 ms on lock 0x7b54001f5754. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f9ae2fa 00007fcc1496fb17 00007fcc0deea6d4 00007fcc0deea662 00007fcc0deea591 00007fcc0deea50c 00007fcc0dee97c2 00007fcc0dce548c 00007fcc0dce48c6 00007fcc0dce426f
0709 13:19:00.359671 (+   230us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":856019712}
I20260709 13:19:00.349987  6804 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:32976 (request call id 1993) took 1320 ms. Trace:
I20260709 13:19:00.371057  6804 rpcz_store.cc:276] 0709 13:18:59.029384 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:00.334231 (+1304847us) service_pool.cc:224] Handling call
0709 13:19:00.348995 (+ 14764us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:00.349722 (+   727us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:00.349927 (+   205us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:00.372709  6799 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:32976 (request call id 1996) took 1339 ms. Trace:
I20260709 13:19:00.373348  6799 rpcz_store.cc:276] 0709 13:18:59.030230 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:00.345020 (+1314790us) service_pool.cc:224] Handling call
0709 13:19:00.345426 (+   406us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:00.368806 (+ 23380us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:00.369103 (+   297us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:00.375744  6874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1704639a875409b9959353527b3fd68" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:19:00.377177  8094 consensus_queue.cc:1059] T 34f36d59d88f40fe8a2805e604fc6c0a P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:19:00.365015  8757 raft_consensus.cc:493] T 7c44c4849aa54f2b94d1f1bef9ed546f P cd75a17ab2604397adab03bb8b5fd75c [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:00.358847  8727 leader_election.cc:290] T 404190ce4ce94cecbfcb6ea9d1dd8626 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:19:00.368378  8723 leader_election.cc:290] T f09c2a98de1a4decabd0ff900dd44caa P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:00.389076  8756 raft_consensus.cc:493] T d8cee0accdb8499c86d4414b72565a38 P cd75a17ab2604397adab03bb8b5fd75c [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:19:00.392529  6876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f58dc08b12a2494bb9a1372837970ca2" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:19:00.370231  8519 raft_consensus.cc:3055] T 9b3759de40694069b13c0f8bd40e5709 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:19:00.311439  8673 consensus_queue.cc:237] T 20f6842e26174571996b8dea4151d4be P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:00.396763  6695 leader_election.cc:304] T 90d42e216d9741e190bca19a781291fd P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: cd75a17ab2604397adab03bb8b5fd75c
W20260709 13:19:00.399087  6772 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 53863.5us
W20260709 13:19:00.400357  7468 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:00.414907  6876 raft_consensus.cc:2393] T f58dc08b12a2494bb9a1372837970ca2 P cd75a17ab2604397adab03bb8b5fd75c [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ccd8a4c3bfe3413cb2ae219b09aea832 in current term 6: Already voted for candidate cd75a17ab2604397adab03bb8b5fd75c in this term.
I20260709 13:19:00.398332  6800 raft_consensus.cc:1275] T 9e326172347f45e99a0d482b5d8ef768 P b7ab4784c7344b939bc36f639286f377 [term 4 FOLLOWER]: Refusing update from remote peer cd75a17ab2604397adab03bb8b5fd75c: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:19:00.342620  8074 raft_consensus.cc:515] T ce4f062dcd314d43a63ca74067cb5ee3 P b7ab4784c7344b939bc36f639286f377 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } attrs { replace: true } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:19:00.416406  6875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30e88460611e47b2ba16a46a30b5f416" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:19:00.418130  6800 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:32966 (request call id 611) took 1385 ms. Trace:
I20260709 13:19:00.420744  6875 raft_consensus.cc:2393] T 30e88460611e47b2ba16a46a30b5f416 P cd75a17ab2604397adab03bb8b5fd75c [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ccd8a4c3bfe3413cb2ae219b09aea832 in current term 4: Already voted for candidate b7ab4784c7344b939bc36f639286f377 in this term.
I20260709 13:19:00.420513  6800 rpcz_store.cc:276] 0709 13:18:59.033400 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:00.391681 (+1358281us) service_pool.cc:224] Handling call
0709 13:19:00.392178 (+   497us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:00.416701 (+ 24523us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:00.418059 (+  1358us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":70016}
I20260709 13:19:00.387683  8757 raft_consensus.cc:3060] T 7c44c4849aa54f2b94d1f1bef9ed546f P cd75a17ab2604397adab03bb8b5fd75c [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:00.420073  6798 raft_consensus.cc:2468] T 427c124d773f483294511e80fe340075 P b7ab4784c7344b939bc36f639286f377 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in term 3.
I20260709 13:19:00.425021  6803 raft_consensus.cc:1240] T c4db81d9d329422bb3b4160ca4ac2d1d P b7ab4784c7344b939bc36f639286f377 [term 5 FOLLOWER]: Rejecting Update request from peer ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 13:19:00.397295  8519 raft_consensus.cc:740] T 9b3759de40694069b13c0f8bd40e5709 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
W20260709 13:19:00.427380  7468 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:00.428131  6803 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:32976 (request call id 2001) took 1396 ms. Trace:
I20260709 13:19:00.428481  6803 rpcz_store.cc:276] 0709 13:18:59.031657 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:00.370549 (+1338892us) service_pool.cc:224] Handling call
0709 13:19:00.392178 (+ 21629us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:00.425560 (+ 33382us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:00.428076 (+  2516us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":32896}
I20260709 13:19:00.438320  6874 raft_consensus.cc:1275] T f03d0dbf16864ca4bc1bb5e4c0334c0f P cd75a17ab2604397adab03bb8b5fd75c [term 5 FOLLOWER]: Refusing update from remote peer ccd8a4c3bfe3413cb2ae219b09aea832: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:19:00.434953  8257 raft_consensus.cc:993] T 3fa34c08b205435dba97346991aa1f92 P ccd8a4c3bfe3413cb2ae219b09aea832: : Instructing follower cd75a17ab2604397adab03bb8b5fd75c to start an election
I20260709 13:19:00.444826  6800 raft_consensus.cc:1240] T a1704639a875409b9959353527b3fd68 P b7ab4784c7344b939bc36f639286f377 [term 5 FOLLOWER]: Rejecting Update request from peer cd75a17ab2604397adab03bb8b5fd75c for earlier term 4. Current term is 5. Ops: [2.2-4.3]
I20260709 13:19:00.445892  6800 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:32966 (request call id 618) took 1409 ms. Trace:
I20260709 13:19:00.446287  6800 rpcz_store.cc:276] 0709 13:18:59.036372 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:00.427047 (+1390675us) service_pool.cc:224] Handling call
0709 13:19:00.440900 (+ 13853us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:19:00.445478 (+  4578us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:00.445816 (+   338us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:00.416352  8710 raft_consensus.cc:515] T 95a75bfe094d4bdc963aba3f08dfcd25 P b7ab4784c7344b939bc36f639286f377 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:00.457360  6772 leader_election.cc:304] T 427c124d773f483294511e80fe340075 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb
I20260709 13:19:00.466454  8760 raft_consensus.cc:493] T 2c240553ce044eedb41541d72b9475d7 P cd75a17ab2604397adab03bb8b5fd75c [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:19:00.467991  8760 raft_consensus.cc:515] T 2c240553ce044eedb41541d72b9475d7 P cd75a17ab2604397adab03bb8b5fd75c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
W20260709 13:19:00.477945  6695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 92155us
I20260709 13:19:00.486670  7466 leader_election.cc:304] T 427c124d773f483294511e80fe340075 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
W20260709 13:19:00.499702  6847 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:00.502578  8759 log.cc:927] Time spent T 4d9def8b32fd443aa94ab1420b06837b P ccd8a4c3bfe3413cb2ae219b09aea832: Append to log took a long time: real 0.123s	user 0.000s	sys 0.001s
I20260709 13:19:00.503265  8534 leader_election.cc:290] T bb7fa124c3bf4ef9ab65a407cb008441 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:00.442004  8756 raft_consensus.cc:515] T d8cee0accdb8499c86d4414b72565a38 P cd75a17ab2604397adab03bb8b5fd75c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
W20260709 13:19:00.512514  6697 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 63977us
I20260709 13:19:00.505087  6723 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49998 (request call id 586) took 2257 ms. Trace:
I20260709 13:19:00.509030  6846 leader_election.cc:304] T 4b8cacb381b746da8d0049b0a83b41dd P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:19:00.515537  6626 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:51654 (request call id 78) took 5574 ms. Trace:
I20260709 13:19:00.525511  8615 raft_consensus.cc:2804] T 427c124d773f483294511e80fe340075 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:19:00.493541  8441 leader_election.cc:290] T d33d5ee8ef6f415593d8df52063161ad P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:00.525633  8765 raft_consensus.cc:2804] T 90d42e216d9741e190bca19a781291fd P ccd8a4c3bfe3413cb2ae219b09aea832 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:19:00.495819  8094 raft_consensus.cc:1081] T 3fa34c08b205435dba97346991aa1f92 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 5 LEADER]: Signalling peer cd75a17ab2604397adab03bb8b5fd75c to start an election
I20260709 13:19:00.518860  6723 rpcz_store.cc:276] 0709 13:18:58.247536 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:59.254634 (+1007098us) service_pool.cc:224] Handling call
0709 13:18:59.255142 (+   508us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:59.303681 (+ 48539us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:00.504594 (+1200913us) spinlock_profiling.cc:243] Waited 31.9 ms on lock 0x7b5400058554. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f9aae01 00007fcc0f9a983e 00007fcc1496e419 00007fcc0dee5bd4 00007fcc0dee5b62 00007fcc0dee5a91 00007fcc0dee5a0c 00007fcc0dee4cc2 00007fcc0dce548c 00007fcc0dce48c6
0709 13:19:00.504871 (+   277us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":73478528}
I20260709 13:19:00.503299  8720 leader_election.cc:290] T e31b9971c15848dea59d4d4130141d9e P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:00.514220  8074 leader_election.cc:290] T ce4f062dcd314d43a63ca74067cb5ee3 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:19:00.507982  7993 raft_consensus.cc:2749] T dbdf895bba214ff68685a24fd17dfb5d P ccd8a4c3bfe3413cb2ae219b09aea832 [term 6 FOLLOWER]: Leader pre-election lost for term 5. Reason: Vote denied by peer b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817) with higher term. Message: Invalid argument: T dbdf895bba214ff68685a24fd17dfb5d P b7ab4784c7344b939bc36f639286f377 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 5. Current term is 6.
W20260709 13:19:00.549549  6846 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.68:45071, user_credentials={real_user=slave}} blocked reactor thread for 139064us
I20260709 13:19:00.526271  8615 raft_consensus.cc:493] T 427c124d773f483294511e80fe340075 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:19:00.552409  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 171415us
I20260709 13:19:00.529979  8760 leader_election.cc:290] T 2c240553ce044eedb41541d72b9475d7 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:19:00.572660  8760 consensus_queue.cc:1059] T ce4f062dcd314d43a63ca74067cb5ee3 P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } attrs { replace: true }, Status: INVALID_TERM, Last received: 5.5, Next index: 6, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:19:00.573378  8756 leader_election.cc:290] T d8cee0accdb8499c86d4414b72565a38 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:19:00.574016  8756 raft_consensus.cc:3055] T ce4f062dcd314d43a63ca74067cb5ee3 P cd75a17ab2604397adab03bb8b5fd75c [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:19:00.574393  8756 raft_consensus.cc:740] T ce4f062dcd314d43a63ca74067cb5ee3 P cd75a17ab2604397adab03bb8b5fd75c [term 5 LEADER]: Becoming Follower/Learner. State: Replica: cd75a17ab2604397adab03bb8b5fd75c, State: Running, Role: LEADER
I20260709 13:19:00.577358  6802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb7fa124c3bf4ef9ab65a407cb008441" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
W20260709 13:19:00.563831  6770 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 95846us
I20260709 13:19:00.560451  8574 raft_consensus.cc:515] T 4f00a2e87e56452083b759f60d461ee3 P b7ab4784c7344b939bc36f639286f377 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
W20260709 13:19:00.564849  6772 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 144350us
W20260709 13:19:00.568140  6771 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:00.568966  6697 leader_election.cc:304] T 711ef6523deb4cbe8ef2ba61e1c21c98 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377
I20260709 13:19:00.569682  8763 raft_consensus.cc:2804] T 427c124d773f483294511e80fe340075 P b7ab4784c7344b939bc36f639286f377 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:19:00.601013  6772 leader_election.cc:304] T dbdf895bba214ff68685a24fd17dfb5d P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:19:00.558883  8519 consensus_queue.cc:260] T 9b3759de40694069b13c0f8bd40e5709 P ccd8a4c3bfe3413cb2ae219b09aea832 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:00.656857  6726 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50004 (request call id 1205) took 1854 ms. Trace:
I20260709 13:19:00.575624  8756 consensus_queue.cc:260] T ce4f062dcd314d43a63ca74067cb5ee3 P cd75a17ab2604397adab03bb8b5fd75c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.5, Last appended by leader: 5, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } attrs { replace: true } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
W20260709 13:19:00.657492  6697 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 88639.3us
I20260709 13:19:00.657820  8519 raft_consensus.cc:3060] T 9b3759de40694069b13c0f8bd40e5709 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:19:00.555277  8765 raft_consensus.cc:697] T 90d42e216d9741e190bca19a781291fd P ccd8a4c3bfe3413cb2ae219b09aea832 [term 5 LEADER]: Becoming Leader. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
I20260709 13:19:00.559296  8615 raft_consensus.cc:3060] T 427c124d773f483294511e80fe340075 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:19:00.659871  8347 raft_consensus.cc:515] T 3d65025eea89441290d85dd053810e31 P b7ab4784c7344b939bc36f639286f377 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:00.657444  8710 leader_election.cc:290] T 95a75bfe094d4bdc963aba3f08dfcd25 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 6 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:00.663786  8574 leader_election.cc:290] T 4f00a2e87e56452083b759f60d461ee3 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 5 election: Requested vote from peers cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:19:00.657428  6726 rpcz_store.cc:276] 0709 13:18:58.802398 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:58.998740 (+196342us) service_pool.cc:224] Handling call
0709 13:19:00.636637 (+1637897us) spinlock_profiling.cc:243] Waited 199 ms on lock 0x7b540020b7d4. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f9ae2fa 00007fcc1496fb17 00007fcc0deea6d4 00007fcc0deea662 00007fcc0deea591 00007fcc0deea50c 00007fcc0dee97c2 00007fcc0dce548c 00007fcc0dce48c6 00007fcc0dce426f
0709 13:19:00.656636 (+ 19999us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":457941888}
I20260709 13:19:00.660300  6801 raft_consensus.cc:1240] T a3022224cc81473690653a83d4e99470 P b7ab4784c7344b939bc36f639286f377 [term 5 FOLLOWER]: Rejecting Update request from peer ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 4. Current term is 5. Ops: []
I20260709 13:19:00.667747  6802 raft_consensus.cc:2468] T bb7fa124c3bf4ef9ab65a407cb008441 P b7ab4784c7344b939bc36f639286f377 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in term 5.
I20260709 13:19:00.668507  6801 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:32976 (request call id 2003) took 1627 ms. Trace:
I20260709 13:19:00.668866  6801 rpcz_store.cc:276] 0709 13:18:59.041376 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:00.659547 (+1618171us) service_pool.cc:224] Handling call
0709 13:19:00.660010 (+   463us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:00.668268 (+  8258us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:00.668443 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:00.669297  6802 raft_consensus.cc:1240] T 95a75bfe094d4bdc963aba3f08dfcd25 P b7ab4784c7344b939bc36f639286f377 [term 6 FOLLOWER]: Rejecting Update request from peer ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 5. Current term is 6. Ops: [5.2-5.2]
I20260709 13:19:00.669898  6802 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:32976 (request call id 2007) took 1480 ms. Trace:
I20260709 13:19:00.670194  6802 rpcz_store.cc:276] 0709 13:18:59.190014 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:00.668646 (+1478632us) service_pool.cc:224] Handling call
0709 13:19:00.669095 (+   449us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:00.669675 (+   580us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:00.669847 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:00.603770  8763 raft_consensus.cc:493] T 427c124d773f483294511e80fe340075 P b7ab4784c7344b939bc36f639286f377 [term 3 FOLLOWER]: Starting leader election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:19:00.680994  6805 raft_consensus.cc:1240] T 4f00a2e87e56452083b759f60d461ee3 P b7ab4784c7344b939bc36f639286f377 [term 5 FOLLOWER]: Rejecting Update request from peer 7ba59cc884714e8aa5f3f0ecaed84cbb for earlier term 4. Current term is 5. Ops: []
I20260709 13:19:00.688134  8074 raft_consensus.cc:2804] T dbdf895bba214ff68685a24fd17dfb5d P b7ab4784c7344b939bc36f639286f377 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:19:00.688822  8074 raft_consensus.cc:697] T dbdf895bba214ff68685a24fd17dfb5d P b7ab4784c7344b939bc36f639286f377 [term 6 LEADER]: Becoming Leader. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
I20260709 13:19:00.689841  8074 consensus_queue.cc:237] T dbdf895bba214ff68685a24fd17dfb5d P b7ab4784c7344b939bc36f639286f377 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:00.690995  8100 leader_election.cc:290] T 1bf4668eeb70467fb3dc5a0289233b3c P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:00.693189  6806 raft_consensus.cc:1240] T 3d65025eea89441290d85dd053810e31 P b7ab4784c7344b939bc36f639286f377 [term 4 FOLLOWER]: Rejecting Update request from peer ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 3. Current term is 4. Ops: []
I20260709 13:19:00.695047  6806 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:32976 (request call id 2000) took 1663 ms. Trace:
I20260709 13:19:00.671772  8763 raft_consensus.cc:3060] T 427c124d773f483294511e80fe340075 P b7ab4784c7344b939bc36f639286f377 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:19:00.696055  6876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d9def8b32fd443aa94ab1420b06837b" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
W20260709 13:19:00.707235  7468 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:00.707707  7466 leader_election.cc:304] T bb7fa124c3bf4ef9ab65a407cb008441 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, b7ab4784c7344b939bc36f639286f377; no voters: 
W20260709 13:19:00.706167  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 145648us
I20260709 13:19:00.702617  6874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab432e62819d499eaaf3dd55481dd930" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:19:00.695437  6806 rpcz_store.cc:276] 0709 13:18:59.031373 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:00.375108 (+1343735us) service_pool.cc:224] Handling call
0709 13:19:00.417069 (+ 41961us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:00.693631 (+276562us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:00.694720 (+  1089us) spinlock_profiling.cc:243] Waited 276 ms on lock 0x7b540028a5d4. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f9aae01 00007fcc0f9a983e 00007fcc1496e419 00007fcc0dee5bd4 00007fcc0dee5b62 00007fcc0dee5a91 00007fcc0dee5a0c 00007fcc0dee4cc2 00007fcc0dce548c 00007fcc0dce48c6
0709 13:19:00.694941 (+   221us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":634546432}
I20260709 13:19:00.662988  8347 leader_election.cc:290] T 3d65025eea89441290d85dd053810e31 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 4 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:00.711773  6805 raft_consensus.cc:1240] T bb7fa124c3bf4ef9ab65a407cb008441 P b7ab4784c7344b939bc36f639286f377 [term 5 FOLLOWER]: Rejecting Update request from peer 7ba59cc884714e8aa5f3f0ecaed84cbb for earlier term 4. Current term is 5. Ops: []
I20260709 13:19:00.699827  8766 raft_consensus.cc:2804] T 711ef6523deb4cbe8ef2ba61e1c21c98 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:19:00.719974  6874 raft_consensus.cc:2468] T ab432e62819d499eaaf3dd55481dd930 P cd75a17ab2604397adab03bb8b5fd75c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 5.
I20260709 13:19:00.713724  8744 raft_consensus.cc:2804] T bb7fa124c3bf4ef9ab65a407cb008441 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:19:00.715023  8716 consensus_queue.cc:1048] T 3d65025eea89441290d85dd053810e31 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:19:00.715667  7500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17587d6730594da4a56fa13a353232a1" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb"
I20260709 13:19:00.717031  6880 raft_consensus.cc:1240] T 3a485a995abc4807b6e511e45419f737 P cd75a17ab2604397adab03bb8b5fd75c [term 4 FOLLOWER]: Rejecting Update request from peer b7ab4784c7344b939bc36f639286f377 for earlier term 3. Current term is 4. Ops: []
I20260709 13:19:00.720851  6876 raft_consensus.cc:2393] T 4d9def8b32fd443aa94ab1420b06837b P cd75a17ab2604397adab03bb8b5fd75c [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7ab4784c7344b939bc36f639286f377 in current term 5: Already voted for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in this term.
W20260709 13:19:00.712842  6696 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:00.699262  7495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8cee0accdb8499c86d4414b72565a38" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:19:00.716997  8762 raft_consensus.cc:2804] T 4b8cacb381b746da8d0049b0a83b41dd P cd75a17ab2604397adab03bb8b5fd75c [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:19:00.699321  8712 leader_election.cc:290] T 24ee15416e3145beaa1b8183453729a3 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:19:00.757750  8100 raft_consensus.cc:493] T 7c37d41cd9164c15a6826ca62a851a69 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:00.762861  6872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09c2a98de1a4decabd0ff900dd44caa" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:19:00.763562  8100 raft_consensus.cc:515] T 7c37d41cd9164c15a6826ca62a851a69 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:00.764479  7501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "404190ce4ce94cecbfcb6ea9d1dd8626" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:19:00.764758  6872 raft_consensus.cc:2410] T f09c2a98de1a4decabd0ff900dd44caa P cd75a17ab2604397adab03bb8b5fd75c [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7ab4784c7344b939bc36f639286f377 for term 6 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:19:00.765319  7501 raft_consensus.cc:2468] T 404190ce4ce94cecbfcb6ea9d1dd8626 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 5.
I20260709 13:19:00.766204  8100 leader_election.cc:290] T 7c37d41cd9164c15a6826ca62a851a69 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:00.758963  8762 raft_consensus.cc:493] T 4b8cacb381b746da8d0049b0a83b41dd P cd75a17ab2604397adab03bb8b5fd75c [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:00.766692  6873 raft_consensus.cc:1240] T d8292e16e5654be6bc408560cf256aaa P cd75a17ab2604397adab03bb8b5fd75c [term 6 FOLLOWER]: Rejecting Update request from peer b7ab4784c7344b939bc36f639286f377 for earlier term 5. Current term is 6. Ops: []
W20260709 13:19:00.767488  6698 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:00.768342  8745 consensus_queue.cc:1048] T 4275cf08e63345f993bce8664eada830 P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Connected to new peer: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:19:00.769333  6805 raft_consensus.cc:1240] T 17587d6730594da4a56fa13a353232a1 P b7ab4784c7344b939bc36f639286f377 [term 7 FOLLOWER]: Rejecting Update request from peer 7ba59cc884714e8aa5f3f0ecaed84cbb for earlier term 6. Current term is 7. Ops: []
I20260709 13:19:00.776197  8754 consensus_queue.cc:1059] T a1704639a875409b9959353527b3fd68 P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.045s
I20260709 13:19:00.778055  8257 raft_consensus.cc:3055] T 34f36d59d88f40fe8a2805e604fc6c0a P ccd8a4c3bfe3413cb2ae219b09aea832 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:19:00.778555  8257 raft_consensus.cc:740] T 34f36d59d88f40fe8a2805e604fc6c0a P ccd8a4c3bfe3413cb2ae219b09aea832 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
W20260709 13:19:00.781304  6845 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:00.782027  6807 raft_consensus.cc:2955] T 1528ab62b6fe4e3099d08f141afee116 P b7ab4784c7344b939bc36f639286f377 [term 5 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } attrs { replace: true } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } } }
I20260709 13:19:00.784705  6697 leader_election.cc:304] T f58dc08b12a2494bb9a1372837970ca2 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:19:00.786161  6697 leader_election.cc:304] T 30e88460611e47b2ba16a46a30b5f416 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:19:00.786620  8756 raft_consensus.cc:3060] T ce4f062dcd314d43a63ca74067cb5ee3 P cd75a17ab2604397adab03bb8b5fd75c [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:00.790277  8716 raft_consensus.cc:3060] T f58dc08b12a2494bb9a1372837970ca2 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:00.791028  6798 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:32966 (request call id 621) took 1753 ms. Trace:
I20260709 13:19:00.738054  8744 raft_consensus.cc:493] T bb7fa124c3bf4ef9ab65a407cb008441 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:00.793463  8744 raft_consensus.cc:3060] T bb7fa124c3bf4ef9ab65a407cb008441 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:00.793291  8765 consensus_queue.cc:237] T 90d42e216d9741e190bca19a781291fd P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
W20260709 13:19:00.795912  6772 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:00.787845  8768 consensus_queue.cc:1059] T 07a92dd554674067a83a9cb68c4773f2 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.009s
I20260709 13:19:00.796914  8405 raft_consensus.cc:3060] T 30e88460611e47b2ba16a46a30b5f416 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:19:00.797194  8768 raft_consensus.cc:3055] T 07a92dd554674067a83a9cb68c4773f2 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:19:00.797689  8768 raft_consensus.cc:740] T 07a92dd554674067a83a9cb68c4773f2 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
I20260709 13:19:00.798629  8768 consensus_queue.cc:260] T 07a92dd554674067a83a9cb68c4773f2 P ccd8a4c3bfe3413cb2ae219b09aea832 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:00.799045  6772 leader_election.cc:304] T bb7fa124c3bf4ef9ab65a407cb008441 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, b7ab4784c7344b939bc36f639286f377; no voters: cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:19:00.802886  8445 raft_consensus.cc:493] T f3f9c2e2bf644115957398fe4c9459db P b7ab4784c7344b939bc36f639286f377 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:00.803052  8757 raft_consensus.cc:515] T 7c44c4849aa54f2b94d1f1bef9ed546f P cd75a17ab2604397adab03bb8b5fd75c [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:00.805311  6873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e31b9971c15848dea59d4d4130141d9e" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:19:00.806406  6880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a75bfe094d4bdc963aba3f08dfcd25" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:19:00.807039  6872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce4f062dcd314d43a63ca74067cb5ee3" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 6 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:19:00.807723  8711 leader_election.cc:290] T 3411566abe2d4c9bb4b2adfdd05e6f17 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
W20260709 13:19:00.808769  6695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 70579.3us
I20260709 13:19:00.809291  6770 leader_election.cc:304] T f4b8bd455d5a47c18a1380839c6e0d61 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:19:00.723392  8766 raft_consensus.cc:493] T 711ef6523deb4cbe8ef2ba61e1c21c98 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 4 FOLLOWER]: Starting leader election (detected failure of leader cd75a17ab2604397adab03bb8b5fd75c)
W20260709 13:19:00.812987  7466 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 67511.9us
I20260709 13:19:00.767012  8762 raft_consensus.cc:3060] T 4b8cacb381b746da8d0049b0a83b41dd P cd75a17ab2604397adab03bb8b5fd75c [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:00.791734  6798 rpcz_store.cc:276] 0709 13:18:59.037744 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:00.461219 (+1423475us) service_pool.cc:224] Handling call
0709 13:19:00.496492 (+ 35273us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:00.514727 (+ 18235us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:00.514760 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:00.515405 (+   645us) log.cc:844] Serialized 26 byte log entry
0709 13:19:00.789845 (+274440us) spinlock_profiling.cc:243] Waited 3.23 ms on lock 0x7b180033f940. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc15785de1 00007fcc157925b1 00007fcc0f5524bc 00007fcc0c8a048b 00007fcc156faab9 00007fcc0c8bc69b 00007fcc0c8ba93f 00007fcc0c8bcc02 00007fcc0f54420b 00007fcc0f549d23 00007fcc0f54a0d1
0709 13:19:00.790107 (+   262us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:19:00.790186 (+    79us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:00.790303 (+   117us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:00.790516 (+   213us) raft_consensus.cc:1685] finished
0709 13:19:00.790546 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:00.790899 (+   353us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":608,"raft.queue_time_us":1471,"raft.run_cpu_time_us":191,"raft.run_wall_time_us":7343,"spinlock_wait_cycles":7432448,"thread_start_us":21879,"threads_started":1,"wal-append.queue_time_us":184596}
W20260709 13:19:00.815364  7468 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:00.807214  6880 raft_consensus.cc:3060] T 95a75bfe094d4bdc963aba3f08dfcd25 P cd75a17ab2604397adab03bb8b5fd75c [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:00.806291  6873 raft_consensus.cc:2468] T e31b9971c15848dea59d4d4130141d9e P cd75a17ab2604397adab03bb8b5fd75c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 3.
I20260709 13:19:00.830116  6878 raft_consensus.cc:1240] T 7c44c4849aa54f2b94d1f1bef9ed546f P cd75a17ab2604397adab03bb8b5fd75c [term 6 FOLLOWER]: Rejecting Update request from peer b7ab4784c7344b939bc36f639286f377 for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 13:19:00.830794  6874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d33d5ee8ef6f415593d8df52063161ad" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
W20260709 13:19:00.832489  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 71994.3us
I20260709 13:19:00.838568  6772 leader_election.cc:304] T 404190ce4ce94cecbfcb6ea9d1dd8626 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, b7ab4784c7344b939bc36f639286f377; no voters: 
I20260709 13:19:00.802886  8574 raft_consensus.cc:2804] T bb7fa124c3bf4ef9ab65a407cb008441 P b7ab4784c7344b939bc36f639286f377 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:19:00.814786  8768 raft_consensus.cc:3060] T 07a92dd554674067a83a9cb68c4773f2 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:19:00.853588  7993 consensus_queue.cc:1059] T a3022224cc81473690653a83d4e99470 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
W20260709 13:19:00.857757  6770 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 47044.4us
I20260709 13:19:00.851747  6805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bf4668eeb70467fb3dc5a0289233b3c" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:19:00.803520  8445 raft_consensus.cc:515] T f3f9c2e2bf644115957398fe4c9459db P b7ab4784c7344b939bc36f639286f377 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:00.859287  6726 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "427c124d773f483294511e80fe340075"
dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:49996
I20260709 13:19:00.861611  6798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de3186201e1a40d0b335eeb8b4e256e0" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:19:00.864696  6726 raft_consensus.cc:606] T 427c124d773f483294511e80fe340075 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 4 FOLLOWER]: Received request to transfer leadership
I20260709 13:19:00.865339  6726 raft_consensus.cc:614] T 427c124d773f483294511e80fe340075 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 4 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:19:00.817159  8766 raft_consensus.cc:3060] T 711ef6523deb4cbe8ef2ba61e1c21c98 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:19:00.835412  8711 raft_consensus.cc:2749] T f4b8bd455d5a47c18a1380839c6e0d61 P b7ab4784c7344b939bc36f639286f377 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:19:00.779639  8257 consensus_queue.cc:260] T 34f36d59d88f40fe8a2805e604fc6c0a P ccd8a4c3bfe3413cb2ae219b09aea832 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:00.883895  6844 leader_election.cc:304] T 7a734b5ab7834e05a8c422208acc58b1 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:19:00.851750  8347 raft_consensus.cc:2804] T 404190ce4ce94cecbfcb6ea9d1dd8626 P b7ab4784c7344b939bc36f639286f377 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:19:00.882614  6873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d65025eea89441290d85dd053810e31" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:19:00.893936  6873 raft_consensus.cc:3060] T 3d65025eea89441290d85dd053810e31 P cd75a17ab2604397adab03bb8b5fd75c [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:19:00.854919  8574 raft_consensus.cc:493] T bb7fa124c3bf4ef9ab65a407cb008441 P b7ab4784c7344b939bc36f639286f377 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:00.890926  6874 raft_consensus.cc:2468] T d33d5ee8ef6f415593d8df52063161ad P cd75a17ab2604397adab03bb8b5fd75c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 4.
I20260709 13:19:00.816977  8094 consensus_queue.cc:1059] T f4b8bd455d5a47c18a1380839c6e0d61 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.064s
I20260709 13:19:00.898939  6798 raft_consensus.cc:2468] T de3186201e1a40d0b335eeb8b4e256e0 P b7ab4784c7344b939bc36f639286f377 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 4.
I20260709 13:19:00.882416  7501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f00a2e87e56452083b759f60d461ee3" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb"
I20260709 13:19:00.904166  6876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f00a2e87e56452083b759f60d461ee3" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:19:00.828019  8100 consensus_queue.cc:1059] T c4db81d9d329422bb3b4160ca4ac2d1d P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.050s
I20260709 13:19:00.904875  6876 raft_consensus.cc:3060] T 4f00a2e87e56452083b759f60d461ee3 P cd75a17ab2604397adab03bb8b5fd75c [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:19:00.839108  8688 consensus_queue.cc:1059] T 4f00a2e87e56452083b759f60d461ee3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.045s
I20260709 13:19:00.902542  6799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4275cf08e63345f993bce8664eada830" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:19:00.880021  7495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce4f062dcd314d43a63ca74067cb5ee3" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 6 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:19:00.880560  8745 raft_consensus.cc:493] T 711ef6523deb4cbe8ef2ba61e1c21c98 P cd75a17ab2604397adab03bb8b5fd75c [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:00.923643  7500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24ee15416e3145beaa1b8183453729a3" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:19:00.893029  8347 raft_consensus.cc:493] T 404190ce4ce94cecbfcb6ea9d1dd8626 P b7ab4784c7344b939bc36f639286f377 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:19:00.925647  6695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 114892us
I20260709 13:19:00.925767  6798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce4f062dcd314d43a63ca74067cb5ee3" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:19:00.926095  6805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "404190ce4ce94cecbfcb6ea9d1dd8626" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:19:00.860888  8475 consensus_queue.cc:1048] T f03d0dbf16864ca4bc1bb5e4c0334c0f P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.059s
I20260709 13:19:00.898814  8520 raft_consensus.cc:493] T fe20b4b48823486ca3b9c648db6ce8aa P cd75a17ab2604397adab03bb8b5fd75c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:19:00.900480  8574 raft_consensus.cc:3060] T bb7fa124c3bf4ef9ab65a407cb008441 P b7ab4784c7344b939bc36f639286f377 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:00.907752  8754 raft_consensus.cc:2804] T 7a734b5ab7834e05a8c422208acc58b1 P cd75a17ab2604397adab03bb8b5fd75c [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:19:00.965293  6799 raft_consensus.cc:2410] T 4275cf08e63345f993bce8664eada830 P b7ab4784c7344b939bc36f639286f377 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ccd8a4c3bfe3413cb2ae219b09aea832 for term 5 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:19:00.955474  6879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24ee15416e3145beaa1b8183453729a3" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:19:00.938807  8347 raft_consensus.cc:3060] T 404190ce4ce94cecbfcb6ea9d1dd8626 P b7ab4784c7344b939bc36f639286f377 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:00.969246  6806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b56bf91d90824c959e21e0cee5ba1816" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:19:00.972486  6798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22ccee1b570c4ad3a57bd7aec085b1b4" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:19:00.975754  6874 raft_consensus.cc:1275] T 7ba5dac66ab5497e9e336f2a3c28cda5 P cd75a17ab2604397adab03bb8b5fd75c [term 5 FOLLOWER]: Refusing update from remote peer b7ab4784c7344b939bc36f639286f377: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
W20260709 13:19:00.977562  7468 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:00.953395  8754 raft_consensus.cc:493] T 7a734b5ab7834e05a8c422208acc58b1 P cd75a17ab2604397adab03bb8b5fd75c [term 4 FOLLOWER]: Starting leader election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:19:00.990267  6880 raft_consensus.cc:2468] T 95a75bfe094d4bdc963aba3f08dfcd25 P cd75a17ab2604397adab03bb8b5fd75c [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 6.
W20260709 13:19:00.992528  6770 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 87951.8us
W20260709 13:19:00.995234  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 60138.7us
I20260709 13:19:00.998908  7500 raft_consensus.cc:1275] T 7ba5dac66ab5497e9e336f2a3c28cda5 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 5 FOLLOWER]: Refusing update from remote peer b7ab4784c7344b939bc36f639286f377: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:19:01.003919  8445 leader_election.cc:290] T f3f9c2e2bf644115957398fe4c9459db P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:01.007513  6799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3411566abe2d4c9bb4b2adfdd05e6f17" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:19:01.012982  8777 raft_consensus.cc:3055] T a3022224cc81473690653a83d4e99470 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 4 LEADER]: Stepping down as leader of term 4
W20260709 13:19:01.013618  8774 log.cc:927] Time spent T b56bf91d90824c959e21e0cee5ba1816 P b7ab4784c7344b939bc36f639286f377: Append to log took a long time: real 0.091s	user 0.000s	sys 0.001s
I20260709 13:19:00.985280  8711 raft_consensus.cc:493] T a3022224cc81473690653a83d4e99470 P b7ab4784c7344b939bc36f639286f377 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:01.014159  8777 raft_consensus.cc:740] T a3022224cc81473690653a83d4e99470 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
I20260709 13:19:01.021404  6770 leader_election.cc:304] T 9b3759de40694069b13c0f8bd40e5709 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:19:00.998903  8754 raft_consensus.cc:3060] T 7a734b5ab7834e05a8c422208acc58b1 P cd75a17ab2604397adab03bb8b5fd75c [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:19:01.037906  7466 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 85247.2us
I20260709 13:19:00.971901  8745 raft_consensus.cc:515] T 711ef6523deb4cbe8ef2ba61e1c21c98 P cd75a17ab2604397adab03bb8b5fd75c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:00.521549  6626 rpcz_store.cc:276] 0709 13:18:54.940550 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:54.954988 (+ 14438us) service_pool.cc:224] Handling call
0709 13:19:00.515231 (+5560243us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:18:56.540186 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:18:56.630717 (+ 90531us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:18:56.630774 (+    57us) write_op.cc:435] Acquired schema lock
0709 13:18:56.630801 (+    27us) tablet.cc:662] Decoding operations
0709 13:18:56.733911 (+103110us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:18:56.739972 (+  6061us) write_op.cc:641] Partition lock acquired for write op
0709 13:18:56.742648 (+  2676us) tablet.cc:685] Acquiring locks for 5 operations
0709 13:18:56.864625 (+121977us) tablet.cc:701] Row locks acquired
0709 13:18:56.864649 (+    24us) write_op.cc:260] PREPARE: finished
0709 13:18:56.864821 (+   172us) write_op.cc:270] Start()
0709 13:18:56.864959 (+   138us) write_op.cc:276] Timestamp: P: 1783603136864769 usec, L: 0
0709 13:18:56.864982 (+    23us) op_driver.cc:348] REPLICATION: starting
0709 13:18:56.905186 (+ 40204us) log.cc:844] Serialized 2671 byte log entry
0709 13:18:59.172513 (+2267327us) spinlock_profiling.cc:243] Waited 84.6 ms on lock 0x7b4400022b4c. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0c745db1 00007fcc0c7e3c85 00007fcc0c7e46a2 00007fcc0f5561db 00007fcc0f551aaf 00007fcc0c8a00ac 00007fcc156faab9 00007fcc0c8bc69b 00007fcc0c8ba93f 00007fcc0c8bcc02 00007fcc0f54420b
0709 13:18:59.486063 (+313550us) op_driver.cc:464] REPLICATION: finished
0709 13:18:59.521641 (+ 35578us) write_op.cc:301] APPLY: starting
0709 13:18:59.521781 (+   140us) tablet.cc:1367] starting BulkCheckPresence
0709 13:18:59.522040 (+   259us) tablet.cc:1370] finished BulkCheckPresence
0709 13:18:59.522073 (+    33us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:18:59.523149 (+  1076us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:18:59.523284 (+   135us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=5
0709 13:18:59.523315 (+    31us) write_op.cc:312] APPLY: finished
0709 13:18:59.523526 (+   211us) log.cc:844] Serialized 46 byte log entry
0709 13:18:59.523671 (+   145us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:18:59.523842 (+   171us) write_op.cc:454] Released schema lock
0709 13:18:59.523893 (+    51us) write_op.cc:341] FINISH: Updating metrics
0709 13:18:59.524280 (+   387us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:18:59.524298 (+    18us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":6,"child_traces":[["op",{"apply.queue_time_us":35222,"apply.run_cpu_time_us":2545,"apply.run_wall_time_us":2662,"num_ops":5,"prepare.queue_time_us":137349,"prepare.run_cpu_time_us":39030,"prepare.run_wall_time_us":2779771,"raft.queue_time_us":146218,"raft.run_cpu_time_us":5270,"raft.run_wall_time_us":80935,"replication_time_us":2620859,"spinlock_wait_cycles":194472832,"thread_start_us":2579511,"threads_started":4,"wal-append.queue_time_us":2382846,"wal-append.run_cpu_time_us":31138,"wal-append.run_wall_time_us":1414145}]]}
I20260709 13:19:00.967005  8520 raft_consensus.cc:515] T fe20b4b48823486ca3b9c648db6ce8aa P cd75a17ab2604397adab03bb8b5fd75c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:19:01.019876  8100 raft_consensus.cc:3055] T c4db81d9d329422bb3b4160ca4ac2d1d P ccd8a4c3bfe3413cb2ae219b09aea832 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:19:01.041347  6879 raft_consensus.cc:2468] T 24ee15416e3145beaa1b8183453729a3 P cd75a17ab2604397adab03bb8b5fd75c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 4.
I20260709 13:19:01.035087  8688 consensus_queue.cc:1059] T 17587d6730594da4a56fa13a353232a1 P 7ba59cc884714e8aa5f3f0ecaed84cbb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: INVALID_TERM, Last received: 6.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.045s
I20260709 13:19:01.057368  8727 consensus_queue.cc:1048] T 7ba5dac66ab5497e9e336f2a3c28cda5 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.033s
I20260709 13:19:01.041932  8779 raft_consensus.cc:3055] T a1704639a875409b9959353527b3fd68 P cd75a17ab2604397adab03bb8b5fd75c [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:19:01.094465  8440 raft_consensus.cc:493] T 7887766dc6784fcaa42b35c05fea7a99 P b7ab4784c7344b939bc36f639286f377 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:01.096565  6873 raft_consensus.cc:2468] T 3d65025eea89441290d85dd053810e31 P cd75a17ab2604397adab03bb8b5fd75c [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 4.
I20260709 13:19:01.099195  8440 raft_consensus.cc:515] T 7887766dc6784fcaa42b35c05fea7a99 P b7ab4784c7344b939bc36f639286f377 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
W20260709 13:19:01.102012  8782 log.cc:927] Time spent T e77e330a82df4b43a745d57a68f6f057 P b7ab4784c7344b939bc36f639286f377: Append to log took a long time: real 0.119s	user 0.001s	sys 0.000s
W20260709 13:19:01.104497  8788 log.cc:927] Time spent T dbdf895bba214ff68685a24fd17dfb5d P b7ab4784c7344b939bc36f639286f377: Append to log took a long time: real 0.117s	user 0.001s	sys 0.000s
W20260709 13:19:01.108389  8787 log.cc:927] Time spent T be1a92657f494cac8dd227d152f50151 P 7ba59cc884714e8aa5f3f0ecaed84cbb: Append to log took a long time: real 0.052s	user 0.001s	sys 0.000s
I20260709 13:19:01.063663  8100 raft_consensus.cc:740] T c4db81d9d329422bb3b4160ca4ac2d1d P ccd8a4c3bfe3413cb2ae219b09aea832 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
I20260709 13:19:01.110596  8100 consensus_queue.cc:260] T c4db81d9d329422bb3b4160ca4ac2d1d P ccd8a4c3bfe3413cb2ae219b09aea832 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
W20260709 13:19:01.112911  8780 log.cc:927] Time spent T 3411566abe2d4c9bb4b2adfdd05e6f17 P cd75a17ab2604397adab03bb8b5fd75c: Append to log took a long time: real 0.173s	user 0.000s	sys 0.001s
I20260709 13:19:01.113359  6879 raft_consensus.cc:1275] T 34f36d59d88f40fe8a2805e604fc6c0a P cd75a17ab2604397adab03bb8b5fd75c [term 2 FOLLOWER]: Refusing update from remote peer b7ab4784c7344b939bc36f639286f377: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:19:01.113725  8405 raft_consensus.cc:2749] T 30e88460611e47b2ba16a46a30b5f416 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:19:01.117077  6802 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50550 (request call id 143) took 1366 ms. Trace:
I20260709 13:19:01.117592  6802 rpcz_store.cc:276] 0709 13:18:59.778861 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:00.670950 (+892089us) service_pool.cc:224] Handling call
0709 13:19:00.671270 (+   320us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:00.699715 (+ 28445us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:00.699749 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:00.700468 (+   719us) log.cc:844] Serialized 26 byte log entry
0709 13:19:00.893300 (+192832us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:19:00.893346 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:00.893415 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:01.116800 (+223385us) raft_consensus.cc:1685] finished
0709 13:19:01.116829 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:01.117003 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":27780,"raft.queue_time_us":30526,"raft.run_cpu_time_us":210,"raft.run_wall_time_us":16117,"thread_start_us":192402,"threads_started":1,"wal-append.queue_time_us":288973}
I20260709 13:19:01.119864  6802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e326172347f45e99a0d482b5d8ef768" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:19:01.120534  6802 raft_consensus.cc:2468] T 9e326172347f45e99a0d482b5d8ef768 P b7ab4784c7344b939bc36f639286f377 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 4.
I20260709 13:19:01.121337  6802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44bde925b2e541b69890d70715b85176" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:19:01.122133  6802 raft_consensus.cc:2410] T 44bde925b2e541b69890d70715b85176 P b7ab4784c7344b939bc36f639286f377 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ccd8a4c3bfe3413cb2ae219b09aea832 for term 6 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:19:01.123006  6802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c37d41cd9164c15a6826ca62a851a69" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:19:01.123181  6872 raft_consensus.cc:2410] T ce4f062dcd314d43a63ca74067cb5ee3 P cd75a17ab2604397adab03bb8b5fd75c [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7ab4784c7344b939bc36f639286f377 for term 6 because replica has last-logged OpId of term: 5 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 4.
I20260709 13:19:01.124903  6802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5be3a11b23d4ea9b08300a2789821c7" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
W20260709 13:19:01.125411  8778 log.cc:927] Time spent T 22ccee1b570c4ad3a57bd7aec085b1b4 P b7ab4784c7344b939bc36f639286f377: Append to log took a long time: real 0.189s	user 0.001s	sys 0.000s
I20260709 13:19:01.125192  8756 consensus_queue.cc:1048] T 9e326172347f45e99a0d482b5d8ef768 P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Connected to new peer: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:19:01.127274  6800 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:32966 (request call id 620) took 2090 ms. Trace:
I20260709 13:19:01.127951  6800 rpcz_store.cc:276] 0709 13:18:59.036966 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:00.447285 (+1410319us) service_pool.cc:224] Handling call
0709 13:19:00.447891 (+   606us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:00.449446 (+  1555us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:19:00.534924 (+ 85478us) log.cc:844] Serialized 14 byte log entry
0709 13:19:00.720166 (+185242us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:00.768077 (+ 47911us) log.cc:844] Serialized 26 byte log entry
0709 13:19:00.768245 (+   168us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:19:00.768292 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:00.768371 (+    79us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:01.126980 (+358609us) raft_consensus.cc:1685] finished
0709 13:19:01.127005 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:01.127162 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":206859,"prepare.run_cpu_time_us":67,"prepare.run_wall_time_us":70,"raft.queue_time_us":4997,"raft.run_cpu_time_us":325,"raft.run_wall_time_us":7112,"thread_start_us":241047,"threads_started":2,"wal-append.queue_time_us":296215}
I20260709 13:19:01.130045  8745 leader_election.cc:290] T 711ef6523deb4cbe8ef2ba61e1c21c98 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:19:01.131160  6800 raft_consensus.cc:1240] T 07a92dd554674067a83a9cb68c4773f2 P b7ab4784c7344b939bc36f639286f377 [term 4 FOLLOWER]: Rejecting Update request from peer ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 3. Current term is 4. Ops: []
I20260709 13:19:01.096661  8615 raft_consensus.cc:515] T 427c124d773f483294511e80fe340075 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 5 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } attrs { replace: true } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:19:01.132431  8690 raft_consensus.cc:493] T 90d42e216d9741e190bca19a781291fd P b7ab4784c7344b939bc36f639286f377 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:01.132718  8100 raft_consensus.cc:3060] T c4db81d9d329422bb3b4160ca4ac2d1d P ccd8a4c3bfe3413cb2ae219b09aea832 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:19:01.133056  8690 raft_consensus.cc:515] T 90d42e216d9741e190bca19a781291fd P b7ab4784c7344b939bc36f639286f377 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:01.134912  8615 leader_election.cc:290] T 427c124d773f483294511e80fe340075 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 5 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:01.064182  8673 consensus_queue.cc:1048] T f03d0dbf16864ca4bc1bb5e4c0334c0f P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.075s
W20260709 13:19:01.100122  8785 log.cc:927] Time spent T e77e330a82df4b43a745d57a68f6f057 P ccd8a4c3bfe3413cb2ae219b09aea832: Append to log took a long time: real 0.062s	user 0.001s	sys 0.001s
I20260709 13:19:01.135526  8690 leader_election.cc:290] T 90d42e216d9741e190bca19a781291fd P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:01.104425  6801 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:32976 (request call id 2009) took 1892 ms. Trace:
W20260709 13:19:01.138440  6770 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 117241us
I20260709 13:19:01.144726  6800 raft_consensus.cc:3060] T f3f9c2e2bf644115957398fe4c9459db P b7ab4784c7344b939bc36f639286f377 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:19:01.126870  6802 raft_consensus.cc:1275] T f09c2a98de1a4decabd0ff900dd44caa P b7ab4784c7344b939bc36f639286f377 [term 5 FOLLOWER]: Refusing update from remote peer ccd8a4c3bfe3413cb2ae219b09aea832: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:19:01.152645  6876 raft_consensus.cc:2468] T 4f00a2e87e56452083b759f60d461ee3 P cd75a17ab2604397adab03bb8b5fd75c [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 5.
I20260709 13:19:01.076735  8757 leader_election.cc:290] T 7c44c4849aa54f2b94d1f1bef9ed546f P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 6 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:19:01.042414  8711 raft_consensus.cc:515] T a3022224cc81473690653a83d4e99470 P b7ab4784c7344b939bc36f639286f377 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:01.164973  6803 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:32966 (request call id 619) took 2128 ms. Trace:
I20260709 13:19:01.074772  8074 raft_consensus.cc:2749] T 9b3759de40694069b13c0f8bd40e5709 P b7ab4784c7344b939bc36f639286f377 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:19:01.153945  6801 rpcz_store.cc:276] 0709 13:18:59.212535 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:00.669553 (+1457018us) service_pool.cc:224] Handling call
0709 13:19:00.669929 (+   376us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:00.670385 (+   456us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:19:00.671077 (+   692us) log.cc:844] Serialized 14 byte log entry
0709 13:19:00.831237 (+160160us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:00.871681 (+ 40444us) log.cc:844] Serialized 26 byte log entry
0709 13:19:00.872078 (+   397us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:19:00.872134 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:00.872241 (+   107us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:01.104144 (+231903us) raft_consensus.cc:1685] finished
0709 13:19:01.104170 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:01.104336 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":179,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":37,"raft.queue_time_us":12286,"raft.run_cpu_time_us":292,"raft.run_wall_time_us":15182,"thread_start_us":149666,"threads_started":1,"wal-append.queue_time_us":224098}
W20260709 13:19:01.145677  6697 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 358070us
I20260709 13:19:01.148674  8440 leader_election.cc:290] T 7887766dc6784fcaa42b35c05fea7a99 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:01.173260  6770 leader_election.cc:304] T 22ccee1b570c4ad3a57bd7aec085b1b4 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:19:01.098924  8779 raft_consensus.cc:740] T a1704639a875409b9959353527b3fd68 P cd75a17ab2604397adab03bb8b5fd75c [term 4 LEADER]: Becoming Follower/Learner. State: Replica: cd75a17ab2604397adab03bb8b5fd75c, State: Running, Role: LEADER
W20260709 13:19:01.180932  6695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 166859us
I20260709 13:19:01.181263  6802 raft_consensus.cc:1240] T 34f36d59d88f40fe8a2805e604fc6c0a P b7ab4784c7344b939bc36f639286f377 [term 2 LEADER]: Rejecting Update request from peer ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 1. Current term is 2. Ops: []
I20260709 13:19:01.184119  6876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3411566abe2d4c9bb4b2adfdd05e6f17" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:19:01.165710  6803 rpcz_store.cc:276] 0709 13:18:59.036648 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:00.437326 (+1400678us) service_pool.cc:224] Handling call
0709 13:19:00.476057 (+ 38731us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:00.508476 (+ 32419us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:00.508519 (+    43us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:00.509417 (+   898us) log.cc:844] Serialized 26 byte log entry
0709 13:19:00.702785 (+193368us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:19:00.712735 (+  9950us) log.cc:844] Serialized 14 byte log entry
0709 13:19:00.713122 (+   387us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:00.718812 (+  5690us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:00.795178 (+ 76366us) spinlock_profiling.cc:243] Waited 2.42 ms on lock 0x7b4800061ed8. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc148d3aa1 00007fcc148cab37 00007fcc148ca9ca 00007fcc149c226f 00007fcc149c1f37 00007fcc149d655c 00007fcc149d6508 00007fcc149d6488 00007fcc149d6443 00007fcc149d56ec 00007fcc138ffa96
0709 13:19:01.155771 (+360593us) raft_consensus.cc:1685] finished
0709 13:19:01.164604 (+  8833us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:01.164879 (+   275us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":9701,"prepare.run_cpu_time_us":45,"prepare.run_wall_time_us":46,"raft.queue_time_us":2267,"raft.run_cpu_time_us":3537,"raft.run_wall_time_us":77654,"spinlock_wait_cycles":5572352,"thread_start_us":192785,"threads_started":1,"wal-append.queue_time_us":327244}
I20260709 13:19:01.187788  6695 leader_election.cc:304] T de3186201e1a40d0b335eeb8b4e256e0 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
W20260709 13:19:01.190496  6846 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:01.195094  6696 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:01.176177  8690 raft_consensus.cc:2749] T 22ccee1b570c4ad3a57bd7aec085b1b4 P b7ab4784c7344b939bc36f639286f377 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:19:01.196616  6845 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:01.127581  8777 consensus_queue.cc:260] T a3022224cc81473690653a83d4e99470 P ccd8a4c3bfe3413cb2ae219b09aea832 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:01.266989  7495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe20b4b48823486ca3b9c648db6ce8aa" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:19:01.269652  7495 raft_consensus.cc:2468] T fe20b4b48823486ca3b9c648db6ce8aa P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 1.
W20260709 13:19:01.270227  8781 log.cc:927] Time spent T ce4f062dcd314d43a63ca74067cb5ee3 P b7ab4784c7344b939bc36f639286f377: Append to log took a long time: real 0.263s	user 0.000s	sys 0.007s
I20260709 13:19:01.272516  8744 raft_consensus.cc:515] T bb7fa124c3bf4ef9ab65a407cb008441 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:19:01.274856  6804 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:32966 (request call id 623) took 2236 ms. Trace:
I20260709 13:19:01.292392  6804 rpcz_store.cc:276] 0709 13:18:59.038319 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:00.506495 (+1468176us) service_pool.cc:224] Handling call
0709 13:19:00.506989 (+   494us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:00.507449 (+   460us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:00.507480 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:00.522645 (+ 15165us) log.cc:844] Serialized 26 byte log entry
0709 13:19:00.863534 (+340889us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:19:00.863780 (+   246us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:00.863887 (+   107us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:01.258684 (+394797us) spinlock_profiling.cc:243] Waited 7.83 ms on lock 0x7b4400022b4c. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0c745db1 00007fcc0c7e3c85 00007fcc0c7e46a2 00007fcc0f5561db 00007fcc0f551aaf 00007fcc0f54586e 00007fcc0f544bb6 00007fcc0f5447d8 00007fcc0f54e221 00007fcc0f54e1d9 00007fcc0f54e169
0709 13:19:01.272362 (+ 13678us) raft_consensus.cc:1685] finished
0709 13:19:01.272400 (+    38us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:01.273991 (+  1591us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2900,"raft.run_cpu_time_us":118,"raft.run_wall_time_us":119,"spinlock_wait_cycles":17997696,"thread_start_us":293631,"threads_started":1,"wal-append.queue_time_us":463025}
I20260709 13:19:01.246630  8765 raft_consensus.cc:2804] T de3186201e1a40d0b335eeb8b4e256e0 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:19:01.295708  8765 raft_consensus.cc:493] T de3186201e1a40d0b335eeb8b4e256e0 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:01.296253  8765 raft_consensus.cc:3060] T de3186201e1a40d0b335eeb8b4e256e0 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:19:01.295950  8754 raft_consensus.cc:515] T 7a734b5ab7834e05a8c422208acc58b1 P cd75a17ab2604397adab03bb8b5fd75c [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:01.254901  8555 raft_consensus.cc:3055] T 17587d6730594da4a56fa13a353232a1 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:19:01.300357  8555 raft_consensus.cc:740] T 17587d6730594da4a56fa13a353232a1 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 7ba59cc884714e8aa5f3f0ecaed84cbb, State: Running, Role: LEADER
I20260709 13:19:01.301477  8555 consensus_queue.cc:260] T 17587d6730594da4a56fa13a353232a1 P 7ba59cc884714e8aa5f3f0ecaed84cbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:19:01.300928  6846 leader_election.cc:304] T fe20b4b48823486ca3b9c648db6ce8aa P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:19:01.257050  6879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7887766dc6784fcaa42b35c05fea7a99" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:19:01.258062  6873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90d42e216d9741e190bca19a781291fd" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:19:01.170408  8405 consensus_queue.cc:1059] T 95a75bfe094d4bdc963aba3f08dfcd25 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.038s
W20260709 13:19:01.309010  8783 log.cc:927] Time spent T f5be3a11b23d4ea9b08300a2789821c7 P cd75a17ab2604397adab03bb8b5fd75c: Append to log took a long time: real 0.260s	user 0.000s	sys 0.002s
I20260709 13:19:01.305733  6873 raft_consensus.cc:2468] T 90d42e216d9741e190bca19a781291fd P cd75a17ab2604397adab03bb8b5fd75c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 5.
I20260709 13:19:01.309315  8405 raft_consensus.cc:3055] T 95a75bfe094d4bdc963aba3f08dfcd25 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 5 LEADER]: Stepping down as leader of term 5
W20260709 13:19:01.305886  8716 consensus_meta.cc:287] T f58dc08b12a2494bb9a1372837970ca2 P ccd8a4c3bfe3413cb2ae219b09aea832: Time spent flushing consensus metadata: real 0.515s	user 0.015s	sys 0.001s
I20260709 13:19:01.310465  8405 raft_consensus.cc:740] T 95a75bfe094d4bdc963aba3f08dfcd25 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
I20260709 13:19:01.299820  8754 leader_election.cc:290] T 7a734b5ab7834e05a8c422208acc58b1 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 5 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:19:01.311053  8716 raft_consensus.cc:2749] T f58dc08b12a2494bb9a1372837970ca2 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:19:01.307448  8691 raft_consensus.cc:3055] T 4f00a2e87e56452083b759f60d461ee3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:19:01.312621  8691 raft_consensus.cc:740] T 4f00a2e87e56452083b759f60d461ee3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 7ba59cc884714e8aa5f3f0ecaed84cbb, State: Running, Role: LEADER
I20260709 13:19:01.311730  8405 consensus_queue.cc:260] T 95a75bfe094d4bdc963aba3f08dfcd25 P ccd8a4c3bfe3413cb2ae219b09aea832 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 5.2, Last appended by leader: 2, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:01.311719  8754 raft_consensus.cc:2804] T fe20b4b48823486ca3b9c648db6ce8aa P cd75a17ab2604397adab03bb8b5fd75c [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:19:01.313707  8691 consensus_queue.cc:260] T 4f00a2e87e56452083b759f60d461ee3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:19:01.279078  6876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f9c2e2bf644115957398fe4c9459db" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:19:01.315785  8691 raft_consensus.cc:3060] T 4f00a2e87e56452083b759f60d461ee3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:19:01.316187  6876 raft_consensus.cc:2393] T f3f9c2e2bf644115957398fe4c9459db P cd75a17ab2604397adab03bb8b5fd75c [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7ab4784c7344b939bc36f639286f377 in current term 5: Already voted for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in this term.
I20260709 13:19:01.308429  6770 leader_election.cc:304] T c4db81d9d329422bb3b4160ca4ac2d1d P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:19:01.319729  8727 raft_consensus.cc:2749] T c4db81d9d329422bb3b4160ca4ac2d1d P b7ab4784c7344b939bc36f639286f377 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:19:01.304013  8555 raft_consensus.cc:3060] T 17587d6730594da4a56fa13a353232a1 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:01.187417  8793 consensus_queue.cc:1059] T 3d65025eea89441290d85dd053810e31 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.079s
I20260709 13:19:01.325572  8405 raft_consensus.cc:3060] T 95a75bfe094d4bdc963aba3f08dfcd25 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:01.325413  8793 raft_consensus.cc:3055] T 3d65025eea89441290d85dd053810e31 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:19:01.326696  8793 raft_consensus.cc:740] T 3d65025eea89441290d85dd053810e31 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
I20260709 13:19:01.265795  6880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a734b5ab7834e05a8c422208acc58b1" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:19:01.285181  8790 raft_consensus.cc:3055] T f4b8bd455d5a47c18a1380839c6e0d61 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:19:01.329545  8790 raft_consensus.cc:740] T f4b8bd455d5a47c18a1380839c6e0d61 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
I20260709 13:19:01.330572  8790 consensus_queue.cc:260] T f4b8bd455d5a47c18a1380839c6e0d61 P ccd8a4c3bfe3413cb2ae219b09aea832 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:01.281477  8711 leader_election.cc:290] T a3022224cc81473690653a83d4e99470 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:01.305065  6879 raft_consensus.cc:2468] T 7887766dc6784fcaa42b35c05fea7a99 P cd75a17ab2604397adab03bb8b5fd75c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 3.
I20260709 13:19:01.314700  8754 raft_consensus.cc:493] T fe20b4b48823486ca3b9c648db6ce8aa P cd75a17ab2604397adab03bb8b5fd75c [term 1 FOLLOWER]: Starting leader election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:19:01.332938  8790 raft_consensus.cc:3060] T f4b8bd455d5a47c18a1380839c6e0d61 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:19:01.238428  8520 leader_election.cc:290] T fe20b4b48823486ca3b9c648db6ce8aa P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:19:01.323866  8257 raft_consensus.cc:3060] T 34f36d59d88f40fe8a2805e604fc6c0a P ccd8a4c3bfe3413cb2ae219b09aea832 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:01.284497  6800 raft_consensus.cc:1275] T f3f9c2e2bf644115957398fe4c9459db P b7ab4784c7344b939bc36f639286f377 [term 5 FOLLOWER]: Refusing update from remote peer ccd8a4c3bfe3413cb2ae219b09aea832: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:19:01.333000  8754 raft_consensus.cc:3060] T fe20b4b48823486ca3b9c648db6ce8aa P cd75a17ab2604397adab03bb8b5fd75c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:01.294483  8779 consensus_queue.cc:260] T a1704639a875409b9959353527b3fd68 P cd75a17ab2604397adab03bb8b5fd75c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:01.333808  8793 consensus_queue.cc:260] T 3d65025eea89441290d85dd053810e31 P ccd8a4c3bfe3413cb2ae219b09aea832 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:01.349125  8793 raft_consensus.cc:3060] T 3d65025eea89441290d85dd053810e31 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:19:01.352262  8765 raft_consensus.cc:515] T de3186201e1a40d0b335eeb8b4e256e0 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
W20260709 13:19:01.233431  8764 log.cc:927] Time spent T 713b5728a197487c9300b310ab94e5a3 P ccd8a4c3bfe3413cb2ae219b09aea832: Append to log took a long time: real 0.767s	user 0.018s	sys 0.016s
I20260709 13:19:01.359892  8765 leader_election.cc:290] T de3186201e1a40d0b335eeb8b4e256e0 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 5 election: Requested vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:01.366609  8754 raft_consensus.cc:515] T fe20b4b48823486ca3b9c648db6ce8aa P cd75a17ab2604397adab03bb8b5fd75c [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
W20260709 13:19:01.367652  8762 consensus_meta.cc:287] T 4b8cacb381b746da8d0049b0a83b41dd P cd75a17ab2604397adab03bb8b5fd75c: Time spent flushing consensus metadata: real 0.509s	user 0.007s	sys 0.004s
W20260709 13:19:01.372056  6696 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:01.371950  8762 raft_consensus.cc:515] T 4b8cacb381b746da8d0049b0a83b41dd P cd75a17ab2604397adab03bb8b5fd75c [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:19:01.377048  8762 leader_election.cc:290] T 4b8cacb381b746da8d0049b0a83b41dd P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 6 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:19:01.369124  8744 leader_election.cc:290] T bb7fa124c3bf4ef9ab65a407cb008441 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 6 election: Requested vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
W20260709 13:19:01.289798  8763 consensus_meta.cc:287] T 427c124d773f483294511e80fe340075 P b7ab4784c7344b939bc36f639286f377: Time spent flushing consensus metadata: real 0.573s	user 0.010s	sys 0.006s
I20260709 13:19:01.370409  8520 raft_consensus.cc:493] T 7ba5dac66ab5497e9e336f2a3c28cda5 P cd75a17ab2604397adab03bb8b5fd75c [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:01.378288  7495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b8cacb381b746da8d0049b0a83b41dd" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb"
I20260709 13:19:01.368902  8777 raft_consensus.cc:3060] T a3022224cc81473690653a83d4e99470 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:19:01.400274  6695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 188421us
I20260709 13:19:01.378229  8779 raft_consensus.cc:3060] T a1704639a875409b9959353527b3fd68 P cd75a17ab2604397adab03bb8b5fd75c [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:19:01.385190  7501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe20b4b48823486ca3b9c648db6ce8aa" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb"
W20260709 13:19:01.388479  6770 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 66134us
W20260709 13:19:00.664798  8767 consensus_queue.cc:1175] T 9b3759de40694069b13c0f8bd40e5709 P ccd8a4c3bfe3413cb2ae219b09aea832 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "b7ab4784c7344b939bc36f639286f377" responder_term: 5 status { last_received { term: 2 index: 2 } last_committed_idx: 2 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 4. Current term is 5. Ops: [4.3-4.3]" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:19:01.337275  8347 raft_consensus.cc:515] T 404190ce4ce94cecbfcb6ea9d1dd8626 P b7ab4784c7344b939bc36f639286f377 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:19:01.419003  8347 leader_election.cc:290] T 404190ce4ce94cecbfcb6ea9d1dd8626 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 6 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:19:01.395965  8446 consensus_queue.cc:1048] T 7c37d41cd9164c15a6826ca62a851a69 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.025s
I20260709 13:19:01.421522  6880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de3186201e1a40d0b335eeb8b4e256e0" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:19:01.422083  6805 raft_consensus.cc:2368] T 404190ce4ce94cecbfcb6ea9d1dd8626 P b7ab4784c7344b939bc36f639286f377 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 5. Current term is 6.
I20260709 13:19:01.422490  6880 raft_consensus.cc:2393] T de3186201e1a40d0b335eeb8b4e256e0 P cd75a17ab2604397adab03bb8b5fd75c [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ccd8a4c3bfe3413cb2ae219b09aea832 in current term 5: Already voted for candidate cd75a17ab2604397adab03bb8b5fd75c in this term.
I20260709 13:19:01.424291  6879 raft_consensus.cc:1275] T f09c2a98de1a4decabd0ff900dd44caa P cd75a17ab2604397adab03bb8b5fd75c [term 5 FOLLOWER]: Refusing update from remote peer ccd8a4c3bfe3413cb2ae219b09aea832: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 3. (term mismatch)
I20260709 13:19:01.424861  6879 pending_rounds.cc:85] T f09c2a98de1a4decabd0ff900dd44caa P cd75a17ab2604397adab03bb8b5fd75c: Aborting all ops after (but not including) 2
I20260709 13:19:01.424722  7495 raft_consensus.cc:3060] T 4b8cacb381b746da8d0049b0a83b41dd P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:01.425616  6879 pending_rounds.cc:107] T f09c2a98de1a4decabd0ff900dd44caa P cd75a17ab2604397adab03bb8b5fd75c: Aborting uncommitted NO_OP operation due to leader change: 4.3
I20260709 13:19:01.426131  6879 raft_consensus.cc:2889] T f09c2a98de1a4decabd0ff900dd44caa P cd75a17ab2604397adab03bb8b5fd75c [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:19:01.428490  6872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e326172347f45e99a0d482b5d8ef768" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:19:01.430516  6876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce4f062dcd314d43a63ca74067cb5ee3" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
W20260709 13:19:01.396127  6772 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 54574.2us
I20260709 13:19:01.397414  8766 raft_consensus.cc:515] T 711ef6523deb4cbe8ef2ba61e1c21c98 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
W20260709 13:19:01.404202  7468 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:01.433372  6772 leader_election.cc:304] T ab432e62819d499eaaf3dd55481dd930 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:19:01.403081  8760 raft_consensus.cc:493] T bb3d8792045a4583ae2e965b1350a5b4 P cd75a17ab2604397adab03bb8b5fd75c [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:19:01.412319  7501 raft_consensus.cc:3060] T fe20b4b48823486ca3b9c648db6ce8aa P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:01.402997  8763 raft_consensus.cc:515] T 427c124d773f483294511e80fe340075 P b7ab4784c7344b939bc36f639286f377 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } attrs { replace: true } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
W20260709 13:19:01.440532  6771 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:01.440683  6873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4275cf08e63345f993bce8664eada830" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:19:01.416157  8757 raft_consensus.cc:493] T 713b5728a197487c9300b310ab94e5a3 P cd75a17ab2604397adab03bb8b5fd75c [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:01.433534  7468 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:01.407330  6847 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:01.395553  8754 leader_election.cc:290] T fe20b4b48823486ca3b9c648db6ce8aa P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 2 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
W20260709 13:19:01.435806  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 403064us
I20260709 13:19:01.439006  6880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44bde925b2e541b69890d70715b85176" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:19:01.457748  6880 raft_consensus.cc:2410] T 44bde925b2e541b69890d70715b85176 P cd75a17ab2604397adab03bb8b5fd75c [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ccd8a4c3bfe3413cb2ae219b09aea832 for term 6 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:19:01.459285  6872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b56bf91d90824c959e21e0cee5ba1816" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:19:01.461148  6695 leader_election.cc:304] T 9e326172347f45e99a0d482b5d8ef768 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
I20260709 13:19:01.465480  6874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b56bf91d90824c959e21e0cee5ba1816" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:19:01.469859  6879 raft_consensus.cc:1275] T f3f9c2e2bf644115957398fe4c9459db P cd75a17ab2604397adab03bb8b5fd75c [term 5 FOLLOWER]: Refusing update from remote peer ccd8a4c3bfe3413cb2ae219b09aea832: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:19:01.467818  6875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5be3a11b23d4ea9b08300a2789821c7" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:19:01.472074  6878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22ccee1b570c4ad3a57bd7aec085b1b4" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
W20260709 13:19:01.484356  6695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 50653.1us
I20260709 13:19:01.484793  6872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3411566abe2d4c9bb4b2adfdd05e6f17" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:19:01.464730  8690 raft_consensus.cc:2804] T ab432e62819d499eaaf3dd55481dd930 P b7ab4784c7344b939bc36f639286f377 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:19:01.439466  8574 raft_consensus.cc:515] T bb7fa124c3bf4ef9ab65a407cb008441 P b7ab4784c7344b939bc36f639286f377 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:19:01.435731  8520 raft_consensus.cc:515] T 7ba5dac66ab5497e9e336f2a3c28cda5 P cd75a17ab2604397adab03bb8b5fd75c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:19:01.490417  6878 raft_consensus.cc:1240] T 95a75bfe094d4bdc963aba3f08dfcd25 P cd75a17ab2604397adab03bb8b5fd75c [term 6 FOLLOWER]: Rejecting Update request from peer ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 5. Current term is 6. Ops: [5.2-5.2]
I20260709 13:19:01.474834  8440 consensus_queue.cc:1059] T d8292e16e5654be6bc408560cf256aaa P b7ab4784c7344b939bc36f639286f377 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.014s
I20260709 13:19:01.494582  6728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b56bf91d90824c959e21e0cee5ba1816" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:19:01.501014  6728 raft_consensus.cc:2393] T b56bf91d90824c959e21e0cee5ba1816 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7ab4784c7344b939bc36f639286f377 in current term 5: Already voted for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in this term.
I20260709 13:19:01.472391  8445 consensus_queue.cc:1059] T 3a485a995abc4807b6e511e45419f737 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.025s
I20260709 13:19:01.457531  8760 raft_consensus.cc:515] T bb3d8792045a4583ae2e965b1350a5b4 P cd75a17ab2604397adab03bb8b5fd75c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:19:01.494369  6730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4275cf08e63345f993bce8664eada830" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:19:01.497720  8440 consensus_queue.cc:1243] T d8292e16e5654be6bc408560cf256aaa P b7ab4784c7344b939bc36f639286f377 [LEADER]: Peer cd75a17ab2604397adab03bb8b5fd75c log is divergent from this leader: its last log entry 4.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260709 13:19:01.508173  6876 raft_consensus.cc:2468] T ce4f062dcd314d43a63ca74067cb5ee3 P cd75a17ab2604397adab03bb8b5fd75c [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 6.
I20260709 13:19:01.505532  6724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d9def8b32fd443aa94ab1420b06837b" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:19:01.510800  6730 raft_consensus.cc:2468] T 4275cf08e63345f993bce8664eada830 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 4.
I20260709 13:19:01.489748  8690 raft_consensus.cc:493] T ab432e62819d499eaaf3dd55481dd930 P b7ab4784c7344b939bc36f639286f377 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:01.475970  8757 raft_consensus.cc:515] T 713b5728a197487c9300b310ab94e5a3 P cd75a17ab2604397adab03bb8b5fd75c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:01.514474  6723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09c2a98de1a4decabd0ff900dd44caa" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:19:01.524150  6876 raft_consensus.cc:1240] T fe20b4b48823486ca3b9c648db6ce8aa P cd75a17ab2604397adab03bb8b5fd75c [term 2 FOLLOWER]: Rejecting Update request from peer ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 1. Current term is 2. Ops: []
I20260709 13:19:01.525568  6879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bf4668eeb70467fb3dc5a0289233b3c" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:19:01.525091  6628 catalog_manager.cc:5697] T 20f6842e26174571996b8dea4151d4be P cd75a17ab2604397adab03bb8b5fd75c reported cstate change: term changed from 2 to 3, leader changed from cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67) to ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65). New cstate: current_term: 3 leader_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } }
I20260709 13:19:01.527047  6695 leader_election.cc:400] T 404190ce4ce94cecbfcb6ea9d1dd8626 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 5 election: Vote denied by peer b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817) with higher term. Message: Invalid argument: T 404190ce4ce94cecbfcb6ea9d1dd8626 P b7ab4784c7344b939bc36f639286f377 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 5. Current term is 6.
I20260709 13:19:01.527487  6695 leader_election.cc:403] T 404190ce4ce94cecbfcb6ea9d1dd8626 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 5 election: Cancelling election due to peer responding with higher term
I20260709 13:19:01.528254  6732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3411566abe2d4c9bb4b2adfdd05e6f17" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:19:01.529214  6732 raft_consensus.cc:2393] T 3411566abe2d4c9bb4b2adfdd05e6f17 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7ab4784c7344b939bc36f639286f377 in current term 4: Already voted for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in this term.
I20260709 13:19:01.529981  8792 consensus_queue.cc:1048] T f3f9c2e2bf644115957398fe4c9459db P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:19:01.530290  6732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbdf895bba214ff68685a24fd17dfb5d" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:19:01.525669  8440 raft_consensus.cc:3055] T d8292e16e5654be6bc408560cf256aaa P b7ab4784c7344b939bc36f639286f377 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:19:01.532003  8440 raft_consensus.cc:740] T d8292e16e5654be6bc408560cf256aaa P b7ab4784c7344b939bc36f639286f377 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
I20260709 13:19:01.532183  6878 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3fa34c08b205435dba97346991aa1f92"
dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
 from {username='slave'} at 127.0.0.1:53416
I20260709 13:19:01.532480  6731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d65025eea89441290d85dd053810e31" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:19:01.532927  8440 consensus_queue.cc:260] T d8292e16e5654be6bc408560cf256aaa P b7ab4784c7344b939bc36f639286f377 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:01.534211  8440 raft_consensus.cc:3060] T d8292e16e5654be6bc408560cf256aaa P b7ab4784c7344b939bc36f639286f377 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:01.534387  8520 leader_election.cc:290] T 7ba5dac66ab5497e9e336f2a3c28cda5 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:19:01.534888  6730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4db81d9d329422bb3b4160ca4ac2d1d" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:19:01.536375  6729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24ee15416e3145beaa1b8183453729a3" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:19:01.537720  6729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "404190ce4ce94cecbfcb6ea9d1dd8626" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:19:01.537810  6807 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50550 (request call id 148) took 1561 ms. Trace:
I20260709 13:19:01.538318  6729 raft_consensus.cc:2468] T 404190ce4ce94cecbfcb6ea9d1dd8626 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 5.
I20260709 13:19:01.538260  6807 rpcz_store.cc:276] 0709 13:18:59.976222 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:00.780855 (+804633us) service_pool.cc:224] Handling call
0709 13:19:00.781262 (+   407us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:19:00.781781 (+   519us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:19:01.147355 (+365574us) log.cc:844] Serialized 14 byte log entry
0709 13:19:01.434134 (+286779us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:19:01.445715 (+ 11581us) log.cc:844] Serialized 52 byte log entry
0709 13:19:01.445922 (+   207us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:19:01.445988 (+    66us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:01.446092 (+   104us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:01.537600 (+ 91508us) raft_consensus.cc:1685] finished
0709 13:19:01.537619 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:01.537748 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":27708,"raft.queue_time_us":46150,"raft.run_cpu_time_us":517,"raft.run_wall_time_us":7147,"thread_start_us":202727,"threads_started":1,"wal-append.queue_time_us":280542}
I20260709 13:19:01.539573  6729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17587d6730594da4a56fa13a353232a1" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
W20260709 13:19:01.540277  6678 auto_rebalancer.cc:893] Removing replace marker failed: Replica ccd8a4c3bfe3413cb2ae219b09aea832 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 4 committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } attrs { replace: true } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } } }
W20260709 13:19:01.540834  6678 auto_rebalancer.cc:901] Could not move replica: Illegal state: not currently leader
W20260709 13:19:01.541132  6678 auto_rebalancer.cc:330] scheduled replica move failed to complete: Illegal state: not currently leader
I20260709 13:19:01.543480  8257 raft_consensus.cc:3060] T 404190ce4ce94cecbfcb6ea9d1dd8626 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:01.543833  6723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab432e62819d499eaaf3dd55481dd930" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:19:01.544620  6723 raft_consensus.cc:2468] T ab432e62819d499eaaf3dd55481dd930 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 5.
I20260709 13:19:01.545586  6723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d33d5ee8ef6f415593d8df52063161ad" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:19:01.546581  6804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de3186201e1a40d0b335eeb8b4e256e0" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:19:01.546869  6723 raft_consensus.cc:2468] T d33d5ee8ef6f415593d8df52063161ad P ccd8a4c3bfe3413cb2ae219b09aea832 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 5.
I20260709 13:19:01.547886  6725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30e88460611e47b2ba16a46a30b5f416" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:19:01.536556  6724 raft_consensus.cc:1275] T d8292e16e5654be6bc408560cf256aaa P ccd8a4c3bfe3413cb2ae219b09aea832 [term 5 FOLLOWER]: Refusing update from remote peer b7ab4784c7344b939bc36f639286f377: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
W20260709 13:19:01.549451  6695 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:01.540273  6805 raft_consensus.cc:1275] T 20f6842e26174571996b8dea4151d4be P b7ab4784c7344b939bc36f639286f377 [term 5 FOLLOWER]: Refusing update from remote peer ccd8a4c3bfe3413cb2ae219b09aea832: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:19:01.547225  6804 raft_consensus.cc:3060] T de3186201e1a40d0b335eeb8b4e256e0 P b7ab4784c7344b939bc36f639286f377 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:19:01.550910  6729 raft_consensus.cc:3060] T 17587d6730594da4a56fa13a353232a1 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:01.550472  6728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a75bfe094d4bdc963aba3f08dfcd25" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:19:01.522753  6727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e31b9971c15848dea59d4d4130141d9e" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:19:01.553989  6728 raft_consensus.cc:2410] T 95a75bfe094d4bdc963aba3f08dfcd25 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7ab4784c7344b939bc36f639286f377 for term 6 because replica has last-logged OpId of term: 5 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:19:01.526929  6628 catalog_manager.cc:5697] T 07a92dd554674067a83a9cb68c4773f2 P cd75a17ab2604397adab03bb8b5fd75c reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } }
I20260709 13:19:01.498081  8797 raft_consensus.cc:2804] T 9e326172347f45e99a0d482b5d8ef768 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:19:01.561767  6723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a75bfe094d4bdc963aba3f08dfcd25" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:19:01.568625  6879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c37d41cd9164c15a6826ca62a851a69" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:19:01.521514  8690 raft_consensus.cc:3060] T ab432e62819d499eaaf3dd55481dd930 P b7ab4784c7344b939bc36f639286f377 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:01.573019  6723 raft_consensus.cc:1275] T f5be3a11b23d4ea9b08300a2789821c7 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 5 FOLLOWER]: Refusing update from remote peer b7ab4784c7344b939bc36f639286f377: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:19:01.573210  6874 raft_consensus.cc:1240] T 3d65025eea89441290d85dd053810e31 P cd75a17ab2604397adab03bb8b5fd75c [term 4 FOLLOWER]: Rejecting Update request from peer ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 13:19:01.578068  6724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce4f062dcd314d43a63ca74067cb5ee3" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 6 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
W20260709 13:19:01.579730  6770 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 118827us
I20260709 13:19:01.584517  6770 leader_election.cc:304] T de3186201e1a40d0b335eeb8b4e256e0 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: cd75a17ab2604397adab03bb8b5fd75c
W20260709 13:19:01.575922  7466 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.519s	user 0.012s	sys 0.015s
I20260709 13:19:01.575574  6881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3022224cc81473690653a83d4e99470" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:19:01.591810  6697 leader_election.cc:304] T 7a734b5ab7834e05a8c422208acc58b1 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
W20260709 13:19:01.594516  6772 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 124626us
W20260709 13:19:01.600370  7466 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.543s	user 0.013s	sys 0.015s
W20260709 13:19:01.600854  7466 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 544884us
I20260709 13:19:01.600922  6881 raft_consensus.cc:2468] T a3022224cc81473690653a83d4e99470 P cd75a17ab2604397adab03bb8b5fd75c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 4.
I20260709 13:19:01.520463  8446 consensus_queue.cc:1048] T 7c44c4849aa54f2b94d1f1bef9ed546f P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 1, Time since last communication: 0.056s
I20260709 13:19:01.601992  6724 raft_consensus.cc:2393] T ce4f062dcd314d43a63ca74067cb5ee3 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7ab4784c7344b939bc36f639286f377 in current term 6: Already voted for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in this term.
I20260709 13:19:01.565213  8797 raft_consensus.cc:493] T 9e326172347f45e99a0d482b5d8ef768 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:19:01.601183  7467 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:01.549342  8094 consensus_queue.cc:1048] T f09c2a98de1a4decabd0ff900dd44caa P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.044s
I20260709 13:19:01.595825  6628 catalog_manager.cc:5697] T a1704639a875409b9959353527b3fd68 P cd75a17ab2604397adab03bb8b5fd75c reported cstate change: term changed from 1 to 4, leader changed from b7ab4784c7344b939bc36f639286f377 (127.5.126.66) to cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67). New cstate: current_term: 4 leader_uuid: "cd75a17ab2604397adab03bb8b5fd75c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:01.611634  6805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "427c124d773f483294511e80fe340075" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
W20260709 13:19:01.610648  7466 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:01.612390  6805 raft_consensus.cc:3060] T 427c124d773f483294511e80fe340075 P b7ab4784c7344b939bc36f639286f377 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:19:01.603808  7468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 157043us
I20260709 13:19:01.612708  6772 leader_election.cc:304] T e31b9971c15848dea59d4d4130141d9e P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:19:01.613721  6723 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4b8cacb381b746da8d0049b0a83b41dd"
dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
mode: GRACEFUL
new_leader_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
 from {username='slave'} at 127.0.0.1:38536
I20260709 13:19:01.590724  8792 raft_consensus.cc:493] T d8292e16e5654be6bc408560cf256aaa P ccd8a4c3bfe3413cb2ae219b09aea832 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:01.615912  6728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d65025eea89441290d85dd053810e31" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:19:01.614429  6723 raft_consensus.cc:606] T 4b8cacb381b746da8d0049b0a83b41dd P ccd8a4c3bfe3413cb2ae219b09aea832 [term 5 LEADER]: Received request to transfer leadership to TS cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:19:01.619436  6724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "427c124d773f483294511e80fe340075" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:19:01.620074  6772 leader_election.cc:304] T d33d5ee8ef6f415593d8df52063161ad P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:19:01.621575  6724 raft_consensus.cc:3060] T 427c124d773f483294511e80fe340075 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:19:01.627650  6803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "711ef6523deb4cbe8ef2ba61e1c21c98" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:19:01.628667  6802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb7fa124c3bf4ef9ab65a407cb008441" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:19:01.629474  6802 raft_consensus.cc:2393] T bb7fa124c3bf4ef9ab65a407cb008441 P b7ab4784c7344b939bc36f639286f377 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in current term 6: Already voted for candidate b7ab4784c7344b939bc36f639286f377 in this term.
I20260709 13:19:01.629778  6881 raft_consensus.cc:1240] T 34f36d59d88f40fe8a2805e604fc6c0a P cd75a17ab2604397adab03bb8b5fd75c [term 2 FOLLOWER]: Rejecting Update request from peer ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 1. Current term is 2. Ops: []
I20260709 13:19:01.628746  6798 raft_consensus.cc:1240] T 4f00a2e87e56452083b759f60d461ee3 P b7ab4784c7344b939bc36f639286f377 [term 5 FOLLOWER]: Rejecting Update request from peer 7ba59cc884714e8aa5f3f0ecaed84cbb for earlier term 4. Current term is 5. Ops: []
I20260709 13:19:01.605012  8797 raft_consensus.cc:3060] T 9e326172347f45e99a0d482b5d8ef768 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:19:01.636274  6770 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 51897us
I20260709 13:19:01.638777  6803 raft_consensus.cc:2393] T 711ef6523deb4cbe8ef2ba61e1c21c98 P b7ab4784c7344b939bc36f639286f377 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate ccd8a4c3bfe3413cb2ae219b09aea832 in current term 5: Already voted for candidate b7ab4784c7344b939bc36f639286f377 in this term.
I20260709 13:19:01.622761  8791 raft_consensus.cc:2749] T 7a734b5ab7834e05a8c422208acc58b1 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:19:01.646955  6881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de3186201e1a40d0b335eeb8b4e256e0" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:19:01.590927  8801 consensus_queue.cc:1048] T 20f6842e26174571996b8dea4151d4be P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 1, Time since last communication: 0.051s
I20260709 13:19:01.656870  6881 raft_consensus.cc:2393] T de3186201e1a40d0b335eeb8b4e256e0 P cd75a17ab2604397adab03bb8b5fd75c [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate ccd8a4c3bfe3413cb2ae219b09aea832 in current term 5: Already voted for candidate cd75a17ab2604397adab03bb8b5fd75c in this term.
I20260709 13:19:01.667615  6628 catalog_manager.cc:5697] T b56bf91d90824c959e21e0cee5ba1816 P cd75a17ab2604397adab03bb8b5fd75c reported cstate change: term changed from 1 to 4, leader changed from ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65) to cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67). New cstate: current_term: 4 leader_uuid: "cd75a17ab2604397adab03bb8b5fd75c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:01.638473  8806 raft_consensus.cc:2804] T e31b9971c15848dea59d4d4130141d9e P b7ab4784c7344b939bc36f639286f377 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:19:01.686852  8806 raft_consensus.cc:493] T e31b9971c15848dea59d4d4130141d9e P b7ab4784c7344b939bc36f639286f377 [term 3 FOLLOWER]: Starting leader election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:19:01.634426  8792 raft_consensus.cc:515] T d8292e16e5654be6bc408560cf256aaa P ccd8a4c3bfe3413cb2ae219b09aea832 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:01.665598  8347 raft_consensus.cc:2804] T d33d5ee8ef6f415593d8df52063161ad P b7ab4784c7344b939bc36f639286f377 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:19:01.683844  8727 raft_consensus.cc:3055] T 3a485a995abc4807b6e511e45419f737 P b7ab4784c7344b939bc36f639286f377 [term 3 LEADER]: Stepping down as leader of term 3
W20260709 13:19:01.691717  8100 consensus_meta.cc:287] T c4db81d9d329422bb3b4160ca4ac2d1d P ccd8a4c3bfe3413cb2ae219b09aea832: Time spent flushing consensus metadata: real 0.558s	user 0.014s	sys 0.001s
I20260709 13:19:01.726107  6731 raft_consensus.cc:2410] T 3d65025eea89441290d85dd053810e31 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7ab4784c7344b939bc36f639286f377 for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:19:01.728572  6723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f9c2e2bf644115957398fe4c9459db" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:19:01.713577  8347 raft_consensus.cc:493] T d33d5ee8ef6f415593d8df52063161ad P b7ab4784c7344b939bc36f639286f377 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:01.745927  6732 raft_consensus.cc:2468] T dbdf895bba214ff68685a24fd17dfb5d P ccd8a4c3bfe3413cb2ae219b09aea832 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 6.
I20260709 13:19:01.749439  6728 raft_consensus.cc:1275] T 34f36d59d88f40fe8a2805e604fc6c0a P ccd8a4c3bfe3413cb2ae219b09aea832 [term 2 FOLLOWER]: Refusing update from remote peer b7ab4784c7344b939bc36f639286f377: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:19:01.712273  6628 catalog_manager.cc:5697] T bd6869f07b5a4885a0b99fbe60c3b175 P cd75a17ab2604397adab03bb8b5fd75c reported cstate change: term changed from 2 to 5. New cstate: current_term: 5 leader_uuid: "b7ab4784c7344b939bc36f639286f377" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } }
I20260709 13:19:01.690456  8806 raft_consensus.cc:3060] T e31b9971c15848dea59d4d4130141d9e P b7ab4784c7344b939bc36f639286f377 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:19:01.709959  8765 raft_consensus.cc:493] T bd6869f07b5a4885a0b99fbe60c3b175 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:19:01.706751  8805 raft_consensus.cc:493] T ce4f062dcd314d43a63ca74067cb5ee3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 5 FOLLOWER]: Starting pre-election (detected failure of leader cd75a17ab2604397adab03bb8b5fd75c)
I20260709 13:19:01.759394  6730 raft_consensus.cc:2410] T c4db81d9d329422bb3b4160ca4ac2d1d P ccd8a4c3bfe3413cb2ae219b09aea832 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7ab4784c7344b939bc36f639286f377 for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:19:01.760630  6872 raft_consensus.cc:1275] T 20f6842e26174571996b8dea4151d4be P cd75a17ab2604397adab03bb8b5fd75c [term 5 FOLLOWER]: Refusing update from remote peer ccd8a4c3bfe3413cb2ae219b09aea832: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:19:01.673813  8767 consensus_queue.cc:1048] T f09c2a98de1a4decabd0ff900dd44caa P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.061s
I20260709 13:19:01.758755  7502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "404190ce4ce94cecbfcb6ea9d1dd8626" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb"
I20260709 13:19:01.737825  8727 raft_consensus.cc:740] T 3a485a995abc4807b6e511e45419f737 P b7ab4784c7344b939bc36f639286f377 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
W20260709 13:19:01.759019  7467 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:01.781790  6696 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:01.874668  6696 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:01.780855  7468 leader_election.cc:336] T fe20b4b48823486ca3b9c648db6ce8aa P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931): Timed out: RequestConsensusVote RPC to 127.5.126.67:42931 timed out after 1.586s (SENT)
I20260709 13:19:01.876263  7468 leader_election.cc:304] T fe20b4b48823486ca3b9c648db6ce8aa P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:19:01.784893  7496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce4f062dcd314d43a63ca74067cb5ee3" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb"
W20260709 13:19:01.788017  8804 log.cc:927] Time spent T 7ba5dac66ab5497e9e336f2a3c28cda5 P 7ba59cc884714e8aa5f3f0ecaed84cbb: Append to log took a long time: real 0.149s	user 0.000s	sys 0.001s
I20260709 13:19:01.759428  8763 leader_election.cc:290] T 427c124d773f483294511e80fe340075 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 4 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:19:01.791577  8805 raft_consensus.cc:515] T ce4f062dcd314d43a63ca74067cb5ee3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } attrs { replace: true } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:19:01.797078  7502 raft_consensus.cc:2393] T 404190ce4ce94cecbfcb6ea9d1dd8626 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate ccd8a4c3bfe3413cb2ae219b09aea832 in current term 5: Already voted for candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in this term.
W20260709 13:19:01.903288  6770 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 218004us
I20260709 13:19:01.753036  8347 raft_consensus.cc:3060] T d33d5ee8ef6f415593d8df52063161ad P b7ab4784c7344b939bc36f639286f377 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:01.795724  8727 consensus_queue.cc:260] T 3a485a995abc4807b6e511e45419f737 P b7ab4784c7344b939bc36f639286f377 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
W20260709 13:19:01.889703  8813 log.cc:927] Time spent T f3f9c2e2bf644115957398fe4c9459db P b7ab4784c7344b939bc36f639286f377: Append to log took a long time: real 0.134s	user 0.000s	sys 0.000s
I20260709 13:19:01.890555  6728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20f6842e26174571996b8dea4151d4be" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:19:01.756145  8760 leader_election.cc:290] T bb3d8792045a4583ae2e965b1350a5b4 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:19:01.756124  8757 leader_election.cc:290] T 713b5728a197487c9300b310ab94e5a3 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:19:01.762177  8574 leader_election.cc:290] T bb7fa124c3bf4ef9ab65a407cb008441 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 6 election: Requested vote from peers cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:19:01.917403  8074 raft_consensus.cc:493] T 44bde925b2e541b69890d70715b85176 P b7ab4784c7344b939bc36f639286f377 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:01.952461  8100 raft_consensus.cc:493] T 7887766dc6784fcaa42b35c05fea7a99 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:01.920194  8440 raft_consensus.cc:493] T 711ef6523deb4cbe8ef2ba61e1c21c98 P b7ab4784c7344b939bc36f639286f377 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:01.920454  6770 leader_election.cc:304] T 4275cf08e63345f993bce8664eada830 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:19:01.925010  7496 raft_consensus.cc:3060] T ce4f062dcd314d43a63ca74067cb5ee3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:01.953308  8100 raft_consensus.cc:515] T 7887766dc6784fcaa42b35c05fea7a99 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:01.774192  8765 raft_consensus.cc:515] T bd6869f07b5a4885a0b99fbe60c3b175 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:01.955886  8574 raft_consensus.cc:2804] T 4275cf08e63345f993bce8664eada830 P b7ab4784c7344b939bc36f639286f377 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:19:01.956414  8574 raft_consensus.cc:493] T 4275cf08e63345f993bce8664eada830 P b7ab4784c7344b939bc36f639286f377 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:01.956916  8574 raft_consensus.cc:3060] T 4275cf08e63345f993bce8664eada830 P b7ab4784c7344b939bc36f639286f377 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:19:01.953504  8440 raft_consensus.cc:515] T 711ef6523deb4cbe8ef2ba61e1c21c98 P b7ab4784c7344b939bc36f639286f377 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:01.956426  6728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "404190ce4ce94cecbfcb6ea9d1dd8626" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:19:01.962380  8440 leader_election.cc:290] T 711ef6523deb4cbe8ef2ba61e1c21c98 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:01.965492  6726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "427c124d773f483294511e80fe340075" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:19:01.967391  6726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de3186201e1a40d0b335eeb8b4e256e0" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:19:01.968267  6726 raft_consensus.cc:2393] T de3186201e1a40d0b335eeb8b4e256e0 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c in current term 5: Already voted for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in this term.
W20260709 13:19:01.968644  6847 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:01.936419  6698 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:01.986651  8808 raft_consensus.cc:493] T 07a92dd554674067a83a9cb68c4773f2 P b7ab4784c7344b939bc36f639286f377 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:01.987517  6731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a92dd554674067a83a9cb68c4773f2" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:19:01.987444  8808 raft_consensus.cc:515] T 07a92dd554674067a83a9cb68c4773f2 P b7ab4784c7344b939bc36f639286f377 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:01.988379  6731 raft_consensus.cc:2468] T 07a92dd554674067a83a9cb68c4773f2 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 4.
W20260709 13:19:01.989579  8812 log.cc:927] Time spent T f03d0dbf16864ca4bc1bb5e4c0334c0f P b7ab4784c7344b939bc36f639286f377: Append to log took a long time: real 0.129s	user 0.000s	sys 0.000s
I20260709 13:19:01.989514  6731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3022224cc81473690653a83d4e99470" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:19:01.990350  6731 raft_consensus.cc:2468] T a3022224cc81473690653a83d4e99470 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 5.
I20260709 13:19:01.991395  6731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8292e16e5654be6bc408560cf256aaa" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:19:01.996419  6731 raft_consensus.cc:3060] T d8292e16e5654be6bc408560cf256aaa P ccd8a4c3bfe3413cb2ae219b09aea832 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:02.001924  6723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90d42e216d9741e190bca19a781291fd" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:19:01.970120  6726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "427c124d773f483294511e80fe340075" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:19:01.896785  8766 leader_election.cc:290] T 711ef6523deb4cbe8ef2ba61e1c21c98 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 5 election: Requested vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:02.102591  6732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7887766dc6784fcaa42b35c05fea7a99" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:19:02.103667  6732 raft_consensus.cc:2468] T 7887766dc6784fcaa42b35c05fea7a99 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 4.
W20260709 13:19:02.115170  6770 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 194798us
I20260709 13:19:01.757301  6628 catalog_manager.cc:5697] T 711ef6523deb4cbe8ef2ba61e1c21c98 P cd75a17ab2604397adab03bb8b5fd75c reported cstate change: term changed from 1 to 4, leader changed from ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65) to cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67). New cstate: current_term: 4 leader_uuid: "cd75a17ab2604397adab03bb8b5fd75c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } health_report { overall_health: HEALTHY } } }
W20260709 13:19:02.122115  6846 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:02.123324  6846 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:01.968690  8727 raft_consensus.cc:3060] T 3a485a995abc4807b6e511e45419f737 P b7ab4784c7344b939bc36f639286f377 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:19:01.947351  8405 raft_consensus.cc:493] T 3a485a995abc4807b6e511e45419f737 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
W20260709 13:19:02.147022  6772 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.503s	user 0.001s	sys 0.020s
W20260709 13:19:02.152953  6772 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.508s	user 0.001s	sys 0.020s
W20260709 13:19:02.155133  6695 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:02.157217  6798 raft_consensus.cc:1275] T 713b5728a197487c9300b310ab94e5a3 P b7ab4784c7344b939bc36f639286f377 [term 5 FOLLOWER]: Refusing update from remote peer ccd8a4c3bfe3413cb2ae219b09aea832: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
W20260709 13:19:02.153328  6772 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 533344us
I20260709 13:19:02.166568  6807 raft_consensus.cc:1275] T 90d42e216d9741e190bca19a781291fd P b7ab4784c7344b939bc36f639286f377 [term 5 FOLLOWER]: Refusing update from remote peer ccd8a4c3bfe3413cb2ae219b09aea832: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:19:02.117027  6628 catalog_manager.cc:5697] T 24ee15416e3145beaa1b8183453729a3 P cd75a17ab2604397adab03bb8b5fd75c reported cstate change: config changed from index 2 to 3, term changed from 4 to 3, leader changed from 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68) to cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68) changed from NON_VOTER to VOTER, no longer has a pending config: VOTER ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65), VOTER b7ab4784c7344b939bc36f639286f377 (127.5.126.66), VOTER cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67), VOTER 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68). New cstate: current_term: 3 leader_uuid: "cd75a17ab2604397adab03bb8b5fd75c" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:19:02.168366  6800 raft_consensus.cc:1275] T a1704639a875409b9959353527b3fd68 P b7ab4784c7344b939bc36f639286f377 [term 5 FOLLOWER]: Refusing update from remote peer ccd8a4c3bfe3413cb2ae219b09aea832: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:19:01.952595  8074 raft_consensus.cc:515] T 44bde925b2e541b69890d70715b85176 P b7ab4784c7344b939bc36f639286f377 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:02.170639  6770 leader_election.cc:304] T 4d9def8b32fd443aa94ab1420b06837b P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:19:02.176394  6628 catalog_manager.cc:5697] T 44bde925b2e541b69890d70715b85176 P cd75a17ab2604397adab03bb8b5fd75c reported cstate change: term changed from 1 to 4, leader changed from ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65) to cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67). New cstate: current_term: 4 leader_uuid: "cd75a17ab2604397adab03bb8b5fd75c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:02.187345  6799 raft_consensus.cc:1275] T b3f13b31a1f84f0d89d007eadd57924c P b7ab4784c7344b939bc36f639286f377 [term 4 FOLLOWER]: Refusing update from remote peer ccd8a4c3bfe3413cb2ae219b09aea832: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:19:02.187968  6802 raft_consensus.cc:1275] T 4d9def8b32fd443aa94ab1420b06837b P b7ab4784c7344b939bc36f639286f377 [term 5 FOLLOWER]: Refusing update from remote peer ccd8a4c3bfe3413cb2ae219b09aea832: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:19:02.188938  6881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "711ef6523deb4cbe8ef2ba61e1c21c98" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:19:02.162099  8765 leader_election.cc:290] T bd6869f07b5a4885a0b99fbe60c3b175 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:02.198215  6770 leader_election.cc:304] T 24ee15416e3145beaa1b8183453729a3 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:19:02.195080  6807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6869f07b5a4885a0b99fbe60c3b175" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 6 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:19:02.196528  6628 catalog_manager.cc:5697] T e31b9971c15848dea59d4d4130141d9e P cd75a17ab2604397adab03bb8b5fd75c reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } }
I20260709 13:19:02.247118  6874 raft_consensus.cc:1275] T 90d42e216d9741e190bca19a781291fd P cd75a17ab2604397adab03bb8b5fd75c [term 5 FOLLOWER]: Refusing update from remote peer ccd8a4c3bfe3413cb2ae219b09aea832: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:19:02.158728  8405 raft_consensus.cc:515] T 3a485a995abc4807b6e511e45419f737 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:02.244794  6802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7887766dc6784fcaa42b35c05fea7a99" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:19:02.248764  6880 raft_consensus.cc:1275] T 713b5728a197487c9300b310ab94e5a3 P cd75a17ab2604397adab03bb8b5fd75c [term 5 FOLLOWER]: Refusing update from remote peer ccd8a4c3bfe3413cb2ae219b09aea832: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:19:02.189779  8791 raft_consensus.cc:493] T 34f36d59d88f40fe8a2805e604fc6c0a P ccd8a4c3bfe3413cb2ae219b09aea832 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:02.265039  6804 consensus_meta.cc:287] T de3186201e1a40d0b335eeb8b4e256e0 P b7ab4784c7344b939bc36f639286f377: Time spent flushing consensus metadata: real 0.702s	user 0.011s	sys 0.000s
I20260709 13:19:02.251205  6873 raft_consensus.cc:1240] T 4b8cacb381b746da8d0049b0a83b41dd P cd75a17ab2604397adab03bb8b5fd75c [term 6 FOLLOWER]: Rejecting Update request from peer ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 5. Current term is 6. Ops: []
W20260709 13:19:02.278182  7466 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:02.318775  7503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ba5dac66ab5497e9e336f2a3c28cda5" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:19:02.264973  6802 raft_consensus.cc:2468] T 7887766dc6784fcaa42b35c05fea7a99 P b7ab4784c7344b939bc36f639286f377 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 4.
I20260709 13:19:02.283460  6723 raft_consensus.cc:1275] T dbdf895bba214ff68685a24fd17dfb5d P ccd8a4c3bfe3413cb2ae219b09aea832 [term 6 FOLLOWER]: Refusing update from remote peer b7ab4784c7344b939bc36f639286f377: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 6 index: 3. (index mismatch)
I20260709 13:19:02.379266  6804 raft_consensus.cc:2468] T de3186201e1a40d0b335eeb8b4e256e0 P b7ab4784c7344b939bc36f639286f377 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 5.
I20260709 13:19:02.322892  7502 raft_consensus.cc:1275] T b3f13b31a1f84f0d89d007eadd57924c P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 4 FOLLOWER]: Refusing update from remote peer ccd8a4c3bfe3413cb2ae219b09aea832: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
W20260709 13:19:02.340808  6724 consensus_meta.cc:287] T 427c124d773f483294511e80fe340075 P ccd8a4c3bfe3413cb2ae219b09aea832: Time spent flushing consensus metadata: real 0.719s	user 0.027s	sys 0.007s
I20260709 13:19:02.381582  6724 raft_consensus.cc:2468] T 427c124d773f483294511e80fe340075 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in term 5.
I20260709 13:19:02.243063  6697 leader_election.cc:304] T 4275cf08e63345f993bce8664eada830 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
W20260709 13:19:02.319590  6695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 62219.8us
W20260709 13:19:02.274619  6696 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:02.290264  6805 consensus_meta.cc:287] T 427c124d773f483294511e80fe340075 P b7ab4784c7344b939bc36f639286f377: Time spent flushing consensus metadata: real 0.675s	user 0.041s	sys 0.037s
I20260709 13:19:02.387581  6805 raft_consensus.cc:2468] T 427c124d773f483294511e80fe340075 P b7ab4784c7344b939bc36f639286f377 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in term 5.
I20260709 13:19:02.197495  8760 raft_consensus.cc:493] T f5be3a11b23d4ea9b08300a2789821c7 P cd75a17ab2604397adab03bb8b5fd75c [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
W20260709 13:19:02.242753  8812 log.cc:927] Time spent T f03d0dbf16864ca4bc1bb5e4c0334c0f P b7ab4784c7344b939bc36f639286f377: Append to log took a long time: real 0.067s	user 0.001s	sys 0.000s
I20260709 13:19:02.349622  6628 catalog_manager.cc:5697] T 7887766dc6784fcaa42b35c05fea7a99 P cd75a17ab2604397adab03bb8b5fd75c reported cstate change: term changed from 1 to 2, leader changed from ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65) to cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67). New cstate: current_term: 2 leader_uuid: "cd75a17ab2604397adab03bb8b5fd75c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:02.332222  6876 raft_consensus.cc:1275] T 4d9def8b32fd443aa94ab1420b06837b P cd75a17ab2604397adab03bb8b5fd75c [term 5 FOLLOWER]: Refusing update from remote peer ccd8a4c3bfe3413cb2ae219b09aea832: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
W20260709 13:19:02.403338  6725 consensus_meta.cc:287] T 30e88460611e47b2ba16a46a30b5f416 P ccd8a4c3bfe3413cb2ae219b09aea832: Time spent flushing consensus metadata: real 0.855s	user 0.016s	sys 0.050s
I20260709 13:19:02.414100  6725 raft_consensus.cc:2468] T 30e88460611e47b2ba16a46a30b5f416 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 4.
W20260709 13:19:02.413678  6729 consensus_meta.cc:287] T 17587d6730594da4a56fa13a353232a1 P ccd8a4c3bfe3413cb2ae219b09aea832: Time spent flushing consensus metadata: real 0.862s	user 0.016s	sys 0.012s
W20260709 13:19:02.415325  6697 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 172401us
I20260709 13:19:02.414347  6724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce4f062dcd314d43a63ca74067cb5ee3" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:19:02.322892  6877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6869f07b5a4885a0b99fbe60c3b175" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 6 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:19:02.415678  6729 raft_consensus.cc:2468] T 17587d6730594da4a56fa13a353232a1 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 7.
I20260709 13:19:02.416244  6697 leader_election.cc:304] T 44bde925b2e541b69890d70715b85176 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:19:02.244622  8757 raft_consensus.cc:493] T 853ac0a8cbd64ce99457f170216d4d0f P cd75a17ab2604397adab03bb8b5fd75c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:19:02.444308  6697 leader_election.cc:304] T b56bf91d90824c959e21e0cee5ba1816 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:19:02.462807  6724 raft_consensus.cc:2393] T ce4f062dcd314d43a63ca74067cb5ee3 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in current term 6: Already voted for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in this term.
I20260709 13:19:02.241689  8823 consensus_queue.cc:1048] T 7ba5dac66ab5497e9e336f2a3c28cda5 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.268s
W20260709 13:19:02.319725  8802 log.cc:927] Time spent T 1528ab62b6fe4e3099d08f141afee116 P b7ab4784c7344b939bc36f639286f377: Append to log took a long time: real 0.070s	user 0.000s	sys 0.001s
I20260709 13:19:02.295555  8763 raft_consensus.cc:2749] T 24ee15416e3145beaa1b8183453729a3 P b7ab4784c7344b939bc36f639286f377 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:19:02.250787  8446 raft_consensus.cc:2749] T 4d9def8b32fd443aa94ab1420b06837b P b7ab4784c7344b939bc36f639286f377 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:19:02.386176  7495 consensus_meta.cc:287] T 4b8cacb381b746da8d0049b0a83b41dd P 7ba59cc884714e8aa5f3f0ecaed84cbb: Time spent flushing consensus metadata: real 0.960s	user 0.007s	sys 0.008s
W20260709 13:19:02.344112  8814 log.cc:927] Time spent T c4db81d9d329422bb3b4160ca4ac2d1d P cd75a17ab2604397adab03bb8b5fd75c: Append to log took a long time: real 0.062s	user 0.001s	sys 0.000s
I20260709 13:19:02.197726  8094 consensus_queue.cc:1048] T 90d42e216d9741e190bca19a781291fd P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.215s
I20260709 13:19:02.203372  8801 consensus_queue.cc:1048] T 4d9def8b32fd443aa94ab1420b06837b P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.209s
I20260709 13:19:02.376626  8808 leader_election.cc:290] T 07a92dd554674067a83a9cb68c4773f2 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:02.467952  6724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d65025eea89441290d85dd053810e31" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:19:02.525491  6724 raft_consensus.cc:2410] T 3d65025eea89441290d85dd053810e31 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
W20260709 13:19:02.476452  6847 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:02.422541  6726 raft_consensus.cc:1275] T 30e88460611e47b2ba16a46a30b5f416 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 4 FOLLOWER]: Refusing update from remote peer b7ab4784c7344b939bc36f639286f377: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:19:02.282186  8100 leader_election.cc:290] T 7887766dc6784fcaa42b35c05fea7a99 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:02.422665  6727 raft_consensus.cc:1240] T 17587d6730594da4a56fa13a353232a1 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 7 FOLLOWER]: Rejecting Update request from peer 7ba59cc884714e8aa5f3f0ecaed84cbb for earlier term 6. Current term is 7. Ops: []
I20260709 13:19:02.383507  8711 raft_consensus.cc:2764] T de3186201e1a40d0b335eeb8b4e256e0 P b7ab4784c7344b939bc36f639286f377 [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
I20260709 13:19:02.328073  8828 consensus_queue.cc:1048] T b3f13b31a1f84f0d89d007eadd57924c P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.197s
W20260709 13:19:02.467741  8813 log.cc:927] Time spent T f3f9c2e2bf644115957398fe4c9459db P b7ab4784c7344b939bc36f639286f377: Append to log took a long time: real 0.098s	user 0.001s	sys 0.000s
I20260709 13:19:02.422392  8777 raft_consensus.cc:493] T 9b3759de40694069b13c0f8bd40e5709 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:02.487897  8691 consensus_meta.cc:287] T 4f00a2e87e56452083b759f60d461ee3 P 7ba59cc884714e8aa5f3f0ecaed84cbb: Time spent flushing consensus metadata: real 1.172s	user 0.009s	sys 0.010s
I20260709 13:19:02.469254  8760 raft_consensus.cc:515] T f5be3a11b23d4ea9b08300a2789821c7 P cd75a17ab2604397adab03bb8b5fd75c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:02.488698  7497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3d8792045a4583ae2e965b1350a5b4" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:19:02.492409  8440 raft_consensus.cc:493] T be1a92657f494cac8dd227d152f50151 P b7ab4784c7344b939bc36f639286f377 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 7ba59cc884714e8aa5f3f0ecaed84cbb)
W20260709 13:19:02.569339  6771 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:02.569481  8440 raft_consensus.cc:515] T be1a92657f494cac8dd227d152f50151 P b7ab4784c7344b939bc36f639286f377 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:19:02.494496  8405 leader_election.cc:290] T 3a485a995abc4807b6e511e45419f737 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:02.497428  8347 raft_consensus.cc:515] T d33d5ee8ef6f415593d8df52063161ad P b7ab4784c7344b939bc36f639286f377 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:02.479444  8798 raft_consensus.cc:2749] T 44bde925b2e541b69890d70715b85176 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:19:02.466333  8768 raft_consensus.cc:2749] T b56bf91d90824c959e21e0cee5ba1816 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:19:02.466710  8829 raft_consensus.cc:493] T be1a92657f494cac8dd227d152f50151 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 7ba59cc884714e8aa5f3f0ecaed84cbb)
I20260709 13:19:02.508744  8074 leader_election.cc:290] T 44bde925b2e541b69890d70715b85176 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:02.240226  8673 consensus_queue.cc:1048] T a1704639a875409b9959353527b3fd68 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 1, Time since last communication: 0.219s
I20260709 13:19:02.512782  6723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a92dd554674067a83a9cb68c4773f2" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
W20260709 13:19:02.513590  7501 consensus_meta.cc:287] T fe20b4b48823486ca3b9c648db6ce8aa P 7ba59cc884714e8aa5f3f0ecaed84cbb: Time spent flushing consensus metadata: real 1.059s	user 0.018s	sys 0.008s
I20260709 13:19:02.594731  7501 raft_consensus.cc:2468] T fe20b4b48823486ca3b9c648db6ce8aa P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 2.
I20260709 13:19:02.461529  8793 raft_consensus.cc:2749] T 4275cf08e63345f993bce8664eada830 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:19:02.517516  6628 catalog_manager.cc:5697] T f58dc08b12a2494bb9a1372837970ca2 P cd75a17ab2604397adab03bb8b5fd75c reported cstate change: term changed from 1 to 4, leader changed from ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65) to cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67). New cstate: current_term: 4 leader_uuid: "cd75a17ab2604397adab03bb8b5fd75c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } health_report { overall_health: HEALTHY } } }
W20260709 13:19:02.519411  6770 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 321233us
I20260709 13:19:02.605803  6770 leader_election.cc:304] T f09c2a98de1a4decabd0ff900dd44caa P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
W20260709 13:19:02.520136  6772 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 340601us
I20260709 13:19:02.607112  6772 leader_election.cc:304] T 95a75bfe094d4bdc963aba3f08dfcd25 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:19:02.319291  8773 raft_consensus.cc:493] T 7c37d41cd9164c15a6826ca62a851a69 P cd75a17ab2604397adab03bb8b5fd75c [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:19:02.521404  6881 raft_consensus.cc:2468] T 711ef6523deb4cbe8ef2ba61e1c21c98 P cd75a17ab2604397adab03bb8b5fd75c [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 5.
W20260709 13:19:02.523665  7468 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.632s	user 0.019s	sys 0.003s
I20260709 13:19:02.625839  7501 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50756 (request call id 147) took 1211 ms. Trace:
I20260709 13:19:02.383806  8791 raft_consensus.cc:515] T 34f36d59d88f40fe8a2805e604fc6c0a P ccd8a4c3bfe3413cb2ae219b09aea832 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
W20260709 13:19:02.521776  8257 consensus_meta.cc:287] T 404190ce4ce94cecbfcb6ea9d1dd8626 P ccd8a4c3bfe3413cb2ae219b09aea832: Time spent flushing consensus metadata: real 0.978s	user 0.013s	sys 0.015s
W20260709 13:19:02.520215  8779 consensus_meta.cc:287] T a1704639a875409b9959353527b3fd68 P cd75a17ab2604397adab03bb8b5fd75c: Time spent flushing consensus metadata: real 1.088s	user 0.017s	sys 0.003s
I20260709 13:19:02.533010  7466 leader_election.cc:304] T 427c124d773f483294511e80fe340075 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
I20260709 13:19:02.240468  8519 consensus_queue.cc:1048] T 713b5728a197487c9300b310ab94e5a3 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.188s
I20260709 13:19:02.344450  8445 consensus_queue.cc:1059] T 7c44c4849aa54f2b94d1f1bef9ed546f P b7ab4784c7344b939bc36f639286f377 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.180s
I20260709 13:19:02.539837  6724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d9def8b32fd443aa94ab1420b06837b" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:19:02.522388  7495 raft_consensus.cc:2468] T 4b8cacb381b746da8d0049b0a83b41dd P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 6.
I20260709 13:19:02.771214  6724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a485a995abc4807b6e511e45419f737" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:19:02.771843  6724 raft_consensus.cc:3060] T 3a485a995abc4807b6e511e45419f737 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:19:02.772981  7500 raft_consensus.cc:1240] T 4b8cacb381b746da8d0049b0a83b41dd P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 6 FOLLOWER]: Rejecting Update request from peer ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 5. Current term is 6. Ops: []
I20260709 13:19:02.519616  8792 leader_election.cc:290] T d8292e16e5654be6bc408560cf256aaa P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
W20260709 13:19:02.533496  8574 consensus_meta.cc:287] T 4275cf08e63345f993bce8664eada830 P b7ab4784c7344b939bc36f639286f377: Time spent flushing consensus metadata: real 0.576s	user 0.012s	sys 0.011s
W20260709 13:19:02.533267  8790 consensus_meta.cc:287] T f4b8bd455d5a47c18a1380839c6e0d61 P ccd8a4c3bfe3413cb2ae219b09aea832: Time spent flushing consensus metadata: real 1.193s	user 0.011s	sys 0.011s
I20260709 13:19:02.516856  8767 consensus_queue.cc:1048] T f3f9c2e2bf644115957398fe4c9459db P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.026s
W20260709 13:19:02.552053  6695 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:02.515292  8757 raft_consensus.cc:515] T 853ac0a8cbd64ce99457f170216d4d0f P cd75a17ab2604397adab03bb8b5fd75c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:02.572213  6805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a485a995abc4807b6e511e45419f737" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:19:02.576089  6801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8292e16e5654be6bc408560cf256aaa" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:19:02.577327  8440 leader_election.cc:290] T be1a92657f494cac8dd227d152f50151 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:19:02.779285  6628 catalog_manager.cc:5697] T 1528ab62b6fe4e3099d08f141afee116 P cd75a17ab2604397adab03bb8b5fd75c reported cstate change: config changed from index 3 to 2, term changed from 1 to 3, leader changed from ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65) to cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68) changed from VOTER to NON_VOTER, now has a pending config: VOTER ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65), VOTER b7ab4784c7344b939bc36f639286f377 (127.5.126.66), VOTER cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67), VOTER 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68). New cstate: current_term: 3 leader_uuid: "cd75a17ab2604397adab03bb8b5fd75c" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: NON_VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: true } health_report { overall_health: HEALTHY } } } pending_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } attrs { replace: true } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } } }
W20260709 13:19:02.577564  7496 consensus_meta.cc:287] T ce4f062dcd314d43a63ca74067cb5ee3 P 7ba59cc884714e8aa5f3f0ecaed84cbb: Time spent flushing consensus metadata: real 0.624s	user 0.010s	sys 0.023s
W20260709 13:19:02.581892  6875 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.585s	user 0.029s	sys 0.027s
W20260709 13:19:02.586295  6731 consensus_meta.cc:287] T d8292e16e5654be6bc408560cf256aaa P ccd8a4c3bfe3413cb2ae219b09aea832: Time spent flushing consensus metadata: real 0.578s	user 0.011s	sys 0.000s
I20260709 13:19:02.800356  6724 raft_consensus.cc:2468] T 3a485a995abc4807b6e511e45419f737 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 4.
W20260709 13:19:02.589304  6846 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:02.626421  7501 rpcz_store.cc:276] 0709 13:19:01.384368 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:01.384692 (+   324us) service_pool.cc:224] Handling call
0709 13:19:02.595507 (+1210815us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:19:02.698096  6770 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 92368.5us
I20260709 13:19:02.800879  6731 raft_consensus.cc:2468] T d8292e16e5654be6bc408560cf256aaa P ccd8a4c3bfe3413cb2ae219b09aea832 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 6.
W20260709 13:19:02.802580  6846 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:02.777889  8813 log.cc:927] Time spent T f3f9c2e2bf644115957398fe4c9459db P b7ab4784c7344b939bc36f639286f377: Append to log took a long time: real 0.090s	user 0.001s	sys 0.000s
W20260709 13:19:02.626186  7468 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.734s	user 0.020s	sys 0.003s
I20260709 13:19:02.800416  6628 catalog_manager.cc:5697] T 90d42e216d9741e190bca19a781291fd P cd75a17ab2604397adab03bb8b5fd75c reported cstate change: term changed from 1 to 4. New cstate: current_term: 4 leader_uuid: "b7ab4784c7344b939bc36f639286f377" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } }
I20260709 13:19:02.715945  6726 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50004 (request call id 1245) took 1021 ms. Trace:
I20260709 13:19:02.717128  6727 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49744 (request call id 126) took 1109 ms. Trace:
I20260709 13:19:02.801970  6724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a734b5ab7834e05a8c422208acc58b1" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:19:02.805222  6727 rpcz_store.cc:276] 0709 13:19:01.607448 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:01.607972 (+   524us) service_pool.cc:224] Handling call
0709 13:19:02.417809 (+809837us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:02.532122 (+114313us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:02.716884 (+184762us) spinlock_profiling.cc:243] Waited 798 ms on lock 0x7b54003624d0. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f9a98ad 00007fcc1496e419 00007fcc0dee5bd4 00007fcc0dee5b62 00007fcc0dee5a91 00007fcc0dee5a0c 00007fcc0dee4cc2 00007fcc0dce548c 00007fcc0dce48c6 00007fcc0dce426f
0709 13:19:02.717047 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1834255104}
I20260709 13:19:02.723095  6729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c240553ce044eedb41541d72b9475d7" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:19:02.806571  6724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c44c4849aa54f2b94d1f1bef9ed546f" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:19:02.806885  6731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44bde925b2e541b69890d70715b85176" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:19:02.807194  6724 raft_consensus.cc:3060] T 7c44c4849aa54f2b94d1f1bef9ed546f P ccd8a4c3bfe3413cb2ae219b09aea832 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:19:02.727157  8821 log.cc:927] Time spent T f03d0dbf16864ca4bc1bb5e4c0334c0f P cd75a17ab2604397adab03bb8b5fd75c: Append to log took a long time: real 0.461s	user 0.001s	sys 0.001s
I20260709 13:19:02.666278  8615 raft_consensus.cc:2749] T fe20b4b48823486ca3b9c648db6ce8aa P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:19:02.667147  8808 raft_consensus.cc:2749] T f09c2a98de1a4decabd0ff900dd44caa P b7ab4784c7344b939bc36f639286f377 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:19:02.741120  6732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3022224cc81473690653a83d4e99470" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:19:02.814507  6732 raft_consensus.cc:2468] T a3022224cc81473690653a83d4e99470 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 5.
I20260709 13:19:02.745060  8805 leader_election.cc:290] T ce4f062dcd314d43a63ca74067cb5ee3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:02.566723  8777 raft_consensus.cc:515] T 9b3759de40694069b13c0f8bd40e5709 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:02.710247  6725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "711ef6523deb4cbe8ef2ba61e1c21c98" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:19:02.817255  6725 raft_consensus.cc:2468] T 711ef6523deb4cbe8ef2ba61e1c21c98 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 5.
I20260709 13:19:02.593326  8691 raft_consensus.cc:493] T b3f13b31a1f84f0d89d007eadd57924c P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:02.766180  6698 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:02.812434  6628 catalog_manager.cc:5697] T 713b5728a197487c9300b310ab94e5a3 P cd75a17ab2604397adab03bb8b5fd75c reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } }
I20260709 13:19:02.639297  8773 raft_consensus.cc:515] T 7c37d41cd9164c15a6826ca62a851a69 P cd75a17ab2604397adab03bb8b5fd75c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:02.697984  6872 raft_consensus.cc:1275] T a1704639a875409b9959353527b3fd68 P cd75a17ab2604397adab03bb8b5fd75c [term 5 FOLLOWER]: Refusing update from remote peer ccd8a4c3bfe3413cb2ae219b09aea832: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
W20260709 13:19:02.769769  6772 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 71470us
I20260709 13:19:02.836987  6628 catalog_manager.cc:5697] T 4b8cacb381b746da8d0049b0a83b41dd P cd75a17ab2604397adab03bb8b5fd75c reported cstate change: term changed from 1 to 4, leader changed from ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65) to cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67). New cstate: current_term: 4 leader_uuid: "cd75a17ab2604397adab03bb8b5fd75c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 13:19:02.778602  7466 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 245739us
I20260709 13:19:02.688604  8257 raft_consensus.cc:2749] T 404190ce4ce94cecbfcb6ea9d1dd8626 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 6 FOLLOWER]: Leader election lost for term 5. Reason: Vote denied by peer b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817) with higher term. Message: Invalid argument: T 404190ce4ce94cecbfcb6ea9d1dd8626 P b7ab4784c7344b939bc36f639286f377 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 5. Current term is 6.
I20260709 13:19:02.767169  8823 raft_consensus.cc:2804] T 95a75bfe094d4bdc963aba3f08dfcd25 P b7ab4784c7344b939bc36f639286f377 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:19:02.846094  6732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b8cacb381b746da8d0049b0a83b41dd" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:19:02.846455  6725 raft_consensus.cc:1240] T 3411566abe2d4c9bb4b2adfdd05e6f17 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 4 FOLLOWER]: Rejecting Update request from peer cd75a17ab2604397adab03bb8b5fd75c for earlier term 3. Current term is 4. Ops: []
I20260709 13:19:02.764441  8779 raft_consensus.cc:493] T f3f9c2e2bf644115957398fe4c9459db P cd75a17ab2604397adab03bb8b5fd75c [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:02.795487  6801 raft_consensus.cc:2410] T d8292e16e5654be6bc408560cf256aaa P b7ab4784c7344b939bc36f639286f377 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ccd8a4c3bfe3413cb2ae219b09aea832 for term 6 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:19:02.793083  6695 leader_election.cc:304] T 7887766dc6784fcaa42b35c05fea7a99 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
W20260709 13:19:02.853405  6695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 60463.1us
I20260709 13:19:02.854131  6695 leader_election.cc:304] T de3186201e1a40d0b335eeb8b4e256e0 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
I20260709 13:19:02.638959  8829 raft_consensus.cc:515] T be1a92657f494cac8dd227d152f50151 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
W20260709 13:19:02.800786  6875 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.828s	user 0.030s	sys 0.027s
I20260709 13:19:02.807523  6731 raft_consensus.cc:2468] T 44bde925b2e541b69890d70715b85176 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 5.
I20260709 13:19:02.777297  7495 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50756 (request call id 146) took 1398 ms. Trace:
I20260709 13:19:02.804296  6726 rpcz_store.cc:276] 0709 13:19:01.694213 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:02.148433 (+454220us) service_pool.cc:224] Handling call
0709 13:19:02.414935 (+266502us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:02.526569 (+111634us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:02.715457 (+188888us) spinlock_profiling.cc:243] Waited 245 ms on lock 0x7b54003b74d0. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f9a98ad 00007fcc1496e419 00007fcc0dee5bd4 00007fcc0dee5b62 00007fcc0dee5a91 00007fcc0dee5a0c 00007fcc0dee4cc2 00007fcc0dce548c 00007fcc0dce48c6 00007fcc0dce426f
0709 13:19:02.715831 (+   374us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":564374400}
W20260709 13:19:02.816519  7468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 1.03564e+06us
I20260709 13:19:02.838338  6727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe20b4b48823486ca3b9c648db6ce8aa" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:19:02.805019  8763 raft_consensus.cc:3055] T 7c44c4849aa54f2b94d1f1bef9ed546f P b7ab4784c7344b939bc36f639286f377 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:19:02.802929  8794 raft_consensus.cc:2804] T 427c124d773f483294511e80fe340075 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:19:02.802793  7496 raft_consensus.cc:2468] T ce4f062dcd314d43a63ca74067cb5ee3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 6.
I20260709 13:19:02.788482  8574 raft_consensus.cc:515] T 4275cf08e63345f993bce8664eada830 P b7ab4784c7344b939bc36f639286f377 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
W20260709 13:19:02.848163  6697 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 388138us
I20260709 13:19:02.856478  6772 leader_election.cc:304] T 3d65025eea89441290d85dd053810e31 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:19:02.852475  7498 raft_consensus.cc:1240] T fe20b4b48823486ca3b9c648db6ce8aa P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 2 FOLLOWER]: Rejecting Update request from peer ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 1. Current term is 2. Ops: []
I20260709 13:19:02.837009  8790 raft_consensus.cc:493] T c4db81d9d329422bb3b4160ca4ac2d1d P ccd8a4c3bfe3413cb2ae219b09aea832 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:02.862820  6628 catalog_manager.cc:5697] T f03d0dbf16864ca4bc1bb5e4c0334c0f P cd75a17ab2604397adab03bb8b5fd75c reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } }
I20260709 13:19:02.859967  7495 rpcz_store.cc:276] 0709 13:19:01.377292 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:01.377701 (+   409us) service_pool.cc:224] Handling call
0709 13:19:02.775577 (+1397876us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:02.866209  8763 raft_consensus.cc:740] T 7c44c4849aa54f2b94d1f1bef9ed546f P b7ab4784c7344b939bc36f639286f377 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
I20260709 13:19:02.875784  8347 leader_election.cc:290] T d33d5ee8ef6f415593d8df52063161ad P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 6 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:02.836922  8792 raft_consensus.cc:493] T 95a75bfe094d4bdc963aba3f08dfcd25 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:02.877447  7499 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50742 (request call id 270) took 1209 ms. Trace:
I20260709 13:19:02.839040  8805 raft_consensus.cc:493] T 17587d6730594da4a56fa13a353232a1 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:02.869263  7468 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:02.869585  6725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe20b4b48823486ca3b9c648db6ce8aa" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:19:02.860862  8100 raft_consensus.cc:2804] T de3186201e1a40d0b335eeb8b4e256e0 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:19:02.860662  8673 raft_consensus.cc:2804] T 7887766dc6784fcaa42b35c05fea7a99 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:19:02.868875  6801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce4f062dcd314d43a63ca74067cb5ee3" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:19:02.893187  6801 raft_consensus.cc:2468] T ce4f062dcd314d43a63ca74067cb5ee3 P b7ab4784c7344b939bc36f639286f377 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in term 5.
I20260709 13:19:02.881816  6726 raft_consensus.cc:1240] T a1704639a875409b9959353527b3fd68 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 5 LEADER]: Rejecting Update request from peer cd75a17ab2604397adab03bb8b5fd75c for earlier term 4. Current term is 5. Ops: []
I20260709 13:19:02.895253  6727 raft_consensus.cc:1240] T b56bf91d90824c959e21e0cee5ba1816 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 5 FOLLOWER]: Rejecting Update request from peer cd75a17ab2604397adab03bb8b5fd75c for earlier term 4. Current term is 5. Ops: []
I20260709 13:19:02.884717  6724 raft_consensus.cc:2468] T 7c44c4849aa54f2b94d1f1bef9ed546f P ccd8a4c3bfe3413cb2ae219b09aea832 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 6.
I20260709 13:19:02.839599  8691 raft_consensus.cc:515] T b3f13b31a1f84f0d89d007eadd57924c P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:19:02.898612  6772 leader_election.cc:304] T 4f00a2e87e56452083b759f60d461ee3 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb
I20260709 13:19:02.898939  6697 leader_election.cc:304] T 22ccee1b570c4ad3a57bd7aec085b1b4 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:19:02.901860  6772 leader_election.cc:304] T 3411566abe2d4c9bb4b2adfdd05e6f17 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:19:02.903424  6770 leader_election.cc:304] T ce4f062dcd314d43a63ca74067cb5ee3 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, ccd8a4c3bfe3413cb2ae219b09aea832
W20260709 13:19:02.906673  8835 log.cc:927] Time spent T 1528ab62b6fe4e3099d08f141afee116 P ccd8a4c3bfe3413cb2ae219b09aea832: Append to log took a long time: real 0.092s	user 0.001s	sys 0.000s
I20260709 13:19:02.906893  8574 leader_election.cc:290] T 4275cf08e63345f993bce8664eada830 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 5 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:02.858276  8779 raft_consensus.cc:515] T f3f9c2e2bf644115957398fe4c9459db P cd75a17ab2604397adab03bb8b5fd75c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
W20260709 13:19:02.895143  7468 leader_election.cc:336] T 1528ab62b6fe4e3099d08f141afee116 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931): Timed out: RequestConsensusVote RPC to 127.5.126.67:42931 timed out after 2.104s (SENT)
W20260709 13:19:02.892763  8690 consensus_meta.cc:287] T ab432e62819d499eaaf3dd55481dd930 P b7ab4784c7344b939bc36f639286f377: Time spent flushing consensus metadata: real 1.288s	user 0.014s	sys 0.015s
I20260709 13:19:02.878144  7499 rpcz_store.cc:276] 0709 13:19:01.625375 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:01.657012 (+ 31637us) service_pool.cc:224] Handling call
0709 13:19:01.669302 (+ 12290us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:01.669643 (+   341us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:19:02.171684 (+502041us) log.cc:844] Serialized 14 byte log entry
0709 13:19:02.775095 (+603411us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:02.784496 (+  9401us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:19:02.804682 (+ 20186us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:02.810153 (+  5471us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:02.835149 (+ 24996us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1786,"prepare.queue_time_us":816488,"prepare.run_cpu_time_us":52,"prepare.run_wall_time_us":53,"raft.queue_time_us":71795,"raft.run_cpu_time_us":112,"raft.run_wall_time_us":1777,"thread_start_us":844382,"threads_started":2,"wal-append.queue_time_us":617656}
I20260709 13:19:02.873631  8823 raft_consensus.cc:697] T 95a75bfe094d4bdc963aba3f08dfcd25 P b7ab4784c7344b939bc36f639286f377 [term 6 LEADER]: Becoming Leader. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
I20260709 13:19:02.915073  6879 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53416 (request call id 2102) took 1313 ms. Trace:
I20260709 13:19:02.898097  8673 raft_consensus.cc:493] T 7887766dc6784fcaa42b35c05fea7a99 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:02.938210  6770 leader_election.cc:304] T a3022224cc81473690653a83d4e99470 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
I20260709 13:19:02.922952  6772 leader_election.cc:304] T 90d42e216d9741e190bca19a781291fd P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:19:02.913403  8440 consensus_queue.cc:1048] T f5be3a11b23d4ea9b08300a2789821c7 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.016s
I20260709 13:19:02.916796  8347 raft_consensus.cc:2804] T 4f00a2e87e56452083b759f60d461ee3 P b7ab4784c7344b939bc36f639286f377 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:19:02.929927  6879 rpcz_store.cc:276] 0709 13:19:01.601626 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:01.602676 (+  1050us) service_pool.cc:224] Handling call
0709 13:19:01.613838 (+ 11162us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:01.627705 (+ 13867us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:01.627738 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:01.651063 (+ 23325us) log.cc:844] Serialized 26 byte log entry
0709 13:19:02.135390 (+484327us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:19:02.135446 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:02.135528 (+    82us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:02.726280 (+590752us) spinlock_profiling.cc:243] Waited 13.7 ms on lock 0x7b4400022b4c. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0c745db1 00007fcc0c7e3c85 00007fcc0c7e46a2 00007fcc0f5561db 00007fcc0f551aaf 00007fcc0f54586e 00007fcc0f544bb6 00007fcc0f5447d8 00007fcc0f54e221 00007fcc0f54e1d9 00007fcc0f54e169
0709 13:19:02.892498 (+166218us) raft_consensus.cc:1685] finished
0709 13:19:02.892524 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:02.914984 (+ 22460us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":9972,"raft.run_cpu_time_us":143,"raft.run_wall_time_us":7775,"spinlock_wait_cycles":31616384,"thread_start_us":383547,"threads_started":1,"wal-append.queue_time_us":483227}
I20260709 13:19:02.947362  6846 leader_election.cc:304] T fe20b4b48823486ca3b9c648db6ce8aa P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:19:02.909194  8445 raft_consensus.cc:2804] T 3d65025eea89441290d85dd053810e31 P b7ab4784c7344b939bc36f639286f377 [term 4 FOLLOWER]: Leader election won for term 4
W20260709 13:19:02.948704  6696 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:02.914158  8760 leader_election.cc:290] T f5be3a11b23d4ea9b08300a2789821c7 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
W20260709 13:19:02.943136  8797 consensus_meta.cc:287] T 9e326172347f45e99a0d482b5d8ef768 P ccd8a4c3bfe3413cb2ae219b09aea832: Time spent flushing consensus metadata: real 1.298s	user 0.027s	sys 0.040s
I20260709 13:19:02.886292  8790 raft_consensus.cc:515] T c4db81d9d329422bb3b4160ca4ac2d1d P ccd8a4c3bfe3413cb2ae219b09aea832 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:02.958801  6772 leader_election.cc:304] T f3f9c2e2bf644115957398fe4c9459db P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:19:02.961385  6846 leader_election.cc:304] T 4b8cacb381b746da8d0049b0a83b41dd P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:19:02.976215  6770 leader_election.cc:304] T 7887766dc6784fcaa42b35c05fea7a99 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
I20260709 13:19:02.922894  8446 raft_consensus.cc:3060] T ce4f062dcd314d43a63ca74067cb5ee3 P b7ab4784c7344b939bc36f639286f377 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:02.957669  6872 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53416 (request call id 2107) took 1158 ms. Trace:
I20260709 13:19:02.892560  8792 raft_consensus.cc:515] T 95a75bfe094d4bdc963aba3f08dfcd25 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:02.944885  8673 raft_consensus.cc:3060] T 7887766dc6784fcaa42b35c05fea7a99 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:19:02.913939  8832 consensus_queue.cc:1048] T 34f36d59d88f40fe8a2805e604fc6c0a P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.043s
I20260709 13:19:02.935638  8834 raft_consensus.cc:3060] T 3411566abe2d4c9bb4b2adfdd05e6f17 P b7ab4784c7344b939bc36f639286f377 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:19:02.994887  7468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 99777.8us
I20260709 13:19:02.905010  8805 raft_consensus.cc:515] T 17587d6730594da4a56fa13a353232a1 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:19:02.953564  8791 leader_election.cc:290] T 34f36d59d88f40fe8a2805e604fc6c0a P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:02.975288  8711 raft_consensus.cc:2804] T a3022224cc81473690653a83d4e99470 P b7ab4784c7344b939bc36f639286f377 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:19:02.995991  6872 rpcz_store.cc:276] 0709 13:19:01.798965 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:01.897448 (+ 98483us) service_pool.cc:224] Handling call
0709 13:19:02.125945 (+228497us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:02.837974 (+712029us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:02.957386 (+119412us) spinlock_profiling.cc:243] Waited 562 ms on lock 0x7b540042ac54. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f9aae01 00007fcc0f9a983e 00007fcc1496e419 00007fcc0dee5bd4 00007fcc0dee5b62 00007fcc0dee5a91 00007fcc0dee5a0c 00007fcc0dee4cc2 00007fcc0dce548c 00007fcc0dce48c6
0709 13:19:02.957595 (+   209us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1292777344}
W20260709 13:19:03.004338  7468 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:03.005544  6696 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:02.929096  8690 raft_consensus.cc:515] T ab432e62819d499eaaf3dd55481dd930 P b7ab4784c7344b939bc36f639286f377 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
W20260709 13:19:03.021281  6847 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:02.998610  7467 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:02.982638  8347 raft_consensus.cc:697] T 4f00a2e87e56452083b759f60d461ee3 P b7ab4784c7344b939bc36f639286f377 [term 5 LEADER]: Becoming Leader. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
I20260709 13:19:02.985412  8760 raft_consensus.cc:493] T d33d5ee8ef6f415593d8df52063161ad P cd75a17ab2604397adab03bb8b5fd75c [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:19:02.976475  8763 consensus_queue.cc:260] T 7c44c4849aa54f2b94d1f1bef9ed546f P b7ab4784c7344b939bc36f639286f377 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:03.029518  8777 leader_election.cc:290] T 9b3759de40694069b13c0f8bd40e5709 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:03.033311  8849 raft_consensus.cc:493] T 4f00a2e87e56452083b759f60d461ee3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:03.030282  8711 raft_consensus.cc:493] T a3022224cc81473690653a83d4e99470 P b7ab4784c7344b939bc36f639286f377 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:03.030066  8808 consensus_queue.cc:1048] T 34f36d59d88f40fe8a2805e604fc6c0a P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.037s
W20260709 13:19:03.048439  6770 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 72290us
I20260709 13:19:03.033469  8845 raft_consensus.cc:2804] T fe20b4b48823486ca3b9c648db6ce8aa P cd75a17ab2604397adab03bb8b5fd75c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:19:03.054643  6723 raft_consensus.cc:2468] T 07a92dd554674067a83a9cb68c4773f2 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 4.
W20260709 13:19:03.041033  8833 log.cc:927] Time spent T 3fa34c08b205435dba97346991aa1f92 P cd75a17ab2604397adab03bb8b5fd75c: Append to log took a long time: real 0.161s	user 0.000s	sys 0.002s
I20260709 13:19:02.994623  8797 raft_consensus.cc:515] T 9e326172347f45e99a0d482b5d8ef768 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
W20260709 13:19:03.031736  8744 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.131s	user 0.016s	sys 0.009s
W20260709 13:19:03.051563  7466 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 134598us
I20260709 13:19:03.034360  8825 raft_consensus.cc:2804] T 7887766dc6784fcaa42b35c05fea7a99 P b7ab4784c7344b939bc36f639286f377 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:19:03.079984  8744 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.181s	user 0.017s	sys 0.010s
I20260709 13:19:03.080205  8825 raft_consensus.cc:493] T 7887766dc6784fcaa42b35c05fea7a99 P b7ab4784c7344b939bc36f639286f377 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:03.080634  8825 raft_consensus.cc:3060] T 7887766dc6784fcaa42b35c05fea7a99 P b7ab4784c7344b939bc36f639286f377 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:19:03.081892  6770 leader_election.cc:304] T 17587d6730594da4a56fa13a353232a1 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb
W20260709 13:19:03.057572  6772 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 98900.4us
I20260709 13:19:03.096873  6872 raft_consensus.cc:1275] T 30e88460611e47b2ba16a46a30b5f416 P cd75a17ab2604397adab03bb8b5fd75c [term 4 FOLLOWER]: Refusing update from remote peer b7ab4784c7344b939bc36f639286f377: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:19:03.038619  8757 leader_election.cc:290] T 853ac0a8cbd64ce99457f170216d4d0f P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:19:03.099046  8757 raft_consensus.cc:493] T a1704639a875409b9959353527b3fd68 P cd75a17ab2604397adab03bb8b5fd75c [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:03.099709  8757 raft_consensus.cc:515] T a1704639a875409b9959353527b3fd68 P cd75a17ab2604397adab03bb8b5fd75c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:03.102576  8757 leader_election.cc:290] T a1704639a875409b9959353527b3fd68 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:19:03.036844  8830 raft_consensus.cc:2749] T f3f9c2e2bf644115957398fe4c9459db P b7ab4784c7344b939bc36f639286f377 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:19:03.103789  8830 consensus_queue.cc:1048] T dbdf895bba214ff68685a24fd17dfb5d P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:19:03.105963  8830 raft_consensus.cc:2804] T 17587d6730594da4a56fa13a353232a1 P b7ab4784c7344b939bc36f639286f377 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:19:03.106594  8830 raft_consensus.cc:697] T 17587d6730594da4a56fa13a353232a1 P b7ab4784c7344b939bc36f639286f377 [term 7 LEADER]: Becoming Leader. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
I20260709 13:19:03.107861  8830 consensus_queue.cc:237] T 17587d6730594da4a56fa13a353232a1 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:19:03.054613  8773 leader_election.cc:290] T 7c37d41cd9164c15a6826ca62a851a69 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:19:03.056672  8711 raft_consensus.cc:3060] T a3022224cc81473690653a83d4e99470 P b7ab4784c7344b939bc36f639286f377 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:03.127511  6872 raft_consensus.cc:1275] T dbdf895bba214ff68685a24fd17dfb5d P cd75a17ab2604397adab03bb8b5fd75c [term 6 FOLLOWER]: Refusing update from remote peer b7ab4784c7344b939bc36f639286f377: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 6 index: 3. (index mismatch)
I20260709 13:19:03.060448  8852 raft_consensus.cc:2804] T 4b8cacb381b746da8d0049b0a83b41dd P cd75a17ab2604397adab03bb8b5fd75c [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:19:03.142930  6877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "427c124d773f483294511e80fe340075" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:19:03.143868  6873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb7fa124c3bf4ef9ab65a407cb008441" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:19:03.112536  8845 raft_consensus.cc:697] T fe20b4b48823486ca3b9c648db6ce8aa P cd75a17ab2604397adab03bb8b5fd75c [term 2 LEADER]: Becoming Leader. State: Replica: cd75a17ab2604397adab03bb8b5fd75c, State: Running, Role: LEADER
I20260709 13:19:03.054270  8760 raft_consensus.cc:515] T d33d5ee8ef6f415593d8df52063161ad P cd75a17ab2604397adab03bb8b5fd75c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:03.156332  6874 raft_consensus.cc:1240] T 7a734b5ab7834e05a8c422208acc58b1 P cd75a17ab2604397adab03bb8b5fd75c [term 5 FOLLOWER]: Rejecting Update request from peer b7ab4784c7344b939bc36f639286f377 for earlier term 4. Current term is 5. Ops: []
I20260709 13:19:03.157262  6876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "711ef6523deb4cbe8ef2ba61e1c21c98" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:19:03.126140  8763 raft_consensus.cc:3060] T 7c44c4849aa54f2b94d1f1bef9ed546f P b7ab4784c7344b939bc36f639286f377 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:03.158154  6876 raft_consensus.cc:2410] T 711ef6523deb4cbe8ef2ba61e1c21c98 P cd75a17ab2604397adab03bb8b5fd75c [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7ab4784c7344b939bc36f639286f377 for term 6 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:19:03.161219  6877 raft_consensus.cc:3060] T 427c124d773f483294511e80fe340075 P cd75a17ab2604397adab03bb8b5fd75c [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:19:03.170992  6801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a92dd554674067a83a9cb68c4773f2" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:19:03.222180  6801 raft_consensus.cc:2393] T 07a92dd554674067a83a9cb68c4773f2 P b7ab4784c7344b939bc36f639286f377 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c in current term 4: Already voted for candidate b7ab4784c7344b939bc36f639286f377 in this term.
I20260709 13:19:03.222375  6872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d33d5ee8ef6f415593d8df52063161ad" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
W20260709 13:19:03.223577  7466 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 138676us
I20260709 13:19:03.224450  6873 raft_consensus.cc:3060] T bb7fa124c3bf4ef9ab65a407cb008441 P cd75a17ab2604397adab03bb8b5fd75c [term 4 FOLLOWER]: Advancing to term 6
I20260709 13:19:03.141300  8773 raft_consensus.cc:493] T c4db81d9d329422bb3b4160ca4ac2d1d P cd75a17ab2604397adab03bb8b5fd75c [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:19:03.226398  6872 raft_consensus.cc:3060] T d33d5ee8ef6f415593d8df52063161ad P cd75a17ab2604397adab03bb8b5fd75c [term 4 FOLLOWER]: Advancing to term 6
I20260709 13:19:03.228108  6803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20f6842e26174571996b8dea4151d4be" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:19:03.227294  6801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de3186201e1a40d0b335eeb8b4e256e0" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:19:03.229071  6801 raft_consensus.cc:2393] T de3186201e1a40d0b335eeb8b4e256e0 P b7ab4784c7344b939bc36f639286f377 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c in current term 5: Already voted for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in this term.
W20260709 13:19:03.164657  6844 connection.cc:256] RPC call timeout handler was delayed by -2.9266570909999245s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17300000000000001s for a response
I20260709 13:19:03.167274  8852 raft_consensus.cc:697] T 4b8cacb381b746da8d0049b0a83b41dd P cd75a17ab2604397adab03bb8b5fd75c [term 6 LEADER]: Becoming Leader. State: Replica: cd75a17ab2604397adab03bb8b5fd75c, State: Running, Role: LEADER
I20260709 13:19:03.156394  8574 raft_consensus.cc:2804] T 90d42e216d9741e190bca19a781291fd P b7ab4784c7344b939bc36f639286f377 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:19:03.140085  8794 raft_consensus.cc:697] T 427c124d773f483294511e80fe340075 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 5 LEADER]: Becoming Leader. State: Replica: 7ba59cc884714e8aa5f3f0ecaed84cbb, State: Running, Role: LEADER
I20260709 13:19:03.062059  8849 raft_consensus.cc:515] T 4f00a2e87e56452083b759f60d461ee3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
W20260709 13:19:03.247764  6844 connection.cc:256] RPC call timeout handler was delayed by -2.7024790939999548s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1542s for a response
W20260709 13:19:03.251616  6844 connection.cc:256] RPC call timeout handler was delayed by -2.6801984369999445s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2068s for a response
I20260709 13:19:03.168888  8691 leader_election.cc:290] T b3f13b31a1f84f0d89d007eadd57924c P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
W20260709 13:19:03.251996  6844 connection.cc:256] RPC call timeout handler was delayed by -2.6403790939998544s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16110000000000002s for a response
W20260709 13:19:03.254583  6844 connection.cc:256] RPC call timeout handler was delayed by -2.6286790939998355s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16240000000000002s for a response
I20260709 13:19:03.248991  6806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8292e16e5654be6bc408560cf256aaa" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:19:03.255779  6806 raft_consensus.cc:2410] T d8292e16e5654be6bc408560cf256aaa P b7ab4784c7344b939bc36f639286f377 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c for term 6 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:19:03.196867  8445 raft_consensus.cc:697] T 3d65025eea89441290d85dd053810e31 P b7ab4784c7344b939bc36f639286f377 [term 4 LEADER]: Becoming Leader. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
I20260709 13:19:03.256763  6874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a92dd554674067a83a9cb68c4773f2" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:19:03.259949  7499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "404190ce4ce94cecbfcb6ea9d1dd8626" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb"
I20260709 13:19:03.260617  6806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3f13b31a1f84f0d89d007eadd57924c" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:19:03.260803  7499 raft_consensus.cc:3060] T 404190ce4ce94cecbfcb6ea9d1dd8626 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:03.261961  6806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24ee15416e3145beaa1b8183453729a3" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:19:03.262569  6806 raft_consensus.cc:2468] T 24ee15416e3145beaa1b8183453729a3 P b7ab4784c7344b939bc36f639286f377 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 4.
I20260709 13:19:03.198508  8829 leader_election.cc:290] T be1a92657f494cac8dd227d152f50151 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:19:03.267216  7500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb7fa124c3bf4ef9ab65a407cb008441" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb"
I20260709 13:19:03.271056  7500 raft_consensus.cc:2393] T bb7fa124c3bf4ef9ab65a407cb008441 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate b7ab4784c7344b939bc36f639286f377 in current term 6: Already voted for candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in this term.
I20260709 13:19:03.268509  7497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be1a92657f494cac8dd227d152f50151" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:19:03.247008  8773 raft_consensus.cc:515] T c4db81d9d329422bb3b4160ca4ac2d1d P cd75a17ab2604397adab03bb8b5fd75c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:03.282227  6874 raft_consensus.cc:2468] T 07a92dd554674067a83a9cb68c4773f2 P cd75a17ab2604397adab03bb8b5fd75c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 4.
I20260709 13:19:03.283442  6874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4275cf08e63345f993bce8664eada830" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:19:03.280026  6873 raft_consensus.cc:2468] T bb7fa124c3bf4ef9ab65a407cb008441 P cd75a17ab2604397adab03bb8b5fd75c [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 6.
I20260709 13:19:03.285732  6873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44bde925b2e541b69890d70715b85176" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:19:03.287891  6873 raft_consensus.cc:2468] T 44bde925b2e541b69890d70715b85176 P cd75a17ab2604397adab03bb8b5fd75c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 5.
I20260709 13:19:03.289085  6803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "427c124d773f483294511e80fe340075" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:19:03.290422  6728 raft_consensus.cc:2468] T 404190ce4ce94cecbfcb6ea9d1dd8626 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 6.
I20260709 13:19:03.109967  8823 consensus_queue.cc:237] T 95a75bfe094d4bdc963aba3f08dfcd25 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:03.282867  8773 leader_election.cc:290] T c4db81d9d329422bb3b4160ca4ac2d1d P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:19:03.296054  7501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "427c124d773f483294511e80fe340075" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb"
I20260709 13:19:03.301222  6803 raft_consensus.cc:2368] T 427c124d773f483294511e80fe340075 P b7ab4784c7344b939bc36f639286f377 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c for earlier term 4. Current term is 5.
I20260709 13:19:03.167057  8757 raft_consensus.cc:493] T bd6869f07b5a4885a0b99fbe60c3b175 P cd75a17ab2604397adab03bb8b5fd75c [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:19:03.233049  8779 leader_election.cc:290] T f3f9c2e2bf644115957398fe4c9459db P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
W20260709 13:19:03.289449  8727 consensus_meta.cc:287] T 3a485a995abc4807b6e511e45419f737 P b7ab4784c7344b939bc36f639286f377: Time spent flushing consensus metadata: real 1.137s	user 0.015s	sys 0.000s
W20260709 13:19:03.317085  7468 leader_election.cc:336] T 3fa34c08b205435dba97346991aa1f92 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931): Timed out: RequestConsensusVote RPC to 127.5.126.67:42931 timed out after 1.540s (SENT)
I20260709 13:19:03.317761  7468 leader_election.cc:304] T 3fa34c08b205435dba97346991aa1f92 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:19:03.284492  8790 leader_election.cc:290] T c4db81d9d329422bb3b4160ca4ac2d1d P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:03.199364  8825 raft_consensus.cc:515] T 7887766dc6784fcaa42b35c05fea7a99 P b7ab4784c7344b939bc36f639286f377 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:03.323988  6805 raft_consensus.cc:2468] T 3a485a995abc4807b6e511e45419f737 P b7ab4784c7344b939bc36f639286f377 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 4.
I20260709 13:19:03.322892  6799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a92dd554674067a83a9cb68c4773f2" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:19:03.331192  6799 raft_consensus.cc:2393] T 07a92dd554674067a83a9cb68c4773f2 P b7ab4784c7344b939bc36f639286f377 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c in current term 4: Already voted for candidate b7ab4784c7344b939bc36f639286f377 in this term.
I20260709 13:19:03.328128  6803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d9def8b32fd443aa94ab1420b06837b" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
W20260709 13:19:03.327280  7468 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.5.126.67:42931 timed out after 1.645s (SENT) [suppressed 12 similar messages]
I20260709 13:19:03.303567  8757 raft_consensus.cc:515] T bd6869f07b5a4885a0b99fbe60c3b175 P cd75a17ab2604397adab03bb8b5fd75c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
W20260709 13:19:03.340480  8844 log.cc:927] Time spent T f03d0dbf16864ca4bc1bb5e4c0334c0f P ccd8a4c3bfe3413cb2ae219b09aea832: Append to log took a long time: real 0.323s	user 0.001s	sys 0.001s
W20260709 13:19:03.341446  8839 log.cc:927] Time spent T 3fa34c08b205435dba97346991aa1f92 P 7ba59cc884714e8aa5f3f0ecaed84cbb: Append to log took a long time: real 0.342s	user 0.000s	sys 0.002s
I20260709 13:19:03.335831  6801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d65025eea89441290d85dd053810e31" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:19:03.322700  8691 raft_consensus.cc:2749] T 3fa34c08b205435dba97346991aa1f92 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:19:03.321161  8792 leader_election.cc:290] T 95a75bfe094d4bdc963aba3f08dfcd25 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:03.323348  8690 leader_election.cc:290] T ab432e62819d499eaaf3dd55481dd930 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 6 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:03.346318  6877 raft_consensus.cc:2468] T 427c124d773f483294511e80fe340075 P cd75a17ab2604397adab03bb8b5fd75c [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 4.
I20260709 13:19:03.225220  8347 consensus_queue.cc:237] T 4f00a2e87e56452083b759f60d461ee3 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:19:03.341624  8849 leader_election.cc:290] T 4f00a2e87e56452083b759f60d461ee3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:03.352193  6799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3022224cc81473690653a83d4e99470" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:19:03.353065  6803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f00a2e87e56452083b759f60d461ee3" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:19:03.338050  8773 raft_consensus.cc:493] T 1bf4668eeb70467fb3dc5a0289233b3c P cd75a17ab2604397adab03bb8b5fd75c [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
W20260709 13:19:03.351773  8843 log.cc:927] Time spent T 7c37d41cd9164c15a6826ca62a851a69 P ccd8a4c3bfe3413cb2ae219b09aea832: Append to log took a long time: real 0.335s	user 0.000s	sys 0.001s
I20260709 13:19:03.350070  6801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c240553ce044eedb41541d72b9475d7" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
W20260709 13:19:03.355693  6697 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 456807us
I20260709 13:19:03.361478  6697 leader_election.cc:304] T f5be3a11b23d4ea9b08300a2789821c7 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:19:03.361363  8773 raft_consensus.cc:515] T 1bf4668eeb70467fb3dc5a0289233b3c P cd75a17ab2604397adab03bb8b5fd75c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:03.362166  8861 consensus_queue.cc:1048] T 30e88460611e47b2ba16a46a30b5f416 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.137s
I20260709 13:19:03.363471  8847 consensus_queue.cc:1048] T 1528ab62b6fe4e3099d08f141afee116 P 7ba59cc884714e8aa5f3f0ecaed84cbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 2, Time since last communication: 0.049s
I20260709 13:19:03.361757  8859 raft_consensus.cc:493] T ab432e62819d499eaaf3dd55481dd930 P cd75a17ab2604397adab03bb8b5fd75c [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:03.364522  8859 raft_consensus.cc:515] T ab432e62819d499eaaf3dd55481dd930 P cd75a17ab2604397adab03bb8b5fd75c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:03.365072  8862 raft_consensus.cc:493] T f4b8bd455d5a47c18a1380839c6e0d61 P b7ab4784c7344b939bc36f639286f377 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:03.367679  8842 log.cc:927] Time spent T f3f9c2e2bf644115957398fe4c9459db P ccd8a4c3bfe3413cb2ae219b09aea832: Append to log took a long time: real 0.411s	user 0.003s	sys 0.000s
I20260709 13:19:03.337371  8779 raft_consensus.cc:493] T e31b9971c15848dea59d4d4130141d9e P cd75a17ab2604397adab03bb8b5fd75c [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:19:03.369968  8779 raft_consensus.cc:515] T e31b9971c15848dea59d4d4130141d9e P cd75a17ab2604397adab03bb8b5fd75c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:03.373368  6801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44bde925b2e541b69890d70715b85176" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:19:03.374107  6801 raft_consensus.cc:2468] T 44bde925b2e541b69890d70715b85176 P b7ab4784c7344b939bc36f639286f377 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 5.
I20260709 13:19:03.375267  6801 raft_consensus.cc:1240] T 44bde925b2e541b69890d70715b85176 P b7ab4784c7344b939bc36f639286f377 [term 5 FOLLOWER]: Rejecting Update request from peer cd75a17ab2604397adab03bb8b5fd75c for earlier term 4. Current term is 5. Ops: []
I20260709 13:19:03.376703  6805 raft_consensus.cc:1240] T 4275cf08e63345f993bce8664eada830 P b7ab4784c7344b939bc36f639286f377 [term 5 FOLLOWER]: Rejecting Update request from peer cd75a17ab2604397adab03bb8b5fd75c for earlier term 4. Current term is 5. Ops: []
I20260709 13:19:03.376909  8850 raft_consensus.cc:493] T 7ba5dac66ab5497e9e336f2a3c28cda5 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
W20260709 13:19:03.377818  6698 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:03.377506  8850 raft_consensus.cc:515] T 7ba5dac66ab5497e9e336f2a3c28cda5 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:19:03.380005  8791 raft_consensus.cc:493] T 2c240553ce044eedb41541d72b9475d7 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:19:03.380795  8791 raft_consensus.cc:515] T 2c240553ce044eedb41541d72b9475d7 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:03.367422  8862 raft_consensus.cc:515] T f4b8bd455d5a47c18a1380839c6e0d61 P b7ab4784c7344b939bc36f639286f377 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:03.368674  8797 leader_election.cc:290] T 9e326172347f45e99a0d482b5d8ef768 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 5 election: Requested vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:03.383014  6723 raft_consensus.cc:1240] T 7c44c4849aa54f2b94d1f1bef9ed546f P ccd8a4c3bfe3413cb2ae219b09aea832 [term 6 FOLLOWER]: Rejecting Update request from peer b7ab4784c7344b939bc36f639286f377 for earlier term 5. Current term is 6. Ops: [3.3-5.4]
W20260709 13:19:03.384495  6696 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:03.386866  6724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "711ef6523deb4cbe8ef2ba61e1c21c98" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:19:03.397692  6803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a485a995abc4807b6e511e45419f737" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:19:03.398599  6724 raft_consensus.cc:2410] T 711ef6523deb4cbe8ef2ba61e1c21c98 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7ab4784c7344b939bc36f639286f377 for term 6 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:19:03.390677  6872 raft_consensus.cc:2468] T d33d5ee8ef6f415593d8df52063161ad P cd75a17ab2604397adab03bb8b5fd75c [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 6.
I20260709 13:19:03.391602  6801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8cee0accdb8499c86d4414b72565a38" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
W20260709 13:19:03.410971  6695 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:03.415318  6725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b56bf91d90824c959e21e0cee5ba1816" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:19:03.416937  6726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a92dd554674067a83a9cb68c4773f2" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:19:03.418882  6725 raft_consensus.cc:2393] T b56bf91d90824c959e21e0cee5ba1816 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7ab4784c7344b939bc36f639286f377 in current term 5: Already voted for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in this term.
I20260709 13:19:03.410970  6723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d33d5ee8ef6f415593d8df52063161ad" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:19:03.419946  6723 raft_consensus.cc:3060] T d33d5ee8ef6f415593d8df52063161ad P ccd8a4c3bfe3413cb2ae219b09aea832 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:03.334120  8845 consensus_queue.cc:237] T fe20b4b48823486ca3b9c648db6ce8aa P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
W20260709 13:19:03.422302  8806 consensus_meta.cc:287] T e31b9971c15848dea59d4d4130141d9e P b7ab4784c7344b939bc36f639286f377: Time spent flushing consensus metadata: real 1.649s	user 0.022s	sys 0.007s
I20260709 13:19:03.422974  6727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4275cf08e63345f993bce8664eada830" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:19:03.391629  8760 leader_election.cc:290] T d33d5ee8ef6f415593d8df52063161ad P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:19:03.424256  8760 raft_consensus.cc:493] T ce4f062dcd314d43a63ca74067cb5ee3 P cd75a17ab2604397adab03bb8b5fd75c [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:03.424448  6729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be1a92657f494cac8dd227d152f50151" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:19:03.404311  8445 consensus_queue.cc:237] T 3d65025eea89441290d85dd053810e31 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:03.425130  6729 raft_consensus.cc:2468] T be1a92657f494cac8dd227d152f50151 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 5.
I20260709 13:19:03.424857  8760 raft_consensus.cc:515] T ce4f062dcd314d43a63ca74067cb5ee3 P cd75a17ab2604397adab03bb8b5fd75c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } attrs { replace: true } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:19:03.426141  6729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44bde925b2e541b69890d70715b85176" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:19:03.426839  6729 raft_consensus.cc:2468] T 44bde925b2e541b69890d70715b85176 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 5.
I20260709 13:19:03.422747  8806 raft_consensus.cc:515] T e31b9971c15848dea59d4d4130141d9e P b7ab4784c7344b939bc36f639286f377 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:03.428310  6732 raft_consensus.cc:1240] T 3a485a995abc4807b6e511e45419f737 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 4 FOLLOWER]: Rejecting Update request from peer b7ab4784c7344b939bc36f639286f377 for earlier term 3. Current term is 4. Ops: []
I20260709 13:19:03.417753  6726 raft_consensus.cc:2468] T 07a92dd554674067a83a9cb68c4773f2 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 4.
I20260709 13:19:03.396642  8793 raft_consensus.cc:493] T 853ac0a8cbd64ce99457f170216d4d0f P ccd8a4c3bfe3413cb2ae219b09aea832 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:19:03.396734  8768 raft_consensus.cc:493] T 24ee15416e3145beaa1b8183453729a3 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 7ba59cc884714e8aa5f3f0ecaed84cbb)
I20260709 13:19:03.451152  6801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c44c4849aa54f2b94d1f1bef9ed546f" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:19:03.485638  6805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "711ef6523deb4cbe8ef2ba61e1c21c98" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:19:03.511888  6805 raft_consensus.cc:2468] T 711ef6523deb4cbe8ef2ba61e1c21c98 P b7ab4784c7344b939bc36f639286f377 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 5.
W20260709 13:19:03.512634  6696 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:03.513787  6805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a734b5ab7834e05a8c422208acc58b1" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
W20260709 13:19:03.486956  8846 log.cc:927] Time spent T 1528ab62b6fe4e3099d08f141afee116 P 7ba59cc884714e8aa5f3f0ecaed84cbb: Append to log took a long time: real 0.452s	user 0.000s	sys 0.003s
W20260709 13:19:03.525873  6697 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 164482us
I20260709 13:19:03.503017  6798 raft_consensus.cc:1240] T e31b9971c15848dea59d4d4130141d9e P b7ab4784c7344b939bc36f639286f377 [term 4 FOLLOWER]: Rejecting Update request from peer ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 3. Current term is 4. Ops: []
I20260709 13:19:03.546212  6723 raft_consensus.cc:2468] T d33d5ee8ef6f415593d8df52063161ad P ccd8a4c3bfe3413cb2ae219b09aea832 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 6.
I20260709 13:19:03.426715  8829 raft_consensus.cc:493] T f58dc08b12a2494bb9a1372837970ca2 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:03.519675  7467 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:03.533283  6724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3f13b31a1f84f0d89d007eadd57924c" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:19:03.534842  6697 leader_election.cc:304] T 3411566abe2d4c9bb4b2adfdd05e6f17 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:19:03.349596  8794 consensus_queue.cc:237] T 427c124d773f483294511e80fe340075 P 7ba59cc884714e8aa5f3f0ecaed84cbb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.4, Last appended by leader: 4, Current term: 5, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } attrs { replace: true } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
W20260709 13:19:03.492951  6844 connection.cc:256] RPC call timeout handler was delayed by -2.5260790939998969s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1738s for a response
I20260709 13:19:03.554396  6732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab432e62819d499eaaf3dd55481dd930" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:19:03.559661  6732 raft_consensus.cc:3060] T ab432e62819d499eaaf3dd55481dd930 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:03.560309  6697 leader_election.cc:304] T 1bf4668eeb70467fb3dc5a0289233b3c P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:19:03.451202  8765 raft_consensus.cc:2749] T f5be3a11b23d4ea9b08300a2789821c7 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:19:03.446544  8100 raft_consensus.cc:697] T de3186201e1a40d0b335eeb8b4e256e0 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 5 LEADER]: Becoming Leader. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
I20260709 13:19:03.446020  8792 raft_consensus.cc:493] T f4b8bd455d5a47c18a1380839c6e0d61 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:03.476680  7496 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50742 (request call id 271) took 1843 ms (client timeout 1895 ms). Trace:
I20260709 13:19:03.565150  7466 leader_election.cc:304] T b3f13b31a1f84f0d89d007eadd57924c P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
W20260709 13:19:03.566008  6844 connection.cc:256] RPC call timeout handler was delayed by -2.4630790940000225s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18080000000000002s for a response
I20260709 13:19:03.452534  8841 raft_consensus.cc:2749] T 22ccee1b570c4ad3a57bd7aec085b1b4 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:19:03.359865  8852 consensus_queue.cc:237] T 4b8cacb381b746da8d0049b0a83b41dd P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
W20260709 13:19:03.569617  6846 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:03.572614  6844 connection.cc:256] RPC call timeout handler was delayed by -2.4576790940000137s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1814s for a response
W20260709 13:19:03.575317  6844 connection.cc:256] RPC call timeout handler was delayed by -2.3496790939998391s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19340000000000002s for a response
W20260709 13:19:03.575656  6846 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:03.561923  8767 raft_consensus.cc:2749] T 3411566abe2d4c9bb4b2adfdd05e6f17 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260709 13:19:03.580407  6844 connection.cc:256] RPC call timeout handler was delayed by -2.3406790939998245s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19440000000000002s for a response
W20260709 13:19:03.580935  6844 connection.cc:256] RPC call timeout handler was delayed by -2.238079093999886s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20579999999999998s for a response
W20260709 13:19:03.581231  6844 connection.cc:256] RPC call timeout handler was delayed by -2.1525790939999752s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21530000000000002s for a response
W20260709 13:19:03.581490  6844 connection.cc:256] RPC call timeout handler was delayed by -2.11837909399992s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2191s for a response
W20260709 13:19:03.581938  6844 connection.cc:256] RPC call timeout handler was delayed by -1.7263978890000544s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1892s for a response
W20260709 13:19:03.582242  6844 connection.cc:256] RPC call timeout handler was delayed by -1.5607268510000267s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15660000000000002s for a response
W20260709 13:19:03.582499  6844 connection.cc:256] RPC call timeout handler was delayed by -1.4896978890001265s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2155s for a response
W20260709 13:19:03.582743  6844 connection.cc:256] RPC call timeout handler was delayed by -1.3870268509999732s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1759s for a response
W20260709 13:19:03.583001  6844 connection.cc:256] RPC call timeout handler was delayed by -1.2574268509999911s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19030000000000002s for a response
I20260709 13:19:03.548302  8793 raft_consensus.cc:515] T 853ac0a8cbd64ce99457f170216d4d0f P ccd8a4c3bfe3413cb2ae219b09aea832 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
W20260709 13:19:03.586387  7468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 259120us
I20260709 13:19:03.586956  6732 raft_consensus.cc:2468] T ab432e62819d499eaaf3dd55481dd930 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 6.
W20260709 13:19:03.587164  7468 leader_election.cc:336] T d8cee0accdb8499c86d4414b72565a38 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931): Timed out: RequestConsensusVote RPC to 127.5.126.67:42931 timed out after 1.917s (SENT)
I20260709 13:19:03.587613  7468 leader_election.cc:304] T d8cee0accdb8499c86d4414b72565a38 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:19:03.569679  8850 leader_election.cc:290] T 7ba5dac66ab5497e9e336f2a3c28cda5 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:03.557395  8829 raft_consensus.cc:515] T f58dc08b12a2494bb9a1372837970ca2 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:03.574344  8534 raft_consensus.cc:2749] T b3f13b31a1f84f0d89d007eadd57924c P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:19:03.565402  8257 consensus_queue.cc:1059] T fe20b4b48823486ca3b9c648db6ce8aa P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.022s
I20260709 13:19:03.605260  8257 raft_consensus.cc:3055] T fe20b4b48823486ca3b9c648db6ce8aa P ccd8a4c3bfe3413cb2ae219b09aea832 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:19:03.605835  8257 raft_consensus.cc:740] T fe20b4b48823486ca3b9c648db6ce8aa P ccd8a4c3bfe3413cb2ae219b09aea832 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
I20260709 13:19:03.609345  8806 leader_election.cc:290] T e31b9971c15848dea59d4d4130141d9e P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 4 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:03.561514  8768 raft_consensus.cc:515] T 24ee15416e3145beaa1b8183453729a3 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } attrs { replace: true } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:19:03.576843  8792 raft_consensus.cc:515] T f4b8bd455d5a47c18a1380839c6e0d61 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:03.596939  8826 raft_consensus.cc:2749] T d8cee0accdb8499c86d4414b72565a38 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:19:03.599944  8711 raft_consensus.cc:515] T a3022224cc81473690653a83d4e99470 P b7ab4784c7344b939bc36f639286f377 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
W20260709 13:19:03.574689  7496 rpcz_store.cc:269] 0709 13:19:01.634801 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:01.663799 (+ 28998us) service_pool.cc:224] Handling call
0709 13:19:03.426261 (+1762462us) spinlock_profiling.cc:243] Waited 33.4 ms on lock 0x7b5400496454. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f9ae2fa 00007fcc1496fb17 00007fcc0deea6d4 00007fcc0deea662 00007fcc0deea591 00007fcc0deea50c 00007fcc0dee97c2 00007fcc0dce548c 00007fcc0dce48c6 00007fcc0dce426f
0709 13:19:03.450743 (+ 24482us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":76932992}
I20260709 13:19:03.670086  8792 leader_election.cc:290] T f4b8bd455d5a47c18a1380839c6e0d61 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:03.672793  7498 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50742 (request call id 273) took 1959 ms. Trace:
I20260709 13:19:03.673563  7498 rpcz_store.cc:276] 0709 13:19:01.713023 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:01.780741 (+ 67718us) service_pool.cc:224] Handling call
0709 13:19:02.636904 (+856163us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:02.876445 (+239541us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:03.670648 (+794203us) spinlock_profiling.cc:243] Waited 139 ms on lock 0x7b5400538ed4. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f9aae01 00007fcc0f9a983e 00007fcc1496e419 00007fcc0dee5bd4 00007fcc0dee5b62 00007fcc0dee5a91 00007fcc0dee5a0c 00007fcc0dee4cc2 00007fcc0dce548c 00007fcc0dce48c6
0709 13:19:03.672361 (+  1713us) spinlock_profiling.cc:243] Waited 710 ms on lock 0x7b5400538ed0. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f9a98ad 00007fcc1496e419 00007fcc0dee5bd4 00007fcc0dee5b62 00007fcc0dee5a91 00007fcc0dee5a0c 00007fcc0dee4cc2 00007fcc0dce548c 00007fcc0dce48c6 00007fcc0dce426f
0709 13:19:03.672659 (+   298us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1953398400}
I20260709 13:19:03.602741  6844 leader_election.cc:304] T 7887766dc6784fcaa42b35c05fea7a99 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:19:03.596958  6697 leader_election.cc:304] T 7c37d41cd9164c15a6826ca62a851a69 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
W20260709 13:19:03.675200  8673 consensus_meta.cc:287] T 7887766dc6784fcaa42b35c05fea7a99 P ccd8a4c3bfe3413cb2ae219b09aea832: Time spent flushing consensus metadata: real 0.643s	user 0.009s	sys 0.000s
W20260709 13:19:03.613306  7468 leader_election.cc:336] T bb3d8792045a4583ae2e965b1350a5b4 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931): Timed out: RequestConsensusVote RPC to 127.5.126.67:42931 timed out after 2.162s (SENT)
W20260709 13:19:03.676023  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 73327.1us
I20260709 13:19:03.676312  7468 leader_election.cc:304] T bb3d8792045a4583ae2e965b1350a5b4 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:19:03.677139  6844 leader_election.cc:304] T 34f36d59d88f40fe8a2805e604fc6c0a P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:19:03.677280  8744 raft_consensus.cc:2749] T bb3d8792045a4583ae2e965b1350a5b4 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:19:03.677472  7468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 64279.8us
W20260709 13:19:03.678522  6697 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 79182.5us
W20260709 13:19:03.627449  6847 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:03.647475  6730 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50004 (request call id 1249) took 1952 ms. Trace:
I20260709 13:19:03.681809  8792 raft_consensus.cc:2749] T 7c37d41cd9164c15a6826ca62a851a69 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:19:03.680713  6730 rpcz_store.cc:276] 0709 13:19:01.695369 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:02.238995 (+543626us) service_pool.cc:224] Handling call
0709 13:19:02.282919 (+ 43924us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:19:02.329000 (+ 46081us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:02.329036 (+    36us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:19:02.385422 (+ 56386us) log.cc:844] Serialized 52 byte log entry
0709 13:19:02.814470 (+429048us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:19:02.844187 (+ 29717us) log.cc:844] Serialized 14 byte log entry
0709 13:19:02.910654 (+ 66467us) spinlock_profiling.cc:243] Waited 3.59 ms on lock 0x7b1800341f80. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc15785de1 00007fcc157925b1 00007fcc0c837c0a 00007fcc15f77219 00007fcc0c8bfa40 00007fcc0c8ba4e4 00007fcc0c8ba455 00007fcc133a23c7 00007fcc0f9b49a7 00007fcc0f9c40bf 00007fcc0f9c4038
0709 13:19:02.910917 (+   263us) log.cc:844] Serialized 14 byte log entry
0709 13:19:03.340960 (+430043us) spinlock_profiling.cc:243] Waited 7.25 ms on lock 0x7b1800341f80. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc15785de1 00007fcc157925b1 00007fcc0c837c0a 00007fcc15f77219 00007fcc1387e58f 00007fcc0c8bd571 00007fcc0c8bf7c1 00007fcc0c8bf779 00007fcc0c8bf709 00007fcc0c8bf6d1 00007fcc0c8be9cd
0709 13:19:03.360388 (+ 19428us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:03.360449 (+    61us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:03.645578 (+285129us) raft_consensus.cc:1685] finished
0709 13:19:03.645609 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:03.647381 (+  1772us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":506716,"prepare.queue_time_us":133475,"prepare.run_cpu_time_us":128,"prepare.run_wall_time_us":18544,"raft.queue_time_us":471067,"raft.run_cpu_time_us":448,"raft.run_wall_time_us":8525,"spinlock_wait_cycles":25083776,"thread_start_us":317679,"threads_started":1,"wal-append.queue_time_us":432376}
W20260709 13:19:03.682557  8858 log.cc:927] Time spent T 4d9def8b32fd443aa94ab1420b06837b P b7ab4784c7344b939bc36f639286f377: Append to log took a long time: real 0.199s	user 0.000s	sys 0.002s
I20260709 13:19:03.682986  8873 raft_consensus.cc:3060] T 7887766dc6784fcaa42b35c05fea7a99 P cd75a17ab2604397adab03bb8b5fd75c [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:19:03.683436  8875 raft_consensus.cc:2749] T 34f36d59d88f40fe8a2805e604fc6c0a P cd75a17ab2604397adab03bb8b5fd75c [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:19:03.685925  8828 consensus_queue.cc:1048] T 20f6842e26174571996b8dea4151d4be P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:19:03.590790  8825 leader_election.cc:290] T 7887766dc6784fcaa42b35c05fea7a99 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 5 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:03.588733  8827 raft_consensus.cc:2749] T 1bf4668eeb70467fb3dc5a0289233b3c P ccd8a4c3bfe3413cb2ae219b09aea832 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:19:03.643950  6803 raft_consensus.cc:2468] T 3a485a995abc4807b6e511e45419f737 P b7ab4784c7344b939bc36f639286f377 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 4.
I20260709 13:19:03.653674  8767 raft_consensus.cc:493] T 7a734b5ab7834e05a8c422208acc58b1 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
W20260709 13:19:03.657338  8834 consensus_meta.cc:287] T 3411566abe2d4c9bb4b2adfdd05e6f17 P b7ab4784c7344b939bc36f639286f377: Time spent flushing consensus metadata: real 0.621s	user 0.011s	sys 0.001s
W20260709 13:19:03.661233  8857 log.cc:927] Time spent T a1704639a875409b9959353527b3fd68 P b7ab4784c7344b939bc36f639286f377: Append to log took a long time: real 0.156s	user 0.000s	sys 0.001s
I20260709 13:19:03.607192  8257 consensus_queue.cc:260] T fe20b4b48823486ca3b9c648db6ce8aa P ccd8a4c3bfe3413cb2ae219b09aea832 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:19:03.661945  6799 raft_consensus.cc:2368] T a3022224cc81473690653a83d4e99470 P b7ab4784c7344b939bc36f639286f377 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c for earlier term 5. Current term is 6.
W20260709 13:19:03.667411  8446 consensus_meta.cc:287] T ce4f062dcd314d43a63ca74067cb5ee3 P b7ab4784c7344b939bc36f639286f377: Time spent flushing consensus metadata: real 0.669s	user 0.010s	sys 0.003s
I20260709 13:19:03.669488  8711 leader_election.cc:290] T a3022224cc81473690653a83d4e99470 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 6 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:03.597601  8757 leader_election.cc:290] T bd6869f07b5a4885a0b99fbe60c3b175 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:19:03.697175  6844 leader_election.cc:304] T f58dc08b12a2494bb9a1372837970ca2 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
W20260709 13:19:03.742439  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 45359.2us
I20260709 13:19:03.743048  8760 leader_election.cc:290] T ce4f062dcd314d43a63ca74067cb5ee3 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
W20260709 13:19:03.682337  8763 consensus_meta.cc:287] T 7c44c4849aa54f2b94d1f1bef9ed546f P b7ab4784c7344b939bc36f639286f377: Time spent flushing consensus metadata: real 0.515s	user 0.010s	sys 0.000s
I20260709 13:19:03.675791  8673 raft_consensus.cc:515] T 7887766dc6784fcaa42b35c05fea7a99 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:03.733630  6731 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49998 (request call id 619) took 1249 ms. Trace:
I20260709 13:19:03.718765  6697 leader_election.cc:304] T bd6869f07b5a4885a0b99fbe60c3b175 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:19:03.746011  6801 raft_consensus.cc:2410] T 7c44c4849aa54f2b94d1f1bef9ed546f P b7ab4784c7344b939bc36f639286f377 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c for term 6 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 13:19:03.744895  6844 leader_election.cc:304] T dbdf895bba214ff68685a24fd17dfb5d P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:19:03.761288  6697 leader_election.cc:304] T 711ef6523deb4cbe8ef2ba61e1c21c98 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377
I20260709 13:19:03.759555  6731 rpcz_store.cc:276] 0709 13:19:02.483839 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:02.868524 (+384685us) service_pool.cc:224] Handling call
0709 13:19:02.877241 (+  8717us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:19:03.353648 (+476407us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:03.353686 (+    38us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:19:03.381469 (+ 27783us) log.cc:844] Serialized 52 byte log entry
0709 13:19:03.587832 (+206363us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:19:03.727596 (+139764us) log.cc:844] Serialized 14 byte log entry
0709 13:19:03.733168 (+  5572us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:03.733254 (+    86us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:03.733300 (+    46us) raft_consensus.cc:1685] finished
0709 13:19:03.733312 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:03.733467 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":529360,"prepare.queue_time_us":139838,"prepare.run_cpu_time_us":71,"prepare.run_wall_time_us":72,"raft.queue_time_us":475754,"raft.run_cpu_time_us":391,"raft.run_wall_time_us":37719,"thread_start_us":337740,"threads_started":2,"wal-append.queue_time_us":274540}
I20260709 13:19:03.721280  8791 leader_election.cc:290] T 2c240553ce044eedb41541d72b9475d7 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:03.722856  8834 raft_consensus.cc:2749] T 3411566abe2d4c9bb4b2adfdd05e6f17 P b7ab4784c7344b939bc36f639286f377 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:19:03.735621  8777 consensus_queue.cc:1048] T 4d9def8b32fd443aa94ab1420b06837b P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.075s
I20260709 13:19:03.810935  8891 raft_consensus.cc:493] T 1528ab62b6fe4e3099d08f141afee116 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 7ba59cc884714e8aa5f3f0ecaed84cbb)
I20260709 13:19:03.721781  8766 consensus_queue.cc:1048] T 90d42e216d9741e190bca19a781291fd P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.088s
I20260709 13:19:03.769497  8257 raft_consensus.cc:3060] T fe20b4b48823486ca3b9c648db6ce8aa P ccd8a4c3bfe3413cb2ae219b09aea832 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:03.745627  7498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce4f062dcd314d43a63ca74067cb5ee3" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:19:03.721958  8792 consensus_queue.cc:1048] T 713b5728a197487c9300b310ab94e5a3 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.087s
W20260709 13:19:03.817656  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 72880.5us
I20260709 13:19:03.753448  8446 raft_consensus.cc:2749] T ce4f062dcd314d43a63ca74067cb5ee3 P b7ab4784c7344b939bc36f639286f377 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:19:03.769166  8519 raft_consensus.cc:2749] T bd6869f07b5a4885a0b99fbe60c3b175 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:19:03.744024  8760 raft_consensus.cc:2749] T f58dc08b12a2494bb9a1372837970ca2 P cd75a17ab2604397adab03bb8b5fd75c [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:19:03.806602  8827 raft_consensus.cc:2804] T 711ef6523deb4cbe8ef2ba61e1c21c98 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:19:03.846987  6803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f00a2e87e56452083b759f60d461ee3" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:19:03.847299  6804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ba5dac66ab5497e9e336f2a3c28cda5" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:19:03.746433  8862 leader_election.cc:290] T f4b8bd455d5a47c18a1380839c6e0d61 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:03.815478  8765 consensus_queue.cc:1048] T a1704639a875409b9959353527b3fd68 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.034s
I20260709 13:19:03.836967  6878 raft_consensus.cc:493] T 3fa34c08b205435dba97346991aa1f92 P cd75a17ab2604397adab03bb8b5fd75c [term 5 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:19:03.850718  6878 raft_consensus.cc:3060] T 3fa34c08b205435dba97346991aa1f92 P cd75a17ab2604397adab03bb8b5fd75c [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:03.751117  7499 raft_consensus.cc:2468] T 404190ce4ce94cecbfcb6ea9d1dd8626 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 6.
I20260709 13:19:03.733104  8767 raft_consensus.cc:515] T 7a734b5ab7834e05a8c422208acc58b1 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:03.846943  8827 raft_consensus.cc:697] T 711ef6523deb4cbe8ef2ba61e1c21c98 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 5 LEADER]: Becoming Leader. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
W20260709 13:19:03.853112  8880 log.cc:927] Time spent T f5be3a11b23d4ea9b08300a2789821c7 P b7ab4784c7344b939bc36f639286f377: Append to log took a long time: real 0.139s	user 0.004s	sys 0.000s
W20260709 13:19:03.854297  8888 log.cc:927] Time spent T 3d65025eea89441290d85dd053810e31 P b7ab4784c7344b939bc36f639286f377: Append to log took a long time: real 0.125s	user 0.001s	sys 0.000s
I20260709 13:19:03.854014  8827 consensus_queue.cc:237] T 711ef6523deb4cbe8ef2ba61e1c21c98 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:03.855633  8768 leader_election.cc:290] T 24ee15416e3145beaa1b8183453729a3 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:19:03.858566  8779 leader_election.cc:290] T e31b9971c15848dea59d4d4130141d9e P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:19:03.859171  6770 leader_election.cc:304] T be1a92657f494cac8dd227d152f50151 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
W20260709 13:19:03.860244  6697 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 94133.6us
I20260709 13:19:03.746244  8829 leader_election.cc:290] T f58dc08b12a2494bb9a1372837970ca2 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:03.682337  8100 consensus_queue.cc:237] T de3186201e1a40d0b335eeb8b4e256e0 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
W20260709 13:19:03.815963  8857 log.cc:927] Time spent T a1704639a875409b9959353527b3fd68 P b7ab4784c7344b939bc36f639286f377: Append to log took a long time: real 0.062s	user 0.000s	sys 0.001s
I20260709 13:19:03.732697  8790 consensus_queue.cc:1059] T 4b8cacb381b746da8d0049b0a83b41dd P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.083s
I20260709 13:19:03.812533  8757 raft_consensus.cc:2764] T dbdf895bba214ff68685a24fd17dfb5d P cd75a17ab2604397adab03bb8b5fd75c [term 6 FOLLOWER]: Leader election decision vote started in defunct term 5: won
I20260709 13:19:03.833654  6844 leader_election.cc:304] T f4b8bd455d5a47c18a1380839c6e0d61 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:19:03.836592  6875 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53416 (request call id 2094) took 2352 ms. Trace:
W20260709 13:19:03.836786  8884 log.cc:927] Time spent T fe20b4b48823486ca3b9c648db6ce8aa P cd75a17ab2604397adab03bb8b5fd75c: Append to log took a long time: real 0.112s	user 0.000s	sys 0.008s
I20260709 13:19:03.839362  8805 leader_election.cc:290] T 17587d6730594da4a56fa13a353232a1 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:19:03.832458  7498 raft_consensus.cc:2468] T ce4f062dcd314d43a63ca74067cb5ee3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 6.
I20260709 13:19:03.844060  8673 leader_election.cc:290] T 7887766dc6784fcaa42b35c05fea7a99 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 5 election: Requested vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:03.871881  6805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17587d6730594da4a56fa13a353232a1" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:19:03.872895  6770 leader_election.cc:304] T 44bde925b2e541b69890d70715b85176 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
I20260709 13:19:03.844343  8574 raft_consensus.cc:493] T 90d42e216d9741e190bca19a781291fd P b7ab4784c7344b939bc36f639286f377 [term 5 FOLLOWER]: Starting leader election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:19:03.868955  6875 rpcz_store.cc:276] 0709 13:19:01.484237 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:01.492466 (+  8229us) service_pool.cc:224] Handling call
0709 13:19:01.513431 (+ 20965us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:01.590997 (+ 77566us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:19:01.691507 (+100510us) log.cc:844] Serialized 14 byte log entry
0709 13:19:01.972334 (+280827us) spinlock_profiling.cc:243] Waited 3.06 ms on lock 0x7b18003e6ec0. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc15785de1 00007fcc157925b1 00007fcc0c89fe07 00007fcc156faab9 00007fcc0c8bc69b 00007fcc0c8ba93f 00007fcc0c8bcc02 00007fcc0f54420b 00007fcc0f549d23 00007fcc0f54a23a 00007fcc0f9b4a2a
0709 13:19:03.819235 (+1846901us) spinlock_profiling.cc:243] Waited 17.5 ms on lock 0x7b18003e6ec0. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc15785de1 00007fcc157925b1 00007fcc0f5524bc 00007fcc0c8a048b 00007fcc156faab9 00007fcc0c8bc69b 00007fcc0c8ba93f 00007fcc0c8ba455 00007fcc0f9a2060 00007fcc0f9b4716 00007fcc0f9c5287
0709 13:19:03.836135 (+ 16900us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:03.836199 (+    64us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:19:03.836251 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:03.836350 (+    99us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:03.836489 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":91383,"prepare.run_cpu_time_us":81,"prepare.run_wall_time_us":564,"raft.queue_time_us":98553,"raft.run_cpu_time_us":232,"raft.run_wall_time_us":20255,"spinlock_wait_cycles":47400960,"thread_start_us":1047818,"threads_started":3,"wal-append.queue_time_us":1139718}
I20260709 13:19:03.876741  6770 leader_election.cc:304] T b56bf91d90824c959e21e0cee5ba1816 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:19:03.879751  8871 raft_consensus.cc:2804] T 44bde925b2e541b69890d70715b85176 P b7ab4784c7344b939bc36f639286f377 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:19:03.882450  8871 raft_consensus.cc:493] T 44bde925b2e541b69890d70715b85176 P b7ab4784c7344b939bc36f639286f377 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:03.882848  8871 raft_consensus.cc:3060] T 44bde925b2e541b69890d70715b85176 P b7ab4784c7344b939bc36f639286f377 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:03.881695  8779 raft_consensus.cc:3060] T f4b8bd455d5a47c18a1380839c6e0d61 P cd75a17ab2604397adab03bb8b5fd75c [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:19:03.889215  8870 raft_consensus.cc:493] T f58dc08b12a2494bb9a1372837970ca2 P b7ab4784c7344b939bc36f639286f377 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:03.890079  8870 raft_consensus.cc:515] T f58dc08b12a2494bb9a1372837970ca2 P b7ab4784c7344b939bc36f639286f377 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
W20260709 13:19:03.893543  6728 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50004 (request call id 1248) took 2198 ms (client timeout 1798 ms). Trace:
W20260709 13:19:03.894040  6728 rpcz_store.cc:269] 0709 13:19:01.695078 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:01.956060 (+260982us) service_pool.cc:224] Handling call
0709 13:19:03.893261 (+1937201us) spinlock_profiling.cc:243] Waited 885 ms on lock 0x7b5400394ed4. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f9ae2fa 00007fcc1496fb17 00007fcc0deea6d4 00007fcc0deea662 00007fcc0deea591 00007fcc0deea50c 00007fcc0dee97c2 00007fcc0dce548c 00007fcc0dce48c6 00007fcc0dce426f
0709 13:19:03.893455 (+   194us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2036543872}
W20260709 13:19:03.896410  6771 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:03.819821  8891 raft_consensus.cc:515] T 1528ab62b6fe4e3099d08f141afee116 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } attrs { replace: true } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:19:03.901831  6802 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:32976 (request call id 2048) took 1087 ms. Trace:
I20260709 13:19:03.902271  6802 rpcz_store.cc:276] 0709 13:19:02.814566 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:02.814760 (+   194us) service_pool.cc:224] Handling call
0709 13:19:02.837181 (+ 22421us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 13:19:02.868843 (+ 31662us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:02.868877 (+    34us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 13:19:02.869614 (+   737us) log.cc:844] Serialized 78 byte log entry
0709 13:19:03.116522 (+246908us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:19:03.141774 (+ 25252us) log.cc:844] Serialized 14 byte log entry
0709 13:19:03.303723 (+161949us) log.cc:844] Serialized 14 byte log entry
0709 13:19:03.303967 (+   244us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:03.304079 (+   112us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:03.901571 (+597492us) raft_consensus.cc:1685] finished
0709 13:19:03.901595 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:03.901767 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":572605,"prepare.queue_time_us":65195,"prepare.run_cpu_time_us":92,"prepare.run_wall_time_us":98,"raft.queue_time_us":765657,"raft.run_cpu_time_us":560,"raft.run_wall_time_us":14772,"thread_start_us":323495,"threads_started":2,"wal-append.queue_time_us":504496}
W20260709 13:19:03.905596  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 72134.8us
I20260709 13:19:03.906232  6844 leader_election.cc:304] T 95a75bfe094d4bdc963aba3f08dfcd25 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:19:03.904531  6697 leader_election.cc:304] T ce4f062dcd314d43a63ca74067cb5ee3 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377
I20260709 13:19:03.910576  6770 leader_election.cc:304] T 07a92dd554674067a83a9cb68c4773f2 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
I20260709 13:19:03.873687  8790 consensus_queue.cc:1243] T 4b8cacb381b746da8d0049b0a83b41dd P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Peer cd75a17ab2604397adab03bb8b5fd75c log is divergent from this leader: its last log entry 4.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 13:19:03.914693  8757 raft_consensus.cc:2764] T 95a75bfe094d4bdc963aba3f08dfcd25 P cd75a17ab2604397adab03bb8b5fd75c [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 5: won
I20260709 13:19:03.878484  8574 raft_consensus.cc:3060] T 90d42e216d9741e190bca19a781291fd P b7ab4784c7344b939bc36f639286f377 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:03.875532  8825 raft_consensus.cc:2804] T be1a92657f494cac8dd227d152f50151 P b7ab4784c7344b939bc36f639286f377 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:19:03.915913  6770 leader_election.cc:304] T d33d5ee8ef6f415593d8df52063161ad P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
I20260709 13:19:03.923368  6728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7887766dc6784fcaa42b35c05fea7a99" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:19:03.924289  6728 raft_consensus.cc:2393] T 7887766dc6784fcaa42b35c05fea7a99 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate b7ab4784c7344b939bc36f639286f377 in current term 5: Already voted for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in this term.
I20260709 13:19:03.927578  6731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4b8bd455d5a47c18a1380839c6e0d61" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:19:03.912405  8446 raft_consensus.cc:493] T 22ccee1b570c4ad3a57bd7aec085b1b4 P b7ab4784c7344b939bc36f639286f377 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader cd75a17ab2604397adab03bb8b5fd75c)
I20260709 13:19:03.927955  6730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3022224cc81473690653a83d4e99470" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:19:03.928741  6730 raft_consensus.cc:3060] T a3022224cc81473690653a83d4e99470 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:03.928505  6731 raft_consensus.cc:2410] T f4b8bd455d5a47c18a1380839c6e0d61 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7ab4784c7344b939bc36f639286f377 for term 5 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:19:03.909538  8440 raft_consensus.cc:3060] T b56bf91d90824c959e21e0cee5ba1816 P b7ab4784c7344b939bc36f639286f377 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:19:03.869479  8829 consensus_queue.cc:1048] T b3f13b31a1f84f0d89d007eadd57924c P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.042s
I20260709 13:19:03.933075  6804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b3759de40694069b13c0f8bd40e5709" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:19:03.933619  6804 raft_consensus.cc:2468] T 9b3759de40694069b13c0f8bd40e5709 P b7ab4784c7344b939bc36f639286f377 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 5.
I20260709 13:19:03.933831  6729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e31b9971c15848dea59d4d4130141d9e" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:19:03.912595  8793 leader_election.cc:290] T 853ac0a8cbd64ce99457f170216d4d0f P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:03.941542  6881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a485a995abc4807b6e511e45419f737" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:19:03.942520  6881 raft_consensus.cc:2393] T 3a485a995abc4807b6e511e45419f737 P cd75a17ab2604397adab03bb8b5fd75c [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ccd8a4c3bfe3413cb2ae219b09aea832 in current term 4: Already voted for candidate cd75a17ab2604397adab03bb8b5fd75c in this term.
I20260709 13:19:03.943179  6880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b3759de40694069b13c0f8bd40e5709" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:19:03.941763  6877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4db81d9d329422bb3b4160ca4ac2d1d" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:19:03.943926  6877 raft_consensus.cc:2468] T c4db81d9d329422bb3b4160ca4ac2d1d P cd75a17ab2604397adab03bb8b5fd75c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 4.
I20260709 13:19:03.938248  6805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34f36d59d88f40fe8a2805e604fc6c0a" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:19:03.925971  8763 raft_consensus.cc:2804] T 07a92dd554674067a83a9cb68c4773f2 P b7ab4784c7344b939bc36f639286f377 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:19:03.948753  8763 raft_consensus.cc:493] T 07a92dd554674067a83a9cb68c4773f2 P b7ab4784c7344b939bc36f639286f377 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:03.949229  8763 raft_consensus.cc:3060] T 07a92dd554674067a83a9cb68c4773f2 P b7ab4784c7344b939bc36f639286f377 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:19:03.949144  6875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7887766dc6784fcaa42b35c05fea7a99" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:19:03.929481  8832 raft_consensus.cc:2804] T d33d5ee8ef6f415593d8df52063161ad P b7ab4784c7344b939bc36f639286f377 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:19:03.919529  8841 consensus_queue.cc:1059] T 4b8cacb381b746da8d0049b0a83b41dd P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.028s
I20260709 13:19:03.950392  6873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a75bfe094d4bdc963aba3f08dfcd25" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 7 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:19:03.954952  8793 raft_consensus.cc:493] T 3d65025eea89441290d85dd053810e31 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:03.955761  8797 raft_consensus.cc:493] T 8c7f33e544204fbaac4078e3e83bbf4e P ccd8a4c3bfe3413cb2ae219b09aea832 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:19:03.956492  6877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24ee15416e3145beaa1b8183453729a3" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:19:03.928494  8446 raft_consensus.cc:515] T 22ccee1b570c4ad3a57bd7aec085b1b4 P b7ab4784c7344b939bc36f639286f377 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:03.956701  6731 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "853ac0a8cbd64ce99457f170216d4d0f"
dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
mode: GRACEFUL
new_leader_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
 from {username='slave'} at 127.0.0.1:38536
I20260709 13:19:03.926517  8767 leader_election.cc:290] T 7a734b5ab7834e05a8c422208acc58b1 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:03.986747  6877 raft_consensus.cc:2468] T 24ee15416e3145beaa1b8183453729a3 P cd75a17ab2604397adab03bb8b5fd75c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 4.
I20260709 13:19:03.929277  8790 raft_consensus.cc:2804] T ce4f062dcd314d43a63ca74067cb5ee3 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 6 FOLLOWER]: Leader election won for term 6
W20260709 13:19:03.958253  7467 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:03.958760  6803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4db81d9d329422bb3b4160ca4ac2d1d" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:19:03.960124  6804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be1a92657f494cac8dd227d152f50151" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:19:03.988842  6803 raft_consensus.cc:2468] T c4db81d9d329422bb3b4160ca4ac2d1d P b7ab4784c7344b939bc36f639286f377 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 5.
I20260709 13:19:03.961817  6880 raft_consensus.cc:2468] T 9b3759de40694069b13c0f8bd40e5709 P cd75a17ab2604397adab03bb8b5fd75c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 5.
I20260709 13:19:03.962915  6873 raft_consensus.cc:2468] T 95a75bfe094d4bdc963aba3f08dfcd25 P cd75a17ab2604397adab03bb8b5fd75c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 6.
I20260709 13:19:03.964512  6731 raft_consensus.cc:606] T 853ac0a8cbd64ce99457f170216d4d0f P ccd8a4c3bfe3413cb2ae219b09aea832 [term 2 FOLLOWER]: Received request to transfer leadership to TS cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:19:03.964568  6876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34f36d59d88f40fe8a2805e604fc6c0a" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:19:03.925382  8825 raft_consensus.cc:493] T be1a92657f494cac8dd227d152f50151 P b7ab4784c7344b939bc36f639286f377 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 7ba59cc884714e8aa5f3f0ecaed84cbb)
I20260709 13:19:03.987102  6805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a75bfe094d4bdc963aba3f08dfcd25" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 7 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:19:03.987941  6872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8292e16e5654be6bc408560cf256aaa" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:19:03.990355  6731 raft_consensus.cc:614] T 853ac0a8cbd64ce99457f170216d4d0f P ccd8a4c3bfe3413cb2ae219b09aea832 [term 2 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:19:03.990909  6876 raft_consensus.cc:2468] T 34f36d59d88f40fe8a2805e604fc6c0a P cd75a17ab2604397adab03bb8b5fd75c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 2.
I20260709 13:19:03.991330  6872 raft_consensus.cc:2393] T d8292e16e5654be6bc408560cf256aaa P cd75a17ab2604397adab03bb8b5fd75c [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ccd8a4c3bfe3413cb2ae219b09aea832 in current term 6: Already voted for candidate cd75a17ab2604397adab03bb8b5fd75c in this term.
I20260709 13:19:03.988139  6878 raft_consensus.cc:515] T 3fa34c08b205435dba97346991aa1f92 P cd75a17ab2604397adab03bb8b5fd75c [term 6 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:19:03.959658  7498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be1a92657f494cac8dd227d152f50151" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:19:04.000870  6873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4b8bd455d5a47c18a1380839c6e0d61" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:19:04.002089  6872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e326172347f45e99a0d482b5d8ef768" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:19:04.003954  6880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "853ac0a8cbd64ce99457f170216d4d0f" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:19:03.995091  8876 raft_consensus.cc:493] T 3fa34c08b205435dba97346991aa1f92 P cd75a17ab2604397adab03bb8b5fd75c [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:04.006403  6877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c240553ce044eedb41541d72b9475d7" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:19:04.007557  5625 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:19:04.008994  8446 leader_election.cc:290] T 22ccee1b570c4ad3a57bd7aec085b1b4 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:04.010083  5625 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:19:04.010954  8871 raft_consensus.cc:515] T 44bde925b2e541b69890d70715b85176 P b7ab4784c7344b939bc36f639286f377 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:04.012004  8773 leader_election.cc:290] T 1bf4668eeb70467fb3dc5a0289233b3c P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:19:04.013037  8891 leader_election.cc:290] T 1528ab62b6fe4e3099d08f141afee116 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:19:04.014353  7495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1528ab62b6fe4e3099d08f141afee116" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:19:04.006084  8790 raft_consensus.cc:697] T ce4f062dcd314d43a63ca74067cb5ee3 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 6 LEADER]: Becoming Leader. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
I20260709 13:19:04.021234  8790 consensus_queue.cc:237] T ce4f062dcd314d43a63ca74067cb5ee3 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.5, Last appended by leader: 5, Current term: 6, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } attrs { replace: true } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:19:04.024080  8876 raft_consensus.cc:515] T 3fa34c08b205435dba97346991aa1f92 P cd75a17ab2604397adab03bb8b5fd75c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:19:04.026974  6880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7887766dc6784fcaa42b35c05fea7a99" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:19:04.027603  6876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a734b5ab7834e05a8c422208acc58b1" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:19:04.028362  6876 raft_consensus.cc:2393] T 7a734b5ab7834e05a8c422208acc58b1 P cd75a17ab2604397adab03bb8b5fd75c [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ccd8a4c3bfe3413cb2ae219b09aea832 in current term 5: Already voted for candidate cd75a17ab2604397adab03bb8b5fd75c in this term.
I20260709 13:19:04.029012  6877 raft_consensus.cc:2468] T 2c240553ce044eedb41541d72b9475d7 P cd75a17ab2604397adab03bb8b5fd75c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 5.
I20260709 13:19:03.993925  8825 raft_consensus.cc:3060] T be1a92657f494cac8dd227d152f50151 P b7ab4784c7344b939bc36f639286f377 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:03.992321  8832 raft_consensus.cc:697] T d33d5ee8ef6f415593d8df52063161ad P b7ab4784c7344b939bc36f639286f377 [term 6 LEADER]: Becoming Leader. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
I20260709 13:19:04.031114  6804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e326172347f45e99a0d482b5d8ef768" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:19:04.039106  6804 raft_consensus.cc:3060] T 9e326172347f45e99a0d482b5d8ef768 P b7ab4784c7344b939bc36f639286f377 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:19:04.045192  6770 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 120636us
I20260709 13:19:03.995353  7499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24ee15416e3145beaa1b8183453729a3" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:19:04.054569  6872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f58dc08b12a2494bb9a1372837970ca2" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:19:04.055502  6872 raft_consensus.cc:2468] T f58dc08b12a2494bb9a1372837970ca2 P cd75a17ab2604397adab03bb8b5fd75c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 6.
I20260709 13:19:04.001579  8870 leader_election.cc:290] T f58dc08b12a2494bb9a1372837970ca2 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:04.057454  6770 leader_election.cc:304] T ab432e62819d499eaaf3dd55481dd930 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
I20260709 13:19:03.993996  8793 raft_consensus.cc:515] T 3d65025eea89441290d85dd053810e31 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:04.061091  6726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22ccee1b570c4ad3a57bd7aec085b1b4" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:19:04.063131  8711 raft_consensus.cc:493] T 20f6842e26174571996b8dea4151d4be P b7ab4784c7344b939bc36f639286f377 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:19:04.061659  6804 raft_consensus.cc:2468] T 9e326172347f45e99a0d482b5d8ef768 P b7ab4784c7344b939bc36f639286f377 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 5.
I20260709 13:19:03.994194  8797 raft_consensus.cc:515] T 8c7f33e544204fbaac4078e3e83bbf4e P ccd8a4c3bfe3413cb2ae219b09aea832 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:04.072129  6728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44bde925b2e541b69890d70715b85176" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:19:04.081415  6728 raft_consensus.cc:3060] T 44bde925b2e541b69890d70715b85176 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:04.072757  6731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f58dc08b12a2494bb9a1372837970ca2" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:19:04.060360  8257 raft_consensus.cc:493] T 427c124d773f483294511e80fe340075 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:04.084074  6731 raft_consensus.cc:2468] T f58dc08b12a2494bb9a1372837970ca2 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 6.
I20260709 13:19:04.053807  8873 raft_consensus.cc:2749] T 7887766dc6784fcaa42b35c05fea7a99 P cd75a17ab2604397adab03bb8b5fd75c [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:19:04.092752  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 141902us
I20260709 13:19:04.093155  6770 leader_election.cc:304] T f58dc08b12a2494bb9a1372837970ca2 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
I20260709 13:19:04.073613  8861 raft_consensus.cc:2804] T ab432e62819d499eaaf3dd55481dd930 P b7ab4784c7344b939bc36f639286f377 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:19:04.102990  6844 leader_election.cc:304] T 90d42e216d9741e190bca19a781291fd P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:19:04.074234  8440 raft_consensus.cc:2749] T b56bf91d90824c959e21e0cee5ba1816 P b7ab4784c7344b939bc36f639286f377 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:19:04.116881  6875 raft_consensus.cc:2468] T 7887766dc6784fcaa42b35c05fea7a99 P cd75a17ab2604397adab03bb8b5fd75c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 4.
I20260709 13:19:04.097482  8779 raft_consensus.cc:2749] T f4b8bd455d5a47c18a1380839c6e0d61 P cd75a17ab2604397adab03bb8b5fd75c [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:19:04.109905  6730 raft_consensus.cc:2468] T a3022224cc81473690653a83d4e99470 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 6.
I20260709 13:19:04.086503  8711 raft_consensus.cc:515] T 20f6842e26174571996b8dea4151d4be P b7ab4784c7344b939bc36f639286f377 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:04.142400  6770 leader_election.cc:304] T a3022224cc81473690653a83d4e99470 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
I20260709 13:19:04.112717  8869 raft_consensus.cc:2804] T f58dc08b12a2494bb9a1372837970ca2 P b7ab4784c7344b939bc36f639286f377 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:19:04.151988  6728 raft_consensus.cc:2468] T 44bde925b2e541b69890d70715b85176 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 6.
W20260709 13:19:04.146526  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 43668us
I20260709 13:19:04.127029  8861 raft_consensus.cc:697] T ab432e62819d499eaaf3dd55481dd930 P b7ab4784c7344b939bc36f639286f377 [term 6 LEADER]: Becoming Leader. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
I20260709 13:19:04.100358  8257 raft_consensus.cc:515] T 427c124d773f483294511e80fe340075 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } attrs { replace: true } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:19:04.188620  6731 raft_consensus.cc:1275] T 95a75bfe094d4bdc963aba3f08dfcd25 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 6 FOLLOWER]: Refusing update from remote peer b7ab4784c7344b939bc36f639286f377: Log matching property violated. Preceding OpId in replica: term: 5 index: 2. Preceding OpId from leader: term: 6 index: 2. (term mismatch)
W20260709 13:19:04.133630  8893 log.cc:927] Time spent T 4f00a2e87e56452083b759f60d461ee3 P b7ab4784c7344b939bc36f639286f377: Append to log took a long time: real 0.128s	user 0.001s	sys 0.000s
I20260709 13:19:04.153446  6873 raft_consensus.cc:2468] T f4b8bd455d5a47c18a1380839c6e0d61 P cd75a17ab2604397adab03bb8b5fd75c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 4.
I20260709 13:19:04.196988  6731 pending_rounds.cc:85] T 95a75bfe094d4bdc963aba3f08dfcd25 P ccd8a4c3bfe3413cb2ae219b09aea832: Aborting all ops after (but not including) 1
I20260709 13:19:04.200748  6731 pending_rounds.cc:107] T 95a75bfe094d4bdc963aba3f08dfcd25 P ccd8a4c3bfe3413cb2ae219b09aea832: Aborting uncommitted NO_OP operation due to leader change: 5.2
I20260709 13:19:04.201156  6731 raft_consensus.cc:2889] T 95a75bfe094d4bdc963aba3f08dfcd25 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:19:04.190975  8440 raft_consensus.cc:2804] T a3022224cc81473690653a83d4e99470 P b7ab4784c7344b939bc36f639286f377 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:19:04.204371  6770 leader_election.cc:304] T 44bde925b2e541b69890d70715b85176 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
I20260709 13:19:04.147755  8446 raft_consensus.cc:493] T 7c44c4849aa54f2b94d1f1bef9ed546f P b7ab4784c7344b939bc36f639286f377 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:04.168090  8869 raft_consensus.cc:493] T f58dc08b12a2494bb9a1372837970ca2 P b7ab4784c7344b939bc36f639286f377 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:04.206914  6844 leader_election.cc:304] T 9b3759de40694069b13c0f8bd40e5709 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:19:04.195766  8757 raft_consensus.cc:2749] T 90d42e216d9741e190bca19a781291fd P cd75a17ab2604397adab03bb8b5fd75c [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:19:04.206476  8797 leader_election.cc:290] T 8c7f33e544204fbaac4078e3e83bbf4e P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:04.216935  8440 raft_consensus.cc:697] T a3022224cc81473690653a83d4e99470 P b7ab4784c7344b939bc36f639286f377 [term 6 LEADER]: Becoming Leader. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
I20260709 13:19:04.218012  8440 consensus_queue.cc:237] T a3022224cc81473690653a83d4e99470 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
W20260709 13:19:04.222596  8854 log.cc:927] Time spent T 90d42e216d9741e190bca19a781291fd P b7ab4784c7344b939bc36f639286f377: Append to log took a long time: real 0.854s	user 0.002s	sys 0.004s
I20260709 13:19:04.224372  6807 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:32976 (request call id 2046) took 1422 ms. Trace:
I20260709 13:19:04.224813  6807 rpcz_store.cc:276] 0709 13:19:02.801612 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:02.808145 (+  6533us) service_pool.cc:224] Handling call
0709 13:19:02.808519 (+   374us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:02.816212 (+  7693us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:02.816258 (+    46us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:02.861901 (+ 45643us) spinlock_profiling.cc:243] Waited 2.07 ms on lock 0x7b2c00117598. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0e2a3a11 00007fcc0e2b3372 00007fcc0f9e5a01 00007fcc0f9aa43a 00007fcc0f9a983e 00007fcc1496e419 00007fcc0dee5bd4 00007fcc0dee5b62 00007fcc0dee5a91 00007fcc0dee5a0c 00007fcc0dee4cc2
0709 13:19:02.867292 (+  5391us) log.cc:844] Serialized 26 byte log entry
0709 13:19:03.151510 (+284218us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:19:03.151559 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:03.151649 (+    90us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:04.221875 (+1070226us) spinlock_profiling.cc:243] Waited 23.3 ms on lock 0x7b4400022b4c. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0c745db1 00007fcc0c7e3c85 00007fcc0c7e46a2 00007fcc0f5561db 00007fcc0f551aaf 00007fcc0f54586e 00007fcc0f544bb6 00007fcc0f5447d8 00007fcc0f54e221 00007fcc0f54e1d9 00007fcc0f54e169
0709 13:19:04.224060 (+  2185us) raft_consensus.cc:1685] finished
0709 13:19:04.224084 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:04.224280 (+   196us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":37043,"raft.queue_time_us":4998,"raft.run_cpu_time_us":140,"raft.run_wall_time_us":5954,"spinlock_wait_cycles":58256512,"thread_start_us":243631,"threads_started":1,"wal-append.queue_time_us":467505}
I20260709 13:19:04.229815  6728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "404190ce4ce94cecbfcb6ea9d1dd8626" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:19:04.230204  6798 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:32976 (request call id 2042) took 1989 ms. Trace:
I20260709 13:19:04.230626  6728 raft_consensus.cc:2376] T 404190ce4ce94cecbfcb6ea9d1dd8626 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 6. Re-sending same reply.
I20260709 13:19:04.230736  6798 rpcz_store.cc:276] 0709 13:19:02.241077 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:02.276611 (+ 35534us) service_pool.cc:224] Handling call
0709 13:19:02.329370 (+ 52759us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:03.536571 (+1207201us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:04.229962 (+693391us) spinlock_profiling.cc:243] Waited 1.17 s on lock 0x7b54001b3fd4. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f9aae01 00007fcc0f9a983e 00007fcc1496e419 00007fcc0dee5bd4 00007fcc0dee5b62 00007fcc0dee5a91 00007fcc0dee5a0c 00007fcc0dee4cc2 00007fcc0dce548c 00007fcc0dce48c6
0709 13:19:04.230140 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2698487680}
W20260709 13:19:04.214555  8894 log.cc:927] Time spent T 7ba5dac66ab5497e9e336f2a3c28cda5 P cd75a17ab2604397adab03bb8b5fd75c: Append to log took a long time: real 0.219s	user 0.000s	sys 0.002s
I20260709 13:19:04.215675  8445 raft_consensus.cc:2804] T 44bde925b2e541b69890d70715b85176 P b7ab4784c7344b939bc36f639286f377 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:19:04.213342  8869 raft_consensus.cc:3060] T f58dc08b12a2494bb9a1372837970ca2 P b7ab4784c7344b939bc36f639286f377 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:19:04.242511  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 43798us
I20260709 13:19:04.244349  6729 raft_consensus.cc:1275] T 427c124d773f483294511e80fe340075 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 5 FOLLOWER]: Refusing update from remote peer 7ba59cc884714e8aa5f3f0ecaed84cbb: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:19:04.245409  8257 leader_election.cc:290] T 427c124d773f483294511e80fe340075 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:19:04.233196  8845 raft_consensus.cc:2804] T 9b3759de40694069b13c0f8bd40e5709 P cd75a17ab2604397adab03bb8b5fd75c [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:19:04.249271  8845 raft_consensus.cc:697] T 9b3759de40694069b13c0f8bd40e5709 P cd75a17ab2604397adab03bb8b5fd75c [term 5 LEADER]: Becoming Leader. State: Replica: cd75a17ab2604397adab03bb8b5fd75c, State: Running, Role: LEADER
I20260709 13:19:04.250335  8845 consensus_queue.cc:237] T 9b3759de40694069b13c0f8bd40e5709 P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:04.252208  8688 consensus_queue.cc:1048] T 427c124d773f483294511e80fe340075 P 7ba59cc884714e8aa5f3f0ecaed84cbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
W20260709 13:19:04.253648  6846 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:04.254144  6846 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:04.255115  6697 leader_election.cc:304] T c4db81d9d329422bb3b4160ca4ac2d1d P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:19:04.256413  6697 leader_election.cc:304] T 9b3759de40694069b13c0f8bd40e5709 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:19:04.257298  6697 leader_election.cc:304] T 95a75bfe094d4bdc963aba3f08dfcd25 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:19:04.247176  6798 raft_consensus.cc:1275] T 427c124d773f483294511e80fe340075 P b7ab4784c7344b939bc36f639286f377 [term 5 FOLLOWER]: Refusing update from remote peer 7ba59cc884714e8aa5f3f0ecaed84cbb: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:19:04.247298  6844 leader_election.cc:304] T e77e330a82df4b43a745d57a68f6f057 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:19:04.247525  6731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17587d6730594da4a56fa13a353232a1" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:19:04.260550  6731 raft_consensus.cc:2468] T 17587d6730594da4a56fa13a353232a1 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in term 7.
I20260709 13:19:04.262614  6697 leader_election.cc:304] T 34f36d59d88f40fe8a2805e604fc6c0a P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:19:04.213512  8446 raft_consensus.cc:515] T 7c44c4849aa54f2b94d1f1bef9ed546f P b7ab4784c7344b939bc36f639286f377 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:04.167393  8832 consensus_queue.cc:237] T d33d5ee8ef6f415593d8df52063161ad P b7ab4784c7344b939bc36f639286f377 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:04.261826  7466 leader_election.cc:304] T 17587d6730594da4a56fa13a353232a1 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: b7ab4784c7344b939bc36f639286f377
I20260709 13:19:04.241335  8829 raft_consensus.cc:493] T b56bf91d90824c959e21e0cee5ba1816 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:04.233662  8830 consensus_queue.cc:1048] T 95a75bfe094d4bdc963aba3f08dfcd25 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.027s
I20260709 13:19:04.271247  6697 leader_election.cc:304] T d8292e16e5654be6bc408560cf256aaa P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:19:04.292984  8836 consensus_queue.cc:1048] T 427c124d773f483294511e80fe340075 P 7ba59cc884714e8aa5f3f0ecaed84cbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
W20260709 13:19:04.294754  8897 log.cc:927] Time spent T 34f36d59d88f40fe8a2805e604fc6c0a P ccd8a4c3bfe3413cb2ae219b09aea832: Append to log took a long time: real 0.087s	user 0.000s	sys 0.000s
W20260709 13:19:04.296612  8899 log.cc:927] Time spent T f09c2a98de1a4decabd0ff900dd44caa P cd75a17ab2604397adab03bb8b5fd75c: Append to log took a long time: real 0.092s	user 0.000s	sys 0.000s
W20260709 13:19:04.298276  8865 log.cc:927] Time spent T 22ccee1b570c4ad3a57bd7aec085b1b4 P ccd8a4c3bfe3413cb2ae219b09aea832: Append to log took a long time: real 0.918s	user 0.000s	sys 0.007s
I20260709 13:19:04.262782  8445 raft_consensus.cc:697] T 44bde925b2e541b69890d70715b85176 P b7ab4784c7344b939bc36f639286f377 [term 6 LEADER]: Becoming Leader. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
I20260709 13:19:04.274283  6697 leader_election.cc:304] T 2c240553ce044eedb41541d72b9475d7 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:19:04.317731  6807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4b8bd455d5a47c18a1380839c6e0d61" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:19:04.318094  6801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f58dc08b12a2494bb9a1372837970ca2" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:19:04.317746  6874 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53406 (request call id 1326) took 1169 ms. Trace:
I20260709 13:19:04.274134  8773 raft_consensus.cc:2804] T e77e330a82df4b43a745d57a68f6f057 P cd75a17ab2604397adab03bb8b5fd75c [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:19:04.269140  8257 raft_consensus.cc:2804] T 95a75bfe094d4bdc963aba3f08dfcd25 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:19:04.326367  6695 leader_election.cc:304] T 3a485a995abc4807b6e511e45419f737 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:19:04.319170  6874 rpcz_store.cc:276] 0709 13:19:03.145727 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:03.288069 (+142342us) service_pool.cc:224] Handling call
0709 13:19:03.288442 (+   373us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:03.752114 (+463672us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:03.752148 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:03.774175 (+ 22027us) log.cc:844] Serialized 26 byte log entry
0709 13:19:03.867522 (+ 93347us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:19:03.867577 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:03.867671 (+    94us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:04.315189 (+447518us) raft_consensus.cc:1685] finished
0709 13:19:04.315211 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:04.315356 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":128530,"raft.run_cpu_time_us":125,"raft.run_wall_time_us":126,"thread_start_us":488398,"threads_started":2,"wal-append.queue_time_us":121006}
I20260709 13:19:04.270071  8855 raft_consensus.cc:2804] T 17587d6730594da4a56fa13a353232a1 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:19:04.330714  8257 raft_consensus.cc:493] T 95a75bfe094d4bdc963aba3f08dfcd25 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:04.339296  8257 raft_consensus.cc:3060] T 95a75bfe094d4bdc963aba3f08dfcd25 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:19:04.339524  8901 log.cc:927] Time spent T 713b5728a197487c9300b310ab94e5a3 P cd75a17ab2604397adab03bb8b5fd75c: Append to log took a long time: real 0.101s	user 0.000s	sys 0.000s
I20260709 13:19:04.340253  7499 raft_consensus.cc:1275] T fe20b4b48823486ca3b9c648db6ce8aa P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 2 FOLLOWER]: Refusing update from remote peer cd75a17ab2604397adab03bb8b5fd75c: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:19:04.330830  8773 raft_consensus.cc:493] T e77e330a82df4b43a745d57a68f6f057 P cd75a17ab2604397adab03bb8b5fd75c [term 6 FOLLOWER]: Starting leader election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:19:04.341146  8773 raft_consensus.cc:3060] T e77e330a82df4b43a745d57a68f6f057 P cd75a17ab2604397adab03bb8b5fd75c [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:04.341861  8792 raft_consensus.cc:2764] T 3a485a995abc4807b6e511e45419f737 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 4 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
I20260709 13:19:04.342252  8779 consensus_queue.cc:1048] T fe20b4b48823486ca3b9c648db6ce8aa P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:19:04.266700  8767 raft_consensus.cc:2804] T 9b3759de40694069b13c0f8bd40e5709 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:19:04.318607  6807 raft_consensus.cc:2468] T f4b8bd455d5a47c18a1380839c6e0d61 P b7ab4784c7344b939bc36f639286f377 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 4.
I20260709 13:19:04.357965  6799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24ee15416e3145beaa1b8183453729a3" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:19:04.360277  6807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "853ac0a8cbd64ce99457f170216d4d0f" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:19:04.361894  6807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a734b5ab7834e05a8c422208acc58b1" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:19:04.265012  8891 raft_consensus.cc:2804] T c4db81d9d329422bb3b4160ca4ac2d1d P ccd8a4c3bfe3413cb2ae219b09aea832 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:19:04.291981  8798 raft_consensus.cc:2804] T 34f36d59d88f40fe8a2805e604fc6c0a P ccd8a4c3bfe3413cb2ae219b09aea832 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:19:04.313331  8827 raft_consensus.cc:2749] T d8292e16e5654be6bc408560cf256aaa P ccd8a4c3bfe3413cb2ae219b09aea832 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:19:04.363924  6874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1528ab62b6fe4e3099d08f141afee116" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:19:04.372573  6874 raft_consensus.cc:2468] T 1528ab62b6fe4e3099d08f141afee116 P cd75a17ab2604397adab03bb8b5fd75c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 5.
I20260709 13:19:04.374929  8711 leader_election.cc:290] T 20f6842e26174571996b8dea4151d4be P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
W20260709 13:19:04.375394  8840 log.cc:927] Time spent T f09c2a98de1a4decabd0ff900dd44caa P b7ab4784c7344b939bc36f639286f377: Append to log took a long time: real 1.379s	user 0.000s	sys 0.006s
I20260709 13:19:04.273522  8829 raft_consensus.cc:515] T b56bf91d90824c959e21e0cee5ba1816 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:04.365658  8798 raft_consensus.cc:493] T 34f36d59d88f40fe8a2805e604fc6c0a P ccd8a4c3bfe3413cb2ae219b09aea832 [term 2 FOLLOWER]: Starting leader election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:19:04.294780  8574 raft_consensus.cc:515] T 90d42e216d9741e190bca19a781291fd P b7ab4784c7344b939bc36f639286f377 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
W20260709 13:19:04.377833  8900 log.cc:927] Time spent T 20f6842e26174571996b8dea4151d4be P cd75a17ab2604397adab03bb8b5fd75c: Append to log took a long time: real 0.070s	user 0.000s	sys 0.000s
W20260709 13:19:04.385535  6697 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 111314us
I20260709 13:19:04.256507  8861 consensus_queue.cc:237] T ab432e62819d499eaaf3dd55481dd930 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:04.392149  6799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1528ab62b6fe4e3099d08f141afee116" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
W20260709 13:19:04.413409  7467 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:04.414377  6697 leader_election.cc:304] T f58dc08b12a2494bb9a1372837970ca2 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:19:04.376427  8445 consensus_queue.cc:237] T 44bde925b2e541b69890d70715b85176 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:04.345302  8855 raft_consensus.cc:493] T 17587d6730594da4a56fa13a353232a1 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:04.366087  8891 raft_consensus.cc:493] T c4db81d9d329422bb3b4160ca4ac2d1d P ccd8a4c3bfe3413cb2ae219b09aea832 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:04.366317  8767 raft_consensus.cc:493] T 9b3759de40694069b13c0f8bd40e5709 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:04.382110  8792 raft_consensus.cc:2804] T 2c240553ce044eedb41541d72b9475d7 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:19:04.346750  8446 leader_election.cc:290] T 7c44c4849aa54f2b94d1f1bef9ed546f P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:04.395438  6874 raft_consensus.cc:1240] T 4b8cacb381b746da8d0049b0a83b41dd P cd75a17ab2604397adab03bb8b5fd75c [term 6 LEADER]: Rejecting Update request from peer ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 5. Current term is 6. Ops: [5.6-5.6]
W20260709 13:19:04.276194  6847 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:04.416972  6807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c7f33e544204fbaac4078e3e83bbf4e" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
W20260709 13:19:04.405606  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 162314us
I20260709 13:19:04.447988  6844 leader_election.cc:304] T bb7fa124c3bf4ef9ab65a407cb008441 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, b7ab4784c7344b939bc36f639286f377
I20260709 13:19:04.450153  6807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7887766dc6784fcaa42b35c05fea7a99" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:19:04.426506  8688 raft_consensus.cc:493] T fe20b4b48823486ca3b9c648db6ce8aa P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:04.438331  8896 log.cc:927] Time spent T b3f13b31a1f84f0d89d007eadd57924c P 7ba59cc884714e8aa5f3f0ecaed84cbb: Append to log took a long time: real 0.209s	user 0.000s	sys 0.001s
I20260709 13:19:04.440948  8869 raft_consensus.cc:515] T f58dc08b12a2494bb9a1372837970ca2 P b7ab4784c7344b939bc36f639286f377 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:04.445340  8825 raft_consensus.cc:515] T be1a92657f494cac8dd227d152f50151 P b7ab4784c7344b939bc36f639286f377 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:19:04.450130  6844 leader_election.cc:304] T f09c2a98de1a4decabd0ff900dd44caa P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:19:04.418674  8891 raft_consensus.cc:3060] T c4db81d9d329422bb3b4160ca4ac2d1d P ccd8a4c3bfe3413cb2ae219b09aea832 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:04.419034  8767 raft_consensus.cc:3060] T 9b3759de40694069b13c0f8bd40e5709 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:04.418282  6799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d65025eea89441290d85dd053810e31" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:19:04.451335  6807 raft_consensus.cc:2393] T 7887766dc6784fcaa42b35c05fea7a99 P b7ab4784c7344b939bc36f639286f377 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate ccd8a4c3bfe3413cb2ae219b09aea832 in current term 5: Already voted for candidate b7ab4784c7344b939bc36f639286f377 in this term.
I20260709 13:19:04.454051  6800 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:32976 (request call id 2039) took 2278 ms. Trace:
I20260709 13:19:04.418887  8792 raft_consensus.cc:493] T 2c240553ce044eedb41541d72b9475d7 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 5 FOLLOWER]: Starting leader election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:19:04.393671  8763 raft_consensus.cc:515] T 07a92dd554674067a83a9cb68c4773f2 P b7ab4784c7344b939bc36f639286f377 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:04.453637  8760 raft_consensus.cc:2749] T bb7fa124c3bf4ef9ab65a407cb008441 P cd75a17ab2604397adab03bb8b5fd75c [term 6 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:19:04.467882  7468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 148647us
I20260709 13:19:04.470005  6801 raft_consensus.cc:2393] T f58dc08b12a2494bb9a1372837970ca2 P b7ab4784c7344b939bc36f639286f377 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ccd8a4c3bfe3413cb2ae219b09aea832 in current term 7: Already voted for candidate b7ab4784c7344b939bc36f639286f377 in this term.
I20260709 13:19:04.470544  6804 raft_consensus.cc:1240] T be1a92657f494cac8dd227d152f50151 P b7ab4784c7344b939bc36f639286f377 [term 6 FOLLOWER]: Rejecting Update request from peer 7ba59cc884714e8aa5f3f0ecaed84cbb for earlier term 5. Current term is 6. Ops: []
I20260709 13:19:04.462080  6800 rpcz_store.cc:276] 0709 13:19:02.172223 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:02.278615 (+106392us) service_pool.cc:224] Handling call
0709 13:19:02.279023 (+   408us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:19:02.330664 (+ 51641us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:02.330710 (+    46us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:19:02.345858 (+ 15148us) log.cc:844] Serialized 52 byte log entry
0709 13:19:02.637752 (+291894us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:19:02.637801 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:02.637885 (+    84us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:02.712879 (+ 74994us) spinlock_profiling.cc:243] Waited 10.5 ms on lock 0x7b4800061ed8. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc148d3aa1 00007fcc148cab37 00007fcc148ca9ca 00007fcc149c226f 00007fcc149c1f37 00007fcc149d655c 00007fcc149d6508 00007fcc149d6488 00007fcc149d6443 00007fcc149d56ec 00007fcc138ffa96
0709 13:19:04.316003 (+1603124us) spinlock_profiling.cc:243] Waited 251 ms on lock 0x7b4400022b4c. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0c745db1 00007fcc0c7e3c85 00007fcc0c7e46a2 00007fcc0f5561db 00007fcc0f551aaf 00007fcc0f54586e 00007fcc0f544bb6 00007fcc0f5447d8 00007fcc0f54e221 00007fcc0f54e1d9 00007fcc0f54e169
0709 13:19:04.450217 (+134214us) raft_consensus.cc:1685] finished
0709 13:19:04.450238 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:04.450378 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":139506,"raft.queue_time_us":186313,"raft.run_cpu_time_us":1892,"raft.run_wall_time_us":286438,"spinlock_wait_cycles":601849984,"thread_start_us":214967,"threads_started":1,"wal-append.queue_time_us":547947}
I20260709 13:19:04.419023  8855 raft_consensus.cc:3060] T 17587d6730594da4a56fa13a353232a1 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:04.408782  8798 raft_consensus.cc:3060] T 34f36d59d88f40fe8a2805e604fc6c0a P ccd8a4c3bfe3413cb2ae219b09aea832 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:19:04.467779  6807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "427c124d773f483294511e80fe340075" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 6 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:19:04.478765  6844 leader_election.cc:400] T 30e88460611e47b2ba16a46a30b5f416 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 3 election: Vote denied by peer b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817) with higher term. Message: Invalid argument: T 30e88460611e47b2ba16a46a30b5f416 P b7ab4784c7344b939bc36f639286f377 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c for earlier term 3. Current term is 4.
I20260709 13:19:04.479220  6844 leader_election.cc:403] T 30e88460611e47b2ba16a46a30b5f416 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 3 election: Cancelling election due to peer responding with higher term
I20260709 13:19:04.465349  8873 raft_consensus.cc:2804] T f09c2a98de1a4decabd0ff900dd44caa P cd75a17ab2604397adab03bb8b5fd75c [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:19:04.468022  8792 raft_consensus.cc:3060] T 2c240553ce044eedb41541d72b9475d7 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:04.456176  8688 raft_consensus.cc:515] T fe20b4b48823486ca3b9c648db6ce8aa P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
W20260709 13:19:04.496778  6697 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 82473.2us
I20260709 13:19:04.500769  8869 leader_election.cc:290] T f58dc08b12a2494bb9a1372837970ca2 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 7 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:04.503444  8574 leader_election.cc:290] T 90d42e216d9741e190bca19a781291fd P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 6 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:04.484903  8873 raft_consensus.cc:493] T f09c2a98de1a4decabd0ff900dd44caa P cd75a17ab2604397adab03bb8b5fd75c [term 5 FOLLOWER]: Starting leader election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:19:04.492818  8760 raft_consensus.cc:2749] T 30e88460611e47b2ba16a46a30b5f416 P cd75a17ab2604397adab03bb8b5fd75c [term 4 FOLLOWER]: Leader election lost for term 3. Reason: Vote denied by peer b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817) with higher term. Message: Invalid argument: T 30e88460611e47b2ba16a46a30b5f416 P b7ab4784c7344b939bc36f639286f377 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c for earlier term 3. Current term is 4.
I20260709 13:19:04.478379  8519 raft_consensus.cc:2804] T f58dc08b12a2494bb9a1372837970ca2 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:19:04.511886  8763 leader_election.cc:290] T 07a92dd554674067a83a9cb68c4773f2 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 5 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:04.513319  8825 leader_election.cc:290] T be1a92657f494cac8dd227d152f50151 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 6 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
W20260709 13:19:04.515801  8889 log.cc:927] Time spent T 4b8cacb381b746da8d0049b0a83b41dd P cd75a17ab2604397adab03bb8b5fd75c: Append to log took a long time: real 0.800s	user 0.002s	sys 0.003s
I20260709 13:19:04.516387  6724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe20b4b48823486ca3b9c648db6ce8aa" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:19:04.593295  6724 raft_consensus.cc:2468] T fe20b4b48823486ca3b9c648db6ce8aa P ccd8a4c3bfe3413cb2ae219b09aea832 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in term 2.
I20260709 13:19:04.529116  8829 leader_election.cc:290] T b56bf91d90824c959e21e0cee5ba1816 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:04.533847  8792 raft_consensus.cc:515] T 2c240553ce044eedb41541d72b9475d7 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:04.536023  6772 leader_election.cc:304] T 427c124d773f483294511e80fe340075 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:19:04.595888  7466 leader_election.cc:304] T fe20b4b48823486ca3b9c648db6ce8aa P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
W20260709 13:19:04.612915  6772 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.68:45071, user_credentials={real_user=slave}} blocked reactor thread for 76991.7us
I20260709 13:19:04.561821  6874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c7f33e544204fbaac4078e3e83bbf4e" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:19:04.617398  6874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d65025eea89441290d85dd053810e31" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:19:04.618196  6874 raft_consensus.cc:2468] T 3d65025eea89441290d85dd053810e31 P cd75a17ab2604397adab03bb8b5fd75c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 4.
I20260709 13:19:04.619163  6874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3022224cc81473690653a83d4e99470" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:19:04.565045  6872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "427c124d773f483294511e80fe340075" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 6 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:19:04.620424  6872 raft_consensus.cc:2468] T 427c124d773f483294511e80fe340075 P cd75a17ab2604397adab03bb8b5fd75c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 4.
W20260709 13:19:04.569525  6695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 153108us
I20260709 13:19:04.536463  8257 raft_consensus.cc:515] T 95a75bfe094d4bdc963aba3f08dfcd25 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:04.619867  6874 raft_consensus.cc:3060] T a3022224cc81473690653a83d4e99470 P cd75a17ab2604397adab03bb8b5fd75c [term 4 FOLLOWER]: Advancing to term 6
I20260709 13:19:04.515616  8688 leader_election.cc:290] T fe20b4b48823486ca3b9c648db6ce8aa P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:04.585256  8873 raft_consensus.cc:3060] T f09c2a98de1a4decabd0ff900dd44caa P cd75a17ab2604397adab03bb8b5fd75c [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:19:04.682879  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 217038us
I20260709 13:19:04.683576  6872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e31b9971c15848dea59d4d4130141d9e" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:19:04.595373  8519 raft_consensus.cc:493] T f58dc08b12a2494bb9a1372837970ca2 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:04.543565  8773 raft_consensus.cc:515] T e77e330a82df4b43a745d57a68f6f057 P cd75a17ab2604397adab03bb8b5fd75c [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } }
I20260709 13:19:04.647207  8869 raft_consensus.cc:2749] T 427c124d773f483294511e80fe340075 P b7ab4784c7344b939bc36f639286f377 [term 5 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:19:04.756001  6872 raft_consensus.cc:3060] T e31b9971c15848dea59d4d4130141d9e P cd75a17ab2604397adab03bb8b5fd75c [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:19:04.628100  7496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "427c124d773f483294511e80fe340075" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 6 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
W20260709 13:19:04.757740  7466 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 162013us
W20260709 13:19:04.764809  6695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 142774us
I20260709 13:19:04.771081  6695 leader_election.cc:304] T be1a92657f494cac8dd227d152f50151 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, b7ab4784c7344b939bc36f639286f377
I20260709 13:19:04.774462  6874 raft_consensus.cc:2468] T a3022224cc81473690653a83d4e99470 P cd75a17ab2604397adab03bb8b5fd75c [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 6.
I20260709 13:19:04.692655  8864 raft_consensus.cc:493] T d8292e16e5654be6bc408560cf256aaa P b7ab4784c7344b939bc36f639286f377 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:04.792574  6880 raft_consensus.cc:1240] T e77e330a82df4b43a745d57a68f6f057 P cd75a17ab2604397adab03bb8b5fd75c [term 7 FOLLOWER]: Rejecting Update request from peer ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 6. Current term is 7. Ops: []
I20260709 13:19:04.794248  6874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c44c4849aa54f2b94d1f1bef9ed546f" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:19:04.795187  6874 raft_consensus.cc:2468] T 7c44c4849aa54f2b94d1f1bef9ed546f P cd75a17ab2604397adab03bb8b5fd75c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 6.
I20260709 13:19:04.759904  8519 raft_consensus.cc:3060] T f58dc08b12a2494bb9a1372837970ca2 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:04.799804  6874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f58dc08b12a2494bb9a1372837970ca2" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:19:04.801352  6874 raft_consensus.cc:2468] T f58dc08b12a2494bb9a1372837970ca2 P cd75a17ab2604397adab03bb8b5fd75c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 6.
I20260709 13:19:04.817559  6874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90d42e216d9741e190bca19a781291fd" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:19:04.821120  8859 leader_election.cc:290] T ab432e62819d499eaaf3dd55481dd930 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
W20260709 13:19:04.822281  8917 log.cc:927] Time spent T 427c124d773f483294511e80fe340075 P b7ab4784c7344b939bc36f639286f377: Append to log took a long time: real 0.151s	user 0.001s	sys 0.000s
I20260709 13:19:04.800462  8864 raft_consensus.cc:515] T d8292e16e5654be6bc408560cf256aaa P b7ab4784c7344b939bc36f639286f377 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:04.826457  8864 leader_election.cc:290] T d8292e16e5654be6bc408560cf256aaa P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:04.828197  8927 raft_consensus.cc:2804] T fe20b4b48823486ca3b9c648db6ce8aa P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:19:04.828753  8927 raft_consensus.cc:493] T fe20b4b48823486ca3b9c648db6ce8aa P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:19:04.828926  8914 log.cc:927] Time spent T f03d0dbf16864ca4bc1bb5e4c0334c0f P cd75a17ab2604397adab03bb8b5fd75c: Append to log took a long time: real 0.061s	user 0.001s	sys 0.000s
I20260709 13:19:04.829133  8927 raft_consensus.cc:3060] T fe20b4b48823486ca3b9c648db6ce8aa P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:19:04.773185  8825 consensus_queue.cc:1048] T 30e88460611e47b2ba16a46a30b5f416 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.042s
I20260709 13:19:04.842922  6772 leader_election.cc:304] T 711ef6523deb4cbe8ef2ba61e1c21c98 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:19:04.797251  8711 consensus_queue.cc:1048] T dbdf895bba214ff68685a24fd17dfb5d P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.037s
I20260709 13:19:04.801008  8845 consensus_queue.cc:1048] T 9e326172347f45e99a0d482b5d8ef768 P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.044s
W20260709 13:19:04.878464  8898 log.cc:927] Time spent T 713b5728a197487c9300b310ab94e5a3 P b7ab4784c7344b939bc36f639286f377: Append to log took a long time: real 0.164s	user 0.001s	sys 0.000s
I20260709 13:19:04.879086  8891 raft_consensus.cc:515] T c4db81d9d329422bb3b4160ca4ac2d1d P ccd8a4c3bfe3413cb2ae219b09aea832 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:04.829931  7498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be1a92657f494cac8dd227d152f50151" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb"
I20260709 13:19:04.893707  6772 leader_election.cc:304] T bb7fa124c3bf4ef9ab65a407cb008441 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb
I20260709 13:19:04.884852  6874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab432e62819d499eaaf3dd55481dd930" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:19:04.894814  6874 raft_consensus.cc:3060] T ab432e62819d499eaaf3dd55481dd930 P cd75a17ab2604397adab03bb8b5fd75c [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:04.895587  6772 leader_election.cc:304] T 4275cf08e63345f993bce8664eada830 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:19:04.908516  8918 raft_consensus.cc:493] T 7c44c4849aa54f2b94d1f1bef9ed546f P ccd8a4c3bfe3413cb2ae219b09aea832 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:04.909353  8918 raft_consensus.cc:515] T 7c44c4849aa54f2b94d1f1bef9ed546f P ccd8a4c3bfe3413cb2ae219b09aea832 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:04.912843  6802 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:32976 (request call id 2051) took 1002 ms. Trace:
I20260709 13:19:04.913203  8891 leader_election.cc:290] T c4db81d9d329422bb3b4160ca4ac2d1d P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 6 election: Requested vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:04.913527  6802 rpcz_store.cc:276] 0709 13:19:03.910641 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:03.910815 (+   174us) service_pool.cc:224] Handling call
0709 13:19:03.922580 (+ 11765us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:19:03.932899 (+ 10319us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:03.932951 (+    52us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:19:03.943708 (+ 10757us) log.cc:844] Serialized 52 byte log entry
0709 13:19:04.125799 (+182091us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:19:04.212269 (+ 86470us) log.cc:844] Serialized 14 byte log entry
0709 13:19:04.214112 (+  1843us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:04.214196 (+    84us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:04.639769 (+425573us) spinlock_profiling.cc:243] Waited 9.13 ms on lock 0x7b18002c0c80. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc15785de1 00007fcc157925b1 00007fcc0c8bd3f3 00007fcc0c8bf7c1 00007fcc0c8bf779 00007fcc0c8bf709 00007fcc0c8bf6d1 00007fcc0c8be9cd 000000000038f354 000000000038f199 00007fcc0c8a083a
0709 13:19:04.893558 (+253789us) raft_consensus.cc:1685] finished
0709 13:19:04.912529 (+ 18971us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:04.912750 (+   221us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1688,"prepare.queue_time_us":166299,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":44,"raft.queue_time_us":11324,"raft.run_cpu_time_us":269,"raft.run_wall_time_us":9849,"spinlock_wait_cycles":20999424,"thread_start_us":152973,"threads_started":2,"wal-append.queue_time_us":266317}
W20260709 13:19:04.917040  8890 log.cc:927] Time spent T 427c124d773f483294511e80fe340075 P 7ba59cc884714e8aa5f3f0ecaed84cbb: Append to log took a long time: real 1.187s	user 0.003s	sys 0.002s
I20260709 13:19:04.918511  8862 raft_consensus.cc:2804] T bb7fa124c3bf4ef9ab65a407cb008441 P b7ab4784c7344b939bc36f639286f377 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:19:04.919245  8862 raft_consensus.cc:697] T bb7fa124c3bf4ef9ab65a407cb008441 P b7ab4784c7344b939bc36f639286f377 [term 6 LEADER]: Becoming Leader. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
I20260709 13:19:04.887763  8440 raft_consensus.cc:2749] T 711ef6523deb4cbe8ef2ba61e1c21c98 P b7ab4784c7344b939bc36f639286f377 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:19:04.923353  8876 leader_election.cc:290] T 3fa34c08b205435dba97346991aa1f92 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:19:04.924271  8688 consensus_queue.cc:1059] T be1a92657f494cac8dd227d152f50151 P 7ba59cc884714e8aa5f3f0ecaed84cbb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:19:04.844558  8574 consensus_queue.cc:1059] T 7a734b5ab7834e05a8c422208acc58b1 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.081s
I20260709 13:19:04.926610  8862 consensus_queue.cc:237] T bb7fa124c3bf4ef9ab65a407cb008441 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:19:04.925458  8257 leader_election.cc:290] T 95a75bfe094d4bdc963aba3f08dfcd25 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 7 election: Requested vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
W20260709 13:19:04.929963  6727 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.677s	user 0.053s	sys 0.065s
I20260709 13:19:04.905875  6772 leader_election.cc:304] T 7c44c4849aa54f2b94d1f1bef9ed546f P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:19:04.933866  6874 raft_consensus.cc:2468] T ab432e62819d499eaaf3dd55481dd930 P cd75a17ab2604397adab03bb8b5fd75c [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 6.
W20260709 13:19:04.935276  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 61144.9us
W20260709 13:19:04.937284  6727 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.684s	user 0.053s	sys 0.065s
I20260709 13:19:04.947034  6872 raft_consensus.cc:2468] T e31b9971c15848dea59d4d4130141d9e P cd75a17ab2604397adab03bb8b5fd75c [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 4.
I20260709 13:19:04.905165  8798 raft_consensus.cc:515] T 34f36d59d88f40fe8a2805e604fc6c0a P ccd8a4c3bfe3413cb2ae219b09aea832 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:04.888191  8100 raft_consensus.cc:2749] T be1a92657f494cac8dd227d152f50151 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:19:04.941418  6772 leader_election.cc:304] T 404190ce4ce94cecbfcb6ea9d1dd8626 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, b7ab4784c7344b939bc36f639286f377; no voters: 
I20260709 13:19:04.954170  6874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22ccee1b570c4ad3a57bd7aec085b1b4" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:19:04.958413  6872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20f6842e26174571996b8dea4151d4be" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:19:04.964310  6874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f58dc08b12a2494bb9a1372837970ca2" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:19:04.967231  6874 raft_consensus.cc:3060] T f58dc08b12a2494bb9a1372837970ca2 P cd75a17ab2604397adab03bb8b5fd75c [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:04.929672  8763 raft_consensus.cc:2749] T 4275cf08e63345f993bce8664eada830 P b7ab4784c7344b939bc36f639286f377 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:19:04.983340  8798 leader_election.cc:290] T 34f36d59d88f40fe8a2805e604fc6c0a P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 3 election: Requested vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:04.925479  8688 raft_consensus.cc:3055] T be1a92657f494cac8dd227d152f50151 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:19:04.952898  8440 raft_consensus.cc:2804] T 7c44c4849aa54f2b94d1f1bef9ed546f P b7ab4784c7344b939bc36f639286f377 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:19:04.926612  8574 raft_consensus.cc:3055] T 7a734b5ab7834e05a8c422208acc58b1 P b7ab4784c7344b939bc36f639286f377 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:19:04.995236  6874 raft_consensus.cc:2468] T f58dc08b12a2494bb9a1372837970ca2 P cd75a17ab2604397adab03bb8b5fd75c [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 7.
I20260709 13:19:04.995724  6872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a92dd554674067a83a9cb68c4773f2" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
W20260709 13:19:04.986159  8767 consensus_meta.cc:287] T 9b3759de40694069b13c0f8bd40e5709 P ccd8a4c3bfe3413cb2ae219b09aea832: Time spent flushing consensus metadata: real 0.519s	user 0.013s	sys 0.000s
I20260709 13:19:04.998863  6872 raft_consensus.cc:3060] T 07a92dd554674067a83a9cb68c4773f2 P cd75a17ab2604397adab03bb8b5fd75c [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:19:04.961709  8869 raft_consensus.cc:2804] T 404190ce4ce94cecbfcb6ea9d1dd8626 P b7ab4784c7344b939bc36f639286f377 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:19:04.999220  6874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4db81d9d329422bb3b4160ca4ac2d1d" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:19:04.998907  6844 leader_election.cc:304] T 24ee15416e3145beaa1b8183453729a3 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb
W20260709 13:19:05.027990  7467 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:04.985638  8257 raft_consensus.cc:493] T 4275cf08e63345f993bce8664eada830 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader cd75a17ab2604397adab03bb8b5fd75c)
I20260709 13:19:05.033699  6874 raft_consensus.cc:3060] T c4db81d9d329422bb3b4160ca4ac2d1d P cd75a17ab2604397adab03bb8b5fd75c [term 4 FOLLOWER]: Advancing to term 6
I20260709 13:19:04.990720  8792 leader_election.cc:290] T 2c240553ce044eedb41541d72b9475d7 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 6 election: Requested vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:04.989197  8688 raft_consensus.cc:740] T be1a92657f494cac8dd227d152f50151 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 7ba59cc884714e8aa5f3f0ecaed84cbb, State: Running, Role: LEADER
W20260709 13:19:05.002343  8855 consensus_meta.cc:287] T 17587d6730594da4a56fa13a353232a1 P 7ba59cc884714e8aa5f3f0ecaed84cbb: Time spent flushing consensus metadata: real 0.528s	user 0.011s	sys 0.000s
I20260709 13:19:04.998293  8440 raft_consensus.cc:493] T 7c44c4849aa54f2b94d1f1bef9ed546f P b7ab4784c7344b939bc36f639286f377 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:04.998435  8574 raft_consensus.cc:740] T 7a734b5ab7834e05a8c422208acc58b1 P b7ab4784c7344b939bc36f639286f377 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
W20260709 13:19:05.046541  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 47734.9us
W20260709 13:19:05.050428  6695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 279411us
I20260709 13:19:05.046238  6874 raft_consensus.cc:2468] T c4db81d9d329422bb3b4160ca4ac2d1d P cd75a17ab2604397adab03bb8b5fd75c [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 6.
I20260709 13:19:05.034984  8918 leader_election.cc:290] T 7c44c4849aa54f2b94d1f1bef9ed546f P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:05.061480  6874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34f36d59d88f40fe8a2805e604fc6c0a" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:19:05.065498  6874 raft_consensus.cc:3060] T 34f36d59d88f40fe8a2805e604fc6c0a P cd75a17ab2604397adab03bb8b5fd75c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:19:05.065841  6844 leader_election.cc:400] T 427c124d773f483294511e80fe340075 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 4 pre-election: Vote denied by peer b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817) with higher term. Message: Invalid argument: T 427c124d773f483294511e80fe340075 P b7ab4784c7344b939bc36f639286f377 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c for earlier term 4. Current term is 5.
I20260709 13:19:05.066463  6844 leader_election.cc:403] T 427c124d773f483294511e80fe340075 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 4 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:19:05.069453  6872 raft_consensus.cc:2468] T 07a92dd554674067a83a9cb68c4773f2 P cd75a17ab2604397adab03bb8b5fd75c [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 5.
I20260709 13:19:05.070561  6872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c240553ce044eedb41541d72b9475d7" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:19:05.040705  8869 raft_consensus.cc:697] T 404190ce4ce94cecbfcb6ea9d1dd8626 P b7ab4784c7344b939bc36f639286f377 [term 6 LEADER]: Becoming Leader. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
I20260709 13:19:05.047235  8440 raft_consensus.cc:3060] T 7c44c4849aa54f2b94d1f1bef9ed546f P b7ab4784c7344b939bc36f639286f377 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:05.047447  8773 leader_election.cc:290] T e77e330a82df4b43a745d57a68f6f057 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 7 election: Requested vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391)
I20260709 13:19:05.032596  8767 raft_consensus.cc:515] T 9b3759de40694069b13c0f8bd40e5709 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:05.039917  8257 raft_consensus.cc:515] T 4275cf08e63345f993bce8664eada830 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:05.056422  8845 raft_consensus.cc:2804] T 24ee15416e3145beaa1b8183453729a3 P cd75a17ab2604397adab03bb8b5fd75c [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:19:05.048693  8855 raft_consensus.cc:515] T 17587d6730594da4a56fa13a353232a1 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:19:05.089061  8873 raft_consensus.cc:515] T f09c2a98de1a4decabd0ff900dd44caa P cd75a17ab2604397adab03bb8b5fd75c [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:05.092610  8688 consensus_queue.cc:260] T be1a92657f494cac8dd227d152f50151 P 7ba59cc884714e8aa5f3f0ecaed84cbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:19:05.071378  6872 raft_consensus.cc:3060] T 2c240553ce044eedb41541d72b9475d7 P cd75a17ab2604397adab03bb8b5fd75c [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:05.080888  7495 raft_consensus.cc:1275] T ce4f062dcd314d43a63ca74067cb5ee3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 6 FOLLOWER]: Refusing update from remote peer ccd8a4c3bfe3413cb2ae219b09aea832: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
W20260709 13:19:05.111994  6695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 58932.5us
I20260709 13:19:05.112596  6879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c44c4849aa54f2b94d1f1bef9ed546f" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 7 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
W20260709 13:19:05.105640  8928 log.cc:927] Time spent T a1704639a875409b9959353527b3fd68 P ccd8a4c3bfe3413cb2ae219b09aea832: Append to log took a long time: real 0.067s	user 0.000s	sys 0.001s
I20260709 13:19:05.107779  8869 consensus_queue.cc:237] T 404190ce4ce94cecbfcb6ea9d1dd8626 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:19:05.119937  8855 leader_election.cc:290] T 17587d6730594da4a56fa13a353232a1 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 8 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:19:05.122372  6802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17587d6730594da4a56fa13a353232a1" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
W20260709 13:19:05.108651  7468 leader_election.cc:336] T 427c124d773f483294511e80fe340075 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931): Timed out: RequestConsensusVote RPC to 127.5.126.67:42931 timed out after 2.060s (SENT)
I20260709 13:19:05.103075  8926 raft_consensus.cc:3060] T 427c124d773f483294511e80fe340075 P cd75a17ab2604397adab03bb8b5fd75c [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:19:05.104341  8845 raft_consensus.cc:493] T 24ee15416e3145beaa1b8183453729a3 P cd75a17ab2604397adab03bb8b5fd75c [term 4 FOLLOWER]: Starting leader election (detected failure of leader 7ba59cc884714e8aa5f3f0ecaed84cbb)
I20260709 13:19:05.109690  7499 raft_consensus.cc:1240] T 17587d6730594da4a56fa13a353232a1 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 8 FOLLOWER]: Rejecting Update request from peer b7ab4784c7344b939bc36f639286f377 for earlier term 7. Current term is 8. Ops: []
I20260709 13:19:05.103982  6844 leader_election.cc:304] T 4f00a2e87e56452083b759f60d461ee3 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, b7ab4784c7344b939bc36f639286f377
I20260709 13:19:05.113128  6695 leader_election.cc:304] T 9e326172347f45e99a0d482b5d8ef768 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: cd75a17ab2604397adab03bb8b5fd75c
W20260709 13:19:05.115860  8887 log.cc:927] Time spent T 30e88460611e47b2ba16a46a30b5f416 P ccd8a4c3bfe3413cb2ae219b09aea832: Append to log took a long time: real 1.387s	user 0.000s	sys 0.005s
I20260709 13:19:05.116175  8768 raft_consensus.cc:3055] T 4b8cacb381b746da8d0049b0a83b41dd P ccd8a4c3bfe3413cb2ae219b09aea832 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:19:05.140265  8767 leader_election.cc:290] T 9b3759de40694069b13c0f8bd40e5709 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 6 election: Requested vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:05.140626  8768 raft_consensus.cc:740] T 4b8cacb381b746da8d0049b0a83b41dd P ccd8a4c3bfe3413cb2ae219b09aea832 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
I20260709 13:19:05.141019  8767 raft_consensus.cc:2804] T 9e326172347f45e99a0d482b5d8ef768 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:19:05.141561  8768 consensus_queue.cc:260] T 4b8cacb381b746da8d0049b0a83b41dd P ccd8a4c3bfe3413cb2ae219b09aea832 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:19:05.143215  6723 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50004 (request call id 1265) took 1607 ms. Trace:
I20260709 13:19:05.143390  8768 raft_consensus.cc:3060] T 4b8cacb381b746da8d0049b0a83b41dd P ccd8a4c3bfe3413cb2ae219b09aea832 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:05.124523  6874 raft_consensus.cc:2468] T 34f36d59d88f40fe8a2805e604fc6c0a P cd75a17ab2604397adab03bb8b5fd75c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 3.
I20260709 13:19:05.146498  6874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a75bfe094d4bdc963aba3f08dfcd25" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 7 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:19:05.146873  6872 raft_consensus.cc:2468] T 2c240553ce044eedb41541d72b9475d7 P cd75a17ab2604397adab03bb8b5fd75c [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 6.
I20260709 13:19:05.147123  6874 raft_consensus.cc:3060] T 95a75bfe094d4bdc963aba3f08dfcd25 P cd75a17ab2604397adab03bb8b5fd75c [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:05.143875  6723 rpcz_store.cc:276] 0709 13:19:03.535611 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:03.549159 (+ 13548us) service_pool.cc:224] Handling call
0709 13:19:03.549711 (+   552us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:03.553587 (+  3876us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:03.553676 (+    89us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:03.573994 (+ 20318us) log.cc:844] Serialized 26 byte log entry
0709 13:19:03.723586 (+149592us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:19:03.723669 (+    83us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:03.723810 (+   141us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:05.113416 (+1389606us) spinlock_profiling.cc:243] Waited 32 ms on lock 0x7b4400022b4c. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0c745db1 00007fcc0c7e3c85 00007fcc0c7e46a2 00007fcc0f5561db 00007fcc0f551aaf 00007fcc0f54586e 00007fcc0f544bb6 00007fcc0f5447d8 00007fcc0f54e221 00007fcc0f54e1d9 00007fcc0f54e169
0709 13:19:05.142722 (+ 29306us) raft_consensus.cc:1685] finished
0709 13:19:05.142760 (+    38us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:05.143106 (+   346us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2994,"raft.queue_time_us":3180,"raft.run_cpu_time_us":150,"raft.run_wall_time_us":7167,"spinlock_wait_cycles":73529216,"thread_start_us":65513,"threads_started":1,"wal-append.queue_time_us":135289}
I20260709 13:19:05.141851  6695 leader_election.cc:304] T f4b8bd455d5a47c18a1380839c6e0d61 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
I20260709 13:19:05.117161  6879 raft_consensus.cc:2410] T 7c44c4849aa54f2b94d1f1bef9ed546f P cd75a17ab2604397adab03bb8b5fd75c [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ccd8a4c3bfe3413cb2ae219b09aea832 for term 7 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
W20260709 13:19:05.150486  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 46622us
I20260709 13:19:05.150862  6732 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50004 (request call id 1274) took 1092 ms. Trace:
I20260709 13:19:05.153143  6844 leader_election.cc:304] T 44bde925b2e541b69890d70715b85176 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:19:05.151350  6732 rpcz_store.cc:276] 0709 13:19:04.058327 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:04.065843 (+  7516us) service_pool.cc:224] Handling call
0709 13:19:04.079533 (+ 13690us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:04.103357 (+ 23824us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:04.103401 (+    44us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:04.103457 (+    56us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:19:04.103515 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:05.150566 (+1047051us) spinlock_profiling.cc:243] Waited 23.6 ms on lock 0x7b54003b7ed4. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f9aae01 00007fcc0f9a983e 00007fcc1496e419 00007fcc0dee5bd4 00007fcc0dee5b62 00007fcc0dee5a91 00007fcc0dee5a0c 00007fcc0dee4cc2 00007fcc0dce548c 00007fcc0dce48c6
0709 13:19:05.150636 (+    70us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:05.150793 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":54206848}
W20260709 13:19:05.162048  7468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 53430.5us
I20260709 13:19:05.162446  6695 leader_election.cc:304] T 24ee15416e3145beaa1b8183453729a3 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, b7ab4784c7344b939bc36f639286f377
I20260709 13:19:05.164079  6872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b56bf91d90824c959e21e0cee5ba1816" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:19:05.165629  6695 leader_election.cc:304] T 853ac0a8cbd64ce99457f170216d4d0f P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:19:05.123379  8827 raft_consensus.cc:493] T 07a92dd554674067a83a9cb68c4773f2 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:05.159927  6874 raft_consensus.cc:2468] T 95a75bfe094d4bdc963aba3f08dfcd25 P cd75a17ab2604397adab03bb8b5fd75c [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 7.
I20260709 13:19:05.161477  8773 raft_consensus.cc:2749] T 4f00a2e87e56452083b759f60d461ee3 P cd75a17ab2604397adab03bb8b5fd75c [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:19:05.149948  8767 raft_consensus.cc:697] T 9e326172347f45e99a0d482b5d8ef768 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 5 LEADER]: Becoming Leader. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
I20260709 13:19:05.169051  8910 consensus_queue.cc:1048] T ce4f062dcd314d43a63ca74067cb5ee3 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 2, Time since last communication: 0.004s
I20260709 13:19:05.170095  8767 consensus_queue.cc:237] T 9e326172347f45e99a0d482b5d8ef768 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:05.171285  8876 raft_consensus.cc:2804] T 44bde925b2e541b69890d70715b85176 P cd75a17ab2604397adab03bb8b5fd75c [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:19:05.171747  8876 raft_consensus.cc:493] T 44bde925b2e541b69890d70715b85176 P cd75a17ab2604397adab03bb8b5fd75c [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:05.134253  8845 raft_consensus.cc:3060] T 24ee15416e3145beaa1b8183453729a3 P cd75a17ab2604397adab03bb8b5fd75c [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:19:05.177130  8519 raft_consensus.cc:515] T f58dc08b12a2494bb9a1372837970ca2 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:05.177626  8440 raft_consensus.cc:515] T 7c44c4849aa54f2b94d1f1bef9ed546f P b7ab4784c7344b939bc36f639286f377 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:05.161715  8940 raft_consensus.cc:493] T b3f13b31a1f84f0d89d007eadd57924c P b7ab4784c7344b939bc36f639286f377 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:19:05.144760  8688 raft_consensus.cc:3060] T be1a92657f494cac8dd227d152f50151 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:05.143450  8938 consensus_queue.cc:1059] T e31b9971c15848dea59d4d4130141d9e P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.037s
I20260709 13:19:05.175909  8873 leader_election.cc:290] T f09c2a98de1a4decabd0ff900dd44caa P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 6 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:19:05.175628  6879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4b8bd455d5a47c18a1380839c6e0d61" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:19:05.173151  6695 leader_election.cc:304] T 7a734b5ab7834e05a8c422208acc58b1 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:19:05.189347  6872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7887766dc6784fcaa42b35c05fea7a99" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:19:05.173331  6844 leader_election.cc:304] T d8cee0accdb8499c86d4414b72565a38 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, b7ab4784c7344b939bc36f639286f377
I20260709 13:19:05.190750  6695 leader_election.cc:304] T 1528ab62b6fe4e3099d08f141afee116 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, b7ab4784c7344b939bc36f639286f377
I20260709 13:19:05.192554  6695 leader_election.cc:304] T 7887766dc6784fcaa42b35c05fea7a99 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:19:05.173817  8859 consensus_queue.cc:1059] T 4275cf08e63345f993bce8664eada830 P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.021s
I20260709 13:19:05.179806  8940 raft_consensus.cc:515] T b3f13b31a1f84f0d89d007eadd57924c P b7ab4784c7344b939bc36f639286f377 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:19:05.193854  8859 raft_consensus.cc:3055] T 4275cf08e63345f993bce8664eada830 P cd75a17ab2604397adab03bb8b5fd75c [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:19:05.180591  8440 leader_election.cc:290] T 7c44c4849aa54f2b94d1f1bef9ed546f P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 7 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:05.194919  8773 raft_consensus.cc:2749] T d8cee0accdb8499c86d4414b72565a38 P cd75a17ab2604397adab03bb8b5fd75c [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:19:05.195384  8940 leader_election.cc:290] T b3f13b31a1f84f0d89d007eadd57924c P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:19:05.196305  8932 raft_consensus.cc:2749] T 1528ab62b6fe4e3099d08f141afee116 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:19:05.196693  6844 leader_election.cc:304] T 711ef6523deb4cbe8ef2ba61e1c21c98 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:19:05.197525  8773 raft_consensus.cc:2804] T 711ef6523deb4cbe8ef2ba61e1c21c98 P cd75a17ab2604397adab03bb8b5fd75c [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:19:05.197923  8773 raft_consensus.cc:493] T 711ef6523deb4cbe8ef2ba61e1c21c98 P cd75a17ab2604397adab03bb8b5fd75c [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:05.198271  8773 raft_consensus.cc:3060] T 711ef6523deb4cbe8ef2ba61e1c21c98 P cd75a17ab2604397adab03bb8b5fd75c [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:05.181713  8927 raft_consensus.cc:515] T fe20b4b48823486ca3b9c648db6ce8aa P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:19:05.173985  8791 raft_consensus.cc:2749] T 24ee15416e3145beaa1b8183453729a3 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:19:05.180733  6874 raft_consensus.cc:1240] T 3fa34c08b205435dba97346991aa1f92 P cd75a17ab2604397adab03bb8b5fd75c [term 6 FOLLOWER]: Rejecting Update request from peer ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 5. Current term is 6. Ops: []
I20260709 13:19:05.201427  6844 leader_election.cc:304] T 3a485a995abc4807b6e511e45419f737 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:19:05.203799  6844 leader_election.cc:400] T a3022224cc81473690653a83d4e99470 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 5 pre-election: Vote denied by peer b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817) with higher term. Message: Invalid argument: T a3022224cc81473690653a83d4e99470 P b7ab4784c7344b939bc36f639286f377 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c for earlier term 5. Current term is 6.
I20260709 13:19:05.203922  6874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f58dc08b12a2494bb9a1372837970ca2" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:19:05.195436  6880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b3759de40694069b13c0f8bd40e5709" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:19:05.172358  8797 raft_consensus.cc:2804] T f4b8bd455d5a47c18a1380839c6e0d61 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:19:05.184381  8910 raft_consensus.cc:2749] T 853ac0a8cbd64ce99457f170216d4d0f P ccd8a4c3bfe3413cb2ae219b09aea832 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:19:05.173239  8831 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.958s	user 0.013s	sys 0.031s
I20260709 13:19:05.204699  6844 leader_election.cc:403] T a3022224cc81473690653a83d4e99470 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 5 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:19:05.191596  8918 raft_consensus.cc:3060] T 7a734b5ab7834e05a8c422208acc58b1 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:19:05.205497  6872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4275cf08e63345f993bce8664eada830" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:19:05.173519  8876 raft_consensus.cc:3060] T 44bde925b2e541b69890d70715b85176 P cd75a17ab2604397adab03bb8b5fd75c [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:05.204905  6874 raft_consensus.cc:2393] T f58dc08b12a2494bb9a1372837970ca2 P cd75a17ab2604397adab03bb8b5fd75c [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate ccd8a4c3bfe3413cb2ae219b09aea832 in current term 7: Already voted for candidate b7ab4784c7344b939bc36f639286f377 in this term.
I20260709 13:19:05.224654  6874 raft_consensus.cc:1275] T 3d65025eea89441290d85dd053810e31 P cd75a17ab2604397adab03bb8b5fd75c [term 4 FOLLOWER]: Refusing update from remote peer b7ab4784c7344b939bc36f639286f377: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 2. (index mismatch)
I20260709 13:19:05.225874  6874 raft_consensus.cc:1240] T e31b9971c15848dea59d4d4130141d9e P cd75a17ab2604397adab03bb8b5fd75c [term 4 FOLLOWER]: Rejecting Update request from peer ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 3. Current term is 4. Ops: []
I20260709 13:19:05.180274  8257 leader_election.cc:290] T 4275cf08e63345f993bce8664eada830 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:05.206802  8797 raft_consensus.cc:493] T f4b8bd455d5a47c18a1380839c6e0d61 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:05.179647  8519 leader_election.cc:290] T f58dc08b12a2494bb9a1372837970ca2 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 7 election: Requested vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:05.212301  6695 leader_election.cc:304] T 427c124d773f483294511e80fe340075 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, b7ab4784c7344b939bc36f639286f377
I20260709 13:19:05.194327  8859 raft_consensus.cc:740] T 4275cf08e63345f993bce8664eada830 P cd75a17ab2604397adab03bb8b5fd75c [term 4 LEADER]: Becoming Follower/Learner. State: Replica: cd75a17ab2604397adab03bb8b5fd75c, State: Running, Role: LEADER
I20260709 13:19:05.231465  8938 raft_consensus.cc:493] T 7c37d41cd9164c15a6826ca62a851a69 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:19:05.231807  8859 consensus_queue.cc:260] T 4275cf08e63345f993bce8664eada830 P cd75a17ab2604397adab03bb8b5fd75c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:05.232494  8938 raft_consensus.cc:515] T 7c37d41cd9164c15a6826ca62a851a69 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:05.233261  8859 raft_consensus.cc:3060] T 4275cf08e63345f993bce8664eada830 P cd75a17ab2604397adab03bb8b5fd75c [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:19:05.218387  7501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3f13b31a1f84f0d89d007eadd57924c" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:19:05.220767  6880 raft_consensus.cc:1240] T 34f36d59d88f40fe8a2805e604fc6c0a P cd75a17ab2604397adab03bb8b5fd75c [term 3 FOLLOWER]: Rejecting Update request from peer b7ab4784c7344b939bc36f639286f377 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 13:19:05.239233  6880 raft_consensus.cc:1240] T f09c2a98de1a4decabd0ff900dd44caa P cd75a17ab2604397adab03bb8b5fd75c [term 6 FOLLOWER]: Rejecting Update request from peer ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 5. Current term is 6. Ops: []
I20260709 13:19:05.241178  6880 raft_consensus.cc:1275] T ce4f062dcd314d43a63ca74067cb5ee3 P cd75a17ab2604397adab03bb8b5fd75c [term 6 FOLLOWER]: Refusing update from remote peer ccd8a4c3bfe3413cb2ae219b09aea832: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 13:19:05.242053  6880 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1528ab62b6fe4e3099d08f141afee116"
dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:53394
I20260709 13:19:05.242565  6880 raft_consensus.cc:606] T 1528ab62b6fe4e3099d08f141afee116 P cd75a17ab2604397adab03bb8b5fd75c [term 5 FOLLOWER]: Received request to transfer leadership
I20260709 13:19:05.242875  6880 raft_consensus.cc:614] T 1528ab62b6fe4e3099d08f141afee116 P cd75a17ab2604397adab03bb8b5fd75c [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:19:05.202582  8927 leader_election.cc:290] T fe20b4b48823486ca3b9c648db6ce8aa P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 3 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:05.209446  8873 raft_consensus.cc:2804] T 3a485a995abc4807b6e511e45419f737 P cd75a17ab2604397adab03bb8b5fd75c [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:19:05.075459  5625 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:19:05.216995  6872 raft_consensus.cc:1240] T 2c240553ce044eedb41541d72b9475d7 P cd75a17ab2604397adab03bb8b5fd75c [term 6 FOLLOWER]: Rejecting Update request from peer b7ab4784c7344b939bc36f639286f377 for earlier term 5. Current term is 6. Ops: []
I20260709 13:19:05.246866  6807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c240553ce044eedb41541d72b9475d7" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
W20260709 13:19:05.214056  8831 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.008s	user 0.013s	sys 0.032s
I20260709 13:19:05.249212  8760 raft_consensus.cc:2749] T a3022224cc81473690653a83d4e99470 P cd75a17ab2604397adab03bb8b5fd75c [term 6 FOLLOWER]: Leader pre-election lost for term 5. Reason: Vote denied by peer b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817) with higher term. Message: Invalid argument: T a3022224cc81473690653a83d4e99470 P b7ab4784c7344b939bc36f639286f377 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c for earlier term 5. Current term is 6.
I20260709 13:19:05.249990  6801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b56bf91d90824c959e21e0cee5ba1816" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:19:05.277132  6801 raft_consensus.cc:2468] T b56bf91d90824c959e21e0cee5ba1816 P b7ab4784c7344b939bc36f639286f377 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 5.
I20260709 13:19:05.250705  8911 raft_consensus.cc:2749] T 7887766dc6784fcaa42b35c05fea7a99 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:19:05.250988  6806 raft_consensus.cc:1275] T 711ef6523deb4cbe8ef2ba61e1c21c98 P b7ab4784c7344b939bc36f639286f377 [term 5 FOLLOWER]: Refusing update from remote peer ccd8a4c3bfe3413cb2ae219b09aea832: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:19:05.243382  8797 raft_consensus.cc:3060] T f4b8bd455d5a47c18a1380839c6e0d61 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:19:05.184296  8827 raft_consensus.cc:515] T 07a92dd554674067a83a9cb68c4773f2 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
W20260709 13:19:05.256634  6875 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53416 (request call id 2115) took 1317 ms (client timeout 1621 ms). Trace:
I20260709 13:19:05.271754  8773 raft_consensus.cc:515] T 711ef6523deb4cbe8ef2ba61e1c21c98 P cd75a17ab2604397adab03bb8b5fd75c [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
W20260709 13:19:05.291496  7466 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:05.292515  6875 rpcz_store.cc:269] 0709 13:19:03.939385 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:03.939529 (+   144us) service_pool.cc:224] Handling call
0709 13:19:05.256391 (+1316862us) spinlock_profiling.cc:243] Waited 167 ms on lock 0x7b5400347e54. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f9ae2fa 00007fcc1496fb17 00007fcc0deea6d4 00007fcc0deea662 00007fcc0deea591 00007fcc0deea50c 00007fcc0dee97c2 00007fcc0dce548c 00007fcc0dce48c6 00007fcc0dce426f
0709 13:19:05.256539 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":383561088}
I20260709 13:19:05.216902  8845 raft_consensus.cc:515] T 24ee15416e3145beaa1b8183453729a3 P cd75a17ab2604397adab03bb8b5fd75c [term 5 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } attrs { replace: true } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:19:05.299134  8918 raft_consensus.cc:2749] T 7a734b5ab7834e05a8c422208acc58b1 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:19:05.299211  6726 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49744 (request call id 135) took 1060 ms. Trace:
I20260709 13:19:05.313596  6726 rpcz_store.cc:276] 0709 13:19:04.238719 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:04.239055 (+   336us) service_pool.cc:224] Handling call
0709 13:19:05.298343 (+1059288us) spinlock_profiling.cc:243] Waited 1.06 ms on lock 0x7b5800000c98. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0c745db1 00007fcc0c885b71 00007fcc0c885a22 00007fcc1579ec09 00007fcc148f8ee0 00007fcc149c20ab 00007fcc149c2131 00007fcc14983fc0 00007fcc1496e929 00007fcc1496e3d2 00007fcc0dee5bd4
0709 13:19:05.298586 (+   243us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:05.298832 (+   246us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:05.298861 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:05.298905 (+    44us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:19:05.298942 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:05.299002 (+    60us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:05.299144 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2443648}
I20260709 13:19:05.285133  8873 raft_consensus.cc:697] T 3a485a995abc4807b6e511e45419f737 P cd75a17ab2604397adab03bb8b5fd75c [term 4 LEADER]: Becoming Leader. State: Replica: cd75a17ab2604397adab03bb8b5fd75c, State: Running, Role: LEADER
I20260709 13:19:05.346289  6874 raft_consensus.cc:1240] T 711ef6523deb4cbe8ef2ba61e1c21c98 P cd75a17ab2604397adab03bb8b5fd75c [term 6 FOLLOWER]: Rejecting Update request from peer ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 5. Current term is 6. Ops: []
I20260709 13:19:05.357457  6880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe20b4b48823486ca3b9c648db6ce8aa" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
W20260709 13:19:05.365000  6844 connection.cc:256] RPC call timeout handler was delayed by -2.3885011510001277s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15380000000000002s for a response
W20260709 13:19:05.365617  6844 connection.cc:256] RPC call timeout handler was delayed by -2.32190115100002s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1612s for a response
W20260709 13:19:05.366050  6844 connection.cc:256] RPC call timeout handler was delayed by -2.3075011509999968s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1628s for a response
W20260709 13:19:05.366484  6844 connection.cc:256] RPC call timeout handler was delayed by -2.2913011510001979s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1646s for a response
W20260709 13:19:05.366865  6844 connection.cc:256] RPC call timeout handler was delayed by -2.2868011510001907s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16510000000000002s for a response
W20260709 13:19:05.367231  6844 connection.cc:256] RPC call timeout handler was delayed by -2.269701151000163s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.167s for a response
W20260709 13:19:05.367879  6844 connection.cc:256] RPC call timeout handler was delayed by -2.2643011510001543s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1676s for a response
W20260709 13:19:05.368395  6844 connection.cc:256] RPC call timeout handler was delayed by -2.2409011510001164s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17020000000000002s for a response
W20260709 13:19:05.368834  6844 connection.cc:256] RPC call timeout handler was delayed by -2.2274011510000946s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17170000000000002s for a response
W20260709 13:19:05.369240  6844 connection.cc:256] RPC call timeout handler was delayed by -2.1320011510001677s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18230000000000002s for a response
W20260709 13:19:05.369736  6844 connection.cc:256] RPC call timeout handler was delayed by -2.0879011510000964s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18720000000000003s for a response
W20260709 13:19:05.370121  6844 connection.cc:256] RPC call timeout handler was delayed by -2.01590115099998s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1952s for a response
W20260709 13:19:05.370509  6844 connection.cc:256] RPC call timeout handler was delayed by -1.892601151000008s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2089s for a response
W20260709 13:19:05.370873  6844 connection.cc:256] RPC call timeout handler was delayed by -1.8836011509999935s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20990000000000003s for a response
W20260709 13:19:05.371248  6844 connection.cc:256] RPC call timeout handler was delayed by -1.8611011510001845s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21240000000000003s for a response
W20260709 13:19:05.371635  6844 connection.cc:256] RPC call timeout handler was delayed by -1.7882011510000666s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22050000000000003s for a response
W20260709 13:19:05.372000  6844 connection.cc:256] RPC call timeout handler was delayed by -1.7675011510000331s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22280000000000003s for a response
W20260709 13:19:05.372933  6844 connection.cc:256] RPC call timeout handler was delayed by -1.7486011510000026s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22490000000000002s for a response
I20260709 13:19:05.373795  6844 leader_election.cc:304] T 20f6842e26174571996b8dea4151d4be P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:19:05.299214  8845 leader_election.cc:290] T 24ee15416e3145beaa1b8183453729a3 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 5 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:19:05.376099  6801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4db81d9d329422bb3b4160ca4ac2d1d" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:19:05.376968  6801 raft_consensus.cc:3060] T c4db81d9d329422bb3b4160ca4ac2d1d P b7ab4784c7344b939bc36f639286f377 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:19:05.381383  7468 leader_election.cc:336] T bb7fa124c3bf4ef9ab65a407cb008441 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931): Timed out: RequestConsensusVote RPC to 127.5.126.67:42931 timed out after 1.645s (SENT)
I20260709 13:19:05.388623  6806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a75bfe094d4bdc963aba3f08dfcd25" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 7 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:19:05.388903  6880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe20b4b48823486ca3b9c648db6ce8aa" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:19:05.354753  8876 raft_consensus.cc:515] T 44bde925b2e541b69890d70715b85176 P cd75a17ab2604397adab03bb8b5fd75c [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:05.393998  8876 leader_election.cc:290] T 44bde925b2e541b69890d70715b85176 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 6 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:19:05.383745  8757 raft_consensus.cc:2749] T 20f6842e26174571996b8dea4151d4be P cd75a17ab2604397adab03bb8b5fd75c [term 5 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:19:05.396535  6880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb7fa124c3bf4ef9ab65a407cb008441" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:19:05.397378  6880 raft_consensus.cc:2393] T bb7fa124c3bf4ef9ab65a407cb008441 P cd75a17ab2604397adab03bb8b5fd75c [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in current term 6: Already voted for candidate b7ab4784c7344b939bc36f639286f377 in this term.
I20260709 13:19:05.398183  6880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb7fa124c3bf4ef9ab65a407cb008441" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:19:05.398824  6880 raft_consensus.cc:2393] T bb7fa124c3bf4ef9ab65a407cb008441 P cd75a17ab2604397adab03bb8b5fd75c [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in current term 6: Already voted for candidate b7ab4784c7344b939bc36f639286f377 in this term.
I20260709 13:19:05.400851  6798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c240553ce044eedb41541d72b9475d7" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:19:05.399540  6880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f00a2e87e56452083b759f60d461ee3" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:19:05.401552  6880 raft_consensus.cc:2468] T 4f00a2e87e56452083b759f60d461ee3 P cd75a17ab2604397adab03bb8b5fd75c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in term 5.
I20260709 13:19:05.404671  6798 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:32976 (request call id 2060) took 1103 ms. Trace:
I20260709 13:19:05.405045  6798 rpcz_store.cc:276] 0709 13:19:04.301170 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:04.324506 (+ 23336us) service_pool.cc:224] Handling call
0709 13:19:05.400714 (+1076208us) spinlock_profiling.cc:243] Waited 13.3 ms on lock 0x7b5800003098. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0c745db1 00007fcc0c885b71 00007fcc0c885a22 00007fcc1579ec09 00007fcc148f8ee0 00007fcc149c20ab 00007fcc149c2131 00007fcc149700a0 00007fcc1496f984 00007fcc0deea6d4 00007fcc0deea662
0709 13:19:05.404596 (+  3882us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":30538112}
I20260709 13:19:05.409026  6844 leader_election.cc:304] T de3186201e1a40d0b335eeb8b4e256e0 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:19:05.410249  6805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c44c4849aa54f2b94d1f1bef9ed546f" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 7 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:19:05.411660  6805 raft_consensus.cc:2393] T 7c44c4849aa54f2b94d1f1bef9ed546f P b7ab4784c7344b939bc36f639286f377 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ccd8a4c3bfe3413cb2ae219b09aea832 in current term 7: Already voted for candidate b7ab4784c7344b939bc36f639286f377 in this term.
I20260709 13:19:05.440255  6801 raft_consensus.cc:2468] T c4db81d9d329422bb3b4160ca4ac2d1d P b7ab4784c7344b939bc36f639286f377 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 6.
I20260709 13:19:05.441592  8773 leader_election.cc:290] T 711ef6523deb4cbe8ef2ba61e1c21c98 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 6 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
W20260709 13:19:05.442943  8943 log.cc:927] Time spent T bb7fa124c3bf4ef9ab65a407cb008441 P b7ab4784c7344b939bc36f639286f377: Append to log took a long time: real 0.229s	user 0.001s	sys 0.000s
I20260709 13:19:05.443418  8871 leader_election.cc:290] T 44bde925b2e541b69890d70715b85176 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 6 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:05.444684  8797 raft_consensus.cc:515] T f4b8bd455d5a47c18a1380839c6e0d61 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:05.445052  6844 leader_election.cc:304] T 07a92dd554674067a83a9cb68c4773f2 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377
I20260709 13:19:05.444890  8873 consensus_queue.cc:237] T 3a485a995abc4807b6e511e45419f737 P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:05.446337  6844 leader_election.cc:304] T 3d65025eea89441290d85dd053810e31 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:19:05.447309  8876 raft_consensus.cc:2749] T de3186201e1a40d0b335eeb8b4e256e0 P cd75a17ab2604397adab03bb8b5fd75c [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:19:05.447523  6844 leader_election.cc:304] T 4d9def8b32fd443aa94ab1420b06837b P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:19:05.447986  8876 raft_consensus.cc:2764] T 07a92dd554674067a83a9cb68c4773f2 P cd75a17ab2604397adab03bb8b5fd75c [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
I20260709 13:19:05.448674  8876 raft_consensus.cc:2749] T 3d65025eea89441290d85dd053810e31 P cd75a17ab2604397adab03bb8b5fd75c [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:19:05.449275  8827 leader_election.cc:290] T 07a92dd554674067a83a9cb68c4773f2 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:05.449718  6880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb7fa124c3bf4ef9ab65a407cb008441" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:19:05.450523  6880 raft_consensus.cc:2393] T bb7fa124c3bf4ef9ab65a407cb008441 P cd75a17ab2604397adab03bb8b5fd75c [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in current term 6: Already voted for candidate b7ab4784c7344b939bc36f639286f377 in this term.
I20260709 13:19:05.451277  6880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb7fa124c3bf4ef9ab65a407cb008441" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:19:05.452956  6801 raft_consensus.cc:1275] T de3186201e1a40d0b335eeb8b4e256e0 P b7ab4784c7344b939bc36f639286f377 [term 5 FOLLOWER]: Refusing update from remote peer ccd8a4c3bfe3413cb2ae219b09aea832: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:19:05.454640  8926 raft_consensus.cc:2749] T 427c124d773f483294511e80fe340075 P cd75a17ab2604397adab03bb8b5fd75c [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: Vote denied by peer b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817) with higher term. Message: Invalid argument: T 427c124d773f483294511e80fe340075 P b7ab4784c7344b939bc36f639286f377 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c for earlier term 4. Current term is 5.
I20260709 13:19:05.451944  6880 raft_consensus.cc:2393] T bb7fa124c3bf4ef9ab65a407cb008441 P cd75a17ab2604397adab03bb8b5fd75c [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in current term 6: Already voted for candidate b7ab4784c7344b939bc36f639286f377 in this term.
I20260709 13:19:05.455786  6806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4275cf08e63345f993bce8664eada830" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:19:05.456051  6880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce4f062dcd314d43a63ca74067cb5ee3" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:19:05.456372  6807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b3759de40694069b13c0f8bd40e5709" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:19:05.456686  6806 raft_consensus.cc:2393] T 4275cf08e63345f993bce8664eada830 P b7ab4784c7344b939bc36f639286f377 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ccd8a4c3bfe3413cb2ae219b09aea832 in current term 5: Already voted for candidate b7ab4784c7344b939bc36f639286f377 in this term.
I20260709 13:19:05.456856  6807 raft_consensus.cc:3060] T 9b3759de40694069b13c0f8bd40e5709 P b7ab4784c7344b939bc36f639286f377 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:05.457170  6800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f58dc08b12a2494bb9a1372837970ca2" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:19:05.457849  6806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4b8bd455d5a47c18a1380839c6e0d61" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:19:05.458240  6803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c37d41cd9164c15a6826ca62a851a69" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:19:05.458572  6806 raft_consensus.cc:3060] T f4b8bd455d5a47c18a1380839c6e0d61 P b7ab4784c7344b939bc36f639286f377 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:19:05.459491  6695 leader_election.cc:304] T b56bf91d90824c959e21e0cee5ba1816 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
I20260709 13:19:05.460690  6799 raft_consensus.cc:1240] T 90d42e216d9741e190bca19a781291fd P b7ab4784c7344b939bc36f639286f377 [term 6 FOLLOWER]: Rejecting Update request from peer ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 5. Current term is 6. Ops: []
I20260709 13:19:05.461306  6805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34f36d59d88f40fe8a2805e604fc6c0a" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:19:05.460985  8768 raft_consensus.cc:2804] T b56bf91d90824c959e21e0cee5ba1816 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:19:05.462512  8768 raft_consensus.cc:493] T b56bf91d90824c959e21e0cee5ba1816 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:05.462895  8768 raft_consensus.cc:3060] T b56bf91d90824c959e21e0cee5ba1816 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:05.461452  8892 consensus_queue.cc:1048] T 711ef6523deb4cbe8ef2ba61e1c21c98 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 1, Time since last communication: 0.003s
I20260709 13:19:05.465390  8773 raft_consensus.cc:2749] T 4d9def8b32fd443aa94ab1420b06837b P cd75a17ab2604397adab03bb8b5fd75c [term 5 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:19:05.457868  6800 raft_consensus.cc:2393] T f58dc08b12a2494bb9a1372837970ca2 P b7ab4784c7344b939bc36f639286f377 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate ccd8a4c3bfe3413cb2ae219b09aea832 in current term 7: Already voted for candidate b7ab4784c7344b939bc36f639286f377 in this term.
I20260709 13:19:05.456856  6880 raft_consensus.cc:2393] T ce4f062dcd314d43a63ca74067cb5ee3 P cd75a17ab2604397adab03bb8b5fd75c [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in current term 6: Already voted for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in this term.
W20260709 13:19:05.468706  6847 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:05.469687  6695 leader_election.cc:304] T c4db81d9d329422bb3b4160ca4ac2d1d P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
I20260709 13:19:05.470561  8892 raft_consensus.cc:2804] T c4db81d9d329422bb3b4160ca4ac2d1d P ccd8a4c3bfe3413cb2ae219b09aea832 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:19:05.471066  6772 leader_election.cc:304] T e31b9971c15848dea59d4d4130141d9e P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:19:05.473050  8827 consensus_queue.cc:1048] T de3186201e1a40d0b335eeb8b4e256e0 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:19:05.473278  6880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ba5dac66ab5497e9e336f2a3c28cda5" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:19:05.475381  8347 raft_consensus.cc:2804] T e31b9971c15848dea59d4d4130141d9e P b7ab4784c7344b939bc36f639286f377 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:19:05.480875  8347 raft_consensus.cc:697] T e31b9971c15848dea59d4d4130141d9e P b7ab4784c7344b939bc36f639286f377 [term 4 LEADER]: Becoming Leader. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
I20260709 13:19:05.485399  6772 leader_election.cc:304] T 22ccee1b570c4ad3a57bd7aec085b1b4 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:19:05.488670  6844 leader_election.cc:304] T d8292e16e5654be6bc408560cf256aaa P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377
I20260709 13:19:05.489375  6880 raft_consensus.cc:2468] T 7ba5dac66ab5497e9e336f2a3c28cda5 P cd75a17ab2604397adab03bb8b5fd75c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in term 5.
W20260709 13:19:05.473613  8903 log.cc:927] Time spent T 90d42e216d9741e190bca19a781291fd P cd75a17ab2604397adab03bb8b5fd75c: Append to log took a long time: real 1.228s	user 0.003s	sys 0.000s
I20260709 13:19:05.491828  6807 raft_consensus.cc:2468] T 9b3759de40694069b13c0f8bd40e5709 P b7ab4784c7344b939bc36f639286f377 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 6.
I20260709 13:19:05.490326  6772 leader_election.cc:304] T f58dc08b12a2494bb9a1372837970ca2 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:19:05.498088  6800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a92dd554674067a83a9cb68c4773f2" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:19:05.509979  6800 raft_consensus.cc:2393] T 07a92dd554674067a83a9cb68c4773f2 P b7ab4784c7344b939bc36f639286f377 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ccd8a4c3bfe3413cb2ae219b09aea832 in current term 5: Already voted for candidate b7ab4784c7344b939bc36f639286f377 in this term.
I20260709 13:19:05.510232  6772 leader_election.cc:304] T 07a92dd554674067a83a9cb68c4773f2 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:19:05.511612  6772 leader_election.cc:304] T 7887766dc6784fcaa42b35c05fea7a99 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:19:05.515064  6772 leader_election.cc:304] T f4b8bd455d5a47c18a1380839c6e0d61 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:19:05.520026  6844 leader_election.cc:304] T 7a734b5ab7834e05a8c422208acc58b1 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:19:05.521662  6844 leader_election.cc:304] T 2c240553ce044eedb41541d72b9475d7 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:19:05.500572  8869 raft_consensus.cc:2749] T 22ccee1b570c4ad3a57bd7aec085b1b4 P b7ab4784c7344b939bc36f639286f377 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:19:05.538269  7467 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:05.538968  6806 raft_consensus.cc:2468] T f4b8bd455d5a47c18a1380839c6e0d61 P b7ab4784c7344b939bc36f639286f377 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 5.
I20260709 13:19:05.471118  8892 raft_consensus.cc:697] T c4db81d9d329422bb3b4160ca4ac2d1d P ccd8a4c3bfe3413cb2ae219b09aea832 [term 6 LEADER]: Becoming Leader. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
I20260709 13:19:05.527498  8926 raft_consensus.cc:2749] T 7a734b5ab7834e05a8c422208acc58b1 P cd75a17ab2604397adab03bb8b5fd75c [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:19:05.543232  6880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce4f062dcd314d43a63ca74067cb5ee3" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:19:05.525588  8823 raft_consensus.cc:2749] T 7887766dc6784fcaa42b35c05fea7a99 P b7ab4784c7344b939bc36f639286f377 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:19:05.555230  6880 raft_consensus.cc:2393] T ce4f062dcd314d43a63ca74067cb5ee3 P cd75a17ab2604397adab03bb8b5fd75c [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in current term 6: Already voted for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in this term.
I20260709 13:19:05.555665  6844 leader_election.cc:304] T 7c44c4849aa54f2b94d1f1bef9ed546f P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377
I20260709 13:19:05.525854  8446 raft_consensus.cc:2804] T 07a92dd554674067a83a9cb68c4773f2 P b7ab4784c7344b939bc36f639286f377 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:19:05.527293  8859 raft_consensus.cc:2804] T d8292e16e5654be6bc408560cf256aaa P cd75a17ab2604397adab03bb8b5fd75c [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:19:05.535144  8773 raft_consensus.cc:2749] T 2c240553ce044eedb41541d72b9475d7 P cd75a17ab2604397adab03bb8b5fd75c [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:19:05.545131  8440 raft_consensus.cc:2749] T f4b8bd455d5a47c18a1380839c6e0d61 P b7ab4784c7344b939bc36f639286f377 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:19:05.544770  8757 raft_consensus.cc:493] T dbdf895bba214ff68685a24fd17dfb5d P cd75a17ab2604397adab03bb8b5fd75c [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:05.510893  8918 consensus_queue.cc:1059] T 90d42e216d9741e190bca19a781291fd P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.039s
I20260709 13:19:05.578931  6844 leader_election.cc:304] T 07a92dd554674067a83a9cb68c4773f2 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377
I20260709 13:19:05.576254  8845 raft_consensus.cc:2804] T 7c44c4849aa54f2b94d1f1bef9ed546f P cd75a17ab2604397adab03bb8b5fd75c [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:19:05.578028  6876 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53416 (request call id 2129) took 1631 ms. Trace:
I20260709 13:19:05.525915  8871 raft_consensus.cc:2804] T f58dc08b12a2494bb9a1372837970ca2 P b7ab4784c7344b939bc36f639286f377 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:19:05.549791  8797 leader_election.cc:290] T f4b8bd455d5a47c18a1380839c6e0d61 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 5 election: Requested vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:05.580989  6876 rpcz_store.cc:276] 0709 13:19:03.946522 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:04.033053 (+ 86531us) service_pool.cc:224] Handling call
0709 13:19:04.063924 (+ 30871us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:04.076322 (+ 12398us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:04.076392 (+    70us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:04.088669 (+ 12277us) log.cc:844] Serialized 26 byte log entry
0709 13:19:04.194456 (+105787us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:19:04.194505 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:04.194584 (+    79us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:05.472588 (+1278004us) spinlock_profiling.cc:243] Waited 1.59 ms on lock 0x7b4400022b4c. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0c745db1 00007fcc0c7e3c85 00007fcc0c7e46a2 00007fcc0f5561db 00007fcc0f551aaf 00007fcc0f54586e 00007fcc0f544bb6 00007fcc0f5447d8 00007fcc0f54e221 00007fcc0f54e1d9 00007fcc0f54e169
0709 13:19:05.572528 (+ 99940us) raft_consensus.cc:1685] finished
0709 13:19:05.572550 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:05.577958 (+  5408us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":22303,"raft.queue_time_us":7564,"raft.run_cpu_time_us":147,"raft.run_wall_time_us":5215,"spinlock_wait_cycles":3646336,"thread_start_us":69517,"threads_started":1,"wal-append.queue_time_us":124327}
I20260709 13:19:05.574515  8864 consensus_queue.cc:1048] T 3d65025eea89441290d85dd053810e31 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.005s
I20260709 13:19:05.589648  8823 consensus_queue.cc:1059] T 2c240553ce044eedb41541d72b9475d7 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.007s
I20260709 13:19:05.591130  6880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8cee0accdb8499c86d4414b72565a38" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:19:05.633471  6880 raft_consensus.cc:2468] T d8cee0accdb8499c86d4414b72565a38 P cd75a17ab2604397adab03bb8b5fd75c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in term 5.
I20260709 13:19:05.557015  8876 consensus_queue.cc:1059] T 3411566abe2d4c9bb4b2adfdd05e6f17 P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.034s
W20260709 13:19:05.637899  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 56427.9us
I20260709 13:19:05.641258  6876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "427c124d773f483294511e80fe340075" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:19:05.642259  6876 raft_consensus.cc:2468] T 427c124d773f483294511e80fe340075 P cd75a17ab2604397adab03bb8b5fd75c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in term 5.
I20260709 13:19:05.584579  8446 raft_consensus.cc:697] T 07a92dd554674067a83a9cb68c4773f2 P b7ab4784c7344b939bc36f639286f377 [term 5 LEADER]: Becoming Leader. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
I20260709 13:19:05.595690  8760 raft_consensus.cc:2764] T 07a92dd554674067a83a9cb68c4773f2 P cd75a17ab2604397adab03bb8b5fd75c [term 5 FOLLOWER]: Leader election decision vote started in defunct term 4: won
I20260709 13:19:05.654608  6880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "427c124d773f483294511e80fe340075" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:19:05.655552  6880 raft_consensus.cc:2468] T 427c124d773f483294511e80fe340075 P cd75a17ab2604397adab03bb8b5fd75c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in term 5.
I20260709 13:19:05.577489  8862 consensus_queue.cc:1059] T 34f36d59d88f40fe8a2805e604fc6c0a P b7ab4784c7344b939bc36f639286f377 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.070s
I20260709 13:19:05.653159  8845 raft_consensus.cc:697] T 7c44c4849aa54f2b94d1f1bef9ed546f P cd75a17ab2604397adab03bb8b5fd75c [term 6 LEADER]: Becoming Leader. State: Replica: cd75a17ab2604397adab03bb8b5fd75c, State: Running, Role: LEADER
I20260709 13:19:05.658314  6879 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53406 (request call id 1330) took 1043 ms. Trace:
I20260709 13:19:05.590750  8919 consensus_queue.cc:1059] T b56bf91d90824c959e21e0cee5ba1816 P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.064s
I20260709 13:19:05.574527  8347 consensus_queue.cc:237] T e31b9971c15848dea59d4d4130141d9e P b7ab4784c7344b939bc36f639286f377 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:05.649511  8892 consensus_queue.cc:237] T c4db81d9d329422bb3b4160ca4ac2d1d P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:05.673053  8845 consensus_queue.cc:237] T 7c44c4849aa54f2b94d1f1bef9ed546f P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:05.717891  6732 raft_consensus.cc:1240] T 7a734b5ab7834e05a8c422208acc58b1 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 5 FOLLOWER]: Rejecting Update request from peer b7ab4784c7344b939bc36f639286f377 for earlier term 4. Current term is 5. Ops: []
I20260709 13:19:05.685272  8768 raft_consensus.cc:515] T b56bf91d90824c959e21e0cee5ba1816 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:05.591202  8757 raft_consensus.cc:515] T dbdf895bba214ff68685a24fd17dfb5d P cd75a17ab2604397adab03bb8b5fd75c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
W20260709 13:19:05.691417  8916 log.cc:927] Time spent T f5be3a11b23d4ea9b08300a2789821c7 P ccd8a4c3bfe3413cb2ae219b09aea832: Append to log took a long time: real 0.867s	user 0.004s	sys 0.000s
I20260709 13:19:05.663766  6879 rpcz_store.cc:276] 0709 13:19:04.615060 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:05.205437 (+590377us) service_pool.cc:224] Handling call
0709 13:19:05.230212 (+ 24775us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:05.230764 (+   552us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:19:05.282006 (+ 51242us) log.cc:844] Serialized 14 byte log entry
0709 13:19:05.657844 (+375838us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:05.657899 (+    55us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:19:05.657969 (+    70us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:05.658042 (+    73us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:05.658250 (+   208us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8669,"prepare.queue_time_us":51010,"prepare.run_cpu_time_us":9843,"prepare.run_wall_time_us":81598,"thread_start_us":366670,"threads_started":1}
I20260709 13:19:05.705909  8919 raft_consensus.cc:3055] T b56bf91d90824c959e21e0cee5ba1816 P cd75a17ab2604397adab03bb8b5fd75c [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:19:05.705755  8933 raft_consensus.cc:3055] T e31b9971c15848dea59d4d4130141d9e P ccd8a4c3bfe3413cb2ae219b09aea832 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:19:05.708986  6726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c44c4849aa54f2b94d1f1bef9ed546f" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
W20260709 13:19:05.636483  7468 leader_election.cc:336] T bb7fa124c3bf4ef9ab65a407cb008441 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931): Timed out: RequestConsensusVote RPC to 127.5.126.67:42931 timed out after 1.870s (SENT)
I20260709 13:19:05.727239  6726 raft_consensus.cc:2468] T 7c44c4849aa54f2b94d1f1bef9ed546f P ccd8a4c3bfe3413cb2ae219b09aea832 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 6.
I20260709 13:19:05.727869  7468 leader_election.cc:304] T bb7fa124c3bf4ef9ab65a407cb008441 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:19:05.710343  6878 leader_election.cc:290] T 3fa34c08b205435dba97346991aa1f92 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 6 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:19:05.717664  6730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20f6842e26174571996b8dea4151d4be" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
W20260709 13:19:05.729101  7468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 92674.6us
I20260709 13:19:05.720193  6876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1528ab62b6fe4e3099d08f141afee116" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
W20260709 13:19:05.720741  7466 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:05.725888  6723 raft_consensus.cc:1240] T 95a75bfe094d4bdc963aba3f08dfcd25 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 7 FOLLOWER]: Rejecting Update request from peer b7ab4784c7344b939bc36f639286f377 for earlier term 6. Current term is 7. Ops: [6.2-6.2]
I20260709 13:19:05.687467  8446 consensus_queue.cc:237] T 07a92dd554674067a83a9cb68c4773f2 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:05.730934  6876 raft_consensus.cc:2376] T 1528ab62b6fe4e3099d08f141afee116 P cd75a17ab2604397adab03bb8b5fd75c [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in term 5. Re-sending same reply.
I20260709 13:19:05.733814  6732 raft_consensus.cc:1275] T 17587d6730594da4a56fa13a353232a1 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 7 FOLLOWER]: Refusing update from remote peer b7ab4784c7344b939bc36f639286f377: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:19:05.730964  7468 leader_election.cc:304] T ce4f062dcd314d43a63ca74067cb5ee3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, b7ab4784c7344b939bc36f639286f377; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:19:05.719249  8797 raft_consensus.cc:493] T 1bf4668eeb70467fb3dc5a0289233b3c P ccd8a4c3bfe3413cb2ae219b09aea832 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:19:05.754571  6878 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RunLeaderElection from 127.0.0.1:53416 (request call id 2096) took 4231 ms. Trace:
I20260709 13:19:05.756644  6878 rpcz_store.cc:276] 0709 13:19:01.497502 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:01.498148 (+   646us) service_pool.cc:224] Handling call
0709 13:19:05.659289 (+4161141us) spinlock_profiling.cc:243] Waited 2.3 s on lock 0x7b54001428d4. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f9a1a3d 00007fcc14971cd0 00007fcc0def6254 00007fcc0def61e2 00007fcc0def6111 00007fcc0def608c 00007fcc0def5342 00007fcc0dce548c 00007fcc0dce48c6 00007fcc0dce426f
0709 13:19:05.728866 (+ 69577us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5299075328}
I20260709 13:19:05.758224  6878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8292e16e5654be6bc408560cf256aaa" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:19:05.759167  6723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f58dc08b12a2494bb9a1372837970ca2" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:19:05.760078  6723 raft_consensus.cc:2393] T f58dc08b12a2494bb9a1372837970ca2 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate b7ab4784c7344b939bc36f639286f377 in current term 7: Already voted for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in this term.
I20260709 13:19:05.723999  8919 raft_consensus.cc:740] T b56bf91d90824c959e21e0cee5ba1816 P cd75a17ab2604397adab03bb8b5fd75c [term 4 LEADER]: Becoming Follower/Learner. State: Replica: cd75a17ab2604397adab03bb8b5fd75c, State: Running, Role: LEADER
I20260709 13:19:05.726859  8933 raft_consensus.cc:740] T e31b9971c15848dea59d4d4130141d9e P ccd8a4c3bfe3413cb2ae219b09aea832 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
I20260709 13:19:05.735035  8826 raft_consensus.cc:2749] T bb7fa124c3bf4ef9ab65a407cb008441 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
W20260709 13:19:05.768011  6697 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 205490us
I20260709 13:19:05.762490  6879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3d8792045a4583ae2e965b1350a5b4" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:19:05.772472  6876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c44c4849aa54f2b94d1f1bef9ed546f" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:19:05.773932  6879 raft_consensus.cc:2468] T bb3d8792045a4583ae2e965b1350a5b4 P cd75a17ab2604397adab03bb8b5fd75c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in term 4.
W20260709 13:19:05.778573  6772 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.68:45071, user_credentials={real_user=slave}} blocked reactor thread for 198103us
I20260709 13:19:05.788188  6730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90d42e216d9741e190bca19a781291fd" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:19:05.789309  6723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a92dd554674067a83a9cb68c4773f2" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:19:05.789997  6723 raft_consensus.cc:3060] T 07a92dd554674067a83a9cb68c4773f2 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:19:05.790952  6727 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50004 (request call id 1262) took 2387 ms. Trace:
I20260709 13:19:05.760049  8927 raft_consensus.cc:2749] T ce4f062dcd314d43a63ca74067cb5ee3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:19:05.794133  6876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ba5dac66ab5497e9e336f2a3c28cda5" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:19:05.823792  6876 raft_consensus.cc:2468] T 7ba5dac66ab5497e9e336f2a3c28cda5 P cd75a17ab2604397adab03bb8b5fd75c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in term 5.
I20260709 13:19:05.824937  6876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe20b4b48823486ca3b9c648db6ce8aa" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:19:05.791330  6727 rpcz_store.cc:276] 0709 13:19:03.387864 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:03.458457 (+ 70593us) service_pool.cc:224] Handling call
0709 13:19:04.251418 (+792961us) spinlock_profiling.cc:243] Waited 2.94 ms on lock 0x7b5800000c98. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0c745db1 00007fcc0c885b71 00007fcc0c885a22 00007fcc1579ec09 00007fcc148f8ee0 00007fcc149c20ab 00007fcc149c2131 00007fcc14983fc0 00007fcc1496e929 00007fcc1496e3d2 00007fcc0dee5bd4
0709 13:19:04.251669 (+   251us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:04.252189 (+   520us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:04.252216 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:04.252746 (+   530us) log.cc:844] Serialized 26 byte log entry
0709 13:19:04.942838 (+690092us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:19:04.942882 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:04.942954 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:05.690315 (+747361us) spinlock_profiling.cc:243] Waited 20 ms on lock 0x7b4400022b4c. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0c745db1 00007fcc0c7e3c85 00007fcc0c7e46a2 00007fcc0f5561db 00007fcc0f551aaf 00007fcc0f54586e 00007fcc0f544bb6 00007fcc0f5447d8 00007fcc0f54e221 00007fcc0f54e1d9 00007fcc0f54e169
0709 13:19:05.774962 (+ 84647us) raft_consensus.cc:1685] finished
0709 13:19:05.774982 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:05.775116 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2240,"raft.queue_time_us":3774,"raft.run_cpu_time_us":187,"raft.run_wall_time_us":5182,"spinlock_wait_cycles":52688896,"thread_start_us":689642,"threads_started":1,"wal-append.queue_time_us":571212}
I20260709 13:19:05.821080  6730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be1a92657f494cac8dd227d152f50151" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:19:05.821532  6879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f00a2e87e56452083b759f60d461ee3" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:19:05.826836  6723 raft_consensus.cc:2468] T 07a92dd554674067a83a9cb68c4773f2 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 5.
I20260709 13:19:05.826346  6879 raft_consensus.cc:2468] T 4f00a2e87e56452083b759f60d461ee3 P cd75a17ab2604397adab03bb8b5fd75c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in term 5.
I20260709 13:19:05.834975  6876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44bde925b2e541b69890d70715b85176" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:19:05.835820  6876 raft_consensus.cc:2393] T 44bde925b2e541b69890d70715b85176 P cd75a17ab2604397adab03bb8b5fd75c [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate b7ab4784c7344b939bc36f639286f377 in current term 6: Already voted for candidate cd75a17ab2604397adab03bb8b5fd75c in this term.
I20260709 13:19:05.836843  7468 leader_election.cc:304] T 7ba5dac66ab5497e9e336f2a3c28cda5 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377
I20260709 13:19:05.838295  6726 raft_consensus.cc:1275] T a3022224cc81473690653a83d4e99470 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 6 FOLLOWER]: Refusing update from remote peer b7ab4784c7344b939bc36f639286f377: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:19:05.756721  8797 raft_consensus.cc:515] T 1bf4668eeb70467fb3dc5a0289233b3c P ccd8a4c3bfe3413cb2ae219b09aea832 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:05.843658  8797 leader_election.cc:290] T 1bf4668eeb70467fb3dc5a0289233b3c P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:05.844249  7498 raft_consensus.cc:1275] T bb7fa124c3bf4ef9ab65a407cb008441 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 6 FOLLOWER]: Refusing update from remote peer b7ab4784c7344b939bc36f639286f377: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:19:05.845551  6876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "427c124d773f483294511e80fe340075" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:19:05.854187  6726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8292e16e5654be6bc408560cf256aaa" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:19:05.859398  6726 raft_consensus.cc:2468] T d8292e16e5654be6bc408560cf256aaa P ccd8a4c3bfe3413cb2ae219b09aea832 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 6.
I20260709 13:19:05.859948  6879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe20b4b48823486ca3b9c648db6ce8aa" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:19:05.871109  6876 raft_consensus.cc:2468] T 427c124d773f483294511e80fe340075 P cd75a17ab2604397adab03bb8b5fd75c [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in term 5.
I20260709 13:19:05.862381  8871 raft_consensus.cc:697] T f58dc08b12a2494bb9a1372837970ca2 P b7ab4784c7344b939bc36f639286f377 [term 7 LEADER]: Becoming Leader. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
I20260709 13:19:05.861030  8797 raft_consensus.cc:493] T d33d5ee8ef6f415593d8df52063161ad P ccd8a4c3bfe3413cb2ae219b09aea832 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:05.914925  7468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 78133.5us
I20260709 13:19:05.917421  7468 leader_election.cc:304] T 4f00a2e87e56452083b759f60d461ee3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377
I20260709 13:19:05.917289  6879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "427c124d773f483294511e80fe340075" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:19:05.885965  8911 raft_consensus.cc:493] T a3022224cc81473690653a83d4e99470 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:05.918520  6879 raft_consensus.cc:2376] T 427c124d773f483294511e80fe340075 P cd75a17ab2604397adab03bb8b5fd75c [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in term 5. Re-sending same reply.
I20260709 13:19:05.907074  8826 raft_consensus.cc:2804] T 7ba5dac66ab5497e9e336f2a3c28cda5 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:19:05.884613  8859 raft_consensus.cc:697] T d8292e16e5654be6bc408560cf256aaa P cd75a17ab2604397adab03bb8b5fd75c [term 6 LEADER]: Becoming Leader. State: Replica: cd75a17ab2604397adab03bb8b5fd75c, State: Running, Role: LEADER
I20260709 13:19:05.950145  8859 consensus_queue.cc:237] T d8292e16e5654be6bc408560cf256aaa P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
W20260709 13:19:05.955031  8955 log.cc:927] Time spent T f09c2a98de1a4decabd0ff900dd44caa P b7ab4784c7344b939bc36f639286f377: Append to log took a long time: real 0.180s	user 0.000s	sys 0.001s
I20260709 13:19:05.964737  8871 consensus_queue.cc:237] T f58dc08b12a2494bb9a1372837970ca2 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:05.971690  7496 raft_consensus.cc:1240] T fe20b4b48823486ca3b9c648db6ce8aa P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 3 FOLLOWER]: Rejecting Update request from peer cd75a17ab2604397adab03bb8b5fd75c for earlier term 2. Current term is 3. Ops: [2.5-2.5]
I20260709 13:19:05.947325  6881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b8cacb381b746da8d0049b0a83b41dd" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:19:05.858206  8933 consensus_queue.cc:260] T e31b9971c15848dea59d4d4130141d9e P ccd8a4c3bfe3413cb2ae219b09aea832 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:05.944657  8826 raft_consensus.cc:493] T 7ba5dac66ab5497e9e336f2a3c28cda5 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 5 FOLLOWER]: Starting leader election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
W20260709 13:19:05.983549  7468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 64667.1us
I20260709 13:19:05.984839  7501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fa34c08b205435dba97346991aa1f92" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:19:05.987119  6879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b8cacb381b746da8d0049b0a83b41dd" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:19:05.992476  6872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fa34c08b205435dba97346991aa1f92" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:19:05.993417  6872 raft_consensus.cc:2393] T 3fa34c08b205435dba97346991aa1f92 P cd75a17ab2604397adab03bb8b5fd75c [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in current term 6: Already voted for candidate cd75a17ab2604397adab03bb8b5fd75c in this term.
I20260709 13:19:05.993789  7495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fa34c08b205435dba97346991aa1f92" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: true dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb"
I20260709 13:19:05.994580  7495 raft_consensus.cc:3060] T 3fa34c08b205435dba97346991aa1f92 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:05.995110  6872 raft_consensus.cc:1275] T 427c124d773f483294511e80fe340075 P cd75a17ab2604397adab03bb8b5fd75c [term 5 FOLLOWER]: Refusing update from remote peer 7ba59cc884714e8aa5f3f0ecaed84cbb: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:19:05.997175  6872 raft_consensus.cc:1240] T 24ee15416e3145beaa1b8183453729a3 P cd75a17ab2604397adab03bb8b5fd75c [term 5 FOLLOWER]: Rejecting Update request from peer 7ba59cc884714e8aa5f3f0ecaed84cbb for earlier term 4. Current term is 5. Ops: []
I20260709 13:19:05.998911  6872 raft_consensus.cc:1275] T a3022224cc81473690653a83d4e99470 P cd75a17ab2604397adab03bb8b5fd75c [term 6 FOLLOWER]: Refusing update from remote peer b7ab4784c7344b939bc36f639286f377: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:19:06.001037  7500 raft_consensus.cc:1275] T 4b8cacb381b746da8d0049b0a83b41dd P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 6 FOLLOWER]: Refusing update from remote peer cd75a17ab2604397adab03bb8b5fd75c: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:19:06.006269  6881 raft_consensus.cc:1240] T 4f00a2e87e56452083b759f60d461ee3 P cd75a17ab2604397adab03bb8b5fd75c [term 5 FOLLOWER]: Rejecting Update request from peer 7ba59cc884714e8aa5f3f0ecaed84cbb for earlier term 4. Current term is 5. Ops: []
I20260709 13:19:05.991950  8926 consensus_queue.cc:1059] T fe20b4b48823486ca3b9c648db6ce8aa P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.018s
I20260709 13:19:06.009465  8768 leader_election.cc:290] T b56bf91d90824c959e21e0cee5ba1816 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 6 election: Requested vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:06.010185  8768 raft_consensus.cc:493] T dbdf895bba214ff68685a24fd17dfb5d P ccd8a4c3bfe3413cb2ae219b09aea832 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:19:06.010459  8926 raft_consensus.cc:3055] T fe20b4b48823486ca3b9c648db6ce8aa P cd75a17ab2604397adab03bb8b5fd75c [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:19:06.009701  6879 raft_consensus.cc:2955] T 1528ab62b6fe4e3099d08f141afee116 P cd75a17ab2604397adab03bb8b5fd75c [term 5 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } attrs { replace: true } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } } }
I20260709 13:19:06.010875  8768 raft_consensus.cc:515] T dbdf895bba214ff68685a24fd17dfb5d P ccd8a4c3bfe3413cb2ae219b09aea832 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:06.010895  8926 raft_consensus.cc:740] T fe20b4b48823486ca3b9c648db6ce8aa P cd75a17ab2604397adab03bb8b5fd75c [term 2 LEADER]: Becoming Follower/Learner. State: Replica: cd75a17ab2604397adab03bb8b5fd75c, State: Running, Role: LEADER
I20260709 13:19:05.929566  8797 raft_consensus.cc:515] T d33d5ee8ef6f415593d8df52063161ad P ccd8a4c3bfe3413cb2ae219b09aea832 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:06.012194  7496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24ee15416e3145beaa1b8183453729a3" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb"
I20260709 13:19:06.012604  8926 consensus_queue.cc:260] T fe20b4b48823486ca3b9c648db6ce8aa P cd75a17ab2604397adab03bb8b5fd75c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:19:06.013942  8926 raft_consensus.cc:3060] T fe20b4b48823486ca3b9c648db6ce8aa P cd75a17ab2604397adab03bb8b5fd75c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:19:06.014210  8797 leader_election.cc:290] T d33d5ee8ef6f415593d8df52063161ad P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:05.974314  8911 raft_consensus.cc:515] T a3022224cc81473690653a83d4e99470 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:06.016956  8911 leader_election.cc:290] T a3022224cc81473690653a83d4e99470 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:06.012378  8973 raft_consensus.cc:2804] T 4f00a2e87e56452083b759f60d461ee3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:19:06.021677  8973 raft_consensus.cc:493] T 4f00a2e87e56452083b759f60d461ee3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:06.021914  8793 leader_election.cc:290] T 3d65025eea89441290d85dd053810e31 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:05.991710  8826 raft_consensus.cc:3060] T 7ba5dac66ab5497e9e336f2a3c28cda5 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:06.015324  8574 consensus_queue.cc:260] T 7a734b5ab7834e05a8c422208acc58b1 P b7ab4784c7344b939bc36f639286f377 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:05.910378  8919 consensus_queue.cc:260] T b56bf91d90824c959e21e0cee5ba1816 P cd75a17ab2604397adab03bb8b5fd75c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:06.004658  8757 leader_election.cc:290] T dbdf895bba214ff68685a24fd17dfb5d P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
W20260709 13:19:06.107457  7467 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:06.064145  6873 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53416 (request call id 2125) took 2118 ms (client timeout 2152 ms). Trace:
I20260709 13:19:06.034910  6874 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53416 (request call id 2147) took 1096 ms. Trace:
I20260709 13:19:06.136729  6874 rpcz_store.cc:276] 0709 13:19:04.938393 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:05.226513 (+288120us) service_pool.cc:224] Handling call
0709 13:19:05.226751 (+   238us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:05.346853 (+120102us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:06.034469 (+687616us) spinlock_profiling.cc:243] Waited 119 ms on lock 0x7b54001e96d4. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f9aae01 00007fcc0f9a983e 00007fcc1496e419 00007fcc0dee5bd4 00007fcc0dee5b62 00007fcc0dee5a91 00007fcc0dee5a0c 00007fcc0dee4cc2 00007fcc0dce548c 00007fcc0dce48c6
0709 13:19:06.034799 (+   330us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":274381056}
W20260709 13:19:06.074744  6847 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:06.135987  6873 rpcz_store.cc:269] 0709 13:19:03.945409 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:03.990408 (+ 44999us) service_pool.cc:224] Handling call
0709 13:19:06.063860 (+2073452us) spinlock_profiling.cc:243] Waited 150 ms on lock 0x7b54002184d4. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f9ae2fa 00007fcc1496fb17 00007fcc0deea6d4 00007fcc0deea662 00007fcc0deea591 00007fcc0deea50c 00007fcc0dee97c2 00007fcc0dce548c 00007fcc0dce48c6 00007fcc0dce426f
0709 13:19:06.064016 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":344758016}
W20260709 13:19:06.140245  6697 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 156832us
I20260709 13:19:06.064205  8574 raft_consensus.cc:3060] T 7a734b5ab7834e05a8c422208acc58b1 P b7ab4784c7344b939bc36f639286f377 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:19:06.029819  8973 raft_consensus.cc:3060] T 4f00a2e87e56452083b759f60d461ee3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:06.033196  8768 leader_election.cc:290] T dbdf895bba214ff68685a24fd17dfb5d P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:06.139091  8919 raft_consensus.cc:3060] T b56bf91d90824c959e21e0cee5ba1816 P cd75a17ab2604397adab03bb8b5fd75c [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:19:06.161466  8961 log.cc:927] Time spent T 711ef6523deb4cbe8ef2ba61e1c21c98 P b7ab4784c7344b939bc36f639286f377: Append to log took a long time: real 0.125s	user 0.000s	sys 0.001s
I20260709 13:19:06.030421  8845 consensus_queue.cc:1048] T 4b8cacb381b746da8d0049b0a83b41dd P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.128s
I20260709 13:19:06.157682  6697 leader_election.cc:304] T 8c7f33e544204fbaac4078e3e83bbf4e P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:19:06.160147  6873 raft_consensus.cc:1275] T d33d5ee8ef6f415593d8df52063161ad P cd75a17ab2604397adab03bb8b5fd75c [term 6 FOLLOWER]: Refusing update from remote peer b7ab4784c7344b939bc36f639286f377: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:19:06.171177  6873 raft_consensus.cc:1240] T 7a734b5ab7834e05a8c422208acc58b1 P cd75a17ab2604397adab03bb8b5fd75c [term 5 FOLLOWER]: Rejecting Update request from peer b7ab4784c7344b939bc36f639286f377 for earlier term 4. Current term is 5. Ops: []
W20260709 13:19:06.158154  8932 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.905s	user 0.013s	sys 0.018s
I20260709 13:19:06.078939  7495 raft_consensus.cc:2468] T 3fa34c08b205435dba97346991aa1f92 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 6.
I20260709 13:19:06.172664  6873 raft_consensus.cc:1240] T 95a75bfe094d4bdc963aba3f08dfcd25 P cd75a17ab2604397adab03bb8b5fd75c [term 7 FOLLOWER]: Rejecting Update request from peer b7ab4784c7344b939bc36f639286f377 for earlier term 6. Current term is 7. Ops: []
I20260709 13:19:06.171509  6697 leader_election.cc:304] T 3d65025eea89441290d85dd053810e31 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377
I20260709 13:19:06.183132  8768 raft_consensus.cc:2804] T 3d65025eea89441290d85dd053810e31 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:19:06.184576  8768 raft_consensus.cc:493] T 3d65025eea89441290d85dd053810e31 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:06.185747  8768 raft_consensus.cc:3060] T 3d65025eea89441290d85dd053810e31 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:19:06.193924  8938 leader_election.cc:290] T 7c37d41cd9164c15a6826ca62a851a69 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:06.194329  6726 raft_consensus.cc:1240] T 9e326172347f45e99a0d482b5d8ef768 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 5 LEADER]: Rejecting Update request from peer cd75a17ab2604397adab03bb8b5fd75c for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 13:19:06.194463  8911 raft_consensus.cc:493] T 3411566abe2d4c9bb4b2adfdd05e6f17 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:06.195104  8911 raft_consensus.cc:515] T 3411566abe2d4c9bb4b2adfdd05e6f17 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:06.195840  6730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3d8792045a4583ae2e965b1350a5b4" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:19:06.197458  8911 leader_election.cc:290] T 3411566abe2d4c9bb4b2adfdd05e6f17 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:06.197916  6875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fa34c08b205435dba97346991aa1f92" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:19:06.198987  6875 raft_consensus.cc:2393] T 3fa34c08b205435dba97346991aa1f92 P cd75a17ab2604397adab03bb8b5fd75c [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in current term 6: Already voted for candidate cd75a17ab2604397adab03bb8b5fd75c in this term.
I20260709 13:19:06.199103  6697 leader_election.cc:304] T 34f36d59d88f40fe8a2805e604fc6c0a P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377
I20260709 13:19:06.199398  6723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "713b5728a197487c9300b310ab94e5a3" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:19:06.194545  8938 raft_consensus.cc:493] T 22ccee1b570c4ad3a57bd7aec085b1b4 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader cd75a17ab2604397adab03bb8b5fd75c)
I20260709 13:19:06.201193  8793 raft_consensus.cc:2804] T 34f36d59d88f40fe8a2805e604fc6c0a P ccd8a4c3bfe3413cb2ae219b09aea832 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:19:06.201721  8793 raft_consensus.cc:697] T 34f36d59d88f40fe8a2805e604fc6c0a P ccd8a4c3bfe3413cb2ae219b09aea832 [term 3 LEADER]: Becoming Leader. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
I20260709 13:19:06.201637  8938 raft_consensus.cc:515] T 22ccee1b570c4ad3a57bd7aec085b1b4 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:06.202705  8793 consensus_queue.cc:237] T 34f36d59d88f40fe8a2805e604fc6c0a P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:06.173954  8929 raft_consensus.cc:2749] T 8c7f33e544204fbaac4078e3e83bbf4e P ccd8a4c3bfe3413cb2ae219b09aea832 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:19:06.206120  6697 leader_election.cc:304] T 2c240553ce044eedb41541d72b9475d7 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377
I20260709 13:19:06.209857  6697 leader_election.cc:304] T 7c44c4849aa54f2b94d1f1bef9ed546f P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:19:06.214805  8797 raft_consensus.cc:2804] T 2c240553ce044eedb41541d72b9475d7 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:19:06.221490  6730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "853ac0a8cbd64ce99457f170216d4d0f" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:19:06.217374  6732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5be3a11b23d4ea9b08300a2789821c7" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:19:06.219372  6723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c37d41cd9164c15a6826ca62a851a69" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:19:06.223205  6697 leader_election.cc:304] T 95a75bfe094d4bdc963aba3f08dfcd25 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377
I20260709 13:19:06.220422  6727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f9c2e2bf644115957398fe4c9459db" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:19:06.224896  6732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4db81d9d329422bb3b4160ca4ac2d1d" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:19:06.225854  6723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bf4668eeb70467fb3dc5a0289233b3c" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:19:06.219965  6726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1704639a875409b9959353527b3fd68" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:19:06.227378  8918 raft_consensus.cc:3060] T 7c44c4849aa54f2b94d1f1bef9ed546f P ccd8a4c3bfe3413cb2ae219b09aea832 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:06.228538  6730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d33d5ee8ef6f415593d8df52063161ad" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:19:06.230046  6730 raft_consensus.cc:2368] T d33d5ee8ef6f415593d8df52063161ad P ccd8a4c3bfe3413cb2ae219b09aea832 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c for earlier term 5. Current term is 6.
I20260709 13:19:06.231015  6727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab432e62819d499eaaf3dd55481dd930" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
W20260709 13:19:06.174722  8932 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.921s	user 0.013s	sys 0.018s
I20260709 13:19:06.233593  6727 raft_consensus.cc:2393] T ab432e62819d499eaaf3dd55481dd930 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c in current term 6: Already voted for candidate b7ab4784c7344b939bc36f639286f377 in this term.
I20260709 13:19:06.206773  8673 raft_consensus.cc:3055] T 90d42e216d9741e190bca19a781291fd P ccd8a4c3bfe3413cb2ae219b09aea832 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:19:06.237304  6846 leader_election.cc:304] T 3fa34c08b205435dba97346991aa1f92 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:19:06.240921  6730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e31b9971c15848dea59d4d4130141d9e" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:19:06.218341  8965 raft_consensus.cc:493] T f03d0dbf16864ca4bc1bb5e4c0334c0f P cd75a17ab2604397adab03bb8b5fd75c [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:19:06.248967  6727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6869f07b5a4885a0b99fbe60c3b175" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 6 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:19:06.270757  8911 consensus_queue.cc:1059] T 3fa34c08b205435dba97346991aa1f92 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:19:06.272540  8938 leader_election.cc:290] T 22ccee1b570c4ad3a57bd7aec085b1b4 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:06.232893  8768 raft_consensus.cc:515] T 3d65025eea89441290d85dd053810e31 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
W20260709 13:19:06.278755  8925 log.cc:927] Time spent T b3f13b31a1f84f0d89d007eadd57924c P ccd8a4c3bfe3413cb2ae219b09aea832: Append to log took a long time: real 1.455s	user 0.003s	sys 0.000s
I20260709 13:19:06.279843  8773 raft_consensus.cc:3055] T 3411566abe2d4c9bb4b2adfdd05e6f17 P cd75a17ab2604397adab03bb8b5fd75c [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:19:06.239799  8673 raft_consensus.cc:740] T 90d42e216d9741e190bca19a781291fd P ccd8a4c3bfe3413cb2ae219b09aea832 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
W20260709 13:19:06.285990  8954 log.cc:927] Time spent T f5be3a11b23d4ea9b08300a2789821c7 P cd75a17ab2604397adab03bb8b5fd75c: Append to log took a long time: real 0.450s	user 0.000s	sys 0.000s
I20260709 13:19:06.287951  6723 raft_consensus.cc:1275] T d33d5ee8ef6f415593d8df52063161ad P ccd8a4c3bfe3413cb2ae219b09aea832 [term 6 FOLLOWER]: Refusing update from remote peer b7ab4784c7344b939bc36f639286f377: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:19:06.364228  6723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fa34c08b205435dba97346991aa1f92" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
W20260709 13:19:06.288677  8976 log.cc:927] Time spent T d8292e16e5654be6bc408560cf256aaa P cd75a17ab2604397adab03bb8b5fd75c: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
I20260709 13:19:06.290297  8965 raft_consensus.cc:515] T f03d0dbf16864ca4bc1bb5e4c0334c0f P cd75a17ab2604397adab03bb8b5fd75c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:06.292860  8918 raft_consensus.cc:2749] T 7c44c4849aa54f2b94d1f1bef9ed546f P ccd8a4c3bfe3413cb2ae219b09aea832 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:19:06.295502  6729 raft_consensus.cc:1275] T ab432e62819d499eaaf3dd55481dd930 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 6 FOLLOWER]: Refusing update from remote peer b7ab4784c7344b939bc36f639286f377: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 6 index: 3. (index mismatch)
I20260709 13:19:06.296705  6725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3f13b31a1f84f0d89d007eadd57924c" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:19:06.297343  6724 raft_consensus.cc:1275] T 44bde925b2e541b69890d70715b85176 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 6 FOLLOWER]: Refusing update from remote peer b7ab4784c7344b939bc36f639286f377: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
W20260709 13:19:06.297645  6770 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:06.298237  6728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c44c4849aa54f2b94d1f1bef9ed546f" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:19:06.375715  6726 raft_consensus.cc:1240] T 3d65025eea89441290d85dd053810e31 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 5 FOLLOWER]: Rejecting Update request from peer b7ab4784c7344b939bc36f639286f377 for earlier term 4. Current term is 5. Ops: []
I20260709 13:19:06.314174  8826 raft_consensus.cc:515] T 7ba5dac66ab5497e9e336f2a3c28cda5 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:19:06.315541  6877 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53416 (request call id 2124) took 2370 ms. Trace:
I20260709 13:19:06.327688  6844 leader_election.cc:304] T bb3d8792045a4583ae2e965b1350a5b4 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:19:06.250263  8876 raft_consensus.cc:2804] T 3fa34c08b205435dba97346991aa1f92 P cd75a17ab2604397adab03bb8b5fd75c [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:19:06.233268  8929 raft_consensus.cc:2804] T 95a75bfe094d4bdc963aba3f08dfcd25 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:19:06.337774  6727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fa34c08b205435dba97346991aa1f92" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: true dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:19:06.252475  8972 consensus_queue.cc:1059] T e77e330a82df4b43a745d57a68f6f057 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: INVALID_TERM, Last received: 6.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.083s
I20260709 13:19:06.352022  6804 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:32976 (request call id 2075) took 1106 ms. Trace:
I20260709 13:19:06.401412  6804 rpcz_store.cc:276] 0709 13:19:05.245603 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:05.246474 (+   871us) service_pool.cc:224] Handling call
0709 13:19:05.375437 (+128963us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:05.375682 (+   245us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:19:05.579701 (+204019us) log.cc:844] Serialized 14 byte log entry
0709 13:19:06.351558 (+771857us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:06.351641 (+    83us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:19:06.351709 (+    68us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:06.351798 (+    89us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:06.351955 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":565121,"prepare.queue_time_us":136750,"prepare.run_cpu_time_us":85,"prepare.run_wall_time_us":4715,"raft.queue_time_us":601437,"thread_start_us":408422,"threads_started":2,"wal-append.queue_time_us":281814}
I20260709 13:19:06.365851  6723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24ee15416e3145beaa1b8183453729a3" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:19:06.404223  6723 raft_consensus.cc:3060] T 24ee15416e3145beaa1b8183453729a3 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:19:06.352896  8864 raft_consensus.cc:3055] T 34f36d59d88f40fe8a2805e604fc6c0a P b7ab4784c7344b939bc36f639286f377 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:19:06.407958  8864 raft_consensus.cc:740] T 34f36d59d88f40fe8a2805e604fc6c0a P b7ab4784c7344b939bc36f639286f377 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
I20260709 13:19:06.409170  8864 consensus_queue.cc:260] T 34f36d59d88f40fe8a2805e604fc6c0a P b7ab4784c7344b939bc36f639286f377 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:06.410853  8864 raft_consensus.cc:3060] T 34f36d59d88f40fe8a2805e604fc6c0a P b7ab4784c7344b939bc36f639286f377 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:19:06.388784  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 61261.1us
I20260709 13:19:06.415084  6844 leader_election.cc:400] T d33d5ee8ef6f415593d8df52063161ad P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 5 pre-election: Vote denied by peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391) with higher term. Message: Invalid argument: T d33d5ee8ef6f415593d8df52063161ad P ccd8a4c3bfe3413cb2ae219b09aea832 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c for earlier term 5. Current term is 6.
I20260709 13:19:06.415522  6844 leader_election.cc:403] T d33d5ee8ef6f415593d8df52063161ad P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 5 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:19:06.345237  8926 consensus_queue.cc:1059] T 9e326172347f45e99a0d482b5d8ef768 P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.026s
I20260709 13:19:06.356593  8773 raft_consensus.cc:740] T 3411566abe2d4c9bb4b2adfdd05e6f17 P cd75a17ab2604397adab03bb8b5fd75c [term 3 LEADER]: Becoming Follower/Learner. State: Replica: cd75a17ab2604397adab03bb8b5fd75c, State: Running, Role: LEADER
I20260709 13:19:06.417115  8773 consensus_queue.cc:260] T 3411566abe2d4c9bb4b2adfdd05e6f17 P cd75a17ab2604397adab03bb8b5fd75c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:06.418570  8773 raft_consensus.cc:3060] T 3411566abe2d4c9bb4b2adfdd05e6f17 P cd75a17ab2604397adab03bb8b5fd75c [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:19:06.387714  6877 rpcz_store.cc:276] 0709 13:19:03.945093 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:04.029733 (+ 84640us) service_pool.cc:224] Handling call
0709 13:19:04.059210 (+ 29477us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:04.073252 (+ 14042us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:19:04.138164 (+ 64912us) log.cc:844] Serialized 14 byte log entry
0709 13:19:04.523043 (+384879us) spinlock_profiling.cc:243] Waited 3.39 ms on lock 0x7b180035b840. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc15785de1 00007fcc157925b1 00007fcc0c89fe07 00007fcc156faab9 00007fcc0c8bc69b 00007fcc0c8ba93f 00007fcc0c8bcc02 00007fcc0f54420b 00007fcc0f549d23 00007fcc0f54a23a 00007fcc0f9b4a2a
0709 13:19:04.688466 (+165423us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:04.768399 (+ 79933us) log.cc:844] Serialized 26 byte log entry
0709 13:19:04.768611 (+   212us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:19:04.768882 (+   271us) log.cc:844] Serialized 14 byte log entry
0709 13:19:04.769079 (+   197us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:04.769159 (+    80us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:06.290530 (+1521371us) spinlock_profiling.cc:243] Waited 4.5 ms on lock 0x7b180035b840. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc15785de1 00007fcc157925b1 00007fcc0c8bd3f3 00007fcc0c8bf7c1 00007fcc0c8bf779 00007fcc0c8bf709 00007fcc0c8bf6d1 00007fcc0c8be9cd 000000000038f354 000000000038f199 00007fcc0c8a083a
0709 13:19:06.315214 (+ 24684us) raft_consensus.cc:1685] finished
0709 13:19:06.315246 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:06.315453 (+   207us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":26650,"prepare.queue_time_us":120758,"prepare.run_cpu_time_us":137,"prepare.run_wall_time_us":1829,"raft.queue_time_us":6937,"raft.run_cpu_time_us":506,"raft.run_wall_time_us":85804,"spinlock_wait_cycles":18144384,"thread_start_us":207866,"threads_started":2,"wal-append.queue_time_us":634658}
I20260709 13:19:06.398584  6727 raft_consensus.cc:3055] T 3fa34c08b205435dba97346991aa1f92 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:19:06.422201  6727 raft_consensus.cc:740] T 3fa34c08b205435dba97346991aa1f92 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
I20260709 13:19:06.424858  6844 leader_election.cc:304] T 3fa34c08b205435dba97346991aa1f92 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:19:06.426652  8673 consensus_queue.cc:260] T 90d42e216d9741e190bca19a781291fd P ccd8a4c3bfe3413cb2ae219b09aea832 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:06.427361  8972 raft_consensus.cc:3055] T e77e330a82df4b43a745d57a68f6f057 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:19:06.427886  8972 raft_consensus.cc:740] T e77e330a82df4b43a745d57a68f6f057 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
I20260709 13:19:06.428521  6729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44bde925b2e541b69890d70715b85176" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:19:06.429387  6729 raft_consensus.cc:2393] T 44bde925b2e541b69890d70715b85176 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c in current term 6: Already voted for candidate b7ab4784c7344b939bc36f639286f377 in this term.
I20260709 13:19:06.428990  8972 consensus_queue.cc:260] T e77e330a82df4b43a745d57a68f6f057 P ccd8a4c3bfe3413cb2ae219b09aea832 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } }
I20260709 13:19:06.430473  8972 raft_consensus.cc:3060] T e77e330a82df4b43a745d57a68f6f057 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:19:06.431147  8950 log.cc:927] Time spent T 4d9def8b32fd443aa94ab1420b06837b P b7ab4784c7344b939bc36f639286f377: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260709 13:19:06.431807  8929 raft_consensus.cc:697] T 95a75bfe094d4bdc963aba3f08dfcd25 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 7 LEADER]: Becoming Leader. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
I20260709 13:19:06.432789  8929 consensus_queue.cc:237] T 95a75bfe094d4bdc963aba3f08dfcd25 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 2, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:06.433521  8965 leader_election.cc:290] T f03d0dbf16864ca4bc1bb5e4c0334c0f P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:19:06.434172  7499 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50744 (request call id 163) took 1654 ms. Trace:
I20260709 13:19:06.397330  8779 raft_consensus.cc:2749] T bb3d8792045a4583ae2e965b1350a5b4 P cd75a17ab2604397adab03bb8b5fd75c [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:19:06.439638  8941 consensus_queue.cc:1048] T a3022224cc81473690653a83d4e99470 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:19:06.443302  8862 consensus_queue.cc:1059] T 95a75bfe094d4bdc963aba3f08dfcd25 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:19:06.377295  8967 raft_consensus.cc:493] T f3f9c2e2bf644115957398fe4c9459db P b7ab4784c7344b939bc36f639286f377 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:19:06.445706  8862 raft_consensus.cc:3055] T 95a75bfe094d4bdc963aba3f08dfcd25 P b7ab4784c7344b939bc36f639286f377 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:19:06.373047  8892 raft_consensus.cc:493] T 3a485a995abc4807b6e511e45419f737 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:06.446192  8862 raft_consensus.cc:740] T 95a75bfe094d4bdc963aba3f08dfcd25 P b7ab4784c7344b939bc36f639286f377 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
I20260709 13:19:06.446556  8892 raft_consensus.cc:515] T 3a485a995abc4807b6e511e45419f737 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:06.372895  8978 raft_consensus.cc:493] T 30e88460611e47b2ba16a46a30b5f416 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:19:06.434603  7499 rpcz_store.cc:276] 0709 13:19:04.779637 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:04.779791 (+   154us) service_pool.cc:224] Handling call
0709 13:19:04.780166 (+   375us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:05.139502 (+359336us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:06.433858 (+1294356us) spinlock_profiling.cc:243] Waited 329 ms on lock 0x7b5400537d54. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f9aae01 00007fcc0f9a983e 00007fcc1496e419 00007fcc0dee5bd4 00007fcc0dee5b62 00007fcc0dee5a91 00007fcc0dee5a0c 00007fcc0dee4cc2 00007fcc0dce548c 00007fcc0dce48c6
0709 13:19:06.434100 (+   242us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":757267200}
I20260709 13:19:06.445601  6726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09c2a98de1a4decabd0ff900dd44caa" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:19:06.430485  6729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77e330a82df4b43a745d57a68f6f057" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:19:06.439428  8973 raft_consensus.cc:515] T 4f00a2e87e56452083b759f60d461ee3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 6 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:19:06.460668  6726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17587d6730594da4a56fa13a353232a1" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
W20260709 13:19:06.460551  6847 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:06.463617  6726 raft_consensus.cc:3060] T 17587d6730594da4a56fa13a353232a1 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:06.448503  8978 raft_consensus.cc:515] T 30e88460611e47b2ba16a46a30b5f416 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:06.452173  8845 raft_consensus.cc:2749] T d33d5ee8ef6f415593d8df52063161ad P cd75a17ab2604397adab03bb8b5fd75c [term 6 FOLLOWER]: Leader pre-election lost for term 5. Reason: Vote denied by peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391) with higher term. Message: Invalid argument: T d33d5ee8ef6f415593d8df52063161ad P ccd8a4c3bfe3413cb2ae219b09aea832 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c for earlier term 5. Current term is 6.
I20260709 13:19:06.464648  8963 raft_consensus.cc:493] T 3a485a995abc4807b6e511e45419f737 P b7ab4784c7344b939bc36f639286f377 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:06.459213  8673 raft_consensus.cc:3060] T 90d42e216d9741e190bca19a781291fd P ccd8a4c3bfe3413cb2ae219b09aea832 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:06.471557  8978 leader_election.cc:290] T 30e88460611e47b2ba16a46a30b5f416 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:06.493592  7468 leader_election.cc:304] T 4b8cacb381b746da8d0049b0a83b41dd P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:19:06.473606  6770 leader_election.cc:304] T 20f6842e26174571996b8dea4151d4be P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:19:06.476233  8876 raft_consensus.cc:697] T 3fa34c08b205435dba97346991aa1f92 P cd75a17ab2604397adab03bb8b5fd75c [term 6 LEADER]: Becoming Leader. State: Replica: cd75a17ab2604397adab03bb8b5fd75c, State: Running, Role: LEADER
I20260709 13:19:06.477728  6724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "711ef6523deb4cbe8ef2ba61e1c21c98" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:19:06.496342  8876 consensus_queue.cc:237] T 3fa34c08b205435dba97346991aa1f92 P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:19:06.497313  6724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbdf895bba214ff68685a24fd17dfb5d" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:19:06.498905  6724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe20b4b48823486ca3b9c648db6ce8aa" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:19:06.478855  6723 raft_consensus.cc:2468] T 24ee15416e3145beaa1b8183453729a3 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 5.
I20260709 13:19:06.480400  6876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ba5dac66ab5497e9e336f2a3c28cda5" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:19:06.501760  8445 raft_consensus.cc:2749] T 20f6842e26174571996b8dea4151d4be P b7ab4784c7344b939bc36f639286f377 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:19:06.445722  8826 leader_election.cc:290] T 7ba5dac66ab5497e9e336f2a3c28cda5 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 6 election: Requested vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:06.460469  8926 consensus_queue.cc:1243] T 9e326172347f45e99a0d482b5d8ef768 P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Peer ccd8a4c3bfe3413cb2ae219b09aea832 log is divergent from this leader: its last log entry 5.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260709 13:19:06.470006  8347 raft_consensus.cc:493] T ce4f062dcd314d43a63ca74067cb5ee3 P b7ab4784c7344b939bc36f639286f377 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:06.503155  8892 leader_election.cc:290] T 3a485a995abc4807b6e511e45419f737 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:06.503381  8347 raft_consensus.cc:515] T ce4f062dcd314d43a63ca74067cb5ee3 P b7ab4784c7344b939bc36f639286f377 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } attrs { replace: true } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
W20260709 13:19:06.502727  6847 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:06.507160  8831 consensus_queue.cc:1048] T 17587d6730594da4a56fa13a353232a1 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:19:06.510298  6770 leader_election.cc:304] T 90d42e216d9741e190bca19a781291fd P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:19:06.513833  6695 leader_election.cc:304] T 9b3759de40694069b13c0f8bd40e5709 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
I20260709 13:19:06.499922  6724 raft_consensus.cc:3060] T fe20b4b48823486ca3b9c648db6ce8aa P ccd8a4c3bfe3413cb2ae219b09aea832 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:19:06.492197  8963 raft_consensus.cc:515] T 3a485a995abc4807b6e511e45419f737 P b7ab4784c7344b939bc36f639286f377 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:06.446214  8967 raft_consensus.cc:515] T f3f9c2e2bf644115957398fe4c9459db P b7ab4784c7344b939bc36f639286f377 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:06.481262  8446 raft_consensus.cc:493] T 24ee15416e3145beaa1b8183453729a3 P b7ab4784c7344b939bc36f639286f377 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 7ba59cc884714e8aa5f3f0ecaed84cbb)
I20260709 13:19:06.528275  6803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ba5dac66ab5497e9e336f2a3c28cda5" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:19:06.522861  8826 consensus_queue.cc:1048] T 427c124d773f483294511e80fe340075 P 7ba59cc884714e8aa5f3f0ecaed84cbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.008s
I20260709 13:19:06.560999  8836 raft_consensus.cc:493] T be1a92657f494cac8dd227d152f50151 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:06.534011  6695 leader_election.cc:304] T f4b8bd455d5a47c18a1380839c6e0d61 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
W20260709 13:19:06.614912  6695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 81036us
I20260709 13:19:06.545135  6726 raft_consensus.cc:2468] T 17587d6730594da4a56fa13a353232a1 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in term 8.
I20260709 13:19:06.546557  8792 raft_consensus.cc:2804] T 9b3759de40694069b13c0f8bd40e5709 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:19:06.544883  8845 raft_consensus.cc:493] T bb7fa124c3bf4ef9ab65a407cb008441 P cd75a17ab2604397adab03bb8b5fd75c [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:06.455888  8862 consensus_queue.cc:260] T 95a75bfe094d4bdc963aba3f08dfcd25 P b7ab4784c7344b939bc36f639286f377 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 6.2, Last appended by leader: 2, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:06.549249  8965 raft_consensus.cc:3055] T 9e326172347f45e99a0d482b5d8ef768 P cd75a17ab2604397adab03bb8b5fd75c [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:19:06.461356  8941 consensus_queue.cc:1048] T d33d5ee8ef6f415593d8df52063161ad P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.072s
I20260709 13:19:06.614607  8830 raft_consensus.cc:2749] T 90d42e216d9741e190bca19a781291fd P b7ab4784c7344b939bc36f639286f377 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:19:06.632725  8845 raft_consensus.cc:515] T bb7fa124c3bf4ef9ab65a407cb008441 P cd75a17ab2604397adab03bb8b5fd75c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:19:06.635313  8845 leader_election.cc:290] T bb7fa124c3bf4ef9ab65a407cb008441 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:19:06.555083  6732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce4f062dcd314d43a63ca74067cb5ee3" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
W20260709 13:19:06.556730  8977 log.cc:927] Time spent T 07a92dd554674067a83a9cb68c4773f2 P b7ab4784c7344b939bc36f639286f377: Append to log took a long time: real 0.236s	user 0.001s	sys 0.002s
I20260709 13:19:06.562023  6728 raft_consensus.cc:2468] T 7c44c4849aa54f2b94d1f1bef9ed546f P ccd8a4c3bfe3413cb2ae219b09aea832 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 7.
W20260709 13:19:06.562090  6697 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 326172us
I20260709 13:19:06.637230  6697 leader_election.cc:304] T 4275cf08e63345f993bce8664eada830 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:19:06.640283  8963 leader_election.cc:290] T 3a485a995abc4807b6e511e45419f737 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:06.644816  8806 raft_consensus.cc:3055] T 2c240553ce044eedb41541d72b9475d7 P b7ab4784c7344b939bc36f639286f377 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:19:06.645287  8806 raft_consensus.cc:740] T 2c240553ce044eedb41541d72b9475d7 P b7ab4784c7344b939bc36f639286f377 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
I20260709 13:19:06.645685  8938 raft_consensus.cc:3060] T 4275cf08e63345f993bce8664eada830 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:19:06.646595  6729 raft_consensus.cc:2468] T e77e330a82df4b43a745d57a68f6f057 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 7.
I20260709 13:19:06.646231  8806 consensus_queue.cc:260] T 2c240553ce044eedb41541d72b9475d7 P b7ab4784c7344b939bc36f639286f377 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:06.647312  8855 consensus_queue.cc:1059] T 24ee15416e3145beaa1b8183453729a3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: INVALID_TERM, Last received: 4.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:19:06.647671  8806 raft_consensus.cc:3060] T 2c240553ce044eedb41541d72b9475d7 P b7ab4784c7344b939bc36f639286f377 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:19:06.604619  6770 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 94414.4us
I20260709 13:19:06.640317  8765 raft_consensus.cc:493] T 4b8cacb381b746da8d0049b0a83b41dd P ccd8a4c3bfe3413cb2ae219b09aea832 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:06.607126  6804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f00a2e87e56452083b759f60d461ee3" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:19:06.609938  6724 raft_consensus.cc:2468] T fe20b4b48823486ca3b9c648db6ce8aa P ccd8a4c3bfe3413cb2ae219b09aea832 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in term 3.
I20260709 13:19:06.619505  7466 leader_election.cc:304] T 17587d6730594da4a56fa13a353232a1 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: b7ab4784c7344b939bc36f639286f377
I20260709 13:19:06.606506  8768 leader_election.cc:290] T 3d65025eea89441290d85dd053810e31 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 5 election: Requested vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:06.629405  8826 raft_consensus.cc:493] T 404190ce4ce94cecbfcb6ea9d1dd8626 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:06.620570  8836 raft_consensus.cc:515] T be1a92657f494cac8dd227d152f50151 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:19:06.625185  8965 raft_consensus.cc:740] T 9e326172347f45e99a0d482b5d8ef768 P cd75a17ab2604397adab03bb8b5fd75c [term 4 LEADER]: Becoming Follower/Learner. State: Replica: cd75a17ab2604397adab03bb8b5fd75c, State: Running, Role: LEADER
I20260709 13:19:06.637362  6881 raft_consensus.cc:1275] T bb7fa124c3bf4ef9ab65a407cb008441 P cd75a17ab2604397adab03bb8b5fd75c [term 6 FOLLOWER]: Refusing update from remote peer b7ab4784c7344b939bc36f639286f377: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:19:06.572906  6725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f03d0dbf16864ca4bc1bb5e4c0334c0f" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:19:06.645524  6697 leader_election.cc:304] T f58dc08b12a2494bb9a1372837970ca2 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
W20260709 13:19:06.699924  6697 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 54460.7us
W20260709 13:19:06.602098  6872 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.579s	user 0.018s	sys 0.015s
I20260709 13:19:06.649014  8927 raft_consensus.cc:3055] T 24ee15416e3145beaa1b8183453729a3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:19:06.649580  8864 raft_consensus.cc:493] T f03d0dbf16864ca4bc1bb5e4c0334c0f P b7ab4784c7344b939bc36f639286f377 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:19:06.650739  8823 raft_consensus.cc:493] T de3186201e1a40d0b335eeb8b4e256e0 P b7ab4784c7344b939bc36f639286f377 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:06.623588  8446 raft_consensus.cc:515] T 24ee15416e3145beaa1b8183453729a3 P b7ab4784c7344b939bc36f639286f377 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } attrs { replace: true } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
W20260709 13:19:06.653061  6772 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:06.600188  6880 raft_consensus.cc:1275] T ab432e62819d499eaaf3dd55481dd930 P cd75a17ab2604397adab03bb8b5fd75c [term 6 FOLLOWER]: Refusing update from remote peer b7ab4784c7344b939bc36f639286f377: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 6 index: 3. (index mismatch)
I20260709 13:19:06.615549  8971 raft_consensus.cc:2804] T f4b8bd455d5a47c18a1380839c6e0d61 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:19:06.625995  8869 raft_consensus.cc:493] T 9e326172347f45e99a0d482b5d8ef768 P b7ab4784c7344b939bc36f639286f377 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:06.668951  6770 leader_election.cc:304] T be1a92657f494cac8dd227d152f50151 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:19:06.529563  8973 leader_election.cc:290] T 4f00a2e87e56452083b759f60d461ee3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 6 election: Requested vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:06.640445  8792 raft_consensus.cc:697] T 9b3759de40694069b13c0f8bd40e5709 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 6 LEADER]: Becoming Leader. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
W20260709 13:19:06.682839  7466 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 63450.5us
I20260709 13:19:06.684603  6723 raft_consensus.cc:1240] T fe20b4b48823486ca3b9c648db6ce8aa P ccd8a4c3bfe3413cb2ae219b09aea832 [term 3 FOLLOWER]: Rejecting Update request from peer cd75a17ab2604397adab03bb8b5fd75c for earlier term 2. Current term is 3. Ops: []
I20260709 13:19:06.685099  6724 raft_consensus.cc:1240] T 3411566abe2d4c9bb4b2adfdd05e6f17 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 4 FOLLOWER]: Rejecting Update request from peer cd75a17ab2604397adab03bb8b5fd75c for earlier term 3. Current term is 4. Ops: []
I20260709 13:19:06.746156  8830 raft_consensus.cc:2749] T be1a92657f494cac8dd227d152f50151 P b7ab4784c7344b939bc36f639286f377 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:19:06.753997  6724 raft_consensus.cc:1275] T 3a485a995abc4807b6e511e45419f737 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 4 FOLLOWER]: Refusing update from remote peer cd75a17ab2604397adab03bb8b5fd75c: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:19:06.715771  8918 raft_consensus.cc:2749] T f58dc08b12a2494bb9a1372837970ca2 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
W20260709 13:19:06.701228  6872 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.678s	user 0.019s	sys 0.015s
I20260709 13:19:06.715456  8927 raft_consensus.cc:740] T 24ee15416e3145beaa1b8183453729a3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 7ba59cc884714e8aa5f3f0ecaed84cbb, State: Running, Role: LEADER
W20260709 13:19:06.712405  6698 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:06.716150  6728 raft_consensus.cc:1240] T 24ee15416e3145beaa1b8183453729a3 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 5 FOLLOWER]: Rejecting Update request from peer 7ba59cc884714e8aa5f3f0ecaed84cbb for earlier term 4. Current term is 5. Ops: []
I20260709 13:19:06.653980  8445 consensus_queue.cc:1059] T 95a75bfe094d4bdc963aba3f08dfcd25 P b7ab4784c7344b939bc36f639286f377 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.046s
I20260709 13:19:06.718489  6725 raft_consensus.cc:1240] T 7c44c4849aa54f2b94d1f1bef9ed546f P ccd8a4c3bfe3413cb2ae219b09aea832 [term 7 FOLLOWER]: Rejecting Update request from peer cd75a17ab2604397adab03bb8b5fd75c for earlier term 6. Current term is 7. Ops: []
I20260709 13:19:06.671178  8978 raft_consensus.cc:493] T ab432e62819d499eaaf3dd55481dd930 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:06.743845  6770 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 74976us
I20260709 13:19:06.737478  6727 consensus_queue.cc:260] T 3fa34c08b205435dba97346991aa1f92 P ccd8a4c3bfe3413cb2ae219b09aea832 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:19:06.769970  6727 raft_consensus.cc:3060] T 3fa34c08b205435dba97346991aa1f92 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:06.748744  6880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a92dd554674067a83a9cb68c4773f2" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:19:06.771399  6880 raft_consensus.cc:2393] T 07a92dd554674067a83a9cb68c4773f2 P cd75a17ab2604397adab03bb8b5fd75c [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ccd8a4c3bfe3413cb2ae219b09aea832 in current term 5: Already voted for candidate b7ab4784c7344b939bc36f639286f377 in this term.
W20260709 13:19:06.756848  6845 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:06.667560  8924 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.838s	user 0.004s	sys 0.022s
I20260709 13:19:06.719177  8797 raft_consensus.cc:697] T 2c240553ce044eedb41541d72b9475d7 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 6 LEADER]: Becoming Leader. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
I20260709 13:19:06.762408  7466 leader_election.cc:304] T fe20b4b48823486ca3b9c648db6ce8aa P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:19:06.761456  6875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c37d41cd9164c15a6826ca62a851a69" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:19:06.697072  8765 raft_consensus.cc:515] T 4b8cacb381b746da8d0049b0a83b41dd P ccd8a4c3bfe3413cb2ae219b09aea832 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:19:06.841338  6726 raft_consensus.cc:1275] T 4b8cacb381b746da8d0049b0a83b41dd P ccd8a4c3bfe3413cb2ae219b09aea832 [term 6 FOLLOWER]: Refusing update from remote peer cd75a17ab2604397adab03bb8b5fd75c: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:19:06.826313  6728 raft_consensus.cc:1275] T d8292e16e5654be6bc408560cf256aaa P ccd8a4c3bfe3413cb2ae219b09aea832 [term 6 FOLLOWER]: Refusing update from remote peer cd75a17ab2604397adab03bb8b5fd75c: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:19:06.782014  6880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7887766dc6784fcaa42b35c05fea7a99" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
W20260709 13:19:06.828405  6772 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 65201.6us
W20260709 13:19:06.828518  6770 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 59391.4us
I20260709 13:19:06.844870  6770 leader_election.cc:304] T d8292e16e5654be6bc408560cf256aaa P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: cd75a17ab2604397adab03bb8b5fd75c
W20260709 13:19:06.828372  7466 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 66006.7us
I20260709 13:19:06.700201  8826 raft_consensus.cc:515] T 404190ce4ce94cecbfcb6ea9d1dd8626 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
W20260709 13:19:06.833278  6698 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:06.745981  8711 consensus_queue.cc:1048] T bb7fa124c3bf4ef9ab65a407cb008441 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.093s
W20260709 13:19:06.828550  8924 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 2.003s	user 0.004s	sys 0.028s
I20260709 13:19:06.838549  8986 consensus_queue.cc:1048] T ce4f062dcd314d43a63ca74067cb5ee3 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 2, Time since last communication: 0.066s
I20260709 13:19:06.755604  8347 leader_election.cc:290] T ce4f062dcd314d43a63ca74067cb5ee3 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:19:06.743045  8870 raft_consensus.cc:493] T 7a734b5ab7834e05a8c422208acc58b1 P b7ab4784c7344b939bc36f639286f377 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:06.805214  6696 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:06.842152  8765 leader_election.cc:290] T 4b8cacb381b746da8d0049b0a83b41dd P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:19:06.843724  6880 raft_consensus.cc:2468] T 7887766dc6784fcaa42b35c05fea7a99 P cd75a17ab2604397adab03bb8b5fd75c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 4.
I20260709 13:19:06.872882  6880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a485a995abc4807b6e511e45419f737" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:19:06.760332  8982 raft_consensus.cc:2749] T 4b8cacb381b746da8d0049b0a83b41dd P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:19:06.877864  6880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b56bf91d90824c959e21e0cee5ba1816" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:19:06.878535  6880 raft_consensus.cc:3060] T b56bf91d90824c959e21e0cee5ba1816 P cd75a17ab2604397adab03bb8b5fd75c [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:19:06.879650  8984 log.cc:927] Time spent T 34f36d59d88f40fe8a2805e604fc6c0a P ccd8a4c3bfe3413cb2ae219b09aea832: Append to log took a long time: real 0.182s	user 0.000s	sys 0.000s
I20260709 13:19:06.826172  8845 raft_consensus.cc:493] T 90d42e216d9741e190bca19a781291fd P cd75a17ab2604397adab03bb8b5fd75c [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:19:06.738526  8864 raft_consensus.cc:515] T f03d0dbf16864ca4bc1bb5e4c0334c0f P b7ab4784c7344b939bc36f639286f377 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:06.849844  8926 raft_consensus.cc:493] T 4275cf08e63345f993bce8664eada830 P cd75a17ab2604397adab03bb8b5fd75c [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:06.840188  8836 leader_election.cc:290] T be1a92657f494cac8dd227d152f50151 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:19:06.765545  8941 raft_consensus.cc:493] T 3411566abe2d4c9bb4b2adfdd05e6f17 P b7ab4784c7344b939bc36f639286f377 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:06.867646  7467 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:06.741129  8823 raft_consensus.cc:515] T de3186201e1a40d0b335eeb8b4e256e0 P b7ab4784c7344b939bc36f639286f377 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:06.900669  6804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bf4668eeb70467fb3dc5a0289233b3c" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:19:06.871315  6728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be1a92657f494cac8dd227d152f50151" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:19:06.740146  8768 consensus_queue.cc:1059] T f09c2a98de1a4decabd0ff900dd44caa P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 1, Time since last communication: 0.029s
I20260709 13:19:06.843786  8973 raft_consensus.cc:2804] T 17587d6730594da4a56fa13a353232a1 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:19:06.753249  8869 raft_consensus.cc:515] T 9e326172347f45e99a0d482b5d8ef768 P b7ab4784c7344b939bc36f639286f377 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:06.858507  6875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbdf895bba214ff68685a24fd17dfb5d" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:19:06.764529  8773 consensus_queue.cc:1048] T 3a485a995abc4807b6e511e45419f737 P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Connected to new peer: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.107s
I20260709 13:19:06.759896  8574 consensus_queue.cc:1059] T 17587d6730594da4a56fa13a353232a1 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.114s
I20260709 13:19:06.891620  6807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b56bf91d90824c959e21e0cee5ba1816" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:19:06.957260  6807 raft_consensus.cc:3060] T b56bf91d90824c959e21e0cee5ba1816 P b7ab4784c7344b939bc36f639286f377 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:06.893405  6801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d33d5ee8ef6f415593d8df52063161ad" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:19:06.962225  6801 raft_consensus.cc:1275] T ce4f062dcd314d43a63ca74067cb5ee3 P b7ab4784c7344b939bc36f639286f377 [term 6 FOLLOWER]: Refusing update from remote peer ccd8a4c3bfe3413cb2ae219b09aea832: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 13:19:06.894758  6805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3022224cc81473690653a83d4e99470" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:19:06.827209  8978 raft_consensus.cc:515] T ab432e62819d499eaaf3dd55481dd930 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:06.876646  8892 raft_consensus.cc:493] T 404190ce4ce94cecbfcb6ea9d1dd8626 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:06.901005  7468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 355815us
I20260709 13:19:06.918253  6728 raft_consensus.cc:2468] T be1a92657f494cac8dd227d152f50151 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in term 5.
I20260709 13:19:06.917335  6800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbdf895bba214ff68685a24fd17dfb5d" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:19:06.985296  6805 raft_consensus.cc:1275] T c4db81d9d329422bb3b4160ca4ac2d1d P b7ab4784c7344b939bc36f639286f377 [term 6 FOLLOWER]: Refusing update from remote peer ccd8a4c3bfe3413cb2ae219b09aea832: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:19:06.986547  6800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30e88460611e47b2ba16a46a30b5f416" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:19:06.875661  8870 raft_consensus.cc:515] T 7a734b5ab7834e05a8c422208acc58b1 P b7ab4784c7344b939bc36f639286f377 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:06.985074  6799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3411566abe2d4c9bb4b2adfdd05e6f17" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:19:06.988329  6798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22ccee1b570c4ad3a57bd7aec085b1b4" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:19:06.989084  6798 raft_consensus.cc:2468] T 22ccee1b570c4ad3a57bd7aec085b1b4 P b7ab4784c7344b939bc36f639286f377 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 4.
I20260709 13:19:06.917912  8836 raft_consensus.cc:2804] T fe20b4b48823486ca3b9c648db6ce8aa P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:19:06.899365  8779 raft_consensus.cc:2749] T 3fa34c08b205435dba97346991aa1f92 P cd75a17ab2604397adab03bb8b5fd75c [term 6 LEADER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:19:06.916532  8891 raft_consensus.cc:2749] T 427c124d773f483294511e80fe340075 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:19:06.867827  8987 consensus_queue.cc:1059] T 711ef6523deb4cbe8ef2ba61e1c21c98 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 1, Time since last communication: 0.060s
I20260709 13:19:07.002478  6800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d65025eea89441290d85dd053810e31" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:19:07.003715  6798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a485a995abc4807b6e511e45419f737" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:19:06.988741  8797 consensus_queue.cc:237] T 2c240553ce044eedb41541d72b9475d7 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:07.022924  8773 raft_consensus.cc:493] T 95a75bfe094d4bdc963aba3f08dfcd25 P cd75a17ab2604397adab03bb8b5fd75c [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:07.023663  8773 raft_consensus.cc:515] T 95a75bfe094d4bdc963aba3f08dfcd25 P cd75a17ab2604397adab03bb8b5fd75c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:07.011258  8938 raft_consensus.cc:2749] T 4275cf08e63345f993bce8664eada830 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:19:06.877063  8965 consensus_queue.cc:260] T 9e326172347f45e99a0d482b5d8ef768 P cd75a17ab2604397adab03bb8b5fd75c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:07.021943  6798 raft_consensus.cc:2468] T 3a485a995abc4807b6e511e45419f737 P b7ab4784c7344b939bc36f639286f377 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 4.
I20260709 13:19:06.891820  8347 consensus_queue.cc:1048] T a3022224cc81473690653a83d4e99470 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.105s
I20260709 13:19:06.891719  8845 raft_consensus.cc:515] T 90d42e216d9741e190bca19a781291fd P cd75a17ab2604397adab03bb8b5fd75c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:07.026839  8773 leader_election.cc:290] T 95a75bfe094d4bdc963aba3f08dfcd25 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:19:06.956005  8963 raft_consensus.cc:2804] T d8292e16e5654be6bc408560cf256aaa P b7ab4784c7344b939bc36f639286f377 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:19:06.918138  8941 raft_consensus.cc:515] T 3411566abe2d4c9bb4b2adfdd05e6f17 P b7ab4784c7344b939bc36f639286f377 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:07.016709  7468 leader_election.cc:304] T 7ba5dac66ab5497e9e336f2a3c28cda5 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
W20260709 13:19:07.057116  6772 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 204677us
I20260709 13:19:07.013466  7495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb7fa124c3bf4ef9ab65a407cb008441" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:19:06.984992  8768 raft_consensus.cc:493] T f5be3a11b23d4ea9b08300a2789821c7 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:19:07.047660  6875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d65025eea89441290d85dd053810e31" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:19:07.048225  6804 raft_consensus.cc:1275] T 9e326172347f45e99a0d482b5d8ef768 P b7ab4784c7344b939bc36f639286f377 [term 5 FOLLOWER]: Refusing update from remote peer ccd8a4c3bfe3413cb2ae219b09aea832: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:19:07.031749  6874 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53406 (request call id 1352) took 1553 ms. Trace:
I20260709 13:19:06.898540  8926 raft_consensus.cc:515] T 4275cf08e63345f993bce8664eada830 P cd75a17ab2604397adab03bb8b5fd75c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:06.896741  8927 consensus_queue.cc:260] T 24ee15416e3145beaa1b8183453729a3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } attrs { replace: true } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:19:07.056402  6881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4b8bd455d5a47c18a1380839c6e0d61" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:19:07.081450  6881 raft_consensus.cc:3060] T f4b8bd455d5a47c18a1380839c6e0d61 P cd75a17ab2604397adab03bb8b5fd75c [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:19:06.996548  8892 raft_consensus.cc:515] T 404190ce4ce94cecbfcb6ea9d1dd8626 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:19:07.085265  6799 raft_consensus.cc:2468] T 3411566abe2d4c9bb4b2adfdd05e6f17 P b7ab4784c7344b939bc36f639286f377 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 4.
I20260709 13:19:07.065135  6872 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53406 (request call id 1350) took 1587 ms. Trace:
W20260709 13:19:07.070695  6847 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:06.893209  8792 consensus_queue.cc:237] T 9b3759de40694069b13c0f8bd40e5709 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:07.074399  6874 rpcz_store.cc:276] 0709 13:19:05.478701 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:06.137702 (+659001us) service_pool.cc:224] Handling call
0709 13:19:06.138081 (+   379us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:06.138546 (+   465us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:06.138578 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:06.157213 (+ 18635us) log.cc:844] Serialized 26 byte log entry
0709 13:19:06.694075 (+536862us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:19:07.030735 (+336660us) log.cc:844] Serialized 14 byte log entry
0709 13:19:07.031272 (+   537us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:07.031381 (+   109us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:07.031443 (+    62us) raft_consensus.cc:1685] finished
0709 13:19:07.031461 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:07.031663 (+   202us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":226436,"raft.queue_time_us":254,"raft.run_cpu_time_us":355,"raft.run_wall_time_us":20067,"spinlock_wait_cycles":69730688,"thread_start_us":761726,"threads_started":2,"wal-append.queue_time_us":782096}
I20260709 13:19:07.094204  6874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bf4668eeb70467fb3dc5a0289233b3c" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:19:07.061866  8965 raft_consensus.cc:3060] T 9e326172347f45e99a0d482b5d8ef768 P cd75a17ab2604397adab03bb8b5fd75c [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:19:07.077781  6697 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:07.052304  8963 raft_consensus.cc:493] T d8292e16e5654be6bc408560cf256aaa P b7ab4784c7344b939bc36f639286f377 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:07.087206  6872 rpcz_store.cc:276] 0709 13:19:05.477846 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:05.999933 (+522087us) service_pool.cc:224] Handling call
0709 13:19:06.022776 (+ 22843us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:06.023052 (+   276us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:19:06.759240 (+736188us) log.cc:844] Serialized 14 byte log entry
0709 13:19:07.064729 (+305489us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:07.064783 (+    54us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:19:07.064842 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:07.064917 (+    75us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:07.065069 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":749784,"prepare.run_cpu_time_us":50,"prepare.run_wall_time_us":51,"raft.queue_time_us":78,"raft.run_cpu_time_us":135,"raft.run_wall_time_us":10743,"thread_start_us":1040736,"threads_started":2}
I20260709 13:19:07.137725  6872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30e88460611e47b2ba16a46a30b5f416" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:19:07.086733  6807 raft_consensus.cc:2468] T b56bf91d90824c959e21e0cee5ba1816 P b7ab4784c7344b939bc36f639286f377 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 6.
I20260709 13:19:07.068491  6880 raft_consensus.cc:2468] T b56bf91d90824c959e21e0cee5ba1816 P cd75a17ab2604397adab03bb8b5fd75c [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 6.
I20260709 13:19:07.094962  6874 raft_consensus.cc:2468] T 1bf4668eeb70467fb3dc5a0289233b3c P cd75a17ab2604397adab03bb8b5fd75c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 4.
I20260709 13:19:07.044840  8967 leader_election.cc:290] T f3f9c2e2bf644115957398fe4c9459db P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:07.141363  6880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d33d5ee8ef6f415593d8df52063161ad" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:19:07.149657  6880 raft_consensus.cc:2468] T d33d5ee8ef6f415593d8df52063161ad P cd75a17ab2604397adab03bb8b5fd75c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 6.
I20260709 13:19:07.150326  6697 leader_election.cc:304] T 07a92dd554674067a83a9cb68c4773f2 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:19:07.150719  6880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3022224cc81473690653a83d4e99470" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
W20260709 13:19:07.151837  6847 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:07.152912  6881 raft_consensus.cc:2468] T f4b8bd455d5a47c18a1380839c6e0d61 P cd75a17ab2604397adab03bb8b5fd75c [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 5.
I20260709 13:19:07.154070  6881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a485a995abc4807b6e511e45419f737" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:19:07.155604  6697 leader_election.cc:304] T 7c37d41cd9164c15a6826ca62a851a69 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:19:07.147292  8864 leader_election.cc:290] T f03d0dbf16864ca4bc1bb5e4c0334c0f P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:07.147643  8823 leader_election.cc:290] T de3186201e1a40d0b335eeb8b4e256e0 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:07.152936  7466 leader_election.cc:304] T be1a92657f494cac8dd227d152f50151 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
I20260709 13:19:07.157107  6874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b8cacb381b746da8d0049b0a83b41dd" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:19:07.165529  6729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "404190ce4ce94cecbfcb6ea9d1dd8626" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:19:07.157226  6875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce4f062dcd314d43a63ca74067cb5ee3" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:19:07.166388  6729 raft_consensus.cc:2410] T 404190ce4ce94cecbfcb6ea9d1dd8626 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ba59cc884714e8aa5f3f0ecaed84cbb for term 7 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
W20260709 13:19:07.136343  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 303780us
I20260709 13:19:07.160302  7500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b8cacb381b746da8d0049b0a83b41dd" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:19:07.168797  6723 raft_consensus.cc:1240] T 9e326172347f45e99a0d482b5d8ef768 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 5 LEADER]: Rejecting Update request from peer cd75a17ab2604397adab03bb8b5fd75c for earlier term 4. Current term is 5. Ops: [4.3-4.3]
W20260709 13:19:07.132805  8961 log.cc:927] Time spent T 711ef6523deb4cbe8ef2ba61e1c21c98 P b7ab4784c7344b939bc36f639286f377: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260709 13:19:07.173599  6728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a75bfe094d4bdc963aba3f08dfcd25" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 8 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:19:07.077287  8992 raft_consensus.cc:3055] T 17587d6730594da4a56fa13a353232a1 P b7ab4784c7344b939bc36f639286f377 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:19:07.166234  6875 raft_consensus.cc:2468] T ce4f062dcd314d43a63ca74067cb5ee3 P cd75a17ab2604397adab03bb8b5fd75c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 6.
I20260709 13:19:07.177134  8992 raft_consensus.cc:740] T 17587d6730594da4a56fa13a353232a1 P b7ab4784c7344b939bc36f639286f377 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
I20260709 13:19:07.178110  6875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22ccee1b570c4ad3a57bd7aec085b1b4" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:19:07.155362  6881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3411566abe2d4c9bb4b2adfdd05e6f17" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:19:07.182420  6881 raft_consensus.cc:2468] T 3411566abe2d4c9bb4b2adfdd05e6f17 P cd75a17ab2604397adab03bb8b5fd75c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 4.
I20260709 13:19:07.167066  6697 leader_election.cc:304] T 1bf4668eeb70467fb3dc5a0289233b3c P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:19:07.139099  8963 raft_consensus.cc:3060] T d8292e16e5654be6bc408560cf256aaa P b7ab4784c7344b939bc36f639286f377 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:07.079613  7495 raft_consensus.cc:2468] T bb7fa124c3bf4ef9ab65a407cb008441 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 6.
W20260709 13:19:07.244407  6697 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 77393.7us
W20260709 13:19:07.160221  7469 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:07.264967  6697 leader_election.cc:304] T b56bf91d90824c959e21e0cee5ba1816 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:19:07.160597  8986 raft_consensus.cc:2749] T 07a92dd554674067a83a9cb68c4773f2 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:19:07.182482  8971 raft_consensus.cc:697] T f4b8bd455d5a47c18a1380839c6e0d61 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 5 LEADER]: Becoming Leader. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
I20260709 13:19:07.079509  8768 raft_consensus.cc:515] T f5be3a11b23d4ea9b08300a2789821c7 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:07.160470  8929 raft_consensus.cc:2749] T 7c37d41cd9164c15a6826ca62a851a69 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:19:07.270744  6697 leader_election.cc:304] T d33d5ee8ef6f415593d8df52063161ad P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:19:07.123639  8998 consensus_queue.cc:1059] T 24ee15416e3145beaa1b8183453729a3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: INVALID_TERM, Last received: 4.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.174s
W20260709 13:19:07.268610  7468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 251991us
W20260709 13:19:07.290688  6727 consensus_meta.cc:287] T 3fa34c08b205435dba97346991aa1f92 P ccd8a4c3bfe3413cb2ae219b09aea832: Time spent flushing consensus metadata: real 0.520s	user 0.009s	sys 0.000s
I20260709 13:19:07.186630  8826 leader_election.cc:290] T 404190ce4ce94cecbfcb6ea9d1dd8626 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:19:07.263450  8973 raft_consensus.cc:697] T 17587d6730594da4a56fa13a353232a1 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 8 LEADER]: Becoming Leader. State: Replica: 7ba59cc884714e8aa5f3f0ecaed84cbb, State: Running, Role: LEADER
I20260709 13:19:07.293437  6727 raft_consensus.cc:2468] T 3fa34c08b205435dba97346991aa1f92 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 6.
I20260709 13:19:07.273114  8990 raft_consensus.cc:2804] T 1bf4668eeb70467fb3dc5a0289233b3c P ccd8a4c3bfe3413cb2ae219b09aea832 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:19:07.275993  9015 raft_consensus.cc:493] T bb3d8792045a4583ae2e965b1350a5b4 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:19:07.265224  8711 consensus_queue.cc:1048] T ab432e62819d499eaaf3dd55481dd930 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.053s
I20260709 13:19:07.246181  8859 consensus_queue.cc:1059] T 7c44c4849aa54f2b94d1f1bef9ed546f P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 1, Time since last communication: 0.047s
I20260709 13:19:07.292385  8938 raft_consensus.cc:2804] T b56bf91d90824c959e21e0cee5ba1816 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 6 FOLLOWER]: Leader election won for term 6
W20260709 13:19:07.320428  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 140450us
I20260709 13:19:07.335420  6844 leader_election.cc:304] T e77e330a82df4b43a745d57a68f6f057 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
W20260709 13:19:07.312681  8932 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 6 current term: 6 is higher.
I20260709 13:19:07.278214  8773 consensus_queue.cc:1048] T d8292e16e5654be6bc408560cf256aaa P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Connected to new peer: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 1, Time since last communication: 0.044s
I20260709 13:19:07.178573  8992 consensus_queue.cc:260] T 17587d6730594da4a56fa13a353232a1 P b7ab4784c7344b939bc36f639286f377 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:19:07.314252  8446 leader_election.cc:290] T 24ee15416e3145beaa1b8183453729a3 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:19:07.313912  8990 raft_consensus.cc:493] T 1bf4668eeb70467fb3dc5a0289233b3c P ccd8a4c3bfe3413cb2ae219b09aea832 [term 4 FOLLOWER]: Starting leader election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:19:07.312026  9000 raft_consensus.cc:493] T d8cee0accdb8499c86d4414b72565a38 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
W20260709 13:19:07.332162  8991 log.cc:927] Time spent T f09c2a98de1a4decabd0ff900dd44caa P ccd8a4c3bfe3413cb2ae219b09aea832: Append to log took a long time: real 0.397s	user 0.001s	sys 0.000s
I20260709 13:19:07.368422  8990 raft_consensus.cc:3060] T 1bf4668eeb70467fb3dc5a0289233b3c P ccd8a4c3bfe3413cb2ae219b09aea832 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:19:07.368599  8971 consensus_queue.cc:237] T f4b8bd455d5a47c18a1380839c6e0d61 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:07.368979  9000 raft_consensus.cc:515] T d8cee0accdb8499c86d4414b72565a38 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:19:07.369719  8919 raft_consensus.cc:3055] T 7c44c4849aa54f2b94d1f1bef9ed546f P cd75a17ab2604397adab03bb8b5fd75c [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:19:07.370155  8998 raft_consensus.cc:2804] T be1a92657f494cac8dd227d152f50151 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:19:07.370564  8859 raft_consensus.cc:2804] T e77e330a82df4b43a745d57a68f6f057 P cd75a17ab2604397adab03bb8b5fd75c [term 7 FOLLOWER]: Leader election won for term 7
W20260709 13:19:07.353111  8994 log.cc:927] Time spent T 30e88460611e47b2ba16a46a30b5f416 P b7ab4784c7344b939bc36f639286f377: Append to log took a long time: real 0.324s	user 0.000s	sys 0.002s
I20260709 13:19:07.353147  8826 raft_consensus.cc:2749] T 7ba5dac66ab5497e9e336f2a3c28cda5 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:19:07.372242  8978 leader_election.cc:290] T ab432e62819d499eaaf3dd55481dd930 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:07.324409  9015 raft_consensus.cc:515] T bb3d8792045a4583ae2e965b1350a5b4 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
W20260709 13:19:07.377025  8993 log.cc:927] Time spent T 427c124d773f483294511e80fe340075 P ccd8a4c3bfe3413cb2ae219b09aea832: Append to log took a long time: real 0.283s	user 0.000s	sys 0.001s
I20260709 13:19:07.322448  8869 leader_election.cc:290] T 9e326172347f45e99a0d482b5d8ef768 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:07.382180  7495 raft_consensus.cc:1240] T 4f00a2e87e56452083b759f60d461ee3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 6 FOLLOWER]: Rejecting Update request from peer b7ab4784c7344b939bc36f639286f377 for earlier term 5. Current term is 6. Ops: []
I20260709 13:19:07.322808  8797 raft_consensus.cc:2804] T d33d5ee8ef6f415593d8df52063161ad P ccd8a4c3bfe3413cb2ae219b09aea832 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:19:07.397102  6877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f00a2e87e56452083b759f60d461ee3" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:19:07.397066  6799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be1a92657f494cac8dd227d152f50151" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:19:07.329185  8876 raft_consensus.cc:493] T 34f36d59d88f40fe8a2805e604fc6c0a P cd75a17ab2604397adab03bb8b5fd75c [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:07.409145  6807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "404190ce4ce94cecbfcb6ea9d1dd8626" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:19:07.415434  6800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab432e62819d499eaaf3dd55481dd930" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:19:07.418339  7501 raft_consensus.cc:1275] T 3fa34c08b205435dba97346991aa1f92 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 6 FOLLOWER]: Refusing update from remote peer cd75a17ab2604397adab03bb8b5fd75c: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:19:07.419018  6846 leader_election.cc:304] T bb7fa124c3bf4ef9ab65a407cb008441 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
W20260709 13:19:07.420825  9002 log.cc:927] Time spent T 44bde925b2e541b69890d70715b85176 P cd75a17ab2604397adab03bb8b5fd75c: Append to log took a long time: real 0.101s	user 0.000s	sys 0.000s
I20260709 13:19:07.423202  6802 raft_consensus.cc:1275] T 34f36d59d88f40fe8a2805e604fc6c0a P b7ab4784c7344b939bc36f639286f377 [term 3 FOLLOWER]: Refusing update from remote peer ccd8a4c3bfe3413cb2ae219b09aea832: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
W20260709 13:19:07.424091  8995 log.cc:927] Time spent T 1528ab62b6fe4e3099d08f141afee116 P cd75a17ab2604397adab03bb8b5fd75c: Append to log took a long time: real 0.321s	user 0.000s	sys 0.001s
I20260709 13:19:07.424250  6803 raft_consensus.cc:1240] T e31b9971c15848dea59d4d4130141d9e P b7ab4784c7344b939bc36f639286f377 [term 4 LEADER]: Rejecting Update request from peer ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 3. Current term is 4. Ops: []
I20260709 13:19:07.424846  6697 leader_election.cc:304] T 3411566abe2d4c9bb4b2adfdd05e6f17 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:19:07.425199  8926 leader_election.cc:290] T 4275cf08e63345f993bce8664eada830 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:19:07.425855  6726 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49998 (request call id 644) took 1121 ms. Trace:
I20260709 13:19:07.426023  8941 leader_election.cc:290] T 3411566abe2d4c9bb4b2adfdd05e6f17 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:07.730372  6726 rpcz_store.cc:276] 0709 13:19:06.304509 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:06.618326 (+313817us) service_pool.cc:224] Handling call
0709 13:19:06.656388 (+ 38062us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:06.841898 (+185510us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:07.425620 (+583722us) spinlock_profiling.cc:243] Waited 184 ms on lock 0x7b540020b2d4. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f9aae01 00007fcc0f9a983e 00007fcc1496e419 00007fcc0dee5bd4 00007fcc0dee5b62 00007fcc0dee5a91 00007fcc0dee5a0c 00007fcc0dee4cc2 00007fcc0dce548c 00007fcc0dce48c6
0709 13:19:07.425794 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":424181504}
I20260709 13:19:07.426613  6798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "404190ce4ce94cecbfcb6ea9d1dd8626" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:19:07.532554  8972 raft_consensus.cc:493] T 7a734b5ab7834e05a8c422208acc58b1 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:07.737136  8972 raft_consensus.cc:515] T 7a734b5ab7834e05a8c422208acc58b1 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:07.738369  6876 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53406 (request call id 1363) took 1154 ms. Trace:
I20260709 13:19:07.739349  6731 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49744 (request call id 138) took 3416 ms. Trace:
I20260709 13:19:07.739578  8972 leader_election.cc:290] T 7a734b5ab7834e05a8c422208acc58b1 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:07.532927  9016 raft_consensus.cc:493] T b3f13b31a1f84f0d89d007eadd57924c P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:19:07.741628  8859 raft_consensus.cc:697] T e77e330a82df4b43a745d57a68f6f057 P cd75a17ab2604397adab03bb8b5fd75c [term 7 LEADER]: Becoming Leader. State: Replica: cd75a17ab2604397adab03bb8b5fd75c, State: Running, Role: LEADER
I20260709 13:19:07.739879  6731 rpcz_store.cc:276] 0709 13:19:04.322573 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:04.322761 (+   188us) service_pool.cc:224] Handling call
0709 13:19:04.323241 (+   480us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:04.327590 (+  4349us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:04.327651 (+    61us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:06.440249 (+2112598us) spinlock_profiling.cc:243] Waited 2.95 ms on lock 0x7b2c00000f48. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0e2a3a11 00007fcc0e2b3372 00007fcc0f9e5a01 00007fcc0f9aa43a 00007fcc0f9a983e 00007fcc1496e419 00007fcc0dee5bd4 00007fcc0dee5b62 00007fcc0dee5a91 00007fcc0dee5a0c 00007fcc0dee4cc2
0709 13:19:06.440788 (+   539us) log.cc:844] Serialized 26 byte log entry
0709 13:19:06.909294 (+468506us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:19:06.909359 (+    65us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:06.909486 (+   127us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:07.739035 (+829549us) raft_consensus.cc:1685] finished
0709 13:19:07.739058 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:07.739273 (+   215us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3805,"raft.queue_time_us":7034,"raft.run_cpu_time_us":154,"raft.run_wall_time_us":14473,"spinlock_wait_cycles":6776704,"thread_start_us":467943,"threads_started":1,"wal-append.queue_time_us":595647}
I20260709 13:19:07.742646  8859 consensus_queue.cc:237] T e77e330a82df4b43a745d57a68f6f057 P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } }
I20260709 13:19:07.533135  8773 raft_consensus.cc:493] T fe20b4b48823486ca3b9c648db6ce8aa P cd75a17ab2604397adab03bb8b5fd75c [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:07.744422  7500 raft_consensus.cc:1240] T 7ba5dac66ab5497e9e336f2a3c28cda5 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 6 FOLLOWER]: Rejecting Update request from peer b7ab4784c7344b939bc36f639286f377 for earlier term 5. Current term is 6. Ops: []
I20260709 13:19:07.744735  8773 raft_consensus.cc:515] T fe20b4b48823486ca3b9c648db6ce8aa P cd75a17ab2604397adab03bb8b5fd75c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:19:07.738982  6876 rpcz_store.cc:276] 0709 13:19:06.583811 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:06.584026 (+   215us) service_pool.cc:224] Handling call
0709 13:19:06.584529 (+   503us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:06.584871 (+   342us) raft_consensus.cc:1534] Early marking committed up to index 1
0709 13:19:06.584909 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:06.614328 (+ 29419us) log.cc:844] Serialized 26 byte log entry
0709 13:19:06.990629 (+376301us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:19:06.990680 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:06.990775 (+    95us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:07.738072 (+747297us) raft_consensus.cc:1685] finished
0709 13:19:07.738105 (+    33us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:07.738273 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":362134,"threads_started":1,"wal-append.queue_time_us":557225}
I20260709 13:19:07.746631  6876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab432e62819d499eaaf3dd55481dd930" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:19:07.747565  6876 raft_consensus.cc:2468] T ab432e62819d499eaaf3dd55481dd930 P cd75a17ab2604397adab03bb8b5fd75c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 6.
I20260709 13:19:07.749873  9000 leader_election.cc:290] T d8cee0accdb8499c86d4414b72565a38 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:07.750869  6799 raft_consensus.cc:2468] T be1a92657f494cac8dd227d152f50151 P b7ab4784c7344b939bc36f639286f377 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in term 6.
I20260709 13:19:07.740972  6877 raft_consensus.cc:3060] T 4f00a2e87e56452083b759f60d461ee3 P cd75a17ab2604397adab03bb8b5fd75c [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:07.741032  8998 raft_consensus.cc:493] T be1a92657f494cac8dd227d152f50151 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:07.459288  8845 leader_election.cc:290] T 90d42e216d9741e190bca19a781291fd P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
W20260709 13:19:07.767400  6678 auto_rebalancer.cc:893] Removing replace marker failed: Replica cd75a17ab2604397adab03bb8b5fd75c is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 5 leader_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } attrs { replace: true } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } } }
W20260709 13:19:07.767835  6678 auto_rebalancer.cc:901] Could not move replica: Illegal state: not currently leader
I20260709 13:19:07.398715  8973 consensus_queue.cc:237] T 17587d6730594da4a56fa13a353232a1 P 7ba59cc884714e8aa5f3f0ecaed84cbb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:19:07.402606  9008 raft_consensus.cc:493] T 853ac0a8cbd64ce99457f170216d4d0f P ccd8a4c3bfe3413cb2ae219b09aea832 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
W20260709 13:19:07.657701  8836 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.586s	user 0.012s	sys 0.011s
I20260709 13:19:07.552238  8987 raft_consensus.cc:3055] T f09c2a98de1a4decabd0ff900dd44caa P ccd8a4c3bfe3413cb2ae219b09aea832 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:19:07.385675  8938 raft_consensus.cc:697] T b56bf91d90824c959e21e0cee5ba1816 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 6 LEADER]: Becoming Leader. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
W20260709 13:19:07.772087  9006 log.cc:927] Time spent T 7ba5dac66ab5497e9e336f2a3c28cda5 P cd75a17ab2604397adab03bb8b5fd75c: Append to log took a long time: real 0.364s	user 0.001s	sys 0.000s
W20260709 13:19:07.772594  8997 log.cc:927] Time spent T 3fa34c08b205435dba97346991aa1f92 P cd75a17ab2604397adab03bb8b5fd75c: Append to log took a long time: real 0.415s	user 0.000s	sys 0.002s
W20260709 13:19:07.893744  6770 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.031s	user 0.017s	sys 0.036s
W20260709 13:19:07.785581  6697 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 360781us
W20260709 13:19:07.469600  8989 log.cc:927] Time spent T 4b8cacb381b746da8d0049b0a83b41dd P 7ba59cc884714e8aa5f3f0ecaed84cbb: Append to log took a long time: real 0.430s	user 0.000s	sys 0.001s
I20260709 13:19:07.857967  6803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8cee0accdb8499c86d4414b72565a38" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:19:07.786181  6872 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53416 (request call id 2171) took 1044 ms. Trace:
I20260709 13:19:07.974452  6872 rpcz_store.cc:276] 0709 13:19:06.742334 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:07.348661 (+606327us) service_pool.cc:224] Handling call
0709 13:19:07.378583 (+ 29922us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:07.379099 (+   516us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:19:07.407222 (+ 28123us) log.cc:844] Serialized 14 byte log entry
0709 13:19:07.785718 (+378496us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:07.785796 (+    78us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:19:07.785853 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:07.785933 (+    80us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:07.786108 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":14262,"prepare.queue_time_us":22302,"prepare.run_cpu_time_us":43,"prepare.run_wall_time_us":45,"thread_start_us":378034,"threads_started":1}
I20260709 13:19:07.740432  8926 raft_consensus.cc:493] T f58dc08b12a2494bb9a1372837970ca2 P cd75a17ab2604397adab03bb8b5fd75c [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:07.572353  8892 leader_election.cc:290] T 404190ce4ce94cecbfcb6ea9d1dd8626 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:19:07.752092  8797 raft_consensus.cc:493] T d33d5ee8ef6f415593d8df52063161ad P ccd8a4c3bfe3413cb2ae219b09aea832 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:19:07.865227  8836 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.791s	user 0.012s	sys 0.018s
I20260709 13:19:07.865656  8987 raft_consensus.cc:740] T f09c2a98de1a4decabd0ff900dd44caa P ccd8a4c3bfe3413cb2ae219b09aea832 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
W20260709 13:19:07.774605  6678 auto_rebalancer.cc:330] scheduled replica move failed to complete: Illegal state: not currently leader
I20260709 13:19:07.751259  9016 raft_consensus.cc:515] T b3f13b31a1f84f0d89d007eadd57924c P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:19:07.575919  9023 raft_consensus.cc:493] T 07a92dd554674067a83a9cb68c4773f2 P cd75a17ab2604397adab03bb8b5fd75c [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:07.950367  6697 leader_election.cc:304] T 4b8cacb381b746da8d0049b0a83b41dd P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, cd75a17ab2604397adab03bb8b5fd75c
W20260709 13:19:07.951270  6770 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.089s	user 0.018s	sys 0.043s
W20260709 13:19:08.061038  6770 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 1.21615e+06us
I20260709 13:19:07.865293  8978 raft_consensus.cc:2804] T 3411566abe2d4c9bb4b2adfdd05e6f17 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:19:08.073423  6772 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.002s	user 0.045s	sys 0.063s
W20260709 13:19:08.023648  6847 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:07.921600  8793 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.910s	user 0.014s	sys 0.027s
I20260709 13:19:07.754948  8876 raft_consensus.cc:515] T 34f36d59d88f40fe8a2805e604fc6c0a P cd75a17ab2604397adab03bb8b5fd75c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
W20260709 13:19:07.947193  8832 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.992s	user 0.002s	sys 0.031s
I20260709 13:19:07.866338  9008 raft_consensus.cc:515] T 853ac0a8cbd64ce99457f170216d4d0f P ccd8a4c3bfe3413cb2ae219b09aea832 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
W20260709 13:19:08.061038  6697 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 110816us
I20260709 13:19:07.766496  8998 raft_consensus.cc:3060] T be1a92657f494cac8dd227d152f50151 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:19:07.984422  7469 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:08.071424  6877 raft_consensus.cc:2468] T 4f00a2e87e56452083b759f60d461ee3 P cd75a17ab2604397adab03bb8b5fd75c [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in term 6.
I20260709 13:19:08.073526  6872 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53406 (request call id 1372) took 1323 ms. Trace:
I20260709 13:19:07.752321  8919 raft_consensus.cc:740] T 7c44c4849aa54f2b94d1f1bef9ed546f P cd75a17ab2604397adab03bb8b5fd75c [term 6 LEADER]: Becoming Follower/Learner. State: Replica: cd75a17ab2604397adab03bb8b5fd75c, State: Running, Role: LEADER
W20260709 13:19:08.074309  6772 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.003s	user 0.045s	sys 0.063s
W20260709 13:19:08.350229  6845 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:08.267877  6876 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.517s	user 0.001s	sys 0.000s
W20260709 13:19:08.380162  6772 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 1.30914e+06us
W20260709 13:19:08.315281  6771 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:08.381240  6877 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58592 (request call id 135) took 1018 ms. Trace:
I20260709 13:19:08.382652  6877 rpcz_store.cc:276] 0709 13:19:07.363313 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:07.396789 (+ 33476us) service_pool.cc:224] Handling call
0709 13:19:08.381177 (+984388us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:19:08.385389  6697 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:08.380523  6876 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.630s	user 0.003s	sys 0.005s
I20260709 13:19:08.382424  6872 rpcz_store.cc:276] 0709 13:19:06.750218 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:08.023007 (+1272789us) service_pool.cc:224] Handling call
0709 13:19:08.072831 (+ 49824us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:08.073139 (+   308us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:08.073171 (+    32us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:08.073212 (+    41us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:19:08.073239 (+    27us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:08.073297 (+    58us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:08.073451 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:19:08.154927  6695 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.688s	user 0.018s	sys 0.055s
W20260709 13:19:08.388267  6881 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.755s	user 0.002s	sys 0.010s
W20260709 13:19:08.388669  6695 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.922s	user 0.027s	sys 0.060s
W20260709 13:19:08.389011  6881 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.756s	user 0.002s	sys 0.010s
I20260709 13:19:08.400595  7500 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50744 (request call id 171) took 1058 ms. Trace:
I20260709 13:19:08.023172  8797 raft_consensus.cc:3060] T d33d5ee8ef6f415593d8df52063161ad P ccd8a4c3bfe3413cb2ae219b09aea832 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:08.021979  8836 raft_consensus.cc:697] T fe20b4b48823486ca3b9c648db6ce8aa P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 3 LEADER]: Becoming Leader. State: Replica: 7ba59cc884714e8aa5f3f0ecaed84cbb, State: Running, Role: LEADER
I20260709 13:19:08.416641  6877 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53406 (request call id 1374) took 1665 ms. Trace:
I20260709 13:19:08.033776  8574 raft_consensus.cc:493] T 2c240553ce044eedb41541d72b9475d7 P b7ab4784c7344b939bc36f639286f377 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:08.404840  7500 rpcz_store.cc:276] 0709 13:19:07.398862 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:07.410304 (+ 11442us) service_pool.cc:224] Handling call
0709 13:19:07.410614 (+   310us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:07.745151 (+334537us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:08.400188 (+655037us) spinlock_profiling.cc:243] Waited 333 ms on lock 0x7b54004691d4. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f9aae01 00007fcc0f9a983e 00007fcc1496e419 00007fcc0dee5bd4 00007fcc0dee5b62 00007fcc0dee5a91 00007fcc0dee5a0c 00007fcc0dee4cc2 00007fcc0dce548c 00007fcc0dce48c6
0709 13:19:08.400494 (+   306us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":766975232}
W20260709 13:19:08.072136  8995 log.cc:927] Time spent T 1528ab62b6fe4e3099d08f141afee116 P cd75a17ab2604397adab03bb8b5fd75c: Append to log took a long time: real 0.147s	user 0.000s	sys 0.000s
W20260709 13:19:08.090031  8963 consensus_meta.cc:287] T d8292e16e5654be6bc408560cf256aaa P b7ab4784c7344b939bc36f639286f377: Time spent flushing consensus metadata: real 0.818s	user 0.006s	sys 0.005s
I20260709 13:19:08.417341  6877 rpcz_store.cc:276] 0709 13:19:06.750709 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:08.412318 (+1661609us) service_pool.cc:224] Handling call
0709 13:19:08.414047 (+  1729us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:08.415820 (+  1773us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:08.415865 (+    45us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:08.415936 (+    71us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:19:08.415986 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:08.416102 (+   116us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:08.416526 (+   424us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:08.447117  6877 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53416 (request call id 2175) took 1692 ms. Trace:
W20260709 13:19:08.087603  9011 log.cc:927] Time spent T 3d65025eea89441290d85dd053810e31 P b7ab4784c7344b939bc36f639286f377: Append to log took a long time: real 0.332s	user 0.000s	sys 0.000s
W20260709 13:19:08.382213  8832 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.504s	user 0.004s	sys 0.038s
W20260709 13:19:08.259815  8859 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.513s	user 0.026s	sys 0.018s
W20260709 13:19:08.385562  8793 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.374s	user 0.014s	sys 0.035s
W20260709 13:19:08.363691  8792 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.979s	user 0.001s	sys 0.008s
I20260709 13:19:08.080643  8892 raft_consensus.cc:2749] T 4b8cacb381b746da8d0049b0a83b41dd P ccd8a4c3bfe3413cb2ae219b09aea832 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:19:08.086426  7499 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50742 (request call id 286) took 1235 ms. Trace:
I20260709 13:19:08.448172  6872 raft_consensus.cc:1240] T 4f00a2e87e56452083b759f60d461ee3 P cd75a17ab2604397adab03bb8b5fd75c [term 6 FOLLOWER]: Rejecting Update request from peer b7ab4784c7344b939bc36f639286f377 for earlier term 5. Current term is 6. Ops: []
I20260709 13:19:08.100729  8992 raft_consensus.cc:3060] T 17587d6730594da4a56fa13a353232a1 P b7ab4784c7344b939bc36f639286f377 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:08.080852  8978 raft_consensus.cc:493] T 3411566abe2d4c9bb4b2adfdd05e6f17 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:08.400820  9028 raft_consensus.cc:493] T 3fa34c08b205435dba97346991aa1f92 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:08.520323  8978 raft_consensus.cc:3060] T 3411566abe2d4c9bb4b2adfdd05e6f17 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:19:08.520629  9028 raft_consensus.cc:515] T 3fa34c08b205435dba97346991aa1f92 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:19:08.523155  9028 leader_election.cc:290] T 3fa34c08b205435dba97346991aa1f92 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:08.524499  8836 consensus_queue.cc:237] T fe20b4b48823486ca3b9c648db6ce8aa P 7ba59cc884714e8aa5f3f0ecaed84cbb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:19:08.525184  6872 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53406 (request call id 1375) took 1774 ms. Trace:
I20260709 13:19:08.525842  6872 rpcz_store.cc:276] 0709 13:19:06.750976 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:08.407846 (+1656870us) service_pool.cc:224] Handling call
0709 13:19:08.447868 (+ 40022us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:08.515807 (+ 67939us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:08.525084 (+  9277us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:08.528008  6872 raft_consensus.cc:1275] T c4db81d9d329422bb3b4160ca4ac2d1d P cd75a17ab2604397adab03bb8b5fd75c [term 6 FOLLOWER]: Refusing update from remote peer ccd8a4c3bfe3413cb2ae219b09aea832: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:19:08.529048  6872 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53416 (request call id 2178) took 1698 ms. Trace:
I20260709 13:19:08.529520  6872 rpcz_store.cc:276] 0709 13:19:06.830722 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:08.526978 (+1696256us) service_pool.cc:224] Handling call
0709 13:19:08.527521 (+   543us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:08.528695 (+  1174us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:08.528971 (+   276us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:08.513181  7499 rpcz_store.cc:276] 0709 13:19:06.851042 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:06.867407 (+ 16365us) service_pool.cc:224] Handling call
0709 13:19:08.085552 (+1218145us) spinlock_profiling.cc:243] Waited 3.72 ms on lock 0x7b5800123f98. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0c745db1 00007fcc0c885b71 00007fcc0c885a22 00007fcc1579ec09 00007fcc148f8ee0 00007fcc149c20ab 00007fcc149c2131 00007fcc14983fc0 00007fcc1496e929 00007fcc1496e3d2 00007fcc0dee5bd4
0709 13:19:08.085818 (+   266us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:08.086052 (+   234us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:08.086082 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:08.086128 (+    46us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:19:08.086159 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:08.086222 (+    63us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:08.086342 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":8558464}
I20260709 13:19:08.531448  6872 raft_consensus.cc:1275] T de3186201e1a40d0b335eeb8b4e256e0 P cd75a17ab2604397adab03bb8b5fd75c [term 5 FOLLOWER]: Refusing update from remote peer ccd8a4c3bfe3413cb2ae219b09aea832: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:19:08.155176  9023 raft_consensus.cc:515] T 07a92dd554674067a83a9cb68c4773f2 P cd75a17ab2604397adab03bb8b5fd75c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:08.437264  9034 consensus_queue.cc:1048] T 44bde925b2e541b69890d70715b85176 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 1, Time since last communication: 0.098s
I20260709 13:19:08.457132  7495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "404190ce4ce94cecbfcb6ea9d1dd8626" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:19:08.090229  8941 consensus_queue.cc:1048] T d33d5ee8ef6f415593d8df52063161ad P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.368s
I20260709 13:19:08.102847  9024 raft_consensus.cc:493] T 4d9def8b32fd443aa94ab1420b06837b P cd75a17ab2604397adab03bb8b5fd75c [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:19:08.091761  8987 consensus_queue.cc:260] T f09c2a98de1a4decabd0ff900dd44caa P ccd8a4c3bfe3413cb2ae219b09aea832 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:08.465759  8876 leader_election.cc:290] T 34f36d59d88f40fe8a2805e604fc6c0a P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:19:08.472615  8986 raft_consensus.cc:493] T bd6869f07b5a4885a0b99fbe60c3b175 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:19:08.033424  8926 raft_consensus.cc:515] T f58dc08b12a2494bb9a1372837970ca2 P cd75a17ab2604397adab03bb8b5fd75c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:08.534219  9023 leader_election.cc:290] T 07a92dd554674067a83a9cb68c4773f2 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:19:08.346938  9016 leader_election.cc:290] T b3f13b31a1f84f0d89d007eadd57924c P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:19:08.472651  8919 consensus_queue.cc:260] T 7c44c4849aa54f2b94d1f1bef9ed546f P cd75a17ab2604397adab03bb8b5fd75c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:08.540871  9023 raft_consensus.cc:493] T de3186201e1a40d0b335eeb8b4e256e0 P cd75a17ab2604397adab03bb8b5fd75c [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:08.541019  8919 raft_consensus.cc:3060] T 7c44c4849aa54f2b94d1f1bef9ed546f P cd75a17ab2604397adab03bb8b5fd75c [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:08.541368  9023 raft_consensus.cc:515] T de3186201e1a40d0b335eeb8b4e256e0 P cd75a17ab2604397adab03bb8b5fd75c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:08.541581  8926 leader_election.cc:290] T f58dc08b12a2494bb9a1372837970ca2 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:19:08.223502  8768 leader_election.cc:290] T f5be3a11b23d4ea9b08300a2789821c7 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
W20260709 13:19:08.441807  6696 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:08.476367  7466 leader_election.cc:304] T 404190ce4ce94cecbfcb6ea9d1dd8626 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:19:08.347872  6627 catalog_manager.cc:5697] T 24ee15416e3145beaa1b8183453729a3 P 7ba59cc884714e8aa5f3f0ecaed84cbb reported cstate change: term changed from 3 to 4, leader changed from cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67) to 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68). New cstate: current_term: 4 leader_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:19:08.098845  8347 consensus_queue.cc:1048] T ab432e62819d499eaaf3dd55481dd930 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.381s
W20260709 13:19:08.483136  8965 consensus_meta.cc:287] T 9e326172347f45e99a0d482b5d8ef768 P cd75a17ab2604397adab03bb8b5fd75c: Time spent flushing consensus metadata: real 1.325s	user 0.012s	sys 0.002s
I20260709 13:19:08.437451  8973 raft_consensus.cc:493] T ce4f062dcd314d43a63ca74067cb5ee3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 6 FOLLOWER]: Starting pre-election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:19:08.439291  9036 raft_consensus.cc:493] T 1528ab62b6fe4e3099d08f141afee116 P cd75a17ab2604397adab03bb8b5fd75c [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 7ba59cc884714e8aa5f3f0ecaed84cbb)
I20260709 13:19:08.445946  7496 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50756 (request call id 157) took 2255 ms. Trace:
I20260709 13:19:08.538592  8876 raft_consensus.cc:493] T 2c240553ce044eedb41541d72b9475d7 P cd75a17ab2604397adab03bb8b5fd75c [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:08.568262  8876 raft_consensus.cc:515] T 2c240553ce044eedb41541d72b9475d7 P cd75a17ab2604397adab03bb8b5fd75c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:08.567173  7496 rpcz_store.cc:276] 0709 13:19:06.166668 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:06.166911 (+   243us) service_pool.cc:224] Handling call
0709 13:19:06.167447 (+   536us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:19:06.239893 (+ 72446us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:06.247005 (+  7112us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:19:06.289688 (+ 42683us) log.cc:844] Serialized 52 byte log entry
0709 13:19:06.740659 (+450971us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:19:06.745802 (+  5143us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:06.761999 (+ 16197us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:08.097115 (+1335116us) raft_consensus.cc:1685] finished
0709 13:19:08.097179 (+    64us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:08.418722 (+321543us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":18065,"raft.run_cpu_time_us":116,"raft.run_wall_time_us":115,"thread_start_us":472232,"threads_started":2,"wal-append.queue_time_us":594716}
I20260709 13:19:08.570636  8876 leader_election.cc:290] T 2c240553ce044eedb41541d72b9475d7 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:19:08.539633  8986 raft_consensus.cc:515] T bd6869f07b5a4885a0b99fbe60c3b175 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:08.532239  8797 raft_consensus.cc:515] T d33d5ee8ef6f415593d8df52063161ad P ccd8a4c3bfe3413cb2ae219b09aea832 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
W20260709 13:19:08.498924  8859 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.752s	user 0.026s	sys 0.027s
I20260709 13:19:08.487723  9015 leader_election.cc:290] T bb3d8792045a4583ae2e965b1350a5b4 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
W20260709 13:19:08.510260  8792 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.126s	user 0.003s	sys 0.010s
W20260709 13:19:08.518929  8996 log.cc:927] Time spent T 95a75bfe094d4bdc963aba3f08dfcd25 P ccd8a4c3bfe3413cb2ae219b09aea832: Append to log took a long time: real 1.386s	user 0.002s	sys 0.000s
I20260709 13:19:08.421358  8938 consensus_queue.cc:237] T b56bf91d90824c959e21e0cee5ba1816 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:08.534498  9042 raft_consensus.cc:493] T 7a734b5ab7834e05a8c422208acc58b1 P cd75a17ab2604397adab03bb8b5fd75c [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:08.535993  9033 consensus_queue.cc:1048] T bb7fa124c3bf4ef9ab65a407cb008441 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.040s
I20260709 13:19:08.405356  6881 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53416 (request call id 2169) took 1673 ms. Trace:
I20260709 13:19:08.480381  8963 raft_consensus.cc:515] T d8292e16e5654be6bc408560cf256aaa P b7ab4784c7344b939bc36f639286f377 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:08.593276  6732 raft_consensus.cc:1240] T 9b3759de40694069b13c0f8bd40e5709 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 6 LEADER]: Rejecting Update request from peer cd75a17ab2604397adab03bb8b5fd75c for earlier term 5. Current term is 6. Ops: []
W20260709 13:19:08.546597  7466 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 70373.4us
I20260709 13:19:08.534950  6872 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53416 (request call id 2179) took 1672 ms. Trace:
I20260709 13:19:08.490368  8574 raft_consensus.cc:515] T 2c240553ce044eedb41541d72b9475d7 P b7ab4784c7344b939bc36f639286f377 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:08.563364  6874 raft_consensus.cc:1275] T 9e326172347f45e99a0d482b5d8ef768 P cd75a17ab2604397adab03bb8b5fd75c [term 5 FOLLOWER]: Refusing update from remote peer ccd8a4c3bfe3413cb2ae219b09aea832: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 3. (term mismatch)
I20260709 13:19:08.594406  6874 pending_rounds.cc:85] T 9e326172347f45e99a0d482b5d8ef768 P cd75a17ab2604397adab03bb8b5fd75c: Aborting all ops after (but not including) 2
I20260709 13:19:08.594770  6874 pending_rounds.cc:107] T 9e326172347f45e99a0d482b5d8ef768 P cd75a17ab2604397adab03bb8b5fd75c: Aborting uncommitted NO_OP operation due to leader change: 4.3
I20260709 13:19:08.588300  6881 rpcz_store.cc:276] 0709 13:19:06.731637 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:07.343408 (+611771us) service_pool.cc:224] Handling call
0709 13:19:07.343838 (+   430us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:07.344093 (+   255us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:19:07.365565 (+ 21472us) log.cc:844] Serialized 14 byte log entry
0709 13:19:08.404746 (+1039181us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:08.404823 (+    77us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:19:08.404907 (+    84us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:08.405028 (+   121us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:08.405260 (+   232us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":24049,"prepare.queue_time_us":33171,"prepare.run_cpu_time_us":43,"prepare.run_wall_time_us":44,"raft.queue_time_us":815780,"raft.run_cpu_time_us":297,"raft.run_wall_time_us":14722,"thread_start_us":1038551,"threads_started":2,"wal-append.queue_time_us":1018111}
I20260709 13:19:08.595033  6874 raft_consensus.cc:2889] T 9e326172347f45e99a0d482b5d8ef768 P cd75a17ab2604397adab03bb8b5fd75c [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:19:08.512639  9038 raft_consensus.cc:2804] T bb7fa124c3bf4ef9ab65a407cb008441 P cd75a17ab2604397adab03bb8b5fd75c [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:19:08.539194  9008 leader_election.cc:290] T 853ac0a8cbd64ce99457f170216d4d0f P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
W20260709 13:19:08.585937  6770 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 497260us
I20260709 13:19:08.536473  7495 raft_consensus.cc:2468] T 404190ce4ce94cecbfcb6ea9d1dd8626 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 6.
I20260709 13:19:08.491068  6877 rpcz_store.cc:276] 0709 13:19:06.756593 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:08.446010 (+1689417us) service_pool.cc:224] Handling call
0709 13:19:08.446425 (+   415us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:08.446669 (+   244us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:08.446710 (+    41us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:08.446764 (+    54us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:19:08.446806 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:08.446879 (+    73us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:08.447037 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:08.595665  6872 rpcz_store.cc:276] 0709 13:19:06.862979 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:08.530556 (+1667577us) service_pool.cc:224] Handling call
0709 13:19:08.531000 (+   444us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:08.531956 (+   956us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:08.534859 (+  2903us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:08.607327  6770 leader_election.cc:304] T b3f13b31a1f84f0d89d007eadd57924c P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:19:08.537921  9024 raft_consensus.cc:515] T 4d9def8b32fd443aa94ab1420b06837b P cd75a17ab2604397adab03bb8b5fd75c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:08.603538  6881 raft_consensus.cc:2955] T ce4f062dcd314d43a63ca74067cb5ee3 P cd75a17ab2604397adab03bb8b5fd75c [term 6 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } attrs { replace: true } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } } }
W20260709 13:19:08.639529  6844 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.093s	user 0.024s	sys 0.052s
W20260709 13:19:08.640168  6844 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.094s	user 0.025s	sys 0.052s
I20260709 13:19:08.590819  9023 leader_election.cc:290] T de3186201e1a40d0b335eeb8b4e256e0 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:19:08.574751  8973 raft_consensus.cc:515] T ce4f062dcd314d43a63ca74067cb5ee3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } attrs { replace: true } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:19:08.598865  8773 leader_election.cc:290] T fe20b4b48823486ca3b9c648db6ce8aa P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:19:08.599036  9038 raft_consensus.cc:493] T bb7fa124c3bf4ef9ab65a407cb008441 P cd75a17ab2604397adab03bb8b5fd75c [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:19:08.645828  8995 log.cc:927] Time spent T 1528ab62b6fe4e3099d08f141afee116 P cd75a17ab2604397adab03bb8b5fd75c: Append to log took a long time: real 0.054s	user 0.001s	sys 0.000s
I20260709 13:19:08.626699  9016 raft_consensus.cc:2749] T 404190ce4ce94cecbfcb6ea9d1dd8626 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:19:08.627331  9008 raft_consensus.cc:493] T 90d42e216d9741e190bca19a781291fd P ccd8a4c3bfe3413cb2ae219b09aea832 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:08.657701  8990 consensus_meta.cc:287] T 1bf4668eeb70467fb3dc5a0289233b3c P ccd8a4c3bfe3413cb2ae219b09aea832: Time spent flushing consensus metadata: real 0.892s	user 0.006s	sys 0.006s
I20260709 13:19:08.574447  9036 raft_consensus.cc:515] T 1528ab62b6fe4e3099d08f141afee116 P cd75a17ab2604397adab03bb8b5fd75c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } attrs { replace: true } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:19:08.656198  6872 raft_consensus.cc:1240] T 711ef6523deb4cbe8ef2ba61e1c21c98 P cd75a17ab2604397adab03bb8b5fd75c [term 6 FOLLOWER]: Rejecting Update request from peer ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 13:19:08.676510  8990 raft_consensus.cc:515] T 1bf4668eeb70467fb3dc5a0289233b3c P ccd8a4c3bfe3413cb2ae219b09aea832 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
W20260709 13:19:08.677112  9032 log.cc:927] Time spent T 711ef6523deb4cbe8ef2ba61e1c21c98 P ccd8a4c3bfe3413cb2ae219b09aea832: Append to log took a long time: real 0.102s	user 0.000s	sys 0.001s
W20260709 13:19:08.670897  6844 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.5.126.66:42817 timed out after 1.804s (SENT) [suppressed 21 similar messages]
I20260709 13:19:08.676231  9028 raft_consensus.cc:2955] T 427c124d773f483294511e80fe340075 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 5 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } attrs { replace: true } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } } }
I20260709 13:19:08.663399  8347 raft_consensus.cc:2749] T b3f13b31a1f84f0d89d007eadd57924c P b7ab4784c7344b939bc36f639286f377 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:19:08.682174  6879 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58592 (request call id 121) took 3428 ms. Trace:
I20260709 13:19:08.683323  6872 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53416 (request call id 2183) took 1265 ms. Trace:
I20260709 13:19:08.684125  6872 rpcz_store.cc:276] 0709 13:19:07.418277 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:08.606785 (+1188508us) service_pool.cc:224] Handling call
0709 13:19:08.655881 (+ 49096us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:08.682989 (+ 27108us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:08.683252 (+   263us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:08.682754  6879 rpcz_store.cc:276] 0709 13:19:05.253633 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:06.002337 (+748704us) service_pool.cc:224] Handling call
0709 13:19:06.008832 (+  6495us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:06.009565 (+   733us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:19:06.361603 (+352038us) log.cc:844] Serialized 14 byte log entry
0709 13:19:07.041335 (+679732us) spinlock_profiling.cc:243] Waited 946 us on lock 0x7b1800429460. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc15785de1 00007fcc157925b1 00007fcc0c89fe07 00007fcc156faab9 00007fcc0c8bc69b 00007fcc0c8ba93f 00007fcc0c8ba455 00007fcc133a23c7 00007fcc0f9b49a7 00007fcc0f9bd5e5 00007fcc0f9bd568
0709 13:19:07.298203 (+256868us) log.cc:844] Serialized 14 byte log entry
0709 13:19:07.298344 (+   141us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:07.311833 (+ 13489us) log.cc:844] Serialized 26 byte log entry
0709 13:19:07.312013 (+   180us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:19:07.312287 (+   274us) log.cc:844] Serialized 14 byte log entry
0709 13:19:07.312455 (+   168us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:07.321013 (+  8558us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:08.681897 (+1360884us) raft_consensus.cc:1685] finished
0709 13:19:08.681925 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:08.682095 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":336,"prepare.queue_time_us":274432,"prepare.run_cpu_time_us":86,"prepare.run_wall_time_us":91,"raft.queue_time_us":13119,"raft.run_cpu_time_us":465,"raft.run_wall_time_us":19779,"spinlock_wait_cycles":2177152,"thread_start_us":650671,"threads_started":2,"wal-append.queue_time_us":626426}
I20260709 13:19:08.657948  8986 leader_election.cc:290] T bd6869f07b5a4885a0b99fbe60c3b175 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:08.606582  9042 raft_consensus.cc:515] T 7a734b5ab7834e05a8c422208acc58b1 P cd75a17ab2604397adab03bb8b5fd75c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:08.663110  9038 raft_consensus.cc:3060] T bb7fa124c3bf4ef9ab65a407cb008441 P cd75a17ab2604397adab03bb8b5fd75c [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:19:08.698987  6772 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 261076us
W20260709 13:19:08.674763  6770 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 67555.1us
I20260709 13:19:08.702346  6770 leader_election.cc:304] T 7c44c4849aa54f2b94d1f1bef9ed546f P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:19:08.705768  6798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5be3a11b23d4ea9b08300a2789821c7" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:19:08.706091  6799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "853ac0a8cbd64ce99457f170216d4d0f" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
W20260709 13:19:08.700412  6847 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:08.709802  6807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1704639a875409b9959353527b3fd68" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:19:08.718688  6800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f9c2e2bf644115957398fe4c9459db" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:19:08.720151  6800 raft_consensus.cc:2410] T f3f9c2e2bf644115957398fe4c9459db P b7ab4784c7344b939bc36f639286f377 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c for term 6 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
W20260709 13:19:08.723634  6846 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.972s	user 0.013s	sys 0.017s
W20260709 13:19:08.724215  6846 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.973s	user 0.013s	sys 0.017s
W20260709 13:19:08.724646  6846 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.68:45071, user_credentials={real_user=slave}} blocked reactor thread for 1.30566e+06us
I20260709 13:19:08.734901  6876 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53416 (request call id 2172) took 1992 ms. Trace:
W20260709 13:19:08.739494  6772 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:08.740007  6697 leader_election.cc:304] T ab432e62819d499eaaf3dd55481dd930 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:19:08.736116  6876 rpcz_store.cc:276] 0709 13:19:06.751753 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:07.749005 (+997252us) service_pool.cc:224] Handling call
0709 13:19:07.749306 (+   301us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:07.749569 (+   263us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:19:07.750021 (+   452us) log.cc:844] Serialized 14 byte log entry
0709 13:19:08.734539 (+984518us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:08.734590 (+    51us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:19:08.734635 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:08.734705 (+    70us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:08.734829 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":27485,"prepare.queue_time_us":248,"prepare.run_cpu_time_us":47,"prepare.run_wall_time_us":50,"raft.queue_time_us":154387,"raft.run_cpu_time_us":112,"raft.run_wall_time_us":112,"thread_start_us":956461,"threads_started":2,"wal-append.queue_time_us":700358}
I20260709 13:19:08.738134  8768 raft_consensus.cc:493] T 7887766dc6784fcaa42b35c05fea7a99 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:08.742120  8768 raft_consensus.cc:515] T 7887766dc6784fcaa42b35c05fea7a99 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:08.742450  8574 leader_election.cc:290] T 2c240553ce044eedb41541d72b9475d7 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:08.657892  9031 consensus_queue.cc:1059] T 3d65025eea89441290d85dd053810e31 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.042s
I20260709 13:19:08.678334  9008 raft_consensus.cc:515] T 90d42e216d9741e190bca19a781291fd P ccd8a4c3bfe3413cb2ae219b09aea832 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:08.747237  6879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f9c2e2bf644115957398fe4c9459db" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:19:08.747987  6879 raft_consensus.cc:2468] T f3f9c2e2bf644115957398fe4c9459db P cd75a17ab2604397adab03bb8b5fd75c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 5.
I20260709 13:19:08.747608  6804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ba5dac66ab5497e9e336f2a3c28cda5" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:19:08.749830  6800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4db81d9d329422bb3b4160ca4ac2d1d" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:19:08.751657  6879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f03d0dbf16864ca4bc1bb5e4c0334c0f" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:19:08.752015  6802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c37d41cd9164c15a6826ca62a851a69" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:19:08.751575  6803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "713b5728a197487c9300b310ab94e5a3" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:19:08.755373  6800 raft_consensus.cc:2368] T c4db81d9d329422bb3b4160ca4ac2d1d P b7ab4784c7344b939bc36f639286f377 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c for earlier term 5. Current term is 6.
I20260709 13:19:08.758956  6876 raft_consensus.cc:1275] T e31b9971c15848dea59d4d4130141d9e P cd75a17ab2604397adab03bb8b5fd75c [term 4 FOLLOWER]: Refusing update from remote peer b7ab4784c7344b939bc36f639286f377: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:19:08.737653  9033 raft_consensus.cc:2804] T 7c44c4849aa54f2b94d1f1bef9ed546f P b7ab4784c7344b939bc36f639286f377 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:19:08.770255  6876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6869f07b5a4885a0b99fbe60c3b175" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 6 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:19:08.735257  8940 raft_consensus.cc:493] T 711ef6523deb4cbe8ef2ba61e1c21c98 P b7ab4784c7344b939bc36f639286f377 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:19:08.782269  6724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3d8792045a4583ae2e965b1350a5b4" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:19:08.734889  8986 raft_consensus.cc:493] T 8c7f33e544204fbaac4078e3e83bbf4e P ccd8a4c3bfe3413cb2ae219b09aea832 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:19:08.787165  6800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6869f07b5a4885a0b99fbe60c3b175" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 6 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:19:08.787899  6879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24ee15416e3145beaa1b8183453729a3" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:19:08.789039  6879 raft_consensus.cc:2393] T 24ee15416e3145beaa1b8183453729a3 P cd75a17ab2604397adab03bb8b5fd75c [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7ab4784c7344b939bc36f639286f377 in current term 5: Already voted for candidate cd75a17ab2604397adab03bb8b5fd75c in this term.
I20260709 13:19:08.791929  6724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3f13b31a1f84f0d89d007eadd57924c" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:19:08.747550  8574 raft_consensus.cc:493] T 34f36d59d88f40fe8a2805e604fc6c0a P b7ab4784c7344b939bc36f639286f377 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:08.795787  6724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fa34c08b205435dba97346991aa1f92" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:19:08.757105  9031 consensus_queue.cc:1243] T 3d65025eea89441290d85dd053810e31 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Peer ccd8a4c3bfe3413cb2ae219b09aea832 log is divergent from this leader: its last log entry 3.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260709 13:19:08.798126  6803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d33d5ee8ef6f415593d8df52063161ad" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:19:08.799219  6724 raft_consensus.cc:2468] T 3fa34c08b205435dba97346991aa1f92 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in term 6.
I20260709 13:19:08.799732  6872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3411566abe2d4c9bb4b2adfdd05e6f17" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:19:08.801569  6800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce4f062dcd314d43a63ca74067cb5ee3" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:19:08.757104  8773 raft_consensus.cc:493] T 7887766dc6784fcaa42b35c05fea7a99 P cd75a17ab2604397adab03bb8b5fd75c [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:08.757257  8992 raft_consensus.cc:493] T c4db81d9d329422bb3b4160ca4ac2d1d P b7ab4784c7344b939bc36f639286f377 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:08.852371  6723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90d42e216d9741e190bca19a781291fd" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:19:08.853295  6723 raft_consensus.cc:2468] T 90d42e216d9741e190bca19a781291fd P ccd8a4c3bfe3413cb2ae219b09aea832 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 6.
I20260709 13:19:08.875934  9053 raft_consensus.cc:493] T 1528ab62b6fe4e3099d08f141afee116 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 7ba59cc884714e8aa5f3f0ecaed84cbb)
I20260709 13:19:08.876695  9053 raft_consensus.cc:515] T 1528ab62b6fe4e3099d08f141afee116 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } attrs { replace: true } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:19:08.877996  8990 leader_election.cc:290] T 1bf4668eeb70467fb3dc5a0289233b3c P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 5 election: Requested vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:08.878739  8990 raft_consensus.cc:493] T 4275cf08e63345f993bce8664eada830 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:08.879515  9053 leader_election.cc:290] T 1528ab62b6fe4e3099d08f141afee116 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:19:08.880568  9049 raft_consensus.cc:493] T 20f6842e26174571996b8dea4151d4be P cd75a17ab2604397adab03bb8b5fd75c [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:19:08.881165  9049 raft_consensus.cc:515] T 20f6842e26174571996b8dea4151d4be P cd75a17ab2604397adab03bb8b5fd75c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:08.883406  9049 leader_election.cc:290] T 20f6842e26174571996b8dea4151d4be P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:19:08.839102  6800 raft_consensus.cc:2468] T ce4f062dcd314d43a63ca74067cb5ee3 P b7ab4784c7344b939bc36f639286f377 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 6.
I20260709 13:19:08.797729  8986 raft_consensus.cc:515] T 8c7f33e544204fbaac4078e3e83bbf4e P ccd8a4c3bfe3413cb2ae219b09aea832 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:08.841033  6879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e326172347f45e99a0d482b5d8ef768" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:19:08.841495  9042 leader_election.cc:290] T 7a734b5ab7834e05a8c422208acc58b1 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:19:08.842293  9050 consensus_queue.cc:1059] T 4f00a2e87e56452083b759f60d461ee3 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
W20260709 13:19:08.842765  9039 log.cc:927] Time spent T e77e330a82df4b43a745d57a68f6f057 P cd75a17ab2604397adab03bb8b5fd75c: Append to log took a long time: real 0.151s	user 0.000s	sys 0.000s
I20260709 13:19:08.843538  6725 raft_consensus.cc:1275] T 3fa34c08b205435dba97346991aa1f92 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 6 FOLLOWER]: Refusing update from remote peer cd75a17ab2604397adab03bb8b5fd75c: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:19:08.879240  8990 raft_consensus.cc:515] T 4275cf08e63345f993bce8664eada830 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:08.605870  5625 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:19:08.906267  6878 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53406 (request call id 1364) took 2320 ms. Trace:
I20260709 13:19:08.787004  8797 leader_election.cc:290] T d33d5ee8ef6f415593d8df52063161ad P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 7 election: Requested vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:08.884500  7500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24ee15416e3145beaa1b8183453729a3" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:19:08.833280  6872 raft_consensus.cc:2468] T 3411566abe2d4c9bb4b2adfdd05e6f17 P cd75a17ab2604397adab03bb8b5fd75c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 4.
I20260709 13:19:08.899868  6724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fa34c08b205435dba97346991aa1f92" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: true dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:19:08.908700  6724 raft_consensus.cc:2376] T 3fa34c08b205435dba97346991aa1f92 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 6. Re-sending same reply.
I20260709 13:19:08.901793  6731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4275cf08e63345f993bce8664eada830" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:19:08.770164  9023 consensus_queue.cc:1048] T 3fa34c08b205435dba97346991aa1f92 P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.085s
I20260709 13:19:08.893721  6800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e31b9971c15848dea59d4d4130141d9e" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:19:08.910760  6876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c240553ce044eedb41541d72b9475d7" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:19:08.911433  6724 raft_consensus.cc:1240] T 7c44c4849aa54f2b94d1f1bef9ed546f P ccd8a4c3bfe3413cb2ae219b09aea832 [term 7 FOLLOWER]: Rejecting Update request from peer cd75a17ab2604397adab03bb8b5fd75c for earlier term 6. Current term is 7. Ops: [3.3-6.4]
I20260709 13:19:08.906730  6878 rpcz_store.cc:276] 0709 13:19:06.586094 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:06.586325 (+   231us) service_pool.cc:224] Handling call
0709 13:19:06.615968 (+ 29643us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:06.616215 (+   247us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:19:08.630118 (+2013903us) spinlock_profiling.cc:243] Waited 1.46 ms on lock 0x7b18003a4e60. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc15785de1 00007fcc157925b1 00007fcc0f5524bc 00007fcc0c8a048b 00007fcc156faab9 00007fcc0c8bc69b 00007fcc0c8ba93f 00007fcc0c8ba455 00007fcc133a23c7 00007fcc0f9b49a7 00007fcc0f9c40bf
0709 13:19:08.630358 (+   240us) log.cc:844] Serialized 14 byte log entry
0709 13:19:08.905835 (+275477us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:08.905907 (+    72us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:19:08.905970 (+    63us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:08.906055 (+    85us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:08.906197 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":14529,"prepare.queue_time_us":264738,"prepare.run_cpu_time_us":79,"prepare.run_wall_time_us":2082,"spinlock_wait_cycles":3352832,"thread_start_us":546169,"threads_started":2}
I20260709 13:19:08.913792  6727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe20b4b48823486ca3b9c648db6ce8aa" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:19:08.915526  6728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a92dd554674067a83a9cb68c4773f2" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:19:08.919330  6876 raft_consensus.cc:2468] T 2c240553ce044eedb41541d72b9475d7 P cd75a17ab2604397adab03bb8b5fd75c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 6.
I20260709 13:19:08.920202  6728 raft_consensus.cc:2468] T 07a92dd554674067a83a9cb68c4773f2 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 5.
I20260709 13:19:08.803939  9043 raft_consensus.cc:493] T b56bf91d90824c959e21e0cee5ba1816 P cd75a17ab2604397adab03bb8b5fd75c [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:08.924690  6695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 166594us
I20260709 13:19:08.864632  8971 raft_consensus.cc:493] T fe20b4b48823486ca3b9c648db6ce8aa P ccd8a4c3bfe3413cb2ae219b09aea832 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:08.892581  6627 catalog_manager.cc:5697] T 427c124d773f483294511e80fe340075 P 7ba59cc884714e8aa5f3f0ecaed84cbb reported cstate change: term changed from 3 to 5, leader changed from ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65) to 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68), pending config changed. New cstate: current_term: 5 leader_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: NON_VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: true } health_report { overall_health: HEALTHY } } } pending_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } attrs { replace: true } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } } }
I20260709 13:19:08.939546  6879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5be3a11b23d4ea9b08300a2789821c7" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:19:08.940387  6726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e31b9971c15848dea59d4d4130141d9e" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:19:08.940726  6879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "853ac0a8cbd64ce99457f170216d4d0f" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:19:08.941270  6879 raft_consensus.cc:2468] T 853ac0a8cbd64ce99457f170216d4d0f P cd75a17ab2604397adab03bb8b5fd75c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 2.
I20260709 13:19:08.857290  9008 leader_election.cc:290] T 90d42e216d9741e190bca19a781291fd P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
W20260709 13:19:08.949874  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 279036us
I20260709 13:19:08.887355  8768 leader_election.cc:290] T 7887766dc6784fcaa42b35c05fea7a99 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:08.793136  7495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe20b4b48823486ca3b9c648db6ce8aa" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:19:08.953611  6800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab432e62819d499eaaf3dd55481dd930" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:19:08.954663  6799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77e330a82df4b43a745d57a68f6f057" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:19:08.954902  6802 raft_consensus.cc:1240] T 9e326172347f45e99a0d482b5d8ef768 P b7ab4784c7344b939bc36f639286f377 [term 5 FOLLOWER]: Rejecting Update request from peer cd75a17ab2604397adab03bb8b5fd75c for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 13:19:08.921512  6728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f58dc08b12a2494bb9a1372837970ca2" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:19:08.799031  8940 raft_consensus.cc:515] T 711ef6523deb4cbe8ef2ba61e1c21c98 P b7ab4784c7344b939bc36f639286f377 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:08.833601  8574 raft_consensus.cc:515] T 34f36d59d88f40fe8a2805e604fc6c0a P b7ab4784c7344b939bc36f639286f377 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:08.856899  8773 raft_consensus.cc:515] T 7887766dc6784fcaa42b35c05fea7a99 P cd75a17ab2604397adab03bb8b5fd75c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:08.891425  9031 consensus_queue.cc:1059] T 7ba5dac66ab5497e9e336f2a3c28cda5 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.104s
I20260709 13:19:08.885689  8992 raft_consensus.cc:515] T c4db81d9d329422bb3b4160ca4ac2d1d P b7ab4784c7344b939bc36f639286f377 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:09.277372  6879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de3186201e1a40d0b335eeb8b4e256e0" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:19:08.972932  6805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24ee15416e3145beaa1b8183453729a3" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:19:09.279947  6725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a734b5ab7834e05a8c422208acc58b1" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
W20260709 13:19:09.149780  6845 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:09.288492  6725 raft_consensus.cc:2468] T 7a734b5ab7834e05a8c422208acc58b1 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 5.
W20260709 13:19:09.156761  6772 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 397683us
I20260709 13:19:08.900357  9053 raft_consensus.cc:2804] T ab432e62819d499eaaf3dd55481dd930 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:19:08.993956  6726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de3186201e1a40d0b335eeb8b4e256e0" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:19:09.013049  6803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bf4668eeb70467fb3dc5a0289233b3c" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:19:09.300854  6800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a75bfe094d4bdc963aba3f08dfcd25" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 8 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
W20260709 13:19:08.987536  6695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 59892.2us
I20260709 13:19:08.987074  6729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34f36d59d88f40fe8a2805e604fc6c0a" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
W20260709 13:19:09.223376  6771 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:08.996480  6731 raft_consensus.cc:2468] T 4275cf08e63345f993bce8664eada830 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 5.
I20260709 13:19:09.287146  6879 raft_consensus.cc:2468] T de3186201e1a40d0b335eeb8b4e256e0 P cd75a17ab2604397adab03bb8b5fd75c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 5.
W20260709 13:19:09.292359  6844 leader_election.cc:336] T 3fa34c08b205435dba97346991aa1f92 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Timed out: RequestConsensusVote RPC to 127.5.126.65:44391 timed out after 1.526s (SENT)
I20260709 13:19:09.286504  6799 raft_consensus.cc:3060] T e77e330a82df4b43a745d57a68f6f057 P b7ab4784c7344b939bc36f639286f377 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:08.964452  6807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09c2a98de1a4decabd0ff900dd44caa" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:19:09.294145  6772 leader_election.cc:304] T f3f9c2e2bf644115957398fe4c9459db P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
W20260709 13:19:09.289409  6845 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:09.303094  6879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a734b5ab7834e05a8c422208acc58b1" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:19:08.955569  6804 raft_consensus.cc:1240] T 3411566abe2d4c9bb4b2adfdd05e6f17 P b7ab4784c7344b939bc36f639286f377 [term 4 FOLLOWER]: Rejecting Update request from peer cd75a17ab2604397adab03bb8b5fd75c for earlier term 3. Current term is 4. Ops: []
W20260709 13:19:09.224434  6697 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 484487us
I20260709 13:19:09.304683  6879 raft_consensus.cc:2468] T 7a734b5ab7834e05a8c422208acc58b1 P cd75a17ab2604397adab03bb8b5fd75c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 5.
I20260709 13:19:08.906867  9044 raft_consensus.cc:493] T 30e88460611e47b2ba16a46a30b5f416 P cd75a17ab2604397adab03bb8b5fd75c [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
W20260709 13:19:09.171530  8998 consensus_meta.cc:287] T be1a92657f494cac8dd227d152f50151 P 7ba59cc884714e8aa5f3f0ecaed84cbb: Time spent flushing consensus metadata: real 0.753s	user 0.007s	sys 0.007s
I20260709 13:19:09.300860  6805 raft_consensus.cc:3060] T 24ee15416e3145beaa1b8183453729a3 P b7ab4784c7344b939bc36f639286f377 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:19:09.150252  8978 consensus_meta.cc:287] T 3411566abe2d4c9bb4b2adfdd05e6f17 P ccd8a4c3bfe3413cb2ae219b09aea832: Time spent flushing consensus metadata: real 0.629s	user 0.013s	sys 0.001s
W20260709 13:19:09.306505  6844 leader_election.cc:336] T 7c37d41cd9164c15a6826ca62a851a69 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817): Timed out: RequestConsensusVote RPC to 127.5.126.66:42817 timed out after 1.575s (SENT)
I20260709 13:19:09.304387  6695 leader_election.cc:304] T a3022224cc81473690653a83d4e99470 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:19:09.112824  8797 raft_consensus.cc:3055] T 711ef6523deb4cbe8ef2ba61e1c21c98 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 5 LEADER]: Stepping down as leader of term 5
W20260709 13:19:08.983850  7469 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:09.084064  6847 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:09.327937  6802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f03d0dbf16864ca4bc1bb5e4c0334c0f" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
W20260709 13:19:09.330338  6847 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:09.283964  9060 raft_consensus.cc:493] T be1a92657f494cac8dd227d152f50151 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 7ba59cc884714e8aa5f3f0ecaed84cbb)
W20260709 13:19:09.033568  9032 log.cc:927] Time spent T 711ef6523deb4cbe8ef2ba61e1c21c98 P ccd8a4c3bfe3413cb2ae219b09aea832: Append to log took a long time: real 0.095s	user 0.000s	sys 0.000s
I20260709 13:19:09.303602  6807 raft_consensus.cc:3060] T f09c2a98de1a4decabd0ff900dd44caa P b7ab4784c7344b939bc36f639286f377 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:09.307488  8986 leader_election.cc:290] T 8c7f33e544204fbaac4078e3e83bbf4e P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:09.277443  6801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44bde925b2e541b69890d70715b85176" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:19:09.345953  6801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3f13b31a1f84f0d89d007eadd57924c" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:19:09.347100  6801 raft_consensus.cc:2468] T b3f13b31a1f84f0d89d007eadd57924c P b7ab4784c7344b939bc36f639286f377 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in term 4.
I20260709 13:19:08.939100  8963 leader_election.cc:290] T d8292e16e5654be6bc408560cf256aaa P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 7 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:09.284535  8673 raft_consensus.cc:493] T e77e330a82df4b43a745d57a68f6f057 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:09.276921  8855 raft_consensus.cc:493] T 4b8cacb381b746da8d0049b0a83b41dd P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 6 FOLLOWER]: Starting pre-election (detected failure of leader cd75a17ab2604397adab03bb8b5fd75c)
W20260709 13:19:09.024334  9047 log.cc:927] Time spent T 17587d6730594da4a56fa13a353232a1 P 7ba59cc884714e8aa5f3f0ecaed84cbb: Append to log took a long time: real 0.359s	user 0.001s	sys 0.001s
I20260709 13:19:09.110813  8831 raft_consensus.cc:493] T f4b8bd455d5a47c18a1380839c6e0d61 P b7ab4784c7344b939bc36f639286f377 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:09.322734  6878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8cee0accdb8499c86d4414b72565a38" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:19:09.066998  9050 raft_consensus.cc:3055] T 4f00a2e87e56452083b759f60d461ee3 P b7ab4784c7344b939bc36f639286f377 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:19:09.324576  6844 leader_election.cc:304] T 7c37d41cd9164c15a6826ca62a851a69 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:19:09.119199  8869 raft_consensus.cc:493] T 17587d6730594da4a56fa13a353232a1 P b7ab4784c7344b939bc36f639286f377 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:09.028221  8926 raft_consensus.cc:493] T 9e326172347f45e99a0d482b5d8ef768 P cd75a17ab2604397adab03bb8b5fd75c [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:09.026198  8779 raft_consensus.cc:493] T 3d65025eea89441290d85dd053810e31 P cd75a17ab2604397adab03bb8b5fd75c [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:19:09.019739  8965 raft_consensus.cc:493] T 8c7f33e544204fbaac4078e3e83bbf4e P cd75a17ab2604397adab03bb8b5fd75c [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:19:09.015254  6724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c240553ce044eedb41541d72b9475d7" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:19:09.116918  7497 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50744 (request call id 172) took 1657 ms. Trace:
I20260709 13:19:09.287112  8933 raft_consensus.cc:3060] T e31b9971c15848dea59d4d4130141d9e P ccd8a4c3bfe3413cb2ae219b09aea832 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:19:09.280813  8990 leader_election.cc:290] T 4275cf08e63345f993bce8664eada830 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:09.319872  6879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a734b5ab7834e05a8c422208acc58b1" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:19:09.170297  9033 raft_consensus.cc:697] T 7c44c4849aa54f2b94d1f1bef9ed546f P b7ab4784c7344b939bc36f639286f377 [term 7 LEADER]: Becoming Leader. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
I20260709 13:19:09.288317  6728 raft_consensus.cc:2410] T f58dc08b12a2494bb9a1372837970ca2 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c for term 8 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:19:09.330688  6802 raft_consensus.cc:2468] T f03d0dbf16864ca4bc1bb5e4c0334c0f P b7ab4784c7344b939bc36f639286f377 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 5.
I20260709 13:19:09.306195  9053 raft_consensus.cc:493] T ab432e62819d499eaaf3dd55481dd930 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:09.025015  8876 raft_consensus.cc:493] T d8cee0accdb8499c86d4414b72565a38 P cd75a17ab2604397adab03bb8b5fd75c [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:19:09.025684  8793 consensus_queue.cc:1048] T ce4f062dcd314d43a63ca74067cb5ee3 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 2, Time since last communication: 0.306s
I20260709 13:19:08.994087  8971 raft_consensus.cc:515] T fe20b4b48823486ca3b9c648db6ce8aa P ccd8a4c3bfe3413cb2ae219b09aea832 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
W20260709 13:19:09.450789  6695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 146464us
I20260709 13:19:09.424470  6801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bf4668eeb70467fb3dc5a0289233b3c" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:19:09.348688  6803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d33d5ee8ef6f415593d8df52063161ad" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:19:09.333379  6804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c37d41cd9164c15a6826ca62a851a69" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:19:09.498507  6879 raft_consensus.cc:2468] T 7a734b5ab7834e05a8c422208acc58b1 P cd75a17ab2604397adab03bb8b5fd75c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 5.
I20260709 13:19:09.417027  6729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20f6842e26174571996b8dea4151d4be" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
W20260709 13:19:09.500835  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 195294us
I20260709 13:19:09.604065  6804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f58dc08b12a2494bb9a1372837970ca2" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
W20260709 13:19:09.604718  6844 leader_election.cc:336] T d33d5ee8ef6f415593d8df52063161ad P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817): Timed out: RequestConsensusVote RPC to 127.5.126.66:42817 timed out after 1.617s (SENT)
W20260709 13:19:09.605558  6844 leader_election.cc:336] T 1bf4668eeb70467fb3dc5a0289233b3c P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817): Timed out: RequestConsensusVote RPC to 127.5.126.66:42817 timed out after 1.677s (SENT)
I20260709 13:19:09.605917  6844 leader_election.cc:304] T 1bf4668eeb70467fb3dc5a0289233b3c P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
W20260709 13:19:09.606972  6844 leader_election.cc:336] T f3f9c2e2bf644115957398fe4c9459db P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817): Timed out: RequestConsensusVote RPC to 127.5.126.66:42817 timed out after 1.774s (SENT)
W20260709 13:19:09.440478  6772 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 146415us
I20260709 13:19:09.419863  9024 leader_election.cc:290] T 4d9def8b32fd443aa94ab1420b06837b P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:19:09.500159  6695 leader_election.cc:304] T dbdf895bba214ff68685a24fd17dfb5d P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:19:09.503420  6805 raft_consensus.cc:2468] T 24ee15416e3145beaa1b8183453729a3 P b7ab4784c7344b939bc36f639286f377 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 5.
I20260709 13:19:08.948632  9043 raft_consensus.cc:515] T b56bf91d90824c959e21e0cee5ba1816 P cd75a17ab2604397adab03bb8b5fd75c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:09.537261  6802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f9c2e2bf644115957398fe4c9459db" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:19:09.521567  8869 raft_consensus.cc:515] T 17587d6730594da4a56fa13a353232a1 P b7ab4784c7344b939bc36f639286f377 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:19:09.501780  7497 rpcz_store.cc:276] 0709 13:19:07.532251 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:07.551915 (+ 19664us) service_pool.cc:224] Handling call
0709 13:19:07.554861 (+  2946us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:07.747452 (+192591us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:07.747495 (+    43us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:07.747556 (+    61us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:19:07.747602 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:09.116465 (+1368863us) spinlock_profiling.cc:243] Waited 192 ms on lock 0x7b54005802d4. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f9aae01 00007fcc0f9a983e 00007fcc1496e419 00007fcc0dee5bd4 00007fcc0dee5b62 00007fcc0dee5a91 00007fcc0dee5a0c 00007fcc0dee4cc2 00007fcc0dce548c 00007fcc0dce48c6
0709 13:19:09.116540 (+    75us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:09.116805 (+   265us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":442002816}
I20260709 13:19:09.520999  8779 raft_consensus.cc:515] T 3d65025eea89441290d85dd053810e31 P cd75a17ab2604397adab03bb8b5fd75c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:09.327805  8998 raft_consensus.cc:515] T be1a92657f494cac8dd227d152f50151 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
W20260709 13:19:09.554217  6697 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 226281us
I20260709 13:19:09.538643  8574 leader_election.cc:290] T 34f36d59d88f40fe8a2805e604fc6c0a P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:09.520628  8831 raft_consensus.cc:515] T f4b8bd455d5a47c18a1380839c6e0d61 P b7ab4784c7344b939bc36f639286f377 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:09.572603  6807 raft_consensus.cc:2468] T f09c2a98de1a4decabd0ff900dd44caa P b7ab4784c7344b939bc36f639286f377 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 6.
I20260709 13:19:09.630486  6798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbdf895bba214ff68685a24fd17dfb5d" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:19:09.631274  6807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09c2a98de1a4decabd0ff900dd44caa" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:19:09.632009  6807 raft_consensus.cc:2376] T f09c2a98de1a4decabd0ff900dd44caa P b7ab4784c7344b939bc36f639286f377 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 6. Re-sending same reply.
I20260709 13:19:09.632894  6807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a92dd554674067a83a9cb68c4773f2" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:19:09.418295  8773 leader_election.cc:290] T 7887766dc6784fcaa42b35c05fea7a99 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:19:09.326870  8797 raft_consensus.cc:740] T 711ef6523deb4cbe8ef2ba61e1c21c98 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
I20260709 13:19:09.323606  9037 raft_consensus.cc:476] T 3fa34c08b205435dba97346991aa1f92 P cd75a17ab2604397adab03bb8b5fd75c [term 6 LEADER]: Not starting pre-election -- already a leader
I20260709 13:19:09.510988  8673 raft_consensus.cc:515] T e77e330a82df4b43a745d57a68f6f057 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } }
I20260709 13:19:09.028383  9051 consensus_queue.cc:1048] T 4b8cacb381b746da8d0049b0a83b41dd P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Connected to new peer: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.392s
I20260709 13:19:09.538936  6801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce4f062dcd314d43a63ca74067cb5ee3" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:19:09.642299  6801 raft_consensus.cc:2468] T ce4f062dcd314d43a63ca74067cb5ee3 P b7ab4784c7344b939bc36f639286f377 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 6.
I20260709 13:19:09.542151  8971 leader_election.cc:290] T fe20b4b48823486ca3b9c648db6ce8aa P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:19:09.544278  6727 raft_consensus.cc:2468] T fe20b4b48823486ca3b9c648db6ce8aa P ccd8a4c3bfe3413cb2ae219b09aea832 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 3.
I20260709 13:19:09.321743  9070 consensus_queue.cc:1059] T 4f00a2e87e56452083b759f60d461ee3 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.146s
W20260709 13:19:09.452693  8919 consensus_meta.cc:287] T 7c44c4849aa54f2b94d1f1bef9ed546f P cd75a17ab2604397adab03bb8b5fd75c: Time spent flushing consensus metadata: real 0.911s	user 0.008s	sys 0.006s
I20260709 13:19:09.330595  8978 raft_consensus.cc:515] T 3411566abe2d4c9bb4b2adfdd05e6f17 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
W20260709 13:19:09.439977  6771 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:09.504112  9053 raft_consensus.cc:3060] T ab432e62819d499eaaf3dd55481dd930 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:09.608441  6844 leader_election.cc:304] T f3f9c2e2bf644115957398fe4c9459db P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:19:09.452296  9071 raft_consensus.cc:493] T 7887766dc6784fcaa42b35c05fea7a99 P b7ab4784c7344b939bc36f639286f377 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:09.503479  8845 raft_consensus.cc:2749] T 7c37d41cd9164c15a6826ca62a851a69 P cd75a17ab2604397adab03bb8b5fd75c [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:19:09.499925  9050 raft_consensus.cc:740] T 4f00a2e87e56452083b759f60d461ee3 P b7ab4784c7344b939bc36f639286f377 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
I20260709 13:19:09.613996  6879 raft_consensus.cc:1275] T 07a92dd554674067a83a9cb68c4773f2 P cd75a17ab2604397adab03bb8b5fd75c [term 5 FOLLOWER]: Refusing update from remote peer b7ab4784c7344b939bc36f639286f377: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
W20260709 13:19:09.667940  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 60976.1us
W20260709 13:19:09.669931  6844 leader_election.cc:336] T ce4f062dcd314d43a63ca74067cb5ee3 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817): Timed out: RequestConsensusVote RPC to 127.5.126.66:42817 timed out after 1.815s (SENT)
I20260709 13:19:09.670209  6879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8292e16e5654be6bc408560cf256aaa" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:19:09.670428  6844 leader_election.cc:304] T ce4f062dcd314d43a63ca74067cb5ee3 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:19:09.616364  6805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "853ac0a8cbd64ce99457f170216d4d0f" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
W20260709 13:19:09.616446  6695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 116490us
I20260709 13:19:09.360064  9041 raft_consensus.cc:493] T bb3d8792045a4583ae2e965b1350a5b4 P cd75a17ab2604397adab03bb8b5fd75c [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:19:09.624989  6804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6869f07b5a4885a0b99fbe60c3b175" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 6 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:19:09.410739  9065 raft_consensus.cc:2749] T a3022224cc81473690653a83d4e99470 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:19:09.622289  9048 raft_consensus.cc:2749] T 1bf4668eeb70467fb3dc5a0289233b3c P cd75a17ab2604397adab03bb8b5fd75c [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:19:09.398315  9028 consensus_meta.cc:287] T 427c124d773f483294511e80fe340075 P 7ba59cc884714e8aa5f3f0ecaed84cbb: Time spent flushing consensus metadata: real 0.700s	user 0.012s	sys 0.000s
W20260709 13:19:09.608565  9032 log.cc:927] Time spent T 711ef6523deb4cbe8ef2ba61e1c21c98 P ccd8a4c3bfe3413cb2ae219b09aea832: Append to log took a long time: real 0.102s	user 0.000s	sys 0.001s
I20260709 13:19:09.552682  9031 raft_consensus.cc:2804] T f3f9c2e2bf644115957398fe4c9459db P b7ab4784c7344b939bc36f639286f377 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:19:09.326766  9044 raft_consensus.cc:515] T 30e88460611e47b2ba16a46a30b5f416 P cd75a17ab2604397adab03bb8b5fd75c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:09.410856  8986 consensus_queue.cc:1048] T c4db81d9d329422bb3b4160ca4ac2d1d P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.204s
I20260709 13:19:09.510752  8855 raft_consensus.cc:515] T 4b8cacb381b746da8d0049b0a83b41dd P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:19:09.636152  6799 raft_consensus.cc:2468] T e77e330a82df4b43a745d57a68f6f057 P b7ab4784c7344b939bc36f639286f377 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 7.
I20260709 13:19:09.688863  6799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb7fa124c3bf4ef9ab65a407cb008441" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:19:09.690147  6879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34f36d59d88f40fe8a2805e604fc6c0a" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:19:09.691231  6879 raft_consensus.cc:2468] T 34f36d59d88f40fe8a2805e604fc6c0a P cd75a17ab2604397adab03bb8b5fd75c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 3.
I20260709 13:19:09.638150  6798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "711ef6523deb4cbe8ef2ba61e1c21c98" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:19:09.692147  6798 raft_consensus.cc:3060] T 711ef6523deb4cbe8ef2ba61e1c21c98 P b7ab4784c7344b939bc36f639286f377 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:09.638324  6803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77e330a82df4b43a745d57a68f6f057" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:19:09.521338  8926 raft_consensus.cc:515] T 9e326172347f45e99a0d482b5d8ef768 P cd75a17ab2604397adab03bb8b5fd75c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:09.674073  9037 raft_consensus.cc:2749] T f3f9c2e2bf644115957398fe4c9459db P cd75a17ab2604397adab03bb8b5fd75c [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:19:09.644155  6807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20f6842e26174571996b8dea4151d4be" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:19:09.521703  8876 raft_consensus.cc:515] T d8cee0accdb8499c86d4414b72565a38 P cd75a17ab2604397adab03bb8b5fd75c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:19:09.521129  8965 raft_consensus.cc:515] T 8c7f33e544204fbaac4078e3e83bbf4e P cd75a17ab2604397adab03bb8b5fd75c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:09.647370  9058 consensus_queue.cc:1048] T e31b9971c15848dea59d4d4130141d9e P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.041s
I20260709 13:19:09.624883  8938 raft_consensus.cc:2749] T dbdf895bba214ff68685a24fd17dfb5d P ccd8a4c3bfe3413cb2ae219b09aea832 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:19:09.634063  9067 log.cc:927] Time spent T 427c124d773f483294511e80fe340075 P cd75a17ab2604397adab03bb8b5fd75c: Append to log took a long time: real 0.265s	user 0.001s	sys 0.001s
W20260709 13:19:09.635358  9062 log.cc:927] Time spent T 4d9def8b32fd443aa94ab1420b06837b P cd75a17ab2604397adab03bb8b5fd75c: Append to log took a long time: real 0.297s	user 0.001s	sys 0.000s
I20260709 13:19:09.660969  6801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e31b9971c15848dea59d4d4130141d9e" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:19:09.672083  6695 leader_election.cc:304] T 30e88460611e47b2ba16a46a30b5f416 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:19:09.674926  6844 leader_election.cc:304] T 90d42e216d9741e190bca19a781291fd P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:19:09.348160  9060 raft_consensus.cc:515] T be1a92657f494cac8dd227d152f50151 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:19:09.645265  9051 consensus_queue.cc:1243] T 4b8cacb381b746da8d0049b0a83b41dd P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Peer ccd8a4c3bfe3413cb2ae219b09aea832 log is divergent from this leader: its last log entry 5.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 13:19:09.679641  6805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4db81d9d329422bb3b4160ca4ac2d1d" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:19:09.693334  6803 raft_consensus.cc:2376] T e77e330a82df4b43a745d57a68f6f057 P b7ab4784c7344b939bc36f639286f377 [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 7. Re-sending same reply.
I20260709 13:19:09.690651  6799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34f36d59d88f40fe8a2805e604fc6c0a" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:19:09.537806  9066 raft_consensus.cc:493] T 20f6842e26174571996b8dea4151d4be P b7ab4784c7344b939bc36f639286f377 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:19:09.674324  8773 raft_consensus.cc:2749] T ce4f062dcd314d43a63ca74067cb5ee3 P cd75a17ab2604397adab03bb8b5fd75c [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:19:09.648415  8971 consensus_queue.cc:1059] T 711ef6523deb4cbe8ef2ba61e1c21c98 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 1, Time since last communication: 0.046s
I20260709 13:19:09.711834  7466 leader_election.cc:304] T b3f13b31a1f84f0d89d007eadd57924c P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, b7ab4784c7344b939bc36f639286f377; no voters: 
I20260709 13:19:09.715150  6804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4275cf08e63345f993bce8664eada830" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
W20260709 13:19:09.749359  6772 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:09.683651  9031 raft_consensus.cc:493] T f3f9c2e2bf644115957398fe4c9459db P b7ab4784c7344b939bc36f639286f377 [term 5 FOLLOWER]: Starting leader election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
W20260709 13:19:09.720922  6697 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 88618.3us
I20260709 13:19:09.762182  6806 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:32976 (request call id 2100) took 2866 ms. Trace:
I20260709 13:19:09.762801  6697 leader_election.cc:304] T 853ac0a8cbd64ce99457f170216d4d0f P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:19:09.762761  6806 rpcz_store.cc:276] 0709 13:19:06.895604 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:06.921383 (+ 25779us) service_pool.cc:224] Handling call
0709 13:19:06.921825 (+   442us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:07.064107 (+142282us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:07.064152 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:07.072812 (+  8660us) log.cc:844] Serialized 26 byte log entry
0709 13:19:07.313482 (+240670us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:19:07.313530 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:09.761701 (+2448171us) spinlock_profiling.cc:243] Waited 100 ms on lock 0x7b54001f6154. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f9aae01 00007fcc0f9a983e 00007fcc1496e419 00007fcc0dee5bd4 00007fcc0dee5b62 00007fcc0dee5a91 00007fcc0dee5a0c 00007fcc0dee4cc2 00007fcc0dce548c 00007fcc0dce48c6
0709 13:19:09.761789 (+    88us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:09.761841 (+    52us) raft_consensus.cc:1685] finished
0709 13:19:09.761854 (+    13us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:09.762105 (+   251us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":41613,"raft.queue_time_us":44403,"raft.run_cpu_time_us":157,"raft.run_wall_time_us":8340,"spinlock_wait_cycles":230229376,"thread_start_us":166375,"threads_started":1,"wal-append.queue_time_us":335859,"wal-append.run_cpu_time_us":2071,"wal-append.run_wall_time_us":1232346}
W20260709 13:19:09.721438  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 46633.6us
I20260709 13:19:09.765529  6844 leader_election.cc:304] T 07a92dd554674067a83a9cb68c4773f2 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:19:09.723263  6799 raft_consensus.cc:2410] T 34f36d59d88f40fe8a2805e604fc6c0a P b7ab4784c7344b939bc36f639286f377 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c for term 4 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:19:09.723440  6805 raft_consensus.cc:2368] T c4db81d9d329422bb3b4160ca4ac2d1d P b7ab4784c7344b939bc36f639286f377 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c for earlier term 5. Current term is 6.
I20260709 13:19:09.694080  8992 leader_election.cc:290] T c4db81d9d329422bb3b4160ca4ac2d1d P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:09.728334  6878 raft_consensus.cc:2468] T d8cee0accdb8499c86d4414b72565a38 P cd75a17ab2604397adab03bb8b5fd75c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in term 5.
I20260709 13:19:09.685357  9041 raft_consensus.cc:515] T bb3d8792045a4583ae2e965b1350a5b4 P cd75a17ab2604397adab03bb8b5fd75c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:19:09.737197  6798 raft_consensus.cc:2410] T 711ef6523deb4cbe8ef2ba61e1c21c98 P b7ab4784c7344b939bc36f639286f377 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c for term 6 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
W20260709 13:19:09.738567  9061 log.cc:927] Time spent T 30e88460611e47b2ba16a46a30b5f416 P cd75a17ab2604397adab03bb8b5fd75c: Append to log took a long time: real 0.382s	user 0.000s	sys 0.001s
I20260709 13:19:09.739499  6801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90d42e216d9741e190bca19a781291fd" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:19:09.740216  9077 raft_consensus.cc:493] T 4275cf08e63345f993bce8664eada830 P b7ab4784c7344b939bc36f639286f377 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:09.741314  8869 leader_election.cc:290] T 17587d6730594da4a56fa13a353232a1 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:19:09.659160  9033 consensus_queue.cc:237] T 7c44c4849aa54f2b94d1f1bef9ed546f P b7ab4784c7344b939bc36f639286f377 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:09.776755  9041 leader_election.cc:290] T bb3d8792045a4583ae2e965b1350a5b4 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:19:09.745807  9043 leader_election.cc:290] T b56bf91d90824c959e21e0cee5ba1816 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:19:09.668148  9071 raft_consensus.cc:515] T 7887766dc6784fcaa42b35c05fea7a99 P b7ab4784c7344b939bc36f639286f377 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
W20260709 13:19:09.721037  6695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 49095us
I20260709 13:19:09.779170  6695 leader_election.cc:304] T 22ccee1b570c4ad3a57bd7aec085b1b4 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:19:09.729079  8938 raft_consensus.cc:2749] T 30e88460611e47b2ba16a46a30b5f416 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:19:09.768203  6697 leader_election.cc:304] T 7a734b5ab7834e05a8c422208acc58b1 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:19:09.771979  6844 leader_election.cc:304] T 7a734b5ab7834e05a8c422208acc58b1 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:19:09.695345  8963 raft_consensus.cc:493] T 90d42e216d9741e190bca19a781291fd P b7ab4784c7344b939bc36f639286f377 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:09.768356  6805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a734b5ab7834e05a8c422208acc58b1" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:19:09.780843  6799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c240553ce044eedb41541d72b9475d7" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:19:09.731400  9048 raft_consensus.cc:2804] T 90d42e216d9741e190bca19a781291fd P cd75a17ab2604397adab03bb8b5fd75c [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:19:09.783771  6805 raft_consensus.cc:2468] T 7a734b5ab7834e05a8c422208acc58b1 P b7ab4784c7344b939bc36f639286f377 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 5.
I20260709 13:19:09.784117  6799 raft_consensus.cc:2468] T 2c240553ce044eedb41541d72b9475d7 P b7ab4784c7344b939bc36f639286f377 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 6.
I20260709 13:19:09.784670  9043 raft_consensus.cc:2804] T 7a734b5ab7834e05a8c422208acc58b1 P cd75a17ab2604397adab03bb8b5fd75c [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:19:09.784719  9083 raft_consensus.cc:2804] T b3f13b31a1f84f0d89d007eadd57924c P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:19:09.790599  6844 leader_election.cc:336] T bd6869f07b5a4885a0b99fbe60c3b175 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817): Timed out: RequestConsensusVote RPC to 127.5.126.66:42817 timed out after 1.855s (SENT)
I20260709 13:19:09.747835  9056 raft_consensus.cc:493] T 427c124d773f483294511e80fe340075 P b7ab4784c7344b939bc36f639286f377 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 7ba59cc884714e8aa5f3f0ecaed84cbb)
W20260709 13:19:09.794045  7466 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 82369us
I20260709 13:19:09.795091  6695 leader_election.cc:304] T 3d65025eea89441290d85dd053810e31 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:19:09.807862  6695 leader_election.cc:304] T 3a485a995abc4807b6e511e45419f737 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:19:09.780552  8971 raft_consensus.cc:2804] T 853ac0a8cbd64ce99457f170216d4d0f P ccd8a4c3bfe3413cb2ae219b09aea832 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:19:09.765318  9079 raft_consensus.cc:493] T 713b5728a197487c9300b310ab94e5a3 P b7ab4784c7344b939bc36f639286f377 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:19:09.748883  9058 raft_consensus.cc:493] T 1528ab62b6fe4e3099d08f141afee116 P b7ab4784c7344b939bc36f639286f377 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 7ba59cc884714e8aa5f3f0ecaed84cbb)
I20260709 13:19:09.802488  6844 leader_election.cc:304] T bd6869f07b5a4885a0b99fbe60c3b175 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:19:09.766688  9031 raft_consensus.cc:3060] T f3f9c2e2bf644115957398fe4c9459db P b7ab4784c7344b939bc36f639286f377 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:09.811883  7466 leader_election.cc:304] T 3fa34c08b205435dba97346991aa1f92 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
I20260709 13:19:09.780148  9037 raft_consensus.cc:2804] T 07a92dd554674067a83a9cb68c4773f2 P cd75a17ab2604397adab03bb8b5fd75c [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 13:19:09.782989  9068 log.cc:927] Time spent T ce4f062dcd314d43a63ca74067cb5ee3 P cd75a17ab2604397adab03bb8b5fd75c: Append to log took a long time: real 0.267s	user 0.000s	sys 0.000s
I20260709 13:19:09.799902  9076 consensus_queue.cc:1048] T de3186201e1a40d0b335eeb8b4e256e0 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.154s
W20260709 13:19:09.818652  6844 leader_election.cc:336] T e77e330a82df4b43a745d57a68f6f057 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817): Timed out: RequestConsensusVote RPC to 127.5.126.66:42817 timed out after 1.888s (SENT)
I20260709 13:19:09.801806  8990 raft_consensus.cc:2804] T 22ccee1b570c4ad3a57bd7aec085b1b4 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:19:09.776151  9077 raft_consensus.cc:515] T 4275cf08e63345f993bce8664eada830 P b7ab4784c7344b939bc36f639286f377 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
W20260709 13:19:09.858490  6844 leader_election.cc:336] T 853ac0a8cbd64ce99457f170216d4d0f P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817): Timed out: RequestConsensusVote RPC to 127.5.126.66:42817 timed out after 1.914s (SENT)
I20260709 13:19:09.820597  6806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24ee15416e3145beaa1b8183453729a3" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:19:09.859557  6806 raft_consensus.cc:2376] T 24ee15416e3145beaa1b8183453729a3 P b7ab4784c7344b939bc36f639286f377 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 5. Re-sending same reply.
I20260709 13:19:09.843161  6879 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53406 (request call id 1384) took 1089 ms. Trace:
I20260709 13:19:09.798326  9048 raft_consensus.cc:493] T 90d42e216d9741e190bca19a781291fd P cd75a17ab2604397adab03bb8b5fd75c [term 5 FOLLOWER]: Starting leader election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:19:09.797722  9043 raft_consensus.cc:493] T 7a734b5ab7834e05a8c422208acc58b1 P cd75a17ab2604397adab03bb8b5fd75c [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:09.713521  9050 consensus_queue.cc:260] T 4f00a2e87e56452083b759f60d461ee3 P b7ab4784c7344b939bc36f639286f377 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:19:09.848307  9090 raft_consensus.cc:2804] T 3fa34c08b205435dba97346991aa1f92 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:19:09.820506  7497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3d8792045a4583ae2e965b1350a5b4" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:19:09.816524  9080 raft_consensus.cc:2749] T 3d65025eea89441290d85dd053810e31 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:19:09.802151  9083 raft_consensus.cc:493] T b3f13b31a1f84f0d89d007eadd57924c P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 4 FOLLOWER]: Starting leader election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:19:09.805081  8793 raft_consensus.cc:2804] T 7a734b5ab7834e05a8c422208acc58b1 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:19:09.780577  8845 consensus_queue.cc:1048] T 3fa34c08b205435dba97346991aa1f92 P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Connected to new peer: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.041s
I20260709 13:19:09.859262  6844 leader_election.cc:304] T 853ac0a8cbd64ce99457f170216d4d0f P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
W20260709 13:19:09.863787  6845 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:09.862871  6879 rpcz_store.cc:276] 0709 13:19:08.753729 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:09.696993 (+943264us) service_pool.cc:224] Handling call
0709 13:19:09.732813 (+ 35820us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:09.733125 (+   312us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:19:09.765674 (+ 32549us) log.cc:844] Serialized 14 byte log entry
0709 13:19:09.841959 (+ 76285us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:09.842794 (+   835us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:19:09.842854 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:09.842934 (+    80us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:09.843089 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":40629,"prepare.run_cpu_time_us":60,"prepare.run_wall_time_us":63,"raft.queue_time_us":7321,"raft.run_cpu_time_us":110,"raft.run_wall_time_us":111,"thread_start_us":75869,"threads_started":1,"wal-append.queue_time_us":86532}
I20260709 13:19:09.812992  8779 leader_election.cc:290] T 3d65025eea89441290d85dd053810e31 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:19:09.816058  8971 raft_consensus.cc:493] T 853ac0a8cbd64ce99457f170216d4d0f P ccd8a4c3bfe3413cb2ae219b09aea832 [term 2 FOLLOWER]: Starting leader election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:19:09.870559  6877 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58592 (request call id 136) took 2506 ms. Trace:
I20260709 13:19:09.820340  8938 raft_consensus.cc:2804] T 3a485a995abc4807b6e511e45419f737 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:19:09.872762  9073 log.cc:927] Time spent T 3a485a995abc4807b6e511e45419f737 P cd75a17ab2604397adab03bb8b5fd75c: Append to log took a long time: real 0.231s	user 0.000s	sys 0.001s
I20260709 13:19:09.820839  9041 raft_consensus.cc:2749] T bd6869f07b5a4885a0b99fbe60c3b175 P cd75a17ab2604397adab03bb8b5fd75c [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:19:09.842757  9037 raft_consensus.cc:493] T 07a92dd554674067a83a9cb68c4773f2 P cd75a17ab2604397adab03bb8b5fd75c [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:09.801344  8963 raft_consensus.cc:515] T 90d42e216d9741e190bca19a781291fd P b7ab4784c7344b939bc36f639286f377 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:09.841128  9058 raft_consensus.cc:515] T 1528ab62b6fe4e3099d08f141afee116 P b7ab4784c7344b939bc36f639286f377 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } attrs { replace: true } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:19:09.838040  9079 raft_consensus.cc:515] T 713b5728a197487c9300b310ab94e5a3 P b7ab4784c7344b939bc36f639286f377 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:09.783618  9065 consensus_queue.cc:1048] T c4db81d9d329422bb3b4160ca4ac2d1d P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.091s
I20260709 13:19:09.772810  9066 raft_consensus.cc:515] T 20f6842e26174571996b8dea4151d4be P b7ab4784c7344b939bc36f639286f377 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
W20260709 13:19:09.875957  6697 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.68:45071, user_credentials={real_user=slave}} blocked reactor thread for 77294.4us
W20260709 13:19:09.891659  6771 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:10.583127  6772 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.722s	user 0.004s	sys 0.011s
W20260709 13:19:10.583819  6772 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.723s	user 0.005s	sys 0.011s
I20260709 13:19:09.879562  6806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7887766dc6784fcaa42b35c05fea7a99" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:19:09.878935  6804 raft_consensus.cc:2468] T 4275cf08e63345f993bce8664eada830 P b7ab4784c7344b939bc36f639286f377 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 5.
I20260709 13:19:10.586472  6806 raft_consensus.cc:2393] T 7887766dc6784fcaa42b35c05fea7a99 P b7ab4784c7344b939bc36f639286f377 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c in current term 5: Already voted for candidate b7ab4784c7344b939bc36f639286f377 in this term.
I20260709 13:19:10.586274  6697 leader_election.cc:304] T 404190ce4ce94cecbfcb6ea9d1dd8626 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
I20260709 13:19:10.589430  6806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be1a92657f494cac8dd227d152f50151" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:19:10.590400  6806 raft_consensus.cc:3060] T be1a92657f494cac8dd227d152f50151 P b7ab4784c7344b939bc36f639286f377 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:19:10.598666  6770 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.738s	user 0.000s	sys 0.008s
W20260709 13:19:10.599275  6770 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.738s	user 0.000s	sys 0.008s
I20260709 13:19:09.886274  6881 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53416 (request call id 2182) took 2809 ms. Trace:
W20260709 13:19:10.611428  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 752743us
I20260709 13:19:10.609541  6881 rpcz_store.cc:276] 0709 13:19:07.076576 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:08.602440 (+1525864us) service_pool.cc:224] Handling call
0709 13:19:08.602912 (+   472us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:08.603397 (+   485us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:19:08.697358 (+ 93961us) log.cc:844] Serialized 14 byte log entry
0709 13:19:09.279399 (+582041us) log.cc:844] Serialized 14 byte log entry
0709 13:19:09.292001 (+ 12602us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:09.292652 (+   651us) log.cc:844] Serialized 26 byte log entry
0709 13:19:09.292871 (+   219us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:19:09.292924 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:09.293212 (+   288us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:09.886052 (+592840us) raft_consensus.cc:1685] finished
0709 13:19:09.886073 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:09.886205 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2137,"prepare.queue_time_us":30402,"prepare.run_cpu_time_us":82,"prepare.run_wall_time_us":3845,"raft.queue_time_us":38555,"raft.run_cpu_time_us":623,"raft.run_wall_time_us":47196,"thread_start_us":459508,"threads_started":1,"wal-append.queue_time_us":535663}
W20260709 13:19:10.015460  7469 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:10.621644  6875 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53416 (request call id 2174) took 3867 ms. Trace:
W20260709 13:19:10.622690  6844 leader_election.cc:336] T f09c2a98de1a4decabd0ff900dd44caa P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817): Timed out: RequestConsensusVote RPC to 127.5.126.66:42817 timed out after 1.967s (SENT)
I20260709 13:19:10.622975  6881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d33d5ee8ef6f415593d8df52063161ad" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:19:10.623795  6844 leader_election.cc:304] T f09c2a98de1a4decabd0ff900dd44caa P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
W20260709 13:19:10.614323  7496 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.521s	user 0.000s	sys 0.030s
I20260709 13:19:10.615494  6873 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53406 (request call id 1362) took 4034 ms. Trace:
I20260709 13:19:10.617905  6874 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53416 (request call id 2168) took 3886 ms. Trace:
I20260709 13:19:10.618631  6879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90d42e216d9741e190bca19a781291fd" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:19:10.130931  6878 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58592 (request call id 137) took 1102 ms. Trace:
I20260709 13:19:10.628002  8986 raft_consensus.cc:2804] T 404190ce4ce94cecbfcb6ea9d1dd8626 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:19:10.628538  8971 raft_consensus.cc:3060] T 853ac0a8cbd64ce99457f170216d4d0f P ccd8a4c3bfe3413cb2ae219b09aea832 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:19:09.875437  9043 raft_consensus.cc:3060] T 7a734b5ab7834e05a8c422208acc58b1 P cd75a17ab2604397adab03bb8b5fd75c [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:10.628880  6729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d9def8b32fd443aa94ab1420b06837b" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
W20260709 13:19:10.343124  9055 log.cc:927] Time spent T d33d5ee8ef6f415593d8df52063161ad P cd75a17ab2604397adab03bb8b5fd75c: Append to log took a long time: real 1.321s	user 0.010s	sys 0.003s
I20260709 13:19:10.630136  6873 rpcz_store.cc:276] 0709 13:19:06.581241 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:06.581475 (+   234us) service_pool.cc:224] Handling call
0709 13:19:06.581983 (+   508us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:06.582490 (+   507us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:06.582531 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:06.623801 (+ 41270us) log.cc:844] Serialized 26 byte log entry
0709 13:19:07.312375 (+688574us) spinlock_profiling.cc:243] Waited 27.3 ms on lock 0x7b18002c4820. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc15785de1 00007fcc157925b1 00007fcc0c89fe07 00007fcc156faab9 00007fcc0c8bc69b 00007fcc0c8ba93f 00007fcc0c8bcc02 00007fcc0f54420b 00007fcc0f549d23 00007fcc0f54a0d1 00007fcc0f965a0f
0709 13:19:07.690935 (+378560us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:19:07.690975 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:07.691052 (+    77us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:10.192908 (+2501856us) spinlock_profiling.cc:243] Waited 147 ms on lock 0x7b24002c3078. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0c745db1 00007fcc0c7439c4 00007fcc0c741acb 00007fcc0c8fcdc9 00007fcc0c8fca55 00007fcc0c8fbfb0 00007fcc0f572488 00007fcc0f572be8 00007fcc0f54a398 00007fcc0f54576a 00007fcc0f544bb6
0709 13:19:10.614567 (+421659us) raft_consensus.cc:1685] finished
0709 13:19:10.614645 (+    78us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:10.615076 (+   431us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":19367,"raft.run_cpu_time_us":206,"raft.run_wall_time_us":17320,"spinlock_wait_cycles":401802240,"thread_start_us":378331,"threads_started":1,"wal-append.queue_time_us":1473257}
W20260709 13:19:09.928596  9074 log.cc:927] Time spent T b56bf91d90824c959e21e0cee5ba1816 P ccd8a4c3bfe3413cb2ae219b09aea832: Append to log took a long time: real 0.099s	user 0.000s	sys 0.000s
I20260709 13:19:10.647192  6873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4275cf08e63345f993bce8664eada830" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:19:10.648500  9037 raft_consensus.cc:3060] T 07a92dd554674067a83a9cb68c4773f2 P cd75a17ab2604397adab03bb8b5fd75c [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:10.648933  6873 raft_consensus.cc:2410] T 4275cf08e63345f993bce8664eada830 P cd75a17ab2604397adab03bb8b5fd75c [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7ab4784c7344b939bc36f639286f377 for term 6 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:19:10.649693  8767 raft_consensus.cc:493] T 7c37d41cd9164c15a6826ca62a851a69 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:19:10.650592  8767 raft_consensus.cc:515] T 7c37d41cd9164c15a6826ca62a851a69 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:10.651609  8793 raft_consensus.cc:493] T 7a734b5ab7834e05a8c422208acc58b1 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:10.652225  8793 raft_consensus.cc:3060] T 7a734b5ab7834e05a8c422208acc58b1 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:09.927809  9090 raft_consensus.cc:493] T 3fa34c08b205435dba97346991aa1f92 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:10.653082  9090 raft_consensus.cc:3060] T 3fa34c08b205435dba97346991aa1f92 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:10.654006  8767 leader_election.cc:290] T 7c37d41cd9164c15a6826ca62a851a69 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:10.654692  8767 raft_consensus.cc:493] T f58dc08b12a2494bb9a1372837970ca2 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:10.118381  8876 leader_election.cc:290] T d8cee0accdb8499c86d4414b72565a38 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:19:10.655369  8767 raft_consensus.cc:515] T f58dc08b12a2494bb9a1372837970ca2 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:10.655988  8876 raft_consensus.cc:2749] T f09c2a98de1a4decabd0ff900dd44caa P cd75a17ab2604397adab03bb8b5fd75c [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:19:09.883281  9085 raft_consensus.cc:493] T 4d9def8b32fd443aa94ab1420b06837b P b7ab4784c7344b939bc36f639286f377 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:19:10.657666  9085 raft_consensus.cc:515] T 4d9def8b32fd443aa94ab1420b06837b P b7ab4784c7344b939bc36f639286f377 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:10.660279  7494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1528ab62b6fe4e3099d08f141afee116" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:19:10.662228  6726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7887766dc6784fcaa42b35c05fea7a99" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:19:10.662771  6728 raft_consensus.cc:1275] T e77e330a82df4b43a745d57a68f6f057 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 7 FOLLOWER]: Refusing update from remote peer cd75a17ab2604397adab03bb8b5fd75c: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:19:10.663347  6726 raft_consensus.cc:2393] T 7887766dc6784fcaa42b35c05fea7a99 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c in current term 5: Already voted for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in this term.
W20260709 13:19:10.345888  9054 log.cc:927] Time spent T f4b8bd455d5a47c18a1380839c6e0d61 P ccd8a4c3bfe3413cb2ae219b09aea832: Append to log took a long time: real 1.317s	user 0.008s	sys 0.008s
I20260709 13:19:10.664937  6728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3d8792045a4583ae2e965b1350a5b4" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:19:10.665068  6726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be1a92657f494cac8dd227d152f50151" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:19:10.665604  6725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d65025eea89441290d85dd053810e31" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:19:10.663197  7494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe20b4b48823486ca3b9c648db6ce8aa" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:19:09.887392  9083 raft_consensus.cc:3060] T b3f13b31a1f84f0d89d007eadd57924c P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:19:10.666922  6725 raft_consensus.cc:2393] T 3d65025eea89441290d85dd053810e31 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c in current term 5: Already voted for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in this term.
I20260709 13:19:10.666935  6726 raft_consensus.cc:3060] T be1a92657f494cac8dd227d152f50151 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 5 FOLLOWER]: Advancing to term 7
I20260709 13:19:10.667053  6728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce4f062dcd314d43a63ca74067cb5ee3" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:19:10.670259  6728 pending_rounds.cc:85] T 4b8cacb381b746da8d0049b0a83b41dd P ccd8a4c3bfe3413cb2ae219b09aea832: Aborting all ops after (but not including) 5
I20260709 13:19:09.930437  8978 leader_election.cc:290] T 3411566abe2d4c9bb4b2adfdd05e6f17 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 5 election: Requested vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:10.670943  6728 pending_rounds.cc:107] T 4b8cacb381b746da8d0049b0a83b41dd P ccd8a4c3bfe3413cb2ae219b09aea832: Aborting uncommitted NO_OP operation due to leader change: 5.6
I20260709 13:19:09.868992  9048 raft_consensus.cc:3060] T 90d42e216d9741e190bca19a781291fd P cd75a17ab2604397adab03bb8b5fd75c [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:10.673063  6876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4db81d9d329422bb3b4160ca4ac2d1d" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 7 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:19:10.671703  6728 raft_consensus.cc:2889] T 4b8cacb381b746da8d0049b0a83b41dd P ccd8a4c3bfe3413cb2ae219b09aea832 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:19:10.674216  6876 raft_consensus.cc:2410] T c4db81d9d329422bb3b4160ca4ac2d1d P cd75a17ab2604397adab03bb8b5fd75c [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7ab4784c7344b939bc36f639286f377 for term 7 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:19:10.675510  6876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4b8bd455d5a47c18a1380839c6e0d61" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:19:10.650774  6873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7887766dc6784fcaa42b35c05fea7a99" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:19:10.629020  9023 raft_consensus.cc:2749] T 853ac0a8cbd64ce99457f170216d4d0f P cd75a17ab2604397adab03bb8b5fd75c [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:19:10.676698  6873 raft_consensus.cc:2468] T 7887766dc6784fcaa42b35c05fea7a99 P cd75a17ab2604397adab03bb8b5fd75c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 4.
I20260709 13:19:10.677146  6729 raft_consensus.cc:1275] T 17587d6730594da4a56fa13a353232a1 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 8 FOLLOWER]: Refusing update from remote peer 7ba59cc884714e8aa5f3f0ecaed84cbb: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 13:19:10.348754  8987 raft_consensus.cc:3060] T f09c2a98de1a4decabd0ff900dd44caa P ccd8a4c3bfe3413cb2ae219b09aea832 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:09.859084  8990 raft_consensus.cc:493] T 22ccee1b570c4ad3a57bd7aec085b1b4 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 4 FOLLOWER]: Starting leader election (detected failure of leader cd75a17ab2604397adab03bb8b5fd75c)
I20260709 13:19:10.195806  7499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce4f062dcd314d43a63ca74067cb5ee3" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:19:10.678432  6801 raft_consensus.cc:2393] T 90d42e216d9741e190bca19a781291fd P b7ab4784c7344b939bc36f639286f377 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c in current term 6: Already voted for candidate b7ab4784c7344b939bc36f639286f377 in this term.
I20260709 13:19:10.635946  6732 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49998 (request call id 652) took 4305 ms. Trace:
I20260709 13:19:10.678813  6873 raft_consensus.cc:1275] T 34f36d59d88f40fe8a2805e604fc6c0a P cd75a17ab2604397adab03bb8b5fd75c [term 3 FOLLOWER]: Refusing update from remote peer ccd8a4c3bfe3413cb2ae219b09aea832: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:19:10.620632  6877 rpcz_store.cc:276] 0709 13:19:07.363702 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:08.605654 (+1241952us) service_pool.cc:224] Handling call
0709 13:19:08.606052 (+   398us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:08.698127 (+ 92075us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:08.698172 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:08.735656 (+ 37484us) log.cc:844] Serialized 26 byte log entry
0709 13:19:09.223968 (+488312us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:19:09.224059 (+    91us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:09.224183 (+   124us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:09.870288 (+646105us) raft_consensus.cc:1685] finished
0709 13:19:09.870318 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:09.870483 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":91232,"raft.queue_time_us":91378,"raft.run_cpu_time_us":126,"raft.run_wall_time_us":129,"thread_start_us":439525,"threads_started":1,"wal-append.queue_time_us":541305}
I20260709 13:19:10.622272  6875 rpcz_store.cc:276] 0709 13:19:06.754382 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:08.417793 (+1663411us) service_pool.cc:224] Handling call
0709 13:19:08.478251 (+ 60458us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:08.662844 (+184593us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:19:08.677728 (+ 14884us) log.cc:844] Serialized 14 byte log entry
0709 13:19:09.068089 (+390361us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:09.068164 (+    75us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:19:09.068225 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:10.620997 (+1552772us) spinlock_profiling.cc:243] Waited 184 ms on lock 0x7b54000a5fd4. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f9aae01 00007fcc0f9a983e 00007fcc1496e419 00007fcc0dee5bd4 00007fcc0dee5b62 00007fcc0dee5a91 00007fcc0dee5a0c 00007fcc0dee4cc2 00007fcc0dce548c 00007fcc0dce48c6
0709 13:19:10.621089 (+    92us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:10.621402 (+   313us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":149658,"prepare.queue_time_us":15144,"prepare.run_cpu_time_us":84,"prepare.run_wall_time_us":6003,"raft.queue_time_us":179557,"raft.run_cpu_time_us":113,"raft.run_wall_time_us":113,"spinlock_wait_cycles":423769472,"thread_start_us":240042,"threads_started":1,"wal-append.queue_time_us":482427}
I20260709 13:19:10.909912  6729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b8cacb381b746da8d0049b0a83b41dd" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:19:10.667959  6725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b56bf91d90824c959e21e0cee5ba1816" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
W20260709 13:19:10.754983  6772 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:10.864876  6876 raft_consensus.cc:2410] T f4b8bd455d5a47c18a1380839c6e0d61 P cd75a17ab2604397adab03bb8b5fd75c [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7ab4784c7344b939bc36f639286f377 for term 6 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:19:10.828155  6726 raft_consensus.cc:2468] T be1a92657f494cac8dd227d152f50151 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in term 7.
W20260709 13:19:10.805213  6695 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.988s	user 0.017s	sys 0.011s
I20260709 13:19:10.630218  6874 rpcz_store.cc:276] 0709 13:19:06.731348 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:07.340263 (+608915us) service_pool.cc:224] Handling call
0709 13:19:07.354813 (+ 14550us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:08.609273 (+1254460us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:10.617016 (+2007743us) spinlock_profiling.cc:243] Waited 1.21 s on lock 0x7b54000d2354. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f9aae01 00007fcc0f9a983e 00007fcc1496e419 00007fcc0dee5bd4 00007fcc0dee5b62 00007fcc0dee5a91 00007fcc0dee5a0c 00007fcc0dee4cc2 00007fcc0dce548c 00007fcc0dce48c6
0709 13:19:10.617616 (+   600us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2778244480}
I20260709 13:19:10.958565  8446 raft_consensus.cc:493] T 22ccee1b570c4ad3a57bd7aec085b1b4 P b7ab4784c7344b939bc36f639286f377 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader cd75a17ab2604397adab03bb8b5fd75c)
W20260709 13:19:10.958897  6727 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49998 (request call id 670) took 2045 ms (client timeout 1961 ms). Trace:
I20260709 13:19:10.117825  9077 leader_election.cc:290] T 4275cf08e63345f993bce8664eada830 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:10.950487  6873 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53416 (request call id 2185) took 2188 ms. Trace:
I20260709 13:19:10.961138  6873 rpcz_store.cc:276] 0709 13:19:08.754849 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:10.677706 (+1922857us) service_pool.cc:224] Handling call
0709 13:19:10.678184 (+   478us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:10.942911 (+264727us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:10.943138 (+   227us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:10.959651  8446 raft_consensus.cc:515] T 22ccee1b570c4ad3a57bd7aec085b1b4 P b7ab4784c7344b939bc36f639286f377 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:10.964398  7494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1528ab62b6fe4e3099d08f141afee116" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
W20260709 13:19:10.964771  8832 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.604s	user 0.000s	sys 0.007s
I20260709 13:19:10.965229  6875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bf4668eeb70467fb3dc5a0289233b3c" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:19:10.966115  6875 raft_consensus.cc:3060] T 1bf4668eeb70467fb3dc5a0289233b3c P cd75a17ab2604397adab03bb8b5fd75c [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:19:10.966176  7494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be1a92657f494cac8dd227d152f50151" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:19:10.966758  8446 leader_election.cc:290] T 22ccee1b570c4ad3a57bd7aec085b1b4 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:10.967337  7494 raft_consensus.cc:2368] T be1a92657f494cac8dd227d152f50151 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 6. Current term is 7.
W20260709 13:19:10.116876  9084 log.cc:927] Time spent T 427c124d773f483294511e80fe340075 P 7ba59cc884714e8aa5f3f0ecaed84cbb: Append to log took a long time: real 0.188s	user 0.000s	sys 0.000s
I20260709 13:19:10.996126  6627 catalog_manager.cc:5697] T 7ba5dac66ab5497e9e336f2a3c28cda5 P 7ba59cc884714e8aa5f3f0ecaed84cbb reported cstate change: term changed from 4 to 5, leader changed from 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68) to b7ab4784c7344b939bc36f639286f377 (127.5.126.66). New cstate: current_term: 5 leader_uuid: "b7ab4784c7344b939bc36f639286f377" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } } }
I20260709 13:19:10.997035  6801 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:32966 (request call id 689) took 1581 ms. Trace:
I20260709 13:19:10.997753  6801 rpcz_store.cc:276] 0709 13:19:09.415718 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:09.739114 (+323396us) service_pool.cc:224] Handling call
0709 13:19:10.996703 (+1257589us) spinlock_profiling.cc:243] Waited 902 ms on lock 0x7b54001cacd4. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f9ae2fa 00007fcc1496fb17 00007fcc0deea6d4 00007fcc0deea662 00007fcc0deea591 00007fcc0deea50c 00007fcc0dee97c2 00007fcc0dce548c 00007fcc0dce48c6 00007fcc0dce426f
0709 13:19:10.996940 (+   237us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2074002304}
I20260709 13:19:10.998726  6627 catalog_manager.cc:5697] T b3f13b31a1f84f0d89d007eadd57924c P 7ba59cc884714e8aa5f3f0ecaed84cbb reported cstate change: term changed from 2 to 4, leader changed from 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68) to ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65). New cstate: current_term: 4 leader_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } } }
I20260709 13:19:10.941250  6732 rpcz_store.cc:276] 0709 13:19:06.306808 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:06.636527 (+329719us) service_pool.cc:224] Handling call
0709 13:19:06.636894 (+   367us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:08.595947 (+1959053us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:10.611238 (+2015291us) spinlock_profiling.cc:243] Waited 1.96 s on lock 0x7b5400057b54. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f9aae01 00007fcc0f9a983e 00007fcc1496e419 00007fcc0dee5bd4 00007fcc0dee5b62 00007fcc0dee5a91 00007fcc0dee5a0c 00007fcc0dee4cc2 00007fcc0dce548c 00007fcc0dce48c6
0709 13:19:10.611748 (+   510us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4498656640}
I20260709 13:19:10.745409  6799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b56bf91d90824c959e21e0cee5ba1816" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
W20260709 13:19:10.643814  7496 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.605s	user 0.000s	sys 0.031s
I20260709 13:19:10.644240  8986 raft_consensus.cc:493] T 404190ce4ce94cecbfcb6ea9d1dd8626 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:10.964428  6877 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53406 (request call id 1386) took 2197 ms. Trace:
W20260709 13:19:10.751322  9031 consensus_meta.cc:287] T f3f9c2e2bf644115957398fe4c9459db P b7ab4784c7344b939bc36f639286f377: Time spent flushing consensus metadata: real 0.890s	user 0.014s	sys 0.000s
I20260709 13:19:10.977072  6804 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:32966 (request call id 688) took 1566 ms. Trace:
I20260709 13:19:10.754385  9051 raft_consensus.cc:493] T 7c44c4849aa54f2b94d1f1bef9ed546f P cd75a17ab2604397adab03bb8b5fd75c [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:10.978246  9066 leader_election.cc:290] T 20f6842e26174571996b8dea4151d4be P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:10.980142  8941 raft_consensus.cc:493] T b56bf91d90824c959e21e0cee5ba1816 P b7ab4784c7344b939bc36f639286f377 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:11.017886  8845 raft_consensus.cc:493] T 3411566abe2d4c9bb4b2adfdd05e6f17 P cd75a17ab2604397adab03bb8b5fd75c [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:10.037361  9060 leader_election.cc:290] T be1a92657f494cac8dd227d152f50151 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:19:11.018517  8941 raft_consensus.cc:515] T b56bf91d90824c959e21e0cee5ba1816 P b7ab4784c7344b939bc36f639286f377 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:11.018776  8845 raft_consensus.cc:515] T 3411566abe2d4c9bb4b2adfdd05e6f17 P cd75a17ab2604397adab03bb8b5fd75c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:09.850307  9056 raft_consensus.cc:515] T 427c124d773f483294511e80fe340075 P b7ab4784c7344b939bc36f639286f377 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } attrs { replace: true } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:19:11.020131  9085 leader_election.cc:290] T 4d9def8b32fd443aa94ab1420b06837b P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:11.021452  8845 leader_election.cc:290] T 3411566abe2d4c9bb4b2adfdd05e6f17 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
W20260709 13:19:11.022416  6731 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49998 (request call id 667) took 2121 ms (client timeout 2205 ms). Trace:
I20260709 13:19:11.022696  9056 leader_election.cc:290] T 427c124d773f483294511e80fe340075 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:19:11.023555  7499 raft_consensus.cc:2410] T ce4f062dcd314d43a63ca74067cb5ee3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7ab4784c7344b939bc36f639286f377 for term 7 because replica has last-logged OpId of term: 6 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 5.
I20260709 13:19:10.989574  6798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d9def8b32fd443aa94ab1420b06837b" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:19:11.018573  6873 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53406 (request call id 1388) took 2255 ms. Trace:
W20260709 13:19:11.024261  7499 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50744 (request call id 173) took 2275 ms (client timeout 2116 ms). Trace:
I20260709 13:19:10.992381  6807 raft_consensus.cc:2468] T 20f6842e26174571996b8dea4151d4be P b7ab4784c7344b939bc36f639286f377 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 5.
W20260709 13:19:10.959393  6727 rpcz_store.cc:269] 0709 13:19:08.913334 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:08.913478 (+   144us) service_pool.cc:224] Handling call
0709 13:19:10.943911 (+2030433us) spinlock_profiling.cc:243] Waited 624 ms on lock 0x7b5400058054. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f9ae2fa 00007fcc1496fb17 00007fcc0deea6d4 00007fcc0deea662 00007fcc0deea591 00007fcc0deea50c 00007fcc0dee97c2 00007fcc0dce548c 00007fcc0dce48c6 00007fcc0dce426f
0709 13:19:10.958665 (+ 14754us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1436094848}
W20260709 13:19:11.024747  7499 rpcz_store.cc:269] 0709 13:19:08.773524 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:08.793084 (+ 19560us) service_pool.cc:224] Handling call
0709 13:19:10.195551 (+1402467us) spinlock_profiling.cc:243] Waited 3.63 ms on lock 0x7b5800123f98. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0c745db1 00007fcc0c885b71 00007fcc0c885a22 00007fcc1579ec09 00007fcc148f8ee0 00007fcc149c20ab 00007fcc149c2131 00007fcc149700a0 00007fcc1496f984 00007fcc0deea6d4 00007fcc0deea662
0709 13:19:11.024127 (+828576us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":8353024}
I20260709 13:19:11.024420  6798 raft_consensus.cc:2468] T 4d9def8b32fd443aa94ab1420b06837b P b7ab4784c7344b939bc36f639286f377 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 5.
I20260709 13:19:11.026180  6798 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:32966 (request call id 700) took 1238 ms. Trace:
I20260709 13:19:11.026515  6798 rpcz_store.cc:276] 0709 13:19:09.787732 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:10.989008 (+1201276us) service_pool.cc:224] Handling call
0709 13:19:11.026095 (+ 37087us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:11.026857  9048 raft_consensus.cc:515] T 90d42e216d9741e190bca19a781291fd P cd75a17ab2604397adab03bb8b5fd75c [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:11.027581  7499 raft_consensus.cc:1275] T 404190ce4ce94cecbfcb6ea9d1dd8626 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 6 FOLLOWER]: Refusing update from remote peer b7ab4784c7344b939bc36f639286f377: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:19:11.027657  6798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de3186201e1a40d0b335eeb8b4e256e0" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:19:11.028143  6879 raft_consensus.cc:2468] T 90d42e216d9741e190bca19a781291fd P cd75a17ab2604397adab03bb8b5fd75c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 6.
I20260709 13:19:10.269119  8797 consensus_queue.cc:260] T 711ef6523deb4cbe8ef2ba61e1c21c98 P ccd8a4c3bfe3413cb2ae219b09aea832 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:11.029423  6798 raft_consensus.cc:2410] T de3186201e1a40d0b335eeb8b4e256e0 P b7ab4784c7344b939bc36f639286f377 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c for term 6 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:19:11.029939  6798 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:32966 (request call id 696) took 1611 ms. Trace:
I20260709 13:19:11.030373  6798 rpcz_store.cc:276] 0709 13:19:09.418629 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:11.027260 (+1608631us) service_pool.cc:224] Handling call
0709 13:19:11.029844 (+  2584us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:11.031252  9048 leader_election.cc:290] T 90d42e216d9741e190bca19a781291fd P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 6 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:19:11.032783  6872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1528ab62b6fe4e3099d08f141afee116" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:19:11.033746  6872 raft_consensus.cc:2468] T 1528ab62b6fe4e3099d08f141afee116 P cd75a17ab2604397adab03bb8b5fd75c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 5.
I20260709 13:19:10.660480  8767 leader_election.cc:290] T f58dc08b12a2494bb9a1372837970ca2 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:11.034615  6805 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50550 (request call id 183) took 1979 ms. Trace:
W20260709 13:19:10.014279  9038 consensus_meta.cc:287] T bb7fa124c3bf4ef9ab65a407cb008441 P cd75a17ab2604397adab03bb8b5fd75c: Time spent flushing consensus metadata: real 1.273s	user 0.011s	sys 0.003s
W20260709 13:19:10.379953  9053 consensus_meta.cc:287] T ab432e62819d499eaaf3dd55481dd930 P ccd8a4c3bfe3413cb2ae219b09aea832: Time spent flushing consensus metadata: real 0.713s	user 0.011s	sys 0.000s
I20260709 13:19:11.035859  9038 raft_consensus.cc:515] T bb7fa124c3bf4ef9ab65a407cb008441 P cd75a17ab2604397adab03bb8b5fd75c [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:19:11.036540  9053 raft_consensus.cc:515] T ab432e62819d499eaaf3dd55481dd930 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:11.039326  9053 leader_election.cc:290] T ab432e62819d499eaaf3dd55481dd930 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 7 election: Requested vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:11.013105  6804 rpcz_store.cc:276] 0709 13:19:09.410942 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:09.684022 (+273080us) service_pool.cc:224] Handling call
0709 13:19:10.976708 (+1292686us) spinlock_profiling.cc:243] Waited 130 ms on lock 0x7b54002c97d4. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f9ae2fa 00007fcc1496fb17 00007fcc0deea6d4 00007fcc0deea662 00007fcc0deea591 00007fcc0deea50c 00007fcc0dee97c2 00007fcc0dce548c 00007fcc0dce48c6 00007fcc0dce426f
0709 13:19:10.976881 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":298679552}
I20260709 13:19:11.042958  6804 raft_consensus.cc:1275] T 3a485a995abc4807b6e511e45419f737 P b7ab4784c7344b939bc36f639286f377 [term 4 FOLLOWER]: Refusing update from remote peer cd75a17ab2604397adab03bb8b5fd75c: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:19:11.045681  6803 raft_consensus.cc:1240] T 9b3759de40694069b13c0f8bd40e5709 P b7ab4784c7344b939bc36f639286f377 [term 6 FOLLOWER]: Rejecting Update request from peer cd75a17ab2604397adab03bb8b5fd75c for earlier term 5. Current term is 6. Ops: []
I20260709 13:19:11.046214  8941 leader_election.cc:290] T b56bf91d90824c959e21e0cee5ba1816 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:11.046404  6798 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50550 (request call id 182) took 1991 ms. Trace:
I20260709 13:19:11.046686  6803 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:32966 (request call id 673) took 1945 ms. Trace:
I20260709 13:19:11.047367  9037 raft_consensus.cc:515] T 07a92dd554674067a83a9cb68c4773f2 P cd75a17ab2604397adab03bb8b5fd75c [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:11.047060  6798 rpcz_store.cc:276] 0709 13:19:09.054498 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:11.033456 (+1978958us) service_pool.cc:224] Handling call
0709 13:19:11.033983 (+   527us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:11.045735 (+ 11752us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:19:11.045789 (+    54us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:11.045879 (+    90us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:19:11.045946 (+    67us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:11.046071 (+   125us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:11.046251 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:10.279327  9046 raft_consensus.cc:3055] T 3d65025eea89441290d85dd053810e31 P b7ab4784c7344b939bc36f639286f377 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:19:11.049997  9037 leader_election.cc:290] T 07a92dd554674067a83a9cb68c4773f2 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 6 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:19:11.050630  9046 raft_consensus.cc:740] T 3d65025eea89441290d85dd053810e31 P b7ab4784c7344b939bc36f639286f377 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
I20260709 13:19:09.927048  9076 consensus_queue.cc:1048] T 9e326172347f45e99a0d482b5d8ef768 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 1.128s
I20260709 13:19:10.138451  8855 leader_election.cc:290] T 4b8cacb381b746da8d0049b0a83b41dd P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:09.886507  8831 leader_election.cc:290] T f4b8bd455d5a47c18a1380839c6e0d61 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:11.057916  6879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4275cf08e63345f993bce8664eada830" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:19:11.059005  6879 raft_consensus.cc:2468] T 4275cf08e63345f993bce8664eada830 P cd75a17ab2604397adab03bb8b5fd75c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 5.
I20260709 13:19:11.059160  6881 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53416 (request call id 2186) took 2304 ms. Trace:
I20260709 13:19:11.043851  6804 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:32966 (request call id 671) took 1942 ms. Trace:
I20260709 13:19:11.060010  6881 rpcz_store.cc:276] 0709 13:19:08.755164 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:10.745931 (+1990767us) service_pool.cc:224] Handling call
0709 13:19:11.057873 (+311942us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:11.058503 (+   630us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:11.058529 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:11.058641 (+   112us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:19:11.058724 (+    83us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:11.058839 (+   115us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:11.059072 (+   233us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:19:11.061606  6698 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:09.885332  7497 raft_consensus.cc:2468] T bb3d8792045a4583ae2e965b1350a5b4 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 4.
I20260709 13:19:11.064798  7494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb7fa124c3bf4ef9ab65a407cb008441" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb"
I20260709 13:19:11.063773  9058 leader_election.cc:290] T 1528ab62b6fe4e3099d08f141afee116 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:19:11.085850  8855 consensus_queue.cc:1048] T 17587d6730594da4a56fa13a353232a1 P 7ba59cc884714e8aa5f3f0ecaed84cbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:19:11.085219  6627 catalog_manager.cc:5697] T 1528ab62b6fe4e3099d08f141afee116 P 7ba59cc884714e8aa5f3f0ecaed84cbb reported cstate change: config changed from index 2 to 3, term changed from 3 to 5, leader changed from cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67) to 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68) changed from NON_VOTER to VOTER, no longer has a pending config: VOTER ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65), VOTER b7ab4784c7344b939bc36f639286f377 (127.5.126.66), VOTER cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67), VOTER 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68). New cstate: current_term: 5 leader_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:19:10.471264  8933 consensus_meta.cc:287] T e31b9971c15848dea59d4d4130141d9e P ccd8a4c3bfe3413cb2ae219b09aea832: Time spent flushing consensus metadata: real 0.961s	user 0.009s	sys 0.005s
I20260709 13:19:11.074277  6799 raft_consensus.cc:2468] T b56bf91d90824c959e21e0cee5ba1816 P b7ab4784c7344b939bc36f639286f377 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 6.
I20260709 13:19:11.088398  6879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c7f33e544204fbaac4078e3e83bbf4e" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
W20260709 13:19:10.278453  9069 log.cc:927] Time spent T bb7fa124c3bf4ef9ab65a407cb008441 P 7ba59cc884714e8aa5f3f0ecaed84cbb: Append to log took a long time: real 0.934s	user 0.003s	sys 0.000s
I20260709 13:19:10.257784  9071 leader_election.cc:290] T 7887766dc6784fcaa42b35c05fea7a99 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
W20260709 13:19:11.009584  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 386949us
I20260709 13:19:10.197043  8927 raft_consensus.cc:3060] T 24ee15416e3145beaa1b8183453729a3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:19:11.009200  8986 raft_consensus.cc:3060] T 404190ce4ce94cecbfcb6ea9d1dd8626 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:19:10.976986  6695 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.160s	user 0.025s	sys 0.029s
I20260709 13:19:10.110963  9086 raft_consensus.cc:493] T 7ba5dac66ab5497e9e336f2a3c28cda5 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:11.009289  6877 rpcz_store.cc:276] 0709 13:19:08.762993 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:10.958801 (+2195808us) service_pool.cc:224] Handling call
0709 13:19:10.959411 (+   610us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:10.959947 (+   536us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:10.959988 (+    41us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:10.960210 (+   222us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:19:10.960249 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:10.960314 (+    65us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:10.960456 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:11.015756  6876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7887766dc6784fcaa42b35c05fea7a99" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:19:10.744254  8963 leader_election.cc:290] T 90d42e216d9741e190bca19a781291fd P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
W20260709 13:19:10.340868  9059 log.cc:927] Time spent T fe20b4b48823486ca3b9c648db6ce8aa P 7ba59cc884714e8aa5f3f0ecaed84cbb: Append to log took a long time: real 0.945s	user 0.002s	sys 0.000s
I20260709 13:19:10.282060  8940 leader_election.cc:290] T 711ef6523deb4cbe8ef2ba61e1c21c98 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:10.995203  6880 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53406 (request call id 1371) took 4245 ms. Trace:
I20260709 13:19:11.032977  9060 raft_consensus.cc:493] T 3fa34c08b205435dba97346991aa1f92 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:11.034847  6872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77e330a82df4b43a745d57a68f6f057" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:19:11.035145  6805 rpcz_store.cc:276] 0709 13:19:09.054829 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:11.032999 (+1978170us) service_pool.cc:224] Handling call
0709 13:19:11.033460 (+   461us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:11.034020 (+   560us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:11.034055 (+    35us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:11.034121 (+    66us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:19:11.034157 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:11.034223 (+    66us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:11.034356 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:19:11.039423  6628 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:53234 (request call id 169) took 12172 ms (client timeout 15000 ms). Trace:
I20260709 13:19:10.999827  6801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce4f062dcd314d43a63ca74067cb5ee3" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:19:11.039880  9031 raft_consensus.cc:515] T f3f9c2e2bf644115957398fe4c9459db P b7ab4784c7344b939bc36f639286f377 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:11.042846  6874 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53406 (request call id 1389) took 2279 ms. Trace:
I20260709 13:19:11.065812  9079 leader_election.cc:290] T 713b5728a197487c9300b310ab94e5a3 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:10.316691  8862 raft_consensus.cc:3060] T 95a75bfe094d4bdc963aba3f08dfcd25 P b7ab4784c7344b939bc36f639286f377 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:10.128609  8870 leader_election.cc:290] T 7a734b5ab7834e05a8c422208acc58b1 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:09.950690  7495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17587d6730594da4a56fa13a353232a1" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:19:10.139603  7502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8cee0accdb8499c86d4414b72565a38" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:19:10.259155  8347 raft_consensus.cc:3055] T 7ba5dac66ab5497e9e336f2a3c28cda5 P b7ab4784c7344b939bc36f639286f377 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:19:11.061304  6804 rpcz_store.cc:276] 0709 13:19:09.100975 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:11.041975 (+1941000us) service_pool.cc:224] Handling call
0709 13:19:11.042459 (+   484us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:11.043621 (+  1162us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:11.043797 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:11.024521  6873 rpcz_store.cc:276] 0709 13:19:08.763541 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:10.999921 (+2236380us) service_pool.cc:224] Handling call
0709 13:19:11.000404 (+   483us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:11.018158 (+ 17754us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:11.018206 (+    48us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:11.018247 (+    41us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:19:11.018274 (+    27us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:11.018339 (+    65us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:11.018489 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:10.744896  6878 rpcz_store.cc:276] 0709 13:19:09.028106 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:09.289644 (+261538us) service_pool.cc:224] Handling call
0709 13:19:10.130640 (+840996us) spinlock_profiling.cc:243] Waited 227 ms on lock 0x7b54002382d4. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f9ae2fa 00007fcc1496fb17 00007fcc0deea6d4 00007fcc0deea662 00007fcc0deea591 00007fcc0deea50c 00007fcc0dee97c2 00007fcc0dce548c 00007fcc0dce48c6 00007fcc0dce426f
0709 13:19:10.130831 (+   191us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":522666368}
W20260709 13:19:10.751713  9049 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.512s	user 0.002s	sys 0.008s
W20260709 13:19:10.267139  7468 connection.cc:256] RPC call timeout handler was delayed by -1.4399378699999943s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17020000000000002s for a response
W20260709 13:19:11.070396  6807 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:32966 (request call id 698) took 1621 ms (client timeout 1958 ms). Trace:
W20260709 13:19:11.120971  6807 rpcz_store.cc:269] 0709 13:19:09.449009 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:09.642991 (+193982us) service_pool.cc:224] Handling call
0709 13:19:11.070174 (+1427183us) spinlock_profiling.cc:243] Waited 1.26 s on lock 0x7b54001a36d4. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f9ae2fa 00007fcc1496fb17 00007fcc0deea6d4 00007fcc0deea662 00007fcc0deea591 00007fcc0deea50c 00007fcc0dee97c2 00007fcc0dce548c 00007fcc0dce48c6 00007fcc0dce426f
0709 13:19:11.070327 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2889085312}
W20260709 13:19:11.073732  6731 rpcz_store.cc:269] 0709 13:19:08.901001 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:08.901465 (+   464us) service_pool.cc:224] Handling call
0709 13:19:11.015422 (+2113957us) spinlock_profiling.cc:243] Waited 86.2 ms on lock 0x7b54003d5c54. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f9ae2fa 00007fcc1496fb17 00007fcc0deea6d4 00007fcc0deea662 00007fcc0deea591 00007fcc0deea50c 00007fcc0dee97c2 00007fcc0dce548c 00007fcc0dce48c6 00007fcc0dce426f
0709 13:19:11.022183 (+  6761us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":198273408}
I20260709 13:19:11.102064  6880 rpcz_store.cc:276] 0709 13:19:06.749934 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:07.787871 (+1037937us) service_pool.cc:224] Handling call
0709 13:19:07.788404 (+   533us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:08.385331 (+596927us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:08.385382 (+    51us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:08.386147 (+   765us) log.cc:844] Serialized 26 byte log entry
0709 13:19:08.826216 (+440069us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:19:08.826285 (+    69us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:08.826406 (+   121us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:10.342328 (+1515922us) spinlock_profiling.cc:243] Waited 14.4 ms on lock 0x7b4400022b4c. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0c745db1 00007fcc0c7e3c85 00007fcc0c7e46a2 00007fcc0f5561db 00007fcc0f551aaf 00007fcc0f54586e 00007fcc0f544bb6 00007fcc0f5447d8 00007fcc0f54e221 00007fcc0f54e1d9 00007fcc0f54e169
0709 13:19:10.994390 (+652062us) raft_consensus.cc:1685] finished
0709 13:19:10.994452 (+    62us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:10.994914 (+   462us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":745433,"raft.run_cpu_time_us":54,"raft.run_wall_time_us":54,"spinlock_wait_cycles":33121024,"thread_start_us":875367,"threads_started":2,"wal-append.queue_time_us":613643}
W20260709 13:19:11.076399  6771 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:11.069243  8892 raft_consensus.cc:493] T 44bde925b2e541b69890d70715b85176 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:11.077674  6726 raft_consensus.cc:1240] T 2c240553ce044eedb41541d72b9475d7 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 6 LEADER]: Rejecting Update request from peer b7ab4784c7344b939bc36f639286f377 for earlier term 5. Current term is 6. Ops: []
I20260709 13:19:11.047235  6803 rpcz_store.cc:276] 0709 13:19:09.101495 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:11.044475 (+1942980us) service_pool.cc:224] Handling call
0709 13:19:11.045126 (+   651us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:11.046314 (+  1188us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:11.046588 (+   274us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:11.080297  7466 leader_election.cc:304] T be1a92657f494cac8dd227d152f50151 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
I20260709 13:19:11.084235  8797 raft_consensus.cc:3060] T 711ef6523deb4cbe8ef2ba61e1c21c98 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:10.337062  9050 raft_consensus.cc:3060] T 4f00a2e87e56452083b759f60d461ee3 P b7ab4784c7344b939bc36f639286f377 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:11.089380  6627 catalog_manager.cc:5697] T be1a92657f494cac8dd227d152f50151 P 7ba59cc884714e8aa5f3f0ecaed84cbb reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:19:11.091090  6806 raft_consensus.cc:2468] T be1a92657f494cac8dd227d152f50151 P b7ab4784c7344b939bc36f639286f377 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in term 7.
I20260709 13:19:10.147053  8926 leader_election.cc:290] T 9e326172347f45e99a0d482b5d8ef768 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:19:10.906632  8574 raft_consensus.cc:493] T a1704639a875409b9959353527b3fd68 P b7ab4784c7344b939bc36f639286f377 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
W20260709 13:19:11.063282  7497 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50756 (request call id 163) took 1267 ms (client timeout 1677 ms). Trace:
I20260709 13:19:09.931027  8998 leader_election.cc:290] T be1a92657f494cac8dd227d152f50151 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 7 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:19:10.217855  9044 leader_election.cc:290] T 30e88460611e47b2ba16a46a30b5f416 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:19:09.867457  8673 leader_election.cc:290] T e77e330a82df4b43a745d57a68f6f057 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:11.097622  6875 raft_consensus.cc:2468] T 1bf4668eeb70467fb3dc5a0289233b3c P cd75a17ab2604397adab03bb8b5fd75c [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 5.
I20260709 13:19:10.190146  8965 leader_election.cc:290] T 8c7f33e544204fbaac4078e3e83bbf4e P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:19:10.253638  9036 leader_election.cc:290] T 1528ab62b6fe4e3099d08f141afee116 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:19:11.139787  6730 raft_consensus.cc:2468] T e31b9971c15848dea59d4d4130141d9e P ccd8a4c3bfe3413cb2ae219b09aea832 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 4.
I20260709 13:19:11.101679  6881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "711ef6523deb4cbe8ef2ba61e1c21c98" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:19:11.104686  6876 raft_consensus.cc:2468] T 7887766dc6784fcaa42b35c05fea7a99 P cd75a17ab2604397adab03bb8b5fd75c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 4.
I20260709 13:19:11.089733  9038 leader_election.cc:290] T bb7fa124c3bf4ef9ab65a407cb008441 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 7 election: Requested vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:19:11.144289  6805 raft_consensus.cc:1240] T d8292e16e5654be6bc408560cf256aaa P b7ab4784c7344b939bc36f639286f377 [term 7 FOLLOWER]: Rejecting Update request from peer cd75a17ab2604397adab03bb8b5fd75c for earlier term 6. Current term is 7. Ops: []
I20260709 13:19:10.271054  8973 leader_election.cc:290] T ce4f062dcd314d43a63ca74067cb5ee3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:11.106361  6874 rpcz_store.cc:276] 0709 13:19:08.763780 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:11.041015 (+2277235us) service_pool.cc:224] Handling call
0709 13:19:11.041756 (+   741us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:11.042292 (+   536us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:11.042334 (+    42us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:11.042426 (+    92us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:19:11.042477 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:11.042571 (+    94us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:11.042744 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:11.106045  6799 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:32966 (request call id 702) took 1312 ms. Trace:
I20260709 13:19:11.053535  9046 consensus_queue.cc:260] T 3d65025eea89441290d85dd053810e31 P b7ab4784c7344b939bc36f639286f377 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
W20260709 13:19:11.105814  6695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 1.29121e+06us
I20260709 13:19:11.114456  6725 raft_consensus.cc:1240] T 17587d6730594da4a56fa13a353232a1 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 8 FOLLOWER]: Rejecting Update request from peer b7ab4784c7344b939bc36f639286f377 for earlier term 7. Current term is 8. Ops: [7.7-7.7]
I20260709 13:19:11.148942  6799 rpcz_store.cc:276] 0709 13:19:09.789429 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:10.744626 (+955197us) service_pool.cc:224] Handling call
0709 13:19:11.100625 (+355999us) spinlock_profiling.cc:243] Waited 72.6 ms on lock 0x7b54001b62d4. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f9ae2fa 00007fcc1496fb17 00007fcc0deea6d4 00007fcc0deea662 00007fcc0deea591 00007fcc0deea50c 00007fcc0dee97c2 00007fcc0dce548c 00007fcc0dce48c6 00007fcc0dce426f
0709 13:19:11.102116 (+  1491us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":166956928}
I20260709 13:19:11.108404  9060 raft_consensus.cc:515] T 3fa34c08b205435dba97346991aa1f92 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:19:11.119710  8971 raft_consensus.cc:515] T 853ac0a8cbd64ce99457f170216d4d0f P ccd8a4c3bfe3413cb2ae219b09aea832 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
W20260709 13:19:11.126531  7466 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 46605.4us
I20260709 13:19:11.126214  6877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20f6842e26174571996b8dea4151d4be" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:19:11.129357  6801 raft_consensus.cc:2468] T ce4f062dcd314d43a63ca74067cb5ee3 P b7ab4784c7344b939bc36f639286f377 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in term 6.
I20260709 13:19:11.139739  6802 raft_consensus.cc:2393] T f3f9c2e2bf644115957398fe4c9459db P b7ab4784c7344b939bc36f639286f377 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c in current term 6: Already voted for candidate b7ab4784c7344b939bc36f639286f377 in this term.
I20260709 13:19:11.147287  6873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe20b4b48823486ca3b9c648db6ce8aa" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
W20260709 13:19:11.135560  9049 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.896s	user 0.002s	sys 0.017s
I20260709 13:19:11.125111  8990 raft_consensus.cc:3060] T 22ccee1b570c4ad3a57bd7aec085b1b4 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:19:11.123063  6879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22ccee1b570c4ad3a57bd7aec085b1b4" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:19:11.126027  6806 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50550 (request call id 186) took 1237 ms. Trace:
I20260709 13:19:11.164585  6805 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:32966 (request call id 676) took 2055 ms. Trace:
I20260709 13:19:11.165163  6805 rpcz_store.cc:276] 0709 13:19:09.102324 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:11.109120 (+2006796us) service_pool.cc:224] Handling call
0709 13:19:11.135118 (+ 25998us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:11.146810 (+ 11692us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:11.157461 (+ 10651us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:11.168359  6872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3411566abe2d4c9bb4b2adfdd05e6f17" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:19:11.169355  6872 raft_consensus.cc:3060] T 3411566abe2d4c9bb4b2adfdd05e6f17 P cd75a17ab2604397adab03bb8b5fd75c [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:19:11.164767  6806 rpcz_store.cc:276] 0709 13:19:09.888690 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:10.588721 (+700031us) service_pool.cc:224] Handling call
0709 13:19:11.125957 (+537236us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:11.139393  8855 raft_consensus.cc:2804] T be1a92657f494cac8dd227d152f50151 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:19:11.170415  6878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90d42e216d9741e190bca19a781291fd" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:19:11.147112  6627 catalog_manager.cc:5697] T 3fa34c08b205435dba97346991aa1f92 P 7ba59cc884714e8aa5f3f0ecaed84cbb reported cstate change: term changed from 1 to 5. New cstate: current_term: 5 leader_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } } }
I20260709 13:19:11.109098  9051 raft_consensus.cc:515] T 7c44c4849aa54f2b94d1f1bef9ed546f P cd75a17ab2604397adab03bb8b5fd75c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
W20260709 13:19:11.130384  7497 rpcz_store.cc:269] 0709 13:19:09.796051 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:09.796301 (+   250us) service_pool.cc:224] Handling call
0709 13:19:11.062940 (+1266639us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:11.177075  6878 raft_consensus.cc:2468] T 90d42e216d9741e190bca19a781291fd P cd75a17ab2604397adab03bb8b5fd75c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 6.
I20260709 13:19:11.186244  6725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a485a995abc4807b6e511e45419f737" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:19:11.187986  6881 raft_consensus.cc:2393] T 711ef6523deb4cbe8ef2ba61e1c21c98 P cd75a17ab2604397adab03bb8b5fd75c [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7ab4784c7344b939bc36f639286f377 in current term 6: Already voted for candidate cd75a17ab2604397adab03bb8b5fd75c in this term.
I20260709 13:19:11.195015  6798 raft_consensus.cc:1240] T 7c44c4849aa54f2b94d1f1bef9ed546f P b7ab4784c7344b939bc36f639286f377 [term 7 LEADER]: Rejecting Update request from peer cd75a17ab2604397adab03bb8b5fd75c for earlier term 6. Current term is 7. Ops: []
I20260709 13:19:11.142375  8892 raft_consensus.cc:515] T 44bde925b2e541b69890d70715b85176 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
W20260709 13:19:11.105319  6628 rpcz_store.cc:269] 0709 13:18:58.866380 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:58.886193 (+ 19813us) service_pool.cc:224] Handling call
0709 13:19:00.217774 (+1331581us) spinlock_profiling.cc:243] Waited 88.7 ms on lock 0x7b5400156154. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f914090 00007fcc0f9b2f3a 00007fcc157691cc 00007fcc1586737e 00007fcc13d282a4 00007fcc13d28232 00007fcc13d28161 00007fcc13d280dc 00007fcc13d27392 00007fcc0dce548c 00007fcc0dce48c6
0709 13:19:11.039112 (+10821338us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:19:03.268668 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:19:03.281560 (+ 12892us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:19:03.281640 (+    80us) write_op.cc:435] Acquired schema lock
0709 13:19:03.281668 (+    28us) tablet.cc:662] Decoding operations
0709 13:19:03.348696 (+ 67028us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:19:03.363910 (+ 15214us) write_op.cc:641] Partition lock acquired for write op
0709 13:19:03.363960 (+    50us) tablet.cc:685] Acquiring locks for 16 operations
0709 13:19:03.365803 (+  1843us) tablet.cc:701] Row locks acquired
0709 13:19:03.365881 (+    78us) write_op.cc:260] PREPARE: finished
0709 13:19:03.366112 (+   231us) write_op.cc:270] Start()
0709 13:19:03.366373 (+   261us) write_op.cc:276] Timestamp: P: 1783603143366023 usec, L: 0
0709 13:19:03.366407 (+    34us) op_driver.cc:348] REPLICATION: starting
0709 13:19:03.367537 (+  1130us) log.cc:844] Serialized 6669 byte log entry
0709 13:19:03.737415 (+369878us) op_driver.cc:464] REPLICATION: finished
0709 13:19:04.128566 (+391151us) spinlock_profiling.cc:243] Waited 15.9 ms on lock 0x7b4400022b4c. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0c745db1 00007fcc0c7e3c85 00007fcc0c7e46a2 00007fcc0f5561db 00007fcc0f551aaf 00007fcc0c8a00ac 00007fcc156faab9 00007fcc0c8bc69b 00007fcc0c8ba93f 00007fcc0c8bcc02 00007fcc133e0ef0
0709 13:19:04.222921 (+ 94355us) write_op.cc:301] APPLY: starting
0709 13:19:04.223054 (+   133us) tablet.cc:1367] starting BulkCheckPresence
0709 13:19:04.223536 (+   482us) tablet.cc:1370] finished BulkCheckPresence
0709 13:19:04.223585 (+    49us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:19:04.445315 (+221730us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:19:04.445707 (+   392us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=16
0709 13:19:04.445756 (+    49us) write_op.cc:312] APPLY: finished
0709 13:19:04.446148 (+   392us) log.cc:844] Serialized 112 byte log entry
0709 13:19:04.446343 (+   195us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:19:04.446533 (+   190us) write_op.cc:454] Released schema lock
0709 13:19:04.446616 (+    83us) write_op.cc:341] FINISH: Updating metrics
0709 13:19:04.447074 (+   458us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:19:04.447101 (+    27us) write_op.cc:454] Released schema lock
0709 13:19:04.525729 (+ 78628us) spinlock_profiling.cc:243] Waited 6.94 ms on lock 0x7b5400156154. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f9a732a 00007fcc0f92cf14 00007fcc0f92cec3 00007fcc0f92ce38 00007fcc0f92cdf3 00007fcc0f92c0dc 00007fcc0f955e16 00007fcc0f93dcbb 00007fcc0f92839d 00007fcc0f92bd75
Metrics: {"mutex_wait_us":88705,"reported_tablets":39,"spinlock_wait_cycles":204030848,"child_traces":[["op",{"apply.queue_time_us":485091,"apply.run_cpu_time_us":7161,"apply.run_wall_time_us":224163,"num_ops":16,"prepare.queue_time_us":223627,"prepare.run_cpu_time_us":96499,"prepare.run_wall_time_us":299883,"raft.queue_time_us":68403,"raft.run_cpu_time_us":43830,"raft.run_wall_time_us":802047,"replication_time_us":364509,"spinlock_wait_cycles":52596736,"thread_start_us":845168,"threads_started":4,"wal-append.queue_time_us":243825,"wal-append.run_cpu_time_us":16798,"wal-append.run_wall_time_us":1831221}]]}
I20260709 13:19:11.202205  6877 raft_consensus.cc:2468] T 20f6842e26174571996b8dea4151d4be P cd75a17ab2604397adab03bb8b5fd75c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 5.
I20260709 13:19:11.218397  6874 raft_consensus.cc:1240] T bb7fa124c3bf4ef9ab65a407cb008441 P cd75a17ab2604397adab03bb8b5fd75c [term 7 FOLLOWER]: Rejecting Update request from peer b7ab4784c7344b939bc36f639286f377 for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260709 13:19:11.208215  6798 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:32966 (request call id 674) took 2094 ms. Trace:
I20260709 13:19:11.219473  6798 rpcz_store.cc:276] 0709 13:19:09.101788 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:11.095888 (+1994100us) service_pool.cc:224] Handling call
0709 13:19:11.162293 (+ 66405us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:11.195668 (+ 33375us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:11.195931 (+   263us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:11.252702  6804 raft_consensus.cc:1275] T 17587d6730594da4a56fa13a353232a1 P b7ab4784c7344b939bc36f639286f377 [term 8 FOLLOWER]: Refusing update from remote peer 7ba59cc884714e8aa5f3f0ecaed84cbb: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 7. (term mismatch)
I20260709 13:19:11.253391  6804 pending_rounds.cc:85] T 17587d6730594da4a56fa13a353232a1 P b7ab4784c7344b939bc36f639286f377: Aborting all ops after (but not including) 6
I20260709 13:19:11.253698  6804 pending_rounds.cc:107] T 17587d6730594da4a56fa13a353232a1 P b7ab4784c7344b939bc36f639286f377: Aborting uncommitted NO_OP operation due to leader change: 7.7
I20260709 13:19:11.254012  6804 raft_consensus.cc:2889] T 17587d6730594da4a56fa13a353232a1 P b7ab4784c7344b939bc36f639286f377 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:19:11.255004  6804 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50550 (request call id 185) took 1543 ms. Trace:
I20260709 13:19:11.255380  6804 rpcz_store.cc:276] 0709 13:19:09.711969 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:11.123735 (+1411766us) service_pool.cc:224] Handling call
0709 13:19:11.194927 (+ 71192us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:11.254641 (+ 59714us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:11.254898 (+   257us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:11.256114  7502 raft_consensus.cc:2468] T d8cee0accdb8499c86d4414b72565a38 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 5.
I20260709 13:19:11.257052  7502 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50756 (request call id 164) took 1123 ms. Trace:
I20260709 13:19:11.257418  7502 rpcz_store.cc:276] 0709 13:19:10.133582 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:10.134090 (+   508us) service_pool.cc:224] Handling call
0709 13:19:11.256960 (+1122870us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:11.258311  8792 raft_consensus.cc:493] T e31b9971c15848dea59d4d4130141d9e P ccd8a4c3bfe3413cb2ae219b09aea832 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:11.258921  8792 raft_consensus.cc:515] T e31b9971c15848dea59d4d4130141d9e P ccd8a4c3bfe3413cb2ae219b09aea832 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:11.260866  9099 raft_consensus.cc:493] T be1a92657f494cac8dd227d152f50151 P b7ab4784c7344b939bc36f639286f377 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:11.261507  6875 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53406 (request call id 1390) took 2492 ms. Trace:
I20260709 13:19:11.261447  9099 raft_consensus.cc:515] T be1a92657f494cac8dd227d152f50151 P b7ab4784c7344b939bc36f639286f377 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:19:11.261966  6875 rpcz_store.cc:276] 0709 13:19:08.768946 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:11.164990 (+2396044us) service_pool.cc:224] Handling call
0709 13:19:11.178172 (+ 13182us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:11.261112 (+ 82940us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:11.261146 (+    34us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:11.261194 (+    48us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:19:11.261225 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:11.261284 (+    59us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:11.261417 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:11.263464  6875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "427c124d773f483294511e80fe340075" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:19:11.264571  6846 leader_election.cc:304] T bb3d8792045a4583ae2e965b1350a5b4 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:19:11.267289  6873 raft_consensus.cc:2410] T fe20b4b48823486ca3b9c648db6ce8aa P cd75a17ab2604397adab03bb8b5fd75c [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ccd8a4c3bfe3413cb2ae219b09aea832 for term 4 because replica has last-logged OpId of term: 2 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 13:19:11.268308  6874 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53406 (request call id 1392) took 2477 ms. Trace:
I20260709 13:19:11.268790  6874 rpcz_store.cc:276] 0709 13:19:08.773961 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:11.176197 (+2402236us) service_pool.cc:224] Handling call
0709 13:19:11.202852 (+ 26655us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:11.250648 (+ 47796us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:11.250980 (+   332us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:11.275818  6878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d9def8b32fd443aa94ab1420b06837b" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
W20260709 13:19:11.280279  7468 connection.cc:256] RPC call timeout handler was delayed by -1.0363937810002426s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1644s for a response
I20260709 13:19:11.281333  7468 leader_election.cc:304] T 4f00a2e87e56452083b759f60d461ee3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377
W20260709 13:19:11.284175  7495 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50744 (request call id 176) took 1305 ms (client timeout 1614 ms). Trace:
W20260709 13:19:11.284720  7495 rpcz_store.cc:269] 0709 13:19:09.885028 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:09.885502 (+   474us) service_pool.cc:224] Handling call
0709 13:19:11.176586 (+1291084us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:11.289615  8971 leader_election.cc:290] T 853ac0a8cbd64ce99457f170216d4d0f P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 3 election: Requested vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
W20260709 13:19:11.293684  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 108507us
W20260709 13:19:11.284209  6845 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:11.297343  6725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce4f062dcd314d43a63ca74067cb5ee3" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:19:11.222259  8347 raft_consensus.cc:740] T 7ba5dac66ab5497e9e336f2a3c28cda5 P b7ab4784c7344b939bc36f639286f377 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
W20260709 13:19:11.311569  6846 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.68:45071, user_credentials={real_user=slave}} blocked reactor thread for 47379.7us
W20260709 13:19:11.315690  6770 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 254713us
I20260709 13:19:11.313941  6874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b56bf91d90824c959e21e0cee5ba1816" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:19:11.266928  8767 raft_consensus.cc:493] T d8292e16e5654be6bc408560cf256aaa P ccd8a4c3bfe3413cb2ae219b09aea832 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader cd75a17ab2604397adab03bb8b5fd75c)
I20260709 13:19:11.275211  9046 raft_consensus.cc:3060] T 3d65025eea89441290d85dd053810e31 P b7ab4784c7344b939bc36f639286f377 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:19:11.328966  6878 raft_consensus.cc:2468] T 4d9def8b32fd443aa94ab1420b06837b P cd75a17ab2604397adab03bb8b5fd75c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 5.
I20260709 13:19:11.196324  8574 raft_consensus.cc:515] T a1704639a875409b9959353527b3fd68 P b7ab4784c7344b939bc36f639286f377 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:11.334048  7501 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50744 (request call id 174) took 2518 ms. Trace:
I20260709 13:19:11.341070  6875 raft_consensus.cc:2468] T 427c124d773f483294511e80fe340075 P cd75a17ab2604397adab03bb8b5fd75c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 5.
I20260709 13:19:11.362185  6874 raft_consensus.cc:2468] T b56bf91d90824c959e21e0cee5ba1816 P cd75a17ab2604397adab03bb8b5fd75c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 6.
I20260709 13:19:11.357551  6846 leader_election.cc:304] T d8cee0accdb8499c86d4414b72565a38 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
W20260709 13:19:11.356324  8793 consensus_meta.cc:287] T 7a734b5ab7834e05a8c422208acc58b1 P ccd8a4c3bfe3413cb2ae219b09aea832: Time spent flushing consensus metadata: real 0.703s	user 0.009s	sys 0.005s
I20260709 13:19:11.357899  6772 leader_election.cc:304] T de3186201e1a40d0b335eeb8b4e256e0 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:19:11.382730  6874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1528ab62b6fe4e3099d08f141afee116" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:19:11.384361  6874 raft_consensus.cc:2468] T 1528ab62b6fe4e3099d08f141afee116 P cd75a17ab2604397adab03bb8b5fd75c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 5.
W20260709 13:19:11.391777  6846 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.68:45071, user_credentials={real_user=slave}} blocked reactor thread for 57302.1us
I20260709 13:19:11.390201  6725 raft_consensus.cc:1275] T 07a92dd554674067a83a9cb68c4773f2 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 5 FOLLOWER]: Refusing update from remote peer b7ab4784c7344b939bc36f639286f377: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:19:11.296311  9086 raft_consensus.cc:515] T 7ba5dac66ab5497e9e336f2a3c28cda5 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:19:11.337478  7501 rpcz_store.cc:276] 0709 13:19:08.836138 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:08.837662 (+  1524us) service_pool.cc:224] Handling call
0709 13:19:08.838308 (+   646us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:08.838867 (+   559us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:08.838897 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:08.839441 (+   544us) log.cc:844] Serialized 26 byte log entry
0709 13:19:09.147960 (+308519us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:19:09.148055 (+    95us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:09.148178 (+   123us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:10.277659 (+1129481us) spinlock_profiling.cc:243] Waited 38.9 ms on lock 0x7b4400022b4c. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0c745db1 00007fcc0c7e3c85 00007fcc0c7e46a2 00007fcc0f5561db 00007fcc0f551aaf 00007fcc0f54586e 00007fcc0f544bb6 00007fcc0f5447d8 00007fcc0f54e221 00007fcc0f54e1d9 00007fcc0f54e169
0709 13:19:11.223183 (+945524us) raft_consensus.cc:1685] finished
0709 13:19:11.266826 (+ 43643us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:11.321149 (+ 54323us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":39965,"raft.run_cpu_time_us":106,"raft.run_wall_time_us":107,"spinlock_wait_cycles":89533312,"thread_start_us":307950,"threads_started":1,"wal-append.queue_time_us":442375}
W20260709 13:19:11.426455  7466 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 125820us
I20260709 13:19:11.369086  8767 raft_consensus.cc:515] T d8292e16e5654be6bc408560cf256aaa P ccd8a4c3bfe3413cb2ae219b09aea832 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:11.442966  6725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f9c2e2bf644115957398fe4c9459db" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
W20260709 13:19:11.435645  6772 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 101649us
I20260709 13:19:11.390946  8793 raft_consensus.cc:515] T 7a734b5ab7834e05a8c422208acc58b1 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
W20260709 13:19:11.456557  6770 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:11.457228  8940 raft_consensus.cc:493] T f09c2a98de1a4decabd0ff900dd44caa P b7ab4784c7344b939bc36f639286f377 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:11.462252  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 138585us
W20260709 13:19:11.463052  6697 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 59200.3us
I20260709 13:19:11.444855  9079 raft_consensus.cc:2804] T de3186201e1a40d0b335eeb8b4e256e0 P b7ab4784c7344b939bc36f639286f377 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:19:11.470724  6873 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53406 (request call id 1395) took 1815 ms. Trace:
I20260709 13:19:11.475006  6873 rpcz_store.cc:276] 0709 13:19:09.647372 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:11.328546 (+1681174us) service_pool.cc:224] Handling call
0709 13:19:11.370999 (+ 42453us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:11.451484 (+ 80485us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:11.451525 (+    41us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:11.462363 (+ 10838us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:19:11.462414 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:11.462489 (+    75us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:11.462628 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:11.478562  6878 raft_consensus.cc:1275] T f58dc08b12a2494bb9a1372837970ca2 P cd75a17ab2604397adab03bb8b5fd75c [term 7 FOLLOWER]: Refusing update from remote peer b7ab4784c7344b939bc36f639286f377: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:19:11.484345  6878 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53406 (request call id 1396) took 1836 ms. Trace:
I20260709 13:19:11.473896  6727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24ee15416e3145beaa1b8183453729a3" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:19:11.484845  6878 rpcz_store.cc:276] 0709 13:19:09.647708 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:11.346724 (+1699016us) service_pool.cc:224] Handling call
0709 13:19:11.419519 (+ 72795us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:11.483933 (+ 64414us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:11.484264 (+   331us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:11.488889  6772 leader_election.cc:304] T 7a734b5ab7834e05a8c422208acc58b1 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
W20260709 13:19:11.488914  6695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 148570us
I20260709 13:19:11.489871  6728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f03d0dbf16864ca4bc1bb5e4c0334c0f" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:19:11.492933  6879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "853ac0a8cbd64ce99457f170216d4d0f" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:19:11.493484  6697 leader_election.cc:304] T 7887766dc6784fcaa42b35c05fea7a99 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
W20260709 13:19:11.492339  7468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 168805us
I20260709 13:19:11.471388  8973 raft_consensus.cc:2804] T 4f00a2e87e56452083b759f60d461ee3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:19:11.499085  6873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab432e62819d499eaaf3dd55481dd930" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:19:11.499873  6874 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53406 (request call id 1398) took 1848 ms. Trace:
I20260709 13:19:11.481778  9036 raft_consensus.cc:2804] T bb3d8792045a4583ae2e965b1350a5b4 P cd75a17ab2604397adab03bb8b5fd75c [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:19:11.505226  6875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f58dc08b12a2494bb9a1372837970ca2" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:19:11.494038  6844 leader_election.cc:304] T e31b9971c15848dea59d4d4130141d9e P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:19:11.503515  6874 rpcz_store.cc:276] 0709 13:19:09.651093 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:11.405498 (+1754405us) service_pool.cc:224] Handling call
0709 13:19:11.454047 (+ 48549us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:11.493733 (+ 39686us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:11.493776 (+    43us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:11.499610 (+  5834us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:19:11.499648 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:11.499706 (+    58us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:11.499820 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:11.485772  9051 leader_election.cc:290] T 7c44c4849aa54f2b94d1f1bef9ed546f P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:19:11.511165  6727 raft_consensus.cc:2393] T 24ee15416e3145beaa1b8183453729a3 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7ab4784c7344b939bc36f639286f377 in current term 5: Already voted for candidate cd75a17ab2604397adab03bb8b5fd75c in this term.
I20260709 13:19:11.480495  9079 raft_consensus.cc:493] T de3186201e1a40d0b335eeb8b4e256e0 P b7ab4784c7344b939bc36f639286f377 [term 5 FOLLOWER]: Starting leader election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:19:11.502144  6881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "713b5728a197487c9300b310ab94e5a3" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
W20260709 13:19:11.502107  6772 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 47521.5us
I20260709 13:19:11.505374  6878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c37d41cd9164c15a6826ca62a851a69" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:19:11.493427  8940 raft_consensus.cc:515] T f09c2a98de1a4decabd0ff900dd44caa P b7ab4784c7344b939bc36f639286f377 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
W20260709 13:19:11.516172  6730 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49998 (request call id 640) took 5277 ms (client timeout 1978 ms). Trace:
I20260709 13:19:11.520679  6875 raft_consensus.cc:2468] T f58dc08b12a2494bb9a1372837970ca2 P cd75a17ab2604397adab03bb8b5fd75c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 7.
I20260709 13:19:11.525996  6873 raft_consensus.cc:3060] T ab432e62819d499eaaf3dd55481dd930 P cd75a17ab2604397adab03bb8b5fd75c [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:11.499450  9060 leader_election.cc:290] T 3fa34c08b205435dba97346991aa1f92 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
W20260709 13:19:11.520838  6730 rpcz_store.cc:269] 0709 13:19:06.238733 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:06.239357 (+   624us) service_pool.cc:224] Handling call
0709 13:19:11.515797 (+5276440us) spinlock_profiling.cc:243] Waited 4.87 s on lock 0x7b54000983d4. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f9ae2fa 00007fcc1496fb17 00007fcc0deea6d4 00007fcc0deea662 00007fcc0deea591 00007fcc0deea50c 00007fcc0dee97c2 00007fcc0dce548c 00007fcc0dce48c6 00007fcc0dce426f
0709 13:19:11.516019 (+   222us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":11203777408}
W20260709 13:19:11.508708  9083 consensus_meta.cc:287] T b3f13b31a1f84f0d89d007eadd57924c P 7ba59cc884714e8aa5f3f0ecaed84cbb: Time spent flushing consensus metadata: real 0.720s	user 0.010s	sys 0.005s
I20260709 13:19:11.538482  6725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de3186201e1a40d0b335eeb8b4e256e0" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:19:11.506788  8892 leader_election.cc:290] T 44bde925b2e541b69890d70715b85176 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:11.521620  9079 raft_consensus.cc:3060] T de3186201e1a40d0b335eeb8b4e256e0 P b7ab4784c7344b939bc36f639286f377 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:11.567205  6881 raft_consensus.cc:2468] T 713b5728a197487c9300b310ab94e5a3 P cd75a17ab2604397adab03bb8b5fd75c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 5.
W20260709 13:19:11.571316  6695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 61178.9us
I20260709 13:19:11.520606  9044 raft_consensus.cc:2804] T d8cee0accdb8499c86d4414b72565a38 P cd75a17ab2604397adab03bb8b5fd75c [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:19:11.510075  9036 raft_consensus.cc:493] T bb3d8792045a4583ae2e965b1350a5b4 P cd75a17ab2604397adab03bb8b5fd75c [term 4 FOLLOWER]: Starting leader election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
W20260709 13:19:11.580704  6847 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:11.584044  7503 raft_consensus.cc:1240] T 7ba5dac66ab5497e9e336f2a3c28cda5 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 6 FOLLOWER]: Rejecting Update request from peer b7ab4784c7344b939bc36f639286f377 for earlier term 5. Current term is 6. Ops: []
I20260709 13:19:11.586275  6879 raft_consensus.cc:1240] T 1bf4668eeb70467fb3dc5a0289233b3c P cd75a17ab2604397adab03bb8b5fd75c [term 5 FOLLOWER]: Rejecting Update request from peer b7ab4784c7344b939bc36f639286f377 for earlier term 4. Current term is 5. Ops: []
I20260709 13:19:11.583840  8827 raft_consensus.cc:2804] T 7887766dc6784fcaa42b35c05fea7a99 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 13:19:11.592370  6771 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:11.607503  6879 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53406 (request call id 1401) took 1736 ms. Trace:
W20260709 13:19:11.590945  9043 consensus_meta.cc:287] T 7a734b5ab7834e05a8c422208acc58b1 P cd75a17ab2604397adab03bb8b5fd75c: Time spent flushing consensus metadata: real 0.716s	user 0.009s	sys 0.006s
I20260709 13:19:11.581795  9044 raft_consensus.cc:493] T d8cee0accdb8499c86d4414b72565a38 P cd75a17ab2604397adab03bb8b5fd75c [term 5 FOLLOWER]: Starting leader election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:19:11.608330  6879 rpcz_store.cc:276] 0709 13:19:09.862099 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:11.537027 (+1674928us) service_pool.cc:224] Handling call
0709 13:19:11.585990 (+ 48963us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:11.598474 (+ 12484us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:11.598783 (+   309us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:11.537664  8347 consensus_queue.cc:260] T 7ba5dac66ab5497e9e336f2a3c28cda5 P b7ab4784c7344b939bc36f639286f377 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
W20260709 13:19:11.610625  6772 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 69835.2us
I20260709 13:19:11.590492  8827 raft_consensus.cc:493] T 7887766dc6784fcaa42b35c05fea7a99 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:11.588317  9036 raft_consensus.cc:3060] T bb3d8792045a4583ae2e965b1350a5b4 P cd75a17ab2604397adab03bb8b5fd75c [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:19:11.656252  6881 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53406 (request call id 1403) took 1042 ms. Trace:
W20260709 13:19:11.680235  6872 consensus_meta.cc:287] T 3411566abe2d4c9bb4b2adfdd05e6f17 P cd75a17ab2604397adab03bb8b5fd75c: Time spent flushing consensus metadata: real 0.502s	user 0.008s	sys 0.004s
I20260709 13:19:11.633828  6728 raft_consensus.cc:1240] T 853ac0a8cbd64ce99457f170216d4d0f P ccd8a4c3bfe3413cb2ae219b09aea832 [term 3 FOLLOWER]: Rejecting Update request from peer b7ab4784c7344b939bc36f639286f377 for earlier term 2. Current term is 3. Ops: []
W20260709 13:19:11.621982  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 138042us
I20260709 13:19:11.633569  6876 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53406 (request call id 1405) took 1018 ms. Trace:
I20260709 13:19:11.569597  8938 raft_consensus.cc:493] T 3a485a995abc4807b6e511e45419f737 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 4 FOLLOWER]: Starting leader election (detected failure of leader cd75a17ab2604397adab03bb8b5fd75c)
I20260709 13:19:11.686255  6726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e326172347f45e99a0d482b5d8ef768" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
W20260709 13:19:11.614171  9094 log.cc:927] Time spent T 4b8cacb381b746da8d0049b0a83b41dd P 7ba59cc884714e8aa5f3f0ecaed84cbb: Append to log took a long time: real 0.123s	user 0.001s	sys 0.000s
I20260709 13:19:11.692023  6872 raft_consensus.cc:2468] T 3411566abe2d4c9bb4b2adfdd05e6f17 P cd75a17ab2604397adab03bb8b5fd75c [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 5.
I20260709 13:19:11.693758  6881 rpcz_store.cc:276] 0709 13:19:10.613985 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:11.582592 (+968607us) service_pool.cc:224] Handling call
0709 13:19:11.604931 (+ 22339us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:11.643581 (+ 38650us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:11.643628 (+    47us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:11.643718 (+    90us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:19:11.643761 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:11.643857 (+    96us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:11.656147 (+ 12290us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:11.565042  9083 raft_consensus.cc:515] T b3f13b31a1f84f0d89d007eadd57924c P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
W20260709 13:19:11.714555  6695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 116425us
I20260709 13:19:11.714737  6725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3411566abe2d4c9bb4b2adfdd05e6f17" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
W20260709 13:19:11.616187  9103 log.cc:927] Time spent T 44bde925b2e541b69890d70715b85176 P b7ab4784c7344b939bc36f639286f377: Append to log took a long time: real 0.146s	user 0.000s	sys 0.001s
W20260709 13:19:11.614423  9104 log.cc:927] Time spent T d8292e16e5654be6bc408560cf256aaa P ccd8a4c3bfe3413cb2ae219b09aea832: Append to log took a long time: real 0.150s	user 0.002s	sys 0.000s
W20260709 13:19:11.635164  8987 consensus_meta.cc:287] T f09c2a98de1a4decabd0ff900dd44caa P ccd8a4c3bfe3413cb2ae219b09aea832: Time spent flushing consensus metadata: real 0.838s	user 0.012s	sys 0.001s
I20260709 13:19:11.621418  9031 leader_election.cc:290] T f3f9c2e2bf644115957398fe4c9459db P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 6 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:11.733580  6731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8292e16e5654be6bc408560cf256aaa" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
W20260709 13:19:11.646332  9097 log.cc:927] Time spent T 4b8cacb381b746da8d0049b0a83b41dd P cd75a17ab2604397adab03bb8b5fd75c: Append to log took a long time: real 0.088s	user 0.000s	sys 0.000s
I20260709 13:19:11.609454  8855 raft_consensus.cc:697] T be1a92657f494cac8dd227d152f50151 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 7 LEADER]: Becoming Leader. State: Replica: 7ba59cc884714e8aa5f3f0ecaed84cbb, State: Running, Role: LEADER
I20260709 13:19:11.614197  8792 leader_election.cc:290] T e31b9971c15848dea59d4d4130141d9e P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:11.734481  6730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a734b5ab7834e05a8c422208acc58b1" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
W20260709 13:19:11.654793  8927 consensus_meta.cc:287] T 24ee15416e3145beaa1b8183453729a3 P 7ba59cc884714e8aa5f3f0ecaed84cbb: Time spent flushing consensus metadata: real 0.539s	user 0.008s	sys 0.001s
I20260709 13:19:11.682474  9044 raft_consensus.cc:3060] T d8cee0accdb8499c86d4414b72565a38 P cd75a17ab2604397adab03bb8b5fd75c [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:11.617513  9060 consensus_queue.cc:1048] T 9e326172347f45e99a0d482b5d8ef768 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.113s
I20260709 13:19:11.616199  9071 raft_consensus.cc:2804] T 7a734b5ab7834e05a8c422208acc58b1 P b7ab4784c7344b939bc36f639286f377 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:19:11.695787  8938 raft_consensus.cc:3060] T 3a485a995abc4807b6e511e45419f737 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:19:11.690830  8827 raft_consensus.cc:3060] T 7887766dc6784fcaa42b35c05fea7a99 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:11.715718  7502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1528ab62b6fe4e3099d08f141afee116" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:19:11.740087  6725 raft_consensus.cc:2393] T 3411566abe2d4c9bb4b2adfdd05e6f17 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7ab4784c7344b939bc36f639286f377 in current term 5: Already voted for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in this term.
I20260709 13:19:11.716526  9038 raft_consensus.cc:493] T f4b8bd455d5a47c18a1380839c6e0d61 P cd75a17ab2604397adab03bb8b5fd75c [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:11.742025  6728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c240553ce044eedb41541d72b9475d7" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
W20260709 13:19:11.711354  6697 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 96211us
I20260709 13:19:11.614477  8832 consensus_queue.cc:1048] T 07a92dd554674067a83a9cb68c4773f2 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.124s
I20260709 13:19:11.627574  8767 leader_election.cc:290] T d8292e16e5654be6bc408560cf256aaa P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:11.748574  8793 leader_election.cc:290] T 7a734b5ab7834e05a8c422208acc58b1 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 6 election: Requested vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:11.716882  8973 raft_consensus.cc:697] T 4f00a2e87e56452083b759f60d461ee3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 6 LEADER]: Becoming Leader. State: Replica: 7ba59cc884714e8aa5f3f0ecaed84cbb, State: Running, Role: LEADER
I20260709 13:19:11.753605  9099 leader_election.cc:290] T be1a92657f494cac8dd227d152f50151 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:19:11.754349  6730 raft_consensus.cc:2393] T 7a734b5ab7834e05a8c422208acc58b1 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7ab4784c7344b939bc36f639286f377 in current term 6: Already voted for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in this term.
I20260709 13:19:11.617966  8892 consensus_queue.cc:1048] T 34f36d59d88f40fe8a2805e604fc6c0a P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.129s
I20260709 13:19:11.788926  6725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "711ef6523deb4cbe8ef2ba61e1c21c98" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:19:11.757077  6726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34f36d59d88f40fe8a2805e604fc6c0a" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:19:11.687028  9043 raft_consensus.cc:515] T 7a734b5ab7834e05a8c422208acc58b1 P cd75a17ab2604397adab03bb8b5fd75c [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:11.775787  6731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17587d6730594da4a56fa13a353232a1" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:19:11.712867  6876 rpcz_store.cc:276] 0709 13:19:10.615034 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:11.632563 (+1017529us) service_pool.cc:224] Handling call
0709 13:19:11.632894 (+   331us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:11.633195 (+   301us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:11.633229 (+    34us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:11.633287 (+    58us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:19:11.633344 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:11.633399 (+    55us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:11.633510 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:11.756820  8347 raft_consensus.cc:3060] T 7ba5dac66ab5497e9e336f2a3c28cda5 P b7ab4784c7344b939bc36f639286f377 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:11.781478  6772 leader_election.cc:304] T 34f36d59d88f40fe8a2805e604fc6c0a P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:19:11.744853  8574 leader_election.cc:290] T a1704639a875409b9959353527b3fd68 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:11.753295  7495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "427c124d773f483294511e80fe340075" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:19:11.759119  9071 raft_consensus.cc:493] T 7a734b5ab7834e05a8c422208acc58b1 P b7ab4784c7344b939bc36f639286f377 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:11.811452  6731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7887766dc6784fcaa42b35c05fea7a99" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:19:11.812331  8973 consensus_queue.cc:237] T 4f00a2e87e56452083b759f60d461ee3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:19:11.816812  6844 leader_election.cc:304] T 34f36d59d88f40fe8a2805e604fc6c0a P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
W20260709 13:19:11.831121  6772 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 61308.9us
I20260709 13:19:11.827977  6728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4db81d9d329422bb3b4160ca4ac2d1d" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 7 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:19:11.832782  6730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4b8bd455d5a47c18a1380839c6e0d61" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:19:11.838083  7500 raft_consensus.cc:2468] T 24ee15416e3145beaa1b8183453729a3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 5.
I20260709 13:19:11.840294  9000 raft_consensus.cc:493] T 24ee15416e3145beaa1b8183453729a3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:11.841204  9000 raft_consensus.cc:515] T 24ee15416e3145beaa1b8183453729a3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } attrs { replace: true } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:19:11.762200  9120 consensus_queue.cc:1048] T 17587d6730594da4a56fa13a353232a1 P 7ba59cc884714e8aa5f3f0ecaed84cbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.066s
I20260709 13:19:11.840353  6729 raft_consensus.cc:1240] T ab432e62819d499eaaf3dd55481dd930 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 7 FOLLOWER]: Rejecting Update request from peer b7ab4784c7344b939bc36f639286f377 for earlier term 6. Current term is 7. Ops: [6.3-6.3]
I20260709 13:19:11.834517  6697 leader_election.cc:304] T 90d42e216d9741e190bca19a781291fd P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:19:11.819486  9071 raft_consensus.cc:3060] T 7a734b5ab7834e05a8c422208acc58b1 P b7ab4784c7344b939bc36f639286f377 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:11.864507  6723 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49998 (request call id 665) took 2973 ms. Trace:
I20260709 13:19:11.864967  6723 rpcz_store.cc:276] 0709 13:19:08.891502 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:08.895176 (+  3674us) service_pool.cc:224] Handling call
0709 13:19:08.895808 (+   632us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:19:08.904557 (+  8749us) raft_consensus.cc:1534] Early marking committed up to index 1
0709 13:19:08.904596 (+    39us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:19:08.924010 (+ 19414us) log.cc:844] Serialized 52 byte log entry
0709 13:19:10.240184 (+1316174us) spinlock_profiling.cc:243] Waited 83.7 ms on lock 0x7b48003300d8. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc148d3aa1 00007fcc148cab37 00007fcc148ca9ca 00007fcc149c226f 00007fcc149c1f37 00007fcc149d655c 00007fcc149d6508 00007fcc149d6488 00007fcc149d6443 00007fcc149d56ec 00007fcc138ffa96
0709 13:19:10.982665 (+742481us) spinlock_profiling.cc:243] Waited 1.45 ms on lock 0x7b18003bc740. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc15785de1 00007fcc157925b1 00007fcc0c89fe07 00007fcc156faab9 00007fcc0c8bc69b 00007fcc0c8ba93f 00007fcc0c8bcc02 00007fcc0f54420b 00007fcc0f549d23 00007fcc0f54a0d1 00007fcc0f965a0f
0709 13:19:11.251634 (+268969us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:19:11.251709 (+    75us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:11.251847 (+   138us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:11.864125 (+612278us) raft_consensus.cc:1685] finished
0709 13:19:11.864148 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:11.864346 (+   198us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":97490,"raft.run_cpu_time_us":4226,"raft.run_wall_time_us":1226035,"spinlock_wait_cycles":195768960,"thread_start_us":195698,"threads_started":1,"wal-append.queue_time_us":2311528}
I20260709 13:19:11.867396  6723 raft_consensus.cc:1275] T f58dc08b12a2494bb9a1372837970ca2 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 7 FOLLOWER]: Refusing update from remote peer b7ab4784c7344b939bc36f639286f377: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
W20260709 13:19:11.833372  9090 consensus_meta.cc:287] T 3fa34c08b205435dba97346991aa1f92 P 7ba59cc884714e8aa5f3f0ecaed84cbb: Time spent flushing consensus metadata: real 1.179s	user 0.013s	sys 0.005s
I20260709 13:19:11.872442  9090 raft_consensus.cc:515] T 3fa34c08b205435dba97346991aa1f92 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:19:11.875538  7498 raft_consensus.cc:1240] T 3fa34c08b205435dba97346991aa1f92 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 7 FOLLOWER]: Rejecting Update request from peer cd75a17ab2604397adab03bb8b5fd75c for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260709 13:19:11.854552  6877 raft_consensus.cc:1275] T 95a75bfe094d4bdc963aba3f08dfcd25 P cd75a17ab2604397adab03bb8b5fd75c [term 7 FOLLOWER]: Refusing update from remote peer ccd8a4c3bfe3413cb2ae219b09aea832: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 7 index: 2. (index mismatch)
I20260709 13:19:11.853893  8855 consensus_queue.cc:237] T be1a92657f494cac8dd227d152f50151 P 7ba59cc884714e8aa5f3f0ecaed84cbb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:19:11.856153  9051 raft_consensus.cc:2749] T 34f36d59d88f40fe8a2805e604fc6c0a P cd75a17ab2604397adab03bb8b5fd75c [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:19:11.856370  9079 raft_consensus.cc:515] T de3186201e1a40d0b335eeb8b4e256e0 P b7ab4784c7344b939bc36f639286f377 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
W20260709 13:19:11.857805  8862 consensus_meta.cc:287] T 95a75bfe094d4bdc963aba3f08dfcd25 P b7ab4784c7344b939bc36f639286f377: Time spent flushing consensus metadata: real 0.737s	user 0.011s	sys 0.000s
I20260709 13:19:11.814989  9086 leader_election.cc:290] T 7ba5dac66ab5497e9e336f2a3c28cda5 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
W20260709 13:19:11.861128  9050 consensus_meta.cc:287] T 4f00a2e87e56452083b759f60d461ee3 P b7ab4784c7344b939bc36f639286f377: Time spent flushing consensus metadata: real 0.735s	user 0.011s	sys 0.001s
I20260709 13:19:11.861766  6728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4275cf08e63345f993bce8664eada830" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:19:11.813545  9076 consensus_queue.cc:1048] T 34f36d59d88f40fe8a2805e604fc6c0a P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.055s
W20260709 13:19:11.829836  8986 consensus_meta.cc:287] T 404190ce4ce94cecbfcb6ea9d1dd8626 P ccd8a4c3bfe3413cb2ae219b09aea832: Time spent flushing consensus metadata: real 0.723s	user 0.013s	sys 0.002s
I20260709 13:19:11.780010  9038 raft_consensus.cc:515] T f4b8bd455d5a47c18a1380839c6e0d61 P cd75a17ab2604397adab03bb8b5fd75c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:11.933966  6726 raft_consensus.cc:1240] T d33d5ee8ef6f415593d8df52063161ad P ccd8a4c3bfe3413cb2ae219b09aea832 [term 7 FOLLOWER]: Rejecting Update request from peer b7ab4784c7344b939bc36f639286f377 for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 13:19:11.926970  6873 raft_consensus.cc:2468] T ab432e62819d499eaaf3dd55481dd930 P cd75a17ab2604397adab03bb8b5fd75c [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 7.
I20260709 13:19:11.931947  8673 raft_consensus.cc:493] T f09c2a98de1a4decabd0ff900dd44caa P ccd8a4c3bfe3413cb2ae219b09aea832 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:11.877837  9046 raft_consensus.cc:2804] T 34f36d59d88f40fe8a2805e604fc6c0a P b7ab4784c7344b939bc36f639286f377 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 13:19:11.941265  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 173113us
I20260709 13:19:11.951614  6801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "853ac0a8cbd64ce99457f170216d4d0f" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:19:11.939888  6800 raft_consensus.cc:2410] T 95a75bfe094d4bdc963aba3f08dfcd25 P b7ab4784c7344b939bc36f639286f377 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c for term 8 because replica has last-logged OpId of term: 6 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:19:11.950742  6805 raft_consensus.cc:1275] T 2c240553ce044eedb41541d72b9475d7 P b7ab4784c7344b939bc36f639286f377 [term 6 FOLLOWER]: Refusing update from remote peer ccd8a4c3bfe3413cb2ae219b09aea832: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:19:11.932871  6803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7887766dc6784fcaa42b35c05fea7a99" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:19:11.955662  6803 raft_consensus.cc:2468] T 7887766dc6784fcaa42b35c05fea7a99 P b7ab4784c7344b939bc36f639286f377 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 5.
W20260709 13:19:11.935667  6697 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 115399us
I20260709 13:19:11.939172  6806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6869f07b5a4885a0b99fbe60c3b175" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 6 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:19:11.938323  6880 raft_consensus.cc:1240] T ab432e62819d499eaaf3dd55481dd930 P cd75a17ab2604397adab03bb8b5fd75c [term 7 FOLLOWER]: Rejecting Update request from peer b7ab4784c7344b939bc36f639286f377 for earlier term 6. Current term is 7. Ops: [4.2-6.3]
I20260709 13:19:11.939467  6798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5be3a11b23d4ea9b08300a2789821c7" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:19:11.938410  6772 leader_election.cc:304] T 7887766dc6784fcaa42b35c05fea7a99 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:19:11.962622  6799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d33d5ee8ef6f415593d8df52063161ad" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:19:11.968353  6772 leader_election.cc:304] T 90d42e216d9741e190bca19a781291fd P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:19:11.969548  6730 raft_consensus.cc:1240] T 3d65025eea89441290d85dd053810e31 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 5 FOLLOWER]: Rejecting Update request from peer b7ab4784c7344b939bc36f639286f377 for earlier term 4. Current term is 5. Ops: [4.2-4.2]
I20260709 13:19:11.963423  6697 leader_election.cc:304] T 4275cf08e63345f993bce8664eada830 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:19:11.965966  6807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90d42e216d9741e190bca19a781291fd" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:19:11.975289  6807 raft_consensus.cc:2468] T 90d42e216d9741e190bca19a781291fd P b7ab4784c7344b939bc36f639286f377 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 6.
I20260709 13:19:11.980427  6728 raft_consensus.cc:2410] T 4275cf08e63345f993bce8664eada830 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7ab4784c7344b939bc36f639286f377 for term 6 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:19:11.959764  9046 raft_consensus.cc:493] T 34f36d59d88f40fe8a2805e604fc6c0a P b7ab4784c7344b939bc36f639286f377 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:11.941877  9038 leader_election.cc:290] T f4b8bd455d5a47c18a1380839c6e0d61 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:19:11.970042  6804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a734b5ab7834e05a8c422208acc58b1" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:19:11.966667  8845 raft_consensus.cc:2749] T e31b9971c15848dea59d4d4130141d9e P cd75a17ab2604397adab03bb8b5fd75c [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:19:11.988215  8440 raft_consensus.cc:493] T 95a75bfe094d4bdc963aba3f08dfcd25 P b7ab4784c7344b939bc36f639286f377 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:12.002678  6807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bf4668eeb70467fb3dc5a0289233b3c" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:19:11.942322  9000 leader_election.cc:290] T 24ee15416e3145beaa1b8183453729a3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:11.977789  9050 raft_consensus.cc:2804] T 7887766dc6784fcaa42b35c05fea7a99 P b7ab4784c7344b939bc36f639286f377 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:19:11.950567  9129 raft_consensus.cc:2804] T 90d42e216d9741e190bca19a781291fd P ccd8a4c3bfe3413cb2ae219b09aea832 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:19:12.007831  6877 raft_consensus.cc:1275] T 7c44c4849aa54f2b94d1f1bef9ed546f P cd75a17ab2604397adab03bb8b5fd75c [term 7 FOLLOWER]: Refusing update from remote peer b7ab4784c7344b939bc36f639286f377: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:19:12.011143  6844 leader_election.cc:400] T c4db81d9d329422bb3b4160ca4ac2d1d P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 5 pre-election: Vote denied by peer b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817) with higher term. Message: Invalid argument: T c4db81d9d329422bb3b4160ca4ac2d1d P b7ab4784c7344b939bc36f639286f377 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c for earlier term 5. Current term is 6.
I20260709 13:19:12.018814  6844 leader_election.cc:403] T c4db81d9d329422bb3b4160ca4ac2d1d P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 5 pre-election: Cancelling election due to peer responding with higher term
W20260709 13:19:11.997898  9116 log.cc:927] Time spent T 427c124d773f483294511e80fe340075 P ccd8a4c3bfe3413cb2ae219b09aea832: Append to log took a long time: real 0.051s	user 0.001s	sys 0.000s
I20260709 13:19:11.987089  8938 raft_consensus.cc:515] T 3a485a995abc4807b6e511e45419f737 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:11.954494  8673 raft_consensus.cc:515] T f09c2a98de1a4decabd0ff900dd44caa P ccd8a4c3bfe3413cb2ae219b09aea832 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:11.999009  8793 raft_consensus.cc:2804] T 4275cf08e63345f993bce8664eada830 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:19:12.017467  6772 leader_election.cc:304] T 20f6842e26174571996b8dea4151d4be P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:19:11.938988  8986 raft_consensus.cc:515] T 404190ce4ce94cecbfcb6ea9d1dd8626 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:19:11.997402  9046 raft_consensus.cc:3060] T 34f36d59d88f40fe8a2805e604fc6c0a P b7ab4784c7344b939bc36f639286f377 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:19:12.043244  8574 raft_consensus.cc:2804] T 20f6842e26174571996b8dea4151d4be P b7ab4784c7344b939bc36f639286f377 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:19:12.044255  8827 raft_consensus.cc:515] T 7887766dc6784fcaa42b35c05fea7a99 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
W20260709 13:19:12.049705  6802 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:32966 (request call id 682) took 2942 ms (client timeout 1774 ms). Trace:
I20260709 13:19:12.050675  6726 raft_consensus.cc:1240] T 1bf4668eeb70467fb3dc5a0289233b3c P ccd8a4c3bfe3413cb2ae219b09aea832 [term 5 FOLLOWER]: Rejecting Update request from peer b7ab4784c7344b939bc36f639286f377 for earlier term 4. Current term is 5. Ops: []
I20260709 13:19:12.052922  6801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1528ab62b6fe4e3099d08f141afee116" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
W20260709 13:19:12.053947  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 80214.2us
I20260709 13:19:12.050561  6873 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.ChangeConfig from 127.0.0.1:53394 (request call id 66) took 1009 ms. Trace:
W20260709 13:19:12.034950  8797 consensus_meta.cc:287] T 711ef6523deb4cbe8ef2ba61e1c21c98 P ccd8a4c3bfe3413cb2ae219b09aea832: Time spent flushing consensus metadata: real 0.891s	user 0.003s	sys 0.010s
I20260709 13:19:12.016759  9099 raft_consensus.cc:2804] T 90d42e216d9741e190bca19a781291fd P b7ab4784c7344b939bc36f639286f377 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:19:12.054431  6873 rpcz_store.cc:276] 0709 13:19:11.036463 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:11.957243 (+920780us) service_pool.cc:224] Handling call
0709 13:19:12.045260 (+ 88017us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:12.016105  9050 raft_consensus.cc:493] T 7887766dc6784fcaa42b35c05fea7a99 P b7ab4784c7344b939bc36f639286f377 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:19:12.045814  8990 consensus_meta.cc:287] T 22ccee1b570c4ad3a57bd7aec085b1b4 P ccd8a4c3bfe3413cb2ae219b09aea832: Time spent flushing consensus metadata: real 0.854s	user 0.011s	sys 0.002s
I20260709 13:19:12.062858  6872 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53406 (request call id 1407) took 1446 ms. Trace:
W20260709 13:19:12.053021  6802 rpcz_store.cc:269] 0709 13:19:09.103735 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:09.522892 (+419157us) service_pool.cc:224] Handling call
0709 13:19:12.008618 (+2485726us) spinlock_profiling.cc:243] Waited 1.5 s on lock 0x7b54001a31d4. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f9ae2fa 00007fcc1496fb17 00007fcc0deea6d4 00007fcc0deea662 00007fcc0deea591 00007fcc0deea50c 00007fcc0dee97c2 00007fcc0dce548c 00007fcc0dce48c6 00007fcc0dce426f
0709 13:19:12.045642 (+ 37024us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3461479168}
I20260709 13:19:12.030649  9129 raft_consensus.cc:493] T 90d42e216d9741e190bca19a781291fd P ccd8a4c3bfe3413cb2ae219b09aea832 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:12.058283  6725 raft_consensus.cc:2468] T 711ef6523deb4cbe8ef2ba61e1c21c98 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 6.
I20260709 13:19:12.045840  8793 raft_consensus.cc:493] T 4275cf08e63345f993bce8664eada830 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:12.034296  9051 raft_consensus.cc:2749] T c4db81d9d329422bb3b4160ca4ac2d1d P cd75a17ab2604397adab03bb8b5fd75c [term 6 FOLLOWER]: Leader pre-election lost for term 5. Reason: Vote denied by peer b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817) with higher term. Message: Invalid argument: T c4db81d9d329422bb3b4160ca4ac2d1d P b7ab4784c7344b939bc36f639286f377 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c for earlier term 5. Current term is 6.
I20260709 13:19:12.068297  6807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c7f33e544204fbaac4078e3e83bbf4e" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:19:12.034017  9083 leader_election.cc:290] T b3f13b31a1f84f0d89d007eadd57924c P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 5 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:19:12.066013  6732 raft_consensus.cc:1240] T 404190ce4ce94cecbfcb6ea9d1dd8626 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 7 FOLLOWER]: Rejecting Update request from peer b7ab4784c7344b939bc36f639286f377 for earlier term 6. Current term is 7. Ops: []
I20260709 13:19:12.067214  6723 raft_consensus.cc:1275] T e31b9971c15848dea59d4d4130141d9e P ccd8a4c3bfe3413cb2ae219b09aea832 [term 4 FOLLOWER]: Refusing update from remote peer b7ab4784c7344b939bc36f639286f377: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:19:12.030639  8440 raft_consensus.cc:515] T 95a75bfe094d4bdc963aba3f08dfcd25 P b7ab4784c7344b939bc36f639286f377 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:12.071102  6726 raft_consensus.cc:1275] T 7c44c4849aa54f2b94d1f1bef9ed546f P ccd8a4c3bfe3413cb2ae219b09aea832 [term 7 FOLLOWER]: Refusing update from remote peer b7ab4784c7344b939bc36f639286f377: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:19:12.072167  8986 leader_election.cc:290] T 404190ce4ce94cecbfcb6ea9d1dd8626 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 7 election: Requested vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:19:12.081081  6697 leader_election.cc:304] T 1bf4668eeb70467fb3dc5a0289233b3c P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:19:12.058722  9043 leader_election.cc:290] T 7a734b5ab7834e05a8c422208acc58b1 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 6 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:19:12.066921  6731 raft_consensus.cc:2393] T 7887766dc6784fcaa42b35c05fea7a99 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7ab4784c7344b939bc36f639286f377 in current term 6: Already voted for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in this term.
I20260709 13:19:12.051887  8574 raft_consensus.cc:493] T 20f6842e26174571996b8dea4151d4be P b7ab4784c7344b939bc36f639286f377 [term 5 FOLLOWER]: Starting leader election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:19:12.056236  9079 leader_election.cc:290] T de3186201e1a40d0b335eeb8b4e256e0 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 6 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:12.063228  6872 rpcz_store.cc:276] 0709 13:19:10.629623 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:11.733538 (+1103915us) service_pool.cc:224] Handling call
0709 13:19:11.744132 (+ 10594us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:11.791983 (+ 47851us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:19:11.860374 (+ 68391us) log.cc:844] Serialized 14 byte log entry
0709 13:19:12.057120 (+196746us) log.cc:844] Serialized 14 byte log entry
0709 13:19:12.057429 (+   309us) log.cc:844] Serialized 14 byte log entry
0709 13:19:12.062534 (+  5105us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:12.062585 (+    51us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:19:12.062627 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:12.062697 (+    70us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:12.062809 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":47724,"prepare.run_cpu_time_us":43,"prepare.run_wall_time_us":44,"thread_start_us":185798,"threads_started":1}
I20260709 13:19:12.057964  9099 raft_consensus.cc:493] T 90d42e216d9741e190bca19a781291fd P b7ab4784c7344b939bc36f639286f377 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:12.044970  8862 consensus_queue.cc:1059] T bb7fa124c3bf4ef9ab65a407cb008441 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.053s
I20260709 13:19:12.097451  9071 raft_consensus.cc:515] T 7a734b5ab7834e05a8c422208acc58b1 P b7ab4784c7344b939bc36f639286f377 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:12.098367  6801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4275cf08e63345f993bce8664eada830" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:19:12.098423  9090 leader_election.cc:290] T 3fa34c08b205435dba97346991aa1f92 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 7 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:12.103266  6799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77e330a82df4b43a745d57a68f6f057" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:19:12.094920  6844 leader_election.cc:304] T 2c240553ce044eedb41541d72b9475d7 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:19:12.084458  8793 raft_consensus.cc:3060] T 4275cf08e63345f993bce8664eada830 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:12.104473  6803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be1a92657f494cac8dd227d152f50151" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:19:12.104871  6874 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53406 (request call id 1400) took 2243 ms. Trace:
I20260709 13:19:12.105034  6798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3411566abe2d4c9bb4b2adfdd05e6f17" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:19:12.108312  6697 leader_election.cc:304] T fe20b4b48823486ca3b9c648db6ce8aa P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:19:12.109234  9117 raft_consensus.cc:2804] T 1bf4668eeb70467fb3dc5a0289233b3c P ccd8a4c3bfe3413cb2ae219b09aea832 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:19:12.111445  6875 raft_consensus.cc:1275] T f4b8bd455d5a47c18a1380839c6e0d61 P cd75a17ab2604397adab03bb8b5fd75c [term 5 FOLLOWER]: Refusing update from remote peer ccd8a4c3bfe3413cb2ae219b09aea832: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:19:12.112002  6879 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53416 (request call id 2199) took 1091 ms. Trace:
I20260709 13:19:12.087208  8870 raft_consensus.cc:493] T 4f00a2e87e56452083b759f60d461ee3 P b7ab4784c7344b939bc36f639286f377 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:12.118866  7500 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50744 (request call id 175) took 3282 ms (client timeout 1770 ms). Trace:
W20260709 13:19:12.121915  6770 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 622653us
I20260709 13:19:12.063915  9050 raft_consensus.cc:3060] T 7887766dc6784fcaa42b35c05fea7a99 P b7ab4784c7344b939bc36f639286f377 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:12.143800  6803 raft_consensus.cc:2368] T be1a92657f494cac8dd227d152f50151 P b7ab4784c7344b939bc36f639286f377 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 6. Current term is 7.
I20260709 13:19:12.092157  8574 raft_consensus.cc:3060] T 20f6842e26174571996b8dea4151d4be P b7ab4784c7344b939bc36f639286f377 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:19:12.149294  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 54511.7us
I20260709 13:19:12.075824  8940 leader_election.cc:290] T f09c2a98de1a4decabd0ff900dd44caa P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:12.133441  6806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c37d41cd9164c15a6826ca62a851a69" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:19:12.070057  9129 raft_consensus.cc:3060] T 90d42e216d9741e190bca19a781291fd P ccd8a4c3bfe3413cb2ae219b09aea832 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:12.188931  6726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24ee15416e3145beaa1b8183453729a3" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:19:12.189785  6726 raft_consensus.cc:2468] T 24ee15416e3145beaa1b8183453729a3 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in term 5.
W20260709 13:19:12.142277  7500 rpcz_store.cc:269] 0709 13:19:08.836774 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:08.884150 (+ 47376us) service_pool.cc:224] Handling call
0709 13:19:12.118579 (+3234429us) spinlock_profiling.cc:243] Waited 2.85 s on lock 0x7b54004957d4. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f9ae2fa 00007fcc1496fb17 00007fcc0deea6d4 00007fcc0deea662 00007fcc0deea591 00007fcc0deea50c 00007fcc0dee97c2 00007fcc0dce548c 00007fcc0dce48c6 00007fcc0dce426f
0709 13:19:12.118767 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6550926080}
W20260709 13:19:12.123543  6772 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 79103.3us
I20260709 13:19:12.191220  6772 leader_election.cc:304] T 4d9def8b32fd443aa94ab1420b06837b P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:19:12.158100  9071 leader_election.cc:290] T 7a734b5ab7834e05a8c422208acc58b1 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 6 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:12.134545  6874 rpcz_store.cc:276] 0709 13:19:09.861822 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:11.510974 (+1649152us) service_pool.cc:224] Handling call
0709 13:19:11.540695 (+ 29721us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:11.597780 (+ 57085us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:11.597822 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:11.650390 (+ 52568us) spinlock_profiling.cc:243] Waited 51.3 ms on lock 0x7b4800210258. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc148d3aa1 00007fcc148cab37 00007fcc148ca9ca 00007fcc149c226f 00007fcc149c1f37 00007fcc149d655c 00007fcc149d6508 00007fcc149d6488 00007fcc149d6443 00007fcc149d56ec 00007fcc138ffa96
0709 13:19:11.738557 (+ 88167us) log.cc:844] Serialized 26 byte log entry
0709 13:19:11.965079 (+226522us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:19:11.965150 (+    71us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:11.965289 (+   139us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:12.104517 (+139228us) raft_consensus.cc:1685] finished
0709 13:19:12.104548 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:12.104778 (+   230us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8214,"raft.queue_time_us":13347,"raft.run_cpu_time_us":2812,"raft.run_wall_time_us":53893,"spinlock_wait_cycles":118010112,"thread_start_us":160953,"threads_started":1,"wal-append.queue_time_us":297443}
W20260709 13:19:12.160429  6697 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.68:45071, user_credentials={real_user=slave}} blocked reactor thread for 52190.2us
I20260709 13:19:12.192824  6723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3f13b31a1f84f0d89d007eadd57924c" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:19:12.197045  6806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e31b9971c15848dea59d4d4130141d9e" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:19:12.149113  6799 raft_consensus.cc:2468] T e77e330a82df4b43a745d57a68f6f057 P b7ab4784c7344b939bc36f639286f377 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 7.
I20260709 13:19:12.127213  9099 raft_consensus.cc:3060] T 90d42e216d9741e190bca19a781291fd P b7ab4784c7344b939bc36f639286f377 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:12.150372  6801 raft_consensus.cc:2468] T 4275cf08e63345f993bce8664eada830 P b7ab4784c7344b939bc36f639286f377 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 5.
I20260709 13:19:12.166195  6803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab432e62819d499eaaf3dd55481dd930" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:19:12.068279  8990 raft_consensus.cc:515] T 22ccee1b570c4ad3a57bd7aec085b1b4 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:12.166656  6727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90d42e216d9741e190bca19a781291fd" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:19:12.167795  6798 raft_consensus.cc:3060] T 3411566abe2d4c9bb4b2adfdd05e6f17 P b7ab4784c7344b939bc36f639286f377 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:19:12.168145  6771 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:12.119143  9036 raft_consensus.cc:515] T bb3d8792045a4583ae2e965b1350a5b4 P cd75a17ab2604397adab03bb8b5fd75c [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:19:12.169283  9051 raft_consensus.cc:2804] T 2c240553ce044eedb41541d72b9475d7 P cd75a17ab2604397adab03bb8b5fd75c [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:19:12.169227  9044 raft_consensus.cc:515] T d8cee0accdb8499c86d4414b72565a38 P cd75a17ab2604397adab03bb8b5fd75c [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:19:12.169943  8767 raft_consensus.cc:2749] T fe20b4b48823486ca3b9c648db6ce8aa P ccd8a4c3bfe3413cb2ae219b09aea832 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:19:12.184530  6695 leader_election.cc:304] T bd6869f07b5a4885a0b99fbe60c3b175 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:19:12.193014  6697 leader_election.cc:400] T be1a92657f494cac8dd227d152f50151 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 6 pre-election: Vote denied by peer 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071) with higher term. Message: Invalid argument: T be1a92657f494cac8dd227d152f50151 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 6. Current term is 7.
I20260709 13:19:12.222344  6697 leader_election.cc:403] T be1a92657f494cac8dd227d152f50151 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 6 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:19:12.160640  9117 raft_consensus.cc:697] T 1bf4668eeb70467fb3dc5a0289233b3c P ccd8a4c3bfe3413cb2ae219b09aea832 [term 5 LEADER]: Becoming Leader. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
I20260709 13:19:12.212352  6804 raft_consensus.cc:2393] T 7a734b5ab7834e05a8c422208acc58b1 P b7ab4784c7344b939bc36f639286f377 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ccd8a4c3bfe3413cb2ae219b09aea832 in current term 6: Already voted for candidate b7ab4784c7344b939bc36f639286f377 in this term.
I20260709 13:19:12.142091  6879 rpcz_store.cc:276] 0709 13:19:11.020675 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:11.737952 (+717277us) service_pool.cc:224] Handling call
0709 13:19:11.757020 (+ 19068us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:11.808285 (+ 51265us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:11.808317 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:11.829527 (+ 21210us) log.cc:844] Serialized 26 byte log entry
0709 13:19:11.937038 (+107511us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:19:11.937118 (+    80us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:11.956569 (+ 19451us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:12.111752 (+155183us) raft_consensus.cc:1685] finished
0709 13:19:12.111777 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:12.111929 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":11722,"raft.run_cpu_time_us":134,"raft.run_wall_time_us":13315,"thread_start_us":73565,"threads_started":1,"wal-append.queue_time_us":224855}
I20260709 13:19:12.213426  6799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24ee15416e3145beaa1b8183453729a3" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:19:12.168285  8870 raft_consensus.cc:515] T 4f00a2e87e56452083b759f60d461ee3 P b7ab4784c7344b939bc36f639286f377 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:19:12.219383  6772 leader_election.cc:304] T b56bf91d90824c959e21e0cee5ba1816 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:19:12.225507  6723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fa34c08b205435dba97346991aa1f92" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:19:12.229987  6723 raft_consensus.cc:3060] T 3fa34c08b205435dba97346991aa1f92 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:12.230237  6806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3f13b31a1f84f0d89d007eadd57924c" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:19:12.234707  6872 raft_consensus.cc:1240] T bb3d8792045a4583ae2e965b1350a5b4 P cd75a17ab2604397adab03bb8b5fd75c [term 5 FOLLOWER]: Rejecting Update request from peer ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 4. Current term is 5. Ops: []
I20260709 13:19:12.237888  6803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "853ac0a8cbd64ce99457f170216d4d0f" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:19:12.225106  8862 raft_consensus.cc:2804] T 4d9def8b32fd443aa94ab1420b06837b P b7ab4784c7344b939bc36f639286f377 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:19:12.245954  6801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "404190ce4ce94cecbfcb6ea9d1dd8626" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:19:12.247098  6725 raft_consensus.cc:1275] T fe20b4b48823486ca3b9c648db6ce8aa P ccd8a4c3bfe3413cb2ae219b09aea832 [term 3 FOLLOWER]: Refusing update from remote peer 7ba59cc884714e8aa5f3f0ecaed84cbb: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:19:12.242084  6799 raft_consensus.cc:2468] T 24ee15416e3145beaa1b8183453729a3 P b7ab4784c7344b939bc36f639286f377 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in term 5.
I20260709 13:19:12.240661  6731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "713b5728a197487c9300b310ab94e5a3" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:19:12.222519  9051 raft_consensus.cc:493] T 2c240553ce044eedb41541d72b9475d7 P cd75a17ab2604397adab03bb8b5fd75c [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:12.252985  7500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fa34c08b205435dba97346991aa1f92" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:19:12.275113  7503 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50744 (request call id 177) took 1650 ms. Trace:
I20260709 13:19:12.404723  6731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20f6842e26174571996b8dea4151d4be" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:19:12.274716  6801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ba5dac66ab5497e9e336f2a3c28cda5" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:19:12.402446  6730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22ccee1b570c4ad3a57bd7aec085b1b4" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:19:12.399693  6724 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49998 (request call id 680) took 1768 ms. Trace:
W20260709 13:19:12.382262  6770 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 100359us
I20260709 13:19:12.243938  6844 leader_election.cc:304] T 24ee15416e3145beaa1b8183453729a3 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb
I20260709 13:19:12.240265  8797 raft_consensus.cc:2749] T bd6869f07b5a4885a0b99fbe60c3b175 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:19:12.262732  6695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 78329.6us
I20260709 13:19:12.254698  6728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1528ab62b6fe4e3099d08f141afee116" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:19:12.256529  6799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a734b5ab7834e05a8c422208acc58b1" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:19:12.257599  6803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8292e16e5654be6bc408560cf256aaa" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:19:12.405061  7503 rpcz_store.cc:276] 0709 13:19:10.624609 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:10.624980 (+   371us) service_pool.cc:224] Handling call
0709 13:19:10.627454 (+  2474us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:11.584496 (+957042us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:12.270174 (+685678us) spinlock_profiling.cc:243] Waited 815 ms on lock 0x7b54004691d4. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f9aae01 00007fcc0f9a983e 00007fcc1496e419 00007fcc0dee5bd4 00007fcc0dee5b62 00007fcc0dee5a91 00007fcc0dee5a0c 00007fcc0dee4cc2 00007fcc0dce548c 00007fcc0dce48c6
0709 13:19:12.275029 (+  4855us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1873826176}
I20260709 13:19:12.257112  8973 raft_consensus.cc:493] T bb7fa124c3bf4ef9ab65a407cb008441 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:19:12.246001  8940 raft_consensus.cc:2804] T b56bf91d90824c959e21e0cee5ba1816 P b7ab4784c7344b939bc36f639286f377 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:19:12.243309  9122 raft_consensus.cc:2749] T be1a92657f494cac8dd227d152f50151 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 7 FOLLOWER]: Leader pre-election lost for term 6. Reason: Vote denied by peer 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071) with higher term. Message: Invalid argument: T be1a92657f494cac8dd227d152f50151 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 6. Current term is 7.
I20260709 13:19:12.263816  9117 consensus_queue.cc:237] T 1bf4668eeb70467fb3dc5a0289233b3c P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:12.249338  8862 raft_consensus.cc:493] T 4d9def8b32fd443aa94ab1420b06837b P b7ab4784c7344b939bc36f639286f377 [term 5 FOLLOWER]: Starting leader election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:19:12.261471  7466 leader_election.cc:304] T 24ee15416e3145beaa1b8183453729a3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
I20260709 13:19:12.275530  6805 raft_consensus.cc:1275] T 95a75bfe094d4bdc963aba3f08dfcd25 P b7ab4784c7344b939bc36f639286f377 [term 7 FOLLOWER]: Refusing update from remote peer ccd8a4c3bfe3413cb2ae219b09aea832: Log matching property violated. Preceding OpId in replica: term: 6 index: 2. Preceding OpId from leader: term: 7 index: 2. (term mismatch)
I20260709 13:19:12.441628  6805 pending_rounds.cc:85] T 95a75bfe094d4bdc963aba3f08dfcd25 P b7ab4784c7344b939bc36f639286f377: Aborting all ops after (but not including) 1
I20260709 13:19:12.258515  6806 raft_consensus.cc:3060] T b3f13b31a1f84f0d89d007eadd57924c P b7ab4784c7344b939bc36f639286f377 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:19:12.442216  6879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44bde925b2e541b69890d70715b85176" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 7 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:19:12.442010  6805 pending_rounds.cc:107] T 95a75bfe094d4bdc963aba3f08dfcd25 P b7ab4784c7344b939bc36f639286f377: Aborting uncommitted NO_OP operation due to leader change: 6.2
I20260709 13:19:12.401254  7496 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50756 (request call id 161) took 3095 ms. Trace:
I20260709 13:19:12.408492  6730 raft_consensus.cc:2393] T 22ccee1b570c4ad3a57bd7aec085b1b4 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7ab4784c7344b939bc36f639286f377 in current term 5: Already voted for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in this term.
I20260709 13:19:12.424141  6799 raft_consensus.cc:2393] T 7a734b5ab7834e05a8c422208acc58b1 P b7ab4784c7344b939bc36f639286f377 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate ccd8a4c3bfe3413cb2ae219b09aea832 in current term 6: Already voted for candidate b7ab4784c7344b939bc36f639286f377 in this term.
I20260709 13:19:12.405710  6801 raft_consensus.cc:2468] T 7ba5dac66ab5497e9e336f2a3c28cda5 P b7ab4784c7344b939bc36f639286f377 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in term 6.
W20260709 13:19:12.274945  6800 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:32966 (request call id 678) took 3172 ms (client timeout 1549 ms). Trace:
I20260709 13:19:12.446857  9120 raft_consensus.cc:2804] T 24ee15416e3145beaa1b8183453729a3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:19:12.447373  9120 raft_consensus.cc:493] T 24ee15416e3145beaa1b8183453729a3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:12.447754  9120 raft_consensus.cc:3060] T 24ee15416e3145beaa1b8183453729a3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:12.460000  6880 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53406 (request call id 1406) took 1844 ms. Trace:
I20260709 13:19:12.460474  6880 rpcz_store.cc:276] 0709 13:19:10.615665 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:11.637350 (+1021685us) service_pool.cc:224] Handling call
0709 13:19:11.936520 (+299170us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:19:11.960557 (+ 24037us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:12.459771 (+499214us) spinlock_profiling.cc:243] Waited 299 ms on lock 0x7b5400065ed0. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f9a98ad 00007fcc1496e419 00007fcc0dee5bd4 00007fcc0dee5b62 00007fcc0dee5a91 00007fcc0dee5a0c 00007fcc0dee4cc2 00007fcc0dce548c 00007fcc0dce48c6 00007fcc0dce426f
0709 13:19:12.459920 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":687192448}
I20260709 13:19:12.465096  9044 leader_election.cc:290] T d8cee0accdb8499c86d4414b72565a38 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 6 election: Requested vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:19:12.433920  9038 raft_consensus.cc:2804] T 24ee15416e3145beaa1b8183453729a3 P cd75a17ab2604397adab03bb8b5fd75c [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:19:12.414008  6697 leader_election.cc:304] T f58dc08b12a2494bb9a1372837970ca2 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:19:12.427591  6726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d9def8b32fd443aa94ab1420b06837b" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:19:12.429828  6731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "427c124d773f483294511e80fe340075" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:19:12.435101  6804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f58dc08b12a2494bb9a1372837970ca2" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:19:12.406308  6724 rpcz_store.cc:276] 0709 13:19:10.641611 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:10.664238 (+ 22627us) service_pool.cc:224] Handling call
0709 13:19:10.664786 (+   548us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:10.924893 (+260107us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:19:11.193774 (+268881us) log.cc:844] Serialized 14 byte log entry
0709 13:19:11.440552 (+246778us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:11.440637 (+    85us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:19:11.440718 (+    81us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:12.399124 (+958406us) spinlock_profiling.cc:243] Waited 71.9 ms on lock 0x7b5400407254. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f9aae01 00007fcc0f9a983e 00007fcc1496e419 00007fcc0dee5bd4 00007fcc0dee5b62 00007fcc0dee5a91 00007fcc0dee5a0c 00007fcc0dee4cc2 00007fcc0dce548c 00007fcc0dce48c6
0709 13:19:12.399245 (+   121us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:12.399447 (+   202us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":23354,"prepare.queue_time_us":248591,"prepare.run_cpu_time_us":50,"prepare.run_wall_time_us":52,"raft.queue_time_us":55768,"raft.run_cpu_time_us":177,"raft.run_wall_time_us":12692,"spinlock_wait_cycles":165344128,"thread_start_us":293471,"threads_started":2,"wal-append.queue_time_us":560296}
I20260709 13:19:12.258810  9065 raft_consensus.cc:493] T 07a92dd554674067a83a9cb68c4773f2 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:12.257560  8990 leader_election.cc:290] T 22ccee1b570c4ad3a57bd7aec085b1b4 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 5 election: Requested vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:12.249226  9051 raft_consensus.cc:3060] T 2c240553ce044eedb41541d72b9475d7 P cd75a17ab2604397adab03bb8b5fd75c [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:12.439582  6874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a734b5ab7834e05a8c422208acc58b1" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:19:12.443763  6805 raft_consensus.cc:2889] T 95a75bfe094d4bdc963aba3f08dfcd25 P b7ab4784c7344b939bc36f639286f377 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:19:12.410760  6847 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:12.484895  6731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1704639a875409b9959353527b3fd68" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:19:12.442070  6878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8292e16e5654be6bc408560cf256aaa" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:19:12.429824  9043 raft_consensus.cc:493] T ce4f062dcd314d43a63ca74067cb5ee3 P cd75a17ab2604397adab03bb8b5fd75c [term 6 FOLLOWER]: Starting pre-election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:19:12.442555  6872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fa34c08b205435dba97346991aa1f92" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:19:12.486303  6874 raft_consensus.cc:2393] T 7a734b5ab7834e05a8c422208acc58b1 P cd75a17ab2604397adab03bb8b5fd75c [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate ccd8a4c3bfe3413cb2ae219b09aea832 in current term 6: Already voted for candidate cd75a17ab2604397adab03bb8b5fd75c in this term.
I20260709 13:19:12.445283  6728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f9c2e2bf644115957398fe4c9459db" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
W20260709 13:19:12.446089  7466 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 184716us
I20260709 13:19:12.451898  8673 leader_election.cc:290] T f09c2a98de1a4decabd0ff900dd44caa P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:12.453387  6877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e31b9971c15848dea59d4d4130141d9e" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:19:12.455104  6876 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53416 (request call id 2202) took 1433 ms. Trace:
I20260709 13:19:12.456276  9137 consensus_queue.cc:1048] T f58dc08b12a2494bb9a1372837970ca2 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:19:12.459002  6806 raft_consensus.cc:2468] T b3f13b31a1f84f0d89d007eadd57924c P b7ab4784c7344b939bc36f639286f377 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in term 5.
I20260709 13:19:12.459460  8870 leader_election.cc:290] T 4f00a2e87e56452083b759f60d461ee3 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:19:12.459739  6799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44bde925b2e541b69890d70715b85176" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 7 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:19:12.420409  6803 raft_consensus.cc:2393] T d8292e16e5654be6bc408560cf256aaa P b7ab4784c7344b939bc36f639286f377 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ccd8a4c3bfe3413cb2ae219b09aea832 in current term 7: Already voted for candidate b7ab4784c7344b939bc36f639286f377 in this term.
W20260709 13:19:12.446580  6800 rpcz_store.cc:269] 0709 13:19:09.102848 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:09.300428 (+197580us) service_pool.cc:224] Handling call
0709 13:19:12.270227 (+2969799us) spinlock_profiling.cc:243] Waited 2.64 s on lock 0x7b54003309d4. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f9ae2fa 00007fcc1496fb17 00007fcc0deea6d4 00007fcc0deea662 00007fcc0deea591 00007fcc0deea50c 00007fcc0dee97c2 00007fcc0dce548c 00007fcc0dce48c6 00007fcc0dce426f
0709 13:19:12.274858 (+  4631us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6062930816}
I20260709 13:19:12.446722  6695 leader_election.cc:304] T f5be3a11b23d4ea9b08300a2789821c7 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
W20260709 13:19:12.479938  6697 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 66035.8us
I20260709 13:19:12.443549  8862 raft_consensus.cc:3060] T 4d9def8b32fd443aa94ab1420b06837b P b7ab4784c7344b939bc36f639286f377 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:12.491667  6876 rpcz_store.cc:276] 0709 13:19:11.021550 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:11.824922 (+803372us) service_pool.cc:224] Handling call
0709 13:19:11.847189 (+ 22267us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:11.972665 (+125476us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:11.972697 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:12.014448 (+ 41751us) log.cc:844] Serialized 26 byte log entry
0709 13:19:12.205632 (+191184us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:19:12.205697 (+    65us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:12.205802 (+   105us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:12.454853 (+249051us) raft_consensus.cc:1685] finished
0709 13:19:12.454879 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:12.455036 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":12321,"raft.run_cpu_time_us":184,"raft.run_wall_time_us":22403,"thread_start_us":138965,"threads_started":1,"wal-append.queue_time_us":219330}
I20260709 13:19:12.482496  6772 leader_election.cc:304] T 713b5728a197487c9300b310ab94e5a3 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:19:12.432965  8940 raft_consensus.cc:493] T b56bf91d90824c959e21e0cee5ba1816 P b7ab4784c7344b939bc36f639286f377 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:12.476923  7503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8cee0accdb8499c86d4414b72565a38" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb"
I20260709 13:19:12.411273  9050 raft_consensus.cc:515] T 7887766dc6784fcaa42b35c05fea7a99 P b7ab4784c7344b939bc36f639286f377 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:12.481041  6730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b56bf91d90824c959e21e0cee5ba1816" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:19:12.476656  8827 leader_election.cc:290] T 7887766dc6784fcaa42b35c05fea7a99 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 6 election: Requested vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:12.444934  8973 raft_consensus.cc:515] T bb7fa124c3bf4ef9ab65a407cb008441 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:19:12.472913  9038 raft_consensus.cc:697] T 24ee15416e3145beaa1b8183453729a3 P cd75a17ab2604397adab03bb8b5fd75c [term 5 LEADER]: Becoming Leader. State: Replica: cd75a17ab2604397adab03bb8b5fd75c, State: Running, Role: LEADER
I20260709 13:19:12.434266  8892 consensus_queue.cc:1048] T 2c240553ce044eedb41541d72b9475d7 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.047s
I20260709 13:19:12.504690  7500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "404190ce4ce94cecbfcb6ea9d1dd8626" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb"
I20260709 13:19:12.485774  9100 raft_consensus.cc:2804] T f58dc08b12a2494bb9a1372837970ca2 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:19:12.505113  6728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be1a92657f494cac8dd227d152f50151" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:19:12.505748  7466 leader_election.cc:304] T 7ba5dac66ab5497e9e336f2a3c28cda5 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, b7ab4784c7344b939bc36f639286f377; no voters: 
I20260709 13:19:12.514427  6697 leader_election.cc:304] T 3411566abe2d4c9bb4b2adfdd05e6f17 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:19:12.516145  7500 raft_consensus.cc:3060] T 404190ce4ce94cecbfcb6ea9d1dd8626 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:12.488279  9065 raft_consensus.cc:515] T 07a92dd554674067a83a9cb68c4773f2 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:12.525285  8973 leader_election.cc:290] T bb7fa124c3bf4ef9ab65a407cb008441 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:12.525484  7498 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50756 (request call id 162) took 3211 ms. Trace:
I20260709 13:19:12.565517  9046 raft_consensus.cc:515] T 34f36d59d88f40fe8a2805e604fc6c0a P b7ab4784c7344b939bc36f639286f377 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:12.575362  7498 rpcz_store.cc:276] 0709 13:19:09.310452 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:09.321013 (+ 10561us) service_pool.cc:224] Handling call
0709 13:19:10.344083 (+1023070us) spinlock_profiling.cc:243] Waited 6.24 ms on lock 0x7b5800123f98. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0c745db1 00007fcc0c885b71 00007fcc0c885a22 00007fcc1579ec09 00007fcc148f8ee0 00007fcc149c20ab 00007fcc149c2131 00007fcc14983fc0 00007fcc1496e929 00007fcc1496e3d2 00007fcc0dee5bd4
0709 13:19:10.344434 (+   351us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:11.876085 (+1531651us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:12.493853 (+617768us) spinlock_profiling.cc:243] Waited 1.53 s on lock 0x7b54001ec8d4. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f9aae01 00007fcc0f9a983e 00007fcc1496e419 00007fcc0dee5bd4 00007fcc0dee5b62 00007fcc0dee5a91 00007fcc0dee5a0c 00007fcc0dee4cc2 00007fcc0dce548c 00007fcc0dce48c6
0709 13:19:12.521306 (+ 27453us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3534134912}
I20260709 13:19:12.576256  8827 raft_consensus.cc:2804] T 3411566abe2d4c9bb4b2adfdd05e6f17 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:19:12.563369  8793 raft_consensus.cc:515] T 4275cf08e63345f993bce8664eada830 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:12.526832  9050 leader_election.cc:290] T 7887766dc6784fcaa42b35c05fea7a99 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 6 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:12.577001  8827 raft_consensus.cc:697] T 3411566abe2d4c9bb4b2adfdd05e6f17 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 5 LEADER]: Becoming Leader. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
I20260709 13:19:12.562606  6799 raft_consensus.cc:1240] T de3186201e1a40d0b335eeb8b4e256e0 P b7ab4784c7344b939bc36f639286f377 [term 6 FOLLOWER]: Rejecting Update request from peer ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 5. Current term is 6. Ops: []
I20260709 13:19:12.578088  8827 consensus_queue.cc:237] T 3411566abe2d4c9bb4b2adfdd05e6f17 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:12.578575  9065 leader_election.cc:290] T 07a92dd554674067a83a9cb68c4773f2 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:12.578800  9046 leader_election.cc:290] T 34f36d59d88f40fe8a2805e604fc6c0a P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 4 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:12.503961  8673 raft_consensus.cc:2749] T f5be3a11b23d4ea9b08300a2789821c7 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:19:12.538434  6806 raft_consensus.cc:1275] T 4f00a2e87e56452083b759f60d461ee3 P b7ab4784c7344b939bc36f639286f377 [term 6 FOLLOWER]: Refusing update from remote peer 7ba59cc884714e8aa5f3f0ecaed84cbb: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 7. (term mismatch)
W20260709 13:19:12.541318  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 320562us
W20260709 13:19:12.599661  6695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 163462us
I20260709 13:19:12.606170  6806 pending_rounds.cc:85] T 4f00a2e87e56452083b759f60d461ee3 P b7ab4784c7344b939bc36f639286f377: Aborting all ops after (but not including) 6
I20260709 13:19:12.606670  6806 pending_rounds.cc:107] T 4f00a2e87e56452083b759f60d461ee3 P b7ab4784c7344b939bc36f639286f377: Aborting uncommitted NO_OP operation due to leader change: 5.7
I20260709 13:19:12.505856  8940 raft_consensus.cc:3060] T b56bf91d90824c959e21e0cee5ba1816 P b7ab4784c7344b939bc36f639286f377 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:12.607251  6806 raft_consensus.cc:2889] T 4f00a2e87e56452083b759f60d461ee3 P b7ab4784c7344b939bc36f639286f377 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:19:12.601467  6728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f03d0dbf16864ca4bc1bb5e4c0334c0f" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
W20260709 13:19:12.563221  9141 log.cc:927] Time spent T 00000000000000000000000000000000 P b3ae52d33b9a4273a42e5e2cf3b5d6b5: Append to log took a long time: real 0.153s	user 0.002s	sys 0.000s
W20260709 13:19:12.602242  7466 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 96593.6us
I20260709 13:19:12.581297  6697 leader_election.cc:304] T ab432e62819d499eaaf3dd55481dd930 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:19:12.522202  9100 raft_consensus.cc:493] T f58dc08b12a2494bb9a1372837970ca2 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:12.516219  9137 consensus_queue.cc:1243] T f58dc08b12a2494bb9a1372837970ca2 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Peer cd75a17ab2604397adab03bb8b5fd75c log is divergent from this leader: its last log entry 4.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260709 13:19:12.615473  7466 leader_election.cc:304] T b3f13b31a1f84f0d89d007eadd57924c P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, b7ab4784c7344b939bc36f639286f377; no voters: ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:19:12.562361  8347 raft_consensus.cc:2804] T 713b5728a197487c9300b310ab94e5a3 P b7ab4784c7344b939bc36f639286f377 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:19:12.578725  8793 leader_election.cc:290] T 4275cf08e63345f993bce8664eada830 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 6 election: Requested vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
W20260709 13:19:12.624452  6697 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 85498.5us
I20260709 13:19:12.627511  6723 raft_consensus.cc:2468] T 3fa34c08b205435dba97346991aa1f92 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in term 7.
I20260709 13:19:12.611457  9127 raft_consensus.cc:2804] T 7ba5dac66ab5497e9e336f2a3c28cda5 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:19:12.628511  6728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3411566abe2d4c9bb4b2adfdd05e6f17" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
W20260709 13:19:12.636821  6616 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 24ee15416e3145beaa1b8183453729a3 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER failed with leader cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica cd75a17ab2604397adab03bb8b5fd75c is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 5 committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } attrs { replace: true } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } } }
I20260709 13:19:12.637593  6732 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50004 (request call id 1305) took 1573 ms. Trace:
I20260709 13:19:12.638228  6731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e326172347f45e99a0d482b5d8ef768" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:19:12.639092  6730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a734b5ab7834e05a8c422208acc58b1" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:19:12.639840  6730 raft_consensus.cc:2393] T 7a734b5ab7834e05a8c422208acc58b1 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate b7ab4784c7344b939bc36f639286f377 in current term 6: Already voted for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in this term.
I20260709 13:19:12.640352  6726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17587d6730594da4a56fa13a353232a1" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:19:12.638053  6732 rpcz_store.cc:276] 0709 13:19:11.063924 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:11.065272 (+  1348us) service_pool.cc:224] Handling call
0709 13:19:11.065845 (+   573us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:12.082176 (+1016331us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:12.637342 (+555166us) spinlock_profiling.cc:243] Waited 995 ms on lock 0x7b5400394ed4. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f9aae01 00007fcc0f9a983e 00007fcc1496e419 00007fcc0dee5bd4 00007fcc0dee5b62 00007fcc0dee5a91 00007fcc0dee5a0c 00007fcc0dee4cc2 00007fcc0dce548c 00007fcc0dce48c6
0709 13:19:12.637525 (+   183us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2289443712}
I20260709 13:19:12.620879  8347 raft_consensus.cc:493] T 713b5728a197487c9300b310ab94e5a3 P b7ab4784c7344b939bc36f639286f377 [term 5 FOLLOWER]: Starting leader election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:19:12.645742  6695 leader_election.cc:304] T d33d5ee8ef6f415593d8df52063161ad P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:19:12.611310  8574 raft_consensus.cc:515] T 20f6842e26174571996b8dea4151d4be P b7ab4784c7344b939bc36f639286f377 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:12.620373  9100 raft_consensus.cc:3060] T f58dc08b12a2494bb9a1372837970ca2 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:12.651960  6806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb7fa124c3bf4ef9ab65a407cb008441" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:19:12.526492  9129 raft_consensus.cc:515] T 90d42e216d9741e190bca19a781291fd P ccd8a4c3bfe3413cb2ae219b09aea832 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:12.657298  6724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de3186201e1a40d0b335eeb8b4e256e0" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:19:12.525856  9038 consensus_queue.cc:237] T 24ee15416e3145beaa1b8183453729a3 P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 5, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } attrs { replace: true } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:19:12.672255  9044 raft_consensus.cc:493] T 7c37d41cd9164c15a6826ca62a851a69 P cd75a17ab2604397adab03bb8b5fd75c [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:19:12.673105  9044 raft_consensus.cc:515] T 7c37d41cd9164c15a6826ca62a851a69 P cd75a17ab2604397adab03bb8b5fd75c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:12.631311  8673 raft_consensus.cc:2804] T ab432e62819d499eaaf3dd55481dd930 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:19:12.677353  9031 raft_consensus.cc:3055] T bb7fa124c3bf4ef9ab65a407cb008441 P b7ab4784c7344b939bc36f639286f377 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:19:12.677524  6725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24ee15416e3145beaa1b8183453729a3" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:19:12.677850  9031 raft_consensus.cc:740] T bb7fa124c3bf4ef9ab65a407cb008441 P b7ab4784c7344b939bc36f639286f377 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
I20260709 13:19:12.678393  6725 raft_consensus.cc:2393] T 24ee15416e3145beaa1b8183453729a3 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7ab4784c7344b939bc36f639286f377 in current term 5: Already voted for candidate cd75a17ab2604397adab03bb8b5fd75c in this term.
I20260709 13:19:12.681011  6723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09c2a98de1a4decabd0ff900dd44caa" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:19:12.682034  6723 raft_consensus.cc:2468] T f09c2a98de1a4decabd0ff900dd44caa P ccd8a4c3bfe3413cb2ae219b09aea832 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 6.
I20260709 13:19:12.521926  9043 raft_consensus.cc:515] T ce4f062dcd314d43a63ca74067cb5ee3 P cd75a17ab2604397adab03bb8b5fd75c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } attrs { replace: true } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:19:12.646337  7498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3d8792045a4583ae2e965b1350a5b4" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb"
I20260709 13:19:12.631572  9127 raft_consensus.cc:493] T 7ba5dac66ab5497e9e336f2a3c28cda5 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:12.646281  8862 raft_consensus.cc:515] T 4d9def8b32fd443aa94ab1420b06837b P b7ab4784c7344b939bc36f639286f377 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:12.696986  9127 raft_consensus.cc:3060] T 7ba5dac66ab5497e9e336f2a3c28cda5 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:12.666239  9060 consensus_queue.cc:1048] T f4b8bd455d5a47c18a1380839c6e0d61 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:19:12.666926  6732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c240553ce044eedb41541d72b9475d7" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:19:12.668269  9090 raft_consensus.cc:2804] T b3f13b31a1f84f0d89d007eadd57924c P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:19:12.638242  8938 leader_election.cc:290] T 3a485a995abc4807b6e511e45419f737 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 5 election: Requested vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:12.675768  9044 leader_election.cc:290] T 7c37d41cd9164c15a6826ca62a851a69 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:19:12.663060  7466 leader_election.cc:304] T 3fa34c08b205435dba97346991aa1f92 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
I20260709 13:19:12.646541  9050 raft_consensus.cc:493] T 9b3759de40694069b13c0f8bd40e5709 P b7ab4784c7344b939bc36f639286f377 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:12.715512  6727 raft_consensus.cc:2393] T 90d42e216d9741e190bca19a781291fd P ccd8a4c3bfe3413cb2ae219b09aea832 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7ab4784c7344b939bc36f639286f377 in current term 7: Already voted for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in this term.
I20260709 13:19:12.692234  9126 consensus_queue.cc:1048] T fe20b4b48823486ca3b9c648db6ce8aa P 7ba59cc884714e8aa5f3f0ecaed84cbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.189s
I20260709 13:19:12.695760  8673 raft_consensus.cc:697] T ab432e62819d499eaaf3dd55481dd930 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 7 LEADER]: Becoming Leader. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
I20260709 13:19:12.696102  8793 consensus_queue.cc:1048] T 95a75bfe094d4bdc963aba3f08dfcd25 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.009s
I20260709 13:19:12.669343  8845 raft_consensus.cc:493] T d33d5ee8ef6f415593d8df52063161ad P cd75a17ab2604397adab03bb8b5fd75c [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:19:12.701783  6804 raft_consensus.cc:1240] T 20f6842e26174571996b8dea4151d4be P b7ab4784c7344b939bc36f639286f377 [term 6 FOLLOWER]: Rejecting Update request from peer ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 5. Current term is 6. Ops: []
W20260709 13:19:12.702271  6695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 56665.1us
I20260709 13:19:12.699198  8862 leader_election.cc:290] T 4d9def8b32fd443aa94ab1420b06837b P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 6 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:12.708019  6725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8292e16e5654be6bc408560cf256aaa" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:19:12.648314  8347 raft_consensus.cc:3060] T 713b5728a197487c9300b310ab94e5a3 P b7ab4784c7344b939bc36f639286f377 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:12.722817  6723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f9c2e2bf644115957398fe4c9459db" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:19:12.663403  8832 consensus_queue.cc:1059] T 1bf4668eeb70467fb3dc5a0289233b3c P b7ab4784c7344b939bc36f639286f377 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.061s
W20260709 13:19:12.722568  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 91128.6us
I20260709 13:19:12.734594  9115 raft_consensus.cc:2804] T 3fa34c08b205435dba97346991aa1f92 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:19:12.750859  6874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09c2a98de1a4decabd0ff900dd44caa" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:19:12.751546  9043 leader_election.cc:290] T ce4f062dcd314d43a63ca74067cb5ee3 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:19:12.744972  9046 raft_consensus.cc:493] T 3d65025eea89441290d85dd053810e31 P b7ab4784c7344b939bc36f639286f377 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:12.751632  6874 raft_consensus.cc:2468] T f09c2a98de1a4decabd0ff900dd44caa P cd75a17ab2604397adab03bb8b5fd75c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 6.
I20260709 13:19:12.714144  9117 raft_consensus.cc:2749] T d33d5ee8ef6f415593d8df52063161ad P ccd8a4c3bfe3413cb2ae219b09aea832 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:19:12.755422  6697 leader_election.cc:304] T 3fa34c08b205435dba97346991aa1f92 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:19:12.759604  6877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a92dd554674067a83a9cb68c4773f2" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:19:12.761746  6877 raft_consensus.cc:2393] T 07a92dd554674067a83a9cb68c4773f2 P cd75a17ab2604397adab03bb8b5fd75c [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ccd8a4c3bfe3413cb2ae219b09aea832 in current term 6: Already voted for candidate cd75a17ab2604397adab03bb8b5fd75c in this term.
I20260709 13:19:12.759923  6695 leader_election.cc:304] T 1528ab62b6fe4e3099d08f141afee116 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, b7ab4784c7344b939bc36f639286f377
I20260709 13:19:12.724125  9044 raft_consensus.cc:493] T f3f9c2e2bf644115957398fe4c9459db P cd75a17ab2604397adab03bb8b5fd75c [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:19:12.763127  9046 raft_consensus.cc:515] T 3d65025eea89441290d85dd053810e31 P b7ab4784c7344b939bc36f639286f377 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:12.715379  9060 consensus_queue.cc:1059] T bb3d8792045a4583ae2e965b1350a5b4 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.042s
I20260709 13:19:12.774602  6878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7887766dc6784fcaa42b35c05fea7a99" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:19:12.776316  6878 raft_consensus.cc:3060] T 7887766dc6784fcaa42b35c05fea7a99 P cd75a17ab2604397adab03bb8b5fd75c [term 4 FOLLOWER]: Advancing to term 6
I20260709 13:19:12.748193  8767 raft_consensus.cc:493] T 427c124d773f483294511e80fe340075 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 7ba59cc884714e8aa5f3f0ecaed84cbb)
I20260709 13:19:12.762427  9115 raft_consensus.cc:697] T 3fa34c08b205435dba97346991aa1f92 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 7 LEADER]: Becoming Leader. State: Replica: 7ba59cc884714e8aa5f3f0ecaed84cbb, State: Running, Role: LEADER
I20260709 13:19:12.821348  6695 leader_election.cc:304] T 8c7f33e544204fbaac4078e3e83bbf4e P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:19:12.730141  9071 consensus_queue.cc:1048] T 7c44c4849aa54f2b94d1f1bef9ed546f P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.037s
W20260709 13:19:12.801252  9142 log.cc:927] Time spent T 44bde925b2e541b69890d70715b85176 P ccd8a4c3bfe3413cb2ae219b09aea832: Append to log took a long time: real 0.368s	user 0.002s	sys 0.004s
I20260709 13:19:12.801685  9036 leader_election.cc:290] T bb3d8792045a4583ae2e965b1350a5b4 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 5 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:19:12.719590  9146 consensus_queue.cc:1059] T 3fa34c08b205435dba97346991aa1f92 P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.061s
W20260709 13:19:12.803723  9153 log.cc:927] Time spent T 9e326172347f45e99a0d482b5d8ef768 P b7ab4784c7344b939bc36f639286f377: Append to log took a long time: real 0.054s	user 0.001s	sys 0.000s
I20260709 13:19:12.839498  7500 raft_consensus.cc:2468] T 404190ce4ce94cecbfcb6ea9d1dd8626 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 7.
W20260709 13:19:12.804840  9147 log.cc:927] Time spent T 17587d6730594da4a56fa13a353232a1 P b7ab4784c7344b939bc36f639286f377: Append to log took a long time: real 0.090s	user 0.000s	sys 0.001s
I20260709 13:19:12.805701  8986 raft_consensus.cc:2749] T 1528ab62b6fe4e3099d08f141afee116 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:19:12.445437  7496 rpcz_store.cc:276] 0709 13:19:09.305712 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:09.310033 (+  4321us) service_pool.cc:224] Handling call
0709 13:19:09.357577 (+ 47544us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:09.732058 (+374481us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:19:09.928459 (+196401us) log.cc:844] Serialized 14 byte log entry
0709 13:19:11.366627 (+1438168us) log.cc:844] Serialized 14 byte log entry
0709 13:19:11.493443 (+126816us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:11.504556 (+ 11113us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:19:11.541048 (+ 36492us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:12.263845 (+722797us) spinlock_profiling.cc:243] Waited 4.94 ms on lock 0x7b18003068e0. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc15785de1 00007fcc157925b1 00007fcc0c8bd522 00007fcc0c8bf7c1 00007fcc0c8bf779 00007fcc0c8bf709 00007fcc0c8bf6d1 00007fcc0c8be9cd 000000000038f354 000000000038f199 00007fcc0c8a083a
0709 13:19:12.400841 (+136996us) spinlock_profiling.cc:243] Waited 357 ms on lock 0x7b54006040d4. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f9aae01 00007fcc0f9a983e 00007fcc1496e419 00007fcc0dee5bd4 00007fcc0dee5b62 00007fcc0dee5a91 00007fcc0dee5a0c 00007fcc0dee4cc2 00007fcc0dce548c 00007fcc0dce48c6
0709 13:19:12.400924 (+    83us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:12.401175 (+   251us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":496684,"prepare.run_cpu_time_us":135,"prepare.run_wall_time_us":4790,"raft.queue_time_us":136357,"raft.run_cpu_time_us":311,"raft.run_wall_time_us":6334,"spinlock_wait_cycles":831429888,"thread_start_us":1391738,"threads_started":4,"wal-append.queue_time_us":485794}
W20260709 13:19:12.806660  9144 log.cc:927] Time spent T ce4f062dcd314d43a63ca74067cb5ee3 P b7ab4784c7344b939bc36f639286f377: Append to log took a long time: real 0.158s	user 0.000s	sys 0.001s
I20260709 13:19:12.808825  6876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22ccee1b570c4ad3a57bd7aec085b1b4" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:19:12.809579  8673 consensus_queue.cc:237] T ab432e62819d499eaaf3dd55481dd930 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 4.2, Last appended by leader: 2, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:12.810045  9121 raft_consensus.cc:493] T 4b8cacb381b746da8d0049b0a83b41dd P ccd8a4c3bfe3413cb2ae219b09aea832 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader cd75a17ab2604397adab03bb8b5fd75c)
I20260709 13:19:12.836488  9071 consensus_queue.cc:1243] T 7c44c4849aa54f2b94d1f1bef9ed546f P b7ab4784c7344b939bc36f639286f377 [LEADER]: Peer cd75a17ab2604397adab03bb8b5fd75c log is divergent from this leader: its last log entry 6.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 13:19:12.811479  9129 leader_election.cc:290] T 90d42e216d9741e190bca19a781291fd P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 7 election: Requested vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:12.814294  8440 leader_election.cc:290] T 95a75bfe094d4bdc963aba3f08dfcd25 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:12.817318  8574 leader_election.cc:290] T 20f6842e26174571996b8dea4151d4be P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 6 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:12.756565  9120 raft_consensus.cc:515] T 24ee15416e3145beaa1b8183453729a3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 6 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } attrs { replace: true } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:19:12.827111  6723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34f36d59d88f40fe8a2805e604fc6c0a" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:19:12.829068  6731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d9def8b32fd443aa94ab1420b06837b" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:19:12.745239  9050 raft_consensus.cc:515] T 9b3759de40694069b13c0f8bd40e5709 P b7ab4784c7344b939bc36f639286f377 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:12.754542  8845 raft_consensus.cc:515] T d33d5ee8ef6f415593d8df52063161ad P cd75a17ab2604397adab03bb8b5fd75c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
W20260709 13:19:12.835486  7466 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 172485us
I20260709 13:19:12.827224  6877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4275cf08e63345f993bce8664eada830" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:19:12.837253  6874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a485a995abc4807b6e511e45419f737" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:19:12.778644  9043 raft_consensus.cc:493] T 1bf4668eeb70467fb3dc5a0289233b3c P cd75a17ab2604397adab03bb8b5fd75c [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:12.838876  6844 leader_election.cc:304] T 4d9def8b32fd443aa94ab1420b06837b P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:19:12.842394  6728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7887766dc6784fcaa42b35c05fea7a99" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:19:12.930513  6877 raft_consensus.cc:3060] T 4275cf08e63345f993bce8664eada830 P cd75a17ab2604397adab03bb8b5fd75c [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:12.843144  6725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a734b5ab7834e05a8c422208acc58b1" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:19:12.852022  6724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce4f062dcd314d43a63ca74067cb5ee3" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:19:12.853009  6730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de3186201e1a40d0b335eeb8b4e256e0" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:19:12.843957  6727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a485a995abc4807b6e511e45419f737" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
W20260709 13:19:12.833688  9150 log.cc:927] Time spent T 9e326172347f45e99a0d482b5d8ef768 P cd75a17ab2604397adab03bb8b5fd75c: Append to log took a long time: real 0.108s	user 0.000s	sys 0.004s
I20260709 13:19:12.932958  6727 raft_consensus.cc:2393] T 3a485a995abc4807b6e511e45419f737 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7ab4784c7344b939bc36f639286f377 in current term 5: Already voted for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in this term.
I20260709 13:19:12.859882  9046 leader_election.cc:290] T 3d65025eea89441290d85dd053810e31 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:12.866451  9051 raft_consensus.cc:515] T 2c240553ce044eedb41541d72b9475d7 P cd75a17ab2604397adab03bb8b5fd75c [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:12.935720  6873 raft_consensus.cc:1240] T 2c240553ce044eedb41541d72b9475d7 P cd75a17ab2604397adab03bb8b5fd75c [term 7 FOLLOWER]: Rejecting Update request from peer ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 6. Current term is 7. Ops: []
I20260709 13:19:12.872169  9115 consensus_queue.cc:237] T 3fa34c08b205435dba97346991aa1f92 P 7ba59cc884714e8aa5f3f0ecaed84cbb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
W20260709 13:19:12.874699  6695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 53486.1us
I20260709 13:19:12.936756  9051 leader_election.cc:290] T 2c240553ce044eedb41541d72b9475d7 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 7 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:19:12.937682  6695 leader_election.cc:400] T be1a92657f494cac8dd227d152f50151 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 6 pre-election: Vote denied by peer b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817) with higher term. Message: Invalid argument: T be1a92657f494cac8dd227d152f50151 P b7ab4784c7344b939bc36f639286f377 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 6. Current term is 7.
I20260709 13:19:12.771427  9044 raft_consensus.cc:515] T f3f9c2e2bf644115957398fe4c9459db P cd75a17ab2604397adab03bb8b5fd75c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:12.942394  8990 raft_consensus.cc:3055] T bb3d8792045a4583ae2e965b1350a5b4 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:19:12.942639  9044 leader_election.cc:290] T f3f9c2e2bf644115957398fe4c9459db P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:19:12.942958  8990 raft_consensus.cc:740] T bb3d8792045a4583ae2e965b1350a5b4 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
I20260709 13:19:12.877107  6878 raft_consensus.cc:2468] T 7887766dc6784fcaa42b35c05fea7a99 P cd75a17ab2604397adab03bb8b5fd75c [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 6.
W20260709 13:19:12.880693  6798 consensus_meta.cc:287] T 3411566abe2d4c9bb4b2adfdd05e6f17 P b7ab4784c7344b939bc36f639286f377: Time spent flushing consensus metadata: real 0.643s	user 0.012s	sys 0.000s
I20260709 13:19:12.767235  8938 raft_consensus.cc:2749] T 3fa34c08b205435dba97346991aa1f92 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:19:12.843053  8767 raft_consensus.cc:515] T 427c124d773f483294511e80fe340075 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } attrs { replace: true } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:19:12.898909  8987 raft_consensus.cc:493] T 30e88460611e47b2ba16a46a30b5f416 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
W20260709 13:19:12.914867  6772 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 183509us
W20260709 13:19:12.954365  6770 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 93174.5us
I20260709 13:19:12.938840  6728 raft_consensus.cc:2393] T 7887766dc6784fcaa42b35c05fea7a99 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate b7ab4784c7344b939bc36f639286f377 in current term 6: Already voted for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in this term.
I20260709 13:19:12.939285  6725 raft_consensus.cc:2393] T 7a734b5ab7834e05a8c422208acc58b1 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7ab4784c7344b939bc36f639286f377 in current term 6: Already voted for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in this term.
I20260709 13:19:12.948565  6876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90d42e216d9741e190bca19a781291fd" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:19:12.846750  9065 raft_consensus.cc:2749] T 8c7f33e544204fbaac4078e3e83bbf4e P ccd8a4c3bfe3413cb2ae219b09aea832 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:19:12.957219  6798 raft_consensus.cc:2468] T 3411566abe2d4c9bb4b2adfdd05e6f17 P b7ab4784c7344b939bc36f639286f377 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 5.
W20260709 13:19:13.002002  6695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 64523.1us
I20260709 13:19:13.016466  6695 leader_election.cc:304] T 7c37d41cd9164c15a6826ca62a851a69 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:19:12.930137  6697 leader_election.cc:304] T 404190ce4ce94cecbfcb6ea9d1dd8626 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
W20260709 13:19:12.944639  9154 log.cc:927] Time spent T 24ee15416e3145beaa1b8183453729a3 P cd75a17ab2604397adab03bb8b5fd75c: Append to log took a long time: real 0.219s	user 0.000s	sys 0.004s
W20260709 13:19:12.945574  9140 log.cc:927] Time spent T 427c124d773f483294511e80fe340075 P b7ab4784c7344b939bc36f639286f377: Append to log took a long time: real 0.554s	user 0.004s	sys 0.000s
W20260709 13:19:13.004537  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 237378us
W20260709 13:19:12.944779  9147 log.cc:927] Time spent T 17587d6730594da4a56fa13a353232a1 P b7ab4784c7344b939bc36f639286f377: Append to log took a long time: real 0.069s	user 0.000s	sys 0.001s
W20260709 13:19:12.949407  9157 log.cc:927] Time spent T be1a92657f494cac8dd227d152f50151 P 7ba59cc884714e8aa5f3f0ecaed84cbb: Append to log took a long time: real 0.127s	user 0.000s	sys 0.000s
I20260709 13:19:12.897714  9090 raft_consensus.cc:697] T b3f13b31a1f84f0d89d007eadd57924c P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 5 LEADER]: Becoming Leader. State: Replica: 7ba59cc884714e8aa5f3f0ecaed84cbb, State: Running, Role: LEADER
I20260709 13:19:13.009354  6876 raft_consensus.cc:3060] T 90d42e216d9741e190bca19a781291fd P cd75a17ab2604397adab03bb8b5fd75c [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:12.943867  9038 raft_consensus.cc:3055] T 3fa34c08b205435dba97346991aa1f92 P cd75a17ab2604397adab03bb8b5fd75c [term 6 LEADER]: Stepping down as leader of term 6
W20260709 13:19:13.026592  9099 consensus_meta.cc:287] T 90d42e216d9741e190bca19a781291fd P b7ab4784c7344b939bc36f639286f377: Time spent flushing consensus metadata: real 0.800s	user 0.013s	sys 0.000s
I20260709 13:19:12.946739  8862 raft_consensus.cc:3055] T 1bf4668eeb70467fb3dc5a0289233b3c P b7ab4784c7344b939bc36f639286f377 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:19:13.024801  6807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24ee15416e3145beaa1b8183453729a3" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:19:13.044051  6807 raft_consensus.cc:3060] T 24ee15416e3145beaa1b8183453729a3 P b7ab4784c7344b939bc36f639286f377 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:13.028913  6695 leader_election.cc:304] T e31b9971c15848dea59d4d4130141d9e P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:19:13.029259  6875 raft_consensus.cc:3055] T 9b3759de40694069b13c0f8bd40e5709 P cd75a17ab2604397adab03bb8b5fd75c [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:19:13.030753  6727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24ee15416e3145beaa1b8183453729a3" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:19:13.044957  6875 raft_consensus.cc:740] T 9b3759de40694069b13c0f8bd40e5709 P cd75a17ab2604397adab03bb8b5fd75c [term 5 LEADER]: Becoming Follower/Learner. State: Replica: cd75a17ab2604397adab03bb8b5fd75c, State: Running, Role: LEADER
I20260709 13:19:13.040131  6844 leader_election.cc:304] T de3186201e1a40d0b335eeb8b4e256e0 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
W20260709 13:19:13.018018  6697 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.68:45071, user_credentials={real_user=slave}} blocked reactor thread for 87987.9us
I20260709 13:19:12.924665  9121 raft_consensus.cc:515] T 4b8cacb381b746da8d0049b0a83b41dd P ccd8a4c3bfe3413cb2ae219b09aea832 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:19:13.020545  9146 raft_consensus.cc:2804] T 4d9def8b32fd443aa94ab1420b06837b P cd75a17ab2604397adab03bb8b5fd75c [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:19:12.958657  8870 consensus_queue.cc:1048] T 07a92dd554674067a83a9cb68c4773f2 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.072s
I20260709 13:19:12.952778  8973 consensus_queue.cc:1048] T 4f00a2e87e56452083b759f60d461ee3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.072s
I20260709 13:19:13.079465  6729 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50004 (request call id 1327) took 1444 ms. Trace:
I20260709 13:19:12.907104  6732 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "07a92dd554674067a83a9cb68c4773f2"
dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
mode: GRACEFUL
new_leader_uuid: "b7ab4784c7344b939bc36f639286f377"
 from {username='slave'} at 127.0.0.1:38536
I20260709 13:19:13.089254  6732 raft_consensus.cc:606] T 07a92dd554674067a83a9cb68c4773f2 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 5 FOLLOWER]: Received request to transfer leadership to TS b7ab4784c7344b939bc36f639286f377
I20260709 13:19:13.089784  6732 raft_consensus.cc:614] T 07a92dd554674067a83a9cb68c4773f2 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:19:13.046370  6697 leader_election.cc:304] T f09c2a98de1a4decabd0ff900dd44caa P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
W20260709 13:19:13.090528  6697 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 44275.4us
I20260709 13:19:13.034127  8938 raft_consensus.cc:2749] T 7c37d41cd9164c15a6826ca62a851a69 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:19:12.963284  9043 raft_consensus.cc:515] T 1bf4668eeb70467fb3dc5a0289233b3c P cd75a17ab2604397adab03bb8b5fd75c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:13.048517  6874 raft_consensus.cc:1275] T b56bf91d90824c959e21e0cee5ba1816 P cd75a17ab2604397adab03bb8b5fd75c [term 6 FOLLOWER]: Refusing update from remote peer ccd8a4c3bfe3413cb2ae219b09aea832: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:19:13.045166  6727 raft_consensus.cc:3060] T 24ee15416e3145beaa1b8183453729a3 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:13.102205  9043 leader_election.cc:290] T 1bf4668eeb70467fb3dc5a0289233b3c P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:19:13.094656  7498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be1a92657f494cac8dd227d152f50151" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:19:13.064579  8845 leader_election.cc:290] T d33d5ee8ef6f415593d8df52063161ad P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:19:13.056571  9050 leader_election.cc:290] T 9b3759de40694069b13c0f8bd40e5709 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:13.065467  6770 leader_election.cc:304] T c4db81d9d329422bb3b4160ca4ac2d1d P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:19:13.106076  6770 leader_election.cc:304] T f4b8bd455d5a47c18a1380839c6e0d61 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:19:13.042009  9167 consensus_queue.cc:1059] T ab432e62819d499eaaf3dd55481dd930 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.023s
I20260709 13:19:13.057488  9146 raft_consensus.cc:493] T 4d9def8b32fd443aa94ab1420b06837b P cd75a17ab2604397adab03bb8b5fd75c [term 5 FOLLOWER]: Starting leader election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:19:13.107787  9146 raft_consensus.cc:3060] T 4d9def8b32fd443aa94ab1420b06837b P cd75a17ab2604397adab03bb8b5fd75c [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:13.023036  8940 raft_consensus.cc:515] T b56bf91d90824c959e21e0cee5ba1816 P b7ab4784c7344b939bc36f639286f377 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:13.109179  9046 raft_consensus.cc:2749] T c4db81d9d329422bb3b4160ca4ac2d1d P b7ab4784c7344b939bc36f639286f377 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:19:13.109944  8940 leader_election.cc:290] T b56bf91d90824c959e21e0cee5ba1816 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 7 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:13.109882  9046 consensus_queue.cc:1048] T f58dc08b12a2494bb9a1372837970ca2 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:19:13.060420  6877 raft_consensus.cc:2468] T 4275cf08e63345f993bce8664eada830 P cd75a17ab2604397adab03bb8b5fd75c [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 6.
I20260709 13:19:13.040951  9038 raft_consensus.cc:740] T 3fa34c08b205435dba97346991aa1f92 P cd75a17ab2604397adab03bb8b5fd75c [term 6 LEADER]: Becoming Follower/Learner. State: Replica: cd75a17ab2604397adab03bb8b5fd75c, State: Running, Role: LEADER
I20260709 13:19:13.070561  9164 consensus_queue.cc:1059] T 853ac0a8cbd64ce99457f170216d4d0f P b7ab4784c7344b939bc36f639286f377 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:19:13.111308  9046 raft_consensus.cc:2749] T f4b8bd455d5a47c18a1380839c6e0d61 P b7ab4784c7344b939bc36f639286f377 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:19:13.072214  8892 raft_consensus.cc:2749] T e31b9971c15848dea59d4d4130141d9e P ccd8a4c3bfe3413cb2ae219b09aea832 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:19:13.069630  6695 leader_election.cc:304] T e77e330a82df4b43a745d57a68f6f057 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:19:13.076771  9090 consensus_queue.cc:237] T b3f13b31a1f84f0d89d007eadd57924c P 7ba59cc884714e8aa5f3f0ecaed84cbb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:19:13.113418  6807 raft_consensus.cc:2468] T 24ee15416e3145beaa1b8183453729a3 P b7ab4784c7344b939bc36f639286f377 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in term 6.
W20260709 13:19:13.078214  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 48004.5us
I20260709 13:19:13.115319  6844 leader_election.cc:304] T 4275cf08e63345f993bce8664eada830 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:19:13.116698  6844 leader_election.cc:304] T 20f6842e26174571996b8dea4151d4be P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:19:13.117842  6844 leader_election.cc:304] T b56bf91d90824c959e21e0cee5ba1816 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:19:12.943872  8990 consensus_queue.cc:260] T bb3d8792045a4583ae2e965b1350a5b4 P ccd8a4c3bfe3413cb2ae219b09aea832 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:19:13.025593  9129 raft_consensus.cc:2804] T 404190ce4ce94cecbfcb6ea9d1dd8626 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:19:13.118902  9129 raft_consensus.cc:697] T 404190ce4ce94cecbfcb6ea9d1dd8626 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 7 LEADER]: Becoming Leader. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
I20260709 13:19:13.119977  9129 consensus_queue.cc:237] T 404190ce4ce94cecbfcb6ea9d1dd8626 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:19:13.064579  8767 leader_election.cc:290] T 427c124d773f483294511e80fe340075 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:19:13.121178  9031 consensus_queue.cc:260] T bb7fa124c3bf4ef9ab65a407cb008441 P b7ab4784c7344b939bc36f639286f377 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:19:13.122273  9031 raft_consensus.cc:3060] T bb7fa124c3bf4ef9ab65a407cb008441 P b7ab4784c7344b939bc36f639286f377 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:13.091988  6872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1704639a875409b9959353527b3fd68" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:19:13.023450  8987 raft_consensus.cc:515] T 30e88460611e47b2ba16a46a30b5f416 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:13.093463  6697 leader_election.cc:304] T 7887766dc6784fcaa42b35c05fea7a99 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:19:13.123409  6872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de3186201e1a40d0b335eeb8b4e256e0" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:19:13.123494  6801 raft_consensus.cc:1275] T be1a92657f494cac8dd227d152f50151 P b7ab4784c7344b939bc36f639286f377 [term 7 FOLLOWER]: Refusing update from remote peer 7ba59cc884714e8aa5f3f0ecaed84cbb: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:19:13.094857  7503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24ee15416e3145beaa1b8183453729a3" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:19:13.124682  7503 raft_consensus.cc:2368] T 24ee15416e3145beaa1b8183453729a3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7ab4784c7344b939bc36f639286f377 for earlier term 5. Current term is 6.
I20260709 13:19:13.124821  6879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3411566abe2d4c9bb4b2adfdd05e6f17" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:19:13.095237  7495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f00a2e87e56452083b759f60d461ee3" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:19:13.125779  6879 raft_consensus.cc:2393] T 3411566abe2d4c9bb4b2adfdd05e6f17 P cd75a17ab2604397adab03bb8b5fd75c [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7ab4784c7344b939bc36f639286f377 in current term 5: Already voted for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in this term.
I20260709 13:19:13.126076  6874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c240553ce044eedb41541d72b9475d7" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:19:13.126451  8892 raft_consensus.cc:2804] T 7887766dc6784fcaa42b35c05fea7a99 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:19:13.126888  6874 raft_consensus.cc:2393] T 2c240553ce044eedb41541d72b9475d7 P cd75a17ab2604397adab03bb8b5fd75c [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7ab4784c7344b939bc36f639286f377 in current term 7: Already voted for candidate cd75a17ab2604397adab03bb8b5fd75c in this term.
I20260709 13:19:13.126720  6879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09c2a98de1a4decabd0ff900dd44caa" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:19:13.127127  8892 raft_consensus.cc:697] T 7887766dc6784fcaa42b35c05fea7a99 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 6 LEADER]: Becoming Leader. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
I20260709 13:19:13.127429  6879 raft_consensus.cc:2468] T f09c2a98de1a4decabd0ff900dd44caa P cd75a17ab2604397adab03bb8b5fd75c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 6.
I20260709 13:19:13.096446  6873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f9c2e2bf644115957398fe4c9459db" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:19:13.111332  9038 consensus_queue.cc:260] T 3fa34c08b205435dba97346991aa1f92 P cd75a17ab2604397adab03bb8b5fd75c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:19:13.128444  6873 raft_consensus.cc:3060] T f3f9c2e2bf644115957398fe4c9459db P cd75a17ab2604397adab03bb8b5fd75c [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:13.129302  9038 raft_consensus.cc:3060] T 3fa34c08b205435dba97346991aa1f92 P cd75a17ab2604397adab03bb8b5fd75c [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:13.130895  9065 raft_consensus.cc:2804] T e77e330a82df4b43a745d57a68f6f057 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:19:13.131428  9065 raft_consensus.cc:493] T e77e330a82df4b43a745d57a68f6f057 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:13.048848  8862 raft_consensus.cc:740] T 1bf4668eeb70467fb3dc5a0289233b3c P b7ab4784c7344b939bc36f639286f377 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
I20260709 13:19:13.132736  8862 consensus_queue.cc:260] T 1bf4668eeb70467fb3dc5a0289233b3c P b7ab4784c7344b939bc36f639286f377 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:13.134001  8862 raft_consensus.cc:3060] T 1bf4668eeb70467fb3dc5a0289233b3c P b7ab4784c7344b939bc36f639286f377 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:19:13.124478  8987 leader_election.cc:290] T 30e88460611e47b2ba16a46a30b5f416 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:13.089448  9120 leader_election.cc:290] T 24ee15416e3145beaa1b8183453729a3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 6 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
W20260709 13:19:13.125264  6695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 55724.1us
I20260709 13:19:13.137953  7495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "427c124d773f483294511e80fe340075" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:19:13.111960  9046 raft_consensus.cc:3055] T 853ac0a8cbd64ce99457f170216d4d0f P b7ab4784c7344b939bc36f639286f377 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:19:13.139010  9046 raft_consensus.cc:740] T 853ac0a8cbd64ce99457f170216d4d0f P b7ab4784c7344b939bc36f639286f377 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
I20260709 13:19:13.131842  9065 raft_consensus.cc:3060] T e77e330a82df4b43a745d57a68f6f057 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:13.140672  9155 consensus_queue.cc:1048] T 3a485a995abc4807b6e511e45419f737 P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:19:13.124557  6872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a734b5ab7834e05a8c422208acc58b1" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:19:13.141973  6872 raft_consensus.cc:2393] T 7a734b5ab7834e05a8c422208acc58b1 P cd75a17ab2604397adab03bb8b5fd75c [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate b7ab4784c7344b939bc36f639286f377 in current term 6: Already voted for candidate cd75a17ab2604397adab03bb8b5fd75c in this term.
I20260709 13:19:13.142194  9155 raft_consensus.cc:2804] T 20f6842e26174571996b8dea4151d4be P cd75a17ab2604397adab03bb8b5fd75c [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:19:13.142555  9155 raft_consensus.cc:493] T 20f6842e26174571996b8dea4151d4be P cd75a17ab2604397adab03bb8b5fd75c [term 5 FOLLOWER]: Starting leader election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:19:13.142683  9121 leader_election.cc:290] T 4b8cacb381b746da8d0049b0a83b41dd P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:19:13.143790  9044 consensus_queue.cc:1059] T 9b3759de40694069b13c0f8bd40e5709 P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:19:13.144366  6881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "427c124d773f483294511e80fe340075" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:19:13.144913  9036 raft_consensus.cc:2804] T b56bf91d90824c959e21e0cee5ba1816 P cd75a17ab2604397adab03bb8b5fd75c [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:19:13.145452  9036 raft_consensus.cc:493] T b56bf91d90824c959e21e0cee5ba1816 P cd75a17ab2604397adab03bb8b5fd75c [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:13.145804  9036 raft_consensus.cc:3060] T b56bf91d90824c959e21e0cee5ba1816 P cd75a17ab2604397adab03bb8b5fd75c [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:13.146852  9100 raft_consensus.cc:515] T f58dc08b12a2494bb9a1372837970ca2 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:13.148301  7495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b8cacb381b746da8d0049b0a83b41dd" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:19:13.142921  9155 raft_consensus.cc:3060] T 20f6842e26174571996b8dea4151d4be P cd75a17ab2604397adab03bb8b5fd75c [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:13.149113  7495 raft_consensus.cc:2468] T 4b8cacb381b746da8d0049b0a83b41dd P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 6.
I20260709 13:19:13.093832  8986 raft_consensus.cc:2804] T f09c2a98de1a4decabd0ff900dd44caa P ccd8a4c3bfe3413cb2ae219b09aea832 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:19:13.151273  6726 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "853ac0a8cbd64ce99457f170216d4d0f"
dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
mode: GRACEFUL
new_leader_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
 from {username='slave'} at 127.0.0.1:38536
I20260709 13:19:13.151700  6697 leader_election.cc:304] T 4b8cacb381b746da8d0049b0a83b41dd P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
I20260709 13:19:13.138106  6695 leader_election.cc:304] T 853ac0a8cbd64ce99457f170216d4d0f P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:19:13.151291  8986 raft_consensus.cc:493] T f09c2a98de1a4decabd0ff900dd44caa P ccd8a4c3bfe3413cb2ae219b09aea832 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:13.152731  8986 raft_consensus.cc:3060] T f09c2a98de1a4decabd0ff900dd44caa P ccd8a4c3bfe3413cb2ae219b09aea832 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:13.154697  6695 leader_election.cc:304] T 7a734b5ab7834e05a8c422208acc58b1 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:19:13.151943  6726 raft_consensus.cc:606] T 853ac0a8cbd64ce99457f170216d4d0f P ccd8a4c3bfe3413cb2ae219b09aea832 [term 3 FOLLOWER]: Received request to transfer leadership to TS cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:19:13.155963  6726 raft_consensus.cc:614] T 853ac0a8cbd64ce99457f170216d4d0f P ccd8a4c3bfe3413cb2ae219b09aea832 [term 3 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:19:13.067724  9127 raft_consensus.cc:515] T 7ba5dac66ab5497e9e336f2a3c28cda5 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:19:13.144963  6881 raft_consensus.cc:2468] T 427c124d773f483294511e80fe340075 P cd75a17ab2604397adab03bb8b5fd75c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 5.
W20260709 13:19:13.086939  6772 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:13.161381  6873 raft_consensus.cc:2468] T f3f9c2e2bf644115957398fe4c9459db P cd75a17ab2604397adab03bb8b5fd75c [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 6.
I20260709 13:19:13.127733  6874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f00a2e87e56452083b759f60d461ee3" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:19:13.167006  6877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30e88460611e47b2ba16a46a30b5f416" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:19:13.158684  8845 raft_consensus.cc:2764] T 4275cf08e63345f993bce8664eada830 P cd75a17ab2604397adab03bb8b5fd75c [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 5: won
I20260709 13:19:13.058337  9051 raft_consensus.cc:2749] T de3186201e1a40d0b335eeb8b4e256e0 P cd75a17ab2604397adab03bb8b5fd75c [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:19:13.169414  6877 raft_consensus.cc:2468] T 30e88460611e47b2ba16a46a30b5f416 P cd75a17ab2604397adab03bb8b5fd75c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 4.
I20260709 13:19:13.171066  6695 leader_election.cc:304] T d8292e16e5654be6bc408560cf256aaa P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:19:13.172634  6727 raft_consensus.cc:2468] T 24ee15416e3145beaa1b8183453729a3 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in term 6.
I20260709 13:19:13.088991  6729 rpcz_store.cc:276] 0709 13:19:11.634817 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:11.876762 (+241945us) service_pool.cc:224] Handling call
0709 13:19:11.911335 (+ 34573us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 13:19:11.950936 (+ 39601us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:11.950974 (+    38us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 13:19:11.951780 (+   806us) log.cc:844] Serialized 78 byte log entry
0709 13:19:12.193682 (+241902us) spinlock_profiling.cc:243] Waited 4.18 ms on lock 0x7b1800342d60. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc15785de1 00007fcc157925b1 00007fcc0c89fe07 00007fcc156faab9 00007fcc0c8bc69b 00007fcc0c8ba93f 00007fcc0c8bcc02 00007fcc0f54420b 00007fcc0f549d23 00007fcc0f54a0d1 00007fcc0f965a0f
0709 13:19:12.231897 (+ 38215us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:19:12.250259 (+ 18362us) log.cc:844] Serialized 14 byte log entry
0709 13:19:12.265198 (+ 14939us) log.cc:844] Serialized 14 byte log entry
0709 13:19:12.265547 (+   349us) log.cc:844] Serialized 14 byte log entry
0709 13:19:12.265741 (+   194us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:12.392268 (+126527us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:12.695705 (+303437us) spinlock_profiling.cc:243] Waited 2.23 ms on lock 0x7b4400022b4c. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0c745db1 00007fcc0c7e3c85 00007fcc0c7e46a2 00007fcc0f5561db 00007fcc0f551aaf 00007fcc0f54586e 00007fcc0f544bb6 00007fcc0f5447d8 00007fcc0f54e221 00007fcc0f54e1d9 00007fcc0f54e169
0709 13:19:13.079219 (+383514us) raft_consensus.cc:1685] finished
0709 13:19:13.079246 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:13.079397 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":37766,"prepare.queue_time_us":38342,"prepare.run_cpu_time_us":83,"prepare.run_wall_time_us":87,"raft.queue_time_us":21787,"raft.run_cpu_time_us":467,"raft.run_wall_time_us":10857,"spinlock_wait_cycles":14738176,"thread_start_us":37996,"threads_started":1,"wal-append.queue_time_us":439466}
I20260709 13:19:13.177780  6881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b8cacb381b746da8d0049b0a83b41dd" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:19:13.056922  9137 consensus_queue.cc:1048] T 404190ce4ce94cecbfcb6ea9d1dd8626 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.121s
I20260709 13:19:13.179123  6872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7887766dc6784fcaa42b35c05fea7a99" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:19:13.170055  6874 raft_consensus.cc:2468] T 4f00a2e87e56452083b759f60d461ee3 P cd75a17ab2604397adab03bb8b5fd75c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 6.
I20260709 13:19:13.191304  6877 raft_consensus.cc:1240] T 07a92dd554674067a83a9cb68c4773f2 P cd75a17ab2604397adab03bb8b5fd75c [term 6 FOLLOWER]: Rejecting Update request from peer b7ab4784c7344b939bc36f639286f377 for earlier term 5. Current term is 6. Ops: [5.3-5.3]
I20260709 13:19:13.157202  8827 raft_consensus.cc:2749] T 853ac0a8cbd64ce99457f170216d4d0f P ccd8a4c3bfe3413cb2ae219b09aea832 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:19:13.059736  9099 raft_consensus.cc:515] T 90d42e216d9741e190bca19a781291fd P b7ab4784c7344b939bc36f639286f377 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:13.139771  9046 consensus_queue.cc:260] T 853ac0a8cbd64ce99457f170216d4d0f P b7ab4784c7344b939bc36f639286f377 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:13.186565  6804 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:32976 (request call id 2149) took 1027 ms. Trace:
I20260709 13:19:13.201102  6804 rpcz_store.cc:276] 0709 13:19:12.159557 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:12.500773 (+341216us) service_pool.cc:224] Handling call
0709 13:19:12.520506 (+ 19733us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:12.728773 (+208267us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:13.186238 (+457465us) spinlock_profiling.cc:243] Waited 181 ms on lock 0x7b54001a36d4. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f9aae01 00007fcc0f9a983e 00007fcc1496e419 00007fcc0dee5bd4 00007fcc0dee5b62 00007fcc0dee5a91 00007fcc0dee5a0c 00007fcc0dee4cc2 00007fcc0dce548c 00007fcc0dce48c6
0709 13:19:13.186488 (+   250us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":416281344}
I20260709 13:19:13.186755  6772 leader_election.cc:400] T 24ee15416e3145beaa1b8183453729a3 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 5 pre-election: Vote denied by peer 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071) with higher term. Message: Invalid argument: T 24ee15416e3145beaa1b8183453729a3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7ab4784c7344b939bc36f639286f377 for earlier term 5. Current term is 6.
I20260709 13:19:13.205514  6772 leader_election.cc:403] T 24ee15416e3145beaa1b8183453729a3 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 5 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:19:13.159312  9121 raft_consensus.cc:2804] T 4b8cacb381b746da8d0049b0a83b41dd P ccd8a4c3bfe3413cb2ae219b09aea832 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:19:13.177534  9141 log.cc:927] Time spent T 00000000000000000000000000000000 P b3ae52d33b9a4273a42e5e2cf3b5d6b5: Append to log took a long time: real 0.089s	user 0.000s	sys 0.000s
I20260709 13:19:13.189782  6695 leader_election.cc:304] T 44bde925b2e541b69890d70715b85176 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:19:13.192903  6872 raft_consensus.cc:2393] T 7887766dc6784fcaa42b35c05fea7a99 P cd75a17ab2604397adab03bb8b5fd75c [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate b7ab4784c7344b939bc36f639286f377 in current term 6: Already voted for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in this term.
I20260709 13:19:13.173426  8938 raft_consensus.cc:2749] T 7a734b5ab7834e05a8c422208acc58b1 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:19:13.216128  6881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34f36d59d88f40fe8a2805e604fc6c0a" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:19:13.194857  8793 raft_consensus.cc:3060] T d8292e16e5654be6bc408560cf256aaa P ccd8a4c3bfe3413cb2ae219b09aea832 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:13.128367  8892 consensus_queue.cc:237] T 7887766dc6784fcaa42b35c05fea7a99 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:13.207118  9121 raft_consensus.cc:493] T 4b8cacb381b746da8d0049b0a83b41dd P ccd8a4c3bfe3413cb2ae219b09aea832 [term 6 FOLLOWER]: Starting leader election (detected failure of leader cd75a17ab2604397adab03bb8b5fd75c)
I20260709 13:19:13.234081  6881 raft_consensus.cc:1240] T d8cee0accdb8499c86d4414b72565a38 P cd75a17ab2604397adab03bb8b5fd75c [term 6 FOLLOWER]: Rejecting Update request from peer b7ab4784c7344b939bc36f639286f377 for earlier term 5. Current term is 6. Ops: []
I20260709 13:19:13.186151  9156 consensus_queue.cc:1048] T be1a92657f494cac8dd227d152f50151 P 7ba59cc884714e8aa5f3f0ecaed84cbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.035s
I20260709 13:19:13.218185  9060 raft_consensus.cc:2749] T 44bde925b2e541b69890d70715b85176 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:19:13.237560  6732 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ab432e62819d499eaaf3dd55481dd930"
dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
mode: GRACEFUL
new_leader_uuid: "b7ab4784c7344b939bc36f639286f377"
 from {username='slave'} at 127.0.0.1:38536
I20260709 13:19:13.243852  6872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d9def8b32fd443aa94ab1420b06837b" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:19:13.237165  9121 raft_consensus.cc:3060] T 4b8cacb381b746da8d0049b0a83b41dd P ccd8a4c3bfe3413cb2ae219b09aea832 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:13.219092  8347 raft_consensus.cc:515] T 713b5728a197487c9300b310ab94e5a3 P b7ab4784c7344b939bc36f639286f377 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:13.228065  9050 raft_consensus.cc:2749] T 24ee15416e3145beaa1b8183453729a3 P b7ab4784c7344b939bc36f639286f377 [term 6 FOLLOWER]: Leader pre-election lost for term 5. Reason: Vote denied by peer 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071) with higher term. Message: Invalid argument: T 24ee15416e3145beaa1b8183453729a3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7ab4784c7344b939bc36f639286f377 for earlier term 5. Current term is 6.
I20260709 13:19:13.211320  9051 consensus_queue.cc:1059] T d8292e16e5654be6bc408560cf256aaa P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.031s
W20260709 13:19:13.249935  6770 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 143918us
I20260709 13:19:13.278004  6732 raft_consensus.cc:606] T ab432e62819d499eaaf3dd55481dd930 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 7 LEADER]: Received request to transfer leadership to TS b7ab4784c7344b939bc36f639286f377
I20260709 13:19:13.227586  8938 consensus_queue.cc:1059] T de3186201e1a40d0b335eeb8b4e256e0 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.038s
I20260709 13:19:13.227720  9036 raft_consensus.cc:515] T b56bf91d90824c959e21e0cee5ba1816 P cd75a17ab2604397adab03bb8b5fd75c [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:13.289561  7500 raft_consensus.cc:1240] T b3f13b31a1f84f0d89d007eadd57924c P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 5 LEADER]: Rejecting Update request from peer ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 4. Current term is 5. Ops: []
I20260709 13:19:13.305395  9065 raft_consensus.cc:515] T e77e330a82df4b43a745d57a68f6f057 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } }
I20260709 13:19:13.292274  8673 raft_consensus.cc:3055] T de3186201e1a40d0b335eeb8b4e256e0 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:19:13.309795  8673 raft_consensus.cc:740] T de3186201e1a40d0b335eeb8b4e256e0 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
I20260709 13:19:13.289696  9051 consensus_queue.cc:1243] T d8292e16e5654be6bc408560cf256aaa P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Peer b7ab4784c7344b939bc36f639286f377 log is divergent from this leader: its last log entry 5.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260709 13:19:13.282418  9099 leader_election.cc:290] T 90d42e216d9741e190bca19a781291fd P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 7 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:13.333165  6872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a75bfe094d4bdc963aba3f08dfcd25" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 8 candidate_status { last_received { term: 6 index: 2 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:19:13.326202  6770 leader_election.cc:304] T 4275cf08e63345f993bce8664eada830 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
W20260709 13:19:13.335088  6695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 120202us
I20260709 13:19:13.339900  6804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ba5dac66ab5497e9e336f2a3c28cda5" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:19:13.339924  9076 consensus_queue.cc:1048] T 95a75bfe094d4bdc963aba3f08dfcd25 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:19:13.340929  6804 raft_consensus.cc:3060] T 7ba5dac66ab5497e9e336f2a3c28cda5 P b7ab4784c7344b939bc36f639286f377 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:13.326632  9050 consensus_queue.cc:1059] T d33d5ee8ef6f415593d8df52063161ad P b7ab4784c7344b939bc36f639286f377 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.016s
I20260709 13:19:13.344511  9036 leader_election.cc:290] T b56bf91d90824c959e21e0cee5ba1816 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 7 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:19:13.345193  9036 raft_consensus.cc:3055] T d8292e16e5654be6bc408560cf256aaa P cd75a17ab2604397adab03bb8b5fd75c [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:19:13.345553  9036 raft_consensus.cc:740] T d8292e16e5654be6bc408560cf256aaa P cd75a17ab2604397adab03bb8b5fd75c [term 6 LEADER]: Becoming Follower/Learner. State: Replica: cd75a17ab2604397adab03bb8b5fd75c, State: Running, Role: LEADER
I20260709 13:19:13.346455  6878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d65025eea89441290d85dd053810e31" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:19:13.346390  9036 consensus_queue.cc:260] T d8292e16e5654be6bc408560cf256aaa P cd75a17ab2604397adab03bb8b5fd75c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:13.347087  6878 raft_consensus.cc:2468] T 3d65025eea89441290d85dd053810e31 P cd75a17ab2604397adab03bb8b5fd75c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 4.
I20260709 13:19:13.347649  9036 raft_consensus.cc:3060] T d8292e16e5654be6bc408560cf256aaa P cd75a17ab2604397adab03bb8b5fd75c [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:13.347965  6878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f58dc08b12a2494bb9a1372837970ca2" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:19:13.348510  6878 raft_consensus.cc:3060] T f58dc08b12a2494bb9a1372837970ca2 P cd75a17ab2604397adab03bb8b5fd75c [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:13.353727  9127 leader_election.cc:290] T 7ba5dac66ab5497e9e336f2a3c28cda5 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 7 election: Requested vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:13.353969  9117 consensus_queue.cc:1059] T 20f6842e26174571996b8dea4151d4be P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:19:13.355458  9076 raft_consensus.cc:3055] T 20f6842e26174571996b8dea4151d4be P ccd8a4c3bfe3413cb2ae219b09aea832 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:19:13.355899  9076 raft_consensus.cc:740] T 20f6842e26174571996b8dea4151d4be P ccd8a4c3bfe3413cb2ae219b09aea832 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
I20260709 13:19:13.356375  8673 consensus_queue.cc:260] T de3186201e1a40d0b335eeb8b4e256e0 P ccd8a4c3bfe3413cb2ae219b09aea832 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:13.356719  9146 raft_consensus.cc:515] T 4d9def8b32fd443aa94ab1420b06837b P cd75a17ab2604397adab03bb8b5fd75c [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:13.357393  8673 raft_consensus.cc:3060] T de3186201e1a40d0b335eeb8b4e256e0 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:13.356930  9076 consensus_queue.cc:260] T 20f6842e26174571996b8dea4151d4be P ccd8a4c3bfe3413cb2ae219b09aea832 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:13.358855  9076 raft_consensus.cc:3060] T 20f6842e26174571996b8dea4151d4be P ccd8a4c3bfe3413cb2ae219b09aea832 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:13.359110  9146 leader_election.cc:290] T 4d9def8b32fd443aa94ab1420b06837b P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 6 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:19:13.295053  9100 leader_election.cc:290] T f58dc08b12a2494bb9a1372837970ca2 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 8 election: Requested vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:13.367408  6878 raft_consensus.cc:2468] T f58dc08b12a2494bb9a1372837970ca2 P cd75a17ab2604397adab03bb8b5fd75c [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 8.
I20260709 13:19:13.375427  8347 leader_election.cc:290] T 713b5728a197487c9300b310ab94e5a3 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 6 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:13.380889  9065 leader_election.cc:290] T e77e330a82df4b43a745d57a68f6f057 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 8 election: Requested vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:13.381036  6878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b3759de40694069b13c0f8bd40e5709" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 7 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:19:13.383419  6872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90d42e216d9741e190bca19a781291fd" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:19:13.384778  6872 raft_consensus.cc:1240] T 4d9def8b32fd443aa94ab1420b06837b P cd75a17ab2604397adab03bb8b5fd75c [term 6 FOLLOWER]: Rejecting Update request from peer ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 5. Current term is 6. Ops: []
W20260709 13:19:13.384980  6698 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:13.386967  6872 raft_consensus.cc:1217] T f58dc08b12a2494bb9a1372837970ca2 P cd75a17ab2604397adab03bb8b5fd75c [term 8 FOLLOWER]: Deduplicated request from leader. Original: 1.1->[3.2-7.4]   Dedup: 3.2->[5.3-7.4]
I20260709 13:19:13.387521  6872 raft_consensus.cc:1240] T f58dc08b12a2494bb9a1372837970ca2 P cd75a17ab2604397adab03bb8b5fd75c [term 8 FOLLOWER]: Rejecting Update request from peer b7ab4784c7344b939bc36f639286f377 for earlier term 7. Current term is 8. Ops: [3.2-7.4]
I20260709 13:19:13.390754  6879 raft_consensus.cc:1240] T bb7fa124c3bf4ef9ab65a407cb008441 P cd75a17ab2604397adab03bb8b5fd75c [term 7 FOLLOWER]: Rejecting Update request from peer b7ab4784c7344b939bc36f639286f377 for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260709 13:19:13.397660  6880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77e330a82df4b43a745d57a68f6f057" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:19:13.399894  8986 raft_consensus.cc:515] T f09c2a98de1a4decabd0ff900dd44caa P ccd8a4c3bfe3413cb2ae219b09aea832 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:13.401440  7466 leader_election.cc:304] T 24ee15416e3145beaa1b8183453729a3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
W20260709 13:19:13.444222  6772 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.68:45071, user_credentials={real_user=slave}} blocked reactor thread for 83590.5us
I20260709 13:19:13.445153  6876 raft_consensus.cc:2468] T 90d42e216d9741e190bca19a781291fd P cd75a17ab2604397adab03bb8b5fd75c [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 7.
I20260709 13:19:13.450453  6804 raft_consensus.cc:2468] T 7ba5dac66ab5497e9e336f2a3c28cda5 P b7ab4784c7344b939bc36f639286f377 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in term 7.
W20260709 13:19:13.458811  7466 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 57497.4us
W20260709 13:19:13.459455  6847 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:13.471822  6878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b56bf91d90824c959e21e0cee5ba1816" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:19:13.472277  6806 raft_consensus.cc:1240] T b3f13b31a1f84f0d89d007eadd57924c P b7ab4784c7344b939bc36f639286f377 [term 5 FOLLOWER]: Rejecting Update request from peer ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 4. Current term is 5. Ops: []
I20260709 13:19:13.472785  6878 raft_consensus.cc:2393] T b56bf91d90824c959e21e0cee5ba1816 P cd75a17ab2604397adab03bb8b5fd75c [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate b7ab4784c7344b939bc36f639286f377 in current term 7: Already voted for candidate cd75a17ab2604397adab03bb8b5fd75c in this term.
W20260709 13:19:13.459558  6770 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 133533us
I20260709 13:19:13.463265  6872 pending_rounds.cc:85] T 7c44c4849aa54f2b94d1f1bef9ed546f P cd75a17ab2604397adab03bb8b5fd75c: Aborting all ops after (but not including) 3
I20260709 13:19:13.473959  6872 pending_rounds.cc:107] T 7c44c4849aa54f2b94d1f1bef9ed546f P cd75a17ab2604397adab03bb8b5fd75c: Aborting uncommitted NO_OP operation due to leader change: 6.4
I20260709 13:19:13.474294  6872 raft_consensus.cc:2889] T 7c44c4849aa54f2b94d1f1bef9ed546f P cd75a17ab2604397adab03bb8b5fd75c [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:19:13.476328  6877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "713b5728a197487c9300b310ab94e5a3" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:19:13.456532  6881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20f6842e26174571996b8dea4151d4be" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:19:13.473289  6806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a485a995abc4807b6e511e45419f737" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:19:13.478617  6806 raft_consensus.cc:3060] T 3a485a995abc4807b6e511e45419f737 P b7ab4784c7344b939bc36f639286f377 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:19:13.480260  7496 raft_consensus.cc:1240] T 404190ce4ce94cecbfcb6ea9d1dd8626 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 7 FOLLOWER]: Rejecting Update request from peer b7ab4784c7344b939bc36f639286f377 for earlier term 6. Current term is 7. Ops: [4.6-6.7]
W20260709 13:19:13.482414  6696 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:13.484490  8793 raft_consensus.cc:2749] T d8292e16e5654be6bc408560cf256aaa P ccd8a4c3bfe3413cb2ae219b09aea832 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:19:13.489255  6773 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:13.490792  9121 raft_consensus.cc:515] T 4b8cacb381b746da8d0049b0a83b41dd P ccd8a4c3bfe3413cb2ae219b09aea832 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
W20260709 13:19:13.493683  6847 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:13.493896  6798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22ccee1b570c4ad3a57bd7aec085b1b4" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:19:13.496577  6798 raft_consensus.cc:3060] T 22ccee1b570c4ad3a57bd7aec085b1b4 P b7ab4784c7344b939bc36f639286f377 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:19:13.492566  6804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4275cf08e63345f993bce8664eada830" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:19:13.500618  6772 leader_election.cc:304] T f3f9c2e2bf644115957398fe4c9459db P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:19:13.504647  6805 raft_consensus.cc:1240] T 4d9def8b32fd443aa94ab1420b06837b P b7ab4784c7344b939bc36f639286f377 [term 6 FOLLOWER]: Rejecting Update request from peer ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 5. Current term is 6. Ops: []
I20260709 13:19:13.508818  6802 raft_consensus.cc:1240] T 34f36d59d88f40fe8a2805e604fc6c0a P b7ab4784c7344b939bc36f639286f377 [term 4 FOLLOWER]: Rejecting Update request from peer ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 3. Current term is 4. Ops: [3.3-3.3]
I20260709 13:19:13.471601  9031 raft_consensus.cc:2749] T 4275cf08e63345f993bce8664eada830 P b7ab4784c7344b939bc36f639286f377 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:19:13.513476  6800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7887766dc6784fcaa42b35c05fea7a99" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:19:13.473310  9127 raft_consensus.cc:2804] T 24ee15416e3145beaa1b8183453729a3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:19:13.493542  8940 consensus_queue.cc:1059] T ab432e62819d499eaaf3dd55481dd930 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: INVALID_TERM, Last received: 4.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.040s
I20260709 13:19:13.499532  8347 raft_consensus.cc:3055] T d33d5ee8ef6f415593d8df52063161ad P b7ab4784c7344b939bc36f639286f377 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:19:13.441021  9155 raft_consensus.cc:515] T 20f6842e26174571996b8dea4151d4be P cd75a17ab2604397adab03bb8b5fd75c [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:13.516134  6805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "427c124d773f483294511e80fe340075" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:19:13.516484  6803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09c2a98de1a4decabd0ff900dd44caa" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:19:13.538020  6804 raft_consensus.cc:3060] T 4275cf08e63345f993bce8664eada830 P b7ab4784c7344b939bc36f639286f377 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:13.493269  8986 leader_election.cc:290] T f09c2a98de1a4decabd0ff900dd44caa P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 7 election: Requested vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:13.523303  6772 leader_election.cc:304] T f09c2a98de1a4decabd0ff900dd44caa P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:19:13.524811  6802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90d42e216d9741e190bca19a781291fd" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:19:13.471352  8845 raft_consensus.cc:493] T bd6869f07b5a4885a0b99fbe60c3b175 P cd75a17ab2604397adab03bb8b5fd75c [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
W20260709 13:19:13.547101  7468 leader_election.cc:336] T d8cee0accdb8499c86d4414b72565a38 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931): Timed out: RequestConsensusVote RPC to 127.5.126.67:42931 timed out after 1.644s (SENT)
I20260709 13:19:13.557933  7468 leader_election.cc:304] T d8cee0accdb8499c86d4414b72565a38 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:19:13.559098  6802 raft_consensus.cc:2393] T 90d42e216d9741e190bca19a781291fd P b7ab4784c7344b939bc36f639286f377 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate ccd8a4c3bfe3413cb2ae219b09aea832 in current term 7: Already voted for candidate b7ab4784c7344b939bc36f639286f377 in this term.
I20260709 13:19:13.537935  6803 raft_consensus.cc:2468] T f09c2a98de1a4decabd0ff900dd44caa P b7ab4784c7344b939bc36f639286f377 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 6.
I20260709 13:19:13.520777  6800 raft_consensus.cc:2393] T 7887766dc6784fcaa42b35c05fea7a99 P b7ab4784c7344b939bc36f639286f377 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate ccd8a4c3bfe3413cb2ae219b09aea832 in current term 6: Already voted for candidate b7ab4784c7344b939bc36f639286f377 in this term.
I20260709 13:19:13.494197  8767 consensus_queue.cc:1059] T 2c240553ce044eedb41541d72b9475d7 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.053s
I20260709 13:19:13.558699  6772 leader_election.cc:304] T 4f00a2e87e56452083b759f60d461ee3 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb
I20260709 13:19:13.566763  6802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30e88460611e47b2ba16a46a30b5f416" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:19:13.574744  6798 raft_consensus.cc:2468] T 22ccee1b570c4ad3a57bd7aec085b1b4 P b7ab4784c7344b939bc36f639286f377 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 5.
I20260709 13:19:13.574915  6806 raft_consensus.cc:2468] T 3a485a995abc4807b6e511e45419f737 P b7ab4784c7344b939bc36f639286f377 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 5.
I20260709 13:19:13.529067  8347 raft_consensus.cc:740] T d33d5ee8ef6f415593d8df52063161ad P b7ab4784c7344b939bc36f639286f377 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
I20260709 13:19:13.580679  6770 leader_election.cc:304] T 1528ab62b6fe4e3099d08f141afee116 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:19:13.581890  6804 raft_consensus.cc:2468] T 4275cf08e63345f993bce8664eada830 P b7ab4784c7344b939bc36f639286f377 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 6.
I20260709 13:19:13.557341  8574 raft_consensus.cc:2804] T f3f9c2e2bf644115957398fe4c9459db P b7ab4784c7344b939bc36f639286f377 [term 6 FOLLOWER]: Leader election won for term 6
W20260709 13:19:13.606070  7466 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 86823.8us
I20260709 13:19:13.527592  8793 consensus_queue.cc:1048] T b56bf91d90824c959e21e0cee5ba1816 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.044s
I20260709 13:19:13.610190  7466 leader_election.cc:304] T 7ba5dac66ab5497e9e336f2a3c28cda5 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, b7ab4784c7344b939bc36f639286f377; no voters: 
I20260709 13:19:13.566767  9167 raft_consensus.cc:2804] T f09c2a98de1a4decabd0ff900dd44caa P b7ab4784c7344b939bc36f639286f377 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:19:13.570740  9127 raft_consensus.cc:697] T 24ee15416e3145beaa1b8183453729a3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 6 LEADER]: Becoming Leader. State: Replica: 7ba59cc884714e8aa5f3f0ecaed84cbb, State: Running, Role: LEADER
I20260709 13:19:13.624212  8767 raft_consensus.cc:493] T 3d65025eea89441290d85dd053810e31 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:13.624341  9076 raft_consensus.cc:493] T a3022224cc81473690653a83d4e99470 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:19:13.623946  8986 raft_consensus.cc:493] T 711ef6523deb4cbe8ef2ba61e1c21c98 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:13.578766  9125 raft_consensus.cc:2749] T d8cee0accdb8499c86d4414b72565a38 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:19:13.613349  6802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f58dc08b12a2494bb9a1372837970ca2" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:19:13.564105  9099 consensus_queue.cc:1048] T 7c44c4849aa54f2b94d1f1bef9ed546f P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 1, Time since last communication: 0.054s
I20260709 13:19:13.557765  8832 consensus_queue.cc:1048] T e31b9971c15848dea59d4d4130141d9e P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.054s
I20260709 13:19:13.578840  8845 raft_consensus.cc:515] T bd6869f07b5a4885a0b99fbe60c3b175 P cd75a17ab2604397adab03bb8b5fd75c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:13.634891  6803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a92dd554674067a83a9cb68c4773f2" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:19:14.149736  7500 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50742 (request call id 300) took 1145 ms. Trace:
I20260709 13:19:14.157882  6798 raft_consensus.cc:1275] T 9b3759de40694069b13c0f8bd40e5709 P b7ab4784c7344b939bc36f639286f377 [term 6 FOLLOWER]: Refusing update from remote peer ccd8a4c3bfe3413cb2ae219b09aea832: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
W20260709 13:19:14.164352  6847 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:14.163496  7500 rpcz_store.cc:276] 0709 13:19:13.004548 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:13.004776 (+   228us) service_pool.cc:224] Handling call
0709 13:19:13.005124 (+   348us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:13.290393 (+285269us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:14.149290 (+858897us) spinlock_profiling.cc:243] Waited 284 ms on lock 0x7b540032d2d4. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f9aae01 00007fcc0f9a983e 00007fcc1496e419 00007fcc0dee5bd4 00007fcc0dee5b62 00007fcc0dee5a91 00007fcc0dee5a0c 00007fcc0dee4cc2 00007fcc0dce548c 00007fcc0dce48c6
0709 13:19:14.149644 (+   354us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":653446016}
I20260709 13:19:13.816601  6730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c44c4849aa54f2b94d1f1bef9ed546f" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
W20260709 13:19:13.736454  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 206405us
I20260709 13:19:13.676283  6728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e326172347f45e99a0d482b5d8ef768" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
W20260709 13:19:13.845494  6696 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:13.780834  6724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1528ab62b6fe4e3099d08f141afee116" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:19:14.166399  6802 raft_consensus.cc:1240] T b56bf91d90824c959e21e0cee5ba1816 P b7ab4784c7344b939bc36f639286f377 [term 7 FOLLOWER]: Rejecting Update request from peer ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 6. Current term is 7. Ops: []
I20260709 13:19:13.740171  6731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30e88460611e47b2ba16a46a30b5f416" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:19:14.168732  6731 raft_consensus.cc:2468] T 30e88460611e47b2ba16a46a30b5f416 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 4.
W20260709 13:19:13.648142  6773 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:13.660285  7468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 113250us
W20260709 13:19:14.169451  6770 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.551s	user 0.006s	sys 0.008s
I20260709 13:19:13.636970  6772 leader_election.cc:304] T 3d65025eea89441290d85dd053810e31 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
W20260709 13:19:14.165599  6844 connection.cc:256] RPC call timeout handler was delayed by -3.1651926069998808s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16060000000000002s for a response
I20260709 13:19:13.829079  6725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a92dd554674067a83a9cb68c4773f2" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:19:14.192444  6726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90d42e216d9741e190bca19a781291fd" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
W20260709 13:19:14.192768  6844 connection.cc:256] RPC call timeout handler was delayed by -2.8456926070000463s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19610000000000002s for a response
I20260709 13:19:14.193631  6726 raft_consensus.cc:2368] T 90d42e216d9741e190bca19a781291fd P ccd8a4c3bfe3413cb2ae219b09aea832 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c for earlier term 6. Current term is 7.
W20260709 13:19:14.193361  6844 connection.cc:256] RPC call timeout handler was delayed by -2.4607958700000836s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1958s for a response
W20260709 13:19:14.194149  6844 connection.cc:256] RPC call timeout handler was delayed by -2.3479926069999237s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2514s for a response
W20260709 13:19:14.194525  6844 connection.cc:256] RPC call timeout handler was delayed by -1.9560466900002211s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16770000000000002s for a response
W20260709 13:19:14.194836  6844 connection.cc:256] RPC call timeout handler was delayed by -1.5051466900001742s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2178s for a response
W20260709 13:19:14.195158  6844 connection.cc:256] RPC call timeout handler was delayed by -1.5051466900001742s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2178s for a response
I20260709 13:19:14.195300  6731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a734b5ab7834e05a8c422208acc58b1" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
W20260709 13:19:14.195510  6844 connection.cc:256] RPC call timeout handler was delayed by -1.4772466900001291s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2209s for a response
I20260709 13:19:14.193316  6798 raft_consensus.cc:1275] T 1bf4668eeb70467fb3dc5a0289233b3c P b7ab4784c7344b939bc36f639286f377 [term 5 FOLLOWER]: Refusing update from remote peer ccd8a4c3bfe3413cb2ae219b09aea832: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
W20260709 13:19:14.196004  6844 connection.cc:256] RPC call timeout handler was delayed by -1.1622466900000745s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2559s for a response
I20260709 13:19:14.196377  6731 raft_consensus.cc:2393] T 7a734b5ab7834e05a8c422208acc58b1 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c in current term 6: Already voted for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in this term.
I20260709 13:19:14.197129  6725 raft_consensus.cc:3060] T 07a92dd554674067a83a9cb68c4773f2 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:13.687798  6723 raft_consensus.cc:1240] T 3fa34c08b205435dba97346991aa1f92 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 7 FOLLOWER]: Rejecting Update request from peer cd75a17ab2604397adab03bb8b5fd75c for earlier term 6. Current term is 7. Ops: [6.7-6.7]
W20260709 13:19:14.203244  7468 leader_election.cc:336] T 3fa34c08b205435dba97346991aa1f92 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931): Timed out: RequestConsensusVote RPC to 127.5.126.67:42931 timed out after 1.590s (SENT)
W20260709 13:19:14.171056  6770 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.553s	user 0.006s	sys 0.008s
I20260709 13:19:14.168861  6727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c7f33e544204fbaac4078e3e83bbf4e" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:19:14.202265  6729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3411566abe2d4c9bb4b2adfdd05e6f17" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
W20260709 13:19:13.658545  9044 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.514s	user 0.015s	sys 0.019s
W20260709 13:19:13.821343  9184 log.cc:927] Time spent T 7887766dc6784fcaa42b35c05fea7a99 P ccd8a4c3bfe3413cb2ae219b09aea832: Append to log took a long time: real 0.134s	user 0.000s	sys 0.000s
W20260709 13:19:14.211668  6773 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:13.984073  9129 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.808s	user 0.006s	sys 0.008s
W20260709 13:19:13.940590  9183 log.cc:927] Time spent T d33d5ee8ef6f415593d8df52063161ad P cd75a17ab2604397adab03bb8b5fd75c: Append to log took a long time: real 0.451s	user 0.000s	sys 0.002s
W20260709 13:19:13.819486  9179 log.cc:927] Time spent T a3022224cc81473690653a83d4e99470 P cd75a17ab2604397adab03bb8b5fd75c: Append to log took a long time: real 0.213s	user 0.000s	sys 0.001s
I20260709 13:19:13.629397  9167 raft_consensus.cc:493] T f09c2a98de1a4decabd0ff900dd44caa P b7ab4784c7344b939bc36f639286f377 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:14.207430  6801 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50550 (request call id 199) took 1047 ms. Trace:
I20260709 13:19:13.615432  8862 consensus_queue.cc:1059] T 07a92dd554674067a83a9cb68c4773f2 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.607s
I20260709 13:19:14.218879  6726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f9c2e2bf644115957398fe4c9459db" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:19:13.629067  9156 raft_consensus.cc:2804] T 7ba5dac66ab5497e9e336f2a3c28cda5 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 7 FOLLOWER]: Leader election won for term 7
W20260709 13:19:14.161525  9036 consensus_meta.cc:287] T d8292e16e5654be6bc408560cf256aaa P cd75a17ab2604397adab03bb8b5fd75c: Time spent flushing consensus metadata: real 0.756s	user 0.009s	sys 0.002s
I20260709 13:19:13.611280  9181 raft_consensus.cc:2804] T 4f00a2e87e56452083b759f60d461ee3 P b7ab4784c7344b939bc36f639286f377 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:19:14.221488  6728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d33d5ee8ef6f415593d8df52063161ad" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:19:14.244382  6726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce4f062dcd314d43a63ca74067cb5ee3" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:19:14.245292  6728 raft_consensus.cc:2393] T d33d5ee8ef6f415593d8df52063161ad P ccd8a4c3bfe3413cb2ae219b09aea832 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c in current term 7: Already voted for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in this term.
W20260709 13:19:14.213337  6772 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 576436us
W20260709 13:19:14.218109  9044 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.074s	user 0.065s	sys 0.091s
W20260709 13:19:14.220961  9129 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.098s	user 0.006s	sys 0.012s
I20260709 13:19:13.869064  8793 raft_consensus.cc:493] T 7c44c4849aa54f2b94d1f1bef9ed546f P ccd8a4c3bfe3413cb2ae219b09aea832 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:13.659862  9176 raft_consensus.cc:2749] T 1528ab62b6fe4e3099d08f141afee116 P b7ab4784c7344b939bc36f639286f377 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:19:13.917484  9121 leader_election.cc:290] T 4b8cacb381b746da8d0049b0a83b41dd P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 7 election: Requested vote from peers cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:19:14.223228  6727 raft_consensus.cc:2468] T 8c7f33e544204fbaac4078e3e83bbf4e P ccd8a4c3bfe3413cb2ae219b09aea832 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 3.
W20260709 13:19:14.224727  6770 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 644080us
I20260709 13:19:14.261107  6770 leader_election.cc:304] T 22ccee1b570c4ad3a57bd7aec085b1b4 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:19:14.198141  9076 raft_consensus.cc:515] T a3022224cc81473690653a83d4e99470 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:14.219632  6731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3d8792045a4583ae2e965b1350a5b4" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
W20260709 13:19:14.225917  6696 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:14.002451  9164 raft_consensus.cc:3055] T ab432e62819d499eaaf3dd55481dd930 P b7ab4784c7344b939bc36f639286f377 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:19:14.264895  9164 raft_consensus.cc:740] T ab432e62819d499eaaf3dd55481dd930 P b7ab4784c7344b939bc36f639286f377 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
I20260709 13:19:14.265506  9199 consensus_queue.cc:1059] T 34f36d59d88f40fe8a2805e604fc6c0a P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:19:14.265920  9164 consensus_queue.cc:260] T ab432e62819d499eaaf3dd55481dd930 P b7ab4784c7344b939bc36f639286f377 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 6.3, Last appended by leader: 3, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:14.267216  9164 raft_consensus.cc:3060] T ab432e62819d499eaaf3dd55481dd930 P b7ab4784c7344b939bc36f639286f377 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:19:14.195540  8673 consensus_meta.cc:287] T de3186201e1a40d0b335eeb8b4e256e0 P ccd8a4c3bfe3413cb2ae219b09aea832: Time spent flushing consensus metadata: real 0.838s	user 0.012s	sys 0.001s
I20260709 13:19:14.269778  9206 raft_consensus.cc:3055] T 07a92dd554674067a83a9cb68c4773f2 P b7ab4784c7344b939bc36f639286f377 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:19:14.270238  9206 raft_consensus.cc:740] T 07a92dd554674067a83a9cb68c4773f2 P b7ab4784c7344b939bc36f639286f377 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
I20260709 13:19:14.271165  9206 consensus_queue.cc:260] T 07a92dd554674067a83a9cb68c4773f2 P b7ab4784c7344b939bc36f639286f377 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
W20260709 13:19:14.272130  7469 thread.cc:641] server-negotiator [worker] (thread pool) Time spent creating pthread: real 0.575s	user 0.031s	sys 0.060s
W20260709 13:19:14.272574  7469 thread.cc:608] server-negotiator [worker] (thread pool) Time spent starting thread: real 0.774s	user 0.032s	sys 0.060s
W20260709 13:19:14.250021  8574 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.585s	user 0.017s	sys 0.019s
W20260709 13:19:13.820379  9180 log.cc:927] Time spent T ce4f062dcd314d43a63ca74067cb5ee3 P 7ba59cc884714e8aa5f3f0ecaed84cbb: Append to log took a long time: real 0.214s	user 0.001s	sys 0.000s
I20260709 13:19:13.635612  7496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce4f062dcd314d43a63ca74067cb5ee3" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:19:14.233455  6844 leader_election.cc:304] T f58dc08b12a2494bb9a1372837970ca2 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:19:14.233686  6729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c37d41cd9164c15a6826ca62a851a69" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
W20260709 13:19:14.227903  6697 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.727s	user 0.021s	sys 0.024s
I20260709 13:19:14.289227  6729 raft_consensus.cc:2468] T 7c37d41cd9164c15a6826ca62a851a69 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 4.
I20260709 13:19:14.241077  6723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4b8bd455d5a47c18a1380839c6e0d61" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:19:14.230443  6801 rpcz_store.cc:276] 0709 13:19:13.159868 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:13.169593 (+  9725us) service_pool.cc:224] Handling call
0709 13:19:13.183114 (+ 13521us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:13.190097 (+  6983us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:13.190132 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:13.378807 (+188675us) spinlock_profiling.cc:243] Waited 3.49 ms on lock 0x7b1800278800. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc15785de1 00007fcc157925b1 00007fcc0c88b2a6 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0e2a3a11 00007fcc0e2b3372 00007fcc0f9e5a01 00007fcc0f9aa43a
0709 13:19:13.492437 (+113630us) spinlock_profiling.cc:243] Waited 2.3 ms on lock 0x7b2c00117598. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0e2a3a11 00007fcc0e2b3372 00007fcc0f9e5a01 00007fcc0f9aa43a 00007fcc0f9a983e 00007fcc1496e419 00007fcc0dee5bd4 00007fcc0dee5b62 00007fcc0dee5a91 00007fcc0dee5a0c 00007fcc0dee4cc2
0709 13:19:13.492996 (+   559us) log.cc:844] Serialized 26 byte log entry
0709 13:19:13.607326 (+114330us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:19:13.607364 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:13.607433 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:14.207132 (+599699us) raft_consensus.cc:1685] finished
0709 13:19:14.207160 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:14.207350 (+   190us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":147,"raft.run_cpu_time_us":147,"raft.run_wall_time_us":4862,"spinlock_wait_cycles":13317120,"thread_start_us":112563,"threads_started":1,"wal-append.queue_time_us":325459}
W20260709 13:19:14.254325  7468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 72737us
I20260709 13:19:14.232599  9167 raft_consensus.cc:3060] T f09c2a98de1a4decabd0ff900dd44caa P b7ab4784c7344b939bc36f639286f377 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:14.198236  8986 raft_consensus.cc:515] T 711ef6523deb4cbe8ef2ba61e1c21c98 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:14.218935  9193 consensus_queue.cc:1059] T b3f13b31a1f84f0d89d007eadd57924c P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.029s
I20260709 13:19:13.687697  8347 consensus_queue.cc:260] T d33d5ee8ef6f415593d8df52063161ad P b7ab4784c7344b939bc36f639286f377 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:14.275796  6725 raft_consensus.cc:2468] T 07a92dd554674067a83a9cb68c4773f2 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 6.
I20260709 13:19:14.227581  6724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bf4668eeb70467fb3dc5a0289233b3c" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:19:14.263362  6726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c240553ce044eedb41541d72b9475d7" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:19:14.247246  9031 raft_consensus.cc:2804] T 3d65025eea89441290d85dd053810e31 P b7ab4784c7344b939bc36f639286f377 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:19:14.220717  8767 raft_consensus.cc:515] T 3d65025eea89441290d85dd053810e31 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:14.280479  9206 raft_consensus.cc:3060] T 07a92dd554674067a83a9cb68c4773f2 P b7ab4784c7344b939bc36f639286f377 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:14.233374  9065 consensus_queue.cc:1059] T 4d9def8b32fd443aa94ab1420b06837b P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.029s
I20260709 13:19:14.250983  9156 raft_consensus.cc:697] T 7ba5dac66ab5497e9e336f2a3c28cda5 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 7 LEADER]: Becoming Leader. State: Replica: 7ba59cc884714e8aa5f3f0ecaed84cbb, State: Running, Role: LEADER
I20260709 13:19:14.308581  9076 leader_election.cc:290] T a3022224cc81473690653a83d4e99470 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:14.041828  9127 consensus_queue.cc:237] T 24ee15416e3145beaa1b8183453729a3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 6, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } attrs { replace: true } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:19:14.253232  9155 leader_election.cc:290] T 20f6842e26174571996b8dea4151d4be P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 6 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
W20260709 13:19:14.289399  6697 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.790s	user 0.021s	sys 0.025s
W20260709 13:19:14.317162  6697 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 841078us
I20260709 13:19:13.615568  8963 consensus_queue.cc:1059] T d8cee0accdb8499c86d4414b72565a38 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.605s
I20260709 13:19:14.317873  6697 leader_election.cc:304] T 4275cf08e63345f993bce8664eada830 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
W20260709 13:19:14.295696  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 62334.2us
W20260709 13:19:14.293965  7468 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.5.126.67:42931 timed out after 2.108s (SENT) [suppressed 33 similar messages]
I20260709 13:19:14.255349  8793 raft_consensus.cc:515] T 7c44c4849aa54f2b94d1f1bef9ed546f P ccd8a4c3bfe3413cb2ae219b09aea832 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
W20260709 13:19:14.292167  8574 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.634s	user 0.017s	sys 0.020s
I20260709 13:19:14.300004  9031 raft_consensus.cc:493] T 3d65025eea89441290d85dd053810e31 P b7ab4784c7344b939bc36f639286f377 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:19:14.347635  6772 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.68:45071, user_credentials={real_user=slave}} blocked reactor thread for 58089.7us
I20260709 13:19:14.348316  6697 leader_election.cc:304] T 30e88460611e47b2ba16a46a30b5f416 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:19:14.290220  9099 raft_consensus.cc:2749] T 22ccee1b570c4ad3a57bd7aec085b1b4 P b7ab4784c7344b939bc36f639286f377 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:19:14.299515  9100 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.767s	user 0.010s	sys 0.024s
I20260709 13:19:14.301628  9186 raft_consensus.cc:2749] T f58dc08b12a2494bb9a1372837970ca2 P cd75a17ab2604397adab03bb8b5fd75c [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:19:14.343674  9190 log.cc:927] Time spent T 3fa34c08b205435dba97346991aa1f92 P 7ba59cc884714e8aa5f3f0ecaed84cbb: Append to log took a long time: real 0.137s	user 0.001s	sys 0.000s
I20260709 13:19:14.377274  9181 raft_consensus.cc:493] T 4f00a2e87e56452083b759f60d461ee3 P b7ab4784c7344b939bc36f639286f377 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 7ba59cc884714e8aa5f3f0ecaed84cbb)
I20260709 13:19:14.386464  6730 raft_consensus.cc:2468] T 7c44c4849aa54f2b94d1f1bef9ed546f P ccd8a4c3bfe3413cb2ae219b09aea832 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 7.
I20260709 13:19:14.356849  6697 leader_election.cc:304] T f58dc08b12a2494bb9a1372837970ca2 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
W20260709 13:19:14.386440  6773 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:14.296013  9204 consensus_queue.cc:1059] T f58dc08b12a2494bb9a1372837970ca2 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.062s
I20260709 13:19:14.395916  6697 leader_election.cc:304] T 90d42e216d9741e190bca19a781291fd P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377
I20260709 13:19:14.351809  9031 raft_consensus.cc:3060] T 3d65025eea89441290d85dd053810e31 P b7ab4784c7344b939bc36f639286f377 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:14.309096  9156 consensus_queue.cc:237] T 7ba5dac66ab5497e9e336f2a3c28cda5 P 7ba59cc884714e8aa5f3f0ecaed84cbb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
W20260709 13:19:14.402251  6770 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 141229us
I20260709 13:19:14.402561  8990 raft_consensus.cc:3060] T bb3d8792045a4583ae2e965b1350a5b4 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:19:14.376147  8827 raft_consensus.cc:2804] T 4275cf08e63345f993bce8664eada830 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 6 FOLLOWER]: Leader election won for term 6
W20260709 13:19:14.388983  9100 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.855s	user 0.011s	sys 0.025s
I20260709 13:19:14.382860  9199 raft_consensus.cc:2804] T 30e88460611e47b2ba16a46a30b5f416 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:19:14.378153  8845 leader_election.cc:290] T bd6869f07b5a4885a0b99fbe60c3b175 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:19:14.377792  8767 leader_election.cc:290] T 3d65025eea89441290d85dd053810e31 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:14.343662  8574 raft_consensus.cc:697] T f3f9c2e2bf644115957398fe4c9459db P b7ab4784c7344b939bc36f639286f377 [term 6 LEADER]: Becoming Leader. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
I20260709 13:19:14.391870  9181 raft_consensus.cc:3060] T 4f00a2e87e56452083b759f60d461ee3 P b7ab4784c7344b939bc36f639286f377 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:14.430042  6732 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:38536 (request call id 10) took 1204 ms. Trace:
I20260709 13:19:14.474711  6732 rpcz_store.cc:276] 0709 13:19:13.226159 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:13.226510 (+   351us) service_pool.cc:224] Handling call
0709 13:19:14.405104 (+1178594us) spinlock_profiling.cc:243] Waited 36.5 ms on lock 0x7b5400058a54. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f9a4853 00007fcc1497260a 00007fcc0def87d4 00007fcc0def8762 00007fcc0def8691 00007fcc0def860c 00007fcc0def78c2 00007fcc0dce548c 00007fcc0dce48c6 00007fcc0dce426f
0709 13:19:14.429941 (+ 24837us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":84013440}
I20260709 13:19:14.435092  9199 raft_consensus.cc:493] T 30e88460611e47b2ba16a46a30b5f416 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 4 FOLLOWER]: Starting leader election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:19:14.379791  8440 consensus_queue.cc:1059] T 404190ce4ce94cecbfcb6ea9d1dd8626 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.051s
I20260709 13:19:14.435490  6805 raft_consensus.cc:1275] T b3f13b31a1f84f0d89d007eadd57924c P b7ab4784c7344b939bc36f639286f377 [term 5 FOLLOWER]: Refusing update from remote peer 7ba59cc884714e8aa5f3f0ecaed84cbb: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:19:14.479094  8440 raft_consensus.cc:3055] T 404190ce4ce94cecbfcb6ea9d1dd8626 P b7ab4784c7344b939bc36f639286f377 [term 6 LEADER]: Stepping down as leader of term 6
W20260709 13:19:14.481102  9200 log.cc:927] Time spent T 404190ce4ce94cecbfcb6ea9d1dd8626 P ccd8a4c3bfe3413cb2ae219b09aea832: Append to log took a long time: real 0.169s	user 0.000s	sys 0.000s
I20260709 13:19:14.432224  6770 leader_election.cc:304] T 427c124d773f483294511e80fe340075 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:19:14.459280  8845 consensus_queue.cc:1048] T e77e330a82df4b43a745d57a68f6f057 P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Connected to new peer: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:19:14.470515  8574 consensus_queue.cc:237] T f3f9c2e2bf644115957398fe4c9459db P b7ab4784c7344b939bc36f639286f377 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:14.477411  9199 raft_consensus.cc:3060] T 30e88460611e47b2ba16a46a30b5f416 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:19:14.511731  6697 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 57520.3us
I20260709 13:19:14.396335  9065 raft_consensus.cc:2804] T f58dc08b12a2494bb9a1372837970ca2 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 8 FOLLOWER]: Leader election won for term 8
W20260709 13:19:14.480924  7468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 186931us
I20260709 13:19:14.448532  6844 leader_election.cc:304] T 7887766dc6784fcaa42b35c05fea7a99 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
W20260709 13:19:14.484773  6770 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 53286us
W20260709 13:19:14.488160  7466 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 99497.4us
W20260709 13:19:14.518496  6847 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:14.488160  9137 raft_consensus.cc:2749] T 427c124d773f483294511e80fe340075 P b7ab4784c7344b939bc36f639286f377 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:19:14.452135  9117 raft_consensus.cc:2804] T 90d42e216d9741e190bca19a781291fd P ccd8a4c3bfe3413cb2ae219b09aea832 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:19:14.445839  8827 raft_consensus.cc:697] T 4275cf08e63345f993bce8664eada830 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 6 LEADER]: Becoming Leader. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
I20260709 13:19:14.534809  6770 leader_election.cc:304] T a1704639a875409b9959353527b3fd68 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:19:14.550361  6880 raft_consensus.cc:1240] T 2c240553ce044eedb41541d72b9475d7 P cd75a17ab2604397adab03bb8b5fd75c [term 7 FOLLOWER]: Rejecting Update request from peer ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 13:19:14.449065  9155 raft_consensus.cc:493] T 34f36d59d88f40fe8a2805e604fc6c0a P cd75a17ab2604397adab03bb8b5fd75c [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
W20260709 13:19:14.319077  9202 consensus_queue.cc:1175] T d33d5ee8ef6f415593d8df52063161ad P b7ab4784c7344b939bc36f639286f377 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "cd75a17ab2604397adab03bb8b5fd75c" responder_term: 6 status { last_received { term: 6 index: 4 } last_committed_idx: 4 last_received_current_leader { term: 6 index: 4 } }
I20260709 13:19:14.571178  6874 raft_consensus.cc:1240] T f3f9c2e2bf644115957398fe4c9459db P cd75a17ab2604397adab03bb8b5fd75c [term 6 FOLLOWER]: Rejecting Update request from peer ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 5. Current term is 6. Ops: []
I20260709 13:19:14.566955  6879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09c2a98de1a4decabd0ff900dd44caa" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:19:14.573663  6802 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:32976 (request call id 2172) took 1066 ms. Trace:
I20260709 13:19:14.595009  6879 raft_consensus.cc:3060] T f09c2a98de1a4decabd0ff900dd44caa P cd75a17ab2604397adab03bb8b5fd75c [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:14.581846  6877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b8cacb381b746da8d0049b0a83b41dd" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:19:14.512676  9186 raft_consensus.cc:493] T 3fa34c08b205435dba97346991aa1f92 P cd75a17ab2604397adab03bb8b5fd75c [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:14.587435  6878 raft_consensus.cc:1240] T b56bf91d90824c959e21e0cee5ba1816 P cd75a17ab2604397adab03bb8b5fd75c [term 7 FOLLOWER]: Rejecting Update request from peer ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 13:19:14.483798  8440 raft_consensus.cc:740] T 404190ce4ce94cecbfcb6ea9d1dd8626 P b7ab4784c7344b939bc36f639286f377 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
I20260709 13:19:14.445819  9121 consensus_queue.cc:1059] T 4d9def8b32fd443aa94ab1420b06837b P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.111s
W20260709 13:19:14.610726  6773 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:14.611168  6878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3022224cc81473690653a83d4e99470" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:19:14.595255  6802 rpcz_store.cc:276] 0709 13:19:13.507086 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:14.201193 (+694107us) service_pool.cc:224] Handling call
0709 13:19:14.201441 (+   248us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:14.201627 (+   186us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:19:14.393230 (+191603us) log.cc:844] Serialized 14 byte log entry
0709 13:19:14.568749 (+175519us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:14.568864 (+   115us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:19:14.568951 (+    87us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:14.569033 (+    82us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:14.573542 (+  4509us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":308928,"prepare.run_wall_time_us":206,"raft.queue_time_us":304,"thread_start_us":366293,"threads_started":2}
I20260709 13:19:14.524159  9205 raft_consensus.cc:493] T 1528ab62b6fe4e3099d08f141afee116 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 7ba59cc884714e8aa5f3f0ecaed84cbb)
I20260709 13:19:14.642127  6877 raft_consensus.cc:1275] T ab432e62819d499eaaf3dd55481dd930 P cd75a17ab2604397adab03bb8b5fd75c [term 7 FOLLOWER]: Refusing update from remote peer ccd8a4c3bfe3413cb2ae219b09aea832: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 7 index: 3. (index mismatch)
W20260709 13:19:14.766294  6773 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:14.835243  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 386866us
W20260709 13:19:14.759558  6847 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:14.847267  6770 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 312881us
I20260709 13:19:14.647809  6877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d65025eea89441290d85dd053810e31" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:19:14.859783  6877 raft_consensus.cc:2410] T 3d65025eea89441290d85dd053810e31 P cd75a17ab2604397adab03bb8b5fd75c [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ccd8a4c3bfe3413cb2ae219b09aea832 for term 6 because replica has last-logged OpId of term: 4 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:19:14.656172  6878 raft_consensus.cc:1275] T 1bf4668eeb70467fb3dc5a0289233b3c P cd75a17ab2604397adab03bb8b5fd75c [term 5 FOLLOWER]: Refusing update from remote peer ccd8a4c3bfe3413cb2ae219b09aea832: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:19:14.590909  9036 raft_consensus.cc:2749] T 7887766dc6784fcaa42b35c05fea7a99 P cd75a17ab2604397adab03bb8b5fd75c [term 6 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:19:14.864982  6773 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:14.861567  8845 raft_consensus.cc:493] T de3186201e1a40d0b335eeb8b4e256e0 P cd75a17ab2604397adab03bb8b5fd75c [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:19:14.699882  9205 raft_consensus.cc:515] T 1528ab62b6fe4e3099d08f141afee116 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } attrs { replace: true } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:19:14.869517  6770 leader_election.cc:304] T be1a92657f494cac8dd227d152f50151 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, ccd8a4c3bfe3413cb2ae219b09aea832
W20260709 13:19:14.826922  9198 log.cc:927] Time spent T 2c240553ce044eedb41541d72b9475d7 P b7ab4784c7344b939bc36f639286f377: Append to log took a long time: real 0.206s	user 0.002s	sys 0.000s
I20260709 13:19:14.887498  6874 raft_consensus.cc:1275] T 7887766dc6784fcaa42b35c05fea7a99 P cd75a17ab2604397adab03bb8b5fd75c [term 6 FOLLOWER]: Refusing update from remote peer ccd8a4c3bfe3413cb2ae219b09aea832: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 6 index: 3. (index mismatch)
I20260709 13:19:14.893869  6770 leader_election.cc:304] T f03d0dbf16864ca4bc1bb5e4c0334c0f P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:19:14.820314  8986 leader_election.cc:290] T 711ef6523deb4cbe8ef2ba61e1c21c98 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:14.679538  8793 leader_election.cc:290] T 7c44c4849aa54f2b94d1f1bef9ed546f P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:14.599615  9155 raft_consensus.cc:515] T 34f36d59d88f40fe8a2805e604fc6c0a P cd75a17ab2604397adab03bb8b5fd75c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:14.908656  6879 raft_consensus.cc:2468] T f09c2a98de1a4decabd0ff900dd44caa P cd75a17ab2604397adab03bb8b5fd75c [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 7.
I20260709 13:19:14.804764  9212 raft_consensus.cc:2749] T a1704639a875409b9959353527b3fd68 P b7ab4784c7344b939bc36f639286f377 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:19:14.883882  8673 raft_consensus.cc:493] T 20f6842e26174571996b8dea4151d4be P ccd8a4c3bfe3413cb2ae219b09aea832 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:14.629633  9186 raft_consensus.cc:515] T 3fa34c08b205435dba97346991aa1f92 P cd75a17ab2604397adab03bb8b5fd75c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:19:14.926587  9181 raft_consensus.cc:515] T 4f00a2e87e56452083b759f60d461ee3 P b7ab4784c7344b939bc36f639286f377 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:19:14.892782  8767 raft_consensus.cc:493] T f5be3a11b23d4ea9b08300a2789821c7 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:19:14.900539  9121 raft_consensus.cc:493] T bd6869f07b5a4885a0b99fbe60c3b175 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:19:14.888420  8845 raft_consensus.cc:515] T de3186201e1a40d0b335eeb8b4e256e0 P cd75a17ab2604397adab03bb8b5fd75c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:14.934178  9176 raft_consensus.cc:2749] T be1a92657f494cac8dd227d152f50151 P b7ab4784c7344b939bc36f639286f377 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:19:14.828902  8827 consensus_queue.cc:237] T 4275cf08e63345f993bce8664eada830 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:14.936605  9210 raft_consensus.cc:2749] T f03d0dbf16864ca4bc1bb5e4c0334c0f P b7ab4784c7344b939bc36f639286f377 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:19:14.745184  8440 consensus_queue.cc:260] T 404190ce4ce94cecbfcb6ea9d1dd8626 P b7ab4784c7344b939bc36f639286f377 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:19:14.942281  6844 leader_election.cc:304] T fe20b4b48823486ca3b9c648db6ce8aa P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb
W20260709 13:19:14.943459  8990 consensus_meta.cc:287] T bb3d8792045a4583ae2e965b1350a5b4 P ccd8a4c3bfe3413cb2ae219b09aea832: Time spent flushing consensus metadata: real 0.510s	user 0.021s	sys 0.000s
I20260709 13:19:14.944413  9036 consensus_queue.cc:1059] T 9b3759de40694069b13c0f8bd40e5709 P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:19:14.945046  9046 raft_consensus.cc:3060] T 853ac0a8cbd64ce99457f170216d4d0f P b7ab4784c7344b939bc36f639286f377 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:19:14.913087  9197 log.cc:927] Time spent T e31b9971c15848dea59d4d4130141d9e P cd75a17ab2604397adab03bb8b5fd75c: Append to log took a long time: real 0.258s	user 0.000s	sys 0.002s
W20260709 13:19:14.956228  6847 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:14.960906  6697 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:14.945309  9155 leader_election.cc:290] T 34f36d59d88f40fe8a2805e604fc6c0a P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:19:14.978370  6695 leader_election.cc:304] T 22ccee1b570c4ad3a57bd7aec085b1b4 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: cd75a17ab2604397adab03bb8b5fd75c
W20260709 13:19:14.980726  6771 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:14.928603  8673 raft_consensus.cc:515] T 20f6842e26174571996b8dea4151d4be P ccd8a4c3bfe3413cb2ae219b09aea832 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
W20260709 13:19:14.963819  9204 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.519s	user 0.004s	sys 0.004s
I20260709 13:19:14.983479  6799 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:32976 (request call id 2159) took 1509 ms. Trace:
W20260709 13:19:14.985854  6771 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:14.987769  6799 rpcz_store.cc:276] 0709 13:19:13.467004 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:13.494062 (+ 27058us) service_pool.cc:224] Handling call
0709 13:19:13.512769 (+ 18707us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:13.528432 (+ 15663us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:13.528475 (+    43us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:13.531269 (+  2794us) log.cc:844] Serialized 26 byte log entry
0709 13:19:13.929905 (+398636us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:19:13.929962 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:13.930118 (+   156us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:14.976341 (+1046223us) raft_consensus.cc:1685] finished
0709 13:19:14.976364 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:14.976530 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7912,"raft.queue_time_us":21555,"raft.run_cpu_time_us":226,"raft.run_wall_time_us":29596,"thread_start_us":398168,"threads_started":1,"wal-append.queue_time_us":820510}
W20260709 13:19:14.996392  6724 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.556s	user 0.000s	sys 0.008s
W20260709 13:19:14.996964  6724 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.556s	user 0.000s	sys 0.008s
W20260709 13:19:14.990489  7466 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 457359us
W20260709 13:19:15.004340  9164 consensus_meta.cc:287] T ab432e62819d499eaaf3dd55481dd930 P b7ab4784c7344b939bc36f639286f377: Time spent flushing consensus metadata: real 0.737s	user 0.020s	sys 0.005s
I20260709 13:19:14.974308  9117 raft_consensus.cc:697] T 90d42e216d9741e190bca19a781291fd P ccd8a4c3bfe3413cb2ae219b09aea832 [term 7 LEADER]: Becoming Leader. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
I20260709 13:19:14.960772  9121 raft_consensus.cc:515] T bd6869f07b5a4885a0b99fbe60c3b175 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:14.963368  8767 raft_consensus.cc:515] T f5be3a11b23d4ea9b08300a2789821c7 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:14.976596  9065 raft_consensus.cc:697] T f58dc08b12a2494bb9a1372837970ca2 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 8 LEADER]: Becoming Leader. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
I20260709 13:19:15.013918  6802 raft_consensus.cc:1275] T f4b8bd455d5a47c18a1380839c6e0d61 P b7ab4784c7344b939bc36f639286f377 [term 5 FOLLOWER]: Refusing update from remote peer ccd8a4c3bfe3413cb2ae219b09aea832: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:19:15.014727  6799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77e330a82df4b43a745d57a68f6f057" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:19:15.019243  6799 raft_consensus.cc:3060] T e77e330a82df4b43a745d57a68f6f057 P b7ab4784c7344b939bc36f639286f377 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:15.020399  6804 raft_consensus.cc:1240] T 713b5728a197487c9300b310ab94e5a3 P b7ab4784c7344b939bc36f639286f377 [term 6 FOLLOWER]: Rejecting Update request from peer ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 5. Current term is 6. Ops: []
I20260709 13:19:14.989785  9155 raft_consensus.cc:2804] T fe20b4b48823486ca3b9c648db6ce8aa P cd75a17ab2604397adab03bb8b5fd75c [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:19:14.991911  8940 raft_consensus.cc:493] T bb7fa124c3bf4ef9ab65a407cb008441 P b7ab4784c7344b939bc36f639286f377 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:14.990415  9204 consensus_queue.cc:1243] T f58dc08b12a2494bb9a1372837970ca2 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Peer cd75a17ab2604397adab03bb8b5fd75c log is divergent from this leader: its last log entry 4.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260709 13:19:15.024153  6806 raft_consensus.cc:1275] T 7887766dc6784fcaa42b35c05fea7a99 P b7ab4784c7344b939bc36f639286f377 [term 6 FOLLOWER]: Refusing update from remote peer ccd8a4c3bfe3413cb2ae219b09aea832: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 6 index: 3. (index mismatch)
I20260709 13:19:15.011698  6695 leader_election.cc:304] T 427c124d773f483294511e80fe340075 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, b7ab4784c7344b939bc36f639286f377
W20260709 13:19:15.023932  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 81754.1us
W20260709 13:19:15.027575  6770 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 133790us
I20260709 13:19:15.002358  9137 raft_consensus.cc:493] T 1bf4668eeb70467fb3dc5a0289233b3c P b7ab4784c7344b939bc36f639286f377 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:15.005578  8440 raft_consensus.cc:3060] T 404190ce4ce94cecbfcb6ea9d1dd8626 P b7ab4784c7344b939bc36f639286f377 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:15.033269  6806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "711ef6523deb4cbe8ef2ba61e1c21c98" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:19:15.002348  8990 raft_consensus.cc:493] T dbdf895bba214ff68685a24fd17dfb5d P ccd8a4c3bfe3413cb2ae219b09aea832 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:19:15.038357  6879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "711ef6523deb4cbe8ef2ba61e1c21c98" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:19:15.042945  6879 raft_consensus.cc:2468] T 711ef6523deb4cbe8ef2ba61e1c21c98 P cd75a17ab2604397adab03bb8b5fd75c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 6.
I20260709 13:19:15.043432  6695 leader_election.cc:304] T 3a485a995abc4807b6e511e45419f737 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:19:15.038866  6804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09c2a98de1a4decabd0ff900dd44caa" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:19:15.039549  6801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3022224cc81473690653a83d4e99470" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:19:15.046088  6879 raft_consensus.cc:1275] T 3411566abe2d4c9bb4b2adfdd05e6f17 P cd75a17ab2604397adab03bb8b5fd75c [term 5 FOLLOWER]: Refusing update from remote peer ccd8a4c3bfe3413cb2ae219b09aea832: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:19:15.045984  6803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d65025eea89441290d85dd053810e31" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:19:15.026234  9155 raft_consensus.cc:493] T fe20b4b48823486ca3b9c648db6ce8aa P cd75a17ab2604397adab03bb8b5fd75c [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:15.047107  6806 raft_consensus.cc:2468] T 711ef6523deb4cbe8ef2ba61e1c21c98 P b7ab4784c7344b939bc36f639286f377 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 6.
I20260709 13:19:15.068441  6881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c44c4849aa54f2b94d1f1bef9ed546f" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 8 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:19:15.055279  6728 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f4b8bd455d5a47c18a1380839c6e0d61"
dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
mode: GRACEFUL
new_leader_uuid: "b7ab4784c7344b939bc36f639286f377"
 from {username='slave'} at 127.0.0.1:38536
I20260709 13:19:15.055692  6806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c44c4849aa54f2b94d1f1bef9ed546f" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 8 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:19:15.070083  6728 raft_consensus.cc:606] T f4b8bd455d5a47c18a1380839c6e0d61 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 5 LEADER]: Received request to transfer leadership to TS b7ab4784c7344b939bc36f639286f377
I20260709 13:19:15.034998  9218 raft_consensus.cc:2804] T 22ccee1b570c4ad3a57bd7aec085b1b4 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 5 FOLLOWER]: Leader election won for term 5
W20260709 13:19:15.068177  9211 log.cc:927] Time spent T 95a75bfe094d4bdc963aba3f08dfcd25 P b7ab4784c7344b939bc36f639286f377: Append to log took a long time: real 0.241s	user 0.002s	sys 0.000s
I20260709 13:19:15.054378  8986 raft_consensus.cc:2804] T 3a485a995abc4807b6e511e45419f737 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:19:15.034379  8940 raft_consensus.cc:515] T bb7fa124c3bf4ef9ab65a407cb008441 P b7ab4784c7344b939bc36f639286f377 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:19:15.043965  9137 raft_consensus.cc:515] T 1bf4668eeb70467fb3dc5a0289233b3c P b7ab4784c7344b939bc36f639286f377 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
W20260709 13:19:15.101858  6770 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 54899.1us
I20260709 13:19:15.102741  9209 raft_consensus.cc:493] T 44bde925b2e541b69890d70715b85176 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:19:15.103245  9194 raft_consensus.cc:493] T d33d5ee8ef6f415593d8df52063161ad P ccd8a4c3bfe3413cb2ae219b09aea832 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:15.070333  9155 raft_consensus.cc:3060] T fe20b4b48823486ca3b9c648db6ce8aa P cd75a17ab2604397adab03bb8b5fd75c [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:19:15.120262  6801 raft_consensus.cc:1275] T 3411566abe2d4c9bb4b2adfdd05e6f17 P b7ab4784c7344b939bc36f639286f377 [term 5 FOLLOWER]: Refusing update from remote peer ccd8a4c3bfe3413cb2ae219b09aea832: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:19:15.119663  6770 leader_election.cc:304] T 7a734b5ab7834e05a8c422208acc58b1 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:19:15.058444  9181 leader_election.cc:290] T 4f00a2e87e56452083b759f60d461ee3 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 7 election: Requested vote from peers cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
W20260709 13:19:15.123492  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 81114.7us
I20260709 13:19:15.125522  9236 raft_consensus.cc:2749] T 7a734b5ab7834e05a8c422208acc58b1 P b7ab4784c7344b939bc36f639286f377 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:19:15.124677  6770 leader_election.cc:304] T 9e326172347f45e99a0d482b5d8ef768 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:19:15.068061  8990 raft_consensus.cc:515] T dbdf895bba214ff68685a24fd17dfb5d P ccd8a4c3bfe3413cb2ae219b09aea832 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:15.159314  6801 raft_consensus.cc:1275] T ab432e62819d499eaaf3dd55481dd930 P b7ab4784c7344b939bc36f639286f377 [term 7 FOLLOWER]: Refusing update from remote peer ccd8a4c3bfe3413cb2ae219b09aea832: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 7 index: 3. (term mismatch)
I20260709 13:19:15.160512  6801 pending_rounds.cc:85] T ab432e62819d499eaaf3dd55481dd930 P b7ab4784c7344b939bc36f639286f377: Aborting all ops after (but not including) 2
I20260709 13:19:15.160763  6801 pending_rounds.cc:107] T ab432e62819d499eaaf3dd55481dd930 P b7ab4784c7344b939bc36f639286f377: Aborting uncommitted NO_OP operation due to leader change: 6.3
I20260709 13:19:15.161039  6801 raft_consensus.cc:2889] T ab432e62819d499eaaf3dd55481dd930 P b7ab4784c7344b939bc36f639286f377 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:19:15.115746  9241 raft_consensus.cc:493] T c4db81d9d329422bb3b4160ca4ac2d1d P cd75a17ab2604397adab03bb8b5fd75c [term 6 FOLLOWER]: Starting pre-election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:19:15.100190  9225 consensus_queue.cc:1048] T b3f13b31a1f84f0d89d007eadd57924c P 7ba59cc884714e8aa5f3f0ecaed84cbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.033s
W20260709 13:19:15.158782  6695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 108882us
I20260709 13:19:15.170120  6798 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:32976 (request call id 2171) took 1663 ms. Trace:
I20260709 13:19:15.170619  6798 rpcz_store.cc:276] 0709 13:19:13.506816 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:14.196971 (+690155us) service_pool.cc:224] Handling call
0709 13:19:14.197385 (+   414us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:14.209929 (+ 12544us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:14.209976 (+    47us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:14.210633 (+   657us) log.cc:844] Serialized 26 byte log entry
0709 13:19:14.397954 (+187321us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:19:14.398013 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:14.398119 (+   106us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:15.169884 (+771765us) raft_consensus.cc:1685] finished
0709 13:19:15.169906 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:15.170051 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":19731,"raft.run_cpu_time_us":132,"raft.run_wall_time_us":2779,"thread_start_us":147650,"threads_started":1,"wal-append.queue_time_us":303559}
I20260709 13:19:15.153568  8845 leader_election.cc:290] T de3186201e1a40d0b335eeb8b4e256e0 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
W20260709 13:19:15.179229  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 53303.7us
I20260709 13:19:15.181284  6844 leader_election.cc:304] T 30e88460611e47b2ba16a46a30b5f416 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
W20260709 13:19:15.179388  6770 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 54815.9us
I20260709 13:19:15.183812  6770 leader_election.cc:304] T 17587d6730594da4a56fa13a353232a1 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:19:15.159981  9181 raft_consensus.cc:493] T 24ee15416e3145beaa1b8183453729a3 P b7ab4784c7344b939bc36f639286f377 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:15.128165  9209 raft_consensus.cc:515] T 44bde925b2e541b69890d70715b85176 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:15.119249  9117 consensus_queue.cc:237] T 90d42e216d9741e190bca19a781291fd P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:15.201941  6770 leader_election.cc:304] T 3411566abe2d4c9bb4b2adfdd05e6f17 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:19:15.166307  9186 leader_election.cc:290] T 3fa34c08b205435dba97346991aa1f92 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
W20260709 13:19:15.190935  9031 consensus_meta.cc:287] T 3d65025eea89441290d85dd053810e31 P b7ab4784c7344b939bc36f639286f377: Time spent flushing consensus metadata: real 0.758s	user 0.007s	sys 0.010s
I20260709 13:19:15.209190  7500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b8cacb381b746da8d0049b0a83b41dd" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb"
I20260709 13:19:15.129519  9194 raft_consensus.cc:515] T d33d5ee8ef6f415593d8df52063161ad P ccd8a4c3bfe3413cb2ae219b09aea832 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:15.212507  7500 raft_consensus.cc:3060] T 4b8cacb381b746da8d0049b0a83b41dd P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:15.216002  6770 leader_election.cc:304] T de3186201e1a40d0b335eeb8b4e256e0 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:19:15.220245  6770 leader_election.cc:304] T 2c240553ce044eedb41541d72b9475d7 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:19:15.225803  6799 raft_consensus.cc:2468] T e77e330a82df4b43a745d57a68f6f057 P b7ab4784c7344b939bc36f639286f377 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 8.
I20260709 13:19:15.198930  9210 raft_consensus.cc:2749] T 17587d6730594da4a56fa13a353232a1 P b7ab4784c7344b939bc36f639286f377 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:19:15.190810  8938 consensus_queue.cc:1059] T b56bf91d90824c959e21e0cee5ba1816 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.023s
I20260709 13:19:15.161813  9065 consensus_queue.cc:237] T f58dc08b12a2494bb9a1372837970ca2 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.3, Last appended by leader: 3, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:15.191071  9181 raft_consensus.cc:515] T 24ee15416e3145beaa1b8183453729a3 P b7ab4784c7344b939bc36f639286f377 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } attrs { replace: true } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:19:15.238953  9240 raft_consensus.cc:2804] T 30e88460611e47b2ba16a46a30b5f416 P cd75a17ab2604397adab03bb8b5fd75c [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:19:15.239037  9248 consensus_queue.cc:1048] T 9b3759de40694069b13c0f8bd40e5709 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:19:15.239590  9240 raft_consensus.cc:493] T 30e88460611e47b2ba16a46a30b5f416 P cd75a17ab2604397adab03bb8b5fd75c [term 4 FOLLOWER]: Starting leader election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:19:15.211808  7496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fa34c08b205435dba97346991aa1f92" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:19:15.217300  9079 raft_consensus.cc:2749] T 3411566abe2d4c9bb4b2adfdd05e6f17 P b7ab4784c7344b939bc36f639286f377 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:19:15.240482  9224 log.cc:927] Time spent T f4b8bd455d5a47c18a1380839c6e0d61 P ccd8a4c3bfe3413cb2ae219b09aea832: Append to log took a long time: real 0.218s	user 0.001s	sys 0.000s
I20260709 13:19:15.245038  7500 raft_consensus.cc:2468] T 4b8cacb381b746da8d0049b0a83b41dd P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 7.
I20260709 13:19:15.230048  6770 leader_election.cc:304] T d8292e16e5654be6bc408560cf256aaa P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:19:15.210546  9218 raft_consensus.cc:697] T 22ccee1b570c4ad3a57bd7aec085b1b4 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 5 LEADER]: Becoming Leader. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
I20260709 13:19:15.221766  9121 leader_election.cc:290] T bd6869f07b5a4885a0b99fbe60c3b175 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:15.225127  9212 raft_consensus.cc:2749] T de3186201e1a40d0b335eeb8b4e256e0 P b7ab4784c7344b939bc36f639286f377 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:19:15.211956  8673 leader_election.cc:290] T 20f6842e26174571996b8dea4151d4be P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:15.169412  9241 raft_consensus.cc:515] T c4db81d9d329422bb3b4160ca4ac2d1d P cd75a17ab2604397adab03bb8b5fd75c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:15.208994  9036 consensus_queue.cc:1243] T 9b3759de40694069b13c0f8bd40e5709 P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Peer ccd8a4c3bfe3413cb2ae219b09aea832 log is divergent from this leader: its last log entry 6.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
W20260709 13:19:15.235440  9199 consensus_meta.cc:287] T 30e88460611e47b2ba16a46a30b5f416 P ccd8a4c3bfe3413cb2ae219b09aea832: Time spent flushing consensus metadata: real 0.673s	user 0.014s	sys 0.000s
I20260709 13:19:15.271745  9199 raft_consensus.cc:515] T 30e88460611e47b2ba16a46a30b5f416 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:15.272125  9230 consensus_queue.cc:1059] T f3f9c2e2bf644115957398fe4c9459db P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.108s
I20260709 13:19:15.272935  9220 consensus_queue.cc:1059] T 2c240553ce044eedb41541d72b9475d7 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.142s
I20260709 13:19:15.274246  9251 consensus_queue.cc:1059] T b56bf91d90824c959e21e0cee5ba1816 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.015s
I20260709 13:19:15.274570  9199 leader_election.cc:290] T 30e88460611e47b2ba16a46a30b5f416 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 5 election: Requested vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:15.212015  9232 raft_consensus.cc:2749] T 427c124d773f483294511e80fe340075 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:19:15.275312  9239 log.cc:927] Time spent T f4b8bd455d5a47c18a1380839c6e0d61 P cd75a17ab2604397adab03bb8b5fd75c: Append to log took a long time: real 0.075s	user 0.000s	sys 0.001s
I20260709 13:19:15.229907  9176 raft_consensus.cc:3060] T 2c240553ce044eedb41541d72b9475d7 P b7ab4784c7344b939bc36f639286f377 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:15.248989  6724 raft_consensus.cc:1275] T 3fa34c08b205435dba97346991aa1f92 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 7 FOLLOWER]: Refusing update from remote peer 7ba59cc884714e8aa5f3f0ecaed84cbb: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:19:15.247128  9240 raft_consensus.cc:3060] T 30e88460611e47b2ba16a46a30b5f416 P cd75a17ab2604397adab03bb8b5fd75c [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:19:15.265799  9181 leader_election.cc:290] T 24ee15416e3145beaa1b8183453729a3 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:19:15.241367  9233 raft_consensus.cc:493] T 404190ce4ce94cecbfcb6ea9d1dd8626 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:15.218318  9031 raft_consensus.cc:515] T 3d65025eea89441290d85dd053810e31 P b7ab4784c7344b939bc36f639286f377 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:15.241869  8767 leader_election.cc:290] T f5be3a11b23d4ea9b08300a2789821c7 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:15.233420  9137 leader_election.cc:290] T 1bf4668eeb70467fb3dc5a0289233b3c P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:15.241253  9248 consensus_queue.cc:1048] T 1bf4668eeb70467fb3dc5a0289233b3c P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.017s
I20260709 13:19:15.269598  9210 raft_consensus.cc:2749] T d8292e16e5654be6bc408560cf256aaa P b7ab4784c7344b939bc36f639286f377 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:19:15.309803  6803 raft_consensus.cc:2393] T 3d65025eea89441290d85dd053810e31 P b7ab4784c7344b939bc36f639286f377 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ccd8a4c3bfe3413cb2ae219b09aea832 in current term 6: Already voted for candidate b7ab4784c7344b939bc36f639286f377 in this term.
I20260709 13:19:15.263378  6731 raft_consensus.cc:2468] T bb3d8792045a4583ae2e965b1350a5b4 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 5.
I20260709 13:19:15.252643  9205 leader_election.cc:290] T 1528ab62b6fe4e3099d08f141afee116 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
W20260709 13:19:15.282109  9206 consensus_meta.cc:287] T 07a92dd554674067a83a9cb68c4773f2 P b7ab4784c7344b939bc36f639286f377: Time spent flushing consensus metadata: real 0.962s	user 0.011s	sys 0.005s
I20260709 13:19:15.288884  8990 leader_election.cc:290] T dbdf895bba214ff68685a24fd17dfb5d P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
W20260709 13:19:15.289496  9258 log.cc:927] Time spent T 7ba5dac66ab5497e9e336f2a3c28cda5 P 7ba59cc884714e8aa5f3f0ecaed84cbb: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 13:19:15.297308  8940 leader_election.cc:290] T bb7fa124c3bf4ef9ab65a407cb008441 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:19:15.297873  9223 raft_consensus.cc:493] T d8292e16e5654be6bc408560cf256aaa P ccd8a4c3bfe3413cb2ae219b09aea832 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:15.318236  9223 raft_consensus.cc:515] T d8292e16e5654be6bc408560cf256aaa P ccd8a4c3bfe3413cb2ae219b09aea832 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:15.320837  9223 leader_election.cc:290] T d8292e16e5654be6bc408560cf256aaa P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:15.322818  9031 leader_election.cc:290] T 3d65025eea89441290d85dd053810e31 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 6 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
W20260709 13:19:15.328176  7468 leader_election.cc:336] T bb3d8792045a4583ae2e965b1350a5b4 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931): Timed out: RequestConsensusVote RPC to 127.5.126.67:42931 timed out after 2.181s (SENT)
I20260709 13:19:15.328804  7468 leader_election.cc:304] T bb3d8792045a4583ae2e965b1350a5b4 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
W20260709 13:19:15.313370  6770 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 51977.3us
I20260709 13:19:15.310798  9100 raft_consensus.cc:493] T bb3d8792045a4583ae2e965b1350a5b4 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:15.333889  8987 raft_consensus.cc:3055] T 2c240553ce044eedb41541d72b9475d7 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:19:15.331107  6770 leader_election.cc:304] T 34f36d59d88f40fe8a2805e604fc6c0a P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:19:15.337427  6770 leader_election.cc:304] T 4d9def8b32fd443aa94ab1420b06837b P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:19:15.334481  8987 raft_consensus.cc:740] T 2c240553ce044eedb41541d72b9475d7 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
I20260709 13:19:15.339365  9231 raft_consensus.cc:2749] T 34f36d59d88f40fe8a2805e604fc6c0a P b7ab4784c7344b939bc36f639286f377 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:19:15.356742  8987 consensus_queue.cc:260] T 2c240553ce044eedb41541d72b9475d7 P ccd8a4c3bfe3413cb2ae219b09aea832 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:15.358364  8987 raft_consensus.cc:3060] T 2c240553ce044eedb41541d72b9475d7 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:15.346285  9241 leader_election.cc:290] T c4db81d9d329422bb3b4160ca4ac2d1d P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:19:15.333845  9100 raft_consensus.cc:515] T bb3d8792045a4583ae2e965b1350a5b4 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:19:15.363401  6798 raft_consensus.cc:1275] T 7ba5dac66ab5497e9e336f2a3c28cda5 P b7ab4784c7344b939bc36f639286f377 [term 7 FOLLOWER]: Refusing update from remote peer 7ba59cc884714e8aa5f3f0ecaed84cbb: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:19:15.352353  6770 leader_election.cc:304] T ce4f062dcd314d43a63ca74067cb5ee3 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:19:15.356199  9046 raft_consensus.cc:2749] T 4d9def8b32fd443aa94ab1420b06837b P b7ab4784c7344b939bc36f639286f377 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:19:15.296204  9233 raft_consensus.cc:515] T 404190ce4ce94cecbfcb6ea9d1dd8626 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:19:15.376255  7503 raft_consensus.cc:1275] T 404190ce4ce94cecbfcb6ea9d1dd8626 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 7 FOLLOWER]: Refusing update from remote peer ccd8a4c3bfe3413cb2ae219b09aea832: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:19:15.376761  9254 raft_consensus.cc:493] T 4275cf08e63345f993bce8664eada830 P cd75a17ab2604397adab03bb8b5fd75c [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:15.377960  9233 leader_election.cc:290] T 404190ce4ce94cecbfcb6ea9d1dd8626 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:19:15.377877  9254 raft_consensus.cc:515] T 4275cf08e63345f993bce8664eada830 P cd75a17ab2604397adab03bb8b5fd75c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:15.396370  6724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "404190ce4ce94cecbfcb6ea9d1dd8626" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 8 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:19:15.397634  6798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "404190ce4ce94cecbfcb6ea9d1dd8626" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 8 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
W20260709 13:19:15.403503  9167 consensus_meta.cc:287] T f09c2a98de1a4decabd0ff900dd44caa P b7ab4784c7344b939bc36f639286f377: Time spent flushing consensus metadata: real 1.084s	user 0.013s	sys 0.006s
I20260709 13:19:15.405949  9167 raft_consensus.cc:515] T f09c2a98de1a4decabd0ff900dd44caa P b7ab4784c7344b939bc36f639286f377 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
W20260709 13:19:15.413142  6770 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 60920.5us
W20260709 13:19:15.424437  6847 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:15.437090  9194 leader_election.cc:290] T d33d5ee8ef6f415593d8df52063161ad P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:15.443270  6804 raft_consensus.cc:2393] T f09c2a98de1a4decabd0ff900dd44caa P b7ab4784c7344b939bc36f639286f377 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate ccd8a4c3bfe3413cb2ae219b09aea832 in current term 7: Already voted for candidate b7ab4784c7344b939bc36f639286f377 in this term.
W20260709 13:19:15.442800  7468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 114661us
W20260709 13:19:15.450244  7468 leader_election.cc:336] T 4b8cacb381b746da8d0049b0a83b41dd P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931): Timed out: RequestConsensusVote RPC to 127.5.126.67:42931 timed out after 2.328s (SENT)
I20260709 13:19:15.450959  7468 leader_election.cc:304] T 4b8cacb381b746da8d0049b0a83b41dd P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:19:15.454430  6770 leader_election.cc:304] T 3a485a995abc4807b6e511e45419f737 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:19:15.488956  9235 raft_consensus.cc:2749] T bb3d8792045a4583ae2e965b1350a5b4 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:19:15.489987  6876 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53406 (request call id 1448) took 2112 ms. Trace:
I20260709 13:19:15.490492  6876 rpcz_store.cc:276] 0709 13:19:13.377564 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:13.463562 (+ 85998us) service_pool.cc:224] Handling call
0709 13:19:13.480355 (+ 16793us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:14.218302 (+737947us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:14.218332 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:14.218370 (+    38us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:19:14.218398 (+    28us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:15.489665 (+1271267us) spinlock_profiling.cc:243] Waited 738 ms on lock 0x7b54002378d4. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f9aae01 00007fcc0f9a983e 00007fcc1496e419 00007fcc0dee5bd4 00007fcc0dee5b62 00007fcc0dee5a91 00007fcc0dee5a0c 00007fcc0dee4cc2 00007fcc0dce548c 00007fcc0dce48c6
0709 13:19:15.489718 (+    53us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:15.489878 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1696658304}
I20260709 13:19:15.453771  9125 raft_consensus.cc:2749] T 4b8cacb381b746da8d0049b0a83b41dd P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:19:15.501928  8870 raft_consensus.cc:2749] T 3a485a995abc4807b6e511e45419f737 P b7ab4784c7344b939bc36f639286f377 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:19:15.503006  6627 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:51654 (request call id 79) took 10596 ms. Trace:
I20260709 13:19:15.503150  8862 raft_consensus.cc:3055] T d8cee0accdb8499c86d4414b72565a38 P b7ab4784c7344b939bc36f639286f377 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:19:15.503584  8862 raft_consensus.cc:740] T d8cee0accdb8499c86d4414b72565a38 P b7ab4784c7344b939bc36f639286f377 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
I20260709 13:19:15.504868  9121 raft_consensus.cc:3055] T b56bf91d90824c959e21e0cee5ba1816 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:19:15.394354  9218 consensus_queue.cc:237] T 22ccee1b570c4ad3a57bd7aec085b1b4 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:15.513489  9209 leader_election.cc:290] T 44bde925b2e541b69890d70715b85176 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:15.518916  9167 leader_election.cc:290] T f09c2a98de1a4decabd0ff900dd44caa P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 7 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:15.519145  9254 leader_election.cc:290] T 4275cf08e63345f993bce8664eada830 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:19:15.522611  9240 raft_consensus.cc:515] T 30e88460611e47b2ba16a46a30b5f416 P cd75a17ab2604397adab03bb8b5fd75c [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:15.537076  9240 leader_election.cc:290] T 30e88460611e47b2ba16a46a30b5f416 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 5 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:19:15.511710  8862 consensus_queue.cc:260] T d8cee0accdb8499c86d4414b72565a38 P b7ab4784c7344b939bc36f639286f377 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:19:15.509441  9155 raft_consensus.cc:515] T fe20b4b48823486ca3b9c648db6ce8aa P cd75a17ab2604397adab03bb8b5fd75c [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:19:15.509123  9121 raft_consensus.cc:740] T b56bf91d90824c959e21e0cee5ba1816 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
I20260709 13:19:15.528894  6798 raft_consensus.cc:2410] T 404190ce4ce94cecbfcb6ea9d1dd8626 P b7ab4784c7344b939bc36f639286f377 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ba59cc884714e8aa5f3f0ecaed84cbb for term 8 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 13:19:15.533463  8347 raft_consensus.cc:3060] T d33d5ee8ef6f415593d8df52063161ad P b7ab4784c7344b939bc36f639286f377 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:15.503491  6627 rpcz_store.cc:276] 0709 13:19:04.907033 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:04.907359 (+   326us) service_pool.cc:224] Handling call
0709 13:19:15.502920 (+10595561us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:19:12.056467 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:19:12.073727 (+ 17260us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:19:12.073795 (+    68us) write_op.cc:435] Acquired schema lock
0709 13:19:12.073808 (+    13us) tablet.cc:662] Decoding operations
0709 13:19:12.074824 (+  1016us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:19:12.074904 (+    80us) write_op.cc:641] Partition lock acquired for write op
0709 13:19:12.074929 (+    25us) tablet.cc:685] Acquiring locks for 7 operations
0709 13:19:12.075690 (+   761us) tablet.cc:701] Row locks acquired
0709 13:19:12.075744 (+    54us) write_op.cc:260] PREPARE: finished
0709 13:19:12.075906 (+   162us) write_op.cc:270] Start()
0709 13:19:12.124186 (+ 48280us) write_op.cc:276] Timestamp: P: 1783603152075842 usec, L: 0
0709 13:19:12.124207 (+    21us) op_driver.cc:348] REPLICATION: starting
0709 13:19:12.165709 (+ 41502us) log.cc:844] Serialized 3242 byte log entry
0709 13:19:12.756282 (+590573us) op_driver.cc:464] REPLICATION: finished
0709 13:19:13.034972 (+278690us) write_op.cc:301] APPLY: starting
0709 13:19:13.035093 (+   121us) tablet.cc:1367] starting BulkCheckPresence
0709 13:19:13.035332 (+   239us) tablet.cc:1370] finished BulkCheckPresence
0709 13:19:13.035526 (+   194us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:19:13.062450 (+ 26924us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:19:13.062827 (+   377us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=7
0709 13:19:13.062880 (+    53us) write_op.cc:312] APPLY: finished
0709 13:19:13.063254 (+   374us) log.cc:844] Serialized 58 byte log entry
0709 13:19:13.063470 (+   216us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:19:13.063599 (+   129us) write_op.cc:454] Released schema lock
0709 13:19:13.063664 (+    65us) write_op.cc:341] FINISH: Updating metrics
0709 13:19:13.064128 (+   464us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:19:13.064160 (+    32us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":4609061,"reported_tablets":12,"child_traces":[["op",{"apply.queue_time_us":278339,"apply.run_cpu_time_us":4528,"apply.run_wall_time_us":29130,"num_ops":7,"prepare.queue_time_us":497412,"prepare.run_cpu_time_us":34268,"prepare.run_wall_time_us":364019,"raft.queue_time_us":97817,"raft.run_cpu_time_us":41238,"raft.run_wall_time_us":273322,"replication_time_us":627097,"thread_start_us":499348,"threads_started":4,"wal-append.queue_time_us":243807,"wal-append.run_cpu_time_us":21487,"wal-append.run_wall_time_us":1826081}]]}
I20260709 13:19:15.534327  9176 raft_consensus.cc:2749] T 2c240553ce044eedb41541d72b9475d7 P b7ab4784c7344b939bc36f639286f377 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:19:15.537343  6875 consensus_queue.cc:260] T 9b3759de40694069b13c0f8bd40e5709 P cd75a17ab2604397adab03bb8b5fd75c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:15.556913  9121 consensus_queue.cc:260] T b56bf91d90824c959e21e0cee5ba1816 P ccd8a4c3bfe3413cb2ae219b09aea832 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
W20260709 13:19:15.560633  6770 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 106341us
I20260709 13:19:15.562641  6770 leader_election.cc:304] T 7887766dc6784fcaa42b35c05fea7a99 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:19:15.563846  8440 raft_consensus.cc:2749] T 7887766dc6784fcaa42b35c05fea7a99 P b7ab4784c7344b939bc36f639286f377 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:19:15.566227  9155 leader_election.cc:290] T fe20b4b48823486ca3b9c648db6ce8aa P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 4 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:19:15.568917  9129 raft_consensus.cc:3055] T 4d9def8b32fd443aa94ab1420b06837b P ccd8a4c3bfe3413cb2ae219b09aea832 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:19:15.569479  9129 raft_consensus.cc:740] T 4d9def8b32fd443aa94ab1420b06837b P ccd8a4c3bfe3413cb2ae219b09aea832 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
W20260709 13:19:15.594026  9203 log.cc:927] Time spent T be1a92657f494cac8dd227d152f50151 P b7ab4784c7344b939bc36f639286f377: Append to log took a long time: real 0.973s	user 0.004s	sys 0.000s
I20260709 13:19:15.600957  6875 raft_consensus.cc:3060] T 9b3759de40694069b13c0f8bd40e5709 P cd75a17ab2604397adab03bb8b5fd75c [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:19:15.612600  6770 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 50051.4us
W20260709 13:19:15.641446  6731 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49998 (request call id 698) took 1824 ms (client timeout 2062 ms). Trace:
W20260709 13:19:15.642027  6731 rpcz_store.cc:269] 0709 13:19:13.816514 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:14.219393 (+402879us) service_pool.cc:224] Handling call
0709 13:19:15.641209 (+1421816us) spinlock_profiling.cc:243] Waited 705 ms on lock 0x7b54000e4a54. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f9ae2fa 00007fcc1496fb17 00007fcc0deea6d4 00007fcc0deea662 00007fcc0deea591 00007fcc0deea50c 00007fcc0dee97c2 00007fcc0dce548c 00007fcc0dce48c6 00007fcc0dce426f
0709 13:19:15.641364 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1622510848}
I20260709 13:19:15.643579  6807 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50550 (request call id 202) took 2277 ms. Trace:
I20260709 13:19:15.644238  6807 rpcz_store.cc:276] 0709 13:19:13.365729 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:13.365924 (+   195us) service_pool.cc:224] Handling call
0709 13:19:13.366436 (+   512us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:13.520027 (+153591us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:13.520162 (+   135us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:13.538440 (+ 18278us) log.cc:844] Serialized 26 byte log entry
0709 13:19:14.048792 (+510352us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:19:14.048851 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:14.048969 (+   118us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:15.593231 (+1544262us) spinlock_profiling.cc:243] Waited 31.2 ms on lock 0x7b4400022b4c. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0c745db1 00007fcc0c7e3c85 00007fcc0c7e46a2 00007fcc0f5561db 00007fcc0f551aaf 00007fcc0f54586e 00007fcc0f544bb6 00007fcc0f5447d8 00007fcc0f54e221 00007fcc0f54e1d9 00007fcc0f54e169
0709 13:19:15.643031 (+ 49800us) raft_consensus.cc:1685] finished
0709 13:19:15.643068 (+    37us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:15.643447 (+   379us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":144260,"raft.queue_time_us":144406,"raft.run_cpu_time_us":142,"raft.run_wall_time_us":11600,"spinlock_wait_cycles":71782656,"thread_start_us":417677,"threads_started":1,"wal-append.queue_time_us":803495}
I20260709 13:19:15.648911  6804 raft_consensus.cc:1240] T 4f00a2e87e56452083b759f60d461ee3 P b7ab4784c7344b939bc36f639286f377 [term 7 FOLLOWER]: Rejecting Update request from peer 7ba59cc884714e8aa5f3f0ecaed84cbb for earlier term 6. Current term is 7. Ops: []
I20260709 13:19:15.621984  7503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe20b4b48823486ca3b9c648db6ce8aa" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb"
I20260709 13:19:15.570441  9129 consensus_queue.cc:260] T 4d9def8b32fd443aa94ab1420b06837b P ccd8a4c3bfe3413cb2ae219b09aea832 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:15.680518  9129 raft_consensus.cc:3060] T 4d9def8b32fd443aa94ab1420b06837b P ccd8a4c3bfe3413cb2ae219b09aea832 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:15.690647  8832 raft_consensus.cc:3055] T f58dc08b12a2494bb9a1372837970ca2 P b7ab4784c7344b939bc36f639286f377 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:19:15.691303  8832 raft_consensus.cc:740] T f58dc08b12a2494bb9a1372837970ca2 P b7ab4784c7344b939bc36f639286f377 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
I20260709 13:19:15.706847  6874 raft_consensus.cc:1240] T d8cee0accdb8499c86d4414b72565a38 P cd75a17ab2604397adab03bb8b5fd75c [term 6 FOLLOWER]: Rejecting Update request from peer b7ab4784c7344b939bc36f639286f377 for earlier term 5. Current term is 6. Ops: []
I20260709 13:19:15.708526  6879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f00a2e87e56452083b759f60d461ee3" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:19:15.709244  6879 raft_consensus.cc:3060] T 4f00a2e87e56452083b759f60d461ee3 P cd75a17ab2604397adab03bb8b5fd75c [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:19:15.715624  6730 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49998 (request call id 695) took 1900 ms (client timeout 2139 ms). Trace:
W20260709 13:19:15.716102  6730 rpcz_store.cc:269] 0709 13:19:13.815401 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:13.816195 (+   794us) service_pool.cc:224] Handling call
0709 13:19:15.715400 (+1899205us) spinlock_profiling.cc:243] Waited 218 ms on lock 0x7b54003d5254. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f9ae2fa 00007fcc1496fb17 00007fcc0deea6d4 00007fcc0deea662 00007fcc0deea591 00007fcc0deea50c 00007fcc0dee97c2 00007fcc0dce548c 00007fcc0dce48c6 00007fcc0dce426f
0709 13:19:15.715549 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":501647104}
I20260709 13:19:15.720026  8832 consensus_queue.cc:260] T f58dc08b12a2494bb9a1372837970ca2 P b7ab4784c7344b939bc36f639286f377 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:15.721987  6877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bf4668eeb70467fb3dc5a0289233b3c" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:19:15.721913  9100 leader_election.cc:290] T bb3d8792045a4583ae2e965b1350a5b4 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:19:15.723454  6873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24ee15416e3145beaa1b8183453729a3" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:19:15.736027  6877 raft_consensus.cc:2468] T 1bf4668eeb70467fb3dc5a0289233b3c P cd75a17ab2604397adab03bb8b5fd75c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 5.
W20260709 13:19:15.733278  6770 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 97400.5us
I20260709 13:19:15.737603  8832 raft_consensus.cc:3060] T f58dc08b12a2494bb9a1372837970ca2 P b7ab4784c7344b939bc36f639286f377 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:19:15.733820  7466 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 85828.1us
I20260709 13:19:15.747629  6881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb7fa124c3bf4ef9ab65a407cb008441" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:19:15.748931  6879 raft_consensus.cc:2468] T 4f00a2e87e56452083b759f60d461ee3 P cd75a17ab2604397adab03bb8b5fd75c [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 7.
W20260709 13:19:15.752310  6805 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.619s	user 0.023s	sys 0.032s
W20260709 13:19:15.752687  6805 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.620s	user 0.023s	sys 0.032s
I20260709 13:19:15.754663  6881 raft_consensus.cc:2468] T bb7fa124c3bf4ef9ab65a407cb008441 P cd75a17ab2604397adab03bb8b5fd75c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 7.
I20260709 13:19:15.755925  6875 raft_consensus.cc:1275] T 9b3759de40694069b13c0f8bd40e5709 P cd75a17ab2604397adab03bb8b5fd75c [term 6 FOLLOWER]: Refusing update from remote peer ccd8a4c3bfe3413cb2ae219b09aea832: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 4. (term mismatch)
I20260709 13:19:15.756445  6875 pending_rounds.cc:85] T 9b3759de40694069b13c0f8bd40e5709 P cd75a17ab2604397adab03bb8b5fd75c: Aborting all ops after (but not including) 3
I20260709 13:19:15.757117  6875 pending_rounds.cc:107] T 9b3759de40694069b13c0f8bd40e5709 P cd75a17ab2604397adab03bb8b5fd75c: Aborting uncommitted NO_OP operation due to leader change: 5.4
I20260709 13:19:15.757594  6875 raft_consensus.cc:2889] T 9b3759de40694069b13c0f8bd40e5709 P cd75a17ab2604397adab03bb8b5fd75c [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:19:15.758211  6878 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.626s	user 0.000s	sys 0.021s
I20260709 13:19:15.761063  6729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "711ef6523deb4cbe8ef2ba61e1c21c98" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
W20260709 13:19:15.761528  6878 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.631s	user 0.000s	sys 0.021s
I20260709 13:19:15.765121  6729 raft_consensus.cc:2468] T 711ef6523deb4cbe8ef2ba61e1c21c98 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 6.
I20260709 13:19:15.766393  6729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b3759de40694069b13c0f8bd40e5709" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 7 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:19:15.762959  6731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09c2a98de1a4decabd0ff900dd44caa" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:19:15.767947  6731 raft_consensus.cc:2393] T f09c2a98de1a4decabd0ff900dd44caa P ccd8a4c3bfe3413cb2ae219b09aea832 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate b7ab4784c7344b939bc36f639286f377 in current term 7: Already voted for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in this term.
I20260709 13:19:15.759506  6727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d65025eea89441290d85dd053810e31" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:19:15.768849  6727 raft_consensus.cc:2468] T 3d65025eea89441290d85dd053810e31 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 5.
I20260709 13:19:15.769946  6727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d65025eea89441290d85dd053810e31" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:19:15.770519  6727 raft_consensus.cc:3060] T 3d65025eea89441290d85dd053810e31 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:15.763935  6728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a75bfe094d4bdc963aba3f08dfcd25" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 8 candidate_status { last_received { term: 6 index: 2 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:19:15.772127  6728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bf4668eeb70467fb3dc5a0289233b3c" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:19:15.773474  6728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "713b5728a197487c9300b310ab94e5a3" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
W20260709 13:19:15.775498  6697 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.727s	user 0.014s	sys 0.017s
W20260709 13:19:15.777478  6697 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.729s	user 0.014s	sys 0.017s
W20260709 13:19:15.798995  6697 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 750753us
I20260709 13:19:15.799407  9167 consensus_queue.cc:1059] T d8cee0accdb8499c86d4414b72565a38 P b7ab4784c7344b939bc36f639286f377 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:19:15.779191  6724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20f6842e26174571996b8dea4151d4be" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:19:15.779785  6730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34f36d59d88f40fe8a2805e604fc6c0a" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:19:15.784211  6731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90d42e216d9741e190bca19a781291fd" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:19:15.784174  6875 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53416 (request call id 2234) took 2838 ms. Trace:
I20260709 13:19:15.786968  6729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24ee15416e3145beaa1b8183453729a3" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:19:15.788424  6728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b56bf91d90824c959e21e0cee5ba1816" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:19:15.734405  9236 raft_consensus.cc:2749] T 9e326172347f45e99a0d482b5d8ef768 P b7ab4784c7344b939bc36f639286f377 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:19:15.756778  8963 raft_consensus.cc:493] T 853ac0a8cbd64ce99457f170216d4d0f P b7ab4784c7344b939bc36f639286f377 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:15.779332  8827 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.538s	user 0.007s	sys 0.017s
I20260709 13:19:15.782713  9079 raft_consensus.cc:493] T 4275cf08e63345f993bce8664eada830 P b7ab4784c7344b939bc36f639286f377 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:15.782222  9046 raft_consensus.cc:2749] T ce4f062dcd314d43a63ca74067cb5ee3 P b7ab4784c7344b939bc36f639286f377 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:19:15.797577  9031 raft_consensus.cc:493] T 7ba5dac66ab5497e9e336f2a3c28cda5 P b7ab4784c7344b939bc36f639286f377 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:15.799898  9217 consensus_queue.cc:1048] T ab432e62819d499eaaf3dd55481dd930 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:19:15.780299  9043 raft_consensus.cc:493] T 9b3759de40694069b13c0f8bd40e5709 P cd75a17ab2604397adab03bb8b5fd75c [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:15.736141  9199 raft_consensus.cc:3055] T f3f9c2e2bf644115957398fe4c9459db P ccd8a4c3bfe3413cb2ae219b09aea832 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:19:15.828756  6697 leader_election.cc:304] T f09c2a98de1a4decabd0ff900dd44caa P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:19:15.802068  6801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8cee0accdb8499c86d4414b72565a38" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:19:15.801623  6772 leader_election.cc:304] T 1bf4668eeb70467fb3dc5a0289233b3c P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:19:15.802882  6806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c7f33e544204fbaac4078e3e83bbf4e" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
W20260709 13:19:15.816363  8986 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.683s	user 0.024s	sys 0.036s
I20260709 13:19:15.809285  6875 rpcz_store.cc:276] 0709 13:19:12.946197 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:12.987811 (+ 41614us) service_pool.cc:224] Handling call
0709 13:19:13.019987 (+ 32176us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:13.155818 (+135831us) spinlock_profiling.cc:243] Waited 13.2 ms on lock 0x7b4c000595c0. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0dc76a20 00007fcc0dc87a29 00007fcc0dc4d644 00007fcc0dc74f2d 00007fcc0dc74b93 00007fcc0f9a518b 00007fcc0f9a5cb5 00007fcc0f9a0f30 00007fcc0f9a27de 00007fcc0f9acb49 00007fcc0f9ad416
0709 13:19:15.536901 (+2381083us) spinlock_profiling.cc:243] Waited 1.1 s on lock 0x7b54000f8320. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f92806f 00007fcc0f9a0f60 00007fcc0f9a27de 00007fcc0f9acb49 00007fcc0f9ad416 00007fcc0f9a9d8f 00007fcc0f9a983e 00007fcc1496e419 00007fcc0dee5bd4 00007fcc0dee5b62
0709 13:19:15.779666 (+242765us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:15.784101 (+  4435us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2551723264}
I20260709 13:19:15.811874  6805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d65025eea89441290d85dd053810e31" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:19:15.812804  6802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e326172347f45e99a0d482b5d8ef768" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:19:15.815781  6807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30e88460611e47b2ba16a46a30b5f416" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
W20260709 13:19:15.802652  8855 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.547s	user 0.020s	sys 0.044s
I20260709 13:19:15.821686  6804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44bde925b2e541b69890d70715b85176" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:19:15.852468  6805 raft_consensus.cc:2368] T 3d65025eea89441290d85dd053810e31 P b7ab4784c7344b939bc36f639286f377 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c for earlier term 5. Current term is 6.
I20260709 13:19:15.853379  6804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5be3a11b23d4ea9b08300a2789821c7" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:19:15.800590  9221 consensus_queue.cc:1048] T 7ba5dac66ab5497e9e336f2a3c28cda5 P 7ba59cc884714e8aa5f3f0ecaed84cbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.042s
I20260709 13:19:15.778412  9115 consensus_queue.cc:1059] T 4f00a2e87e56452083b759f60d461ee3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.027s
I20260709 13:19:15.831898  6803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1528ab62b6fe4e3099d08f141afee116" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
W20260709 13:19:15.860852  6695 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.682s	user 0.009s	sys 0.029s
I20260709 13:19:15.803704  6727 raft_consensus.cc:2468] T 3d65025eea89441290d85dd053810e31 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 6.
W20260709 13:19:15.824488  8827 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.577s	user 0.008s	sys 0.017s
I20260709 13:19:15.831758  9199 raft_consensus.cc:740] T f3f9c2e2bf644115957398fe4c9459db P ccd8a4c3bfe3413cb2ae219b09aea832 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
W20260709 13:19:15.846944  6773 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:15.872484  6773 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:15.821723  9127 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.692s	user 0.016s	sys 0.035s
W20260709 13:19:15.857178  8855 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.597s	user 0.020s	sys 0.045s
I20260709 13:19:15.822402  9210 raft_consensus.cc:493] T c4db81d9d329422bb3b4160ca4ac2d1d P b7ab4784c7344b939bc36f639286f377 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
W20260709 13:19:15.861570  6695 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.683s	user 0.010s	sys 0.029s
I20260709 13:19:15.861701  6805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f03d0dbf16864ca4bc1bb5e4c0334c0f" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:19:15.854897  6697 leader_election.cc:304] T 711ef6523deb4cbe8ef2ba61e1c21c98 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:19:15.842792  9219 raft_consensus.cc:2804] T f09c2a98de1a4decabd0ff900dd44caa P ccd8a4c3bfe3413cb2ae219b09aea832 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:19:15.865482  6730 raft_consensus.cc:1240] T 07a92dd554674067a83a9cb68c4773f2 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 6 FOLLOWER]: Rejecting Update request from peer b7ab4784c7344b939bc36f639286f377 for earlier term 5. Current term is 6. Ops: [5.3-5.3]
I20260709 13:19:15.867503  6804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ba5dac66ab5497e9e336f2a3c28cda5" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:19:15.866410  6807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a75bfe094d4bdc963aba3f08dfcd25" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 8 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:19:15.870154  6806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1704639a875409b9959353527b3fd68" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:19:15.832233  9100 consensus_queue.cc:1048] T 1bf4668eeb70467fb3dc5a0289233b3c P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.032s
I20260709 13:19:15.854025  9137 raft_consensus.cc:2804] T 1bf4668eeb70467fb3dc5a0289233b3c P b7ab4784c7344b939bc36f639286f377 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:19:15.889036  6806 raft_consensus.cc:2410] T a1704639a875409b9959353527b3fd68 P b7ab4784c7344b939bc36f639286f377 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c for term 6 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
W20260709 13:19:15.877455  6695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 699913us
I20260709 13:19:15.843322  6772 leader_election.cc:304] T 4f00a2e87e56452083b759f60d461ee3 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
W20260709 13:19:15.889273  7469 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.661s	user 0.016s	sys 0.052s
I20260709 13:19:15.827111  9079 raft_consensus.cc:515] T 4275cf08e63345f993bce8664eada830 P b7ab4784c7344b939bc36f639286f377 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
W20260709 13:19:15.857368  8973 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.612s	user 0.003s	sys 0.029s
I20260709 13:19:15.875993  6802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbdf895bba214ff68685a24fd17dfb5d" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
W20260709 13:19:15.901855  6772 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 58660.1us
I20260709 13:19:15.902736  6772 leader_election.cc:304] T bb7fa124c3bf4ef9ab65a407cb008441 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:19:15.834949  9031 raft_consensus.cc:515] T 7ba5dac66ab5497e9e336f2a3c28cda5 P b7ab4784c7344b939bc36f639286f377 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
W20260709 13:19:15.889232  6799 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.577s	user 0.013s	sys 0.034s
W20260709 13:19:15.906172  6799 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.594s	user 0.014s	sys 0.034s
W20260709 13:19:15.894479  7469 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.666s	user 0.017s	sys 0.052s
I20260709 13:19:15.907140  6803 raft_consensus.cc:1240] T e77e330a82df4b43a745d57a68f6f057 P b7ab4784c7344b939bc36f639286f377 [term 8 FOLLOWER]: Rejecting Update request from peer cd75a17ab2604397adab03bb8b5fd75c for earlier term 7. Current term is 8. Ops: []
W20260709 13:19:15.874930  9127 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.753s	user 0.019s	sys 0.035s
I20260709 13:19:15.824160  8963 raft_consensus.cc:515] T 853ac0a8cbd64ce99457f170216d4d0f P b7ab4784c7344b939bc36f639286f377 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:15.835568  9043 raft_consensus.cc:515] T 9b3759de40694069b13c0f8bd40e5709 P cd75a17ab2604397adab03bb8b5fd75c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
W20260709 13:19:15.924968  6847 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:15.864805  9234 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.679s	user 0.019s	sys 0.012s
I20260709 13:19:15.911978  6695 leader_election.cc:304] T 07a92dd554674067a83a9cb68c4773f2 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
W20260709 13:19:15.852224  8986 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.720s	user 0.025s	sys 0.037s
W20260709 13:19:15.901536  8973 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.668s	user 0.004s	sys 0.030s
I20260709 13:19:15.940467  6802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "713b5728a197487c9300b310ab94e5a3" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:19:15.941037  9031 leader_election.cc:290] T 7ba5dac66ab5497e9e336f2a3c28cda5 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:19:15.904774  9137 raft_consensus.cc:493] T 1bf4668eeb70467fb3dc5a0289233b3c P b7ab4784c7344b939bc36f639286f377 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:15.941952  9137 raft_consensus.cc:3060] T 1bf4668eeb70467fb3dc5a0289233b3c P b7ab4784c7344b939bc36f639286f377 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:15.890795  8827 raft_consensus.cc:2804] T 711ef6523deb4cbe8ef2ba61e1c21c98 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:19:15.943150  6803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "711ef6523deb4cbe8ef2ba61e1c21c98" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:19:15.945154  6803 raft_consensus.cc:2410] T 711ef6523deb4cbe8ef2ba61e1c21c98 P b7ab4784c7344b939bc36f639286f377 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c for term 6 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:19:15.946774  6804 raft_consensus.cc:2368] T 7ba5dac66ab5497e9e336f2a3c28cda5 P b7ab4784c7344b939bc36f639286f377 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c for earlier term 6. Current term is 7.
I20260709 13:19:15.941665  6802 raft_consensus.cc:2393] T 713b5728a197487c9300b310ab94e5a3 P b7ab4784c7344b939bc36f639286f377 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c in current term 6: Already voted for candidate b7ab4784c7344b939bc36f639286f377 in this term.
I20260709 13:19:15.947098  6805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb7fa124c3bf4ef9ab65a407cb008441" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
W20260709 13:19:15.931840  9234 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.754s	user 0.020s	sys 0.012s
I20260709 13:19:15.912118  9181 raft_consensus.cc:2804] T 4f00a2e87e56452083b759f60d461ee3 P b7ab4784c7344b939bc36f639286f377 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:19:15.964541  6802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3411566abe2d4c9bb4b2adfdd05e6f17" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:19:15.966665  6875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ba5dac66ab5497e9e336f2a3c28cda5" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:19:15.967083  6802 raft_consensus.cc:2393] T 3411566abe2d4c9bb4b2adfdd05e6f17 P b7ab4784c7344b939bc36f639286f377 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c in current term 5: Already voted for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in this term.
I20260709 13:19:15.967141  6806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab432e62819d499eaaf3dd55481dd930" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:19:15.967427  6875 raft_consensus.cc:2468] T 7ba5dac66ab5497e9e336f2a3c28cda5 P cd75a17ab2604397adab03bb8b5fd75c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 5.
I20260709 13:19:15.968143  6806 raft_consensus.cc:2368] T ab432e62819d499eaaf3dd55481dd930 P b7ab4784c7344b939bc36f639286f377 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c for earlier term 6. Current term is 7.
I20260709 13:19:15.927186  9219 raft_consensus.cc:697] T f09c2a98de1a4decabd0ff900dd44caa P ccd8a4c3bfe3413cb2ae219b09aea832 [term 7 LEADER]: Becoming Leader. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
I20260709 13:19:15.948884  8827 raft_consensus.cc:493] T 711ef6523deb4cbe8ef2ba61e1c21c98 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:15.924865  8987 consensus_queue.cc:1048] T 3411566abe2d4c9bb4b2adfdd05e6f17 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.043s
I20260709 13:19:15.931319  8986 raft_consensus.cc:697] T 3a485a995abc4807b6e511e45419f737 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 5 LEADER]: Becoming Leader. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
I20260709 13:19:15.946431  9167 raft_consensus.cc:2804] T bb7fa124c3bf4ef9ab65a407cb008441 P b7ab4784c7344b939bc36f639286f377 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:19:15.891829  9210 raft_consensus.cc:515] T c4db81d9d329422bb3b4160ca4ac2d1d P b7ab4784c7344b939bc36f639286f377 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:15.941774  7495 raft_consensus.cc:1240] T 24ee15416e3145beaa1b8183453729a3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 6 LEADER]: Rejecting Update request from peer cd75a17ab2604397adab03bb8b5fd75c for earlier term 5. Current term is 6. Ops: []
I20260709 13:19:15.999835  7502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb7fa124c3bf4ef9ab65a407cb008441" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:19:16.000819  7502 raft_consensus.cc:2468] T bb7fa124c3bf4ef9ab65a407cb008441 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 6.
I20260709 13:19:15.992236  6803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90d42e216d9741e190bca19a781291fd" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:19:16.002002  6806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a734b5ab7834e05a8c422208acc58b1" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:19:16.003460  6806 raft_consensus.cc:2393] T 7a734b5ab7834e05a8c422208acc58b1 P b7ab4784c7344b939bc36f639286f377 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c in current term 6: Already voted for candidate b7ab4784c7344b939bc36f639286f377 in this term.
W20260709 13:19:15.983425  9178 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 2.450s	user 0.031s	sys 0.028s
I20260709 13:19:15.985018  6772 leader_election.cc:304] T 7ba5dac66ab5497e9e336f2a3c28cda5 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:19:16.005443  6878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1528ab62b6fe4e3099d08f141afee116" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:19:16.024962  6878 raft_consensus.cc:2468] T 1528ab62b6fe4e3099d08f141afee116 P cd75a17ab2604397adab03bb8b5fd75c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 5.
I20260709 13:19:16.006285  6881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20f6842e26174571996b8dea4151d4be" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:19:16.026821  6881 raft_consensus.cc:2468] T 20f6842e26174571996b8dea4151d4be P cd75a17ab2604397adab03bb8b5fd75c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 6.
I20260709 13:19:16.007112  6879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6869f07b5a4885a0b99fbe60c3b175" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 6 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:19:16.002111  7503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f00a2e87e56452083b759f60d461ee3" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb"
I20260709 13:19:15.956327  9194 raft_consensus.cc:2749] T 07a92dd554674067a83a9cb68c4773f2 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:19:16.010807  7500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24ee15416e3145beaa1b8183453729a3" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:19:16.011021  7502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1528ab62b6fe4e3099d08f141afee116" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:19:16.009552  6803 raft_consensus.cc:2368] T 90d42e216d9741e190bca19a781291fd P b7ab4784c7344b939bc36f639286f377 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c for earlier term 6. Current term is 7.
I20260709 13:19:16.027922  6879 raft_consensus.cc:2468] T bd6869f07b5a4885a0b99fbe60c3b175 P cd75a17ab2604397adab03bb8b5fd75c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 5.
I20260709 13:19:16.026183  6878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbdf895bba214ff68685a24fd17dfb5d" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
W20260709 13:19:16.009101  6844 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.809s	user 0.017s	sys 0.060s
I20260709 13:19:15.982656  9181 raft_consensus.cc:697] T 4f00a2e87e56452083b759f60d461ee3 P b7ab4784c7344b939bc36f639286f377 [term 7 LEADER]: Becoming Leader. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
W20260709 13:19:16.015173  6872 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.909s	user 0.035s	sys 0.026s
W20260709 13:19:16.035681  6872 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.929s	user 0.035s	sys 0.026s
I20260709 13:19:16.020159  6873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5be3a11b23d4ea9b08300a2789821c7" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:19:15.997181  9167 raft_consensus.cc:493] T bb7fa124c3bf4ef9ab65a407cb008441 P b7ab4784c7344b939bc36f639286f377 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:15.988224  8827 raft_consensus.cc:3060] T 711ef6523deb4cbe8ef2ba61e1c21c98 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:16.036741  6878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8292e16e5654be6bc408560cf256aaa" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
W20260709 13:19:16.032577  6844 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.832s	user 0.018s	sys 0.060s
I20260709 13:19:16.022823  6875 raft_consensus.cc:1240] T 4d9def8b32fd443aa94ab1420b06837b P cd75a17ab2604397adab03bb8b5fd75c [term 6 FOLLOWER]: Rejecting Update request from peer ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 5. Current term is 6. Ops: []
W20260709 13:19:16.051589  6772 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 66690.3us
W20260709 13:19:16.016552  9178 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 2.484s	user 0.032s	sys 0.029s
I20260709 13:19:15.945963  9199 consensus_queue.cc:260] T f3f9c2e2bf644115957398fe4c9459db P ccd8a4c3bfe3413cb2ae219b09aea832 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:16.049547  6872 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53416 (request call id 2248) took 1507 ms. Trace:
W20260709 13:19:16.046643  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 865361us
W20260709 13:19:16.050293  6697 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:16.050359  6881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30e88460611e47b2ba16a46a30b5f416" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:19:16.047534  6879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44bde925b2e541b69890d70715b85176" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:19:16.040241  6806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8cee0accdb8499c86d4414b72565a38" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:19:16.053792  6772 leader_election.cc:304] T 24ee15416e3145beaa1b8183453729a3 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:19:16.084321  6879 raft_consensus.cc:2468] T 44bde925b2e541b69890d70715b85176 P cd75a17ab2604397adab03bb8b5fd75c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 6.
I20260709 13:19:16.063405  6878 raft_consensus.cc:2468] T d8292e16e5654be6bc408560cf256aaa P cd75a17ab2604397adab03bb8b5fd75c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 7.
I20260709 13:19:15.991849  9217 consensus_queue.cc:1048] T 7887766dc6784fcaa42b35c05fea7a99 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.044s
I20260709 13:19:16.091066  6844 leader_election.cc:304] T 1528ab62b6fe4e3099d08f141afee116 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:19:16.091835  8963 leader_election.cc:290] T 853ac0a8cbd64ce99457f170216d4d0f P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:16.092437  8963 raft_consensus.cc:2749] T 24ee15416e3145beaa1b8183453729a3 P b7ab4784c7344b939bc36f639286f377 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:19:16.085886  6872 rpcz_store.cc:276] 0709 13:19:14.542560 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:14.544515 (+  1955us) service_pool.cc:224] Handling call
0709 13:19:14.545550 (+  1035us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:14.545953 (+   403us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:19:14.969051 (+423098us) log.cc:844] Serialized 14 byte log entry
0709 13:19:16.049196 (+1080145us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:16.049247 (+    51us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:19:16.049294 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:16.049358 (+    64us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:16.049490 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9587,"prepare.queue_time_us":466573,"prepare.run_cpu_time_us":82,"prepare.run_wall_time_us":3610,"raft.queue_time_us":131895,"raft.run_cpu_time_us":109,"raft.run_wall_time_us":109,"thread_start_us":1435214,"threads_started":3,"wal-append.queue_time_us":155281}
I20260709 13:19:16.092546  6844 leader_election.cc:400] T 90d42e216d9741e190bca19a781291fd P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 6 election: Vote denied by peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391) with higher term. Message: Invalid argument: T 90d42e216d9741e190bca19a781291fd P ccd8a4c3bfe3413cb2ae219b09aea832 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c for earlier term 6. Current term is 7.
I20260709 13:19:16.093709  6844 leader_election.cc:403] T 90d42e216d9741e190bca19a781291fd P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 6 election: Cancelling election due to peer responding with higher term
I20260709 13:19:16.094043  6803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c44c4849aa54f2b94d1f1bef9ed546f" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
W20260709 13:19:16.054958  6771 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:16.096422  6771 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:16.097955  6873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d33d5ee8ef6f415593d8df52063161ad" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
W20260709 13:19:16.098614  6697 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:16.098994  6873 raft_consensus.cc:2410] T d33d5ee8ef6f415593d8df52063161ad P cd75a17ab2604397adab03bb8b5fd75c [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ccd8a4c3bfe3413cb2ae219b09aea832 for term 8 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:19:16.055467  7498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ba5dac66ab5497e9e336f2a3c28cda5" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:19:16.014293  9100 consensus_queue.cc:1048] T 9b3759de40694069b13c0f8bd40e5709 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.071s
I20260709 13:19:16.049351  9167 raft_consensus.cc:3060] T bb7fa124c3bf4ef9ab65a407cb008441 P b7ab4784c7344b939bc36f639286f377 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:16.048998  9218 raft_consensus.cc:493] T 3fa34c08b205435dba97346991aa1f92 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:16.051486  9031 raft_consensus.cc:493] T 07a92dd554674067a83a9cb68c4773f2 P b7ab4784c7344b939bc36f639286f377 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:16.112531  6807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c37d41cd9164c15a6826ca62a851a69" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:19:16.113459  6875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3d8792045a4583ae2e965b1350a5b4" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:19:16.115897  6844 leader_election.cc:304] T ce4f062dcd314d43a63ca74067cb5ee3 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:19:16.120253  6875 raft_consensus.cc:2468] T bb3d8792045a4583ae2e965b1350a5b4 P cd75a17ab2604397adab03bb8b5fd75c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 5.
I20260709 13:19:16.122310  6844 leader_election.cc:304] T 8c7f33e544204fbaac4078e3e83bbf4e P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:19:16.118607  6697 leader_election.cc:304] T 4b8cacb381b746da8d0049b0a83b41dd P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:19:16.095402  8940 raft_consensus.cc:2804] T 7ba5dac66ab5497e9e336f2a3c28cda5 P b7ab4784c7344b939bc36f639286f377 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:19:16.085968  9206 raft_consensus.cc:493] T 404190ce4ce94cecbfcb6ea9d1dd8626 P b7ab4784c7344b939bc36f639286f377 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:16.126484  6806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a92dd554674067a83a9cb68c4773f2" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:19:16.132366  6798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4b8bd455d5a47c18a1380839c6e0d61" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:19:16.133153  6798 raft_consensus.cc:2468] T f4b8bd455d5a47c18a1380839c6e0d61 P b7ab4784c7344b939bc36f639286f377 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 5.
I20260709 13:19:16.134019  6803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb7fa124c3bf4ef9ab65a407cb008441" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:19:16.136831  6770 leader_election.cc:304] T 711ef6523deb4cbe8ef2ba61e1c21c98 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:19:16.112999  8963 raft_consensus.cc:493] T ab432e62819d499eaaf3dd55481dd930 P b7ab4784c7344b939bc36f639286f377 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:16.140893  9079 leader_election.cc:290] T 4275cf08e63345f993bce8664eada830 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:16.111641  9188 raft_consensus.cc:2749] T 1528ab62b6fe4e3099d08f141afee116 P cd75a17ab2604397adab03bb8b5fd75c [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:19:16.153623  6697 leader_election.cc:304] T 20f6842e26174571996b8dea4151d4be P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:19:16.159099  6725 raft_consensus.cc:1240] T 30e88460611e47b2ba16a46a30b5f416 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 5 FOLLOWER]: Rejecting Update request from peer b7ab4784c7344b939bc36f639286f377 for earlier term 4. Current term is 5. Ops: []
I20260709 13:19:16.159193  6697 leader_election.cc:304] T bd6869f07b5a4885a0b99fbe60c3b175 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:19:16.154702  6807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d33d5ee8ef6f415593d8df52063161ad" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:19:16.141762  6844 leader_election.cc:304] T 7c37d41cd9164c15a6826ca62a851a69 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:19:16.105613  7497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3d8792045a4583ae2e965b1350a5b4" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:19:16.119257  9240 raft_consensus.cc:2749] T 90d42e216d9741e190bca19a781291fd P cd75a17ab2604397adab03bb8b5fd75c [term 7 FOLLOWER]: Leader election lost for term 6. Reason: Vote denied by peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391) with higher term. Message: Invalid argument: T 90d42e216d9741e190bca19a781291fd P ccd8a4c3bfe3413cb2ae219b09aea832 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c for earlier term 6. Current term is 7.
I20260709 13:19:16.126896  8940 raft_consensus.cc:493] T 7ba5dac66ab5497e9e336f2a3c28cda5 P b7ab4784c7344b939bc36f639286f377 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:16.124181  8845 raft_consensus.cc:2749] T ce4f062dcd314d43a63ca74067cb5ee3 P cd75a17ab2604397adab03bb8b5fd75c [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:19:16.163147  6844 leader_election.cc:304] T 07a92dd554674067a83a9cb68c4773f2 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
W20260709 13:19:16.151015  9266 log.cc:927] Time spent T be1a92657f494cac8dd227d152f50151 P 7ba59cc884714e8aa5f3f0ecaed84cbb: Append to log took a long time: real 0.095s	user 0.000s	sys 0.000s
I20260709 13:19:16.127624  9199 raft_consensus.cc:3060] T f3f9c2e2bf644115957398fe4c9459db P ccd8a4c3bfe3413cb2ae219b09aea832 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:19:16.154507  9262 log.cc:927] Time spent T ce4f062dcd314d43a63ca74067cb5ee3 P b7ab4784c7344b939bc36f639286f377: Append to log took a long time: real 0.120s	user 0.000s	sys 0.001s
I20260709 13:19:16.171983  6697 leader_election.cc:304] T 44bde925b2e541b69890d70715b85176 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:19:16.172178  6807 raft_consensus.cc:2468] T d33d5ee8ef6f415593d8df52063161ad P b7ab4784c7344b939bc36f639286f377 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 7.
I20260709 13:19:16.175402  8940 raft_consensus.cc:3060] T 7ba5dac66ab5497e9e336f2a3c28cda5 P b7ab4784c7344b939bc36f639286f377 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:16.124620  9218 raft_consensus.cc:515] T 3fa34c08b205435dba97346991aa1f92 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:19:16.180404  6798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bf4668eeb70467fb3dc5a0289233b3c" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:19:16.155335  9212 raft_consensus.cc:2764] T 711ef6523deb4cbe8ef2ba61e1c21c98 P b7ab4784c7344b939bc36f639286f377 [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 5: won
I20260709 13:19:16.128417  9031 raft_consensus.cc:515] T 07a92dd554674067a83a9cb68c4773f2 P b7ab4784c7344b939bc36f639286f377 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:16.160669  8855 consensus_queue.cc:1048] T 3fa34c08b205435dba97346991aa1f92 P 7ba59cc884714e8aa5f3f0ecaed84cbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.026s
I20260709 13:19:16.173633  6724 raft_consensus.cc:2468] T 20f6842e26174571996b8dea4151d4be P ccd8a4c3bfe3413cb2ae219b09aea832 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 6.
I20260709 13:19:16.162529  9181 consensus_queue.cc:237] T 4f00a2e87e56452083b759f60d461ee3 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:19:16.162787  9217 raft_consensus.cc:2804] T 4b8cacb381b746da8d0049b0a83b41dd P ccd8a4c3bfe3413cb2ae219b09aea832 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:19:16.157779  9155 raft_consensus.cc:2804] T 8c7f33e544204fbaac4078e3e83bbf4e P cd75a17ab2604397adab03bb8b5fd75c [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 13:19:16.152472  8574 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.512s	user 0.015s	sys 0.032s
I20260709 13:19:16.196861  6807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f9c2e2bf644115957398fe4c9459db" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:19:16.141041  9206 raft_consensus.cc:515] T 404190ce4ce94cecbfcb6ea9d1dd8626 P b7ab4784c7344b939bc36f639286f377 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:19:16.198926  9100 raft_consensus.cc:2804] T bd6869f07b5a4885a0b99fbe60c3b175 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:19:16.221194  6806 raft_consensus.cc:2410] T 07a92dd554674067a83a9cb68c4773f2 P b7ab4784c7344b939bc36f639286f377 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c for term 6 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:19:16.199347  6844 leader_election.cc:304] T bb3d8792045a4583ae2e965b1350a5b4 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb
I20260709 13:19:16.222929  6844 leader_election.cc:304] T 7c44c4849aa54f2b94d1f1bef9ed546f P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
W20260709 13:19:16.207856  6880 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.526s	user 0.007s	sys 0.043s
I20260709 13:19:16.129071  9209 raft_consensus.cc:493] T fe20b4b48823486ca3b9c648db6ce8aa P ccd8a4c3bfe3413cb2ae219b09aea832 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 7ba59cc884714e8aa5f3f0ecaed84cbb)
I20260709 13:19:16.105799  9219 consensus_queue.cc:237] T f09c2a98de1a4decabd0ff900dd44caa P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:16.182458  7497 raft_consensus.cc:2468] T bb3d8792045a4583ae2e965b1350a5b4 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 4.
W20260709 13:19:16.199582  9270 log.cc:927] Time spent T 95a75bfe094d4bdc963aba3f08dfcd25 P cd75a17ab2604397adab03bb8b5fd75c: Append to log took a long time: real 0.166s	user 0.001s	sys 0.001s
I20260709 13:19:16.160118  8963 raft_consensus.cc:515] T ab432e62819d499eaaf3dd55481dd930 P b7ab4784c7344b939bc36f639286f377 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:16.164721  9259 consensus_queue.cc:1048] T 404190ce4ce94cecbfcb6ea9d1dd8626 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.047s
I20260709 13:19:16.155540  8986 consensus_queue.cc:237] T 3a485a995abc4807b6e511e45419f737 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:16.173003  6770 leader_election.cc:304] T 95a75bfe094d4bdc963aba3f08dfcd25 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:19:16.199295  6697 leader_election.cc:304] T d8292e16e5654be6bc408560cf256aaa P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:19:16.197846  9188 raft_consensus.cc:2804] T 7c37d41cd9164c15a6826ca62a851a69 P cd75a17ab2604397adab03bb8b5fd75c [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:19:16.200838  8845 raft_consensus.cc:2804] T 07a92dd554674067a83a9cb68c4773f2 P cd75a17ab2604397adab03bb8b5fd75c [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:19:16.213407  8987 raft_consensus.cc:2804] T 20f6842e26174571996b8dea4151d4be P ccd8a4c3bfe3413cb2ae219b09aea832 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:19:16.224238  6880 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.542s	user 0.007s	sys 0.044s
I20260709 13:19:16.250168  6877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fa34c08b205435dba97346991aa1f92" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:19:16.246891  6881 raft_consensus.cc:1240] T fe20b4b48823486ca3b9c648db6ce8aa P cd75a17ab2604397adab03bb8b5fd75c [term 4 FOLLOWER]: Rejecting Update request from peer 7ba59cc884714e8aa5f3f0ecaed84cbb for earlier term 3. Current term is 4. Ops: []
W20260709 13:19:16.254192  6770 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 90207.7us
I20260709 13:19:16.201014  9263 raft_consensus.cc:2804] T 44bde925b2e541b69890d70715b85176 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:19:16.257504  6697 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 58272.9us
I20260709 13:19:16.257900  6807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce4f062dcd314d43a63ca74067cb5ee3" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
W20260709 13:19:16.218447  8574 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.579s	user 0.015s	sys 0.032s
I20260709 13:19:16.263612  6876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d65025eea89441290d85dd053810e31" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:19:16.265249  6875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3d8792045a4583ae2e965b1350a5b4" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:19:16.262072  6874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09c2a98de1a4decabd0ff900dd44caa" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:19:16.270993  6878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce4f062dcd314d43a63ca74067cb5ee3" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:19:16.260188  9188 raft_consensus.cc:493] T 7c37d41cd9164c15a6826ca62a851a69 P cd75a17ab2604397adab03bb8b5fd75c [term 4 FOLLOWER]: Starting leader election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:19:16.261624  9079 raft_consensus.cc:2749] T 95a75bfe094d4bdc963aba3f08dfcd25 P b7ab4784c7344b939bc36f639286f377 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:19:16.272293  6881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b8cacb381b746da8d0049b0a83b41dd" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:19:16.220381  9217 raft_consensus.cc:697] T 4b8cacb381b746da8d0049b0a83b41dd P ccd8a4c3bfe3413cb2ae219b09aea832 [term 7 LEADER]: Becoming Leader. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
I20260709 13:19:16.215785  9155 raft_consensus.cc:493] T 8c7f33e544204fbaac4078e3e83bbf4e P cd75a17ab2604397adab03bb8b5fd75c [term 3 FOLLOWER]: Starting leader election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:19:16.297245  9210 leader_election.cc:290] T c4db81d9d329422bb3b4160ca4ac2d1d P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:16.302049  6878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8cee0accdb8499c86d4414b72565a38" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:19:16.303000  6878 raft_consensus.cc:2393] T d8cee0accdb8499c86d4414b72565a38 P cd75a17ab2604397adab03bb8b5fd75c [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in current term 6: Already voted for candidate cd75a17ab2604397adab03bb8b5fd75c in this term.
I20260709 13:19:16.276829  6877 raft_consensus.cc:2410] T 3fa34c08b205435dba97346991aa1f92 P cd75a17ab2604397adab03bb8b5fd75c [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ba59cc884714e8aa5f3f0ecaed84cbb for term 7 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 6.
I20260709 13:19:16.259763  9240 raft_consensus.cc:2804] T bb3d8792045a4583ae2e965b1350a5b4 P cd75a17ab2604397adab03bb8b5fd75c [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:19:16.220955  9100 raft_consensus.cc:493] T bd6869f07b5a4885a0b99fbe60c3b175 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 5 FOLLOWER]: Starting leader election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:19:16.328059  9100 raft_consensus.cc:3060] T bd6869f07b5a4885a0b99fbe60c3b175 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:16.327934  6877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fa34c08b205435dba97346991aa1f92" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:19:16.329118  6877 raft_consensus.cc:2410] T 3fa34c08b205435dba97346991aa1f92 P cd75a17ab2604397adab03bb8b5fd75c [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 7ba59cc884714e8aa5f3f0ecaed84cbb for term 7 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 6.
I20260709 13:19:16.331269  6877 raft_consensus.cc:1240] T 4f00a2e87e56452083b759f60d461ee3 P cd75a17ab2604397adab03bb8b5fd75c [term 7 FOLLOWER]: Rejecting Update request from peer 7ba59cc884714e8aa5f3f0ecaed84cbb for earlier term 6. Current term is 7. Ops: []
I20260709 13:19:16.263311  9060 raft_consensus.cc:493] T de3186201e1a40d0b335eeb8b4e256e0 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:16.270207  6770 leader_election.cc:304] T 9b3759de40694069b13c0f8bd40e5709 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:19:16.291424  6874 raft_consensus.cc:2393] T f09c2a98de1a4decabd0ff900dd44caa P cd75a17ab2604397adab03bb8b5fd75c [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate b7ab4784c7344b939bc36f639286f377 in current term 7: Already voted for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in this term.
I20260709 13:19:16.332458  9060 raft_consensus.cc:515] T de3186201e1a40d0b335eeb8b4e256e0 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
W20260709 13:19:16.332877  9264 log.cc:927] Time spent T fe20b4b48823486ca3b9c648db6ce8aa P 7ba59cc884714e8aa5f3f0ecaed84cbb: Append to log took a long time: real 0.138s	user 0.000s	sys 0.000s
W20260709 13:19:16.333007  6770 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 62894.4us
I20260709 13:19:16.334345  6770 leader_election.cc:304] T 713b5728a197487c9300b310ab94e5a3 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:19:16.335628  6770 leader_election.cc:304] T 90d42e216d9741e190bca19a781291fd P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:19:16.267349  9267 raft_consensus.cc:2804] T d8292e16e5654be6bc408560cf256aaa P ccd8a4c3bfe3413cb2ae219b09aea832 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:19:16.291740  6726 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fe20b4b48823486ca3b9c648db6ce8aa"
dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
mode: GRACEFUL
new_leader_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
 from {username='slave'} at 127.0.0.1:38536
I20260709 13:19:16.295297  6807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c240553ce044eedb41541d72b9475d7" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:19:16.291923  6881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fa34c08b205435dba97346991aa1f92" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:19:16.339074  6881 raft_consensus.cc:2410] T 3fa34c08b205435dba97346991aa1f92 P cd75a17ab2604397adab03bb8b5fd75c [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ba59cc884714e8aa5f3f0ecaed84cbb for term 7 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 6.
I20260709 13:19:16.294624  6697 leader_election.cc:304] T bb3d8792045a4583ae2e965b1350a5b4 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
I20260709 13:19:16.298574  6876 raft_consensus.cc:3060] T 3d65025eea89441290d85dd053810e31 P cd75a17ab2604397adab03bb8b5fd75c [term 4 FOLLOWER]: Advancing to term 6
I20260709 13:19:16.303999  6878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24ee15416e3145beaa1b8183453729a3" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:19:16.305786  9217 consensus_queue.cc:237] T 4b8cacb381b746da8d0049b0a83b41dd P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:19:16.309284  8827 raft_consensus.cc:515] T 711ef6523deb4cbe8ef2ba61e1c21c98 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:16.309818  8963 leader_election.cc:290] T ab432e62819d499eaaf3dd55481dd930 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:16.361020  6874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb7fa124c3bf4ef9ab65a407cb008441" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:19:16.310029  9155 raft_consensus.cc:3060] T 8c7f33e544204fbaac4078e3e83bbf4e P cd75a17ab2604397adab03bb8b5fd75c [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:19:16.311208  9031 leader_election.cc:290] T 07a92dd554674067a83a9cb68c4773f2 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:16.312849  9206 leader_election.cc:290] T 404190ce4ce94cecbfcb6ea9d1dd8626 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:19:16.317812  8793 consensus_queue.cc:1059] T b3f13b31a1f84f0d89d007eadd57924c P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:19:16.293184  9188 raft_consensus.cc:3060] T 7c37d41cd9164c15a6826ca62a851a69 P cd75a17ab2604397adab03bb8b5fd75c [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:19:16.278932  8845 raft_consensus.cc:697] T 07a92dd554674067a83a9cb68c4773f2 P cd75a17ab2604397adab03bb8b5fd75c [term 6 LEADER]: Becoming Leader. State: Replica: cd75a17ab2604397adab03bb8b5fd75c, State: Running, Role: LEADER
I20260709 13:19:16.272517  6879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ba5dac66ab5497e9e336f2a3c28cda5" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:19:16.397145  6879 raft_consensus.cc:2468] T 7ba5dac66ab5497e9e336f2a3c28cda5 P cd75a17ab2604397adab03bb8b5fd75c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in term 5.
I20260709 13:19:16.349152  6881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3d8792045a4583ae2e965b1350a5b4" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:19:16.286536  9263 raft_consensus.cc:493] T 44bde925b2e541b69890d70715b85176 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 6 FOLLOWER]: Starting leader election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:19:16.279886  9209 raft_consensus.cc:515] T fe20b4b48823486ca3b9c648db6ce8aa P ccd8a4c3bfe3413cb2ae219b09aea832 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:19:16.358246  9199 raft_consensus.cc:493] T 853ac0a8cbd64ce99457f170216d4d0f P ccd8a4c3bfe3413cb2ae219b09aea832 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:16.358754  9060 leader_election.cc:290] T de3186201e1a40d0b335eeb8b4e256e0 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
W20260709 13:19:16.358914  9129 consensus_meta.cc:287] T 4d9def8b32fd443aa94ab1420b06837b P ccd8a4c3bfe3413cb2ae219b09aea832: Time spent flushing consensus metadata: real 0.678s	user 0.010s	sys 0.004s
I20260709 13:19:16.363688  6807 raft_consensus.cc:1240] T 3a485a995abc4807b6e511e45419f737 P b7ab4784c7344b939bc36f639286f377 [term 5 FOLLOWER]: Rejecting Update request from peer cd75a17ab2604397adab03bb8b5fd75c for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 13:19:16.365217  6878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24ee15416e3145beaa1b8183453729a3" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:19:16.425500  6878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fa34c08b205435dba97346991aa1f92" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:19:16.362097  6770 leader_election.cc:304] T 3d65025eea89441290d85dd053810e31 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
I20260709 13:19:16.426751  6879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24ee15416e3145beaa1b8183453729a3" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
W20260709 13:19:16.427134  6770 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 65138.9us
I20260709 13:19:16.366037  6874 raft_consensus.cc:2393] T bb7fa124c3bf4ef9ab65a407cb008441 P cd75a17ab2604397adab03bb8b5fd75c [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in current term 7: Already voted for candidate cd75a17ab2604397adab03bb8b5fd75c in this term.
I20260709 13:19:16.426743  6878 raft_consensus.cc:2410] T 3fa34c08b205435dba97346991aa1f92 P cd75a17ab2604397adab03bb8b5fd75c [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 7ba59cc884714e8aa5f3f0ecaed84cbb for term 7 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 6.
I20260709 13:19:16.367981  6877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24ee15416e3145beaa1b8183453729a3" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:19:16.359488  9273 raft_consensus.cc:2804] T 7c44c4849aa54f2b94d1f1bef9ed546f P cd75a17ab2604397adab03bb8b5fd75c [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:19:16.346056  6800 raft_consensus.cc:1240] T f3f9c2e2bf644115957398fe4c9459db P b7ab4784c7344b939bc36f639286f377 [term 6 LEADER]: Rejecting Update request from peer ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 5. Current term is 6. Ops: []
I20260709 13:19:16.342852  9267 raft_consensus.cc:493] T d8292e16e5654be6bc408560cf256aaa P ccd8a4c3bfe3413cb2ae219b09aea832 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:16.405756  6881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb7fa124c3bf4ef9ab65a407cb008441" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:19:16.346292  9050 raft_consensus.cc:2749] T 90d42e216d9741e190bca19a781291fd P b7ab4784c7344b939bc36f639286f377 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:19:16.354835  9210 raft_consensus.cc:2749] T 713b5728a197487c9300b310ab94e5a3 P b7ab4784c7344b939bc36f639286f377 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:19:16.414849  8793 consensus_queue.cc:1243] T b3f13b31a1f84f0d89d007eadd57924c P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Peer 7ba59cc884714e8aa5f3f0ecaed84cbb log is divergent from this leader: its last log entry 5.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:19:16.405195  9263 raft_consensus.cc:3060] T 44bde925b2e541b69890d70715b85176 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:16.450394  6878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ba5dac66ab5497e9e336f2a3c28cda5" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:19:16.434084  6726 raft_consensus.cc:606] T fe20b4b48823486ca3b9c648db6ce8aa P ccd8a4c3bfe3413cb2ae219b09aea832 [term 3 FOLLOWER]: Received request to transfer leadership to TS cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:19:16.452632  6881 raft_consensus.cc:2393] T bb7fa124c3bf4ef9ab65a407cb008441 P cd75a17ab2604397adab03bb8b5fd75c [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in current term 7: Already voted for candidate cd75a17ab2604397adab03bb8b5fd75c in this term.
W20260709 13:19:16.454105  6695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 497576us
I20260709 13:19:16.362991  9079 raft_consensus.cc:2749] T 9b3759de40694069b13c0f8bd40e5709 P b7ab4784c7344b939bc36f639286f377 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:19:16.458071  6877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b8cacb381b746da8d0049b0a83b41dd" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:19:16.482765  8574 consensus_queue.cc:1059] T 30e88460611e47b2ba16a46a30b5f416 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:19:16.493134  6726 raft_consensus.cc:614] T fe20b4b48823486ca3b9c648db6ce8aa P ccd8a4c3bfe3413cb2ae219b09aea832 [term 3 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:19:16.457108  6874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ba5dac66ab5497e9e336f2a3c28cda5" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:19:16.486253  6879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce4f062dcd314d43a63ca74067cb5ee3" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:19:16.496357  6874 raft_consensus.cc:1275] T 3fa34c08b205435dba97346991aa1f92 P cd75a17ab2604397adab03bb8b5fd75c [term 7 FOLLOWER]: Refusing update from remote peer 7ba59cc884714e8aa5f3f0ecaed84cbb: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 7. (term mismatch)
I20260709 13:19:16.496882  6874 pending_rounds.cc:85] T 3fa34c08b205435dba97346991aa1f92 P cd75a17ab2604397adab03bb8b5fd75c: Aborting all ops after (but not including) 6
I20260709 13:19:16.493072  6878 raft_consensus.cc:3060] T 7ba5dac66ab5497e9e336f2a3c28cda5 P cd75a17ab2604397adab03bb8b5fd75c [term 5 FOLLOWER]: Advancing to term 7
I20260709 13:19:16.497182  6874 pending_rounds.cc:107] T 3fa34c08b205435dba97346991aa1f92 P cd75a17ab2604397adab03bb8b5fd75c: Aborting uncommitted NO_OP operation due to leader change: 6.7
I20260709 13:19:16.497617  6874 raft_consensus.cc:2889] T 3fa34c08b205435dba97346991aa1f92 P cd75a17ab2604397adab03bb8b5fd75c [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:19:16.501936  6876 raft_consensus.cc:2468] T 3d65025eea89441290d85dd053810e31 P cd75a17ab2604397adab03bb8b5fd75c [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 6.
I20260709 13:19:16.432827  9060 raft_consensus.cc:2804] T bb3d8792045a4583ae2e965b1350a5b4 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:19:16.448340  9031 raft_consensus.cc:2804] T 3d65025eea89441290d85dd053810e31 P b7ab4784c7344b939bc36f639286f377 [term 6 FOLLOWER]: Leader election won for term 6
W20260709 13:19:16.513643  7468 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.517s	user 0.039s	sys 0.051s
W20260709 13:19:16.525095  7468 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.528s	user 0.039s	sys 0.051s
W20260709 13:19:16.525940  7468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 529405us
I20260709 13:19:16.527135  6878 raft_consensus.cc:2468] T 7ba5dac66ab5497e9e336f2a3c28cda5 P cd75a17ab2604397adab03bb8b5fd75c [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in term 7.
I20260709 13:19:16.533689  6695 leader_election.cc:304] T a3022224cc81473690653a83d4e99470 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:19:16.461892  9273 raft_consensus.cc:493] T 7c44c4849aa54f2b94d1f1bef9ed546f P cd75a17ab2604397adab03bb8b5fd75c [term 7 FOLLOWER]: Starting leader election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:19:16.423636  9199 raft_consensus.cc:515] T 853ac0a8cbd64ce99457f170216d4d0f P ccd8a4c3bfe3413cb2ae219b09aea832 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
W20260709 13:19:16.542833  6770 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 82236.6us
I20260709 13:19:16.479256  9267 raft_consensus.cc:3060] T d8292e16e5654be6bc408560cf256aaa P ccd8a4c3bfe3413cb2ae219b09aea832 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:16.546026  6879 raft_consensus.cc:1275] T 7ba5dac66ab5497e9e336f2a3c28cda5 P cd75a17ab2604397adab03bb8b5fd75c [term 7 FOLLOWER]: Refusing update from remote peer 7ba59cc884714e8aa5f3f0ecaed84cbb: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:19:16.556552  6695 leader_election.cc:304] T 7c44c4849aa54f2b94d1f1bef9ed546f P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:19:16.514776  9060 raft_consensus.cc:493] T bb3d8792045a4583ae2e965b1350a5b4 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:16.552672  6770 leader_election.cc:304] T 20f6842e26174571996b8dea4151d4be P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:19:16.569293  6695 leader_election.cc:304] T e77e330a82df4b43a745d57a68f6f057 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:19:16.522354  8855 raft_consensus.cc:3055] T 4f00a2e87e56452083b759f60d461ee3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 6 LEADER]: Stepping down as leader of term 6
W20260709 13:19:16.583536  6771 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:16.550665  9218 leader_election.cc:290] T 3fa34c08b205435dba97346991aa1f92 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:19:16.551203  9031 raft_consensus.cc:697] T 3d65025eea89441290d85dd053810e31 P b7ab4784c7344b939bc36f639286f377 [term 6 LEADER]: Becoming Leader. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
W20260709 13:19:16.591547  6772 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.507s	user 0.009s	sys 0.021s
I20260709 13:19:16.522766  9193 consensus_queue.cc:1048] T f4b8bd455d5a47c18a1380839c6e0d61 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.057s
I20260709 13:19:16.523656  9129 consensus_queue.cc:1059] T 713b5728a197487c9300b310ab94e5a3 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.055s
W20260709 13:19:16.595484  6772 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.511s	user 0.009s	sys 0.022s
I20260709 13:19:16.550944  9273 raft_consensus.cc:3060] T 7c44c4849aa54f2b94d1f1bef9ed546f P cd75a17ab2604397adab03bb8b5fd75c [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:16.579352  8855 raft_consensus.cc:740] T 4f00a2e87e56452083b759f60d461ee3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 7ba59cc884714e8aa5f3f0ecaed84cbb, State: Running, Role: LEADER
W20260709 13:19:16.592938  9137 consensus_meta.cc:287] T 1bf4668eeb70467fb3dc5a0289233b3c P b7ab4784c7344b939bc36f639286f377: Time spent flushing consensus metadata: real 0.650s	user 0.012s	sys 0.003s
I20260709 13:19:16.585680  8963 raft_consensus.cc:2804] T 20f6842e26174571996b8dea4151d4be P b7ab4784c7344b939bc36f639286f377 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:19:16.571130  9261 consensus_queue.cc:1059] T fe20b4b48823486ca3b9c648db6ce8aa P 7ba59cc884714e8aa5f3f0ecaed84cbb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.034s
W20260709 13:19:16.598975  6772 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.68:45071, user_credentials={real_user=slave}} blocked reactor thread for 545208us
I20260709 13:19:16.544520  9251 consensus_queue.cc:1048] T 7887766dc6784fcaa42b35c05fea7a99 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.044s
I20260709 13:19:16.570690  9060 raft_consensus.cc:3060] T bb3d8792045a4583ae2e965b1350a5b4 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:16.622241  6878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4275cf08e63345f993bce8664eada830" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:19:16.623522  6878 raft_consensus.cc:2410] T 4275cf08e63345f993bce8664eada830 P cd75a17ab2604397adab03bb8b5fd75c [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7ab4784c7344b939bc36f639286f377 for term 7 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
W20260709 13:19:16.629945  6730 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.680s	user 0.011s	sys 0.011s
I20260709 13:19:16.636162  6807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b56bf91d90824c959e21e0cee5ba1816" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:19:16.640911  6807 raft_consensus.cc:2393] T b56bf91d90824c959e21e0cee5ba1816 P b7ab4784c7344b939bc36f639286f377 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c in current term 7: Already voted for candidate b7ab4784c7344b939bc36f639286f377 in this term.
I20260709 13:19:16.643218  6807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34f36d59d88f40fe8a2805e604fc6c0a" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:19:16.644332  6807 raft_consensus.cc:2393] T 34f36d59d88f40fe8a2805e604fc6c0a P b7ab4784c7344b939bc36f639286f377 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c in current term 4: Already voted for candidate b7ab4784c7344b939bc36f639286f377 in this term.
I20260709 13:19:16.580910  8845 consensus_queue.cc:237] T 07a92dd554674067a83a9cb68c4773f2 P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:16.619452  8963 raft_consensus.cc:697] T 20f6842e26174571996b8dea4151d4be P b7ab4784c7344b939bc36f639286f377 [term 6 LEADER]: Becoming Leader. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
I20260709 13:19:16.645359  6807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6869f07b5a4885a0b99fbe60c3b175" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 6 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:19:16.660483  6807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20f6842e26174571996b8dea4151d4be" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
W20260709 13:19:16.647078  6730 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.691s	user 0.011s	sys 0.011s
I20260709 13:19:16.656484  6877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab432e62819d499eaaf3dd55481dd930" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 8 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:19:16.658205  6803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d9def8b32fd443aa94ab1420b06837b" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:19:16.648708  6879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "853ac0a8cbd64ce99457f170216d4d0f" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:19:16.662628  6803 raft_consensus.cc:2393] T 4d9def8b32fd443aa94ab1420b06837b P b7ab4784c7344b939bc36f639286f377 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c in current term 6: Already voted for candidate b7ab4784c7344b939bc36f639286f377 in this term.
I20260709 13:19:16.662529  6879 raft_consensus.cc:2468] T 853ac0a8cbd64ce99457f170216d4d0f P cd75a17ab2604397adab03bb8b5fd75c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 2.
I20260709 13:19:16.623674  9261 consensus_queue.cc:1243] T fe20b4b48823486ca3b9c648db6ce8aa P 7ba59cc884714e8aa5f3f0ecaed84cbb [LEADER]: Peer cd75a17ab2604397adab03bb8b5fd75c log is divergent from this leader: its last log entry 2.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 13:19:16.666545  6881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a92dd554674067a83a9cb68c4773f2" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:19:16.613373  9137 raft_consensus.cc:515] T 1bf4668eeb70467fb3dc5a0289233b3c P b7ab4784c7344b939bc36f639286f377 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:16.669293  6878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4db81d9d329422bb3b4160ca4ac2d1d" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:19:16.673959  6878 raft_consensus.cc:2468] T c4db81d9d329422bb3b4160ca4ac2d1d P cd75a17ab2604397adab03bb8b5fd75c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 6.
I20260709 13:19:16.675071  6727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34f36d59d88f40fe8a2805e604fc6c0a" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:19:16.679611  6807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30e88460611e47b2ba16a46a30b5f416" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:19:16.622929  9259 consensus_queue.cc:1048] T 3411566abe2d4c9bb4b2adfdd05e6f17 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.043s
I20260709 13:19:16.686257  6727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6869f07b5a4885a0b99fbe60c3b175" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 6 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:19:16.692524  6880 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53416 (request call id 2254) took 2098 ms. Trace:
W20260709 13:19:16.697654  6771 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:16.644798  9129 consensus_queue.cc:1048] T ab432e62819d499eaaf3dd55481dd930 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.041s
W20260709 13:19:16.745726  6697 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.68:45071, user_credentials={real_user=slave}} blocked reactor thread for 451148us
I20260709 13:19:16.746162  6727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe20b4b48823486ca3b9c648db6ce8aa" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:19:16.751039  6798 raft_consensus.cc:2393] T 1bf4668eeb70467fb3dc5a0289233b3c P b7ab4784c7344b939bc36f639286f377 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c in current term 6: Already voted for candidate b7ab4784c7344b939bc36f639286f377 in this term.
I20260709 13:19:16.751196  6727 raft_consensus.cc:3060] T fe20b4b48823486ca3b9c648db6ce8aa P ccd8a4c3bfe3413cb2ae219b09aea832 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:19:16.752419  6807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4db81d9d329422bb3b4160ca4ac2d1d" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:19:16.753162  6807 raft_consensus.cc:2468] T c4db81d9d329422bb3b4160ca4ac2d1d P b7ab4784c7344b939bc36f639286f377 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 6.
I20260709 13:19:16.745819  6803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4275cf08e63345f993bce8664eada830" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:19:16.663745  9218 raft_consensus.cc:2749] T a3022224cc81473690653a83d4e99470 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:19:16.664287  9240 raft_consensus.cc:697] T bb3d8792045a4583ae2e965b1350a5b4 P cd75a17ab2604397adab03bb8b5fd75c [term 5 LEADER]: Becoming Leader. State: Replica: cd75a17ab2604397adab03bb8b5fd75c, State: Running, Role: LEADER
I20260709 13:19:16.759120  6807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de3186201e1a40d0b335eeb8b4e256e0" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:19:16.753350  6772 leader_election.cc:304] T f09c2a98de1a4decabd0ff900dd44caa P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:19:16.754153  6803 raft_consensus.cc:2468] T 4275cf08e63345f993bce8664eada830 P b7ab4784c7344b939bc36f639286f377 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 6.
I20260709 13:19:16.760146  6807 raft_consensus.cc:2393] T de3186201e1a40d0b335eeb8b4e256e0 P b7ab4784c7344b939bc36f639286f377 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c in current term 6: Already voted for candidate b7ab4784c7344b939bc36f639286f377 in this term.
I20260709 13:19:16.756131  6731 raft_consensus.cc:1240] T f58dc08b12a2494bb9a1372837970ca2 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 8 LEADER]: Rejecting Update request from peer b7ab4784c7344b939bc36f639286f377 for earlier term 7. Current term is 8. Ops: [7.4-7.4]
I20260709 13:19:16.673974  9209 leader_election.cc:290] T fe20b4b48823486ca3b9c648db6ce8aa P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
W20260709 13:19:16.750486  6698 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:16.826581  6697 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:16.827921  6727 raft_consensus.cc:2410] T fe20b4b48823486ca3b9c648db6ce8aa P ccd8a4c3bfe3413cb2ae219b09aea832 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c for term 4 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:19:16.658661  9031 consensus_queue.cc:237] T 3d65025eea89441290d85dd053810e31 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:16.848049  6727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d9def8b32fd443aa94ab1420b06837b" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
W20260709 13:19:16.827791  9275 log.cc:927] Time spent T f3f9c2e2bf644115957398fe4c9459db P b7ab4784c7344b939bc36f639286f377: Append to log took a long time: real 0.290s	user 0.000s	sys 0.001s
I20260709 13:19:16.817234  9065 raft_consensus.cc:2804] T e77e330a82df4b43a745d57a68f6f057 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 8 FOLLOWER]: Leader election won for term 8
W20260709 13:19:16.865785  6695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 296556us
I20260709 13:19:16.816169  7497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "404190ce4ce94cecbfcb6ea9d1dd8626" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
W20260709 13:19:16.847150  8940 consensus_meta.cc:287] T 7ba5dac66ab5497e9e336f2a3c28cda5 P b7ab4784c7344b939bc36f639286f377: Time spent flushing consensus metadata: real 0.638s	user 0.013s	sys 0.000s
W20260709 13:19:16.837291  9271 log.cc:927] Time spent T 34f36d59d88f40fe8a2805e604fc6c0a P ccd8a4c3bfe3413cb2ae219b09aea832: Append to log took a long time: real 0.342s	user 0.000s	sys 0.001s
I20260709 13:19:16.838788  9193 raft_consensus.cc:3055] T 713b5728a197487c9300b310ab94e5a3 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:19:16.913058  6695 leader_election.cc:304] T 3d65025eea89441290d85dd053810e31 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:19:16.854833  7496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fa34c08b205435dba97346991aa1f92" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
W20260709 13:19:16.928581  6844 connection.cc:256] RPC call timeout handler was delayed by -1.7415615170000365s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1519s for a response
W20260709 13:19:16.960532  6844 connection.cc:256] RPC call timeout handler was delayed by -1.7145615169999928s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1549s for a response
I20260709 13:19:16.923967  6727 raft_consensus.cc:2468] T 4d9def8b32fd443aa94ab1420b06837b P ccd8a4c3bfe3413cb2ae219b09aea832 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 6.
I20260709 13:19:16.678566  8855 consensus_queue.cc:260] T 4f00a2e87e56452083b759f60d461ee3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:19:16.853953  9199 leader_election.cc:290] T 853ac0a8cbd64ce99457f170216d4d0f P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:16.755486  8963 consensus_queue.cc:237] T 20f6842e26174571996b8dea4151d4be P b7ab4784c7344b939bc36f639286f377 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
W20260709 13:19:16.960711  6695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 47767.2us
W20260709 13:19:16.960983  6844 connection.cc:256] RPC call timeout handler was delayed by -1.7136615169999914s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15500000000000003s for a response
W20260709 13:19:17.017383  6844 connection.cc:256] RPC call timeout handler was delayed by -1.7073615169999812s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1557s for a response
W20260709 13:19:17.017876  6844 connection.cc:256] RPC call timeout handler was delayed by -1.6857615169999463s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15810000000000002s for a response
W20260709 13:19:17.019104  6844 connection.cc:256] RPC call timeout handler was delayed by -1.5111615169998913s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1775s for a response
W20260709 13:19:17.019502  6844 connection.cc:256] RPC call timeout handler was delayed by -1.4760615170000619s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1814s for a response
W20260709 13:19:17.019879  6844 connection.cc:256] RPC call timeout handler was delayed by -1.4418615170000066s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18520000000000003s for a response
W20260709 13:19:17.020275  6844 connection.cc:256] RPC call timeout handler was delayed by -1.4400615170000037s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1854s for a response
W20260709 13:19:17.020653  6844 connection.cc:256] RPC call timeout handler was delayed by -1.4355615169999965s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1859s for a response
W20260709 13:19:17.021023  6844 connection.cc:256] RPC call timeout handler was delayed by -1.395061516999931s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1904s for a response
W20260709 13:19:17.021265  6844 connection.cc:256] RPC call timeout handler was delayed by -1.3815615169999091s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19190000000000002s for a response
W20260709 13:19:17.021530  6844 connection.cc:256] RPC call timeout handler was delayed by -1.3266615170000478s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.198s for a response
W20260709 13:19:17.021811  6844 connection.cc:256] RPC call timeout handler was delayed by -1.26006151699994s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2054s for a response
W20260709 13:19:17.022086  6844 connection.cc:256] RPC call timeout handler was delayed by -1.1970615170000656s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21240000000000003s for a response
W20260709 13:19:17.022379  6844 connection.cc:256] RPC call timeout handler was delayed by -1.1943615170000612s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2127s for a response
W20260709 13:19:17.022652  6844 connection.cc:256] RPC call timeout handler was delayed by -1.1934615170000598s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21280000000000002s for a response
W20260709 13:19:17.022943  6844 connection.cc:256] RPC call timeout handler was delayed by -1.1835615170000438s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21389999999999998s for a response
W20260709 13:19:17.023228  6844 connection.cc:256] RPC call timeout handler was delayed by -1.148461516999987s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2178s for a response
W20260709 13:19:17.023505  6844 connection.cc:256] RPC call timeout handler was delayed by -1.1322615169999608s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21960000000000002s for a response
W20260709 13:19:17.023794  6844 connection.cc:256] RPC call timeout handler was delayed by -1.1295615169999564s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21989999999999998s for a response
W20260709 13:19:17.027649  7468 leader_election.cc:336] T 24ee15416e3145beaa1b8183453729a3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931): Timed out: RequestConsensusVote RPC to 127.5.126.67:42931 timed out after 1.850s (SENT)
W20260709 13:19:17.067530  6844 connection.cc:256] RPC call timeout handler was delayed by -1.1052615169999171s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22260000000000002s for a response
I20260709 13:19:16.974637  9283 raft_consensus.cc:493] T 22ccee1b570c4ad3a57bd7aec085b1b4 P b7ab4784c7344b939bc36f639286f377 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:16.970115  9282 log.cc:927] Time spent T 4f00a2e87e56452083b759f60d461ee3 P 7ba59cc884714e8aa5f3f0ecaed84cbb: Append to log took a long time: real 0.216s	user 0.000s	sys 0.000s
W20260709 13:19:16.987537  9188 consensus_meta.cc:287] T 7c37d41cd9164c15a6826ca62a851a69 P cd75a17ab2604397adab03bb8b5fd75c: Time spent flushing consensus metadata: real 0.572s	user 0.003s	sys 0.006s
W20260709 13:19:16.964587  9291 log.cc:927] Time spent T 24ee15416e3145beaa1b8183453729a3 P ccd8a4c3bfe3413cb2ae219b09aea832: Append to log took a long time: real 0.088s	user 0.000s	sys 0.000s
W20260709 13:19:16.974632  9100 consensus_meta.cc:287] T bd6869f07b5a4885a0b99fbe60c3b175 P ccd8a4c3bfe3413cb2ae219b09aea832: Time spent flushing consensus metadata: real 0.646s	user 0.005s	sys 0.005s
W20260709 13:19:16.969775  8832 consensus_meta.cc:287] T f58dc08b12a2494bb9a1372837970ca2 P b7ab4784c7344b939bc36f639286f377: Time spent flushing consensus metadata: real 1.232s	user 0.003s	sys 0.013s
I20260709 13:19:17.015156  9259 raft_consensus.cc:2749] T 3d65025eea89441290d85dd053810e31 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:19:17.068023  6844 connection.cc:256] RPC call timeout handler was delayed by -1.1007615169999099s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2231s for a response
I20260709 13:19:16.969311  7495 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50756 (request call id 170) took 3359 ms. Trace:
I20260709 13:19:17.052479  6727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b56bf91d90824c959e21e0cee5ba1816" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:19:16.969592  9079 raft_consensus.cc:2749] T f09c2a98de1a4decabd0ff900dd44caa P b7ab4784c7344b939bc36f639286f377 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:19:16.959836  9193 raft_consensus.cc:740] T 713b5728a197487c9300b310ab94e5a3 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
I20260709 13:19:16.970893  9129 raft_consensus.cc:493] T 8c7f33e544204fbaac4078e3e83bbf4e P ccd8a4c3bfe3413cb2ae219b09aea832 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:19:16.980334  9137 leader_election.cc:290] T 1bf4668eeb70467fb3dc5a0289233b3c P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 6 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
W20260709 13:19:17.064636  9263 consensus_meta.cc:287] T 44bde925b2e541b69890d70715b85176 P ccd8a4c3bfe3413cb2ae219b09aea832: Time spent flushing consensus metadata: real 0.549s	user 0.012s	sys 0.000s
W20260709 13:19:17.071354  6772 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 318082us
I20260709 13:19:17.064239  8855 raft_consensus.cc:3060] T 4f00a2e87e56452083b759f60d461ee3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:16.959640  8940 raft_consensus.cc:515] T 7ba5dac66ab5497e9e336f2a3c28cda5 P b7ab4784c7344b939bc36f639286f377 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
W20260709 13:19:17.109918  6844 connection.cc:256] RPC call timeout handler was delayed by -1.0854615169998851s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22480000000000003s for a response
W20260709 13:19:17.110160  6695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 58580.2us
W20260709 13:19:17.113145  6804 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.753s	user 0.005s	sys 0.013s
W20260709 13:19:17.136312  6804 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.776s	user 0.005s	sys 0.013s
I20260709 13:19:17.067288  9267 raft_consensus.cc:515] T d8292e16e5654be6bc408560cf256aaa P ccd8a4c3bfe3413cb2ae219b09aea832 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
W20260709 13:19:17.121742  6771 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:16.978368  9240 consensus_queue.cc:237] T bb3d8792045a4583ae2e965b1350a5b4 P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:19:17.124933  6727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20f6842e26174571996b8dea4151d4be" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:19:17.084836  9181 raft_consensus.cc:493] T 1528ab62b6fe4e3099d08f141afee116 P b7ab4784c7344b939bc36f639286f377 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 7ba59cc884714e8aa5f3f0ecaed84cbb)
W20260709 13:19:17.130478  9155 consensus_meta.cc:287] T 8c7f33e544204fbaac4078e3e83bbf4e P cd75a17ab2604397adab03bb8b5fd75c: Time spent flushing consensus metadata: real 0.728s	user 0.012s	sys 0.001s
I20260709 13:19:17.087414  9100 raft_consensus.cc:515] T bd6869f07b5a4885a0b99fbe60c3b175 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:17.179749  9155 raft_consensus.cc:515] T 8c7f33e544204fbaac4078e3e83bbf4e P cd75a17ab2604397adab03bb8b5fd75c [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:17.111899  7495 rpcz_store.cc:276] 0709 13:19:13.609919 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:13.612086 (+  2167us) service_pool.cc:224] Handling call
0709 13:19:14.005253 (+393167us) spinlock_profiling.cc:243] Waited 23.9 ms on lock 0x7b5800123f98. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0c745db1 00007fcc0c885b71 00007fcc0c885a22 00007fcc1579ec09 00007fcc148f8ee0 00007fcc149c20ab 00007fcc149c2131 00007fcc14983fc0 00007fcc1496e929 00007fcc1496e3d2 00007fcc0dee5bd4
0709 13:19:14.005643 (+   390us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:16.009295 (+2003652us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:16.969033 (+959738us) spinlock_profiling.cc:243] Waited 1.94 s on lock 0x7b54004957d4. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f9aae01 00007fcc0f9a983e 00007fcc1496e419 00007fcc0dee5bd4 00007fcc0dee5b62 00007fcc0dee5a91 00007fcc0dee5a0c 00007fcc0dee4cc2 00007fcc0dce548c 00007fcc0dce48c6
0709 13:19:16.969236 (+   203us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4506904320}
I20260709 13:19:17.145828  6727 raft_consensus.cc:2393] T 20f6842e26174571996b8dea4151d4be P ccd8a4c3bfe3413cb2ae219b09aea832 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c in current term 6: Already voted for candidate b7ab4784c7344b939bc36f639286f377 in this term.
I20260709 13:19:17.082888  9188 raft_consensus.cc:515] T 7c37d41cd9164c15a6826ca62a851a69 P cd75a17ab2604397adab03bb8b5fd75c [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
W20260709 13:19:17.186465  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 45503.7us
I20260709 13:19:17.183480  6802 raft_consensus.cc:1240] T 7ba5dac66ab5497e9e336f2a3c28cda5 P b7ab4784c7344b939bc36f639286f377 [term 8 FOLLOWER]: Rejecting Update request from peer 7ba59cc884714e8aa5f3f0ecaed84cbb for earlier term 7. Current term is 8. Ops: [7.8-7.8]
I20260709 13:19:17.147646  6772 leader_election.cc:304] T 853ac0a8cbd64ce99457f170216d4d0f P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:19:17.191207  6724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4275cf08e63345f993bce8664eada830" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
W20260709 13:19:17.191934  6772 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 44398.5us
I20260709 13:19:17.192682  6724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4db81d9d329422bb3b4160ca4ac2d1d" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:19:17.196106  6879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bf4668eeb70467fb3dc5a0289233b3c" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:19:17.197266  6877 raft_consensus.cc:1240] T 8c7f33e544204fbaac4078e3e83bbf4e P cd75a17ab2604397adab03bb8b5fd75c [term 4 FOLLOWER]: Rejecting Update request from peer b7ab4784c7344b939bc36f639286f377 for earlier term 3. Current term is 4. Ops: []
I20260709 13:19:17.200528  6727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4275cf08e63345f993bce8664eada830" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:19:17.202499  6844 leader_election.cc:304] T 44bde925b2e541b69890d70715b85176 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:19:17.213680  6724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fa34c08b205435dba97346991aa1f92" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:19:17.081424  9283 raft_consensus.cc:515] T 22ccee1b570c4ad3a57bd7aec085b1b4 P b7ab4784c7344b939bc36f639286f377 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
W20260709 13:19:17.216146  6695 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:17.220942  6724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de3186201e1a40d0b335eeb8b4e256e0" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:19:17.221796  6724 raft_consensus.cc:2468] T de3186201e1a40d0b335eeb8b4e256e0 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 6.
W20260709 13:19:17.222652  6757 heartbeater.cc:646] Failed to heartbeat to 127.5.126.126:34367 (0 consecutive failures): Timed out: Failed to send heartbeat to master: TSHeartbeat RPC to 127.5.126.126:34367 timed out after 15.000s (SENT)
I20260709 13:19:17.222962  6724 raft_consensus.cc:1240] T 24ee15416e3145beaa1b8183453729a3 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 6 FOLLOWER]: Rejecting Update request from peer cd75a17ab2604397adab03bb8b5fd75c for earlier term 5. Current term is 6. Ops: []
I20260709 13:19:17.224826  9289 raft_consensus.cc:2749] T 44bde925b2e541b69890d70715b85176 P cd75a17ab2604397adab03bb8b5fd75c [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:19:17.227825  9267 leader_election.cc:290] T d8292e16e5654be6bc408560cf256aaa P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 8 election: Requested vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:17.135564  9263 raft_consensus.cc:515] T 44bde925b2e541b69890d70715b85176 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:17.231186  6724 raft_consensus.cc:1240] T 22ccee1b570c4ad3a57bd7aec085b1b4 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 5 LEADER]: Rejecting Update request from peer cd75a17ab2604397adab03bb8b5fd75c for earlier term 4. Current term is 5. Ops: []
I20260709 13:19:17.235595  6727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30e88460611e47b2ba16a46a30b5f416" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:19:17.236716  6727 raft_consensus.cc:2393] T 30e88460611e47b2ba16a46a30b5f416 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c in current term 5: Already voted for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in this term.
I20260709 13:19:17.238101  6727 raft_consensus.cc:1240] T 4b8cacb381b746da8d0049b0a83b41dd P ccd8a4c3bfe3413cb2ae219b09aea832 [term 7 LEADER]: Rejecting Update request from peer cd75a17ab2604397adab03bb8b5fd75c for earlier term 6. Current term is 7. Ops: []
I20260709 13:19:17.239617  6727 raft_consensus.cc:1240] T 3a485a995abc4807b6e511e45419f737 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 5 LEADER]: Rejecting Update request from peer cd75a17ab2604397adab03bb8b5fd75c for earlier term 4. Current term is 5. Ops: []
I20260709 13:19:17.185917  9209 raft_consensus.cc:3055] T 34f36d59d88f40fe8a2805e604fc6c0a P ccd8a4c3bfe3413cb2ae219b09aea832 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:19:17.267568  6844 leader_election.cc:304] T f5be3a11b23d4ea9b08300a2789821c7 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:19:17.127605  9129 raft_consensus.cc:515] T 8c7f33e544204fbaac4078e3e83bbf4e P ccd8a4c3bfe3413cb2ae219b09aea832 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:17.257351  6732 raft_consensus.cc:3055] T b3f13b31a1f84f0d89d007eadd57924c P ccd8a4c3bfe3413cb2ae219b09aea832 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:19:17.143968  9065 raft_consensus.cc:697] T e77e330a82df4b43a745d57a68f6f057 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 8 LEADER]: Becoming Leader. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
I20260709 13:19:17.255492  9279 raft_consensus.cc:493] T 7a734b5ab7834e05a8c422208acc58b1 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:17.275621  7468 leader_election.cc:336] T 24ee15416e3145beaa1b8183453729a3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931): Timed out: RequestConsensusVote RPC to 127.5.126.67:42931 timed out after 1.600s (SENT)
I20260709 13:19:17.214831  9178 raft_consensus.cc:2749] T 7c44c4849aa54f2b94d1f1bef9ed546f P ccd8a4c3bfe3413cb2ae219b09aea832 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:19:17.270529  6732 raft_consensus.cc:740] T b3f13b31a1f84f0d89d007eadd57924c P ccd8a4c3bfe3413cb2ae219b09aea832 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
W20260709 13:19:17.278990  7468 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:17.277763  9155 leader_election.cc:290] T 8c7f33e544204fbaac4078e3e83bbf4e P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 4 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:19:17.284945  9279 raft_consensus.cc:515] T 7a734b5ab7834e05a8c422208acc58b1 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:17.279330  9294 raft_consensus.cc:493] T 2c240553ce044eedb41541d72b9475d7 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:17.286237  9294 raft_consensus.cc:515] T 2c240553ce044eedb41541d72b9475d7 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:17.287562  9279 leader_election.cc:290] T 7a734b5ab7834e05a8c422208acc58b1 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
W20260709 13:19:17.288591  9299 log.cc:927] Time spent T 4f00a2e87e56452083b759f60d461ee3 P b7ab4784c7344b939bc36f639286f377: Append to log took a long time: real 0.153s	user 0.000s	sys 0.000s
I20260709 13:19:17.289849  9188 leader_election.cc:290] T 7c37d41cd9164c15a6826ca62a851a69 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 5 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
W20260709 13:19:17.290123  9292 log.cc:927] Time spent T a3022224cc81473690653a83d4e99470 P ccd8a4c3bfe3413cb2ae219b09aea832: Append to log took a long time: real 0.238s	user 0.001s	sys 0.000s
I20260709 13:19:17.257651  9259 raft_consensus.cc:493] T be1a92657f494cac8dd227d152f50151 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 7ba59cc884714e8aa5f3f0ecaed84cbb)
I20260709 13:19:17.278559  9289 raft_consensus.cc:2749] T f5be3a11b23d4ea9b08300a2789821c7 P cd75a17ab2604397adab03bb8b5fd75c [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:19:17.267798  9209 raft_consensus.cc:740] T 34f36d59d88f40fe8a2805e604fc6c0a P ccd8a4c3bfe3413cb2ae219b09aea832 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
W20260709 13:19:17.296953  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 56002us
I20260709 13:19:17.301813  6844 leader_election.cc:400] T 3d65025eea89441290d85dd053810e31 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 5 pre-election: Vote denied by peer b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817) with higher term. Message: Invalid argument: T 3d65025eea89441290d85dd053810e31 P b7ab4784c7344b939bc36f639286f377 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c for earlier term 5. Current term is 6.
I20260709 13:19:17.302232  6844 leader_election.cc:403] T 3d65025eea89441290d85dd053810e31 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 5 pre-election: Cancelling election due to peer responding with higher term
W20260709 13:19:17.302459  7468 leader_election.cc:336] T ce4f062dcd314d43a63ca74067cb5ee3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931): Timed out: RequestConsensusVote RPC to 127.5.126.67:42931 timed out after 2.108s (SENT)
I20260709 13:19:17.302942  7468 leader_election.cc:304] T ce4f062dcd314d43a63ca74067cb5ee3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, b7ab4784c7344b939bc36f639286f377; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:19:17.303658  8845 raft_consensus.cc:2749] T 3d65025eea89441290d85dd053810e31 P cd75a17ab2604397adab03bb8b5fd75c [term 6 FOLLOWER]: Leader pre-election lost for term 5. Reason: Vote denied by peer b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817) with higher term. Message: Invalid argument: T 3d65025eea89441290d85dd053810e31 P b7ab4784c7344b939bc36f639286f377 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c for earlier term 5. Current term is 6.
I20260709 13:19:17.304718  6844 leader_election.cc:304] T 9e326172347f45e99a0d482b5d8ef768 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:19:17.305752  9213 raft_consensus.cc:493] T a1704639a875409b9959353527b3fd68 P b7ab4784c7344b939bc36f639286f377 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:19:17.307507  8862 raft_consensus.cc:3060] T d8cee0accdb8499c86d4414b72565a38 P b7ab4784c7344b939bc36f639286f377 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:17.309393  9129 leader_election.cc:290] T 8c7f33e544204fbaac4078e3e83bbf4e P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:17.283064  9193 consensus_queue.cc:260] T 713b5728a197487c9300b310ab94e5a3 P ccd8a4c3bfe3413cb2ae219b09aea832 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:17.294127  9137 raft_consensus.cc:493] T 7a734b5ab7834e05a8c422208acc58b1 P b7ab4784c7344b939bc36f639286f377 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:17.291672  9050 raft_consensus.cc:493] T 4d9def8b32fd443aa94ab1420b06837b P b7ab4784c7344b939bc36f639286f377 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:17.310842  9316 raft_consensus.cc:493] T 4b8cacb381b746da8d0049b0a83b41dd P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:17.312772  9167 consensus_meta.cc:287] T bb7fa124c3bf4ef9ab65a407cb008441 P b7ab4784c7344b939bc36f639286f377: Time spent flushing consensus metadata: real 1.187s	user 0.010s	sys 0.003s
I20260709 13:19:17.190011  9181 raft_consensus.cc:515] T 1528ab62b6fe4e3099d08f141afee116 P b7ab4784c7344b939bc36f639286f377 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } attrs { replace: true } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:19:17.288637  9263 leader_election.cc:290] T 44bde925b2e541b69890d70715b85176 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 7 election: Requested vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
W20260709 13:19:17.291244  9273 consensus_meta.cc:287] T 7c44c4849aa54f2b94d1f1bef9ed546f P cd75a17ab2604397adab03bb8b5fd75c: Time spent flushing consensus metadata: real 0.678s	user 0.003s	sys 0.009s
I20260709 13:19:17.315873  6804 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50550 (request call id 215) took 1306 ms. Trace:
W20260709 13:19:17.288591  9290 log.cc:927] Time spent T f58dc08b12a2494bb9a1372837970ca2 P ccd8a4c3bfe3413cb2ae219b09aea832: Append to log took a long time: real 0.203s	user 0.001s	sys 0.000s
I20260709 13:19:17.275177  9313 raft_consensus.cc:493] T 17587d6730594da4a56fa13a353232a1 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 7ba59cc884714e8aa5f3f0ecaed84cbb)
I20260709 13:19:17.318643  9188 raft_consensus.cc:2749] T 9e326172347f45e99a0d482b5d8ef768 P cd75a17ab2604397adab03bb8b5fd75c [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:19:17.339761  6844 leader_election.cc:304] T 95a75bfe094d4bdc963aba3f08dfcd25 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:19:17.299568  9303 raft_consensus.cc:2804] T 853ac0a8cbd64ce99457f170216d4d0f P b7ab4784c7344b939bc36f639286f377 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:19:17.319583  6803 raft_consensus.cc:1240] T 24ee15416e3145beaa1b8183453729a3 P b7ab4784c7344b939bc36f639286f377 [term 6 FOLLOWER]: Rejecting Update request from peer cd75a17ab2604397adab03bb8b5fd75c for earlier term 5. Current term is 6. Ops: []
I20260709 13:19:17.368209  6879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ba5dac66ab5497e9e336f2a3c28cda5" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:19:17.325578  9213 raft_consensus.cc:515] T a1704639a875409b9959353527b3fd68 P b7ab4784c7344b939bc36f639286f377 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
W20260709 13:19:17.343580  9060 consensus_meta.cc:287] T bb3d8792045a4583ae2e965b1350a5b4 P ccd8a4c3bfe3413cb2ae219b09aea832: Time spent flushing consensus metadata: real 0.710s	user 0.009s	sys 0.003s
I20260709 13:19:17.368916  6879 raft_consensus.cc:3060] T 7ba5dac66ab5497e9e336f2a3c28cda5 P cd75a17ab2604397adab03bb8b5fd75c [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:17.376168  9313 raft_consensus.cc:515] T 17587d6730594da4a56fa13a353232a1 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:19:17.377210  9065 consensus_queue.cc:237] T e77e330a82df4b43a745d57a68f6f057 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } }
I20260709 13:19:17.367879  9273 raft_consensus.cc:515] T 7c44c4849aa54f2b94d1f1bef9ed546f P cd75a17ab2604397adab03bb8b5fd75c [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:17.378369  9294 leader_election.cc:290] T 2c240553ce044eedb41541d72b9475d7 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:17.344622  9167 raft_consensus.cc:515] T bb7fa124c3bf4ef9ab65a407cb008441 P b7ab4784c7344b939bc36f639286f377 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:19:17.379202  9031 raft_consensus.cc:493] T d8292e16e5654be6bc408560cf256aaa P b7ab4784c7344b939bc36f639286f377 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:17.398097  9313 leader_election.cc:290] T 17587d6730594da4a56fa13a353232a1 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:19:17.398741  7495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ba5dac66ab5497e9e336f2a3c28cda5" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb"
I20260709 13:19:17.398573  9031 raft_consensus.cc:515] T d8292e16e5654be6bc408560cf256aaa P b7ab4784c7344b939bc36f639286f377 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:17.393051  9193 raft_consensus.cc:3060] T 713b5728a197487c9300b310ab94e5a3 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:17.336087  9079 raft_consensus.cc:493] T 427c124d773f483294511e80fe340075 P b7ab4784c7344b939bc36f639286f377 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 7ba59cc884714e8aa5f3f0ecaed84cbb)
I20260709 13:19:17.381717  6873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1528ab62b6fe4e3099d08f141afee116" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
W20260709 13:19:17.393613  7468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 91154us
I20260709 13:19:17.395495  9181 leader_election.cc:290] T 1528ab62b6fe4e3099d08f141afee116 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:19:17.396914  9125 raft_consensus.cc:2749] T ce4f062dcd314d43a63ca74067cb5ee3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:19:17.344885  9137 raft_consensus.cc:515] T 7a734b5ab7834e05a8c422208acc58b1 P b7ab4784c7344b939bc36f639286f377 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:17.354314  9050 raft_consensus.cc:515] T 4d9def8b32fd443aa94ab1420b06837b P b7ab4784c7344b939bc36f639286f377 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:17.399010  9222 raft_consensus.cc:3055] T fe20b4b48823486ca3b9c648db6ce8aa P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:19:17.401768  9273 leader_election.cc:290] T 7c44c4849aa54f2b94d1f1bef9ed546f P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 8 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:19:17.403745  9167 leader_election.cc:290] T bb7fa124c3bf4ef9ab65a407cb008441 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 8 election: Requested vote from peers cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:19:17.345155  6804 rpcz_store.cc:276] 0709 13:19:16.009260 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:16.330664 (+321404us) service_pool.cc:224] Handling call
0709 13:19:16.331120 (+   456us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:16.331403 (+   283us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:16.331440 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:16.335923 (+  4483us) log.cc:844] Serialized 26 byte log entry
0709 13:19:17.136841 (+800918us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:19:17.136984 (+   143us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:17.137134 (+   150us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:17.315570 (+178436us) raft_consensus.cc:1685] finished
0709 13:19:17.315599 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:17.315787 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":776317,"threads_started":1,"wal-append.queue_time_us":951201}
I20260709 13:19:17.403930  9283 leader_election.cc:290] T 22ccee1b570c4ad3a57bd7aec085b1b4 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:17.404294  6872 raft_consensus.cc:1240] T 7c44c4849aa54f2b94d1f1bef9ed546f P cd75a17ab2604397adab03bb8b5fd75c [term 8 FOLLOWER]: Rejecting Update request from peer b7ab4784c7344b939bc36f639286f377 for earlier term 7. Current term is 8. Ops: []
I20260709 13:19:17.405009  6805 raft_consensus.cc:2368] T bb7fa124c3bf4ef9ab65a407cb008441 P b7ab4784c7344b939bc36f639286f377 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c for earlier term 7. Current term is 8.
W20260709 13:19:17.405089  9308 log.cc:927] Time spent T 4b8cacb381b746da8d0049b0a83b41dd P ccd8a4c3bfe3413cb2ae219b09aea832: Append to log took a long time: real 0.176s	user 0.000s	sys 0.000s
I20260709 13:19:17.405449  9213 leader_election.cc:290] T a1704639a875409b9959353527b3fd68 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:17.406025  6801 raft_consensus.cc:2468] T d8cee0accdb8499c86d4414b72565a38 P b7ab4784c7344b939bc36f639286f377 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 6.
I20260709 13:19:17.400655  6874 raft_consensus.cc:1275] T 4f00a2e87e56452083b759f60d461ee3 P cd75a17ab2604397adab03bb8b5fd75c [term 7 FOLLOWER]: Refusing update from remote peer b7ab4784c7344b939bc36f639286f377: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:19:17.407801  8987 raft_consensus.cc:493] T 20f6842e26174571996b8dea4151d4be P ccd8a4c3bfe3413cb2ae219b09aea832 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:17.410284  6798 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:32966 (request call id 734) took 1284 ms. Trace:
I20260709 13:19:17.411497  7496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb7fa124c3bf4ef9ab65a407cb008441" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb"
I20260709 13:19:17.412259  7495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1528ab62b6fe4e3099d08f141afee116" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:19:17.393373  9060 raft_consensus.cc:515] T bb3d8792045a4583ae2e965b1350a5b4 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:19:16.699496  6880 rpcz_store.cc:276] 0709 13:19:14.594533 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:14.610635 (+ 16102us) service_pool.cc:224] Handling call
0709 13:19:15.681190 (+1070555us) spinlock_profiling.cc:243] Waited 1.2 ms on lock 0x7b5800147c98. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0c745db1 00007fcc0c885b71 00007fcc0c885a22 00007fcc1579ec09 00007fcc148f8ee0 00007fcc149c20ab 00007fcc149c2131 00007fcc14983fc0 00007fcc1496e929 00007fcc1496e3d2 00007fcc0dee5bd4
0709 13:19:15.681429 (+   239us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:15.681694 (+   265us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:19:16.272986 (+591292us) log.cc:844] Serialized 14 byte log entry
0709 13:19:16.685389 (+412403us) log.cc:844] Serialized 14 byte log entry
0709 13:19:16.686846 (+  1457us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:16.686918 (+    72us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:19:16.687010 (+    92us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:16.692196 (+  5186us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:16.692412 (+   216us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":755706,"prepare.run_cpu_time_us":48,"prepare.run_wall_time_us":100,"raft.queue_time_us":66839,"raft.run_cpu_time_us":158,"raft.run_wall_time_us":10160,"spinlock_wait_cycles":2755840,"thread_start_us":991931,"threads_started":2}
W20260709 13:19:17.414268  9311 log.cc:927] Time spent T 3fa34c08b205435dba97346991aa1f92 P ccd8a4c3bfe3413cb2ae219b09aea832: Append to log took a long time: real 0.188s	user 0.003s	sys 0.000s
I20260709 13:19:17.415020  6731 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50004 (request call id 1377) took 1672 ms. Trace:
I20260709 13:19:17.385299  8940 leader_election.cc:290] T 7ba5dac66ab5497e9e336f2a3c28cda5 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 8 election: Requested vote from peers cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:19:17.299839  9259 raft_consensus.cc:515] T be1a92657f494cac8dd227d152f50151 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:19:17.422441  6879 raft_consensus.cc:2468] T 7ba5dac66ab5497e9e336f2a3c28cda5 P cd75a17ab2604397adab03bb8b5fd75c [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 8.
I20260709 13:19:17.384320  9303 raft_consensus.cc:493] T 853ac0a8cbd64ce99457f170216d4d0f P b7ab4784c7344b939bc36f639286f377 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:19:17.484895  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 159987us
I20260709 13:19:17.449532  6873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb7fa124c3bf4ef9ab65a407cb008441" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:19:17.515441  6879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8292e16e5654be6bc408560cf256aaa" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:19:17.517951  6879 raft_consensus.cc:2410] T d8292e16e5654be6bc408560cf256aaa P cd75a17ab2604397adab03bb8b5fd75c [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7ab4784c7344b939bc36f639286f377 for term 8 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 13:19:17.510187  6798 rpcz_store.cc:276] 0709 13:19:16.126286 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:16.164440 (+ 38154us) service_pool.cc:224] Handling call
0709 13:19:17.410046 (+1245606us) spinlock_profiling.cc:243] Waited 543 ms on lock 0x7b54001f4d54. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f9ae2fa 00007fcc1496fb17 00007fcc0deea6d4 00007fcc0deea662 00007fcc0deea591 00007fcc0deea50c 00007fcc0dee97c2 00007fcc0dce548c 00007fcc0dce48c6 00007fcc0dce426f
0709 13:19:17.410209 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1248853760}
I20260709 13:19:17.477134  7501 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.ChangeConfig from 127.0.0.1:56392 (request call id 0) took 1402 ms. Trace:
I20260709 13:19:17.516479  6804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20f6842e26174571996b8dea4151d4be" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
W20260709 13:19:17.489070  7468 leader_election.cc:336] T bb7fa124c3bf4ef9ab65a407cb008441 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931): Timed out: RequestConsensusVote RPC to 127.5.126.67:42931 timed out after 1.948s (SENT)
I20260709 13:19:17.507783  6731 rpcz_store.cc:276] 0709 13:19:15.742157 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:15.807281 (+ 65124us) service_pool.cc:224] Handling call
0709 13:19:15.807675 (+   394us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:16.761153 (+953478us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:17.414693 (+653540us) spinlock_profiling.cc:243] Waited 948 ms on lock 0x7b5400407c54. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f9aae01 00007fcc0f9a983e 00007fcc1496e419 00007fcc0dee5bd4 00007fcc0dee5b62 00007fcc0dee5a91 00007fcc0dee5a0c 00007fcc0dee4cc2 00007fcc0dce548c 00007fcc0dce48c6
0709 13:19:17.414938 (+   245us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2180507008}
I20260709 13:19:17.448172  9031 leader_election.cc:290] T d8292e16e5654be6bc408560cf256aaa P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
W20260709 13:19:17.526574  7467 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:17.429968  9079 raft_consensus.cc:515] T 427c124d773f483294511e80fe340075 P b7ab4784c7344b939bc36f639286f377 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } attrs { replace: true } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:19:17.615942  9079 leader_election.cc:290] T 427c124d773f483294511e80fe340075 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:19:17.505940  9222 raft_consensus.cc:740] T fe20b4b48823486ca3b9c648db6ce8aa P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 7ba59cc884714e8aa5f3f0ecaed84cbb, State: Running, Role: LEADER
I20260709 13:19:17.621868  9050 leader_election.cc:290] T 4d9def8b32fd443aa94ab1420b06837b P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:17.516184  9303 raft_consensus.cc:3060] T 853ac0a8cbd64ce99457f170216d4d0f P b7ab4784c7344b939bc36f639286f377 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:19:17.630723  9315 log.cc:927] Time spent T 20f6842e26174571996b8dea4151d4be P b7ab4784c7344b939bc36f639286f377: Append to log took a long time: real 0.283s	user 0.003s	sys 0.000s
I20260709 13:19:17.631449  9261 raft_consensus.cc:493] T d8cee0accdb8499c86d4414b72565a38 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:19:17.632442  9100 leader_election.cc:290] T bd6869f07b5a4885a0b99fbe60c3b175 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 6 election: Requested vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:17.353281  9316 raft_consensus.cc:515] T 4b8cacb381b746da8d0049b0a83b41dd P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:19:17.632937  6803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30e88460611e47b2ba16a46a30b5f416" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:19:17.389863  9209 consensus_queue.cc:260] T 34f36d59d88f40fe8a2805e604fc6c0a P ccd8a4c3bfe3413cb2ae219b09aea832 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:17.590981  6798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbdf895bba214ff68685a24fd17dfb5d" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:19:17.510855  8987 raft_consensus.cc:3060] T 20f6842e26174571996b8dea4151d4be P ccd8a4c3bfe3413cb2ae219b09aea832 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:19:17.591537  6772 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.68:45071, user_credentials={real_user=slave}} blocked reactor thread for 63055.7us
I20260709 13:19:17.592201  7468 leader_election.cc:304] T bb7fa124c3bf4ef9ab65a407cb008441 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:19:17.424790  9188 raft_consensus.cc:2749] T 95a75bfe094d4bdc963aba3f08dfcd25 P cd75a17ab2604397adab03bb8b5fd75c [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:19:17.518572  6873 raft_consensus.cc:3060] T bb7fa124c3bf4ef9ab65a407cb008441 P cd75a17ab2604397adab03bb8b5fd75c [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:17.593564  6844 leader_election.cc:304] T f03d0dbf16864ca4bc1bb5e4c0334c0f P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:19:17.595194  6874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22ccee1b570c4ad3a57bd7aec085b1b4" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:19:17.595270  6880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1704639a875409b9959353527b3fd68" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:19:17.599522  6806 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:32966 (request call id 724) took 1657 ms. Trace:
I20260709 13:19:17.602244  6804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44bde925b2e541b69890d70715b85176" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:19:17.642691  6880 raft_consensus.cc:2468] T a1704639a875409b9959353527b3fd68 P cd75a17ab2604397adab03bb8b5fd75c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 5.
I20260709 13:19:17.515537  7496 raft_consensus.cc:3060] T bb7fa124c3bf4ef9ab65a407cb008441 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 6 FOLLOWER]: Advancing to term 8
I20260709 13:19:17.606082  6731 raft_consensus.cc:1240] T fe20b4b48823486ca3b9c648db6ce8aa P ccd8a4c3bfe3413cb2ae219b09aea832 [term 4 FOLLOWER]: Rejecting Update request from peer 7ba59cc884714e8aa5f3f0ecaed84cbb for earlier term 3. Current term is 4. Ops: []
I20260709 13:19:17.610445  9043 leader_election.cc:290] T 9b3759de40694069b13c0f8bd40e5709 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:19:17.613296  9060 leader_election.cc:290] T bb3d8792045a4583ae2e965b1350a5b4 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 6 election: Requested vote from peers cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:19:17.622745  9259 leader_election.cc:290] T be1a92657f494cac8dd227d152f50151 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:19:17.623709  9222 consensus_queue.cc:260] T fe20b4b48823486ca3b9c648db6ce8aa P 7ba59cc884714e8aa5f3f0ecaed84cbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:19:17.656323  6880 raft_consensus.cc:1240] T 30e88460611e47b2ba16a46a30b5f416 P cd75a17ab2604397adab03bb8b5fd75c [term 5 FOLLOWER]: Rejecting Update request from peer b7ab4784c7344b939bc36f639286f377 for earlier term 4. Current term is 5. Ops: []
I20260709 13:19:17.526885  7497 raft_consensus.cc:1275] T 4f00a2e87e56452083b759f60d461ee3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 7 FOLLOWER]: Refusing update from remote peer b7ab4784c7344b939bc36f639286f377: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:19:17.625680  9137 leader_election.cc:290] T 7a734b5ab7834e05a8c422208acc58b1 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
W20260709 13:19:17.590385  6771 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:17.658100  6804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de3186201e1a40d0b335eeb8b4e256e0" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:19:17.658809  6804 raft_consensus.cc:2468] T de3186201e1a40d0b335eeb8b4e256e0 P b7ab4784c7344b939bc36f639286f377 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 6.
W20260709 13:19:17.637410  7468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 148385us
I20260709 13:19:17.592659  7501 rpcz_store.cc:276] 0709 13:19:16.026827 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:16.048573 (+ 21746us) service_pool.cc:224] Handling call
0709 13:19:17.427145 (+1378572us) spinlock_profiling.cc:243] Waited 13.3 ms on lock 0x7b5800123f98. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0c745db1 00007fcc0c885b71 00007fcc0c885a22 00007fcc1579ec09 00007fcc148f8ee0 00007fcc149c20ab 00007fcc149c2131 00007fcc149841c0 00007fcc149709d9 00007fcc14970442 00007fcc0deecc54
0709 13:19:17.427507 (+   362us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":30570240}
I20260709 13:19:17.641256  6803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1528ab62b6fe4e3099d08f141afee116" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:19:17.642869  6800 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:32976 (request call id 2180) took 2620 ms. Trace:
I20260709 13:19:17.660175  6803 raft_consensus.cc:2468] T 1528ab62b6fe4e3099d08f141afee116 P b7ab4784c7344b939bc36f639286f377 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 5.
I20260709 13:19:17.604473  6725 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49744 (request call id 181) took 1249 ms. Trace:
I20260709 13:19:17.642629  6806 rpcz_store.cc:276] 0709 13:19:15.941727 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:16.105114 (+163387us) service_pool.cc:224] Handling call
0709 13:19:17.599283 (+1494169us) spinlock_profiling.cc:243] Waited 93.1 ms on lock 0x7b54001b44d4. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f9ae2fa 00007fcc1496fb17 00007fcc0deea6d4 00007fcc0deea662 00007fcc0deea591 00007fcc0deea50c 00007fcc0dee97c2 00007fcc0dce548c 00007fcc0dce48c6 00007fcc0dce426f
0709 13:19:17.599456 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":214228224}
W20260709 13:19:17.661319  7468 leader_election.cc:336] T 7ba5dac66ab5497e9e336f2a3c28cda5 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931): Timed out: RequestConsensusVote RPC to 127.5.126.67:42931 timed out after 2.302s (SENT)
I20260709 13:19:17.644501  6877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "427c124d773f483294511e80fe340075" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:19:17.645395  6798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6869f07b5a4885a0b99fbe60c3b175" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 6 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:19:17.646412  6731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b8cacb381b746da8d0049b0a83b41dd" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
W20260709 13:19:17.649637  6695 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:17.645076  9209 raft_consensus.cc:3060] T 34f36d59d88f40fe8a2805e604fc6c0a P ccd8a4c3bfe3413cb2ae219b09aea832 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:19:17.651304  9273 raft_consensus.cc:2749] T f03d0dbf16864ca4bc1bb5e4c0334c0f P cd75a17ab2604397adab03bb8b5fd75c [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:19:17.651530  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 132964us
I20260709 13:19:17.891839  6844 leader_election.cc:304] T a1704639a875409b9959353527b3fd68 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:19:17.651329  6874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d9def8b32fd443aa94ab1420b06837b" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:19:17.654121  6724 raft_consensus.cc:1240] T e77e330a82df4b43a745d57a68f6f057 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 8 LEADER]: Rejecting Update request from peer cd75a17ab2604397adab03bb8b5fd75c for earlier term 7. Current term is 8. Ops: [7.4-7.4]
I20260709 13:19:17.623297  7498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe20b4b48823486ca3b9c648db6ce8aa" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:19:17.893093  6874 raft_consensus.cc:2468] T 4d9def8b32fd443aa94ab1420b06837b P cd75a17ab2604397adab03bb8b5fd75c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 6.
I20260709 13:19:17.836828  7499 raft_consensus.cc:1275] T 4b8cacb381b746da8d0049b0a83b41dd P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 7 FOLLOWER]: Refusing update from remote peer ccd8a4c3bfe3413cb2ae219b09aea832: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:19:17.835816  7502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3d8792045a4583ae2e965b1350a5b4" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb"
I20260709 13:19:17.825682  8827 leader_election.cc:290] T 711ef6523deb4cbe8ef2ba61e1c21c98 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 7 election: Requested vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
W20260709 13:19:17.811918  9272 log.cc:927] Time spent T b3f13b31a1f84f0d89d007eadd57924c P b7ab4784c7344b939bc36f639286f377: Append to log took a long time: real 1.661s	user 0.009s	sys 0.003s
W20260709 13:19:17.723681  7468 leader_election.cc:336] T 3fa34c08b205435dba97346991aa1f92 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931): Timed out: RequestConsensusVote RPC to 127.5.126.67:42931 timed out after 2.045s (SENT)
I20260709 13:19:17.818379  6807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c240553ce044eedb41541d72b9475d7" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:19:17.904811  6807 raft_consensus.cc:2468] T 2c240553ce044eedb41541d72b9475d7 P b7ab4784c7344b939bc36f639286f377 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 7.
W20260709 13:19:17.905092  7468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 181452us
W20260709 13:19:17.905900  7468 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:17.742632  9050 raft_consensus.cc:493] T 9e326172347f45e99a0d482b5d8ef768 P b7ab4784c7344b939bc36f639286f377 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:19:17.732828  6695 leader_election.cc:304] T 30e88460611e47b2ba16a46a30b5f416 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
W20260709 13:19:17.908963  6695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 176267us
W20260709 13:19:17.823073  9302 log.cc:927] Time spent T e31b9971c15848dea59d4d4130141d9e P ccd8a4c3bfe3413cb2ae219b09aea832: Append to log took a long time: real 0.446s	user 0.000s	sys 0.001s
W20260709 13:19:17.821717  9305 log.cc:927] Time spent T 90d42e216d9741e190bca19a781291fd P ccd8a4c3bfe3413cb2ae219b09aea832: Append to log took a long time: real 0.593s	user 0.001s	sys 0.001s
I20260709 13:19:17.816720  9240 consensus_queue.cc:1059] T 24ee15416e3145beaa1b8183453729a3 P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:19:17.810685  6875 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58592 (request call id 138) took 1584 ms. Trace:
I20260709 13:19:17.926956  6875 rpcz_store.cc:276] 0709 13:19:16.226360 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:16.226554 (+   194us) service_pool.cc:224] Handling call
0709 13:19:17.810409 (+1583855us) spinlock_profiling.cc:243] Waited 1.36 s on lock 0x7b540021a2d4. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f9ae2fa 00007fcc1496fb17 00007fcc0deea6d4 00007fcc0deea662 00007fcc0deea591 00007fcc0deea50c 00007fcc0dee97c2 00007fcc0dce548c 00007fcc0dce48c6 00007fcc0dce426f
0709 13:19:17.810575 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3136126336}
I20260709 13:19:17.802304  6729 raft_consensus.cc:1240] T 44bde925b2e541b69890d70715b85176 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 7 FOLLOWER]: Rejecting Update request from peer b7ab4784c7344b939bc36f639286f377 for earlier term 6. Current term is 7. Ops: []
I20260709 13:19:17.660094  6800 rpcz_store.cc:276] 0709 13:19:15.022851 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:15.022983 (+   132us) service_pool.cc:224] Handling call
0709 13:19:15.034702 (+ 11719us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:16.449298 (+1414596us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:17.642605 (+1193307us) spinlock_profiling.cc:243] Waited 1.31 s on lock 0x7b54001a31d4. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f9aae01 00007fcc0f9a983e 00007fcc1496e419 00007fcc0dee5bd4 00007fcc0dee5b62 00007fcc0dee5a91 00007fcc0dee5a0c 00007fcc0dee4cc2 00007fcc0dce548c 00007fcc0dce48c6
0709 13:19:17.642798 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3011210624}
I20260709 13:19:17.644121  9261 raft_consensus.cc:515] T d8cee0accdb8499c86d4414b72565a38 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:19:17.737156  6806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8292e16e5654be6bc408560cf256aaa" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:19:17.929908  6806 raft_consensus.cc:2468] T d8292e16e5654be6bc408560cf256aaa P b7ab4784c7344b939bc36f639286f377 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 7.
I20260709 13:19:17.727813  6804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c7f33e544204fbaac4078e3e83bbf4e" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:19:17.840095  6877 raft_consensus.cc:1275] T 3d65025eea89441290d85dd053810e31 P cd75a17ab2604397adab03bb8b5fd75c [term 6 FOLLOWER]: Refusing update from remote peer b7ab4784c7344b939bc36f639286f377: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 6 index: 3. (index mismatch)
I20260709 13:19:17.724704  9316 leader_election.cc:290] T 4b8cacb381b746da8d0049b0a83b41dd P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:17.806012  9121 raft_consensus.cc:3060] T b56bf91d90824c959e21e0cee5ba1816 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:17.910027  6695 leader_election.cc:304] T dbdf895bba214ff68685a24fd17dfb5d P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:19:17.940598  6877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de3186201e1a40d0b335eeb8b4e256e0" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:19:17.941489  6877 raft_consensus.cc:2468] T de3186201e1a40d0b335eeb8b4e256e0 P cd75a17ab2604397adab03bb8b5fd75c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 5.
I20260709 13:19:17.801690  6732 consensus_queue.cc:260] T b3f13b31a1f84f0d89d007eadd57924c P ccd8a4c3bfe3413cb2ae219b09aea832 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:19:17.740641  6873 raft_consensus.cc:2468] T bb7fa124c3bf4ef9ab65a407cb008441 P cd75a17ab2604397adab03bb8b5fd75c [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 8.
I20260709 13:19:17.943931  6873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fa34c08b205435dba97346991aa1f92" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:19:17.944574  6873 raft_consensus.cc:2468] T 3fa34c08b205435dba97346991aa1f92 P cd75a17ab2604397adab03bb8b5fd75c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 7.
I20260709 13:19:17.944860  8827 raft_consensus.cc:2749] T dbdf895bba214ff68685a24fd17dfb5d P ccd8a4c3bfe3413cb2ae219b09aea832 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:19:17.946138  6874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe20b4b48823486ca3b9c648db6ce8aa" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:19:17.946377  6729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4db81d9d329422bb3b4160ca4ac2d1d" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:19:17.947083  6874 raft_consensus.cc:2393] T fe20b4b48823486ca3b9c648db6ce8aa P cd75a17ab2604397adab03bb8b5fd75c [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ccd8a4c3bfe3413cb2ae219b09aea832 in current term 4: Already voted for candidate cd75a17ab2604397adab03bb8b5fd75c in this term.
I20260709 13:19:17.940665  9234 raft_consensus.cc:493] T 4f00a2e87e56452083b759f60d461ee3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:17.948354  9234 raft_consensus.cc:515] T 4f00a2e87e56452083b759f60d461ee3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:19:17.903623  9188 raft_consensus.cc:2749] T a1704639a875409b9959353527b3fd68 P cd75a17ab2604397adab03bb8b5fd75c [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:19:17.660884  7495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "427c124d773f483294511e80fe340075" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:19:17.723192  6879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a734b5ab7834e05a8c422208acc58b1" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:19:17.974045  7466 leader_election.cc:304] T 404190ce4ce94cecbfcb6ea9d1dd8626 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:19:17.974395  6879 raft_consensus.cc:2468] T 7a734b5ab7834e05a8c422208acc58b1 P cd75a17ab2604397adab03bb8b5fd75c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 6.
I20260709 13:19:17.928097  9060 raft_consensus.cc:2749] T 30e88460611e47b2ba16a46a30b5f416 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:19:17.726723  9303 raft_consensus.cc:515] T 853ac0a8cbd64ce99457f170216d4d0f P b7ab4784c7344b939bc36f639286f377 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:17.735138  6798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17587d6730594da4a56fa13a353232a1" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
W20260709 13:19:17.785975  6801 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:32966 (request call id 704) took 1987 ms (client timeout 1859 ms). Trace:
I20260709 13:19:17.779762  6726 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:38536 (request call id 12) took 1488 ms. Trace:
W20260709 13:19:17.781239  9300 log.cc:927] Time spent T 7c44c4849aa54f2b94d1f1bef9ed546f P ccd8a4c3bfe3413cb2ae219b09aea832: Append to log took a long time: real 0.561s	user 0.000s	sys 0.002s
I20260709 13:19:17.836756  7500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17587d6730594da4a56fa13a353232a1" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:19:17.810670  6772 leader_election.cc:304] T c4db81d9d329422bb3b4160ca4ac2d1d P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:19:17.661033  6725 rpcz_store.cc:276] 0709 13:19:16.354851 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:16.355065 (+   214us) service_pool.cc:224] Handling call
0709 13:19:16.355525 (+   460us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:16.776470 (+420945us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:16.776517 (+    47us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:16.826754 (+ 50237us) log.cc:844] Serialized 26 byte log entry
0709 13:19:17.120396 (+293642us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:19:17.120462 (+    66us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:17.120574 (+   112us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:17.403786 (+283212us) spinlock_profiling.cc:243] Waited 7.23 ms on lock 0x7b4400022b4c. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0c745db1 00007fcc0c7e3c85 00007fcc0c7e46a2 00007fcc0f5561db 00007fcc0f551aaf 00007fcc0f54586e 00007fcc0f544bb6 00007fcc0f5447d8 00007fcc0f54e221 00007fcc0f54e1d9 00007fcc0f54e169
0709 13:19:17.604090 (+200304us) raft_consensus.cc:1685] finished
0709 13:19:17.604121 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:17.604398 (+   277us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1031,"raft.queue_time_us":78557,"raft.run_cpu_time_us":188,"raft.run_wall_time_us":27064,"spinlock_wait_cycles":16624512,"thread_start_us":660937,"threads_started":2,"wal-append.queue_time_us":346350}
I20260709 13:19:17.870410  6731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "404190ce4ce94cecbfcb6ea9d1dd8626" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
W20260709 13:19:17.872776  6696 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:17.876595  6727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a92dd554674067a83a9cb68c4773f2" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:19:17.840929  6803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5be3a11b23d4ea9b08300a2789821c7" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:19:17.878235  6805 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:32966 (request call id 720) took 1937 ms. Trace:
I20260709 13:19:17.861521  7503 consensus_queue.cc:237] T 1528ab62b6fe4e3099d08f141afee116 P 7ba59cc884714e8aa5f3f0ecaed84cbb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.5, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
W20260709 13:19:17.899966  6697 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:17.984138  6697 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:17.899516  6844 leader_election.cc:304] T dbdf895bba214ff68685a24fd17dfb5d P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:19:17.983991  6805 rpcz_store.cc:276] 0709 13:19:15.940565 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:15.946783 (+  6218us) service_pool.cc:224] Handling call
0709 13:19:17.877867 (+1931084us) spinlock_profiling.cc:243] Waited 1.45 s on lock 0x7b5400331b54. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f9ae2fa 00007fcc1496fb17 00007fcc0deea6d4 00007fcc0deea662 00007fcc0deea591 00007fcc0deea50c 00007fcc0dee97c2 00007fcc0dce548c 00007fcc0dce48c6 00007fcc0dce426f
0709 13:19:17.878116 (+   249us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3342758656}
I20260709 13:19:17.903946  7502 raft_consensus.cc:3060] T bb3d8792045a4583ae2e965b1350a5b4 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 4 FOLLOWER]: Advancing to term 6
I20260709 13:19:17.905751  6807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44bde925b2e541b69890d70715b85176" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:19:17.985450  6805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6869f07b5a4885a0b99fbe60c3b175" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 6 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
W20260709 13:19:17.986037  6697 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:17.986642  6727 raft_consensus.cc:2468] T 07a92dd554674067a83a9cb68c4773f2 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 6.
I20260709 13:19:17.986850  6725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "853ac0a8cbd64ce99457f170216d4d0f" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
W20260709 13:19:17.907336  7468 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:17.987558  6727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab432e62819d499eaaf3dd55481dd930" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 8 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
W20260709 13:19:17.988020  7468 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:17.988266  6772 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 177709us
I20260709 13:19:17.923404  7501 raft_consensus.cc:1240] T 4b8cacb381b746da8d0049b0a83b41dd P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 7 FOLLOWER]: Rejecting Update request from peer cd75a17ab2604397adab03bb8b5fd75c for earlier term 6. Current term is 7. Ops: []
I20260709 13:19:17.802560  9279 raft_consensus.cc:493] T f3f9c2e2bf644115957398fe4c9459db P ccd8a4c3bfe3413cb2ae219b09aea832 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:17.947911  6729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4275cf08e63345f993bce8664eada830" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:19:17.993765  6874 raft_consensus.cc:3055] T 22ccee1b570c4ad3a57bd7aec085b1b4 P cd75a17ab2604397adab03bb8b5fd75c [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:19:17.994123  6874 raft_consensus.cc:740] T 22ccee1b570c4ad3a57bd7aec085b1b4 P cd75a17ab2604397adab03bb8b5fd75c [term 4 LEADER]: Becoming Follower/Learner. State: Replica: cd75a17ab2604397adab03bb8b5fd75c, State: Running, Role: LEADER
I20260709 13:19:17.962792  6877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8292e16e5654be6bc408560cf256aaa" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:19:17.995262  6877 raft_consensus.cc:3060] T d8292e16e5654be6bc408560cf256aaa P cd75a17ab2604397adab03bb8b5fd75c [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:17.947904  9210 raft_consensus.cc:3055] T 30e88460611e47b2ba16a46a30b5f416 P b7ab4784c7344b939bc36f639286f377 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:19:17.990329  6726 rpcz_store.cc:276] 0709 13:19:16.291425 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:16.291583 (+   158us) service_pool.cc:224] Handling call
0709 13:19:17.779394 (+1487811us) spinlock_profiling.cc:243] Waited 96.2 ms on lock 0x7b5400058054. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f9a4853 00007fcc1497260a 00007fcc0def87d4 00007fcc0def8762 00007fcc0def8691 00007fcc0def860c 00007fcc0def78c2 00007fcc0dce548c 00007fcc0dce48c6 00007fcc0dce426f
0709 13:19:17.779617 (+   223us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":221313920}
I20260709 13:19:17.971621  6804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d33d5ee8ef6f415593d8df52063161ad" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:19:17.997376  6804 raft_consensus.cc:2410] T d33d5ee8ef6f415593d8df52063161ad P b7ab4784c7344b939bc36f639286f377 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ccd8a4c3bfe3413cb2ae219b09aea832 for term 8 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:19:17.971056  6800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "853ac0a8cbd64ce99457f170216d4d0f" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:19:17.974220  6806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a734b5ab7834e05a8c422208acc58b1" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:19:17.997929  6806 raft_consensus.cc:2468] T 7a734b5ab7834e05a8c422208acc58b1 P b7ab4784c7344b939bc36f639286f377 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 6.
W20260709 13:19:17.760453  6616 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 24ee15416e3145beaa1b8183453729a3 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER failed with leader 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071) due to error UNKNOWN_ERROR; will retry: Illegal state: Leader has not yet committed an operation in its own term
I20260709 13:19:17.702607  9321 consensus_queue.cc:1059] T fe20b4b48823486ca3b9c648db6ce8aa P 7ba59cc884714e8aa5f3f0ecaed84cbb [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:19:17.899436  9251 raft_consensus.cc:493] T 7c37d41cd9164c15a6826ca62a851a69 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:19:17.837950  7494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be1a92657f494cac8dd227d152f50151" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:19:17.927747  9050 raft_consensus.cc:515] T 9e326172347f45e99a0d482b5d8ef768 P b7ab4784c7344b939bc36f639286f377 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
W20260709 13:19:17.990948  6801 rpcz_store.cc:269] 0709 13:19:15.798521 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:15.800502 (+  1981us) service_pool.cc:224] Handling call
0709 13:19:17.785597 (+1985095us) spinlock_profiling.cc:243] Waited 1.57 s on lock 0x7b54001cb6d4. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f9ae2fa 00007fcc1496fb17 00007fcc0deea6d4 00007fcc0deea662 00007fcc0deea591 00007fcc0deea50c 00007fcc0dee97c2 00007fcc0dce548c 00007fcc0dce48c6 00007fcc0dce426f
0709 13:19:17.785831 (+   234us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3617274752}
I20260709 13:19:17.987514  6725 raft_consensus.cc:2468] T 853ac0a8cbd64ce99457f170216d4d0f P ccd8a4c3bfe3413cb2ae219b09aea832 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 3.
I20260709 13:19:17.992954  6807 raft_consensus.cc:1240] T 4d9def8b32fd443aa94ab1420b06837b P b7ab4784c7344b939bc36f639286f377 [term 6 FOLLOWER]: Rejecting Update request from peer ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 5. Current term is 6. Ops: []
I20260709 13:19:17.970443  6875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "853ac0a8cbd64ce99457f170216d4d0f" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:19:17.955888  9240 consensus_queue.cc:1243] T 24ee15416e3145beaa1b8183453729a3 P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Peer 7ba59cc884714e8aa5f3f0ecaed84cbb log is divergent from this leader: its last log entry 6.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 13:19:18.010633  6875 raft_consensus.cc:2468] T 853ac0a8cbd64ce99457f170216d4d0f P cd75a17ab2604397adab03bb8b5fd75c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 2.
I20260709 13:19:18.011533  6800 raft_consensus.cc:2393] T 853ac0a8cbd64ce99457f170216d4d0f P b7ab4784c7344b939bc36f639286f377 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ccd8a4c3bfe3413cb2ae219b09aea832 in current term 4: Already voted for candidate b7ab4784c7344b939bc36f639286f377 in this term.
I20260709 13:19:17.998414  6772 leader_election.cc:304] T 1528ab62b6fe4e3099d08f141afee116 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:19:17.979359  8832 raft_consensus.cc:493] T 34f36d59d88f40fe8a2805e604fc6c0a P b7ab4784c7344b939bc36f639286f377 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:17.979020  9099 raft_consensus.cc:493] T 17587d6730594da4a56fa13a353232a1 P b7ab4784c7344b939bc36f639286f377 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 7ba59cc884714e8aa5f3f0ecaed84cbb)
I20260709 13:19:18.014914  6803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8292e16e5654be6bc408560cf256aaa" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:19:18.015189  6876 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58592 (request call id 163) took 1655 ms. Trace:
I20260709 13:19:17.980023  9316 raft_consensus.cc:2749] T 404190ce4ce94cecbfcb6ea9d1dd8626 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:19:18.017513  6806 raft_consensus.cc:1275] T 404190ce4ce94cecbfcb6ea9d1dd8626 P b7ab4784c7344b939bc36f639286f377 [term 7 FOLLOWER]: Refusing update from remote peer ccd8a4c3bfe3413cb2ae219b09aea832: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 7. (term mismatch)
I20260709 13:19:18.018517  6804 raft_consensus.cc:1240] T 1bf4668eeb70467fb3dc5a0289233b3c P b7ab4784c7344b939bc36f639286f377 [term 6 FOLLOWER]: Rejecting Update request from peer ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 13:19:18.021907  6806 pending_rounds.cc:85] T 404190ce4ce94cecbfcb6ea9d1dd8626 P b7ab4784c7344b939bc36f639286f377: Aborting all ops after (but not including) 6
I20260709 13:19:18.019143  8347 raft_consensus.cc:2749] T 1528ab62b6fe4e3099d08f141afee116 P b7ab4784c7344b939bc36f639286f377 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:19:18.022389  6806 pending_rounds.cc:107] T 404190ce4ce94cecbfcb6ea9d1dd8626 P b7ab4784c7344b939bc36f639286f377: Aborting uncommitted NO_OP operation due to leader change: 6.7
I20260709 13:19:18.023131  6806 raft_consensus.cc:2889] T 404190ce4ce94cecbfcb6ea9d1dd8626 P b7ab4784c7344b939bc36f639286f377 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:19:18.024950  6879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44bde925b2e541b69890d70715b85176" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:19:18.025501  6879 raft_consensus.cc:3060] T 44bde925b2e541b69890d70715b85176 P cd75a17ab2604397adab03bb8b5fd75c [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:18.026647  6799 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50550 (request call id 206) took 2778 ms. Trace:
I20260709 13:19:18.026986  6799 rpcz_store.cc:276] 0709 13:19:15.248552 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:15.258777 (+ 10225us) service_pool.cc:224] Handling call
0709 13:19:15.267416 (+  8639us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:15.277026 (+  9610us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:15.277059 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:15.282933 (+  5874us) log.cc:844] Serialized 26 byte log entry
0709 13:19:15.906704 (+623771us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:19:15.906746 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:15.906825 (+    79us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:17.811304 (+1904479us) spinlock_profiling.cc:243] Waited 5.63 ms on lock 0x7b4400022b4c. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0c745db1 00007fcc0c7e3c85 00007fcc0c7e46a2 00007fcc0f5561db 00007fcc0f551aaf 00007fcc0f54586e 00007fcc0f544bb6 00007fcc0f5447d8 00007fcc0f54e221 00007fcc0f54e1d9 00007fcc0f54e169
0709 13:19:18.015360 (+204056us) raft_consensus.cc:1685] finished
0709 13:19:18.015382 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:18.026581 (+ 11199us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":10803,"raft.run_cpu_time_us":154,"raft.run_wall_time_us":3678,"spinlock_wait_cycles":12938496,"thread_start_us":594320,"threads_started":1,"wal-append.queue_time_us":818892}
I20260709 13:19:18.021649  6803 raft_consensus.cc:3060] T d8292e16e5654be6bc408560cf256aaa P b7ab4784c7344b939bc36f639286f377 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:18.003520  9212 raft_consensus.cc:2804] T c4db81d9d329422bb3b4160ca4ac2d1d P b7ab4784c7344b939bc36f639286f377 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:19:17.974656  9236 consensus_queue.cc:1059] T 44bde925b2e541b69890d70715b85176 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.038s
I20260709 13:19:18.032907  6772 leader_election.cc:304] T 7ba5dac66ab5497e9e336f2a3c28cda5 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb
I20260709 13:19:18.001099  9210 raft_consensus.cc:740] T 30e88460611e47b2ba16a46a30b5f416 P b7ab4784c7344b939bc36f639286f377 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
W20260709 13:19:18.037235  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 137810us
I20260709 13:19:18.006953  9043 raft_consensus.cc:2749] T dbdf895bba214ff68685a24fd17dfb5d P cd75a17ab2604397adab03bb8b5fd75c [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:19:18.041350  6875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a734b5ab7834e05a8c422208acc58b1" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:19:18.046200  6844 leader_election.cc:304] T 711ef6523deb4cbe8ef2ba61e1c21c98 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:19:18.065193  6730 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50004 (request call id 1384) took 2315 ms. Trace:
I20260709 13:19:18.036343  9212 raft_consensus.cc:493] T c4db81d9d329422bb3b4160ca4ac2d1d P b7ab4784c7344b939bc36f639286f377 [term 6 FOLLOWER]: Starting leader election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:19:18.066381  9212 raft_consensus.cc:3060] T c4db81d9d329422bb3b4160ca4ac2d1d P b7ab4784c7344b939bc36f639286f377 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:18.065701  6730 rpcz_store.cc:276] 0709 13:19:15.749664 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:15.887117 (+137453us) service_pool.cc:224] Handling call
0709 13:19:15.931709 (+ 44592us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:16.663800 (+732091us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:16.663835 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:16.746285 (+ 82450us) log.cc:844] Serialized 26 byte log entry
0709 13:19:17.127158 (+380873us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:19:17.182428 (+ 55270us) log.cc:844] Serialized 14 byte log entry
0709 13:19:17.183534 (+  1106us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:17.183627 (+    93us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:17.406738 (+223111us) spinlock_profiling.cc:243] Waited 2.32 ms on lock 0x7b1800432ca0. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc15785de1 00007fcc157925b1 00007fcc0c8bd3f3 00007fcc0c8bf7c1 00007fcc0c8bf779 00007fcc0c8bf709 00007fcc0c8bf6d1 00007fcc0c8be9cd 000000000038f354 000000000038f199 00007fcc0c8a083a
0709 13:19:17.822467 (+415729us) spinlock_profiling.cc:243] Waited 9.13 ms on lock 0x7b4400022b4c. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0c745db1 00007fcc0c7e3c85 00007fcc0c7e46a2 00007fcc0f5561db 00007fcc0f551aaf 00007fcc0f54586e 00007fcc0f544bb6 00007fcc0f5447d8 00007fcc0f54e221 00007fcc0f54e1d9 00007fcc0f54e169
0709 13:19:18.064966 (+242499us) raft_consensus.cc:1685] finished
0709 13:19:18.064986 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:18.065124 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":18336,"prepare.queue_time_us":55466,"prepare.run_cpu_time_us":42,"prepare.run_wall_time_us":43,"raft.queue_time_us":55535,"raft.run_cpu_time_us":243,"raft.run_wall_time_us":245,"spinlock_wait_cycles":26317952,"thread_start_us":1077488,"threads_started":2,"wal-append.queue_time_us":582352}
I20260709 13:19:18.065251  5625 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:19:18.008065  9071 consensus_queue.cc:1059] T 8c7f33e544204fbaac4078e3e83bbf4e P b7ab4784c7344b939bc36f639286f377 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.037s
W20260709 13:19:18.007371  6616 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.5.126.68:45071, user_credentials={real_user=slave}} blocked reactor thread for 246967us
I20260709 13:19:18.053177  6806 raft_consensus.cc:1275] T 22ccee1b570c4ad3a57bd7aec085b1b4 P b7ab4784c7344b939bc36f639286f377 [term 5 FOLLOWER]: Refusing update from remote peer ccd8a4c3bfe3413cb2ae219b09aea832: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:19:18.011139  9251 raft_consensus.cc:515] T 7c37d41cd9164c15a6826ca62a851a69 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:18.051026  6877 raft_consensus.cc:2468] T d8292e16e5654be6bc408560cf256aaa P cd75a17ab2604397adab03bb8b5fd75c [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 8.
I20260709 13:19:18.081681  6877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6869f07b5a4885a0b99fbe60c3b175" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 6 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:19:18.071676  6772 leader_election.cc:304] T a1704639a875409b9959353527b3fd68 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:19:18.043391  8870 consensus_queue.cc:1048] T 4f00a2e87e56452083b759f60d461ee3 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.032s
I20260709 13:19:18.075326  9188 raft_consensus.cc:2749] T 711ef6523deb4cbe8ef2ba61e1c21c98 P cd75a17ab2604397adab03bb8b5fd75c [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:19:18.006178  9279 raft_consensus.cc:515] T f3f9c2e2bf644115957398fe4c9459db P ccd8a4c3bfe3413cb2ae219b09aea832 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:18.054899  6875 raft_consensus.cc:2468] T 7a734b5ab7834e05a8c422208acc58b1 P cd75a17ab2604397adab03bb8b5fd75c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 6.
I20260709 13:19:18.034217  8832 raft_consensus.cc:515] T 34f36d59d88f40fe8a2805e604fc6c0a P b7ab4784c7344b939bc36f639286f377 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:18.096262  6806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be1a92657f494cac8dd227d152f50151" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:19:18.073216  9046 raft_consensus.cc:2804] T 7ba5dac66ab5497e9e336f2a3c28cda5 P b7ab4784c7344b939bc36f639286f377 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:19:18.086429  5625 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:19:18.037847  9099 raft_consensus.cc:515] T 17587d6730594da4a56fa13a353232a1 P b7ab4784c7344b939bc36f639286f377 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
W20260709 13:19:18.102789  7467 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:18.103241  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 57172.5us
I20260709 13:19:18.104005  6844 leader_election.cc:304] T 713b5728a197487c9300b310ab94e5a3 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:19:18.094393  6877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c7f33e544204fbaac4078e3e83bbf4e" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:19:18.099215  6772 leader_election.cc:304] T 4d9def8b32fd443aa94ab1420b06837b P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:19:18.096911  6806 raft_consensus.cc:2468] T be1a92657f494cac8dd227d152f50151 P b7ab4784c7344b939bc36f639286f377 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 7.
I20260709 13:19:18.106204  6877 raft_consensus.cc:2393] T 8c7f33e544204fbaac4078e3e83bbf4e P cd75a17ab2604397adab03bb8b5fd75c [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ccd8a4c3bfe3413cb2ae219b09aea832 in current term 4: Already voted for candidate cd75a17ab2604397adab03bb8b5fd75c in this term.
I20260709 13:19:18.101112  6695 leader_election.cc:304] T de3186201e1a40d0b335eeb8b4e256e0 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
I20260709 13:19:18.056360  9240 consensus_queue.cc:1059] T e77e330a82df4b43a745d57a68f6f057 P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.037s
I20260709 13:19:18.118968  6877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3d8792045a4583ae2e965b1350a5b4" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:19:18.124675  6807 raft_consensus.cc:1240] T 34f36d59d88f40fe8a2805e604fc6c0a P b7ab4784c7344b939bc36f639286f377 [term 4 FOLLOWER]: Rejecting Update request from peer ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 3. Current term is 4. Ops: [3.3-3.3]
I20260709 13:19:18.128216  7502 raft_consensus.cc:2468] T bb3d8792045a4583ae2e965b1350a5b4 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 6.
I20260709 13:19:18.131028  6877 raft_consensus.cc:1275] T 4275cf08e63345f993bce8664eada830 P cd75a17ab2604397adab03bb8b5fd75c [term 6 FOLLOWER]: Refusing update from remote peer ccd8a4c3bfe3413cb2ae219b09aea832: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:19:18.134331  6879 raft_consensus.cc:2468] T 44bde925b2e541b69890d70715b85176 P cd75a17ab2604397adab03bb8b5fd75c [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 7.
I20260709 13:19:18.123050  6695 leader_election.cc:304] T 1528ab62b6fe4e3099d08f141afee116 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb
I20260709 13:19:18.137903  6798 raft_consensus.cc:2468] T 17587d6730594da4a56fa13a353232a1 P b7ab4784c7344b939bc36f639286f377 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 8.
I20260709 13:19:18.140465  6844 leader_election.cc:304] T 3411566abe2d4c9bb4b2adfdd05e6f17 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:19:18.111531  9079 raft_consensus.cc:2804] T a1704639a875409b9959353527b3fd68 P b7ab4784c7344b939bc36f639286f377 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:19:18.152933  6695 leader_election.cc:304] T 2c240553ce044eedb41541d72b9475d7 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
I20260709 13:19:18.161430  6806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "711ef6523deb4cbe8ef2ba61e1c21c98" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:19:18.162323  6806 raft_consensus.cc:3060] T 711ef6523deb4cbe8ef2ba61e1c21c98 P b7ab4784c7344b939bc36f639286f377 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:18.161520  6877 raft_consensus.cc:1275] T f58dc08b12a2494bb9a1372837970ca2 P cd75a17ab2604397adab03bb8b5fd75c [term 8 FOLLOWER]: Refusing update from remote peer ccd8a4c3bfe3413cb2ae219b09aea832: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 8 index: 4. (index mismatch)
I20260709 13:19:18.119903  9188 raft_consensus.cc:3060] T 713b5728a197487c9300b310ab94e5a3 P cd75a17ab2604397adab03bb8b5fd75c [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:18.138368  9259 raft_consensus.cc:2804] T de3186201e1a40d0b335eeb8b4e256e0 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:19:18.177198  6844 leader_election.cc:400] T ab432e62819d499eaaf3dd55481dd930 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 6 pre-election: Vote denied by peer b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817) with higher term. Message: Invalid argument: T ab432e62819d499eaaf3dd55481dd930 P b7ab4784c7344b939bc36f639286f377 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c for earlier term 6. Current term is 7.
I20260709 13:19:18.193133  6844 leader_election.cc:403] T ab432e62819d499eaaf3dd55481dd930 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 6 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:19:18.195345  6695 leader_election.cc:304] T f5be3a11b23d4ea9b08300a2789821c7 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:19:18.118837  6875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c240553ce044eedb41541d72b9475d7" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:19:18.119972  9071 raft_consensus.cc:493] T 24ee15416e3145beaa1b8183453729a3 P b7ab4784c7344b939bc36f639286f377 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 7ba59cc884714e8aa5f3f0ecaed84cbb)
I20260709 13:19:18.111035  9210 consensus_queue.cc:260] T 30e88460611e47b2ba16a46a30b5f416 P b7ab4784c7344b939bc36f639286f377 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:18.147536  9043 raft_consensus.cc:3055] T e77e330a82df4b43a745d57a68f6f057 P cd75a17ab2604397adab03bb8b5fd75c [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:19:18.233768  8347 consensus_queue.cc:1059] T 30e88460611e47b2ba16a46a30b5f416 P b7ab4784c7344b939bc36f639286f377 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:19:18.204027  6723 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50004 (request call id 1386) took 2453 ms. Trace:
I20260709 13:19:18.192840  9259 raft_consensus.cc:493] T de3186201e1a40d0b335eeb8b4e256e0 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:18.162138  9065 raft_consensus.cc:2804] T 1528ab62b6fe4e3099d08f141afee116 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:19:18.162340  9194 raft_consensus.cc:2804] T 2c240553ce044eedb41541d72b9475d7 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 13:19:18.210795  7467 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:18.199956  7496 consensus_meta.cc:287] T bb7fa124c3bf4ef9ab65a407cb008441 P 7ba59cc884714e8aa5f3f0ecaed84cbb: Time spent flushing consensus metadata: real 0.545s	user 0.013s	sys 0.005s
I20260709 13:19:18.211534  6875 raft_consensus.cc:2468] T 2c240553ce044eedb41541d72b9475d7 P cd75a17ab2604397adab03bb8b5fd75c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 7.
I20260709 13:19:18.155042  9079 raft_consensus.cc:493] T a1704639a875409b9959353527b3fd68 P b7ab4784c7344b939bc36f639286f377 [term 5 FOLLOWER]: Starting leader election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:19:18.176925  9240 raft_consensus.cc:2749] T 3411566abe2d4c9bb4b2adfdd05e6f17 P cd75a17ab2604397adab03bb8b5fd75c [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:19:18.197049  6877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "711ef6523deb4cbe8ef2ba61e1c21c98" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:19:18.276216  6877 raft_consensus.cc:3060] T 711ef6523deb4cbe8ef2ba61e1c21c98 P cd75a17ab2604397adab03bb8b5fd75c [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:18.203279  9202 raft_consensus.cc:2804] T 4d9def8b32fd443aa94ab1420b06837b P b7ab4784c7344b939bc36f639286f377 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:19:18.235004  6723 rpcz_store.cc:276] 0709 13:19:15.750315 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:16.107418 (+357103us) service_pool.cc:224] Handling call
0709 13:19:16.122651 (+ 15233us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 13:19:16.142029 (+ 19378us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:19:16.624301 (+482272us) log.cc:844] Serialized 14 byte log entry
0709 13:19:17.132850 (+508549us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 13:19:17.139952 (+  7102us) log.cc:844] Serialized 78 byte log entry
0709 13:19:17.140240 (+   288us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:19:17.198871 (+ 58631us) log.cc:844] Serialized 14 byte log entry
0709 13:19:17.204520 (+  5649us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:17.204618 (+    98us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:17.780286 (+575668us) spinlock_profiling.cc:243] Waited 11.7 ms on lock 0x7b4400022b4c. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0c745db1 00007fcc0c7e3c85 00007fcc0c7e46a2 00007fcc0f5561db 00007fcc0f551aaf 00007fcc0f54586e 00007fcc0f544bb6 00007fcc0f5447d8 00007fcc0f54e221 00007fcc0f54e1d9 00007fcc0f54e169
0709 13:19:18.203755 (+423469us) raft_consensus.cc:1685] finished
0709 13:19:18.203783 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:18.203956 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":127514,"prepare.queue_time_us":540549,"prepare.run_cpu_time_us":88,"prepare.run_wall_time_us":92,"raft.queue_time_us":90998,"raft.run_cpu_time_us":489,"raft.run_wall_time_us":26904,"spinlock_wait_cycles":26825088,"thread_start_us":885729,"threads_started":2,"wal-append.queue_time_us":505199}
I20260709 13:19:18.237855  9218 raft_consensus.cc:2749] T f5be3a11b23d4ea9b08300a2789821c7 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:19:18.223680  9261 leader_election.cc:290] T d8cee0accdb8499c86d4414b72565a38 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:18.240017  6732 raft_consensus.cc:3060] T b3f13b31a1f84f0d89d007eadd57924c P ccd8a4c3bfe3413cb2ae219b09aea832 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:19:18.245263  9043 raft_consensus.cc:740] T e77e330a82df4b43a745d57a68f6f057 P cd75a17ab2604397adab03bb8b5fd75c [term 7 LEADER]: Becoming Follower/Learner. State: Replica: cd75a17ab2604397adab03bb8b5fd75c, State: Running, Role: LEADER
I20260709 13:19:18.257115  6697 leader_election.cc:304] T 3fa34c08b205435dba97346991aa1f92 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb
I20260709 13:19:18.266412  6803 raft_consensus.cc:2468] T d8292e16e5654be6bc408560cf256aaa P b7ab4784c7344b939bc36f639286f377 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 8.
I20260709 13:19:18.272655  7502 consensus_queue.cc:237] T 24ee15416e3145beaa1b8183453729a3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.6, Last appended by leader: 5, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
W20260709 13:19:18.286140  7468 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:18.224138  9303 leader_election.cc:290] T 853ac0a8cbd64ce99457f170216d4d0f P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 4 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:18.239737  6879 raft_consensus.cc:1275] T f09c2a98de1a4decabd0ff900dd44caa P cd75a17ab2604397adab03bb8b5fd75c [term 7 FOLLOWER]: Refusing update from remote peer ccd8a4c3bfe3413cb2ae219b09aea832: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:19:18.283927  6806 raft_consensus.cc:2468] T 711ef6523deb4cbe8ef2ba61e1c21c98 P b7ab4784c7344b939bc36f639286f377 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 7.
I20260709 13:19:18.254000  9259 raft_consensus.cc:3060] T de3186201e1a40d0b335eeb8b4e256e0 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:18.294797  6880 raft_consensus.cc:3055] T 3a485a995abc4807b6e511e45419f737 P cd75a17ab2604397adab03bb8b5fd75c [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:19:18.275038  9194 raft_consensus.cc:493] T 2c240553ce044eedb41541d72b9475d7 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:19:18.309734  6772 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 210570us
I20260709 13:19:18.316779  6772 leader_election.cc:304] T bb7fa124c3bf4ef9ab65a407cb008441 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
W20260709 13:19:18.317692  7468 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:18.312407  6880 raft_consensus.cc:740] T 3a485a995abc4807b6e511e45419f737 P cd75a17ab2604397adab03bb8b5fd75c [term 4 LEADER]: Becoming Follower/Learner. State: Replica: cd75a17ab2604397adab03bb8b5fd75c, State: Running, Role: LEADER
I20260709 13:19:18.252933  9065 raft_consensus.cc:493] T 1528ab62b6fe4e3099d08f141afee116 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 7ba59cc884714e8aa5f3f0ecaed84cbb)
W20260709 13:19:18.280200  9331 log.cc:927] Time spent T 7887766dc6784fcaa42b35c05fea7a99 P cd75a17ab2604397adab03bb8b5fd75c: Append to log took a long time: real 0.124s	user 0.001s	sys 0.002s
I20260709 13:19:18.280308  9202 raft_consensus.cc:493] T 4d9def8b32fd443aa94ab1420b06837b P b7ab4784c7344b939bc36f639286f377 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:19:18.306012  9209 consensus_meta.cc:287] T 34f36d59d88f40fe8a2805e604fc6c0a P ccd8a4c3bfe3413cb2ae219b09aea832: Time spent flushing consensus metadata: real 0.605s	user 0.011s	sys 0.000s
I20260709 13:19:18.277607  9079 raft_consensus.cc:3060] T a1704639a875409b9959353527b3fd68 P b7ab4784c7344b939bc36f639286f377 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:18.275554  7496 raft_consensus.cc:2468] T bb7fa124c3bf4ef9ab65a407cb008441 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 8.
I20260709 13:19:18.281519  9210 raft_consensus.cc:3060] T 30e88460611e47b2ba16a46a30b5f416 P b7ab4784c7344b939bc36f639286f377 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:19:18.334129  6877 raft_consensus.cc:2468] T 711ef6523deb4cbe8ef2ba61e1c21c98 P cd75a17ab2604397adab03bb8b5fd75c [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 7.
W20260709 13:19:18.346006  6695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 150730us
W20260709 13:19:18.346731  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 191758us
I20260709 13:19:18.347249  6695 leader_election.cc:304] T 7a734b5ab7834e05a8c422208acc58b1 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
I20260709 13:19:18.347438  6844 leader_election.cc:304] T 7a734b5ab7834e05a8c422208acc58b1 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:19:18.310734  9313 raft_consensus.cc:2804] T 3fa34c08b205435dba97346991aa1f92 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 13:19:18.373884  6772 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 57198.9us
I20260709 13:19:18.374819  6772 leader_election.cc:304] T 7a734b5ab7834e05a8c422208acc58b1 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:19:18.375576  6695 leader_election.cc:304] T d33d5ee8ef6f415593d8df52063161ad P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:19:18.337170  9322 raft_consensus.cc:2749] T bb7fa124c3bf4ef9ab65a407cb008441 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:19:18.324404  9065 raft_consensus.cc:3060] T 1528ab62b6fe4e3099d08f141afee116 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:19:18.372888  9332 log.cc:927] Time spent T 427c124d773f483294511e80fe340075 P cd75a17ab2604397adab03bb8b5fd75c: Append to log took a long time: real 0.107s	user 0.000s	sys 0.000s
I20260709 13:19:18.319738  9194 raft_consensus.cc:3060] T 2c240553ce044eedb41541d72b9475d7 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:19:18.392118  9268 log.cc:927] Time spent T 24ee15416e3145beaa1b8183453729a3 P 7ba59cc884714e8aa5f3f0ecaed84cbb: Append to log took a long time: real 0.069s	user 0.000s	sys 0.001s
I20260709 13:19:18.336383  6880 consensus_queue.cc:260] T 3a485a995abc4807b6e511e45419f737 P cd75a17ab2604397adab03bb8b5fd75c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:18.249194  9071 raft_consensus.cc:515] T 24ee15416e3145beaa1b8183453729a3 P b7ab4784c7344b939bc36f639286f377 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } attrs { replace: true } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:19:18.372611  9303 consensus_queue.cc:1048] T 3d65025eea89441290d85dd053810e31 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.015s
I20260709 13:19:18.352849  9251 leader_election.cc:290] T 7c37d41cd9164c15a6826ca62a851a69 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
W20260709 13:19:18.380839  6772 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:18.368924  8987 consensus_meta.cc:287] T 20f6842e26174571996b8dea4151d4be P ccd8a4c3bfe3413cb2ae219b09aea832: Time spent flushing consensus metadata: real 0.723s	user 0.009s	sys 0.002s
I20260709 13:19:18.337905  9202 raft_consensus.cc:3060] T 4d9def8b32fd443aa94ab1420b06837b P b7ab4784c7344b939bc36f639286f377 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:18.372488  9099 leader_election.cc:290] T 17587d6730594da4a56fa13a353232a1 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:19:18.397054  6880 raft_consensus.cc:3060] T 3a485a995abc4807b6e511e45419f737 P cd75a17ab2604397adab03bb8b5fd75c [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:19:18.386587  9209 raft_consensus.cc:2804] T 7a734b5ab7834e05a8c422208acc58b1 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:19:18.390301  9100 raft_consensus.cc:2749] T d33d5ee8ef6f415593d8df52063161ad P ccd8a4c3bfe3413cb2ae219b09aea832 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:19:18.400028  6772 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:18.402460  7468 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:18.381565  9313 raft_consensus.cc:493] T 3fa34c08b205435dba97346991aa1f92 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 7ba59cc884714e8aa5f3f0ecaed84cbb)
I20260709 13:19:18.414239  9313 raft_consensus.cc:3060] T 3fa34c08b205435dba97346991aa1f92 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:18.392264  9043 consensus_queue.cc:260] T e77e330a82df4b43a745d57a68f6f057 P cd75a17ab2604397adab03bb8b5fd75c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } }
I20260709 13:19:18.393095  8832 leader_election.cc:290] T 34f36d59d88f40fe8a2805e604fc6c0a P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:18.380455  6844 leader_election.cc:400] T 90d42e216d9741e190bca19a781291fd P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 6 election: Vote denied by peer b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817) with higher term. Message: Invalid argument: T 90d42e216d9741e190bca19a781291fd P b7ab4784c7344b939bc36f639286f377 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c for earlier term 6. Current term is 7.
W20260709 13:19:18.424799  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 44592.4us
I20260709 13:19:18.425691  6844 leader_election.cc:304] T d8cee0accdb8499c86d4414b72565a38 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, b7ab4784c7344b939bc36f639286f377
I20260709 13:19:18.401185  9176 raft_consensus.cc:2804] T 7a734b5ab7834e05a8c422208acc58b1 P b7ab4784c7344b939bc36f639286f377 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:19:18.428220  9176 raft_consensus.cc:493] T 7a734b5ab7834e05a8c422208acc58b1 P b7ab4784c7344b939bc36f639286f377 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:18.428622  9176 raft_consensus.cc:3060] T 7a734b5ab7834e05a8c422208acc58b1 P b7ab4784c7344b939bc36f639286f377 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:18.405752  8987 raft_consensus.cc:515] T 20f6842e26174571996b8dea4151d4be P ccd8a4c3bfe3413cb2ae219b09aea832 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:18.434252  9071 leader_election.cc:290] T 24ee15416e3145beaa1b8183453729a3 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:19:18.434386  8987 leader_election.cc:290] T 20f6842e26174571996b8dea4151d4be P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 7 election: Requested vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:18.397282  9279 leader_election.cc:290] T f3f9c2e2bf644115957398fe4c9459db P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:18.436163  9251 consensus_queue.cc:1048] T 404190ce4ce94cecbfcb6ea9d1dd8626 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
W20260709 13:19:18.440189  6696 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:18.399266  7496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17587d6730594da4a56fa13a353232a1" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:19:18.442621  9212 raft_consensus.cc:515] T c4db81d9d329422bb3b4160ca4ac2d1d P b7ab4784c7344b939bc36f639286f377 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:18.443828  6804 raft_consensus.cc:1240] T c4db81d9d329422bb3b4160ca4ac2d1d P b7ab4784c7344b939bc36f639286f377 [term 7 FOLLOWER]: Rejecting Update request from peer ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 6. Current term is 7. Ops: []
I20260709 13:19:18.452083  9188 raft_consensus.cc:2749] T 713b5728a197487c9300b310ab94e5a3 P cd75a17ab2604397adab03bb8b5fd75c [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:19:18.400892  9339 raft_consensus.cc:2804] T bb7fa124c3bf4ef9ab65a407cb008441 P b7ab4784c7344b939bc36f639286f377 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:19:18.456408  6732 raft_consensus.cc:1275] T b3f13b31a1f84f0d89d007eadd57924c P ccd8a4c3bfe3413cb2ae219b09aea832 [term 5 FOLLOWER]: Refusing update from remote peer 7ba59cc884714e8aa5f3f0ecaed84cbb: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:19:18.457408  6732 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49744 (request call id 173) took 3457 ms. Trace:
W20260709 13:19:18.457719  6695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 45432.6us
I20260709 13:19:18.458025  6732 rpcz_store.cc:276] 0709 13:19:15.000182 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:15.002286 (+  2104us) service_pool.cc:224] Handling call
0709 13:19:15.020741 (+ 18455us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:17.257240 (+2236499us) spinlock_profiling.cc:243] Waited 1.28 s on lock 0x7b54001291a0. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f921dc0 00007fcc0f9ac1c0 00007fcc0f9ad231 00007fcc0f9a9d8f 00007fcc0f9a983e 00007fcc1496e419 00007fcc0dee5bd4 00007fcc0dee5b62 00007fcc0dee5a91 00007fcc0dee5a0c
0709 13:19:17.801320 (+544080us) spinlock_profiling.cc:243] Waited 1.71 ms on lock 0x7b4c001d7d80. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0dc76a20 00007fcc0dc87a29 00007fcc0dc4d644 00007fcc0dc74f2d 00007fcc0dc74b93 00007fcc0f9a518b 00007fcc0f9a5cb5 00007fcc0f9a0f30 00007fcc0f9a27de 00007fcc0f9acb49 00007fcc0f9ad416
0709 13:19:18.239612 (+438292us) spinlock_profiling.cc:243] Waited 266 ms on lock 0x7b58006542d0. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f9060aa 00007fcc0f988447 00007fcc0f9a0fe7 00007fcc0f9a27de 00007fcc0f9acb49 00007fcc0f9ad416 00007fcc0f9a9d8f 00007fcc0f9a983e 00007fcc1496e419 00007fcc0dee5bd4
0709 13:19:18.456842 (+217230us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:18.457333 (+   491us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3560220800}
I20260709 13:19:18.407194  9209 raft_consensus.cc:493] T 7a734b5ab7834e05a8c422208acc58b1 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:18.582206  6880 raft_consensus.cc:1275] T 3a485a995abc4807b6e511e45419f737 P cd75a17ab2604397adab03bb8b5fd75c [term 5 FOLLOWER]: Refusing update from remote peer ccd8a4c3bfe3413cb2ae219b09aea832: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
W20260709 13:19:18.473503  7468 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:18.606707  6772 leader_election.cc:304] T 427c124d773f483294511e80fe340075 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, cd75a17ab2604397adab03bb8b5fd75c
W20260709 13:19:18.642293  7468 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:18.643613  7466 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:18.583487  6880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "853ac0a8cbd64ce99457f170216d4d0f" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:19:18.646095  6880 raft_consensus.cc:3060] T 853ac0a8cbd64ce99457f170216d4d0f P cd75a17ab2604397adab03bb8b5fd75c [term 2 FOLLOWER]: Advancing to term 4
I20260709 13:19:18.608950  6807 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:32976 (request call id 2203) took 1378 ms. Trace:
I20260709 13:19:18.647220  6807 rpcz_store.cc:276] 0709 13:19:17.230366 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:18.011796 (+781430us) service_pool.cc:224] Handling call
0709 13:19:18.012149 (+   353us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:18.136591 (+124442us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:18.608654 (+472063us) spinlock_profiling.cc:243] Waited 112 ms on lock 0x7b54001a3bd4. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f9aae01 00007fcc0f9a983e 00007fcc1496e419 00007fcc0dee5bd4 00007fcc0dee5b62 00007fcc0dee5a91 00007fcc0dee5a0c 00007fcc0dee4cc2 00007fcc0dce548c 00007fcc0dce48c6
0709 13:19:18.608890 (+   236us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":257998208}
I20260709 13:19:18.442691  9344 raft_consensus.cc:2749] T 7a734b5ab7834e05a8c422208acc58b1 P cd75a17ab2604397adab03bb8b5fd75c [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:19:18.655330  6798 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:32976 (request call id 2220) took 1141 ms. Trace:
I20260709 13:19:18.655926  6798 rpcz_store.cc:276] 0709 13:19:17.514344 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:17.734760 (+220416us) service_pool.cc:224] Handling call
0709 13:19:18.655090 (+920330us) spinlock_profiling.cc:243] Waited 139 ms on lock 0x7b54001d1fd4. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f9ae2fa 00007fcc1496fb17 00007fcc0deea6d4 00007fcc0deea662 00007fcc0deea591 00007fcc0deea50c 00007fcc0dee97c2 00007fcc0dce548c 00007fcc0dce48c6 00007fcc0dce426f
0709 13:19:18.655251 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":319230720}
W20260709 13:19:18.467517  9076 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 5 current term: 5 is higher.
I20260709 13:19:18.661001  6807 raft_consensus.cc:1240] T b3f13b31a1f84f0d89d007eadd57924c P b7ab4784c7344b939bc36f639286f377 [term 5 FOLLOWER]: Rejecting Update request from peer ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 4. Current term is 5. Ops: []
I20260709 13:19:18.724888  6723 raft_consensus.cc:1275] T 24ee15416e3145beaa1b8183453729a3 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 6 FOLLOWER]: Refusing update from remote peer 7ba59cc884714e8aa5f3f0ecaed84cbb: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:19:18.732152  6880 raft_consensus.cc:2468] T 853ac0a8cbd64ce99457f170216d4d0f P cd75a17ab2604397adab03bb8b5fd75c [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 4.
I20260709 13:19:18.734282  6772 leader_election.cc:304] T 853ac0a8cbd64ce99457f170216d4d0f P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
W20260709 13:19:18.734606  7469 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:18.658025  6878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4db81d9d329422bb3b4160ca4ac2d1d" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:19:18.737226  6880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e326172347f45e99a0d482b5d8ef768" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:19:18.737447  6807 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:32976 (request call id 2212) took 1391 ms. Trace:
W20260709 13:19:18.605352  9334 log.cc:927] Time spent T 1528ab62b6fe4e3099d08f141afee116 P 7ba59cc884714e8aa5f3f0ecaed84cbb: Append to log took a long time: real 0.150s	user 0.001s	sys 0.001s
I20260709 13:19:18.737974  6807 rpcz_store.cc:276] 0709 13:19:17.345830 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:18.660418 (+1314588us) service_pool.cc:224] Handling call
0709 13:19:18.660778 (+   360us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:18.737101 (+ 76323us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:18.737386 (+   285us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:19:18.607641  9336 log.cc:927] Time spent T 9b3759de40694069b13c0f8bd40e5709 P b7ab4784c7344b939bc36f639286f377: Append to log took a long time: real 0.141s	user 0.000s	sys 0.000s
W20260709 13:19:18.629038  9333 log.cc:927] Time spent T 9b3759de40694069b13c0f8bd40e5709 P cd75a17ab2604397adab03bb8b5fd75c: Append to log took a long time: real 0.172s	user 0.000s	sys 0.000s
I20260709 13:19:18.599216  9188 raft_consensus.cc:493] T 1528ab62b6fe4e3099d08f141afee116 P cd75a17ab2604397adab03bb8b5fd75c [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 7ba59cc884714e8aa5f3f0ecaed84cbb)
I20260709 13:19:18.422545  9046 raft_consensus.cc:697] T 7ba5dac66ab5497e9e336f2a3c28cda5 P b7ab4784c7344b939bc36f639286f377 [term 8 LEADER]: Becoming Leader. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
I20260709 13:19:18.582563  9100 raft_consensus.cc:493] T 713b5728a197487c9300b310ab94e5a3 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:18.465166  9212 leader_election.cc:290] T c4db81d9d329422bb3b4160ca4ac2d1d P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 7 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:18.609869  9031 raft_consensus.cc:3055] T 44bde925b2e541b69890d70715b85176 P b7ab4784c7344b939bc36f639286f377 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:19:18.745177  6880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34f36d59d88f40fe8a2805e604fc6c0a" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:19:18.582314  9279 consensus_queue.cc:1048] T 22ccee1b570c4ad3a57bd7aec085b1b4 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.176s
I20260709 13:19:18.768955  6880 raft_consensus.cc:2410] T 34f36d59d88f40fe8a2805e604fc6c0a P cd75a17ab2604397adab03bb8b5fd75c [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7ab4784c7344b939bc36f639286f377 for term 5 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
W20260709 13:19:18.751300  9342 log.cc:927] Time spent T f4b8bd455d5a47c18a1380839c6e0d61 P b7ab4784c7344b939bc36f639286f377: Append to log took a long time: real 0.126s	user 0.001s	sys 0.000s
I20260709 13:19:18.748265  6877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24ee15416e3145beaa1b8183453729a3" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:19:18.748514  6807 raft_consensus.cc:1275] T f58dc08b12a2494bb9a1372837970ca2 P b7ab4784c7344b939bc36f639286f377 [term 8 FOLLOWER]: Refusing update from remote peer ccd8a4c3bfe3413cb2ae219b09aea832: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 4. (term mismatch)
I20260709 13:19:18.466243  9338 raft_consensus.cc:493] T f03d0dbf16864ca4bc1bb5e4c0334c0f P b7ab4784c7344b939bc36f639286f377 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:19:18.753149  6878 raft_consensus.cc:1240] T 7c37d41cd9164c15a6826ca62a851a69 P cd75a17ab2604397adab03bb8b5fd75c [term 5 FOLLOWER]: Rejecting Update request from peer b7ab4784c7344b939bc36f639286f377 for earlier term 4. Current term is 5. Ops: []
I20260709 13:19:18.595629  9209 raft_consensus.cc:3060] T 7a734b5ab7834e05a8c422208acc58b1 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:18.582499  9339 raft_consensus.cc:697] T bb7fa124c3bf4ef9ab65a407cb008441 P b7ab4784c7344b939bc36f639286f377 [term 8 LEADER]: Becoming Leader. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
I20260709 13:19:18.456257  9347 consensus_queue.cc:1059] T 1bf4668eeb70467fb3dc5a0289233b3c P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.320s
I20260709 13:19:18.608783  9349 raft_consensus.cc:2749] T d8cee0accdb8499c86d4414b72565a38 P cd75a17ab2604397adab03bb8b5fd75c [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
W20260709 13:19:18.758157  6845 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:18.769032  6697 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 463439us
W20260709 13:19:18.758138  9304 log.cc:927] Time spent T f09c2a98de1a4decabd0ff900dd44caa P ccd8a4c3bfe3413cb2ae219b09aea832: Append to log took a long time: real 1.530s	user 0.002s	sys 0.004s
I20260709 13:19:18.798511  6807 pending_rounds.cc:85] T f58dc08b12a2494bb9a1372837970ca2 P b7ab4784c7344b939bc36f639286f377: Aborting all ops after (but not including) 3
W20260709 13:19:18.795738  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 370122us
I20260709 13:19:18.747331  7496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24ee15416e3145beaa1b8183453729a3" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:19:18.726058  9303 consensus_queue.cc:1048] T 4f00a2e87e56452083b759f60d461ee3 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.040s
W20260709 13:19:18.627015  9121 consensus_meta.cc:287] T b56bf91d90824c959e21e0cee5ba1816 P ccd8a4c3bfe3413cb2ae219b09aea832: Time spent flushing consensus metadata: real 0.655s	user 0.005s	sys 0.005s
W20260709 13:19:18.836571  6696 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:18.771459  9231 raft_consensus.cc:2749] T 427c124d773f483294511e80fe340075 P b7ab4784c7344b939bc36f639286f377 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:19:18.845664  6807 pending_rounds.cc:107] T f58dc08b12a2494bb9a1372837970ca2 P b7ab4784c7344b939bc36f639286f377: Aborting uncommitted NO_OP operation due to leader change: 7.4
I20260709 13:19:18.771755  9031 raft_consensus.cc:740] T 44bde925b2e541b69890d70715b85176 P b7ab4784c7344b939bc36f639286f377 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
I20260709 13:19:18.842458  6697 leader_election.cc:304] T 853ac0a8cbd64ce99457f170216d4d0f P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:19:18.797097  9100 raft_consensus.cc:515] T 713b5728a197487c9300b310ab94e5a3 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:18.844178  8986 raft_consensus.cc:493] T b3f13b31a1f84f0d89d007eadd57924c P ccd8a4c3bfe3413cb2ae219b09aea832 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:18.809546  9338 raft_consensus.cc:515] T f03d0dbf16864ca4bc1bb5e4c0334c0f P b7ab4784c7344b939bc36f639286f377 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:18.847558  6844 leader_election.cc:304] T f4b8bd455d5a47c18a1380839c6e0d61 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:19:18.867633  6807 raft_consensus.cc:2889] T f58dc08b12a2494bb9a1372837970ca2 P b7ab4784c7344b939bc36f639286f377 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:19:18.867085  7466 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 193294us
I20260709 13:19:18.848237  9188 raft_consensus.cc:515] T 1528ab62b6fe4e3099d08f141afee116 P cd75a17ab2604397adab03bb8b5fd75c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } attrs { replace: true } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
W20260709 13:19:18.871743  7468 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:18.886724  6844 leader_election.cc:304] T bb7fa124c3bf4ef9ab65a407cb008441 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, b7ab4784c7344b939bc36f639286f377
I20260709 13:19:18.886682  6807 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:32976 (request call id 2213) took 1492 ms. Trace:
I20260709 13:19:18.887415  6807 rpcz_store.cc:276] 0709 13:19:17.394058 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:18.747234 (+1353176us) service_pool.cc:224] Handling call
0709 13:19:18.748094 (+   860us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:18.886385 (+138291us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:18.886624 (+   239us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:19:18.887693  7468 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:18.875697  6846 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.611s	user 0.017s	sys 0.023s
I20260709 13:19:18.859395  9079 raft_consensus.cc:515] T a1704639a875409b9959353527b3fd68 P b7ab4784c7344b939bc36f639286f377 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:18.879400  6728 raft_consensus.cc:2410] T b56bf91d90824c959e21e0cee5ba1816 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate b7ab4784c7344b939bc36f639286f377 for term 7 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:19:18.879339  6697 leader_election.cc:304] T d8292e16e5654be6bc408560cf256aaa P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:19:18.815521  9212 raft_consensus.cc:2804] T 853ac0a8cbd64ce99457f170216d4d0f P b7ab4784c7344b939bc36f639286f377 [term 4 FOLLOWER]: Leader election won for term 4
W20260709 13:19:18.891439  6846 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.626s	user 0.017s	sys 0.023s
I20260709 13:19:18.888664  6807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f00a2e87e56452083b759f60d461ee3" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:19:18.892802  6798 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:32976 (request call id 2211) took 1572 ms. Trace:
I20260709 13:19:18.896447  6697 leader_election.cc:304] T bd6869f07b5a4885a0b99fbe60c3b175 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:19:18.896700  6844 leader_election.cc:304] T d33d5ee8ef6f415593d8df52063161ad P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: ccd8a4c3bfe3413cb2ae219b09aea832
W20260709 13:19:18.897433  7468 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:18.900905  6807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8cee0accdb8499c86d4414b72565a38" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:19:18.901661  9344 raft_consensus.cc:2804] T d33d5ee8ef6f415593d8df52063161ad P cd75a17ab2604397adab03bb8b5fd75c [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:19:18.901825  6807 raft_consensus.cc:2468] T d8cee0accdb8499c86d4414b72565a38 P b7ab4784c7344b939bc36f639286f377 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in term 6.
I20260709 13:19:18.903286  6844 leader_election.cc:304] T f3f9c2e2bf644115957398fe4c9459db P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:19:18.900274  6798 rpcz_store.cc:276] 0709 13:19:17.320607 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:18.658451 (+1337844us) service_pool.cc:224] Handling call
0709 13:19:18.743889 (+ 85438us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:18.744183 (+   294us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:19:18.757205 (+ 13022us) log.cc:844] Serialized 14 byte log entry
0709 13:19:18.892426 (+135221us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:18.892481 (+    55us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:19:18.892542 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:18.892611 (+    69us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:18.892731 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":20309,"prepare.queue_time_us":134303,"raft.queue_time_us":20793,"thread_start_us":114389,"threads_started":1}
W20260709 13:19:18.905596  6846 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:18.903448  6807 raft_consensus.cc:1240] T 4f00a2e87e56452083b759f60d461ee3 P b7ab4784c7344b939bc36f639286f377 [term 7 LEADER]: Rejecting Update request from peer 7ba59cc884714e8aa5f3f0ecaed84cbb for earlier term 6. Current term is 7. Ops: []
I20260709 13:19:18.902145  9344 raft_consensus.cc:493] T d33d5ee8ef6f415593d8df52063161ad P cd75a17ab2604397adab03bb8b5fd75c [term 6 FOLLOWER]: Starting leader election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:19:18.859766  9209 raft_consensus.cc:515] T 7a734b5ab7834e05a8c422208acc58b1 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:18.882763  9347 raft_consensus.cc:2804] T 853ac0a8cbd64ce99457f170216d4d0f P ccd8a4c3bfe3413cb2ae219b09aea832 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:19:18.907862  6697 leader_election.cc:304] T 8c7f33e544204fbaac4078e3e83bbf4e P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:19:18.851986  9202 raft_consensus.cc:515] T 4d9def8b32fd443aa94ab1420b06837b P b7ab4784c7344b939bc36f639286f377 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:18.911952  6844 leader_election.cc:400] T 7ba5dac66ab5497e9e336f2a3c28cda5 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 6 pre-election: Vote denied by peer b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817) with higher term. Message: Invalid argument: T 7ba5dac66ab5497e9e336f2a3c28cda5 P b7ab4784c7344b939bc36f639286f377 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c for earlier term 6. Current term is 7.
I20260709 13:19:18.914088  6772 leader_election.cc:304] T 24ee15416e3145beaa1b8183453729a3 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:19:18.986375  6844 leader_election.cc:403] T 7ba5dac66ab5497e9e336f2a3c28cda5 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 6 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:19:18.966113  6697 leader_election.cc:304] T 44bde925b2e541b69890d70715b85176 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377
I20260709 13:19:18.988473  6805 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:32976 (request call id 2194) took 1808 ms. Trace:
I20260709 13:19:18.944922  6872 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53406 (request call id 1478) took 1750 ms. Trace:
I20260709 13:19:18.990950  6872 rpcz_store.cc:276] 0709 13:19:17.194679 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:17.196247 (+  1568us) service_pool.cc:224] Handling call
0709 13:19:17.196542 (+   295us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:17.506362 (+309820us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:18.944707 (+1438345us) spinlock_profiling.cc:243] Waited 208 ms on lock 0x7b5400142dd4. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f9aae01 00007fcc0f9a983e 00007fcc1496e419 00007fcc0dee5bd4 00007fcc0dee5b62 00007fcc0dee5a91 00007fcc0dee5a0c 00007fcc0dee4cc2 00007fcc0dce548c 00007fcc0dce48c6
0709 13:19:18.944865 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":477286784}
I20260709 13:19:18.944329  6804 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:32976 (request call id 2204) took 1703 ms. Trace:
I20260709 13:19:18.992491  6804 rpcz_store.cc:276] 0709 13:19:17.240909 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:18.022664 (+781755us) service_pool.cc:224] Handling call
0709 13:19:18.042701 (+ 20037us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:18.444219 (+401518us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:18.944019 (+499800us) spinlock_profiling.cc:243] Waited 401 ms on lock 0x7b54002da854. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f9aae01 00007fcc0f9a983e 00007fcc1496e419 00007fcc0dee5bd4 00007fcc0dee5b62 00007fcc0dee5a91 00007fcc0dee5a0c 00007fcc0dee4cc2 00007fcc0dce548c 00007fcc0dce48c6
0709 13:19:18.944254 (+   235us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":922017024}
I20260709 13:19:18.937345  6873 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53416 (request call id 2283) took 1122 ms. Trace:
I20260709 13:19:18.994151  7500 raft_consensus.cc:1240] T bb3d8792045a4583ae2e965b1350a5b4 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 6 FOLLOWER]: Rejecting Update request from peer cd75a17ab2604397adab03bb8b5fd75c for earlier term 5. Current term is 6. Ops: []
I20260709 13:19:18.899900  9267 raft_consensus.cc:493] T b56bf91d90824c959e21e0cee5ba1816 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:18.998224  6807 raft_consensus.cc:1275] T 4275cf08e63345f993bce8664eada830 P b7ab4784c7344b939bc36f639286f377 [term 6 FOLLOWER]: Refusing update from remote peer ccd8a4c3bfe3413cb2ae219b09aea832: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:19:19.002738  6807 raft_consensus.cc:1275] T f09c2a98de1a4decabd0ff900dd44caa P b7ab4784c7344b939bc36f639286f377 [term 7 FOLLOWER]: Refusing update from remote peer ccd8a4c3bfe3413cb2ae219b09aea832: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:19:18.993578  6873 rpcz_store.cc:276] 0709 13:19:17.815340 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:17.945138 (+129798us) service_pool.cc:224] Handling call
0709 13:19:17.945549 (+   411us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:17.975544 (+ 29995us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:19:17.993370 (+ 17826us) log.cc:844] Serialized 14 byte log entry
0709 13:19:18.415923 (+422553us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:18.416680 (+   757us) log.cc:844] Serialized 26 byte log entry
0709 13:19:18.416876 (+   196us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:19:18.416923 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:18.417022 (+    99us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:18.937147 (+520125us) raft_consensus.cc:1685] finished
0709 13:19:18.937166 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:18.937288 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":27717,"prepare.queue_time_us":24495,"prepare.run_cpu_time_us":46,"prepare.run_wall_time_us":47,"raft.queue_time_us":223929,"raft.run_cpu_time_us":345,"raft.run_wall_time_us":19526,"thread_start_us":382888,"threads_started":2,"wal-append.queue_time_us":374057}
I20260709 13:19:18.951066  8892 raft_consensus.cc:3060] T 8c7f33e544204fbaac4078e3e83bbf4e P ccd8a4c3bfe3413cb2ae219b09aea832 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:19:18.918444  9347 raft_consensus.cc:493] T 853ac0a8cbd64ce99457f170216d4d0f P ccd8a4c3bfe3413cb2ae219b09aea832 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:19.009079  9347 raft_consensus.cc:3060] T 853ac0a8cbd64ce99457f170216d4d0f P ccd8a4c3bfe3413cb2ae219b09aea832 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:19:19.009982  9338 leader_election.cc:290] T f03d0dbf16864ca4bc1bb5e4c0334c0f P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:19.010512  9267 raft_consensus.cc:515] T b56bf91d90824c959e21e0cee5ba1816 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:19.011198  9364 consensus_queue.cc:1048] T f58dc08b12a2494bb9a1372837970ca2 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:19:18.941218  9316 consensus_queue.cc:1048] T b3f13b31a1f84f0d89d007eadd57924c P 7ba59cc884714e8aa5f3f0ecaed84cbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.075s
I20260709 13:19:19.016427  9364 consensus_queue.cc:1243] T f58dc08b12a2494bb9a1372837970ca2 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Peer cd75a17ab2604397adab03bb8b5fd75c log is divergent from this leader: its last log entry 4.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260709 13:19:18.908128  9319 raft_consensus.cc:2749] T bd6869f07b5a4885a0b99fbe60c3b175 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:19:18.918133  9365 raft_consensus.cc:2749] T f3f9c2e2bf644115957398fe4c9459db P cd75a17ab2604397adab03bb8b5fd75c [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:19:18.950276  9339 consensus_queue.cc:237] T bb7fa124c3bf4ef9ab65a407cb008441 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:19:19.018193  9188 leader_election.cc:290] T 1528ab62b6fe4e3099d08f141afee116 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:19:19.018808  8827 raft_consensus.cc:2804] T 44bde925b2e541b69890d70715b85176 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:19:19.019423  8827 raft_consensus.cc:697] T 44bde925b2e541b69890d70715b85176 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 7 LEADER]: Becoming Leader. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
I20260709 13:19:19.020397  8827 consensus_queue.cc:237] T 44bde925b2e541b69890d70715b85176 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:18.905010  9121 raft_consensus.cc:2804] T d8292e16e5654be6bc408560cf256aaa P ccd8a4c3bfe3413cb2ae219b09aea832 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:19:19.023691  9121 raft_consensus.cc:697] T d8292e16e5654be6bc408560cf256aaa P ccd8a4c3bfe3413cb2ae219b09aea832 [term 8 LEADER]: Becoming Leader. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
I20260709 13:19:19.001833  6801 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:32976 (request call id 2208) took 1718 ms. Trace:
W20260709 13:19:18.945961  9176 consensus_meta.cc:287] T 7a734b5ab7834e05a8c422208acc58b1 P b7ab4784c7344b939bc36f639286f377: Time spent flushing consensus metadata: real 0.517s	user 0.010s	sys 0.000s
W20260709 13:19:18.942245  9353 log.cc:927] Time spent T 1bf4668eeb70467fb3dc5a0289233b3c P cd75a17ab2604397adab03bb8b5fd75c: Append to log took a long time: real 0.135s	user 0.000s	sys 0.000s
I20260709 13:19:19.051908  7500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1528ab62b6fe4e3099d08f141afee116" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
W20260709 13:19:18.949868  9194 consensus_meta.cc:287] T 2c240553ce044eedb41541d72b9475d7 P ccd8a4c3bfe3413cb2ae219b09aea832: Time spent flushing consensus metadata: real 0.557s	user 0.010s	sys 0.001s
I20260709 13:19:18.886628  9046 consensus_queue.cc:237] T 7ba5dac66ab5497e9e336f2a3c28cda5 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
W20260709 13:19:18.936549  9354 log.cc:927] Time spent T 3411566abe2d4c9bb4b2adfdd05e6f17 P b7ab4784c7344b939bc36f639286f377: Append to log took a long time: real 0.192s	user 0.001s	sys 0.000s
W20260709 13:19:18.988457  9346 log.cc:927] Time spent T ab432e62819d499eaaf3dd55481dd930 P ccd8a4c3bfe3413cb2ae219b09aea832: Append to log took a long time: real 0.378s	user 0.000s	sys 0.001s
I20260709 13:19:18.887537  8986 raft_consensus.cc:515] T b3f13b31a1f84f0d89d007eadd57924c P ccd8a4c3bfe3413cb2ae219b09aea832 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:19:19.025661  6801 rpcz_store.cc:276] 0709 13:19:17.283421 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:18.031002 (+747581us) service_pool.cc:224] Handling call
0709 13:19:18.051748 (+ 20746us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:19:18.102628 (+ 50880us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:18.102659 (+    31us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:19:18.121617 (+ 18958us) log.cc:844] Serialized 52 byte log entry
0709 13:19:18.344678 (+223061us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:19:18.482348 (+137670us) log.cc:844] Serialized 14 byte log entry
0709 13:19:18.583534 (+101186us) log.cc:844] Serialized 14 byte log entry
0709 13:19:18.749541 (+166007us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:18.749616 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:19.001477 (+251861us) raft_consensus.cc:1685] finished
0709 13:19:19.001505 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:19.001736 (+   231us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":145626,"prepare.queue_time_us":266540,"raft.queue_time_us":194787,"raft.run_cpu_time_us":273,"raft.run_wall_time_us":14019,"spinlock_wait_cycles":113274112,"thread_start_us":454435,"threads_started":3,"wal-append.queue_time_us":446678}
I20260709 13:19:18.898454  9350 raft_consensus.cc:2749] T bb7fa124c3bf4ef9ab65a407cb008441 P cd75a17ab2604397adab03bb8b5fd75c [term 8 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:19:18.914552  9344 raft_consensus.cc:3060] T d33d5ee8ef6f415593d8df52063161ad P cd75a17ab2604397adab03bb8b5fd75c [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:18.933979  7496 raft_consensus.cc:1240] T 24ee15416e3145beaa1b8183453729a3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 6 LEADER]: Rejecting Update request from peer cd75a17ab2604397adab03bb8b5fd75c for earlier term 5. Current term is 6. Ops: [5.6-5.6]
I20260709 13:19:18.989001  6805 rpcz_store.cc:276] 0709 13:19:17.180387 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:17.999131 (+818744us) service_pool.cc:224] Handling call
0709 13:19:17.999442 (+   311us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:19:18.062289 (+ 62847us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:18.062323 (+    34us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:19:18.077739 (+ 15416us) log.cc:844] Serialized 52 byte log entry
0709 13:19:18.351249 (+273510us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:19:18.739680 (+388431us) log.cc:844] Serialized 14 byte log entry
0709 13:19:18.895212 (+155532us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:18.895297 (+    85us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:18.988222 (+ 92925us) raft_consensus.cc:1685] finished
0709 13:19:18.988242 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:18.988411 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":61380,"prepare.queue_time_us":447207,"prepare.run_cpu_time_us":41,"prepare.run_wall_time_us":44,"raft.queue_time_us":160345,"raft.run_cpu_time_us":280,"raft.run_wall_time_us":13060,"thread_start_us":735122,"threads_started":3,"wal-append.queue_time_us":362405}
I20260709 13:19:18.917230  9212 raft_consensus.cc:697] T 853ac0a8cbd64ce99457f170216d4d0f P b7ab4784c7344b939bc36f639286f377 [term 4 LEADER]: Becoming Leader. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
I20260709 13:19:18.975545  9279 raft_consensus.cc:493] T a3022224cc81473690653a83d4e99470 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:19:18.907181  9349 raft_consensus.cc:2804] T f4b8bd455d5a47c18a1380839c6e0d61 P cd75a17ab2604397adab03bb8b5fd75c [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:19:18.894712  8832 consensus_queue.cc:1059] T 7c37d41cd9164c15a6826ca62a851a69 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.132s
I20260709 13:19:18.944425  9209 leader_election.cc:290] T 7a734b5ab7834e05a8c422208acc58b1 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 7 election: Requested vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:19.077090  6804 raft_consensus.cc:1275] T 1528ab62b6fe4e3099d08f141afee116 P b7ab4784c7344b939bc36f639286f377 [term 5 FOLLOWER]: Refusing update from remote peer 7ba59cc884714e8aa5f3f0ecaed84cbb: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:19:18.977133  9251 consensus_queue.cc:1048] T 4275cf08e63345f993bce8664eada830 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.097s
W20260709 13:19:19.089154  7468 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:19.055133  9176 raft_consensus.cc:515] T 7a734b5ab7834e05a8c422208acc58b1 P b7ab4784c7344b939bc36f639286f377 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:18.933239  9031 consensus_queue.cc:260] T 44bde925b2e541b69890d70715b85176 P b7ab4784c7344b939bc36f639286f377 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:19.115945  6803 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:32976 (request call id 2209) took 1822 ms. Trace:
W20260709 13:19:19.120311  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 208542us
I20260709 13:19:19.120736  6803 rpcz_store.cc:276] 0709 13:19:17.293740 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:18.284933 (+991193us) service_pool.cc:224] Handling call
0709 13:19:18.285260 (+   327us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:18.308934 (+ 23674us) raft_consensus.cc:1534] Early marking committed up to index 1
0709 13:19:18.308978 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:18.309579 (+   601us) log.cc:844] Serialized 26 byte log entry
0709 13:19:18.474478 (+164899us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:19:18.474538 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:18.474644 (+   106us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:19.115712 (+641068us) raft_consensus.cc:1685] finished
0709 13:19:19.115732 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:19.115871 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":39907,"raft.run_cpu_time_us":183,"raft.run_wall_time_us":13523,"thread_start_us":121191,"threads_started":1,"wal-append.queue_time_us":287175}
I20260709 13:19:19.076385  9194 raft_consensus.cc:515] T 2c240553ce044eedb41541d72b9475d7 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:19.025116  9121 consensus_queue.cc:237] T d8292e16e5654be6bc408560cf256aaa P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
W20260709 13:19:19.114629  9210 consensus_meta.cc:287] T 30e88460611e47b2ba16a46a30b5f416 P b7ab4784c7344b939bc36f639286f377: Time spent flushing consensus metadata: real 0.762s	user 0.011s	sys 0.000s
I20260709 13:19:19.106384  9349 raft_consensus.cc:493] T f4b8bd455d5a47c18a1380839c6e0d61 P cd75a17ab2604397adab03bb8b5fd75c [term 5 FOLLOWER]: Starting leader election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:19:19.112130  9240 raft_consensus.cc:2749] T ab432e62819d499eaaf3dd55481dd930 P cd75a17ab2604397adab03bb8b5fd75c [term 7 FOLLOWER]: Leader pre-election lost for term 6. Reason: Vote denied by peer b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817) with higher term. Message: Invalid argument: T ab432e62819d499eaaf3dd55481dd930 P b7ab4784c7344b939bc36f639286f377 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c for earlier term 6. Current term is 7.
I20260709 13:19:19.087978  9362 raft_consensus.cc:2749] T 7ba5dac66ab5497e9e336f2a3c28cda5 P cd75a17ab2604397adab03bb8b5fd75c [term 8 FOLLOWER]: Leader pre-election lost for term 6. Reason: Vote denied by peer b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817) with higher term. Message: Invalid argument: T 7ba5dac66ab5497e9e336f2a3c28cda5 P b7ab4784c7344b939bc36f639286f377 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c for earlier term 6. Current term is 7.
W20260709 13:19:19.136092  9313 consensus_meta.cc:287] T 3fa34c08b205435dba97346991aa1f92 P ccd8a4c3bfe3413cb2ae219b09aea832: Time spent flushing consensus metadata: real 0.721s	user 0.013s	sys 0.001s
W20260709 13:19:19.150578  9259 consensus_meta.cc:287] T de3186201e1a40d0b335eeb8b4e256e0 P ccd8a4c3bfe3413cb2ae219b09aea832: Time spent flushing consensus metadata: real 0.825s	user 0.008s	sys 0.004s
I20260709 13:19:19.111836  9279 raft_consensus.cc:515] T a3022224cc81473690653a83d4e99470 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
W20260709 13:19:19.153609  7468 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:19.140817  9349 raft_consensus.cc:3060] T f4b8bd455d5a47c18a1380839c6e0d61 P cd75a17ab2604397adab03bb8b5fd75c [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:19.161242  9259 raft_consensus.cc:515] T de3186201e1a40d0b335eeb8b4e256e0 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
W20260709 13:19:19.152314  6697 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 75108.6us
W20260709 13:19:19.147539  9065 consensus_meta.cc:287] T 1528ab62b6fe4e3099d08f141afee116 P ccd8a4c3bfe3413cb2ae219b09aea832: Time spent flushing consensus metadata: real 0.749s	user 0.011s	sys 0.000s
I20260709 13:19:19.143527  6844 leader_election.cc:304] T 2c240553ce044eedb41541d72b9475d7 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
W20260709 13:19:19.180568  7469 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:19.165118  9100 leader_election.cc:290] T 713b5728a197487c9300b310ab94e5a3 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
W20260709 13:19:19.201572  7466 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 315674us
I20260709 13:19:19.184931  9079 leader_election.cc:290] T a1704639a875409b9959353527b3fd68 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 6 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
W20260709 13:19:19.259457  6695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 128981us
W20260709 13:19:19.260988  7466 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:19.186506  8892 raft_consensus.cc:2749] T 8c7f33e544204fbaac4078e3e83bbf4e P ccd8a4c3bfe3413cb2ae219b09aea832 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:19:19.197633  9202 leader_election.cc:290] T 4d9def8b32fd443aa94ab1420b06837b P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 7 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:19.211849  9176 leader_election.cc:290] T 7a734b5ab7834e05a8c422208acc58b1 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 7 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:19.214013  9222 raft_consensus.cc:3060] T fe20b4b48823486ca3b9c648db6ce8aa P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:19:19.219440  6845 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:19.268323  6845 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:19.222673  6697 leader_election.cc:304] T 711ef6523deb4cbe8ef2ba61e1c21c98 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:19:19.262058  7466 leader_election.cc:304] T d8cee0accdb8499c86d4414b72565a38 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, b7ab4784c7344b939bc36f639286f377; no voters: 
W20260709 13:19:19.269429  6697 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 46910.6us
W20260709 13:19:19.265956  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 131841us
I20260709 13:19:19.152235  9313 raft_consensus.cc:515] T 3fa34c08b205435dba97346991aa1f92 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
W20260709 13:19:19.265461  9377 log.cc:927] Time spent T bb7fa124c3bf4ef9ab65a407cb008441 P b7ab4784c7344b939bc36f639286f377: Append to log took a long time: real 0.121s	user 0.007s	sys 0.003s
W20260709 13:19:19.300678  6697 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.5.126.68:45071 timed out after 1.554s (SENT) [suppressed 7 similar messages]
I20260709 13:19:19.223773  9065 raft_consensus.cc:515] T 1528ab62b6fe4e3099d08f141afee116 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } attrs { replace: true } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
W20260709 13:19:19.303828  6697 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:19.303905  6877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c37d41cd9164c15a6826ca62a851a69" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:19:19.372442  6877 raft_consensus.cc:2393] T 7c37d41cd9164c15a6826ca62a851a69 P cd75a17ab2604397adab03bb8b5fd75c [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ccd8a4c3bfe3413cb2ae219b09aea832 in current term 5: Already voted for candidate cd75a17ab2604397adab03bb8b5fd75c in this term.
I20260709 13:19:19.313079  6844 leader_election.cc:304] T c4db81d9d329422bb3b4160ca4ac2d1d P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
W20260709 13:19:19.373296  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 60322.7us
I20260709 13:19:19.374176  6844 leader_election.cc:304] T 4275cf08e63345f993bce8664eada830 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
W20260709 13:19:19.346194  6696 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:19.360855  9374 log.cc:927] Time spent T ab432e62819d499eaaf3dd55481dd930 P cd75a17ab2604397adab03bb8b5fd75c: Append to log took a long time: real 0.154s	user 0.000s	sys 0.001s
W20260709 13:19:19.292754  9378 log.cc:927] Time spent T 44bde925b2e541b69890d70715b85176 P ccd8a4c3bfe3413cb2ae219b09aea832: Append to log took a long time: real 0.086s	user 0.000s	sys 0.000s
I20260709 13:19:19.271173  9362 raft_consensus.cc:2749] T 2c240553ce044eedb41541d72b9475d7 P cd75a17ab2604397adab03bb8b5fd75c [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:19:19.268977  9321 consensus_queue.cc:1048] T 24ee15416e3145beaa1b8183453729a3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.096s
I20260709 13:19:19.362691  6873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20f6842e26174571996b8dea4151d4be" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:19:19.292119  9385 raft_consensus.cc:2804] T d8cee0accdb8499c86d4414b72565a38 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:19:19.215708  9347 raft_consensus.cc:515] T 853ac0a8cbd64ce99457f170216d4d0f P ccd8a4c3bfe3413cb2ae219b09aea832 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
W20260709 13:19:19.364984  9375 log.cc:927] Time spent T 3fa34c08b205435dba97346991aa1f92 P 7ba59cc884714e8aa5f3f0ecaed84cbb: Append to log took a long time: real 0.116s	user 0.000s	sys 0.001s
I20260709 13:19:19.365507  9384 consensus_queue.cc:1048] T 3a485a995abc4807b6e511e45419f737 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.063s
I20260709 13:19:19.367002  5625 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:19:19.368074  6875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f9c2e2bf644115957398fe4c9459db" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:19:19.248275  9379 consensus_queue.cc:1048] T f09c2a98de1a4decabd0ff900dd44caa P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 1, Time since last communication: 0.026s
W20260709 13:19:19.369899  7468 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:19.154228  9212 consensus_queue.cc:237] T 853ac0a8cbd64ce99457f170216d4d0f P b7ab4784c7344b939bc36f639286f377 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:19.361984  9313 leader_election.cc:290] T 3fa34c08b205435dba97346991aa1f92 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 8 election: Requested vote from peers cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:19:19.395855  6730 raft_consensus.cc:1240] T 3fa34c08b205435dba97346991aa1f92 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 8 FOLLOWER]: Rejecting Update request from peer 7ba59cc884714e8aa5f3f0ecaed84cbb for earlier term 7. Current term is 8. Ops: []
I20260709 13:19:19.401376  6725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c37d41cd9164c15a6826ca62a851a69" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:19:19.403290  6726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c44c4849aa54f2b94d1f1bef9ed546f" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:19:19.404316  6731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b3759de40694069b13c0f8bd40e5709" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:19:19.486461  6725 raft_consensus.cc:3060] T 7c37d41cd9164c15a6826ca62a851a69 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:19:19.405833  6729 raft_consensus.cc:1275] T 07a92dd554674067a83a9cb68c4773f2 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 6 FOLLOWER]: Refusing update from remote peer cd75a17ab2604397adab03bb8b5fd75c: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 6 index: 3. (index mismatch)
I20260709 13:19:19.486461  6726 raft_consensus.cc:3060] T 7c44c4849aa54f2b94d1f1bef9ed546f P ccd8a4c3bfe3413cb2ae219b09aea832 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:19.438491  9385 raft_consensus.cc:493] T d8cee0accdb8499c86d4414b72565a38 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 5 FOLLOWER]: Starting leader election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:19:19.412119  6877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "713b5728a197487c9300b310ab94e5a3" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:19:19.421015  6873 raft_consensus.cc:3060] T 20f6842e26174571996b8dea4151d4be P cd75a17ab2604397adab03bb8b5fd75c [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:19.292824  9100 raft_consensus.cc:2804] T 711ef6523deb4cbe8ef2ba61e1c21c98 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:19:19.444079  6732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c7f33e544204fbaac4078e3e83bbf4e" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:19:19.453655  6723 raft_consensus.cc:1240] T 1528ab62b6fe4e3099d08f141afee116 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 6 FOLLOWER]: Rejecting Update request from peer 7ba59cc884714e8aa5f3f0ecaed84cbb for earlier term 5. Current term is 6. Ops: []
I20260709 13:19:19.419413  9350 raft_consensus.cc:2804] T c4db81d9d329422bb3b4160ca4ac2d1d P cd75a17ab2604397adab03bb8b5fd75c [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:19:19.440093  9365 raft_consensus.cc:2804] T 4275cf08e63345f993bce8664eada830 P cd75a17ab2604397adab03bb8b5fd75c [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:19:19.483816  6875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a734b5ab7834e05a8c422208acc58b1" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:19:19.500802  6875 raft_consensus.cc:3060] T 7a734b5ab7834e05a8c422208acc58b1 P cd75a17ab2604397adab03bb8b5fd75c [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:19:19.491201  7466 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 198179us
I20260709 13:19:19.406312  6727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1528ab62b6fe4e3099d08f141afee116" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:19:19.492066  6877 raft_consensus.cc:2468] T 713b5728a197487c9300b310ab94e5a3 P cd75a17ab2604397adab03bb8b5fd75c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 6.
I20260709 13:19:19.484513  8986 leader_election.cc:290] T b3f13b31a1f84f0d89d007eadd57924c P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
W20260709 13:19:19.504622  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 97159.8us
W20260709 13:19:19.514321  6844 leader_election.cc:336] T bb7fa124c3bf4ef9ab65a407cb008441 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817): Timed out: RequestConsensusVote RPC to 127.5.126.66:42817 timed out after 2.650s (SENT)
I20260709 13:19:19.504949  6877 raft_consensus.cc:3055] T 4b8cacb381b746da8d0049b0a83b41dd P cd75a17ab2604397adab03bb8b5fd75c [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:19:19.516433  6877 raft_consensus.cc:740] T 4b8cacb381b746da8d0049b0a83b41dd P cd75a17ab2604397adab03bb8b5fd75c [term 6 LEADER]: Becoming Follower/Learner. State: Replica: cd75a17ab2604397adab03bb8b5fd75c, State: Running, Role: LEADER
I20260709 13:19:19.524266  6725 raft_consensus.cc:2468] T 7c37d41cd9164c15a6826ca62a851a69 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 5.
I20260709 13:19:19.525475  6732 raft_consensus.cc:2468] T 8c7f33e544204fbaac4078e3e83bbf4e P ccd8a4c3bfe3413cb2ae219b09aea832 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 4.
I20260709 13:19:19.494172  9385 raft_consensus.cc:3060] T d8cee0accdb8499c86d4414b72565a38 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:19.493603  9194 leader_election.cc:290] T 2c240553ce044eedb41541d72b9475d7 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 8 election: Requested vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:19.497217  9350 raft_consensus.cc:493] T c4db81d9d329422bb3b4160ca4ac2d1d P cd75a17ab2604397adab03bb8b5fd75c [term 6 FOLLOWER]: Starting leader election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:19:19.500525  9365 raft_consensus.cc:493] T 4275cf08e63345f993bce8664eada830 P cd75a17ab2604397adab03bb8b5fd75c [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:19:19.556586  7466 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 54685.3us
W20260709 13:19:19.537532  9381 log.cc:927] Time spent T 3d65025eea89441290d85dd053810e31 P cd75a17ab2604397adab03bb8b5fd75c: Append to log took a long time: real 0.273s	user 0.000s	sys 0.001s
I20260709 13:19:19.529299  6877 consensus_queue.cc:260] T 4b8cacb381b746da8d0049b0a83b41dd P cd75a17ab2604397adab03bb8b5fd75c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:19:19.566015  6877 raft_consensus.cc:3060] T 4b8cacb381b746da8d0049b0a83b41dd P cd75a17ab2604397adab03bb8b5fd75c [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:19.519448  9100 raft_consensus.cc:697] T 711ef6523deb4cbe8ef2ba61e1c21c98 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 7 LEADER]: Becoming Leader. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
W20260709 13:19:19.568715  7468 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:19.563158  6875 raft_consensus.cc:2468] T 7a734b5ab7834e05a8c422208acc58b1 P cd75a17ab2604397adab03bb8b5fd75c [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 7.
W20260709 13:19:19.569621  7468 leader_election.cc:336] T 7ba5dac66ab5497e9e336f2a3c28cda5 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931): Timed out: RequestConsensusVote RPC to 127.5.126.67:42931 timed out after 2.613s (SENT)
I20260709 13:19:19.571118  6875 raft_consensus.cc:1217] T f58dc08b12a2494bb9a1372837970ca2 P cd75a17ab2604397adab03bb8b5fd75c [term 8 FOLLOWER]: Deduplicated request from leader. Original: 1.1->[3.2-8.4]   Dedup: 3.2->[5.3-8.4]
I20260709 13:19:19.536829  9357 raft_consensus.cc:493] T 7887766dc6784fcaa42b35c05fea7a99 P cd75a17ab2604397adab03bb8b5fd75c [term 6 FOLLOWER]: Starting pre-election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:19:19.538216  9362 raft_consensus.cc:493] T 427c124d773f483294511e80fe340075 P cd75a17ab2604397adab03bb8b5fd75c [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 7ba59cc884714e8aa5f3f0ecaed84cbb)
I20260709 13:19:19.575367  6726 raft_consensus.cc:2468] T 7c44c4849aa54f2b94d1f1bef9ed546f P ccd8a4c3bfe3413cb2ae219b09aea832 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 8.
I20260709 13:19:19.549273  6873 raft_consensus.cc:2468] T 20f6842e26174571996b8dea4151d4be P cd75a17ab2604397adab03bb8b5fd75c [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 7.
I20260709 13:19:19.554487  9350 raft_consensus.cc:3060] T c4db81d9d329422bb3b4160ca4ac2d1d P cd75a17ab2604397adab03bb8b5fd75c [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:19.578684  6875 pending_rounds.cc:85] T f58dc08b12a2494bb9a1372837970ca2 P cd75a17ab2604397adab03bb8b5fd75c: Aborting all ops after (but not including) 2
I20260709 13:19:19.588068  6875 pending_rounds.cc:107] T f58dc08b12a2494bb9a1372837970ca2 P cd75a17ab2604397adab03bb8b5fd75c: Aborting uncommitted NO_OP operation due to leader change: 4.3
I20260709 13:19:19.588459  6875 raft_consensus.cc:2889] T f58dc08b12a2494bb9a1372837970ca2 P cd75a17ab2604397adab03bb8b5fd75c [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:19:19.584985  6877 raft_consensus.cc:1275] T 4b8cacb381b746da8d0049b0a83b41dd P cd75a17ab2604397adab03bb8b5fd75c [term 7 FOLLOWER]: Refusing update from remote peer ccd8a4c3bfe3413cb2ae219b09aea832: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:19:19.556599  9365 raft_consensus.cc:3060] T 4275cf08e63345f993bce8664eada830 P cd75a17ab2604397adab03bb8b5fd75c [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:19:19.576445  9373 log.cc:927] Time spent T 90d42e216d9741e190bca19a781291fd P cd75a17ab2604397adab03bb8b5fd75c: Append to log took a long time: real 0.216s	user 0.000s	sys 0.001s
I20260709 13:19:19.564260  9279 leader_election.cc:290] T a3022224cc81473690653a83d4e99470 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:19.572439  9379 raft_consensus.cc:493] T 34f36d59d88f40fe8a2805e604fc6c0a P ccd8a4c3bfe3413cb2ae219b09aea832 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:19.591223  9397 raft_consensus.cc:493] T 4d9def8b32fd443aa94ab1420b06837b P ccd8a4c3bfe3413cb2ae219b09aea832 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:19.606192  9397 raft_consensus.cc:515] T 4d9def8b32fd443aa94ab1420b06837b P ccd8a4c3bfe3413cb2ae219b09aea832 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:19.608966  9273 raft_consensus.cc:3055] T 24ee15416e3145beaa1b8183453729a3 P cd75a17ab2604397adab03bb8b5fd75c [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:19:19.672451  9390 consensus_queue.cc:1048] T 3fa34c08b205435dba97346991aa1f92 P 7ba59cc884714e8aa5f3f0ecaed84cbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.068s
I20260709 13:19:19.610975  9273 raft_consensus.cc:740] T 24ee15416e3145beaa1b8183453729a3 P cd75a17ab2604397adab03bb8b5fd75c [term 5 LEADER]: Becoming Follower/Learner. State: Replica: cd75a17ab2604397adab03bb8b5fd75c, State: Running, Role: LEADER
I20260709 13:19:19.692247  9367 consensus_queue.cc:1048] T 7ba5dac66ab5497e9e336f2a3c28cda5 P 7ba59cc884714e8aa5f3f0ecaed84cbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.081s
I20260709 13:19:19.587647  9362 raft_consensus.cc:515] T 427c124d773f483294511e80fe340075 P cd75a17ab2604397adab03bb8b5fd75c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } attrs { replace: true } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:19:19.599699  9379 raft_consensus.cc:515] T 34f36d59d88f40fe8a2805e604fc6c0a P ccd8a4c3bfe3413cb2ae219b09aea832 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
W20260709 13:19:19.702701  6728 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50004 (request call id 1376) took 3960 ms (client timeout 2900 ms). Trace:
I20260709 13:19:19.706578  9267 leader_election.cc:290] T b56bf91d90824c959e21e0cee5ba1816 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:19.583376  9357 raft_consensus.cc:515] T 7887766dc6784fcaa42b35c05fea7a99 P cd75a17ab2604397adab03bb8b5fd75c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
W20260709 13:19:19.720294  6728 rpcz_store.cc:269] 0709 13:19:15.741893 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:15.788158 (+ 46265us) service_pool.cc:224] Handling call
0709 13:19:19.702332 (+3914174us) spinlock_profiling.cc:243] Waited 3.07 s on lock 0x7b54003d5754. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f9ae2fa 00007fcc1496fb17 00007fcc0deea6d4 00007fcc0deea662 00007fcc0deea591 00007fcc0deea50c 00007fcc0dee97c2 00007fcc0dce548c 00007fcc0dce48c6 00007fcc0dce426f
0709 13:19:19.702564 (+   232us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":7057312640}
I20260709 13:19:19.671330  9349 raft_consensus.cc:515] T f4b8bd455d5a47c18a1380839c6e0d61 P cd75a17ab2604397adab03bb8b5fd75c [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:19.719022  9347 leader_election.cc:290] T 853ac0a8cbd64ce99457f170216d4d0f P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 4 election: Requested vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:19.657691  9100 consensus_queue.cc:237] T 711ef6523deb4cbe8ef2ba61e1c21c98 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:19.746465  9349 leader_election.cc:290] T f4b8bd455d5a47c18a1380839c6e0d61 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 6 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
W20260709 13:19:19.747537  9383 log.cc:927] Time spent T f3f9c2e2bf644115957398fe4c9459db P cd75a17ab2604397adab03bb8b5fd75c: Append to log took a long time: real 0.506s	user 0.000s	sys 0.004s
I20260709 13:19:19.748502  9065 leader_election.cc:290] T 1528ab62b6fe4e3099d08f141afee116 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 6 election: Requested vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:19:19.750545  9362 leader_election.cc:290] T 427c124d773f483294511e80fe340075 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:19:19.751546  9397 leader_election.cc:290] T 4d9def8b32fd443aa94ab1420b06837b P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:19.757932  7498 raft_consensus.cc:2468] T fe20b4b48823486ca3b9c648db6ce8aa P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 4.
I20260709 13:19:19.759863  9366 raft_consensus.cc:493] T fe20b4b48823486ca3b9c648db6ce8aa P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:19.761456  9366 raft_consensus.cc:515] T fe20b4b48823486ca3b9c648db6ce8aa P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
W20260709 13:19:19.762367  6844 connection.cc:256] RPC call timeout handler was delayed by -1.5303274099999271s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16720000000000002s for a response
W20260709 13:19:19.762899  6844 connection.cc:256] RPC call timeout handler was delayed by -1.4556274099998063s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1755s for a response
W20260709 13:19:19.763185  6844 connection.cc:256] RPC call timeout handler was delayed by -1.4340274099997714s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1779s for a response
W20260709 13:19:19.763502  6844 connection.cc:256] RPC call timeout handler was delayed by -1.3134274099998038s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19130000000000003s for a response
W20260709 13:19:19.763772  6844 connection.cc:256] RPC call timeout handler was delayed by -1.288227409999763s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19410000000000002s for a response
W20260709 13:19:19.764021  6844 connection.cc:256] RPC call timeout handler was delayed by -1.2279274099998929s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2008s for a response
W20260709 13:19:19.764319  6844 connection.cc:256] RPC call timeout handler was delayed by -1.0767274099998758s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21760000000000002s for a response
W20260709 13:19:19.764571  6844 connection.cc:256] RPC call timeout handler was delayed by -1.0506274099998336s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22050000000000003s for a response
W20260709 13:19:19.764838  6844 connection.cc:256] RPC call timeout handler was delayed by -1.0326274099998045s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22250000000000003s for a response
W20260709 13:19:19.765111  6844 connection.cc:256] RPC call timeout handler was delayed by -1.0281274099997972s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.223s for a response
I20260709 13:19:19.765723  9379 leader_election.cc:290] T 34f36d59d88f40fe8a2805e604fc6c0a P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:19.769635  6724 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49998 (request call id 712) took 3399 ms. Trace:
I20260709 13:19:19.769963  9357 leader_election.cc:290] T 7887766dc6784fcaa42b35c05fea7a99 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:19:19.770117  6724 rpcz_store.cc:276] 0709 13:19:16.369855 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:17.232487 (+862632us) service_pool.cc:224] Handling call
0709 13:19:17.232862 (+   375us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:17.896362 (+663500us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:19.769336 (+1872974us) spinlock_profiling.cc:243] Waited 421 ms on lock 0x7b5400056c54. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f9aae01 00007fcc0f9a983e 00007fcc1496e419 00007fcc0dee5bd4 00007fcc0dee5b62 00007fcc0dee5a91 00007fcc0dee5a0c 00007fcc0dee4cc2 00007fcc0dce548c 00007fcc0dce48c6
0709 13:19:19.769570 (+   234us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":968165120}
I20260709 13:19:18.021667  6876 rpcz_store.cc:276] 0709 13:19:16.359801 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:16.502984 (+143183us) service_pool.cc:224] Handling call
0709 13:19:16.503341 (+   357us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:16.554544 (+ 51203us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:19:16.570435 (+ 15891us) log.cc:844] Serialized 14 byte log entry
0709 13:19:17.871582 (+1301147us) spinlock_profiling.cc:243] Waited 2.11 ms on lock 0x7b1800321b20. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc15785de1 00007fcc157925b1 00007fcc0c89fe07 00007fcc156faab9 00007fcc0c8bc69b 00007fcc0c8ba93f 00007fcc0c8bcc02 00007fcc0f54420b 00007fcc0f549d23 00007fcc0f54a23a 00007fcc0f9b4a2a
0709 13:19:18.014796 (+143214us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:18.014856 (+    60us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:19:18.014921 (+    65us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:18.014983 (+    62us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:18.015129 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2641,"prepare.queue_time_us":16246,"prepare.run_cpu_time_us":84,"prepare.run_wall_time_us":3454,"raft.queue_time_us":13319,"spinlock_wait_cycles":4863744,"thread_start_us":133974,"threads_started":1}
I20260709 13:19:19.772178  9273 consensus_queue.cc:260] T 24ee15416e3145beaa1b8183453729a3 P cd75a17ab2604397adab03bb8b5fd75c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } attrs { replace: true } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
W20260709 13:19:19.790093  9344 consensus_meta.cc:287] T d33d5ee8ef6f415593d8df52063161ad P cd75a17ab2604397adab03bb8b5fd75c: Time spent flushing consensus metadata: real 0.684s	user 0.011s	sys 0.000s
W20260709 13:19:19.793954  7468 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:19.793442  9344 raft_consensus.cc:515] T d33d5ee8ef6f415593d8df52063161ad P cd75a17ab2604397adab03bb8b5fd75c [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:19.795073  9043 raft_consensus.cc:3060] T e77e330a82df4b43a745d57a68f6f057 P cd75a17ab2604397adab03bb8b5fd75c [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:19.796792  6802 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50550 (request call id 214) took 3833 ms. Trace:
I20260709 13:19:19.797020  9344 leader_election.cc:290] T d33d5ee8ef6f415593d8df52063161ad P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 7 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
W20260709 13:19:19.805392  7469 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:19.805920  6696 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:19.792651  6844 leader_election.cc:304] T 34f36d59d88f40fe8a2805e604fc6c0a P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:19:19.797308  6802 rpcz_store.cc:276] 0709 13:19:15.963611 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:16.324800 (+361189us) service_pool.cc:224] Handling call
0709 13:19:16.335615 (+ 10815us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:17.188315 (+852700us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:19.049117 (+1860802us) spinlock_profiling.cc:243] Waited 847 ms on lock 0x7b5400185e54. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f9aae01 00007fcc0f9a983e 00007fcc1496e419 00007fcc0dee5bd4 00007fcc0dee5b62 00007fcc0dee5a91 00007fcc0dee5a0c 00007fcc0dee4cc2 00007fcc0dce548c 00007fcc0dce48c6
0709 13:19:19.796478 (+747361us) spinlock_profiling.cc:243] Waited 10.4 ms on lock 0x7b5400185e50. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f9a98ad 00007fcc1496e419 00007fcc0dee5bd4 00007fcc0dee5b62 00007fcc0dee5a91 00007fcc0dee5a0c 00007fcc0dee4cc2 00007fcc0dce548c 00007fcc0dce48c6 00007fcc0dce426f
0709 13:19:19.796698 (+   220us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1973059328}
I20260709 13:19:19.788033  9273 raft_consensus.cc:3060] T 24ee15416e3145beaa1b8183453729a3 P cd75a17ab2604397adab03bb8b5fd75c [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:19:19.788280  6770 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 1.81716e+06us
W20260709 13:19:19.811848  6772 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.68:45071, user_credentials={real_user=slave}} blocked reactor thread for 897783us
I20260709 13:19:19.815745  6724 raft_consensus.cc:1275] T f3f9c2e2bf644115957398fe4c9459db P ccd8a4c3bfe3413cb2ae219b09aea832 [term 6 FOLLOWER]: Refusing update from remote peer b7ab4784c7344b939bc36f639286f377: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:19:19.815928  6732 raft_consensus.cc:1240] T 7c37d41cd9164c15a6826ca62a851a69 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 5 FOLLOWER]: Rejecting Update request from peer b7ab4784c7344b939bc36f639286f377 for earlier term 4. Current term is 5. Ops: []
W20260709 13:19:19.817521  6772 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:19.818285  6772 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:19.821514  6844 leader_election.cc:304] T bd6869f07b5a4885a0b99fbe60c3b175 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:19:19.829797  6725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1528ab62b6fe4e3099d08f141afee116" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:19:19.829977  6727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8292e16e5654be6bc408560cf256aaa" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:19:19.830204  6729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22ccee1b570c4ad3a57bd7aec085b1b4" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:19:19.831180  6731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1704639a875409b9959353527b3fd68" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:19:19.836568  6725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "427c124d773f483294511e80fe340075" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:19:19.838066  6725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "853ac0a8cbd64ce99457f170216d4d0f" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:19:19.839740  6724 raft_consensus.cc:1240] T bd6869f07b5a4885a0b99fbe60c3b175 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 6 FOLLOWER]: Rejecting Update request from peer b7ab4784c7344b939bc36f639286f377 for earlier term 5. Current term is 6. Ops: []
I20260709 13:19:19.841779  6727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d9def8b32fd443aa94ab1420b06837b" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:19:19.842113  6731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a734b5ab7834e05a8c422208acc58b1" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:19:19.842417  6727 raft_consensus.cc:2468] T 4d9def8b32fd443aa94ab1420b06837b P ccd8a4c3bfe3413cb2ae219b09aea832 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 6.
I20260709 13:19:19.842828  6731 raft_consensus.cc:2393] T 7a734b5ab7834e05a8c422208acc58b1 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7ab4784c7344b939bc36f639286f377 in current term 7: Already voted for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in this term.
I20260709 13:19:19.844378  6729 raft_consensus.cc:1240] T 8c7f33e544204fbaac4078e3e83bbf4e P ccd8a4c3bfe3413cb2ae219b09aea832 [term 4 FOLLOWER]: Rejecting Update request from peer b7ab4784c7344b939bc36f639286f377 for earlier term 3. Current term is 4. Ops: []
I20260709 13:19:19.845309  6725 raft_consensus.cc:2393] T 853ac0a8cbd64ce99457f170216d4d0f P ccd8a4c3bfe3413cb2ae219b09aea832 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate b7ab4784c7344b939bc36f639286f377 in current term 4: Already voted for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in this term.
I20260709 13:19:19.846828  6727 raft_consensus.cc:1275] T 3d65025eea89441290d85dd053810e31 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 6 FOLLOWER]: Refusing update from remote peer b7ab4784c7344b939bc36f639286f377: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 6 index: 3. (index mismatch)
I20260709 13:19:19.848469  6844 leader_election.cc:304] T fe20b4b48823486ca3b9c648db6ce8aa P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:19:19.850375  6732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bf4668eeb70467fb3dc5a0289233b3c" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:19:19.852927  8832 raft_consensus.cc:3055] T 7c37d41cd9164c15a6826ca62a851a69 P b7ab4784c7344b939bc36f639286f377 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:19:19.853514  8832 raft_consensus.cc:740] T 7c37d41cd9164c15a6826ca62a851a69 P b7ab4784c7344b939bc36f639286f377 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
I20260709 13:19:19.854400  9349 raft_consensus.cc:2749] T fe20b4b48823486ca3b9c648db6ce8aa P cd75a17ab2604397adab03bb8b5fd75c [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:19:19.856184  9234 leader_election.cc:290] T 4f00a2e87e56452083b759f60d461ee3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:19.855998  9367 consensus_queue.cc:1048] T 1528ab62b6fe4e3099d08f141afee116 P 7ba59cc884714e8aa5f3f0ecaed84cbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:19:19.858297  6730 raft_consensus.cc:1240] T 30e88460611e47b2ba16a46a30b5f416 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 5 FOLLOWER]: Rejecting Update request from peer b7ab4784c7344b939bc36f639286f377 for earlier term 4. Current term is 5. Ops: []
I20260709 13:19:19.851897  6844 leader_election.cc:304] T 4d9def8b32fd443aa94ab1420b06837b P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377
I20260709 13:19:19.865079  6844 leader_election.cc:304] T b56bf91d90824c959e21e0cee5ba1816 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:19:19.866652  6844 leader_election.cc:304] T 20f6842e26174571996b8dea4151d4be P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:19:19.820060  9240 raft_consensus.cc:493] T 9e326172347f45e99a0d482b5d8ef768 P cd75a17ab2604397adab03bb8b5fd75c [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:19:19.871673  6731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34f36d59d88f40fe8a2805e604fc6c0a" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:19:19.853646  9050 leader_election.cc:290] T 9e326172347f45e99a0d482b5d8ef768 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:19.876560  6732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e326172347f45e99a0d482b5d8ef768" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:19:19.848417  9362 raft_consensus.cc:3060] T 34f36d59d88f40fe8a2805e604fc6c0a P cd75a17ab2604397adab03bb8b5fd75c [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:19:19.877271  7466 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:19.851755  9344 raft_consensus.cc:2749] T bd6869f07b5a4885a0b99fbe60c3b175 P cd75a17ab2604397adab03bb8b5fd75c [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:19:19.876982  6807 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50550 (request call id 222) took 1112 ms. Trace:
I20260709 13:19:19.881589  9137 raft_consensus.cc:493] T 9b3759de40694069b13c0f8bd40e5709 P b7ab4784c7344b939bc36f639286f377 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:19:19.885593  6730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17587d6730594da4a56fa13a353232a1" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:19:19.879297  6731 raft_consensus.cc:2410] T 34f36d59d88f40fe8a2805e604fc6c0a P ccd8a4c3bfe3413cb2ae219b09aea832 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7ab4784c7344b939bc36f639286f377 for term 5 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:19:19.879107  6844 leader_election.cc:304] T 3fa34c08b205435dba97346991aa1f92 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:19:19.879061  6727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24ee15416e3145beaa1b8183453729a3" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:19:19.820417  9221 consensus_queue.cc:1059] T 3fa34c08b205435dba97346991aa1f92 P 7ba59cc884714e8aa5f3f0ecaed84cbb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.049s
I20260709 13:19:19.878397  9303 raft_consensus.cc:2749] T 24ee15416e3145beaa1b8183453729a3 P b7ab4784c7344b939bc36f639286f377 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:19:19.856961  9234 consensus_queue.cc:1059] T 7ba5dac66ab5497e9e336f2a3c28cda5 P 7ba59cc884714e8aa5f3f0ecaed84cbb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:19:19.869665  9079 raft_consensus.cc:493] T 30e88460611e47b2ba16a46a30b5f416 P b7ab4784c7344b939bc36f639286f377 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:19.889391  6770 connection.cc:256] RPC call timeout handler was delayed by -1.8330547470000056s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2054s for a response
W20260709 13:19:19.893131  6772 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 74060.2us
I20260709 13:19:19.870630  9349 raft_consensus.cc:2749] T b56bf91d90824c959e21e0cee5ba1816 P cd75a17ab2604397adab03bb8b5fd75c [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:19:19.869273  9202 raft_consensus.cc:493] T f4b8bd455d5a47c18a1380839c6e0d61 P b7ab4784c7344b939bc36f639286f377 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:19:19.882794  6725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4db81d9d329422bb3b4160ca4ac2d1d" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:19:19.876480  9357 raft_consensus.cc:2804] T 4d9def8b32fd443aa94ab1420b06837b P cd75a17ab2604397adab03bb8b5fd75c [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:19:19.854394  8832 consensus_queue.cc:260] T 7c37d41cd9164c15a6826ca62a851a69 P b7ab4784c7344b939bc36f639286f377 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
W20260709 13:19:19.898622  6770 connection.cc:256] RPC call timeout handler was delayed by -1.7782949550000922s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1622s for a response
W20260709 13:19:19.901615  6770 connection.cc:256] RPC call timeout handler was delayed by -1.7745547470001384s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21190000000000003s for a response
W20260709 13:19:19.904851  6770 connection.cc:256] RPC call timeout handler was delayed by -1.6801949550001609s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17310000000000003s for a response
W20260709 13:19:19.907666  6770 connection.cc:256] RPC call timeout handler was delayed by -1.4659149830001752s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.29s for a response
W20260709 13:19:19.908229  6770 connection.cc:256] RPC call timeout handler was delayed by -1.2976949550002246s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2156s for a response
I20260709 13:19:19.912283  6805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c44c4849aa54f2b94d1f1bef9ed546f" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:19:19.915552  6802 raft_consensus.cc:1240] T 22ccee1b570c4ad3a57bd7aec085b1b4 P b7ab4784c7344b939bc36f639286f377 [term 5 FOLLOWER]: Rejecting Update request from peer cd75a17ab2604397adab03bb8b5fd75c for earlier term 4. Current term is 5. Ops: []
I20260709 13:19:19.900719  9344 raft_consensus.cc:2749] T 20f6842e26174571996b8dea4151d4be P cd75a17ab2604397adab03bb8b5fd75c [term 7 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:19:19.920351  6804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c7f33e544204fbaac4078e3e83bbf4e" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:19:19.919750  6802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b3759de40694069b13c0f8bd40e5709" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:19:19.924773  7502 raft_consensus.cc:1275] T bb7fa124c3bf4ef9ab65a407cb008441 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 8 FOLLOWER]: Refusing update from remote peer b7ab4784c7344b939bc36f639286f377: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:19:19.925154  6805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1528ab62b6fe4e3099d08f141afee116" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:19:19.904461  9222 raft_consensus.cc:3055] T 3fa34c08b205435dba97346991aa1f92 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 7 LEADER]: Stepping down as leader of term 7
W20260709 13:19:19.923228  9215 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.108s	user 0.022s	sys 0.022s
I20260709 13:19:19.896684  9137 raft_consensus.cc:515] T 9b3759de40694069b13c0f8bd40e5709 P b7ab4784c7344b939bc36f639286f377 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:19.926191  6770 leader_election.cc:304] T 07a92dd554674067a83a9cb68c4773f2 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:19:19.886829  9240 raft_consensus.cc:515] T 9e326172347f45e99a0d482b5d8ef768 P cd75a17ab2604397adab03bb8b5fd75c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:19.905733  9221 raft_consensus.cc:3055] T 7ba5dac66ab5497e9e336f2a3c28cda5 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:19:19.914875  9202 raft_consensus.cc:515] T f4b8bd455d5a47c18a1380839c6e0d61 P b7ab4784c7344b939bc36f639286f377 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
W20260709 13:19:19.972355  6770 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 46288.1us
I20260709 13:19:19.936429  6804 raft_consensus.cc:1275] T 07a92dd554674067a83a9cb68c4773f2 P b7ab4784c7344b939bc36f639286f377 [term 6 FOLLOWER]: Refusing update from remote peer cd75a17ab2604397adab03bb8b5fd75c: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 3. (term mismatch)
I20260709 13:19:19.973637  6770 leader_election.cc:304] T ab432e62819d499eaaf3dd55481dd930 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:19:19.914987  9349 raft_consensus.cc:2749] T 3fa34c08b205435dba97346991aa1f92 P cd75a17ab2604397adab03bb8b5fd75c [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:19:19.926918  6803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c37d41cd9164c15a6826ca62a851a69" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
W20260709 13:19:19.990708  7468 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:19.904219  9231 consensus_queue.cc:1059] T 7c44c4849aa54f2b94d1f1bef9ed546f P b7ab4784c7344b939bc36f639286f377 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.024s
I20260709 13:19:19.901053  9079 raft_consensus.cc:515] T 30e88460611e47b2ba16a46a30b5f416 P b7ab4784c7344b939bc36f639286f377 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:19.916137  9357 raft_consensus.cc:697] T 4d9def8b32fd443aa94ab1420b06837b P cd75a17ab2604397adab03bb8b5fd75c [term 6 LEADER]: Becoming Leader. State: Replica: cd75a17ab2604397adab03bb8b5fd75c, State: Running, Role: LEADER
I20260709 13:19:19.973683  6804 pending_rounds.cc:85] T 07a92dd554674067a83a9cb68c4773f2 P b7ab4784c7344b939bc36f639286f377: Aborting all ops after (but not including) 2
I20260709 13:19:19.996265  6804 pending_rounds.cc:107] T 07a92dd554674067a83a9cb68c4773f2 P b7ab4784c7344b939bc36f639286f377: Aborting uncommitted NO_OP operation due to leader change: 5.3
I20260709 13:19:19.996554  6804 raft_consensus.cc:2889] T 07a92dd554674067a83a9cb68c4773f2 P b7ab4784c7344b939bc36f639286f377 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:19:19.928151  6697 leader_election.cc:304] T bb3d8792045a4583ae2e965b1350a5b4 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:19:19.992666  6770 leader_election.cc:304] T 4275cf08e63345f993bce8664eada830 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:19:19.971175  9221 raft_consensus.cc:740] T 7ba5dac66ab5497e9e336f2a3c28cda5 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 7ba59cc884714e8aa5f3f0ecaed84cbb, State: Running, Role: LEADER
I20260709 13:19:19.994652  9071 raft_consensus.cc:2749] T ab432e62819d499eaaf3dd55481dd930 P b7ab4784c7344b939bc36f639286f377 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:19:19.998986  9221 consensus_queue.cc:260] T 7ba5dac66ab5497e9e336f2a3c28cda5 P 7ba59cc884714e8aa5f3f0ecaed84cbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
W20260709 13:19:20.005590  6697 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.68:45071, user_credentials={real_user=slave}} blocked reactor thread for 77516.9us
W20260709 13:19:19.971167  9215 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.165s	user 0.022s	sys 0.022s
W20260709 13:19:20.013731  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 134698us
I20260709 13:19:20.014770  6844 leader_election.cc:304] T de3186201e1a40d0b335eeb8b4e256e0 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377
I20260709 13:19:20.014935  6770 leader_election.cc:304] T 404190ce4ce94cecbfcb6ea9d1dd8626 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:19:19.929296  9222 raft_consensus.cc:740] T 3fa34c08b205435dba97346991aa1f92 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 7ba59cc884714e8aa5f3f0ecaed84cbb, State: Running, Role: LEADER
I20260709 13:19:20.023506  6802 raft_consensus.cc:2410] T 9b3759de40694069b13c0f8bd40e5709 P b7ab4784c7344b939bc36f639286f377 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c for term 7 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:19:20.029064  6878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c240553ce044eedb41541d72b9475d7" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:19:20.029956  6878 raft_consensus.cc:3060] T 2c240553ce044eedb41541d72b9475d7 P cd75a17ab2604397adab03bb8b5fd75c [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:20.033056  7502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fa34c08b205435dba97346991aa1f92" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb"
I20260709 13:19:20.034448  6877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fa34c08b205435dba97346991aa1f92" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
W20260709 13:19:20.078647  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 62148.8us
I20260709 13:19:20.081061  6844 leader_election.cc:304] T 30e88460611e47b2ba16a46a30b5f416 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:19:20.080255  6877 raft_consensus.cc:3060] T 3fa34c08b205435dba97346991aa1f92 P cd75a17ab2604397adab03bb8b5fd75c [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:19:20.090706  6770 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 75898us
I20260709 13:19:19.929051  9212 consensus_queue.cc:1048] T bb7fa124c3bf4ef9ab65a407cb008441 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.127s
I20260709 13:19:20.012797  9050 raft_consensus.cc:2804] T 07a92dd554674067a83a9cb68c4773f2 P b7ab4784c7344b939bc36f639286f377 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:19:20.021814  9209 raft_consensus.cc:2804] T bb3d8792045a4583ae2e965b1350a5b4 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:19:19.968169  9385 raft_consensus.cc:515] T d8cee0accdb8499c86d4414b72565a38 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:19:19.931097  9100 consensus_queue.cc:1048] T 4b8cacb381b746da8d0049b0a83b41dd P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.125s
I20260709 13:19:20.048976  9071 raft_consensus.cc:2749] T 4275cf08e63345f993bce8664eada830 P b7ab4784c7344b939bc36f639286f377 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:19:20.112248  7500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3f13b31a1f84f0d89d007eadd57924c" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:19:20.100716  9349 raft_consensus.cc:493] T 3a485a995abc4807b6e511e45419f737 P cd75a17ab2604397adab03bb8b5fd75c [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:20.077893  9344 raft_consensus.cc:2804] T de3186201e1a40d0b335eeb8b4e256e0 P cd75a17ab2604397adab03bb8b5fd75c [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:19:20.116933  6770 leader_election.cc:304] T b56bf91d90824c959e21e0cee5ba1816 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:19:20.120566  6877 raft_consensus.cc:2468] T 3fa34c08b205435dba97346991aa1f92 P cd75a17ab2604397adab03bb8b5fd75c [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 8.
I20260709 13:19:20.121007  6878 raft_consensus.cc:2468] T 2c240553ce044eedb41541d72b9475d7 P cd75a17ab2604397adab03bb8b5fd75c [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 8.
I20260709 13:19:20.124284  7503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1528ab62b6fe4e3099d08f141afee116" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb"
I20260709 13:19:20.112672  7502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe20b4b48823486ca3b9c648db6ce8aa" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:19:19.956367  9365 raft_consensus.cc:515] T 4275cf08e63345f993bce8664eada830 P cd75a17ab2604397adab03bb8b5fd75c [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:20.098832  9348 raft_consensus.cc:2749] T 404190ce4ce94cecbfcb6ea9d1dd8626 P b7ab4784c7344b939bc36f639286f377 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:19:20.137836  6878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34f36d59d88f40fe8a2805e604fc6c0a" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
W20260709 13:19:20.123003  9413 log.cc:927] Time spent T 711ef6523deb4cbe8ef2ba61e1c21c98 P ccd8a4c3bfe3413cb2ae219b09aea832: Append to log took a long time: real 0.090s	user 0.000s	sys 0.000s
I20260709 13:19:20.143826  6877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de3186201e1a40d0b335eeb8b4e256e0" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:19:20.116555  9380 raft_consensus.cc:493] T 3d65025eea89441290d85dd053810e31 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:20.167832  6770 leader_election.cc:304] T d8292e16e5654be6bc408560cf256aaa P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:19:20.173740  6697 leader_election.cc:304] T fe20b4b48823486ca3b9c648db6ce8aa P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:19:20.130820  9261 raft_consensus.cc:493] T bb7fa124c3bf4ef9ab65a407cb008441 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:20.179071  6873 raft_consensus.cc:1240] T 4275cf08e63345f993bce8664eada830 P cd75a17ab2604397adab03bb8b5fd75c [term 7 FOLLOWER]: Rejecting Update request from peer ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 13:19:20.181097  6770 leader_election.cc:304] T 22ccee1b570c4ad3a57bd7aec085b1b4 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:19:20.131934  9209 raft_consensus.cc:697] T bb3d8792045a4583ae2e965b1350a5b4 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 6 LEADER]: Becoming Leader. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
I20260709 13:19:20.132776  9344 raft_consensus.cc:493] T de3186201e1a40d0b335eeb8b4e256e0 P cd75a17ab2604397adab03bb8b5fd75c [term 5 FOLLOWER]: Starting leader election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:19:20.228744  9344 raft_consensus.cc:3060] T de3186201e1a40d0b335eeb8b4e256e0 P cd75a17ab2604397adab03bb8b5fd75c [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:19:20.198899  9359 log.cc:927] Time spent T ab432e62819d499eaaf3dd55481dd930 P b7ab4784c7344b939bc36f639286f377: Append to log took a long time: real 1.314s	user 0.003s	sys 0.008s
I20260709 13:19:20.169335  9071 raft_consensus.cc:2749] T b56bf91d90824c959e21e0cee5ba1816 P b7ab4784c7344b939bc36f639286f377 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:19:20.234491  6806 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:32976 (request call id 2210) took 2920 ms. Trace:
I20260709 13:19:20.234968  6806 rpcz_store.cc:276] 0709 13:19:17.313999 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:18.295576 (+981577us) service_pool.cc:224] Handling call
0709 13:19:18.296012 (+   436us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:18.296717 (+   705us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:18.296761 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:18.297484 (+   723us) log.cc:844] Serialized 26 byte log entry
0709 13:19:18.643398 (+345914us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:19:18.643438 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:18.643521 (+    83us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:20.198169 (+1554648us) spinlock_profiling.cc:243] Waited 25.2 ms on lock 0x7b4400022b4c. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0c745db1 00007fcc0c7e3c85 00007fcc0c7e46a2 00007fcc0f5561db 00007fcc0f551aaf 00007fcc0f54586e 00007fcc0f544bb6 00007fcc0f5447d8 00007fcc0f54e221 00007fcc0f54e1d9 00007fcc0f54e169
0709 13:19:20.234092 (+ 35923us) raft_consensus.cc:1685] finished
0709 13:19:20.234121 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:20.234416 (+   295us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":75737,"raft.run_cpu_time_us":87,"raft.run_wall_time_us":88,"spinlock_wait_cycles":58060672,"thread_start_us":257950,"threads_started":1,"wal-append.queue_time_us":421657}
W20260709 13:19:20.180751  9407 log.cc:927] Time spent T 3411566abe2d4c9bb4b2adfdd05e6f17 P cd75a17ab2604397adab03bb8b5fd75c: Append to log took a long time: real 0.244s	user 0.000s	sys 0.001s
I20260709 13:19:20.141093  9414 raft_consensus.cc:2749] T 30e88460611e47b2ba16a46a30b5f416 P cd75a17ab2604397adab03bb8b5fd75c [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:19:20.176523  9046 raft_consensus.cc:493] T de3186201e1a40d0b335eeb8b4e256e0 P b7ab4784c7344b939bc36f639286f377 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:20.237967  9046 raft_consensus.cc:515] T de3186201e1a40d0b335eeb8b4e256e0 P b7ab4784c7344b939bc36f639286f377 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:20.238054  9414 consensus_queue.cc:1048] T 07a92dd554674067a83a9cb68c4773f2 P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Connected to new peer: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
W20260709 13:19:20.215474  9356 log.cc:927] Time spent T 404190ce4ce94cecbfcb6ea9d1dd8626 P ccd8a4c3bfe3413cb2ae219b09aea832: Append to log took a long time: real 1.326s	user 0.009s	sys 0.002s
I20260709 13:19:20.139639  9222 consensus_queue.cc:260] T 3fa34c08b205435dba97346991aa1f92 P 7ba59cc884714e8aa5f3f0ecaed84cbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
W20260709 13:19:20.213001  9410 log.cc:927] Time spent T b3f13b31a1f84f0d89d007eadd57924c P ccd8a4c3bfe3413cb2ae219b09aea832: Append to log took a long time: real 0.212s	user 0.001s	sys 0.000s
I20260709 13:19:20.191609  9339 raft_consensus.cc:2749] T d8292e16e5654be6bc408560cf256aaa P b7ab4784c7344b939bc36f639286f377 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:19:20.180905  9380 raft_consensus.cc:515] T 3d65025eea89441290d85dd053810e31 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:20.188575  9401 raft_consensus.cc:2749] T fe20b4b48823486ca3b9c648db6ce8aa P ccd8a4c3bfe3413cb2ae219b09aea832 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:19:20.174110  8870 consensus_queue.cc:1048] T f3f9c2e2bf644115957398fe4c9459db P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.039s
W20260709 13:19:20.222195  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 98920.6us
W20260709 13:19:20.223721  7468 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:20.177680  9231 consensus_queue.cc:1059] T 7c37d41cd9164c15a6826ca62a851a69 P b7ab4784c7344b939bc36f639286f377 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.039s
I20260709 13:19:20.215626  9202 leader_election.cc:290] T f4b8bd455d5a47c18a1380839c6e0d61 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:20.226363  9402 raft_consensus.cc:493] T 404190ce4ce94cecbfcb6ea9d1dd8626 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 7 FOLLOWER]: Starting pre-election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:19:20.199738  9261 raft_consensus.cc:515] T bb7fa124c3bf4ef9ab65a407cb008441 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:19:20.268596  9361 raft_consensus.cc:2749] T 22ccee1b570c4ad3a57bd7aec085b1b4 P b7ab4784c7344b939bc36f639286f377 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:19:20.130566  9415 consensus_queue.cc:1059] T 22ccee1b570c4ad3a57bd7aec085b1b4 P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.123s
I20260709 13:19:20.259642  6844 leader_election.cc:304] T 7c37d41cd9164c15a6826ca62a851a69 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:19:20.139703  9349 raft_consensus.cc:515] T 3a485a995abc4807b6e511e45419f737 P cd75a17ab2604397adab03bb8b5fd75c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:20.265074  9402 raft_consensus.cc:515] T 404190ce4ce94cecbfcb6ea9d1dd8626 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:19:20.180294  9357 consensus_queue.cc:237] T 4d9def8b32fd443aa94ab1420b06837b P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:20.219744  9212 consensus_queue.cc:1059] T bd6869f07b5a4885a0b99fbe60c3b175 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: INVALID_TERM, Last received: 5.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.040s
I20260709 13:19:20.221673  9348 consensus_queue.cc:1059] T 8c7f33e544204fbaac4078e3e83bbf4e P b7ab4784c7344b939bc36f639286f377 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.042s
I20260709 13:19:20.286320  6846 leader_election.cc:304] T 1528ab62b6fe4e3099d08f141afee116 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, ccd8a4c3bfe3413cb2ae219b09aea832
W20260709 13:19:20.287184  7467 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:20.254904  9240 leader_election.cc:290] T 9e326172347f45e99a0d482b5d8ef768 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:19:20.263000  9234 raft_consensus.cc:493] T ce4f062dcd314d43a63ca74067cb5ee3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 6 FOLLOWER]: Starting pre-election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:19:20.294394  9212 raft_consensus.cc:3055] T bd6869f07b5a4885a0b99fbe60c3b175 P b7ab4784c7344b939bc36f639286f377 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:19:20.294521  9362 raft_consensus.cc:2749] T 34f36d59d88f40fe8a2805e604fc6c0a P cd75a17ab2604397adab03bb8b5fd75c [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:19:20.295019  9212 raft_consensus.cc:740] T bd6869f07b5a4885a0b99fbe60c3b175 P b7ab4784c7344b939bc36f639286f377 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
I20260709 13:19:20.297243  9402 leader_election.cc:290] T 404190ce4ce94cecbfcb6ea9d1dd8626 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:19:20.298636  9420 consensus_queue.cc:1059] T bb3d8792045a4583ae2e965b1350a5b4 P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.008s
I20260709 13:19:20.299839  9385 leader_election.cc:290] T d8cee0accdb8499c86d4414b72565a38 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 6 election: Requested vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:20.304350  6878 raft_consensus.cc:2468] T 34f36d59d88f40fe8a2805e604fc6c0a P cd75a17ab2604397adab03bb8b5fd75c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 4.
W20260709 13:19:20.306241  6696 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:20.310863  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 51276us
I20260709 13:19:20.311770  6844 leader_election.cc:304] T 8c7f33e544204fbaac4078e3e83bbf4e P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:19:20.285408  9046 leader_election.cc:290] T de3186201e1a40d0b335eeb8b4e256e0 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
W20260709 13:19:20.318795  6770 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 103214us
I20260709 13:19:20.321043  9071 consensus_queue.cc:1048] T 3d65025eea89441290d85dd053810e31 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:19:20.322027  9071 consensus_queue.cc:1243] T 3d65025eea89441290d85dd053810e31 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Peer ccd8a4c3bfe3413cb2ae219b09aea832 log is divergent from this leader: its last log entry 3.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260709 13:19:20.324570  6770 leader_election.cc:304] T 1bf4668eeb70467fb3dc5a0289233b3c P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:19:20.332178  6876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b56bf91d90824c959e21e0cee5ba1816" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:19:20.333249  6876 raft_consensus.cc:2468] T b56bf91d90824c959e21e0cee5ba1816 P cd75a17ab2604397adab03bb8b5fd75c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 7.
I20260709 13:19:20.334519  6876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1528ab62b6fe4e3099d08f141afee116" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:19:20.317528  9415 consensus_queue.cc:1243] T 22ccee1b570c4ad3a57bd7aec085b1b4 P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Peer ccd8a4c3bfe3413cb2ae219b09aea832 log is divergent from this leader: its last log entry 5.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 13:19:20.341946  9414 raft_consensus.cc:2804] T 8c7f33e544204fbaac4078e3e83bbf4e P cd75a17ab2604397adab03bb8b5fd75c [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:19:20.324014  9240 raft_consensus.cc:2749] T 1528ab62b6fe4e3099d08f141afee116 P cd75a17ab2604397adab03bb8b5fd75c [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:19:20.349882  6770 leader_election.cc:304] T 9e326172347f45e99a0d482b5d8ef768 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:19:20.341388  9273 raft_consensus.cc:2804] T 7c37d41cd9164c15a6826ca62a851a69 P cd75a17ab2604397adab03bb8b5fd75c [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:19:20.344501  9231 raft_consensus.cc:2749] T 1bf4668eeb70467fb3dc5a0289233b3c P b7ab4784c7344b939bc36f639286f377 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:19:20.350625  9414 raft_consensus.cc:697] T 8c7f33e544204fbaac4078e3e83bbf4e P cd75a17ab2604397adab03bb8b5fd75c [term 4 LEADER]: Becoming Leader. State: Replica: cd75a17ab2604397adab03bb8b5fd75c, State: Running, Role: LEADER
I20260709 13:19:20.363303  6876 raft_consensus.cc:3060] T 1528ab62b6fe4e3099d08f141afee116 P cd75a17ab2604397adab03bb8b5fd75c [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:20.309000  9209 consensus_queue.cc:237] T bb3d8792045a4583ae2e965b1350a5b4 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
W20260709 13:19:20.388517  9417 log.cc:927] Time spent T 1528ab62b6fe4e3099d08f141afee116 P b7ab4784c7344b939bc36f639286f377: Append to log took a long time: real 0.163s	user 0.000s	sys 0.001s
W20260709 13:19:20.390480  9371 log.cc:927] Time spent T 404190ce4ce94cecbfcb6ea9d1dd8626 P 7ba59cc884714e8aa5f3f0ecaed84cbb: Append to log took a long time: real 1.255s	user 0.002s	sys 0.001s
I20260709 13:19:20.390961  9303 raft_consensus.cc:2749] T 9e326172347f45e99a0d482b5d8ef768 P b7ab4784c7344b939bc36f639286f377 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:19:20.318972  9212 consensus_queue.cc:260] T bd6869f07b5a4885a0b99fbe60c3b175 P b7ab4784c7344b939bc36f639286f377 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.2, Last appended by leader: 2, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
W20260709 13:19:20.392529  9043 consensus_meta.cc:287] T e77e330a82df4b43a745d57a68f6f057 P cd75a17ab2604397adab03bb8b5fd75c: Time spent flushing consensus metadata: real 0.597s	user 0.007s	sys 0.006s
I20260709 13:19:20.356509  9406 raft_consensus.cc:493] T f58dc08b12a2494bb9a1372837970ca2 P cd75a17ab2604397adab03bb8b5fd75c [term 8 FOLLOWER]: Starting pre-election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:19:20.393267  9212 raft_consensus.cc:3060] T bd6869f07b5a4885a0b99fbe60c3b175 P b7ab4784c7344b939bc36f639286f377 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:19:20.392457  9337 log.cc:927] Time spent T 7887766dc6784fcaa42b35c05fea7a99 P b7ab4784c7344b939bc36f639286f377: Append to log took a long time: real 1.741s	user 0.002s	sys 0.006s
I20260709 13:19:20.393503  9406 raft_consensus.cc:515] T f58dc08b12a2494bb9a1372837970ca2 P cd75a17ab2604397adab03bb8b5fd75c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
W20260709 13:19:20.395218  9350 consensus_meta.cc:287] T c4db81d9d329422bb3b4160ca4ac2d1d P cd75a17ab2604397adab03bb8b5fd75c: Time spent flushing consensus metadata: real 0.793s	user 0.009s	sys 0.005s
I20260709 13:19:20.355615  9415 raft_consensus.cc:3055] T bb3d8792045a4583ae2e965b1350a5b4 P cd75a17ab2604397adab03bb8b5fd75c [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:19:20.353768  9365 leader_election.cc:290] T 4275cf08e63345f993bce8664eada830 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 7 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:19:20.396417  9415 raft_consensus.cc:740] T bb3d8792045a4583ae2e965b1350a5b4 P cd75a17ab2604397adab03bb8b5fd75c [term 5 LEADER]: Becoming Follower/Learner. State: Replica: cd75a17ab2604397adab03bb8b5fd75c, State: Running, Role: LEADER
I20260709 13:19:20.368228  9273 raft_consensus.cc:697] T 7c37d41cd9164c15a6826ca62a851a69 P cd75a17ab2604397adab03bb8b5fd75c [term 5 LEADER]: Becoming Leader. State: Replica: cd75a17ab2604397adab03bb8b5fd75c, State: Running, Role: LEADER
I20260709 13:19:20.397753  9273 consensus_queue.cc:237] T 7c37d41cd9164c15a6826ca62a851a69 P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:20.398504  6879 raft_consensus.cc:1275] T e77e330a82df4b43a745d57a68f6f057 P cd75a17ab2604397adab03bb8b5fd75c [term 8 FOLLOWER]: Refusing update from remote peer ccd8a4c3bfe3413cb2ae219b09aea832: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 4. (term mismatch)
I20260709 13:19:20.398939  6879 pending_rounds.cc:85] T e77e330a82df4b43a745d57a68f6f057 P cd75a17ab2604397adab03bb8b5fd75c: Aborting all ops after (but not including) 3
I20260709 13:19:20.399152  6879 pending_rounds.cc:107] T e77e330a82df4b43a745d57a68f6f057 P cd75a17ab2604397adab03bb8b5fd75c: Aborting uncommitted NO_OP operation due to leader change: 7.4
I20260709 13:19:20.399370  6879 raft_consensus.cc:2889] T e77e330a82df4b43a745d57a68f6f057 P cd75a17ab2604397adab03bb8b5fd75c [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:19:20.370252  9416 log.cc:927] Time spent T 4f00a2e87e56452083b759f60d461ee3 P 7ba59cc884714e8aa5f3f0ecaed84cbb: Append to log took a long time: real 0.115s	user 0.001s	sys 0.000s
W20260709 13:19:20.401639  7469 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:20.313850  9234 raft_consensus.cc:515] T ce4f062dcd314d43a63ca74067cb5ee3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } attrs { replace: true } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:19:20.402866  6875 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53416 (request call id 2318) took 1102 ms. Trace:
W20260709 13:19:20.403326  6697 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:20.372743  9380 leader_election.cc:290] T 3d65025eea89441290d85dd053810e31 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:20.374696  9261 leader_election.cc:290] T bb7fa124c3bf4ef9ab65a407cb008441 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:20.378881  6876 raft_consensus.cc:2468] T 1528ab62b6fe4e3099d08f141afee116 P cd75a17ab2604397adab03bb8b5fd75c [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 6.
I20260709 13:19:20.395166  6799 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:32976 (request call id 2207) took 3118 ms. Trace:
I20260709 13:19:20.403294  6875 rpcz_store.cc:276] 0709 13:19:19.300532 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:19.570352 (+269820us) service_pool.cc:224] Handling call
0709 13:19:19.570848 (+   496us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 13:19:19.963716 (+392868us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:19:20.003437 (+ 39721us) log.cc:844] Serialized 14 byte log entry
0709 13:19:20.353155 (+349718us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:19:20.354170 (+  1015us) log.cc:844] Serialized 52 byte log entry
0709 13:19:20.354370 (+   200us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:19:20.354404 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:20.354690 (+   286us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:20.402632 (+ 47942us) raft_consensus.cc:1685] finished
0709 13:19:20.402650 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:20.402808 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":39748,"prepare.run_cpu_time_us":65,"prepare.run_wall_time_us":14844,"raft.queue_time_us":236698,"raft.run_cpu_time_us":320,"raft.run_wall_time_us":12636,"thread_start_us":615687,"threads_started":3,"wal-append.queue_time_us":189779}
I20260709 13:19:20.414800  6799 rpcz_store.cc:276] 0709 13:19:17.276384 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:18.028131 (+751747us) service_pool.cc:224] Handling call
0709 13:19:18.046315 (+ 18184us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:18.074233 (+ 27918us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:18.074258 (+    25us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:18.074689 (+   431us) log.cc:844] Serialized 26 byte log entry
0709 13:19:18.353836 (+279147us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:19:18.353920 (+    84us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:18.354024 (+   104us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:20.391851 (+2037827us) spinlock_profiling.cc:243] Waited 6.54 ms on lock 0x7b4400022b4c. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0c745db1 00007fcc0c7e3c85 00007fcc0c7e46a2 00007fcc0f5561db 00007fcc0f551aaf 00007fcc0f54586e 00007fcc0f544bb6 00007fcc0f5447d8 00007fcc0f54e221 00007fcc0f54e1d9 00007fcc0f54e169
0709 13:19:20.394859 (+  3008us) raft_consensus.cc:1685] finished
0709 13:19:20.394882 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:20.395103 (+   221us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":27466,"raft.queue_time_us":28917,"raft.run_cpu_time_us":114,"raft.run_wall_time_us":117,"spinlock_wait_cycles":15042816,"thread_start_us":250176,"threads_started":1,"wal-append.queue_time_us":372773}
I20260709 13:19:20.395681  9350 raft_consensus.cc:515] T c4db81d9d329422bb3b4160ca4ac2d1d P cd75a17ab2604397adab03bb8b5fd75c [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:20.370007  9414 consensus_queue.cc:237] T 8c7f33e544204fbaac4078e3e83bbf4e P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:20.416226  6875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d65025eea89441290d85dd053810e31" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:19:20.374017  9349 leader_election.cc:290] T 3a485a995abc4807b6e511e45419f737 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:19:20.423058  6875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d9def8b32fd443aa94ab1420b06837b" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:19:20.426258  6872 raft_consensus.cc:1240] T c4db81d9d329422bb3b4160ca4ac2d1d P cd75a17ab2604397adab03bb8b5fd75c [term 7 FOLLOWER]: Rejecting Update request from peer ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 6. Current term is 7. Ops: []
I20260709 13:19:20.397676  9415 consensus_queue.cc:260] T bb3d8792045a4583ae2e965b1350a5b4 P cd75a17ab2604397adab03bb8b5fd75c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
W20260709 13:19:20.430263  6800 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:32976 (request call id 2206) took 3160 ms (client timeout 2438 ms). Trace:
W20260709 13:19:20.432734  6800 rpcz_store.cc:269] 0709 13:19:17.270226 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:17.928360 (+658134us) service_pool.cc:224] Handling call
0709 13:19:20.430002 (+2501642us) spinlock_profiling.cc:243] Waited 13.5 ms on lock 0x7b54001b53d4. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f9ae2fa 00007fcc1496fb17 00007fcc0deea6d4 00007fcc0deea662 00007fcc0deea591 00007fcc0deea50c 00007fcc0dee97c2 00007fcc0dce548c 00007fcc0dce48c6 00007fcc0dce426f
0709 13:19:20.430163 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":31014144}
I20260709 13:19:20.435796  9415 raft_consensus.cc:3060] T bb3d8792045a4583ae2e965b1350a5b4 P cd75a17ab2604397adab03bb8b5fd75c [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:20.436967  9350 leader_election.cc:290] T c4db81d9d329422bb3b4160ca4ac2d1d P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 7 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
W20260709 13:19:20.439808  6798 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.628s	user 0.012s	sys 0.036s
I20260709 13:19:20.399940  9390 raft_consensus.cc:2955] T 1528ab62b6fe4e3099d08f141afee116 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 5 LEADER]: Committing config change with OpId 5.6: config changed from index 3 to 6, VOTER cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } } }
I20260709 13:19:20.441810  6875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "853ac0a8cbd64ce99457f170216d4d0f" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
W20260709 13:19:20.443684  6770 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 93878.5us
I20260709 13:19:20.444602  6875 raft_consensus.cc:2393] T 853ac0a8cbd64ce99457f170216d4d0f P cd75a17ab2604397adab03bb8b5fd75c [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate ccd8a4c3bfe3413cb2ae219b09aea832 in current term 4: Already voted for candidate b7ab4784c7344b939bc36f639286f377 in this term.
W20260709 13:19:20.442109  6798 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.631s	user 0.013s	sys 0.036s
I20260709 13:19:20.449682  6875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3022224cc81473690653a83d4e99470" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:19:20.450525  6875 raft_consensus.cc:2468] T a3022224cc81473690653a83d4e99470 P cd75a17ab2604397adab03bb8b5fd75c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 6.
W20260709 13:19:20.464376  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 152690us
I20260709 13:19:20.465619  6844 leader_election.cc:304] T 7c44c4849aa54f2b94d1f1bef9ed546f P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
W20260709 13:19:20.473637  6773 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:20.503687  8870 raft_consensus.cc:493] T e77e330a82df4b43a745d57a68f6f057 P b7ab4784c7344b939bc36f639286f377 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:20.504422  8870 raft_consensus.cc:515] T e77e330a82df4b43a745d57a68f6f057 P b7ab4784c7344b939bc36f639286f377 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } }
I20260709 13:19:20.506634  8870 leader_election.cc:290] T e77e330a82df4b43a745d57a68f6f057 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931), ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391)
I20260709 13:19:20.507119  9344 raft_consensus.cc:515] T de3186201e1a40d0b335eeb8b4e256e0 P cd75a17ab2604397adab03bb8b5fd75c [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:20.514032  9234 leader_election.cc:290] T ce4f062dcd314d43a63ca74067cb5ee3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:20.508384  9380 raft_consensus.cc:493] T 07a92dd554674067a83a9cb68c4773f2 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:20.517316  9380 raft_consensus.cc:515] T 07a92dd554674067a83a9cb68c4773f2 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:20.516573  6877 raft_consensus.cc:3060] T de3186201e1a40d0b335eeb8b4e256e0 P cd75a17ab2604397adab03bb8b5fd75c [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:20.519992  9380 leader_election.cc:290] T 07a92dd554674067a83a9cb68c4773f2 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:20.525486  9344 leader_election.cc:290] T de3186201e1a40d0b335eeb8b4e256e0 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 6 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:19:20.528959  9366 leader_election.cc:290] T fe20b4b48823486ca3b9c648db6ce8aa P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:20.500772  9350 raft_consensus.cc:2804] T 7c44c4849aa54f2b94d1f1bef9ed546f P cd75a17ab2604397adab03bb8b5fd75c [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:19:20.532191  9350 raft_consensus.cc:697] T 7c44c4849aa54f2b94d1f1bef9ed546f P cd75a17ab2604397adab03bb8b5fd75c [term 8 LEADER]: Becoming Leader. State: Replica: cd75a17ab2604397adab03bb8b5fd75c, State: Running, Role: LEADER
I20260709 13:19:20.533793  9350 consensus_queue.cc:237] T 7c44c4849aa54f2b94d1f1bef9ed546f P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:20.537663  6877 raft_consensus.cc:2468] T de3186201e1a40d0b335eeb8b4e256e0 P cd75a17ab2604397adab03bb8b5fd75c [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 7.
I20260709 13:19:20.499600  6879 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53416 (request call id 2310) took 2292 ms. Trace:
I20260709 13:19:20.558429  6879 rpcz_store.cc:276] 0709 13:19:18.206805 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:18.294995 (+ 88190us) service_pool.cc:224] Handling call
0709 13:19:18.320158 (+ 25163us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:20.399829 (+2079671us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:20.499219 (+ 99390us) spinlock_profiling.cc:243] Waited 2.08 s on lock 0x7b54000a5ad4. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f9aae01 00007fcc0f9a983e 00007fcc1496e419 00007fcc0dee5bd4 00007fcc0dee5b62 00007fcc0dee5a91 00007fcc0dee5a0c 00007fcc0dee4cc2 00007fcc0dce548c 00007fcc0dce48c6
0709 13:19:20.499493 (+   274us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4778832768}
W20260709 13:19:20.549741  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 51572.4us
W20260709 13:19:20.565209  7468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 207847us
W20260709 13:19:20.567279  7468 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:20.567934  7468 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:20.580394  7469 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:20.547467  9212 raft_consensus.cc:493] T f58dc08b12a2494bb9a1372837970ca2 P b7ab4784c7344b939bc36f639286f377 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:20.620645  9212 raft_consensus.cc:515] T f58dc08b12a2494bb9a1372837970ca2 P b7ab4784c7344b939bc36f639286f377 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:20.620759  9125 raft_consensus.cc:2955] T 24ee15416e3145beaa1b8183453729a3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 6 LEADER]: Committing config change with OpId 6.7: config changed from index 3 to 7, VOTER b7ab4784c7344b939bc36f639286f377 (127.5.126.66) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } } }
I20260709 13:19:20.623003  9212 leader_election.cc:290] T f58dc08b12a2494bb9a1372837970ca2 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:20.628400  6798 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:32976 (request call id 2221) took 2551 ms. Trace:
I20260709 13:19:20.557683  9231 raft_consensus.cc:493] T d33d5ee8ef6f415593d8df52063161ad P b7ab4784c7344b939bc36f639286f377 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:20.630930  7467 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:20.633092  6879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a92dd554674067a83a9cb68c4773f2" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:19:20.641584  9414 raft_consensus.cc:493] T dbdf895bba214ff68685a24fd17dfb5d P cd75a17ab2604397adab03bb8b5fd75c [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:19:20.641851  9344 raft_consensus.cc:493] T ce4f062dcd314d43a63ca74067cb5ee3 P cd75a17ab2604397adab03bb8b5fd75c [term 6 FOLLOWER]: Starting pre-election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:19:20.642319  9414 raft_consensus.cc:515] T dbdf895bba214ff68685a24fd17dfb5d P cd75a17ab2604397adab03bb8b5fd75c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:20.642426  9344 raft_consensus.cc:515] T ce4f062dcd314d43a63ca74067cb5ee3 P cd75a17ab2604397adab03bb8b5fd75c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } attrs { replace: true } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:19:20.644222  9357 raft_consensus.cc:493] T 3d65025eea89441290d85dd053810e31 P cd75a17ab2604397adab03bb8b5fd75c [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:19:20.645263  6879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f00a2e87e56452083b759f60d461ee3" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:19:20.646127  6727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4b8bd455d5a47c18a1380839c6e0d61" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:19:20.646947  6879 raft_consensus.cc:2410] T 4f00a2e87e56452083b759f60d461ee3 P cd75a17ab2604397adab03bb8b5fd75c [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ba59cc884714e8aa5f3f0ecaed84cbb for term 8 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 13:19:20.647907  6805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a92dd554674067a83a9cb68c4773f2" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:19:20.649194  6727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "427c124d773f483294511e80fe340075" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:19:20.652545  6804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "427c124d773f483294511e80fe340075" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:19:20.653432  6804 raft_consensus.cc:2468] T 427c124d773f483294511e80fe340075 P b7ab4784c7344b939bc36f639286f377 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 5.
I20260709 13:19:20.651769  6725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7887766dc6784fcaa42b35c05fea7a99" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:19:20.652545  6806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4b8bd455d5a47c18a1380839c6e0d61" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:19:20.654681  6806 raft_consensus.cc:3060] T f4b8bd455d5a47c18a1380839c6e0d61 P b7ab4784c7344b939bc36f639286f377 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:20.655146  6731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d33d5ee8ef6f415593d8df52063161ad" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:19:20.655943  6731 raft_consensus.cc:2393] T d33d5ee8ef6f415593d8df52063161ad P ccd8a4c3bfe3413cb2ae219b09aea832 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c in current term 7: Already voted for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in this term.
I20260709 13:19:20.655879  6726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e326172347f45e99a0d482b5d8ef768" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:19:20.658485  6731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a485a995abc4807b6e511e45419f737" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:19:20.660421  6800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8cee0accdb8499c86d4414b72565a38" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:19:20.660682  6724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de3186201e1a40d0b335eeb8b4e256e0" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:19:20.661638  6724 raft_consensus.cc:2368] T de3186201e1a40d0b335eeb8b4e256e0 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c for earlier term 6. Current term is 7.
I20260709 13:19:20.659796  6799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bf4668eeb70467fb3dc5a0289233b3c" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:19:20.662600  6799 raft_consensus.cc:2393] T 1bf4668eeb70467fb3dc5a0289233b3c P b7ab4784c7344b939bc36f639286f377 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c in current term 6: Already voted for candidate b7ab4784c7344b939bc36f639286f377 in this term.
I20260709 13:19:20.661248  6800 raft_consensus.cc:2468] T d8cee0accdb8499c86d4414b72565a38 P b7ab4784c7344b939bc36f639286f377 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 6.
I20260709 13:19:20.666553  6801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7887766dc6784fcaa42b35c05fea7a99" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:19:20.669946  6732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4db81d9d329422bb3b4160ca4ac2d1d" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:19:20.674513  6730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4275cf08e63345f993bce8664eada830" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:19:20.677137  9338 raft_consensus.cc:3055] T 7c44c4849aa54f2b94d1f1bef9ed546f P b7ab4784c7344b939bc36f639286f377 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:19:20.677597  9338 raft_consensus.cc:740] T 7c44c4849aa54f2b94d1f1bef9ed546f P b7ab4784c7344b939bc36f639286f377 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
I20260709 13:19:20.678448  9338 consensus_queue.cc:260] T 7c44c4849aa54f2b94d1f1bef9ed546f P b7ab4784c7344b939bc36f639286f377 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:20.679528  9338 raft_consensus.cc:3060] T 7c44c4849aa54f2b94d1f1bef9ed546f P b7ab4784c7344b939bc36f639286f377 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:20.684509  9071 raft_consensus.cc:493] T 3a485a995abc4807b6e511e45419f737 P b7ab4784c7344b939bc36f639286f377 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:20.685150  9071 raft_consensus.cc:515] T 3a485a995abc4807b6e511e45419f737 P b7ab4784c7344b939bc36f639286f377 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:20.687469  9071 leader_election.cc:290] T 3a485a995abc4807b6e511e45419f737 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:20.690378  9222 raft_consensus.cc:3060] T 3fa34c08b205435dba97346991aa1f92 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:20.694846  6804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4db81d9d329422bb3b4160ca4ac2d1d" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:19:20.695785  6804 raft_consensus.cc:2393] T c4db81d9d329422bb3b4160ca4ac2d1d P b7ab4784c7344b939bc36f639286f377 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c in current term 7: Already voted for candidate b7ab4784c7344b939bc36f639286f377 in this term.
W20260709 13:19:20.696142  7467 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:20.696805  6804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4275cf08e63345f993bce8664eada830" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:19:20.697472  6804 raft_consensus.cc:3060] T 4275cf08e63345f993bce8664eada830 P b7ab4784c7344b939bc36f639286f377 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:20.701973  6879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb7fa124c3bf4ef9ab65a407cb008441" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:19:20.702926  6879 raft_consensus.cc:2468] T bb7fa124c3bf4ef9ab65a407cb008441 P cd75a17ab2604397adab03bb8b5fd75c [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in term 8.
I20260709 13:19:20.704226  6806 raft_consensus.cc:2468] T f4b8bd455d5a47c18a1380839c6e0d61 P b7ab4784c7344b939bc36f639286f377 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 6.
I20260709 13:19:20.705410  6806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a485a995abc4807b6e511e45419f737" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:19:20.650257  8855 raft_consensus.cc:493] T bb3d8792045a4583ae2e965b1350a5b4 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:20.634435  9231 raft_consensus.cc:515] T d33d5ee8ef6f415593d8df52063161ad P b7ab4784c7344b939bc36f639286f377 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:20.706296  6806 raft_consensus.cc:2468] T 3a485a995abc4807b6e511e45419f737 P b7ab4784c7344b939bc36f639286f377 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 5.
I20260709 13:19:20.649961  9422 raft_consensus.cc:493] T 2c240553ce044eedb41541d72b9475d7 P b7ab4784c7344b939bc36f639286f377 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:20.714084  6801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e326172347f45e99a0d482b5d8ef768" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:19:20.715314  6879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce4f062dcd314d43a63ca74067cb5ee3" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:19:20.716233  6879 raft_consensus.cc:2468] T ce4f062dcd314d43a63ca74067cb5ee3 P cd75a17ab2604397adab03bb8b5fd75c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in term 6.
I20260709 13:19:20.714929  6801 raft_consensus.cc:2468] T 9e326172347f45e99a0d482b5d8ef768 P b7ab4784c7344b939bc36f639286f377 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 5.
I20260709 13:19:20.725303  6806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d33d5ee8ef6f415593d8df52063161ad" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:19:20.703646  9125 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.ChangeConfig from 127.0.0.1:56392 (request call id 2) took 2413 ms. Trace:
I20260709 13:19:20.650782  9357 raft_consensus.cc:515] T 3d65025eea89441290d85dd053810e31 P cd75a17ab2604397adab03bb8b5fd75c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
W20260709 13:19:20.718971  9426 log.cc:927] Time spent T bb7fa124c3bf4ef9ab65a407cb008441 P 7ba59cc884714e8aa5f3f0ecaed84cbb: Append to log took a long time: real 0.092s	user 0.001s	sys 0.000s
I20260709 13:19:20.669076  9273 raft_consensus.cc:493] T e31b9971c15848dea59d4d4130141d9e P cd75a17ab2604397adab03bb8b5fd75c [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:19:20.735414  6801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de3186201e1a40d0b335eeb8b4e256e0" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:19:20.708169  8855 raft_consensus.cc:515] T bb3d8792045a4583ae2e965b1350a5b4 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:19:20.733914  6879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe20b4b48823486ca3b9c648db6ce8aa" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:19:20.747442  6879 raft_consensus.cc:2468] T fe20b4b48823486ca3b9c648db6ce8aa P cd75a17ab2604397adab03bb8b5fd75c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in term 4.
I20260709 13:19:20.723469  9236 raft_consensus.cc:3055] T 8c7f33e544204fbaac4078e3e83bbf4e P b7ab4784c7344b939bc36f639286f377 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:19:20.753283  6804 raft_consensus.cc:2468] T 4275cf08e63345f993bce8664eada830 P b7ab4784c7344b939bc36f639286f377 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 7.
I20260709 13:19:20.755820  6801 raft_consensus.cc:2393] T de3186201e1a40d0b335eeb8b4e256e0 P b7ab4784c7344b939bc36f639286f377 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c in current term 6: Already voted for candidate b7ab4784c7344b939bc36f639286f377 in this term.
I20260709 13:19:20.763090  6879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4b8bd455d5a47c18a1380839c6e0d61" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:19:20.763273  6806 raft_consensus.cc:2468] T d33d5ee8ef6f415593d8df52063161ad P b7ab4784c7344b939bc36f639286f377 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 7.
I20260709 13:19:20.763927  6879 raft_consensus.cc:2393] T f4b8bd455d5a47c18a1380839c6e0d61 P cd75a17ab2604397adab03bb8b5fd75c [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7ab4784c7344b939bc36f639286f377 in current term 6: Already voted for candidate cd75a17ab2604397adab03bb8b5fd75c in this term.
I20260709 13:19:20.715369  9422 raft_consensus.cc:515] T 2c240553ce044eedb41541d72b9475d7 P b7ab4784c7344b939bc36f639286f377 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:20.767866  9344 leader_election.cc:290] T ce4f062dcd314d43a63ca74067cb5ee3 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:19:20.769354  9259 leader_election.cc:290] T de3186201e1a40d0b335eeb8b4e256e0 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 7 election: Requested vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
W20260709 13:19:20.772634  6845 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:20.772812  9231 leader_election.cc:290] T d33d5ee8ef6f415593d8df52063161ad P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:20.773267  9415 raft_consensus.cc:493] T e77e330a82df4b43a745d57a68f6f057 P cd75a17ab2604397adab03bb8b5fd75c [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:20.773756  9424 raft_consensus.cc:493] T f03d0dbf16864ca4bc1bb5e4c0334c0f P cd75a17ab2604397adab03bb8b5fd75c [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:19:20.774268  6880 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53406 (request call id 1504) took 2127 ms. Trace:
I20260709 13:19:20.773775  9415 raft_consensus.cc:515] T e77e330a82df4b43a745d57a68f6f057 P cd75a17ab2604397adab03bb8b5fd75c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } }
I20260709 13:19:20.738289  9414 leader_election.cc:290] T dbdf895bba214ff68685a24fd17dfb5d P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:19:20.755383  9236 raft_consensus.cc:740] T 8c7f33e544204fbaac4078e3e83bbf4e P b7ab4784c7344b939bc36f639286f377 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
I20260709 13:19:20.774652  6880 rpcz_store.cc:276] 0709 13:19:18.646801 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:18.938013 (+291212us) service_pool.cc:224] Handling call
0709 13:19:18.938249 (+   236us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:19.088748 (+150499us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:19:19.102208 (+ 13460us) log.cc:844] Serialized 14 byte log entry
0709 13:19:19.139080 (+ 36872us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:19.139139 (+    59us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:19:19.139195 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:19.709906 (+570711us) spinlock_profiling.cc:243] Waited 1.66 ms on lock 0x7b4400022b4c. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0c745db1 00007fcc0c7e3c85 00007fcc0c7e46a2 00007fcc0f5561db 00007fcc0f551aaf 00007fcc0f54586e 00007fcc0f544bb6 00007fcc0f5447d8 00007fcc0f54e221 00007fcc0f54e1d9 00007fcc0f54e169
0709 13:19:20.447048 (+737142us) spinlock_profiling.cc:243] Waited 5.29 ms on lock 0x7b18003c80e0. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc15785de1 00007fcc157925b1 00007fcc0c88b2a6 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f9aae01 00007fcc0f9a983e 00007fcc1496e419
0709 13:19:20.774042 (+326994us) spinlock_profiling.cc:243] Waited 150 ms on lock 0x7b54000d1e54. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f9aae01 00007fcc0f9a983e 00007fcc1496e419 00007fcc0dee5bd4 00007fcc0dee5b62 00007fcc0dee5a91 00007fcc0dee5a0c 00007fcc0dee4cc2 00007fcc0dce548c 00007fcc0dce48c6
0709 13:19:20.774081 (+    39us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:20.774212 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":17242,"prepare.run_cpu_time_us":62,"prepare.run_wall_time_us":2813,"raft.queue_time_us":109,"raft.run_cpu_time_us":98,"raft.run_wall_time_us":100,"spinlock_wait_cycles":361413632,"thread_start_us":36274,"threads_started":1,"wal-append.queue_time_us":95892,"wal-append.run_cpu_time_us":5210,"wal-append.run_wall_time_us":1549599}
W20260709 13:19:20.783135  7468 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:20.784474  9435 log.cc:927] Time spent T 90d42e216d9741e190bca19a781291fd P b7ab4784c7344b939bc36f639286f377: Append to log took a long time: real 0.073s	user 0.001s	sys 0.000s
W20260709 13:19:20.817148  7469 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:20.931504  6732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "404190ce4ce94cecbfcb6ea9d1dd8626" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:19:20.934841  6725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce4f062dcd314d43a63ca74067cb5ee3" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:19:20.947608  9206 raft_consensus.cc:493] T f09c2a98de1a4decabd0ff900dd44caa P b7ab4784c7344b939bc36f639286f377 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:20.952772  9236 consensus_queue.cc:260] T 8c7f33e544204fbaac4078e3e83bbf4e P b7ab4784c7344b939bc36f639286f377 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:20.953141  9206 raft_consensus.cc:515] T f09c2a98de1a4decabd0ff900dd44caa P b7ab4784c7344b939bc36f639286f377 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:20.953450  6806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb7fa124c3bf4ef9ab65a407cb008441" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:19:20.957264  6879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1704639a875409b9959353527b3fd68" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:19:20.971812  6879 raft_consensus.cc:3060] T a1704639a875409b9959353527b3fd68 P cd75a17ab2604397adab03bb8b5fd75c [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:20.767879  9422 leader_election.cc:290] T 2c240553ce044eedb41541d72b9475d7 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:20.751019  9273 raft_consensus.cc:515] T e31b9971c15848dea59d4d4130141d9e P cd75a17ab2604397adab03bb8b5fd75c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
W20260709 13:19:21.011116  7468 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:20.780216  9349 raft_consensus.cc:493] T f5be3a11b23d4ea9b08300a2789821c7 P cd75a17ab2604397adab03bb8b5fd75c [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:19:20.812420  9344 raft_consensus.cc:493] T f3f9c2e2bf644115957398fe4c9459db P cd75a17ab2604397adab03bb8b5fd75c [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:19:20.819527  9231 raft_consensus.cc:493] T 713b5728a197487c9300b310ab94e5a3 P b7ab4784c7344b939bc36f639286f377 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:21.010949  6804 raft_consensus.cc:1240] T 7ba5dac66ab5497e9e336f2a3c28cda5 P b7ab4784c7344b939bc36f639286f377 [term 8 LEADER]: Rejecting Update request from peer 7ba59cc884714e8aa5f3f0ecaed84cbb for earlier term 7. Current term is 8. Ops: [7.8-7.8]
W20260709 13:19:21.041368  7467 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:21.062667  6773 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:21.091765  6773 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:20.955022  9432 log.cc:927] Time spent T 7c37d41cd9164c15a6826ca62a851a69 P cd75a17ab2604397adab03bb8b5fd75c: Append to log took a long time: real 0.190s	user 0.000s	sys 0.000s
I20260709 13:19:21.088449  6732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe20b4b48823486ca3b9c648db6ce8aa" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
W20260709 13:19:21.098151  7467 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:21.098428  6732 raft_consensus.cc:2468] T fe20b4b48823486ca3b9c648db6ce8aa P ccd8a4c3bfe3413cb2ae219b09aea832 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in term 4.
I20260709 13:19:20.955456  9206 leader_election.cc:290] T f09c2a98de1a4decabd0ff900dd44caa P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:21.096505  6806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "404190ce4ce94cecbfcb6ea9d1dd8626" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:19:21.103513  6806 raft_consensus.cc:2468] T 404190ce4ce94cecbfcb6ea9d1dd8626 P b7ab4784c7344b939bc36f639286f377 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in term 7.
I20260709 13:19:20.955691  9415 leader_election.cc:290] T e77e330a82df4b43a745d57a68f6f057 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391)
I20260709 13:19:20.966419  9236 raft_consensus.cc:3060] T 8c7f33e544204fbaac4078e3e83bbf4e P b7ab4784c7344b939bc36f639286f377 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:19:21.080103  7468 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:21.111686  6804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce4f062dcd314d43a63ca74067cb5ee3" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:19:21.112984  6804 raft_consensus.cc:2468] T ce4f062dcd314d43a63ca74067cb5ee3 P b7ab4784c7344b939bc36f639286f377 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in term 6.
I20260709 13:19:20.774586  9424 raft_consensus.cc:515] T f03d0dbf16864ca4bc1bb5e4c0334c0f P cd75a17ab2604397adab03bb8b5fd75c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:21.103075  9231 raft_consensus.cc:515] T 713b5728a197487c9300b310ab94e5a3 P b7ab4784c7344b939bc36f639286f377 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:20.629076  6798 rpcz_store.cc:276] 0709 13:19:18.077478 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:18.935424 (+857946us) service_pool.cc:224] Handling call
0709 13:19:18.935708 (+   284us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:19.802036 (+866328us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:19:20.447659 (+645623us) log.cc:844] Serialized 14 byte log entry
0709 13:19:20.626994 (+179335us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:20.627068 (+    74us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:19:20.628010 (+   942us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:20.628113 (+   103us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:20.628318 (+   205us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":939915,"prepare.queue_time_us":825766,"prepare.run_cpu_time_us":43,"prepare.run_wall_time_us":1107,"raft.queue_time_us":866522,"raft.run_cpu_time_us":255,"raft.run_wall_time_us":8826,"thread_start_us":746337,"threads_started":2}
I20260709 13:19:21.139272  9424 leader_election.cc:290] T f03d0dbf16864ca4bc1bb5e4c0334c0f P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:19:21.139307  9231 leader_election.cc:290] T 713b5728a197487c9300b310ab94e5a3 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:21.115316  9357 leader_election.cc:290] T 3d65025eea89441290d85dd053810e31 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:19:21.119294  6799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8cee0accdb8499c86d4414b72565a38" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:19:19.884758  6807 rpcz_store.cc:276] 0709 13:19:18.765055 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:19.050491 (+285436us) service_pool.cc:224] Handling call
0709 13:19:19.074912 (+ 24421us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:19.075181 (+   269us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:19:19.083670 (+  8489us) log.cc:844] Serialized 14 byte log entry
0709 13:19:19.876590 (+792920us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:19.876655 (+    65us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:19:19.876716 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:19.876793 (+    77us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:19.876921 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":440594,"prepare.queue_time_us":8416,"prepare.run_cpu_time_us":41,"prepare.run_wall_time_us":43,"raft.queue_time_us":449379,"thread_start_us":351864,"threads_started":1,"wal-append.queue_time_us":358806}
I20260709 13:19:21.128291  6873 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53416 (request call id 2320) took 1827 ms. Trace:
I20260709 13:19:21.145354  6873 rpcz_store.cc:276] 0709 13:19:19.301135 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:19.583850 (+282715us) service_pool.cc:224] Handling call
0709 13:19:19.584260 (+   410us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:20.182286 (+598026us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:21.127986 (+945700us) spinlock_profiling.cc:243] Waited 594 ms on lock 0x7b54000b3bd4. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f9aae01 00007fcc0f9a983e 00007fcc1496e419 00007fcc0dee5bd4 00007fcc0dee5b62 00007fcc0dee5a91 00007fcc0dee5a0c 00007fcc0dee4cc2 00007fcc0dce548c 00007fcc0dce48c6
0709 13:19:21.128226 (+   240us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1367313664}
I20260709 13:19:21.129040  8855 leader_election.cc:290] T bb3d8792045a4583ae2e965b1350a5b4 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:21.090063  9349 raft_consensus.cc:515] T f5be3a11b23d4ea9b08300a2789821c7 P cd75a17ab2604397adab03bb8b5fd75c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:20.733435  9125 rpcz_store.cc:276] 0709 13:19:18.246785 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:18.247020 (+   235us) service_pool.cc:224] Handling call
0709 13:19:18.307448 (+ 60428us) log.cc:844] Serialized 494 byte log entry
0709 13:19:19.707572 (+1400124us) spinlock_profiling.cc:243] Waited 3.35 ms on lock 0x7b18000ac6c0. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc15785de1 00007fcc157925b1 00007fcc0c8bd3f3 00007fcc0c8bf7c1 00007fcc0c8bf779 00007fcc0c8bf709 00007fcc0c8bf6d1 00007fcc0c8be9cd 000000000038f354 000000000038f199 00007fcc0c8a083a
0709 13:19:20.660441 (+952869us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":911,"raft.queue_time_us":4321,"raft.run_cpu_time_us":1136,"raft.run_wall_time_us":84734,"spinlock_wait_cycles":7711488}
I20260709 13:19:21.133199  6732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3d8792045a4583ae2e965b1350a5b4" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:19:21.131317  6806 raft_consensus.cc:2955] T 1528ab62b6fe4e3099d08f141afee116 P b7ab4784c7344b939bc36f639286f377 [term 5 FOLLOWER]: Committing config change with OpId 5.6: config changed from index 3 to 6, VOTER cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } } }
W20260709 13:19:21.134681  9390 consensus_meta.cc:287] T 1528ab62b6fe4e3099d08f141afee116 P 7ba59cc884714e8aa5f3f0ecaed84cbb: Time spent flushing consensus metadata: real 0.618s	user 0.006s	sys 0.004s
I20260709 13:19:21.154472  7466 leader_election.cc:304] T 404190ce4ce94cecbfcb6ea9d1dd8626 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, b7ab4784c7344b939bc36f639286f377; no voters: 
I20260709 13:19:21.171809  6879 raft_consensus.cc:2468] T a1704639a875409b9959353527b3fd68 P cd75a17ab2604397adab03bb8b5fd75c [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 6.
W20260709 13:19:21.174098  7469 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:21.097983  9344 raft_consensus.cc:515] T f3f9c2e2bf644115957398fe4c9459db P cd75a17ab2604397adab03bb8b5fd75c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:21.203732  6799 raft_consensus.cc:2468] T d8cee0accdb8499c86d4414b72565a38 P b7ab4784c7344b939bc36f639286f377 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in term 6.
W20260709 13:19:21.205961  6697 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 188401us
I20260709 13:19:21.166081  9424 raft_consensus.cc:493] T 7ba5dac66ab5497e9e336f2a3c28cda5 P cd75a17ab2604397adab03bb8b5fd75c [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:21.190541  6873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8cee0accdb8499c86d4414b72565a38" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:19:21.220481  6873 raft_consensus.cc:2393] T d8cee0accdb8499c86d4414b72565a38 P cd75a17ab2604397adab03bb8b5fd75c [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in current term 6: Already voted for candidate cd75a17ab2604397adab03bb8b5fd75c in this term.
W20260709 13:19:21.225464  7498 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50742 (request call id 311) took 4406 ms (client timeout 1554 ms). Trace:
W20260709 13:19:21.226046  7498 rpcz_store.cc:269] 0709 13:19:16.819043 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:16.820391 (+  1348us) service_pool.cc:224] Handling call
0709 13:19:17.623075 (+802684us) spinlock_profiling.cc:243] Waited 4.99 ms on lock 0x7b5800123f98. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0c745db1 00007fcc0c885b71 00007fcc0c885a22 00007fcc1579ec09 00007fcc148f8ee0 00007fcc149c20ab 00007fcc149c2131 00007fcc149700a0 00007fcc1496f984 00007fcc0deea6d4 00007fcc0deea662
0709 13:19:21.225124 (+3602049us) spinlock_profiling.cc:243] Waited 1.86 s on lock 0x7b5400538ed4. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f9ae2fa 00007fcc1496fb17 00007fcc0deea6d4 00007fcc0deea662 00007fcc0deea591 00007fcc0deea50c 00007fcc0dee97c2 00007fcc0dce548c 00007fcc0dce48c6 00007fcc0dce426f
0709 13:19:21.225306 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4290279936}
I20260709 13:19:21.220582  6879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f03d0dbf16864ca4bc1bb5e4c0334c0f" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:19:21.228420  6879 raft_consensus.cc:2468] T f03d0dbf16864ca4bc1bb5e4c0334c0f P cd75a17ab2604397adab03bb8b5fd75c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 5.
I20260709 13:19:21.190407  8855 raft_consensus.cc:2804] T 404190ce4ce94cecbfcb6ea9d1dd8626 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 13:19:21.236644  6845 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:21.254074  6879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8cee0accdb8499c86d4414b72565a38" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
W20260709 13:19:21.256632  7468 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:21.267987  6879 raft_consensus.cc:2393] T d8cee0accdb8499c86d4414b72565a38 P cd75a17ab2604397adab03bb8b5fd75c [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in current term 6: Already voted for candidate cd75a17ab2604397adab03bb8b5fd75c in this term.
W20260709 13:19:21.273684  6805 consensus_meta.cc:287] T 07a92dd554674067a83a9cb68c4773f2 P b7ab4784c7344b939bc36f639286f377: Time spent flushing consensus metadata: real 0.625s	user 0.011s	sys 0.000s
I20260709 13:19:21.295694  6805 raft_consensus.cc:2468] T 07a92dd554674067a83a9cb68c4773f2 P b7ab4784c7344b939bc36f639286f377 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 6.
I20260709 13:19:21.314282  9415 raft_consensus.cc:493] T 3411566abe2d4c9bb4b2adfdd05e6f17 P cd75a17ab2604397adab03bb8b5fd75c [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:19:21.314436  9050 raft_consensus.cc:493] T 07a92dd554674067a83a9cb68c4773f2 P b7ab4784c7344b939bc36f639286f377 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:21.315416  9050 raft_consensus.cc:3060] T 07a92dd554674067a83a9cb68c4773f2 P b7ab4784c7344b939bc36f639286f377 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:21.315358  9415 raft_consensus.cc:515] T 3411566abe2d4c9bb4b2adfdd05e6f17 P cd75a17ab2604397adab03bb8b5fd75c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:21.319120  9415 leader_election.cc:290] T 3411566abe2d4c9bb4b2adfdd05e6f17 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:19:21.223492  9424 raft_consensus.cc:515] T 7ba5dac66ab5497e9e336f2a3c28cda5 P cd75a17ab2604397adab03bb8b5fd75c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
W20260709 13:19:21.263415  9222 consensus_meta.cc:287] T 3fa34c08b205435dba97346991aa1f92 P 7ba59cc884714e8aa5f3f0ecaed84cbb: Time spent flushing consensus metadata: real 0.572s	user 0.014s	sys 0.000s
I20260709 13:19:21.346876  9079 leader_election.cc:290] T 30e88460611e47b2ba16a46a30b5f416 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:21.322328  8855 raft_consensus.cc:493] T 404190ce4ce94cecbfcb6ea9d1dd8626 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 7 FOLLOWER]: Starting leader election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:19:21.411958  8855 raft_consensus.cc:3060] T 404190ce4ce94cecbfcb6ea9d1dd8626 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:19:21.424695  9417 log.cc:927] Time spent T 1528ab62b6fe4e3099d08f141afee116 P b7ab4784c7344b939bc36f639286f377: Append to log took a long time: real 0.068s	user 0.001s	sys 0.000s
W20260709 13:19:21.481173  7467 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:21.487107  7467 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:22.222738  9447 raft_consensus.cc:493] T 3fa34c08b205435dba97346991aa1f92 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:22.224848  9447 raft_consensus.cc:515] T 3fa34c08b205435dba97346991aa1f92 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
W20260709 13:19:22.005117  6847 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.956s	user 0.022s	sys 0.060s
W20260709 13:19:22.114151  7467 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:22.009266  6845 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:22.128508  7469 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:22.000432  6730 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.949s	user 0.008s	sys 0.016s
I20260709 13:19:22.006963  6873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d9def8b32fd443aa94ab1420b06837b" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:19:22.128800  6616 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 24ee15416e3145beaa1b8183453729a3 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 5)
W20260709 13:19:21.753719  7468 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:22.253654  7469 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:21.693533  9294 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.569s	user 0.011s	sys 0.042s
W20260709 13:19:22.255265  9294 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.131s	user 0.018s	sys 0.066s
I20260709 13:19:21.731360  9050 raft_consensus.cc:515] T 07a92dd554674067a83a9cb68c4773f2 P b7ab4784c7344b939bc36f639286f377 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
W20260709 13:19:22.252053  6847 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.203s	user 0.030s	sys 0.062s
W20260709 13:19:22.258345  7467 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:21.759496  9390 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.563s	user 0.003s	sys 0.016s
I20260709 13:19:22.103370  6879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a734b5ab7834e05a8c422208acc58b1" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
W20260709 13:19:21.677414  9259 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.565s	user 0.006s	sys 0.045s
W20260709 13:19:22.259464  6730 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.208s	user 0.011s	sys 0.025s
I20260709 13:19:22.261776  9349 leader_election.cc:290] T f5be3a11b23d4ea9b08300a2789821c7 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:19:22.155813  9344 leader_election.cc:290] T f3f9c2e2bf644115957398fe4c9459db P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:19:22.095873  9450 raft_consensus.cc:493] T ab432e62819d499eaaf3dd55481dd930 P b7ab4784c7344b939bc36f639286f377 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
W20260709 13:19:22.000448  6697 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 790919us
I20260709 13:19:21.560010  9424 leader_election.cc:290] T 7ba5dac66ab5497e9e336f2a3c28cda5 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
W20260709 13:19:22.270272  7468 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:22.270426  6873 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53406 (request call id 1511) took 1626 ms. Trace:
I20260709 13:19:21.592592  9273 leader_election.cc:290] T e31b9971c15848dea59d4d4130141d9e P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
W20260709 13:19:22.276070  6697 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:22.277540  7468 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:22.272083  6873 rpcz_store.cc:276] 0709 13:19:20.642567 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:21.230958 (+588391us) service_pool.cc:224] Handling call
0709 13:19:22.268621 (+1037663us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:19:22.277206  9390 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.072s	user 0.012s	sys 0.016s
I20260709 13:19:22.280120  6879 raft_consensus.cc:2393] T 7a734b5ab7834e05a8c422208acc58b1 P cd75a17ab2604397adab03bb8b5fd75c [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate b7ab4784c7344b939bc36f639286f377 in current term 7: Already voted for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in this term.
W20260709 13:19:22.275418  6616 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.5.126.68:45071, user_credentials={real_user=slave}} blocked reactor thread for 146872us
I20260709 13:19:22.286562  6879 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53406 (request call id 1512) took 1643 ms. Trace:
W20260709 13:19:22.289927  9259 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.160s	user 0.016s	sys 0.063s
I20260709 13:19:22.287276  9442 raft_consensus.cc:493] T bb3d8792045a4583ae2e965b1350a5b4 P cd75a17ab2604397adab03bb8b5fd75c [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:22.293924  6873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ba5dac66ab5497e9e336f2a3c28cda5" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:19:22.293462  9442 raft_consensus.cc:515] T bb3d8792045a4583ae2e965b1350a5b4 P cd75a17ab2604397adab03bb8b5fd75c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:19:22.288587  6879 rpcz_store.cc:276] 0709 13:19:20.642808 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:21.328519 (+685711us) service_pool.cc:224] Handling call
0709 13:19:22.285356 (+956837us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:22.282748  9424 raft_consensus.cc:493] T bd6869f07b5a4885a0b99fbe60c3b175 P cd75a17ab2604397adab03bb8b5fd75c [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
W20260709 13:19:22.296725  6773 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:22.297793  9349 raft_consensus.cc:493] T 3fa34c08b205435dba97346991aa1f92 P cd75a17ab2604397adab03bb8b5fd75c [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:22.301249  9349 raft_consensus.cc:515] T 3fa34c08b205435dba97346991aa1f92 P cd75a17ab2604397adab03bb8b5fd75c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:19:22.333047  9344 raft_consensus.cc:493] T 24ee15416e3145beaa1b8183453729a3 P cd75a17ab2604397adab03bb8b5fd75c [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:22.334223  9344 raft_consensus.cc:515] T 24ee15416e3145beaa1b8183453729a3 P cd75a17ab2604397adab03bb8b5fd75c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } attrs { replace: true } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:19:22.338335  9390 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.ChangeConfig from 127.0.0.1:56392 (request call id 1) took 6286 ms. Trace:
I20260709 13:19:22.338842  9390 rpcz_store.cc:276] 0709 13:19:16.052318 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:16.082398 (+ 30080us) service_pool.cc:224] Handling call
0709 13:19:17.794512 (+1712114us) spinlock_profiling.cc:243] Waited 10.3 ms on lock 0x7b5800123f98. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0c745db1 00007fcc0c885b71 00007fcc0c885a22 00007fcc1579ec09 00007fcc148f8ee0 00007fcc149c20ab 00007fcc149c2131 00007fcc149841c0 00007fcc149709d9 00007fcc14970442 00007fcc0deecc54
0709 13:19:17.860802 (+ 66290us) spinlock_profiling.cc:243] Waited 60.1 ms on lock 0x7b580050dbd0. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f9060aa 00007fcc0f988447 00007fcc0f9a570a 00007fcc0f9a676a 00007fcc0f9a591b 00007fcc0f9b103c 00007fcc0f9b06b3 00007fcc0f9a89fa 00007fcc149704c9 00007fcc0deecc54
0709 13:19:18.011023 (+150221us) log.cc:844] Serialized 494 byte log entry
0709 13:19:18.939070 (+928047us) spinlock_profiling.cc:243] Waited 3.6 ms on lock 0x7b54005b1920. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f923142 00007fcc0f903eaa 00007fcc0f90ad53 00007fcc0f90acd9 00007fcc0f90ac69 00007fcc0f90ac31 00007fcc0f909dfd 000000000038f354 000000000038f199 00007fcc0c8bd475
0709 13:19:22.338161 (+3399091us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":241,"raft.run_cpu_time_us":4220,"raft.run_wall_time_us":705438,"spinlock_wait_cycles":170049024,"thread_start_us":260615,"threads_started":1,"wal-append.queue_time_us":361756,"wal-append.run_cpu_time_us":4167,"wal-append.run_wall_time_us":1488608}
I20260709 13:19:22.303882  9273 raft_consensus.cc:493] T 4b8cacb381b746da8d0049b0a83b41dd P cd75a17ab2604397adab03bb8b5fd75c [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:22.304374  9424 raft_consensus.cc:515] T bd6869f07b5a4885a0b99fbe60c3b175 P cd75a17ab2604397adab03bb8b5fd75c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:22.347548  9273 raft_consensus.cc:515] T 4b8cacb381b746da8d0049b0a83b41dd P cd75a17ab2604397adab03bb8b5fd75c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:19:22.307375  9349 leader_election.cc:290] T 3fa34c08b205435dba97346991aa1f92 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:19:22.349278  9349 raft_consensus.cc:493] T 2c240553ce044eedb41541d72b9475d7 P cd75a17ab2604397adab03bb8b5fd75c [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:22.350154  9349 raft_consensus.cc:515] T 2c240553ce044eedb41541d72b9475d7 P cd75a17ab2604397adab03bb8b5fd75c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
W20260709 13:19:22.354600  6773 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:22.352305  8347 raft_consensus.cc:493] T 3411566abe2d4c9bb4b2adfdd05e6f17 P b7ab4784c7344b939bc36f639286f377 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:19:22.306993  9442 leader_election.cc:290] T bb3d8792045a4583ae2e965b1350a5b4 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:19:22.291584  9450 raft_consensus.cc:515] T ab432e62819d499eaaf3dd55481dd930 P b7ab4784c7344b939bc36f639286f377 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:22.370688  8574 raft_consensus.cc:493] T 95a75bfe094d4bdc963aba3f08dfcd25 P b7ab4784c7344b939bc36f639286f377 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:19:22.371202  6616 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 1528ab62b6fe4e3099d08f141afee116 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:19:22.371734  8574 raft_consensus.cc:515] T 95a75bfe094d4bdc963aba3f08dfcd25 P b7ab4784c7344b939bc36f639286f377 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:22.372646  9424 leader_election.cc:290] T bd6869f07b5a4885a0b99fbe60c3b175 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
W20260709 13:19:22.372730  7466 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 72074.7us
I20260709 13:19:22.374202  8347 raft_consensus.cc:515] T 3411566abe2d4c9bb4b2adfdd05e6f17 P b7ab4784c7344b939bc36f639286f377 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:22.381047  7466 leader_election.cc:304] T d8cee0accdb8499c86d4414b72565a38 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, b7ab4784c7344b939bc36f639286f377; no voters: 
I20260709 13:19:22.382038  8347 leader_election.cc:290] T 3411566abe2d4c9bb4b2adfdd05e6f17 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:22.386824  9390 raft_consensus.cc:2804] T d8cee0accdb8499c86d4414b72565a38 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:19:22.390064  6873 raft_consensus.cc:2368] T 7ba5dac66ab5497e9e336f2a3c28cda5 P cd75a17ab2604397adab03bb8b5fd75c [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 7ba59cc884714e8aa5f3f0ecaed84cbb for earlier term 7. Current term is 8.
I20260709 13:19:22.390211  6879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b8cacb381b746da8d0049b0a83b41dd" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:19:22.393002  6879 raft_consensus.cc:2468] T 4b8cacb381b746da8d0049b0a83b41dd P cd75a17ab2604397adab03bb8b5fd75c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in term 7.
I20260709 13:19:22.388912  9349 leader_election.cc:290] T 2c240553ce044eedb41541d72b9475d7 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:19:22.387476  9344 leader_election.cc:290] T 24ee15416e3145beaa1b8183453729a3 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:19:22.401382  6879 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58592 (request call id 168) took 1768 ms. Trace:
I20260709 13:19:22.402311  6879 rpcz_store.cc:276] 0709 13:19:20.627624 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:22.337509 (+1709885us) service_pool.cc:224] Handling call
0709 13:19:22.395939 (+ 58430us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:22.409057  9273 leader_election.cc:290] T 4b8cacb381b746da8d0049b0a83b41dd P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:19:22.410633  6723 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49744 (request call id 192) took 3149 ms. Trace:
I20260709 13:19:22.411084  6723 rpcz_store.cc:276] 0709 13:19:19.260996 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:19.261144 (+   148us) service_pool.cc:224] Handling call
0709 13:19:19.265514 (+  4370us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:19.494457 (+228943us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:22.409920 (+2915463us) spinlock_profiling.cc:243] Waited 180 ms on lock 0x7b54000992d4. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f9aae01 00007fcc0f9a983e 00007fcc1496e419 00007fcc0dee5bd4 00007fcc0dee5b62 00007fcc0dee5a91 00007fcc0dee5a0c 00007fcc0dee4cc2 00007fcc0dce548c 00007fcc0dce48c6
0709 13:19:22.410351 (+   431us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":413752320}
I20260709 13:19:22.413857  8574 leader_election.cc:290] T 95a75bfe094d4bdc963aba3f08dfcd25 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:22.402051  6873 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58592 (request call id 165) took 1769 ms. Trace:
I20260709 13:19:22.425220  6873 rpcz_store.cc:276] 0709 13:19:20.625801 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:22.290935 (+1665134us) service_pool.cc:224] Handling call
0709 13:19:22.395296 (+104361us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:22.374694  9451 raft_consensus.cc:493] T 7887766dc6784fcaa42b35c05fea7a99 P b7ab4784c7344b939bc36f639286f377 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
W20260709 13:19:22.431556  6697 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.68:45071, user_credentials={real_user=slave}} blocked reactor thread for 60678.9us
I20260709 13:19:22.434960  9031 raft_consensus.cc:3060] T 44bde925b2e541b69890d70715b85176 P b7ab4784c7344b939bc36f639286f377 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:22.440488  9451 raft_consensus.cc:515] T 7887766dc6784fcaa42b35c05fea7a99 P b7ab4784c7344b939bc36f639286f377 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
W20260709 13:19:22.444689  6877 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53416 (request call id 2329) took 2411 ms (client timeout 1645 ms). Trace:
I20260709 13:19:22.445050  9462 raft_consensus.cc:493] T 1bf4668eeb70467fb3dc5a0289233b3c P b7ab4784c7344b939bc36f639286f377 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:22.445446  6877 rpcz_store.cc:269] 0709 13:19:20.030102 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:20.143526 (+113424us) service_pool.cc:224] Handling call
0709 13:19:22.441362 (+2297836us) spinlock_profiling.cc:243] Waited 344 ms on lock 0x7b54000a73d4. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f9ae2fa 00007fcc1496fb17 00007fcc0deea6d4 00007fcc0deea662 00007fcc0deea591 00007fcc0deea50c 00007fcc0dee97c2 00007fcc0dce548c 00007fcc0dce48c6 00007fcc0dce426f
0709 13:19:22.441633 (+   271us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":792313216}
W20260709 13:19:22.456794  7466 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 73679.2us
I20260709 13:19:22.464536  9450 leader_election.cc:290] T ab432e62819d499eaaf3dd55481dd930 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:22.459528  6877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f9c2e2bf644115957398fe4c9459db" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:19:22.459069  6730 raft_consensus.cc:2955] T 24ee15416e3145beaa1b8183453729a3 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 6 FOLLOWER]: Committing config change with OpId 6.7: config changed from index 3 to 7, VOTER b7ab4784c7344b939bc36f639286f377 (127.5.126.66) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } } }
I20260709 13:19:22.476419  9406 leader_election.cc:290] T f58dc08b12a2494bb9a1372837970ca2 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
W20260709 13:19:22.477177  6770 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 129729us
I20260709 13:19:22.478081  9221 raft_consensus.cc:3060] T 7ba5dac66ab5497e9e336f2a3c28cda5 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:22.481967  9451 leader_election.cc:290] T 7887766dc6784fcaa42b35c05fea7a99 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:22.458782  9447 leader_election.cc:290] T 3fa34c08b205435dba97346991aa1f92 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:22.448132  9390 raft_consensus.cc:697] T d8cee0accdb8499c86d4414b72565a38 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 6 LEADER]: Becoming Leader. State: Replica: 7ba59cc884714e8aa5f3f0ecaed84cbb, State: Running, Role: LEADER
I20260709 13:19:22.487602  9390 consensus_queue.cc:237] T d8cee0accdb8499c86d4414b72565a38 P 7ba59cc884714e8aa5f3f0ecaed84cbb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:19:22.493758  6877 raft_consensus.cc:2410] T f3f9c2e2bf644115957398fe4c9459db P cd75a17ab2604397adab03bb8b5fd75c [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ccd8a4c3bfe3413cb2ae219b09aea832 for term 7 because replica has last-logged OpId of term: 6 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 13:19:22.495047  6877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "713b5728a197487c9300b310ab94e5a3" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:19:22.495745  6877 raft_consensus.cc:2468] T 713b5728a197487c9300b310ab94e5a3 P cd75a17ab2604397adab03bb8b5fd75c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 6.
I20260709 13:19:22.505967  6723 raft_consensus.cc:1240] T 44bde925b2e541b69890d70715b85176 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 7 LEADER]: Rejecting Update request from peer b7ab4784c7344b939bc36f639286f377 for earlier term 6. Current term is 7. Ops: []
I20260709 13:19:22.506745  6725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fa34c08b205435dba97346991aa1f92" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:19:22.506773  6805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c37d41cd9164c15a6826ca62a851a69" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:19:22.507925  6732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f03d0dbf16864ca4bc1bb5e4c0334c0f" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:19:22.508179  6725 raft_consensus.cc:2468] T 3fa34c08b205435dba97346991aa1f92 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in term 8.
I20260709 13:19:22.509666  6805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f9c2e2bf644115957398fe4c9459db" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:19:22.476455  6881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77e330a82df4b43a745d57a68f6f057" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:19:22.515353  6728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1704639a875409b9959353527b3fd68" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:19:22.515836  6881 raft_consensus.cc:2468] T e77e330a82df4b43a745d57a68f6f057 P cd75a17ab2604397adab03bb8b5fd75c [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 8.
I20260709 13:19:22.517556  6881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f58dc08b12a2494bb9a1372837970ca2" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:19:22.518675  6804 raft_consensus.cc:1275] T e77e330a82df4b43a745d57a68f6f057 P b7ab4784c7344b939bc36f639286f377 [term 8 FOLLOWER]: Refusing update from remote peer ccd8a4c3bfe3413cb2ae219b09aea832: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 8 index: 4. (index mismatch)
I20260709 13:19:22.519061  6881 raft_consensus.cc:2410] T f58dc08b12a2494bb9a1372837970ca2 P cd75a17ab2604397adab03bb8b5fd75c [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7ab4784c7344b939bc36f639286f377 for term 9 because replica has last-logged OpId of term: 8 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 13:19:22.521634  8986 raft_consensus.cc:493] T e31b9971c15848dea59d4d4130141d9e P ccd8a4c3bfe3413cb2ae219b09aea832 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:19:22.522646  8986 raft_consensus.cc:515] T e31b9971c15848dea59d4d4130141d9e P ccd8a4c3bfe3413cb2ae219b09aea832 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:22.524808  6728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d9def8b32fd443aa94ab1420b06837b" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:19:22.525959  6728 raft_consensus.cc:3060] T 4d9def8b32fd443aa94ab1420b06837b P ccd8a4c3bfe3413cb2ae219b09aea832 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:22.527354  6724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30e88460611e47b2ba16a46a30b5f416" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:19:22.528492  6724 raft_consensus.cc:2468] T 30e88460611e47b2ba16a46a30b5f416 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 5.
I20260709 13:19:22.528704  6732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4b8bd455d5a47c18a1380839c6e0d61" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:19:22.530778  6723 raft_consensus.cc:1240] T 7c44c4849aa54f2b94d1f1bef9ed546f P ccd8a4c3bfe3413cb2ae219b09aea832 [term 8 FOLLOWER]: Rejecting Update request from peer b7ab4784c7344b939bc36f639286f377 for earlier term 7. Current term is 8. Ops: []
I20260709 13:19:22.531311  6725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a734b5ab7834e05a8c422208acc58b1" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:19:22.532618  6725 raft_consensus.cc:2393] T 7a734b5ab7834e05a8c422208acc58b1 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate b7ab4784c7344b939bc36f639286f377 in current term 7: Already voted for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in this term.
I20260709 13:19:22.532469  6732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b3759de40694069b13c0f8bd40e5709" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:19:22.541335  9384 raft_consensus.cc:493] T 7c44c4849aa54f2b94d1f1bef9ed546f P ccd8a4c3bfe3413cb2ae219b09aea832 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:22.542203  9384 raft_consensus.cc:515] T 7c44c4849aa54f2b94d1f1bef9ed546f P ccd8a4c3bfe3413cb2ae219b09aea832 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:22.545806  7498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "427c124d773f483294511e80fe340075" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:19:22.551151  6724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de3186201e1a40d0b335eeb8b4e256e0" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:19:22.552222  6724 raft_consensus.cc:2393] T de3186201e1a40d0b335eeb8b4e256e0 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7ab4784c7344b939bc36f639286f377 in current term 7: Already voted for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in this term.
I20260709 13:19:22.557624  9384 leader_election.cc:290] T 7c44c4849aa54f2b94d1f1bef9ed546f P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:22.558101  6730 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49744 (request call id 199) took 1781 ms. Trace:
W20260709 13:19:22.558570  8855 consensus_meta.cc:287] T 404190ce4ce94cecbfcb6ea9d1dd8626 P 7ba59cc884714e8aa5f3f0ecaed84cbb: Time spent flushing consensus metadata: real 1.093s	user 0.008s	sys 0.018s
I20260709 13:19:22.559428  8855 raft_consensus.cc:515] T 404190ce4ce94cecbfcb6ea9d1dd8626 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:19:22.559438  9050 leader_election.cc:290] T 07a92dd554674067a83a9cb68c4773f2 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 7 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:22.561865  9259 raft_consensus.cc:3055] T 1bf4668eeb70467fb3dc5a0289233b3c P ccd8a4c3bfe3413cb2ae219b09aea832 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:19:22.562376  9259 raft_consensus.cc:740] T 1bf4668eeb70467fb3dc5a0289233b3c P ccd8a4c3bfe3413cb2ae219b09aea832 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
I20260709 13:19:22.563092  6731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77e330a82df4b43a745d57a68f6f057" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:19:22.446733  9462 raft_consensus.cc:515] T 1bf4668eeb70467fb3dc5a0289233b3c P b7ab4784c7344b939bc36f639286f377 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:22.558877  6730 rpcz_store.cc:276] 0709 13:19:20.776934 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:20.777319 (+   385us) service_pool.cc:224] Handling call
0709 13:19:20.948053 (+170734us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:20.948368 (+   315us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:19:22.282142 (+1333774us) log.cc:844] Serialized 14 byte log entry
0709 13:19:22.513421 (+231279us) log.cc:844] Serialized 14 byte log entry
0709 13:19:22.536963 (+ 23542us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:22.539448 (+  2485us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:19:22.557403 (+ 17955us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:22.557724 (+   321us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:22.557983 (+   259us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8742,"prepare.queue_time_us":394788,"prepare.run_cpu_time_us":76,"prepare.run_wall_time_us":76,"raft.queue_time_us":23818,"raft.run_cpu_time_us":373,"raft.run_wall_time_us":381,"thread_start_us":1271552,"threads_started":2,"wal-append.queue_time_us":141869}
I20260709 13:19:22.570042  6724 pending_rounds.cc:85] T 3d65025eea89441290d85dd053810e31 P ccd8a4c3bfe3413cb2ae219b09aea832: Aborting all ops after (but not including) 1
I20260709 13:19:22.572803  6805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20f6842e26174571996b8dea4151d4be" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:19:22.574585  6881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de3186201e1a40d0b335eeb8b4e256e0" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
W20260709 13:19:22.563103  6695 connection.cc:256] RPC call timeout handler was delayed by -3.1938152479999644s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.24380000000000002s for a response
I20260709 13:19:22.539686  8986 leader_election.cc:290] T e31b9971c15848dea59d4d4130141d9e P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:22.577390  6724 pending_rounds.cc:107] T 3d65025eea89441290d85dd053810e31 P ccd8a4c3bfe3413cb2ae219b09aea832: Aborting uncommitted NO_OP operation due to leader change: 3.2
W20260709 13:19:22.579345  6695 connection.cc:256] RPC call timeout handler was delayed by -3.1770906909998757s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1917s for a response
I20260709 13:19:22.590461  9448 raft_consensus.cc:493] T 7ba5dac66ab5497e9e336f2a3c28cda5 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:22.585450  6724 raft_consensus.cc:2889] T 3d65025eea89441290d85dd053810e31 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:19:22.591130  9448 raft_consensus.cc:515] T 7ba5dac66ab5497e9e336f2a3c28cda5 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:19:22.592223  9050 raft_consensus.cc:493] T 711ef6523deb4cbe8ef2ba61e1c21c98 P b7ab4784c7344b939bc36f639286f377 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:22.593448  6877 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53416 (request call id 2331) took 2562 ms. Trace:
I20260709 13:19:22.593245  9050 raft_consensus.cc:515] T 711ef6523deb4cbe8ef2ba61e1c21c98 P b7ab4784c7344b939bc36f639286f377 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:22.593976  6877 rpcz_store.cc:276] 0709 13:19:20.030580 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:22.539882 (+2509302us) service_pool.cc:224] Handling call
0709 13:19:22.592513 (+ 52631us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:22.592928 (+   415us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:22.592961 (+    33us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:22.593041 (+    80us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:19:22.593106 (+    65us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:22.593213 (+   107us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:22.593350 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:22.596676  7466 leader_election.cc:304] T fe20b4b48823486ca3b9c648db6ce8aa P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
I20260709 13:19:22.597594  8855 leader_election.cc:290] T 404190ce4ce94cecbfcb6ea9d1dd8626 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 8 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:19:22.599614  7502 raft_consensus.cc:1275] T 7ba5dac66ab5497e9e336f2a3c28cda5 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 8 FOLLOWER]: Refusing update from remote peer b7ab4784c7344b939bc36f639286f377: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 8. (term mismatch)
I20260709 13:19:22.600006  7502 pending_rounds.cc:85] T 7ba5dac66ab5497e9e336f2a3c28cda5 P 7ba59cc884714e8aa5f3f0ecaed84cbb: Aborting all ops after (but not including) 7
I20260709 13:19:22.600268  7502 pending_rounds.cc:107] T 7ba5dac66ab5497e9e336f2a3c28cda5 P 7ba59cc884714e8aa5f3f0ecaed84cbb: Aborting uncommitted NO_OP operation due to leader change: 7.8
I20260709 13:19:22.600522  7502 raft_consensus.cc:2889] T 7ba5dac66ab5497e9e336f2a3c28cda5 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:19:22.593750  7494 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50744 (request call id 203) took 2381 ms. Trace:
I20260709 13:19:22.602675  7494 rpcz_store.cc:276] 0709 13:19:20.212717 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:20.212941 (+   224us) service_pool.cc:224] Handling call
0709 13:19:20.215403 (+  2462us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:20.294238 (+ 78835us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:20.294280 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:20.295010 (+   730us) log.cc:844] Serialized 26 byte log entry
0709 13:19:20.435460 (+140450us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:19:20.435521 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:22.593005 (+2157484us) spinlock_profiling.cc:243] Waited 56.8 ms on lock 0x7b540032c654. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f9aae01 00007fcc0f9a983e 00007fcc1496e419 00007fcc0dee5bd4 00007fcc0dee5b62 00007fcc0dee5a91 00007fcc0dee5a0c 00007fcc0dee4cc2 00007fcc0dce548c 00007fcc0dce48c6
0709 13:19:22.593096 (+    91us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:22.593165 (+    69us) raft_consensus.cc:1685] finished
0709 13:19:22.593178 (+    13us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:22.593546 (+   368us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":8704,"raft.run_cpu_time_us":117,"raft.run_wall_time_us":117,"spinlock_wait_cycles":130648832,"thread_start_us":136516,"threads_started":1,"wal-append.queue_time_us":252259,"wal-append.run_cpu_time_us":3545,"wal-append.run_wall_time_us":1382716}
I20260709 13:19:22.607267  9462 leader_election.cc:290] T 1bf4668eeb70467fb3dc5a0289233b3c P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:22.607018  6874 consensus_queue.cc:260] T 22ccee1b570c4ad3a57bd7aec085b1b4 P cd75a17ab2604397adab03bb8b5fd75c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:22.563722  9259 consensus_queue.cc:260] T 1bf4668eeb70467fb3dc5a0289233b3c P ccd8a4c3bfe3413cb2ae219b09aea832 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
W20260709 13:19:22.608686  6697 connection.cc:256] RPC call timeout handler was delayed by -1.2430657230001998s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.211s for a response
I20260709 13:19:22.609663  9259 raft_consensus.cc:3060] T 1bf4668eeb70467fb3dc5a0289233b3c P ccd8a4c3bfe3413cb2ae219b09aea832 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:19:22.610077  6697 connection.cc:256] RPC call timeout handler was delayed by -1.032033371000125s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15410000000000001s for a response
I20260709 13:19:22.610698  6626 catalog_manager.cc:5697] T 17587d6730594da4a56fa13a353232a1 P ccd8a4c3bfe3413cb2ae219b09aea832 reported cstate change: term changed from 2 to 6, leader changed from b7ab4784c7344b939bc36f639286f377 (127.5.126.66) to 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68). New cstate: current_term: 6 leader_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } } }
I20260709 13:19:22.612370  9466 raft_consensus.cc:493] T bd6869f07b5a4885a0b99fbe60c3b175 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:22.613309  6801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a734b5ab7834e05a8c422208acc58b1" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:19:22.613269  9466 raft_consensus.cc:515] T bd6869f07b5a4885a0b99fbe60c3b175 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:22.614516  6801 raft_consensus.cc:2393] T 7a734b5ab7834e05a8c422208acc58b1 P b7ab4784c7344b939bc36f639286f377 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate ccd8a4c3bfe3413cb2ae219b09aea832 in current term 7: Already voted for candidate b7ab4784c7344b939bc36f639286f377 in this term.
I20260709 13:19:22.615171  7499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b8cacb381b746da8d0049b0a83b41dd" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:19:22.615404  6798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17587d6730594da4a56fa13a353232a1" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:19:22.616120  7501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3d8792045a4583ae2e965b1350a5b4" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:19:22.616345  6798 raft_consensus.cc:2468] T 17587d6730594da4a56fa13a353232a1 P b7ab4784c7344b939bc36f639286f377 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 8.
I20260709 13:19:22.617012  7501 raft_consensus.cc:2468] T bb3d8792045a4583ae2e965b1350a5b4 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 6.
I20260709 13:19:22.618388  7498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ba5dac66ab5497e9e336f2a3c28cda5" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 9 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:19:22.618566  7495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24ee15416e3145beaa1b8183453729a3" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:19:22.614288  6799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "713b5728a197487c9300b310ab94e5a3" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:19:22.616532  7499 raft_consensus.cc:2410] T 4b8cacb381b746da8d0049b0a83b41dd P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c for term 8 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 13:19:22.620208  6799 raft_consensus.cc:2468] T 713b5728a197487c9300b310ab94e5a3 P b7ab4784c7344b939bc36f639286f377 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 6.
I20260709 13:19:22.621031  6798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c240553ce044eedb41541d72b9475d7" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:19:22.621289  6872 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53416 (request call id 2325) took 2592 ms. Trace:
I20260709 13:19:22.621333  6799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b56bf91d90824c959e21e0cee5ba1816" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:19:22.621662  9466 leader_election.cc:290] T bd6869f07b5a4885a0b99fbe60c3b175 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:22.622270  6805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1528ab62b6fe4e3099d08f141afee116" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:19:22.622467  9466 raft_consensus.cc:493] T f5be3a11b23d4ea9b08300a2789821c7 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:19:22.623231  7494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce4f062dcd314d43a63ca74067cb5ee3" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:19:22.624261  7494 raft_consensus.cc:2468] T ce4f062dcd314d43a63ca74067cb5ee3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 6.
W20260709 13:19:22.624550  6878 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53416 (request call id 2338) took 2512 ms (client timeout 1541 ms). Trace:
W20260709 13:19:22.625077  6878 rpcz_store.cc:269] 0709 13:19:20.113175 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:20.137557 (+ 24382us) service_pool.cc:224] Handling call
0709 13:19:22.624125 (+2486568us) spinlock_profiling.cc:243] Waited 163 ms on lock 0x7b540005b4d4. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f9ae2fa 00007fcc1496fb17 00007fcc0deea6d4 00007fcc0deea662 00007fcc0deea591 00007fcc0deea50c 00007fcc0dee97c2 00007fcc0dce548c 00007fcc0dce48c6 00007fcc0dce426f
0709 13:19:22.624309 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":375612800}
I20260709 13:19:22.625977  7496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fa34c08b205435dba97346991aa1f92" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 9 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:19:22.627177  7496 raft_consensus.cc:2410] T 3fa34c08b205435dba97346991aa1f92 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c for term 9 because replica has last-logged OpId of term: 7 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 6.
I20260709 13:19:22.626295  6878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a75bfe094d4bdc963aba3f08dfcd25" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 8 candidate_status { last_received { term: 7 index: 2 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:19:22.598017  9366 raft_consensus.cc:2804] T fe20b4b48823486ca3b9c648db6ce8aa P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:19:22.630458  6801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de3186201e1a40d0b335eeb8b4e256e0" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:19:22.629388  6731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f58dc08b12a2494bb9a1372837970ca2" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:19:22.630650  6846 leader_election.cc:304] T bb3d8792045a4583ae2e965b1350a5b4 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:19:22.630913  6770 leader_election.cc:304] T 34f36d59d88f40fe8a2805e604fc6c0a P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:19:22.621815  6872 rpcz_store.cc:276] 0709 13:19:20.028776 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:20.032268 (+  3492us) service_pool.cc:224] Handling call
0709 13:19:20.032592 (+   324us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:20.428235 (+395643us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:22.620799 (+2192564us) spinlock_profiling.cc:243] Waited 393 ms on lock 0x7b54001e8cd4. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f9aae01 00007fcc0f9a983e 00007fcc1496e419 00007fcc0dee5bd4 00007fcc0dee5b62 00007fcc0dee5a91 00007fcc0dee5a0c 00007fcc0dee4cc2 00007fcc0dce548c 00007fcc0dce48c6
0709 13:19:22.621067 (+   268us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":904729472}
I20260709 13:19:22.634029  6772 leader_election.cc:304] T a1704639a875409b9959353527b3fd68 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:19:22.636909  6727 raft_consensus.cc:1240] T 8c7f33e544204fbaac4078e3e83bbf4e P ccd8a4c3bfe3413cb2ae219b09aea832 [term 4 FOLLOWER]: Rejecting Update request from peer b7ab4784c7344b939bc36f639286f377 for earlier term 3. Current term is 4. Ops: []
W20260709 13:19:22.648363  7466 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 51861us
I20260709 13:19:22.649895  6881 raft_consensus.cc:2393] T de3186201e1a40d0b335eeb8b4e256e0 P cd75a17ab2604397adab03bb8b5fd75c [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7ab4784c7344b939bc36f639286f377 in current term 7: Already voted for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in this term.
I20260709 13:19:22.623514  6807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3f13b31a1f84f0d89d007eadd57924c" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:19:22.595763  6877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3411566abe2d4c9bb4b2adfdd05e6f17" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:19:22.640065  6626 catalog_manager.cc:5697] T 4b8cacb381b746da8d0049b0a83b41dd P ccd8a4c3bfe3413cb2ae219b09aea832 reported cstate change: term changed from 4 to 5, leader changed from cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67) to ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65). New cstate: current_term: 5 leader_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:22.641047  6880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09c2a98de1a4decabd0ff900dd44caa" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:19:22.642269  6874 raft_consensus.cc:3060] T 22ccee1b570c4ad3a57bd7aec085b1b4 P cd75a17ab2604397adab03bb8b5fd75c [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:19:22.643771  9351 raft_consensus.cc:493] T 95a75bfe094d4bdc963aba3f08dfcd25 P cd75a17ab2604397adab03bb8b5fd75c [term 7 FOLLOWER]: Starting pre-election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:19:22.644637  9362 raft_consensus.cc:493] T ab432e62819d499eaaf3dd55481dd930 P cd75a17ab2604397adab03bb8b5fd75c [term 7 FOLLOWER]: Starting pre-election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
W20260709 13:19:22.644981  6876 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53416 (request call id 2333) took 2613 ms (client timeout 1691 ms). Trace:
I20260709 13:19:22.669955  6728 raft_consensus.cc:2468] T 4d9def8b32fd443aa94ab1420b06837b P ccd8a4c3bfe3413cb2ae219b09aea832 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 7.
I20260709 13:19:22.623749  6805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "853ac0a8cbd64ce99457f170216d4d0f" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:19:22.639055  9050 leader_election.cc:290] T 711ef6523deb4cbe8ef2ba61e1c21c98 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
W20260709 13:19:22.670156  6876 rpcz_store.cc:269] 0709 13:19:20.031148 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:20.334203 (+303055us) service_pool.cc:224] Handling call
0709 13:19:22.644521 (+2310318us) spinlock_profiling.cc:243] Waited 28 ms on lock 0x7b54002369d4. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f9ae2fa 00007fcc1496fb17 00007fcc0deea6d4 00007fcc0deea662 00007fcc0deea591 00007fcc0deea50c 00007fcc0dee97c2 00007fcc0dce548c 00007fcc0dce48c6 00007fcc0dce426f
0709 13:19:22.644752 (+   231us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":64338688}
I20260709 13:19:22.675508  6877 raft_consensus.cc:2468] T 3411566abe2d4c9bb4b2adfdd05e6f17 P cd75a17ab2604397adab03bb8b5fd75c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 5.
I20260709 13:19:22.678021  6801 raft_consensus.cc:3060] T de3186201e1a40d0b335eeb8b4e256e0 P b7ab4784c7344b939bc36f639286f377 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:22.682432  6799 raft_consensus.cc:2468] T b56bf91d90824c959e21e0cee5ba1816 P b7ab4784c7344b939bc36f639286f377 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 7.
I20260709 13:19:22.683274  7466 leader_election.cc:304] T 3fa34c08b205435dba97346991aa1f92 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
I20260709 13:19:22.684480  9261 consensus_queue.cc:1059] T 1528ab62b6fe4e3099d08f141afee116 P 7ba59cc884714e8aa5f3f0ecaed84cbb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
W20260709 13:19:22.685578  6802 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:32966 (request call id 750) took 2771 ms (client timeout 1668 ms). Trace:
I20260709 13:19:22.685827  9261 raft_consensus.cc:3055] T 1528ab62b6fe4e3099d08f141afee116 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:19:22.686342  9261 raft_consensus.cc:740] T 1528ab62b6fe4e3099d08f141afee116 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 7ba59cc884714e8aa5f3f0ecaed84cbb, State: Running, Role: LEADER
W20260709 13:19:22.686081  6802 rpcz_store.cc:269] 0709 13:19:19.918288 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:19.919445 (+  1157us) service_pool.cc:224] Handling call
0709 13:19:22.671216 (+2751771us) spinlock_profiling.cc:243] Waited 100 ms on lock 0x7b54001f6654. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f9ae2fa 00007fcc1496fb17 00007fcc0deea6d4 00007fcc0deea662 00007fcc0deea591 00007fcc0deea50c 00007fcc0dee97c2 00007fcc0dce548c 00007fcc0dce48c6 00007fcc0dce426f
0709 13:19:22.685342 (+ 14126us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":230270208}
I20260709 13:19:22.688442  6798 raft_consensus.cc:3060] T 2c240553ce044eedb41541d72b9475d7 P b7ab4784c7344b939bc36f639286f377 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:22.688827  9366 raft_consensus.cc:493] T fe20b4b48823486ca3b9c648db6ce8aa P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:22.689215  6805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3022224cc81473690653a83d4e99470" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:19:22.689253  9366 raft_consensus.cc:3060] T fe20b4b48823486ca3b9c648db6ce8aa P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:19:22.692245  6772 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 58540us
I20260709 13:19:22.693272  6772 leader_election.cc:304] T f03d0dbf16864ca4bc1bb5e4c0334c0f P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:19:22.693713  9031 raft_consensus.cc:2804] T a1704639a875409b9959353527b3fd68 P b7ab4784c7344b939bc36f639286f377 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:19:22.694377  9031 raft_consensus.cc:697] T a1704639a875409b9959353527b3fd68 P b7ab4784c7344b939bc36f639286f377 [term 6 LEADER]: Becoming Leader. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
I20260709 13:19:22.692420  9215 raft_consensus.cc:2804] T 3fa34c08b205435dba97346991aa1f92 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:19:22.695652  9215 raft_consensus.cc:493] T 3fa34c08b205435dba97346991aa1f92 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:22.696188  9215 raft_consensus.cc:3060] T 3fa34c08b205435dba97346991aa1f92 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:19:22.696871  6770 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 66180.2us
I20260709 13:19:22.698294  9469 raft_consensus.cc:2749] T 34f36d59d88f40fe8a2805e604fc6c0a P b7ab4784c7344b939bc36f639286f377 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:19:22.699031  6872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d33d5ee8ef6f415593d8df52063161ad" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
W20260709 13:19:22.700070  7468 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:22.700204  9461 raft_consensus.cc:2804] T bb3d8792045a4583ae2e965b1350a5b4 P cd75a17ab2604397adab03bb8b5fd75c [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:19:22.700484  6770 leader_election.cc:304] T 30e88460611e47b2ba16a46a30b5f416 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
I20260709 13:19:22.700794  9461 raft_consensus.cc:493] T bb3d8792045a4583ae2e965b1350a5b4 P cd75a17ab2604397adab03bb8b5fd75c [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:22.701293  9461 raft_consensus.cc:3060] T bb3d8792045a4583ae2e965b1350a5b4 P cd75a17ab2604397adab03bb8b5fd75c [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:22.701854  6770 leader_election.cc:304] T f4b8bd455d5a47c18a1380839c6e0d61 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:19:22.702997  9360 raft_consensus.cc:2804] T 30e88460611e47b2ba16a46a30b5f416 P b7ab4784c7344b939bc36f639286f377 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:19:22.702791  9351 raft_consensus.cc:515] T 95a75bfe094d4bdc963aba3f08dfcd25 P cd75a17ab2604397adab03bb8b5fd75c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:22.703486  9360 raft_consensus.cc:493] T 30e88460611e47b2ba16a46a30b5f416 P b7ab4784c7344b939bc36f639286f377 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:22.703928  9360 raft_consensus.cc:3060] T 30e88460611e47b2ba16a46a30b5f416 P b7ab4784c7344b939bc36f639286f377 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:22.687997  9261 consensus_queue.cc:260] T 1528ab62b6fe4e3099d08f141afee116 P 7ba59cc884714e8aa5f3f0ecaed84cbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:19:22.699924  6872 raft_consensus.cc:2468] T d33d5ee8ef6f415593d8df52063161ad P cd75a17ab2604397adab03bb8b5fd75c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 7.
I20260709 13:19:22.711524  6873 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53416 (request call id 2330) took 2681 ms. Trace:
I20260709 13:19:22.712147  6873 rpcz_store.cc:276] 0709 13:19:20.030347 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:22.428537 (+2398190us) service_pool.cc:224] Handling call
0709 13:19:22.429127 (+   590us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:22.449557 (+ 20430us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:19:22.585959 (+136402us) log.cc:844] Serialized 14 byte log entry
0709 13:19:22.711105 (+125146us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:22.711175 (+    70us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:19:22.711239 (+    64us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:22.711316 (+    77us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:22.711443 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":223084,"prepare.run_cpu_time_us":55,"prepare.run_wall_time_us":56,"raft.queue_time_us":342,"raft.run_cpu_time_us":200,"raft.run_wall_time_us":201,"thread_start_us":154103,"threads_started":2}
I20260709 13:19:22.705730  6878 raft_consensus.cc:2468] T 95a75bfe094d4bdc963aba3f08dfcd25 P cd75a17ab2604397adab03bb8b5fd75c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 7.
I20260709 13:19:22.669780  9294 raft_consensus.cc:493] T 8c7f33e544204fbaac4078e3e83bbf4e P ccd8a4c3bfe3413cb2ae219b09aea832 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:22.720644  6799 raft_consensus.cc:1275] T 44bde925b2e541b69890d70715b85176 P b7ab4784c7344b939bc36f639286f377 [term 7 FOLLOWER]: Refusing update from remote peer ccd8a4c3bfe3413cb2ae219b09aea832: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:19:22.695554  9031 consensus_queue.cc:237] T a1704639a875409b9959353527b3fd68 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:22.727341  9050 raft_consensus.cc:2749] T f4b8bd455d5a47c18a1380839c6e0d61 P b7ab4784c7344b939bc36f639286f377 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:19:22.702129  9362 raft_consensus.cc:515] T ab432e62819d499eaaf3dd55481dd930 P cd75a17ab2604397adab03bb8b5fd75c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
W20260709 13:19:22.837003  6696 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:22.755175  7466 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:22.748744  6695 connection.cc:256] RPC call timeout handler was delayed by -3.0615070580001884s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1653s for a response
W20260709 13:19:22.744580  7467 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:22.728088  6731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "404190ce4ce94cecbfcb6ea9d1dd8626" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:19:22.832701  6874 raft_consensus.cc:1275] T 22ccee1b570c4ad3a57bd7aec085b1b4 P cd75a17ab2604397adab03bb8b5fd75c [term 5 FOLLOWER]: Refusing update from remote peer ccd8a4c3bfe3413cb2ae219b09aea832: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:19:22.677093  9406 raft_consensus.cc:493] T 711ef6523deb4cbe8ef2ba61e1c21c98 P cd75a17ab2604397adab03bb8b5fd75c [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:22.732867  6772 leader_election.cc:304] T e77e330a82df4b43a745d57a68f6f057 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:19:22.836795  6801 raft_consensus.cc:2468] T de3186201e1a40d0b335eeb8b4e256e0 P b7ab4784c7344b939bc36f639286f377 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 7.
I20260709 13:19:22.751665  6805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34f36d59d88f40fe8a2805e604fc6c0a" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:19:22.867966  6798 raft_consensus.cc:2468] T 2c240553ce044eedb41541d72b9475d7 P b7ab4784c7344b939bc36f639286f377 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 8.
W20260709 13:19:22.847862  7469 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:22.705356  9351 leader_election.cc:290] T 95a75bfe094d4bdc963aba3f08dfcd25 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:19:22.731653  6879 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53416 (request call id 2328) took 2701 ms. Trace:
W20260709 13:19:22.860219  6697 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 152990us
W20260709 13:19:22.858335  6773 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:22.934688  7467 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:22.948110  6773 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:22.735136  6807 raft_consensus.cc:2410] T b3f13b31a1f84f0d89d007eadd57924c P b7ab4784c7344b939bc36f639286f377 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ccd8a4c3bfe3413cb2ae219b09aea832 for term 6 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
W20260709 13:19:22.843833  6770 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 142110us
I20260709 13:19:22.954115  6801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d65025eea89441290d85dd053810e31" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:19:22.955665  6801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d9def8b32fd443aa94ab1420b06837b" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:19:22.956674  6801 raft_consensus.cc:2393] T 4d9def8b32fd443aa94ab1420b06837b P b7ab4784c7344b939bc36f639286f377 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ccd8a4c3bfe3413cb2ae219b09aea832 in current term 7: Already voted for candidate b7ab4784c7344b939bc36f639286f377 in this term.
I20260709 13:19:22.957551  6801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a92dd554674067a83a9cb68c4773f2" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:19:22.959010  6801 raft_consensus.cc:2393] T 07a92dd554674067a83a9cb68c4773f2 P b7ab4784c7344b939bc36f639286f377 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ccd8a4c3bfe3413cb2ae219b09aea832 in current term 7: Already voted for candidate b7ab4784c7344b939bc36f639286f377 in this term.
I20260709 13:19:22.934333  9428 raft_consensus.cc:493] T 22ccee1b570c4ad3a57bd7aec085b1b4 P cd75a17ab2604397adab03bb8b5fd75c [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:22.869910  9210 raft_consensus.cc:493] T 1528ab62b6fe4e3099d08f141afee116 P b7ab4784c7344b939bc36f639286f377 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 7ba59cc884714e8aa5f3f0ecaed84cbb)
I20260709 13:19:22.736385  9215 raft_consensus.cc:515] T 3fa34c08b205435dba97346991aa1f92 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:19:22.872378  9461 raft_consensus.cc:515] T bb3d8792045a4583ae2e965b1350a5b4 P cd75a17ab2604397adab03bb8b5fd75c [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:19:22.960525  9428 raft_consensus.cc:515] T 22ccee1b570c4ad3a57bd7aec085b1b4 P cd75a17ab2604397adab03bb8b5fd75c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:22.961658  6801 raft_consensus.cc:1240] T 1bf4668eeb70467fb3dc5a0289233b3c P b7ab4784c7344b939bc36f639286f377 [term 6 FOLLOWER]: Rejecting Update request from peer ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 13:19:22.961683  6875 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53416 (request call id 2326) took 2917 ms. Trace:
I20260709 13:19:22.963202  6801 raft_consensus.cc:1275] T 3a485a995abc4807b6e511e45419f737 P b7ab4784c7344b939bc36f639286f377 [term 5 FOLLOWER]: Refusing update from remote peer ccd8a4c3bfe3413cb2ae219b09aea832: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:19:22.962677  9461 leader_election.cc:290] T bb3d8792045a4583ae2e965b1350a5b4 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 7 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:19:22.962266  6875 rpcz_store.cc:276] 0709 13:19:20.029077 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:20.451244 (+422167us) service_pool.cc:224] Handling call
0709 13:19:20.455487 (+  4243us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:20.458302 (+  2815us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:19:20.501032 (+ 42730us) log.cc:844] Serialized 14 byte log entry
0709 13:19:20.639540 (+138508us) spinlock_profiling.cc:243] Waited 40.7 ms on lock 0x7b18002b0240. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc15785de1 00007fcc157925b1 00007fcc0c8bd3f3 00007fcc0c8bf7c1 00007fcc0c8bf779 00007fcc0c8bf709 00007fcc0c8bf6d1 00007fcc0c8be9cd 000000000038f354 000000000038f199 00007fcc0c8a083a
0709 13:19:22.551060 (+1911520us) spinlock_profiling.cc:243] Waited 18.4 ms on lock 0x7b18002b0240. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc15785de1 00007fcc157925b1 00007fcc0c89fe07 00007fcc156faab9 00007fcc0c8bc69b 00007fcc0c8ba93f 00007fcc0c8bcc02 00007fcc0f54420b 00007fcc0f549d23 00007fcc0f54a23a 00007fcc0f9b4a2a
0709 13:19:22.871481 (+320421us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:22.872220 (+   739us) log.cc:844] Serialized 26 byte log entry
0709 13:19:22.872377 (+   157us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:19:22.872412 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:22.872514 (+   102us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:22.938284 (+ 65770us) raft_consensus.cc:1685] finished
0709 13:19:22.938301 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:22.946556 (+  8255us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":44301,"prepare.run_cpu_time_us":42,"prepare.run_wall_time_us":43,"raft.queue_time_us":111946,"raft.run_cpu_time_us":363,"raft.run_wall_time_us":54200,"spinlock_wait_cycles":135929472,"thread_start_us":100160,"threads_started":1,"wal-append.queue_time_us":2320140}
W20260709 13:19:22.732841  7468 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:22.936944  9218 raft_consensus.cc:493] T 24ee15416e3145beaa1b8183453729a3 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 7ba59cc884714e8aa5f3f0ecaed84cbb)
I20260709 13:19:22.937085  9349 raft_consensus.cc:493] T 44bde925b2e541b69890d70715b85176 P cd75a17ab2604397adab03bb8b5fd75c [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:22.832326  9469 raft_consensus.cc:2804] T f03d0dbf16864ca4bc1bb5e4c0334c0f P b7ab4784c7344b939bc36f639286f377 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:19:22.708575  9344 raft_consensus.cc:493] T 853ac0a8cbd64ce99457f170216d4d0f P cd75a17ab2604397adab03bb8b5fd75c [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:22.843592  9261 raft_consensus.cc:3060] T 1528ab62b6fe4e3099d08f141afee116 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:22.938570  6873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c240553ce044eedb41541d72b9475d7" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:19:22.973948  6874 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53416 (request call id 2289) took 5069 ms. Trace:
I20260709 13:19:22.836498  6876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30e88460611e47b2ba16a46a30b5f416" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:19:22.944500  6805 raft_consensus.cc:2468] T 34f36d59d88f40fe8a2805e604fc6c0a P b7ab4784c7344b939bc36f639286f377 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 4.
I20260709 13:19:22.727444  6626 catalog_manager.cc:5697] T 1bf4668eeb70467fb3dc5a0289233b3c P ccd8a4c3bfe3413cb2ae219b09aea832 reported cstate change: term changed from 2 to 4, leader changed from ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65) to b7ab4784c7344b939bc36f639286f377 (127.5.126.66). New cstate: current_term: 4 leader_uuid: "b7ab4784c7344b939bc36f639286f377" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } }
W20260709 13:19:22.948855  6773 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:22.958194  6798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "404190ce4ce94cecbfcb6ea9d1dd8626" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:19:22.965608  6875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6869f07b5a4885a0b99fbe60c3b175" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 7 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:19:22.980329  6804 raft_consensus.cc:1275] T d8cee0accdb8499c86d4414b72565a38 P b7ab4784c7344b939bc36f639286f377 [term 6 FOLLOWER]: Refusing update from remote peer 7ba59cc884714e8aa5f3f0ecaed84cbb: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:19:22.751936  9384 raft_consensus.cc:493] T d33d5ee8ef6f415593d8df52063161ad P ccd8a4c3bfe3413cb2ae219b09aea832 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:22.800146  6845 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:22.945137  6879 rpcz_store.cc:276] 0709 13:19:20.029810 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:22.403283 (+2373473us) service_pool.cc:224] Handling call
0709 13:19:22.404027 (+   744us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:22.419980 (+ 15953us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:22.420018 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:22.467501 (+ 47483us) log.cc:844] Serialized 26 byte log entry
0709 13:19:22.568988 (+101487us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:19:22.569046 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:22.570859 (+  1813us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:22.731201 (+160342us) raft_consensus.cc:1685] finished
0709 13:19:22.731235 (+    34us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:22.731558 (+   323us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":20242,"raft.run_cpu_time_us":254,"raft.run_wall_time_us":3878,"thread_start_us":100784,"threads_started":1,"wal-append.queue_time_us":260470}
W20260709 13:19:22.933735  6695 connection.cc:256] RPC call timeout handler was delayed by -2.8198333849998107s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.27140000000000003s for a response
I20260709 13:19:22.981678  9384 raft_consensus.cc:515] T d33d5ee8ef6f415593d8df52063161ad P ccd8a4c3bfe3413cb2ae219b09aea832 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
W20260709 13:19:22.982280  6695 connection.cc:256] RPC call timeout handler was delayed by -2.6293013939998673s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1585s for a response
I20260709 13:19:22.982501  6879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e31b9971c15848dea59d4d4130141d9e" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
W20260709 13:19:22.982932  6695 connection.cc:256] RPC call timeout handler was delayed by -2.4286013939999975s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18080000000000002s for a response
I20260709 13:19:22.983230  6879 raft_consensus.cc:2468] T e31b9971c15848dea59d4d4130141d9e P cd75a17ab2604397adab03bb8b5fd75c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 4.
W20260709 13:19:22.983484  6695 connection.cc:256] RPC call timeout handler was delayed by -2.1568013940000128s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.211s for a response
W20260709 13:19:22.984000  6695 connection.cc:256] RPC call timeout handler was delayed by -1.9135674230001314s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16570000000000001s for a response
I20260709 13:19:22.975564  6801 raft_consensus.cc:1275] T 711ef6523deb4cbe8ef2ba61e1c21c98 P b7ab4784c7344b939bc36f639286f377 [term 7 FOLLOWER]: Refusing update from remote peer ccd8a4c3bfe3413cb2ae219b09aea832: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:19:22.944981  9050 raft_consensus.cc:493] T 44bde925b2e541b69890d70715b85176 P b7ab4784c7344b939bc36f639286f377 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:22.877069  9366 raft_consensus.cc:515] T fe20b4b48823486ca3b9c648db6ce8aa P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:19:22.871220  9466 raft_consensus.cc:515] T f5be3a11b23d4ea9b08300a2789821c7 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:22.744441  9294 raft_consensus.cc:515] T 8c7f33e544204fbaac4078e3e83bbf4e P ccd8a4c3bfe3413cb2ae219b09aea832 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:23.436414  6802 raft_consensus.cc:1240] T a1704639a875409b9959353527b3fd68 P b7ab4784c7344b939bc36f639286f377 [term 6 LEADER]: Rejecting Update request from peer ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 5. Current term is 6. Ops: []
I20260709 13:19:22.974951  6874 rpcz_store.cc:276] 0709 13:19:17.877957 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:17.970977 (+ 93020us) service_pool.cc:224] Handling call
0709 13:19:17.993659 (+ 22682us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:20.330206 (+2336547us) spinlock_profiling.cc:243] Waited 6.94 ms on lock 0x7b4c00059780. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0dc76a20 00007fcc0dc87a29 00007fcc0dc4d644 00007fcc0dc74f2d 00007fcc0dc74b93 00007fcc0f9a518b 00007fcc0f9a5cb5 00007fcc0f9a0f30 00007fcc0f9a27de 00007fcc0f9acb49 00007fcc0f9ad416
0709 13:19:22.606075 (+2275869us) spinlock_profiling.cc:243] Waited 17.9 ms on lock 0x7b54003fe6a0. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f92806f 00007fcc0f9a0f60 00007fcc0f9a27de 00007fcc0f9acb49 00007fcc0f9ad416 00007fcc0f9a9d8f 00007fcc0f9a983e 00007fcc1496e419 00007fcc0dee5bd4 00007fcc0dee5b62
0709 13:19:22.934196 (+328121us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:22.947304 (+ 13108us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":57243648}
I20260709 13:19:22.996495  6873 raft_consensus.cc:2393] T 2c240553ce044eedb41541d72b9475d7 P cd75a17ab2604397adab03bb8b5fd75c [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7ab4784c7344b939bc36f639286f377 in current term 8: Already voted for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in this term.
I20260709 13:19:23.407433  6877 raft_consensus.cc:1240] T f4b8bd455d5a47c18a1380839c6e0d61 P cd75a17ab2604397adab03bb8b5fd75c [term 6 FOLLOWER]: Rejecting Update request from peer ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 5. Current term is 6. Ops: []
I20260709 13:19:22.999471  6731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fa34c08b205435dba97346991aa1f92" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:19:23.405562  6878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c44c4849aa54f2b94d1f1bef9ed546f" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:19:22.977341  6875 raft_consensus.cc:2468] T bd6869f07b5a4885a0b99fbe60c3b175 P cd75a17ab2604397adab03bb8b5fd75c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 5.
I20260709 13:19:23.455502  6731 raft_consensus.cc:3060] T 3fa34c08b205435dba97346991aa1f92 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:22.966310  9351 raft_consensus.cc:493] T d8cee0accdb8499c86d4414b72565a38 P cd75a17ab2604397adab03bb8b5fd75c [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:23.461853  7469 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:23.411505  6872 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53416 (request call id 2334) took 3380 ms. Trace:
I20260709 13:19:23.463757  6872 rpcz_store.cc:276] 0709 13:19:20.031385 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:23.410223 (+3378838us) service_pool.cc:224] Handling call
0709 13:19:23.410720 (+   497us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:23.411007 (+   287us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:23.411043 (+    36us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:23.411127 (+    84us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:19:23.411179 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:23.411259 (+    80us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:23.411402 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:22.984422  6879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c37d41cd9164c15a6826ca62a851a69" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
W20260709 13:19:23.324636  7467 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:23.238571  6881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a485a995abc4807b6e511e45419f737" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:19:23.239753  6880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "713b5728a197487c9300b310ab94e5a3" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:19:23.465363  6877 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53416 (request call id 2332) took 3434 ms. Trace:
W20260709 13:19:23.104254  6772 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 371487us
W20260709 13:19:23.058390  6697 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 88979.9us
I20260709 13:19:23.079911  6807 raft_consensus.cc:1275] T d8292e16e5654be6bc408560cf256aaa P b7ab4784c7344b939bc36f639286f377 [term 8 FOLLOWER]: Refusing update from remote peer ccd8a4c3bfe3413cb2ae219b09aea832: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:19:23.465828  6877 rpcz_store.cc:276] 0709 13:19:20.030885 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:23.406660 (+3375775us) service_pool.cc:224] Handling call
0709 13:19:23.407159 (+   499us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:23.465089 (+ 57930us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:23.465302 (+   213us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:22.962304  9215 leader_election.cc:290] T 3fa34c08b205435dba97346991aa1f92 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 9 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:23.235683  5625 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:19:22.998040  6770 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 44631.1us
I20260709 13:19:22.875802  9273 raft_consensus.cc:493] T f09c2a98de1a4decabd0ff900dd44caa P cd75a17ab2604397adab03bb8b5fd75c [term 7 FOLLOWER]: Starting pre-election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
W20260709 13:19:23.066529  7468 leader_election.cc:336] T d8cee0accdb8499c86d4414b72565a38 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931): Timed out: RequestConsensusVote RPC to 127.5.126.67:42931 timed out after 2.142s (SENT)
W20260709 13:19:23.451257  6773 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:23.107982  6626 catalog_manager.cc:5697] T f09c2a98de1a4decabd0ff900dd44caa P ccd8a4c3bfe3413cb2ae219b09aea832 reported cstate change: term changed from 1 to 5. New cstate: current_term: 5 leader_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:23.465994  6880 raft_consensus.cc:2468] T 713b5728a197487c9300b310ab94e5a3 P cd75a17ab2604397adab03bb8b5fd75c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 6.
I20260709 13:19:22.985049  6695 leader_election.cc:304] T be1a92657f494cac8dd227d152f50151 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb
I20260709 13:19:23.472460  7466 leader_election.cc:304] T 404190ce4ce94cecbfcb6ea9d1dd8626 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
W20260709 13:19:23.212999  9360 consensus_meta.cc:287] T 30e88460611e47b2ba16a46a30b5f416 P b7ab4784c7344b939bc36f639286f377: Time spent flushing consensus metadata: real 0.509s	user 0.009s	sys 0.001s
I20260709 13:19:22.974224  9469 raft_consensus.cc:493] T f03d0dbf16864ca4bc1bb5e4c0334c0f P b7ab4784c7344b939bc36f639286f377 [term 5 FOLLOWER]: Starting leader election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:19:23.146019  9451 raft_consensus.cc:2804] T e77e330a82df4b43a745d57a68f6f057 P b7ab4784c7344b939bc36f639286f377 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:19:23.485751  6807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ba5dac66ab5497e9e336f2a3c28cda5" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:19:23.500958  9451 raft_consensus.cc:493] T e77e330a82df4b43a745d57a68f6f057 P b7ab4784c7344b939bc36f639286f377 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:23.501403  9451 raft_consensus.cc:3060] T e77e330a82df4b43a745d57a68f6f057 P b7ab4784c7344b939bc36f639286f377 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:23.495659  6770 leader_election.cc:304] T f58dc08b12a2494bb9a1372837970ca2 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:19:23.502641  6731 raft_consensus.cc:2468] T 3fa34c08b205435dba97346991aa1f92 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in term 9.
I20260709 13:19:23.203598  9137 leader_election.cc:290] T 9b3759de40694069b13c0f8bd40e5709 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:23.420246  9428 leader_election.cc:290] T 22ccee1b570c4ad3a57bd7aec085b1b4 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:19:23.536711  9428 consensus_queue.cc:1048] T 07a92dd554674067a83a9cb68c4773f2 P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:19:23.414077  9448 leader_election.cc:290] T 7ba5dac66ab5497e9e336f2a3c28cda5 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:23.402263  9461 raft_consensus.cc:493] T 34f36d59d88f40fe8a2805e604fc6c0a P cd75a17ab2604397adab03bb8b5fd75c [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:23.485184  6772 leader_election.cc:304] T 3411566abe2d4c9bb4b2adfdd05e6f17 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:19:22.997747  9450 raft_consensus.cc:493] T 7c44c4849aa54f2b94d1f1bef9ed546f P b7ab4784c7344b939bc36f639286f377 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:23.483614  9454 raft_consensus.cc:2749] T 404190ce4ce94cecbfcb6ea9d1dd8626 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:19:23.490217  9294 leader_election.cc:290] T 8c7f33e544204fbaac4078e3e83bbf4e P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:23.491556  6875 raft_consensus.cc:1240] T fe20b4b48823486ca3b9c648db6ce8aa P cd75a17ab2604397adab03bb8b5fd75c [term 4 FOLLOWER]: Rejecting Update request from peer 7ba59cc884714e8aa5f3f0ecaed84cbb for earlier term 3. Current term is 4. Ops: [3.5-3.5]
I20260709 13:19:22.987362  9218 raft_consensus.cc:515] T 24ee15416e3145beaa1b8183453729a3 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:19:23.117601  9349 raft_consensus.cc:515] T 44bde925b2e541b69890d70715b85176 P cd75a17ab2604397adab03bb8b5fd75c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:23.492172  9452 raft_consensus.cc:493] T d8292e16e5654be6bc408560cf256aaa P b7ab4784c7344b939bc36f639286f377 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:23.481554  9273 raft_consensus.cc:515] T f09c2a98de1a4decabd0ff900dd44caa P cd75a17ab2604397adab03bb8b5fd75c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:23.553617  9452 raft_consensus.cc:515] T d8292e16e5654be6bc408560cf256aaa P b7ab4784c7344b939bc36f639286f377 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:23.554001  6732 raft_consensus.cc:1240] T 20f6842e26174571996b8dea4151d4be P ccd8a4c3bfe3413cb2ae219b09aea832 [term 7 FOLLOWER]: Rejecting Update request from peer b7ab4784c7344b939bc36f639286f377 for earlier term 6. Current term is 7. Ops: []
I20260709 13:19:23.462379  9050 raft_consensus.cc:515] T 44bde925b2e541b69890d70715b85176 P b7ab4784c7344b939bc36f639286f377 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:22.960553  9210 raft_consensus.cc:515] T 1528ab62b6fe4e3099d08f141afee116 P b7ab4784c7344b939bc36f639286f377 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:19:23.494587  6876 raft_consensus.cc:2468] T 30e88460611e47b2ba16a46a30b5f416 P cd75a17ab2604397adab03bb8b5fd75c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 5.
I20260709 13:19:23.078930  9390 consensus_queue.cc:1048] T d8cee0accdb8499c86d4414b72565a38 P 7ba59cc884714e8aa5f3f0ecaed84cbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.427s
I20260709 13:19:23.144248  9465 raft_consensus.cc:493] T 9e326172347f45e99a0d482b5d8ef768 P b7ab4784c7344b939bc36f639286f377 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:19:23.500447  9466 leader_election.cc:290] T f5be3a11b23d4ea9b08300a2789821c7 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:22.975771  9406 raft_consensus.cc:515] T 711ef6523deb4cbe8ef2ba61e1c21c98 P cd75a17ab2604397adab03bb8b5fd75c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:23.504395  9046 raft_consensus.cc:2749] T f58dc08b12a2494bb9a1372837970ca2 P b7ab4784c7344b939bc36f639286f377 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:19:23.504463  9469 raft_consensus.cc:3060] T f03d0dbf16864ca4bc1bb5e4c0334c0f P b7ab4784c7344b939bc36f639286f377 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:23.484498  9360 raft_consensus.cc:515] T 30e88460611e47b2ba16a46a30b5f416 P b7ab4784c7344b939bc36f639286f377 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
W20260709 13:19:23.513509  6695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 528706us
I20260709 13:19:23.516445  9259 raft_consensus.cc:2804] T be1a92657f494cac8dd227d152f50151 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:19:23.517850  7502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3d8792045a4583ae2e965b1350a5b4" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb"
I20260709 13:19:23.483580  9351 raft_consensus.cc:515] T d8cee0accdb8499c86d4414b72565a38 P cd75a17ab2604397adab03bb8b5fd75c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:19:23.520812  6844 leader_election.cc:304] T 1bf4668eeb70467fb3dc5a0289233b3c P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
W20260709 13:19:23.522027  7468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 455501us
I20260709 13:19:23.418356  9384 leader_election.cc:290] T d33d5ee8ef6f415593d8df52063161ad P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:23.523396  6879 raft_consensus.cc:1240] T 3fa34c08b205435dba97346991aa1f92 P cd75a17ab2604397adab03bb8b5fd75c [term 8 FOLLOWER]: Rejecting Update request from peer 7ba59cc884714e8aa5f3f0ecaed84cbb for earlier term 7. Current term is 8. Ops: [7.7-7.7]
I20260709 13:19:23.188726  9462 raft_consensus.cc:493] T bd6869f07b5a4885a0b99fbe60c3b175 P b7ab4784c7344b939bc36f639286f377 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:23.528945  6725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a485a995abc4807b6e511e45419f737" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:19:23.528983  6878 raft_consensus.cc:1275] T 24ee15416e3145beaa1b8183453729a3 P cd75a17ab2604397adab03bb8b5fd75c [term 6 FOLLOWER]: Refusing update from remote peer 7ba59cc884714e8aa5f3f0ecaed84cbb: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:19:23.529939  6626 catalog_manager.cc:5697] T 9b3759de40694069b13c0f8bd40e5709 P ccd8a4c3bfe3413cb2ae219b09aea832 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } health_report { overall_health: UNKNOWN } } }
W20260709 13:19:23.533047  7466 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 46987.4us
I20260709 13:19:23.567906  9031 raft_consensus.cc:493] T 4275cf08e63345f993bce8664eada830 P b7ab4784c7344b939bc36f639286f377 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:23.575695  9350 raft_consensus.cc:493] T fe20b4b48823486ca3b9c648db6ce8aa P cd75a17ab2604397adab03bb8b5fd75c [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:23.584534  9218 leader_election.cc:290] T 24ee15416e3145beaa1b8183453729a3 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:19:23.584724  9350 raft_consensus.cc:515] T fe20b4b48823486ca3b9c648db6ce8aa P cd75a17ab2604397adab03bb8b5fd75c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:19:23.561777  9450 raft_consensus.cc:515] T 7c44c4849aa54f2b94d1f1bef9ed546f P b7ab4784c7344b939bc36f639286f377 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:23.586077  6877 raft_consensus.cc:1275] T 24ee15416e3145beaa1b8183453729a3 P cd75a17ab2604397adab03bb8b5fd75c [term 6 FOLLOWER]: Refusing update from remote peer 7ba59cc884714e8aa5f3f0ecaed84cbb: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 6. (term mismatch)
W20260709 13:19:23.541913  7467 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:23.589383  7500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8cee0accdb8499c86d4414b72565a38" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:19:23.535382  6873 raft_consensus.cc:1240] T 1528ab62b6fe4e3099d08f141afee116 P cd75a17ab2604397adab03bb8b5fd75c [term 6 FOLLOWER]: Rejecting Update request from peer 7ba59cc884714e8aa5f3f0ecaed84cbb for earlier term 5. Current term is 6. Ops: []
I20260709 13:19:23.591287  9384 consensus_queue.cc:1048] T f58dc08b12a2494bb9a1372837970ca2 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:19:23.591652  6873 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58592 (request call id 167) took 2965 ms. Trace:
I20260709 13:19:23.575842  9259 raft_consensus.cc:493] T be1a92657f494cac8dd227d152f50151 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 7ba59cc884714e8aa5f3f0ecaed84cbb)
I20260709 13:19:23.592454  9406 leader_election.cc:290] T 711ef6523deb4cbe8ef2ba61e1c21c98 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:19:23.592720  9259 raft_consensus.cc:3060] T be1a92657f494cac8dd227d152f50151 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:19:23.541342  9474 log.cc:927] Time spent T d8cee0accdb8499c86d4414b72565a38 P 7ba59cc884714e8aa5f3f0ecaed84cbb: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
I20260709 13:19:23.593014  9384 consensus_queue.cc:1059] T c4db81d9d329422bb3b4160ca4ac2d1d P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:19:23.593320  9466 consensus_queue.cc:1048] T 4275cf08e63345f993bce8664eada830 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:19:23.545207  6727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d33d5ee8ef6f415593d8df52063161ad" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:19:23.594135  9218 raft_consensus.cc:3055] T c4db81d9d329422bb3b4160ca4ac2d1d P ccd8a4c3bfe3413cb2ae219b09aea832 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:19:23.594429  6727 raft_consensus.cc:2468] T d33d5ee8ef6f415593d8df52063161ad P ccd8a4c3bfe3413cb2ae219b09aea832 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 7.
I20260709 13:19:23.594666  8832 raft_consensus.cc:3060] T 7c37d41cd9164c15a6826ca62a851a69 P b7ab4784c7344b939bc36f639286f377 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:19:22.987628  9344 raft_consensus.cc:515] T 853ac0a8cbd64ce99457f170216d4d0f P cd75a17ab2604397adab03bb8b5fd75c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:23.553308  9137 raft_consensus.cc:2804] T 3411566abe2d4c9bb4b2adfdd05e6f17 P b7ab4784c7344b939bc36f639286f377 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 13:19:23.550165  6772 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 65077.2us
I20260709 13:19:23.557296  6728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "713b5728a197487c9300b310ab94e5a3" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:19:23.595388  9137 raft_consensus.cc:493] T 3411566abe2d4c9bb4b2adfdd05e6f17 P b7ab4784c7344b939bc36f639286f377 [term 5 FOLLOWER]: Starting leader election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:19:23.558415  6880 raft_consensus.cc:1240] T 7ba5dac66ab5497e9e336f2a3c28cda5 P cd75a17ab2604397adab03bb8b5fd75c [term 8 FOLLOWER]: Rejecting Update request from peer 7ba59cc884714e8aa5f3f0ecaed84cbb for earlier term 7. Current term is 8. Ops: [7.8-7.8]
I20260709 13:19:23.557296  6875 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58592 (request call id 166) took 2926 ms. Trace:
I20260709 13:19:23.561136  6723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3411566abe2d4c9bb4b2adfdd05e6f17" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:19:23.559505  6876 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53406 (request call id 1530) took 1007 ms. Trace:
I20260709 13:19:23.567574  6872 raft_consensus.cc:1275] T 44bde925b2e541b69890d70715b85176 P cd75a17ab2604397adab03bb8b5fd75c [term 7 FOLLOWER]: Refusing update from remote peer ccd8a4c3bfe3413cb2ae219b09aea832: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:19:23.596863  6876 rpcz_store.cc:276] 0709 13:19:22.551853 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:22.705312 (+153459us) service_pool.cc:224] Handling call
0709 13:19:23.559436 (+854124us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:23.597319  9349 leader_election.cc:290] T 44bde925b2e541b69890d70715b85176 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:19:23.559069  9362 leader_election.cc:290] T ab432e62819d499eaaf3dd55481dd930 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:19:23.598209  6872 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53416 (request call id 2340) took 3350 ms. Trace:
I20260709 13:19:23.598291  9046 raft_consensus.cc:493] T 24ee15416e3145beaa1b8183453729a3 P b7ab4784c7344b939bc36f639286f377 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 7ba59cc884714e8aa5f3f0ecaed84cbb)
I20260709 13:19:23.574375  9273 leader_election.cc:290] T f09c2a98de1a4decabd0ff900dd44caa P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
W20260709 13:19:23.538260  6696 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:23.598963  9046 raft_consensus.cc:515] T 24ee15416e3145beaa1b8183453729a3 P b7ab4784c7344b939bc36f639286f377 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } attrs { replace: true } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:19:23.567572  6730 raft_consensus.cc:1275] T 853ac0a8cbd64ce99457f170216d4d0f P ccd8a4c3bfe3413cb2ae219b09aea832 [term 4 FOLLOWER]: Refusing update from remote peer b7ab4784c7344b939bc36f639286f377: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:19:23.547377  6731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c240553ce044eedb41541d72b9475d7" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:19:23.578250  9351 leader_election.cc:290] T d8cee0accdb8499c86d4414b72565a38 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:19:23.579607  9486 raft_consensus.cc:3060] T 1bf4668eeb70467fb3dc5a0289233b3c P cd75a17ab2604397adab03bb8b5fd75c [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:23.601709  9046 leader_election.cc:290] T 24ee15416e3145beaa1b8183453729a3 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:19:23.595880  9137 raft_consensus.cc:3060] T 3411566abe2d4c9bb4b2adfdd05e6f17 P b7ab4784c7344b939bc36f639286f377 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:23.576182  7502 raft_consensus.cc:3060] T bb3d8792045a4583ae2e965b1350a5b4 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:19:23.579907  7468 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:23.604568  7468 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:23.581462  9210 leader_election.cc:290] T 1528ab62b6fe4e3099d08f141afee116 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:19:23.581622  9360 leader_election.cc:290] T 30e88460611e47b2ba16a46a30b5f416 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 6 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:23.580879  6879 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58592 (request call id 171) took 2951 ms. Trace:
I20260709 13:19:23.606343  6879 rpcz_store.cc:276] 0709 13:19:20.629856 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:23.522505 (+2892649us) service_pool.cc:224] Handling call
0709 13:19:23.523071 (+   566us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:23.580543 (+ 57472us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:23.580806 (+   263us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:23.583976  6626 catalog_manager.cc:5697] T e77e330a82df4b43a745d57a68f6f057 P ccd8a4c3bfe3413cb2ae219b09aea832 reported cstate change: term changed from 2 to 6, leader changed from b7ab4784c7344b939bc36f639286f377 (127.5.126.66) to ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65). New cstate: current_term: 6 leader_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:23.581238  9462 raft_consensus.cc:515] T bd6869f07b5a4885a0b99fbe60c3b175 P b7ab4784c7344b939bc36f639286f377 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:23.608199  9465 raft_consensus.cc:515] T 9e326172347f45e99a0d482b5d8ef768 P b7ab4784c7344b939bc36f639286f377 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:23.577275  9452 leader_election.cc:290] T d8292e16e5654be6bc408560cf256aaa P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:23.609153  6626 catalog_manager.cc:5697] T a3022224cc81473690653a83d4e99470 P ccd8a4c3bfe3413cb2ae219b09aea832 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:23.610287  9137 raft_consensus.cc:515] T 3411566abe2d4c9bb4b2adfdd05e6f17 P b7ab4784c7344b939bc36f639286f377 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:23.596228  6875 rpcz_store.cc:276] 0709 13:19:20.626074 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:23.477091 (+2851017us) service_pool.cc:224] Handling call
0709 13:19:23.491201 (+ 14110us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:23.551691 (+ 60490us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:23.552052 (+   361us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:23.610865  6626 catalog_manager.cc:5697] T 404190ce4ce94cecbfcb6ea9d1dd8626 P ccd8a4c3bfe3413cb2ae219b09aea832 reported cstate change: term changed from 3 to 4, leader changed from 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68) to b7ab4784c7344b939bc36f639286f377 (127.5.126.66). New cstate: current_term: 4 leader_uuid: "b7ab4784c7344b939bc36f639286f377" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } } }
I20260709 13:19:23.582443  6878 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58592 (request call id 170) took 2952 ms. Trace:
I20260709 13:19:23.595831  6728 raft_consensus.cc:2468] T 713b5728a197487c9300b310ab94e5a3 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 6.
I20260709 13:19:23.583523  9031 raft_consensus.cc:515] T 4275cf08e63345f993bce8664eada830 P b7ab4784c7344b939bc36f639286f377 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:23.601536  6731 raft_consensus.cc:2393] T 2c240553ce044eedb41541d72b9475d7 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7ab4784c7344b939bc36f639286f377 in current term 8: Already voted for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in this term.
I20260709 13:19:23.596468  6880 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58592 (request call id 172) took 2966 ms. Trace:
I20260709 13:19:23.583302  7466 leader_election.cc:304] T 3fa34c08b205435dba97346991aa1f92 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
I20260709 13:19:23.612210  6878 rpcz_store.cc:276] 0709 13:19:20.629559 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:23.528216 (+2898657us) service_pool.cc:224] Handling call
0709 13:19:23.528640 (+   424us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:23.582188 (+ 53548us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:23.582386 (+   198us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:23.592113  6873 rpcz_store.cc:276] 0709 13:19:20.626363 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:23.480497 (+2854134us) service_pool.cc:224] Handling call
0709 13:19:23.531554 (+ 51057us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:23.591410 (+ 59856us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:23.591593 (+   183us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:23.551554  9461 raft_consensus.cc:515] T 34f36d59d88f40fe8a2805e604fc6c0a P cd75a17ab2604397adab03bb8b5fd75c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:23.598971  6876 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53406 (request call id 1514) took 2955 ms. Trace:
I20260709 13:19:23.587517  9450 leader_election.cc:290] T 7c44c4849aa54f2b94d1f1bef9ed546f P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:23.610704  9462 leader_election.cc:290] T bd6869f07b5a4885a0b99fbe60c3b175 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:23.629886  6873 raft_consensus.cc:1275] T 7ba5dac66ab5497e9e336f2a3c28cda5 P cd75a17ab2604397adab03bb8b5fd75c [term 8 FOLLOWER]: Refusing update from remote peer b7ab4784c7344b939bc36f639286f377: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:19:23.630291  6879 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53406 (request call id 1515) took 2969 ms. Trace:
I20260709 13:19:23.630615  6873 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53406 (request call id 1519) took 1167 ms. Trace:
I20260709 13:19:23.629081  6876 rpcz_store.cc:276] 0709 13:19:20.645681 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:23.597866 (+2952185us) service_pool.cc:224] Handling call
0709 13:19:23.598329 (+   463us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:23.598594 (+   265us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:23.598621 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:23.598665 (+    44us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:19:23.598723 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:23.598780 (+    57us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:23.598899 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:23.598670  6872 rpcz_store.cc:276] 0709 13:19:20.248272 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:23.464825 (+3216553us) service_pool.cc:224] Handling call
0709 13:19:23.529453 (+ 64628us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:23.597388 (+ 67935us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:23.597946 (+   558us) spinlock_profiling.cc:243] Waited 35.1 ms on lock 0x7b54001e7dd4. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f9aae01 00007fcc0f9a983e 00007fcc1496e419 00007fcc0dee5bd4 00007fcc0dee5b62 00007fcc0dee5a91 00007fcc0dee5a0c 00007fcc0dee4cc2 00007fcc0dce548c 00007fcc0dce48c6
0709 13:19:23.598134 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":80807808}
W20260709 13:19:23.579245  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 58732.9us
I20260709 13:19:23.617909  7502 raft_consensus.cc:2468] T bb3d8792045a4583ae2e965b1350a5b4 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 7.
I20260709 13:19:23.619064  6881 raft_consensus.cc:1240] T 44bde925b2e541b69890d70715b85176 P cd75a17ab2604397adab03bb8b5fd75c [term 7 FOLLOWER]: Rejecting Update request from peer b7ab4784c7344b939bc36f639286f377 for earlier term 6. Current term is 7. Ops: []
I20260709 13:19:23.612254  6875 raft_consensus.cc:1240] T bb3d8792045a4583ae2e965b1350a5b4 P cd75a17ab2604397adab03bb8b5fd75c [term 7 FOLLOWER]: Rejecting Update request from peer ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 6. Current term is 7. Ops: []
I20260709 13:19:23.630760  6879 rpcz_store.cc:276] 0709 13:19:20.650973 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:23.607430 (+2956457us) service_pool.cc:224] Handling call
0709 13:19:23.607832 (+   402us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:23.608017 (+   185us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:23.613647 (+  5630us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:23.613699 (+    52us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:19:23.620597 (+  6898us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:23.620665 (+    68us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:23.620774 (+   109us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:23.631151  6873 rpcz_store.cc:276] 0709 13:19:22.463706 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:23.620693 (+1156987us) service_pool.cc:224] Handling call
0709 13:19:23.621050 (+   357us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:23.630345 (+  9295us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:23.630559 (+   214us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:23.636392  6727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1704639a875409b9959353527b3fd68" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:19:23.634332  6732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4db81d9d329422bb3b4160ca4ac2d1d" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:19:23.637846  6730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab432e62819d499eaaf3dd55481dd930" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:19:23.640328  6875 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53416 (request call id 2345) took 1193 ms. Trace:
I20260709 13:19:23.640753  6875 rpcz_store.cc:276] 0709 13:19:22.448256 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:23.611708 (+1163452us) service_pool.cc:224] Handling call
0709 13:19:23.612063 (+   355us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:23.634590 (+ 22527us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:23.634839 (+   249us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:23.582782  9050 leader_election.cc:290] T 44bde925b2e541b69890d70715b85176 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:23.645754  9125 raft_consensus.cc:2804] T 3fa34c08b205435dba97346991aa1f92 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:19:23.594569  9218 raft_consensus.cc:740] T c4db81d9d329422bb3b4160ca4ac2d1d P ccd8a4c3bfe3413cb2ae219b09aea832 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
I20260709 13:19:23.646476  9125 raft_consensus.cc:697] T 3fa34c08b205435dba97346991aa1f92 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 9 LEADER]: Becoming Leader. State: Replica: 7ba59cc884714e8aa5f3f0ecaed84cbb, State: Running, Role: LEADER
I20260709 13:19:23.647341  9218 consensus_queue.cc:260] T c4db81d9d329422bb3b4160ca4ac2d1d P ccd8a4c3bfe3413cb2ae219b09aea832 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:23.648919  9218 raft_consensus.cc:3060] T c4db81d9d329422bb3b4160ca4ac2d1d P ccd8a4c3bfe3413cb2ae219b09aea832 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:23.595903  6772 leader_election.cc:304] T de3186201e1a40d0b335eeb8b4e256e0 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:19:23.649868  6626 catalog_manager.cc:5697] T d33d5ee8ef6f415593d8df52063161ad P ccd8a4c3bfe3413cb2ae219b09aea832 reported cstate change: term changed from 1 to 4, leader changed from b7ab4784c7344b939bc36f639286f377 (127.5.126.66) to ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65). New cstate: current_term: 4 leader_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:23.581594  6726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09c2a98de1a4decabd0ff900dd44caa" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:19:23.646240  9031 leader_election.cc:290] T 4275cf08e63345f993bce8664eada830 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:23.619328  6880 rpcz_store.cc:276] 0709 13:19:20.630140 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:23.533461 (+2903321us) service_pool.cc:224] Handling call
0709 13:19:23.558153 (+ 24692us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:23.596162 (+ 38009us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:23.596407 (+   245us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:23.610796  9465 leader_election.cc:290] T 9e326172347f45e99a0d482b5d8ef768 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:23.576205  6729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a75bfe094d4bdc963aba3f08dfcd25" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 8 candidate_status { last_received { term: 7 index: 2 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:19:23.645205  9351 raft_consensus.cc:493] T 7a734b5ab7834e05a8c422208acc58b1 P cd75a17ab2604397adab03bb8b5fd75c [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:23.653069  6728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24ee15416e3145beaa1b8183453729a3" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:19:23.615144  6877 pending_rounds.cc:85] T 24ee15416e3145beaa1b8183453729a3 P cd75a17ab2604397adab03bb8b5fd75c: Aborting all ops after (but not including) 5
I20260709 13:19:23.656268  6727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17587d6730594da4a56fa13a353232a1" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:19:23.664096  6877 pending_rounds.cc:107] T 24ee15416e3145beaa1b8183453729a3 P cd75a17ab2604397adab03bb8b5fd75c: Aborting uncommitted NO_OP operation due to leader change: 5.6
I20260709 13:19:23.664644  6877 raft_consensus.cc:2889] T 24ee15416e3145beaa1b8183453729a3 P cd75a17ab2604397adab03bb8b5fd75c [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:19:23.667548  6878 raft_consensus.cc:1275] T bb7fa124c3bf4ef9ab65a407cb008441 P cd75a17ab2604397adab03bb8b5fd75c [term 8 FOLLOWER]: Refusing update from remote peer b7ab4784c7344b939bc36f639286f377: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:19:23.668344  6878 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53406 (request call id 1518) took 1205 ms. Trace:
I20260709 13:19:23.668676  6878 rpcz_store.cc:276] 0709 13:19:22.463219 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:23.620375 (+1157156us) service_pool.cc:224] Handling call
0709 13:19:23.640735 (+ 20360us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:23.668005 (+ 27270us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:23.668277 (+   272us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:23.669778  6875 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53406 (request call id 1533) took 1061 ms. Trace:
I20260709 13:19:23.670205  6875 rpcz_store.cc:276] 0709 13:19:22.608867 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:23.668685 (+1059818us) service_pool.cc:224] Handling call
0709 13:19:23.669096 (+   411us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:23.669427 (+   331us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:23.669453 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:23.669509 (+    56us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:19:23.669563 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:23.669627 (+    64us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:23.669725 (+    98us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:23.681246  6881 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53406 (request call id 1513) took 3038 ms. Trace:
I20260709 13:19:23.684957  9350 leader_election.cc:290] T fe20b4b48823486ca3b9c648db6ce8aa P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:19:23.681624  6881 rpcz_store.cc:276] 0709 13:19:20.643044 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:23.539117 (+2896073us) service_pool.cc:224] Handling call
0709 13:19:23.618915 (+ 79798us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:23.638154 (+ 19239us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:23.680996 (+ 42842us) spinlock_profiling.cc:243] Waited 75.7 ms on lock 0x7b54001e7dd0. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f9a98ad 00007fcc1496e419 00007fcc0dee5bd4 00007fcc0dee5b62 00007fcc0dee5a91 00007fcc0dee5a0c 00007fcc0dee4cc2 00007fcc0dce548c 00007fcc0dce48c6 00007fcc0dce426f
0709 13:19:23.681168 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":174213888}
I20260709 13:19:23.645771  9461 leader_election.cc:290] T 34f36d59d88f40fe8a2805e604fc6c0a P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:19:23.687203  6876 raft_consensus.cc:1275] T 853ac0a8cbd64ce99457f170216d4d0f P cd75a17ab2604397adab03bb8b5fd75c [term 4 FOLLOWER]: Refusing update from remote peer b7ab4784c7344b939bc36f639286f377: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:19:23.688571  6726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f03d0dbf16864ca4bc1bb5e4c0334c0f" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:19:23.699877  6880 raft_consensus.cc:1240] T 20f6842e26174571996b8dea4151d4be P cd75a17ab2604397adab03bb8b5fd75c [term 7 FOLLOWER]: Rejecting Update request from peer b7ab4784c7344b939bc36f639286f377 for earlier term 6. Current term is 7. Ops: []
I20260709 13:19:23.692440  7502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe20b4b48823486ca3b9c648db6ce8aa" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:19:23.689432  6876 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53406 (request call id 1520) took 1225 ms. Trace:
I20260709 13:19:23.680783  6626 catalog_manager.cc:5697] T de3186201e1a40d0b335eeb8b4e256e0 P ccd8a4c3bfe3413cb2ae219b09aea832 reported cstate change: term changed from 1 to 3, leader changed from b7ab4784c7344b939bc36f639286f377 (127.5.126.66) to ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65). New cstate: current_term: 3 leader_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:23.701973  7502 raft_consensus.cc:2393] T fe20b4b48823486ca3b9c648db6ce8aa P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c in current term 5: Already voted for candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in this term.
I20260709 13:19:23.701817  6876 rpcz_store.cc:276] 0709 13:19:22.464167 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:23.655610 (+1191443us) service_pool.cc:224] Handling call
0709 13:19:23.675697 (+ 20087us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:23.689134 (+ 13437us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:23.689360 (+   226us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:23.700430  6872 raft_consensus.cc:1240] T 7c44c4849aa54f2b94d1f1bef9ed546f P cd75a17ab2604397adab03bb8b5fd75c [term 8 LEADER]: Rejecting Update request from peer b7ab4784c7344b939bc36f639286f377 for earlier term 7. Current term is 8. Ops: []
I20260709 13:19:23.631220  9466 consensus_queue.cc:1048] T f09c2a98de1a4decabd0ff900dd44caa P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.048s
I20260709 13:19:23.704296  6880 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53406 (request call id 1524) took 1167 ms. Trace:
I20260709 13:19:23.710335  6880 rpcz_store.cc:276] 0709 13:19:22.536747 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:23.653015 (+1116268us) service_pool.cc:224] Handling call
0709 13:19:23.670434 (+ 17419us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:23.704027 (+ 33593us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:23.704243 (+   216us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:23.704926  6872 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53406 (request call id 1522) took 1239 ms. Trace:
I20260709 13:19:23.711313  6872 rpcz_store.cc:276] 0709 13:19:22.465080 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:23.658497 (+1193417us) service_pool.cc:224] Handling call
0709 13:19:23.679195 (+ 20698us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:23.704619 (+ 25424us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:23.704859 (+   240us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:19:23.711725  6697 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 212922us
I20260709 13:19:23.691119  6846 leader_election.cc:304] T bb3d8792045a4583ae2e965b1350a5b4 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:19:23.716852  6877 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58592 (request call id 164) took 3091 ms. Trace:
I20260709 13:19:23.717343  6877 rpcz_store.cc:276] 0709 13:19:20.625269 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:23.475698 (+2850429us) service_pool.cc:224] Handling call
0709 13:19:23.585665 (+109967us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:23.707051 (+121386us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:23.716654 (+  9603us) spinlock_profiling.cc:243] Waited 36.7 ms on lock 0x7b5400237dd0. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f9a98ad 00007fcc1496e419 00007fcc0dee5bd4 00007fcc0dee5b62 00007fcc0dee5a91 00007fcc0dee5a0c 00007fcc0dee4cc2 00007fcc0dce548c 00007fcc0dce48c6 00007fcc0dce426f
0709 13:19:23.716790 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":84297472}
W20260709 13:19:23.718822  6772 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 123042us
I20260709 13:19:23.686761  9351 raft_consensus.cc:515] T 7a734b5ab7834e05a8c422208acc58b1 P cd75a17ab2604397adab03bb8b5fd75c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:23.719935  6772 leader_election.cc:304] T d33d5ee8ef6f415593d8df52063161ad P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:19:23.686165  9273 raft_consensus.cc:493] T b56bf91d90824c959e21e0cee5ba1816 P cd75a17ab2604397adab03bb8b5fd75c [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:23.721446  9485 log.cc:927] Time spent T a1704639a875409b9959353527b3fd68 P b7ab4784c7344b939bc36f639286f377: Append to log took a long time: real 0.093s	user 0.000s	sys 0.000s
I20260709 13:19:23.721324  9273 raft_consensus.cc:515] T b56bf91d90824c959e21e0cee5ba1816 P cd75a17ab2604397adab03bb8b5fd75c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:23.721712  9351 leader_election.cc:290] T 7a734b5ab7834e05a8c422208acc58b1 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:19:23.707351  9428 raft_consensus.cc:493] T 20f6842e26174571996b8dea4151d4be P cd75a17ab2604397adab03bb8b5fd75c [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:23.723857  9273 leader_election.cc:290] T b56bf91d90824c959e21e0cee5ba1816 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:19:23.724714  9428 raft_consensus.cc:515] T 20f6842e26174571996b8dea4151d4be P cd75a17ab2604397adab03bb8b5fd75c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
W20260709 13:19:23.741557  6846 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.68:45071, user_credentials={real_user=slave}} blocked reactor thread for 50581.9us
I20260709 13:19:23.647717  9125 consensus_queue.cc:237] T 3fa34c08b205435dba97346991aa1f92 P 7ba59cc884714e8aa5f3f0ecaed84cbb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:19:23.722532  6626 catalog_manager.cc:5697] T 9e326172347f45e99a0d482b5d8ef768 P ccd8a4c3bfe3413cb2ae219b09aea832 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "b7ab4784c7344b939bc36f639286f377" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } }
I20260709 13:19:23.751739  6727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbdf895bba214ff68685a24fd17dfb5d" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:19:23.754285  6730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7887766dc6784fcaa42b35c05fea7a99" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:19:23.755517  6874 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53416 (request call id 2339) took 3640 ms. Trace:
I20260709 13:19:23.755760  6732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f03d0dbf16864ca4bc1bb5e4c0334c0f" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:19:23.755957  6874 rpcz_store.cc:276] 0709 13:19:20.115180 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:23.463128 (+3347948us) service_pool.cc:224] Handling call
0709 13:19:23.484520 (+ 21392us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:23.493503 (+  8983us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:23.493537 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:23.494113 (+   576us) log.cc:844] Serialized 26 byte log entry
0709 13:19:23.674154 (+180041us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:19:23.674200 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:23.674273 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:23.755283 (+ 81010us) raft_consensus.cc:1685] finished
0709 13:19:23.755303 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:23.755449 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":179583,"threads_started":1,"wal-append.queue_time_us":253099}
I20260709 13:19:23.707783  9465 raft_consensus.cc:2749] T de3186201e1a40d0b335eeb8b4e256e0 P b7ab4784c7344b939bc36f639286f377 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:19:23.760869  6726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d9def8b32fd443aa94ab1420b06837b" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:19:23.759229  6626 catalog_manager.cc:5697] T f4b8bd455d5a47c18a1380839c6e0d61 P ccd8a4c3bfe3413cb2ae219b09aea832 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } health_report { overall_health: UNKNOWN } } }
W20260709 13:19:23.764324  6770 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 51488.3us
I20260709 13:19:23.764844  6729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce4f062dcd314d43a63ca74067cb5ee3" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:19:23.764362  6728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d65025eea89441290d85dd053810e31" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:19:23.762949  6726 raft_consensus.cc:2376] T 4d9def8b32fd443aa94ab1420b06837b P ccd8a4c3bfe3413cb2ae219b09aea832 [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 7. Re-sending same reply.
I20260709 13:19:23.770443  6727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77e330a82df4b43a745d57a68f6f057" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:19:23.750234  9461 raft_consensus.cc:2804] T bb3d8792045a4583ae2e965b1350a5b4 P cd75a17ab2604397adab03bb8b5fd75c [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:19:23.775555  6772 leader_election.cc:304] T 95a75bfe094d4bdc963aba3f08dfcd25 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:19:23.764788  9490 raft_consensus.cc:2804] T d33d5ee8ef6f415593d8df52063161ad P b7ab4784c7344b939bc36f639286f377 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:19:23.777786  6729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a734b5ab7834e05a8c422208acc58b1" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:19:23.778769  6729 raft_consensus.cc:2393] T 7a734b5ab7834e05a8c422208acc58b1 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate b7ab4784c7344b939bc36f639286f377 in current term 7: Already voted for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in this term.
I20260709 13:19:23.780300  9031 raft_consensus.cc:2804] T 95a75bfe094d4bdc963aba3f08dfcd25 P b7ab4784c7344b939bc36f639286f377 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:19:23.780769  9031 raft_consensus.cc:493] T 95a75bfe094d4bdc963aba3f08dfcd25 P b7ab4784c7344b939bc36f639286f377 [term 7 FOLLOWER]: Starting leader election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:19:23.781122  9031 raft_consensus.cc:3060] T 95a75bfe094d4bdc963aba3f08dfcd25 P b7ab4784c7344b939bc36f639286f377 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:23.782856  9461 raft_consensus.cc:697] T bb3d8792045a4583ae2e965b1350a5b4 P cd75a17ab2604397adab03bb8b5fd75c [term 7 LEADER]: Becoming Leader. State: Replica: cd75a17ab2604397adab03bb8b5fd75c, State: Running, Role: LEADER
I20260709 13:19:23.783949  9461 consensus_queue.cc:237] T bb3d8792045a4583ae2e965b1350a5b4 P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:19:23.784675  6772 leader_election.cc:304] T 713b5728a197487c9300b310ab94e5a3 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:19:23.787443  9176 raft_consensus.cc:2804] T 713b5728a197487c9300b310ab94e5a3 P b7ab4784c7344b939bc36f639286f377 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:19:23.787906  9176 raft_consensus.cc:493] T 713b5728a197487c9300b310ab94e5a3 P b7ab4784c7344b939bc36f639286f377 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:23.777813  9490 raft_consensus.cc:493] T d33d5ee8ef6f415593d8df52063161ad P b7ab4784c7344b939bc36f639286f377 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:23.788329  9176 raft_consensus.cc:3060] T 713b5728a197487c9300b310ab94e5a3 P b7ab4784c7344b939bc36f639286f377 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:23.788548  9490 raft_consensus.cc:3060] T d33d5ee8ef6f415593d8df52063161ad P b7ab4784c7344b939bc36f639286f377 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:23.793138  9050 consensus_queue.cc:1048] T 7ba5dac66ab5497e9e336f2a3c28cda5 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:19:23.795894  9462 consensus_queue.cc:1048] T bb7fa124c3bf4ef9ab65a407cb008441 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:19:23.796690  9465 consensus_queue.cc:1048] T 853ac0a8cbd64ce99457f170216d4d0f P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:19:23.797791  9366 leader_election.cc:290] T fe20b4b48823486ca3b9c648db6ce8aa P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 5 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:23.798897  6729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3411566abe2d4c9bb4b2adfdd05e6f17" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:19:23.800627  9465 consensus_queue.cc:1059] T 20f6842e26174571996b8dea4151d4be P b7ab4784c7344b939bc36f639286f377 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:19:23.801569  9450 raft_consensus.cc:3055] T 20f6842e26174571996b8dea4151d4be P b7ab4784c7344b939bc36f639286f377 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:19:23.802021  9450 raft_consensus.cc:740] T 20f6842e26174571996b8dea4151d4be P b7ab4784c7344b939bc36f639286f377 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
I20260709 13:19:23.802834  6728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e31b9971c15848dea59d4d4130141d9e" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:19:23.803195  9450 consensus_queue.cc:260] T 20f6842e26174571996b8dea4151d4be P b7ab4784c7344b939bc36f639286f377 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:23.800834  6723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77e330a82df4b43a745d57a68f6f057" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:19:23.816224  9450 raft_consensus.cc:3060] T 20f6842e26174571996b8dea4151d4be P b7ab4784c7344b939bc36f639286f377 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:23.816502  6723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24ee15416e3145beaa1b8183453729a3" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:19:23.817634  6723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a75bfe094d4bdc963aba3f08dfcd25" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 8 candidate_status { last_received { term: 7 index: 2 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:19:23.818599  6723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1528ab62b6fe4e3099d08f141afee116" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:19:23.819346  6723 raft_consensus.cc:2393] T 1528ab62b6fe4e3099d08f141afee116 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7ab4784c7344b939bc36f639286f377 in current term 6: Already voted for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in this term.
I20260709 13:19:23.819718  7500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24ee15416e3145beaa1b8183453729a3" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:19:23.804419  6728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5be3a11b23d4ea9b08300a2789821c7" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:19:23.806469  6729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f9c2e2bf644115957398fe4c9459db" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:19:23.806520  6724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6869f07b5a4885a0b99fbe60c3b175" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 6 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:19:23.808451  6725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b8cacb381b746da8d0049b0a83b41dd" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:19:23.808954  9487 consensus_queue.cc:1048] T 7ba5dac66ab5497e9e336f2a3c28cda5 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:19:23.821432  6724 raft_consensus.cc:2393] T bd6869f07b5a4885a0b99fbe60c3b175 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c in current term 6: Already voted for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in this term.
I20260709 13:19:23.809437  9486 raft_consensus.cc:2749] T 1bf4668eeb70467fb3dc5a0289233b3c P cd75a17ab2604397adab03bb8b5fd75c [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:19:23.822513  6724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bf4668eeb70467fb3dc5a0289233b3c" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:19:23.810002  9137 leader_election.cc:290] T 3411566abe2d4c9bb4b2adfdd05e6f17 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 6 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:23.823060  6878 raft_consensus.cc:1240] T 1bf4668eeb70467fb3dc5a0289233b3c P cd75a17ab2604397adab03bb8b5fd75c [term 6 FOLLOWER]: Rejecting Update request from peer ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 5. Current term is 6. Ops: []
I20260709 13:19:23.823468  6724 raft_consensus.cc:2410] T 1bf4668eeb70467fb3dc5a0289233b3c P ccd8a4c3bfe3413cb2ae219b09aea832 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7ab4784c7344b939bc36f639286f377 for term 7 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:19:23.823040  6728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30e88460611e47b2ba16a46a30b5f416" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:19:23.824324  6728 raft_consensus.cc:3060] T 30e88460611e47b2ba16a46a30b5f416 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:23.827612  6877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a92dd554674067a83a9cb68c4773f2" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:19:23.828235  6723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "711ef6523deb4cbe8ef2ba61e1c21c98" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:19:23.829772  6729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f58dc08b12a2494bb9a1372837970ca2" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:19:23.829888  6880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab432e62819d499eaaf3dd55481dd930" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:19:23.830575  6880 raft_consensus.cc:2468] T ab432e62819d499eaaf3dd55481dd930 P cd75a17ab2604397adab03bb8b5fd75c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 7.
I20260709 13:19:23.830955  6729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c240553ce044eedb41541d72b9475d7" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:19:23.831746  6729 raft_consensus.cc:2410] T 2c240553ce044eedb41541d72b9475d7 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c for term 9 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 13:19:23.824452  6724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8292e16e5654be6bc408560cf256aaa" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:19:23.813777  6732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3d8792045a4583ae2e965b1350a5b4" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:19:23.814599  6730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fa34c08b205435dba97346991aa1f92" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 9 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:19:23.831571  6872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7887766dc6784fcaa42b35c05fea7a99" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:19:23.838883  6728 raft_consensus.cc:2468] T 30e88460611e47b2ba16a46a30b5f416 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 6.
I20260709 13:19:23.846657  6728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe20b4b48823486ca3b9c648db6ce8aa" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:19:23.847610  6730 raft_consensus.cc:2393] T 3fa34c08b205435dba97346991aa1f92 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c in current term 9: Already voted for candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in this term.
I20260709 13:19:23.851641  7502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1528ab62b6fe4e3099d08f141afee116" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:19:23.811655  9428 leader_election.cc:290] T 20f6842e26174571996b8dea4151d4be P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:19:23.856310  6876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "711ef6523deb4cbe8ef2ba61e1c21c98" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:19:23.860479  6876 raft_consensus.cc:2468] T 711ef6523deb4cbe8ef2ba61e1c21c98 P cd75a17ab2604397adab03bb8b5fd75c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 7.
I20260709 13:19:23.853538  7502 raft_consensus.cc:2468] T 1528ab62b6fe4e3099d08f141afee116 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 6.
I20260709 13:19:23.854573  6729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44bde925b2e541b69890d70715b85176" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:19:23.854871  9487 raft_consensus.cc:493] T 8c7f33e544204fbaac4078e3e83bbf4e P b7ab4784c7344b939bc36f639286f377 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:23.857798  6724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3d8792045a4583ae2e965b1350a5b4" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:19:23.858503  6725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a92dd554674067a83a9cb68c4773f2" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:19:23.866670  6872 raft_consensus.cc:2468] T 7887766dc6784fcaa42b35c05fea7a99 P cd75a17ab2604397adab03bb8b5fd75c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 6.
I20260709 13:19:23.875890  6879 raft_consensus.cc:1275] T a1704639a875409b9959353527b3fd68 P cd75a17ab2604397adab03bb8b5fd75c [term 6 FOLLOWER]: Refusing update from remote peer b7ab4784c7344b939bc36f639286f377: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:19:23.877655  6875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b3759de40694069b13c0f8bd40e5709" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:19:23.879305  6877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bf4668eeb70467fb3dc5a0289233b3c" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:19:23.865032  6873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8292e16e5654be6bc408560cf256aaa" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:19:23.880187  6877 raft_consensus.cc:2410] T 1bf4668eeb70467fb3dc5a0289233b3c P cd75a17ab2604397adab03bb8b5fd75c [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7ab4784c7344b939bc36f639286f377 for term 7 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
W20260709 13:19:23.881536  6770 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:23.885097  6726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b3759de40694069b13c0f8bd40e5709" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:19:23.887030  6772 leader_election.cc:304] T 1528ab62b6fe4e3099d08f141afee116 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, b7ab4784c7344b939bc36f639286f377; no voters: 
I20260709 13:19:23.894775  6732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab432e62819d499eaaf3dd55481dd930" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:19:23.896550  6732 raft_consensus.cc:1240] T 4d9def8b32fd443aa94ab1420b06837b P ccd8a4c3bfe3413cb2ae219b09aea832 [term 7 FOLLOWER]: Rejecting Update request from peer cd75a17ab2604397adab03bb8b5fd75c for earlier term 6. Current term is 7. Ops: []
I20260709 13:19:23.905189  6873 raft_consensus.cc:2410] T d8292e16e5654be6bc408560cf256aaa P cd75a17ab2604397adab03bb8b5fd75c [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7ab4784c7344b939bc36f639286f377 for term 9 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 13:19:23.913326  6872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30e88460611e47b2ba16a46a30b5f416" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:19:23.914204  6872 raft_consensus.cc:3060] T 30e88460611e47b2ba16a46a30b5f416 P cd75a17ab2604397adab03bb8b5fd75c [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:23.767867  9469 raft_consensus.cc:515] T f03d0dbf16864ca4bc1bb5e4c0334c0f P b7ab4784c7344b939bc36f639286f377 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:23.917184  6724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22ccee1b570c4ad3a57bd7aec085b1b4" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:19:23.918555  6730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c44c4849aa54f2b94d1f1bef9ed546f" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:19:23.921836  6807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbdf895bba214ff68685a24fd17dfb5d" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
W20260709 13:19:23.923046  6695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 193329us
W20260709 13:19:23.924431  6844 connection.cc:256] RPC call timeout handler was delayed by -2.7924820110001747s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1668s for a response
I20260709 13:19:23.914677  6697 leader_election.cc:304] T 7a734b5ab7834e05a8c422208acc58b1 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:19:23.928730  6725 raft_consensus.cc:3060] T 07a92dd554674067a83a9cb68c4773f2 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:23.921082  6802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce4f062dcd314d43a63ca74067cb5ee3" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:19:23.930203  6876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44bde925b2e541b69890d70715b85176" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:19:23.931053  6876 raft_consensus.cc:2468] T 44bde925b2e541b69890d70715b85176 P cd75a17ab2604397adab03bb8b5fd75c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 7.
I20260709 13:19:23.906711  9215 consensus_queue.cc:1048] T 24ee15416e3145beaa1b8183453729a3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.028s
I20260709 13:19:23.936178  6799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77e330a82df4b43a745d57a68f6f057" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:19:23.934667  6800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d65025eea89441290d85dd053810e31" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:19:23.940182  6728 raft_consensus.cc:3060] T fe20b4b48823486ca3b9c648db6ce8aa P ccd8a4c3bfe3413cb2ae219b09aea832 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:19:23.941291  6729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09c2a98de1a4decabd0ff900dd44caa" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:19:23.913509  9465 raft_consensus.cc:2804] T 1528ab62b6fe4e3099d08f141afee116 P b7ab4784c7344b939bc36f639286f377 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:19:23.944173  6878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c44c4849aa54f2b94d1f1bef9ed546f" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
W20260709 13:19:23.945513  6697 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 73302.1us
W20260709 13:19:23.947016  6844 connection.cc:256] RPC call timeout handler was delayed by -2.2983820110000579s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2217s for a response
I20260709 13:19:23.948165  6732 raft_consensus.cc:1275] T 7c37d41cd9164c15a6826ca62a851a69 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 5 FOLLOWER]: Refusing update from remote peer cd75a17ab2604397adab03bb8b5fd75c: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:19:23.949827  6724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe20b4b48823486ca3b9c648db6ce8aa" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:19:23.849996  9259 raft_consensus.cc:515] T be1a92657f494cac8dd227d152f50151 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:19:23.918524  9428 raft_consensus.cc:493] T a1704639a875409b9959353527b3fd68 P cd75a17ab2604397adab03bb8b5fd75c [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:23.953192  6876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24ee15416e3145beaa1b8183453729a3" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:19:23.953598  6732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44bde925b2e541b69890d70715b85176" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:19:23.955672  6876 raft_consensus.cc:2468] T 24ee15416e3145beaa1b8183453729a3 P cd75a17ab2604397adab03bb8b5fd75c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 6.
I20260709 13:19:23.883524  9451 raft_consensus.cc:515] T e77e330a82df4b43a745d57a68f6f057 P b7ab4784c7344b939bc36f639286f377 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } }
I20260709 13:19:23.866745  9176 raft_consensus.cc:515] T 713b5728a197487c9300b310ab94e5a3 P b7ab4784c7344b939bc36f639286f377 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:23.967389  6729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "711ef6523deb4cbe8ef2ba61e1c21c98" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
W20260709 13:19:23.969249  6844 connection.cc:256] RPC call timeout handler was delayed by -1.6976663350001218s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1504s for a response
I20260709 13:19:23.875969  9487 raft_consensus.cc:515] T 8c7f33e544204fbaac4078e3e83bbf4e P b7ab4784c7344b939bc36f639286f377 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
W20260709 13:19:23.969887  6844 connection.cc:256] RPC call timeout handler was delayed by -1.6976663350001218s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1504s for a response
W20260709 13:19:23.973029  6844 connection.cc:256] RPC call timeout handler was delayed by -1.6607663350000621s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1545s for a response
W20260709 13:19:23.973500  6844 connection.cc:256] RPC call timeout handler was delayed by -1.6607663350000621s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1545s for a response
W20260709 13:19:23.973861  6844 connection.cc:256] RPC call timeout handler was delayed by -1.5788663349999297s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1636s for a response
I20260709 13:19:23.974078  6807 raft_consensus.cc:1240] T 4d9def8b32fd443aa94ab1420b06837b P b7ab4784c7344b939bc36f639286f377 [term 7 FOLLOWER]: Rejecting Update request from peer cd75a17ab2604397adab03bb8b5fd75c for earlier term 6. Current term is 7. Ops: []
W20260709 13:19:23.974404  6844 connection.cc:256] RPC call timeout handler was delayed by -1.5788663349999297s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1636s for a response
I20260709 13:19:23.974740  6730 raft_consensus.cc:1275] T 8c7f33e544204fbaac4078e3e83bbf4e P ccd8a4c3bfe3413cb2ae219b09aea832 [term 4 FOLLOWER]: Refusing update from remote peer cd75a17ab2604397adab03bb8b5fd75c: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
W20260709 13:19:23.974970  6844 connection.cc:256] RPC call timeout handler was delayed by -1.4240663350001341s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18080000000000002s for a response
W20260709 13:19:23.975457  6844 connection.cc:256] RPC call timeout handler was delayed by -1.4240663350001341s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18080000000000002s for a response
W20260709 13:19:23.975816  6844 connection.cc:256] RPC call timeout handler was delayed by -1.3538663350000206s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1886s for a response
W20260709 13:19:23.976500  6844 connection.cc:256] RPC call timeout handler was delayed by -1.316966334999961s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1927s for a response
W20260709 13:19:23.976891  6844 connection.cc:256] RPC call timeout handler was delayed by -1.316966334999961s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1927s for a response
I20260709 13:19:23.977679  6731 raft_consensus.cc:1240] T be1a92657f494cac8dd227d152f50151 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 8 FOLLOWER]: Rejecting Update request from peer 7ba59cc884714e8aa5f3f0ecaed84cbb for earlier term 7. Current term is 8. Ops: []
W20260709 13:19:23.977247  6844 connection.cc:256] RPC call timeout handler was delayed by -1.2422663350000676s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20099999999999998s for a response
W20260709 13:19:23.978354  6844 connection.cc:256] RPC call timeout handler was delayed by -1.2422663350000676s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20099999999999998s for a response
W20260709 13:19:23.978845  6844 connection.cc:256] RPC call timeout handler was delayed by -1.0748663350000243s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21960000000000002s for a response
W20260709 13:19:23.979161  6844 connection.cc:256] RPC call timeout handler was delayed by -1.0748663350000243s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21960000000000002s for a response
W20260709 13:19:23.979478  6844 connection.cc:256] RPC call timeout handler was delayed by -1.0478663349999806s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22260000000000002s for a response
I20260709 13:19:23.983295  6805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f03d0dbf16864ca4bc1bb5e4c0334c0f" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:19:23.938512  9215 consensus_queue.cc:1243] T 24ee15416e3145beaa1b8183453729a3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [LEADER]: Peer cd75a17ab2604397adab03bb8b5fd75c log is divergent from this leader: its last log entry 5.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 13:19:23.949280  9465 raft_consensus.cc:493] T 1528ab62b6fe4e3099d08f141afee116 P b7ab4784c7344b939bc36f639286f377 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 7ba59cc884714e8aa5f3f0ecaed84cbb)
I20260709 13:19:23.954193  9384 raft_consensus.cc:2804] T 7a734b5ab7834e05a8c422208acc58b1 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:19:23.991268  6799 raft_consensus.cc:2393] T e77e330a82df4b43a745d57a68f6f057 P b7ab4784c7344b939bc36f639286f377 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c in current term 9: Already voted for candidate b7ab4784c7344b939bc36f639286f377 in this term.
I20260709 13:19:23.992288  6800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3411566abe2d4c9bb4b2adfdd05e6f17" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:19:23.992931  6876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6869f07b5a4885a0b99fbe60c3b175" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 7 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:19:23.992933  6728 raft_consensus.cc:2468] T fe20b4b48823486ca3b9c648db6ce8aa P ccd8a4c3bfe3413cb2ae219b09aea832 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in term 5.
I20260709 13:19:23.953030  9344 leader_election.cc:290] T 853ac0a8cbd64ce99457f170216d4d0f P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:19:24.003182  6876 raft_consensus.cc:2468] T bd6869f07b5a4885a0b99fbe60c3b175 P cd75a17ab2604397adab03bb8b5fd75c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 5.
W20260709 13:19:24.003815  7469 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:24.003266  6800 raft_consensus.cc:2393] T 3411566abe2d4c9bb4b2adfdd05e6f17 P b7ab4784c7344b939bc36f639286f377 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c in current term 6: Already voted for candidate b7ab4784c7344b939bc36f639286f377 in this term.
I20260709 13:19:24.005821  6879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3d8792045a4583ae2e965b1350a5b4" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:19:24.006832  6878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8cee0accdb8499c86d4414b72565a38" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:19:24.006942  6728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a734b5ab7834e05a8c422208acc58b1" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:19:24.011250  6803 raft_consensus.cc:2468] T 7c37d41cd9164c15a6826ca62a851a69 P b7ab4784c7344b939bc36f639286f377 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 5.
I20260709 13:19:24.012135  9046 raft_consensus.cc:493] T 7c37d41cd9164c15a6826ca62a851a69 P b7ab4784c7344b939bc36f639286f377 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:24.012766  9046 raft_consensus.cc:515] T 7c37d41cd9164c15a6826ca62a851a69 P b7ab4784c7344b939bc36f639286f377 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:24.017413  6875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e326172347f45e99a0d482b5d8ef768" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:19:24.018631  6877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b8cacb381b746da8d0049b0a83b41dd" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:19:23.976631  9351 raft_consensus.cc:493] T 1528ab62b6fe4e3099d08f141afee116 P cd75a17ab2604397adab03bb8b5fd75c [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:24.022413  6798 raft_consensus.cc:1275] T 8c7f33e544204fbaac4078e3e83bbf4e P b7ab4784c7344b939bc36f639286f377 [term 4 FOLLOWER]: Refusing update from remote peer cd75a17ab2604397adab03bb8b5fd75c: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:19:24.024750  6807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ba5dac66ab5497e9e336f2a3c28cda5" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 9 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:19:24.019285  6877 raft_consensus.cc:2468] T 4b8cacb381b746da8d0049b0a83b41dd P cd75a17ab2604397adab03bb8b5fd75c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in term 7.
I20260709 13:19:24.028676  6802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e31b9971c15848dea59d4d4130141d9e" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:19:23.988319  9484 raft_consensus.cc:493] T d8292e16e5654be6bc408560cf256aaa P cd75a17ab2604397adab03bb8b5fd75c [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:24.029552  6873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fa34c08b205435dba97346991aa1f92" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:19:24.032981  6873 raft_consensus.cc:2468] T 3fa34c08b205435dba97346991aa1f92 P cd75a17ab2604397adab03bb8b5fd75c [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in term 8.
I20260709 13:19:24.029597  6878 raft_consensus.cc:2393] T d8cee0accdb8499c86d4414b72565a38 P cd75a17ab2604397adab03bb8b5fd75c [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in current term 6: Already voted for candidate cd75a17ab2604397adab03bb8b5fd75c in this term.
I20260709 13:19:24.033490  6730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34f36d59d88f40fe8a2805e604fc6c0a" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:19:24.008314  9465 raft_consensus.cc:3060] T 1528ab62b6fe4e3099d08f141afee116 P b7ab4784c7344b939bc36f639286f377 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:23.965360  9428 raft_consensus.cc:515] T a1704639a875409b9959353527b3fd68 P cd75a17ab2604397adab03bb8b5fd75c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:24.040432  6873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce4f062dcd314d43a63ca74067cb5ee3" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
W20260709 13:19:24.043957  6697 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 62658.1us
I20260709 13:19:24.045523  6877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f00a2e87e56452083b759f60d461ee3" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:19:24.047369  6879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4275cf08e63345f993bce8664eada830" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 8 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:19:24.051936  6730 raft_consensus.cc:2468] T 34f36d59d88f40fe8a2805e604fc6c0a P ccd8a4c3bfe3413cb2ae219b09aea832 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 4.
I20260709 13:19:24.052568  6807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5be3a11b23d4ea9b08300a2789821c7" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
W20260709 13:19:24.055367  6803 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:32966 (request call id 748) took 4144 ms (client timeout 2217 ms). Trace:
W20260709 13:19:24.055883  6803 rpcz_store.cc:269] 0709 13:19:19.911158 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:19.911321 (+   163us) service_pool.cc:224] Handling call
0709 13:19:24.055113 (+4143792us) spinlock_profiling.cc:243] Waited 3.79 s on lock 0x7b540032ffd4. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f9ae2fa 00007fcc1496fb17 00007fcc0deea6d4 00007fcc0deea662 00007fcc0deea591 00007fcc0deea50c 00007fcc0dee97c2 00007fcc0dce548c 00007fcc0dce48c6 00007fcc0dce426f
0709 13:19:24.055272 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":8718002048}
I20260709 13:19:23.976656  9489 consensus_queue.cc:1048] T 4b8cacb381b746da8d0049b0a83b41dd P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.060s
I20260709 13:19:24.061172  6878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb7fa124c3bf4ef9ab65a407cb008441" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:19:24.061928  6878 raft_consensus.cc:2468] T bb7fa124c3bf4ef9ab65a407cb008441 P cd75a17ab2604397adab03bb8b5fd75c [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in term 8.
I20260709 13:19:24.078558  6802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f9c2e2bf644115957398fe4c9459db" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:19:24.088021  6873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe20b4b48823486ca3b9c648db6ce8aa" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:19:24.051136  9137 raft_consensus.cc:493] T ce4f062dcd314d43a63ca74067cb5ee3 P b7ab4784c7344b939bc36f639286f377 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:19:24.089917  6725 raft_consensus.cc:2410] T 07a92dd554674067a83a9cb68c4773f2 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate b7ab4784c7344b939bc36f639286f377 for term 7 because replica has last-logged OpId of term: 6 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:19:24.096889  6878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8cee0accdb8499c86d4414b72565a38" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:19:24.037217  9351 raft_consensus.cc:515] T 1528ab62b6fe4e3099d08f141afee116 P cd75a17ab2604397adab03bb8b5fd75c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } attrs { replace: true } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:19:24.104908  6879 raft_consensus.cc:2410] T 4275cf08e63345f993bce8664eada830 P cd75a17ab2604397adab03bb8b5fd75c [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7ab4784c7344b939bc36f639286f377 for term 8 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
W20260709 13:19:24.106617  6695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 100135us
I20260709 13:19:24.100096  6876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3d8792045a4583ae2e965b1350a5b4" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:19:24.100687  6803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24ee15416e3145beaa1b8183453729a3" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:19:24.095723  6873 raft_consensus.cc:2468] T fe20b4b48823486ca3b9c648db6ce8aa P cd75a17ab2604397adab03bb8b5fd75c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in term 4.
I20260709 13:19:24.102934  6878 raft_consensus.cc:2393] T d8cee0accdb8499c86d4414b72565a38 P cd75a17ab2604397adab03bb8b5fd75c [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in current term 6: Already voted for candidate cd75a17ab2604397adab03bb8b5fd75c in this term.
I20260709 13:19:24.117702  6803 raft_consensus.cc:2410] T 24ee15416e3145beaa1b8183453729a3 P b7ab4784c7344b939bc36f639286f377 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c for term 7 because replica has last-logged OpId of term: 6 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 6.
I20260709 13:19:24.126410  6881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fa34c08b205435dba97346991aa1f92" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:19:24.127499  6881 raft_consensus.cc:3060] T 3fa34c08b205435dba97346991aa1f92 P cd75a17ab2604397adab03bb8b5fd75c [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:19:24.135098  6697 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 85155.1us
I20260709 13:19:24.142627  6873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ba5dac66ab5497e9e336f2a3c28cda5" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:19:24.144387  8832 raft_consensus.cc:493] T 22ccee1b570c4ad3a57bd7aec085b1b4 P b7ab4784c7344b939bc36f639286f377 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:19:24.144971  8832 raft_consensus.cc:515] T 22ccee1b570c4ad3a57bd7aec085b1b4 P b7ab4784c7344b939bc36f639286f377 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:24.147398  8832 leader_election.cc:290] T 22ccee1b570c4ad3a57bd7aec085b1b4 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:24.051213  9484 raft_consensus.cc:515] T d8292e16e5654be6bc408560cf256aaa P cd75a17ab2604397adab03bb8b5fd75c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:24.143527  6873 raft_consensus.cc:2468] T 7ba5dac66ab5497e9e336f2a3c28cda5 P cd75a17ab2604397adab03bb8b5fd75c [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in term 8.
I20260709 13:19:24.084290  9031 raft_consensus.cc:515] T 95a75bfe094d4bdc963aba3f08dfcd25 P b7ab4784c7344b939bc36f639286f377 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:24.104167  9259 leader_election.cc:290] T be1a92657f494cac8dd227d152f50151 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 8 election: Requested vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:19:24.171734  6878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3411566abe2d4c9bb4b2adfdd05e6f17" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:19:24.161469  9469 leader_election.cc:290] T f03d0dbf16864ca4bc1bb5e4c0334c0f P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 6 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
W20260709 13:19:24.211740  9496 log.cc:927] Time spent T bb7fa124c3bf4ef9ab65a407cb008441 P b7ab4784c7344b939bc36f639286f377: Append to log took a long time: real 0.055s	user 0.001s	sys 0.001s
I20260709 13:19:24.142645  9137 raft_consensus.cc:515] T ce4f062dcd314d43a63ca74067cb5ee3 P b7ab4784c7344b939bc36f639286f377 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } attrs { replace: true } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:19:24.220613  6807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6869f07b5a4885a0b99fbe60c3b175" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 6 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:19:24.221453  6803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c240553ce044eedb41541d72b9475d7" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:19:24.275020  6803 raft_consensus.cc:2410] T 2c240553ce044eedb41541d72b9475d7 P b7ab4784c7344b939bc36f639286f377 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c for term 9 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 13:19:24.147977  8832 raft_consensus.cc:493] T 404190ce4ce94cecbfcb6ea9d1dd8626 P b7ab4784c7344b939bc36f639286f377 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:19:24.260200  6878 raft_consensus.cc:3060] T 3411566abe2d4c9bb4b2adfdd05e6f17 P cd75a17ab2604397adab03bb8b5fd75c [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:24.264447  7466 leader_election.cc:304] T fe20b4b48823486ca3b9c648db6ce8aa P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
W20260709 13:19:24.272665  7468 leader_election.cc:336] T 4b8cacb381b746da8d0049b0a83b41dd P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931): Timed out: RequestConsensusVote RPC to 127.5.126.67:42931 timed out after 2.969s (SENT)
I20260709 13:19:24.271836  6872 raft_consensus.cc:2468] T 30e88460611e47b2ba16a46a30b5f416 P cd75a17ab2604397adab03bb8b5fd75c [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 6.
I20260709 13:19:24.283849  9451 leader_election.cc:290] T e77e330a82df4b43a745d57a68f6f057 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 9 election: Requested vote from peers cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931), ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391)
I20260709 13:19:24.308313  6799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f58dc08b12a2494bb9a1372837970ca2" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:19:24.309775  6799 raft_consensus.cc:2468] T f58dc08b12a2494bb9a1372837970ca2 P b7ab4784c7344b939bc36f639286f377 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 8.
W20260709 13:19:24.311573  7466 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 47271.4us
I20260709 13:19:24.284842  9351 leader_election.cc:290] T 1528ab62b6fe4e3099d08f141afee116 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:19:24.286489  9137 leader_election.cc:290] T ce4f062dcd314d43a63ca74067cb5ee3 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:19:24.274123  6807 raft_consensus.cc:2468] T bd6869f07b5a4885a0b99fbe60c3b175 P b7ab4784c7344b939bc36f639286f377 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 6.
I20260709 13:19:24.289196  6730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24ee15416e3145beaa1b8183453729a3" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
W20260709 13:19:24.316761  9218 consensus_meta.cc:287] T c4db81d9d329422bb3b4160ca4ac2d1d P ccd8a4c3bfe3413cb2ae219b09aea832: Time spent flushing consensus metadata: real 0.667s	user 0.007s	sys 0.016s
W20260709 13:19:24.289727  9492 log.cc:927] Time spent T d8cee0accdb8499c86d4414b72565a38 P b7ab4784c7344b939bc36f639286f377: Append to log took a long time: real 0.378s	user 0.001s	sys 0.002s
I20260709 13:19:24.319689  9454 raft_consensus.cc:2804] T fe20b4b48823486ca3b9c648db6ce8aa P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:19:24.292239  6726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6869f07b5a4885a0b99fbe60c3b175" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 7 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:19:24.292481  9428 leader_election.cc:290] T a1704639a875409b9959353527b3fd68 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:19:24.292541  6725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e326172347f45e99a0d482b5d8ef768" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
W20260709 13:19:24.294443  6698 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:24.295522  6724 raft_consensus.cc:3055] T a1704639a875409b9959353527b3fd68 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:19:24.334820  6724 raft_consensus.cc:740] T a1704639a875409b9959353527b3fd68 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
I20260709 13:19:24.300657  7500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1528ab62b6fe4e3099d08f141afee116" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:19:24.301440  7502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce4f062dcd314d43a63ca74067cb5ee3" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:19:24.335645  7500 raft_consensus.cc:1813] T 1528ab62b6fe4e3099d08f141afee116 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 6 FOLLOWER]: Handling vote request from an unknown peer cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:19:24.335940  7502 raft_consensus.cc:2468] T ce4f062dcd314d43a63ca74067cb5ee3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 6.
I20260709 13:19:24.336359  7500 raft_consensus.cc:2410] T 1528ab62b6fe4e3099d08f141afee116 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c for term 7 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 5.
I20260709 13:19:24.252487  9384 raft_consensus.cc:697] T 7a734b5ab7834e05a8c422208acc58b1 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 7 LEADER]: Becoming Leader. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
I20260709 13:19:24.304764  6873 raft_consensus.cc:1275] T d8cee0accdb8499c86d4414b72565a38 P cd75a17ab2604397adab03bb8b5fd75c [term 6 FOLLOWER]: Refusing update from remote peer 7ba59cc884714e8aa5f3f0ecaed84cbb: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:19:24.304637  8832 raft_consensus.cc:515] T 404190ce4ce94cecbfcb6ea9d1dd8626 P b7ab4784c7344b939bc36f639286f377 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:19:24.305809  9046 leader_election.cc:290] T 7c37d41cd9164c15a6826ca62a851a69 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:24.306500  6729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4275cf08e63345f993bce8664eada830" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 8 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:19:24.307832  6879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe20b4b48823486ca3b9c648db6ce8aa" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:19:24.322232  9506 raft_consensus.cc:493] T dbdf895bba214ff68685a24fd17dfb5d P ccd8a4c3bfe3413cb2ae219b09aea832 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:19:24.291144  6844 leader_election.cc:304] T 427c124d773f483294511e80fe340075 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:19:24.330592  6878 raft_consensus.cc:2468] T 3411566abe2d4c9bb4b2adfdd05e6f17 P cd75a17ab2604397adab03bb8b5fd75c [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 6.
I20260709 13:19:24.324538  6726 raft_consensus.cc:2468] T bd6869f07b5a4885a0b99fbe60c3b175 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 6.
I20260709 13:19:24.298606  7468 leader_election.cc:304] T 4b8cacb381b746da8d0049b0a83b41dd P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:19:24.339586  6879 raft_consensus.cc:3060] T fe20b4b48823486ca3b9c648db6ce8aa P cd75a17ab2604397adab03bb8b5fd75c [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:19:24.348441  6801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a75bfe094d4bdc963aba3f08dfcd25" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 8 candidate_status { last_received { term: 7 index: 2 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:19:24.349613  6801 raft_consensus.cc:2393] T 95a75bfe094d4bdc963aba3f08dfcd25 P b7ab4784c7344b939bc36f639286f377 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c in current term 8: Already voted for candidate b7ab4784c7344b939bc36f639286f377 in this term.
I20260709 13:19:24.339193  6881 raft_consensus.cc:2468] T 3fa34c08b205435dba97346991aa1f92 P cd75a17ab2604397adab03bb8b5fd75c [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in term 9.
I20260709 13:19:24.352010  9454 raft_consensus.cc:697] T fe20b4b48823486ca3b9c648db6ce8aa P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 5 LEADER]: Becoming Leader. State: Replica: 7ba59cc884714e8aa5f3f0ecaed84cbb, State: Running, Role: LEADER
I20260709 13:19:24.362354  9454 consensus_queue.cc:237] T fe20b4b48823486ca3b9c648db6ce8aa P 7ba59cc884714e8aa5f3f0ecaed84cbb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:19:24.351301  9390 consensus_queue.cc:1059] T be1a92657f494cac8dd227d152f50151 P 7ba59cc884714e8aa5f3f0ecaed84cbb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.013s
I20260709 13:19:24.365275  9512 raft_consensus.cc:2749] T 4b8cacb381b746da8d0049b0a83b41dd P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:19:24.367187  9390 raft_consensus.cc:3055] T be1a92657f494cac8dd227d152f50151 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:19:24.367731  9390 raft_consensus.cc:740] T be1a92657f494cac8dd227d152f50151 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 7ba59cc884714e8aa5f3f0ecaed84cbb, State: Running, Role: LEADER
I20260709 13:19:24.368752  9390 consensus_queue.cc:260] T be1a92657f494cac8dd227d152f50151 P 7ba59cc884714e8aa5f3f0ecaed84cbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:19:24.369486  9384 consensus_queue.cc:237] T 7a734b5ab7834e05a8c422208acc58b1 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
W20260709 13:19:24.371917  9495 log.cc:927] Time spent T 3fa34c08b205435dba97346991aa1f92 P 7ba59cc884714e8aa5f3f0ecaed84cbb: Append to log took a long time: real 0.240s	user 0.001s	sys 0.000s
I20260709 13:19:24.373107  9390 raft_consensus.cc:3060] T be1a92657f494cac8dd227d152f50151 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:24.376720  9484 leader_election.cc:290] T d8292e16e5654be6bc408560cf256aaa P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
W20260709 13:19:24.380647  9494 log.cc:927] Time spent T bb3d8792045a4583ae2e965b1350a5b4 P cd75a17ab2604397adab03bb8b5fd75c: Append to log took a long time: real 0.279s	user 0.002s	sys 0.000s
I20260709 13:19:24.358522  6724 consensus_queue.cc:260] T a1704639a875409b9959353527b3fd68 P ccd8a4c3bfe3413cb2ae219b09aea832 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:24.387727  6801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22ccee1b570c4ad3a57bd7aec085b1b4" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:19:24.393142  6801 raft_consensus.cc:2410] T 22ccee1b570c4ad3a57bd7aec085b1b4 P b7ab4784c7344b939bc36f639286f377 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c for term 6 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:19:24.393594  6878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77e330a82df4b43a745d57a68f6f057" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:19:24.394414  6878 raft_consensus.cc:3060] T e77e330a82df4b43a745d57a68f6f057 P cd75a17ab2604397adab03bb8b5fd75c [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:19:24.399684  7468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 142763us
I20260709 13:19:24.400195  6724 raft_consensus.cc:3060] T a1704639a875409b9959353527b3fd68 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:19:24.401467  7468 leader_election.cc:336] T bb7fa124c3bf4ef9ab65a407cb008441 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931): Timed out: RequestConsensusVote RPC to 127.5.126.67:42931 timed out after 1.684s (SENT)
I20260709 13:19:24.401919  7468 leader_election.cc:304] T bb7fa124c3bf4ef9ab65a407cb008441 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:19:24.403666  9031 leader_election.cc:290] T 95a75bfe094d4bdc963aba3f08dfcd25 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 8 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
W20260709 13:19:24.405118  7468 leader_election.cc:336] T 4f00a2e87e56452083b759f60d461ee3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931): Timed out: RequestConsensusVote RPC to 127.5.126.67:42931 timed out after 1.831s (SENT)
I20260709 13:19:24.405668  7468 leader_election.cc:304] T 4f00a2e87e56452083b759f60d461ee3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:19:24.406538  6802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09c2a98de1a4decabd0ff900dd44caa" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:19:24.407199  9215 raft_consensus.cc:2749] T bb7fa124c3bf4ef9ab65a407cb008441 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:19:24.359653  9428 raft_consensus.cc:2749] T 427c124d773f483294511e80fe340075 P cd75a17ab2604397adab03bb8b5fd75c [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:19:24.407918  6804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a734b5ab7834e05a8c422208acc58b1" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:19:24.408115  6805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34f36d59d88f40fe8a2805e604fc6c0a" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:19:24.408746  6804 raft_consensus.cc:2468] T 7a734b5ab7834e05a8c422208acc58b1 P b7ab4784c7344b939bc36f639286f377 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 7.
I20260709 13:19:24.409157  6803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8cee0accdb8499c86d4414b72565a38" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:19:24.408814  6805 raft_consensus.cc:2468] T 34f36d59d88f40fe8a2805e604fc6c0a P b7ab4784c7344b939bc36f639286f377 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 4.
I20260709 13:19:24.407266  6802 raft_consensus.cc:2468] T f09c2a98de1a4decabd0ff900dd44caa P b7ab4784c7344b939bc36f639286f377 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 7.
I20260709 13:19:24.407254  9512 raft_consensus.cc:2749] T 4f00a2e87e56452083b759f60d461ee3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:19:24.410403  6798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "711ef6523deb4cbe8ef2ba61e1c21c98" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:19:24.410758  6806 raft_consensus.cc:1240] T 07a92dd554674067a83a9cb68c4773f2 P b7ab4784c7344b939bc36f639286f377 [term 7 FOLLOWER]: Rejecting Update request from peer cd75a17ab2604397adab03bb8b5fd75c for earlier term 6. Current term is 7. Ops: [6.3-6.3]
I20260709 13:19:24.411278  6798 raft_consensus.cc:2410] T 711ef6523deb4cbe8ef2ba61e1c21c98 P b7ab4784c7344b939bc36f639286f377 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c for term 8 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:19:24.412273  6800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44bde925b2e541b69890d70715b85176" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:19:24.412431  6729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3411566abe2d4c9bb4b2adfdd05e6f17" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:19:24.413029  6800 raft_consensus.cc:2468] T 44bde925b2e541b69890d70715b85176 P b7ab4784c7344b939bc36f639286f377 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 7.
W20260709 13:19:24.408739  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 117684us
I20260709 13:19:24.414213  6729 raft_consensus.cc:1275] T 3fa34c08b205435dba97346991aa1f92 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 9 FOLLOWER]: Refusing update from remote peer 7ba59cc884714e8aa5f3f0ecaed84cbb: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
W20260709 13:19:24.414012  7496 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.535s	user 0.020s	sys 0.026s
I20260709 13:19:24.353454  9176 leader_election.cc:290] T 713b5728a197487c9300b310ab94e5a3 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 7 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:24.417840  9261 consensus_queue.cc:1048] T 3fa34c08b205435dba97346991aa1f92 P 7ba59cc884714e8aa5f3f0ecaed84cbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:19:24.418921  6879 raft_consensus.cc:2468] T fe20b4b48823486ca3b9c648db6ce8aa P cd75a17ab2604397adab03bb8b5fd75c [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in term 5.
W20260709 13:19:24.418285  7496 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.540s	user 0.020s	sys 0.027s
I20260709 13:19:24.419974  6801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab432e62819d499eaaf3dd55481dd930" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:19:24.421404  6801 raft_consensus.cc:2468] T ab432e62819d499eaaf3dd55481dd930 P b7ab4784c7344b939bc36f639286f377 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 7.
I20260709 13:19:24.438266  7502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "404190ce4ce94cecbfcb6ea9d1dd8626" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:19:24.439632  7502 raft_consensus.cc:2393] T 404190ce4ce94cecbfcb6ea9d1dd8626 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7ab4784c7344b939bc36f639286f377 in current term 8: Already voted for candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in this term.
I20260709 13:19:24.456200  6879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22ccee1b570c4ad3a57bd7aec085b1b4" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:19:24.457067  6879 raft_consensus.cc:2468] T 22ccee1b570c4ad3a57bd7aec085b1b4 P cd75a17ab2604397adab03bb8b5fd75c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 5.
W20260709 13:19:24.475658  6695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 332533us
I20260709 13:19:24.387380  9487 leader_election.cc:290] T 8c7f33e544204fbaac4078e3e83bbf4e P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:24.502554  6878 raft_consensus.cc:2468] T e77e330a82df4b43a745d57a68f6f057 P cd75a17ab2604397adab03bb8b5fd75c [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 9.
I20260709 13:19:24.511626  6725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "713b5728a197487c9300b310ab94e5a3" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:19:24.511947  6732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22ccee1b570c4ad3a57bd7aec085b1b4" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:19:24.512353  6725 raft_consensus.cc:3060] T 713b5728a197487c9300b310ab94e5a3 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:24.512876  6730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77e330a82df4b43a745d57a68f6f057" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:19:24.514508  6727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f03d0dbf16864ca4bc1bb5e4c0334c0f" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:19:24.513240  6731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c7f33e544204fbaac4078e3e83bbf4e" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:19:24.444155  8832 leader_election.cc:290] T 404190ce4ce94cecbfcb6ea9d1dd8626 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:19:24.520314  6731 raft_consensus.cc:2468] T 8c7f33e544204fbaac4078e3e83bbf4e P ccd8a4c3bfe3413cb2ae219b09aea832 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 4.
W20260709 13:19:24.521174  9490 consensus_meta.cc:287] T d33d5ee8ef6f415593d8df52063161ad P b7ab4784c7344b939bc36f639286f377: Time spent flushing consensus metadata: real 0.732s	user 0.019s	sys 0.005s
I20260709 13:19:24.521687  9490 raft_consensus.cc:515] T d33d5ee8ef6f415593d8df52063161ad P b7ab4784c7344b939bc36f639286f377 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:24.515872  6727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce4f062dcd314d43a63ca74067cb5ee3" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:19:24.523564  6725 raft_consensus.cc:2468] T 713b5728a197487c9300b310ab94e5a3 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 7.
I20260709 13:19:24.537467  6730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c37d41cd9164c15a6826ca62a851a69" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:19:24.538272  6730 raft_consensus.cc:2468] T 7c37d41cd9164c15a6826ca62a851a69 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 5.
I20260709 13:19:24.355912  9506 raft_consensus.cc:515] T dbdf895bba214ff68685a24fd17dfb5d P ccd8a4c3bfe3413cb2ae219b09aea832 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
W20260709 13:19:24.550472  6695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 67902.8us
I20260709 13:19:24.550839  6725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "404190ce4ce94cecbfcb6ea9d1dd8626" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:19:24.551409  6730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a75bfe094d4bdc963aba3f08dfcd25" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 8 candidate_status { last_received { term: 7 index: 2 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:19:24.555881  6724 raft_consensus.cc:1275] T a1704639a875409b9959353527b3fd68 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 6 FOLLOWER]: Refusing update from remote peer b7ab4784c7344b939bc36f639286f377: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
W20260709 13:19:24.557222  7468 leader_election.cc:336] T bb3d8792045a4583ae2e965b1350a5b4 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931): Timed out: RequestConsensusVote RPC to 127.5.126.67:42931 timed out after 1.561s (SENT)
I20260709 13:19:24.571416  7468 leader_election.cc:304] T bb3d8792045a4583ae2e965b1350a5b4 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:19:24.558897  9493 consensus_queue.cc:1048] T e77e330a82df4b43a745d57a68f6f057 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:19:24.558890  8832 raft_consensus.cc:493] T 90d42e216d9741e190bca19a781291fd P b7ab4784c7344b939bc36f639286f377 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:19:24.576208  6770 leader_election.cc:304] T 3a485a995abc4807b6e511e45419f737 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:19:24.561815  9506 leader_election.cc:290] T dbdf895bba214ff68685a24fd17dfb5d P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:24.540144  6844 leader_election.cc:400] T de3186201e1a40d0b335eeb8b4e256e0 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 6 election: Vote denied by peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391) with higher term. Message: Invalid argument: T de3186201e1a40d0b335eeb8b4e256e0 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c for earlier term 6. Current term is 7.
I20260709 13:19:24.582286  6844 leader_election.cc:403] T de3186201e1a40d0b335eeb8b4e256e0 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 6 election: Cancelling election due to peer responding with higher term
I20260709 13:19:24.523993  9490 leader_election.cc:290] T d33d5ee8ef6f415593d8df52063161ad P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 8 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:24.578732  6875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce4f062dcd314d43a63ca74067cb5ee3" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
W20260709 13:19:24.567212  6697 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 422700us
I20260709 13:19:24.583905  6878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f03d0dbf16864ca4bc1bb5e4c0334c0f" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:19:24.563341  9515 raft_consensus.cc:493] T 1bf4668eeb70467fb3dc5a0289233b3c P ccd8a4c3bfe3413cb2ae219b09aea832 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:24.585959  6875 raft_consensus.cc:2468] T ce4f062dcd314d43a63ca74067cb5ee3 P cd75a17ab2604397adab03bb8b5fd75c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 6.
W20260709 13:19:24.592998  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 85135.7us
W20260709 13:19:24.623852  7468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 66666.8us
W20260709 13:19:24.625043  7468 leader_election.cc:336] T ce4f062dcd314d43a63ca74067cb5ee3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931): Timed out: RequestConsensusVote RPC to 127.5.126.67:42931 timed out after 1.740s (SENT)
I20260709 13:19:24.625527  7468 leader_election.cc:304] T ce4f062dcd314d43a63ca74067cb5ee3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, b7ab4784c7344b939bc36f639286f377; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:19:24.629058  6697 leader_election.cc:304] T a3022224cc81473690653a83d4e99470 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:19:24.629369  6879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "713b5728a197487c9300b310ab94e5a3" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:19:24.630012  6879 raft_consensus.cc:3060] T 713b5728a197487c9300b310ab94e5a3 P cd75a17ab2604397adab03bb8b5fd75c [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:24.630709  6877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c37d41cd9164c15a6826ca62a851a69" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:19:24.631398  6697 leader_election.cc:304] T f3f9c2e2bf644115957398fe4c9459db P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:19:24.594944  9487 raft_consensus.cc:2749] T 3a485a995abc4807b6e511e45419f737 P b7ab4784c7344b939bc36f639286f377 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:19:24.632228  9516 raft_consensus.cc:2804] T a3022224cc81473690653a83d4e99470 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:19:24.632700  9516 raft_consensus.cc:493] T a3022224cc81473690653a83d4e99470 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 6 FOLLOWER]: Starting leader election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:19:24.633065  9516 raft_consensus.cc:3060] T a3022224cc81473690653a83d4e99470 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:24.590658  9125 raft_consensus.cc:2749] T bb3d8792045a4583ae2e965b1350a5b4 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:19:24.638795  6879 raft_consensus.cc:2468] T 713b5728a197487c9300b310ab94e5a3 P cd75a17ab2604397adab03bb8b5fd75c [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 7.
I20260709 13:19:24.597090  9428 raft_consensus.cc:2749] T de3186201e1a40d0b335eeb8b4e256e0 P cd75a17ab2604397adab03bb8b5fd75c [term 7 FOLLOWER]: Leader election lost for term 6. Reason: Vote denied by peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391) with higher term. Message: Invalid argument: T de3186201e1a40d0b335eeb8b4e256e0 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c for earlier term 6. Current term is 7.
W20260709 13:19:24.635886  9465 consensus_meta.cc:287] T 1528ab62b6fe4e3099d08f141afee116 P b7ab4784c7344b939bc36f639286f377: Time spent flushing consensus metadata: real 0.579s	user 0.000s	sys 0.009s
I20260709 13:19:24.594111  8832 raft_consensus.cc:515] T 90d42e216d9741e190bca19a781291fd P b7ab4784c7344b939bc36f639286f377 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:24.656471  9465 raft_consensus.cc:515] T 1528ab62b6fe4e3099d08f141afee116 P b7ab4784c7344b939bc36f639286f377 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:19:24.659001  9465 leader_election.cc:290] T 1528ab62b6fe4e3099d08f141afee116 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 6 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:19:24.660465  7496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1528ab62b6fe4e3099d08f141afee116" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb"
W20260709 13:19:24.663841  6770 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 87780.6us
I20260709 13:19:24.641166  6879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c7f33e544204fbaac4078e3e83bbf4e" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:19:24.652228  9502 raft_consensus.cc:2749] T f3f9c2e2bf644115957398fe4c9459db P ccd8a4c3bfe3413cb2ae219b09aea832 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:19:24.636240  9384 consensus_queue.cc:1059] T 4275cf08e63345f993bce8664eada830 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.016s
I20260709 13:19:24.641744  9215 raft_consensus.cc:2749] T ce4f062dcd314d43a63ca74067cb5ee3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:19:24.676867  6697 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 45544.4us
I20260709 13:19:24.647610  6844 leader_election.cc:304] T 24ee15416e3145beaa1b8183453729a3 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, ccd8a4c3bfe3413cb2ae219b09aea832
W20260709 13:19:24.682301  6698 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:24.677867  6697 leader_election.cc:304] T 713b5728a197487c9300b310ab94e5a3 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:19:24.703291  6877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a75bfe094d4bdc963aba3f08dfcd25" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 8 candidate_status { last_received { term: 7 index: 2 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:19:24.688531  6844 leader_election.cc:304] T 4b8cacb381b746da8d0049b0a83b41dd P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:19:24.704926  6877 raft_consensus.cc:3060] T 95a75bfe094d4bdc963aba3f08dfcd25 P cd75a17ab2604397adab03bb8b5fd75c [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:24.708920  8832 leader_election.cc:290] T 90d42e216d9741e190bca19a781291fd P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:24.685457  9428 raft_consensus.cc:2749] T 24ee15416e3145beaa1b8183453729a3 P cd75a17ab2604397adab03bb8b5fd75c [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:19:24.642119  9489 consensus_queue.cc:1048] T e77e330a82df4b43a745d57a68f6f057 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.072s
W20260709 13:19:24.716809  6698 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:24.717123  6772 leader_election.cc:304] T ab432e62819d499eaaf3dd55481dd930 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:19:24.717892  6844 leader_election.cc:304] T 3fa34c08b205435dba97346991aa1f92 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:19:24.718052  6772 leader_election.cc:304] T 7887766dc6784fcaa42b35c05fea7a99 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
W20260709 13:19:24.718498  6770 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 47970.6us
I20260709 13:19:24.720103  6879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d33d5ee8ef6f415593d8df52063161ad" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:19:24.720898  6879 raft_consensus.cc:3060] T d33d5ee8ef6f415593d8df52063161ad P cd75a17ab2604397adab03bb8b5fd75c [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:24.722482  6772 leader_election.cc:304] T 711ef6523deb4cbe8ef2ba61e1c21c98 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:19:24.593305  9515 raft_consensus.cc:515] T 1bf4668eeb70467fb3dc5a0289233b3c P ccd8a4c3bfe3413cb2ae219b09aea832 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:24.723851  6770 leader_election.cc:304] T 2c240553ce044eedb41541d72b9475d7 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:19:24.727120  6844 leader_election.cc:304] T fe20b4b48823486ca3b9c648db6ce8aa P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:19:24.729207  6844 leader_election.cc:304] T 34f36d59d88f40fe8a2805e604fc6c0a P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:19:24.723389  9294 raft_consensus.cc:3055] T 4275cf08e63345f993bce8664eada830 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:19:24.749226  9490 raft_consensus.cc:2749] T 2c240553ce044eedb41541d72b9475d7 P b7ab4784c7344b939bc36f639286f377 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:19:24.730103  9428 raft_consensus.cc:2749] T 4b8cacb381b746da8d0049b0a83b41dd P cd75a17ab2604397adab03bb8b5fd75c [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:19:24.730036  9484 consensus_queue.cc:1059] T 4d9def8b32fd443aa94ab1420b06837b P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.022s
I20260709 13:19:24.752383  9351 raft_consensus.cc:2804] T 34f36d59d88f40fe8a2805e604fc6c0a P cd75a17ab2604397adab03bb8b5fd75c [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:19:24.752862  9351 raft_consensus.cc:493] T 34f36d59d88f40fe8a2805e604fc6c0a P cd75a17ab2604397adab03bb8b5fd75c [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:24.753091  9484 raft_consensus.cc:3055] T 4d9def8b32fd443aa94ab1420b06837b P cd75a17ab2604397adab03bb8b5fd75c [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:19:24.744340  9344 consensus_queue.cc:1048] T 8c7f33e544204fbaac4078e3e83bbf4e P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Connected to new peer: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.025s
I20260709 13:19:24.752075  9450 raft_consensus.cc:2804] T 711ef6523deb4cbe8ef2ba61e1c21c98 P b7ab4784c7344b939bc36f639286f377 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:19:24.753206  9351 raft_consensus.cc:3060] T 34f36d59d88f40fe8a2805e604fc6c0a P cd75a17ab2604397adab03bb8b5fd75c [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:19:24.753851  9484 raft_consensus.cc:740] T 4d9def8b32fd443aa94ab1420b06837b P cd75a17ab2604397adab03bb8b5fd75c [term 6 LEADER]: Becoming Follower/Learner. State: Replica: cd75a17ab2604397adab03bb8b5fd75c, State: Running, Role: LEADER
W20260709 13:19:24.732275  6697 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 54490.2us
W20260709 13:19:24.745117  6695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 102317us
I20260709 13:19:24.766805  6770 leader_election.cc:304] T c4db81d9d329422bb3b4160ca4ac2d1d P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:19:24.767483  6695 leader_election.cc:304] T 17587d6730594da4a56fa13a353232a1 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb
W20260709 13:19:24.743461  7468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 118456us
I20260709 13:19:24.685305  9465 consensus_queue.cc:1048] T 853ac0a8cbd64ce99457f170216d4d0f P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.052s
I20260709 13:19:24.727839  9486 raft_consensus.cc:2749] T 3fa34c08b205435dba97346991aa1f92 P cd75a17ab2604397adab03bb8b5fd75c [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:19:24.756814  6772 leader_election.cc:304] T 44bde925b2e541b69890d70715b85176 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:19:24.729645  9349 raft_consensus.cc:2749] T fe20b4b48823486ca3b9c648db6ce8aa P cd75a17ab2604397adab03bb8b5fd75c [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:19:24.729461  9461 consensus_queue.cc:1048] T 7c37d41cd9164c15a6826ca62a851a69 P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Connected to new peer: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.023s
I20260709 13:19:24.724632  9031 raft_consensus.cc:2804] T ab432e62819d499eaaf3dd55481dd930 P b7ab4784c7344b939bc36f639286f377 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:19:24.760417  9450 raft_consensus.cc:493] T 711ef6523deb4cbe8ef2ba61e1c21c98 P b7ab4784c7344b939bc36f639286f377 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:24.728458  8832 consensus_queue.cc:1048] T a1704639a875409b9959353527b3fd68 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.041s
W20260709 13:19:24.768726  7468 leader_election.cc:336] T fe20b4b48823486ca3b9c648db6ce8aa P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931): Timed out: RequestConsensusVote RPC to 127.5.126.67:42931 timed out after 1.889s (SENT)
I20260709 13:19:24.744894  9502 raft_consensus.cc:2764] T 713b5728a197487c9300b310ab94e5a3 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 7 FOLLOWER]: Leader pre-election decision vote started in defunct term 6: won
I20260709 13:19:24.747910  9294 raft_consensus.cc:740] T 4275cf08e63345f993bce8664eada830 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
I20260709 13:19:24.782013  9046 raft_consensus.cc:2804] T 44bde925b2e541b69890d70715b85176 P b7ab4784c7344b939bc36f639286f377 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:19:24.791071  9046 raft_consensus.cc:493] T 44bde925b2e541b69890d70715b85176 P b7ab4784c7344b939bc36f639286f377 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:24.791473  9046 raft_consensus.cc:3060] T 44bde925b2e541b69890d70715b85176 P b7ab4784c7344b939bc36f639286f377 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:24.776007  6844 leader_election.cc:304] T c4db81d9d329422bb3b4160ca4ac2d1d P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:19:24.728229  9487 raft_consensus.cc:2804] T 7887766dc6784fcaa42b35c05fea7a99 P b7ab4784c7344b939bc36f639286f377 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:19:24.800789  9487 raft_consensus.cc:493] T 7887766dc6784fcaa42b35c05fea7a99 P b7ab4784c7344b939bc36f639286f377 [term 6 FOLLOWER]: Starting leader election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:19:24.781879  9450 raft_consensus.cc:3060] T 711ef6523deb4cbe8ef2ba61e1c21c98 P b7ab4784c7344b939bc36f639286f377 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:24.801410  9487 raft_consensus.cc:3060] T 7887766dc6784fcaa42b35c05fea7a99 P b7ab4784c7344b939bc36f639286f377 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:24.780272  9031 raft_consensus.cc:493] T ab432e62819d499eaaf3dd55481dd930 P b7ab4784c7344b939bc36f639286f377 [term 7 FOLLOWER]: Starting leader election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:19:24.804425  9031 raft_consensus.cc:3060] T ab432e62819d499eaaf3dd55481dd930 P b7ab4784c7344b939bc36f639286f377 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:19:24.807744  7468 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.5.126.67:42931 timed out after 2.174s (SENT) [suppressed 33 similar messages]
I20260709 13:19:24.789803  9490 raft_consensus.cc:2749] T c4db81d9d329422bb3b4160ca4ac2d1d P b7ab4784c7344b939bc36f639286f377 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:19:24.786753  6879 raft_consensus.cc:2468] T d33d5ee8ef6f415593d8df52063161ad P cd75a17ab2604397adab03bb8b5fd75c [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 8.
I20260709 13:19:24.789045  6772 leader_election.cc:304] T bd6869f07b5a4885a0b99fbe60c3b175 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:19:24.775640  9259 raft_consensus.cc:2804] T 17587d6730594da4a56fa13a353232a1 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:19:24.825338  9259 raft_consensus.cc:493] T 17587d6730594da4a56fa13a353232a1 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 7ba59cc884714e8aa5f3f0ecaed84cbb)
I20260709 13:19:24.825840  9259 raft_consensus.cc:3060] T 17587d6730594da4a56fa13a353232a1 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:24.813798  9294 consensus_queue.cc:260] T 4275cf08e63345f993bce8664eada830 P ccd8a4c3bfe3413cb2ae219b09aea832 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:24.797812  9484 consensus_queue.cc:260] T 4d9def8b32fd443aa94ab1420b06837b P cd75a17ab2604397adab03bb8b5fd75c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:24.819186  7502 raft_consensus.cc:1275] T bb3d8792045a4583ae2e965b1350a5b4 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 7 FOLLOWER]: Refusing update from remote peer cd75a17ab2604397adab03bb8b5fd75c: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:19:24.828851  9484 raft_consensus.cc:3060] T 4d9def8b32fd443aa94ab1420b06837b P cd75a17ab2604397adab03bb8b5fd75c [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:24.829218  6695 leader_election.cc:304] T 1528ab62b6fe4e3099d08f141afee116 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, b7ab4784c7344b939bc36f639286f377
I20260709 13:19:24.830222  9502 raft_consensus.cc:2749] T 1528ab62b6fe4e3099d08f141afee116 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:19:24.830621  6695 leader_election.cc:304] T b56bf91d90824c959e21e0cee5ba1816 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
I20260709 13:19:24.831413  9502 raft_consensus.cc:2804] T b56bf91d90824c959e21e0cee5ba1816 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:19:24.831768  9502 raft_consensus.cc:493] T b56bf91d90824c959e21e0cee5ba1816 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:24.832118  9502 raft_consensus.cc:3060] T b56bf91d90824c959e21e0cee5ba1816 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:24.833115  9294 raft_consensus.cc:3060] T 4275cf08e63345f993bce8664eada830 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:19:24.819186  9530 log.cc:927] Time spent T 07a92dd554674067a83a9cb68c4773f2 P cd75a17ab2604397adab03bb8b5fd75c: Append to log took a long time: real 0.070s	user 0.001s	sys 0.000s
W20260709 13:19:24.836380  6770 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 69733.9us
W20260709 13:19:24.838140  6697 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 52065.1us
I20260709 13:19:24.841647  9490 raft_consensus.cc:2804] T bd6869f07b5a4885a0b99fbe60c3b175 P b7ab4784c7344b939bc36f639286f377 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:19:24.843142  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 67943.7us
I20260709 13:19:24.844161  9490 raft_consensus.cc:493] T bd6869f07b5a4885a0b99fbe60c3b175 P b7ab4784c7344b939bc36f639286f377 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:24.842063  9461 raft_consensus.cc:2749] T c4db81d9d329422bb3b4160ca4ac2d1d P cd75a17ab2604397adab03bb8b5fd75c [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:19:24.845309  9490 raft_consensus.cc:3060] T bd6869f07b5a4885a0b99fbe60c3b175 P b7ab4784c7344b939bc36f639286f377 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:24.844772  6844 leader_election.cc:304] T f4b8bd455d5a47c18a1380839c6e0d61 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:19:24.843750  6695 leader_election.cc:304] T 2c240553ce044eedb41541d72b9475d7 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
I20260709 13:19:24.858265  6844 leader_election.cc:304] T 7887766dc6784fcaa42b35c05fea7a99 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:19:24.859272  9486 raft_consensus.cc:2804] T f4b8bd455d5a47c18a1380839c6e0d61 P cd75a17ab2604397adab03bb8b5fd75c [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:19:24.859833  9486 raft_consensus.cc:697] T f4b8bd455d5a47c18a1380839c6e0d61 P cd75a17ab2604397adab03bb8b5fd75c [term 6 LEADER]: Becoming Leader. State: Replica: cd75a17ab2604397adab03bb8b5fd75c, State: Running, Role: LEADER
I20260709 13:19:24.860834  9486 consensus_queue.cc:237] T f4b8bd455d5a47c18a1380839c6e0d61 P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:24.872663  6695 leader_election.cc:304] T de3186201e1a40d0b335eeb8b4e256e0 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
I20260709 13:19:24.869040  9489 raft_consensus.cc:2804] T 2c240553ce044eedb41541d72b9475d7 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 8 FOLLOWER]: Leader election won for term 8
W20260709 13:19:24.883909  7468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 76218.1us
I20260709 13:19:24.885752  6844 leader_election.cc:304] T 3a485a995abc4807b6e511e45419f737 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:19:24.846061  9344 consensus_queue.cc:1048] T bb3d8792045a4583ae2e965b1350a5b4 P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.028s
I20260709 13:19:24.887611  6695 leader_election.cc:304] T 07a92dd554674067a83a9cb68c4773f2 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:19:24.889777  6697 leader_election.cc:304] T e31b9971c15848dea59d4d4130141d9e P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:19:24.874123  9461 raft_consensus.cc:2749] T 7887766dc6784fcaa42b35c05fea7a99 P cd75a17ab2604397adab03bb8b5fd75c [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:19:24.886880  7468 leader_election.cc:336] T d8cee0accdb8499c86d4414b72565a38 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931): Timed out: RequestConsensusVote RPC to 127.5.126.67:42931 timed out after 2.197s (SENT)
W20260709 13:19:24.894599  6772 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 105618us
I20260709 13:19:24.880473  9505 raft_consensus.cc:2804] T de3186201e1a40d0b335eeb8b4e256e0 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 7 FOLLOWER]: Leader election won for term 7
W20260709 13:19:24.900177  6770 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 62211.1us
I20260709 13:19:24.902696  6770 leader_election.cc:304] T 17587d6730594da4a56fa13a353232a1 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:19:24.904838  9031 raft_consensus.cc:515] T ab432e62819d499eaaf3dd55481dd930 P b7ab4784c7344b939bc36f639286f377 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:24.907140  9031 leader_election.cc:290] T ab432e62819d499eaaf3dd55481dd930 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 8 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:24.907222  9524 consensus_queue.cc:1048] T 22ccee1b570c4ad3a57bd7aec085b1b4 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:19:24.908062  6697 leader_election.cc:304] T bd6869f07b5a4885a0b99fbe60c3b175 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:19:24.909053  9524 consensus_queue.cc:1059] T f4b8bd455d5a47c18a1380839c6e0d61 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:19:24.909807  9526 raft_consensus.cc:2804] T bd6869f07b5a4885a0b99fbe60c3b175 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:19:24.910102  9524 raft_consensus.cc:3055] T f4b8bd455d5a47c18a1380839c6e0d61 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:19:24.910372  9526 raft_consensus.cc:493] T bd6869f07b5a4885a0b99fbe60c3b175 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:24.910645  9524 raft_consensus.cc:740] T f4b8bd455d5a47c18a1380839c6e0d61 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
I20260709 13:19:24.910917  9526 raft_consensus.cc:3060] T bd6869f07b5a4885a0b99fbe60c3b175 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:24.918073  9515 leader_election.cc:290] T 1bf4668eeb70467fb3dc5a0289233b3c P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:24.919235  7496 raft_consensus.cc:2468] T 1528ab62b6fe4e3099d08f141afee116 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 6.
I20260709 13:19:24.920079  9489 raft_consensus.cc:697] T 2c240553ce044eedb41541d72b9475d7 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 8 LEADER]: Becoming Leader. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
I20260709 13:19:24.921373  9489 consensus_queue.cc:237] T 2c240553ce044eedb41541d72b9475d7 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:24.924269  6726 raft_consensus.cc:1275] T fe20b4b48823486ca3b9c648db6ce8aa P ccd8a4c3bfe3413cb2ae219b09aea832 [term 5 FOLLOWER]: Refusing update from remote peer 7ba59cc884714e8aa5f3f0ecaed84cbb: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:19:24.926189  9512 consensus_queue.cc:1048] T fe20b4b48823486ca3b9c648db6ce8aa P 7ba59cc884714e8aa5f3f0ecaed84cbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:19:24.897049  9531 raft_consensus.cc:2804] T 3a485a995abc4807b6e511e45419f737 P cd75a17ab2604397adab03bb8b5fd75c [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:19:24.932356  9531 raft_consensus.cc:493] T 3a485a995abc4807b6e511e45419f737 P cd75a17ab2604397adab03bb8b5fd75c [term 5 FOLLOWER]: Starting leader election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:19:24.932811  9531 raft_consensus.cc:3060] T 3a485a995abc4807b6e511e45419f737 P cd75a17ab2604397adab03bb8b5fd75c [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:24.933604  9046 raft_consensus.cc:515] T 44bde925b2e541b69890d70715b85176 P b7ab4784c7344b939bc36f639286f377 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:24.935738  9046 leader_election.cc:290] T 44bde925b2e541b69890d70715b85176 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 8 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:24.937147  9351 raft_consensus.cc:515] T 34f36d59d88f40fe8a2805e604fc6c0a P cd75a17ab2604397adab03bb8b5fd75c [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:24.954380  9351 leader_election.cc:290] T 34f36d59d88f40fe8a2805e604fc6c0a P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 5 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
W20260709 13:19:24.962693  6772 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 51408.7us
I20260709 13:19:24.938366  9487 raft_consensus.cc:515] T 7887766dc6784fcaa42b35c05fea7a99 P b7ab4784c7344b939bc36f639286f377 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:24.938956  6770 leader_election.cc:304] T f09c2a98de1a4decabd0ff900dd44caa P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:19:24.939845  9465 raft_consensus.cc:2749] T 17587d6730594da4a56fa13a353232a1 P b7ab4784c7344b939bc36f639286f377 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:19:24.940498  9516 raft_consensus.cc:515] T a3022224cc81473690653a83d4e99470 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:24.902101  9384 raft_consensus.cc:2749] T 07a92dd554674067a83a9cb68c4773f2 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:19:24.951411  9526 raft_consensus.cc:515] T bd6869f07b5a4885a0b99fbe60c3b175 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:24.951143  9531 raft_consensus.cc:515] T 3a485a995abc4807b6e511e45419f737 P cd75a17ab2604397adab03bb8b5fd75c [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:24.888585  9450 raft_consensus.cc:515] T 711ef6523deb4cbe8ef2ba61e1c21c98 P b7ab4784c7344b939bc36f639286f377 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:24.968788  6772 leader_election.cc:304] T 30e88460611e47b2ba16a46a30b5f416 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
W20260709 13:19:24.969966  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 84316.9us
W20260709 13:19:24.978729  6695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 91191.3us
I20260709 13:19:24.985052  6877 raft_consensus.cc:2468] T 95a75bfe094d4bdc963aba3f08dfcd25 P cd75a17ab2604397adab03bb8b5fd75c [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 8.
I20260709 13:19:24.924139  9466 raft_consensus.cc:2804] T e31b9971c15848dea59d4d4130141d9e P ccd8a4c3bfe3413cb2ae219b09aea832 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:19:25.000389  6770 leader_election.cc:304] T 4d9def8b32fd443aa94ab1420b06837b P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:19:25.009162  6844 leader_election.cc:304] T 9e326172347f45e99a0d482b5d8ef768 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:19:25.009892  9531 leader_election.cc:290] T 3a485a995abc4807b6e511e45419f737 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 6 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:19:25.010725  6844 leader_election.cc:304] T 4275cf08e63345f993bce8664eada830 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:19:25.010751  9531 raft_consensus.cc:2804] T 9e326172347f45e99a0d482b5d8ef768 P cd75a17ab2604397adab03bb8b5fd75c [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:19:25.011497  9531 raft_consensus.cc:493] T 9e326172347f45e99a0d482b5d8ef768 P cd75a17ab2604397adab03bb8b5fd75c [term 5 FOLLOWER]: Starting leader election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:19:25.011925  9531 raft_consensus.cc:3060] T 9e326172347f45e99a0d482b5d8ef768 P cd75a17ab2604397adab03bb8b5fd75c [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:25.012825  9259 raft_consensus.cc:515] T 17587d6730594da4a56fa13a353232a1 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:19:25.015339  9259 leader_election.cc:290] T 17587d6730594da4a56fa13a353232a1 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 9 election: Requested vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:19:25.016263  9351 raft_consensus.cc:2804] T 4275cf08e63345f993bce8664eada830 P cd75a17ab2604397adab03bb8b5fd75c [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:19:25.016948  9351 raft_consensus.cc:697] T 4275cf08e63345f993bce8664eada830 P cd75a17ab2604397adab03bb8b5fd75c [term 7 LEADER]: Becoming Leader. State: Replica: cd75a17ab2604397adab03bb8b5fd75c, State: Running, Role: LEADER
I20260709 13:19:25.017958  9351 consensus_queue.cc:237] T 4275cf08e63345f993bce8664eada830 P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:25.005486  9031 raft_consensus.cc:2749] T f09c2a98de1a4decabd0ff900dd44caa P b7ab4784c7344b939bc36f639286f377 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:19:25.024353  6697 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 116370us
I20260709 13:19:25.026608  6697 leader_election.cc:304] T 7c37d41cd9164c15a6826ca62a851a69 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:19:24.996717  9505 raft_consensus.cc:697] T de3186201e1a40d0b335eeb8b4e256e0 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 7 LEADER]: Becoming Leader. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
W20260709 13:19:25.029565  6772 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 60886.4us
I20260709 13:19:25.032327  9294 raft_consensus.cc:2749] T 7c37d41cd9164c15a6826ca62a851a69 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:19:25.032778  6772 leader_election.cc:304] T 3411566abe2d4c9bb4b2adfdd05e6f17 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:19:25.033186  9294 consensus_queue.cc:1048] T 44bde925b2e541b69890d70715b85176 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:19:25.033504  9384 consensus_queue.cc:1059] T bb3d8792045a4583ae2e965b1350a5b4 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:19:25.034283  9384 consensus_queue.cc:1243] T bb3d8792045a4583ae2e965b1350a5b4 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Peer cd75a17ab2604397adab03bb8b5fd75c log is divergent from this leader: its last log entry 5.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:19:25.035269  9259 raft_consensus.cc:3055] T bb3d8792045a4583ae2e965b1350a5b4 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:19:25.035681  9259 raft_consensus.cc:740] T bb3d8792045a4583ae2e965b1350a5b4 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
I20260709 13:19:25.040922  6772 leader_election.cc:304] T 22ccee1b570c4ad3a57bd7aec085b1b4 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:19:25.043128  6772 leader_election.cc:304] T e77e330a82df4b43a745d57a68f6f057 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:19:25.043563  6695 leader_election.cc:304] T b3f13b31a1f84f0d89d007eadd57924c P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, b7ab4784c7344b939bc36f639286f377
I20260709 13:19:25.022110  9466 raft_consensus.cc:493] T e31b9971c15848dea59d4d4130141d9e P ccd8a4c3bfe3413cb2ae219b09aea832 [term 4 FOLLOWER]: Starting leader election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:19:25.042439  9465 raft_consensus.cc:2804] T 4d9def8b32fd443aa94ab1420b06837b P b7ab4784c7344b939bc36f639286f377 [term 7 FOLLOWER]: Leader election won for term 7
W20260709 13:19:25.049106  6770 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 48788.5us
I20260709 13:19:25.025000  9516 leader_election.cc:290] T a3022224cc81473690653a83d4e99470 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 7 election: Requested vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:25.054462  6770 leader_election.cc:304] T 7a734b5ab7834e05a8c422208acc58b1 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:19:24.911636  9524 consensus_queue.cc:260] T f4b8bd455d5a47c18a1380839c6e0d61 P ccd8a4c3bfe3413cb2ae219b09aea832 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:25.056504  6844 leader_election.cc:304] T d33d5ee8ef6f415593d8df52063161ad P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:19:25.019620  9502 raft_consensus.cc:515] T b56bf91d90824c959e21e0cee5ba1816 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:25.036473  8832 raft_consensus.cc:2804] T 3411566abe2d4c9bb4b2adfdd05e6f17 P b7ab4784c7344b939bc36f639286f377 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:19:25.042697  9046 raft_consensus.cc:2804] T 30e88460611e47b2ba16a46a30b5f416 P b7ab4784c7344b939bc36f639286f377 [term 6 FOLLOWER]: Leader election won for term 6
W20260709 13:19:25.066864  6698 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:25.070976  6877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34f36d59d88f40fe8a2805e604fc6c0a" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:19:25.071686  6879 raft_consensus.cc:1275] T d8292e16e5654be6bc408560cf256aaa P cd75a17ab2604397adab03bb8b5fd75c [term 8 FOLLOWER]: Refusing update from remote peer ccd8a4c3bfe3413cb2ae219b09aea832: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:19:25.072768  6877 raft_consensus.cc:2393] T 34f36d59d88f40fe8a2805e604fc6c0a P cd75a17ab2604397adab03bb8b5fd75c [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ccd8a4c3bfe3413cb2ae219b09aea832 in current term 5: Already voted for candidate cd75a17ab2604397adab03bb8b5fd75c in this term.
I20260709 13:19:25.051597  9031 raft_consensus.cc:2804] T 22ccee1b570c4ad3a57bd7aec085b1b4 P b7ab4784c7344b939bc36f639286f377 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:19:25.053195  9466 raft_consensus.cc:3060] T e31b9971c15848dea59d4d4130141d9e P ccd8a4c3bfe3413cb2ae219b09aea832 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:19:25.074429  6879 raft_consensus.cc:1240] T 95a75bfe094d4bdc963aba3f08dfcd25 P cd75a17ab2604397adab03bb8b5fd75c [term 8 FOLLOWER]: Rejecting Update request from peer ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 7. Current term is 8. Ops: []
I20260709 13:19:25.054584  9294 raft_consensus.cc:2749] T b3f13b31a1f84f0d89d007eadd57924c P ccd8a4c3bfe3413cb2ae219b09aea832 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:19:25.031329  9506 consensus_queue.cc:1048] T 3a485a995abc4807b6e511e45419f737 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.033s
I20260709 13:19:25.081198  6881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c7f33e544204fbaac4078e3e83bbf4e" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:19:25.083526  6877 raft_consensus.cc:1240] T a1704639a875409b9959353527b3fd68 P cd75a17ab2604397adab03bb8b5fd75c [term 6 FOLLOWER]: Rejecting Update request from peer ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 5. Current term is 6. Ops: []
I20260709 13:19:25.082569  6880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d65025eea89441290d85dd053810e31" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:19:25.052817  9176 raft_consensus.cc:2804] T e77e330a82df4b43a745d57a68f6f057 P b7ab4784c7344b939bc36f639286f377 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:19:25.080758  9516 raft_consensus.cc:493] T c4db81d9d329422bb3b4160ca4ac2d1d P ccd8a4c3bfe3413cb2ae219b09aea832 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:25.086936  6879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20f6842e26174571996b8dea4151d4be" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:19:25.084793  6873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1528ab62b6fe4e3099d08f141afee116" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:19:25.090369  6879 raft_consensus.cc:2376] T 20f6842e26174571996b8dea4151d4be P cd75a17ab2604397adab03bb8b5fd75c [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 7. Re-sending same reply.
I20260709 13:19:25.085255  6844 leader_election.cc:304] T 9b3759de40694069b13c0f8bd40e5709 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:19:25.085475  6878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de3186201e1a40d0b335eeb8b4e256e0" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:19:25.091403  6878 raft_consensus.cc:2376] T de3186201e1a40d0b335eeb8b4e256e0 P cd75a17ab2604397adab03bb8b5fd75c [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 7. Re-sending same reply.
I20260709 13:19:25.065265  9344 raft_consensus.cc:2764] T d33d5ee8ef6f415593d8df52063161ad P cd75a17ab2604397adab03bb8b5fd75c [term 8 FOLLOWER]: Leader election decision vote started in defunct term 7: won
I20260709 13:19:25.088609  6872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fa34c08b205435dba97346991aa1f92" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:19:25.088721  6875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b56bf91d90824c959e21e0cee5ba1816" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:19:25.098003  6872 raft_consensus.cc:2368] T 3fa34c08b205435dba97346991aa1f92 P cd75a17ab2604397adab03bb8b5fd75c [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 8. Current term is 9.
I20260709 13:19:25.098179  6875 raft_consensus.cc:2468] T b56bf91d90824c959e21e0cee5ba1816 P cd75a17ab2604397adab03bb8b5fd75c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 7.
I20260709 13:19:25.089605  6876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d33d5ee8ef6f415593d8df52063161ad" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:19:25.090811  6873 raft_consensus.cc:2376] T 1528ab62b6fe4e3099d08f141afee116 P cd75a17ab2604397adab03bb8b5fd75c [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 6. Re-sending same reply.
I20260709 13:19:25.077032  9031 raft_consensus.cc:493] T 22ccee1b570c4ad3a57bd7aec085b1b4 P b7ab4784c7344b939bc36f639286f377 [term 5 FOLLOWER]: Starting leader election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:19:25.102977  9516 raft_consensus.cc:515] T c4db81d9d329422bb3b4160ca4ac2d1d P ccd8a4c3bfe3413cb2ae219b09aea832 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:25.106429  6844 leader_election.cc:304] T dbdf895bba214ff68685a24fd17dfb5d P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:19:25.108202  9484 raft_consensus.cc:2749] T dbdf895bba214ff68685a24fd17dfb5d P cd75a17ab2604397adab03bb8b5fd75c [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:19:25.108836  6874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c240553ce044eedb41541d72b9475d7" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:19:25.109678  6874 raft_consensus.cc:2376] T 2c240553ce044eedb41541d72b9475d7 P cd75a17ab2604397adab03bb8b5fd75c [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 8. Re-sending same reply.
I20260709 13:19:25.107853  6844 leader_election.cc:304] T ce4f062dcd314d43a63ca74067cb5ee3 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:19:25.036583  9259 consensus_queue.cc:260] T bb3d8792045a4583ae2e965b1350a5b4 P ccd8a4c3bfe3413cb2ae219b09aea832 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
W20260709 13:19:25.114602  6770 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 60215.3us
I20260709 13:19:25.113590  9449 raft_consensus.cc:493] T 404190ce4ce94cecbfcb6ea9d1dd8626 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:25.120345  9450 leader_election.cc:290] T 711ef6523deb4cbe8ef2ba61e1c21c98 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 8 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:25.121284  9450 raft_consensus.cc:2749] T 7a734b5ab7834e05a8c422208acc58b1 P b7ab4784c7344b939bc36f639286f377 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:19:25.125599  6770 leader_election.cc:304] T 1bf4668eeb70467fb3dc5a0289233b3c P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:19:25.108072  9487 leader_election.cc:290] T 7887766dc6784fcaa42b35c05fea7a99 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 7 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:25.131270  6881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5be3a11b23d4ea9b08300a2789821c7" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:19:25.107839  9516 leader_election.cc:290] T c4db81d9d329422bb3b4160ca4ac2d1d P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:25.130347  9484 raft_consensus.cc:2749] T ce4f062dcd314d43a63ca74067cb5ee3 P cd75a17ab2604397adab03bb8b5fd75c [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:19:25.128664  9449 raft_consensus.cc:515] T 404190ce4ce94cecbfcb6ea9d1dd8626 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:19:25.137941  6844 leader_election.cc:304] T 3d65025eea89441290d85dd053810e31 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:19:25.138959  9484 raft_consensus.cc:2749] T 3d65025eea89441290d85dd053810e31 P cd75a17ab2604397adab03bb8b5fd75c [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:19:25.143760  6695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 114312us
I20260709 13:19:25.111275  9031 raft_consensus.cc:3060] T 22ccee1b570c4ad3a57bd7aec085b1b4 P b7ab4784c7344b939bc36f639286f377 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:25.146070  6876 raft_consensus.cc:2393] T d33d5ee8ef6f415593d8df52063161ad P cd75a17ab2604397adab03bb8b5fd75c [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ccd8a4c3bfe3413cb2ae219b09aea832 in current term 8: Already voted for candidate b7ab4784c7344b939bc36f639286f377 in this term.
I20260709 13:19:25.112306  9461 raft_consensus.cc:2749] T 9b3759de40694069b13c0f8bd40e5709 P cd75a17ab2604397adab03bb8b5fd75c [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:19:25.146459  6770 leader_election.cc:304] T d8292e16e5654be6bc408560cf256aaa P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:19:25.139848  6844 leader_election.cc:304] T f03d0dbf16864ca4bc1bb5e4c0334c0f P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:19:25.152763  6770 leader_election.cc:304] T 9b3759de40694069b13c0f8bd40e5709 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:19:25.147698  9259 raft_consensus.cc:3060] T bb3d8792045a4583ae2e965b1350a5b4 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:25.162215  6881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d9def8b32fd443aa94ab1420b06837b" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:19:25.163173  6881 raft_consensus.cc:2410] T 4d9def8b32fd443aa94ab1420b06837b P cd75a17ab2604397adab03bb8b5fd75c [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ccd8a4c3bfe3413cb2ae219b09aea832 for term 7 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 13:19:25.147995  9046 raft_consensus.cc:697] T 30e88460611e47b2ba16a46a30b5f416 P b7ab4784c7344b939bc36f639286f377 [term 6 LEADER]: Becoming Leader. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
I20260709 13:19:25.160912  6844 leader_election.cc:304] T 3411566abe2d4c9bb4b2adfdd05e6f17 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:19:25.141888  9524 raft_consensus.cc:3060] T f4b8bd455d5a47c18a1380839c6e0d61 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:25.185307  6695 leader_election.cc:304] T 34f36d59d88f40fe8a2805e604fc6c0a P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
I20260709 13:19:25.150666  9465 raft_consensus.cc:697] T 4d9def8b32fd443aa94ab1420b06837b P b7ab4784c7344b939bc36f639286f377 [term 7 LEADER]: Becoming Leader. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
I20260709 13:19:25.188012  7499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17587d6730594da4a56fa13a353232a1" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb"
I20260709 13:19:25.188961  9465 consensus_queue.cc:237] T 4d9def8b32fd443aa94ab1420b06837b P b7ab4784c7344b939bc36f639286f377 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:25.190331  9449 leader_election.cc:290] T 404190ce4ce94cecbfcb6ea9d1dd8626 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:19:25.192426  9544 raft_consensus.cc:2749] T 1bf4668eeb70467fb3dc5a0289233b3c P b7ab4784c7344b939bc36f639286f377 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:19:25.192960  9046 consensus_queue.cc:237] T 30e88460611e47b2ba16a46a30b5f416 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:25.187105  7494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be1a92657f494cac8dd227d152f50151" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb"
I20260709 13:19:25.194005  9450 raft_consensus.cc:2749] T 9b3759de40694069b13c0f8bd40e5709 P b7ab4784c7344b939bc36f639286f377 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:19:25.089613  9505 consensus_queue.cc:237] T de3186201e1a40d0b335eeb8b4e256e0 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:25.201848  7494 raft_consensus.cc:2468] T be1a92657f494cac8dd227d152f50151 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 8.
I20260709 13:19:25.202286  9466 raft_consensus.cc:515] T e31b9971c15848dea59d4d4130141d9e P ccd8a4c3bfe3413cb2ae219b09aea832 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:25.193378  9544 raft_consensus.cc:2749] T d8292e16e5654be6bc408560cf256aaa P b7ab4784c7344b939bc36f639286f377 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:19:25.201519  9490 raft_consensus.cc:515] T bd6869f07b5a4885a0b99fbe60c3b175 P b7ab4784c7344b939bc36f639286f377 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:25.203022  9517 raft_consensus.cc:2804] T 34f36d59d88f40fe8a2805e604fc6c0a P ccd8a4c3bfe3413cb2ae219b09aea832 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:19:25.167125  9344 raft_consensus.cc:2749] T f03d0dbf16864ca4bc1bb5e4c0334c0f P cd75a17ab2604397adab03bb8b5fd75c [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:19:25.219949  6770 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 67265.8us
I20260709 13:19:25.221202  6770 leader_election.cc:304] T 7c44c4849aa54f2b94d1f1bef9ed546f P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:19:25.183943  8832 raft_consensus.cc:697] T 3411566abe2d4c9bb4b2adfdd05e6f17 P b7ab4784c7344b939bc36f639286f377 [term 6 LEADER]: Becoming Leader. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
W20260709 13:19:25.228367  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 67550.6us
I20260709 13:19:25.230825  6770 leader_election.cc:304] T 07a92dd554674067a83a9cb68c4773f2 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:19:25.233783  6873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24ee15416e3145beaa1b8183453729a3" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:19:25.238562  6876 raft_consensus.cc:1240] T e77e330a82df4b43a745d57a68f6f057 P cd75a17ab2604397adab03bb8b5fd75c [term 9 FOLLOWER]: Rejecting Update request from peer ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 8. Current term is 9. Ops: [8.4-8.4]
I20260709 13:19:25.206235  9526 leader_election.cc:290] T bd6869f07b5a4885a0b99fbe60c3b175 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 7 election: Requested vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:25.195706  9531 raft_consensus.cc:515] T 9e326172347f45e99a0d482b5d8ef768 P cd75a17ab2604397adab03bb8b5fd75c [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:25.205710  9351 raft_consensus.cc:2749] T 3411566abe2d4c9bb4b2adfdd05e6f17 P cd75a17ab2604397adab03bb8b5fd75c [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:19:25.265224  6844 leader_election.cc:304] T 7ba5dac66ab5497e9e336f2a3c28cda5 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, b7ab4784c7344b939bc36f639286f377
W20260709 13:19:25.290007  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 60603.9us
I20260709 13:19:25.290187  6881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bf4668eeb70467fb3dc5a0289233b3c" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:19:25.290978  6881 raft_consensus.cc:2468] T 1bf4668eeb70467fb3dc5a0289233b3c P cd75a17ab2604397adab03bb8b5fd75c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 6.
I20260709 13:19:25.291150  6844 leader_election.cc:304] T e31b9971c15848dea59d4d4130141d9e P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:19:25.267110  6880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "853ac0a8cbd64ce99457f170216d4d0f" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:19:25.234786  6873 raft_consensus.cc:2468] T 24ee15416e3145beaa1b8183453729a3 P cd75a17ab2604397adab03bb8b5fd75c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 6.
I20260709 13:19:25.268289  6770 leader_election.cc:304] T 24ee15416e3145beaa1b8183453729a3 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:19:25.218010  9517 raft_consensus.cc:493] T 34f36d59d88f40fe8a2805e604fc6c0a P ccd8a4c3bfe3413cb2ae219b09aea832 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:25.293807  6770 leader_election.cc:304] T 9e326172347f45e99a0d482b5d8ef768 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
W20260709 13:19:25.289369  6772 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 240673us
I20260709 13:19:25.296788  6770 leader_election.cc:304] T 4275cf08e63345f993bce8664eada830 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:19:25.295677  6878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbdf895bba214ff68685a24fd17dfb5d" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:19:25.288968  9544 raft_consensus.cc:2749] T 7c44c4849aa54f2b94d1f1bef9ed546f P b7ab4784c7344b939bc36f639286f377 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:19:25.218209  9515 consensus_queue.cc:1048] T 44bde925b2e541b69890d70715b85176 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.076s
I20260709 13:19:25.333324  6772 leader_election.cc:304] T ce4f062dcd314d43a63ca74067cb5ee3 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:19:25.331460  6844 leader_election.cc:304] T f5be3a11b23d4ea9b08300a2789821c7 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:19:25.345072  6728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "404190ce4ce94cecbfcb6ea9d1dd8626" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:19:25.218626  9506 consensus_queue.cc:1048] T 711ef6523deb4cbe8ef2ba61e1c21c98 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.077s
I20260709 13:19:25.341022  6876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3022224cc81473690653a83d4e99470" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
W20260709 13:19:25.353065  6697 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 124936us
I20260709 13:19:25.266697  9502 leader_election.cc:290] T b56bf91d90824c959e21e0cee5ba1816 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 8 election: Requested vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:25.358228  6801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "404190ce4ce94cecbfcb6ea9d1dd8626" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:19:25.361362  6801 raft_consensus.cc:2468] T 404190ce4ce94cecbfcb6ea9d1dd8626 P b7ab4784c7344b939bc36f639286f377 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in term 7.
I20260709 13:19:25.349208  9526 consensus_queue.cc:1059] T 95a75bfe094d4bdc963aba3f08dfcd25 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: INVALID_TERM, Last received: 7.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.013s
I20260709 13:19:25.362783  9526 raft_consensus.cc:3055] T 95a75bfe094d4bdc963aba3f08dfcd25 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:19:25.365191  6881 raft_consensus.cc:1240] T 3a485a995abc4807b6e511e45419f737 P cd75a17ab2604397adab03bb8b5fd75c [term 6 FOLLOWER]: Rejecting Update request from peer ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 5. Current term is 6. Ops: []
I20260709 13:19:25.362995  7466 leader_election.cc:304] T 404190ce4ce94cecbfcb6ea9d1dd8626 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, b7ab4784c7344b939bc36f639286f377; no voters: 
I20260709 13:19:25.369427  6844 leader_election.cc:304] T f3f9c2e2bf644115957398fe4c9459db P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:19:25.301412  9344 raft_consensus.cc:2749] T 7ba5dac66ab5497e9e336f2a3c28cda5 P cd75a17ab2604397adab03bb8b5fd75c [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:19:25.372123  6697 leader_election.cc:304] T 20f6842e26174571996b8dea4151d4be P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377
I20260709 13:19:25.332708  9486 raft_consensus.cc:2749] T e31b9971c15848dea59d4d4130141d9e P cd75a17ab2604397adab03bb8b5fd75c [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:19:25.295785  9517 raft_consensus.cc:3060] T 34f36d59d88f40fe8a2805e604fc6c0a P ccd8a4c3bfe3413cb2ae219b09aea832 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:19:25.294988  9545 raft_consensus.cc:2749] T 07a92dd554674067a83a9cb68c4773f2 P b7ab4784c7344b939bc36f639286f377 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
W20260709 13:19:25.379626  6695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 176504us
I20260709 13:19:25.304109  9493 consensus_queue.cc:1048] T d8292e16e5654be6bc408560cf256aaa P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 1, Time since last communication: 0.069s
I20260709 13:19:25.397646  6881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4db81d9d329422bb3b4160ca4ac2d1d" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:19:25.398406  6881 raft_consensus.cc:2468] T c4db81d9d329422bb3b4160ca4ac2d1d P cd75a17ab2604397adab03bb8b5fd75c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 7.
I20260709 13:19:25.227888  6726 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4275cf08e63345f993bce8664eada830"
dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
mode: GRACEFUL
new_leader_uuid: "b7ab4784c7344b939bc36f639286f377"
 from {username='slave'} at 127.0.0.1:38536
I20260709 13:19:25.402438  6726 raft_consensus.cc:606] T 4275cf08e63345f993bce8664eada830 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 7 FOLLOWER]: Received request to transfer leadership to TS b7ab4784c7344b939bc36f639286f377
W20260709 13:19:25.401376  6772 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 68105.5us
I20260709 13:19:25.402875  6726 raft_consensus.cc:614] T 4275cf08e63345f993bce8664eada830 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 7 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:19:25.406296  6876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6869f07b5a4885a0b99fbe60c3b175" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 7 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:19:25.406962  6876 raft_consensus.cc:3060] T bd6869f07b5a4885a0b99fbe60c3b175 P cd75a17ab2604397adab03bb8b5fd75c [term 5 FOLLOWER]: Advancing to term 7
I20260709 13:19:25.367835  9176 raft_consensus.cc:697] T e77e330a82df4b43a745d57a68f6f057 P b7ab4784c7344b939bc36f639286f377 [term 9 LEADER]: Becoming Leader. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
I20260709 13:19:25.363150  9526 raft_consensus.cc:740] T 95a75bfe094d4bdc963aba3f08dfcd25 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
I20260709 13:19:25.394014  9366 raft_consensus.cc:2804] T 404190ce4ce94cecbfcb6ea9d1dd8626 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:19:25.378664  9461 raft_consensus.cc:2749] T f5be3a11b23d4ea9b08300a2789821c7 P cd75a17ab2604397adab03bb8b5fd75c [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:19:25.420789  6844 leader_election.cc:304] T e77e330a82df4b43a745d57a68f6f057 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:19:25.425338  9351 raft_consensus.cc:2749] T e77e330a82df4b43a745d57a68f6f057 P cd75a17ab2604397adab03bb8b5fd75c [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:19:25.426196  9351 consensus_queue.cc:1048] T 8c7f33e544204fbaac4078e3e83bbf4e P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:19:25.428987  6844 leader_election.cc:304] T 2c240553ce044eedb41541d72b9475d7 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
W20260709 13:19:25.430976  6698 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:25.431025  9351 raft_consensus.cc:2749] T 2c240553ce044eedb41541d72b9475d7 P cd75a17ab2604397adab03bb8b5fd75c [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:19:25.432231  6844 leader_election.cc:304] T f58dc08b12a2494bb9a1372837970ca2 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:19:25.416262  7503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24ee15416e3145beaa1b8183453729a3" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:19:25.404204  9548 raft_consensus.cc:2749] T 4275cf08e63345f993bce8664eada830 P b7ab4784c7344b939bc36f639286f377 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:19:25.445955  6695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 47142.2us
I20260709 13:19:25.415658  9273 raft_consensus.cc:2749] T f3f9c2e2bf644115957398fe4c9459db P cd75a17ab2604397adab03bb8b5fd75c [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:19:25.468596  6697 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 97553.4us
I20260709 13:19:25.436285  6844 leader_election.cc:304] T bd6869f07b5a4885a0b99fbe60c3b175 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:19:25.441002  6772 leader_election.cc:304] T 713b5728a197487c9300b310ab94e5a3 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:19:25.470789  6697 leader_election.cc:304] T 3d65025eea89441290d85dd053810e31 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:19:25.471920  6844 leader_election.cc:304] T 95a75bfe094d4bdc963aba3f08dfcd25 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:19:25.422861  9366 raft_consensus.cc:493] T 404190ce4ce94cecbfcb6ea9d1dd8626 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:25.476250  6844 leader_election.cc:304] T 22ccee1b570c4ad3a57bd7aec085b1b4 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:19:25.470465  9505 raft_consensus.cc:2804] T 20f6842e26174571996b8dea4151d4be P ccd8a4c3bfe3413cb2ae219b09aea832 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:19:25.499622  6697 leader_election.cc:400] T 3fa34c08b205435dba97346991aa1f92 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 8 election: Vote denied by peer cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931) with higher term. Message: Invalid argument: T 3fa34c08b205435dba97346991aa1f92 P cd75a17ab2604397adab03bb8b5fd75c [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 8. Current term is 9.
W20260709 13:19:25.481312  6770 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 140542us
I20260709 13:19:25.504453  6697 leader_election.cc:403] T 3fa34c08b205435dba97346991aa1f92 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 8 election: Cancelling election due to peer responding with higher term
I20260709 13:19:25.504972  6770 leader_election.cc:304] T f03d0dbf16864ca4bc1bb5e4c0334c0f P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:19:25.486012  9366 raft_consensus.cc:3060] T 404190ce4ce94cecbfcb6ea9d1dd8626 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:19:25.508553  7466 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 113193us
W20260709 13:19:25.485469  9539 log.cc:927] Time spent T bb3d8792045a4583ae2e965b1350a5b4 P 7ba59cc884714e8aa5f3f0ecaed84cbb: Append to log took a long time: real 0.336s	user 0.001s	sys 0.000s
I20260709 13:19:25.414556  8832 consensus_queue.cc:237] T 3411566abe2d4c9bb4b2adfdd05e6f17 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:25.495081  9461 raft_consensus.cc:2749] T 95a75bfe094d4bdc963aba3f08dfcd25 P cd75a17ab2604397adab03bb8b5fd75c [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:19:25.592907  6770 leader_election.cc:304] T 8c7f33e544204fbaac4078e3e83bbf4e P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
I20260709 13:19:25.500676  9502 raft_consensus.cc:2749] T 3d65025eea89441290d85dd053810e31 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:19:25.498344  9466 leader_election.cc:290] T e31b9971c15848dea59d4d4130141d9e P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 5 election: Requested vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:25.475596  9515 consensus_queue.cc:1048] T d8292e16e5654be6bc408560cf256aaa P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 2, Time since last communication: 0.047s
W20260709 13:19:25.649905  6697 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 150446us
I20260709 13:19:25.507011  9545 raft_consensus.cc:2804] T ce4f062dcd314d43a63ca74067cb5ee3 P b7ab4784c7344b939bc36f639286f377 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:19:25.604599  6772 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 167475us
W20260709 13:19:25.614912  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 138758us
I20260709 13:19:25.513586  9273 raft_consensus.cc:2749] T 22ccee1b570c4ad3a57bd7aec085b1b4 P cd75a17ab2604397adab03bb8b5fd75c [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:19:25.656761  6770 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 134852us
I20260709 13:19:25.592367  9490 leader_election.cc:290] T bd6869f07b5a4885a0b99fbe60c3b175 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 7 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:25.667493  6770 leader_election.cc:304] T 7c37d41cd9164c15a6826ca62a851a69 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:19:25.669777  6770 leader_election.cc:304] T 404190ce4ce94cecbfcb6ea9d1dd8626 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:19:25.670713  6772 leader_election.cc:304] T d33d5ee8ef6f415593d8df52063161ad P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:19:25.592482  9541 raft_consensus.cc:2749] T 24ee15416e3145beaa1b8183453729a3 P b7ab4784c7344b939bc36f639286f377 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:19:25.678411  6772 leader_election.cc:304] T 95a75bfe094d4bdc963aba3f08dfcd25 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:19:25.674427  6697 leader_election.cc:304] T 4d9def8b32fd443aa94ab1420b06837b P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:19:25.597076  9505 raft_consensus.cc:697] T 20f6842e26174571996b8dea4151d4be P ccd8a4c3bfe3413cb2ae219b09aea832 [term 7 LEADER]: Becoming Leader. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
I20260709 13:19:25.608238  9046 raft_consensus.cc:2804] T 713b5728a197487c9300b310ab94e5a3 P b7ab4784c7344b939bc36f639286f377 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:19:25.604377  9555 raft_consensus.cc:2749] T 3fa34c08b205435dba97346991aa1f92 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 9 FOLLOWER]: Leader election lost for term 8. Reason: Vote denied by peer cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931) with higher term. Message: Invalid argument: T 3fa34c08b205435dba97346991aa1f92 P cd75a17ab2604397adab03bb8b5fd75c [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 8. Current term is 9.
I20260709 13:19:25.610605  9550 raft_consensus.cc:2749] T f03d0dbf16864ca4bc1bb5e4c0334c0f P b7ab4784c7344b939bc36f639286f377 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:19:25.659759  9515 consensus_queue.cc:1243] T d8292e16e5654be6bc408560cf256aaa P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Peer b7ab4784c7344b939bc36f639286f377 log is divergent from this leader: its last log entry 5.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260709 13:19:25.605888  9546 raft_consensus.cc:2749] T 9e326172347f45e99a0d482b5d8ef768 P b7ab4784c7344b939bc36f639286f377 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:19:25.657987  9545 raft_consensus.cc:493] T ce4f062dcd314d43a63ca74067cb5ee3 P b7ab4784c7344b939bc36f639286f377 [term 6 FOLLOWER]: Starting leader election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:19:25.712021  6729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b56bf91d90824c959e21e0cee5ba1816" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:19:25.506261  9526 consensus_queue.cc:260] T 95a75bfe094d4bdc963aba3f08dfcd25 P ccd8a4c3bfe3413cb2ae219b09aea832 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 7.2, Last appended by leader: 2, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:25.712992  6730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1528ab62b6fe4e3099d08f141afee116" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:19:25.713887  6730 raft_consensus.cc:2468] T 1528ab62b6fe4e3099d08f141afee116 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 6.
I20260709 13:19:25.694383  9561 raft_consensus.cc:2804] T 8c7f33e544204fbaac4078e3e83bbf4e P b7ab4784c7344b939bc36f639286f377 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:19:25.696607  9505 consensus_queue.cc:237] T 20f6842e26174571996b8dea4151d4be P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:25.697352  7468 leader_election.cc:304] T 7ba5dac66ab5497e9e336f2a3c28cda5 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377
W20260709 13:19:25.722934  6697 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 48591.4us
I20260709 13:19:25.715323  6730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1704639a875409b9959353527b3fd68" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:19:25.718966  6729 raft_consensus.cc:2393] T b56bf91d90824c959e21e0cee5ba1816 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c in current term 8: Already voted for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in this term.
I20260709 13:19:25.679694  9531 leader_election.cc:290] T 9e326172347f45e99a0d482b5d8ef768 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 6 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:19:25.730508  6724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "853ac0a8cbd64ce99457f170216d4d0f" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:19:25.721666  6728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20f6842e26174571996b8dea4151d4be" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:19:25.729238  6730 raft_consensus.cc:2468] T a1704639a875409b9959353527b3fd68 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 6.
I20260709 13:19:25.704207  9490 raft_consensus.cc:3060] T 404190ce4ce94cecbfcb6ea9d1dd8626 P b7ab4784c7344b939bc36f639286f377 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:25.707261  9450 raft_consensus.cc:2804] T 7c37d41cd9164c15a6826ca62a851a69 P b7ab4784c7344b939bc36f639286f377 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:19:25.736073  6697 leader_election.cc:304] T 1bf4668eeb70467fb3dc5a0289233b3c P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:19:25.738592  6724 raft_consensus.cc:2468] T 853ac0a8cbd64ce99457f170216d4d0f P ccd8a4c3bfe3413cb2ae219b09aea832 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 4.
I20260709 13:19:25.714970  9545 raft_consensus.cc:3060] T ce4f062dcd314d43a63ca74067cb5ee3 P b7ab4784c7344b939bc36f639286f377 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:25.752532  6728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8292e16e5654be6bc408560cf256aaa" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:19:25.669590  9176 consensus_queue.cc:237] T e77e330a82df4b43a745d57a68f6f057 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } }
I20260709 13:19:25.771049  7500 raft_consensus.cc:1240] T bb3d8792045a4583ae2e965b1350a5b4 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 7 FOLLOWER]: Rejecting Update request from peer ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 6. Current term is 7. Ops: []
I20260709 13:19:25.714243  9046 raft_consensus.cc:697] T 713b5728a197487c9300b310ab94e5a3 P b7ab4784c7344b939bc36f639286f377 [term 7 LEADER]: Becoming Leader. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
I20260709 13:19:25.779042  6697 leader_election.cc:304] T 24ee15416e3145beaa1b8183453729a3 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:19:25.725956  9561 raft_consensus.cc:493] T 8c7f33e544204fbaac4078e3e83bbf4e P b7ab4784c7344b939bc36f639286f377 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:25.724606  9541 raft_consensus.cc:2804] T 95a75bfe094d4bdc963aba3f08dfcd25 P b7ab4784c7344b939bc36f639286f377 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:19:25.729420  9294 raft_consensus.cc:2749] T 4d9def8b32fd443aa94ab1420b06837b P ccd8a4c3bfe3413cb2ae219b09aea832 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:19:25.806397  6729 raft_consensus.cc:1240] T e31b9971c15848dea59d4d4130141d9e P ccd8a4c3bfe3413cb2ae219b09aea832 [term 5 FOLLOWER]: Rejecting Update request from peer b7ab4784c7344b939bc36f639286f377 for earlier term 4. Current term is 5. Ops: []
I20260709 13:19:25.807068  6697 leader_election.cc:304] T 853ac0a8cbd64ce99457f170216d4d0f P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
W20260709 13:19:25.791244  6772 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 112970us
I20260709 13:19:25.793140  6730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1528ab62b6fe4e3099d08f141afee116" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:19:25.834642  6730 raft_consensus.cc:2393] T 1528ab62b6fe4e3099d08f141afee116 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate b7ab4784c7344b939bc36f639286f377 in current term 6: Already voted for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in this term.
I20260709 13:19:25.794169  6731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90d42e216d9741e190bca19a781291fd" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:19:25.795313  6728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34f36d59d88f40fe8a2805e604fc6c0a" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
W20260709 13:19:25.799016  9543 log.cc:927] Time spent T 4275cf08e63345f993bce8664eada830 P cd75a17ab2604397adab03bb8b5fd75c: Append to log took a long time: real 0.387s	user 0.001s	sys 0.000s
I20260709 13:19:25.799715  6727 raft_consensus.cc:1240] T 07a92dd554674067a83a9cb68c4773f2 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 7 FOLLOWER]: Rejecting Update request from peer cd75a17ab2604397adab03bb8b5fd75c for earlier term 6. Current term is 7. Ops: []
I20260709 13:19:25.799962  9553 raft_consensus.cc:2804] T d33d5ee8ef6f415593d8df52063161ad P b7ab4784c7344b939bc36f639286f377 [term 8 FOLLOWER]: Leader election won for term 8
W20260709 13:19:25.801680  9551 log.cc:927] Time spent T 90d42e216d9741e190bca19a781291fd P ccd8a4c3bfe3413cb2ae219b09aea832: Append to log took a long time: real 0.202s	user 0.000s	sys 0.000s
I20260709 13:19:25.801482  6875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fa34c08b205435dba97346991aa1f92" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
W20260709 13:19:25.804827  9558 log.cc:927] Time spent T 30e88460611e47b2ba16a46a30b5f416 P b7ab4784c7344b939bc36f639286f377: Append to log took a long time: real 0.127s	user 0.001s	sys 0.000s
I20260709 13:19:25.805181  6878 raft_consensus.cc:1275] T 3fa34c08b205435dba97346991aa1f92 P cd75a17ab2604397adab03bb8b5fd75c [term 9 FOLLOWER]: Refusing update from remote peer 7ba59cc884714e8aa5f3f0ecaed84cbb: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:19:25.805848  6724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d33d5ee8ef6f415593d8df52063161ad" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:19:25.874603  6724 raft_consensus.cc:3060] T d33d5ee8ef6f415593d8df52063161ad P ccd8a4c3bfe3413cb2ae219b09aea832 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:25.799604  9512 raft_consensus.cc:2804] T 7ba5dac66ab5497e9e336f2a3c28cda5 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:19:25.869155  6731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44bde925b2e541b69890d70715b85176" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:19:25.873155  6807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6869f07b5a4885a0b99fbe60c3b175" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 7 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:19:25.771489  9450 raft_consensus.cc:493] T 7c37d41cd9164c15a6826ca62a851a69 P b7ab4784c7344b939bc36f639286f377 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:25.804128  6723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7887766dc6784fcaa42b35c05fea7a99" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:19:25.841838  6799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c44c4849aa54f2b94d1f1bef9ed546f" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
W20260709 13:19:25.851480  6695 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:25.880344  6807 raft_consensus.cc:2393] T bd6869f07b5a4885a0b99fbe60c3b175 P b7ab4784c7344b939bc36f639286f377 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ccd8a4c3bfe3413cb2ae219b09aea832 in current term 7: Already voted for candidate b7ab4784c7344b939bc36f639286f377 in this term.
I20260709 13:19:25.879454  6801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e31b9971c15848dea59d4d4130141d9e" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:19:25.880395  6877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fa34c08b205435dba97346991aa1f92" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:19:25.796653  6844 leader_election.cc:304] T a1704639a875409b9959353527b3fd68 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:19:25.896224  6727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab432e62819d499eaaf3dd55481dd930" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:19:25.895943  6800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d33d5ee8ef6f415593d8df52063161ad" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
W20260709 13:19:25.896720  6697 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 89732.4us
I20260709 13:19:25.898674  6877 raft_consensus.cc:2376] T 3fa34c08b205435dba97346991aa1f92 P cd75a17ab2604397adab03bb8b5fd75c [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in term 9. Re-sending same reply.
I20260709 13:19:25.895417  6879 raft_consensus.cc:1275] T fe20b4b48823486ca3b9c648db6ce8aa P cd75a17ab2604397adab03bb8b5fd75c [term 5 FOLLOWER]: Refusing update from remote peer 7ba59cc884714e8aa5f3f0ecaed84cbb: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
W20260709 13:19:25.937855  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 141268us
I20260709 13:19:25.924871  6803 raft_consensus.cc:1240] T 4275cf08e63345f993bce8664eada830 P b7ab4784c7344b939bc36f639286f377 [term 7 FOLLOWER]: Rejecting Update request from peer ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 6. Current term is 7. Ops: [4.3-6.4]
I20260709 13:19:25.770694  9550 consensus_queue.cc:1048] T a1704639a875409b9959353527b3fd68 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.111s
I20260709 13:19:25.788806  9526 raft_consensus.cc:3060] T 95a75bfe094d4bdc963aba3f08dfcd25 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:25.806810  9351 raft_consensus.cc:2804] T f58dc08b12a2494bb9a1372837970ca2 P cd75a17ab2604397adab03bb8b5fd75c [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 13:19:25.930439  6876 consensus_meta.cc:287] T bd6869f07b5a4885a0b99fbe60c3b175 P cd75a17ab2604397adab03bb8b5fd75c: Time spent flushing consensus metadata: real 0.517s	user 0.020s	sys 0.002s
I20260709 13:19:25.950822  6876 raft_consensus.cc:2468] T bd6869f07b5a4885a0b99fbe60c3b175 P cd75a17ab2604397adab03bb8b5fd75c [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 7.
I20260709 13:19:25.788066  9556 raft_consensus.cc:493] T 30e88460611e47b2ba16a46a30b5f416 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:25.960587  6724 raft_consensus.cc:2468] T d33d5ee8ef6f415593d8df52063161ad P ccd8a4c3bfe3413cb2ae219b09aea832 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 8.
I20260709 13:19:25.807955  9561 raft_consensus.cc:3060] T 8c7f33e544204fbaac4078e3e83bbf4e P b7ab4784c7344b939bc36f639286f377 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:19:25.906410  6723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6869f07b5a4885a0b99fbe60c3b175" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 7 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:19:25.902848  6798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c7f33e544204fbaac4078e3e83bbf4e" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:19:25.894559  6799 raft_consensus.cc:2468] T 7c44c4849aa54f2b94d1f1bef9ed546f P b7ab4784c7344b939bc36f639286f377 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 8.
W20260709 13:19:25.939540  6698 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:25.926514  7468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 229238us
I20260709 13:19:25.944545  6844 leader_election.cc:304] T 853ac0a8cbd64ce99457f170216d4d0f P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:19:25.808530  9384 raft_consensus.cc:2804] T 1bf4668eeb70467fb3dc5a0289233b3c P ccd8a4c3bfe3413cb2ae219b09aea832 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:19:25.904211  6806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5be3a11b23d4ea9b08300a2789821c7" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:19:25.956334  6807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be1a92657f494cac8dd227d152f50151" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:19:25.930918  6727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "711ef6523deb4cbe8ef2ba61e1c21c98" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:19:25.961812  6724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e326172347f45e99a0d482b5d8ef768" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:19:25.979283  6727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a485a995abc4807b6e511e45419f737" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:19:25.742830  9555 consensus_queue.cc:1059] T e77e330a82df4b43a745d57a68f6f057 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: INVALID_TERM, Last received: 6.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.154s
I20260709 13:19:25.960561  6697 leader_election.cc:304] T c4db81d9d329422bb3b4160ca4ac2d1d P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:19:25.995051  6799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "853ac0a8cbd64ce99457f170216d4d0f" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:19:25.974145  6723 raft_consensus.cc:2393] T bd6869f07b5a4885a0b99fbe60c3b175 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate b7ab4784c7344b939bc36f639286f377 in current term 7: Already voted for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in this term.
I20260709 13:19:25.924157  9557 raft_consensus.cc:2749] T 853ac0a8cbd64ce99457f170216d4d0f P ccd8a4c3bfe3413cb2ae219b09aea832 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:19:25.900854  9450 raft_consensus.cc:3060] T 7c37d41cd9164c15a6826ca62a851a69 P b7ab4784c7344b939bc36f639286f377 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:25.892875  9512 raft_consensus.cc:493] T 7ba5dac66ab5497e9e336f2a3c28cda5 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 8 FOLLOWER]: Starting leader election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:19:25.903961  9465 raft_consensus.cc:493] T 20f6842e26174571996b8dea4151d4be P b7ab4784c7344b939bc36f639286f377 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:25.909138  9553 raft_consensus.cc:697] T d33d5ee8ef6f415593d8df52063161ad P b7ab4784c7344b939bc36f639286f377 [term 8 LEADER]: Becoming Leader. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
I20260709 13:19:25.998334  6724 raft_consensus.cc:1240] T a3022224cc81473690653a83d4e99470 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 7 FOLLOWER]: Rejecting Update request from peer b7ab4784c7344b939bc36f639286f377 for earlier term 6. Current term is 7. Ops: []
I20260709 13:19:25.999409  6805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e326172347f45e99a0d482b5d8ef768" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:19:26.057066  6805 raft_consensus.cc:3060] T 9e326172347f45e99a0d482b5d8ef768 P b7ab4784c7344b939bc36f639286f377 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:25.954767  9344 raft_consensus.cc:2764] T bd6869f07b5a4885a0b99fbe60c3b175 P cd75a17ab2604397adab03bb8b5fd75c [term 7 FOLLOWER]: Leader pre-election decision vote started in defunct term 5: won
W20260709 13:19:26.032845  6697 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 72358.3us
I20260709 13:19:25.996847  6807 raft_consensus.cc:3060] T be1a92657f494cac8dd227d152f50151 P b7ab4784c7344b939bc36f639286f377 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:19:26.042558  9524 consensus_meta.cc:287] T f4b8bd455d5a47c18a1380839c6e0d61 P ccd8a4c3bfe3413cb2ae219b09aea832: Time spent flushing consensus metadata: real 0.843s	user 0.019s	sys 0.004s
W20260709 13:19:26.000221  7466 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 201138us
I20260709 13:19:25.977828  9384 raft_consensus.cc:493] T 1bf4668eeb70467fb3dc5a0289233b3c P ccd8a4c3bfe3413cb2ae219b09aea832 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:26.052693  6799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1704639a875409b9959353527b3fd68" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:19:26.031246  6727 raft_consensus.cc:1275] T 4275cf08e63345f993bce8664eada830 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 7 FOLLOWER]: Refusing update from remote peer cd75a17ab2604397adab03bb8b5fd75c: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 4. (term mismatch)
I20260709 13:19:25.963951  9548 raft_consensus.cc:493] T de3186201e1a40d0b335eeb8b4e256e0 P b7ab4784c7344b939bc36f639286f377 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:25.974330  9461 raft_consensus.cc:2804] T a1704639a875409b9959353527b3fd68 P cd75a17ab2604397adab03bb8b5fd75c [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:19:26.070026  6724 raft_consensus.cc:1240] T 17587d6730594da4a56fa13a353232a1 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 9 FOLLOWER]: Rejecting Update request from peer 7ba59cc884714e8aa5f3f0ecaed84cbb for earlier term 8. Current term is 9. Ops: []
I20260709 13:19:26.077986  6727 pending_rounds.cc:85] T 4275cf08e63345f993bce8664eada830 P ccd8a4c3bfe3413cb2ae219b09aea832: Aborting all ops after (but not including) 3
I20260709 13:19:26.087229  6727 pending_rounds.cc:107] T 4275cf08e63345f993bce8664eada830 P ccd8a4c3bfe3413cb2ae219b09aea832: Aborting uncommitted NO_OP operation due to leader change: 6.4
I20260709 13:19:26.087025  6799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbdf895bba214ff68685a24fd17dfb5d" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:19:26.087484  6727 raft_consensus.cc:2889] T 4275cf08e63345f993bce8664eada830 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:19:26.082149  6806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8292e16e5654be6bc408560cf256aaa" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:19:26.042137  9512 raft_consensus.cc:3060] T 7ba5dac66ab5497e9e336f2a3c28cda5 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:26.078092  6723 raft_consensus.cc:1275] T f4b8bd455d5a47c18a1380839c6e0d61 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 6 FOLLOWER]: Refusing update from remote peer cd75a17ab2604397adab03bb8b5fd75c: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
W20260709 13:19:26.087533  6770 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 138273us
I20260709 13:19:25.974967  9516 consensus_queue.cc:1059] T 3a485a995abc4807b6e511e45419f737 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.091s
I20260709 13:19:26.088239  6806 raft_consensus.cc:2468] T d8292e16e5654be6bc408560cf256aaa P b7ab4784c7344b939bc36f639286f377 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 8.
I20260709 13:19:26.066201  9515 raft_consensus.cc:2804] T c4db81d9d329422bb3b4160ca4ac2d1d P ccd8a4c3bfe3413cb2ae219b09aea832 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:19:26.078876  9531 raft_consensus.cc:2804] T 853ac0a8cbd64ce99457f170216d4d0f P cd75a17ab2604397adab03bb8b5fd75c [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:19:26.085302  9384 raft_consensus.cc:3060] T 1bf4668eeb70467fb3dc5a0289233b3c P ccd8a4c3bfe3413cb2ae219b09aea832 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:26.104509  6799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a485a995abc4807b6e511e45419f737" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:19:26.116962  6799 raft_consensus.cc:3060] T 3a485a995abc4807b6e511e45419f737 P b7ab4784c7344b939bc36f639286f377 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:26.086823  9461 raft_consensus.cc:493] T a1704639a875409b9959353527b3fd68 P cd75a17ab2604397adab03bb8b5fd75c [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:26.060350  9465 raft_consensus.cc:515] T 20f6842e26174571996b8dea4151d4be P b7ab4784c7344b939bc36f639286f377 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:26.100600  9515 raft_consensus.cc:493] T c4db81d9d329422bb3b4160ca4ac2d1d P ccd8a4c3bfe3413cb2ae219b09aea832 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:25.996165  9556 raft_consensus.cc:515] T 30e88460611e47b2ba16a46a30b5f416 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
W20260709 13:19:26.118337  9517 consensus_meta.cc:287] T 34f36d59d88f40fe8a2805e604fc6c0a P ccd8a4c3bfe3413cb2ae219b09aea832: Time spent flushing consensus metadata: real 0.703s	user 0.013s	sys 0.016s
I20260709 13:19:26.114907  9531 raft_consensus.cc:493] T 853ac0a8cbd64ce99457f170216d4d0f P cd75a17ab2604397adab03bb8b5fd75c [term 4 FOLLOWER]: Starting leader election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:19:26.167263  9531 raft_consensus.cc:3060] T 853ac0a8cbd64ce99457f170216d4d0f P cd75a17ab2604397adab03bb8b5fd75c [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:19:26.169057  9578 log.cc:927] Time spent T 22ccee1b570c4ad3a57bd7aec085b1b4 P ccd8a4c3bfe3413cb2ae219b09aea832: Append to log took a long time: real 0.077s	user 0.000s	sys 0.000s
I20260709 13:19:26.169963  6806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20f6842e26174571996b8dea4151d4be" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:19:26.134598  9536 raft_consensus.cc:2804] T 24ee15416e3145beaa1b8183453729a3 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:19:26.172379  9536 raft_consensus.cc:493] T 24ee15416e3145beaa1b8183453729a3 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 7ba59cc884714e8aa5f3f0ecaed84cbb)
I20260709 13:19:26.173009  9536 raft_consensus.cc:3060] T 24ee15416e3145beaa1b8183453729a3 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:19:26.173496  9552 log.cc:927] Time spent T 2c240553ce044eedb41541d72b9475d7 P ccd8a4c3bfe3413cb2ae219b09aea832: Append to log took a long time: real 0.567s	user 0.002s	sys 0.000s
I20260709 13:19:26.158017  7500 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50742 (request call id 327) took 1003 ms. Trace:
I20260709 13:19:26.158262  9582 raft_consensus.cc:493] T b56bf91d90824c959e21e0cee5ba1816 P b7ab4784c7344b939bc36f639286f377 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:26.176628  6878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90d42e216d9741e190bca19a781291fd" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:19:26.177047  9582 raft_consensus.cc:515] T b56bf91d90824c959e21e0cee5ba1816 P b7ab4784c7344b939bc36f639286f377 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:26.177697  6879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab432e62819d499eaaf3dd55481dd930" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:19:26.178300  6879 raft_consensus.cc:3060] T ab432e62819d499eaaf3dd55481dd930 P cd75a17ab2604397adab03bb8b5fd75c [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:26.178566  9553 consensus_queue.cc:237] T d33d5ee8ef6f415593d8df52063161ad P b7ab4784c7344b939bc36f639286f377 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:26.130514  9461 raft_consensus.cc:3060] T a1704639a875409b9959353527b3fd68 P cd75a17ab2604397adab03bb8b5fd75c [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:26.179349  9582 leader_election.cc:290] T b56bf91d90824c959e21e0cee5ba1816 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:26.180392  9589 raft_consensus.cc:493] T f4b8bd455d5a47c18a1380839c6e0d61 P b7ab4784c7344b939bc36f639286f377 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:26.180787  6875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7887766dc6784fcaa42b35c05fea7a99" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:19:26.181102  9589 raft_consensus.cc:515] T f4b8bd455d5a47c18a1380839c6e0d61 P b7ab4784c7344b939bc36f639286f377 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:26.079623  9046 consensus_queue.cc:237] T 713b5728a197487c9300b310ab94e5a3 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:26.176352  7500 rpcz_store.cc:276] 0709 13:19:25.154494 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:25.154793 (+   299us) service_pool.cc:224] Handling call
0709 13:19:25.744626 (+589833us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:25.781426 (+ 36800us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:26.157764 (+376338us) spinlock_profiling.cc:243] Waited 567 ms on lock 0x7b54005a0350. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f9a98ad 00007fcc1496e419 00007fcc0dee5bd4 00007fcc0dee5b62 00007fcc0dee5a91 00007fcc0dee5a0c 00007fcc0dee4cc2 00007fcc0dce548c 00007fcc0dce48c6 00007fcc0dce426f
0709 13:19:26.157937 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1303731584}
I20260709 13:19:26.180392  6877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44bde925b2e541b69890d70715b85176" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:19:26.126914  9555 raft_consensus.cc:3055] T 3a485a995abc4807b6e511e45419f737 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:19:26.184229  6878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6869f07b5a4885a0b99fbe60c3b175" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 7 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:19:26.159377  9586 consensus_queue.cc:1048] T d8cee0accdb8499c86d4414b72565a38 P 7ba59cc884714e8aa5f3f0ecaed84cbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.064s
I20260709 13:19:26.190981  6806 raft_consensus.cc:2410] T 20f6842e26174571996b8dea4151d4be P b7ab4784c7344b939bc36f639286f377 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c for term 8 because replica has last-logged OpId of term: 6 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 13:19:26.194898  6878 raft_consensus.cc:2393] T bd6869f07b5a4885a0b99fbe60c3b175 P cd75a17ab2604397adab03bb8b5fd75c [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate b7ab4784c7344b939bc36f639286f377 in current term 7: Already voted for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in this term.
I20260709 13:19:26.142547  9515 raft_consensus.cc:3060] T c4db81d9d329422bb3b4160ca4ac2d1d P ccd8a4c3bfe3413cb2ae219b09aea832 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:26.089969  9548 raft_consensus.cc:515] T de3186201e1a40d0b335eeb8b4e256e0 P b7ab4784c7344b939bc36f639286f377 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:26.215685  6874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "711ef6523deb4cbe8ef2ba61e1c21c98" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:19:26.251482  6874 raft_consensus.cc:3060] T 711ef6523deb4cbe8ef2ba61e1c21c98 P cd75a17ab2604397adab03bb8b5fd75c [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:26.129187  9487 consensus_queue.cc:1059] T e31b9971c15848dea59d4d4130141d9e P b7ab4784c7344b939bc36f639286f377 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.073s
I20260709 13:19:26.193502  9555 raft_consensus.cc:740] T 3a485a995abc4807b6e511e45419f737 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
W20260709 13:19:26.227113  9259 consensus_meta.cc:287] T bb3d8792045a4583ae2e965b1350a5b4 P ccd8a4c3bfe3413cb2ae219b09aea832: Time spent flushing consensus metadata: real 1.045s	user 0.012s	sys 0.012s
W20260709 13:19:26.318379  7466 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 238019us
I20260709 13:19:26.372490  6725 raft_consensus.cc:1275] T bb3d8792045a4583ae2e965b1350a5b4 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 7 FOLLOWER]: Refusing update from remote peer cd75a17ab2604397adab03bb8b5fd75c: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
W20260709 13:19:26.379546  6695 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:26.304955  9502 raft_consensus.cc:493] T 4275cf08e63345f993bce8664eada830 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:26.189913  9517 raft_consensus.cc:515] T 34f36d59d88f40fe8a2805e604fc6c0a P ccd8a4c3bfe3413cb2ae219b09aea832 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
W20260709 13:19:26.418289  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 473813us
I20260709 13:19:26.442783  9541 raft_consensus.cc:697] T 95a75bfe094d4bdc963aba3f08dfcd25 P b7ab4784c7344b939bc36f639286f377 [term 8 LEADER]: Becoming Leader. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
W20260709 13:19:26.472337  6698 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:26.500022  6728 raft_consensus.cc:2393] T 34f36d59d88f40fe8a2805e604fc6c0a P ccd8a4c3bfe3413cb2ae219b09aea832 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c in current term 5: Already voted for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in this term.
I20260709 13:19:26.389827  9502 raft_consensus.cc:515] T 4275cf08e63345f993bce8664eada830 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:26.444267  9484 raft_consensus.cc:493] T 30e88460611e47b2ba16a46a30b5f416 P cd75a17ab2604397adab03bb8b5fd75c [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:26.548594  7469 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.669s	user 0.010s	sys 0.018s
W20260709 13:19:26.561452  7469 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.682s	user 0.010s	sys 0.019s
I20260709 13:19:26.554023  6879 raft_consensus.cc:2468] T ab432e62819d499eaaf3dd55481dd930 P cd75a17ab2604397adab03bb8b5fd75c [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 8.
W20260709 13:19:26.449903  8832 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.609s	user 0.001s	sys 0.008s
W20260709 13:19:26.557169  6872 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.604s	user 0.011s	sys 0.017s
W20260709 13:19:26.567301  6872 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.614s	user 0.011s	sys 0.017s
W20260709 13:19:26.548830  6697 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 486665us
W20260709 13:19:26.572511  9593 log.cc:927] Time spent T 7c37d41cd9164c15a6826ca62a851a69 P ccd8a4c3bfe3413cb2ae219b09aea832: Append to log took a long time: real 0.102s	user 0.000s	sys 0.001s
I20260709 13:19:26.574120  6872 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53416 (request call id 2374) took 1328 ms. Trace:
I20260709 13:19:26.574486  6872 rpcz_store.cc:276] 0709 13:19:25.240058 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:25.240195 (+   137us) service_pool.cc:224] Handling call
0709 13:19:25.289606 (+ 49411us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:25.289813 (+   207us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:19:25.786038 (+496225us) log.cc:844] Serialized 14 byte log entry
0709 13:19:26.567666 (+781628us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:26.567721 (+    55us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:19:26.567777 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:26.567843 (+    66us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:26.567958 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":64776,"prepare.queue_time_us":455461,"prepare.run_cpu_time_us":43,"prepare.run_wall_time_us":43,"raft.queue_time_us":69345,"raft.run_cpu_time_us":158,"raft.run_wall_time_us":20081,"thread_start_us":1179844,"threads_started":3,"wal-append.queue_time_us":555686}
W20260709 13:19:26.567224  8832 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.761s	user 0.001s	sys 0.009s
W20260709 13:19:26.570791  9539 log.cc:927] Time spent T bb3d8792045a4583ae2e965b1350a5b4 P 7ba59cc884714e8aa5f3f0ecaed84cbb: Append to log took a long time: real 0.066s	user 0.000s	sys 0.001s
I20260709 13:19:26.591421  9536 raft_consensus.cc:515] T 24ee15416e3145beaa1b8183453729a3 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
W20260709 13:19:26.588668  9571 log.cc:927] Time spent T 90d42e216d9741e190bca19a781291fd P cd75a17ab2604397adab03bb8b5fd75c: Append to log took a long time: real 0.204s	user 0.001s	sys 0.000s
W20260709 13:19:26.589519  9587 log.cc:927] Time spent T 7c44c4849aa54f2b94d1f1bef9ed546f P ccd8a4c3bfe3413cb2ae219b09aea832: Append to log took a long time: real 0.192s	user 0.001s	sys 0.000s
I20260709 13:19:26.568887  9568 raft_consensus.cc:493] T de3186201e1a40d0b335eeb8b4e256e0 P cd75a17ab2604397adab03bb8b5fd75c [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:26.591715  6874 raft_consensus.cc:2468] T 711ef6523deb4cbe8ef2ba61e1c21c98 P cd75a17ab2604397adab03bb8b5fd75c [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 8.
I20260709 13:19:26.593209  6803 raft_consensus.cc:1240] T 3411566abe2d4c9bb4b2adfdd05e6f17 P b7ab4784c7344b939bc36f639286f377 [term 6 LEADER]: Rejecting Update request from peer ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 5. Current term is 6. Ops: []
I20260709 13:19:26.565783  9484 raft_consensus.cc:515] T 30e88460611e47b2ba16a46a30b5f416 P cd75a17ab2604397adab03bb8b5fd75c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:26.585322  6697 leader_election.cc:304] T bd6869f07b5a4885a0b99fbe60c3b175 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
W20260709 13:19:26.587815  9580 log.cc:927] Time spent T 44bde925b2e541b69890d70715b85176 P cd75a17ab2604397adab03bb8b5fd75c: Append to log took a long time: real 0.245s	user 0.000s	sys 0.000s
I20260709 13:19:26.577805  9449 raft_consensus.cc:493] T 4b8cacb381b746da8d0049b0a83b41dd P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 7 FOLLOWER]: Starting pre-election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:19:26.503618  9592 consensus_queue.cc:1059] T 17587d6730594da4a56fa13a353232a1 P 7ba59cc884714e8aa5f3f0ecaed84cbb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: INVALID_TERM, Last received: 8.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.200s
I20260709 13:19:26.546100  9555 consensus_queue.cc:260] T 3a485a995abc4807b6e511e45419f737 P ccd8a4c3bfe3413cb2ae219b09aea832 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:26.723706  6801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3022224cc81473690653a83d4e99470" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
W20260709 13:19:26.595744  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 93569.4us
W20260709 13:19:26.666548  6846 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.68:45071, user_credentials={real_user=slave}} blocked reactor thread for 166938us
I20260709 13:19:26.597843  9487 raft_consensus.cc:493] T 2c240553ce044eedb41541d72b9475d7 P b7ab4784c7344b939bc36f639286f377 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:26.642325  6881 raft_consensus.cc:2955] T 24ee15416e3145beaa1b8183453729a3 P cd75a17ab2604397adab03bb8b5fd75c [term 6 FOLLOWER]: Committing config change with OpId 6.7: config changed from index 3 to 7, VOTER b7ab4784c7344b939bc36f639286f377 (127.5.126.66) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } } }
I20260709 13:19:26.760749  6844 leader_election.cc:304] T 7a734b5ab7834e05a8c422208acc58b1 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: ccd8a4c3bfe3413cb2ae219b09aea832
W20260709 13:19:26.704490  9539 log.cc:927] Time spent T bb3d8792045a4583ae2e965b1350a5b4 P 7ba59cc884714e8aa5f3f0ecaed84cbb: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
W20260709 13:19:26.693348  9598 log.cc:927] Time spent T 24ee15416e3145beaa1b8183453729a3 P cd75a17ab2604397adab03bb8b5fd75c: Append to log took a long time: real 0.058s	user 0.000s	sys 0.001s
I20260709 13:19:26.770144  6844 leader_election.cc:304] T d8cee0accdb8499c86d4414b72565a38 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, b7ab4784c7344b939bc36f639286f377
I20260709 13:19:26.596556  9465 leader_election.cc:290] T 20f6842e26174571996b8dea4151d4be P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
W20260709 13:19:26.773936  6697 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 188739us
W20260709 13:19:26.774605  6807 consensus_meta.cc:287] T be1a92657f494cac8dd227d152f50151 P b7ab4784c7344b939bc36f639286f377: Time spent flushing consensus metadata: real 0.690s	user 0.012s	sys 0.000s
I20260709 13:19:26.763069  9449 raft_consensus.cc:515] T 4b8cacb381b746da8d0049b0a83b41dd P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:19:26.778558  9502 leader_election.cc:290] T 4275cf08e63345f993bce8664eada830 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:26.779815  9536 leader_election.cc:290] T 24ee15416e3145beaa1b8183453729a3 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 7 election: Requested vote from peers cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
W20260709 13:19:26.781937  9512 consensus_meta.cc:287] T 7ba5dac66ab5497e9e336f2a3c28cda5 P 7ba59cc884714e8aa5f3f0ecaed84cbb: Time spent flushing consensus metadata: real 0.680s	user 0.001s	sys 0.008s
I20260709 13:19:26.684859  9486 consensus_queue.cc:1048] T 4275cf08e63345f993bce8664eada830 P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Connected to new peer: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.098s
I20260709 13:19:26.608469  9548 leader_election.cc:290] T de3186201e1a40d0b335eeb8b4e256e0 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:26.784343  9506 raft_consensus.cc:2804] T bd6869f07b5a4885a0b99fbe60c3b175 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:19:26.784410  6880 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53416 (request call id 2379) took 1429 ms. Trace:
W20260709 13:19:26.785732  9490 consensus_meta.cc:287] T 404190ce4ce94cecbfcb6ea9d1dd8626 P b7ab4784c7344b939bc36f639286f377: Time spent flushing consensus metadata: real 1.014s	user 0.010s	sys 0.003s
I20260709 13:19:26.786909  6804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6869f07b5a4885a0b99fbe60c3b175" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 7 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
W20260709 13:19:26.787856  9384 consensus_meta.cc:287] T 1bf4668eeb70467fb3dc5a0289233b3c P ccd8a4c3bfe3413cb2ae219b09aea832: Time spent flushing consensus metadata: real 0.655s	user 0.013s	sys 0.005s
I20260709 13:19:26.788118  6844 leader_election.cc:304] T f09c2a98de1a4decabd0ff900dd44caa P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:19:26.788693  6802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b56bf91d90824c959e21e0cee5ba1816" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:19:26.849493  6802 raft_consensus.cc:3060] T b56bf91d90824c959e21e0cee5ba1816 P b7ab4784c7344b939bc36f639286f377 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:19:26.789144  9585 log.cc:927] Time spent T f09c2a98de1a4decabd0ff900dd44caa P cd75a17ab2604397adab03bb8b5fd75c: Append to log took a long time: real 0.295s	user 0.000s	sys 0.001s
W20260709 13:19:26.791579  9600 log.cc:927] Time spent T 853ac0a8cbd64ce99457f170216d4d0f P ccd8a4c3bfe3413cb2ae219b09aea832: Append to log took a long time: real 0.120s	user 0.000s	sys 0.001s
I20260709 13:19:26.684768  9517 leader_election.cc:290] T 34f36d59d88f40fe8a2805e604fc6c0a P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 5 election: Requested vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:26.797170  6807 raft_consensus.cc:2468] T be1a92657f494cac8dd227d152f50151 P b7ab4784c7344b939bc36f639286f377 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 8.
I20260709 13:19:26.855490  7500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24ee15416e3145beaa1b8183453729a3" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb"
W20260709 13:19:26.799119  6805 consensus_meta.cc:287] T 9e326172347f45e99a0d482b5d8ef768 P b7ab4784c7344b939bc36f639286f377: Time spent flushing consensus metadata: real 0.739s	user 0.020s	sys 0.000s
I20260709 13:19:26.592603  9541 consensus_queue.cc:237] T 95a75bfe094d4bdc963aba3f08dfcd25 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 7.2, Last appended by leader: 2, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:26.805435  6874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b56bf91d90824c959e21e0cee5ba1816" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:19:26.808143  6878 raft_consensus.cc:1275] T 2c240553ce044eedb41541d72b9475d7 P cd75a17ab2604397adab03bb8b5fd75c [term 8 FOLLOWER]: Refusing update from remote peer ccd8a4c3bfe3413cb2ae219b09aea832: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:19:26.858839  6874 raft_consensus.cc:3060] T b56bf91d90824c959e21e0cee5ba1816 P cd75a17ab2604397adab03bb8b5fd75c [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:26.824512  6801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bf4668eeb70467fb3dc5a0289233b3c" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:19:26.760845  9556 leader_election.cc:290] T 30e88460611e47b2ba16a46a30b5f416 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
W20260709 13:19:26.799566  9553 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.617s	user 0.006s	sys 0.023s
W20260709 13:19:26.830684  6799 consensus_meta.cc:287] T 3a485a995abc4807b6e511e45419f737 P b7ab4784c7344b939bc36f639286f377: Time spent flushing consensus metadata: real 0.697s	user 0.011s	sys 0.006s
I20260709 13:19:26.817286  9592 raft_consensus.cc:493] T ce4f062dcd314d43a63ca74067cb5ee3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 6 FOLLOWER]: Starting pre-election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
W20260709 13:19:26.842378  9561 consensus_meta.cc:287] T 8c7f33e544204fbaac4078e3e83bbf4e P b7ab4784c7344b939bc36f639286f377: Time spent flushing consensus metadata: real 0.811s	user 0.010s	sys 0.001s
I20260709 13:19:26.843173  9569 raft_consensus.cc:3055] T e77e330a82df4b43a745d57a68f6f057 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:19:26.844229  6881 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58592 (request call id 193) took 1053 ms. Trace:
I20260709 13:19:26.832922  9512 raft_consensus.cc:515] T 7ba5dac66ab5497e9e336f2a3c28cda5 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
W20260709 13:19:26.845296  9450 consensus_meta.cc:287] T 7c37d41cd9164c15a6826ca62a851a69 P b7ab4784c7344b939bc36f639286f377: Time spent flushing consensus metadata: real 0.782s	user 0.008s	sys 0.012s
I20260709 13:19:26.801476  9555 raft_consensus.cc:3060] T 3a485a995abc4807b6e511e45419f737 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:26.846743  6804 raft_consensus.cc:2393] T bd6869f07b5a4885a0b99fbe60c3b175 P b7ab4784c7344b939bc36f639286f377 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate ccd8a4c3bfe3413cb2ae219b09aea832 in current term 7: Already voted for candidate b7ab4784c7344b939bc36f639286f377 in this term.
W20260709 13:19:26.847082  6697 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:26.851614  6873 raft_consensus.cc:1240] T 9e326172347f45e99a0d482b5d8ef768 P cd75a17ab2604397adab03bb8b5fd75c [term 6 FOLLOWER]: Rejecting Update request from peer ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 5. Current term is 6. Ops: []
I20260709 13:19:26.859349  9506 raft_consensus.cc:697] T bd6869f07b5a4885a0b99fbe60c3b175 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 7 LEADER]: Becoming Leader. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
I20260709 13:19:26.833338  6880 rpcz_store.cc:276] 0709 13:19:25.355132 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:25.355442 (+   310us) service_pool.cc:224] Handling call
0709 13:19:25.355816 (+   374us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:25.394212 (+ 38396us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:25.394255 (+    43us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:25.416024 (+ 21769us) log.cc:844] Serialized 26 byte log entry
0709 13:19:25.787507 (+371483us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:19:25.787549 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:25.788327 (+   778us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:26.784144 (+995817us) raft_consensus.cc:1685] finished
0709 13:19:26.784168 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:26.784332 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":11521,"raft.queue_time_us":32461,"raft.run_cpu_time_us":124,"raft.run_wall_time_us":7071,"thread_start_us":301643,"threads_started":1,"wal-append.queue_time_us":720610}
W20260709 13:19:26.833834  9366 consensus_meta.cc:287] T 404190ce4ce94cecbfcb6ea9d1dd8626 P 7ba59cc884714e8aa5f3f0ecaed84cbb: Time spent flushing consensus metadata: real 1.235s	user 0.014s	sys 0.008s
I20260709 13:19:26.856432  6805 raft_consensus.cc:2468] T 9e326172347f45e99a0d482b5d8ef768 P b7ab4784c7344b939bc36f639286f377 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 6.
W20260709 13:19:26.816644  9601 log.cc:927] Time spent T bb3d8792045a4583ae2e965b1350a5b4 P cd75a17ab2604397adab03bb8b5fd75c: Append to log took a long time: real 0.080s	user 0.001s	sys 0.000s
W20260709 13:19:26.859812  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 84808.9us
I20260709 13:19:26.793498  9487 raft_consensus.cc:515] T 2c240553ce044eedb41541d72b9475d7 P b7ab4784c7344b939bc36f639286f377 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:26.852332  9384 raft_consensus.cc:515] T 1bf4668eeb70467fb3dc5a0289233b3c P ccd8a4c3bfe3413cb2ae219b09aea832 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:26.849289  9489 raft_consensus.cc:493] T f4b8bd455d5a47c18a1380839c6e0d61 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:26.917116  9610 log.cc:927] Time spent T 7ba5dac66ab5497e9e336f2a3c28cda5 P cd75a17ab2604397adab03bb8b5fd75c: Append to log took a long time: real 0.065s	user 0.000s	sys 0.001s
I20260709 13:19:26.866452  6807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4db81d9d329422bb3b4160ca4ac2d1d" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:19:26.919163  6807 raft_consensus.cc:2468] T c4db81d9d329422bb3b4160ca4ac2d1d P b7ab4784c7344b939bc36f639286f377 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 7.
I20260709 13:19:26.853901  9490 raft_consensus.cc:2749] T 404190ce4ce94cecbfcb6ea9d1dd8626 P b7ab4784c7344b939bc36f639286f377 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:19:26.883205  6695 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:26.862807  9449 leader_election.cc:290] T 4b8cacb381b746da8d0049b0a83b41dd P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
W20260709 13:19:26.865208  9553 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.683s	user 0.006s	sys 0.024s
W20260709 13:19:26.894047  6697 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:26.652019  9568 raft_consensus.cc:515] T de3186201e1a40d0b335eeb8b4e256e0 P cd75a17ab2604397adab03bb8b5fd75c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:26.851342  6877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e31b9971c15848dea59d4d4130141d9e" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:19:26.935760  6877 raft_consensus.cc:3060] T e31b9971c15848dea59d4d4130141d9e P cd75a17ab2604397adab03bb8b5fd75c [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:19:26.908517  6880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30e88460611e47b2ba16a46a30b5f416" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:19:26.909631  6875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34f36d59d88f40fe8a2805e604fc6c0a" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:19:26.907783  6805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b56bf91d90824c959e21e0cee5ba1816" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:19:26.860108  6801 raft_consensus.cc:2468] T 1bf4668eeb70467fb3dc5a0289233b3c P b7ab4784c7344b939bc36f639286f377 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 6.
I20260709 13:19:26.916792  9489 raft_consensus.cc:515] T f4b8bd455d5a47c18a1380839c6e0d61 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
W20260709 13:19:26.856439  9031 consensus_meta.cc:287] T 22ccee1b570c4ad3a57bd7aec085b1b4 P b7ab4784c7344b939bc36f639286f377: Time spent flushing consensus metadata: real 1.693s	user 0.014s	sys 0.010s
I20260709 13:19:26.881940  9569 raft_consensus.cc:740] T e77e330a82df4b43a745d57a68f6f057 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
I20260709 13:19:26.920164  6807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34f36d59d88f40fe8a2805e604fc6c0a" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:19:26.921504  9605 raft_consensus.cc:2804] T 7a734b5ab7834e05a8c422208acc58b1 P cd75a17ab2604397adab03bb8b5fd75c [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:19:26.922937  6804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17587d6730594da4a56fa13a353232a1" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:19:26.896919  9450 raft_consensus.cc:515] T 7c37d41cd9164c15a6826ca62a851a69 P b7ab4784c7344b939bc36f639286f377 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:26.923988  6844 leader_election.cc:304] T 711ef6523deb4cbe8ef2ba61e1c21c98 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:19:26.921782  9534 raft_consensus.cc:493] T 07a92dd554674067a83a9cb68c4773f2 P b7ab4784c7344b939bc36f639286f377 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:26.957965  9031 raft_consensus.cc:515] T 22ccee1b570c4ad3a57bd7aec085b1b4 P b7ab4784c7344b939bc36f639286f377 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:26.966771  9534 raft_consensus.cc:515] T 07a92dd554674067a83a9cb68c4773f2 P b7ab4784c7344b939bc36f639286f377 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:26.967723  9384 leader_election.cc:290] T 1bf4668eeb70467fb3dc5a0289233b3c P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 7 election: Requested vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:26.960421  9605 raft_consensus.cc:493] T 7a734b5ab7834e05a8c422208acc58b1 P cd75a17ab2604397adab03bb8b5fd75c [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:26.969331  9605 raft_consensus.cc:3060] T 7a734b5ab7834e05a8c422208acc58b1 P cd75a17ab2604397adab03bb8b5fd75c [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:26.969893  9534 leader_election.cc:290] T 07a92dd554674067a83a9cb68c4773f2 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:26.924986  9351 raft_consensus.cc:493] T f58dc08b12a2494bb9a1372837970ca2 P cd75a17ab2604397adab03bb8b5fd75c [term 8 FOLLOWER]: Starting leader election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:19:26.971247  9351 raft_consensus.cc:3060] T f58dc08b12a2494bb9a1372837970ca2 P cd75a17ab2604397adab03bb8b5fd75c [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:26.971536  9506 consensus_queue.cc:237] T bd6869f07b5a4885a0b99fbe60c3b175 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.2, Last appended by leader: 2, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
W20260709 13:19:26.974434  9461 consensus_meta.cc:287] T a1704639a875409b9959353527b3fd68 P cd75a17ab2604397adab03bb8b5fd75c: Time spent flushing consensus metadata: real 0.795s	user 0.008s	sys 0.003s
I20260709 13:19:26.974948  9461 raft_consensus.cc:515] T a1704639a875409b9959353527b3fd68 P cd75a17ab2604397adab03bb8b5fd75c [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
W20260709 13:19:26.925823  9607 log.cc:927] Time spent T 3411566abe2d4c9bb4b2adfdd05e6f17 P b7ab4784c7344b939bc36f639286f377: Append to log took a long time: real 0.083s	user 0.000s	sys 0.001s
I20260709 13:19:26.926192  9613 raft_consensus.cc:2804] T f09c2a98de1a4decabd0ff900dd44caa P cd75a17ab2604397adab03bb8b5fd75c [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:19:26.977150  9613 raft_consensus.cc:493] T f09c2a98de1a4decabd0ff900dd44caa P cd75a17ab2604397adab03bb8b5fd75c [term 7 FOLLOWER]: Starting leader election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:19:26.977561  9613 raft_consensus.cc:3060] T f09c2a98de1a4decabd0ff900dd44caa P cd75a17ab2604397adab03bb8b5fd75c [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:26.981304  6876 raft_consensus.cc:1240] T a1704639a875409b9959353527b3fd68 P cd75a17ab2604397adab03bb8b5fd75c [term 7 FOLLOWER]: Rejecting Update request from peer b7ab4784c7344b939bc36f639286f377 for earlier term 6. Current term is 7. Ops: [6.5-6.5]
I20260709 13:19:26.927227  6772 leader_election.cc:304] T 1528ab62b6fe4e3099d08f141afee116 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, b7ab4784c7344b939bc36f639286f377; no voters: ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:19:26.929239  6874 raft_consensus.cc:2468] T b56bf91d90824c959e21e0cee5ba1816 P cd75a17ab2604397adab03bb8b5fd75c [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 8.
W20260709 13:19:26.982565  6772 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.68:45071, user_credentials={real_user=slave}} blocked reactor thread for 55470.9us
I20260709 13:19:26.982877  6874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24ee15416e3145beaa1b8183453729a3" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:19:26.670704  9616 consensus_queue.cc:1059] T 07a92dd554674067a83a9cb68c4773f2 P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: INVALID_TERM, Last received: 6.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.206s
I20260709 13:19:26.983908  9512 leader_election.cc:290] T 7ba5dac66ab5497e9e336f2a3c28cda5 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 9 election: Requested vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:26.938480  9609 raft_consensus.cc:493] T bb3d8792045a4583ae2e965b1350a5b4 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:26.985054  9553 raft_consensus.cc:2804] T 1528ab62b6fe4e3099d08f141afee116 P b7ab4784c7344b939bc36f639286f377 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:19:26.984905  9609 raft_consensus.cc:515] T bb3d8792045a4583ae2e965b1350a5b4 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:19:26.985654  9553 raft_consensus.cc:697] T 1528ab62b6fe4e3099d08f141afee116 P b7ab4784c7344b939bc36f639286f377 [term 6 LEADER]: Becoming Leader. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
I20260709 13:19:26.986689  9553 consensus_queue.cc:237] T 1528ab62b6fe4e3099d08f141afee116 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:19:26.987293  9609 leader_election.cc:290] T bb3d8792045a4583ae2e965b1350a5b4 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:19:26.945040  9486 raft_consensus.cc:493] T 9b3759de40694069b13c0f8bd40e5709 P cd75a17ab2604397adab03bb8b5fd75c [term 6 FOLLOWER]: Starting pre-election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:19:26.936444  6880 raft_consensus.cc:2468] T 30e88460611e47b2ba16a46a30b5f416 P cd75a17ab2604397adab03bb8b5fd75c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 6.
I20260709 13:19:26.988183  9486 raft_consensus.cc:515] T 9b3759de40694069b13c0f8bd40e5709 P cd75a17ab2604397adab03bb8b5fd75c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:26.989127  6880 raft_consensus.cc:1275] T de3186201e1a40d0b335eeb8b4e256e0 P cd75a17ab2604397adab03bb8b5fd75c [term 7 FOLLOWER]: Refusing update from remote peer ccd8a4c3bfe3413cb2ae219b09aea832: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:19:26.989903  7500 raft_consensus.cc:1240] T 7ba5dac66ab5497e9e336f2a3c28cda5 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 9 FOLLOWER]: Rejecting Update request from peer b7ab4784c7344b939bc36f639286f377 for earlier term 8. Current term is 9. Ops: []
I20260709 13:19:26.990521  6880 raft_consensus.cc:1240] T ab432e62819d499eaaf3dd55481dd930 P cd75a17ab2604397adab03bb8b5fd75c [term 8 FOLLOWER]: Rejecting Update request from peer ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 7. Current term is 8. Ops: []
I20260709 13:19:26.990867  6874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4275cf08e63345f993bce8664eada830" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:19:26.949012  9502 raft_consensus.cc:493] T 07a92dd554674067a83a9cb68c4773f2 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:26.882283  9592 raft_consensus.cc:515] T ce4f062dcd314d43a63ca74067cb5ee3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } attrs { replace: true } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:19:26.954412  6875 raft_consensus.cc:2393] T 34f36d59d88f40fe8a2805e604fc6c0a P cd75a17ab2604397adab03bb8b5fd75c [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate ccd8a4c3bfe3413cb2ae219b09aea832 in current term 5: Already voted for candidate cd75a17ab2604397adab03bb8b5fd75c in this term.
I20260709 13:19:26.901077  9622 raft_consensus.cc:493] T 4b8cacb381b746da8d0049b0a83b41dd P cd75a17ab2604397adab03bb8b5fd75c [term 7 FOLLOWER]: Starting pre-election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:19:27.021075  9622 raft_consensus.cc:515] T 4b8cacb381b746da8d0049b0a83b41dd P cd75a17ab2604397adab03bb8b5fd75c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:19:27.022578  9592 leader_election.cc:290] T ce4f062dcd314d43a63ca74067cb5ee3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:27.023402  9622 leader_election.cc:290] T 4b8cacb381b746da8d0049b0a83b41dd P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:19:27.023919  9489 leader_election.cc:290] T f4b8bd455d5a47c18a1380839c6e0d61 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
W20260709 13:19:26.922684  9545 consensus_meta.cc:287] T ce4f062dcd314d43a63ca74067cb5ee3 P b7ab4784c7344b939bc36f639286f377: Time spent flushing consensus metadata: real 1.117s	user 0.011s	sys 0.016s
I20260709 13:19:27.024835  9545 raft_consensus.cc:515] T ce4f062dcd314d43a63ca74067cb5ee3 P b7ab4784c7344b939bc36f639286f377 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } attrs { replace: true } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
W20260709 13:19:27.025727  9531 consensus_meta.cc:287] T 853ac0a8cbd64ce99457f170216d4d0f P cd75a17ab2604397adab03bb8b5fd75c: Time spent flushing consensus metadata: real 0.858s	user 0.008s	sys 0.004s
I20260709 13:19:27.026132  9531 raft_consensus.cc:515] T 853ac0a8cbd64ce99457f170216d4d0f P cd75a17ab2604397adab03bb8b5fd75c [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:27.027753  9545 leader_election.cc:290] T ce4f062dcd314d43a63ca74067cb5ee3 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 7 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:19:26.956676  6805 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:32966 (request call id 791) took 1013 ms. Trace:
I20260709 13:19:27.028486  6805 rpcz_store.cc:276] 0709 13:19:25.943757 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:26.907395 (+963638us) service_pool.cc:224] Handling call
0709 13:19:26.956602 (+ 49207us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:27.029649  6805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bf4668eeb70467fb3dc5a0289233b3c" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:19:27.030164  6805 raft_consensus.cc:3060] T 1bf4668eeb70467fb3dc5a0289233b3c P b7ab4784c7344b939bc36f639286f377 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:19:27.030632  9526 consensus_meta.cc:287] T 95a75bfe094d4bdc963aba3f08dfcd25 P ccd8a4c3bfe3413cb2ae219b09aea832: Time spent flushing consensus metadata: real 1.069s	user 0.001s	sys 0.018s
I20260709 13:19:26.895035  9614 consensus_queue.cc:1048] T f4b8bd455d5a47c18a1380839c6e0d61 P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Connected to new peer: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.077s
I20260709 13:19:27.033241  9614 raft_consensus.cc:2749] T 711ef6523deb4cbe8ef2ba61e1c21c98 P cd75a17ab2604397adab03bb8b5fd75c [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:19:26.883198  9561 raft_consensus.cc:515] T 8c7f33e544204fbaac4078e3e83bbf4e P b7ab4784c7344b939bc36f639286f377 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:27.034933  6798 raft_consensus.cc:2393] T 8c7f33e544204fbaac4078e3e83bbf4e P b7ab4784c7344b939bc36f639286f377 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ccd8a4c3bfe3413cb2ae219b09aea832 in current term 5: Already voted for candidate b7ab4784c7344b939bc36f639286f377 in this term.
I20260709 13:19:26.881893  6881 rpcz_store.cc:276] 0709 13:19:25.790746 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:25.805005 (+ 14259us) service_pool.cc:224] Handling call
0709 13:19:25.892973 (+ 87968us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:19:25.936498 (+ 43525us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:25.936534 (+    36us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:19:26.059101 (+122567us) log.cc:844] Serialized 520 byte log entry
0709 13:19:26.419896 (+360795us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:19:26.504367 (+ 84471us) log.cc:844] Serialized 14 byte log entry
0709 13:19:26.782888 (+278521us) log.cc:844] Serialized 14 byte log entry
0709 13:19:26.817565 (+ 34677us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:26.817638 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:26.843978 (+ 26340us) raft_consensus.cc:1685] finished
0709 13:19:26.843998 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:26.844168 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":79886,"prepare.queue_time_us":82355,"prepare.run_wall_time_us":4380,"raft.queue_time_us":411857,"raft.run_cpu_time_us":607,"raft.run_wall_time_us":60318,"spinlock_wait_cycles":8477440,"thread_start_us":382944,"threads_started":3,"wal-append.queue_time_us":458605}
I20260709 13:19:27.035882  9561 leader_election.cc:290] T 8c7f33e544204fbaac4078e3e83bbf4e P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 5 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:26.958526  6807 raft_consensus.cc:3060] T 34f36d59d88f40fe8a2805e604fc6c0a P b7ab4784c7344b939bc36f639286f377 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:19:27.037426  9484 leader_election.cc:290] T 30e88460611e47b2ba16a46a30b5f416 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:19:26.866775  6799 raft_consensus.cc:2468] T 3a485a995abc4807b6e511e45419f737 P b7ab4784c7344b939bc36f639286f377 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 6.
I20260709 13:19:26.960661  6804 raft_consensus.cc:3060] T 17587d6730594da4a56fa13a353232a1 P b7ab4784c7344b939bc36f639286f377 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:26.923610  6873 raft_consensus.cc:1240] T 3411566abe2d4c9bb4b2adfdd05e6f17 P cd75a17ab2604397adab03bb8b5fd75c [term 6 FOLLOWER]: Rejecting Update request from peer ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 5. Current term is 6. Ops: []
I20260709 13:19:26.925449  9608 raft_consensus.cc:2749] T d8cee0accdb8499c86d4414b72565a38 P cd75a17ab2604397adab03bb8b5fd75c [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:19:26.981796  9031 leader_election.cc:290] T 22ccee1b570c4ad3a57bd7aec085b1b4 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 6 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:26.906352  9366 raft_consensus.cc:515] T 404190ce4ce94cecbfcb6ea9d1dd8626 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:19:26.996780  6801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1528ab62b6fe4e3099d08f141afee116" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:19:26.999382  6772 leader_election.cc:304] T 90d42e216d9741e190bca19a781291fd P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
W20260709 13:19:27.053679  6772 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 54441.6us
I20260709 13:19:27.054612  6772 leader_election.cc:304] T 7887766dc6784fcaa42b35c05fea7a99 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:19:27.056677  6801 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:32966 (request call id 795) took 1111 ms. Trace:
I20260709 13:19:27.057780  6772 leader_election.cc:304] T 44bde925b2e541b69890d70715b85176 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:19:27.005985  6874 raft_consensus.cc:1240] T e77e330a82df4b43a745d57a68f6f057 P cd75a17ab2604397adab03bb8b5fd75c [term 9 FOLLOWER]: Rejecting Update request from peer ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 8. Current term is 9. Ops: [8.4-8.4]
I20260709 13:19:27.006433  9450 leader_election.cc:290] T 7c37d41cd9164c15a6826ca62a851a69 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 6 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:26.996312  9487 leader_election.cc:290] T 2c240553ce044eedb41541d72b9475d7 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:27.057056  6801 rpcz_store.cc:276] 0709 13:19:25.945110 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:26.957443 (+1012333us) service_pool.cc:224] Handling call
0709 13:19:27.056607 (+ 99164us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:27.016495  6695 leader_election.cc:304] T 7c44c4849aa54f2b94d1f1bef9ed546f P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:19:27.039355  6799 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:32966 (request call id 799) took 1093 ms. Trace:
I20260709 13:19:27.065378  6799 rpcz_store.cc:276] 0709 13:19:25.946359 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:26.104207 (+157848us) service_pool.cc:224] Handling call
0709 13:19:27.039283 (+935076us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:19:27.066766  6695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 50356.2us
I20260709 13:19:27.067268  6799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34f36d59d88f40fe8a2805e604fc6c0a" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:19:27.067788  6695 leader_election.cc:304] T f5be3a11b23d4ea9b08300a2789821c7 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:19:27.068969  6799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e31b9971c15848dea59d4d4130141d9e" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:19:27.070317  6799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30e88460611e47b2ba16a46a30b5f416" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:19:27.074275  6805 raft_consensus.cc:2468] T 1bf4668eeb70467fb3dc5a0289233b3c P b7ab4784c7344b939bc36f639286f377 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 7.
I20260709 13:19:27.079564  6805 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50550 (request call id 259) took 1181 ms. Trace:
W20260709 13:19:27.044257  7468 leader_election.cc:336] T 3fa34c08b205435dba97346991aa1f92 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931): Timed out: RequestConsensusVote RPC to 127.5.126.67:42931 timed out after 2.026s (SENT)
I20260709 13:19:27.080680  9489 raft_consensus.cc:493] T 713b5728a197487c9300b310ab94e5a3 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:27.083942  9489 raft_consensus.cc:515] T 713b5728a197487c9300b310ab94e5a3 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:27.086018  9489 leader_election.cc:290] T 713b5728a197487c9300b310ab94e5a3 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:27.086531  9489 raft_consensus.cc:2749] T f5be3a11b23d4ea9b08300a2789821c7 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:19:27.087096  9384 raft_consensus.cc:2804] T 7c44c4849aa54f2b94d1f1bef9ed546f P ccd8a4c3bfe3413cb2ae219b09aea832 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:19:27.087612  9384 raft_consensus.cc:493] T 7c44c4849aa54f2b94d1f1bef9ed546f P ccd8a4c3bfe3413cb2ae219b09aea832 [term 8 FOLLOWER]: Starting leader election (detected failure of leader cd75a17ab2604397adab03bb8b5fd75c)
I20260709 13:19:27.087976  9384 raft_consensus.cc:3060] T 7c44c4849aa54f2b94d1f1bef9ed546f P ccd8a4c3bfe3413cb2ae219b09aea832 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:27.089329  9461 leader_election.cc:290] T a1704639a875409b9959353527b3fd68 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 7 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:19:27.052119  9531 leader_election.cc:290] T 853ac0a8cbd64ce99457f170216d4d0f P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 5 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:19:27.092068  9608 raft_consensus.cc:493] T 7887766dc6784fcaa42b35c05fea7a99 P cd75a17ab2604397adab03bb8b5fd75c [term 6 FOLLOWER]: Starting pre-election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:19:27.092674  9608 raft_consensus.cc:515] T 7887766dc6784fcaa42b35c05fea7a99 P cd75a17ab2604397adab03bb8b5fd75c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:27.061764  9609 raft_consensus.cc:493] T fe20b4b48823486ca3b9c648db6ce8aa P ccd8a4c3bfe3413cb2ae219b09aea832 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 7ba59cc884714e8aa5f3f0ecaed84cbb)
I20260709 13:19:27.094030  9366 leader_election.cc:290] T 404190ce4ce94cecbfcb6ea9d1dd8626 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 9 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:19:27.093953  9609 raft_consensus.cc:515] T fe20b4b48823486ca3b9c648db6ce8aa P ccd8a4c3bfe3413cb2ae219b09aea832 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:19:27.094834  7502 raft_consensus.cc:1240] T 404190ce4ce94cecbfcb6ea9d1dd8626 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 9 FOLLOWER]: Rejecting Update request from peer ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 7. Current term is 9. Ops: []
W20260709 13:19:27.095901  9515 consensus_meta.cc:287] T c4db81d9d329422bb3b4160ca4ac2d1d P ccd8a4c3bfe3413cb2ae219b09aea832: Time spent flushing consensus metadata: real 0.818s	user 0.010s	sys 0.001s
I20260709 13:19:27.061976  9526 raft_consensus.cc:493] T f3f9c2e2bf644115957398fe4c9459db P ccd8a4c3bfe3413cb2ae219b09aea832 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:19:27.096539  9515 raft_consensus.cc:515] T c4db81d9d329422bb3b4160ca4ac2d1d P ccd8a4c3bfe3413cb2ae219b09aea832 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:27.096683  9526 raft_consensus.cc:515] T f3f9c2e2bf644115957398fe4c9459db P ccd8a4c3bfe3413cb2ae219b09aea832 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:27.046868  6880 raft_consensus.cc:1240] T 711ef6523deb4cbe8ef2ba61e1c21c98 P cd75a17ab2604397adab03bb8b5fd75c [term 8 FOLLOWER]: Rejecting Update request from peer ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 7. Current term is 8. Ops: []
I20260709 13:19:27.098791  9526 leader_election.cc:290] T f3f9c2e2bf644115957398fe4c9459db P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:27.099000  6880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20f6842e26174571996b8dea4151d4be" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:19:27.099759  6880 raft_consensus.cc:2468] T 20f6842e26174571996b8dea4151d4be P cd75a17ab2604397adab03bb8b5fd75c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 7.
W20260709 13:19:27.101624  7468 leader_election.cc:336] T 3fa34c08b205435dba97346991aa1f92 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931): Timed out: RequestConsensusVote RPC to 127.5.126.67:42931 timed out after 2.174s (SENT)
I20260709 13:19:27.102144  6877 raft_consensus.cc:2468] T e31b9971c15848dea59d4d4130141d9e P cd75a17ab2604397adab03bb8b5fd75c [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 5.
I20260709 13:19:27.103287  6873 raft_consensus.cc:1240] T e31b9971c15848dea59d4d4130141d9e P cd75a17ab2604397adab03bb8b5fd75c [term 5 FOLLOWER]: Rejecting Update request from peer b7ab4784c7344b939bc36f639286f377 for earlier term 4. Current term is 5. Ops: []
I20260709 13:19:27.104602  6877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22ccee1b570c4ad3a57bd7aec085b1b4" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:19:27.105477  6877 raft_consensus.cc:3060] T 22ccee1b570c4ad3a57bd7aec085b1b4 P cd75a17ab2604397adab03bb8b5fd75c [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:19:27.079958  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 156041us
I20260709 13:19:27.039400  9512 raft_consensus.cc:493] T 1528ab62b6fe4e3099d08f141afee116 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:27.081815  6695 leader_election.cc:304] T dbdf895bba214ff68685a24fd17dfb5d P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:19:27.082181  6801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4275cf08e63345f993bce8664eada830" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:19:27.109349  6799 raft_consensus.cc:1240] T ab432e62819d499eaaf3dd55481dd930 P b7ab4784c7344b939bc36f639286f377 [term 8 FOLLOWER]: Rejecting Update request from peer ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 7. Current term is 8. Ops: []
I20260709 13:19:27.111549  6844 leader_election.cc:304] T 44bde925b2e541b69890d70715b85176 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:19:27.082237  6772 leader_election.cc:304] T bd6869f07b5a4885a0b99fbe60c3b175 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:19:27.043627  6802 raft_consensus.cc:2468] T b56bf91d90824c959e21e0cee5ba1816 P b7ab4784c7344b939bc36f639286f377 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 8.
I20260709 13:19:27.059027  6730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b8cacb381b746da8d0049b0a83b41dd" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:19:27.117647  6799 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:32976 (request call id 2267) took 1218 ms. Trace:
I20260709 13:19:27.108489  6805 rpcz_store.cc:276] 0709 13:19:25.898312 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:27.078510 (+1180198us) service_pool.cc:224] Handling call
0709 13:19:27.078908 (+   398us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:27.079170 (+   262us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:27.079207 (+    37us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:27.079265 (+    58us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:19:27.079310 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:27.079378 (+    68us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:27.079495 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:27.052286  6807 raft_consensus.cc:2468] T 34f36d59d88f40fe8a2805e604fc6c0a P b7ab4784c7344b939bc36f639286f377 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 5.
I20260709 13:19:27.118863  6799 rpcz_store.cc:276] 0709 13:19:25.898963 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:27.108816 (+1209853us) service_pool.cc:224] Handling call
0709 13:19:27.109161 (+   345us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:27.117346 (+  8185us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:27.117581 (+   235us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:27.119757  6807 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:32966 (request call id 798) took 1173 ms. Trace:
I20260709 13:19:27.122627  6804 raft_consensus.cc:2468] T 17587d6730594da4a56fa13a353232a1 P b7ab4784c7344b939bc36f639286f377 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 9.
I20260709 13:19:27.138048  6874 raft_consensus.cc:1240] T 853ac0a8cbd64ce99457f170216d4d0f P cd75a17ab2604397adab03bb8b5fd75c [term 5 FOLLOWER]: Rejecting Update request from peer b7ab4784c7344b939bc36f639286f377 for earlier term 4. Current term is 5. Ops: []
I20260709 13:19:27.115692  6801 raft_consensus.cc:2468] T 4275cf08e63345f993bce8664eada830 P b7ab4784c7344b939bc36f639286f377 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 7.
I20260709 13:19:27.141987  6801 raft_consensus.cc:1275] T f4b8bd455d5a47c18a1380839c6e0d61 P b7ab4784c7344b939bc36f639286f377 [term 6 FOLLOWER]: Refusing update from remote peer cd75a17ab2604397adab03bb8b5fd75c: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:19:27.120523  6807 rpcz_store.cc:276] 0709 13:19:25.946035 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:26.919887 (+973852us) service_pool.cc:224] Handling call
0709 13:19:27.119674 (+199787us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:27.143823  6877 raft_consensus.cc:2468] T 22ccee1b570c4ad3a57bd7aec085b1b4 P cd75a17ab2604397adab03bb8b5fd75c [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 6.
I20260709 13:19:27.066244  9582 raft_consensus.cc:2749] T 90d42e216d9741e190bca19a781291fd P b7ab4784c7344b939bc36f639286f377 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:19:27.046021  9502 raft_consensus.cc:515] T 07a92dd554674067a83a9cb68c4773f2 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
W20260709 13:19:27.145654  6772 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 63497us
I20260709 13:19:27.145853  6695 leader_election.cc:304] T a3022224cc81473690653a83d4e99470 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:19:27.094842  9608 leader_election.cc:290] T 7887766dc6784fcaa42b35c05fea7a99 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:19:27.066177  9561 raft_consensus.cc:2749] T 7887766dc6784fcaa42b35c05fea7a99 P b7ab4784c7344b939bc36f639286f377 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:19:27.157238  6772 leader_election.cc:304] T ab432e62819d499eaaf3dd55481dd930 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:19:27.114605  9273 raft_consensus.cc:493] T e31b9971c15848dea59d4d4130141d9e P cd75a17ab2604397adab03bb8b5fd75c [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:27.147699  6880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c240553ce044eedb41541d72b9475d7" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:19:27.142573  6801 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:32966 (request call id 801) took 1195 ms. Trace:
I20260709 13:19:27.159294  6801 rpcz_store.cc:276] 0709 13:19:25.946990 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:27.141310 (+1194320us) service_pool.cc:224] Handling call
0709 13:19:27.141641 (+   331us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:27.142348 (+   707us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:27.142519 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:19:27.160050  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 48617us
I20260709 13:19:27.161048  6844 leader_election.cc:304] T ab432e62819d499eaaf3dd55481dd930 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:19:27.138660  9609 leader_election.cc:290] T fe20b4b48823486ca3b9c648db6ce8aa P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:19:27.144699  6799 raft_consensus.cc:1240] T 7c37d41cd9164c15a6826ca62a851a69 P b7ab4784c7344b939bc36f639286f377 [term 6 FOLLOWER]: Rejecting Update request from peer cd75a17ab2604397adab03bb8b5fd75c for earlier term 5. Current term is 6. Ops: []
I20260709 13:19:27.167225  6799 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:32966 (request call id 794) took 1222 ms. Trace:
I20260709 13:19:27.114986  9366 raft_consensus.cc:493] T be1a92657f494cac8dd227d152f50151 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:27.155642  6846 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.68:45071, user_credentials={real_user=slave}} blocked reactor thread for 208185us
I20260709 13:19:27.152911  6802 raft_consensus.cc:1240] T 9e326172347f45e99a0d482b5d8ef768 P b7ab4784c7344b939bc36f639286f377 [term 6 FOLLOWER]: Rejecting Update request from peer ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 5. Current term is 6. Ops: []
I20260709 13:19:27.137964  9534 raft_consensus.cc:493] T 17587d6730594da4a56fa13a353232a1 P b7ab4784c7344b939bc36f639286f377 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:27.143989  9526 raft_consensus.cc:2749] T dbdf895bba214ff68685a24fd17dfb5d P ccd8a4c3bfe3413cb2ae219b09aea832 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:19:27.107786  9588 raft_consensus.cc:2749] T 44bde925b2e541b69890d70715b85176 P b7ab4784c7344b939bc36f639286f377 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:19:27.158879  6880 raft_consensus.cc:2468] T 2c240553ce044eedb41541d72b9475d7 P cd75a17ab2604397adab03bb8b5fd75c [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 8.
I20260709 13:19:27.167644  6799 rpcz_store.cc:276] 0709 13:19:25.944805 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:27.144124 (+1199319us) service_pool.cc:224] Handling call
0709 13:19:27.144471 (+   347us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:27.166904 (+ 22433us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:27.167159 (+   255us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:27.233389  6802 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:32976 (request call id 2268) took 1334 ms. Trace:
I20260709 13:19:27.234148  6799 raft_consensus.cc:1240] T e77e330a82df4b43a745d57a68f6f057 P b7ab4784c7344b939bc36f639286f377 [term 9 LEADER]: Rejecting Update request from peer ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 8. Current term is 9. Ops: [8.4-8.4]
I20260709 13:19:27.234817  6799 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:32976 (request call id 2273) took 1108 ms. Trace:
I20260709 13:19:27.235118  6799 rpcz_store.cc:276] 0709 13:19:26.126347 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:27.233520 (+1107173us) service_pool.cc:224] Handling call
0709 13:19:27.233882 (+   362us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:27.234553 (+   671us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:27.234761 (+   208us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:27.154796  6695 leader_election.cc:304] T be1a92657f494cac8dd227d152f50151 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
W20260709 13:19:27.236725  6695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 82000.3us
I20260709 13:19:27.236779  7500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b8cacb381b746da8d0049b0a83b41dd" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:19:27.237493  7500 raft_consensus.cc:2468] T 4b8cacb381b746da8d0049b0a83b41dd P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 7.
I20260709 13:19:27.239621  6695 leader_election.cc:304] T 1bf4668eeb70467fb3dc5a0289233b3c P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
I20260709 13:19:27.169598  6801 raft_consensus.cc:1240] T ce4f062dcd314d43a63ca74067cb5ee3 P b7ab4784c7344b939bc36f639286f377 [term 7 FOLLOWER]: Rejecting Update request from peer ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 6. Current term is 7. Ops: []
I20260709 13:19:27.241560  6801 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:32976 (request call id 2272) took 1144 ms. Trace:
W20260709 13:19:27.175479  9554 log.cc:927] Time spent T de3186201e1a40d0b335eeb8b4e256e0 P ccd8a4c3bfe3413cb2ae219b09aea832: Append to log took a long time: real 1.567s	user 0.001s	sys 0.002s
I20260709 13:19:27.149348  9450 raft_consensus.cc:2749] T bd6869f07b5a4885a0b99fbe60c3b175 P b7ab4784c7344b939bc36f639286f377 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:19:27.137714  9351 raft_consensus.cc:515] T f58dc08b12a2494bb9a1372837970ca2 P cd75a17ab2604397adab03bb8b5fd75c [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:27.182806  6807 raft_consensus.cc:1240] T 7887766dc6784fcaa42b35c05fea7a99 P b7ab4784c7344b939bc36f639286f377 [term 7 FOLLOWER]: Rejecting Update request from peer ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 6. Current term is 7. Ops: []
I20260709 13:19:27.158852  6772 leader_election.cc:304] T 711ef6523deb4cbe8ef2ba61e1c21c98 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:19:27.242079  6801 rpcz_store.cc:276] 0709 13:19:26.096962 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:27.160289 (+1063327us) service_pool.cc:224] Handling call
0709 13:19:27.160624 (+   335us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:27.241272 (+ 80648us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:27.241495 (+   223us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:27.160333  9556 raft_consensus.cc:2749] T a3022224cc81473690653a83d4e99470 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:19:27.143954  9512 raft_consensus.cc:515] T 1528ab62b6fe4e3099d08f141afee116 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:19:27.246455  6880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a92dd554674067a83a9cb68c4773f2" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 8 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:19:27.233747  6802 rpcz_store.cc:276] 0709 13:19:25.899266 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:27.118600 (+1219334us) service_pool.cc:224] Handling call
0709 13:19:27.152659 (+ 34059us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:27.233126 (+ 80467us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:27.233334 (+   208us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:27.229120  6874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4b8bd455d5a47c18a1380839c6e0d61" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:19:27.256249  6695 leader_election.cc:304] T b56bf91d90824c959e21e0cee5ba1816 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
I20260709 13:19:27.230609  9608 raft_consensus.cc:2804] T 44bde925b2e541b69890d70715b85176 P cd75a17ab2604397adab03bb8b5fd75c [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:19:27.164423  9553 raft_consensus.cc:493] T 7a734b5ab7834e05a8c422208acc58b1 P b7ab4784c7344b939bc36f639286f377 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:27.092259  9569 consensus_queue.cc:260] T e77e330a82df4b43a745d57a68f6f057 P ccd8a4c3bfe3413cb2ae219b09aea832 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 8.4, Last appended by leader: 4, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } }
I20260709 13:19:27.232475  9616 raft_consensus.cc:493] T 427c124d773f483294511e80fe340075 P cd75a17ab2604397adab03bb8b5fd75c [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 7ba59cc884714e8aa5f3f0ecaed84cbb)
I20260709 13:19:27.245927  9516 raft_consensus.cc:2804] T be1a92657f494cac8dd227d152f50151 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 8 FOLLOWER]: Leader election won for term 8
W20260709 13:19:27.266821  6772 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 108072us
I20260709 13:19:27.307583  6772 leader_election.cc:304] T 20f6842e26174571996b8dea4151d4be P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:19:27.144582  9621 consensus_queue.cc:1059] T 07a92dd554674067a83a9cb68c4773f2 P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.134s
I20260709 13:19:27.242026  9631 raft_consensus.cc:493] T 90d42e216d9741e190bca19a781291fd P cd75a17ab2604397adab03bb8b5fd75c [term 7 FOLLOWER]: Starting pre-election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:19:27.229808  9630 raft_consensus.cc:2764] T ab432e62819d499eaaf3dd55481dd930 P cd75a17ab2604397adab03bb8b5fd75c [term 8 FOLLOWER]: Leader pre-election decision vote started in defunct term 7: won
I20260709 13:19:27.298153  6880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ba5dac66ab5497e9e336f2a3c28cda5" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:19:27.283910  9515 leader_election.cc:290] T c4db81d9d329422bb3b4160ca4ac2d1d P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 8 election: Requested vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:27.177318  9487 raft_consensus.cc:2804] T ab432e62819d499eaaf3dd55481dd930 P b7ab4784c7344b939bc36f639286f377 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:19:27.299929  6695 leader_election.cc:304] T 17587d6730594da4a56fa13a353232a1 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb
I20260709 13:19:27.228785  9592 consensus_queue.cc:1048] T 3fa34c08b205435dba97346991aa1f92 P 7ba59cc884714e8aa5f3f0ecaed84cbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.053s
W20260709 13:19:27.353462  7468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 173489us
I20260709 13:19:27.242621  9531 raft_consensus.cc:493] T 4d9def8b32fd443aa94ab1420b06837b P cd75a17ab2604397adab03bb8b5fd75c [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:27.311218  7500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce4f062dcd314d43a63ca74067cb5ee3" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb"
I20260709 13:19:27.357623  7500 raft_consensus.cc:3060] T ce4f062dcd314d43a63ca74067cb5ee3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:27.245000  9461 raft_consensus.cc:493] T 4f00a2e87e56452083b759f60d461ee3 P cd75a17ab2604397adab03bb8b5fd75c [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:19:27.232015  9449 consensus_queue.cc:1048] T fe20b4b48823486ca3b9c648db6ce8aa P 7ba59cc884714e8aa5f3f0ecaed84cbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.052s
I20260709 13:19:27.282199  9588 raft_consensus.cc:2804] T 711ef6523deb4cbe8ef2ba61e1c21c98 P b7ab4784c7344b939bc36f639286f377 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:19:27.268362  9609 raft_consensus.cc:2804] T 1bf4668eeb70467fb3dc5a0289233b3c P ccd8a4c3bfe3413cb2ae219b09aea832 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:19:27.245978  9366 raft_consensus.cc:515] T be1a92657f494cac8dd227d152f50151 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:19:27.266091  6725 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49998 (request call id 773) took 1550 ms. Trace:
I20260709 13:19:27.282903  9608 raft_consensus.cc:493] T 44bde925b2e541b69890d70715b85176 P cd75a17ab2604397adab03bb8b5fd75c [term 7 FOLLOWER]: Starting leader election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:19:27.168394  9273 raft_consensus.cc:515] T e31b9971c15848dea59d4d4130141d9e P cd75a17ab2604397adab03bb8b5fd75c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:27.257032  9534 raft_consensus.cc:515] T 17587d6730594da4a56fa13a353232a1 P b7ab4784c7344b939bc36f639286f377 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:19:27.379635  9351 leader_election.cc:290] T f58dc08b12a2494bb9a1372837970ca2 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 9 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:19:27.350693  6802 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50550 (request call id 260) took 1006 ms. Trace:
I20260709 13:19:27.380321  6802 rpcz_store.cc:276] 0709 13:19:26.343895 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:27.305578 (+961683us) service_pool.cc:224] Handling call
0709 13:19:27.350018 (+ 44440us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:27.350276 (+   258us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:27.350312 (+    36us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:27.350366 (+    54us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:19:27.350413 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:27.350479 (+    66us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:27.350618 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:27.318574  6874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce4f062dcd314d43a63ca74067cb5ee3" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:19:27.402338  6874 raft_consensus.cc:2468] T ce4f062dcd314d43a63ca74067cb5ee3 P cd75a17ab2604397adab03bb8b5fd75c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in term 6.
I20260709 13:19:27.315286  9450 raft_consensus.cc:2804] T 20f6842e26174571996b8dea4151d4be P b7ab4784c7344b939bc36f639286f377 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:19:27.347409  9569 raft_consensus.cc:3060] T e77e330a82df4b43a745d57a68f6f057 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:27.371310  6725 rpcz_store.cc:276] 0709 13:19:25.716755 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:25.719325 (+  2570us) service_pool.cc:224] Handling call
0709 13:19:25.719615 (+   290us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:26.373043 (+653428us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:27.265814 (+892771us) spinlock_profiling.cc:243] Waited 627 ms on lock 0x7b54000e4a54. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f9aae01 00007fcc0f9a983e 00007fcc1496e419 00007fcc0dee5bd4 00007fcc0dee5b62 00007fcc0dee5a91 00007fcc0dee5a0c 00007fcc0dee4cc2 00007fcc0dce548c 00007fcc0dce48c6
0709 13:19:27.266020 (+   206us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1441922816}
I20260709 13:19:27.376084  6880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b8cacb381b746da8d0049b0a83b41dd" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:19:27.313602  9553 raft_consensus.cc:515] T 7a734b5ab7834e05a8c422208acc58b1 P b7ab4784c7344b939bc36f639286f377 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:27.378705  9609 raft_consensus.cc:697] T 1bf4668eeb70467fb3dc5a0289233b3c P ccd8a4c3bfe3413cb2ae219b09aea832 [term 7 LEADER]: Becoming Leader. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
I20260709 13:19:27.378924  9484 raft_consensus.cc:493] T fe20b4b48823486ca3b9c648db6ce8aa P cd75a17ab2604397adab03bb8b5fd75c [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:27.313141  9506 consensus_queue.cc:1059] T ab432e62819d499eaaf3dd55481dd930 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: INVALID_TERM, Last received: 7.3, Next index: 4, Last known committed idx: 1, Time since last communication: 0.063s
I20260709 13:19:27.364605  9449 consensus_queue.cc:1243] T fe20b4b48823486ca3b9c648db6ce8aa P 7ba59cc884714e8aa5f3f0ecaed84cbb [LEADER]: Peer cd75a17ab2604397adab03bb8b5fd75c log is divergent from this leader: its last log entry 2.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 13:19:27.349248  9031 consensus_queue.cc:1059] T 7ba5dac66ab5497e9e336f2a3c28cda5 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.031s
I20260709 13:19:27.352149  9556 consensus_queue.cc:1048] T 2c240553ce044eedb41541d72b9475d7 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.029s
I20260709 13:19:27.318287  9616 raft_consensus.cc:515] T 427c124d773f483294511e80fe340075 P cd75a17ab2604397adab03bb8b5fd75c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } attrs { replace: true } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:19:27.412266  6880 raft_consensus.cc:2468] T 4b8cacb381b746da8d0049b0a83b41dd P cd75a17ab2604397adab03bb8b5fd75c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in term 7.
I20260709 13:19:27.368856  9461 raft_consensus.cc:515] T 4f00a2e87e56452083b759f60d461ee3 P cd75a17ab2604397adab03bb8b5fd75c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:19:27.380904  9366 leader_election.cc:290] T be1a92657f494cac8dd227d152f50151 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:19:27.314901  9046 consensus_queue.cc:1059] T 853ac0a8cbd64ce99457f170216d4d0f P b7ab4784c7344b939bc36f639286f377 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.068s
I20260709 13:19:27.348965  9631 raft_consensus.cc:515] T 90d42e216d9741e190bca19a781291fd P cd75a17ab2604397adab03bb8b5fd75c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
W20260709 13:19:27.414220  6800 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:32976 (request call id 2258) took 1564 ms (client timeout 1728 ms). Trace:
I20260709 13:19:27.384618  9605 raft_consensus.cc:515] T 7a734b5ab7834e05a8c422208acc58b1 P cd75a17ab2604397adab03bb8b5fd75c [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:27.375283  9630 raft_consensus.cc:493] T 3411566abe2d4c9bb4b2adfdd05e6f17 P cd75a17ab2604397adab03bb8b5fd75c [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:27.381332  9526 raft_consensus.cc:2804] T 17587d6730594da4a56fa13a353232a1 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:19:27.376332  9588 raft_consensus.cc:697] T 711ef6523deb4cbe8ef2ba61e1c21c98 P b7ab4784c7344b939bc36f639286f377 [term 8 LEADER]: Becoming Leader. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
I20260709 13:19:27.350790  9613 raft_consensus.cc:515] T f09c2a98de1a4decabd0ff900dd44caa P cd75a17ab2604397adab03bb8b5fd75c [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:27.425729  6802 raft_consensus.cc:1240] T 17587d6730594da4a56fa13a353232a1 P b7ab4784c7344b939bc36f639286f377 [term 9 FOLLOWER]: Rejecting Update request from peer 7ba59cc884714e8aa5f3f0ecaed84cbb for earlier term 8. Current term is 9. Ops: []
I20260709 13:19:27.365980  9531 raft_consensus.cc:515] T 4d9def8b32fd443aa94ab1420b06837b P cd75a17ab2604397adab03bb8b5fd75c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:27.405707  9450 raft_consensus.cc:493] T 20f6842e26174571996b8dea4151d4be P b7ab4784c7344b939bc36f639286f377 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:27.427312  6874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de3186201e1a40d0b335eeb8b4e256e0" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:19:27.428946  6880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b56bf91d90824c959e21e0cee5ba1816" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:19:27.360567  9487 raft_consensus.cc:697] T ab432e62819d499eaaf3dd55481dd930 P b7ab4784c7344b939bc36f639286f377 [term 8 LEADER]: Becoming Leader. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
I20260709 13:19:27.459569  6874 raft_consensus.cc:2468] T de3186201e1a40d0b335eeb8b4e256e0 P cd75a17ab2604397adab03bb8b5fd75c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 7.
W20260709 13:19:27.429759  6695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 129911us
I20260709 13:19:27.430718  6799 raft_consensus.cc:1275] T 7a734b5ab7834e05a8c422208acc58b1 P b7ab4784c7344b939bc36f639286f377 [term 7 FOLLOWER]: Refusing update from remote peer ccd8a4c3bfe3413cb2ae219b09aea832: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:19:27.381306  9608 raft_consensus.cc:3060] T 44bde925b2e541b69890d70715b85176 P cd75a17ab2604397adab03bb8b5fd75c [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:19:27.435289  6800 rpcz_store.cc:269] 0709 13:19:25.842044 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:25.843129 (+  1085us) service_pool.cc:224] Handling call
0709 13:19:27.406455 (+1563326us) spinlock_profiling.cc:243] Waited 1.01 s on lock 0x7b54002c88d4. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f9ae2fa 00007fcc1496fb17 00007fcc0deea6d4 00007fcc0deea662 00007fcc0deea591 00007fcc0deea50c 00007fcc0dee97c2 00007fcc0dce548c 00007fcc0dce48c6 00007fcc0dce426f
0709 13:19:27.406599 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2323841792}
I20260709 13:19:27.426816  9484 raft_consensus.cc:515] T fe20b4b48823486ca3b9c648db6ce8aa P cd75a17ab2604397adab03bb8b5fd75c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:19:27.425321  9502 leader_election.cc:290] T 07a92dd554674067a83a9cb68c4773f2 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:27.481220  6880 raft_consensus.cc:2393] T b56bf91d90824c959e21e0cee5ba1816 P cd75a17ab2604397adab03bb8b5fd75c [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7ab4784c7344b939bc36f639286f377 in current term 8: Already voted for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in this term.
I20260709 13:19:27.428182  9489 raft_consensus.cc:3055] T ab432e62819d499eaaf3dd55481dd930 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:19:27.461380  6846 leader_election.cc:304] T 4b8cacb381b746da8d0049b0a83b41dd P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:19:27.461380  6695 leader_election.cc:304] T 4275cf08e63345f993bce8664eada830 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
I20260709 13:19:27.440680  9031 raft_consensus.cc:3055] T 7ba5dac66ab5497e9e336f2a3c28cda5 P b7ab4784c7344b939bc36f639286f377 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:19:27.471403  9628 raft_consensus.cc:2804] T b56bf91d90824c959e21e0cee5ba1816 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 8 FOLLOWER]: Leader election won for term 8
W20260709 13:19:27.469751  6697 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 166837us
I20260709 13:19:27.472431  9630 raft_consensus.cc:515] T 3411566abe2d4c9bb4b2adfdd05e6f17 P cd75a17ab2604397adab03bb8b5fd75c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:27.468456  9450 raft_consensus.cc:3060] T 20f6842e26174571996b8dea4151d4be P b7ab4784c7344b939bc36f639286f377 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:27.455052  6802 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50550 (request call id 261) took 1070 ms. Trace:
I20260709 13:19:27.488787  6802 rpcz_store.cc:276] 0709 13:19:26.384368 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:27.416693 (+1032325us) service_pool.cc:224] Handling call
0709 13:19:27.425527 (+  8834us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:27.454588 (+ 29061us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:27.454949 (+   361us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:27.488492  6880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4b8bd455d5a47c18a1380839c6e0d61" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:19:27.448016  9366 raft_consensus.cc:493] T 4f00a2e87e56452083b759f60d461ee3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:19:27.436646  9641 raft_consensus.cc:493] T f5be3a11b23d4ea9b08300a2789821c7 P cd75a17ab2604397adab03bb8b5fd75c [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:19:27.511642  6874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bf4668eeb70467fb3dc5a0289233b3c" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:19:27.512333  6802 raft_consensus.cc:1240] T 3a485a995abc4807b6e511e45419f737 P b7ab4784c7344b939bc36f639286f377 [term 6 FOLLOWER]: Rejecting Update request from peer ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 5. Current term is 6. Ops: [4.3-5.4]
I20260709 13:19:27.491834  6880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe20b4b48823486ca3b9c648db6ce8aa" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:19:27.512404  6874 raft_consensus.cc:3060] T 1bf4668eeb70467fb3dc5a0289233b3c P cd75a17ab2604397adab03bb8b5fd75c [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:27.513377  6880 raft_consensus.cc:2468] T fe20b4b48823486ca3b9c648db6ce8aa P cd75a17ab2604397adab03bb8b5fd75c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 5.
I20260709 13:19:27.519918  6802 raft_consensus.cc:1240] T 95a75bfe094d4bdc963aba3f08dfcd25 P b7ab4784c7344b939bc36f639286f377 [term 8 LEADER]: Rejecting Update request from peer ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 7. Current term is 8. Ops: []
I20260709 13:19:27.521268  6802 raft_consensus.cc:1240] T 44bde925b2e541b69890d70715b85176 P b7ab4784c7344b939bc36f639286f377 [term 8 FOLLOWER]: Rejecting Update request from peer ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 7. Current term is 8. Ops: [7.5-7.5]
I20260709 13:19:27.521786  6697 leader_election.cc:304] T 24ee15416e3145beaa1b8183453729a3 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, cd75a17ab2604397adab03bb8b5fd75c
W20260709 13:19:27.522135  6846 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.68:45071, user_credentials={real_user=slave}} blocked reactor thread for 60858us
I20260709 13:19:27.523612  6802 raft_consensus.cc:1240] T 22ccee1b570c4ad3a57bd7aec085b1b4 P b7ab4784c7344b939bc36f639286f377 [term 6 FOLLOWER]: Rejecting Update request from peer ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 5. Current term is 6. Ops: []
I20260709 13:19:27.525820  6800 raft_consensus.cc:1240] T f03d0dbf16864ca4bc1bb5e4c0334c0f P b7ab4784c7344b939bc36f639286f377 [term 6 FOLLOWER]: Rejecting Update request from peer ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 5. Current term is 6. Ops: []
W20260709 13:19:27.527477  6695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 66207.1us
I20260709 13:19:27.529032  6800 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:32976 (request call id 2280) took 1024 ms. Trace:
I20260709 13:19:27.529417  6697 leader_election.cc:304] T 30e88460611e47b2ba16a46a30b5f416 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377
I20260709 13:19:27.529763  6800 rpcz_store.cc:276] 0709 13:19:26.504700 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:27.489561 (+984861us) service_pool.cc:224] Handling call
0709 13:19:27.519668 (+ 30107us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:27.528615 (+  8947us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:27.528952 (+   337us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:27.533129  6880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3d8792045a4583ae2e965b1350a5b4" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:19:27.534560  6880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "713b5728a197487c9300b310ab94e5a3" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:19:27.490988  9594 raft_consensus.cc:493] T 7c44c4849aa54f2b94d1f1bef9ed546f P b7ab4784c7344b939bc36f639286f377 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:27.488961  9031 raft_consensus.cc:740] T 7ba5dac66ab5497e9e336f2a3c28cda5 P b7ab4784c7344b939bc36f639286f377 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
I20260709 13:19:27.487548  9489 raft_consensus.cc:740] T ab432e62819d499eaaf3dd55481dd930 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
I20260709 13:19:27.540910  6880 raft_consensus.cc:2468] T 713b5728a197487c9300b310ab94e5a3 P cd75a17ab2604397adab03bb8b5fd75c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 7.
I20260709 13:19:27.481464  9609 consensus_queue.cc:237] T 1bf4668eeb70467fb3dc5a0289233b3c P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:27.526471  9641 raft_consensus.cc:515] T f5be3a11b23d4ea9b08300a2789821c7 P cd75a17ab2604397adab03bb8b5fd75c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:27.511435  9512 leader_election.cc:290] T 1528ab62b6fe4e3099d08f141afee116 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:19:27.515208  9526 raft_consensus.cc:697] T 17587d6730594da4a56fa13a353232a1 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 9 LEADER]: Becoming Leader. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
W20260709 13:19:27.542584  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 124795us
I20260709 13:19:27.864639  7503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17587d6730594da4a56fa13a353232a1" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:19:27.792516  6807 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:32976 (request call id 2269) took 1827 ms. Trace:
I20260709 13:19:28.174636  7468 leader_election.cc:304] T 4b8cacb381b746da8d0049b0a83b41dd P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:19:28.174552  6807 rpcz_store.cc:276] 0709 13:19:25.966015 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:27.145793 (+1179778us) service_pool.cc:224] Handling call
0709 13:19:27.146098 (+   305us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:27.262296 (+116198us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:27.792216 (+529920us) spinlock_profiling.cc:243] Waited 36.5 ms on lock 0x7b5400288cd4. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f9aae01 00007fcc0f9a983e 00007fcc1496e419 00007fcc0dee5bd4 00007fcc0dee5b62 00007fcc0dee5a91 00007fcc0dee5a0c 00007fcc0dee4cc2 00007fcc0dce548c 00007fcc0dce48c6
0709 13:19:27.792432 (+   216us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":83877632}
I20260709 13:19:27.713426  6881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f9c2e2bf644115957398fe4c9459db" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:19:28.175658  6881 raft_consensus.cc:2468] T f3f9c2e2bf644115957398fe4c9459db P cd75a17ab2604397adab03bb8b5fd75c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 6.
I20260709 13:19:27.922158  6772 leader_election.cc:304] T 22ccee1b570c4ad3a57bd7aec085b1b4 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:19:27.859472  6877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c37d41cd9164c15a6826ca62a851a69" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
W20260709 13:19:27.866631  6806 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:32966 (request call id 792) took 1922 ms (client timeout 2292 ms). Trace:
W20260709 13:19:27.917431  7500 consensus_meta.cc:287] T ce4f062dcd314d43a63ca74067cb5ee3 P 7ba59cc884714e8aa5f3f0ecaed84cbb: Time spent flushing consensus metadata: real 0.556s	user 0.011s	sys 0.000s
I20260709 13:19:28.181615  7500 raft_consensus.cc:2468] T ce4f062dcd314d43a63ca74067cb5ee3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 7.
W20260709 13:19:27.628301  6697 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 97940.4us
I20260709 13:19:27.864784  6875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c7f33e544204fbaac4078e3e83bbf4e" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:19:27.732275  6874 raft_consensus.cc:2468] T 1bf4668eeb70467fb3dc5a0289233b3c P cd75a17ab2604397adab03bb8b5fd75c [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 7.
I20260709 13:19:27.538157  9515 raft_consensus.cc:2749] T 24ee15416e3145beaa1b8183453729a3 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:19:28.187279  6874 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53406 (request call id 1585) took 1115 ms. Trace:
I20260709 13:19:28.192303  6874 rpcz_store.cc:276] 0709 13:19:27.071801 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:28.184786 (+1112985us) service_pool.cc:224] Handling call
0709 13:19:28.186673 (+  1887us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:28.186934 (+   261us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:28.186960 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:28.187006 (+    46us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:19:28.187037 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:28.187108 (+    71us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:28.187218 (+   110us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:19:27.560619  9633 log.cc:927] Time spent T 95a75bfe094d4bdc963aba3f08dfcd25 P b7ab4784c7344b939bc36f639286f377: Append to log took a long time: real 0.125s	user 0.001s	sys 0.000s
W20260709 13:19:27.618207  6695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 78218.8us
I20260709 13:19:28.172849  6880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce4f062dcd314d43a63ca74067cb5ee3" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:19:27.536520  9628 raft_consensus.cc:697] T b56bf91d90824c959e21e0cee5ba1816 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 8 LEADER]: Becoming Leader. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
I20260709 13:19:27.540741  9502 raft_consensus.cc:2804] T 4275cf08e63345f993bce8664eada830 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:19:28.346698  6844 leader_election.cc:304] T d8292e16e5654be6bc408560cf256aaa P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: ccd8a4c3bfe3413cb2ae219b09aea832
W20260709 13:19:28.179126  6806 rpcz_store.cc:269] 0709 13:19:25.944178 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:26.127516 (+183338us) service_pool.cc:224] Handling call
0709 13:19:27.866345 (+1738829us) spinlock_profiling.cc:243] Waited 20 ms on lock 0x7b54001a36d4. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f9ae2fa 00007fcc1496fb17 00007fcc0deea6d4 00007fcc0deea662 00007fcc0deea591 00007fcc0deea50c 00007fcc0dee97c2 00007fcc0dce548c 00007fcc0dce48c6 00007fcc0dce426f
0709 13:19:27.866548 (+   203us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":46090112}
W20260709 13:19:27.874217  9624 log.cc:927] Time spent T d8292e16e5654be6bc408560cf256aaa P cd75a17ab2604397adab03bb8b5fd75c: Append to log took a long time: real 0.454s	user 0.000s	sys 0.001s
W20260709 13:19:27.611977  9629 log.cc:927] Time spent T bd6869f07b5a4885a0b99fbe60c3b175 P ccd8a4c3bfe3413cb2ae219b09aea832: Append to log took a long time: real 0.263s	user 0.004s	sys 0.000s
W20260709 13:19:27.905706  9632 log.cc:927] Time spent T 1528ab62b6fe4e3099d08f141afee116 P b7ab4784c7344b939bc36f639286f377: Append to log took a long time: real 0.626s	user 0.001s	sys 0.000s
W20260709 13:19:28.337076  6697 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 151399us
I20260709 13:19:27.870231  9344 raft_consensus.cc:493] T dbdf895bba214ff68685a24fd17dfb5d P cd75a17ab2604397adab03bb8b5fd75c [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:19:28.382633  6844 leader_election.cc:304] T b56bf91d90824c959e21e0cee5ba1816 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:19:27.631907  9548 consensus_queue.cc:1059] T a3022224cc81473690653a83d4e99470 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.748s
I20260709 13:19:27.556016  9626 raft_consensus.cc:2804] T 30e88460611e47b2ba16a46a30b5f416 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:19:27.648903  9384 consensus_meta.cc:287] T 7c44c4849aa54f2b94d1f1bef9ed546f P ccd8a4c3bfe3413cb2ae219b09aea832: Time spent flushing consensus metadata: real 0.560s	user 0.010s	sys 0.000s
I20260709 13:19:28.338014  9658 raft_consensus.cc:2804] T 4b8cacb381b746da8d0049b0a83b41dd P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:19:28.341241  6881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a734b5ab7834e05a8c422208acc58b1" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:19:28.389642  6881 raft_consensus.cc:2393] T 7a734b5ab7834e05a8c422208acc58b1 P cd75a17ab2604397adab03bb8b5fd75c [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7ab4784c7344b939bc36f639286f377 in current term 8: Already voted for candidate cd75a17ab2604397adab03bb8b5fd75c in this term.
I20260709 13:19:27.689808  9351 raft_consensus.cc:2804] T 4b8cacb381b746da8d0049b0a83b41dd P cd75a17ab2604397adab03bb8b5fd75c [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:19:27.556661  9553 leader_election.cc:290] T 7a734b5ab7834e05a8c422208acc58b1 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:27.789330  9581 raft_consensus.cc:3055] T e31b9971c15848dea59d4d4130141d9e P b7ab4784c7344b939bc36f639286f377 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:19:28.337280  6800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f58dc08b12a2494bb9a1372837970ca2" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:19:27.641534  9461 leader_election.cc:290] T 4f00a2e87e56452083b759f60d461ee3 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:19:27.538354  9506 consensus_queue.cc:1059] T 9e326172347f45e99a0d482b5d8ef768 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.663s
I20260709 13:19:27.563494  9486 leader_election.cc:290] T 9b3759de40694069b13c0f8bd40e5709 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:19:27.902870  9605 leader_election.cc:290] T 7a734b5ab7834e05a8c422208acc58b1 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 8 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:19:27.783355  9631 leader_election.cc:290] T 90d42e216d9741e190bca19a781291fd P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:19:27.788511  9613 leader_election.cc:290] T f09c2a98de1a4decabd0ff900dd44caa P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 8 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:19:27.868425  9649 raft_consensus.cc:493] T 95a75bfe094d4bdc963aba3f08dfcd25 P cd75a17ab2604397adab03bb8b5fd75c [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:28.001075  9046 raft_consensus.cc:493] T f03d0dbf16864ca4bc1bb5e4c0334c0f P b7ab4784c7344b939bc36f639286f377 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:28.351866  6695 leader_election.cc:304] T d33d5ee8ef6f415593d8df52063161ad P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:19:27.557997  9588 consensus_queue.cc:237] T 711ef6523deb4cbe8ef2ba61e1c21c98 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:27.637068  9490 raft_consensus.cc:493] T f09c2a98de1a4decabd0ff900dd44caa P b7ab4784c7344b939bc36f639286f377 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:19:27.642467  9531 leader_election.cc:290] T 4d9def8b32fd443aa94ab1420b06837b P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:19:27.641412  9630 leader_election.cc:290] T 3411566abe2d4c9bb4b2adfdd05e6f17 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:19:27.689453  9516 raft_consensus.cc:697] T be1a92657f494cac8dd227d152f50151 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 8 LEADER]: Becoming Leader. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
I20260709 13:19:28.409710  9046 raft_consensus.cc:515] T f03d0dbf16864ca4bc1bb5e4c0334c0f P b7ab4784c7344b939bc36f639286f377 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:28.414324  9490 raft_consensus.cc:515] T f09c2a98de1a4decabd0ff900dd44caa P b7ab4784c7344b939bc36f639286f377 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:28.415107  9516 consensus_queue.cc:237] T be1a92657f494cac8dd227d152f50151 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:19:28.416685  9490 leader_election.cc:290] T f09c2a98de1a4decabd0ff900dd44caa P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:28.417305  9490 raft_consensus.cc:2804] T 22ccee1b570c4ad3a57bd7aec085b1b4 P b7ab4784c7344b939bc36f639286f377 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:19:27.639886  9484 leader_election.cc:290] T fe20b4b48823486ca3b9c648db6ce8aa P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:19:27.640324  9645 raft_consensus.cc:493] T d8cee0accdb8499c86d4414b72565a38 P b7ab4784c7344b939bc36f639286f377 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 7ba59cc884714e8aa5f3f0ecaed84cbb)
I20260709 13:19:27.842007  9541 raft_consensus.cc:493] T 9b3759de40694069b13c0f8bd40e5709 P b7ab4784c7344b939bc36f639286f377 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:19:27.863400  9534 leader_election.cc:290] T 17587d6730594da4a56fa13a353232a1 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:19:27.793238  9596 raft_consensus.cc:3055] T 17587d6730594da4a56fa13a353232a1 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:19:28.000311  9643 raft_consensus.cc:493] T 24ee15416e3145beaa1b8183453729a3 P b7ab4784c7344b939bc36f639286f377 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 7ba59cc884714e8aa5f3f0ecaed84cbb)
W20260709 13:19:28.335717  9569 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.583s	user 0.016s	sys 0.003s
I20260709 13:19:28.338114  6880 raft_consensus.cc:3060] T ce4f062dcd314d43a63ca74067cb5ee3 P cd75a17ab2604397adab03bb8b5fd75c [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:27.526963  9366 raft_consensus.cc:515] T 4f00a2e87e56452083b759f60d461ee3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:19:27.785403  9616 leader_election.cc:290] T 427c124d773f483294511e80fe340075 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:19:28.355791  6697 leader_election.cc:304] T 34f36d59d88f40fe8a2805e604fc6c0a P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
W20260709 13:19:28.443665  6697 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 87968.1us
I20260709 13:19:28.446622  6726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b56bf91d90824c959e21e0cee5ba1816" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:19:28.383873  6844 leader_election.cc:304] T 1528ab62b6fe4e3099d08f141afee116 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, b7ab4784c7344b939bc36f639286f377
I20260709 13:19:28.448632  6732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20f6842e26174571996b8dea4151d4be" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
W20260709 13:19:28.448870  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 65066.4us
I20260709 13:19:28.450168  6844 leader_election.cc:304] T 3a485a995abc4807b6e511e45419f737 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:19:28.452251  6844 leader_election.cc:304] T 34f36d59d88f40fe8a2805e604fc6c0a P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:19:27.874907  9608 raft_consensus.cc:515] T 44bde925b2e541b69890d70715b85176 P cd75a17ab2604397adab03bb8b5fd75c [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
W20260709 13:19:27.750288  9638 log.cc:927] Time spent T bb7fa124c3bf4ef9ab65a407cb008441 P cd75a17ab2604397adab03bb8b5fd75c: Append to log took a long time: real 0.099s	user 0.000s	sys 0.000s
I20260709 13:19:28.347162  9502 raft_consensus.cc:493] T 4275cf08e63345f993bce8664eada830 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:19:28.336696  6846 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.804s	user 0.018s	sys 0.065s
I20260709 13:19:28.459944  6729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c37d41cd9164c15a6826ca62a851a69" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
W20260709 13:19:28.460455  6846 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.928s	user 0.018s	sys 0.065s
I20260709 13:19:28.460899  6729 raft_consensus.cc:3060] T 7c37d41cd9164c15a6826ca62a851a69 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:27.805065  9450 raft_consensus.cc:515] T 20f6842e26174571996b8dea4151d4be P b7ab4784c7344b939bc36f639286f377 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:28.390594  6877 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53406 (request call id 1589) took 1317 ms. Trace:
I20260709 13:19:28.384652  7499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe20b4b48823486ca3b9c648db6ce8aa" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:19:28.387100  9626 raft_consensus.cc:493] T 30e88460611e47b2ba16a46a30b5f416 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:28.462666  6726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22ccee1b570c4ad3a57bd7aec085b1b4" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:19:27.632413  9487 consensus_queue.cc:237] T ab432e62819d499eaaf3dd55481dd930 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 7.3, Last appended by leader: 3, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:27.639045  9642 consensus_queue.cc:1048] T de3186201e1a40d0b335eeb8b4e256e0 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.751s
I20260709 13:19:27.567042  9594 raft_consensus.cc:515] T 7c44c4849aa54f2b94d1f1bef9ed546f P b7ab4784c7344b939bc36f639286f377 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:28.356902  9652 raft_consensus.cc:493] T 7ba5dac66ab5497e9e336f2a3c28cda5 P cd75a17ab2604397adab03bb8b5fd75c [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:19:28.394012  6800 raft_consensus.cc:3060] T f58dc08b12a2494bb9a1372837970ca2 P b7ab4784c7344b939bc36f639286f377 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:28.426505  9517 raft_consensus.cc:2749] T d33d5ee8ef6f415593d8df52063161ad P ccd8a4c3bfe3413cb2ae219b09aea832 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:19:27.646829  9489 consensus_queue.cc:260] T ab432e62819d499eaaf3dd55481dd930 P ccd8a4c3bfe3413cb2ae219b09aea832 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.3, Last appended by leader: 3, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:27.752100  9639 consensus_queue.cc:1059] T ce4f062dcd314d43a63ca74067cb5ee3 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: INVALID_TERM, Last received: 6.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.632s
I20260709 13:19:28.383503  9656 raft_consensus.cc:493] T a3022224cc81473690653a83d4e99470 P cd75a17ab2604397adab03bb8b5fd75c [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:19:28.400600  6806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1704639a875409b9959353527b3fd68" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:19:27.755585  9031 consensus_queue.cc:260] T 7ba5dac66ab5497e9e336f2a3c28cda5 P b7ab4784c7344b939bc36f639286f377 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
W20260709 13:19:28.405316  6772 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 483269us
I20260709 13:19:28.389168  9658 raft_consensus.cc:493] T 4b8cacb381b746da8d0049b0a83b41dd P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 7 FOLLOWER]: Starting leader election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:19:28.394012  9351 raft_consensus.cc:493] T 4b8cacb381b746da8d0049b0a83b41dd P cd75a17ab2604397adab03bb8b5fd75c [term 7 FOLLOWER]: Starting leader election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:19:28.397248  9650 raft_consensus.cc:2749] T b56bf91d90824c959e21e0cee5ba1816 P cd75a17ab2604397adab03bb8b5fd75c [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:19:28.407819  6876 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53406 (request call id 1570) took 2231 ms. Trace:
I20260709 13:19:27.663589  9637 raft_consensus.cc:493] T d33d5ee8ef6f415593d8df52063161ad P cd75a17ab2604397adab03bb8b5fd75c [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:28.468885  9616 consensus_queue.cc:1048] T f4b8bd455d5a47c18a1380839c6e0d61 P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.029s
I20260709 13:19:28.504256  9637 raft_consensus.cc:515] T d33d5ee8ef6f415593d8df52063161ad P cd75a17ab2604397adab03bb8b5fd75c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:28.506491  9637 leader_election.cc:290] T d33d5ee8ef6f415593d8df52063161ad P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:19:28.396719  9581 raft_consensus.cc:740] T e31b9971c15848dea59d4d4130141d9e P b7ab4784c7344b939bc36f639286f377 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
I20260709 13:19:28.507494  9581 consensus_queue.cc:260] T e31b9971c15848dea59d4d4130141d9e P b7ab4784c7344b939bc36f639286f377 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:28.508759  9581 raft_consensus.cc:3060] T e31b9971c15848dea59d4d4130141d9e P b7ab4784c7344b939bc36f639286f377 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:19:28.509495  6772 leader_election.cc:304] T 2c240553ce044eedb41541d72b9475d7 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:19:28.511479  9663 raft_consensus.cc:2804] T 2c240553ce044eedb41541d72b9475d7 P b7ab4784c7344b939bc36f639286f377 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:19:28.396900  9651 raft_consensus.cc:2804] T d8292e16e5654be6bc408560cf256aaa P cd75a17ab2604397adab03bb8b5fd75c [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:19:28.417586  9046 leader_election.cc:290] T f03d0dbf16864ca4bc1bb5e4c0334c0f P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
W20260709 13:19:28.421764  6695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 70016.9us
I20260709 13:19:28.512320  9651 raft_consensus.cc:493] T d8292e16e5654be6bc408560cf256aaa P cd75a17ab2604397adab03bb8b5fd75c [term 8 FOLLOWER]: Starting leader election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:19:28.512683  6772 leader_election.cc:304] T de3186201e1a40d0b335eeb8b4e256e0 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:19:28.512924  9651 raft_consensus.cc:3060] T d8292e16e5654be6bc408560cf256aaa P cd75a17ab2604397adab03bb8b5fd75c [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:28.511917  9663 raft_consensus.cc:493] T 2c240553ce044eedb41541d72b9475d7 P b7ab4784c7344b939bc36f639286f377 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:28.514633  9663 raft_consensus.cc:3060] T 2c240553ce044eedb41541d72b9475d7 P b7ab4784c7344b939bc36f639286f377 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:28.391839  9384 raft_consensus.cc:515] T 7c44c4849aa54f2b94d1f1bef9ed546f P ccd8a4c3bfe3413cb2ae219b09aea832 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:28.519703  6805 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:32976 (request call id 2271) took 2442 ms. Trace:
I20260709 13:19:28.425184  6872 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53416 (request call id 2386) took 1619 ms. Trace:
I20260709 13:19:28.520210  6805 rpcz_store.cc:276] 0709 13:19:26.077026 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:27.144464 (+1067438us) service_pool.cc:224] Handling call
0709 13:19:27.144824 (+   360us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:27.165196 (+ 20372us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:27.165231 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:27.234345 (+ 69114us) log.cc:844] Serialized 26 byte log entry
0709 13:19:27.476893 (+242548us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:19:27.477013 (+   120us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:28.519275 (+1042262us) spinlock_profiling.cc:243] Waited 20.1 ms on lock 0x7b54001cacd4. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f9aae01 00007fcc0f9a983e 00007fcc1496e419 00007fcc0dee5bd4 00007fcc0dee5b62 00007fcc0dee5a91 00007fcc0dee5a0c 00007fcc0dee4cc2 00007fcc0dce548c 00007fcc0dce48c6
0709 13:19:28.519326 (+    51us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:28.519388 (+    62us) raft_consensus.cc:1685] finished
0709 13:19:28.519403 (+    15us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:28.519633 (+   230us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":46162176,"thread_start_us":167268,"threads_started":1,"wal-append.queue_time_us":343870}
I20260709 13:19:28.520375  6872 rpcz_store.cc:276] 0709 13:19:26.806223 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:26.807340 (+  1117us) service_pool.cc:224] Handling call
0709 13:19:26.942089 (+134749us) spinlock_profiling.cc:243] Waited 2.82 ms on lock 0x7b5800147c98. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0c745db1 00007fcc0c885b71 00007fcc0c885a22 00007fcc1579ec09 00007fcc148f8ee0 00007fcc149c20ab 00007fcc149c2131 00007fcc14983fc0 00007fcc1496e929 00007fcc1496e3d2 00007fcc0dee5bd4
0709 13:19:26.942313 (+   224us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:26.942759 (+   446us) raft_consensus.cc:1534] Early marking committed up to index 1
0709 13:19:26.942789 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:26.943291 (+   502us) log.cc:844] Serialized 26 byte log entry
0709 13:19:27.229018 (+285727us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:19:27.229064 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:27.229132 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:27.873379 (+644247us) spinlock_profiling.cc:243] Waited 1.72 ms on lock 0x7b4400022b4c. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0c745db1 00007fcc0c7e3c85 00007fcc0c7e46a2 00007fcc0f5561db 00007fcc0f551aaf 00007fcc0f54586e 00007fcc0f544bb6 00007fcc0f5447d8 00007fcc0f54e221 00007fcc0f54e1d9 00007fcc0f54e169
0709 13:19:28.424909 (+551530us) raft_consensus.cc:1685] finished
0709 13:19:28.424943 (+    34us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:28.425109 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":81271,"raft.run_cpu_time_us":119,"raft.run_wall_time_us":120,"spinlock_wait_cycles":10431104,"thread_start_us":285207,"threads_started":1,"wal-append.queue_time_us":416528}
I20260709 13:19:28.522351  6805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d9def8b32fd443aa94ab1420b06837b" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:19:28.523195  6872 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58592 (request call id 198) took 1287 ms. Trace:
I20260709 13:19:28.436439  6731 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50004 (request call id 1491) took 2642 ms. Trace:
I20260709 13:19:28.440795  6799 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:32976 (request call id 2274) took 2297 ms. Trace:
I20260709 13:19:28.525002  6799 rpcz_store.cc:276] 0709 13:19:26.143289 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:27.235887 (+1092598us) service_pool.cc:224] Handling call
0709 13:19:27.236242 (+   355us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:27.460722 (+224480us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:28.440408 (+979686us) spinlock_profiling.cc:243] Waited 192 ms on lock 0x7b54001b58d4. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f9aae01 00007fcc0f9a983e 00007fcc1496e419 00007fcc0dee5bd4 00007fcc0dee5b62 00007fcc0dee5a91 00007fcc0dee5a0c 00007fcc0dee4cc2 00007fcc0dce548c 00007fcc0dce48c6
0709 13:19:28.440677 (+   269us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":442177408}
I20260709 13:19:28.526166  6799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30e88460611e47b2ba16a46a30b5f416" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:19:28.527355  6799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b3759de40694069b13c0f8bd40e5709" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:19:28.454034  6724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c240553ce044eedb41541d72b9475d7" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:19:28.498149  9658 raft_consensus.cc:3060] T 4b8cacb381b746da8d0049b0a83b41dd P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:28.528771  6724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c7f33e544204fbaac4078e3e83bbf4e" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:19:28.529451  6724 raft_consensus.cc:3060] T 8c7f33e544204fbaac4078e3e83bbf4e P ccd8a4c3bfe3413cb2ae219b09aea832 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:19:28.388003  9344 raft_consensus.cc:515] T dbdf895bba214ff68685a24fd17dfb5d P cd75a17ab2604397adab03bb8b5fd75c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:28.533967  9344 leader_election.cc:290] T dbdf895bba214ff68685a24fd17dfb5d P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:19:28.536006  9594 leader_election.cc:290] T 7c44c4849aa54f2b94d1f1bef9ed546f P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:28.536425  6806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e326172347f45e99a0d482b5d8ef768" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:19:28.537151  6806 raft_consensus.cc:2376] T 9e326172347f45e99a0d482b5d8ef768 P b7ab4784c7344b939bc36f639286f377 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 6. Re-sending same reply.
I20260709 13:19:28.491371  9656 raft_consensus.cc:515] T a3022224cc81473690653a83d4e99470 P cd75a17ab2604397adab03bb8b5fd75c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:28.538198  6806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09c2a98de1a4decabd0ff900dd44caa" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:19:28.538815  6806 raft_consensus.cc:3060] T f09c2a98de1a4decabd0ff900dd44caa P b7ab4784c7344b939bc36f639286f377 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:28.417750  9490 raft_consensus.cc:697] T 22ccee1b570c4ad3a57bd7aec085b1b4 P b7ab4784c7344b939bc36f639286f377 [term 6 LEADER]: Becoming Leader. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
I20260709 13:19:28.465076  9541 raft_consensus.cc:515] T 9b3759de40694069b13c0f8bd40e5709 P b7ab4784c7344b939bc36f639286f377 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:28.524185  6731 rpcz_store.cc:276] 0709 13:19:25.796780 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:25.896814 (+100034us) service_pool.cc:224] Handling call
0709 13:19:25.897098 (+   284us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:26.058811 (+161713us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:26.058855 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:26.072429 (+ 13574us) log.cc:844] Serialized 26 byte log entry
0709 13:19:26.420966 (+348537us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:19:26.421028 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:28.435802 (+2014774us) spinlock_profiling.cc:243] Waited 138 ms on lock 0x7b54000997d4. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f9aae01 00007fcc0f9a983e 00007fcc1496e419 00007fcc0dee5bd4 00007fcc0dee5b62 00007fcc0dee5a91 00007fcc0dee5a0c 00007fcc0dee4cc2 00007fcc0dce548c 00007fcc0dce48c6
0709 13:19:28.435879 (+    77us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:28.435965 (+    86us) raft_consensus.cc:1685] finished
0709 13:19:28.435987 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:28.436352 (+   365us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":41817,"raft.queue_time_us":23490,"raft.run_cpu_time_us":170,"raft.run_wall_time_us":6967,"spinlock_wait_cycles":318174976,"thread_start_us":313581,"threads_started":1,"wal-append.queue_time_us":479674,"wal-append.run_cpu_time_us":3494,"wal-append.run_wall_time_us":1379176}
I20260709 13:19:28.540838  9490 consensus_queue.cc:237] T 22ccee1b570c4ad3a57bd7aec085b1b4 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:28.541958  6731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a92dd554674067a83a9cb68c4773f2" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 8 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:19:28.542285  9541 leader_election.cc:290] T 9b3759de40694069b13c0f8bd40e5709 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:28.542829  6731 raft_consensus.cc:2410] T 07a92dd554674067a83a9cb68c4773f2 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7ab4784c7344b939bc36f639286f377 for term 8 because replica has last-logged OpId of term: 6 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:19:28.485636  9652 raft_consensus.cc:515] T 7ba5dac66ab5497e9e336f2a3c28cda5 P cd75a17ab2604397adab03bb8b5fd75c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:19:28.347210  9660 raft_consensus.cc:493] T e77e330a82df4b43a745d57a68f6f057 P cd75a17ab2604397adab03bb8b5fd75c [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:28.520221  9046 raft_consensus.cc:2804] T de3186201e1a40d0b335eeb8b4e256e0 P b7ab4784c7344b939bc36f639286f377 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:19:28.545255  9046 raft_consensus.cc:493] T de3186201e1a40d0b335eeb8b4e256e0 P b7ab4784c7344b939bc36f639286f377 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:28.545456  9652 leader_election.cc:290] T 7ba5dac66ab5497e9e336f2a3c28cda5 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:19:28.545747  6878 raft_consensus.cc:1240] T 22ccee1b570c4ad3a57bd7aec085b1b4 P cd75a17ab2604397adab03bb8b5fd75c [term 6 FOLLOWER]: Rejecting Update request from peer ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 5. Current term is 6. Ops: []
I20260709 13:19:28.545970  9641 leader_election.cc:290] T f5be3a11b23d4ea9b08300a2789821c7 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:19:28.546522  6878 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53416 (request call id 2401) took 1107 ms. Trace:
I20260709 13:19:28.456844  9628 consensus_queue.cc:237] T b56bf91d90824c959e21e0cee5ba1816 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:28.466459  6732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de3186201e1a40d0b335eeb8b4e256e0" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:19:28.547036  9384 leader_election.cc:290] T 7c44c4849aa54f2b94d1f1bef9ed546f P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 9 election: Requested vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:28.547648  9614 raft_consensus.cc:3055] T 07a92dd554674067a83a9cb68c4773f2 P cd75a17ab2604397adab03bb8b5fd75c [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:19:28.548143  9614 raft_consensus.cc:740] T 07a92dd554674067a83a9cb68c4773f2 P cd75a17ab2604397adab03bb8b5fd75c [term 6 LEADER]: Becoming Follower/Learner. State: Replica: cd75a17ab2604397adab03bb8b5fd75c, State: Running, Role: LEADER
I20260709 13:19:28.548662  6732 raft_consensus.cc:1275] T e77e330a82df4b43a745d57a68f6f057 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 9 FOLLOWER]: Refusing update from remote peer b7ab4784c7344b939bc36f639286f377: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 9 index: 4. (term mismatch)
I20260709 13:19:28.549010  6732 pending_rounds.cc:85] T e77e330a82df4b43a745d57a68f6f057 P ccd8a4c3bfe3413cb2ae219b09aea832: Aborting all ops after (but not including) 3
I20260709 13:19:28.468189  6725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4b8bd455d5a47c18a1380839c6e0d61" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:19:28.461686  9524 consensus_queue.cc:1059] T 3411566abe2d4c9bb4b2adfdd05e6f17 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.032s
I20260709 13:19:28.421132  9596 raft_consensus.cc:740] T 17587d6730594da4a56fa13a353232a1 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 7ba59cc884714e8aa5f3f0ecaed84cbb, State: Running, Role: LEADER
I20260709 13:19:28.473518  7500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f00a2e87e56452083b759f60d461ee3" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:19:28.475376  6726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce4f062dcd314d43a63ca74067cb5ee3" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:19:28.357553  7494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3d8792045a4583ae2e965b1350a5b4" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:19:28.411851  9649 raft_consensus.cc:515] T 95a75bfe094d4bdc963aba3f08dfcd25 P cd75a17ab2604397adab03bb8b5fd75c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:28.404431  9526 consensus_queue.cc:237] T 17587d6730594da4a56fa13a353232a1 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:19:28.458612  9657 raft_consensus.cc:2749] T 34f36d59d88f40fe8a2805e604fc6c0a P ccd8a4c3bfe3413cb2ae219b09aea832 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:19:28.501231  9351 raft_consensus.cc:3060] T 4b8cacb381b746da8d0049b0a83b41dd P cd75a17ab2604397adab03bb8b5fd75c [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:28.465710  9502 raft_consensus.cc:3060] T 4275cf08e63345f993bce8664eada830 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:28.465323  9484 raft_consensus.cc:2804] T 34f36d59d88f40fe8a2805e604fc6c0a P cd75a17ab2604397adab03bb8b5fd75c [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:19:28.483234  7503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe20b4b48823486ca3b9c648db6ce8aa" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:19:28.469048  9531 consensus_queue.cc:1059] T 7c37d41cd9164c15a6826ca62a851a69 P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.018s
I20260709 13:19:28.473589  9613 raft_consensus.cc:493] T c4db81d9d329422bb3b4160ca4ac2d1d P cd75a17ab2604397adab03bb8b5fd75c [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:28.488451  7495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "427c124d773f483294511e80fe340075" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:19:28.468457  9605 raft_consensus.cc:493] T 24ee15416e3145beaa1b8183453729a3 P cd75a17ab2604397adab03bb8b5fd75c [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 7ba59cc884714e8aa5f3f0ecaed84cbb)
I20260709 13:19:28.464564  9630 raft_consensus.cc:2749] T 1528ab62b6fe4e3099d08f141afee116 P cd75a17ab2604397adab03bb8b5fd75c [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:19:28.425408  9515 consensus_queue.cc:1059] T 9e326172347f45e99a0d482b5d8ef768 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.054s
I20260709 13:19:28.473635  9626 raft_consensus.cc:3060] T 30e88460611e47b2ba16a46a30b5f416 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:28.549140  9614 consensus_queue.cc:260] T 07a92dd554674067a83a9cb68c4773f2 P cd75a17ab2604397adab03bb8b5fd75c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:28.606120  9614 raft_consensus.cc:3060] T 07a92dd554674067a83a9cb68c4773f2 P cd75a17ab2604397adab03bb8b5fd75c [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:28.460024  9662 raft_consensus.cc:2804] T 3a485a995abc4807b6e511e45419f737 P cd75a17ab2604397adab03bb8b5fd75c [term 6 FOLLOWER]: Leader election won for term 6
W20260709 13:19:28.499454  7466 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 310334us
I20260709 13:19:28.609620  9450 leader_election.cc:290] T 20f6842e26174571996b8dea4151d4be P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 8 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:28.501250  6876 rpcz_store.cc:276] 0709 13:19:26.176318 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:26.177906 (+  1588us) service_pool.cc:224] Handling call
0709 13:19:26.178233 (+   327us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:26.981715 (+803482us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:28.407547 (+1425832us) spinlock_profiling.cc:243] Waited 803 ms on lock 0x7b540042ac54. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f9aae01 00007fcc0f9a983e 00007fcc1496e419 00007fcc0dee5bd4 00007fcc0dee5b62 00007fcc0dee5a91 00007fcc0dee5a0c 00007fcc0dee4cc2 00007fcc0dce548c 00007fcc0dce48c6
0709 13:19:28.407758 (+   211us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1846289664}
I20260709 13:19:28.511896  6729 raft_consensus.cc:2410] T 7c37d41cd9164c15a6826ca62a851a69 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate b7ab4784c7344b939bc36f639286f377 for term 6 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
W20260709 13:19:28.516403  6695 connection.cc:256] RPC call timeout handler was delayed by -1.3681971990001784s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18560000000000001s for a response
I20260709 13:19:28.611866  6729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17587d6730594da4a56fa13a353232a1" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
W20260709 13:19:28.612337  6695 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:28.524583  6803 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:32976 (request call id 2265) took 2627 ms. Trace:
I20260709 13:19:28.613888  6803 rpcz_store.cc:276] 0709 13:19:25.897564 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:25.955399 (+ 57835us) service_pool.cc:224] Handling call
0709 13:19:25.955827 (+   428us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:26.747804 (+791977us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:28.524322 (+1776518us) spinlock_profiling.cc:243] Waited 637 ms on lock 0x7b5400070b54. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f9aae01 00007fcc0f9a983e 00007fcc1496e419 00007fcc0dee5bd4 00007fcc0dee5b62 00007fcc0dee5a91 00007fcc0dee5a0c 00007fcc0dee4cc2 00007fcc0dce548c 00007fcc0dce48c6
0709 13:19:28.524493 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1465373056}
I20260709 13:19:28.544395  9660 raft_consensus.cc:515] T e77e330a82df4b43a745d57a68f6f057 P cd75a17ab2604397adab03bb8b5fd75c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } }
W20260709 13:19:28.424300  9569 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.671s	user 0.016s	sys 0.004s
I20260709 13:19:28.547868  9384 consensus_queue.cc:1059] T 44bde925b2e541b69890d70715b85176 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:19:28.463451  6877 rpcz_store.cc:276] 0709 13:19:27.072990 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:28.336973 (+1263983us) service_pool.cc:224] Handling call
0709 13:19:28.349304 (+ 12331us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:28.390233 (+ 40929us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:28.390267 (+    34us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:28.390311 (+    44us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:19:28.390345 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:28.390408 (+    63us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:28.390535 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":32315,"raft.run_cpu_time_us":121,"raft.run_wall_time_us":1769}
I20260709 13:19:28.549263  6732 pending_rounds.cc:107] T e77e330a82df4b43a745d57a68f6f057 P ccd8a4c3bfe3413cb2ae219b09aea832: Aborting uncommitted NO_OP operation due to leader change: 8.4
I20260709 13:19:28.619069  6732 raft_consensus.cc:2889] T e77e330a82df4b43a745d57a68f6f057 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:19:28.619207  6803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90d42e216d9741e190bca19a781291fd" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:19:28.462749  6844 leader_election.cc:304] T 20f6842e26174571996b8dea4151d4be P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:19:28.546885  6878 rpcz_store.cc:276] 0709 13:19:27.439062 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:28.545276 (+1106214us) service_pool.cc:224] Handling call
0709 13:19:28.545578 (+   302us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:28.546259 (+   681us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:28.546462 (+   203us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:19:28.620805  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 158152us
I20260709 13:19:28.621397  6878 raft_consensus.cc:1240] T f09c2a98de1a4decabd0ff900dd44caa P cd75a17ab2604397adab03bb8b5fd75c [term 8 FOLLOWER]: Rejecting Update request from peer ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 7. Current term is 8. Ops: []
I20260709 13:19:28.622267  6878 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53416 (request call id 2408) took 1161 ms. Trace:
I20260709 13:19:28.622649  6878 rpcz_store.cc:276] 0709 13:19:27.460503 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:28.620761 (+1160258us) service_pool.cc:224] Handling call
0709 13:19:28.621155 (+   394us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:28.621964 (+   809us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:28.622200 (+   236us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:28.523594  6872 rpcz_store.cc:276] 0709 13:19:27.235740 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:28.522349 (+1286609us) service_pool.cc:224] Handling call
0709 13:19:28.522682 (+   333us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:28.522892 (+   210us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:28.522927 (+    35us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:28.522970 (+    43us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:19:28.523005 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:28.523057 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:28.523144 (+    87us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:28.527943  7502 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50742 (request call id 331) took 1721 ms. Trace:
I20260709 13:19:28.549702  6725 raft_consensus.cc:2468] T f4b8bd455d5a47c18a1380839c6e0d61 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 6.
I20260709 13:19:28.523699  6805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3411566abe2d4c9bb4b2adfdd05e6f17" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:19:28.442746  9645 raft_consensus.cc:515] T d8cee0accdb8499c86d4414b72565a38 P b7ab4784c7344b939bc36f639286f377 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:19:28.554136  6880 raft_consensus.cc:2468] T ce4f062dcd314d43a63ca74067cb5ee3 P cd75a17ab2604397adab03bb8b5fd75c [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 7.
W20260709 13:19:28.556078  6798 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:32976 (request call id 2259) took 2713 ms (client timeout 1856 ms). Trace:
I20260709 13:19:28.556264  6804 raft_consensus.cc:1240] T 8c7f33e544204fbaac4078e3e83bbf4e P b7ab4784c7344b939bc36f639286f377 [term 5 FOLLOWER]: Rejecting Update request from peer cd75a17ab2604397adab03bb8b5fd75c for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 13:19:28.545604  9046 raft_consensus.cc:3060] T de3186201e1a40d0b335eeb8b4e256e0 P b7ab4784c7344b939bc36f639286f377 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:19:28.625813  6798 rpcz_store.cc:269] 0709 13:19:25.842356 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:25.843228 (+   872us) service_pool.cc:224] Handling call
0709 13:19:28.555849 (+2712621us) spinlock_profiling.cc:243] Waited 1.07 s on lock 0x7b5400289bd4. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f9ae2fa 00007fcc1496fb17 00007fcc0deea6d4 00007fcc0deea662 00007fcc0deea591 00007fcc0deea50c 00007fcc0dee97c2 00007fcc0dce548c 00007fcc0dce48c6 00007fcc0dce426f
0709 13:19:28.555993 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2454862208}
I20260709 13:19:28.624014  7502 rpcz_store.cc:276] 0709 13:19:26.806605 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:26.806840 (+   235us) service_pool.cc:224] Handling call
0709 13:19:26.813870 (+  7030us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:27.095276 (+281406us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:28.527665 (+1432389us) spinlock_profiling.cc:243] Waited 281 ms on lock 0x7b5400570154. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f9aae01 00007fcc0f9a983e 00007fcc1496e419 00007fcc0dee5bd4 00007fcc0dee5b62 00007fcc0dee5a91 00007fcc0dee5a0c 00007fcc0dee4cc2 00007fcc0dce548c 00007fcc0dce48c6
0709 13:19:28.527850 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":645693824}
I20260709 13:19:28.559217  6731 raft_consensus.cc:1275] T 4d9def8b32fd443aa94ab1420b06837b P ccd8a4c3bfe3413cb2ae219b09aea832 [term 7 FOLLOWER]: Refusing update from remote peer b7ab4784c7344b939bc36f639286f377: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:19:28.560326  6724 raft_consensus.cc:2410] T 8c7f33e544204fbaac4078e3e83bbf4e P ccd8a4c3bfe3413cb2ae219b09aea832 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate b7ab4784c7344b939bc36f639286f377 for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:19:28.550686  6799 raft_consensus.cc:2468] T 9b3759de40694069b13c0f8bd40e5709 P b7ab4784c7344b939bc36f639286f377 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 6.
I20260709 13:19:28.564319  7500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ba5dac66ab5497e9e336f2a3c28cda5" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:19:28.566186  6726 raft_consensus.cc:1275] T 95a75bfe094d4bdc963aba3f08dfcd25 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 8 FOLLOWER]: Refusing update from remote peer b7ab4784c7344b939bc36f639286f377: Log matching property violated. Preceding OpId in replica: term: 7 index: 2. Preceding OpId from leader: term: 8 index: 3. (index mismatch)
I20260709 13:19:28.480746  9259 consensus_queue.cc:1059] T ab432e62819d499eaaf3dd55481dd930 P ccd8a4c3bfe3413cb2ae219b09aea832 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: INVALID_TERM, Last received: 7.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.072s
I20260709 13:19:28.629235  7500 raft_consensus.cc:2393] T 7ba5dac66ab5497e9e336f2a3c28cda5 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c in current term 9: Already voted for candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in this term.
I20260709 13:19:28.515105  9654 consensus_queue.cc:1059] T 711ef6523deb4cbe8ef2ba61e1c21c98 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 1, Time since last communication: 0.070s
I20260709 13:19:28.550246  9656 leader_election.cc:290] T a3022224cc81473690653a83d4e99470 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:19:28.598666  6800 raft_consensus.cc:2468] T f58dc08b12a2494bb9a1372837970ca2 P b7ab4784c7344b939bc36f639286f377 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 9.
I20260709 13:19:28.639477  6800 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:32966 (request call id 809) took 1094 ms. Trace:
W20260709 13:19:28.615167  6697 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 169142us
I20260709 13:19:28.615512  6729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09c2a98de1a4decabd0ff900dd44caa" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:19:28.625524  6876 raft_consensus.cc:1240] T ce4f062dcd314d43a63ca74067cb5ee3 P cd75a17ab2604397adab03bb8b5fd75c [term 7 FOLLOWER]: Rejecting Update request from peer ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 6. Current term is 7. Ops: []
I20260709 13:19:28.425472  9643 raft_consensus.cc:515] T 24ee15416e3145beaa1b8183453729a3 P b7ab4784c7344b939bc36f639286f377 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } attrs { replace: true } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:19:28.600708  9616 raft_consensus.cc:3055] T 7c37d41cd9164c15a6826ca62a851a69 P cd75a17ab2604397adab03bb8b5fd75c [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:19:28.631094  6805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "427c124d773f483294511e80fe340075" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:19:28.568666  9516 consensus_queue.cc:1059] T 22ccee1b570c4ad3a57bd7aec085b1b4 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.045s
I20260709 13:19:28.632218  6878 raft_consensus.cc:1275] T 4d9def8b32fd443aa94ab1420b06837b P cd75a17ab2604397adab03bb8b5fd75c [term 7 FOLLOWER]: Refusing update from remote peer b7ab4784c7344b939bc36f639286f377: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 4. (term mismatch)
I20260709 13:19:28.632676  6880 raft_consensus.cc:1275] T 30e88460611e47b2ba16a46a30b5f416 P cd75a17ab2604397adab03bb8b5fd75c [term 6 FOLLOWER]: Refusing update from remote peer b7ab4784c7344b939bc36f639286f377: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:19:28.652189  6878 pending_rounds.cc:85] T 4d9def8b32fd443aa94ab1420b06837b P cd75a17ab2604397adab03bb8b5fd75c: Aborting all ops after (but not including) 3
I20260709 13:19:28.634233  6803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a734b5ab7834e05a8c422208acc58b1" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:19:28.616822  9662 raft_consensus.cc:697] T 3a485a995abc4807b6e511e45419f737 P cd75a17ab2604397adab03bb8b5fd75c [term 6 LEADER]: Becoming Leader. State: Replica: cd75a17ab2604397adab03bb8b5fd75c, State: Running, Role: LEADER
I20260709 13:19:28.641451  6729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a734b5ab7834e05a8c422208acc58b1" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:19:28.599691  9484 raft_consensus.cc:697] T 34f36d59d88f40fe8a2805e604fc6c0a P cd75a17ab2604397adab03bb8b5fd75c [term 5 LEADER]: Becoming Leader. State: Replica: cd75a17ab2604397adab03bb8b5fd75c, State: Running, Role: LEADER
I20260709 13:19:28.658483  9484 consensus_queue.cc:237] T 34f36d59d88f40fe8a2805e604fc6c0a P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:28.651908  9384 raft_consensus.cc:493] T 1528ab62b6fe4e3099d08f141afee116 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:28.661103  9384 raft_consensus.cc:515] T 1528ab62b6fe4e3099d08f141afee116 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } attrs { replace: true } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:19:28.645506  6877 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53416 (request call id 2403) took 1205 ms. Trace:
I20260709 13:19:28.664103  6877 rpcz_store.cc:276] 0709 13:19:27.439924 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:28.618889 (+1178965us) service_pool.cc:224] Handling call
0709 13:19:28.644758 (+ 25869us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:28.645039 (+   281us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:28.645078 (+    39us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:28.645142 (+    64us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:19:28.645197 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:28.645272 (+    75us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:28.645424 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:28.646893  6697 leader_election.cc:304] T e31b9971c15848dea59d4d4130141d9e P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377
I20260709 13:19:28.648120  6798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f00a2e87e56452083b759f60d461ee3" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:19:28.652657  6878 pending_rounds.cc:107] T 4d9def8b32fd443aa94ab1420b06837b P cd75a17ab2604397adab03bb8b5fd75c: Aborting uncommitted NO_OP operation due to leader change: 6.4
I20260709 13:19:28.666618  6878 raft_consensus.cc:2889] T 4d9def8b32fd443aa94ab1420b06837b P cd75a17ab2604397adab03bb8b5fd75c [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:19:28.653267  6803 raft_consensus.cc:3060] T 7a734b5ab7834e05a8c422208acc58b1 P b7ab4784c7344b939bc36f639286f377 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:28.639897  6800 rpcz_store.cc:276] 0709 13:19:27.545088 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:28.176839 (+631751us) service_pool.cc:224] Handling call
0709 13:19:28.639404 (+462565us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:28.651477  6802 raft_consensus.cc:1240] T 711ef6523deb4cbe8ef2ba61e1c21c98 P b7ab4784c7344b939bc36f639286f377 [term 8 LEADER]: Rejecting Update request from peer ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 7. Current term is 8. Ops: [7.5-7.5]
I20260709 13:19:28.653919  6732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f03d0dbf16864ca4bc1bb5e4c0334c0f" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:19:28.601099  9613 raft_consensus.cc:515] T c4db81d9d329422bb3b4160ca4ac2d1d P cd75a17ab2604397adab03bb8b5fd75c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:28.624359  9666 raft_consensus.cc:493] T 427c124d773f483294511e80fe340075 P b7ab4784c7344b939bc36f639286f377 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 7ba59cc884714e8aa5f3f0ecaed84cbb)
I20260709 13:19:28.656482  9639 raft_consensus.cc:493] T 427c124d773f483294511e80fe340075 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 7ba59cc884714e8aa5f3f0ecaed84cbb)
I20260709 13:19:28.657192  6729 raft_consensus.cc:1275] T d33d5ee8ef6f415593d8df52063161ad P ccd8a4c3bfe3413cb2ae219b09aea832 [term 8 FOLLOWER]: Refusing update from remote peer b7ab4784c7344b939bc36f639286f377: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:19:28.657378  9649 leader_election.cc:290] T 95a75bfe094d4bdc963aba3f08dfcd25 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:19:28.670249  9670 raft_consensus.cc:3055] T 22ccee1b570c4ad3a57bd7aec085b1b4 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:19:28.673919  6878 raft_consensus.cc:1275] T 713b5728a197487c9300b310ab94e5a3 P cd75a17ab2604397adab03bb8b5fd75c [term 7 FOLLOWER]: Refusing update from remote peer b7ab4784c7344b939bc36f639286f377: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:19:28.675671  9555 raft_consensus.cc:2804] T e31b9971c15848dea59d4d4130141d9e P ccd8a4c3bfe3413cb2ae219b09aea832 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:19:28.631351  9531 raft_consensus.cc:493] T bb7fa124c3bf4ef9ab65a407cb008441 P cd75a17ab2604397adab03bb8b5fd75c [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:19:28.640993  9652 raft_consensus.cc:2749] T 20f6842e26174571996b8dea4151d4be P cd75a17ab2604397adab03bb8b5fd75c [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:19:28.603173  9605 raft_consensus.cc:515] T 24ee15416e3145beaa1b8183453729a3 P cd75a17ab2604397adab03bb8b5fd75c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:19:28.693126  6732 raft_consensus.cc:1275] T 713b5728a197487c9300b310ab94e5a3 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 7 FOLLOWER]: Refusing update from remote peer b7ab4784c7344b939bc36f639286f377: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:19:28.693619  6800 pending_rounds.cc:85] T d8292e16e5654be6bc408560cf256aaa P b7ab4784c7344b939bc36f639286f377: Aborting all ops after (but not including) 2
I20260709 13:19:28.695413  6872 raft_consensus.cc:1275] T e77e330a82df4b43a745d57a68f6f057 P cd75a17ab2604397adab03bb8b5fd75c [term 9 FOLLOWER]: Refusing update from remote peer b7ab4784c7344b939bc36f639286f377: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 9 index: 4. (index mismatch)
I20260709 13:19:28.651625  9616 raft_consensus.cc:740] T 7c37d41cd9164c15a6826ca62a851a69 P cd75a17ab2604397adab03bb8b5fd75c [term 5 LEADER]: Becoming Follower/Learner. State: Replica: cd75a17ab2604397adab03bb8b5fd75c, State: Running, Role: LEADER
I20260709 13:19:28.706813  6800 pending_rounds.cc:107] T d8292e16e5654be6bc408560cf256aaa P b7ab4784c7344b939bc36f639286f377: Aborting uncommitted NO_OP operation due to leader change: 5.3
I20260709 13:19:28.709291  6800 raft_consensus.cc:2889] T d8292e16e5654be6bc408560cf256aaa P b7ab4784c7344b939bc36f639286f377 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:19:28.712393  6732 raft_consensus.cc:1275] T 1528ab62b6fe4e3099d08f141afee116 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 6 FOLLOWER]: Refusing update from remote peer b7ab4784c7344b939bc36f639286f377: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:19:28.708779  9555 raft_consensus.cc:697] T e31b9971c15848dea59d4d4130141d9e P ccd8a4c3bfe3413cb2ae219b09aea832 [term 5 LEADER]: Becoming Leader. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
I20260709 13:19:28.725123  9555 consensus_queue.cc:237] T e31b9971c15848dea59d4d4130141d9e P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:28.690927  9670 raft_consensus.cc:740] T 22ccee1b570c4ad3a57bd7aec085b1b4 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
I20260709 13:19:28.716161  9639 raft_consensus.cc:515] T 427c124d773f483294511e80fe340075 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } attrs { replace: true } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:19:28.708477  9531 raft_consensus.cc:515] T bb7fa124c3bf4ef9ab65a407cb008441 P cd75a17ab2604397adab03bb8b5fd75c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:19:28.722770  9487 raft_consensus.cc:493] T 7887766dc6784fcaa42b35c05fea7a99 P b7ab4784c7344b939bc36f639286f377 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:28.652583  9596 consensus_queue.cc:260] T 17587d6730594da4a56fa13a353232a1 P 7ba59cc884714e8aa5f3f0ecaed84cbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:19:28.729938  6877 pending_rounds.cc:85] T fe20b4b48823486ca3b9c648db6ce8aa P cd75a17ab2604397adab03bb8b5fd75c: Aborting all ops after (but not including) 4
I20260709 13:19:28.788687  6877 pending_rounds.cc:107] T fe20b4b48823486ca3b9c648db6ce8aa P cd75a17ab2604397adab03bb8b5fd75c: Aborting uncommitted NO_OP operation due to leader change: 2.5
I20260709 13:19:28.789058  6877 raft_consensus.cc:2889] T fe20b4b48823486ca3b9c648db6ce8aa P cd75a17ab2604397adab03bb8b5fd75c [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:19:28.703236  9666 raft_consensus.cc:515] T 427c124d773f483294511e80fe340075 P b7ab4784c7344b939bc36f639286f377 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } attrs { replace: true } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:19:28.728240  6803 raft_consensus.cc:2468] T 7a734b5ab7834e05a8c422208acc58b1 P b7ab4784c7344b939bc36f639286f377 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 8.
I20260709 13:19:28.889611  6805 raft_consensus.cc:2468] T 427c124d773f483294511e80fe340075 P b7ab4784c7344b939bc36f639286f377 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 5.
I20260709 13:19:28.763710  6806 raft_consensus.cc:2468] T f09c2a98de1a4decabd0ff900dd44caa P b7ab4784c7344b939bc36f639286f377 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 8.
I20260709 13:19:28.914362  7500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8cee0accdb8499c86d4414b72565a38" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:19:28.932283  7502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb7fa124c3bf4ef9ab65a407cb008441" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
W20260709 13:19:28.929965  6697 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 283171us
I20260709 13:19:28.923869  6803 raft_consensus.cc:1240] T 20f6842e26174571996b8dea4151d4be P b7ab4784c7344b939bc36f639286f377 [term 8 FOLLOWER]: Rejecting Update request from peer ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 7. Current term is 8. Ops: []
I20260709 13:19:28.930900  6880 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53406 (request call id 1603) took 1210 ms. Trace:
W20260709 13:19:28.868974  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 245452us
W20260709 13:19:28.915522  6695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 215076us
I20260709 13:19:28.937157  6803 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:32976 (request call id 2292) took 1928 ms. Trace:
I20260709 13:19:28.940212  6803 rpcz_store.cc:276] 0709 13:19:27.008285 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:28.923091 (+1914806us) service_pool.cc:224] Handling call
0709 13:19:28.923605 (+   514us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:28.936799 (+ 13194us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:28.937097 (+   298us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:28.941632  7503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24ee15416e3145beaa1b8183453729a3" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:19:28.740429  9589 leader_election.cc:290] T f4b8bd455d5a47c18a1380839c6e0d61 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:28.934279  6697 leader_election.cc:304] T fe20b4b48823486ca3b9c648db6ce8aa P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
W20260709 13:19:28.984587  7466 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:28.750181  9596 raft_consensus.cc:3060] T 17587d6730594da4a56fa13a353232a1 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:28.731571  9608 leader_election.cc:290] T 44bde925b2e541b69890d70715b85176 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 8 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
W20260709 13:19:28.989852  6697 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 55634.1us
I20260709 13:19:28.753784  9643 leader_election.cc:290] T 24ee15416e3145beaa1b8183453729a3 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:19:29.004657  6697 leader_election.cc:304] T 713b5728a197487c9300b310ab94e5a3 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:19:28.937397  6880 rpcz_store.cc:276] 0709 13:19:27.720397 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:28.666186 (+945789us) service_pool.cc:224] Handling call
0709 13:19:28.930229 (+264043us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:28.930493 (+   264us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:28.930529 (+    36us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:28.930590 (+    61us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:19:28.930637 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:28.930714 (+    77us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:28.930835 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:29.005535  6803 raft_consensus.cc:1275] T 7c44c4849aa54f2b94d1f1bef9ed546f P b7ab4784c7344b939bc36f639286f377 [term 8 FOLLOWER]: Refusing update from remote peer cd75a17ab2604397adab03bb8b5fd75c: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:19:29.012121  6803 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:32966 (request call id 803) took 1469 ms. Trace:
I20260709 13:19:28.827677  9613 leader_election.cc:290] T c4db81d9d329422bb3b4160ca4ac2d1d P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:19:29.012511  6803 rpcz_store.cc:276] 0709 13:19:27.543096 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:29.000556 (+1457460us) service_pool.cc:224] Handling call
0709 13:19:29.001102 (+   546us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:29.011834 (+ 10732us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:29.012063 (+   229us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:29.011016  6697 leader_election.cc:304] T f3f9c2e2bf644115957398fe4c9459db P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:19:28.936138  9588 raft_consensus.cc:493] T 404190ce4ce94cecbfcb6ea9d1dd8626 P b7ab4784c7344b939bc36f639286f377 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:28.826829  9651 raft_consensus.cc:515] T d8292e16e5654be6bc408560cf256aaa P cd75a17ab2604397adab03bb8b5fd75c [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:28.753348  9502 raft_consensus.cc:515] T 4275cf08e63345f993bce8664eada830 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:29.018024  9669 raft_consensus.cc:2804] T 713b5728a197487c9300b310ab94e5a3 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:19:29.025084  9669 raft_consensus.cc:493] T 713b5728a197487c9300b310ab94e5a3 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:28.754160  9645 leader_election.cc:290] T d8cee0accdb8499c86d4414b72565a38 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:19:29.025573  9669 raft_consensus.cc:3060] T 713b5728a197487c9300b310ab94e5a3 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:29.025964  9588 raft_consensus.cc:515] T 404190ce4ce94cecbfcb6ea9d1dd8626 P b7ab4784c7344b939bc36f639286f377 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:19:28.739298  9531 leader_election.cc:290] T bb7fa124c3bf4ef9ab65a407cb008441 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
W20260709 13:19:29.028112  7469 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:28.758073  9626 raft_consensus.cc:515] T 30e88460611e47b2ba16a46a30b5f416 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:29.071081  6730 raft_consensus.cc:1240] T 30e88460611e47b2ba16a46a30b5f416 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 7 FOLLOWER]: Rejecting Update request from peer b7ab4784c7344b939bc36f639286f377 for earlier term 6. Current term is 7. Ops: []
I20260709 13:19:28.885298  9605 leader_election.cc:290] T 24ee15416e3145beaa1b8183453729a3 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
W20260709 13:19:29.015360  6772 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 80378.1us
W20260709 13:19:29.055868  6697 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 44910.9us
I20260709 13:19:28.759524  9487 raft_consensus.cc:515] T 7887766dc6784fcaa42b35c05fea7a99 P b7ab4784c7344b939bc36f639286f377 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:28.759357  9351 raft_consensus.cc:515] T 4b8cacb381b746da8d0049b0a83b41dd P cd75a17ab2604397adab03bb8b5fd75c [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:19:29.012935  7495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24ee15416e3145beaa1b8183453729a3" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:19:28.825613  9670 consensus_queue.cc:260] T 22ccee1b570c4ad3a57bd7aec085b1b4 P ccd8a4c3bfe3413cb2ae219b09aea832 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:29.147159  6803 raft_consensus.cc:1275] T 4275cf08e63345f993bce8664eada830 P b7ab4784c7344b939bc36f639286f377 [term 7 FOLLOWER]: Refusing update from remote peer cd75a17ab2604397adab03bb8b5fd75c: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:19:29.150911  6803 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:32966 (request call id 804) took 1607 ms. Trace:
I20260709 13:19:29.151310  6803 rpcz_store.cc:276] 0709 13:19:27.543461 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:29.146165 (+1602704us) service_pool.cc:224] Handling call
0709 13:19:29.146669 (+   504us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:29.150621 (+  3952us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:29.150850 (+   229us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:29.007812  9657 raft_consensus.cc:2804] T fe20b4b48823486ca3b9c648db6ce8aa P ccd8a4c3bfe3413cb2ae219b09aea832 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:19:29.009083  9486 raft_consensus.cc:493] T 3d65025eea89441290d85dd053810e31 P cd75a17ab2604397adab03bb8b5fd75c [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
W20260709 13:19:29.148309  7466 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 65845.4us
I20260709 13:19:28.784668  9616 consensus_queue.cc:260] T 7c37d41cd9164c15a6826ca62a851a69 P cd75a17ab2604397adab03bb8b5fd75c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:28.749603  9663 raft_consensus.cc:515] T 2c240553ce044eedb41541d72b9475d7 P b7ab4784c7344b939bc36f639286f377 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:29.134248  9564 raft_consensus.cc:3055] T 853ac0a8cbd64ce99457f170216d4d0f P b7ab4784c7344b939bc36f639286f377 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:19:29.072543  9626 leader_election.cc:290] T 30e88460611e47b2ba16a46a30b5f416 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 7 election: Requested vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:29.173480  9502 leader_election.cc:290] T 4275cf08e63345f993bce8664eada830 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 8 election: Requested vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:29.072702  9639 leader_election.cc:290] T 427c124d773f483294511e80fe340075 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:19:29.139808  9654 raft_consensus.cc:2804] T f3f9c2e2bf644115957398fe4c9459db P ccd8a4c3bfe3413cb2ae219b09aea832 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:19:29.153633  9657 raft_consensus.cc:493] T fe20b4b48823486ca3b9c648db6ce8aa P ccd8a4c3bfe3413cb2ae219b09aea832 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 7ba59cc884714e8aa5f3f0ecaed84cbb)
I20260709 13:19:29.097162  9586 raft_consensus.cc:493] T bb7fa124c3bf4ef9ab65a407cb008441 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:19:29.198478  6806 raft_consensus.cc:1240] T 2c240553ce044eedb41541d72b9475d7 P b7ab4784c7344b939bc36f639286f377 [term 9 FOLLOWER]: Rejecting Update request from peer ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 8. Current term is 9. Ops: []
I20260709 13:19:29.169955  9384 leader_election.cc:290] T 1528ab62b6fe4e3099d08f141afee116 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:19:28.752133  9662 consensus_queue.cc:237] T 3a485a995abc4807b6e511e45419f737 P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:29.190960  9564 raft_consensus.cc:740] T 853ac0a8cbd64ce99457f170216d4d0f P b7ab4784c7344b939bc36f639286f377 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
I20260709 13:19:29.192306  9654 raft_consensus.cc:493] T f3f9c2e2bf644115957398fe4c9459db P ccd8a4c3bfe3413cb2ae219b09aea832 [term 6 FOLLOWER]: Starting leader election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:19:29.198451  9657 raft_consensus.cc:3060] T fe20b4b48823486ca3b9c648db6ce8aa P ccd8a4c3bfe3413cb2ae219b09aea832 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:29.165172  9486 raft_consensus.cc:515] T 3d65025eea89441290d85dd053810e31 P cd75a17ab2604397adab03bb8b5fd75c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
W20260709 13:19:29.207423  9658 consensus_meta.cc:287] T 4b8cacb381b746da8d0049b0a83b41dd P 7ba59cc884714e8aa5f3f0ecaed84cbb: Time spent flushing consensus metadata: real 0.679s	user 0.010s	sys 0.004s
I20260709 13:19:29.218992  6800 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:32976 (request call id 2289) took 2211 ms. Trace:
I20260709 13:19:29.221028  9273 leader_election.cc:290] T e31b9971c15848dea59d4d4130141d9e P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:19:29.221633  9666 leader_election.cc:290] T 427c124d773f483294511e80fe340075 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:19:29.222726  6873 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53406 (request call id 1581) took 2152 ms. Trace:
I20260709 13:19:29.228646  6873 rpcz_store.cc:276] 0709 13:19:27.070592 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:27.070722 (+   130us) service_pool.cc:224] Handling call
0709 13:19:27.103045 (+ 32323us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:27.107695 (+  4650us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:29.222435 (+2114740us) spinlock_profiling.cc:243] Waited 7.81 ms on lock 0x7b5400065250. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f9a98ad 00007fcc1496e419 00007fcc0dee5bd4 00007fcc0dee5b62 00007fcc0dee5a91 00007fcc0dee5a0c 00007fcc0dee4cc2 00007fcc0dce548c 00007fcc0dce48c6 00007fcc0dce426f
0709 13:19:29.222636 (+   201us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":17969536}
W20260709 13:19:29.223143  9581 consensus_meta.cc:287] T e31b9971c15848dea59d4d4130141d9e P b7ab4784c7344b939bc36f639286f377: Time spent flushing consensus metadata: real 0.714s	user 0.008s	sys 0.003s
I20260709 13:19:29.223623  9351 leader_election.cc:290] T 4b8cacb381b746da8d0049b0a83b41dd P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 8 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:19:29.216444  9654 raft_consensus.cc:3060] T f3f9c2e2bf644115957398fe4c9459db P ccd8a4c3bfe3413cb2ae219b09aea832 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:29.225185  7495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b8cacb381b746da8d0049b0a83b41dd" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb"
I20260709 13:19:29.222754  9487 leader_election.cc:290] T 7887766dc6784fcaa42b35c05fea7a99 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:29.226585  6800 rpcz_store.cc:276] 0709 13:19:27.007333 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:28.692817 (+1685484us) service_pool.cc:224] Handling call
0709 13:19:28.693289 (+   472us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 13:19:28.738046 (+ 44757us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:28.738099 (+    53us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 13:19:28.762165 (+ 24066us) log.cc:844] Serialized 78 byte log entry
0709 13:19:28.937622 (+175457us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:19:28.937664 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:28.937740 (+    76us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:29.218766 (+281026us) raft_consensus.cc:1685] finished
0709 13:19:29.218786 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:29.218937 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":4725,"raft.run_cpu_time_us":172,"raft.run_wall_time_us":12353,"thread_start_us":174983,"threads_started":1,"wal-append.queue_time_us":425222}
W20260709 13:19:29.241425  6773 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:29.212137  9670 raft_consensus.cc:3060] T 22ccee1b570c4ad3a57bd7aec085b1b4 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:19:29.242439  9674 log.cc:927] Time spent T ab432e62819d499eaaf3dd55481dd930 P b7ab4784c7344b939bc36f639286f377: Append to log took a long time: real 0.102s	user 0.000s	sys 0.000s
I20260709 13:19:29.239675  9653 raft_consensus.cc:3055] T 9e326172347f45e99a0d482b5d8ef768 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:19:29.243366  9653 raft_consensus.cc:740] T 9e326172347f45e99a0d482b5d8ef768 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
I20260709 13:19:29.244298  9653 consensus_queue.cc:260] T 9e326172347f45e99a0d482b5d8ef768 P ccd8a4c3bfe3413cb2ae219b09aea832 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
W20260709 13:19:29.240409  9681 log.cc:927] Time spent T b56bf91d90824c959e21e0cee5ba1816 P ccd8a4c3bfe3413cb2ae219b09aea832: Append to log took a long time: real 0.051s	user 0.001s	sys 0.000s
W20260709 13:19:29.245350  9677 log.cc:927] Time spent T 44bde925b2e541b69890d70715b85176 P ccd8a4c3bfe3413cb2ae219b09aea832: Append to log took a long time: real 0.050s	user 0.000s	sys 0.000s
I20260709 13:19:29.245513  9569 raft_consensus.cc:3055] T 44bde925b2e541b69890d70715b85176 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:19:29.246201  9569 raft_consensus.cc:740] T 44bde925b2e541b69890d70715b85176 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
I20260709 13:19:29.246366  9643 raft_consensus.cc:493] T 90d42e216d9741e190bca19a781291fd P b7ab4784c7344b939bc36f639286f377 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:19:29.247305  9366 leader_election.cc:290] T 4f00a2e87e56452083b759f60d461ee3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:29.247206  9643 raft_consensus.cc:515] T 90d42e216d9741e190bca19a781291fd P b7ab4784c7344b939bc36f639286f377 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:29.249923  9643 leader_election.cc:290] T 90d42e216d9741e190bca19a781291fd P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
W20260709 13:19:29.250097  9682 log.cc:927] Time spent T 853ac0a8cbd64ce99457f170216d4d0f P b7ab4784c7344b939bc36f639286f377: Append to log took a long time: real 0.086s	user 0.000s	sys 0.001s
I20260709 13:19:29.250511  9643 raft_consensus.cc:493] T 34f36d59d88f40fe8a2805e604fc6c0a P b7ab4784c7344b939bc36f639286f377 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:29.251042  9643 raft_consensus.cc:515] T 34f36d59d88f40fe8a2805e604fc6c0a P b7ab4784c7344b939bc36f639286f377 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
W20260709 13:19:29.251883  9612 log.cc:927] Time spent T a1704639a875409b9959353527b3fd68 P ccd8a4c3bfe3413cb2ae219b09aea832: Append to log took a long time: real 2.327s	user 0.012s	sys 0.006s
W20260709 13:19:29.261688  9614 consensus_meta.cc:287] T 07a92dd554674067a83a9cb68c4773f2 P cd75a17ab2604397adab03bb8b5fd75c: Time spent flushing consensus metadata: real 0.655s	user 0.015s	sys 0.000s
I20260709 13:19:29.262192  6723 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50004 (request call id 1498) took 3091 ms. Trace:
I20260709 13:19:29.208711  9626 consensus_queue.cc:1059] T f09c2a98de1a4decabd0ff900dd44caa P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.028s
I20260709 13:19:29.253759  6803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce4f062dcd314d43a63ca74067cb5ee3" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:19:29.247480  9569 consensus_queue.cc:260] T 44bde925b2e541b69890d70715b85176 P ccd8a4c3bfe3413cb2ae219b09aea832 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:29.234112  9658 raft_consensus.cc:515] T 4b8cacb381b746da8d0049b0a83b41dd P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:19:29.260562  6800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ba5dac66ab5497e9e336f2a3c28cda5" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:19:29.265924  9663 leader_election.cc:290] T 2c240553ce044eedb41541d72b9475d7 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 9 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:29.268805  6803 raft_consensus.cc:2393] T ce4f062dcd314d43a63ca74067cb5ee3 P b7ab4784c7344b939bc36f639286f377 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in current term 7: Already voted for candidate b7ab4784c7344b939bc36f639286f377 in this term.
I20260709 13:19:29.262642  6723 rpcz_store.cc:276] 0709 13:19:26.170371 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:26.182955 (+ 12584us) service_pool.cc:224] Handling call
0709 13:19:26.183261 (+   306us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:26.187313 (+  4052us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:26.187340 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:26.196138 (+  8798us) log.cc:844] Serialized 26 byte log entry
0709 13:19:26.763732 (+567594us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:19:26.763785 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:26.763873 (+    88us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:29.251193 (+2487320us) spinlock_profiling.cc:243] Waited 2.43 ms on lock 0x7b4400022b4c. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0c745db1 00007fcc0c7e3c85 00007fcc0c7e46a2 00007fcc0f5561db 00007fcc0f551aaf 00007fcc0f54586e 00007fcc0f544bb6 00007fcc0f5447d8 00007fcc0f54e221 00007fcc0f54e1d9 00007fcc0f54e169
0709 13:19:29.261891 (+ 10698us) raft_consensus.cc:1685] finished
0709 13:19:29.261916 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:29.262138 (+   222us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3701,"raft.queue_time_us":4218,"raft.run_cpu_time_us":188,"raft.run_wall_time_us":13980,"spinlock_wait_cycles":5586176,"thread_start_us":293723,"threads_started":1,"wal-append.queue_time_us":596269}
I20260709 13:19:29.277218  6729 raft_consensus.cc:1240] T e31b9971c15848dea59d4d4130141d9e P ccd8a4c3bfe3413cb2ae219b09aea832 [term 5 LEADER]: Rejecting Update request from peer b7ab4784c7344b939bc36f639286f377 for earlier term 4. Current term is 5. Ops: []
I20260709 13:19:29.277707  6803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1528ab62b6fe4e3099d08f141afee116" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:19:29.281883  6803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be1a92657f494cac8dd227d152f50151" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:19:29.204238  9586 raft_consensus.cc:515] T bb7fa124c3bf4ef9ab65a407cb008441 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:19:29.264127  9588 leader_election.cc:290] T 404190ce4ce94cecbfcb6ea9d1dd8626 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:19:29.283397  6803 raft_consensus.cc:2468] T be1a92657f494cac8dd227d152f50151 P b7ab4784c7344b939bc36f639286f377 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in term 8.
I20260709 13:19:29.291991  7502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "427c124d773f483294511e80fe340075" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:19:29.292477  7466 leader_election.cc:304] T be1a92657f494cac8dd227d152f50151 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, b7ab4784c7344b939bc36f639286f377; no voters: 
I20260709 13:19:29.277560  9569 raft_consensus.cc:3060] T 44bde925b2e541b69890d70715b85176 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:29.299547  6803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f00a2e87e56452083b759f60d461ee3" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:19:29.302675  6803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "404190ce4ce94cecbfcb6ea9d1dd8626" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:19:29.303957  6803 raft_consensus.cc:3060] T 404190ce4ce94cecbfcb6ea9d1dd8626 P b7ab4784c7344b939bc36f639286f377 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:19:29.303160  9627 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.925s	user 0.007s	sys 0.011s
I20260709 13:19:29.305315  7494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "404190ce4ce94cecbfcb6ea9d1dd8626" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:19:29.305922  7495 raft_consensus.cc:2393] T 4b8cacb381b746da8d0049b0a83b41dd P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c in current term 8: Already voted for candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in this term.
I20260709 13:19:29.306244  7494 raft_consensus.cc:2393] T 404190ce4ce94cecbfcb6ea9d1dd8626 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7ab4784c7344b939bc36f639286f377 in current term 9: Already voted for candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in this term.
W20260709 13:19:29.305277  9627 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.927s	user 0.007s	sys 0.011s
I20260709 13:19:29.298947  9603 raft_consensus.cc:2804] T be1a92657f494cac8dd227d152f50151 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:19:29.309698  9603 raft_consensus.cc:493] T be1a92657f494cac8dd227d152f50151 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:29.309942  7494 raft_consensus.cc:1275] T 1528ab62b6fe4e3099d08f141afee116 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 6 FOLLOWER]: Refusing update from remote peer b7ab4784c7344b939bc36f639286f377: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:19:29.310175  9603 raft_consensus.cc:3060] T be1a92657f494cac8dd227d152f50151 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:29.314213  9588 consensus_queue.cc:1048] T 1528ab62b6fe4e3099d08f141afee116 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:19:29.320878  6803 raft_consensus.cc:2468] T 404190ce4ce94cecbfcb6ea9d1dd8626 P b7ab4784c7344b939bc36f639286f377 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in term 9.
I20260709 13:19:29.325110  7466 leader_election.cc:304] T 404190ce4ce94cecbfcb6ea9d1dd8626 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, b7ab4784c7344b939bc36f639286f377; no voters: 
I20260709 13:19:29.327770  9366 raft_consensus.cc:2804] T 404190ce4ce94cecbfcb6ea9d1dd8626 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:19:29.328512  9366 raft_consensus.cc:697] T 404190ce4ce94cecbfcb6ea9d1dd8626 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 9 LEADER]: Becoming Leader. State: Replica: 7ba59cc884714e8aa5f3f0ecaed84cbb, State: Running, Role: LEADER
I20260709 13:19:29.329555  9643 leader_election.cc:290] T 34f36d59d88f40fe8a2805e604fc6c0a P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:29.329702  9366 consensus_queue.cc:237] T 404190ce4ce94cecbfcb6ea9d1dd8626 P 7ba59cc884714e8aa5f3f0ecaed84cbb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:19:29.331629  9486 leader_election.cc:290] T 3d65025eea89441290d85dd053810e31 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:19:29.334252  9658 leader_election.cc:290] T 4b8cacb381b746da8d0049b0a83b41dd P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 8 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:29.278921  9564 consensus_queue.cc:260] T 853ac0a8cbd64ce99457f170216d4d0f P b7ab4784c7344b939bc36f639286f377 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:29.338407  9568 leader_election.cc:290] T de3186201e1a40d0b335eeb8b4e256e0 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
W20260709 13:19:29.344276  9046 consensus_meta.cc:287] T de3186201e1a40d0b335eeb8b4e256e0 P b7ab4784c7344b939bc36f639286f377: Time spent flushing consensus metadata: real 0.702s	user 0.013s	sys 0.001s
W20260709 13:19:29.346014  6801 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:32966 (request call id 808) took 1801 ms (client timeout 1629 ms). Trace:
W20260709 13:19:29.346642  6801 rpcz_store.cc:269] 0709 13:19:27.544756 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:29.345728 (+1800972us) service_pool.cc:211] Skipping call since client already timed out
0709 13:19:29.345905 (+   177us) inbound_call.cc:177] Queueing failure response
Metrics: {}
I20260709 13:19:29.357714  9515 raft_consensus.cc:3055] T f09c2a98de1a4decabd0ff900dd44caa P ccd8a4c3bfe3413cb2ae219b09aea832 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:19:29.358362  9515 raft_consensus.cc:740] T f09c2a98de1a4decabd0ff900dd44caa P ccd8a4c3bfe3413cb2ae219b09aea832 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
I20260709 13:19:29.367329  9651 leader_election.cc:290] T d8292e16e5654be6bc408560cf256aaa P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 9 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:19:29.368996  9517 raft_consensus.cc:3055] T ce4f062dcd314d43a63ca74067cb5ee3 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:19:29.369501  9517 raft_consensus.cc:740] T ce4f062dcd314d43a63ca74067cb5ee3 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
I20260709 13:19:29.370489  9517 consensus_queue.cc:260] T ce4f062dcd314d43a63ca74067cb5ee3 P ccd8a4c3bfe3413cb2ae219b09aea832 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } attrs { replace: true } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:19:29.372061  9517 raft_consensus.cc:3060] T ce4f062dcd314d43a63ca74067cb5ee3 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:29.375295  6876 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53416 (request call id 2402) took 1935 ms. Trace:
I20260709 13:19:29.375856  6876 rpcz_store.cc:276] 0709 13:19:27.439479 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:28.610700 (+1171221us) service_pool.cc:224] Handling call
0709 13:19:28.625339 (+ 14639us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:28.640611 (+ 15272us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:29.375013 (+734402us) spinlock_profiling.cc:243] Waited 14.3 ms on lock 0x7b54002189d0. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f9a98ad 00007fcc1496e419 00007fcc0dee5bd4 00007fcc0dee5b62 00007fcc0dee5a91 00007fcc0dee5a0c 00007fcc0dee4cc2 00007fcc0dce548c 00007fcc0dce48c6 00007fcc0dce426f
0709 13:19:29.375207 (+   194us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":32927104}
I20260709 13:19:29.381671  9489 raft_consensus.cc:3060] T ab432e62819d499eaaf3dd55481dd930 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:29.384299  6723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24ee15416e3145beaa1b8183453729a3" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:19:29.384928  6723 raft_consensus.cc:1813] T 24ee15416e3145beaa1b8183453729a3 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 7 FOLLOWER]: Handling vote request from an unknown peer b7ab4784c7344b939bc36f639286f377
I20260709 13:19:29.385387  6723 raft_consensus.cc:2393] T 24ee15416e3145beaa1b8183453729a3 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7ab4784c7344b939bc36f639286f377 in current term 7: Already voted for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in this term.
I20260709 13:19:29.386611  6802 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:32976 (request call id 2287) took 2457 ms. Trace:
I20260709 13:19:29.387019  6802 rpcz_store.cc:276] 0709 13:19:26.928998 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:27.524431 (+595433us) service_pool.cc:224] Handling call
0709 13:19:27.524688 (+   257us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:28.670104 (+1145416us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:29.386333 (+716229us) spinlock_profiling.cc:243] Waited 1.13 s on lock 0x7b54001b67d4. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f9aae01 00007fcc0f9a983e 00007fcc1496e419 00007fcc0dee5bd4 00007fcc0dee5b62 00007fcc0dee5a91 00007fcc0dee5a0c 00007fcc0dee4cc2 00007fcc0dce548c 00007fcc0dce48c6
0709 13:19:29.386552 (+   219us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2590466304}
I20260709 13:19:29.387482  9669 raft_consensus.cc:515] T 713b5728a197487c9300b310ab94e5a3 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:29.389240  6804 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:32966 (request call id 800) took 3442 ms. Trace:
I20260709 13:19:29.389667  6804 rpcz_store.cc:276] 0709 13:19:25.946687 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:27.130977 (+1184290us) service_pool.cc:224] Handling call
0709 13:19:28.555990 (+1425013us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:28.625947 (+ 69957us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:29.389047 (+763100us) spinlock_profiling.cc:243] Waited 1.42 s on lock 0x7b5400289bd0. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f9a98ad 00007fcc1496e419 00007fcc0dee5bd4 00007fcc0dee5b62 00007fcc0dee5a91 00007fcc0dee5a0c 00007fcc0dee4cc2 00007fcc0dce548c 00007fcc0dce48c6 00007fcc0dce426f
0709 13:19:29.389176 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3270503680}
I20260709 13:19:29.345058  9046 raft_consensus.cc:515] T de3186201e1a40d0b335eeb8b4e256e0 P b7ab4784c7344b939bc36f639286f377 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:29.397156  6772 leader_election.cc:304] T ce4f062dcd314d43a63ca74067cb5ee3 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:19:29.398180  9046 leader_election.cc:290] T de3186201e1a40d0b335eeb8b4e256e0 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 8 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:29.398934  9046 consensus_queue.cc:1059] T a1704639a875409b9959353527b3fd68 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:19:29.397156  6798 raft_consensus.cc:1240] T de3186201e1a40d0b335eeb8b4e256e0 P b7ab4784c7344b939bc36f639286f377 [term 8 FOLLOWER]: Rejecting Update request from peer ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 7. Current term is 8. Ops: []
I20260709 13:19:29.399806  9666 raft_consensus.cc:2804] T ce4f062dcd314d43a63ca74067cb5ee3 P b7ab4784c7344b939bc36f639286f377 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:19:29.401057  9666 raft_consensus.cc:697] T ce4f062dcd314d43a63ca74067cb5ee3 P b7ab4784c7344b939bc36f639286f377 [term 7 LEADER]: Becoming Leader. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
I20260709 13:19:29.402083  9666 consensus_queue.cc:237] T ce4f062dcd314d43a63ca74067cb5ee3 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 7, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } attrs { replace: true } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:19:29.403803  6726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b3759de40694069b13c0f8bd40e5709" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:19:29.405273  9582 consensus_queue.cc:1048] T 30e88460611e47b2ba16a46a30b5f416 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:19:29.407668  6725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c44c4849aa54f2b94d1f1bef9ed546f" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:19:29.408699  6725 raft_consensus.cc:2393] T 7c44c4849aa54f2b94d1f1bef9ed546f P ccd8a4c3bfe3413cb2ae219b09aea832 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7ab4784c7344b939bc36f639286f377 in current term 9: Already voted for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in this term.
I20260709 13:19:29.411756  9660 leader_election.cc:290] T e77e330a82df4b43a745d57a68f6f057 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391)
W20260709 13:19:29.415055  9659 log.cc:927] Time spent T 7c37d41cd9164c15a6826ca62a851a69 P cd75a17ab2604397adab03bb8b5fd75c: Append to log took a long time: real 1.562s	user 0.006s	sys 0.013s
I20260709 13:19:29.415935  6724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "404190ce4ce94cecbfcb6ea9d1dd8626" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:19:29.418704  6724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "427c124d773f483294511e80fe340075" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:19:29.419302  6724 raft_consensus.cc:2468] T 427c124d773f483294511e80fe340075 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 5.
I20260709 13:19:29.420979  9561 raft_consensus.cc:493] T 3a485a995abc4807b6e511e45419f737 P b7ab4784c7344b939bc36f639286f377 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:29.421480  9561 raft_consensus.cc:515] T 3a485a995abc4807b6e511e45419f737 P b7ab4784c7344b939bc36f639286f377 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:29.421926  9517 raft_consensus.cc:493] T 853ac0a8cbd64ce99457f170216d4d0f P ccd8a4c3bfe3413cb2ae219b09aea832 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:19:29.422616  9517 raft_consensus.cc:515] T 853ac0a8cbd64ce99457f170216d4d0f P ccd8a4c3bfe3413cb2ae219b09aea832 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:29.423491  9561 leader_election.cc:290] T 3a485a995abc4807b6e511e45419f737 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:29.424160  9450 raft_consensus.cc:493] T 44bde925b2e541b69890d70715b85176 P b7ab4784c7344b939bc36f639286f377 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:29.424633  9450 raft_consensus.cc:515] T 44bde925b2e541b69890d70715b85176 P b7ab4784c7344b939bc36f639286f377 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
W20260709 13:19:29.425483  6807 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:32966 (request call id 806) took 1881 ms (client timeout 1686 ms). Trace:
I20260709 13:19:29.425833  9517 leader_election.cc:290] T 853ac0a8cbd64ce99457f170216d4d0f P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:29.426606  9450 leader_election.cc:290] T 44bde925b2e541b69890d70715b85176 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:29.427136  9450 raft_consensus.cc:493] T bd6869f07b5a4885a0b99fbe60c3b175 P b7ab4784c7344b939bc36f639286f377 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:29.425860  6807 rpcz_store.cc:269] 0709 13:19:27.544139 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:29.425261 (+1881122us) service_pool.cc:211] Skipping call since client already timed out
0709 13:19:29.425377 (+   116us) inbound_call.cc:177] Queueing failure response
Metrics: {}
I20260709 13:19:29.429006  9517 raft_consensus.cc:493] T 3a485a995abc4807b6e511e45419f737 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:29.429579  9517 raft_consensus.cc:515] T 3a485a995abc4807b6e511e45419f737 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:29.430590  9616 raft_consensus.cc:3060] T 7c37d41cd9164c15a6826ca62a851a69 P cd75a17ab2604397adab03bb8b5fd75c [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:29.431771  9517 leader_election.cc:290] T 3a485a995abc4807b6e511e45419f737 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:29.432729  6732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be1a92657f494cac8dd227d152f50151" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
W20260709 13:19:29.433287  6846 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:29.436785  9516 raft_consensus.cc:3055] T 711ef6523deb4cbe8ef2ba61e1c21c98 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:19:29.437316  9516 raft_consensus.cc:740] T 711ef6523deb4cbe8ef2ba61e1c21c98 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
I20260709 13:19:29.438078  6807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "713b5728a197487c9300b310ab94e5a3" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:19:29.438148  9516 consensus_queue.cc:260] T 711ef6523deb4cbe8ef2ba61e1c21c98 P ccd8a4c3bfe3413cb2ae219b09aea832 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:29.439417  9516 raft_consensus.cc:3060] T 711ef6523deb4cbe8ef2ba61e1c21c98 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:29.439525  6803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4b8bd455d5a47c18a1380839c6e0d61" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:19:29.436844  9669 leader_election.cc:290] T 713b5728a197487c9300b310ab94e5a3 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 8 election: Requested vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:29.441540  6803 raft_consensus.cc:2468] T f4b8bd455d5a47c18a1380839c6e0d61 P b7ab4784c7344b939bc36f639286f377 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 6.
I20260709 13:19:29.442153  6732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1528ab62b6fe4e3099d08f141afee116" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:19:29.442911  6802 raft_consensus.cc:1240] T 404190ce4ce94cecbfcb6ea9d1dd8626 P b7ab4784c7344b939bc36f639286f377 [term 9 FOLLOWER]: Rejecting Update request from peer ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 7. Current term is 9. Ops: []
I20260709 13:19:29.443027  6723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "404190ce4ce94cecbfcb6ea9d1dd8626" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
W20260709 13:19:29.443266  6728 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49998 (request call id 779) took 3649 ms (client timeout 2493 ms). Trace:
W20260709 13:19:29.443706  6728 rpcz_store.cc:269] 0709 13:19:25.794031 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:25.795100 (+  1069us) service_pool.cc:224] Handling call
0709 13:19:29.443007 (+3647907us) spinlock_profiling.cc:243] Waited 640 ms on lock 0x7b540008edd4. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f9ae2fa 00007fcc1496fb17 00007fcc0deea6d4 00007fcc0deea662 00007fcc0deea591 00007fcc0deea50c 00007fcc0dee97c2 00007fcc0dce548c 00007fcc0dce48c6 00007fcc0dce426f
0709 13:19:29.443159 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1472950144}
I20260709 13:19:29.427564  9450 raft_consensus.cc:515] T bd6869f07b5a4885a0b99fbe60c3b175 P b7ab4784c7344b939bc36f639286f377 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:29.444453  6804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4db81d9d329422bb3b4160ca4ac2d1d" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:19:29.445036  6728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b8cacb381b746da8d0049b0a83b41dd" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
W20260709 13:19:29.461884  9675 log.cc:927] Time spent T 1bf4668eeb70467fb3dc5a0289233b3c P ccd8a4c3bfe3413cb2ae219b09aea832: Append to log took a long time: real 0.299s	user 0.003s	sys 0.000s
I20260709 13:19:29.462898  6728 raft_consensus.cc:1240] T 17587d6730594da4a56fa13a353232a1 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 9 LEADER]: Rejecting Update request from peer 7ba59cc884714e8aa5f3f0ecaed84cbb for earlier term 8. Current term is 9. Ops: []
I20260709 13:19:29.444981  6724 raft_consensus.cc:1240] T 24ee15416e3145beaa1b8183453729a3 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 7 FOLLOWER]: Rejecting Update request from peer 7ba59cc884714e8aa5f3f0ecaed84cbb for earlier term 6. Current term is 7. Ops: []
I20260709 13:19:29.445111  6807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f9c2e2bf644115957398fe4c9459db" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:19:29.465234  9450 leader_election.cc:290] T bd6869f07b5a4885a0b99fbe60c3b175 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:29.448096  6803 raft_consensus.cc:1240] T f09c2a98de1a4decabd0ff900dd44caa P b7ab4784c7344b939bc36f639286f377 [term 8 FOLLOWER]: Rejecting Update request from peer ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 7. Current term is 8. Ops: []
I20260709 13:19:29.449592  6802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a92dd554674067a83a9cb68c4773f2" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:19:29.467118  6802 raft_consensus.cc:2468] T 07a92dd554674067a83a9cb68c4773f2 P b7ab4784c7344b939bc36f639286f377 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 7.
I20260709 13:19:29.449872  6799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c44c4849aa54f2b94d1f1bef9ed546f" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:19:29.468178  6728 raft_consensus.cc:1240] T 4275cf08e63345f993bce8664eada830 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 8 FOLLOWER]: Rejecting Update request from peer cd75a17ab2604397adab03bb8b5fd75c for earlier term 7. Current term is 8. Ops: [7.4-7.4]
I20260709 13:19:29.450002  6729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30e88460611e47b2ba16a46a30b5f416" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:19:29.469069  6729 raft_consensus.cc:2393] T 30e88460611e47b2ba16a46a30b5f416 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c in current term 7: Already voted for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in this term.
I20260709 13:19:29.469672  6732 raft_consensus.cc:2468] T 1528ab62b6fe4e3099d08f141afee116 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in term 6.
I20260709 13:19:29.450248  9657 raft_consensus.cc:515] T fe20b4b48823486ca3b9c648db6ce8aa P ccd8a4c3bfe3413cb2ae219b09aea832 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:19:29.451977  6730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20f6842e26174571996b8dea4151d4be" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:19:29.470379  9564 raft_consensus.cc:3060] T 853ac0a8cbd64ce99457f170216d4d0f P b7ab4784c7344b939bc36f639286f377 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:19:29.471513  6772 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 68226.8us
I20260709 13:19:29.459465  6726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce4f062dcd314d43a63ca74067cb5ee3" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:19:29.472477  6726 raft_consensus.cc:2468] T ce4f062dcd314d43a63ca74067cb5ee3 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in term 7.
I20260709 13:19:29.468395  6727 raft_consensus.cc:3055] T 3411566abe2d4c9bb4b2adfdd05e6f17 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:19:29.473170  6727 raft_consensus.cc:740] T 3411566abe2d4c9bb4b2adfdd05e6f17 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
I20260709 13:19:29.459824  6725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7887766dc6784fcaa42b35c05fea7a99" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:19:29.468247  6799 raft_consensus.cc:3060] T 7c44c4849aa54f2b94d1f1bef9ed546f P b7ab4784c7344b939bc36f639286f377 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:29.444015  6723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b3759de40694069b13c0f8bd40e5709" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:19:29.476604  6802 raft_consensus.cc:1240] T f58dc08b12a2494bb9a1372837970ca2 P b7ab4784c7344b939bc36f639286f377 [term 9 FOLLOWER]: Rejecting Update request from peer ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 8. Current term is 9. Ops: []
W20260709 13:19:29.477118  6698 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:29.483180  6723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de3186201e1a40d0b335eeb8b4e256e0" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:19:29.486189  6725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90d42e216d9741e190bca19a781291fd" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:19:29.492982  6726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c240553ce044eedb41541d72b9475d7" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:19:29.493470  6730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34f36d59d88f40fe8a2805e604fc6c0a" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:19:29.494781  6730 raft_consensus.cc:2410] T 34f36d59d88f40fe8a2805e604fc6c0a P ccd8a4c3bfe3413cb2ae219b09aea832 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7ab4784c7344b939bc36f639286f377 for term 6 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:19:29.502745  6725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b8cacb381b746da8d0049b0a83b41dd" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
W20260709 13:19:29.503580  6697 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 346932us
I20260709 13:19:29.504443  6803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "427c124d773f483294511e80fe340075" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:19:29.506975  6725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "853ac0a8cbd64ce99457f170216d4d0f" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:19:29.508185  6725 raft_consensus.cc:3060] T 853ac0a8cbd64ce99457f170216d4d0f P ccd8a4c3bfe3413cb2ae219b09aea832 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:19:29.526921  6807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1528ab62b6fe4e3099d08f141afee116" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:19:29.530993  6802 raft_consensus.cc:1275] T 1bf4668eeb70467fb3dc5a0289233b3c P b7ab4784c7344b939bc36f639286f377 [term 7 FOLLOWER]: Refusing update from remote peer ccd8a4c3bfe3413cb2ae219b09aea832: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:19:29.531911  6802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "713b5728a197487c9300b310ab94e5a3" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:19:29.532089  6803 raft_consensus.cc:1240] T 44bde925b2e541b69890d70715b85176 P b7ab4784c7344b939bc36f639286f377 [term 8 FOLLOWER]: Rejecting Update request from peer ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 7. Current term is 8. Ops: [7.5-7.5]
I20260709 13:19:29.533633  6799 raft_consensus.cc:2468] T 7c44c4849aa54f2b94d1f1bef9ed546f P b7ab4784c7344b939bc36f639286f377 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 9.
W20260709 13:19:29.535919  6847 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:29.503845  6727 consensus_queue.cc:260] T 3411566abe2d4c9bb4b2adfdd05e6f17 P ccd8a4c3bfe3413cb2ae219b09aea832 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:29.450757  9534 raft_consensus.cc:3055] T a3022224cc81473690653a83d4e99470 P b7ab4784c7344b939bc36f639286f377 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:19:29.473254  9561 raft_consensus.cc:493] T c4db81d9d329422bb3b4160ca4ac2d1d P b7ab4784c7344b939bc36f639286f377 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:29.359323  9515 consensus_queue.cc:260] T f09c2a98de1a4decabd0ff900dd44caa P ccd8a4c3bfe3413cb2ae219b09aea832 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:29.538259  6805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4275cf08e63345f993bce8664eada830" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:19:29.590102  6805 raft_consensus.cc:3060] T 4275cf08e63345f993bce8664eada830 P b7ab4784c7344b939bc36f639286f377 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:29.538492  6801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c7f33e544204fbaac4078e3e83bbf4e" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:19:29.591286  6801 raft_consensus.cc:2393] T 8c7f33e544204fbaac4078e3e83bbf4e P b7ab4784c7344b939bc36f639286f377 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ccd8a4c3bfe3413cb2ae219b09aea832 in current term 5: Already voted for candidate b7ab4784c7344b939bc36f639286f377 in this term.
I20260709 13:19:29.540096  6726 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9b3759de40694069b13c0f8bd40e5709"
dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
mode: GRACEFUL
new_leader_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
 from {username='slave'} at 127.0.0.1:38536
I20260709 13:19:29.543035  6876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a92dd554674067a83a9cb68c4773f2" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:19:29.547479  6879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c44c4849aa54f2b94d1f1bef9ed546f" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:19:29.592582  6876 raft_consensus.cc:2468] T 07a92dd554674067a83a9cb68c4773f2 P cd75a17ab2604397adab03bb8b5fd75c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 7.
W20260709 13:19:29.552249  6698 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:29.555370  7502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1528ab62b6fe4e3099d08f141afee116" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
W20260709 13:19:29.566164  6695 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:29.594789  6803 raft_consensus.cc:1240] T ce4f062dcd314d43a63ca74067cb5ee3 P b7ab4784c7344b939bc36f639286f377 [term 7 LEADER]: Rejecting Update request from peer ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 6. Current term is 7. Ops: []
I20260709 13:19:29.594790  6876 raft_consensus.cc:1240] T 3411566abe2d4c9bb4b2adfdd05e6f17 P cd75a17ab2604397adab03bb8b5fd75c [term 6 FOLLOWER]: Rejecting Update request from peer ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 5. Current term is 6. Ops: []
I20260709 13:19:29.596406  6872 raft_consensus.cc:1240] T 44bde925b2e541b69890d70715b85176 P cd75a17ab2604397adab03bb8b5fd75c [term 8 FOLLOWER]: Rejecting Update request from peer ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 7. Current term is 8. Ops: []
I20260709 13:19:29.598429  6807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30e88460611e47b2ba16a46a30b5f416" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:19:29.591851  6726 raft_consensus.cc:606] T 9b3759de40694069b13c0f8bd40e5709 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 6 LEADER]: Received request to transfer leadership to TS cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:19:29.601181  6801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a485a995abc4807b6e511e45419f737" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:19:29.602244  6806 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:32976 (request call id 2294) took 2593 ms. Trace:
I20260709 13:19:29.602671  6806 rpcz_store.cc:276] 0709 13:19:27.008826 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:28.928345 (+1919519us) service_pool.cc:224] Handling call
0709 13:19:28.928781 (+   436us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:29.199117 (+270336us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:29.602014 (+402897us) spinlock_profiling.cc:243] Waited 269 ms on lock 0x7b54001f7554. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f9aae01 00007fcc0f9a983e 00007fcc1496e419 00007fcc0dee5bd4 00007fcc0dee5b62 00007fcc0dee5a91 00007fcc0dee5a0c 00007fcc0dee4cc2 00007fcc0dce548c 00007fcc0dce48c6
0709 13:19:29.602184 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":619728768}
I20260709 13:19:29.565653  6725 raft_consensus.cc:2468] T 853ac0a8cbd64ce99457f170216d4d0f P ccd8a4c3bfe3413cb2ae219b09aea832 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 5.
I20260709 13:19:29.582634  6727 raft_consensus.cc:3060] T 3411566abe2d4c9bb4b2adfdd05e6f17 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:29.567593  6799 raft_consensus.cc:1275] T bd6869f07b5a4885a0b99fbe60c3b175 P b7ab4784c7344b939bc36f639286f377 [term 7 FOLLOWER]: Refusing update from remote peer ccd8a4c3bfe3413cb2ae219b09aea832: Log matching property violated. Preceding OpId in replica: term: 5 index: 2. Preceding OpId from leader: term: 7 index: 3. (index mismatch)
I20260709 13:19:29.604857  7503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "427c124d773f483294511e80fe340075" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:19:29.566676  6802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "853ac0a8cbd64ce99457f170216d4d0f" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:19:29.596562  6876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1528ab62b6fe4e3099d08f141afee116" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:19:29.504987  9651 raft_consensus.cc:493] T d8cee0accdb8499c86d4414b72565a38 P cd75a17ab2604397adab03bb8b5fd75c [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:29.561333  9450 consensus_queue.cc:1048] T 4d9def8b32fd443aa94ab1420b06837b P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.025s
I20260709 13:19:29.589133  6729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7887766dc6784fcaa42b35c05fea7a99" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:19:29.604955  6881 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53406 (request call id 1590) took 2531 ms. Trace:
I20260709 13:19:29.612448  6725 raft_consensus.cc:1240] T 7c37d41cd9164c15a6826ca62a851a69 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 6 FOLLOWER]: Rejecting Update request from peer cd75a17ab2604397adab03bb8b5fd75c for earlier term 5. Current term is 6. Ops: []
I20260709 13:19:29.606305  6873 raft_consensus.cc:1240] T 7a734b5ab7834e05a8c422208acc58b1 P cd75a17ab2604397adab03bb8b5fd75c [term 8 FOLLOWER]: Rejecting Update request from peer ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 7. Current term is 8. Ops: []
W20260709 13:19:29.606665  6770 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:29.668464  6770 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:29.670231  6799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d33d5ee8ef6f415593d8df52063161ad" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:19:29.582554  6730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1704639a875409b9959353527b3fd68" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
W20260709 13:19:29.607461  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 71301.1us
I20260709 13:19:29.673203  6844 leader_election.cc:304] T 9e326172347f45e99a0d482b5d8ef768 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:19:29.608246  6877 raft_consensus.cc:1240] T f58dc08b12a2494bb9a1372837970ca2 P cd75a17ab2604397adab03bb8b5fd75c [term 9 FOLLOWER]: Rejecting Update request from peer ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 8. Current term is 9. Ops: []
I20260709 13:19:29.609532  6875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4db81d9d329422bb3b4160ca4ac2d1d" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:19:29.675665  6875 raft_consensus.cc:3060] T c4db81d9d329422bb3b4160ca4ac2d1d P cd75a17ab2604397adab03bb8b5fd75c [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:29.601897  6801 raft_consensus.cc:2468] T 3a485a995abc4807b6e511e45419f737 P b7ab4784c7344b939bc36f639286f377 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 6.
I20260709 13:19:29.677085  6801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5be3a11b23d4ea9b08300a2789821c7" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:19:29.612246  6881 rpcz_store.cc:276] 0709 13:19:27.073256 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:28.397522 (+1324266us) service_pool.cc:224] Handling call
0709 13:19:28.408269 (+ 10747us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:28.552023 (+143754us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:28.552092 (+    69us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:28.552162 (+    70us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:19:28.552214 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:29.604744 (+1052530us) spinlock_profiling.cc:243] Waited 107 ms on lock 0x7b54001e87d4. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f9aae01 00007fcc0f9a983e 00007fcc1496e419 00007fcc0dee5bd4 00007fcc0dee5b62 00007fcc0dee5a91 00007fcc0dee5a0c 00007fcc0dee4cc2 00007fcc0dce548c 00007fcc0dce48c6
0709 13:19:29.604789 (+    45us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:29.604906 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":234,"raft.run_cpu_time_us":141,"raft.run_wall_time_us":7471,"spinlock_wait_cycles":245759232}
I20260709 13:19:29.605996  6876 raft_consensus.cc:2468] T 1528ab62b6fe4e3099d08f141afee116 P cd75a17ab2604397adab03bb8b5fd75c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 6.
I20260709 13:19:29.614382  6874 raft_consensus.cc:1275] T 20f6842e26174571996b8dea4151d4be P cd75a17ab2604397adab03bb8b5fd75c [term 7 FOLLOWER]: Refusing update from remote peer ccd8a4c3bfe3413cb2ae219b09aea832: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
W20260709 13:19:29.615262  6697 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:29.616638  6729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f58dc08b12a2494bb9a1372837970ca2" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:19:29.580509  9582 consensus_queue.cc:1048] T 713b5728a197487c9300b310ab94e5a3 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.043s
I20260709 13:19:29.619334  6728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe20b4b48823486ca3b9c648db6ce8aa" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:19:29.735633  6728 raft_consensus.cc:2393] T fe20b4b48823486ca3b9c648db6ce8aa P ccd8a4c3bfe3413cb2ae219b09aea832 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c in current term 6: Already voted for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in this term.
I20260709 13:19:29.619542  6872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "427c124d773f483294511e80fe340075" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:19:29.560961  9643 raft_consensus.cc:493] T b3f13b31a1f84f0d89d007eadd57924c P b7ab4784c7344b939bc36f639286f377 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 7ba59cc884714e8aa5f3f0ecaed84cbb)
I20260709 13:19:29.454829  9603 raft_consensus.cc:515] T be1a92657f494cac8dd227d152f50151 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:19:29.624861  6726 raft_consensus.cc:1240] T 8c7f33e544204fbaac4078e3e83bbf4e P ccd8a4c3bfe3413cb2ae219b09aea832 [term 5 FOLLOWER]: Rejecting Update request from peer cd75a17ab2604397adab03bb8b5fd75c for earlier term 4. Current term is 5. Ops: []
I20260709 13:19:29.646575  9506 raft_consensus.cc:493] T e77e330a82df4b43a745d57a68f6f057 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:29.766000  6877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20f6842e26174571996b8dea4151d4be" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:19:29.766209  9506 raft_consensus.cc:515] T e77e330a82df4b43a745d57a68f6f057 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } }
I20260709 13:19:29.766760  6877 raft_consensus.cc:3060] T 20f6842e26174571996b8dea4151d4be P cd75a17ab2604397adab03bb8b5fd75c [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:29.768227  7495 raft_consensus.cc:1240] T 4b8cacb381b746da8d0049b0a83b41dd P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 8 FOLLOWER]: Rejecting Update request from peer ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 7. Current term is 8. Ops: []
I20260709 13:19:29.648250  9628 consensus_queue.cc:1059] T 7887766dc6784fcaa42b35c05fea7a99 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: INVALID_TERM, Last received: 6.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:19:29.650166  9669 consensus_queue.cc:1048] T 7a734b5ab7834e05a8c422208acc58b1 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:19:29.651038  9694 consensus_queue.cc:1059] T 20f6842e26174571996b8dea4151d4be P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:19:29.656913  6805 raft_consensus.cc:2468] T 4275cf08e63345f993bce8664eada830 P b7ab4784c7344b939bc36f639286f377 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 8.
I20260709 13:19:29.628482  9657 leader_election.cc:290] T fe20b4b48823486ca3b9c648db6ce8aa P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 6 election: Requested vote from peers cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:19:29.671470  6799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a75bfe094d4bdc963aba3f08dfcd25" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 9 candidate_status { last_received { term: 7 index: 2 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:19:29.560694  9534 raft_consensus.cc:740] T a3022224cc81473690653a83d4e99470 P b7ab4784c7344b939bc36f639286f377 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
I20260709 13:19:29.617331  9608 raft_consensus.cc:493] T 22ccee1b570c4ad3a57bd7aec085b1b4 P cd75a17ab2604397adab03bb8b5fd75c [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:29.619400  9641 raft_consensus.cc:493] T bd6869f07b5a4885a0b99fbe60c3b175 P cd75a17ab2604397adab03bb8b5fd75c [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:29.615483  9515 raft_consensus.cc:3060] T f09c2a98de1a4decabd0ff900dd44caa P ccd8a4c3bfe3413cb2ae219b09aea832 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:19:29.739378  9698 log.cc:927] Time spent T d8292e16e5654be6bc408560cf256aaa P ccd8a4c3bfe3413cb2ae219b09aea832: Append to log took a long time: real 0.061s	user 0.001s	sys 0.001s
W20260709 13:19:29.739529  9702 log.cc:927] Time spent T 1528ab62b6fe4e3099d08f141afee116 P 7ba59cc884714e8aa5f3f0ecaed84cbb: Append to log took a long time: real 0.152s	user 0.001s	sys 0.000s
I20260709 13:19:29.740160  6874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8cee0accdb8499c86d4414b72565a38" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:19:29.616767  9691 consensus_queue.cc:1048] T e77e330a82df4b43a745d57a68f6f057 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.128s
I20260709 13:19:29.741214  9489 raft_consensus.cc:493] T 95a75bfe094d4bdc963aba3f08dfcd25 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:29.597920  9561 raft_consensus.cc:515] T c4db81d9d329422bb3b4160ca4ac2d1d P b7ab4784c7344b939bc36f639286f377 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:29.739562  6873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c37d41cd9164c15a6826ca62a851a69" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:19:29.613425  9649 raft_consensus.cc:493] T 1bf4668eeb70467fb3dc5a0289233b3c P cd75a17ab2604397adab03bb8b5fd75c [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:29.647157  9609 consensus_queue.cc:1059] T f03d0dbf16864ca4bc1bb5e4c0334c0f P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:19:29.768337  9506 leader_election.cc:290] T e77e330a82df4b43a745d57a68f6f057 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
W20260709 13:19:29.663949  6878 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.532s	user 0.000s	sys 0.022s
I20260709 13:19:29.619215  9696 consensus_queue.cc:1048] T bb3d8792045a4583ae2e965b1350a5b4 P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Connected to new peer: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.170s
I20260709 13:19:29.733248  9627 raft_consensus.cc:2804] T 9e326172347f45e99a0d482b5d8ef768 P cd75a17ab2604397adab03bb8b5fd75c [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:19:29.782891  9688 raft_consensus.cc:493] T 3fa34c08b205435dba97346991aa1f92 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 7ba59cc884714e8aa5f3f0ecaed84cbb)
I20260709 13:19:29.782740  9697 raft_consensus.cc:493] T 7c37d41cd9164c15a6826ca62a851a69 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:29.769372  9642 raft_consensus.cc:493] T b3f13b31a1f84f0d89d007eadd57924c P ccd8a4c3bfe3413cb2ae219b09aea832 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 7ba59cc884714e8aa5f3f0ecaed84cbb)
I20260709 13:19:29.770358  9643 raft_consensus.cc:515] T b3f13b31a1f84f0d89d007eadd57924c P b7ab4784c7344b939bc36f639286f377 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
W20260709 13:19:29.826819  6695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 178804us
I20260709 13:19:29.828369  6881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c7f33e544204fbaac4078e3e83bbf4e" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:19:30.084930  6803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb7fa124c3bf4ef9ab65a407cb008441" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:19:29.829222  6876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "713b5728a197487c9300b310ab94e5a3" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
W20260709 13:19:29.831197  7466 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 152257us
I20260709 13:19:29.834395  6875 raft_consensus.cc:2468] T c4db81d9d329422bb3b4160ca4ac2d1d P cd75a17ab2604397adab03bb8b5fd75c [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 8.
I20260709 13:19:29.833809  6844 leader_election.cc:304] T 4f00a2e87e56452083b759f60d461ee3 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, b7ab4784c7344b939bc36f639286f377
W20260709 13:19:29.835001  6697 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.68:45071, user_credentials={real_user=slave}} blocked reactor thread for 93628.9us
I20260709 13:19:29.798934  6877 raft_consensus.cc:2468] T 20f6842e26174571996b8dea4151d4be P cd75a17ab2604397adab03bb8b5fd75c [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 8.
I20260709 13:19:30.005066  6801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbdf895bba214ff68685a24fd17dfb5d" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:19:30.016467  6806 raft_consensus.cc:1275] T be1a92657f494cac8dd227d152f50151 P b7ab4784c7344b939bc36f639286f377 [term 8 FOLLOWER]: Refusing update from remote peer ccd8a4c3bfe3413cb2ae219b09aea832: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:19:29.617147  9651 raft_consensus.cc:515] T d8cee0accdb8499c86d4414b72565a38 P cd75a17ab2604397adab03bb8b5fd75c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:19:30.066010  6798 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:32976 (request call id 2288) took 3065 ms. Trace:
I20260709 13:19:29.828263  7496 raft_consensus.cc:1240] T be1a92657f494cac8dd227d152f50151 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 9 FOLLOWER]: Rejecting Update request from peer ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 8. Current term is 9. Ops: []
W20260709 13:19:30.083058  6878 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.951s	user 0.000s	sys 0.022s
I20260709 13:19:30.084558  6731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3411566abe2d4c9bb4b2adfdd05e6f17" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
W20260709 13:19:30.085008  6770 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 81807.4us
I20260709 13:19:29.770184  9654 raft_consensus.cc:515] T f3f9c2e2bf644115957398fe4c9459db P ccd8a4c3bfe3413cb2ae219b09aea832 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
W20260709 13:19:30.090410  6773 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:30.128345  6798 rpcz_store.cc:276] 0709 13:19:27.000801 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:28.670040 (+1669239us) service_pool.cc:224] Handling call
0709 13:19:28.931409 (+261369us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:29.400895 (+469486us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:30.065791 (+664896us) spinlock_profiling.cc:243] Waited 465 ms on lock 0x7b54001f6154. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f9aae01 00007fcc0f9a983e 00007fcc1496e419 00007fcc0dee5bd4 00007fcc0dee5b62 00007fcc0dee5a91 00007fcc0dee5a0c 00007fcc0dee4cc2 00007fcc0dce548c 00007fcc0dce48c6
0709 13:19:30.065948 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1070626048}
I20260709 13:19:30.129333  6695 leader_election.cc:304] T f4b8bd455d5a47c18a1380839c6e0d61 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:19:30.129904  6876 raft_consensus.cc:3060] T 713b5728a197487c9300b310ab94e5a3 P cd75a17ab2604397adab03bb8b5fd75c [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:30.130740  6801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3022224cc81473690653a83d4e99470" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
W20260709 13:19:30.131343  6846 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:30.131690  6804 raft_consensus.cc:3060] T c4db81d9d329422bb3b4160ca4ac2d1d P b7ab4784c7344b939bc36f639286f377 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:30.128866  6697 leader_election.cc:304] T bb3d8792045a4583ae2e965b1350a5b4 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:19:30.157285  6803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e31b9971c15848dea59d4d4130141d9e" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:19:30.157538  6881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "853ac0a8cbd64ce99457f170216d4d0f" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:19:30.158167  6803 raft_consensus.cc:2468] T e31b9971c15848dea59d4d4130141d9e P b7ab4784c7344b939bc36f639286f377 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 5.
I20260709 13:19:30.158707  6881 raft_consensus.cc:2393] T 853ac0a8cbd64ce99457f170216d4d0f P cd75a17ab2604397adab03bb8b5fd75c [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ccd8a4c3bfe3413cb2ae219b09aea832 in current term 5: Already voted for candidate cd75a17ab2604397adab03bb8b5fd75c in this term.
I20260709 13:19:30.159291  6803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d65025eea89441290d85dd053810e31" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:19:30.160372  6875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "427c124d773f483294511e80fe340075" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:19:30.161051  6875 raft_consensus.cc:2468] T 427c124d773f483294511e80fe340075 P cd75a17ab2604397adab03bb8b5fd75c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 5.
W20260709 13:19:30.164340  6698 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:30.212430  6727 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50004 (request call id 1507) took 1761 ms. Trace:
W20260709 13:19:30.164386  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 331533us
I20260709 13:19:30.213644  6844 leader_election.cc:304] T 7a734b5ab7834e05a8c422208acc58b1 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:19:30.212836  6727 rpcz_store.cc:276] 0709 13:19:28.451289 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:28.451463 (+   174us) service_pool.cc:224] Handling call
0709 13:19:28.451800 (+   337us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:29.468284 (+1016484us) spinlock_profiling.cc:243] Waited 123 ms on lock 0x7b54004b0da0. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f921dc0 00007fcc0f9ac1c0 00007fcc0f9ad231 00007fcc0f9a9d8f 00007fcc0f9a983e 00007fcc1496e419 00007fcc0dee5bd4 00007fcc0dee5b62 00007fcc0dee5a91 00007fcc0dee5a0c
0709 13:19:30.211924 (+743640us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:30.211955 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:30.212001 (+    46us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:19:30.212123 (+   122us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:30.212204 (+    81us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:30.212366 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":454380,"spinlock_wait_cycles":282956032}
I20260709 13:19:30.262854  6803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ba5dac66ab5497e9e336f2a3c28cda5" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:19:30.266891  6727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d9def8b32fd443aa94ab1420b06837b" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:19:30.267656  6727 raft_consensus.cc:2468] T 4d9def8b32fd443aa94ab1420b06837b P ccd8a4c3bfe3413cb2ae219b09aea832 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 7.
I20260709 13:19:30.091012  9696 consensus_queue.cc:1243] T bb3d8792045a4583ae2e965b1350a5b4 P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Peer ccd8a4c3bfe3413cb2ae219b09aea832 log is divergent from this leader: its last log entry 6.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:19:30.270160  6874 raft_consensus.cc:2468] T d8cee0accdb8499c86d4414b72565a38 P cd75a17ab2604397adab03bb8b5fd75c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 6.
W20260709 13:19:30.140213  9698 log.cc:927] Time spent T d8292e16e5654be6bc408560cf256aaa P ccd8a4c3bfe3413cb2ae219b09aea832: Append to log took a long time: real 0.080s	user 0.000s	sys 0.000s
I20260709 13:19:30.072952  9489 raft_consensus.cc:515] T 95a75bfe094d4bdc963aba3f08dfcd25 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
W20260709 13:19:30.280470  6695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 151186us
W20260709 13:19:30.281241  6697 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.68:45071, user_credentials={real_user=slave}} blocked reactor thread for 152468us
I20260709 13:19:30.279881  6806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77e330a82df4b43a745d57a68f6f057" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 10 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:19:30.284495  6877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4275cf08e63345f993bce8664eada830" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:19:29.861156  9641 raft_consensus.cc:515] T bd6869f07b5a4885a0b99fbe60c3b175 P cd75a17ab2604397adab03bb8b5fd75c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:29.912966  9608 raft_consensus.cc:515] T 22ccee1b570c4ad3a57bd7aec085b1b4 P cd75a17ab2604397adab03bb8b5fd75c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:30.281571  9506 raft_consensus.cc:2804] T f4b8bd455d5a47c18a1380839c6e0d61 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:19:30.281736  9502 raft_consensus.cc:2749] T bb3d8792045a4583ae2e965b1350a5b4 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:19:30.156625  9366 raft_consensus.cc:493] T bb3d8792045a4583ae2e965b1350a5b4 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 7 FOLLOWER]: Starting pre-election (detected failure of leader cd75a17ab2604397adab03bb8b5fd75c)
I20260709 13:19:30.328886  9366 raft_consensus.cc:515] T bb3d8792045a4583ae2e965b1350a5b4 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:19:30.330298  9653 raft_consensus.cc:3060] T 9e326172347f45e99a0d482b5d8ef768 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:30.294248  6875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24ee15416e3145beaa1b8183453729a3" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:19:30.332456  6875 raft_consensus.cc:1813] T 24ee15416e3145beaa1b8183453729a3 P cd75a17ab2604397adab03bb8b5fd75c [term 6 FOLLOWER]: Handling vote request from an unknown peer b7ab4784c7344b939bc36f639286f377
I20260709 13:19:30.333281  6875 raft_consensus.cc:2410] T 24ee15416e3145beaa1b8183453729a3 P cd75a17ab2604397adab03bb8b5fd75c [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7ab4784c7344b939bc36f639286f377 for term 7 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 6.
I20260709 13:19:30.318851  9657 raft_consensus.cc:493] T 22ccee1b570c4ad3a57bd7aec085b1b4 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:30.334339  6875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90d42e216d9741e190bca19a781291fd" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:19:30.219619  6876 raft_consensus.cc:2468] T 713b5728a197487c9300b310ab94e5a3 P cd75a17ab2604397adab03bb8b5fd75c [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 8.
I20260709 13:19:30.335116  6875 raft_consensus.cc:2468] T 90d42e216d9741e190bca19a781291fd P cd75a17ab2604397adab03bb8b5fd75c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 7.
I20260709 13:19:30.335625  6876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09c2a98de1a4decabd0ff900dd44caa" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:19:30.294387  6804 raft_consensus.cc:2468] T c4db81d9d329422bb3b4160ca4ac2d1d P b7ab4784c7344b939bc36f639286f377 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 8.
I20260709 13:19:30.336365  6876 raft_consensus.cc:2393] T f09c2a98de1a4decabd0ff900dd44caa P cd75a17ab2604397adab03bb8b5fd75c [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7ab4784c7344b939bc36f639286f377 in current term 8: Already voted for candidate cd75a17ab2604397adab03bb8b5fd75c in this term.
I20260709 13:19:30.337113  6876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7887766dc6784fcaa42b35c05fea7a99" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:19:30.337652  6876 raft_consensus.cc:2468] T 7887766dc6784fcaa42b35c05fea7a99 P cd75a17ab2604397adab03bb8b5fd75c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 6.
I20260709 13:19:30.078182  9694 consensus_queue.cc:1243] T 20f6842e26174571996b8dea4151d4be P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Peer b7ab4784c7344b939bc36f639286f377 log is divergent from this leader: its last log entry 6.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
W20260709 13:19:30.268426  9672 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 6 current term: 6 is higher.
I20260709 13:19:30.335924  6875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30e88460611e47b2ba16a46a30b5f416" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:19:30.339020  6875 raft_consensus.cc:3060] T 30e88460611e47b2ba16a46a30b5f416 P cd75a17ab2604397adab03bb8b5fd75c [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:30.339941  6876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f03d0dbf16864ca4bc1bb5e4c0334c0f" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:19:30.341552  9489 leader_election.cc:290] T 95a75bfe094d4bdc963aba3f08dfcd25 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:30.299388  6881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c44c4849aa54f2b94d1f1bef9ed546f" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
W20260709 13:19:30.315889  6698 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:30.082382  9649 raft_consensus.cc:515] T 1bf4668eeb70467fb3dc5a0289233b3c P cd75a17ab2604397adab03bb8b5fd75c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:30.217257  9660 raft_consensus.cc:2749] T 4f00a2e87e56452083b759f60d461ee3 P cd75a17ab2604397adab03bb8b5fd75c [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:19:30.320420  6727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90d42e216d9741e190bca19a781291fd" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:19:30.211923  9642 raft_consensus.cc:515] T b3f13b31a1f84f0d89d007eadd57924c P ccd8a4c3bfe3413cb2ae219b09aea832 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:19:30.218997  9526 raft_consensus.cc:493] T dbdf895bba214ff68685a24fd17dfb5d P ccd8a4c3bfe3413cb2ae219b09aea832 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:19:30.326648  6805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44bde925b2e541b69890d70715b85176" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:19:30.386595  6805 raft_consensus.cc:2393] T 44bde925b2e541b69890d70715b85176 P b7ab4784c7344b939bc36f639286f377 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c in current term 8: Already voted for candidate b7ab4784c7344b939bc36f639286f377 in this term.
I20260709 13:19:30.334164  9657 raft_consensus.cc:515] T 22ccee1b570c4ad3a57bd7aec085b1b4 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:30.315555  6803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4db81d9d329422bb3b4160ca4ac2d1d" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:19:30.341624  6876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6869f07b5a4885a0b99fbe60c3b175" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 8 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:19:30.394189  6876 raft_consensus.cc:2468] T bd6869f07b5a4885a0b99fbe60c3b175 P cd75a17ab2604397adab03bb8b5fd75c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 7.
I20260709 13:19:30.395157  6876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a485a995abc4807b6e511e45419f737" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:19:30.394090  6732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a734b5ab7834e05a8c422208acc58b1" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
W20260709 13:19:30.314008  9685 log.cc:927] Time spent T 3fa34c08b205435dba97346991aa1f92 P cd75a17ab2604397adab03bb8b5fd75c: Append to log took a long time: real 0.054s	user 0.001s	sys 0.000s
I20260709 13:19:30.319664  9636 raft_consensus.cc:2804] T 7a734b5ab7834e05a8c422208acc58b1 P cd75a17ab2604397adab03bb8b5fd75c [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:19:30.349510  6806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de3186201e1a40d0b335eeb8b4e256e0" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:19:30.342192  9628 consensus_queue.cc:1059] T 404190ce4ce94cecbfcb6ea9d1dd8626 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.038s
W20260709 13:19:30.320926  6879 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.541s	user 0.052s	sys 0.044s
W20260709 13:19:30.401422  6879 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.622s	user 0.053s	sys 0.045s
I20260709 13:19:30.163340  9688 raft_consensus.cc:515] T 3fa34c08b205435dba97346991aa1f92 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:19:30.136650  9697 raft_consensus.cc:515] T 7c37d41cd9164c15a6826ca62a851a69 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:30.360232  9649 leader_election.cc:290] T 1bf4668eeb70467fb3dc5a0289233b3c P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:19:30.362514  6881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44bde925b2e541b69890d70715b85176" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:19:30.405967  6881 raft_consensus.cc:2410] T 44bde925b2e541b69890d70715b85176 P cd75a17ab2604397adab03bb8b5fd75c [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7ab4784c7344b939bc36f639286f377 for term 9 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 13:19:30.406865  6881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de3186201e1a40d0b335eeb8b4e256e0" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:19:30.364091  9259 raft_consensus.cc:3055] T 20f6842e26174571996b8dea4151d4be P ccd8a4c3bfe3413cb2ae219b09aea832 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:19:30.217861  9534 consensus_queue.cc:260] T a3022224cc81473690653a83d4e99470 P b7ab4784c7344b939bc36f639286f377 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:30.408203  9259 raft_consensus.cc:740] T 20f6842e26174571996b8dea4151d4be P ccd8a4c3bfe3413cb2ae219b09aea832 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
I20260709 13:19:30.372503  6877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a485a995abc4807b6e511e45419f737" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:19:30.342214  9561 leader_election.cc:290] T c4db81d9d329422bb3b4160ca4ac2d1d P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:30.374822  6726 raft_consensus.cc:1240] T 07a92dd554674067a83a9cb68c4773f2 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 7 FOLLOWER]: Rejecting Update request from peer cd75a17ab2604397adab03bb8b5fd75c for earlier term 6. Current term is 7. Ops: []
I20260709 13:19:30.375275  6728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5be3a11b23d4ea9b08300a2789821c7" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:19:30.375324  6727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "427c124d773f483294511e80fe340075" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:19:30.413727  6728 raft_consensus.cc:2468] T f5be3a11b23d4ea9b08300a2789821c7 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 5.
I20260709 13:19:30.378086  6731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09c2a98de1a4decabd0ff900dd44caa" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:19:30.397776  6875 raft_consensus.cc:2468] T 30e88460611e47b2ba16a46a30b5f416 P cd75a17ab2604397adab03bb8b5fd75c [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 7.
I20260709 13:19:30.316676  9506 raft_consensus.cc:493] T f4b8bd455d5a47c18a1380839c6e0d61 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 6 FOLLOWER]: Starting leader election (detected failure of leader cd75a17ab2604397adab03bb8b5fd75c)
I20260709 13:19:30.398231  6803 raft_consensus.cc:2393] T c4db81d9d329422bb3b4160ca4ac2d1d P b7ab4784c7344b939bc36f639286f377 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c in current term 8: Already voted for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in this term.
I20260709 13:19:30.334180  9031 raft_consensus.cc:3060] T 7ba5dac66ab5497e9e336f2a3c28cda5 P b7ab4784c7344b939bc36f639286f377 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:19:30.399006  6847 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:30.400956  6806 raft_consensus.cc:2393] T de3186201e1a40d0b335eeb8b4e256e0 P b7ab4784c7344b939bc36f639286f377 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c in current term 8: Already voted for candidate b7ab4784c7344b939bc36f639286f377 in this term.
I20260709 13:19:30.303812  9614 raft_consensus.cc:493] T ab432e62819d499eaaf3dd55481dd930 P cd75a17ab2604397adab03bb8b5fd75c [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:30.401738  6732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d33d5ee8ef6f415593d8df52063161ad" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:19:30.426115  6732 raft_consensus.cc:2468] T d33d5ee8ef6f415593d8df52063161ad P ccd8a4c3bfe3413cb2ae219b09aea832 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 8.
I20260709 13:19:30.420266  9506 raft_consensus.cc:3060] T f4b8bd455d5a47c18a1380839c6e0d61 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:30.428884  9614 raft_consensus.cc:515] T ab432e62819d499eaaf3dd55481dd930 P cd75a17ab2604397adab03bb8b5fd75c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:30.402794  6876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34f36d59d88f40fe8a2805e604fc6c0a" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:19:30.373050  6872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b3759de40694069b13c0f8bd40e5709" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:19:30.407891  6881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c240553ce044eedb41541d72b9475d7" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:19:30.412278  6730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbdf895bba214ff68685a24fd17dfb5d" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:19:30.422166  6728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3022224cc81473690653a83d4e99470" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:19:30.425201  6727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44bde925b2e541b69890d70715b85176" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:19:30.433027  6876 raft_consensus.cc:1275] T 22ccee1b570c4ad3a57bd7aec085b1b4 P cd75a17ab2604397adab03bb8b5fd75c [term 6 FOLLOWER]: Refusing update from remote peer b7ab4784c7344b939bc36f639286f377: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:19:30.433027  6728 raft_consensus.cc:2393] T a3022224cc81473690653a83d4e99470 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c in current term 7: Already voted for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in this term.
I20260709 13:19:30.418444  9636 raft_consensus.cc:697] T 7a734b5ab7834e05a8c422208acc58b1 P cd75a17ab2604397adab03bb8b5fd75c [term 8 LEADER]: Becoming Leader. State: Replica: cd75a17ab2604397adab03bb8b5fd75c, State: Running, Role: LEADER
I20260709 13:19:30.399443  9526 raft_consensus.cc:515] T dbdf895bba214ff68685a24fd17dfb5d P ccd8a4c3bfe3413cb2ae219b09aea832 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
W20260709 13:19:30.478538  7466 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.5.126.65:44391 timed out after 2.014s (SENT) [suppressed 18 similar messages]
I20260709 13:19:30.474330  6799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8292e16e5654be6bc408560cf256aaa" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:19:30.481674  6799 raft_consensus.cc:3060] T d8292e16e5654be6bc408560cf256aaa P b7ab4784c7344b939bc36f639286f377 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:30.437235  6728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a75bfe094d4bdc963aba3f08dfcd25" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 9 candidate_status { last_received { term: 7 index: 2 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:19:30.482858  6728 raft_consensus.cc:2468] T 95a75bfe094d4bdc963aba3f08dfcd25 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 8.
I20260709 13:19:30.426357  9649 raft_consensus.cc:493] T 711ef6523deb4cbe8ef2ba61e1c21c98 P cd75a17ab2604397adab03bb8b5fd75c [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:30.484498  6872 raft_consensus.cc:1240] T d8292e16e5654be6bc408560cf256aaa P cd75a17ab2604397adab03bb8b5fd75c [term 9 FOLLOWER]: Rejecting Update request from peer ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 8. Current term is 9. Ops: []
W20260709 13:19:30.483294  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 269733us
I20260709 13:19:30.485919  6844 leader_election.cc:304] T f09c2a98de1a4decabd0ff900dd44caa P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:19:30.430668  9608 leader_election.cc:290] T 22ccee1b570c4ad3a57bd7aec085b1b4 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:19:30.510625  6727 raft_consensus.cc:2468] T 44bde925b2e541b69890d70715b85176 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 8.
I20260709 13:19:30.419027  9555 consensus_queue.cc:1059] T 404190ce4ce94cecbfcb6ea9d1dd8626 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.060s
I20260709 13:19:30.526433  9603 leader_election.cc:290] T be1a92657f494cac8dd227d152f50151 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 9 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
W20260709 13:19:30.540337  6772 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:30.540145  6730 raft_consensus.cc:2468] T dbdf895bba214ff68685a24fd17dfb5d P ccd8a4c3bfe3413cb2ae219b09aea832 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 6.
I20260709 13:19:30.544005  6874 raft_consensus.cc:1240] T 30e88460611e47b2ba16a46a30b5f416 P cd75a17ab2604397adab03bb8b5fd75c [term 7 FOLLOWER]: Rejecting Update request from peer b7ab4784c7344b939bc36f639286f377 for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 13:19:30.545532  6874 raft_consensus.cc:1275] T ab432e62819d499eaaf3dd55481dd930 P cd75a17ab2604397adab03bb8b5fd75c [term 8 FOLLOWER]: Refusing update from remote peer b7ab4784c7344b939bc36f639286f377: Log matching property violated. Preceding OpId in replica: term: 7 index: 3. Preceding OpId from leader: term: 8 index: 4. (index mismatch)
I20260709 13:19:30.540699  6726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24ee15416e3145beaa1b8183453729a3" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:19:30.475143  9627 raft_consensus.cc:697] T 9e326172347f45e99a0d482b5d8ef768 P cd75a17ab2604397adab03bb8b5fd75c [term 6 LEADER]: Becoming Leader. State: Replica: cd75a17ab2604397adab03bb8b5fd75c, State: Running, Role: LEADER
I20260709 13:19:30.549124  6799 raft_consensus.cc:2468] T d8292e16e5654be6bc408560cf256aaa P b7ab4784c7344b939bc36f639286f377 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 9.
I20260709 13:19:30.549887  6727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8292e16e5654be6bc408560cf256aaa" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:19:30.479596  9561 raft_consensus.cc:493] T 9e326172347f45e99a0d482b5d8ef768 P b7ab4784c7344b939bc36f639286f377 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:30.557538  6726 raft_consensus.cc:2393] T 24ee15416e3145beaa1b8183453729a3 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c in current term 7: Already voted for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in this term.
I20260709 13:19:30.570896  6728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77e330a82df4b43a745d57a68f6f057" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 10 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:19:30.571894  6728 raft_consensus.cc:2468] T e77e330a82df4b43a745d57a68f6f057 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 9.
I20260709 13:19:30.528769  9649 raft_consensus.cc:515] T 711ef6523deb4cbe8ef2ba61e1c21c98 P cd75a17ab2604397adab03bb8b5fd75c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:30.578806  6881 raft_consensus.cc:1240] T 4b8cacb381b746da8d0049b0a83b41dd P cd75a17ab2604397adab03bb8b5fd75c [term 8 FOLLOWER]: Rejecting Update request from peer ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 7. Current term is 8. Ops: []
I20260709 13:19:30.553112  9688 leader_election.cc:290] T 3fa34c08b205435dba97346991aa1f92 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:19:30.439388  9259 consensus_queue.cc:260] T 20f6842e26174571996b8dea4151d4be P ccd8a4c3bfe3413cb2ae219b09aea832 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
W20260709 13:19:30.680426  6697 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.68:45071, user_credentials={real_user=slave}} blocked reactor thread for 385424us
I20260709 13:19:30.647419  6877 raft_consensus.cc:1275] T 711ef6523deb4cbe8ef2ba61e1c21c98 P cd75a17ab2604397adab03bb8b5fd75c [term 8 FOLLOWER]: Refusing update from remote peer b7ab4784c7344b939bc36f639286f377: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
W20260709 13:19:30.692180  6698 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:30.806687  6698 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:30.645345  6725 raft_consensus.cc:1240] T 7c44c4849aa54f2b94d1f1bef9ed546f P ccd8a4c3bfe3413cb2ae219b09aea832 [term 9 FOLLOWER]: Rejecting Update request from peer cd75a17ab2604397adab03bb8b5fd75c for earlier term 8. Current term is 9. Ops: []
I20260709 13:19:30.803519  6732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4db81d9d329422bb3b4160ca4ac2d1d" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:19:30.595979  6727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34f36d59d88f40fe8a2805e604fc6c0a" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:19:30.811481  6727 raft_consensus.cc:2393] T 34f36d59d88f40fe8a2805e604fc6c0a P ccd8a4c3bfe3413cb2ae219b09aea832 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c in current term 5: Already voted for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in this term.
I20260709 13:19:30.776216  6723 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49998 (request call id 790) took 1215 ms. Trace:
I20260709 13:19:30.643607  6729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d65025eea89441290d85dd053810e31" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:19:30.800854  6872 raft_consensus.cc:1275] T 95a75bfe094d4bdc963aba3f08dfcd25 P cd75a17ab2604397adab03bb8b5fd75c [term 8 FOLLOWER]: Refusing update from remote peer b7ab4784c7344b939bc36f639286f377: Log matching property violated. Preceding OpId in replica: term: 7 index: 2. Preceding OpId from leader: term: 8 index: 3. (index mismatch)
I20260709 13:19:30.822404  6872 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53406 (request call id 1628) took 1176 ms. Trace:
I20260709 13:19:30.772607  6880 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53416 (request call id 2417) took 1228 ms. Trace:
I20260709 13:19:30.819669  6697 leader_election.cc:304] T 07a92dd554674067a83a9cb68c4773f2 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:19:30.618747  6726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b8cacb381b746da8d0049b0a83b41dd" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
W20260709 13:19:30.754351  6878 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.545s	user 0.000s	sys 0.019s
W20260709 13:19:30.830204  6878 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.666s	user 0.000s	sys 0.022s
W20260709 13:19:30.754113  6770 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.612s	user 0.002s	sys 0.017s
W20260709 13:19:30.831574  6770 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.689s	user 0.004s	sys 0.018s
I20260709 13:19:30.636762  6875 raft_consensus.cc:1240] T 713b5728a197487c9300b310ab94e5a3 P cd75a17ab2604397adab03bb8b5fd75c [term 8 FOLLOWER]: Rejecting Update request from peer b7ab4784c7344b939bc36f639286f377 for earlier term 7. Current term is 8. Ops: [7.4-7.4]
W20260709 13:19:30.816085  6772 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 274766us
W20260709 13:19:30.820240  6773 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:30.819943  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 332792us
I20260709 13:19:30.771502  6728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e31b9971c15848dea59d4d4130141d9e" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:19:30.817082  6732 raft_consensus.cc:2393] T c4db81d9d329422bb3b4160ca4ac2d1d P ccd8a4c3bfe3413cb2ae219b09aea832 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c in current term 8: Already voted for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in this term.
W20260709 13:19:30.816247  6695 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.500s	user 0.013s	sys 0.033s
W20260709 13:19:30.834482  6695 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.519s	user 0.013s	sys 0.033s
W20260709 13:19:30.834832  6695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 519296us
I20260709 13:19:30.834348  6772 leader_election.cc:304] T 24ee15416e3145beaa1b8183453729a3 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:19:30.813127  6729 raft_consensus.cc:2468] T 3d65025eea89441290d85dd053810e31 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 6.
W20260709 13:19:30.626821  9705 log.cc:927] Time spent T de3186201e1a40d0b335eeb8b4e256e0 P cd75a17ab2604397adab03bb8b5fd75c: Append to log took a long time: real 0.074s	user 0.000s	sys 0.000s
I20260709 13:19:30.812642  6723 rpcz_store.cc:276] 0709 13:19:29.561002 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:29.561338 (+   336us) service_pool.cc:224] Handling call
0709 13:19:29.561801 (+   463us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:29.562281 (+   480us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:29.562322 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:29.589398 (+ 27076us) log.cc:844] Serialized 26 byte log entry
0709 13:19:30.112720 (+523322us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:19:30.112786 (+    66us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:30.112901 (+   115us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:30.775863 (+662962us) raft_consensus.cc:1685] finished
0709 13:19:30.775914 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:30.776129 (+   215us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":10979,"raft.queue_time_us":368,"raft.run_cpu_time_us":148,"raft.run_wall_time_us":12928,"thread_start_us":479614,"threads_started":1,"wal-append.queue_time_us":911900}
I20260709 13:19:30.831316  6872 rpcz_store.cc:276] 0709 13:19:29.646140 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:30.527830 (+881690us) service_pool.cc:224] Handling call
0709 13:19:30.800340 (+272510us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:30.822028 (+ 21688us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:30.822315 (+   287us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:19:30.681234  9564 consensus_meta.cc:287] T 853ac0a8cbd64ce99457f170216d4d0f P b7ab4784c7344b939bc36f639286f377: Time spent flushing consensus metadata: real 1.205s	user 0.008s	sys 0.007s
W20260709 13:19:30.642051  9616 consensus_meta.cc:287] T 7c37d41cd9164c15a6826ca62a851a69 P cd75a17ab2604397adab03bb8b5fd75c: Time spent flushing consensus metadata: real 1.211s	user 0.010s	sys 0.000s
I20260709 13:19:30.837890  6772 leader_election.cc:304] T 90d42e216d9741e190bca19a781291fd P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:19:30.628623  9669 raft_consensus.cc:3055] T f03d0dbf16864ca4bc1bb5e4c0334c0f P ccd8a4c3bfe3413cb2ae219b09aea832 [term 5 LEADER]: Stepping down as leader of term 5
W20260709 13:19:30.632831  9701 log.cc:927] Time spent T 3a485a995abc4807b6e511e45419f737 P cd75a17ab2604397adab03bb8b5fd75c: Append to log took a long time: real 0.984s	user 0.003s	sys 0.007s
I20260709 13:19:30.616712  9603 raft_consensus.cc:493] T 17587d6730594da4a56fa13a353232a1 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:30.772346  9651 leader_election.cc:290] T d8cee0accdb8499c86d4414b72565a38 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:19:30.798113  9631 raft_consensus.cc:2804] T f09c2a98de1a4decabd0ff900dd44caa P cd75a17ab2604397adab03bb8b5fd75c [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:19:30.791889  9657 leader_election.cc:290] T 22ccee1b570c4ad3a57bd7aec085b1b4 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:30.846061  6802 raft_consensus.cc:2468] T 853ac0a8cbd64ce99457f170216d4d0f P b7ab4784c7344b939bc36f639286f377 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 5.
I20260709 13:19:30.829711  6880 rpcz_store.cc:276] 0709 13:19:29.544472 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:29.544599 (+   127us) service_pool.cc:224] Handling call
0709 13:19:29.545062 (+   463us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:19:29.622295 (+ 77233us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:29.622325 (+    30us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:19:29.836311 (+213986us) log.cc:844] Serialized 52 byte log entry
0709 13:19:30.408836 (+572525us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:19:30.408879 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:30.408949 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:30.645935 (+236986us) raft_consensus.cc:1685] finished
0709 13:19:30.645956 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:30.772535 (+126579us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":76684,"raft.queue_time_us":77054,"raft.run_cpu_time_us":191,"raft.run_wall_time_us":27720,"thread_start_us":287928,"threads_started":1,"wal-append.queue_time_us":565771}
I20260709 13:19:30.837018  6875 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53406 (request call id 1634) took 1007 ms. Trace:
I20260709 13:19:30.868412  6875 rpcz_store.cc:276] 0709 13:19:29.829467 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:30.635979 (+806512us) service_pool.cc:224] Handling call
0709 13:19:30.636482 (+   503us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:30.836641 (+200159us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:30.836957 (+   316us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:30.626734  9676 raft_consensus.cc:3055] T 7887766dc6784fcaa42b35c05fea7a99 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:19:30.792346  9643 leader_election.cc:290] T b3f13b31a1f84f0d89d007eadd57924c P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:19:30.647686  9641 leader_election.cc:290] T bd6869f07b5a4885a0b99fbe60c3b175 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:19:30.640420  9654 leader_election.cc:290] T f3f9c2e2bf644115957398fe4c9459db P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 7 election: Requested vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:30.632685  9614 leader_election.cc:290] T ab432e62819d499eaaf3dd55481dd930 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:19:30.849002  6873 raft_consensus.cc:2410] T 7c37d41cd9164c15a6826ca62a851a69 P cd75a17ab2604397adab03bb8b5fd75c [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate b7ab4784c7344b939bc36f639286f377 for term 6 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:19:30.849937  7500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3f13b31a1f84f0d89d007eadd57924c" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:19:30.649492  9642 leader_election.cc:290] T b3f13b31a1f84f0d89d007eadd57924c P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:19:30.570567  9561 raft_consensus.cc:515] T 9e326172347f45e99a0d482b5d8ef768 P b7ab4784c7344b939bc36f639286f377 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:30.772146  9526 leader_election.cc:290] T dbdf895bba214ff68685a24fd17dfb5d P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:30.830768  9502 raft_consensus.cc:493] T ab432e62819d499eaaf3dd55481dd930 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:30.842710  9515 consensus_meta.cc:287] T f09c2a98de1a4decabd0ff900dd44caa P ccd8a4c3bfe3413cb2ae219b09aea832: Time spent flushing consensus metadata: real 0.978s	user 0.012s	sys 0.001s
I20260709 13:19:30.646955  9649 leader_election.cc:290] T 711ef6523deb4cbe8ef2ba61e1c21c98 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:19:30.596269  9627 consensus_queue.cc:237] T 9e326172347f45e99a0d482b5d8ef768 P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:30.857285  6772 leader_election.cc:304] T 7887766dc6784fcaa42b35c05fea7a99 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:19:30.863384  9716 raft_consensus.cc:493] T a1704639a875409b9959353527b3fd68 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:19:30.871598  9717 raft_consensus.cc:493] T 34f36d59d88f40fe8a2805e604fc6c0a P ccd8a4c3bfe3413cb2ae219b09aea832 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:30.915282  9717 raft_consensus.cc:515] T 34f36d59d88f40fe8a2805e604fc6c0a P ccd8a4c3bfe3413cb2ae219b09aea832 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:30.865166  7495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fa34c08b205435dba97346991aa1f92" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:19:30.856138  9708 raft_consensus.cc:493] T f3f9c2e2bf644115957398fe4c9459db P cd75a17ab2604397adab03bb8b5fd75c [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
W20260709 13:19:30.832005  6770 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 702234us
I20260709 13:19:30.851222  9259 raft_consensus.cc:3060] T 20f6842e26174571996b8dea4151d4be P ccd8a4c3bfe3413cb2ae219b09aea832 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:30.874795  6874 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53406 (request call id 1633) took 1227 ms. Trace:
I20260709 13:19:30.647867  9636 consensus_queue.cc:237] T 7a734b5ab7834e05a8c422208acc58b1 P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:30.860083  9687 raft_consensus.cc:493] T a3022224cc81473690653a83d4e99470 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:30.829900  9714 consensus_queue.cc:1048] T 7c44c4849aa54f2b94d1f1bef9ed546f P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.058s
I20260709 13:19:30.899554  9697 leader_election.cc:290] T 7c37d41cd9164c15a6826ca62a851a69 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:30.862586  7494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe20b4b48823486ca3b9c648db6ce8aa" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb"
I20260709 13:19:30.845223  9658 consensus_queue.cc:1059] T 24ee15416e3145beaa1b8183453729a3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.031s
I20260709 13:19:30.864420  9564 raft_consensus.cc:2804] T 90d42e216d9741e190bca19a781291fd P b7ab4784c7344b939bc36f639286f377 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 13:19:30.905462  6772 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 48264.2us
I20260709 13:19:30.841969  9715 raft_consensus.cc:2749] T 24ee15416e3145beaa1b8183453729a3 P b7ab4784c7344b939bc36f639286f377 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:19:30.866938  9651 raft_consensus.cc:493] T ce4f062dcd314d43a63ca74067cb5ee3 P cd75a17ab2604397adab03bb8b5fd75c [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:30.910965  6879 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53416 (request call id 2420) took 1362 ms. Trace:
I20260709 13:19:30.913164  9654 consensus_queue.cc:1048] T 1bf4668eeb70467fb3dc5a0289233b3c P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:19:30.915688  6807 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:32966 (request call id 819) took 1246 ms. Trace:
I20260709 13:19:30.873198  9657 raft_consensus.cc:2804] T 07a92dd554674067a83a9cb68c4773f2 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:19:30.875828  9631 raft_consensus.cc:697] T f09c2a98de1a4decabd0ff900dd44caa P cd75a17ab2604397adab03bb8b5fd75c [term 8 LEADER]: Becoming Leader. State: Replica: cd75a17ab2604397adab03bb8b5fd75c, State: Running, Role: LEADER
I20260709 13:19:30.847421  9669 raft_consensus.cc:740] T f03d0dbf16864ca4bc1bb5e4c0334c0f P ccd8a4c3bfe3413cb2ae219b09aea832 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
I20260709 13:19:30.921234  6770 leader_election.cc:304] T b56bf91d90824c959e21e0cee5ba1816 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
W20260709 13:19:30.921482  6847 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:30.919922  6874 rpcz_store.cc:276] 0709 13:19:29.647564 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:30.546218 (+898654us) service_pool.cc:224] Handling call
0709 13:19:30.546503 (+   285us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:30.546860 (+   357us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:30.546885 (+    25us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:30.547364 (+   479us) log.cc:844] Serialized 26 byte log entry
0709 13:19:30.839389 (+292025us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:19:30.839428 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:30.839497 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:30.874578 (+ 35081us) raft_consensus.cc:1685] finished
0709 13:19:30.874602 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:30.874739 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":304245,"raft.run_cpu_time_us":238,"raft.run_wall_time_us":6655,"thread_start_us":220333,"threads_started":1,"wal-append.queue_time_us":304217}
I20260709 13:19:30.958189  6874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4db81d9d329422bb3b4160ca4ac2d1d" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:19:30.959275  6874 raft_consensus.cc:2393] T c4db81d9d329422bb3b4160ca4ac2d1d P cd75a17ab2604397adab03bb8b5fd75c [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7ab4784c7344b939bc36f639286f377 in current term 8: Already voted for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in this term.
W20260709 13:19:30.924315  6695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 55048.6us
I20260709 13:19:30.880437  9676 raft_consensus.cc:740] T 7887766dc6784fcaa42b35c05fea7a99 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
I20260709 13:19:30.911782  9642 consensus_queue.cc:1059] T f58dc08b12a2494bb9a1372837970ca2 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: INVALID_TERM, Last received: 8.4, Next index: 5, Last known committed idx: 2, Time since last communication: 0.035s
W20260709 13:19:30.921748  6696 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:30.894454  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 60667.5us
I20260709 13:19:30.977278  6723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f58dc08b12a2494bb9a1372837970ca2" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:19:30.979007  6729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7887766dc6784fcaa42b35c05fea7a99" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:19:30.899757  9616 raft_consensus.cc:493] T 7c37d41cd9164c15a6826ca62a851a69 P cd75a17ab2604397adab03bb8b5fd75c [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:30.862710  9603 raft_consensus.cc:515] T 17587d6730594da4a56fa13a353232a1 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:19:30.929502  6731 raft_consensus.cc:2468] T f09c2a98de1a4decabd0ff900dd44caa P ccd8a4c3bfe3413cb2ae219b09aea832 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 8.
I20260709 13:19:30.943884  6878 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58592 (request call id 202) took 2602 ms. Trace:
I20260709 13:19:30.937361  6772 leader_election.cc:304] T bd6869f07b5a4885a0b99fbe60c3b175 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:19:30.921963  9643 raft_consensus.cc:2804] T 7887766dc6784fcaa42b35c05fea7a99 P b7ab4784c7344b939bc36f639286f377 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:19:30.917577  9717 leader_election.cc:290] T 34f36d59d88f40fe8a2805e604fc6c0a P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:30.907353  9502 raft_consensus.cc:515] T ab432e62819d499eaaf3dd55481dd930 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:30.957381  9657 raft_consensus.cc:493] T 07a92dd554674067a83a9cb68c4773f2 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:30.943110  6879 rpcz_store.cc:276] 0709 13:19:29.548612 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:29.593156 (+ 44544us) service_pool.cc:224] Handling call
0709 13:19:29.593470 (+   314us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:29.613751 (+ 20281us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:29.613782 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:29.620480 (+  6698us) log.cc:844] Serialized 26 byte log entry
0709 13:19:30.401861 (+781381us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:19:30.401907 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:30.401975 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:30.910668 (+508693us) raft_consensus.cc:1685] finished
0709 13:19:30.910701 (+    33us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:30.910881 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":19866,"raft.queue_time_us":23784,"raft.run_cpu_time_us":123,"raft.run_wall_time_us":13266,"thread_start_us":622371,"threads_started":1,"wal-append.queue_time_us":700102}
W20260709 13:19:30.934124  9031 consensus_meta.cc:287] T 7ba5dac66ab5497e9e336f2a3c28cda5 P b7ab4784c7344b939bc36f639286f377: Time spent flushing consensus metadata: real 0.507s	user 0.012s	sys 0.000s
I20260709 13:19:30.962117  6695 leader_election.cc:304] T 7c44c4849aa54f2b94d1f1bef9ed546f P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:19:30.906253  9641 consensus_queue.cc:1048] T 4275cf08e63345f993bce8664eada830 P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.037s
I20260709 13:19:30.967877  6770 leader_election.cc:304] T 07a92dd554674067a83a9cb68c4773f2 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
W20260709 13:19:30.985508  6772 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 48043.3us
W20260709 13:19:30.987498  6844 connection.cc:256] RPC call timeout handler was delayed by -1.3096650880002016s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2781s for a response
I20260709 13:19:30.999806  6695 leader_election.cc:304] T 8c7f33e544204fbaac4078e3e83bbf4e P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:19:30.936636  9564 raft_consensus.cc:493] T 90d42e216d9741e190bca19a781291fd P b7ab4784c7344b939bc36f639286f377 [term 7 FOLLOWER]: Starting leader election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:19:30.989951  6728 pending_rounds.cc:85] T bb3d8792045a4583ae2e965b1350a5b4 P ccd8a4c3bfe3413cb2ae219b09aea832: Aborting all ops after (but not including) 6
I20260709 13:19:31.000866  6728 pending_rounds.cc:107] T bb3d8792045a4583ae2e965b1350a5b4 P ccd8a4c3bfe3413cb2ae219b09aea832: Aborting uncommitted NO_OP operation due to leader change: 6.7
I20260709 13:19:31.001243  6728 raft_consensus.cc:2889] T bb3d8792045a4583ae2e965b1350a5b4 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:19:30.990825  6726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b8cacb381b746da8d0049b0a83b41dd" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:19:30.992691  6729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b3759de40694069b13c0f8bd40e5709" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:19:30.992838  6723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "853ac0a8cbd64ce99457f170216d4d0f" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:19:30.990077  6732 raft_consensus.cc:1275] T 34f36d59d88f40fe8a2805e604fc6c0a P ccd8a4c3bfe3413cb2ae219b09aea832 [term 5 FOLLOWER]: Refusing update from remote peer cd75a17ab2604397adab03bb8b5fd75c: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:19:30.944394  9709 raft_consensus.cc:493] T 3fa34c08b205435dba97346991aa1f92 P cd75a17ab2604397adab03bb8b5fd75c [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 7ba59cc884714e8aa5f3f0ecaed84cbb)
W20260709 13:19:30.993670  6697 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 137410us
I20260709 13:19:30.982190  9715 raft_consensus.cc:2749] T b56bf91d90824c959e21e0cee5ba1816 P b7ab4784c7344b939bc36f639286f377 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:19:30.948110  6807 rpcz_store.cc:276] 0709 13:19:29.669424 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:29.669591 (+   167us) service_pool.cc:224] Handling call
0709 13:19:30.126928 (+457337us) spinlock_profiling.cc:243] Waited 173 ms on lock 0x7b5800003098. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0c745db1 00007fcc0c885e9c 00007fcc0c885a5b 00007fcc1579ec09 00007fcc148f8ee0 00007fcc149c20ab 00007fcc149c2131 00007fcc14983fc0 00007fcc1496e929 00007fcc1496e3d2 00007fcc0dee5bd4
0709 13:19:30.127172 (+   244us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:30.469689 (+342517us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:30.469730 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:30.549358 (+ 79628us) log.cc:844] Serialized 26 byte log entry
0709 13:19:30.898597 (+349239us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:19:30.898763 (+   166us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:30.898933 (+   170us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:30.915345 (+ 16412us) raft_consensus.cc:1685] finished
0709 13:19:30.915369 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:30.915614 (+   245us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":23147,"raft.queue_time_us":201347,"raft.run_cpu_time_us":114,"raft.run_wall_time_us":114,"spinlock_wait_cycles":398762624,"thread_start_us":479210,"threads_started":2,"wal-append.queue_time_us":342753}
I20260709 13:19:30.991822  6725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22ccee1b570c4ad3a57bd7aec085b1b4" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:19:31.009095  6725 raft_consensus.cc:2468] T 22ccee1b570c4ad3a57bd7aec085b1b4 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 6.
I20260709 13:19:30.982702  6878 rpcz_store.cc:276] 0709 13:19:28.341271 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:28.694894 (+353623us) service_pool.cc:224] Handling call
0709 13:19:28.912300 (+217406us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:19:28.936221 (+ 23921us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:28.936249 (+    28us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:19:28.941593 (+  5344us) log.cc:844] Serialized 52 byte log entry
0709 13:19:29.125330 (+183737us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:19:30.129308 (+1003978us) log.cc:844] Serialized 14 byte log entry
0709 13:19:30.942909 (+813601us) log.cc:844] Serialized 14 byte log entry
0709 13:19:30.943405 (+   496us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:30.943530 (+   125us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:30.943595 (+    65us) raft_consensus.cc:1685] finished
0709 13:19:30.943610 (+    15us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:30.943790 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":88701,"prepare.queue_time_us":95084,"prepare.run_cpu_time_us":28,"prepare.run_wall_time_us":28,"raft.queue_time_us":108992,"raft.run_cpu_time_us":530,"raft.run_wall_time_us":53374,"thread_start_us":1948335,"threads_started":4,"wal-append.queue_time_us":257479}
I20260709 13:19:31.009904  6729 raft_consensus.cc:1275] T 3a485a995abc4807b6e511e45419f737 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 6 FOLLOWER]: Refusing update from remote peer cd75a17ab2604397adab03bb8b5fd75c: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:19:30.994948  6727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bf4668eeb70467fb3dc5a0289233b3c" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
W20260709 13:19:31.011286  6770 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 43536.1us
I20260709 13:19:31.013778  6770 leader_election.cc:304] T 17587d6730594da4a56fa13a353232a1 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:19:31.005327  6726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "711ef6523deb4cbe8ef2ba61e1c21c98" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 9 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:19:30.920348  9716 raft_consensus.cc:515] T a1704639a875409b9959353527b3fd68 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:31.003471  6879 raft_consensus.cc:1240] T a1704639a875409b9959353527b3fd68 P cd75a17ab2604397adab03bb8b5fd75c [term 7 FOLLOWER]: Rejecting Update request from peer b7ab4784c7344b939bc36f639286f377 for earlier term 6. Current term is 7. Ops: [6.5-6.5]
I20260709 13:19:30.932808  9687 raft_consensus.cc:515] T a3022224cc81473690653a83d4e99470 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
W20260709 13:19:30.995070  9516 consensus_meta.cc:287] T 711ef6523deb4cbe8ef2ba61e1c21c98 P ccd8a4c3bfe3413cb2ae219b09aea832: Time spent flushing consensus metadata: real 1.555s	user 0.017s	sys 0.000s
I20260709 13:19:31.003751  6732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab432e62819d499eaaf3dd55481dd930" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 9 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:19:30.986044  9643 raft_consensus.cc:493] T 7887766dc6784fcaa42b35c05fea7a99 P b7ab4784c7344b939bc36f639286f377 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:30.984922  9616 raft_consensus.cc:515] T 7c37d41cd9164c15a6826ca62a851a69 P cd75a17ab2604397adab03bb8b5fd75c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:31.025238  9031 raft_consensus.cc:2749] T 07a92dd554674067a83a9cb68c4773f2 P b7ab4784c7344b939bc36f639286f377 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:19:31.003743  9657 raft_consensus.cc:3060] T 07a92dd554674067a83a9cb68c4773f2 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:31.025046  9642 raft_consensus.cc:2749] T 8c7f33e544204fbaac4078e3e83bbf4e P ccd8a4c3bfe3413cb2ae219b09aea832 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:19:30.927241  9708 raft_consensus.cc:515] T f3f9c2e2bf644115957398fe4c9459db P cd75a17ab2604397adab03bb8b5fd75c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:31.037935  6732 raft_consensus.cc:2468] T ab432e62819d499eaaf3dd55481dd930 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 8.
I20260709 13:19:30.960395  9651 raft_consensus.cc:515] T ce4f062dcd314d43a63ca74067cb5ee3 P cd75a17ab2604397adab03bb8b5fd75c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } attrs { replace: true } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:19:31.001401  9731 raft_consensus.cc:3055] T f58dc08b12a2494bb9a1372837970ca2 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:19:31.026531  9729 raft_consensus.cc:2804] T 7c44c4849aa54f2b94d1f1bef9ed546f P ccd8a4c3bfe3413cb2ae219b09aea832 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:19:31.019981  9709 raft_consensus.cc:515] T 3fa34c08b205435dba97346991aa1f92 P cd75a17ab2604397adab03bb8b5fd75c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:19:31.001545  9564 raft_consensus.cc:3060] T 90d42e216d9741e190bca19a781291fd P b7ab4784c7344b939bc36f639286f377 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:31.005333  6724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6869f07b5a4885a0b99fbe60c3b175" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 8 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:19:31.002693  6723 raft_consensus.cc:2376] T 853ac0a8cbd64ce99457f170216d4d0f P ccd8a4c3bfe3413cb2ae219b09aea832 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 5. Re-sending same reply.
I20260709 13:19:30.998553  9712 raft_consensus.cc:2804] T bd6869f07b5a4885a0b99fbe60c3b175 P b7ab4784c7344b939bc36f639286f377 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:19:31.035504  6697 leader_election.cc:304] T 427c124d773f483294511e80fe340075 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:19:31.037599  6695 leader_election.cc:304] T 3a485a995abc4807b6e511e45419f737 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
I20260709 13:19:31.038707  6799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ba5dac66ab5497e9e336f2a3c28cda5" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:19:31.030769  6729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce4f062dcd314d43a63ca74067cb5ee3" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:19:31.034166  6725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1528ab62b6fe4e3099d08f141afee116" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:19:31.042490  9717 consensus_queue.cc:1059] T f58dc08b12a2494bb9a1372837970ca2 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: INVALID_TERM, Last received: 8.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.043s
I20260709 13:19:31.058678  9713 consensus_queue.cc:1048] T 22ccee1b570c4ad3a57bd7aec085b1b4 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.027s
I20260709 13:19:31.042580  9697 consensus_queue.cc:1059] T 7a734b5ab7834e05a8c422208acc58b1 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.044s
I20260709 13:19:31.028595  6727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b8cacb381b746da8d0049b0a83b41dd" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:19:31.086643  9697 raft_consensus.cc:3055] T 7a734b5ab7834e05a8c422208acc58b1 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:19:31.086849  9708 leader_election.cc:290] T f3f9c2e2bf644115957398fe4c9459db P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:19:31.087030  9697 raft_consensus.cc:740] T 7a734b5ab7834e05a8c422208acc58b1 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
I20260709 13:19:31.043133  9515 consensus_queue.cc:1048] T bd6869f07b5a4885a0b99fbe60c3b175 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.046s
I20260709 13:19:31.060174  9669 consensus_queue.cc:260] T f03d0dbf16864ca4bc1bb5e4c0334c0f P ccd8a4c3bfe3413cb2ae219b09aea832 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:31.089426  9651 leader_election.cc:290] T ce4f062dcd314d43a63ca74067cb5ee3 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:19:31.043768  9603 leader_election.cc:290] T 17587d6730594da4a56fa13a353232a1 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
W20260709 13:19:31.062850  6802 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:32976 (request call id 2315) took 1497 ms (client timeout 1806 ms). Trace:
I20260709 13:19:31.090718  9716 leader_election.cc:290] T a1704639a875409b9959353527b3fd68 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:31.052330  9631 consensus_queue.cc:237] T f09c2a98de1a4decabd0ff900dd44caa P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:31.033209  9450 raft_consensus.cc:2749] T 17587d6730594da4a56fa13a353232a1 P b7ab4784c7344b939bc36f639286f377 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:19:31.044234  9586 leader_election.cc:290] T bb7fa124c3bf4ef9ab65a407cb008441 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:31.085119  9561 leader_election.cc:290] T 9e326172347f45e99a0d482b5d8ef768 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:31.098140  6877 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53406 (request call id 1616) took 1482 ms. Trace:
W20260709 13:19:31.090803  6802 rpcz_store.cc:269] 0709 13:19:29.565128 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:29.566354 (+  1226us) service_pool.cc:224] Handling call
0709 13:19:31.062660 (+1496306us) spinlock_profiling.cc:243] Waited 1.24 s on lock 0x7b54001b53d4. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f9ae2fa 00007fcc1496fb17 00007fcc0deea6d4 00007fcc0deea662 00007fcc0deea591 00007fcc0deea50c 00007fcc0dee97c2 00007fcc0dce548c 00007fcc0dce48c6 00007fcc0dce426f
0709 13:19:31.062784 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2851931392}
I20260709 13:19:31.098678  6877 rpcz_store.cc:276] 0709 13:19:29.615769 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:30.433325 (+817556us) service_pool.cc:224] Handling call
0709 13:19:30.477567 (+ 44242us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:30.805468 (+327901us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:31.097882 (+292414us) spinlock_profiling.cc:243] Waited 169 ms on lock 0x7b54001e96d4. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f9aae01 00007fcc0f9a983e 00007fcc1496e419 00007fcc0dee5bd4 00007fcc0dee5b62 00007fcc0dee5a91 00007fcc0dee5a0c 00007fcc0dee4cc2 00007fcc0dce548c 00007fcc0dce48c6
0709 13:19:31.098066 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":389700480}
I20260709 13:19:31.102701  7500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce4f062dcd314d43a63ca74067cb5ee3" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:19:31.103551  7500 raft_consensus.cc:2468] T ce4f062dcd314d43a63ca74067cb5ee3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 7.
I20260709 13:19:31.104247  9708 raft_consensus.cc:493] T f03d0dbf16864ca4bc1bb5e4c0334c0f P cd75a17ab2604397adab03bb8b5fd75c [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:19:31.096024  7494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8cee0accdb8499c86d4414b72565a38" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:19:31.104946  9708 raft_consensus.cc:515] T f03d0dbf16864ca4bc1bb5e4c0334c0f P cd75a17ab2604397adab03bb8b5fd75c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:31.087919  6727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "404190ce4ce94cecbfcb6ea9d1dd8626" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:19:31.106252  9663 raft_consensus.cc:3055] T a1704639a875409b9959353527b3fd68 P b7ab4784c7344b939bc36f639286f377 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:19:31.106810  9663 raft_consensus.cc:740] T a1704639a875409b9959353527b3fd68 P b7ab4784c7344b939bc36f639286f377 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
I20260709 13:19:31.107508  9708 leader_election.cc:290] T f03d0dbf16864ca4bc1bb5e4c0334c0f P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:19:31.046957  9502 leader_election.cc:290] T ab432e62819d499eaaf3dd55481dd930 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:31.065017  9731 raft_consensus.cc:740] T f58dc08b12a2494bb9a1372837970ca2 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
I20260709 13:19:31.111575  9731 consensus_queue.cc:260] T f58dc08b12a2494bb9a1372837970ca2 P ccd8a4c3bfe3413cb2ae219b09aea832 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:31.112322  6802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be1a92657f494cac8dd227d152f50151" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:19:31.066009  9676 consensus_queue.cc:260] T 7887766dc6784fcaa42b35c05fea7a99 P ccd8a4c3bfe3413cb2ae219b09aea832 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:31.113314  6802 raft_consensus.cc:3060] T be1a92657f494cac8dd227d152f50151 P b7ab4784c7344b939bc36f639286f377 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:31.113714  9676 raft_consensus.cc:3060] T 7887766dc6784fcaa42b35c05fea7a99 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:19:31.115578  6772 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 75692.6us
I20260709 13:19:31.116510  6772 leader_election.cc:304] T d8cee0accdb8499c86d4414b72565a38 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb
I20260709 13:19:31.064781  6732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3d8792045a4583ae2e965b1350a5b4" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:19:31.066605  9729 raft_consensus.cc:697] T 7c44c4849aa54f2b94d1f1bef9ed546f P ccd8a4c3bfe3413cb2ae219b09aea832 [term 9 LEADER]: Becoming Leader. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
W20260709 13:19:31.068106  9718 log.cc:927] Time spent T 3411566abe2d4c9bb4b2adfdd05e6f17 P cd75a17ab2604397adab03bb8b5fd75c: Append to log took a long time: real 0.065s	user 0.000s	sys 0.001s
I20260709 13:19:31.120266  9729 consensus_queue.cc:237] T 7c44c4849aa54f2b94d1f1bef9ed546f P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:31.071322  6723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be1a92657f494cac8dd227d152f50151" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:19:31.121820  6876 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53406 (request call id 1626) took 1476 ms. Trace:
I20260709 13:19:31.122967  6876 rpcz_store.cc:276] 0709 13:19:29.645627 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:30.435264 (+789637us) service_pool.cc:224] Handling call
0709 13:19:30.435568 (+   304us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:30.435801 (+   233us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:30.435827 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:30.436391 (+   564us) log.cc:844] Serialized 26 byte log entry
0709 13:19:30.879441 (+443050us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:19:30.879485 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:30.879571 (+    86us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:31.121541 (+241970us) raft_consensus.cc:1685] finished
0709 13:19:31.121566 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:31.121733 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":403443,"threads_started":1,"wal-append.queue_time_us":473420}
I20260709 13:19:31.069394  6807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb7fa124c3bf4ef9ab65a407cb008441" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:19:31.071331  6724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be1a92657f494cac8dd227d152f50151" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:19:31.071528  9712 raft_consensus.cc:493] T bd6869f07b5a4885a0b99fbe60c3b175 P b7ab4784c7344b939bc36f639286f377 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:31.125818  9712 raft_consensus.cc:3060] T bd6869f07b5a4885a0b99fbe60c3b175 P b7ab4784c7344b939bc36f639286f377 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:31.071668  6874 raft_consensus.cc:1275] T ce4f062dcd314d43a63ca74067cb5ee3 P cd75a17ab2604397adab03bb8b5fd75c [term 7 FOLLOWER]: Refusing update from remote peer b7ab4784c7344b939bc36f639286f377: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:19:31.072362  6697 leader_election.cc:304] T c4db81d9d329422bb3b4160ca4ac2d1d P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:19:31.073110  6695 leader_election.cc:304] T 4275cf08e63345f993bce8664eada830 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
W20260709 13:19:31.127091  6697 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 54840.4us
W20260709 13:19:31.127876  6695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 54864.3us
I20260709 13:19:31.128633  6697 leader_election.cc:304] T 713b5728a197487c9300b310ab94e5a3 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377
I20260709 13:19:31.130328  6697 leader_election.cc:304] T 30e88460611e47b2ba16a46a30b5f416 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377
I20260709 13:19:31.130566  6695 leader_election.cc:304] T 853ac0a8cbd64ce99457f170216d4d0f P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:19:31.074535  6725 raft_consensus.cc:2468] T 1528ab62b6fe4e3099d08f141afee116 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in term 6.
I20260709 13:19:31.042237  9487 consensus_queue.cc:1048] T e77e330a82df4b43a745d57a68f6f057 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.091s
W20260709 13:19:31.042047  6844 connection.cc:256] RPC call timeout handler was delayed by -1.2566573750000316s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17170000000000002s for a response
W20260709 13:19:31.133747  6844 connection.cc:256] RPC call timeout handler was delayed by -1.1450573750000785s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1841s for a response
W20260709 13:19:31.134189  6844 connection.cc:256] RPC call timeout handler was delayed by -1.0604573749999417s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1935s for a response
I20260709 13:19:31.136411  6881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b8cacb381b746da8d0049b0a83b41dd" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:19:31.105902  6731 raft_consensus.cc:3055] T 404190ce4ce94cecbfcb6ea9d1dd8626 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:19:31.137444  6881 raft_consensus.cc:2393] T 4b8cacb381b746da8d0049b0a83b41dd P cd75a17ab2604397adab03bb8b5fd75c [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in current term 8: Already voted for candidate cd75a17ab2604397adab03bb8b5fd75c in this term.
I20260709 13:19:31.137506  6731 raft_consensus.cc:740] T 404190ce4ce94cecbfcb6ea9d1dd8626 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
I20260709 13:19:31.137727  9366 leader_election.cc:290] T bb3d8792045a4583ae2e965b1350a5b4 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:31.042550  9643 raft_consensus.cc:3060] T 7887766dc6784fcaa42b35c05fea7a99 P b7ab4784c7344b939bc36f639286f377 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:31.138489  6731 consensus_queue.cc:260] T 404190ce4ce94cecbfcb6ea9d1dd8626 P ccd8a4c3bfe3413cb2ae219b09aea832 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:19:31.139520  9720 raft_consensus.cc:493] T 2c240553ce044eedb41541d72b9475d7 P cd75a17ab2604397adab03bb8b5fd75c [term 8 FOLLOWER]: Starting pre-election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:19:31.139880  6731 raft_consensus.cc:3060] T 404190ce4ce94cecbfcb6ea9d1dd8626 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 7 FOLLOWER]: Advancing to term 9
W20260709 13:19:31.056304  9506 consensus_meta.cc:287] T f4b8bd455d5a47c18a1380839c6e0d61 P ccd8a4c3bfe3413cb2ae219b09aea832: Time spent flushing consensus metadata: real 0.626s	user 0.007s	sys 0.006s
I20260709 13:19:31.140506  9506 raft_consensus.cc:515] T f4b8bd455d5a47c18a1380839c6e0d61 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:31.142676  9506 leader_election.cc:290] T f4b8bd455d5a47c18a1380839c6e0d61 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 7 election: Requested vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:31.084440  9653 raft_consensus.cc:2749] T 427c124d773f483294511e80fe340075 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:19:31.084605  9628 raft_consensus.cc:2804] T 3a485a995abc4807b6e511e45419f737 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:19:31.089759  9669 raft_consensus.cc:3060] T f03d0dbf16864ca4bc1bb5e4c0334c0f P ccd8a4c3bfe3413cb2ae219b09aea832 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:31.144533  9628 raft_consensus.cc:493] T 3a485a995abc4807b6e511e45419f737 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:31.144824  9731 raft_consensus.cc:3060] T f58dc08b12a2494bb9a1372837970ca2 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:31.144999  9628 raft_consensus.cc:3060] T 3a485a995abc4807b6e511e45419f737 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:31.096442  9534 raft_consensus.cc:3060] T a3022224cc81473690653a83d4e99470 P b7ab4784c7344b939bc36f639286f377 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:19:31.149359  6873 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53406 (request call id 1617) took 1533 ms (client timeout 1542 ms). Trace:
W20260709 13:19:31.149904  6873 rpcz_store.cc:269] 0709 13:19:29.615992 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:29.668909 (+ 52917us) service_pool.cc:224] Handling call
0709 13:19:31.149032 (+1480123us) spinlock_profiling.cc:243] Waited 786 ms on lock 0x7b5400236ed4. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f9ae2fa 00007fcc1496fb17 00007fcc0deea6d4 00007fcc0deea662 00007fcc0deea591 00007fcc0deea50c 00007fcc0dee97c2 00007fcc0dce548c 00007fcc0dce48c6 00007fcc0dce426f
0709 13:19:31.149236 (+   204us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1808389376}
W20260709 13:19:31.097994  6846 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:31.152508  6727 raft_consensus.cc:1240] T fe20b4b48823486ca3b9c648db6ce8aa P ccd8a4c3bfe3413cb2ae219b09aea832 [term 6 FOLLOWER]: Rejecting Update request from peer 7ba59cc884714e8aa5f3f0ecaed84cbb for earlier term 5. Current term is 6. Ops: []
I20260709 13:19:31.154434  9709 leader_election.cc:290] T 3fa34c08b205435dba97346991aa1f92 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:19:31.155398  6879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22ccee1b570c4ad3a57bd7aec085b1b4" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:19:31.060560  6726 raft_consensus.cc:2410] T 711ef6523deb4cbe8ef2ba61e1c21c98 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c for term 9 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:19:31.156314  6879 raft_consensus.cc:2468] T 22ccee1b570c4ad3a57bd7aec085b1b4 P cd75a17ab2604397adab03bb8b5fd75c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 6.
I20260709 13:19:31.156977  6880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fa34c08b205435dba97346991aa1f92" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:19:31.157651  6880 raft_consensus.cc:2468] T 3fa34c08b205435dba97346991aa1f92 P cd75a17ab2604397adab03bb8b5fd75c [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 9.
I20260709 13:19:31.157933  6879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbdf895bba214ff68685a24fd17dfb5d" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:19:31.158608  6880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f9c2e2bf644115957398fe4c9459db" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:19:31.159511  9515 raft_consensus.cc:2804] T c4db81d9d329422bb3b4160ca4ac2d1d P ccd8a4c3bfe3413cb2ae219b09aea832 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:19:31.160230  9614 raft_consensus.cc:493] T 07a92dd554674067a83a9cb68c4773f2 P cd75a17ab2604397adab03bb8b5fd75c [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:31.160506  9515 raft_consensus.cc:697] T c4db81d9d329422bb3b4160ca4ac2d1d P ccd8a4c3bfe3413cb2ae219b09aea832 [term 8 LEADER]: Becoming Leader. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
I20260709 13:19:31.160746  9614 raft_consensus.cc:515] T 07a92dd554674067a83a9cb68c4773f2 P cd75a17ab2604397adab03bb8b5fd75c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:31.127790  7496 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50742 (request call id 338) took 1568 ms. Trace:
I20260709 13:19:31.161729  9515 consensus_queue.cc:237] T c4db81d9d329422bb3b4160ca4ac2d1d P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:31.162191  7496 rpcz_store.cc:276] 0709 13:19:29.559211 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:29.559414 (+   203us) service_pool.cc:224] Handling call
0709 13:19:29.559772 (+   358us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:30.161928 (+602156us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:31.127512 (+965584us) spinlock_profiling.cc:243] Waited 236 ms on lock 0x7b5400604d54. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f9aae01 00007fcc0f9a983e 00007fcc1496e419 00007fcc0dee5bd4 00007fcc0dee5b62 00007fcc0dee5a91 00007fcc0dee5a0c 00007fcc0dee4cc2 00007fcc0dce548c 00007fcc0dce48c6
0709 13:19:31.127725 (+   213us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":542856448}
I20260709 13:19:31.162937  9614 leader_election.cc:290] T 07a92dd554674067a83a9cb68c4773f2 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:19:31.107833  9663 consensus_queue.cc:260] T a1704639a875409b9959353527b3fd68 P b7ab4784c7344b939bc36f639286f377 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:31.163507  9726 raft_consensus.cc:993] T 9b3759de40694069b13c0f8bd40e5709 P ccd8a4c3bfe3413cb2ae219b09aea832: : Instructing follower cd75a17ab2604397adab03bb8b5fd75c to start an election
I20260709 13:19:31.164021  9717 raft_consensus.cc:2804] T 713b5728a197487c9300b310ab94e5a3 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:19:31.097563  9697 consensus_queue.cc:260] T 7a734b5ab7834e05a8c422208acc58b1 P ccd8a4c3bfe3413cb2ae219b09aea832 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:31.164150  9726 consensus_queue.cc:1048] T be1a92657f494cac8dd227d152f50151 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:19:31.164716  9717 raft_consensus.cc:697] T 713b5728a197487c9300b310ab94e5a3 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 8 LEADER]: Becoming Leader. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
I20260709 13:19:31.165150  9697 raft_consensus.cc:3060] T 7a734b5ab7834e05a8c422208acc58b1 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:31.165808  9726 consensus_queue.cc:1059] T de3186201e1a40d0b335eeb8b4e256e0 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:19:31.165700  9717 consensus_queue.cc:237] T 713b5728a197487c9300b310ab94e5a3 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:31.166930  6876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f00a2e87e56452083b759f60d461ee3" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:19:31.163793  9663 raft_consensus.cc:3060] T a1704639a875409b9959353527b3fd68 P b7ab4784c7344b939bc36f639286f377 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:31.168345  9710 raft_consensus.cc:3055] T 24ee15416e3145beaa1b8183453729a3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:19:31.168781  9710 raft_consensus.cc:740] T 24ee15416e3145beaa1b8183453729a3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 7ba59cc884714e8aa5f3f0ecaed84cbb, State: Running, Role: LEADER
I20260709 13:19:31.074193  6729 raft_consensus.cc:2468] T ce4f062dcd314d43a63ca74067cb5ee3 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in term 7.
I20260709 13:19:31.166119  6881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a75bfe094d4bdc963aba3f08dfcd25" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 9 candidate_status { last_received { term: 7 index: 2 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:19:31.171895  6881 raft_consensus.cc:2468] T 95a75bfe094d4bdc963aba3f08dfcd25 P cd75a17ab2604397adab03bb8b5fd75c [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 8.
I20260709 13:19:31.172212  6874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe20b4b48823486ca3b9c648db6ce8aa" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:19:31.172840  6874 raft_consensus.cc:3060] T fe20b4b48823486ca3b9c648db6ce8aa P cd75a17ab2604397adab03bb8b5fd75c [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:31.174741  6844 leader_election.cc:304] T 30e88460611e47b2ba16a46a30b5f416 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:19:31.175220  6799 raft_consensus.cc:1275] T 404190ce4ce94cecbfcb6ea9d1dd8626 P b7ab4784c7344b939bc36f639286f377 [term 9 FOLLOWER]: Refusing update from remote peer 7ba59cc884714e8aa5f3f0ecaed84cbb: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:19:31.140354  9720 raft_consensus.cc:515] T 2c240553ce044eedb41541d72b9475d7 P cd75a17ab2604397adab03bb8b5fd75c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
W20260709 13:19:31.177013  6772 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 60596.4us
I20260709 13:19:31.188998  6800 raft_consensus.cc:2468] T 7ba5dac66ab5497e9e336f2a3c28cda5 P b7ab4784c7344b939bc36f639286f377 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in term 9.
I20260709 13:19:31.190230  6879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3d8792045a4583ae2e965b1350a5b4" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:19:31.179245  9259 raft_consensus.cc:2764] T 853ac0a8cbd64ce99457f170216d4d0f P ccd8a4c3bfe3413cb2ae219b09aea832 [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
I20260709 13:19:31.163828  9626 raft_consensus.cc:2804] T 4275cf08e63345f993bce8664eada830 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:19:31.185983  9649 consensus_queue.cc:1059] T 4275cf08e63345f993bce8664eada830 P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.016s
I20260709 13:19:31.202786  9649 raft_consensus.cc:3055] T 4275cf08e63345f993bce8664eada830 P cd75a17ab2604397adab03bb8b5fd75c [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:19:31.203358  9649 raft_consensus.cc:740] T 4275cf08e63345f993bce8664eada830 P cd75a17ab2604397adab03bb8b5fd75c [term 7 LEADER]: Becoming Follower/Learner. State: Replica: cd75a17ab2604397adab03bb8b5fd75c, State: Running, Role: LEADER
I20260709 13:19:31.205106  6873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77e330a82df4b43a745d57a68f6f057" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 10 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:19:31.206530  9526 raft_consensus.cc:3055] T de3186201e1a40d0b335eeb8b4e256e0 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:19:31.207085  9526 raft_consensus.cc:740] T de3186201e1a40d0b335eeb8b4e256e0 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
I20260709 13:19:31.208027  9526 consensus_queue.cc:260] T de3186201e1a40d0b335eeb8b4e256e0 P ccd8a4c3bfe3413cb2ae219b09aea832 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
W20260709 13:19:31.178143  6695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 47664.5us
I20260709 13:19:31.126461  9616 leader_election.cc:290] T 7c37d41cd9164c15a6826ca62a851a69 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:19:31.201433  9711 consensus_queue.cc:1048] T ab432e62819d499eaaf3dd55481dd930 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.002s
I20260709 13:19:31.213563  6878 raft_consensus.cc:1275] T bd6869f07b5a4885a0b99fbe60c3b175 P cd75a17ab2604397adab03bb8b5fd75c [term 7 FOLLOWER]: Refusing update from remote peer ccd8a4c3bfe3413cb2ae219b09aea832: Log matching property violated. Preceding OpId in replica: term: 5 index: 2. Preceding OpId from leader: term: 7 index: 3. (index mismatch)
I20260709 13:19:31.217697  6881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb7fa124c3bf4ef9ab65a407cb008441" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
W20260709 13:19:31.227669  6697 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 96285.6us
W20260709 13:19:31.233074  6698 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:31.236604  6772 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 50927.2us
I20260709 13:19:31.177234  6844 leader_election.cc:304] T fe20b4b48823486ca3b9c648db6ce8aa P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:19:31.240060  6874 raft_consensus.cc:2468] T fe20b4b48823486ca3b9c648db6ce8aa P cd75a17ab2604397adab03bb8b5fd75c [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 6.
I20260709 13:19:31.240567  6806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77e330a82df4b43a745d57a68f6f057" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 10 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:19:31.241035  6880 raft_consensus.cc:1240] T fe20b4b48823486ca3b9c648db6ce8aa P cd75a17ab2604397adab03bb8b5fd75c [term 6 FOLLOWER]: Rejecting Update request from peer 7ba59cc884714e8aa5f3f0ecaed84cbb for earlier term 5. Current term is 6. Ops: []
I20260709 13:19:31.236343  6729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17587d6730594da4a56fa13a353232a1" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:19:31.244138  6799 raft_consensus.cc:1275] T 17587d6730594da4a56fa13a353232a1 P b7ab4784c7344b939bc36f639286f377 [term 9 FOLLOWER]: Refusing update from remote peer ccd8a4c3bfe3413cb2ae219b09aea832: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:19:31.189848  9545 raft_consensus.cc:493] T 7ba5dac66ab5497e9e336f2a3c28cda5 P b7ab4784c7344b939bc36f639286f377 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:31.096174  9687 leader_election.cc:290] T a3022224cc81473690653a83d4e99470 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:31.030215  6770 leader_election.cc:304] T 8c7f33e544204fbaac4078e3e83bbf4e P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:19:31.185974  9654 raft_consensus.cc:2804] T 30e88460611e47b2ba16a46a30b5f416 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:19:31.186888  9639 raft_consensus.cc:1081] T 9b3759de40694069b13c0f8bd40e5709 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 6 LEADER]: Signalling peer cd75a17ab2604397adab03bb8b5fd75c to start an election
I20260709 13:19:31.186376  9691 raft_consensus.cc:2804] T d8cee0accdb8499c86d4414b72565a38 P b7ab4784c7344b939bc36f639286f377 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:19:31.209198  9526 raft_consensus.cc:3060] T de3186201e1a40d0b335eeb8b4e256e0 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:31.304527  9691 raft_consensus.cc:493] T d8cee0accdb8499c86d4414b72565a38 P b7ab4784c7344b939bc36f639286f377 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 7ba59cc884714e8aa5f3f0ecaed84cbb)
I20260709 13:19:31.305492  9691 raft_consensus.cc:3060] T d8cee0accdb8499c86d4414b72565a38 P b7ab4784c7344b939bc36f639286f377 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:19:31.305699  6772 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 49556.2us
I20260709 13:19:31.186084  9608 raft_consensus.cc:2749] T 30e88460611e47b2ba16a46a30b5f416 P cd75a17ab2604397adab03bb8b5fd75c [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:19:31.247803  6799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17587d6730594da4a56fa13a353232a1" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
W20260709 13:19:31.250814  6770 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 220710us
I20260709 13:19:31.249259  6804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a75bfe094d4bdc963aba3f08dfcd25" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 9 candidate_status { last_received { term: 7 index: 2 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:19:31.308350  6799 raft_consensus.cc:2468] T 17587d6730594da4a56fa13a353232a1 P b7ab4784c7344b939bc36f639286f377 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in term 9.
I20260709 13:19:31.259590  6803 raft_consensus.cc:1240] T 7a734b5ab7834e05a8c422208acc58b1 P b7ab4784c7344b939bc36f639286f377 [term 8 FOLLOWER]: Rejecting Update request from peer ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 7. Current term is 8. Ops: [7.4-7.4]
W20260709 13:19:31.262221  6773 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:31.309405  6799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3f13b31a1f84f0d89d007eadd57924c" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:19:31.264196  6627 catalog_manager.cc:5697] T 427c124d773f483294511e80fe340075 P 7ba59cc884714e8aa5f3f0ecaed84cbb reported cstate change: config changed from index 2 to 3, 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68) changed from NON_VOTER to VOTER, no longer has a pending config: VOTER ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65), VOTER b7ab4784c7344b939bc36f639286f377 (127.5.126.66), VOTER cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67), VOTER 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68). New cstate: current_term: 5 leader_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:19:31.271381  6801 raft_consensus.cc:2468] T a3022224cc81473690653a83d4e99470 P b7ab4784c7344b939bc36f639286f377 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 7.
I20260709 13:19:31.245903  9545 raft_consensus.cc:515] T 7ba5dac66ab5497e9e336f2a3c28cda5 P b7ab4784c7344b939bc36f639286f377 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
W20260709 13:19:31.272753  6800 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50550 (request call id 262) took 2020 ms (client timeout 1765 ms). Trace:
I20260709 13:19:31.179899  9710 consensus_queue.cc:260] T 24ee15416e3145beaa1b8183453729a3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:19:31.216784  9487 consensus_queue.cc:1059] T 30e88460611e47b2ba16a46a30b5f416 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.063s
I20260709 13:19:31.251055  9616 raft_consensus.cc:2749] T fe20b4b48823486ca3b9c648db6ce8aa P cd75a17ab2604397adab03bb8b5fd75c [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:19:31.277511  6697 leader_election.cc:304] T 22ccee1b570c4ad3a57bd7aec085b1b4 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
W20260709 13:19:31.336449  6697 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 59019.8us
I20260709 13:19:31.337260  6697 leader_election.cc:304] T 3fa34c08b205435dba97346991aa1f92 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:19:31.278312  9653 consensus_queue.cc:1059] T 4b8cacb381b746da8d0049b0a83b41dd P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
W20260709 13:19:31.279989  9489 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 9 current term: 9 is higher.
I20260709 13:19:31.284423  9654 raft_consensus.cc:697] T 30e88460611e47b2ba16a46a30b5f416 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 7 LEADER]: Becoming Leader. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
I20260709 13:19:31.285050  7496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fa34c08b205435dba97346991aa1f92" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:19:31.286741  9720 leader_election.cc:290] T 2c240553ce044eedb41541d72b9475d7 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
W20260709 13:19:31.287019  6771 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:31.404909  6771 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:31.404624  9657 raft_consensus.cc:515] T 07a92dd554674067a83a9cb68c4773f2 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:31.406910  9657 leader_election.cc:290] T 07a92dd554674067a83a9cb68c4773f2 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 8 election: Requested vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
W20260709 13:19:31.287993  6698 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:31.409054  6698 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:31.408628  9031 consensus_queue.cc:1048] T 711ef6523deb4cbe8ef2ba61e1c21c98 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:19:31.288780  9676 raft_consensus.cc:493] T 711ef6523deb4cbe8ef2ba61e1c21c98 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:31.409844  9676 raft_consensus.cc:515] T 711ef6523deb4cbe8ef2ba61e1c21c98 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:31.248104  9726 consensus_queue.cc:1059] T d8292e16e5654be6bc408560cf256aaa P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 1, Time since last communication: 0.045s
I20260709 13:19:31.413460  9726 raft_consensus.cc:3055] T d8292e16e5654be6bc408560cf256aaa P ccd8a4c3bfe3413cb2ae219b09aea832 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:19:31.413884  9726 raft_consensus.cc:740] T d8292e16e5654be6bc408560cf256aaa P ccd8a4c3bfe3413cb2ae219b09aea832 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
I20260709 13:19:31.414635  9726 consensus_queue.cc:260] T d8292e16e5654be6bc408560cf256aaa P ccd8a4c3bfe3413cb2ae219b09aea832 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:31.293018  6872 raft_consensus.cc:1240] T 9e326172347f45e99a0d482b5d8ef768 P cd75a17ab2604397adab03bb8b5fd75c [term 6 LEADER]: Rejecting Update request from peer ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 5. Current term is 6. Ops: []
I20260709 13:19:31.280350  6807 raft_consensus.cc:1240] T d8292e16e5654be6bc408560cf256aaa P b7ab4784c7344b939bc36f639286f377 [term 9 FOLLOWER]: Rejecting Update request from peer ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 8. Current term is 9. Ops: []
I20260709 13:19:31.417991  6807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f9c2e2bf644115957398fe4c9459db" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:19:31.417748  9564 raft_consensus.cc:515] T 90d42e216d9741e190bca19a781291fd P b7ab4784c7344b939bc36f639286f377 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:31.418999  6798 raft_consensus.cc:1240] T 90d42e216d9741e190bca19a781291fd P b7ab4784c7344b939bc36f639286f377 [term 8 FOLLOWER]: Rejecting Update request from peer ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 7. Current term is 8. Ops: []
I20260709 13:19:31.419114  6807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22ccee1b570c4ad3a57bd7aec085b1b4" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:19:31.419860  9717 raft_consensus.cc:2804] T 3fa34c08b205435dba97346991aa1f92 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 13:19:31.245462  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 68290.9us
I20260709 13:19:31.420550  9717 raft_consensus.cc:493] T 3fa34c08b205435dba97346991aa1f92 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 7ba59cc884714e8aa5f3f0ecaed84cbb)
I20260709 13:19:31.316939  6802 raft_consensus.cc:2468] T be1a92657f494cac8dd227d152f50151 P b7ab4784c7344b939bc36f639286f377 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in term 9.
W20260709 13:19:31.322258  7466 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 72248us
I20260709 13:19:31.421356  6844 leader_election.cc:304] T 3411566abe2d4c9bb4b2adfdd05e6f17 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:19:31.422041  7466 leader_election.cc:304] T 7ba5dac66ab5497e9e336f2a3c28cda5 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:19:31.422122  6802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34f36d59d88f40fe8a2805e604fc6c0a" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:19:31.422305  9712 raft_consensus.cc:515] T bd6869f07b5a4885a0b99fbe60c3b175 P b7ab4784c7344b939bc36f639286f377 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:31.422971  6802 raft_consensus.cc:2468] T 34f36d59d88f40fe8a2805e604fc6c0a P b7ab4784c7344b939bc36f639286f377 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 5.
W20260709 13:19:31.319939  6800 rpcz_store.cc:269] 0709 13:19:29.252452 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:29.260150 (+  7698us) service_pool.cc:224] Handling call
0709 13:19:31.272324 (+2012174us) spinlock_profiling.cc:243] Waited 1.73 s on lock 0x7b5400185e54. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f9ae2fa 00007fcc1496fb17 00007fcc0deea6d4 00007fcc0deea662 00007fcc0deea591 00007fcc0deea50c 00007fcc0dee97c2 00007fcc0dce548c 00007fcc0dce48c6 00007fcc0dce426f
0709 13:19:31.272541 (+   217us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3987332864}
I20260709 13:19:31.423251  9608 consensus_queue.cc:1059] T 8c7f33e544204fbaac4078e3e83bbf4e P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.001s
W20260709 13:19:31.325522  6801 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:32966 (request call id 822) took 1655 ms (client timeout 1947 ms). Trace:
I20260709 13:19:31.422892  6844 leader_election.cc:304] T 4d9def8b32fd443aa94ab1420b06837b P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377
I20260709 13:19:31.325907  6806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c37d41cd9164c15a6826ca62a851a69" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:19:31.427773  9736 consensus_queue.cc:1048] T 404190ce4ce94cecbfcb6ea9d1dd8626 P 7ba59cc884714e8aa5f3f0ecaed84cbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:19:31.428409  6806 raft_consensus.cc:2468] T 7c37d41cd9164c15a6826ca62a851a69 P b7ab4784c7344b939bc36f639286f377 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 6.
I20260709 13:19:31.429308  9390 raft_consensus.cc:2749] T 7ba5dac66ab5497e9e336f2a3c28cda5 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:19:31.430178  6806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3022224cc81473690653a83d4e99470" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:19:31.431255  6806 raft_consensus.cc:2468] T a3022224cc81473690653a83d4e99470 P b7ab4784c7344b939bc36f639286f377 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 7.
I20260709 13:19:31.432163  9643 raft_consensus.cc:515] T 7887766dc6784fcaa42b35c05fea7a99 P b7ab4784c7344b939bc36f639286f377 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:31.433616  6805 raft_consensus.cc:1240] T 7887766dc6784fcaa42b35c05fea7a99 P b7ab4784c7344b939bc36f639286f377 [term 8 FOLLOWER]: Rejecting Update request from peer ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 6. Current term is 8. Ops: []
I20260709 13:19:31.434541  6806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4b8bd455d5a47c18a1380839c6e0d61" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:19:31.434866  9643 leader_election.cc:290] T 7887766dc6784fcaa42b35c05fea7a99 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 8 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:31.415848  9726 raft_consensus.cc:3060] T d8292e16e5654be6bc408560cf256aaa P ccd8a4c3bfe3413cb2ae219b09aea832 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:31.436318  6806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1704639a875409b9959353527b3fd68" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:19:31.339666  6697 leader_election.cc:304] T 95a75bfe094d4bdc963aba3f08dfcd25 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:19:31.436901  9450 consensus_queue.cc:1048] T 4d9def8b32fd443aa94ab1420b06837b P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:19:31.339038  6627 catalog_manager.cc:5697] T 24ee15416e3145beaa1b8183453729a3 P 7ba59cc884714e8aa5f3f0ecaed84cbb reported cstate change: config changed from index 3 to 7, term changed from 4 to 6, VOTER b7ab4784c7344b939bc36f639286f377 (127.5.126.66) evicted. New cstate: current_term: 6 leader_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:19:31.439011  9720 raft_consensus.cc:3055] T 8c7f33e544204fbaac4078e3e83bbf4e P cd75a17ab2604397adab03bb8b5fd75c [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:19:31.439499  9720 raft_consensus.cc:740] T 8c7f33e544204fbaac4078e3e83bbf4e P cd75a17ab2604397adab03bb8b5fd75c [term 4 LEADER]: Becoming Follower/Learner. State: Replica: cd75a17ab2604397adab03bb8b5fd75c, State: Running, Role: LEADER
I20260709 13:19:31.440457  9720 consensus_queue.cc:260] T 8c7f33e544204fbaac4078e3e83bbf4e P cd75a17ab2604397adab03bb8b5fd75c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:31.441617  9720 raft_consensus.cc:3060] T 8c7f33e544204fbaac4078e3e83bbf4e P cd75a17ab2604397adab03bb8b5fd75c [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:19:31.421357  9717 raft_consensus.cc:3060] T 3fa34c08b205435dba97346991aa1f92 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:31.254347  9626 raft_consensus.cc:697] T 4275cf08e63345f993bce8664eada830 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 8 LEADER]: Becoming Leader. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
I20260709 13:19:31.444805  9626 consensus_queue.cc:237] T 4275cf08e63345f993bce8664eada830 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:31.447409  6803 raft_consensus.cc:1275] T e31b9971c15848dea59d4d4130141d9e P b7ab4784c7344b939bc36f639286f377 [term 5 FOLLOWER]: Refusing update from remote peer ccd8a4c3bfe3413cb2ae219b09aea832: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:19:31.449751  6799 raft_consensus.cc:1275] T b56bf91d90824c959e21e0cee5ba1816 P b7ab4784c7344b939bc36f639286f377 [term 8 FOLLOWER]: Refusing update from remote peer ccd8a4c3bfe3413cb2ae219b09aea832: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:19:31.451133  6799 raft_consensus.cc:1240] T bd6869f07b5a4885a0b99fbe60c3b175 P b7ab4784c7344b939bc36f639286f377 [term 8 FOLLOWER]: Rejecting Update request from peer ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 7. Current term is 8. Ops: [7.3-7.3]
I20260709 13:19:31.450965  9691 raft_consensus.cc:515] T d8cee0accdb8499c86d4414b72565a38 P b7ab4784c7344b939bc36f639286f377 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:19:31.452934  9710 raft_consensus.cc:3060] T 24ee15416e3145beaa1b8183453729a3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:31.376717  9687 raft_consensus.cc:2804] T 22ccee1b570c4ad3a57bd7aec085b1b4 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:19:31.457476  6697 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 117907us
I20260709 13:19:31.459030  6697 leader_election.cc:304] T fe20b4b48823486ca3b9c648db6ce8aa P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:19:31.464452  6880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c37d41cd9164c15a6826ca62a851a69" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:19:31.465188  6880 raft_consensus.cc:2468] T 7c37d41cd9164c15a6826ca62a851a69 P cd75a17ab2604397adab03bb8b5fd75c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 6.
I20260709 13:19:31.466074  6880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4b8bd455d5a47c18a1380839c6e0d61" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:19:31.468565  6879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1704639a875409b9959353527b3fd68" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:19:31.470188  6876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3022224cc81473690653a83d4e99470" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:19:31.472355  6874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34f36d59d88f40fe8a2805e604fc6c0a" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:19:31.473815  6874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a92dd554674067a83a9cb68c4773f2" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:19:31.474438  6874 raft_consensus.cc:3060] T 07a92dd554674067a83a9cb68c4773f2 P cd75a17ab2604397adab03bb8b5fd75c [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:31.476222  6878 raft_consensus.cc:1275] T b56bf91d90824c959e21e0cee5ba1816 P cd75a17ab2604397adab03bb8b5fd75c [term 8 FOLLOWER]: Refusing update from remote peer ccd8a4c3bfe3413cb2ae219b09aea832: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:19:31.479593  6879 raft_consensus.cc:2393] T a1704639a875409b9959353527b3fd68 P cd75a17ab2604397adab03bb8b5fd75c [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ccd8a4c3bfe3413cb2ae219b09aea832 in current term 7: Already voted for candidate cd75a17ab2604397adab03bb8b5fd75c in this term.
I20260709 13:19:31.480683  6879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "711ef6523deb4cbe8ef2ba61e1c21c98" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:19:31.481153  6695 leader_election.cc:304] T e77e330a82df4b43a745d57a68f6f057 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:19:31.305519  9589 consensus_queue.cc:1059] T 713b5728a197487c9300b310ab94e5a3 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.081s
I20260709 13:19:31.501430  9526 raft_consensus.cc:3055] T 4b8cacb381b746da8d0049b0a83b41dd P ccd8a4c3bfe3413cb2ae219b09aea832 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:19:31.391161  9628 raft_consensus.cc:515] T 3a485a995abc4807b6e511e45419f737 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:31.502199  9526 raft_consensus.cc:740] T 4b8cacb381b746da8d0049b0a83b41dd P ccd8a4c3bfe3413cb2ae219b09aea832 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
I20260709 13:19:31.503165  9526 consensus_queue.cc:260] T 4b8cacb381b746da8d0049b0a83b41dd P ccd8a4c3bfe3413cb2ae219b09aea832 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:19:31.504202  9628 leader_election.cc:290] T 3a485a995abc4807b6e511e45419f737 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 7 election: Requested vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:31.504925  9728 raft_consensus.cc:493] T 9e326172347f45e99a0d482b5d8ef768 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:31.505043  9628 raft_consensus.cc:2749] T e77e330a82df4b43a745d57a68f6f057 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:19:31.505467  9728 raft_consensus.cc:515] T 9e326172347f45e99a0d482b5d8ef768 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:31.424322  9608 raft_consensus.cc:2749] T 3411566abe2d4c9bb4b2adfdd05e6f17 P cd75a17ab2604397adab03bb8b5fd75c [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:19:31.424463  7466 leader_election.cc:304] T 17587d6730594da4a56fa13a353232a1 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, b7ab4784c7344b939bc36f639286f377; no voters: 
I20260709 13:19:31.322613  6770 leader_election.cc:304] T f4b8bd455d5a47c18a1380839c6e0d61 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:19:31.424329  6800 raft_consensus.cc:1240] T f03d0dbf16864ca4bc1bb5e4c0334c0f P b7ab4784c7344b939bc36f639286f377 [term 6 FOLLOWER]: Rejecting Update request from peer ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 5. Current term is 6. Ops: []
I20260709 13:19:31.257473  9688 consensus_queue.cc:1059] T 2c240553ce044eedb41541d72b9475d7 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.339s
I20260709 13:19:31.423910  6802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab432e62819d499eaaf3dd55481dd930" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 9 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:19:31.501549  6881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab432e62819d499eaaf3dd55481dd930" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 9 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:19:31.410085  6804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbdf895bba214ff68685a24fd17dfb5d" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
W20260709 13:19:31.507828  7466 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 83397.7us
I20260709 13:19:31.509274  6881 raft_consensus.cc:2468] T ab432e62819d499eaaf3dd55481dd930 P cd75a17ab2604397adab03bb8b5fd75c [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 8.
I20260709 13:19:31.319881  9561 consensus_queue.cc:1048] T 95a75bfe094d4bdc963aba3f08dfcd25 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.131s
I20260709 13:19:31.255203  9588 raft_consensus.cc:2749] T 8c7f33e544204fbaac4078e3e83bbf4e P b7ab4784c7344b939bc36f639286f377 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:19:31.488287  9627 raft_consensus.cc:2804] T 4d9def8b32fd443aa94ab1420b06837b P cd75a17ab2604397adab03bb8b5fd75c [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:19:31.523977  9627 raft_consensus.cc:493] T 4d9def8b32fd443aa94ab1420b06837b P cd75a17ab2604397adab03bb8b5fd75c [term 7 FOLLOWER]: Starting leader election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:19:31.501374  9669 raft_consensus.cc:2804] T fe20b4b48823486ca3b9c648db6ce8aa P ccd8a4c3bfe3413cb2ae219b09aea832 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:19:31.524709  9627 raft_consensus.cc:3060] T 4d9def8b32fd443aa94ab1420b06837b P cd75a17ab2604397adab03bb8b5fd75c [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:31.526175  9691 leader_election.cc:290] T d8cee0accdb8499c86d4414b72565a38 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 7 election: Requested vote from peers cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:19:31.527532  9688 raft_consensus.cc:3055] T 2c240553ce044eedb41541d72b9475d7 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:19:31.507736  9728 leader_election.cc:290] T 9e326172347f45e99a0d482b5d8ef768 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:31.528110  9688 raft_consensus.cc:740] T 2c240553ce044eedb41541d72b9475d7 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
I20260709 13:19:31.529597  9553 raft_consensus.cc:2804] T f4b8bd455d5a47c18a1380839c6e0d61 P b7ab4784c7344b939bc36f639286f377 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:19:31.530115  9553 raft_consensus.cc:493] T f4b8bd455d5a47c18a1380839c6e0d61 P b7ab4784c7344b939bc36f639286f377 [term 6 FOLLOWER]: Starting leader election (detected failure of leader cd75a17ab2604397adab03bb8b5fd75c)
I20260709 13:19:31.530514  9553 raft_consensus.cc:3060] T f4b8bd455d5a47c18a1380839c6e0d61 P b7ab4784c7344b939bc36f639286f377 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:31.531388  9489 consensus_queue.cc:1048] T 17587d6730594da4a56fa13a353232a1 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:19:31.532442  6695 leader_election.cc:304] T f3f9c2e2bf644115957398fe4c9459db P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:19:31.532645  9669 raft_consensus.cc:697] T fe20b4b48823486ca3b9c648db6ce8aa P ccd8a4c3bfe3413cb2ae219b09aea832 [term 6 LEADER]: Becoming Leader. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
I20260709 13:19:31.471143  6876 raft_consensus.cc:2468] T a3022224cc81473690653a83d4e99470 P cd75a17ab2604397adab03bb8b5fd75c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 6.
I20260709 13:19:31.510637  6878 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9b3759de40694069b13c0f8bd40e5709"
dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
 from {username='slave'} at 127.0.0.1:53416
I20260709 13:19:31.533712  9669 consensus_queue.cc:237] T fe20b4b48823486ca3b9c648db6ce8aa P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:19:31.534540  6878 raft_consensus.cc:493] T 9b3759de40694069b13c0f8bd40e5709 P cd75a17ab2604397adab03bb8b5fd75c [term 6 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:19:31.534904  6878 raft_consensus.cc:3060] T 9b3759de40694069b13c0f8bd40e5709 P cd75a17ab2604397adab03bb8b5fd75c [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:31.524482  9589 raft_consensus.cc:3055] T 713b5728a197487c9300b310ab94e5a3 P b7ab4784c7344b939bc36f639286f377 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:19:31.536134  9589 raft_consensus.cc:740] T 713b5728a197487c9300b310ab94e5a3 P b7ab4784c7344b939bc36f639286f377 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
I20260709 13:19:31.536362  9653 raft_consensus.cc:2749] T f3f9c2e2bf644115957398fe4c9459db P ccd8a4c3bfe3413cb2ae219b09aea832 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:19:31.524379  9526 raft_consensus.cc:3060] T 4b8cacb381b746da8d0049b0a83b41dd P ccd8a4c3bfe3413cb2ae219b09aea832 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:31.537030  9589 consensus_queue.cc:260] T 713b5728a197487c9300b310ab94e5a3 P b7ab4784c7344b939bc36f639286f377 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:31.457163  9687 raft_consensus.cc:493] T 22ccee1b570c4ad3a57bd7aec085b1b4 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:31.538342  9687 raft_consensus.cc:3060] T 22ccee1b570c4ad3a57bd7aec085b1b4 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:31.381984  9639 raft_consensus.cc:493] T 24ee15416e3145beaa1b8183453729a3 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:31.539673  9639 raft_consensus.cc:515] T 24ee15416e3145beaa1b8183453729a3 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:19:31.479650  9676 leader_election.cc:290] T 711ef6523deb4cbe8ef2ba61e1c21c98 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:31.496152  6872 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53416 (request call id 2433) took 1376 ms. Trace:
I20260709 13:19:31.499778  9545 leader_election.cc:290] T 7ba5dac66ab5497e9e336f2a3c28cda5 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:19:31.500298  9697 consensus_queue.cc:1048] T bd6869f07b5a4885a0b99fbe60c3b175 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:19:31.542204  9639 leader_election.cc:290] T 24ee15416e3145beaa1b8183453729a3 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:19:31.483565  9657 raft_consensus.cc:2804] T 95a75bfe094d4bdc963aba3f08dfcd25 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:19:31.485392  6697 leader_election.cc:304] T 1528ab62b6fe4e3099d08f141afee116 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, b7ab4784c7344b939bc36f639286f377
I20260709 13:19:31.500980  6873 raft_consensus.cc:1275] T 1bf4668eeb70467fb3dc5a0289233b3c P cd75a17ab2604397adab03bb8b5fd75c [term 7 FOLLOWER]: Refusing update from remote peer ccd8a4c3bfe3413cb2ae219b09aea832: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:19:31.425765  9564 leader_election.cc:290] T 90d42e216d9741e190bca19a781291fd P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 8 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
W20260709 13:19:31.544132  6697 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.68:45071, user_credentials={real_user=slave}} blocked reactor thread for 59017.8us
I20260709 13:19:31.545022  6799 raft_consensus.cc:1240] T be1a92657f494cac8dd227d152f50151 P b7ab4784c7344b939bc36f639286f377 [term 9 FOLLOWER]: Rejecting Update request from peer ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 8. Current term is 9. Ops: [8.8-8.8]
I20260709 13:19:31.546085  6697 leader_election.cc:304] T b3f13b31a1f84f0d89d007eadd57924c P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, b7ab4784c7344b939bc36f639286f377
I20260709 13:19:31.501500  9712 leader_election.cc:290] T bd6869f07b5a4885a0b99fbe60c3b175 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 8 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:31.548055  9697 raft_consensus.cc:2749] T 1528ab62b6fe4e3099d08f141afee116 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:19:31.512969  6770 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 190463us
I20260709 13:19:31.550230  6770 leader_election.cc:304] T f09c2a98de1a4decabd0ff900dd44caa P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:19:31.515622  7466 leader_election.cc:304] T 1528ab62b6fe4e3099d08f141afee116 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: b7ab4784c7344b939bc36f639286f377
I20260709 13:19:31.550696  6695 leader_election.cc:304] T 34f36d59d88f40fe8a2805e604fc6c0a P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
I20260709 13:19:31.551537  6695 leader_election.cc:304] T 7c37d41cd9164c15a6826ca62a851a69 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
I20260709 13:19:31.552066  7466 leader_election.cc:304] T ce4f062dcd314d43a63ca74067cb5ee3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377
I20260709 13:19:31.522598  9586 raft_consensus.cc:2804] T 17587d6730594da4a56fa13a353232a1 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:19:31.522779  9654 consensus_queue.cc:237] T 30e88460611e47b2ba16a46a30b5f416 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:31.529114  9688 consensus_queue.cc:260] T 2c240553ce044eedb41541d72b9475d7 P ccd8a4c3bfe3413cb2ae219b09aea832 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:31.543118  9657 raft_consensus.cc:493] T 95a75bfe094d4bdc963aba3f08dfcd25 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:31.481413  6879 raft_consensus.cc:2468] T 711ef6523deb4cbe8ef2ba61e1c21c98 P cd75a17ab2604397adab03bb8b5fd75c [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 8.
W20260709 13:19:31.426010  6801 rpcz_store.cc:269] 0709 13:19:29.670411 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:30.130465 (+460054us) service_pool.cc:224] Handling call
0709 13:19:31.325328 (+1194863us) spinlock_profiling.cc:243] Waited 1.13 s on lock 0x7b5400185454. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f9ae2fa 00007fcc1496fb17 00007fcc0deea6d4 00007fcc0deea662 00007fcc0deea591 00007fcc0deea50c 00007fcc0dee97c2 00007fcc0dce548c 00007fcc0dce48c6 00007fcc0dce426f
0709 13:19:31.325451 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2599452928}
I20260709 13:19:31.541842  6872 rpcz_store.cc:276] 0709 13:19:30.119678 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:30.858787 (+739109us) service_pool.cc:224] Handling call
0709 13:19:30.875918 (+ 17131us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:31.416265 (+540347us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:31.495675 (+ 79410us) spinlock_profiling.cc:243] Waited 380 ms on lock 0x7b54000d2354. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f9aae01 00007fcc0f9a983e 00007fcc1496e419 00007fcc0dee5bd4 00007fcc0dee5b62 00007fcc0dee5a91 00007fcc0dee5a0c 00007fcc0dee4cc2 00007fcc0dce548c 00007fcc0dce48c6
0709 13:19:31.496067 (+   392us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":873713024}
I20260709 13:19:31.538385  9589 raft_consensus.cc:3060] T 713b5728a197487c9300b310ab94e5a3 P b7ab4784c7344b939bc36f639286f377 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:31.555553  9390 consensus_queue.cc:1059] T fe20b4b48823486ca3b9c648db6ce8aa P 7ba59cc884714e8aa5f3f0ecaed84cbb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:19:31.556318  9366 raft_consensus.cc:2804] T 1528ab62b6fe4e3099d08f141afee116 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:19:31.556146  9712 consensus_queue.cc:1048] T 95a75bfe094d4bdc963aba3f08dfcd25 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:19:31.558028  9586 raft_consensus.cc:493] T 17587d6730594da4a56fa13a353232a1 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:31.550266  6627 catalog_manager.cc:5697] T 4f00a2e87e56452083b759f60d461ee3 P 7ba59cc884714e8aa5f3f0ecaed84cbb reported cstate change: term changed from 4 to 7, leader changed from 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68) to b7ab4784c7344b939bc36f639286f377 (127.5.126.66). New cstate: current_term: 7 leader_uuid: "b7ab4784c7344b939bc36f639286f377" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } } }
W20260709 13:19:31.558982  7468 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:31.558921  6770 leader_election.cc:304] T 7a734b5ab7834e05a8c422208acc58b1 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:19:31.587131  6770 leader_election.cc:304] T f03d0dbf16864ca4bc1bb5e4c0334c0f P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
W20260709 13:19:31.327623  9734 log.cc:927] Time spent T e77e330a82df4b43a745d57a68f6f057 P cd75a17ab2604397adab03bb8b5fd75c: Append to log took a long time: real 0.119s	user 0.007s	sys 0.000s
I20260709 13:19:31.552372  6695 leader_election.cc:304] T a3022224cc81473690653a83d4e99470 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
I20260709 13:19:31.570003  9736 raft_consensus.cc:2764] T ce4f062dcd314d43a63ca74067cb5ee3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 7 FOLLOWER]: Leader pre-election decision vote started in defunct term 6: won
I20260709 13:19:31.595067  6695 leader_election.cc:304] T dbdf895bba214ff68685a24fd17dfb5d P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:19:31.320780  9649 consensus_queue.cc:260] T 4275cf08e63345f993bce8664eada830 P cd75a17ab2604397adab03bb8b5fd75c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:31.570408  6731 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f09c2a98de1a4decabd0ff900dd44caa"
dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
mode: GRACEFUL
new_leader_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
 from {username='slave'} at 127.0.0.1:38536
I20260709 13:19:31.607577  6731 raft_consensus.cc:606] T f09c2a98de1a4decabd0ff900dd44caa P ccd8a4c3bfe3413cb2ae219b09aea832 [term 8 FOLLOWER]: Received request to transfer leadership to TS cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:19:31.608053  6731 raft_consensus.cc:614] T f09c2a98de1a4decabd0ff900dd44caa P ccd8a4c3bfe3413cb2ae219b09aea832 [term 8 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:19:31.574275  6805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "711ef6523deb4cbe8ef2ba61e1c21c98" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:19:31.564695  6799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a92dd554674067a83a9cb68c4773f2" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
W20260709 13:19:31.580502  6847 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:31.581069  6806 raft_consensus.cc:2468] T a1704639a875409b9959353527b3fd68 P b7ab4784c7344b939bc36f639286f377 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 7.
I20260709 13:19:31.556895  9502 raft_consensus.cc:2804] T 7c37d41cd9164c15a6826ca62a851a69 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:19:31.549012  9259 raft_consensus.cc:2749] T b3f13b31a1f84f0d89d007eadd57924c P ccd8a4c3bfe3413cb2ae219b09aea832 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:19:31.587409  6697 leader_election.cc:304] T ab432e62819d499eaaf3dd55481dd930 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:19:31.549177  6844 leader_election.cc:304] T 90d42e216d9741e190bca19a781291fd P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
W20260709 13:19:31.617218  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 68166.6us
I20260709 13:19:31.618884  6697 leader_election.cc:304] T f4b8bd455d5a47c18a1380839c6e0d61 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:19:31.619123  6844 leader_election.cc:304] T 427c124d773f483294511e80fe340075 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, ccd8a4c3bfe3413cb2ae219b09aea832
W20260709 13:19:31.621309  6728 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.556s	user 0.008s	sys 0.010s
I20260709 13:19:31.571614  9564 raft_consensus.cc:2749] T f09c2a98de1a4decabd0ff900dd44caa P b7ab4784c7344b939bc36f639286f377 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:19:31.595412  6770 leader_election.cc:304] T 9b3759de40694069b13c0f8bd40e5709 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:19:31.597760  6879 raft_consensus.cc:1275] T e31b9971c15848dea59d4d4130141d9e P cd75a17ab2604397adab03bb8b5fd75c [term 5 FOLLOWER]: Refusing update from remote peer ccd8a4c3bfe3413cb2ae219b09aea832: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:19:31.575594  9697 consensus_queue.cc:1059] T be1a92657f494cac8dd227d152f50151 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.033s
I20260709 13:19:31.595767  9688 raft_consensus.cc:3060] T 2c240553ce044eedb41541d72b9475d7 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:31.581442  9639 consensus_queue.cc:1048] T b56bf91d90824c959e21e0cee5ba1816 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.019s
I20260709 13:19:31.600078  9653 consensus_queue.cc:1059] T bd6869f07b5a4885a0b99fbe60c3b175 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: INVALID_TERM, Last received: 5.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:19:31.600860  9731 consensus_queue.cc:1048] T e31b9971c15848dea59d4d4130141d9e P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:19:31.601567  9728 consensus_queue.cc:1059] T 90d42e216d9741e190bca19a781291fd P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:19:31.602133  9582 consensus_queue.cc:1048] T 1528ab62b6fe4e3099d08f141afee116 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:19:31.627195  9730 consensus_queue.cc:1048] T 1bf4668eeb70467fb3dc5a0289233b3c P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.016s
I20260709 13:19:31.603025  9628 raft_consensus.cc:2804] T a3022224cc81473690653a83d4e99470 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:19:31.644603  9628 raft_consensus.cc:493] T a3022224cc81473690653a83d4e99470 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:31.645001  9628 raft_consensus.cc:3060] T a3022224cc81473690653a83d4e99470 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:31.577682  9657 raft_consensus.cc:3060] T 95a75bfe094d4bdc963aba3f08dfcd25 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:31.631577  9696 raft_consensus.cc:2749] T 90d42e216d9741e190bca19a781291fd P cd75a17ab2604397adab03bb8b5fd75c [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:19:31.603703  6872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a485a995abc4807b6e511e45419f737" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:19:31.610666  6799 raft_consensus.cc:3060] T 07a92dd554674067a83a9cb68c4773f2 P b7ab4784c7344b939bc36f639286f377 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:19:31.585579  9555 consensus_queue.cc:1175] T 2c240553ce044eedb41541d72b9475d7 P ccd8a4c3bfe3413cb2ae219b09aea832 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "cd75a17ab2604397adab03bb8b5fd75c" responder_term: 8 status { last_received { term: 8 index: 5 } last_committed_idx: 3 last_received_current_leader { term: 8 index: 5 } }
I20260709 13:19:31.657086  9259 raft_consensus.cc:3055] T be1a92657f494cac8dd227d152f50151 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:19:31.657608  9259 raft_consensus.cc:740] T be1a92657f494cac8dd227d152f50151 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
I20260709 13:19:31.658501  9259 consensus_queue.cc:260] T be1a92657f494cac8dd227d152f50151 P ccd8a4c3bfe3413cb2ae219b09aea832 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:19:31.659621  6799 raft_consensus.cc:2468] T 07a92dd554674067a83a9cb68c4773f2 P b7ab4784c7344b939bc36f639286f377 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 8.
I20260709 13:19:31.626937  9716 raft_consensus.cc:2749] T f4b8bd455d5a47c18a1380839c6e0d61 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:19:31.633451  9651 raft_consensus.cc:2749] T 427c124d773f483294511e80fe340075 P cd75a17ab2604397adab03bb8b5fd75c [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:19:31.591440  9715 raft_consensus.cc:3055] T 30e88460611e47b2ba16a46a30b5f416 P b7ab4784c7344b939bc36f639286f377 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:19:31.593344  9586 raft_consensus.cc:3060] T 17587d6730594da4a56fa13a353232a1 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:31.622712  6844 leader_election.cc:304] T f5be3a11b23d4ea9b08300a2789821c7 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:19:31.557327  9489 raft_consensus.cc:2804] T 34f36d59d88f40fe8a2805e604fc6c0a P ccd8a4c3bfe3413cb2ae219b09aea832 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:19:31.623554  6873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e326172347f45e99a0d482b5d8ef768" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:19:31.624853  6697 leader_election.cc:304] T 711ef6523deb4cbe8ef2ba61e1c21c98 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:19:31.599466  9450 raft_consensus.cc:2749] T f03d0dbf16864ca4bc1bb5e4c0334c0f P b7ab4784c7344b939bc36f639286f377 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:19:31.627987  6770 leader_election.cc:304] T 7c44c4849aa54f2b94d1f1bef9ed546f P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
W20260709 13:19:31.695744  6697 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 71018.6us
W20260709 13:19:31.698410  6770 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 70504.1us
I20260709 13:19:31.699471  6770 leader_election.cc:304] T 404190ce4ce94cecbfcb6ea9d1dd8626 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:19:31.700958  6770 leader_election.cc:304] T 427c124d773f483294511e80fe340075 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb
I20260709 13:19:31.703004  9582 raft_consensus.cc:2749] T 7c44c4849aa54f2b94d1f1bef9ed546f P b7ab4784c7344b939bc36f639286f377 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:19:31.703191  9564 raft_consensus.cc:2804] T 427c124d773f483294511e80fe340075 P b7ab4784c7344b939bc36f639286f377 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:19:31.703771  9564 raft_consensus.cc:493] T 427c124d773f483294511e80fe340075 P b7ab4784c7344b939bc36f639286f377 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 7ba59cc884714e8aa5f3f0ecaed84cbb)
I20260709 13:19:31.704269  9564 raft_consensus.cc:3060] T 427c124d773f483294511e80fe340075 P b7ab4784c7344b939bc36f639286f377 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:31.595579  9545 raft_consensus.cc:2749] T 7a734b5ab7834e05a8c422208acc58b1 P b7ab4784c7344b939bc36f639286f377 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:19:31.707587  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 84955.1us
W20260709 13:19:31.630896  6728 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.566s	user 0.009s	sys 0.010s
I20260709 13:19:31.621660  9663 consensus_queue.cc:1059] T 30e88460611e47b2ba16a46a30b5f416 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.011s
I20260709 13:19:31.582700  9717 raft_consensus.cc:515] T 3fa34c08b205435dba97346991aa1f92 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:19:31.629619  6878 raft_consensus.cc:515] T 9b3759de40694069b13c0f8bd40e5709 P cd75a17ab2604397adab03bb8b5fd75c [term 7 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:31.633625  6875 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53406 (request call id 1637) took 1190 ms. Trace:
I20260709 13:19:31.635228  6879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24ee15416e3145beaa1b8183453729a3" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:19:31.615993  9676 raft_consensus.cc:2749] T dbdf895bba214ff68685a24fd17dfb5d P ccd8a4c3bfe3413cb2ae219b09aea832 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:19:31.616161  9502 raft_consensus.cc:493] T 7c37d41cd9164c15a6826ca62a851a69 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:31.639051  9215 raft_consensus.cc:3055] T fe20b4b48823486ca3b9c648db6ce8aa P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 5 LEADER]: Stepping down as leader of term 5
W20260709 13:19:31.642390  9742 log.cc:927] Time spent T 713b5728a197487c9300b310ab94e5a3 P ccd8a4c3bfe3413cb2ae219b09aea832: Append to log took a long time: real 0.059s	user 0.000s	sys 0.001s
I20260709 13:19:31.600078  9712 consensus_queue.cc:1048] T d33d5ee8ef6f415593d8df52063161ad P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.032s
I20260709 13:19:31.622540  9515 raft_consensus.cc:2804] T ab432e62819d499eaaf3dd55481dd930 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:19:31.665810  7494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24ee15416e3145beaa1b8183453729a3" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:19:31.614651  6874 raft_consensus.cc:2468] T 07a92dd554674067a83a9cb68c4773f2 P cd75a17ab2604397adab03bb8b5fd75c [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 8.
I20260709 13:19:31.677997  9653 raft_consensus.cc:3055] T bd6869f07b5a4885a0b99fbe60c3b175 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:19:31.678859  9728 raft_consensus.cc:3055] T 90d42e216d9741e190bca19a781291fd P ccd8a4c3bfe3413cb2ae219b09aea832 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:19:31.748709  9728 raft_consensus.cc:740] T 90d42e216d9741e190bca19a781291fd P ccd8a4c3bfe3413cb2ae219b09aea832 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
I20260709 13:19:31.749848  9728 consensus_queue.cc:260] T 90d42e216d9741e190bca19a781291fd P ccd8a4c3bfe3413cb2ae219b09aea832 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:31.751302  9728 raft_consensus.cc:3060] T 90d42e216d9741e190bca19a781291fd P ccd8a4c3bfe3413cb2ae219b09aea832 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:31.688830  9729 consensus_queue.cc:1048] T b56bf91d90824c959e21e0cee5ba1816 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.062s
I20260709 13:19:31.751819  7494 raft_consensus.cc:2468] T 24ee15416e3145beaa1b8183453729a3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 7.
I20260709 13:19:31.710438  9506 raft_consensus.cc:2804] T 711ef6523deb4cbe8ef2ba61e1c21c98 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:19:31.763263  9506 raft_consensus.cc:493] T 711ef6523deb4cbe8ef2ba61e1c21c98 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:31.763732  9506 raft_consensus.cc:3060] T 711ef6523deb4cbe8ef2ba61e1c21c98 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:31.633611  9711 raft_consensus.cc:2749] T 9b3759de40694069b13c0f8bd40e5709 P b7ab4784c7344b939bc36f639286f377 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:19:31.768608  6626 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:53214 (request call id 176) took 30294 ms (client timeout 15000 ms). Trace:
W20260709 13:19:31.770502  6695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 165521us
I20260709 13:19:31.637338  9649 raft_consensus.cc:3060] T 4275cf08e63345f993bce8664eada830 P cd75a17ab2604397adab03bb8b5fd75c [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:31.769750  9717 leader_election.cc:290] T 3fa34c08b205435dba97346991aa1f92 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 10 election: Requested vote from peers cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:19:31.659828  9259 raft_consensus.cc:3060] T be1a92657f494cac8dd227d152f50151 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:19:31.775444  9741 log.cc:927] Time spent T c4db81d9d329422bb3b4160ca4ac2d1d P ccd8a4c3bfe3413cb2ae219b09aea832: Append to log took a long time: real 0.085s	user 0.000s	sys 0.000s
I20260709 13:19:31.776158  9628 raft_consensus.cc:515] T a3022224cc81473690653a83d4e99470 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:31.723491  9716 consensus_queue.cc:1048] T e31b9971c15848dea59d4d4130141d9e P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.054s
I20260709 13:19:31.778569  9657 raft_consensus.cc:515] T 95a75bfe094d4bdc963aba3f08dfcd25 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:31.708299  6844 leader_election.cc:304] T d33d5ee8ef6f415593d8df52063161ad P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
W20260709 13:19:31.780479  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 72251.5us
I20260709 13:19:31.780679  9657 leader_election.cc:290] T 95a75bfe094d4bdc963aba3f08dfcd25 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 9 election: Requested vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:31.781594  6844 leader_election.cc:304] T 95a75bfe094d4bdc963aba3f08dfcd25 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:19:31.782788  9651 raft_consensus.cc:2804] T d33d5ee8ef6f415593d8df52063161ad P cd75a17ab2604397adab03bb8b5fd75c [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:19:31.783263  9651 raft_consensus.cc:493] T d33d5ee8ef6f415593d8df52063161ad P cd75a17ab2604397adab03bb8b5fd75c [term 8 FOLLOWER]: Starting leader election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:19:31.783669  9651 raft_consensus.cc:3060] T d33d5ee8ef6f415593d8df52063161ad P cd75a17ab2604397adab03bb8b5fd75c [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:31.784574  9709 raft_consensus.cc:2804] T 95a75bfe094d4bdc963aba3f08dfcd25 P cd75a17ab2604397adab03bb8b5fd75c [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:19:31.744081  9515 raft_consensus.cc:493] T ab432e62819d499eaaf3dd55481dd930 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:31.784994  9709 raft_consensus.cc:493] T 95a75bfe094d4bdc963aba3f08dfcd25 P cd75a17ab2604397adab03bb8b5fd75c [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:31.785195  9515 raft_consensus.cc:3060] T ab432e62819d499eaaf3dd55481dd930 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:31.785406  9709 raft_consensus.cc:3060] T 95a75bfe094d4bdc963aba3f08dfcd25 P cd75a17ab2604397adab03bb8b5fd75c [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:31.675099  9553 raft_consensus.cc:515] T f4b8bd455d5a47c18a1380839c6e0d61 P b7ab4784c7344b939bc36f639286f377 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:31.713996  6770 leader_election.cc:304] T 34f36d59d88f40fe8a2805e604fc6c0a P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
W20260709 13:19:31.787359  6770 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 73468.9us
I20260709 13:19:31.711138  6875 rpcz_store.cc:276] 0709 13:19:30.442891 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:30.874814 (+431923us) service_pool.cc:224] Handling call
0709 13:19:30.889544 (+ 14730us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:30.900239 (+ 10695us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:30.900270 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:30.907971 (+  7701us) log.cc:844] Serialized 26 byte log entry
0709 13:19:31.001018 (+ 93047us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:19:31.001070 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:31.001156 (+    86us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:31.154758 (+153602us) spinlock_profiling.cc:243] Waited 5.1 ms on lock 0x7b4800210258. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc148d3aa1 00007fcc148cab37 00007fcc148ca9ca 00007fcc149c226f 00007fcc149c1f37 00007fcc149d655c 00007fcc149d6508 00007fcc149d6488 00007fcc149d6443 00007fcc149d56ec 00007fcc138ffa96
0709 13:19:31.303552 (+148794us) spinlock_profiling.cc:243] Waited 27.2 ms on lock 0x7b4400022b4c. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0c745db1 00007fcc0c7e3c85 00007fcc0c7e46a2 00007fcc0f5561db 00007fcc0f551aaf 00007fcc0f54586e 00007fcc0f544bb6 00007fcc0f5447d8 00007fcc0f54e221 00007fcc0f54e1d9 00007fcc0f54e169
0709 13:19:31.633311 (+329759us) raft_consensus.cc:1685] finished
0709 13:19:31.633336 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:31.633548 (+   212us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9518,"raft.queue_time_us":29036,"raft.run_cpu_time_us":2027,"raft.run_wall_time_us":235264,"spinlock_wait_cycles":74350208,"thread_start_us":45799,"threads_started":1,"wal-append.queue_time_us":271979}
I20260709 13:19:31.720491  6627 catalog_manager.cc:5697] T 17587d6730594da4a56fa13a353232a1 P 7ba59cc884714e8aa5f3f0ecaed84cbb reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:19:31.788023  7466 leader_election.cc:304] T be1a92657f494cac8dd227d152f50151 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, b7ab4784c7344b939bc36f639286f377; no voters: ccd8a4c3bfe3413cb2ae219b09aea832
W20260709 13:19:31.789474  6847 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:31.789098  6627 catalog_manager.cc:5697] T b3f13b31a1f84f0d89d007eadd57924c P 7ba59cc884714e8aa5f3f0ecaed84cbb reported cstate change: term changed from 4 to 5, leader changed from ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65) to 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68). New cstate: current_term: 5 leader_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:19:31.722304  6876 raft_consensus.cc:1240] T 9b3759de40694069b13c0f8bd40e5709 P cd75a17ab2604397adab03bb8b5fd75c [term 7 FOLLOWER]: Rejecting Update request from peer ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 6. Current term is 7. Ops: []
I20260709 13:19:31.715229  9215 raft_consensus.cc:740] T fe20b4b48823486ca3b9c648db6ce8aa P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 7ba59cc884714e8aa5f3f0ecaed84cbb, State: Running, Role: LEADER
I20260709 13:19:31.692612  9715 raft_consensus.cc:740] T 30e88460611e47b2ba16a46a30b5f416 P b7ab4784c7344b939bc36f639286f377 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
I20260709 13:19:31.744393  6878 leader_election.cc:290] T 9b3759de40694069b13c0f8bd40e5709 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 7 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:19:31.745589  6697 leader_election.cc:304] T 07a92dd554674067a83a9cb68c4773f2 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:19:31.697671  9489 raft_consensus.cc:493] T 34f36d59d88f40fe8a2805e604fc6c0a P ccd8a4c3bfe3413cb2ae219b09aea832 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:31.586934  9366 raft_consensus.cc:493] T 1528ab62b6fe4e3099d08f141afee116 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 6 FOLLOWER]: Starting leader election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:19:31.746855  9653 raft_consensus.cc:740] T bd6869f07b5a4885a0b99fbe60c3b175 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
I20260709 13:19:31.782529  9687 raft_consensus.cc:515] T 22ccee1b570c4ad3a57bd7aec085b1b4 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:31.798942  6770 leader_election.cc:304] T 2c240553ce044eedb41541d72b9475d7 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:19:31.799173  6805 raft_consensus.cc:1240] T d8cee0accdb8499c86d4414b72565a38 P b7ab4784c7344b939bc36f639286f377 [term 7 FOLLOWER]: Rejecting Update request from peer 7ba59cc884714e8aa5f3f0ecaed84cbb for earlier term 6. Current term is 7. Ops: []
W20260709 13:19:31.662806  9631 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.555s	user 0.007s	sys 0.019s
I20260709 13:19:31.782552  6844 leader_election.cc:304] T 44bde925b2e541b69890d70715b85176 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
W20260709 13:19:31.829850  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 47376.1us
I20260709 13:19:31.791500  6627 catalog_manager.cc:5697] T bb7fa124c3bf4ef9ab65a407cb008441 P 7ba59cc884714e8aa5f3f0ecaed84cbb reported cstate change: term changed from 4 to 8, leader changed from 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68) to b7ab4784c7344b939bc36f639286f377 (127.5.126.66). New cstate: current_term: 8 leader_uuid: "b7ab4784c7344b939bc36f639286f377" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } } }
I20260709 13:19:31.834945  6627 catalog_manager.cc:5697] T be1a92657f494cac8dd227d152f50151 P 7ba59cc884714e8aa5f3f0ecaed84cbb reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:19:31.722352  9608 raft_consensus.cc:2804] T f5be3a11b23d4ea9b08300a2789821c7 P cd75a17ab2604397adab03bb8b5fd75c [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:19:31.715193  9502 raft_consensus.cc:3060] T 7c37d41cd9164c15a6826ca62a851a69 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:31.825634  6695 leader_election.cc:304] T a1704639a875409b9959353527b3fd68 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: cd75a17ab2604397adab03bb8b5fd75c
W20260709 13:19:31.826254  6697 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 80776.1us
I20260709 13:19:31.845063  6876 raft_consensus.cc:1275] T 713b5728a197487c9300b310ab94e5a3 P cd75a17ab2604397adab03bb8b5fd75c [term 8 FOLLOWER]: Refusing update from remote peer ccd8a4c3bfe3413cb2ae219b09aea832: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 8 index: 4. (index mismatch)
I20260709 13:19:31.846047  6697 leader_election.cc:304] T 24ee15416e3145beaa1b8183453729a3 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:19:31.835548  6729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de3186201e1a40d0b335eeb8b4e256e0" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:19:31.822161  9489 raft_consensus.cc:3060] T 34f36d59d88f40fe8a2805e604fc6c0a P ccd8a4c3bfe3413cb2ae219b09aea832 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:31.825356  9366 raft_consensus.cc:3060] T 1528ab62b6fe4e3099d08f141afee116 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:31.851600  6875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3022224cc81473690653a83d4e99470" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:19:31.852414  6875 raft_consensus.cc:3060] T a3022224cc81473690653a83d4e99470 P cd75a17ab2604397adab03bb8b5fd75c [term 6 FOLLOWER]: Advancing to term 8
I20260709 13:19:31.707150  9643 raft_consensus.cc:2749] T 404190ce4ce94cecbfcb6ea9d1dd8626 P b7ab4784c7344b939bc36f639286f377 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:19:31.837565  6731 raft_consensus.cc:1240] T a3022224cc81473690653a83d4e99470 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 8 FOLLOWER]: Rejecting Update request from peer b7ab4784c7344b939bc36f639286f377 for earlier term 6. Current term is 8. Ops: []
I20260709 13:19:31.830104  9717 raft_consensus.cc:2804] T 07a92dd554674067a83a9cb68c4773f2 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:19:31.817516  9616 raft_consensus.cc:493] T b56bf91d90824c959e21e0cee5ba1816 P cd75a17ab2604397adab03bb8b5fd75c [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:31.815557  9712 raft_consensus.cc:2749] T 34f36d59d88f40fe8a2805e604fc6c0a P b7ab4784c7344b939bc36f639286f377 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:19:31.839743  6730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a485a995abc4807b6e511e45419f737" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
W20260709 13:19:31.839722  7468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 254439us
I20260709 13:19:31.840929  6727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44bde925b2e541b69890d70715b85176" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:19:31.821825  9603 raft_consensus.cc:2804] T be1a92657f494cac8dd227d152f50151 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:19:31.838907  6627 catalog_manager.cc:5697] T 1528ab62b6fe4e3099d08f141afee116 P 7ba59cc884714e8aa5f3f0ecaed84cbb reported cstate change: config changed from index 3 to 6, term changed from 5 to 6, leader changed from 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68) to <none>, VOTER cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67) evicted. New cstate: current_term: 6 committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } } }
I20260709 13:19:31.966475  6798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a75bfe094d4bdc963aba3f08dfcd25" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 9 candidate_status { last_received { term: 7 index: 2 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:19:31.843001  6725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6869f07b5a4885a0b99fbe60c3b175" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 8 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:19:31.790637  9628 leader_election.cc:290] T a3022224cc81473690653a83d4e99470 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 8 election: Requested vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:31.850108  6729 raft_consensus.cc:2410] T de3186201e1a40d0b335eeb8b4e256e0 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate b7ab4784c7344b939bc36f639286f377 for term 8 because replica has last-logged OpId of term: 7 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 13:19:31.850157  6874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a75bfe094d4bdc963aba3f08dfcd25" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 9 candidate_status { last_received { term: 7 index: 2 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:19:31.835419  6844 leader_election.cc:304] T e77e330a82df4b43a745d57a68f6f057 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
W20260709 13:19:31.973625  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 138268us
I20260709 13:19:31.974304  6844 leader_election.cc:304] T 24ee15416e3145beaa1b8183453729a3 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:19:31.843202  9608 raft_consensus.cc:493] T f5be3a11b23d4ea9b08300a2789821c7 P cd75a17ab2604397adab03bb8b5fd75c [term 5 FOLLOWER]: Starting leader election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:19:31.895105  6723 raft_consensus.cc:1275] T ce4f062dcd314d43a63ca74067cb5ee3 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 7 FOLLOWER]: Refusing update from remote peer b7ab4784c7344b939bc36f639286f377: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
W20260709 13:19:31.861495  6772 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 482388us
I20260709 13:19:31.880004  6732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4db81d9d329422bb3b4160ca4ac2d1d" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:19:31.944700  6875 raft_consensus.cc:2468] T a3022224cc81473690653a83d4e99470 P cd75a17ab2604397adab03bb8b5fd75c [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 8.
I20260709 13:19:31.838315  9711 raft_consensus.cc:2749] T 2c240553ce044eedb41541d72b9475d7 P b7ab4784c7344b939bc36f639286f377 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:19:31.842715  9720 raft_consensus.cc:2804] T 44bde925b2e541b69890d70715b85176 P cd75a17ab2604397adab03bb8b5fd75c [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:19:31.939155  6724 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f4b8bd455d5a47c18a1380839c6e0d61"
dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
mode: GRACEFUL
new_leader_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
 from {username='slave'} at 127.0.0.1:38536
I20260709 13:19:32.074079  6724 raft_consensus.cc:606] T f4b8bd455d5a47c18a1380839c6e0d61 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 7 FOLLOWER]: Received request to transfer leadership to TS cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:19:32.074482  6724 raft_consensus.cc:614] T f4b8bd455d5a47c18a1380839c6e0d61 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 7 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:19:31.940126  6802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e326172347f45e99a0d482b5d8ef768" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:19:31.856325  6805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a485a995abc4807b6e511e45419f737" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:19:31.963801  6727 raft_consensus.cc:2410] T 44bde925b2e541b69890d70715b85176 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7ab4784c7344b939bc36f639286f377 for term 9 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 13:19:31.962535  6800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3022224cc81473690653a83d4e99470" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:19:32.077080  6800 raft_consensus.cc:3060] T a3022224cc81473690653a83d4e99470 P b7ab4784c7344b939bc36f639286f377 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:31.859064  9694 raft_consensus.cc:2804] T a1704639a875409b9959353527b3fd68 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:19:31.856017  9657 raft_consensus.cc:2804] T 24ee15416e3145beaa1b8183453729a3 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:19:31.961942  6730 raft_consensus.cc:2393] T 3a485a995abc4807b6e511e45419f737 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7ab4784c7344b939bc36f639286f377 in current term 7: Already voted for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in this term.
I20260709 13:19:31.855391  6876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fa34c08b205435dba97346991aa1f92" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:19:32.092963  6876 raft_consensus.cc:3060] T 3fa34c08b205435dba97346991aa1f92 P cd75a17ab2604397adab03bb8b5fd75c [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:31.824688  9627 raft_consensus.cc:515] T 4d9def8b32fd443aa94ab1420b06837b P cd75a17ab2604397adab03bb8b5fd75c [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:32.082634  9694 raft_consensus.cc:493] T a1704639a875409b9959353527b3fd68 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 6 FOLLOWER]: Starting leader election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:19:31.971794  6627 catalog_manager.cc:5697] T ce4f062dcd314d43a63ca74067cb5ee3 P 7ba59cc884714e8aa5f3f0ecaed84cbb reported cstate change: term changed from 4 to 6, leader changed from <none> to ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65). New cstate: current_term: 6 leader_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } attrs { replace: true } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } } }
I20260709 13:19:31.837989  9592 consensus_queue.cc:1059] T d8cee0accdb8499c86d4414b72565a38 P 7ba59cc884714e8aa5f3f0ecaed84cbb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.128s
I20260709 13:19:32.076504  6802 raft_consensus.cc:2468] T 9e326172347f45e99a0d482b5d8ef768 P b7ab4784c7344b939bc36f639286f377 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 6.
I20260709 13:19:32.076514  6805 raft_consensus.cc:3060] T 3a485a995abc4807b6e511e45419f737 P b7ab4784c7344b939bc36f639286f377 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:19:32.078444  6771 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:32.079485  6729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7887766dc6784fcaa42b35c05fea7a99" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:19:31.979756  6844 leader_election.cc:304] T 4b8cacb381b746da8d0049b0a83b41dd P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:19:32.089344  6803 raft_consensus.cc:1275] T 713b5728a197487c9300b310ab94e5a3 P b7ab4784c7344b939bc36f639286f377 [term 8 FOLLOWER]: Refusing update from remote peer ccd8a4c3bfe3413cb2ae219b09aea832: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 4. (term mismatch)
I20260709 13:19:32.128861  6803 pending_rounds.cc:85] T 713b5728a197487c9300b310ab94e5a3 P b7ab4784c7344b939bc36f639286f377: Aborting all ops after (but not including) 3
I20260709 13:19:32.129213  6803 pending_rounds.cc:107] T 713b5728a197487c9300b310ab94e5a3 P b7ab4784c7344b939bc36f639286f377: Aborting uncommitted NO_OP operation due to leader change: 7.4
I20260709 13:19:32.129580  6803 raft_consensus.cc:2889] T 713b5728a197487c9300b310ab94e5a3 P b7ab4784c7344b939bc36f639286f377 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:19:32.085314  9747 log.cc:927] Time spent T 1bf4668eeb70467fb3dc5a0289233b3c P b7ab4784c7344b939bc36f639286f377: Append to log took a long time: real 0.122s	user 0.001s	sys 0.000s
I20260709 13:19:32.091641  6724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90d42e216d9741e190bca19a781291fd" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:19:32.100560  6723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3f13b31a1f84f0d89d007eadd57924c" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:19:32.108855  6732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6869f07b5a4885a0b99fbe60c3b175" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 8 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
W20260709 13:19:32.112685  6695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 147475us
I20260709 13:19:32.121469  6800 raft_consensus.cc:2468] T a3022224cc81473690653a83d4e99470 P b7ab4784c7344b939bc36f639286f377 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 8.
I20260709 13:19:31.964211  9697 raft_consensus.cc:493] T 20f6842e26174571996b8dea4151d4be P ccd8a4c3bfe3413cb2ae219b09aea832 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:31.769121  6626 rpcz_store.cc:269] 0709 13:19:01.474143 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:01.484378 (+ 10235us) service_pool.cc:224] Handling call
0709 13:19:31.768476 (+30284098us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:19:24.497804 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:19:24.560169 (+ 62365us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:19:24.560221 (+    52us) write_op.cc:435] Acquired schema lock
0709 13:19:24.560255 (+    34us) tablet.cc:662] Decoding operations
0709 13:19:24.561436 (+  1181us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:19:24.561517 (+    81us) write_op.cc:641] Partition lock acquired for write op
0709 13:19:24.561543 (+    26us) tablet.cc:685] Acquiring locks for 12 operations
0709 13:19:24.626451 (+ 64908us) tablet.cc:701] Row locks acquired
0709 13:19:24.626508 (+    57us) write_op.cc:260] PREPARE: finished
0709 13:19:24.626722 (+   214us) write_op.cc:270] Start()
0709 13:19:24.626907 (+   185us) write_op.cc:276] Timestamp: P: 1783603164626656 usec, L: 0
0709 13:19:24.626933 (+    26us) op_driver.cc:348] REPLICATION: starting
0709 13:19:24.629151 (+  2218us) log.cc:844] Serialized 4754 byte log entry
0709 13:19:25.024928 (+395777us) op_driver.cc:464] REPLICATION: finished
0709 13:19:25.404689 (+379761us) write_op.cc:301] APPLY: starting
0709 13:19:25.404879 (+   190us) tablet.cc:1367] starting BulkCheckPresence
0709 13:19:25.405191 (+   312us) tablet.cc:1370] finished BulkCheckPresence
0709 13:19:25.405354 (+   163us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:19:26.128181 (+722827us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:19:26.389418 (+261237us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=12
0709 13:19:26.403165 (+ 13747us) write_op.cc:312] APPLY: finished
0709 13:19:26.573649 (+170484us) log.cc:844] Serialized 88 byte log entry
0709 13:19:26.772884 (+199235us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:19:26.801164 (+ 28280us) write_op.cc:454] Released schema lock
0709 13:19:26.826545 (+ 25381us) write_op.cc:341] FINISH: Updating metrics
0709 13:19:26.883612 (+ 57067us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:19:26.892781 (+  9169us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":731159,"reported_tablets":39,"child_traces":[["op",{"apply.queue_time_us":333900,"apply.run_cpu_time_us":24180,"apply.run_wall_time_us":1485449,"num_ops":12,"prepare.queue_time_us":339583,"prepare.run_cpu_time_us":88560,"prepare.run_wall_time_us":397282,"raft.queue_time_us":109537,"raft.run_cpu_time_us":37738,"raft.run_wall_time_us":193625,"replication_time_us":397786,"thread_start_us":653786,"threads_started":5,"wal-append.queue_time_us":482932,"wal-append.run_cpu_time_us":16863,"wal-append.run_wall_time_us":2219248}]]}
I20260709 13:19:32.128404  6729 raft_consensus.cc:3060] T 7887766dc6784fcaa42b35c05fea7a99 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:32.128440  6730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e326172347f45e99a0d482b5d8ef768" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:19:32.153373  6730 raft_consensus.cc:2468] T 9e326172347f45e99a0d482b5d8ef768 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 6.
I20260709 13:19:32.153529  6728 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49998 (request call id 824) took 1164 ms. Trace:
W20260709 13:19:31.972807  9487 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.542s	user 0.024s	sys 0.058s
I20260709 13:19:32.111609  6627 catalog_manager.cc:5697] T 4b8cacb381b746da8d0049b0a83b41dd P 7ba59cc884714e8aa5f3f0ecaed84cbb reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } } }
W20260709 13:19:32.137393  6697 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 195901us
I20260709 13:19:32.137327  6805 raft_consensus.cc:2468] T 3a485a995abc4807b6e511e45419f737 P b7ab4784c7344b939bc36f639286f377 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 7.
W20260709 13:19:32.139693  6847 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:31.970542  9717 raft_consensus.cc:697] T 07a92dd554674067a83a9cb68c4773f2 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 8 LEADER]: Becoming Leader. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
I20260709 13:19:32.092525  9657 raft_consensus.cc:493] T 24ee15416e3145beaa1b8183453729a3 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:32.074568  9608 raft_consensus.cc:3060] T f5be3a11b23d4ea9b08300a2789821c7 P cd75a17ab2604397adab03bb8b5fd75c [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:32.075426  7494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fa34c08b205435dba97346991aa1f92" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb"
W20260709 13:19:32.087436  9740 log.cc:927] Time spent T d8cee0accdb8499c86d4414b72565a38 P cd75a17ab2604397adab03bb8b5fd75c: Append to log took a long time: real 0.125s	user 0.000s	sys 0.000s
W20260709 13:19:32.203333  6847 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:32.204095  6772 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 122711us
I20260709 13:19:32.043988  9631 raft_consensus.cc:3060] T 24ee15416e3145beaa1b8183453729a3 P cd75a17ab2604397adab03bb8b5fd75c [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:32.151809  6876 raft_consensus.cc:2468] T 3fa34c08b205435dba97346991aa1f92 P cd75a17ab2604397adab03bb8b5fd75c [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 10.
I20260709 13:19:32.158792  6695 leader_election.cc:304] T 9e326172347f45e99a0d482b5d8ef768 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:19:32.176710  6807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7887766dc6784fcaa42b35c05fea7a99" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:19:32.153924  6728 rpcz_store.cc:276] 0709 13:19:30.989273 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:30.989389 (+   116us) service_pool.cc:224] Handling call
0709 13:19:30.989700 (+   311us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:19:31.036828 (+ 47128us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:31.036871 (+    43us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:19:31.062911 (+ 26040us) log.cc:844] Serialized 52 byte log entry
0709 13:19:31.708452 (+645541us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:19:32.108623 (+400171us) log.cc:844] Serialized 14 byte log entry
0709 13:19:32.153014 (+ 44391us) log.cc:844] Serialized 14 byte log entry
0709 13:19:32.153191 (+   177us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:32.153281 (+    90us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:32.153323 (+    42us) raft_consensus.cc:1685] finished
0709 13:19:32.153336 (+    13us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:32.153474 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":28980,"raft.queue_time_us":10849,"raft.run_cpu_time_us":112,"raft.run_wall_time_us":112,"thread_start_us":1022599,"threads_started":2,"wal-append.queue_time_us":683982}
I20260709 13:19:32.224666  6807 raft_consensus.cc:2368] T 7887766dc6784fcaa42b35c05fea7a99 P b7ab4784c7344b939bc36f639286f377 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c for earlier term 7. Current term is 8.
I20260709 13:19:32.043596  9636 raft_consensus.cc:2804] T e77e330a82df4b43a745d57a68f6f057 P cd75a17ab2604397adab03bb8b5fd75c [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 13:19:32.180756  9487 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.750s	user 0.042s	sys 0.085s
I20260709 13:19:32.075898  9696 consensus_queue.cc:1059] T 7c44c4849aa54f2b94d1f1bef9ed546f P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.112s
I20260709 13:19:31.976626  9730 consensus_queue.cc:1059] T 9b3759de40694069b13c0f8bd40e5709 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.181s
I20260709 13:19:31.965895  9616 raft_consensus.cc:515] T b56bf91d90824c959e21e0cee5ba1816 P cd75a17ab2604397adab03bb8b5fd75c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:32.080760  9716 consensus_queue.cc:1048] T 713b5728a197487c9300b310ab94e5a3 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.081s
I20260709 13:19:32.129669  9694 raft_consensus.cc:3060] T a1704639a875409b9959353527b3fd68 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:32.214805  6805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f58dc08b12a2494bb9a1372837970ca2" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:19:32.278193  6805 raft_consensus.cc:2376] T f58dc08b12a2494bb9a1372837970ca2 P b7ab4784c7344b939bc36f639286f377 [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 9. Re-sending same reply.
I20260709 13:19:32.203737  6802 raft_consensus.cc:1275] T 4275cf08e63345f993bce8664eada830 P b7ab4784c7344b939bc36f639286f377 [term 8 FOLLOWER]: Refusing update from remote peer ccd8a4c3bfe3413cb2ae219b09aea832: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 8 index: 4. (index mismatch)
I20260709 13:19:32.220594  6800 raft_consensus.cc:1275] T 7c44c4849aa54f2b94d1f1bef9ed546f P b7ab4784c7344b939bc36f639286f377 [term 9 FOLLOWER]: Refusing update from remote peer ccd8a4c3bfe3413cb2ae219b09aea832: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 13:19:32.223171  6798 raft_consensus.cc:1275] T 34f36d59d88f40fe8a2805e604fc6c0a P b7ab4784c7344b939bc36f639286f377 [term 5 FOLLOWER]: Refusing update from remote peer cd75a17ab2604397adab03bb8b5fd75c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:19:32.171504  6697 leader_election.cc:304] T a3022224cc81473690653a83d4e99470 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:19:32.183955  6732 raft_consensus.cc:1240] T 95a75bfe094d4bdc963aba3f08dfcd25 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 9 FOLLOWER]: Rejecting Update request from peer b7ab4784c7344b939bc36f639286f377 for earlier term 8. Current term is 9. Ops: [8.3-8.3]
I20260709 13:19:32.279662  6805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22ccee1b570c4ad3a57bd7aec085b1b4" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:19:32.243960  6729 raft_consensus.cc:2468] T 7887766dc6784fcaa42b35c05fea7a99 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 8.
I20260709 13:19:32.245769  6807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "853ac0a8cbd64ce99457f170216d4d0f" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
W20260709 13:19:32.246965  6695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 88275.3us
I20260709 13:19:32.282897  6805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab432e62819d499eaaf3dd55481dd930" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 9 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:19:31.938064  9715 consensus_queue.cc:260] T 30e88460611e47b2ba16a46a30b5f416 P b7ab4784c7344b939bc36f639286f377 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:32.258639  6772 leader_election.cc:304] T 7c37d41cd9164c15a6826ca62a851a69 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:19:32.284088  6805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bf4668eeb70467fb3dc5a0289233b3c" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
W20260709 13:19:32.264704  6770 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 76000us
I20260709 13:19:32.285159  6805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "711ef6523deb4cbe8ef2ba61e1c21c98" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 9 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:19:32.285709  6770 leader_election.cc:304] T de3186201e1a40d0b335eeb8b4e256e0 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:19:32.286172  6805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6869f07b5a4885a0b99fbe60c3b175" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 8 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:19:32.287022  6805 raft_consensus.cc:2393] T bd6869f07b5a4885a0b99fbe60c3b175 P b7ab4784c7344b939bc36f639286f377 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c in current term 8: Already voted for candidate b7ab4784c7344b939bc36f639286f377 in this term.
I20260709 13:19:32.287109  9744 raft_consensus.cc:2749] T 7c37d41cd9164c15a6826ca62a851a69 P b7ab4784c7344b939bc36f639286f377 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:19:32.194227  9657 raft_consensus.cc:3060] T 24ee15416e3145beaa1b8183453729a3 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:31.962232  9215 consensus_queue.cc:260] T fe20b4b48823486ca3b9c648db6ce8aa P 7ba59cc884714e8aa5f3f0ecaed84cbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:19:32.287751  6805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8cee0accdb8499c86d4414b72565a38" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:19:32.293159  6729 raft_consensus.cc:1240] T 3fa34c08b205435dba97346991aa1f92 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 10 FOLLOWER]: Rejecting Update request from peer 7ba59cc884714e8aa5f3f0ecaed84cbb for earlier term 9. Current term is 10. Ops: []
W20260709 13:19:32.258147  9737 log.cc:927] Time spent T bb3d8792045a4583ae2e965b1350a5b4 P ccd8a4c3bfe3413cb2ae219b09aea832: Append to log took a long time: real 0.077s	user 0.001s	sys 0.000s
I20260709 13:19:32.232820  9636 raft_consensus.cc:493] T e77e330a82df4b43a745d57a68f6f057 P cd75a17ab2604397adab03bb8b5fd75c [term 9 FOLLOWER]: Starting leader election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:19:32.182132  9697 raft_consensus.cc:515] T 20f6842e26174571996b8dea4151d4be P ccd8a4c3bfe3413cb2ae219b09aea832 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:32.291492  6695 leader_election.cc:304] T 3a485a995abc4807b6e511e45419f737 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:19:32.043021  9653 consensus_queue.cc:260] T bd6869f07b5a4885a0b99fbe60c3b175 P ccd8a4c3bfe3413cb2ae219b09aea832 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 7.3, Last appended by leader: 3, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:32.264602  9654 raft_consensus.cc:493] T 44bde925b2e541b69890d70715b85176 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:32.331727  6802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22ccee1b570c4ad3a57bd7aec085b1b4" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:19:32.352111  6729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4b8bd455d5a47c18a1380839c6e0d61" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:19:32.353093  6729 raft_consensus.cc:2393] T f4b8bd455d5a47c18a1380839c6e0d61 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate b7ab4784c7344b939bc36f639286f377 in current term 7: Already voted for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in this term.
I20260709 13:19:32.291446  9614 raft_consensus.cc:2749] T 4b8cacb381b746da8d0049b0a83b41dd P cd75a17ab2604397adab03bb8b5fd75c [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
W20260709 13:19:32.366264  7467 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:32.369867  6770 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 84248.1us
I20260709 13:19:32.371002  6770 leader_election.cc:304] T c4db81d9d329422bb3b4160ca4ac2d1d P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
W20260709 13:19:32.371945  6772 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 87265.4us
W20260709 13:19:32.374985  7468 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:32.302057  9553 leader_election.cc:290] T f4b8bd455d5a47c18a1380839c6e0d61 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 7 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:32.309239  9636 raft_consensus.cc:3060] T e77e330a82df4b43a745d57a68f6f057 P cd75a17ab2604397adab03bb8b5fd75c [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:32.387696  6876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20f6842e26174571996b8dea4151d4be" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:19:32.388712  6876 raft_consensus.cc:2376] T 20f6842e26174571996b8dea4151d4be P cd75a17ab2604397adab03bb8b5fd75c [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 8. Re-sending same reply.
I20260709 13:19:32.390985  6770 leader_election.cc:304] T 3a485a995abc4807b6e511e45419f737 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:19:32.393464  6876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e326172347f45e99a0d482b5d8ef768" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:19:32.301833  9691 raft_consensus.cc:493] T e31b9971c15848dea59d4d4130141d9e P b7ab4784c7344b939bc36f639286f377 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:19:32.398991  9691 raft_consensus.cc:515] T e31b9971c15848dea59d4d4130141d9e P b7ab4784c7344b939bc36f639286f377 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:32.278599  9643 consensus_queue.cc:1048] T ce4f062dcd314d43a63ca74067cb5ee3 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.083s
I20260709 13:19:32.414187  6879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90d42e216d9741e190bca19a781291fd" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:19:32.309059  9720 raft_consensus.cc:697] T 44bde925b2e541b69890d70715b85176 P cd75a17ab2604397adab03bb8b5fd75c [term 8 LEADER]: Becoming Leader. State: Replica: cd75a17ab2604397adab03bb8b5fd75c, State: Running, Role: LEADER
I20260709 13:19:32.401355  7500 raft_consensus.cc:1275] T ce4f062dcd314d43a63ca74067cb5ee3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 7 FOLLOWER]: Refusing update from remote peer b7ab4784c7344b939bc36f639286f377: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:19:32.420222  6879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6869f07b5a4885a0b99fbe60c3b175" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 8 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:19:32.367230  9609 raft_consensus.cc:2804] T 9e326172347f45e99a0d482b5d8ef768 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:19:32.422595  6697 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 251209us
I20260709 13:19:32.423080  6807 raft_consensus.cc:2468] T 853ac0a8cbd64ce99457f170216d4d0f P b7ab4784c7344b939bc36f639286f377 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 5.
I20260709 13:19:32.384064  9726 raft_consensus.cc:3055] T 9b3759de40694069b13c0f8bd40e5709 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:19:32.430302  6879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4b8bd455d5a47c18a1380839c6e0d61" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:19:32.367883  9713 raft_consensus.cc:2749] T de3186201e1a40d0b335eeb8b4e256e0 P b7ab4784c7344b939bc36f639286f377 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:19:32.447976  6881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ba5dac66ab5497e9e336f2a3c28cda5" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:19:32.374244  9626 raft_consensus.cc:493] T f5be3a11b23d4ea9b08300a2789821c7 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:19:32.460352  6872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7887766dc6784fcaa42b35c05fea7a99" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:19:32.465278  6872 raft_consensus.cc:3060] T 7887766dc6784fcaa42b35c05fea7a99 P cd75a17ab2604397adab03bb8b5fd75c [term 6 FOLLOWER]: Advancing to term 8
I20260709 13:19:32.400385  9759 raft_consensus.cc:2804] T a3022224cc81473690653a83d4e99470 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:19:32.448900  6881 raft_consensus.cc:2468] T 7ba5dac66ab5497e9e336f2a3c28cda5 P cd75a17ab2604397adab03bb8b5fd75c [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 8.
W20260709 13:19:32.434446  9737 log.cc:927] Time spent T bb3d8792045a4583ae2e965b1350a5b4 P ccd8a4c3bfe3413cb2ae219b09aea832: Append to log took a long time: real 0.057s	user 0.001s	sys 0.000s
I20260709 13:19:32.351361  9654 raft_consensus.cc:515] T 44bde925b2e541b69890d70715b85176 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
W20260709 13:19:32.475564  6846 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.68:45071, user_credentials={real_user=slave}} blocked reactor thread for 221353us
I20260709 13:19:32.383975  9687 leader_election.cc:290] T 22ccee1b570c4ad3a57bd7aec085b1b4 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 7 election: Requested vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
W20260709 13:19:32.451093  9745 log.cc:927] Time spent T f09c2a98de1a4decabd0ff900dd44caa P cd75a17ab2604397adab03bb8b5fd75c: Append to log took a long time: real 0.485s	user 0.000s	sys 0.001s
I20260709 13:19:32.439990  9609 raft_consensus.cc:493] T 9e326172347f45e99a0d482b5d8ef768 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:19:32.462178  9506 consensus_meta.cc:287] T 711ef6523deb4cbe8ef2ba61e1c21c98 P ccd8a4c3bfe3413cb2ae219b09aea832: Time spent flushing consensus metadata: real 0.698s	user 0.009s	sys 0.001s
I20260709 13:19:32.617125  7502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8cee0accdb8499c86d4414b72565a38" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb"
I20260709 13:19:32.447211  9726 raft_consensus.cc:740] T 9b3759de40694069b13c0f8bd40e5709 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
I20260709 13:19:32.621819  6879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8cee0accdb8499c86d4414b72565a38" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:19:32.365312  9717 consensus_queue.cc:237] T 07a92dd554674067a83a9cb68c4773f2 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 6.3, Last appended by leader: 3, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
W20260709 13:19:32.592820  9747 log.cc:927] Time spent T 1bf4668eeb70467fb3dc5a0289233b3c P b7ab4784c7344b939bc36f639286f377: Append to log took a long time: real 0.160s	user 0.001s	sys 0.000s
W20260709 13:19:32.613197  9259 consensus_meta.cc:287] T be1a92657f494cac8dd227d152f50151 P ccd8a4c3bfe3413cb2ae219b09aea832: Time spent flushing consensus metadata: real 0.838s	user 0.010s	sys 0.000s
I20260709 13:19:32.441625  9744 consensus_queue.cc:1048] T ce4f062dcd314d43a63ca74067cb5ee3 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.185s
I20260709 13:19:32.601833  9766 raft_consensus.cc:2804] T 3a485a995abc4807b6e511e45419f737 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:19:32.601342  7494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3f13b31a1f84f0d89d007eadd57924c" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:19:32.606287  7503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ba5dac66ab5497e9e336f2a3c28cda5" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:19:32.616439  9487 raft_consensus.cc:2749] T c4db81d9d329422bb3b4160ca4ac2d1d P b7ab4784c7344b939bc36f639286f377 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:19:32.618701  9609 raft_consensus.cc:3060] T 9e326172347f45e99a0d482b5d8ef768 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:19:32.648469  9757 log.cc:927] Time spent T 1bf4668eeb70467fb3dc5a0289233b3c P cd75a17ab2604397adab03bb8b5fd75c: Append to log took a long time: real 0.264s	user 0.001s	sys 0.000s
I20260709 13:19:32.649256  9710 raft_consensus.cc:3055] T d8cee0accdb8499c86d4414b72565a38 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:19:32.649756  9710 raft_consensus.cc:740] T d8cee0accdb8499c86d4414b72565a38 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 7ba59cc884714e8aa5f3f0ecaed84cbb, State: Running, Role: LEADER
I20260709 13:19:32.645565  9716 consensus_queue.cc:1048] T 4275cf08e63345f993bce8664eada830 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.001s
W20260709 13:19:32.645943  9762 log.cc:927] Time spent T e31b9971c15848dea59d4d4130141d9e P cd75a17ab2604397adab03bb8b5fd75c: Append to log took a long time: real 0.183s	user 0.000s	sys 0.001s
I20260709 13:19:32.646479  9259 consensus_queue.cc:1048] T 7c44c4849aa54f2b94d1f1bef9ed546f P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
W20260709 13:19:32.649418  9764 log.cc:927] Time spent T 30e88460611e47b2ba16a46a30b5f416 P ccd8a4c3bfe3413cb2ae219b09aea832: Append to log took a long time: real 0.217s	user 0.000s	sys 0.000s
W20260709 13:19:32.645721  9763 log.cc:927] Time spent T 17587d6730594da4a56fa13a353232a1 P b7ab4784c7344b939bc36f639286f377: Append to log took a long time: real 0.212s	user 0.001s	sys 0.000s
I20260709 13:19:32.620273  9627 leader_election.cc:290] T 4d9def8b32fd443aa94ab1420b06837b P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 8 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:19:32.621759  9759 raft_consensus.cc:697] T a3022224cc81473690653a83d4e99470 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 8 LEADER]: Becoming Leader. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
I20260709 13:19:32.477072  9626 raft_consensus.cc:515] T f5be3a11b23d4ea9b08300a2789821c7 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
W20260709 13:19:32.651006  9752 log.cc:927] Time spent T 4275cf08e63345f993bce8664eada830 P ccd8a4c3bfe3413cb2ae219b09aea832: Append to log took a long time: real 0.373s	user 0.000s	sys 0.000s
W20260709 13:19:32.655719  9754 log.cc:927] Time spent T fe20b4b48823486ca3b9c648db6ce8aa P ccd8a4c3bfe3413cb2ae219b09aea832: Append to log took a long time: real 0.432s	user 0.000s	sys 0.001s
I20260709 13:19:32.659967  9766 raft_consensus.cc:697] T 3a485a995abc4807b6e511e45419f737 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 7 LEADER]: Becoming Leader. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
I20260709 13:19:32.662145  9713 raft_consensus.cc:2749] T 3a485a995abc4807b6e511e45419f737 P b7ab4784c7344b939bc36f639286f377 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:19:32.627225  9506 raft_consensus.cc:515] T 711ef6523deb4cbe8ef2ba61e1c21c98 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:32.654201  9720 consensus_queue.cc:237] T 44bde925b2e541b69890d70715b85176 P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:32.669023  9616 leader_election.cc:290] T b56bf91d90824c959e21e0cee5ba1816 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
W20260709 13:19:32.671803  9564 consensus_meta.cc:287] T 427c124d773f483294511e80fe340075 P b7ab4784c7344b939bc36f639286f377: Time spent flushing consensus metadata: real 0.967s	user 0.010s	sys 0.002s
I20260709 13:19:32.652541  9770 raft_consensus.cc:493] T f03d0dbf16864ca4bc1bb5e4c0334c0f P ccd8a4c3bfe3413cb2ae219b09aea832 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:32.650691  9710 consensus_queue.cc:260] T d8cee0accdb8499c86d4414b72565a38 P 7ba59cc884714e8aa5f3f0ecaed84cbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:19:32.673270  9627 raft_consensus.cc:493] T 4f00a2e87e56452083b759f60d461ee3 P cd75a17ab2604397adab03bb8b5fd75c [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:19:32.690347  9710 raft_consensus.cc:3060] T d8cee0accdb8499c86d4414b72565a38 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:19:32.703100  9767 log.cc:927] Time spent T 4d9def8b32fd443aa94ab1420b06837b P b7ab4784c7344b939bc36f639286f377: Append to log took a long time: real 0.072s	user 0.001s	sys 0.000s
I20260709 13:19:32.702970  9766 consensus_queue.cc:237] T 3a485a995abc4807b6e511e45419f737 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:32.675654  9726 consensus_queue.cc:260] T 9b3759de40694069b13c0f8bd40e5709 P ccd8a4c3bfe3413cb2ae219b09aea832 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:32.706712  9759 consensus_queue.cc:237] T a3022224cc81473690653a83d4e99470 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
W20260709 13:19:32.716548  9728 consensus_meta.cc:287] T 90d42e216d9741e190bca19a781291fd P ccd8a4c3bfe3413cb2ae219b09aea832: Time spent flushing consensus metadata: real 0.965s	user 0.006s	sys 0.010s
I20260709 13:19:32.690546  9770 raft_consensus.cc:515] T f03d0dbf16864ca4bc1bb5e4c0334c0f P ccd8a4c3bfe3413cb2ae219b09aea832 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:32.721164  9770 leader_election.cc:290] T f03d0dbf16864ca4bc1bb5e4c0334c0f P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
W20260709 13:19:32.775724  6696 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.523s	user 0.013s	sys 0.016s
W20260709 13:19:32.776541  6696 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.525s	user 0.013s	sys 0.017s
W20260709 13:19:32.775398  6770 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 384306us
I20260709 13:19:32.790036  6770 leader_election.cc:304] T 44bde925b2e541b69890d70715b85176 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:19:32.797276  6879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22ccee1b570c4ad3a57bd7aec085b1b4" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:19:32.800173  6880 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53416 (request call id 2459) took 1164 ms. Trace:
I20260709 13:19:32.802284  6873 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53416 (request call id 2460) took 1092 ms. Trace:
I20260709 13:19:32.800776  6880 rpcz_store.cc:276] 0709 13:19:31.635680 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:31.635886 (+   206us) service_pool.cc:224] Handling call
0709 13:19:31.636413 (+   527us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:31.637246 (+   833us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:31.637277 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:31.643518 (+  6241us) log.cc:844] Serialized 26 byte log entry
0709 13:19:31.968633 (+325115us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:19:31.968698 (+    65us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:31.968806 (+   108us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:32.799510 (+830704us) raft_consensus.cc:1685] finished
0709 13:19:32.799560 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:32.799881 (+   321us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":389,"raft.queue_time_us":571,"raft.run_cpu_time_us":155,"raft.run_wall_time_us":21522,"thread_start_us":324620,"threads_started":1,"wal-append.queue_time_us":974129}
I20260709 13:19:32.802750  6873 rpcz_store.cc:276] 0709 13:19:31.709825 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:31.709967 (+   142us) service_pool.cc:224] Handling call
0709 13:19:31.744364 (+ 34397us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:31.744781 (+   417us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:31.744826 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:31.748804 (+  3978us) log.cc:844] Serialized 26 byte log entry
0709 13:19:32.123472 (+374668us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:19:32.123545 (+    73us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:32.123675 (+   130us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:32.795300 (+671625us) raft_consensus.cc:1685] finished
0709 13:19:32.795359 (+    59us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:32.802077 (+  6718us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":672,"raft.run_cpu_time_us":135,"raft.run_wall_time_us":5121,"thread_start_us":358226,"threads_started":1,"wal-append.queue_time_us":546850}
W20260709 13:19:32.807319  7468 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:32.644325  7503 raft_consensus.cc:2468] T 7ba5dac66ab5497e9e336f2a3c28cda5 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 9.
I20260709 13:19:32.810997  9564 raft_consensus.cc:515] T 427c124d773f483294511e80fe340075 P b7ab4784c7344b939bc36f639286f377 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } attrs { replace: true } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:19:32.815153  9259 raft_consensus.cc:493] T f09c2a98de1a4decabd0ff900dd44caa P ccd8a4c3bfe3413cb2ae219b09aea832 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:32.818315  9564 leader_election.cc:290] T 427c124d773f483294511e80fe340075 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 6 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:19:32.821014  6806 raft_consensus.cc:1240] T 427c124d773f483294511e80fe340075 P b7ab4784c7344b939bc36f639286f377 [term 6 FOLLOWER]: Rejecting Update request from peer 7ba59cc884714e8aa5f3f0ecaed84cbb for earlier term 5. Current term is 6. Ops: []
I20260709 13:19:32.824860  6731 raft_consensus.cc:1240] T 711ef6523deb4cbe8ef2ba61e1c21c98 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 9 FOLLOWER]: Rejecting Update request from peer b7ab4784c7344b939bc36f639286f377 for earlier term 8. Current term is 9. Ops: []
I20260709 13:19:32.834031  9553 raft_consensus.cc:2749] T 44bde925b2e541b69890d70715b85176 P b7ab4784c7344b939bc36f639286f377 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:19:32.838198  6873 raft_consensus.cc:1275] T c4db81d9d329422bb3b4160ca4ac2d1d P cd75a17ab2604397adab03bb8b5fd75c [term 8 FOLLOWER]: Refusing update from remote peer ccd8a4c3bfe3413cb2ae219b09aea832: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:19:32.831482  6770 leader_election.cc:304] T 9e326172347f45e99a0d482b5d8ef768 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
I20260709 13:19:32.840543  7495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "427c124d773f483294511e80fe340075" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb"
I20260709 13:19:32.841502  9553 raft_consensus.cc:493] T d8292e16e5654be6bc408560cf256aaa P b7ab4784c7344b939bc36f639286f377 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:32.843050  6770 leader_election.cc:304] T 7887766dc6784fcaa42b35c05fea7a99 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
I20260709 13:19:32.844599  9506 leader_election.cc:290] T 711ef6523deb4cbe8ef2ba61e1c21c98 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 9 election: Requested vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:32.845058  6879 raft_consensus.cc:1240] T 4d9def8b32fd443aa94ab1420b06837b P cd75a17ab2604397adab03bb8b5fd75c [term 8 FOLLOWER]: Rejecting Update request from peer b7ab4784c7344b939bc36f639286f377 for earlier term 7. Current term is 8. Ops: []
I20260709 13:19:32.845974  9506 raft_consensus.cc:493] T f58dc08b12a2494bb9a1372837970ca2 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:32.846685  9031 consensus_queue.cc:1048] T ce4f062dcd314d43a63ca74067cb5ee3 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:19:32.848344  9487 raft_consensus.cc:493] T f58dc08b12a2494bb9a1372837970ca2 P b7ab4784c7344b939bc36f639286f377 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:32.833267  9259 raft_consensus.cc:515] T f09c2a98de1a4decabd0ff900dd44caa P ccd8a4c3bfe3413cb2ae219b09aea832 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:32.849676  9487 raft_consensus.cc:515] T f58dc08b12a2494bb9a1372837970ca2 P b7ab4784c7344b939bc36f639286f377 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:32.842746  9553 raft_consensus.cc:515] T d8292e16e5654be6bc408560cf256aaa P b7ab4784c7344b939bc36f639286f377 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
W20260709 13:19:32.855165  7467 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:32.857805  9031 raft_consensus.cc:2804] T 9e326172347f45e99a0d482b5d8ef768 P b7ab4784c7344b939bc36f639286f377 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:19:32.846957  9506 raft_consensus.cc:515] T f58dc08b12a2494bb9a1372837970ca2 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
W20260709 13:19:32.858600  9603 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.775s	user 0.005s	sys 0.009s
I20260709 13:19:32.859601  9259 leader_election.cc:290] T f09c2a98de1a4decabd0ff900dd44caa P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:32.860392  9589 consensus_queue.cc:1059] T 95a75bfe094d4bdc963aba3f08dfcd25 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: INVALID_TERM, Last received: 7.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:19:32.860991  6772 leader_election.cc:304] T b3f13b31a1f84f0d89d007eadd57924c P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:19:32.880676  9031 raft_consensus.cc:493] T 9e326172347f45e99a0d482b5d8ef768 P b7ab4784c7344b939bc36f639286f377 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:19:32.968024  6730 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.767s	user 0.003s	sys 0.009s
W20260709 13:19:32.968732  6730 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.768s	user 0.003s	sys 0.009s
W20260709 13:19:32.960282  9603 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.884s	user 0.006s	sys 0.010s
I20260709 13:19:32.962049  9031 raft_consensus.cc:3060] T 9e326172347f45e99a0d482b5d8ef768 P b7ab4784c7344b939bc36f639286f377 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:32.957803  9726 raft_consensus.cc:3060] T 9b3759de40694069b13c0f8bd40e5709 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:19:33.004817  6627 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.714s	user 0.026s	sys 0.050s
I20260709 13:19:33.006544  9589 raft_consensus.cc:3055] T 95a75bfe094d4bdc963aba3f08dfcd25 P b7ab4784c7344b939bc36f639286f377 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:19:33.007112  9589 raft_consensus.cc:740] T 95a75bfe094d4bdc963aba3f08dfcd25 P b7ab4784c7344b939bc36f639286f377 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
I20260709 13:19:33.007459  9487 leader_election.cc:290] T f58dc08b12a2494bb9a1372837970ca2 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:33.008111  9730 raft_consensus.cc:493] T bb3d8792045a4583ae2e965b1350a5b4 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader cd75a17ab2604397adab03bb8b5fd75c)
W20260709 13:19:33.008459  9663 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.785s	user 0.006s	sys 0.013s
I20260709 13:19:33.010144  9728 raft_consensus.cc:493] T 853ac0a8cbd64ce99457f170216d4d0f P ccd8a4c3bfe3413cb2ae219b09aea832 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:33.008638  9589 consensus_queue.cc:260] T 95a75bfe094d4bdc963aba3f08dfcd25 P b7ab4784c7344b939bc36f639286f377 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 8.3, Last appended by leader: 3, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:33.016259  9616 raft_consensus.cc:493] T 20f6842e26174571996b8dea4151d4be P cd75a17ab2604397adab03bb8b5fd75c [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:33.017103  9616 raft_consensus.cc:515] T 20f6842e26174571996b8dea4151d4be P cd75a17ab2604397adab03bb8b5fd75c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
W20260709 13:19:33.010124  6772 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.68:45071, user_credentials={real_user=slave}} blocked reactor thread for 149472us
I20260709 13:19:33.019143  6772 leader_election.cc:304] T 7ba5dac66ab5497e9e336f2a3c28cda5 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, b7ab4784c7344b939bc36f639286f377; no voters: 
W20260709 13:19:33.020262  9515 consensus_meta.cc:287] T ab432e62819d499eaaf3dd55481dd930 P ccd8a4c3bfe3413cb2ae219b09aea832: Time spent flushing consensus metadata: real 1.190s	user 0.005s	sys 0.017s
I20260709 13:19:33.020910  9515 raft_consensus.cc:515] T ab432e62819d499eaaf3dd55481dd930 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
W20260709 13:19:33.021127  6875 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.578s	user 0.007s	sys 0.005s
I20260709 13:19:33.021225  9654 leader_election.cc:290] T 44bde925b2e541b69890d70715b85176 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
W20260709 13:19:33.021883  6875 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.622s	user 0.008s	sys 0.005s
W20260709 13:19:33.024214  6728 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.528s	user 0.001s	sys 0.006s
I20260709 13:19:33.020325  9592 consensus_queue.cc:1059] T 3fa34c08b205435dba97346991aa1f92 P 7ba59cc884714e8aa5f3f0ecaed84cbb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.163s
W20260709 13:19:33.025110  6728 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.586s	user 0.001s	sys 0.007s
I20260709 13:19:33.025974  9592 raft_consensus.cc:3055] T 3fa34c08b205435dba97346991aa1f92 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:19:33.026527  9592 raft_consensus.cc:740] T 3fa34c08b205435dba97346991aa1f92 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 7ba59cc884714e8aa5f3f0ecaed84cbb, State: Running, Role: LEADER
I20260709 13:19:33.023617  9515 leader_election.cc:290] T ab432e62819d499eaaf3dd55481dd930 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 9 election: Requested vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
W20260709 13:19:33.004833  6844 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.843s	user 0.002s	sys 0.005s
I20260709 13:19:33.029656  9592 consensus_queue.cc:260] T 3fa34c08b205435dba97346991aa1f92 P 7ba59cc884714e8aa5f3f0ecaed84cbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
W20260709 13:19:33.030442  6844 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.902s	user 0.002s	sys 0.006s
I20260709 13:19:33.016614  9728 raft_consensus.cc:515] T 853ac0a8cbd64ce99457f170216d4d0f P ccd8a4c3bfe3413cb2ae219b09aea832 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
W20260709 13:19:33.033515  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 1.05377e+06us
W20260709 13:19:33.011555  6872 consensus_meta.cc:287] T 7887766dc6784fcaa42b35c05fea7a99 P cd75a17ab2604397adab03bb8b5fd75c: Time spent flushing consensus metadata: real 0.545s	user 0.013s	sys 0.006s
I20260709 13:19:33.031149  9781 raft_consensus.cc:2804] T 7ba5dac66ab5497e9e336f2a3c28cda5 P b7ab4784c7344b939bc36f639286f377 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:19:33.031466  9766 raft_consensus.cc:493] T 4b8cacb381b746da8d0049b0a83b41dd P ccd8a4c3bfe3413cb2ae219b09aea832 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:33.005411  6627 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.715s	user 0.027s	sys 0.050s
I20260709 13:19:33.036405  6872 raft_consensus.cc:2468] T 7887766dc6784fcaa42b35c05fea7a99 P cd75a17ab2604397adab03bb8b5fd75c [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 8.
W20260709 13:19:33.046238  9663 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.850s	user 0.006s	sys 0.013s
I20260709 13:19:33.046962  9766 raft_consensus.cc:515] T 4b8cacb381b746da8d0049b0a83b41dd P ccd8a4c3bfe3413cb2ae219b09aea832 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:19:33.009008  9730 raft_consensus.cc:515] T bb3d8792045a4583ae2e965b1350a5b4 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:19:33.050199  9766 leader_election.cc:290] T 4b8cacb381b746da8d0049b0a83b41dd P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:19:33.054320  9592 raft_consensus.cc:3060] T 3fa34c08b205435dba97346991aa1f92 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:19:32.994652  9649 consensus_meta.cc:287] T 4275cf08e63345f993bce8664eada830 P cd75a17ab2604397adab03bb8b5fd75c: Time spent flushing consensus metadata: real 1.198s	user 0.011s	sys 0.000s
I20260709 13:19:33.020233  9589 raft_consensus.cc:3060] T 95a75bfe094d4bdc963aba3f08dfcd25 P b7ab4784c7344b939bc36f639286f377 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:19:33.015393  9586 consensus_meta.cc:287] T 17587d6730594da4a56fa13a353232a1 P 7ba59cc884714e8aa5f3f0ecaed84cbb: Time spent flushing consensus metadata: real 1.304s	user 0.013s	sys 0.008s
I20260709 13:19:33.064397  6727 raft_consensus.cc:1240] T ab432e62819d499eaaf3dd55481dd930 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 9 FOLLOWER]: Rejecting Update request from peer b7ab4784c7344b939bc36f639286f377 for earlier term 8. Current term is 9. Ops: []
I20260709 13:19:33.030906  9626 leader_election.cc:290] T f5be3a11b23d4ea9b08300a2789821c7 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:33.068254  9759 raft_consensus.cc:493] T 8c7f33e544204fbaac4078e3e83bbf4e P ccd8a4c3bfe3413cb2ae219b09aea832 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:33.082640  9759 raft_consensus.cc:515] T 8c7f33e544204fbaac4078e3e83bbf4e P ccd8a4c3bfe3413cb2ae219b09aea832 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:33.085670  9506 leader_election.cc:290] T f58dc08b12a2494bb9a1372837970ca2 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:33.087092  6732 raft_consensus.cc:2955] T 1528ab62b6fe4e3099d08f141afee116 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 6 FOLLOWER]: Committing config change with OpId 5.6: config changed from index 3 to 6, VOTER cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } } }
I20260709 13:19:33.069585  9553 leader_election.cc:290] T d8292e16e5654be6bc408560cf256aaa P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:33.036774  6844 leader_election.cc:304] T 3d65025eea89441290d85dd053810e31 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
W20260709 13:19:33.081561  9651 consensus_meta.cc:287] T d33d5ee8ef6f415593d8df52063161ad P cd75a17ab2604397adab03bb8b5fd75c: Time spent flushing consensus metadata: real 1.297s	user 0.006s	sys 0.010s
I20260709 13:19:33.092305  9775 raft_consensus.cc:2804] T 7887766dc6784fcaa42b35c05fea7a99 P b7ab4784c7344b939bc36f639286f377 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:19:33.092739  6772 leader_election.cc:304] T 20f6842e26174571996b8dea4151d4be P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: ccd8a4c3bfe3413cb2ae219b09aea832
W20260709 13:19:33.090859  6770 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 247998us
I20260709 13:19:33.051034  9781 raft_consensus.cc:493] T 7ba5dac66ab5497e9e336f2a3c28cda5 P b7ab4784c7344b939bc36f639286f377 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:32.995831  9603 raft_consensus.cc:697] T be1a92657f494cac8dd227d152f50151 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 9 LEADER]: Becoming Leader. State: Replica: 7ba59cc884714e8aa5f3f0ecaed84cbb, State: Running, Role: LEADER
I20260709 13:19:33.010787  9783 raft_consensus.cc:2749] T b3f13b31a1f84f0d89d007eadd57924c P b7ab4784c7344b939bc36f639286f377 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:19:33.102360  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 66569.7us
I20260709 13:19:33.109838  9780 raft_consensus.cc:493] T 2c240553ce044eedb41541d72b9475d7 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:33.104461  9651 raft_consensus.cc:515] T d33d5ee8ef6f415593d8df52063161ad P cd75a17ab2604397adab03bb8b5fd75c [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:33.110836  9780 raft_consensus.cc:515] T 2c240553ce044eedb41541d72b9475d7 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:33.114965  9627 raft_consensus.cc:515] T 4f00a2e87e56452083b759f60d461ee3 P cd75a17ab2604397adab03bb8b5fd75c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:19:33.100461  9586 raft_consensus.cc:515] T 17587d6730594da4a56fa13a353232a1 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
W20260709 13:19:33.122723  9366 consensus_meta.cc:287] T 1528ab62b6fe4e3099d08f141afee116 P 7ba59cc884714e8aa5f3f0ecaed84cbb: Time spent flushing consensus metadata: real 1.224s	user 0.007s	sys 0.015s
I20260709 13:19:33.123211  9759 leader_election.cc:290] T 8c7f33e544204fbaac4078e3e83bbf4e P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:33.124120  6877 raft_consensus.cc:1240] T d33d5ee8ef6f415593d8df52063161ad P cd75a17ab2604397adab03bb8b5fd75c [term 9 FOLLOWER]: Rejecting Update request from peer b7ab4784c7344b939bc36f639286f377 for earlier term 8. Current term is 9. Ops: []
I20260709 13:19:33.125653  7495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f00a2e87e56452083b759f60d461ee3" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:19:33.126044  9769 raft_consensus.cc:493] T 4275cf08e63345f993bce8664eada830 P cd75a17ab2604397adab03bb8b5fd75c [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:33.126780  9769 raft_consensus.cc:515] T 4275cf08e63345f993bce8664eada830 P cd75a17ab2604397adab03bb8b5fd75c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:33.127367  7496 raft_consensus.cc:1240] T 17587d6730594da4a56fa13a353232a1 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 10 FOLLOWER]: Rejecting Update request from peer ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 9. Current term is 10. Ops: []
W20260709 13:19:33.128376  6771 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:33.122639  9586 leader_election.cc:290] T 17587d6730594da4a56fa13a353232a1 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 10 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:19:33.123356  9366 raft_consensus.cc:515] T 1528ab62b6fe4e3099d08f141afee116 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 7 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:19:33.100896  9781 raft_consensus.cc:3060] T 7ba5dac66ab5497e9e336f2a3c28cda5 P b7ab4784c7344b939bc36f639286f377 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:33.126801  7495 raft_consensus.cc:2468] T 4f00a2e87e56452083b759f60d461ee3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 7.
I20260709 13:19:33.103533  9728 leader_election.cc:290] T 853ac0a8cbd64ce99457f170216d4d0f P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:33.140475  9654 raft_consensus.cc:493] T de3186201e1a40d0b335eeb8b4e256e0 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:33.144876  9794 raft_consensus.cc:2804] T 20f6842e26174571996b8dea4151d4be P b7ab4784c7344b939bc36f639286f377 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:19:33.131323  9627 leader_election.cc:290] T 4f00a2e87e56452083b759f60d461ee3 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:19:33.157518  9800 raft_consensus.cc:493] T ce4f062dcd314d43a63ca74067cb5ee3 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:33.158149  9720 raft_consensus.cc:2804] T 3d65025eea89441290d85dd053810e31 P cd75a17ab2604397adab03bb8b5fd75c [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:19:33.157506  7503 raft_consensus.cc:1240] T 1528ab62b6fe4e3099d08f141afee116 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 7 FOLLOWER]: Rejecting Update request from peer b7ab4784c7344b939bc36f639286f377 for earlier term 6. Current term is 7. Ops: []
W20260709 13:19:33.160091  6723 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.563s	user 0.007s	sys 0.005s
I20260709 13:19:33.160195  9780 leader_election.cc:290] T 2c240553ce044eedb41541d72b9475d7 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:33.160527  9506 consensus_queue.cc:1048] T 713b5728a197487c9300b310ab94e5a3 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
W20260709 13:19:33.161959  9709 consensus_meta.cc:287] T 95a75bfe094d4bdc963aba3f08dfcd25 P cd75a17ab2604397adab03bb8b5fd75c: Time spent flushing consensus metadata: real 1.376s	user 0.007s	sys 0.010s
I20260709 13:19:33.130517  9616 leader_election.cc:290] T 20f6842e26174571996b8dea4151d4be P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
W20260709 13:19:33.162292  9694 consensus_meta.cc:287] T a1704639a875409b9959353527b3fd68 P ccd8a4c3bfe3413cb2ae219b09aea832: Time spent flushing consensus metadata: real 0.854s	user 0.012s	sys 0.004s
I20260709 13:19:33.162864  9654 raft_consensus.cc:515] T de3186201e1a40d0b335eeb8b4e256e0 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:33.153013  9759 raft_consensus.cc:493] T b3f13b31a1f84f0d89d007eadd57924c P ccd8a4c3bfe3413cb2ae219b09aea832 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 7ba59cc884714e8aa5f3f0ecaed84cbb)
I20260709 13:19:33.163339  9603 consensus_queue.cc:237] T be1a92657f494cac8dd227d152f50151 P 7ba59cc884714e8aa5f3f0ecaed84cbb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:19:33.184087  6724 raft_consensus.cc:2468] T 90d42e216d9741e190bca19a781291fd P ccd8a4c3bfe3413cb2ae219b09aea832 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 8.
W20260709 13:19:33.185551  7468 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:33.183655  9720 raft_consensus.cc:493] T 3d65025eea89441290d85dd053810e31 P cd75a17ab2604397adab03bb8b5fd75c [term 6 FOLLOWER]: Starting leader election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:19:33.150071  9775 raft_consensus.cc:697] T 7887766dc6784fcaa42b35c05fea7a99 P b7ab4784c7344b939bc36f639286f377 [term 8 LEADER]: Becoming Leader. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
I20260709 13:19:33.294140  6806 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50550 (request call id 280) took 1478 ms. Trace:
W20260709 13:19:33.388226  6697 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.664s	user 0.015s	sys 0.061s
I20260709 13:19:33.188509  6804 raft_consensus.cc:1275] T c4db81d9d329422bb3b4160ca4ac2d1d P b7ab4784c7344b939bc36f639286f377 [term 8 FOLLOWER]: Refusing update from remote peer ccd8a4c3bfe3413cb2ae219b09aea832: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
W20260709 13:19:33.254289  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 88598.3us
W20260709 13:19:33.273167  6772 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 180650us
I20260709 13:19:33.403005  6730 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50004 (request call id 1552) took 1408 ms. Trace:
I20260709 13:19:33.412755  6801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20f6842e26174571996b8dea4151d4be" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
W20260709 13:19:33.434834  6697 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.997s	user 0.019s	sys 0.065s
W20260709 13:19:33.436015  7467 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:33.188438  6723 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.748s	user 0.007s	sys 0.006s
I20260709 13:19:33.189451  6799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44bde925b2e541b69890d70715b85176" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:19:33.432868  6730 rpcz_store.cc:276] 0709 13:19:31.994537 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:32.180157 (+185620us) service_pool.cc:224] Handling call
0709 13:19:32.180490 (+   333us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:32.969562 (+789072us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:32.969648 (+    86us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:32.970796 (+  1148us) log.cc:844] Serialized 26 byte log entry
0709 13:19:33.103026 (+132230us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:19:33.183070 (+ 80044us) log.cc:844] Serialized 14 byte log entry
0709 13:19:33.237688 (+ 54618us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:33.266263 (+ 28575us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:33.402554 (+136291us) raft_consensus.cc:1685] finished
0709 13:19:33.402581 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:33.402841 (+   260us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":160032,"prepare.queue_time_us":43530,"prepare.run_cpu_time_us":70,"prepare.run_wall_time_us":70,"raft.queue_time_us":181683,"raft.run_cpu_time_us":359,"raft.run_wall_time_us":56173,"thread_start_us":934407,"threads_started":3,"wal-append.queue_time_us":424880}
I20260709 13:19:33.458120  9775 consensus_queue.cc:237] T 7887766dc6784fcaa42b35c05fea7a99 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 6.3, Last appended by leader: 3, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:33.465380  6844 leader_election.cc:304] T 22ccee1b570c4ad3a57bd7aec085b1b4 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
W20260709 13:19:33.198249  9657 consensus_meta.cc:287] T 24ee15416e3145beaa1b8183453729a3 P ccd8a4c3bfe3413cb2ae219b09aea832: Time spent flushing consensus metadata: real 0.910s	user 0.018s	sys 0.000s
W20260709 13:19:33.444917  7468 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:33.472353  7468 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:33.472752  7468 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:33.289309  9489 consensus_meta.cc:287] T 34f36d59d88f40fe8a2805e604fc6c0a P ccd8a4c3bfe3413cb2ae219b09aea832: Time spent flushing consensus metadata: real 1.323s	user 0.012s	sys 0.013s
I20260709 13:19:33.186025  9651 leader_election.cc:290] T d33d5ee8ef6f415593d8df52063161ad P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 9 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:19:33.428746  9720 raft_consensus.cc:3060] T 3d65025eea89441290d85dd053810e31 P cd75a17ab2604397adab03bb8b5fd75c [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:33.448949  6804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5be3a11b23d4ea9b08300a2789821c7" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:19:33.449569  6802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "711ef6523deb4cbe8ef2ba61e1c21c98" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:19:33.450098  9654 leader_election.cc:290] T de3186201e1a40d0b335eeb8b4e256e0 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:33.450167  9694 raft_consensus.cc:515] T a1704639a875409b9959353527b3fd68 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
W20260709 13:19:33.327611  9609 consensus_meta.cc:287] T 9e326172347f45e99a0d482b5d8ef768 P ccd8a4c3bfe3413cb2ae219b09aea832: Time spent flushing consensus metadata: real 0.680s	user 0.011s	sys 0.000s
I20260709 13:19:33.288987  9770 raft_consensus.cc:493] T 4d9def8b32fd443aa94ab1420b06837b P ccd8a4c3bfe3413cb2ae219b09aea832 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:19:33.272054  9794 raft_consensus.cc:697] T 20f6842e26174571996b8dea4151d4be P b7ab4784c7344b939bc36f639286f377 [term 8 LEADER]: Becoming Leader. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
I20260709 13:19:33.289847  9800 raft_consensus.cc:515] T ce4f062dcd314d43a63ca74067cb5ee3 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } attrs { replace: true } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
W20260709 13:19:33.452421  6697 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:33.452741  6723 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50004 (request call id 1547) took 1477 ms. Trace:
I20260709 13:19:33.453228  6799 raft_consensus.cc:2468] T 44bde925b2e541b69890d70715b85176 P b7ab4784c7344b939bc36f639286f377 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 8.
I20260709 13:19:33.454931  6772 leader_election.cc:304] T bd6869f07b5a4885a0b99fbe60c3b175 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:19:33.447098  9783 raft_consensus.cc:493] T 17587d6730594da4a56fa13a353232a1 P b7ab4784c7344b939bc36f639286f377 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:19:33.466094  6846 leader_election.cc:304] T 4f00a2e87e56452083b759f60d461ee3 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:19:33.447389  9586 raft_consensus.cc:493] T ce4f062dcd314d43a63ca74067cb5ee3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:33.468305  6805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09c2a98de1a4decabd0ff900dd44caa" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:19:33.426348  6806 rpcz_store.cc:276] 0709 13:19:31.815492 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:31.815618 (+   126us) service_pool.cc:224] Handling call
0709 13:19:31.815934 (+   316us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:32.821925 (+1005991us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:33.293816 (+471891us) spinlock_profiling.cc:243] Waited 1 s on lock 0x7b54001f7f54. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f9aae01 00007fcc0f9a983e 00007fcc1496e419 00007fcc0dee5bd4 00007fcc0dee5b62 00007fcc0dee5a91 00007fcc0dee5a0c 00007fcc0dee4cc2 00007fcc0dce548c 00007fcc0dce48c6
0709 13:19:33.294060 (+   244us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2309478272}
I20260709 13:19:33.322616  9366 leader_election.cc:290] T 1528ab62b6fe4e3099d08f141afee116 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 7 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:19:33.482303  9759 raft_consensus.cc:515] T b3f13b31a1f84f0d89d007eadd57924c P ccd8a4c3bfe3413cb2ae219b09aea832 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
W20260709 13:19:33.483253  9502 consensus_meta.cc:287] T 7c37d41cd9164c15a6826ca62a851a69 P ccd8a4c3bfe3413cb2ae219b09aea832: Time spent flushing consensus metadata: real 1.625s	user 0.008s	sys 0.016s
W20260709 13:19:33.486586  9792 log.cc:927] Time spent T 44bde925b2e541b69890d70715b85176 P cd75a17ab2604397adab03bb8b5fd75c: Append to log took a long time: real 0.313s	user 0.002s	sys 0.000s
I20260709 13:19:33.530745  9728 raft_consensus.cc:493] T f4b8bd455d5a47c18a1380839c6e0d61 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:33.489017  9749 log.cc:927] Time spent T 404190ce4ce94cecbfcb6ea9d1dd8626 P ccd8a4c3bfe3413cb2ae219b09aea832: Append to log took a long time: real 1.199s	user 0.007s	sys 0.007s
I20260709 13:19:33.477735  6875 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53406 (request call id 1646) took 1077 ms. Trace:
I20260709 13:19:33.193133  9713 raft_consensus.cc:493] T a1704639a875409b9959353527b3fd68 P b7ab4784c7344b939bc36f639286f377 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:33.514036  6805 raft_consensus.cc:2468] T f09c2a98de1a4decabd0ff900dd44caa P b7ab4784c7344b939bc36f639286f377 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 8.
W20260709 13:19:33.540272  9631 consensus_meta.cc:287] T 24ee15416e3145beaa1b8183453729a3 P cd75a17ab2604397adab03bb8b5fd75c: Time spent flushing consensus metadata: real 1.259s	user 0.014s	sys 0.003s
W20260709 13:19:33.514253  9608 consensus_meta.cc:287] T f5be3a11b23d4ea9b08300a2789821c7 P cd75a17ab2604397adab03bb8b5fd75c: Time spent flushing consensus metadata: real 1.269s	user 0.012s	sys 0.003s
I20260709 13:19:33.540904  9631 raft_consensus.cc:2749] T 24ee15416e3145beaa1b8183453729a3 P cd75a17ab2604397adab03bb8b5fd75c [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:19:33.541098  9608 raft_consensus.cc:515] T f5be3a11b23d4ea9b08300a2789821c7 P cd75a17ab2604397adab03bb8b5fd75c [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:33.542205  9589 raft_consensus.cc:2749] T bd6869f07b5a4885a0b99fbe60c3b175 P b7ab4784c7344b939bc36f639286f377 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:19:33.542593  6730 raft_consensus.cc:1240] T 22ccee1b570c4ad3a57bd7aec085b1b4 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 7 FOLLOWER]: Rejecting Update request from peer b7ab4784c7344b939bc36f639286f377 for earlier term 6. Current term is 7. Ops: []
I20260709 13:19:33.515425  6806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "853ac0a8cbd64ce99457f170216d4d0f" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:19:33.480888  9657 raft_consensus.cc:515] T 24ee15416e3145beaa1b8183453729a3 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:19:33.515466  6799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f58dc08b12a2494bb9a1372837970ca2" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:19:33.444254  9709 raft_consensus.cc:515] T 95a75bfe094d4bdc963aba3f08dfcd25 P cd75a17ab2604397adab03bb8b5fd75c [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:33.524075  9784 raft_consensus.cc:493] T 404190ce4ce94cecbfcb6ea9d1dd8626 P b7ab4784c7344b939bc36f639286f377 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 7ba59cc884714e8aa5f3f0ecaed84cbb)
W20260709 13:19:33.524816  9799 log.cc:927] Time spent T d33d5ee8ef6f415593d8df52063161ad P ccd8a4c3bfe3413cb2ae219b09aea832: Append to log took a long time: real 0.080s	user 0.001s	sys 0.000s
I20260709 13:19:33.524271  9770 raft_consensus.cc:515] T 4d9def8b32fd443aa94ab1420b06837b P ccd8a4c3bfe3413cb2ae219b09aea832 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:33.526104  9366 consensus_queue.cc:1059] T 427c124d773f483294511e80fe340075 P 7ba59cc884714e8aa5f3f0ecaed84cbb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: INVALID_TERM, Last received: 5.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:19:33.527001  9502 raft_consensus.cc:515] T 7c37d41cd9164c15a6826ca62a851a69 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:33.527851  9654 raft_consensus.cc:493] T be1a92657f494cac8dd227d152f50151 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:33.529461  9800 leader_election.cc:290] T ce4f062dcd314d43a63ca74067cb5ee3 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
W20260709 13:19:33.532848  6846 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.68:45071, user_credentials={real_user=slave}} blocked reactor thread for 367418us
W20260709 13:19:33.534682  6772 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 79872.2us
I20260709 13:19:33.543936  9608 leader_election.cc:290] T f5be3a11b23d4ea9b08300a2789821c7 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 6 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:19:33.539636  9651 raft_consensus.cc:2804] T 4f00a2e87e56452083b759f60d461ee3 P cd75a17ab2604397adab03bb8b5fd75c [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:19:33.543311  9783 raft_consensus.cc:515] T 17587d6730594da4a56fa13a353232a1 P b7ab4784c7344b939bc36f639286f377 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:19:33.544234  9797 raft_consensus.cc:493] T f3f9c2e2bf644115957398fe4c9459db P ccd8a4c3bfe3413cb2ae219b09aea832 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:33.519876  6732 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50004 (request call id 1555) took 1372 ms. Trace:
I20260709 13:19:33.544524  6806 raft_consensus.cc:2468] T 853ac0a8cbd64ce99457f170216d4d0f P b7ab4784c7344b939bc36f639286f377 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 5.
I20260709 13:19:33.549678  6799 raft_consensus.cc:2468] T f58dc08b12a2494bb9a1372837970ca2 P b7ab4784c7344b939bc36f639286f377 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 9.
I20260709 13:19:33.520747  9649 raft_consensus.cc:2804] T 22ccee1b570c4ad3a57bd7aec085b1b4 P cd75a17ab2604397adab03bb8b5fd75c [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:19:33.504293  6723 rpcz_store.cc:276] 0709 13:19:31.974949 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:32.172236 (+197287us) service_pool.cc:224] Handling call
0709 13:19:32.172577 (+   341us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:32.363677 (+191100us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:32.363735 (+    58us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:32.364719 (+   984us) log.cc:844] Serialized 26 byte log entry
0709 13:19:33.452160 (+1087441us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:19:33.452228 (+    68us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:33.452380 (+   152us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:33.452431 (+    51us) raft_consensus.cc:1685] finished
0709 13:19:33.452445 (+    14us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:33.452667 (+   222us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":29227,"raft.queue_time_us":136257,"raft.run_cpu_time_us":228,"raft.run_wall_time_us":52181,"thread_start_us":1160904,"threads_started":2,"wal-append.queue_time_us":678737}
I20260709 13:19:33.536028  6875 rpcz_store.cc:276] 0709 13:19:32.394697 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:32.394832 (+   135us) service_pool.cc:224] Handling call
0709 13:19:32.399220 (+  4388us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:33.022792 (+623572us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:19:33.022861 (+    69us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:33.023917 (+  1056us) log.cc:844] Serialized 26 byte log entry
0709 13:19:33.141781 (+117864us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:19:33.141835 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:33.153756 (+ 11921us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:33.470310 (+316554us) raft_consensus.cc:1685] finished
0709 13:19:33.470329 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:33.472451 (+  2122us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":283254,"raft.run_cpu_time_us":163,"raft.run_wall_time_us":4112,"thread_start_us":725589,"threads_started":2,"wal-append.queue_time_us":424011}
I20260709 13:19:33.531417  9728 raft_consensus.cc:515] T f4b8bd455d5a47c18a1380839c6e0d61 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
W20260709 13:19:33.566056  9636 consensus_meta.cc:287] T e77e330a82df4b43a745d57a68f6f057 P cd75a17ab2604397adab03bb8b5fd75c: Time spent flushing consensus metadata: real 1.138s	user 0.004s	sys 0.015s
I20260709 13:19:33.566815  6802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab432e62819d499eaaf3dd55481dd930" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 9 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:19:33.567224  6729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "427c124d773f483294511e80fe340075" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:19:33.567847  6876 raft_consensus.cc:1240] T f5be3a11b23d4ea9b08300a2789821c7 P cd75a17ab2604397adab03bb8b5fd75c [term 6 FOLLOWER]: Rejecting Update request from peer b7ab4784c7344b939bc36f639286f377 for earlier term 5. Current term is 6. Ops: []
I20260709 13:19:33.569343  6728 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50004 (request call id 1556) took 1410 ms. Trace:
I20260709 13:19:33.512143  9609 raft_consensus.cc:515] T 9e326172347f45e99a0d482b5d8ef768 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:33.570940  6726 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49744 (request call id 264) took 1965 ms. Trace:
I20260709 13:19:33.504017  9489 raft_consensus.cc:515] T 34f36d59d88f40fe8a2805e604fc6c0a P ccd8a4c3bfe3413cb2ae219b09aea832 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
W20260709 13:19:33.564146  6695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 248648us
I20260709 13:19:33.590981  6732 rpcz_store.cc:276] 0709 13:19:32.147571 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:32.291769 (+144198us) service_pool.cc:224] Handling call
0709 13:19:32.296568 (+  4799us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:19:32.469807 (+173239us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:32.469847 (+    40us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:19:32.773509 (+303662us) log.cc:844] Serialized 520 byte log entry
0709 13:19:33.072445 (+298936us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:19:33.253657 (+181212us) log.cc:844] Serialized 14 byte log entry
0709 13:19:33.480360 (+226703us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:33.509704 (+ 29344us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:33.509773 (+    69us) raft_consensus.cc:1685] finished
0709 13:19:33.509794 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:33.519789 (+  9995us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":315118,"raft.queue_time_us":356380,"raft.run_cpu_time_us":455,"raft.run_wall_time_us":48355,"thread_start_us":374028,"threads_started":2,"wal-append.queue_time_us":303056}
I20260709 13:19:33.569931  6807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f03d0dbf16864ca4bc1bb5e4c0334c0f" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:19:33.601234  6728 rpcz_store.cc:276] 0709 13:19:32.159115 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:32.291911 (+132796us) service_pool.cc:224] Handling call
0709 13:19:32.331935 (+ 40024us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:19:32.353976 (+ 22041us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:32.354008 (+    32us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:19:32.354616 (+   608us) log.cc:844] Serialized 52 byte log entry
0709 13:19:33.026016 (+671400us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:19:33.026912 (+   896us) log.cc:844] Serialized 14 byte log entry
0709 13:19:33.103695 (+ 76783us) log.cc:844] Serialized 14 byte log entry
0709 13:19:33.163039 (+ 59344us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:33.163149 (+   110us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:33.568905 (+405756us) raft_consensus.cc:1685] finished
0709 13:19:33.568947 (+    42us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:33.569227 (+   280us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":146451,"prepare.queue_time_us":1945,"prepare.run_cpu_time_us":198,"prepare.run_wall_time_us":130,"raft.queue_time_us":395635,"raft.run_cpu_time_us":719,"raft.run_wall_time_us":57028,"thread_start_us":586450,"threads_started":1,"wal-append.queue_time_us":891999}
I20260709 13:19:33.617681  6874 raft_consensus.cc:2393] T 95a75bfe094d4bdc963aba3f08dfcd25 P cd75a17ab2604397adab03bb8b5fd75c [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate ccd8a4c3bfe3413cb2ae219b09aea832 in current term 9: Already voted for candidate cd75a17ab2604397adab03bb8b5fd75c in this term.
I20260709 13:19:33.511067  9616 consensus_queue.cc:1048] T 34f36d59d88f40fe8a2805e604fc6c0a P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Connected to new peer: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.086s
I20260709 13:19:33.590737  9589 raft_consensus.cc:493] T be1a92657f494cac8dd227d152f50151 P b7ab4784c7344b939bc36f639286f377 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:33.592726  9651 raft_consensus.cc:493] T 4f00a2e87e56452083b759f60d461ee3 P cd75a17ab2604397adab03bb8b5fd75c [term 7 FOLLOWER]: Starting leader election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:19:33.537890  9781 raft_consensus.cc:515] T 7ba5dac66ab5497e9e336f2a3c28cda5 P b7ab4784c7344b939bc36f639286f377 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:19:33.616608  6807 raft_consensus.cc:2468] T f03d0dbf16864ca4bc1bb5e4c0334c0f P b7ab4784c7344b939bc36f639286f377 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 6.
W20260709 13:19:33.616843  9726 consensus_meta.cc:287] T 9b3759de40694069b13c0f8bd40e5709 P ccd8a4c3bfe3413cb2ae219b09aea832: Time spent flushing consensus metadata: real 0.524s	user 0.011s	sys 0.002s
I20260709 13:19:33.618669  6695 leader_election.cc:304] T 44bde925b2e541b69890d70715b85176 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
W20260709 13:19:33.616375  9696 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.197s	user 0.002s	sys 0.032s
I20260709 13:19:33.540402  9713 raft_consensus.cc:515] T a1704639a875409b9959353527b3fd68 P b7ab4784c7344b939bc36f639286f377 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:33.600984  9649 raft_consensus.cc:493] T 22ccee1b570c4ad3a57bd7aec085b1b4 P cd75a17ab2604397adab03bb8b5fd75c [term 6 FOLLOWER]: Starting leader election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:19:33.574618  9586 raft_consensus.cc:515] T ce4f062dcd314d43a63ca74067cb5ee3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } attrs { replace: true } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:19:33.747267  9651 raft_consensus.cc:3060] T 4f00a2e87e56452083b759f60d461ee3 P cd75a17ab2604397adab03bb8b5fd75c [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:33.750092  9772 raft_consensus.cc:493] T 3411566abe2d4c9bb4b2adfdd05e6f17 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:19:33.751438  6697 leader_election.cc:304] T 3fa34c08b205435dba97346991aa1f92 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:19:33.620661  9489 leader_election.cc:290] T 34f36d59d88f40fe8a2805e604fc6c0a P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 6 election: Requested vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:33.741900  9631 raft_consensus.cc:493] T fe20b4b48823486ca3b9c648db6ce8aa P cd75a17ab2604397adab03bb8b5fd75c [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:33.610505  6726 rpcz_store.cc:276] 0709 13:19:31.605773 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:31.605932 (+   159us) service_pool.cc:224] Handling call
0709 13:19:31.606283 (+   351us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:31.606540 (+   257us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:31.606567 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:31.607088 (+   521us) log.cc:844] Serialized 26 byte log entry
0709 13:19:31.972548 (+365460us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:19:31.972589 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:31.972656 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:33.408993 (+1436337us) spinlock_profiling.cc:243] Waited 1.59 ms on lock 0x7b4400022b4c. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0c745db1 00007fcc0c7e3c85 00007fcc0c7e46a2 00007fcc0f5561db 00007fcc0f551aaf 00007fcc0f54586e 00007fcc0f544bb6 00007fcc0f5447d8 00007fcc0f54e221 00007fcc0f54e1d9 00007fcc0f54e169
0709 13:19:33.570321 (+161328us) raft_consensus.cc:1685] finished
0709 13:19:33.570355 (+    34us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:33.570751 (+   396us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3660544,"thread_start_us":356693,"threads_started":1,"wal-append.queue_time_us":673817}
I20260709 13:19:33.756145  6844 leader_election.cc:304] T ab432e62819d499eaaf3dd55481dd930 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:19:33.760994  6873 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53416 (request call id 2468) took 1167 ms. Trace:
I20260709 13:19:33.622766  9783 leader_election.cc:290] T 17587d6730594da4a56fa13a353232a1 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
W20260709 13:19:33.770491  6771 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:33.758055  9696 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.487s	user 0.002s	sys 0.033s
I20260709 13:19:33.804541  6806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c7f33e544204fbaac4078e3e83bbf4e" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:19:33.808007  6732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f58dc08b12a2494bb9a1372837970ca2" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:19:33.574433  9627 consensus_queue.cc:1048] T 3a485a995abc4807b6e511e45419f737 P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Connected to new peer: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.183s
I20260709 13:19:33.723201  9797 raft_consensus.cc:515] T f3f9c2e2bf644115957398fe4c9459db P ccd8a4c3bfe3413cb2ae219b09aea832 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:33.620769  9716 consensus_queue.cc:1048] T c4db81d9d329422bb3b4160ca4ac2d1d P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.145s
I20260709 13:19:33.825752  9809 raft_consensus.cc:2804] T ab432e62819d499eaaf3dd55481dd930 P cd75a17ab2604397adab03bb8b5fd75c [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:19:33.826380  9809 raft_consensus.cc:493] T ab432e62819d499eaaf3dd55481dd930 P cd75a17ab2604397adab03bb8b5fd75c [term 8 FOLLOWER]: Starting leader election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:19:33.826795  9589 raft_consensus.cc:515] T be1a92657f494cac8dd227d152f50151 P b7ab4784c7344b939bc36f639286f377 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:19:33.827644  9694 leader_election.cc:290] T a1704639a875409b9959353527b3fd68 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 7 election: Requested vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:33.829487  9770 leader_election.cc:290] T 4d9def8b32fd443aa94ab1420b06837b P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:33.613662  9784 raft_consensus.cc:515] T 404190ce4ce94cecbfcb6ea9d1dd8626 P b7ab4784c7344b939bc36f639286f377 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:19:33.829864  9589 leader_election.cc:290] T be1a92657f494cac8dd227d152f50151 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:19:33.825752  9728 leader_election.cc:290] T f4b8bd455d5a47c18a1380839c6e0d61 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:33.831889  9784 leader_election.cc:290] T 404190ce4ce94cecbfcb6ea9d1dd8626 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:19:33.833482  9730 leader_election.cc:290] T bb3d8792045a4583ae2e965b1350a5b4 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:19:33.601248  9794 consensus_queue.cc:237] T 20f6842e26174571996b8dea4151d4be P b7ab4784c7344b939bc36f639286f377 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:33.807619  9608 raft_consensus.cc:493] T 90d42e216d9741e190bca19a781291fd P cd75a17ab2604397adab03bb8b5fd75c [term 7 FOLLOWER]: Starting pre-election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
W20260709 13:19:33.836982  9592 consensus_meta.cc:287] T 3fa34c08b205435dba97346991aa1f92 P 7ba59cc884714e8aa5f3f0ecaed84cbb: Time spent flushing consensus metadata: real 0.782s	user 0.009s	sys 0.005s
I20260709 13:19:33.836436  9772 raft_consensus.cc:515] T 3411566abe2d4c9bb4b2adfdd05e6f17 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:33.837931  6877 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53406 (request call id 1648) took 1426 ms. Trace:
I20260709 13:19:33.616828  9636 raft_consensus.cc:515] T e77e330a82df4b43a745d57a68f6f057 P cd75a17ab2604397adab03bb8b5fd75c [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } }
I20260709 13:19:33.852458  9781 leader_election.cc:290] T 7ba5dac66ab5497e9e336f2a3c28cda5 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 10 election: Requested vote from peers cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:19:33.853165  9614 raft_consensus.cc:3055] T 7c44c4849aa54f2b94d1f1bef9ed546f P cd75a17ab2604397adab03bb8b5fd75c [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:19:33.853693  9614 raft_consensus.cc:740] T 7c44c4849aa54f2b94d1f1bef9ed546f P cd75a17ab2604397adab03bb8b5fd75c [term 8 LEADER]: Becoming Follower/Learner. State: Replica: cd75a17ab2604397adab03bb8b5fd75c, State: Running, Role: LEADER
I20260709 13:19:33.854779  6732 raft_consensus.cc:2468] T f58dc08b12a2494bb9a1372837970ca2 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 9.
I20260709 13:19:33.824137  9800 raft_consensus.cc:493] T 427c124d773f483294511e80fe340075 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 7ba59cc884714e8aa5f3f0ecaed84cbb)
I20260709 13:19:33.831949  9758 raft_consensus.cc:3055] T 427c124d773f483294511e80fe340075 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:19:33.748027  9654 raft_consensus.cc:515] T be1a92657f494cac8dd227d152f50151 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:19:33.746050  9697 leader_election.cc:290] T 20f6842e26174571996b8dea4151d4be P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:33.765635  9743 raft_consensus.cc:493] T 8c7f33e544204fbaac4078e3e83bbf4e P b7ab4784c7344b939bc36f639286f377 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:33.765491  9649 raft_consensus.cc:3060] T 22ccee1b570c4ad3a57bd7aec085b1b4 P cd75a17ab2604397adab03bb8b5fd75c [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:33.836541  6729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8292e16e5654be6bc408560cf256aaa" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
W20260709 13:19:33.829910  9031 consensus_meta.cc:287] T 9e326172347f45e99a0d482b5d8ef768 P b7ab4784c7344b939bc36f639286f377: Time spent flushing consensus metadata: real 0.788s	user 0.012s	sys 0.000s
I20260709 13:19:33.836649  9608 raft_consensus.cc:515] T 90d42e216d9741e190bca19a781291fd P cd75a17ab2604397adab03bb8b5fd75c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:33.846621  9772 leader_election.cc:290] T 3411566abe2d4c9bb4b2adfdd05e6f17 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
W20260709 13:19:33.821909  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 206729us
I20260709 13:19:33.849542  9631 raft_consensus.cc:515] T fe20b4b48823486ca3b9c648db6ce8aa P cd75a17ab2604397adab03bb8b5fd75c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:19:33.838549  6723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17587d6730594da4a56fa13a353232a1" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
W20260709 13:19:33.862167  6770 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 120478us
I20260709 13:19:33.838339  6877 rpcz_store.cc:276] 0709 13:19:32.412100 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:32.412251 (+   151us) service_pool.cc:224] Handling call
0709 13:19:32.447463 (+ 35212us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:33.124708 (+677245us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:33.837593 (+712885us) spinlock_profiling.cc:243] Waited 676 ms on lock 0x7b54001e87d4. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f9aae01 00007fcc0f9a983e 00007fcc1496e419 00007fcc0dee5bd4 00007fcc0dee5b62 00007fcc0dee5a91 00007fcc0dee5a0c 00007fcc0dee4cc2 00007fcc0dce548c 00007fcc0dce48c6
0709 13:19:33.837857 (+   264us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1555073920}
I20260709 13:19:33.868721  9215 raft_consensus.cc:3060] T fe20b4b48823486ca3b9c648db6ce8aa P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:33.870566  9797 leader_election.cc:290] T f3f9c2e2bf644115957398fe4c9459db P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:33.870633  9657 leader_election.cc:290] T 24ee15416e3145beaa1b8183453729a3 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 8 election: Requested vote from peers cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:19:33.871467  9800 raft_consensus.cc:515] T 427c124d773f483294511e80fe340075 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } attrs { replace: true } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:19:33.854008  9759 leader_election.cc:290] T b3f13b31a1f84f0d89d007eadd57924c P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:19:33.826808  9809 raft_consensus.cc:3060] T ab432e62819d499eaaf3dd55481dd930 P cd75a17ab2604397adab03bb8b5fd75c [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:33.873526  9636 leader_election.cc:290] T e77e330a82df4b43a745d57a68f6f057 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 10 election: Requested vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391)
I20260709 13:19:33.874215  9758 raft_consensus.cc:740] T 427c124d773f483294511e80fe340075 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 7ba59cc884714e8aa5f3f0ecaed84cbb, State: Running, Role: LEADER
I20260709 13:19:33.903635  6844 leader_election.cc:304] T 853ac0a8cbd64ce99457f170216d4d0f P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:19:33.904997  9758 consensus_queue.cc:260] T 427c124d773f483294511e80fe340075 P 7ba59cc884714e8aa5f3f0ecaed84cbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.5, Last appended by leader: 5, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } attrs { replace: true } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:19:33.906459  9758 raft_consensus.cc:3060] T 427c124d773f483294511e80fe340075 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:33.906594  6844 leader_election.cc:304] T dbdf895bba214ff68685a24fd17dfb5d P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
W20260709 13:19:33.874934  6695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 256359us
I20260709 13:19:33.810104  6873 rpcz_store.cc:276] 0709 13:19:32.593588 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:32.839951 (+246363us) service_pool.cc:224] Handling call
0709 13:19:32.840616 (+   665us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:19:32.964244 (+123628us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:32.964293 (+    49us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:19:33.051029 (+ 86736us) log.cc:844] Serialized 52 byte log entry
0709 13:19:33.186460 (+135431us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:19:33.186503 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:33.186578 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:33.574336 (+387758us) raft_consensus.cc:1685] finished
0709 13:19:33.574358 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:33.760897 (+186539us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":44115,"raft.queue_time_us":142772,"raft.run_cpu_time_us":432,"raft.run_wall_time_us":18015,"thread_start_us":91141,"threads_started":1,"wal-append.queue_time_us":436869}
W20260709 13:19:33.883271  6697 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 137460us
I20260709 13:19:33.879920  9031 raft_consensus.cc:515] T 9e326172347f45e99a0d482b5d8ef768 P b7ab4784c7344b939bc36f639286f377 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:33.871920  9709 leader_election.cc:290] T 95a75bfe094d4bdc963aba3f08dfcd25 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 9 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:19:33.902397  6729 raft_consensus.cc:2468] T d8292e16e5654be6bc408560cf256aaa P ccd8a4c3bfe3413cb2ae219b09aea832 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 9.
I20260709 13:19:33.916494  9031 leader_election.cc:290] T 9e326172347f45e99a0d482b5d8ef768 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 7 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
W20260709 13:19:33.917994  7468 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:33.919076  7495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17587d6730594da4a56fa13a353232a1" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:19:33.919549  7502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be1a92657f494cac8dd227d152f50151" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:19:33.919935  6876 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53406 (request call id 1656) took 1492 ms. Trace:
I20260709 13:19:33.920439  6876 rpcz_store.cc:276] 0709 13:19:32.427343 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:32.800906 (+373563us) service_pool.cc:224] Handling call
0709 13:19:32.801478 (+   572us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:33.609712 (+808234us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:33.919704 (+309992us) spinlock_profiling.cc:243] Waited 743 ms on lock 0x7b5400219dd4. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f9aae01 00007fcc0f9a983e 00007fcc1496e419 00007fcc0dee5bd4 00007fcc0dee5b62 00007fcc0dee5a91 00007fcc0dee5a0c 00007fcc0dee4cc2 00007fcc0dce548c 00007fcc0dce48c6
0709 13:19:33.919878 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1709465472}
I20260709 13:19:33.921231  9627 raft_consensus.cc:2804] T 853ac0a8cbd64ce99457f170216d4d0f P cd75a17ab2604397adab03bb8b5fd75c [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:19:33.922533  6798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c240553ce044eedb41541d72b9475d7" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:19:33.923554  6798 raft_consensus.cc:2468] T 2c240553ce044eedb41541d72b9475d7 P b7ab4784c7344b939bc36f639286f377 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 9.
I20260709 13:19:33.913031  9730 raft_consensus.cc:2804] T 44bde925b2e541b69890d70715b85176 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:19:33.925566  9730 raft_consensus.cc:493] T 44bde925b2e541b69890d70715b85176 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:33.925926  9730 raft_consensus.cc:3060] T 44bde925b2e541b69890d70715b85176 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:33.926543  9502 leader_election.cc:290] T 7c37d41cd9164c15a6826ca62a851a69 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 7 election: Requested vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:33.926973  9654 leader_election.cc:290] T be1a92657f494cac8dd227d152f50151 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:19:33.945544  6732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "404190ce4ce94cecbfcb6ea9d1dd8626" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
W20260709 13:19:33.966377  7468 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:33.909337  9772 raft_consensus.cc:2804] T 3fa34c08b205435dba97346991aa1f92 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:19:33.932200  9781 raft_consensus.cc:493] T 713b5728a197487c9300b310ab94e5a3 P b7ab4784c7344b939bc36f639286f377 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:33.920446  9743 raft_consensus.cc:515] T 8c7f33e544204fbaac4078e3e83bbf4e P b7ab4784c7344b939bc36f639286f377 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:33.936164  9636 raft_consensus.cc:2804] T dbdf895bba214ff68685a24fd17dfb5d P cd75a17ab2604397adab03bb8b5fd75c [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:19:33.965054  9616 raft_consensus.cc:493] T 427c124d773f483294511e80fe340075 P cd75a17ab2604397adab03bb8b5fd75c [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 7ba59cc884714e8aa5f3f0ecaed84cbb)
I20260709 13:19:33.939030  9627 raft_consensus.cc:697] T 853ac0a8cbd64ce99457f170216d4d0f P cd75a17ab2604397adab03bb8b5fd75c [term 5 LEADER]: Becoming Leader. State: Replica: cd75a17ab2604397adab03bb8b5fd75c, State: Running, Role: LEADER
I20260709 13:19:33.945012  9712 raft_consensus.cc:493] T 1bf4668eeb70467fb3dc5a0289233b3c P b7ab4784c7344b939bc36f639286f377 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:19:33.976477  9031 consensus_queue.cc:1059] T 22ccee1b570c4ad3a57bd7aec085b1b4 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.004s
I20260709 13:19:33.980966  6723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be1a92657f494cac8dd227d152f50151" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:19:33.979434  7502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "404190ce4ce94cecbfcb6ea9d1dd8626" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:19:33.933892  9502 raft_consensus.cc:493] T e77e330a82df4b43a745d57a68f6f057 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:19:33.988336  6723 raft_consensus.cc:2410] T be1a92657f494cac8dd227d152f50151 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7ab4784c7344b939bc36f639286f377 for term 10 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 7.
I20260709 13:19:33.969775  9608 leader_election.cc:290] T 90d42e216d9741e190bca19a781291fd P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:19:33.993182  6806 raft_consensus.cc:2468] T 8c7f33e544204fbaac4078e3e83bbf4e P b7ab4784c7344b939bc36f639286f377 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 5.
I20260709 13:19:33.978473  9636 raft_consensus.cc:493] T dbdf895bba214ff68685a24fd17dfb5d P cd75a17ab2604397adab03bb8b5fd75c [term 6 FOLLOWER]: Starting leader election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:19:33.980556  9766 raft_consensus.cc:493] T 9b3759de40694069b13c0f8bd40e5709 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:34.001991  6807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de3186201e1a40d0b335eeb8b4e256e0" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:19:33.999890  9627 consensus_queue.cc:237] T 853ac0a8cbd64ce99457f170216d4d0f P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:34.002893  6802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce4f062dcd314d43a63ca74067cb5ee3" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:19:34.003114  7498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe20b4b48823486ca3b9c648db6ce8aa" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:19:34.003912  9712 raft_consensus.cc:515] T 1bf4668eeb70467fb3dc5a0289233b3c P b7ab4784c7344b939bc36f639286f377 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:34.004981  6697 leader_election.cc:304] T 22ccee1b570c4ad3a57bd7aec085b1b4 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:19:33.987283  9553 raft_consensus.cc:493] T a3022224cc81473690653a83d4e99470 P b7ab4784c7344b939bc36f639286f377 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:33.989585  9616 raft_consensus.cc:515] T 427c124d773f483294511e80fe340075 P cd75a17ab2604397adab03bb8b5fd75c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } attrs { replace: true } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:19:34.013724  9636 raft_consensus.cc:3060] T dbdf895bba214ff68685a24fd17dfb5d P cd75a17ab2604397adab03bb8b5fd75c [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:34.029752  6805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d9def8b32fd443aa94ab1420b06837b" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:19:34.030458  9616 leader_election.cc:290] T 427c124d773f483294511e80fe340075 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:19:34.031145  6805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34f36d59d88f40fe8a2805e604fc6c0a" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:19:34.032269  6800 raft_consensus.cc:1275] T 3a485a995abc4807b6e511e45419f737 P b7ab4784c7344b939bc36f639286f377 [term 7 FOLLOWER]: Refusing update from remote peer ccd8a4c3bfe3413cb2ae219b09aea832: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:19:33.996173  9631 leader_election.cc:290] T fe20b4b48823486ca3b9c648db6ce8aa P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:19:34.008283  9614 consensus_queue.cc:260] T 7c44c4849aa54f2b94d1f1bef9ed546f P cd75a17ab2604397adab03bb8b5fd75c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:34.010344  6770 leader_election.cc:304] T 427c124d773f483294511e80fe340075 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:19:34.011597  9609 leader_election.cc:290] T 9e326172347f45e99a0d482b5d8ef768 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 7 election: Requested vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:34.019558  9800 leader_election.cc:290] T 427c124d773f483294511e80fe340075 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
W20260709 13:19:34.021183  7468 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:34.021587  9553 raft_consensus.cc:515] T a3022224cc81473690653a83d4e99470 P b7ab4784c7344b939bc36f639286f377 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:33.998054  9713 leader_election.cc:290] T a1704639a875409b9959353527b3fd68 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:34.032284  7500 raft_consensus.cc:1275] T fe20b4b48823486ca3b9c648db6ce8aa P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 6 FOLLOWER]: Refusing update from remote peer ccd8a4c3bfe3413cb2ae219b09aea832: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:19:33.990581  9626 raft_consensus.cc:493] T 1528ab62b6fe4e3099d08f141afee116 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
W20260709 13:19:34.047158  7467 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:33.994508  7495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ba5dac66ab5497e9e336f2a3c28cda5" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb"
I20260709 13:19:34.043931  6805 raft_consensus.cc:3060] T 34f36d59d88f40fe8a2805e604fc6c0a P b7ab4784c7344b939bc36f639286f377 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:34.025575  6727 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50004 (request call id 1546) took 2051 ms. Trace:
I20260709 13:19:33.993439  9772 raft_consensus.cc:697] T 3fa34c08b205435dba97346991aa1f92 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 10 LEADER]: Becoming Leader. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
I20260709 13:19:34.048463  9031 raft_consensus.cc:2749] T 427c124d773f483294511e80fe340075 P b7ab4784c7344b939bc36f639286f377 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:19:33.993961  9781 raft_consensus.cc:515] T 713b5728a197487c9300b310ab94e5a3 P b7ab4784c7344b939bc36f639286f377 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
W20260709 13:19:34.061736  6724 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50004 (request call id 1548) took 2086 ms (client timeout 1868 ms). Trace:
I20260709 13:19:34.069757  6727 rpcz_store.cc:276] 0709 13:19:31.974320 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:32.124712 (+150392us) service_pool.cc:224] Handling call
0709 13:19:32.125082 (+   370us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:33.106631 (+981549us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:34.025179 (+918548us) spinlock_profiling.cc:243] Waited 914 ms on lock 0x7b5400058a54. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f9aae01 00007fcc0f9a983e 00007fcc1496e419 00007fcc0dee5bd4 00007fcc0dee5b62 00007fcc0dee5a91 00007fcc0dee5a0c 00007fcc0dee4cc2 00007fcc0dce548c 00007fcc0dce48c6
0709 13:19:34.025489 (+   310us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2101299072}
I20260709 13:19:34.051460  6800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3411566abe2d4c9bb4b2adfdd05e6f17" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:19:34.051936  6728 raft_consensus.cc:1240] T f3f9c2e2bf644115957398fe4c9459db P ccd8a4c3bfe3413cb2ae219b09aea832 [term 7 FOLLOWER]: Rejecting Update request from peer b7ab4784c7344b939bc36f639286f377 for earlier term 6. Current term is 7. Ops: []
I20260709 13:19:34.068629  6807 raft_consensus.cc:2468] T de3186201e1a40d0b335eeb8b4e256e0 P b7ab4784c7344b939bc36f639286f377 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 8.
I20260709 13:19:34.059597  7503 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50744 (request call id 237) took 1230 ms. Trace:
W20260709 13:19:34.077670  6724 rpcz_store.cc:269] 0709 13:19:31.975748 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:32.091354 (+115606us) service_pool.cc:224] Handling call
0709 13:19:34.061495 (+1970141us) spinlock_profiling.cc:243] Waited 622 ms on lock 0x7b54000e4054. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f9ae2fa 00007fcc1496fb17 00007fcc0deea6d4 00007fcc0deea662 00007fcc0deea591 00007fcc0deea50c 00007fcc0dee97c2 00007fcc0dce548c 00007fcc0dce48c6 00007fcc0dce426f
0709 13:19:34.061638 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1431652608}
I20260709 13:19:34.040737  9654 raft_consensus.cc:2749] T 22ccee1b570c4ad3a57bd7aec085b1b4 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:19:34.070218  6770 leader_election.cc:304] T f58dc08b12a2494bb9a1372837970ca2 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
I20260709 13:19:34.065821  7500 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50742 (request call id 345) took 1629 ms. Trace:
I20260709 13:19:34.060451  6802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1704639a875409b9959353527b3fd68" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:19:34.080098  7503 rpcz_store.cc:276] 0709 13:19:32.829612 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:32.830017 (+   405us) service_pool.cc:224] Handling call
0709 13:19:32.831020 (+  1003us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:33.183229 (+352209us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:34.059311 (+876082us) spinlock_profiling.cc:243] Waited 322 ms on lock 0x7b5400644954. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f9aae01 00007fcc0f9a983e 00007fcc1496e419 00007fcc0dee5bd4 00007fcc0dee5b62 00007fcc0dee5a91 00007fcc0dee5a0c 00007fcc0dee4cc2 00007fcc0dce548c 00007fcc0dce48c6
0709 13:19:34.059508 (+   197us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":741620480}
I20260709 13:19:34.014568  9502 raft_consensus.cc:515] T e77e330a82df4b43a745d57a68f6f057 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } }
I20260709 13:19:34.058187  9614 raft_consensus.cc:3060] T 7c44c4849aa54f2b94d1f1bef9ed546f P cd75a17ab2604397adab03bb8b5fd75c [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:34.084470  6770 leader_election.cc:304] T 17587d6730594da4a56fa13a353232a1 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:19:34.084271  9031 raft_consensus.cc:2804] T f58dc08b12a2494bb9a1372837970ca2 P b7ab4784c7344b939bc36f639286f377 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:19:34.091437  9031 raft_consensus.cc:493] T f58dc08b12a2494bb9a1372837970ca2 P b7ab4784c7344b939bc36f639286f377 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:19:34.087755  7468 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:34.091921  9031 raft_consensus.cc:3060] T f58dc08b12a2494bb9a1372837970ca2 P b7ab4784c7344b939bc36f639286f377 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:34.035416  9766 raft_consensus.cc:515] T 9b3759de40694069b13c0f8bd40e5709 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:34.053169  9769 leader_election.cc:290] T 4275cf08e63345f993bce8664eada830 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:19:34.058525  9553 leader_election.cc:290] T a3022224cc81473690653a83d4e99470 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:34.083989  7500 rpcz_store.cc:276] 0709 13:19:32.436207 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:32.436368 (+   161us) service_pool.cc:224] Handling call
0709 13:19:32.436704 (+   336us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:34.045719 (+1609015us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:34.065438 (+ 19719us) spinlock_profiling.cc:243] Waited 1.59 s on lock 0x7b5400538ed4. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f9aae01 00007fcc0f9a983e 00007fcc1496e419 00007fcc0dee5bd4 00007fcc0dee5b62 00007fcc0dee5a91 00007fcc0dee5a0c 00007fcc0dee4cc2 00007fcc0dce548c 00007fcc0dce48c6
0709 13:19:34.065750 (+   312us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3667972992}
I20260709 13:19:34.078881  7495 raft_consensus.cc:3060] T 7ba5dac66ab5497e9e336f2a3c28cda5 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:34.088251  7502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "427c124d773f483294511e80fe340075" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:19:34.059803  9712 leader_election.cc:290] T 1bf4668eeb70467fb3dc5a0289233b3c P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:34.055756  9586 leader_election.cc:290] T ce4f062dcd314d43a63ca74067cb5ee3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:34.097618  6770 leader_election.cc:304] T d8292e16e5654be6bc408560cf256aaa P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
I20260709 13:19:34.046468  9797 consensus_queue.cc:1048] T c4db81d9d329422bb3b4160ca4ac2d1d P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.045s
I20260709 13:19:34.054909  9809 raft_consensus.cc:515] T ab432e62819d499eaaf3dd55481dd930 P cd75a17ab2604397adab03bb8b5fd75c [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:34.057576  9626 raft_consensus.cc:515] T 1528ab62b6fe4e3099d08f141afee116 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:19:34.112869  6800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce4f062dcd314d43a63ca74067cb5ee3" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:19:34.113736  6807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be1a92657f494cac8dd227d152f50151" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:19:34.114670  6770 leader_election.cc:304] T 404190ce4ce94cecbfcb6ea9d1dd8626 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:19:34.116688  6807 raft_consensus.cc:2468] T be1a92657f494cac8dd227d152f50151 P b7ab4784c7344b939bc36f639286f377 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 9.
I20260709 13:19:34.123317  9772 consensus_queue.cc:237] T 3fa34c08b205435dba97346991aa1f92 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:19:34.106158  9784 raft_consensus.cc:2749] T 17587d6730594da4a56fa13a353232a1 P b7ab4784c7344b939bc36f639286f377 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:19:34.125375  6770 leader_election.cc:304] T be1a92657f494cac8dd227d152f50151 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:19:34.090340  9649 raft_consensus.cc:515] T 22ccee1b570c4ad3a57bd7aec085b1b4 P cd75a17ab2604397adab03bb8b5fd75c [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:34.136292  9553 consensus_queue.cc:1059] T 1528ab62b6fe4e3099d08f141afee116 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:19:34.138918  9781 leader_election.cc:290] T 713b5728a197487c9300b310ab94e5a3 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:34.139689  9781 raft_consensus.cc:2749] T be1a92657f494cac8dd227d152f50151 P b7ab4784c7344b939bc36f639286f377 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:19:34.142077  9649 leader_election.cc:290] T 22ccee1b570c4ad3a57bd7aec085b1b4 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 7 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:19:34.141939  9031 raft_consensus.cc:515] T f58dc08b12a2494bb9a1372837970ca2 P b7ab4784c7344b939bc36f639286f377 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:34.145469  6731 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50004 (request call id 1541) took 2274 ms. Trace:
I20260709 13:19:34.146286  9626 leader_election.cc:290] T 1528ab62b6fe4e3099d08f141afee116 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
W20260709 13:19:34.146522  6874 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53416 (request call id 2465) took 2298 ms (client timeout 2169 ms). Trace:
I20260709 13:19:34.148821  7496 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50742 (request call id 342) took 2577 ms. Trace:
I20260709 13:19:34.134685  9636 raft_consensus.cc:515] T dbdf895bba214ff68685a24fd17dfb5d P cd75a17ab2604397adab03bb8b5fd75c [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:34.149560  6878 raft_consensus.cc:1240] T 95a75bfe094d4bdc963aba3f08dfcd25 P cd75a17ab2604397adab03bb8b5fd75c [term 9 FOLLOWER]: Rejecting Update request from peer b7ab4784c7344b939bc36f639286f377 for earlier term 8. Current term is 9. Ops: [8.3-8.3]
I20260709 13:19:34.150060  6805 raft_consensus.cc:2468] T 34f36d59d88f40fe8a2805e604fc6c0a P b7ab4784c7344b939bc36f639286f377 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 6.
I20260709 13:19:34.162034  6802 raft_consensus.cc:2468] T a1704639a875409b9959353527b3fd68 P b7ab4784c7344b939bc36f639286f377 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 7.
I20260709 13:19:34.170214  6807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c37d41cd9164c15a6826ca62a851a69" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:19:34.118352  9775 raft_consensus.cc:2804] T d8292e16e5654be6bc408560cf256aaa P b7ab4784c7344b939bc36f639286f377 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:19:34.178669  7502 raft_consensus.cc:2468] T 427c124d773f483294511e80fe340075 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 6.
I20260709 13:19:34.169838  6731 rpcz_store.cc:276] 0709 13:19:31.871547 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:31.871801 (+   254us) service_pool.cc:224] Handling call
0709 13:19:31.872235 (+   434us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:32.825775 (+953540us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:34.145059 (+1319284us) spinlock_profiling.cc:243] Waited 952 ms on lock 0x7b540020c6d4. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f9aae01 00007fcc0f9a983e 00007fcc1496e419 00007fcc0dee5bd4 00007fcc0dee5b62 00007fcc0dee5a91 00007fcc0dee5a0c 00007fcc0dee4cc2 00007fcc0dce548c 00007fcc0dce48c6
0709 13:19:34.145374 (+   315us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2189322496}
I20260709 13:19:34.178238  6807 raft_consensus.cc:3060] T 7c37d41cd9164c15a6826ca62a851a69 P b7ab4784c7344b939bc36f639286f377 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:34.125285  9712 raft_consensus.cc:2749] T 404190ce4ce94cecbfcb6ea9d1dd8626 P b7ab4784c7344b939bc36f639286f377 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:19:34.178799  9775 raft_consensus.cc:493] T d8292e16e5654be6bc408560cf256aaa P b7ab4784c7344b939bc36f639286f377 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:19:34.173134  6874 rpcz_store.cc:269] 0709 13:19:31.849557 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:31.849931 (+   374us) service_pool.cc:224] Handling call
0709 13:19:34.146214 (+2296283us) spinlock_profiling.cc:243] Waited 1.62 s on lock 0x7b54001752d4. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f9ae2fa 00007fcc1496fb17 00007fcc0deea6d4 00007fcc0deea662 00007fcc0deea591 00007fcc0deea50c 00007fcc0dee97c2 00007fcc0dce548c 00007fcc0dce48c6 00007fcc0dce426f
0709 13:19:34.146416 (+   202us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3733381376}
I20260709 13:19:34.180166  9031 leader_election.cc:290] T f58dc08b12a2494bb9a1372837970ca2 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 10 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:34.179209  6802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3f13b31a1f84f0d89d007eadd57924c" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:19:34.201956  6805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e326172347f45e99a0d482b5d8ef768" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:19:34.203032  6805 raft_consensus.cc:2393] T 9e326172347f45e99a0d482b5d8ef768 P b7ab4784c7344b939bc36f639286f377 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate ccd8a4c3bfe3413cb2ae219b09aea832 in current term 7: Already voted for candidate b7ab4784c7344b939bc36f639286f377 in this term.
I20260709 13:19:34.212415  6802 raft_consensus.cc:2468] T b3f13b31a1f84f0d89d007eadd57924c P b7ab4784c7344b939bc36f639286f377 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 5.
I20260709 13:19:34.193737  9775 raft_consensus.cc:3060] T d8292e16e5654be6bc408560cf256aaa P b7ab4784c7344b939bc36f639286f377 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:34.214962  9031 raft_consensus.cc:493] T 9b3759de40694069b13c0f8bd40e5709 P b7ab4784c7344b939bc36f639286f377 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:19:34.217144  6800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17587d6730594da4a56fa13a353232a1" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:19:34.219275  6800 raft_consensus.cc:3060] T 17587d6730594da4a56fa13a353232a1 P b7ab4784c7344b939bc36f639286f377 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:34.216192  9743 leader_election.cc:290] T 8c7f33e544204fbaac4078e3e83bbf4e P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:34.201732  7495 raft_consensus.cc:2468] T 7ba5dac66ab5497e9e336f2a3c28cda5 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 10.
I20260709 13:19:34.222617  6805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f9c2e2bf644115957398fe4c9459db" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:19:34.225075  9502 leader_election.cc:290] T e77e330a82df4b43a745d57a68f6f057 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:34.229153  9766 leader_election.cc:290] T 9b3759de40694069b13c0f8bd40e5709 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:34.229753  6772 leader_election.cc:304] T 7ba5dac66ab5497e9e336f2a3c28cda5 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, b7ab4784c7344b939bc36f639286f377; no voters: 
I20260709 13:19:34.229918  6803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1528ab62b6fe4e3099d08f141afee116" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
W20260709 13:19:34.231547  9814 log.cc:927] Time spent T 00000000000000000000000000000000 P b3ae52d33b9a4273a42e5e2cf3b5d6b5: Append to log took a long time: real 0.222s	user 0.000s	sys 0.005s
I20260709 13:19:34.231709  9663 raft_consensus.cc:2804] T 7ba5dac66ab5497e9e336f2a3c28cda5 P b7ab4784c7344b939bc36f639286f377 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:19:34.232343  9663 raft_consensus.cc:697] T 7ba5dac66ab5497e9e336f2a3c28cda5 P b7ab4784c7344b939bc36f639286f377 [term 10 LEADER]: Becoming Leader. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
I20260709 13:19:34.234368  6802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4b8bd455d5a47c18a1380839c6e0d61" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:19:34.240543  6802 raft_consensus.cc:2468] T f4b8bd455d5a47c18a1380839c6e0d61 P b7ab4784c7344b939bc36f639286f377 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 7.
I20260709 13:19:34.240808  7495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b8cacb381b746da8d0049b0a83b41dd" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
W20260709 13:19:34.241415  6844 connection.cc:256] RPC call timeout handler was delayed by -2.9604340020000564s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.32120000000000004s for a response
I20260709 13:19:34.241737  7495 raft_consensus.cc:2468] T 4b8cacb381b746da8d0049b0a83b41dd P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 8.
I20260709 13:19:34.244180  7495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce4f062dcd314d43a63ca74067cb5ee3" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:19:34.247542  6801 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:32976 (request call id 2357) took 1082 ms. Trace:
I20260709 13:19:34.245426  9663 consensus_queue.cc:237] T 7ba5dac66ab5497e9e336f2a3c28cda5 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:19:34.247993  6801 rpcz_store.cc:276] 0709 13:19:33.165170 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:33.192678 (+ 27508us) service_pool.cc:224] Handling call
0709 13:19:34.247266 (+1054588us) spinlock_profiling.cc:243] Waited 779 ms on lock 0x7b54001a36d4. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f9ae2fa 00007fcc1496fb17 00007fcc0deea6d4 00007fcc0deea662 00007fcc0deea591 00007fcc0deea50c 00007fcc0dee97c2 00007fcc0dce548c 00007fcc0dce48c6 00007fcc0dce426f
0709 13:19:34.247447 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1791631872}
I20260709 13:19:34.253249  6772 leader_election.cc:304] T d8cee0accdb8499c86d4414b72565a38 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, cd75a17ab2604397adab03bb8b5fd75c
W20260709 13:19:34.254966  6847 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:34.255578  6847 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:34.256632  9450 raft_consensus.cc:2749] T d8cee0accdb8499c86d4414b72565a38 P b7ab4784c7344b939bc36f639286f377 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:19:34.257694  9809 leader_election.cc:290] T ab432e62819d499eaaf3dd55481dd930 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 9 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:19:34.258669  9691 leader_election.cc:290] T e31b9971c15848dea59d4d4130141d9e P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:34.258420  9031 raft_consensus.cc:515] T 9b3759de40694069b13c0f8bd40e5709 P b7ab4784c7344b939bc36f639286f377 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:34.262982  9031 leader_election.cc:290] T 9b3759de40694069b13c0f8bd40e5709 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:34.176883  7496 rpcz_store.cc:276] 0709 13:19:31.571302 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:31.575684 (+  4382us) service_pool.cc:224] Handling call
0709 13:19:31.604812 (+ 29128us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:33.128088 (+1523276us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:34.148528 (+1020440us) spinlock_profiling.cc:243] Waited 1.52 s on lock 0x7b5400537d54. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f9aae01 00007fcc0f9a983e 00007fcc1496e419 00007fcc0dee5bd4 00007fcc0dee5b62 00007fcc0dee5a91 00007fcc0dee5a0c 00007fcc0dee4cc2 00007fcc0dce548c 00007fcc0dce48c6
0709 13:19:34.148740 (+   212us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3494037248}
W20260709 13:19:34.268899  7468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 68607.9us
W20260709 13:19:34.270756  6770 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 145473us
I20260709 13:19:34.271167  6807 raft_consensus.cc:2468] T 7c37d41cd9164c15a6826ca62a851a69 P b7ab4784c7344b939bc36f639286f377 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 7.
I20260709 13:19:34.272863  6807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b3759de40694069b13c0f8bd40e5709" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:19:34.276718  6807 raft_consensus.cc:2468] T 9b3759de40694069b13c0f8bd40e5709 P b7ab4784c7344b939bc36f639286f377 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 6.
I20260709 13:19:34.275061  7503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3f13b31a1f84f0d89d007eadd57924c" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:19:34.285281  9636 leader_election.cc:290] T dbdf895bba214ff68685a24fd17dfb5d P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 7 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:19:34.272109  9730 raft_consensus.cc:515] T 44bde925b2e541b69890d70715b85176 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:34.288308  9730 leader_election.cc:290] T 44bde925b2e541b69890d70715b85176 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 9 election: Requested vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:34.290581  9784 raft_consensus.cc:3055] T 1528ab62b6fe4e3099d08f141afee116 P b7ab4784c7344b939bc36f639286f377 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:19:34.291030  9784 raft_consensus.cc:740] T 1528ab62b6fe4e3099d08f141afee116 P b7ab4784c7344b939bc36f639286f377 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
I20260709 13:19:34.277207  9450 consensus_queue.cc:1059] T 4d9def8b32fd443aa94ab1420b06837b P b7ab4784c7344b939bc36f639286f377 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.026s
I20260709 13:19:34.297268  7496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24ee15416e3145beaa1b8183453729a3" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb"
I20260709 13:19:34.298013  9450 raft_consensus.cc:3055] T 4d9def8b32fd443aa94ab1420b06837b P b7ab4784c7344b939bc36f639286f377 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:19:34.298383  7496 raft_consensus.cc:3060] T 24ee15416e3145beaa1b8183453729a3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:34.279204  9809 raft_consensus.cc:493] T 8c7f33e544204fbaac4078e3e83bbf4e P cd75a17ab2604397adab03bb8b5fd75c [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:34.301141  9809 raft_consensus.cc:515] T 8c7f33e544204fbaac4078e3e83bbf4e P cd75a17ab2604397adab03bb8b5fd75c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:34.303444  9809 leader_election.cc:290] T 8c7f33e544204fbaac4078e3e83bbf4e P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
W20260709 13:19:34.303788  7467 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:34.308441  6807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77e330a82df4b43a745d57a68f6f057" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:19:34.310060  6800 raft_consensus.cc:2410] T 17587d6730594da4a56fa13a353232a1 P b7ab4784c7344b939bc36f639286f377 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 7ba59cc884714e8aa5f3f0ecaed84cbb for term 10 because replica has last-logged OpId of term: 9 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 7.
I20260709 13:19:34.310669  6801 raft_consensus.cc:1240] T 17587d6730594da4a56fa13a353232a1 P b7ab4784c7344b939bc36f639286f377 [term 10 FOLLOWER]: Rejecting Update request from peer ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 9. Current term is 10. Ops: []
I20260709 13:19:34.310982  6800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1528ab62b6fe4e3099d08f141afee116" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:19:34.313674  7494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be1a92657f494cac8dd227d152f50151" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:19:34.312659  9784 consensus_queue.cc:260] T 1528ab62b6fe4e3099d08f141afee116 P b7ab4784c7344b939bc36f639286f377 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:19:34.316398  9784 raft_consensus.cc:3060] T 1528ab62b6fe4e3099d08f141afee116 P b7ab4784c7344b939bc36f639286f377 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:34.312701  7495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3d8792045a4583ae2e965b1350a5b4" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:19:34.272725  9651 raft_consensus.cc:515] T 4f00a2e87e56452083b759f60d461ee3 P cd75a17ab2604397adab03bb8b5fd75c [term 8 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:19:35.034921  7494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1528ab62b6fe4e3099d08f141afee116" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:19:34.333665  9758 raft_consensus.cc:493] T 3fa34c08b205435dba97346991aa1f92 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:34.656416  9627 raft_consensus.cc:493] T 1528ab62b6fe4e3099d08f141afee116 P cd75a17ab2604397adab03bb8b5fd75c [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:34.323684  7495 raft_consensus.cc:2468] T bb3d8792045a4583ae2e965b1350a5b4 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 7.
I20260709 13:19:34.436965  6807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "427c124d773f483294511e80fe340075" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:19:34.402209  6873 raft_consensus.cc:1240] T e77e330a82df4b43a745d57a68f6f057 P cd75a17ab2604397adab03bb8b5fd75c [term 10 FOLLOWER]: Rejecting Update request from peer b7ab4784c7344b939bc36f639286f377 for earlier term 9. Current term is 10. Ops: []
I20260709 13:19:34.593993  6803 raft_consensus.cc:1240] T 427c124d773f483294511e80fe340075 P b7ab4784c7344b939bc36f639286f377 [term 6 FOLLOWER]: Rejecting Update request from peer 7ba59cc884714e8aa5f3f0ecaed84cbb for earlier term 5. Current term is 6. Ops: []
I20260709 13:19:34.439397  7502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "427c124d773f483294511e80fe340075" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:19:34.546332  6695 leader_election.cc:304] T f09c2a98de1a4decabd0ff900dd44caa P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
I20260709 13:19:34.333384  6806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44bde925b2e541b69890d70715b85176" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:19:35.052891  6806 raft_consensus.cc:3060] T 44bde925b2e541b69890d70715b85176 P b7ab4784c7344b939bc36f639286f377 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:19:35.032843  7468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 727828us
W20260709 13:19:34.330030  6770 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:34.451828  7467 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:34.621943  7496 raft_consensus.cc:2468] T 24ee15416e3145beaa1b8183453729a3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 8.
W20260709 13:19:34.412941  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 170588us
W20260709 13:19:34.930902  6847 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:34.531226  6880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8292e16e5654be6bc408560cf256aaa" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:19:34.513891  6872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f58dc08b12a2494bb9a1372837970ca2" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
W20260709 13:19:35.056005  6847 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:34.673988  6878 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53406 (request call id 1653) took 2249 ms. Trace:
W20260709 13:19:35.042723  6696 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:34.447678  6876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "427c124d773f483294511e80fe340075" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:19:35.057459  6876 raft_consensus.cc:3060] T 427c124d773f483294511e80fe340075 P cd75a17ab2604397adab03bb8b5fd75c [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:34.298507  9450 raft_consensus.cc:740] T 4d9def8b32fd443aa94ab1420b06837b P b7ab4784c7344b939bc36f639286f377 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
I20260709 13:19:35.051272  6799 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:32976 (request call id 2375) took 1054 ms. Trace:
I20260709 13:19:35.061388  6801 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:32976 (request call id 2384) took 1048 ms. Trace:
I20260709 13:19:35.051879  7502 raft_consensus.cc:2468] T 427c124d773f483294511e80fe340075 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 6.
W20260709 13:19:35.066672  7467 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:34.326385  9720 consensus_meta.cc:287] T 3d65025eea89441290d85dd053810e31 P cd75a17ab2604397adab03bb8b5fd75c: Time spent flushing consensus metadata: real 0.800s	user 0.006s	sys 0.007s
I20260709 13:19:35.056651  6878 rpcz_store.cc:276] 0709 13:19:32.424433 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:32.798516 (+374083us) service_pool.cc:224] Handling call
0709 13:19:34.149183 (+1350667us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:34.192224 (+ 43041us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:34.673626 (+481402us) spinlock_profiling.cc:243] Waited 1.35 s on lock 0x7b54001752d0. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f9a98ad 00007fcc1496e419 00007fcc0dee5bd4 00007fcc0dee5b62 00007fcc0dee5a91 00007fcc0dee5a0c 00007fcc0dee4cc2 00007fcc0dce548c 00007fcc0dce48c6 00007fcc0dce426f
0709 13:19:34.673894 (+   268us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3104606080}
I20260709 13:19:35.020191  6881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3022224cc81473690653a83d4e99470" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:19:35.037616  7494 raft_consensus.cc:2393] T 1528ab62b6fe4e3099d08f141afee116 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ccd8a4c3bfe3413cb2ae219b09aea832 in current term 7: Already voted for candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in this term.
W20260709 13:19:34.677177  9823 log.cc:927] Time spent T 7887766dc6784fcaa42b35c05fea7a99 P b7ab4784c7344b939bc36f639286f377: Append to log took a long time: real 0.678s	user 0.005s	sys 0.000s
W20260709 13:19:35.075443  6804 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.543s	user 0.013s	sys 0.049s
I20260709 13:19:35.071424  6801 rpcz_store.cc:276] 0709 13:19:34.012605 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:34.249119 (+236514us) service_pool.cc:224] Handling call
0709 13:19:34.310488 (+ 61369us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:34.317787 (+  7299us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:35.061171 (+743384us) spinlock_profiling.cc:243] Waited 61 ms on lock 0x7b54001d1fd0. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f9a98ad 00007fcc1496e419 00007fcc0dee5bd4 00007fcc0dee5b62 00007fcc0dee5a91 00007fcc0dee5a0c 00007fcc0dee4cc2 00007fcc0dce548c 00007fcc0dce48c6 00007fcc0dce426f
0709 13:19:35.061323 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":140273536}
W20260709 13:19:34.770013  9835 log.cc:927] Time spent T 713b5728a197487c9300b310ab94e5a3 P b7ab4784c7344b939bc36f639286f377: Append to log took a long time: real 0.297s	user 0.000s	sys 0.001s
I20260709 13:19:35.067473  6799 rpcz_store.cc:276] 0709 13:19:34.000852 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:34.005581 (+  4729us) service_pool.cc:224] Handling call
0709 13:19:34.005920 (+   339us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:34.056826 (+ 50906us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:34.056870 (+    44us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:34.056920 (+    50us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:19:34.056964 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:35.051002 (+994038us) spinlock_profiling.cc:243] Waited 40.3 ms on lock 0x7b54001f4d54. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f9aae01 00007fcc0f9a983e 00007fcc1496e419 00007fcc0dee5bd4 00007fcc0dee5b62 00007fcc0dee5a91 00007fcc0dee5a0c 00007fcc0dee4cc2 00007fcc0dce548c 00007fcc0dce48c6
0709 13:19:35.051060 (+    58us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:35.051205 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":92745472}
I20260709 13:19:34.629309  9663 raft_consensus.cc:493] T 07a92dd554674067a83a9cb68c4773f2 P b7ab4784c7344b939bc36f639286f377 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:35.078981  6874 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.597s	user 0.024s	sys 0.036s
I20260709 13:19:34.455291  9809 raft_consensus.cc:493] T 30e88460611e47b2ba16a46a30b5f416 P cd75a17ab2604397adab03bb8b5fd75c [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:35.084645  6874 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.603s	user 0.024s	sys 0.036s
I20260709 13:19:35.082086  6875 raft_consensus.cc:1240] T 4f00a2e87e56452083b759f60d461ee3 P cd75a17ab2604397adab03bb8b5fd75c [term 8 FOLLOWER]: Rejecting Update request from peer b7ab4784c7344b939bc36f639286f377 for earlier term 7. Current term is 8. Ops: []
I20260709 13:19:34.802946  9586 raft_consensus.cc:493] T fe20b4b48823486ca3b9c648db6ce8aa P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:35.080421  6804 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.548s	user 0.014s	sys 0.049s
I20260709 13:19:35.080915  6873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bf4668eeb70467fb3dc5a0289233b3c" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
W20260709 13:19:35.077805  9794 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.606s	user 0.010s	sys 0.050s
I20260709 13:19:35.087445  6881 raft_consensus.cc:2468] T a3022224cc81473690653a83d4e99470 P cd75a17ab2604397adab03bb8b5fd75c [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 8.
I20260709 13:19:35.106976  6807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f9c2e2bf644115957398fe4c9459db" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:19:34.333695  9691 consensus_queue.cc:1059] T d33d5ee8ef6f415593d8df52063161ad P b7ab4784c7344b939bc36f639286f377 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.749s
I20260709 13:19:35.111871  6803 raft_consensus.cc:1275] T a3022224cc81473690653a83d4e99470 P b7ab4784c7344b939bc36f639286f377 [term 8 FOLLOWER]: Refusing update from remote peer ccd8a4c3bfe3413cb2ae219b09aea832: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:19:35.114082  6799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce4f062dcd314d43a63ca74067cb5ee3" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:19:34.506585  9775 raft_consensus.cc:515] T d8292e16e5654be6bc408560cf256aaa P b7ab4784c7344b939bc36f639286f377 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:35.114866  6872 raft_consensus.cc:2468] T f58dc08b12a2494bb9a1372837970ca2 P cd75a17ab2604397adab03bb8b5fd75c [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 9.
I20260709 13:19:35.037616  9758 raft_consensus.cc:515] T 3fa34c08b205435dba97346991aa1f92 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:19:35.108757  6880 raft_consensus.cc:2468] T d8292e16e5654be6bc408560cf256aaa P cd75a17ab2604397adab03bb8b5fd75c [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 9.
I20260709 13:19:34.335964  9711 consensus_queue.cc:1059] T f5be3a11b23d4ea9b08300a2789821c7 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.757s
I20260709 13:19:35.080833  9836 raft_consensus.cc:493] T 24ee15416e3145beaa1b8183453729a3 P b7ab4784c7344b939bc36f639286f377 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 7ba59cc884714e8aa5f3f0ecaed84cbb)
I20260709 13:19:35.124701  9653 raft_consensus.cc:3060] T bd6869f07b5a4885a0b99fbe60c3b175 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:35.124917  9836 raft_consensus.cc:515] T 24ee15416e3145beaa1b8183453729a3 P b7ab4784c7344b939bc36f639286f377 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } attrs { replace: true } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:19:35.124698  6799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c240553ce044eedb41541d72b9475d7" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:19:35.129082  9687 raft_consensus.cc:2804] T f09c2a98de1a4decabd0ff900dd44caa P ccd8a4c3bfe3413cb2ae219b09aea832 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:19:35.129638  9687 raft_consensus.cc:493] T f09c2a98de1a4decabd0ff900dd44caa P ccd8a4c3bfe3413cb2ae219b09aea832 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:35.130182  9687 raft_consensus.cc:3060] T f09c2a98de1a4decabd0ff900dd44caa P ccd8a4c3bfe3413cb2ae219b09aea832 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:35.130275  9450 consensus_queue.cc:260] T 4d9def8b32fd443aa94ab1420b06837b P b7ab4784c7344b939bc36f639286f377 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:35.129634  6799 raft_consensus.cc:2393] T 2c240553ce044eedb41541d72b9475d7 P b7ab4784c7344b939bc36f639286f377 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c in current term 9: Already voted for candidate b7ab4784c7344b939bc36f639286f377 in this term.
I20260709 13:19:35.118809  6801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f03d0dbf16864ca4bc1bb5e4c0334c0f" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:19:35.133491  6801 raft_consensus.cc:2393] T f03d0dbf16864ca4bc1bb5e4c0334c0f P b7ab4784c7344b939bc36f639286f377 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c in current term 6: Already voted for candidate b7ab4784c7344b939bc36f639286f377 in this term.
W20260709 13:19:35.119510  6695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 573297us
W20260709 13:19:35.100322  9794 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.629s	user 0.010s	sys 0.050s
I20260709 13:19:35.110441  9663 raft_consensus.cc:515] T 07a92dd554674067a83a9cb68c4773f2 P b7ab4784c7344b939bc36f639286f377 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:35.123984  9651 leader_election.cc:290] T 4f00a2e87e56452083b759f60d461ee3 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 8 election: Requested vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:19:35.101862  9586 raft_consensus.cc:515] T fe20b4b48823486ca3b9c648db6ce8aa P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:19:35.144398  6798 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:32976 (request call id 2370) took 1210 ms. Trace:
I20260709 13:19:35.144546  6799 raft_consensus.cc:1217] T 7c44c4849aa54f2b94d1f1bef9ed546f P b7ab4784c7344b939bc36f639286f377 [term 9 FOLLOWER]: Deduplicated request from leader. Original: 7.5->[8.6-8.6]   Dedup: 8.6->[]
I20260709 13:19:35.139345  6873 raft_consensus.cc:2468] T 1bf4668eeb70467fb3dc5a0289233b3c P cd75a17ab2604397adab03bb8b5fd75c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 7.
I20260709 13:19:35.145231  6799 raft_consensus.cc:1240] T 7c44c4849aa54f2b94d1f1bef9ed546f P b7ab4784c7344b939bc36f639286f377 [term 9 FOLLOWER]: Rejecting Update request from peer cd75a17ab2604397adab03bb8b5fd75c for earlier term 8. Current term is 9. Ops: [8.6-8.6]
W20260709 13:19:35.134465  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 54996us
I20260709 13:19:35.131803  9450 raft_consensus.cc:3060] T 4d9def8b32fd443aa94ab1420b06837b P b7ab4784c7344b939bc36f639286f377 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:35.137398  9772 raft_consensus.cc:493] T 7a734b5ab7834e05a8c422208acc58b1 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:35.136992  6878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ba5dac66ab5497e9e336f2a3c28cda5" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:19:35.150686  6872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ba5dac66ab5497e9e336f2a3c28cda5" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:19:35.143137  6807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c37d41cd9164c15a6826ca62a851a69" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:19:35.148078  6803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a92dd554674067a83a9cb68c4773f2" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:19:35.078774  9720 raft_consensus.cc:515] T 3d65025eea89441290d85dd053810e31 P cd75a17ab2604397adab03bb8b5fd75c [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
W20260709 13:19:35.155172  7468 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:35.144938  6798 rpcz_store.cc:276] 0709 13:19:33.933874 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:33.934087 (+   213us) service_pool.cc:224] Handling call
0709 13:19:33.951311 (+ 17224us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:34.100814 (+149503us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:34.100871 (+    57us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:34.105598 (+  4727us) log.cc:844] Serialized 26 byte log entry
0709 13:19:34.219387 (+113789us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:19:34.219432 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:34.644667 (+425235us) spinlock_profiling.cc:243] Waited 143 ms on lock 0x7b54001d1ad4. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f9aae01 00007fcc0f9a983e 00007fcc1496e419 00007fcc0dee5bd4 00007fcc0dee5b62 00007fcc0dee5a91 00007fcc0dee5a0c 00007fcc0dee4cc2 00007fcc0dce548c 00007fcc0dce48c6
0709 13:19:34.644745 (+    78us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:35.143974 (+499229us) raft_consensus.cc:1685] finished
0709 13:19:35.143994 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:35.144318 (+   324us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":719,"raft.run_cpu_time_us":166,"raft.run_wall_time_us":5233,"spinlock_wait_cycles":329446784,"thread_start_us":66512,"threads_started":1,"wal-append.queue_time_us":304350}
I20260709 13:19:35.159354  6807 raft_consensus.cc:2393] T 7c37d41cd9164c15a6826ca62a851a69 P b7ab4784c7344b939bc36f639286f377 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c in current term 7: Already voted for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in this term.
I20260709 13:19:35.161274  6872 raft_consensus.cc:2468] T 7ba5dac66ab5497e9e336f2a3c28cda5 P cd75a17ab2604397adab03bb8b5fd75c [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 8.
I20260709 13:19:35.112401  9809 raft_consensus.cc:515] T 30e88460611e47b2ba16a46a30b5f416 P cd75a17ab2604397adab03bb8b5fd75c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:35.164173  6873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f58dc08b12a2494bb9a1372837970ca2" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:19:35.167258  6877 raft_consensus.cc:1240] T 3d65025eea89441290d85dd053810e31 P cd75a17ab2604397adab03bb8b5fd75c [term 7 FOLLOWER]: Rejecting Update request from peer b7ab4784c7344b939bc36f639286f377 for earlier term 6. Current term is 7. Ops: []
I20260709 13:19:35.169472  6873 raft_consensus.cc:3060] T f58dc08b12a2494bb9a1372837970ca2 P cd75a17ab2604397adab03bb8b5fd75c [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:35.173300  6798 raft_consensus.cc:1240] T 3a485a995abc4807b6e511e45419f737 P b7ab4784c7344b939bc36f639286f377 [term 7 FOLLOWER]: Rejecting Update request from peer cd75a17ab2604397adab03bb8b5fd75c for earlier term 6. Current term is 7. Ops: []
I20260709 13:19:35.175734  6881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1704639a875409b9959353527b3fd68" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:19:35.176684  6878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c7f33e544204fbaac4078e3e83bbf4e" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:19:35.127910  9836 leader_election.cc:290] T 24ee15416e3145beaa1b8183453729a3 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:19:35.180181  6881 raft_consensus.cc:2468] T a1704639a875409b9959353527b3fd68 P cd75a17ab2604397adab03bb8b5fd75c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 7.
I20260709 13:19:35.180243  6878 raft_consensus.cc:2410] T 8c7f33e544204fbaac4078e3e83bbf4e P cd75a17ab2604397adab03bb8b5fd75c [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7ab4784c7344b939bc36f639286f377 for term 6 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:19:35.181957  6799 raft_consensus.cc:1217] T 4275cf08e63345f993bce8664eada830 P b7ab4784c7344b939bc36f639286f377 [term 8 FOLLOWER]: Deduplicated request from leader. Original: 3.2->[4.3-7.4]   Dedup: 4.3->[7.4-7.4]
I20260709 13:19:35.182039  6872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4b8bd455d5a47c18a1380839c6e0d61" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:19:35.182601  6799 raft_consensus.cc:1240] T 4275cf08e63345f993bce8664eada830 P b7ab4784c7344b939bc36f639286f377 [term 8 FOLLOWER]: Rejecting Update request from peer cd75a17ab2604397adab03bb8b5fd75c for earlier term 7. Current term is 8. Ops: [4.3-7.4]
I20260709 13:19:35.178484  6803 raft_consensus.cc:2393] T 07a92dd554674067a83a9cb68c4773f2 P b7ab4784c7344b939bc36f639286f377 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c in current term 8: Already voted for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in this term.
I20260709 13:19:35.104864  9627 raft_consensus.cc:515] T 1528ab62b6fe4e3099d08f141afee116 P cd75a17ab2604397adab03bb8b5fd75c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } attrs { replace: true } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:19:35.188571  6881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "713b5728a197487c9300b310ab94e5a3" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:19:35.172297  9657 raft_consensus.cc:493] T 7887766dc6784fcaa42b35c05fea7a99 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:35.198686  6799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b3759de40694069b13c0f8bd40e5709" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: true dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:19:35.199659  6799 raft_consensus.cc:3060] T 9b3759de40694069b13c0f8bd40e5709 P b7ab4784c7344b939bc36f639286f377 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:35.202275  6872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e31b9971c15848dea59d4d4130141d9e" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:19:35.204978  6878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e326172347f45e99a0d482b5d8ef768" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:19:35.213109  6872 raft_consensus.cc:2468] T e31b9971c15848dea59d4d4130141d9e P cd75a17ab2604397adab03bb8b5fd75c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 5.
I20260709 13:19:35.215718  9586 leader_election.cc:290] T fe20b4b48823486ca3b9c648db6ce8aa P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:35.221715  9586 raft_consensus.cc:493] T d8cee0accdb8499c86d4414b72565a38 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:35.222332  9838 log.cc:927] Time spent T 7ba5dac66ab5497e9e336f2a3c28cda5 P b7ab4784c7344b939bc36f639286f377: Append to log took a long time: real 0.060s	user 0.001s	sys 0.001s
I20260709 13:19:35.222285  9586 raft_consensus.cc:515] T d8cee0accdb8499c86d4414b72565a38 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:19:35.217994  6798 raft_consensus.cc:1275] T 7a734b5ab7834e05a8c422208acc58b1 P b7ab4784c7344b939bc36f639286f377 [term 8 FOLLOWER]: Refusing update from remote peer cd75a17ab2604397adab03bb8b5fd75c: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 8 index: 4. (index mismatch)
W20260709 13:19:35.228176  9842 log.cc:927] Time spent T 3fa34c08b205435dba97346991aa1f92 P ccd8a4c3bfe3413cb2ae219b09aea832: Append to log took a long time: real 0.061s	user 0.001s	sys 0.001s
I20260709 13:19:35.228243  9627 leader_election.cc:290] T 1528ab62b6fe4e3099d08f141afee116 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:19:35.229077  6798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d9def8b32fd443aa94ab1420b06837b" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:19:35.177762  9772 raft_consensus.cc:515] T 7a734b5ab7834e05a8c422208acc58b1 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
W20260709 13:19:35.239295  6844 connection.cc:256] RPC call timeout handler was delayed by -2.8692541369998708s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18910000000000002s for a response
I20260709 13:19:35.237761  6881 raft_consensus.cc:2468] T 713b5728a197487c9300b310ab94e5a3 P cd75a17ab2604397adab03bb8b5fd75c [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 8.
I20260709 13:19:35.216557  9775 leader_election.cc:290] T d8292e16e5654be6bc408560cf256aaa P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 10 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
W20260709 13:19:35.250989  6772 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:35.257593  6881 raft_consensus.cc:1240] T 22ccee1b570c4ad3a57bd7aec085b1b4 P cd75a17ab2604397adab03bb8b5fd75c [term 7 FOLLOWER]: Rejecting Update request from peer b7ab4784c7344b939bc36f639286f377 for earlier term 6. Current term is 7. Ops: []
I20260709 13:19:35.205163  9657 raft_consensus.cc:515] T 7887766dc6784fcaa42b35c05fea7a99 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:35.259675  6878 raft_consensus.cc:1240] T ab432e62819d499eaaf3dd55481dd930 P cd75a17ab2604397adab03bb8b5fd75c [term 9 FOLLOWER]: Rejecting Update request from peer b7ab4784c7344b939bc36f639286f377 for earlier term 8. Current term is 9. Ops: []
I20260709 13:19:35.249910  6872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b3759de40694069b13c0f8bd40e5709" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:19:35.293560  9586 leader_election.cc:290] T d8cee0accdb8499c86d4414b72565a38 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:35.299321  6881 raft_consensus.cc:3060] T 7ba5dac66ab5497e9e336f2a3c28cda5 P cd75a17ab2604397adab03bb8b5fd75c [term 8 FOLLOWER]: Advancing to term 10
I20260709 13:19:35.263891  9809 leader_election.cc:290] T 30e88460611e47b2ba16a46a30b5f416 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:19:35.312922  6872 raft_consensus.cc:2393] T 9b3759de40694069b13c0f8bd40e5709 P cd75a17ab2604397adab03bb8b5fd75c [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7ab4784c7344b939bc36f639286f377 in current term 7: Already voted for candidate cd75a17ab2604397adab03bb8b5fd75c in this term.
I20260709 13:19:35.306496  9758 leader_election.cc:290] T 3fa34c08b205435dba97346991aa1f92 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
W20260709 13:19:35.329021  9784 consensus_meta.cc:287] T 1528ab62b6fe4e3099d08f141afee116 P b7ab4784c7344b939bc36f639286f377: Time spent flushing consensus metadata: real 1.012s	user 0.013s	sys 0.001s
W20260709 13:19:35.332221  9813 log.cc:927] Time spent T 404190ce4ce94cecbfcb6ea9d1dd8626 P 7ba59cc884714e8aa5f3f0ecaed84cbb: Append to log took a long time: real 1.516s	user 0.008s	sys 0.006s
I20260709 13:19:35.336853  6876 raft_consensus.cc:2468] T 427c124d773f483294511e80fe340075 P cd75a17ab2604397adab03bb8b5fd75c [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 6.
I20260709 13:19:35.339564  6800 raft_consensus.cc:2468] T 1528ab62b6fe4e3099d08f141afee116 P b7ab4784c7344b939bc36f639286f377 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 7.
I20260709 13:19:35.335773  9720 leader_election.cc:290] T 3d65025eea89441290d85dd053810e31 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 7 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
W20260709 13:19:35.350044  9825 log.cc:927] Time spent T 3411566abe2d4c9bb4b2adfdd05e6f17 P b7ab4784c7344b939bc36f639286f377: Append to log took a long time: real 1.337s	user 0.004s	sys 0.014s
W20260709 13:19:35.351895  6844 connection.cc:256] RPC call timeout handler was delayed by -2.7882541369999672s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19810000000000003s for a response
W20260709 13:19:35.352449  6844 connection.cc:256] RPC call timeout handler was delayed by -2.6892541369998071s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20910000000000004s for a response
W20260709 13:19:35.353109  6771 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:35.353523  6771 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:35.355822  6724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3022224cc81473690653a83d4e99470" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
W20260709 13:19:35.351743  7468 leader_election.cc:336] T bb3d8792045a4583ae2e965b1350a5b4 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931): Timed out: RequestConsensusVote RPC to 127.5.126.67:42931 timed out after 1.815s (SENT)
I20260709 13:19:35.338390  9663 leader_election.cc:290] T 07a92dd554674067a83a9cb68c4773f2 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:35.362383  6726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1704639a875409b9959353527b3fd68" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:19:35.361689  6727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bf4668eeb70467fb3dc5a0289233b3c" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:19:35.367519  6729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e326172347f45e99a0d482b5d8ef768" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:19:35.366696  6726 raft_consensus.cc:2468] T a1704639a875409b9959353527b3fd68 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 7.
W20260709 13:19:35.379647  6844 connection.cc:256] RPC call timeout handler was delayed by -2.1197203269998681s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.32970000000000005s for a response
W20260709 13:19:35.380191  6844 connection.cc:256] RPC call timeout handler was delayed by -1.6641766269999607s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1539s for a response
W20260709 13:19:35.380606  6844 connection.cc:256] RPC call timeout handler was delayed by -1.5831766269998298s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16290000000000002s for a response
W20260709 13:19:35.380962  6844 connection.cc:256] RPC call timeout handler was delayed by -1.5318766269999742s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1686s for a response
I20260709 13:19:35.381165  6729 raft_consensus.cc:2393] T 9e326172347f45e99a0d482b5d8ef768 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate b7ab4784c7344b939bc36f639286f377 in current term 7: Already voted for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in this term.
I20260709 13:19:35.360581  7468 leader_election.cc:304] T bb3d8792045a4583ae2e965b1350a5b4 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
W20260709 13:19:35.384475  6844 connection.cc:256] RPC call timeout handler was delayed by -1.2825766270000258s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19630000000000003s for a response
W20260709 13:19:35.385241  6844 connection.cc:256] RPC call timeout handler was delayed by -1.0800766269999258s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21880000000000002s for a response
I20260709 13:19:35.359025  9589 raft_consensus.cc:3055] T 22ccee1b570c4ad3a57bd7aec085b1b4 P b7ab4784c7344b939bc36f639286f377 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:19:35.389325  6723 raft_consensus.cc:1275] T 7887766dc6784fcaa42b35c05fea7a99 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 8 FOLLOWER]: Refusing update from remote peer b7ab4784c7344b939bc36f639286f377: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 8 index: 4. (index mismatch)
I20260709 13:19:35.389956  6804 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50550 (request call id 282) took 1326 ms. Trace:
I20260709 13:19:35.392560  6804 rpcz_store.cc:276] 0709 13:19:34.063740 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:34.512650 (+448910us) service_pool.cc:224] Handling call
0709 13:19:34.530966 (+ 18316us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:34.531241 (+   275us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:19:34.531673 (+   432us) log.cc:844] Serialized 14 byte log entry
0709 13:19:35.389432 (+857759us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:35.389527 (+    95us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:19:35.389592 (+    65us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:35.389694 (+   102us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:35.389876 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":193,"prepare.run_cpu_time_us":41,"prepare.run_wall_time_us":43,"raft.queue_time_us":122030,"raft.run_cpu_time_us":102,"raft.run_wall_time_us":134,"thread_start_us":845686,"threads_started":2,"wal-append.queue_time_us":776993}
I20260709 13:19:35.396333  6804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5be3a11b23d4ea9b08300a2789821c7" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:19:35.399881  6727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c7f33e544204fbaac4078e3e83bbf4e" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:19:35.369598  9663 raft_consensus.cc:493] T 7c44c4849aa54f2b94d1f1bef9ed546f P b7ab4784c7344b939bc36f639286f377 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:19:35.405375  6727 raft_consensus.cc:2410] T 8c7f33e544204fbaac4078e3e83bbf4e P ccd8a4c3bfe3413cb2ae219b09aea832 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7ab4784c7344b939bc36f639286f377 for term 6 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:19:35.391312  9589 raft_consensus.cc:740] T 22ccee1b570c4ad3a57bd7aec085b1b4 P b7ab4784c7344b939bc36f639286f377 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
I20260709 13:19:35.422919  6723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "713b5728a197487c9300b310ab94e5a3" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:19:35.429330  6872 raft_consensus.cc:1275] T fe20b4b48823486ca3b9c648db6ce8aa P cd75a17ab2604397adab03bb8b5fd75c [term 6 FOLLOWER]: Refusing update from remote peer ccd8a4c3bfe3413cb2ae219b09aea832: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:19:35.400676  9771 raft_consensus.cc:493] T bd6869f07b5a4885a0b99fbe60c3b175 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:35.399825  9586 raft_consensus.cc:2749] T bb3d8792045a4583ae2e965b1350a5b4 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:19:35.435847  6878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f03d0dbf16864ca4bc1bb5e4c0334c0f" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
W20260709 13:19:35.438740  7468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 87036us
W20260709 13:19:35.439674  7468 leader_election.cc:336] T 4f00a2e87e56452083b759f60d461ee3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931): Timed out: RequestConsensusVote RPC to 127.5.126.67:42931 timed out after 2.088s (SENT)
I20260709 13:19:35.440387  7468 leader_election.cc:304] T 4f00a2e87e56452083b759f60d461ee3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:19:35.409714  9772 leader_election.cc:290] T 7a734b5ab7834e05a8c422208acc58b1 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:35.456028  6873 raft_consensus.cc:2468] T f58dc08b12a2494bb9a1372837970ca2 P cd75a17ab2604397adab03bb8b5fd75c [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 10.
I20260709 13:19:35.441628  6804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f00a2e87e56452083b759f60d461ee3" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:19:35.436609  6878 raft_consensus.cc:2468] T f03d0dbf16864ca4bc1bb5e4c0334c0f P cd75a17ab2604397adab03bb8b5fd75c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 5.
I20260709 13:19:35.458740  6727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f58dc08b12a2494bb9a1372837970ca2" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:19:35.459810  6727 raft_consensus.cc:3060] T f58dc08b12a2494bb9a1372837970ca2 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:35.462702  6807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a75bfe094d4bdc963aba3f08dfcd25" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 9 candidate_status { last_received { term: 7 index: 2 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:19:35.427874  9657 leader_election.cc:290] T 7887766dc6784fcaa42b35c05fea7a99 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:35.482470  6875 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53406 (request call id 1664) took 1027 ms. Trace:
I20260709 13:19:35.486040  6875 rpcz_store.cc:276] 0709 13:19:34.455618 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:34.455804 (+   186us) service_pool.cc:224] Handling call
0709 13:19:35.034310 (+578506us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:35.090949 (+ 56639us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:35.482110 (+391161us) spinlock_profiling.cc:243] Waited 47.5 ms on lock 0x7b5400217fd4. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f9aae01 00007fcc0f9a983e 00007fcc1496e419 00007fcc0dee5bd4 00007fcc0dee5b62 00007fcc0dee5a91 00007fcc0dee5a0c 00007fcc0dee4cc2 00007fcc0dce548c 00007fcc0dce48c6
0709 13:19:35.482379 (+   269us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":109329664}
I20260709 13:19:35.481958  6873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "711ef6523deb4cbe8ef2ba61e1c21c98" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:19:35.500806  6801 raft_consensus.cc:1275] T 07a92dd554674067a83a9cb68c4773f2 P b7ab4784c7344b939bc36f639286f377 [term 8 FOLLOWER]: Refusing update from remote peer ccd8a4c3bfe3413cb2ae219b09aea832: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 6 index: 3. (index mismatch)
I20260709 13:19:35.502872  6806 raft_consensus.cc:2468] T 44bde925b2e541b69890d70715b85176 P b7ab4784c7344b939bc36f639286f377 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 9.
I20260709 13:19:35.503854  6806 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:32976 (request call id 2394) took 1190 ms. Trace:
I20260709 13:19:35.504472  6806 rpcz_store.cc:276] 0709 13:19:34.313934 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:34.333041 (+ 19107us) service_pool.cc:224] Handling call
0709 13:19:35.503763 (+1170722us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:35.506820  6806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b56bf91d90824c959e21e0cee5ba1816" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 9 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:19:35.508210  6806 raft_consensus.cc:2410] T b56bf91d90824c959e21e0cee5ba1816 P b7ab4784c7344b939bc36f639286f377 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c for term 9 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
W20260709 13:19:35.510133  6847 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:35.511291  6723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17587d6730594da4a56fa13a353232a1" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:19:35.515141  9848 raft_consensus.cc:493] T 3a485a995abc4807b6e511e45419f737 P b7ab4784c7344b939bc36f639286f377 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:35.515610  7468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 75957.7us
I20260709 13:19:35.515141  6872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09c2a98de1a4decabd0ff900dd44caa" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:19:35.515890  9848 raft_consensus.cc:515] T 3a485a995abc4807b6e511e45419f737 P b7ab4784c7344b939bc36f639286f377 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:35.528616  6804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d33d5ee8ef6f415593d8df52063161ad" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:19:35.530985  6726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90d42e216d9741e190bca19a781291fd" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
W20260709 13:19:35.535614  6772 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 54863us
I20260709 13:19:35.535760  6724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1528ab62b6fe4e3099d08f141afee116" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:19:35.542552  6873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44bde925b2e541b69890d70715b85176" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:19:35.441339  9663 raft_consensus.cc:515] T 7c44c4849aa54f2b94d1f1bef9ed546f P b7ab4784c7344b939bc36f639286f377 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:35.499323  9657 raft_consensus.cc:493] T 90d42e216d9741e190bca19a781291fd P ccd8a4c3bfe3413cb2ae219b09aea832 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:35.539085  6803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77e330a82df4b43a745d57a68f6f057" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:19:35.480686  9853 raft_consensus.cc:2749] T 4f00a2e87e56452083b759f60d461ee3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:19:35.437702  9771 raft_consensus.cc:515] T bd6869f07b5a4885a0b99fbe60c3b175 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:35.559253  6723 raft_consensus.cc:1240] T 30e88460611e47b2ba16a46a30b5f416 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 7 LEADER]: Rejecting Update request from peer b7ab4784c7344b939bc36f639286f377 for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 13:19:35.555584  6803 raft_consensus.cc:1240] T 44bde925b2e541b69890d70715b85176 P b7ab4784c7344b939bc36f639286f377 [term 9 FOLLOWER]: Rejecting Update request from peer cd75a17ab2604397adab03bb8b5fd75c for earlier term 8. Current term is 9. Ops: []
I20260709 13:19:35.500183  9772 raft_consensus.cc:493] T 404190ce4ce94cecbfcb6ea9d1dd8626 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 7ba59cc884714e8aa5f3f0ecaed84cbb)
I20260709 13:19:35.556655  9848 leader_election.cc:290] T 3a485a995abc4807b6e511e45419f737 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
W20260709 13:19:35.557518  9847 log.cc:927] Time spent T 711ef6523deb4cbe8ef2ba61e1c21c98 P cd75a17ab2604397adab03bb8b5fd75c: Append to log took a long time: real 0.175s	user 0.000s	sys 0.000s
I20260709 13:19:35.519016  9653 raft_consensus.cc:493] T 3d65025eea89441290d85dd053810e31 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:19:35.563452  6873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab432e62819d499eaaf3dd55481dd930" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 9 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:19:35.567878  6804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20f6842e26174571996b8dea4151d4be" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:19:35.600543  6732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce4f062dcd314d43a63ca74067cb5ee3" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:19:35.604189  6724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e31b9971c15848dea59d4d4130141d9e" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:19:35.603415  6732 raft_consensus.cc:2468] T ce4f062dcd314d43a63ca74067cb5ee3 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in term 7.
I20260709 13:19:35.567890  6806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90d42e216d9741e190bca19a781291fd" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
W20260709 13:19:35.607259  6773 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:35.607992  6872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5be3a11b23d4ea9b08300a2789821c7" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:19:35.608889  6872 raft_consensus.cc:2393] T f5be3a11b23d4ea9b08300a2789821c7 P cd75a17ab2604397adab03bb8b5fd75c [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ccd8a4c3bfe3413cb2ae219b09aea832 in current term 6: Already voted for candidate cd75a17ab2604397adab03bb8b5fd75c in this term.
I20260709 13:19:35.612363  6873 raft_consensus.cc:2393] T ab432e62819d499eaaf3dd55481dd930 P cd75a17ab2604397adab03bb8b5fd75c [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate ccd8a4c3bfe3413cb2ae219b09aea832 in current term 9: Already voted for candidate cd75a17ab2604397adab03bb8b5fd75c in this term.
W20260709 13:19:35.614318  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 209899us
I20260709 13:19:35.547004  9589 consensus_queue.cc:260] T 22ccee1b570c4ad3a57bd7aec085b1b4 P b7ab4784c7344b939bc36f639286f377 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:35.603333  9627 raft_consensus.cc:493] T 24ee15416e3145beaa1b8183453729a3 P cd75a17ab2604397adab03bb8b5fd75c [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:35.617152  9653 raft_consensus.cc:515] T 3d65025eea89441290d85dd053810e31 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:35.638859  9653 leader_election.cc:290] T 3d65025eea89441290d85dd053810e31 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:35.558733  9657 raft_consensus.cc:515] T 90d42e216d9741e190bca19a781291fd P ccd8a4c3bfe3413cb2ae219b09aea832 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:35.641160  9657 leader_election.cc:290] T 90d42e216d9741e190bca19a781291fd P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:35.617728  6728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b3759de40694069b13c0f8bd40e5709" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:19:35.618897  6772 leader_election.cc:304] T a3022224cc81473690653a83d4e99470 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:19:35.623373  6725 raft_consensus.cc:2410] T bd6869f07b5a4885a0b99fbe60c3b175 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7ab4784c7344b939bc36f639286f377 for term 8 because replica has last-logged OpId of term: 7 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 2.
I20260709 13:19:35.632025  6723 raft_consensus.cc:1275] T be1a92657f494cac8dd227d152f50151 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 9 FOLLOWER]: Refusing update from remote peer 7ba59cc884714e8aa5f3f0ecaed84cbb: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 8. (term mismatch)
I20260709 13:19:35.628494  6730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f03d0dbf16864ca4bc1bb5e4c0334c0f" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:19:35.600865  9545 raft_consensus.cc:493] T 95a75bfe094d4bdc963aba3f08dfcd25 P b7ab4784c7344b939bc36f639286f377 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:35.644362  6728 raft_consensus.cc:2468] T 9b3759de40694069b13c0f8bd40e5709 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 7.
I20260709 13:19:35.622637  6727 raft_consensus.cc:2468] T f58dc08b12a2494bb9a1372837970ca2 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 10.
W20260709 13:19:35.654153  6695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 192400us
I20260709 13:19:35.646103  6723 pending_rounds.cc:85] T be1a92657f494cac8dd227d152f50151 P ccd8a4c3bfe3413cb2ae219b09aea832: Aborting all ops after (but not including) 7
I20260709 13:19:35.619050  6799 raft_consensus.cc:2468] T 9b3759de40694069b13c0f8bd40e5709 P b7ab4784c7344b939bc36f639286f377 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 7.
I20260709 13:19:35.647019  6881 raft_consensus.cc:1275] T 7ba5dac66ab5497e9e336f2a3c28cda5 P cd75a17ab2604397adab03bb8b5fd75c [term 10 FOLLOWER]: Refusing update from remote peer b7ab4784c7344b939bc36f639286f377: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:19:35.633183  6732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f9c2e2bf644115957398fe4c9459db" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:19:35.641599  6697 leader_election.cc:304] T 4b8cacb381b746da8d0049b0a83b41dd P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
I20260709 13:19:35.656534  6732 raft_consensus.cc:2393] T f3f9c2e2bf644115957398fe4c9459db P ccd8a4c3bfe3413cb2ae219b09aea832 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c in current term 7: Already voted for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in this term.
W20260709 13:19:35.653824  7468 leader_election.cc:336] T bb7fa124c3bf4ef9ab65a407cb008441 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931): Timed out: RequestConsensusVote RPC to 127.5.126.67:42931 timed out after 2.136s (SENT)
I20260709 13:19:35.657933  7468 leader_election.cc:304] T bb7fa124c3bf4ef9ab65a407cb008441 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:19:35.602957  9729 raft_consensus.cc:493] T d33d5ee8ef6f415593d8df52063161ad P ccd8a4c3bfe3413cb2ae219b09aea832 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:19:35.660708  6804 raft_consensus.cc:1275] T be1a92657f494cac8dd227d152f50151 P b7ab4784c7344b939bc36f639286f377 [term 9 FOLLOWER]: Refusing update from remote peer 7ba59cc884714e8aa5f3f0ecaed84cbb: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
W20260709 13:19:35.661180  6770 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 48231.1us
I20260709 13:19:35.642500  6731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5be3a11b23d4ea9b08300a2789821c7" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:19:35.662808  6730 raft_consensus.cc:2468] T f03d0dbf16864ca4bc1bb5e4c0334c0f P ccd8a4c3bfe3413cb2ae219b09aea832 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 6.
I20260709 13:19:35.646379  6726 raft_consensus.cc:2376] T 90d42e216d9741e190bca19a781291fd P ccd8a4c3bfe3413cb2ae219b09aea832 [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 8. Re-sending same reply.
I20260709 13:19:35.664947  6806 raft_consensus.cc:2393] T 90d42e216d9741e190bca19a781291fd P b7ab4784c7344b939bc36f639286f377 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c in current term 8: Already voted for candidate b7ab4784c7344b939bc36f639286f377 in this term.
I20260709 13:19:35.666520  6881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b8cacb381b746da8d0049b0a83b41dd" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
W20260709 13:19:35.660809  7466 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.5.126.65:44391 timed out after 1.550s (SENT) [suppressed 21 similar messages]
I20260709 13:19:35.668262  6731 raft_consensus.cc:3060] T f5be3a11b23d4ea9b08300a2789821c7 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:35.631374  9589 raft_consensus.cc:3060] T 22ccee1b570c4ad3a57bd7aec085b1b4 P b7ab4784c7344b939bc36f639286f377 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:35.626972  9715 raft_consensus.cc:3060] T 30e88460611e47b2ba16a46a30b5f416 P b7ab4784c7344b939bc36f639286f377 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:35.678752  6844 leader_election.cc:304] T e31b9971c15848dea59d4d4130141d9e P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:19:35.680548  9720 raft_consensus.cc:2804] T e31b9971c15848dea59d4d4130141d9e P cd75a17ab2604397adab03bb8b5fd75c [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 13:19:35.680974  6725 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50004 (request call id 1540) took 3838 ms (client timeout 2946 ms). Trace:
I20260709 13:19:35.680984  9720 raft_consensus.cc:493] T e31b9971c15848dea59d4d4130141d9e P cd75a17ab2604397adab03bb8b5fd75c [term 5 FOLLOWER]: Starting leader election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:19:35.681874  9720 raft_consensus.cc:3060] T e31b9971c15848dea59d4d4130141d9e P cd75a17ab2604397adab03bb8b5fd75c [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:19:35.681435  6725 rpcz_store.cc:269] 0709 13:19:31.842564 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:31.842728 (+   164us) service_pool.cc:224] Handling call
0709 13:19:35.680682 (+3837954us) spinlock_profiling.cc:243] Waited 3.64 s on lock 0x7b5400319cd4. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f9ae2fa 00007fcc1496fb17 00007fcc0deea6d4 00007fcc0deea662 00007fcc0deea591 00007fcc0deea50c 00007fcc0dee97c2 00007fcc0dce548c 00007fcc0dce48c6 00007fcc0dce426f
0709 13:19:35.680868 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":8361179520}
I20260709 13:19:35.682968  6725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b3759de40694069b13c0f8bd40e5709" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: true dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:19:35.601768  9862 consensus_queue.cc:1059] T e77e330a82df4b43a745d57a68f6f057 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: INVALID_TERM, Last received: 9.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.065s
I20260709 13:19:35.684618  9862 raft_consensus.cc:3055] T e77e330a82df4b43a745d57a68f6f057 P b7ab4784c7344b939bc36f639286f377 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:19:35.685066  9862 raft_consensus.cc:740] T e77e330a82df4b43a745d57a68f6f057 P b7ab4784c7344b939bc36f639286f377 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
I20260709 13:19:35.686041  9862 consensus_queue.cc:260] T e77e330a82df4b43a745d57a68f6f057 P b7ab4784c7344b939bc36f639286f377 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.4, Last appended by leader: 4, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } }
I20260709 13:19:35.687335  9862 raft_consensus.cc:3060] T e77e330a82df4b43a745d57a68f6f057 P b7ab4784c7344b939bc36f639286f377 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:35.688777  6728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a75bfe094d4bdc963aba3f08dfcd25" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 9 candidate_status { last_received { term: 7 index: 2 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:19:35.654874  6723 pending_rounds.cc:107] T be1a92657f494cac8dd227d152f50151 P ccd8a4c3bfe3413cb2ae219b09aea832: Aborting uncommitted NO_OP operation due to leader change: 8.8
I20260709 13:19:35.689723  6723 raft_consensus.cc:2889] T be1a92657f494cac8dd227d152f50151 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:19:35.690088  6874 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53406 (request call id 1659) took 1408 ms. Trace:
I20260709 13:19:35.690968  6723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d33d5ee8ef6f415593d8df52063161ad" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:19:35.690506  6874 rpcz_store.cc:276] 0709 13:19:34.325441 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:34.348252 (+ 22811us) service_pool.cc:224] Handling call
0709 13:19:34.401294 (+ 53042us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:19:34.476830 (+ 75536us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:19:35.089138 (+612308us) log.cc:844] Serialized 14 byte log entry
0709 13:19:35.253436 (+164298us) log.cc:844] Serialized 14 byte log entry
0709 13:19:35.253569 (+   133us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:19:35.264923 (+ 11354us) log.cc:844] Serialized 52 byte log entry
0709 13:19:35.269352 (+  4429us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:19:35.291116 (+ 21764us) log.cc:844] Serialized 14 byte log entry
0709 13:19:35.291353 (+   237us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:35.291450 (+    97us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:35.676157 (+384707us) spinlock_profiling.cc:243] Waited 1.9 ms on lock 0x7b180037cfc0. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc15785de1 00007fcc157925b1 00007fcc0c8bd3f3 00007fcc0c8bf7c1 00007fcc0c8bf779 00007fcc0c8bf709 00007fcc0c8bf6d1 00007fcc0c8be9cd 000000000038f354 000000000038f199 00007fcc0c8a083a
0709 13:19:35.689821 (+ 13664us) raft_consensus.cc:1685] finished
0709 13:19:35.689846 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:35.690015 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3605,"prepare.queue_time_us":818252,"prepare.run_cpu_time_us":91,"prepare.run_wall_time_us":100,"raft.queue_time_us":6223,"raft.run_cpu_time_us":425,"raft.run_wall_time_us":28686,"spinlock_wait_cycles":5177856,"thread_start_us":692618,"threads_started":2,"wal-append.queue_time_us":170001}
W20260709 13:19:35.692565  9843 log.cc:927] Time spent T c4db81d9d329422bb3b4160ca4ac2d1d P b7ab4784c7344b939bc36f639286f377: Append to log took a long time: real 0.386s	user 0.000s	sys 0.005s
I20260709 13:19:35.665719  9545 raft_consensus.cc:515] T 95a75bfe094d4bdc963aba3f08dfcd25 P b7ab4784c7344b939bc36f639286f377 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
W20260709 13:19:35.695026  6847 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:35.696352  6802 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:32976 (request call id 2380) took 1685 ms. Trace:
I20260709 13:19:35.696914  6879 raft_consensus.cc:1275] T 7c44c4849aa54f2b94d1f1bef9ed546f P cd75a17ab2604397adab03bb8b5fd75c [term 9 FOLLOWER]: Refusing update from remote peer ccd8a4c3bfe3413cb2ae219b09aea832: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 13:19:35.672943  9653 raft_consensus.cc:2804] T 4b8cacb381b746da8d0049b0a83b41dd P ccd8a4c3bfe3413cb2ae219b09aea832 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:19:35.673154  6729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce4f062dcd314d43a63ca74067cb5ee3" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:19:35.673831  9856 consensus_queue.cc:1059] T 711ef6523deb4cbe8ef2ba61e1c21c98 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:19:35.670738  9657 raft_consensus.cc:493] T dbdf895bba214ff68685a24fd17dfb5d P ccd8a4c3bfe3413cb2ae219b09aea832 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:19:35.674134  9729 raft_consensus.cc:515] T d33d5ee8ef6f415593d8df52063161ad P ccd8a4c3bfe3413cb2ae219b09aea832 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:35.724936  6874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "853ac0a8cbd64ce99457f170216d4d0f" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:19:35.726223  6881 raft_consensus.cc:2468] T 4b8cacb381b746da8d0049b0a83b41dd P cd75a17ab2604397adab03bb8b5fd75c [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 8.
W20260709 13:19:35.674964  6772 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 56148.8us
I20260709 13:19:35.675107  9853 raft_consensus.cc:2749] T bb7fa124c3bf4ef9ab65a407cb008441 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:19:35.675634  9744 raft_consensus.cc:2804] T a3022224cc81473690653a83d4e99470 P b7ab4784c7344b939bc36f639286f377 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:19:35.641578  9859 consensus_queue.cc:1048] T fe20b4b48823486ca3b9c648db6ce8aa P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.035s
I20260709 13:19:35.676807  6801 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:32976 (request call id 2396) took 1362 ms. Trace:
I20260709 13:19:35.732686  6801 rpcz_store.cc:276] 0709 13:19:34.314571 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:35.142880 (+828309us) service_pool.cc:224] Handling call
0709 13:19:35.493719 (+350839us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:35.501746 (+  8027us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:35.676571 (+174825us) spinlock_profiling.cc:243] Waited 337 ms on lock 0x7b54001b44d0. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f9a98ad 00007fcc1496e419 00007fcc0dee5bd4 00007fcc0dee5b62 00007fcc0dee5a91 00007fcc0dee5a0c 00007fcc0dee4cc2 00007fcc0dce548c 00007fcc0dce48c6 00007fcc0dce426f
0709 13:19:35.676727 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":775555328}
I20260709 13:19:35.617954  9772 raft_consensus.cc:515] T 404190ce4ce94cecbfcb6ea9d1dd8626 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:19:35.606000  9848 consensus_queue.cc:1059] T ab432e62819d499eaaf3dd55481dd930 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.055s
I20260709 13:19:35.623373  9851 consensus_queue.cc:1059] T f3f9c2e2bf644115957398fe4c9459db P b7ab4784c7344b939bc36f639286f377 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.070s
I20260709 13:19:35.697072  6770 leader_election.cc:304] T a1704639a875409b9959353527b3fd68 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
I20260709 13:19:35.632550  9627 raft_consensus.cc:515] T 24ee15416e3145beaa1b8183453729a3 P cd75a17ab2604397adab03bb8b5fd75c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:19:35.745253  6879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de3186201e1a40d0b335eeb8b4e256e0" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:19:35.697620  6880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3d8792045a4583ae2e965b1350a5b4" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:19:35.689747  6728 raft_consensus.cc:2393] T 95a75bfe094d4bdc963aba3f08dfcd25 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c in current term 9: Already voted for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in this term.
I20260709 13:19:35.747326  6723 raft_consensus.cc:3060] T d33d5ee8ef6f415593d8df52063161ad P ccd8a4c3bfe3413cb2ae219b09aea832 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:35.705384  6807 raft_consensus.cc:2410] T 95a75bfe094d4bdc963aba3f08dfcd25 P b7ab4784c7344b939bc36f639286f377 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c for term 9 because replica has last-logged OpId of term: 8 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 2.
I20260709 13:19:35.669977  6695 leader_election.cc:304] T 853ac0a8cbd64ce99457f170216d4d0f P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
I20260709 13:19:35.708060  6729 raft_consensus.cc:2468] T ce4f062dcd314d43a63ca74067cb5ee3 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 7.
I20260709 13:19:35.696712  6802 rpcz_store.cc:276] 0709 13:19:34.011319 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:34.241614 (+230295us) service_pool.cc:224] Handling call
0709 13:19:34.241959 (+   345us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:34.259078 (+ 17119us) spinlock_profiling.cc:243] Waited 1.47 ms on lock 0x7b4800061ed8. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc148d3aa1 00007fcc148cab37 00007fcc148ca9ca 00007fcc149c226f 00007fcc149c1f37 00007fcc149d655c 00007fcc149d6508 00007fcc149d6488 00007fcc149d6443 00007fcc149d56ec 00007fcc138ffa96
0709 13:19:34.263257 (+  4179us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:34.263293 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:34.263878 (+   585us) log.cc:844] Serialized 26 byte log entry
0709 13:19:34.425573 (+161695us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:19:34.425635 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:34.425732 (+    97us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:35.691758 (+1266026us) spinlock_profiling.cc:243] Waited 5.13 ms on lock 0x7b4400022b4c. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0c745db1 00007fcc0c7e3c85 00007fcc0c7e46a2 00007fcc0f5561db 00007fcc0f551aaf 00007fcc0f54586e 00007fcc0f544bb6 00007fcc0f5447d8 00007fcc0f54e221 00007fcc0f54e1d9 00007fcc0f54e169
0709 13:19:35.696111 (+  4353us) raft_consensus.cc:1685] finished
0709 13:19:35.696138 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:35.696281 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1117,"raft.queue_time_us":13181,"raft.run_cpu_time_us":2351,"raft.run_wall_time_us":3656,"spinlock_wait_cycles":15180544,"thread_start_us":160992,"threads_started":1,"wal-append.queue_time_us":966353}
I20260709 13:19:35.722982  6697 leader_election.cc:304] T 24ee15416e3145beaa1b8183453729a3 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
I20260709 13:19:35.727414  6772 leader_election.cc:304] T 1bf4668eeb70467fb3dc5a0289233b3c P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:19:35.662598  9863 raft_consensus.cc:493] T b56bf91d90824c959e21e0cee5ba1816 P b7ab4784c7344b939bc36f639286f377 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:19:35.740594  6875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f58dc08b12a2494bb9a1372837970ca2" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:19:35.695864  9545 leader_election.cc:290] T 95a75bfe094d4bdc963aba3f08dfcd25 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:35.734140  6878 raft_consensus.cc:1275] T 4275cf08e63345f993bce8664eada830 P cd75a17ab2604397adab03bb8b5fd75c [term 8 FOLLOWER]: Refusing update from remote peer ccd8a4c3bfe3413cb2ae219b09aea832: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 4. (term mismatch)
I20260709 13:19:35.734278  6873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c240553ce044eedb41541d72b9475d7" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:19:35.735189  6844 leader_election.cc:304] T c4db81d9d329422bb3b4160ca4ac2d1d P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:19:35.736822  6732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fa34c08b205435dba97346991aa1f92" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:19:35.709689  9771 leader_election.cc:290] T bd6869f07b5a4885a0b99fbe60c3b175 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:35.740193  6872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c7f33e544204fbaac4078e3e83bbf4e" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:19:35.801678  6872 raft_consensus.cc:2468] T 8c7f33e544204fbaac4078e3e83bbf4e P cd75a17ab2604397adab03bb8b5fd75c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 5.
I20260709 13:19:35.711257  9653 raft_consensus.cc:493] T 4b8cacb381b746da8d0049b0a83b41dd P ccd8a4c3bfe3413cb2ae219b09aea832 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:35.753063  6726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a92dd554674067a83a9cb68c4773f2" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:19:35.753490  9836 raft_consensus.cc:3055] T d33d5ee8ef6f415593d8df52063161ad P b7ab4784c7344b939bc36f639286f377 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:19:35.756075  9627 leader_election.cc:290] T 24ee15416e3145beaa1b8183453729a3 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
W20260709 13:19:35.756862  6800 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:32976 (request call id 2391) took 1506 ms (client timeout 1911 ms). Trace:
I20260709 13:19:35.800223  6878 pending_rounds.cc:85] T 4275cf08e63345f993bce8664eada830 P cd75a17ab2604397adab03bb8b5fd75c: Aborting all ops after (but not including) 3
I20260709 13:19:35.811967  6878 pending_rounds.cc:107] T 4275cf08e63345f993bce8664eada830 P cd75a17ab2604397adab03bb8b5fd75c: Aborting uncommitted NO_OP operation due to leader change: 7.4
I20260709 13:19:35.757977  6880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d9def8b32fd443aa94ab1420b06837b" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:19:35.812326  6878 raft_consensus.cc:2889] T 4275cf08e63345f993bce8664eada830 P cd75a17ab2604397adab03bb8b5fd75c [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:19:35.731936  9744 raft_consensus.cc:493] T a3022224cc81473690653a83d4e99470 P b7ab4784c7344b939bc36f639286f377 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:19:35.798007  6695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 128194us
I20260709 13:19:35.818938  6695 leader_election.cc:304] T f58dc08b12a2494bb9a1372837970ca2 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
W20260709 13:19:35.811877  6800 rpcz_store.cc:269] 0709 13:19:34.250352 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:34.310732 (+ 60380us) service_pool.cc:224] Handling call
0709 13:19:35.756681 (+1445949us) spinlock_profiling.cc:243] Waited 1.03 s on lock 0x7b54001b4ed4. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f9ae2fa 00007fcc1496fb17 00007fcc0deea6d4 00007fcc0deea662 00007fcc0deea591 00007fcc0deea50c 00007fcc0dee97c2 00007fcc0dce548c 00007fcc0dce48c6 00007fcc0dce426f
0709 13:19:35.756797 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2364072704}
I20260709 13:19:35.804838  6875 raft_consensus.cc:2393] T f58dc08b12a2494bb9a1372837970ca2 P cd75a17ab2604397adab03bb8b5fd75c [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ccd8a4c3bfe3413cb2ae219b09aea832 in current term 10: Already voted for candidate b7ab4784c7344b939bc36f639286f377 in this term.
I20260709 13:19:35.817340  6880 raft_consensus.cc:2393] T 4d9def8b32fd443aa94ab1420b06837b P cd75a17ab2604397adab03bb8b5fd75c [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ccd8a4c3bfe3413cb2ae219b09aea832 in current term 8: Already voted for candidate cd75a17ab2604397adab03bb8b5fd75c in this term.
I20260709 13:19:35.797892  6879 raft_consensus.cc:2468] T de3186201e1a40d0b335eeb8b4e256e0 P cd75a17ab2604397adab03bb8b5fd75c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 7.
I20260709 13:19:35.761274  6881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce4f062dcd314d43a63ca74067cb5ee3" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
W20260709 13:19:35.817713  6770 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 120700us
W20260709 13:19:35.820992  7468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 167218us
W20260709 13:19:35.822106  7468 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:35.810473  6697 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.68:45071, user_credentials={real_user=slave}} blocked reactor thread for 87544.3us
I20260709 13:19:35.824018  9867 raft_consensus.cc:2804] T 24ee15416e3145beaa1b8183453729a3 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:19:35.824674  9867 raft_consensus.cc:697] T 24ee15416e3145beaa1b8183453729a3 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 8 LEADER]: Becoming Leader. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
I20260709 13:19:35.825631  6726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c240553ce044eedb41541d72b9475d7" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:19:35.825718  9867 consensus_queue.cc:237] T 24ee15416e3145beaa1b8183453729a3 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:19:35.826414  6726 raft_consensus.cc:2468] T 2c240553ce044eedb41541d72b9475d7 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 9.
I20260709 13:19:35.827338  6726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c37d41cd9164c15a6826ca62a851a69" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:19:35.834851  9771 raft_consensus.cc:2764] T f58dc08b12a2494bb9a1372837970ca2 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 10 FOLLOWER]: Leader pre-election decision vote started in defunct term 9: won
I20260709 13:19:35.837385  6728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d9def8b32fd443aa94ab1420b06837b" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:19:35.847357  6728 raft_consensus.cc:3060] T 4d9def8b32fd443aa94ab1420b06837b P ccd8a4c3bfe3413cb2ae219b09aea832 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:19:35.839993  7466 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 226074us
W20260709 13:19:35.799217  9687 consensus_meta.cc:287] T f09c2a98de1a4decabd0ff900dd44caa P ccd8a4c3bfe3413cb2ae219b09aea832: Time spent flushing consensus metadata: real 0.668s	user 0.011s	sys 0.002s
I20260709 13:19:35.828384  9809 raft_consensus.cc:2749] T c4db81d9d329422bb3b4160ca4ac2d1d P cd75a17ab2604397adab03bb8b5fd75c [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:19:35.828437  9861 raft_consensus.cc:2804] T 853ac0a8cbd64ce99457f170216d4d0f P ccd8a4c3bfe3413cb2ae219b09aea832 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:19:35.729290  9780 consensus_queue.cc:1059] T 17587d6730594da4a56fa13a353232a1 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.112s
I20260709 13:19:35.855741  6873 raft_consensus.cc:2468] T 2c240553ce044eedb41541d72b9475d7 P cd75a17ab2604397adab03bb8b5fd75c [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 8.
I20260709 13:19:35.828006  6726 raft_consensus.cc:2393] T 7c37d41cd9164c15a6826ca62a851a69 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c in current term 7: Already voted for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in this term.
W20260709 13:19:35.830772  6772 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 103429us
I20260709 13:19:35.858098  7466 leader_election.cc:304] T 17587d6730594da4a56fa13a353232a1 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:19:35.834549  6732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8292e16e5654be6bc408560cf256aaa" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:19:35.830319  6880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3411566abe2d4c9bb4b2adfdd05e6f17" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:19:35.844872  6725 raft_consensus.cc:2468] T 9b3759de40694069b13c0f8bd40e5709 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 7.
I20260709 13:19:35.811244  9653 raft_consensus.cc:3060] T 4b8cacb381b746da8d0049b0a83b41dd P ccd8a4c3bfe3413cb2ae219b09aea832 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:35.845688  6872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c37d41cd9164c15a6826ca62a851a69" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:19:35.849558  6731 raft_consensus.cc:2468] T f5be3a11b23d4ea9b08300a2789821c7 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 6.
I20260709 13:19:35.830965  9691 raft_consensus.cc:3055] T f3f9c2e2bf644115957398fe4c9459db P b7ab4784c7344b939bc36f639286f377 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:19:35.866039  9691 raft_consensus.cc:740] T f3f9c2e2bf644115957398fe4c9459db P b7ab4784c7344b939bc36f639286f377 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
I20260709 13:19:35.867002  9691 consensus_queue.cc:260] T f3f9c2e2bf644115957398fe4c9459db P b7ab4784c7344b939bc36f639286f377 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:35.858429  9711 raft_consensus.cc:493] T bd6869f07b5a4885a0b99fbe60c3b175 P b7ab4784c7344b939bc36f639286f377 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:35.868463  9586 consensus_queue.cc:1048] T be1a92657f494cac8dd227d152f50151 P 7ba59cc884714e8aa5f3f0ecaed84cbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:19:35.868716  6880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e326172347f45e99a0d482b5d8ef768" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:19:35.831213  9848 raft_consensus.cc:2804] T 1bf4668eeb70467fb3dc5a0289233b3c P b7ab4784c7344b939bc36f639286f377 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:19:35.869427  9848 raft_consensus.cc:493] T 1bf4668eeb70467fb3dc5a0289233b3c P b7ab4784c7344b939bc36f639286f377 [term 7 FOLLOWER]: Starting leader election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:19:35.869856  9848 raft_consensus.cc:3060] T 1bf4668eeb70467fb3dc5a0289233b3c P b7ab4784c7344b939bc36f639286f377 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:35.870021  6880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f9c2e2bf644115957398fe4c9459db" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:19:35.870672  6880 raft_consensus.cc:2468] T f3f9c2e2bf644115957398fe4c9459db P cd75a17ab2604397adab03bb8b5fd75c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 6.
I20260709 13:19:35.871452  6880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24ee15416e3145beaa1b8183453729a3" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:19:35.871754  9586 consensus_queue.cc:1048] T be1a92657f494cac8dd227d152f50151 P 7ba59cc884714e8aa5f3f0ecaed84cbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:19:35.811513  9836 raft_consensus.cc:740] T d33d5ee8ef6f415593d8df52063161ad P b7ab4784c7344b939bc36f639286f377 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
I20260709 13:19:35.735798  9657 raft_consensus.cc:515] T dbdf895bba214ff68685a24fd17dfb5d P ccd8a4c3bfe3413cb2ae219b09aea832 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:35.841567  9663 leader_election.cc:290] T 7c44c4849aa54f2b94d1f1bef9ed546f P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:35.860154  6732 raft_consensus.cc:3060] T d8292e16e5654be6bc408560cf256aaa P ccd8a4c3bfe3413cb2ae219b09aea832 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:35.860930  6725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe20b4b48823486ca3b9c648db6ce8aa" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:19:35.860121  6770 leader_election.cc:304] T 9b3759de40694069b13c0f8bd40e5709 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
I20260709 13:19:35.912027  6874 raft_consensus.cc:1275] T a3022224cc81473690653a83d4e99470 P cd75a17ab2604397adab03bb8b5fd75c [term 8 FOLLOWER]: Refusing update from remote peer ccd8a4c3bfe3413cb2ae219b09aea832: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:19:35.934310  6723 raft_consensus.cc:2468] T d33d5ee8ef6f415593d8df52063161ad P ccd8a4c3bfe3413cb2ae219b09aea832 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 9.
I20260709 13:19:35.863911  6800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8cee0accdb8499c86d4414b72565a38" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:19:35.830346  9849 raft_consensus.cc:2804] T a1704639a875409b9959353527b3fd68 P b7ab4784c7344b939bc36f639286f377 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:19:35.865557  9853 raft_consensus.cc:2749] T 17587d6730594da4a56fa13a353232a1 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:19:35.868609  9711 raft_consensus.cc:515] T bd6869f07b5a4885a0b99fbe60c3b175 P b7ab4784c7344b939bc36f639286f377 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:35.839123  9744 raft_consensus.cc:3060] T a3022224cc81473690653a83d4e99470 P b7ab4784c7344b939bc36f639286f377 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:35.871917  6880 raft_consensus.cc:3060] T 24ee15416e3145beaa1b8183453729a3 P cd75a17ab2604397adab03bb8b5fd75c [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:19:35.852681  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 117576us
I20260709 13:19:35.875087  6879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34f36d59d88f40fe8a2805e604fc6c0a" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:19:35.851397  6877 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53406 (request call id 1663) took 1412 ms. Trace:
I20260709 13:19:35.952253  6697 leader_election.cc:304] T f03d0dbf16864ca4bc1bb5e4c0334c0f P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:19:35.952505  6877 rpcz_store.cc:276] 0709 13:19:34.439528 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:34.455615 (+ 16087us) service_pool.cc:224] Handling call
0709 13:19:34.477394 (+ 21779us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:35.168958 (+691564us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:35.851198 (+682240us) spinlock_profiling.cc:243] Waited 690 ms on lock 0x7b54002198d4. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f9aae01 00007fcc0f9a983e 00007fcc1496e419 00007fcc0dee5bd4 00007fcc0dee5b62 00007fcc0dee5a91 00007fcc0dee5a0c 00007fcc0dee4cc2 00007fcc0dce548c 00007fcc0dce48c6
0709 13:19:35.851347 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1585961216}
I20260709 13:19:35.848418  6881 raft_consensus.cc:2468] T ce4f062dcd314d43a63ca74067cb5ee3 P cd75a17ab2604397adab03bb8b5fd75c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 7.
I20260709 13:19:35.952951  6872 raft_consensus.cc:3060] T 7c37d41cd9164c15a6826ca62a851a69 P cd75a17ab2604397adab03bb8b5fd75c [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:35.763916  9856 consensus_queue.cc:1243] T 711ef6523deb4cbe8ef2ba61e1c21c98 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Peer ccd8a4c3bfe3413cb2ae219b09aea832 log is divergent from this leader: its last log entry 7.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 13:19:35.856700  6727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b56bf91d90824c959e21e0cee5ba1816" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 9 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:19:35.879040  6726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fa34c08b205435dba97346991aa1f92" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
W20260709 13:19:35.872735  9869 log.cc:927] Time spent T e77e330a82df4b43a745d57a68f6f057 P ccd8a4c3bfe3413cb2ae219b09aea832: Append to log took a long time: real 0.140s	user 0.000s	sys 0.000s
I20260709 13:19:35.880785  6878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "427c124d773f483294511e80fe340075" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:19:35.881636  6876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4b8bd455d5a47c18a1380839c6e0d61" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:19:35.881811  9836 consensus_queue.cc:260] T d33d5ee8ef6f415593d8df52063161ad P b7ab4784c7344b939bc36f639286f377 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:35.884433  9851 raft_consensus.cc:3055] T ab432e62819d499eaaf3dd55481dd930 P b7ab4784c7344b939bc36f639286f377 [term 8 LEADER]: Stepping down as leader of term 8
W20260709 13:19:35.884609  9450 consensus_meta.cc:287] T 4d9def8b32fd443aa94ab1420b06837b P b7ab4784c7344b939bc36f639286f377: Time spent flushing consensus metadata: real 0.734s	user 0.011s	sys 0.002s
I20260709 13:19:35.966382  6800 raft_consensus.cc:2468] T d8cee0accdb8499c86d4414b72565a38 P b7ab4784c7344b939bc36f639286f377 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in term 7.
I20260709 13:19:35.851032  9775 raft_consensus.cc:3055] T f5be3a11b23d4ea9b08300a2789821c7 P b7ab4784c7344b939bc36f639286f377 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:19:35.902256  9774 consensus_queue.cc:1048] T 7887766dc6784fcaa42b35c05fea7a99 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.048s
I20260709 13:19:35.880815  6729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1704639a875409b9959353527b3fd68" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:19:35.855468  9861 raft_consensus.cc:493] T 853ac0a8cbd64ce99457f170216d4d0f P ccd8a4c3bfe3413cb2ae219b09aea832 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:35.856251  9687 raft_consensus.cc:515] T f09c2a98de1a4decabd0ff900dd44caa P ccd8a4c3bfe3413cb2ae219b09aea832 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
W20260709 13:19:35.970506  7468 leader_election.cc:336] T 4b8cacb381b746da8d0049b0a83b41dd P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931): Timed out: RequestConsensusVote RPC to 127.5.126.67:42931 timed out after 3.152s (SENT)
I20260709 13:19:35.914333  6731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90d42e216d9741e190bca19a781291fd" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:19:35.974148  6874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b3759de40694069b13c0f8bd40e5709" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:19:35.974697  6731 raft_consensus.cc:2393] T 90d42e216d9741e190bca19a781291fd P ccd8a4c3bfe3413cb2ae219b09aea832 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c in current term 8: Already voted for candidate b7ab4784c7344b939bc36f639286f377 in this term.
I20260709 13:19:35.974992  6874 raft_consensus.cc:2468] T 9b3759de40694069b13c0f8bd40e5709 P cd75a17ab2604397adab03bb8b5fd75c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 7.
I20260709 13:19:35.921065  7495 raft_consensus.cc:1275] T 3fa34c08b205435dba97346991aa1f92 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 10 FOLLOWER]: Refusing update from remote peer ccd8a4c3bfe3413cb2ae219b09aea832: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:19:35.861974  6730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77e330a82df4b43a745d57a68f6f057" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
W20260709 13:19:35.936527  6770 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 76503.7us
I20260709 13:19:35.979455  6770 leader_election.cc:304] T f58dc08b12a2494bb9a1372837970ca2 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
I20260709 13:19:35.939452  6725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe20b4b48823486ca3b9c648db6ce8aa" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:19:35.940627  6873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20f6842e26174571996b8dea4151d4be" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:19:35.981745  6873 raft_consensus.cc:2468] T 20f6842e26174571996b8dea4151d4be P cd75a17ab2604397adab03bb8b5fd75c [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 8.
I20260709 13:19:35.944052  6875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1704639a875409b9959353527b3fd68" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:19:35.958272  6697 leader_election.cc:304] T 711ef6523deb4cbe8ef2ba61e1c21c98 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:19:35.959506  6881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44bde925b2e541b69890d70715b85176" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:19:35.982936  6875 raft_consensus.cc:2393] T a1704639a875409b9959353527b3fd68 P cd75a17ab2604397adab03bb8b5fd75c [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate ccd8a4c3bfe3413cb2ae219b09aea832 in current term 7: Already voted for candidate cd75a17ab2604397adab03bb8b5fd75c in this term.
I20260709 13:19:35.962206  7496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f00a2e87e56452083b759f60d461ee3" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb"
I20260709 13:19:35.983762  7496 raft_consensus.cc:3060] T 4f00a2e87e56452083b759f60d461ee3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:35.941367  9691 raft_consensus.cc:3060] T f3f9c2e2bf644115957398fe4c9459db P b7ab4784c7344b939bc36f639286f377 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:35.987003  6877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77e330a82df4b43a745d57a68f6f057" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:19:35.963267  7503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1528ab62b6fe4e3099d08f141afee116" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:19:35.890739  6772 leader_election.cc:304] T f4b8bd455d5a47c18a1380839c6e0d61 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:19:35.990302  7503 raft_consensus.cc:1813] T 1528ab62b6fe4e3099d08f141afee116 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 7 FOLLOWER]: Handling vote request from an unknown peer cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:19:35.990890  7503 raft_consensus.cc:2393] T 1528ab62b6fe4e3099d08f141afee116 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c in current term 7: Already voted for candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in this term.
I20260709 13:19:35.944396  9663 raft_consensus.cc:2764] T 9b3759de40694069b13c0f8bd40e5709 P b7ab4784c7344b939bc36f639286f377 [term 7 FOLLOWER]: Leader pre-election decision vote started in defunct term 6: won
I20260709 13:19:35.992849  6844 leader_election.cc:304] T de3186201e1a40d0b335eeb8b4e256e0 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:19:35.968743  6878 raft_consensus.cc:2393] T 427c124d773f483294511e80fe340075 P cd75a17ab2604397adab03bb8b5fd75c [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ccd8a4c3bfe3413cb2ae219b09aea832 in current term 6: Already voted for candidate b7ab4784c7344b939bc36f639286f377 in this term.
I20260709 13:19:35.969422  6726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a92dd554674067a83a9cb68c4773f2" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 9 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:19:35.816457  9863 raft_consensus.cc:515] T b56bf91d90824c959e21e0cee5ba1816 P b7ab4784c7344b939bc36f639286f377 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:35.974014  6729 raft_consensus.cc:2393] T a1704639a875409b9959353527b3fd68 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c in current term 7: Already voted for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in this term.
I20260709 13:19:35.948676  9849 raft_consensus.cc:493] T a1704639a875409b9959353527b3fd68 P b7ab4784c7344b939bc36f639286f377 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:35.984386  7468 leader_election.cc:304] T 4b8cacb381b746da8d0049b0a83b41dd P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:19:35.970445  9775 raft_consensus.cc:740] T f5be3a11b23d4ea9b08300a2789821c7 P b7ab4784c7344b939bc36f639286f377 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
I20260709 13:19:35.981267  6725 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fe20b4b48823486ca3b9c648db6ce8aa"
dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
mode: GRACEFUL
new_leader_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
 from {username='slave'} at 127.0.0.1:38536
I20260709 13:19:36.010953  9711 leader_election.cc:290] T bd6869f07b5a4885a0b99fbe60c3b175 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:36.011088  6725 raft_consensus.cc:606] T fe20b4b48823486ca3b9c648db6ce8aa P ccd8a4c3bfe3413cb2ae219b09aea832 [term 6 LEADER]: Received request to transfer leadership to TS cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:19:36.011674  9711 raft_consensus.cc:2749] T f4b8bd455d5a47c18a1380839c6e0d61 P b7ab4784c7344b939bc36f639286f377 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:19:36.001137  6723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24ee15416e3145beaa1b8183453729a3" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:19:36.004962  9687 leader_election.cc:290] T f09c2a98de1a4decabd0ff900dd44caa P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 9 election: Requested vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:36.007555  6732 raft_consensus.cc:2468] T d8292e16e5654be6bc408560cf256aaa P ccd8a4c3bfe3413cb2ae219b09aea832 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 10.
I20260709 13:19:36.008921  6728 raft_consensus.cc:2468] T 4d9def8b32fd443aa94ab1420b06837b P ccd8a4c3bfe3413cb2ae219b09aea832 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 8.
I20260709 13:19:36.009052  9785 raft_consensus.cc:493] T 30e88460611e47b2ba16a46a30b5f416 P b7ab4784c7344b939bc36f639286f377 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:36.009215  9856 raft_consensus.cc:2804] T f58dc08b12a2494bb9a1372837970ca2 P b7ab4784c7344b939bc36f639286f377 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:19:36.009996  9853 raft_consensus.cc:2749] T 4b8cacb381b746da8d0049b0a83b41dd P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
W20260709 13:19:36.010094  7468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 47345.9us
I20260709 13:19:36.011298  9775 consensus_queue.cc:260] T f5be3a11b23d4ea9b08300a2789821c7 P b7ab4784c7344b939bc36f639286f377 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
W20260709 13:19:36.013505  9858 log.cc:927] Time spent T f09c2a98de1a4decabd0ff900dd44caa P b7ab4784c7344b939bc36f639286f377: Append to log took a long time: real 0.190s	user 0.000s	sys 0.001s
I20260709 13:19:36.014283  6877 raft_consensus.cc:2393] T e77e330a82df4b43a745d57a68f6f057 P cd75a17ab2604397adab03bb8b5fd75c [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ccd8a4c3bfe3413cb2ae219b09aea832 in current term 10: Already voted for candidate cd75a17ab2604397adab03bb8b5fd75c in this term.
I20260709 13:19:36.009163  9849 raft_consensus.cc:3060] T a1704639a875409b9959353527b3fd68 P b7ab4784c7344b939bc36f639286f377 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:36.016247  9627 raft_consensus.cc:3060] T de3186201e1a40d0b335eeb8b4e256e0 P cd75a17ab2604397adab03bb8b5fd75c [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:19:36.016925  6772 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 126263us
I20260709 13:19:36.017382  9720 raft_consensus.cc:515] T e31b9971c15848dea59d4d4130141d9e P cd75a17ab2604397adab03bb8b5fd75c [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:36.019587  9860 consensus_queue.cc:1048] T fe20b4b48823486ca3b9c648db6ce8aa P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:19:36.021142  6876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90d42e216d9741e190bca19a781291fd" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:19:36.051999  6876 raft_consensus.cc:2468] T 90d42e216d9741e190bca19a781291fd P cd75a17ab2604397adab03bb8b5fd75c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 7.
W20260709 13:19:36.052341  6770 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 49891.8us
I20260709 13:19:35.967054  9851 raft_consensus.cc:740] T ab432e62819d499eaaf3dd55481dd930 P b7ab4784c7344b939bc36f639286f377 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
I20260709 13:19:35.998582  6727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20f6842e26174571996b8dea4151d4be" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:19:36.026181  6726 raft_consensus.cc:1240] T f09c2a98de1a4decabd0ff900dd44caa P ccd8a4c3bfe3413cb2ae219b09aea832 [term 9 FOLLOWER]: Rejecting Update request from peer cd75a17ab2604397adab03bb8b5fd75c for earlier term 8. Current term is 9. Ops: []
I20260709 13:19:35.978304  9861 raft_consensus.cc:3060] T 853ac0a8cbd64ce99457f170216d4d0f P ccd8a4c3bfe3413cb2ae219b09aea832 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:36.038808  6728 raft_consensus.cc:1240] T 4d9def8b32fd443aa94ab1420b06837b P ccd8a4c3bfe3413cb2ae219b09aea832 [term 8 FOLLOWER]: Rejecting Update request from peer b7ab4784c7344b939bc36f639286f377 for earlier term 7. Current term is 8. Ops: []
I20260709 13:19:36.057570  6730 raft_consensus.cc:1240] T 9e326172347f45e99a0d482b5d8ef768 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 7 FOLLOWER]: Rejecting Update request from peer cd75a17ab2604397adab03bb8b5fd75c for earlier term 6. Current term is 7. Ops: []
W20260709 13:19:36.039222  6697 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 81026.4us
I20260709 13:19:36.058409  6726 raft_consensus.cc:1240] T 3a485a995abc4807b6e511e45419f737 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 7 LEADER]: Rejecting Update request from peer cd75a17ab2604397adab03bb8b5fd75c for earlier term 6. Current term is 7. Ops: [6.5-6.5]
I20260709 13:19:36.060648  6727 raft_consensus.cc:2410] T 20f6842e26174571996b8dea4151d4be P ccd8a4c3bfe3413cb2ae219b09aea832 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c for term 9 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 13:19:36.061314  6770 leader_election.cc:304] T 90d42e216d9741e190bca19a781291fd P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:19:36.060638  6697 leader_election.cc:304] T ab432e62819d499eaaf3dd55481dd930 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:19:36.050642  7496 raft_consensus.cc:2468] T 4f00a2e87e56452083b759f60d461ee3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 8.
I20260709 13:19:36.053227  6772 leader_election.cc:304] T 8c7f33e544204fbaac4078e3e83bbf4e P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:19:36.063614  9851 consensus_queue.cc:260] T ab432e62819d499eaaf3dd55481dd930 P b7ab4784c7344b939bc36f639286f377 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:36.064975  9851 raft_consensus.cc:3060] T ab432e62819d499eaaf3dd55481dd930 P b7ab4784c7344b939bc36f639286f377 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:36.065197  6772 leader_election.cc:304] T e31b9971c15848dea59d4d4130141d9e P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:19:36.066533  6772 leader_election.cc:304] T 9e326172347f45e99a0d482b5d8ef768 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:19:36.067469  9643 raft_consensus.cc:2749] T 8c7f33e544204fbaac4078e3e83bbf4e P b7ab4784c7344b939bc36f639286f377 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:19:36.067677  9711 raft_consensus.cc:2804] T e31b9971c15848dea59d4d4130141d9e P b7ab4784c7344b939bc36f639286f377 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:19:36.068238  9711 raft_consensus.cc:493] T e31b9971c15848dea59d4d4130141d9e P b7ab4784c7344b939bc36f639286f377 [term 5 FOLLOWER]: Starting leader election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:19:36.068353  9643 raft_consensus.cc:2749] T 9e326172347f45e99a0d482b5d8ef768 P b7ab4784c7344b939bc36f639286f377 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:19:36.055630  6731 raft_consensus.cc:1275] T 7a734b5ab7834e05a8c422208acc58b1 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 8 FOLLOWER]: Refusing update from remote peer cd75a17ab2604397adab03bb8b5fd75c: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 4. (term mismatch)
I20260709 13:19:36.039170  9780 raft_consensus.cc:2804] T f03d0dbf16864ca4bc1bb5e4c0334c0f P ccd8a4c3bfe3413cb2ae219b09aea832 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:19:36.032665  9836 raft_consensus.cc:3060] T d33d5ee8ef6f415593d8df52063161ad P b7ab4784c7344b939bc36f639286f377 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:36.068715  9711 raft_consensus.cc:3060] T e31b9971c15848dea59d4d4130141d9e P b7ab4784c7344b939bc36f639286f377 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:36.070760  6772 leader_election.cc:304] T 713b5728a197487c9300b310ab94e5a3 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:19:36.102478  6880 raft_consensus.cc:2468] T 24ee15416e3145beaa1b8183453729a3 P cd75a17ab2604397adab03bb8b5fd75c [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 8.
I20260709 13:19:36.103726  6880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7887766dc6784fcaa42b35c05fea7a99" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:19:36.007477  7498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24ee15416e3145beaa1b8183453729a3" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:19:36.073451  6846 leader_election.cc:304] T 4f00a2e87e56452083b759f60d461ee3 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:19:36.081207  6697 leader_election.cc:304] T f5be3a11b23d4ea9b08300a2789821c7 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:19:36.082206  6876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a734b5ab7834e05a8c422208acc58b1" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:19:36.073410  6723 raft_consensus.cc:1240] T f4b8bd455d5a47c18a1380839c6e0d61 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 7 FOLLOWER]: Rejecting Update request from peer cd75a17ab2604397adab03bb8b5fd75c for earlier term 6. Current term is 7. Ops: []
I20260709 13:19:36.072649  6877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6869f07b5a4885a0b99fbe60c3b175" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 9 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:19:36.072270  6731 pending_rounds.cc:85] T 7a734b5ab7834e05a8c422208acc58b1 P ccd8a4c3bfe3413cb2ae219b09aea832: Aborting all ops after (but not including) 3
I20260709 13:19:36.090255  6872 raft_consensus.cc:2468] T 7c37d41cd9164c15a6826ca62a851a69 P cd75a17ab2604397adab03bb8b5fd75c [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 7.
I20260709 13:19:36.090880  9720 leader_election.cc:290] T e31b9971c15848dea59d4d4130141d9e P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 6 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:19:36.092013  9663 raft_consensus.cc:2804] T 90d42e216d9741e190bca19a781291fd P b7ab4784c7344b939bc36f639286f377 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:19:36.138293  9663 raft_consensus.cc:697] T 90d42e216d9741e190bca19a781291fd P b7ab4784c7344b939bc36f639286f377 [term 8 LEADER]: Becoming Leader. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
I20260709 13:19:36.139307  9663 consensus_queue.cc:237] T 90d42e216d9741e190bca19a781291fd P b7ab4784c7344b939bc36f639286f377 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:36.072050  9880 raft_consensus.cc:2749] T 711ef6523deb4cbe8ef2ba61e1c21c98 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:19:36.099928  6728 raft_consensus.cc:1240] T 34f36d59d88f40fe8a2805e604fc6c0a P ccd8a4c3bfe3413cb2ae219b09aea832 [term 6 FOLLOWER]: Rejecting Update request from peer cd75a17ab2604397adab03bb8b5fd75c for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 13:19:36.081437  9775 raft_consensus.cc:3060] T f5be3a11b23d4ea9b08300a2789821c7 P b7ab4784c7344b939bc36f639286f377 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:36.114259  6726 raft_consensus.cc:1240] T 22ccee1b570c4ad3a57bd7aec085b1b4 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 7 FOLLOWER]: Rejecting Update request from peer b7ab4784c7344b939bc36f639286f377 for earlier term 6. Current term is 7. Ops: [6.5-6.5]
I20260709 13:19:36.051923  9856 raft_consensus.cc:697] T f58dc08b12a2494bb9a1372837970ca2 P b7ab4784c7344b939bc36f639286f377 [term 10 LEADER]: Becoming Leader. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
W20260709 13:19:36.135022  6772 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 64335.1us
I20260709 13:19:36.086135  9780 raft_consensus.cc:493] T f03d0dbf16864ca4bc1bb5e4c0334c0f P ccd8a4c3bfe3413cb2ae219b09aea832 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:36.106626  6844 leader_election.cc:400] T 7887766dc6784fcaa42b35c05fea7a99 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 7 pre-election: Vote denied by peer b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817) with higher term. Message: Invalid argument: T 7887766dc6784fcaa42b35c05fea7a99 P b7ab4784c7344b939bc36f639286f377 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c for earlier term 7. Current term is 8.
I20260709 13:19:36.193799  6844 leader_election.cc:403] T 7887766dc6784fcaa42b35c05fea7a99 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 7 pre-election: Cancelling election due to peer responding with higher term
W20260709 13:19:36.117280  6695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 272527us
I20260709 13:19:36.144106  6731 pending_rounds.cc:107] T 7a734b5ab7834e05a8c422208acc58b1 P ccd8a4c3bfe3413cb2ae219b09aea832: Aborting uncommitted NO_OP operation due to leader change: 7.4
I20260709 13:19:36.080682  9875 raft_consensus.cc:2749] T ab432e62819d499eaaf3dd55481dd930 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:19:36.118228  6880 raft_consensus.cc:2468] T 7887766dc6784fcaa42b35c05fea7a99 P cd75a17ab2604397adab03bb8b5fd75c [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 8.
I20260709 13:19:36.119179  6881 raft_consensus.cc:1240] T e31b9971c15848dea59d4d4130141d9e P cd75a17ab2604397adab03bb8b5fd75c [term 6 FOLLOWER]: Rejecting Update request from peer ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 5. Current term is 6. Ops: []
I20260709 13:19:36.178821  6723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a75bfe094d4bdc963aba3f08dfcd25" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 10 candidate_status { last_received { term: 8 index: 3 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
W20260709 13:19:36.180761  6697 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 99660.4us
I20260709 13:19:36.136031  6727 raft_consensus.cc:1240] T f5be3a11b23d4ea9b08300a2789821c7 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 6 FOLLOWER]: Rejecting Update request from peer b7ab4784c7344b939bc36f639286f377 for earlier term 5. Current term is 6. Ops: []
I20260709 13:19:36.181387  6877 raft_consensus.cc:2468] T bd6869f07b5a4885a0b99fbe60c3b175 P cd75a17ab2604397adab03bb8b5fd75c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 7.
I20260709 13:19:36.181759  6879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d65025eea89441290d85dd053810e31" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:19:36.137508  9450 raft_consensus.cc:493] T 853ac0a8cbd64ce99457f170216d4d0f P b7ab4784c7344b939bc36f639286f377 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:36.194602  6731 raft_consensus.cc:2889] T 7a734b5ab7834e05a8c422208acc58b1 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:19:36.199574  6697 leader_election.cc:304] T 8c7f33e544204fbaac4078e3e83bbf4e P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:19:36.039655  9785 raft_consensus.cc:515] T 30e88460611e47b2ba16a46a30b5f416 P b7ab4784c7344b939bc36f639286f377 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:36.212929  6723 raft_consensus.cc:2468] T 95a75bfe094d4bdc963aba3f08dfcd25 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 9.
I20260709 13:19:36.203934  6697 leader_election.cc:304] T de3186201e1a40d0b335eeb8b4e256e0 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:19:36.208822  6879 raft_consensus.cc:2393] T 3d65025eea89441290d85dd053810e31 P cd75a17ab2604397adab03bb8b5fd75c [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ccd8a4c3bfe3413cb2ae219b09aea832 in current term 7: Already voted for candidate cd75a17ab2604397adab03bb8b5fd75c in this term.
I20260709 13:19:36.209082  6726 raft_consensus.cc:1275] T 20f6842e26174571996b8dea4151d4be P ccd8a4c3bfe3413cb2ae219b09aea832 [term 8 FOLLOWER]: Refusing update from remote peer b7ab4784c7344b939bc36f639286f377: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:19:36.210078  6728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a485a995abc4807b6e511e45419f737" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 8 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:19:36.194697  6695 leader_election.cc:304] T 2c240553ce044eedb41541d72b9475d7 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
I20260709 13:19:36.116156  9643 raft_consensus.cc:493] T 404190ce4ce94cecbfcb6ea9d1dd8626 P b7ab4784c7344b939bc36f639286f377 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 7ba59cc884714e8aa5f3f0ecaed84cbb)
I20260709 13:19:36.188494  9715 raft_consensus.cc:2804] T 713b5728a197487c9300b310ab94e5a3 P b7ab4784c7344b939bc36f639286f377 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 13:19:36.243417  6695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 48832us
I20260709 13:19:36.199868  9780 raft_consensus.cc:3060] T f03d0dbf16864ca4bc1bb5e4c0334c0f P ccd8a4c3bfe3413cb2ae219b09aea832 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:36.230707  9881 raft_consensus.cc:2804] T 4f00a2e87e56452083b759f60d461ee3 P cd75a17ab2604397adab03bb8b5fd75c [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:19:36.236215  6731 raft_consensus.cc:1240] T d33d5ee8ef6f415593d8df52063161ad P ccd8a4c3bfe3413cb2ae219b09aea832 [term 9 FOLLOWER]: Rejecting Update request from peer b7ab4784c7344b939bc36f639286f377 for earlier term 8. Current term is 9. Ops: []
I20260709 13:19:36.253348  6732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1528ab62b6fe4e3099d08f141afee116" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:19:36.208360  7498 raft_consensus.cc:2393] T 24ee15416e3145beaa1b8183453729a3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c in current term 8: Already voted for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in this term.
I20260709 13:19:36.208451  9880 raft_consensus.cc:493] T 22ccee1b570c4ad3a57bd7aec085b1b4 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:36.231539  9852 consensus_queue.cc:1048] T 7ba5dac66ab5497e9e336f2a3c28cda5 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:19:36.215276  6729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c44c4849aa54f2b94d1f1bef9ed546f" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:19:36.241302  6872 raft_consensus.cc:1275] T 30e88460611e47b2ba16a46a30b5f416 P cd75a17ab2604397adab03bb8b5fd75c [term 7 FOLLOWER]: Refusing update from remote peer ccd8a4c3bfe3413cb2ae219b09aea832: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:19:36.133386  9863 leader_election.cc:290] T b56bf91d90824c959e21e0cee5ba1816 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:36.215739  9862 consensus_queue.cc:1059] T 4f00a2e87e56452083b759f60d461ee3 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.016s
I20260709 13:19:36.244292  6727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce4f062dcd314d43a63ca74067cb5ee3" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:19:36.248535  6695 leader_election.cc:304] T 4d9def8b32fd443aa94ab1420b06837b P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:19:36.214587  9687 raft_consensus.cc:2804] T 8c7f33e544204fbaac4078e3e83bbf4e P ccd8a4c3bfe3413cb2ae219b09aea832 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:19:36.232568  9805 raft_consensus.cc:493] T 4275cf08e63345f993bce8664eada830 P b7ab4784c7344b939bc36f639286f377 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:19:36.264706  6805 raft_consensus.cc:1275] T 30e88460611e47b2ba16a46a30b5f416 P b7ab4784c7344b939bc36f639286f377 [term 7 FOLLOWER]: Refusing update from remote peer ccd8a4c3bfe3413cb2ae219b09aea832: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 4. (term mismatch)
I20260709 13:19:36.266803  6874 raft_consensus.cc:3055] T 3a485a995abc4807b6e511e45419f737 P cd75a17ab2604397adab03bb8b5fd75c [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:19:36.271549  6874 raft_consensus.cc:740] T 3a485a995abc4807b6e511e45419f737 P cd75a17ab2604397adab03bb8b5fd75c [term 6 LEADER]: Becoming Follower/Learner. State: Replica: cd75a17ab2604397adab03bb8b5fd75c, State: Running, Role: LEADER
I20260709 13:19:36.272143  7466 leader_election.cc:304] T d8cee0accdb8499c86d4414b72565a38 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, b7ab4784c7344b939bc36f639286f377; no voters: 
W20260709 13:19:36.269676  6773 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:36.247515  9875 raft_consensus.cc:2804] T de3186201e1a40d0b335eeb8b4e256e0 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:19:36.270872  6805 pending_rounds.cc:85] T 30e88460611e47b2ba16a46a30b5f416 P b7ab4784c7344b939bc36f639286f377: Aborting all ops after (but not including) 3
I20260709 13:19:36.280328  6805 pending_rounds.cc:107] T 30e88460611e47b2ba16a46a30b5f416 P b7ab4784c7344b939bc36f639286f377: Aborting uncommitted NO_OP operation due to leader change: 6.4
I20260709 13:19:36.280654  6805 raft_consensus.cc:2889] T 30e88460611e47b2ba16a46a30b5f416 P b7ab4784c7344b939bc36f639286f377 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:19:36.211524  9860 consensus_queue.cc:1048] T 7c44c4849aa54f2b94d1f1bef9ed546f P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.050s
I20260709 13:19:36.285537  6877 raft_consensus.cc:1275] T 3fa34c08b205435dba97346991aa1f92 P cd75a17ab2604397adab03bb8b5fd75c [term 10 FOLLOWER]: Refusing update from remote peer ccd8a4c3bfe3413cb2ae219b09aea832: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:19:36.247941  9715 raft_consensus.cc:493] T 713b5728a197487c9300b310ab94e5a3 P b7ab4784c7344b939bc36f639286f377 [term 8 FOLLOWER]: Starting leader election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:19:36.291658  7496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24ee15416e3145beaa1b8183453729a3" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:19:36.292374  7496 raft_consensus.cc:1813] T 24ee15416e3145beaa1b8183453729a3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 8 FOLLOWER]: Handling vote request from an unknown peer b7ab4784c7344b939bc36f639286f377
I20260709 13:19:36.292861  7496 raft_consensus.cc:2368] T 24ee15416e3145beaa1b8183453729a3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7ab4784c7344b939bc36f639286f377 for earlier term 7. Current term is 8.
I20260709 13:19:36.284277  7466 leader_election.cc:304] T 1528ab62b6fe4e3099d08f141afee116 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:19:36.298024  6728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6869f07b5a4885a0b99fbe60c3b175" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 9 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:19:36.305672  6728 raft_consensus.cc:2410] T bd6869f07b5a4885a0b99fbe60c3b175 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7ab4784c7344b939bc36f639286f377 for term 9 because replica has last-logged OpId of term: 7 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 2.
I20260709 13:19:36.279506  6874 consensus_queue.cc:260] T 3a485a995abc4807b6e511e45419f737 P cd75a17ab2604397adab03bb8b5fd75c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:36.240391  9450 raft_consensus.cc:515] T 853ac0a8cbd64ce99457f170216d4d0f P b7ab4784c7344b939bc36f639286f377 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:36.268962  9687 raft_consensus.cc:493] T 8c7f33e544204fbaac4078e3e83bbf4e P ccd8a4c3bfe3413cb2ae219b09aea832 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:36.317744  7466 leader_election.cc:304] T ce4f062dcd314d43a63ca74067cb5ee3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:19:36.317801  6874 raft_consensus.cc:3060] T 3a485a995abc4807b6e511e45419f737 P cd75a17ab2604397adab03bb8b5fd75c [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:36.279201  9545 raft_consensus.cc:493] T 17587d6730594da4a56fa13a353232a1 P b7ab4784c7344b939bc36f639286f377 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:36.279690  9875 raft_consensus.cc:493] T de3186201e1a40d0b335eeb8b4e256e0 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:19:36.322512  6695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 74052us
I20260709 13:19:36.277372  9729 leader_election.cc:290] T d33d5ee8ef6f415593d8df52063161ad P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:36.260519  9832 consensus_queue.cc:1059] T 3d65025eea89441290d85dd053810e31 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: INVALID_TERM, Last received: 6.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.054s
I20260709 13:19:36.288480  9853 raft_consensus.cc:2804] T d8cee0accdb8499c86d4414b72565a38 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:19:36.324905  6772 leader_election.cc:400] T 24ee15416e3145beaa1b8183453729a3 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 7 pre-election: Vote denied by peer 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071) with higher term. Message: Invalid argument: T 24ee15416e3145beaa1b8183453729a3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7ab4784c7344b939bc36f639286f377 for earlier term 7. Current term is 8.
I20260709 13:19:36.355279  6772 leader_election.cc:403] T 24ee15416e3145beaa1b8183453729a3 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 7 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:19:36.257805  9643 raft_consensus.cc:515] T 404190ce4ce94cecbfcb6ea9d1dd8626 P b7ab4784c7344b939bc36f639286f377 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:19:36.293560  9772 leader_election.cc:290] T 404190ce4ce94cecbfcb6ea9d1dd8626 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:19:36.294567  9873 raft_consensus.cc:2804] T 2c240553ce044eedb41541d72b9475d7 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:19:36.294062  9715 raft_consensus.cc:3060] T 713b5728a197487c9300b310ab94e5a3 P b7ab4784c7344b939bc36f639286f377 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:19:36.357838  6771 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:36.361356  6798 raft_consensus.cc:2468] T 4d9def8b32fd443aa94ab1420b06837b P b7ab4784c7344b939bc36f639286f377 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 8.
W20260709 13:19:36.323355  9883 log.cc:927] Time spent T 00000000000000000000000000000000 P b3ae52d33b9a4273a42e5e2cf3b5d6b5: Append to log took a long time: real 0.059s	user 0.001s	sys 0.000s
W20260709 13:19:36.379230  6771 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:36.321300  9758 raft_consensus.cc:2749] T 1528ab62b6fe4e3099d08f141afee116 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:19:36.317356  9687 raft_consensus.cc:3060] T 8c7f33e544204fbaac4078e3e83bbf4e P ccd8a4c3bfe3413cb2ae219b09aea832 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:36.283847  9805 raft_consensus.cc:515] T 4275cf08e63345f993bce8664eada830 P b7ab4784c7344b939bc36f639286f377 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:36.271116  9880 raft_consensus.cc:515] T 22ccee1b570c4ad3a57bd7aec085b1b4 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:36.353806  9853 raft_consensus.cc:493] T d8cee0accdb8499c86d4414b72565a38 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:36.326038  9875 raft_consensus.cc:3060] T de3186201e1a40d0b335eeb8b4e256e0 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:19:36.405619  9878 log.cc:927] Time spent T fe20b4b48823486ca3b9c648db6ce8aa P 7ba59cc884714e8aa5f3f0ecaed84cbb: Append to log took a long time: real 0.203s	user 0.001s	sys 0.000s
I20260709 13:19:36.405972  7495 raft_consensus.cc:1275] T 7ba5dac66ab5497e9e336f2a3c28cda5 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 10 FOLLOWER]: Refusing update from remote peer b7ab4784c7344b939bc36f639286f377: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
W20260709 13:19:36.414052  6697 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 174770us
I20260709 13:19:36.475373  9780 raft_consensus.cc:515] T f03d0dbf16864ca4bc1bb5e4c0334c0f P ccd8a4c3bfe3413cb2ae219b09aea832 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:36.476375  6697 leader_election.cc:304] T f3f9c2e2bf644115957398fe4c9459db P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:19:36.415606  6726 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ce4f062dcd314d43a63ca74067cb5ee3"
dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:49996
I20260709 13:19:36.477737  9780 leader_election.cc:290] T f03d0dbf16864ca4bc1bb5e4c0334c0f P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 7 election: Requested vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:36.478487  9780 raft_consensus.cc:2804] T f3f9c2e2bf644115957398fe4c9459db P ccd8a4c3bfe3413cb2ae219b09aea832 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:19:36.478401  9729 consensus_queue.cc:1048] T 4275cf08e63345f993bce8664eada830 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:19:36.479209  9780 raft_consensus.cc:493] T f3f9c2e2bf644115957398fe4c9459db P ccd8a4c3bfe3413cb2ae219b09aea832 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:36.479645  9780 raft_consensus.cc:3060] T f3f9c2e2bf644115957398fe4c9459db P ccd8a4c3bfe3413cb2ae219b09aea832 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:36.483090  6697 leader_election.cc:304] T 20f6842e26174571996b8dea4151d4be P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:19:36.364229  9873 raft_consensus.cc:493] T 2c240553ce044eedb41541d72b9475d7 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:36.484280  9873 raft_consensus.cc:3060] T 2c240553ce044eedb41541d72b9475d7 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:36.356639  9862 raft_consensus.cc:493] T 427c124d773f483294511e80fe340075 P b7ab4784c7344b939bc36f639286f377 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:36.488443  9862 raft_consensus.cc:515] T 427c124d773f483294511e80fe340075 P b7ab4784c7344b939bc36f639286f377 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } attrs { replace: true } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:19:36.383733  9657 leader_election.cc:290] T dbdf895bba214ff68685a24fd17dfb5d P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:36.419085  9450 leader_election.cc:290] T 853ac0a8cbd64ce99457f170216d4d0f P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:36.492736  9657 consensus_queue.cc:1048] T a3022224cc81473690653a83d4e99470 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:19:36.494566  9657 raft_consensus.cc:2804] T 20f6842e26174571996b8dea4151d4be P ccd8a4c3bfe3413cb2ae219b09aea832 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:19:36.495064  9657 raft_consensus.cc:493] T 20f6842e26174571996b8dea4151d4be P ccd8a4c3bfe3413cb2ae219b09aea832 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:36.495409  9657 raft_consensus.cc:3060] T 20f6842e26174571996b8dea4151d4be P ccd8a4c3bfe3413cb2ae219b09aea832 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:36.500609  9785 leader_election.cc:290] T 30e88460611e47b2ba16a46a30b5f416 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:36.501286  9862 leader_election.cc:290] T 427c124d773f483294511e80fe340075 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:19:36.420737  9864 raft_consensus.cc:3055] T 711ef6523deb4cbe8ef2ba61e1c21c98 P b7ab4784c7344b939bc36f639286f377 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:19:36.502041  9864 raft_consensus.cc:740] T 711ef6523deb4cbe8ef2ba61e1c21c98 P b7ab4784c7344b939bc36f639286f377 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
I20260709 13:19:36.423682  6798 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:32966 (request call id 856) took 1216 ms. Trace:
I20260709 13:19:36.503391  6798 rpcz_store.cc:276] 0709 13:19:35.207250 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:35.228761 (+ 21511us) service_pool.cc:224] Handling call
0709 13:19:36.423479 (+1194718us) spinlock_profiling.cc:243] Waited 740 ms on lock 0x7b54002c79d4. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f9ae2fa 00007fcc1496fb17 00007fcc0deea6d4 00007fcc0deea662 00007fcc0deea591 00007fcc0deea50c 00007fcc0dee97c2 00007fcc0dce548c 00007fcc0dce48c6 00007fcc0dce426f
0709 13:19:36.423614 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1701451136}
W20260709 13:19:36.424198  6695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 99984us
I20260709 13:19:36.504663  6695 leader_election.cc:304] T ce4f062dcd314d43a63ca74067cb5ee3 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, b7ab4784c7344b939bc36f639286f377
I20260709 13:19:36.505378  6805 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:32976 (request call id 2376) took 2495 ms. Trace:
I20260709 13:19:36.506327  6695 leader_election.cc:304] T 3411566abe2d4c9bb4b2adfdd05e6f17 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:19:36.402122  9758 raft_consensus.cc:2749] T ce4f062dcd314d43a63ca74067cb5ee3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:19:36.382639  9888 raft_consensus.cc:2749] T 4d9def8b32fd443aa94ab1420b06837b P ccd8a4c3bfe3413cb2ae219b09aea832 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:19:36.430163  9882 log.cc:927] Time spent T 7c44c4849aa54f2b94d1f1bef9ed546f P ccd8a4c3bfe3413cb2ae219b09aea832: Append to log took a long time: real 0.155s	user 0.001s	sys 0.000s
W20260709 13:19:36.430907  9879 log.cc:927] Time spent T 404190ce4ce94cecbfcb6ea9d1dd8626 P ccd8a4c3bfe3413cb2ae219b09aea832: Append to log took a long time: real 0.181s	user 0.000s	sys 0.000s
W20260709 13:19:36.431973  9884 log.cc:927] Time spent T 1bf4668eeb70467fb3dc5a0289233b3c P cd75a17ab2604397adab03bb8b5fd75c: Append to log took a long time: real 0.067s	user 0.000s	sys 0.000s
I20260709 13:19:36.385901  9874 raft_consensus.cc:2749] T f5be3a11b23d4ea9b08300a2789821c7 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:19:36.426512  9832 raft_consensus.cc:3060] T 24ee15416e3145beaa1b8183453729a3 P b7ab4784c7344b939bc36f639286f377 [term 6 FOLLOWER]: Advancing to term 8
I20260709 13:19:36.437822  9880 leader_election.cc:290] T 22ccee1b570c4ad3a57bd7aec085b1b4 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
W20260709 13:19:36.539052  9653 consensus_meta.cc:287] T 4b8cacb381b746da8d0049b0a83b41dd P ccd8a4c3bfe3413cb2ae219b09aea832: Time spent flushing consensus metadata: real 0.595s	user 0.010s	sys 0.001s
W20260709 13:19:36.443277  9848 consensus_meta.cc:287] T 1bf4668eeb70467fb3dc5a0289233b3c P b7ab4784c7344b939bc36f639286f377: Time spent flushing consensus metadata: real 0.573s	user 0.008s	sys 0.001s
I20260709 13:19:36.389477  9772 consensus_queue.cc:1048] T 3a485a995abc4807b6e511e45419f737 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 2, Time since last communication: 0.055s
I20260709 13:19:36.381894  9720 raft_consensus.cc:2749] T 7887766dc6784fcaa42b35c05fea7a99 P cd75a17ab2604397adab03bb8b5fd75c [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: Vote denied by peer b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817) with higher term. Message: Invalid argument: T 7887766dc6784fcaa42b35c05fea7a99 P b7ab4784c7344b939bc36f639286f377 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c for earlier term 7. Current term is 8.
I20260709 13:19:36.450937  9852 raft_consensus.cc:493] T 7a734b5ab7834e05a8c422208acc58b1 P b7ab4784c7344b939bc36f639286f377 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:36.415518  9859 raft_consensus.cc:3055] T 17587d6730594da4a56fa13a353232a1 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:19:36.453426  9643 leader_election.cc:290] T 404190ce4ce94cecbfcb6ea9d1dd8626 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:19:36.372574  9856 consensus_queue.cc:237] T f58dc08b12a2494bb9a1372837970ca2 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 8.4, Last appended by leader: 4, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:36.393289  9881 raft_consensus.cc:697] T 4f00a2e87e56452083b759f60d461ee3 P cd75a17ab2604397adab03bb8b5fd75c [term 8 LEADER]: Becoming Leader. State: Replica: cd75a17ab2604397adab03bb8b5fd75c, State: Running, Role: LEADER
W20260709 13:19:36.582499  7466 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 264853us
W20260709 13:19:36.468106  9744 consensus_meta.cc:287] T a3022224cc81473690653a83d4e99470 P b7ab4784c7344b939bc36f639286f377: Time spent flushing consensus metadata: real 0.503s	user 0.007s	sys 0.004s
W20260709 13:19:36.468528  6770 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:36.587996  6770 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:36.470881  9711 raft_consensus.cc:515] T e31b9971c15848dea59d4d4130141d9e P b7ab4784c7344b939bc36f639286f377 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:36.505944  6805 rpcz_store.cc:276] 0709 13:19:34.010145 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:34.223693 (+213548us) service_pool.cc:224] Handling call
0709 13:19:34.224060 (+   367us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:36.319385 (+2095325us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:36.504957 (+185572us) spinlock_profiling.cc:243] Waited 2.03 s on lock 0x7b54001f5754. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f9aae01 00007fcc0f9a983e 00007fcc1496e419 00007fcc0dee5bd4 00007fcc0dee5b62 00007fcc0dee5a91 00007fcc0dee5a0c 00007fcc0dee4cc2 00007fcc0dce548c 00007fcc0dce48c6
0709 13:19:36.505243 (+   286us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4669352320}
I20260709 13:19:36.330613  9545 raft_consensus.cc:515] T 17587d6730594da4a56fa13a353232a1 P b7ab4784c7344b939bc36f639286f377 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:19:36.416934  9853 raft_consensus.cc:3060] T d8cee0accdb8499c86d4414b72565a38 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:36.571280  6726 raft_consensus.cc:606] T ce4f062dcd314d43a63ca74067cb5ee3 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 7 FOLLOWER]: Received request to transfer leadership
W20260709 13:19:36.575001  6772 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.68:45071, user_credentials={real_user=slave}} blocked reactor thread for 253934us
I20260709 13:19:36.576017  6874 raft_consensus.cc:1275] T 3a485a995abc4807b6e511e45419f737 P cd75a17ab2604397adab03bb8b5fd75c [term 7 FOLLOWER]: Refusing update from remote peer ccd8a4c3bfe3413cb2ae219b09aea832: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 5. (term mismatch)
I20260709 13:19:36.594877  6726 raft_consensus.cc:614] T ce4f062dcd314d43a63ca74067cb5ee3 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 7 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:19:36.466097  9805 leader_election.cc:290] T 4275cf08e63345f993bce8664eada830 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:36.584726  6728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b56bf91d90824c959e21e0cee5ba1816" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:19:36.574504  9859 raft_consensus.cc:740] T 17587d6730594da4a56fa13a353232a1 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
I20260709 13:19:36.577261  9880 raft_consensus.cc:2749] T 3411566abe2d4c9bb4b2adfdd05e6f17 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:19:36.590282  6725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "853ac0a8cbd64ce99457f170216d4d0f" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:19:36.595229  6874 pending_rounds.cc:85] T 3a485a995abc4807b6e511e45419f737 P cd75a17ab2604397adab03bb8b5fd75c: Aborting all ops after (but not including) 4
I20260709 13:19:36.600096  7503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "404190ce4ce94cecbfcb6ea9d1dd8626" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:19:36.603735  6874 pending_rounds.cc:107] T 3a485a995abc4807b6e511e45419f737 P cd75a17ab2604397adab03bb8b5fd75c: Aborting uncommitted NO_OP operation due to leader change: 6.5
I20260709 13:19:36.604418  6874 raft_consensus.cc:2889] T 3a485a995abc4807b6e511e45419f737 P cd75a17ab2604397adab03bb8b5fd75c [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:19:36.606583  6727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "404190ce4ce94cecbfcb6ea9d1dd8626" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:19:36.574606  9653 raft_consensus.cc:515] T 4b8cacb381b746da8d0049b0a83b41dd P ccd8a4c3bfe3413cb2ae219b09aea832 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:19:36.578063  9848 raft_consensus.cc:515] T 1bf4668eeb70467fb3dc5a0289233b3c P b7ab4784c7344b939bc36f639286f377 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:36.598218  9888 raft_consensus.cc:2749] T ce4f062dcd314d43a63ca74067cb5ee3 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:19:36.614655  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 541969us
I20260709 13:19:36.618027  6728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4275cf08e63345f993bce8664eada830" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:19:36.621515  6727 raft_consensus.cc:1240] T 711ef6523deb4cbe8ef2ba61e1c21c98 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 9 FOLLOWER]: Rejecting Update request from peer b7ab4784c7344b939bc36f639286f377 for earlier term 8. Current term is 9. Ops: [8.5-8.5]
I20260709 13:19:36.502983  9864 consensus_queue.cc:260] T 711ef6523deb4cbe8ef2ba61e1c21c98 P b7ab4784c7344b939bc36f639286f377 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
W20260709 13:19:36.628161  6772 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:36.611006  9643 consensus_queue.cc:1048] T 7ba5dac66ab5497e9e336f2a3c28cda5 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.026s
I20260709 13:19:36.636974  6844 leader_election.cc:304] T f58dc08b12a2494bb9a1372837970ca2 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:19:36.576910  9852 raft_consensus.cc:515] T 7a734b5ab7834e05a8c422208acc58b1 P b7ab4784c7344b939bc36f639286f377 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:36.591593  9744 raft_consensus.cc:515] T a3022224cc81473690653a83d4e99470 P b7ab4784c7344b939bc36f639286f377 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:36.649161  6727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30e88460611e47b2ba16a46a30b5f416" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:19:36.649381  6770 leader_election.cc:304] T d8292e16e5654be6bc408560cf256aaa P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
W20260709 13:19:36.652390  6697 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 169359us
I20260709 13:19:36.652968  6728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "427c124d773f483294511e80fe340075" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:19:36.654008  6697 leader_election.cc:304] T 9b3759de40694069b13c0f8bd40e5709 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
W20260709 13:19:36.665242  9627 consensus_meta.cc:287] T de3186201e1a40d0b335eeb8b4e256e0 P cd75a17ab2604397adab03bb8b5fd75c: Time spent flushing consensus metadata: real 0.612s	user 0.013s	sys 0.000s
I20260709 13:19:36.665594  9715 raft_consensus.cc:515] T 713b5728a197487c9300b310ab94e5a3 P b7ab4784c7344b939bc36f639286f377 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:36.639977  7495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "427c124d773f483294511e80fe340075" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:19:36.669442  9859 consensus_queue.cc:260] T 17587d6730594da4a56fa13a353232a1 P ccd8a4c3bfe3413cb2ae219b09aea832 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:19:36.670442  7495 raft_consensus.cc:2468] T 427c124d773f483294511e80fe340075 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 6.
I20260709 13:19:36.670961  9859 raft_consensus.cc:3060] T 17587d6730594da4a56fa13a353232a1 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:36.673771  9848 leader_election.cc:290] T 1bf4668eeb70467fb3dc5a0289233b3c P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 8 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:36.679616  9805 raft_consensus.cc:493] T f03d0dbf16864ca4bc1bb5e4c0334c0f P b7ab4784c7344b939bc36f639286f377 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:36.655018  9864 raft_consensus.cc:3060] T 711ef6523deb4cbe8ef2ba61e1c21c98 P b7ab4784c7344b939bc36f639286f377 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:36.680267  9805 raft_consensus.cc:515] T f03d0dbf16864ca4bc1bb5e4c0334c0f P b7ab4784c7344b939bc36f639286f377 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:36.681491  9775 raft_consensus.cc:493] T 22ccee1b570c4ad3a57bd7aec085b1b4 P b7ab4784c7344b939bc36f639286f377 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:36.682137  9775 raft_consensus.cc:515] T 22ccee1b570c4ad3a57bd7aec085b1b4 P b7ab4784c7344b939bc36f639286f377 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:36.683740  9744 leader_election.cc:290] T a3022224cc81473690653a83d4e99470 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 9 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:36.646917  9809 raft_consensus.cc:2764] T f58dc08b12a2494bb9a1372837970ca2 P cd75a17ab2604397adab03bb8b5fd75c [term 10 FOLLOWER]: Leader election decision vote started in defunct term 9: won
I20260709 13:19:36.685118  6770 leader_election.cc:304] T 95a75bfe094d4bdc963aba3f08dfcd25 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
I20260709 13:19:36.685402  9545 leader_election.cc:290] T 17587d6730594da4a56fa13a353232a1 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:19:36.666745  9881 consensus_queue.cc:237] T 4f00a2e87e56452083b759f60d461ee3 P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:19:36.688226  9450 raft_consensus.cc:2804] T 95a75bfe094d4bdc963aba3f08dfcd25 P b7ab4784c7344b939bc36f639286f377 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:19:36.688318  9836 consensus_queue.cc:1048] T 20f6842e26174571996b8dea4151d4be P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:19:36.688700  9450 raft_consensus.cc:493] T 95a75bfe094d4bdc963aba3f08dfcd25 P b7ab4784c7344b939bc36f639286f377 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:36.689034  9836 consensus_queue.cc:1243] T 20f6842e26174571996b8dea4151d4be P b7ab4784c7344b939bc36f639286f377 [LEADER]: Peer ccd8a4c3bfe3413cb2ae219b09aea832 log is divergent from this leader: its last log entry 7.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 13:19:36.689112  9450 raft_consensus.cc:3060] T 95a75bfe094d4bdc963aba3f08dfcd25 P b7ab4784c7344b939bc36f639286f377 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:19:36.689258  6773 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:36.690708  9774 raft_consensus.cc:3055] T 3d65025eea89441290d85dd053810e31 P b7ab4784c7344b939bc36f639286f377 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:19:36.691039  9711 leader_election.cc:290] T e31b9971c15848dea59d4d4130141d9e P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 6 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:36.692015  9772 raft_consensus.cc:2804] T 9b3759de40694069b13c0f8bd40e5709 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:19:36.655404  9862 raft_consensus.cc:2804] T d8292e16e5654be6bc408560cf256aaa P b7ab4784c7344b939bc36f639286f377 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:19:36.692471  9772 raft_consensus.cc:493] T 9b3759de40694069b13c0f8bd40e5709 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:36.692817  9862 raft_consensus.cc:697] T d8292e16e5654be6bc408560cf256aaa P b7ab4784c7344b939bc36f639286f377 [term 10 LEADER]: Becoming Leader. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
I20260709 13:19:36.693034  9772 raft_consensus.cc:3060] T 9b3759de40694069b13c0f8bd40e5709 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:36.694274  7498 raft_consensus.cc:1240] T 4f00a2e87e56452083b759f60d461ee3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 8 FOLLOWER]: Rejecting Update request from peer b7ab4784c7344b939bc36f639286f377 for earlier term 7. Current term is 8. Ops: []
I20260709 13:19:36.693902  9862 consensus_queue.cc:237] T d8292e16e5654be6bc408560cf256aaa P b7ab4784c7344b939bc36f639286f377 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
W20260709 13:19:36.698145  9849 consensus_meta.cc:287] T a1704639a875409b9959353527b3fd68 P b7ab4784c7344b939bc36f639286f377: Time spent flushing consensus metadata: real 0.619s	user 0.012s	sys 0.000s
I20260709 13:19:36.698419  9863 raft_consensus.cc:3055] T 4f00a2e87e56452083b759f60d461ee3 P b7ab4784c7344b939bc36f639286f377 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:19:36.698912  9863 raft_consensus.cc:740] T 4f00a2e87e56452083b759f60d461ee3 P b7ab4784c7344b939bc36f639286f377 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
I20260709 13:19:36.698683  9849 raft_consensus.cc:515] T a1704639a875409b9959353527b3fd68 P b7ab4784c7344b939bc36f639286f377 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:36.699888  9863 consensus_queue.cc:260] T 4f00a2e87e56452083b759f60d461ee3 P b7ab4784c7344b939bc36f639286f377 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:19:36.700995  9863 raft_consensus.cc:3060] T 4f00a2e87e56452083b759f60d461ee3 P b7ab4784c7344b939bc36f639286f377 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:19:36.704699  6847 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:36.691145  9774 raft_consensus.cc:740] T 3d65025eea89441290d85dd053810e31 P b7ab4784c7344b939bc36f639286f377 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
I20260709 13:19:36.706077  9774 consensus_queue.cc:260] T 3d65025eea89441290d85dd053810e31 P b7ab4784c7344b939bc36f639286f377 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:36.707438  9774 raft_consensus.cc:3060] T 3d65025eea89441290d85dd053810e31 P b7ab4784c7344b939bc36f639286f377 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:36.708336  9627 raft_consensus.cc:2749] T de3186201e1a40d0b335eeb8b4e256e0 P cd75a17ab2604397adab03bb8b5fd75c [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:19:36.705235  6847 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:36.717978  6847 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:36.720258  6876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24ee15416e3145beaa1b8183453729a3" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:19:36.721174  6876 raft_consensus.cc:1813] T 24ee15416e3145beaa1b8183453729a3 P cd75a17ab2604397adab03bb8b5fd75c [term 8 FOLLOWER]: Handling vote request from an unknown peer b7ab4784c7344b939bc36f639286f377
I20260709 13:19:36.721752  6876 raft_consensus.cc:2368] T 24ee15416e3145beaa1b8183453729a3 P cd75a17ab2604397adab03bb8b5fd75c [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7ab4784c7344b939bc36f639286f377 for earlier term 7. Current term is 8.
I20260709 13:19:36.729413  7498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17587d6730594da4a56fa13a353232a1" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:19:36.730199  7498 raft_consensus.cc:2468] T 17587d6730594da4a56fa13a353232a1 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 10.
I20260709 13:19:36.733530  9687 raft_consensus.cc:515] T 8c7f33e544204fbaac4078e3e83bbf4e P ccd8a4c3bfe3413cb2ae219b09aea832 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:36.738286  6770 leader_election.cc:304] T 404190ce4ce94cecbfcb6ea9d1dd8626 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:19:36.724188  6697 leader_election.cc:304] T 90d42e216d9741e190bca19a781291fd P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:19:36.746528  9874 raft_consensus.cc:2804] T 90d42e216d9741e190bca19a781291fd P ccd8a4c3bfe3413cb2ae219b09aea832 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:19:36.746996  9874 raft_consensus.cc:493] T 90d42e216d9741e190bca19a781291fd P ccd8a4c3bfe3413cb2ae219b09aea832 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:36.747339  9874 raft_consensus.cc:3060] T 90d42e216d9741e190bca19a781291fd P ccd8a4c3bfe3413cb2ae219b09aea832 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:36.749339  6772 leader_election.cc:304] T 17587d6730594da4a56fa13a353232a1 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, b7ab4784c7344b939bc36f639286f377; no voters: 
I20260709 13:19:36.752629  6876 raft_consensus.cc:1240] T dbdf895bba214ff68685a24fd17dfb5d P cd75a17ab2604397adab03bb8b5fd75c [term 7 FOLLOWER]: Rejecting Update request from peer b7ab4784c7344b939bc36f639286f377 for earlier term 6. Current term is 7. Ops: []
I20260709 13:19:36.754770  6880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8292e16e5654be6bc408560cf256aaa" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:19:36.755468  6880 raft_consensus.cc:3060] T d8292e16e5654be6bc408560cf256aaa P cd75a17ab2604397adab03bb8b5fd75c [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:36.759093  9836 raft_consensus.cc:2749] T 404190ce4ce94cecbfcb6ea9d1dd8626 P b7ab4784c7344b939bc36f639286f377 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:19:36.765698  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 81286.4us
I20260709 13:19:36.766477  9657 raft_consensus.cc:515] T 20f6842e26174571996b8dea4151d4be P ccd8a4c3bfe3413cb2ae219b09aea832 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:36.768045  9805 leader_election.cc:290] T f03d0dbf16864ca4bc1bb5e4c0334c0f P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:36.772310  9775 leader_election.cc:290] T 22ccee1b570c4ad3a57bd7aec085b1b4 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:36.774046  9852 leader_election.cc:290] T 7a734b5ab7834e05a8c422208acc58b1 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:36.774892  9715 leader_election.cc:290] T 713b5728a197487c9300b310ab94e5a3 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 9 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:36.749670  6697 leader_election.cc:304] T 7c37d41cd9164c15a6826ca62a851a69 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:19:36.777406  9780 raft_consensus.cc:515] T f3f9c2e2bf644115957398fe4c9459db P ccd8a4c3bfe3413cb2ae219b09aea832 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:36.778124  9875 raft_consensus.cc:515] T de3186201e1a40d0b335eeb8b4e256e0 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:36.779650  9780 leader_election.cc:290] T f3f9c2e2bf644115957398fe4c9459db P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 8 election: Requested vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:36.783268  6876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a92dd554674067a83a9cb68c4773f2" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 9 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:19:36.784729  9880 raft_consensus.cc:2804] T 7c37d41cd9164c15a6826ca62a851a69 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:19:36.785125  9849 leader_election.cc:290] T a1704639a875409b9959353527b3fd68 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 8 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:36.853199  9875 leader_election.cc:290] T de3186201e1a40d0b335eeb8b4e256e0 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 9 election: Requested vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
W20260709 13:19:36.785646  6772 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:36.785466  6697 leader_election.cc:304] T 7887766dc6784fcaa42b35c05fea7a99 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
W20260709 13:19:36.777951  9861 consensus_meta.cc:287] T 853ac0a8cbd64ce99457f170216d4d0f P ccd8a4c3bfe3413cb2ae219b09aea832: Time spent flushing consensus metadata: real 0.682s	user 0.004s	sys 0.009s
I20260709 13:19:36.766748  6844 leader_election.cc:304] T 1bf4668eeb70467fb3dc5a0289233b3c P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:19:36.790689  9744 raft_consensus.cc:2804] T 17587d6730594da4a56fa13a353232a1 P b7ab4784c7344b939bc36f639286f377 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:19:36.793071  6881 raft_consensus.cc:1275] T 20f6842e26174571996b8dea4151d4be P cd75a17ab2604397adab03bb8b5fd75c [term 8 FOLLOWER]: Refusing update from remote peer b7ab4784c7344b939bc36f639286f377: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:19:36.793973  6872 raft_consensus.cc:1275] T 7887766dc6784fcaa42b35c05fea7a99 P cd75a17ab2604397adab03bb8b5fd75c [term 8 FOLLOWER]: Refusing update from remote peer b7ab4784c7344b939bc36f639286f377: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 8 index: 4. (index mismatch)
W20260709 13:19:36.794649  6616 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 427c124d773f483294511e80fe340075 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER failed with leader 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 7ba59cc884714e8aa5f3f0ecaed84cbb is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 6 committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } attrs { replace: true } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } } }
W20260709 13:19:36.797195  6627 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:51654 (request call id 80) took 13148 ms (client timeout 15000 ms). Trace:
I20260709 13:19:36.804499  9873 raft_consensus.cc:515] T 2c240553ce044eedb41541d72b9475d7 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:36.819785  6880 raft_consensus.cc:2468] T d8292e16e5654be6bc408560cf256aaa P cd75a17ab2604397adab03bb8b5fd75c [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 10.
I20260709 13:19:36.824851  6727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e31b9971c15848dea59d4d4130141d9e" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
W20260709 13:19:36.816179  6695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 309869us
W20260709 13:19:36.885448  6697 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 100071us
I20260709 13:19:36.887265  6695 leader_election.cc:304] T be1a92657f494cac8dd227d152f50151 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb
I20260709 13:19:36.887449  6697 leader_election.cc:304] T bd6869f07b5a4885a0b99fbe60c3b175 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:19:36.888793  6695 leader_election.cc:304] T a1704639a875409b9959353527b3fd68 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:19:36.799611  9687 leader_election.cc:290] T 8c7f33e544204fbaac4078e3e83bbf4e P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 6 election: Requested vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:36.836704  6879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c44c4849aa54f2b94d1f1bef9ed546f" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:19:36.836807  6875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a485a995abc4807b6e511e45419f737" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 8 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:19:36.892163  6875 raft_consensus.cc:2410] T 3a485a995abc4807b6e511e45419f737 P cd75a17ab2604397adab03bb8b5fd75c [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7ab4784c7344b939bc36f639286f377 for term 8 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:19:36.837535  6729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "713b5728a197487c9300b310ab94e5a3" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:19:36.838347  6731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a734b5ab7834e05a8c422208acc58b1" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 9 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:19:36.893035  6731 raft_consensus.cc:2468] T 7a734b5ab7834e05a8c422208acc58b1 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 8.
I20260709 13:19:36.893054  6880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b56bf91d90824c959e21e0cee5ba1816" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:19:36.839159  6724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3022224cc81473690653a83d4e99470" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:19:36.840409  6730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22ccee1b570c4ad3a57bd7aec085b1b4" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:19:36.894752  6730 raft_consensus.cc:2468] T 22ccee1b570c4ad3a57bd7aec085b1b4 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 7.
I20260709 13:19:36.842494  6878 raft_consensus.cc:1240] T f5be3a11b23d4ea9b08300a2789821c7 P cd75a17ab2604397adab03bb8b5fd75c [term 6 FOLLOWER]: Rejecting Update request from peer b7ab4784c7344b939bc36f639286f377 for earlier term 5. Current term is 6. Ops: []
I20260709 13:19:36.843724  6732 raft_consensus.cc:1240] T 20f6842e26174571996b8dea4151d4be P ccd8a4c3bfe3413cb2ae219b09aea832 [term 9 FOLLOWER]: Rejecting Update request from peer b7ab4784c7344b939bc36f639286f377 for earlier term 8. Current term is 9. Ops: [6.5-8.6]
I20260709 13:19:36.790247  9653 leader_election.cc:290] T 4b8cacb381b746da8d0049b0a83b41dd P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 9 election: Requested vote from peers cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:19:36.845233  6726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bf4668eeb70467fb3dc5a0289233b3c" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:19:36.846091  6873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a75bfe094d4bdc963aba3f08dfcd25" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 10 candidate_status { last_received { term: 8 index: 3 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:19:36.847085  9758 raft_consensus.cc:493] T 24ee15416e3145beaa1b8183453729a3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:36.851655  9874 raft_consensus.cc:515] T 90d42e216d9741e190bca19a781291fd P ccd8a4c3bfe3413cb2ae219b09aea832 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:36.839977  6723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17587d6730594da4a56fa13a353232a1" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:19:36.863539  9657 leader_election.cc:290] T 20f6842e26174571996b8dea4151d4be P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 9 election: Requested vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
W20260709 13:19:36.864853  6771 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:36.884158  9880 raft_consensus.cc:697] T 7c37d41cd9164c15a6826ca62a851a69 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 7 LEADER]: Becoming Leader. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
I20260709 13:19:36.900449  6770 leader_election.cc:304] T 7a734b5ab7834e05a8c422208acc58b1 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
I20260709 13:19:36.891369  6879 raft_consensus.cc:2468] T 7c44c4849aa54f2b94d1f1bef9ed546f P cd75a17ab2604397adab03bb8b5fd75c [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 9.
I20260709 13:19:36.900987  6877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6869f07b5a4885a0b99fbe60c3b175" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 9 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:19:36.923169  6877 raft_consensus.cc:2410] T bd6869f07b5a4885a0b99fbe60c3b175 P cd75a17ab2604397adab03bb8b5fd75c [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7ab4784c7344b939bc36f639286f377 for term 9 because replica has last-logged OpId of term: 7 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 2.
I20260709 13:19:36.901978  6873 raft_consensus.cc:2468] T 95a75bfe094d4bdc963aba3f08dfcd25 P cd75a17ab2604397adab03bb8b5fd75c [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 9.
I20260709 13:19:36.848642  9832 raft_consensus.cc:2749] T 24ee15416e3145beaa1b8183453729a3 P b7ab4784c7344b939bc36f639286f377 [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: Vote denied by peer 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071) with higher term. Message: Invalid argument: T 24ee15416e3145beaa1b8183453729a3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7ab4784c7344b939bc36f639286f377 for earlier term 7. Current term is 8.
I20260709 13:19:36.905573  6731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1704639a875409b9959353527b3fd68" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
W20260709 13:19:36.890429  6616 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.5.126.68:45071, user_credentials={real_user=slave}} blocked reactor thread for 95993.9us
I20260709 13:19:36.882256  9744 raft_consensus.cc:493] T 17587d6730594da4a56fa13a353232a1 P b7ab4784c7344b939bc36f639286f377 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:36.807906  9450 raft_consensus.cc:515] T 95a75bfe094d4bdc963aba3f08dfcd25 P b7ab4784c7344b939bc36f639286f377 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
W20260709 13:19:36.908928  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 142269us
I20260709 13:19:36.910719  6723 raft_consensus.cc:2468] T 17587d6730594da4a56fa13a353232a1 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 10.
I20260709 13:19:36.924117  6731 raft_consensus.cc:3060] T a1704639a875409b9959353527b3fd68 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:36.884753  9901 raft_consensus.cc:2749] T 1bf4668eeb70467fb3dc5a0289233b3c P cd75a17ab2604397adab03bb8b5fd75c [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:19:36.935074  6844 leader_election.cc:304] T 711ef6523deb4cbe8ef2ba61e1c21c98 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:19:36.927314  6770 leader_election.cc:304] T 22ccee1b570c4ad3a57bd7aec085b1b4 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
I20260709 13:19:36.900876  9905 raft_consensus.cc:2804] T be1a92657f494cac8dd227d152f50151 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:19:36.900938  9890 raft_consensus.cc:2804] T bd6869f07b5a4885a0b99fbe60c3b175 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 13:19:36.934180  6695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 45457.3us
I20260709 13:19:36.897754  9910 raft_consensus.cc:2804] T 7887766dc6784fcaa42b35c05fea7a99 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:19:36.883569  9861 raft_consensus.cc:515] T 853ac0a8cbd64ce99457f170216d4d0f P ccd8a4c3bfe3413cb2ae219b09aea832 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:36.937382  6728 raft_consensus.cc:1240] T 90d42e216d9741e190bca19a781291fd P ccd8a4c3bfe3413cb2ae219b09aea832 [term 9 FOLLOWER]: Rejecting Update request from peer b7ab4784c7344b939bc36f639286f377 for earlier term 8. Current term is 9. Ops: []
I20260709 13:19:36.928385  6730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f03d0dbf16864ca4bc1bb5e4c0334c0f" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:19:36.941571  6695 leader_election.cc:304] T 34f36d59d88f40fe8a2805e604fc6c0a P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: cd75a17ab2604397adab03bb8b5fd75c
W20260709 13:19:36.943403  6697 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 51047.3us
I20260709 13:19:36.906646  9867 consensus_queue.cc:1048] T 30e88460611e47b2ba16a46a30b5f416 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.031s
I20260709 13:19:36.950556  9450 leader_election.cc:290] T 95a75bfe094d4bdc963aba3f08dfcd25 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 10 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:36.950863  6873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "853ac0a8cbd64ce99457f170216d4d0f" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:19:36.938073  9905 raft_consensus.cc:493] T be1a92657f494cac8dd227d152f50151 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 7ba59cc884714e8aa5f3f0ecaed84cbb)
I20260709 13:19:36.952423  9905 raft_consensus.cc:3060] T be1a92657f494cac8dd227d152f50151 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:36.908838  9780 consensus_queue.cc:1048] T 3fa34c08b205435dba97346991aa1f92 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.032s
I20260709 13:19:36.952786  9861 leader_election.cc:290] T 853ac0a8cbd64ce99457f170216d4d0f P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 6 election: Requested vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:36.953641  6725 raft_consensus.cc:2393] T 853ac0a8cbd64ce99457f170216d4d0f P ccd8a4c3bfe3413cb2ae219b09aea832 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7ab4784c7344b939bc36f639286f377 in current term 6: Already voted for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in this term.
I20260709 13:19:36.925169  9771 consensus_queue.cc:1048] T 3a485a995abc4807b6e511e45419f737 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.018s
I20260709 13:19:36.908618  9860 consensus_queue.cc:1059] T e31b9971c15848dea59d4d4130141d9e P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.036s
I20260709 13:19:36.932497  9849 raft_consensus.cc:2804] T 7a734b5ab7834e05a8c422208acc58b1 P b7ab4784c7344b939bc36f639286f377 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:19:36.926231  9853 raft_consensus.cc:515] T d8cee0accdb8499c86d4414b72565a38 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:19:36.931978  9744 raft_consensus.cc:3060] T 17587d6730594da4a56fa13a353232a1 P b7ab4784c7344b939bc36f639286f377 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:36.954993  6731 raft_consensus.cc:2468] T a1704639a875409b9959353527b3fd68 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 8.
I20260709 13:19:36.943410  9910 raft_consensus.cc:493] T 7887766dc6784fcaa42b35c05fea7a99 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 8 FOLLOWER]: Starting leader election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:19:36.957496  6725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a75bfe094d4bdc963aba3f08dfcd25" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 10 candidate_status { last_received { term: 8 index: 3 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:19:37.011960  6725 raft_consensus.cc:3060] T 95a75bfe094d4bdc963aba3f08dfcd25 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:36.959180  6695 leader_election.cc:304] T 9e326172347f45e99a0d482b5d8ef768 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:19:36.918423  9758 raft_consensus.cc:515] T 24ee15416e3145beaa1b8183453729a3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:19:36.941526  9832 raft_consensus.cc:2804] T 22ccee1b570c4ad3a57bd7aec085b1b4 P b7ab4784c7344b939bc36f639286f377 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:19:36.943997  9890 raft_consensus.cc:493] T bd6869f07b5a4885a0b99fbe60c3b175 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:37.016502  9832 raft_consensus.cc:493] T 22ccee1b570c4ad3a57bd7aec085b1b4 P b7ab4784c7344b939bc36f639286f377 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:37.016959  9832 raft_consensus.cc:3060] T 22ccee1b570c4ad3a57bd7aec085b1b4 P b7ab4784c7344b939bc36f639286f377 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:37.017979  6867 tablet_service.cc:1558] Processing DeleteTablet for tablet 1528ab62b6fe4e3099d08f141afee116 with delete_type TABLET_DATA_TOMBSTONED (TS cd75a17ab2604397adab03bb8b5fd75c not found in new config with opid_index 6) from {username='slave'} at 127.0.0.1:53394
I20260709 13:19:37.016536  9890 raft_consensus.cc:3060] T bd6869f07b5a4885a0b99fbe60c3b175 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:37.010972  9859 raft_consensus.cc:2764] T a1704639a875409b9959353527b3fd68 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 8 FOLLOWER]: Leader election decision vote started in defunct term 7: won
I20260709 13:19:37.021788  9873 leader_election.cc:290] T 2c240553ce044eedb41541d72b9475d7 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 10 election: Requested vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:36.947947  6730 raft_consensus.cc:2393] T f03d0dbf16864ca4bc1bb5e4c0334c0f P ccd8a4c3bfe3413cb2ae219b09aea832 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7ab4784c7344b939bc36f639286f377 in current term 7: Already voted for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in this term.
I20260709 13:19:37.002612  6844 leader_election.cc:304] T bd6869f07b5a4885a0b99fbe60c3b175 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:19:37.025823  6844 leader_election.cc:304] T d8cee0accdb8499c86d4414b72565a38 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, b7ab4784c7344b939bc36f639286f377
I20260709 13:19:36.947412  6697 leader_election.cc:304] T bb3d8792045a4583ae2e965b1350a5b4 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:19:37.027734  6880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bf4668eeb70467fb3dc5a0289233b3c" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:19:36.980681  9849 raft_consensus.cc:493] T 7a734b5ab7834e05a8c422208acc58b1 P b7ab4784c7344b939bc36f639286f377 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:19:36.884646  6627 rpcz_store.cc:269] 0709 13:19:23.648920 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:23.663604 (+ 14684us) service_pool.cc:224] Handling call
0709 13:19:36.797093 (+13133489us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:19:33.128083 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:19:33.393543 (+265460us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:19:33.400840 (+  7297us) write_op.cc:435] Acquired schema lock
0709 13:19:33.400980 (+   140us) tablet.cc:662] Decoding operations
0709 13:19:33.402962 (+  1982us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:19:33.403070 (+   108us) write_op.cc:641] Partition lock acquired for write op
0709 13:19:33.403129 (+    59us) tablet.cc:685] Acquiring locks for 10 operations
0709 13:19:33.483507 (+ 80378us) tablet.cc:701] Row locks acquired
0709 13:19:33.483563 (+    56us) write_op.cc:260] PREPARE: finished
0709 13:19:33.483856 (+   293us) write_op.cc:270] Start()
0709 13:19:33.484112 (+   256us) write_op.cc:276] Timestamp: P: 1783603173483762 usec, L: 0
0709 13:19:33.484137 (+    25us) op_driver.cc:348] REPLICATION: starting
0709 13:19:33.485438 (+  1301us) log.cc:844] Serialized 4039 byte log entry
0709 13:19:34.230174 (+744736us) spinlock_profiling.cc:243] Waited 6.32 ms on lock 0x7b4400022b4c. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0c745db1 00007fcc0c7e3c85 00007fcc0c7e46a2 00007fcc0f5561db 00007fcc0f551aaf 00007fcc0f54586e 00007fcc0f544bb6 00007fcc0f5447d8 00007fcc0f54e221 00007fcc0f54e1d9 00007fcc0f54e169
0709 13:19:35.319208 (+1089034us) op_driver.cc:464] REPLICATION: finished
0709 13:19:35.710495 (+391287us) write_op.cc:301] APPLY: starting
0709 13:19:35.730713 (+ 20218us) tablet.cc:1367] starting BulkCheckPresence
0709 13:19:35.846702 (+115989us) tablet.cc:1370] finished BulkCheckPresence
0709 13:19:35.857391 (+ 10689us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:19:36.138288 (+280897us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:19:36.138700 (+   412us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=10
0709 13:19:36.138750 (+    50us) write_op.cc:312] APPLY: finished
0709 13:19:36.139157 (+   407us) log.cc:844] Serialized 76 byte log entry
0709 13:19:36.216636 (+ 77479us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:19:36.246318 (+ 29682us) write_op.cc:454] Released schema lock
0709 13:19:36.263398 (+ 17080us) write_op.cc:341] FINISH: Updating metrics
0709 13:19:36.316252 (+ 52854us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:19:36.320869 (+  4617us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":1059205,"reported_tablets":14,"child_traces":[["op",{"apply.queue_time_us":350791,"apply.run_cpu_time_us":12170,"apply.run_wall_time_us":612319,"num_ops":10,"prepare.queue_time_us":837292,"prepare.run_cpu_time_us":27908,"prepare.run_wall_time_us":431831,"raft.queue_time_us":966641,"raft.run_cpu_time_us":22511,"raft.run_wall_time_us":162033,"replication_time_us":1809020,"spinlock_wait_cycles":14539520,"thread_start_us":1176642,"threads_started":5,"wal-append.queue_time_us":579267,"wal-append.run_cpu_time_us":30836,"wal-append.run_wall_time_us":1608427}]]}
I20260709 13:19:37.033154  6879 raft_consensus.cc:1240] T 3d65025eea89441290d85dd053810e31 P cd75a17ab2604397adab03bb8b5fd75c [term 7 FOLLOWER]: Rejecting Update request from peer b7ab4784c7344b939bc36f639286f377 for earlier term 6. Current term is 7. Ops: []
I20260709 13:19:36.975026  9861 raft_consensus.cc:2804] T 34f36d59d88f40fe8a2805e604fc6c0a P ccd8a4c3bfe3413cb2ae219b09aea832 [term 6 FOLLOWER]: Leader election won for term 6
W20260709 13:19:37.031663  6695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 72576.5us
I20260709 13:19:37.035112  6881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e31b9971c15848dea59d4d4130141d9e" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:19:37.013450  9910 raft_consensus.cc:3060] T 7887766dc6784fcaa42b35c05fea7a99 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:37.029496  6873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4275cf08e63345f993bce8664eada830" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:19:37.041150  6876 raft_consensus.cc:3060] T 90d42e216d9741e190bca19a781291fd P cd75a17ab2604397adab03bb8b5fd75c [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:37.041826  6873 raft_consensus.cc:2468] T 4275cf08e63345f993bce8664eada830 P cd75a17ab2604397adab03bb8b5fd75c [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 8.
I20260709 13:19:36.956743  9862 consensus_queue.cc:1059] T 20f6842e26174571996b8dea4151d4be P b7ab4784c7344b939bc36f639286f377 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.062s
I20260709 13:19:37.046779  6874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30e88460611e47b2ba16a46a30b5f416" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:19:37.003423  9627 raft_consensus.cc:2749] T 711ef6523deb4cbe8ef2ba61e1c21c98 P cd75a17ab2604397adab03bb8b5fd75c [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:19:37.050438  6878 raft_consensus.cc:1240] T 4f00a2e87e56452083b759f60d461ee3 P cd75a17ab2604397adab03bb8b5fd75c [term 8 LEADER]: Rejecting Update request from peer b7ab4784c7344b939bc36f639286f377 for earlier term 7. Current term is 8. Ops: []
I20260709 13:19:37.035940  6881 raft_consensus.cc:2393] T e31b9971c15848dea59d4d4130141d9e P cd75a17ab2604397adab03bb8b5fd75c [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate b7ab4784c7344b939bc36f639286f377 in current term 6: Already voted for candidate cd75a17ab2604397adab03bb8b5fd75c in this term.
W20260709 13:19:37.047248  6697 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.68:45071, user_credentials={real_user=slave}} blocked reactor thread for 99917.7us
I20260709 13:19:37.035923  6695 leader_election.cc:304] T b3f13b31a1f84f0d89d007eadd57924c P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb
I20260709 13:19:37.047535  6874 raft_consensus.cc:2468] T 30e88460611e47b2ba16a46a30b5f416 P cd75a17ab2604397adab03bb8b5fd75c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 7.
W20260709 13:19:37.081444  6773 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:37.100562  6772 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:37.103289  6725 raft_consensus.cc:2468] T 95a75bfe094d4bdc963aba3f08dfcd25 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 10.
I20260709 13:19:37.103964  6872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3022224cc81473690653a83d4e99470" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:19:37.104480  6875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "427c124d773f483294511e80fe340075" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:19:37.104925  6872 raft_consensus.cc:3060] T a3022224cc81473690653a83d4e99470 P cd75a17ab2604397adab03bb8b5fd75c [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:37.037074  9849 raft_consensus.cc:3060] T 7a734b5ab7834e05a8c422208acc58b1 P b7ab4784c7344b939bc36f639286f377 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:19:37.109371  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 60866.6us
I20260709 13:19:37.109964  6875 raft_consensus.cc:2468] T 427c124d773f483294511e80fe340075 P cd75a17ab2604397adab03bb8b5fd75c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 6.
I20260709 13:19:37.115727  9853 leader_election.cc:290] T d8cee0accdb8499c86d4414b72565a38 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 8 election: Requested vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:37.040972  9880 consensus_queue.cc:237] T 7c37d41cd9164c15a6826ca62a851a69 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:37.117317  9758 leader_election.cc:290] T 24ee15416e3145beaa1b8183453729a3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:37.117707  6881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22ccee1b570c4ad3a57bd7aec085b1b4" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:19:37.150007  6881 raft_consensus.cc:2468] T 22ccee1b570c4ad3a57bd7aec085b1b4 P cd75a17ab2604397adab03bb8b5fd75c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 7.
I20260709 13:19:37.118592  6873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a734b5ab7834e05a8c422208acc58b1" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 9 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:19:37.120379  6880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1704639a875409b9959353527b3fd68" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:19:37.151459  6880 raft_consensus.cc:3060] T a1704639a875409b9959353527b3fd68 P cd75a17ab2604397adab03bb8b5fd75c [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:37.109534  9862 consensus_queue.cc:1243] T 20f6842e26174571996b8dea4151d4be P b7ab4784c7344b939bc36f639286f377 [LEADER]: Peer ccd8a4c3bfe3413cb2ae219b09aea832 log is divergent from this leader: its last log entry 7.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 13:19:37.036720  9772 raft_consensus.cc:515] T 9b3759de40694069b13c0f8bd40e5709 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:37.117360  6874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f03d0dbf16864ca4bc1bb5e4c0334c0f" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:19:37.125375  6772 leader_election.cc:400] T 24ee15416e3145beaa1b8183453729a3 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 7 pre-election: Vote denied by peer cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931) with higher term. Message: Invalid argument: T 24ee15416e3145beaa1b8183453729a3 P cd75a17ab2604397adab03bb8b5fd75c [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7ab4784c7344b939bc36f639286f377 for earlier term 7. Current term is 8.
I20260709 13:19:37.180433  6874 raft_consensus.cc:2468] T f03d0dbf16864ca4bc1bb5e4c0334c0f P cd75a17ab2604397adab03bb8b5fd75c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 5.
I20260709 13:19:37.125957  9918 raft_consensus.cc:2804] T bb3d8792045a4583ae2e965b1350a5b4 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:19:37.180734  6877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b8cacb381b746da8d0049b0a83b41dd" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
W20260709 13:19:37.180905  6772 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 55755.6us
I20260709 13:19:37.181535  6877 raft_consensus.cc:3060] T 4b8cacb381b746da8d0049b0a83b41dd P cd75a17ab2604397adab03bb8b5fd75c [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:37.127732  6879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "713b5728a197487c9300b310ab94e5a3" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:19:37.182126  6873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d33d5ee8ef6f415593d8df52063161ad" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
W20260709 13:19:37.130484  6695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 94705.3us
I20260709 13:19:37.184022  6695 leader_election.cc:304] T f4b8bd455d5a47c18a1380839c6e0d61 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:19:37.047850  9892 raft_consensus.cc:3060] T bd6869f07b5a4885a0b99fbe60c3b175 P cd75a17ab2604397adab03bb8b5fd75c [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:37.137357  6798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8cee0accdb8499c86d4414b72565a38" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:19:37.141309  6876 raft_consensus.cc:1275] T 90d42e216d9741e190bca19a781291fd P cd75a17ab2604397adab03bb8b5fd75c [term 8 FOLLOWER]: Refusing update from remote peer b7ab4784c7344b939bc36f639286f377: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:19:37.047696  9901 raft_consensus.cc:2749] T d8cee0accdb8499c86d4414b72565a38 P cd75a17ab2604397adab03bb8b5fd75c [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:19:37.204285  6798 raft_consensus.cc:3060] T d8cee0accdb8499c86d4414b72565a38 P b7ab4784c7344b939bc36f639286f377 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:37.157992  6881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09c2a98de1a4decabd0ff900dd44caa" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:19:37.129797  9861 raft_consensus.cc:697] T 34f36d59d88f40fe8a2805e604fc6c0a P ccd8a4c3bfe3413cb2ae219b09aea832 [term 6 LEADER]: Becoming Leader. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
I20260709 13:19:37.146051  9888 raft_consensus.cc:2804] T b3f13b31a1f84f0d89d007eadd57924c P ccd8a4c3bfe3413cb2ae219b09aea832 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:19:37.211352  6875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a75bfe094d4bdc963aba3f08dfcd25" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 9 candidate_status { last_received { term: 7 index: 2 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:19:37.210688  6881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f03d0dbf16864ca4bc1bb5e4c0334c0f" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:19:37.212848  6881 raft_consensus.cc:3060] T f03d0dbf16864ca4bc1bb5e4c0334c0f P cd75a17ab2604397adab03bb8b5fd75c [term 5 FOLLOWER]: Advancing to term 7
I20260709 13:19:37.123396  6878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a75bfe094d4bdc963aba3f08dfcd25" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 10 candidate_status { last_received { term: 8 index: 3 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:19:37.182240  6879 raft_consensus.cc:3060] T 713b5728a197487c9300b310ab94e5a3 P cd75a17ab2604397adab03bb8b5fd75c [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:37.040817  9860 raft_consensus.cc:2749] T 9e326172347f45e99a0d482b5d8ef768 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:19:37.189023  6872 raft_consensus.cc:2468] T a3022224cc81473690653a83d4e99470 P cd75a17ab2604397adab03bb8b5fd75c [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 9.
I20260709 13:19:37.050639  9898 consensus_queue.cc:1048] T 34f36d59d88f40fe8a2805e604fc6c0a P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 1, Time since last communication: 0.094s
I20260709 13:19:37.203979  6695 leader_election.cc:304] T e77e330a82df4b43a745d57a68f6f057 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:19:37.207839  6873 raft_consensus.cc:2393] T d33d5ee8ef6f415593d8df52063161ad P cd75a17ab2604397adab03bb8b5fd75c [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ccd8a4c3bfe3413cb2ae219b09aea832 in current term 9: Already voted for candidate cd75a17ab2604397adab03bb8b5fd75c in this term.
W20260709 13:19:37.214784  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 94774.4us
I20260709 13:19:37.215569  7503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b8cacb381b746da8d0049b0a83b41dd" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb"
I20260709 13:19:37.222462  6772 leader_election.cc:304] T 07a92dd554674067a83a9cb68c4773f2 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:19:37.223026  7503 raft_consensus.cc:3060] T 4b8cacb381b746da8d0049b0a83b41dd P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:37.190546  5625 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:19:37.216460  6874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbdf895bba214ff68685a24fd17dfb5d" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:19:37.224164  6874 raft_consensus.cc:2393] T dbdf895bba214ff68685a24fd17dfb5d P cd75a17ab2604397adab03bb8b5fd75c [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ccd8a4c3bfe3413cb2ae219b09aea832 in current term 7: Already voted for candidate cd75a17ab2604397adab03bb8b5fd75c in this term.
I20260709 13:19:37.225122  6874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "853ac0a8cbd64ce99457f170216d4d0f" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:19:37.216851  6877 raft_consensus.cc:2468] T 4b8cacb381b746da8d0049b0a83b41dd P cd75a17ab2604397adab03bb8b5fd75c [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 9.
I20260709 13:19:37.173523  9785 raft_consensus.cc:493] T d33d5ee8ef6f415593d8df52063161ad P b7ab4784c7344b939bc36f639286f377 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:37.212858  6876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22ccee1b570c4ad3a57bd7aec085b1b4" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:19:37.218019  6875 raft_consensus.cc:2393] T 95a75bfe094d4bdc963aba3f08dfcd25 P cd75a17ab2604397adab03bb8b5fd75c [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate ccd8a4c3bfe3413cb2ae219b09aea832 in current term 9: Already voted for candidate cd75a17ab2604397adab03bb8b5fd75c in this term.
I20260709 13:19:37.228335  6877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de3186201e1a40d0b335eeb8b4e256e0" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:19:37.233964  6876 raft_consensus.cc:2410] T 22ccee1b570c4ad3a57bd7aec085b1b4 P cd75a17ab2604397adab03bb8b5fd75c [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ccd8a4c3bfe3413cb2ae219b09aea832 for term 8 because replica has last-logged OpId of term: 6 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 13:19:37.234028  6877 raft_consensus.cc:3060] T de3186201e1a40d0b335eeb8b4e256e0 P cd75a17ab2604397adab03bb8b5fd75c [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:37.206147  9867 raft_consensus.cc:2804] T f4b8bd455d5a47c18a1380839c6e0d61 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:19:37.148061  9771 consensus_queue.cc:1048] T 3fa34c08b205435dba97346991aa1f92 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.061s
I20260709 13:19:37.226747  6873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c240553ce044eedb41541d72b9475d7" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:19:37.189358  7495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "404190ce4ce94cecbfcb6ea9d1dd8626" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:19:37.190129  9925 tablet_replica.cc:333] T 1528ab62b6fe4e3099d08f141afee116 P cd75a17ab2604397adab03bb8b5fd75c: stopping tablet replica
I20260709 13:19:37.189173  9918 raft_consensus.cc:493] T bb3d8792045a4583ae2e965b1350a5b4 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 7 FOLLOWER]: Starting leader election (detected failure of leader cd75a17ab2604397adab03bb8b5fd75c)
I20260709 13:19:37.231150  6697 leader_election.cc:304] T 4b8cacb381b746da8d0049b0a83b41dd P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:19:37.241758  6728 raft_consensus.cc:1275] T d8292e16e5654be6bc408560cf256aaa P ccd8a4c3bfe3413cb2ae219b09aea832 [term 10 FOLLOWER]: Refusing update from remote peer b7ab4784c7344b939bc36f639286f377: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:19:37.256718  6798 raft_consensus.cc:2468] T d8cee0accdb8499c86d4414b72565a38 P b7ab4784c7344b939bc36f639286f377 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in term 8.
I20260709 13:19:37.215045  9888 raft_consensus.cc:493] T b3f13b31a1f84f0d89d007eadd57924c P ccd8a4c3bfe3413cb2ae219b09aea832 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 7ba59cc884714e8aa5f3f0ecaed84cbb)
I20260709 13:19:37.224026  9874 leader_election.cc:290] T 90d42e216d9741e190bca19a781291fd P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 9 election: Requested vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:37.232306  9687 raft_consensus.cc:3060] T e77e330a82df4b43a745d57a68f6f057 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:37.217067  9852 raft_consensus.cc:493] T de3186201e1a40d0b335eeb8b4e256e0 P b7ab4784c7344b939bc36f639286f377 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:37.254732  6880 raft_consensus.cc:2468] T a1704639a875409b9959353527b3fd68 P cd75a17ab2604397adab03bb8b5fd75c [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 8.
I20260709 13:19:37.244254  6873 raft_consensus.cc:3060] T 2c240553ce044eedb41541d72b9475d7 P cd75a17ab2604397adab03bb8b5fd75c [term 8 FOLLOWER]: Advancing to term 10
I20260709 13:19:37.288484  6728 raft_consensus.cc:1275] T f58dc08b12a2494bb9a1372837970ca2 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 10 FOLLOWER]: Refusing update from remote peer b7ab4784c7344b939bc36f639286f377: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 10 index: 5. (index mismatch)
I20260709 13:19:37.289752  6881 raft_consensus.cc:2468] T f03d0dbf16864ca4bc1bb5e4c0334c0f P cd75a17ab2604397adab03bb8b5fd75c [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 7.
W20260709 13:19:37.268946  9914 log.cc:927] Time spent T 7ba5dac66ab5497e9e336f2a3c28cda5 P 7ba59cc884714e8aa5f3f0ecaed84cbb: Append to log took a long time: real 0.163s	user 0.000s	sys 0.001s
W20260709 13:19:37.269564  9920 log.cc:927] Time spent T 711ef6523deb4cbe8ef2ba61e1c21c98 P cd75a17ab2604397adab03bb8b5fd75c: Append to log took a long time: real 0.137s	user 0.001s	sys 0.000s
I20260709 13:19:37.269613  5625 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:19:37.190089  9744 raft_consensus.cc:515] T 17587d6730594da4a56fa13a353232a1 P b7ab4784c7344b939bc36f639286f377 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:19:37.270771  6878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90d42e216d9741e190bca19a781291fd" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:19:37.257063  9896 raft_consensus.cc:493] T 7c37d41cd9164c15a6826ca62a851a69 P b7ab4784c7344b939bc36f639286f377 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:37.272872  6772 leader_election.cc:304] T b56bf91d90824c959e21e0cee5ba1816 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:19:37.273509  9836 consensus_queue.cc:1048] T 7887766dc6784fcaa42b35c05fea7a99 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:19:37.274132  9772 leader_election.cc:290] T 9b3759de40694069b13c0f8bd40e5709 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 8 election: Requested vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
W20260709 13:19:37.275359  9917 log.cc:927] Time spent T f58dc08b12a2494bb9a1372837970ca2 P b7ab4784c7344b939bc36f639286f377: Append to log took a long time: real 0.225s	user 0.001s	sys 0.000s
I20260709 13:19:37.274847  9861 consensus_queue.cc:237] T 34f36d59d88f40fe8a2805e604fc6c0a P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:37.275790  9805 raft_consensus.cc:2749] T 07a92dd554674067a83a9cb68c4773f2 P b7ab4784c7344b939bc36f639286f377 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:19:37.279901  7503 raft_consensus.cc:2468] T 4b8cacb381b746da8d0049b0a83b41dd P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 9.
I20260709 13:19:37.248526  6872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c7f33e544204fbaac4078e3e83bbf4e" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:19:37.326207  6872 raft_consensus.cc:3060] T 8c7f33e544204fbaac4078e3e83bbf4e P cd75a17ab2604397adab03bb8b5fd75c [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:37.276062  9774 raft_consensus.cc:493] T e77e330a82df4b43a745d57a68f6f057 P b7ab4784c7344b939bc36f639286f377 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:37.332441  9774 raft_consensus.cc:515] T e77e330a82df4b43a745d57a68f6f057 P b7ab4784c7344b939bc36f639286f377 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } }
I20260709 13:19:37.335440  9774 leader_election.cc:290] T e77e330a82df4b43a745d57a68f6f057 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931), ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391)
I20260709 13:19:37.242516  9867 raft_consensus.cc:493] T f4b8bd455d5a47c18a1380839c6e0d61 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:37.336411  9867 raft_consensus.cc:3060] T f4b8bd455d5a47c18a1380839c6e0d61 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:37.337191  6728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77e330a82df4b43a745d57a68f6f057" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 11 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:19:37.244802  6877 raft_consensus.cc:2468] T de3186201e1a40d0b335eeb8b4e256e0 P cd75a17ab2604397adab03bb8b5fd75c [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 9.
I20260709 13:19:37.293090  6875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20f6842e26174571996b8dea4151d4be" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:19:37.342311  6875 raft_consensus.cc:3060] T 20f6842e26174571996b8dea4151d4be P cd75a17ab2604397adab03bb8b5fd75c [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:37.294684  6880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f9c2e2bf644115957398fe4c9459db" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:19:37.295423  9848 raft_consensus.cc:493] T 1528ab62b6fe4e3099d08f141afee116 P b7ab4784c7344b939bc36f639286f377 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:37.295325  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 72651.8us
I20260709 13:19:37.350119  9848 raft_consensus.cc:515] T 1528ab62b6fe4e3099d08f141afee116 P b7ab4784c7344b939bc36f639286f377 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:19:37.257254  9775 raft_consensus.cc:493] T ab432e62819d499eaaf3dd55481dd930 P b7ab4784c7344b939bc36f639286f377 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:37.353598  9775 raft_consensus.cc:515] T ab432e62819d499eaaf3dd55481dd930 P b7ab4784c7344b939bc36f639286f377 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:37.354144  9848 leader_election.cc:290] T 1528ab62b6fe4e3099d08f141afee116 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:19:37.228870  9881 consensus_queue.cc:1048] T 7a734b5ab7834e05a8c422208acc58b1 P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.052s
I20260709 13:19:37.237497  9450 consensus_queue.cc:1059] T dbdf895bba214ff68685a24fd17dfb5d P b7ab4784c7344b939bc36f639286f377 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: INVALID_TERM, Last received: 6.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.052s
I20260709 13:19:37.299266  6878 raft_consensus.cc:3060] T 90d42e216d9741e190bca19a781291fd P cd75a17ab2604397adab03bb8b5fd75c [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:37.272055  9862 consensus_queue.cc:1048] T 20f6842e26174571996b8dea4151d4be P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:19:37.357307  9450 raft_consensus.cc:3055] T dbdf895bba214ff68685a24fd17dfb5d P b7ab4784c7344b939bc36f639286f377 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:19:37.357820  9450 raft_consensus.cc:740] T dbdf895bba214ff68685a24fd17dfb5d P b7ab4784c7344b939bc36f639286f377 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
I20260709 13:19:37.358601  6730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1528ab62b6fe4e3099d08f141afee116" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:19:37.358814  9774 raft_consensus.cc:2749] T b56bf91d90824c959e21e0cee5ba1816 P b7ab4784c7344b939bc36f639286f377 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:19:37.359505  6730 raft_consensus.cc:2468] T 1528ab62b6fe4e3099d08f141afee116 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 6.
I20260709 13:19:37.262894  9918 raft_consensus.cc:3060] T bb3d8792045a4583ae2e965b1350a5b4 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:37.363436  9775 leader_election.cc:290] T ab432e62819d499eaaf3dd55481dd930 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:37.250953  9785 raft_consensus.cc:515] T d33d5ee8ef6f415593d8df52063161ad P b7ab4784c7344b939bc36f639286f377 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:37.370786  9785 leader_election.cc:290] T d33d5ee8ef6f415593d8df52063161ad P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
W20260709 13:19:37.324265  6695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 101308us
I20260709 13:19:37.372185  6695 leader_election.cc:304] T 427c124d773f483294511e80fe340075 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:19:37.373410  9874 raft_consensus.cc:3060] T 427c124d773f483294511e80fe340075 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:37.276854  9888 raft_consensus.cc:3060] T b3f13b31a1f84f0d89d007eadd57924c P ccd8a4c3bfe3413cb2ae219b09aea832 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:37.375561  6695 leader_election.cc:304] T 44bde925b2e541b69890d70715b85176 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:19:37.300014  9657 raft_consensus.cc:2804] T 4b8cacb381b746da8d0049b0a83b41dd P ccd8a4c3bfe3413cb2ae219b09aea832 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:19:37.358881  9450 consensus_queue.cc:260] T dbdf895bba214ff68685a24fd17dfb5d P b7ab4784c7344b939bc36f639286f377 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:37.366204  6878 raft_consensus.cc:2468] T 90d42e216d9741e190bca19a781291fd P cd75a17ab2604397adab03bb8b5fd75c [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 9.
I20260709 13:19:37.380944  9450 raft_consensus.cc:3060] T dbdf895bba214ff68685a24fd17dfb5d P b7ab4784c7344b939bc36f639286f377 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:37.366374  6730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab432e62819d499eaaf3dd55481dd930" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:19:37.378898  6725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d33d5ee8ef6f415593d8df52063161ad" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:19:37.382560  6730 raft_consensus.cc:2468] T ab432e62819d499eaaf3dd55481dd930 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 9.
I20260709 13:19:37.382565  6725 raft_consensus.cc:2468] T d33d5ee8ef6f415593d8df52063161ad P ccd8a4c3bfe3413cb2ae219b09aea832 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 9.
I20260709 13:19:37.389827  6873 raft_consensus.cc:2468] T 2c240553ce044eedb41541d72b9475d7 P cd75a17ab2604397adab03bb8b5fd75c [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 10.
I20260709 13:19:37.390352  6872 raft_consensus.cc:2468] T 8c7f33e544204fbaac4078e3e83bbf4e P cd75a17ab2604397adab03bb8b5fd75c [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 6.
I20260709 13:19:37.391119  6873 raft_consensus.cc:1240] T a3022224cc81473690653a83d4e99470 P cd75a17ab2604397adab03bb8b5fd75c [term 9 FOLLOWER]: Rejecting Update request from peer ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 8. Current term is 9. Ops: [8.5-8.5]
I20260709 13:19:37.392822  6875 raft_consensus.cc:2468] T 20f6842e26174571996b8dea4151d4be P cd75a17ab2604397adab03bb8b5fd75c [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 9.
I20260709 13:19:37.293666  9852 raft_consensus.cc:515] T de3186201e1a40d0b335eeb8b4e256e0 P b7ab4784c7344b939bc36f639286f377 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
W20260709 13:19:37.424249  6772 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 151457us
I20260709 13:19:37.426115  6772 leader_election.cc:304] T 3a485a995abc4807b6e511e45419f737 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:19:37.426287  9867 raft_consensus.cc:515] T f4b8bd455d5a47c18a1380839c6e0d61 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:37.427289  9805 raft_consensus.cc:2749] T 3a485a995abc4807b6e511e45419f737 P b7ab4784c7344b939bc36f639286f377 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:19:37.427842  6772 leader_election.cc:304] T 7c44c4849aa54f2b94d1f1bef9ed546f P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:19:37.432693  6772 leader_election.cc:304] T bd6869f07b5a4885a0b99fbe60c3b175 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
W20260709 13:19:37.438613  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 85606.4us
I20260709 13:19:37.439657  6844 leader_election.cc:304] T 9b3759de40694069b13c0f8bd40e5709 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:19:37.442031  6772 leader_election.cc:304] T 1bf4668eeb70467fb3dc5a0289233b3c P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:19:37.393975  9772 consensus_queue.cc:1048] T a3022224cc81473690653a83d4e99470 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.043s
I20260709 13:19:37.452416  6844 leader_election.cc:304] T 4d9def8b32fd443aa94ab1420b06837b P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:19:37.460259  6772 leader_election.cc:304] T 4275cf08e63345f993bce8664eada830 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:19:37.441048  9775 raft_consensus.cc:2749] T bd6869f07b5a4885a0b99fbe60c3b175 P b7ab4784c7344b939bc36f639286f377 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:19:37.438476  9805 raft_consensus.cc:2804] T 7c44c4849aa54f2b94d1f1bef9ed546f P b7ab4784c7344b939bc36f639286f377 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:19:37.469190  9805 raft_consensus.cc:493] T 7c44c4849aa54f2b94d1f1bef9ed546f P b7ab4784c7344b939bc36f639286f377 [term 9 FOLLOWER]: Starting leader election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:19:37.469882  9805 raft_consensus.cc:3060] T 7c44c4849aa54f2b94d1f1bef9ed546f P b7ab4784c7344b939bc36f639286f377 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:37.471473  9852 leader_election.cc:290] T de3186201e1a40d0b335eeb8b4e256e0 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:37.473206  6725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de3186201e1a40d0b335eeb8b4e256e0" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:19:37.474308  6725 raft_consensus.cc:2393] T de3186201e1a40d0b335eeb8b4e256e0 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7ab4784c7344b939bc36f639286f377 in current term 9: Already voted for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in this term.
I20260709 13:19:37.463060  6879 raft_consensus.cc:2468] T 713b5728a197487c9300b310ab94e5a3 P cd75a17ab2604397adab03bb8b5fd75c [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 9.
W20260709 13:19:37.463465  6695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 88014.7us
I20260709 13:19:37.467083  6772 leader_election.cc:304] T e31b9971c15848dea59d4d4130141d9e P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:19:37.446812  9862 raft_consensus.cc:2749] T 1bf4668eeb70467fb3dc5a0289233b3c P b7ab4784c7344b939bc36f639286f377 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:19:37.482215  6872 raft_consensus.cc:1240] T 713b5728a197487c9300b310ab94e5a3 P cd75a17ab2604397adab03bb8b5fd75c [term 9 FOLLOWER]: Rejecting Update request from peer ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 8. Current term is 9. Ops: []
I20260709 13:19:37.483222  9657 raft_consensus.cc:697] T 4b8cacb381b746da8d0049b0a83b41dd P ccd8a4c3bfe3413cb2ae219b09aea832 [term 9 LEADER]: Becoming Leader. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
W20260709 13:19:37.486373  7468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 385603us
I20260709 13:19:37.459743  9809 raft_consensus.cc:2804] T 9b3759de40694069b13c0f8bd40e5709 P cd75a17ab2604397adab03bb8b5fd75c [term 7 FOLLOWER]: Leader election won for term 7
W20260709 13:19:37.492179  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 44627.6us
I20260709 13:19:37.492193  6772 leader_election.cc:304] T 30e88460611e47b2ba16a46a30b5f416 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: ccd8a4c3bfe3413cb2ae219b09aea832
W20260709 13:19:37.494957  6847 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:37.452273  9933 raft_consensus.cc:2804] T 44bde925b2e541b69890d70715b85176 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:19:37.311807  9896 raft_consensus.cc:515] T 7c37d41cd9164c15a6826ca62a851a69 P b7ab4784c7344b939bc36f639286f377 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:37.502702  6772 leader_election.cc:304] T 427c124d773f483294511e80fe340075 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:19:37.514761  6695 leader_election.cc:304] T 1528ab62b6fe4e3099d08f141afee116 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb
I20260709 13:19:37.518131  6798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7887766dc6784fcaa42b35c05fea7a99" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:19:37.518764  6805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a734b5ab7834e05a8c422208acc58b1" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:19:37.520162  6802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6869f07b5a4885a0b99fbe60c3b175" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 9 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:19:37.520593  6800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90d42e216d9741e190bca19a781291fd" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:19:37.521059  6802 raft_consensus.cc:2468] T bd6869f07b5a4885a0b99fbe60c3b175 P b7ab4784c7344b939bc36f639286f377 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 8.
I20260709 13:19:37.518275  6807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d65025eea89441290d85dd053810e31" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:19:37.520156  9934 raft_consensus.cc:2804] T 1528ab62b6fe4e3099d08f141afee116 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:19:37.522179  6807 raft_consensus.cc:2468] T 3d65025eea89441290d85dd053810e31 P b7ab4784c7344b939bc36f639286f377 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 7.
I20260709 13:19:37.522630  9934 raft_consensus.cc:493] T 1528ab62b6fe4e3099d08f141afee116 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 6 FOLLOWER]: Starting leader election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:19:37.522835  9774 raft_consensus.cc:2804] T 427c124d773f483294511e80fe340075 P b7ab4784c7344b939bc36f639286f377 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:19:37.523283  9934 raft_consensus.cc:3060] T 1528ab62b6fe4e3099d08f141afee116 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:37.523391  9774 raft_consensus.cc:493] T 427c124d773f483294511e80fe340075 P b7ab4784c7344b939bc36f639286f377 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:37.524156  9774 raft_consensus.cc:3060] T 427c124d773f483294511e80fe340075 P b7ab4784c7344b939bc36f639286f377 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:37.533133  6801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f03d0dbf16864ca4bc1bb5e4c0334c0f" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:19:37.533394  6804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d33d5ee8ef6f415593d8df52063161ad" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:19:37.534327  6804 raft_consensus.cc:2468] T d33d5ee8ef6f415593d8df52063161ad P b7ab4784c7344b939bc36f639286f377 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 9.
I20260709 13:19:37.534451  6806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbdf895bba214ff68685a24fd17dfb5d" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:19:37.535429  6799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "404190ce4ce94cecbfcb6ea9d1dd8626" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:19:37.536180  6803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09c2a98de1a4decabd0ff900dd44caa" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:19:37.533962  6801 raft_consensus.cc:2468] T f03d0dbf16864ca4bc1bb5e4c0334c0f P b7ab4784c7344b939bc36f639286f377 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 6.
I20260709 13:19:37.536738  6803 raft_consensus.cc:3060] T f09c2a98de1a4decabd0ff900dd44caa P b7ab4784c7344b939bc36f639286f377 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:19:37.543330  6678 auto_rebalancer.cc:893] Removing replace marker failed: Replica ccd8a4c3bfe3413cb2ae219b09aea832 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 7 leader_uuid: "b7ab4784c7344b939bc36f639286f377" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } attrs { replace: true } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } } }
W20260709 13:19:37.544051  6678 auto_rebalancer.cc:901] Could not move replica: Illegal state: not currently leader
W20260709 13:19:37.544420  6678 auto_rebalancer.cc:330] scheduled replica move failed to complete: Illegal state: not currently leader
I20260709 13:19:37.556900  9934 raft_consensus.cc:515] T 1528ab62b6fe4e3099d08f141afee116 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:19:37.559660  6772 leader_election.cc:304] T f03d0dbf16864ca4bc1bb5e4c0334c0f P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:19:37.561095  6803 raft_consensus.cc:2468] T f09c2a98de1a4decabd0ff900dd44caa P b7ab4784c7344b939bc36f639286f377 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 9.
I20260709 13:19:37.571285  9774 raft_consensus.cc:515] T 427c124d773f483294511e80fe340075 P b7ab4784c7344b939bc36f639286f377 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } attrs { replace: true } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:19:37.449800  9889 consensus_queue.cc:1059] T 44bde925b2e541b69890d70715b85176 P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.044s
I20260709 13:19:37.562934  6725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17587d6730594da4a56fa13a353232a1" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:19:37.478242  9936 raft_consensus.cc:2804] T 4275cf08e63345f993bce8664eada830 P b7ab4784c7344b939bc36f639286f377 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:19:37.569119  6876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b8cacb381b746da8d0049b0a83b41dd" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:19:37.573135  6725 raft_consensus.cc:3060] T 17587d6730594da4a56fa13a353232a1 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:37.573966  6876 raft_consensus.cc:2368] T 4b8cacb381b746da8d0049b0a83b41dd P cd75a17ab2604397adab03bb8b5fd75c [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 7ba59cc884714e8aa5f3f0ecaed84cbb for earlier term 8. Current term is 9.
I20260709 13:19:37.496837  9852 raft_consensus.cc:2749] T e31b9971c15848dea59d4d4130141d9e P b7ab4784c7344b939bc36f639286f377 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:19:37.500129  9867 leader_election.cc:290] T f4b8bd455d5a47c18a1380839c6e0d61 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 8 election: Requested vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
W20260709 13:19:37.643188  6697 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 412068us
I20260709 13:19:37.641527  6725 raft_consensus.cc:2468] T 17587d6730594da4a56fa13a353232a1 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 11.
I20260709 13:19:37.646893  6876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3d8792045a4583ae2e965b1350a5b4" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:19:37.651553  6879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f00a2e87e56452083b759f60d461ee3" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:19:37.558698  9775 raft_consensus.cc:2804] T 30e88460611e47b2ba16a46a30b5f416 P b7ab4784c7344b939bc36f639286f377 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 13:19:37.652537  7468 outbound_call.cc:321] RPC callback for RPC call kudu.master.MasterService.TSHeartbeat -> {remote=127.5.126.126:34367, user_credentials={real_user=slave}} blocked reactor thread for 70182.5us
I20260709 13:19:37.573180  9936 raft_consensus.cc:493] T 4275cf08e63345f993bce8664eada830 P b7ab4784c7344b939bc36f639286f377 [term 8 FOLLOWER]: Starting leader election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:19:37.496188  9898 raft_consensus.cc:2804] T 4d9def8b32fd443aa94ab1420b06837b P cd75a17ab2604397adab03bb8b5fd75c [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:19:37.679167  6876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb7fa124c3bf4ef9ab65a407cb008441" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
W20260709 13:19:37.568110  9905 consensus_meta.cc:287] T be1a92657f494cac8dd227d152f50151 P ccd8a4c3bfe3413cb2ae219b09aea832: Time spent flushing consensus metadata: real 0.615s	user 0.012s	sys 0.000s
I20260709 13:19:37.679739  6730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "427c124d773f483294511e80fe340075" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:19:37.748191  6879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce4f062dcd314d43a63ca74067cb5ee3" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:19:37.753947  9875 raft_consensus.cc:3055] T e31b9971c15848dea59d4d4130141d9e P ccd8a4c3bfe3413cb2ae219b09aea832 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:19:37.754714  9875 raft_consensus.cc:740] T e31b9971c15848dea59d4d4130141d9e P ccd8a4c3bfe3413cb2ae219b09aea832 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
I20260709 13:19:37.755826  9687 raft_consensus.cc:2749] T e77e330a82df4b43a745d57a68f6f057 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:19:37.709501  7468 leader_election.cc:336] T ce4f062dcd314d43a63ca74067cb5ee3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931): Timed out: RequestConsensusVote RPC to 127.5.126.67:42931 timed out after 1.550s (SENT)
I20260709 13:19:37.756922  9774 leader_election.cc:290] T 427c124d773f483294511e80fe340075 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 7 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
W20260709 13:19:37.757682  7468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 48250.5us
I20260709 13:19:37.655362  9862 raft_consensus.cc:2804] T f03d0dbf16864ca4bc1bb5e4c0334c0f P b7ab4784c7344b939bc36f639286f377 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:19:37.863155  6876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe20b4b48823486ca3b9c648db6ce8aa" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:19:37.567767  9873 consensus_queue.cc:1048] T 30e88460611e47b2ba16a46a30b5f416 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.157s
I20260709 13:19:37.773232  7466 leader_election.cc:304] T d8cee0accdb8499c86d4414b72565a38 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, b7ab4784c7344b939bc36f639286f377; no voters: 
I20260709 13:19:37.764138  6728 raft_consensus.cc:2468] T e77e330a82df4b43a745d57a68f6f057 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 10.
I20260709 13:19:37.767153  6770 leader_election.cc:304] T 853ac0a8cbd64ce99457f170216d4d0f P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
W20260709 13:19:37.872483  6770 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 105431us
I20260709 13:19:37.566069  9933 raft_consensus.cc:697] T 44bde925b2e541b69890d70715b85176 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 9 LEADER]: Becoming Leader. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
I20260709 13:19:37.710608  9775 raft_consensus.cc:493] T 30e88460611e47b2ba16a46a30b5f416 P b7ab4784c7344b939bc36f639286f377 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:37.583150  9809 raft_consensus.cc:697] T 9b3759de40694069b13c0f8bd40e5709 P cd75a17ab2604397adab03bb8b5fd75c [term 7 LEADER]: Becoming Leader. State: Replica: cd75a17ab2604397adab03bb8b5fd75c, State: Running, Role: LEADER
I20260709 13:19:37.723191  9627 raft_consensus.cc:493] T c4db81d9d329422bb3b4160ca4ac2d1d P cd75a17ab2604397adab03bb8b5fd75c [term 8 FOLLOWER]: Starting pre-election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
W20260709 13:19:37.879124  6772 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 306726us
W20260709 13:19:37.881884  7466 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 108771us
I20260709 13:19:37.711818  9901 raft_consensus.cc:3055] T 44bde925b2e541b69890d70715b85176 P cd75a17ab2604397adab03bb8b5fd75c [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:19:37.651289  9785 consensus_queue.cc:1048] T 90d42e216d9741e190bca19a781291fd P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.201s
I20260709 13:19:37.725898  9744 leader_election.cc:290] T 17587d6730594da4a56fa13a353232a1 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 11 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:19:37.873759  6770 leader_election.cc:304] T a1704639a875409b9959353527b3fd68 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
I20260709 13:19:37.562124  9907 consensus_queue.cc:1048] T 07a92dd554674067a83a9cb68c4773f2 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.290s
I20260709 13:19:37.718606  9936 raft_consensus.cc:3060] T 4275cf08e63345f993bce8664eada830 P b7ab4784c7344b939bc36f639286f377 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:37.901614  6876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8cee0accdb8499c86d4414b72565a38" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:19:37.902753  6772 leader_election.cc:304] T a3022224cc81473690653a83d4e99470 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:19:37.863163  9862 raft_consensus.cc:493] T f03d0dbf16864ca4bc1bb5e4c0334c0f P b7ab4784c7344b939bc36f639286f377 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:19:37.890239  9851 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.574s	user 0.046s	sys 0.124s
I20260709 13:19:37.890918  9934 leader_election.cc:290] T 1528ab62b6fe4e3099d08f141afee116 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 7 election: Requested vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:19:37.902606  9897 raft_consensus.cc:2804] T d8cee0accdb8499c86d4414b72565a38 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:19:37.977934  6876 raft_consensus.cc:2468] T d8cee0accdb8499c86d4414b72565a38 P cd75a17ab2604397adab03bb8b5fd75c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in term 6.
W20260709 13:19:37.980463  6772 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 77811.6us
I20260709 13:19:37.982947  6772 leader_election.cc:304] T 713b5728a197487c9300b310ab94e5a3 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:19:37.900341  9775 raft_consensus.cc:3060] T 30e88460611e47b2ba16a46a30b5f416 P b7ab4784c7344b939bc36f639286f377 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:37.887113  9898 raft_consensus.cc:697] T 4d9def8b32fd443aa94ab1420b06837b P cd75a17ab2604397adab03bb8b5fd75c [term 8 LEADER]: Becoming Leader. State: Replica: cd75a17ab2604397adab03bb8b5fd75c, State: Running, Role: LEADER
I20260709 13:19:37.998901  6876 raft_consensus.cc:1275] T d8292e16e5654be6bc408560cf256aaa P cd75a17ab2604397adab03bb8b5fd75c [term 10 FOLLOWER]: Refusing update from remote peer b7ab4784c7344b939bc36f639286f377: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:19:37.896742  9853 raft_consensus.cc:493] T bb3d8792045a4583ae2e965b1350a5b4 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 7 FOLLOWER]: Starting pre-election (detected failure of leader cd75a17ab2604397adab03bb8b5fd75c)
I20260709 13:19:38.007956  9774 raft_consensus.cc:493] T f5be3a11b23d4ea9b08300a2789821c7 P b7ab4784c7344b939bc36f639286f377 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:37.978914  9862 raft_consensus.cc:3060] T f03d0dbf16864ca4bc1bb5e4c0334c0f P b7ab4784c7344b939bc36f639286f377 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:19:37.977551  9851 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.662s	user 0.054s	sys 0.131s
I20260709 13:19:38.061069  7503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1528ab62b6fe4e3099d08f141afee116" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:19:38.062052  7503 raft_consensus.cc:2468] T 1528ab62b6fe4e3099d08f141afee116 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 7.
W20260709 13:19:38.008550  9939 log.cc:927] Time spent T fe20b4b48823486ca3b9c648db6ce8aa P cd75a17ab2604397adab03bb8b5fd75c: Append to log took a long time: real 0.129s	user 0.000s	sys 0.001s
W20260709 13:19:38.009699  9941 log.cc:927] Time spent T 7c44c4849aa54f2b94d1f1bef9ed546f P cd75a17ab2604397adab03bb8b5fd75c: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 13:19:38.067061  7498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17587d6730594da4a56fa13a353232a1" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb"
I20260709 13:19:38.067780  7498 raft_consensus.cc:3060] T 17587d6730594da4a56fa13a353232a1 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:38.069056  7494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "427c124d773f483294511e80fe340075" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb"
I20260709 13:19:38.069789  7494 raft_consensus.cc:3060] T 427c124d773f483294511e80fe340075 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:38.011327  6879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fa34c08b205435dba97346991aa1f92" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
W20260709 13:19:38.012403  9849 consensus_meta.cc:287] T 7a734b5ab7834e05a8c422208acc58b1 P b7ab4784c7344b939bc36f639286f377: Time spent flushing consensus metadata: real 0.895s	user 0.012s	sys 0.000s
I20260709 13:19:38.016527  9809 consensus_queue.cc:237] T 9b3759de40694069b13c0f8bd40e5709 P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:38.020552  9933 consensus_queue.cc:237] T 44bde925b2e541b69890d70715b85176 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:38.022264  9898 consensus_queue.cc:237] T 4d9def8b32fd443aa94ab1420b06837b P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:38.088798  6880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce4f062dcd314d43a63ca74067cb5ee3" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:19:38.090113  6880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "427c124d773f483294511e80fe340075" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:19:38.090157  7498 raft_consensus.cc:2468] T 17587d6730594da4a56fa13a353232a1 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 11.
I20260709 13:19:38.023576  9836 raft_consensus.cc:2804] T a1704639a875409b9959353527b3fd68 P b7ab4784c7344b939bc36f639286f377 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:19:38.090794  6880 raft_consensus.cc:3060] T 427c124d773f483294511e80fe340075 P cd75a17ab2604397adab03bb8b5fd75c [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:37.863144  9905 raft_consensus.cc:515] T be1a92657f494cac8dd227d152f50151 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
W20260709 13:19:38.091380  9450 consensus_meta.cc:287] T dbdf895bba214ff68685a24fd17dfb5d P b7ab4784c7344b939bc36f639286f377: Time spent flushing consensus metadata: real 0.710s	user 0.005s	sys 0.005s
I20260709 13:19:37.906390  9875 consensus_queue.cc:260] T e31b9971c15848dea59d4d4130141d9e P ccd8a4c3bfe3413cb2ae219b09aea832 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:38.092767  9875 raft_consensus.cc:3060] T e31b9971c15848dea59d4d4130141d9e P ccd8a4c3bfe3413cb2ae219b09aea832 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:38.091981  6806 raft_consensus.cc:2468] T dbdf895bba214ff68685a24fd17dfb5d P b7ab4784c7344b939bc36f639286f377 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 7.
I20260709 13:19:38.080498  9851 raft_consensus.cc:2804] T 713b5728a197487c9300b310ab94e5a3 P b7ab4784c7344b939bc36f639286f377 [term 9 FOLLOWER]: Leader election won for term 9
W20260709 13:19:38.028841  6847 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:37.909482  9901 raft_consensus.cc:740] T 44bde925b2e541b69890d70715b85176 P cd75a17ab2604397adab03bb8b5fd75c [term 8 LEADER]: Becoming Follower/Learner. State: Replica: cd75a17ab2604397adab03bb8b5fd75c, State: Running, Role: LEADER
I20260709 13:19:38.097679  9901 consensus_queue.cc:260] T 44bde925b2e541b69890d70715b85176 P cd75a17ab2604397adab03bb8b5fd75c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:38.099056  9901 raft_consensus.cc:3060] T 44bde925b2e541b69890d70715b85176 P cd75a17ab2604397adab03bb8b5fd75c [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:37.856710  9657 consensus_queue.cc:237] T 4b8cacb381b746da8d0049b0a83b41dd P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:19:37.913904  9627 raft_consensus.cc:515] T c4db81d9d329422bb3b4160ca4ac2d1d P cd75a17ab2604397adab03bb8b5fd75c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:38.102403  9627 leader_election.cc:290] T c4db81d9d329422bb3b4160ca4ac2d1d P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:19:38.103454  9836 raft_consensus.cc:697] T a1704639a875409b9959353527b3fd68 P b7ab4784c7344b939bc36f639286f377 [term 8 LEADER]: Becoming Leader. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
I20260709 13:19:38.083072  9849 raft_consensus.cc:515] T 7a734b5ab7834e05a8c422208acc58b1 P b7ab4784c7344b939bc36f639286f377 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:38.104719  9836 consensus_queue.cc:237] T a1704639a875409b9959353527b3fd68 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:38.106057  6805 raft_consensus.cc:2393] T 7a734b5ab7834e05a8c422208acc58b1 P b7ab4784c7344b939bc36f639286f377 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ccd8a4c3bfe3413cb2ae219b09aea832 in current term 9: Already voted for candidate b7ab4784c7344b939bc36f639286f377 in this term.
I20260709 13:19:38.051883  6876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab432e62819d499eaaf3dd55481dd930" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:19:38.006335  9848 raft_consensus.cc:3060] T 853ac0a8cbd64ce99457f170216d4d0f P b7ab4784c7344b939bc36f639286f377 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:38.072494  6877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77e330a82df4b43a745d57a68f6f057" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 11 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:19:38.005892  9897 raft_consensus.cc:697] T d8cee0accdb8499c86d4414b72565a38 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 8 LEADER]: Becoming Leader. State: Replica: 7ba59cc884714e8aa5f3f0ecaed84cbb, State: Running, Role: LEADER
I20260709 13:19:38.128675  6876 raft_consensus.cc:2468] T ab432e62819d499eaaf3dd55481dd930 P cd75a17ab2604397adab03bb8b5fd75c [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 9.
I20260709 13:19:38.124612  6881 raft_consensus.cc:1240] T 20f6842e26174571996b8dea4151d4be P cd75a17ab2604397adab03bb8b5fd75c [term 9 FOLLOWER]: Rejecting Update request from peer b7ab4784c7344b939bc36f639286f377 for earlier term 8. Current term is 9. Ops: [6.5-8.6]
W20260709 13:19:38.065243  9874 consensus_meta.cc:287] T 427c124d773f483294511e80fe340075 P ccd8a4c3bfe3413cb2ae219b09aea832: Time spent flushing consensus metadata: real 0.691s	user 0.013s	sys 0.000s
I20260709 13:19:38.086624  6879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d33d5ee8ef6f415593d8df52063161ad" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:19:38.121578  6875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de3186201e1a40d0b335eeb8b4e256e0" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:19:38.138392  6879 raft_consensus.cc:2468] T d33d5ee8ef6f415593d8df52063161ad P cd75a17ab2604397adab03bb8b5fd75c [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 9.
I20260709 13:19:38.139348  6875 raft_consensus.cc:2393] T de3186201e1a40d0b335eeb8b4e256e0 P cd75a17ab2604397adab03bb8b5fd75c [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7ab4784c7344b939bc36f639286f377 in current term 9: Already voted for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in this term.
I20260709 13:19:38.127122  6804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c7f33e544204fbaac4078e3e83bbf4e" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:19:38.140336  6804 raft_consensus.cc:3060] T 8c7f33e544204fbaac4078e3e83bbf4e P b7ab4784c7344b939bc36f639286f377 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:38.124545  6803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b3759de40694069b13c0f8bd40e5709" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:19:38.141571  6803 raft_consensus.cc:3060] T 9b3759de40694069b13c0f8bd40e5709 P b7ab4784c7344b939bc36f639286f377 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:38.126188  6800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90d42e216d9741e190bca19a781291fd" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:19:38.128129  6799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22ccee1b570c4ad3a57bd7aec085b1b4" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:19:38.110250  9905 leader_election.cc:290] T be1a92657f494cac8dd227d152f50151 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 10 election: Requested vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:19:38.130033  6877 raft_consensus.cc:2468] T e77e330a82df4b43a745d57a68f6f057 P cd75a17ab2604397adab03bb8b5fd75c [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 10.
W20260709 13:19:38.144562  6847 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:38.063076  9774 raft_consensus.cc:515] T f5be3a11b23d4ea9b08300a2789821c7 P b7ab4784c7344b939bc36f639286f377 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
W20260709 13:19:38.083971  9890 consensus_meta.cc:287] T bd6869f07b5a4885a0b99fbe60c3b175 P ccd8a4c3bfe3413cb2ae219b09aea832: Time spent flushing consensus metadata: real 1.064s	user 0.012s	sys 0.000s
I20260709 13:19:38.144656  6880 raft_consensus.cc:2468] T 427c124d773f483294511e80fe340075 P cd75a17ab2604397adab03bb8b5fd75c [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 7.
I20260709 13:19:38.110502  9851 raft_consensus.cc:697] T 713b5728a197487c9300b310ab94e5a3 P b7ab4784c7344b939bc36f639286f377 [term 9 LEADER]: Becoming Leader. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
W20260709 13:19:38.120751  9931 log.cc:927] Time spent T be1a92657f494cac8dd227d152f50151 P b7ab4784c7344b939bc36f639286f377: Append to log took a long time: real 0.668s	user 0.001s	sys 0.004s
W20260709 13:19:38.125402  9943 log.cc:927] Time spent T 3fa34c08b205435dba97346991aa1f92 P cd75a17ab2604397adab03bb8b5fd75c: Append to log took a long time: real 0.146s	user 0.000s	sys 0.001s
W20260709 13:19:38.153080  7466 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 250351us
I20260709 13:19:38.116322  9715 raft_consensus.cc:3055] T 20f6842e26174571996b8dea4151d4be P b7ab4784c7344b939bc36f639286f377 [term 8 LEADER]: Stepping down as leader of term 8
W20260709 13:19:38.125073  6616 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 427c124d773f483294511e80fe340075 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER failed with leader 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 7ba59cc884714e8aa5f3f0ecaed84cbb is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 6 committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } attrs { replace: true } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } } }
W20260709 13:19:38.183951  6616 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.5.126.68:45071, user_credentials={real_user=slave}} blocked reactor thread for 58975us
I20260709 13:19:38.181221  9715 raft_consensus.cc:740] T 20f6842e26174571996b8dea4151d4be P b7ab4784c7344b939bc36f639286f377 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
I20260709 13:19:38.184719  6772 leader_election.cc:304] T 1528ab62b6fe4e3099d08f141afee116 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, b7ab4784c7344b939bc36f639286f377; no voters: 
I20260709 13:19:38.185784  6772 leader_election.cc:304] T 17587d6730594da4a56fa13a353232a1 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, b7ab4784c7344b939bc36f639286f377; no voters: 
I20260709 13:19:38.185956  6800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4b8bd455d5a47c18a1380839c6e0d61" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:19:38.186579  6800 raft_consensus.cc:3060] T f4b8bd455d5a47c18a1380839c6e0d61 P b7ab4784c7344b939bc36f639286f377 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:38.188378  9863 raft_consensus.cc:493] T f3f9c2e2bf644115957398fe4c9459db P b7ab4784c7344b939bc36f639286f377 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:38.190305  6879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8cee0accdb8499c86d4414b72565a38" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:19:38.191238  6879 raft_consensus.cc:3060] T d8cee0accdb8499c86d4414b72565a38 P cd75a17ab2604397adab03bb8b5fd75c [term 6 FOLLOWER]: Advancing to term 8
I20260709 13:19:38.066233  9853 raft_consensus.cc:515] T bb3d8792045a4583ae2e965b1350a5b4 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:19:38.196211  9856 raft_consensus.cc:493] T 44bde925b2e541b69890d70715b85176 P b7ab4784c7344b939bc36f639286f377 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:38.196771  9856 raft_consensus.cc:515] T 44bde925b2e541b69890d70715b85176 P b7ab4784c7344b939bc36f639286f377 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:38.188923  9863 raft_consensus.cc:515] T f3f9c2e2bf644115957398fe4c9459db P b7ab4784c7344b939bc36f639286f377 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:38.198635  9853 leader_election.cc:290] T bb3d8792045a4583ae2e965b1350a5b4 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:38.199717  9771 raft_consensus.cc:493] T f58dc08b12a2494bb9a1372837970ca2 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:38.200321  9771 raft_consensus.cc:515] T f58dc08b12a2494bb9a1372837970ca2 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:38.086691  9945 raft_consensus.cc:2804] T a3022224cc81473690653a83d4e99470 P b7ab4784c7344b939bc36f639286f377 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:19:38.148809  9874 raft_consensus.cc:2749] T 427c124d773f483294511e80fe340075 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:19:38.202112  6772 leader_election.cc:304] T ab432e62819d499eaaf3dd55481dd930 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:19:38.205487  6873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24ee15416e3145beaa1b8183453729a3" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:19:38.210870  6873 raft_consensus.cc:2468] T 24ee15416e3145beaa1b8183453729a3 P cd75a17ab2604397adab03bb8b5fd75c [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in term 8.
I20260709 13:19:38.212598  6803 raft_consensus.cc:2468] T 9b3759de40694069b13c0f8bd40e5709 P b7ab4784c7344b939bc36f639286f377 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 8.
W20260709 13:19:38.229955  6770 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 356299us
I20260709 13:19:38.217788  6803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "853ac0a8cbd64ce99457f170216d4d0f" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:19:38.232115  6770 leader_election.cc:304] T 95a75bfe094d4bdc963aba3f08dfcd25 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:19:38.235096  6800 raft_consensus.cc:2468] T f4b8bd455d5a47c18a1380839c6e0d61 P b7ab4784c7344b939bc36f639286f377 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 8.
I20260709 13:19:38.237975  6730 raft_consensus.cc:3060] T 427c124d773f483294511e80fe340075 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:38.245647  6873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8cee0accdb8499c86d4414b72565a38" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:19:38.214388  9744 raft_consensus.cc:2804] T 1528ab62b6fe4e3099d08f141afee116 P b7ab4784c7344b939bc36f639286f377 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:19:38.195926  9864 raft_consensus.cc:493] T c4db81d9d329422bb3b4160ca4ac2d1d P b7ab4784c7344b939bc36f639286f377 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:19:38.214733  9450 raft_consensus.cc:2804] T 17587d6730594da4a56fa13a353232a1 P b7ab4784c7344b939bc36f639286f377 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:19:38.229647  9907 raft_consensus.cc:493] T d8292e16e5654be6bc408560cf256aaa P ccd8a4c3bfe3413cb2ae219b09aea832 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:38.278075  6800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f03d0dbf16864ca4bc1bb5e4c0334c0f" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:19:38.155862  9890 raft_consensus.cc:515] T bd6869f07b5a4885a0b99fbe60c3b175 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
W20260709 13:19:38.289798  9880 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.530s	user 0.055s	sys 0.043s
I20260709 13:19:38.258126  9744 raft_consensus.cc:493] T 1528ab62b6fe4e3099d08f141afee116 P b7ab4784c7344b939bc36f639286f377 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:38.285650  9874 raft_consensus.cc:493] T f5be3a11b23d4ea9b08300a2789821c7 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:38.300225  6876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe20b4b48823486ca3b9c648db6ce8aa" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:19:38.304831  6879 raft_consensus.cc:2468] T d8cee0accdb8499c86d4414b72565a38 P cd75a17ab2604397adab03bb8b5fd75c [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in term 8.
I20260709 13:19:38.282454  9849 leader_election.cc:290] T 7a734b5ab7834e05a8c422208acc58b1 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 9 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:38.215472  9949 consensus_queue.cc:1048] T d8292e16e5654be6bc408560cf256aaa P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 1, Time since last communication: 0.084s
I20260709 13:19:38.301625  9785 raft_consensus.cc:493] T 4f00a2e87e56452083b759f60d461ee3 P b7ab4784c7344b939bc36f639286f377 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:38.364846  9785 raft_consensus.cc:515] T 4f00a2e87e56452083b759f60d461ee3 P b7ab4784c7344b939bc36f639286f377 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
W20260709 13:19:38.364940  6845 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:38.369736  6876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fa34c08b205435dba97346991aa1f92" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:19:38.282786  9864 raft_consensus.cc:515] T c4db81d9d329422bb3b4160ca4ac2d1d P b7ab4784c7344b939bc36f639286f377 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:38.405278  7503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be1a92657f494cac8dd227d152f50151" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb"
W20260709 13:19:38.311506  9880 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.551s	user 0.055s	sys 0.044s
I20260709 13:19:38.425164  6801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c240553ce044eedb41541d72b9475d7" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:19:38.425993  6801 raft_consensus.cc:3060] T 2c240553ce044eedb41541d72b9475d7 P b7ab4784c7344b939bc36f639286f377 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:38.426353  7496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1528ab62b6fe4e3099d08f141afee116" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb"
I20260709 13:19:38.427311  7496 raft_consensus.cc:2393] T 1528ab62b6fe4e3099d08f141afee116 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate ccd8a4c3bfe3413cb2ae219b09aea832 in current term 7: Already voted for candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in this term.
I20260709 13:19:38.301213  7494 raft_consensus.cc:2468] T 427c124d773f483294511e80fe340075 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 7.
W20260709 13:19:38.302130  9832 consensus_meta.cc:287] T 22ccee1b570c4ad3a57bd7aec085b1b4 P b7ab4784c7344b939bc36f639286f377: Time spent flushing consensus metadata: real 1.285s	user 0.014s	sys 0.000s
I20260709 13:19:38.290583  9954 raft_consensus.cc:493] T 711ef6523deb4cbe8ef2ba61e1c21c98 P b7ab4784c7344b939bc36f639286f377 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:38.353452  9744 raft_consensus.cc:3060] T 1528ab62b6fe4e3099d08f141afee116 P b7ab4784c7344b939bc36f639286f377 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:38.452608  6876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3d8792045a4583ae2e965b1350a5b4" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:19:38.364205  9945 raft_consensus.cc:697] T a3022224cc81473690653a83d4e99470 P b7ab4784c7344b939bc36f639286f377 [term 9 LEADER]: Becoming Leader. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
I20260709 13:19:38.457191  9832 raft_consensus.cc:515] T 22ccee1b570c4ad3a57bd7aec085b1b4 P b7ab4784c7344b939bc36f639286f377 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:38.424425  9785 leader_election.cc:290] T 4f00a2e87e56452083b759f60d461ee3 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:19:38.294198  9851 consensus_queue.cc:237] T 713b5728a197487c9300b310ab94e5a3 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 8.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:38.283625  9897 consensus_queue.cc:237] T d8cee0accdb8499c86d4414b72565a38 P 7ba59cc884714e8aa5f3f0ecaed84cbb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:19:38.292230  9907 raft_consensus.cc:515] T d8292e16e5654be6bc408560cf256aaa P ccd8a4c3bfe3413cb2ae219b09aea832 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:38.369246  9874 raft_consensus.cc:515] T f5be3a11b23d4ea9b08300a2789821c7 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
W20260709 13:19:38.506719  9805 consensus_meta.cc:287] T 7c44c4849aa54f2b94d1f1bef9ed546f P b7ab4784c7344b939bc36f639286f377: Time spent flushing consensus metadata: real 1.027s	user 0.013s	sys 0.005s
I20260709 13:19:38.491829  9873 raft_consensus.cc:493] T 4d9def8b32fd443aa94ab1420b06837b P ccd8a4c3bfe3413cb2ae219b09aea832 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:38.309944  6772 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 107169us
I20260709 13:19:38.368355  9958 raft_consensus.cc:2804] T ab432e62819d499eaaf3dd55481dd930 P b7ab4784c7344b939bc36f639286f377 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:19:38.469112  9849 raft_consensus.cc:2804] T 95a75bfe094d4bdc963aba3f08dfcd25 P b7ab4784c7344b939bc36f639286f377 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:19:38.551715  9958 raft_consensus.cc:493] T ab432e62819d499eaaf3dd55481dd930 P b7ab4784c7344b939bc36f639286f377 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:38.552188  9849 raft_consensus.cc:697] T 95a75bfe094d4bdc963aba3f08dfcd25 P b7ab4784c7344b939bc36f639286f377 [term 10 LEADER]: Becoming Leader. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
I20260709 13:19:38.553880  9849 consensus_queue.cc:237] T 95a75bfe094d4bdc963aba3f08dfcd25 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 8.3, Last appended by leader: 3, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:38.534330  6799 raft_consensus.cc:2393] T 22ccee1b570c4ad3a57bd7aec085b1b4 P b7ab4784c7344b939bc36f639286f377 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ccd8a4c3bfe3413cb2ae219b09aea832 in current term 8: Already voted for candidate b7ab4784c7344b939bc36f639286f377 in this term.
I20260709 13:19:38.507268  9771 leader_election.cc:290] T f58dc08b12a2494bb9a1372837970ca2 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:38.552287  9958 raft_consensus.cc:3060] T ab432e62819d499eaaf3dd55481dd930 P b7ab4784c7344b939bc36f639286f377 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:38.548629  7468 leader_election.cc:304] T 24ee15416e3145beaa1b8183453729a3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:19:38.557238  5625 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:19:38.510342  6770 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 278311us
W20260709 13:19:38.550632  6844 connection.cc:256] RPC call timeout handler was delayed by -2.9363402250000945s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.165s for a response
W20260709 13:19:38.589701  6844 connection.cc:256] RPC call timeout handler was delayed by -2.9165402250000625s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16720000000000002s for a response
W20260709 13:19:38.590256  6844 connection.cc:256] RPC call timeout handler was delayed by -2.905740225000045s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1684s for a response
W20260709 13:19:38.590719  6844 connection.cc:256] RPC call timeout handler was delayed by -2.8229402249999112s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1776s for a response
W20260709 13:19:38.591187  6844 connection.cc:256] RPC call timeout handler was delayed by -2.7464402250000148s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18610000000000002s for a response
W20260709 13:19:38.591697  6844 connection.cc:256] RPC call timeout handler was delayed by -2.6870402249999188s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1927s for a response
W20260709 13:19:38.592203  6844 connection.cc:256] RPC call timeout handler was delayed by -2.641140225000072s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1978s for a response
W20260709 13:19:38.592658  6844 connection.cc:256] RPC call timeout handler was delayed by -2.599740225000005s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20240000000000002s for a response
W20260709 13:19:38.593122  6844 connection.cc:256] RPC call timeout handler was delayed by -2.5637402249999468s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20640000000000003s for a response
W20260709 13:19:38.593564  6844 connection.cc:256] RPC call timeout handler was delayed by -2.5151402250000956s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2118s for a response
W20260709 13:19:38.594015  6844 connection.cc:256] RPC call timeout handler was delayed by -2.5097402250000869s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21240000000000003s for a response
W20260709 13:19:38.596938  6844 connection.cc:256] RPC call timeout handler was delayed by -2.4512402249999923s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2189s for a response
W20260709 13:19:38.597400  6844 connection.cc:256] RPC call timeout handler was delayed by -2.4314402249999603s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2211s for a response
W20260709 13:19:38.597725  6844 connection.cc:256] RPC call timeout handler was delayed by -2.4206402249999428s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2223s for a response
W20260709 13:19:38.598042  6844 connection.cc:256] RPC call timeout handler was delayed by -2.1335402249999333s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2542s for a response
W20260709 13:19:38.598364  6844 connection.cc:256] RPC call timeout handler was delayed by -1.9652402249998886s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.27290000000000003s for a response
W20260709 13:19:38.598686  6844 connection.cc:256] RPC call timeout handler was delayed by -1.8590402249999443s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2847s for a response
W20260709 13:19:38.599092  6844 connection.cc:256] RPC call timeout handler was delayed by -1.331640225000001s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.3433s for a response
I20260709 13:19:38.598701  6770 leader_election.cc:304] T d33d5ee8ef6f415593d8df52063161ad P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
I20260709 13:19:38.599911  6844 leader_election.cc:304] T f3f9c2e2bf644115957398fe4c9459db P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
W20260709 13:19:38.602002  7468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 53507.6us
I20260709 13:19:38.610432  7468 leader_election.cc:304] T fe20b4b48823486ca3b9c648db6ce8aa P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:19:38.507783  9775 raft_consensus.cc:515] T 30e88460611e47b2ba16a46a30b5f416 P b7ab4784c7344b939bc36f639286f377 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:38.472954  9954 raft_consensus.cc:515] T 711ef6523deb4cbe8ef2ba61e1c21c98 P b7ab4784c7344b939bc36f639286f377 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:38.640463  7468 leader_election.cc:304] T 3fa34c08b205435dba97346991aa1f92 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
W20260709 13:19:38.649021  6770 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 48218.9us
I20260709 13:19:38.651572  7496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f00a2e87e56452083b759f60d461ee3" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
W20260709 13:19:38.660497  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 60646.5us
I20260709 13:19:38.661629  6844 leader_election.cc:304] T f03d0dbf16864ca4bc1bb5e4c0334c0f P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377
I20260709 13:19:38.595341  9450 raft_consensus.cc:697] T 17587d6730594da4a56fa13a353232a1 P b7ab4784c7344b939bc36f639286f377 [term 11 LEADER]: Becoming Leader. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
I20260709 13:19:38.650297  6770 leader_election.cc:304] T e77e330a82df4b43a745d57a68f6f057 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
I20260709 13:19:38.542474  9805 raft_consensus.cc:515] T 7c44c4849aa54f2b94d1f1bef9ed546f P b7ab4784c7344b939bc36f639286f377 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
W20260709 13:19:38.645880  9892 consensus_meta.cc:287] T bd6869f07b5a4885a0b99fbe60c3b175 P cd75a17ab2604397adab03bb8b5fd75c: Time spent flushing consensus metadata: real 1.429s	user 0.012s	sys 0.007s
W20260709 13:19:38.687383  6804 consensus_meta.cc:287] T 8c7f33e544204fbaac4078e3e83bbf4e P b7ab4784c7344b939bc36f639286f377: Time spent flushing consensus metadata: real 0.546s	user 0.013s	sys 0.004s
I20260709 13:19:38.563570  9873 raft_consensus.cc:515] T 4d9def8b32fd443aa94ab1420b06837b P ccd8a4c3bfe3413cb2ae219b09aea832 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:38.674350  6844 leader_election.cc:304] T 95a75bfe094d4bdc963aba3f08dfcd25 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:19:38.607735  9785 consensus_queue.cc:1048] T d8292e16e5654be6bc408560cf256aaa P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.067s
W20260709 13:19:38.711879  6770 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 61691.4us
I20260709 13:19:38.717301  6726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c37d41cd9164c15a6826ca62a851a69" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:19:38.601964  9949 consensus_queue.cc:1059] T 90d42e216d9741e190bca19a781291fd P b7ab4784c7344b939bc36f639286f377 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.067s
W20260709 13:19:38.671669  9962 log.cc:927] Time spent T 34f36d59d88f40fe8a2805e604fc6c0a P ccd8a4c3bfe3413cb2ae219b09aea832: Append to log took a long time: real 0.147s	user 0.001s	sys 0.000s
I20260709 13:19:38.688416  9627 raft_consensus.cc:2764] T f03d0dbf16864ca4bc1bb5e4c0334c0f P cd75a17ab2604397adab03bb8b5fd75c [term 7 FOLLOWER]: Leader pre-election decision vote started in defunct term 5: won
I20260709 13:19:38.699470  6804 raft_consensus.cc:2468] T 8c7f33e544204fbaac4078e3e83bbf4e P b7ab4784c7344b939bc36f639286f377 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 6.
I20260709 13:19:38.734927  6726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a734b5ab7834e05a8c422208acc58b1" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 9 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:19:38.755002  6726 raft_consensus.cc:3060] T 7a734b5ab7834e05a8c422208acc58b1 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:38.738005  6725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44bde925b2e541b69890d70715b85176" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:19:38.755188  6802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de3186201e1a40d0b335eeb8b4e256e0" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:19:38.691954  9903 raft_consensus.cc:2804] T 24ee15416e3145beaa1b8183453729a3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:19:38.755934  6802 raft_consensus.cc:3060] T de3186201e1a40d0b335eeb8b4e256e0 P b7ab4784c7344b939bc36f639286f377 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:38.692600  9947 raft_consensus.cc:3060] T f3f9c2e2bf644115957398fe4c9459db P cd75a17ab2604397adab03bb8b5fd75c [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:38.695025  9953 raft_consensus.cc:2749] T 3fa34c08b205435dba97346991aa1f92 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:19:38.671257  9964 raft_consensus.cc:493] T 4f00a2e87e56452083b759f60d461ee3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:38.692104  9955 log.cc:927] Time spent T 3a485a995abc4807b6e511e45419f737 P cd75a17ab2604397adab03bb8b5fd75c: Append to log took a long time: real 0.110s	user 0.000s	sys 0.000s
W20260709 13:19:38.744486  6730 consensus_meta.cc:287] T 427c124d773f483294511e80fe340075 P ccd8a4c3bfe3413cb2ae219b09aea832: Time spent flushing consensus metadata: real 0.506s	user 0.011s	sys 0.004s
I20260709 13:19:38.708717  6801 raft_consensus.cc:2468] T 2c240553ce044eedb41541d72b9475d7 P b7ab4784c7344b939bc36f639286f377 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 10.
I20260709 13:19:38.675482  9957 raft_consensus.cc:493] T 404190ce4ce94cecbfcb6ea9d1dd8626 P b7ab4784c7344b939bc36f639286f377 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 7ba59cc884714e8aa5f3f0ecaed84cbb)
W20260709 13:19:38.748910  6696 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:38.695281  9969 raft_consensus.cc:2804] T d33d5ee8ef6f415593d8df52063161ad P b7ab4784c7344b939bc36f639286f377 [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 13:19:38.740788  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 66547.7us
I20260709 13:19:38.739995  6731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f9c2e2bf644115957398fe4c9459db" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:19:38.779472  6731 raft_consensus.cc:2393] T f3f9c2e2bf644115957398fe4c9459db P ccd8a4c3bfe3413cb2ae219b09aea832 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7ab4784c7344b939bc36f639286f377 in current term 8: Already voted for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in this term.
I20260709 13:19:38.759079  6804 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:32976 (request call id 2412) took 1221 ms. Trace:
W20260709 13:19:38.743319  9836 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.503s	user 0.034s	sys 0.106s
I20260709 13:19:38.692898  9965 raft_consensus.cc:2749] T fe20b4b48823486ca3b9c648db6ce8aa P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:19:38.763324  6732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4db81d9d329422bb3b4160ca4ac2d1d" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
W20260709 13:19:38.726187  9875 consensus_meta.cc:287] T e31b9971c15848dea59d4d4130141d9e P ccd8a4c3bfe3413cb2ae219b09aea832: Time spent flushing consensus metadata: real 0.633s	user 0.013s	sys 0.000s
I20260709 13:19:38.765062  6724 raft_consensus.cc:1240] T 20f6842e26174571996b8dea4151d4be P ccd8a4c3bfe3413cb2ae219b09aea832 [term 9 FOLLOWER]: Rejecting Update request from peer b7ab4784c7344b939bc36f639286f377 for earlier term 8. Current term is 9. Ops: [6.5-8.6]
I20260709 13:19:38.765859  6723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5be3a11b23d4ea9b08300a2789821c7" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:19:38.763222  9903 raft_consensus.cc:493] T 24ee15416e3145beaa1b8183453729a3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:38.771512  6801 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:32976 (request call id 2417) took 1232 ms. Trace:
I20260709 13:19:38.704358  9892 raft_consensus.cc:2749] T bd6869f07b5a4885a0b99fbe60c3b175 P cd75a17ab2604397adab03bb8b5fd75c [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:19:38.724269  9890 leader_election.cc:290] T bd6869f07b5a4885a0b99fbe60c3b175 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 9 election: Requested vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:38.671016  9967 consensus_queue.cc:1059] T 20f6842e26174571996b8dea4151d4be P b7ab4784c7344b939bc36f639286f377 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.199s
I20260709 13:19:38.780727  6804 rpcz_store.cc:276] 0709 13:19:37.537429 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:38.126870 (+589441us) service_pool.cc:224] Handling call
0709 13:19:38.758997 (+632127us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:38.786584  6725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "427c124d773f483294511e80fe340075" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:19:38.692925  9966 consensus_queue.cc:1048] T f58dc08b12a2494bb9a1372837970ca2 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.110s
I20260709 13:19:38.788755  6729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4275cf08e63345f993bce8664eada830" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:19:38.791007  6723 raft_consensus.cc:2468] T f5be3a11b23d4ea9b08300a2789821c7 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 6.
I20260709 13:19:38.771184  6730 raft_consensus.cc:2468] T 427c124d773f483294511e80fe340075 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 7.
I20260709 13:19:38.791616  6844 leader_election.cc:304] T 3fa34c08b205435dba97346991aa1f92 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:19:38.792062  6801 rpcz_store.cc:276] 0709 13:19:37.538684 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:38.424818 (+886134us) service_pool.cc:224] Handling call
0709 13:19:38.771439 (+346621us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:19:38.780802  9888 consensus_meta.cc:287] T b3f13b31a1f84f0d89d007eadd57924c P ccd8a4c3bfe3413cb2ae219b09aea832: Time spent flushing consensus metadata: real 1.404s	user 0.013s	sys 0.004s
I20260709 13:19:38.797952  6731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22ccee1b570c4ad3a57bd7aec085b1b4" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:19:38.815248  6731 raft_consensus.cc:2393] T 22ccee1b570c4ad3a57bd7aec085b1b4 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c in current term 7: Already voted for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in this term.
I20260709 13:19:38.799584  6802 raft_consensus.cc:2468] T de3186201e1a40d0b335eeb8b4e256e0 P b7ab4784c7344b939bc36f639286f377 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 9.
I20260709 13:19:38.782920  9969 raft_consensus.cc:493] T d33d5ee8ef6f415593d8df52063161ad P b7ab4784c7344b939bc36f639286f377 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:38.801026  6732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c7f33e544204fbaac4078e3e83bbf4e" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:19:38.662823  9945 consensus_queue.cc:237] T a3022224cc81473690653a83d4e99470 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
W20260709 13:19:38.787119  9836 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.553s	user 0.034s	sys 0.107s
I20260709 13:19:38.801811  6724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d65025eea89441290d85dd053810e31" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:19:38.798739  9903 raft_consensus.cc:3060] T 24ee15416e3145beaa1b8183453729a3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:38.816344  6802 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:32976 (request call id 2415) took 1278 ms. Trace:
I20260709 13:19:38.823465  6732 raft_consensus.cc:2393] T 8c7f33e544204fbaac4078e3e83bbf4e P ccd8a4c3bfe3413cb2ae219b09aea832 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c in current term 6: Already voted for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in this term.
I20260709 13:19:38.786747  9864 leader_election.cc:290] T c4db81d9d329422bb3b4160ca4ac2d1d P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:38.826606  6723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3d8792045a4583ae2e965b1350a5b4" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:19:38.827498  6801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20f6842e26174571996b8dea4151d4be" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:19:38.828727  6724 raft_consensus.cc:3060] T 3d65025eea89441290d85dd053810e31 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:38.831774  6731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e31b9971c15848dea59d4d4130141d9e" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:19:38.804919  9627 raft_consensus.cc:2749] T 95a75bfe094d4bdc963aba3f08dfcd25 P cd75a17ab2604397adab03bb8b5fd75c [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:19:38.830572  6801 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:32976 (request call id 2414) took 1292 ms. Trace:
W20260709 13:19:38.831751  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 45692.7us
I20260709 13:19:38.828858  6802 rpcz_store.cc:276] 0709 13:19:37.538192 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:38.754909 (+1216717us) service_pool.cc:224] Handling call
0709 13:19:38.816268 (+ 61359us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:38.846580  6801 rpcz_store.cc:276] 0709 13:19:37.537957 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:38.810880 (+1272923us) service_pool.cc:224] Handling call
0709 13:19:38.830484 (+ 19604us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:38.849093  6844 leader_election.cc:304] T 07a92dd554674067a83a9cb68c4773f2 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:19:38.850127  6804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1528ab62b6fe4e3099d08f141afee116" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:19:38.779306  9964 raft_consensus.cc:515] T 4f00a2e87e56452083b759f60d461ee3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:19:38.816906  9785 raft_consensus.cc:2804] T e77e330a82df4b43a745d57a68f6f057 P b7ab4784c7344b939bc36f639286f377 [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 13:19:38.853412  6845 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:38.823577  9969 raft_consensus.cc:3060] T d33d5ee8ef6f415593d8df52063161ad P b7ab4784c7344b939bc36f639286f377 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:38.783221  9957 raft_consensus.cc:515] T 404190ce4ce94cecbfcb6ea9d1dd8626 P b7ab4784c7344b939bc36f639286f377 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:19:38.824565  9832 leader_election.cc:290] T 22ccee1b570c4ad3a57bd7aec085b1b4 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 8 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:38.823081  9898 raft_consensus.cc:2749] T 3fa34c08b205435dba97346991aa1f92 P cd75a17ab2604397adab03bb8b5fd75c [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:19:38.866180  6731 raft_consensus.cc:2468] T e31b9971c15848dea59d4d4130141d9e P ccd8a4c3bfe3413cb2ae219b09aea832 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 6.
I20260709 13:19:38.869481  6844 leader_election.cc:304] T ce4f062dcd314d43a63ca74067cb5ee3 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377
I20260709 13:19:38.874111  6732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4db81d9d329422bb3b4160ca4ac2d1d" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:19:38.884831  7496 raft_consensus.cc:2468] T 4f00a2e87e56452083b759f60d461ee3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 8.
I20260709 13:19:38.886040  6731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab432e62819d499eaaf3dd55481dd930" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:19:38.887910  6874 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53416 (request call id 2536) took 1666 ms. Trace:
I20260709 13:19:38.888052  6724 raft_consensus.cc:2468] T 3d65025eea89441290d85dd053810e31 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 7.
I20260709 13:19:38.889501  9805 leader_election.cc:290] T 7c44c4849aa54f2b94d1f1bef9ed546f P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 10 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:38.890002  9978 raft_consensus.cc:493] T be1a92657f494cac8dd227d152f50151 P b7ab4784c7344b939bc36f639286f377 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 7ba59cc884714e8aa5f3f0ecaed84cbb)
I20260709 13:19:38.890990  6790 tablet_service.cc:1558] Processing DeleteTablet for tablet 24ee15416e3145beaa1b8183453729a3 with delete_type TABLET_DATA_TOMBSTONED (TS b7ab4784c7344b939bc36f639286f377 not found in new config with opid_index 7) from {username='slave'} at 127.0.0.1:41714
I20260709 13:19:38.862553  9874 leader_election.cc:290] T f5be3a11b23d4ea9b08300a2789821c7 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
W20260709 13:19:38.892520  9956 log.cc:927] Time spent T 3fa34c08b205435dba97346991aa1f92 P 7ba59cc884714e8aa5f3f0ecaed84cbb: Append to log took a long time: real 0.230s	user 0.000s	sys 0.001s
I20260709 13:19:38.893384  6732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24ee15416e3145beaa1b8183453729a3" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:19:38.895365  6724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbdf895bba214ff68685a24fd17dfb5d" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:19:38.890707  9978 raft_consensus.cc:515] T be1a92657f494cac8dd227d152f50151 P b7ab4784c7344b939bc36f639286f377 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:19:38.862170  9785 raft_consensus.cc:493] T e77e330a82df4b43a745d57a68f6f057 P b7ab4784c7344b939bc36f639286f377 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:38.825398  9888 raft_consensus.cc:515] T b3f13b31a1f84f0d89d007eadd57924c P ccd8a4c3bfe3413cb2ae219b09aea832 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:19:38.871627  9907 leader_election.cc:290] T d8292e16e5654be6bc408560cf256aaa P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:38.914225  6726 raft_consensus.cc:2468] T 7a734b5ab7834e05a8c422208acc58b1 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 9.
I20260709 13:19:38.888816  6874 rpcz_store.cc:276] 0709 13:19:37.221209 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:37.431706 (+210497us) service_pool.cc:224] Handling call
0709 13:19:37.432265 (+   559us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:37.492376 (+ 60111us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:19:37.899525 (+407149us) log.cc:844] Serialized 14 byte log entry
0709 13:19:38.150010 (+250485us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:38.150433 (+   423us) log.cc:844] Serialized 26 byte log entry
0709 13:19:38.160772 (+ 10339us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:19:38.160841 (+    69us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:38.160941 (+   100us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:38.887612 (+726671us) raft_consensus.cc:1685] finished
0709 13:19:38.887642 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:38.887820 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":59550,"prepare.queue_time_us":614101,"prepare.run_cpu_time_us":42,"prepare.run_wall_time_us":44,"raft.queue_time_us":61782,"raft.run_cpu_time_us":263,"raft.run_wall_time_us":6407,"thread_start_us":536662,"threads_started":2,"wal-append.queue_time_us":343542}
I20260709 13:19:38.914286  9627 raft_consensus.cc:2804] T ce4f062dcd314d43a63ca74067cb5ee3 P cd75a17ab2604397adab03bb8b5fd75c [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:19:38.915776  7503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be1a92657f494cac8dd227d152f50151" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
W20260709 13:19:38.916446  9971 log.cc:927] Time spent T 44bde925b2e541b69890d70715b85176 P ccd8a4c3bfe3413cb2ae219b09aea832: Append to log took a long time: real 0.056s	user 0.000s	sys 0.001s
I20260709 13:19:38.897856  9863 leader_election.cc:290] T f3f9c2e2bf644115957398fe4c9459db P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:38.902974  9957 leader_election.cc:290] T 404190ce4ce94cecbfcb6ea9d1dd8626 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:19:38.903167  9775 leader_election.cc:290] T 30e88460611e47b2ba16a46a30b5f416 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 8 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:38.870079  9892 raft_consensus.cc:2749] T 07a92dd554674067a83a9cb68c4773f2 P cd75a17ab2604397adab03bb8b5fd75c [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:19:38.907037  6732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24ee15416e3145beaa1b8183453729a3" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:19:38.907780  6798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f9c2e2bf644115957398fe4c9459db" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:19:38.896478  6724 raft_consensus.cc:3060] T dbdf895bba214ff68685a24fd17dfb5d P ccd8a4c3bfe3413cb2ae219b09aea832 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:38.918676  6798 raft_consensus.cc:3060] T f3f9c2e2bf644115957398fe4c9459db P b7ab4784c7344b939bc36f639286f377 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:19:38.897418  9968 log.cc:927] Time spent T 7887766dc6784fcaa42b35c05fea7a99 P cd75a17ab2604397adab03bb8b5fd75c: Append to log took a long time: real 0.151s	user 0.000s	sys 0.001s
I20260709 13:19:38.916400  9627 raft_consensus.cc:493] T ce4f062dcd314d43a63ca74067cb5ee3 P cd75a17ab2604397adab03bb8b5fd75c [term 7 FOLLOWER]: Starting leader election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
W20260709 13:19:38.902661  9970 log.cc:927] Time spent T 7ba5dac66ab5497e9e336f2a3c28cda5 P cd75a17ab2604397adab03bb8b5fd75c: Append to log took a long time: real 0.206s	user 0.000s	sys 0.001s
I20260709 13:19:38.883080  9949 raft_consensus.cc:493] T 4d9def8b32fd443aa94ab1420b06837b P b7ab4784c7344b939bc36f639286f377 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:38.813903  9450 consensus_queue.cc:237] T 17587d6730594da4a56fa13a353232a1 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:19:38.895973  6731 raft_consensus.cc:2393] T ab432e62819d499eaaf3dd55481dd930 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c in current term 9: Already voted for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in this term.
I20260709 13:19:38.908914  6872 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53416 (request call id 2527) took 1734 ms. Trace:
I20260709 13:19:38.920827  9925 raft_consensus.cc:2243] T 1528ab62b6fe4e3099d08f141afee116 P cd75a17ab2604397adab03bb8b5fd75c [term 6 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:38.921270  9964 leader_election.cc:290] T 4f00a2e87e56452083b759f60d461ee3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:38.921442  9898 raft_consensus.cc:493] T f58dc08b12a2494bb9a1372837970ca2 P cd75a17ab2604397adab03bb8b5fd75c [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:38.913924  9977 raft_consensus.cc:493] T de3186201e1a40d0b335eeb8b4e256e0 P cd75a17ab2604397adab03bb8b5fd75c [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:38.909384  9856 leader_election.cc:290] T 44bde925b2e541b69890d70715b85176 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:38.920710  9873 leader_election.cc:290] T 4d9def8b32fd443aa94ab1420b06837b P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:38.926275  6732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30e88460611e47b2ba16a46a30b5f416" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
W20260709 13:19:38.929435  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 60072.5us
I20260709 13:19:38.948765  6844 leader_election.cc:304] T 2c240553ce044eedb41541d72b9475d7 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377
I20260709 13:19:38.931367  6726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1528ab62b6fe4e3099d08f141afee116" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:19:38.949775  6726 raft_consensus.cc:1813] T 1528ab62b6fe4e3099d08f141afee116 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 7 FOLLOWER]: Handling vote request from an unknown peer cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:19:38.950438  6726 raft_consensus.cc:2393] T 1528ab62b6fe4e3099d08f141afee116 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c in current term 7: Already voted for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in this term.
W20260709 13:19:38.934774  9910 consensus_meta.cc:287] T 7887766dc6784fcaa42b35c05fea7a99 P ccd8a4c3bfe3413cb2ae219b09aea832: Time spent flushing consensus metadata: real 1.879s	user 0.015s	sys 0.000s
I20260709 13:19:38.930804  9627 raft_consensus.cc:3060] T ce4f062dcd314d43a63ca74067cb5ee3 P cd75a17ab2604397adab03bb8b5fd75c [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:38.939127  6798 raft_consensus.cc:2468] T f3f9c2e2bf644115957398fe4c9459db P b7ab4784c7344b939bc36f639286f377 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 8.
I20260709 13:19:38.937707  6872 rpcz_store.cc:276] 0709 13:19:37.174080 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:37.390903 (+216823us) service_pool.cc:224] Handling call
0709 13:19:37.482021 (+ 91118us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:37.488862 (+  6841us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:38.908672 (+1419810us) spinlock_profiling.cc:243] Waited 90.8 ms on lock 0x7b540005b9d0. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f9a98ad 00007fcc1496e419 00007fcc0dee5bd4 00007fcc0dee5b62 00007fcc0dee5a91 00007fcc0dee5a0c 00007fcc0dee4cc2 00007fcc0dce548c 00007fcc0dce48c6 00007fcc0dce426f
0709 13:19:38.908842 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":208880384}
I20260709 13:19:38.912405  9785 raft_consensus.cc:3060] T e77e330a82df4b43a745d57a68f6f057 P b7ab4784c7344b939bc36f639286f377 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:38.953708  6798 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:32976 (request call id 2413) took 1416 ms. Trace:
I20260709 13:19:38.954245  6798 rpcz_store.cc:276] 0709 13:19:37.537694 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:38.907460 (+1369766us) service_pool.cc:224] Handling call
0709 13:19:38.953622 (+ 46162us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:38.955492  6798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22ccee1b570c4ad3a57bd7aec085b1b4" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:19:38.956622  6724 raft_consensus.cc:2468] T dbdf895bba214ff68685a24fd17dfb5d P ccd8a4c3bfe3413cb2ae219b09aea832 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 7.
I20260709 13:19:38.957405  9888 leader_election.cc:290] T b3f13b31a1f84f0d89d007eadd57924c P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 6 election: Requested vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:19:38.958590  6844 leader_election.cc:304] T f5be3a11b23d4ea9b08300a2789821c7 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377
I20260709 13:19:38.960024  6844 leader_election.cc:304] T 7c37d41cd9164c15a6826ca62a851a69 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
W20260709 13:19:38.960412  9848 consensus_meta.cc:287] T 853ac0a8cbd64ce99457f170216d4d0f P b7ab4784c7344b939bc36f639286f377: Time spent flushing consensus metadata: real 0.815s	user 0.011s	sys 0.005s
I20260709 13:19:38.960992  9848 raft_consensus.cc:2749] T 853ac0a8cbd64ce99457f170216d4d0f P b7ab4784c7344b939bc36f639286f377 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:19:38.961916  9744 raft_consensus.cc:515] T 1528ab62b6fe4e3099d08f141afee116 P b7ab4784c7344b939bc36f639286f377 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:19:38.964224  9892 raft_consensus.cc:2764] T 2c240553ce044eedb41541d72b9475d7 P cd75a17ab2604397adab03bb8b5fd75c [term 10 FOLLOWER]: Leader pre-election decision vote started in defunct term 8: won
I20260709 13:19:38.965015  9892 raft_consensus.cc:2804] T f5be3a11b23d4ea9b08300a2789821c7 P cd75a17ab2604397adab03bb8b5fd75c [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:19:38.965519  9892 raft_consensus.cc:697] T f5be3a11b23d4ea9b08300a2789821c7 P cd75a17ab2604397adab03bb8b5fd75c [term 6 LEADER]: Becoming Leader. State: Replica: cd75a17ab2604397adab03bb8b5fd75c, State: Running, Role: LEADER
I20260709 13:19:38.966565  9809 raft_consensus.cc:2749] T 7c37d41cd9164c15a6826ca62a851a69 P cd75a17ab2604397adab03bb8b5fd75c [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:19:38.966341  9715 consensus_queue.cc:260] T 20f6842e26174571996b8dea4151d4be P b7ab4784c7344b939bc36f639286f377 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:38.967551  9715 raft_consensus.cc:3060] T 20f6842e26174571996b8dea4151d4be P b7ab4784c7344b939bc36f639286f377 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:38.968382  6804 raft_consensus.cc:2368] T 1528ab62b6fe4e3099d08f141afee116 P b7ab4784c7344b939bc36f639286f377 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 7. Current term is 8.
I20260709 13:19:38.968479  9744 leader_election.cc:290] T 1528ab62b6fe4e3099d08f141afee116 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 8 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:19:38.966395  9892 consensus_queue.cc:237] T f5be3a11b23d4ea9b08300a2789821c7 P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:38.970217  6731 raft_consensus.cc:1240] T b3f13b31a1f84f0d89d007eadd57924c P ccd8a4c3bfe3413cb2ae219b09aea832 [term 6 FOLLOWER]: Rejecting Update request from peer 7ba59cc884714e8aa5f3f0ecaed84cbb for earlier term 5. Current term is 6. Ops: []
I20260709 13:19:38.972229  9964 consensus_queue.cc:1059] T b3f13b31a1f84f0d89d007eadd57924c P 7ba59cc884714e8aa5f3f0ecaed84cbb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:19:38.946101  9984 tablet_replica.cc:333] T 24ee15416e3145beaa1b8183453729a3 P b7ab4784c7344b939bc36f639286f377: stopping tablet replica
I20260709 13:19:38.981122  9758 raft_consensus.cc:3055] T b3f13b31a1f84f0d89d007eadd57924c P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:19:38.981637  9758 raft_consensus.cc:740] T b3f13b31a1f84f0d89d007eadd57924c P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 7ba59cc884714e8aa5f3f0ecaed84cbb, State: Running, Role: LEADER
I20260709 13:19:38.982645  9758 consensus_queue.cc:260] T b3f13b31a1f84f0d89d007eadd57924c P 7ba59cc884714e8aa5f3f0ecaed84cbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:19:38.984534  9758 raft_consensus.cc:3060] T b3f13b31a1f84f0d89d007eadd57924c P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:38.986665  9967 raft_consensus.cc:3055] T 90d42e216d9741e190bca19a781291fd P b7ab4784c7344b939bc36f639286f377 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:19:38.987461  9967 raft_consensus.cc:740] T 90d42e216d9741e190bca19a781291fd P b7ab4784c7344b939bc36f639286f377 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
I20260709 13:19:38.988544  9925 raft_consensus.cc:2272] T 1528ab62b6fe4e3099d08f141afee116 P cd75a17ab2604397adab03bb8b5fd75c [term 6 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:38.989158  9774 leader_election.cc:290] T f5be3a11b23d4ea9b08300a2789821c7 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
W20260709 13:19:38.990315  6806 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:32976 (request call id 2404) took 1457 ms (client timeout 1851 ms). Trace:
W20260709 13:19:38.990779  6806 rpcz_store.cc:269] 0709 13:19:37.533268 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:37.534153 (+   885us) service_pool.cc:224] Handling call
0709 13:19:38.990130 (+1455977us) spinlock_profiling.cc:243] Waited 557 ms on lock 0x7b5400353754. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f9ae2fa 00007fcc1496fb17 00007fcc0deea6d4 00007fcc0deea662 00007fcc0deea591 00007fcc0deea50c 00007fcc0dee97c2 00007fcc0dce548c 00007fcc0dce48c6 00007fcc0dce426f
0709 13:19:38.990243 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1280626944}
I20260709 13:19:38.933107  9954 leader_election.cc:290] T 711ef6523deb4cbe8ef2ba61e1c21c98 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:38.991995  6806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44bde925b2e541b69890d70715b85176" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:19:38.992826  6806 raft_consensus.cc:2368] T 44bde925b2e541b69890d70715b85176 P b7ab4784c7344b939bc36f639286f377 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c for earlier term 8. Current term is 9.
I20260709 13:19:38.993847  6806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a75bfe094d4bdc963aba3f08dfcd25" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 9 candidate_status { last_received { term: 7 index: 2 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:19:38.974284  7502 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50742 (request call id 358) took 1314 ms. Trace:
I20260709 13:19:39.001165  6803 raft_consensus.cc:2468] T 853ac0a8cbd64ce99457f170216d4d0f P b7ab4784c7344b939bc36f639286f377 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 6.
W20260709 13:19:39.003825  6846 connection.cc:256] RPC call timeout handler was delayed by -1.1977054819999466s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 1.5s for a response
I20260709 13:19:39.006858  6877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4b8bd455d5a47c18a1380839c6e0d61" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:19:38.946491  6728 raft_consensus.cc:1240] T 44bde925b2e541b69890d70715b85176 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 9 LEADER]: Rejecting Update request from peer cd75a17ab2604397adab03bb8b5fd75c for earlier term 8. Current term is 9. Ops: []
I20260709 13:19:38.909457  9978 leader_election.cc:290] T be1a92657f494cac8dd227d152f50151 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:19:39.014393  6806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4275cf08e63345f993bce8664eada830" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:19:39.018517  6732 raft_consensus.cc:1240] T 853ac0a8cbd64ce99457f170216d4d0f P ccd8a4c3bfe3413cb2ae219b09aea832 [term 6 FOLLOWER]: Rejecting Update request from peer cd75a17ab2604397adab03bb8b5fd75c for earlier term 5. Current term is 6. Ops: []
I20260709 13:19:39.018787  6872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b3759de40694069b13c0f8bd40e5709" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:19:39.020865  9903 raft_consensus.cc:515] T 24ee15416e3145beaa1b8183453729a3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 9 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
W20260709 13:19:39.024699  6799 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:32976 (request call id 2409) took 1488 ms (client timeout 1866 ms). Trace:
W20260709 13:19:39.039181  6799 rpcz_store.cc:269] 0709 13:19:37.536677 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:38.127827 (+591150us) service_pool.cc:224] Handling call
0709 13:19:39.024465 (+896638us) spinlock_profiling.cc:243] Waited 389 ms on lock 0x7b54001a40d4. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f9ae2fa 00007fcc1496fb17 00007fcc0deea6d4 00007fcc0deea662 00007fcc0deea591 00007fcc0deea50c 00007fcc0dee97c2 00007fcc0dce548c 00007fcc0dce48c6 00007fcc0dce426f
0709 13:19:39.024625 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":894613376}
I20260709 13:19:38.973651  7494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "404190ce4ce94cecbfcb6ea9d1dd8626" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:19:39.025763  6798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8292e16e5654be6bc408560cf256aaa" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:19:38.995718  7502 rpcz_store.cc:276] 0709 13:19:37.659994 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:37.660152 (+   158us) service_pool.cc:224] Handling call
0709 13:19:37.726001 (+ 65849us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:37.762626 (+ 36625us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:37.762673 (+    47us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:37.868228 (+105555us) log.cc:844] Serialized 26 byte log entry
0709 13:19:38.218451 (+350223us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:19:38.218527 (+    76us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:38.218637 (+   110us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:38.973974 (+755337us) raft_consensus.cc:1685] finished
0709 13:19:38.974019 (+    45us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:38.974207 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":734,"raft.run_cpu_time_us":190,"raft.run_wall_time_us":92805,"thread_start_us":254627,"threads_started":1,"wal-append.queue_time_us":616501}
I20260709 13:19:38.974853  9856 raft_consensus.cc:493] T b3f13b31a1f84f0d89d007eadd57924c P b7ab4784c7344b939bc36f639286f377 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 7ba59cc884714e8aa5f3f0ecaed84cbb)
I20260709 13:19:38.940923  9949 raft_consensus.cc:515] T 4d9def8b32fd443aa94ab1420b06837b P b7ab4784c7344b939bc36f639286f377 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:39.028290  6724 raft_consensus.cc:1240] T be1a92657f494cac8dd227d152f50151 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 10 FOLLOWER]: Rejecting Update request from peer 7ba59cc884714e8aa5f3f0ecaed84cbb for earlier term 9. Current term is 10. Ops: []
W20260709 13:19:39.026181  9936 consensus_meta.cc:287] T 4275cf08e63345f993bce8664eada830 P b7ab4784c7344b939bc36f639286f377: Time spent flushing consensus metadata: real 1.028s	user 0.009s	sys 0.004s
I20260709 13:19:38.994809  9848 raft_consensus.cc:493] T 07a92dd554674067a83a9cb68c4773f2 P b7ab4784c7344b939bc36f639286f377 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:39.051193  6799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c7f33e544204fbaac4078e3e83bbf4e" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
W20260709 13:19:39.055141  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 95202.2us
I20260709 13:19:39.055998  6799 raft_consensus.cc:2393] T 8c7f33e544204fbaac4078e3e83bbf4e P b7ab4784c7344b939bc36f639286f377 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c in current term 6: Already voted for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in this term.
I20260709 13:19:38.947151  9898 raft_consensus.cc:515] T f58dc08b12a2494bb9a1372837970ca2 P cd75a17ab2604397adab03bb8b5fd75c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:39.054419  6798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab432e62819d499eaaf3dd55481dd930" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:19:39.056345  6844 leader_election.cc:304] T b56bf91d90824c959e21e0cee5ba1816 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:19:38.943871  9958 raft_consensus.cc:515] T ab432e62819d499eaaf3dd55481dd930 P b7ab4784c7344b939bc36f639286f377 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:39.037658  9981 raft_consensus.cc:493] T 34f36d59d88f40fe8a2805e604fc6c0a P b7ab4784c7344b939bc36f639286f377 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:39.064889  9978 raft_consensus.cc:493] T d8cee0accdb8499c86d4414b72565a38 P b7ab4784c7344b939bc36f639286f377 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:39.052948  9856 raft_consensus.cc:515] T b3f13b31a1f84f0d89d007eadd57924c P b7ab4784c7344b939bc36f639286f377 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:19:39.065624  9978 raft_consensus.cc:515] T d8cee0accdb8499c86d4414b72565a38 P b7ab4784c7344b939bc36f639286f377 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:19:39.066571  9903 leader_election.cc:290] T 24ee15416e3145beaa1b8183453729a3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 9 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
W20260709 13:19:39.066946  9862 consensus_meta.cc:287] T f03d0dbf16864ca4bc1bb5e4c0334c0f P b7ab4784c7344b939bc36f639286f377: Time spent flushing consensus metadata: real 0.987s	user 0.007s	sys 0.006s
I20260709 13:19:39.067397  9856 leader_election.cc:290] T b3f13b31a1f84f0d89d007eadd57924c P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:19:39.067536  9862 raft_consensus.cc:515] T f03d0dbf16864ca4bc1bb5e4c0334c0f P b7ab4784c7344b939bc36f639286f377 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:39.068200  9981 raft_consensus.cc:515] T 34f36d59d88f40fe8a2805e604fc6c0a P b7ab4784c7344b939bc36f639286f377 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:38.995100  9910 raft_consensus.cc:515] T 7887766dc6784fcaa42b35c05fea7a99 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:39.069366  6800 raft_consensus.cc:2393] T f03d0dbf16864ca4bc1bb5e4c0334c0f P b7ab4784c7344b939bc36f639286f377 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate ccd8a4c3bfe3413cb2ae219b09aea832 in current term 7: Already voted for candidate b7ab4784c7344b939bc36f639286f377 in this term.
I20260709 13:19:39.069938  6727 raft_consensus.cc:1240] T 7887766dc6784fcaa42b35c05fea7a99 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 9 FOLLOWER]: Rejecting Update request from peer b7ab4784c7344b939bc36f639286f377 for earlier term 8. Current term is 9. Ops: []
W20260709 13:19:39.047096  9918 consensus_meta.cc:287] T bb3d8792045a4583ae2e965b1350a5b4 P ccd8a4c3bfe3413cb2ae219b09aea832: Time spent flushing consensus metadata: real 1.686s	user 0.008s	sys 0.007s
I20260709 13:19:39.071686  6724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24ee15416e3145beaa1b8183453729a3" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:19:39.044925  9925 ts_tablet_manager.cc:1916] T 1528ab62b6fe4e3099d08f141afee116 P cd75a17ab2604397adab03bb8b5fd75c: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:19:38.950102  9977 raft_consensus.cc:515] T de3186201e1a40d0b335eeb8b4e256e0 P cd75a17ab2604397adab03bb8b5fd75c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:39.079020  6799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5be3a11b23d4ea9b08300a2789821c7" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:19:39.079811  6799 raft_consensus.cc:2468] T f5be3a11b23d4ea9b08300a2789821c7 P b7ab4784c7344b939bc36f639286f377 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 6.
I20260709 13:19:39.080618  6798 raft_consensus.cc:2368] T ab432e62819d499eaaf3dd55481dd930 P b7ab4784c7344b939bc36f639286f377 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c for earlier term 9. Current term is 10.
W20260709 13:19:39.082274  6805 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:32976 (request call id 2397) took 1565 ms (client timeout 2049 ms). Trace:
I20260709 13:19:39.082907  6802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f00a2e87e56452083b759f60d461ee3" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:19:39.083478  7498 raft_consensus.cc:1275] T 4f00a2e87e56452083b759f60d461ee3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 8 FOLLOWER]: Refusing update from remote peer cd75a17ab2604397adab03bb8b5fd75c: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:19:39.083645  6802 raft_consensus.cc:2468] T 4f00a2e87e56452083b759f60d461ee3 P b7ab4784c7344b939bc36f639286f377 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in term 8.
I20260709 13:19:39.084671  6802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbdf895bba214ff68685a24fd17dfb5d" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:19:39.085446  6727 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50004 (request call id 1621) took 2222 ms. Trace:
I20260709 13:19:39.085837  6727 rpcz_store.cc:276] 0709 13:19:36.862612 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:36.898154 (+ 35542us) service_pool.cc:224] Handling call
0709 13:19:36.898577 (+   423us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:39.070363 (+2171786us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:39.085217 (+ 14854us) spinlock_profiling.cc:243] Waited 2.17 s on lock 0x7b5400166a54. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f9aae01 00007fcc0f9a983e 00007fcc1496e419 00007fcc0dee5bd4 00007fcc0dee5b62 00007fcc0dee5a91 00007fcc0dee5a0c 00007fcc0dee4cc2 00007fcc0dce548c 00007fcc0dce48c6
0709 13:19:39.085389 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4993178368}
I20260709 13:19:39.086664  9949 leader_election.cc:290] T 4d9def8b32fd443aa94ab1420b06837b P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:39.079047  9809 raft_consensus.cc:2749] T b56bf91d90824c959e21e0cee5ba1816 P cd75a17ab2604397adab03bb8b5fd75c [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:19:39.082741  6805 rpcz_store.cc:269] 0709 13:19:37.517179 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:37.518559 (+  1380us) service_pool.cc:224] Handling call
0709 13:19:39.082018 (+1563459us) spinlock_profiling.cc:243] Waited 586 ms on lock 0x7b54001b58d4. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f9ae2fa 00007fcc1496fb17 00007fcc0deea6d4 00007fcc0deea662 00007fcc0deea591 00007fcc0deea50c 00007fcc0dee97c2 00007fcc0dce548c 00007fcc0dce48c6 00007fcc0dce426f
0709 13:19:39.082201 (+   183us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1348788096}
I20260709 13:19:39.088763  6805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f00a2e87e56452083b759f60d461ee3" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:19:39.093380  9856 raft_consensus.cc:493] T 1bf4668eeb70467fb3dc5a0289233b3c P b7ab4784c7344b939bc36f639286f377 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:39.082758  6807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d65025eea89441290d85dd053810e31" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:19:39.093981  9856 raft_consensus.cc:515] T 1bf4668eeb70467fb3dc5a0289233b3c P b7ab4784c7344b939bc36f639286f377 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:39.096531  9969 raft_consensus.cc:515] T d33d5ee8ef6f415593d8df52063161ad P b7ab4784c7344b939bc36f639286f377 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:39.073448  9897 consensus_queue.cc:1059] T be1a92657f494cac8dd227d152f50151 P 7ba59cc884714e8aa5f3f0ecaed84cbb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.025s
I20260709 13:19:39.098763  9969 leader_election.cc:290] T d33d5ee8ef6f415593d8df52063161ad P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 10 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:39.100481  7466 leader_election.cc:304] T 4f00a2e87e56452083b759f60d461ee3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, b7ab4784c7344b939bc36f639286f377; no voters: 
I20260709 13:19:39.098649  9897 raft_consensus.cc:3055] T be1a92657f494cac8dd227d152f50151 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:19:39.103776  6807 raft_consensus.cc:2468] T 3d65025eea89441290d85dd053810e31 P b7ab4784c7344b939bc36f639286f377 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 7.
I20260709 13:19:39.081285  6799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb7fa124c3bf4ef9ab65a407cb008441" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:19:39.107060  6799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "427c124d773f483294511e80fe340075" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:19:39.107925  6799 raft_consensus.cc:2368] T 427c124d773f483294511e80fe340075 P b7ab4784c7344b939bc36f639286f377 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c for earlier term 6. Current term is 7.
I20260709 13:19:39.109375  6802 raft_consensus.cc:2468] T dbdf895bba214ff68685a24fd17dfb5d P b7ab4784c7344b939bc36f639286f377 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 7.
W20260709 13:19:39.105116  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 48947.1us
I20260709 13:19:39.110755  6805 raft_consensus.cc:2468] T 4f00a2e87e56452083b759f60d461ee3 P b7ab4784c7344b939bc36f639286f377 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 8.
I20260709 13:19:39.110559  6802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30e88460611e47b2ba16a46a30b5f416" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:19:39.111104  6844 leader_election.cc:304] T d33d5ee8ef6f415593d8df52063161ad P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377
I20260709 13:19:39.072176  9978 leader_election.cc:290] T d8cee0accdb8499c86d4414b72565a38 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:19:39.109735  6807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1528ab62b6fe4e3099d08f141afee116" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:19:39.069947  9862 leader_election.cc:290] T f03d0dbf16864ca4bc1bb5e4c0334c0f P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 7 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:39.062594  9848 raft_consensus.cc:515] T 07a92dd554674067a83a9cb68c4773f2 P b7ab4784c7344b939bc36f639286f377 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:39.076697  9918 raft_consensus.cc:515] T bb3d8792045a4583ae2e965b1350a5b4 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:19:39.111949  9586 raft_consensus.cc:2804] T 4f00a2e87e56452083b759f60d461ee3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:19:39.115079  6805 raft_consensus.cc:1240] T 7c44c4849aa54f2b94d1f1bef9ed546f P b7ab4784c7344b939bc36f639286f377 [term 10 FOLLOWER]: Rejecting Update request from peer ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 9. Current term is 10. Ops: []
I20260709 13:19:39.070408  9981 leader_election.cc:290] T 34f36d59d88f40fe8a2805e604fc6c0a P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:39.116472  6844 leader_election.cc:304] T 90d42e216d9741e190bca19a781291fd P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:19:39.116823  9958 leader_election.cc:290] T ab432e62819d499eaaf3dd55481dd930 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 10 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:39.118642  9977 leader_election.cc:290] T de3186201e1a40d0b335eeb8b4e256e0 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:19:39.113444  6802 raft_consensus.cc:2393] T 30e88460611e47b2ba16a46a30b5f416 P b7ab4784c7344b939bc36f639286f377 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c in current term 8: Already voted for candidate b7ab4784c7344b939bc36f639286f377 in this term.
I20260709 13:19:39.121481  7494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3f13b31a1f84f0d89d007eadd57924c" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb"
I20260709 13:19:39.059092  9936 raft_consensus.cc:515] T 4275cf08e63345f993bce8664eada830 P b7ab4784c7344b939bc36f639286f377 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:39.124686  9898 leader_election.cc:290] T f58dc08b12a2494bb9a1372837970ca2 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:19:39.114125  9969 raft_consensus.cc:493] T 3d65025eea89441290d85dd053810e31 P b7ab4784c7344b939bc36f639286f377 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:39.055719  9967 consensus_queue.cc:260] T 90d42e216d9741e190bca19a781291fd P b7ab4784c7344b939bc36f639286f377 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:39.133169  6877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8292e16e5654be6bc408560cf256aaa" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:19:39.158303  6877 raft_consensus.cc:2468] T d8292e16e5654be6bc408560cf256aaa P cd75a17ab2604397adab03bb8b5fd75c [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 10.
I20260709 13:19:39.158550  6878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6869f07b5a4885a0b99fbe60c3b175" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 9 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:19:39.159237  6878 raft_consensus.cc:3060] T bd6869f07b5a4885a0b99fbe60c3b175 P cd75a17ab2604397adab03bb8b5fd75c [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:39.134456  6805 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:32976 (request call id 2407) took 1598 ms. Trace:
I20260709 13:19:39.134364  6799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbdf895bba214ff68685a24fd17dfb5d" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:19:39.130645  9809 consensus_queue.cc:1048] T 4f00a2e87e56452083b759f60d461ee3 P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.010s
I20260709 13:19:39.140311  6844 leader_election.cc:304] T fe20b4b48823486ca3b9c648db6ce8aa P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, ccd8a4c3bfe3413cb2ae219b09aea832
W20260709 13:19:39.140906  9929 log.cc:927] Time spent T c4db81d9d329422bb3b4160ca4ac2d1d P ccd8a4c3bfe3413cb2ae219b09aea832: Append to log took a long time: real 1.710s	user 0.005s	sys 0.008s
I20260709 13:19:39.143620  6881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d9def8b32fd443aa94ab1420b06837b" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:19:39.163718  6844 leader_election.cc:304] T e77e330a82df4b43a745d57a68f6f057 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:19:39.149575  6802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b3759de40694069b13c0f8bd40e5709" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:19:39.164731  6802 raft_consensus.cc:2368] T 9b3759de40694069b13c0f8bd40e5709 P b7ab4784c7344b939bc36f639286f377 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c for earlier term 7. Current term is 8.
I20260709 13:19:39.136454  9586 raft_consensus.cc:493] T 4f00a2e87e56452083b759f60d461ee3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:39.125614  7498 raft_consensus.cc:1240] T 24ee15416e3145beaa1b8183453729a3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 9 FOLLOWER]: Rejecting Update request from peer ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 8. Current term is 9. Ops: []
I20260709 13:19:39.167805  6806 raft_consensus.cc:2393] T 4275cf08e63345f993bce8664eada830 P b7ab4784c7344b939bc36f639286f377 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c in current term 9: Already voted for candidate b7ab4784c7344b939bc36f639286f377 in this term.
I20260709 13:19:39.105424  9897 raft_consensus.cc:740] T be1a92657f494cac8dd227d152f50151 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 7ba59cc884714e8aa5f3f0ecaed84cbb, State: Running, Role: LEADER
I20260709 13:19:39.127895  6697 leader_election.cc:304] T 95a75bfe094d4bdc963aba3f08dfcd25 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:19:39.156792  6723 raft_consensus.cc:2393] T bb3d8792045a4583ae2e965b1350a5b4 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in current term 8: Already voted for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in this term.
I20260709 13:19:39.143700  6875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f58dc08b12a2494bb9a1372837970ca2" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:19:39.149356  9910 leader_election.cc:290] T 7887766dc6784fcaa42b35c05fea7a99 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 9 election: Requested vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:39.170128  6875 raft_consensus.cc:2468] T f58dc08b12a2494bb9a1372837970ca2 P cd75a17ab2604397adab03bb8b5fd75c [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 10.
I20260709 13:19:39.127889  9901 raft_consensus.cc:2804] T d33d5ee8ef6f415593d8df52063161ad P cd75a17ab2604397adab03bb8b5fd75c [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:19:39.165534  6802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e31b9971c15848dea59d4d4130141d9e" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:19:39.219904  6802 raft_consensus.cc:2393] T e31b9971c15848dea59d4d4130141d9e P b7ab4784c7344b939bc36f639286f377 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c in current term 6: Already voted for candidate b7ab4784c7344b939bc36f639286f377 in this term.
I20260709 13:19:39.143978  6872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5be3a11b23d4ea9b08300a2789821c7" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:19:39.172168  6844 leader_election.cc:304] T a1704639a875409b9959353527b3fd68 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:19:39.172748  9986 raft_consensus.cc:2749] T fe20b4b48823486ca3b9c648db6ce8aa P cd75a17ab2604397adab03bb8b5fd75c [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:19:39.173270  9898 raft_consensus.cc:2749] T e77e330a82df4b43a745d57a68f6f057 P cd75a17ab2604397adab03bb8b5fd75c [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:19:39.173347  9936 leader_election.cc:290] T 4275cf08e63345f993bce8664eada830 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 9 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:39.223767  6802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3022224cc81473690653a83d4e99470" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:19:39.146405  9892 raft_consensus.cc:2749] T 90d42e216d9741e190bca19a781291fd P cd75a17ab2604397adab03bb8b5fd75c [term 9 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:19:39.175576  6772 leader_election.cc:304] T 4f00a2e87e56452083b759f60d461ee3 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, b7ab4784c7344b939bc36f639286f377; no voters: 
W20260709 13:19:39.247350  6772 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.68:45071, user_credentials={real_user=slave}} blocked reactor thread for 71973.5us
I20260709 13:19:39.152982  9856 leader_election.cc:290] T 1bf4668eeb70467fb3dc5a0289233b3c P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:39.160373  6805 rpcz_store.cc:276] 0709 13:19:37.536137 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:39.114600 (+1578463us) service_pool.cc:224] Handling call
0709 13:19:39.114900 (+   300us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:39.134144 (+ 19244us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:39.134391 (+   247us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:39.160962  6799 raft_consensus.cc:2376] T dbdf895bba214ff68685a24fd17dfb5d P b7ab4784c7344b939bc36f639286f377 [term 7 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 7. Re-sending same reply.
I20260709 13:19:39.249647  6799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ba5dac66ab5497e9e336f2a3c28cda5" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:19:39.232177  6878 raft_consensus.cc:2468] T bd6869f07b5a4885a0b99fbe60c3b175 P cd75a17ab2604397adab03bb8b5fd75c [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 9.
I20260709 13:19:39.167968  9586 raft_consensus.cc:3060] T 4f00a2e87e56452083b759f60d461ee3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:39.217334  9958 raft_consensus.cc:493] T f09c2a98de1a4decabd0ff900dd44caa P b7ab4784c7344b939bc36f639286f377 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:39.256618  9958 raft_consensus.cc:515] T f09c2a98de1a4decabd0ff900dd44caa P b7ab4784c7344b939bc36f639286f377 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:39.257323  9896 leader_election.cc:290] T 7c37d41cd9164c15a6826ca62a851a69 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:39.221571  9967 raft_consensus.cc:3060] T 90d42e216d9741e190bca19a781291fd P b7ab4784c7344b939bc36f639286f377 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:39.258905  9958 leader_election.cc:290] T f09c2a98de1a4decabd0ff900dd44caa P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:39.259550  9977 raft_consensus.cc:2749] T a1704639a875409b9959353527b3fd68 P cd75a17ab2604397adab03bb8b5fd75c [term 8 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:19:39.259529  6805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d33d5ee8ef6f415593d8df52063161ad" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
W20260709 13:19:39.264583  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 93731.8us
I20260709 13:19:39.264775  6805 raft_consensus.cc:2368] T d33d5ee8ef6f415593d8df52063161ad P b7ab4784c7344b939bc36f639286f377 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c for earlier term 9. Current term is 10.
I20260709 13:19:39.267892  6805 raft_consensus.cc:1240] T 713b5728a197487c9300b310ab94e5a3 P b7ab4784c7344b939bc36f639286f377 [term 9 LEADER]: Rejecting Update request from peer ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 8. Current term is 9. Ops: []
I20260709 13:19:39.268755  6805 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:32976 (request call id 2422) took 1728 ms. Trace:
I20260709 13:19:39.269207  6805 rpcz_store.cc:276] 0709 13:19:37.540348 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:39.267139 (+1726791us) service_pool.cc:224] Handling call
0709 13:19:39.267618 (+   479us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:39.268430 (+   812us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:39.268652 (+   222us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:39.272589  9897 consensus_queue.cc:260] T be1a92657f494cac8dd227d152f50151 P 7ba59cc884714e8aa5f3f0ecaed84cbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:19:39.274104  9897 raft_consensus.cc:3060] T be1a92657f494cac8dd227d152f50151 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:39.222039  9657 raft_consensus.cc:2749] T 95a75bfe094d4bdc963aba3f08dfcd25 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 10 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
W20260709 13:19:39.292122  6804 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:32976 (request call id 2425) took 1567 ms (client timeout 2049 ms). Trace:
W20260709 13:19:39.292845  6804 rpcz_store.cc:269] 0709 13:19:37.725093 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:38.813731 (+1088638us) service_pool.cc:224] Handling call
0709 13:19:39.291752 (+478021us) spinlock_profiling.cc:243] Waited 117 ms on lock 0x7b54001b4ed4. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f9ae2fa 00007fcc1496fb17 00007fcc0deea6d4 00007fcc0deea662 00007fcc0deea591 00007fcc0deea50c 00007fcc0dee97c2 00007fcc0dce548c 00007fcc0dce48c6 00007fcc0dce426f
0709 13:19:39.291989 (+   237us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":269931264}
I20260709 13:19:39.295548  6804 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50550 (request call id 296) took 1417 ms. Trace:
W20260709 13:19:39.299346  6730 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50004 (request call id 1631) took 1718 ms (client timeout 2114 ms). Trace:
I20260709 13:19:39.332134  6804 rpcz_store.cc:276] 0709 13:19:37.877936 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:39.294017 (+1416081us) service_pool.cc:224] Handling call
0709 13:19:39.294757 (+   740us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:39.295053 (+   296us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:39.295090 (+    37us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:39.295158 (+    68us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:19:39.295204 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:39.295279 (+    75us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:39.295456 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:19:39.332353  6730 rpcz_store.cc:269] 0709 13:19:37.580669 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:37.580873 (+   204us) service_pool.cc:224] Handling call
0709 13:19:39.299081 (+1718208us) spinlock_profiling.cc:243] Waited 377 ms on lock 0x7b5400395dd4. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f9ae2fa 00007fcc1496fb17 00007fcc0deea6d4 00007fcc0deea662 00007fcc0deea591 00007fcc0deea50c 00007fcc0dee97c2 00007fcc0dce548c 00007fcc0dce48c6 00007fcc0dce426f
0709 13:19:39.299254 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":867045120}
W20260709 13:19:39.304947  6845 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:39.287336  6803 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:32976 (request call id 2416) took 1748 ms (client timeout 1918 ms). Trace:
W20260709 13:19:39.328986  6697 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 201209us
I20260709 13:19:39.338201  6697 leader_election.cc:304] T f03d0dbf16864ca4bc1bb5e4c0334c0f P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:19:39.303117  9981 raft_consensus.cc:2804] T 4f00a2e87e56452083b759f60d461ee3 P b7ab4784c7344b939bc36f639286f377 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:19:39.331342  6772 leader_election.cc:304] T 427c124d773f483294511e80fe340075 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:19:39.343310  6726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30e88460611e47b2ba16a46a30b5f416" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:19:39.345278  6725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "711ef6523deb4cbe8ef2ba61e1c21c98" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:19:39.360760  6725 raft_consensus.cc:2468] T 711ef6523deb4cbe8ef2ba61e1c21c98 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 9.
W20260709 13:19:39.335662  6803 rpcz_store.cc:269] 0709 13:19:37.538426 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:38.217516 (+679090us) service_pool.cc:224] Handling call
0709 13:19:39.287067 (+1069551us) spinlock_profiling.cc:243] Waited 730 ms on lock 0x7b54001b53d4. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f9ae2fa 00007fcc1496fb17 00007fcc0deea6d4 00007fcc0deea662 00007fcc0deea591 00007fcc0deea50c 00007fcc0dee97c2 00007fcc0dce548c 00007fcc0dce48c6 00007fcc0dce426f
0709 13:19:39.287243 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1678983936}
I20260709 13:19:39.356490  6697 leader_election.cc:304] T de3186201e1a40d0b335eeb8b4e256e0 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:19:39.356855  6695 leader_election.cc:304] T 404190ce4ce94cecbfcb6ea9d1dd8626 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, b7ab4784c7344b939bc36f639286f377
W20260709 13:19:39.362916  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 96564.5us
I20260709 13:19:39.373713  6695 leader_election.cc:304] T 3d65025eea89441290d85dd053810e31 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:19:39.376107  6724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1528ab62b6fe4e3099d08f141afee116" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:19:39.376394  6725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "404190ce4ce94cecbfcb6ea9d1dd8626" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:19:39.376809  6724 raft_consensus.cc:3060] T 1528ab62b6fe4e3099d08f141afee116 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:19:39.377553  6847 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:39.379047  7467 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:39.385308  6803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4db81d9d329422bb3b4160ca4ac2d1d" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:19:39.162091  9969 raft_consensus.cc:515] T 3d65025eea89441290d85dd053810e31 P b7ab4784c7344b939bc36f639286f377 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:39.397020  6880 raft_consensus.cc:1240] T 90d42e216d9741e190bca19a781291fd P cd75a17ab2604397adab03bb8b5fd75c [term 9 FOLLOWER]: Rejecting Update request from peer b7ab4784c7344b939bc36f639286f377 for earlier term 8. Current term is 9. Ops: [8.5-8.5]
I20260709 13:19:39.397634  6879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a734b5ab7834e05a8c422208acc58b1" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 9 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
W20260709 13:19:39.390899  6772 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 59656.8us
I20260709 13:19:39.398814  6772 leader_election.cc:304] T de3186201e1a40d0b335eeb8b4e256e0 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:19:39.396957  6876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44bde925b2e541b69890d70715b85176" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:19:39.400496  6876 raft_consensus.cc:2410] T 44bde925b2e541b69890d70715b85176 P cd75a17ab2604397adab03bb8b5fd75c [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7ab4784c7344b939bc36f639286f377 for term 10 because replica has last-logged OpId of term: 8 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 13:19:39.395740  6697 leader_election.cc:304] T 90d42e216d9741e190bca19a781291fd P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:19:39.400717  6880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4db81d9d329422bb3b4160ca4ac2d1d" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:19:39.399288  6877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f9c2e2bf644115957398fe4c9459db" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
W20260709 13:19:39.391688  6771 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:39.394397  6730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22ccee1b570c4ad3a57bd7aec085b1b4" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:19:39.402299  6880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22ccee1b570c4ad3a57bd7aec085b1b4" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:19:39.402469  6730 raft_consensus.cc:3060] T 22ccee1b570c4ad3a57bd7aec085b1b4 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:39.402977  6880 raft_consensus.cc:3060] T 22ccee1b570c4ad3a57bd7aec085b1b4 P cd75a17ab2604397adab03bb8b5fd75c [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:39.394649  6878 raft_consensus.cc:1275] T f58dc08b12a2494bb9a1372837970ca2 P cd75a17ab2604397adab03bb8b5fd75c [term 10 FOLLOWER]: Refusing update from remote peer b7ab4784c7344b939bc36f639286f377: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 10 index: 5. (index mismatch)
W20260709 13:19:39.388859  6800 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:32976 (request call id 2410) took 1851 ms (client timeout 2021 ms). Trace:
W20260709 13:19:39.404970  6800 rpcz_store.cc:269] 0709 13:19:37.536933 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:38.237007 (+700074us) service_pool.cc:224] Handling call
0709 13:19:39.388628 (+1151621us) spinlock_profiling.cc:243] Waited 790 ms on lock 0x7b54002c83d4. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f9ae2fa 00007fcc1496fb17 00007fcc0deea6d4 00007fcc0deea662 00007fcc0deea591 00007fcc0deea50c 00007fcc0dee97c2 00007fcc0dce548c 00007fcc0dce48c6 00007fcc0dce426f
0709 13:19:39.388789 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1817733504}
I20260709 13:19:39.406549  6873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30e88460611e47b2ba16a46a30b5f416" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:19:39.407294  6873 raft_consensus.cc:3060] T 30e88460611e47b2ba16a46a30b5f416 P cd75a17ab2604397adab03bb8b5fd75c [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:39.409099  6732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c44c4849aa54f2b94d1f1bef9ed546f" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:19:39.411875  6724 raft_consensus.cc:2468] T 1528ab62b6fe4e3099d08f141afee116 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 8.
I20260709 13:19:39.413048  6725 raft_consensus.cc:1275] T 95a75bfe094d4bdc963aba3f08dfcd25 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 10 FOLLOWER]: Refusing update from remote peer b7ab4784c7344b939bc36f639286f377: Log matching property violated. Preceding OpId in replica: term: 7 index: 2. Preceding OpId from leader: term: 8 index: 3. (index mismatch)
I20260709 13:19:39.415992  6803 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50550 (request call id 297) took 1047 ms. Trace:
I20260709 13:19:39.416750  6803 rpcz_store.cc:276] 0709 13:19:38.368776 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:39.414114 (+1045338us) service_pool.cc:224] Handling call
0709 13:19:39.415269 (+  1155us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:39.415540 (+   271us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:39.415581 (+    41us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:39.415647 (+    66us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:19:39.415698 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:39.415776 (+    78us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:39.415907 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:39.419809  6803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f58dc08b12a2494bb9a1372837970ca2" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:19:39.425318  6876 raft_consensus.cc:1275] T a1704639a875409b9959353527b3fd68 P cd75a17ab2604397adab03bb8b5fd75c [term 8 FOLLOWER]: Refusing update from remote peer b7ab4784c7344b939bc36f639286f377: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:19:39.425594  6725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3f13b31a1f84f0d89d007eadd57924c" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:19:39.427078  6725 raft_consensus.cc:2393] T b3f13b31a1f84f0d89d007eadd57924c P ccd8a4c3bfe3413cb2ae219b09aea832 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7ab4784c7344b939bc36f639286f377 in current term 6: Already voted for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in this term.
I20260709 13:19:39.426839  6876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "711ef6523deb4cbe8ef2ba61e1c21c98" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:19:39.428057  6876 raft_consensus.cc:2468] T 711ef6523deb4cbe8ef2ba61e1c21c98 P cd75a17ab2604397adab03bb8b5fd75c [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 8.
I20260709 13:19:39.445138  6875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c37d41cd9164c15a6826ca62a851a69" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:19:39.446758  6875 raft_consensus.cc:2410] T 7c37d41cd9164c15a6826ca62a851a69 P cd75a17ab2604397adab03bb8b5fd75c [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7ab4784c7344b939bc36f639286f377 for term 8 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:19:39.431334  6697 leader_election.cc:304] T 2c240553ce044eedb41541d72b9475d7 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:19:39.448398  6878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c44c4849aa54f2b94d1f1bef9ed546f" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:19:39.449097  6878 raft_consensus.cc:3060] T 7c44c4849aa54f2b94d1f1bef9ed546f P cd75a17ab2604397adab03bb8b5fd75c [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:39.376899  9981 raft_consensus.cc:493] T 4f00a2e87e56452083b759f60d461ee3 P b7ab4784c7344b939bc36f639286f377 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:39.453016  6880 raft_consensus.cc:2468] T 22ccee1b570c4ad3a57bd7aec085b1b4 P cd75a17ab2604397adab03bb8b5fd75c [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 8.
I20260709 13:19:39.455639  6879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f00a2e87e56452083b759f60d461ee3" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:19:39.456473  6803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be1a92657f494cac8dd227d152f50151" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:19:39.463215  6803 raft_consensus.cc:3060] T be1a92657f494cac8dd227d152f50151 P b7ab4784c7344b939bc36f639286f377 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:39.383448  9890 raft_consensus.cc:2804] T f03d0dbf16864ca4bc1bb5e4c0334c0f P ccd8a4c3bfe3413cb2ae219b09aea832 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:19:39.372458  9860 raft_consensus.cc:493] T 711ef6523deb4cbe8ef2ba61e1c21c98 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:39.448904  6725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f03d0dbf16864ca4bc1bb5e4c0334c0f" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:19:39.468778  6724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34f36d59d88f40fe8a2805e604fc6c0a" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 7 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
W20260709 13:19:39.469251  7466 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:39.469498  6772 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 61381.6us
I20260709 13:19:39.476967  6800 raft_consensus.cc:1240] T 9e326172347f45e99a0d482b5d8ef768 P b7ab4784c7344b939bc36f639286f377 [term 7 FOLLOWER]: Rejecting Update request from peer cd75a17ab2604397adab03bb8b5fd75c for earlier term 6. Current term is 7. Ops: []
I20260709 13:19:39.396991  9873 raft_consensus.cc:2749] T 404190ce4ce94cecbfcb6ea9d1dd8626 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:19:39.408876  9888 raft_consensus.cc:2804] T de3186201e1a40d0b335eeb8b4e256e0 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:19:39.502339  6728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bf4668eeb70467fb3dc5a0289233b3c" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:19:39.506508  6803 raft_consensus.cc:2468] T be1a92657f494cac8dd227d152f50151 P b7ab4784c7344b939bc36f639286f377 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 10.
I20260709 13:19:39.506810  6772 leader_election.cc:304] T c4db81d9d329422bb3b4160ca4ac2d1d P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:19:39.498041  6724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4275cf08e63345f993bce8664eada830" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:19:39.423142  9856 raft_consensus.cc:2804] T 427c124d773f483294511e80fe340075 P b7ab4784c7344b939bc36f639286f377 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:19:39.509902  6804 raft_consensus.cc:1240] T be1a92657f494cac8dd227d152f50151 P b7ab4784c7344b939bc36f639286f377 [term 10 FOLLOWER]: Rejecting Update request from peer 7ba59cc884714e8aa5f3f0ecaed84cbb for earlier term 9. Current term is 10. Ops: []
I20260709 13:19:39.517933  6724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab432e62819d499eaaf3dd55481dd930" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:19:39.518870  6724 raft_consensus.cc:3060] T ab432e62819d499eaaf3dd55481dd930 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:39.526316  6801 raft_consensus.cc:1240] T a3022224cc81473690653a83d4e99470 P b7ab4784c7344b939bc36f639286f377 [term 9 LEADER]: Rejecting Update request from peer ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 8. Current term is 9. Ops: [8.5-8.5]
I20260709 13:19:39.504441  6770 leader_election.cc:304] T f5be3a11b23d4ea9b08300a2789821c7 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
I20260709 13:19:39.508962  6878 raft_consensus.cc:2468] T 7c44c4849aa54f2b94d1f1bef9ed546f P cd75a17ab2604397adab03bb8b5fd75c [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 10.
I20260709 13:19:39.510911  6873 raft_consensus.cc:2410] T 30e88460611e47b2ba16a46a30b5f416 P cd75a17ab2604397adab03bb8b5fd75c [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate b7ab4784c7344b939bc36f639286f377 for term 8 because replica has last-logged OpId of term: 7 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:19:39.508019  6803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6869f07b5a4885a0b99fbe60c3b175" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 9 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:19:39.530331  6803 raft_consensus.cc:3060] T bd6869f07b5a4885a0b99fbe60c3b175 P b7ab4784c7344b939bc36f639286f377 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:39.487548  6730 raft_consensus.cc:2468] T 22ccee1b570c4ad3a57bd7aec085b1b4 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 8.
I20260709 13:19:39.514716  6732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d9def8b32fd443aa94ab1420b06837b" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:19:39.526361  6728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09c2a98de1a4decabd0ff900dd44caa" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:19:39.532387  6728 raft_consensus.cc:2468] T f09c2a98de1a4decabd0ff900dd44caa P ccd8a4c3bfe3413cb2ae219b09aea832 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 9.
I20260709 13:19:39.532349  6732 raft_consensus.cc:2468] T 4d9def8b32fd443aa94ab1420b06837b P ccd8a4c3bfe3413cb2ae219b09aea832 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 8.
W20260709 13:19:39.538352  6697 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 107125us
I20260709 13:19:39.539340  6697 leader_election.cc:304] T 8c7f33e544204fbaac4078e3e83bbf4e P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:19:39.480321  9981 raft_consensus.cc:3060] T 4f00a2e87e56452083b759f60d461ee3 P b7ab4784c7344b939bc36f639286f377 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:39.395982  9892 consensus_queue.cc:1059] T f09c2a98de1a4decabd0ff900dd44caa P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.101s
I20260709 13:19:39.461778  9657 raft_consensus.cc:2804] T 90d42e216d9741e190bca19a781291fd P ccd8a4c3bfe3413cb2ae219b09aea832 [term 9 FOLLOWER]: Leader election won for term 9
W20260709 13:19:39.567124  6772 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 45247.6us
I20260709 13:19:39.568383  6772 leader_election.cc:304] T 44bde925b2e541b69890d70715b85176 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:19:39.477754  9864 raft_consensus.cc:2749] T de3186201e1a40d0b335eeb8b4e256e0 P b7ab4784c7344b939bc36f639286f377 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:19:39.555032  6695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 181434us
I20260709 13:19:39.564929  6800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7887766dc6784fcaa42b35c05fea7a99" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:19:39.573967  6730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d33d5ee8ef6f415593d8df52063161ad" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:19:39.579483  6728 raft_consensus.cc:3055] T 713b5728a197487c9300b310ab94e5a3 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:19:39.579865  6730 raft_consensus.cc:3060] T d33d5ee8ef6f415593d8df52063161ad P ccd8a4c3bfe3413cb2ae219b09aea832 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:39.580132  6728 raft_consensus.cc:740] T 713b5728a197487c9300b310ab94e5a3 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
I20260709 13:19:39.515511  9860 raft_consensus.cc:515] T 711ef6523deb4cbe8ef2ba61e1c21c98 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
W20260709 13:19:39.582499  9988 log.cc:927] Time spent T f5be3a11b23d4ea9b08300a2789821c7 P cd75a17ab2604397adab03bb8b5fd75c: Append to log took a long time: real 0.247s	user 0.000s	sys 0.000s
W20260709 13:19:39.582616  6770 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 78253.7us
I20260709 13:19:39.583338  6770 leader_election.cc:304] T 7a734b5ab7834e05a8c422208acc58b1 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:19:39.584012  6628 catalog_manager.cc:5697] T 7c44c4849aa54f2b94d1f1bef9ed546f P cd75a17ab2604397adab03bb8b5fd75c reported cstate change: term changed from 2 to 8. New cstate: current_term: 8 leader_uuid: "cd75a17ab2604397adab03bb8b5fd75c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:39.584661  9910 raft_consensus.cc:2804] T 8c7f33e544204fbaac4078e3e83bbf4e P ccd8a4c3bfe3413cb2ae219b09aea832 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:19:39.585436  9910 raft_consensus.cc:697] T 8c7f33e544204fbaac4078e3e83bbf4e P ccd8a4c3bfe3413cb2ae219b09aea832 [term 6 LEADER]: Becoming Leader. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
I20260709 13:19:39.585759  6770 leader_election.cc:304] T 711ef6523deb4cbe8ef2ba61e1c21c98 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
I20260709 13:19:39.586838  9949 raft_consensus.cc:2804] T f5be3a11b23d4ea9b08300a2789821c7 P b7ab4784c7344b939bc36f639286f377 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:19:39.586409  6628 catalog_manager.cc:5697] T f3f9c2e2bf644115957398fe4c9459db P cd75a17ab2604397adab03bb8b5fd75c reported cstate change: term changed from 2 to 6, leader changed from cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67) to b7ab4784c7344b939bc36f639286f377 (127.5.126.66). New cstate: current_term: 6 leader_uuid: "b7ab4784c7344b939bc36f639286f377" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } }
I20260709 13:19:39.587268  9949 raft_consensus.cc:493] T f5be3a11b23d4ea9b08300a2789821c7 P b7ab4784c7344b939bc36f639286f377 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:39.587978  9949 raft_consensus.cc:3060] T f5be3a11b23d4ea9b08300a2789821c7 P b7ab4784c7344b939bc36f639286f377 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:39.571359  9780 raft_consensus.cc:2804] T 2c240553ce044eedb41541d72b9475d7 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:19:39.589867  9780 raft_consensus.cc:697] T 2c240553ce044eedb41541d72b9475d7 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 10 LEADER]: Becoming Leader. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
I20260709 13:19:39.581736  9856 raft_consensus.cc:697] T 427c124d773f483294511e80fe340075 P b7ab4784c7344b939bc36f639286f377 [term 7 LEADER]: Becoming Leader. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
I20260709 13:19:39.593232  9849 raft_consensus.cc:2804] T 711ef6523deb4cbe8ef2ba61e1c21c98 P b7ab4784c7344b939bc36f639286f377 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:19:39.592269  9851 raft_consensus.cc:2804] T 7a734b5ab7834e05a8c422208acc58b1 P b7ab4784c7344b939bc36f639286f377 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:19:39.477494  9809 consensus_queue.cc:1059] T 9e326172347f45e99a0d482b5d8ef768 P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.083s
I20260709 13:19:39.602303  6772 leader_election.cc:304] T 7c37d41cd9164c15a6826ca62a851a69 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:19:39.412724  9627 raft_consensus.cc:515] T ce4f062dcd314d43a63ca74067cb5ee3 P cd75a17ab2604397adab03bb8b5fd75c [term 8 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } attrs { replace: true } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:19:39.591125  9780 consensus_queue.cc:237] T 2c240553ce044eedb41541d72b9475d7 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:39.605875  6728 consensus_queue.cc:260] T 713b5728a197487c9300b310ab94e5a3 P ccd8a4c3bfe3413cb2ae219b09aea832 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:39.616290  6728 raft_consensus.cc:3060] T 713b5728a197487c9300b310ab94e5a3 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:39.603667  9852 raft_consensus.cc:2749] T 44bde925b2e541b69890d70715b85176 P b7ab4784c7344b939bc36f639286f377 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:19:39.621248  6800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8292e16e5654be6bc408560cf256aaa" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:19:39.623063  6800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3f13b31a1f84f0d89d007eadd57924c" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
W20260709 13:19:39.627368  6695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 49016.4us
I20260709 13:19:39.627970  9851 raft_consensus.cc:697] T 7a734b5ab7834e05a8c422208acc58b1 P b7ab4784c7344b939bc36f639286f377 [term 9 LEADER]: Becoming Leader. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
I20260709 13:19:39.637876  9851 consensus_queue.cc:237] T 7a734b5ab7834e05a8c422208acc58b1 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:39.576560  9893 raft_consensus.cc:2764] T 3d65025eea89441290d85dd053810e31 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 7 FOLLOWER]: Leader pre-election decision vote started in defunct term 6: won
I20260709 13:19:39.569279  9890 raft_consensus.cc:697] T f03d0dbf16864ca4bc1bb5e4c0334c0f P ccd8a4c3bfe3413cb2ae219b09aea832 [term 7 LEADER]: Becoming Leader. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
I20260709 13:19:39.644492  6800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5be3a11b23d4ea9b08300a2789821c7" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
W20260709 13:19:39.613817  9785 consensus_meta.cc:287] T e77e330a82df4b43a745d57a68f6f057 P b7ab4784c7344b939bc36f639286f377: Time spent flushing consensus metadata: real 0.649s	user 0.012s	sys 0.000s
I20260709 13:19:39.593706  9849 raft_consensus.cc:493] T 711ef6523deb4cbe8ef2ba61e1c21c98 P b7ab4784c7344b939bc36f639286f377 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:39.604357  9657 raft_consensus.cc:697] T 90d42e216d9741e190bca19a781291fd P ccd8a4c3bfe3413cb2ae219b09aea832 [term 9 LEADER]: Becoming Leader. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
I20260709 13:19:39.587007  9910 consensus_queue.cc:237] T 8c7f33e544204fbaac4078e3e83bbf4e P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:39.611936  9898 raft_consensus.cc:3055] T f09c2a98de1a4decabd0ff900dd44caa P cd75a17ab2604397adab03bb8b5fd75c [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:19:39.593647  9856 consensus_queue.cc:237] T 427c124d773f483294511e80fe340075 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.5, Last appended by leader: 5, Current term: 7, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } attrs { replace: true } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:19:39.661571  6807 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:32976 (request call id 2408) took 2125 ms. Trace:
W20260709 13:19:39.651489  9947 consensus_meta.cc:287] T f3f9c2e2bf644115957398fe4c9459db P cd75a17ab2604397adab03bb8b5fd75c: Time spent flushing consensus metadata: real 0.862s	user 0.016s	sys 0.000s
W20260709 13:19:39.684160  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 320154us
I20260709 13:19:39.685361  6844 leader_election.cc:304] T 20f6842e26174571996b8dea4151d4be P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:19:39.659101  9849 raft_consensus.cc:3060] T 711ef6523deb4cbe8ef2ba61e1c21c98 P b7ab4784c7344b939bc36f639286f377 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:39.640746  9862 consensus_queue.cc:1048] T a1704639a875409b9959353527b3fd68 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.054s
W20260709 13:19:39.729913  9990 log.cc:927] Time spent T 4b8cacb381b746da8d0049b0a83b41dd P ccd8a4c3bfe3413cb2ae219b09aea832: Append to log took a long time: real 0.121s	user 0.000s	sys 0.001s
I20260709 13:19:39.652370  9715 consensus_queue.cc:1059] T 7887766dc6784fcaa42b35c05fea7a99 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: INVALID_TERM, Last received: 8.4, Next index: 5, Last known committed idx: 2, Time since last communication: 0.053s
I20260709 13:19:39.669905  9898 raft_consensus.cc:740] T f09c2a98de1a4decabd0ff900dd44caa P cd75a17ab2604397adab03bb8b5fd75c [term 8 LEADER]: Becoming Follower/Learner. State: Replica: cd75a17ab2604397adab03bb8b5fd75c, State: Running, Role: LEADER
I20260709 13:19:39.713390  9947 raft_consensus.cc:2749] T f3f9c2e2bf644115957398fe4c9459db P cd75a17ab2604397adab03bb8b5fd75c [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:19:39.681169  9977 raft_consensus.cc:493] T 7887766dc6784fcaa42b35c05fea7a99 P cd75a17ab2604397adab03bb8b5fd75c [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:19:39.596741  9774 consensus_queue.cc:1048] T f58dc08b12a2494bb9a1372837970ca2 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.057s
I20260709 13:19:39.625972  9860 leader_election.cc:290] T 711ef6523deb4cbe8ef2ba61e1c21c98 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:39.601020  6724 raft_consensus.cc:2468] T ab432e62819d499eaaf3dd55481dd930 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 10.
I20260709 13:19:39.671038  6807 rpcz_store.cc:276] 0709 13:19:37.536417 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:39.120769 (+1584352us) service_pool.cc:224] Handling call
0709 13:19:39.121092 (+   323us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:39.121287 (+   195us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:19:39.502588 (+381301us) log.cc:844] Serialized 14 byte log entry
0709 13:19:39.660953 (+158365us) log.cc:844] Serialized 14 byte log entry
0709 13:19:39.661176 (+   223us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:39.661223 (+    47us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:19:39.661288 (+    65us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:39.661360 (+    72us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:39.661507 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8247,"prepare.queue_time_us":355222,"prepare.run_cpu_time_us":30,"prepare.run_wall_time_us":32,"raft.queue_time_us":11339,"raft.run_cpu_time_us":161,"raft.run_wall_time_us":10938,"thread_start_us":530338,"threads_started":2}
I20260709 13:19:39.653035  9852 raft_consensus.cc:2749] T 7c37d41cd9164c15a6826ca62a851a69 P b7ab4784c7344b939bc36f639286f377 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:19:39.650074  9892 raft_consensus.cc:3055] T 9e326172347f45e99a0d482b5d8ef768 P cd75a17ab2604397adab03bb8b5fd75c [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:19:39.650504  9848 leader_election.cc:290] T 07a92dd554674067a83a9cb68c4773f2 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
W20260709 13:19:39.785202  6772 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 182972us
W20260709 13:19:39.681633  6847 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:39.791348  6803 raft_consensus.cc:2468] T bd6869f07b5a4885a0b99fbe60c3b175 P b7ab4784c7344b939bc36f639286f377 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 9.
I20260709 13:19:39.633100  6628 catalog_manager.cc:5697] T 4d9def8b32fd443aa94ab1420b06837b P cd75a17ab2604397adab03bb8b5fd75c reported cstate change: term changed from 1 to 6, leader changed from ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65) to cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67). New cstate: current_term: 6 leader_uuid: "cd75a17ab2604397adab03bb8b5fd75c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:39.660247  9785 raft_consensus.cc:515] T e77e330a82df4b43a745d57a68f6f057 P b7ab4784c7344b939bc36f639286f377 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } }
W20260709 13:19:39.741765  9989 log.cc:927] Time spent T 17587d6730594da4a56fa13a353232a1 P b7ab4784c7344b939bc36f639286f377: Append to log took a long time: real 0.565s	user 0.002s	sys 0.000s
I20260709 13:19:39.786953  6772 leader_election.cc:304] T 22ccee1b570c4ad3a57bd7aec085b1b4 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:19:39.795562  6877 raft_consensus.cc:2468] T f3f9c2e2bf644115957398fe4c9459db P cd75a17ab2604397adab03bb8b5fd75c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 7.
I20260709 13:19:39.796929  6695 leader_election.cc:304] T d33d5ee8ef6f415593d8df52063161ad P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: cd75a17ab2604397adab03bb8b5fd75c
W20260709 13:19:39.781978  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 96763.9us
I20260709 13:19:39.796962  6803 raft_consensus.cc:1240] T 853ac0a8cbd64ce99457f170216d4d0f P b7ab4784c7344b939bc36f639286f377 [term 6 FOLLOWER]: Rejecting Update request from peer cd75a17ab2604397adab03bb8b5fd75c for earlier term 5. Current term is 6. Ops: []
I20260709 13:19:39.803565  6803 raft_consensus.cc:1240] T f4b8bd455d5a47c18a1380839c6e0d61 P b7ab4784c7344b939bc36f639286f377 [term 8 FOLLOWER]: Rejecting Update request from peer cd75a17ab2604397adab03bb8b5fd75c for earlier term 6. Current term is 8. Ops: []
I20260709 13:19:39.806680  6807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d9def8b32fd443aa94ab1420b06837b" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:19:39.806978  6728 raft_consensus.cc:1275] T 713b5728a197487c9300b310ab94e5a3 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 9 FOLLOWER]: Refusing update from remote peer b7ab4784c7344b939bc36f639286f377: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:19:39.807603  6807 raft_consensus.cc:2468] T 4d9def8b32fd443aa94ab1420b06837b P b7ab4784c7344b939bc36f639286f377 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 8.
I20260709 13:19:39.811910  6695 leader_election.cc:304] T f09c2a98de1a4decabd0ff900dd44caa P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: cd75a17ab2604397adab03bb8b5fd75c
W20260709 13:19:39.825416  6698 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:39.831054  9893 raft_consensus.cc:2804] T f09c2a98de1a4decabd0ff900dd44caa P ccd8a4c3bfe3413cb2ae219b09aea832 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:19:39.837415  5625 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:19:39.781808  9892 raft_consensus.cc:740] T 9e326172347f45e99a0d482b5d8ef768 P cd75a17ab2604397adab03bb8b5fd75c [term 6 LEADER]: Becoming Follower/Learner. State: Replica: cd75a17ab2604397adab03bb8b5fd75c, State: Running, Role: LEADER
I20260709 13:19:39.839619  6628 catalog_manager.cc:5697] T 3d65025eea89441290d85dd053810e31 P cd75a17ab2604397adab03bb8b5fd75c reported cstate change: term changed from 1 to 6, leader changed from cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67) to b7ab4784c7344b939bc36f639286f377 (127.5.126.66). New cstate: current_term: 6 leader_uuid: "b7ab4784c7344b939bc36f639286f377" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } }
I20260709 13:19:39.822579  6730 raft_consensus.cc:2468] T d33d5ee8ef6f415593d8df52063161ad P ccd8a4c3bfe3413cb2ae219b09aea832 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 10.
I20260709 13:19:39.813001  9947 raft_consensus.cc:2749] T 20f6842e26174571996b8dea4151d4be P cd75a17ab2604397adab03bb8b5fd75c [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:19:39.824738  6695 leader_election.cc:304] T 9b3759de40694069b13c0f8bd40e5709 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
I20260709 13:19:39.774111  9977 raft_consensus.cc:515] T 7887766dc6784fcaa42b35c05fea7a99 P cd75a17ab2604397adab03bb8b5fd75c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:39.842170  9901 raft_consensus.cc:697] T d33d5ee8ef6f415593d8df52063161ad P cd75a17ab2604397adab03bb8b5fd75c [term 9 LEADER]: Becoming Leader. State: Replica: cd75a17ab2604397adab03bb8b5fd75c, State: Running, Role: LEADER
W20260709 13:19:39.872619  9995 log.cc:927] Time spent T 7ba5dac66ab5497e9e336f2a3c28cda5 P 7ba59cc884714e8aa5f3f0ecaed84cbb: Append to log took a long time: real 0.102s	user 0.001s	sys 0.000s
W20260709 13:19:39.873518  6695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 49076.8us
I20260709 13:19:39.832340  9875 raft_consensus.cc:493] T 17587d6730594da4a56fa13a353232a1 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:39.871731  6628 catalog_manager.cc:5697] T 3a485a995abc4807b6e511e45419f737 P cd75a17ab2604397adab03bb8b5fd75c reported cstate change: term changed from 3 to 5, leader changed from b7ab4784c7344b939bc36f639286f377 (127.5.126.66) to ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65). New cstate: current_term: 5 leader_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } }
I20260709 13:19:39.874418  6695 leader_election.cc:304] T f4b8bd455d5a47c18a1380839c6e0d61 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
I20260709 13:19:39.838654  9893 raft_consensus.cc:697] T f09c2a98de1a4decabd0ff900dd44caa P ccd8a4c3bfe3413cb2ae219b09aea832 [term 9 LEADER]: Becoming Leader. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
W20260709 13:19:39.877537  6770 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 291807us
I20260709 13:19:39.864256  9860 raft_consensus.cc:2764] T d33d5ee8ef6f415593d8df52063161ad P ccd8a4c3bfe3413cb2ae219b09aea832 [term 10 FOLLOWER]: Leader pre-election decision vote started in defunct term 8: won
I20260709 13:19:39.873245  9933 raft_consensus.cc:2804] T 9b3759de40694069b13c0f8bd40e5709 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 8 FOLLOWER]: Leader election won for term 8
W20260709 13:19:39.882328  6874 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.729s	user 0.002s	sys 0.013s
I20260709 13:19:39.880333  6770 leader_election.cc:304] T 404190ce4ce94cecbfcb6ea9d1dd8626 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, ccd8a4c3bfe3413cb2ae219b09aea832
W20260709 13:19:39.882748  6874 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.729s	user 0.002s	sys 0.013s
I20260709 13:19:39.809240  9890 consensus_queue.cc:237] T f03d0dbf16864ca4bc1bb5e4c0334c0f P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:39.783545  9657 consensus_queue.cc:237] T 90d42e216d9741e190bca19a781291fd P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:39.886840  6695 leader_election.cc:304] T f3f9c2e2bf644115957398fe4c9459db P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:19:39.880354  6628 catalog_manager.cc:5697] T 9e326172347f45e99a0d482b5d8ef768 P cd75a17ab2604397adab03bb8b5fd75c reported cstate change: term changed from 3 to 5, leader changed from b7ab4784c7344b939bc36f639286f377 (127.5.126.66) to ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65). New cstate: current_term: 5 leader_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } }
W20260709 13:19:39.889752  7466 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:39.888569  6628 catalog_manager.cc:5697] T 8c7f33e544204fbaac4078e3e83bbf4e P cd75a17ab2604397adab03bb8b5fd75c reported cstate change: term changed from 1 to 4, leader changed from b7ab4784c7344b939bc36f639286f377 (127.5.126.66) to cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67). New cstate: current_term: 4 leader_uuid: "cd75a17ab2604397adab03bb8b5fd75c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:39.893221  6695 leader_election.cc:304] T dbdf895bba214ff68685a24fd17dfb5d P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:19:39.818567  9898 consensus_queue.cc:260] T f09c2a98de1a4decabd0ff900dd44caa P cd75a17ab2604397adab03bb8b5fd75c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
W20260709 13:19:39.912564  6697 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 373310us
I20260709 13:19:39.886869  9969 leader_election.cc:290] T 3d65025eea89441290d85dd053810e31 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:39.884131  9888 raft_consensus.cc:697] T de3186201e1a40d0b335eeb8b4e256e0 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 9 LEADER]: Becoming Leader. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
I20260709 13:19:39.880067  9875 raft_consensus.cc:515] T 17587d6730594da4a56fa13a353232a1 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:19:39.893329  9873 raft_consensus.cc:2804] T f4b8bd455d5a47c18a1380839c6e0d61 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 8 FOLLOWER]: Leader election won for term 8
W20260709 13:19:39.939204  7467 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:39.942632  6726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be1a92657f494cac8dd227d152f50151" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:19:39.892241  9933 raft_consensus.cc:697] T 9b3759de40694069b13c0f8bd40e5709 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 8 LEADER]: Becoming Leader. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
I20260709 13:19:39.895934  9627 leader_election.cc:290] T ce4f062dcd314d43a63ca74067cb5ee3 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 8 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
W20260709 13:19:39.952520  6845 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:39.911435  9892 consensus_queue.cc:260] T 9e326172347f45e99a0d482b5d8ef768 P cd75a17ab2604397adab03bb8b5fd75c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:39.945925  6628 catalog_manager.cc:5697] T 95a75bfe094d4bdc963aba3f08dfcd25 P cd75a17ab2604397adab03bb8b5fd75c reported cstate change: term changed from 1 to 7, leader changed from b7ab4784c7344b939bc36f639286f377 (127.5.126.66) to ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65). New cstate: current_term: 7 leader_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } }
I20260709 13:19:40.002737  6726 raft_consensus.cc:2393] T be1a92657f494cac8dd227d152f50151 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7ab4784c7344b939bc36f639286f377 in current term 10: Already voted for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in this term.
I20260709 13:19:39.909091  9947 consensus_queue.cc:1059] T f4b8bd455d5a47c18a1380839c6e0d61 P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.091s
I20260709 13:19:40.007908  6628 catalog_manager.cc:5697] T 1bf4668eeb70467fb3dc5a0289233b3c P cd75a17ab2604397adab03bb8b5fd75c reported cstate change: term changed from 4 to 5, leader changed from b7ab4784c7344b939bc36f639286f377 (127.5.126.66) to ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65). New cstate: current_term: 5 leader_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } }
W20260709 13:19:40.014822  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 173275us
I20260709 13:19:40.013304  9933 consensus_queue.cc:237] T 9b3759de40694069b13c0f8bd40e5709 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:39.959532  9999 consensus_queue.cc:1059] T 34f36d59d88f40fe8a2805e604fc6c0a P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.095s
I20260709 13:19:40.017959  6844 leader_election.cc:304] T e31b9971c15848dea59d4d4130141d9e P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:19:39.890166  9901 consensus_queue.cc:237] T d33d5ee8ef6f415593d8df52063161ad P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:40.022491  6628 catalog_manager.cc:5697] T f09c2a98de1a4decabd0ff900dd44caa P cd75a17ab2604397adab03bb8b5fd75c reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } }
I20260709 13:19:40.009138  9964 raft_consensus.cc:493] T 1528ab62b6fe4e3099d08f141afee116 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:40.017249 10008 raft_consensus.cc:2804] T f3f9c2e2bf644115957398fe4c9459db P ccd8a4c3bfe3413cb2ae219b09aea832 [term 8 FOLLOWER]: Leader election won for term 8
W20260709 13:19:40.025089  9967 consensus_meta.cc:287] T 90d42e216d9741e190bca19a781291fd P b7ab4784c7344b939bc36f639286f377: Time spent flushing consensus metadata: real 0.766s	user 0.012s	sys 0.007s
I20260709 13:19:40.010058  9873 raft_consensus.cc:697] T f4b8bd455d5a47c18a1380839c6e0d61 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 8 LEADER]: Becoming Leader. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
W20260709 13:19:40.049062 10002 log.cc:927] Time spent T b56bf91d90824c959e21e0cee5ba1816 P b7ab4784c7344b939bc36f639286f377: Append to log took a long time: real 0.175s	user 0.001s	sys 0.000s
W20260709 13:19:40.001324  6616 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 427c124d773f483294511e80fe340075 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER failed with leader 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 7ba59cc884714e8aa5f3f0ecaed84cbb is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 7 committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } attrs { replace: true } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } } }
W20260709 13:19:40.050065  6695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 156898us
I20260709 13:19:40.049971  6628 catalog_manager.cc:5697] T dbdf895bba214ff68685a24fd17dfb5d P cd75a17ab2604397adab03bb8b5fd75c reported cstate change: term changed from 1 to 6, leader changed from ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65) to b7ab4784c7344b939bc36f639286f377 (127.5.126.66). New cstate: current_term: 6 leader_uuid: "b7ab4784c7344b939bc36f639286f377" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } }
I20260709 13:19:40.018386  9892 raft_consensus.cc:3060] T 9e326172347f45e99a0d482b5d8ef768 P cd75a17ab2604397adab03bb8b5fd75c [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:40.038028 10001 raft_consensus.cc:493] T 44bde925b2e541b69890d70715b85176 P cd75a17ab2604397adab03bb8b5fd75c [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:40.065318  6695 leader_election.cc:304] T 22ccee1b570c4ad3a57bd7aec085b1b4 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:19:40.084520  6628 catalog_manager.cc:5697] T 9b3759de40694069b13c0f8bd40e5709 P cd75a17ab2604397adab03bb8b5fd75c reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } }
I20260709 13:19:40.052855  9785 leader_election.cc:290] T e77e330a82df4b43a745d57a68f6f057 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 11 election: Requested vote from peers cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931), ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391)
I20260709 13:19:40.027776  9949 raft_consensus.cc:515] T f5be3a11b23d4ea9b08300a2789821c7 P b7ab4784c7344b939bc36f639286f377 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:40.006179  9893 consensus_queue.cc:237] T f09c2a98de1a4decabd0ff900dd44caa P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:40.100656  6628 catalog_manager.cc:5697] T 7c37d41cd9164c15a6826ca62a851a69 P cd75a17ab2604397adab03bb8b5fd75c reported cstate change: term changed from 1 to 4, leader changed from ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65) to b7ab4784c7344b939bc36f639286f377 (127.5.126.66). New cstate: current_term: 4 leader_uuid: "b7ab4784c7344b939bc36f639286f377" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } }
I20260709 13:19:40.115986  6628 catalog_manager.cc:5697] T 3411566abe2d4c9bb4b2adfdd05e6f17 P cd75a17ab2604397adab03bb8b5fd75c reported cstate change: term changed from 1 to 5. New cstate: current_term: 5 leader_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } }
I20260709 13:19:40.053279  9964 raft_consensus.cc:515] T 1528ab62b6fe4e3099d08f141afee116 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
W20260709 13:19:40.088310  6616 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.5.126.68:45071, user_credentials={real_user=slave}} blocked reactor thread for 89449.2us
I20260709 13:19:40.093216 10004 raft_consensus.cc:2764] T dbdf895bba214ff68685a24fd17dfb5d P ccd8a4c3bfe3413cb2ae219b09aea832 [term 7 FOLLOWER]: Leader pre-election decision vote started in defunct term 6: won
I20260709 13:19:40.126667  6800 raft_consensus.cc:2393] T f5be3a11b23d4ea9b08300a2789821c7 P b7ab4784c7344b939bc36f639286f377 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ccd8a4c3bfe3413cb2ae219b09aea832 in current term 7: Already voted for candidate b7ab4784c7344b939bc36f639286f377 in this term.
W20260709 13:19:40.136197  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 118316us
W20260709 13:19:40.116169 10007 log.cc:927] Time spent T c4db81d9d329422bb3b4160ca4ac2d1d P b7ab4784c7344b939bc36f639286f377: Append to log took a long time: real 0.067s	user 0.000s	sys 0.001s
I20260709 13:19:40.138886  6628 catalog_manager.cc:5697] T e31b9971c15848dea59d4d4130141d9e P cd75a17ab2604397adab03bb8b5fd75c reported cstate change: term changed from 3 to 4, leader changed from ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65) to b7ab4784c7344b939bc36f639286f377 (127.5.126.66). New cstate: current_term: 4 leader_uuid: "b7ab4784c7344b939bc36f639286f377" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } }
I20260709 13:19:40.144142  6874 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53416 (request call id 2546) took 1011 ms. Trace:
I20260709 13:19:40.144668  6874 rpcz_store.cc:276] 0709 13:19:39.132266 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:39.133943 (+  1677us) service_pool.cc:224] Handling call
0709 13:19:39.134209 (+   266us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:39.134406 (+   197us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:19:39.886603 (+752197us) log.cc:844] Serialized 14 byte log entry
0709 13:19:40.143737 (+257134us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:40.143801 (+    64us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:19:40.143849 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:40.143914 (+    65us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:40.144073 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":744,"prepare.queue_time_us":884391,"prepare.run_cpu_time_us":43,"prepare.run_wall_time_us":43,"spinlock_wait_cycles":12618624,"thread_start_us":985954,"threads_started":3,"wal-append.queue_time_us":162269}
I20260709 13:19:40.138769  6844 leader_election.cc:304] T 3d65025eea89441290d85dd053810e31 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:19:40.098688 10001 raft_consensus.cc:515] T 44bde925b2e541b69890d70715b85176 P cd75a17ab2604397adab03bb8b5fd75c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:40.062937  9888 consensus_queue.cc:237] T de3186201e1a40d0b335eeb8b4e256e0 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:40.124979  9977 leader_election.cc:290] T 7887766dc6784fcaa42b35c05fea7a99 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:19:40.170176  6798 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:32966 (request call id 869) took 1319 ms. Trace:
I20260709 13:19:40.170948  6807 raft_consensus.cc:1240] T 7a734b5ab7834e05a8c422208acc58b1 P b7ab4784c7344b939bc36f639286f377 [term 9 LEADER]: Rejecting Update request from peer cd75a17ab2604397adab03bb8b5fd75c for earlier term 8. Current term is 9. Ops: [8.4-8.4]
I20260709 13:19:40.170629  6798 rpcz_store.cc:276] 0709 13:19:38.850659 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:39.042617 (+191958us) service_pool.cc:224] Handling call
0709 13:19:40.167907 (+1125290us) spinlock_profiling.cc:243] Waited 23.6 ms on lock 0x7b54001f7a54. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f9ae2fa 00007fcc1496fb17 00007fcc0deea6d4 00007fcc0deea662 00007fcc0deea591 00007fcc0deea50c 00007fcc0dee97c2 00007fcc0dce548c 00007fcc0dce48c6 00007fcc0dce426f
0709 13:19:40.170095 (+  2188us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":54296960}
W20260709 13:19:40.194765  6695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 129593us
I20260709 13:19:40.195942  6695 leader_election.cc:304] T 7a734b5ab7834e05a8c422208acc58b1 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:19:40.201460  6798 raft_consensus.cc:1240] T 34f36d59d88f40fe8a2805e604fc6c0a P b7ab4784c7344b939bc36f639286f377 [term 6 FOLLOWER]: Rejecting Update request from peer cd75a17ab2604397adab03bb8b5fd75c for earlier term 5. Current term is 6. Ops: [3.3-5.4]
W20260709 13:19:40.204469  7466 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 65082us
I20260709 13:19:40.163511  6628 catalog_manager.cc:5697] T a3022224cc81473690653a83d4e99470 P cd75a17ab2604397adab03bb8b5fd75c reported cstate change: term changed from 4 to 6, leader changed from ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65) to b7ab4784c7344b939bc36f639286f377 (127.5.126.66). New cstate: current_term: 6 leader_uuid: "b7ab4784c7344b939bc36f639286f377" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } }
I20260709 13:19:40.210712  6695 leader_election.cc:400] T 1528ab62b6fe4e3099d08f141afee116 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 7 election: Vote denied by peer b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817) with higher term. Message: Invalid argument: T 1528ab62b6fe4e3099d08f141afee116 P b7ab4784c7344b939bc36f639286f377 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 7. Current term is 8.
I20260709 13:19:40.211853  6695 leader_election.cc:403] T 1528ab62b6fe4e3099d08f141afee116 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 7 election: Cancelling election due to peer responding with higher term
I20260709 13:19:40.190258  9910 raft_consensus.cc:2749] T 22ccee1b570c4ad3a57bd7aec085b1b4 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:19:40.214516  6695 leader_election.cc:304] T 853ac0a8cbd64ce99457f170216d4d0f P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:19:40.159803 10012 consensus_queue.cc:1059] T a3022224cc81473690653a83d4e99470 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.072s
I20260709 13:19:40.198948  9964 leader_election.cc:290] T 1528ab62b6fe4e3099d08f141afee116 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:19:40.187783  9849 raft_consensus.cc:515] T 711ef6523deb4cbe8ef2ba61e1c21c98 P b7ab4784c7344b939bc36f639286f377 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:40.209550 10004 raft_consensus.cc:2749] T 7a734b5ab7834e05a8c422208acc58b1 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:19:40.221952  6695 leader_election.cc:304] T be1a92657f494cac8dd227d152f50151 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb
I20260709 13:19:40.223279  6798 raft_consensus.cc:1240] T f09c2a98de1a4decabd0ff900dd44caa P b7ab4784c7344b939bc36f639286f377 [term 9 FOLLOWER]: Rejecting Update request from peer cd75a17ab2604397adab03bb8b5fd75c for earlier term 8. Current term is 9. Ops: [8.5-8.5]
I20260709 13:19:40.227473  6798 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:32966 (request call id 893) took 1003 ms. Trace:
I20260709 13:19:40.214023 10020 raft_consensus.cc:493] T bb7fa124c3bf4ef9ab65a407cb008441 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:19:40.161532  9873 consensus_queue.cc:237] T f4b8bd455d5a47c18a1380839c6e0d61 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:40.228119  6798 rpcz_store.cc:276] 0709 13:19:39.224172 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:40.202866 (+978694us) service_pool.cc:224] Handling call
0709 13:19:40.222987 (+ 20121us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:40.227092 (+  4105us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:40.227394 (+   302us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:40.218724  9875 leader_election.cc:290] T 17587d6730594da4a56fa13a353232a1 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
W20260709 13:19:40.229895  7468 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:40.221021  9897 consensus_meta.cc:287] T be1a92657f494cac8dd227d152f50151 P 7ba59cc884714e8aa5f3f0ecaed84cbb: Time spent flushing consensus metadata: real 0.946s	user 0.022s	sys 0.002s
I20260709 13:19:40.213572  9890 consensus_queue.cc:1059] T 7c44c4849aa54f2b94d1f1bef9ed546f P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: INVALID_TERM, Last received: 9.7, Next index: 8, Last known committed idx: 5, Time since last communication: 0.029s
I20260709 13:19:40.235116  6628 catalog_manager.cc:5697] T 853ac0a8cbd64ce99457f170216d4d0f P cd75a17ab2604397adab03bb8b5fd75c reported cstate change: term changed from 1 to 2, leader changed from ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65) to b7ab4784c7344b939bc36f639286f377 (127.5.126.66). New cstate: current_term: 2 leader_uuid: "b7ab4784c7344b939bc36f639286f377" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } }
I20260709 13:19:40.341076  6798 raft_consensus.cc:1240] T 44bde925b2e541b69890d70715b85176 P b7ab4784c7344b939bc36f639286f377 [term 9 FOLLOWER]: Rejecting Update request from peer cd75a17ab2604397adab03bb8b5fd75c for earlier term 8. Current term is 9. Ops: [7.5-8.6]
W20260709 13:19:40.341588 10025 log.cc:927] Time spent T f03d0dbf16864ca4bc1bb5e4c0334c0f P ccd8a4c3bfe3413cb2ae219b09aea832: Append to log took a long time: real 0.054s	user 0.001s	sys 0.000s
I20260709 13:19:40.342000  6798 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:32966 (request call id 894) took 1102 ms. Trace:
I20260709 13:19:40.287981 10004 raft_consensus.cc:3055] T a3022224cc81473690653a83d4e99470 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 8 LEADER]: Stepping down as leader of term 8
W20260709 13:19:40.343158 10018 log.cc:927] Time spent T d8292e16e5654be6bc408560cf256aaa P ccd8a4c3bfe3413cb2ae219b09aea832: Append to log took a long time: real 0.119s	user 0.001s	sys 0.000s
I20260709 13:19:40.229574  9964 raft_consensus.cc:493] T 17587d6730594da4a56fa13a353232a1 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:40.290391 10021 raft_consensus.cc:2804] T 853ac0a8cbd64ce99457f170216d4d0f P ccd8a4c3bfe3413cb2ae219b09aea832 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:19:40.344184  9964 raft_consensus.cc:515] T 17587d6730594da4a56fa13a353232a1 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
W20260709 13:19:40.287272 10003 log.cc:927] Time spent T f58dc08b12a2494bb9a1372837970ca2 P ccd8a4c3bfe3413cb2ae219b09aea832: Append to log took a long time: real 0.224s	user 0.000s	sys 0.002s
I20260709 13:19:40.342767  6628 catalog_manager.cc:5697] T f03d0dbf16864ca4bc1bb5e4c0334c0f P cd75a17ab2604397adab03bb8b5fd75c reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } }
I20260709 13:19:40.343710  9897 raft_consensus.cc:493] T 7ba5dac66ab5497e9e336f2a3c28cda5 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:19:40.342424  6798 rpcz_store.cc:276] 0709 13:19:39.239981 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:40.340350 (+1100369us) service_pool.cc:224] Handling call
0709 13:19:40.340793 (+   443us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:19:40.341625 (+   832us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:40.341945 (+   320us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:40.224180  9910 raft_consensus.cc:2749] T 1528ab62b6fe4e3099d08f141afee116 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 8 FOLLOWER]: Leader election lost for term 7. Reason: Vote denied by peer b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817) with higher term. Message: Invalid argument: T 1528ab62b6fe4e3099d08f141afee116 P b7ab4784c7344b939bc36f639286f377 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 7. Current term is 8.
I20260709 13:19:40.362741  6731 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50004 (request call id 1642) took 1020 ms. Trace:
I20260709 13:19:40.367817  6731 rpcz_store.cc:276] 0709 13:19:39.341848 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:39.342014 (+   166us) service_pool.cc:224] Handling call
0709 13:19:39.393691 (+ 51677us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:39.446198 (+ 52507us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:39.446231 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:39.480853 (+ 34622us) log.cc:844] Serialized 26 byte log entry
0709 13:19:40.014075 (+533222us) spinlock_profiling.cc:243] Waited 5.35 ms on lock 0x7b1800308020. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc15785de1 00007fcc157925b1 00007fcc0c89fe07 00007fcc156faab9 00007fcc0c8bc69b 00007fcc0c8ba93f 00007fcc0c8bcc02 00007fcc0f54420b 00007fcc0f549d23 00007fcc0f54a0d1 00007fcc0f965a0f
0709 13:19:40.144668 (+130593us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:19:40.144927 (+   259us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:40.145292 (+   365us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:40.346409 (+201117us) raft_consensus.cc:1685] finished
0709 13:19:40.346434 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:40.362639 (+ 16205us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":110124,"raft.queue_time_us":36785,"raft.run_cpu_time_us":147,"raft.run_wall_time_us":29339,"spinlock_wait_cycles":12308736,"thread_start_us":106921,"threads_started":1,"wal-append.queue_time_us":616353}
W20260709 13:19:40.340894 10023 log.cc:927] Time spent T 8c7f33e544204fbaac4078e3e83bbf4e P ccd8a4c3bfe3413cb2ae219b09aea832: Append to log took a long time: real 0.113s	user 0.000s	sys 0.000s
I20260709 13:19:40.370995  6628 catalog_manager.cc:5697] T de3186201e1a40d0b335eeb8b4e256e0 P cd75a17ab2604397adab03bb8b5fd75c reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } }
W20260709 13:19:40.372185  6847 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:40.365995 10034 raft_consensus.cc:493] T a1704639a875409b9959353527b3fd68 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:40.376740  7466 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 48263.1us
I20260709 13:19:40.377535  6628 catalog_manager.cc:5697] T 34f36d59d88f40fe8a2805e604fc6c0a P cd75a17ab2604397adab03bb8b5fd75c reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } }
W20260709 13:19:40.362227  7494 consensus_meta.cc:287] T b3f13b31a1f84f0d89d007eadd57924c P 7ba59cc884714e8aa5f3f0ecaed84cbb: Time spent flushing consensus metadata: real 1.200s	user 0.010s	sys 0.011s
I20260709 13:19:40.330507  9949 leader_election.cc:290] T f5be3a11b23d4ea9b08300a2789821c7 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 7 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:40.347536 10004 raft_consensus.cc:740] T a3022224cc81473690653a83d4e99470 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
I20260709 13:19:40.379441  6798 raft_consensus.cc:1275] T d8cee0accdb8499c86d4414b72565a38 P b7ab4784c7344b939bc36f639286f377 [term 8 FOLLOWER]: Refusing update from remote peer 7ba59cc884714e8aa5f3f0ecaed84cbb: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
W20260709 13:19:40.387633 10015 log.cc:927] Time spent T 7a734b5ab7834e05a8c422208acc58b1 P b7ab4784c7344b939bc36f639286f377: Append to log took a long time: real 0.163s	user 0.001s	sys 0.000s
I20260709 13:19:40.388412  9780 raft_consensus.cc:3055] T 7c44c4849aa54f2b94d1f1bef9ed546f P ccd8a4c3bfe3413cb2ae219b09aea832 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:19:40.384593 10034 raft_consensus.cc:515] T a1704639a875409b9959353527b3fd68 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:40.240567 10016 raft_consensus.cc:493] T ce4f062dcd314d43a63ca74067cb5ee3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:19:40.366848  9875 raft_consensus.cc:2804] T be1a92657f494cac8dd227d152f50151 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:19:40.391314  6727 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50004 (request call id 1646) took 1043 ms. Trace:
I20260709 13:19:40.376253 10027 raft_consensus.cc:493] T 427c124d773f483294511e80fe340075 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:40.392565  6798 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50550 (request call id 300) took 1131 ms. Trace:
I20260709 13:19:40.243743 10020 raft_consensus.cc:515] T bb7fa124c3bf4ef9ab65a407cb008441 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:19:40.399655  6724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17587d6730594da4a56fa13a353232a1" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 12 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:19:40.373939  9890 raft_consensus.cc:493] T 9e326172347f45e99a0d482b5d8ef768 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:40.399426  6728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3d8792045a4583ae2e965b1350a5b4" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
W20260709 13:19:40.385125 10013 log.cc:927] Time spent T d8292e16e5654be6bc408560cf256aaa P cd75a17ab2604397adab03bb8b5fd75c: Append to log took a long time: real 0.226s	user 0.000s	sys 0.001s
W20260709 13:19:40.404402  6697 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 490660us
I20260709 13:19:40.423579  6798 rpcz_store.cc:276] 0709 13:19:39.328193 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:40.367350 (+1039157us) service_pool.cc:224] Handling call
0709 13:19:40.378952 (+ 11602us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:40.392258 (+ 13306us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:40.392502 (+   244us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:40.408892  6730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1528ab62b6fe4e3099d08f141afee116" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:19:40.421676  6628 catalog_manager.cc:5697] T f5be3a11b23d4ea9b08300a2789821c7 P cd75a17ab2604397adab03bb8b5fd75c reported cstate change: term changed from 3 to 5, leader changed from cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67) to b7ab4784c7344b939bc36f639286f377 (127.5.126.66). New cstate: current_term: 5 leader_uuid: "b7ab4784c7344b939bc36f639286f377" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } }
I20260709 13:19:40.408097  9984 raft_consensus.cc:2243] T 24ee15416e3145beaa1b8183453729a3 P b7ab4784c7344b939bc36f639286f377 [term 8 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:40.422886  6724 raft_consensus.cc:2410] T 17587d6730594da4a56fa13a353232a1 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ba59cc884714e8aa5f3f0ecaed84cbb for term 12 because replica has last-logged OpId of term: 9 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 7.
W20260709 13:19:40.425803  6723 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49744 (request call id 285) took 1622 ms (client timeout 1774 ms). Trace:
I20260709 13:19:40.384472  9849 leader_election.cc:290] T 711ef6523deb4cbe8ef2ba61e1c21c98 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 10 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:40.424721  6697 leader_election.cc:304] T 20f6842e26174571996b8dea4151d4be P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377
W20260709 13:19:40.427168  6723 rpcz_store.cc:269] 0709 13:19:38.803479 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:38.808622 (+  5143us) service_pool.cc:224] Handling call
0709 13:19:40.425570 (+1616948us) spinlock_profiling.cc:243] Waited 327 ms on lock 0x7b54000e4a54. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f9ae2fa 00007fcc1496fb17 00007fcc0deea6d4 00007fcc0deea662 00007fcc0deea591 00007fcc0deea50c 00007fcc0dee97c2 00007fcc0dce548c 00007fcc0dce48c6 00007fcc0dce426f
0709 13:19:40.425737 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":751276288}
I20260709 13:19:40.426426  6730 raft_consensus.cc:2393] T 1528ab62b6fe4e3099d08f141afee116 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in current term 8: Already voted for candidate b7ab4784c7344b939bc36f639286f377 in this term.
I20260709 13:19:40.408809  6727 rpcz_store.cc:276] 0709 13:19:39.347505 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:39.347760 (+   255us) service_pool.cc:224] Handling call
0709 13:19:39.348298 (+   538us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:39.392533 (+ 44235us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:39.392571 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:39.446760 (+ 54189us) log.cc:844] Serialized 26 byte log entry
0709 13:19:39.875525 (+428765us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:19:39.875583 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:39.876017 (+   434us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:40.391005 (+514988us) raft_consensus.cc:1685] finished
0709 13:19:40.391032 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:40.391222 (+   190us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":92311,"raft.queue_time_us":46417,"raft.run_cpu_time_us":271,"raft.run_wall_time_us":17274,"thread_start_us":335152,"threads_started":1,"wal-append.queue_time_us":506050}
I20260709 13:19:40.431423  6798 raft_consensus.cc:1240] T 30e88460611e47b2ba16a46a30b5f416 P b7ab4784c7344b939bc36f639286f377 [term 8 FOLLOWER]: Rejecting Update request from peer ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 7. Current term is 8. Ops: [7.4-7.4]
I20260709 13:19:40.432253  6798 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:32976 (request call id 2426) took 1025 ms. Trace:
I20260709 13:19:40.432729  6798 rpcz_store.cc:276] 0709 13:19:39.406897 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:40.427230 (+1020333us) service_pool.cc:224] Handling call
0709 13:19:40.427687 (+   457us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:40.431934 (+  4247us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:40.432199 (+   265us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:40.433264  6729 raft_consensus.cc:1240] T bb3d8792045a4583ae2e965b1350a5b4 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 8 FOLLOWER]: Rejecting Update request from peer cd75a17ab2604397adab03bb8b5fd75c for earlier term 7. Current term is 8. Ops: []
I20260709 13:19:40.434782  6798 raft_consensus.cc:1240] T 1bf4668eeb70467fb3dc5a0289233b3c P b7ab4784c7344b939bc36f639286f377 [term 8 FOLLOWER]: Rejecting Update request from peer ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 7. Current term is 8. Ops: []
I20260709 13:19:40.406910  9780 raft_consensus.cc:740] T 7c44c4849aa54f2b94d1f1bef9ed546f P ccd8a4c3bfe3413cb2ae219b09aea832 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
W20260709 13:19:40.425199  9981 consensus_meta.cc:287] T 4f00a2e87e56452083b759f60d461ee3 P b7ab4784c7344b939bc36f639286f377: Time spent flushing consensus metadata: real 0.827s	user 0.018s	sys 0.007s
I20260709 13:19:40.374840  9897 raft_consensus.cc:515] T 7ba5dac66ab5497e9e336f2a3c28cda5 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:19:40.436098  6798 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:32976 (request call id 2427) took 1028 ms. Trace:
W20260709 13:19:40.439038  6698 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:40.438896  6628 catalog_manager.cc:5697] T f4b8bd455d5a47c18a1380839c6e0d61 P cd75a17ab2604397adab03bb8b5fd75c reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } }
I20260709 13:19:40.394986  7494 raft_consensus.cc:2468] T b3f13b31a1f84f0d89d007eadd57924c P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 6.
I20260709 13:19:40.432561  9964 leader_election.cc:290] T 17587d6730594da4a56fa13a353232a1 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:19:40.427420  9875 raft_consensus.cc:697] T be1a92657f494cac8dd227d152f50151 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 10 LEADER]: Becoming Leader. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
I20260709 13:19:40.427625  9890 raft_consensus.cc:515] T 9e326172347f45e99a0d482b5d8ef768 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:40.427832 10027 raft_consensus.cc:515] T 427c124d773f483294511e80fe340075 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } attrs { replace: true } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:19:40.423210 10016 raft_consensus.cc:515] T ce4f062dcd314d43a63ca74067cb5ee3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } attrs { replace: true } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:19:40.482414  7494 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50742 (request call id 363) took 1362 ms. Trace:
I20260709 13:19:40.445390  9981 raft_consensus.cc:515] T 4f00a2e87e56452083b759f60d461ee3 P b7ab4784c7344b939bc36f639286f377 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:19:40.490582  6803 raft_consensus.cc:1240] T 4f00a2e87e56452083b759f60d461ee3 P b7ab4784c7344b939bc36f639286f377 [term 9 FOLLOWER]: Rejecting Update request from peer cd75a17ab2604397adab03bb8b5fd75c for earlier term 8. Current term is 9. Ops: []
I20260709 13:19:40.438468 10001 leader_election.cc:290] T 44bde925b2e541b69890d70715b85176 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
W20260709 13:19:40.503650  7466 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 100040us
I20260709 13:19:40.443197  6678 placement_policy_util.cc:248] tablet 1528ab62b6fe4e3099d08f141afee116: not considering replicas for movement since the tablet's status is 'UNAVAILABLE'
I20260709 13:19:40.444154  6798 rpcz_store.cc:276] 0709 13:19:39.407280 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:40.434253 (+1026973us) service_pool.cc:224] Handling call
0709 13:19:40.434604 (+   351us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:40.435413 (+   809us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:40.436020 (+   607us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:40.621558  9964 raft_consensus.cc:493] T 4b8cacb381b746da8d0049b0a83b41dd P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:40.634661  9890 leader_election.cc:290] T 9e326172347f45e99a0d482b5d8ef768 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:40.625192  9981 leader_election.cc:290] T 4f00a2e87e56452083b759f60d461ee3 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 9 election: Requested vote from peers cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:19:40.636695  9897 leader_election.cc:290] T 7ba5dac66ab5497e9e336f2a3c28cda5 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:40.640323 10027 leader_election.cc:290] T 427c124d773f483294511e80fe340075 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:40.642537  6807 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:32966 (request call id 891) took 1463 ms. Trace:
I20260709 13:19:40.643203 10016 leader_election.cc:290] T ce4f062dcd314d43a63ca74067cb5ee3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:40.646944  7502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce4f062dcd314d43a63ca74067cb5ee3" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb"
I20260709 13:19:40.647593  7502 raft_consensus.cc:3060] T ce4f062dcd314d43a63ca74067cb5ee3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:40.643694  6802 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:32976 (request call id 2411) took 3106 ms. Trace:
W20260709 13:19:40.648489  6846 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:40.648975  6846 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:40.621830  7466 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:40.648667  6802 rpcz_store.cc:276] 0709 13:19:37.537176 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:39.254154 (+1716978us) service_pool.cc:224] Handling call
0709 13:19:39.254681 (+   527us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 13:19:39.255248 (+   567us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:39.255289 (+    41us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 13:19:39.265262 (+  9973us) log.cc:844] Serialized 78 byte log entry
0709 13:19:39.648808 (+383546us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:19:39.670532 (+ 21724us) log.cc:844] Serialized 14 byte log entry
0709 13:19:39.671166 (+   634us) log.cc:844] Serialized 14 byte log entry
0709 13:19:39.671367 (+   201us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:39.671451 (+    84us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:40.640739 (+969288us) spinlock_profiling.cc:243] Waited 4.73 ms on lock 0x7b18003cb560. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc15785de1 00007fcc157925b1 00007fcc0c8bd3f3 00007fcc0c8bf7c1 00007fcc0c8bf779 00007fcc0c8bf709 00007fcc0c8bf6d1 00007fcc0c8be9cd 000000000038f354 000000000038f199 00007fcc0c8a083a
0709 13:19:40.643409 (+  2670us) raft_consensus.cc:1685] finished
0709 13:19:40.643434 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:40.643622 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":11923,"prepare.run_wall_time_us":69,"raft.queue_time_us":12363,"raft.run_cpu_time_us":419,"raft.run_wall_time_us":28285,"spinlock_wait_cycles":49692416,"thread_start_us":382910,"threads_started":1,"wal-append.queue_time_us":444434}
I20260709 13:19:40.628587  9875 consensus_queue.cc:237] T be1a92657f494cac8dd227d152f50151 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
W20260709 13:19:40.631419  9892 consensus_meta.cc:287] T 9e326172347f45e99a0d482b5d8ef768 P cd75a17ab2604397adab03bb8b5fd75c: Time spent flushing consensus metadata: real 0.546s	user 0.014s	sys 0.003s
I20260709 13:19:40.655287  6802 raft_consensus.cc:1275] T 34f36d59d88f40fe8a2805e604fc6c0a P b7ab4784c7344b939bc36f639286f377 [term 6 FOLLOWER]: Refusing update from remote peer ccd8a4c3bfe3413cb2ae219b09aea832: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:19:40.655553  6881 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53406 (request call id 1736) took 1256 ms. Trace:
I20260709 13:19:40.656131  6802 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:32976 (request call id 2430) took 1247 ms. Trace:
I20260709 13:19:40.656697  6802 rpcz_store.cc:276] 0709 13:19:39.408265 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:40.651762 (+1243497us) service_pool.cc:224] Handling call
0709 13:19:40.652198 (+   436us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:40.655753 (+  3555us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:40.656027 (+   274us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:40.658139  6802 raft_consensus.cc:1275] T 44bde925b2e541b69890d70715b85176 P b7ab4784c7344b939bc36f639286f377 [term 9 FOLLOWER]: Refusing update from remote peer ccd8a4c3bfe3413cb2ae219b09aea832: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:19:40.658720  6802 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:32976 (request call id 2438) took 1223 ms. Trace:
I20260709 13:19:40.659385  6802 rpcz_store.cc:276] 0709 13:19:39.435588 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:40.657473 (+1221885us) service_pool.cc:224] Handling call
0709 13:19:40.657807 (+   334us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:40.658454 (+   647us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:40.658663 (+   209us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:40.642982  6807 rpcz_store.cc:276] 0709 13:19:39.179164 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:39.808575 (+629411us) service_pool.cc:224] Handling call
0709 13:19:39.834447 (+ 25872us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:40.171775 (+337328us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:40.642232 (+470457us) spinlock_profiling.cc:243] Waited 336 ms on lock 0x7b54001b58d4. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f9aae01 00007fcc0f9a983e 00007fcc1496e419 00007fcc0dee5bd4 00007fcc0dee5b62 00007fcc0dee5a91 00007fcc0dee5a0c 00007fcc0dee4cc2 00007fcc0dce548c 00007fcc0dce48c6
0709 13:19:40.642462 (+   230us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":772850560}
I20260709 13:19:40.653597  6728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "427c124d773f483294511e80fe340075" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:19:40.660465  9918 leader_election.cc:290] T bb3d8792045a4583ae2e965b1350a5b4 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 8 election: Requested vote from peers cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:19:40.660632  6728 raft_consensus.cc:2468] T 427c124d773f483294511e80fe340075 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in term 7.
I20260709 13:19:40.654304  6727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce4f062dcd314d43a63ca74067cb5ee3" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:19:40.661015  6802 raft_consensus.cc:1275] T 7c37d41cd9164c15a6826ca62a851a69 P b7ab4784c7344b939bc36f639286f377 [term 7 FOLLOWER]: Refusing update from remote peer ccd8a4c3bfe3413cb2ae219b09aea832: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:19:40.661690  6727 raft_consensus.cc:2468] T ce4f062dcd314d43a63ca74067cb5ee3 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in term 7.
I20260709 13:19:40.634320  9964 raft_consensus.cc:515] T 4b8cacb381b746da8d0049b0a83b41dd P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:19:40.662005  6725 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50004 (request call id 1652) took 1214 ms. Trace:
I20260709 13:19:40.662478  6725 rpcz_store.cc:276] 0709 13:19:39.448077 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:39.448544 (+   467us) service_pool.cc:224] Handling call
0709 13:19:40.661817 (+1213273us) spinlock_profiling.cc:243] Waited 714 ms on lock 0x7b540027b854. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f9ae2fa 00007fcc1496fb17 00007fcc0deea6d4 00007fcc0deea662 00007fcc0deea591 00007fcc0deea50c 00007fcc0dee97c2 00007fcc0dce548c 00007fcc0dce48c6 00007fcc0dce426f
0709 13:19:40.661951 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1643016064}
I20260709 13:19:40.661942  6802 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:32976 (request call id 2439) took 1225 ms. Trace:
I20260709 13:19:40.482928  7494 rpcz_store.cc:276] 0709 13:19:39.119929 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:39.121116 (+  1187us) service_pool.cc:224] Handling call
0709 13:19:40.482302 (+1361186us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:40.623554 10020 leader_election.cc:290] T bb7fa124c3bf4ef9ab65a407cb008441 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
W20260709 13:19:40.650691  9586 consensus_meta.cc:287] T 4f00a2e87e56452083b759f60d461ee3 P 7ba59cc884714e8aa5f3f0ecaed84cbb: Time spent flushing consensus metadata: real 1.251s	user 0.017s	sys 0.018s
I20260709 13:19:40.665040  6725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b8cacb381b746da8d0049b0a83b41dd" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:19:40.664379  6802 rpcz_store.cc:276] 0709 13:19:39.436165 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:40.660259 (+1224094us) service_pool.cc:224] Handling call
0709 13:19:40.660611 (+   352us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:40.661688 (+  1077us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:40.661889 (+   201us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:19:40.675261  6772 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 888323us
W20260709 13:19:40.621851 10028 log.cc:927] Time spent T 427c124d773f483294511e80fe340075 P b7ab4784c7344b939bc36f639286f377: Append to log took a long time: real 0.295s	user 0.010s	sys 0.000s
W20260709 13:19:40.711071  6695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 275343us
I20260709 13:19:40.711658  6805 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:32976 (request call id 2423) took 3168 ms. Trace:
I20260709 13:19:40.738857  6695 leader_election.cc:304] T bd6869f07b5a4885a0b99fbe60c3b175 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
I20260709 13:19:40.738746  6805 rpcz_store.cc:276] 0709 13:19:37.542960 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:39.270133 (+1727173us) service_pool.cc:224] Handling call
0709 13:19:39.271266 (+  1133us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:39.271718 (+   452us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:19:39.597350 (+325632us) log.cc:844] Serialized 14 byte log entry
0709 13:19:40.711003 (+1113653us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:40.711112 (+   109us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:19:40.711196 (+    84us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:40.711331 (+   135us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:40.711554 (+   223us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":828708,"prepare.queue_time_us":204917,"prepare.run_cpu_time_us":36,"prepare.run_wall_time_us":36,"thread_start_us":608912,"threads_started":2,"wal-append.queue_time_us":446319}
I20260709 13:19:40.664489  9925 ts_tablet_manager.cc:1929] T 1528ab62b6fe4e3099d08f141afee116 P cd75a17ab2604397adab03bb8b5fd75c: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 5.5
I20260709 13:19:40.738668 10034 leader_election.cc:290] T a1704639a875409b9959353527b3fd68 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:40.737757  9964 leader_election.cc:290] T 4b8cacb381b746da8d0049b0a83b41dd P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:40.711448  9450 raft_consensus.cc:2749] T c4db81d9d329422bb3b4160ca4ac2d1d P b7ab4784c7344b939bc36f639286f377 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:19:40.714617  9864 raft_consensus.cc:2804] T 22ccee1b570c4ad3a57bd7aec085b1b4 P b7ab4784c7344b939bc36f639286f377 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:19:40.714994 10032 raft_consensus.cc:2804] T 20f6842e26174571996b8dea4151d4be P ccd8a4c3bfe3413cb2ae219b09aea832 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:19:40.709942  9888 raft_consensus.cc:493] T 427c124d773f483294511e80fe340075 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:40.753731  6731 raft_consensus.cc:1240] T be1a92657f494cac8dd227d152f50151 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 10 LEADER]: Rejecting Update request from peer 7ba59cc884714e8aa5f3f0ecaed84cbb for earlier term 9. Current term is 10. Ops: []
I20260709 13:19:40.739287 10020 raft_consensus.cc:493] T fe20b4b48823486ca3b9c648db6ce8aa P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 6 FOLLOWER]: Starting pre-election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:19:40.765455 10020 raft_consensus.cc:515] T fe20b4b48823486ca3b9c648db6ce8aa P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:19:40.767726 10020 leader_election.cc:290] T fe20b4b48823486ca3b9c648db6ce8aa P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:40.755697  9984 raft_consensus.cc:2272] T 24ee15416e3145beaa1b8183453729a3 P b7ab4784c7344b939bc36f639286f377 [term 8 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:40.753084  6772 leader_election.cc:304] T 7c44c4849aa54f2b94d1f1bef9ed546f P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:19:40.655999  6881 rpcz_store.cc:276] 0709 13:19:39.399311 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:39.399514 (+   203us) service_pool.cc:224] Handling call
0709 13:19:39.399828 (+   314us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:39.781340 (+381512us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:19:39.949469 (+168129us) log.cc:844] Serialized 14 byte log entry
0709 13:19:39.955076 (+  5607us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:39.979555 (+ 24479us) log.cc:844] Serialized 26 byte log entry
0709 13:19:39.979771 (+   216us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:19:39.979821 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:39.979920 (+    99us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:40.655343 (+675423us) raft_consensus.cc:1685] finished
0709 13:19:40.655365 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:40.655497 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":53860,"prepare.queue_time_us":254995,"prepare.run_cpu_time_us":91,"prepare.run_wall_time_us":2858,"raft.queue_time_us":255430,"raft.run_cpu_time_us":386,"raft.run_wall_time_us":16532,"spinlock_wait_cycles":15422336,"thread_start_us":436817,"threads_started":3,"wal-append.queue_time_us":152098}
I20260709 13:19:40.764228  6695 leader_election.cc:304] T 4d9def8b32fd443aa94ab1420b06837b P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
I20260709 13:19:40.764820 10034 raft_consensus.cc:2804] T bd6869f07b5a4885a0b99fbe60c3b175 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:19:40.692190  9586 raft_consensus.cc:515] T 4f00a2e87e56452083b759f60d461ee3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 9 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:19:40.776648  7502 raft_consensus.cc:2468] T ce4f062dcd314d43a63ca74067cb5ee3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 8.
I20260709 13:19:40.769274  6725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe20b4b48823486ca3b9c648db6ce8aa" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:19:40.760952  9925 log.cc:1199] T 1528ab62b6fe4e3099d08f141afee116 P cd75a17ab2604397adab03bb8b5fd75c: Deleting WAL directory at /tmp/dist-test-taskWHb0CB/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783603057096655-5625-0/minicluster-data/ts-2-root/wals/1528ab62b6fe4e3099d08f141afee116
W20260709 13:19:40.780745  6697 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 342059us
I20260709 13:19:40.773476 10032 raft_consensus.cc:697] T 20f6842e26174571996b8dea4151d4be P ccd8a4c3bfe3413cb2ae219b09aea832 [term 9 LEADER]: Becoming Leader. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
I20260709 13:19:40.791215  6799 raft_consensus.cc:1240] T 4275cf08e63345f993bce8664eada830 P b7ab4784c7344b939bc36f639286f377 [term 9 FOLLOWER]: Rejecting Update request from peer ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 8. Current term is 9. Ops: []
I20260709 13:19:40.792126  6801 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:32976 (request call id 2424) took 3150 ms. Trace:
I20260709 13:19:40.792465  6801 rpcz_store.cc:276] 0709 13:19:37.641747 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:39.285489 (+1643742us) service_pool.cc:224] Handling call
0709 13:19:39.286065 (+   576us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:39.527014 (+240949us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:40.791834 (+1264820us) spinlock_profiling.cc:243] Waited 240 ms on lock 0x7b5400185454. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f9aae01 00007fcc0f9a983e 00007fcc1496e419 00007fcc0dee5bd4 00007fcc0dee5b62 00007fcc0dee5a91 00007fcc0dee5a0c 00007fcc0dee4cc2 00007fcc0dce548c 00007fcc0dce48c6
0709 13:19:40.792065 (+   231us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":551481600}
I20260709 13:19:40.792871  6804 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50550 (request call id 298) took 2384 ms. Trace:
W20260709 13:19:40.791133  6806 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:32966 (request call id 867) took 1941 ms (client timeout 1943 ms). Trace:
W20260709 13:19:40.793618  6806 rpcz_store.cc:269] 0709 13:19:38.850092 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:39.014086 (+163994us) service_pool.cc:224] Handling call
0709 13:19:40.790899 (+1776813us) spinlock_profiling.cc:243] Waited 152 ms on lock 0x7b54002c97d4. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f9ae2fa 00007fcc1496fb17 00007fcc0deea6d4 00007fcc0deea662 00007fcc0deea591 00007fcc0deea50c 00007fcc0dee97c2 00007fcc0dce548c 00007fcc0dce48c6 00007fcc0dce426f
0709 13:19:40.791068 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":350703488}
I20260709 13:19:40.793509  6804 rpcz_store.cc:276] 0709 13:19:38.409058 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:39.422004 (+1012946us) service_pool.cc:224] Handling call
0709 13:19:39.509611 (+ 87607us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:39.516673 (+  7062us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:40.792528 (+1275855us) spinlock_profiling.cc:243] Waited 27.6 ms on lock 0x7b54001cbbd0. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f9a98ad 00007fcc1496e419 00007fcc0dee5bd4 00007fcc0dee5b62 00007fcc0dee5a91 00007fcc0dee5a0c 00007fcc0dee4cc2 00007fcc0dce548c 00007fcc0dce48c6 00007fcc0dce426f
0709 13:19:40.792762 (+   234us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":63590656}
I20260709 13:19:40.785588 10034 raft_consensus.cc:697] T bd6869f07b5a4885a0b99fbe60c3b175 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 9 LEADER]: Becoming Leader. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
I20260709 13:19:40.805097 10034 consensus_queue.cc:237] T bd6869f07b5a4885a0b99fbe60c3b175 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 7.3, Last appended by leader: 3, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:40.808913  9925 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:53394 (request call id 69) took 3830 ms. Trace:
I20260709 13:19:40.809408  9925 rpcz_store.cc:276] 0709 13:19:37.011979 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:37.017559 (+  5580us) service_pool.cc:224] Handling call
0709 13:19:37.189690 (+172131us) ts_tablet_manager.cc:1151] Deleting tablet 1528ab62b6fe4e3099d08f141afee116
0709 13:19:37.189838 (+   148us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0709 13:19:40.105265 (+2915427us) tablet_metadata.cc:665] Metadata flushed
0709 13:19:40.651525 (+546260us) tablet_metadata.cc:665] Metadata flushed
0709 13:19:40.808803 (+157278us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1609790,"tablet-delete.queue_time_us":170851,"thread_start_us":127622,"threads_started":1}
I20260709 13:19:40.803053  7495 raft_consensus.cc:1240] T 4f00a2e87e56452083b759f60d461ee3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 9 FOLLOWER]: Rejecting Update request from peer cd75a17ab2604397adab03bb8b5fd75c for earlier term 8. Current term is 9. Ops: [8.9-8.9]
I20260709 13:19:40.774524  9888 raft_consensus.cc:515] T 427c124d773f483294511e80fe340075 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } attrs { replace: true } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:19:40.786382 10033 raft_consensus.cc:2804] T 4d9def8b32fd443aa94ab1420b06837b P ccd8a4c3bfe3413cb2ae219b09aea832 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:19:40.816973  6800 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:32976 (request call id 2433) took 1383 ms. Trace:
I20260709 13:19:40.817400  6800 rpcz_store.cc:276] 0709 13:19:39.433984 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:39.640592 (+206608us) service_pool.cc:224] Handling call
0709 13:19:40.816750 (+1176158us) spinlock_profiling.cc:243] Waited 475 ms on lock 0x7b54002c8dd4. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f9ae2fa 00007fcc1496fb17 00007fcc0deea6d4 00007fcc0deea662 00007fcc0deea591 00007fcc0deea50c 00007fcc0dee97c2 00007fcc0dce548c 00007fcc0dce48c6 00007fcc0dce426f
0709 13:19:40.816887 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1092753152}
I20260709 13:19:40.815303  9627 consensus_queue.cc:1048] T 7a734b5ab7834e05a8c422208acc58b1 P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Connected to new peer: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.010s
W20260709 13:19:40.902557  6847 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:40.879504  6697 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 78679.4us
W20260709 13:19:40.848402  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 709667us
I20260709 13:19:40.906064  6844 leader_election.cc:304] T 24ee15416e3145beaa1b8183453729a3 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, ccd8a4c3bfe3413cb2ae219b09aea832
W20260709 13:19:40.840426  7468 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.5.126.67:42931 timed out after 1.748s (SENT) [suppressed 8 similar messages]
W20260709 13:19:40.849876  6845 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:40.827688  9888 leader_election.cc:290] T 427c124d773f483294511e80fe340075 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
W20260709 13:19:40.909238  7468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 68828.5us
I20260709 13:19:40.816092 10033 raft_consensus.cc:493] T 4d9def8b32fd443aa94ab1420b06837b P ccd8a4c3bfe3413cb2ae219b09aea832 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:40.829358  9947 raft_consensus.cc:2804] T e31b9971c15848dea59d4d4130141d9e P cd75a17ab2604397adab03bb8b5fd75c [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:19:40.918936  6697 leader_election.cc:304] T d8292e16e5654be6bc408560cf256aaa P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377
I20260709 13:19:40.849053  9977 raft_consensus.cc:2804] T 3d65025eea89441290d85dd053810e31 P cd75a17ab2604397adab03bb8b5fd75c [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:19:40.914978 10033 raft_consensus.cc:3060] T 4d9def8b32fd443aa94ab1420b06837b P ccd8a4c3bfe3413cb2ae219b09aea832 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:40.921579  9586 leader_election.cc:290] T 4f00a2e87e56452083b759f60d461ee3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 9 election: Requested vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
W20260709 13:19:40.922987  6770 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 1.04267e+06us
I20260709 13:19:40.924436 10010 raft_consensus.cc:2749] T 24ee15416e3145beaa1b8183453729a3 P cd75a17ab2604397adab03bb8b5fd75c [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:19:40.924602  9785 raft_consensus.cc:2749] T 404190ce4ce94cecbfcb6ea9d1dd8626 P b7ab4784c7344b939bc36f639286f377 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:19:40.926595 10001 raft_consensus.cc:493] T e77e330a82df4b43a745d57a68f6f057 P cd75a17ab2604397adab03bb8b5fd75c [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:40.927071  9809 raft_consensus.cc:493] T 4b8cacb381b746da8d0049b0a83b41dd P cd75a17ab2604397adab03bb8b5fd75c [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:40.927500 10000 raft_consensus.cc:493] T b56bf91d90824c959e21e0cee5ba1816 P cd75a17ab2604397adab03bb8b5fd75c [term 8 FOLLOWER]: Starting pre-election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:19:40.928284  6844 leader_election.cc:304] T 1528ab62b6fe4e3099d08f141afee116 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:19:40.928483  9852 raft_consensus.cc:3055] T 7887766dc6784fcaa42b35c05fea7a99 P b7ab4784c7344b939bc36f639286f377 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:19:40.889055  6616 catalog_manager.cc:5028] TS cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931): tablet 1528ab62b6fe4e3099d08f141afee116 (table test-workload [id=04f4d366747e43549980077479ed75b9]) successfully deleted
I20260709 13:19:40.913324  9892 raft_consensus.cc:493] T f03d0dbf16864ca4bc1bb5e4c0334c0f P cd75a17ab2604397adab03bb8b5fd75c [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:40.968243 10019 raft_consensus.cc:493] T d8cee0accdb8499c86d4414b72565a38 P cd75a17ab2604397adab03bb8b5fd75c [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:40.918638 10031 raft_consensus.cc:493] T 3fa34c08b205435dba97346991aa1f92 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 10 FOLLOWER]: Starting pre-election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:19:40.973336 10020 raft_consensus.cc:493] T be1a92657f494cac8dd227d152f50151 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:40.946271  9780 consensus_queue.cc:260] T 7c44c4849aa54f2b94d1f1bef9ed546f P ccd8a4c3bfe3413cb2ae219b09aea832 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
W20260709 13:19:40.978477  6772 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 225473us
I20260709 13:19:40.848071 10022 raft_consensus.cc:3055] T f4b8bd455d5a47c18a1380839c6e0d61 P cd75a17ab2604397adab03bb8b5fd75c [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:19:40.969343  6800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "711ef6523deb4cbe8ef2ba61e1c21c98" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
W20260709 13:19:40.979334  6697 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 60477.9us
W20260709 13:19:40.985888 10021 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.635s	user 0.010s	sys 0.002s
I20260709 13:19:40.987856  6807 raft_consensus.cc:1275] T de3186201e1a40d0b335eeb8b4e256e0 P b7ab4784c7344b939bc36f639286f377 [term 9 FOLLOWER]: Refusing update from remote peer ccd8a4c3bfe3413cb2ae219b09aea832: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:19:40.986593  6804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17587d6730594da4a56fa13a353232a1" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:19:40.985374  6805 raft_consensus.cc:1275] T f03d0dbf16864ca4bc1bb5e4c0334c0f P b7ab4784c7344b939bc36f639286f377 [term 7 FOLLOWER]: Refusing update from remote peer ccd8a4c3bfe3413cb2ae219b09aea832: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:19:40.982833  6770 leader_election.cc:304] T 1528ab62b6fe4e3099d08f141afee116 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
I20260709 13:19:40.985436  6801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1704639a875409b9959353527b3fd68" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:19:40.987389  6806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e326172347f45e99a0d482b5d8ef768" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:19:41.012759  6806 raft_consensus.cc:2468] T 9e326172347f45e99a0d482b5d8ef768 P b7ab4784c7344b939bc36f639286f377 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 7.
I20260709 13:19:40.973073 10006 raft_consensus.cc:493] T 2c240553ce044eedb41541d72b9475d7 P b7ab4784c7344b939bc36f639286f377 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:40.900225 10032 consensus_queue.cc:237] T 20f6842e26174571996b8dea4151d4be P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:40.990552  9852 raft_consensus.cc:740] T 7887766dc6784fcaa42b35c05fea7a99 P b7ab4784c7344b939bc36f639286f377 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
I20260709 13:19:40.972616  6802 raft_consensus.cc:1240] T 7c44c4849aa54f2b94d1f1bef9ed546f P b7ab4784c7344b939bc36f639286f377 [term 10 FOLLOWER]: Rejecting Update request from peer ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 9. Current term is 10. Ops: []
W20260709 13:19:40.990585  6844 raft_consensus.cc:2686] T 1528ab62b6fe4e3099d08f141afee116 P cd75a17ab2604397adab03bb8b5fd75c: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260709 13:19:40.999214  6772 leader_election.cc:304] T 30e88460611e47b2ba16a46a30b5f416 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:19:40.979584  9864 raft_consensus.cc:697] T 22ccee1b570c4ad3a57bd7aec085b1b4 P b7ab4784c7344b939bc36f639286f377 [term 8 LEADER]: Becoming Leader. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
I20260709 13:19:41.001911  6800 raft_consensus.cc:2393] T 711ef6523deb4cbe8ef2ba61e1c21c98 P b7ab4784c7344b939bc36f639286f377 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ccd8a4c3bfe3413cb2ae219b09aea832 in current term 10: Already voted for candidate b7ab4784c7344b939bc36f639286f377 in this term.
I20260709 13:19:41.002002 10020 raft_consensus.cc:515] T be1a92657f494cac8dd227d152f50151 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:19:41.002767  6697 leader_election.cc:304] T f58dc08b12a2494bb9a1372837970ca2 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377
W20260709 13:19:42.046849  6697 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 1.04407e+06us
I20260709 13:19:40.998378 10010 raft_consensus.cc:493] T bd6869f07b5a4885a0b99fbe60c3b175 P cd75a17ab2604397adab03bb8b5fd75c [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:42.050251 10010 raft_consensus.cc:515] T bd6869f07b5a4885a0b99fbe60c3b175 P cd75a17ab2604397adab03bb8b5fd75c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:42.053109 10010 leader_election.cc:290] T bd6869f07b5a4885a0b99fbe60c3b175 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:19:42.053855  9918 raft_consensus.cc:2804] T f58dc08b12a2494bb9a1372837970ca2 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:19:42.054345  9918 raft_consensus.cc:493] T f58dc08b12a2494bb9a1372837970ca2 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 10 FOLLOWER]: Starting leader election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:19:42.054737  9918 raft_consensus.cc:3060] T f58dc08b12a2494bb9a1372837970ca2 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:19:40.990388 10008 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.890s	user 0.003s	sys 0.012s
W20260709 13:19:40.990278  9999 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.941s	user 0.010s	sys 0.007s
I20260709 13:19:40.984192 10041 raft_consensus.cc:2804] T d8292e16e5654be6bc408560cf256aaa P ccd8a4c3bfe3413cb2ae219b09aea832 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:19:40.987656  9977 raft_consensus.cc:697] T 3d65025eea89441290d85dd053810e31 P cd75a17ab2604397adab03bb8b5fd75c [term 7 LEADER]: Becoming Leader. State: Replica: cd75a17ab2604397adab03bb8b5fd75c, State: Running, Role: LEADER
W20260709 13:19:42.060635  9999 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 2.014s	user 0.010s	sys 0.007s
I20260709 13:19:42.060755 10041 raft_consensus.cc:493] T d8292e16e5654be6bc408560cf256aaa P ccd8a4c3bfe3413cb2ae219b09aea832 [term 10 FOLLOWER]: Starting leader election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:19:42.061390  9977 consensus_queue.cc:237] T 3d65025eea89441290d85dd053810e31 P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:40.976617  9836 raft_consensus.cc:493] T f4b8bd455d5a47c18a1380839c6e0d61 P b7ab4784c7344b939bc36f639286f377 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:42.064342  9836 raft_consensus.cc:515] T f4b8bd455d5a47c18a1380839c6e0d61 P b7ab4784c7344b939bc36f639286f377 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:42.066413  9836 leader_election.cc:290] T f4b8bd455d5a47c18a1380839c6e0d61 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:40.991837  9947 raft_consensus.cc:697] T e31b9971c15848dea59d4d4130141d9e P cd75a17ab2604397adab03bb8b5fd75c [term 6 LEADER]: Becoming Leader. State: Replica: cd75a17ab2604397adab03bb8b5fd75c, State: Running, Role: LEADER
I20260709 13:19:41.015295  6770 leader_election.cc:304] T f09c2a98de1a4decabd0ff900dd44caa P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
I20260709 13:19:42.067705  9947 consensus_queue.cc:237] T e31b9971c15848dea59d4d4130141d9e P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
W20260709 13:19:42.068755  6770 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 1.05348e+06us
I20260709 13:19:42.061408 10041 raft_consensus.cc:3060] T d8292e16e5654be6bc408560cf256aaa P ccd8a4c3bfe3413cb2ae219b09aea832 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:42.070501  9836 raft_consensus.cc:2804] T f09c2a98de1a4decabd0ff900dd44caa P b7ab4784c7344b939bc36f639286f377 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:19:42.071007  9836 raft_consensus.cc:493] T f09c2a98de1a4decabd0ff900dd44caa P b7ab4784c7344b939bc36f639286f377 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:42.071393  9836 raft_consensus.cc:3060] T f09c2a98de1a4decabd0ff900dd44caa P b7ab4784c7344b939bc36f639286f377 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:19:41.010689 10021 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.666s	user 0.010s	sys 0.003s
W20260709 13:19:42.060580 10008 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.962s	user 0.003s	sys 0.012s
I20260709 13:19:42.072290 10021 raft_consensus.cc:697] T 853ac0a8cbd64ce99457f170216d4d0f P ccd8a4c3bfe3413cb2ae219b09aea832 [term 6 LEADER]: Becoming Leader. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
I20260709 13:19:42.072511 10008 raft_consensus.cc:697] T f3f9c2e2bf644115957398fe4c9459db P ccd8a4c3bfe3413cb2ae219b09aea832 [term 8 LEADER]: Becoming Leader. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
I20260709 13:19:42.073424 10021 consensus_queue.cc:237] T 853ac0a8cbd64ce99457f170216d4d0f P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:42.073640 10008 consensus_queue.cc:237] T f3f9c2e2bf644115957398fe4c9459db P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:41.018646  9780 raft_consensus.cc:3060] T 7c44c4849aa54f2b94d1f1bef9ed546f P ccd8a4c3bfe3413cb2ae219b09aea832 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:41.044445  6800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1528ab62b6fe4e3099d08f141afee116" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:19:41.022698  9785 consensus_queue.cc:1048] T 95a75bfe094d4bdc963aba3f08dfcd25 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.106s
I20260709 13:19:41.000241  9892 raft_consensus.cc:515] T f03d0dbf16864ca4bc1bb5e4c0334c0f P cd75a17ab2604397adab03bb8b5fd75c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:42.080526  9892 leader_election.cc:290] T f03d0dbf16864ca4bc1bb5e4c0334c0f P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:19:41.024309  6807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb7fa124c3bf4ef9ab65a407cb008441" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:19:40.995561  9809 raft_consensus.cc:515] T 4b8cacb381b746da8d0049b0a83b41dd P cd75a17ab2604397adab03bb8b5fd75c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:19:41.004233 10031 raft_consensus.cc:515] T 3fa34c08b205435dba97346991aa1f92 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:19:42.082355  6807 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50550 (request call id 303) took 1071 ms. Trace:
I20260709 13:19:42.082861  6807 rpcz_store.cc:276] 0709 13:19:41.011270 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:41.023856 (+ 12586us) service_pool.cc:224] Handling call
0709 13:19:42.082274 (+1058418us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:42.083796 10031 leader_election.cc:290] T 3fa34c08b205435dba97346991aa1f92 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:41.018421  9627 raft_consensus.cc:493] T 90d42e216d9741e190bca19a781291fd P cd75a17ab2604397adab03bb8b5fd75c [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:42.083985  6807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ba5dac66ab5497e9e336f2a3c28cda5" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:19:42.084592  9627 raft_consensus.cc:515] T 90d42e216d9741e190bca19a781291fd P cd75a17ab2604397adab03bb8b5fd75c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:42.086088  6807 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50550 (request call id 304) took 1009 ms. Trace:
I20260709 13:19:42.086803 10032 raft_consensus.cc:493] T e77e330a82df4b43a745d57a68f6f057 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:42.087486  9627 leader_election.cc:290] T 90d42e216d9741e190bca19a781291fd P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:19:42.087404 10032 raft_consensus.cc:515] T e77e330a82df4b43a745d57a68f6f057 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } }
I20260709 13:19:41.018555  9958 raft_consensus.cc:2804] T 1528ab62b6fe4e3099d08f141afee116 P b7ab4784c7344b939bc36f639286f377 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:19:42.088661  9958 raft_consensus.cc:697] T 1528ab62b6fe4e3099d08f141afee116 P b7ab4784c7344b939bc36f639286f377 [term 8 LEADER]: Becoming Leader. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
I20260709 13:19:42.089593  9893 raft_consensus.cc:493] T 3d65025eea89441290d85dd053810e31 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:42.089680 10012 raft_consensus.cc:493] T dbdf895bba214ff68685a24fd17dfb5d P ccd8a4c3bfe3413cb2ae219b09aea832 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:42.090023  9657 raft_consensus.cc:493] T d33d5ee8ef6f415593d8df52063161ad P ccd8a4c3bfe3413cb2ae219b09aea832 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:42.090409 10012 raft_consensus.cc:515] T dbdf895bba214ff68685a24fd17dfb5d P ccd8a4c3bfe3413cb2ae219b09aea832 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:42.090643  9657 raft_consensus.cc:515] T d33d5ee8ef6f415593d8df52063161ad P ccd8a4c3bfe3413cb2ae219b09aea832 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:41.003842 10000 raft_consensus.cc:515] T b56bf91d90824c959e21e0cee5ba1816 P cd75a17ab2604397adab03bb8b5fd75c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:42.092624  9958 consensus_queue.cc:237] T 1528ab62b6fe4e3099d08f141afee116 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:19:40.991536 10001 raft_consensus.cc:515] T e77e330a82df4b43a745d57a68f6f057 P cd75a17ab2604397adab03bb8b5fd75c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } }
W20260709 13:19:40.997128  6616 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 111191us
W20260709 13:19:40.982736  7468 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:41.149757  7466 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:41.884531 10059 raft_consensus.cc:493] T 9b3759de40694069b13c0f8bd40e5709 P b7ab4784c7344b939bc36f639286f377 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:42.287135 10059 raft_consensus.cc:515] T 9b3759de40694069b13c0f8bd40e5709 P b7ab4784c7344b939bc36f639286f377 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:42.289669 10059 leader_election.cc:290] T 9b3759de40694069b13c0f8bd40e5709 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:41.885407 10060 raft_consensus.cc:493] T 8c7f33e544204fbaac4078e3e83bbf4e P b7ab4784c7344b939bc36f639286f377 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:42.290599  7494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17587d6730594da4a56fa13a353232a1" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:19:42.291278 10060 raft_consensus.cc:515] T 8c7f33e544204fbaac4078e3e83bbf4e P b7ab4784c7344b939bc36f639286f377 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:42.291909  7494 raft_consensus.cc:2468] T 17587d6730594da4a56fa13a353232a1 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 11.
I20260709 13:19:42.293963 10060 leader_election.cc:290] T 8c7f33e544204fbaac4078e3e83bbf4e P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
W20260709 13:19:41.885461  6772 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 886343us
I20260709 13:19:41.888293 10061 raft_consensus.cc:493] T dbdf895bba214ff68685a24fd17dfb5d P b7ab4784c7344b939bc36f639286f377 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:41.889364 10062 raft_consensus.cc:493] T 7c37d41cd9164c15a6826ca62a851a69 P b7ab4784c7344b939bc36f639286f377 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:41.890390 10063 raft_consensus.cc:493] T bd6869f07b5a4885a0b99fbe60c3b175 P b7ab4784c7344b939bc36f639286f377 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:42.301043 10062 raft_consensus.cc:515] T 7c37d41cd9164c15a6826ca62a851a69 P b7ab4784c7344b939bc36f639286f377 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:42.301241 10063 raft_consensus.cc:515] T bd6869f07b5a4885a0b99fbe60c3b175 P b7ab4784c7344b939bc36f639286f377 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
W20260709 13:19:42.043725  6846 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:42.304934  9999 raft_consensus.cc:493] T fe20b4b48823486ca3b9c648db6ce8aa P cd75a17ab2604397adab03bb8b5fd75c [term 6 FOLLOWER]: Starting pre-election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:19:42.305447  9999 raft_consensus.cc:515] T fe20b4b48823486ca3b9c648db6ce8aa P cd75a17ab2604397adab03bb8b5fd75c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:19:42.307477  9999 leader_election.cc:290] T fe20b4b48823486ca3b9c648db6ce8aa P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:19:42.069658  6770 leader_election.cc:304] T 4d9def8b32fd443aa94ab1420b06837b P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
I20260709 13:19:42.307965  9999 raft_consensus.cc:493] T 07a92dd554674067a83a9cb68c4773f2 P cd75a17ab2604397adab03bb8b5fd75c [term 8 FOLLOWER]: Starting pre-election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
W20260709 13:19:42.308522  6770 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 238975us
I20260709 13:19:42.308456  9999 raft_consensus.cc:515] T 07a92dd554674067a83a9cb68c4773f2 P cd75a17ab2604397adab03bb8b5fd75c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:42.308619  6730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be1a92657f494cac8dd227d152f50151" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:19:42.309347  6770 leader_election.cc:304] T ab432e62819d499eaaf3dd55481dd930 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
I20260709 13:19:42.310536  6877 raft_consensus.cc:1275] T 4b8cacb381b746da8d0049b0a83b41dd P cd75a17ab2604397adab03bb8b5fd75c [term 9 FOLLOWER]: Refusing update from remote peer ccd8a4c3bfe3413cb2ae219b09aea832: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:19:42.310901  6724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fa34c08b205435dba97346991aa1f92" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:19:42.311764  6879 raft_consensus.cc:1275] T 24ee15416e3145beaa1b8183453729a3 P cd75a17ab2604397adab03bb8b5fd75c [term 8 FOLLOWER]: Refusing update from remote peer ccd8a4c3bfe3413cb2ae219b09aea832: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:19:42.311986 10059 raft_consensus.cc:2804] T 4d9def8b32fd443aa94ab1420b06837b P b7ab4784c7344b939bc36f639286f377 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:19:42.312379 10059 raft_consensus.cc:493] T 4d9def8b32fd443aa94ab1420b06837b P b7ab4784c7344b939bc36f639286f377 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:41.295971  9849 raft_consensus.cc:2749] T 30e88460611e47b2ba16a46a30b5f416 P b7ab4784c7344b939bc36f639286f377 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:19:41.295594 10044 consensus_queue.cc:1048] T 44bde925b2e541b69890d70715b85176 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.049s
I20260709 13:19:42.360379  7500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "427c124d773f483294511e80fe340075" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:19:42.361066  7500 raft_consensus.cc:2468] T 427c124d773f483294511e80fe340075 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 7.
I20260709 13:19:42.364675  6880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7887766dc6784fcaa42b35c05fea7a99" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:19:42.365361  6880 raft_consensus.cc:3060] T 7887766dc6784fcaa42b35c05fea7a99 P cd75a17ab2604397adab03bb8b5fd75c [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:42.365768 10031 consensus_queue.cc:1048] T d8cee0accdb8499c86d4414b72565a38 P 7ba59cc884714e8aa5f3f0ecaed84cbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
W20260709 13:19:41.293136 10046 log.cc:927] Time spent T 07a92dd554674067a83a9cb68c4773f2 P b7ab4784c7344b939bc36f639286f377: Append to log took a long time: real 0.275s	user 0.000s	sys 0.000s
I20260709 13:19:42.373885 10012 leader_election.cc:290] T dbdf895bba214ff68685a24fd17dfb5d P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
W20260709 13:19:41.317946 10048 log.cc:927] Time spent T f4b8bd455d5a47c18a1380839c6e0d61 P ccd8a4c3bfe3413cb2ae219b09aea832: Append to log took a long time: real 0.336s	user 0.005s	sys 0.003s
I20260709 13:19:42.375977  6798 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:32976 (request call id 2428) took 2968 ms. Trace:
I20260709 13:19:42.376385  6798 rpcz_store.cc:276] 0709 13:19:39.407591 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:40.626321 (+1218730us) service_pool.cc:224] Handling call
0709 13:19:40.626785 (+   464us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:19:40.756426 (+129641us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:40.756460 (+    34us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:19:40.757067 (+   607us) log.cc:844] Serialized 52 byte log entry
0709 13:19:40.816452 (+ 59385us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:19:40.816493 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:40.816565 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:42.375763 (+1559198us) raft_consensus.cc:1685] finished
0709 13:19:42.375782 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:42.375920 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":301479,"raft.queue_time_us":132085,"raft.run_cpu_time_us":173,"raft.run_wall_time_us":2219,"thread_start_us":58851,"threads_started":1,"wal-append.queue_time_us":220279}
I20260709 13:19:42.378123  6798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be1a92657f494cac8dd227d152f50151" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:19:42.378751  6798 raft_consensus.cc:2468] T be1a92657f494cac8dd227d152f50151 P b7ab4784c7344b939bc36f639286f377 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in term 10.
I20260709 13:19:42.380497  6878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e326172347f45e99a0d482b5d8ef768" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:19:41.289170  9852 consensus_queue.cc:260] T 7887766dc6784fcaa42b35c05fea7a99 P b7ab4784c7344b939bc36f639286f377 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:41.284958  9901 raft_consensus.cc:493] T 2c240553ce044eedb41541d72b9475d7 P cd75a17ab2604397adab03bb8b5fd75c [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:42.392792  9901 raft_consensus.cc:515] T 2c240553ce044eedb41541d72b9475d7 P cd75a17ab2604397adab03bb8b5fd75c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:42.395005  9901 leader_election.cc:290] T 2c240553ce044eedb41541d72b9475d7 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:19:41.290575  9949 raft_consensus.cc:2804] T 7c44c4849aa54f2b94d1f1bef9ed546f P b7ab4784c7344b939bc36f639286f377 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:19:41.284796  9986 raft_consensus.cc:493] T 95a75bfe094d4bdc963aba3f08dfcd25 P cd75a17ab2604397adab03bb8b5fd75c [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:42.397269  9986 raft_consensus.cc:515] T 95a75bfe094d4bdc963aba3f08dfcd25 P cd75a17ab2604397adab03bb8b5fd75c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:42.399425  9986 leader_election.cc:290] T 95a75bfe094d4bdc963aba3f08dfcd25 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:19:41.287171 10020 leader_election.cc:290] T be1a92657f494cac8dd227d152f50151 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:19:41.001365 10022 raft_consensus.cc:740] T f4b8bd455d5a47c18a1380839c6e0d61 P cd75a17ab2604397adab03bb8b5fd75c [term 6 LEADER]: Becoming Follower/Learner. State: Replica: cd75a17ab2604397adab03bb8b5fd75c, State: Running, Role: LEADER
W20260709 13:19:41.471127 10049 log.cc:927] Time spent T 00000000000000000000000000000000 P b3ae52d33b9a4273a42e5e2cf3b5d6b5: Append to log took a long time: real 0.453s	user 0.001s	sys 0.000s
W20260709 13:19:42.097422  6697 connection.cc:256] RPC call timeout handler was delayed by -1.0325348560002112s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.215s for a response
I20260709 13:19:42.416018  6724 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3411566abe2d4c9bb4b2adfdd05e6f17"
dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
mode: GRACEFUL
new_leader_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
 from {username='slave'} at 127.0.0.1:38536
I20260709 13:19:42.415858  6697 leader_election.cc:304] T b3f13b31a1f84f0d89d007eadd57924c P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: b7ab4784c7344b939bc36f639286f377
I20260709 13:19:42.417021  6724 raft_consensus.cc:606] T 3411566abe2d4c9bb4b2adfdd05e6f17 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 6 FOLLOWER]: Received request to transfer leadership to TS cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:19:42.417526  6724 raft_consensus.cc:614] T 3411566abe2d4c9bb4b2adfdd05e6f17 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 6 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:19:41.082427  9875 consensus_queue.cc:1048] T 34f36d59d88f40fe8a2805e604fc6c0a P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 1, Time since last communication: 0.223s
I20260709 13:19:41.006594  9933 consensus_queue.cc:1059] T 1bf4668eeb70467fb3dc5a0289233b3c P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.075s
I20260709 13:19:41.705646  9984 ts_tablet_manager.cc:1916] T 24ee15416e3145beaa1b8183453729a3 P b7ab4784c7344b939bc36f639286f377: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:19:41.780836 10004 consensus_queue.cc:260] T a3022224cc81473690653a83d4e99470 P ccd8a4c3bfe3413cb2ae219b09aea832 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:42.458900 10004 raft_consensus.cc:3060] T a3022224cc81473690653a83d4e99470 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:19:42.461627  7468 leader_election.cc:336] T bb3d8792045a4583ae2e965b1350a5b4 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931): Timed out: RequestConsensusVote RPC to 127.5.126.67:42931 timed out after 1.774s (SENT)
I20260709 13:19:42.462275  7468 leader_election.cc:304] T bb3d8792045a4583ae2e965b1350a5b4 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:19:41.022441 10006 raft_consensus.cc:515] T 2c240553ce044eedb41541d72b9475d7 P b7ab4784c7344b939bc36f639286f377 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:41.003975 10019 raft_consensus.cc:515] T d8cee0accdb8499c86d4414b72565a38 P cd75a17ab2604397adab03bb8b5fd75c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
W20260709 13:19:41.582019 10033 consensus_meta.cc:287] T 4d9def8b32fd443aa94ab1420b06837b P ccd8a4c3bfe3413cb2ae219b09aea832: Time spent flushing consensus metadata: real 0.591s	user 0.009s	sys 0.003s
I20260709 13:19:42.472158 10033 raft_consensus.cc:515] T 4d9def8b32fd443aa94ab1420b06837b P ccd8a4c3bfe3413cb2ae219b09aea832 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:40.997098 10045 consensus_queue.cc:1059] T 30e88460611e47b2ba16a46a30b5f416 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.081s
W20260709 13:19:41.816767 10054 log.cc:927] Time spent T 30e88460611e47b2ba16a46a30b5f416 P ccd8a4c3bfe3413cb2ae219b09aea832: Append to log took a long time: real 0.182s	user 0.003s	sys 0.000s
I20260709 13:19:42.481735 10033 leader_election.cc:290] T 4d9def8b32fd443aa94ab1420b06837b P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 9 election: Requested vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
W20260709 13:19:42.130857  6695 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.127s	user 0.000s	sys 0.024s
W20260709 13:19:42.482437  6695 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.481s	user 0.001s	sys 0.025s
W20260709 13:19:42.482793  6695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 1.48163e+06us
I20260709 13:19:42.483744 10045 consensus_queue.cc:1048] T 7c37d41cd9164c15a6826ca62a851a69 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:19:42.484545  6695 leader_election.cc:304] T f5be3a11b23d4ea9b08300a2789821c7 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:19:42.484894 10019 leader_election.cc:290] T d8cee0accdb8499c86d4414b72565a38 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:19:42.485189 10034 raft_consensus.cc:3055] T 30e88460611e47b2ba16a46a30b5f416 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:19:42.485622 10034 raft_consensus.cc:740] T 30e88460611e47b2ba16a46a30b5f416 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
I20260709 13:19:42.145077  6803 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:32966 (request call id 890) took 2976 ms. Trace:
I20260709 13:19:42.486083  6803 rpcz_store.cc:276] 0709 13:19:39.168427 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:39.804915 (+636488us) service_pool.cc:224] Handling call
0709 13:19:39.805200 (+   285us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:40.491085 (+685885us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:42.144676 (+1653591us) spinlock_profiling.cc:243] Waited 685 ms on lock 0x7b54001b0154. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f9aae01 00007fcc0f9a983e 00007fcc1496e419 00007fcc0dee5bd4 00007fcc0dee5b62 00007fcc0dee5a91 00007fcc0dee5a0c 00007fcc0dee4cc2 00007fcc0dce548c 00007fcc0dce48c6
0709 13:19:42.144979 (+   303us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1575696768}
I20260709 13:19:42.486856  7502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8cee0accdb8499c86d4414b72565a38" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:19:42.156507  6801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "427c124d773f483294511e80fe340075" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:19:42.488543  6801 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:32976 (request call id 2448) took 1496 ms. Trace:
I20260709 13:19:42.488875  6801 rpcz_store.cc:276] 0709 13:19:40.992447 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:42.156168 (+1163721us) service_pool.cc:224] Handling call
0709 13:19:42.488479 (+332311us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:42.162518  7495 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50756 (request call id 217) took 1521 ms. Trace:
I20260709 13:19:42.167367 10055 raft_consensus.cc:493] T 1528ab62b6fe4e3099d08f141afee116 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:42.490187  7495 rpcz_store.cc:276] 0709 13:19:40.640691 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:40.643365 (+  2674us) service_pool.cc:224] Handling call
0709 13:19:40.643788 (+   423us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:40.812628 (+168840us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:42.162102 (+1349474us) spinlock_profiling.cc:243] Waited 141 ms on lock 0x7b540046fad4. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f9aae01 00007fcc0f9a983e 00007fcc1496e419 00007fcc0dee5bd4 00007fcc0dee5b62 00007fcc0dee5a91 00007fcc0dee5a0c 00007fcc0dee4cc2 00007fcc0dce548c 00007fcc0dce48c6
0709 13:19:42.162433 (+   331us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":323186560}
I20260709 13:19:42.175937  6731 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49744 (request call id 289) took 1783 ms. Trace:
I20260709 13:19:42.491283 10055 raft_consensus.cc:515] T 1528ab62b6fe4e3099d08f141afee116 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:19:42.491803  6731 rpcz_store.cc:276] 0709 13:19:40.392868 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:40.393080 (+   212us) service_pool.cc:224] Handling call
0709 13:19:40.408904 (+ 15824us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:40.762240 (+353336us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:42.175582 (+1413342us) spinlock_profiling.cc:243] Waited 345 ms on lock 0x7b540008d254. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f9aae01 00007fcc0f9a983e 00007fcc1496e419 00007fcc0dee5bd4 00007fcc0dee5b62 00007fcc0dee5a91 00007fcc0dee5a0c 00007fcc0dee4cc2 00007fcc0dce548c 00007fcc0dce48c6
0709 13:19:42.175850 (+   268us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":792722048}
I20260709 13:19:42.178812  6805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "427c124d773f483294511e80fe340075" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:19:42.493695 10055 leader_election.cc:290] T 1528ab62b6fe4e3099d08f141afee116 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:19:42.180574  6729 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49998 (request call id 860) took 3402 ms. Trace:
I20260709 13:19:42.182020  6799 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:32976 (request call id 2419) took 4642 ms. Trace:
I20260709 13:19:42.496228  6799 rpcz_store.cc:276] 0709 13:19:37.539202 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:39.261174 (+1721972us) service_pool.cc:224] Handling call
0709 13:19:40.791031 (+1529857us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:40.791748 (+   717us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:42.181813 (+1390065us) spinlock_profiling.cc:243] Waited 1.53 s on lock 0x7b54002c97d0. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f9a98ad 00007fcc1496e419 00007fcc0dee5bd4 00007fcc0dee5b62 00007fcc0dee5a91 00007fcc0dee5a0c 00007fcc0dee4cc2 00007fcc0dce548c 00007fcc0dce48c6 00007fcc0dce426f
0709 13:19:42.181950 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3517428608}
I20260709 13:19:42.188985 10000 leader_election.cc:290] T b56bf91d90824c959e21e0cee5ba1816 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:19:42.083815  9809 leader_election.cc:290] T 4b8cacb381b746da8d0049b0a83b41dd P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
W20260709 13:19:42.201587  6616 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 427c124d773f483294511e80fe340075 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER failed with leader 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 7ba59cc884714e8aa5f3f0ecaed84cbb is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 7 committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } attrs { replace: true } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } } }
I20260709 13:19:42.211210  9657 leader_election.cc:290] T d33d5ee8ef6f415593d8df52063161ad P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:42.090190  9893 raft_consensus.cc:515] T 3d65025eea89441290d85dd053810e31 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:42.228029  6800 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50550 (request call id 301) took 1297 ms. Trace:
I20260709 13:19:42.249053  9918 raft_consensus.cc:515] T f58dc08b12a2494bb9a1372837970ca2 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:42.253888  9836 raft_consensus.cc:515] T f09c2a98de1a4decabd0ff900dd44caa P b7ab4784c7344b939bc36f639286f377 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
W20260709 13:19:42.262809  6845 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:42.264855  6802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17587d6730594da4a56fa13a353232a1" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 12 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
W20260709 13:19:42.508426  6802 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50550 (request call id 302) took 1521 ms (client timeout 1926 ms). Trace:
I20260709 13:19:42.507663  9657 consensus_queue.cc:1048] T f03d0dbf16864ca4bc1bb5e4c0334c0f P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.002s
W20260709 13:19:42.508899  6802 rpcz_store.cc:269] 0709 13:19:40.987573 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:41.044006 (+ 56433us) service_pool.cc:224] Handling call
0709 13:19:42.508362 (+1464356us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":18688}
I20260709 13:19:42.271607  6804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce4f062dcd314d43a63ca74067cb5ee3" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:19:42.510419  9836 leader_election.cc:290] T f09c2a98de1a4decabd0ff900dd44caa P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 10 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:42.299986 10061 raft_consensus.cc:515] T dbdf895bba214ff68685a24fd17dfb5d P b7ab4784c7344b939bc36f639286f377 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:42.510974  6798 raft_consensus.cc:1240] T f09c2a98de1a4decabd0ff900dd44caa P b7ab4784c7344b939bc36f639286f377 [term 10 FOLLOWER]: Rejecting Update request from peer ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 9. Current term is 10. Ops: []
W20260709 13:19:42.505517  6616 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.5.126.68:45071, user_credentials={real_user=slave}} blocked reactor thread for 303987us
I20260709 13:19:42.310495  6770 leader_election.cc:304] T d33d5ee8ef6f415593d8df52063161ad P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
W20260709 13:19:41.043211  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 123230us
I20260709 13:19:41.329381  9864 consensus_queue.cc:237] T 22ccee1b570c4ad3a57bd7aec085b1b4 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:42.312671  9785 raft_consensus.cc:2804] T ab432e62819d499eaaf3dd55481dd930 P b7ab4784c7344b939bc36f639286f377 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:19:42.312709 10059 raft_consensus.cc:3060] T 4d9def8b32fd443aa94ab1420b06837b P b7ab4784c7344b939bc36f639286f377 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:42.311708  6872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "711ef6523deb4cbe8ef2ba61e1c21c98" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:19:42.314131  7496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b8cacb381b746da8d0049b0a83b41dd" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:19:42.311039  9892 raft_consensus.cc:493] T 9e326172347f45e99a0d482b5d8ef768 P cd75a17ab2604397adab03bb8b5fd75c [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:42.303893 10063 leader_election.cc:290] T bd6869f07b5a4885a0b99fbe60c3b175 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:42.316404  6877 raft_consensus.cc:3055] T 34f36d59d88f40fe8a2805e604fc6c0a P cd75a17ab2604397adab03bb8b5fd75c [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:19:42.521792  6877 raft_consensus.cc:740] T 34f36d59d88f40fe8a2805e604fc6c0a P cd75a17ab2604397adab03bb8b5fd75c [term 5 LEADER]: Becoming Follower/Learner. State: Replica: cd75a17ab2604397adab03bb8b5fd75c, State: Running, Role: LEADER
I20260709 13:19:42.522673  6877 consensus_queue.cc:260] T 34f36d59d88f40fe8a2805e604fc6c0a P cd75a17ab2604397adab03bb8b5fd75c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:42.319880  7494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe20b4b48823486ca3b9c648db6ce8aa" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:19:42.524403  7494 raft_consensus.cc:2468] T fe20b4b48823486ca3b9c648db6ce8aa P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 6.
I20260709 13:19:42.525817  6846 leader_election.cc:304] T fe20b4b48823486ca3b9c648db6ce8aa P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:19:42.526688 10000 raft_consensus.cc:2804] T fe20b4b48823486ca3b9c648db6ce8aa P cd75a17ab2604397adab03bb8b5fd75c [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:19:42.527062 10000 raft_consensus.cc:493] T fe20b4b48823486ca3b9c648db6ce8aa P cd75a17ab2604397adab03bb8b5fd75c [term 6 FOLLOWER]: Starting leader election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:19:42.527451 10000 raft_consensus.cc:3060] T fe20b4b48823486ca3b9c648db6ce8aa P cd75a17ab2604397adab03bb8b5fd75c [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:42.319921  6879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1704639a875409b9959353527b3fd68" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:19:42.528343  6879 raft_consensus.cc:2468] T a1704639a875409b9959353527b3fd68 P cd75a17ab2604397adab03bb8b5fd75c [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 8.
I20260709 13:19:42.529538  6879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "427c124d773f483294511e80fe340075" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:19:42.530079  6879 raft_consensus.cc:2468] T 427c124d773f483294511e80fe340075 P cd75a17ab2604397adab03bb8b5fd75c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 7.
I20260709 13:19:42.531248  6879 raft_consensus.cc:1275] T 8c7f33e544204fbaac4078e3e83bbf4e P cd75a17ab2604397adab03bb8b5fd75c [term 6 FOLLOWER]: Refusing update from remote peer ccd8a4c3bfe3413cb2ae219b09aea832: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:19:42.328293  6875 raft_consensus.cc:1240] T a3022224cc81473690653a83d4e99470 P cd75a17ab2604397adab03bb8b5fd75c [term 9 FOLLOWER]: Rejecting Update request from peer ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 8. Current term is 9. Ops: [8.5-8.5]
I20260709 13:19:42.328294  9999 leader_election.cc:290] T 07a92dd554674067a83a9cb68c4773f2 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:19:42.329277  6876 raft_consensus.cc:3055] T 9b3759de40694069b13c0f8bd40e5709 P cd75a17ab2604397adab03bb8b5fd75c [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:19:42.532519  6876 raft_consensus.cc:740] T 9b3759de40694069b13c0f8bd40e5709 P cd75a17ab2604397adab03bb8b5fd75c [term 7 LEADER]: Becoming Follower/Learner. State: Replica: cd75a17ab2604397adab03bb8b5fd75c, State: Running, Role: LEADER
I20260709 13:19:42.532883  9785 raft_consensus.cc:697] T ab432e62819d499eaaf3dd55481dd930 P b7ab4784c7344b939bc36f639286f377 [term 10 LEADER]: Becoming Leader. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
I20260709 13:19:42.533309  6876 consensus_queue.cc:260] T 9b3759de40694069b13c0f8bd40e5709 P cd75a17ab2604397adab03bb8b5fd75c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:42.533735  9785 consensus_queue.cc:237] T ab432e62819d499eaaf3dd55481dd930 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:42.333734  9450 consensus_queue.cc:1048] T 713b5728a197487c9300b310ab94e5a3 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:19:42.338606 10032 leader_election.cc:290] T e77e330a82df4b43a745d57a68f6f057 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:42.341233  6881 raft_consensus.cc:1275] T 7c37d41cd9164c15a6826ca62a851a69 P cd75a17ab2604397adab03bb8b5fd75c [term 7 FOLLOWER]: Refusing update from remote peer ccd8a4c3bfe3413cb2ae219b09aea832: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:19:42.342439  6873 raft_consensus.cc:1275] T 44bde925b2e541b69890d70715b85176 P cd75a17ab2604397adab03bb8b5fd75c [term 9 FOLLOWER]: Refusing update from remote peer ccd8a4c3bfe3413cb2ae219b09aea832: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 6. (term mismatch)
I20260709 13:19:42.343048  6874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3d8792045a4583ae2e965b1350a5b4" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:19:42.300096  6772 leader_election.cc:304] T f3f9c2e2bf644115957398fe4c9459db P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:19:42.344259  9586 raft_consensus.cc:493] T b3f13b31a1f84f0d89d007eadd57924c P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:42.345876  9898 raft_consensus.cc:3060] T f09c2a98de1a4decabd0ff900dd44caa P cd75a17ab2604397adab03bb8b5fd75c [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:42.348508 10062 leader_election.cc:290] T 7c37d41cd9164c15a6826ca62a851a69 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
W20260709 13:19:42.355571  6847 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:42.357872  7498 raft_consensus.cc:1275] T 4b8cacb381b746da8d0049b0a83b41dd P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 9 FOLLOWER]: Refusing update from remote peer ccd8a4c3bfe3413cb2ae219b09aea832: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:19:42.534238  6876 raft_consensus.cc:3060] T 9b3759de40694069b13c0f8bd40e5709 P cd75a17ab2604397adab03bb8b5fd75c [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:42.359076  7503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3d8792045a4583ae2e965b1350a5b4" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb"
I20260709 13:19:42.381191  7466 leader_election.cc:304] T be1a92657f494cac8dd227d152f50151 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, b7ab4784c7344b939bc36f639286f377; no voters: ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:19:42.383877  9852 raft_consensus.cc:3060] T 7887766dc6784fcaa42b35c05fea7a99 P b7ab4784c7344b939bc36f639286f377 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:42.536381  9892 raft_consensus.cc:515] T 9e326172347f45e99a0d482b5d8ef768 P cd75a17ab2604397adab03bb8b5fd75c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
W20260709 13:19:42.537477  7466 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 156378us
I20260709 13:19:42.538628  9892 leader_election.cc:290] T 9e326172347f45e99a0d482b5d8ef768 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:19:42.396751  9949 raft_consensus.cc:697] T 7c44c4849aa54f2b94d1f1bef9ed546f P b7ab4784c7344b939bc36f639286f377 [term 10 LEADER]: Becoming Leader. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
I20260709 13:19:42.401628  6880 raft_consensus.cc:2468] T 7887766dc6784fcaa42b35c05fea7a99 P cd75a17ab2604397adab03bb8b5fd75c [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 9.
I20260709 13:19:42.542423  6880 raft_consensus.cc:1240] T 30e88460611e47b2ba16a46a30b5f416 P cd75a17ab2604397adab03bb8b5fd75c [term 8 FOLLOWER]: Rejecting Update request from peer ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 7. Current term is 8. Ops: []
I20260709 13:19:42.542873  6873 pending_rounds.cc:85] T 44bde925b2e541b69890d70715b85176 P cd75a17ab2604397adab03bb8b5fd75c: Aborting all ops after (but not including) 5
I20260709 13:19:42.543164  6873 pending_rounds.cc:107] T 44bde925b2e541b69890d70715b85176 P cd75a17ab2604397adab03bb8b5fd75c: Aborting uncommitted NO_OP operation due to leader change: 8.6
I20260709 13:19:42.543332  6873 raft_consensus.cc:2889] T 44bde925b2e541b69890d70715b85176 P cd75a17ab2604397adab03bb8b5fd75c [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:19:42.412125 10022 consensus_queue.cc:260] T f4b8bd455d5a47c18a1380839c6e0d61 P cd75a17ab2604397adab03bb8b5fd75c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:42.417834  6697 leader_election.cc:304] T 17587d6730594da4a56fa13a353232a1 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
W20260709 13:19:42.545825  6697 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.68:45071, user_credentials={real_user=slave}} blocked reactor thread for 128094us
W20260709 13:19:42.440557  6771 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:42.412184 10041 raft_consensus.cc:515] T d8292e16e5654be6bc408560cf256aaa P ccd8a4c3bfe3413cb2ae219b09aea832 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:42.439637 10035 raft_consensus.cc:2804] T b3f13b31a1f84f0d89d007eadd57924c P ccd8a4c3bfe3413cb2ae219b09aea832 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:19:42.449785  9933 raft_consensus.cc:3055] T 1bf4668eeb70467fb3dc5a0289233b3c P ccd8a4c3bfe3413cb2ae219b09aea832 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:19:42.438540 10012 consensus_queue.cc:1059] T 24ee15416e3145beaa1b8183453729a3 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.012s
I20260709 13:19:42.467585 10020 raft_consensus.cc:2749] T bb3d8792045a4583ae2e965b1350a5b4 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:19:42.471567 10006 leader_election.cc:290] T 2c240553ce044eedb41541d72b9475d7 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:42.086505  6807 rpcz_store.cc:276] 0709 13:19:41.076915 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:42.083663 (+1006748us) service_pool.cc:224] Handling call
0709 13:19:42.086016 (+  2353us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:42.490540 10033 consensus_queue.cc:1048] T de3186201e1a40d0b335eeb8b4e256e0 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:19:42.490010 10034 consensus_queue.cc:260] T 30e88460611e47b2ba16a46a30b5f416 P ccd8a4c3bfe3413cb2ae219b09aea832 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:42.194329 10001 leader_election.cc:290] T e77e330a82df4b43a745d57a68f6f057 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391)
I20260709 13:19:42.495888  6729 rpcz_store.cc:276] 0709 13:19:38.778627 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:38.943517 (+164890us) service_pool.cc:224] Handling call
0709 13:19:40.426178 (+1482661us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:40.437324 (+ 11146us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:42.180342 (+1743018us) spinlock_profiling.cc:243] Waited 1.47 s on lock 0x7b54000e4a50. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f9a98ad 00007fcc1496e419 00007fcc0dee5bd4 00007fcc0dee5b62 00007fcc0dee5a91 00007fcc0dee5a0c 00007fcc0dee4cc2 00007fcc0dce548c 00007fcc0dce48c6 00007fcc0dce426f
0709 13:19:42.180508 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3389232896}
I20260709 13:19:42.503578  6695 leader_election.cc:304] T 9e326172347f45e99a0d482b5d8ef768 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
I20260709 13:19:42.504406  6800 rpcz_store.cc:276] 0709 13:19:40.936836 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:41.043929 (+107093us) service_pool.cc:224] Handling call
0709 13:19:42.227772 (+1183843us) spinlock_profiling.cc:243] Waited 148 ms on lock 0x7b54001b4ed4. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f9ae2fa 00007fcc1496fb17 00007fcc0deea6d4 00007fcc0deea662 00007fcc0deea591 00007fcc0deea50c 00007fcc0dee97c2 00007fcc0dce548c 00007fcc0dce48c6 00007fcc0dce426f
0709 13:19:42.227947 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":339430912}
I20260709 13:19:42.275218  6806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f00a2e87e56452083b759f60d461ee3" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:19:42.490036  9888 raft_consensus.cc:3060] T f5be3a11b23d4ea9b08300a2789821c7 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:42.510630  9918 leader_election.cc:290] T f58dc08b12a2494bb9a1372837970ca2 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 11 election: Requested vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
W20260709 13:19:42.512416  6770 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 201969us
I20260709 13:19:42.510969  9809 raft_consensus.cc:493] T f3f9c2e2bf644115957398fe4c9459db P cd75a17ab2604397adab03bb8b5fd75c [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:42.514060  9893 leader_election.cc:290] T 3d65025eea89441290d85dd053810e31 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:42.514915  6798 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:32976 (request call id 2447) took 1542 ms. Trace:
I20260709 13:19:42.515115  9836 raft_consensus.cc:2804] T d33d5ee8ef6f415593d8df52063161ad P b7ab4784c7344b939bc36f639286f377 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:19:42.514940 10061 leader_election.cc:290] T dbdf895bba214ff68685a24fd17dfb5d P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:42.502820 10019 consensus_queue.cc:1059] T 4f00a2e87e56452083b759f60d461ee3 P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.013s
I20260709 13:19:42.505350 10053 raft_consensus.cc:493] T a3022224cc81473690653a83d4e99470 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:42.517239  6844 leader_election.cc:304] T dbdf895bba214ff68685a24fd17dfb5d P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:19:42.520371  6872 raft_consensus.cc:2410] T 711ef6523deb4cbe8ef2ba61e1c21c98 P cd75a17ab2604397adab03bb8b5fd75c [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ccd8a4c3bfe3413cb2ae219b09aea832 for term 10 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 13:19:42.539812  6878 raft_consensus.cc:2410] T 9e326172347f45e99a0d482b5d8ef768 P cd75a17ab2604397adab03bb8b5fd75c [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ccd8a4c3bfe3413cb2ae219b09aea832 for term 8 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 13:19:42.523802  6877 raft_consensus.cc:3060] T 34f36d59d88f40fe8a2805e604fc6c0a P cd75a17ab2604397adab03bb8b5fd75c [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:19:42.544752  6847 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:42.556185 10041 leader_election.cc:290] T d8292e16e5654be6bc408560cf256aaa P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 11 election: Requested vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:42.660519 10035 raft_consensus.cc:697] T b3f13b31a1f84f0d89d007eadd57924c P ccd8a4c3bfe3413cb2ae219b09aea832 [term 6 LEADER]: Becoming Leader. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
I20260709 13:19:42.587004  9949 consensus_queue.cc:237] T 7c44c4849aa54f2b94d1f1bef9ed546f P b7ab4784c7344b939bc36f639286f377 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:42.559091  9586 raft_consensus.cc:515] T b3f13b31a1f84f0d89d007eadd57924c P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:19:42.560874 10031 raft_consensus.cc:2804] T be1a92657f494cac8dd227d152f50151 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:19:42.661585 10035 consensus_queue.cc:237] T b3f13b31a1f84f0d89d007eadd57924c P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:19:42.662276 10031 raft_consensus.cc:493] T be1a92657f494cac8dd227d152f50151 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:42.662837 10031 raft_consensus.cc:3060] T be1a92657f494cac8dd227d152f50151 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:42.586234 10022 raft_consensus.cc:3060] T f4b8bd455d5a47c18a1380839c6e0d61 P cd75a17ab2604397adab03bb8b5fd75c [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:42.664714 10012 raft_consensus.cc:3055] T 24ee15416e3145beaa1b8183453729a3 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 8 LEADER]: Stepping down as leader of term 8
W20260709 13:19:42.641079 10077 log.cc:927] Time spent T d8cee0accdb8499c86d4414b72565a38 P b7ab4784c7344b939bc36f639286f377: Append to log took a long time: real 0.085s	user 0.001s	sys 0.000s
I20260709 13:19:42.665305 10012 raft_consensus.cc:740] T 24ee15416e3145beaa1b8183453729a3 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
I20260709 13:19:42.584674 10066 raft_consensus.cc:2764] T f3f9c2e2bf644115957398fe4c9459db P b7ab4784c7344b939bc36f639286f377 [term 8 FOLLOWER]: Leader pre-election decision vote started in defunct term 7: won
I20260709 13:19:42.666637 10012 consensus_queue.cc:260] T 24ee15416e3145beaa1b8183453729a3 P ccd8a4c3bfe3413cb2ae219b09aea832 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:19:42.667634  9809 raft_consensus.cc:515] T f3f9c2e2bf644115957398fe4c9459db P cd75a17ab2604397adab03bb8b5fd75c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:42.668331  9933 raft_consensus.cc:740] T 1bf4668eeb70467fb3dc5a0289233b3c P ccd8a4c3bfe3413cb2ae219b09aea832 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
I20260709 13:19:42.669510  9933 consensus_queue.cc:260] T 1bf4668eeb70467fb3dc5a0289233b3c P ccd8a4c3bfe3413cb2ae219b09aea832 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
W20260709 13:19:42.670678  6695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 167125us
I20260709 13:19:42.670938  9933 raft_consensus.cc:3060] T 1bf4668eeb70467fb3dc5a0289233b3c P ccd8a4c3bfe3413cb2ae219b09aea832 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:42.671434 10034 raft_consensus.cc:3060] T 30e88460611e47b2ba16a46a30b5f416 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:42.672070 10030 raft_consensus.cc:2804] T 9e326172347f45e99a0d482b5d8ef768 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:19:42.672904 10030 raft_consensus.cc:493] T 9e326172347f45e99a0d482b5d8ef768 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:42.673333 10030 raft_consensus.cc:3060] T 9e326172347f45e99a0d482b5d8ef768 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:42.675424 10053 raft_consensus.cc:515] T a3022224cc81473690653a83d4e99470 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:42.556470  9657 raft_consensus.cc:2804] T 17587d6730594da4a56fa13a353232a1 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:19:42.677309  9657 raft_consensus.cc:493] T 17587d6730594da4a56fa13a353232a1 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:42.676720  6798 rpcz_store.cc:276] 0709 13:19:40.972427 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:42.385155 (+1412728us) service_pool.cc:224] Handling call
0709 13:19:42.385621 (+   466us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:42.511579 (+125958us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:42.514695 (+  3116us) spinlock_profiling.cc:243] Waited 125 ms on lock 0x7b54001f5254. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f9aae01 00007fcc0f9a983e 00007fcc1496e419 00007fcc0dee5bd4 00007fcc0dee5b62 00007fcc0dee5a91 00007fcc0dee5a0c 00007fcc0dee4cc2 00007fcc0dce548c 00007fcc0dce48c6
0709 13:19:42.514855 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":287874304}
I20260709 13:19:42.678524 10019 raft_consensus.cc:3055] T 4f00a2e87e56452083b759f60d461ee3 P cd75a17ab2604397adab03bb8b5fd75c [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:19:42.679046 10019 raft_consensus.cc:740] T 4f00a2e87e56452083b759f60d461ee3 P cd75a17ab2604397adab03bb8b5fd75c [term 8 LEADER]: Becoming Follower/Learner. State: Replica: cd75a17ab2604397adab03bb8b5fd75c, State: Running, Role: LEADER
I20260709 13:19:42.680188 10019 consensus_queue.cc:260] T 4f00a2e87e56452083b759f60d461ee3 P cd75a17ab2604397adab03bb8b5fd75c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:19:42.681836 10019 raft_consensus.cc:3060] T 4f00a2e87e56452083b759f60d461ee3 P cd75a17ab2604397adab03bb8b5fd75c [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:42.556794 10045 consensus_queue.cc:1048] T 4b8cacb381b746da8d0049b0a83b41dd P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.129s
I20260709 13:19:42.667996 10012 raft_consensus.cc:3060] T 24ee15416e3145beaa1b8183453729a3 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:42.690950  9657 raft_consensus.cc:3060] T 17587d6730594da4a56fa13a353232a1 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:19:42.693957  6698 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:42.699221  9999 raft_consensus.cc:2804] T dbdf895bba214ff68685a24fd17dfb5d P cd75a17ab2604397adab03bb8b5fd75c [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:19:42.701406  6770 leader_election.cc:304] T be1a92657f494cac8dd227d152f50151 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:19:42.699879  6806 raft_consensus.cc:2393] T 4f00a2e87e56452083b759f60d461ee3 P b7ab4784c7344b939bc36f639286f377 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in current term 9: Already voted for candidate b7ab4784c7344b939bc36f639286f377 in this term.
I20260709 13:19:42.696528  9836 raft_consensus.cc:697] T d33d5ee8ef6f415593d8df52063161ad P b7ab4784c7344b939bc36f639286f377 [term 10 LEADER]: Becoming Leader. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
W20260709 13:19:42.699071  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 181950us
W20260709 13:19:42.704020  6846 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:42.695645  6772 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 395659us
I20260709 13:19:42.697022  9586 leader_election.cc:290] T b3f13b31a1f84f0d89d007eadd57924c P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:19:42.710811  6876 raft_consensus.cc:1275] T 9b3759de40694069b13c0f8bd40e5709 P cd75a17ab2604397adab03bb8b5fd75c [term 8 FOLLOWER]: Refusing update from remote peer ccd8a4c3bfe3413cb2ae219b09aea832: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 5. (term mismatch)
I20260709 13:19:42.715865  6876 pending_rounds.cc:85] T 9b3759de40694069b13c0f8bd40e5709 P cd75a17ab2604397adab03bb8b5fd75c: Aborting all ops after (but not including) 4
I20260709 13:19:42.716236  6876 pending_rounds.cc:107] T 9b3759de40694069b13c0f8bd40e5709 P cd75a17ab2604397adab03bb8b5fd75c: Aborting uncommitted NO_OP operation due to leader change: 7.5
I20260709 13:19:42.718358  6876 raft_consensus.cc:2889] T 9b3759de40694069b13c0f8bd40e5709 P cd75a17ab2604397adab03bb8b5fd75c [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:19:42.672344  6696 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:42.720021  6876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f58dc08b12a2494bb9a1372837970ca2" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
W20260709 13:19:42.729342  7466 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 184950us
W20260709 13:19:42.737802  6696 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:42.739749  6724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f58dc08b12a2494bb9a1372837970ca2" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:19:42.740700  6724 raft_consensus.cc:2393] T f58dc08b12a2494bb9a1372837970ca2 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c in current term 11: Already voted for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in this term.
I20260709 13:19:42.741032  7503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1528ab62b6fe4e3099d08f141afee116" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:19:42.741766  7503 raft_consensus.cc:2468] T 1528ab62b6fe4e3099d08f141afee116 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 7.
I20260709 13:19:42.747674  7494 raft_consensus.cc:1240] T ce4f062dcd314d43a63ca74067cb5ee3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 8 FOLLOWER]: Rejecting Update request from peer b7ab4784c7344b939bc36f639286f377 for earlier term 7. Current term is 8. Ops: []
I20260709 13:19:42.748351  9864 raft_consensus.cc:2749] T be1a92657f494cac8dd227d152f50151 P b7ab4784c7344b939bc36f639286f377 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:19:42.749089  7496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3f13b31a1f84f0d89d007eadd57924c" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:19:42.749891  7496 raft_consensus.cc:2393] T b3f13b31a1f84f0d89d007eadd57924c P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7ab4784c7344b939bc36f639286f377 in current term 6: Already voted for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in this term.
I20260709 13:19:42.752277  6800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3f13b31a1f84f0d89d007eadd57924c" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:19:42.753240  6800 raft_consensus.cc:2468] T b3f13b31a1f84f0d89d007eadd57924c P b7ab4784c7344b939bc36f639286f377 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in term 5.
I20260709 13:19:42.756290  6876 raft_consensus.cc:3060] T f58dc08b12a2494bb9a1372837970ca2 P cd75a17ab2604397adab03bb8b5fd75c [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:42.759483  6798 raft_consensus.cc:1275] T f4b8bd455d5a47c18a1380839c6e0d61 P b7ab4784c7344b939bc36f639286f377 [term 8 FOLLOWER]: Refusing update from remote peer ccd8a4c3bfe3413cb2ae219b09aea832: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:19:42.762321  6804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d33d5ee8ef6f415593d8df52063161ad" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:19:42.762915  6799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbdf895bba214ff68685a24fd17dfb5d" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:19:42.763345  6802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77e330a82df4b43a745d57a68f6f057" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 11 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:19:42.763549  6799 raft_consensus.cc:2468] T dbdf895bba214ff68685a24fd17dfb5d P b7ab4784c7344b939bc36f639286f377 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 7.
I20260709 13:19:42.764230  6802 raft_consensus.cc:2393] T e77e330a82df4b43a745d57a68f6f057 P b7ab4784c7344b939bc36f639286f377 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ccd8a4c3bfe3413cb2ae219b09aea832 in current term 11: Already voted for candidate b7ab4784c7344b939bc36f639286f377 in this term.
I20260709 13:19:42.768862  6807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17587d6730594da4a56fa13a353232a1" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 12 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
W20260709 13:19:42.769354  6844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:42.769915  6806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1528ab62b6fe4e3099d08f141afee116" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:19:42.774266  6729 raft_consensus.cc:1240] T 4d9def8b32fd443aa94ab1420b06837b P ccd8a4c3bfe3413cb2ae219b09aea832 [term 9 FOLLOWER]: Rejecting Update request from peer cd75a17ab2604397adab03bb8b5fd75c for earlier term 8. Current term is 9. Ops: []
I20260709 13:19:42.775564  6807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f58dc08b12a2494bb9a1372837970ca2" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:19:42.777316  6801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d9def8b32fd443aa94ab1420b06837b" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:19:42.777411  6731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de3186201e1a40d0b335eeb8b4e256e0" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:19:42.778479  6725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44bde925b2e541b69890d70715b85176" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:19:42.778757  6730 raft_consensus.cc:1240] T 9b3759de40694069b13c0f8bd40e5709 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 8 LEADER]: Rejecting Update request from peer cd75a17ab2604397adab03bb8b5fd75c for earlier term 7. Current term is 8. Ops: []
I20260709 13:19:42.801239  6724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce4f062dcd314d43a63ca74067cb5ee3" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:19:43.030890  6724 raft_consensus.cc:3060] T ce4f062dcd314d43a63ca74067cb5ee3 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:42.805959  6872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4275cf08e63345f993bce8664eada830" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:19:43.033088  6872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d9def8b32fd443aa94ab1420b06837b" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
W20260709 13:19:43.033655  6844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:43.034365  6872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d33d5ee8ef6f415593d8df52063161ad" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:19:42.867311  6729 raft_consensus.cc:1240] T f4b8bd455d5a47c18a1380839c6e0d61 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 8 LEADER]: Rejecting Update request from peer cd75a17ab2604397adab03bb8b5fd75c for earlier term 6. Current term is 8. Ops: []
W20260709 13:19:42.871290  6695 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:42.786512  6877 raft_consensus.cc:1275] T 34f36d59d88f40fe8a2805e604fc6c0a P cd75a17ab2604397adab03bb8b5fd75c [term 6 FOLLOWER]: Refusing update from remote peer ccd8a4c3bfe3413cb2ae219b09aea832: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 4. (term mismatch)
W20260709 13:19:42.884462  6845 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:42.975844  7503 raft_consensus.cc:1275] T 17587d6730594da4a56fa13a353232a1 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 11 FOLLOWER]: Refusing update from remote peer b7ab4784c7344b939bc36f639286f377: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:19:43.036932  6877 pending_rounds.cc:85] T 34f36d59d88f40fe8a2805e604fc6c0a P cd75a17ab2604397adab03bb8b5fd75c: Aborting all ops after (but not including) 3
I20260709 13:19:43.038491  6877 pending_rounds.cc:107] T 34f36d59d88f40fe8a2805e604fc6c0a P cd75a17ab2604397adab03bb8b5fd75c: Aborting uncommitted NO_OP operation due to leader change: 5.4
W20260709 13:19:42.815296  6847 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:42.845116  6723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7887766dc6784fcaa42b35c05fea7a99" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:19:43.041893  6723 raft_consensus.cc:2393] T 7887766dc6784fcaa42b35c05fea7a99 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c in current term 9: Already voted for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in this term.
W20260709 13:19:42.778812  6770 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 49831.9us
I20260709 13:19:43.039336  6877 raft_consensus.cc:2889] T 34f36d59d88f40fe8a2805e604fc6c0a P cd75a17ab2604397adab03bb8b5fd75c [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:19:42.786834  6876 raft_consensus.cc:2468] T f58dc08b12a2494bb9a1372837970ca2 P cd75a17ab2604397adab03bb8b5fd75c [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 11.
I20260709 13:19:42.782209  6798 raft_consensus.cc:1275] T 2c240553ce044eedb41541d72b9475d7 P b7ab4784c7344b939bc36f639286f377 [term 10 FOLLOWER]: Refusing update from remote peer ccd8a4c3bfe3413cb2ae219b09aea832: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:19:43.043879  6876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab432e62819d499eaaf3dd55481dd930" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:19:43.044552  6876 raft_consensus.cc:3060] T ab432e62819d499eaaf3dd55481dd930 P cd75a17ab2604397adab03bb8b5fd75c [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:43.045254  6800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1528ab62b6fe4e3099d08f141afee116" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:19:42.863862  6727 raft_consensus.cc:1240] T d33d5ee8ef6f415593d8df52063161ad P ccd8a4c3bfe3413cb2ae219b09aea832 [term 10 FOLLOWER]: Rejecting Update request from peer cd75a17ab2604397adab03bb8b5fd75c for earlier term 9. Current term is 10. Ops: []
I20260709 13:19:42.757117  9999 raft_consensus.cc:697] T dbdf895bba214ff68685a24fd17dfb5d P cd75a17ab2604397adab03bb8b5fd75c [term 7 LEADER]: Becoming Leader. State: Replica: cd75a17ab2604397adab03bb8b5fd75c, State: Running, Role: LEADER
I20260709 13:19:42.842952  7496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f00a2e87e56452083b759f60d461ee3" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb"
I20260709 13:19:43.054924  7496 raft_consensus.cc:2393] T 4f00a2e87e56452083b759f60d461ee3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate b7ab4784c7344b939bc36f639286f377 in current term 9: Already voted for candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in this term.
I20260709 13:19:43.052326  6725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6869f07b5a4885a0b99fbe60c3b175" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 10 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:19:43.055779  6872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5be3a11b23d4ea9b08300a2789821c7" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:19:43.057109  6872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbdf895bba214ff68685a24fd17dfb5d" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:19:43.058380  6872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09c2a98de1a4decabd0ff900dd44caa" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:19:43.063934  6876 raft_consensus.cc:2468] T ab432e62819d499eaaf3dd55481dd930 P cd75a17ab2604397adab03bb8b5fd75c [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 10.
I20260709 13:19:42.970378  7498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1528ab62b6fe4e3099d08f141afee116" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb"
I20260709 13:19:43.065111  6876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d65025eea89441290d85dd053810e31" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
W20260709 13:19:43.066045  6771 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:43.068511  6872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d33d5ee8ef6f415593d8df52063161ad" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:19:43.070103  6697 leader_election.cc:304] T a1704639a875409b9959353527b3fd68 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377
I20260709 13:19:43.070199  6872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d65025eea89441290d85dd053810e31" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:19:43.066839  6876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "711ef6523deb4cbe8ef2ba61e1c21c98" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:19:43.073207  6730 raft_consensus.cc:1240] T 7a734b5ab7834e05a8c422208acc58b1 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 9 FOLLOWER]: Rejecting Update request from peer cd75a17ab2604397adab03bb8b5fd75c for earlier term 8. Current term is 9. Ops: [8.4-8.4]
I20260709 13:19:43.054154  6877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77e330a82df4b43a745d57a68f6f057" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 11 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:19:43.075196  6877 raft_consensus.cc:2468] T e77e330a82df4b43a745d57a68f6f057 P cd75a17ab2604397adab03bb8b5fd75c [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 10.
I20260709 13:19:43.076174  6877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5be3a11b23d4ea9b08300a2789821c7" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:19:42.758665  7495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8cee0accdb8499c86d4414b72565a38" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:19:43.078706  6730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f03d0dbf16864ca4bc1bb5e4c0334c0f" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:19:43.074553  6697 leader_election.cc:304] T 427c124d773f483294511e80fe340075 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377
I20260709 13:19:43.094708  6730 raft_consensus.cc:1275] T 427c124d773f483294511e80fe340075 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 7 FOLLOWER]: Refusing update from remote peer b7ab4784c7344b939bc36f639286f377: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 13:19:43.098605  6804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d65025eea89441290d85dd053810e31" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:19:43.099542  6804 raft_consensus.cc:2468] T 3d65025eea89441290d85dd053810e31 P b7ab4784c7344b939bc36f639286f377 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 7.
I20260709 13:19:43.079103  6727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a92dd554674067a83a9cb68c4773f2" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 9 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:19:43.077518  6877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d9def8b32fd443aa94ab1420b06837b" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:19:43.105372  6877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8cee0accdb8499c86d4414b72565a38" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:19:43.106325  6877 raft_consensus.cc:2468] T d8cee0accdb8499c86d4414b72565a38 P cd75a17ab2604397adab03bb8b5fd75c [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 8.
I20260709 13:19:43.107450  6877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77e330a82df4b43a745d57a68f6f057" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 11 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:19:43.084434  6728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5be3a11b23d4ea9b08300a2789821c7" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:19:43.086530  6726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "711ef6523deb4cbe8ef2ba61e1c21c98" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:19:43.108880  6726 raft_consensus.cc:3060] T 711ef6523deb4cbe8ef2ba61e1c21c98 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:43.113867  6877 raft_consensus.cc:3060] T e77e330a82df4b43a745d57a68f6f057 P cd75a17ab2604397adab03bb8b5fd75c [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:43.118170  6872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f00a2e87e56452083b759f60d461ee3" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
W20260709 13:19:43.119136  6697 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 47217.7us
I20260709 13:19:43.121119  6697 leader_election.cc:304] T 7887766dc6784fcaa42b35c05fea7a99 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377
W20260709 13:19:43.066071  9852 consensus_meta.cc:287] T 7887766dc6784fcaa42b35c05fea7a99 P b7ab4784c7344b939bc36f639286f377: Time spent flushing consensus metadata: real 0.529s	user 0.008s	sys 0.014s
I20260709 13:19:43.137636  6730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4b8bd455d5a47c18a1380839c6e0d61" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:19:43.145356  6723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d65025eea89441290d85dd053810e31" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:19:43.146097  6804 raft_consensus.cc:1275] T f3f9c2e2bf644115957398fe4c9459db P b7ab4784c7344b939bc36f639286f377 [term 8 FOLLOWER]: Refusing update from remote peer ccd8a4c3bfe3413cb2ae219b09aea832: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:19:43.146307  6723 raft_consensus.cc:2468] T 3d65025eea89441290d85dd053810e31 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 7.
I20260709 13:19:42.757517  9892 consensus_queue.cc:1059] T bb3d8792045a4583ae2e965b1350a5b4 P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.334s
I20260709 13:19:42.856928  9890 raft_consensus.cc:493] T 3411566abe2d4c9bb4b2adfdd05e6f17 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:19:43.128450  6724 raft_consensus.cc:2468] T ce4f062dcd314d43a63ca74067cb5ee3 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 8.
W20260709 13:19:43.065157 10014 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 6 current term: 6 is higher.
I20260709 13:19:42.751428  9977 consensus_queue.cc:1059] T 853ac0a8cbd64ce99457f170216d4d0f P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.312s
I20260709 13:19:43.134414  6731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77e330a82df4b43a745d57a68f6f057" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 11 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:19:43.159672  6731 raft_consensus.cc:3060] T e77e330a82df4b43a745d57a68f6f057 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:43.160135  6880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b3759de40694069b13c0f8bd40e5709" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:19:42.864259 10059 raft_consensus.cc:515] T 4d9def8b32fd443aa94ab1420b06837b P b7ab4784c7344b939bc36f639286f377 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:43.147792  6732 raft_consensus.cc:1275] T a3022224cc81473690653a83d4e99470 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 9 FOLLOWER]: Refusing update from remote peer b7ab4784c7344b939bc36f639286f377: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 5. (term mismatch)
I20260709 13:19:43.162416  6732 pending_rounds.cc:85] T a3022224cc81473690653a83d4e99470 P ccd8a4c3bfe3413cb2ae219b09aea832: Aborting all ops after (but not including) 4
I20260709 13:19:43.162681  6732 pending_rounds.cc:107] T a3022224cc81473690653a83d4e99470 P ccd8a4c3bfe3413cb2ae219b09aea832: Aborting uncommitted NO_OP operation due to leader change: 8.5
I20260709 13:19:42.778119  9780 consensus_queue.cc:1059] T 4275cf08e63345f993bce8664eada830 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: INVALID_TERM, Last received: 8.4, Next index: 5, Last known committed idx: 2, Time since last communication: 0.343s
W20260709 13:19:43.150689 10000 consensus_meta.cc:287] T fe20b4b48823486ca3b9c648db6ce8aa P cd75a17ab2604397adab03bb8b5fd75c: Time spent flushing consensus metadata: real 0.623s	user 0.014s	sys 0.005s
I20260709 13:19:43.066946  9947 raft_consensus.cc:493] T 711ef6523deb4cbe8ef2ba61e1c21c98 P cd75a17ab2604397adab03bb8b5fd75c [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:19:42.819839  9918 consensus_queue.cc:1059] T f09c2a98de1a4decabd0ff900dd44caa P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.331s
I20260709 13:19:43.073767 10001 raft_consensus.cc:493] T 713b5728a197487c9300b310ab94e5a3 P cd75a17ab2604397adab03bb8b5fd75c [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:43.227171 10045 raft_consensus.cc:3055] T f09c2a98de1a4decabd0ff900dd44caa P ccd8a4c3bfe3413cb2ae219b09aea832 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:19:43.092371 10033 raft_consensus.cc:2804] T a1704639a875409b9959353527b3fd68 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:19:43.227697 10045 raft_consensus.cc:740] T f09c2a98de1a4decabd0ff900dd44caa P ccd8a4c3bfe3413cb2ae219b09aea832 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
I20260709 13:19:43.075992 10063 raft_consensus.cc:493] T c4db81d9d329422bb3b4160ca4ac2d1d P b7ab4784c7344b939bc36f639286f377 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:19:43.228503 10063 raft_consensus.cc:515] T c4db81d9d329422bb3b4160ca4ac2d1d P b7ab4784c7344b939bc36f639286f377 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:43.231545 10063 leader_election.cc:290] T c4db81d9d329422bb3b4160ca4ac2d1d P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:43.160845  6880 raft_consensus.cc:2468] T 9b3759de40694069b13c0f8bd40e5709 P cd75a17ab2604397adab03bb8b5fd75c [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 8.
W20260709 13:19:43.095156  7524 debug-util.cc:398] Leaking SignalData structure 0x7b08002d8160 after lost signal to thread 5628
I20260709 13:19:43.232791  6880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbdf895bba214ff68685a24fd17dfb5d" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
W20260709 13:19:43.233191  7524 debug-util.cc:398] Leaking SignalData structure 0x7b080037c2a0 after lost signal to thread 6664
I20260709 13:19:43.233963  6880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09c2a98de1a4decabd0ff900dd44caa" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
W20260709 13:19:43.234715  7524 debug-util.cc:398] Leaking SignalData structure 0x7b08002d8960 after lost signal to thread 6756
W20260709 13:19:43.235019  7524 debug-util.cc:398] Leaking SignalData structure 0x7b08002d8940 after lost signal to thread 6757
I20260709 13:19:43.135139 10032 raft_consensus.cc:2804] T 427c124d773f483294511e80fe340075 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:19:43.235685 10032 raft_consensus.cc:493] T 427c124d773f483294511e80fe340075 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:19:43.235958  6772 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.68:45071, user_credentials={real_user=slave}} blocked reactor thread for 142861us
I20260709 13:19:42.964439  9836 consensus_queue.cc:237] T d33d5ee8ef6f415593d8df52063161ad P b7ab4784c7344b939bc36f639286f377 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
W20260709 13:19:43.214148  6844 connection.cc:256] RPC call timeout handler was delayed by -2.9054913740001211s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15280000000000002s for a response
W20260709 13:19:43.225354  6845 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:43.235044  6880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bf4668eeb70467fb3dc5a0289233b3c" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:19:43.237583  6880 raft_consensus.cc:2468] T 1bf4668eeb70467fb3dc5a0289233b3c P cd75a17ab2604397adab03bb8b5fd75c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 7.
W20260709 13:19:43.237751  6845 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:43.238511  6880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c240553ce044eedb41541d72b9475d7" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 11 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:19:43.239472  6880 raft_consensus.cc:2410] T 2c240553ce044eedb41541d72b9475d7 P cd75a17ab2604397adab03bb8b5fd75c [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7ab4784c7344b939bc36f639286f377 for term 11 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 13:19:43.092975 10044 consensus_queue.cc:1048] T 4b8cacb381b746da8d0049b0a83b41dd P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.067s
I20260709 13:19:43.118587  7498 raft_consensus.cc:3060] T 1528ab62b6fe4e3099d08f141afee116 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:43.240388  6880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a92dd554674067a83a9cb68c4773f2" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 9 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:19:43.227872 10033 raft_consensus.cc:493] T a1704639a875409b9959353527b3fd68 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:43.241691 10033 raft_consensus.cc:3060] T a1704639a875409b9959353527b3fd68 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:43.242157  6880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4b8bd455d5a47c18a1380839c6e0d61" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:19:43.236145 10032 raft_consensus.cc:3060] T 427c124d773f483294511e80fe340075 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:43.243443  6880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f03d0dbf16864ca4bc1bb5e4c0334c0f" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:19:43.244228  6880 raft_consensus.cc:2393] T f03d0dbf16864ca4bc1bb5e4c0334c0f P cd75a17ab2604397adab03bb8b5fd75c [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate b7ab4784c7344b939bc36f639286f377 in current term 7: Already voted for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in this term.
W20260709 13:19:43.236651  6844 connection.cc:256] RPC call timeout handler was delayed by -2.8649913740000557s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1573s for a response
W20260709 13:19:43.244756  6844 connection.cc:256] RPC call timeout handler was delayed by -2.8514913740000338s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15880000000000002s for a response
I20260709 13:19:43.245000  6880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34f36d59d88f40fe8a2805e604fc6c0a" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 7 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
W20260709 13:19:43.245141  6844 connection.cc:256] RPC call timeout handler was delayed by -2.8055913739999596s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16390000000000002s for a response
W20260709 13:19:43.249624  6844 connection.cc:256] RPC call timeout handler was delayed by -2.7533913740001026s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16970000000000002s for a response
W20260709 13:19:43.250334  6844 connection.cc:256] RPC call timeout handler was delayed by -2.744391374000088s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17070000000000002s for a response
W20260709 13:19:43.250738  6844 connection.cc:256] RPC call timeout handler was delayed by -2.6507913740001641s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1811s for a response
W20260709 13:19:43.251101  6844 connection.cc:256] RPC call timeout handler was delayed by -2.6183913740001117s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1847s for a response
I20260709 13:19:43.251194  6801 raft_consensus.cc:2393] T 4d9def8b32fd443aa94ab1420b06837b P b7ab4784c7344b939bc36f639286f377 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate ccd8a4c3bfe3413cb2ae219b09aea832 in current term 9: Already voted for candidate b7ab4784c7344b939bc36f639286f377 in this term.
W20260709 13:19:43.251539  6844 connection.cc:256] RPC call timeout handler was delayed by -2.5949913740000738s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18730000000000002s for a response
W20260709 13:19:43.252003  6844 connection.cc:256] RPC call timeout handler was delayed by -2.5661913740000273s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1905s for a response
W20260709 13:19:43.252285  6844 connection.cc:256] RPC call timeout handler was delayed by -2.5589913740000156s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19130000000000003s for a response
W20260709 13:19:43.252545  6844 connection.cc:256] RPC call timeout handler was delayed by -2.5391913739999836s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1935s for a response
W20260709 13:19:43.252485  6846 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.68:45071, user_credentials={real_user=slave}} blocked reactor thread for 216847us
W20260709 13:19:43.252996  6844 connection.cc:256] RPC call timeout handler was delayed by -2.531991373999972s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19430000000000003s for a response
W20260709 13:19:43.253310  6844 connection.cc:256] RPC call timeout handler was delayed by -2.5283913739999662s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1947s for a response
W20260709 13:19:43.253561  6844 connection.cc:256] RPC call timeout handler was delayed by -2.499591374000147s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19790000000000002s for a response
W20260709 13:19:43.253820  6844 connection.cc:256] RPC call timeout handler was delayed by -2.4365913740000451s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2049s for a response
W20260709 13:19:43.254073  6844 connection.cc:256] RPC call timeout handler was delayed by -2.3240913740000906s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2174s for a response
W20260709 13:19:43.254346  6844 connection.cc:256] RPC call timeout handler was delayed by -2.2997913740000513s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22010000000000002s for a response
W20260709 13:19:43.254611  6844 connection.cc:256] RPC call timeout handler was delayed by -2.2592913739999858s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22460000000000002s for a response
I20260709 13:19:43.225760  9947 raft_consensus.cc:515] T 711ef6523deb4cbe8ef2ba61e1c21c98 P cd75a17ab2604397adab03bb8b5fd75c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
W20260709 13:19:43.255199  6844 connection.cc:256] RPC call timeout handler was delayed by -2.0990913740001815s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2424s for a response
I20260709 13:19:43.256458  6880 raft_consensus.cc:2410] T 34f36d59d88f40fe8a2805e604fc6c0a P cd75a17ab2604397adab03bb8b5fd75c [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7ab4784c7344b939bc36f639286f377 for term 7 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:19:43.135799  9849 consensus_queue.cc:1059] T ce4f062dcd314d43a63ca74067cb5ee3 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.080s
I20260709 13:19:43.134059 10041 consensus_queue.cc:1048] T 8c7f33e544204fbaac4078e3e83bbf4e P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.081s
W20260709 13:19:43.259583  6844 connection.cc:256] RPC call timeout handler was delayed by -1.1189913739999611s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.3513s for a response
I20260709 13:19:43.257951  6772 leader_election.cc:304] T b3f13b31a1f84f0d89d007eadd57924c P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:19:43.169109 10034 raft_consensus.cc:2804] T 7887766dc6784fcaa42b35c05fea7a99 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:19:43.262849  6844 leader_election.cc:304] T 22ccee1b570c4ad3a57bd7aec085b1b4 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:19:43.264947  6880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c37d41cd9164c15a6826ca62a851a69" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:19:43.267004  6880 raft_consensus.cc:2410] T 7c37d41cd9164c15a6826ca62a851a69 P cd75a17ab2604397adab03bb8b5fd75c [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7ab4784c7344b939bc36f639286f377 for term 8 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
W20260709 13:19:43.266849  6846 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:43.268628  6880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c7f33e544204fbaac4078e3e83bbf4e" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:19:43.274792  6880 raft_consensus.cc:2410] T 8c7f33e544204fbaac4078e3e83bbf4e P cd75a17ab2604397adab03bb8b5fd75c [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7ab4784c7344b939bc36f639286f377 for term 7 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:19:43.161028  9890 raft_consensus.cc:515] T 3411566abe2d4c9bb4b2adfdd05e6f17 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:43.275782  6876 raft_consensus.cc:3060] T 711ef6523deb4cbe8ef2ba61e1c21c98 P cd75a17ab2604397adab03bb8b5fd75c [term 8 FOLLOWER]: Advancing to term 10
I20260709 13:19:43.280211 10034 raft_consensus.cc:697] T 7887766dc6784fcaa42b35c05fea7a99 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 9 LEADER]: Becoming Leader. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
I20260709 13:19:43.227289 10001 raft_consensus.cc:515] T 713b5728a197487c9300b310ab94e5a3 P cd75a17ab2604397adab03bb8b5fd75c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:43.280637 10091 raft_consensus.cc:493] T 1bf4668eeb70467fb3dc5a0289233b3c P cd75a17ab2604397adab03bb8b5fd75c [term 7 FOLLOWER]: Starting pre-election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:19:43.215675 10000 raft_consensus.cc:515] T fe20b4b48823486ca3b9c648db6ce8aa P cd75a17ab2604397adab03bb8b5fd75c [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:19:43.301999  6880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6869f07b5a4885a0b99fbe60c3b175" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 10 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
W20260709 13:19:43.291299  7524 debug-util.cc:398] Leaking SignalData structure 0x7b08002adbe0 after lost signal to thread 6831
I20260709 13:19:43.313512  6880 raft_consensus.cc:2410] T bd6869f07b5a4885a0b99fbe60c3b175 P cd75a17ab2604397adab03bb8b5fd75c [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7ab4784c7344b939bc36f639286f377 for term 10 because replica has last-logged OpId of term: 7 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 2.
W20260709 13:19:43.313633  7524 debug-util.cc:398] Leaking SignalData structure 0x7b08003abb80 after lost signal to thread 6832
I20260709 13:19:43.273211  7494 raft_consensus.cc:1275] T 427c124d773f483294511e80fe340075 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 7 FOLLOWER]: Refusing update from remote peer b7ab4784c7344b939bc36f639286f377: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
W20260709 13:19:43.317834  7524 debug-util.cc:398] Leaking SignalData structure 0x7b0800391f20 after lost signal to thread 6905
W20260709 13:19:43.327971  7524 debug-util.cc:398] Leaking SignalData structure 0x7b08003b7f40 after lost signal to thread 7527
I20260709 13:19:43.228711 10045 consensus_queue.cc:260] T f09c2a98de1a4decabd0ff900dd44caa P ccd8a4c3bfe3413cb2ae219b09aea832 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:43.262063  9999 consensus_queue.cc:237] T dbdf895bba214ff68685a24fd17dfb5d P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:43.346128 10034 consensus_queue.cc:237] T 7887766dc6784fcaa42b35c05fea7a99 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 8.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:43.350270 10098 raft_consensus.cc:2749] T 22ccee1b570c4ad3a57bd7aec085b1b4 P cd75a17ab2604397adab03bb8b5fd75c [term 8 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:19:43.350952 10093 raft_consensus.cc:3055] T 853ac0a8cbd64ce99457f170216d4d0f P cd75a17ab2604397adab03bb8b5fd75c [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:19:43.351454 10093 raft_consensus.cc:740] T 853ac0a8cbd64ce99457f170216d4d0f P cd75a17ab2604397adab03bb8b5fd75c [term 5 LEADER]: Becoming Follower/Learner. State: Replica: cd75a17ab2604397adab03bb8b5fd75c, State: Running, Role: LEADER
I20260709 13:19:43.352454 10093 consensus_queue.cc:260] T 853ac0a8cbd64ce99457f170216d4d0f P cd75a17ab2604397adab03bb8b5fd75c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:43.353796 10093 raft_consensus.cc:3060] T 853ac0a8cbd64ce99457f170216d4d0f P cd75a17ab2604397adab03bb8b5fd75c [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:19:43.356318 10079 log.cc:927] Time spent T ab432e62819d499eaaf3dd55481dd930 P b7ab4784c7344b939bc36f639286f377: Append to log took a long time: real 0.100s	user 0.000s	sys 0.001s
I20260709 13:19:43.319896 10091 raft_consensus.cc:515] T 1bf4668eeb70467fb3dc5a0289233b3c P cd75a17ab2604397adab03bb8b5fd75c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:43.358924 10091 leader_election.cc:290] T 1bf4668eeb70467fb3dc5a0289233b3c P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:19:43.345324 10045 raft_consensus.cc:3060] T f09c2a98de1a4decabd0ff900dd44caa P ccd8a4c3bfe3413cb2ae219b09aea832 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:43.360720 10053 leader_election.cc:290] T a3022224cc81473690653a83d4e99470 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:43.360823 10059 leader_election.cc:290] T 4d9def8b32fd443aa94ab1420b06837b P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 9 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:43.127467  6727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b8cacb381b746da8d0049b0a83b41dd" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:19:43.163921  6726 raft_consensus.cc:2468] T 711ef6523deb4cbe8ef2ba61e1c21c98 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 10.
I20260709 13:19:43.154033  6730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b56bf91d90824c959e21e0cee5ba1816" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:19:43.164983  6723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90d42e216d9741e190bca19a781291fd" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:19:43.408517  6727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a92dd554674067a83a9cb68c4773f2" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:19:43.162907  6732 raft_consensus.cc:2889] T a3022224cc81473690653a83d4e99470 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:19:43.409747  6730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe20b4b48823486ca3b9c648db6ce8aa" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
W20260709 13:19:43.425765  6847 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:43.425837  6846 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:43.427183  6846 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:43.447763  6875 raft_consensus.cc:1240] T fe20b4b48823486ca3b9c648db6ce8aa P cd75a17ab2604397adab03bb8b5fd75c [term 7 FOLLOWER]: Rejecting Update request from peer ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 6. Current term is 7. Ops: []
I20260709 13:19:43.449829  6880 raft_consensus.cc:1275] T bd6869f07b5a4885a0b99fbe60c3b175 P cd75a17ab2604397adab03bb8b5fd75c [term 9 FOLLOWER]: Refusing update from remote peer ccd8a4c3bfe3413cb2ae219b09aea832: Log matching property violated. Preceding OpId in replica: term: 7 index: 3. Preceding OpId from leader: term: 9 index: 4. (index mismatch)
I20260709 13:19:43.482851  9450 raft_consensus.cc:493] T b56bf91d90824c959e21e0cee5ba1816 P b7ab4784c7344b939bc36f639286f377 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:19:43.484163  9450 raft_consensus.cc:515] T b56bf91d90824c959e21e0cee5ba1816 P b7ab4784c7344b939bc36f639286f377 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:43.506505  9849 raft_consensus.cc:3060] T b3f13b31a1f84f0d89d007eadd57924c P b7ab4784c7344b939bc36f639286f377 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:43.534284 10000 leader_election.cc:290] T fe20b4b48823486ca3b9c648db6ce8aa P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 7 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:19:43.584941 10063 raft_consensus.cc:3055] T ce4f062dcd314d43a63ca74067cb5ee3 P b7ab4784c7344b939bc36f639286f377 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:19:43.585626 10063 raft_consensus.cc:740] T ce4f062dcd314d43a63ca74067cb5ee3 P b7ab4784c7344b939bc36f639286f377 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
I20260709 13:19:43.605645  7494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe20b4b48823486ca3b9c648db6ce8aa" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb"
W20260709 13:19:43.621713  6845 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:43.598582 10063 consensus_queue.cc:260] T ce4f062dcd314d43a63ca74067cb5ee3 P b7ab4784c7344b939bc36f639286f377 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } attrs { replace: true } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
W20260709 13:19:43.670367  7466 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.918s	user 0.010s	sys 0.006s
W20260709 13:19:43.671150  7466 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.919s	user 0.010s	sys 0.006s
W20260709 13:19:43.671667  7466 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 929011us
W20260709 13:19:43.672724  6873 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.652s	user 0.012s	sys 0.015s
W20260709 13:19:43.673575  6873 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.653s	user 0.012s	sys 0.015s
I20260709 13:19:43.675786  6873 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53416 (request call id 2568) took 1357 ms. Trace:
I20260709 13:19:43.690209 10063 raft_consensus.cc:3060] T ce4f062dcd314d43a63ca74067cb5ee3 P b7ab4784c7344b939bc36f639286f377 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:43.693405  7466 leader_election.cc:304] T b3f13b31a1f84f0d89d007eadd57924c P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, b7ab4784c7344b939bc36f639286f377; no voters: 
W20260709 13:19:43.703642  6877 consensus_meta.cc:287] T e77e330a82df4b43a745d57a68f6f057 P cd75a17ab2604397adab03bb8b5fd75c: Time spent flushing consensus metadata: real 0.589s	user 0.011s	sys 0.010s
I20260709 13:19:43.682557  7494 raft_consensus.cc:3060] T fe20b4b48823486ca3b9c648db6ce8aa P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:19:43.721344  6845 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:43.729995  6874 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.502s	user 0.003s	sys 0.033s
W20260709 13:19:43.730576  6772 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.68:45071, user_credentials={real_user=slave}} blocked reactor thread for 472574us
I20260709 13:19:43.731559  9947 leader_election.cc:290] T 711ef6523deb4cbe8ef2ba61e1c21c98 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:19:43.738703  9890 leader_election.cc:290] T 3411566abe2d4c9bb4b2adfdd05e6f17 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:43.740067  6727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e326172347f45e99a0d482b5d8ef768" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:19:43.742077  6723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3f13b31a1f84f0d89d007eadd57924c" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:19:43.753584  9864 raft_consensus.cc:493] T 20f6842e26174571996b8dea4151d4be P b7ab4784c7344b939bc36f639286f377 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:43.754443  9864 raft_consensus.cc:515] T 20f6842e26174571996b8dea4151d4be P b7ab4784c7344b939bc36f639286f377 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
W20260709 13:19:43.756278  6698 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:43.759068  9864 leader_election.cc:290] T 20f6842e26174571996b8dea4151d4be P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:43.757483  6799 raft_consensus.cc:1240] T 1bf4668eeb70467fb3dc5a0289233b3c P b7ab4784c7344b939bc36f639286f377 [term 8 FOLLOWER]: Rejecting Update request from peer ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 7. Current term is 8. Ops: []
W20260709 13:19:43.761092  6696 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:43.728171  6732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c240553ce044eedb41541d72b9475d7" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
W20260709 13:19:43.764698  6696 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:43.759917  9809 leader_election.cc:290] T f3f9c2e2bf644115957398fe4c9459db P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:19:43.763788  9864 raft_consensus.cc:493] T 853ac0a8cbd64ce99457f170216d4d0f P b7ab4784c7344b939bc36f639286f377 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:43.768004  9864 raft_consensus.cc:515] T 853ac0a8cbd64ce99457f170216d4d0f P b7ab4784c7344b939bc36f639286f377 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:43.771126  9864 leader_election.cc:290] T 853ac0a8cbd64ce99457f170216d4d0f P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
W20260709 13:19:43.730629  6874 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.515s	user 0.003s	sys 0.033s
I20260709 13:19:43.775501  6874 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53416 (request call id 2567) took 1457 ms. Trace:
I20260709 13:19:43.775930  6874 rpcz_store.cc:276] 0709 13:19:42.318563 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:42.560448 (+241885us) service_pool.cc:224] Handling call
0709 13:19:42.685707 (+125259us) spinlock_profiling.cc:243] Waited 13.3 ms on lock 0x7b5800147c98. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0c745db1 00007fcc0c885b71 00007fcc0c885a22 00007fcc1579ec09 00007fcc148f8ee0 00007fcc149c20ab 00007fcc149c2131 00007fcc14983fc0 00007fcc1496e929 00007fcc1496e3d2 00007fcc0dee5bd4
0709 13:19:42.686035 (+   328us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:42.686273 (+   238us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:19:43.191472 (+505199us) log.cc:844] Serialized 14 byte log entry
0709 13:19:43.774929 (+583457us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:43.775039 (+   110us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:19:43.775162 (+   123us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:43.775259 (+    97us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:43.775440 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":86392,"prepare.queue_time_us":478322,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":38,"spinlock_wait_cycles":30566784,"thread_start_us":886761,"threads_started":2}
I20260709 13:19:43.781881  6874 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53406 (request call id 1743) took 1051 ms. Trace:
I20260709 13:19:43.782905  6874 rpcz_store.cc:276] 0709 13:19:42.730182 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:43.778963 (+1048781us) service_pool.cc:224] Handling call
0709 13:19:43.779966 (+  1003us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:43.781094 (+  1128us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:43.781166 (+    72us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:43.781260 (+    94us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:19:43.781372 (+   112us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:43.781464 (+    92us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:43.781734 (+   270us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:43.773993  6799 raft_consensus.cc:1275] T 853ac0a8cbd64ce99457f170216d4d0f P b7ab4784c7344b939bc36f639286f377 [term 6 FOLLOWER]: Refusing update from remote peer ccd8a4c3bfe3413cb2ae219b09aea832: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
W20260709 13:19:43.785660  6772 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.68:45071, user_credentials={real_user=slave}} blocked reactor thread for 53654.7us
W20260709 13:19:43.786921  6697 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.603s	user 0.006s	sys 0.016s
W20260709 13:19:43.790035  6697 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.668s	user 0.006s	sys 0.017s
I20260709 13:19:43.792870 10115 raft_consensus.cc:2804] T b3f13b31a1f84f0d89d007eadd57924c P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:19:43.793572 10115 raft_consensus.cc:493] T b3f13b31a1f84f0d89d007eadd57924c P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:43.793764 10001 leader_election.cc:290] T 713b5728a197487c9300b310ab94e5a3 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:19:43.794090 10115 raft_consensus.cc:3060] T b3f13b31a1f84f0d89d007eadd57924c P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:43.795188  6880 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53416 (request call id 2575) took 1077 ms. Trace:
I20260709 13:19:43.796101  6726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77e330a82df4b43a745d57a68f6f057" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 11 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:19:43.796566  6730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a75bfe094d4bdc963aba3f08dfcd25" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 10 candidate_status { last_received { term: 7 index: 2 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:19:43.797614  6730 raft_consensus.cc:2393] T 95a75bfe094d4bdc963aba3f08dfcd25 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c in current term 10: Already voted for candidate b7ab4784c7344b939bc36f639286f377 in this term.
W20260709 13:19:43.798770  6805 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.543s	user 0.003s	sys 0.018s
I20260709 13:19:43.800010  6805 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:32976 (request call id 2451) took 1038 ms. Trace:
I20260709 13:19:43.795609  6880 rpcz_store.cc:276] 0709 13:19:42.717319 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:43.451400 (+734081us) service_pool.cc:224] Handling call
0709 13:19:43.714928 (+263528us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:43.794724 (+ 79796us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:43.794754 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:43.794802 (+    48us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:19:43.794894 (+    92us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:43.794961 (+    67us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:43.795098 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:43.800428  6805 rpcz_store.cc:276] 0709 13:19:42.761588 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:42.761720 (+   132us) service_pool.cc:224] Handling call
0709 13:19:43.096518 (+334798us) spinlock_profiling.cc:243] Waited 10.9 ms on lock 0x7b5800003098. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0c745db1 00007fcc0c885b71 00007fcc0c885a22 00007fcc1579ec09 00007fcc148f8ee0 00007fcc149c20ab 00007fcc149c2131 00007fcc14983fc0 00007fcc1496e929 00007fcc1496e3d2 00007fcc0dee5bd4
0709 13:19:43.096722 (+   204us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:43.096957 (+   235us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:19:43.255739 (+158782us) log.cc:844] Serialized 14 byte log entry
0709 13:19:43.799420 (+543681us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:43.799514 (+    94us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:19:43.799654 (+   140us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:43.799781 (+   127us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:43.799947 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":179354,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":36,"spinlock_wait_cycles":25137408,"thread_start_us":701557,"threads_started":2,"wal-append.queue_time_us":469627}
I20260709 13:19:43.802956  6880 raft_consensus.cc:1275] T 713b5728a197487c9300b310ab94e5a3 P cd75a17ab2604397adab03bb8b5fd75c [term 9 FOLLOWER]: Refusing update from remote peer b7ab4784c7344b939bc36f639286f377: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:19:43.803081  6805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce4f062dcd314d43a63ca74067cb5ee3" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
W20260709 13:19:43.806378  6847 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:43.803781  6880 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53406 (request call id 1754) took 1059 ms. Trace:
I20260709 13:19:43.808357  6880 rpcz_store.cc:276] 0709 13:19:42.771667 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:43.801704 (+1030037us) service_pool.cc:224] Handling call
0709 13:19:43.802237 (+   533us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:43.803486 (+  1249us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:43.803714 (+   228us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:43.810420  6880 raft_consensus.cc:1275] T 90d42e216d9741e190bca19a781291fd P cd75a17ab2604397adab03bb8b5fd75c [term 9 FOLLOWER]: Refusing update from remote peer ccd8a4c3bfe3413cb2ae219b09aea832: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:19:43.811156  6880 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53416 (request call id 2580) took 1037 ms. Trace:
W20260709 13:19:43.812592  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 549617us
I20260709 13:19:43.814496  6844 leader_election.cc:400] T 44bde925b2e541b69890d70715b85176 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 8 election: Vote denied by peer b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817) with higher term. Message: Invalid argument: T 44bde925b2e541b69890d70715b85176 P b7ab4784c7344b939bc36f639286f377 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c for earlier term 8. Current term is 9.
W20260709 13:19:43.815028  9933 consensus_meta.cc:287] T 1bf4668eeb70467fb3dc5a0289233b3c P ccd8a4c3bfe3413cb2ae219b09aea832: Time spent flushing consensus metadata: real 1.143s	user 0.012s	sys 0.012s
I20260709 13:19:43.820457  9450 leader_election.cc:290] T b56bf91d90824c959e21e0cee5ba1816 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:43.723440  6877 raft_consensus.cc:2468] T e77e330a82df4b43a745d57a68f6f057 P cd75a17ab2604397adab03bb8b5fd75c [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 11.
W20260709 13:19:43.825078  6697 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 704005us
I20260709 13:19:43.826627  6877 raft_consensus.cc:1275] T 20f6842e26174571996b8dea4151d4be P cd75a17ab2604397adab03bb8b5fd75c [term 9 FOLLOWER]: Refusing update from remote peer ccd8a4c3bfe3413cb2ae219b09aea832: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:19:43.827337  6877 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53416 (request call id 2581) took 1047 ms. Trace:
I20260709 13:19:43.827127 10104 consensus_queue.cc:1048] T 7c37d41cd9164c15a6826ca62a851a69 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
W20260709 13:19:43.828646  6803 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.570s	user 0.010s	sys 0.007s
W20260709 13:19:43.829255  6803 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.684s	user 0.010s	sys 0.007s
I20260709 13:19:43.830530  6803 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:32976 (request call id 2457) took 1064 ms. Trace:
I20260709 13:19:43.831061  6697 leader_election.cc:304] T bb3d8792045a4583ae2e965b1350a5b4 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:19:43.832248 10001 raft_consensus.cc:493] T 34f36d59d88f40fe8a2805e604fc6c0a P cd75a17ab2604397adab03bb8b5fd75c [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:43.834017 10001 raft_consensus.cc:515] T 34f36d59d88f40fe8a2805e604fc6c0a P cd75a17ab2604397adab03bb8b5fd75c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:43.832419  6874 raft_consensus.cc:3060] T f3f9c2e2bf644115957398fe4c9459db P cd75a17ab2604397adab03bb8b5fd75c [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:43.832568  6726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b3759de40694069b13c0f8bd40e5709" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:19:43.811518  6880 rpcz_store.cc:276] 0709 13:19:42.773412 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:43.809296 (+1035884us) service_pool.cc:224] Handling call
0709 13:19:43.809851 (+   555us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:43.810818 (+   967us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:43.811076 (+   258us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:19:43.838177 10030 consensus_meta.cc:287] T 9e326172347f45e99a0d482b5d8ef768 P ccd8a4c3bfe3413cb2ae219b09aea832: Time spent flushing consensus metadata: real 1.164s	user 0.003s	sys 0.011s
I20260709 13:19:43.838740 10030 raft_consensus.cc:515] T 9e326172347f45e99a0d482b5d8ef768 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:43.774794  6806 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:32976 (request call id 2458) took 1008 ms. Trace:
I20260709 13:19:43.834036  6732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c7f33e544204fbaac4078e3e83bbf4e" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:19:43.839932  6727 raft_consensus.cc:2393] T 9e326172347f45e99a0d482b5d8ef768 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c in current term 8: Already voted for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in this term.
I20260709 13:19:43.841233  6880 raft_consensus.cc:1240] T f58dc08b12a2494bb9a1372837970ca2 P cd75a17ab2604397adab03bb8b5fd75c [term 11 FOLLOWER]: Rejecting Update request from peer b7ab4784c7344b939bc36f639286f377 for earlier term 10. Current term is 11. Ops: [10.5-10.5]
W20260709 13:19:43.847046  6846 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:43.841933 10030 leader_election.cc:290] T 9e326172347f45e99a0d482b5d8ef768 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 8 election: Requested vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:43.839728  6806 rpcz_store.cc:276] 0709 13:19:42.766247 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:42.770999 (+  4752us) service_pool.cc:224] Handling call
0709 13:19:42.771357 (+   358us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:19:43.029544 (+258187us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:43.029581 (+    37us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:19:43.030160 (+   579us) log.cc:844] Serialized 52 byte log entry
0709 13:19:43.252233 (+222073us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:19:43.420009 (+167776us) log.cc:844] Serialized 14 byte log entry
0709 13:19:43.772465 (+352456us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:43.773001 (+   536us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:43.773302 (+   301us) raft_consensus.cc:1685] finished
0709 13:19:43.773388 (+    86us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:43.774163 (+   775us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":226003,"prepare.queue_time_us":333523,"prepare.run_cpu_time_us":71,"prepare.run_wall_time_us":70,"raft.queue_time_us":377466,"raft.run_cpu_time_us":354,"raft.run_wall_time_us":357,"spinlock_wait_cycles":37773568,"thread_start_us":425743,"threads_started":2,"wal-append.queue_time_us":266283}
I20260709 13:19:43.851524  9875 raft_consensus.cc:3055] T 4275cf08e63345f993bce8664eada830 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:19:43.851616  6806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f58dc08b12a2494bb9a1372837970ca2" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:19:43.855758  6697 leader_election.cc:304] T 711ef6523deb4cbe8ef2ba61e1c21c98 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:19:43.855976 10030 raft_consensus.cc:2749] T bb3d8792045a4583ae2e965b1350a5b4 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:19:43.883860  9875 raft_consensus.cc:740] T 4275cf08e63345f993bce8664eada830 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
I20260709 13:19:43.857051  6732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c37d41cd9164c15a6826ca62a851a69" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:19:43.858871  6726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6869f07b5a4885a0b99fbe60c3b175" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 10 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:19:43.859561 10006 consensus_queue.cc:1048] T 427c124d773f483294511e80fe340075 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:19:43.860466  6723 raft_consensus.cc:1275] T 7a734b5ab7834e05a8c422208acc58b1 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 9 FOLLOWER]: Refusing update from remote peer b7ab4784c7344b939bc36f639286f377: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 9 index: 4. (index mismatch)
I20260709 13:19:43.861552  6800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c240553ce044eedb41541d72b9475d7" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:19:43.862166  6724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c240553ce044eedb41541d72b9475d7" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 11 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:19:43.862809  6770 leader_election.cc:304] T 3d65025eea89441290d85dd053810e31 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
W20260709 13:19:43.864199  6845 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:43.869591  6771 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:43.877969  6772 leader_election.cc:304] T 4275cf08e63345f993bce8664eada830 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:19:43.830986  6803 rpcz_store.cc:276] 0709 13:19:42.765893 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:42.766010 (+   117us) service_pool.cc:224] Handling call
0709 13:19:42.766454 (+   444us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:19:43.028635 (+262181us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:43.028664 (+    29us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:19:43.049289 (+ 20625us) log.cc:844] Serialized 52 byte log entry
0709 13:19:43.829908 (+780619us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:19:43.830025 (+   117us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:43.830168 (+   143us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:43.830235 (+    67us) raft_consensus.cc:1685] finished
0709 13:19:43.830249 (+    14us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:43.830442 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":261697,"raft.queue_time_us":262599,"raft.run_cpu_time_us":134,"raft.run_wall_time_us":22699,"thread_start_us":684586,"threads_started":1,"wal-append.queue_time_us":574529}
I20260709 13:19:43.880468  9836 raft_consensus.cc:493] T e31b9971c15848dea59d4d4130141d9e P b7ab4784c7344b939bc36f639286f377 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:43.882408  6807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8292e16e5654be6bc408560cf256aaa" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:19:43.875854  6801 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:32976 (request call id 2456) took 1110 ms. Trace:
I20260709 13:19:43.827752  6877 rpcz_store.cc:276] 0709 13:19:42.780495 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:43.825621 (+1045126us) service_pool.cc:224] Handling call
0709 13:19:43.826090 (+   469us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:43.827063 (+   973us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:43.827276 (+   213us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:43.676707  6873 rpcz_store.cc:276] 0709 13:19:42.318794 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:42.563548 (+244754us) service_pool.cc:224] Handling call
0709 13:19:42.683407 (+119859us) spinlock_profiling.cc:243] Waited 1.9 ms on lock 0x7b5800147c98. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0c745db1 00007fcc0c885b71 00007fcc0c885a22 00007fcc1579ec09 00007fcc148f8ee0 00007fcc149c20ab 00007fcc149c2131 00007fcc14983fc0 00007fcc1496e929 00007fcc1496e3d2 00007fcc0dee5bd4
0709 13:19:42.683643 (+   236us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:42.683888 (+   245us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:19:43.020069 (+336181us) log.cc:844] Serialized 14 byte log entry
0709 13:19:43.675047 (+654978us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:43.675179 (+   132us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:19:43.675317 (+   138us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:43.675470 (+   153us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:43.675672 (+   202us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":332640,"prepare.run_cpu_time_us":52,"prepare.run_wall_time_us":54,"raft.queue_time_us":156,"raft.run_cpu_time_us":268,"raft.run_wall_time_us":268,"spinlock_wait_cycles":4377856,"thread_start_us":952117,"threads_started":2,"wal-append.queue_time_us":652759}
I20260709 13:19:43.893666  6801 rpcz_store.cc:276] 0709 13:19:42.765539 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:42.765663 (+   124us) service_pool.cc:224] Handling call
0709 13:19:43.875283 (+1109620us) spinlock_profiling.cc:243] Waited 473 ms on lock 0x7b54002c79d4. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f9ae2fa 00007fcc1496fb17 00007fcc0deea6d4 00007fcc0deea662 00007fcc0deea591 00007fcc0deea50c 00007fcc0dee97c2 00007fcc0dce548c 00007fcc0dce48c6 00007fcc0dce426f
0709 13:19:43.875565 (+   282us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1087390592}
I20260709 13:19:43.905279  6806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44bde925b2e541b69890d70715b85176" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:19:43.841970 10001 leader_election.cc:290] T 34f36d59d88f40fe8a2805e604fc6c0a P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:19:43.883663  9849 raft_consensus.cc:2749] T b3f13b31a1f84f0d89d007eadd57924c P b7ab4784c7344b939bc36f639286f377 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:19:43.902850  9888 consensus_meta.cc:287] T f5be3a11b23d4ea9b08300a2789821c7 P ccd8a4c3bfe3413cb2ae219b09aea832: Time spent flushing consensus metadata: real 1.136s	user 0.010s	sys 0.010s
W20260709 13:19:43.913900  7466 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 220859us
I20260709 13:19:43.922041  6801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7887766dc6784fcaa42b35c05fea7a99" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:19:43.922083  6732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b56bf91d90824c959e21e0cee5ba1816" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:19:43.923189  6801 raft_consensus.cc:2468] T 7887766dc6784fcaa42b35c05fea7a99 P b7ab4784c7344b939bc36f639286f377 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 9.
I20260709 13:19:43.923763  6732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20f6842e26174571996b8dea4151d4be" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:19:43.892375  9836 raft_consensus.cc:515] T e31b9971c15848dea59d4d4130141d9e P b7ab4784c7344b939bc36f639286f377 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
W20260709 13:19:43.924597 10019 consensus_meta.cc:287] T 4f00a2e87e56452083b759f60d461ee3 P cd75a17ab2604397adab03bb8b5fd75c: Time spent flushing consensus metadata: real 1.242s	user 0.010s	sys 0.015s
I20260709 13:19:43.925112  6732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbdf895bba214ff68685a24fd17dfb5d" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:19:43.925817  6732 raft_consensus.cc:2468] T dbdf895bba214ff68685a24fd17dfb5d P ccd8a4c3bfe3413cb2ae219b09aea832 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 7.
I20260709 13:19:43.926252  9836 leader_election.cc:290] T e31b9971c15848dea59d4d4130141d9e P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:43.926750  6732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09c2a98de1a4decabd0ff900dd44caa" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:19:43.927045  6844 leader_election.cc:304] T d8292e16e5654be6bc408560cf256aaa P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:19:43.930013  6844 leader_election.cc:304] T 8c7f33e544204fbaac4078e3e83bbf4e P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
W20260709 13:19:43.931079  6847 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:43.944293  6846 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:43.931573 10019 raft_consensus.cc:2749] T d8292e16e5654be6bc408560cf256aaa P cd75a17ab2604397adab03bb8b5fd75c [term 10 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:19:43.931638 10053 raft_consensus.cc:493] T 7a734b5ab7834e05a8c422208acc58b1 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:43.924639  6801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8cee0accdb8499c86d4414b72565a38" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:19:43.933274  9933 raft_consensus.cc:493] T 713b5728a197487c9300b310ab94e5a3 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:43.889050  9875 consensus_queue.cc:260] T 4275cf08e63345f993bce8664eada830 P ccd8a4c3bfe3413cb2ae219b09aea832 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:43.956768  6807 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:32976 (request call id 2464) took 1089 ms. Trace:
I20260709 13:19:43.936028  6727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d9def8b32fd443aa94ab1420b06837b" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
W20260709 13:19:43.937404  7498 consensus_meta.cc:287] T 1528ab62b6fe4e3099d08f141afee116 P 7ba59cc884714e8aa5f3f0ecaed84cbb: Time spent flushing consensus metadata: real 0.697s	user 0.018s	sys 0.010s
I20260709 13:19:43.932052  6872 raft_consensus.cc:2410] T 4f00a2e87e56452083b759f60d461ee3 P cd75a17ab2604397adab03bb8b5fd75c [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate b7ab4784c7344b939bc36f639286f377 for term 9 because replica has last-logged OpId of term: 8 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 8.
I20260709 13:19:43.931088  9984 ts_tablet_manager.cc:1929] T 24ee15416e3145beaa1b8183453729a3 P b7ab4784c7344b939bc36f639286f377: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 6.6
I20260709 13:19:43.942159  6725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4db81d9d329422bb3b4160ca4ac2d1d" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:19:43.942394  7494 raft_consensus.cc:2468] T fe20b4b48823486ca3b9c648db6ce8aa P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 7.
I20260709 13:19:43.951457  6805 raft_consensus.cc:2468] T ce4f062dcd314d43a63ca74067cb5ee3 P b7ab4784c7344b939bc36f639286f377 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 8.
I20260709 13:19:43.953470  6874 raft_consensus.cc:1275] T f3f9c2e2bf644115957398fe4c9459db P cd75a17ab2604397adab03bb8b5fd75c [term 8 FOLLOWER]: Refusing update from remote peer ccd8a4c3bfe3413cb2ae219b09aea832: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:19:43.931140  6877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20f6842e26174571996b8dea4151d4be" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
W20260709 13:19:43.959316  6731 consensus_meta.cc:287] T e77e330a82df4b43a745d57a68f6f057 P ccd8a4c3bfe3413cb2ae219b09aea832: Time spent flushing consensus metadata: real 0.796s	user 0.009s	sys 0.018s
W20260709 13:19:43.934080 10022 consensus_meta.cc:287] T f4b8bd455d5a47c18a1380839c6e0d61 P cd75a17ab2604397adab03bb8b5fd75c: Time spent flushing consensus metadata: real 1.248s	user 0.017s	sys 0.007s
W20260709 13:19:43.960762  6697 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 105155us
I20260709 13:19:43.959957  6798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e326172347f45e99a0d482b5d8ef768" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:19:43.961145  6807 rpcz_store.cc:276] 0709 13:19:42.862567 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:43.029360 (+166793us) service_pool.cc:224] Handling call
0709 13:19:43.882050 (+852690us) spinlock_profiling.cc:243] Waited 9.66 ms on lock 0x7b5800003098. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0c745db1 00007fcc0c885b71 00007fcc0c885a22 00007fcc1579ec09 00007fcc148f8ee0 00007fcc149c20ab 00007fcc149c2131 00007fcc149700a0 00007fcc1496f984 00007fcc0deea6d4 00007fcc0deea662
0709 13:19:43.952303 (+ 70253us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":22207360}
I20260709 13:19:43.962700  6803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6869f07b5a4885a0b99fbe60c3b175" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 10 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:19:43.959964  7466 leader_election.cc:304] T 1528ab62b6fe4e3099d08f141afee116 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:19:43.911603 10030 raft_consensus.cc:2749] T 711ef6523deb4cbe8ef2ba61e1c21c98 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:19:43.965821  6770 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 103426us
I20260709 13:19:43.968614  6877 raft_consensus.cc:2468] T 20f6842e26174571996b8dea4151d4be P cd75a17ab2604397adab03bb8b5fd75c [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 9.
I20260709 13:19:43.960342  6804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de3186201e1a40d0b335eeb8b4e256e0" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:19:43.973994  6874 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53416 (request call id 2579) took 1229 ms. Trace:
I20260709 13:19:43.974692  6874 rpcz_store.cc:276] 0709 13:19:42.740535 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:43.785041 (+1044506us) service_pool.cc:224] Handling call
0709 13:19:43.794562 (+  9521us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:43.969171 (+174609us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:43.969477 (+   306us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:43.971642  6731 raft_consensus.cc:2468] T e77e330a82df4b43a745d57a68f6f057 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 11.
I20260709 13:19:43.978371  6801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b56bf91d90824c959e21e0cee5ba1816" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:19:43.978928  6731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "853ac0a8cbd64ce99457f170216d4d0f" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:19:43.979130  6801 raft_consensus.cc:2468] T b56bf91d90824c959e21e0cee5ba1816 P b7ab4784c7344b939bc36f639286f377 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 8.
I20260709 13:19:43.980223  6801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a92dd554674067a83a9cb68c4773f2" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:19:43.980928  6801 raft_consensus.cc:2468] T 07a92dd554674067a83a9cb68c4773f2 P b7ab4784c7344b939bc36f639286f377 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 8.
I20260709 13:19:43.981702  7466 leader_election.cc:304] T 17587d6730594da4a56fa13a353232a1 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:19:43.981884  6872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d9def8b32fd443aa94ab1420b06837b" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:19:43.982291  6878 raft_consensus.cc:3060] T f4b8bd455d5a47c18a1380839c6e0d61 P cd75a17ab2604397adab03bb8b5fd75c [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:43.983559  6872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4db81d9d329422bb3b4160ca4ac2d1d" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:19:43.984140  7498 raft_consensus.cc:2468] T 1528ab62b6fe4e3099d08f141afee116 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 8.
I20260709 13:19:43.984366  9875 raft_consensus.cc:3060] T 4275cf08e63345f993bce8664eada830 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:43.984910  7498 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50744 (request call id 268) took 1238 ms. Trace:
I20260709 13:19:43.985334  7498 rpcz_store.cc:276] 0709 13:19:42.746008 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:42.778942 (+ 32934us) service_pool.cc:224] Handling call
0709 13:19:43.984799 (+1205857us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:43.987299  6725 raft_consensus.cc:1240] T d8292e16e5654be6bc408560cf256aaa P ccd8a4c3bfe3413cb2ae219b09aea832 [term 11 FOLLOWER]: Rejecting Update request from peer b7ab4784c7344b939bc36f639286f377 for earlier term 10. Current term is 11. Ops: []
I20260709 13:19:43.988348  6803 raft_consensus.cc:2468] T bd6869f07b5a4885a0b99fbe60c3b175 P b7ab4784c7344b939bc36f639286f377 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 9.
I20260709 13:19:43.988933  9984 log.cc:1199] T 24ee15416e3145beaa1b8183453729a3 P b7ab4784c7344b939bc36f639286f377: Deleting WAL directory at /tmp/dist-test-taskWHb0CB/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783603057096655-5625-0/minicluster-data/ts-1-root/wals/24ee15416e3145beaa1b8183453729a3
I20260709 13:19:43.905867 10104 consensus_queue.cc:1048] T 44bde925b2e541b69890d70715b85176 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.084s
I20260709 13:19:43.989511 10030 consensus_queue.cc:1048] T 9b3759de40694069b13c0f8bd40e5709 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:19:43.992789  6804 raft_consensus.cc:2468] T de3186201e1a40d0b335eeb8b4e256e0 P b7ab4784c7344b939bc36f639286f377 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 9.
I20260709 13:19:43.978946  6727 raft_consensus.cc:2393] T 4d9def8b32fd443aa94ab1420b06837b P ccd8a4c3bfe3413cb2ae219b09aea832 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate b7ab4784c7344b939bc36f639286f377 in current term 9: Already voted for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in this term.
I20260709 13:19:43.989523  6803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a75bfe094d4bdc963aba3f08dfcd25" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 10 candidate_status { last_received { term: 7 index: 2 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:19:43.981912  6801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90d42e216d9741e190bca19a781291fd" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:19:43.997104  6807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f03d0dbf16864ca4bc1bb5e4c0334c0f" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:19:43.977008  6800 raft_consensus.cc:2468] T 2c240553ce044eedb41541d72b9475d7 P b7ab4784c7344b939bc36f639286f377 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 10.
W20260709 13:19:44.009855  6846 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:43.981932  6798 raft_consensus.cc:2468] T 9e326172347f45e99a0d482b5d8ef768 P b7ab4784c7344b939bc36f639286f377 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 7.
I20260709 13:19:44.011533  6770 leader_election.cc:304] T 711ef6523deb4cbe8ef2ba61e1c21c98 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
I20260709 13:19:43.963743  9888 raft_consensus.cc:2749] T f5be3a11b23d4ea9b08300a2789821c7 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:19:44.017117 10063 raft_consensus.cc:2804] T 3d65025eea89441290d85dd053810e31 P b7ab4784c7344b939bc36f639286f377 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:19:44.020982  6806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77e330a82df4b43a745d57a68f6f057" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 11 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:19:44.023159  6874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "853ac0a8cbd64ce99457f170216d4d0f" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:19:44.026015  9984 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41714 (request call id 0) took 5429 ms. Trace:
W20260709 13:19:44.027324  6773 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:44.027099  6846 leader_election.cc:304] T fe20b4b48823486ca3b9c648db6ce8aa P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:19:44.028218  6801 raft_consensus.cc:2410] T 90d42e216d9741e190bca19a781291fd P b7ab4784c7344b939bc36f639286f377 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c for term 10 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 4.
I20260709 13:19:44.026575  9984 rpcz_store.cc:276] 0709 13:19:38.603288 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:38.695701 (+ 92413us) service_pool.cc:224] Handling call
0709 13:19:38.945665 (+249964us) ts_tablet_manager.cc:1151] Deleting tablet 24ee15416e3145beaa1b8183453729a3
0709 13:19:38.945738 (+    73us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0709 13:19:42.588535 (+3642797us) tablet_metadata.cc:665] Metadata flushed
0709 13:19:43.930790 (+1342255us) tablet_metadata.cc:665] Metadata flushed
0709 13:19:44.018731 (+ 87941us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1886163,"tablet-delete.queue_time_us":53856,"thread_start_us":53364,"threads_started":1}
I20260709 13:19:44.013068  9999 raft_consensus.cc:2749] T 8c7f33e544204fbaac4078e3e83bbf4e P cd75a17ab2604397adab03bb8b5fd75c [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:19:44.029431 10021 raft_consensus.cc:493] T 22ccee1b570c4ad3a57bd7aec085b1b4 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:44.030175  9999 raft_consensus.cc:2804] T fe20b4b48823486ca3b9c648db6ce8aa P cd75a17ab2604397adab03bb8b5fd75c [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:19:44.030102 10021 raft_consensus.cc:515] T 22ccee1b570c4ad3a57bd7aec085b1b4 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:44.030722  9999 raft_consensus.cc:697] T fe20b4b48823486ca3b9c648db6ce8aa P cd75a17ab2604397adab03bb8b5fd75c [term 7 LEADER]: Becoming Leader. State: Replica: cd75a17ab2604397adab03bb8b5fd75c, State: Running, Role: LEADER
I20260709 13:19:44.032442  6727 raft_consensus.cc:1240] T f58dc08b12a2494bb9a1372837970ca2 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 11 FOLLOWER]: Rejecting Update request from peer b7ab4784c7344b939bc36f639286f377 for earlier term 10. Current term is 11. Ops: []
I20260709 13:19:44.033094  9586 raft_consensus.cc:2749] T 1528ab62b6fe4e3099d08f141afee116 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:19:44.023358 10063 raft_consensus.cc:493] T 3d65025eea89441290d85dd053810e31 P b7ab4784c7344b939bc36f639286f377 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:44.033907 10063 raft_consensus.cc:3060] T 3d65025eea89441290d85dd053810e31 P b7ab4784c7344b939bc36f639286f377 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:19:44.033937  6772 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 156230us
W20260709 13:19:44.036700  7468 leader_election.cc:336] T 24ee15416e3145beaa1b8183453729a3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931): Timed out: RequestConsensusVote RPC to 127.5.126.67:42931 timed out after 1.748s (SENT)
I20260709 13:19:44.037302  7468 leader_election.cc:304] T 24ee15416e3145beaa1b8183453729a3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
W20260709 13:19:44.043680 10114 log.cc:927] Time spent T 07a92dd554674067a83a9cb68c4773f2 P cd75a17ab2604397adab03bb8b5fd75c: Append to log took a long time: real 0.083s	user 0.001s	sys 0.000s
W20260709 13:19:44.032397  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 102593us
W20260709 13:19:44.044313 10083 log.cc:927] Time spent T 3a485a995abc4807b6e511e45419f737 P cd75a17ab2604397adab03bb8b5fd75c: Append to log took a long time: real 0.814s	user 0.000s	sys 0.015s
I20260709 13:19:44.049011  6875 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53416 (request call id 2563) took 1731 ms. Trace:
I20260709 13:19:44.024017 10055 raft_consensus.cc:493] T 7c44c4849aa54f2b94d1f1bef9ed546f P ccd8a4c3bfe3413cb2ae219b09aea832 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:44.013831  9947 raft_consensus.cc:493] T 24ee15416e3145beaa1b8183453729a3 P cd75a17ab2604397adab03bb8b5fd75c [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:44.051236  6770 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 44617us
W20260709 13:19:44.052287  6697 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 71087.3us
I20260709 13:19:44.049523  6875 rpcz_store.cc:276] 0709 13:19:42.317594 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:42.542674 (+225080us) service_pool.cc:224] Handling call
0709 13:19:42.708626 (+165952us) spinlock_profiling.cc:243] Waited 14 ms on lock 0x7b5800147c98. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0c745db1 00007fcc0c885b71 00007fcc0c885a22 00007fcc1579ec09 00007fcc148f8ee0 00007fcc149c20ab 00007fcc149c2131 00007fcc14983fc0 00007fcc1496e929 00007fcc1496e3d2 00007fcc0dee5bd4
0709 13:19:42.708840 (+   214us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:43.449160 (+740320us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:44.039863 (+590703us) spinlock_profiling.cc:243] Waited 738 ms on lock 0x7b54000a78d4. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f9aae01 00007fcc0f9a983e 00007fcc1496e419 00007fcc0dee5bd4 00007fcc0dee5b62 00007fcc0dee5a91 00007fcc0dee5a0c 00007fcc0dee4cc2 00007fcc0dce548c 00007fcc0dce48c6
0709 13:19:44.048906 (+  9043us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1729134080}
W20260709 13:19:44.044366  9898 consensus_meta.cc:287] T f09c2a98de1a4decabd0ff900dd44caa P cd75a17ab2604397adab03bb8b5fd75c: Time spent flushing consensus metadata: real 1.399s	user 0.010s	sys 0.025s
I20260709 13:19:44.054963 10113 raft_consensus.cc:2749] T 4275cf08e63345f993bce8664eada830 P b7ab4784c7344b939bc36f639286f377 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:19:44.033962 10020 raft_consensus.cc:2749] T 17587d6730594da4a56fa13a353232a1 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:19:44.057430  6878 raft_consensus.cc:1275] T f4b8bd455d5a47c18a1380839c6e0d61 P cd75a17ab2604397adab03bb8b5fd75c [term 8 FOLLOWER]: Refusing update from remote peer ccd8a4c3bfe3413cb2ae219b09aea832: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:19:44.055707  6872 raft_consensus.cc:1240] T ce4f062dcd314d43a63ca74067cb5ee3 P cd75a17ab2604397adab03bb8b5fd75c [term 8 FOLLOWER]: Rejecting Update request from peer b7ab4784c7344b939bc36f639286f377 for earlier term 7. Current term is 8. Ops: []
I20260709 13:19:43.976619 10053 raft_consensus.cc:515] T 7a734b5ab7834e05a8c422208acc58b1 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:44.017485  9933 raft_consensus.cc:515] T 713b5728a197487c9300b310ab94e5a3 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:44.068984  6803 raft_consensus.cc:1240] T d33d5ee8ef6f415593d8df52063161ad P b7ab4784c7344b939bc36f639286f377 [term 10 LEADER]: Rejecting Update request from peer cd75a17ab2604397adab03bb8b5fd75c for earlier term 9. Current term is 10. Ops: []
I20260709 13:19:44.075994  6806 raft_consensus.cc:2393] T e77e330a82df4b43a745d57a68f6f057 P b7ab4784c7344b939bc36f639286f377 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c in current term 11: Already voted for candidate b7ab4784c7344b939bc36f639286f377 in this term.
I20260709 13:19:44.082278  9933 leader_election.cc:290] T 713b5728a197487c9300b310ab94e5a3 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
W20260709 13:19:44.082942 10012 consensus_meta.cc:287] T 24ee15416e3145beaa1b8183453729a3 P ccd8a4c3bfe3413cb2ae219b09aea832: Time spent flushing consensus metadata: real 1.334s	user 0.012s	sys 0.012s
I20260709 13:19:44.083629 10014 raft_consensus.cc:493] T f4b8bd455d5a47c18a1380839c6e0d61 P cd75a17ab2604397adab03bb8b5fd75c [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:44.084270 10014 raft_consensus.cc:515] T f4b8bd455d5a47c18a1380839c6e0d61 P cd75a17ab2604397adab03bb8b5fd75c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:44.086369  6844 leader_election.cc:304] T bb7fa124c3bf4ef9ab65a407cb008441 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, b7ab4784c7344b939bc36f639286f377
I20260709 13:19:44.069907  9586 raft_consensus.cc:2749] T 24ee15416e3145beaa1b8183453729a3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:19:44.071552 10055 raft_consensus.cc:515] T 7c44c4849aa54f2b94d1f1bef9ed546f P ccd8a4c3bfe3413cb2ae219b09aea832 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:44.098521  9892 raft_consensus.cc:2749] T bb7fa124c3bf4ef9ab65a407cb008441 P cd75a17ab2604397adab03bb8b5fd75c [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:19:44.100922 10055 leader_election.cc:290] T 7c44c4849aa54f2b94d1f1bef9ed546f P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:44.073719 10113 consensus_queue.cc:1048] T a3022224cc81473690653a83d4e99470 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.028s
I20260709 13:19:44.077801  6798 raft_consensus.cc:1240] T f5be3a11b23d4ea9b08300a2789821c7 P b7ab4784c7344b939bc36f639286f377 [term 7 FOLLOWER]: Rejecting Update request from peer cd75a17ab2604397adab03bb8b5fd75c for earlier term 6. Current term is 7. Ops: []
I20260709 13:19:44.107714  6807 raft_consensus.cc:1240] T 9b3759de40694069b13c0f8bd40e5709 P b7ab4784c7344b939bc36f639286f377 [term 8 FOLLOWER]: Rejecting Update request from peer cd75a17ab2604397adab03bb8b5fd75c for earlier term 7. Current term is 8. Ops: []
I20260709 13:19:44.108870  6697 leader_election.cc:304] T f58dc08b12a2494bb9a1372837970ca2 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:19:44.098337 10063 raft_consensus.cc:515] T 3d65025eea89441290d85dd053810e31 P b7ab4784c7344b939bc36f639286f377 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:44.031868  9999 consensus_queue.cc:237] T fe20b4b48823486ca3b9c648db6ce8aa P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:19:44.115159 10004 consensus_queue.cc:1048] T f4b8bd455d5a47c18a1380839c6e0d61 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:19:44.116998  9450 consensus_queue.cc:1048] T 7a734b5ab7834e05a8c422208acc58b1 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:19:44.117623 10053 leader_election.cc:290] T 7a734b5ab7834e05a8c422208acc58b1 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:44.107928 10006 raft_consensus.cc:2804] T 711ef6523deb4cbe8ef2ba61e1c21c98 P b7ab4784c7344b939bc36f639286f377 [term 10 FOLLOWER]: Leader election won for term 10
W20260709 13:19:44.118113  6876 consensus_meta.cc:287] T 711ef6523deb4cbe8ef2ba61e1c21c98 P cd75a17ab2604397adab03bb8b5fd75c: Time spent flushing consensus metadata: real 0.718s	user 0.007s	sys 0.014s
I20260709 13:19:44.118583 10006 raft_consensus.cc:697] T 711ef6523deb4cbe8ef2ba61e1c21c98 P b7ab4784c7344b939bc36f639286f377 [term 10 LEADER]: Becoming Leader. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
I20260709 13:19:44.118705  6876 raft_consensus.cc:2468] T 711ef6523deb4cbe8ef2ba61e1c21c98 P cd75a17ab2604397adab03bb8b5fd75c [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 10.
I20260709 13:19:44.119850 10006 consensus_queue.cc:237] T 711ef6523deb4cbe8ef2ba61e1c21c98 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:44.121604 10063 leader_election.cc:290] T 3d65025eea89441290d85dd053810e31 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 8 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:44.122450  6801 raft_consensus.cc:1240] T 3d65025eea89441290d85dd053810e31 P b7ab4784c7344b939bc36f639286f377 [term 8 FOLLOWER]: Rejecting Update request from peer cd75a17ab2604397adab03bb8b5fd75c for earlier term 7. Current term is 8. Ops: []
W20260709 13:19:44.122565  6772 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 70190.6us
I20260709 13:19:44.105369  9947 raft_consensus.cc:515] T 24ee15416e3145beaa1b8183453729a3 P cd75a17ab2604397adab03bb8b5fd75c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:19:44.123858  6770 leader_election.cc:304] T dbdf895bba214ff68685a24fd17dfb5d P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
I20260709 13:19:44.126430  9947 leader_election.cc:290] T 24ee15416e3145beaa1b8183453729a3 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:19:44.130208  6806 raft_consensus.cc:1275] T 9b3759de40694069b13c0f8bd40e5709 P b7ab4784c7344b939bc36f639286f377 [term 8 FOLLOWER]: Refusing update from remote peer ccd8a4c3bfe3413cb2ae219b09aea832: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:19:44.113808 10021 leader_election.cc:290] T 22ccee1b570c4ad3a57bd7aec085b1b4 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
W20260709 13:19:44.131834  6845 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:44.115269  9657 consensus_meta.cc:287] T 17587d6730594da4a56fa13a353232a1 P ccd8a4c3bfe3413cb2ae219b09aea832: Time spent flushing consensus metadata: real 1.418s	user 0.034s	sys 0.002s
I20260709 13:19:44.135668  6877 raft_consensus.cc:1240] T 7887766dc6784fcaa42b35c05fea7a99 P cd75a17ab2604397adab03bb8b5fd75c [term 9 FOLLOWER]: Rejecting Update request from peer b7ab4784c7344b939bc36f639286f377 for earlier term 8. Current term is 9. Ops: []
I20260709 13:19:44.136376  6844 leader_election.cc:400] T 427c124d773f483294511e80fe340075 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 6 pre-election: Vote denied by peer b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817) with higher term. Message: Invalid argument: T 427c124d773f483294511e80fe340075 P b7ab4784c7344b939bc36f639286f377 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c for earlier term 6. Current term is 7.
I20260709 13:19:44.136848  6844 leader_election.cc:403] T 427c124d773f483294511e80fe340075 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 6 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:19:44.137725  6872 raft_consensus.cc:1275] T ab432e62819d499eaaf3dd55481dd930 P cd75a17ab2604397adab03bb8b5fd75c [term 10 FOLLOWER]: Refusing update from remote peer b7ab4784c7344b939bc36f639286f377: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 10 index: 5. (index mismatch)
W20260709 13:19:44.140483  6697 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 69769.7us
I20260709 13:19:44.141894 10109 raft_consensus.cc:2804] T dbdf895bba214ff68685a24fd17dfb5d P b7ab4784c7344b939bc36f639286f377 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:19:44.142395 10109 raft_consensus.cc:493] T dbdf895bba214ff68685a24fd17dfb5d P b7ab4784c7344b939bc36f639286f377 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:44.142802 10109 raft_consensus.cc:3060] T dbdf895bba214ff68685a24fd17dfb5d P b7ab4784c7344b939bc36f639286f377 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:44.144176  6881 raft_consensus.cc:1275] T f09c2a98de1a4decabd0ff900dd44caa P cd75a17ab2604397adab03bb8b5fd75c [term 9 FOLLOWER]: Refusing update from remote peer ccd8a4c3bfe3413cb2ae219b09aea832: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 5. (term mismatch)
I20260709 13:19:44.144583  6881 pending_rounds.cc:85] T f09c2a98de1a4decabd0ff900dd44caa P cd75a17ab2604397adab03bb8b5fd75c: Aborting all ops after (but not including) 4
I20260709 13:19:44.144541  7495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24ee15416e3145beaa1b8183453729a3" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:19:44.144968  6881 pending_rounds.cc:107] T f09c2a98de1a4decabd0ff900dd44caa P cd75a17ab2604397adab03bb8b5fd75c: Aborting uncommitted NO_OP operation due to leader change: 8.5
I20260709 13:19:44.145282  6881 raft_consensus.cc:2889] T f09c2a98de1a4decabd0ff900dd44caa P cd75a17ab2604397adab03bb8b5fd75c [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:19:44.145556  7495 raft_consensus.cc:2393] T 24ee15416e3145beaa1b8183453729a3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c in current term 9: Already voted for candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in this term.
W20260709 13:19:44.148136 10093 consensus_meta.cc:287] T 853ac0a8cbd64ce99457f170216d4d0f P cd75a17ab2604397adab03bb8b5fd75c: Time spent flushing consensus metadata: real 0.794s	user 0.012s	sys 0.007s
I20260709 13:19:44.147807  9657 raft_consensus.cc:515] T 17587d6730594da4a56fa13a353232a1 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
W20260709 13:19:44.149820 10032 consensus_meta.cc:287] T 427c124d773f483294511e80fe340075 P ccd8a4c3bfe3413cb2ae219b09aea832: Time spent flushing consensus metadata: real 0.906s	user 0.013s	sys 0.010s
I20260709 13:19:44.150084  6725 raft_consensus.cc:1240] T 17587d6730594da4a56fa13a353232a1 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 12 FOLLOWER]: Rejecting Update request from peer b7ab4784c7344b939bc36f639286f377 for earlier term 11. Current term is 12. Ops: []
I20260709 13:19:44.150385 10032 raft_consensus.cc:515] T 427c124d773f483294511e80fe340075 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } attrs { replace: true } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
W20260709 13:19:44.151396 10031 consensus_meta.cc:287] T be1a92657f494cac8dd227d152f50151 P 7ba59cc884714e8aa5f3f0ecaed84cbb: Time spent flushing consensus metadata: real 1.488s	user 0.010s	sys 0.013s
I20260709 13:19:44.151559  6872 raft_consensus.cc:1275] T a3022224cc81473690653a83d4e99470 P cd75a17ab2604397adab03bb8b5fd75c [term 9 FOLLOWER]: Refusing update from remote peer b7ab4784c7344b939bc36f639286f377: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:19:44.152192  6877 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53406 (request call id 1763) took 1058 ms. Trace:
I20260709 13:19:44.152635  7494 raft_consensus.cc:1275] T 1528ab62b6fe4e3099d08f141afee116 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 8 FOLLOWER]: Refusing update from remote peer b7ab4784c7344b939bc36f639286f377: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:19:44.152599  6877 rpcz_store.cc:276] 0709 13:19:43.080492 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:44.019460 (+938968us) service_pool.cc:224] Handling call
0709 13:19:44.078233 (+ 58773us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:44.138552 (+ 60319us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:44.138681 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:44.150449  6876 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53406 (request call id 1761) took 1088 ms. Trace:
I20260709 13:19:44.160005  6874 raft_consensus.cc:2410] T 853ac0a8cbd64ce99457f170216d4d0f P cd75a17ab2604397adab03bb8b5fd75c [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7ab4784c7344b939bc36f639286f377 for term 7 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:19:44.155033  6876 rpcz_store.cc:276] 0709 13:19:43.061762 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:43.066541 (+  4779us) service_pool.cc:224] Handling call
0709 13:19:44.150189 (+1083648us) spinlock_profiling.cc:243] Waited 204 ms on lock 0x7b54001e96d4. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f9ae2fa 00007fcc1496fb17 00007fcc0deea6d4 00007fcc0deea662 00007fcc0deea591 00007fcc0deea50c 00007fcc0dee97c2 00007fcc0dce548c 00007fcc0dce48c6 00007fcc0dce426f
0709 13:19:44.150356 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":468113664}
W20260709 13:19:44.154405 10033 consensus_meta.cc:287] T a1704639a875409b9959353527b3fd68 P ccd8a4c3bfe3413cb2ae219b09aea832: Time spent flushing consensus metadata: real 0.912s	user 0.006s	sys 0.010s
I20260709 13:19:44.165515  6772 leader_election.cc:304] T d8cee0accdb8499c86d4414b72565a38 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
W20260709 13:19:44.177000  6772 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 44820.1us
I20260709 13:19:44.181473  9657 leader_election.cc:290] T 17587d6730594da4a56fa13a353232a1 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 12 election: Requested vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:19:44.182502  6695 leader_election.cc:304] T dbdf895bba214ff68685a24fd17dfb5d P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
W20260709 13:19:44.188604  6845 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:44.189018 10045 consensus_meta.cc:287] T f09c2a98de1a4decabd0ff900dd44caa P ccd8a4c3bfe3413cb2ae219b09aea832: Time spent flushing consensus metadata: real 0.828s	user 0.008s	sys 0.007s
I20260709 13:19:44.172627  6770 leader_election.cc:304] T e77e330a82df4b43a745d57a68f6f057 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
I20260709 13:19:44.190300  6732 raft_consensus.cc:2410] T f09c2a98de1a4decabd0ff900dd44caa P ccd8a4c3bfe3413cb2ae219b09aea832 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate b7ab4784c7344b939bc36f639286f377 for term 10 because replica has last-logged OpId of term: 9 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 4.
I20260709 13:19:44.165112 10021 raft_consensus.cc:2804] T f58dc08b12a2494bb9a1372837970ca2 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 11 FOLLOWER]: Leader election won for term 11
W20260709 13:19:44.192552  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 79131.1us
I20260709 13:19:44.190201 10115 raft_consensus.cc:515] T b3f13b31a1f84f0d89d007eadd57924c P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:19:44.201154 10033 raft_consensus.cc:515] T a1704639a875409b9959353527b3fd68 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:44.202800  6802 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:32976 (request call id 2461) took 1415 ms. Trace:
I20260709 13:19:44.202943 10115 leader_election.cc:290] T b3f13b31a1f84f0d89d007eadd57924c P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 7 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:19:44.203680 10093 raft_consensus.cc:2749] T 427c124d773f483294511e80fe340075 P cd75a17ab2604397adab03bb8b5fd75c [term 7 FOLLOWER]: Leader pre-election lost for term 6. Reason: Vote denied by peer b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817) with higher term. Message: Invalid argument: T 427c124d773f483294511e80fe340075 P b7ab4784c7344b939bc36f639286f377 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c for earlier term 6. Current term is 7.
I20260709 13:19:44.204216  6725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3f13b31a1f84f0d89d007eadd57924c" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:19:44.204418  6806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3f13b31a1f84f0d89d007eadd57924c" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:19:44.203333  6802 rpcz_store.cc:276] 0709 13:19:42.787201 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:43.032760 (+245559us) service_pool.cc:224] Handling call
0709 13:19:43.937659 (+904899us) spinlock_profiling.cc:243] Waited 11.9 ms on lock 0x7b5800003098. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0c745db1 00007fcc0c885b71 00007fcc0c885a22 00007fcc1579ec09 00007fcc148f8ee0 00007fcc149c20ab 00007fcc149c2131 00007fcc14983fc0 00007fcc1496e929 00007fcc1496e3d2 00007fcc0dee5bd4
0709 13:19:43.938012 (+   353us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:43.976686 (+ 38674us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:43.976743 (+    57us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:44.017453 (+ 40710us) log.cc:844] Serialized 26 byte log entry
0709 13:19:44.110849 (+ 93396us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:19:44.110904 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:44.110981 (+    77us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:44.202373 (+ 91392us) raft_consensus.cc:1685] finished
0709 13:19:44.202407 (+    34us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:44.202631 (+   224us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":31912,"raft.queue_time_us":59418,"raft.run_cpu_time_us":132,"raft.run_wall_time_us":4620,"spinlock_wait_cycles":27479936,"thread_start_us":80318,"threads_started":1,"wal-append.queue_time_us":144750}
I20260709 13:19:44.207036 10033 leader_election.cc:290] T a1704639a875409b9959353527b3fd68 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 9 election: Requested vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:44.205684  6729 raft_consensus.cc:1240] T a1704639a875409b9959353527b3fd68 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 9 FOLLOWER]: Rejecting Update request from peer b7ab4784c7344b939bc36f639286f377 for earlier term 8. Current term is 9. Ops: []
I20260709 13:19:44.208925 10014 leader_election.cc:290] T f4b8bd455d5a47c18a1380839c6e0d61 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:19:44.151895 10031 raft_consensus.cc:515] T be1a92657f494cac8dd227d152f50151 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:19:44.210256  6800 raft_consensus.cc:1240] T 4d9def8b32fd443aa94ab1420b06837b P b7ab4784c7344b939bc36f639286f377 [term 9 FOLLOWER]: Rejecting Update request from peer cd75a17ab2604397adab03bb8b5fd75c for earlier term 8. Current term is 9. Ops: []
I20260709 13:19:44.210997 10032 leader_election.cc:290] T 427c124d773f483294511e80fe340075 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 8 election: Requested vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:19:44.212446 10031 leader_election.cc:290] T be1a92657f494cac8dd227d152f50151 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 11 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:19:44.214133 10109 raft_consensus.cc:515] T dbdf895bba214ff68685a24fd17dfb5d P b7ab4784c7344b939bc36f639286f377 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:44.214886  6844 leader_election.cc:304] T 30e88460611e47b2ba16a46a30b5f416 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:19:44.217110  6629 catalog_manager.cc:5697] T bb3d8792045a4583ae2e965b1350a5b4 P 7ba59cc884714e8aa5f3f0ecaed84cbb reported cstate change: term changed from 4 to 7, leader changed from ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65) to cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67). New cstate: current_term: 7 leader_uuid: "cd75a17ab2604397adab03bb8b5fd75c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } } }
I20260709 13:19:44.218396  6725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be1a92657f494cac8dd227d152f50151" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:19:44.218904  6629 catalog_manager.cc:5697] T d8cee0accdb8499c86d4414b72565a38 P 7ba59cc884714e8aa5f3f0ecaed84cbb reported cstate change: term changed from 5 to 8, leader changed from b7ab4784c7344b939bc36f639286f377 (127.5.126.66) to 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68). New cstate: current_term: 8 leader_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:19:44.219686  6799 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:32976 (request call id 2466) took 1356 ms. Trace:
I20260709 13:19:44.219868  6772 leader_election.cc:304] T 9b3759de40694069b13c0f8bd40e5709 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:19:44.220218  6799 rpcz_store.cc:276] 0709 13:19:42.863220 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:43.765324 (+902104us) service_pool.cc:224] Handling call
0709 13:19:43.766404 (+  1080us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:43.786334 (+ 19930us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:44.219343 (+433009us) spinlock_profiling.cc:243] Waited 7.13 ms on lock 0x7b54001b53d4. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f9aae01 00007fcc0f9a983e 00007fcc1496e419 00007fcc0dee5bd4 00007fcc0dee5b62 00007fcc0dee5a91 00007fcc0dee5a0c 00007fcc0dee4cc2 00007fcc0dce548c 00007fcc0dce48c6
0709 13:19:44.219575 (+   232us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":16396160}
I20260709 13:19:44.221382  6878 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53416 (request call id 2569) took 1506 ms. Trace:
I20260709 13:19:44.221772  6878 rpcz_store.cc:276] 0709 13:19:42.714834 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:42.715576 (+   742us) service_pool.cc:224] Handling call
0709 13:19:42.745262 (+ 29686us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:44.057853 (+1312591us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:44.221112 (+163259us) spinlock_profiling.cc:243] Waited 1.24 s on lock 0x7b54002184d4. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f9aae01 00007fcc0f9a983e 00007fcc1496e419 00007fcc0dee5bd4 00007fcc0dee5b62 00007fcc0dee5a91 00007fcc0dee5a0c 00007fcc0dee4cc2 00007fcc0dce548c 00007fcc0dce48c6
0709 13:19:44.221321 (+   209us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2844041600}
I20260709 13:19:44.222733  9849 raft_consensus.cc:2804] T 9b3759de40694069b13c0f8bd40e5709 P b7ab4784c7344b939bc36f639286f377 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:19:44.223203  9849 raft_consensus.cc:493] T 9b3759de40694069b13c0f8bd40e5709 P b7ab4784c7344b939bc36f639286f377 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:44.223676  9849 raft_consensus.cc:3060] T 9b3759de40694069b13c0f8bd40e5709 P b7ab4784c7344b939bc36f639286f377 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:44.224385 10109 leader_election.cc:290] T dbdf895bba214ff68685a24fd17dfb5d P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 8 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:44.226812 10107 raft_consensus.cc:2749] T 30e88460611e47b2ba16a46a30b5f416 P cd75a17ab2604397adab03bb8b5fd75c [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:19:44.228366  6806 raft_consensus.cc:3060] T b3f13b31a1f84f0d89d007eadd57924c P b7ab4784c7344b939bc36f639286f377 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:44.230870  6880 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53406 (request call id 1757) took 1188 ms. Trace:
I20260709 13:19:44.231325  6880 rpcz_store.cc:276] 0709 13:19:43.042112 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:43.849207 (+807095us) service_pool.cc:224] Handling call
0709 13:19:43.849849 (+   642us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:19:43.853330 (+  3481us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:43.853367 (+    37us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:19:43.855584 (+  2217us) log.cc:844] Serialized 52 byte log entry
0709 13:19:44.050024 (+194440us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:19:44.050088 (+    64us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:44.050197 (+   109us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:44.230572 (+180375us) raft_consensus.cc:1685] finished
0709 13:19:44.230603 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:44.230800 (+   197us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1285,"raft.run_cpu_time_us":168,"raft.run_wall_time_us":169,"thread_start_us":193033,"threads_started":1,"wal-append.queue_time_us":371718}
I20260709 13:19:44.238773  6799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be1a92657f494cac8dd227d152f50151" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:19:44.239686  6799 raft_consensus.cc:3060] T be1a92657f494cac8dd227d152f50151 P b7ab4784c7344b939bc36f639286f377 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:44.255394  6800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3022224cc81473690653a83d4e99470" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:19:44.258644  6800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3411566abe2d4c9bb4b2adfdd05e6f17" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
W20260709 13:19:44.260345  6846 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:44.260691  6802 raft_consensus.cc:1240] T 4275cf08e63345f993bce8664eada830 P b7ab4784c7344b939bc36f639286f377 [term 9 FOLLOWER]: Rejecting Update request from peer ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 8. Current term is 9. Ops: []
W20260709 13:19:44.262522  6770 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 123421us
I20260709 13:19:44.264359 10109 raft_consensus.cc:2804] T e77e330a82df4b43a745d57a68f6f057 P b7ab4784c7344b939bc36f639286f377 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:19:44.264767  9450 consensus_queue.cc:1059] T d8292e16e5654be6bc408560cf256aaa P b7ab4784c7344b939bc36f639286f377 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:19:44.265167 10109 raft_consensus.cc:697] T e77e330a82df4b43a745d57a68f6f057 P b7ab4784c7344b939bc36f639286f377 [term 11 LEADER]: Becoming Leader. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
I20260709 13:19:44.266180 10063 raft_consensus.cc:3055] T d8292e16e5654be6bc408560cf256aaa P b7ab4784c7344b939bc36f639286f377 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:19:44.266604 10063 raft_consensus.cc:740] T d8292e16e5654be6bc408560cf256aaa P b7ab4784c7344b939bc36f639286f377 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
I20260709 13:19:44.266700 10109 consensus_queue.cc:237] T e77e330a82df4b43a745d57a68f6f057 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.4, Last appended by leader: 4, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } }
I20260709 13:19:44.267668 10063 consensus_queue.cc:260] T d8292e16e5654be6bc408560cf256aaa P b7ab4784c7344b939bc36f639286f377 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:44.269161 10063 raft_consensus.cc:3060] T d8292e16e5654be6bc408560cf256aaa P b7ab4784c7344b939bc36f639286f377 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:44.278708 10092 raft_consensus.cc:3055] T bb3d8792045a4583ae2e965b1350a5b4 P cd75a17ab2604397adab03bb8b5fd75c [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:19:44.279402 10092 raft_consensus.cc:740] T bb3d8792045a4583ae2e965b1350a5b4 P cd75a17ab2604397adab03bb8b5fd75c [term 7 LEADER]: Becoming Follower/Learner. State: Replica: cd75a17ab2604397adab03bb8b5fd75c, State: Running, Role: LEADER
I20260709 13:19:44.288931  6804 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:32976 (request call id 2467) took 1425 ms. Trace:
I20260709 13:19:44.289834  6881 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53416 (request call id 2565) took 1971 ms. Trace:
W20260709 13:19:44.290836  7468 leader_election.cc:336] T 4f00a2e87e56452083b759f60d461ee3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931): Timed out: RequestConsensusVote RPC to 127.5.126.67:42931 timed out after 2.006s (SENT)
I20260709 13:19:44.290779  6881 rpcz_store.cc:276] 0709 13:19:42.318072 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:42.542191 (+224119us) service_pool.cc:224] Handling call
0709 13:19:42.542493 (+   302us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:44.145786 (+1603293us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:44.289512 (+143726us) spinlock_profiling.cc:243] Waited 1.51 s on lock 0x7b54001e78d4. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f9aae01 00007fcc0f9a983e 00007fcc1496e419 00007fcc0dee5bd4 00007fcc0dee5b62 00007fcc0dee5a91 00007fcc0dee5a0c 00007fcc0dee4cc2 00007fcc0dce548c 00007fcc0dce48c6
0709 13:19:44.289765 (+   253us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3481213696}
I20260709 13:19:44.293629  6729 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50004 (request call id 1662) took 1213 ms. Trace:
I20260709 13:19:44.294126 10104 consensus_queue.cc:1048] T 34f36d59d88f40fe8a2805e604fc6c0a P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
W20260709 13:19:44.295760  6695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 163391us
I20260709 13:19:44.296864 10104 raft_consensus.cc:2804] T dbdf895bba214ff68685a24fd17dfb5d P ccd8a4c3bfe3413cb2ae219b09aea832 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:19:44.297447 10104 raft_consensus.cc:493] T dbdf895bba214ff68685a24fd17dfb5d P ccd8a4c3bfe3413cb2ae219b09aea832 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:44.297907 10104 raft_consensus.cc:3060] T dbdf895bba214ff68685a24fd17dfb5d P ccd8a4c3bfe3413cb2ae219b09aea832 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:44.297725  6629 catalog_manager.cc:5697] T 7ba5dac66ab5497e9e336f2a3c28cda5 P 7ba59cc884714e8aa5f3f0ecaed84cbb reported cstate change: term changed from 5 to 10. New cstate: current_term: 10 leader_uuid: "b7ab4784c7344b939bc36f639286f377" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } } }
I20260709 13:19:44.298659  6695 leader_election.cc:304] T 3d65025eea89441290d85dd053810e31 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
I20260709 13:19:44.299877 10021 raft_consensus.cc:697] T f58dc08b12a2494bb9a1372837970ca2 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 11 LEADER]: Becoming Leader. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
I20260709 13:19:44.300303 10012 consensus_queue.cc:1048] T 2c240553ce044eedb41541d72b9475d7 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.000s
W20260709 13:19:44.300707  6697 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 134564us
I20260709 13:19:44.301002 10021 consensus_queue.cc:237] T f58dc08b12a2494bb9a1372837970ca2 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 10.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:44.301992 10012 raft_consensus.cc:2804] T 3d65025eea89441290d85dd053810e31 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:19:44.302104  6697 leader_election.cc:304] T d33d5ee8ef6f415593d8df52063161ad P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:19:44.308665 10092 consensus_queue.cc:260] T bb3d8792045a4583ae2e965b1350a5b4 P cd75a17ab2604397adab03bb8b5fd75c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:19:44.307479  9949 consensus_queue.cc:1059] T f58dc08b12a2494bb9a1372837970ca2 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: INVALID_TERM, Last received: 10.5, Next index: 6, Last known committed idx: 2, Time since last communication: 0.003s
W20260709 13:19:44.309857  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 95088.6us
I20260709 13:19:44.310546  9949 raft_consensus.cc:3055] T f58dc08b12a2494bb9a1372837970ca2 P b7ab4784c7344b939bc36f639286f377 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:19:44.311134  9949 raft_consensus.cc:740] T f58dc08b12a2494bb9a1372837970ca2 P b7ab4784c7344b939bc36f639286f377 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
I20260709 13:19:44.311314  6844 leader_election.cc:400] T 9b3759de40694069b13c0f8bd40e5709 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 7 pre-election: Vote denied by peer b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817) with higher term. Message: Invalid argument: T 9b3759de40694069b13c0f8bd40e5709 P b7ab4784c7344b939bc36f639286f377 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c for earlier term 7. Current term is 8.
I20260709 13:19:44.311775  6844 leader_election.cc:403] T 9b3759de40694069b13c0f8bd40e5709 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 7 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:19:44.312176  9949 consensus_queue.cc:260] T f58dc08b12a2494bb9a1372837970ca2 P b7ab4784c7344b939bc36f639286f377 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 5, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:44.313592 10092 raft_consensus.cc:3060] T bb3d8792045a4583ae2e965b1350a5b4 P cd75a17ab2604397adab03bb8b5fd75c [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:44.289695  6804 rpcz_store.cc:276] 0709 13:19:42.863509 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:43.994077 (+1130568us) service_pool.cc:224] Handling call
0709 13:19:44.018858 (+ 24781us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:19:44.026026 (+  7168us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:19:44.026497 (+   471us) log.cc:844] Serialized 14 byte log entry
0709 13:19:44.111127 (+ 84630us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:19:44.141072 (+ 29945us) log.cc:844] Serialized 52 byte log entry
0709 13:19:44.156009 (+ 14937us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:19:44.156120 (+   111us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:44.156214 (+    94us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:44.288563 (+132349us) raft_consensus.cc:1685] finished
0709 13:19:44.288602 (+    39us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:44.288853 (+   251us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2920,"prepare.queue_time_us":4927,"prepare.run_cpu_time_us":74,"prepare.run_wall_time_us":75,"raft.queue_time_us":7657,"raft.run_cpu_time_us":368,"raft.run_wall_time_us":15741,"thread_start_us":78316,"threads_started":1,"wal-append.queue_time_us":169912}
I20260709 13:19:44.317941  6802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e326172347f45e99a0d482b5d8ef768" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:19:44.344554  6802 raft_consensus.cc:3060] T 9e326172347f45e99a0d482b5d8ef768 P b7ab4784c7344b939bc36f639286f377 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:44.320791 10113 consensus_queue.cc:1059] T 17587d6730594da4a56fa13a353232a1 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:19:44.299664  6629 catalog_manager.cc:5697] T 3fa34c08b205435dba97346991aa1f92 P 7ba59cc884714e8aa5f3f0ecaed84cbb reported cstate change: term changed from 5 to 10. New cstate: current_term: 10 leader_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } } }
W20260709 13:19:44.355011  6696 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:44.222745  6772 leader_election.cc:304] T 1bf4668eeb70467fb3dc5a0289233b3c P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:19:44.279105  6728 raft_consensus.cc:2468] T f5be3a11b23d4ea9b08300a2789821c7 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 7.
I20260709 13:19:44.294198  6729 rpcz_store.cc:276] 0709 13:19:43.080443 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:43.080587 (+   144us) service_pool.cc:224] Handling call
0709 13:19:43.126879 (+ 46292us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:44.208432 (+1081553us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:44.293218 (+ 84786us) spinlock_profiling.cc:243] Waited 1.08 s on lock 0x7b54003b88d4. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f9aae01 00007fcc0f9a983e 00007fcc1496e419 00007fcc0dee5bd4 00007fcc0dee5b62 00007fcc0dee5a91 00007fcc0dee5a0c 00007fcc0dee4cc2 00007fcc0dce548c 00007fcc0dce48c6
0709 13:19:44.293519 (+   301us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2479997696}
I20260709 13:19:44.329406  6801 raft_consensus.cc:1275] T 8c7f33e544204fbaac4078e3e83bbf4e P b7ab4784c7344b939bc36f639286f377 [term 6 FOLLOWER]: Refusing update from remote peer ccd8a4c3bfe3413cb2ae219b09aea832: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:19:44.332157 10012 raft_consensus.cc:493] T 3d65025eea89441290d85dd053810e31 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:44.332906  6770 leader_election.cc:304] T f09c2a98de1a4decabd0ff900dd44caa P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
W20260709 13:19:44.338521  6698 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:44.341812  6799 raft_consensus.cc:2468] T be1a92657f494cac8dd227d152f50151 P b7ab4784c7344b939bc36f639286f377 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in term 11.
I20260709 13:19:44.343870  6806 raft_consensus.cc:2468] T b3f13b31a1f84f0d89d007eadd57924c P b7ab4784c7344b939bc36f639286f377 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in term 7.
W20260709 13:19:44.346714  7468 leader_election.cc:336] T bb7fa124c3bf4ef9ab65a407cb008441 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931): Timed out: RequestConsensusVote RPC to 127.5.126.67:42931 timed out after 1.828s (SENT)
I20260709 13:19:44.366986  7468 leader_election.cc:304] T bb7fa124c3bf4ef9ab65a407cb008441 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:19:44.368108  7466 leader_election.cc:304] T be1a92657f494cac8dd227d152f50151 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, b7ab4784c7344b939bc36f639286f377; no voters: ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:19:44.375869  6807 raft_consensus.cc:1240] T be1a92657f494cac8dd227d152f50151 P b7ab4784c7344b939bc36f639286f377 [term 11 FOLLOWER]: Rejecting Update request from peer ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 10. Current term is 11. Ops: []
W20260709 13:19:44.380927  6697 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 78999.8us
I20260709 13:19:44.375560  9888 raft_consensus.cc:2749] T d33d5ee8ef6f415593d8df52063161ad P ccd8a4c3bfe3413cb2ae219b09aea832 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:19:44.384234  6728 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50004 (request call id 1665) took 1300 ms. Trace:
W20260709 13:19:44.384384  6695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 79681.9us
I20260709 13:19:44.384721  6728 rpcz_store.cc:276] 0709 13:19:43.083870 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:43.084022 (+   152us) service_pool.cc:224] Handling call
0709 13:19:44.383964 (+1299942us) spinlock_profiling.cc:243] Waited 944 ms on lock 0x7b540020c1d4. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f9ae2fa 00007fcc1496fb17 00007fcc0deea6d4 00007fcc0deea662 00007fcc0deea591 00007fcc0deea50c 00007fcc0dee97c2 00007fcc0dce548c 00007fcc0dce48c6 00007fcc0dce426f
0709 13:19:44.384131 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2170493184}
I20260709 13:19:44.387209  9852 raft_consensus.cc:2804] T d8cee0accdb8499c86d4414b72565a38 P b7ab4784c7344b939bc36f639286f377 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 13:19:44.389513  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 78405.4us
I20260709 13:19:44.392289  9450 raft_consensus.cc:2804] T 1bf4668eeb70467fb3dc5a0289233b3c P b7ab4784c7344b939bc36f639286f377 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:19:44.393046  9450 raft_consensus.cc:493] T 1bf4668eeb70467fb3dc5a0289233b3c P b7ab4784c7344b939bc36f639286f377 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:44.393399  9450 raft_consensus.cc:3060] T 1bf4668eeb70467fb3dc5a0289233b3c P b7ab4784c7344b939bc36f639286f377 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:44.363907 10012 raft_consensus.cc:3060] T 3d65025eea89441290d85dd053810e31 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:19:44.395529  6770 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 62875.7us
I20260709 13:19:44.395661 10110 raft_consensus.cc:2749] T f09c2a98de1a4decabd0ff900dd44caa P b7ab4784c7344b939bc36f639286f377 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:19:44.382038  9949 raft_consensus.cc:3060] T f58dc08b12a2494bb9a1372837970ca2 P b7ab4784c7344b939bc36f639286f377 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:44.384763  9890 consensus_queue.cc:1048] T f3f9c2e2bf644115957398fe4c9459db P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.014s
I20260709 13:19:44.400177 10115 raft_consensus.cc:2749] T bb7fa124c3bf4ef9ab65a407cb008441 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:19:44.400578 10031 raft_consensus.cc:2804] T be1a92657f494cac8dd227d152f50151 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:19:44.401327 10031 raft_consensus.cc:697] T be1a92657f494cac8dd227d152f50151 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 11 LEADER]: Becoming Leader. State: Replica: 7ba59cc884714e8aa5f3f0ecaed84cbb, State: Running, Role: LEADER
W20260709 13:19:44.402300  6772 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 179594us
I20260709 13:19:44.403141 10033 raft_consensus.cc:493] T 1bf4668eeb70467fb3dc5a0289233b3c P ccd8a4c3bfe3413cb2ae219b09aea832 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:44.403606  6772 leader_election.cc:304] T 2c240553ce044eedb41541d72b9475d7 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
W20260709 13:19:44.407264  6847 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:44.400274  7468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 53656.7us
W20260709 13:19:44.410470  6845 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:44.413130  6847 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:44.360567 10014 raft_consensus.cc:2749] T 9b3759de40694069b13c0f8bd40e5709 P cd75a17ab2604397adab03bb8b5fd75c [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: Vote denied by peer b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817) with higher term. Message: Invalid argument: T 9b3759de40694069b13c0f8bd40e5709 P b7ab4784c7344b939bc36f639286f377 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c for earlier term 7. Current term is 8.
I20260709 13:19:44.405871 10053 raft_consensus.cc:493] T 30e88460611e47b2ba16a46a30b5f416 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:44.435046  6723 raft_consensus.cc:1275] T 7c44c4849aa54f2b94d1f1bef9ed546f P ccd8a4c3bfe3413cb2ae219b09aea832 [term 10 FOLLOWER]: Refusing update from remote peer b7ab4784c7344b939bc36f639286f377: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 13:19:44.439497  6805 raft_consensus.cc:1240] T b3f13b31a1f84f0d89d007eadd57924c P b7ab4784c7344b939bc36f639286f377 [term 7 FOLLOWER]: Rejecting Update request from peer ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 6. Current term is 7. Ops: []
I20260709 13:19:44.439502  7466 leader_election.cc:304] T b3f13b31a1f84f0d89d007eadd57924c P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, b7ab4784c7344b939bc36f639286f377; no voters: ccd8a4c3bfe3413cb2ae219b09aea832
W20260709 13:19:44.441707  6770 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:44.442587  6770 leader_election.cc:304] T f5be3a11b23d4ea9b08300a2789821c7 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:19:44.443445 10110 raft_consensus.cc:2804] T f5be3a11b23d4ea9b08300a2789821c7 P b7ab4784c7344b939bc36f639286f377 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:19:44.444314  9836 consensus_queue.cc:1059] T a1704639a875409b9959353527b3fd68 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:19:44.444887 10110 raft_consensus.cc:697] T f5be3a11b23d4ea9b08300a2789821c7 P b7ab4784c7344b939bc36f639286f377 [term 7 LEADER]: Becoming Leader. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
I20260709 13:19:44.445617  9836 raft_consensus.cc:3055] T a1704639a875409b9959353527b3fd68 P b7ab4784c7344b939bc36f639286f377 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:19:44.446182  9836 raft_consensus.cc:740] T a1704639a875409b9959353527b3fd68 P b7ab4784c7344b939bc36f639286f377 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
I20260709 13:19:44.446415 10110 consensus_queue.cc:237] T f5be3a11b23d4ea9b08300a2789821c7 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:44.449097  9785 raft_consensus.cc:3055] T 17587d6730594da4a56fa13a353232a1 P b7ab4784c7344b939bc36f639286f377 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:19:44.449178  6697 leader_election.cc:304] T e77e330a82df4b43a745d57a68f6f057 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377
I20260709 13:19:44.449874  9785 raft_consensus.cc:740] T 17587d6730594da4a56fa13a353232a1 P b7ab4784c7344b939bc36f639286f377 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
I20260709 13:19:44.451077  9785 consensus_queue.cc:260] T 17587d6730594da4a56fa13a353232a1 P b7ab4784c7344b939bc36f639286f377 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:19:44.452158  9890 raft_consensus.cc:2764] T e77e330a82df4b43a745d57a68f6f057 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 11 FOLLOWER]: Leader pre-election decision vote started in defunct term 10: won
I20260709 13:19:44.433828 10113 raft_consensus.cc:2749] T 2c240553ce044eedb41541d72b9475d7 P b7ab4784c7344b939bc36f639286f377 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:19:44.453394 10020 raft_consensus.cc:2804] T b3f13b31a1f84f0d89d007eadd57924c P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:19:44.454101 10020 raft_consensus.cc:697] T b3f13b31a1f84f0d89d007eadd57924c P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 7 LEADER]: Becoming Leader. State: Replica: 7ba59cc884714e8aa5f3f0ecaed84cbb, State: Running, Role: LEADER
I20260709 13:19:44.455065 10020 consensus_queue.cc:237] T b3f13b31a1f84f0d89d007eadd57924c P 7ba59cc884714e8aa5f3f0ecaed84cbb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:19:44.456511 10053 raft_consensus.cc:515] T 30e88460611e47b2ba16a46a30b5f416 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:44.458966 10053 leader_election.cc:290] T 30e88460611e47b2ba16a46a30b5f416 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:44.453364  9785 raft_consensus.cc:3060] T 17587d6730594da4a56fa13a353232a1 P b7ab4784c7344b939bc36f639286f377 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:44.465350  6729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e31b9971c15848dea59d4d4130141d9e" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:19:44.465909  6731 raft_consensus.cc:1275] T 22ccee1b570c4ad3a57bd7aec085b1b4 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 8 FOLLOWER]: Refusing update from remote peer b7ab4784c7344b939bc36f639286f377: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:19:44.466212  6729 raft_consensus.cc:2468] T e31b9971c15848dea59d4d4130141d9e P ccd8a4c3bfe3413cb2ae219b09aea832 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 6.
I20260709 13:19:44.466473  6732 raft_consensus.cc:1275] T d33d5ee8ef6f415593d8df52063161ad P ccd8a4c3bfe3413cb2ae219b09aea832 [term 10 FOLLOWER]: Refusing update from remote peer b7ab4784c7344b939bc36f639286f377: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
W20260709 13:19:44.467839  6771 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:44.456707 10012 raft_consensus.cc:515] T 3d65025eea89441290d85dd053810e31 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:44.469635  6725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d65025eea89441290d85dd053810e31" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:19:44.470228  6723 raft_consensus.cc:1275] T 1528ab62b6fe4e3099d08f141afee116 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 8 FOLLOWER]: Refusing update from remote peer b7ab4784c7344b939bc36f639286f377: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:19:44.472553  6732 raft_consensus.cc:1240] T 427c124d773f483294511e80fe340075 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 8 FOLLOWER]: Rejecting Update request from peer b7ab4784c7344b939bc36f639286f377 for earlier term 7. Current term is 8. Ops: [7.6-7.6]
I20260709 13:19:44.470259  6629 catalog_manager.cc:5697] T fe20b4b48823486ca3b9c648db6ce8aa P 7ba59cc884714e8aa5f3f0ecaed84cbb reported cstate change: term changed from 1 to 6. New cstate: current_term: 6 leader_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } } }
W20260709 13:19:44.474285  6846 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:44.402359 10031 consensus_queue.cc:237] T be1a92657f494cac8dd227d152f50151 P 7ba59cc884714e8aa5f3f0ecaed84cbb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:19:44.474470  6629 catalog_manager.cc:5697] T 404190ce4ce94cecbfcb6ea9d1dd8626 P 7ba59cc884714e8aa5f3f0ecaed84cbb reported cstate change: term changed from 4 to 9, leader changed from b7ab4784c7344b939bc36f639286f377 (127.5.126.66) to 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68). New cstate: current_term: 9 leader_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:19:44.477017  6725 raft_consensus.cc:2393] T 3d65025eea89441290d85dd053810e31 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate b7ab4784c7344b939bc36f639286f377 in current term 8: Already voted for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in this term.
I20260709 13:19:44.408764  9852 raft_consensus.cc:493] T d8cee0accdb8499c86d4414b72565a38 P b7ab4784c7344b939bc36f639286f377 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 7ba59cc884714e8aa5f3f0ecaed84cbb)
I20260709 13:19:44.479064  9852 raft_consensus.cc:3060] T d8cee0accdb8499c86d4414b72565a38 P b7ab4784c7344b939bc36f639286f377 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:44.480865 10012 leader_election.cc:290] T 3d65025eea89441290d85dd053810e31 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 8 election: Requested vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:44.403713 10033 raft_consensus.cc:515] T 1bf4668eeb70467fb3dc5a0289233b3c P ccd8a4c3bfe3413cb2ae219b09aea832 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:44.486301 10033 leader_election.cc:290] T 1bf4668eeb70467fb3dc5a0289233b3c P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:44.486949  6728 raft_consensus.cc:1275] T ab432e62819d499eaaf3dd55481dd930 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 10 FOLLOWER]: Refusing update from remote peer b7ab4784c7344b939bc36f639286f377: Log matching property violated. Preceding OpId in replica: term: 7 index: 3. Preceding OpId from leader: term: 10 index: 5. (index mismatch)
I20260709 13:19:44.496474  6732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbdf895bba214ff68685a24fd17dfb5d" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
W20260709 13:19:44.503616  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 111775us
I20260709 13:19:44.500633  6695 leader_election.cc:304] T 4d9def8b32fd443aa94ab1420b06837b P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
W20260709 13:19:44.503774  6773 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:44.504739  6802 raft_consensus.cc:2468] T 9e326172347f45e99a0d482b5d8ef768 P b7ab4784c7344b939bc36f639286f377 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 8.
I20260709 13:19:44.506702  6772 leader_election.cc:304] T 07a92dd554674067a83a9cb68c4773f2 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
W20260709 13:19:44.517494  6846 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:44.525945  6725 raft_consensus.cc:1240] T 17587d6730594da4a56fa13a353232a1 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 12 FOLLOWER]: Rejecting Update request from peer b7ab4784c7344b939bc36f639286f377 for earlier term 11. Current term is 12. Ops: [11.9-11.9]
W20260709 13:19:44.530130  6773 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:44.506160 10006 raft_consensus.cc:493] T f3f9c2e2bf644115957398fe4c9459db P b7ab4784c7344b939bc36f639286f377 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:44.545271  6844 leader_election.cc:304] T a3022224cc81473690653a83d4e99470 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:19:44.488221  9849 raft_consensus.cc:515] T 9b3759de40694069b13c0f8bd40e5709 P b7ab4784c7344b939bc36f639286f377 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:44.447502  9836 consensus_queue.cc:260] T a1704639a875409b9959353527b3fd68 P b7ab4784c7344b939bc36f639286f377 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:44.548080 10109 consensus_queue.cc:1048] T 7c44c4849aa54f2b94d1f1bef9ed546f P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.002s
W20260709 13:19:44.547895  6695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 114756us
I20260709 13:19:44.562004  6772 leader_election.cc:304] T f4b8bd455d5a47c18a1380839c6e0d61 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:19:44.541186 10113 raft_consensus.cc:2749] T 07a92dd554674067a83a9cb68c4773f2 P b7ab4784c7344b939bc36f639286f377 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:19:44.545032 10033 raft_consensus.cc:493] T f09c2a98de1a4decabd0ff900dd44caa P ccd8a4c3bfe3413cb2ae219b09aea832 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:44.555475 10021 raft_consensus.cc:2749] T 4d9def8b32fd443aa94ab1420b06837b P ccd8a4c3bfe3413cb2ae219b09aea832 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
W20260709 13:19:44.580448  6845 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:44.567662 10092 raft_consensus.cc:2749] T a3022224cc81473690653a83d4e99470 P cd75a17ab2604397adab03bb8b5fd75c [term 9 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:19:44.540165 10053 consensus_queue.cc:1048] T bd6869f07b5a4885a0b99fbe60c3b175 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.034s
W20260709 13:19:44.612567  6770 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 86793.3us
I20260709 13:19:44.554802 10006 raft_consensus.cc:515] T f3f9c2e2bf644115957398fe4c9459db P b7ab4784c7344b939bc36f639286f377 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
W20260709 13:19:44.623391  6772 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 70296us
I20260709 13:19:44.619532  6770 leader_election.cc:304] T e31b9971c15848dea59d4d4130141d9e P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
I20260709 13:19:44.577847 10033 raft_consensus.cc:515] T f09c2a98de1a4decabd0ff900dd44caa P ccd8a4c3bfe3413cb2ae219b09aea832 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:44.625360  9836 raft_consensus.cc:3060] T a1704639a875409b9959353527b3fd68 P b7ab4784c7344b939bc36f639286f377 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:44.620642 10063 raft_consensus.cc:2749] T f4b8bd455d5a47c18a1380839c6e0d61 P b7ab4784c7344b939bc36f639286f377 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:19:44.614173 10012 consensus_queue.cc:1048] T 9b3759de40694069b13c0f8bd40e5709 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.025s
W20260709 13:19:44.670048  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 128460us
I20260709 13:19:44.628141  9888 consensus_queue.cc:1048] T 853ac0a8cbd64ce99457f170216d4d0f P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.038s
I20260709 13:19:44.631534 10113 consensus_queue.cc:1048] T 22ccee1b570c4ad3a57bd7aec085b1b4 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.039s
I20260709 13:19:44.684378  6772 leader_election.cc:304] T f03d0dbf16864ca4bc1bb5e4c0334c0f P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
W20260709 13:19:44.691526  6770 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 54676.2us
I20260709 13:19:44.692987  6695 leader_election.cc:304] T 9e326172347f45e99a0d482b5d8ef768 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
I20260709 13:19:44.633159 10104 raft_consensus.cc:515] T dbdf895bba214ff68685a24fd17dfb5d P ccd8a4c3bfe3413cb2ae219b09aea832 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
W20260709 13:19:44.698493  6846 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:44.663631  9933 consensus_queue.cc:1048] T 20f6842e26174571996b8dea4151d4be P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.025s
I20260709 13:19:44.700212  6844 leader_election.cc:304] T 7ba5dac66ab5497e9e336f2a3c28cda5 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, b7ab4784c7344b939bc36f639286f377
I20260709 13:19:44.679031  9890 consensus_queue.cc:1048] T 8c7f33e544204fbaac4078e3e83bbf4e P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.010s
I20260709 13:19:44.662467 10021 consensus_queue.cc:1048] T 90d42e216d9741e190bca19a781291fd P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.027s
W20260709 13:19:44.724100  6845 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:44.730978  6772 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 65550.9us
W20260709 13:19:44.731186  6846 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:44.693274 10123 consensus_queue.cc:1059] T b3f13b31a1f84f0d89d007eadd57924c P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.096s
I20260709 13:19:44.683427 10111 raft_consensus.cc:2804] T e31b9971c15848dea59d4d4130141d9e P b7ab4784c7344b939bc36f639286f377 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:19:44.752617  7468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 251316us
I20260709 13:19:44.747107  6803 raft_consensus.cc:1275] T 20f6842e26174571996b8dea4151d4be P b7ab4784c7344b939bc36f639286f377 [term 9 FOLLOWER]: Refusing update from remote peer ccd8a4c3bfe3413cb2ae219b09aea832: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 6. (term mismatch)
I20260709 13:19:44.784111  6804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a734b5ab7834e05a8c422208acc58b1" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 10 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:19:44.783950  6801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c44c4849aa54f2b94d1f1bef9ed546f" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
W20260709 13:19:44.797840  6695 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:44.792428  6800 raft_consensus.cc:1275] T 90d42e216d9741e190bca19a781291fd P b7ab4784c7344b939bc36f639286f377 [term 9 FOLLOWER]: Refusing update from remote peer ccd8a4c3bfe3413cb2ae219b09aea832: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 5. (term mismatch)
I20260709 13:19:44.798024  6806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "713b5728a197487c9300b310ab94e5a3" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:19:44.798705  6805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22ccee1b570c4ad3a57bd7aec085b1b4" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
W20260709 13:19:44.791136  6697 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 85617.2us
I20260709 13:19:44.695845 10063 consensus_queue.cc:1048] T d33d5ee8ef6f415593d8df52063161ad P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.087s
I20260709 13:19:44.742378  9875 raft_consensus.cc:2804] T 9e326172347f45e99a0d482b5d8ef768 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:19:44.803519  6802 raft_consensus.cc:1275] T bd6869f07b5a4885a0b99fbe60c3b175 P b7ab4784c7344b939bc36f639286f377 [term 9 FOLLOWER]: Refusing update from remote peer ccd8a4c3bfe3413cb2ae219b09aea832: Log matching property violated. Preceding OpId in replica: term: 5 index: 2. Preceding OpId from leader: term: 9 index: 4. (index mismatch)
I20260709 13:19:44.822192  6798 raft_consensus.cc:1275] T 7887766dc6784fcaa42b35c05fea7a99 P b7ab4784c7344b939bc36f639286f377 [term 9 FOLLOWER]: Refusing update from remote peer ccd8a4c3bfe3413cb2ae219b09aea832: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:19:44.738759  6732 raft_consensus.cc:2393] T dbdf895bba214ff68685a24fd17dfb5d P ccd8a4c3bfe3413cb2ae219b09aea832 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate b7ab4784c7344b939bc36f639286f377 in current term 8: Already voted for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in this term.
I20260709 13:19:44.707767 10032 consensus_queue.cc:1059] T be1a92657f494cac8dd227d152f50151 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.083s
I20260709 13:19:44.788442 10107 raft_consensus.cc:2749] T 7ba5dac66ab5497e9e336f2a3c28cda5 P cd75a17ab2604397adab03bb8b5fd75c [term 10 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:19:44.830778  6800 pending_rounds.cc:85] T 90d42e216d9741e190bca19a781291fd P b7ab4784c7344b939bc36f639286f377: Aborting all ops after (but not including) 4
I20260709 13:19:44.857517  6800 pending_rounds.cc:107] T 90d42e216d9741e190bca19a781291fd P b7ab4784c7344b939bc36f639286f377: Aborting uncommitted NO_OP operation due to leader change: 8.5
I20260709 13:19:44.857846  6800 raft_consensus.cc:2889] T 90d42e216d9741e190bca19a781291fd P b7ab4784c7344b939bc36f639286f377 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:19:44.835391 10004 consensus_queue.cc:1048] T f3f9c2e2bf644115957398fe4c9459db P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.005s
W20260709 13:19:44.840212 10127 log.cc:927] Time spent T fe20b4b48823486ca3b9c648db6ce8aa P cd75a17ab2604397adab03bb8b5fd75c: Append to log took a long time: real 0.265s	user 0.000s	sys 0.002s
W20260709 13:19:44.840806  6628 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:53234 (request call id 170) took 20548 ms (client timeout 15000 ms). Trace:
I20260709 13:19:44.842971  9852 raft_consensus.cc:515] T d8cee0accdb8499c86d4414b72565a38 P b7ab4784c7344b939bc36f639286f377 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:19:44.745682 10145 consensus_queue.cc:1048] T 1528ab62b6fe4e3099d08f141afee116 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.107s
I20260709 13:19:44.844926  6772 leader_election.cc:304] T 34f36d59d88f40fe8a2805e604fc6c0a P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:19:44.818987  9849 leader_election.cc:290] T 9b3759de40694069b13c0f8bd40e5709 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 9 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:44.829849  6803 pending_rounds.cc:85] T 20f6842e26174571996b8dea4151d4be P b7ab4784c7344b939bc36f639286f377: Aborting all ops after (but not including) 5
I20260709 13:19:44.870875  6803 pending_rounds.cc:107] T 20f6842e26174571996b8dea4151d4be P b7ab4784c7344b939bc36f639286f377: Aborting uncommitted NO_OP operation due to leader change: 8.6
W20260709 13:19:44.870541  6770 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 173624us
I20260709 13:19:44.871317  6803 raft_consensus.cc:2889] T 20f6842e26174571996b8dea4151d4be P b7ab4784c7344b939bc36f639286f377 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:19:44.850417 10143 log.cc:927] Time spent T 7a734b5ab7834e05a8c422208acc58b1 P ccd8a4c3bfe3413cb2ae219b09aea832: Append to log took a long time: real 0.233s	user 0.000s	sys 0.002s
W20260709 13:19:44.851711 10132 log.cc:927] Time spent T 711ef6523deb4cbe8ef2ba61e1c21c98 P b7ab4784c7344b939bc36f639286f377: Append to log took a long time: real 0.108s	user 0.000s	sys 0.000s
I20260709 13:19:44.817879 10110 raft_consensus.cc:493] T 30e88460611e47b2ba16a46a30b5f416 P b7ab4784c7344b939bc36f639286f377 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:44.829443 10111 raft_consensus.cc:493] T e31b9971c15848dea59d4d4130141d9e P b7ab4784c7344b939bc36f639286f377 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:19:44.870494  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 180326us
I20260709 13:19:44.853973 10113 raft_consensus.cc:2749] T f03d0dbf16864ca4bc1bb5e4c0334c0f P b7ab4784c7344b939bc36f639286f377 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:19:44.877616  6798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "427c124d773f483294511e80fe340075" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:19:44.880160  6804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17587d6730594da4a56fa13a353232a1" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:19:44.884621  6879 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53416 (request call id 2561) took 2376 ms. Trace:
I20260709 13:19:44.891077  6800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1704639a875409b9959353527b3fd68" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:19:44.892987  6807 raft_consensus.cc:1240] T d8cee0accdb8499c86d4414b72565a38 P b7ab4784c7344b939bc36f639286f377 [term 9 FOLLOWER]: Rejecting Update request from peer 7ba59cc884714e8aa5f3f0ecaed84cbb for earlier term 8. Current term is 9. Ops: []
I20260709 13:19:44.900982  6844 leader_election.cc:400] T d33d5ee8ef6f415593d8df52063161ad P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 9 pre-election: Vote denied by peer b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817) with higher term. Message: Invalid argument: T d33d5ee8ef6f415593d8df52063161ad P b7ab4784c7344b939bc36f639286f377 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c for earlier term 9. Current term is 10.
I20260709 13:19:44.885354 10111 raft_consensus.cc:3060] T e31b9971c15848dea59d4d4130141d9e P b7ab4784c7344b939bc36f639286f377 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:44.907966  6803 raft_consensus.cc:1275] T b3f13b31a1f84f0d89d007eadd57924c P b7ab4784c7344b939bc36f639286f377 [term 7 FOLLOWER]: Refusing update from remote peer 7ba59cc884714e8aa5f3f0ecaed84cbb: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:19:44.881554  9875 raft_consensus.cc:697] T 9e326172347f45e99a0d482b5d8ef768 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 8 LEADER]: Becoming Leader. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
I20260709 13:19:44.887144 10123 raft_consensus.cc:3055] T be1a92657f494cac8dd227d152f50151 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 10 LEADER]: Stepping down as leader of term 10
W20260709 13:19:44.912840  6846 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:44.889142  6879 rpcz_store.cc:276] 0709 13:19:42.317097 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:42.540170 (+223073us) service_pool.cc:224] Handling call
0709 13:19:42.684443 (+144273us) spinlock_profiling.cc:243] Waited 5.59 ms on lock 0x7b5800147c98. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0c745db1 00007fcc0c885b71 00007fcc0c885a22 00007fcc1579ec09 00007fcc148f8ee0 00007fcc149c20ab 00007fcc149c2131 00007fcc14983fc0 00007fcc1496e929 00007fcc1496e3d2 00007fcc0dee5bd4
0709 13:19:42.684701 (+   258us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:42.684923 (+   222us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:19:44.091982 (+1407059us) spinlock_profiling.cc:243] Waited 15.3 ms on lock 0x7b1800322b40. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc15785de1 00007fcc157925b1 00007fcc0f5524bc 00007fcc0c8a048b 00007fcc156faab9 00007fcc0c8bc69b 00007fcc0c8ba93f 00007fcc0c8ba455 00007fcc133a23c7 00007fcc0f9b49a7 00007fcc0f9bd5e5
0709 13:19:44.092177 (+   195us) log.cc:844] Serialized 14 byte log entry
0709 13:19:44.615470 (+523293us) log.cc:844] Serialized 14 byte log entry
0709 13:19:44.630790 (+ 15320us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:44.637583 (+  6793us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:19:44.665966 (+ 28383us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:44.679336 (+ 13370us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:44.693796 (+ 14460us) inbound_call.cc:177] Queueing success response
0709 13:19:44.851358 (+157562us) spinlock_profiling.cc:243] Waited 6.99 ms on lock 0x7b1800322b40. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc15785de1 00007fcc157925b1 00007fcc0c8bd3f3 00007fcc0c8bf7c1 00007fcc0c8bf779 00007fcc0c8bf709 00007fcc0c8bf6d1 00007fcc0c8be9cd 000000000038f354 000000000038f199 00007fcc0c8a083a
Metrics: {"mutex_wait_us":47029,"prepare.queue_time_us":644250,"prepare.run_cpu_time_us":133,"prepare.run_wall_time_us":11048,"raft.queue_time_us":5792,"raft.run_cpu_time_us":180,"raft.run_wall_time_us":6541,"spinlock_wait_cycles":64046976,"thread_start_us":742277,"threads_started":3,"wal-append.queue_time_us":343000}
W20260709 13:19:44.920627  6773 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:44.908550  9864 consensus_queue.cc:1048] T ab432e62819d499eaaf3dd55481dd930 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.013s
I20260709 13:19:44.921399  9875 consensus_queue.cc:237] T 9e326172347f45e99a0d482b5d8ef768 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
W20260709 13:19:44.930557  6847 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:44.932636 10008 raft_consensus.cc:3055] T b3f13b31a1f84f0d89d007eadd57924c P ccd8a4c3bfe3413cb2ae219b09aea832 [term 6 LEADER]: Stepping down as leader of term 6
W20260709 13:19:44.935699  9450 consensus_meta.cc:287] T 1bf4668eeb70467fb3dc5a0289233b3c P b7ab4784c7344b939bc36f639286f377: Time spent flushing consensus metadata: real 0.542s	user 0.007s	sys 0.007s
I20260709 13:19:44.900403  9888 consensus_queue.cc:1059] T fe20b4b48823486ca3b9c648db6ce8aa P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.040s
W20260709 13:19:44.940887 10133 log.cc:927] Time spent T f58dc08b12a2494bb9a1372837970ca2 P ccd8a4c3bfe3413cb2ae219b09aea832: Append to log took a long time: real 0.198s	user 0.000s	sys 0.002s
I20260709 13:19:44.941985 10031 consensus_queue.cc:1059] T d8cee0accdb8499c86d4414b72565a38 P 7ba59cc884714e8aa5f3f0ecaed84cbb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
W20260709 13:19:44.942708  6772 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 98008.4us
I20260709 13:19:44.891445 10006 leader_election.cc:290] T f3f9c2e2bf644115957398fe4c9459db P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
W20260709 13:19:44.955920  6697 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 48765.6us
W20260709 13:19:44.966578  6773 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:44.908643 10141 log.cc:927] Time spent T b3f13b31a1f84f0d89d007eadd57924c P 7ba59cc884714e8aa5f3f0ecaed84cbb: Append to log took a long time: real 0.109s	user 0.002s	sys 0.000s
I20260709 13:19:44.922451 10033 leader_election.cc:290] T f09c2a98de1a4decabd0ff900dd44caa P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
W20260709 13:19:45.025696  6847 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:44.992347  6770 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 120187us
I20260709 13:19:44.891609  9849 consensus_queue.cc:1059] T 427c124d773f483294511e80fe340075 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } attrs { replace: true }, Status: INVALID_TERM, Last received: 5.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.086s
I20260709 13:19:44.989809  6803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbdf895bba214ff68685a24fd17dfb5d" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:19:45.034812  6803 raft_consensus.cc:2393] T dbdf895bba214ff68685a24fd17dfb5d P b7ab4784c7344b939bc36f639286f377 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate ccd8a4c3bfe3413cb2ae219b09aea832 in current term 8: Already voted for candidate b7ab4784c7344b939bc36f639286f377 in this term.
W20260709 13:19:45.009665  6771 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:44.988373 10020 consensus_queue.cc:1048] T b3f13b31a1f84f0d89d007eadd57924c P 7ba59cc884714e8aa5f3f0ecaed84cbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.023s
W20260709 13:19:45.011624  6846 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:45.035974  6772 leader_election.cc:304] T 7c37d41cd9164c15a6826ca62a851a69 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:19:44.916903 10032 consensus_queue.cc:1048] T f4b8bd455d5a47c18a1380839c6e0d61 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.088s
I20260709 13:19:44.998477  9933 consensus_queue.cc:1048] T bd6869f07b5a4885a0b99fbe60c3b175 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.018s
W20260709 13:19:45.018510  9949 consensus_meta.cc:287] T f58dc08b12a2494bb9a1372837970ca2 P b7ab4784c7344b939bc36f639286f377: Time spent flushing consensus metadata: real 0.622s	user 0.013s	sys 0.001s
W20260709 13:19:45.019724  9785 consensus_meta.cc:287] T 17587d6730594da4a56fa13a353232a1 P b7ab4784c7344b939bc36f639286f377: Time spent flushing consensus metadata: real 0.558s	user 0.011s	sys 0.003s
I20260709 13:19:45.020819  7494 raft_consensus.cc:1240] T fe20b4b48823486ca3b9c648db6ce8aa P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 7 FOLLOWER]: Rejecting Update request from peer ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 6. Current term is 7. Ops: []
I20260709 13:19:44.954046 10104 leader_election.cc:290] T dbdf895bba214ff68685a24fd17dfb5d P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 8 election: Requested vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:44.900179 10110 raft_consensus.cc:515] T 30e88460611e47b2ba16a46a30b5f416 P b7ab4784c7344b939bc36f639286f377 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:44.923305 10123 raft_consensus.cc:740] T be1a92657f494cac8dd227d152f50151 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
I20260709 13:19:44.977034 10008 raft_consensus.cc:740] T b3f13b31a1f84f0d89d007eadd57924c P ccd8a4c3bfe3413cb2ae219b09aea832 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
W20260709 13:19:45.038820  6771 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:45.049633  6803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30e88460611e47b2ba16a46a30b5f416" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
W20260709 13:19:45.072674  6845 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:45.102767  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 201827us
W20260709 13:19:44.864017  6628 rpcz_store.cc:269] 0709 13:19:24.292115 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:24.293359 (+  1244us) service_pool.cc:224] Handling call
0709 13:19:44.835787 (+20542428us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:19:40.781475 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:19:40.814258 (+ 32783us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:19:40.814312 (+    54us) write_op.cc:435] Acquired schema lock
0709 13:19:40.814325 (+    13us) tablet.cc:662] Decoding operations
0709 13:19:40.827160 (+ 12835us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:19:40.827228 (+    68us) write_op.cc:641] Partition lock acquired for write op
0709 13:19:40.827257 (+    29us) tablet.cc:685] Acquiring locks for 22 operations
0709 13:19:40.848352 (+ 21095us) tablet.cc:701] Row locks acquired
0709 13:19:40.848379 (+    27us) write_op.cc:260] PREPARE: finished
0709 13:19:40.848628 (+   249us) write_op.cc:270] Start()
0709 13:19:40.848810 (+   182us) write_op.cc:276] Timestamp: P: 1783603180848558 usec, L: 0
0709 13:19:40.848832 (+    22us) op_driver.cc:348] REPLICATION: starting
0709 13:19:40.887394 (+ 38562us) log.cc:844] Serialized 8623 byte log entry
0709 13:19:42.519165 (+1631771us) op_driver.cc:464] REPLICATION: finished
0709 13:19:42.956284 (+437119us) write_op.cc:301] APPLY: starting
0709 13:19:42.956403 (+   119us) tablet.cc:1367] starting BulkCheckPresence
0709 13:19:42.957216 (+   813us) tablet.cc:1370] finished BulkCheckPresence
0709 13:19:42.957417 (+   201us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:19:43.149952 (+192535us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:19:43.276333 (+126381us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=22
0709 13:19:43.276392 (+    59us) write_op.cc:312] APPLY: finished
0709 13:19:43.276949 (+   557us) log.cc:844] Serialized 151 byte log entry
0709 13:19:43.277229 (+   280us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:19:43.277555 (+   326us) write_op.cc:454] Released schema lock
0709 13:19:43.277658 (+   103us) write_op.cc:341] FINISH: Updating metrics
0709 13:19:43.278269 (+   611us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:19:43.278309 (+    40us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":3463,"reported_tablets":50,"child_traces":[["op",{"apply.queue_time_us":436829,"apply.run_cpu_time_us":8510,"apply.run_wall_time_us":321927,"num_ops":22,"prepare.queue_time_us":115928,"prepare.run_cpu_time_us":15487,"prepare.run_wall_time_us":141270,"raft.queue_time_us":103972,"raft.run_cpu_time_us":9255,"raft.run_wall_time_us":253303,"replication_time_us":1670149,"thread_start_us":441506,"threads_started":4,"wal-append.queue_time_us":100508,"wal-append.run_cpu_time_us":15543,"wal-append.run_wall_time_us":3286526}]]}
I20260709 13:19:45.068436  6804 raft_consensus.cc:2410] T 17587d6730594da4a56fa13a353232a1 P b7ab4784c7344b939bc36f639286f377 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate ccd8a4c3bfe3413cb2ae219b09aea832 for term 12 because replica has last-logged OpId of term: 11 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 8.
W20260709 13:19:45.104074  6770 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 69552.9us
I20260709 13:19:44.989132  9450 raft_consensus.cc:515] T 1bf4668eeb70467fb3dc5a0289233b3c P b7ab4784c7344b939bc36f639286f377 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:45.129252  6798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d65025eea89441290d85dd053810e31" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
W20260709 13:19:45.112959  6770 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:45.130694  6845 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:45.132356  6798 raft_consensus.cc:2393] T 3d65025eea89441290d85dd053810e31 P b7ab4784c7344b939bc36f639286f377 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate ccd8a4c3bfe3413cb2ae219b09aea832 in current term 8: Already voted for candidate b7ab4784c7344b939bc36f639286f377 in this term.
I20260709 13:19:45.031131 10030 consensus_queue.cc:1048] T 7887766dc6784fcaa42b35c05fea7a99 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.078s
I20260709 13:19:45.055172 10012 consensus_queue.cc:1048] T 90d42e216d9741e190bca19a781291fd P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.105s
I20260709 13:19:45.353811  6877 raft_consensus.cc:1275] T 853ac0a8cbd64ce99457f170216d4d0f P cd75a17ab2604397adab03bb8b5fd75c [term 6 FOLLOWER]: Refusing update from remote peer ccd8a4c3bfe3413cb2ae219b09aea832: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 4. (term mismatch)
I20260709 13:19:45.262928  6878 raft_consensus.cc:1275] T de3186201e1a40d0b335eeb8b4e256e0 P cd75a17ab2604397adab03bb8b5fd75c [term 9 FOLLOWER]: Refusing update from remote peer ccd8a4c3bfe3413cb2ae219b09aea832: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:19:45.231345  6844 leader_election.cc:304] T c4db81d9d329422bb3b4160ca4ac2d1d P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:19:45.275314  6872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3411566abe2d4c9bb4b2adfdd05e6f17" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:19:45.371994  6876 raft_consensus.cc:1275] T f03d0dbf16864ca4bc1bb5e4c0334c0f P cd75a17ab2604397adab03bb8b5fd75c [term 7 FOLLOWER]: Refusing update from remote peer ccd8a4c3bfe3413cb2ae219b09aea832: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
W20260709 13:19:45.134843  6695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 56042.3us
W20260709 13:19:45.170293  6772 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 134429us
W20260709 13:19:45.159235  6773 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:45.241534  6873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3022224cc81473690653a83d4e99470" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:19:45.208134  6881 raft_consensus.cc:1275] T 2c240553ce044eedb41541d72b9475d7 P cd75a17ab2604397adab03bb8b5fd75c [term 10 FOLLOWER]: Refusing update from remote peer ccd8a4c3bfe3413cb2ae219b09aea832: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
W20260709 13:19:45.132767  7468 leader_election.cc:336] T 427c124d773f483294511e80fe340075 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931): Timed out: RequestConsensusVote RPC to 127.5.126.67:42931 timed out after 2.022s (SENT)
I20260709 13:19:45.182600  6804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09c2a98de1a4decabd0ff900dd44caa" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
W20260709 13:19:45.392494  6845 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:45.138909  6879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8292e16e5654be6bc408560cf256aaa" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:19:45.388303  6877 pending_rounds.cc:85] T 853ac0a8cbd64ce99457f170216d4d0f P cd75a17ab2604397adab03bb8b5fd75c: Aborting all ops after (but not including) 3
I20260709 13:19:45.380703  6803 raft_consensus.cc:2468] T 30e88460611e47b2ba16a46a30b5f416 P b7ab4784c7344b939bc36f639286f377 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 8.
I20260709 13:19:45.168375  6798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bf4668eeb70467fb3dc5a0289233b3c" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:19:45.410351  6877 pending_rounds.cc:107] T 853ac0a8cbd64ce99457f170216d4d0f P cd75a17ab2604397adab03bb8b5fd75c: Aborting uncommitted NO_OP operation due to leader change: 5.4
I20260709 13:19:45.411569  6798 raft_consensus.cc:2393] T 1bf4668eeb70467fb3dc5a0289233b3c P b7ab4784c7344b939bc36f639286f377 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ccd8a4c3bfe3413cb2ae219b09aea832 in current term 9: Already voted for candidate b7ab4784c7344b939bc36f639286f377 in this term.
I20260709 13:19:45.411569  6877 raft_consensus.cc:2889] T 853ac0a8cbd64ce99457f170216d4d0f P cd75a17ab2604397adab03bb8b5fd75c [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:19:45.415885  6772 leader_election.cc:304] T 8c7f33e544204fbaac4078e3e83bbf4e P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:19:45.392109  6872 raft_consensus.cc:2468] T 3411566abe2d4c9bb4b2adfdd05e6f17 P cd75a17ab2604397adab03bb8b5fd75c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 6.
I20260709 13:19:45.067673  9657 consensus_queue.cc:1048] T 20f6842e26174571996b8dea4151d4be P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.342s
I20260709 13:19:45.400362  6873 raft_consensus.cc:2468] T a3022224cc81473690653a83d4e99470 P cd75a17ab2604397adab03bb8b5fd75c [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 9.
W20260709 13:19:45.443830  6773 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:45.481173  7468 leader_election.cc:304] T 427c124d773f483294511e80fe340075 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:19:45.452975  6878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e326172347f45e99a0d482b5d8ef768" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:19:45.494854  6878 raft_consensus.cc:3060] T 9e326172347f45e99a0d482b5d8ef768 P cd75a17ab2604397adab03bb8b5fd75c [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:19:45.242965 10149 log.cc:927] Time spent T d8292e16e5654be6bc408560cf256aaa P cd75a17ab2604397adab03bb8b5fd75c: Append to log took a long time: real 0.104s	user 0.000s	sys 0.001s
I20260709 13:19:45.419232  6727 raft_consensus.cc:1275] T f5be3a11b23d4ea9b08300a2789821c7 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 7 FOLLOWER]: Refusing update from remote peer b7ab4784c7344b939bc36f639286f377: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:19:45.106171 10063 raft_consensus.cc:3055] T 427c124d773f483294511e80fe340075 P b7ab4784c7344b939bc36f639286f377 [term 7 LEADER]: Stepping down as leader of term 7
W20260709 13:19:45.324949 10170 log.cc:927] Time spent T f3f9c2e2bf644115957398fe4c9459db P b7ab4784c7344b939bc36f639286f377: Append to log took a long time: real 0.117s	user 0.000s	sys 0.001s
W20260709 13:19:45.181499  9836 consensus_meta.cc:287] T a1704639a875409b9959353527b3fd68 P b7ab4784c7344b939bc36f639286f377: Time spent flushing consensus metadata: real 0.512s	user 0.013s	sys 0.000s
W20260709 13:19:45.478590  6697 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:45.430385  6847 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:45.262949  9852 leader_election.cc:290] T d8cee0accdb8499c86d4414b72565a38 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 9 election: Requested vote from peers cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:19:45.420401  6804 raft_consensus.cc:2468] T f09c2a98de1a4decabd0ff900dd44caa P b7ab4784c7344b939bc36f639286f377 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 10.
W20260709 13:19:45.521953  7466 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 497284us
W20260709 13:19:45.528501  6772 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 112769us
I20260709 13:19:45.476989 10107 raft_consensus.cc:2749] T c4db81d9d329422bb3b4160ca4ac2d1d P cd75a17ab2604397adab03bb8b5fd75c [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:19:45.495064  9657 consensus_queue.cc:1243] T 20f6842e26174571996b8dea4151d4be P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Peer b7ab4784c7344b939bc36f639286f377 log is divergent from this leader: its last log entry 6.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 13:19:45.232633 10111 raft_consensus.cc:515] T e31b9971c15848dea59d4d4130141d9e P b7ab4784c7344b939bc36f639286f377 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:45.533581  6772 leader_election.cc:304] T bd6869f07b5a4885a0b99fbe60c3b175 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:19:45.513183  9999 raft_consensus.cc:493] T 22ccee1b570c4ad3a57bd7aec085b1b4 P cd75a17ab2604397adab03bb8b5fd75c [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:45.538800  6878 raft_consensus.cc:2410] T 9e326172347f45e99a0d482b5d8ef768 P cd75a17ab2604397adab03bb8b5fd75c [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate ccd8a4c3bfe3413cb2ae219b09aea832 for term 8 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
W20260709 13:19:45.540957  6845 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:45.565202  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 365836us
I20260709 13:19:45.518419 10145 raft_consensus.cc:2749] T 34f36d59d88f40fe8a2805e604fc6c0a P b7ab4784c7344b939bc36f639286f377 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:19:45.536330  6800 raft_consensus.cc:2410] T a1704639a875409b9959353527b3fd68 P b7ab4784c7344b939bc36f639286f377 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate ccd8a4c3bfe3413cb2ae219b09aea832 for term 9 because replica has last-logged OpId of term: 8 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 5.
I20260709 13:19:45.515574 10063 raft_consensus.cc:740] T 427c124d773f483294511e80fe340075 P b7ab4784c7344b939bc36f639286f377 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
I20260709 13:19:45.520540 10113 raft_consensus.cc:2749] T 7c37d41cd9164c15a6826ca62a851a69 P b7ab4784c7344b939bc36f639286f377 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:19:45.589879 10172 raft_consensus.cc:2749] T 427c124d773f483294511e80fe340075 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:19:45.591085 10063 consensus_queue.cc:260] T 427c124d773f483294511e80fe340075 P b7ab4784c7344b939bc36f639286f377 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.6, Last appended by leader: 6, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } attrs { replace: true } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:19:45.323550 10008 consensus_queue.cc:260] T b3f13b31a1f84f0d89d007eadd57924c P ccd8a4c3bfe3413cb2ae219b09aea832 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
W20260709 13:19:45.592787 10165 log.cc:927] Time spent T 2c240553ce044eedb41541d72b9475d7 P b7ab4784c7344b939bc36f639286f377: Append to log took a long time: real 0.139s	user 0.001s	sys 0.000s
I20260709 13:19:45.592904 10008 raft_consensus.cc:3060] T b3f13b31a1f84f0d89d007eadd57924c P ccd8a4c3bfe3413cb2ae219b09aea832 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:45.595006  6802 raft_consensus.cc:1240] T 9b3759de40694069b13c0f8bd40e5709 P b7ab4784c7344b939bc36f639286f377 [term 9 FOLLOWER]: Rejecting Update request from peer ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 8. Current term is 9. Ops: [8.5-8.5]
I20260709 13:19:45.421099 10147 raft_consensus.cc:493] T 3a485a995abc4807b6e511e45419f737 P b7ab4784c7344b939bc36f639286f377 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:19:45.592837 10063 raft_consensus.cc:3060] T 427c124d773f483294511e80fe340075 P b7ab4784c7344b939bc36f639286f377 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:45.599226 10109 raft_consensus.cc:493] T ce4f062dcd314d43a63ca74067cb5ee3 P b7ab4784c7344b939bc36f639286f377 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:45.179476  6867 tablet_service.cc:1558] Processing DeleteTablet for tablet 1528ab62b6fe4e3099d08f141afee116 with delete_type TABLET_DATA_TOMBSTONED (Replica with old config index 3 (current committed config index is 6)) from {username='slave'} at 127.0.0.1:53394
I20260709 13:19:45.599735 10109 raft_consensus.cc:515] T ce4f062dcd314d43a63ca74067cb5ee3 P b7ab4784c7344b939bc36f639286f377 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } attrs { replace: true } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:19:45.576346  6878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "713b5728a197487c9300b310ab94e5a3" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:19:45.601389  6878 raft_consensus.cc:2468] T 713b5728a197487c9300b310ab94e5a3 P cd75a17ab2604397adab03bb8b5fd75c [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 9.
W20260709 13:19:45.592952  6847 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:45.605332  6771 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:45.614562  6773 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:45.580718  9999 raft_consensus.cc:515] T 22ccee1b570c4ad3a57bd7aec085b1b4 P cd75a17ab2604397adab03bb8b5fd75c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:45.615005  7498 raft_consensus.cc:1240] T b3f13b31a1f84f0d89d007eadd57924c P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 7 LEADER]: Rejecting Update request from peer ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 6. Current term is 7. Ops: []
I20260709 13:19:45.615294  9836 raft_consensus.cc:493] T de3186201e1a40d0b335eeb8b4e256e0 P b7ab4784c7344b939bc36f639286f377 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:19:45.615789  9836 raft_consensus.cc:515] T de3186201e1a40d0b335eeb8b4e256e0 P b7ab4784c7344b939bc36f639286f377 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
W20260709 13:19:45.616671  7468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 548174us
I20260709 13:19:45.616719  7494 raft_consensus.cc:1240] T be1a92657f494cac8dd227d152f50151 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 11 LEADER]: Rejecting Update request from peer ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 10. Current term is 11. Ops: []
W20260709 13:19:45.617951  7468 leader_election.cc:336] T 7ba5dac66ab5497e9e336f2a3c28cda5 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931): Timed out: RequestConsensusVote RPC to 127.5.126.67:42931 timed out after 2.087s (SENT)
I20260709 13:19:45.618464  7468 leader_election.cc:304] T 7ba5dac66ab5497e9e336f2a3c28cda5 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:19:45.618770  6806 raft_consensus.cc:1275] T f58dc08b12a2494bb9a1372837970ca2 P b7ab4784c7344b939bc36f639286f377 [term 11 FOLLOWER]: Refusing update from remote peer ccd8a4c3bfe3413cb2ae219b09aea832: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
W20260709 13:19:45.619637  7468 leader_election.cc:336] T ce4f062dcd314d43a63ca74067cb5ee3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931): Timed out: RequestConsensusVote RPC to 127.5.126.67:42931 timed out after 2.089s (SENT)
I20260709 13:19:45.620024  7468 leader_election.cc:304] T ce4f062dcd314d43a63ca74067cb5ee3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:19:45.621196  6878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22ccee1b570c4ad3a57bd7aec085b1b4" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:19:45.622359  6878 raft_consensus.cc:2410] T 22ccee1b570c4ad3a57bd7aec085b1b4 P cd75a17ab2604397adab03bb8b5fd75c [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ccd8a4c3bfe3413cb2ae219b09aea832 for term 9 because replica has last-logged OpId of term: 6 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 13:19:45.572916  9450 leader_election.cc:290] T 1bf4668eeb70467fb3dc5a0289233b3c P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 9 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:45.180367 10123 consensus_queue.cc:260] T be1a92657f494cac8dd227d152f50151 P ccd8a4c3bfe3413cb2ae219b09aea832 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:19:45.581238  9785 raft_consensus.cc:2749] T 8c7f33e544204fbaac4078e3e83bbf4e P b7ab4784c7344b939bc36f639286f377 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:19:45.632128  6845 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:45.597427 10147 raft_consensus.cc:515] T 3a485a995abc4807b6e511e45419f737 P b7ab4784c7344b939bc36f639286f377 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:45.632606 10173 raft_consensus.cc:493] T bb3d8792045a4583ae2e965b1350a5b4 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 7 FOLLOWER]: Starting pre-election (detected failure of leader cd75a17ab2604397adab03bb8b5fd75c)
I20260709 13:19:45.633462 10173 raft_consensus.cc:515] T bb3d8792045a4583ae2e965b1350a5b4 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:19:45.634631 10147 leader_election.cc:290] T 3a485a995abc4807b6e511e45419f737 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
W20260709 13:19:45.635190 10168 log.cc:927] Time spent T 7c37d41cd9164c15a6826ca62a851a69 P b7ab4784c7344b939bc36f639286f377: Append to log took a long time: real 0.393s	user 0.001s	sys 0.000s
I20260709 13:19:45.616835  9999 leader_election.cc:290] T 22ccee1b570c4ad3a57bd7aec085b1b4 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:19:45.637539  6877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c44c4849aa54f2b94d1f1bef9ed546f" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:19:45.591143 10110 leader_election.cc:290] T 30e88460611e47b2ba16a46a30b5f416 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:45.661665  6697 leader_election.cc:304] T 1528ab62b6fe4e3099d08f141afee116 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: b7ab4784c7344b939bc36f639286f377
W20260709 13:19:45.664698 10158 log.cc:927] Time spent T 713b5728a197487c9300b310ab94e5a3 P b7ab4784c7344b939bc36f639286f377: Append to log took a long time: real 0.255s	user 0.000s	sys 0.001s
I20260709 13:19:45.668272 10159 raft_consensus.cc:2749] T bd6869f07b5a4885a0b99fbe60c3b175 P b7ab4784c7344b939bc36f639286f377 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:19:45.670878  6877 raft_consensus.cc:2468] T 7c44c4849aa54f2b94d1f1bef9ed546f P cd75a17ab2604397adab03bb8b5fd75c [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 10.
I20260709 13:19:45.671234  9893 raft_consensus.cc:493] T ce4f062dcd314d43a63ca74067cb5ee3 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:45.671954  9893 raft_consensus.cc:515] T ce4f062dcd314d43a63ca74067cb5ee3 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } attrs { replace: true } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:19:45.674849  9893 leader_election.cc:290] T ce4f062dcd314d43a63ca74067cb5ee3 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:19:45.676601  7494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17587d6730594da4a56fa13a353232a1" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb"
I20260709 13:19:45.677605  7494 raft_consensus.cc:3060] T 17587d6730594da4a56fa13a353232a1 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:19:45.679060 10162 log.cc:927] Time spent T de3186201e1a40d0b335eeb8b4e256e0 P ccd8a4c3bfe3413cb2ae219b09aea832: Append to log took a long time: real 0.269s	user 0.002s	sys 0.000s
W20260709 13:19:45.680738  6772 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 147247us
I20260709 13:19:45.617980  9836 leader_election.cc:290] T de3186201e1a40d0b335eeb8b4e256e0 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
W20260709 13:19:45.685293  7468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 65707.1us
I20260709 13:19:45.687150  6878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a734b5ab7834e05a8c422208acc58b1" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 10 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:19:45.684891 10174 raft_consensus.cc:2749] T 7ba5dac66ab5497e9e336f2a3c28cda5 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:19:45.690928  6877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1704639a875409b9959353527b3fd68" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:19:45.675805 10123 raft_consensus.cc:3060] T be1a92657f494cac8dd227d152f50151 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:45.685242  7498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "427c124d773f483294511e80fe340075" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb"
I20260709 13:19:45.662889 10173 leader_election.cc:290] T bb3d8792045a4583ae2e965b1350a5b4 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
W20260709 13:19:45.676671 10171 log.cc:927] Time spent T 07a92dd554674067a83a9cb68c4773f2 P b7ab4784c7344b939bc36f639286f377: Append to log took a long time: real 0.223s	user 0.000s	sys 0.001s
I20260709 13:19:45.691636  6877 raft_consensus.cc:3060] T a1704639a875409b9959353527b3fd68 P cd75a17ab2604397adab03bb8b5fd75c [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:45.692809 10176 raft_consensus.cc:2749] T ce4f062dcd314d43a63ca74067cb5ee3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:19:45.693531  6872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "427c124d773f483294511e80fe340075" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:19:45.695369  7498 raft_consensus.cc:3060] T 427c124d773f483294511e80fe340075 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:45.712399  6872 raft_consensus.cc:3060] T 427c124d773f483294511e80fe340075 P cd75a17ab2604397adab03bb8b5fd75c [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:45.695713  6878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30e88460611e47b2ba16a46a30b5f416" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:19:45.713212  6878 raft_consensus.cc:2468] T 30e88460611e47b2ba16a46a30b5f416 P cd75a17ab2604397adab03bb8b5fd75c [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 8.
I20260709 13:19:45.725786  6878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bf4668eeb70467fb3dc5a0289233b3c" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:19:45.726645  6878 raft_consensus.cc:2468] T 1bf4668eeb70467fb3dc5a0289233b3c P cd75a17ab2604397adab03bb8b5fd75c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 7.
I20260709 13:19:45.715361  9893 raft_consensus.cc:2804] T 1528ab62b6fe4e3099d08f141afee116 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:19:45.741892  6878 raft_consensus.cc:1275] T 7887766dc6784fcaa42b35c05fea7a99 P cd75a17ab2604397adab03bb8b5fd75c [term 9 FOLLOWER]: Refusing update from remote peer ccd8a4c3bfe3413cb2ae219b09aea832: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:19:45.741876  6881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d65025eea89441290d85dd053810e31" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:19:45.764417  6844 leader_election.cc:400] T ab432e62819d499eaaf3dd55481dd930 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 9 election: Vote denied by peer b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817) with higher term. Message: Invalid argument: T ab432e62819d499eaaf3dd55481dd930 P b7ab4784c7344b939bc36f639286f377 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c for earlier term 9. Current term is 10.
I20260709 13:19:45.765064  6844 leader_election.cc:403] T ab432e62819d499eaaf3dd55481dd930 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 9 election: Cancelling election due to peer responding with higher term
I20260709 13:19:45.770674  7498 raft_consensus.cc:2468] T 427c124d773f483294511e80fe340075 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 8.
I20260709 13:19:45.717686 10012 consensus_queue.cc:1059] T fe20b4b48823486ca3b9c648db6ce8aa P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.048s
I20260709 13:19:45.751430  9450 consensus_queue.cc:1048] T 713b5728a197487c9300b310ab94e5a3 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.031s
W20260709 13:19:45.793256  6845 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:45.799052  6807 raft_consensus.cc:1240] T d8cee0accdb8499c86d4414b72565a38 P b7ab4784c7344b939bc36f639286f377 [term 9 FOLLOWER]: Rejecting Update request from peer 7ba59cc884714e8aa5f3f0ecaed84cbb for earlier term 8. Current term is 9. Ops: []
I20260709 13:19:45.803575 10182 raft_consensus.cc:2749] T ab432e62819d499eaaf3dd55481dd930 P cd75a17ab2604397adab03bb8b5fd75c [term 10 FOLLOWER]: Leader election lost for term 9. Reason: Vote denied by peer b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817) with higher term. Message: Invalid argument: T ab432e62819d499eaaf3dd55481dd930 P b7ab4784c7344b939bc36f639286f377 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c for earlier term 9. Current term is 10.
W20260709 13:19:45.813751  6773 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:45.790190 10154 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.556s	user 0.005s	sys 0.014s
W20260709 13:19:45.820412 10154 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.603s	user 0.005s	sys 0.015s
W20260709 13:19:45.841885  6770 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:45.834873  6772 leader_election.cc:304] T 4d9def8b32fd443aa94ab1420b06837b P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
W20260709 13:19:45.839147  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 74969.5us
W20260709 13:19:45.840844 10169 log.cc:927] Time spent T 34f36d59d88f40fe8a2805e604fc6c0a P b7ab4784c7344b939bc36f639286f377: Append to log took a long time: real 0.381s	user 0.004s	sys 0.000s
I20260709 13:19:45.854966  6874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09c2a98de1a4decabd0ff900dd44caa" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:19:45.867900  6874 raft_consensus.cc:2468] T f09c2a98de1a4decabd0ff900dd44caa P cd75a17ab2604397adab03bb8b5fd75c [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 9.
I20260709 13:19:45.860270 10004 raft_consensus.cc:3055] T fe20b4b48823486ca3b9c648db6ce8aa P ccd8a4c3bfe3413cb2ae219b09aea832 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:19:45.860975 10109 leader_election.cc:290] T ce4f062dcd314d43a63ca74067cb5ee3 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
W20260709 13:19:45.892680  6772 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 57931.6us
I20260709 13:19:45.842213 10178 raft_consensus.cc:493] T f58dc08b12a2494bb9a1372837970ca2 P b7ab4784c7344b939bc36f639286f377 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:45.920718  6874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbdf895bba214ff68685a24fd17dfb5d" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:19:45.878412  9852 raft_consensus.cc:2749] T 4d9def8b32fd443aa94ab1420b06837b P b7ab4784c7344b939bc36f639286f377 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:19:45.919572  6877 raft_consensus.cc:2410] T a1704639a875409b9959353527b3fd68 P cd75a17ab2604397adab03bb8b5fd75c [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate ccd8a4c3bfe3413cb2ae219b09aea832 for term 9 because replica has last-logged OpId of term: 8 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 5.
I20260709 13:19:45.912556  6772 leader_election.cc:304] T 20f6842e26174571996b8dea4151d4be P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:19:45.926390  6772 leader_election.cc:304] T c4db81d9d329422bb3b4160ca4ac2d1d P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:19:45.876771  9836 raft_consensus.cc:493] T d8292e16e5654be6bc408560cf256aaa P b7ab4784c7344b939bc36f639286f377 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:45.928342  9836 raft_consensus.cc:515] T d8292e16e5654be6bc408560cf256aaa P b7ab4784c7344b939bc36f639286f377 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:45.931334  9836 leader_election.cc:290] T d8292e16e5654be6bc408560cf256aaa P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
W20260709 13:19:45.951009  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 64877.4us
I20260709 13:19:45.910312 10004 raft_consensus.cc:740] T fe20b4b48823486ca3b9c648db6ce8aa P ccd8a4c3bfe3413cb2ae219b09aea832 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
I20260709 13:19:45.962193 10187 raft_consensus.cc:493] T bb3d8792045a4583ae2e965b1350a5b4 P cd75a17ab2604397adab03bb8b5fd75c [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:45.961279  9864 raft_consensus.cc:2749] T c4db81d9d329422bb3b4160ca4ac2d1d P b7ab4784c7344b939bc36f639286f377 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:19:45.961684  9836 raft_consensus.cc:2804] T 20f6842e26174571996b8dea4151d4be P b7ab4784c7344b939bc36f639286f377 [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 13:19:45.994598  7468 leader_election.cc:336] T fe20b4b48823486ca3b9c648db6ce8aa P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931): Timed out: RequestConsensusVote RPC to 127.5.126.67:42931 timed out after 2.059s (SENT)
I20260709 13:19:46.000115  7468 leader_election.cc:304] T fe20b4b48823486ca3b9c648db6ce8aa P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:19:46.017760  6877 raft_consensus.cc:1275] T f58dc08b12a2494bb9a1372837970ca2 P cd75a17ab2604397adab03bb8b5fd75c [term 11 FOLLOWER]: Refusing update from remote peer ccd8a4c3bfe3413cb2ae219b09aea832: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:19:45.948734 10178 raft_consensus.cc:515] T f58dc08b12a2494bb9a1372837970ca2 P b7ab4784c7344b939bc36f639286f377 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:45.999923  9836 raft_consensus.cc:493] T 20f6842e26174571996b8dea4151d4be P b7ab4784c7344b939bc36f639286f377 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:46.038326  9836 raft_consensus.cc:3060] T 20f6842e26174571996b8dea4151d4be P b7ab4784c7344b939bc36f639286f377 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:46.038544 10004 consensus_queue.cc:260] T fe20b4b48823486ca3b9c648db6ce8aa P ccd8a4c3bfe3413cb2ae219b09aea832 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:19:46.042055  6805 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:32976 (request call id 2500) took 1104 ms. Trace:
I20260709 13:19:46.045310  9999 raft_consensus.cc:493] T bb7fa124c3bf4ef9ab65a407cb008441 P cd75a17ab2604397adab03bb8b5fd75c [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:19:46.045981 10045 consensus_queue.cc:1048] T de3186201e1a40d0b335eeb8b4e256e0 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:19:46.046223  9875 consensus_queue.cc:1048] T 2c240553ce044eedb41541d72b9475d7 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:19:46.046155  9999 raft_consensus.cc:515] T bb7fa124c3bf4ef9ab65a407cb008441 P cd75a17ab2604397adab03bb8b5fd75c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:19:46.045849  6697 leader_election.cc:304] T d8292e16e5654be6bc408560cf256aaa P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:19:46.048133 10102 raft_consensus.cc:2749] T fe20b4b48823486ca3b9c648db6ce8aa P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:19:45.997658 10032 raft_consensus.cc:493] T ab432e62819d499eaaf3dd55481dd930 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:19:46.049067  6697 leader_election.cc:304] T 3411566abe2d4c9bb4b2adfdd05e6f17 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377
I20260709 13:19:46.050469  9999 leader_election.cc:290] T bb7fa124c3bf4ef9ab65a407cb008441 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:19:46.049736 10164 raft_consensus.cc:2749] T d8292e16e5654be6bc408560cf256aaa P ccd8a4c3bfe3413cb2ae219b09aea832 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:19:46.050830  9933 raft_consensus.cc:2804] T 3411566abe2d4c9bb4b2adfdd05e6f17 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:19:46.043010  6805 rpcz_store.cc:276] 0709 13:19:44.937309 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:45.572188 (+634879us) service_pool.cc:224] Handling call
0709 13:19:45.587987 (+ 15799us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:45.683958 (+ 95971us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:45.683988 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:45.689171 (+  5183us) log.cc:844] Serialized 26 byte log entry
0709 13:19:45.921886 (+232715us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:19:45.921950 (+    64us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:45.922074 (+   124us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:46.041724 (+119650us) raft_consensus.cc:1685] finished
0709 13:19:46.041754 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:46.041971 (+   217us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":100064,"raft.queue_time_us":90584,"raft.run_cpu_time_us":120,"raft.run_wall_time_us":1771,"thread_start_us":230082,"threads_started":1,"wal-append.queue_time_us":312747}
I20260709 13:19:46.049345 10032 raft_consensus.cc:515] T ab432e62819d499eaaf3dd55481dd930 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:46.052572  6697 leader_election.cc:304] T a3022224cc81473690653a83d4e99470 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377
I20260709 13:19:45.995348 10006 consensus_queue.cc:1048] T ab432e62819d499eaaf3dd55481dd930 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 2, Time since last communication: 0.035s
I20260709 13:19:45.995909  9852 consensus_queue.cc:1048] T a3022224cc81473690653a83d4e99470 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.035s
I20260709 13:19:46.047571 10045 consensus_queue.cc:1048] T f03d0dbf16864ca4bc1bb5e4c0334c0f P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.010s
W20260709 13:19:46.066466  7468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 79826.6us
I20260709 13:19:46.051582  9450 raft_consensus.cc:493] T a1704639a875409b9959353527b3fd68 P b7ab4784c7344b939bc36f639286f377 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:46.068015 10030 raft_consensus.cc:2804] T a3022224cc81473690653a83d4e99470 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:19:46.058880  9933 raft_consensus.cc:493] T 3411566abe2d4c9bb4b2adfdd05e6f17 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 6 FOLLOWER]: Starting leader election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:19:46.059674  9875 consensus_queue.cc:1048] T 853ac0a8cbd64ce99457f170216d4d0f P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.006s
I20260709 13:19:46.069829 10189 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:53394 (request call id 70) took 1199 ms. Trace:
I20260709 13:19:46.099465 10030 raft_consensus.cc:493] T a3022224cc81473690653a83d4e99470 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 9 FOLLOWER]: Starting leader election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:19:46.006551 10187 raft_consensus.cc:515] T bb3d8792045a4583ae2e965b1350a5b4 P cd75a17ab2604397adab03bb8b5fd75c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:19:46.072366  6724 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3fa34c08b205435dba97346991aa1f92"
dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
mode: GRACEFUL
new_leader_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
 from {username='slave'} at 127.0.0.1:38536
W20260709 13:19:46.074827 10179 log.cc:927] Time spent T f4b8bd455d5a47c18a1380839c6e0d61 P b7ab4784c7344b939bc36f639286f377: Append to log took a long time: real 0.457s	user 0.002s	sys 0.000s
I20260709 13:19:46.075985  7498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce4f062dcd314d43a63ca74067cb5ee3" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
W20260709 13:19:46.077975  6847 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:46.116736  7498 raft_consensus.cc:2468] T ce4f062dcd314d43a63ca74067cb5ee3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 8.
I20260709 13:19:46.117333  6799 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:32976 (request call id 2482) took 1382 ms. Trace:
I20260709 13:19:46.125262  6872 raft_consensus.cc:2468] T 427c124d773f483294511e80fe340075 P cd75a17ab2604397adab03bb8b5fd75c [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 8.
I20260709 13:19:46.114403  6729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b3759de40694069b13c0f8bd40e5709" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:19:46.078745  6878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce4f062dcd314d43a63ca74067cb5ee3" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:19:46.082216  6805 raft_consensus.cc:1275] T be1a92657f494cac8dd227d152f50151 P b7ab4784c7344b939bc36f639286f377 [term 11 FOLLOWER]: Refusing update from remote peer 7ba59cc884714e8aa5f3f0ecaed84cbb: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:19:46.127913  6878 raft_consensus.cc:2468] T ce4f062dcd314d43a63ca74067cb5ee3 P cd75a17ab2604397adab03bb8b5fd75c [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 8.
W20260709 13:19:46.086066 10185 log.cc:927] Time spent T 1528ab62b6fe4e3099d08f141afee116 P ccd8a4c3bfe3413cb2ae219b09aea832: Append to log took a long time: real 0.224s	user 0.000s	sys 0.002s
I20260709 13:19:46.131696 10197 consensus_queue.cc:1059] T d8cee0accdb8499c86d4414b72565a38 P 7ba59cc884714e8aa5f3f0ecaed84cbb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:19:46.089493  6803 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:32976 (request call id 2496) took 1153 ms. Trace:
I20260709 13:19:46.105449  9933 raft_consensus.cc:3060] T 3411566abe2d4c9bb4b2adfdd05e6f17 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:46.133195  6803 rpcz_store.cc:276] 0709 13:19:44.935965 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:45.049262 (+113297us) service_pool.cc:224] Handling call
0709 13:19:46.089323 (+1040061us) spinlock_profiling.cc:243] Waited 273 ms on lock 0x7b54001f5754. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f9ae2fa 00007fcc1496fb17 00007fcc0deea6d4 00007fcc0deea662 00007fcc0deea591 00007fcc0deea50c 00007fcc0dee97c2 00007fcc0dce548c 00007fcc0dce48c6 00007fcc0dce426f
0709 13:19:46.089427 (+   104us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":628518144}
I20260709 13:19:46.133699  6726 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50004 (request call id 1707) took 1021 ms. Trace:
I20260709 13:19:46.136684 10172 consensus_queue.cc:1048] T be1a92657f494cac8dd227d152f50151 P 7ba59cc884714e8aa5f3f0ecaed84cbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:19:46.135037  6726 rpcz_store.cc:276] 0709 13:19:45.112747 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:45.112954 (+   207us) service_pool.cc:224] Handling call
0709 13:19:45.138154 (+ 25200us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:45.207690 (+ 69536us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:45.207722 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:45.220616 (+ 12894us) log.cc:844] Serialized 26 byte log entry
0709 13:19:45.696339 (+475723us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:19:45.696398 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:45.696495 (+    97us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:46.132837 (+436342us) raft_consensus.cc:1685] finished
0709 13:19:46.132857 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:46.133613 (+   756us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4158,"raft.queue_time_us":25108,"raft.run_cpu_time_us":201,"raft.run_wall_time_us":22236,"thread_start_us":373399,"threads_started":1,"wal-append.queue_time_us":555448}
I20260709 13:19:46.089598 10178 leader_election.cc:290] T f58dc08b12a2494bb9a1372837970ca2 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:46.096818  6772 leader_election.cc:304] T 853ac0a8cbd64ce99457f170216d4d0f P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
W20260709 13:19:46.143025  6772 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 46319.3us
W20260709 13:19:46.141837  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 46244.8us
W20260709 13:19:46.142838  7468 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.5.126.67:42931 timed out after 3.188s (SENT) [suppressed 10 similar messages]
I20260709 13:19:46.149905  6729 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50004 (request call id 1704) took 1038 ms. Trace:
I20260709 13:19:46.151470  6729 rpcz_store.cc:276] 0709 13:19:45.111550 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:45.113539 (+  1989us) service_pool.cc:224] Handling call
0709 13:19:46.114197 (+1000658us) spinlock_profiling.cc:243] Waited 37.8 ms on lock 0x7b5800000c98. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0c745db1 00007fcc0c885b71 00007fcc0c885a22 00007fcc1579ec09 00007fcc148f8ee0 00007fcc149c20ab 00007fcc149c2131 00007fcc149700a0 00007fcc1496f984 00007fcc0deea6d4 00007fcc0deea662
0709 13:19:46.149783 (+ 35586us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":87054208}
I20260709 13:19:46.112632  6724 raft_consensus.cc:606] T 3fa34c08b205435dba97346991aa1f92 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 10 LEADER]: Received request to transfer leadership to TS cd75a17ab2604397adab03bb8b5fd75c
W20260709 13:19:46.106201 10191 log.cc:927] Time spent T de3186201e1a40d0b335eeb8b4e256e0 P b7ab4784c7344b939bc36f639286f377: Append to log took a long time: real 0.083s	user 0.000s	sys 0.001s
W20260709 13:19:46.150048  6847 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:46.070756  6697 leader_election.cc:304] T 713b5728a197487c9300b310ab94e5a3 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377
I20260709 13:19:46.124742  6799 rpcz_store.cc:276] 0709 13:19:44.734828 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:44.742625 (+  7797us) service_pool.cc:224] Handling call
0709 13:19:44.785651 (+ 43026us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:45.045553 (+259902us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:19:45.045598 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:45.108374 (+ 62776us) log.cc:844] Serialized 26 byte log entry
0709 13:19:45.492661 (+384287us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:19:45.492724 (+    63us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:45.492838 (+   114us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:46.073884 (+581046us) spinlock_profiling.cc:243] Waited 19.1 ms on lock 0x7b4400022b4c. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0c745db1 00007fcc0c7e3c85 00007fcc0c7e46a2 00007fcc0f5561db 00007fcc0f551aaf 00007fcc0f54586e 00007fcc0f544bb6 00007fcc0f5447d8 00007fcc0f54e221 00007fcc0f54e1d9 00007fcc0f54e169
0709 13:19:46.116868 (+ 42984us) raft_consensus.cc:1685] finished
0709 13:19:46.116939 (+    71us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:46.117258 (+   319us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5054,"raft.queue_time_us":130523,"raft.run_cpu_time_us":158,"raft.run_wall_time_us":8887,"spinlock_wait_cycles":44018048,"thread_start_us":530093,"threads_started":2,"wal-append.queue_time_us":456192}
W20260709 13:19:46.098783  6846 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:46.111594 10030 raft_consensus.cc:3060] T a3022224cc81473690653a83d4e99470 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:19:46.160342  6697 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 89666.8us
I20260709 13:19:46.099722 10184 raft_consensus.cc:493] T d8292e16e5654be6bc408560cf256aaa P cd75a17ab2604397adab03bb8b5fd75c [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:19:46.170334  6697 leader_election.cc:304] T 7c44c4849aa54f2b94d1f1bef9ed546f P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377
W20260709 13:19:46.157904 10160 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.559s	user 0.003s	sys 0.006s
I20260709 13:19:46.175335  6697 leader_election.cc:304] T 22ccee1b570c4ad3a57bd7aec085b1b4 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:19:46.149919  9999 consensus_queue.cc:1059] T 7a734b5ab7834e05a8c422208acc58b1 P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.028s
W20260709 13:19:46.178153 10160 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.579s	user 0.004s	sys 0.006s
I20260709 13:19:46.180279 10045 raft_consensus.cc:2804] T 7c44c4849aa54f2b94d1f1bef9ed546f P ccd8a4c3bfe3413cb2ae219b09aea832 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:19:46.180855 10045 raft_consensus.cc:493] T 7c44c4849aa54f2b94d1f1bef9ed546f P ccd8a4c3bfe3413cb2ae219b09aea832 [term 10 FOLLOWER]: Starting leader election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:19:46.181293 10045 raft_consensus.cc:3060] T 7c44c4849aa54f2b94d1f1bef9ed546f P ccd8a4c3bfe3413cb2ae219b09aea832 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:46.099872  9450 raft_consensus.cc:515] T a1704639a875409b9959353527b3fd68 P b7ab4784c7344b939bc36f639286f377 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:46.184569  9450 leader_election.cc:290] T a1704639a875409b9959353527b3fd68 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:46.185920  7498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3d8792045a4583ae2e965b1350a5b4" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:19:46.186262  7495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb7fa124c3bf4ef9ab65a407cb008441" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
W20260709 13:19:46.179164  7494 consensus_meta.cc:287] T 17587d6730594da4a56fa13a353232a1 P 7ba59cc884714e8aa5f3f0ecaed84cbb: Time spent flushing consensus metadata: real 0.501s	user 0.011s	sys 0.004s
I20260709 13:19:46.178187  9999 consensus_queue.cc:1243] T 7a734b5ab7834e05a8c422208acc58b1 P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Peer b7ab4784c7344b939bc36f639286f377 log is divergent from this leader: its last log entry 9.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 13:19:46.186694  7498 raft_consensus.cc:2468] T bb3d8792045a4583ae2e965b1350a5b4 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 7.
I20260709 13:19:46.187381  7494 raft_consensus.cc:2468] T 17587d6730594da4a56fa13a353232a1 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 12.
I20260709 13:19:46.187599  9999 raft_consensus.cc:3055] T 7a734b5ab7834e05a8c422208acc58b1 P cd75a17ab2604397adab03bb8b5fd75c [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:19:46.186553 10184 raft_consensus.cc:515] T d8292e16e5654be6bc408560cf256aaa P cd75a17ab2604397adab03bb8b5fd75c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:46.188086  9999 raft_consensus.cc:740] T 7a734b5ab7834e05a8c422208acc58b1 P cd75a17ab2604397adab03bb8b5fd75c [term 8 LEADER]: Becoming Follower/Learner. State: Replica: cd75a17ab2604397adab03bb8b5fd75c, State: Running, Role: LEADER
I20260709 13:19:46.188211  6844 leader_election.cc:304] T 4275cf08e63345f993bce8664eada830 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:19:46.188946  7495 raft_consensus.cc:2468] T bb7fa124c3bf4ef9ab65a407cb008441 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 8.
W20260709 13:19:46.192978  6845 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:46.189306  9999 consensus_queue.cc:260] T 7a734b5ab7834e05a8c422208acc58b1 P cd75a17ab2604397adab03bb8b5fd75c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 8.4, Last appended by leader: 4, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:46.195255  9999 raft_consensus.cc:3060] T 7a734b5ab7834e05a8c422208acc58b1 P cd75a17ab2604397adab03bb8b5fd75c [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:46.189678  9875 raft_consensus.cc:2749] T 22ccee1b570c4ad3a57bd7aec085b1b4 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:19:46.197659  6806 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:32976 (request call id 2507) took 1067 ms. Trace:
I20260709 13:19:46.178709  9890 raft_consensus.cc:2804] T 713b5728a197487c9300b310ab94e5a3 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:19:46.204398  9890 raft_consensus.cc:493] T 713b5728a197487c9300b310ab94e5a3 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 9 FOLLOWER]: Starting leader election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:19:46.204926  9890 raft_consensus.cc:3060] T 713b5728a197487c9300b310ab94e5a3 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:19:46.206399 10177 log.cc:927] Time spent T 44bde925b2e541b69890d70715b85176 P b7ab4784c7344b939bc36f639286f377: Append to log took a long time: real 0.588s	user 0.002s	sys 0.000s
I20260709 13:19:46.208777  6881 raft_consensus.cc:1275] T 7c44c4849aa54f2b94d1f1bef9ed546f P cd75a17ab2604397adab03bb8b5fd75c [term 10 FOLLOWER]: Refusing update from remote peer b7ab4784c7344b939bc36f639286f377: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 13:19:46.146462  9852 raft_consensus.cc:2749] T 853ac0a8cbd64ce99457f170216d4d0f P b7ab4784c7344b939bc36f639286f377 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:19:46.210191  6881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e31b9971c15848dea59d4d4130141d9e" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:19:46.212132  6878 raft_consensus.cc:3060] T 95a75bfe094d4bdc963aba3f08dfcd25 P cd75a17ab2604397adab03bb8b5fd75c [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:19:46.212823 10192 log.cc:927] Time spent T 00000000000000000000000000000000 P b3ae52d33b9a4273a42e5e2cf3b5d6b5: Append to log took a long time: real 0.182s	user 0.000s	sys 0.001s
I20260709 13:19:46.216097  6876 raft_consensus.cc:1240] T 427c124d773f483294511e80fe340075 P cd75a17ab2604397adab03bb8b5fd75c [term 8 FOLLOWER]: Rejecting Update request from peer b7ab4784c7344b939bc36f639286f377 for earlier term 7. Current term is 8. Ops: []
I20260709 13:19:46.216781  6873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b56bf91d90824c959e21e0cee5ba1816" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:19:46.197666 10182 raft_consensus.cc:3060] T 4275cf08e63345f993bce8664eada830 P cd75a17ab2604397adab03bb8b5fd75c [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:46.218297  9893 raft_consensus.cc:493] T 1528ab62b6fe4e3099d08f141afee116 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 8 FOLLOWER]: Starting leader election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:19:46.218896  9893 raft_consensus.cc:3060] T 1528ab62b6fe4e3099d08f141afee116 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:46.153558 10178 raft_consensus.cc:493] T 4275cf08e63345f993bce8664eada830 P b7ab4784c7344b939bc36f639286f377 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:46.220161 10178 raft_consensus.cc:515] T 4275cf08e63345f993bce8664eada830 P b7ab4784c7344b939bc36f639286f377 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:46.204923  6614 catalog_manager.cc:5028] TS b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817): tablet 24ee15416e3145beaa1b8183453729a3 (table test-workload [id=04f4d366747e43549980077479ed75b9]) successfully deleted
I20260709 13:19:46.189757 10184 leader_election.cc:290] T d8292e16e5654be6bc408560cf256aaa P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:19:46.191200  6846 leader_election.cc:304] T bb3d8792045a4583ae2e965b1350a5b4 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:19:46.222440 10178 leader_election.cc:290] T 4275cf08e63345f993bce8664eada830 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
W20260709 13:19:46.223220  6698 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:46.223718  6846 leader_election.cc:304] T bb7fa124c3bf4ef9ab65a407cb008441 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:19:46.224656 10184 raft_consensus.cc:2804] T bb7fa124c3bf4ef9ab65a407cb008441 P cd75a17ab2604397adab03bb8b5fd75c [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:19:46.225036 10184 raft_consensus.cc:493] T bb7fa124c3bf4ef9ab65a407cb008441 P cd75a17ab2604397adab03bb8b5fd75c [term 8 FOLLOWER]: Starting leader election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:19:46.225381 10184 raft_consensus.cc:3060] T bb7fa124c3bf4ef9ab65a407cb008441 P cd75a17ab2604397adab03bb8b5fd75c [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:46.226325 10045 raft_consensus.cc:515] T 7c44c4849aa54f2b94d1f1bef9ed546f P ccd8a4c3bfe3413cb2ae219b09aea832 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:46.232687 10032 leader_election.cc:290] T ab432e62819d499eaaf3dd55481dd930 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:46.233659  6725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f9c2e2bf644115957398fe4c9459db" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:19:46.234196 10115 raft_consensus.cc:3055] T d8cee0accdb8499c86d4414b72565a38 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:19:46.234596 10115 raft_consensus.cc:740] T d8cee0accdb8499c86d4414b72565a38 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 7ba59cc884714e8aa5f3f0ecaed84cbb, State: Running, Role: LEADER
W20260709 13:19:46.203789 10188 log.cc:927] Time spent T 22ccee1b570c4ad3a57bd7aec085b1b4 P ccd8a4c3bfe3413cb2ae219b09aea832: Append to log took a long time: real 0.179s	user 0.002s	sys 0.001s
I20260709 13:19:46.236938 10115 consensus_queue.cc:260] T d8cee0accdb8499c86d4414b72565a38 P 7ba59cc884714e8aa5f3f0ecaed84cbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:19:46.198276  6806 rpcz_store.cc:276] 0709 13:19:45.135320 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:45.619628 (+484308us) service_pool.cc:224] Handling call
0709 13:19:45.619940 (+   312us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:45.635336 (+ 15396us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:45.635396 (+    60us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:45.635439 (+    43us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:19:45.635470 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:46.197390 (+561920us) spinlock_profiling.cc:243] Waited 15.2 ms on lock 0x7b54002891d4. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f9aae01 00007fcc0f9a983e 00007fcc1496e419 00007fcc0dee5bd4 00007fcc0dee5b62 00007fcc0dee5a91 00007fcc0dee5a0c 00007fcc0dee4cc2 00007fcc0dce548c 00007fcc0dce48c6
0709 13:19:46.197445 (+    55us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:46.197583 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":34913152}
I20260709 13:19:46.238773  6723 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50004 (request call id 1706) took 1126 ms. Trace:
I20260709 13:19:46.239565 10115 raft_consensus.cc:3060] T d8cee0accdb8499c86d4414b72565a38 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:46.239480  6723 rpcz_store.cc:276] 0709 13:19:45.112345 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:45.130941 (+ 18596us) service_pool.cc:224] Handling call
0709 13:19:45.380402 (+249461us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:19:45.395481 (+ 15079us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:45.395540 (+    59us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:19:45.479732 (+ 84192us) log.cc:844] Serialized 52 byte log entry
0709 13:19:45.848114 (+368382us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:19:45.848178 (+    64us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:45.848296 (+   118us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:46.202969 (+354673us) spinlock_profiling.cc:243] Waited 955 us on lock 0x7b4400022b4c. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0c745db1 00007fcc0c7e3c85 00007fcc0c7e46a2 00007fcc0f5561db 00007fcc0f551aaf 00007fcc0f54586e 00007fcc0f544bb6 00007fcc0f5447d8 00007fcc0f54e221 00007fcc0f54e1d9 00007fcc0f54e169
0709 13:19:46.237992 (+ 35023us) raft_consensus.cc:1685] finished
0709 13:19:46.238024 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:46.238494 (+   470us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":125,"raft.run_cpu_time_us":189,"raft.run_wall_time_us":41970,"spinlock_wait_cycles":2220672,"thread_start_us":314879,"threads_started":1,"wal-append.queue_time_us":446950}
I20260709 13:19:46.240609  6724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3d8792045a4583ae2e965b1350a5b4" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:19:46.241761  6872 raft_consensus.cc:1275] T 7a734b5ab7834e05a8c422208acc58b1 P cd75a17ab2604397adab03bb8b5fd75c [term 9 FOLLOWER]: Refusing update from remote peer b7ab4784c7344b939bc36f639286f377: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 9 index: 4. (term mismatch)
I20260709 13:19:46.241981  6724 raft_consensus.cc:2393] T bb3d8792045a4583ae2e965b1350a5b4 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in current term 8: Already voted for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in this term.
I20260709 13:19:46.242168  6872 pending_rounds.cc:85] T 7a734b5ab7834e05a8c422208acc58b1 P cd75a17ab2604397adab03bb8b5fd75c: Aborting all ops after (but not including) 3
I20260709 13:19:46.242401  6872 pending_rounds.cc:107] T 7a734b5ab7834e05a8c422208acc58b1 P cd75a17ab2604397adab03bb8b5fd75c: Aborting uncommitted NO_OP operation due to leader change: 8.4
I20260709 13:19:46.242646  6872 raft_consensus.cc:2889] T 7a734b5ab7834e05a8c422208acc58b1 P cd75a17ab2604397adab03bb8b5fd75c [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:19:46.106453 10189 rpcz_store.cc:276] 0709 13:19:44.917131 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:45.043340 (+126209us) service_pool.cc:224] Handling call
0709 13:19:46.069259 (+1025919us) ts_tablet_manager.cc:1151] Deleting tablet 1528ab62b6fe4e3099d08f141afee116
0709 13:19:46.069399 (+   140us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0709 13:19:46.069747 (+   348us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":467400,"thread_start_us":309365,"threads_started":1}
I20260709 13:19:46.246299  6802 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:32976 (request call id 2503) took 1307 ms. Trace:
I20260709 13:19:46.246941  6616 catalog_manager.cc:5028] TS cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931): tablet 1528ab62b6fe4e3099d08f141afee116 (table test-workload [id=04f4d366747e43549980077479ed75b9]) successfully deleted
I20260709 13:19:46.233093  6729 raft_consensus.cc:1275] T b3f13b31a1f84f0d89d007eadd57924c P ccd8a4c3bfe3413cb2ae219b09aea832 [term 7 FOLLOWER]: Refusing update from remote peer 7ba59cc884714e8aa5f3f0ecaed84cbb: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 7 index: 8. (term mismatch)
I20260709 13:19:46.247524  6729 pending_rounds.cc:85] T b3f13b31a1f84f0d89d007eadd57924c P ccd8a4c3bfe3413cb2ae219b09aea832: Aborting all ops after (but not including) 7
I20260709 13:19:46.247768  6729 pending_rounds.cc:107] T b3f13b31a1f84f0d89d007eadd57924c P ccd8a4c3bfe3413cb2ae219b09aea832: Aborting uncommitted NO_OP operation due to leader change: 6.8
I20260709 13:19:46.248071  6729 raft_consensus.cc:2889] T b3f13b31a1f84f0d89d007eadd57924c P ccd8a4c3bfe3413cb2ae219b09aea832 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:19:46.248634 10153 log.cc:927] Time spent T f5be3a11b23d4ea9b08300a2789821c7 P b7ab4784c7344b939bc36f639286f377: Append to log took a long time: real 0.656s	user 0.003s	sys 0.000s
I20260709 13:19:46.251617  9949 raft_consensus.cc:493] T 17587d6730594da4a56fa13a353232a1 P b7ab4784c7344b939bc36f639286f377 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:46.252436  6800 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:32976 (request call id 2488) took 1421 ms (client timeout 1861 ms). Trace:
I20260709 13:19:46.252609 10160 consensus_queue.cc:1048] T f5be3a11b23d4ea9b08300a2789821c7 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:19:46.234629  6725 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50004 (request call id 1705) took 1122 ms. Trace:
I20260709 13:19:46.191591  6697 leader_election.cc:304] T 7a734b5ab7834e05a8c422208acc58b1 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:19:46.246778  6802 rpcz_store.cc:276] 0709 13:19:44.938455 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:45.595814 (+657359us) service_pool.cc:224] Handling call
0709 13:19:45.596235 (+   421us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:19:45.697266 (+101031us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:45.704729 (+  7463us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:19:45.725276 (+ 20547us) log.cc:844] Serialized 52 byte log entry
0709 13:19:45.992875 (+267599us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:19:45.992953 (+    78us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:46.245257 (+252304us) spinlock_profiling.cc:243] Waited 52 ms on lock 0x7b5400289bd4. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f9aae01 00007fcc0f9a983e 00007fcc1496e419 00007fcc0dee5bd4 00007fcc0dee5b62 00007fcc0dee5a91 00007fcc0dee5a0c 00007fcc0dee4cc2 00007fcc0dce548c 00007fcc0dce48c6
0709 13:19:46.245326 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:46.245408 (+    82us) raft_consensus.cc:1685] finished
0709 13:19:46.245430 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:46.245975 (+   545us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":48564,"raft.queue_time_us":55730,"raft.run_cpu_time_us":191,"raft.run_wall_time_us":20155,"spinlock_wait_cycles":119504256,"thread_start_us":217671,"threads_started":1,"wal-append.queue_time_us":377824}
I20260709 13:19:46.190510  6844 leader_election.cc:304] T 7887766dc6784fcaa42b35c05fea7a99 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:19:46.267203  6723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bf4668eeb70467fb3dc5a0289233b3c" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:19:46.288579  6878 raft_consensus.cc:1275] T 95a75bfe094d4bdc963aba3f08dfcd25 P cd75a17ab2604397adab03bb8b5fd75c [term 10 FOLLOWER]: Refusing update from remote peer b7ab4784c7344b939bc36f639286f377: Log matching property violated. Preceding OpId in replica: term: 7 index: 2. Preceding OpId from leader: term: 10 index: 4. (index mismatch)
W20260709 13:19:46.290346  7468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 147548us
W20260709 13:19:46.265902  6800 rpcz_store.cc:269] 0709 13:19:44.831497 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:44.878893 (+ 47396us) service_pool.cc:224] Handling call
0709 13:19:46.251852 (+1372959us) spinlock_profiling.cc:243] Waited 644 ms on lock 0x7b54003313d4. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f9ae2fa 00007fcc1496fb17 00007fcc0deea6d4 00007fcc0deea662 00007fcc0deea591 00007fcc0deea50c 00007fcc0dee97c2 00007fcc0dce548c 00007fcc0dce48c6 00007fcc0dce426f
0709 13:19:46.252327 (+   475us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1481490304}
I20260709 13:19:46.293211  6880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d65025eea89441290d85dd053810e31" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
W20260709 13:19:46.293949  6845 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:46.296564  6723 raft_consensus.cc:3060] T 1bf4668eeb70467fb3dc5a0289233b3c P ccd8a4c3bfe3413cb2ae219b09aea832 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:46.297627  6725 rpcz_store.cc:276] 0709 13:19:45.111939 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:45.130768 (+ 18829us) service_pool.cc:224] Handling call
0709 13:19:46.233440 (+1102672us) spinlock_profiling.cc:243] Waited 37.7 ms on lock 0x7b5800000c98. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0c745db1 00007fcc0c885b71 00007fcc0c885a22 00007fcc1579ec09 00007fcc148f8ee0 00007fcc149c20ab 00007fcc149c2131 00007fcc149700a0 00007fcc1496f984 00007fcc0deea6d4 00007fcc0deea662
0709 13:19:46.234559 (+  1119us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":86685312}
I20260709 13:19:46.307904  6880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f9c2e2bf644115957398fe4c9459db" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:19:46.308679  6873 raft_consensus.cc:1275] T 22ccee1b570c4ad3a57bd7aec085b1b4 P cd75a17ab2604397adab03bb8b5fd75c [term 8 FOLLOWER]: Refusing update from remote peer b7ab4784c7344b939bc36f639286f377: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:19:46.310302  6876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbdf895bba214ff68685a24fd17dfb5d" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
W20260709 13:19:46.311594  6697 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 120126us
I20260709 13:19:46.313886  6729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30e88460611e47b2ba16a46a30b5f416" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 9 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:19:46.322571  6729 raft_consensus.cc:2410] T 30e88460611e47b2ba16a46a30b5f416 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7ab4784c7344b939bc36f639286f377 for term 9 because replica has last-logged OpId of term: 7 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:19:46.314924  6881 raft_consensus.cc:3055] T d33d5ee8ef6f415593d8df52063161ad P cd75a17ab2604397adab03bb8b5fd75c [term 9 LEADER]: Stepping down as leader of term 9
W20260709 13:19:46.275601 10123 consensus_meta.cc:287] T be1a92657f494cac8dd227d152f50151 P ccd8a4c3bfe3413cb2ae219b09aea832: Time spent flushing consensus metadata: real 0.579s	user 0.012s	sys 0.003s
I20260709 13:19:46.175477 10187 leader_election.cc:290] T bb3d8792045a4583ae2e965b1350a5b4 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:19:46.233018 10045 leader_election.cc:290] T 7c44c4849aa54f2b94d1f1bef9ed546f P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 11 election: Requested vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:46.257148  9999 raft_consensus.cc:2804] T bb3d8792045a4583ae2e965b1350a5b4 P cd75a17ab2604397adab03bb8b5fd75c [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:19:46.323267  6881 raft_consensus.cc:740] T d33d5ee8ef6f415593d8df52063161ad P cd75a17ab2604397adab03bb8b5fd75c [term 9 LEADER]: Becoming Follower/Learner. State: Replica: cd75a17ab2604397adab03bb8b5fd75c, State: Running, Role: LEADER
I20260709 13:19:46.328688  6878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8cee0accdb8499c86d4414b72565a38" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
W20260709 13:19:46.325831  6772 connection.cc:256] RPC call timeout handler was delayed by -1.7527546670000902s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1876s for a response
W20260709 13:19:46.339090  6772 connection.cc:256] RPC call timeout handler was delayed by -1.4593546670000705s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2202s for a response
W20260709 13:19:46.339535  6772 connection.cc:256] RPC call timeout handler was delayed by -1.3369546670001s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2338s for a response
I20260709 13:19:46.340132  6726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e31b9971c15848dea59d4d4130141d9e" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:19:46.338519  6878 raft_consensus.cc:3060] T d8cee0accdb8499c86d4414b72565a38 P cd75a17ab2604397adab03bb8b5fd75c [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:46.340901  6726 raft_consensus.cc:3060] T e31b9971c15848dea59d4d4130141d9e P ccd8a4c3bfe3413cb2ae219b09aea832 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:46.331863  6880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30e88460611e47b2ba16a46a30b5f416" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 9 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:19:46.344504  6880 raft_consensus.cc:2410] T 30e88460611e47b2ba16a46a30b5f416 P cd75a17ab2604397adab03bb8b5fd75c [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7ab4784c7344b939bc36f639286f377 for term 9 because replica has last-logged OpId of term: 7 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
W20260709 13:19:46.332482  6773 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:46.334084  6873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bf4668eeb70467fb3dc5a0289233b3c" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:19:46.324714  6697 leader_election.cc:304] T 30e88460611e47b2ba16a46a30b5f416 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:19:46.345374  6873 raft_consensus.cc:3060] T 1bf4668eeb70467fb3dc5a0289233b3c P cd75a17ab2604397adab03bb8b5fd75c [term 7 FOLLOWER]: Advancing to term 9
I20260709 13:19:46.346010  6697 leader_election.cc:304] T 1bf4668eeb70467fb3dc5a0289233b3c P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377
I20260709 13:19:46.273893 10172 consensus_queue.cc:1048] T b3f13b31a1f84f0d89d007eadd57924c P 7ba59cc884714e8aa5f3f0ecaed84cbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.064s
I20260709 13:19:46.343242  6881 consensus_queue.cc:260] T d33d5ee8ef6f415593d8df52063161ad P cd75a17ab2604397adab03bb8b5fd75c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:46.351934  6876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de3186201e1a40d0b335eeb8b4e256e0" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:19:46.352483  6881 raft_consensus.cc:3060] T d33d5ee8ef6f415593d8df52063161ad P cd75a17ab2604397adab03bb8b5fd75c [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:46.352708  6876 raft_consensus.cc:2468] T de3186201e1a40d0b335eeb8b4e256e0 P cd75a17ab2604397adab03bb8b5fd75c [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 9.
I20260709 13:19:46.312888 10178 raft_consensus.cc:493] T 90d42e216d9741e190bca19a781291fd P b7ab4784c7344b939bc36f639286f377 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:46.313136  9875 raft_consensus.cc:2749] T 7a734b5ab7834e05a8c422208acc58b1 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:19:46.349223  6732 raft_consensus.cc:1275] T be1a92657f494cac8dd227d152f50151 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 11 FOLLOWER]: Refusing update from remote peer 7ba59cc884714e8aa5f3f0ecaed84cbb: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 9. (term mismatch)
I20260709 13:19:46.358762  6732 pending_rounds.cc:85] T be1a92657f494cac8dd227d152f50151 P ccd8a4c3bfe3413cb2ae219b09aea832: Aborting all ops after (but not including) 8
I20260709 13:19:46.359117  6732 pending_rounds.cc:107] T be1a92657f494cac8dd227d152f50151 P ccd8a4c3bfe3413cb2ae219b09aea832: Aborting uncommitted NO_OP operation due to leader change: 10.9
I20260709 13:19:46.359346  6732 raft_consensus.cc:2889] T be1a92657f494cac8dd227d152f50151 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:19:46.349859  6725 raft_consensus.cc:1275] T 711ef6523deb4cbe8ef2ba61e1c21c98 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 10 FOLLOWER]: Refusing update from remote peer b7ab4784c7344b939bc36f639286f377: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:19:46.349934  6729 raft_consensus.cc:1275] T e77e330a82df4b43a745d57a68f6f057 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 11 FOLLOWER]: Refusing update from remote peer b7ab4784c7344b939bc36f639286f377: Log matching property violated. Preceding OpId in replica: term: 9 index: 4. Preceding OpId from leader: term: 11 index: 5. (index mismatch)
I20260709 13:19:46.342780 10187 raft_consensus.cc:2764] T 7887766dc6784fcaa42b35c05fea7a99 P cd75a17ab2604397adab03bb8b5fd75c [term 9 FOLLOWER]: Leader pre-election decision vote started in defunct term 8: won
I20260709 13:19:46.357324  6772 leader_election.cc:304] T 4f00a2e87e56452083b759f60d461ee3 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:19:46.337111 10157 raft_consensus.cc:493] T 7887766dc6784fcaa42b35c05fea7a99 P b7ab4784c7344b939bc36f639286f377 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:46.363571  6727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de3186201e1a40d0b335eeb8b4e256e0" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
W20260709 13:19:46.359752  7468 leader_election.cc:336] T 4f00a2e87e56452083b759f60d461ee3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931): Timed out: RequestConsensusVote RPC to 127.5.126.67:42931 timed out after 2.466s (SENT)
I20260709 13:19:46.369146  7468 leader_election.cc:304] T 4f00a2e87e56452083b759f60d461ee3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:19:46.364607  6880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b3759de40694069b13c0f8bd40e5709" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:19:46.289238  9949 raft_consensus.cc:515] T 17587d6730594da4a56fa13a353232a1 P b7ab4784c7344b939bc36f639286f377 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:19:46.340406  9999 raft_consensus.cc:493] T bb3d8792045a4583ae2e965b1350a5b4 P cd75a17ab2604397adab03bb8b5fd75c [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:46.343468  7494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8cee0accdb8499c86d4414b72565a38" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb"
I20260709 13:19:46.410027  7498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce4f062dcd314d43a63ca74067cb5ee3" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:19:46.386797  6872 raft_consensus.cc:1275] T 711ef6523deb4cbe8ef2ba61e1c21c98 P cd75a17ab2604397adab03bb8b5fd75c [term 10 FOLLOWER]: Refusing update from remote peer b7ab4784c7344b939bc36f639286f377: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:19:46.431242  7498 raft_consensus.cc:2468] T ce4f062dcd314d43a63ca74067cb5ee3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 8.
I20260709 13:19:46.382666 10111 leader_election.cc:290] T e31b9971c15848dea59d4d4130141d9e P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 7 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:46.373705  9999 raft_consensus.cc:3060] T bb3d8792045a4583ae2e965b1350a5b4 P cd75a17ab2604397adab03bb8b5fd75c [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:46.377391 10102 raft_consensus.cc:2749] T 4f00a2e87e56452083b759f60d461ee3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:19:46.365186 10184 raft_consensus.cc:515] T bb7fa124c3bf4ef9ab65a407cb008441 P cd75a17ab2604397adab03bb8b5fd75c [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:19:46.394224 10004 raft_consensus.cc:3060] T fe20b4b48823486ca3b9c648db6ce8aa P ccd8a4c3bfe3413cb2ae219b09aea832 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:46.410349  6875 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53416 (request call id 2592) took 1168 ms. Trace:
W20260709 13:19:46.415345  6845 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:46.411670  9836 raft_consensus.cc:515] T 20f6842e26174571996b8dea4151d4be P b7ab4784c7344b939bc36f639286f377 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:46.376523  6876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a485a995abc4807b6e511e45419f737" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:19:46.444875  6881 raft_consensus.cc:1275] T d33d5ee8ef6f415593d8df52063161ad P cd75a17ab2604397adab03bb8b5fd75c [term 10 FOLLOWER]: Refusing update from remote peer b7ab4784c7344b939bc36f639286f377: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 6. (term mismatch)
I20260709 13:19:46.445734  6881 pending_rounds.cc:85] T d33d5ee8ef6f415593d8df52063161ad P cd75a17ab2604397adab03bb8b5fd75c: Aborting all ops after (but not including) 5
I20260709 13:19:46.358090 10164 raft_consensus.cc:2804] T 30e88460611e47b2ba16a46a30b5f416 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:19:46.366446  6729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f58dc08b12a2494bb9a1372837970ca2" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:19:46.367604 10045 consensus_queue.cc:1048] T 7887766dc6784fcaa42b35c05fea7a99 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.016s
I20260709 13:19:46.419245  6880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce4f062dcd314d43a63ca74067cb5ee3" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:19:46.445963  6881 pending_rounds.cc:107] T d33d5ee8ef6f415593d8df52063161ad P cd75a17ab2604397adab03bb8b5fd75c: Aborting uncommitted NO_OP operation due to leader change: 9.6
I20260709 13:19:46.446661  6880 raft_consensus.cc:2468] T ce4f062dcd314d43a63ca74067cb5ee3 P cd75a17ab2604397adab03bb8b5fd75c [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 8.
I20260709 13:19:46.447813  6880 raft_consensus.cc:3055] T f5be3a11b23d4ea9b08300a2789821c7 P cd75a17ab2604397adab03bb8b5fd75c [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:19:46.419909  6725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8292e16e5654be6bc408560cf256aaa" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:19:46.364343 10031 raft_consensus.cc:493] T 24ee15416e3145beaa1b8183453729a3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:46.423306  6727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1704639a875409b9959353527b3fd68" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:19:46.450259  6727 raft_consensus.cc:2468] T a1704639a875409b9959353527b3fd68 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 9.
I20260709 13:19:46.448853  6725 raft_consensus.cc:2468] T d8292e16e5654be6bc408560cf256aaa P ccd8a4c3bfe3413cb2ae219b09aea832 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 11.
I20260709 13:19:46.430200  6878 raft_consensus.cc:2468] T d8cee0accdb8499c86d4414b72565a38 P cd75a17ab2604397adab03bb8b5fd75c [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 9.
I20260709 13:19:46.443161  6875 rpcz_store.cc:276] 0709 13:19:45.242259 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:45.345902 (+103643us) service_pool.cc:224] Handling call
0709 13:19:45.394874 (+ 48972us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:45.741693 (+346819us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:45.741721 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:45.766145 (+ 24424us) log.cc:844] Serialized 26 byte log entry
0709 13:19:45.998851 (+232706us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:19:45.998896 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:45.998967 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:46.410091 (+411124us) raft_consensus.cc:1685] finished
0709 13:19:46.410114 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:46.410281 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":58833,"raft.queue_time_us":172293,"raft.run_cpu_time_us":101,"raft.run_wall_time_us":101,"thread_start_us":453351,"threads_started":2,"wal-append.queue_time_us":552836}
I20260709 13:19:46.407130  6726 raft_consensus.cc:2468] T e31b9971c15848dea59d4d4130141d9e P ccd8a4c3bfe3413cb2ae219b09aea832 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 7.
W20260709 13:19:46.434214  7468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 83582.5us
W20260709 13:19:46.436729  6772 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.68:45071, user_credentials={real_user=slave}} blocked reactor thread for 79479.8us
I20260709 13:19:46.438678  6872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8292e16e5654be6bc408560cf256aaa" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:19:46.448269  6880 raft_consensus.cc:740] T f5be3a11b23d4ea9b08300a2789821c7 P cd75a17ab2604397adab03bb8b5fd75c [term 6 LEADER]: Becoming Follower/Learner. State: Replica: cd75a17ab2604397adab03bb8b5fd75c, State: Running, Role: LEADER
I20260709 13:19:46.453930  6881 raft_consensus.cc:2889] T d33d5ee8ef6f415593d8df52063161ad P cd75a17ab2604397adab03bb8b5fd75c [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:19:46.454111  6872 raft_consensus.cc:2468] T d8292e16e5654be6bc408560cf256aaa P cd75a17ab2604397adab03bb8b5fd75c [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 10.
I20260709 13:19:46.435981  9849 raft_consensus.cc:2749] T 4f00a2e87e56452083b759f60d461ee3 P b7ab4784c7344b939bc36f639286f377 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:19:46.461699  6876 raft_consensus.cc:1275] T e77e330a82df4b43a745d57a68f6f057 P cd75a17ab2604397adab03bb8b5fd75c [term 11 FOLLOWER]: Refusing update from remote peer b7ab4784c7344b939bc36f639286f377: Log matching property violated. Preceding OpId in replica: term: 9 index: 4. Preceding OpId from leader: term: 11 index: 5. (index mismatch)
I20260709 13:19:46.369047 10178 raft_consensus.cc:515] T 90d42e216d9741e190bca19a781291fd P b7ab4784c7344b939bc36f639286f377 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:46.375069 10157 raft_consensus.cc:515] T 7887766dc6784fcaa42b35c05fea7a99 P b7ab4784c7344b939bc36f639286f377 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:46.477479  6872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f58dc08b12a2494bb9a1372837970ca2" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:19:46.478628  6727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce4f062dcd314d43a63ca74067cb5ee3" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:19:46.416114  9933 raft_consensus.cc:515] T 3411566abe2d4c9bb4b2adfdd05e6f17 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:46.479592  6727 raft_consensus.cc:2468] T ce4f062dcd314d43a63ca74067cb5ee3 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 8.
I20260709 13:19:46.480646  6872 raft_consensus.cc:2468] T f58dc08b12a2494bb9a1372837970ca2 P cd75a17ab2604397adab03bb8b5fd75c [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 11.
I20260709 13:19:46.447506 10164 raft_consensus.cc:493] T 30e88460611e47b2ba16a46a30b5f416 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:46.487308  6723 raft_consensus.cc:2468] T 1bf4668eeb70467fb3dc5a0289233b3c P ccd8a4c3bfe3413cb2ae219b09aea832 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 9.
I20260709 13:19:46.475145  6880 consensus_queue.cc:260] T f5be3a11b23d4ea9b08300a2789821c7 P cd75a17ab2604397adab03bb8b5fd75c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
W20260709 13:19:46.488462  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 298035us
I20260709 13:19:46.490056  6725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4275cf08e63345f993bce8664eada830" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:19:46.492347  6725 raft_consensus.cc:2468] T 4275cf08e63345f993bce8664eada830 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 9.
I20260709 13:19:46.458194 10160 raft_consensus.cc:493] T 07a92dd554674067a83a9cb68c4773f2 P b7ab4784c7344b939bc36f639286f377 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
W20260709 13:19:46.495102  6697 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 144701us
I20260709 13:19:46.496687  6727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a485a995abc4807b6e511e45419f737" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:19:46.503260  6728 raft_consensus.cc:1240] T 3411566abe2d4c9bb4b2adfdd05e6f17 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 7 FOLLOWER]: Rejecting Update request from peer b7ab4784c7344b939bc36f639286f377 for earlier term 6. Current term is 7. Ops: []
I20260709 13:19:46.508415  6697 leader_election.cc:304] T 3d65025eea89441290d85dd053810e31 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:19:46.514089  6806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce4f062dcd314d43a63ca74067cb5ee3" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:19:46.514832  6806 raft_consensus.cc:2468] T ce4f062dcd314d43a63ca74067cb5ee3 P b7ab4784c7344b939bc36f639286f377 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 8.
I20260709 13:19:46.508224  6727 raft_consensus.cc:1240] T 7c44c4849aa54f2b94d1f1bef9ed546f P ccd8a4c3bfe3413cb2ae219b09aea832 [term 11 FOLLOWER]: Rejecting Update request from peer b7ab4784c7344b939bc36f639286f377 for earlier term 10. Current term is 11. Ops: []
I20260709 13:19:46.488240 10164 raft_consensus.cc:3060] T 30e88460611e47b2ba16a46a30b5f416 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:46.523392  6770 leader_election.cc:304] T a1704639a875409b9959353527b3fd68 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
I20260709 13:19:46.525825  6806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c44c4849aa54f2b94d1f1bef9ed546f" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:19:46.527751  6695 leader_election.cc:304] T f09c2a98de1a4decabd0ff900dd44caa P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
I20260709 13:19:46.493559 10123 raft_consensus.cc:2764] T 1bf4668eeb70467fb3dc5a0289233b3c P ccd8a4c3bfe3413cb2ae219b09aea832 [term 9 FOLLOWER]: Leader pre-election decision vote started in defunct term 8: won
I20260709 13:19:46.458547 10031 raft_consensus.cc:515] T 24ee15416e3145beaa1b8183453729a3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:19:46.532559  6801 raft_consensus.cc:1240] T 20f6842e26174571996b8dea4151d4be P b7ab4784c7344b939bc36f639286f377 [term 10 FOLLOWER]: Rejecting Update request from peer ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 9. Current term is 10. Ops: [7.5-9.6]
I20260709 13:19:46.534683  6799 raft_consensus.cc:1275] T 9e326172347f45e99a0d482b5d8ef768 P b7ab4784c7344b939bc36f639286f377 [term 8 FOLLOWER]: Refusing update from remote peer ccd8a4c3bfe3413cb2ae219b09aea832: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 8 index: 4. (index mismatch)
I20260709 13:19:46.541811  6807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab432e62819d499eaaf3dd55481dd930" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:19:46.552291  6881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1704639a875409b9959353527b3fd68" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:19:46.553187  6881 raft_consensus.cc:2468] T a1704639a875409b9959353527b3fd68 P cd75a17ab2604397adab03bb8b5fd75c [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 9.
I20260709 13:19:46.545712  6770 leader_election.cc:304] T d8292e16e5654be6bc408560cf256aaa P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
I20260709 13:19:46.555838  6770 leader_election.cc:304] T e31b9971c15848dea59d4d4130141d9e P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
I20260709 13:19:46.520449  9875 raft_consensus.cc:2749] T 3d65025eea89441290d85dd053810e31 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:19:46.559001  6880 raft_consensus.cc:3060] T f5be3a11b23d4ea9b08300a2789821c7 P cd75a17ab2604397adab03bb8b5fd75c [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:46.520816 10182 raft_consensus.cc:2749] T 4275cf08e63345f993bce8664eada830 P cd75a17ab2604397adab03bb8b5fd75c [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:19:46.539542 10161 log.cc:927] Time spent T 7c37d41cd9164c15a6826ca62a851a69 P ccd8a4c3bfe3413cb2ae219b09aea832: Append to log took a long time: real 1.119s	user 0.005s	sys 0.001s
I20260709 13:19:46.564939  6770 leader_election.cc:304] T 1bf4668eeb70467fb3dc5a0289233b3c P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
I20260709 13:19:46.525441  9657 raft_consensus.cc:493] T 95a75bfe094d4bdc963aba3f08dfcd25 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:19:46.579126  6844 leader_election.cc:304] T d8cee0accdb8499c86d4414b72565a38 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, b7ab4784c7344b939bc36f639286f377
I20260709 13:19:46.584476 10184 leader_election.cc:290] T bb7fa124c3bf4ef9ab65a407cb008441 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 9 election: Requested vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:19:46.584846 10157 leader_election.cc:290] T 7887766dc6784fcaa42b35c05fea7a99 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:46.510821 10160 raft_consensus.cc:515] T 07a92dd554674067a83a9cb68c4773f2 P b7ab4784c7344b939bc36f639286f377 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
W20260709 13:19:46.586830  6697 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 62537.2us
I20260709 13:19:46.525534 10111 consensus_queue.cc:1048] T 711ef6523deb4cbe8ef2ba61e1c21c98 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.044s
I20260709 13:19:46.590006  6873 raft_consensus.cc:2468] T 1bf4668eeb70467fb3dc5a0289233b3c P cd75a17ab2604397adab03bb8b5fd75c [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 9.
I20260709 13:19:46.559264  9864 raft_consensus.cc:2804] T a1704639a875409b9959353527b3fd68 P b7ab4784c7344b939bc36f639286f377 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:19:46.528086  9450 consensus_queue.cc:1048] T e77e330a82df4b43a745d57a68f6f057 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.050s
I20260709 13:19:46.568992 10063 raft_consensus.cc:2804] T e31b9971c15848dea59d4d4130141d9e P b7ab4784c7344b939bc36f639286f377 [term 7 FOLLOWER]: Leader election won for term 7
W20260709 13:19:46.601873  6772 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.68:45071, user_credentials={real_user=slave}} blocked reactor thread for 69415.6us
I20260709 13:19:46.566587  9849 raft_consensus.cc:2804] T d8292e16e5654be6bc408560cf256aaa P b7ab4784c7344b939bc36f639286f377 [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 13:19:46.604274  6846 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:46.632597  6846 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:46.690852  6845 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:46.609722  6770 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 44857.8us
W20260709 13:19:46.914551  6846 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:46.651154 10161 log.cc:927] Time spent T 7c37d41cd9164c15a6826ca62a851a69 P ccd8a4c3bfe3413cb2ae219b09aea832: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
W20260709 13:19:46.740753  7466 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:46.636082  9949 leader_election.cc:290] T 17587d6730594da4a56fa13a353232a1 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
W20260709 13:19:46.747495  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 177038us
W20260709 13:19:46.748641 10208 log.cc:927] Time spent T f4b8bd455d5a47c18a1380839c6e0d61 P cd75a17ab2604397adab03bb8b5fd75c: Append to log took a long time: real 0.249s	user 0.000s	sys 0.001s
W20260709 13:19:46.750442 10214 log.cc:927] Time spent T be1a92657f494cac8dd227d152f50151 P b7ab4784c7344b939bc36f639286f377: Append to log took a long time: real 0.171s	user 0.000s	sys 0.000s
W20260709 13:19:46.759485 10216 log.cc:927] Time spent T 7c44c4849aa54f2b94d1f1bef9ed546f P b7ab4784c7344b939bc36f639286f377: Append to log took a long time: real 0.181s	user 0.000s	sys 0.001s
I20260709 13:19:46.655084 10063 raft_consensus.cc:697] T e31b9971c15848dea59d4d4130141d9e P b7ab4784c7344b939bc36f639286f377 [term 7 LEADER]: Becoming Leader. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
I20260709 13:19:46.956259 10032 raft_consensus.cc:993] T 3fa34c08b205435dba97346991aa1f92 P ccd8a4c3bfe3413cb2ae219b09aea832: : Instructing follower cd75a17ab2604397adab03bb8b5fd75c to start an election
I20260709 13:19:46.957312 10063 consensus_queue.cc:237] T e31b9971c15848dea59d4d4130141d9e P b7ab4784c7344b939bc36f639286f377 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:46.958724 10032 raft_consensus.cc:1081] T 3fa34c08b205435dba97346991aa1f92 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 10 LEADER]: Signalling peer cd75a17ab2604397adab03bb8b5fd75c to start an election
I20260709 13:19:46.655901  9852 raft_consensus.cc:2804] T 1bf4668eeb70467fb3dc5a0289233b3c P b7ab4784c7344b939bc36f639286f377 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:19:46.960505  9852 raft_consensus.cc:697] T 1bf4668eeb70467fb3dc5a0289233b3c P b7ab4784c7344b939bc36f639286f377 [term 9 LEADER]: Becoming Leader. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
I20260709 13:19:46.797701 10178 leader_election.cc:290] T 90d42e216d9741e190bca19a781291fd P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:46.587280  9657 raft_consensus.cc:515] T 95a75bfe094d4bdc963aba3f08dfcd25 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:46.656464 10030 raft_consensus.cc:515] T a3022224cc81473690653a83d4e99470 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:46.749086 10157 consensus_queue.cc:1048] T 1528ab62b6fe4e3099d08f141afee116 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:19:46.636154 10182 raft_consensus.cc:2749] T d8cee0accdb8499c86d4414b72565a38 P cd75a17ab2604397adab03bb8b5fd75c [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:19:46.603025  9875 raft_consensus.cc:2804] T f09c2a98de1a4decabd0ff900dd44caa P ccd8a4c3bfe3413cb2ae219b09aea832 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:19:46.630167  9849 raft_consensus.cc:493] T d8292e16e5654be6bc408560cf256aaa P b7ab4784c7344b939bc36f639286f377 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:46.608870  9864 raft_consensus.cc:493] T a1704639a875409b9959353527b3fd68 P b7ab4784c7344b939bc36f639286f377 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:46.855777  6880 raft_consensus.cc:1275] T f5be3a11b23d4ea9b08300a2789821c7 P cd75a17ab2604397adab03bb8b5fd75c [term 7 FOLLOWER]: Refusing update from remote peer b7ab4784c7344b939bc36f639286f377: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 4. (term mismatch)
I20260709 13:19:46.981163  6880 pending_rounds.cc:85] T f5be3a11b23d4ea9b08300a2789821c7 P cd75a17ab2604397adab03bb8b5fd75c: Aborting all ops after (but not including) 3
I20260709 13:19:46.981499  6880 pending_rounds.cc:107] T f5be3a11b23d4ea9b08300a2789821c7 P cd75a17ab2604397adab03bb8b5fd75c: Aborting uncommitted NO_OP operation due to leader change: 6.4
I20260709 13:19:46.981812  6880 raft_consensus.cc:2889] T f5be3a11b23d4ea9b08300a2789821c7 P cd75a17ab2604397adab03bb8b5fd75c [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:19:46.799628  7495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb7fa124c3bf4ef9ab65a407cb008441" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb"
W20260709 13:19:46.866714  9890 consensus_meta.cc:287] T 713b5728a197487c9300b310ab94e5a3 P ccd8a4c3bfe3413cb2ae219b09aea832: Time spent flushing consensus metadata: real 0.661s	user 0.006s	sys 0.006s
I20260709 13:19:46.846900  9933 leader_election.cc:290] T 3411566abe2d4c9bb4b2adfdd05e6f17 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 7 election: Requested vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
W20260709 13:19:46.894140 10211 log.cc:927] Time spent T 90d42e216d9741e190bca19a781291fd P cd75a17ab2604397adab03bb8b5fd75c: Append to log took a long time: real 0.391s	user 0.001s	sys 0.000s
I20260709 13:19:46.896222 10160 leader_election.cc:290] T 07a92dd554674067a83a9cb68c4773f2 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
W20260709 13:19:46.884629  9893 consensus_meta.cc:287] T 1528ab62b6fe4e3099d08f141afee116 P ccd8a4c3bfe3413cb2ae219b09aea832: Time spent flushing consensus metadata: real 0.665s	user 0.002s	sys 0.013s
W20260709 13:19:46.908416  6697 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 320764us
I20260709 13:19:46.996760  6697 leader_election.cc:304] T dbdf895bba214ff68685a24fd17dfb5d P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
W20260709 13:19:46.909260  6695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 381652us
W20260709 13:19:46.911612  6772 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.68:45071, user_credentials={real_user=slave}} blocked reactor thread for 258631us
I20260709 13:19:46.628420 10111 consensus_queue.cc:1243] T 711ef6523deb4cbe8ef2ba61e1c21c98 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Peer ccd8a4c3bfe3413cb2ae219b09aea832 log is divergent from this leader: its last log entry 7.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
W20260709 13:19:46.915252  6845 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:46.919868  6770 leader_election.cc:304] T 4275cf08e63345f993bce8664eada830 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
I20260709 13:19:46.944736 10176 raft_consensus.cc:493] T 1528ab62b6fe4e3099d08f141afee116 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:46.944870  6844 leader_election.cc:304] T b56bf91d90824c959e21e0cee5ba1816 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:19:46.948026  6732 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49744 (request call id 307) took 1937 ms. Trace:
I20260709 13:19:46.896847 10031 leader_election.cc:290] T 24ee15416e3145beaa1b8183453729a3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:46.998423  6727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24ee15416e3145beaa1b8183453729a3" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:19:47.002075  6724 raft_consensus.cc:1240] T a3022224cc81473690653a83d4e99470 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 10 FOLLOWER]: Rejecting Update request from peer b7ab4784c7344b939bc36f639286f377 for earlier term 9. Current term is 10. Ops: []
I20260709 13:19:46.999018  6772 leader_election.cc:304] T ce4f062dcd314d43a63ca74067cb5ee3 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
W20260709 13:19:47.005466  6845 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:46.989367  9849 raft_consensus.cc:3060] T d8292e16e5654be6bc408560cf256aaa P b7ab4784c7344b939bc36f639286f377 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:19:47.010113  6772 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:46.980726  9875 raft_consensus.cc:493] T f09c2a98de1a4decabd0ff900dd44caa P ccd8a4c3bfe3413cb2ae219b09aea832 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:47.013033  6727 raft_consensus.cc:2410] T 24ee15416e3145beaa1b8183453729a3 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ba59cc884714e8aa5f3f0ecaed84cbb for term 10 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 13:19:46.938508  9999 raft_consensus.cc:515] T bb3d8792045a4583ae2e965b1350a5b4 P cd75a17ab2604397adab03bb8b5fd75c [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
W20260709 13:19:47.005743  6770 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 90799.5us
I20260709 13:19:46.985980  9864 raft_consensus.cc:3060] T a1704639a875409b9959353527b3fd68 P b7ab4784c7344b939bc36f639286f377 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:19:47.011993  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 67293.1us
I20260709 13:19:46.992364 10178 raft_consensus.cc:493] T f03d0dbf16864ca4bc1bb5e4c0334c0f P b7ab4784c7344b939bc36f639286f377 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:19:47.021416  6772 leader_election.cc:304] T b56bf91d90824c959e21e0cee5ba1816 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:19:47.027541  7498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17587d6730594da4a56fa13a353232a1" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:19:47.006079  6732 rpcz_store.cc:276] 0709 13:19:45.010868 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:45.011022 (+   154us) service_pool.cc:224] Handling call
0709 13:19:45.036431 (+ 25409us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:46.376123 (+1339692us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:46.947686 (+571563us) spinlock_profiling.cc:243] Waited 1.31 s on lock 0x7b540008d254. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f9aae01 00007fcc0f9a983e 00007fcc1496e419 00007fcc0dee5bd4 00007fcc0dee5b62 00007fcc0dee5a91 00007fcc0dee5a0c 00007fcc0dee4cc2 00007fcc0dce548c 00007fcc0dce48c6
0709 13:19:46.947944 (+   258us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3008690944}
I20260709 13:19:47.031967  7498 raft_consensus.cc:2468] T 17587d6730594da4a56fa13a353232a1 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 12.
I20260709 13:19:47.003590 10240 raft_consensus.cc:493] T 427c124d773f483294511e80fe340075 P b7ab4784c7344b939bc36f639286f377 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:47.012560  9949 raft_consensus.cc:2804] T ce4f062dcd314d43a63ca74067cb5ee3 P b7ab4784c7344b939bc36f639286f377 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:19:47.045167  6728 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50004 (request call id 1703) took 1934 ms. Trace:
I20260709 13:19:47.009155 10160 raft_consensus.cc:2804] T 4275cf08e63345f993bce8664eada830 P b7ab4784c7344b939bc36f639286f377 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:19:47.045704  6728 rpcz_store.cc:276] 0709 13:19:45.111186 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:45.111350 (+   164us) service_pool.cc:224] Handling call
0709 13:19:46.235668 (+1124318us) spinlock_profiling.cc:243] Waited 53.4 ms on lock 0x7b5800000c98. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0c745db1 00007fcc0c885b71 00007fcc0c885a22 00007fcc1579ec09 00007fcc148f8ee0 00007fcc149c20ab 00007fcc149c2131 00007fcc14983fc0 00007fcc1496e929 00007fcc1496e3d2 00007fcc0dee5bd4
0709 13:19:46.235991 (+   323us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:46.503766 (+267775us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:47.044930 (+541164us) spinlock_profiling.cc:243] Waited 267 ms on lock 0x7b540031a6d4. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f9aae01 00007fcc0f9a983e 00007fcc1496e419 00007fcc0dee5bd4 00007fcc0dee5b62 00007fcc0dee5a91 00007fcc0dee5a0c 00007fcc0dee4cc2 00007fcc0dce548c 00007fcc0dce48c6
0709 13:19:47.045101 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":736862208}
I20260709 13:19:47.019650  9875 raft_consensus.cc:3060] T f09c2a98de1a4decabd0ff900dd44caa P ccd8a4c3bfe3413cb2ae219b09aea832 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:47.016848 10182 raft_consensus.cc:2804] T b56bf91d90824c959e21e0cee5ba1816 P cd75a17ab2604397adab03bb8b5fd75c [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:19:47.043555  6844 leader_election.cc:304] T 07a92dd554674067a83a9cb68c4773f2 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:19:46.991439  9890 raft_consensus.cc:515] T 713b5728a197487c9300b310ab94e5a3 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:47.014323 10237 raft_consensus.cc:2749] T dbdf895bba214ff68685a24fd17dfb5d P ccd8a4c3bfe3413cb2ae219b09aea832 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
W20260709 13:19:47.108088  6770 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 66857.4us
W20260709 13:19:47.126940  6697 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 106676us
I20260709 13:19:47.003750  9893 raft_consensus.cc:515] T 1528ab62b6fe4e3099d08f141afee116 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
W20260709 13:19:47.130239  6695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 112911us
I20260709 13:19:47.003203 10164 raft_consensus.cc:515] T 30e88460611e47b2ba16a46a30b5f416 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:47.028882 10147 consensus_queue.cc:1048] T 7c44c4849aa54f2b94d1f1bef9ed546f P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.051s
I20260709 13:19:47.046000 10032 raft_consensus.cc:493] T e77e330a82df4b43a745d57a68f6f057 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:47.045403  9949 raft_consensus.cc:493] T ce4f062dcd314d43a63ca74067cb5ee3 P b7ab4784c7344b939bc36f639286f377 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:47.058679 10160 raft_consensus.cc:493] T 4275cf08e63345f993bce8664eada830 P b7ab4784c7344b939bc36f639286f377 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:47.013739 10176 raft_consensus.cc:515] T 1528ab62b6fe4e3099d08f141afee116 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:19:47.027817 10225 consensus_queue.cc:1048] T f58dc08b12a2494bb9a1372837970ca2 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.101s
W20260709 13:19:47.187657  6695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 56564.4us
I20260709 13:19:47.169348  6874 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53416 (request call id 2617) took 1167 ms. Trace:
I20260709 13:19:47.072129 10182 raft_consensus.cc:493] T b56bf91d90824c959e21e0cee5ba1816 P cd75a17ab2604397adab03bb8b5fd75c [term 8 FOLLOWER]: Starting leader election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:19:47.189844  6874 rpcz_store.cc:276] 0709 13:19:46.002463 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:46.003945 (+  1482us) service_pool.cc:224] Handling call
0709 13:19:46.023700 (+ 19755us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:46.056332 (+ 32632us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:46.056436 (+   104us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:46.061302 (+  4866us) log.cc:844] Serialized 26 byte log entry
0709 13:19:46.341052 (+279750us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:19:46.341110 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:46.341205 (+    95us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:46.893501 (+552296us) spinlock_profiling.cc:243] Waited 7.12 ms on lock 0x7b4400022b4c. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0c745db1 00007fcc0c7e3c85 00007fcc0c7e46a2 00007fcc0f5561db 00007fcc0f551aaf 00007fcc0f54586e 00007fcc0f544bb6 00007fcc0f5447d8 00007fcc0f54e221 00007fcc0f54e1d9 00007fcc0f54e169
0709 13:19:47.137544 (+244043us) raft_consensus.cc:1685] finished
0709 13:19:47.137574 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:47.169231 (+ 31657us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":13530,"raft.run_cpu_time_us":508,"raft.run_wall_time_us":7370,"spinlock_wait_cycles":16370048,"thread_start_us":256027,"threads_started":1,"wal-append.queue_time_us":375156}
W20260709 13:19:47.144551  6846 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:47.141103  6731 raft_consensus.cc:1240] T 713b5728a197487c9300b310ab94e5a3 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 10 FOLLOWER]: Rejecting Update request from peer b7ab4784c7344b939bc36f639286f377 for earlier term 9. Current term is 10. Ops: []
I20260709 13:19:47.194432  6726 raft_consensus.cc:1240] T 1528ab62b6fe4e3099d08f141afee116 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 9 FOLLOWER]: Rejecting Update request from peer b7ab4784c7344b939bc36f639286f377 for earlier term 8. Current term is 9. Ops: []
I20260709 13:19:47.043174 10178 raft_consensus.cc:515] T f03d0dbf16864ca4bc1bb5e4c0334c0f P b7ab4784c7344b939bc36f639286f377 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:47.124269 10111 raft_consensus.cc:2749] T b56bf91d90824c959e21e0cee5ba1816 P b7ab4784c7344b939bc36f639286f377 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:19:47.198824  6772 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 177495us
I20260709 13:19:47.135658  6844 leader_election.cc:304] T bd6869f07b5a4885a0b99fbe60c3b175 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:19:47.064939 10031 consensus_queue.cc:1048] T be1a92657f494cac8dd227d152f50151 P 7ba59cc884714e8aa5f3f0ecaed84cbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.102s
I20260709 13:19:47.165848  9657 leader_election.cc:290] T 95a75bfe094d4bdc963aba3f08dfcd25 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:47.201498 10182 raft_consensus.cc:3060] T b56bf91d90824c959e21e0cee5ba1816 P cd75a17ab2604397adab03bb8b5fd75c [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:47.066063 10240 raft_consensus.cc:515] T 427c124d773f483294511e80fe340075 P b7ab4784c7344b939bc36f639286f377 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } attrs { replace: true } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:19:47.221784  9450 consensus_queue.cc:1048] T 95a75bfe094d4bdc963aba3f08dfcd25 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:19:47.222849 10178 leader_election.cc:290] T f03d0dbf16864ca4bc1bb5e4c0334c0f P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:47.223265 10240 leader_election.cc:290] T 427c124d773f483294511e80fe340075 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:19:47.166282 10166 consensus_queue.cc:1059] T 7c44c4849aa54f2b94d1f1bef9ed546f P b7ab4784c7344b939bc36f639286f377 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: INVALID_TERM, Last received: 10.8, Next index: 9, Last known committed idx: 5, Time since last communication: 0.058s
I20260709 13:19:47.137825 10157 raft_consensus.cc:493] T 2c240553ce044eedb41541d72b9475d7 P b7ab4784c7344b939bc36f639286f377 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:19:47.228400 10157 raft_consensus.cc:515] T 2c240553ce044eedb41541d72b9475d7 P b7ab4784c7344b939bc36f639286f377 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:47.230050  9890 leader_election.cc:290] T 713b5728a197487c9300b310ab94e5a3 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 10 election: Requested vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:47.230401 10157 leader_election.cc:290] T 2c240553ce044eedb41541d72b9475d7 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:47.230912 10157 raft_consensus.cc:3055] T 7c44c4849aa54f2b94d1f1bef9ed546f P b7ab4784c7344b939bc36f639286f377 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:19:47.231230 10157 raft_consensus.cc:740] T 7c44c4849aa54f2b94d1f1bef9ed546f P b7ab4784c7344b939bc36f639286f377 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
I20260709 13:19:47.231874 10176 leader_election.cc:290] T 1528ab62b6fe4e3099d08f141afee116 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:19:47.169778 10032 raft_consensus.cc:515] T e77e330a82df4b43a745d57a68f6f057 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } }
I20260709 13:19:47.235157 10032 leader_election.cc:290] T e77e330a82df4b43a745d57a68f6f057 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:47.236487  9999 leader_election.cc:290] T bb3d8792045a4583ae2e965b1350a5b4 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 9 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:19:47.167991 10243 consensus_queue.cc:1059] T 9b3759de40694069b13c0f8bd40e5709 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.100s
I20260709 13:19:47.238117 10030 leader_election.cc:290] T a3022224cc81473690653a83d4e99470 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 10 election: Requested vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:47.245257  9893 leader_election.cc:290] T 1528ab62b6fe4e3099d08f141afee116 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 9 election: Requested vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:19:47.247903 10157 consensus_queue.cc:260] T 7c44c4849aa54f2b94d1f1bef9ed546f P b7ab4784c7344b939bc36f639286f377 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:47.249423  6732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7887766dc6784fcaa42b35c05fea7a99" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:19:47.251596  6727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90d42e216d9741e190bca19a781291fd" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:19:47.242784  9849 raft_consensus.cc:515] T d8292e16e5654be6bc408560cf256aaa P b7ab4784c7344b939bc36f639286f377 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:47.201632  9949 raft_consensus.cc:3060] T ce4f062dcd314d43a63ca74067cb5ee3 P b7ab4784c7344b939bc36f639286f377 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:47.077467 10187 raft_consensus.cc:2804] T 07a92dd554674067a83a9cb68c4773f2 P cd75a17ab2604397adab03bb8b5fd75c [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:19:47.074589  9852 consensus_queue.cc:237] T 1bf4668eeb70467fb3dc5a0289233b3c P b7ab4784c7344b939bc36f639286f377 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:47.193460 10006 raft_consensus.cc:493] T 44bde925b2e541b69890d70715b85176 P b7ab4784c7344b939bc36f639286f377 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
W20260709 13:19:47.260232  6616 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 427c124d773f483294511e80fe340075 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER failed with leader 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 7ba59cc884714e8aa5f3f0ecaed84cbb is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 8 committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } attrs { replace: true } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } } }
I20260709 13:19:47.212365  6772 leader_election.cc:304] T 3d65025eea89441290d85dd053810e31 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
W20260709 13:19:47.264098  6695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 68954.7us
I20260709 13:19:47.251025  6728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17587d6730594da4a56fa13a353232a1" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:19:47.285032  6728 raft_consensus.cc:2468] T 17587d6730594da4a56fa13a353232a1 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 12.
W20260709 13:19:47.220961 10238 log.cc:927] Time spent T 713b5728a197487c9300b310ab94e5a3 P cd75a17ab2604397adab03bb8b5fd75c: Append to log took a long time: real 0.084s	user 0.000s	sys 0.001s
I20260709 13:19:47.253437  6729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a92dd554674067a83a9cb68c4773f2" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
W20260709 13:19:47.256978  7494 consensus_meta.cc:287] T d8cee0accdb8499c86d4414b72565a38 P 7ba59cc884714e8aa5f3f0ecaed84cbb: Time spent flushing consensus metadata: real 0.727s	user 0.012s	sys 0.000s
W20260709 13:19:47.271801  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 141728us
I20260709 13:19:47.272274  6800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1528ab62b6fe4e3099d08f141afee116" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
W20260709 13:19:47.290529  6772 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 78675.6us
I20260709 13:19:47.199522 10160 raft_consensus.cc:3060] T 4275cf08e63345f993bce8664eada830 P b7ab4784c7344b939bc36f639286f377 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:47.269634  9999 raft_consensus.cc:493] T 9b3759de40694069b13c0f8bd40e5709 P cd75a17ab2604397adab03bb8b5fd75c [term 8 FOLLOWER]: Starting pre-election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:19:47.323776  6772 leader_election.cc:304] T dbdf895bba214ff68685a24fd17dfb5d P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:19:47.321959  6770 leader_election.cc:304] T 17587d6730594da4a56fa13a353232a1 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
I20260709 13:19:47.326017  6729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c240553ce044eedb41541d72b9475d7" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:19:47.330401  6728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f03d0dbf16864ca4bc1bb5e4c0334c0f" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:19:47.331940 10243 raft_consensus.cc:3055] T 9b3759de40694069b13c0f8bd40e5709 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:19:47.332075  6728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "427c124d773f483294511e80fe340075" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:19:47.332557 10243 raft_consensus.cc:740] T 9b3759de40694069b13c0f8bd40e5709 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
I20260709 13:19:47.332934  6728 raft_consensus.cc:2468] T 427c124d773f483294511e80fe340075 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 8.
I20260709 13:19:47.333302 10164 leader_election.cc:290] T 30e88460611e47b2ba16a46a30b5f416 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 9 election: Requested vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:47.333606 10243 consensus_queue.cc:260] T 9b3759de40694069b13c0f8bd40e5709 P ccd8a4c3bfe3413cb2ae219b09aea832 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:47.330521  9849 leader_election.cc:290] T d8292e16e5654be6bc408560cf256aaa P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 12 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
W20260709 13:19:47.340978  6695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 51104.9us
I20260709 13:19:47.343261  6695 leader_election.cc:304] T a1704639a875409b9959353527b3fd68 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:19:47.335386 10178 consensus_queue.cc:1048] T 22ccee1b570c4ad3a57bd7aec085b1b4 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:19:47.344233  6844 leader_election.cc:304] T de3186201e1a40d0b335eeb8b4e256e0 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:19:47.344218  9999 raft_consensus.cc:515] T 9b3759de40694069b13c0f8bd40e5709 P cd75a17ab2604397adab03bb8b5fd75c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:47.346724  9999 leader_election.cc:290] T 9b3759de40694069b13c0f8bd40e5709 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:19:47.347322  9999 raft_consensus.cc:2804] T de3186201e1a40d0b335eeb8b4e256e0 P cd75a17ab2604397adab03bb8b5fd75c [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:19:47.283911 10184 raft_consensus.cc:2804] T bd6869f07b5a4885a0b99fbe60c3b175 P cd75a17ab2604397adab03bb8b5fd75c [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:19:47.348502 10184 raft_consensus.cc:493] T bd6869f07b5a4885a0b99fbe60c3b175 P cd75a17ab2604397adab03bb8b5fd75c [term 9 FOLLOWER]: Starting leader election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:19:47.351711  6772 leader_election.cc:304] T f3f9c2e2bf644115957398fe4c9459db P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:19:47.282994 10187 raft_consensus.cc:493] T 07a92dd554674067a83a9cb68c4773f2 P cd75a17ab2604397adab03bb8b5fd75c [term 8 FOLLOWER]: Starting leader election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:19:47.346987  6695 leader_election.cc:304] T ce4f062dcd314d43a63ca74067cb5ee3 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:19:47.334381  6728 pending_rounds.cc:85] T 711ef6523deb4cbe8ef2ba61e1c21c98 P ccd8a4c3bfe3413cb2ae219b09aea832: Aborting all ops after (but not including) 4
I20260709 13:19:47.355486  6728 pending_rounds.cc:107] T 711ef6523deb4cbe8ef2ba61e1c21c98 P ccd8a4c3bfe3413cb2ae219b09aea832: Aborting uncommitted NO_OP operation due to leader change: 7.5
I20260709 13:19:47.355885  6728 raft_consensus.cc:2889] T 711ef6523deb4cbe8ef2ba61e1c21c98 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:19:47.359565  6729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8292e16e5654be6bc408560cf256aaa" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:19:47.360422  6729 raft_consensus.cc:3060] T d8292e16e5654be6bc408560cf256aaa P ccd8a4c3bfe3413cb2ae219b09aea832 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:47.362461  6772 leader_election.cc:304] T 30e88460611e47b2ba16a46a30b5f416 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:19:47.364665  9450 raft_consensus.cc:493] T 8c7f33e544204fbaac4078e3e83bbf4e P b7ab4784c7344b939bc36f639286f377 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:19:47.365237  9450 raft_consensus.cc:515] T 8c7f33e544204fbaac4078e3e83bbf4e P b7ab4784c7344b939bc36f639286f377 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:47.299873 10109 raft_consensus.cc:2749] T 3d65025eea89441290d85dd053810e31 P b7ab4784c7344b939bc36f639286f377 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:19:47.348923 10184 raft_consensus.cc:3060] T bd6869f07b5a4885a0b99fbe60c3b175 P cd75a17ab2604397adab03bb8b5fd75c [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:47.364964  7495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3d8792045a4583ae2e965b1350a5b4" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb"
I20260709 13:19:47.380302 10241 raft_consensus.cc:2804] T 17587d6730594da4a56fa13a353232a1 P b7ab4784c7344b939bc36f639286f377 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:19:47.381000 10247 raft_consensus.cc:2749] T 30e88460611e47b2ba16a46a30b5f416 P b7ab4784c7344b939bc36f639286f377 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:19:47.379273  6772 leader_election.cc:304] T de3186201e1a40d0b335eeb8b4e256e0 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: ccd8a4c3bfe3413cb2ae219b09aea832
W20260709 13:19:47.390926  6695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 44027.4us
I20260709 13:19:47.389816  7495 raft_consensus.cc:3060] T bb3d8792045a4583ae2e965b1350a5b4 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 7 FOLLOWER]: Advancing to term 9
I20260709 13:19:47.393481  9893 raft_consensus.cc:2804] T ce4f062dcd314d43a63ca74067cb5ee3 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:19:47.393872  9893 raft_consensus.cc:493] T ce4f062dcd314d43a63ca74067cb5ee3 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:47.394196  9893 raft_consensus.cc:3060] T ce4f062dcd314d43a63ca74067cb5ee3 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:47.397171 10244 consensus_queue.cc:1059] T 20f6842e26174571996b8dea4151d4be P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:19:47.398000 10244 consensus_queue.cc:1243] T 20f6842e26174571996b8dea4151d4be P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Peer b7ab4784c7344b939bc36f639286f377 log is divergent from this leader: its last log entry 6.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 13:19:47.398458 10244 consensus_queue.cc:1048] T 9e326172347f45e99a0d482b5d8ef768 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:19:47.400408 10241 raft_consensus.cc:493] T 17587d6730594da4a56fa13a353232a1 P b7ab4784c7344b939bc36f639286f377 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:47.356694  9849 raft_consensus.cc:2749] T f3f9c2e2bf644115957398fe4c9459db P b7ab4784c7344b939bc36f639286f377 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:19:47.401198 10236 raft_consensus.cc:3055] T 20f6842e26174571996b8dea4151d4be P ccd8a4c3bfe3413cb2ae219b09aea832 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:19:47.295023 10004 consensus_queue.cc:1048] T f58dc08b12a2494bb9a1372837970ca2 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.084s
I20260709 13:19:47.401718 10236 raft_consensus.cc:740] T 20f6842e26174571996b8dea4151d4be P ccd8a4c3bfe3413cb2ae219b09aea832 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
W20260709 13:19:47.402427 10220 log.cc:927] Time spent T 4b8cacb381b746da8d0049b0a83b41dd P ccd8a4c3bfe3413cb2ae219b09aea832: Append to log took a long time: real 0.644s	user 0.003s	sys 0.000s
I20260709 13:19:47.402694 10236 consensus_queue.cc:260] T 20f6842e26174571996b8dea4151d4be P ccd8a4c3bfe3413cb2ae219b09aea832 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:47.356694 10178 raft_consensus.cc:2749] T dbdf895bba214ff68685a24fd17dfb5d P b7ab4784c7344b939bc36f639286f377 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:19:47.378041 10176 raft_consensus.cc:493] T 7ba5dac66ab5497e9e336f2a3c28cda5 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:19:47.404671 10178 raft_consensus.cc:2804] T de3186201e1a40d0b335eeb8b4e256e0 P b7ab4784c7344b939bc36f639286f377 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:19:47.404515 10176 raft_consensus.cc:515] T 7ba5dac66ab5497e9e336f2a3c28cda5 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:19:47.404908  6772 leader_election.cc:304] T 9b3759de40694069b13c0f8bd40e5709 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:19:47.405148 10178 raft_consensus.cc:493] T de3186201e1a40d0b335eeb8b4e256e0 P b7ab4784c7344b939bc36f639286f377 [term 9 FOLLOWER]: Starting leader election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:19:47.405617 10178 raft_consensus.cc:3060] T de3186201e1a40d0b335eeb8b4e256e0 P b7ab4784c7344b939bc36f639286f377 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:47.406855 10176 leader_election.cc:290] T 7ba5dac66ab5497e9e336f2a3c28cda5 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:47.407130 10063 raft_consensus.cc:2749] T 9b3759de40694069b13c0f8bd40e5709 P b7ab4784c7344b939bc36f639286f377 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:19:47.407989 10063 consensus_queue.cc:1048] T 7a734b5ab7834e05a8c422208acc58b1 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:19:47.409849 10063 consensus_queue.cc:1048] T 711ef6523deb4cbe8ef2ba61e1c21c98 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:19:47.406875  6772 leader_election.cc:304] T 3a485a995abc4807b6e511e45419f737 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
W20260709 13:19:47.369980  6846 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:47.347857  9999 raft_consensus.cc:493] T de3186201e1a40d0b335eeb8b4e256e0 P cd75a17ab2604397adab03bb8b5fd75c [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:47.279388 10111 consensus_queue.cc:1059] T 3411566abe2d4c9bb4b2adfdd05e6f17 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.087s
I20260709 13:19:47.296499  7494 raft_consensus.cc:2468] T d8cee0accdb8499c86d4414b72565a38 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 9.
I20260709 13:19:47.377624  9933 raft_consensus.cc:2749] T a1704639a875409b9959353527b3fd68 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:19:47.415051  6800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ba5dac66ab5497e9e336f2a3c28cda5" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:19:47.421692  6772 leader_election.cc:304] T d8cee0accdb8499c86d4414b72565a38 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:19:47.289682 10006 raft_consensus.cc:515] T 44bde925b2e541b69890d70715b85176 P b7ab4784c7344b939bc36f639286f377 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:47.432209 10006 leader_election.cc:290] T 44bde925b2e541b69890d70715b85176 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:47.357066 10187 raft_consensus.cc:3060] T 07a92dd554674067a83a9cb68c4773f2 P cd75a17ab2604397adab03bb8b5fd75c [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:19:47.386482 10238 log.cc:927] Time spent T 713b5728a197487c9300b310ab94e5a3 P cd75a17ab2604397adab03bb8b5fd75c: Append to log took a long time: real 0.080s	user 0.000s	sys 0.000s
I20260709 13:19:47.401054 10182 raft_consensus.cc:515] T b56bf91d90824c959e21e0cee5ba1816 P cd75a17ab2604397adab03bb8b5fd75c [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:47.436372 10160 raft_consensus.cc:515] T 4275cf08e63345f993bce8664eada830 P b7ab4784c7344b939bc36f639286f377 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:47.437779  6878 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53406 (request call id 1802) took 1101 ms. Trace:
W20260709 13:19:47.439067  6846 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:47.403952 10236 raft_consensus.cc:3060] T 20f6842e26174571996b8dea4151d4be P ccd8a4c3bfe3413cb2ae219b09aea832 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:47.438213  6878 rpcz_store.cc:276] 0709 13:19:46.336890 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:46.453760 (+116870us) service_pool.cc:224] Handling call
0709 13:19:46.455917 (+  2157us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:46.489663 (+ 33746us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:19:46.507467 (+ 17804us) log.cc:844] Serialized 14 byte log entry
0709 13:19:46.913339 (+405872us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:46.936500 (+ 23161us) log.cc:844] Serialized 26 byte log entry
0709 13:19:46.936700 (+   200us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:19:46.937016 (+   316us) log.cc:844] Serialized 14 byte log entry
0709 13:19:46.958916 (+ 21900us) spinlock_profiling.cc:243] Waited 15.4 ms on lock 0x7b1800310f00. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc15785de1 00007fcc157925b1 00007fcc0c837c0a 00007fcc15f77219 00007fcc1387e58f 00007fcc0c8bd571 00007fcc0c8bf7c1 00007fcc0c8bf779 00007fcc0c8bf709 00007fcc0c8bf6d1 00007fcc0c8be9cd
0709 13:19:46.965605 (+  6689us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:46.965724 (+   119us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:47.437562 (+471838us) raft_consensus.cc:1685] finished
0709 13:19:47.437583 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:47.437718 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":41856,"prepare.queue_time_us":18625,"prepare.run_cpu_time_us":70,"prepare.run_wall_time_us":72,"raft.queue_time_us":39643,"raft.run_cpu_time_us":485,"raft.run_wall_time_us":30473,"spinlock_wait_cycles":35389184,"thread_start_us":351810,"threads_started":1,"wal-append.queue_time_us":482466}
I20260709 13:19:47.438651 10160 leader_election.cc:290] T 4275cf08e63345f993bce8664eada830 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 10 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
W20260709 13:19:47.413635  6847 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:47.400992 10241 raft_consensus.cc:3060] T 17587d6730594da4a56fa13a353232a1 P b7ab4784c7344b939bc36f639286f377 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:19:47.444120  6847 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:47.445974 10187 raft_consensus.cc:515] T 07a92dd554674067a83a9cb68c4773f2 P cd75a17ab2604397adab03bb8b5fd75c [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:47.420500  9849 raft_consensus.cc:2749] T 3a485a995abc4807b6e511e45419f737 P b7ab4784c7344b939bc36f639286f377 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:19:47.450029  7466 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:47.451836  6725 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50004 (request call id 1724) took 1084 ms. Trace:
I20260709 13:19:47.429760  9450 leader_election.cc:290] T 8c7f33e544204fbaac4078e3e83bbf4e P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:47.452679  6725 rpcz_store.cc:276] 0709 13:19:46.367788 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:46.519176 (+151388us) service_pool.cc:224] Handling call
0709 13:19:46.526233 (+  7057us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:46.996192 (+469959us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:46.996223 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:46.996264 (+    41us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:19:46.996298 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:47.451509 (+455211us) spinlock_profiling.cc:243] Waited 470 ms on lock 0x7b54001626d4. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f9aae01 00007fcc0f9a983e 00007fcc1496e419 00007fcc0dee5bd4 00007fcc0dee5b62 00007fcc0dee5a91 00007fcc0dee5a0c 00007fcc0dee4cc2 00007fcc0dce548c 00007fcc0dce48c6
0709 13:19:47.451574 (+    65us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:47.451759 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1080068352}
I20260709 13:19:47.454550  6725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1528ab62b6fe4e3099d08f141afee116" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
W20260709 13:19:47.455938  6845 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:47.480620  6772 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 58954.3us
I20260709 13:19:47.482257  7466 leader_election.cc:304] T 1528ab62b6fe4e3099d08f141afee116 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:19:47.422677  9999 raft_consensus.cc:3060] T de3186201e1a40d0b335eeb8b4e256e0 P cd75a17ab2604397adab03bb8b5fd75c [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:47.490087  6772 leader_election.cc:304] T f58dc08b12a2494bb9a1372837970ca2 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:19:47.491624  9450 consensus_queue.cc:1048] T d33d5ee8ef6f415593d8df52063161ad P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:19:47.491190 10006 raft_consensus.cc:2804] T d8cee0accdb8499c86d4414b72565a38 P b7ab4784c7344b939bc36f639286f377 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:19:47.438651 10182 leader_election.cc:290] T b56bf91d90824c959e21e0cee5ba1816 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 9 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:19:47.501937 10006 raft_consensus.cc:697] T d8cee0accdb8499c86d4414b72565a38 P b7ab4784c7344b939bc36f639286f377 [term 9 LEADER]: Becoming Leader. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
I20260709 13:19:47.502439 10250 raft_consensus.cc:2749] T 1528ab62b6fe4e3099d08f141afee116 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:19:47.502928  9875 raft_consensus.cc:515] T f09c2a98de1a4decabd0ff900dd44caa P ccd8a4c3bfe3413cb2ae219b09aea832 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:47.503422 10249 raft_consensus.cc:493] T f4b8bd455d5a47c18a1380839c6e0d61 P b7ab4784c7344b939bc36f639286f377 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
W20260709 13:19:47.503925  6845 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:47.510032  6845 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:47.506387  9450 raft_consensus.cc:2804] T f58dc08b12a2494bb9a1372837970ca2 P b7ab4784c7344b939bc36f639286f377 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:19:47.439682  9949 raft_consensus.cc:515] T ce4f062dcd314d43a63ca74067cb5ee3 P b7ab4784c7344b939bc36f639286f377 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } attrs { replace: true } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:19:47.493885 10187 leader_election.cc:290] T 07a92dd554674067a83a9cb68c4773f2 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 9 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:19:47.495128  9849 consensus_queue.cc:1048] T e77e330a82df4b43a745d57a68f6f057 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.019s
I20260709 13:19:47.514463 10006 consensus_queue.cc:237] T d8cee0accdb8499c86d4414b72565a38 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:19:47.516876 10182 raft_consensus.cc:493] T 20f6842e26174571996b8dea4151d4be P cd75a17ab2604397adab03bb8b5fd75c [term 9 FOLLOWER]: Starting pre-election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:19:47.517740  6803 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:32976 (request call id 2518) took 1001 ms. Trace:
I20260709 13:19:47.510929  9450 raft_consensus.cc:493] T f58dc08b12a2494bb9a1372837970ca2 P b7ab4784c7344b939bc36f639286f377 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:47.548497  9450 raft_consensus.cc:3060] T f58dc08b12a2494bb9a1372837970ca2 P b7ab4784c7344b939bc36f639286f377 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:47.491374 10145 raft_consensus.cc:493] T 7c37d41cd9164c15a6826ca62a851a69 P b7ab4784c7344b939bc36f639286f377 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:19:47.548305  6803 rpcz_store.cc:276] 0709 13:19:46.519402 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:46.528226 (+  8824us) service_pool.cc:224] Handling call
0709 13:19:46.528482 (+   256us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:46.593314 (+ 64832us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:46.593344 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:46.593388 (+    44us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:19:46.593420 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:47.517409 (+923989us) spinlock_profiling.cc:243] Waited 64.6 ms on lock 0x7b54001b44d4. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f9aae01 00007fcc0f9a983e 00007fcc1496e419 00007fcc0dee5bd4 00007fcc0dee5b62 00007fcc0dee5a91 00007fcc0dee5a0c 00007fcc0dee4cc2 00007fcc0dce548c 00007fcc0dce48c6
0709 13:19:47.517472 (+    63us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:47.517665 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":148535168}
I20260709 13:19:47.575668  6724 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50004 (request call id 1714) took 1284 ms. Trace:
I20260709 13:19:47.576236  6724 rpcz_store.cc:276] 0709 13:19:46.291476 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:46.291653 (+   177us) service_pool.cc:224] Handling call
0709 13:19:46.326600 (+ 34947us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:47.011897 (+685297us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:47.575378 (+563481us) spinlock_profiling.cc:243] Waited 675 ms on lock 0x7b54003b6fd4. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f9aae01 00007fcc0f9a983e 00007fcc1496e419 00007fcc0dee5bd4 00007fcc0dee5b62 00007fcc0dee5a91 00007fcc0dee5a0c 00007fcc0dee4cc2 00007fcc0dce548c 00007fcc0dce48c6
0709 13:19:47.575600 (+   222us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1552774016}
I20260709 13:19:47.585044 10160 raft_consensus.cc:493] T 4d9def8b32fd443aa94ab1420b06837b P b7ab4784c7344b939bc36f639286f377 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:47.585907 10232 log.cc:927] Time spent T bd6869f07b5a4885a0b99fbe60c3b175 P b7ab4784c7344b939bc36f639286f377: Append to log took a long time: real 0.511s	user 0.003s	sys 0.000s
I20260709 13:19:47.585795 10160 raft_consensus.cc:515] T 4d9def8b32fd443aa94ab1420b06837b P b7ab4784c7344b939bc36f639286f377 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:47.579651  6729 raft_consensus.cc:2468] T d8292e16e5654be6bc408560cf256aaa P ccd8a4c3bfe3413cb2ae219b09aea832 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 12.
W20260709 13:19:47.589371  6698 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:47.589668  6729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44bde925b2e541b69890d70715b85176" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:19:47.591068  6729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20f6842e26174571996b8dea4151d4be" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 10 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:19:47.577751  6724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c7f33e544204fbaac4078e3e83bbf4e" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:19:47.564811 10182 raft_consensus.cc:515] T 20f6842e26174571996b8dea4151d4be P cd75a17ab2604397adab03bb8b5fd75c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:47.536342 10109 consensus_queue.cc:1048] T f5be3a11b23d4ea9b08300a2789821c7 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.052s
I20260709 13:19:47.599418  6802 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:32976 (request call id 2508) took 1093 ms. Trace:
I20260709 13:19:47.600963  6802 rpcz_store.cc:276] 0709 13:19:46.505799 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:46.506143 (+   344us) service_pool.cc:224] Handling call
0709 13:19:46.525182 (+ 19039us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:19:46.533508 (+  8326us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:46.533555 (+    47us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:19:46.540180 (+  6625us) log.cc:844] Serialized 52 byte log entry
0709 13:19:46.852461 (+312281us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:19:46.852519 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:46.852610 (+    91us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:47.585286 (+732676us) spinlock_profiling.cc:243] Waited 54.6 ms on lock 0x7b4400022b4c. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0c745db1 00007fcc0c7e3c85 00007fcc0c7e46a2 00007fcc0f5561db 00007fcc0f551aaf 00007fcc0f54586e 00007fcc0f544bb6 00007fcc0f5447d8 00007fcc0f54e221 00007fcc0f54e1d9 00007fcc0f54e169
0709 13:19:47.591434 (+  6148us) raft_consensus.cc:1685] finished
0709 13:19:47.591461 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:47.599325 (+  7864us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2058,"raft.queue_time_us":8850,"raft.run_cpu_time_us":174,"raft.run_wall_time_us":12694,"spinlock_wait_cycles":125620480,"thread_start_us":264050,"threads_started":1,"wal-append.queue_time_us":444811}
I20260709 13:19:47.566042 10187 raft_consensus.cc:493] T 8c7f33e544204fbaac4078e3e83bbf4e P cd75a17ab2604397adab03bb8b5fd75c [term 6 FOLLOWER]: Starting pre-election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:19:47.605486  9949 leader_election.cc:290] T ce4f062dcd314d43a63ca74067cb5ee3 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 9 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:19:47.606124 10182 leader_election.cc:290] T 20f6842e26174571996b8dea4151d4be P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:19:47.539930 10249 raft_consensus.cc:515] T f4b8bd455d5a47c18a1380839c6e0d61 P b7ab4784c7344b939bc36f639286f377 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:47.605563  6724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4275cf08e63345f993bce8664eada830" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:19:47.608824  6724 raft_consensus.cc:3060] T 4275cf08e63345f993bce8664eada830 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:19:47.613176  6846 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:47.600252  7495 raft_consensus.cc:2468] T bb3d8792045a4583ae2e965b1350a5b4 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 9.
W20260709 13:19:47.619663  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 294108us
W20260709 13:19:47.621037  6697 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 493421us
I20260709 13:19:47.623327  9450 raft_consensus.cc:515] T f58dc08b12a2494bb9a1372837970ca2 P b7ab4784c7344b939bc36f639286f377 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:47.626708  6846 leader_election.cc:304] T bb3d8792045a4583ae2e965b1350a5b4 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:19:47.623759 10102 raft_consensus.cc:493] T fe20b4b48823486ca3b9c648db6ce8aa P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:47.630941  6729 raft_consensus.cc:2410] T 20f6842e26174571996b8dea4151d4be P ccd8a4c3bfe3413cb2ae219b09aea832 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate b7ab4784c7344b939bc36f639286f377 for term 10 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 5.
W20260709 13:19:47.625607  9864 consensus_meta.cc:287] T a1704639a875409b9959353527b3fd68 P b7ab4784c7344b939bc36f639286f377: Time spent flushing consensus metadata: real 0.585s	user 0.004s	sys 0.008s
I20260709 13:19:47.573225 10145 raft_consensus.cc:515] T 7c37d41cd9164c15a6826ca62a851a69 P b7ab4784c7344b939bc36f639286f377 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:47.616390 10187 raft_consensus.cc:515] T 8c7f33e544204fbaac4078e3e83bbf4e P cd75a17ab2604397adab03bb8b5fd75c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:47.629041 10160 leader_election.cc:290] T 4d9def8b32fd443aa94ab1420b06837b P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:47.642131  9450 leader_election.cc:290] T f58dc08b12a2494bb9a1372837970ca2 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 12 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:47.623461 10178 raft_consensus.cc:515] T de3186201e1a40d0b335eeb8b4e256e0 P b7ab4784c7344b939bc36f639286f377 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:47.579680 10241 raft_consensus.cc:515] T 17587d6730594da4a56fa13a353232a1 P b7ab4784c7344b939bc36f639286f377 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:19:47.637252 10182 raft_consensus.cc:2804] T bb3d8792045a4583ae2e965b1350a5b4 P cd75a17ab2604397adab03bb8b5fd75c [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:19:47.672955  6878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4275cf08e63345f993bce8664eada830" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:19:47.673852  6878 raft_consensus.cc:2468] T 4275cf08e63345f993bce8664eada830 P cd75a17ab2604397adab03bb8b5fd75c [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 9.
I20260709 13:19:47.677212  6879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a92dd554674067a83a9cb68c4773f2" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
W20260709 13:19:47.667390 10218 thread.cc:641] apply [worker] (thread pool) Time spent creating pthread: real 0.871s	user 0.018s	sys 0.033s
I20260709 13:19:47.679116  6879 raft_consensus.cc:2393] T 07a92dd554674067a83a9cb68c4773f2 P cd75a17ab2604397adab03bb8b5fd75c [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7ab4784c7344b939bc36f639286f377 in current term 9: Already voted for candidate cd75a17ab2604397adab03bb8b5fd75c in this term.
I20260709 13:19:47.672618  9875 leader_election.cc:290] T f09c2a98de1a4decabd0ff900dd44caa P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 11 election: Requested vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:47.640568  9864 raft_consensus.cc:515] T a1704639a875409b9959353527b3fd68 P b7ab4784c7344b939bc36f639286f377 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:47.685436 10249 leader_election.cc:290] T f4b8bd455d5a47c18a1380839c6e0d61 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:47.686810  9864 leader_election.cc:290] T a1704639a875409b9959353527b3fd68 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 10 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:47.637110 10102 raft_consensus.cc:515] T fe20b4b48823486ca3b9c648db6ce8aa P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:19:47.680760 10228 raft_consensus.cc:493] T 711ef6523deb4cbe8ef2ba61e1c21c98 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:19:47.688809 10228 raft_consensus.cc:515] T 711ef6523deb4cbe8ef2ba61e1c21c98 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:47.689751 10102 leader_election.cc:290] T fe20b4b48823486ca3b9c648db6ce8aa P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:47.693140 10187 leader_election.cc:290] T 8c7f33e544204fbaac4078e3e83bbf4e P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:19:47.668179  9893 raft_consensus.cc:515] T ce4f062dcd314d43a63ca74067cb5ee3 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } attrs { replace: true } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:19:47.695336  6844 leader_election.cc:304] T 2c240553ce044eedb41541d72b9475d7 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:19:47.696494  9893 leader_election.cc:290] T ce4f062dcd314d43a63ca74067cb5ee3 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 9 election: Requested vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
W20260709 13:19:47.696951 10254 log.cc:927] Time spent T 22ccee1b570c4ad3a57bd7aec085b1b4 P ccd8a4c3bfe3413cb2ae219b09aea832: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260709 13:19:47.687605 10241 leader_election.cc:290] T 17587d6730594da4a56fa13a353232a1 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 13 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:19:47.687686  6874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90d42e216d9741e190bca19a781291fd" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
W20260709 13:19:47.682420 10218 thread.cc:608] apply [worker] (thread pool) Time spent starting thread: real 0.886s	user 0.018s	sys 0.034s
I20260709 13:19:47.691851  9999 raft_consensus.cc:515] T de3186201e1a40d0b335eeb8b4e256e0 P cd75a17ab2604397adab03bb8b5fd75c [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
W20260709 13:19:47.669585  6695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 276684us
I20260709 13:19:47.708927  6876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7887766dc6784fcaa42b35c05fea7a99" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:19:47.684211  6872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e31b9971c15848dea59d4d4130141d9e" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:19:47.732614  6876 raft_consensus.cc:2468] T 7887766dc6784fcaa42b35c05fea7a99 P cd75a17ab2604397adab03bb8b5fd75c [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 9.
W20260709 13:19:47.739432  6696 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:47.740732  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 71733us
I20260709 13:19:47.679529 10182 raft_consensus.cc:697] T bb3d8792045a4583ae2e965b1350a5b4 P cd75a17ab2604397adab03bb8b5fd75c [term 9 LEADER]: Becoming Leader. State: Replica: cd75a17ab2604397adab03bb8b5fd75c, State: Running, Role: LEADER
I20260709 13:19:47.750561  6844 leader_election.cc:304] T 9e326172347f45e99a0d482b5d8ef768 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:19:47.752194 10241 raft_consensus.cc:493] T f09c2a98de1a4decabd0ff900dd44caa P b7ab4784c7344b939bc36f639286f377 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:47.745913 10187 raft_consensus.cc:2804] T 2c240553ce044eedb41541d72b9475d7 P cd75a17ab2604397adab03bb8b5fd75c [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:19:47.752823 10241 raft_consensus.cc:515] T f09c2a98de1a4decabd0ff900dd44caa P b7ab4784c7344b939bc36f639286f377 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
W20260709 13:19:47.753389 10221 log.cc:927] Time spent T d33d5ee8ef6f415593d8df52063161ad P ccd8a4c3bfe3413cb2ae219b09aea832: Append to log took a long time: real 1.019s	user 0.000s	sys 0.004s
W20260709 13:19:47.750823  6771 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:47.758073  9450 raft_consensus.cc:493] T b3f13b31a1f84f0d89d007eadd57924c P b7ab4784c7344b939bc36f639286f377 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 7ba59cc884714e8aa5f3f0ecaed84cbb)
I20260709 13:19:47.798169  9450 raft_consensus.cc:515] T b3f13b31a1f84f0d89d007eadd57924c P b7ab4784c7344b939bc36f639286f377 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
W20260709 13:19:47.778321 10256 log.cc:927] Time spent T 2c240553ce044eedb41541d72b9475d7 P ccd8a4c3bfe3413cb2ae219b09aea832: Append to log took a long time: real 0.104s	user 0.001s	sys 0.000s
I20260709 13:19:47.800590  6724 raft_consensus.cc:2468] T 4275cf08e63345f993bce8664eada830 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 10.
W20260709 13:19:47.801131  6772 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 268279us
W20260709 13:19:47.799541  6770 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 275696us
I20260709 13:19:47.753155 10187 raft_consensus.cc:493] T 2c240553ce044eedb41541d72b9475d7 P cd75a17ab2604397adab03bb8b5fd75c [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:47.810815  6802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3411566abe2d4c9bb4b2adfdd05e6f17" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:19:47.801988 10182 consensus_queue.cc:237] T bb3d8792045a4583ae2e965b1350a5b4 P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:19:47.807785  9450 leader_election.cc:290] T b3f13b31a1f84f0d89d007eadd57924c P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:19:47.808528  6724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe20b4b48823486ca3b9c648db6ce8aa" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:19:47.820952  6724 raft_consensus.cc:2468] T fe20b4b48823486ca3b9c648db6ce8aa P ccd8a4c3bfe3413cb2ae219b09aea832 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in term 7.
I20260709 13:19:47.757874 10249 raft_consensus.cc:493] T 34f36d59d88f40fe8a2805e604fc6c0a P b7ab4784c7344b939bc36f639286f377 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:19:47.812598  6798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a75bfe094d4bdc963aba3f08dfcd25" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 11 candidate_status { last_received { term: 10 index: 4 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:19:47.815358  9999 leader_election.cc:290] T de3186201e1a40d0b335eeb8b4e256e0 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 10 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:19:47.816154 10145 leader_election.cc:290] T 7c37d41cd9164c15a6826ca62a851a69 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
W20260709 13:19:47.831833 10267 log.cc:927] Time spent T b3f13b31a1f84f0d89d007eadd57924c P ccd8a4c3bfe3413cb2ae219b09aea832: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 13:19:47.834905 10157 raft_consensus.cc:3060] T 7c44c4849aa54f2b94d1f1bef9ed546f P b7ab4784c7344b939bc36f639286f377 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:47.816430  6807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77e330a82df4b43a745d57a68f6f057" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 12 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:19:47.835837  6805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "713b5728a197487c9300b310ab94e5a3" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:19:47.816774 10259 raft_consensus.cc:493] T 7ba5dac66ab5497e9e336f2a3c28cda5 P cd75a17ab2604397adab03bb8b5fd75c [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:19:47.817175 10241 leader_election.cc:290] T f09c2a98de1a4decabd0ff900dd44caa P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:47.819279 10160 consensus_queue.cc:1059] T a3022224cc81473690653a83d4e99470 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:19:47.837198 10259 raft_consensus.cc:515] T 7ba5dac66ab5497e9e336f2a3c28cda5 P cd75a17ab2604397adab03bb8b5fd75c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:19:47.838267 10160 raft_consensus.cc:3055] T a3022224cc81473690653a83d4e99470 P b7ab4784c7344b939bc36f639286f377 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:19:47.838652 10160 raft_consensus.cc:740] T a3022224cc81473690653a83d4e99470 P b7ab4784c7344b939bc36f639286f377 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
I20260709 13:19:47.839473 10160 consensus_queue.cc:260] T a3022224cc81473690653a83d4e99470 P b7ab4784c7344b939bc36f639286f377 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:47.841084 10160 raft_consensus.cc:3060] T a3022224cc81473690653a83d4e99470 P b7ab4784c7344b939bc36f639286f377 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:47.842792  6730 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50004 (request call id 1709) took 2716 ms. Trace:
I20260709 13:19:47.844198 10249 raft_consensus.cc:515] T 34f36d59d88f40fe8a2805e604fc6c0a P b7ab4784c7344b939bc36f639286f377 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:47.846462 10249 leader_election.cc:290] T 34f36d59d88f40fe8a2805e604fc6c0a P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:47.848213 10265 raft_consensus.cc:2764] T 9e326172347f45e99a0d482b5d8ef768 P cd75a17ab2604397adab03bb8b5fd75c [term 8 FOLLOWER]: Leader pre-election decision vote started in defunct term 7: won
I20260709 13:19:47.849303 10265 raft_consensus.cc:493] T 7a734b5ab7834e05a8c422208acc58b1 P cd75a17ab2604397adab03bb8b5fd75c [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:47.851104  6845 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:47.812889  6772 leader_election.cc:304] T 07a92dd554674067a83a9cb68c4773f2 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:19:47.824958  6798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30e88460611e47b2ba16a46a30b5f416" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:19:47.852185  6798 raft_consensus.cc:3060] T 30e88460611e47b2ba16a46a30b5f416 P b7ab4784c7344b939bc36f639286f377 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:47.831301  6799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1528ab62b6fe4e3099d08f141afee116" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:19:47.853322  6772 leader_election.cc:304] T 7887766dc6784fcaa42b35c05fea7a99 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:19:47.821626  6770 leader_election.cc:304] T d8292e16e5654be6bc408560cf256aaa P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
I20260709 13:19:47.858529  6804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3022224cc81473690653a83d4e99470" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:19:47.858774  6772 leader_election.cc:304] T 90d42e216d9741e190bca19a781291fd P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:19:47.849890 10184 raft_consensus.cc:515] T bd6869f07b5a4885a0b99fbe60c3b175 P cd75a17ab2604397adab03bb8b5fd75c [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:47.821262 10187 raft_consensus.cc:3060] T 2c240553ce044eedb41541d72b9475d7 P cd75a17ab2604397adab03bb8b5fd75c [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:47.866837  6879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "427c124d773f483294511e80fe340075" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:19:47.870317  6880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c240553ce044eedb41541d72b9475d7" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
W20260709 13:19:47.875317  6846 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:47.878615  6879 raft_consensus.cc:2468] T 427c124d773f483294511e80fe340075 P cd75a17ab2604397adab03bb8b5fd75c [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 8.
I20260709 13:19:47.843362  6730 rpcz_store.cc:276] 0709 13:19:45.126322 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:45.139403 (+ 13081us) service_pool.cc:224] Handling call
0709 13:19:46.140147 (+1000744us) spinlock_profiling.cc:243] Waited 38.4 ms on lock 0x7b5800000c98. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0c745db1 00007fcc0c885b71 00007fcc0c885a22 00007fcc1579ec09 00007fcc148f8ee0 00007fcc149c20ab 00007fcc149c2131 00007fcc14983fc0 00007fcc1496e929 00007fcc1496e3d2 00007fcc0dee5bd4
0709 13:19:46.140402 (+   255us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:46.141088 (+   686us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:46.141121 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:46.141658 (+   537us) log.cc:844] Serialized 26 byte log entry
0709 13:19:46.526538 (+384880us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:19:46.526600 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:46.526672 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:47.752648 (+1225976us) spinlock_profiling.cc:243] Waited 47.9 ms on lock 0x7b4400022b4c. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0c745db1 00007fcc0c7e3c85 00007fcc0c7e46a2 00007fcc0f5561db 00007fcc0f551aaf 00007fcc0f54586e 00007fcc0f544bb6 00007fcc0f5447d8 00007fcc0f54e221 00007fcc0f54e1d9 00007fcc0f54e169
0709 13:19:47.842499 (+ 89851us) raft_consensus.cc:1685] finished
0709 13:19:47.842522 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:47.842688 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5160,"raft.queue_time_us":918,"raft.run_cpu_time_us":127,"raft.run_wall_time_us":7241,"spinlock_wait_cycles":198538880,"thread_start_us":244372,"threads_started":1,"wal-append.queue_time_us":437319}
W20260709 13:19:47.944098  7466 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:47.953521  6846 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:47.849861 10265 raft_consensus.cc:515] T 7a734b5ab7834e05a8c422208acc58b1 P cd75a17ab2604397adab03bb8b5fd75c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:47.842833 10063 raft_consensus.cc:3055] T 3411566abe2d4c9bb4b2adfdd05e6f17 P b7ab4784c7344b939bc36f639286f377 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:19:48.010977  6872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f03d0dbf16864ca4bc1bb5e4c0334c0f" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:19:48.016654  6872 raft_consensus.cc:2468] T f03d0dbf16864ca4bc1bb5e4c0334c0f P cd75a17ab2604397adab03bb8b5fd75c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 7.
I20260709 13:19:48.012189  6877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8292e16e5654be6bc408560cf256aaa" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:19:48.018260  6877 raft_consensus.cc:3060] T d8292e16e5654be6bc408560cf256aaa P cd75a17ab2604397adab03bb8b5fd75c [term 10 FOLLOWER]: Advancing to term 12
W20260709 13:19:48.013571  6772 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.68:45071, user_credentials={real_user=slave}} blocked reactor thread for 139208us
W20260709 13:19:47.849908  7494 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50744 (request call id 278) took 1587 ms (client timeout 1555 ms). Trace:
I20260709 13:19:47.861027  9852 raft_consensus.cc:3060] T 07a92dd554674067a83a9cb68c4773f2 P b7ab4784c7344b939bc36f639286f377 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:47.857626 10259 leader_election.cc:290] T 7ba5dac66ab5497e9e336f2a3c28cda5 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:19:47.878089 10241 raft_consensus.cc:2804] T 7887766dc6784fcaa42b35c05fea7a99 P b7ab4784c7344b939bc36f639286f377 [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 13:19:48.031214  6846 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:48.031338  6802 raft_consensus.cc:1240] T f58dc08b12a2494bb9a1372837970ca2 P b7ab4784c7344b939bc36f639286f377 [term 12 FOLLOWER]: Rejecting Update request from peer ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 11. Current term is 12. Ops: [11.6-11.6]
I20260709 13:19:47.857823 10102 raft_consensus.cc:493] T bb7fa124c3bf4ef9ab65a407cb008441 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:19:47.864094 10249 raft_consensus.cc:2749] T 90d42e216d9741e190bca19a781291fd P b7ab4784c7344b939bc36f639286f377 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:19:48.024601  6770 leader_election.cc:304] T 4275cf08e63345f993bce8664eada830 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
I20260709 13:19:48.037223  6879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c7f33e544204fbaac4078e3e83bbf4e" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:19:48.053784  6879 raft_consensus.cc:2468] T 8c7f33e544204fbaac4078e3e83bbf4e P cd75a17ab2604397adab03bb8b5fd75c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 6.
I20260709 13:19:48.060482  6872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44bde925b2e541b69890d70715b85176" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:19:48.061163  6872 raft_consensus.cc:2468] T 44bde925b2e541b69890d70715b85176 P cd75a17ab2604397adab03bb8b5fd75c [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 9.
I20260709 13:19:48.063660  6806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09c2a98de1a4decabd0ff900dd44caa" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:19:48.064522  6806 raft_consensus.cc:3060] T f09c2a98de1a4decabd0ff900dd44caa P b7ab4784c7344b939bc36f639286f377 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:48.073081  6879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c37d41cd9164c15a6826ca62a851a69" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:19:48.074015  6879 raft_consensus.cc:2468] T 7c37d41cd9164c15a6826ca62a851a69 P cd75a17ab2604397adab03bb8b5fd75c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 7.
I20260709 13:19:48.075145  6879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f58dc08b12a2494bb9a1372837970ca2" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:19:48.016026 10063 raft_consensus.cc:740] T 3411566abe2d4c9bb4b2adfdd05e6f17 P b7ab4784c7344b939bc36f639286f377 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
I20260709 13:19:48.034093 10182 raft_consensus.cc:493] T d33d5ee8ef6f415593d8df52063161ad P cd75a17ab2604397adab03bb8b5fd75c [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:48.079493  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 269942us
I20260709 13:19:48.075834  6879 raft_consensus.cc:3060] T f58dc08b12a2494bb9a1372837970ca2 P cd75a17ab2604397adab03bb8b5fd75c [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:47.883719  9999 consensus_queue.cc:1059] T 4d9def8b32fd443aa94ab1420b06837b P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.176s
I20260709 13:19:48.082858  6877 raft_consensus.cc:2468] T d8292e16e5654be6bc408560cf256aaa P cd75a17ab2604397adab03bb8b5fd75c [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 12.
W20260709 13:19:48.079627  6770 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 63835.8us
I20260709 13:19:48.088553  6802 raft_consensus.cc:1240] T de3186201e1a40d0b335eeb8b4e256e0 P b7ab4784c7344b939bc36f639286f377 [term 10 FOLLOWER]: Rejecting Update request from peer ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 9. Current term is 10. Ops: []
I20260709 13:19:48.033560  9836 leader_election.cc:290] T 20f6842e26174571996b8dea4151d4be P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 10 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:48.090487  6872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4b8bd455d5a47c18a1380839c6e0d61" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:19:48.041844 10241 raft_consensus.cc:493] T 7887766dc6784fcaa42b35c05fea7a99 P b7ab4784c7344b939bc36f639286f377 [term 9 FOLLOWER]: Starting leader election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:19:48.047762  7495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ba5dac66ab5497e9e336f2a3c28cda5" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
W20260709 13:19:48.078368 10214 log.cc:927] Time spent T be1a92657f494cac8dd227d152f50151 P b7ab4784c7344b939bc36f639286f377: Append to log took a long time: real 0.054s	user 0.001s	sys 0.000s
I20260709 13:19:48.128197  6730 raft_consensus.cc:1275] T e31b9971c15848dea59d4d4130141d9e P ccd8a4c3bfe3413cb2ae219b09aea832 [term 7 FOLLOWER]: Refusing update from remote peer b7ab4784c7344b939bc36f639286f377: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:19:48.059095 10178 leader_election.cc:290] T de3186201e1a40d0b335eeb8b4e256e0 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 10 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:48.088238 10268 raft_consensus.cc:2804] T 4275cf08e63345f993bce8664eada830 P b7ab4784c7344b939bc36f639286f377 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:19:48.132081 10241 raft_consensus.cc:3060] T 7887766dc6784fcaa42b35c05fea7a99 P b7ab4784c7344b939bc36f639286f377 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:19:48.027104  7494 rpcz_store.cc:269] 0709 13:19:46.262209 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:46.264817 (+  2608us) service_pool.cc:224] Handling call
0709 13:19:47.849667 (+1584850us) spinlock_profiling.cc:243] Waited 102 ms on lock 0x7b54005802d4. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f9ae2fa 00007fcc1496fb17 00007fcc0deea6d4 00007fcc0deea662 00007fcc0deea591 00007fcc0deea50c 00007fcc0dee97c2 00007fcc0dce548c 00007fcc0dce48c6 00007fcc0dce426f
0709 13:19:47.849795 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":234744576}
I20260709 13:19:48.207733  6844 leader_election.cc:304] T ce4f062dcd314d43a63ca74067cb5ee3 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:19:48.067077 10102 raft_consensus.cc:515] T bb7fa124c3bf4ef9ab65a407cb008441 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:19:48.342377  6806 raft_consensus.cc:2468] T f09c2a98de1a4decabd0ff900dd44caa P b7ab4784c7344b939bc36f639286f377 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 11.
W20260709 13:19:48.349751  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 217437us
W20260709 13:19:48.355207  6846 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:48.114048 10182 raft_consensus.cc:515] T d33d5ee8ef6f415593d8df52063161ad P cd75a17ab2604397adab03bb8b5fd75c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
W20260709 13:19:48.369570  6846 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:48.297125 10275 raft_consensus.cc:3055] T 4d9def8b32fd443aa94ab1420b06837b P cd75a17ab2604397adab03bb8b5fd75c [term 8 LEADER]: Stepping down as leader of term 8
W20260709 13:19:48.354219 10255 log.cc:927] Time spent T 22ccee1b570c4ad3a57bd7aec085b1b4 P b7ab4784c7344b939bc36f639286f377: Append to log took a long time: real 0.142s	user 0.000s	sys 0.000s
W20260709 13:19:48.422837 10261 log.cc:927] Time spent T 1bf4668eeb70467fb3dc5a0289233b3c P b7ab4784c7344b939bc36f639286f377: Append to log took a long time: real 0.054s	user 0.001s	sys 0.000s
I20260709 13:19:48.365402 10274 raft_consensus.cc:493] T f5be3a11b23d4ea9b08300a2789821c7 P cd75a17ab2604397adab03bb8b5fd75c [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:48.417693 10259 raft_consensus.cc:2804] T ce4f062dcd314d43a63ca74067cb5ee3 P cd75a17ab2604397adab03bb8b5fd75c [term 8 FOLLOWER]: Leader election won for term 8
W20260709 13:19:48.468850  6846 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:48.529675 10219 raft_consensus.cc:493] T 4d9def8b32fd443aa94ab1420b06837b P ccd8a4c3bfe3413cb2ae219b09aea832 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:48.546864  7468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 247920us
W20260709 13:19:48.568320 10231 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.313s	user 0.022s	sys 0.069s
W20260709 13:19:48.569061 10231 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.772s	user 0.022s	sys 0.070s
I20260709 13:19:48.427466 10269 raft_consensus.cc:2804] T d8292e16e5654be6bc408560cf256aaa P b7ab4784c7344b939bc36f639286f377 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:19:48.425419 10275 raft_consensus.cc:740] T 4d9def8b32fd443aa94ab1420b06837b P cd75a17ab2604397adab03bb8b5fd75c [term 8 LEADER]: Becoming Follower/Learner. State: Replica: cd75a17ab2604397adab03bb8b5fd75c, State: Running, Role: LEADER
I20260709 13:19:48.297528 10063 consensus_queue.cc:260] T 3411566abe2d4c9bb4b2adfdd05e6f17 P b7ab4784c7344b939bc36f639286f377 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
W20260709 13:19:48.593410  6772 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.531s	user 0.033s	sys 0.043s
W20260709 13:19:48.593855  6772 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.532s	user 0.033s	sys 0.043s
W20260709 13:19:48.594168  6772 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.68:45071, user_credentials={real_user=slave}} blocked reactor thread for 573048us
I20260709 13:19:48.608341  7503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "427c124d773f483294511e80fe340075" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:19:48.612474  6877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce4f062dcd314d43a63ca74067cb5ee3" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
W20260709 13:19:48.615424  6847 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:48.612113  7503 raft_consensus.cc:2468] T 427c124d773f483294511e80fe340075 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 8.
W20260709 13:19:48.617633  6770 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 521346us
I20260709 13:19:48.621423  6806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce4f062dcd314d43a63ca74067cb5ee3" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:19:48.622452  6806 raft_consensus.cc:2393] T ce4f062dcd314d43a63ca74067cb5ee3 P b7ab4784c7344b939bc36f639286f377 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate ccd8a4c3bfe3413cb2ae219b09aea832 in current term 9: Already voted for candidate b7ab4784c7344b939bc36f639286f377 in this term.
I20260709 13:19:48.639156 10184 leader_election.cc:290] T bd6869f07b5a4885a0b99fbe60c3b175 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 10 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
W20260709 13:19:48.644604  6875 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.512s	user 0.019s	sys 0.024s
W20260709 13:19:48.646194  6875 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.513s	user 0.019s	sys 0.024s
W20260709 13:19:48.649267  6799 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.527s	user 0.000s	sys 0.010s
W20260709 13:19:48.650015  6799 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.527s	user 0.000s	sys 0.010s
I20260709 13:19:48.561172 10219 raft_consensus.cc:515] T 4d9def8b32fd443aa94ab1420b06837b P ccd8a4c3bfe3413cb2ae219b09aea832 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:48.660895  6872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1704639a875409b9959353527b3fd68" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:19:48.664469  6872 raft_consensus.cc:3060] T a1704639a875409b9959353527b3fd68 P cd75a17ab2604397adab03bb8b5fd75c [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:19:48.668301  6798 consensus_meta.cc:287] T 30e88460611e47b2ba16a46a30b5f416 P b7ab4784c7344b939bc36f639286f377: Time spent flushing consensus metadata: real 0.811s	user 0.013s	sys 0.000s
I20260709 13:19:48.669269  6798 raft_consensus.cc:2468] T 30e88460611e47b2ba16a46a30b5f416 P b7ab4784c7344b939bc36f639286f377 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 9.
I20260709 13:19:48.651046  9864 raft_consensus.cc:493] T 4f00a2e87e56452083b759f60d461ee3 P b7ab4784c7344b939bc36f639286f377 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:48.562644 10274 raft_consensus.cc:515] T f5be3a11b23d4ea9b08300a2789821c7 P cd75a17ab2604397adab03bb8b5fd75c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:48.650588 10270 raft_consensus.cc:493] T c4db81d9d329422bb3b4160ca4ac2d1d P b7ab4784c7344b939bc36f639286f377 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:19:48.620472 10265 leader_election.cc:290] T 7a734b5ab7834e05a8c422208acc58b1 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
W20260709 13:19:48.679648  6845 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:48.658710 10063 raft_consensus.cc:3060] T 3411566abe2d4c9bb4b2adfdd05e6f17 P b7ab4784c7344b939bc36f639286f377 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:19:48.672358 10273 log.cc:927] Time spent T f4b8bd455d5a47c18a1380839c6e0d61 P ccd8a4c3bfe3413cb2ae219b09aea832: Append to log took a long time: real 0.605s	user 0.000s	sys 0.001s
I20260709 13:19:48.651742 10269 raft_consensus.cc:697] T d8292e16e5654be6bc408560cf256aaa P b7ab4784c7344b939bc36f639286f377 [term 12 LEADER]: Becoming Leader. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
W20260709 13:19:48.714351  6800 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.571s	user 0.024s	sys 0.045s
W20260709 13:19:48.714879  6800 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.572s	user 0.024s	sys 0.045s
I20260709 13:19:48.691933  7502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17587d6730594da4a56fa13a353232a1" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb"
I20260709 13:19:48.715746  7502 raft_consensus.cc:3060] T 17587d6730594da4a56fa13a353232a1 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:19:48.730003  6773 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:48.694281 10265 raft_consensus.cc:493] T a3022224cc81473690653a83d4e99470 P cd75a17ab2604397adab03bb8b5fd75c [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:19:48.710356  7500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3f13b31a1f84f0d89d007eadd57924c" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:19:48.658115 10268 raft_consensus.cc:697] T 4275cf08e63345f993bce8664eada830 P b7ab4784c7344b939bc36f639286f377 [term 10 LEADER]: Becoming Leader. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
I20260709 13:19:48.695374 10270 raft_consensus.cc:515] T c4db81d9d329422bb3b4160ca4ac2d1d P b7ab4784c7344b939bc36f639286f377 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
W20260709 13:19:48.729663 10258 log.cc:927] Time spent T bd6869f07b5a4885a0b99fbe60c3b175 P ccd8a4c3bfe3413cb2ae219b09aea832: Append to log took a long time: real 0.640s	user 0.000s	sys 0.001s
I20260709 13:19:48.694957  9864 raft_consensus.cc:515] T 4f00a2e87e56452083b759f60d461ee3 P b7ab4784c7344b939bc36f639286f377 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:19:48.729525 10102 leader_election.cc:290] T bb7fa124c3bf4ef9ab65a407cb008441 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:48.791898  6772 leader_election.cc:304] T 427c124d773f483294511e80fe340075 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
I20260709 13:19:48.794461  6872 raft_consensus.cc:2468] T a1704639a875409b9959353527b3fd68 P cd75a17ab2604397adab03bb8b5fd75c [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 10.
W20260709 13:19:48.796659  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 376896us
I20260709 13:19:48.729172 10184 consensus_queue.cc:1059] T 3d65025eea89441290d85dd053810e31 P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.057s
W20260709 13:19:48.783108 10277 log.cc:927] Time spent T bb3d8792045a4583ae2e965b1350a5b4 P cd75a17ab2604397adab03bb8b5fd75c: Append to log took a long time: real 0.476s	user 0.002s	sys 0.005s
I20260709 13:19:48.811301  6872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de3186201e1a40d0b335eeb8b4e256e0" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:19:48.812453  6872 raft_consensus.cc:2393] T de3186201e1a40d0b335eeb8b4e256e0 P cd75a17ab2604397adab03bb8b5fd75c [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate b7ab4784c7344b939bc36f639286f377 in current term 10: Already voted for candidate cd75a17ab2604397adab03bb8b5fd75c in this term.
I20260709 13:19:48.813800  6872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4275cf08e63345f993bce8664eada830" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:19:48.814479  6872 raft_consensus.cc:3060] T 4275cf08e63345f993bce8664eada830 P cd75a17ab2604397adab03bb8b5fd75c [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:48.782855 10182 leader_election.cc:290] T d33d5ee8ef6f415593d8df52063161ad P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
W20260709 13:19:48.827605  6879 consensus_meta.cc:287] T f58dc08b12a2494bb9a1372837970ca2 P cd75a17ab2604397adab03bb8b5fd75c: Time spent flushing consensus metadata: real 0.688s	user 0.013s	sys 0.000s
I20260709 13:19:48.830168  6879 raft_consensus.cc:2468] T f58dc08b12a2494bb9a1372837970ca2 P cd75a17ab2604397adab03bb8b5fd75c [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 12.
W20260709 13:19:48.832454  6773 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:48.761579 10265 raft_consensus.cc:515] T a3022224cc81473690653a83d4e99470 P cd75a17ab2604397adab03bb8b5fd75c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
W20260709 13:19:48.849434  6803 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.707s	user 0.003s	sys 0.002s
W20260709 13:19:48.825587 10157 consensus_meta.cc:287] T 7c44c4849aa54f2b94d1f1bef9ed546f P b7ab4784c7344b939bc36f639286f377: Time spent flushing consensus metadata: real 0.990s	user 0.011s	sys 0.002s
I20260709 13:19:48.850394  6879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f00a2e87e56452083b759f60d461ee3" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:19:48.889424  6872 raft_consensus.cc:2468] T 4275cf08e63345f993bce8664eada830 P cd75a17ab2604397adab03bb8b5fd75c [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 10.
I20260709 13:19:48.890172  6872 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53406 (request call id 1825) took 1013 ms. Trace:
I20260709 13:19:48.890376  6879 raft_consensus.cc:2410] T 4f00a2e87e56452083b759f60d461ee3 P cd75a17ab2604397adab03bb8b5fd75c [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ba59cc884714e8aa5f3f0ecaed84cbb for term 9 because replica has last-logged OpId of term: 8 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 8.
I20260709 13:19:48.891870  6879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24ee15416e3145beaa1b8183453729a3" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
W20260709 13:19:48.898402  6846 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:48.885488  6803 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.743s	user 0.005s	sys 0.009s
I20260709 13:19:48.898500  6879 raft_consensus.cc:3060] T 24ee15416e3145beaa1b8183453729a3 P cd75a17ab2604397adab03bb8b5fd75c [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:48.890590  6872 rpcz_store.cc:276] 0709 13:19:47.876308 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:48.813491 (+937183us) service_pool.cc:224] Handling call
0709 13:19:48.890095 (+ 76604us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:19:48.907958  6772 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.68:45071, user_credentials={real_user=slave}} blocked reactor thread for 116149us
I20260709 13:19:48.921277  6772 leader_election.cc:304] T f03d0dbf16864ca4bc1bb5e4c0334c0f P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:19:48.887032 10115 raft_consensus.cc:493] T d8cee0accdb8499c86d4414b72565a38 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:48.936319  6878 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.729s	user 0.008s	sys 0.043s
W20260709 13:19:48.937017  6878 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.733s	user 0.009s	sys 0.043s
I20260709 13:19:48.931464  6872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20f6842e26174571996b8dea4151d4be" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 10 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:19:48.940004  6872 raft_consensus.cc:3060] T 20f6842e26174571996b8dea4151d4be P cd75a17ab2604397adab03bb8b5fd75c [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:19:48.961251  6846 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:48.963166  6872 raft_consensus.cc:2410] T 20f6842e26174571996b8dea4151d4be P cd75a17ab2604397adab03bb8b5fd75c [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate b7ab4784c7344b939bc36f639286f377 for term 10 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 5.
W20260709 13:19:48.969756  6772 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 48577us
I20260709 13:19:48.971558  6772 leader_election.cc:304] T 8c7f33e544204fbaac4078e3e83bbf4e P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:19:48.967968  6879 raft_consensus.cc:2468] T 24ee15416e3145beaa1b8183453729a3 P cd75a17ab2604397adab03bb8b5fd75c [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in term 9.
I20260709 13:19:48.974622  6879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d9def8b32fd443aa94ab1420b06837b" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:19:48.913314 10102 raft_consensus.cc:493] T 4f00a2e87e56452083b759f60d461ee3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:48.986213  6731 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50004 (request call id 1702) took 3875 ms. Trace:
I20260709 13:19:48.990597  6772 leader_election.cc:304] T 44bde925b2e541b69890d70715b85176 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:19:48.986739  6731 rpcz_store.cc:276] 0709 13:19:45.110741 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:45.130859 (+ 20118us) service_pool.cc:224] Handling call
0709 13:19:46.233440 (+1102581us) spinlock_profiling.cc:243] Waited 38 ms on lock 0x7b5800000c98. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0c745db1 00007fcc0c885b71 00007fcc0c885a22 00007fcc1579ec09 00007fcc148f8ee0 00007fcc149c20ab 00007fcc149c2131 00007fcc14983fc0 00007fcc1496e929 00007fcc1496e3d2 00007fcc0dee5bd4
0709 13:19:46.233689 (+   249us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:47.192773 (+959084us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:48.985937 (+1793164us) spinlock_profiling.cc:243] Waited 907 ms on lock 0x7b5400166f54. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f9aae01 00007fcc0f9a983e 00007fcc1496e419 00007fcc0dee5bd4 00007fcc0dee5b62 00007fcc0dee5a91 00007fcc0dee5a0c 00007fcc0dee4cc2 00007fcc0dce548c 00007fcc0dce48c6
0709 13:19:48.986145 (+   208us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2173679744}
I20260709 13:19:48.929831 10219 leader_election.cc:290] T 4d9def8b32fd443aa94ab1420b06837b P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
W20260709 13:19:49.001605  6801 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.691s	user 0.011s	sys 0.011s
W20260709 13:19:49.002578  6801 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.701s	user 0.011s	sys 0.011s
I20260709 13:19:48.826328 10269 consensus_queue.cc:237] T d8292e16e5654be6bc408560cf256aaa P b7ab4784c7344b939bc36f639286f377 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
W20260709 13:19:49.004392  6846 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:49.006381 10310 log.cc:927] Time spent T f4b8bd455d5a47c18a1380839c6e0d61 P b7ab4784c7344b939bc36f639286f377: Append to log took a long time: real 0.059s	user 0.001s	sys 0.000s
I20260709 13:19:48.969231 10115 raft_consensus.cc:515] T d8cee0accdb8499c86d4414b72565a38 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:19:48.995524 10102 raft_consensus.cc:515] T 4f00a2e87e56452083b759f60d461ee3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:19:49.016515  6772 leader_election.cc:304] T 7c37d41cd9164c15a6826ca62a851a69 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:19:48.969372 10268 consensus_queue.cc:237] T 4275cf08e63345f993bce8664eada830 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 8.4, Last appended by leader: 4, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:49.037729  6879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3d8792045a4583ae2e965b1350a5b4" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:19:49.191282  6803 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:32976 (request call id 2532) took 1165 ms. Trace:
W20260709 13:19:49.191753  6772 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 175339us
I20260709 13:19:49.193279  6772 leader_election.cc:304] T a1704639a875409b9959353527b3fd68 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:19:49.188695  6801 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:32976 (request call id 2534) took 1144 ms. Trace:
I20260709 13:19:49.003041 10303 raft_consensus.cc:2804] T 427c124d773f483294511e80fe340075 P b7ab4784c7344b939bc36f639286f377 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:19:49.044139  7500 raft_consensus.cc:1275] T bb3d8792045a4583ae2e965b1350a5b4 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 9 FOLLOWER]: Refusing update from remote peer cd75a17ab2604397adab03bb8b5fd75c: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
W20260709 13:19:49.103627 10231 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.528s	user 0.002s	sys 0.004s
I20260709 13:19:49.083963 10275 consensus_queue.cc:260] T 4d9def8b32fd443aa94ab1420b06837b P cd75a17ab2604397adab03bb8b5fd75c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:49.194733  6801 rpcz_store.cc:276] 0709 13:19:48.044153 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:48.044319 (+   166us) service_pool.cc:224] Handling call
0709 13:19:48.082892 (+ 38573us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:48.083117 (+   225us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:19:48.301250 (+218133us) log.cc:844] Serialized 14 byte log entry
0709 13:19:49.188128 (+886878us) log.cc:844] Serialized 14 byte log entry
0709 13:19:49.188330 (+   202us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:49.188373 (+    43us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:19:49.188423 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:49.188505 (+    82us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:49.188636 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":146625,"prepare.queue_time_us":605739,"prepare.run_cpu_time_us":108,"prepare.run_wall_time_us":111,"raft.queue_time_us":95489,"raft.run_cpu_time_us":357,"raft.run_wall_time_us":16263,"thread_start_us":886048,"threads_started":2,"wal-append.queue_time_us":887401}
W20260709 13:19:49.058970 10113 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.631s	user 0.008s	sys 0.024s
I20260709 13:19:49.194878  6772 leader_election.cc:304] T f58dc08b12a2494bb9a1372837970ca2 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
W20260709 13:19:49.201786  6695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 422648us
I20260709 13:19:49.191761  6803 rpcz_store.cc:276] 0709 13:19:48.025951 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:48.026161 (+   210us) service_pool.cc:224] Handling call
0709 13:19:48.026663 (+   502us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:48.060343 (+ 33680us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:48.060376 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:48.060932 (+   556us) log.cc:844] Serialized 26 byte log entry
0709 13:19:48.918291 (+857359us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:19:48.918343 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:48.918435 (+    92us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:49.191058 (+272623us) raft_consensus.cc:1685] finished
0709 13:19:49.191077 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:49.191216 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":552149,"raft.queue_time_us":24119,"raft.run_cpu_time_us":161,"raft.run_wall_time_us":15076,"thread_start_us":775546,"threads_started":1,"wal-append.queue_time_us":893127}
W20260709 13:19:49.067986 10241 consensus_meta.cc:287] T 7887766dc6784fcaa42b35c05fea7a99 P b7ab4784c7344b939bc36f639286f377: Time spent flushing consensus metadata: real 0.763s	user 0.010s	sys 0.000s
I20260709 13:19:49.196292 10274 leader_election.cc:290] T f5be3a11b23d4ea9b08300a2789821c7 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
W20260709 13:19:49.214227  6773 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:49.191484 10249 raft_consensus.cc:2804] T 8c7f33e544204fbaac4078e3e83bbf4e P b7ab4784c7344b939bc36f639286f377 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:19:49.216017  6845 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:49.063807  9864 leader_election.cc:290] T 4f00a2e87e56452083b759f60d461ee3 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:19:49.063198 10228 leader_election.cc:290] T 711ef6523deb4cbe8ef2ba61e1c21c98 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:49.117818 10270 leader_election.cc:290] T c4db81d9d329422bb3b4160ca4ac2d1d P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:49.052472 10299 raft_consensus.cc:3055] T 3d65025eea89441290d85dd053810e31 P cd75a17ab2604397adab03bb8b5fd75c [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:19:49.219735  7502 raft_consensus.cc:2468] T 17587d6730594da4a56fa13a353232a1 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 13.
I20260709 13:19:49.116024 10259 raft_consensus.cc:697] T ce4f062dcd314d43a63ca74067cb5ee3 P cd75a17ab2604397adab03bb8b5fd75c [term 8 LEADER]: Becoming Leader. State: Replica: cd75a17ab2604397adab03bb8b5fd75c, State: Running, Role: LEADER
W20260709 13:19:49.203866 10231 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.634s	user 0.002s	sys 0.009s
I20260709 13:19:49.224529  6799 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:32976 (request call id 2529) took 1363 ms. Trace:
I20260709 13:19:49.042225 10182 raft_consensus.cc:493] T 30e88460611e47b2ba16a46a30b5f416 P cd75a17ab2604397adab03bb8b5fd75c [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:49.219897  6879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb7fa124c3bf4ef9ab65a407cb008441" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
W20260709 13:19:49.225308  6771 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:49.216873 10113 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.814s	user 0.010s	sys 0.031s
I20260709 13:19:49.258720  7502 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50744 (request call id 285) took 1171 ms. Trace:
I20260709 13:19:49.203549 10303 raft_consensus.cc:493] T 427c124d773f483294511e80fe340075 P b7ab4784c7344b939bc36f639286f377 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:19:49.259354 10287 log.cc:927] Time spent T 7a734b5ab7834e05a8c422208acc58b1 P cd75a17ab2604397adab03bb8b5fd75c: Append to log took a long time: real 0.097s	user 0.000s	sys 0.000s
I20260709 13:19:49.260315  7500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8cee0accdb8499c86d4414b72565a38" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb"
W20260709 13:19:49.226727 10298 log.cc:927] Time spent T 2c240553ce044eedb41541d72b9475d7 P b7ab4784c7344b939bc36f639286f377: Append to log took a long time: real 0.085s	user 0.001s	sys 0.000s
I20260709 13:19:49.264106 10322 consensus_queue.cc:1059] T f58dc08b12a2494bb9a1372837970ca2 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: INVALID_TERM, Last received: 10.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.061s
I20260709 13:19:49.261474 10314 raft_consensus.cc:2804] T a1704639a875409b9959353527b3fd68 P b7ab4784c7344b939bc36f639286f377 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:19:49.331593  6875 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53406 (request call id 1822) took 1456 ms. Trace:
I20260709 13:19:49.332017  6875 rpcz_store.cc:276] 0709 13:19:47.875043 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:47.875222 (+   179us) service_pool.cc:224] Handling call
0709 13:19:48.011666 (+136444us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:48.042546 (+ 30880us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:48.042582 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:48.043244 (+   662us) log.cc:844] Serialized 26 byte log entry
0709 13:19:48.647742 (+604498us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:19:48.647803 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:48.647907 (+   104us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:49.331305 (+683398us) raft_consensus.cc:1685] finished
0709 13:19:49.331333 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:49.331516 (+   183us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":89389,"raft.queue_time_us":61095,"raft.run_cpu_time_us":214,"raft.run_wall_time_us":34057,"thread_start_us":514565,"threads_started":1,"wal-append.queue_time_us":1109778}
I20260709 13:19:49.259647 10307 raft_consensus.cc:493] T 7c44c4849aa54f2b94d1f1bef9ed546f P b7ab4784c7344b939bc36f639286f377 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:49.274037  6879 raft_consensus.cc:2393] T bb7fa124c3bf4ef9ab65a407cb008441 P cd75a17ab2604397adab03bb8b5fd75c [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in current term 9: Already voted for candidate cd75a17ab2604397adab03bb8b5fd75c in this term.
I20260709 13:19:49.261488 10301 raft_consensus.cc:2804] T f58dc08b12a2494bb9a1372837970ca2 P b7ab4784c7344b939bc36f639286f377 [term 12 FOLLOWER]: Leader election won for term 12
W20260709 13:19:49.255081 10294 log.cc:927] Time spent T f3f9c2e2bf644115957398fe4c9459db P b7ab4784c7344b939bc36f639286f377: Append to log took a long time: real 0.208s	user 0.002s	sys 0.000s
W20260709 13:19:49.310935  6773 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:49.253902 10275 raft_consensus.cc:3060] T 4d9def8b32fd443aa94ab1420b06837b P cd75a17ab2604397adab03bb8b5fd75c [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:49.273280  7502 rpcz_store.cc:276] 0709 13:19:48.087857 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:48.281039 (+193182us) service_pool.cc:224] Handling call
0709 13:19:49.258644 (+977605us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:49.261883  6799 rpcz_store.cc:276] 0709 13:19:47.861254 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:47.861737 (+   483us) service_pool.cc:224] Handling call
0709 13:19:48.009766 (+148029us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:48.010054 (+   288us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:19:48.650532 (+640478us) log.cc:844] Serialized 14 byte log entry
0709 13:19:48.906497 (+255965us) log.cc:844] Serialized 14 byte log entry
0709 13:19:49.069700 (+163203us) spinlock_profiling.cc:243] Waited 7.69 ms on lock 0x7b18003bee40. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc15785de1 00007fcc157925b1 00007fcc0c89fe07 00007fcc156faab9 00007fcc0c8bc69b 00007fcc0c8ba93f 00007fcc0c8ba455 00007fcc0f9a2060 00007fcc0f9b4716 00007fcc0f9c5287 00007fcc0f9c5208
0709 13:19:49.213460 (+143760us) log.cc:844] Serialized 14 byte log entry
0709 13:19:49.216420 (+  2960us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:49.216468 (+    48us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:19:49.216515 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:49.216584 (+    69us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:49.224423 (+  7839us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":81744,"prepare.queue_time_us":602741,"prepare.run_cpu_time_us":112,"prepare.run_wall_time_us":30978,"raft.queue_time_us":293882,"raft.run_cpu_time_us":527,"raft.run_wall_time_us":38986,"spinlock_wait_cycles":54118528,"thread_start_us":877857,"threads_started":4,"wal-append.queue_time_us":389165}
I20260709 13:19:49.256264  9864 raft_consensus.cc:493] T 3a485a995abc4807b6e511e45419f737 P b7ab4784c7344b939bc36f639286f377 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:19:49.263439 10259 consensus_queue.cc:237] T ce4f062dcd314d43a63ca74067cb5ee3 P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 8, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } attrs { replace: true } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:19:49.332979 10115 leader_election.cc:290] T d8cee0accdb8499c86d4414b72565a38 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:49.261751  7503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f00a2e87e56452083b759f60d461ee3" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:19:49.377565  7503 raft_consensus.cc:2468] T 4f00a2e87e56452083b759f60d461ee3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 9.
I20260709 13:19:49.258553 10299 raft_consensus.cc:740] T 3d65025eea89441290d85dd053810e31 P cd75a17ab2604397adab03bb8b5fd75c [term 7 LEADER]: Becoming Follower/Learner. State: Replica: cd75a17ab2604397adab03bb8b5fd75c, State: Running, Role: LEADER
I20260709 13:19:49.223847 10241 raft_consensus.cc:515] T 7887766dc6784fcaa42b35c05fea7a99 P b7ab4784c7344b939bc36f639286f377 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:49.259464 10313 raft_consensus.cc:2804] T f03d0dbf16864ca4bc1bb5e4c0334c0f P b7ab4784c7344b939bc36f639286f377 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:19:49.326792  7500 raft_consensus.cc:2376] T d8cee0accdb8499c86d4414b72565a38 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 9. Re-sending same reply.
W20260709 13:19:49.324790 10187 consensus_meta.cc:287] T 2c240553ce044eedb41541d72b9475d7 P cd75a17ab2604397adab03bb8b5fd75c: Time spent flushing consensus metadata: real 1.311s	user 0.006s	sys 0.010s
W20260709 13:19:49.354506  7468 leader_election.cc:336] T 4b8cacb381b746da8d0049b0a83b41dd P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931): Timed out: RequestConsensusVote RPC to 127.5.126.67:42931 timed out after 3.721s (SENT)
I20260709 13:19:49.381057  7498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce4f062dcd314d43a63ca74067cb5ee3" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb"
I20260709 13:19:49.382272  7468 leader_election.cc:304] T 4b8cacb381b746da8d0049b0a83b41dd P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:19:49.258749 10300 raft_consensus.cc:2804] T 44bde925b2e541b69890d70715b85176 P b7ab4784c7344b939bc36f639286f377 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:19:49.226850 10318 raft_consensus.cc:2804] T 7c37d41cd9164c15a6826ca62a851a69 P b7ab4784c7344b939bc36f639286f377 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:19:49.355182 10306 raft_consensus.cc:493] T dbdf895bba214ff68685a24fd17dfb5d P b7ab4784c7344b939bc36f639286f377 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:49.339273 10160 consensus_meta.cc:287] T a3022224cc81473690653a83d4e99470 P b7ab4784c7344b939bc36f639286f377: Time spent flushing consensus metadata: real 1.495s	user 0.012s	sys 0.005s
I20260709 13:19:49.369277  6772 leader_election.cc:304] T 17587d6730594da4a56fa13a353232a1 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, b7ab4784c7344b939bc36f639286f377; no voters: 
W20260709 13:19:49.226402 10279 log.cc:927] Time spent T 8c7f33e544204fbaac4078e3e83bbf4e P ccd8a4c3bfe3413cb2ae219b09aea832: Append to log took a long time: real 0.276s	user 0.000s	sys 0.001s
I20260709 13:19:49.329419 10303 raft_consensus.cc:3060] T 427c124d773f483294511e80fe340075 P b7ab4784c7344b939bc36f639286f377 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:49.375993  6726 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50004 (request call id 1728) took 2998 ms. Trace:
I20260709 13:19:49.413722  6726 rpcz_store.cc:276] 0709 13:19:46.377890 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:46.519981 (+142091us) service_pool.cc:224] Handling call
0709 13:19:46.520340 (+   359us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:47.194931 (+674591us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:49.375756 (+2180825us) spinlock_profiling.cc:243] Waited 674 ms on lock 0x7b54000992d4. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f9aae01 00007fcc0f9a983e 00007fcc1496e419 00007fcc0dee5bd4 00007fcc0dee5b62 00007fcc0dee5a91 00007fcc0dee5a0c 00007fcc0dee4cc2 00007fcc0dce548c 00007fcc0dce48c6
0709 13:19:49.375931 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1549696896}
I20260709 13:19:49.326699 10182 raft_consensus.cc:515] T 30e88460611e47b2ba16a46a30b5f416 P cd75a17ab2604397adab03bb8b5fd75c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:49.334143  6875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f00a2e87e56452083b759f60d461ee3" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:19:49.382776  7498 raft_consensus.cc:3060] T ce4f062dcd314d43a63ca74067cb5ee3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:49.416478  6875 raft_consensus.cc:2410] T 4f00a2e87e56452083b759f60d461ee3 P cd75a17ab2604397adab03bb8b5fd75c [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7ab4784c7344b939bc36f639286f377 for term 10 because replica has last-logged OpId of term: 8 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 8.
I20260709 13:19:49.387751 10115 raft_consensus.cc:2749] T 4b8cacb381b746da8d0049b0a83b41dd P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:19:49.404513  6806 raft_consensus.cc:1240] T 7887766dc6784fcaa42b35c05fea7a99 P b7ab4784c7344b939bc36f639286f377 [term 10 FOLLOWER]: Rejecting Update request from peer ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 9. Current term is 10. Ops: []
W20260709 13:19:49.408494  6846 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:49.381428 10313 raft_consensus.cc:493] T f03d0dbf16864ca4bc1bb5e4c0334c0f P b7ab4784c7344b939bc36f639286f377 [term 7 FOLLOWER]: Starting leader election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:19:49.402930 10326 raft_consensus.cc:493] T be1a92657f494cac8dd227d152f50151 P b7ab4784c7344b939bc36f639286f377 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 7ba59cc884714e8aa5f3f0ecaed84cbb)
I20260709 13:19:49.385568  6879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "427c124d773f483294511e80fe340075" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:19:49.416472 10316 raft_consensus.cc:493] T d8cee0accdb8499c86d4414b72565a38 P cd75a17ab2604397adab03bb8b5fd75c [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:49.432018  7468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 77546.8us
I20260709 13:19:49.400305 10318 raft_consensus.cc:493] T 7c37d41cd9164c15a6826ca62a851a69 P b7ab4784c7344b939bc36f639286f377 [term 7 FOLLOWER]: Starting leader election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:19:49.445968  6875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab432e62819d499eaaf3dd55481dd930" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
W20260709 13:19:49.445928  6697 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:49.450870  6881 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53406 (request call id 1821) took 1580 ms. Trace:
I20260709 13:19:49.387583 10300 raft_consensus.cc:493] T 44bde925b2e541b69890d70715b85176 P b7ab4784c7344b939bc36f639286f377 [term 9 FOLLOWER]: Starting leader election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:19:49.378922  9864 raft_consensus.cc:515] T 3a485a995abc4807b6e511e45419f737 P b7ab4784c7344b939bc36f639286f377 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:49.454788  6879 raft_consensus.cc:2393] T 427c124d773f483294511e80fe340075 P cd75a17ab2604397adab03bb8b5fd75c [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in current term 8: Already voted for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in this term.
I20260709 13:19:49.389269 10187 raft_consensus.cc:515] T 2c240553ce044eedb41541d72b9475d7 P cd75a17ab2604397adab03bb8b5fd75c [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
W20260709 13:19:49.423658  6695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 165689us
W20260709 13:19:49.456285  6772 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.68:45071, user_credentials={real_user=slave}} blocked reactor thread for 87127.9us
I20260709 13:19:49.438128 10314 raft_consensus.cc:697] T a1704639a875409b9959353527b3fd68 P b7ab4784c7344b939bc36f639286f377 [term 10 LEADER]: Becoming Leader. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
I20260709 13:19:49.503280  6695 leader_election.cc:304] T f09c2a98de1a4decabd0ff900dd44caa P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
I20260709 13:19:49.466466  7498 raft_consensus.cc:2468] T ce4f062dcd314d43a63ca74067cb5ee3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 9.
I20260709 13:19:49.358810 10307 raft_consensus.cc:515] T 7c44c4849aa54f2b94d1f1bef9ed546f P b7ab4784c7344b939bc36f639286f377 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:49.503669  6878 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53406 (request call id 1817) took 1635 ms. Trace:
I20260709 13:19:49.465808  7496 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50744 (request call id 282) took 1585 ms. Trace:
I20260709 13:19:49.500806  6875 raft_consensus.cc:2468] T ab432e62819d499eaaf3dd55481dd930 P cd75a17ab2604397adab03bb8b5fd75c [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 10.
I20260709 13:19:49.520589  6875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24ee15416e3145beaa1b8183453729a3" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:19:49.513267  6878 rpcz_store.cc:276] 0709 13:19:47.867882 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:47.868684 (+   802us) service_pool.cc:224] Handling call
0709 13:19:47.869123 (+   439us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:19:48.066549 (+197426us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:48.066577 (+    28us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:19:48.083951 (+ 17374us) log.cc:844] Serialized 52 byte log entry
0709 13:19:48.937559 (+853608us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:19:48.986705 (+ 49146us) log.cc:844] Serialized 14 byte log entry
0709 13:19:48.993055 (+  6350us) log.cc:844] Serialized 14 byte log entry
0709 13:19:49.196257 (+203202us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:49.196348 (+    91us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:49.503392 (+307044us) raft_consensus.cc:1685] finished
0709 13:19:49.503418 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:49.503598 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7639,"prepare.queue_time_us":49591,"raft.queue_time_us":290722,"raft.run_cpu_time_us":403,"raft.run_wall_time_us":53818,"spinlock_wait_cycles":16730240,"thread_start_us":990541,"threads_started":3,"wal-append.queue_time_us":1064591}
I20260709 13:19:49.521327  6875 raft_consensus.cc:2376] T 24ee15416e3145beaa1b8183453729a3 P cd75a17ab2604397adab03bb8b5fd75c [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in term 9. Re-sending same reply.
I20260709 13:19:49.521835  6878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ba5dac66ab5497e9e336f2a3c28cda5" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:19:49.522177  6875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb7fa124c3bf4ef9ab65a407cb008441" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:19:49.522473  6878 raft_consensus.cc:2468] T 7ba5dac66ab5497e9e336f2a3c28cda5 P cd75a17ab2604397adab03bb8b5fd75c [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in term 10.
I20260709 13:19:49.522903  6875 raft_consensus.cc:2393] T bb7fa124c3bf4ef9ab65a407cb008441 P cd75a17ab2604397adab03bb8b5fd75c [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in current term 9: Already voted for candidate cd75a17ab2604397adab03bb8b5fd75c in this term.
I20260709 13:19:49.523324  6878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce4f062dcd314d43a63ca74067cb5ee3" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:19:49.523729  6875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a75bfe094d4bdc963aba3f08dfcd25" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 11 candidate_status { last_received { term: 10 index: 4 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:19:49.524920  6878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe20b4b48823486ca3b9c648db6ce8aa" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:19:49.513170  7498 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50744 (request call id 284) took 1435 ms. Trace:
I20260709 13:19:49.457855 10299 consensus_queue.cc:260] T 3d65025eea89441290d85dd053810e31 P cd75a17ab2604397adab03bb8b5fd75c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:49.527698  6878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34f36d59d88f40fe8a2805e604fc6c0a" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:19:49.527006  7498 rpcz_store.cc:276] 0709 13:19:48.077419 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:48.088126 (+ 10707us) service_pool.cc:224] Handling call
0709 13:19:49.380807 (+1292681us) spinlock_profiling.cc:243] Waited 938 us on lock 0x7b5800123f98. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0c745db1 00007fcc0c885b71 00007fcc0c885a22 00007fcc1579ec09 00007fcc148f8ee0 00007fcc149c20ab 00007fcc149c2131 00007fcc149700a0 00007fcc1496f984 00007fcc0deea6d4 00007fcc0deea662
0709 13:19:49.513085 (+132278us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2156928}
I20260709 13:19:49.528378  6878 raft_consensus.cc:2468] T 34f36d59d88f40fe8a2805e604fc6c0a P cd75a17ab2604397adab03bb8b5fd75c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 6.
I20260709 13:19:49.529609  6878 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53406 (request call id 1837) took 1408 ms. Trace:
I20260709 13:19:49.529879  6878 rpcz_store.cc:276] 0709 13:19:48.121554 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:49.527410 (+1405856us) service_pool.cc:224] Handling call
0709 13:19:49.529563 (+  2153us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:49.530572  6878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4db81d9d329422bb3b4160ca4ac2d1d" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:19:49.531045  6878 raft_consensus.cc:2468] T c4db81d9d329422bb3b4160ca4ac2d1d P cd75a17ab2604397adab03bb8b5fd75c [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 8.
I20260709 13:19:49.531644  6878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f00a2e87e56452083b759f60d461ee3" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:19:49.424300 10228 consensus_queue.cc:1059] T de3186201e1a40d0b335eeb8b4e256e0 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.084s
I20260709 13:19:49.526413  6879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "713b5728a197487c9300b310ab94e5a3" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:19:49.503280  6881 rpcz_store.cc:276] 0709 13:19:47.870791 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:47.874492 (+  3701us) service_pool.cc:224] Handling call
0709 13:19:48.014657 (+140165us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:48.052115 (+ 37458us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:48.052164 (+    49us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:48.052823 (+   659us) log.cc:844] Serialized 26 byte log entry
0709 13:19:48.546089 (+493266us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:19:48.608841 (+ 62752us) log.cc:844] Serialized 14 byte log entry
0709 13:19:48.671503 (+ 62662us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:49.065220 (+393717us) spinlock_profiling.cc:243] Waited 36.9 ms on lock 0x7b54002373d4. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f9aae01 00007fcc0f9a983e 00007fcc1496e419 00007fcc0dee5bd4 00007fcc0dee5b62 00007fcc0dee5a91 00007fcc0dee5a0c 00007fcc0dee4cc2 00007fcc0dce548c 00007fcc0dce48c6
0709 13:19:49.065269 (+    49us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:49.445460 (+380191us) raft_consensus.cc:1685] finished
0709 13:19:49.450679 (+  5219us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:49.450814 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":65769,"prepare.queue_time_us":176700,"prepare.run_cpu_time_us":53,"prepare.run_wall_time_us":55,"raft.queue_time_us":170034,"raft.run_cpu_time_us":280,"raft.run_wall_time_us":13789,"spinlock_wait_cycles":84859136,"thread_start_us":479294,"threads_started":2,"wal-append.queue_time_us":1028423}
I20260709 13:19:49.545903  6879 raft_consensus.cc:3060] T 713b5728a197487c9300b310ab94e5a3 P cd75a17ab2604397adab03bb8b5fd75c [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:49.547062  6878 raft_consensus.cc:2410] T 4f00a2e87e56452083b759f60d461ee3 P cd75a17ab2604397adab03bb8b5fd75c [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ba59cc884714e8aa5f3f0ecaed84cbb for term 9 because replica has last-logged OpId of term: 8 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 8.
I20260709 13:19:49.553711  6878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c44c4849aa54f2b94d1f1bef9ed546f" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:19:49.554610  6878 raft_consensus.cc:3060] T 7c44c4849aa54f2b94d1f1bef9ed546f P cd75a17ab2604397adab03bb8b5fd75c [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:49.452955 10322 raft_consensus.cc:493] T 24ee15416e3145beaa1b8183453729a3 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:49.588682 10314 consensus_queue.cc:237] T a1704639a875409b9959353527b3fd68 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:49.589123 10322 raft_consensus.cc:515] T 24ee15416e3145beaa1b8183453729a3 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:19:49.591573 10322 leader_election.cc:290] T 24ee15416e3145beaa1b8183453729a3 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:19:49.403116 10306 raft_consensus.cc:515] T dbdf895bba214ff68685a24fd17dfb5d P b7ab4784c7344b939bc36f639286f377 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:49.574172 10187 leader_election.cc:290] T 2c240553ce044eedb41541d72b9475d7 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 11 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
W20260709 13:19:49.581982  6845 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:49.513454 10329 raft_consensus.cc:493] T bb3d8792045a4583ae2e965b1350a5b4 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:49.460948 10323 raft_consensus.cc:2804] T 17587d6730594da4a56fa13a353232a1 P b7ab4784c7344b939bc36f639286f377 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:19:49.513721 10301 raft_consensus.cc:697] T f58dc08b12a2494bb9a1372837970ca2 P b7ab4784c7344b939bc36f639286f377 [term 12 LEADER]: Becoming Leader. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
I20260709 13:19:49.473454 10318 raft_consensus.cc:3060] T 7c37d41cd9164c15a6826ca62a851a69 P b7ab4784c7344b939bc36f639286f377 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:49.593321  6875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "427c124d773f483294511e80fe340075" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:19:49.572850  6880 raft_consensus.cc:2393] T 2c240553ce044eedb41541d72b9475d7 P cd75a17ab2604397adab03bb8b5fd75c [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7ab4784c7344b939bc36f639286f377 in current term 11: Already voted for candidate cd75a17ab2604397adab03bb8b5fd75c in this term.
I20260709 13:19:49.452823 10313 raft_consensus.cc:3060] T f03d0dbf16864ca4bc1bb5e4c0334c0f P b7ab4784c7344b939bc36f639286f377 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:49.634593  6875 raft_consensus.cc:2393] T 427c124d773f483294511e80fe340075 P cd75a17ab2604397adab03bb8b5fd75c [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in current term 8: Already voted for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in this term.
I20260709 13:19:49.595541  6881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09c2a98de1a4decabd0ff900dd44caa" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 11 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:19:49.596648 10307 leader_election.cc:290] T 7c44c4849aa54f2b94d1f1bef9ed546f P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
W20260709 13:19:49.601091 10327 log.cc:927] Time spent T 00000000000000000000000000000000 P b3ae52d33b9a4273a42e5e2cf3b5d6b5: Append to log took a long time: real 0.148s	user 0.000s	sys 0.000s
I20260709 13:19:49.601300 10332 raft_consensus.cc:493] T 404190ce4ce94cecbfcb6ea9d1dd8626 P b7ab4784c7344b939bc36f639286f377 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 7ba59cc884714e8aa5f3f0ecaed84cbb)
I20260709 13:19:49.602728 10182 leader_election.cc:290] T 30e88460611e47b2ba16a46a30b5f416 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:19:49.459558 10326 raft_consensus.cc:515] T be1a92657f494cac8dd227d152f50151 P b7ab4784c7344b939bc36f639286f377 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
W20260709 13:19:49.554529  9852 consensus_meta.cc:287] T 07a92dd554674067a83a9cb68c4773f2 P b7ab4784c7344b939bc36f639286f377: Time spent flushing consensus metadata: real 1.508s	user 0.006s	sys 0.011s
I20260709 13:19:49.605470  9864 leader_election.cc:290] T 3a485a995abc4807b6e511e45419f737 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:49.503343 10300 raft_consensus.cc:3060] T 44bde925b2e541b69890d70715b85176 P b7ab4784c7344b939bc36f639286f377 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:49.514200  7496 rpcz_store.cc:276] 0709 13:19:47.880793 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:48.077704 (+196911us) service_pool.cc:224] Handling call
0709 13:19:48.204254 (+126550us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:48.222992 (+ 18738us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:19:48.625989 (+402997us) log.cc:844] Serialized 14 byte log entry
0709 13:19:48.686139 (+ 60150us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:48.700230 (+ 14091us) log.cc:844] Serialized 26 byte log entry
0709 13:19:48.700400 (+   170us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:19:48.707297 (+  6897us) log.cc:844] Serialized 14 byte log entry
0709 13:19:48.707521 (+   224us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:48.707606 (+    85us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:49.465419 (+757813us) raft_consensus.cc:1685] finished
0709 13:19:49.465437 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:49.465580 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":19154,"prepare.queue_time_us":542643,"prepare.run_cpu_time_us":77,"prepare.run_wall_time_us":81,"raft.queue_time_us":9493,"raft.run_cpu_time_us":516,"raft.run_wall_time_us":76474,"thread_start_us":224521,"threads_started":2,"wal-append.queue_time_us":599788}
I20260709 13:19:49.526463 10102 leader_election.cc:290] T 4f00a2e87e56452083b759f60d461ee3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:49.609432 10241 leader_election.cc:290] T 7887766dc6784fcaa42b35c05fea7a99 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 10 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:49.528298 10299 raft_consensus.cc:3060] T 3d65025eea89441290d85dd053810e31 P cd75a17ab2604397adab03bb8b5fd75c [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:49.614427  6804 raft_consensus.cc:2468] T a3022224cc81473690653a83d4e99470 P b7ab4784c7344b939bc36f639286f377 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 10.
W20260709 13:19:49.617501  6847 service_pool.cc:136] UpdateConsensus request on kudu.consensus.ConsensusService from 127.0.0.1:53416 dropped due to backpressure: service queue is full with 50 items
I20260709 13:19:49.618624 10322 raft_consensus.cc:2804] T f09c2a98de1a4decabd0ff900dd44caa P ccd8a4c3bfe3413cb2ae219b09aea832 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:19:49.620517 10328 raft_consensus.cc:493] T 404190ce4ce94cecbfcb6ea9d1dd8626 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 7ba59cc884714e8aa5f3f0ecaed84cbb)
I20260709 13:19:49.642570  9852 raft_consensus.cc:2749] T 07a92dd554674067a83a9cb68c4773f2 P b7ab4784c7344b939bc36f639286f377 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:19:49.617542  6878 raft_consensus.cc:2468] T 7c44c4849aa54f2b94d1f1bef9ed546f P cd75a17ab2604397adab03bb8b5fd75c [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 11.
I20260709 13:19:49.625357  6879 raft_consensus.cc:2468] T 713b5728a197487c9300b310ab94e5a3 P cd75a17ab2604397adab03bb8b5fd75c [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 10.
W20260709 13:19:49.629829  6695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 126627us
I20260709 13:19:49.648239 10323 raft_consensus.cc:697] T 17587d6730594da4a56fa13a353232a1 P b7ab4784c7344b939bc36f639286f377 [term 13 LEADER]: Becoming Leader. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
I20260709 13:19:49.653549 10241 raft_consensus.cc:493] T 3d65025eea89441290d85dd053810e31 P b7ab4784c7344b939bc36f639286f377 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:49.471294 10316 raft_consensus.cc:515] T d8cee0accdb8499c86d4414b72565a38 P cd75a17ab2604397adab03bb8b5fd75c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:19:49.635226  6881 raft_consensus.cc:2468] T f09c2a98de1a4decabd0ff900dd44caa P cd75a17ab2604397adab03bb8b5fd75c [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 9.
I20260709 13:19:49.612090 10228 raft_consensus.cc:3055] T de3186201e1a40d0b335eeb8b4e256e0 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:19:49.611054 10113 raft_consensus.cc:493] T 9e326172347f45e99a0d482b5d8ef768 P b7ab4784c7344b939bc36f639286f377 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:19:49.644358 10301 consensus_queue.cc:237] T f58dc08b12a2494bb9a1372837970ca2 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 5, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:49.633621 10329 raft_consensus.cc:515] T bb3d8792045a4583ae2e965b1350a5b4 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:19:49.659502  6695 leader_election.cc:304] T 30e88460611e47b2ba16a46a30b5f416 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
I20260709 13:19:49.632342 10303 raft_consensus.cc:515] T 427c124d773f483294511e80fe340075 P b7ab4784c7344b939bc36f639286f377 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } attrs { replace: true } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:19:49.632758 10265 leader_election.cc:290] T a3022224cc81473690653a83d4e99470 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:19:49.653141 10337 raft_consensus.cc:493] T e31b9971c15848dea59d4d4130141d9e P ccd8a4c3bfe3413cb2ae219b09aea832 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:49.662292  6881 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53406 (request call id 1835) took 1596 ms. Trace:
I20260709 13:19:49.677320  6881 rpcz_store.cc:276] 0709 13:19:48.065816 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:49.557930 (+1492114us) service_pool.cc:224] Handling call
0709 13:19:49.662218 (+104288us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:49.656320 10328 raft_consensus.cc:515] T 404190ce4ce94cecbfcb6ea9d1dd8626 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:19:49.665180 10113 raft_consensus.cc:515] T 9e326172347f45e99a0d482b5d8ef768 P b7ab4784c7344b939bc36f639286f377 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:49.641191 10332 raft_consensus.cc:515] T 404190ce4ce94cecbfcb6ea9d1dd8626 P b7ab4784c7344b939bc36f639286f377 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:19:49.669442 10030 raft_consensus.cc:493] T fe20b4b48823486ca3b9c648db6ce8aa P ccd8a4c3bfe3413cb2ae219b09aea832 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:49.669849 10316 leader_election.cc:290] T d8cee0accdb8499c86d4414b72565a38 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:19:49.624019  6846 service_pool.cc:137] UpdateConsensus request on kudu.consensus.ConsensusService from 127.0.0.1:53416 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58592 (request call id 256)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53406 (request call id 1849)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53416 (request call id 2644)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53406 (request call id 1848)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53416 (request call id 2643)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53416 (request call id 2627)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58592 (request call id 244)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58592 (request call id 246)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58592 (request call id 245)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58592 (request call id 254)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53416 (request call id 2639)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53416 (request call id 2638)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58592 (request call id 238)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58592 (request call id 249)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58592 (request call id 255)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53416 (request call id 2636)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58592 (request call id 247)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58592 (request call id 251)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58592 (request call id 253)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58592 (request call id 252)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58592 (request call id 241)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58592 (request call id 250)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58592 (request call id 236)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58592 (request call id 248)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53406 (request call id 1826)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53406 (request call id 1827)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53406 (request call id 1829)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53406 (request call id 1836)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53406 (request call id 1838)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53406 (request call id 1841)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58592 (request call id 230)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53406 (request call id 1842)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53416 (request call id 2620)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53416 (request call id 2621)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53416 (request call id 2622)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53416 (request call id 2623)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53416 (request call id 2626)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53416 (request call id 2628)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53416 (request call id 2629)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53416 (request call id 2630)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53416 (request call id 2631)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53416 (request call id 2632)
Call kudu.consensus.ConsensusService.RunLeaderElection from 127.0.0.1:53416 (request call id 2633)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53406 (request call id 1845)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53406 (request call id 1846)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53406 (request call id 1847)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53416 (request call id 2637)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53416 (request call id 2640)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53416 (request call id 2641)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53416 (request call id 2642)
I20260709 13:19:49.662946 10228 raft_consensus.cc:740] T de3186201e1a40d0b335eeb8b4e256e0 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
I20260709 13:19:49.692055 10323 consensus_queue.cc:237] T 17587d6730594da4a56fa13a353232a1 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:19:49.695390 10113 leader_election.cc:290] T 9e326172347f45e99a0d482b5d8ef768 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:49.663802 10241 raft_consensus.cc:515] T 3d65025eea89441290d85dd053810e31 P b7ab4784c7344b939bc36f639286f377 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
W20260709 13:19:49.731925  6845 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:49.735462  6771 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:49.810673  6874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3411566abe2d4c9bb4b2adfdd05e6f17" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:19:49.814695  6874 raft_consensus.cc:3060] T 3411566abe2d4c9bb4b2adfdd05e6f17 P cd75a17ab2604397adab03bb8b5fd75c [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:49.688527 10337 raft_consensus.cc:515] T e31b9971c15848dea59d4d4130141d9e P ccd8a4c3bfe3413cb2ae219b09aea832 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
W20260709 13:19:49.812021  6729 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50004 (request call id 1745) took 2284 ms (client timeout 2219 ms). Trace:
W20260709 13:19:49.815769  6845 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:49.816349  6729 rpcz_store.cc:269] 0709 13:19:47.527296 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:47.590821 (+ 63525us) service_pool.cc:224] Handling call
0709 13:19:49.811714 (+2220893us) spinlock_profiling.cc:243] Waited 30.8 ms on lock 0x7b54003d4d54. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f9ae2fa 00007fcc1496fb17 00007fcc0deea6d4 00007fcc0deea662 00007fcc0deea591 00007fcc0deea50c 00007fcc0dee97c2 00007fcc0dce548c 00007fcc0dce48c6 00007fcc0dce426f
0709 13:19:49.811898 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":70899968}
I20260709 13:19:49.822474 10241 leader_election.cc:290] T 3d65025eea89441290d85dd053810e31 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
W20260709 13:19:49.777274  7468 leader_election.cc:336] T 3fa34c08b205435dba97346991aa1f92 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931): Timed out: RequestConsensusVote RPC to 127.5.126.67:42931 timed out after 3.188s (SENT)
W20260709 13:19:49.706113 10063 consensus_meta.cc:287] T 3411566abe2d4c9bb4b2adfdd05e6f17 P b7ab4784c7344b939bc36f639286f377: Time spent flushing consensus metadata: real 1.006s	user 0.016s	sys 0.000s
I20260709 13:19:49.832711  6732 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50004 (request call id 1735) took 2583 ms. Trace:
W20260709 13:19:49.825484  6772 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 94942us
I20260709 13:19:49.828608  6697 leader_election.cc:304] T 427c124d773f483294511e80fe340075 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377
I20260709 13:19:49.703110 10030 raft_consensus.cc:515] T fe20b4b48823486ca3b9c648db6ce8aa P ccd8a4c3bfe3413cb2ae219b09aea832 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:19:49.830902  7468 leader_election.cc:304] T 3fa34c08b205435dba97346991aa1f92 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:19:49.835037  6723 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49744 (request call id 313) took 2814 ms. Trace:
W20260709 13:19:49.833531  6695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 174117us
I20260709 13:19:49.839229  6723 rpcz_store.cc:276] 0709 13:19:47.020614 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:47.021450 (+   836us) service_pool.cc:224] Handling call
0709 13:19:47.021829 (+   379us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:47.451985 (+430156us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:47.452020 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:47.456667 (+  4647us) log.cc:844] Serialized 26 byte log entry
0709 13:19:47.632894 (+176227us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:19:49.670838 (+2037944us) log.cc:844] Serialized 14 byte log entry
0709 13:19:49.833988 (+163150us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:49.834766 (+   778us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:49.834817 (+    51us) raft_consensus.cc:1685] finished
0709 13:19:49.834828 (+    11us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:49.834975 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2215273,"prepare.queue_time_us":2035498,"prepare.run_cpu_time_us":51,"prepare.run_wall_time_us":52,"raft.queue_time_us":174933,"raft.run_cpu_time_us":180,"raft.run_wall_time_us":62057,"thread_start_us":713408,"threads_started":4,"wal-append.queue_time_us":274560,"wal-append.run_cpu_time_us":2843,"wal-append.run_wall_time_us":1071286}
W20260709 13:19:49.844063  6846 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:49.844568  6846 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:49.844992  6846 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:49.713371 10322 raft_consensus.cc:697] T f09c2a98de1a4decabd0ff900dd44caa P ccd8a4c3bfe3413cb2ae219b09aea832 [term 11 LEADER]: Becoming Leader. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
W20260709 13:19:49.853730 10340 log.cc:927] Time spent T a1704639a875409b9959353527b3fd68 P b7ab4784c7344b939bc36f639286f377: Append to log took a long time: real 0.132s	user 0.000s	sys 0.001s
I20260709 13:19:49.833375  6732 rpcz_store.cc:276] 0709 13:19:47.249606 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:47.251022 (+  1416us) service_pool.cc:224] Handling call
0709 13:19:47.251366 (+   344us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:47.251655 (+   289us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:19:47.253149 (+  1494us) log.cc:844] Serialized 14 byte log entry
0709 13:19:49.665449 (+2412300us) spinlock_profiling.cc:243] Waited 1.18 ms on lock 0x7b1800377e60. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc15785de1 00007fcc157925b1 00007fcc0c837c0a 00007fcc15f77219 00007fcc0c8bfa40 00007fcc0c8ba4e4 00007fcc0c8ba455 00007fcc133a23c7 00007fcc0f9b49a7 00007fcc0f9c40bf 00007fcc0f9c4038
0709 13:19:49.665693 (+   244us) log.cc:844] Serialized 14 byte log entry
0709 13:19:49.832168 (+166475us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:49.832334 (+   166us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:19:49.832400 (+    66us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:49.832484 (+    84us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:49.832637 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":15951,"prepare.queue_time_us":2173864,"prepare.run_cpu_time_us":78,"prepare.run_wall_time_us":83,"raft.queue_time_us":1537,"raft.run_cpu_time_us":154,"raft.run_wall_time_us":11330,"spinlock_wait_cycles":2723072,"thread_start_us":403417,"threads_started":3,"wal-append.queue_time_us":371816,"wal-append.run_cpu_time_us":2327,"wal-append.run_wall_time_us":1113338}
I20260709 13:19:49.862694 10328 leader_election.cc:290] T 404190ce4ce94cecbfcb6ea9d1dd8626 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:19:49.863588 10306 leader_election.cc:290] T dbdf895bba214ff68685a24fd17dfb5d P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
W20260709 13:19:49.872840 10336 log.cc:927] Time spent T 4275cf08e63345f993bce8664eada830 P b7ab4784c7344b939bc36f639286f377: Append to log took a long time: real 0.079s	user 0.000s	sys 0.000s
I20260709 13:19:49.874024 10337 leader_election.cc:290] T e31b9971c15848dea59d4d4130141d9e P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:49.837392 10164 raft_consensus.cc:493] T b3f13b31a1f84f0d89d007eadd57924c P ccd8a4c3bfe3413cb2ae219b09aea832 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 7ba59cc884714e8aa5f3f0ecaed84cbb)
I20260709 13:19:49.883605  6874 raft_consensus.cc:2468] T 3411566abe2d4c9bb4b2adfdd05e6f17 P cd75a17ab2604397adab03bb8b5fd75c [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 7.
I20260709 13:19:49.850234 10342 raft_consensus.cc:2804] T 30e88460611e47b2ba16a46a30b5f416 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:19:49.855307 10102 raft_consensus.cc:2749] T 3fa34c08b205435dba97346991aa1f92 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:19:49.855845 10113 raft_consensus.cc:493] T 3411566abe2d4c9bb4b2adfdd05e6f17 P b7ab4784c7344b939bc36f639286f377 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:49.799597 10228 consensus_queue.cc:260] T de3186201e1a40d0b335eeb8b4e256e0 P ccd8a4c3bfe3413cb2ae219b09aea832 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:49.898720  6874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ba5dac66ab5497e9e336f2a3c28cda5" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:19:49.964962  6874 raft_consensus.cc:2468] T 7ba5dac66ab5497e9e336f2a3c28cda5 P cd75a17ab2604397adab03bb8b5fd75c [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in term 10.
I20260709 13:19:49.889127 10164 raft_consensus.cc:515] T b3f13b31a1f84f0d89d007eadd57924c P ccd8a4c3bfe3413cb2ae219b09aea832 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
W20260709 13:19:49.955476 10341 log.cc:927] Time spent T d8292e16e5654be6bc408560cf256aaa P b7ab4784c7344b939bc36f639286f377: Append to log took a long time: real 0.080s	user 0.000s	sys 0.000s
I20260709 13:19:49.977919 10329 leader_election.cc:290] T bb3d8792045a4583ae2e965b1350a5b4 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:19:49.978761 10322 consensus_queue.cc:237] T f09c2a98de1a4decabd0ff900dd44caa P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:49.979144 10318 raft_consensus.cc:515] T 7c37d41cd9164c15a6826ca62a851a69 P b7ab4784c7344b939bc36f639286f377 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:49.981024 10299 raft_consensus.cc:493] T 7887766dc6784fcaa42b35c05fea7a99 P cd75a17ab2604397adab03bb8b5fd75c [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:49.984066 10299 raft_consensus.cc:515] T 7887766dc6784fcaa42b35c05fea7a99 P cd75a17ab2604397adab03bb8b5fd75c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:49.986446 10299 leader_election.cc:290] T 7887766dc6784fcaa42b35c05fea7a99 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:19:49.969952 10113 raft_consensus.cc:515] T 3411566abe2d4c9bb4b2adfdd05e6f17 P b7ab4784c7344b939bc36f639286f377 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
W20260709 13:19:49.981355 10360 log.cc:927] Time spent T 853ac0a8cbd64ce99457f170216d4d0f P ccd8a4c3bfe3413cb2ae219b09aea832: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
W20260709 13:19:49.981868  7468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 204634us
I20260709 13:19:49.983237 10228 raft_consensus.cc:3060] T de3186201e1a40d0b335eeb8b4e256e0 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:49.993882 10318 leader_election.cc:290] T 7c37d41cd9164c15a6826ca62a851a69 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 8 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:50.001916 10243 raft_consensus.cc:3060] T 9b3759de40694069b13c0f8bd40e5709 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:50.003379 10303 leader_election.cc:290] T 427c124d773f483294511e80fe340075 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 9 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
W20260709 13:19:50.015017  6695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 173420us
W20260709 13:19:49.956902 10343 log.cc:927] Time spent T 22ccee1b570c4ad3a57bd7aec085b1b4 P ccd8a4c3bfe3413cb2ae219b09aea832: Append to log took a long time: real 0.067s	user 0.000s	sys 0.000s
I20260709 13:19:49.875285 10030 leader_election.cc:290] T fe20b4b48823486ca3b9c648db6ce8aa P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
W20260709 13:19:49.891177 10275 consensus_meta.cc:287] T 4d9def8b32fd443aa94ab1420b06837b P cd75a17ab2604397adab03bb8b5fd75c: Time spent flushing consensus metadata: real 0.514s	user 0.011s	sys 0.001s
I20260709 13:19:49.957230 10240 raft_consensus.cc:493] T 853ac0a8cbd64ce99457f170216d4d0f P b7ab4784c7344b939bc36f639286f377 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:19:50.023339  6874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe20b4b48823486ca3b9c648db6ce8aa" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:19:49.935360  9890 raft_consensus.cc:2804] T 427c124d773f483294511e80fe340075 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:19:50.019948 10342 raft_consensus.cc:697] T 30e88460611e47b2ba16a46a30b5f416 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 9 LEADER]: Becoming Leader. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
I20260709 13:19:50.036660  6874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce4f062dcd314d43a63ca74067cb5ee3" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
W20260709 13:19:50.040213  6697 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.68:45071, user_credentials={real_user=slave}} blocked reactor thread for 211726us
I20260709 13:19:50.043593  6725 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49744 (request call id 314) took 2706 ms. Trace:
I20260709 13:19:50.044894  6874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d9def8b32fd443aa94ab1420b06837b" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:19:50.046475  6874 raft_consensus.cc:2410] T 4d9def8b32fd443aa94ab1420b06837b P cd75a17ab2604397adab03bb8b5fd75c [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ccd8a4c3bfe3413cb2ae219b09aea832 for term 10 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 4.
I20260709 13:19:50.044179  6725 rpcz_store.cc:276] 0709 13:19:47.337700 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:47.511622 (+173922us) service_pool.cc:224] Handling call
0709 13:19:47.512161 (+   539us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:47.540820 (+ 28659us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:47.540872 (+    52us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:47.551181 (+ 10309us) log.cc:844] Serialized 26 byte log entry
0709 13:19:47.770715 (+219534us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:19:49.829819 (+2059104us) log.cc:844] Serialized 14 byte log entry
0709 13:19:50.042874 (+213055us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:50.042995 (+   121us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:50.043330 (+   335us) raft_consensus.cc:1685] finished
0709 13:19:50.043350 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:50.043507 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2021608,"prepare.queue_time_us":2023261,"prepare.run_cpu_time_us":57,"prepare.run_wall_time_us":57,"raft.queue_time_us":189650,"raft.run_cpu_time_us":229,"raft.run_wall_time_us":7646,"spinlock_wait_cycles":3694848,"thread_start_us":430918,"threads_started":4,"wal-append.queue_time_us":352302,"wal-append.run_cpu_time_us":2773,"wal-append.run_wall_time_us":1012620}
I20260709 13:19:50.025372 10240 raft_consensus.cc:515] T 853ac0a8cbd64ce99457f170216d4d0f P b7ab4784c7344b939bc36f639286f377 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:50.043148 10338 raft_consensus.cc:493] T be1a92657f494cac8dd227d152f50151 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 7ba59cc884714e8aa5f3f0ecaed84cbb)
I20260709 13:19:50.061909 10332 leader_election.cc:290] T 404190ce4ce94cecbfcb6ea9d1dd8626 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
W20260709 13:19:50.065347  6804 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:32976 (request call id 2524) took 2253 ms (client timeout 2177 ms). Trace:
W20260709 13:19:50.065917  6804 rpcz_store.cc:269] 0709 13:19:47.811836 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:47.811948 (+   112us) service_pool.cc:224] Handling call
0709 13:19:50.064999 (+2253051us) spinlock_profiling.cc:243] Waited 1.55 s on lock 0x7b5400185454. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f9ae2fa 00007fcc1496fb17 00007fcc0deea6d4 00007fcc0deea662 00007fcc0deea591 00007fcc0deea50c 00007fcc0dee97c2 00007fcc0dce548c 00007fcc0dce48c6 00007fcc0dce426f
0709 13:19:50.065184 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3558379648}
I20260709 13:19:50.068538  6874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb7fa124c3bf4ef9ab65a407cb008441" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:19:50.069656  6874 raft_consensus.cc:2393] T bb7fa124c3bf4ef9ab65a407cb008441 P cd75a17ab2604397adab03bb8b5fd75c [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in current term 9: Already voted for candidate cd75a17ab2604397adab03bb8b5fd75c in this term.
I20260709 13:19:50.070971  6874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "711ef6523deb4cbe8ef2ba61e1c21c98" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
W20260709 13:19:50.072054 10291 log.cc:927] Time spent T 22ccee1b570c4ad3a57bd7aec085b1b4 P cd75a17ab2604397adab03bb8b5fd75c: Append to log took a long time: real 0.846s	user 0.003s	sys 0.001s
I20260709 13:19:50.047010  9890 raft_consensus.cc:697] T 427c124d773f483294511e80fe340075 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 8 LEADER]: Becoming Leader. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
I20260709 13:19:50.055226 10342 consensus_queue.cc:237] T 30e88460611e47b2ba16a46a30b5f416 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:50.076705  6873 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53406 (request call id 1820) took 2206 ms. Trace:
I20260709 13:19:50.076297  6875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a485a995abc4807b6e511e45419f737" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:19:50.080663  6875 raft_consensus.cc:2468] T 3a485a995abc4807b6e511e45419f737 P cd75a17ab2604397adab03bb8b5fd75c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 7.
I20260709 13:19:50.079680  6873 rpcz_store.cc:276] 0709 13:19:47.870524 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:47.870645 (+   121us) service_pool.cc:224] Handling call
0709 13:19:47.870944 (+   299us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:47.871274 (+   330us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:19:48.303496 (+432222us) log.cc:844] Serialized 14 byte log entry
0709 13:19:48.735059 (+431563us) log.cc:844] Serialized 14 byte log entry
0709 13:19:48.750003 (+ 14944us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:48.759716 (+  9713us) log.cc:844] Serialized 26 byte log entry
0709 13:19:48.759877 (+   161us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:19:48.776865 (+ 16988us) log.cc:844] Serialized 14 byte log entry
0709 13:19:48.777146 (+   281us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:48.777269 (+   123us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:49.066908 (+289639us) spinlock_profiling.cc:243] Waited 5.72 ms on lock 0x7b18003885a0. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc15785de1 00007fcc157925b1 00007fcc0c8bd522 00007fcc0c8bf7c1 00007fcc0c8bf779 00007fcc0c8bf709 00007fcc0c8bf6d1 00007fcc0c8be9cd 000000000038f354 000000000038f199 00007fcc0c8a083a
0709 13:19:50.071614 (+1004706us) spinlock_profiling.cc:243] Waited 9.4 ms on lock 0x7b24002c2fe8. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0c745db1 00007fcc0c7439c4 00007fcc0c741acb 00007fcc0c8fcdc9 00007fcc0c8fca55 00007fcc0c8fc09d 00007fcc0f52e10e 00007fcc0f54588c 00007fcc0f544bb6 00007fcc0f5447d8 00007fcc0f54e221
0709 13:19:50.076445 (+  4831us) raft_consensus.cc:1685] finished
0709 13:19:50.076469 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:50.076631 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4162,"prepare.queue_time_us":875465,"prepare.run_cpu_time_us":159,"prepare.run_wall_time_us":9467,"raft.queue_time_us":672858,"raft.run_cpu_time_us":662,"raft.run_wall_time_us":55620,"spinlock_wait_cycles":34780544,"thread_start_us":707781,"threads_started":2,"wal-append.queue_time_us":865796}
I20260709 13:19:50.081669  6875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30e88460611e47b2ba16a46a30b5f416" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:19:50.082650  6875 raft_consensus.cc:3060] T 30e88460611e47b2ba16a46a30b5f416 P cd75a17ab2604397adab03bb8b5fd75c [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:19:50.086768  6697 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.68:45071, user_credentials={real_user=slave}} blocked reactor thread for 45003.9us
I20260709 13:19:50.087411  6873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3022224cc81473690653a83d4e99470" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:19:50.087602  6697 leader_election.cc:304] T 17587d6730594da4a56fa13a353232a1 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: b7ab4784c7344b939bc36f639286f377
I20260709 13:19:50.088201  6873 raft_consensus.cc:3060] T a3022224cc81473690653a83d4e99470 P cd75a17ab2604397adab03bb8b5fd75c [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:50.092057 10368 raft_consensus.cc:493] T dbdf895bba214ff68685a24fd17dfb5d P ccd8a4c3bfe3413cb2ae219b09aea832 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:50.093921 10368 raft_consensus.cc:515] T dbdf895bba214ff68685a24fd17dfb5d P ccd8a4c3bfe3413cb2ae219b09aea832 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
W20260709 13:19:50.096982 10363 log.cc:927] Time spent T f3f9c2e2bf644115957398fe4c9459db P ccd8a4c3bfe3413cb2ae219b09aea832: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 13:19:50.083171 10249 raft_consensus.cc:493] T 8c7f33e544204fbaac4078e3e83bbf4e P b7ab4784c7344b939bc36f639286f377 [term 6 FOLLOWER]: Starting leader election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:19:50.097851 10249 raft_consensus.cc:3060] T 8c7f33e544204fbaac4078e3e83bbf4e P b7ab4784c7344b939bc36f639286f377 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:19:50.078989 10297 log.cc:927] Time spent T be1a92657f494cac8dd227d152f50151 P 7ba59cc884714e8aa5f3f0ecaed84cbb: Append to log took a long time: real 1.252s	user 0.005s	sys 0.000s
I20260709 13:19:50.104734  6874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f00a2e87e56452083b759f60d461ee3" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
W20260709 13:19:50.105351  6845 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:50.106033  6874 raft_consensus.cc:2410] T 4f00a2e87e56452083b759f60d461ee3 P cd75a17ab2604397adab03bb8b5fd75c [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 7ba59cc884714e8aa5f3f0ecaed84cbb for term 9 because replica has last-logged OpId of term: 8 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 8.
I20260709 13:19:50.099939 10368 leader_election.cc:290] T dbdf895bba214ff68685a24fd17dfb5d P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:50.107299  6875 raft_consensus.cc:2468] T 30e88460611e47b2ba16a46a30b5f416 P cd75a17ab2604397adab03bb8b5fd75c [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 9.
I20260709 13:19:50.074615 10338 raft_consensus.cc:515] T be1a92657f494cac8dd227d152f50151 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:19:50.113225  6875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3d8792045a4583ae2e965b1350a5b4" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:19:50.114434  6802 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:32976 (request call id 2539) took 1493 ms. Trace:
I20260709 13:19:50.115052  6875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77e330a82df4b43a745d57a68f6f057" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 12 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:19:50.115101 10240 leader_election.cc:290] T 853ac0a8cbd64ce99457f170216d4d0f P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:50.115712  6875 raft_consensus.cc:2468] T e77e330a82df4b43a745d57a68f6f057 P cd75a17ab2604397adab03bb8b5fd75c [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 11.
W20260709 13:19:50.116251  6877 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53406 (request call id 1828) took 2107 ms (client timeout 1930 ms). Trace:
W20260709 13:19:50.116706  6877 rpcz_store.cc:269] 0709 13:19:48.008612 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:48.121067 (+112455us) service_pool.cc:224] Handling call
0709 13:19:50.116078 (+1995011us) spinlock_profiling.cc:243] Waited 1.1 s on lock 0x7b54002189d4. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f9ae2fa 00007fcc1496fb17 00007fcc0deea6d4 00007fcc0deea662 00007fcc0deea591 00007fcc0deea50c 00007fcc0dee97c2 00007fcc0dce548c 00007fcc0dce48c6 00007fcc0dce426f
0709 13:19:50.116188 (+   110us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2531073408}
I20260709 13:19:50.118115  6877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f00a2e87e56452083b759f60d461ee3" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:19:50.119095  6877 raft_consensus.cc:2410] T 4f00a2e87e56452083b759f60d461ee3 P cd75a17ab2604397adab03bb8b5fd75c [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 7ba59cc884714e8aa5f3f0ecaed84cbb for term 9 because replica has last-logged OpId of term: 8 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 8.
I20260709 13:19:50.121382  6875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe20b4b48823486ca3b9c648db6ce8aa" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:19:50.122493  6806 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:32976 (request call id 2540) took 1498 ms. Trace:
I20260709 13:19:50.122901  6806 rpcz_store.cc:276] 0709 13:19:48.624152 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:48.624750 (+   598us) service_pool.cc:224] Handling call
0709 13:19:48.625050 (+   300us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:49.451589 (+826539us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:50.122275 (+670686us) spinlock_profiling.cc:243] Waited 779 ms on lock 0x7b5400288cd4. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f9aae01 00007fcc0f9a983e 00007fcc1496e419 00007fcc0dee5bd4 00007fcc0dee5b62 00007fcc0dee5a91 00007fcc0dee5a0c 00007fcc0dee4cc2 00007fcc0dce548c 00007fcc0dce48c6
0709 13:19:50.122439 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1792135552}
I20260709 13:19:50.128221 10300 raft_consensus.cc:515] T 44bde925b2e541b69890d70715b85176 P b7ab4784c7344b939bc36f639286f377 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:50.133258  6872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fa34c08b205435dba97346991aa1f92" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:19:50.114782  6802 rpcz_store.cc:276] 0709 13:19:48.620824 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:50.113422 (+1492598us) service_pool.cc:224] Handling call
0709 13:19:50.113724 (+   302us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:50.113944 (+   220us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:50.113980 (+    36us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:50.114035 (+    55us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:19:50.114078 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:50.114145 (+    67us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:50.114279 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:49.643702  6847 service_pool.cc:137] UpdateConsensus request on kudu.consensus.ConsensusService from 127.0.0.1:53416 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58592 (request call id 256)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53406 (request call id 1849)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53416 (request call id 2644)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53406 (request call id 1848)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53416 (request call id 2643)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53416 (request call id 2627)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58592 (request call id 244)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58592 (request call id 246)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58592 (request call id 245)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58592 (request call id 254)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53416 (request call id 2639)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53416 (request call id 2638)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58592 (request call id 238)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58592 (request call id 249)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58592 (request call id 255)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53416 (request call id 2636)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58592 (request call id 247)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58592 (request call id 251)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58592 (request call id 253)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58592 (request call id 252)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58592 (request call id 241)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58592 (request call id 250)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58592 (request call id 236)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58592 (request call id 248)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53406 (request call id 1826)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53406 (request call id 1827)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53406 (request call id 1829)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53406 (request call id 1836)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53406 (request call id 1838)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53406 (request call id 1841)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58592 (request call id 230)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53406 (request call id 1842)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53416 (request call id 2620)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53416 (request call id 2621)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53416 (request call id 2622)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53416 (request call id 2623)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53416 (request call id 2626)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53416 (request call id 2628)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53416 (request call id 2629)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53416 (request call id 2630)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53416 (request call id 2631)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53416 (request call id 2632)
Call kudu.consensus.ConsensusService.RunLeaderElection from 127.0.0.1:53416 (request call id 2633)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53406 (request call id 1845)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53406 (request call id 1846)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53406 (request call id 1847)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53416 (request call id 2637)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53416 (request call id 2640)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53416 (request call id 2641)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53416 (request call id 2642)
I20260709 13:19:50.129313 10313 raft_consensus.cc:515] T f03d0dbf16864ca4bc1bb5e4c0334c0f P b7ab4784c7344b939bc36f639286f377 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:50.122433  6875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ba5dac66ab5497e9e336f2a3c28cda5" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:19:50.142858  6875 raft_consensus.cc:2468] T 7ba5dac66ab5497e9e336f2a3c28cda5 P cd75a17ab2604397adab03bb8b5fd75c [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in term 10.
I20260709 13:19:50.133982  6872 raft_consensus.cc:2468] T 3fa34c08b205435dba97346991aa1f92 P cd75a17ab2604397adab03bb8b5fd75c [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in term 10.
W20260709 13:19:50.130460 10317 log.cc:927] Time spent T 8c7f33e544204fbaac4078e3e83bbf4e P b7ab4784c7344b939bc36f639286f377: Append to log took a long time: real 0.904s	user 0.000s	sys 0.002s
I20260709 13:19:50.119889  6877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24ee15416e3145beaa1b8183453729a3" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
W20260709 13:19:50.139957  7466 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:50.144227  6877 raft_consensus.cc:2468] T 24ee15416e3145beaa1b8183453729a3 P cd75a17ab2604397adab03bb8b5fd75c [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in term 9.
I20260709 13:19:50.141311  6874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3d8792045a4583ae2e965b1350a5b4" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:19:50.145020  7466 leader_election.cc:304] T fe20b4b48823486ca3b9c648db6ce8aa P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
I20260709 13:19:50.145490  6874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce4f062dcd314d43a63ca74067cb5ee3" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:19:50.134596  9890 consensus_queue.cc:237] T 427c124d773f483294511e80fe340075 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.5, Last appended by leader: 5, Current term: 8, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } attrs { replace: true } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
W20260709 13:19:50.147418  6697 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.68:45071, user_credentials={real_user=slave}} blocked reactor thread for 59915.3us
I20260709 13:19:50.148787 10324 raft_consensus.cc:3055] T f58dc08b12a2494bb9a1372837970ca2 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:19:50.149426 10324 raft_consensus.cc:740] T f58dc08b12a2494bb9a1372837970ca2 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
I20260709 13:19:50.150184 10228 raft_consensus.cc:2804] T 17587d6730594da4a56fa13a353232a1 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:19:50.150779 10228 raft_consensus.cc:697] T 17587d6730594da4a56fa13a353232a1 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 12 LEADER]: Becoming Leader. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
I20260709 13:19:50.150427 10324 consensus_queue.cc:260] T f58dc08b12a2494bb9a1372837970ca2 P ccd8a4c3bfe3413cb2ae219b09aea832 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
W20260709 13:19:50.151984  6695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 62098us
I20260709 13:19:50.153100  6772 leader_election.cc:304] T 34f36d59d88f40fe8a2805e604fc6c0a P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:19:50.142611 10184 raft_consensus.cc:493] T 9e326172347f45e99a0d482b5d8ef768 P cd75a17ab2604397adab03bb8b5fd75c [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:50.154121  6772 leader_election.cc:304] T c4db81d9d329422bb3b4160ca4ac2d1d P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:19:50.155263  6772 leader_election.cc:304] T f09c2a98de1a4decabd0ff900dd44caa P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:19:50.156564 10306 raft_consensus.cc:2804] T 34f36d59d88f40fe8a2805e604fc6c0a P b7ab4784c7344b939bc36f639286f377 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:19:50.156769  6695 leader_election.cc:304] T a3022224cc81473690653a83d4e99470 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
I20260709 13:19:50.157013 10306 raft_consensus.cc:493] T 34f36d59d88f40fe8a2805e604fc6c0a P b7ab4784c7344b939bc36f639286f377 [term 6 FOLLOWER]: Starting leader election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:19:50.157404 10306 raft_consensus.cc:3060] T 34f36d59d88f40fe8a2805e604fc6c0a P b7ab4784c7344b939bc36f639286f377 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:50.159283 10004 raft_consensus.cc:2804] T a3022224cc81473690653a83d4e99470 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:19:50.159844 10004 raft_consensus.cc:697] T a3022224cc81473690653a83d4e99470 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 10 LEADER]: Becoming Leader. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
I20260709 13:19:50.160244  9836 raft_consensus.cc:2804] T c4db81d9d329422bb3b4160ca4ac2d1d P b7ab4784c7344b939bc36f639286f377 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:19:50.160683  9836 raft_consensus.cc:493] T c4db81d9d329422bb3b4160ca4ac2d1d P b7ab4784c7344b939bc36f639286f377 [term 8 FOLLOWER]: Starting leader election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:19:50.161082  9836 raft_consensus.cc:3060] T c4db81d9d329422bb3b4160ca4ac2d1d P b7ab4784c7344b939bc36f639286f377 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:50.160778 10004 consensus_queue.cc:237] T a3022224cc81473690653a83d4e99470 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:50.161309 10268 raft_consensus.cc:2764] T f09c2a98de1a4decabd0ff900dd44caa P b7ab4784c7344b939bc36f639286f377 [term 11 FOLLOWER]: Leader pre-election decision vote started in defunct term 10: won
I20260709 13:19:50.161944  6803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "404190ce4ce94cecbfcb6ea9d1dd8626" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:19:50.162570  6803 raft_consensus.cc:2468] T 404190ce4ce94cecbfcb6ea9d1dd8626 P b7ab4784c7344b939bc36f639286f377 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 9.
I20260709 13:19:50.163576  6802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d9def8b32fd443aa94ab1420b06837b" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:19:50.164250  6801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e31b9971c15848dea59d4d4130141d9e" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:19:50.164568  6804 raft_consensus.cc:1240] T 44bde925b2e541b69890d70715b85176 P b7ab4784c7344b939bc36f639286f377 [term 10 FOLLOWER]: Rejecting Update request from peer ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 9. Current term is 10. Ops: []
I20260709 13:19:50.164944 10113 leader_election.cc:290] T 3411566abe2d4c9bb4b2adfdd05e6f17 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:50.166111  6800 raft_consensus.cc:1240] T 07a92dd554674067a83a9cb68c4773f2 P b7ab4784c7344b939bc36f639286f377 [term 9 FOLLOWER]: Rejecting Update request from peer ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 8. Current term is 9. Ops: []
I20260709 13:19:50.165895 10236 consensus_queue.cc:1059] T 7887766dc6784fcaa42b35c05fea7a99 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:19:50.167505  6806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "711ef6523deb4cbe8ef2ba61e1c21c98" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:19:50.167646 10231 raft_consensus.cc:3055] T 7887766dc6784fcaa42b35c05fea7a99 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:19:50.168203 10231 raft_consensus.cc:740] T 7887766dc6784fcaa42b35c05fea7a99 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
I20260709 13:19:50.168282 10275 consensus_queue.cc:1048] T bb3d8792045a4583ae2e965b1350a5b4 P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:19:50.168787  7500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8cee0accdb8499c86d4414b72565a38" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:19:50.169739  7500 raft_consensus.cc:2410] T d8cee0accdb8499c86d4414b72565a38 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c for term 10 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 13:19:50.171018  6872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c240553ce044eedb41541d72b9475d7" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:19:50.172210  6802 raft_consensus.cc:2468] T 4d9def8b32fd443aa94ab1420b06837b P b7ab4784c7344b939bc36f639286f377 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 9.
I20260709 13:19:50.172309  6872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "427c124d773f483294511e80fe340075" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:19:50.172842  6872 raft_consensus.cc:3060] T 427c124d773f483294511e80fe340075 P cd75a17ab2604397adab03bb8b5fd75c [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:19:50.155660  6847 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:50.167773  6805 raft_consensus.cc:1240] T f03d0dbf16864ca4bc1bb5e4c0334c0f P b7ab4784c7344b939bc36f639286f377 [term 8 FOLLOWER]: Rejecting Update request from peer ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 7. Current term is 8. Ops: []
I20260709 13:19:50.153910 10184 raft_consensus.cc:515] T 9e326172347f45e99a0d482b5d8ef768 P cd75a17ab2604397adab03bb8b5fd75c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:50.166437  6798 raft_consensus.cc:1240] T f58dc08b12a2494bb9a1372837970ca2 P b7ab4784c7344b939bc36f639286f377 [term 12 LEADER]: Rejecting Update request from peer ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 11. Current term is 12. Ops: [11.6-11.6]
I20260709 13:19:50.169143 10231 consensus_queue.cc:260] T 7887766dc6784fcaa42b35c05fea7a99 P ccd8a4c3bfe3413cb2ae219b09aea832 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:50.151561 10324 raft_consensus.cc:3060] T f58dc08b12a2494bb9a1372837970ca2 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:50.179270  6806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbdf895bba214ff68685a24fd17dfb5d" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:19:50.186645  6806 raft_consensus.cc:2468] T dbdf895bba214ff68685a24fd17dfb5d P b7ab4784c7344b939bc36f639286f377 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 8.
I20260709 13:19:50.175155  6772 leader_election.cc:304] T 3a485a995abc4807b6e511e45419f737 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:19:50.135500 10300 leader_election.cc:290] T 44bde925b2e541b69890d70715b85176 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 10 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:50.186156  6875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7887766dc6784fcaa42b35c05fea7a99" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:19:50.189270  6875 raft_consensus.cc:3060] T 7887766dc6784fcaa42b35c05fea7a99 P cd75a17ab2604397adab03bb8b5fd75c [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:19:50.146785 10315 log.cc:927] Time spent T 711ef6523deb4cbe8ef2ba61e1c21c98 P b7ab4784c7344b939bc36f639286f377: Append to log took a long time: real 0.794s	user 0.000s	sys 0.004s
I20260709 13:19:50.193686  6877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e326172347f45e99a0d482b5d8ef768" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:19:50.191829  6872 raft_consensus.cc:2468] T 427c124d773f483294511e80fe340075 P cd75a17ab2604397adab03bb8b5fd75c [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 9.
I20260709 13:19:50.204630  6772 leader_election.cc:304] T 2c240553ce044eedb41541d72b9475d7 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
W20260709 13:19:50.205999  6697 connection.cc:256] RPC call timeout handler was delayed by -1.0546500979999109s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15860000000000002s for a response
I20260709 13:19:50.206970  6697 leader_election.cc:304] T ab432e62819d499eaaf3dd55481dd930 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377
I20260709 13:19:50.210173  6697 leader_election.cc:304] T 95a75bfe094d4bdc963aba3f08dfcd25 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:19:50.212654  6873 raft_consensus.cc:2468] T a3022224cc81473690653a83d4e99470 P cd75a17ab2604397adab03bb8b5fd75c [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 10.
I20260709 13:19:50.212975  6877 raft_consensus.cc:2468] T 9e326172347f45e99a0d482b5d8ef768 P cd75a17ab2604397adab03bb8b5fd75c [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 8.
I20260709 13:19:50.230832 10313 leader_election.cc:290] T f03d0dbf16864ca4bc1bb5e4c0334c0f P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 8 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:50.172250  6844 service_pool.cc:137] UpdateConsensus request on kudu.consensus.ConsensusService from 127.0.0.1:53416 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53416 (request call id 2653)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53416 (request call id 2654)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53406 (request call id 1858)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53416 (request call id 2651)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53406 (request call id 1856)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53406 (request call id 1859)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53406 (request call id 1854)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58592 (request call id 250)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58592 (request call id 236)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53406 (request call id 1852)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58592 (request call id 248)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58592 (request call id 257)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53406 (request call id 1826)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53406 (request call id 1827)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53406 (request call id 1829)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53406 (request call id 1836)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53406 (request call id 1838)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53406 (request call id 1841)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58592 (request call id 230)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53406 (request call id 1842)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53416 (request call id 2620)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53416 (request call id 2621)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53416 (request call id 2622)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53416 (request call id 2623)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53416 (request call id 2628)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53416 (request call id 2629)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53416 (request call id 2630)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53416 (request call id 2631)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53416 (request call id 2632)
Call kudu.consensus.ConsensusService.RunLeaderElection from 127.0.0.1:53416 (request call id 2633)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53406 (request call id 1845)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53406 (request call id 1846)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53406 (request call id 1847)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53416 (request call id 2637)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53416 (request call id 2640)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53416 (request call id 2641)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53416 (request call id 2642)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53416 (request call id 2647)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53416 (request call id 2650)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53416 (request call id 2652)
I20260709 13:19:50.235361 10372 raft_consensus.cc:493] T a1704639a875409b9959353527b3fd68 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:50.236016 10372 raft_consensus.cc:515] T a1704639a875409b9959353527b3fd68 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:50.151784 10228 consensus_queue.cc:237] T 17587d6730594da4a56fa13a353232a1 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
W20260709 13:19:50.258396  6773 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:50.259107  6773 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:50.259083  6697 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 48995.9us
I20260709 13:19:50.260087  6807 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:32976 (request call id 2543) took 1519 ms. Trace:
I20260709 13:19:50.254374  6875 raft_consensus.cc:2468] T 7887766dc6784fcaa42b35c05fea7a99 P cd75a17ab2604397adab03bb8b5fd75c [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 10.
I20260709 13:19:50.261097  6807 rpcz_store.cc:276] 0709 13:19:48.741148 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:48.754804 (+ 13656us) service_pool.cc:224] Handling call
0709 13:19:48.778549 (+ 23745us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:48.811680 (+ 33131us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:48.811713 (+    33us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:48.811763 (+    50us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:19:48.811799 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:50.259813 (+1448014us) spinlock_profiling.cc:243] Waited 20.4 ms on lock 0x7b54002da854. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f9aae01 00007fcc0f9a983e 00007fcc1496e419 00007fcc0dee5bd4 00007fcc0dee5b62 00007fcc0dee5a91 00007fcc0dee5a0c 00007fcc0dee4cc2 00007fcc0dce548c 00007fcc0dce48c6
0709 13:19:50.259862 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:50.260011 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":46875392}
I20260709 13:19:50.231648 10231 raft_consensus.cc:3060] T 7887766dc6784fcaa42b35c05fea7a99 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:50.203425 10240 raft_consensus.cc:2804] T 3a485a995abc4807b6e511e45419f737 P b7ab4784c7344b939bc36f639286f377 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:19:50.268538  6772 leader_election.cc:304] T 7887766dc6784fcaa42b35c05fea7a99 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:19:50.257934 10313 raft_consensus.cc:493] T f3f9c2e2bf644115957398fe4c9459db P b7ab4784c7344b939bc36f639286f377 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:19:50.230130 10314 raft_consensus.cc:493] T 90d42e216d9741e190bca19a781291fd P b7ab4784c7344b939bc36f639286f377 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:19:50.276393 10318 raft_consensus.cc:493] T 30e88460611e47b2ba16a46a30b5f416 P b7ab4784c7344b939bc36f639286f377 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:50.278743 10063 raft_consensus.cc:493] T bd6869f07b5a4885a0b99fbe60c3b175 P b7ab4784c7344b939bc36f639286f377 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:19:50.279335  7498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "404190ce4ce94cecbfcb6ea9d1dd8626" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:19:50.198325 10249 raft_consensus.cc:515] T 8c7f33e544204fbaac4078e3e83bbf4e P b7ab4784c7344b939bc36f639286f377 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:50.280187  7503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be1a92657f494cac8dd227d152f50151" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:19:50.280221  9875 raft_consensus.cc:493] T d8292e16e5654be6bc408560cf256aaa P ccd8a4c3bfe3413cb2ae219b09aea832 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:50.281088 10184 leader_election.cc:290] T 9e326172347f45e99a0d482b5d8ef768 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:19:50.264544 10368 raft_consensus.cc:2749] T 95a75bfe094d4bdc963aba3f08dfcd25 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:19:50.281872  7495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "427c124d773f483294511e80fe340075" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb"
I20260709 13:19:50.282420 10367 raft_consensus.cc:2804] T ab432e62819d499eaaf3dd55481dd930 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:19:50.249732 10164 leader_election.cc:290] T b3f13b31a1f84f0d89d007eadd57924c P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:19:50.211807 10322 raft_consensus.cc:493] T 22ccee1b570c4ad3a57bd7aec085b1b4 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:19:50.268188 10342 raft_consensus.cc:493] T f5be3a11b23d4ea9b08300a2789821c7 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:19:50.257624 10236 raft_consensus.cc:493] T 7a734b5ab7834e05a8c422208acc58b1 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:19:50.286515 10338 leader_election.cc:290] T be1a92657f494cac8dd227d152f50151 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:19:50.287315  6800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f00a2e87e56452083b759f60d461ee3" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:19:50.288100  7502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce4f062dcd314d43a63ca74067cb5ee3" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb"
I20260709 13:19:50.288316 10248 raft_consensus.cc:493] T 1bf4668eeb70467fb3dc5a0289233b3c P ccd8a4c3bfe3413cb2ae219b09aea832 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:50.288794  6725 raft_consensus.cc:1240] T 3d65025eea89441290d85dd053810e31 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 8 FOLLOWER]: Rejecting Update request from peer cd75a17ab2604397adab03bb8b5fd75c for earlier term 7. Current term is 8. Ops: []
I20260709 13:19:50.289551  6724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f9c2e2bf644115957398fe4c9459db" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:19:50.342768  7502 raft_consensus.cc:2376] T ce4f062dcd314d43a63ca74067cb5ee3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 9. Re-sending same reply.
I20260709 13:19:50.317061 10355 raft_consensus.cc:493] T 9b3759de40694069b13c0f8bd40e5709 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:50.291646  6878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce4f062dcd314d43a63ca74067cb5ee3" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:19:50.355626  6878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24ee15416e3145beaa1b8183453729a3" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:19:50.356326  6878 raft_consensus.cc:2468] T 24ee15416e3145beaa1b8183453729a3 P cd75a17ab2604397adab03bb8b5fd75c [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 9.
I20260709 13:19:50.357182  6878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3411566abe2d4c9bb4b2adfdd05e6f17" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:19:50.341943 10263 raft_consensus.cc:493] T 3d65025eea89441290d85dd053810e31 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:50.291997  6728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "713b5728a197487c9300b310ab94e5a3" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:19:50.337363 10063 raft_consensus.cc:515] T bd6869f07b5a4885a0b99fbe60c3b175 P b7ab4784c7344b939bc36f639286f377 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:50.365024  6728 raft_consensus.cc:2393] T 713b5728a197487c9300b310ab94e5a3 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c in current term 10: Already voted for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in this term.
I20260709 13:19:50.365986  6728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de3186201e1a40d0b335eeb8b4e256e0" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:19:50.366873 10063 leader_election.cc:290] T bd6869f07b5a4885a0b99fbe60c3b175 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:50.292125  6798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb7fa124c3bf4ef9ab65a407cb008441" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:19:50.369100  6798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f9c2e2bf644115957398fe4c9459db" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:19:50.291646  6729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "711ef6523deb4cbe8ef2ba61e1c21c98" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:19:50.370112  6729 raft_consensus.cc:2368] T 711ef6523deb4cbe8ef2ba61e1c21c98 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c for earlier term 9. Current term is 10.
I20260709 13:19:50.370942  6729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7887766dc6784fcaa42b35c05fea7a99" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:19:50.292891  6805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8cee0accdb8499c86d4414b72565a38" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:19:50.373126  6805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22ccee1b570c4ad3a57bd7aec085b1b4" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:19:50.293964 10326 leader_election.cc:290] T be1a92657f494cac8dd227d152f50151 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:19:50.293862  6726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34f36d59d88f40fe8a2805e604fc6c0a" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
W20260709 13:19:50.294369  6678 auto_rebalancer.cc:629] Failed to schedule move for tablet 711ef6523deb4cbe8ef2ba61e1c21c98: Illegal state: Replica cd75a17ab2604397adab03bb8b5fd75c is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 10 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } }
I20260709 13:19:50.295600  6731 raft_consensus.cc:1240] T bb3d8792045a4583ae2e965b1350a5b4 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 8 FOLLOWER]: Rejecting Update request from peer cd75a17ab2604397adab03bb8b5fd75c for earlier term 7. Current term is 8. Ops: []
W20260709 13:19:50.296705  6845 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:50.332019  7495 raft_consensus.cc:3060] T 427c124d773f483294511e80fe340075 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:50.311710  6695 leader_election.cc:304] T 404190ce4ce94cecbfcb6ea9d1dd8626 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
I20260709 13:19:50.331089 10367 raft_consensus.cc:493] T ab432e62819d499eaaf3dd55481dd930 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 10 FOLLOWER]: Starting leader election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:19:50.314795  6875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f03d0dbf16864ca4bc1bb5e4c0334c0f" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:19:50.353703 10248 raft_consensus.cc:515] T 1bf4668eeb70467fb3dc5a0289233b3c P ccd8a4c3bfe3413cb2ae219b09aea832 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
W20260709 13:19:50.316534  6772 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 48117.8us
I20260709 13:19:50.401278  6879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8cee0accdb8499c86d4414b72565a38" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:19:50.402160  6879 raft_consensus.cc:2468] T d8cee0accdb8499c86d4414b72565a38 P cd75a17ab2604397adab03bb8b5fd75c [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in term 9.
I20260709 13:19:50.403293  6879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c37d41cd9164c15a6826ca62a851a69" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:19:50.316259  6807 raft_consensus.cc:1240] T 7c37d41cd9164c15a6826ca62a851a69 P b7ab4784c7344b939bc36f639286f377 [term 8 FOLLOWER]: Rejecting Update request from peer ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 7. Current term is 8. Ops: []
I20260709 13:19:50.323027 10313 raft_consensus.cc:515] T f3f9c2e2bf644115957398fe4c9459db P b7ab4784c7344b939bc36f639286f377 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:50.323961 10314 raft_consensus.cc:515] T 90d42e216d9741e190bca19a781291fd P b7ab4784c7344b939bc36f639286f377 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:50.324395 10366 raft_consensus.cc:493] T d33d5ee8ef6f415593d8df52063161ad P ccd8a4c3bfe3413cb2ae219b09aea832 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:19:50.270421 10252 raft_consensus.cc:493] T 20f6842e26174571996b8dea4151d4be P ccd8a4c3bfe3413cb2ae219b09aea832 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:50.327944  6804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3f13b31a1f84f0d89d007eadd57924c" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:19:50.321511 10354 raft_consensus.cc:493] T 4275cf08e63345f993bce8664eada830 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:50.324802 10318 raft_consensus.cc:515] T 30e88460611e47b2ba16a46a30b5f416 P b7ab4784c7344b939bc36f639286f377 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:50.492642  6798 raft_consensus.cc:2393] T f3f9c2e2bf644115957398fe4c9459db P b7ab4784c7344b939bc36f639286f377 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c in current term 8: Already voted for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in this term.
I20260709 13:19:50.329443  9875 raft_consensus.cc:515] T d8292e16e5654be6bc408560cf256aaa P ccd8a4c3bfe3413cb2ae219b09aea832 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:50.325402 10006 raft_consensus.cc:2804] T 7887766dc6784fcaa42b35c05fea7a99 P b7ab4784c7344b939bc36f639286f377 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:19:50.353866 10236 raft_consensus.cc:515] T 7a734b5ab7834e05a8c422208acc58b1 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:50.285230 10306 raft_consensus.cc:515] T 34f36d59d88f40fe8a2805e604fc6c0a P b7ab4784c7344b939bc36f639286f377 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:50.337599  6799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be1a92657f494cac8dd227d152f50151" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:19:50.337683  6727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4b8bd455d5a47c18a1380839c6e0d61" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:19:50.341143  6800 raft_consensus.cc:2468] T 4f00a2e87e56452083b759f60d461ee3 P b7ab4784c7344b939bc36f639286f377 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in term 9.
I20260709 13:19:50.501183  6800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6869f07b5a4885a0b99fbe60c3b175" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:19:50.501338  6724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4b8bd455d5a47c18a1380839c6e0d61" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:19:50.501754  6800 raft_consensus.cc:3060] T bd6869f07b5a4885a0b99fbe60c3b175 P b7ab4784c7344b939bc36f639286f377 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:50.420418 10352 raft_consensus.cc:2804] T 404190ce4ce94cecbfcb6ea9d1dd8626 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:19:50.503304  6724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "853ac0a8cbd64ce99457f170216d4d0f" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:19:50.290285  6732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bf4668eeb70467fb3dc5a0289233b3c" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:19:50.290995  6723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe20b4b48823486ca3b9c648db6ce8aa" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:19:50.232293 10300 raft_consensus.cc:493] T 9b3759de40694069b13c0f8bd40e5709 P b7ab4784c7344b939bc36f639286f377 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:50.358162 10263 raft_consensus.cc:515] T 3d65025eea89441290d85dd053810e31 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:50.331594 10322 raft_consensus.cc:515] T 22ccee1b570c4ad3a57bd7aec085b1b4 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:50.360855  6725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c37d41cd9164c15a6826ca62a851a69" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:19:50.353618 10342 raft_consensus.cc:515] T f5be3a11b23d4ea9b08300a2789821c7 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:50.357884  6878 raft_consensus.cc:2468] T 3411566abe2d4c9bb4b2adfdd05e6f17 P cd75a17ab2604397adab03bb8b5fd75c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 7.
W20260709 13:19:50.377398  6845 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:50.297554  6730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24ee15416e3145beaa1b8183453729a3" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:19:50.540103  6730 raft_consensus.cc:2410] T 24ee15416e3145beaa1b8183453729a3 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c for term 9 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 13:19:50.331897 10249 leader_election.cc:290] T 8c7f33e544204fbaac4078e3e83bbf4e P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 7 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:50.383765  6728 raft_consensus.cc:2468] T de3186201e1a40d0b335eeb8b4e256e0 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 10.
I20260709 13:19:50.258708 10332 raft_consensus.cc:2749] T 2c240553ce044eedb41541d72b9475d7 P b7ab4784c7344b939bc36f639286f377 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:19:50.386139  6875 raft_consensus.cc:3060] T f03d0dbf16864ca4bc1bb5e4c0334c0f P cd75a17ab2604397adab03bb8b5fd75c [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:50.529124 10006 raft_consensus.cc:697] T 7887766dc6784fcaa42b35c05fea7a99 P b7ab4784c7344b939bc36f639286f377 [term 10 LEADER]: Becoming Leader. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
W20260709 13:19:50.386826  6695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 75257.7us
I20260709 13:19:50.400292  6726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a485a995abc4807b6e511e45419f737" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
W20260709 13:19:50.401523  6847 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:50.403987  6879 raft_consensus.cc:3060] T 7c37d41cd9164c15a6826ca62a851a69 P cd75a17ab2604397adab03bb8b5fd75c [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:50.403672  6872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe20b4b48823486ca3b9c648db6ce8aa" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:19:50.548779  6872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fa34c08b205435dba97346991aa1f92" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:19:50.549584  6872 raft_consensus.cc:2468] T 3fa34c08b205435dba97346991aa1f92 P cd75a17ab2604397adab03bb8b5fd75c [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in term 10.
I20260709 13:19:50.406050  6772 leader_election.cc:304] T 4f00a2e87e56452083b759f60d461ee3 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, b7ab4784c7344b939bc36f639286f377; no voters: cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:19:50.340411 10240 raft_consensus.cc:493] T 3a485a995abc4807b6e511e45419f737 P b7ab4784c7344b939bc36f639286f377 [term 7 FOLLOWER]: Starting leader election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:19:50.418154  6731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "427c124d773f483294511e80fe340075" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:19:50.552258  6726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce4f062dcd314d43a63ca74067cb5ee3" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:19:50.436915  6873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "853ac0a8cbd64ce99457f170216d4d0f" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:19:50.553206  6726 raft_consensus.cc:2393] T ce4f062dcd314d43a63ca74067cb5ee3 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate b7ab4784c7344b939bc36f639286f377 in current term 9: Already voted for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in this term.
I20260709 13:19:50.553586  6873 raft_consensus.cc:2468] T 853ac0a8cbd64ce99457f170216d4d0f P cd75a17ab2604397adab03bb8b5fd75c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 6.
I20260709 13:19:50.554137  6726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1704639a875409b9959353527b3fd68" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:19:50.554562  6873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b8cacb381b746da8d0049b0a83b41dd" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:19:50.554780  6726 raft_consensus.cc:3060] T a1704639a875409b9959353527b3fd68 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:50.555570  6873 raft_consensus.cc:2410] T 4b8cacb381b746da8d0049b0a83b41dd P cd75a17ab2604397adab03bb8b5fd75c [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ba59cc884714e8aa5f3f0ecaed84cbb for term 10 because replica has last-logged OpId of term: 9 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 8.
W20260709 13:19:50.437273  7466 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 292364us
I20260709 13:19:50.437587  6805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb7fa124c3bf4ef9ab65a407cb008441" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:19:50.552282 10240 raft_consensus.cc:3060] T 3a485a995abc4807b6e511e45419f737 P b7ab4784c7344b939bc36f639286f377 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:19:50.435945  6880 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53406 (request call id 1818) took 2536 ms (client timeout 1866 ms). Trace:
I20260709 13:19:50.444449  6874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e31b9971c15848dea59d4d4130141d9e" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:19:50.448365  6881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09c2a98de1a4decabd0ff900dd44caa" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
W20260709 13:19:50.487527  6844 connection.cc:256] RPC call timeout handler was delayed by -6.150891503999901s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1545s for a response
I20260709 13:19:50.557473 10248 leader_election.cc:290] T 1bf4668eeb70467fb3dc5a0289233b3c P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:50.567533 10314 leader_election.cc:290] T 90d42e216d9741e190bca19a781291fd P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:50.557821  6805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b3759de40694069b13c0f8bd40e5709" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:19:50.570226  6874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d65025eea89441290d85dd053810e31" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:19:50.571055  6874 raft_consensus.cc:2410] T 3d65025eea89441290d85dd053810e31 P cd75a17ab2604397adab03bb8b5fd75c [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7ab4784c7344b939bc36f639286f377 for term 9 because replica has last-logged OpId of term: 7 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 3.
I20260709 13:19:50.450742  6807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20f6842e26174571996b8dea4151d4be" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
W20260709 13:19:50.566852  6880 rpcz_store.cc:269] 0709 13:19:47.869759 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:47.869942 (+   183us) service_pool.cc:224] Handling call
0709 13:19:50.405470 (+2535528us) spinlock_profiling.cc:243] Waited 1.69 s on lock 0x7b5400348354. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f9ae2fa 00007fcc1496fb17 00007fcc0deea6d4 00007fcc0deea662 00007fcc0deea591 00007fcc0deea50c 00007fcc0dee97c2 00007fcc0dce548c 00007fcc0dce48c6 00007fcc0dce426f
0709 13:19:50.405583 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3892717312}
I20260709 13:19:50.553215  6731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17587d6730594da4a56fa13a353232a1" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:19:50.573136  6880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b8cacb381b746da8d0049b0a83b41dd" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:19:50.573395 10306 leader_election.cc:290] T 34f36d59d88f40fe8a2805e604fc6c0a P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 7 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:50.573669  6731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "404190ce4ce94cecbfcb6ea9d1dd8626" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:19:50.574294  6873 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58592 (request call id 236) took 1351 ms. Trace:
I20260709 13:19:50.574666  6873 rpcz_store.cc:276] 0709 13:19:49.204946 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:50.554304 (+1349358us) service_pool.cc:224] Handling call
0709 13:19:50.555993 (+  1689us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:50.575392 10342 leader_election.cc:290] T f5be3a11b23d4ea9b08300a2789821c7 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:50.495862 10354 raft_consensus.cc:515] T 4275cf08e63345f993bce8664eada830 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:50.576599  6874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3d8792045a4583ae2e965b1350a5b4" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:19:50.506016  6724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3f13b31a1f84f0d89d007eadd57924c" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:19:50.495862  6804 raft_consensus.cc:2468] T b3f13b31a1f84f0d89d007eadd57924c P b7ab4784c7344b939bc36f639286f377 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 7.
I20260709 13:19:50.579448  6724 raft_consensus.cc:2468] T b3f13b31a1f84f0d89d007eadd57924c P ccd8a4c3bfe3413cb2ae219b09aea832 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 7.
I20260709 13:19:50.507756  6732 raft_consensus.cc:2368] T 1bf4668eeb70467fb3dc5a0289233b3c P ccd8a4c3bfe3413cb2ae219b09aea832 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c for earlier term 8. Current term is 9.
I20260709 13:19:50.375818 10355 raft_consensus.cc:515] T 9b3759de40694069b13c0f8bd40e5709 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:50.581527  6881 raft_consensus.cc:3060] T f09c2a98de1a4decabd0ff900dd44caa P cd75a17ab2604397adab03bb8b5fd75c [term 9 FOLLOWER]: Advancing to term 11
I20260709 13:19:50.558331  6799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb7fa124c3bf4ef9ab65a407cb008441" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:19:50.485472 10184 raft_consensus.cc:493] T 4f00a2e87e56452083b759f60d461ee3 P cd75a17ab2604397adab03bb8b5fd75c [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:50.541698  6727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be1a92657f494cac8dd227d152f50151" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:19:50.586826  6727 raft_consensus.cc:2468] T be1a92657f494cac8dd227d152f50151 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 11.
I20260709 13:19:50.583216  6726 raft_consensus.cc:2468] T a1704639a875409b9959353527b3fd68 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 10.
I20260709 13:19:50.528841 10372 leader_election.cc:290] T a1704639a875409b9959353527b3fd68 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:50.540496  6723 raft_consensus.cc:2468] T fe20b4b48823486ca3b9c648db6ce8aa P ccd8a4c3bfe3413cb2ae219b09aea832 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 7.
I20260709 13:19:50.316205  6803 raft_consensus.cc:1240] T e31b9971c15848dea59d4d4130141d9e P b7ab4784c7344b939bc36f639286f377 [term 7 LEADER]: Rejecting Update request from peer cd75a17ab2604397adab03bb8b5fd75c for earlier term 6. Current term is 7. Ops: []
I20260709 13:19:50.589104  6730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e326172347f45e99a0d482b5d8ef768" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:19:50.589708  6803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a734b5ab7834e05a8c422208acc58b1" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 10 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:19:50.544824  6878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbdf895bba214ff68685a24fd17dfb5d" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:19:50.537648 10352 raft_consensus.cc:493] T 404190ce4ce94cecbfcb6ea9d1dd8626 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 7ba59cc884714e8aa5f3f0ecaed84cbb)
I20260709 13:19:50.545111  6802 raft_consensus.cc:1240] T 34f36d59d88f40fe8a2805e604fc6c0a P b7ab4784c7344b939bc36f639286f377 [term 7 FOLLOWER]: Rejecting Update request from peer ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 6. Current term is 7. Ops: []
I20260709 13:19:50.591776  6723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44bde925b2e541b69890d70715b85176" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
W20260709 13:19:50.543656  7468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 271286us
I20260709 13:19:50.546972  6728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f58dc08b12a2494bb9a1372837970ca2" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:19:50.593248  6723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbdf895bba214ff68685a24fd17dfb5d" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:19:50.575767  6873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f00a2e87e56452083b759f60d461ee3" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:19:50.577841 10354 leader_election.cc:290] T 4275cf08e63345f993bce8664eada830 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:50.268028 10102 raft_consensus.cc:2804] T fe20b4b48823486ca3b9c648db6ce8aa P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:19:50.400672 10367 raft_consensus.cc:3060] T ab432e62819d499eaaf3dd55481dd930 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:50.578773  6879 raft_consensus.cc:2468] T 7c37d41cd9164c15a6826ca62a851a69 P cd75a17ab2604397adab03bb8b5fd75c [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 8.
I20260709 13:19:50.580256  6724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c37d41cd9164c15a6826ca62a851a69" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:19:50.507443  6877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44bde925b2e541b69890d70715b85176" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:19:50.596985  6877 raft_consensus.cc:3060] T 44bde925b2e541b69890d70715b85176 P cd75a17ab2604397adab03bb8b5fd75c [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:19:50.580631  6844 connection.cc:256] RPC call timeout handler was delayed by -6.0410915039999509s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16670000000000001s for a response
W20260709 13:19:50.597949  6844 connection.cc:256] RPC call timeout handler was delayed by -6.0104915039999014s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17010000000000003s for a response
W20260709 13:19:50.598254  6844 connection.cc:256] RPC call timeout handler was delayed by -5.8781915039999149s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18480000000000002s for a response
W20260709 13:19:50.598521  6844 connection.cc:256] RPC call timeout handler was delayed by -5.8484915039998668s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18810000000000002s for a response
W20260709 13:19:50.598774  6844 connection.cc:256] RPC call timeout handler was delayed by -5.7764915039999778s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19610000000000002s for a response
W20260709 13:19:50.599038  6844 connection.cc:256] RPC call timeout handler was delayed by -5.762991503999956s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1976s for a response
I20260709 13:19:50.581037  6807 raft_consensus.cc:2393] T 20f6842e26174571996b8dea4151d4be P b7ab4784c7344b939bc36f639286f377 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c in current term 10: Already voted for candidate b7ab4784c7344b939bc36f639286f377 in this term.
I20260709 13:19:50.580844  6872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24ee15416e3145beaa1b8183453729a3" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:19:50.601944  6872 raft_consensus.cc:2468] T 24ee15416e3145beaa1b8183453729a3 P cd75a17ab2604397adab03bb8b5fd75c [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in term 9.
I20260709 13:19:50.602161  6732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4db81d9d329422bb3b4160ca4ac2d1d" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:19:50.602756  6872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbdf895bba214ff68685a24fd17dfb5d" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:19:50.559839  6725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c44c4849aa54f2b94d1f1bef9ed546f" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
W20260709 13:19:50.583163  6772 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.68:45071, user_credentials={real_user=slave}} blocked reactor thread for 179192us
I20260709 13:19:50.528225  6729 raft_consensus.cc:2468] T 7887766dc6784fcaa42b35c05fea7a99 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 10.
I20260709 13:19:50.584827  6695 leader_election.cc:304] T 4d9def8b32fd443aa94ab1420b06837b P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
I20260709 13:19:50.593567  6728 raft_consensus.cc:2410] T f58dc08b12a2494bb9a1372837970ca2 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate b7ab4784c7344b939bc36f639286f377 for term 12 because replica has last-logged OpId of term: 11 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 5.
I20260709 13:19:50.573978  6880 raft_consensus.cc:2410] T 4b8cacb381b746da8d0049b0a83b41dd P cd75a17ab2604397adab03bb8b5fd75c [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ba59cc884714e8aa5f3f0ecaed84cbb for term 10 because replica has last-logged OpId of term: 9 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 8.
I20260709 13:19:50.603999  6872 raft_consensus.cc:3055] T e31b9971c15848dea59d4d4130141d9e P cd75a17ab2604397adab03bb8b5fd75c [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:19:50.606837  6872 raft_consensus.cc:740] T e31b9971c15848dea59d4d4130141d9e P cd75a17ab2604397adab03bb8b5fd75c [term 6 LEADER]: Becoming Follower/Learner. State: Replica: cd75a17ab2604397adab03bb8b5fd75c, State: Running, Role: LEADER
I20260709 13:19:50.604334  6725 raft_consensus.cc:2468] T 7c44c4849aa54f2b94d1f1bef9ed546f P ccd8a4c3bfe3413cb2ae219b09aea832 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 11.
I20260709 13:19:50.611096  6727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3411566abe2d4c9bb4b2adfdd05e6f17" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:19:50.611799  6728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09c2a98de1a4decabd0ff900dd44caa" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 11 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:19:50.611725  6727 raft_consensus.cc:2468] T 3411566abe2d4c9bb4b2adfdd05e6f17 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 7.
I20260709 13:19:50.501689 10252 raft_consensus.cc:515] T 20f6842e26174571996b8dea4151d4be P ccd8a4c3bfe3413cb2ae219b09aea832 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:50.601048  6724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34f36d59d88f40fe8a2805e604fc6c0a" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:19:50.607846  6872 consensus_queue.cc:260] T e31b9971c15848dea59d4d4130141d9e P cd75a17ab2604397adab03bb8b5fd75c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
W20260709 13:19:50.599294  6844 connection.cc:256] RPC call timeout handler was delayed by -5.7143915039998774s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20299999999999999s for a response
I20260709 13:19:50.614349  6880 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58592 (request call id 248) took 1017 ms. Trace:
I20260709 13:19:50.595497 10102 raft_consensus.cc:493] T fe20b4b48823486ca3b9c648db6ce8aa P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:50.619684 10102 raft_consensus.cc:3060] T fe20b4b48823486ca3b9c648db6ce8aa P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:50.619784  6730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d65025eea89441290d85dd053810e31" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:19:50.620330  6876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c44c4849aa54f2b94d1f1bef9ed546f" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:19:50.620730  6730 raft_consensus.cc:2468] T 3d65025eea89441290d85dd053810e31 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 8.
I20260709 13:19:50.621011  6876 raft_consensus.cc:2468] T 7c44c4849aa54f2b94d1f1bef9ed546f P cd75a17ab2604397adab03bb8b5fd75c [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 11.
I20260709 13:19:50.621523  6876 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53406 (request call id 1848) took 1020 ms. Trace:
I20260709 13:19:50.621966  6876 rpcz_store.cc:276] 0709 13:19:49.600894 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:50.592513 (+991619us) service_pool.cc:224] Handling call
0709 13:19:50.621463 (+ 28950us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:50.623065  6876 raft_consensus.cc:1240] T 3411566abe2d4c9bb4b2adfdd05e6f17 P cd75a17ab2604397adab03bb8b5fd75c [term 7 FOLLOWER]: Rejecting Update request from peer b7ab4784c7344b939bc36f639286f377 for earlier term 6. Current term is 7. Ops: []
I20260709 13:19:50.623171  6730 raft_consensus.cc:1275] T 1bf4668eeb70467fb3dc5a0289233b3c P ccd8a4c3bfe3413cb2ae219b09aea832 [term 9 FOLLOWER]: Refusing update from remote peer b7ab4784c7344b939bc36f639286f377: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:19:50.623710  6876 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53406 (request call id 1838) took 2491 ms. Trace:
I20260709 13:19:50.624419  6725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d9def8b32fd443aa94ab1420b06837b" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:19:50.625263  6725 raft_consensus.cc:2468] T 4d9def8b32fd443aa94ab1420b06837b P ccd8a4c3bfe3413cb2ae219b09aea832 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 9.
I20260709 13:19:50.626628  6725 raft_consensus.cc:1275] T a1704639a875409b9959353527b3fd68 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 10 FOLLOWER]: Refusing update from remote peer b7ab4784c7344b939bc36f639286f377: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:19:50.618896  6880 rpcz_store.cc:276] 0709 13:19:49.596845 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:50.572880 (+976035us) service_pool.cc:224] Handling call
0709 13:19:50.614278 (+ 41398us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:50.628316  6880 raft_consensus.cc:1275] T 1bf4668eeb70467fb3dc5a0289233b3c P cd75a17ab2604397adab03bb8b5fd75c [term 9 FOLLOWER]: Refusing update from remote peer b7ab4784c7344b939bc36f639286f377: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:19:50.628943  6880 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53406 (request call id 1841) took 1901 ms. Trace:
I20260709 13:19:50.629310  6880 rpcz_store.cc:276] 0709 13:19:48.727884 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:50.627649 (+1899765us) service_pool.cc:224] Handling call
0709 13:19:50.627959 (+   310us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:50.628700 (+   741us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:50.628876 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:50.599872 10006 consensus_queue.cc:237] T 7887766dc6784fcaa42b35c05fea7a99 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:50.631460 10236 leader_election.cc:290] T 7a734b5ab7834e05a8c422208acc58b1 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:50.632360  6799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de3186201e1a40d0b335eeb8b4e256e0" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:19:50.632835 10313 leader_election.cc:290] T f3f9c2e2bf644115957398fe4c9459db P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:50.632997 10318 leader_election.cc:290] T 30e88460611e47b2ba16a46a30b5f416 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:50.633639  6880 raft_consensus.cc:1240] T d8cee0accdb8499c86d4414b72565a38 P cd75a17ab2604397adab03bb8b5fd75c [term 9 FOLLOWER]: Rejecting Update request from peer 7ba59cc884714e8aa5f3f0ecaed84cbb for earlier term 8. Current term is 9. Ops: []
I20260709 13:19:50.634290  6880 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58592 (request call id 230) took 1690 ms. Trace:
I20260709 13:19:50.634475  9875 leader_election.cc:290] T d8292e16e5654be6bc408560cf256aaa P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:50.634663  6880 rpcz_store.cc:276] 0709 13:19:48.944446 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:50.630555 (+1686109us) service_pool.cc:224] Handling call
0709 13:19:50.633463 (+  2908us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:50.634061 (+   598us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:50.634236 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:19:50.636125  6844 connection.cc:256] RPC call timeout handler was delayed by -5.6900915039998381s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2057s for a response
W20260709 13:19:50.636526  6844 connection.cc:256] RPC call timeout handler was delayed by -5.6648915039997974s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20850000000000002s for a response
I20260709 13:19:50.637347  6807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a92dd554674067a83a9cb68c4773f2" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:19:50.638455 10355 leader_election.cc:290] T 9b3759de40694069b13c0f8bd40e5709 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:50.637442  6803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8292e16e5654be6bc408560cf256aaa" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:19:50.638847 10322 leader_election.cc:290] T 22ccee1b570c4ad3a57bd7aec085b1b4 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:50.587076 10332 raft_consensus.cc:2804] T 4f00a2e87e56452083b759f60d461ee3 P b7ab4784c7344b939bc36f639286f377 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:19:50.639905 10332 raft_consensus.cc:493] T 4f00a2e87e56452083b759f60d461ee3 P b7ab4784c7344b939bc36f639286f377 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:50.640328 10332 raft_consensus.cc:3060] T 4f00a2e87e56452083b759f60d461ee3 P b7ab4784c7344b939bc36f639286f377 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:50.641490  7468 leader_election.cc:304] T bb3d8792045a4583ae2e965b1350a5b4 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
W20260709 13:19:50.643733  6695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 59001us
I20260709 13:19:50.644194  6803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34f36d59d88f40fe8a2805e604fc6c0a" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:19:50.533576 10300 raft_consensus.cc:515] T 9b3759de40694069b13c0f8bd40e5709 P b7ab4784c7344b939bc36f639286f377 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:50.645052  6728 raft_consensus.cc:1240] T 3411566abe2d4c9bb4b2adfdd05e6f17 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 7 FOLLOWER]: Rejecting Update request from peer b7ab4784c7344b939bc36f639286f377 for earlier term 6. Current term is 7. Ops: []
I20260709 13:19:50.657564  6804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "713b5728a197487c9300b310ab94e5a3" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:19:50.633256  6799 raft_consensus.cc:2393] T de3186201e1a40d0b335eeb8b4e256e0 P b7ab4784c7344b939bc36f639286f377 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c in current term 10: Already voted for candidate b7ab4784c7344b939bc36f639286f377 in this term.
I20260709 13:19:50.645522  6877 raft_consensus.cc:2468] T 44bde925b2e541b69890d70715b85176 P cd75a17ab2604397adab03bb8b5fd75c [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 10.
W20260709 13:19:50.636866  6844 connection.cc:256] RPC call timeout handler was delayed by -5.455191503999913s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2318s for a response
W20260709 13:19:50.659087  6844 connection.cc:256] RPC call timeout handler was delayed by -5.4200915039998563s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.23570000000000002s for a response
W20260709 13:19:50.659564  6844 connection.cc:256] RPC call timeout handler was delayed by -5.19059150399994s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.26120000000000004s for a response
W20260709 13:19:50.659958  6844 connection.cc:256] RPC call timeout handler was delayed by -4.82879150399981s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.3014s for a response
W20260709 13:19:50.660362  6844 connection.cc:256] RPC call timeout handler was delayed by -4.5938915039998847s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.3275s for a response
W20260709 13:19:50.660734  6844 connection.cc:256] RPC call timeout handler was delayed by -3.4751915039998948s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.4518s for a response
I20260709 13:19:50.594235  6723 raft_consensus.cc:2468] T dbdf895bba214ff68685a24fd17dfb5d P ccd8a4c3bfe3413cb2ae219b09aea832 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 8.
I20260709 13:19:50.646422  6880 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53406 (request call id 1842) took 1421 ms. Trace:
I20260709 13:19:50.597162 10352 raft_consensus.cc:3060] T 404190ce4ce94cecbfcb6ea9d1dd8626 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:50.646878  6876 rpcz_store.cc:276] 0709 13:19:48.132383 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:50.622604 (+2490221us) service_pool.cc:224] Handling call
0709 13:19:50.622888 (+   284us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:50.623441 (+   553us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:50.623656 (+   215us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:50.650748  6800 raft_consensus.cc:2468] T bd6869f07b5a4885a0b99fbe60c3b175 P b7ab4784c7344b939bc36f639286f377 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 10.
I20260709 13:19:50.674256  6880 rpcz_store.cc:276] 0709 13:19:49.225269 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:50.635447 (+1410178us) service_pool.cc:224] Handling call
0709 13:19:50.635720 (+   273us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:50.635902 (+   182us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:50.635929 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:50.635980 (+    51us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:19:50.636018 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:50.646213 (+ 10195us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:50.646364 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:50.676491  6877 raft_consensus.cc:1240] T de3186201e1a40d0b335eeb8b4e256e0 P cd75a17ab2604397adab03bb8b5fd75c [term 10 FOLLOWER]: Rejecting Update request from peer ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 9. Current term is 10. Ops: [9.5-9.5]
I20260709 13:19:50.677421  6877 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53416 (request call id 2620) took 1276 ms. Trace:
I20260709 13:19:50.677860  6877 rpcz_store.cc:276] 0709 13:19:49.401163 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:50.675617 (+1274454us) service_pool.cc:224] Handling call
0709 13:19:50.676152 (+   535us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:50.677048 (+   896us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:50.677343 (+   295us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:50.675004  6844 leader_election.cc:304] T f58dc08b12a2494bb9a1372837970ca2 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:19:50.651531  6881 raft_consensus.cc:2468] T f09c2a98de1a4decabd0ff900dd44caa P cd75a17ab2604397adab03bb8b5fd75c [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 11.
I20260709 13:19:50.652231  6730 raft_consensus.cc:1275] T f58dc08b12a2494bb9a1372837970ca2 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 12 FOLLOWER]: Refusing update from remote peer b7ab4784c7344b939bc36f639286f377: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 12 index: 6. (term mismatch)
I20260709 13:19:50.680534  6730 pending_rounds.cc:85] T f58dc08b12a2494bb9a1372837970ca2 P ccd8a4c3bfe3413cb2ae219b09aea832: Aborting all ops after (but not including) 5
I20260709 13:19:50.680509  6772 leader_election.cc:304] T 9e326172347f45e99a0d482b5d8ef768 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:19:50.680974  6730 pending_rounds.cc:107] T f58dc08b12a2494bb9a1372837970ca2 P ccd8a4c3bfe3413cb2ae219b09aea832: Aborting uncommitted NO_OP operation due to leader change: 11.6
I20260709 13:19:50.681243  6730 raft_consensus.cc:2889] T f58dc08b12a2494bb9a1372837970ca2 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:19:50.681488  6772 leader_election.cc:304] T 3411566abe2d4c9bb4b2adfdd05e6f17 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:19:50.682113  6881 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53416 (request call id 2643) took 1072 ms. Trace:
I20260709 13:19:50.682512  6881 rpcz_store.cc:276] 0709 13:19:49.609586 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:50.404450 (+794864us) service_pool.cc:224] Handling call
0709 13:19:50.682027 (+277577us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:50.654237  6875 raft_consensus.cc:2468] T f03d0dbf16864ca4bc1bb5e4c0334c0f P cd75a17ab2604397adab03bb8b5fd75c [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 8.
I20260709 13:19:50.496014 10366 raft_consensus.cc:515] T d33d5ee8ef6f415593d8df52063161ad P ccd8a4c3bfe3413cb2ae219b09aea832 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:50.655504  6872 raft_consensus.cc:3060] T e31b9971c15848dea59d4d4130141d9e P cd75a17ab2604397adab03bb8b5fd75c [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:50.663911  6799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b56bf91d90824c959e21e0cee5ba1816" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:19:50.662627  6727 raft_consensus.cc:1240] T e31b9971c15848dea59d4d4130141d9e P ccd8a4c3bfe3413cb2ae219b09aea832 [term 7 FOLLOWER]: Rejecting Update request from peer cd75a17ab2604397adab03bb8b5fd75c for earlier term 6. Current term is 7. Ops: []
I20260709 13:19:50.666289  6805 raft_consensus.cc:2393] T 9b3759de40694069b13c0f8bd40e5709 P b7ab4784c7344b939bc36f639286f377 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c in current term 9: Already voted for candidate b7ab4784c7344b939bc36f639286f377 in this term.
I20260709 13:19:50.667291 10300 leader_election.cc:290] T 9b3759de40694069b13c0f8bd40e5709 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:50.667860  6695 leader_election.cc:304] T dbdf895bba214ff68685a24fd17dfb5d P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
I20260709 13:19:50.589605 10248 consensus_queue.cc:1059] T 07a92dd554674067a83a9cb68c4773f2 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: INVALID_TERM, Last received: 8.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.079s
I20260709 13:19:50.640389  9836 raft_consensus.cc:515] T c4db81d9d329422bb3b4160ca4ac2d1d P b7ab4784c7344b939bc36f639286f377 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:50.669258  9875 consensus_queue.cc:1059] T f03d0dbf16864ca4bc1bb5e4c0334c0f P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:19:50.600072 10299 raft_consensus.cc:493] T 7c37d41cd9164c15a6826ca62a851a69 P cd75a17ab2604397adab03bb8b5fd75c [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:50.594971 10184 raft_consensus.cc:515] T 4f00a2e87e56452083b759f60d461ee3 P cd75a17ab2604397adab03bb8b5fd75c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:19:50.751333 10248 raft_consensus.cc:3055] T 07a92dd554674067a83a9cb68c4773f2 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:19:50.751732 10248 raft_consensus.cc:740] T 07a92dd554674067a83a9cb68c4773f2 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
I20260709 13:19:50.752327 10299 raft_consensus.cc:515] T 7c37d41cd9164c15a6826ca62a851a69 P cd75a17ab2604397adab03bb8b5fd75c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:50.753997  6873 raft_consensus.cc:2410] T 4f00a2e87e56452083b759f60d461ee3 P cd75a17ab2604397adab03bb8b5fd75c [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ba59cc884714e8aa5f3f0ecaed84cbb for term 10 because replica has last-logged OpId of term: 8 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 8.
W20260709 13:19:50.688679  6845 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:50.691818  6801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7887766dc6784fcaa42b35c05fea7a99" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:19:50.588132 10342 consensus_queue.cc:1059] T 44bde925b2e541b69890d70715b85176 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.075s
I20260709 13:19:50.703137  6799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3022224cc81473690653a83d4e99470" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:19:50.755733 10342 raft_consensus.cc:3055] T 44bde925b2e541b69890d70715b85176 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:19:50.756137  6799 raft_consensus.cc:2393] T a3022224cc81473690653a83d4e99470 P b7ab4784c7344b939bc36f639286f377 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c in current term 10: Already voted for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in this term.
I20260709 13:19:50.705884  6803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ba5dac66ab5497e9e336f2a3c28cda5" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:19:50.662348 10328 raft_consensus.cc:2804] T 4d9def8b32fd443aa94ab1420b06837b P ccd8a4c3bfe3413cb2ae219b09aea832 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:19:50.748004 10237 consensus_queue.cc:1059] T 7c37d41cd9164c15a6826ca62a851a69 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:19:50.751006  9875 raft_consensus.cc:3055] T f03d0dbf16864ca4bc1bb5e4c0334c0f P ccd8a4c3bfe3413cb2ae219b09aea832 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:19:50.752581 10248 consensus_queue.cc:260] T 07a92dd554674067a83a9cb68c4773f2 P ccd8a4c3bfe3413cb2ae219b09aea832 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:50.753247 10184 leader_election.cc:290] T 4f00a2e87e56452083b759f60d461ee3 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:19:50.684362  6725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f03d0dbf16864ca4bc1bb5e4c0334c0f" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:19:50.694809  6695 leader_election.cc:304] T b3f13b31a1f84f0d89d007eadd57924c P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
I20260709 13:19:50.757180  6801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e326172347f45e99a0d482b5d8ef768" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:19:50.662637  6807 raft_consensus.cc:2468] T 07a92dd554674067a83a9cb68c4773f2 P b7ab4784c7344b939bc36f639286f377 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 9.
W20260709 13:19:50.988011  6806 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.633s	user 0.006s	sys 0.024s
W20260709 13:19:51.147891  6770 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 451705us
W20260709 13:19:50.996250  6847 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:51.148859  6730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22ccee1b570c4ad3a57bd7aec085b1b4" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:19:51.158108  6730 raft_consensus.cc:2410] T 22ccee1b570c4ad3a57bd7aec085b1b4 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c for term 9 because replica has last-logged OpId of term: 8 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 5.
I20260709 13:19:51.148826  6804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5be3a11b23d4ea9b08300a2789821c7" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
W20260709 13:19:50.769173  6845 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:50.861583  6872 raft_consensus.cc:1275] T e31b9971c15848dea59d4d4130141d9e P cd75a17ab2604397adab03bb8b5fd75c [term 7 FOLLOWER]: Refusing update from remote peer b7ab4784c7344b939bc36f639286f377: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 5. (term mismatch)
W20260709 13:19:51.167135  6845 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:51.153218  6877 raft_consensus.cc:1240] T f03d0dbf16864ca4bc1bb5e4c0334c0f P cd75a17ab2604397adab03bb8b5fd75c [term 8 FOLLOWER]: Rejecting Update request from peer ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 7. Current term is 8. Ops: [7.4-7.4]
I20260709 13:19:51.157455  6732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b3759de40694069b13c0f8bd40e5709" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
W20260709 13:19:50.932983  6697 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.594s	user 0.002s	sys 0.028s
W20260709 13:19:51.155493  6695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 460712us
I20260709 13:19:51.170027  6802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bf4668eeb70467fb3dc5a0289233b3c" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
W20260709 13:19:51.149976  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 475081us
I20260709 13:19:50.757412  6799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c7f33e544204fbaac4078e3e83bbf4e" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
W20260709 13:19:51.171308  6697 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.832s	user 0.009s	sys 0.028s
W20260709 13:19:51.150022  6806 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.795s	user 0.007s	sys 0.028s
I20260709 13:19:51.151695  6723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3d8792045a4583ae2e965b1350a5b4" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:19:50.793052  7495 raft_consensus.cc:2468] T 427c124d773f483294511e80fe340075 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 9.
I20260709 13:19:51.172523  6723 raft_consensus.cc:2468] T bb3d8792045a4583ae2e965b1350a5b4 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 8.
I20260709 13:19:51.167479  6872 pending_rounds.cc:85] T e31b9971c15848dea59d4d4130141d9e P cd75a17ab2604397adab03bb8b5fd75c: Aborting all ops after (but not including) 4
I20260709 13:19:51.174566  6872 pending_rounds.cc:107] T e31b9971c15848dea59d4d4130141d9e P cd75a17ab2604397adab03bb8b5fd75c: Aborting uncommitted NO_OP operation due to leader change: 6.5
I20260709 13:19:51.175004  6872 raft_consensus.cc:2889] T e31b9971c15848dea59d4d4130141d9e P cd75a17ab2604397adab03bb8b5fd75c [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:19:51.168322  6877 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53416 (request call id 2623) took 1766 ms. Trace:
I20260709 13:19:51.175699  6877 rpcz_store.cc:276] 0709 13:19:49.402231 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:50.678864 (+1276633us) service_pool.cc:224] Handling call
0709 13:19:51.152992 (+474128us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:51.167929 (+ 14937us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:51.168261 (+   332us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":419200}
I20260709 13:19:51.177712  6877 raft_consensus.cc:1240] T 7887766dc6784fcaa42b35c05fea7a99 P cd75a17ab2604397adab03bb8b5fd75c [term 10 FOLLOWER]: Rejecting Update request from peer ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 9. Current term is 10. Ops: [9.5-9.5]
I20260709 13:19:51.177953  6872 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53406 (request call id 1836) took 3096 ms. Trace:
I20260709 13:19:51.178411  6877 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53416 (request call id 2630) took 1710 ms. Trace:
I20260709 13:19:50.693159 10160 raft_consensus.cc:2804] T 3411566abe2d4c9bb4b2adfdd05e6f17 P b7ab4784c7344b939bc36f639286f377 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:19:50.710197 10355 raft_consensus.cc:2804] T dbdf895bba214ff68685a24fd17dfb5d P ccd8a4c3bfe3413cb2ae219b09aea832 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:19:50.835330 10275 raft_consensus.cc:2749] T f58dc08b12a2494bb9a1372837970ca2 P cd75a17ab2604397adab03bb8b5fd75c [term 12 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:19:50.915439  6728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8292e16e5654be6bc408560cf256aaa" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:19:51.151093 10328 raft_consensus.cc:493] T 4d9def8b32fd443aa94ab1420b06837b P ccd8a4c3bfe3413cb2ae219b09aea832 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:19:51.171725  6697 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 911416us
W20260709 13:19:51.249641  6697 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: UpdateConsensus request on kudu.consensus.ConsensusService from 127.0.0.1:53416 dropped due to backpressure: service queue is full with 50 items [suppressed 10 similar messages]
I20260709 13:19:51.178643  6872 rpcz_store.cc:276] 0709 13:19:48.081358 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:50.603651 (+2522293us) service_pool.cc:224] Handling call
0709 13:19:50.603905 (+   254us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:51.177565 (+573660us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:51.177866 (+   301us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":12544}
I20260709 13:19:51.182581  6802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8cee0accdb8499c86d4414b72565a38" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:19:51.198036  6799 raft_consensus.cc:2393] T 8c7f33e544204fbaac4078e3e83bbf4e P b7ab4784c7344b939bc36f639286f377 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c in current term 7: Already voted for candidate b7ab4784c7344b939bc36f639286f377 in this term.
I20260709 13:19:51.181257  6725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a92dd554674067a83a9cb68c4773f2" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:19:51.250824  6872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6869f07b5a4885a0b99fbe60c3b175" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:19:51.251641  6872 raft_consensus.cc:2393] T bd6869f07b5a4885a0b99fbe60c3b175 P cd75a17ab2604397adab03bb8b5fd75c [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7ab4784c7344b939bc36f639286f377 in current term 10: Already voted for candidate cd75a17ab2604397adab03bb8b5fd75c in this term.
I20260709 13:19:51.181859  6723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b56bf91d90824c959e21e0cee5ba1816" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:19:51.169278  9836 leader_election.cc:290] T c4db81d9d329422bb3b4160ca4ac2d1d P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 9 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:51.194564  6727 raft_consensus.cc:1275] T fe20b4b48823486ca3b9c648db6ce8aa P ccd8a4c3bfe3413cb2ae219b09aea832 [term 7 FOLLOWER]: Refusing update from remote peer cd75a17ab2604397adab03bb8b5fd75c: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:19:51.178992  6877 rpcz_store.cc:276] 0709 13:19:49.468284 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:51.176821 (+1708537us) service_pool.cc:224] Handling call
0709 13:19:51.177465 (+   644us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:51.178163 (+   698us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:51.178356 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:51.148253  6724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3d8792045a4583ae2e965b1350a5b4" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:19:51.180124  6801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "711ef6523deb4cbe8ef2ba61e1c21c98" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:19:51.255631  6724 raft_consensus.cc:3060] T bb3d8792045a4583ae2e965b1350a5b4 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:51.182008  6770 leader_election.cc:304] T f4b8bd455d5a47c18a1380839c6e0d61 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
W20260709 13:19:51.133335 10240 consensus_meta.cc:287] T 3a485a995abc4807b6e511e45419f737 P b7ab4784c7344b939bc36f639286f377: Time spent flushing consensus metadata: real 0.569s	user 0.013s	sys 0.000s
I20260709 13:19:51.240571  6726 raft_consensus.cc:1240] T dbdf895bba214ff68685a24fd17dfb5d P ccd8a4c3bfe3413cb2ae219b09aea832 [term 8 FOLLOWER]: Rejecting Update request from peer cd75a17ab2604397adab03bb8b5fd75c for earlier term 7. Current term is 8. Ops: []
I20260709 13:19:51.241389 10160 raft_consensus.cc:493] T 3411566abe2d4c9bb4b2adfdd05e6f17 P b7ab4784c7344b939bc36f639286f377 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:51.050249 10252 leader_election.cc:290] T 20f6842e26174571996b8dea4151d4be P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:51.243423  6728 raft_consensus.cc:2368] T d8292e16e5654be6bc408560cf256aaa P ccd8a4c3bfe3413cb2ae219b09aea832 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c for earlier term 11. Current term is 12.
I20260709 13:19:51.277241  6802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5be3a11b23d4ea9b08300a2789821c7" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:19:51.170137  6807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4b8bd455d5a47c18a1380839c6e0d61" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
W20260709 13:19:51.217937 10367 consensus_meta.cc:287] T ab432e62819d499eaaf3dd55481dd930 P ccd8a4c3bfe3413cb2ae219b09aea832: Time spent flushing consensus metadata: real 0.600s	user 0.007s	sys 0.005s
I20260709 13:19:51.225481  6798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c240553ce044eedb41541d72b9475d7" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:19:50.709754 10301 consensus_queue.cc:1059] T 713b5728a197487c9300b310ab94e5a3 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 3, Time since last communication: 0.540s
W20260709 13:19:51.169911  6845 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:51.253778  6804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d33d5ee8ef6f415593d8df52063161ad" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:19:50.762019 10366 leader_election.cc:290] T d33d5ee8ef6f415593d8df52063161ad P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:51.258021  6730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20f6842e26174571996b8dea4151d4be" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:19:51.169755  6732 raft_consensus.cc:2468] T 9b3759de40694069b13c0f8bd40e5709 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 9.
I20260709 13:19:51.266054  6872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90d42e216d9741e190bca19a781291fd" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:19:51.264714  6723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c7f33e544204fbaac4078e3e83bbf4e" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:19:51.293613  6728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de3186201e1a40d0b335eeb8b4e256e0" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:19:51.293560  6877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c7f33e544204fbaac4078e3e83bbf4e" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:19:50.709436 10303 consensus_queue.cc:1048] T e31b9971c15848dea59d4d4130141d9e P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.540s
I20260709 13:19:51.265511  6697 leader_election.cc:304] T 713b5728a197487c9300b310ab94e5a3 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377
I20260709 13:19:51.294874  6728 raft_consensus.cc:2393] T de3186201e1a40d0b335eeb8b4e256e0 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c in current term 10: Already voted for candidate b7ab4784c7344b939bc36f639286f377 in this term.
I20260709 13:19:51.295524  6730 raft_consensus.cc:2468] T 20f6842e26174571996b8dea4151d4be P ccd8a4c3bfe3413cb2ae219b09aea832 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 10.
I20260709 13:19:51.295982  6697 leader_election.cc:304] T 7c44c4849aa54f2b94d1f1bef9ed546f P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377
I20260709 13:19:51.168540 10032 raft_consensus.cc:2804] T b3f13b31a1f84f0d89d007eadd57924c P ccd8a4c3bfe3413cb2ae219b09aea832 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:19:51.151233  9875 raft_consensus.cc:740] T f03d0dbf16864ca4bc1bb5e4c0334c0f P ccd8a4c3bfe3413cb2ae219b09aea832 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
W20260709 13:19:51.277808  6770 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 95880.2us
I20260709 13:19:51.278299  6807 raft_consensus.cc:2410] T f4b8bd455d5a47c18a1380839c6e0d61 P b7ab4784c7344b939bc36f639286f377 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c for term 9 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 13:19:51.243804  6803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30e88460611e47b2ba16a46a30b5f416" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:19:50.756207 10342 raft_consensus.cc:740] T 44bde925b2e541b69890d70715b85176 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
I20260709 13:19:51.250305 10328 raft_consensus.cc:3060] T 4d9def8b32fd443aa94ab1420b06837b P ccd8a4c3bfe3413cb2ae219b09aea832 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:51.218902 10249 consensus_queue.cc:1059] T 1528ab62b6fe4e3099d08f141afee116 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.075s
W20260709 13:19:51.276510  7468 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.634s	user 0.005s	sys 0.009s
I20260709 13:19:51.298460  6697 leader_election.cc:304] T 3411566abe2d4c9bb4b2adfdd05e6f17 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377
I20260709 13:19:51.249830 10324 consensus_queue.cc:1059] T 34f36d59d88f40fe8a2805e604fc6c0a P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.056s
I20260709 13:19:51.307817  6872 raft_consensus.cc:2468] T 90d42e216d9741e190bca19a781291fd P cd75a17ab2604397adab03bb8b5fd75c [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 9.
I20260709 13:19:51.308264  6803 raft_consensus.cc:2393] T 30e88460611e47b2ba16a46a30b5f416 P b7ab4784c7344b939bc36f639286f377 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c in current term 9: Already voted for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in this term.
I20260709 13:19:51.310257  6770 leader_election.cc:304] T de3186201e1a40d0b335eeb8b4e256e0 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:19:51.311875  6844 leader_election.cc:304] T 44bde925b2e541b69890d70715b85176 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:19:51.313325 10219 raft_consensus.cc:2804] T 7c44c4849aa54f2b94d1f1bef9ed546f P ccd8a4c3bfe3413cb2ae219b09aea832 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:19:51.265928 10355 raft_consensus.cc:493] T dbdf895bba214ff68685a24fd17dfb5d P ccd8a4c3bfe3413cb2ae219b09aea832 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:51.299717 10032 raft_consensus.cc:493] T b3f13b31a1f84f0d89d007eadd57924c P ccd8a4c3bfe3413cb2ae219b09aea832 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 7ba59cc884714e8aa5f3f0ecaed84cbb)
I20260709 13:19:51.313730  6877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34f36d59d88f40fe8a2805e604fc6c0a" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:19:51.316675  6802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d33d5ee8ef6f415593d8df52063161ad" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
W20260709 13:19:51.282037 10313 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.517s	user 0.002s	sys 0.023s
I20260709 13:19:51.321261  6723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6869f07b5a4885a0b99fbe60c3b175" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:19:51.326325  6804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4275cf08e63345f993bce8664eada830" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:19:51.278169 10160 raft_consensus.cc:3060] T 3411566abe2d4c9bb4b2adfdd05e6f17 P b7ab4784c7344b939bc36f639286f377 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:51.328869  6807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22ccee1b570c4ad3a57bd7aec085b1b4" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:19:51.329005  6800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20f6842e26174571996b8dea4151d4be" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:19:51.321101 10268 raft_consensus.cc:2749] T f4b8bd455d5a47c18a1380839c6e0d61 P b7ab4784c7344b939bc36f639286f377 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:19:51.334517  6697 leader_election.cc:304] T 711ef6523deb4cbe8ef2ba61e1c21c98 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:19:51.354568  6723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a734b5ab7834e05a8c422208acc58b1" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 10 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:19:51.274842  6799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a734b5ab7834e05a8c422208acc58b1" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
W20260709 13:19:51.336412  7468 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.694s	user 0.005s	sys 0.010s
W20260709 13:19:51.364698  7468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 723218us
W20260709 13:19:51.336859  6878 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.718s	user 0.005s	sys 0.023s
I20260709 13:19:51.340575  6798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bf4668eeb70467fb3dc5a0289233b3c" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:19:51.338775 10366 raft_consensus.cc:2804] T 713b5728a197487c9300b310ab94e5a3 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:19:51.369124  6807 raft_consensus.cc:1240] T bd6869f07b5a4885a0b99fbe60c3b175 P b7ab4784c7344b939bc36f639286f377 [term 10 FOLLOWER]: Rejecting Update request from peer ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 9. Current term is 10. Ops: []
I20260709 13:19:51.369961  6807 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:32976 (request call id 2561) took 1052 ms. Trace:
W20260709 13:19:51.349367  6874 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.761s	user 0.011s	sys 0.036s
I20260709 13:19:51.349557  6802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1704639a875409b9959353527b3fd68" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 10 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:19:51.273603 10240 raft_consensus.cc:515] T 3a485a995abc4807b6e511e45419f737 P b7ab4784c7344b939bc36f639286f377 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:51.347343  6877 raft_consensus.cc:3060] T 34f36d59d88f40fe8a2805e604fc6c0a P cd75a17ab2604397adab03bb8b5fd75c [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:51.347146  6770 leader_election.cc:304] T ce4f062dcd314d43a63ca74067cb5ee3 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, b7ab4784c7344b939bc36f639286f377; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:19:51.344655  6724 raft_consensus.cc:2468] T bb3d8792045a4583ae2e965b1350a5b4 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 9.
I20260709 13:19:51.330338  6801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b3759de40694069b13c0f8bd40e5709" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
W20260709 13:19:51.351482 10313 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.587s	user 0.003s	sys 0.023s
I20260709 13:19:51.352730 10219 raft_consensus.cc:697] T 7c44c4849aa54f2b94d1f1bef9ed546f P ccd8a4c3bfe3413cb2ae219b09aea832 [term 11 LEADER]: Becoming Leader. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
I20260709 13:19:51.353722  6800 raft_consensus.cc:2468] T 20f6842e26174571996b8dea4151d4be P b7ab4784c7344b939bc36f639286f377 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 10.
W20260709 13:19:51.360759  7500 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.783s	user 0.010s	sys 0.040s
W20260709 13:19:51.388204  7500 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.810s	user 0.010s	sys 0.040s
I20260709 13:19:51.351382 10032 raft_consensus.cc:3060] T b3f13b31a1f84f0d89d007eadd57924c P ccd8a4c3bfe3413cb2ae219b09aea832 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:19:51.367280  6878 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.749s	user 0.005s	sys 0.023s
I20260709 13:19:51.370048  6804 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:32976 (request call id 2562) took 1048 ms. Trace:
I20260709 13:19:51.345589  6872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f9c2e2bf644115957398fe4c9459db" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:19:51.379033 10366 raft_consensus.cc:697] T 713b5728a197487c9300b310ab94e5a3 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 10 LEADER]: Becoming Leader. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
W20260709 13:19:51.370431  6773 thread.cc:641] server-negotiator [worker] (thread pool) Time spent creating pthread: real 0.697s	user 0.011s	sys 0.032s
I20260709 13:19:51.370424  6807 rpcz_store.cc:276] 0709 13:19:50.317949 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:51.367968 (+1050019us) service_pool.cc:224] Handling call
0709 13:19:51.368898 (+   930us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:51.369661 (+   763us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:51.369892 (+   231us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:51.371605  6802 raft_consensus.cc:1240] T 4d9def8b32fd443aa94ab1420b06837b P b7ab4784c7344b939bc36f639286f377 [term 9 FOLLOWER]: Rejecting Update request from peer cd75a17ab2604397adab03bb8b5fd75c for earlier term 8. Current term is 9. Ops: [8.5-8.5]
I20260709 13:19:51.399084  6804 rpcz_store.cc:276] 0709 13:19:50.321949 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:51.369169 (+1047220us) service_pool.cc:224] Handling call
0709 13:19:51.369567 (+   398us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:51.369783 (+   216us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:51.369801 (+    18us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:51.369837 (+    36us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:19:51.369868 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:51.369908 (+    40us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:51.369989 (+    81us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:19:51.371995  6874 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.784s	user 0.012s	sys 0.037s
I20260709 13:19:51.399389  6872 raft_consensus.cc:2468] T f3f9c2e2bf644115957398fe4c9459db P cd75a17ab2604397adab03bb8b5fd75c [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 8.
I20260709 13:19:51.343691 10249 raft_consensus.cc:3055] T 1528ab62b6fe4e3099d08f141afee116 P b7ab4784c7344b939bc36f639286f377 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:19:51.341559 10237 raft_consensus.cc:2804] T 3411566abe2d4c9bb4b2adfdd05e6f17 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:19:51.354521  9836 raft_consensus.cc:2804] T de3186201e1a40d0b335eeb8b4e256e0 P b7ab4784c7344b939bc36f639286f377 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:19:51.374111  6799 raft_consensus.cc:1240] T 3d65025eea89441290d85dd053810e31 P b7ab4784c7344b939bc36f639286f377 [term 8 FOLLOWER]: Rejecting Update request from peer cd75a17ab2604397adab03bb8b5fd75c for earlier term 7. Current term is 8. Ops: [7.4-7.4]
I20260709 13:19:51.297955 10367 raft_consensus.cc:515] T ab432e62819d499eaaf3dd55481dd930 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
W20260709 13:19:51.358057  6847 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:51.344183 10355 raft_consensus.cc:3060] T dbdf895bba214ff68685a24fd17dfb5d P ccd8a4c3bfe3413cb2ae219b09aea832 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:51.376718  6803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8292e16e5654be6bc408560cf256aaa" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:19:51.344565 10275 raft_consensus.cc:2749] T 44bde925b2e541b69890d70715b85176 P cd75a17ab2604397adab03bb8b5fd75c [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:19:51.351068 10306 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.679s	user 0.009s	sys 0.020s
W20260709 13:19:51.386911  6846 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.768s	user 0.019s	sys 0.018s
W20260709 13:19:51.361116  7466 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.804s	user 0.015s	sys 0.034s
W20260709 13:19:51.427452  6846 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.809s	user 0.019s	sys 0.018s
W20260709 13:19:51.427666  7466 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.871s	user 0.015s	sys 0.035s
W20260709 13:19:51.428176  7466 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 871375us
I20260709 13:19:51.389840  6798 raft_consensus.cc:1240] T dbdf895bba214ff68685a24fd17dfb5d P b7ab4784c7344b939bc36f639286f377 [term 8 FOLLOWER]: Rejecting Update request from peer cd75a17ab2604397adab03bb8b5fd75c for earlier term 7. Current term is 8. Ops: []
I20260709 13:19:51.429936  6798 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:32966 (request call id 923) took 1060 ms. Trace:
W20260709 13:19:51.370781  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 75964.7us
I20260709 13:19:51.405329  6872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b3759de40694069b13c0f8bd40e5709" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:19:51.431876  6872 raft_consensus.cc:2410] T 9b3759de40694069b13c0f8bd40e5709 P cd75a17ab2604397adab03bb8b5fd75c [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7ab4784c7344b939bc36f639286f377 for term 10 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
W20260709 13:19:51.406772  6773 thread.cc:608] server-negotiator [worker] (thread pool) Time spent starting thread: real 0.734s	user 0.011s	sys 0.032s
I20260709 13:19:51.407912  6724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d33d5ee8ef6f415593d8df52063161ad" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:19:51.409017  6807 raft_consensus.cc:1275] T f09c2a98de1a4decabd0ff900dd44caa P b7ab4784c7344b939bc36f639286f377 [term 11 FOLLOWER]: Refusing update from remote peer ccd8a4c3bfe3413cb2ae219b09aea832: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
W20260709 13:19:51.346017  6672 thread.cc:641] client-negotiator [worker] (thread pool) Time spent creating pthread: real 0.709s	user 0.005s	sys 0.024s
I20260709 13:19:51.432888  6724 raft_consensus.cc:2410] T d33d5ee8ef6f415593d8df52063161ad P ccd8a4c3bfe3413cb2ae219b09aea832 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c for term 11 because replica has last-logged OpId of term: 10 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
W20260709 13:19:51.377909 10102 consensus_meta.cc:287] T fe20b4b48823486ca3b9c648db6ce8aa P 7ba59cc884714e8aa5f3f0ecaed84cbb: Time spent flushing consensus metadata: real 0.758s	user 0.006s	sys 0.006s
I20260709 13:19:51.430399  6798 rpcz_store.cc:276] 0709 13:19:50.369789 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:51.368087 (+998298us) service_pool.cc:224] Handling call
0709 13:19:51.389552 (+ 21465us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:51.429584 (+ 40032us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:51.429860 (+   276us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:51.381479 10324 raft_consensus.cc:3055] T 34f36d59d88f40fe8a2805e604fc6c0a P ccd8a4c3bfe3413cb2ae219b09aea832 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:19:51.408984 10249 raft_consensus.cc:740] T 1528ab62b6fe4e3099d08f141afee116 P b7ab4784c7344b939bc36f639286f377 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
I20260709 13:19:51.406592 10303 raft_consensus.cc:2749] T ce4f062dcd314d43a63ca74067cb5ee3 P b7ab4784c7344b939bc36f639286f377 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:19:51.416193 10252 raft_consensus.cc:2749] T 711ef6523deb4cbe8ef2ba61e1c21c98 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:19:51.435644  6724 raft_consensus.cc:1275] T bb3d8792045a4583ae2e965b1350a5b4 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 9 FOLLOWER]: Refusing update from remote peer cd75a17ab2604397adab03bb8b5fd75c: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
W20260709 13:19:51.438086  6773 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:51.446044  6773 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:51.420591  9836 raft_consensus.cc:697] T de3186201e1a40d0b335eeb8b4e256e0 P b7ab4784c7344b939bc36f639286f377 [term 10 LEADER]: Becoming Leader. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
I20260709 13:19:51.426780 10237 raft_consensus.cc:697] T 3411566abe2d4c9bb4b2adfdd05e6f17 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 7 LEADER]: Becoming Leader. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
W20260709 13:19:51.435199  6672 thread.cc:608] client-negotiator [worker] (thread pool) Time spent starting thread: real 0.798s	user 0.005s	sys 0.024s
W20260709 13:19:51.427232 10306 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.755s	user 0.010s	sys 0.021s
I20260709 13:19:51.397997 10378 raft_consensus.cc:2749] T bb3d8792045a4583ae2e965b1350a5b4 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 9 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:19:51.386113  9875 consensus_queue.cc:260] T f03d0dbf16864ca4bc1bb5e4c0334c0f P ccd8a4c3bfe3413cb2ae219b09aea832 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:51.477458  6877 raft_consensus.cc:2468] T 34f36d59d88f40fe8a2805e604fc6c0a P cd75a17ab2604397adab03bb8b5fd75c [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 7.
I20260709 13:19:51.494769  6724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5be3a11b23d4ea9b08300a2789821c7" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:19:51.443193 10324 raft_consensus.cc:740] T 34f36d59d88f40fe8a2805e604fc6c0a P ccd8a4c3bfe3413cb2ae219b09aea832 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
I20260709 13:19:51.439961  6872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30e88460611e47b2ba16a46a30b5f416" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 10 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:19:51.399724 10342 consensus_queue.cc:260] T 44bde925b2e541b69890d70715b85176 P ccd8a4c3bfe3413cb2ae219b09aea832 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
W20260709 13:19:51.543565  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 64867.9us
I20260709 13:19:51.539758  6872 raft_consensus.cc:2410] T 30e88460611e47b2ba16a46a30b5f416 P cd75a17ab2604397adab03bb8b5fd75c [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7ab4784c7344b939bc36f639286f377 for term 10 because replica has last-logged OpId of term: 7 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:19:51.443044 10102 raft_consensus.cc:515] T fe20b4b48823486ca3b9c648db6ce8aa P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:19:51.562803  6724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3022224cc81473690653a83d4e99470" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:19:51.537005 10219 consensus_queue.cc:237] T 7c44c4849aa54f2b94d1f1bef9ed546f P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
W20260709 13:19:51.553275 10006 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.920s	user 0.036s	sys 0.077s
W20260709 13:19:51.572495 10006 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.939s	user 0.037s	sys 0.078s
W20260709 13:19:51.573357  6846 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:51.577307  6846 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:51.577703  6846 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:51.583693  6872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4db81d9d329422bb3b4160ca4ac2d1d" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:19:51.584717  6872 raft_consensus.cc:3060] T c4db81d9d329422bb3b4160ca4ac2d1d P cd75a17ab2604397adab03bb8b5fd75c [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:51.589578  7495 raft_consensus.cc:1240] T ce4f062dcd314d43a63ca74067cb5ee3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 9 FOLLOWER]: Rejecting Update request from peer cd75a17ab2604397adab03bb8b5fd75c for earlier term 8. Current term is 9. Ops: []
I20260709 13:19:51.592300  7495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f00a2e87e56452083b759f60d461ee3" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:19:51.593076  7495 raft_consensus.cc:2468] T 4f00a2e87e56452083b759f60d461ee3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 9.
I20260709 13:19:51.598234  6846 leader_election.cc:304] T 4f00a2e87e56452083b759f60d461ee3 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:19:51.578220 10342 raft_consensus.cc:3060] T 44bde925b2e541b69890d70715b85176 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:51.552503  9875 raft_consensus.cc:3060] T f03d0dbf16864ca4bc1bb5e4c0334c0f P ccd8a4c3bfe3413cb2ae219b09aea832 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:19:51.614923  6845 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:51.622925  6877 raft_consensus.cc:1275] T 9e326172347f45e99a0d482b5d8ef768 P cd75a17ab2604397adab03bb8b5fd75c [term 8 FOLLOWER]: Refusing update from remote peer ccd8a4c3bfe3413cb2ae219b09aea832: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 4. (term mismatch)
I20260709 13:19:51.623790  6877 pending_rounds.cc:85] T 9e326172347f45e99a0d482b5d8ef768 P cd75a17ab2604397adab03bb8b5fd75c: Aborting all ops after (but not including) 3
I20260709 13:19:51.624202  6877 pending_rounds.cc:107] T 9e326172347f45e99a0d482b5d8ef768 P cd75a17ab2604397adab03bb8b5fd75c: Aborting uncommitted NO_OP operation due to leader change: 6.4
I20260709 13:19:51.624847  6877 raft_consensus.cc:2889] T 9e326172347f45e99a0d482b5d8ef768 P cd75a17ab2604397adab03bb8b5fd75c [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:19:51.548990 10366 consensus_queue.cc:237] T 713b5728a197487c9300b310ab94e5a3 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
W20260709 13:19:51.607004  6875 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.915s	user 0.017s	sys 0.025s
I20260709 13:19:51.610001  6724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c240553ce044eedb41541d72b9475d7" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
W20260709 13:19:51.628999 10395 log.cc:927] Time spent T 711ef6523deb4cbe8ef2ba61e1c21c98 P ccd8a4c3bfe3413cb2ae219b09aea832: Append to log took a long time: real 0.145s	user 0.001s	sys 0.000s
I20260709 13:19:51.607015 10275 consensus_queue.cc:1059] T ce4f062dcd314d43a63ca74067cb5ee3 P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.021s
I20260709 13:19:51.630077 10275 raft_consensus.cc:3055] T ce4f062dcd314d43a63ca74067cb5ee3 P cd75a17ab2604397adab03bb8b5fd75c [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:19:51.630503 10275 raft_consensus.cc:740] T ce4f062dcd314d43a63ca74067cb5ee3 P cd75a17ab2604397adab03bb8b5fd75c [term 8 LEADER]: Becoming Follower/Learner. State: Replica: cd75a17ab2604397adab03bb8b5fd75c, State: Running, Role: LEADER
I20260709 13:19:51.631762 10375 raft_consensus.cc:493] T ce4f062dcd314d43a63ca74067cb5ee3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:51.631523 10275 consensus_queue.cc:260] T ce4f062dcd314d43a63ca74067cb5ee3 P cd75a17ab2604397adab03bb8b5fd75c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } attrs { replace: true } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:19:51.632357 10375 raft_consensus.cc:515] T ce4f062dcd314d43a63ca74067cb5ee3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } attrs { replace: true } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:19:51.633383 10275 raft_consensus.cc:3060] T ce4f062dcd314d43a63ca74067cb5ee3 P cd75a17ab2604397adab03bb8b5fd75c [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:51.633787  6876 raft_consensus.cc:1240] T 2c240553ce044eedb41541d72b9475d7 P cd75a17ab2604397adab03bb8b5fd75c [term 11 FOLLOWER]: Rejecting Update request from peer ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 10. Current term is 11. Ops: [10.6-10.6]
I20260709 13:19:51.634578  6876 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53416 (request call id 2621) took 2233 ms. Trace:
I20260709 13:19:51.634904  6876 rpcz_store.cc:276] 0709 13:19:49.401554 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:50.679393 (+1277839us) service_pool.cc:224] Handling call
0709 13:19:51.633159 (+953766us) spinlock_profiling.cc:243] Waited 2.1 ms on lock 0x7b5800147c98. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0c745db1 00007fcc0c885b71 00007fcc0c885a22 00007fcc1579ec09 00007fcc148f8ee0 00007fcc149c20ab 00007fcc149c2131 00007fcc14983fc0 00007fcc1496e929 00007fcc1496e3d2 00007fcc0dee5bd4
0709 13:19:51.633519 (+   360us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:51.634275 (+   756us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:51.634514 (+   239us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4819712}
I20260709 13:19:51.635514 10375 leader_election.cc:290] T ce4f062dcd314d43a63ca74067cb5ee3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
W20260709 13:19:51.636314  6875 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.944s	user 0.017s	sys 0.025s
I20260709 13:19:51.622869 10240 leader_election.cc:290] T 3a485a995abc4807b6e511e45419f737 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 8 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:51.639698  6875 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53416 (request call id 2629) took 2171 ms. Trace:
W20260709 13:19:51.641382 10332 consensus_meta.cc:287] T 4f00a2e87e56452083b759f60d461ee3 P b7ab4784c7344b939bc36f639286f377: Time spent flushing consensus metadata: real 1.000s	user 0.010s	sys 0.004s
I20260709 13:19:51.641886 10332 raft_consensus.cc:515] T 4f00a2e87e56452083b759f60d461ee3 P b7ab4784c7344b939bc36f639286f377 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:19:51.646323 10367 leader_election.cc:290] T ab432e62819d499eaaf3dd55481dd930 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 11 election: Requested vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:51.648139 10399 raft_consensus.cc:493] T 3fa34c08b205435dba97346991aa1f92 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 10 FOLLOWER]: Starting pre-election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:19:51.641120 10063 raft_consensus.cc:3055] T 713b5728a197487c9300b310ab94e5a3 P b7ab4784c7344b939bc36f639286f377 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:19:51.648766 10399 raft_consensus.cc:515] T 3fa34c08b205435dba97346991aa1f92 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:19:51.649194 10063 raft_consensus.cc:740] T 713b5728a197487c9300b310ab94e5a3 P b7ab4784c7344b939bc36f639286f377 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
I20260709 13:19:51.650976 10399 leader_election.cc:290] T 3fa34c08b205435dba97346991aa1f92 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:51.640857  6875 rpcz_store.cc:276] 0709 13:19:49.467924 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:50.684316 (+1216392us) service_pool.cc:224] Handling call
0709 13:19:50.684599 (+   283us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:50.689559 (+  4960us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:19:50.691487 (+  1928us) log.cc:844] Serialized 14 byte log entry
0709 13:19:51.638278 (+946791us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:51.638520 (+   242us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:19:51.638760 (+   240us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:51.639009 (+   249us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:51.639458 (+   449us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":865,"prepare.run_cpu_time_us":48,"prepare.run_wall_time_us":50,"raft.queue_time_us":202,"raft.run_cpu_time_us":126,"raft.run_wall_time_us":127,"thread_start_us":945538,"threads_started":1}
W20260709 13:19:51.604758  6880 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.717s	user 0.014s	sys 0.052s
W20260709 13:19:51.656662  6880 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.769s	user 0.014s	sys 0.052s
I20260709 13:19:51.655980  6873 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58592 (request call id 257) took 2020 ms. Trace:
I20260709 13:19:51.657210  6873 rpcz_store.cc:276] 0709 13:19:49.635687 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:50.575517 (+939830us) service_pool.cc:224] Handling call
0709 13:19:51.648001 (+1072484us) spinlock_profiling.cc:243] Waited 160 ms on lock 0x7b5400217fd4. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f9ae2fa 00007fcc1496fb17 00007fcc0deea6d4 00007fcc0deea662 00007fcc0deea591 00007fcc0deea50c 00007fcc0dee97c2 00007fcc0dce548c 00007fcc0dce48c6 00007fcc0dce426f
0709 13:19:51.655872 (+  7871us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":367053056}
I20260709 13:19:51.646214  7500 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50756 (request call id 235) took 1474 ms. Trace:
I20260709 13:19:51.667863  6806 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:32976 (request call id 2556) took 1359 ms. Trace:
I20260709 13:19:51.672879  6724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30e88460611e47b2ba16a46a30b5f416" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:19:51.709818  6877 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53416 (request call id 2631) took 2241 ms. Trace:
I20260709 13:19:51.710489  6877 rpcz_store.cc:276] 0709 13:19:49.468624 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:51.615904 (+2147280us) service_pool.cc:224] Handling call
0709 13:19:51.617333 (+  1429us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:51.709420 (+ 92087us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:51.709728 (+   308us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:19:51.713675  6845 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:51.611549 10389 raft_consensus.cc:2804] T 4f00a2e87e56452083b759f60d461ee3 P cd75a17ab2604397adab03bb8b5fd75c [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:19:51.667769  7500 rpcz_store.cc:276] 0709 13:19:50.172219 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:50.172668 (+   449us) service_pool.cc:224] Handling call
0709 13:19:50.173027 (+   359us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:50.498422 (+325395us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:50.498460 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:50.532309 (+ 33849us) log.cc:844] Serialized 26 byte log entry
0709 13:19:51.388692 (+856383us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:19:51.388753 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:51.388857 (+   104us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:51.645981 (+257124us) raft_consensus.cc:1685] finished
0709 13:19:51.646002 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:51.646150 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":440078,"raft.run_cpu_time_us":193,"raft.run_wall_time_us":48524,"thread_start_us":1135560,"threads_started":2,"wal-append.queue_time_us":1047177}
W20260709 13:19:51.731848  6847 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:51.773265  6696 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:51.734568 10379 log.cc:927] Time spent T 427c124d773f483294511e80fe340075 P ccd8a4c3bfe3413cb2ae219b09aea832: Append to log took a long time: real 0.224s	user 0.006s	sys 0.000s
W20260709 13:19:51.735548  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 113136us
I20260709 13:19:51.774515  6844 leader_election.cc:304] T f03d0dbf16864ca4bc1bb5e4c0334c0f P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:19:51.737814  6724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7887766dc6784fcaa42b35c05fea7a99" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:19:51.739722  6875 raft_consensus.cc:1275] T d8cee0accdb8499c86d4414b72565a38 P cd75a17ab2604397adab03bb8b5fd75c [term 9 FOLLOWER]: Refusing update from remote peer b7ab4784c7344b939bc36f639286f377: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:19:51.776139  6875 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53406 (request call id 1845) took 2257 ms. Trace:
I20260709 13:19:51.777020  6724 raft_consensus.cc:2393] T 7887766dc6784fcaa42b35c05fea7a99 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c in current term 10: Already voted for candidate b7ab4784c7344b939bc36f639286f377 in this term.
I20260709 13:19:51.776652  6875 rpcz_store.cc:276] 0709 13:19:49.518473 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:51.738823 (+2220350us) service_pool.cc:224] Handling call
0709 13:19:51.739266 (+   443us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:51.775698 (+ 36432us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:51.776029 (+   331us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:51.741037 10248 raft_consensus.cc:3060] T 07a92dd554674067a83a9cb68c4773f2 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:19:51.711606 10352 consensus_meta.cc:287] T 404190ce4ce94cecbfcb6ea9d1dd8626 P ccd8a4c3bfe3413cb2ae219b09aea832: Time spent flushing consensus metadata: real 1.011s	user 0.014s	sys 0.000s
I20260709 13:19:51.611774  9836 consensus_queue.cc:237] T de3186201e1a40d0b335eeb8b4e256e0 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
W20260709 13:19:51.748629  6770 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 402072us
I20260709 13:19:51.712100 10166 raft_consensus.cc:2804] T 9e326172347f45e99a0d482b5d8ef768 P b7ab4784c7344b939bc36f639286f377 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:19:51.762590  6723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e326172347f45e99a0d482b5d8ef768" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:19:51.606287 10237 consensus_queue.cc:237] T 3411566abe2d4c9bb4b2adfdd05e6f17 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:51.719830 10332 leader_election.cc:290] T 4f00a2e87e56452083b759f60d461ee3 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 10 election: Requested vote from peers cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
W20260709 13:19:51.769452  6805 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:32966 (request call id 928) took 1398 ms (client timeout 1637 ms). Trace:
W20260709 13:19:51.813231  6805 rpcz_store.cc:269] 0709 13:19:50.371304 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:50.557579 (+186275us) service_pool.cc:224] Handling call
0709 13:19:51.769251 (+1211672us) spinlock_profiling.cc:243] Waited 96.8 ms on lock 0x7b54001f6654. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f9ae2fa 00007fcc1496fb17 00007fcc0deea6d4 00007fcc0deea662 00007fcc0deea591 00007fcc0deea50c 00007fcc0dee97c2 00007fcc0dce548c 00007fcc0dce48c6 00007fcc0dce426f
0709 13:19:51.769380 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":222537088}
I20260709 13:19:51.733282  6873 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3fa34c08b205435dba97346991aa1f92"
dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
 from {username='slave'} at 127.0.0.1:53416
I20260709 13:19:51.814877  6873 raft_consensus.cc:493] T 3fa34c08b205435dba97346991aa1f92 P cd75a17ab2604397adab03bb8b5fd75c [term 10 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:19:51.815274  6873 raft_consensus.cc:3060] T 3fa34c08b205435dba97346991aa1f92 P cd75a17ab2604397adab03bb8b5fd75c [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:51.626525 10324 consensus_queue.cc:260] T 34f36d59d88f40fe8a2805e604fc6c0a P ccd8a4c3bfe3413cb2ae219b09aea832 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:51.803241  6770 leader_election.cc:304] T b3f13b31a1f84f0d89d007eadd57924c P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb
I20260709 13:19:51.818176  6770 leader_election.cc:304] T be1a92657f494cac8dd227d152f50151 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb
I20260709 13:19:51.821172  6770 leader_election.cc:304] T 7c44c4849aa54f2b94d1f1bef9ed546f P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
I20260709 13:19:51.777269 10389 raft_consensus.cc:493] T 4f00a2e87e56452083b759f60d461ee3 P cd75a17ab2604397adab03bb8b5fd75c [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:51.830227 10313 raft_consensus.cc:2804] T 7c44c4849aa54f2b94d1f1bef9ed546f P b7ab4784c7344b939bc36f639286f377 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:19:51.830662 10313 raft_consensus.cc:493] T 7c44c4849aa54f2b94d1f1bef9ed546f P b7ab4784c7344b939bc36f639286f377 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:51.831043 10313 raft_consensus.cc:3060] T 7c44c4849aa54f2b94d1f1bef9ed546f P b7ab4784c7344b939bc36f639286f377 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:51.832939  6880 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53416 (request call id 2622) took 2431 ms. Trace:
I20260709 13:19:51.833333  6880 rpcz_store.cc:276] 0709 13:19:49.401896 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:50.676236 (+1274340us) service_pool.cc:224] Handling call
0709 13:19:50.676666 (+   430us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:50.687084 (+ 10418us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:19:50.687134 (+    50us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:50.687807 (+   673us) log.cc:844] Serialized 26 byte log entry
0709 13:19:51.657251 (+969444us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:19:51.657310 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:51.657403 (+    93us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:51.832718 (+175315us) raft_consensus.cc:1685] finished
0709 13:19:51.832736 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:51.832880 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":16199,"raft.run_cpu_time_us":144,"raft.run_wall_time_us":8539,"thread_start_us":769095,"threads_started":1,"wal-append.queue_time_us":1029094}
I20260709 13:19:51.835279  6880 raft_consensus.cc:1240] T f58dc08b12a2494bb9a1372837970ca2 P cd75a17ab2604397adab03bb8b5fd75c [term 12 FOLLOWER]: Rejecting Update request from peer ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 11. Current term is 12. Ops: [10.5-11.6]
I20260709 13:19:51.835906  6880 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53416 (request call id 2637) took 2228 ms. Trace:
W20260709 13:19:51.809958  6695 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.563s	user 0.022s	sys 0.045s
I20260709 13:19:51.807411 10275 raft_consensus.cc:2749] T f03d0dbf16864ca4bc1bb5e4c0334c0f P cd75a17ab2604397adab03bb8b5fd75c [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:19:51.837220  6695 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.595s	user 0.022s	sys 0.046s
W20260709 13:19:51.841225  6695 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:51.841651  6770 leader_election.cc:304] T 3d65025eea89441290d85dd053810e31 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
W20260709 13:19:51.803355  6697 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 468899us
W20260709 13:19:51.843356  6695 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:51.843722  6697 leader_election.cc:304] T e77e330a82df4b43a745d57a68f6f057 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377
I20260709 13:19:51.845541  6807 raft_consensus.cc:1240] T 17587d6730594da4a56fa13a353232a1 P b7ab4784c7344b939bc36f639286f377 [term 13 LEADER]: Rejecting Update request from peer ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 12. Current term is 13. Ops: []
I20260709 13:19:51.846005  6800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab432e62819d499eaaf3dd55481dd930" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:19:51.837049  6880 rpcz_store.cc:276] 0709 13:19:49.607741 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:51.834710 (+2226969us) service_pool.cc:224] Handling call
0709 13:19:51.835053 (+   343us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:19:51.835667 (+   614us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:51.835856 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:51.848582  6798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d65025eea89441290d85dd053810e31" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:19:51.848973 10314 raft_consensus.cc:2804] T 3d65025eea89441290d85dd053810e31 P b7ab4784c7344b939bc36f639286f377 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:19:51.849620 10314 raft_consensus.cc:493] T 3d65025eea89441290d85dd053810e31 P b7ab4784c7344b939bc36f639286f377 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:51.849766 10228 raft_consensus.cc:2804] T e77e330a82df4b43a745d57a68f6f057 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:19:51.850265 10228 raft_consensus.cc:493] T e77e330a82df4b43a745d57a68f6f057 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 11 FOLLOWER]: Starting leader election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:19:51.848914  6803 raft_consensus.cc:1240] T 7c37d41cd9164c15a6826ca62a851a69 P b7ab4784c7344b939bc36f639286f377 [term 8 FOLLOWER]: Rejecting Update request from peer ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 7. Current term is 8. Ops: []
I20260709 13:19:51.851577  6805 raft_consensus.cc:1240] T c4db81d9d329422bb3b4160ca4ac2d1d P b7ab4784c7344b939bc36f639286f377 [term 9 FOLLOWER]: Rejecting Update request from peer ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 8. Current term is 9. Ops: []
I20260709 13:19:51.851924  6880 raft_consensus.cc:1240] T bd6869f07b5a4885a0b99fbe60c3b175 P cd75a17ab2604397adab03bb8b5fd75c [term 10 FOLLOWER]: Rejecting Update request from peer ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 9. Current term is 10. Ops: []
I20260709 13:19:51.852685  6880 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53416 (request call id 2640) took 2244 ms. Trace:
I20260709 13:19:51.853035  6880 rpcz_store.cc:276] 0709 13:19:49.608696 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:51.851390 (+2242694us) service_pool.cc:224] Handling call
0709 13:19:51.851697 (+   307us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:51.852395 (+   698us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:51.852598 (+   203us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:51.854202  6770 leader_election.cc:304] T 4d9def8b32fd443aa94ab1420b06837b P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:19:51.854796  6880 raft_consensus.cc:1240] T 07a92dd554674067a83a9cb68c4773f2 P cd75a17ab2604397adab03bb8b5fd75c [term 9 FOLLOWER]: Rejecting Update request from peer ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 8. Current term is 9. Ops: []
I20260709 13:19:51.855541  6880 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53416 (request call id 2641) took 2246 ms. Trace:
I20260709 13:19:51.855937  6880 rpcz_store.cc:276] 0709 13:19:49.608996 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:51.854301 (+2245305us) service_pool.cc:224] Handling call
0709 13:19:51.854594 (+   293us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:51.855285 (+   691us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:51.855475 (+   190us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:51.856662  6875 raft_consensus.cc:1240] T 713b5728a197487c9300b310ab94e5a3 P cd75a17ab2604397adab03bb8b5fd75c [term 10 FOLLOWER]: Rejecting Update request from peer b7ab4784c7344b939bc36f639286f377 for earlier term 9. Current term is 10. Ops: []
I20260709 13:19:51.859030  6875 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53406 (request call id 1847) took 2339 ms. Trace:
I20260709 13:19:51.859434  6875 rpcz_store.cc:276] 0709 13:19:49.519103 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:51.821028 (+2301925us) service_pool.cc:224] Handling call
0709 13:19:51.856458 (+ 35430us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:51.858714 (+  2256us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:51.858960 (+   246us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:51.847419  6873 raft_consensus.cc:515] T 3fa34c08b205435dba97346991aa1f92 P cd75a17ab2604397adab03bb8b5fd75c [term 11 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:19:51.859493  6697 leader_election.cc:304] T ce4f062dcd314d43a63ca74067cb5ee3 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
W20260709 13:19:51.861873  7466 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 432813us
I20260709 13:19:51.862774  6880 raft_consensus.cc:1240] T 44bde925b2e541b69890d70715b85176 P cd75a17ab2604397adab03bb8b5fd75c [term 10 FOLLOWER]: Rejecting Update request from peer ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 9. Current term is 10. Ops: []
I20260709 13:19:51.829607 10006 raft_consensus.cc:2804] T b3f13b31a1f84f0d89d007eadd57924c P b7ab4784c7344b939bc36f639286f377 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:19:51.889863  6880 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53416 (request call id 2647) took 2105 ms. Trace:
I20260709 13:19:51.892104  6880 rpcz_store.cc:276] 0709 13:19:49.784804 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:51.862299 (+2077495us) service_pool.cc:224] Handling call
0709 13:19:51.862595 (+   296us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:51.889553 (+ 26958us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:51.889792 (+   239us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:51.850181 10314 raft_consensus.cc:3060] T 3d65025eea89441290d85dd053810e31 P b7ab4784c7344b939bc36f639286f377 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:51.887203  6697 leader_election.cc:304] T 24ee15416e3145beaa1b8183453729a3 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:19:51.892464  6801 raft_consensus.cc:1240] T 3a485a995abc4807b6e511e45419f737 P b7ab4784c7344b939bc36f639286f377 [term 8 FOLLOWER]: Rejecting Update request from peer ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 7. Current term is 8. Ops: []
I20260709 13:19:51.834466 10332 raft_consensus.cc:2804] T be1a92657f494cac8dd227d152f50151 P b7ab4784c7344b939bc36f639286f377 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:19:51.887871  6872 raft_consensus.cc:2468] T c4db81d9d329422bb3b4160ca4ac2d1d P cd75a17ab2604397adab03bb8b5fd75c [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 9.
I20260709 13:19:51.900928  6697 leader_election.cc:304] T e31b9971c15848dea59d4d4130141d9e P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:19:51.908597  7495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1528ab62b6fe4e3099d08f141afee116" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb"
I20260709 13:19:51.910180  6876 raft_consensus.cc:1240] T c4db81d9d329422bb3b4160ca4ac2d1d P cd75a17ab2604397adab03bb8b5fd75c [term 9 FOLLOWER]: Rejecting Update request from peer ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 8. Current term is 9. Ops: []
I20260709 13:19:51.910369  7495 raft_consensus.cc:3060] T 1528ab62b6fe4e3099d08f141afee116 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:51.911033  6872 raft_consensus.cc:1240] T b56bf91d90824c959e21e0cee5ba1816 P cd75a17ab2604397adab03bb8b5fd75c [term 9 FOLLOWER]: Rejecting Update request from peer ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 8. Current term is 9. Ops: []
I20260709 13:19:51.912523  6873 leader_election.cc:290] T 3fa34c08b205435dba97346991aa1f92 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 11 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:19:51.912834  6872 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53416 (request call id 2652) took 1761 ms. Trace:
I20260709 13:19:51.913404  6872 rpcz_store.cc:276] 0709 13:19:50.151095 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:51.910226 (+1759131us) service_pool.cc:224] Handling call
0709 13:19:51.910787 (+   561us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:51.912530 (+  1743us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:51.912768 (+   238us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:51.909307  6770 leader_election.cc:304] T dbdf895bba214ff68685a24fd17dfb5d P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
I20260709 13:19:51.835294 10389 raft_consensus.cc:3060] T 4f00a2e87e56452083b759f60d461ee3 P cd75a17ab2604397adab03bb8b5fd75c [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:51.809698 10352 raft_consensus.cc:515] T 404190ce4ce94cecbfcb6ea9d1dd8626 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:19:51.863641 10324 raft_consensus.cc:3060] T 34f36d59d88f40fe8a2805e604fc6c0a P ccd8a4c3bfe3413cb2ae219b09aea832 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:51.863812 10228 raft_consensus.cc:3060] T e77e330a82df4b43a745d57a68f6f057 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:51.891324 10006 raft_consensus.cc:493] T b3f13b31a1f84f0d89d007eadd57924c P b7ab4784c7344b939bc36f639286f377 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 7ba59cc884714e8aa5f3f0ecaed84cbb)
I20260709 13:19:51.909729 10332 raft_consensus.cc:493] T be1a92657f494cac8dd227d152f50151 P b7ab4784c7344b939bc36f639286f377 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 7ba59cc884714e8aa5f3f0ecaed84cbb)
I20260709 13:19:51.888734 10306 raft_consensus.cc:2804] T 4d9def8b32fd443aa94ab1420b06837b P b7ab4784c7344b939bc36f639286f377 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:19:51.919755  7502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce4f062dcd314d43a63ca74067cb5ee3" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb"
I20260709 13:19:51.952102  7502 raft_consensus.cc:2393] T ce4f062dcd314d43a63ca74067cb5ee3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate ccd8a4c3bfe3413cb2ae219b09aea832 in current term 9: Already voted for candidate b7ab4784c7344b939bc36f639286f377 in this term.
I20260709 13:19:51.889149 10322 raft_consensus.cc:2749] T ce4f062dcd314d43a63ca74067cb5ee3 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:19:51.900847 10263 leader_election.cc:290] T 3d65025eea89441290d85dd053810e31 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:51.928016  6873 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RunLeaderElection from 127.0.0.1:53416 (request call id 2633) took 2443 ms. Trace:
W20260709 13:19:51.955219  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 115027us
W20260709 13:19:51.928321  6698 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.686s	user 0.028s	sys 0.056s
I20260709 13:19:51.955542  6873 rpcz_store.cc:276] 0709 13:19:49.469320 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:51.685390 (+2216070us) service_pool.cc:224] Handling call
0709 13:19:51.912965 (+227575us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":25504}
W20260709 13:19:51.956328  6698 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.714s	user 0.028s	sys 0.056s
I20260709 13:19:51.957067  6695 leader_election.cc:304] T 20f6842e26174571996b8dea4151d4be P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
I20260709 13:19:51.949129  7495 raft_consensus.cc:2468] T 1528ab62b6fe4e3099d08f141afee116 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 9.
I20260709 13:19:51.920849 10252 raft_consensus.cc:2749] T e31b9971c15848dea59d4d4130141d9e P ccd8a4c3bfe3413cb2ae219b09aea832 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:19:51.951188  7503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "404190ce4ce94cecbfcb6ea9d1dd8626" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:19:51.917891 10102 leader_election.cc:290] T fe20b4b48823486ca3b9c648db6ce8aa P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 8 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:51.954596  6731 raft_consensus.cc:2393] T 404190ce4ce94cecbfcb6ea9d1dd8626 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7ab4784c7344b939bc36f639286f377 in current term 10: Already voted for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in this term.
I20260709 13:19:51.916102 10367 raft_consensus.cc:2804] T 24ee15416e3145beaa1b8183453729a3 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:19:51.888849 10240 consensus_queue.cc:1048] T 1bf4668eeb70467fb3dc5a0289233b3c P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.040s
W20260709 13:19:51.918256 10032 consensus_meta.cc:287] T b3f13b31a1f84f0d89d007eadd57924c P ccd8a4c3bfe3413cb2ae219b09aea832: Time spent flushing consensus metadata: real 0.506s	user 0.008s	sys 0.003s
W20260709 13:19:51.954314  6846 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:51.954177 10332 raft_consensus.cc:3060] T be1a92657f494cac8dd227d152f50151 P b7ab4784c7344b939bc36f639286f377 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:51.991205  6844 leader_election.cc:304] T 4b8cacb381b746da8d0049b0a83b41dd P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, ccd8a4c3bfe3413cb2ae219b09aea832
W20260709 13:19:51.997295  6846 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:51.991603  7500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24ee15416e3145beaa1b8183453729a3" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:19:52.006417  7500 raft_consensus.cc:2468] T 24ee15416e3145beaa1b8183453729a3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 9.
I20260709 13:19:51.988997 10367 raft_consensus.cc:493] T 24ee15416e3145beaa1b8183453729a3 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:52.012817  6873 raft_consensus.cc:1240] T 7c37d41cd9164c15a6826ca62a851a69 P cd75a17ab2604397adab03bb8b5fd75c [term 8 FOLLOWER]: Rejecting Update request from peer ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 7. Current term is 8. Ops: []
I20260709 13:19:52.013676  6873 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53416 (request call id 2656) took 1415 ms. Trace:
I20260709 13:19:52.014079  6873 rpcz_store.cc:276] 0709 13:19:50.598467 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:52.012067 (+1413600us) service_pool.cc:224] Handling call
0709 13:19:52.012502 (+   435us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:52.013363 (+   861us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:52.013614 (+   251us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:52.015667  6873 raft_consensus.cc:1240] T 3fa34c08b205435dba97346991aa1f92 P cd75a17ab2604397adab03bb8b5fd75c [term 11 FOLLOWER]: Rejecting Update request from peer ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 10. Current term is 11. Ops: []
I20260709 13:19:51.982582  7466 leader_election.cc:304] T bb7fa124c3bf4ef9ab65a407cb008441 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:19:51.946040 10006 raft_consensus.cc:3060] T b3f13b31a1f84f0d89d007eadd57924c P b7ab4784c7344b939bc36f639286f377 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:19:52.025131  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 62501.6us
I20260709 13:19:52.040547  7466 leader_election.cc:304] T 4f00a2e87e56452083b759f60d461ee3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, b7ab4784c7344b939bc36f639286f377; no voters: 
I20260709 13:19:52.037981  6873 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53416 (request call id 2658) took 1434 ms. Trace:
W20260709 13:19:52.010211 10328 consensus_meta.cc:287] T 4d9def8b32fd443aa94ab1420b06837b P ccd8a4c3bfe3413cb2ae219b09aea832: Time spent flushing consensus metadata: real 0.668s	user 0.010s	sys 0.004s
I20260709 13:19:51.966310  7503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3d8792045a4583ae2e965b1350a5b4" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:19:51.955531 10306 raft_consensus.cc:493] T 4d9def8b32fd443aa94ab1420b06837b P b7ab4784c7344b939bc36f639286f377 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:19:51.989670  7468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 469315us
I20260709 13:19:51.960947  7495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe20b4b48823486ca3b9c648db6ce8aa" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:19:52.041778  6873 rpcz_store.cc:276] 0709 13:19:50.603379 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:52.015088 (+1411709us) service_pool.cc:224] Handling call
0709 13:19:52.015455 (+   367us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:52.036876 (+ 21421us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:52.037841 (+   965us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:52.049746  7503 raft_consensus.cc:2393] T bb3d8792045a4583ae2e965b1350a5b4 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ccd8a4c3bfe3413cb2ae219b09aea832 in current term 9: Already voted for candidate cd75a17ab2604397adab03bb8b5fd75c in this term.
I20260709 13:19:52.010742 10366 raft_consensus.cc:493] T de3186201e1a40d0b335eeb8b4e256e0 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:52.057947 10400 log.cc:927] Time spent T 9e326172347f45e99a0d482b5d8ef768 P b7ab4784c7344b939bc36f639286f377: Append to log took a long time: real 0.147s	user 0.001s	sys 0.000s
I20260709 13:19:52.058000  6873 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53416 (request call id 2659) took 1445 ms. Trace:
I20260709 13:19:52.084764  6873 rpcz_store.cc:276] 0709 13:19:50.612513 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:52.056619 (+1444106us) service_pool.cc:224] Handling call
0709 13:19:52.056948 (+   329us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:52.057667 (+   719us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:52.057701 (+    34us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:52.057745 (+    44us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:19:52.057783 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:52.057842 (+    59us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:52.057948 (+   106us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:52.052414  7495 raft_consensus.cc:2393] T fe20b4b48823486ca3b9c648db6ce8aa P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ccd8a4c3bfe3413cb2ae219b09aea832 in current term 8: Already voted for candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in this term.
W20260709 13:19:52.058568 10391 log.cc:927] Time spent T 7887766dc6784fcaa42b35c05fea7a99 P b7ab4784c7344b939bc36f639286f377: Append to log took a long time: real 0.229s	user 0.001s	sys 0.000s
I20260709 13:19:52.062199 10385 raft_consensus.cc:493] T 4b8cacb381b746da8d0049b0a83b41dd P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 9 FOLLOWER]: Starting pre-election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:19:52.053542 10306 raft_consensus.cc:3060] T 4d9def8b32fd443aa94ab1420b06837b P b7ab4784c7344b939bc36f639286f377 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:52.046958 10102 raft_consensus.cc:2804] T 4f00a2e87e56452083b759f60d461ee3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:19:52.053153  6805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce4f062dcd314d43a63ca74067cb5ee3" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:19:52.063835 10166 raft_consensus.cc:493] T 9e326172347f45e99a0d482b5d8ef768 P b7ab4784c7344b939bc36f639286f377 [term 8 FOLLOWER]: Starting leader election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
W20260709 13:19:52.064642  6846 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:52.058573 10323 raft_consensus.cc:493] T b56bf91d90824c959e21e0cee5ba1816 P b7ab4784c7344b939bc36f639286f377 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:19:52.017802 10367 raft_consensus.cc:3060] T 24ee15416e3145beaa1b8183453729a3 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:52.069906  6629 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:51654 (request call id 81) took 9717 ms. Trace:
W20260709 13:19:52.071746  6731 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50004 (request call id 1773) took 1701 ms (client timeout 1931 ms). Trace:
W20260709 13:19:52.048604 10398 log.cc:927] Time spent T 8c7f33e544204fbaac4078e3e83bbf4e P cd75a17ab2604397adab03bb8b5fd75c: Append to log took a long time: real 0.155s	user 0.000s	sys 0.001s
I20260709 13:19:52.087419  6723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce4f062dcd314d43a63ca74067cb5ee3" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:19:52.089578  6724 raft_consensus.cc:1240] T 404190ce4ce94cecbfcb6ea9d1dd8626 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 10 FOLLOWER]: Rejecting Update request from peer 7ba59cc884714e8aa5f3f0ecaed84cbb for earlier term 9. Current term is 10. Ops: []
I20260709 13:19:52.005576 10404 consensus_queue.cc:1059] T 2c240553ce044eedb41541d72b9475d7 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 3, Time since last communication: 0.053s
I20260709 13:19:51.993961 10405 consensus_queue.cc:1048] T a1704639a875409b9959353527b3fd68 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.065s
I20260709 13:19:52.091327  6732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fa34c08b205435dba97346991aa1f92" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:19:52.091776  6873 raft_consensus.cc:1275] T f58dc08b12a2494bb9a1372837970ca2 P cd75a17ab2604397adab03bb8b5fd75c [term 12 FOLLOWER]: Refusing update from remote peer b7ab4784c7344b939bc36f639286f377: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 12 index: 6. (index mismatch)
W20260709 13:19:52.092985 10403 log.cc:927] Time spent T f5be3a11b23d4ea9b08300a2789821c7 P cd75a17ab2604397adab03bb8b5fd75c: Append to log took a long time: real 0.105s	user 0.000s	sys 0.000s
I20260709 13:19:52.017484 10402 consensus_queue.cc:1048] T 9e326172347f45e99a0d482b5d8ef768 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.083s
I20260709 13:19:52.092993  6844 leader_election.cc:304] T 90d42e216d9741e190bca19a781291fd P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:19:52.040215 10406 raft_consensus.cc:3060] T bb7fa124c3bf4ef9ab65a407cb008441 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:52.094641  6730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe20b4b48823486ca3b9c648db6ce8aa" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:19:52.133361 10166 raft_consensus.cc:3060] T 9e326172347f45e99a0d482b5d8ef768 P b7ab4784c7344b939bc36f639286f377 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:19:52.095633  6847 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:52.100468  7495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fa34c08b205435dba97346991aa1f92" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: true dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb"
I20260709 13:19:52.179845  7495 raft_consensus.cc:3060] T 3fa34c08b205435dba97346991aa1f92 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:52.087175 10366 raft_consensus.cc:515] T de3186201e1a40d0b335eeb8b4e256e0 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:52.105273  9890 raft_consensus.cc:3055] T 7c37d41cd9164c15a6826ca62a851a69 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:19:52.118877  6805 raft_consensus.cc:2468] T ce4f062dcd314d43a63ca74067cb5ee3 P b7ab4784c7344b939bc36f639286f377 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in term 9.
W20260709 13:19:52.124641  6698 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:51.668581  6806 rpcz_store.cc:276] 0709 13:19:50.308533 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:50.320488 (+ 11955us) service_pool.cc:224] Handling call
0709 13:19:50.320847 (+   359us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:50.321144 (+   297us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:19:51.172235 (+851091us) log.cc:844] Serialized 14 byte log entry
0709 13:19:51.667006 (+494771us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:51.667109 (+   103us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:19:51.667182 (+    73us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:51.667488 (+   306us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:51.667744 (+   256us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":55606,"prepare.queue_time_us":188051,"prepare.run_cpu_time_us":46,"prepare.run_wall_time_us":48,"raft.queue_time_us":55765,"thread_start_us":1255669,"threads_started":2}
I20260709 13:19:52.072768 10401 raft_consensus.cc:2804] T 20f6842e26174571996b8dea4151d4be P ccd8a4c3bfe3413cb2ae219b09aea832 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:19:52.003937 10032 raft_consensus.cc:515] T b3f13b31a1f84f0d89d007eadd57924c P ccd8a4c3bfe3413cb2ae219b09aea832 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:19:52.090610 10409 raft_consensus.cc:2804] T dbdf895bba214ff68685a24fd17dfb5d P b7ab4784c7344b939bc36f639286f377 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:19:52.050370 10328 raft_consensus.cc:515] T 4d9def8b32fd443aa94ab1420b06837b P ccd8a4c3bfe3413cb2ae219b09aea832 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:52.117617 10102 raft_consensus.cc:493] T 4f00a2e87e56452083b759f60d461ee3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:19:52.137428  6731 rpcz_store.cc:269] 0709 13:19:50.370396 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:50.573369 (+202973us) service_pool.cc:224] Handling call
0709 13:19:52.071514 (+1498145us) spinlock_profiling.cc:243] Waited 1.38 s on lock 0x7b5400394ed4. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f9ae2fa 00007fcc1496fb17 00007fcc0deea6d4 00007fcc0deea662 00007fcc0deea591 00007fcc0deea50c 00007fcc0dee97c2 00007fcc0dce548c 00007fcc0dce48c6 00007fcc0dce426f
0709 13:19:52.071661 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3171985280}
I20260709 13:19:52.147589  6873 raft_consensus.cc:1240] T bb7fa124c3bf4ef9ab65a407cb008441 P cd75a17ab2604397adab03bb8b5fd75c [term 9 FOLLOWER]: Rejecting Update request from peer b7ab4784c7344b939bc36f639286f377 for earlier term 8. Current term is 9. Ops: []
I20260709 13:19:52.171182  6730 raft_consensus.cc:3060] T fe20b4b48823486ca3b9c648db6ce8aa P ccd8a4c3bfe3413cb2ae219b09aea832 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:19:52.094889 10160 consensus_meta.cc:287] T 3411566abe2d4c9bb4b2adfdd05e6f17 P b7ab4784c7344b939bc36f639286f377: Time spent flushing consensus metadata: real 0.722s	user 0.008s	sys 0.004s
W20260709 13:19:52.135804  6697 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 213798us
I20260709 13:19:52.145313  6723 raft_consensus.cc:2468] T ce4f062dcd314d43a63ca74067cb5ee3 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in term 9.
W20260709 13:19:52.204332  6845 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:52.235006  6845 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:52.117406 10385 raft_consensus.cc:515] T 4b8cacb381b746da8d0049b0a83b41dd P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:19:52.215430  6873 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53406 (request call id 1864) took 1060 ms. Trace:
I20260709 13:19:52.219087  7503 raft_consensus.cc:1240] T 1528ab62b6fe4e3099d08f141afee116 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 9 FOLLOWER]: Rejecting Update request from peer b7ab4784c7344b939bc36f639286f377 for earlier term 8. Current term is 9. Ops: []
I20260709 13:19:52.237308  6873 rpcz_store.cc:276] 0709 13:19:51.155387 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:52.147104 (+991717us) service_pool.cc:224] Handling call
0709 13:19:52.147402 (+   298us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:52.215125 (+ 67723us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:52.215365 (+   240us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:52.220290  7495 raft_consensus.cc:2468] T 3fa34c08b205435dba97346991aa1f92 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 11.
I20260709 13:19:52.235891  7466 leader_election.cc:304] T ce4f062dcd314d43a63ca74067cb5ee3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
I20260709 13:19:52.238421  6873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a485a995abc4807b6e511e45419f737" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:19:52.243358  6846 leader_election.cc:304] T 3fa34c08b205435dba97346991aa1f92 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:19:52.137205  6629 rpcz_store.cc:276] 0709 13:19:42.352677 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:42.352898 (+   221us) service_pool.cc:224] Handling call
0709 13:19:52.069808 (+9716910us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:19:45.102851 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:19:45.180618 (+ 77767us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:19:45.180672 (+    54us) write_op.cc:435] Acquired schema lock
0709 13:19:45.180692 (+    20us) tablet.cc:662] Decoding operations
0709 13:19:45.181596 (+   904us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:19:45.181693 (+    97us) write_op.cc:641] Partition lock acquired for write op
0709 13:19:45.181731 (+    38us) tablet.cc:685] Acquiring locks for 6 operations
0709 13:19:45.182407 (+   676us) tablet.cc:701] Row locks acquired
0709 13:19:45.182463 (+    56us) write_op.cc:260] PREPARE: finished
0709 13:19:45.182661 (+   198us) write_op.cc:270] Start()
0709 13:19:45.182858 (+   197us) write_op.cc:276] Timestamp: P: 1783603185182582 usec, L: 0
0709 13:19:45.182884 (+    26us) op_driver.cc:348] REPLICATION: starting
0709 13:19:45.213854 (+ 30970us) log.cc:844] Serialized 2433 byte log entry
0709 13:19:46.796199 (+1582345us) op_driver.cc:464] REPLICATION: finished
0709 13:19:47.446991 (+650792us) spinlock_profiling.cc:243] Waited 40.5 ms on lock 0x7b4400022b4c. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0c745db1 00007fcc0c7e3c85 00007fcc0c7e46a2 00007fcc0f5561db 00007fcc0f551aaf 00007fcc0c8a00ac 00007fcc156faab9 00007fcc0c8bc69b 00007fcc0c8ba93f 00007fcc0c8bcc02 00007fcc133e0ef0
0709 13:19:47.834582 (+387591us) write_op.cc:301] APPLY: starting
0709 13:19:47.863772 (+ 29190us) tablet.cc:1367] starting BulkCheckPresence
0709 13:19:48.056828 (+193056us) tablet.cc:1370] finished BulkCheckPresence
0709 13:19:48.081696 (+ 24868us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:19:48.753562 (+671866us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:19:48.921857 (+168295us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=6
0709 13:19:48.937201 (+ 15344us) write_op.cc:312] APPLY: finished
0709 13:19:49.059527 (+122326us) log.cc:844] Serialized 52 byte log entry
0709 13:19:49.222241 (+162714us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:19:49.222365 (+   124us) write_op.cc:454] Released schema lock
0709 13:19:49.222436 (+    71us) write_op.cc:341] FINISH: Updating metrics
0709 13:19:49.222869 (+   433us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:19:49.222895 (+    26us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":284990,"reported_tablets":12,"child_traces":[["op",{"apply.queue_time_us":1038052,"apply.run_cpu_time_us":25428,"apply.run_wall_time_us":1388282,"num_ops":6,"prepare.queue_time_us":361212,"prepare.run_cpu_time_us":25885,"prepare.run_wall_time_us":807439,"raft.queue_time_us":392772,"raft.run_cpu_time_us":54580,"raft.run_wall_time_us":1104184,"replication_time_us":1482000,"spinlock_wait_cycles":93115648,"thread_start_us":1954238,"threads_started":5,"wal-append.queue_time_us":1079773,"wal-append.run_cpu_time_us":55982,"wal-append.run_wall_time_us":2818721}]]}
I20260709 13:19:52.247475  6873 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53406 (request call id 1865) took 1048 ms. Trace:
I20260709 13:19:52.247956  6873 rpcz_store.cc:276] 0709 13:19:51.198960 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:52.239522 (+1040562us) service_pool.cc:224] Handling call
0709 13:19:52.239840 (+   318us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:52.247071 (+  7231us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:52.247108 (+    37us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:52.247170 (+    62us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:19:52.247226 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:52.247288 (+    62us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:52.247411 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:52.251916  6873 raft_consensus.cc:1275] T a1704639a875409b9959353527b3fd68 P cd75a17ab2604397adab03bb8b5fd75c [term 10 FOLLOWER]: Refusing update from remote peer b7ab4784c7344b939bc36f639286f377: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:19:52.253623  6873 raft_consensus.cc:1275] T d8292e16e5654be6bc408560cf256aaa P cd75a17ab2604397adab03bb8b5fd75c [term 12 FOLLOWER]: Refusing update from remote peer b7ab4784c7344b939bc36f639286f377: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:19:52.197095  9890 raft_consensus.cc:740] T 7c37d41cd9164c15a6826ca62a851a69 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
I20260709 13:19:52.210260 10401 raft_consensus.cc:493] T 20f6842e26174571996b8dea4151d4be P ccd8a4c3bfe3413cb2ae219b09aea832 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:52.139305 10314 raft_consensus.cc:515] T 3d65025eea89441290d85dd053810e31 P b7ab4784c7344b939bc36f639286f377 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:52.257053  6873 raft_consensus.cc:1275] T 4275cf08e63345f993bce8664eada830 P cd75a17ab2604397adab03bb8b5fd75c [term 10 FOLLOWER]: Refusing update from remote peer b7ab4784c7344b939bc36f639286f377: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 10 index: 5. (index mismatch)
W20260709 13:19:52.354225  6697 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 119971us
I20260709 13:19:52.355718  6873 raft_consensus.cc:1275] T 7887766dc6784fcaa42b35c05fea7a99 P cd75a17ab2604397adab03bb8b5fd75c [term 10 FOLLOWER]: Refusing update from remote peer b7ab4784c7344b939bc36f639286f377: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:19:52.213006 10409 raft_consensus.cc:493] T dbdf895bba214ff68685a24fd17dfb5d P b7ab4784c7344b939bc36f639286f377 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:52.257452  6876 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53416 (request call id 2632) took 2788 ms. Trace:
W20260709 13:19:52.290437  6847 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:52.311169  7468 leader_election.cc:336] T 24ee15416e3145beaa1b8183453729a3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931): Timed out: RequestConsensusVote RPC to 127.5.126.67:42931 timed out after 2.597s (SENT)
I20260709 13:19:52.201460 10404 raft_consensus.cc:493] T 95a75bfe094d4bdc963aba3f08dfcd25 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:19:52.352444  7495 raft_consensus.cc:1275] T 17587d6730594da4a56fa13a353232a1 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 13 FOLLOWER]: Refusing update from remote peer b7ab4784c7344b939bc36f639286f377: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:19:52.233266 10102 raft_consensus.cc:3060] T 4f00a2e87e56452083b759f60d461ee3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:52.356567  7503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f00a2e87e56452083b759f60d461ee3" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb"
I20260709 13:19:52.370321  6876 rpcz_store.cc:276] 0709 13:19:49.468979 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:51.673123 (+2204144us) service_pool.cc:224] Handling call
0709 13:19:51.909984 (+236861us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:51.916291 (+  6307us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:52.257206 (+340915us) spinlock_profiling.cc:243] Waited 236 ms on lock 0x7b54001e8cd0. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f9a98ad 00007fcc1496e419 00007fcc0dee5bd4 00007fcc0dee5b62 00007fcc0dee5a91 00007fcc0dee5a0c 00007fcc0dee4cc2 00007fcc0dce548c 00007fcc0dce48c6 00007fcc0dce426f
0709 13:19:52.257373 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":543917824}
I20260709 13:19:52.370661  7468 leader_election.cc:304] T 24ee15416e3145beaa1b8183453729a3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:19:52.144758 10323 raft_consensus.cc:515] T b56bf91d90824c959e21e0cee5ba1816 P b7ab4784c7344b939bc36f639286f377 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:52.372270  6873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f00a2e87e56452083b759f60d461ee3" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:19:52.201596 10375 consensus_queue.cc:1059] T 404190ce4ce94cecbfcb6ea9d1dd8626 P 7ba59cc884714e8aa5f3f0ecaed84cbb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.061s
W20260709 13:19:52.374238  6770 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 465014us
I20260709 13:19:52.377120  6772 leader_election.cc:304] T 853ac0a8cbd64ce99457f170216d4d0f P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:19:52.379040  7495 raft_consensus.cc:1275] T d8cee0accdb8499c86d4414b72565a38 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 9 FOLLOWER]: Refusing update from remote peer b7ab4784c7344b939bc36f639286f377: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
W20260709 13:19:52.383069  6695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 426080us
I20260709 13:19:52.381063  6879 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53406 (request call id 1829) took 4372 ms. Trace:
W20260709 13:19:52.389940  6847 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:52.386679  6879 rpcz_store.cc:276] 0709 13:19:48.008900 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:50.603569 (+2594669us) service_pool.cc:224] Handling call
0709 13:19:50.603870 (+   301us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:51.002661 (+398791us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:51.002724 (+    63us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:51.147770 (+145046us) log.cc:844] Serialized 26 byte log entry
0709 13:19:51.714619 (+566849us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:19:51.926729 (+212110us) log.cc:844] Serialized 14 byte log entry
0709 13:19:51.927615 (+   886us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:51.927694 (+    79us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:52.380740 (+453046us) raft_consensus.cc:1685] finished
0709 13:19:52.380772 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:52.380969 (+   197us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":39310,"prepare.queue_time_us":360295,"prepare.run_cpu_time_us":41,"prepare.run_wall_time_us":42,"raft.queue_time_us":65096,"raft.run_cpu_time_us":238,"raft.run_wall_time_us":13141,"thread_start_us":1029912,"threads_started":3,"wal-append.queue_time_us":705844}
I20260709 13:19:52.347059  9836 raft_consensus.cc:493] T f09c2a98de1a4decabd0ff900dd44caa P b7ab4784c7344b939bc36f639286f377 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:52.402052  6770 leader_election.cc:304] T 404190ce4ce94cecbfcb6ea9d1dd8626 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:19:52.405166  6772 leader_election.cc:304] T 7c37d41cd9164c15a6826ca62a851a69 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:19:52.408106  6798 raft_consensus.cc:2393] T 3d65025eea89441290d85dd053810e31 P b7ab4784c7344b939bc36f639286f377 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ccd8a4c3bfe3413cb2ae219b09aea832 in current term 9: Already voted for candidate b7ab4784c7344b939bc36f639286f377 in this term.
I20260709 13:19:52.413728  6723 raft_consensus.cc:1275] T 4275cf08e63345f993bce8664eada830 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 10 FOLLOWER]: Refusing update from remote peer b7ab4784c7344b939bc36f639286f377: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 10 index: 5. (index mismatch)
I20260709 13:19:52.244866 10160 raft_consensus.cc:515] T 3411566abe2d4c9bb4b2adfdd05e6f17 P b7ab4784c7344b939bc36f639286f377 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:52.368799 10401 raft_consensus.cc:3060] T 20f6842e26174571996b8dea4151d4be P ccd8a4c3bfe3413cb2ae219b09aea832 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:52.380869 10240 raft_consensus.cc:493] T 2c240553ce044eedb41541d72b9475d7 P b7ab4784c7344b939bc36f639286f377 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:19:52.375926 10409 raft_consensus.cc:3060] T dbdf895bba214ff68685a24fd17dfb5d P b7ab4784c7344b939bc36f639286f377 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:52.382138 10352 leader_election.cc:290] T 404190ce4ce94cecbfcb6ea9d1dd8626 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 10 election: Requested vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:19:52.422667  6729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90d42e216d9741e190bca19a781291fd" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:19:52.430403  6729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f9c2e2bf644115957398fe4c9459db" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
W20260709 13:19:52.424185  6773 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:52.431646  6728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6869f07b5a4885a0b99fbe60c3b175" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:19:52.417814  6723 raft_consensus.cc:1275] T d8292e16e5654be6bc408560cf256aaa P ccd8a4c3bfe3413cb2ae219b09aea832 [term 12 FOLLOWER]: Refusing update from remote peer b7ab4784c7344b939bc36f639286f377: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:19:52.419471  6731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c7f33e544204fbaac4078e3e83bbf4e" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
W20260709 13:19:52.440995  7466 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 205210us
I20260709 13:19:52.411244 10405 raft_consensus.cc:2804] T 853ac0a8cbd64ce99457f170216d4d0f P b7ab4784c7344b939bc36f639286f377 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:19:52.442178  6772 leader_election.cc:304] T 44bde925b2e541b69890d70715b85176 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:19:52.444986  6723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30e88460611e47b2ba16a46a30b5f416" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 10 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:19:52.445678  6724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20f6842e26174571996b8dea4151d4be" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 10 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:19:52.446147  6731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b3759de40694069b13c0f8bd40e5709" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:19:52.448001  6727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34f36d59d88f40fe8a2805e604fc6c0a" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:19:52.448590  6723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4db81d9d329422bb3b4160ca4ac2d1d" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:19:52.418630 10410 raft_consensus.cc:3060] T 404190ce4ce94cecbfcb6ea9d1dd8626 P b7ab4784c7344b939bc36f639286f377 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:52.448500  6731 raft_consensus.cc:2410] T 9b3759de40694069b13c0f8bd40e5709 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7ab4784c7344b939bc36f639286f377 for term 10 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 13:19:52.450765  6729 raft_consensus.cc:3055] T 17587d6730594da4a56fa13a353232a1 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:19:52.451237  6729 raft_consensus.cc:740] T 17587d6730594da4a56fa13a353232a1 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
I20260709 13:19:52.452112  6729 consensus_queue.cc:260] T 17587d6730594da4a56fa13a353232a1 P ccd8a4c3bfe3413cb2ae219b09aea832 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:19:52.453351  6729 raft_consensus.cc:3060] T 17587d6730594da4a56fa13a353232a1 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:19:52.421319 10355 consensus_meta.cc:287] T dbdf895bba214ff68685a24fd17dfb5d P ccd8a4c3bfe3413cb2ae219b09aea832: Time spent flushing consensus metadata: real 0.992s	user 0.013s	sys 0.000s
I20260709 13:19:52.380347 10404 raft_consensus.cc:515] T 95a75bfe094d4bdc963aba3f08dfcd25 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
W20260709 13:19:52.432118  7468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 121030us
I20260709 13:19:52.380992 10421 consensus_queue.cc:1059] T bd6869f07b5a4885a0b99fbe60c3b175 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: INVALID_TERM, Last received: 9.4, Next index: 5, Last known committed idx: 2, Time since last communication: 0.066s
I20260709 13:19:52.423908 10268 raft_consensus.cc:2804] T 7c37d41cd9164c15a6826ca62a851a69 P b7ab4784c7344b939bc36f639286f377 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:19:52.479987  6877 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53406 (request call id 1846) took 2961 ms. Trace:
I20260709 13:19:52.481133 10352 consensus_queue.cc:1059] T 3fa34c08b205435dba97346991aa1f92 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.002s
I20260709 13:19:52.414453  9836 raft_consensus.cc:515] T f09c2a98de1a4decabd0ff900dd44caa P b7ab4784c7344b939bc36f639286f377 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:52.458050 10405 raft_consensus.cc:493] T 853ac0a8cbd64ce99457f170216d4d0f P b7ab4784c7344b939bc36f639286f377 [term 6 FOLLOWER]: Starting leader election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:19:52.482040  6877 rpcz_store.cc:276] 0709 13:19:49.518800 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:51.820087 (+2301287us) service_pool.cc:224] Handling call
0709 13:19:51.888656 (+ 68569us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:51.888896 (+   240us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:19:52.120120 (+231224us) log.cc:844] Serialized 14 byte log entry
0709 13:19:52.458553 (+338433us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:52.479177 (+ 20624us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:19:52.479280 (+   103us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:52.479388 (+   108us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:52.479908 (+   520us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":56457,"prepare.queue_time_us":202642,"prepare.run_cpu_time_us":66,"prepare.run_wall_time_us":14285,"thread_start_us":568652,"threads_started":3,"wal-append.queue_time_us":307096}
I20260709 13:19:52.480156  6872 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53406 (request call id 1861) took 2229 ms. Trace:
I20260709 13:19:52.508823  6872 rpcz_store.cc:276] 0709 13:19:50.247172 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:51.915336 (+1668164us) service_pool.cc:224] Handling call
0709 13:19:51.915689 (+   353us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:51.915985 (+   296us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:19:52.159574 (+243589us) log.cc:844] Serialized 14 byte log entry
0709 13:19:52.476097 (+316523us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:52.476170 (+    73us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:19:52.476264 (+    94us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:52.476350 (+    86us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:52.476520 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":152000,"prepare.queue_time_us":253473,"prepare.run_cpu_time_us":51,"prepare.run_wall_time_us":54,"thread_start_us":525093,"threads_started":3,"wal-append.queue_time_us":330298}
W20260709 13:19:52.526768  6697 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 125789us
W20260709 13:19:52.538753  6772 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 96650.5us
W20260709 13:19:52.544910  7466 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:52.417642 10418 consensus_queue.cc:1048] T f58dc08b12a2494bb9a1372837970ca2 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.072s
I20260709 13:19:52.417858 10423 consensus_queue.cc:1059] T b56bf91d90824c959e21e0cee5ba1816 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.080s
I20260709 13:19:52.547916  6729 raft_consensus.cc:1275] T 17587d6730594da4a56fa13a353232a1 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 13 FOLLOWER]: Refusing update from remote peer b7ab4784c7344b939bc36f639286f377: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:19:52.481909 10301 raft_consensus.cc:2804] T 44bde925b2e541b69890d70715b85176 P b7ab4784c7344b939bc36f639286f377 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:19:52.441558 10240 raft_consensus.cc:515] T 2c240553ce044eedb41541d72b9475d7 P b7ab4784c7344b939bc36f639286f377 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:52.555280  6729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a485a995abc4807b6e511e45419f737" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:19:52.557250  6729 raft_consensus.cc:1275] T 7887766dc6784fcaa42b35c05fea7a99 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 10 FOLLOWER]: Refusing update from remote peer b7ab4784c7344b939bc36f639286f377: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:19:52.558372  6729 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7c37d41cd9164c15a6826ca62a851a69"
dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
mode: GRACEFUL
new_leader_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
 from {username='slave'} at 127.0.0.1:38536
I20260709 13:19:52.560927  7495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3f13b31a1f84f0d89d007eadd57924c" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
W20260709 13:19:52.561829  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 468923us
I20260709 13:19:52.563323  7495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be1a92657f494cac8dd227d152f50151" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:19:52.545936 10405 raft_consensus.cc:3060] T 853ac0a8cbd64ce99457f170216d4d0f P b7ab4784c7344b939bc36f639286f377 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:52.477578 10355 raft_consensus.cc:515] T dbdf895bba214ff68685a24fd17dfb5d P ccd8a4c3bfe3413cb2ae219b09aea832 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
W20260709 13:19:52.554665 10389 consensus_meta.cc:287] T 4f00a2e87e56452083b759f60d461ee3 P cd75a17ab2604397adab03bb8b5fd75c: Time spent flushing consensus metadata: real 0.620s	user 0.007s	sys 0.003s
I20260709 13:19:52.595338  7495 raft_consensus.cc:1240] T 17587d6730594da4a56fa13a353232a1 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 13 FOLLOWER]: Rejecting Update request from peer ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 12. Current term is 13. Ops: []
I20260709 13:19:52.495311 10268 raft_consensus.cc:697] T 7c37d41cd9164c15a6826ca62a851a69 P b7ab4784c7344b939bc36f639286f377 [term 8 LEADER]: Becoming Leader. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
W20260709 13:19:52.567514 10425 log.cc:927] Time spent T 4b8cacb381b746da8d0049b0a83b41dd P cd75a17ab2604397adab03bb8b5fd75c: Append to log took a long time: real 0.180s	user 0.000s	sys 0.001s
I20260709 13:19:52.611263  7498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "404190ce4ce94cecbfcb6ea9d1dd8626" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb"
I20260709 13:19:52.483922 10426 consensus_queue.cc:1048] T 1bf4668eeb70467fb3dc5a0289233b3c P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.126s
I20260709 13:19:52.446624  9890 consensus_queue.cc:260] T 7c37d41cd9164c15a6826ca62a851a69 P ccd8a4c3bfe3413cb2ae219b09aea832 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
W20260709 13:19:52.628865  6698 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:52.635365  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 52096us
W20260709 13:19:52.638392 10427 log.cc:927] Time spent T 90d42e216d9741e190bca19a781291fd P cd75a17ab2604397adab03bb8b5fd75c: Append to log took a long time: real 0.090s	user 0.001s	sys 0.000s
I20260709 13:19:52.566893 10431 consensus_queue.cc:1059] T bd6869f07b5a4885a0b99fbe60c3b175 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: INVALID_TERM, Last received: 9.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.078s
W20260709 13:19:52.639053 10432 log.cc:927] Time spent T de3186201e1a40d0b335eeb8b4e256e0 P b7ab4784c7344b939bc36f639286f377: Append to log took a long time: real 0.182s	user 0.001s	sys 0.000s
W20260709 13:19:52.640050 10434 log.cc:927] Time spent T 711ef6523deb4cbe8ef2ba61e1c21c98 P cd75a17ab2604397adab03bb8b5fd75c: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
W20260709 13:19:52.641079 10433 log.cc:927] Time spent T ab432e62819d499eaaf3dd55481dd930 P cd75a17ab2604397adab03bb8b5fd75c: Append to log took a long time: real 0.154s	user 0.000s	sys 0.001s
I20260709 13:19:52.641963 10160 leader_election.cc:290] T 3411566abe2d4c9bb4b2adfdd05e6f17 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 8 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
W20260709 13:19:52.643054 10248 consensus_meta.cc:287] T 07a92dd554674067a83a9cb68c4773f2 P ccd8a4c3bfe3413cb2ae219b09aea832: Time spent flushing consensus metadata: real 0.836s	user 0.010s	sys 0.000s
I20260709 13:19:52.644717 10263 raft_consensus.cc:3055] T b56bf91d90824c959e21e0cee5ba1816 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:19:52.645126 10263 raft_consensus.cc:740] T b56bf91d90824c959e21e0cee5ba1816 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
I20260709 13:19:52.645865 10263 consensus_queue.cc:260] T b56bf91d90824c959e21e0cee5ba1816 P ccd8a4c3bfe3413cb2ae219b09aea832 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:52.647025 10314 leader_election.cc:290] T 3d65025eea89441290d85dd053810e31 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 9 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:52.583896 10437 raft_consensus.cc:2804] T ce4f062dcd314d43a63ca74067cb5ee3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:19:52.633277 10366 leader_election.cc:290] T de3186201e1a40d0b335eeb8b4e256e0 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:52.626037 10439 raft_consensus.cc:493] T 4275cf08e63345f993bce8664eada830 P cd75a17ab2604397adab03bb8b5fd75c [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:52.637208 10332 consensus_meta.cc:287] T be1a92657f494cac8dd227d152f50151 P b7ab4784c7344b939bc36f639286f377: Time spent flushing consensus metadata: real 0.627s	user 0.011s	sys 0.001s
I20260709 13:19:52.602451 10445 raft_consensus.cc:2749] T 24ee15416e3145beaa1b8183453729a3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:19:52.649986 10306 consensus_meta.cc:287] T 4d9def8b32fd443aa94ab1420b06837b P b7ab4784c7344b939bc36f639286f377: Time spent flushing consensus metadata: real 0.512s	user 0.011s	sys 0.000s
I20260709 13:19:52.674935  6726 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49998 (request call id 903) took 1980 ms. Trace:
I20260709 13:19:52.685074  6726 rpcz_store.cc:276] 0709 13:19:50.694582 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:50.695500 (+   918us) service_pool.cc:224] Handling call
0709 13:19:50.709434 (+ 13934us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:51.265195 (+555761us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:52.674650 (+1409455us) spinlock_profiling.cc:243] Waited 531 ms on lock 0x7b540020bcd4. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f9aae01 00007fcc0f9a983e 00007fcc1496e419 00007fcc0dee5bd4 00007fcc0dee5b62 00007fcc0dee5a91 00007fcc0dee5a0c 00007fcc0dee4cc2 00007fcc0dce548c 00007fcc0dce48c6
0709 13:19:52.674865 (+   215us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1220900608}
I20260709 13:19:52.664359  9890 raft_consensus.cc:3060] T 7c37d41cd9164c15a6826ca62a851a69 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:19:52.660454 10415 log.cc:927] Time spent T 7c44c4849aa54f2b94d1f1bef9ed546f P ccd8a4c3bfe3413cb2ae219b09aea832: Append to log took a long time: real 0.308s	user 0.001s	sys 0.001s
I20260709 13:19:52.671612 10263 raft_consensus.cc:3060] T b56bf91d90824c959e21e0cee5ba1816 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:19:52.666307 10430 log.cc:927] Time spent T f3f9c2e2bf644115957398fe4c9459db P cd75a17ab2604397adab03bb8b5fd75c: Append to log took a long time: real 0.105s	user 0.001s	sys 0.000s
I20260709 13:19:52.663115 10390 raft_consensus.cc:2804] T 3fa34c08b205435dba97346991aa1f92 P cd75a17ab2604397adab03bb8b5fd75c [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:19:52.661037 10437 raft_consensus.cc:493] T ce4f062dcd314d43a63ca74067cb5ee3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:19:52.686354  6846 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.68:45071, user_credentials={real_user=slave}} blocked reactor thread for 443059us
I20260709 13:19:52.674800  6730 raft_consensus.cc:2468] T fe20b4b48823486ca3b9c648db6ce8aa P ccd8a4c3bfe3413cb2ae219b09aea832 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in term 8.
I20260709 13:19:52.664736 10032 leader_election.cc:290] T b3f13b31a1f84f0d89d007eadd57924c P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 8 election: Requested vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:19:52.628640 10375 raft_consensus.cc:3055] T 404190ce4ce94cecbfcb6ea9d1dd8626 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:19:52.601125 10389 raft_consensus.cc:515] T 4f00a2e87e56452083b759f60d461ee3 P cd75a17ab2604397adab03bb8b5fd75c [term 10 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
W20260709 13:19:52.700966  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 56945.7us
W20260709 13:19:52.738273  6695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 338502us
I20260709 13:19:52.739907  6725 raft_consensus.cc:2468] T 07a92dd554674067a83a9cb68c4773f2 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 9.
W20260709 13:19:52.689111 10342 consensus_meta.cc:287] T 44bde925b2e541b69890d70715b85176 P ccd8a4c3bfe3413cb2ae219b09aea832: Time spent flushing consensus metadata: real 1.075s	user 0.013s	sys 0.002s
W20260709 13:19:52.722892  6846 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:52.747383  6846 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:52.747839  6846 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:52.739809  6726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b8cacb381b746da8d0049b0a83b41dd" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:19:52.724822  6730 raft_consensus.cc:1240] T 713b5728a197487c9300b310ab94e5a3 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 10 LEADER]: Rejecting Update request from peer b7ab4784c7344b939bc36f639286f377 for earlier term 9. Current term is 10. Ops: []
I20260709 13:19:52.724836  7466 leader_election.cc:304] T fe20b4b48823486ca3b9c648db6ce8aa P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
I20260709 13:19:52.692353 10385 leader_election.cc:290] T 4b8cacb381b746da8d0049b0a83b41dd P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
W20260709 13:19:52.710114  6697 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.68:45071, user_credentials={real_user=slave}} blocked reactor thread for 144828us
I20260709 13:19:52.755106  6879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bf4668eeb70467fb3dc5a0289233b3c" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:19:52.757256  6879 raft_consensus.cc:2468] T 1bf4668eeb70467fb3dc5a0289233b3c P cd75a17ab2604397adab03bb8b5fd75c [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 9.
I20260709 13:19:52.755643  6844 leader_election.cc:304] T e77e330a82df4b43a745d57a68f6f057 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:19:52.732429 10375 raft_consensus.cc:740] T 404190ce4ce94cecbfcb6ea9d1dd8626 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 7ba59cc884714e8aa5f3f0ecaed84cbb, State: Running, Role: LEADER
I20260709 13:19:52.760313  6877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1704639a875409b9959353527b3fd68" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 10 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
W20260709 13:19:52.760607  6697 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:52.680199 10332 raft_consensus.cc:515] T be1a92657f494cac8dd227d152f50151 P b7ab4784c7344b939bc36f639286f377 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:19:52.717571 10301 raft_consensus.cc:697] T 44bde925b2e541b69890d70715b85176 P b7ab4784c7344b939bc36f639286f377 [term 10 LEADER]: Becoming Leader. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
I20260709 13:19:52.699606 10418 consensus_queue.cc:1048] T 4275cf08e63345f993bce8664eada830 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.050s
I20260709 13:19:52.794922 10375 consensus_queue.cc:260] T 404190ce4ce94cecbfcb6ea9d1dd8626 P 7ba59cc884714e8aa5f3f0ecaed84cbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
W20260709 13:19:52.796988 10424 log.cc:927] Time spent T d33d5ee8ef6f415593d8df52063161ad P cd75a17ab2604397adab03bb8b5fd75c: Append to log took a long time: real 0.222s	user 0.000s	sys 0.001s
I20260709 13:19:52.748342 10445 raft_consensus.cc:493] T 17587d6730594da4a56fa13a353232a1 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:52.798928  6726 raft_consensus.cc:1240] T 1528ab62b6fe4e3099d08f141afee116 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 9 FOLLOWER]: Rejecting Update request from peer b7ab4784c7344b939bc36f639286f377 for earlier term 8. Current term is 9. Ops: []
I20260709 13:19:52.799154  6873 raft_consensus.cc:2393] T 4f00a2e87e56452083b759f60d461ee3 P cd75a17ab2604397adab03bb8b5fd75c [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate b7ab4784c7344b939bc36f639286f377 in current term 10: Already voted for candidate cd75a17ab2604397adab03bb8b5fd75c in this term.
I20260709 13:19:52.799074  6879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22ccee1b570c4ad3a57bd7aec085b1b4" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:19:52.835935  6879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a734b5ab7834e05a8c422208acc58b1" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:19:52.837474  6879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b3759de40694069b13c0f8bd40e5709" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:19:52.838239  6879 raft_consensus.cc:2468] T 9b3759de40694069b13c0f8bd40e5709 P cd75a17ab2604397adab03bb8b5fd75c [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 8.
I20260709 13:19:52.839123  6879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d33d5ee8ef6f415593d8df52063161ad" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:19:52.688783 10268 consensus_queue.cc:237] T 7c37d41cd9164c15a6826ca62a851a69 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
W20260709 13:19:52.801081  6880 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.537s	user 0.014s	sys 0.028s
W20260709 13:19:52.802049  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 46534us
I20260709 13:19:52.726580 10437 raft_consensus.cc:3060] T ce4f062dcd314d43a63ca74067cb5ee3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:52.679836 10439 raft_consensus.cc:515] T 4275cf08e63345f993bce8664eada830 P cd75a17ab2604397adab03bb8b5fd75c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
W20260709 13:19:52.804679  6845 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:52.692292 10306 raft_consensus.cc:515] T 4d9def8b32fd443aa94ab1420b06837b P b7ab4784c7344b939bc36f639286f377 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:52.806493  6877 raft_consensus.cc:2393] T a1704639a875409b9959353527b3fd68 P cd75a17ab2604397adab03bb8b5fd75c [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ccd8a4c3bfe3413cb2ae219b09aea832 in current term 10: Already voted for candidate b7ab4784c7344b939bc36f639286f377 in this term.
I20260709 13:19:52.738796 10390 raft_consensus.cc:697] T 3fa34c08b205435dba97346991aa1f92 P cd75a17ab2604397adab03bb8b5fd75c [term 11 LEADER]: Becoming Leader. State: Replica: cd75a17ab2604397adab03bb8b5fd75c, State: Running, Role: LEADER
I20260709 13:19:52.839458  6807 raft_consensus.cc:1240] T be1a92657f494cac8dd227d152f50151 P b7ab4784c7344b939bc36f639286f377 [term 12 FOLLOWER]: Rejecting Update request from peer 7ba59cc884714e8aa5f3f0ecaed84cbb for earlier term 11. Current term is 12. Ops: []
I20260709 13:19:52.759744  6876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5be3a11b23d4ea9b08300a2789821c7" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
W20260709 13:19:52.866870  6881 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.665s	user 0.024s	sys 0.038s
W20260709 13:19:52.894897  6881 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.696s	user 0.025s	sys 0.038s
I20260709 13:19:52.894935  6876 raft_consensus.cc:2468] T f5be3a11b23d4ea9b08300a2789821c7 P cd75a17ab2604397adab03bb8b5fd75c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 7.
I20260709 13:19:52.895658  6881 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53416 (request call id 2628) took 3428 ms. Trace:
I20260709 13:19:52.868427  6844 leader_election.cc:304] T 95a75bfe094d4bdc963aba3f08dfcd25 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:19:52.867074  6879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d65025eea89441290d85dd053810e31" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:19:52.896202  6876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4275cf08e63345f993bce8664eada830" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:19:52.896765  6879 raft_consensus.cc:2410] T 3d65025eea89441290d85dd053810e31 P cd75a17ab2604397adab03bb8b5fd75c [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ccd8a4c3bfe3413cb2ae219b09aea832 for term 9 because replica has last-logged OpId of term: 7 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 3.
W20260709 13:19:52.869131  6880 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.605s	user 0.015s	sys 0.029s
I20260709 13:19:52.897758  6880 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53416 (request call id 2650) took 3055 ms. Trace:
W20260709 13:19:52.880641  6845 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:52.890676  6877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20f6842e26174571996b8dea4151d4be" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:19:52.899137  6879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8292e16e5654be6bc408560cf256aaa" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
W20260709 13:19:52.813771 10006 consensus_meta.cc:287] T b3f13b31a1f84f0d89d007eadd57924c P b7ab4784c7344b939bc36f639286f377: Time spent flushing consensus metadata: real 0.757s	user 0.010s	sys 0.002s
I20260709 13:19:52.900734  6877 raft_consensus.cc:2468] T 20f6842e26174571996b8dea4151d4be P cd75a17ab2604397adab03bb8b5fd75c [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 10.
I20260709 13:19:52.905016  6805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "404190ce4ce94cecbfcb6ea9d1dd8626" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:19:52.900946  6879 raft_consensus.cc:2468] T d8292e16e5654be6bc408560cf256aaa P cd75a17ab2604397adab03bb8b5fd75c [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 12.
I20260709 13:19:52.897836  6881 rpcz_store.cc:276] 0709 13:19:49.467569 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:50.683626 (+1216057us) service_pool.cc:224] Handling call
0709 13:19:51.650860 (+967234us) spinlock_profiling.cc:243] Waited 7.54 ms on lock 0x7b5800147c98. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0c745db1 00007fcc0c885b71 00007fcc0c885a22 00007fcc1579ec09 00007fcc148f8ee0 00007fcc149c20ab 00007fcc149c2131 00007fcc14983fc0 00007fcc1496e929 00007fcc1496e3d2 00007fcc0dee5bd4
0709 13:19:51.651078 (+   218us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:51.651284 (+   206us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:19:51.963058 (+311774us) log.cc:844] Serialized 14 byte log entry
0709 13:19:52.895271 (+932213us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:52.895322 (+    51us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:19:52.895393 (+    71us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:52.895462 (+    69us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:52.895588 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":402674,"prepare.run_cpu_time_us":34,"prepare.run_wall_time_us":37,"raft.queue_time_us":430633,"raft.run_cpu_time_us":176,"raft.run_wall_time_us":11347,"spinlock_wait_cycles":17348864,"thread_start_us":1243171,"threads_started":3,"wal-append.queue_time_us":413240}
I20260709 13:19:52.766148 10032 consensus_queue.cc:1048] T f09c2a98de1a4decabd0ff900dd44caa P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.103s
I20260709 13:19:52.906050  6800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de3186201e1a40d0b335eeb8b4e256e0" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:19:52.906801  6799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d9def8b32fd443aa94ab1420b06837b" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:19:52.907616  6804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3f13b31a1f84f0d89d007eadd57924c" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
W20260709 13:19:52.912099  6770 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 302704us
I20260709 13:19:52.867592 10240 leader_election.cc:290] T 2c240553ce044eedb41541d72b9475d7 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:52.916494  6877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab432e62819d499eaaf3dd55481dd930" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:19:52.930354  6877 raft_consensus.cc:1240] T 427c124d773f483294511e80fe340075 P cd75a17ab2604397adab03bb8b5fd75c [term 9 FOLLOWER]: Rejecting Update request from peer ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 8. Current term is 9. Ops: []
I20260709 13:19:52.919219  6799 raft_consensus.cc:2393] T 4d9def8b32fd443aa94ab1420b06837b P b7ab4784c7344b939bc36f639286f377 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate ccd8a4c3bfe3413cb2ae219b09aea832 in current term 10: Already voted for candidate b7ab4784c7344b939bc36f639286f377 in this term.
I20260709 13:19:52.836790 10385 raft_consensus.cc:2804] T fe20b4b48823486ca3b9c648db6ce8aa P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:19:52.898205  6880 rpcz_store.cc:276] 0709 13:19:49.842192 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:51.895567 (+2053375us) service_pool.cc:224] Handling call
0709 13:19:51.895903 (+   336us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:51.896170 (+   267us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:19:52.045963 (+149793us) log.cc:844] Serialized 14 byte log entry
0709 13:19:52.897297 (+851334us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:52.897365 (+    68us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:19:52.897449 (+    84us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:52.897540 (+    91us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:52.897675 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":73250,"prepare.queue_time_us":234658,"prepare.run_cpu_time_us":73,"prepare.run_wall_time_us":2689,"raft.queue_time_us":435293,"raft.run_cpu_time_us":251,"raft.run_wall_time_us":23678,"thread_start_us":1000131,"threads_started":3,"wal-append.queue_time_us":400678}
W20260709 13:19:52.660995 10402 consensus_queue.cc:1175] T 7c37d41cd9164c15a6826ca62a851a69 P ccd8a4c3bfe3413cb2ae219b09aea832 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "cd75a17ab2604397adab03bb8b5fd75c" responder_term: 8 status { last_received { term: 7 index: 5 } last_committed_idx: 3 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 7. Current term is 8. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:19:52.922663 10459 consensus_queue.cc:1048] T d8292e16e5654be6bc408560cf256aaa P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:19:52.922786 10301 consensus_queue.cc:237] T 44bde925b2e541b69890d70715b85176 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:52.923568  6881 raft_consensus.cc:1240] T 34f36d59d88f40fe8a2805e604fc6c0a P cd75a17ab2604397adab03bb8b5fd75c [term 7 FOLLOWER]: Rejecting Update request from peer ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 6. Current term is 7. Ops: []
I20260709 13:19:52.917168  6876 raft_consensus.cc:2468] T 4275cf08e63345f993bce8664eada830 P cd75a17ab2604397adab03bb8b5fd75c [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 10.
I20260709 13:19:52.923614  6874 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53406 (request call id 1826) took 5047 ms. Trace:
I20260709 13:19:52.893539 10404 leader_election.cc:290] T 95a75bfe094d4bdc963aba3f08dfcd25 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:52.940508  6879 raft_consensus.cc:1275] T 30e88460611e47b2ba16a46a30b5f416 P cd75a17ab2604397adab03bb8b5fd75c [term 9 FOLLOWER]: Refusing update from remote peer ccd8a4c3bfe3413cb2ae219b09aea832: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:19:52.935632  6804 raft_consensus.cc:1240] T 427c124d773f483294511e80fe340075 P b7ab4784c7344b939bc36f639286f377 [term 9 FOLLOWER]: Rejecting Update request from peer ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 8. Current term is 9. Ops: []
I20260709 13:19:52.942971  6877 raft_consensus.cc:1275] T f09c2a98de1a4decabd0ff900dd44caa P cd75a17ab2604397adab03bb8b5fd75c [term 11 FOLLOWER]: Refusing update from remote peer ccd8a4c3bfe3413cb2ae219b09aea832: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:19:52.898859 10275 raft_consensus.cc:2749] T 4b8cacb381b746da8d0049b0a83b41dd P cd75a17ab2604397adab03bb8b5fd75c [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:19:52.946666  6772 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 400198us
I20260709 13:19:52.971990  6772 leader_election.cc:304] T f03d0dbf16864ca4bc1bb5e4c0334c0f P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:19:52.902678 10387 raft_consensus.cc:2749] T 90d42e216d9741e190bca19a781291fd P cd75a17ab2604397adab03bb8b5fd75c [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:19:52.954921  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 86587.1us
I20260709 13:19:52.898504  9836 leader_election.cc:290] T f09c2a98de1a4decabd0ff900dd44caa P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:52.910777 10457 raft_consensus.cc:493] T e31b9971c15848dea59d4d4130141d9e P cd75a17ab2604397adab03bb8b5fd75c [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:52.926823 10375 raft_consensus.cc:3060] T 404190ce4ce94cecbfcb6ea9d1dd8626 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:52.963824  6874 rpcz_store.cc:276] 0709 13:19:47.876682 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:50.585964 (+2709282us) service_pool.cc:224] Handling call
0709 13:19:50.587665 (+  1701us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:51.404433 (+816768us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:19:51.888898 (+484465us) log.cc:844] Serialized 14 byte log entry
0709 13:19:52.170179 (+281281us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:52.175363 (+  5184us) log.cc:844] Serialized 26 byte log entry
0709 13:19:52.175592 (+   229us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:19:52.175646 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:52.175741 (+    95us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:52.923414 (+747673us) raft_consensus.cc:1685] finished
0709 13:19:52.923433 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:52.923549 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":26460,"prepare.queue_time_us":635784,"prepare.run_cpu_time_us":49,"prepare.run_wall_time_us":51,"raft.queue_time_us":91818,"raft.run_cpu_time_us":256,"raft.run_wall_time_us":281,"thread_start_us":1478471,"threads_started":3,"wal-append.queue_time_us":512245}
I20260709 13:19:52.985847  6772 leader_election.cc:304] T bd6869f07b5a4885a0b99fbe60c3b175 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:19:52.811594 10063 consensus_queue.cc:260] T 713b5728a197487c9300b310ab94e5a3 P b7ab4784c7344b939bc36f639286f377 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:52.991909  6804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a75bfe094d4bdc963aba3f08dfcd25" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 11 candidate_status { last_received { term: 10 index: 4 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:19:52.909008 10352 consensus_queue.cc:1059] T 3a485a995abc4807b6e511e45419f737 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.062s
I20260709 13:19:52.933682 10441 raft_consensus.cc:2749] T e77e330a82df4b43a745d57a68f6f057 P cd75a17ab2604397adab03bb8b5fd75c [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:19:53.001681  6874 raft_consensus.cc:1275] T 713b5728a197487c9300b310ab94e5a3 P cd75a17ab2604397adab03bb8b5fd75c [term 10 FOLLOWER]: Refusing update from remote peer ccd8a4c3bfe3413cb2ae219b09aea832: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
W20260709 13:19:52.972767 10313 consensus_meta.cc:287] T 7c44c4849aa54f2b94d1f1bef9ed546f P b7ab4784c7344b939bc36f639286f377: Time spent flushing consensus metadata: real 1.141s	user 0.015s	sys 0.000s
W20260709 13:19:53.014273 10166 consensus_meta.cc:287] T 9e326172347f45e99a0d482b5d8ef768 P b7ab4784c7344b939bc36f639286f377: Time spent flushing consensus metadata: real 0.802s	user 0.005s	sys 0.007s
I20260709 13:19:53.014765 10166 raft_consensus.cc:515] T 9e326172347f45e99a0d482b5d8ef768 P b7ab4784c7344b939bc36f639286f377 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
W20260709 13:19:53.015666 10419 log.cc:927] Time spent T e77e330a82df4b43a745d57a68f6f057 P cd75a17ab2604397adab03bb8b5fd75c: Append to log took a long time: real 0.277s	user 0.000s	sys 0.001s
I20260709 13:19:53.017309  6878 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53406 (request call id 1827) took 5009 ms. Trace:
I20260709 13:19:53.017148 10464 consensus_queue.cc:1048] T e31b9971c15848dea59d4d4130141d9e P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:19:53.018108 10352 raft_consensus.cc:3055] T 3a485a995abc4807b6e511e45419f737 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:19:53.018536 10352 raft_consensus.cc:740] T 3a485a995abc4807b6e511e45419f737 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
I20260709 13:19:52.962071 10450 consensus_queue.cc:1048] T 17587d6730594da4a56fa13a353232a1 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.082s
I20260709 13:19:53.021325 10450 consensus_queue.cc:1243] T 17587d6730594da4a56fa13a353232a1 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Peer ccd8a4c3bfe3413cb2ae219b09aea832 log is divergent from this leader: its last log entry 12.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 13:19:53.022687 10450 raft_consensus.cc:493] T f4b8bd455d5a47c18a1380839c6e0d61 P b7ab4784c7344b939bc36f639286f377 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:19:53.026789  6729 raft_consensus.cc:606] T 7c37d41cd9164c15a6826ca62a851a69 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 8 FOLLOWER]: Received request to transfer leadership to TS cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:19:53.027311  6729 raft_consensus.cc:614] T 7c37d41cd9164c15a6826ca62a851a69 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 8 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:19:53.028800 10389 leader_election.cc:290] T 4f00a2e87e56452083b759f60d461ee3 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 10 election: Requested vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:19:53.029623  6844 leader_election.cc:400] T 711ef6523deb4cbe8ef2ba61e1c21c98 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 9 pre-election: Vote denied by peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391) with higher term. Message: Invalid argument: T 711ef6523deb4cbe8ef2ba61e1c21c98 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c for earlier term 9. Current term is 10.
I20260709 13:19:53.029989  6844 leader_election.cc:403] T 711ef6523deb4cbe8ef2ba61e1c21c98 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 9 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:19:53.031548  6844 leader_election.cc:304] T 24ee15416e3145beaa1b8183453729a3 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:19:52.839051 10445 raft_consensus.cc:515] T 17587d6730594da4a56fa13a353232a1 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:19:53.070297 10445 leader_election.cc:290] T 17587d6730594da4a56fa13a353232a1 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
W20260709 13:19:53.070533  6696 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:53.071487 10442 raft_consensus.cc:2749] T 711ef6523deb4cbe8ef2ba61e1c21c98 P cd75a17ab2604397adab03bb8b5fd75c [term 10 FOLLOWER]: Leader pre-election lost for term 9. Reason: Vote denied by peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391) with higher term. Message: Invalid argument: T 711ef6523deb4cbe8ef2ba61e1c21c98 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c for earlier term 9. Current term is 10.
I20260709 13:19:53.072275  6844 leader_election.cc:400] T 1bf4668eeb70467fb3dc5a0289233b3c P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 8 pre-election: Vote denied by peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391) with higher term. Message: Invalid argument: T 1bf4668eeb70467fb3dc5a0289233b3c P ccd8a4c3bfe3413cb2ae219b09aea832 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c for earlier term 8. Current term is 9.
I20260709 13:19:53.017093 10166 leader_election.cc:290] T 9e326172347f45e99a0d482b5d8ef768 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 9 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:53.035724 10426 consensus_queue.cc:1059] T 713b5728a197487c9300b310ab94e5a3 P b7ab4784c7344b939bc36f639286f377 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.024s
I20260709 13:19:53.073545 10426 consensus_queue.cc:1243] T 713b5728a197487c9300b310ab94e5a3 P b7ab4784c7344b939bc36f639286f377 [NON_LEADER]: Peer ccd8a4c3bfe3413cb2ae219b09aea832 log is divergent from this leader: its last log entry 10.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 13:19:53.075284 10332 leader_election.cc:290] T be1a92657f494cac8dd227d152f50151 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 12 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:19:53.037169  6881 raft_consensus.cc:1240] T fe20b4b48823486ca3b9c648db6ce8aa P cd75a17ab2604397adab03bb8b5fd75c [term 7 LEADER]: Rejecting Update request from peer ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 6. Current term is 7. Ops: []
I20260709 13:19:53.037993 10390 consensus_queue.cc:237] T 3fa34c08b205435dba97346991aa1f92 P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:19:52.916558 10006 raft_consensus.cc:515] T b3f13b31a1f84f0d89d007eadd57924c P b7ab4784c7344b939bc36f639286f377 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:19:53.039471 10299 leader_election.cc:290] T 7c37d41cd9164c15a6826ca62a851a69 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:19:53.040455 10313 raft_consensus.cc:515] T 7c44c4849aa54f2b94d1f1bef9ed546f P b7ab4784c7344b939bc36f639286f377 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
W20260709 13:19:53.042322 10228 consensus_meta.cc:287] T e77e330a82df4b43a745d57a68f6f057 P ccd8a4c3bfe3413cb2ae219b09aea832: Time spent flushing consensus metadata: real 1.088s	user 0.012s	sys 0.000s
I20260709 13:19:52.988880 10270 consensus_queue.cc:1059] T 1528ab62b6fe4e3099d08f141afee116 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.054s
I20260709 13:19:52.908143 10452 consensus_queue.cc:1059] T c4db81d9d329422bb3b4160ca4ac2d1d P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.095s
W20260709 13:19:53.043366 10324 consensus_meta.cc:287] T 34f36d59d88f40fe8a2805e604fc6c0a P ccd8a4c3bfe3413cb2ae219b09aea832: Time spent flushing consensus metadata: real 1.115s	user 0.013s	sys 0.000s
I20260709 13:19:53.013027  9836 raft_consensus.cc:2804] T f03d0dbf16864ca4bc1bb5e4c0334c0f P b7ab4784c7344b939bc36f639286f377 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:19:52.968421 10240 consensus_queue.cc:1048] T 7887766dc6784fcaa42b35c05fea7a99 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.076s
W20260709 13:19:53.045938 10410 consensus_meta.cc:287] T 404190ce4ce94cecbfcb6ea9d1dd8626 P b7ab4784c7344b939bc36f639286f377: Time spent flushing consensus metadata: real 0.596s	user 0.004s	sys 0.009s
I20260709 13:19:52.964531 10436 raft_consensus.cc:2749] T 95a75bfe094d4bdc963aba3f08dfcd25 P cd75a17ab2604397adab03bb8b5fd75c [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:19:53.048169 10401 consensus_meta.cc:287] T 20f6842e26174571996b8dea4151d4be P ccd8a4c3bfe3413cb2ae219b09aea832: Time spent flushing consensus metadata: real 0.602s	user 0.008s	sys 0.003s
I20260709 13:19:53.004665 10457 raft_consensus.cc:515] T e31b9971c15848dea59d4d4130141d9e P cd75a17ab2604397adab03bb8b5fd75c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:53.017868  6878 rpcz_store.cc:276] 0709 13:19:48.008229 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:50.603841 (+2595612us) service_pool.cc:224] Handling call
0709 13:19:50.604372 (+   531us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:51.399179 (+794807us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:19:51.898494 (+499315us) log.cc:844] Serialized 14 byte log entry
0709 13:19:52.480303 (+581809us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:52.523144 (+ 42841us) log.cc:844] Serialized 26 byte log entry
0709 13:19:52.523708 (+   564us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:19:52.523868 (+   160us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:52.524214 (+   346us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:53.017060 (+492846us) raft_consensus.cc:1685] finished
0709 13:19:53.017080 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:53.017248 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":603638,"prepare.run_cpu_time_us":67,"prepare.run_wall_time_us":1770,"raft.queue_time_us":507220,"raft.run_cpu_time_us":54,"raft.run_wall_time_us":54,"spinlock_wait_cycles":9694464,"thread_start_us":1816145,"threads_started":4,"wal-append.queue_time_us":752595}
I20260709 13:19:53.019424 10352 consensus_queue.cc:260] T 3a485a995abc4807b6e511e45419f737 P ccd8a4c3bfe3413cb2ae219b09aea832 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:53.049615 10405 raft_consensus.cc:515] T 853ac0a8cbd64ce99457f170216d4d0f P b7ab4784c7344b939bc36f639286f377 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
W20260709 13:19:53.050590  6772 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 64829.6us
I20260709 13:19:53.132019  6772 leader_election.cc:304] T 8c7f33e544204fbaac4078e3e83bbf4e P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:19:53.053299 10447 raft_consensus.cc:2749] T bd6869f07b5a4885a0b99fbe60c3b175 P b7ab4784c7344b939bc36f639286f377 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:19:53.057164 10420 raft_consensus.cc:3055] T bd6869f07b5a4885a0b99fbe60c3b175 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:19:53.058749 10446 raft_consensus.cc:493] T 07a92dd554674067a83a9cb68c4773f2 P b7ab4784c7344b939bc36f639286f377 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:53.032653 10306 leader_election.cc:290] T 4d9def8b32fd443aa94ab1420b06837b P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 10 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:53.072356 10442 raft_consensus.cc:2749] T 24ee15416e3145beaa1b8183453729a3 P cd75a17ab2604397adab03bb8b5fd75c [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:19:52.976373 10385 raft_consensus.cc:697] T fe20b4b48823486ca3b9c648db6ce8aa P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 8 LEADER]: Becoming Leader. State: Replica: 7ba59cc884714e8aa5f3f0ecaed84cbb, State: Running, Role: LEADER
I20260709 13:19:53.077672  6844 leader_election.cc:403] T 1bf4668eeb70467fb3dc5a0289233b3c P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 8 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:19:53.038651 10439 leader_election.cc:290] T 4275cf08e63345f993bce8664eada830 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:19:53.083459  6875 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53416 (request call id 2642) took 3474 ms. Trace:
I20260709 13:19:53.023310 10450 raft_consensus.cc:515] T f4b8bd455d5a47c18a1380839c6e0d61 P b7ab4784c7344b939bc36f639286f377 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
W20260709 13:19:53.031473 10102 consensus_meta.cc:287] T 4f00a2e87e56452083b759f60d461ee3 P 7ba59cc884714e8aa5f3f0ecaed84cbb: Time spent flushing consensus metadata: real 0.647s	user 0.010s	sys 0.000s
I20260709 13:19:53.085531 10063 raft_consensus.cc:3060] T 713b5728a197487c9300b310ab94e5a3 P b7ab4784c7344b939bc36f639286f377 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:53.095355  6807 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50550 (request call id 339) took 1025 ms. Trace:
W20260709 13:19:53.096828  6695 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:53.155716  6695 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:53.155452  6807 rpcz_store.cc:276] 0709 13:19:52.070090 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:52.070245 (+   155us) service_pool.cc:224] Handling call
0709 13:19:52.070580 (+   335us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:52.900588 (+830008us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:53.094938 (+194350us) spinlock_profiling.cc:243] Waited 769 ms on lock 0x7b54001cbbd4. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f9aae01 00007fcc0f9a983e 00007fcc1496e419 00007fcc0dee5bd4 00007fcc0dee5b62 00007fcc0dee5a91 00007fcc0dee5a0c 00007fcc0dee4cc2 00007fcc0dce548c 00007fcc0dce48c6
0709 13:19:53.095248 (+   310us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1767703936}
I20260709 13:19:53.107184  6803 raft_consensus.cc:1240] T b3f13b31a1f84f0d89d007eadd57924c P b7ab4784c7344b939bc36f639286f377 [term 8 FOLLOWER]: Rejecting Update request from peer 7ba59cc884714e8aa5f3f0ecaed84cbb for earlier term 7. Current term is 8. Ops: []
W20260709 13:19:53.104233  6728 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.556s	user 0.023s	sys 0.061s
W20260709 13:19:53.096143 10406 consensus_meta.cc:287] T bb7fa124c3bf4ef9ab65a407cb008441 P 7ba59cc884714e8aa5f3f0ecaed84cbb: Time spent flushing consensus metadata: real 0.886s	user 0.013s	sys 0.000s
I20260709 13:19:53.126694  6800 raft_consensus.cc:1240] T 7c44c4849aa54f2b94d1f1bef9ed546f P b7ab4784c7344b939bc36f639286f377 [term 12 FOLLOWER]: Rejecting Update request from peer ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 11. Current term is 12. Ops: []
I20260709 13:19:53.133360  6772 leader_election.cc:304] T 90d42e216d9741e190bca19a781291fd P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: ccd8a4c3bfe3413cb2ae219b09aea832
W20260709 13:19:53.128334 10367 consensus_meta.cc:287] T 24ee15416e3145beaa1b8183453729a3 P ccd8a4c3bfe3413cb2ae219b09aea832: Time spent flushing consensus metadata: real 0.971s	user 0.010s	sys 0.003s
I20260709 13:19:53.125728 10410 raft_consensus.cc:2749] T 404190ce4ce94cecbfcb6ea9d1dd8626 P b7ab4784c7344b939bc36f639286f377 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:19:53.150393  6875 rpcz_store.cc:276] 0709 13:19:49.609286 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:51.860646 (+2251360us) service_pool.cc:224] Handling call
0709 13:19:51.908780 (+ 48134us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:51.909020 (+   240us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:19:52.084631 (+175611us) log.cc:844] Serialized 14 byte log entry
0709 13:19:53.067631 (+983000us) spinlock_profiling.cc:243] Waited 4.15 ms on lock 0x7b1800303400. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc15785de1 00007fcc157925b1 00007fcc0f5524bc 00007fcc0c8a048b 00007fcc156faab9 00007fcc0c8bc69b 00007fcc0c8ba93f 00007fcc0c8ba455 00007fcc0f9a2060 00007fcc0f9b4716 00007fcc0f9c5287
0709 13:19:53.067757 (+   126us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:53.067822 (+    65us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:19:53.067914 (+    92us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:53.068008 (+    94us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:53.083379 (+ 15371us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":118067,"prepare.queue_time_us":235244,"prepare.run_cpu_time_us":65,"prepare.run_wall_time_us":68,"raft.queue_time_us":437261,"raft.run_cpu_time_us":111,"raft.run_wall_time_us":112,"spinlock_wait_cycles":9553280,"thread_start_us":553994,"threads_started":3,"wal-append.queue_time_us":395430}
I20260709 13:19:53.135857 10420 raft_consensus.cc:740] T bd6869f07b5a4885a0b99fbe60c3b175 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
I20260709 13:19:53.129842  9836 raft_consensus.cc:697] T f03d0dbf16864ca4bc1bb5e4c0334c0f P b7ab4784c7344b939bc36f639286f377 [term 8 LEADER]: Becoming Leader. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
I20260709 13:19:53.153287  6806 raft_consensus.cc:1240] T 853ac0a8cbd64ce99457f170216d4d0f P b7ab4784c7344b939bc36f639286f377 [term 7 FOLLOWER]: Rejecting Update request from peer ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 6. Current term is 7. Ops: []
W20260709 13:19:53.159489  6728 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.614s	user 0.024s	sys 0.062s
I20260709 13:19:53.102795 10228 raft_consensus.cc:515] T e77e330a82df4b43a745d57a68f6f057 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } }
W20260709 13:19:53.142620 10409 consensus_meta.cc:287] T dbdf895bba214ff68685a24fd17dfb5d P b7ab4784c7344b939bc36f639286f377: Time spent flushing consensus metadata: real 0.685s	user 0.007s	sys 0.004s
I20260709 13:19:53.161504 10102 raft_consensus.cc:515] T 4f00a2e87e56452083b759f60d461ee3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 10 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:19:53.162335 10457 leader_election.cc:290] T e31b9971c15848dea59d4d4130141d9e P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:19:53.135643 10314 raft_consensus.cc:2749] T 8c7f33e544204fbaac4078e3e83bbf4e P b7ab4784c7344b939bc36f639286f377 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
W20260709 13:19:53.167708  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 95603.1us
W20260709 13:19:53.150454  6771 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:53.264276  6678 auto_rebalancer.cc:629] Failed to schedule move for tablet a3022224cc81473690653a83d4e99470: Illegal state: Replica b7ab4784c7344b939bc36f639286f377 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 10 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } }
I20260709 13:19:53.143193 10423 raft_consensus.cc:493] T f03d0dbf16864ca4bc1bb5e4c0334c0f P ccd8a4c3bfe3413cb2ae219b09aea832 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:53.293888  6723 raft_consensus.cc:1240] T e77e330a82df4b43a745d57a68f6f057 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 12 FOLLOWER]: Rejecting Update request from peer b7ab4784c7344b939bc36f639286f377 for earlier term 11. Current term is 12. Ops: []
I20260709 13:19:53.130789 10401 raft_consensus.cc:515] T 20f6842e26174571996b8dea4151d4be P ccd8a4c3bfe3413cb2ae219b09aea832 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
W20260709 13:19:53.300630  6846 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:53.259207 10406 raft_consensus.cc:2749] T bb7fa124c3bf4ef9ab65a407cb008441 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:19:53.272869 10439 raft_consensus.cc:2749] T 1bf4668eeb70467fb3dc5a0289233b3c P cd75a17ab2604397adab03bb8b5fd75c [term 9 FOLLOWER]: Leader pre-election lost for term 8. Reason: Vote denied by peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391) with higher term. Message: Invalid argument: T 1bf4668eeb70467fb3dc5a0289233b3c P ccd8a4c3bfe3413cb2ae219b09aea832 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c for earlier term 8. Current term is 9.
I20260709 13:19:53.323599  6807 raft_consensus.cc:1275] T 30e88460611e47b2ba16a46a30b5f416 P b7ab4784c7344b939bc36f639286f377 [term 9 FOLLOWER]: Refusing update from remote peer ccd8a4c3bfe3413cb2ae219b09aea832: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:19:53.293342  6772 leader_election.cc:304] T f3f9c2e2bf644115957398fe4c9459db P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:19:53.322257  6844 leader_election.cc:400] T d8292e16e5654be6bc408560cf256aaa P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 11 pre-election: Vote denied by peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391) with higher term. Message: Invalid argument: T d8292e16e5654be6bc408560cf256aaa P ccd8a4c3bfe3413cb2ae219b09aea832 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c for earlier term 11. Current term is 12.
W20260709 13:19:53.346112  6845 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:53.279035 10306 raft_consensus.cc:493] T a3022224cc81473690653a83d4e99470 P b7ab4784c7344b939bc36f639286f377 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:53.351178  6804 raft_consensus.cc:1240] T 8c7f33e544204fbaac4078e3e83bbf4e P b7ab4784c7344b939bc36f639286f377 [term 7 FOLLOWER]: Rejecting Update request from peer ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 6. Current term is 7. Ops: []
I20260709 13:19:53.368573  7503 raft_consensus.cc:2393] T 4f00a2e87e56452083b759f60d461ee3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate b7ab4784c7344b939bc36f639286f377 in current term 10: Already voted for candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in this term.
W20260709 13:19:53.375176  6772 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 82194.8us
I20260709 13:19:53.278416 10303 raft_consensus.cc:2804] T 90d42e216d9741e190bca19a781291fd P b7ab4784c7344b939bc36f639286f377 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:19:53.376322  6772 leader_election.cc:304] T 9b3759de40694069b13c0f8bd40e5709 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:19:53.372140  6844 leader_election.cc:403] T d8292e16e5654be6bc408560cf256aaa P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 11 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:19:53.380412  7500 raft_consensus.cc:1240] T bb7fa124c3bf4ef9ab65a407cb008441 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 9 FOLLOWER]: Rejecting Update request from peer b7ab4784c7344b939bc36f639286f377 for earlier term 8. Current term is 9. Ops: []
I20260709 13:19:53.380560  6807 raft_consensus.cc:1240] T 9e326172347f45e99a0d482b5d8ef768 P b7ab4784c7344b939bc36f639286f377 [term 9 FOLLOWER]: Rejecting Update request from peer ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 8. Current term is 9. Ops: []
I20260709 13:19:53.379958 10314 raft_consensus.cc:2804] T f3f9c2e2bf644115957398fe4c9459db P b7ab4784c7344b939bc36f639286f377 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:19:53.381449 10314 raft_consensus.cc:493] T f3f9c2e2bf644115957398fe4c9459db P b7ab4784c7344b939bc36f639286f377 [term 8 FOLLOWER]: Starting leader election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:19:53.381979 10314 raft_consensus.cc:3060] T f3f9c2e2bf644115957398fe4c9459db P b7ab4784c7344b939bc36f639286f377 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:53.383528 10102 leader_election.cc:290] T 4f00a2e87e56452083b759f60d461ee3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 10 election: Requested vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
W20260709 13:19:53.384423  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 62431.2us
I20260709 13:19:53.386484  6727 raft_consensus.cc:2468] T 34f36d59d88f40fe8a2805e604fc6c0a P ccd8a4c3bfe3413cb2ae219b09aea832 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 7.
I20260709 13:19:53.390655  6772 leader_election.cc:304] T 34f36d59d88f40fe8a2805e604fc6c0a P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:19:53.392982 10410 raft_consensus.cc:2749] T 9b3759de40694069b13c0f8bd40e5709 P b7ab4784c7344b939bc36f639286f377 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:19:53.385955  6844 leader_election.cc:304] T 20f6842e26174571996b8dea4151d4be P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:19:53.394659  6724 raft_consensus.cc:2368] T 20f6842e26174571996b8dea4151d4be P ccd8a4c3bfe3413cb2ae219b09aea832 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate b7ab4784c7344b939bc36f639286f377 for earlier term 10. Current term is 11.
I20260709 13:19:53.276016 10367 raft_consensus.cc:515] T 24ee15416e3145beaa1b8183453729a3 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
W20260709 13:19:53.409966  7468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 145745us
I20260709 13:19:53.368759 10454 raft_consensus.cc:493] T 711ef6523deb4cbe8ef2ba61e1c21c98 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:19:53.398900  6844 leader_election.cc:304] T 9b3759de40694069b13c0f8bd40e5709 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:19:53.447675  6772 leader_election.cc:304] T 30e88460611e47b2ba16a46a30b5f416 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
W20260709 13:19:53.452611  6845 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:53.299355 10409 raft_consensus.cc:515] T dbdf895bba214ff68685a24fd17dfb5d P b7ab4784c7344b939bc36f639286f377 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:53.472354  6802 raft_consensus.cc:1240] T bd6869f07b5a4885a0b99fbe60c3b175 P b7ab4784c7344b939bc36f639286f377 [term 10 FOLLOWER]: Rejecting Update request from peer ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 9. Current term is 10. Ops: []
I20260709 13:19:53.378975 10303 raft_consensus.cc:493] T 90d42e216d9741e190bca19a781291fd P b7ab4784c7344b939bc36f639286f377 [term 9 FOLLOWER]: Starting leader election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:19:53.147315 10446 raft_consensus.cc:515] T 07a92dd554674067a83a9cb68c4773f2 P b7ab4784c7344b939bc36f639286f377 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:53.398217 10442 raft_consensus.cc:2749] T d8292e16e5654be6bc408560cf256aaa P cd75a17ab2604397adab03bb8b5fd75c [term 12 FOLLOWER]: Leader pre-election lost for term 11. Reason: Vote denied by peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391) with higher term. Message: Invalid argument: T d8292e16e5654be6bc408560cf256aaa P ccd8a4c3bfe3413cb2ae219b09aea832 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c for earlier term 11. Current term is 12.
I20260709 13:19:53.281448 10470 consensus_queue.cc:1059] T 427c124d773f483294511e80fe340075 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.134s
W20260709 13:19:53.402029 10437 consensus_meta.cc:287] T ce4f062dcd314d43a63ca74067cb5ee3 P 7ba59cc884714e8aa5f3f0ecaed84cbb: Time spent flushing consensus metadata: real 0.502s	user 0.008s	sys 0.004s
I20260709 13:19:53.397878 10447 raft_consensus.cc:2804] T 34f36d59d88f40fe8a2805e604fc6c0a P b7ab4784c7344b939bc36f639286f377 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:19:53.400796 10441 raft_consensus.cc:2764] T 20f6842e26174571996b8dea4151d4be P cd75a17ab2604397adab03bb8b5fd75c [term 10 FOLLOWER]: Leader pre-election decision vote started in defunct term 9: won
I20260709 13:19:53.373184 10457 consensus_queue.cc:1048] T fe20b4b48823486ca3b9c648db6ce8aa P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Connected to new peer: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.043s
W20260709 13:19:53.512805  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 85535us
I20260709 13:19:53.384210 10306 raft_consensus.cc:515] T a3022224cc81473690653a83d4e99470 P b7ab4784c7344b939bc36f639286f377 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:53.485567 10439 raft_consensus.cc:2804] T 9b3759de40694069b13c0f8bd40e5709 P cd75a17ab2604397adab03bb8b5fd75c [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 13:19:53.518278 10477 log.cc:927] Time spent T 853ac0a8cbd64ce99457f170216d4d0f P cd75a17ab2604397adab03bb8b5fd75c: Append to log took a long time: real 0.099s	user 0.001s	sys 0.000s
I20260709 13:19:53.497471 10240 raft_consensus.cc:2749] T 30e88460611e47b2ba16a46a30b5f416 P b7ab4784c7344b939bc36f639286f377 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:19:53.530800 10306 leader_election.cc:290] T a3022224cc81473690653a83d4e99470 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:53.496619  9836 consensus_queue.cc:237] T f03d0dbf16864ca4bc1bb5e4c0334c0f P b7ab4784c7344b939bc36f639286f377 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:53.494762 10454 raft_consensus.cc:515] T 711ef6523deb4cbe8ef2ba61e1c21c98 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:53.373641 10423 raft_consensus.cc:515] T f03d0dbf16864ca4bc1bb5e4c0334c0f P ccd8a4c3bfe3413cb2ae219b09aea832 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
W20260709 13:19:53.529223 10468 log.cc:927] Time spent T 1bf4668eeb70467fb3dc5a0289233b3c P ccd8a4c3bfe3413cb2ae219b09aea832: Append to log took a long time: real 0.356s	user 0.000s	sys 0.001s
I20260709 13:19:53.539436  6730 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50004 (request call id 1802) took 1047 ms. Trace:
W20260709 13:19:53.529371 10466 log.cc:927] Time spent T bb3d8792045a4583ae2e965b1350a5b4 P cd75a17ab2604397adab03bb8b5fd75c: Append to log took a long time: real 0.131s	user 0.001s	sys 0.000s
I20260709 13:19:53.495904 10303 raft_consensus.cc:3060] T 90d42e216d9741e190bca19a781291fd P b7ab4784c7344b939bc36f639286f377 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:19:53.540613 10471 log.cc:927] Time spent T a1704639a875409b9959353527b3fd68 P ccd8a4c3bfe3413cb2ae219b09aea832: Append to log took a long time: real 0.166s	user 0.001s	sys 0.000s
I20260709 13:19:53.537245 10409 leader_election.cc:290] T dbdf895bba214ff68685a24fd17dfb5d P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 9 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
W20260709 13:19:53.543673  6696 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:53.522851 10465 log.cc:927] Time spent T e31b9971c15848dea59d4d4130141d9e P ccd8a4c3bfe3413cb2ae219b09aea832: Append to log took a long time: real 0.235s	user 0.001s	sys 0.000s
I20260709 13:19:53.518606 10389 raft_consensus.cc:493] T f58dc08b12a2494bb9a1372837970ca2 P cd75a17ab2604397adab03bb8b5fd75c [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:53.540002  6730 rpcz_store.cc:276] 0709 13:19:52.492560 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:52.753576 (+261016us) service_pool.cc:224] Handling call
0709 13:19:52.753791 (+   215us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:52.799636 (+ 45845us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:52.799677 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:52.808251 (+  8574us) log.cc:844] Serialized 26 byte log entry
0709 13:19:52.973634 (+165383us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:19:52.973692 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:52.973789 (+    97us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:53.539113 (+565324us) raft_consensus.cc:1685] finished
0709 13:19:53.539150 (+    37us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:53.539349 (+   199us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4132,"raft.queue_time_us":6211,"raft.run_cpu_time_us":153,"raft.run_wall_time_us":10142,"thread_start_us":104436,"threads_started":1,"wal-append.queue_time_us":314213}
I20260709 13:19:53.561991  6730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be1a92657f494cac8dd227d152f50151" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:19:53.562935  6730 raft_consensus.cc:3060] T be1a92657f494cac8dd227d152f50151 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:53.514875 10006 leader_election.cc:290] T b3f13b31a1f84f0d89d007eadd57924c P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 8 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
W20260709 13:19:53.541520 10476 log.cc:927] Time spent T 7c37d41cd9164c15a6826ca62a851a69 P b7ab4784c7344b939bc36f639286f377: Append to log took a long time: real 0.172s	user 0.001s	sys 0.000s
I20260709 13:19:53.525219 10439 raft_consensus.cc:493] T 9b3759de40694069b13c0f8bd40e5709 P cd75a17ab2604397adab03bb8b5fd75c [term 8 FOLLOWER]: Starting leader election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:19:53.544178  6804 raft_consensus.cc:1240] T ce4f062dcd314d43a63ca74067cb5ee3 P b7ab4784c7344b939bc36f639286f377 [term 9 FOLLOWER]: Rejecting Update request from peer cd75a17ab2604397adab03bb8b5fd75c for earlier term 8. Current term is 9. Ops: []
I20260709 13:19:53.517210 10470 consensus_queue.cc:1243] T 427c124d773f483294511e80fe340075 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Peer b7ab4784c7344b939bc36f639286f377 log is divergent from this leader: its last log entry 7.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 13:19:53.512488 10313 leader_election.cc:290] T 7c44c4849aa54f2b94d1f1bef9ed546f P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 12 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:53.557070  6802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f00a2e87e56452083b759f60d461ee3" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:19:53.408649 10385 consensus_queue.cc:237] T fe20b4b48823486ca3b9c648db6ce8aa P 7ba59cc884714e8aa5f3f0ecaed84cbb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
W20260709 13:19:53.565485  6844 connection.cc:256] RPC call timeout handler was delayed by -1.8993931680001879s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15100000000000002s for a response
I20260709 13:19:53.520562 10447 raft_consensus.cc:697] T 34f36d59d88f40fe8a2805e604fc6c0a P b7ab4784c7344b939bc36f639286f377 [term 7 LEADER]: Becoming Leader. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
I20260709 13:19:53.541163 10367 leader_election.cc:290] T 24ee15416e3145beaa1b8183453729a3 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 10 election: Requested vote from peers cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:19:53.494117 10420 consensus_queue.cc:260] T bd6869f07b5a4885a0b99fbe60c3b175 P ccd8a4c3bfe3413cb2ae219b09aea832 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.4, Last appended by leader: 4, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:53.576567  6804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e31b9971c15848dea59d4d4130141d9e" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:19:53.595369  6804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c37d41cd9164c15a6826ca62a851a69" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:19:53.578756  6802 raft_consensus.cc:2393] T 4f00a2e87e56452083b759f60d461ee3 P b7ab4784c7344b939bc36f639286f377 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c in current term 10: Already voted for candidate b7ab4784c7344b939bc36f639286f377 in this term.
I20260709 13:19:53.570523 10405 leader_election.cc:290] T 853ac0a8cbd64ce99457f170216d4d0f P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 7 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:53.549777 10441 raft_consensus.cc:493] T c4db81d9d329422bb3b4160ca4ac2d1d P cd75a17ab2604397adab03bb8b5fd75c [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:53.582327  6844 connection.cc:256] RPC call timeout handler was delayed by -1.8696931680001398s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1543s for a response
W20260709 13:19:53.603960  6844 connection.cc:256] RPC call timeout handler was delayed by -1.8588931680001224s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1555s for a response
W20260709 13:19:53.604312  6844 connection.cc:256] RPC call timeout handler was delayed by -1.8390931680000904s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1577s for a response
W20260709 13:19:53.604566  6844 connection.cc:256] RPC call timeout handler was delayed by -1.8192931680000584s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15990000000000001s for a response
W20260709 13:19:53.604817  6844 connection.cc:256] RPC call timeout handler was delayed by -1.7985931680000249s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1622s for a response
W20260709 13:19:53.605049  6844 connection.cc:256] RPC call timeout handler was delayed by -1.7850931680000031s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1637s for a response
W20260709 13:19:53.605283  6844 connection.cc:256] RPC call timeout handler was delayed by -1.7850931680000031s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1637s for a response
W20260709 13:19:53.605515  6844 connection.cc:256] RPC call timeout handler was delayed by -1.7751931680002144s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1648s for a response
W20260709 13:19:53.605743  6844 connection.cc:256] RPC call timeout handler was delayed by -1.7697931680002057s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1654s for a response
W20260709 13:19:53.605989  6844 connection.cc:256] RPC call timeout handler was delayed by -1.754493168000181s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16710000000000003s for a response
W20260709 13:19:53.606227  6844 connection.cc:256] RPC call timeout handler was delayed by -1.7211931680001271s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1708s for a response
W20260709 13:19:53.606496  6844 connection.cc:256] RPC call timeout handler was delayed by -1.7211931680001271s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1708s for a response
W20260709 13:19:53.606731  6844 connection.cc:256] RPC call timeout handler was delayed by -1.6896931680000762s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1743s for a response
W20260709 13:19:53.607002  6844 connection.cc:256] RPC call timeout handler was delayed by -1.6797931680000602s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1754s for a response
W20260709 13:19:53.607237  6844 connection.cc:256] RPC call timeout handler was delayed by -1.6608931680000296s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1775s for a response
W20260709 13:19:53.607468  6844 connection.cc:256] RPC call timeout handler was delayed by -1.6545931680000194s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17820000000000003s for a response
W20260709 13:19:53.607715  6844 connection.cc:256] RPC call timeout handler was delayed by -1.6509931680000136s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1786s for a response
I20260709 13:19:53.573660 10438 raft_consensus.cc:493] T 3d65025eea89441290d85dd053810e31 P cd75a17ab2604397adab03bb8b5fd75c [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:53.517637 10449 consensus_queue.cc:1048] T bb3d8792045a4583ae2e965b1350a5b4 P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Connected to new peer: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.057s
I20260709 13:19:53.560673 10436 raft_consensus.cc:493] T 4d9def8b32fd443aa94ab1420b06837b P cd75a17ab2604397adab03bb8b5fd75c [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:53.561208 10457 raft_consensus.cc:493] T ab432e62819d499eaaf3dd55481dd930 P cd75a17ab2604397adab03bb8b5fd75c [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:19:53.586144  6730 raft_consensus.cc:2468] T be1a92657f494cac8dd227d152f50151 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 12.
W20260709 13:19:53.589263  6798 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:32976 (request call id 2581) took 1743 ms (client timeout 1644 ms). Trace:
W20260709 13:19:53.623414  6798 rpcz_store.cc:269] 0709 13:19:51.845591 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:51.847350 (+  1759us) service_pool.cc:224] Handling call
0709 13:19:53.588940 (+1741590us) spinlock_profiling.cc:243] Waited 557 ms on lock 0x7b540028a5d4. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f9ae2fa 00007fcc1496fb17 00007fcc0deea6d4 00007fcc0deea662 00007fcc0deea591 00007fcc0deea50c 00007fcc0dee97c2 00007fcc0dce548c 00007fcc0dce48c6 00007fcc0dce426f
0709 13:19:53.589152 (+   212us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1280984448}
I20260709 13:19:53.623894  6726 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50004 (request call id 1804) took 1129 ms. Trace:
I20260709 13:19:53.574441  6801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f00a2e87e56452083b759f60d461ee3" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:19:53.625247  6801 raft_consensus.cc:2393] T 4f00a2e87e56452083b759f60d461ee3 P b7ab4784c7344b939bc36f639286f377 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c in current term 10: Already voted for candidate b7ab4784c7344b939bc36f639286f377 in this term.
I20260709 13:19:53.590919 10454 leader_election.cc:290] T 711ef6523deb4cbe8ef2ba61e1c21c98 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:53.591722 10435 raft_consensus.cc:493] T 44bde925b2e541b69890d70715b85176 P cd75a17ab2604397adab03bb8b5fd75c [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:53.519520 10437 raft_consensus.cc:515] T ce4f062dcd314d43a63ca74067cb5ee3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 10 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } attrs { replace: true } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:19:53.577128 10439 raft_consensus.cc:3060] T 9b3759de40694069b13c0f8bd40e5709 P cd75a17ab2604397adab03bb8b5fd75c [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:53.601444  6804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4275cf08e63345f993bce8664eada830" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
W20260709 13:19:53.607962  6844 connection.cc:256] RPC call timeout handler was delayed by -1.5789931680001246s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18660000000000002s for a response
I20260709 13:19:53.542829 10442 consensus_queue.cc:1059] T dbdf895bba214ff68685a24fd17dfb5d P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.055s
I20260709 13:19:53.635406  6730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c240553ce044eedb41541d72b9475d7" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:19:53.637382  6730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3f13b31a1f84f0d89d007eadd57924c" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:19:53.638502  6730 raft_consensus.cc:2393] T b3f13b31a1f84f0d89d007eadd57924c P ccd8a4c3bfe3413cb2ae219b09aea832 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate b7ab4784c7344b939bc36f639286f377 in current term 8: Already voted for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in this term.
I20260709 13:19:53.618291  6731 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50004 (request call id 1797) took 1131 ms. Trace:
I20260709 13:19:53.624691  6726 rpcz_store.cc:276] 0709 13:19:52.494033 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:52.884676 (+390643us) service_pool.cc:224] Handling call
0709 13:19:52.888506 (+  3830us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:19:52.910260 (+ 21754us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:19:52.910292 (+    32us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:19:52.910859 (+   567us) log.cc:844] Serialized 52 byte log entry
0709 13:19:53.086238 (+175379us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:19:53.086312 (+    74us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:53.086397 (+    85us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:53.623454 (+537057us) raft_consensus.cc:1685] finished
0709 13:19:53.623494 (+    40us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:53.623783 (+   289us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":30300,"raft.queue_time_us":25249,"raft.run_cpu_time_us":142,"raft.run_wall_time_us":15297,"thread_start_us":163290,"threads_started":1,"wal-append.queue_time_us":230345}
I20260709 13:19:53.572085 10389 raft_consensus.cc:515] T f58dc08b12a2494bb9a1372837970ca2 P cd75a17ab2604397adab03bb8b5fd75c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:53.628849  6770 leader_election.cc:304] T be1a92657f494cac8dd227d152f50151 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
I20260709 13:19:53.630564  6772 leader_election.cc:304] T c4db81d9d329422bb3b4160ca4ac2d1d P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:19:53.617707 10420 raft_consensus.cc:3060] T bd6869f07b5a4885a0b99fbe60c3b175 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:53.578718 10228 leader_election.cc:290] T e77e330a82df4b43a745d57a68f6f057 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 12 election: Requested vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:53.638995  6731 rpcz_store.cc:276] 0709 13:19:52.486876 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:52.487068 (+   192us) service_pool.cc:224] Handling call
0709 13:19:52.487491 (+   423us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:52.610617 (+123126us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:52.610666 (+    49us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:52.630221 (+ 19555us) log.cc:844] Serialized 26 byte log entry
0709 13:19:52.946289 (+316068us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:19:52.946331 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:52.946400 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:53.618072 (+671672us) raft_consensus.cc:1685] finished
0709 13:19:53.618093 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:53.618223 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":937,"raft.queue_time_us":104078,"raft.run_cpu_time_us":151,"raft.run_wall_time_us":16542,"thread_start_us":385733,"threads_started":2,"wal-append.queue_time_us":460681}
I20260709 13:19:53.652410  6731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e31b9971c15848dea59d4d4130141d9e" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:19:53.645435  6772 leader_election.cc:304] T 3a485a995abc4807b6e511e45419f737 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
W20260709 13:19:53.633566  6844 connection.cc:256] RPC call timeout handler was delayed by -1.5150931680000213s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1937s for a response
W20260709 13:19:53.654992  6698 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:53.654918  6844 connection.cc:256] RPC call timeout handler was delayed by -1.4133931680000842s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.205s for a response
W20260709 13:19:53.655514  6844 connection.cc:256] RPC call timeout handler was delayed by -1.3620931680000012s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21070000000000003s for a response
W20260709 13:19:53.655925  6844 connection.cc:256] RPC call timeout handler was delayed by -1.303593168000134s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21720000000000003s for a response
W20260709 13:19:53.656286  6844 connection.cc:256] RPC call timeout handler was delayed by -1.2747931680000875s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22040000000000004s for a response
W20260709 13:19:53.656592  6844 connection.cc:256] RPC call timeout handler was delayed by -1.2360931680000249s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2247s for a response
W20260709 13:19:53.656890  6844 connection.cc:256] RPC call timeout handler was delayed by -1.0533931680001842s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.24500000000000002s for a response
I20260709 13:19:53.658087  6844 leader_election.cc:304] T 22ccee1b570c4ad3a57bd7aec085b1b4 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:19:53.659803  6844 leader_election.cc:304] T bb7fa124c3bf4ef9ab65a407cb008441 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, b7ab4784c7344b939bc36f639286f377
I20260709 13:19:53.648773  6726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e326172347f45e99a0d482b5d8ef768" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:19:53.662168  6731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3022224cc81473690653a83d4e99470" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:19:53.666582  6730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3411566abe2d4c9bb4b2adfdd05e6f17" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:19:53.667894  6731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c44c4849aa54f2b94d1f1bef9ed546f" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:19:53.675055  6726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b56bf91d90824c959e21e0cee5ba1816" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:19:53.657020 10410 consensus_queue.cc:1048] T f58dc08b12a2494bb9a1372837970ca2 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.020s
I20260709 13:19:53.677021  6730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d9def8b32fd443aa94ab1420b06837b" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:19:53.677793 10410 raft_consensus.cc:2749] T 3a485a995abc4807b6e511e45419f737 P b7ab4784c7344b939bc36f639286f377 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:19:53.678112  6730 raft_consensus.cc:2393] T 4d9def8b32fd443aa94ab1420b06837b P ccd8a4c3bfe3413cb2ae219b09aea832 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate b7ab4784c7344b939bc36f639286f377 in current term 10: Already voted for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in this term.
I20260709 13:19:53.679800  6730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c37d41cd9164c15a6826ca62a851a69" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:19:53.680800  6730 raft_consensus.cc:2468] T 7c37d41cd9164c15a6826ca62a851a69 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 8.
I20260709 13:19:53.630824 10457 raft_consensus.cc:515] T ab432e62819d499eaaf3dd55481dd930 P cd75a17ab2604397adab03bb8b5fd75c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:53.684748  6730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbdf895bba214ff68685a24fd17dfb5d" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:19:53.687147  6730 raft_consensus.cc:2393] T dbdf895bba214ff68685a24fd17dfb5d P ccd8a4c3bfe3413cb2ae219b09aea832 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate b7ab4784c7344b939bc36f639286f377 in current term 9: Already voted for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in this term.
I20260709 13:19:53.685711 10219 raft_consensus.cc:3055] T 2c240553ce044eedb41541d72b9475d7 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:19:53.631275 10268 consensus_queue.cc:1048] T d8cee0accdb8499c86d4414b72565a38 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.043s
W20260709 13:19:53.675254 10472 log.cc:927] Time spent T f4b8bd455d5a47c18a1380839c6e0d61 P cd75a17ab2604397adab03bb8b5fd75c: Append to log took a long time: real 0.181s	user 0.001s	sys 0.000s
I20260709 13:19:53.650969 10006 raft_consensus.cc:2804] T c4db81d9d329422bb3b4160ca4ac2d1d P b7ab4784c7344b939bc36f639286f377 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:19:53.665870 10442 raft_consensus.cc:3055] T dbdf895bba214ff68685a24fd17dfb5d P cd75a17ab2604397adab03bb8b5fd75c [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:19:53.665311 10423 leader_election.cc:290] T f03d0dbf16864ca4bc1bb5e4c0334c0f P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:53.699743  6731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fa34c08b205435dba97346991aa1f92" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: true dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:19:53.690125  6730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "853ac0a8cbd64ce99457f170216d4d0f" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:19:53.668871 10306 raft_consensus.cc:2804] T be1a92657f494cac8dd227d152f50151 P b7ab4784c7344b939bc36f639286f377 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:19:53.625480 10438 raft_consensus.cc:515] T 3d65025eea89441290d85dd053810e31 P cd75a17ab2604397adab03bb8b5fd75c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:53.618763 10441 raft_consensus.cc:515] T c4db81d9d329422bb3b4160ca4ac2d1d P cd75a17ab2604397adab03bb8b5fd75c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:53.709213  6731 raft_consensus.cc:3055] T 3fa34c08b205435dba97346991aa1f92 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:19:53.626663 10436 raft_consensus.cc:515] T 4d9def8b32fd443aa94ab1420b06837b P cd75a17ab2604397adab03bb8b5fd75c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:53.635939 10435 raft_consensus.cc:515] T 44bde925b2e541b69890d70715b85176 P cd75a17ab2604397adab03bb8b5fd75c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:53.670223 10405 consensus_queue.cc:1059] T bb7fa124c3bf4ef9ab65a407cb008441 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.047s
I20260709 13:19:53.686479 10390 raft_consensus.cc:2749] T 22ccee1b570c4ad3a57bd7aec085b1b4 P cd75a17ab2604397adab03bb8b5fd75c [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:19:53.718602  6731 raft_consensus.cc:740] T 3fa34c08b205435dba97346991aa1f92 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
I20260709 13:19:53.715595  6730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4275cf08e63345f993bce8664eada830" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:19:53.688755 10219 raft_consensus.cc:740] T 2c240553ce044eedb41541d72b9475d7 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
I20260709 13:19:53.697885 10442 raft_consensus.cc:740] T dbdf895bba214ff68685a24fd17dfb5d P cd75a17ab2604397adab03bb8b5fd75c [term 7 LEADER]: Becoming Follower/Learner. State: Replica: cd75a17ab2604397adab03bb8b5fd75c, State: Running, Role: LEADER
I20260709 13:19:53.729787 10219 consensus_queue.cc:260] T 2c240553ce044eedb41541d72b9475d7 P ccd8a4c3bfe3413cb2ae219b09aea832 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
W20260709 13:19:53.722203 10263 consensus_meta.cc:287] T b56bf91d90824c959e21e0cee5ba1816 P ccd8a4c3bfe3413cb2ae219b09aea832: Time spent flushing consensus metadata: real 0.994s	user 0.007s	sys 0.006s
I20260709 13:19:53.715029 10006 raft_consensus.cc:697] T c4db81d9d329422bb3b4160ca4ac2d1d P b7ab4784c7344b939bc36f639286f377 [term 9 LEADER]: Becoming Leader. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
W20260709 13:19:53.734309  6772 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 88992us
I20260709 13:19:53.719539 10306 raft_consensus.cc:697] T be1a92657f494cac8dd227d152f50151 P b7ab4784c7344b939bc36f639286f377 [term 12 LEADER]: Becoming Leader. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
I20260709 13:19:53.720171 10446 leader_election.cc:290] T 07a92dd554674067a83a9cb68c4773f2 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:53.730296 10438 leader_election.cc:290] T 3d65025eea89441290d85dd053810e31 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
W20260709 13:19:53.752468  7468 leader_election.cc:336] T d8cee0accdb8499c86d4414b72565a38 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931): Timed out: RequestConsensusVote RPC to 127.5.126.67:42931 timed out after 1.535s (SENT)
I20260709 13:19:53.727939 10484 raft_consensus.cc:2749] T bb7fa124c3bf4ef9ab65a407cb008441 P cd75a17ab2604397adab03bb8b5fd75c [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:19:53.753144  7468 leader_election.cc:304] T d8cee0accdb8499c86d4414b72565a38 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:19:53.749544 10219 raft_consensus.cc:3060] T 2c240553ce044eedb41541d72b9475d7 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:53.759608 10389 leader_election.cc:290] T f58dc08b12a2494bb9a1372837970ca2 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:19:53.759363 10102 raft_consensus.cc:2749] T d8cee0accdb8499c86d4414b72565a38 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:19:53.759335 10487 consensus_queue.cc:1048] T a1704639a875409b9959353527b3fd68 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:19:53.763207 10303 raft_consensus.cc:515] T 90d42e216d9741e190bca19a781291fd P b7ab4784c7344b939bc36f639286f377 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:53.741573 10457 leader_election.cc:290] T ab432e62819d499eaaf3dd55481dd930 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:19:53.764366 10006 consensus_queue.cc:237] T c4db81d9d329422bb3b4160ca4ac2d1d P b7ab4784c7344b939bc36f639286f377 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:53.766449 10401 leader_election.cc:290] T 20f6842e26174571996b8dea4151d4be P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 11 election: Requested vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:53.770592 10323 leader_election.cc:290] T b56bf91d90824c959e21e0cee5ba1816 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:53.771221 10328 leader_election.cc:290] T 4d9def8b32fd443aa94ab1420b06837b P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 10 election: Requested vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:53.701119 10447 consensus_queue.cc:237] T 34f36d59d88f40fe8a2805e604fc6c0a P b7ab4784c7344b939bc36f639286f377 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:53.778370 10439 raft_consensus.cc:515] T 9b3759de40694069b13c0f8bd40e5709 P cd75a17ab2604397adab03bb8b5fd75c [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:53.778698 10435 leader_election.cc:290] T 44bde925b2e541b69890d70715b85176 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:19:53.781000 10439 leader_election.cc:290] T 9b3759de40694069b13c0f8bd40e5709 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 9 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:19:53.780527 10306 consensus_queue.cc:237] T be1a92657f494cac8dd227d152f50151 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:19:53.785583 10314 raft_consensus.cc:515] T f3f9c2e2bf644115957398fe4c9459db P b7ab4784c7344b939bc36f639286f377 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
W20260709 13:19:53.797750 10375 consensus_meta.cc:287] T 404190ce4ce94cecbfcb6ea9d1dd8626 P 7ba59cc884714e8aa5f3f0ecaed84cbb: Time spent flushing consensus metadata: real 0.794s	user 0.014s	sys 0.001s
I20260709 13:19:53.799057 10437 leader_election.cc:290] T ce4f062dcd314d43a63ca74067cb5ee3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 10 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:53.782459 10442 consensus_queue.cc:260] T dbdf895bba214ff68685a24fd17dfb5d P cd75a17ab2604397adab03bb8b5fd75c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:53.799508 10441 leader_election.cc:290] T c4db81d9d329422bb3b4160ca4ac2d1d P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:19:53.800616 10442 raft_consensus.cc:3060] T dbdf895bba214ff68685a24fd17dfb5d P cd75a17ab2604397adab03bb8b5fd75c [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:53.837952  6726 raft_consensus.cc:2468] T b56bf91d90824c959e21e0cee5ba1816 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 9.
I20260709 13:19:53.728598  6730 raft_consensus.cc:2468] T 4275cf08e63345f993bce8664eada830 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 10.
I20260709 13:19:53.728835  6731 consensus_queue.cc:260] T 3fa34c08b205435dba97346991aa1f92 P ccd8a4c3bfe3413cb2ae219b09aea832 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
W20260709 13:19:53.845860  6845 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:53.737039  6770 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 63829.3us
W20260709 13:19:53.842576  6698 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:53.847359  6731 raft_consensus.cc:3060] T 3fa34c08b205435dba97346991aa1f92 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:53.842536  6730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09c2a98de1a4decabd0ff900dd44caa" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 12 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:19:53.856781  6730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a92dd554674067a83a9cb68c4773f2" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
W20260709 13:19:53.860110  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 188190us
I20260709 13:19:53.874414 10314 leader_election.cc:290] T f3f9c2e2bf644115957398fe4c9459db P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 9 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:53.885964  6844 leader_election.cc:304] T 7a734b5ab7834e05a8c422208acc58b1 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
W20260709 13:19:53.896589  6772 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 156746us
I20260709 13:19:53.902736  6730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d65025eea89441290d85dd053810e31" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:19:53.904276  6730 raft_consensus.cc:3060] T 3d65025eea89441290d85dd053810e31 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:53.909790 10409 consensus_queue.cc:1048] T 4275cf08e63345f993bce8664eada830 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:19:53.912504  6803 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50550 (request call id 337) took 1863 ms. Trace:
I20260709 13:19:53.912938 10314 consensus_queue.cc:1048] T d8292e16e5654be6bc408560cf256aaa P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:19:53.914598  6731 raft_consensus.cc:2468] T 3fa34c08b205435dba97346991aa1f92 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 11.
W20260709 13:19:53.915948 10421 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 11 current term: 11 is higher.
I20260709 13:19:53.916988 10006 consensus_queue.cc:1048] T 7887766dc6784fcaa42b35c05fea7a99 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:19:53.913100  6803 rpcz_store.cc:276] 0709 13:19:52.049031 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:52.051104 (+  2073us) service_pool.cc:224] Handling call
0709 13:19:52.058913 (+  7809us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:53.162957 (+1104044us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:53.911831 (+748874us) spinlock_profiling.cc:243] Waited 1.05 s on lock 0x7b54002c74d4. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f9aae01 00007fcc0f9a983e 00007fcc1496e419 00007fcc0dee5bd4 00007fcc0dee5b62 00007fcc0dee5a91 00007fcc0dee5a0c 00007fcc0dee4cc2 00007fcc0dce548c 00007fcc0dce48c6
0709 13:19:53.912289 (+   458us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2410306432}
I20260709 13:19:53.925868 10355 leader_election.cc:290] T dbdf895bba214ff68685a24fd17dfb5d P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 9 election: Requested vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:53.936681  7500 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50744 (request call id 296) took 1708 ms. Trace:
I20260709 13:19:53.937273  7500 rpcz_store.cc:276] 0709 13:19:52.227671 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:52.228068 (+   397us) service_pool.cc:224] Handling call
0709 13:19:52.228595 (+   527us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:53.381032 (+1152437us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:53.935841 (+554809us) spinlock_profiling.cc:243] Waited 1.15 s on lock 0x7b540032c654. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f9aae01 00007fcc0f9a983e 00007fcc1496e419 00007fcc0dee5bd4 00007fcc0dee5b62 00007fcc0dee5a91 00007fcc0dee5a0c 00007fcc0dee4cc2 00007fcc0dce548c 00007fcc0dce48c6
0709 13:19:53.936308 (+   467us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2646634368}
I20260709 13:19:53.938336  6772 leader_election.cc:304] T 427c124d773f483294511e80fe340075 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: ccd8a4c3bfe3413cb2ae219b09aea832
W20260709 13:19:53.941704  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 56920us
I20260709 13:19:53.944876 10439 raft_consensus.cc:2749] T 7a734b5ab7834e05a8c422208acc58b1 P cd75a17ab2604397adab03bb8b5fd75c [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:19:53.945354  6697 leader_election.cc:304] T bb3d8792045a4583ae2e965b1350a5b4 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:19:53.946192  6874 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53416 (request call id 2679) took 1046 ms. Trace:
I20260709 13:19:53.946915 10492 raft_consensus.cc:2804] T 427c124d773f483294511e80fe340075 P b7ab4784c7344b939bc36f639286f377 [term 9 FOLLOWER]: Leader election won for term 9
W20260709 13:19:53.952145  6847 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:53.952641 10492 raft_consensus.cc:697] T 427c124d773f483294511e80fe340075 P b7ab4784c7344b939bc36f639286f377 [term 9 LEADER]: Becoming Leader. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
W20260709 13:19:53.953191  6847 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:53.955039  6847 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:53.948493 10352 raft_consensus.cc:3060] T 3a485a995abc4807b6e511e45419f737 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:53.952172  6874 rpcz_store.cc:276] 0709 13:19:52.899412 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:53.002624 (+103212us) service_pool.cc:224] Handling call
0709 13:19:53.003004 (+   380us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:53.013963 (+ 10959us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:53.013994 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:53.014582 (+   588us) log.cc:844] Serialized 26 byte log entry
0709 13:19:53.147141 (+132559us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:19:53.927311 (+780170us) spinlock_profiling.cc:243] Waited 3.2 ms on lock 0x7b180033fd60. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc15785de1 00007fcc157925b1 00007fcc0f5524bc 00007fcc0c8a048b 00007fcc156faab9 00007fcc0c8bc69b 00007fcc0c8ba93f 00007fcc0c8ba455 00007fcc133a23c7 00007fcc0f9b49a7 00007fcc0f9c40bf
0709 13:19:53.927623 (+   312us) log.cc:844] Serialized 14 byte log entry
0709 13:19:53.945198 (+ 17575us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:53.945370 (+   172us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:53.945456 (+    86us) raft_consensus.cc:1685] finished
0709 13:19:53.945591 (+   135us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:53.945891 (+   300us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":10451,"prepare.queue_time_us":434127,"prepare.run_cpu_time_us":65,"prepare.run_wall_time_us":68,"raft.queue_time_us":11853,"raft.run_cpu_time_us":422,"raft.run_wall_time_us":431,"spinlock_wait_cycles":7353728,"thread_start_us":480960,"threads_started":2,"wal-append.queue_time_us":486059}
I20260709 13:19:53.947288  6731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f9c2e2bf644115957398fe4c9459db" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:19:53.955054 10492 consensus_queue.cc:237] T 427c124d773f483294511e80fe340075 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.6, Last appended by leader: 6, Current term: 9, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } attrs { replace: true } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:19:53.959203 10032 raft_consensus.cc:2749] T bb3d8792045a4583ae2e965b1350a5b4 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:19:53.952069 10249 consensus_queue.cc:260] T 1528ab62b6fe4e3099d08f141afee116 P b7ab4784c7344b939bc36f639286f377 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:19:53.967130 10249 raft_consensus.cc:3060] T 1528ab62b6fe4e3099d08f141afee116 P b7ab4784c7344b939bc36f639286f377 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:19:53.967895 10493 log.cc:927] Time spent T c4db81d9d329422bb3b4160ca4ac2d1d P b7ab4784c7344b939bc36f639286f377: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
I20260709 13:19:53.968469  6729 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:38536 (request call id 20) took 1411 ms. Trace:
I20260709 13:19:53.969596  6729 rpcz_store.cc:276] 0709 13:19:52.556872 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:52.558243 (+  1371us) service_pool.cc:224] Handling call
0709 13:19:53.967922 (+1409679us) spinlock_profiling.cc:243] Waited 468 ms on lock 0x7b5400099cd4. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f9a4853 00007fcc1497260a 00007fcc0def87d4 00007fcc0def8762 00007fcc0def8691 00007fcc0def860c 00007fcc0def78c2 00007fcc0dce548c 00007fcc0dce48c6 00007fcc0dce426f
0709 13:19:53.968129 (+   207us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1075986688}
I20260709 13:19:53.975729 10410 consensus_queue.cc:1048] T d8cee0accdb8499c86d4414b72565a38 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:19:53.977277  6729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90d42e216d9741e190bca19a781291fd" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:19:53.980057  6731 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50004 (request call id 1805) took 1485 ms. Trace:
W20260709 13:19:53.968343 10306 consensus_queue.cc:1175] T 1528ab62b6fe4e3099d08f141afee116 P b7ab4784c7344b939bc36f639286f377 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" responder_term: 9 status { last_received { term: 8 index: 8 } last_committed_idx: 8 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer b7ab4784c7344b939bc36f639286f377 for earlier term 8. Current term is 9. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:19:53.980929 10314 consensus_queue.cc:1059] T bb7fa124c3bf4ef9ab65a407cb008441 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:19:53.981765  6844 leader_election.cc:304] T 713b5728a197487c9300b310ab94e5a3 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:19:53.980636  6731 rpcz_store.cc:276] 0709 13:19:52.494680 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:53.973508 (+1478828us) service_pool.cc:224] Handling call
0709 13:19:53.976535 (+  3027us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:53.978654 (+  2119us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:53.979690 (+  1036us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:53.979762 (+    72us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:19:53.979813 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:53.979867 (+    54us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:53.979963 (+    96us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:53.986032 10436 leader_election.cc:290] T 4d9def8b32fd443aa94ab1420b06837b P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:19:53.989918 10439 raft_consensus.cc:2749] T 713b5728a197487c9300b310ab94e5a3 P cd75a17ab2604397adab03bb8b5fd75c [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:19:53.990706  6728 raft_consensus.cc:1240] T ab432e62819d499eaaf3dd55481dd930 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 11 FOLLOWER]: Rejecting Update request from peer b7ab4784c7344b939bc36f639286f377 for earlier term 10. Current term is 11. Ops: []
I20260709 13:19:53.992151  6844 leader_election.cc:304] T 34f36d59d88f40fe8a2805e604fc6c0a P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:19:53.971908 10006 consensus_queue.cc:1048] T 17587d6730594da4a56fa13a353232a1 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.022s
I20260709 13:19:53.996913  7500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be1a92657f494cac8dd227d152f50151" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb"
W20260709 13:19:53.999917  6845 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:53.998200  6878 raft_consensus.cc:1275] T de3186201e1a40d0b335eeb8b4e256e0 P cd75a17ab2604397adab03bb8b5fd75c [term 10 FOLLOWER]: Refusing update from remote peer b7ab4784c7344b939bc36f639286f377: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:19:53.999644 10303 leader_election.cc:290] T 90d42e216d9741e190bca19a781291fd P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 10 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:53.998481  6873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d65025eea89441290d85dd053810e31" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:19:53.998809 10450 leader_election.cc:290] T f4b8bd455d5a47c18a1380839c6e0d61 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:53.999260  6881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c240553ce044eedb41541d72b9475d7" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:19:54.006675  6799 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:32976 (request call id 2585) took 1102 ms. Trace:
I20260709 13:19:54.007205  6799 rpcz_store.cc:276] 0709 13:19:52.904131 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:52.906517 (+  2386us) service_pool.cc:224] Handling call
0709 13:19:54.006005 (+1099488us) spinlock_profiling.cc:243] Waited 6.28 ms on lock 0x7b54002c79d4. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f9ae2fa 00007fcc1496fb17 00007fcc0deea6d4 00007fcc0deea662 00007fcc0deea591 00007fcc0deea50c 00007fcc0dee97c2 00007fcc0dce548c 00007fcc0dce48c6 00007fcc0dce426f
0709 13:19:54.006383 (+   378us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":14449024}
I20260709 13:19:54.009006  6881 raft_consensus.cc:2393] T 2c240553ce044eedb41541d72b9475d7 P cd75a17ab2604397adab03bb8b5fd75c [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7ab4784c7344b939bc36f639286f377 in current term 11: Already voted for candidate cd75a17ab2604397adab03bb8b5fd75c in this term.
I20260709 13:19:54.007682 10436 raft_consensus.cc:2749] T 34f36d59d88f40fe8a2805e604fc6c0a P cd75a17ab2604397adab03bb8b5fd75c [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:19:53.999850  6872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09c2a98de1a4decabd0ff900dd44caa" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 12 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:19:54.013082  6872 raft_consensus.cc:2468] T f09c2a98de1a4decabd0ff900dd44caa P cd75a17ab2604397adab03bb8b5fd75c [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 11.
I20260709 13:19:54.015163  6728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4b8bd455d5a47c18a1380839c6e0d61" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:19:54.016871  6878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e326172347f45e99a0d482b5d8ef768" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:19:54.018157  6874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3411566abe2d4c9bb4b2adfdd05e6f17" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:19:54.005262  6873 raft_consensus.cc:3060] T 3d65025eea89441290d85dd053810e31 P cd75a17ab2604397adab03bb8b5fd75c [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:54.016942  6729 pending_rounds.cc:85] T 17587d6730594da4a56fa13a353232a1 P ccd8a4c3bfe3413cb2ae219b09aea832: Aborting all ops after (but not including) 8
I20260709 13:19:54.033979  6876 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53416 (request call id 2663) took 1284 ms. Trace:
I20260709 13:19:54.034545  6876 rpcz_store.cc:276] 0709 13:19:52.749631 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:52.895867 (+146236us) service_pool.cc:224] Handling call
0709 13:19:54.020685 (+1124818us) spinlock_profiling.cc:243] Waited 20.1 ms on lock 0x7b54000b3bd4. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f9ae2fa 00007fcc1496fb17 00007fcc0deea6d4 00007fcc0deea662 00007fcc0deea591 00007fcc0deea50c 00007fcc0dee97c2 00007fcc0dce548c 00007fcc0dce48c6 00007fcc0dce426f
0709 13:19:54.033730 (+ 13045us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":46340992}
I20260709 13:19:54.044735  6874 raft_consensus.cc:3060] T 3411566abe2d4c9bb4b2adfdd05e6f17 P cd75a17ab2604397adab03bb8b5fd75c [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:54.047592 10006 consensus_queue.cc:1059] T ab432e62819d499eaaf3dd55481dd930 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: INVALID_TERM, Last received: 10.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:19:54.048594  6878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d9def8b32fd443aa94ab1420b06837b" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:19:54.049436 10006 raft_consensus.cc:3055] T ab432e62819d499eaaf3dd55481dd930 P b7ab4784c7344b939bc36f639286f377 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:19:54.049782  6878 raft_consensus.cc:3060] T 4d9def8b32fd443aa94ab1420b06837b P cd75a17ab2604397adab03bb8b5fd75c [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:54.050122 10006 raft_consensus.cc:740] T ab432e62819d499eaaf3dd55481dd930 P b7ab4784c7344b939bc36f639286f377 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
I20260709 13:19:54.051795 10006 consensus_queue.cc:260] T ab432e62819d499eaaf3dd55481dd930 P b7ab4784c7344b939bc36f639286f377 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 5, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:54.044742  6697 leader_election.cc:304] T fe20b4b48823486ca3b9c648db6ce8aa P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:19:54.053519 10006 raft_consensus.cc:3060] T ab432e62819d499eaaf3dd55481dd930 P b7ab4784c7344b939bc36f639286f377 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:54.053584  6872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c44c4849aa54f2b94d1f1bef9ed546f" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:19:54.054983 10385 raft_consensus.cc:493] T 1528ab62b6fe4e3099d08f141afee116 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:54.055650 10385 raft_consensus.cc:515] T 1528ab62b6fe4e3099d08f141afee116 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:19:54.056473 10366 raft_consensus.cc:2749] T fe20b4b48823486ca3b9c648db6ce8aa P ccd8a4c3bfe3413cb2ae219b09aea832 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:19:54.058646 10385 leader_election.cc:290] T 1528ab62b6fe4e3099d08f141afee116 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:19:54.026185  6729 pending_rounds.cc:107] T 17587d6730594da4a56fa13a353232a1 P ccd8a4c3bfe3413cb2ae219b09aea832: Aborting uncommitted NO_OP operation due to leader change: 12.9
I20260709 13:19:54.054818  6872 raft_consensus.cc:3060] T 7c44c4849aa54f2b94d1f1bef9ed546f P cd75a17ab2604397adab03bb8b5fd75c [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:54.065423  9836 raft_consensus.cc:3055] T bb7fa124c3bf4ef9ab65a407cb008441 P b7ab4784c7344b939bc36f639286f377 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:19:54.066059  9836 raft_consensus.cc:740] T bb7fa124c3bf4ef9ab65a407cb008441 P b7ab4784c7344b939bc36f639286f377 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
I20260709 13:19:54.069015 10385 consensus_queue.cc:1059] T be1a92657f494cac8dd227d152f50151 P 7ba59cc884714e8aa5f3f0ecaed84cbb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:19:54.069660  6697 leader_election.cc:304] T be1a92657f494cac8dd227d152f50151 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, b7ab4784c7344b939bc36f639286f377
I20260709 13:19:54.071121 10437 raft_consensus.cc:3055] T be1a92657f494cac8dd227d152f50151 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:19:54.071676 10437 raft_consensus.cc:740] T be1a92657f494cac8dd227d152f50151 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 7ba59cc884714e8aa5f3f0ecaed84cbb, State: Running, Role: LEADER
W20260709 13:19:54.072682  6698 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:54.074378  6730 raft_consensus.cc:2468] T 3d65025eea89441290d85dd053810e31 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 9.
I20260709 13:19:54.061067  6729 raft_consensus.cc:2889] T 17587d6730594da4a56fa13a353232a1 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:19:54.075138  6730 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50004 (request call id 1806) took 1092 ms. Trace:
I20260709 13:19:54.077924  6730 rpcz_store.cc:276] 0709 13:19:52.982472 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:53.901920 (+919448us) service_pool.cc:224] Handling call
0709 13:19:54.075062 (+173142us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:54.081884 10240 raft_consensus.cc:493] T ce4f062dcd314d43a63ca74067cb5ee3 P b7ab4784c7344b939bc36f639286f377 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:54.082954 10240 raft_consensus.cc:515] T ce4f062dcd314d43a63ca74067cb5ee3 P b7ab4784c7344b939bc36f639286f377 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } attrs { replace: true } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:19:54.085598 10240 leader_election.cc:290] T ce4f062dcd314d43a63ca74067cb5ee3 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
W20260709 13:19:54.090204  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 98288.3us
W20260709 13:19:54.092414  6696 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:54.091586  6844 leader_election.cc:304] T de3186201e1a40d0b335eeb8b4e256e0 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:19:54.067623  9836 consensus_queue.cc:260] T bb7fa124c3bf4ef9ab65a407cb008441 P b7ab4784c7344b939bc36f639286f377 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:19:54.104748  6873 raft_consensus.cc:2410] T 3d65025eea89441290d85dd053810e31 P cd75a17ab2604397adab03bb8b5fd75c [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate b7ab4784c7344b939bc36f639286f377 for term 9 because replica has last-logged OpId of term: 7 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 3.
I20260709 13:19:54.073397 10437 consensus_queue.cc:260] T be1a92657f494cac8dd227d152f50151 P 7ba59cc884714e8aa5f3f0ecaed84cbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:19:54.110451  6876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3022224cc81473690653a83d4e99470" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:19:54.111580  6876 raft_consensus.cc:2468] T a3022224cc81473690653a83d4e99470 P cd75a17ab2604397adab03bb8b5fd75c [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 10.
I20260709 13:19:54.111634 10437 raft_consensus.cc:3060] T be1a92657f494cac8dd227d152f50151 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:54.112999  6876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbdf895bba214ff68685a24fd17dfb5d" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:19:54.114287 10237 raft_consensus.cc:2749] T be1a92657f494cac8dd227d152f50151 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:19:54.114497  6880 raft_consensus.cc:1275] T 44bde925b2e541b69890d70715b85176 P cd75a17ab2604397adab03bb8b5fd75c [term 10 FOLLOWER]: Refusing update from remote peer b7ab4784c7344b939bc36f639286f377: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:19:54.115795 10442 raft_consensus.cc:2749] T de3186201e1a40d0b335eeb8b4e256e0 P cd75a17ab2604397adab03bb8b5fd75c [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:19:54.116155 10252 raft_consensus.cc:3055] T c4db81d9d329422bb3b4160ca4ac2d1d P ccd8a4c3bfe3413cb2ae219b09aea832 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:19:54.116762 10252 raft_consensus.cc:740] T c4db81d9d329422bb3b4160ca4ac2d1d P ccd8a4c3bfe3413cb2ae219b09aea832 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
I20260709 13:19:54.118410 10252 consensus_queue.cc:260] T c4db81d9d329422bb3b4160ca4ac2d1d P ccd8a4c3bfe3413cb2ae219b09aea832 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:54.122527  6876 raft_consensus.cc:3060] T dbdf895bba214ff68685a24fd17dfb5d P cd75a17ab2604397adab03bb8b5fd75c [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:54.122561  7500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3f13b31a1f84f0d89d007eadd57924c" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb"
I20260709 13:19:54.123425  6770 leader_election.cc:304] T 3d65025eea89441290d85dd053810e31 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
I20260709 13:19:54.105098  9836 raft_consensus.cc:3060] T bb7fa124c3bf4ef9ab65a407cb008441 P b7ab4784c7344b939bc36f639286f377 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:54.128819 10385 raft_consensus.cc:493] T 427c124d773f483294511e80fe340075 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:54.130146  7468 leader_election.cc:336] T fe20b4b48823486ca3b9c648db6ce8aa P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931): Timed out: RequestConsensusVote RPC to 127.5.126.67:42931 timed out after 2.676s (SENT)
I20260709 13:19:54.132135 10464 raft_consensus.cc:493] T 1528ab62b6fe4e3099d08f141afee116 P b7ab4784c7344b939bc36f639286f377 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:54.132829 10464 raft_consensus.cc:515] T 1528ab62b6fe4e3099d08f141afee116 P b7ab4784c7344b939bc36f639286f377 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
W20260709 13:19:54.138291  6724 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50004 (request call id 1786) took 1716 ms (client timeout 2219 ms). Trace:
W20260709 13:19:54.138831  6724 rpcz_store.cc:269] 0709 13:19:52.421664 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:52.421837 (+   173us) service_pool.cc:224] Handling call
0709 13:19:54.137731 (+1715894us) spinlock_profiling.cc:243] Waited 946 ms on lock 0x7b54003d4d54. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f9ae2fa 00007fcc1496fb17 00007fcc0deea6d4 00007fcc0deea662 00007fcc0deea591 00007fcc0deea50c 00007fcc0dee97c2 00007fcc0dce548c 00007fcc0dce48c6 00007fcc0dce426f
0709 13:19:54.138057 (+   326us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2176226560}
I20260709 13:19:54.129741 10385 raft_consensus.cc:515] T 427c124d773f483294511e80fe340075 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } attrs { replace: true } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:19:54.144804  6874 raft_consensus.cc:2468] T 3411566abe2d4c9bb4b2adfdd05e6f17 P cd75a17ab2604397adab03bb8b5fd75c [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 8.
I20260709 13:19:54.163230  6873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a92dd554674067a83a9cb68c4773f2" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:19:54.164214  6873 raft_consensus.cc:2468] T 07a92dd554674067a83a9cb68c4773f2 P cd75a17ab2604397adab03bb8b5fd75c [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 9.
W20260709 13:19:54.160964  6770 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 74566us
I20260709 13:19:54.167480  6874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b56bf91d90824c959e21e0cee5ba1816" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:19:54.166493  6724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1528ab62b6fe4e3099d08f141afee116" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:19:54.170780 10464 leader_election.cc:290] T 1528ab62b6fe4e3099d08f141afee116 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:19:54.182257 10367 raft_consensus.cc:493] T 17587d6730594da4a56fa13a353232a1 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:19:54.183039 10367 raft_consensus.cc:515] T 17587d6730594da4a56fa13a353232a1 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:19:54.183971  6877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f9c2e2bf644115957398fe4c9459db" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:19:54.184397  6723 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50004 (request call id 1796) took 1736 ms. Trace:
I20260709 13:19:54.184990  6723 rpcz_store.cc:276] 0709 13:19:52.447553 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:52.449775 (+  2222us) service_pool.cc:224] Handling call
0709 13:19:52.450096 (+   321us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:53.335067 (+884971us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:54.183756 (+848689us) spinlock_profiling.cc:243] Waited 843 ms on lock 0x7b5400056c54. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f9aae01 00007fcc0f9a983e 00007fcc1496e419 00007fcc0dee5bd4 00007fcc0dee5b62 00007fcc0dee5a91 00007fcc0dee5a0c 00007fcc0dee4cc2 00007fcc0dce548c 00007fcc0dce48c6
0709 13:19:54.184115 (+   359us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1939961600}
I20260709 13:19:54.186522  6723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17587d6730594da4a56fa13a353232a1" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 14 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:19:54.187033 10367 leader_election.cc:290] T 17587d6730594da4a56fa13a353232a1 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:19:54.174301  6880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "853ac0a8cbd64ce99457f170216d4d0f" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:19:54.191138  7500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f00a2e87e56452083b759f60d461ee3" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb"
I20260709 13:19:54.179738  6770 leader_election.cc:400] T 20f6842e26174571996b8dea4151d4be P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 10 election: Vote denied by peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391) with higher term. Message: Invalid argument: T 20f6842e26174571996b8dea4151d4be P ccd8a4c3bfe3413cb2ae219b09aea832 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate b7ab4784c7344b939bc36f639286f377 for earlier term 10. Current term is 11.
I20260709 13:19:54.172513 10252 raft_consensus.cc:3060] T c4db81d9d329422bb3b4160ca4ac2d1d P ccd8a4c3bfe3413cb2ae219b09aea832 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:54.193516  6770 leader_election.cc:403] T 20f6842e26174571996b8dea4151d4be P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 10 election: Cancelling election due to peer responding with higher term
I20260709 13:19:54.194193  6874 raft_consensus.cc:2393] T b56bf91d90824c959e21e0cee5ba1816 P cd75a17ab2604397adab03bb8b5fd75c [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7ab4784c7344b939bc36f639286f377 in current term 9: Already voted for candidate cd75a17ab2604397adab03bb8b5fd75c in this term.
I20260709 13:19:54.187841  6723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce4f062dcd314d43a63ca74067cb5ee3" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:19:54.184943  6877 raft_consensus.cc:3060] T f3f9c2e2bf644115957398fe4c9459db P cd75a17ab2604397adab03bb8b5fd75c [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:54.178730 10249 raft_consensus.cc:2804] T 3d65025eea89441290d85dd053810e31 P b7ab4784c7344b939bc36f639286f377 [term 9 FOLLOWER]: Leader election won for term 9
W20260709 13:19:54.202098  7468 leader_election.cc:336] T 7ba5dac66ab5497e9e336f2a3c28cda5 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931): Timed out: RequestConsensusVote RPC to 127.5.126.67:42931 timed out after 2.835s (SENT)
I20260709 13:19:54.204537  6697 leader_election.cc:304] T 404190ce4ce94cecbfcb6ea9d1dd8626 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, b7ab4784c7344b939bc36f639286f377
I20260709 13:19:54.204905  7468 leader_election.cc:304] T 7ba5dac66ab5497e9e336f2a3c28cda5 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:19:54.210259  6724 raft_consensus.cc:2468] T 1528ab62b6fe4e3099d08f141afee116 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in term 9.
I20260709 13:19:54.211110 10375 raft_consensus.cc:2749] T 7ba5dac66ab5497e9e336f2a3c28cda5 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:19:54.211630  6724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34f36d59d88f40fe8a2805e604fc6c0a" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
W20260709 13:19:54.220541  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 129202us
I20260709 13:19:54.234882  6876 raft_consensus.cc:2410] T dbdf895bba214ff68685a24fd17dfb5d P cd75a17ab2604397adab03bb8b5fd75c [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate b7ab4784c7344b939bc36f639286f377 for term 9 because replica has last-logged OpId of term: 7 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 3.
I20260709 13:19:54.228228 10249 raft_consensus.cc:697] T 3d65025eea89441290d85dd053810e31 P b7ab4784c7344b939bc36f639286f377 [term 9 LEADER]: Becoming Leader. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
I20260709 13:19:54.247414  7500 raft_consensus.cc:1240] T fe20b4b48823486ca3b9c648db6ce8aa P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 8 LEADER]: Rejecting Update request from peer cd75a17ab2604397adab03bb8b5fd75c for earlier term 7. Current term is 8. Ops: []
W20260709 13:19:54.248919  6697 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.68:45071, user_credentials={real_user=slave}} blocked reactor thread for 74692.8us
I20260709 13:19:54.249753  7466 leader_election.cc:304] T 1528ab62b6fe4e3099d08f141afee116 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
I20260709 13:19:54.246052  6844 leader_election.cc:304] T bd6869f07b5a4885a0b99fbe60c3b175 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:19:54.263607  6723 raft_consensus.cc:3060] T ce4f062dcd314d43a63ca74067cb5ee3 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:19:54.264626  7467 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:54.264761 10063 consensus_meta.cc:287] T 713b5728a197487c9300b310ab94e5a3 P b7ab4784c7344b939bc36f639286f377: Time spent flushing consensus metadata: real 1.102s	user 0.013s	sys 0.013s
I20260709 13:19:54.266317  6805 raft_consensus.cc:1275] T 713b5728a197487c9300b310ab94e5a3 P b7ab4784c7344b939bc36f639286f377 [term 10 FOLLOWER]: Refusing update from remote peer ccd8a4c3bfe3413cb2ae219b09aea832: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:19:54.260347 10367 raft_consensus.cc:2749] T 404190ce4ce94cecbfcb6ea9d1dd8626 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:19:54.272027  7500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3f13b31a1f84f0d89d007eadd57924c" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb"
I20260709 13:19:54.272550  6724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce4f062dcd314d43a63ca74067cb5ee3" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:19:54.274525  6878 raft_consensus.cc:2410] T 4d9def8b32fd443aa94ab1420b06837b P cd75a17ab2604397adab03bb8b5fd75c [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate b7ab4784c7344b939bc36f639286f377 for term 10 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 4.
W20260709 13:19:54.266403  7503 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50744 (request call id 299) took 1912 ms (client timeout 2052 ms). Trace:
I20260709 13:19:54.280323  6729 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50004 (request call id 1817) took 1224 ms. Trace:
I20260709 13:19:54.284192 10445 raft_consensus.cc:2804] T 1528ab62b6fe4e3099d08f141afee116 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:19:54.284916 10445 raft_consensus.cc:493] T 1528ab62b6fe4e3099d08f141afee116 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:54.285365 10445 raft_consensus.cc:3060] T 1528ab62b6fe4e3099d08f141afee116 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:54.287024  6878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de3186201e1a40d0b335eeb8b4e256e0" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:19:54.288131  6878 raft_consensus.cc:2468] T de3186201e1a40d0b335eeb8b4e256e0 P cd75a17ab2604397adab03bb8b5fd75c [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 10.
I20260709 13:19:54.289997  6878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d9def8b32fd443aa94ab1420b06837b" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:19:54.263733 10464 raft_consensus.cc:3060] T 20f6842e26174571996b8dea4151d4be P b7ab4784c7344b939bc36f639286f377 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:54.291390  6878 raft_consensus.cc:2410] T 4d9def8b32fd443aa94ab1420b06837b P cd75a17ab2604397adab03bb8b5fd75c [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate ccd8a4c3bfe3413cb2ae219b09aea832 for term 10 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 4.
I20260709 13:19:54.293645  9890 raft_consensus.cc:3055] T 427c124d773f483294511e80fe340075 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:19:54.294327  9890 raft_consensus.cc:740] T 427c124d773f483294511e80fe340075 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
I20260709 13:19:54.296195  6878 raft_consensus.cc:1240] T bd6869f07b5a4885a0b99fbe60c3b175 P cd75a17ab2604397adab03bb8b5fd75c [term 10 FOLLOWER]: Rejecting Update request from peer ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 9. Current term is 10. Ops: []
W20260709 13:19:54.298803  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 61935.9us
I20260709 13:19:54.299752  6844 leader_election.cc:304] T b56bf91d90824c959e21e0cee5ba1816 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
W20260709 13:19:54.299851  6725 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49998 (request call id 911) took 3153 ms (client timeout 1708 ms). Trace:
W20260709 13:19:54.279908  7503 rpcz_store.cc:269] 0709 13:19:52.354208 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:52.356316 (+  2108us) service_pool.cc:224] Handling call
0709 13:19:54.242196 (+1885880us) spinlock_profiling.cc:243] Waited 994 ms on lock 0x7b540046fad4. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f9ae2fa 00007fcc1496fb17 00007fcc0deea6d4 00007fcc0deea662 00007fcc0deea591 00007fcc0deea50c 00007fcc0dee97c2 00007fcc0dce548c 00007fcc0dce48c6 00007fcc0dce426f
0709 13:19:54.266089 (+ 23893us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2286580480}
W20260709 13:19:54.300522  6725 rpcz_store.cc:269] 0709 13:19:51.146306 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:51.170488 (+ 24182us) service_pool.cc:224] Handling call
0709 13:19:54.299358 (+3128870us) spinlock_profiling.cc:243] Waited 1.39 s on lock 0x7b5400057154. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f9ae2fa 00007fcc1496fb17 00007fcc0deea6d4 00007fcc0deea662 00007fcc0deea591 00007fcc0deea50c 00007fcc0dee97c2 00007fcc0dce548c 00007fcc0dce48c6 00007fcc0dce426f
0709 13:19:54.299576 (+   218us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3205477760}
I20260709 13:19:54.301712 10435 raft_consensus.cc:2804] T bd6869f07b5a4885a0b99fbe60c3b175 P cd75a17ab2604397adab03bb8b5fd75c [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:19:54.301883 10442 raft_consensus.cc:2749] T b56bf91d90824c959e21e0cee5ba1816 P cd75a17ab2604397adab03bb8b5fd75c [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:19:54.302562 10435 raft_consensus.cc:697] T bd6869f07b5a4885a0b99fbe60c3b175 P cd75a17ab2604397adab03bb8b5fd75c [term 10 LEADER]: Becoming Leader. State: Replica: cd75a17ab2604397adab03bb8b5fd75c, State: Running, Role: LEADER
I20260709 13:19:54.302647  6725 raft_consensus.cc:1275] T 7c37d41cd9164c15a6826ca62a851a69 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 8 FOLLOWER]: Refusing update from remote peer b7ab4784c7344b939bc36f639286f377: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:19:54.305677  6731 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50004 (request call id 1819) took 1252 ms. Trace:
I20260709 13:19:54.303803 10435 consensus_queue.cc:237] T bd6869f07b5a4885a0b99fbe60c3b175 P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 9.4, Last appended by leader: 4, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:54.306154  6731 rpcz_store.cc:276] 0709 13:19:53.052932 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:54.016927 (+963995us) service_pool.cc:224] Handling call
0709 13:19:54.020648 (+  3721us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:54.065010 (+ 44362us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:19:54.148701 (+ 83691us) log.cc:844] Serialized 14 byte log entry
0709 13:19:54.181169 (+ 32468us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:54.230228 (+ 49059us) log.cc:844] Serialized 26 byte log entry
0709 13:19:54.230418 (+   190us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:19:54.230451 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:54.230535 (+    84us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:54.305470 (+ 74935us) raft_consensus.cc:1685] finished
0709 13:19:54.305490 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:54.305613 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":29275,"prepare.queue_time_us":14021,"prepare.run_cpu_time_us":60,"prepare.run_wall_time_us":60,"raft.queue_time_us":9580,"raft.run_cpu_time_us":363,"raft.run_wall_time_us":16103,"spinlock_wait_cycles":25856,"thread_start_us":92655,"threads_started":2,"wal-append.queue_time_us":106758}
I20260709 13:19:54.308462  6844 leader_election.cc:304] T 7887766dc6784fcaa42b35c05fea7a99 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:19:54.311388 10387 consensus_queue.cc:1059] T fe20b4b48823486ca3b9c648db6ce8aa P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:19:54.313318  6872 raft_consensus.cc:2468] T 7c44c4849aa54f2b94d1f1bef9ed546f P cd75a17ab2604397adab03bb8b5fd75c [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 12.
I20260709 13:19:54.282876  6729 rpcz_store.cc:276] 0709 13:19:53.052375 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:54.007250 (+954875us) service_pool.cc:224] Handling call
0709 13:19:54.016483 (+  9233us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:19:54.127406 (+110923us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:54.127442 (+    36us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:19:54.128990 (+  1548us) log.cc:844] Serialized 52 byte log entry
0709 13:19:54.171810 (+ 42820us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:19:54.171853 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:54.171953 (+   100us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:54.276892 (+104939us) raft_consensus.cc:1685] finished
0709 13:19:54.276914 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:54.277092 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":11870,"raft.queue_time_us":21296,"raft.run_cpu_time_us":117,"raft.run_wall_time_us":118,"thread_start_us":42321,"threads_started":1,"wal-append.queue_time_us":75756}
W20260709 13:19:54.322468  6770 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 147090us
I20260709 13:19:54.323033 10486 raft_consensus.cc:493] T 713b5728a197487c9300b310ab94e5a3 P b7ab4784c7344b939bc36f639286f377 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:54.323354  7498 raft_consensus.cc:1275] T 3fa34c08b205435dba97346991aa1f92 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 11 FOLLOWER]: Refusing update from remote peer cd75a17ab2604397adab03bb8b5fd75c: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:19:54.323678 10486 raft_consensus.cc:515] T 713b5728a197487c9300b310ab94e5a3 P b7ab4784c7344b939bc36f639286f377 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:54.325989 10446 consensus_queue.cc:1059] T e77e330a82df4b43a745d57a68f6f057 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: INVALID_TERM, Last received: 11.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:19:54.326534  6872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24ee15416e3145beaa1b8183453729a3" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:19:54.327196 10446 raft_consensus.cc:3055] T e77e330a82df4b43a745d57a68f6f057 P b7ab4784c7344b939bc36f639286f377 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:19:54.327721  6872 raft_consensus.cc:3060] T 24ee15416e3145beaa1b8183453729a3 P cd75a17ab2604397adab03bb8b5fd75c [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:54.329276  7500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1528ab62b6fe4e3099d08f141afee116" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb"
I20260709 13:19:54.331058  6772 leader_election.cc:304] T 9e326172347f45e99a0d482b5d8ef768 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:19:54.327792 10486 leader_election.cc:290] T 713b5728a197487c9300b310ab94e5a3 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:54.327725 10446 raft_consensus.cc:740] T e77e330a82df4b43a745d57a68f6f057 P b7ab4784c7344b939bc36f639286f377 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
I20260709 13:19:54.331667 10240 consensus_queue.cc:1048] T de3186201e1a40d0b335eeb8b4e256e0 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:19:54.332876  6772 leader_election.cc:304] T 2c240553ce044eedb41541d72b9475d7 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:19:54.336117  7503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce4f062dcd314d43a63ca74067cb5ee3" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb"
I20260709 13:19:54.337862 10486 raft_consensus.cc:2749] T 9e326172347f45e99a0d482b5d8ef768 P b7ab4784c7344b939bc36f639286f377 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:19:54.333400 10446 consensus_queue.cc:260] T e77e330a82df4b43a745d57a68f6f057 P b7ab4784c7344b939bc36f639286f377 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.5, Last appended by leader: 5, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } }
I20260709 13:19:54.343986  6872 raft_consensus.cc:2468] T 24ee15416e3145beaa1b8183453729a3 P cd75a17ab2604397adab03bb8b5fd75c [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 10.
I20260709 13:19:54.347160  6804 raft_consensus.cc:1240] T f3f9c2e2bf644115957398fe4c9459db P b7ab4784c7344b939bc36f639286f377 [term 9 FOLLOWER]: Rejecting Update request from peer ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 8. Current term is 9. Ops: []
I20260709 13:19:54.358830  7503 raft_consensus.cc:2368] T ce4f062dcd314d43a63ca74067cb5ee3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 9. Current term is 10.
I20260709 13:19:54.362317  6803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77e330a82df4b43a745d57a68f6f057" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:19:54.363617  7498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24ee15416e3145beaa1b8183453729a3" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb"
I20260709 13:19:54.363875 10437 raft_consensus.cc:493] T 404190ce4ce94cecbfcb6ea9d1dd8626 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:54.364421  7498 raft_consensus.cc:3060] T 24ee15416e3145beaa1b8183453729a3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:54.364686 10437 raft_consensus.cc:515] T 404190ce4ce94cecbfcb6ea9d1dd8626 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:19:54.368432 10486 raft_consensus.cc:3060] T 2c240553ce044eedb41541d72b9475d7 P b7ab4784c7344b939bc36f639286f377 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:54.334066 10387 consensus_queue.cc:1243] T fe20b4b48823486ca3b9c648db6ce8aa P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Peer 7ba59cc884714e8aa5f3f0ecaed84cbb log is divergent from this leader: its last log entry 8.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 13:19:54.367646 10437 leader_election.cc:290] T 404190ce4ce94cecbfcb6ea9d1dd8626 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
W20260709 13:19:54.364408  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 63241.3us
I20260709 13:19:54.372543  6726 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50004 (request call id 1808) took 1369 ms. Trace:
I20260709 13:19:54.361771  6877 raft_consensus.cc:2468] T f3f9c2e2bf644115957398fe4c9459db P cd75a17ab2604397adab03bb8b5fd75c [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 9.
W20260709 13:19:54.382301  6698 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:54.383739  6725 raft_consensus.cc:1275] T 44bde925b2e541b69890d70715b85176 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 10 FOLLOWER]: Refusing update from remote peer b7ab4784c7344b939bc36f639286f377: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:19:54.373584  6728 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50004 (request call id 1821) took 1212 ms. Trace:
I20260709 13:19:54.377065  6878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a75bfe094d4bdc963aba3f08dfcd25" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 11 candidate_status { last_received { term: 10 index: 4 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:19:54.349849 10446 raft_consensus.cc:3060] T e77e330a82df4b43a745d57a68f6f057 P b7ab4784c7344b939bc36f639286f377 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:54.382164  6726 rpcz_store.cc:276] 0709 13:19:52.983084 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:53.674715 (+691631us) service_pool.cc:224] Handling call
0709 13:19:54.340935 (+666220us) spinlock_profiling.cc:243] Waited 161 ms on lock 0x7b54003d5754. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f9ae2fa 00007fcc1496fb17 00007fcc0deea6d4 00007fcc0deea662 00007fcc0deea591 00007fcc0deea50c 00007fcc0dee97c2 00007fcc0dce548c 00007fcc0dce48c6 00007fcc0dce426f
0709 13:19:54.352661 (+ 11726us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":370667776}
I20260709 13:19:54.296731 10249 consensus_queue.cc:237] T 3d65025eea89441290d85dd053810e31 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:54.359288 10464 raft_consensus.cc:2749] T 20f6842e26174571996b8dea4151d4be P b7ab4784c7344b939bc36f639286f377 [term 11 FOLLOWER]: Leader election lost for term 10. Reason: Vote denied by peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391) with higher term. Message: Invalid argument: T 20f6842e26174571996b8dea4151d4be P ccd8a4c3bfe3413cb2ae219b09aea832 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate b7ab4784c7344b939bc36f639286f377 for earlier term 10. Current term is 11.
I20260709 13:19:54.392241 10275 consensus_queue.cc:1048] T 3fa34c08b205435dba97346991aa1f92 P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.017s
I20260709 13:19:54.400502  6726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "427c124d773f483294511e80fe340075" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 10 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:19:54.400866  6806 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:32976 (request call id 2582) took 1503 ms. Trace:
I20260709 13:19:54.401599  6806 rpcz_store.cc:276] 0709 13:19:52.896854 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:52.899066 (+  2212us) service_pool.cc:224] Handling call
0709 13:19:52.899455 (+   389us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:53.279988 (+380533us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:54.400139 (+1120151us) spinlock_profiling.cc:243] Waited 252 ms on lock 0x7b54001b53d4. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f9aae01 00007fcc0f9a983e 00007fcc1496e419 00007fcc0dee5bd4 00007fcc0dee5b62 00007fcc0dee5a91 00007fcc0dee5a0c 00007fcc0dee4cc2 00007fcc0dce548c 00007fcc0dce48c6
0709 13:19:54.400575 (+   436us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":580666240}
I20260709 13:19:54.402802  6731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "404190ce4ce94cecbfcb6ea9d1dd8626" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:19:54.404244  6844 leader_election.cc:304] T a3022224cc81473690653a83d4e99470 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:19:54.404963  6874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77e330a82df4b43a745d57a68f6f057" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:19:54.405495  6732 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50004 (request call id 1811) took 1361 ms. Trace:
I20260709 13:19:54.405906  6874 raft_consensus.cc:3060] T e77e330a82df4b43a745d57a68f6f057 P cd75a17ab2604397adab03bb8b5fd75c [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:54.411986  6872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "711ef6523deb4cbe8ef2ba61e1c21c98" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:19:54.406073  6732 rpcz_store.cc:276] 0709 13:19:52.983935 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:53.981139 (+997204us) service_pool.cc:224] Handling call
0709 13:19:53.981799 (+   660us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:53.982510 (+   711us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:19:54.077264 (+ 94754us) log.cc:844] Serialized 14 byte log entry
0709 13:19:54.181055 (+103791us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:54.298641 (+117586us) spinlock_profiling.cc:243] Waited 11.5 ms on lock 0x7b180041e120. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc15785de1 00007fcc157925b1 00007fcc0c88b2a6 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0e2a3a11 00007fcc0e2b3372 00007fcc0f9e5a01 00007fcc0f9aa43a
0709 13:19:54.309793 (+ 11152us) log.cc:844] Serialized 26 byte log entry
0709 13:19:54.310145 (+   352us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:19:54.310219 (+    74us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:54.310326 (+   107us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:54.341359 (+ 31033us) raft_consensus.cc:1685] finished
0709 13:19:54.345421 (+  4062us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:54.345581 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3943,"prepare.queue_time_us":95994,"prepare.run_cpu_time_us":107,"prepare.run_wall_time_us":112,"raft.queue_time_us":8836,"raft.run_cpu_time_us":306,"raft.run_wall_time_us":307,"spinlock_wait_cycles":26534144,"thread_start_us":170022,"threads_started":2,"wal-append.queue_time_us":155349}
I20260709 13:19:54.415066  6804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "711ef6523deb4cbe8ef2ba61e1c21c98" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:19:54.386816 10385 leader_election.cc:290] T 427c124d773f483294511e80fe340075 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
W20260709 13:19:54.426594  6847 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:54.421028  7498 raft_consensus.cc:2468] T 24ee15416e3145beaa1b8183453729a3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 10.
I20260709 13:19:54.421433  6877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20f6842e26174571996b8dea4151d4be" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:19:54.385188  6728 rpcz_store.cc:276] 0709 13:19:53.161207 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:54.027778 (+866571us) service_pool.cc:224] Handling call
0709 13:19:54.124761 (+ 96983us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:54.180353 (+ 55592us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:54.180384 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:54.182438 (+  2054us) log.cc:844] Serialized 26 byte log entry
0709 13:19:54.241934 (+ 59496us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:19:54.241977 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:54.242054 (+    77us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:54.373258 (+131204us) raft_consensus.cc:1685] finished
0709 13:19:54.373294 (+    36us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:54.373488 (+   194us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":798,"raft.queue_time_us":7430,"raft.run_cpu_time_us":180,"raft.run_wall_time_us":180,"thread_start_us":59058,"threads_started":1,"wal-append.queue_time_us":153235}
I20260709 13:19:54.406342  6844 leader_election.cc:304] T 07a92dd554674067a83a9cb68c4773f2 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:19:54.295890  9890 consensus_queue.cc:260] T 427c124d773f483294511e80fe340075 P ccd8a4c3bfe3413cb2ae219b09aea832 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } attrs { replace: true } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:19:54.414841 10275 raft_consensus.cc:2749] T a3022224cc81473690653a83d4e99470 P cd75a17ab2604397adab03bb8b5fd75c [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:19:54.423815  7503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17587d6730594da4a56fa13a353232a1" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
W20260709 13:19:54.433382  6847 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:54.436419  6847 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:54.436560  6729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1528ab62b6fe4e3099d08f141afee116" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:19:54.437467  6729 raft_consensus.cc:2468] T 1528ab62b6fe4e3099d08f141afee116 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 9.
I20260709 13:19:54.440992  6799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17587d6730594da4a56fa13a353232a1" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 14 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:19:54.422142 10421 raft_consensus.cc:493] T 44bde925b2e541b69890d70715b85176 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:54.445837  6878 raft_consensus.cc:2468] T 95a75bfe094d4bdc963aba3f08dfcd25 P cd75a17ab2604397adab03bb8b5fd75c [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 10.
I20260709 13:19:54.443285  6806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f03d0dbf16864ca4bc1bb5e4c0334c0f" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:19:54.448124  6877 raft_consensus.cc:3060] T 20f6842e26174571996b8dea4151d4be P cd75a17ab2604397adab03bb8b5fd75c [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:54.452165  6732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "713b5728a197487c9300b310ab94e5a3" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
W20260709 13:19:54.455353  6772 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 122579us
I20260709 13:19:54.452814  6872 raft_consensus.cc:2468] T 711ef6523deb4cbe8ef2ba61e1c21c98 P cd75a17ab2604397adab03bb8b5fd75c [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 10.
I20260709 13:19:54.422794 10437 consensus_queue.cc:1059] T b3f13b31a1f84f0d89d007eadd57924c P 7ba59cc884714e8aa5f3f0ecaed84cbb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.032s
I20260709 13:19:54.459254  6772 leader_election.cc:304] T f09c2a98de1a4decabd0ff900dd44caa P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:19:54.461781  6844 leader_election.cc:304] T f3f9c2e2bf644115957398fe4c9459db P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:19:54.448836 10387 raft_consensus.cc:2804] T 07a92dd554674067a83a9cb68c4773f2 P cd75a17ab2604397adab03bb8b5fd75c [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:19:54.460121  7503 raft_consensus.cc:2468] T 17587d6730594da4a56fa13a353232a1 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 13.
I20260709 13:19:54.477726  6798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1528ab62b6fe4e3099d08f141afee116" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:19:54.479120  7466 leader_election.cc:304] T 17587d6730594da4a56fa13a353232a1 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:19:54.478682  6798 raft_consensus.cc:2468] T 1528ab62b6fe4e3099d08f141afee116 P b7ab4784c7344b939bc36f639286f377 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in term 9.
I20260709 13:19:54.483752  6800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20f6842e26174571996b8dea4151d4be" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:19:54.487095  6807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce4f062dcd314d43a63ca74067cb5ee3" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:19:54.487946  6807 raft_consensus.cc:3060] T ce4f062dcd314d43a63ca74067cb5ee3 P b7ab4784c7344b939bc36f639286f377 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:54.496696  6732 raft_consensus.cc:1240] T b3f13b31a1f84f0d89d007eadd57924c P ccd8a4c3bfe3413cb2ae219b09aea832 [term 8 FOLLOWER]: Rejecting Update request from peer 7ba59cc884714e8aa5f3f0ecaed84cbb for earlier term 7. Current term is 8. Ops: []
I20260709 13:19:54.497742  6878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f03d0dbf16864ca4bc1bb5e4c0334c0f" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:19:54.481055 10275 raft_consensus.cc:2749] T f3f9c2e2bf644115957398fe4c9459db P cd75a17ab2604397adab03bb8b5fd75c [term 9 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:19:54.536589  6697 leader_election.cc:304] T 1bf4668eeb70467fb3dc5a0289233b3c P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377
I20260709 13:19:54.537212  6876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbdf895bba214ff68685a24fd17dfb5d" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:19:54.538374  6876 raft_consensus.cc:2410] T dbdf895bba214ff68685a24fd17dfb5d P cd75a17ab2604397adab03bb8b5fd75c [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate ccd8a4c3bfe3413cb2ae219b09aea832 for term 9 because replica has last-logged OpId of term: 7 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 3.
I20260709 13:19:54.538729  6697 leader_election.cc:304] T 22ccee1b570c4ad3a57bd7aec085b1b4 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:19:54.540249 10237 raft_consensus.cc:2804] T 1bf4668eeb70467fb3dc5a0289233b3c P ccd8a4c3bfe3413cb2ae219b09aea832 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:19:54.540390 10032 raft_consensus.cc:2749] T 22ccee1b570c4ad3a57bd7aec085b1b4 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:19:54.540763 10237 raft_consensus.cc:493] T 1bf4668eeb70467fb3dc5a0289233b3c P ccd8a4c3bfe3413cb2ae219b09aea832 [term 9 FOLLOWER]: Starting leader election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:19:54.541258 10237 raft_consensus.cc:3060] T 1bf4668eeb70467fb3dc5a0289233b3c P ccd8a4c3bfe3413cb2ae219b09aea832 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:54.541954  6728 raft_consensus.cc:1240] T be1a92657f494cac8dd227d152f50151 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 12 FOLLOWER]: Rejecting Update request from peer 7ba59cc884714e8aa5f3f0ecaed84cbb for earlier term 11. Current term is 12. Ops: []
I20260709 13:19:54.491588 10457 raft_consensus.cc:2749] T 7887766dc6784fcaa42b35c05fea7a99 P cd75a17ab2604397adab03bb8b5fd75c [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:19:54.455109 10421 raft_consensus.cc:515] T 44bde925b2e541b69890d70715b85176 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:54.490340 10240 raft_consensus.cc:2804] T f09c2a98de1a4decabd0ff900dd44caa P b7ab4784c7344b939bc36f639286f377 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:19:54.543681 10240 raft_consensus.cc:493] T f09c2a98de1a4decabd0ff900dd44caa P b7ab4784c7344b939bc36f639286f377 [term 11 FOLLOWER]: Starting leader election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:19:54.478669 10387 raft_consensus.cc:697] T 07a92dd554674067a83a9cb68c4773f2 P cd75a17ab2604397adab03bb8b5fd75c [term 9 LEADER]: Becoming Leader. State: Replica: cd75a17ab2604397adab03bb8b5fd75c, State: Running, Role: LEADER
W20260709 13:19:54.520630 10510 log.cc:927] Time spent T 4275cf08e63345f993bce8664eada830 P cd75a17ab2604397adab03bb8b5fd75c: Append to log took a long time: real 0.055s	user 0.001s	sys 0.000s
I20260709 13:19:54.522305  6730 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50004 (request call id 1822) took 1221 ms. Trace:
I20260709 13:19:54.522418  6798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "404190ce4ce94cecbfcb6ea9d1dd8626" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:19:54.549974  6798 raft_consensus.cc:2468] T 404190ce4ce94cecbfcb6ea9d1dd8626 P b7ab4784c7344b939bc36f639286f377 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in term 10.
I20260709 13:19:54.524242  6801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbdf895bba214ff68685a24fd17dfb5d" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:19:54.551100  6801 raft_consensus.cc:2393] T dbdf895bba214ff68685a24fd17dfb5d P b7ab4784c7344b939bc36f639286f377 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate ccd8a4c3bfe3413cb2ae219b09aea832 in current term 9: Already voted for candidate b7ab4784c7344b939bc36f639286f377 in this term.
I20260709 13:19:54.551481  6879 raft_consensus.cc:1240] T 3fa34c08b205435dba97346991aa1f92 P cd75a17ab2604397adab03bb8b5fd75c [term 11 LEADER]: Rejecting Update request from peer ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 10. Current term is 11. Ops: []
I20260709 13:19:54.545130 10421 leader_election.cc:290] T 44bde925b2e541b69890d70715b85176 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:54.517222  6802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f00a2e87e56452083b759f60d461ee3" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:19:54.553345  6725 raft_consensus.cc:1275] T fe20b4b48823486ca3b9c648db6ce8aa P ccd8a4c3bfe3413cb2ae219b09aea832 [term 8 FOLLOWER]: Refusing update from remote peer 7ba59cc884714e8aa5f3f0ecaed84cbb: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:19:54.549615  6730 rpcz_store.cc:276] 0709 13:19:53.300664 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:54.079517 (+778853us) service_pool.cc:224] Handling call
0709 13:19:54.080151 (+   634us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:54.120604 (+ 40453us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:54.120648 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:54.121436 (+   788us) log.cc:844] Serialized 26 byte log entry
0709 13:19:54.428803 (+307367us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:19:54.428866 (+    63us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:54.428975 (+   109us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:54.521846 (+ 92871us) raft_consensus.cc:1685] finished
0709 13:19:54.521879 (+    33us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:54.522209 (+   330us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":26349,"raft.queue_time_us":40229,"raft.run_cpu_time_us":142,"raft.run_wall_time_us":143,"thread_start_us":306746,"threads_started":1,"wal-append.queue_time_us":336281}
I20260709 13:19:54.554059  6802 raft_consensus.cc:2393] T 4f00a2e87e56452083b759f60d461ee3 P b7ab4784c7344b939bc36f639286f377 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in current term 10: Already voted for candidate b7ab4784c7344b939bc36f639286f377 in this term.
I20260709 13:19:54.554245 10437 raft_consensus.cc:2749] T 17587d6730594da4a56fa13a353232a1 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:19:54.555054  6730 raft_consensus.cc:1275] T de3186201e1a40d0b335eeb8b4e256e0 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 10 FOLLOWER]: Refusing update from remote peer b7ab4784c7344b939bc36f639286f377: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
W20260709 13:19:54.555948  7466 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 76947.4us
I20260709 13:19:54.557288 10237 raft_consensus.cc:515] T 1bf4668eeb70467fb3dc5a0289233b3c P ccd8a4c3bfe3413cb2ae219b09aea832 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
W20260709 13:19:54.560376  6845 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:54.560709 10240 raft_consensus.cc:3060] T f09c2a98de1a4decabd0ff900dd44caa P b7ab4784c7344b939bc36f639286f377 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:54.562378  6879 raft_consensus.cc:1240] T 7c44c4849aa54f2b94d1f1bef9ed546f P cd75a17ab2604397adab03bb8b5fd75c [term 12 FOLLOWER]: Rejecting Update request from peer ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 11. Current term is 12. Ops: []
I20260709 13:19:54.562623  6803 raft_consensus.cc:2468] T e77e330a82df4b43a745d57a68f6f057 P b7ab4784c7344b939bc36f639286f377 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 12.
I20260709 13:19:54.564460  6729 raft_consensus.cc:1275] T f03d0dbf16864ca4bc1bb5e4c0334c0f P ccd8a4c3bfe3413cb2ae219b09aea832 [term 8 FOLLOWER]: Refusing update from remote peer b7ab4784c7344b939bc36f639286f377: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:19:54.539866  6876 raft_consensus.cc:1240] T 2c240553ce044eedb41541d72b9475d7 P cd75a17ab2604397adab03bb8b5fd75c [term 11 FOLLOWER]: Rejecting Update request from peer ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 10. Current term is 11. Ops: [10.6-10.6]
I20260709 13:19:54.568011  6723 raft_consensus.cc:2468] T ce4f062dcd314d43a63ca74067cb5ee3 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in term 10.
I20260709 13:19:54.575145  6724 raft_consensus.cc:1240] T ce4f062dcd314d43a63ca74067cb5ee3 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 10 FOLLOWER]: Rejecting Update request from peer cd75a17ab2604397adab03bb8b5fd75c for earlier term 8. Current term is 10. Ops: []
W20260709 13:19:54.555522  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 106278us
I20260709 13:19:54.546938 10387 consensus_queue.cc:237] T 07a92dd554674067a83a9cb68c4773f2 P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:54.610249  6874 raft_consensus.cc:2468] T e77e330a82df4b43a745d57a68f6f057 P cd75a17ab2604397adab03bb8b5fd75c [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 12.
I20260709 13:19:54.610353  6772 leader_election.cc:304] T a3022224cc81473690653a83d4e99470 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: ccd8a4c3bfe3413cb2ae219b09aea832
W20260709 13:19:54.728991 10513 log.cc:927] Time spent T 7887766dc6784fcaa42b35c05fea7a99 P cd75a17ab2604397adab03bb8b5fd75c: Append to log took a long time: real 0.237s	user 0.000s	sys 0.000s
I20260709 13:19:54.730522  6697 leader_election.cc:304] T 7a734b5ab7834e05a8c422208acc58b1 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
W20260709 13:19:54.731774  6697 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 129132us
I20260709 13:19:54.732817  6697 leader_election.cc:304] T 9b3759de40694069b13c0f8bd40e5709 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377
I20260709 13:19:54.733404  6729 raft_consensus.cc:1275] T c4db81d9d329422bb3b4160ca4ac2d1d P ccd8a4c3bfe3413cb2ae219b09aea832 [term 9 FOLLOWER]: Refusing update from remote peer b7ab4784c7344b939bc36f639286f377: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:19:54.734537  6697 leader_election.cc:304] T d33d5ee8ef6f415593d8df52063161ad P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:19:54.739939  6879 raft_consensus.cc:1240] T 3411566abe2d4c9bb4b2adfdd05e6f17 P cd75a17ab2604397adab03bb8b5fd75c [term 8 FOLLOWER]: Rejecting Update request from peer ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 7. Current term is 8. Ops: []
I20260709 13:19:54.744488  6806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "427c124d773f483294511e80fe340075" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 10 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:19:54.748620  6807 raft_consensus.cc:2468] T ce4f062dcd314d43a63ca74067cb5ee3 P b7ab4784c7344b939bc36f639286f377 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in term 10.
I20260709 13:19:54.750458  6800 raft_consensus.cc:2468] T 20f6842e26174571996b8dea4151d4be P b7ab4784c7344b939bc36f639286f377 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 11.
W20260709 13:19:54.754629  6772 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 173473us
I20260709 13:19:54.759523  6878 raft_consensus.cc:2468] T f03d0dbf16864ca4bc1bb5e4c0334c0f P cd75a17ab2604397adab03bb8b5fd75c [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 8.
I20260709 13:19:54.762459  6799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17587d6730594da4a56fa13a353232a1" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:19:54.760425 10275 raft_consensus.cc:493] T 90d42e216d9741e190bca19a781291fd P cd75a17ab2604397adab03bb8b5fd75c [term 9 FOLLOWER]: Starting pre-election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:19:54.764561 10275 raft_consensus.cc:515] T 90d42e216d9741e190bca19a781291fd P cd75a17ab2604397adab03bb8b5fd75c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:54.767158 10275 leader_election.cc:290] T 90d42e216d9741e190bca19a781291fd P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:19:54.768265 10447 raft_consensus.cc:493] T bd6869f07b5a4885a0b99fbe60c3b175 P b7ab4784c7344b939bc36f639286f377 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:54.768977 10447 raft_consensus.cc:515] T bd6869f07b5a4885a0b99fbe60c3b175 P b7ab4784c7344b939bc36f639286f377 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
W20260709 13:19:54.769443  6727 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50004 (request call id 1789) took 2346 ms (client timeout 1623 ms). Trace:
I20260709 13:19:54.769560  6730 raft_consensus.cc:1275] T 34f36d59d88f40fe8a2805e604fc6c0a P ccd8a4c3bfe3413cb2ae219b09aea832 [term 7 FOLLOWER]: Refusing update from remote peer b7ab4784c7344b939bc36f639286f377: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
W20260709 13:19:54.769874  6727 rpcz_store.cc:269] 0709 13:19:52.422517 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:52.422688 (+   171us) service_pool.cc:224] Handling call
0709 13:19:54.769029 (+2346341us) spinlock_profiling.cc:243] Waited 675 ms on lock 0x7b540008edd4. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f9ae2fa 00007fcc1496fb17 00007fcc0deea6d4 00007fcc0deea662 00007fcc0deea591 00007fcc0deea50c 00007fcc0dee97c2 00007fcc0dce548c 00007fcc0dce48c6 00007fcc0dce426f
0709 13:19:54.769225 (+   196us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1552336256}
I20260709 13:19:54.771404 10447 leader_election.cc:290] T bd6869f07b5a4885a0b99fbe60c3b175 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
W20260709 13:19:54.774808  7467 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:54.760396  6877 raft_consensus.cc:2468] T 20f6842e26174571996b8dea4151d4be P cd75a17ab2604397adab03bb8b5fd75c [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 11.
I20260709 13:19:54.777858  6727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6869f07b5a4885a0b99fbe60c3b175" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 11 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:19:54.778663  6727 raft_consensus.cc:2468] T bd6869f07b5a4885a0b99fbe60c3b175 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 10.
I20260709 13:19:54.784188 10303 raft_consensus.cc:2804] T a3022224cc81473690653a83d4e99470 P b7ab4784c7344b939bc36f639286f377 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:19:54.784890 10303 raft_consensus.cc:493] T a3022224cc81473690653a83d4e99470 P b7ab4784c7344b939bc36f639286f377 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:54.785312 10303 raft_consensus.cc:3060] T a3022224cc81473690653a83d4e99470 P b7ab4784c7344b939bc36f639286f377 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:54.787755  7466 leader_election.cc:304] T 404190ce4ce94cecbfcb6ea9d1dd8626 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, b7ab4784c7344b939bc36f639286f377; no voters: 
I20260709 13:19:54.788360  6697 leader_election.cc:304] T a1704639a875409b9959353527b3fd68 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:19:54.789394 10324 raft_consensus.cc:2749] T a1704639a875409b9959353527b3fd68 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:19:54.789731 10437 raft_consensus.cc:2804] T 404190ce4ce94cecbfcb6ea9d1dd8626 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:19:54.790141 10421 raft_consensus.cc:2804] T 9b3759de40694069b13c0f8bd40e5709 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:19:54.790421 10437 raft_consensus.cc:493] T 404190ce4ce94cecbfcb6ea9d1dd8626 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:54.790582 10421 raft_consensus.cc:493] T 9b3759de40694069b13c0f8bd40e5709 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:54.790830 10437 raft_consensus.cc:3060] T 404190ce4ce94cecbfcb6ea9d1dd8626 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:54.790970 10421 raft_consensus.cc:3060] T 9b3759de40694069b13c0f8bd40e5709 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:54.793016 10436 raft_consensus.cc:3055] T fe20b4b48823486ca3b9c648db6ce8aa P cd75a17ab2604397adab03bb8b5fd75c [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:19:54.793712 10436 raft_consensus.cc:740] T fe20b4b48823486ca3b9c648db6ce8aa P cd75a17ab2604397adab03bb8b5fd75c [term 7 LEADER]: Becoming Follower/Learner. State: Replica: cd75a17ab2604397adab03bb8b5fd75c, State: Running, Role: LEADER
I20260709 13:19:54.795003 10436 consensus_queue.cc:260] T fe20b4b48823486ca3b9c648db6ce8aa P cd75a17ab2604397adab03bb8b5fd75c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:19:54.796952 10436 raft_consensus.cc:3060] T fe20b4b48823486ca3b9c648db6ce8aa P cd75a17ab2604397adab03bb8b5fd75c [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:54.798987  9890 raft_consensus.cc:3060] T 427c124d773f483294511e80fe340075 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:54.799283 10437 raft_consensus.cc:515] T 404190ce4ce94cecbfcb6ea9d1dd8626 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:19:54.750506 10252 raft_consensus.cc:2749] T 7a734b5ab7834e05a8c422208acc58b1 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:19:54.742985 10237 leader_election.cc:290] T 1bf4668eeb70467fb3dc5a0289233b3c P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 10 election: Requested vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:54.805014  6731 raft_consensus.cc:2468] T 404190ce4ce94cecbfcb6ea9d1dd8626 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in term 10.
I20260709 13:19:54.808561 10248 raft_consensus.cc:2749] T d33d5ee8ef6f415593d8df52063161ad P ccd8a4c3bfe3413cb2ae219b09aea832 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:19:54.802556  6844 leader_election.cc:304] T f5be3a11b23d4ea9b08300a2789821c7 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
W20260709 13:19:54.789479  6697 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 53419.4us
W20260709 13:19:54.818037  6772 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 62367.4us
I20260709 13:19:54.816696 10385 raft_consensus.cc:3055] T b3f13b31a1f84f0d89d007eadd57924c P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:19:54.824363 10275 raft_consensus.cc:2749] T f5be3a11b23d4ea9b08300a2789821c7 P cd75a17ab2604397adab03bb8b5fd75c [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:19:54.832810  6772 leader_election.cc:304] T 3411566abe2d4c9bb4b2adfdd05e6f17 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:19:54.837849  6697 leader_election.cc:304] T f5be3a11b23d4ea9b08300a2789821c7 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377
I20260709 13:19:54.826361 10385 raft_consensus.cc:740] T b3f13b31a1f84f0d89d007eadd57924c P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 7ba59cc884714e8aa5f3f0ecaed84cbb, State: Running, Role: LEADER
I20260709 13:19:54.827430 10447 consensus_queue.cc:1048] T 44bde925b2e541b69890d70715b85176 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.003s
I20260709 13:19:54.842758 10418 consensus_queue.cc:1048] T 7c37d41cd9164c15a6826ca62a851a69 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.010s
W20260709 13:19:54.856989  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 99268.6us
I20260709 13:19:54.851616 10248 raft_consensus.cc:2804] T f5be3a11b23d4ea9b08300a2789821c7 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:19:54.863278 10249 raft_consensus.cc:2804] T 3411566abe2d4c9bb4b2adfdd05e6f17 P b7ab4784c7344b939bc36f639286f377 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:19:54.870947  6724 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49998 (request call id 925) took 1313 ms. Trace:
I20260709 13:19:54.869572  6770 leader_election.cc:304] T b56bf91d90824c959e21e0cee5ba1816 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
I20260709 13:19:54.871533  6724 rpcz_store.cc:276] 0709 13:19:53.550842 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:54.273614 (+722772us) service_pool.cc:224] Handling call
0709 13:19:54.574890 (+301276us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:54.579276 (+  4386us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:54.863620 (+284344us) spinlock_profiling.cc:243] Waited 274 ms on lock 0x7b5400057650. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f9a98ad 00007fcc1496e419 00007fcc0dee5bd4 00007fcc0dee5b62 00007fcc0dee5a91 00007fcc0dee5a0c 00007fcc0dee4cc2 00007fcc0dce548c 00007fcc0dce48c6 00007fcc0dce426f
0709 13:19:54.863805 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":630835584}
I20260709 13:19:54.873574  6772 leader_election.cc:304] T 07a92dd554674067a83a9cb68c4773f2 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: ccd8a4c3bfe3413cb2ae219b09aea832
W20260709 13:19:54.876639  6698 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:54.858698 10437 leader_election.cc:290] T 404190ce4ce94cecbfcb6ea9d1dd8626 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 11 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:19:54.884900  6805 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:32976 (request call id 2588) took 1943 ms. Trace:
I20260709 13:19:54.885426  6805 rpcz_store.cc:276] 0709 13:19:52.941678 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:52.942008 (+   330us) service_pool.cc:224] Handling call
0709 13:19:52.942368 (+   360us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:54.266819 (+1324451us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:54.884396 (+617577us) spinlock_profiling.cc:243] Waited 1.32 s on lock 0x7b54001d1ad4. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f9aae01 00007fcc0f9a983e 00007fcc1496e419 00007fcc0dee5bd4 00007fcc0dee5b62 00007fcc0dee5a91 00007fcc0dee5a0c 00007fcc0dee4cc2 00007fcc0dce548c 00007fcc0dce48c6
0709 13:19:54.884781 (+   385us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3043020160}
W20260709 13:19:54.888492  6697 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 58417.7us
I20260709 13:19:54.890576  6697 leader_election.cc:304] T d8292e16e5654be6bc408560cf256aaa P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377
I20260709 13:19:54.892817 10252 raft_consensus.cc:2804] T d8292e16e5654be6bc408560cf256aaa P ccd8a4c3bfe3413cb2ae219b09aea832 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:19:54.893365 10252 raft_consensus.cc:493] T d8292e16e5654be6bc408560cf256aaa P ccd8a4c3bfe3413cb2ae219b09aea832 [term 12 FOLLOWER]: Starting leader election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:19:54.893798 10252 raft_consensus.cc:3060] T d8292e16e5654be6bc408560cf256aaa P ccd8a4c3bfe3413cb2ae219b09aea832 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:54.895839  6844 leader_election.cc:304] T 7ba5dac66ab5497e9e336f2a3c28cda5 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, b7ab4784c7344b939bc36f639286f377
I20260709 13:19:54.874544 10486 raft_consensus.cc:2749] T 2c240553ce044eedb41541d72b9475d7 P b7ab4784c7344b939bc36f639286f377 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:19:54.868809 10248 raft_consensus.cc:493] T f5be3a11b23d4ea9b08300a2789821c7 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 7 FOLLOWER]: Starting leader election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:19:54.904423  6697 leader_election.cc:304] T ab432e62819d499eaaf3dd55481dd930 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:19:54.919348 10487 raft_consensus.cc:2804] T b56bf91d90824c959e21e0cee5ba1816 P b7ab4784c7344b939bc36f639286f377 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 13:19:54.922076  6846 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:54.932142  6773 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:54.904068 10445 consensus_meta.cc:287] T 1528ab62b6fe4e3099d08f141afee116 P 7ba59cc884714e8aa5f3f0ecaed84cbb: Time spent flushing consensus metadata: real 0.618s	user 0.007s	sys 0.007s
I20260709 13:19:54.934077 10445 raft_consensus.cc:515] T 1528ab62b6fe4e3099d08f141afee116 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 10 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
W20260709 13:19:54.934449  6696 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:54.935395  7500 raft_consensus.cc:2368] T 1528ab62b6fe4e3099d08f141afee116 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 9. Current term is 10.
I20260709 13:19:54.936583  6805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "404190ce4ce94cecbfcb6ea9d1dd8626" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:19:54.937240  6805 raft_consensus.cc:3060] T 404190ce4ce94cecbfcb6ea9d1dd8626 P b7ab4784c7344b939bc36f639286f377 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:54.919898 10487 raft_consensus.cc:493] T b56bf91d90824c959e21e0cee5ba1816 P b7ab4784c7344b939bc36f639286f377 [term 8 FOLLOWER]: Starting leader election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:19:54.917690 10248 raft_consensus.cc:3060] T f5be3a11b23d4ea9b08300a2789821c7 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:19:54.954576  6847 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:54.923574 10240 raft_consensus.cc:515] T f09c2a98de1a4decabd0ff900dd44caa P b7ab4784c7344b939bc36f639286f377 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:54.956279  6728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "404190ce4ce94cecbfcb6ea9d1dd8626" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:19:54.957294  6728 raft_consensus.cc:3060] T 404190ce4ce94cecbfcb6ea9d1dd8626 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:19:54.953510 10435 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.507s	user 0.035s	sys 0.045s
W20260709 13:19:54.969218  6697 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 68862.4us
I20260709 13:19:54.954421 10487 raft_consensus.cc:3060] T b56bf91d90824c959e21e0cee5ba1816 P b7ab4784c7344b939bc36f639286f377 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:54.953576 10457 raft_consensus.cc:2749] T 7ba5dac66ab5497e9e336f2a3c28cda5 P cd75a17ab2604397adab03bb8b5fd75c [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:19:55.002686 10240 leader_election.cc:290] T f09c2a98de1a4decabd0ff900dd44caa P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 12 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:55.004125 10063 raft_consensus.cc:2804] T 07a92dd554674067a83a9cb68c4773f2 P b7ab4784c7344b939bc36f639286f377 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:19:55.004891 10063 raft_consensus.cc:493] T 07a92dd554674067a83a9cb68c4773f2 P b7ab4784c7344b939bc36f639286f377 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:54.965487 10445 leader_election.cc:290] T 1528ab62b6fe4e3099d08f141afee116 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 10 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
W20260709 13:19:55.010123  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 145416us
W20260709 13:19:55.006011  6847 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:55.012367  6805 raft_consensus.cc:2468] T 404190ce4ce94cecbfcb6ea9d1dd8626 P b7ab4784c7344b939bc36f639286f377 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in term 11.
W20260709 13:19:55.013440  6695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 395491us
W20260709 13:19:55.005254  7468 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.513s	user 0.013s	sys 0.076s
W20260709 13:19:55.021445  7468 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.529s	user 0.013s	sys 0.077s
W20260709 13:19:55.021981  7468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 552555us
W20260709 13:19:55.025079  6695 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:55.024492  6770 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 126050us
I20260709 13:19:55.015898 10063 raft_consensus.cc:3060] T 07a92dd554674067a83a9cb68c4773f2 P b7ab4784c7344b939bc36f639286f377 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:19:55.031626  6695 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:55.034173  7466 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 101174us
W20260709 13:19:55.035796  6695 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:55.037086  6772 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 163630us
I20260709 13:19:54.961971 10385 consensus_queue.cc:260] T b3f13b31a1f84f0d89d007eadd57924c P 7ba59cc884714e8aa5f3f0ecaed84cbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
W20260709 13:19:55.037953  6695 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:55.040510  6844 leader_election.cc:304] T 9e326172347f45e99a0d482b5d8ef768 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:19:55.030151 10445 consensus_queue.cc:1048] T fe20b4b48823486ca3b9c648db6ce8aa P 7ba59cc884714e8aa5f3f0ecaed84cbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.018s
I20260709 13:19:55.056866  7466 leader_election.cc:304] T ce4f062dcd314d43a63ca74067cb5ee3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
W20260709 13:19:55.058851  6845 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:55.049914 10457 raft_consensus.cc:2749] T 9e326172347f45e99a0d482b5d8ef768 P cd75a17ab2604397adab03bb8b5fd75c [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:19:55.052986 10452 raft_consensus.cc:2749] T ab432e62819d499eaaf3dd55481dd930 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:19:55.048520 10421 raft_consensus.cc:515] T 9b3759de40694069b13c0f8bd40e5709 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
W20260709 13:19:55.068203 10516 log.cc:927] Time spent T 3d65025eea89441290d85dd053810e31 P b7ab4784c7344b939bc36f639286f377: Append to log took a long time: real 0.051s	user 0.000s	sys 0.001s
I20260709 13:19:55.049803 10437 consensus_queue.cc:1059] T b3f13b31a1f84f0d89d007eadd57924c P 7ba59cc884714e8aa5f3f0ecaed84cbb [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.021s
I20260709 13:19:55.091347  6770 leader_election.cc:304] T 1528ab62b6fe4e3099d08f141afee116 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
W20260709 13:19:55.091009  6772 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 52249us
I20260709 13:19:55.094687  6772 leader_election.cc:304] T 853ac0a8cbd64ce99457f170216d4d0f P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:19:55.101974  6728 raft_consensus.cc:2468] T 404190ce4ce94cecbfcb6ea9d1dd8626 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in term 11.
W20260709 13:19:55.113227  6695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 59786.3us
I20260709 13:19:55.114703  6726 raft_consensus.cc:2410] T 427c124d773f483294511e80fe340075 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ba59cc884714e8aa5f3f0ecaed84cbb for term 10 because replica has last-logged OpId of term: 8 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 5.
W20260709 13:19:55.113353  7466 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 56463.1us
I20260709 13:19:55.118024  7466 leader_election.cc:304] T 404190ce4ce94cecbfcb6ea9d1dd8626 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
W20260709 13:19:55.118789  6697 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 53820.1us
I20260709 13:19:55.115062 10446 raft_consensus.cc:2804] T 1528ab62b6fe4e3099d08f141afee116 P b7ab4784c7344b939bc36f639286f377 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:19:55.138712  6728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1528ab62b6fe4e3099d08f141afee116" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:19:55.139317  6728 raft_consensus.cc:3060] T 1528ab62b6fe4e3099d08f141afee116 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:55.136000  6805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1528ab62b6fe4e3099d08f141afee116" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
W20260709 13:19:55.137015  6847 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:55.092305 10006 consensus_queue.cc:1048] T 44bde925b2e541b69890d70715b85176 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.040s
I20260709 13:19:55.127420 10375 raft_consensus.cc:2804] T 404190ce4ce94cecbfcb6ea9d1dd8626 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:19:55.172076 10375 raft_consensus.cc:697] T 404190ce4ce94cecbfcb6ea9d1dd8626 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 11 LEADER]: Becoming Leader. State: Replica: 7ba59cc884714e8aa5f3f0ecaed84cbb, State: Running, Role: LEADER
I20260709 13:19:55.173177 10375 consensus_queue.cc:237] T 404190ce4ce94cecbfcb6ea9d1dd8626 P 7ba59cc884714e8aa5f3f0ecaed84cbb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:19:55.176204 10525 raft_consensus.cc:2749] T 853ac0a8cbd64ce99457f170216d4d0f P b7ab4784c7344b939bc36f639286f377 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:19:55.134529 10421 leader_election.cc:290] T 9b3759de40694069b13c0f8bd40e5709 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 10 election: Requested vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
W20260709 13:19:55.184062  6698 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:55.156948  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 121710us
I20260709 13:19:55.142758 10452 consensus_queue.cc:1048] T f09c2a98de1a4decabd0ff900dd44caa P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.018s
I20260709 13:19:55.138238 10446 raft_consensus.cc:493] T 1528ab62b6fe4e3099d08f141afee116 P b7ab4784c7344b939bc36f639286f377 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:55.133940 10324 consensus_queue.cc:1048] T 30e88460611e47b2ba16a46a30b5f416 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.031s
I20260709 13:19:55.166527  6873 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53406 (request call id 1896) took 1025 ms. Trace:
W20260709 13:19:55.167132  6772 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 72637.9us
I20260709 13:19:55.129218 10303 raft_consensus.cc:515] T a3022224cc81473690653a83d4e99470 P b7ab4784c7344b939bc36f639286f377 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:55.220714 10303 leader_election.cc:290] T a3022224cc81473690653a83d4e99470 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 11 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:55.222340  6772 leader_election.cc:304] T dbdf895bba214ff68685a24fd17dfb5d P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:19:55.222216 10252 raft_consensus.cc:515] T d8292e16e5654be6bc408560cf256aaa P ccd8a4c3bfe3413cb2ae219b09aea832 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:55.209599  6873 rpcz_store.cc:276] 0709 13:19:54.140874 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:54.165190 (+ 24316us) service_pool.cc:224] Handling call
0709 13:19:54.173147 (+  7957us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:19:54.341239 (+168092us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:54.341274 (+    35us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:19:54.413112 (+ 71838us) log.cc:844] Serialized 52 byte log entry
0709 13:19:54.948451 (+535339us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:19:55.052713 (+104262us) log.cc:844] Serialized 14 byte log entry
0709 13:19:55.053021 (+   308us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:55.053102 (+    81us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:55.166149 (+113047us) raft_consensus.cc:1685] finished
0709 13:19:55.166181 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:55.166435 (+   254us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":71078,"prepare.queue_time_us":179513,"prepare.run_cpu_time_us":44,"prepare.run_wall_time_us":49,"raft.queue_time_us":89017,"raft.run_cpu_time_us":425,"raft.run_wall_time_us":14689,"thread_start_us":577938,"threads_started":2,"wal-append.queue_time_us":613067}
I20260709 13:19:55.224143 10421 consensus_queue.cc:1048] T 713b5728a197487c9300b310ab94e5a3 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:19:55.131271 10445 raft_consensus.cc:2804] T ce4f062dcd314d43a63ca74067cb5ee3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:19:55.226027 10421 consensus_queue.cc:1059] T 9e326172347f45e99a0d482b5d8ef768 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: INVALID_TERM, Last received: 8.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:19:55.226437 10445 raft_consensus.cc:697] T ce4f062dcd314d43a63ca74067cb5ee3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 10 LEADER]: Becoming Leader. State: Replica: 7ba59cc884714e8aa5f3f0ecaed84cbb, State: Running, Role: LEADER
I20260709 13:19:55.227108 10421 raft_consensus.cc:3055] T 9e326172347f45e99a0d482b5d8ef768 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:19:55.227893 10445 consensus_queue.cc:237] T ce4f062dcd314d43a63ca74067cb5ee3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 10, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } attrs { replace: true } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:19:55.230792  9890 consensus_queue.cc:1048] T 30e88460611e47b2ba16a46a30b5f416 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:19:55.192178  6728 raft_consensus.cc:2468] T 1528ab62b6fe4e3099d08f141afee116 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in term 10.
W20260709 13:19:55.211845  6695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 81094.2us
I20260709 13:19:55.234445  7466 leader_election.cc:304] T 1528ab62b6fe4e3099d08f141afee116 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
I20260709 13:19:55.235345 10529 raft_consensus.cc:2804] T 1528ab62b6fe4e3099d08f141afee116 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:19:55.214179 10248 raft_consensus.cc:515] T f5be3a11b23d4ea9b08300a2789821c7 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:55.235951 10529 raft_consensus.cc:697] T 1528ab62b6fe4e3099d08f141afee116 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 10 LEADER]: Becoming Leader. State: Replica: 7ba59cc884714e8aa5f3f0ecaed84cbb, State: Running, Role: LEADER
I20260709 13:19:55.121129  6630 catalog_manager.cc:5697] T 30e88460611e47b2ba16a46a30b5f416 P b7ab4784c7344b939bc36f639286f377 reported cstate change: term changed from 2 to 4, leader changed from ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65) to b7ab4784c7344b939bc36f639286f377 (127.5.126.66). New cstate: current_term: 4 leader_uuid: "b7ab4784c7344b939bc36f639286f377" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:55.240345 10529 consensus_queue.cc:237] T 1528ab62b6fe4e3099d08f141afee116 P 7ba59cc884714e8aa5f3f0ecaed84cbb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:19:55.239398 10237 consensus_queue.cc:1059] T 8c7f33e544204fbaac4078e3e83bbf4e P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:19:55.131640 10249 raft_consensus.cc:697] T 3411566abe2d4c9bb4b2adfdd05e6f17 P b7ab4784c7344b939bc36f639286f377 [term 8 LEADER]: Becoming Leader. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
I20260709 13:19:55.238417 10248 leader_election.cc:290] T f5be3a11b23d4ea9b08300a2789821c7 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 8 election: Requested vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:55.240984 10421 raft_consensus.cc:740] T 9e326172347f45e99a0d482b5d8ef768 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
I20260709 13:19:55.223966  6772 leader_election.cc:304] T 4d9def8b32fd443aa94ab1420b06837b P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:19:55.211287 10446 raft_consensus.cc:3060] T 1528ab62b6fe4e3099d08f141afee116 P b7ab4784c7344b939bc36f639286f377 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:55.279513 10457 raft_consensus.cc:493] T bb7fa124c3bf4ef9ab65a407cb008441 P cd75a17ab2604397adab03bb8b5fd75c [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:55.230655 10487 raft_consensus.cc:515] T b56bf91d90824c959e21e0cee5ba1816 P b7ab4784c7344b939bc36f639286f377 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
W20260709 13:19:55.284812  6697 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 100768us
I20260709 13:19:55.287988  7466 leader_election.cc:304] T 427c124d773f483294511e80fe340075 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:19:55.230695 10240 raft_consensus.cc:2749] T dbdf895bba214ff68685a24fd17dfb5d P b7ab4784c7344b939bc36f639286f377 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
W20260709 13:19:55.298245  6846 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:55.302805  6772 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 78951.6us
I20260709 13:19:55.288479 10523 raft_consensus.cc:493] T bb7fa124c3bf4ef9ab65a407cb008441 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:55.308393  6772 leader_election.cc:304] T 7c44c4849aa54f2b94d1f1bef9ed546f P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: ccd8a4c3bfe3413cb2ae219b09aea832
W20260709 13:19:55.318528  6770 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 185044us
I20260709 13:19:55.299708 10437 raft_consensus.cc:2749] T 427c124d773f483294511e80fe340075 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:19:55.299595 10486 raft_consensus.cc:493] T 8c7f33e544204fbaac4078e3e83bbf4e P b7ab4784c7344b939bc36f639286f377 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:55.285059 10063 raft_consensus.cc:515] T 07a92dd554674067a83a9cb68c4773f2 P b7ab4784c7344b939bc36f639286f377 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:55.325352  6630 catalog_manager.cc:5697] T f58dc08b12a2494bb9a1372837970ca2 P b7ab4784c7344b939bc36f639286f377 reported cstate change: term changed from 4 to 5, leader changed from cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67) to b7ab4784c7344b939bc36f639286f377 (127.5.126.66). New cstate: current_term: 5 leader_uuid: "b7ab4784c7344b939bc36f639286f377" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:55.309906 10006 raft_consensus.cc:2749] T 4d9def8b32fd443aa94ab1420b06837b P b7ab4784c7344b939bc36f639286f377 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:19:55.297302  9890 consensus_queue.cc:1059] T 7c44c4849aa54f2b94d1f1bef9ed546f P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.034s
I20260709 13:19:55.342388 10435 raft_consensus.cc:493] T 4b8cacb381b746da8d0049b0a83b41dd P cd75a17ab2604397adab03bb8b5fd75c [term 9 FOLLOWER]: Starting pre-election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:19:55.310201 10457 raft_consensus.cc:515] T bb7fa124c3bf4ef9ab65a407cb008441 P cd75a17ab2604397adab03bb8b5fd75c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
W20260709 13:19:55.353178  7466 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:55.309468 10237 consensus_queue.cc:1059] T f3f9c2e2bf644115957398fe4c9459db P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.030s
I20260709 13:19:55.336534 10436 raft_consensus.cc:493] T dbdf895bba214ff68685a24fd17dfb5d P cd75a17ab2604397adab03bb8b5fd75c [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:55.337193 10252 leader_election.cc:290] T d8292e16e5654be6bc408560cf256aaa P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 13 election: Requested vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
W20260709 13:19:55.376479  6695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 90268.2us
I20260709 13:19:55.340785 10240 raft_consensus.cc:2804] T 7c44c4849aa54f2b94d1f1bef9ed546f P b7ab4784c7344b939bc36f639286f377 [term 12 FOLLOWER]: Leader election won for term 12
W20260709 13:19:55.384379  6772 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 80019.6us
I20260709 13:19:55.389400  6772 leader_election.cc:304] T f3f9c2e2bf644115957398fe4c9459db P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: ccd8a4c3bfe3413cb2ae219b09aea832
W20260709 13:19:55.385046  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 120120us
W20260709 13:19:55.391654  6847 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:55.395304  6844 leader_election.cc:304] T d8cee0accdb8499c86d4414b72565a38 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, b7ab4784c7344b939bc36f639286f377
I20260709 13:19:55.397162  6844 leader_election.cc:304] T 8c7f33e544204fbaac4078e3e83bbf4e P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:19:55.398052 10275 raft_consensus.cc:2749] T d8cee0accdb8499c86d4414b72565a38 P cd75a17ab2604397adab03bb8b5fd75c [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:19:55.399098 10275 raft_consensus.cc:3060] T 8c7f33e544204fbaac4078e3e83bbf4e P cd75a17ab2604397adab03bb8b5fd75c [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:55.399456  6844 leader_election.cc:304] T 2c240553ce044eedb41541d72b9475d7 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:19:55.385573 10436 raft_consensus.cc:515] T dbdf895bba214ff68685a24fd17dfb5d P cd75a17ab2604397adab03bb8b5fd75c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:55.402300 10436 leader_election.cc:290] T dbdf895bba214ff68685a24fd17dfb5d P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:19:55.325837 10523 raft_consensus.cc:515] T bb7fa124c3bf4ef9ab65a407cb008441 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:19:55.402904 10442 raft_consensus.cc:2749] T 2c240553ce044eedb41541d72b9475d7 P cd75a17ab2604397adab03bb8b5fd75c [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:19:55.404790  6844 leader_election.cc:304] T d33d5ee8ef6f415593d8df52063161ad P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:19:55.405194 10523 leader_election.cc:290] T bb7fa124c3bf4ef9ab65a407cb008441 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:55.405441 10063 leader_election.cc:290] T 07a92dd554674067a83a9cb68c4773f2 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 10 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
W20260709 13:19:55.406476  6773 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:55.349900 10486 raft_consensus.cc:515] T 8c7f33e544204fbaac4078e3e83bbf4e P b7ab4784c7344b939bc36f639286f377 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:55.417662  6803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb7fa124c3bf4ef9ab65a407cb008441" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:19:55.421571  6803 raft_consensus.cc:2468] T bb7fa124c3bf4ef9ab65a407cb008441 P b7ab4784c7344b939bc36f639286f377 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in term 9.
I20260709 13:19:55.419147 10303 raft_consensus.cc:2804] T f3f9c2e2bf644115957398fe4c9459db P b7ab4784c7344b939bc36f639286f377 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:19:55.336853 10249 consensus_queue.cc:237] T 3411566abe2d4c9bb4b2adfdd05e6f17 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:55.409462  6630 catalog_manager.cc:5697] T 7a734b5ab7834e05a8c422208acc58b1 P b7ab4784c7344b939bc36f639286f377 reported cstate change: term changed from 1 to 4, leader changed from ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65) to b7ab4784c7344b939bc36f639286f377 (127.5.126.66). New cstate: current_term: 4 leader_uuid: "b7ab4784c7344b939bc36f639286f377" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } health_report { overall_health: HEALTHY } } }
W20260709 13:19:55.425057  6770 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 69578.5us
W20260709 13:19:55.428742  6697 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 51660.6us
W20260709 13:19:55.437549  6846 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:55.375595 10435 raft_consensus.cc:515] T 4b8cacb381b746da8d0049b0a83b41dd P cd75a17ab2604397adab03bb8b5fd75c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:19:55.444458  6844 leader_election.cc:304] T f4b8bd455d5a47c18a1380839c6e0d61 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:19:55.444968 10526 consensus_queue.cc:1048] T de3186201e1a40d0b335eeb8b4e256e0 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.070s
I20260709 13:19:55.445886 10457 leader_election.cc:290] T bb7fa124c3bf4ef9ab65a407cb008441 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:19:55.446038 10442 raft_consensus.cc:2749] T f4b8bd455d5a47c18a1380839c6e0d61 P cd75a17ab2604397adab03bb8b5fd75c [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:19:55.447325 10447 consensus_queue.cc:1048] T f03d0dbf16864ca4bc1bb5e4c0334c0f P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:19:55.448335 10487 leader_election.cc:290] T b56bf91d90824c959e21e0cee5ba1816 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 9 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:55.449112 10447 consensus_queue.cc:1048] T c4db81d9d329422bb3b4160ca4ac2d1d P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:19:55.449898  6770 leader_election.cc:304] T bd6869f07b5a4885a0b99fbe60c3b175 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
I20260709 13:19:55.350312 10421 consensus_queue.cc:260] T 9e326172347f45e99a0d482b5d8ef768 P ccd8a4c3bfe3413cb2ae219b09aea832 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:55.454190  7498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb7fa124c3bf4ef9ab65a407cb008441" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:19:55.457660  7498 raft_consensus.cc:2468] T bb7fa124c3bf4ef9ab65a407cb008441 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 9.
I20260709 13:19:55.463436  6846 leader_election.cc:304] T bb7fa124c3bf4ef9ab65a407cb008441 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:19:55.475122 10240 raft_consensus.cc:697] T 7c44c4849aa54f2b94d1f1bef9ed546f P b7ab4784c7344b939bc36f639286f377 [term 12 LEADER]: Becoming Leader. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
I20260709 13:19:55.476729 10240 consensus_queue.cc:237] T 7c44c4849aa54f2b94d1f1bef9ed546f P b7ab4784c7344b939bc36f639286f377 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:55.405720 10538 consensus_queue.cc:1059] T 853ac0a8cbd64ce99457f170216d4d0f P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.102s
I20260709 13:19:55.485127 10452 raft_consensus.cc:3055] T 8c7f33e544204fbaac4078e3e83bbf4e P ccd8a4c3bfe3413cb2ae219b09aea832 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:19:55.485669 10063 consensus_queue.cc:1048] T 34f36d59d88f40fe8a2805e604fc6c0a P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:19:55.455660 10275 raft_consensus.cc:2749] T 8c7f33e544204fbaac4078e3e83bbf4e P cd75a17ab2604397adab03bb8b5fd75c [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:19:55.440752 10436 raft_consensus.cc:2749] T d33d5ee8ef6f415593d8df52063161ad P cd75a17ab2604397adab03bb8b5fd75c [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:19:55.482157  6772 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 61334us
I20260709 13:19:55.500407  6730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09c2a98de1a4decabd0ff900dd44caa" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:19:55.501754  6725 raft_consensus.cc:1275] T 3d65025eea89441290d85dd053810e31 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 9 FOLLOWER]: Refusing update from remote peer b7ab4784c7344b939bc36f639286f377: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 9 index: 4. (index mismatch)
I20260709 13:19:55.460330 10303 raft_consensus.cc:697] T f3f9c2e2bf644115957398fe4c9459db P b7ab4784c7344b939bc36f639286f377 [term 9 LEADER]: Becoming Leader. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
I20260709 13:19:55.482432 10418 raft_consensus.cc:2804] T bd6869f07b5a4885a0b99fbe60c3b175 P b7ab4784c7344b939bc36f639286f377 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:19:55.506707  6727 raft_consensus.cc:1240] T d8292e16e5654be6bc408560cf256aaa P ccd8a4c3bfe3413cb2ae219b09aea832 [term 13 FOLLOWER]: Rejecting Update request from peer b7ab4784c7344b939bc36f639286f377 for earlier term 12. Current term is 13. Ops: []
I20260709 13:19:55.509131  6874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90d42e216d9741e190bca19a781291fd" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:19:55.509496  6724 raft_consensus.cc:1275] T 427c124d773f483294511e80fe340075 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 9 FOLLOWER]: Refusing update from remote peer b7ab4784c7344b939bc36f639286f377: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 13:19:55.489812 10457 raft_consensus.cc:2804] T bb7fa124c3bf4ef9ab65a407cb008441 P cd75a17ab2604397adab03bb8b5fd75c [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:19:55.507637  6695 leader_election.cc:304] T 20f6842e26174571996b8dea4151d4be P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
I20260709 13:19:55.512054  6874 raft_consensus.cc:3060] T 90d42e216d9741e190bca19a781291fd P cd75a17ab2604397adab03bb8b5fd75c [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:55.515380  7466 leader_election.cc:304] T bb7fa124c3bf4ef9ab65a407cb008441 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, b7ab4784c7344b939bc36f639286f377; no voters: 
I20260709 13:19:55.518222  6873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4b8bd455d5a47c18a1380839c6e0d61" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:19:55.518930  6873 raft_consensus.cc:2468] T f4b8bd455d5a47c18a1380839c6e0d61 P cd75a17ab2604397adab03bb8b5fd75c [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 8.
I20260709 13:19:55.485728 10452 raft_consensus.cc:740] T 8c7f33e544204fbaac4078e3e83bbf4e P ccd8a4c3bfe3413cb2ae219b09aea832 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
I20260709 13:19:55.506034  6630 catalog_manager.cc:5697] T 2c240553ce044eedb41541d72b9475d7 P b7ab4784c7344b939bc36f639286f377 reported cstate change: term changed from 1 to 5. New cstate: current_term: 5 leader_uuid: "b7ab4784c7344b939bc36f639286f377" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:55.519901  6732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3022224cc81473690653a83d4e99470" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
W20260709 13:19:55.519835  6772 connection.cc:256] RPC call timeout handler was delayed by -1.436867649000078s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20520000000000002s for a response
I20260709 13:19:55.525871  6876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce4f062dcd314d43a63ca74067cb5ee3" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:19:55.526324  6730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b56bf91d90824c959e21e0cee5ba1816" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:19:55.527617  6872 raft_consensus.cc:1275] T f03d0dbf16864ca4bc1bb5e4c0334c0f P cd75a17ab2604397adab03bb8b5fd75c [term 8 FOLLOWER]: Refusing update from remote peer b7ab4784c7344b939bc36f639286f377: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
W20260709 13:19:55.526671  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 82616.9us
W20260709 13:19:55.511843 10539 log.cc:927] Time spent T 404190ce4ce94cecbfcb6ea9d1dd8626 P 7ba59cc884714e8aa5f3f0ecaed84cbb: Append to log took a long time: real 0.073s	user 0.001s	sys 0.000s
I20260709 13:19:55.499960 10447 raft_consensus.cc:493] T 3a485a995abc4807b6e511e45419f737 P b7ab4784c7344b939bc36f639286f377 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:55.530182  7500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce4f062dcd314d43a63ca74067cb5ee3" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:19:55.528789  6725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a92dd554674067a83a9cb68c4773f2" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:19:55.533036  7503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1528ab62b6fe4e3099d08f141afee116" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:19:55.533089  6772 leader_election.cc:304] T b3f13b31a1f84f0d89d007eadd57924c P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:19:55.514375 10418 raft_consensus.cc:493] T bd6869f07b5a4885a0b99fbe60c3b175 P b7ab4784c7344b939bc36f639286f377 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:55.513447 10457 raft_consensus.cc:493] T bb7fa124c3bf4ef9ab65a407cb008441 P cd75a17ab2604397adab03bb8b5fd75c [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:55.557471  6725 raft_consensus.cc:3060] T 07a92dd554674067a83a9cb68c4773f2 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:55.523005 10523 raft_consensus.cc:2804] T bb7fa124c3bf4ef9ab65a407cb008441 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:19:55.523247 10529 raft_consensus.cc:493] T be1a92657f494cac8dd227d152f50151 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:55.569677  6873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "713b5728a197487c9300b310ab94e5a3" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:19:55.558744  6876 raft_consensus.cc:2410] T ce4f062dcd314d43a63ca74067cb5ee3 P cd75a17ab2604397adab03bb8b5fd75c [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7ab4784c7344b939bc36f639286f377 for term 10 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 7.
I20260709 13:19:55.559307  6844 leader_election.cc:304] T 30e88460611e47b2ba16a46a30b5f416 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:19:55.560714  6772 leader_election.cc:304] T 4f00a2e87e56452083b759f60d461ee3 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:19:55.550570 10387 raft_consensus.cc:493] T 713b5728a197487c9300b310ab94e5a3 P cd75a17ab2604397adab03bb8b5fd75c [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:55.568686  7496 raft_consensus.cc:1275] T 427c124d773f483294511e80fe340075 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 9 FOLLOWER]: Refusing update from remote peer b7ab4784c7344b939bc36f639286f377: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 13:19:55.573132  6874 raft_consensus.cc:2468] T 90d42e216d9741e190bca19a781291fd P cd75a17ab2604397adab03bb8b5fd75c [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 10.
W20260709 13:19:55.573241  6695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 73415.2us
I20260709 13:19:55.556326 10418 raft_consensus.cc:3060] T bd6869f07b5a4885a0b99fbe60c3b175 P b7ab4784c7344b939bc36f639286f377 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:19:55.589680  6697 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 63316.6us
I20260709 13:19:55.558845 10457 raft_consensus.cc:3060] T bb7fa124c3bf4ef9ab65a407cb008441 P cd75a17ab2604397adab03bb8b5fd75c [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:19:55.591665  6698 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:55.608253  6695 leader_election.cc:304] T e77e330a82df4b43a745d57a68f6f057 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
I20260709 13:19:55.562453 10523 raft_consensus.cc:493] T bb7fa124c3bf4ef9ab65a407cb008441 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:55.584408 10385 raft_consensus.cc:3060] T b3f13b31a1f84f0d89d007eadd57924c P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:55.562569 10447 raft_consensus.cc:515] T 3a485a995abc4807b6e511e45419f737 P b7ab4784c7344b939bc36f639286f377 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:55.610823 10526 raft_consensus.cc:2749] T b3f13b31a1f84f0d89d007eadd57924c P b7ab4784c7344b939bc36f639286f377 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
W20260709 13:19:55.650317  6845 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:55.620539 10523 raft_consensus.cc:3060] T bb7fa124c3bf4ef9ab65a407cb008441 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:55.653278  6799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bf4668eeb70467fb3dc5a0289233b3c" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:19:55.575593 10529 raft_consensus.cc:515] T be1a92657f494cac8dd227d152f50151 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:19:55.657150  6807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d65025eea89441290d85dd053810e31" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:19:55.662688  6803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44bde925b2e541b69890d70715b85176" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
W20260709 13:19:55.671741  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 112547us
W20260709 13:19:55.671770  6772 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.68:45071, user_credentials={real_user=slave}} blocked reactor thread for 111142us
I20260709 13:19:55.672209  6697 leader_election.cc:304] T 4275cf08e63345f993bce8664eada830 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377
I20260709 13:19:55.697183  6806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b3759de40694069b13c0f8bd40e5709" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:19:55.646569 10375 raft_consensus.cc:493] T d8cee0accdb8499c86d4414b72565a38 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:19:55.697423  6800 raft_consensus.cc:1240] T a3022224cc81473690653a83d4e99470 P b7ab4784c7344b939bc36f639286f377 [term 11 FOLLOWER]: Rejecting Update request from peer ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 10. Current term is 11. Ops: []
I20260709 13:19:55.649389 10436 raft_consensus.cc:2749] T 30e88460611e47b2ba16a46a30b5f416 P cd75a17ab2604397adab03bb8b5fd75c [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:19:55.649082 10538 raft_consensus.cc:2804] T e77e330a82df4b43a745d57a68f6f057 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 12 FOLLOWER]: Leader election won for term 12
W20260709 13:19:55.699544  6770 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 66118.7us
I20260709 13:19:55.714156  6806 raft_consensus.cc:3060] T 9b3759de40694069b13c0f8bd40e5709 P b7ab4784c7344b939bc36f639286f377 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:55.653316 10324 raft_consensus.cc:493] T 2c240553ce044eedb41541d72b9475d7 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:55.630158 10387 raft_consensus.cc:515] T 713b5728a197487c9300b310ab94e5a3 P cd75a17ab2604397adab03bb8b5fd75c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:55.616524 10303 consensus_queue.cc:237] T f3f9c2e2bf644115957398fe4c9459db P b7ab4784c7344b939bc36f639286f377 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:55.730948  6799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5be3a11b23d4ea9b08300a2789821c7" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:19:55.733522  6800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8292e16e5654be6bc408560cf256aaa" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:19:55.616693 10452 consensus_queue.cc:260] T 8c7f33e544204fbaac4078e3e83bbf4e P ccd8a4c3bfe3413cb2ae219b09aea832 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:55.737073  6772 leader_election.cc:304] T ce4f062dcd314d43a63ca74067cb5ee3 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:19:55.759639  6730 raft_consensus.cc:2468] T b56bf91d90824c959e21e0cee5ba1816 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 9.
W20260709 13:19:55.810215  6697 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 160914us
I20260709 13:19:55.815430  6873 raft_consensus.cc:2468] T 713b5728a197487c9300b310ab94e5a3 P cd75a17ab2604397adab03bb8b5fd75c [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 10.
W20260709 13:19:55.816901  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 79720.1us
I20260709 13:19:55.816151 10436 raft_consensus.cc:493] T d8292e16e5654be6bc408560cf256aaa P cd75a17ab2604397adab03bb8b5fd75c [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:19:55.821574  6697 leader_election.cc:304] T de3186201e1a40d0b335eeb8b4e256e0 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377
I20260709 13:19:55.729686 10538 raft_consensus.cc:697] T e77e330a82df4b43a745d57a68f6f057 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 12 LEADER]: Becoming Leader. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
I20260709 13:19:55.828465  6800 raft_consensus.cc:1240] T f09c2a98de1a4decabd0ff900dd44caa P b7ab4784c7344b939bc36f639286f377 [term 12 FOLLOWER]: Rejecting Update request from peer ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 11. Current term is 12. Ops: []
I20260709 13:19:55.715585  9836 consensus_queue.cc:1048] T 3d65025eea89441290d85dd053810e31 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.104s
I20260709 13:19:55.823341  6803 raft_consensus.cc:1240] T 90d42e216d9741e190bca19a781291fd P b7ab4784c7344b939bc36f639286f377 [term 10 FOLLOWER]: Rejecting Update request from peer ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 9. Current term is 10. Ops: []
I20260709 13:19:55.830217  6695 leader_election.cc:304] T 3d65025eea89441290d85dd053810e31 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:19:55.831189 10435 leader_election.cc:290] T 4b8cacb381b746da8d0049b0a83b41dd P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:19:55.711406 10375 raft_consensus.cc:515] T d8cee0accdb8499c86d4414b72565a38 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:19:55.832916  6876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6869f07b5a4885a0b99fbe60c3b175" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 11 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:19:55.811655 10237 raft_consensus.cc:493] T be1a92657f494cac8dd227d152f50151 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:55.837699  7502 raft_consensus.cc:1275] T be1a92657f494cac8dd227d152f50151 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 12 FOLLOWER]: Refusing update from remote peer b7ab4784c7344b939bc36f639286f377: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:19:55.815415 10324 raft_consensus.cc:515] T 2c240553ce044eedb41541d72b9475d7 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:55.845815  6877 raft_consensus.cc:1275] T 427c124d773f483294511e80fe340075 P cd75a17ab2604397adab03bb8b5fd75c [term 9 FOLLOWER]: Refusing update from remote peer b7ab4784c7344b939bc36f639286f377: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
W20260709 13:19:55.853188  6772 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.68:45071, user_credentials={real_user=slave}} blocked reactor thread for 116216us
I20260709 13:19:55.858741  6875 raft_consensus.cc:1240] T e77e330a82df4b43a745d57a68f6f057 P cd75a17ab2604397adab03bb8b5fd75c [term 12 FOLLOWER]: Rejecting Update request from peer b7ab4784c7344b939bc36f639286f377 for earlier term 11. Current term is 12. Ops: []
I20260709 13:19:55.836297 10547 raft_consensus.cc:2804] T 20f6842e26174571996b8dea4151d4be P ccd8a4c3bfe3413cb2ae219b09aea832 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:19:55.829418 10436 raft_consensus.cc:515] T d8292e16e5654be6bc408560cf256aaa P cd75a17ab2604397adab03bb8b5fd75c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:55.869422  6872 raft_consensus.cc:1275] T c4db81d9d329422bb3b4160ca4ac2d1d P cd75a17ab2604397adab03bb8b5fd75c [term 9 FOLLOWER]: Refusing update from remote peer b7ab4784c7344b939bc36f639286f377: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:19:55.853277 10452 raft_consensus.cc:3060] T 8c7f33e544204fbaac4078e3e83bbf4e P ccd8a4c3bfe3413cb2ae219b09aea832 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:19:55.877866 10546 log.cc:927] Time spent T 4275cf08e63345f993bce8664eada830 P b7ab4784c7344b939bc36f639286f377: Append to log took a long time: real 0.289s	user 0.001s	sys 0.000s
I20260709 13:19:55.859189 10552 raft_consensus.cc:2749] T 4f00a2e87e56452083b759f60d461ee3 P b7ab4784c7344b939bc36f639286f377 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
W20260709 13:19:55.912910  6772 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.68:45071, user_credentials={real_user=slave}} blocked reactor thread for 50395.9us
W20260709 13:19:55.897150 10558 log.cc:927] Time spent T 17587d6730594da4a56fa13a353232a1 P 7ba59cc884714e8aa5f3f0ecaed84cbb: Append to log took a long time: real 0.181s	user 0.001s	sys 0.000s
W20260709 13:19:55.919875  6698 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:55.888672 10352 raft_consensus.cc:3055] T 7c44c4849aa54f2b94d1f1bef9ed546f P ccd8a4c3bfe3413cb2ae219b09aea832 [term 11 LEADER]: Stepping down as leader of term 11
W20260709 13:19:55.910665 10549 log.cc:927] Time spent T ce4f062dcd314d43a63ca74067cb5ee3 P 7ba59cc884714e8aa5f3f0ecaed84cbb: Append to log took a long time: real 0.291s	user 0.000s	sys 0.002s
I20260709 13:19:55.933573  6872 raft_consensus.cc:1275] T 34f36d59d88f40fe8a2805e604fc6c0a P cd75a17ab2604397adab03bb8b5fd75c [term 7 FOLLOWER]: Refusing update from remote peer b7ab4784c7344b939bc36f639286f377: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:19:55.868014 10237 raft_consensus.cc:515] T be1a92657f494cac8dd227d152f50151 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
W20260709 13:19:55.934703  6770 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 180821us
W20260709 13:19:55.935559  6773 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:55.940558  6695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 114522us
I20260709 13:19:55.859319 10550 consensus_queue.cc:1048] T 713b5728a197487c9300b310ab94e5a3 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.282s
W20260709 13:19:55.935146 10548 log.cc:927] Time spent T fe20b4b48823486ca3b9c648db6ce8aa P ccd8a4c3bfe3413cb2ae219b09aea832: Append to log took a long time: real 0.302s	user 0.002s	sys 0.000s
W20260709 13:19:55.968639  6697 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 147140us
I20260709 13:19:55.968742  6804 raft_consensus.cc:1240] T 3411566abe2d4c9bb4b2adfdd05e6f17 P b7ab4784c7344b939bc36f639286f377 [term 8 LEADER]: Rejecting Update request from peer ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 7. Current term is 8. Ops: []
I20260709 13:19:55.970139  6697 leader_election.cc:304] T 4d9def8b32fd443aa94ab1420b06837b P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:19:55.937450 10447 leader_election.cc:290] T 3a485a995abc4807b6e511e45419f737 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:55.938002 10352 raft_consensus.cc:740] T 7c44c4849aa54f2b94d1f1bef9ed546f P ccd8a4c3bfe3413cb2ae219b09aea832 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
I20260709 13:19:55.983192  6770 leader_election.cc:304] T b56bf91d90824c959e21e0cee5ba1816 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
I20260709 13:19:55.955915 10248 raft_consensus.cc:3055] T f3f9c2e2bf644115957398fe4c9459db P ccd8a4c3bfe3413cb2ae219b09aea832 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:19:55.987391  6630 catalog_manager.cc:5697] T 4275cf08e63345f993bce8664eada830 P b7ab4784c7344b939bc36f639286f377 reported cstate change: term changed from 1 to 3, leader changed from ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65) to b7ab4784c7344b939bc36f639286f377 (127.5.126.66). New cstate: current_term: 3 leader_uuid: "b7ab4784c7344b939bc36f639286f377" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:55.980468 10560 raft_consensus.cc:2749] T ce4f062dcd314d43a63ca74067cb5ee3 P b7ab4784c7344b939bc36f639286f377 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:19:55.934512 10240 consensus_queue.cc:1048] T 427c124d773f483294511e80fe340075 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.047s
I20260709 13:19:56.001156 10554 raft_consensus.cc:493] T ab432e62819d499eaaf3dd55481dd930 P b7ab4784c7344b939bc36f639286f377 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:56.006911  6873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09c2a98de1a4decabd0ff900dd44caa" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:19:56.021203  6873 raft_consensus.cc:3060] T f09c2a98de1a4decabd0ff900dd44caa P cd75a17ab2604397adab03bb8b5fd75c [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:19:56.022224  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 63580.4us
I20260709 13:19:55.962141 10487 consensus_queue.cc:1059] T d8292e16e5654be6bc408560cf256aaa P b7ab4784c7344b939bc36f639286f377 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.045s
I20260709 13:19:56.001302 10537 raft_consensus.cc:2804] T 4275cf08e63345f993bce8664eada830 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:19:55.998155 10248 raft_consensus.cc:740] T f3f9c2e2bf644115957398fe4c9459db P ccd8a4c3bfe3413cb2ae219b09aea832 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
W20260709 13:19:56.035732 10564 log.cc:927] Time spent T 4275cf08e63345f993bce8664eada830 P ccd8a4c3bfe3413cb2ae219b09aea832: Append to log took a long time: real 0.122s	user 0.001s	sys 0.000s
I20260709 13:19:56.035537  6877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a92dd554674067a83a9cb68c4773f2" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:19:56.040398  6880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3022224cc81473690653a83d4e99470" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:19:56.024797 10387 leader_election.cc:290] T 713b5728a197487c9300b310ab94e5a3 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
W20260709 13:19:56.043002  6695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 97495us
I20260709 13:19:56.044219  6725 raft_consensus.cc:2468] T 07a92dd554674067a83a9cb68c4773f2 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 10.
I20260709 13:19:56.076740  6878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b56bf91d90824c959e21e0cee5ba1816" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:19:56.077582  6878 raft_consensus.cc:2393] T b56bf91d90824c959e21e0cee5ba1816 P cd75a17ab2604397adab03bb8b5fd75c [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate b7ab4784c7344b939bc36f639286f377 in current term 9: Already voted for candidate cd75a17ab2604397adab03bb8b5fd75c in this term.
I20260709 13:19:56.078909  6770 leader_election.cc:304] T 07a92dd554674067a83a9cb68c4773f2 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
W20260709 13:19:56.041750 10562 log.cc:927] Time spent T f03d0dbf16864ca4bc1bb5e4c0334c0f P ccd8a4c3bfe3413cb2ae219b09aea832: Append to log took a long time: real 0.154s	user 0.000s	sys 0.000s
I20260709 13:19:56.041132 10534 raft_consensus.cc:2804] T b56bf91d90824c959e21e0cee5ba1816 P b7ab4784c7344b939bc36f639286f377 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:19:56.040235 10421 raft_consensus.cc:3060] T 9e326172347f45e99a0d482b5d8ef768 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:56.077158 10352 consensus_queue.cc:260] T 7c44c4849aa54f2b94d1f1bef9ed546f P ccd8a4c3bfe3413cb2ae219b09aea832 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:56.050463  6880 raft_consensus.cc:3060] T a3022224cc81473690653a83d4e99470 P cd75a17ab2604397adab03bb8b5fd75c [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:55.915800 10538 consensus_queue.cc:237] T e77e330a82df4b43a745d57a68f6f057 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 11.5, Last appended by leader: 5, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } }
W20260709 13:19:56.040943 10544 log.cc:927] Time spent T 7887766dc6784fcaa42b35c05fea7a99 P b7ab4784c7344b939bc36f639286f377: Append to log took a long time: real 0.329s	user 0.001s	sys 0.001s
W20260709 13:19:56.041013 10541 log.cc:927] Time spent T 17587d6730594da4a56fa13a353232a1 P b7ab4784c7344b939bc36f639286f377: Append to log took a long time: real 0.307s	user 0.002s	sys 0.000s
W20260709 13:19:56.039639 10446 consensus_meta.cc:287] T 1528ab62b6fe4e3099d08f141afee116 P b7ab4784c7344b939bc36f639286f377: Time spent flushing consensus metadata: real 0.745s	user 0.011s	sys 0.007s
I20260709 13:19:56.015395 10547 raft_consensus.cc:697] T 20f6842e26174571996b8dea4151d4be P ccd8a4c3bfe3413cb2ae219b09aea832 [term 11 LEADER]: Becoming Leader. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
I20260709 13:19:56.029861 10561 consensus_queue.cc:1048] T 427c124d773f483294511e80fe340075 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.069s
I20260709 13:19:56.041854 10248 consensus_queue.cc:260] T f3f9c2e2bf644115957398fe4c9459db P ccd8a4c3bfe3413cb2ae219b09aea832 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
W20260709 13:19:56.092779  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 50516.5us
W20260709 13:19:56.086007 10565 log.cc:927] Time spent T a1704639a875409b9959353527b3fd68 P cd75a17ab2604397adab03bb8b5fd75c: Append to log took a long time: real 0.188s	user 0.001s	sys 0.001s
W20260709 13:19:56.089440 10567 log.cc:927] Time spent T 17587d6730594da4a56fa13a353232a1 P ccd8a4c3bfe3413cb2ae219b09aea832: Append to log took a long time: real 0.116s	user 0.000s	sys 0.001s
W20260709 13:19:56.107257 10553 log.cc:927] Time spent T 7c44c4849aa54f2b94d1f1bef9ed546f P b7ab4784c7344b939bc36f639286f377: Append to log took a long time: real 0.281s	user 0.002s	sys 0.000s
I20260709 13:19:56.103297  6806 raft_consensus.cc:2468] T 9b3759de40694069b13c0f8bd40e5709 P b7ab4784c7344b939bc36f639286f377 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 10.
I20260709 13:19:56.088678 10557 raft_consensus.cc:3055] T d8292e16e5654be6bc408560cf256aaa P b7ab4784c7344b939bc36f639286f377 [term 12 LEADER]: Stepping down as leader of term 12
W20260709 13:19:56.092207 10556 log.cc:927] Time spent T 44bde925b2e541b69890d70715b85176 P ccd8a4c3bfe3413cb2ae219b09aea832: Append to log took a long time: real 0.223s	user 0.001s	sys 0.000s
I20260709 13:19:56.110523  6772 leader_election.cc:304] T f4b8bd455d5a47c18a1380839c6e0d61 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:19:56.144948 10436 leader_election.cc:290] T d8292e16e5654be6bc408560cf256aaa P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:19:56.094987 10352 raft_consensus.cc:3060] T 7c44c4849aa54f2b94d1f1bef9ed546f P ccd8a4c3bfe3413cb2ae219b09aea832 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:56.147239  6878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a485a995abc4807b6e511e45419f737" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:19:56.047503  6873 raft_consensus.cc:2468] T f09c2a98de1a4decabd0ff900dd44caa P cd75a17ab2604397adab03bb8b5fd75c [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 12.
I20260709 13:19:56.107082 10571 consensus_queue.cc:1059] T a3022224cc81473690653a83d4e99470 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.004s
I20260709 13:19:56.107271 10375 leader_election.cc:290] T d8cee0accdb8499c86d4414b72565a38 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
W20260709 13:19:56.210559  6698 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:56.097074 10237 leader_election.cc:290] T be1a92657f494cac8dd227d152f50151 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:19:56.100414 10324 leader_election.cc:290] T 2c240553ce044eedb41541d72b9475d7 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:56.088220 10574 raft_consensus.cc:2749] T 3d65025eea89441290d85dd053810e31 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:19:56.026878 10554 raft_consensus.cc:515] T ab432e62819d499eaaf3dd55481dd930 P b7ab4784c7344b939bc36f639286f377 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:56.213390 10526 raft_consensus.cc:2804] T 07a92dd554674067a83a9cb68c4773f2 P b7ab4784c7344b939bc36f639286f377 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:19:56.170079 10561 consensus_queue.cc:1243] T 427c124d773f483294511e80fe340075 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Peer ccd8a4c3bfe3413cb2ae219b09aea832 log is divergent from this leader: its last log entry 8.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
W20260709 13:19:56.257893  6772 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 147443us
W20260709 13:19:56.276793  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 46008.5us
I20260709 13:19:56.245565  6880 raft_consensus.cc:2468] T a3022224cc81473690653a83d4e99470 P cd75a17ab2604397adab03bb8b5fd75c [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 11.
I20260709 13:19:56.219731 10557 raft_consensus.cc:740] T d8292e16e5654be6bc408560cf256aaa P b7ab4784c7344b939bc36f639286f377 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
I20260709 13:19:56.222745 10534 raft_consensus.cc:697] T b56bf91d90824c959e21e0cee5ba1816 P b7ab4784c7344b939bc36f639286f377 [term 9 LEADER]: Becoming Leader. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
W20260709 13:19:56.273209  6726 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.611s	user 0.012s	sys 0.018s
W20260709 13:19:56.286707  6726 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.637s	user 0.012s	sys 0.018s
I20260709 13:19:56.288393  6772 leader_election.cc:304] T 90d42e216d9741e190bca19a781291fd P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: ccd8a4c3bfe3413cb2ae219b09aea832
W20260709 13:19:56.269294 10541 log.cc:927] Time spent T 17587d6730594da4a56fa13a353232a1 P b7ab4784c7344b939bc36f639286f377: Append to log took a long time: real 0.089s	user 0.000s	sys 0.000s
I20260709 13:19:56.158536 10446 raft_consensus.cc:515] T 1528ab62b6fe4e3099d08f141afee116 P b7ab4784c7344b939bc36f639286f377 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:19:56.300966  6878 raft_consensus.cc:1275] T 7c37d41cd9164c15a6826ca62a851a69 P cd75a17ab2604397adab03bb8b5fd75c [term 8 FOLLOWER]: Refusing update from remote peer b7ab4784c7344b939bc36f639286f377: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
W20260709 13:19:56.282776 10565 log.cc:927] Time spent T a1704639a875409b9959353527b3fd68 P cd75a17ab2604397adab03bb8b5fd75c: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260709 13:19:56.278990 10447 raft_consensus.cc:2804] T f4b8bd455d5a47c18a1380839c6e0d61 P b7ab4784c7344b939bc36f639286f377 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 13:19:56.314546  6874 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.584s	user 0.009s	sys 0.013s
W20260709 13:19:56.315202  6874 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.590s	user 0.009s	sys 0.013s
I20260709 13:19:56.316887  6844 leader_election.cc:304] T 4f00a2e87e56452083b759f60d461ee3 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, b7ab4784c7344b939bc36f639286f377
I20260709 13:19:56.284847 10526 raft_consensus.cc:697] T 07a92dd554674067a83a9cb68c4773f2 P b7ab4784c7344b939bc36f639286f377 [term 10 LEADER]: Becoming Leader. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
I20260709 13:19:56.325541  6805 raft_consensus.cc:2393] T 1528ab62b6fe4e3099d08f141afee116 P b7ab4784c7344b939bc36f639286f377 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in current term 10: Already voted for candidate b7ab4784c7344b939bc36f639286f377 in this term.
I20260709 13:19:56.332440  6799 raft_consensus.cc:1240] T f3f9c2e2bf644115957398fe4c9459db P b7ab4784c7344b939bc36f639286f377 [term 9 LEADER]: Rejecting Update request from peer ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 8. Current term is 9. Ops: []
I20260709 13:19:56.345666  6878 raft_consensus.cc:1275] T 3d65025eea89441290d85dd053810e31 P cd75a17ab2604397adab03bb8b5fd75c [term 9 FOLLOWER]: Refusing update from remote peer b7ab4784c7344b939bc36f639286f377: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 4. (term mismatch)
I20260709 13:19:56.303588 10248 raft_consensus.cc:3060] T f3f9c2e2bf644115957398fe4c9459db P ccd8a4c3bfe3413cb2ae219b09aea832 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:19:56.356170  6697 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 386074us
I20260709 13:19:56.313486 10447 raft_consensus.cc:493] T f4b8bd455d5a47c18a1380839c6e0d61 P b7ab4784c7344b939bc36f639286f377 [term 8 FOLLOWER]: Starting leader election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:19:56.357482  6878 pending_rounds.cc:85] T 3d65025eea89441290d85dd053810e31 P cd75a17ab2604397adab03bb8b5fd75c: Aborting all ops after (but not including) 3
I20260709 13:19:56.367416  6878 pending_rounds.cc:107] T 3d65025eea89441290d85dd053810e31 P cd75a17ab2604397adab03bb8b5fd75c: Aborting uncommitted NO_OP operation due to leader change: 7.4
I20260709 13:19:56.367789  6878 raft_consensus.cc:2889] T 3d65025eea89441290d85dd053810e31 P cd75a17ab2604397adab03bb8b5fd75c [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:19:56.363044  6773 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:56.323470 10487 raft_consensus.cc:2804] T 90d42e216d9741e190bca19a781291fd P b7ab4784c7344b939bc36f639286f377 [term 10 FOLLOWER]: Leader election won for term 10
W20260709 13:19:56.364100  6698 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:56.371762  6697 leader_election.cc:304] T 24ee15416e3145beaa1b8183453729a3 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
W20260709 13:19:56.389621 10578 log.cc:927] Time spent T f09c2a98de1a4decabd0ff900dd44caa P ccd8a4c3bfe3413cb2ae219b09aea832: Append to log took a long time: real 0.075s	user 0.000s	sys 0.001s
W20260709 13:19:56.390229 10583 log.cc:927] Time spent T d8cee0accdb8499c86d4414b72565a38 P b7ab4784c7344b939bc36f639286f377: Append to log took a long time: real 0.104s	user 0.000s	sys 0.001s
I20260709 13:19:56.391033 10313 consensus_queue.cc:1048] T f03d0dbf16864ca4bc1bb5e4c0334c0f P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.107s
I20260709 13:19:56.353283 10547 consensus_queue.cc:237] T 20f6842e26174571996b8dea4151d4be P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:56.372113 10447 raft_consensus.cc:3060] T f4b8bd455d5a47c18a1380839c6e0d61 P b7ab4784c7344b939bc36f639286f377 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:56.404839 10534 consensus_queue.cc:237] T b56bf91d90824c959e21e0cee5ba1816 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:56.409456 10303 consensus_queue.cc:1048] T 427c124d773f483294511e80fe340075 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:19:56.408421 10552 consensus_queue.cc:1048] T c4db81d9d329422bb3b4160ca4ac2d1d P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
W20260709 13:19:56.378046 10579 log.cc:927] Time spent T 3411566abe2d4c9bb4b2adfdd05e6f17 P b7ab4784c7344b939bc36f639286f377: Append to log took a long time: real 0.053s	user 0.001s	sys 0.000s
W20260709 13:19:56.421020  6730 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.582s	user 0.009s	sys 0.023s
W20260709 13:19:56.421470  6730 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.583s	user 0.009s	sys 0.023s
W20260709 13:19:56.422191  7468 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.679s	user 0.014s	sys 0.018s
W20260709 13:19:56.422508  7468 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.679s	user 0.014s	sys 0.018s
W20260709 13:19:56.458309  6770 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 95180.4us
W20260709 13:19:56.470571  6772 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 94840.7us
I20260709 13:19:56.376430 10557 consensus_queue.cc:260] T d8292e16e5654be6bc408560cf256aaa P b7ab4784c7344b939bc36f639286f377 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
W20260709 13:19:56.482430 10545 log.cc:927] Time spent T 1528ab62b6fe4e3099d08f141afee116 P 7ba59cc884714e8aa5f3f0ecaed84cbb: Append to log took a long time: real 0.910s	user 0.012s	sys 0.030s
I20260709 13:19:56.484375  6772 leader_election.cc:304] T 713b5728a197487c9300b310ab94e5a3 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:19:56.489547 10313 raft_consensus.cc:2804] T 713b5728a197487c9300b310ab94e5a3 P b7ab4784c7344b939bc36f639286f377 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:19:56.490161 10313 raft_consensus.cc:493] T 713b5728a197487c9300b310ab94e5a3 P b7ab4784c7344b939bc36f639286f377 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:56.490644 10313 raft_consensus.cc:3060] T 713b5728a197487c9300b310ab94e5a3 P b7ab4784c7344b939bc36f639286f377 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:56.495882 10584 consensus_queue.cc:1048] T 34f36d59d88f40fe8a2805e604fc6c0a P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.015s
I20260709 13:19:56.474498 10487 raft_consensus.cc:697] T 90d42e216d9741e190bca19a781291fd P b7ab4784c7344b939bc36f639286f377 [term 10 LEADER]: Becoming Leader. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
W20260709 13:19:56.531227 10523 consensus_meta.cc:287] T bb7fa124c3bf4ef9ab65a407cb008441 P 7ba59cc884714e8aa5f3f0ecaed84cbb: Time spent flushing consensus metadata: real 0.859s	user 0.014s	sys 0.000s
W20260709 13:19:56.540882 10418 consensus_meta.cc:287] T bd6869f07b5a4885a0b99fbe60c3b175 P b7ab4784c7344b939bc36f639286f377: Time spent flushing consensus metadata: real 0.918s	user 0.013s	sys 0.000s
W20260709 13:19:56.544667 10385 consensus_meta.cc:287] T b3f13b31a1f84f0d89d007eadd57924c P 7ba59cc884714e8aa5f3f0ecaed84cbb: Time spent flushing consensus metadata: real 0.910s	user 0.010s	sys 0.003s
W20260709 13:19:56.560650  6698 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:56.472337 10526 consensus_queue.cc:237] T 07a92dd554674067a83a9cb68c4773f2 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:56.583268  6800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be1a92657f494cac8dd227d152f50151" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:19:56.584465 10537 raft_consensus.cc:493] T 4275cf08e63345f993bce8664eada830 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 10 FOLLOWER]: Starting leader election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:19:56.585052 10537 raft_consensus.cc:3060] T 4275cf08e63345f993bce8664eada830 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:19:56.575852 10596 log.cc:927] Time spent T d8cee0accdb8499c86d4414b72565a38 P cd75a17ab2604397adab03bb8b5fd75c: Append to log took a long time: real 0.096s	user 0.000s	sys 0.001s
W20260709 13:19:56.577798 10597 log.cc:927] Time spent T e77e330a82df4b43a745d57a68f6f057 P ccd8a4c3bfe3413cb2ae219b09aea832: Append to log took a long time: real 0.093s	user 0.000s	sys 0.000s
I20260709 13:19:56.578121 10529 leader_election.cc:290] T be1a92657f494cac8dd227d152f50151 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:19:56.559888 10252 raft_consensus.cc:3055] T 853ac0a8cbd64ce99457f170216d4d0f P ccd8a4c3bfe3413cb2ae219b09aea832 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:19:56.579370 10446 leader_election.cc:290] T 1528ab62b6fe4e3099d08f141afee116 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 10 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:19:56.566821 10554 leader_election.cc:290] T ab432e62819d499eaaf3dd55481dd930 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
W20260709 13:19:56.586112 10452 consensus_meta.cc:287] T 8c7f33e544204fbaac4078e3e83bbf4e P ccd8a4c3bfe3413cb2ae219b09aea832: Time spent flushing consensus metadata: real 0.690s	user 0.011s	sys 0.001s
I20260709 13:19:56.621743  6728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c7f33e544204fbaac4078e3e83bbf4e" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:19:56.581750  6802 raft_consensus.cc:1275] T ce4f062dcd314d43a63ca74067cb5ee3 P b7ab4784c7344b939bc36f639286f377 [term 10 FOLLOWER]: Refusing update from remote peer 7ba59cc884714e8aa5f3f0ecaed84cbb: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 13:19:56.582435  6806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8cee0accdb8499c86d4414b72565a38" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:19:56.585968  6881 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53406 (request call id 1908) took 1083 ms. Trace:
W20260709 13:19:56.602624 10600 log.cc:927] Time spent T f58dc08b12a2494bb9a1372837970ca2 P cd75a17ab2604397adab03bb8b5fd75c: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
W20260709 13:19:56.634320 10457 consensus_meta.cc:287] T bb7fa124c3bf4ef9ab65a407cb008441 P cd75a17ab2604397adab03bb8b5fd75c: Time spent flushing consensus metadata: real 1.014s	user 0.013s	sys 0.002s
I20260709 13:19:56.606401 10486 leader_election.cc:290] T 8c7f33e544204fbaac4078e3e83bbf4e P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
W20260709 13:19:56.671037  7468 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.5.126.67:42931 timed out after 1.555s (SENT) [suppressed 11 similar messages]
I20260709 13:19:56.672549 10568 raft_consensus.cc:493] T b3f13b31a1f84f0d89d007eadd57924c P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:56.673456  6730 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50004 (request call id 1870) took 1118 ms. Trace:
I20260709 13:19:56.673254 10568 raft_consensus.cc:515] T b3f13b31a1f84f0d89d007eadd57924c P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
W20260709 13:19:56.675338 10605 log.cc:927] Time spent T 34f36d59d88f40fe8a2805e604fc6c0a P ccd8a4c3bfe3413cb2ae219b09aea832: Append to log took a long time: real 0.110s	user 0.000s	sys 0.000s
W20260709 13:19:56.619526  6846 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:56.553992 10523 raft_consensus.cc:515] T bb7fa124c3bf4ef9ab65a407cb008441 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:19:56.677066  6727 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50004 (request call id 1871) took 1087 ms. Trace:
I20260709 13:19:56.610222 10252 raft_consensus.cc:740] T 853ac0a8cbd64ce99457f170216d4d0f P ccd8a4c3bfe3413cb2ae219b09aea832 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
I20260709 13:19:56.639319  7498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b8cacb381b746da8d0049b0a83b41dd" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:19:56.639485  6724 raft_consensus.cc:1240] T f5be3a11b23d4ea9b08300a2789821c7 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 8 FOLLOWER]: Rejecting Update request from peer b7ab4784c7344b939bc36f639286f377 for earlier term 7. Current term is 8. Ops: []
I20260709 13:19:56.639443  6725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a485a995abc4807b6e511e45419f737" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:19:56.684412  7498 raft_consensus.cc:2468] T 4b8cacb381b746da8d0049b0a83b41dd P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 9.
I20260709 13:19:56.685005  6725 raft_consensus.cc:2468] T 3a485a995abc4807b6e511e45419f737 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 8.
I20260709 13:19:56.635986  6728 raft_consensus.cc:2468] T 8c7f33e544204fbaac4078e3e83bbf4e P ccd8a4c3bfe3413cb2ae219b09aea832 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 7.
W20260709 13:19:56.604921  6616 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 427c124d773f483294511e80fe340075 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER failed with leader 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 7ba59cc884714e8aa5f3f0ecaed84cbb is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 9 committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } attrs { replace: true } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } } }
I20260709 13:19:56.641799 10487 consensus_queue.cc:237] T 90d42e216d9741e190bca19a781291fd P b7ab4784c7344b939bc36f639286f377 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
W20260709 13:19:56.670087 10599 log.cc:927] Time spent T 7887766dc6784fcaa42b35c05fea7a99 P cd75a17ab2604397adab03bb8b5fd75c: Append to log took a long time: real 0.082s	user 0.000s	sys 0.000s
I20260709 13:19:56.677567  6727 rpcz_store.cc:276] 0709 13:19:55.589914 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:55.898855 (+308941us) service_pool.cc:224] Handling call
0709 13:19:55.915270 (+ 16415us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:56.318566 (+403296us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:56.318627 (+    61us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:56.377468 (+ 58841us) log.cc:844] Serialized 26 byte log entry
0709 13:19:56.471461 (+ 93993us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:19:56.471502 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:56.471568 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:56.676767 (+205199us) raft_consensus.cc:1685] finished
0709 13:19:56.676795 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:56.676992 (+   197us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":158103,"raft.run_cpu_time_us":204,"raft.run_wall_time_us":22087,"thread_start_us":453058,"threads_started":2,"wal-append.queue_time_us":148273}
I20260709 13:19:56.673993  6730 rpcz_store.cc:276] 0709 13:19:55.555668 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:55.798455 (+242787us) service_pool.cc:224] Handling call
0709 13:19:55.825175 (+ 26720us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:56.421826 (+596651us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:56.421865 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:56.431542 (+  9677us) log.cc:844] Serialized 26 byte log entry
0709 13:19:56.527628 (+ 96086us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:19:56.527672 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:56.527755 (+    83us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:56.673245 (+145490us) raft_consensus.cc:1685] finished
0709 13:19:56.673266 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:56.673396 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7344,"raft.queue_time_us":164565,"raft.run_cpu_time_us":252,"raft.run_wall_time_us":19211,"thread_start_us":655885,"threads_started":2,"wal-append.queue_time_us":144658}
I20260709 13:19:56.560215 10418 raft_consensus.cc:515] T bd6869f07b5a4885a0b99fbe60c3b175 P b7ab4784c7344b939bc36f639286f377 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
W20260709 13:19:56.678745  6846 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:56.695065  6846 leader_election.cc:304] T 4b8cacb381b746da8d0049b0a83b41dd P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
W20260709 13:19:56.680119  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 382613us
I20260709 13:19:56.637583 10436 raft_consensus.cc:493] T 34f36d59d88f40fe8a2805e604fc6c0a P cd75a17ab2604397adab03bb8b5fd75c [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:56.697727 10436 raft_consensus.cc:515] T 34f36d59d88f40fe8a2805e604fc6c0a P cd75a17ab2604397adab03bb8b5fd75c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:56.643520  6881 rpcz_store.cc:276] 0709 13:19:55.502757 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:55.502925 (+   168us) service_pool.cc:224] Handling call
0709 13:19:55.530178 (+ 27253us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:55.584928 (+ 54750us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:19:55.644869 (+ 59941us) log.cc:844] Serialized 14 byte log entry
0709 13:19:55.822433 (+177564us) log.cc:844] Serialized 14 byte log entry
0709 13:19:55.822813 (+   380us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:55.829787 (+  6974us) log.cc:844] Serialized 26 byte log entry
0709 13:19:55.829947 (+   160us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:19:55.830125 (+   178us) log.cc:844] Serialized 14 byte log entry
0709 13:19:56.572295 (+742170us) spinlock_profiling.cc:243] Waited 2.79 ms on lock 0x7b18003f1d20. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc15785de1 00007fcc157925b1 00007fcc0c8bd522 00007fcc0c8bf7c1 00007fcc0c8bf779 00007fcc0c8bf709 00007fcc0c8bf6d1 00007fcc0c8be9cd 000000000038f354 000000000038f199 00007fcc0c8a083a
0709 13:19:56.581651 (+  9356us) spinlock_profiling.cc:243] Waited 4.49 ms on lock 0x7b18003f1d20. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc15785de1 00007fcc157925b1 00007fcc0c837c0a 00007fcc15f77219 00007fcc1387e58f 00007fcc0c8bd571 00007fcc0c8bf7c1 00007fcc0c8bf779 00007fcc0c8bf709 00007fcc0c8bf6d1 00007fcc0c8be9cd
0709 13:19:56.585632 (+  3981us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:56.585708 (+    76us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:56.585765 (+    57us) raft_consensus.cc:1685] finished
0709 13:19:56.585778 (+    13us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:56.585911 (+   133us) inbound_call.cc:177] Queueing success response
0709 13:19:56.603142 (+ 17231us) spinlock_profiling.cc:243] Waited 13 ms on lock 0x7b18003f1d20. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc15785de1 00007fcc157925b1 00007fcc0c8bd3f3 00007fcc0c8bf7c1 00007fcc0c8bf779 00007fcc0c8bf709 00007fcc0c8bf6d1 00007fcc0c8be9cd 000000000038f354 000000000038f199 00007fcc0c8a083a
Metrics: {"mutex_wait_us":883479,"prepare.queue_time_us":1587536,"prepare.run_cpu_time_us":73,"prepare.run_wall_time_us":76,"raft.queue_time_us":807522,"raft.run_cpu_time_us":606,"raft.run_wall_time_us":25125,"spinlock_wait_cycles":46582016,"thread_start_us":105852,"threads_started":1,"wal-append.queue_time_us":145693}
I20260709 13:19:56.687037  6800 raft_consensus.cc:1275] T 404190ce4ce94cecbfcb6ea9d1dd8626 P b7ab4784c7344b939bc36f639286f377 [term 11 FOLLOWER]: Refusing update from remote peer 7ba59cc884714e8aa5f3f0ecaed84cbb: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:19:56.692584  6732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab432e62819d499eaaf3dd55481dd930" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:19:56.701936  6732 raft_consensus.cc:2468] T ab432e62819d499eaaf3dd55481dd930 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 11.
I20260709 13:19:56.712105  6802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb7fa124c3bf4ef9ab65a407cb008441" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:19:56.713018  6802 raft_consensus.cc:3060] T bb7fa124c3bf4ef9ab65a407cb008441 P b7ab4784c7344b939bc36f639286f377 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:56.686458 10435 raft_consensus.cc:2749] T 4f00a2e87e56452083b759f60d461ee3 P cd75a17ab2604397adab03bb8b5fd75c [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
W20260709 13:19:56.700224 10421 consensus_meta.cc:287] T 9e326172347f45e99a0d482b5d8ef768 P ccd8a4c3bfe3413cb2ae219b09aea832: Time spent flushing consensus metadata: real 0.610s	user 0.008s	sys 0.005s
I20260709 13:19:56.720209  6877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ba5dac66ab5497e9e336f2a3c28cda5" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:19:56.724942  6724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1528ab62b6fe4e3099d08f141afee116" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:19:56.724805  6770 leader_election.cc:304] T 3a485a995abc4807b6e511e45419f737 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
I20260709 13:19:56.729319  7502 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50744 (request call id 308) took 1196 ms. Trace:
W20260709 13:19:56.693240  6616 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.5.126.68:45071, user_credentials={real_user=slave}} blocked reactor thread for 88558us
I20260709 13:19:56.706789 10387 raft_consensus.cc:2804] T 4b8cacb381b746da8d0049b0a83b41dd P cd75a17ab2604397adab03bb8b5fd75c [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:19:56.735641  6880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe20b4b48823486ca3b9c648db6ce8aa" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:19:56.732717  6724 raft_consensus.cc:2393] T 1528ab62b6fe4e3099d08f141afee116 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate b7ab4784c7344b939bc36f639286f377 in current term 10: Already voted for candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in this term.
I20260709 13:19:56.685585 10457 raft_consensus.cc:515] T bb7fa124c3bf4ef9ab65a407cb008441 P cd75a17ab2604397adab03bb8b5fd75c [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:19:56.733516 10526 raft_consensus.cc:2804] T 3a485a995abc4807b6e511e45419f737 P b7ab4784c7344b939bc36f639286f377 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:19:56.731313  7502 rpcz_store.cc:276] 0709 13:19:55.533276 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:55.536352 (+  3076us) service_pool.cc:224] Handling call
0709 13:19:55.552335 (+ 15983us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:55.845283 (+292948us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:56.729137 (+883854us) spinlock_profiling.cc:243] Waited 159 ms on lock 0x7b5400604d54. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f9aae01 00007fcc0f9a983e 00007fcc1496e419 00007fcc0dee5bd4 00007fcc0dee5b62 00007fcc0dee5a91 00007fcc0dee5a0c 00007fcc0dee4cc2 00007fcc0dce548c 00007fcc0dce48c6
0709 13:19:56.729269 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":366583040}
I20260709 13:19:56.736744  6880 raft_consensus.cc:2410] T fe20b4b48823486ca3b9c648db6ce8aa P cd75a17ab2604397adab03bb8b5fd75c [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ba59cc884714e8aa5f3f0ecaed84cbb for term 8 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 13:19:56.718786 10523 leader_election.cc:290] T bb7fa124c3bf4ef9ab65a407cb008441 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 10 election: Requested vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
W20260709 13:19:56.745412  7468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 74445.4us
I20260709 13:19:56.748337  7498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1528ab62b6fe4e3099d08f141afee116" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb"
I20260709 13:19:56.749827  6724 raft_consensus.cc:1240] T 1bf4668eeb70467fb3dc5a0289233b3c P ccd8a4c3bfe3413cb2ae219b09aea832 [term 10 FOLLOWER]: Rejecting Update request from peer b7ab4784c7344b939bc36f639286f377 for earlier term 9. Current term is 10. Ops: []
I20260709 13:19:56.735780 10445 raft_consensus.cc:493] T bb3d8792045a4583ae2e965b1350a5b4 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 9 FOLLOWER]: Starting pre-election (detected failure of leader cd75a17ab2604397adab03bb8b5fd75c)
I20260709 13:19:56.751817 10619 raft_consensus.cc:493] T b56bf91d90824c959e21e0cee5ba1816 P cd75a17ab2604397adab03bb8b5fd75c [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:56.751994 10575 raft_consensus.cc:493] T 9e326172347f45e99a0d482b5d8ef768 P cd75a17ab2604397adab03bb8b5fd75c [term 8 FOLLOWER]: Starting pre-election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:19:56.752787 10436 leader_election.cc:290] T 34f36d59d88f40fe8a2805e604fc6c0a P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:19:56.752894 10621 raft_consensus.cc:493] T fe20b4b48823486ca3b9c648db6ce8aa P cd75a17ab2604397adab03bb8b5fd75c [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:56.756910  6874 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53406 (request call id 1916) took 1110 ms. Trace:
W20260709 13:19:56.757588 10567 log.cc:927] Time spent T 17587d6730594da4a56fa13a353232a1 P ccd8a4c3bfe3413cb2ae219b09aea832: Append to log took a long time: real 0.489s	user 0.004s	sys 0.001s
I20260709 13:19:56.750612  6879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce4f062dcd314d43a63ca74067cb5ee3" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:19:56.789682  6879 raft_consensus.cc:2410] T ce4f062dcd314d43a63ca74067cb5ee3 P cd75a17ab2604397adab03bb8b5fd75c [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ba59cc884714e8aa5f3f0ecaed84cbb for term 10 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 7.
I20260709 13:19:56.740341 10526 raft_consensus.cc:493] T 3a485a995abc4807b6e511e45419f737 P b7ab4784c7344b939bc36f639286f377 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:56.738830 10387 raft_consensus.cc:493] T 4b8cacb381b746da8d0049b0a83b41dd P cd75a17ab2604397adab03bb8b5fd75c [term 9 FOLLOWER]: Starting leader election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:19:56.790746 10526 raft_consensus.cc:3060] T 3a485a995abc4807b6e511e45419f737 P b7ab4784c7344b939bc36f639286f377 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:56.790865 10387 raft_consensus.cc:3060] T 4b8cacb381b746da8d0049b0a83b41dd P cd75a17ab2604397adab03bb8b5fd75c [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:56.770119  6802 raft_consensus.cc:2468] T bb7fa124c3bf4ef9ab65a407cb008441 P b7ab4784c7344b939bc36f639286f377 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in term 10.
I20260709 13:19:56.792243 10604 consensus_queue.cc:1048] T be1a92657f494cac8dd227d152f50151 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.022s
I20260709 13:19:56.796726 10457 leader_election.cc:290] T bb7fa124c3bf4ef9ab65a407cb008441 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 10 election: Requested vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:19:56.797629  6879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8cee0accdb8499c86d4414b72565a38" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:19:56.798581 10313 raft_consensus.cc:515] T 713b5728a197487c9300b310ab94e5a3 P b7ab4784c7344b939bc36f639286f377 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:56.796800  6724 raft_consensus.cc:3055] T 3411566abe2d4c9bb4b2adfdd05e6f17 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:19:56.727577 10560 consensus_queue.cc:1059] T f5be3a11b23d4ea9b08300a2789821c7 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.023s
I20260709 13:19:56.778849  6880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fa34c08b205435dba97346991aa1f92" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:19:56.779445  6804 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:32976 (request call id 2604) took 2320 ms. Trace:
I20260709 13:19:56.779374  6772 leader_election.cc:304] T f09c2a98de1a4decabd0ff900dd44caa P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:19:56.800820  6724 raft_consensus.cc:740] T 3411566abe2d4c9bb4b2adfdd05e6f17 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
I20260709 13:19:56.770717 10445 raft_consensus.cc:515] T bb3d8792045a4583ae2e965b1350a5b4 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:19:56.804723  6772 leader_election.cc:304] T a3022224cc81473690653a83d4e99470 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:19:56.784780 10614 consensus_queue.cc:1048] T 404190ce4ce94cecbfcb6ea9d1dd8626 P 7ba59cc884714e8aa5f3f0ecaed84cbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.071s
I20260709 13:19:56.784840 10447 raft_consensus.cc:515] T f4b8bd455d5a47c18a1380839c6e0d61 P b7ab4784c7344b939bc36f639286f377 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:56.786788  6874 rpcz_store.cc:276] 0709 13:19:55.646120 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:55.648589 (+  2469us) service_pool.cc:224] Handling call
0709 13:19:55.648929 (+   340us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:19:55.658068 (+  9139us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:19:56.315724 (+657656us) log.cc:844] Serialized 14 byte log entry
0709 13:19:56.680719 (+364995us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:19:56.717618 (+ 36899us) log.cc:844] Serialized 52 byte log entry
0709 13:19:56.717900 (+   282us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:19:56.718784 (+   884us) log.cc:844] Serialized 14 byte log entry
0709 13:19:56.719040 (+   256us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:56.719142 (+   102us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:56.756640 (+ 37498us) raft_consensus.cc:1685] finished
0709 13:19:56.756667 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:56.756834 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":149478,"prepare.queue_time_us":164725,"prepare.run_cpu_time_us":53,"prepare.run_wall_time_us":108,"raft.queue_time_us":150001,"raft.run_cpu_time_us":251,"raft.run_wall_time_us":39736,"spinlock_wait_cycles":16871040,"thread_start_us":782535,"threads_started":3,"wal-append.queue_time_us":321743}
I20260709 13:19:56.784373  6877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe20b4b48823486ca3b9c648db6ce8aa" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:19:56.801405  6804 rpcz_store.cc:276] 0709 13:19:54.459319 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:54.935661 (+476342us) service_pool.cc:224] Handling call
0709 13:19:54.935988 (+   327us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:55.970179 (+1034191us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:56.779150 (+808971us) spinlock_profiling.cc:243] Waited 1.03 s on lock 0x7b5400070b54. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f9aae01 00007fcc0f9a983e 00007fcc1496e419 00007fcc0dee5bd4 00007fcc0dee5b62 00007fcc0dee5a91 00007fcc0dee5a0c 00007fcc0dee4cc2 00007fcc0dce548c 00007fcc0dce48c6
0709 13:19:56.779373 (+   223us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2366653312}
I20260709 13:19:56.811441  6878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce4f062dcd314d43a63ca74067cb5ee3" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:19:56.815543  6878 raft_consensus.cc:3060] T ce4f062dcd314d43a63ca74067cb5ee3 P cd75a17ab2604397adab03bb8b5fd75c [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:56.816570 10533 raft_consensus.cc:2804] T a3022224cc81473690653a83d4e99470 P b7ab4784c7344b939bc36f639286f377 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:19:56.816696  6875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f00a2e87e56452083b759f60d461ee3" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:19:56.817659  6875 raft_consensus.cc:2393] T 4f00a2e87e56452083b759f60d461ee3 P cd75a17ab2604397adab03bb8b5fd75c [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in current term 10: Already voted for candidate cd75a17ab2604397adab03bb8b5fd75c in this term.
I20260709 13:19:56.818795  6875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe20b4b48823486ca3b9c648db6ce8aa" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:19:56.820343  6876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f00a2e87e56452083b759f60d461ee3" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:19:56.821353  6876 raft_consensus.cc:2393] T 4f00a2e87e56452083b759f60d461ee3 P cd75a17ab2604397adab03bb8b5fd75c [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in current term 10: Already voted for candidate cd75a17ab2604397adab03bb8b5fd75c in this term.
I20260709 13:19:56.822378  6876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fa34c08b205435dba97346991aa1f92" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:19:56.823725  6881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b8cacb381b746da8d0049b0a83b41dd" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:19:56.824409  6874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b8cacb381b746da8d0049b0a83b41dd" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:19:56.827847  9836 consensus_queue.cc:1048] T 3d65025eea89441290d85dd053810e31 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:19:56.829902 10447 leader_election.cc:290] T f4b8bd455d5a47c18a1380839c6e0d61 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 9 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:56.830862 10445 leader_election.cc:290] T bb3d8792045a4583ae2e965b1350a5b4 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:56.827780 10606 consensus_queue.cc:1048] T 7c37d41cd9164c15a6826ca62a851a69 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.005s
I20260709 13:19:56.741390 10589 consensus_queue.cc:1048] T ce4f062dcd314d43a63ca74067cb5ee3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.115s
I20260709 13:19:56.832633  6877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8cee0accdb8499c86d4414b72565a38" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
W20260709 13:19:56.950591  6695 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:56.952543  6695 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:56.953347  6695 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:56.833338  6875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb7fa124c3bf4ef9ab65a407cb008441" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:19:56.868448  6878 raft_consensus.cc:2410] T ce4f062dcd314d43a63ca74067cb5ee3 P cd75a17ab2604397adab03bb8b5fd75c [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 7ba59cc884714e8aa5f3f0ecaed84cbb for term 10 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 7.
I20260709 13:19:56.837977  6880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "427c124d773f483294511e80fe340075" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 10 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:19:56.959205  6872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce4f062dcd314d43a63ca74067cb5ee3" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:19:56.960318  6874 raft_consensus.cc:1275] T ce4f062dcd314d43a63ca74067cb5ee3 P cd75a17ab2604397adab03bb8b5fd75c [term 10 FOLLOWER]: Refusing update from remote peer 7ba59cc884714e8aa5f3f0ecaed84cbb: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 8. (term mismatch)
I20260709 13:19:56.959498  6875 raft_consensus.cc:2393] T bb7fa124c3bf4ef9ab65a407cb008441 P cd75a17ab2604397adab03bb8b5fd75c [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in current term 10: Already voted for candidate cd75a17ab2604397adab03bb8b5fd75c in this term.
I20260709 13:19:56.962122  6874 pending_rounds.cc:85] T ce4f062dcd314d43a63ca74067cb5ee3 P cd75a17ab2604397adab03bb8b5fd75c: Aborting all ops after (but not including) 7
I20260709 13:19:56.962433  6874 pending_rounds.cc:107] T ce4f062dcd314d43a63ca74067cb5ee3 P cd75a17ab2604397adab03bb8b5fd75c: Aborting uncommitted NO_OP operation due to leader change: 8.8
I20260709 13:19:56.962702  6874 raft_consensus.cc:2889] T ce4f062dcd314d43a63ca74067cb5ee3 P cd75a17ab2604397adab03bb8b5fd75c [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:19:56.959841  6880 raft_consensus.cc:2468] T 427c124d773f483294511e80fe340075 P cd75a17ab2604397adab03bb8b5fd75c [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in term 9.
I20260709 13:19:56.963193  6872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c7f33e544204fbaac4078e3e83bbf4e" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:19:56.960254  6878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4b8bd455d5a47c18a1380839c6e0d61" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:19:56.964745  6878 raft_consensus.cc:3060] T f4b8bd455d5a47c18a1380839c6e0d61 P cd75a17ab2604397adab03bb8b5fd75c [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:56.963938  6872 raft_consensus.cc:2468] T 8c7f33e544204fbaac4078e3e83bbf4e P cd75a17ab2604397adab03bb8b5fd75c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 7.
I20260709 13:19:56.965713  6880 raft_consensus.cc:1275] T 3411566abe2d4c9bb4b2adfdd05e6f17 P cd75a17ab2604397adab03bb8b5fd75c [term 8 FOLLOWER]: Refusing update from remote peer b7ab4784c7344b939bc36f639286f377: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:19:56.960928 10550 raft_consensus.cc:493] T 3fa34c08b205435dba97346991aa1f92 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:56.866581 10436 raft_consensus.cc:493] T 20f6842e26174571996b8dea4151d4be P cd75a17ab2604397adab03bb8b5fd75c [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:56.967448 10550 raft_consensus.cc:515] T 3fa34c08b205435dba97346991aa1f92 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:19:56.968875 10571 raft_consensus.cc:493] T 427c124d773f483294511e80fe340075 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:56.969475 10571 raft_consensus.cc:515] T 427c124d773f483294511e80fe340075 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } attrs { replace: true } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:19:56.970710  6877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb7fa124c3bf4ef9ab65a407cb008441" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:19:56.971525  6877 raft_consensus.cc:2393] T bb7fa124c3bf4ef9ab65a407cb008441 P cd75a17ab2604397adab03bb8b5fd75c [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in current term 10: Already voted for candidate cd75a17ab2604397adab03bb8b5fd75c in this term.
I20260709 13:19:56.971249 10550 leader_election.cc:290] T 3fa34c08b205435dba97346991aa1f92 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:19:56.972311 10550 raft_consensus.cc:3055] T a3022224cc81473690653a83d4e99470 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:19:56.972834 10550 raft_consensus.cc:740] T a3022224cc81473690653a83d4e99470 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
W20260709 13:19:56.937193 10610 log.cc:927] Time spent T 44bde925b2e541b69890d70715b85176 P b7ab4784c7344b939bc36f639286f377: Append to log took a long time: real 0.137s	user 0.000s	sys 0.001s
I20260709 13:19:56.808627  6724 consensus_queue.cc:260] T 3411566abe2d4c9bb4b2adfdd05e6f17 P ccd8a4c3bfe3413cb2ae219b09aea832 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:56.930797 10532 raft_consensus.cc:2804] T f09c2a98de1a4decabd0ff900dd44caa P b7ab4784c7344b939bc36f639286f377 [term 12 FOLLOWER]: Leader election won for term 12
W20260709 13:19:56.984926  6696 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:56.985185  6697 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 613528us
I20260709 13:19:56.938302 10569 raft_consensus.cc:2749] T 4d9def8b32fd443aa94ab1420b06837b P ccd8a4c3bfe3413cb2ae219b09aea832 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
W20260709 13:19:56.992187  7468 leader_election.cc:336] T 4b8cacb381b746da8d0049b0a83b41dd P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931): Timed out: RequestConsensusVote RPC to 127.5.126.67:42931 timed out after 1.772s (SENT)
I20260709 13:19:56.996366  6724 raft_consensus.cc:3060] T 3411566abe2d4c9bb4b2adfdd05e6f17 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:56.996901  7468 leader_election.cc:304] T 4b8cacb381b746da8d0049b0a83b41dd P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
W20260709 13:19:56.965543 10558 log.cc:927] Time spent T 17587d6730594da4a56fa13a353232a1 P 7ba59cc884714e8aa5f3f0ecaed84cbb: Append to log took a long time: real 0.068s	user 0.001s	sys 0.000s
I20260709 13:19:56.837539 10533 raft_consensus.cc:697] T a3022224cc81473690653a83d4e99470 P b7ab4784c7344b939bc36f639286f377 [term 11 LEADER]: Becoming Leader. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
I20260709 13:19:56.991601  7466 leader_election.cc:304] T bb7fa124c3bf4ef9ab65a407cb008441 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, b7ab4784c7344b939bc36f639286f377; no voters: 
I20260709 13:19:56.809737 10621 raft_consensus.cc:515] T fe20b4b48823486ca3b9c648db6ce8aa P cd75a17ab2604397adab03bb8b5fd75c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:19:57.005260  6726 raft_consensus.cc:1275] T f3f9c2e2bf644115957398fe4c9459db P ccd8a4c3bfe3413cb2ae219b09aea832 [term 9 FOLLOWER]: Refusing update from remote peer b7ab4784c7344b939bc36f639286f377: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 13:19:57.005477  6697 leader_election.cc:304] T 95a75bfe094d4bdc963aba3f08dfcd25 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377
I20260709 13:19:56.802842 10387 raft_consensus.cc:515] T 4b8cacb381b746da8d0049b0a83b41dd P cd75a17ab2604397adab03bb8b5fd75c [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:19:57.005690  6723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be1a92657f494cac8dd227d152f50151" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:19:57.006588  6872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "427c124d773f483294511e80fe340075" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 10 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:19:57.006801  6723 raft_consensus.cc:2468] T be1a92657f494cac8dd227d152f50151 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in term 12.
I20260709 13:19:57.008198 10585 raft_consensus.cc:2804] T 24ee15416e3145beaa1b8183453729a3 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:19:57.010330 10248 raft_consensus.cc:493] T bb3d8792045a4583ae2e965b1350a5b4 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:57.011883  6727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3d8792045a4583ae2e965b1350a5b4" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:19:57.017232  6879 raft_consensus.cc:1275] T fe20b4b48823486ca3b9c648db6ce8aa P cd75a17ab2604397adab03bb8b5fd75c [term 8 FOLLOWER]: Refusing update from remote peer 7ba59cc884714e8aa5f3f0ecaed84cbb: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 8. (term mismatch)
I20260709 13:19:57.017793  6879 pending_rounds.cc:85] T fe20b4b48823486ca3b9c648db6ce8aa P cd75a17ab2604397adab03bb8b5fd75c: Aborting all ops after (but not including) 7
I20260709 13:19:57.018079  6879 pending_rounds.cc:107] T fe20b4b48823486ca3b9c648db6ce8aa P cd75a17ab2604397adab03bb8b5fd75c: Aborting uncommitted NO_OP operation due to leader change: 7.8
I20260709 13:19:57.018352  6879 raft_consensus.cc:2889] T fe20b4b48823486ca3b9c648db6ce8aa P cd75a17ab2604397adab03bb8b5fd75c [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:19:57.010929 10248 raft_consensus.cc:515] T bb3d8792045a4583ae2e965b1350a5b4 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:19:57.023353  6697 leader_election.cc:304] T 711ef6523deb4cbe8ef2ba61e1c21c98 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377
I20260709 13:19:57.008442 10614 raft_consensus.cc:2749] T 4b8cacb381b746da8d0049b0a83b41dd P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:19:57.024025 10248 leader_election.cc:290] T bb3d8792045a4583ae2e965b1350a5b4 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:19:57.024780 10248 raft_consensus.cc:2804] T 95a75bfe094d4bdc963aba3f08dfcd25 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:19:57.024938  6697 leader_election.cc:304] T dbdf895bba214ff68685a24fd17dfb5d P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:19:57.025636 10445 raft_consensus.cc:2804] T bb7fa124c3bf4ef9ab65a407cb008441 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:19:57.026274 10445 raft_consensus.cc:697] T bb7fa124c3bf4ef9ab65a407cb008441 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 10 LEADER]: Becoming Leader. State: Replica: 7ba59cc884714e8aa5f3f0ecaed84cbb, State: Running, Role: LEADER
I20260709 13:19:57.027005  6726 raft_consensus.cc:1275] T 7c44c4849aa54f2b94d1f1bef9ed546f P ccd8a4c3bfe3413cb2ae219b09aea832 [term 12 FOLLOWER]: Refusing update from remote peer b7ab4784c7344b939bc36f639286f377: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 12 index: 9. (term mismatch)
I20260709 13:19:57.027490  6726 pending_rounds.cc:85] T 7c44c4849aa54f2b94d1f1bef9ed546f P ccd8a4c3bfe3413cb2ae219b09aea832: Aborting all ops after (but not including) 8
I20260709 13:19:57.027822  6726 pending_rounds.cc:107] T 7c44c4849aa54f2b94d1f1bef9ed546f P ccd8a4c3bfe3413cb2ae219b09aea832: Aborting uncommitted NO_OP operation due to leader change: 11.9
I20260709 13:19:57.027940 10585 raft_consensus.cc:697] T 24ee15416e3145beaa1b8183453729a3 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 10 LEADER]: Becoming Leader. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
I20260709 13:19:57.044613  6726 raft_consensus.cc:2889] T 7c44c4849aa54f2b94d1f1bef9ed546f P ccd8a4c3bfe3413cb2ae219b09aea832 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:19:57.028438 10547 raft_consensus.cc:2749] T dbdf895bba214ff68685a24fd17dfb5d P ccd8a4c3bfe3413cb2ae219b09aea832 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:19:57.028678 10576 raft_consensus.cc:493] T bd6869f07b5a4885a0b99fbe60c3b175 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:57.027006 10574 raft_consensus.cc:2804] T 711ef6523deb4cbe8ef2ba61e1c21c98 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:19:57.028960 10421 raft_consensus.cc:493] T 9e326172347f45e99a0d482b5d8ef768 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:57.029426 10452 consensus_queue.cc:1059] T f09c2a98de1a4decabd0ff900dd44caa P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:19:57.029834 10533 consensus_queue.cc:237] T a3022224cc81473690653a83d4e99470 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:57.030958  6695 leader_election.cc:304] T 9b3759de40694069b13c0f8bd40e5709 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
I20260709 13:19:57.031777 10542 consensus_queue.cc:1059] T 90d42e216d9741e190bca19a781291fd P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
W20260709 13:19:57.033133  6678 auto_rebalancer.cc:629] Failed to schedule move for tablet 44bde925b2e541b69890d70715b85176: Illegal state: Replica cd75a17ab2604397adab03bb8b5fd75c is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 10 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } }
I20260709 13:19:57.025203 10248 raft_consensus.cc:493] T 95a75bfe094d4bdc963aba3f08dfcd25 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 10 FOLLOWER]: Starting leader election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:19:57.019052 10240 raft_consensus.cc:493] T 9e326172347f45e99a0d482b5d8ef768 P b7ab4784c7344b939bc36f639286f377 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:57.011560 10532 raft_consensus.cc:697] T f09c2a98de1a4decabd0ff900dd44caa P b7ab4784c7344b939bc36f639286f377 [term 12 LEADER]: Becoming Leader. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
I20260709 13:19:57.067265 10532 consensus_queue.cc:237] T f09c2a98de1a4decabd0ff900dd44caa P b7ab4784c7344b939bc36f639286f377 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 11.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:57.037341  6723 raft_consensus.cc:1275] T be1a92657f494cac8dd227d152f50151 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 12 FOLLOWER]: Refusing update from remote peer b7ab4784c7344b939bc36f639286f377: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:19:57.038259 10387 leader_election.cc:290] T 4b8cacb381b746da8d0049b0a83b41dd P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 10 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:19:57.038805 10621 leader_election.cc:290] T fe20b4b48823486ca3b9c648db6ce8aa P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:19:57.038708 10550 consensus_queue.cc:260] T a3022224cc81473690653a83d4e99470 P ccd8a4c3bfe3413cb2ae219b09aea832 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:57.040318 10526 raft_consensus.cc:515] T 3a485a995abc4807b6e511e45419f737 P b7ab4784c7344b939bc36f639286f377 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:57.041260  6879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3d8792045a4583ae2e965b1350a5b4" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:19:57.027230 10445 consensus_queue.cc:237] T bb7fa124c3bf4ef9ab65a407cb008441 P 7ba59cc884714e8aa5f3f0ecaed84cbb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:19:57.041260  6799 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:32976 (request call id 2616) took 1216 ms. Trace:
I20260709 13:19:56.782939 10619 raft_consensus.cc:515] T b56bf91d90824c959e21e0cee5ba1816 P cd75a17ab2604397adab03bb8b5fd75c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:57.042371  6727 raft_consensus.cc:2468] T bb3d8792045a4583ae2e965b1350a5b4 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in term 9.
I20260709 13:19:57.046365  6697 leader_election.cc:304] T f03d0dbf16864ca4bc1bb5e4c0334c0f P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377
I20260709 13:19:56.981323 10436 raft_consensus.cc:515] T 20f6842e26174571996b8dea4151d4be P cd75a17ab2604397adab03bb8b5fd75c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:57.064846 10538 raft_consensus.cc:2804] T 9b3759de40694069b13c0f8bd40e5709 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:19:57.019424 10571 leader_election.cc:290] T 427c124d773f483294511e80fe340075 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:19:57.058769  6878 raft_consensus.cc:2468] T f4b8bd455d5a47c18a1380839c6e0d61 P cd75a17ab2604397adab03bb8b5fd75c [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 9.
I20260709 13:19:57.036566  6881 raft_consensus.cc:2393] T 4b8cacb381b746da8d0049b0a83b41dd P cd75a17ab2604397adab03bb8b5fd75c [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in current term 10: Already voted for candidate cd75a17ab2604397adab03bb8b5fd75c in this term.
I20260709 13:19:57.071949  6723 raft_consensus.cc:1275] T ce4f062dcd314d43a63ca74067cb5ee3 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 10 FOLLOWER]: Refusing update from remote peer 7ba59cc884714e8aa5f3f0ecaed84cbb: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 13:19:57.049136 10574 raft_consensus.cc:493] T 711ef6523deb4cbe8ef2ba61e1c21c98 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 10 FOLLOWER]: Starting leader election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:19:57.081211  6726 raft_consensus.cc:1275] T 404190ce4ce94cecbfcb6ea9d1dd8626 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 11 FOLLOWER]: Refusing update from remote peer 7ba59cc884714e8aa5f3f0ecaed84cbb: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:19:57.081913  6799 rpcz_store.cc:276] 0709 13:19:55.825236 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:55.834837 (+  9601us) service_pool.cc:224] Handling call
0709 13:19:55.845207 (+ 10370us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:56.359601 (+514394us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:57.040930 (+681329us) spinlock_profiling.cc:243] Waited 476 ms on lock 0x7b54001a31d4. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f9aae01 00007fcc0f9a983e 00007fcc1496e419 00007fcc0dee5bd4 00007fcc0dee5b62 00007fcc0dee5a91 00007fcc0dee5a0c 00007fcc0dee4cc2 00007fcc0dce548c 00007fcc0dce48c6
0709 13:19:57.041187 (+   257us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1095900032}
I20260709 13:19:57.089123 10550 raft_consensus.cc:3060] T a3022224cc81473690653a83d4e99470 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:57.091852  6724 raft_consensus.cc:1275] T 3411566abe2d4c9bb4b2adfdd05e6f17 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 8 FOLLOWER]: Refusing update from remote peer b7ab4784c7344b939bc36f639286f377: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 5. (term mismatch)
I20260709 13:19:57.055500 10537 raft_consensus.cc:515] T 4275cf08e63345f993bce8664eada830 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:57.065654 10248 raft_consensus.cc:3060] T 95a75bfe094d4bdc963aba3f08dfcd25 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:57.062636 10581 raft_consensus.cc:3055] T f09c2a98de1a4decabd0ff900dd44caa P ccd8a4c3bfe3413cb2ae219b09aea832 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:19:56.786762 10575 raft_consensus.cc:515] T 9e326172347f45e99a0d482b5d8ef768 P cd75a17ab2604397adab03bb8b5fd75c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:57.057446 10421 raft_consensus.cc:515] T 9e326172347f45e99a0d482b5d8ef768 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:57.116626  6724 pending_rounds.cc:85] T 3411566abe2d4c9bb4b2adfdd05e6f17 P ccd8a4c3bfe3413cb2ae219b09aea832: Aborting all ops after (but not including) 4
I20260709 13:19:57.142427  6724 pending_rounds.cc:107] T 3411566abe2d4c9bb4b2adfdd05e6f17 P ccd8a4c3bfe3413cb2ae219b09aea832: Aborting uncommitted NO_OP operation due to leader change: 7.5
I20260709 13:19:57.142728  6724 raft_consensus.cc:2889] T 3411566abe2d4c9bb4b2adfdd05e6f17 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:19:57.053179 10576 raft_consensus.cc:515] T bd6869f07b5a4885a0b99fbe60c3b175 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:57.146014 10576 leader_election.cc:290] T bd6869f07b5a4885a0b99fbe60c3b175 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:57.148602  9836 raft_consensus.cc:493] T 20f6842e26174571996b8dea4151d4be P b7ab4784c7344b939bc36f639286f377 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:57.149326  9836 raft_consensus.cc:515] T 20f6842e26174571996b8dea4151d4be P b7ab4784c7344b939bc36f639286f377 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:57.125038  6799 raft_consensus.cc:1240] T f4b8bd455d5a47c18a1380839c6e0d61 P b7ab4784c7344b939bc36f639286f377 [term 9 FOLLOWER]: Rejecting Update request from peer ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 8. Current term is 9. Ops: []
I20260709 13:19:57.127240  6726 raft_consensus.cc:1275] T 1528ab62b6fe4e3099d08f141afee116 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 10 FOLLOWER]: Refusing update from remote peer 7ba59cc884714e8aa5f3f0ecaed84cbb: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:19:57.127753  6800 raft_consensus.cc:1240] T 713b5728a197487c9300b310ab94e5a3 P b7ab4784c7344b939bc36f639286f377 [term 11 FOLLOWER]: Rejecting Update request from peer ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 10. Current term is 11. Ops: [10.6-10.6]
I20260709 13:19:57.081116 10352 raft_consensus.cc:493] T a1704639a875409b9959353527b3fd68 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:19:57.136888  6804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c240553ce044eedb41541d72b9475d7" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
W20260709 13:19:57.137678  6697 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 91369us
W20260709 13:19:57.154575  7468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 81050.3us
I20260709 13:19:57.139719  6807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be1a92657f494cac8dd227d152f50151" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:19:57.110914 10584 raft_consensus.cc:493] T 2c240553ce044eedb41541d72b9475d7 P b7ab4784c7344b939bc36f639286f377 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:57.266040  7468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 64621.9us
I20260709 13:19:57.316727  7468 leader_election.cc:304] T 3fa34c08b205435dba97346991aa1f92 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:19:57.203899 10606 raft_consensus.cc:493] T dbdf895bba214ff68685a24fd17dfb5d P b7ab4784c7344b939bc36f639286f377 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:57.285781  6697 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 80448.9us
I20260709 13:19:57.125623 10602 raft_consensus.cc:493] T 404190ce4ce94cecbfcb6ea9d1dd8626 P b7ab4784c7344b939bc36f639286f377 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:57.138517 10581 raft_consensus.cc:740] T f09c2a98de1a4decabd0ff900dd44caa P ccd8a4c3bfe3413cb2ae219b09aea832 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
I20260709 13:19:57.344928 10436 leader_election.cc:290] T 20f6842e26174571996b8dea4151d4be P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:19:57.344846 10581 consensus_queue.cc:260] T f09c2a98de1a4decabd0ff900dd44caa P ccd8a4c3bfe3413cb2ae219b09aea832 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:57.345798 10436 raft_consensus.cc:493] T 711ef6523deb4cbe8ef2ba61e1c21c98 P cd75a17ab2604397adab03bb8b5fd75c [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:19:57.346558 10581 raft_consensus.cc:3060] T f09c2a98de1a4decabd0ff900dd44caa P ccd8a4c3bfe3413cb2ae219b09aea832 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:57.080710 10240 raft_consensus.cc:515] T 9e326172347f45e99a0d482b5d8ef768 P b7ab4784c7344b939bc36f639286f377 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:57.119361 10574 raft_consensus.cc:3060] T 711ef6523deb4cbe8ef2ba61e1c21c98 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:57.140015 10542 raft_consensus.cc:2804] T f03d0dbf16864ca4bc1bb5e4c0334c0f P ccd8a4c3bfe3413cb2ae219b09aea832 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:19:57.286439  6798 raft_consensus.cc:1240] T 853ac0a8cbd64ce99457f170216d4d0f P b7ab4784c7344b939bc36f639286f377 [term 7 FOLLOWER]: Rejecting Update request from peer ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 6. Current term is 7. Ops: []
I20260709 13:19:57.122545 10538 raft_consensus.cc:697] T 9b3759de40694069b13c0f8bd40e5709 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 10 LEADER]: Becoming Leader. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
I20260709 13:19:57.252345  6800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6869f07b5a4885a0b99fbe60c3b175" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 11 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:19:57.255347  6801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "427c124d773f483294511e80fe340075" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:19:57.203003  6806 raft_consensus.cc:1240] T 7c44c4849aa54f2b94d1f1bef9ed546f P b7ab4784c7344b939bc36f639286f377 [term 12 LEADER]: Rejecting Update request from peer ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 11. Current term is 12. Ops: [11.9-11.9]
I20260709 13:19:57.309998  9890 raft_consensus.cc:2804] T de3186201e1a40d0b335eeb8b4e256e0 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 13:19:57.310907 10630 log.cc:927] Time spent T 00000000000000000000000000000000 P b3ae52d33b9a4273a42e5e2cf3b5d6b5: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
W20260709 13:19:57.211174  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 159330us
I20260709 13:19:57.216086 10576 consensus_queue.cc:1059] T 713b5728a197487c9300b310ab94e5a3 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.115s
I20260709 13:19:57.346406 10436 raft_consensus.cc:515] T 711ef6523deb4cbe8ef2ba61e1c21c98 P cd75a17ab2604397adab03bb8b5fd75c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:57.084550 10585 consensus_queue.cc:237] T 24ee15416e3145beaa1b8183453729a3 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:19:57.251255 10352 raft_consensus.cc:515] T a1704639a875409b9959353527b3fd68 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:57.556627  6803 raft_consensus.cc:1275] T 1528ab62b6fe4e3099d08f141afee116 P b7ab4784c7344b939bc36f639286f377 [term 10 FOLLOWER]: Refusing update from remote peer 7ba59cc884714e8aa5f3f0ecaed84cbb: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:19:57.533295  7503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be1a92657f494cac8dd227d152f50151" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
W20260709 13:19:57.562173  6805 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50550 (request call id 348) took 2429 ms (client timeout 2060 ms). Trace:
I20260709 13:19:57.572115  6800 raft_consensus.cc:2393] T bd6869f07b5a4885a0b99fbe60c3b175 P b7ab4784c7344b939bc36f639286f377 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ccd8a4c3bfe3413cb2ae219b09aea832 in current term 11: Already voted for candidate b7ab4784c7344b939bc36f639286f377 in this term.
I20260709 13:19:57.506778  6729 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50004 (request call id 1868) took 1979 ms. Trace:
I20260709 13:19:57.492579  7500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3d8792045a4583ae2e965b1350a5b4" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:19:57.493558  7496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "427c124d773f483294511e80fe340075" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:19:57.574569  7500 raft_consensus.cc:2410] T bb3d8792045a4583ae2e965b1350a5b4 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ccd8a4c3bfe3413cb2ae219b09aea832 for term 10 because replica has last-logged OpId of term: 9 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 8.
I20260709 13:19:57.572775  6729 rpcz_store.cc:276] 0709 13:19:55.527559 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:55.553784 (+ 26225us) service_pool.cc:224] Handling call
0709 13:19:55.554079 (+   295us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:55.607189 (+ 53110us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:55.607225 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:55.618922 (+ 11697us) log.cc:844] Serialized 26 byte log entry
0709 13:19:57.041634 (+1422712us) spinlock_profiling.cc:243] Waited 1.79 ms on lock 0x7b180014caa0. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc15785de1 00007fcc157925b1 00007fcc0c89fe07 00007fcc156faab9 00007fcc0c8bc69b 00007fcc0c8ba93f 00007fcc0c8bcc02 00007fcc0f54420b 00007fcc0f549d23 00007fcc0f54a0d1 00007fcc0f965a0f
0709 13:19:57.309586 (+267952us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:19:57.309667 (+    81us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:57.311649 (+  1982us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:57.506374 (+194725us) raft_consensus.cc:1685] finished
0709 13:19:57.506404 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:57.506692 (+   288us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":31614,"raft.queue_time_us":41036,"raft.run_cpu_time_us":176,"raft.run_wall_time_us":7226,"spinlock_wait_cycles":4126464,"thread_start_us":267614,"threads_started":1,"wal-append.queue_time_us":1858814}
W20260709 13:19:57.572485  6805 rpcz_store.cc:269] 0709 13:19:55.126764 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:55.126970 (+   206us) service_pool.cc:224] Handling call
0709 13:19:57.555805 (+2428835us) spinlock_profiling.cc:243] Waited 1.18 s on lock 0x7b54001b4ed4. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f9ae2fa 00007fcc1496fb17 00007fcc0deea6d4 00007fcc0deea662 00007fcc0deea591 00007fcc0deea50c 00007fcc0dee97c2 00007fcc0dce548c 00007fcc0dce48c6 00007fcc0dce426f
0709 13:19:57.555986 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2724923136}
I20260709 13:19:57.490468  7502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fa34c08b205435dba97346991aa1f92" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
W20260709 13:19:57.415688 10632 log.cc:927] Time spent T 3d65025eea89441290d85dd053810e31 P ccd8a4c3bfe3413cb2ae219b09aea832: Append to log took a long time: real 0.085s	user 0.000s	sys 0.000s
W20260709 13:19:57.505270 10631 log.cc:927] Time spent T de3186201e1a40d0b335eeb8b4e256e0 P b7ab4784c7344b939bc36f639286f377: Append to log took a long time: real 0.189s	user 0.001s	sys 0.001s
I20260709 13:19:57.336805 10589 raft_consensus.cc:2749] T 3fa34c08b205435dba97346991aa1f92 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:19:57.534726 10614 raft_consensus.cc:493] T 427c124d773f483294511e80fe340075 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:57.414428 10627 raft_consensus.cc:493] T 2c240553ce044eedb41541d72b9475d7 P cd75a17ab2604397adab03bb8b5fd75c [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:57.428833  7468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 112233us
I20260709 13:19:57.610960  7468 leader_election.cc:304] T d8cee0accdb8499c86d4414b72565a38 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:19:57.424100 10551 raft_consensus.cc:493] T e77e330a82df4b43a745d57a68f6f057 P b7ab4784c7344b939bc36f639286f377 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:57.433586  6697 connection.cc:256] RPC call timeout handler was delayed by -1.6062720620000164s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16590000000000002s for a response
W20260709 13:19:57.613641  6697 connection.cc:256] RPC call timeout handler was delayed by -1.5747720619999654s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1694s for a response
W20260709 13:19:57.614006  6697 connection.cc:256] RPC call timeout handler was delayed by -1.4838720619998185s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1795s for a response
W20260709 13:19:57.614290  6697 connection.cc:256] RPC call timeout handler was delayed by -1.2786720619999414s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20230000000000004s for a response
W20260709 13:19:57.614486  6697 connection.cc:256] RPC call timeout handler was delayed by -1.2588720619999094s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20450000000000002s for a response
I20260709 13:19:57.427601 10457 raft_consensus.cc:493] T e77e330a82df4b43a745d57a68f6f057 P cd75a17ab2604397adab03bb8b5fd75c [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:57.558993 10537 leader_election.cc:290] T 4275cf08e63345f993bce8664eada830 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 11 election: Requested vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
W20260709 13:19:57.600620  6698 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:57.334277 10584 raft_consensus.cc:515] T 2c240553ce044eedb41541d72b9475d7 P b7ab4784c7344b939bc36f639286f377 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:57.629128  6729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4b8bd455d5a47c18a1380839c6e0d61" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:19:57.589190 10618 raft_consensus.cc:493] T a1704639a875409b9959353527b3fd68 P cd75a17ab2604397adab03bb8b5fd75c [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:19:57.348987 10387 raft_consensus.cc:493] T de3186201e1a40d0b335eeb8b4e256e0 P cd75a17ab2604397adab03bb8b5fd75c [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:19:57.572395 10542 raft_consensus.cc:493] T f03d0dbf16864ca4bc1bb5e4c0334c0f P ccd8a4c3bfe3413cb2ae219b09aea832 [term 8 FOLLOWER]: Starting leader election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:19:57.492919 10526 leader_election.cc:290] T 3a485a995abc4807b6e511e45419f737 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 9 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:57.578692 10249 raft_consensus.cc:493] T 853ac0a8cbd64ce99457f170216d4d0f P b7ab4784c7344b939bc36f639286f377 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:57.655611  6800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b3759de40694069b13c0f8bd40e5709" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:19:57.611927  6802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab432e62819d499eaaf3dd55481dd930" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:19:57.617679 10352 leader_election.cc:290] T a1704639a875409b9959353527b3fd68 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:57.618464 10551 raft_consensus.cc:515] T e77e330a82df4b43a745d57a68f6f057 P b7ab4784c7344b939bc36f639286f377 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } }
I20260709 13:19:57.619597  6805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f58dc08b12a2494bb9a1372837970ca2" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 13 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:19:57.374569 10602 raft_consensus.cc:515] T 404190ce4ce94cecbfcb6ea9d1dd8626 P b7ab4784c7344b939bc36f639286f377 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:19:57.619994  6731 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50004 (request call id 1878) took 1007 ms. Trace:
I20260709 13:19:57.621325  6697 leader_election.cc:304] T b3f13b31a1f84f0d89d007eadd57924c P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, b7ab4784c7344b939bc36f639286f377
I20260709 13:19:57.628734 10619 leader_election.cc:290] T b56bf91d90824c959e21e0cee5ba1816 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
W20260709 13:19:57.609894 10638 log.cc:927] Time spent T 427c124d773f483294511e80fe340075 P cd75a17ab2604397adab03bb8b5fd75c: Append to log took a long time: real 0.072s	user 0.001s	sys 0.001s
I20260709 13:19:57.668793  6806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4db81d9d329422bb3b4160ca4ac2d1d" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:19:57.670359  6732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "713b5728a197487c9300b310ab94e5a3" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:19:57.631359  6729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6869f07b5a4885a0b99fbe60c3b175" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 11 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:19:57.630336 10367 raft_consensus.cc:493] T 404190ce4ce94cecbfcb6ea9d1dd8626 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:57.389321 10606 raft_consensus.cc:515] T dbdf895bba214ff68685a24fd17dfb5d P b7ab4784c7344b939bc36f639286f377 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:57.646126  7502 raft_consensus.cc:2410] T 3fa34c08b205435dba97346991aa1f92 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ccd8a4c3bfe3413cb2ae219b09aea832 for term 12 because replica has last-logged OpId of term: 11 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 9.
I20260709 13:19:57.647747  6798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44bde925b2e541b69890d70715b85176" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:19:57.653074  6804 raft_consensus.cc:2468] T 2c240553ce044eedb41541d72b9475d7 P b7ab4784c7344b939bc36f639286f377 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 11.
I20260709 13:19:57.610457 10575 leader_election.cc:290] T 9e326172347f45e99a0d482b5d8ef768 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:19:57.658130  6802 raft_consensus.cc:2468] T ab432e62819d499eaaf3dd55481dd930 P b7ab4784c7344b939bc36f639286f377 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 11.
W20260709 13:19:57.630903 10640 log.cc:927] Time spent T 34f36d59d88f40fe8a2805e604fc6c0a P cd75a17ab2604397adab03bb8b5fd75c: Append to log took a long time: real 0.052s	user 0.001s	sys 0.000s
I20260709 13:19:57.661435  6800 raft_consensus.cc:2368] T 9b3759de40694069b13c0f8bd40e5709 P b7ab4784c7344b939bc36f639286f377 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c for earlier term 9. Current term is 10.
W20260709 13:19:57.676654  7468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 65807.2us
I20260709 13:19:57.630515 10452 raft_consensus.cc:493] T f3f9c2e2bf644115957398fe4c9459db P ccd8a4c3bfe3413cb2ae219b09aea832 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:57.662067  6731 rpcz_store.cc:276] 0709 13:19:56.612319 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:56.612476 (+   157us) service_pool.cc:224] Handling call
0709 13:19:56.632263 (+ 19787us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:56.991820 (+359557us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:56.991851 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:57.004961 (+ 13110us) log.cc:844] Serialized 26 byte log entry
0709 13:19:57.064198 (+ 59237us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:19:57.064249 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:57.064313 (+    64us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:57.619779 (+555466us) raft_consensus.cc:1685] finished
0709 13:19:57.619799 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:57.619934 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":380327,"raft.queue_time_us":363746,"raft.run_cpu_time_us":138,"raft.run_wall_time_us":4577,"thread_start_us":58761,"threads_started":1,"wal-append.queue_time_us":135073}
I20260709 13:19:57.629115 10554 raft_consensus.cc:493] T 30e88460611e47b2ba16a46a30b5f416 P b7ab4784c7344b939bc36f639286f377 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:19:57.670197  6872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5be3a11b23d4ea9b08300a2789821c7" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:19:57.671223  6729 raft_consensus.cc:3060] T bd6869f07b5a4885a0b99fbe60c3b175 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:57.653435 10589 raft_consensus.cc:2749] T d8cee0accdb8499c86d4414b72565a38 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:19:57.677802  6872 raft_consensus.cc:3060] T f5be3a11b23d4ea9b08300a2789821c7 P cd75a17ab2604397adab03bb8b5fd75c [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:57.674883 10619 raft_consensus.cc:493] T ce4f062dcd314d43a63ca74067cb5ee3 P cd75a17ab2604397adab03bb8b5fd75c [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:57.602301  6801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d65025eea89441290d85dd053810e31" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:19:57.678290  6723 raft_consensus.cc:1275] T b56bf91d90824c959e21e0cee5ba1816 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 9 FOLLOWER]: Refusing update from remote peer b7ab4784c7344b939bc36f639286f377: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:19:57.427249 10568 leader_election.cc:290] T b3f13b31a1f84f0d89d007eadd57924c P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:19:57.653982 10542 raft_consensus.cc:3060] T f03d0dbf16864ca4bc1bb5e4c0334c0f P ccd8a4c3bfe3413cb2ae219b09aea832 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:57.622007  6728 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ab432e62819d499eaaf3dd55481dd930"
dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
mode: GRACEFUL
new_leader_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
 from {username='slave'} at 127.0.0.1:38536
I20260709 13:19:57.707033  6728 raft_consensus.cc:606] T ab432e62819d499eaaf3dd55481dd930 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 11 FOLLOWER]: Received request to transfer leadership to TS cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:19:57.699537  7466 leader_election.cc:304] T be1a92657f494cac8dd227d152f50151 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: b7ab4784c7344b939bc36f639286f377
I20260709 13:19:57.707432  6728 raft_consensus.cc:614] T ab432e62819d499eaaf3dd55481dd930 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 11 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:19:57.630043 10457 raft_consensus.cc:515] T e77e330a82df4b43a745d57a68f6f057 P cd75a17ab2604397adab03bb8b5fd75c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } }
I20260709 13:19:57.680630  6805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1528ab62b6fe4e3099d08f141afee116" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:19:57.712885  6805 raft_consensus.cc:2393] T 1528ab62b6fe4e3099d08f141afee116 P b7ab4784c7344b939bc36f639286f377 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in current term 10: Already voted for candidate b7ab4784c7344b939bc36f639286f377 in this term.
W20260709 13:19:57.686847  6697 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.68:45071, user_credentials={real_user=slave}} blocked reactor thread for 65615us
I20260709 13:19:57.688874  6877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bf4668eeb70467fb3dc5a0289233b3c" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:19:57.714003  6877 raft_consensus.cc:3060] T 1bf4668eeb70467fb3dc5a0289233b3c P cd75a17ab2604397adab03bb8b5fd75c [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:57.655198 10387 raft_consensus.cc:515] T de3186201e1a40d0b335eeb8b4e256e0 P cd75a17ab2604397adab03bb8b5fd75c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:57.699818  6732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a485a995abc4807b6e511e45419f737" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:19:57.716280  6806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3f13b31a1f84f0d89d007eadd57924c" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:19:57.717881  6802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d9def8b32fd443aa94ab1420b06837b" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:19:57.626085 10614 raft_consensus.cc:515] T 427c124d773f483294511e80fe340075 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } attrs { replace: true } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:19:57.623826 10627 raft_consensus.cc:515] T 2c240553ce044eedb41541d72b9475d7 P cd75a17ab2604397adab03bb8b5fd75c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:57.729403  6697 leader_election.cc:400] T ce4f062dcd314d43a63ca74067cb5ee3 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 9 election: Vote denied by peer 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071) with higher term. Message: Invalid argument: T ce4f062dcd314d43a63ca74067cb5ee3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 9. Current term is 10.
I20260709 13:19:57.733795  6806 raft_consensus.cc:2468] T b3f13b31a1f84f0d89d007eadd57924c P b7ab4784c7344b939bc36f639286f377 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in term 8.
I20260709 13:19:57.734581  6732 raft_consensus.cc:3060] T 3a485a995abc4807b6e511e45419f737 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:57.697280 10352 raft_consensus.cc:2749] T b3f13b31a1f84f0d89d007eadd57924c P ccd8a4c3bfe3413cb2ae219b09aea832 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:19:57.727631 10589 raft_consensus.cc:2804] T be1a92657f494cac8dd227d152f50151 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:19:57.684499 10575 raft_consensus.cc:493] T 3411566abe2d4c9bb4b2adfdd05e6f17 P cd75a17ab2604397adab03bb8b5fd75c [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:57.762404  7468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 84865.5us
I20260709 13:19:57.766283  6802 raft_consensus.cc:2393] T 4d9def8b32fd443aa94ab1420b06837b P b7ab4784c7344b939bc36f639286f377 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c in current term 10: Already voted for candidate b7ab4784c7344b939bc36f639286f377 in this term.
I20260709 13:19:57.751196 10589 raft_consensus.cc:493] T be1a92657f494cac8dd227d152f50151 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 12 FOLLOWER]: Starting leader election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:19:57.777508 10589 raft_consensus.cc:3060] T be1a92657f494cac8dd227d152f50151 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:19:57.778424 10641 log.cc:927] Time spent T fe20b4b48823486ca3b9c648db6ce8aa P ccd8a4c3bfe3413cb2ae219b09aea832: Append to log took a long time: real 0.201s	user 0.000s	sys 0.001s
W20260709 13:19:57.779511 10644 log.cc:927] Time spent T f03d0dbf16864ca4bc1bb5e4c0334c0f P b7ab4784c7344b939bc36f639286f377: Append to log took a long time: real 0.151s	user 0.001s	sys 0.000s
I20260709 13:19:57.781828 10457 leader_election.cc:290] T e77e330a82df4b43a745d57a68f6f057 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391)
I20260709 13:19:57.783026  6728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20f6842e26174571996b8dea4151d4be" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 12 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:19:57.649186 10618 raft_consensus.cc:515] T a1704639a875409b9959353527b3fd68 P cd75a17ab2604397adab03bb8b5fd75c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:57.784866 10240 leader_election.cc:290] T 9e326172347f45e99a0d482b5d8ef768 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:57.785810 10618 leader_election.cc:290] T a1704639a875409b9959353527b3fd68 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
W20260709 13:19:57.766084 10640 log.cc:927] Time spent T 34f36d59d88f40fe8a2805e604fc6c0a P cd75a17ab2604397adab03bb8b5fd75c: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260709 13:19:57.787544 10606 leader_election.cc:290] T dbdf895bba214ff68685a24fd17dfb5d P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:57.677758 10554 raft_consensus.cc:515] T 30e88460611e47b2ba16a46a30b5f416 P b7ab4784c7344b939bc36f639286f377 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:57.677877 10367 raft_consensus.cc:515] T 404190ce4ce94cecbfcb6ea9d1dd8626 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:19:57.775853  7496 raft_consensus.cc:2468] T 427c124d773f483294511e80fe340075 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 9.
I20260709 13:19:57.684115 10452 raft_consensus.cc:515] T f3f9c2e2bf644115957398fe4c9459db P ccd8a4c3bfe3413cb2ae219b09aea832 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:57.673966 10249 raft_consensus.cc:515] T 853ac0a8cbd64ce99457f170216d4d0f P b7ab4784c7344b939bc36f639286f377 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
W20260709 13:19:57.797137  6696 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:57.802363  6696 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:57.803764  6728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3f13b31a1f84f0d89d007eadd57924c" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:19:57.798353  6872 raft_consensus.cc:2468] T f5be3a11b23d4ea9b08300a2789821c7 P cd75a17ab2604397adab03bb8b5fd75c [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 8.
I20260709 13:19:57.805131  6731 raft_consensus.cc:1240] T f5be3a11b23d4ea9b08300a2789821c7 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 8 FOLLOWER]: Rejecting Update request from peer b7ab4784c7344b939bc36f639286f377 for earlier term 7. Current term is 8. Ops: []
I20260709 13:19:57.806036  6872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8292e16e5654be6bc408560cf256aaa" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:19:57.806368  6878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44bde925b2e541b69890d70715b85176" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:19:57.807129  6872 raft_consensus.cc:3060] T d8292e16e5654be6bc408560cf256aaa P cd75a17ab2604397adab03bb8b5fd75c [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:57.814927  6728 raft_consensus.cc:2468] T b3f13b31a1f84f0d89d007eadd57924c P ccd8a4c3bfe3413cb2ae219b09aea832 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in term 8.
I20260709 13:19:57.710350 10619 raft_consensus.cc:515] T ce4f062dcd314d43a63ca74067cb5ee3 P cd75a17ab2604397adab03bb8b5fd75c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } attrs { replace: true } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:19:57.813808  6723 pending_rounds.cc:85] T 427c124d773f483294511e80fe340075 P ccd8a4c3bfe3413cb2ae219b09aea832: Aborting all ops after (but not including) 5
I20260709 13:19:57.830081  6723 pending_rounds.cc:107] T 427c124d773f483294511e80fe340075 P ccd8a4c3bfe3413cb2ae219b09aea832: Aborting uncommitted NO_OP operation due to leader change: 8.6
I20260709 13:19:57.830498  6723 raft_consensus.cc:2889] T 427c124d773f483294511e80fe340075 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:19:57.832341  6726 raft_consensus.cc:1217] T fe20b4b48823486ca3b9c648db6ce8aa P ccd8a4c3bfe3413cb2ae219b09aea832 [term 8 FOLLOWER]: Deduplicated request from leader. Original: 6.7->[7.8-7.8]   Dedup: 7.8->[]
I20260709 13:19:57.833112  6726 raft_consensus.cc:1240] T fe20b4b48823486ca3b9c648db6ce8aa P ccd8a4c3bfe3413cb2ae219b09aea832 [term 8 FOLLOWER]: Rejecting Update request from peer cd75a17ab2604397adab03bb8b5fd75c for earlier term 7. Current term is 8. Ops: [7.8-7.8]
I20260709 13:19:57.834504  6877 raft_consensus.cc:2468] T 1bf4668eeb70467fb3dc5a0289233b3c P cd75a17ab2604397adab03bb8b5fd75c [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 10.
I20260709 13:19:57.836090  6877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c240553ce044eedb41541d72b9475d7" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:19:57.841784  6877 raft_consensus.cc:2468] T 2c240553ce044eedb41541d72b9475d7 P cd75a17ab2604397adab03bb8b5fd75c [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 11.
I20260709 13:19:57.773020 10575 raft_consensus.cc:515] T 3411566abe2d4c9bb4b2adfdd05e6f17 P cd75a17ab2604397adab03bb8b5fd75c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:57.712064 10538 consensus_queue.cc:237] T 9b3759de40694069b13c0f8bd40e5709 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:57.848215  6878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b3759de40694069b13c0f8bd40e5709" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:19:57.854367  6729 raft_consensus.cc:2468] T bd6869f07b5a4885a0b99fbe60c3b175 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 11.
I20260709 13:19:57.856439  6729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d65025eea89441290d85dd053810e31" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:19:57.771337 10568 consensus_queue.cc:1048] T ce4f062dcd314d43a63ca74067cb5ee3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.042s
I20260709 13:19:57.807484 10649 raft_consensus.cc:493] T d8cee0accdb8499c86d4414b72565a38 P cd75a17ab2604397adab03bb8b5fd75c [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:19:57.860558  6878 raft_consensus.cc:3060] T 9b3759de40694069b13c0f8bd40e5709 P cd75a17ab2604397adab03bb8b5fd75c [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:57.848857 10436 leader_election.cc:290] T 711ef6523deb4cbe8ef2ba61e1c21c98 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:19:57.859543 10618 raft_consensus.cc:493] T 7c44c4849aa54f2b94d1f1bef9ed546f P cd75a17ab2604397adab03bb8b5fd75c [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:57.865768 10614 leader_election.cc:290] T 427c124d773f483294511e80fe340075 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:57.866533  6731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f58dc08b12a2494bb9a1372837970ca2" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 13 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:19:57.869024  6726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab432e62819d499eaaf3dd55481dd930" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:19:57.869750  6872 raft_consensus.cc:2468] T d8292e16e5654be6bc408560cf256aaa P cd75a17ab2604397adab03bb8b5fd75c [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 13.
I20260709 13:19:57.872560  6872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "427c124d773f483294511e80fe340075" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:19:57.871397  6729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4db81d9d329422bb3b4160ca4ac2d1d" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:19:57.872980  6879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fa34c08b205435dba97346991aa1f92" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:19:57.879377  6726 raft_consensus.cc:2393] T ab432e62819d499eaaf3dd55481dd930 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c in current term 11: Already voted for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in this term.
W20260709 13:19:57.883015  7466 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 144687us
I20260709 13:19:57.878218  6877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6869f07b5a4885a0b99fbe60c3b175" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 11 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:19:57.885618  6872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3d8792045a4583ae2e965b1350a5b4" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:19:57.884465  7466 leader_election.cc:304] T b3f13b31a1f84f0d89d007eadd57924c P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
I20260709 13:19:57.834434 10445 consensus_queue.cc:1048] T 1528ab62b6fe4e3099d08f141afee116 P 7ba59cc884714e8aa5f3f0ecaed84cbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.042s
I20260709 13:19:57.874996 10584 leader_election.cc:290] T 2c240553ce044eedb41541d72b9475d7 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
W20260709 13:19:57.888693  6844 connection.cc:256] RPC call timeout handler was delayed by -2.1466460379999717s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1501s for a response
W20260709 13:19:57.891381  6697 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.68:45071, user_credentials={real_user=slave}} blocked reactor thread for 177687us
I20260709 13:19:57.881949 10626 raft_consensus.cc:493] T 24ee15416e3145beaa1b8183453729a3 P cd75a17ab2604397adab03bb8b5fd75c [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:57.885254 10595 log.cc:927] Time spent T 7c37d41cd9164c15a6826ca62a851a69 P ccd8a4c3bfe3413cb2ae219b09aea832: Append to log took a long time: real 0.859s	user 0.000s	sys 0.004s
W20260709 13:19:57.898561  6844 connection.cc:256] RPC call timeout handler was delayed by -1.5796460379999644s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21309999999999998s for a response
W20260709 13:19:57.909040  6844 connection.cc:256] RPC call timeout handler was delayed by -1.4752460379997956s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2247s for a response
I20260709 13:19:57.903071 10627 leader_election.cc:290] T 2c240553ce044eedb41541d72b9475d7 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:19:57.876608 10649 raft_consensus.cc:515] T d8cee0accdb8499c86d4414b72565a38 P cd75a17ab2604397adab03bb8b5fd75c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:19:57.926060 10649 leader_election.cc:290] T d8cee0accdb8499c86d4414b72565a38 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:19:57.926764 10626 raft_consensus.cc:515] T 24ee15416e3145beaa1b8183453729a3 P cd75a17ab2604397adab03bb8b5fd75c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
W20260709 13:19:57.927605 10639 log.cc:927] Time spent T f03d0dbf16864ca4bc1bb5e4c0334c0f P cd75a17ab2604397adab03bb8b5fd75c: Append to log took a long time: real 0.589s	user 0.001s	sys 0.001s
I20260709 13:19:57.901274  6697 leader_election.cc:304] T 17587d6730594da4a56fa13a353232a1 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: b7ab4784c7344b939bc36f639286f377
I20260709 13:19:57.931149  6697 leader_election.cc:400] T 1528ab62b6fe4e3099d08f141afee116 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 9 election: Vote denied by peer 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071) with higher term. Message: Invalid argument: T 1528ab62b6fe4e3099d08f141afee116 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 9. Current term is 10.
I20260709 13:19:57.931442  6697 leader_election.cc:403] T 1528ab62b6fe4e3099d08f141afee116 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 9 election: Cancelling election due to peer responding with higher term
I20260709 13:19:57.932489 10585 raft_consensus.cc:2804] T 17587d6730594da4a56fa13a353232a1 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:19:57.933041 10585 raft_consensus.cc:493] T 17587d6730594da4a56fa13a353232a1 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 13 FOLLOWER]: Starting leader election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:19:57.933475 10585 raft_consensus.cc:3060] T 17587d6730594da4a56fa13a353232a1 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:57.936472 10537 raft_consensus.cc:2749] T 1528ab62b6fe4e3099d08f141afee116 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 10 FOLLOWER]: Leader election lost for term 9. Reason: Vote denied by peer 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071) with higher term. Message: Invalid argument: T 1528ab62b6fe4e3099d08f141afee116 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 9. Current term is 10.
I20260709 13:19:57.937067 10551 leader_election.cc:290] T e77e330a82df4b43a745d57a68f6f057 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931), ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391)
I20260709 13:19:57.938534 10452 leader_election.cc:290] T f3f9c2e2bf644115957398fe4c9459db P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
W20260709 13:19:57.909840  6844 connection.cc:256] RPC call timeout handler was delayed by -1.2286460379998516s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2521s for a response
I20260709 13:19:57.914461  6872 raft_consensus.cc:1240] T a3022224cc81473690653a83d4e99470 P cd75a17ab2604397adab03bb8b5fd75c [term 11 FOLLOWER]: Rejecting Update request from peer ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 10. Current term is 11. Ops: []
I20260709 13:19:57.847679 10650 consensus_queue.cc:1048] T 404190ce4ce94cecbfcb6ea9d1dd8626 P 7ba59cc884714e8aa5f3f0ecaed84cbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.058s
I20260709 13:19:57.917300  6874 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58592 (request call id 277) took 1084 ms. Trace:
I20260709 13:19:57.941133  6844 leader_election.cc:304] T e31b9971c15848dea59d4d4130141d9e P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:19:57.940900  6874 rpcz_store.cc:276] 0709 13:19:56.832777 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:56.832925 (+   148us) service_pool.cc:224] Handling call
0709 13:19:56.959913 (+126988us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:56.963260 (+  3347us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:57.917062 (+953802us) spinlock_profiling.cc:243] Waited 1.82 ms on lock 0x7b54002189d0. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f9a98ad 00007fcc1496e419 00007fcc0dee5bd4 00007fcc0dee5b62 00007fcc0dee5a91 00007fcc0dee5a0c 00007fcc0dee4cc2 00007fcc0dce548c 00007fcc0dce48c6 00007fcc0dce426f
0709 13:19:57.917230 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4180736}
W20260709 13:19:57.919323 10636 log.cc:927] Time spent T 90d42e216d9741e190bca19a781291fd P b7ab4784c7344b939bc36f639286f377: Append to log took a long time: real 0.544s	user 0.001s	sys 0.000s
I20260709 13:19:57.920898 10591 raft_consensus.cc:3055] T 90d42e216d9741e190bca19a781291fd P ccd8a4c3bfe3413cb2ae219b09aea832 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:19:57.889612 10436 raft_consensus.cc:493] T f09c2a98de1a4decabd0ff900dd44caa P cd75a17ab2604397adab03bb8b5fd75c [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:57.914331 10445 raft_consensus.cc:2804] T b3f13b31a1f84f0d89d007eadd57924c P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:19:57.942592  6732 raft_consensus.cc:2468] T 3a485a995abc4807b6e511e45419f737 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 9.
I20260709 13:19:57.938948  9890 raft_consensus.cc:493] T de3186201e1a40d0b335eeb8b4e256e0 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 10 FOLLOWER]: Starting leader election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:19:57.943459  6878 raft_consensus.cc:2468] T 9b3759de40694069b13c0f8bd40e5709 P cd75a17ab2604397adab03bb8b5fd75c [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 10.
I20260709 13:19:57.945638  6731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "427c124d773f483294511e80fe340075" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 10 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:19:57.874169 10618 raft_consensus.cc:515] T 7c44c4849aa54f2b94d1f1bef9ed546f P cd75a17ab2604397adab03bb8b5fd75c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:57.939213 10626 leader_election.cc:290] T 24ee15416e3145beaa1b8183453729a3 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
W20260709 13:19:57.968123 10648 log.cc:927] Time spent T f09c2a98de1a4decabd0ff900dd44caa P b7ab4784c7344b939bc36f639286f377: Append to log took a long time: real 0.097s	user 0.001s	sys 0.000s
I20260709 13:19:57.969079  6875 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53406 (request call id 1939) took 1112 ms. Trace:
W20260709 13:19:57.997810  6697 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.68:45071, user_credentials={real_user=slave}} blocked reactor thread for 66802.1us
W20260709 13:19:57.970345 10645 log.cc:927] Time spent T ce4f062dcd314d43a63ca74067cb5ee3 P b7ab4784c7344b939bc36f639286f377: Append to log took a long time: real 0.082s	user 0.000s	sys 0.000s
W20260709 13:19:57.977932 10651 log.cc:927] Time spent T 24ee15416e3145beaa1b8183453729a3 P ccd8a4c3bfe3413cb2ae219b09aea832: Append to log took a long time: real 0.128s	user 0.001s	sys 0.000s
I20260709 13:19:57.979225  6730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b3759de40694069b13c0f8bd40e5709" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:19:57.980252 10452 raft_consensus.cc:493] T b56bf91d90824c959e21e0cee5ba1816 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:57.996340  6875 rpcz_store.cc:276] 0709 13:19:56.856531 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:56.962847 (+106316us) service_pool.cc:224] Handling call
0709 13:19:56.963352 (+   505us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:19:56.967862 (+  4510us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:56.967906 (+    44us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:19:57.045975 (+ 78069us) log.cc:844] Serialized 52 byte log entry
0709 13:19:57.120930 (+ 74955us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:19:57.138845 (+ 17915us) log.cc:844] Serialized 14 byte log entry
0709 13:19:57.139223 (+   378us) log.cc:844] Serialized 14 byte log entry
0709 13:19:57.139408 (+   185us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:57.139480 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:57.865369 (+725889us) spinlock_profiling.cc:243] Waited 2.06 ms on lock 0x7b1800411ee0. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc15785de1 00007fcc157925b1 00007fcc0c8bd3f3 00007fcc0c8bf7c1 00007fcc0c8bf779 00007fcc0c8bf709 00007fcc0c8bf6d1 00007fcc0c8be9cd 000000000038f354 000000000038f199 00007fcc0c8a083a
0709 13:19:57.926931 (+ 61562us) spinlock_profiling.cc:243] Waited 22.6 ms on lock 0x7b4400022b4c. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0c745db1 00007fcc0c7e3c85 00007fcc0c7e46a2 00007fcc0f5561db 00007fcc0f551aaf 00007fcc0f54586e 00007fcc0f544bb6 00007fcc0f5447d8 00007fcc0f54e221 00007fcc0f54e1d9 00007fcc0f54e169
0709 13:19:57.968851 (+ 41920us) raft_consensus.cc:1685] finished
0709 13:19:57.968870 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:57.969013 (+   143us) inbound_call.cc:177] Queueing success response
0709 13:19:57.970770 (+  1757us) spinlock_profiling.cc:243] Waited 2.01 ms on lock 0x7b1800411ee0. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc15785de1 00007fcc157925b1 00007fcc0c8bd3f3 00007fcc0c8bf7c1 00007fcc0c8bf779 00007fcc0c8bf709 00007fcc0c8bf6d1 00007fcc0c8be9cd 000000000038f354 000000000038f199 00007fcc0c8a083a
Metrics: {"mutex_wait_us":4300,"prepare.queue_time_us":24339,"prepare.run_cpu_time_us":60,"prepare.run_wall_time_us":61,"raft.queue_time_us":8087,"raft.run_cpu_time_us":355,"raft.run_wall_time_us":358,"spinlock_wait_cycles":61387904,"thread_start_us":39919,"threads_started":1,"wal-append.queue_time_us":136125}
I20260709 13:19:58.004769 10452 raft_consensus.cc:515] T b56bf91d90824c959e21e0cee5ba1816 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:58.005702  6875 raft_consensus.cc:1240] T 90d42e216d9741e190bca19a781291fd P cd75a17ab2604397adab03bb8b5fd75c [term 10 FOLLOWER]: Rejecting Update request from peer ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 9. Current term is 10. Ops: []
I20260709 13:19:58.006906  6875 raft_consensus.cc:1240] T 8c7f33e544204fbaac4078e3e83bbf4e P cd75a17ab2604397adab03bb8b5fd75c [term 7 FOLLOWER]: Rejecting Update request from peer ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 6. Current term is 7. Ops: []
I20260709 13:19:58.007014 10452 leader_election.cc:290] T b56bf91d90824c959e21e0cee5ba1816 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:57.983662  6798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90d42e216d9741e190bca19a781291fd" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:19:57.986029 10575 leader_election.cc:290] T 3411566abe2d4c9bb4b2adfdd05e6f17 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:19:57.951287 10653 raft_consensus.cc:493] T 7887766dc6784fcaa42b35c05fea7a99 P cd75a17ab2604397adab03bb8b5fd75c [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:19:58.007932  6875 raft_consensus.cc:1240] T f4b8bd455d5a47c18a1380839c6e0d61 P cd75a17ab2604397adab03bb8b5fd75c [term 9 FOLLOWER]: Rejecting Update request from peer ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 8. Current term is 9. Ops: []
I20260709 13:19:58.008400 10653 raft_consensus.cc:515] T 7887766dc6784fcaa42b35c05fea7a99 P cd75a17ab2604397adab03bb8b5fd75c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:57.950769 10436 raft_consensus.cc:515] T f09c2a98de1a4decabd0ff900dd44caa P cd75a17ab2604397adab03bb8b5fd75c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
W20260709 13:19:57.989367  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 48341us
I20260709 13:19:57.947875 10445 raft_consensus.cc:493] T b3f13b31a1f84f0d89d007eadd57924c P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:57.945261 10591 raft_consensus.cc:740] T 90d42e216d9741e190bca19a781291fd P ccd8a4c3bfe3413cb2ae219b09aea832 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
I20260709 13:19:58.023824  6844 leader_election.cc:304] T 7c37d41cd9164c15a6826ca62a851a69 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377
I20260709 13:19:57.954015  6732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbdf895bba214ff68685a24fd17dfb5d" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
W20260709 13:19:57.969265 10656 log.cc:927] Time spent T bb7fa124c3bf4ef9ab65a407cb008441 P 7ba59cc884714e8aa5f3f0ecaed84cbb: Append to log took a long time: real 0.078s	user 0.000s	sys 0.000s
I20260709 13:19:58.027393 10436 leader_election.cc:290] T f09c2a98de1a4decabd0ff900dd44caa P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:19:57.999550  6697 leader_election.cc:304] T be1a92657f494cac8dd227d152f50151 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, b7ab4784c7344b939bc36f639286f377
I20260709 13:19:57.960619 10649 raft_consensus.cc:2749] T e31b9971c15848dea59d4d4130141d9e P cd75a17ab2604397adab03bb8b5fd75c [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:19:58.028668 10367 leader_election.cc:290] T 404190ce4ce94cecbfcb6ea9d1dd8626 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:19:58.028864 10649 raft_consensus.cc:2804] T 7c37d41cd9164c15a6826ca62a851a69 P cd75a17ab2604397adab03bb8b5fd75c [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:19:58.023584 10445 raft_consensus.cc:3060] T b3f13b31a1f84f0d89d007eadd57924c P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:58.029346 10649 raft_consensus.cc:493] T 7c37d41cd9164c15a6826ca62a851a69 P cd75a17ab2604397adab03bb8b5fd75c [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:58.030068 10649 raft_consensus.cc:3060] T 7c37d41cd9164c15a6826ca62a851a69 P cd75a17ab2604397adab03bb8b5fd75c [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:58.030511 10554 leader_election.cc:290] T 30e88460611e47b2ba16a46a30b5f416 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:58.010181  6875 raft_consensus.cc:1275] T e77e330a82df4b43a745d57a68f6f057 P cd75a17ab2604397adab03bb8b5fd75c [term 12 FOLLOWER]: Refusing update from remote peer ccd8a4c3bfe3413cb2ae219b09aea832: Log matching property violated. Preceding OpId in replica: term: 11 index: 5. Preceding OpId from leader: term: 12 index: 6. (index mismatch)
W20260709 13:19:58.032064 10248 consensus_meta.cc:287] T 95a75bfe094d4bdc963aba3f08dfcd25 P ccd8a4c3bfe3413cb2ae219b09aea832: Time spent flushing consensus metadata: real 0.890s	user 0.011s	sys 0.002s
I20260709 13:19:57.991963 10602 leader_election.cc:290] T 404190ce4ce94cecbfcb6ea9d1dd8626 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:19:58.032521 10248 raft_consensus.cc:515] T 95a75bfe094d4bdc963aba3f08dfcd25 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:57.963934  9890 raft_consensus.cc:3060] T de3186201e1a40d0b335eeb8b4e256e0 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:58.033773  6803 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50550 (request call id 350) took 2154 ms. Trace:
I20260709 13:19:58.034174  6803 rpcz_store.cc:276] 0709 13:19:55.879200 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:55.884333 (+  5133us) service_pool.cc:224] Handling call
0709 13:19:57.556190 (+1671857us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:57.571095 (+ 14905us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:58.033554 (+462459us) spinlock_profiling.cc:243] Waited 1.67 s on lock 0x7b54001b4ed0. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f9a98ad 00007fcc1496e419 00007fcc0dee5bd4 00007fcc0dee5b62 00007fcc0dee5a91 00007fcc0dee5a0c 00007fcc0dee4cc2 00007fcc0dce548c 00007fcc0dce48c6 00007fcc0dce426f
0709 13:19:58.033687 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3843746048}
I20260709 13:19:58.034729 10619 leader_election.cc:290] T ce4f062dcd314d43a63ca74067cb5ee3 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:19:58.011765  6806 raft_consensus.cc:1240] T bd6869f07b5a4885a0b99fbe60c3b175 P b7ab4784c7344b939bc36f639286f377 [term 11 FOLLOWER]: Rejecting Update request from peer cd75a17ab2604397adab03bb8b5fd75c for earlier term 10. Current term is 11. Ops: []
I20260709 13:19:58.020828 10653 leader_election.cc:290] T 7887766dc6784fcaa42b35c05fea7a99 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:19:58.043833  6875 raft_consensus.cc:1275] T 20f6842e26174571996b8dea4151d4be P cd75a17ab2604397adab03bb8b5fd75c [term 11 FOLLOWER]: Refusing update from remote peer ccd8a4c3bfe3413cb2ae219b09aea832: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:19:58.026476  6732 raft_consensus.cc:2468] T dbdf895bba214ff68685a24fd17dfb5d P ccd8a4c3bfe3413cb2ae219b09aea832 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 9.
I20260709 13:19:58.027927  7495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b8cacb381b746da8d0049b0a83b41dd" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb"
I20260709 13:19:58.024588 10387 leader_election.cc:290] T de3186201e1a40d0b335eeb8b4e256e0 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:19:58.029403  6844 leader_election.cc:304] T 4275cf08e63345f993bce8664eada830 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377
I20260709 13:19:58.015120  7498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb7fa124c3bf4ef9ab65a407cb008441" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb"
I20260709 13:19:58.036638  6731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d9def8b32fd443aa94ab1420b06837b" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:19:58.012493 10568 raft_consensus.cc:493] T 24ee15416e3145beaa1b8183453729a3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:58.050478  6875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e326172347f45e99a0d482b5d8ef768" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:19:58.050948  6725 raft_consensus.cc:1240] T 95a75bfe094d4bdc963aba3f08dfcd25 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 11 FOLLOWER]: Rejecting Update request from peer b7ab4784c7344b939bc36f639286f377 for earlier term 10. Current term is 11. Ops: []
I20260709 13:19:58.054757  6875 raft_consensus.cc:2468] T 9e326172347f45e99a0d482b5d8ef768 P cd75a17ab2604397adab03bb8b5fd75c [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 8.
I20260709 13:19:58.058089  6731 raft_consensus.cc:2393] T 4d9def8b32fd443aa94ab1420b06837b P ccd8a4c3bfe3413cb2ae219b09aea832 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c in current term 10: Already voted for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in this term.
I20260709 13:19:58.049710  6806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbdf895bba214ff68685a24fd17dfb5d" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:19:58.063170  6806 raft_consensus.cc:2468] T dbdf895bba214ff68685a24fd17dfb5d P b7ab4784c7344b939bc36f639286f377 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 9.
I20260709 13:19:58.063263  6875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f9c2e2bf644115957398fe4c9459db" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:19:58.064482  6875 raft_consensus.cc:2468] T f3f9c2e2bf644115957398fe4c9459db P cd75a17ab2604397adab03bb8b5fd75c [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 9.
I20260709 13:19:58.040145 10537 raft_consensus.cc:2749] T be1a92657f494cac8dd227d152f50151 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:19:57.987725 10252 consensus_queue.cc:260] T 853ac0a8cbd64ce99457f170216d4d0f P ccd8a4c3bfe3413cb2ae219b09aea832 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:58.066397  6875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4275cf08e63345f993bce8664eada830" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:19:58.052822  6878 raft_consensus.cc:1240] T f09c2a98de1a4decabd0ff900dd44caa P cd75a17ab2604397adab03bb8b5fd75c [term 12 FOLLOWER]: Rejecting Update request from peer ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 11. Current term is 12. Ops: [9.5-11.6]
I20260709 13:19:58.077744  6806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb7fa124c3bf4ef9ab65a407cb008441" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:19:58.079023  6806 raft_consensus.cc:2393] T bb7fa124c3bf4ef9ab65a407cb008441 P b7ab4784c7344b939bc36f639286f377 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c in current term 10: Already voted for candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in this term.
I20260709 13:19:58.066313 10387 raft_consensus.cc:2804] T 4275cf08e63345f993bce8664eada830 P cd75a17ab2604397adab03bb8b5fd75c [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:19:58.085898  6878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b56bf91d90824c959e21e0cee5ba1816" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:19:58.096840  6732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8292e16e5654be6bc408560cf256aaa" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:19:58.062175 10568 raft_consensus.cc:515] T 24ee15416e3145beaa1b8183453729a3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:19:58.097702  6732 raft_consensus.cc:2393] T d8292e16e5654be6bc408560cf256aaa P ccd8a4c3bfe3413cb2ae219b09aea832 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c in current term 13: Already voted for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in this term.
I20260709 13:19:58.097549  7498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24ee15416e3145beaa1b8183453729a3" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 11 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:19:58.084705 10252 raft_consensus.cc:3060] T 853ac0a8cbd64ce99457f170216d4d0f P ccd8a4c3bfe3413cb2ae219b09aea832 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:58.095161  6878 raft_consensus.cc:2468] T b56bf91d90824c959e21e0cee5ba1816 P cd75a17ab2604397adab03bb8b5fd75c [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 9.
I20260709 13:19:58.105264  6803 raft_consensus.cc:1240] T 07a92dd554674067a83a9cb68c4773f2 P b7ab4784c7344b939bc36f639286f377 [term 10 LEADER]: Rejecting Update request from peer cd75a17ab2604397adab03bb8b5fd75c for earlier term 9. Current term is 10. Ops: []
I20260709 13:19:58.105314  6878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1704639a875409b9959353527b3fd68" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:19:58.106513  6878 raft_consensus.cc:2468] T a1704639a875409b9959353527b3fd68 P cd75a17ab2604397adab03bb8b5fd75c [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 10.
I20260709 13:19:58.093875 10387 raft_consensus.cc:493] T 4275cf08e63345f993bce8664eada830 P cd75a17ab2604397adab03bb8b5fd75c [term 10 FOLLOWER]: Starting leader election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:19:58.114109  7498 raft_consensus.cc:2468] T 24ee15416e3145beaa1b8183453729a3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 10.
I20260709 13:19:58.120769  6806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "713b5728a197487c9300b310ab94e5a3" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:19:58.121909  6806 raft_consensus.cc:2393] T 713b5728a197487c9300b310ab94e5a3 P b7ab4784c7344b939bc36f639286f377 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c in current term 11: Already voted for candidate b7ab4784c7344b939bc36f639286f377 in this term.
I20260709 13:19:58.123880  6732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90d42e216d9741e190bca19a781291fd" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:19:58.125519  6878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "427c124d773f483294511e80fe340075" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 10 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:19:58.127200  6878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce4f062dcd314d43a63ca74067cb5ee3" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:19:58.131196  7499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "404190ce4ce94cecbfcb6ea9d1dd8626" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
W20260709 13:19:58.131695 10660 log.cc:927] Time spent T 404190ce4ce94cecbfcb6ea9d1dd8626 P b7ab4784c7344b939bc36f639286f377: Append to log took a long time: real 0.072s	user 0.001s	sys 0.001s
I20260709 13:19:58.132687  7494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe20b4b48823486ca3b9c648db6ce8aa" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:19:58.133788  7501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce4f062dcd314d43a63ca74067cb5ee3" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 11 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:19:58.137243  6726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b8cacb381b746da8d0049b0a83b41dd" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:19:58.138695  6726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44bde925b2e541b69890d70715b85176" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:19:58.139667  6726 raft_consensus.cc:2410] T 44bde925b2e541b69890d70715b85176 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c for term 11 because replica has last-logged OpId of term: 10 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
W20260709 13:19:58.143193  6773 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:58.145861 10418 leader_election.cc:290] T bd6869f07b5a4885a0b99fbe60c3b175 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 11 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:58.147831 10550 raft_consensus.cc:3055] T 713b5728a197487c9300b310ab94e5a3 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:19:58.116768 10650 consensus_queue.cc:1048] T fe20b4b48823486ca3b9c648db6ce8aa P 7ba59cc884714e8aa5f3f0ecaed84cbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.032s
I20260709 13:19:58.148275 10550 raft_consensus.cc:740] T 713b5728a197487c9300b310ab94e5a3 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
I20260709 13:19:58.149437 10650 consensus_queue.cc:1048] T ce4f062dcd314d43a63ca74067cb5ee3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:19:58.149997 10618 leader_election.cc:290] T 7c44c4849aa54f2b94d1f1bef9ed546f P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:19:58.116488 10387 raft_consensus.cc:3060] T 4275cf08e63345f993bce8664eada830 P cd75a17ab2604397adab03bb8b5fd75c [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:58.089227 10591 consensus_queue.cc:260] T 90d42e216d9741e190bca19a781291fd P ccd8a4c3bfe3413cb2ae219b09aea832 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:58.153275 10591 raft_consensus.cc:3060] T 90d42e216d9741e190bca19a781291fd P ccd8a4c3bfe3413cb2ae219b09aea832 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:58.156132  6798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb7fa124c3bf4ef9ab65a407cb008441" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:19:58.149207 10550 consensus_queue.cc:260] T 713b5728a197487c9300b310ab94e5a3 P ccd8a4c3bfe3413cb2ae219b09aea832 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:58.157274  6807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20f6842e26174571996b8dea4151d4be" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:19:58.163311  6807 raft_consensus.cc:2468] T 20f6842e26174571996b8dea4151d4be P b7ab4784c7344b939bc36f639286f377 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 11.
I20260709 13:19:58.112092 10249 leader_election.cc:290] T 853ac0a8cbd64ce99457f170216d4d0f P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:58.163393  6798 raft_consensus.cc:2393] T bb7fa124c3bf4ef9ab65a407cb008441 P b7ab4784c7344b939bc36f639286f377 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c in current term 10: Already voted for candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in this term.
I20260709 13:19:58.164426  6802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "427c124d773f483294511e80fe340075" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 10 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:19:58.175869  6805 raft_consensus.cc:1275] T bb7fa124c3bf4ef9ab65a407cb008441 P b7ab4784c7344b939bc36f639286f377 [term 10 FOLLOWER]: Refusing update from remote peer 7ba59cc884714e8aa5f3f0ecaed84cbb: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:19:58.178333  6726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "713b5728a197487c9300b310ab94e5a3" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:19:58.179350  6806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8292e16e5654be6bc408560cf256aaa" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:19:58.181905  6803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34f36d59d88f40fe8a2805e604fc6c0a" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:19:58.184469  6878 raft_consensus.cc:2468] T ce4f062dcd314d43a63ca74067cb5ee3 P cd75a17ab2604397adab03bb8b5fd75c [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in term 10.
I20260709 13:19:58.185920  6878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f00a2e87e56452083b759f60d461ee3" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:19:58.186980  6878 raft_consensus.cc:2393] T 4f00a2e87e56452083b759f60d461ee3 P cd75a17ab2604397adab03bb8b5fd75c [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in current term 10: Already voted for candidate cd75a17ab2604397adab03bb8b5fd75c in this term.
I20260709 13:19:58.188889  6723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34f36d59d88f40fe8a2805e604fc6c0a" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:19:58.194407  6723 raft_consensus.cc:2410] T 34f36d59d88f40fe8a2805e604fc6c0a P ccd8a4c3bfe3413cb2ae219b09aea832 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c for term 8 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 13:19:58.195123  7468 leader_election.cc:304] T 427c124d773f483294511e80fe340075 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:19:58.187549 10550 raft_consensus.cc:3060] T 713b5728a197487c9300b310ab94e5a3 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:58.199739  6803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e326172347f45e99a0d482b5d8ef768" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
W20260709 13:19:58.193960 10581 consensus_meta.cc:287] T f09c2a98de1a4decabd0ff900dd44caa P ccd8a4c3bfe3413cb2ae219b09aea832: Time spent flushing consensus metadata: real 0.827s	user 0.011s	sys 0.003s
I20260709 13:19:58.205034  6803 raft_consensus.cc:2393] T 9e326172347f45e99a0d482b5d8ef768 P b7ab4784c7344b939bc36f639286f377 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c in current term 9: Already voted for candidate b7ab4784c7344b939bc36f639286f377 in this term.
I20260709 13:19:58.206151  6802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b56bf91d90824c959e21e0cee5ba1816" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
W20260709 13:19:58.203042 10574 consensus_meta.cc:287] T 711ef6523deb4cbe8ef2ba61e1c21c98 P ccd8a4c3bfe3413cb2ae219b09aea832: Time spent flushing consensus metadata: real 0.616s	user 0.014s	sys 0.000s
I20260709 13:19:58.208622  6723 raft_consensus.cc:1240] T bd6869f07b5a4885a0b99fbe60c3b175 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 11 FOLLOWER]: Rejecting Update request from peer cd75a17ab2604397adab03bb8b5fd75c for earlier term 10. Current term is 11. Ops: []
I20260709 13:19:58.190146 10248 leader_election.cc:290] T 95a75bfe094d4bdc963aba3f08dfcd25 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 11 election: Requested vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:58.216672 10574 raft_consensus.cc:515] T 711ef6523deb4cbe8ef2ba61e1c21c98 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:58.219700 10574 leader_election.cc:290] T 711ef6523deb4cbe8ef2ba61e1c21c98 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 11 election: Requested vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:58.203418 10664 raft_consensus.cc:2749] T 427c124d773f483294511e80fe340075 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:19:58.213810 10650 consensus_queue.cc:1048] T 1528ab62b6fe4e3099d08f141afee116 P 7ba59cc884714e8aa5f3f0ecaed84cbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:19:58.216261  6723 raft_consensus.cc:1275] T 3fa34c08b205435dba97346991aa1f92 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 11 FOLLOWER]: Refusing update from remote peer cd75a17ab2604397adab03bb8b5fd75c: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:19:58.196570 10618 raft_consensus.cc:493] T 3a485a995abc4807b6e511e45419f737 P cd75a17ab2604397adab03bb8b5fd75c [term 7 FOLLOWER]: Starting pre-election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:19:58.185729 10542 raft_consensus.cc:515] T f03d0dbf16864ca4bc1bb5e4c0334c0f P ccd8a4c3bfe3413cb2ae219b09aea832 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:58.230932  7468 leader_election.cc:304] T 4f00a2e87e56452083b759f60d461ee3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:19:58.235558  6723 raft_consensus.cc:1240] T 07a92dd554674067a83a9cb68c4773f2 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 10 FOLLOWER]: Rejecting Update request from peer cd75a17ab2604397adab03bb8b5fd75c for earlier term 9. Current term is 10. Ops: []
I20260709 13:19:58.220458 10653 raft_consensus.cc:493] T d33d5ee8ef6f415593d8df52063161ad P cd75a17ab2604397adab03bb8b5fd75c [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:19:58.248889  6732 raft_consensus.cc:2468] T 90d42e216d9741e190bca19a781291fd P ccd8a4c3bfe3413cb2ae219b09aea832 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 10.
I20260709 13:19:58.242718  6802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77e330a82df4b43a745d57a68f6f057" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:19:58.255626  6877 raft_consensus.cc:1275] T bb7fa124c3bf4ef9ab65a407cb008441 P cd75a17ab2604397adab03bb8b5fd75c [term 10 FOLLOWER]: Refusing update from remote peer 7ba59cc884714e8aa5f3f0ecaed84cbb: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:19:58.255385  6802 raft_consensus.cc:2468] T e77e330a82df4b43a745d57a68f6f057 P b7ab4784c7344b939bc36f639286f377 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 12.
I20260709 13:19:58.261307  6802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1704639a875409b9959353527b3fd68" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:19:58.257987 10664 raft_consensus.cc:2749] T 4f00a2e87e56452083b759f60d461ee3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:19:58.284161  6877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24ee15416e3145beaa1b8183453729a3" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 11 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:19:58.285153  6877 raft_consensus.cc:2468] T 24ee15416e3145beaa1b8183453729a3 P cd75a17ab2604397adab03bb8b5fd75c [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in term 10.
I20260709 13:19:58.289623  6802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "711ef6523deb4cbe8ef2ba61e1c21c98" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:19:58.241312 10618 raft_consensus.cc:515] T 3a485a995abc4807b6e511e45419f737 P cd75a17ab2604397adab03bb8b5fd75c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:58.271772 10568 leader_election.cc:290] T 24ee15416e3145beaa1b8183453729a3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:58.256446 10653 raft_consensus.cc:515] T d33d5ee8ef6f415593d8df52063161ad P cd75a17ab2604397adab03bb8b5fd75c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:58.264685 10650 consensus_queue.cc:1048] T bb7fa124c3bf4ef9ab65a407cb008441 P 7ba59cc884714e8aa5f3f0ecaed84cbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.027s
I20260709 13:19:58.305903  7468 leader_election.cc:304] T 24ee15416e3145beaa1b8183453729a3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:19:58.306936  6873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab432e62819d499eaaf3dd55481dd930" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
W20260709 13:19:58.298768 10589 consensus_meta.cc:287] T be1a92657f494cac8dd227d152f50151 P 7ba59cc884714e8aa5f3f0ecaed84cbb: Time spent flushing consensus metadata: real 0.514s	user 0.010s	sys 0.003s
I20260709 13:19:58.309995  6873 raft_consensus.cc:2468] T ab432e62819d499eaaf3dd55481dd930 P cd75a17ab2604397adab03bb8b5fd75c [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 10.
W20260709 13:19:58.311326  6873 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53406 (request call id 1944) took 1453 ms (client timeout 1551 ms). Trace:
W20260709 13:19:58.311887  6873 rpcz_store.cc:269] 0709 13:19:56.857867 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:56.891009 (+ 33142us) service_pool.cc:224] Handling call
0709 13:19:58.306763 (+1415754us) spinlock_profiling.cc:243] Waited 3.12 ms on lock 0x7b5800147c98. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0c745db1 00007fcc0c885b71 00007fcc0c885a22 00007fcc1579ec09 00007fcc148f8ee0 00007fcc149c20ab 00007fcc149c2131 00007fcc149700a0 00007fcc1496f984 00007fcc0deea6d4 00007fcc0deea662
0709 13:19:58.311247 (+  4484us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":7167232}
I20260709 13:19:58.310546  6802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c240553ce044eedb41541d72b9475d7" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:19:58.309671 10568 raft_consensus.cc:2804] T 24ee15416e3145beaa1b8183453729a3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:19:58.289441  9890 raft_consensus.cc:515] T de3186201e1a40d0b335eeb8b4e256e0 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:58.324388 10568 raft_consensus.cc:493] T 24ee15416e3145beaa1b8183453729a3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:58.325011 10568 raft_consensus.cc:3060] T 24ee15416e3145beaa1b8183453729a3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:58.326500  9890 leader_election.cc:290] T de3186201e1a40d0b335eeb8b4e256e0 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 11 election: Requested vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:58.327929 10542 leader_election.cc:290] T f03d0dbf16864ca4bc1bb5e4c0334c0f P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 9 election: Requested vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:58.328516 10653 leader_election.cc:290] T d33d5ee8ef6f415593d8df52063161ad P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:19:58.307231 10649 raft_consensus.cc:515] T 7c37d41cd9164c15a6826ca62a851a69 P cd75a17ab2604397adab03bb8b5fd75c [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:58.335640 10649 leader_election.cc:290] T 7c37d41cd9164c15a6826ca62a851a69 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 9 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:19:58.338049  6802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8cee0accdb8499c86d4414b72565a38" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:19:58.340090  6798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3411566abe2d4c9bb4b2adfdd05e6f17" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:19:58.340420  6807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7887766dc6784fcaa42b35c05fea7a99" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:19:58.340637  6802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce4f062dcd314d43a63ca74067cb5ee3" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 11 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:19:58.338495 10618 leader_election.cc:290] T 3a485a995abc4807b6e511e45419f737 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:19:58.340978 10445 raft_consensus.cc:515] T b3f13b31a1f84f0d89d007eadd57924c P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:19:58.339530  6800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09c2a98de1a4decabd0ff900dd44caa" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 13 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:19:58.342021  6801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de3186201e1a40d0b335eeb8b4e256e0" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:19:58.341969  6802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c44c4849aa54f2b94d1f1bef9ed546f" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 13 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:19:58.342839  6800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a485a995abc4807b6e511e45419f737" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:19:58.343653  6800 raft_consensus.cc:2368] T 3a485a995abc4807b6e511e45419f737 P b7ab4784c7344b939bc36f639286f377 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c for earlier term 8. Current term is 9.
I20260709 13:19:58.298465 10585 raft_consensus.cc:515] T 17587d6730594da4a56fa13a353232a1 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
W20260709 13:19:58.346303  6698 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:58.346756  6698 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:58.347126  6698 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:58.343698  6844 leader_election.cc:304] T f58dc08b12a2494bb9a1372837970ca2 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:19:58.348907  6725 raft_consensus.cc:1240] T 711ef6523deb4cbe8ef2ba61e1c21c98 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 11 FOLLOWER]: Rejecting Update request from peer b7ab4784c7344b939bc36f639286f377 for earlier term 10. Current term is 11. Ops: []
I20260709 13:19:58.349655  6807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d33d5ee8ef6f415593d8df52063161ad" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:19:58.340128  6724 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.BulkChangeConfig from 127.0.0.1:49742 (request call id 11) took 1222 ms. Trace:
I20260709 13:19:58.350504  6724 rpcz_store.cc:276] 0709 13:19:57.118118 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:57.143708 (+ 25590us) service_pool.cc:224] Handling call
0709 13:19:58.339843 (+1196135us) spinlock_profiling.cc:243] Waited 7.36 ms on lock 0x7b54003d5c54. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f9b0735 00007fcc14970d29 00007fcc0deef1d4 00007fcc0deef162 00007fcc0deef091 00007fcc0deef00c 00007fcc0deee2c2 00007fcc0dce548c 00007fcc0dce48c6 00007fcc0dce426f
0709 13:19:58.339992 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":16935168}
I20260709 13:19:58.351147 10649 raft_consensus.cc:2749] T f58dc08b12a2494bb9a1372837970ca2 P cd75a17ab2604397adab03bb8b5fd75c [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:19:58.354952  6798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c37d41cd9164c15a6826ca62a851a69" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:19:58.356963  6723 raft_consensus.cc:1240] T 4275cf08e63345f993bce8664eada830 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 11 FOLLOWER]: Rejecting Update request from peer b7ab4784c7344b939bc36f639286f377 for earlier term 10. Current term is 11. Ops: []
I20260709 13:19:58.358358  6725 raft_consensus.cc:1275] T a3022224cc81473690653a83d4e99470 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 11 FOLLOWER]: Refusing update from remote peer b7ab4784c7344b939bc36f639286f377: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 6. (term mismatch)
I20260709 13:19:58.358677  6725 pending_rounds.cc:85] T a3022224cc81473690653a83d4e99470 P ccd8a4c3bfe3413cb2ae219b09aea832: Aborting all ops after (but not including) 5
I20260709 13:19:58.358832  6725 pending_rounds.cc:107] T a3022224cc81473690653a83d4e99470 P ccd8a4c3bfe3413cb2ae219b09aea832: Aborting uncommitted NO_OP operation due to leader change: 10.6
I20260709 13:19:58.358976  6725 raft_consensus.cc:2889] T a3022224cc81473690653a83d4e99470 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:19:58.315155 10589 raft_consensus.cc:515] T be1a92657f494cac8dd227d152f50151 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:19:58.360605  6723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e326172347f45e99a0d482b5d8ef768" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:19:58.361361  6723 raft_consensus.cc:2468] T 9e326172347f45e99a0d482b5d8ef768 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 9.
I20260709 13:19:58.362332  6723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbdf895bba214ff68685a24fd17dfb5d" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 10 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:19:58.362778 10589 leader_election.cc:290] T be1a92657f494cac8dd227d152f50151 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 13 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:19:58.362929  6723 raft_consensus.cc:2468] T dbdf895bba214ff68685a24fd17dfb5d P ccd8a4c3bfe3413cb2ae219b09aea832 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 9.
I20260709 13:19:58.363987  6723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c240553ce044eedb41541d72b9475d7" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:19:58.364548  6723 raft_consensus.cc:2468] T 2c240553ce044eedb41541d72b9475d7 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 11.
I20260709 13:19:58.364956 10585 leader_election.cc:290] T 17587d6730594da4a56fa13a353232a1 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 14 election: Requested vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:19:58.366026  6798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be1a92657f494cac8dd227d152f50151" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:19:58.369290  6844 leader_election.cc:304] T ab432e62819d499eaaf3dd55481dd930 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:19:58.370296 10618 raft_consensus.cc:2804] T ab432e62819d499eaaf3dd55481dd930 P cd75a17ab2604397adab03bb8b5fd75c [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:19:58.370675 10618 raft_consensus.cc:493] T ab432e62819d499eaaf3dd55481dd930 P cd75a17ab2604397adab03bb8b5fd75c [term 10 FOLLOWER]: Starting leader election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:19:58.371090 10618 raft_consensus.cc:3060] T ab432e62819d499eaaf3dd55481dd930 P cd75a17ab2604397adab03bb8b5fd75c [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:58.370684  6844 leader_election.cc:304] T c4db81d9d329422bb3b4160ca4ac2d1d P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:19:58.376129  6724 raft_consensus.cc:1275] T 90d42e216d9741e190bca19a781291fd P ccd8a4c3bfe3413cb2ae219b09aea832 [term 10 FOLLOWER]: Refusing update from remote peer b7ab4784c7344b939bc36f639286f377: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:19:58.378130  6723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77e330a82df4b43a745d57a68f6f057" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:19:58.381917  6732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "404190ce4ce94cecbfcb6ea9d1dd8626" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:19:58.382694  6732 raft_consensus.cc:2468] T 404190ce4ce94cecbfcb6ea9d1dd8626 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 11.
I20260709 13:19:58.382772  6725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30e88460611e47b2ba16a46a30b5f416" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:19:58.382189  6770 leader_election.cc:304] T ab432e62819d499eaaf3dd55481dd930 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
I20260709 13:19:58.387055 10649 raft_consensus.cc:2749] T c4db81d9d329422bb3b4160ca4ac2d1d P cd75a17ab2604397adab03bb8b5fd75c [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:19:58.387410  6732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "853ac0a8cbd64ce99457f170216d4d0f" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:19:58.388103 10418 raft_consensus.cc:2804] T ab432e62819d499eaaf3dd55481dd930 P b7ab4784c7344b939bc36f639286f377 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:19:58.388212  6732 raft_consensus.cc:2468] T 853ac0a8cbd64ce99457f170216d4d0f P ccd8a4c3bfe3413cb2ae219b09aea832 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 7.
I20260709 13:19:58.388618 10418 raft_consensus.cc:493] T ab432e62819d499eaaf3dd55481dd930 P b7ab4784c7344b939bc36f639286f377 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:58.389092 10418 raft_consensus.cc:3060] T ab432e62819d499eaaf3dd55481dd930 P b7ab4784c7344b939bc36f639286f377 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:58.391548  9836 leader_election.cc:290] T 20f6842e26174571996b8dea4151d4be P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:58.392606 10589 raft_consensus.cc:493] T 17587d6730594da4a56fa13a353232a1 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:19:58.396957  6844 leader_election.cc:400] T 9b3759de40694069b13c0f8bd40e5709 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 9 election: Vote denied by peer b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817) with higher term. Message: Invalid argument: T 9b3759de40694069b13c0f8bd40e5709 P b7ab4784c7344b939bc36f639286f377 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c for earlier term 9. Current term is 10.
I20260709 13:19:58.397569  6844 leader_election.cc:403] T 9b3759de40694069b13c0f8bd40e5709 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 9 election: Cancelling election due to peer responding with higher term
I20260709 13:19:58.398548  9836 consensus_queue.cc:1059] T 1bf4668eeb70467fb3dc5a0289233b3c P b7ab4784c7344b939bc36f639286f377 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:19:58.399638  9836 raft_consensus.cc:3055] T 1bf4668eeb70467fb3dc5a0289233b3c P b7ab4784c7344b939bc36f639286f377 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:19:58.399981  9836 raft_consensus.cc:740] T 1bf4668eeb70467fb3dc5a0289233b3c P b7ab4784c7344b939bc36f639286f377 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
I20260709 13:19:58.400848  9836 consensus_queue.cc:260] T 1bf4668eeb70467fb3dc5a0289233b3c P b7ab4784c7344b939bc36f639286f377 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:58.402029  9836 raft_consensus.cc:3060] T 1bf4668eeb70467fb3dc5a0289233b3c P b7ab4784c7344b939bc36f639286f377 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:58.406739  6846 leader_election.cc:304] T 24ee15416e3145beaa1b8183453729a3 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:19:58.409536  6798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4275cf08e63345f993bce8664eada830" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:19:58.410295  6876 raft_consensus.cc:1275] T 7c44c4849aa54f2b94d1f1bef9ed546f P cd75a17ab2604397adab03bb8b5fd75c [term 12 FOLLOWER]: Refusing update from remote peer b7ab4784c7344b939bc36f639286f377: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:19:58.410792  6807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e326172347f45e99a0d482b5d8ef768" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:19:58.411405  6807 raft_consensus.cc:2468] T 9e326172347f45e99a0d482b5d8ef768 P b7ab4784c7344b939bc36f639286f377 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 9.
I20260709 13:19:58.410831  6876 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53406 (request call id 1938) took 1554 ms. Trace:
I20260709 13:19:58.413619  6800 raft_consensus.cc:1240] T 90d42e216d9741e190bca19a781291fd P b7ab4784c7344b939bc36f639286f377 [term 10 LEADER]: Rejecting Update request from peer ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 9. Current term is 10. Ops: []
I20260709 13:19:58.413175  6876 rpcz_store.cc:276] 0709 13:19:56.856189 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:56.856456 (+   267us) service_pool.cc:224] Handling call
0709 13:19:58.408936 (+1552480us) spinlock_profiling.cc:243] Waited 2.31 ms on lock 0x7b5800147c98. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0c745db1 00007fcc0c885b71 00007fcc0c885a22 00007fcc1579ec09 00007fcc148f8ee0 00007fcc149c20ab 00007fcc149c2131 00007fcc14983fc0 00007fcc1496e929 00007fcc1496e3d2 00007fcc0dee5bd4
0709 13:19:58.409111 (+   175us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:58.410608 (+  1497us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:58.410779 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5318400}
I20260709 13:19:58.415874  6807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1704639a875409b9959353527b3fd68" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:19:58.420672  6726 raft_consensus.cc:2410] T 713b5728a197487c9300b310ab94e5a3 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c for term 11 because replica has last-logged OpId of term: 10 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 5.
I20260709 13:19:58.409636 10649 raft_consensus.cc:2804] T 24ee15416e3145beaa1b8183453729a3 P cd75a17ab2604397adab03bb8b5fd75c [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:19:58.427959  6798 raft_consensus.cc:1240] T 713b5728a197487c9300b310ab94e5a3 P b7ab4784c7344b939bc36f639286f377 [term 11 FOLLOWER]: Rejecting Update request from peer ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 10. Current term is 11. Ops: [10.6-10.6]
I20260709 13:19:58.432446  6844 leader_election.cc:304] T 3d65025eea89441290d85dd053810e31 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:19:58.412739 10653 raft_consensus.cc:2749] T 9b3759de40694069b13c0f8bd40e5709 P cd75a17ab2604397adab03bb8b5fd75c [term 10 FOLLOWER]: Leader election lost for term 9. Reason: Vote denied by peer b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817) with higher term. Message: Invalid argument: T 9b3759de40694069b13c0f8bd40e5709 P b7ab4784c7344b939bc36f639286f377 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c for earlier term 9. Current term is 10.
I20260709 13:19:58.406101 10589 raft_consensus.cc:515] T 17587d6730594da4a56fa13a353232a1 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
W20260709 13:19:58.450971  6727 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49744 (request call id 339) took 1452 ms (client timeout 1797 ms). Trace:
I20260709 13:19:58.430850 10649 raft_consensus.cc:493] T 24ee15416e3145beaa1b8183453729a3 P cd75a17ab2604397adab03bb8b5fd75c [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:19:58.452530  6727 rpcz_store.cc:269] 0709 13:19:56.999167 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:57.001486 (+  2319us) service_pool.cc:224] Handling call
0709 13:19:58.450728 (+1449242us) spinlock_profiling.cc:243] Waited 29.3 ms on lock 0x7b54000e4a54. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f9ae2fa 00007fcc1496fb17 00007fcc0deea6d4 00007fcc0deea662 00007fcc0deea591 00007fcc0deea50c 00007fcc0dee97c2 00007fcc0dce548c 00007fcc0dce48c6 00007fcc0dce426f
0709 13:19:58.450896 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":67501312}
I20260709 13:19:58.423597 10063 consensus_queue.cc:1048] T f3f9c2e2bf644115957398fe4c9459db P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.031s
I20260709 13:19:58.453047 10436 raft_consensus.cc:2749] T 3d65025eea89441290d85dd053810e31 P cd75a17ab2604397adab03bb8b5fd75c [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:19:58.464367  6844 leader_election.cc:304] T dbdf895bba214ff68685a24fd17dfb5d P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:19:58.467571  6844 leader_election.cc:304] T 20f6842e26174571996b8dea4151d4be P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:19:58.442737 10568 raft_consensus.cc:515] T 24ee15416e3145beaa1b8183453729a3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 11 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:19:58.469600  6844 leader_election.cc:304] T bb7fa124c3bf4ef9ab65a407cb008441 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, b7ab4784c7344b939bc36f639286f377
I20260709 13:19:58.453083 10649 raft_consensus.cc:3060] T 24ee15416e3145beaa1b8183453729a3 P cd75a17ab2604397adab03bb8b5fd75c [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:58.435822 10534 consensus_queue.cc:1048] T 7c44c4849aa54f2b94d1f1bef9ed546f P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.029s
I20260709 13:19:58.445894 10650 raft_consensus.cc:493] T 7ba5dac66ab5497e9e336f2a3c28cda5 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:19:58.441565 10447 consensus_queue.cc:1048] T be1a92657f494cac8dd227d152f50151 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.020s
I20260709 13:19:58.476202 10626 raft_consensus.cc:2804] T 20f6842e26174571996b8dea4151d4be P cd75a17ab2604397adab03bb8b5fd75c [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:19:58.485289 10589 leader_election.cc:290] T 17587d6730594da4a56fa13a353232a1 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:19:58.487584 10618 raft_consensus.cc:515] T ab432e62819d499eaaf3dd55481dd930 P cd75a17ab2604397adab03bb8b5fd75c [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:58.469471 10619 raft_consensus.cc:2804] T dbdf895bba214ff68685a24fd17dfb5d P cd75a17ab2604397adab03bb8b5fd75c [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:19:58.491325 10445 leader_election.cc:290] T b3f13b31a1f84f0d89d007eadd57924c P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 9 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:19:58.490288 10387 raft_consensus.cc:515] T 4275cf08e63345f993bce8664eada830 P cd75a17ab2604397adab03bb8b5fd75c [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:58.522014 10650 raft_consensus.cc:515] T 7ba5dac66ab5497e9e336f2a3c28cda5 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:19:59.196424  6875 raft_consensus.cc:2393] T 4275cf08e63345f993bce8664eada830 P cd75a17ab2604397adab03bb8b5fd75c [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate ccd8a4c3bfe3413cb2ae219b09aea832 in current term 11: Already voted for candidate cd75a17ab2604397adab03bb8b5fd75c in this term.
I20260709 13:19:59.199203  6875 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53416 (request call id 2717) took 1156 ms. Trace:
I20260709 13:19:58.505837 10621 raft_consensus.cc:2749] T bb7fa124c3bf4ef9ab65a407cb008441 P cd75a17ab2604397adab03bb8b5fd75c [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:19:58.516764 10626 raft_consensus.cc:493] T 20f6842e26174571996b8dea4151d4be P cd75a17ab2604397adab03bb8b5fd75c [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:59.213439 10626 raft_consensus.cc:3060] T 20f6842e26174571996b8dea4151d4be P cd75a17ab2604397adab03bb8b5fd75c [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:58.834995  6799 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50550 (request call id 356) took 1548 ms. Trace:
I20260709 13:19:59.216544  6799 rpcz_store.cc:276] 0709 13:19:57.286648 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:57.286870 (+   222us) service_pool.cc:224] Handling call
0709 13:19:57.333628 (+ 46758us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:57.697037 (+363409us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:57.697071 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:57.759463 (+ 62392us) log.cc:844] Serialized 26 byte log entry
0709 13:19:57.881835 (+122372us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:19:57.881892 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:58.834531 (+952639us) spinlock_profiling.cc:243] Waited 363 ms on lock 0x7b54002da354. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f9aae01 00007fcc0f9a983e 00007fcc1496e419 00007fcc0dee5bd4 00007fcc0dee5b62 00007fcc0dee5a91 00007fcc0dee5a0c 00007fcc0dee4cc2 00007fcc0dce548c 00007fcc0dce48c6
0709 13:19:58.834600 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:58.834647 (+    47us) raft_consensus.cc:1685] finished
0709 13:19:58.834658 (+    11us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:58.834931 (+   273us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":131,"raft.run_cpu_time_us":173,"raft.run_wall_time_us":7201,"spinlock_wait_cycles":834646400,"thread_start_us":80633,"threads_started":1,"wal-append.queue_time_us":214819}
I20260709 13:19:59.219146  6799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17587d6730594da4a56fa13a353232a1" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:19:58.864231 10604 raft_consensus.cc:3055] T f5be3a11b23d4ea9b08300a2789821c7 P b7ab4784c7344b939bc36f639286f377 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:19:59.220244 10604 raft_consensus.cc:740] T f5be3a11b23d4ea9b08300a2789821c7 P b7ab4784c7344b939bc36f639286f377 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
I20260709 13:19:59.221378 10604 consensus_queue.cc:260] T f5be3a11b23d4ea9b08300a2789821c7 P b7ab4784c7344b939bc36f639286f377 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:59.222771 10604 raft_consensus.cc:3060] T f5be3a11b23d4ea9b08300a2789821c7 P b7ab4784c7344b939bc36f639286f377 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:19:58.870558  6698 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:59.224478  6698 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:59.224838  6698 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:58.922717 10445 raft_consensus.cc:493] T 4b8cacb381b746da8d0049b0a83b41dd P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 9 FOLLOWER]: Starting pre-election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:19:59.227036 10445 raft_consensus.cc:515] T 4b8cacb381b746da8d0049b0a83b41dd P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:19:59.228217 10537 raft_consensus.cc:493] T 22ccee1b570c4ad3a57bd7aec085b1b4 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:19:59.228843 10537 raft_consensus.cc:515] T 22ccee1b570c4ad3a57bd7aec085b1b4 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:59.231427 10537 leader_election.cc:290] T 22ccee1b570c4ad3a57bd7aec085b1b4 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:58.935698  7495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8cee0accdb8499c86d4414b72565a38" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:19:58.951124 10313 leader_election.cc:290] T 713b5728a197487c9300b310ab94e5a3 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 11 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:58.470909 10575 consensus_queue.cc:1059] T 07a92dd554674067a83a9cb68c4773f2 P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.051s
W20260709 13:19:58.953758  6773 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:58.528926 10619 raft_consensus.cc:493] T dbdf895bba214ff68685a24fd17dfb5d P cd75a17ab2604397adab03bb8b5fd75c [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:58.956920 10618 leader_election.cc:290] T ab432e62819d499eaaf3dd55481dd930 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 11 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:19:58.469285 10627 consensus_queue.cc:1059] T bd6869f07b5a4885a0b99fbe60c3b175 P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.064s
W20260709 13:19:58.970661  6804 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:32976 (request call id 2618) took 1846 ms (client timeout 1926 ms). Trace:
W20260709 13:19:58.972132 10418 consensus_meta.cc:287] T ab432e62819d499eaaf3dd55481dd930 P b7ab4784c7344b939bc36f639286f377: Time spent flushing consensus metadata: real 0.583s	user 0.011s	sys 0.007s
W20260709 13:19:59.027297  6881 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58592 (request call id 265) took 2229 ms (client timeout 1772 ms). Trace:
I20260709 13:19:59.030230 10568 leader_election.cc:290] T 24ee15416e3145beaa1b8183453729a3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 11 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:59.042672  6872 raft_consensus.cc:1240] T 4b8cacb381b746da8d0049b0a83b41dd P cd75a17ab2604397adab03bb8b5fd75c [term 10 FOLLOWER]: Rejecting Update request from peer ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 9. Current term is 10. Ops: []
W20260709 13:19:59.048923  6697 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:59.055351  7496 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50756 (request call id 250) took 1079 ms. Trace:
W20260709 13:19:59.062964 10249 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.584s	user 0.009s	sys 0.010s
W20260709 13:19:59.072016 10649 consensus_meta.cc:287] T 24ee15416e3145beaa1b8183453729a3 P cd75a17ab2604397adab03bb8b5fd75c: Time spent flushing consensus metadata: real 0.557s	user 0.009s	sys 0.000s
I20260709 13:19:59.085599  6798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b56bf91d90824c959e21e0cee5ba1816" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:19:59.089756  6803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f9c2e2bf644115957398fe4c9459db" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:19:59.090957  6807 raft_consensus.cc:1275] T e77e330a82df4b43a745d57a68f6f057 P b7ab4784c7344b939bc36f639286f377 [term 12 FOLLOWER]: Refusing update from remote peer ccd8a4c3bfe3413cb2ae219b09aea832: Log matching property violated. Preceding OpId in replica: term: 11 index: 5. Preceding OpId from leader: term: 12 index: 6. (index mismatch)
I20260709 13:19:59.091571  6802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a75bfe094d4bdc963aba3f08dfcd25" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 11 candidate_status { last_received { term: 10 index: 4 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:19:59.092264  6801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "711ef6523deb4cbe8ef2ba61e1c21c98" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:19:59.098569  6800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "404190ce4ce94cecbfcb6ea9d1dd8626" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:19:59.100126  6805 raft_consensus.cc:1275] T 20f6842e26174571996b8dea4151d4be P b7ab4784c7344b939bc36f639286f377 [term 11 FOLLOWER]: Refusing update from remote peer ccd8a4c3bfe3413cb2ae219b09aea832: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:19:59.100649 10591 raft_consensus.cc:493] T c4db81d9d329422bb3b4160ca4ac2d1d P ccd8a4c3bfe3413cb2ae219b09aea832 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:19:59.068573 10557 raft_consensus.cc:3060] T d8292e16e5654be6bc408560cf256aaa P b7ab4784c7344b939bc36f639286f377 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:19:59.095773  6678 auto_rebalancer.cc:629] Failed to schedule move for tablet 4275cf08e63345f993bce8664eada830: Illegal state: Replica ccd8a4c3bfe3413cb2ae219b09aea832 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 11 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } }
W20260709 13:19:59.079880  6695 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:59.103585  6726 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49998 (request call id 945) took 1237 ms. Trace:
I20260709 13:19:59.115391  6874 raft_consensus.cc:1240] T 7c37d41cd9164c15a6826ca62a851a69 P cd75a17ab2604397adab03bb8b5fd75c [term 9 FOLLOWER]: Rejecting Update request from peer b7ab4784c7344b939bc36f639286f377 for earlier term 8. Current term is 9. Ops: [8.6-8.6]
I20260709 13:19:59.116051  6879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6869f07b5a4885a0b99fbe60c3b175" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 11 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:19:59.117906  6877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a485a995abc4807b6e511e45419f737" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:19:59.119846  6880 raft_consensus.cc:1240] T d8292e16e5654be6bc408560cf256aaa P cd75a17ab2604397adab03bb8b5fd75c [term 13 FOLLOWER]: Rejecting Update request from peer b7ab4784c7344b939bc36f639286f377 for earlier term 12. Current term is 13. Ops: []
I20260709 13:19:59.123755 10421 leader_election.cc:290] T 9e326172347f45e99a0d482b5d8ef768 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:59.151129  7500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "404190ce4ce94cecbfcb6ea9d1dd8626" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:19:59.157972  6772 leader_election.cc:304] T 1528ab62b6fe4e3099d08f141afee116 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:19:59.158466 10524 raft_consensus.cc:493] T bb7fa124c3bf4ef9ab65a407cb008441 P b7ab4784c7344b939bc36f639286f377 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:59.159813 10525 raft_consensus.cc:493] T 4d9def8b32fd443aa94ab1420b06837b P b7ab4784c7344b939bc36f639286f377 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:59.164381  6876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e326172347f45e99a0d482b5d8ef768" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:19:59.170912  6878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbdf895bba214ff68685a24fd17dfb5d" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 10 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:19:59.180275 10613 consensus_queue.cc:1048] T 3411566abe2d4c9bb4b2adfdd05e6f17 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:19:59.182898  6770 leader_election.cc:304] T 8c7f33e544204fbaac4078e3e83bbf4e P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
W20260709 13:19:58.543251 10675 log.cc:927] Time spent T bb7fa124c3bf4ef9ab65a407cb008441 P cd75a17ab2604397adab03bb8b5fd75c: Append to log took a long time: real 0.066s	user 0.000s	sys 0.001s
I20260709 13:19:59.199414 10650 leader_election.cc:290] T 7ba5dac66ab5497e9e336f2a3c28cda5 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:59.205771  6629 catalog_manager.cc:5697] T bb3d8792045a4583ae2e965b1350a5b4 P 7ba59cc884714e8aa5f3f0ecaed84cbb reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "cd75a17ab2604397adab03bb8b5fd75c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } } }
W20260709 13:19:59.232985  7495 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50756 (request call id 255) took 1165 ms (client timeout 1548 ms). Trace:
W20260709 13:19:59.234543  6773 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:59.232372 10571 raft_consensus.cc:493] T a3022224cc81473690653a83d4e99470 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:59.236181  6881 rpcz_store.cc:269] 0709 13:19:56.797471 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:56.800120 (+  2649us) service_pool.cc:224] Handling call
0709 13:19:59.026966 (+2226846us) spinlock_profiling.cc:243] Waited 212 ms on lock 0x7b54000a69d4. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f9ae2fa 00007fcc1496fb17 00007fcc0deea6d4 00007fcc0deea662 00007fcc0deea591 00007fcc0deea50c 00007fcc0dee97c2 00007fcc0dce548c 00007fcc0dce48c6 00007fcc0dce426f
0709 13:19:59.027159 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":487291648}
I20260709 13:19:59.264318 10571 raft_consensus.cc:515] T a3022224cc81473690653a83d4e99470 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
W20260709 13:19:59.264883  6773 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:59.265120  6881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "853ac0a8cbd64ce99457f170216d4d0f" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:19:59.266187 10621 raft_consensus.cc:493] T 4f00a2e87e56452083b759f60d461ee3 P cd75a17ab2604397adab03bb8b5fd75c [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:59.266806 10571 leader_election.cc:290] T a3022224cc81473690653a83d4e99470 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:59.267531 10650 consensus_queue.cc:1048] T bb7fa124c3bf4ef9ab65a407cb008441 P 7ba59cc884714e8aa5f3f0ecaed84cbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:19:59.238138 10547 raft_consensus.cc:493] T 07a92dd554674067a83a9cb68c4773f2 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:59.268736 10547 raft_consensus.cc:515] T 07a92dd554674067a83a9cb68c4773f2 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:59.269833 10613 raft_consensus.cc:493] T 4f00a2e87e56452083b759f60d461ee3 P b7ab4784c7344b939bc36f639286f377 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:59.270394 10613 raft_consensus.cc:515] T 4f00a2e87e56452083b759f60d461ee3 P b7ab4784c7344b939bc36f639286f377 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:19:59.271384 10547 leader_election.cc:290] T 07a92dd554674067a83a9cb68c4773f2 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
W20260709 13:19:59.238356 10249 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.771s	user 0.010s	sys 0.010s
W20260709 13:19:59.262527  7495 rpcz_store.cc:269] 0709 13:19:58.067526 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:58.067742 (+   216us) service_pool.cc:224] Handling call
0709 13:19:58.935503 (+867761us) spinlock_profiling.cc:243] Waited 1.62 ms on lock 0x7b5800123f98. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0c745db1 00007fcc0c885b71 00007fcc0c885a22 00007fcc1579ec09 00007fcc148f8ee0 00007fcc149c20ab 00007fcc149c2131 00007fcc149700a0 00007fcc1496f984 00007fcc0deea6d4 00007fcc0deea662
0709 13:19:59.232907 (+297404us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3722624}
I20260709 13:19:59.239899  6798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f03d0dbf16864ca4bc1bb5e4c0334c0f" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:19:59.266471  6881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c240553ce044eedb41541d72b9475d7" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:19:59.240798  6803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de3186201e1a40d0b335eeb8b4e256e0" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:19:59.243700  6800 raft_consensus.cc:2410] T 404190ce4ce94cecbfcb6ea9d1dd8626 P b7ab4784c7344b939bc36f639286f377 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ccd8a4c3bfe3413cb2ae219b09aea832 for term 12 because replica has last-logged OpId of term: 11 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 8.
W20260709 13:19:59.258912  6772 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.68:45071, user_credentials={real_user=slave}} blocked reactor thread for 101065us
I20260709 13:19:59.274235  6881 raft_consensus.cc:2468] T 2c240553ce044eedb41541d72b9475d7 P cd75a17ab2604397adab03bb8b5fd75c [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 11.
I20260709 13:19:59.258414  6876 raft_consensus.cc:2468] T 9e326172347f45e99a0d482b5d8ef768 P cd75a17ab2604397adab03bb8b5fd75c [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 8.
I20260709 13:19:59.317644  6805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17587d6730594da4a56fa13a353232a1" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:19:59.237777  6697 leader_election.cc:304] T f5be3a11b23d4ea9b08300a2789821c7 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377
W20260709 13:19:59.255292  6696 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:59.321602  6697 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 83961.4us
I20260709 13:19:59.253090  6726 rpcz_store.cc:276] 0709 13:19:57.865770 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:58.162111 (+296341us) service_pool.cc:224] Handling call
0709 13:19:59.103332 (+941221us) spinlock_profiling.cc:243] Waited 241 ms on lock 0x7b5400166f54. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f9ae2fa 00007fcc1496fb17 00007fcc0deea6d4 00007fcc0deea662 00007fcc0deea591 00007fcc0deea50c 00007fcc0dee97c2 00007fcc0dce548c 00007fcc0dce48c6 00007fcc0dce426f
0709 13:19:59.103508 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":553207040}
I20260709 13:19:59.322310  6697 leader_election.cc:304] T 44bde925b2e541b69890d70715b85176 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:19:59.255940  6877 raft_consensus.cc:3060] T 3a485a995abc4807b6e511e45419f737 P cd75a17ab2604397adab03bb8b5fd75c [term 7 FOLLOWER]: Advancing to term 9
W20260709 13:19:59.259382  6770 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 76600.2us
I20260709 13:19:59.254328  6874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30e88460611e47b2ba16a46a30b5f416" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
W20260709 13:19:59.235805  6804 rpcz_store.cc:269] 0709 13:19:57.124670 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:57.125534 (+   864us) service_pool.cc:224] Handling call
0709 13:19:58.970368 (+1844834us) spinlock_profiling.cc:243] Waited 451 ms on lock 0x7b54001f7554. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f9ae2fa 00007fcc1496fb17 00007fcc0deea6d4 00007fcc0deea662 00007fcc0deea591 00007fcc0deea50c 00007fcc0dee97c2 00007fcc0dce548c 00007fcc0dce48c6 00007fcc0dce426f
0709 13:19:58.970554 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1037531904}
I20260709 13:19:59.255206  6879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "713b5728a197487c9300b310ab94e5a3" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:19:59.260722  6875 rpcz_store.cc:276] 0709 13:19:58.042757 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:58.066149 (+ 23392us) service_pool.cc:224] Handling call
0709 13:19:59.198953 (+1132804us) spinlock_profiling.cc:243] Waited 1.13 s on lock 0x7b54000b3bd4. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f9ae2fa 00007fcc1496fb17 00007fcc0deea6d4 00007fcc0deea662 00007fcc0deea591 00007fcc0deea50c 00007fcc0dee97c2 00007fcc0dce548c 00007fcc0dce48c6 00007fcc0dce426f
0709 13:19:59.199127 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2590203136}
I20260709 13:19:59.237989  7496 rpcz_store.cc:276] 0709 13:19:57.975599 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:57.976358 (+   759us) service_pool.cc:224] Handling call
0709 13:19:57.988602 (+ 12244us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:57.988817 (+   215us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:57.988843 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:57.988893 (+    50us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:19:57.988938 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:57.988999 (+    61us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:59.055055 (+1066056us) spinlock_profiling.cc:243] Waited 11.8 ms on lock 0x7b54001ec8d0. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f9a98ad 00007fcc1496e419 00007fcc0dee5bd4 00007fcc0dee5b62 00007fcc0dee5a91 00007fcc0dee5a0c 00007fcc0dee4cc2 00007fcc0dce548c 00007fcc0dce48c6 00007fcc0dce426f
0709 13:19:59.055251 (+   196us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":27120384}
I20260709 13:19:59.340518  6697 leader_election.cc:304] T 1bf4668eeb70467fb3dc5a0289233b3c P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377
I20260709 13:19:59.256863  6880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77e330a82df4b43a745d57a68f6f057" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:19:59.346338  6876 raft_consensus.cc:1240] T 4275cf08e63345f993bce8664eada830 P cd75a17ab2604397adab03bb8b5fd75c [term 11 FOLLOWER]: Rejecting Update request from peer b7ab4784c7344b939bc36f639286f377 for earlier term 10. Current term is 11. Ops: []
I20260709 13:19:59.347815  6875 raft_consensus.cc:1275] T b56bf91d90824c959e21e0cee5ba1816 P cd75a17ab2604397adab03bb8b5fd75c [term 9 FOLLOWER]: Refusing update from remote peer b7ab4784c7344b939bc36f639286f377: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:19:59.373826  6879 raft_consensus.cc:1275] T a3022224cc81473690653a83d4e99470 P cd75a17ab2604397adab03bb8b5fd75c [term 11 FOLLOWER]: Refusing update from remote peer b7ab4784c7344b939bc36f639286f377: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:19:59.372325  6873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20f6842e26174571996b8dea4151d4be" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 12 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:19:59.375531  6772 leader_election.cc:304] T f4b8bd455d5a47c18a1380839c6e0d61 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:19:59.346952  6880 raft_consensus.cc:2468] T e77e330a82df4b43a745d57a68f6f057 P cd75a17ab2604397adab03bb8b5fd75c [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 12.
I20260709 13:19:59.376425 10063 consensus_queue.cc:1048] T 3411566abe2d4c9bb4b2adfdd05e6f17 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:19:59.377030 10613 leader_election.cc:290] T 4f00a2e87e56452083b759f60d461ee3 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:19:59.260138 10313 raft_consensus.cc:2749] T 1528ab62b6fe4e3099d08f141afee116 P b7ab4784c7344b939bc36f639286f377 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:19:59.378350 10421 raft_consensus.cc:2804] T 1bf4668eeb70467fb3dc5a0289233b3c P ccd8a4c3bfe3413cb2ae219b09aea832 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:19:59.247797 10445 leader_election.cc:290] T 4b8cacb381b746da8d0049b0a83b41dd P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:59.260946 10602 raft_consensus.cc:2804] T 8c7f33e544204fbaac4078e3e83bbf4e P b7ab4784c7344b939bc36f639286f377 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:19:59.380010 10602 raft_consensus.cc:493] T 8c7f33e544204fbaac4078e3e83bbf4e P b7ab4784c7344b939bc36f639286f377 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:59.380155  6801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3f13b31a1f84f0d89d007eadd57924c" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:19:59.380559 10602 raft_consensus.cc:3060] T 8c7f33e544204fbaac4078e3e83bbf4e P b7ab4784c7344b939bc36f639286f377 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:59.380823  6801 raft_consensus.cc:3060] T b3f13b31a1f84f0d89d007eadd57924c P b7ab4784c7344b939bc36f639286f377 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:59.381528  6770 leader_election.cc:304] T bd6869f07b5a4885a0b99fbe60c3b175 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
I20260709 13:19:59.244167 10418 raft_consensus.cc:515] T ab432e62819d499eaaf3dd55481dd930 P b7ab4784c7344b939bc36f639286f377 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:59.378360 10446 consensus_queue.cc:1048] T b56bf91d90824c959e21e0cee5ba1816 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.002s
I20260709 13:19:59.258343 10525 raft_consensus.cc:515] T 4d9def8b32fd443aa94ab1420b06837b P b7ab4784c7344b939bc36f639286f377 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:59.259987 10524 raft_consensus.cc:515] T bb7fa124c3bf4ef9ab65a407cb008441 P b7ab4784c7344b939bc36f639286f377 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:19:59.379573  6880 raft_consensus.cc:1275] T f3f9c2e2bf644115957398fe4c9459db P cd75a17ab2604397adab03bb8b5fd75c [term 9 FOLLOWER]: Refusing update from remote peer b7ab4784c7344b939bc36f639286f377: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 13:19:59.195850 10387 leader_election.cc:290] T 4275cf08e63345f993bce8664eada830 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 11 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:19:59.384660  6872 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53416 (request call id 2703) took 2014 ms. Trace:
I20260709 13:19:59.385978  6879 raft_consensus.cc:1275] T 90d42e216d9741e190bca19a781291fd P cd75a17ab2604397adab03bb8b5fd75c [term 10 FOLLOWER]: Refusing update from remote peer b7ab4784c7344b939bc36f639286f377: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:19:59.347533  6697 leader_election.cc:304] T 2c240553ce044eedb41541d72b9475d7 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:19:59.232229 10367 raft_consensus.cc:493] T 3411566abe2d4c9bb4b2adfdd05e6f17 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:59.233893 10575 consensus_queue.cc:1243] T 07a92dd554674067a83a9cb68c4773f2 P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Peer b7ab4784c7344b939bc36f639286f377 log is divergent from this leader: its last log entry 10.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 13:19:59.394033  6802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ba5dac66ab5497e9e336f2a3c28cda5" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:19:59.235623 10627 raft_consensus.cc:3055] T bd6869f07b5a4885a0b99fbe60c3b175 P cd75a17ab2604397adab03bb8b5fd75c [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:19:59.243635 10580 raft_consensus.cc:493] T e31b9971c15848dea59d4d4130141d9e P ccd8a4c3bfe3413cb2ae219b09aea832 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:19:59.234781 10619 raft_consensus.cc:3060] T dbdf895bba214ff68685a24fd17dfb5d P cd75a17ab2604397adab03bb8b5fd75c [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:59.232028 10537 raft_consensus.cc:493] T d33d5ee8ef6f415593d8df52063161ad P ccd8a4c3bfe3413cb2ae219b09aea832 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:19:59.408533  6728 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49998 (request call id 933) took 1546 ms. Trace:
I20260709 13:19:59.407994  6875 raft_consensus.cc:1275] T f09c2a98de1a4decabd0ff900dd44caa P cd75a17ab2604397adab03bb8b5fd75c [term 12 FOLLOWER]: Refusing update from remote peer b7ab4784c7344b939bc36f639286f377: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
W20260709 13:19:59.413112  6696 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:59.382421  6770 leader_election.cc:304] T 3a485a995abc4807b6e511e45419f737 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
W20260709 13:19:59.452741  6696 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:59.415109  6877 raft_consensus.cc:2468] T 3a485a995abc4807b6e511e45419f737 P cd75a17ab2604397adab03bb8b5fd75c [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 9.
I20260709 13:19:59.417712 10525 leader_election.cc:290] T 4d9def8b32fd443aa94ab1420b06837b P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:59.419477 10524 leader_election.cc:290] T bb7fa124c3bf4ef9ab65a407cb008441 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:19:59.388236  6876 raft_consensus.cc:1240] T 1bf4668eeb70467fb3dc5a0289233b3c P cd75a17ab2604397adab03bb8b5fd75c [term 10 FOLLOWER]: Rejecting Update request from peer b7ab4784c7344b939bc36f639286f377 for earlier term 9. Current term is 10. Ops: []
I20260709 13:19:59.374643 10571 raft_consensus.cc:2749] T 44bde925b2e541b69890d70715b85176 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:19:59.454624 10571 raft_consensus.cc:2804] T 2c240553ce044eedb41541d72b9475d7 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:19:59.455132 10571 raft_consensus.cc:493] T 2c240553ce044eedb41541d72b9475d7 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:59.455528 10571 raft_consensus.cc:3060] T 2c240553ce044eedb41541d72b9475d7 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:59.341970 10547 raft_consensus.cc:2804] T f5be3a11b23d4ea9b08300a2789821c7 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:19:59.456415 10547 raft_consensus.cc:697] T f5be3a11b23d4ea9b08300a2789821c7 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 8 LEADER]: Becoming Leader. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
W20260709 13:19:59.458356  6695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 205841us
I20260709 13:19:59.424962  6801 raft_consensus.cc:2468] T b3f13b31a1f84f0d89d007eadd57924c P b7ab4784c7344b939bc36f639286f377 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in term 9.
I20260709 13:19:59.422392  6872 rpcz_store.cc:276] 0709 13:19:57.370251 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:57.940574 (+570323us) service_pool.cc:224] Handling call
0709 13:19:59.042451 (+1101877us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:59.236688 (+194237us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:59.384478 (+147790us) spinlock_profiling.cc:243] Waited 1.08 s on lock 0x7b54000a69d0. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f9a98ad 00007fcc1496e419 00007fcc0dee5bd4 00007fcc0dee5b62 00007fcc0dee5a91 00007fcc0dee5a0c 00007fcc0dee4cc2 00007fcc0dce548c 00007fcc0dce48c6 00007fcc0dce426f
0709 13:19:59.384609 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2485831552}
I20260709 13:19:58.480398  6844 leader_election.cc:304] T e77e330a82df4b43a745d57a68f6f057 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:19:59.394003 10617 raft_consensus.cc:493] T f5be3a11b23d4ea9b08300a2789821c7 P cd75a17ab2604397adab03bb8b5fd75c [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:59.464076  7466 leader_election.cc:304] T b3f13b31a1f84f0d89d007eadd57924c P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, b7ab4784c7344b939bc36f639286f377; no voters: 
I20260709 13:19:59.464011 10617 raft_consensus.cc:515] T f5be3a11b23d4ea9b08300a2789821c7 P cd75a17ab2604397adab03bb8b5fd75c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:59.465781 10445 raft_consensus.cc:2804] T b3f13b31a1f84f0d89d007eadd57924c P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:19:59.466384 10445 raft_consensus.cc:697] T b3f13b31a1f84f0d89d007eadd57924c P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 9 LEADER]: Becoming Leader. State: Replica: 7ba59cc884714e8aa5f3f0ecaed84cbb, State: Running, Role: LEADER
I20260709 13:19:59.467177 10617 leader_election.cc:290] T f5be3a11b23d4ea9b08300a2789821c7 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
W20260709 13:19:59.453282  6696 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:59.457684 10547 consensus_queue.cc:237] T f5be3a11b23d4ea9b08300a2789821c7 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:59.467319 10445 consensus_queue.cc:237] T b3f13b31a1f84f0d89d007eadd57924c P 7ba59cc884714e8aa5f3f0ecaed84cbb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
W20260709 13:19:59.468446  6696 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:59.404014 10313 raft_consensus.cc:2804] T bd6869f07b5a4885a0b99fbe60c3b175 P b7ab4784c7344b939bc36f639286f377 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:19:59.238623 10649 raft_consensus.cc:515] T 24ee15416e3145beaa1b8183453729a3 P cd75a17ab2604397adab03bb8b5fd75c [term 11 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:19:59.244714 10591 raft_consensus.cc:515] T c4db81d9d329422bb3b4160ca4ac2d1d P ccd8a4c3bfe3413cb2ae219b09aea832 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:59.443451  6629 catalog_manager.cc:5697] T d8cee0accdb8499c86d4414b72565a38 P 7ba59cc884714e8aa5f3f0ecaed84cbb reported cstate change: term changed from 8 to 9, leader changed from 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68) to b7ab4784c7344b939bc36f639286f377 (127.5.126.66). New cstate: current_term: 9 leader_uuid: "b7ab4784c7344b939bc36f639286f377" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } } }
I20260709 13:19:59.444725  6728 rpcz_store.cc:276] 0709 13:19:57.862303 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:57.867118 (+  4815us) service_pool.cc:224] Handling call
0709 13:19:58.451150 (+584032us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:58.453266 (+  2116us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:58.453299 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:58.457997 (+  4698us) log.cc:844] Serialized 26 byte log entry
0709 13:19:59.154688 (+696691us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:19:59.183714 (+ 29026us) log.cc:844] Serialized 14 byte log entry
0709 13:19:59.184141 (+   427us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:59.184248 (+   107us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:59.184291 (+    43us) raft_consensus.cc:1685] finished
0709 13:19:59.184302 (+    11us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:59.408368 (+224066us) spinlock_profiling.cc:243] Waited 584 ms on lock 0x7b54000e4a50. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f9a98ad 00007fcc1496e419 00007fcc0dee5bd4 00007fcc0dee5b62 00007fcc0dee5a91 00007fcc0dee5a0c 00007fcc0dee4cc2 00007fcc0dce548c 00007fcc0dce48c6 00007fcc0dce426f
0709 13:19:59.408479 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":24918,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":39,"raft.queue_time_us":3766,"raft.run_cpu_time_us":234,"raft.run_wall_time_us":616,"spinlock_wait_cycles":1342250752,"thread_start_us":100677,"threads_started":2,"wal-append.queue_time_us":685486}
W20260709 13:19:59.478356  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 997953us
I20260709 13:19:59.266796 10621 raft_consensus.cc:515] T 4f00a2e87e56452083b759f60d461ee3 P cd75a17ab2604397adab03bb8b5fd75c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:19:59.483261  6844 leader_election.cc:304] T d8cee0accdb8499c86d4414b72565a38 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, b7ab4784c7344b939bc36f639286f377
I20260709 13:19:59.433226 10627 raft_consensus.cc:740] T bd6869f07b5a4885a0b99fbe60c3b175 P cd75a17ab2604397adab03bb8b5fd75c [term 10 LEADER]: Becoming Follower/Learner. State: Replica: cd75a17ab2604397adab03bb8b5fd75c, State: Running, Role: LEADER
W20260709 13:19:59.490809  6772 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 75258.6us
I20260709 13:19:59.434547 10063 raft_consensus.cc:2804] T f4b8bd455d5a47c18a1380839c6e0d61 P b7ab4784c7344b939bc36f639286f377 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:19:59.488763  6844 leader_election.cc:304] T ce4f062dcd314d43a63ca74067cb5ee3 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, b7ab4784c7344b939bc36f639286f377
I20260709 13:19:59.427263 10387 raft_consensus.cc:493] T 7ba5dac66ab5497e9e336f2a3c28cda5 P cd75a17ab2604397adab03bb8b5fd75c [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:19:59.440366 10421 raft_consensus.cc:697] T 1bf4668eeb70467fb3dc5a0289233b3c P ccd8a4c3bfe3413cb2ae219b09aea832 [term 10 LEADER]: Becoming Leader. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
I20260709 13:19:59.478298 10575 raft_consensus.cc:493] T 95a75bfe094d4bdc963aba3f08dfcd25 P cd75a17ab2604397adab03bb8b5fd75c [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
W20260709 13:19:59.519775  6697 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 172380us
W20260709 13:19:59.520959  6695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 57289.7us
I20260709 13:19:59.486672 10617 raft_consensus.cc:493] T 22ccee1b570c4ad3a57bd7aec085b1b4 P cd75a17ab2604397adab03bb8b5fd75c [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:19:59.435386 10367 raft_consensus.cc:515] T 3411566abe2d4c9bb4b2adfdd05e6f17 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:59.520824  6697 leader_election.cc:304] T d8292e16e5654be6bc408560cf256aaa P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377
I20260709 13:19:59.520802 10547 raft_consensus.cc:493] T 8c7f33e544204fbaac4078e3e83bbf4e P ccd8a4c3bfe3413cb2ae219b09aea832 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:59.536666  6697 leader_election.cc:304] T 427c124d773f483294511e80fe340075 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:19:59.491156 10568 raft_consensus.cc:493] T 3fa34c08b205435dba97346991aa1f92 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 11 FOLLOWER]: Starting pre-election (detected failure of leader cd75a17ab2604397adab03bb8b5fd75c)
I20260709 13:19:59.538615  6697 leader_election.cc:304] T bd6869f07b5a4885a0b99fbe60c3b175 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:19:59.544384  6695 leader_election.cc:304] T 9e326172347f45e99a0d482b5d8ef768 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
I20260709 13:19:59.483533 10537 raft_consensus.cc:515] T d33d5ee8ef6f415593d8df52063161ad P ccd8a4c3bfe3413cb2ae219b09aea832 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:59.474324 10580 raft_consensus.cc:515] T e31b9971c15848dea59d4d4130141d9e P ccd8a4c3bfe3413cb2ae219b09aea832 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
W20260709 13:19:59.569211  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 80559.3us
I20260709 13:19:59.570698 10580 leader_election.cc:290] T e31b9971c15848dea59d4d4130141d9e P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:59.571518 10580 raft_consensus.cc:493] T fe20b4b48823486ca3b9c648db6ce8aa P ccd8a4c3bfe3413cb2ae219b09aea832 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 7ba59cc884714e8aa5f3f0ecaed84cbb)
I20260709 13:19:59.516634 10642 raft_consensus.cc:2804] T 3a485a995abc4807b6e511e45419f737 P b7ab4784c7344b939bc36f639286f377 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:19:59.511091 10313 raft_consensus.cc:697] T bd6869f07b5a4885a0b99fbe60c3b175 P b7ab4784c7344b939bc36f639286f377 [term 11 LEADER]: Becoming Leader. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
I20260709 13:19:59.532469 10063 raft_consensus.cc:697] T f4b8bd455d5a47c18a1380839c6e0d61 P b7ab4784c7344b939bc36f639286f377 [term 9 LEADER]: Becoming Leader. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
I20260709 13:19:59.591826  9836 consensus_queue.cc:1048] T 7c44c4849aa54f2b94d1f1bef9ed546f P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:19:59.595420  6728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b8cacb381b746da8d0049b0a83b41dd" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:19:59.597911  6728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe20b4b48823486ca3b9c648db6ce8aa" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:19:59.599339  6726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20f6842e26174571996b8dea4151d4be" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:19:59.599572  6724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a92dd554674067a83a9cb68c4773f2" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:19:59.600386  6724 raft_consensus.cc:2368] T 07a92dd554674067a83a9cb68c4773f2 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c for earlier term 9. Current term is 10.
I20260709 13:19:59.603526  6729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77e330a82df4b43a745d57a68f6f057" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
W20260709 13:19:59.598742  6770 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 216154us
I20260709 13:19:59.605839  6725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1704639a875409b9959353527b3fd68" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:19:59.606644  6725 raft_consensus.cc:2468] T a1704639a875409b9959353527b3fd68 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 10.
W20260709 13:19:59.612355  6698 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:59.618009  6725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c240553ce044eedb41541d72b9475d7" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:19:59.619138  6724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e326172347f45e99a0d482b5d8ef768" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:19:59.619830  6724 raft_consensus.cc:2468] T 9e326172347f45e99a0d482b5d8ef768 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 9.
I20260709 13:19:59.521626 10387 raft_consensus.cc:515] T 7ba5dac66ab5497e9e336f2a3c28cda5 P cd75a17ab2604397adab03bb8b5fd75c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:19:59.545217 10617 raft_consensus.cc:515] T 22ccee1b570c4ad3a57bd7aec085b1b4 P cd75a17ab2604397adab03bb8b5fd75c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:59.624240  6724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24ee15416e3145beaa1b8183453729a3" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 11 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:19:59.537285 10575 raft_consensus.cc:515] T 95a75bfe094d4bdc963aba3f08dfcd25 P cd75a17ab2604397adab03bb8b5fd75c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:59.544603 10692 consensus_queue.cc:1059] T f4b8bd455d5a47c18a1380839c6e0d61 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.070s
W20260709 13:19:59.662854  6773 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:59.665561  6772 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 130655us
I20260709 13:19:59.674855  6726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b56bf91d90824c959e21e0cee5ba1816" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:19:59.675951  6731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "711ef6523deb4cbe8ef2ba61e1c21c98" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:19:59.679317  6724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de3186201e1a40d0b335eeb8b4e256e0" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:19:59.686002  6726 raft_consensus.cc:2468] T b56bf91d90824c959e21e0cee5ba1816 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 9.
I20260709 13:19:59.552138 10547 raft_consensus.cc:515] T 8c7f33e544204fbaac4078e3e83bbf4e P ccd8a4c3bfe3413cb2ae219b09aea832 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:59.567966 10568 raft_consensus.cc:515] T 3fa34c08b205435dba97346991aa1f92 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:19:59.579391 10580 raft_consensus.cc:515] T fe20b4b48823486ca3b9c648db6ce8aa P ccd8a4c3bfe3413cb2ae219b09aea832 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:19:59.704594  6724 raft_consensus.cc:2393] T de3186201e1a40d0b335eeb8b4e256e0 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c in current term 11: Already voted for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in this term.
I20260709 13:19:59.736963  6724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3411566abe2d4c9bb4b2adfdd05e6f17" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:19:59.737953  6724 raft_consensus.cc:2468] T 3411566abe2d4c9bb4b2adfdd05e6f17 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 8.
I20260709 13:19:59.679611 10421 consensus_queue.cc:237] T 1bf4668eeb70467fb3dc5a0289233b3c P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:59.742614 10703 consensus_queue.cc:1059] T 95a75bfe094d4bdc963aba3f08dfcd25 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: INVALID_TERM, Last received: 10.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.007s
I20260709 13:19:59.673251 10642 raft_consensus.cc:697] T 3a485a995abc4807b6e511e45419f737 P b7ab4784c7344b939bc36f639286f377 [term 9 LEADER]: Becoming Leader. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
I20260709 13:19:59.745107 10367 leader_election.cc:290] T 3411566abe2d4c9bb4b2adfdd05e6f17 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:59.745669 10642 consensus_queue.cc:237] T 3a485a995abc4807b6e511e45419f737 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:59.746587  6726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09c2a98de1a4decabd0ff900dd44caa" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 13 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:19:59.747622  6726 raft_consensus.cc:2410] T f09c2a98de1a4decabd0ff900dd44caa P ccd8a4c3bfe3413cb2ae219b09aea832 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c for term 13 because replica has last-logged OpId of term: 11 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 4.
I20260709 13:19:59.748241  6732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a485a995abc4807b6e511e45419f737" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:19:59.749020  6732 raft_consensus.cc:2368] T 3a485a995abc4807b6e511e45419f737 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c for earlier term 8. Current term is 9.
I20260709 13:19:59.748958  6730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c44c4849aa54f2b94d1f1bef9ed546f" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 13 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:19:59.672959 10707 raft_consensus.cc:2804] T e77e330a82df4b43a745d57a68f6f057 P cd75a17ab2604397adab03bb8b5fd75c [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:19:59.749493 10571 raft_consensus.cc:515] T 2c240553ce044eedb41541d72b9475d7 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:59.750036 10707 raft_consensus.cc:493] T e77e330a82df4b43a745d57a68f6f057 P cd75a17ab2604397adab03bb8b5fd75c [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:59.750206  6730 raft_consensus.cc:2410] T 7c44c4849aa54f2b94d1f1bef9ed546f P ccd8a4c3bfe3413cb2ae219b09aea832 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c for term 13 because replica has last-logged OpId of term: 10 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 7.
I20260709 13:19:59.750463 10707 raft_consensus.cc:3060] T e77e330a82df4b43a745d57a68f6f057 P cd75a17ab2604397adab03bb8b5fd75c [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:59.750773  6725 raft_consensus.cc:2393] T 2c240553ce044eedb41541d72b9475d7 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c in current term 12: Already voted for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in this term.
W20260709 13:19:59.752992  6661 debug-util.cc:398] Leaking SignalData structure 0x7b08003018a0 after lost signal to thread 5625
W20260709 13:19:59.753441  6661 debug-util.cc:398] Leaking SignalData structure 0x7b08002f3c80 after lost signal to thread 5628
I20260709 13:19:59.753732  6730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab432e62819d499eaaf3dd55481dd930" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
W20260709 13:19:59.754580  6661 debug-util.cc:398] Leaking SignalData structure 0x7b08002f3b80 after lost signal to thread 6664
I20260709 13:19:59.754844  6729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce4f062dcd314d43a63ca74067cb5ee3" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 11 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:19:59.767189  6728 raft_consensus.cc:2410] T fe20b4b48823486ca3b9c648db6ce8aa P ccd8a4c3bfe3413cb2ae219b09aea832 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c for term 9 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 8.
W20260709 13:19:59.757717  6661 debug-util.cc:398] Leaking SignalData structure 0x7b080025c980 after lost signal to thread 6756
W20260709 13:19:59.770730  6770 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 89947.3us
W20260709 13:19:59.770964  6661 debug-util.cc:398] Leaking SignalData structure 0x7b08002781a0 after lost signal to thread 6831
W20260709 13:19:59.756286  6695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 220621us
I20260709 13:19:59.773270  6730 raft_consensus.cc:2393] T ab432e62819d499eaaf3dd55481dd930 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c in current term 11: Already voted for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in this term.
I20260709 13:19:59.774240  6723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c37d41cd9164c15a6826ca62a851a69" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:19:59.774945  6723 raft_consensus.cc:3060] T 7c37d41cd9164c15a6826ca62a851a69 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:59.577765 10627 consensus_queue.cc:260] T bd6869f07b5a4885a0b99fbe60c3b175 P cd75a17ab2604397adab03bb8b5fd75c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 10.5, Last appended by leader: 5, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
W20260709 13:19:59.779062  6661 debug-util.cc:398] Leaking SignalData structure 0x7b08003b3b60 after lost signal to thread 6905
W20260709 13:19:59.779422  6661 debug-util.cc:398] Leaking SignalData structure 0x7b0800357840 after lost signal to thread 6906
W20260709 13:19:59.780742  6661 debug-util.cc:398] Leaking SignalData structure 0x7b0800356360 after lost signal to thread 7527
W20260709 13:19:59.781020  6661 debug-util.cc:398] Leaking SignalData structure 0x7b0800297540 after lost signal to thread 7528
W20260709 13:19:59.781512  6661 debug-util.cc:398] Leaking SignalData structure 0x7b08003db2a0 after lost signal to thread 10442
W20260709 13:19:59.782802  6698 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:59.773777  6770 leader_election.cc:304] T 9e326172347f45e99a0d482b5d8ef768 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
I20260709 13:19:59.799623  6724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7887766dc6784fcaa42b35c05fea7a99" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:19:59.691155 10699 raft_consensus.cc:2804] T d8292e16e5654be6bc408560cf256aaa P ccd8a4c3bfe3413cb2ae219b09aea832 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:19:59.800813  6724 raft_consensus.cc:2468] T 7887766dc6784fcaa42b35c05fea7a99 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 10.
I20260709 13:19:59.802029  6729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24ee15416e3145beaa1b8183453729a3" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 11 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:19:59.803457  6727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d33d5ee8ef6f415593d8df52063161ad" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:19:59.804687  6732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4275cf08e63345f993bce8664eada830" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:19:59.809103  6732 raft_consensus.cc:2393] T 4275cf08e63345f993bce8664eada830 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c in current term 11: Already voted for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in this term.
I20260709 13:19:59.806567  6726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5be3a11b23d4ea9b08300a2789821c7" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:19:59.732383 10418 leader_election.cc:290] T ab432e62819d499eaaf3dd55481dd930 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 12 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:59.745826 10367 raft_consensus.cc:2749] T bd6869f07b5a4885a0b99fbe60c3b175 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:19:59.820178  6772 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 129485us
I20260709 13:19:59.808143  6727 raft_consensus.cc:2468] T d33d5ee8ef6f415593d8df52063161ad P ccd8a4c3bfe3413cb2ae219b09aea832 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 10.
I20260709 13:19:59.834424  6732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be1a92657f494cac8dd227d152f50151" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:19:59.835201  6732 raft_consensus.cc:3060] T be1a92657f494cac8dd227d152f50151 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:19:59.833592  6697 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 295034us
I20260709 13:19:59.836644  6697 leader_election.cc:304] T bb3d8792045a4583ae2e965b1350a5b4 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:19:59.754743 10696 raft_consensus.cc:2749] T 427c124d773f483294511e80fe340075 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:19:59.764930 10313 consensus_queue.cc:237] T bd6869f07b5a4885a0b99fbe60c3b175 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.4, Last appended by leader: 4, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:59.838254 10715 raft_consensus.cc:2749] T d8cee0accdb8499c86d4414b72565a38 P cd75a17ab2604397adab03bb8b5fd75c [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:19:59.851795 10715 raft_consensus.cc:493] T 8c7f33e544204fbaac4078e3e83bbf4e P cd75a17ab2604397adab03bb8b5fd75c [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:59.852381  6727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3f13b31a1f84f0d89d007eadd57924c" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:19:59.853147  6727 raft_consensus.cc:3060] T b3f13b31a1f84f0d89d007eadd57924c P ccd8a4c3bfe3413cb2ae219b09aea832 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:19:59.857806  6773 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:59.862928  6772 leader_election.cc:304] T 2c240553ce044eedb41541d72b9475d7 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:19:59.777223 10561 consensus_queue.cc:1059] T 711ef6523deb4cbe8ef2ba61e1c21c98 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.061s
I20260709 13:19:59.870080  6732 raft_consensus.cc:2468] T be1a92657f494cac8dd227d152f50151 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in term 13.
W20260709 13:19:59.870240  6846 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.68:45071, user_credentials={real_user=slave}} blocked reactor thread for 205660us
W20260709 13:19:59.846501 10694 log.cc:927] Time spent T 404190ce4ce94cecbfcb6ea9d1dd8626 P 7ba59cc884714e8aa5f3f0ecaed84cbb: Append to log took a long time: real 0.226s	user 0.001s	sys 0.000s
I20260709 13:19:59.835165 10627 raft_consensus.cc:3060] T bd6869f07b5a4885a0b99fbe60c3b175 P cd75a17ab2604397adab03bb8b5fd75c [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:59.896160  7500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24ee15416e3145beaa1b8183453729a3" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 11 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb"
I20260709 13:19:59.849169 10722 raft_consensus.cc:2749] T ce4f062dcd314d43a63ca74067cb5ee3 P cd75a17ab2604397adab03bb8b5fd75c [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:19:59.908452  7500 raft_consensus.cc:2393] T 24ee15416e3145beaa1b8183453729a3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c in current term 11: Already voted for candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in this term.
I20260709 13:19:59.910808 10575 leader_election.cc:290] T 95a75bfe094d4bdc963aba3f08dfcd25 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:19:59.838155 10063 consensus_queue.cc:237] T f4b8bd455d5a47c18a1380839c6e0d61 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:59.912251 10693 raft_consensus.cc:493] T 427c124d773f483294511e80fe340075 P cd75a17ab2604397adab03bb8b5fd75c [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
W20260709 13:19:59.849115 10701 log.cc:927] Time spent T f5be3a11b23d4ea9b08300a2789821c7 P ccd8a4c3bfe3413cb2ae219b09aea832: Append to log took a long time: real 0.153s	user 0.000s	sys 0.000s
I20260709 13:19:59.912925 10693 raft_consensus.cc:515] T 427c124d773f483294511e80fe340075 P cd75a17ab2604397adab03bb8b5fd75c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } attrs { replace: true } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:19:59.849256 10649 leader_election.cc:290] T 24ee15416e3145beaa1b8183453729a3 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 11 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:19:59.870321 10704 raft_consensus.cc:493] T a3022224cc81473690653a83d4e99470 P cd75a17ab2604397adab03bb8b5fd75c [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:59.914711 10704 raft_consensus.cc:515] T a3022224cc81473690653a83d4e99470 P cd75a17ab2604397adab03bb8b5fd75c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
W20260709 13:19:59.898444 10557 consensus_meta.cc:287] T d8292e16e5654be6bc408560cf256aaa P b7ab4784c7344b939bc36f639286f377: Time spent flushing consensus metadata: real 0.654s	user 0.008s	sys 0.001s
I20260709 13:19:59.848940 10537 leader_election.cc:290] T d33d5ee8ef6f415593d8df52063161ad P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:59.846033 10571 leader_election.cc:290] T 2c240553ce044eedb41541d72b9475d7 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 12 election: Requested vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:19:59.902946 10617 leader_election.cc:290] T 22ccee1b570c4ad3a57bd7aec085b1b4 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:19:59.903519 10621 leader_election.cc:290] T 4f00a2e87e56452083b759f60d461ee3 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
W20260709 13:19:59.849710 10697 log.cc:927] Time spent T 30e88460611e47b2ba16a46a30b5f416 P b7ab4784c7344b939bc36f639286f377: Append to log took a long time: real 0.230s	user 0.000s	sys 0.001s
I20260709 13:19:59.915982 10693 leader_election.cc:290] T 427c124d773f483294511e80fe340075 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:19:59.920930 10696 raft_consensus.cc:2749] T bb3d8792045a4583ae2e965b1350a5b4 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:19:59.917270  6770 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 143596us
I20260709 13:19:59.839927 10591 leader_election.cc:290] T c4db81d9d329422bb3b4160ca4ac2d1d P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
W20260709 13:19:59.917861  6772 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 55018us
I20260709 13:19:59.936853  6732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17587d6730594da4a56fa13a353232a1" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:19:59.939777  6732 raft_consensus.cc:2393] T 17587d6730594da4a56fa13a353232a1 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in current term 14: Already voted for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in this term.
I20260709 13:19:59.927683  6727 raft_consensus.cc:2468] T b3f13b31a1f84f0d89d007eadd57924c P ccd8a4c3bfe3413cb2ae219b09aea832 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in term 9.
I20260709 13:19:59.958962  6723 raft_consensus.cc:2410] T 7c37d41cd9164c15a6826ca62a851a69 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c for term 9 because replica has last-logged OpId of term: 8 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 13:19:59.966020  6806 raft_consensus.cc:2468] T d8292e16e5654be6bc408560cf256aaa P b7ab4784c7344b939bc36f639286f377 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 13.
I20260709 13:19:59.936609  6770 leader_election.cc:304] T dbdf895bba214ff68685a24fd17dfb5d P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
I20260709 13:19:59.968683  6728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3d8792045a4583ae2e965b1350a5b4" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:19:59.885972 10692 raft_consensus.cc:3055] T f4b8bd455d5a47c18a1380839c6e0d61 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:19:59.846941 10700 raft_consensus.cc:2804] T 9e326172347f45e99a0d482b5d8ef768 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:19:59.856362 10487 consensus_queue.cc:1059] T 4275cf08e63345f993bce8664eada830 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: INVALID_TERM, Last received: 10.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.081s
I20260709 13:19:59.871323 10367 raft_consensus.cc:493] T f09c2a98de1a4decabd0ff900dd44caa P ccd8a4c3bfe3413cb2ae219b09aea832 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:59.979610  6727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b8cacb381b746da8d0049b0a83b41dd" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:19:59.979741  6723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24ee15416e3145beaa1b8183453729a3" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 11 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:19:59.918066 10418 raft_consensus.cc:2804] T 2c240553ce044eedb41541d72b9475d7 P b7ab4784c7344b939bc36f639286f377 [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 13:19:59.986685  6772 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 49151.8us
I20260709 13:19:59.992195  6772 leader_election.cc:304] T 713b5728a197487c9300b310ab94e5a3 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
W20260709 13:19:59.937422 10626 consensus_meta.cc:287] T 20f6842e26174571996b8dea4151d4be P cd75a17ab2604397adab03bb8b5fd75c: Time spent flushing consensus metadata: real 0.723s	user 0.011s	sys 0.002s
W20260709 13:19:59.989550  6770 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 53025.6us
W20260709 13:19:59.993006  6695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 170098us
I20260709 13:19:59.917536 10160 raft_consensus.cc:2804] T 9e326172347f45e99a0d482b5d8ef768 P b7ab4784c7344b939bc36f639286f377 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:19:59.916947 10704 leader_election.cc:290] T a3022224cc81473690653a83d4e99470 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:19:59.919782 10698 consensus_queue.cc:1059] T 7c37d41cd9164c15a6826ca62a851a69 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 3, Time since last communication: 0.118s
I20260709 13:19:59.918709 10725 consensus_queue.cc:1048] T e77e330a82df4b43a745d57a68f6f057 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.119s
W20260709 13:20:00.033865  6847 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:59.994242  6770 leader_election.cc:304] T 404190ce4ce94cecbfcb6ea9d1dd8626 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb
W20260709 13:20:00.039896  6772 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 47772.4us
I20260709 13:19:59.975888 10560 raft_consensus.cc:493] T d8292e16e5654be6bc408560cf256aaa P b7ab4784c7344b939bc36f639286f377 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:59.852412 10715 raft_consensus.cc:515] T 8c7f33e544204fbaac4078e3e83bbf4e P cd75a17ab2604397adab03bb8b5fd75c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:19:59.978932 10700 raft_consensus.cc:493] T 9e326172347f45e99a0d482b5d8ef768 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:59.990345 10418 raft_consensus.cc:493] T 2c240553ce044eedb41541d72b9475d7 P b7ab4784c7344b939bc36f639286f377 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:20:00.101164  6697 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 264583us
W20260709 13:20:00.034963 10604 consensus_meta.cc:287] T f5be3a11b23d4ea9b08300a2789821c7 P b7ab4784c7344b939bc36f639286f377: Time spent flushing consensus metadata: real 0.809s	user 0.015s	sys 0.000s
I20260709 13:19:59.990707 10699 raft_consensus.cc:697] T d8292e16e5654be6bc408560cf256aaa P ccd8a4c3bfe3413cb2ae219b09aea832 [term 13 LEADER]: Becoming Leader. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
I20260709 13:19:59.976090 10692 raft_consensus.cc:740] T f4b8bd455d5a47c18a1380839c6e0d61 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
W20260709 13:20:00.108872  6770 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 114695us
I20260709 13:20:00.034567 10561 raft_consensus.cc:2804] T dbdf895bba214ff68685a24fd17dfb5d P b7ab4784c7344b939bc36f639286f377 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:20:00.110347  6772 leader_election.cc:304] T e77e330a82df4b43a745d57a68f6f057 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:20:00.119387  7495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ba5dac66ab5497e9e336f2a3c28cda5" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:20:00.032248 10618 raft_consensus.cc:3055] T 07a92dd554674067a83a9cb68c4773f2 P cd75a17ab2604397adab03bb8b5fd75c [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:20:00.056468 10723 raft_consensus.cc:493] T 7a734b5ab7834e05a8c422208acc58b1 P cd75a17ab2604397adab03bb8b5fd75c [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:20:00.048825 10703 raft_consensus.cc:2749] T 713b5728a197487c9300b310ab94e5a3 P b7ab4784c7344b939bc36f639286f377 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:20:00.085196 10387 leader_election.cc:290] T 7ba5dac66ab5497e9e336f2a3c28cda5 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:20:00.090137 10160 raft_consensus.cc:493] T 9e326172347f45e99a0d482b5d8ef768 P b7ab4784c7344b939bc36f639286f377 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:00.078756 10617 raft_consensus.cc:493] T 30e88460611e47b2ba16a46a30b5f416 P cd75a17ab2604397adab03bb8b5fd75c [term 9 FOLLOWER]: Starting pre-election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:20:00.119498 10561 raft_consensus.cc:493] T dbdf895bba214ff68685a24fd17dfb5d P b7ab4784c7344b939bc36f639286f377 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:00.120141  7495 raft_consensus.cc:2468] T 7ba5dac66ab5497e9e336f2a3c28cda5 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 10.
I20260709 13:19:59.990787 10367 raft_consensus.cc:515] T f09c2a98de1a4decabd0ff900dd44caa P ccd8a4c3bfe3413cb2ae219b09aea832 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:00.144963 10708 consensus_queue.cc:1059] T 4275cf08e63345f993bce8664eada830 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: INVALID_TERM, Last received: 10.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.027s
I20260709 13:20:00.148406  6731 raft_consensus.cc:2393] T 711ef6523deb4cbe8ef2ba61e1c21c98 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c in current term 11: Already voted for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in this term.
I20260709 13:20:00.033502 10626 raft_consensus.cc:515] T 20f6842e26174571996b8dea4151d4be P cd75a17ab2604397adab03bb8b5fd75c [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:00.149101 10367 leader_election.cc:290] T f09c2a98de1a4decabd0ff900dd44caa P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:00.117498 10557 raft_consensus.cc:2804] T 404190ce4ce94cecbfcb6ea9d1dd8626 P b7ab4784c7344b939bc36f639286f377 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:20:00.129372  7500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f00a2e87e56452083b759f60d461ee3" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:20:00.150367 10557 raft_consensus.cc:493] T 404190ce4ce94cecbfcb6ea9d1dd8626 P b7ab4784c7344b939bc36f639286f377 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 7ba59cc884714e8aa5f3f0ecaed84cbb)
I20260709 13:20:00.150643 10626 leader_election.cc:290] T 20f6842e26174571996b8dea4151d4be P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 12 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:20:00.150738  7500 raft_consensus.cc:2468] T 4f00a2e87e56452083b759f60d461ee3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 10.
I20260709 13:20:00.152374  6873 raft_consensus.cc:2393] T 20f6842e26174571996b8dea4151d4be P cd75a17ab2604397adab03bb8b5fd75c [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7ab4784c7344b939bc36f639286f377 in current term 12: Already voted for candidate cd75a17ab2604397adab03bb8b5fd75c in this term.
I20260709 13:20:00.153268  6844 leader_election.cc:304] T 4d9def8b32fd443aa94ab1420b06837b P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:20:00.153369  6697 leader_election.cc:304] T f3f9c2e2bf644115957398fe4c9459db P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377
I20260709 13:20:00.156216 10575 raft_consensus.cc:493] T f03d0dbf16864ca4bc1bb5e4c0334c0f P cd75a17ab2604397adab03bb8b5fd75c [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:20:00.156796 10575 raft_consensus.cc:515] T f03d0dbf16864ca4bc1bb5e4c0334c0f P cd75a17ab2604397adab03bb8b5fd75c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:00.155722  6844 leader_election.cc:304] T 44bde925b2e541b69890d70715b85176 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:20:00.131532 10715 leader_election.cc:290] T 8c7f33e544204fbaac4078e3e83bbf4e P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:20:00.097249 10560 raft_consensus.cc:515] T d8292e16e5654be6bc408560cf256aaa P b7ab4784c7344b939bc36f639286f377 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:00.136111 10580 leader_election.cc:290] T fe20b4b48823486ca3b9c648db6ce8aa P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:20:00.137959  6799 raft_consensus.cc:1275] T b3f13b31a1f84f0d89d007eadd57924c P b7ab4784c7344b939bc36f639286f377 [term 9 FOLLOWER]: Refusing update from remote peer 7ba59cc884714e8aa5f3f0ecaed84cbb: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:20:00.043896 10591 consensus_queue.cc:1048] T 20f6842e26174571996b8dea4151d4be P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.074s
I20260709 13:20:00.097749 10700 raft_consensus.cc:3060] T 9e326172347f45e99a0d482b5d8ef768 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:20:00.033020 10006 consensus_queue.cc:1048] T a3022224cc81473690653a83d4e99470 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.084s
I20260709 13:20:00.110961 10418 raft_consensus.cc:3060] T 2c240553ce044eedb41541d72b9475d7 P b7ab4784c7344b939bc36f639286f377 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:20:00.123167 10571 consensus_queue.cc:1059] T f4b8bd455d5a47c18a1380839c6e0d61 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.017s
I20260709 13:20:00.138490 10698 raft_consensus.cc:2804] T e77e330a82df4b43a745d57a68f6f057 P b7ab4784c7344b939bc36f639286f377 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:20:00.033733 10713 raft_consensus.cc:3055] T 711ef6523deb4cbe8ef2ba61e1c21c98 P b7ab4784c7344b939bc36f639286f377 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:20:00.114542 10547 leader_election.cc:290] T 8c7f33e544204fbaac4078e3e83bbf4e P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:00.148252 10699 consensus_queue.cc:237] T d8292e16e5654be6bc408560cf256aaa P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:00.149683 10734 consensus_queue.cc:1048] T e77e330a82df4b43a745d57a68f6f057 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.005s
W20260709 13:20:00.135708 10602 consensus_meta.cc:287] T 8c7f33e544204fbaac4078e3e83bbf4e P b7ab4784c7344b939bc36f639286f377: Time spent flushing consensus metadata: real 0.755s	user 0.005s	sys 0.005s
I20260709 13:20:00.128837 10618 raft_consensus.cc:740] T 07a92dd554674067a83a9cb68c4773f2 P cd75a17ab2604397adab03bb8b5fd75c [term 9 LEADER]: Becoming Follower/Learner. State: Replica: cd75a17ab2604397adab03bb8b5fd75c, State: Running, Role: LEADER
I20260709 13:20:00.136595 10568 leader_election.cc:290] T 3fa34c08b205435dba97346991aa1f92 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:00.161043  6846 leader_election.cc:304] T 7ba5dac66ab5497e9e336f2a3c28cda5 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
W20260709 13:20:00.209275  6846 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.68:45071, user_credentials={real_user=slave}} blocked reactor thread for 48371.2us
I20260709 13:20:00.165894  6697 leader_election.cc:304] T b56bf91d90824c959e21e0cee5ba1816 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377
I20260709 13:20:00.160619 10557 raft_consensus.cc:3060] T 404190ce4ce94cecbfcb6ea9d1dd8626 P b7ab4784c7344b939bc36f639286f377 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:20:00.143530 10160 raft_consensus.cc:3060] T 9e326172347f45e99a0d482b5d8ef768 P b7ab4784c7344b939bc36f639286f377 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:20:00.141105 10723 raft_consensus.cc:515] T 7a734b5ab7834e05a8c422208acc58b1 P cd75a17ab2604397adab03bb8b5fd75c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:00.177470  7496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "427c124d773f483294511e80fe340075" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:20:00.158934 10561 raft_consensus.cc:3060] T dbdf895bba214ff68685a24fd17dfb5d P b7ab4784c7344b939bc36f639286f377 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:20:00.213040  6697 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 47286.8us
I20260709 13:20:00.213430 10718 consensus_queue.cc:1048] T f09c2a98de1a4decabd0ff900dd44caa P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:20:00.213876  6697 leader_election.cc:304] T a1704639a875409b9959353527b3fd68 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377
I20260709 13:20:00.214673 10735 raft_consensus.cc:2804] T b56bf91d90824c959e21e0cee5ba1816 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:20:00.213131  6772 leader_election.cc:304] T 20f6842e26174571996b8dea4151d4be P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:20:00.215196 10735 raft_consensus.cc:493] T b56bf91d90824c959e21e0cee5ba1816 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:00.168517 10591 consensus_queue.cc:1243] T 20f6842e26174571996b8dea4151d4be P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Peer b7ab4784c7344b939bc36f639286f377 log is divergent from this leader: its last log entry 6.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 13:20:00.160313 10387 raft_consensus.cc:493] T 1bf4668eeb70467fb3dc5a0289233b3c P cd75a17ab2604397adab03bb8b5fd75c [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:00.162271 10649 raft_consensus.cc:493] T f4b8bd455d5a47c18a1380839c6e0d61 P cd75a17ab2604397adab03bb8b5fd75c [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:00.169298 10626 raft_consensus.cc:2749] T 4d9def8b32fd443aa94ab1420b06837b P cd75a17ab2604397adab03bb8b5fd75c [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:20:00.198675  6728 raft_consensus.cc:2468] T bb3d8792045a4583ae2e965b1350a5b4 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in term 9.
W20260709 13:20:00.202428  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 46802.4us
I20260709 13:20:00.243062  6844 leader_election.cc:304] T 34f36d59d88f40fe8a2805e604fc6c0a P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:20:00.243403  7495 raft_consensus.cc:1240] T be1a92657f494cac8dd227d152f50151 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 13 FOLLOWER]: Rejecting Update request from peer b7ab4784c7344b939bc36f639286f377 for earlier term 12. Current term is 13. Ops: []
I20260709 13:20:00.160403 10704 raft_consensus.cc:493] T 853ac0a8cbd64ce99457f170216d4d0f P cd75a17ab2604397adab03bb8b5fd75c [term 6 FOLLOWER]: Starting pre-election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:20:00.206907  7466 leader_election.cc:304] T be1a92657f494cac8dd227d152f50151 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: b7ab4784c7344b939bc36f639286f377
I20260709 13:20:00.210008  6846 leader_election.cc:304] T 4f00a2e87e56452083b759f60d461ee3 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
W20260709 13:20:00.210230  6696 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:00.218719  6697 leader_election.cc:304] T 4275cf08e63345f993bce8664eada830 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:20:00.219170  6879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb7fa124c3bf4ef9ab65a407cb008441" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:00.219416  6877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f00a2e87e56452083b759f60d461ee3" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 11 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:00.228269 10063 raft_consensus.cc:3060] T 20f6842e26174571996b8dea4151d4be P b7ab4784c7344b939bc36f639286f377 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:20:00.221194  6881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab432e62819d499eaaf3dd55481dd930" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:20:00.250644  6881 raft_consensus.cc:3060] T ab432e62819d499eaaf3dd55481dd930 P cd75a17ab2604397adab03bb8b5fd75c [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:20:00.250794  6877 raft_consensus.cc:2410] T 4f00a2e87e56452083b759f60d461ee3 P cd75a17ab2604397adab03bb8b5fd75c [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7ab4784c7344b939bc36f639286f377 for term 11 because replica has last-logged OpId of term: 8 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 8.
I20260709 13:20:00.201061 10698 raft_consensus.cc:493] T e77e330a82df4b43a745d57a68f6f057 P b7ab4784c7344b939bc36f639286f377 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:20:00.253098  7466 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 46266us
I20260709 13:20:00.199218 10733 raft_consensus.cc:493] T f3f9c2e2bf644115957398fe4c9459db P cd75a17ab2604397adab03bb8b5fd75c [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:00.195818 10722 raft_consensus.cc:2749] T 44bde925b2e541b69890d70715b85176 P cd75a17ab2604397adab03bb8b5fd75c [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:20:00.161026 10617 raft_consensus.cc:515] T 30e88460611e47b2ba16a46a30b5f416 P cd75a17ab2604397adab03bb8b5fd75c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:00.220860  6876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d9def8b32fd443aa94ab1420b06837b" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 11 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:00.197790 10731 raft_consensus.cc:2804] T f3f9c2e2bf644115957398fe4c9459db P ccd8a4c3bfe3413cb2ae219b09aea832 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:20:00.199994 10713 raft_consensus.cc:740] T 711ef6523deb4cbe8ef2ba61e1c21c98 P b7ab4784c7344b939bc36f639286f377 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
W20260709 13:20:00.238818  6806 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:32966 (request call id 966) took 2084 ms (client timeout 1981 ms). Trace:
I20260709 13:20:00.197798 10604 consensus_queue.cc:1048] T b56bf91d90824c959e21e0cee5ba1816 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.019s
I20260709 13:20:00.222307  7496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f00a2e87e56452083b759f60d461ee3" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 11 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:20:00.197207 10525 consensus_queue.cc:1048] T a3022224cc81473690653a83d4e99470 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.023s
I20260709 13:20:00.252986 10715 raft_consensus.cc:2749] T 34f36d59d88f40fe8a2805e604fc6c0a P cd75a17ab2604397adab03bb8b5fd75c [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:20:00.247998  7500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb7fa124c3bf4ef9ab65a407cb008441" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:20:00.210835 10738 raft_consensus.cc:2804] T 7ba5dac66ab5497e9e336f2a3c28cda5 P cd75a17ab2604397adab03bb8b5fd75c [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:20:00.253887  7466 leader_election.cc:304] T 17587d6730594da4a56fa13a353232a1 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:20:00.207896 10708 consensus_queue.cc:1048] T f3f9c2e2bf644115957398fe4c9459db P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.041s
I20260709 13:20:00.216126 10735 raft_consensus.cc:3060] T b56bf91d90824c959e21e0cee5ba1816 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:20:00.260804 10537 raft_consensus.cc:493] T 34f36d59d88f40fe8a2805e604fc6c0a P ccd8a4c3bfe3413cb2ae219b09aea832 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:20:00.229751 10580 raft_consensus.cc:2804] T a1704639a875409b9959353527b3fd68 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:20:00.263547  6730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fa34c08b205435dba97346991aa1f92" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
W20260709 13:20:00.298200  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 50354.1us
I20260709 13:20:00.216612 10554 consensus_queue.cc:1048] T 90d42e216d9741e190bca19a781291fd P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.041s
I20260709 13:20:00.211135 10602 raft_consensus.cc:515] T 8c7f33e544204fbaac4078e3e83bbf4e P b7ab4784c7344b939bc36f639286f377 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:00.242964 10703 raft_consensus.cc:493] T 1bf4668eeb70467fb3dc5a0289233b3c P b7ab4784c7344b939bc36f639286f377 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:00.364288  6876 raft_consensus.cc:2410] T 4d9def8b32fd443aa94ab1420b06837b P cd75a17ab2604397adab03bb8b5fd75c [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7ab4784c7344b939bc36f639286f377 for term 11 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 4.
W20260709 13:20:00.385922  6806 rpcz_store.cc:269] 0709 13:19:58.154597 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:58.157383 (+  2786us) service_pool.cc:224] Handling call
0709 13:20:00.238593 (+2081210us) spinlock_profiling.cc:243] Waited 1.79 s on lock 0x7b54002c92d4. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f9ae2fa 00007fcc1496fb17 00007fcc0deea6d4 00007fcc0deea662 00007fcc0deea591 00007fcc0deea50c 00007fcc0dee97c2 00007fcc0dce548c 00007fcc0dce48c6 00007fcc0dce426f
0709 13:20:00.238725 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4107303296}
I20260709 13:20:00.395140  7496 raft_consensus.cc:2468] T 4f00a2e87e56452083b759f60d461ee3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 10.
I20260709 13:20:00.257642 10725 raft_consensus.cc:2749] T 4275cf08e63345f993bce8664eada830 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:20:00.209116 10547 raft_consensus.cc:493] T 713b5728a197487c9300b310ab94e5a3 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:00.236810 10649 raft_consensus.cc:515] T f4b8bd455d5a47c18a1380839c6e0d61 P cd75a17ab2604397adab03bb8b5fd75c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:00.261327 10568 raft_consensus.cc:2804] T be1a92657f494cac8dd227d152f50151 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:20:00.258571 10698 raft_consensus.cc:3060] T e77e330a82df4b43a745d57a68f6f057 P b7ab4784c7344b939bc36f639286f377 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:00.361729 10731 raft_consensus.cc:493] T f3f9c2e2bf644115957398fe4c9459db P ccd8a4c3bfe3413cb2ae219b09aea832 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:20:00.470597  7466 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 216774us
I20260709 13:20:00.261023  6731 raft_consensus.cc:1275] T b3f13b31a1f84f0d89d007eadd57924c P ccd8a4c3bfe3413cb2ae219b09aea832 [term 9 FOLLOWER]: Refusing update from remote peer 7ba59cc884714e8aa5f3f0ecaed84cbb: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:20:00.231273 10387 raft_consensus.cc:515] T 1bf4668eeb70467fb3dc5a0289233b3c P cd75a17ab2604397adab03bb8b5fd75c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
W20260709 13:20:00.478826  6846 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.68:45071, user_credentials={real_user=slave}} blocked reactor thread for 268879us
I20260709 13:20:00.362099 10727 raft_consensus.cc:493] T 7c44c4849aa54f2b94d1f1bef9ed546f P ccd8a4c3bfe3413cb2ae219b09aea832 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:00.510408 10445 raft_consensus.cc:3060] T 17587d6730594da4a56fa13a353232a1 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:20:00.530573 10627 consensus_meta.cc:287] T bd6869f07b5a4885a0b99fbe60c3b175 P cd75a17ab2604397adab03bb8b5fd75c: Time spent flushing consensus metadata: real 0.586s	user 0.036s	sys 0.014s
I20260709 13:20:00.383718 10575 leader_election.cc:290] T f03d0dbf16864ca4bc1bb5e4c0334c0f P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:20:00.512204  6844 leader_election.cc:304] T 90d42e216d9741e190bca19a781291fd P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377
I20260709 13:20:00.256675 10571 consensus_queue.cc:1059] T 4b8cacb381b746da8d0049b0a83b41dd P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.156s
I20260709 13:20:00.258167 10693 consensus_queue.cc:1048] T 3fa34c08b205435dba97346991aa1f92 P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Connected to new peer: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.165s
I20260709 13:20:00.406951 10734 raft_consensus.cc:493] T dbdf895bba214ff68685a24fd17dfb5d P ccd8a4c3bfe3413cb2ae219b09aea832 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:20:00.581343  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 69257.5us
I20260709 13:20:00.582162  6844 leader_election.cc:304] T 713b5728a197487c9300b310ab94e5a3 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:20:00.523636  6730 raft_consensus.cc:2468] T 3fa34c08b205435dba97346991aa1f92 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in term 11.
I20260709 13:20:00.424206 10722 raft_consensus.cc:2804] T 4f00a2e87e56452083b759f60d461ee3 P cd75a17ab2604397adab03bb8b5fd75c [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:20:00.399655 10711 raft_consensus.cc:493] T 3d65025eea89441290d85dd053810e31 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:20:00.421942 10738 raft_consensus.cc:493] T 7ba5dac66ab5497e9e336f2a3c28cda5 P cd75a17ab2604397adab03bb8b5fd75c [term 10 FOLLOWER]: Starting leader election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:20:00.258802 10704 raft_consensus.cc:515] T 853ac0a8cbd64ce99457f170216d4d0f P cd75a17ab2604397adab03bb8b5fd75c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:00.309152 10421 raft_consensus.cc:493] T f58dc08b12a2494bb9a1372837970ca2 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:20:00.488674 10580 raft_consensus.cc:493] T a1704639a875409b9959353527b3fd68 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 10 FOLLOWER]: Starting leader election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:20:00.235384 10730 consensus_queue.cc:1048] T 20f6842e26174571996b8dea4151d4be P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.165s
I20260709 13:20:00.263912 10618 consensus_queue.cc:260] T 07a92dd554674067a83a9cb68c4773f2 P cd75a17ab2604397adab03bb8b5fd75c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:00.406057 10712 consensus_queue.cc:1059] T be1a92657f494cac8dd227d152f50151 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.151s
I20260709 13:20:00.263041 10733 raft_consensus.cc:515] T f3f9c2e2bf644115957398fe4c9459db P cd75a17ab2604397adab03bb8b5fd75c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:00.548767 10731 raft_consensus.cc:3060] T f3f9c2e2bf644115957398fe4c9459db P ccd8a4c3bfe3413cb2ae219b09aea832 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:20:00.514736 10537 raft_consensus.cc:515] T 34f36d59d88f40fe8a2805e604fc6c0a P ccd8a4c3bfe3413cb2ae219b09aea832 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
W20260709 13:20:00.647548 10743 log.cc:927] Time spent T f4b8bd455d5a47c18a1380839c6e0d61 P b7ab4784c7344b939bc36f639286f377: Append to log took a long time: real 0.135s	user 0.001s	sys 0.000s
I20260709 13:20:00.557801 10568 raft_consensus.cc:697] T be1a92657f494cac8dd227d152f50151 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 13 LEADER]: Becoming Leader. State: Replica: 7ba59cc884714e8aa5f3f0ecaed84cbb, State: Running, Role: LEADER
W20260709 13:20:00.648379 10619 consensus_meta.cc:287] T dbdf895bba214ff68685a24fd17dfb5d P cd75a17ab2604397adab03bb8b5fd75c: Time spent flushing consensus metadata: real 1.167s	user 0.003s	sys 0.011s
I20260709 13:20:00.528365 10547 raft_consensus.cc:515] T 713b5728a197487c9300b310ab94e5a3 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
W20260709 13:20:00.649260 10737 log.cc:927] Time spent T bd6869f07b5a4885a0b99fbe60c3b175 P b7ab4784c7344b939bc36f639286f377: Append to log took a long time: real 0.168s	user 0.000s	sys 0.001s
I20260709 13:20:00.649019 10619 raft_consensus.cc:515] T dbdf895bba214ff68685a24fd17dfb5d P cd75a17ab2604397adab03bb8b5fd75c [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:00.650843  6878 raft_consensus.cc:2393] T dbdf895bba214ff68685a24fd17dfb5d P cd75a17ab2604397adab03bb8b5fd75c [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7ab4784c7344b939bc36f639286f377 in current term 10: Already voted for candidate cd75a17ab2604397adab03bb8b5fd75c in this term.
I20260709 13:20:00.651235 10547 leader_election.cc:290] T 713b5728a197487c9300b310ab94e5a3 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
W20260709 13:20:00.593648 10732 log.cc:927] Time spent T 3a485a995abc4807b6e511e45419f737 P b7ab4784c7344b939bc36f639286f377: Append to log took a long time: real 0.393s	user 0.001s	sys 0.001s
I20260709 13:20:00.534433 10703 raft_consensus.cc:515] T 1bf4668eeb70467fb3dc5a0289233b3c P b7ab4784c7344b939bc36f639286f377 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:00.655426 10703 leader_election.cc:290] T 1bf4668eeb70467fb3dc5a0289233b3c P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:00.612618 10738 raft_consensus.cc:3060] T 7ba5dac66ab5497e9e336f2a3c28cda5 P cd75a17ab2604397adab03bb8b5fd75c [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:20:00.658989 10704 leader_election.cc:290] T 853ac0a8cbd64ce99457f170216d4d0f P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:20:00.664595 10618 raft_consensus.cc:3060] T 07a92dd554674067a83a9cb68c4773f2 P cd75a17ab2604397adab03bb8b5fd75c [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:20:00.665210 10626 consensus_queue.cc:1175] T 07a92dd554674067a83a9cb68c4773f2 P cd75a17ab2604397adab03bb8b5fd75c [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" responder_term: 10 status { last_received { term: 8 index: 4 } last_committed_idx: 4 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer cd75a17ab2604397adab03bb8b5fd75c for earlier term 9. Current term is 10. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:20:00.614933 10725 raft_consensus.cc:493] T 7a734b5ab7834e05a8c422208acc58b1 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:20:00.666553 10725 raft_consensus.cc:515] T 7a734b5ab7834e05a8c422208acc58b1 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:00.585089 10575 raft_consensus.cc:2764] T 90d42e216d9741e190bca19a781291fd P cd75a17ab2604397adab03bb8b5fd75c [term 10 FOLLOWER]: Leader pre-election decision vote started in defunct term 9: won
I20260709 13:20:00.602029 10722 raft_consensus.cc:493] T 4f00a2e87e56452083b759f60d461ee3 P cd75a17ab2604397adab03bb8b5fd75c [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:00.668816 10722 raft_consensus.cc:3060] T 4f00a2e87e56452083b759f60d461ee3 P cd75a17ab2604397adab03bb8b5fd75c [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:20:00.565158 10727 raft_consensus.cc:515] T 7c44c4849aa54f2b94d1f1bef9ed546f P ccd8a4c3bfe3413cb2ae219b09aea832 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:00.657915 10619 leader_election.cc:290] T dbdf895bba214ff68685a24fd17dfb5d P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 10 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:20:00.671190 10727 leader_election.cc:290] T 7c44c4849aa54f2b94d1f1bef9ed546f P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:00.673759 10733 leader_election.cc:290] T f3f9c2e2bf644115957398fe4c9459db P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:20:00.674553 10708 raft_consensus.cc:3055] T be1a92657f494cac8dd227d152f50151 P b7ab4784c7344b939bc36f639286f377 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:20:00.675025 10708 raft_consensus.cc:740] T be1a92657f494cac8dd227d152f50151 P b7ab4784c7344b939bc36f639286f377 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
I20260709 13:20:00.580830 10713 consensus_queue.cc:260] T 711ef6523deb4cbe8ef2ba61e1c21c98 P b7ab4784c7344b939bc36f639286f377 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:00.644462  6844 leader_election.cc:304] T 4b8cacb381b746da8d0049b0a83b41dd P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:20:00.636713 10627 raft_consensus.cc:493] T 9b3759de40694069b13c0f8bd40e5709 P cd75a17ab2604397adab03bb8b5fd75c [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:00.646409 10747 raft_consensus.cc:3060] T 713b5728a197487c9300b310ab94e5a3 P cd75a17ab2604397adab03bb8b5fd75c [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:20:00.664690 10617 leader_election.cc:290] T 30e88460611e47b2ba16a46a30b5f416 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:20:00.692350 10387 leader_election.cc:290] T 1bf4668eeb70467fb3dc5a0289233b3c P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:20:00.648955 10568 consensus_queue.cc:237] T be1a92657f494cac8dd227d152f50151 P 7ba59cc884714e8aa5f3f0ecaed84cbb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:20:00.687489 10627 raft_consensus.cc:515] T 9b3759de40694069b13c0f8bd40e5709 P cd75a17ab2604397adab03bb8b5fd75c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:00.683339  6875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a75bfe094d4bdc963aba3f08dfcd25" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 11 candidate_status { last_received { term: 10 index: 4 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:20:00.697779  6875 raft_consensus.cc:3060] T 95a75bfe094d4bdc963aba3f08dfcd25 P cd75a17ab2604397adab03bb8b5fd75c [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:20:00.678503 10713 raft_consensus.cc:3060] T 711ef6523deb4cbe8ef2ba61e1c21c98 P b7ab4784c7344b939bc36f639286f377 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:20:00.701567 10649 leader_election.cc:290] T f4b8bd455d5a47c18a1380839c6e0d61 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
W20260709 13:20:00.701795  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 57440.1us
I20260709 13:20:00.702284 10649 raft_consensus.cc:2749] T 4b8cacb381b746da8d0049b0a83b41dd P cd75a17ab2604397adab03bb8b5fd75c [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:20:00.703264  6844 leader_election.cc:400] T 07a92dd554674067a83a9cb68c4773f2 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 9 election: Vote denied by peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391) with higher term. Message: Invalid argument: T 07a92dd554674067a83a9cb68c4773f2 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c for earlier term 9. Current term is 10.
I20260709 13:20:00.676012 10708 consensus_queue.cc:260] T be1a92657f494cac8dd227d152f50151 P b7ab4784c7344b939bc36f639286f377 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:20:00.705860 10708 raft_consensus.cc:3060] T be1a92657f494cac8dd227d152f50151 P b7ab4784c7344b939bc36f639286f377 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:00.706032 10602 leader_election.cc:290] T 8c7f33e544204fbaac4078e3e83bbf4e P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 8 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:00.707063 10723 leader_election.cc:290] T 7a734b5ab7834e05a8c422208acc58b1 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
W20260709 13:20:00.707666 10739 log.cc:927] Time spent T be1a92657f494cac8dd227d152f50151 P b7ab4784c7344b939bc36f639286f377: Append to log took a long time: real 0.403s	user 0.000s	sys 0.001s
I20260709 13:20:00.686770 10537 leader_election.cc:290] T 34f36d59d88f40fe8a2805e604fc6c0a P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:00.671797 10727 raft_consensus.cc:493] T 4d9def8b32fd443aa94ab1420b06837b P ccd8a4c3bfe3413cb2ae219b09aea832 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:00.627879 10580 raft_consensus.cc:3060] T a1704639a875409b9959353527b3fd68 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:20:00.710284  6844 leader_election.cc:304] T a1704639a875409b9959353527b3fd68 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377
I20260709 13:20:00.624449  6881 raft_consensus.cc:2468] T ab432e62819d499eaaf3dd55481dd930 P cd75a17ab2604397adab03bb8b5fd75c [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 12.
I20260709 13:20:00.780877  6881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09c2a98de1a4decabd0ff900dd44caa" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:00.782416  6881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4db81d9d329422bb3b4160ca4ac2d1d" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:00.634071 10755 raft_consensus.cc:493] T ab432e62819d499eaaf3dd55481dd930 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:00.783638 10755 raft_consensus.cc:515] T ab432e62819d499eaaf3dd55481dd930 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:00.786816 10755 leader_election.cc:290] T ab432e62819d499eaaf3dd55481dd930 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:00.585711 10734 raft_consensus.cc:515] T dbdf895bba214ff68685a24fd17dfb5d P ccd8a4c3bfe3413cb2ae219b09aea832 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:00.790419  6881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c240553ce044eedb41541d72b9475d7" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:20:00.791000  6881 raft_consensus.cc:3060] T 2c240553ce044eedb41541d72b9475d7 P cd75a17ab2604397adab03bb8b5fd75c [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:20:00.792524  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 82524.7us
I20260709 13:20:00.794095  6844 leader_election.cc:304] T 9e326172347f45e99a0d482b5d8ef768 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377
I20260709 13:20:00.612149 10711 raft_consensus.cc:515] T 3d65025eea89441290d85dd053810e31 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
W20260709 13:20:00.728407 10707 consensus_meta.cc:287] T e77e330a82df4b43a745d57a68f6f057 P cd75a17ab2604397adab03bb8b5fd75c: Time spent flushing consensus metadata: real 0.977s	user 0.014s	sys 0.000s
W20260709 13:20:00.728742 10561 consensus_meta.cc:287] T dbdf895bba214ff68685a24fd17dfb5d P b7ab4784c7344b939bc36f639286f377: Time spent flushing consensus metadata: real 0.516s	user 0.003s	sys 0.008s
I20260709 13:20:00.626772 10421 raft_consensus.cc:515] T f58dc08b12a2494bb9a1372837970ca2 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:00.850600  6881 raft_consensus.cc:2468] T 2c240553ce044eedb41541d72b9475d7 P cd75a17ab2604397adab03bb8b5fd75c [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 12.
W20260709 13:20:00.856873  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 62913.7us
I20260709 13:20:00.861745  6844 leader_election.cc:304] T b56bf91d90824c959e21e0cee5ba1816 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377
W20260709 13:20:00.788128  7466 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 237429us
I20260709 13:20:00.811264 10445 raft_consensus.cc:2749] T 17587d6730594da4a56fa13a353232a1 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:20:00.776163 10537 raft_consensus.cc:493] T 7c37d41cd9164c15a6826ca62a851a69 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:00.669096 10725 leader_election.cc:290] T 7a734b5ab7834e05a8c422208acc58b1 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:00.817674  6697 leader_election.cc:304] T 3fa34c08b205435dba97346991aa1f92 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, cd75a17ab2604397adab03bb8b5fd75c
W20260709 13:20:00.884440  6697 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.68:45071, user_credentials={real_user=slave}} blocked reactor thread for 66893.2us
I20260709 13:20:00.864590 10649 raft_consensus.cc:2804] T b56bf91d90824c959e21e0cee5ba1816 P cd75a17ab2604397adab03bb8b5fd75c [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:20:00.865690  6844 leader_election.cc:304] T 3411566abe2d4c9bb4b2adfdd05e6f17 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377
I20260709 13:20:00.863530  6881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3022224cc81473690653a83d4e99470" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:00.867316 10560 leader_election.cc:290] T d8292e16e5654be6bc408560cf256aaa P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
W20260709 13:20:00.875643 10746 log.cc:927] Time spent T 1528ab62b6fe4e3099d08f141afee116 P ccd8a4c3bfe3413cb2ae219b09aea832: Append to log took a long time: real 0.323s	user 0.000s	sys 0.001s
I20260709 13:20:00.807380 10387 raft_consensus.cc:2804] T a1704639a875409b9959353527b3fd68 P cd75a17ab2604397adab03bb8b5fd75c [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:20:00.817775 10755 raft_consensus.cc:493] T 3a485a995abc4807b6e511e45419f737 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:00.884614  7495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17587d6730594da4a56fa13a353232a1" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb"
I20260709 13:20:00.897188  7500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe20b4b48823486ca3b9c648db6ce8aa" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
W20260709 13:20:00.830907  6846 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:00.790087 10727 raft_consensus.cc:515] T 4d9def8b32fd443aa94ab1420b06837b P ccd8a4c3bfe3413cb2ae219b09aea832 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:00.885627  6881 raft_consensus.cc:2468] T a3022224cc81473690653a83d4e99470 P cd75a17ab2604397adab03bb8b5fd75c [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 11.
I20260709 13:20:00.890400  6697 leader_election.cc:304] T 404190ce4ce94cecbfcb6ea9d1dd8626 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, b7ab4784c7344b939bc36f639286f377
W20260709 13:20:00.892025  6696 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.529s	user 0.005s	sys 0.012s
W20260709 13:20:00.909998  6696 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.547s	user 0.006s	sys 0.012s
I20260709 13:20:00.910223  6881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "711ef6523deb4cbe8ef2ba61e1c21c98" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:20:00.910795  6881 raft_consensus.cc:3060] T 711ef6523deb4cbe8ef2ba61e1c21c98 P cd75a17ab2604397adab03bb8b5fd75c [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:20:00.888386  6875 raft_consensus.cc:2468] T 95a75bfe094d4bdc963aba3f08dfcd25 P cd75a17ab2604397adab03bb8b5fd75c [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 11.
I20260709 13:20:00.876835 10723 raft_consensus.cc:2804] T 9e326172347f45e99a0d482b5d8ef768 P cd75a17ab2604397adab03bb8b5fd75c [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:20:00.900072  6880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f03d0dbf16864ca4bc1bb5e4c0334c0f" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:20:00.915143  7466 leader_election.cc:304] T 3fa34c08b205435dba97346991aa1f92 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
I20260709 13:20:00.871788 10580 raft_consensus.cc:515] T a1704639a875409b9959353527b3fd68 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:00.888275 10649 raft_consensus.cc:493] T b56bf91d90824c959e21e0cee5ba1816 P cd75a17ab2604397adab03bb8b5fd75c [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:00.917999  6881 raft_consensus.cc:2468] T 711ef6523deb4cbe8ef2ba61e1c21c98 P cd75a17ab2604397adab03bb8b5fd75c [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 11.
I20260709 13:20:00.857057 10561 raft_consensus.cc:515] T dbdf895bba214ff68685a24fd17dfb5d P b7ab4784c7344b939bc36f639286f377 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:00.936416  6880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c7f33e544204fbaac4078e3e83bbf4e" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:00.889714 10650 raft_consensus.cc:493] T d8cee0accdb8499c86d4414b72565a38 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:20:00.919100  6881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d33d5ee8ef6f415593d8df52063161ad" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:00.940124  6881 raft_consensus.cc:2468] T d33d5ee8ef6f415593d8df52063161ad P cd75a17ab2604397adab03bb8b5fd75c [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 10.
I20260709 13:20:00.919509  6877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e31b9971c15848dea59d4d4130141d9e" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:00.893546 10699 raft_consensus.cc:2749] T 3fa34c08b205435dba97346991aa1f92 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:20:00.849306 10707 raft_consensus.cc:515] T e77e330a82df4b43a745d57a68f6f057 P cd75a17ab2604397adab03bb8b5fd75c [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } }
I20260709 13:20:00.938575  6725 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f09c2a98de1a4decabd0ff900dd44caa"
dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
mode: GRACEFUL
new_leader_uuid: "b7ab4784c7344b939bc36f639286f377"
 from {username='slave'} at 127.0.0.1:38536
I20260709 13:20:00.951632  6725 raft_consensus.cc:606] T f09c2a98de1a4decabd0ff900dd44caa P ccd8a4c3bfe3413cb2ae219b09aea832 [term 12 FOLLOWER]: Received request to transfer leadership to TS b7ab4784c7344b939bc36f639286f377
I20260709 13:20:00.941075  6877 raft_consensus.cc:2468] T e31b9971c15848dea59d4d4130141d9e P cd75a17ab2604397adab03bb8b5fd75c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 7.
I20260709 13:20:00.944459  6875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22ccee1b570c4ad3a57bd7aec085b1b4" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:00.953042  6875 raft_consensus.cc:2468] T 22ccee1b570c4ad3a57bd7aec085b1b4 P cd75a17ab2604397adab03bb8b5fd75c [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 8.
I20260709 13:20:00.950261  6881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe20b4b48823486ca3b9c648db6ce8aa" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:00.888886 10537 raft_consensus.cc:515] T 7c37d41cd9164c15a6826ca62a851a69 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:00.937361  6880 raft_consensus.cc:2468] T 8c7f33e544204fbaac4078e3e83bbf4e P cd75a17ab2604397adab03bb8b5fd75c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 7.
I20260709 13:20:00.898159 10387 raft_consensus.cc:493] T a1704639a875409b9959353527b3fd68 P cd75a17ab2604397adab03bb8b5fd75c [term 10 FOLLOWER]: Starting leader election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
W20260709 13:20:00.946278  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 80652.2us
W20260709 13:20:00.917743 10418 consensus_meta.cc:287] T 2c240553ce044eedb41541d72b9475d7 P b7ab4784c7344b939bc36f639286f377: Time spent flushing consensus metadata: real 0.718s	user 0.009s	sys 0.005s
I20260709 13:20:00.952143  6725 raft_consensus.cc:614] T f09c2a98de1a4decabd0ff900dd44caa P ccd8a4c3bfe3413cb2ae219b09aea832 [term 12 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:20:00.914093 10723 raft_consensus.cc:493] T 9e326172347f45e99a0d482b5d8ef768 P cd75a17ab2604397adab03bb8b5fd75c [term 8 FOLLOWER]: Starting leader election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:20:00.913599 10755 raft_consensus.cc:515] T 3a485a995abc4807b6e511e45419f737 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:00.917209 10627 leader_election.cc:290] T 9b3759de40694069b13c0f8bd40e5709 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:20:00.936205 10445 consensus_queue.cc:1048] T b3f13b31a1f84f0d89d007eadd57924c P 7ba59cc884714e8aa5f3f0ecaed84cbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.067s
I20260709 13:20:00.914191 10571 raft_consensus.cc:2749] T 404190ce4ce94cecbfcb6ea9d1dd8626 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:20:00.956086  6880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3411566abe2d4c9bb4b2adfdd05e6f17" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:01.011610 10580 leader_election.cc:290] T a1704639a875409b9959353527b3fd68 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 11 election: Requested vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:01.033346  6880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34f36d59d88f40fe8a2805e604fc6c0a" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:01.006649 10738 raft_consensus.cc:515] T 7ba5dac66ab5497e9e336f2a3c28cda5 P cd75a17ab2604397adab03bb8b5fd75c [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:20:01.034778  6880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de3186201e1a40d0b335eeb8b4e256e0" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:20:00.952773 10733 raft_consensus.cc:2804] T 3411566abe2d4c9bb4b2adfdd05e6f17 P cd75a17ab2604397adab03bb8b5fd75c [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:20:00.953286 10765 raft_consensus.cc:2804] T 3fa34c08b205435dba97346991aa1f92 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:20:00.990804  6875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a92dd554674067a83a9cb68c4773f2" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
W20260709 13:20:01.044934 10766 log.cc:927] Time spent T d8292e16e5654be6bc408560cf256aaa P ccd8a4c3bfe3413cb2ae219b09aea832: Append to log took a long time: real 0.126s	user 0.001s	sys 0.000s
I20260709 13:20:01.045459  6806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3022224cc81473690653a83d4e99470" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:01.035763 10733 raft_consensus.cc:493] T 3411566abe2d4c9bb4b2adfdd05e6f17 P cd75a17ab2604397adab03bb8b5fd75c [term 8 FOLLOWER]: Starting leader election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:20:01.044975  6799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a92dd554674067a83a9cb68c4773f2" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:01.046340 10733 raft_consensus.cc:3060] T 3411566abe2d4c9bb4b2adfdd05e6f17 P cd75a17ab2604397adab03bb8b5fd75c [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:20:01.047430  6803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e31b9971c15848dea59d4d4130141d9e" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:00.951098 10650 raft_consensus.cc:515] T d8cee0accdb8499c86d4414b72565a38 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:20:01.051405 10650 leader_election.cc:290] T d8cee0accdb8499c86d4414b72565a38 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:00.918840 10649 raft_consensus.cc:3060] T b56bf91d90824c959e21e0cee5ba1816 P cd75a17ab2604397adab03bb8b5fd75c [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:20:01.051981 10418 raft_consensus.cc:515] T 2c240553ce044eedb41541d72b9475d7 P b7ab4784c7344b939bc36f639286f377 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:01.052950 10711 leader_election.cc:290] T 3d65025eea89441290d85dd053810e31 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:01.027369 10537 leader_election.cc:290] T 7c37d41cd9164c15a6826ca62a851a69 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:01.053798  6805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22ccee1b570c4ad3a57bd7aec085b1b4" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:01.054183 10418 leader_election.cc:290] T 2c240553ce044eedb41541d72b9475d7 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 12 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:01.054811 10723 raft_consensus.cc:3060] T 9e326172347f45e99a0d482b5d8ef768 P cd75a17ab2604397adab03bb8b5fd75c [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:20:01.056874 10421 leader_election.cc:290] T f58dc08b12a2494bb9a1372837970ca2 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:01.043954 10765 raft_consensus.cc:493] T 3fa34c08b205435dba97346991aa1f92 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 11 FOLLOWER]: Starting leader election (detected failure of leader cd75a17ab2604397adab03bb8b5fd75c)
I20260709 13:20:01.057598 10765 raft_consensus.cc:3060] T 3fa34c08b205435dba97346991aa1f92 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:20:01.058595  6806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4db81d9d329422bb3b4160ca4ac2d1d" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:01.060606  6803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3411566abe2d4c9bb4b2adfdd05e6f17" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:01.060968 10738 leader_election.cc:290] T 7ba5dac66ab5497e9e336f2a3c28cda5 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 11 election: Requested vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:20:01.035760 10387 raft_consensus.cc:3060] T a1704639a875409b9959353527b3fd68 P cd75a17ab2604397adab03bb8b5fd75c [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:20:01.061759 10534 raft_consensus.cc:3055] T 4275cf08e63345f993bce8664eada830 P b7ab4784c7344b939bc36f639286f377 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:20:01.062211 10534 raft_consensus.cc:740] T 4275cf08e63345f993bce8664eada830 P b7ab4784c7344b939bc36f639286f377 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
I20260709 13:20:01.063218  7502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ba5dac66ab5497e9e336f2a3c28cda5" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb"
I20260709 13:20:01.063084 10534 consensus_queue.cc:260] T 4275cf08e63345f993bce8664eada830 P b7ab4784c7344b939bc36f639286f377 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 5, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:01.064288  6875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a734b5ab7834e05a8c422208acc58b1" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:01.065018  6875 raft_consensus.cc:2468] T 7a734b5ab7834e05a8c422208acc58b1 P cd75a17ab2604397adab03bb8b5fd75c [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 9.
W20260709 13:20:01.065240  6770 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 947565us
I20260709 13:20:01.065994  6770 leader_election.cc:304] T 853ac0a8cbd64ce99457f170216d4d0f P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:20:00.954900  6881 raft_consensus.cc:2468] T fe20b4b48823486ca3b9c648db6ce8aa P cd75a17ab2604397adab03bb8b5fd75c [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 8.
I20260709 13:20:01.035343  6880 raft_consensus.cc:3060] T de3186201e1a40d0b335eeb8b4e256e0 P cd75a17ab2604397adab03bb8b5fd75c [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:20:01.072270  6770 leader_election.cc:304] T 30e88460611e47b2ba16a46a30b5f416 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:20:00.991680  6697 leader_election.cc:304] T 2c240553ce044eedb41541d72b9475d7 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:20:01.079402  6803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c240553ce044eedb41541d72b9475d7" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:20:00.953847  6877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c44c4849aa54f2b94d1f1bef9ed546f" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:00.975131  6844 leader_election.cc:304] T f09c2a98de1a4decabd0ff900dd44caa P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:20:01.084777  6803 raft_consensus.cc:2393] T 2c240553ce044eedb41541d72b9475d7 P b7ab4784c7344b939bc36f639286f377 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate ccd8a4c3bfe3413cb2ae219b09aea832 in current term 12: Already voted for candidate b7ab4784c7344b939bc36f639286f377 in this term.
I20260709 13:20:01.066013  6875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "713b5728a197487c9300b310ab94e5a3" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
W20260709 13:20:01.084712  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 109698us
I20260709 13:20:01.017865 10706 raft_consensus.cc:3055] T 95a75bfe094d4bdc963aba3f08dfcd25 P b7ab4784c7344b939bc36f639286f377 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:20:01.096602 10760 raft_consensus.cc:2804] T 2c240553ce044eedb41541d72b9475d7 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:20:01.096726 10706 raft_consensus.cc:740] T 95a75bfe094d4bdc963aba3f08dfcd25 P b7ab4784c7344b939bc36f639286f377 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
I20260709 13:20:01.097261 10760 raft_consensus.cc:697] T 2c240553ce044eedb41541d72b9475d7 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 12 LEADER]: Becoming Leader. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
I20260709 13:20:01.097287  6799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c7f33e544204fbaac4078e3e83bbf4e" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:01.098268  6799 raft_consensus.cc:2393] T 8c7f33e544204fbaac4078e3e83bbf4e P b7ab4784c7344b939bc36f639286f377 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ccd8a4c3bfe3413cb2ae219b09aea832 in current term 8: Already voted for candidate b7ab4784c7344b939bc36f639286f377 in this term.
I20260709 13:20:01.097960 10706 consensus_queue.cc:260] T 95a75bfe094d4bdc963aba3f08dfcd25 P b7ab4784c7344b939bc36f639286f377 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 10.4, Last appended by leader: 4, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
W20260709 13:20:01.098886 10761 log.cc:927] Time spent T f09c2a98de1a4decabd0ff900dd44caa P cd75a17ab2604397adab03bb8b5fd75c: Append to log took a long time: real 0.051s	user 0.000s	sys 0.001s
I20260709 13:20:01.099767  6799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09c2a98de1a4decabd0ff900dd44caa" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:01.090178 10447 raft_consensus.cc:2749] T 30e88460611e47b2ba16a46a30b5f416 P b7ab4784c7344b939bc36f639286f377 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:20:01.099661 10706 raft_consensus.cc:3060] T 95a75bfe094d4bdc963aba3f08dfcd25 P b7ab4784c7344b939bc36f639286f377 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:20:01.090884  6697 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 99181.8us
I20260709 13:20:01.092006  6806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d33d5ee8ef6f415593d8df52063161ad" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:01.108445  6697 leader_election.cc:304] T a3022224cc81473690653a83d4e99470 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:20:01.108665  6877 raft_consensus.cc:1240] T 24ee15416e3145beaa1b8183453729a3 P cd75a17ab2604397adab03bb8b5fd75c [term 11 FOLLOWER]: Rejecting Update request from peer ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 10. Current term is 11. Ops: []
I20260709 13:20:01.106141  6844 leader_election.cc:400] T 3a485a995abc4807b6e511e45419f737 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 8 pre-election: Vote denied by peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391) with higher term. Message: Invalid argument: T 3a485a995abc4807b6e511e45419f737 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c for earlier term 8. Current term is 9.
I20260709 13:20:01.110584  6844 leader_election.cc:403] T 3a485a995abc4807b6e511e45419f737 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 8 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:20:01.112985  6877 raft_consensus.cc:1275] T 9b3759de40694069b13c0f8bd40e5709 P cd75a17ab2604397adab03bb8b5fd75c [term 10 FOLLOWER]: Refusing update from remote peer ccd8a4c3bfe3413cb2ae219b09aea832: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
W20260709 13:20:01.091190 10557 consensus_meta.cc:287] T 404190ce4ce94cecbfcb6ea9d1dd8626 P b7ab4784c7344b939bc36f639286f377: Time spent flushing consensus metadata: real 0.860s	user 0.008s	sys 0.004s
I20260709 13:20:01.100294 10738 raft_consensus.cc:2749] T f09c2a98de1a4decabd0ff900dd44caa P cd75a17ab2604397adab03bb8b5fd75c [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:20:01.121327  6877 raft_consensus.cc:1240] T e77e330a82df4b43a745d57a68f6f057 P cd75a17ab2604397adab03bb8b5fd75c [term 13 FOLLOWER]: Rejecting Update request from peer ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 12. Current term is 13. Ops: [12.6-12.6]
I20260709 13:20:01.112669  6844 leader_election.cc:304] T 2c240553ce044eedb41541d72b9475d7 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:20:01.085711 10524 raft_consensus.cc:2804] T 853ac0a8cbd64ce99457f170216d4d0f P b7ab4784c7344b939bc36f639286f377 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 13:20:01.113334  6770 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:01.116972  6697 leader_election.cc:304] T 95a75bfe094d4bdc963aba3f08dfcd25 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377
I20260709 13:20:01.134580  6880 raft_consensus.cc:2468] T de3186201e1a40d0b335eeb8b4e256e0 P cd75a17ab2604397adab03bb8b5fd75c [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 11.
I20260709 13:20:01.144371  6844 leader_election.cc:304] T 7887766dc6784fcaa42b35c05fea7a99 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377
I20260709 13:20:01.146368  6844 leader_election.cc:304] T d33d5ee8ef6f415593d8df52063161ad P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
W20260709 13:20:01.110322 10063 consensus_meta.cc:287] T 20f6842e26174571996b8dea4151d4be P b7ab4784c7344b939bc36f639286f377: Time spent flushing consensus metadata: real 0.855s	user 0.011s	sys 0.002s
I20260709 13:20:01.147926 10063 raft_consensus.cc:2749] T 20f6842e26174571996b8dea4151d4be P b7ab4784c7344b939bc36f639286f377 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:20:01.141599 10699 raft_consensus.cc:2804] T a3022224cc81473690653a83d4e99470 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:20:01.148757 10699 raft_consensus.cc:493] T a3022224cc81473690653a83d4e99470 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:01.149246 10699 raft_consensus.cc:3060] T a3022224cc81473690653a83d4e99470 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:20:01.149406 10747 raft_consensus.cc:2749] T 713b5728a197487c9300b310ab94e5a3 P cd75a17ab2604397adab03bb8b5fd75c [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:20:01.149998 10752 raft_consensus.cc:2804] T 7887766dc6784fcaa42b35c05fea7a99 P cd75a17ab2604397adab03bb8b5fd75c [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:20:01.150496 10752 raft_consensus.cc:493] T 7887766dc6784fcaa42b35c05fea7a99 P cd75a17ab2604397adab03bb8b5fd75c [term 10 FOLLOWER]: Starting leader election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:20:01.150876 10752 raft_consensus.cc:3060] T 7887766dc6784fcaa42b35c05fea7a99 P cd75a17ab2604397adab03bb8b5fd75c [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:20:01.152266  6875 raft_consensus.cc:2468] T 713b5728a197487c9300b310ab94e5a3 P cd75a17ab2604397adab03bb8b5fd75c [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 11.
I20260709 13:20:01.155284  6697 leader_election.cc:304] T 711ef6523deb4cbe8ef2ba61e1c21c98 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377
I20260709 13:20:01.156083  6803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4275cf08e63345f993bce8664eada830" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:20:01.156424  6697 leader_election.cc:304] T f03d0dbf16864ca4bc1bb5e4c0334c0f P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:20:01.157447  6697 leader_election.cc:304] T d33d5ee8ef6f415593d8df52063161ad P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:20:01.145426 10524 raft_consensus.cc:493] T 853ac0a8cbd64ce99457f170216d4d0f P b7ab4784c7344b939bc36f639286f377 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:01.159373 10762 raft_consensus.cc:2804] T 95a75bfe094d4bdc963aba3f08dfcd25 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:20:01.160101 10727 leader_election.cc:290] T 4d9def8b32fd443aa94ab1420b06837b P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:01.164513  6799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab432e62819d499eaaf3dd55481dd930" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:20:01.165382  6799 raft_consensus.cc:2368] T ab432e62819d499eaaf3dd55481dd930 P b7ab4784c7344b939bc36f639286f377 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c for earlier term 11. Current term is 12.
I20260709 13:20:01.151379 10621 raft_consensus.cc:2749] T 2c240553ce044eedb41541d72b9475d7 P cd75a17ab2604397adab03bb8b5fd75c [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:20:01.168152  6844 leader_election.cc:304] T fe20b4b48823486ca3b9c648db6ce8aa P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, ccd8a4c3bfe3413cb2ae219b09aea832
W20260709 13:20:01.170262  7466 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 237345us
I20260709 13:20:01.170305  6807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5be3a11b23d4ea9b08300a2789821c7" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:01.171777  6807 raft_consensus.cc:2468] T f5be3a11b23d4ea9b08300a2789821c7 P b7ab4784c7344b939bc36f639286f377 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 8.
I20260709 13:20:01.114349 10734 leader_election.cc:290] T dbdf895bba214ff68685a24fd17dfb5d P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:01.172961  6799 raft_consensus.cc:1275] T 9b3759de40694069b13c0f8bd40e5709 P b7ab4784c7344b939bc36f639286f377 [term 10 FOLLOWER]: Refusing update from remote peer ccd8a4c3bfe3413cb2ae219b09aea832: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:20:01.115792 10534 raft_consensus.cc:3060] T 4275cf08e63345f993bce8664eada830 P b7ab4784c7344b939bc36f639286f377 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:20:01.173738  6697 leader_election.cc:304] T e31b9971c15848dea59d4d4130141d9e P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:20:01.114217 10627 raft_consensus.cc:2749] T 3a485a995abc4807b6e511e45419f737 P cd75a17ab2604397adab03bb8b5fd75c [term 9 FOLLOWER]: Leader pre-election lost for term 8. Reason: Vote denied by peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391) with higher term. Message: Invalid argument: T 3a485a995abc4807b6e511e45419f737 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c for earlier term 8. Current term is 9.
W20260709 13:20:01.178408  7466 leader_election.cc:336] T bb3d8792045a4583ae2e965b1350a5b4 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Timed out: RequestConsensusVote RPC to 127.5.126.65:44391 timed out after 1.797s (SENT)
W20260709 13:20:01.153085 10160 consensus_meta.cc:287] T 9e326172347f45e99a0d482b5d8ef768 P b7ab4784c7344b939bc36f639286f377: Time spent flushing consensus metadata: real 0.917s	user 0.006s	sys 0.006s
I20260709 13:20:01.180544  6844 leader_election.cc:304] T 711ef6523deb4cbe8ef2ba61e1c21c98 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:20:01.115667 10557 raft_consensus.cc:515] T 404190ce4ce94cecbfcb6ea9d1dd8626 P b7ab4784c7344b939bc36f639286f377 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:20:01.109501 10418 consensus_queue.cc:1048] T 90d42e216d9741e190bca19a781291fd P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.067s
I20260709 13:20:01.181746  7466 leader_election.cc:304] T bb3d8792045a4583ae2e965b1350a5b4 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
W20260709 13:20:01.176451 10722 consensus_meta.cc:287] T 4f00a2e87e56452083b759f60d461ee3 P cd75a17ab2604397adab03bb8b5fd75c: Time spent flushing consensus metadata: real 0.507s	user 0.011s	sys 0.000s
I20260709 13:20:01.202088 10571 raft_consensus.cc:2804] T e31b9971c15848dea59d4d4130141d9e P ccd8a4c3bfe3413cb2ae219b09aea832 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:20:01.202608 10571 raft_consensus.cc:493] T e31b9971c15848dea59d4d4130141d9e P ccd8a4c3bfe3413cb2ae219b09aea832 [term 7 FOLLOWER]: Starting leader election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:20:01.202838 10589 raft_consensus.cc:2749] T bb3d8792045a4583ae2e965b1350a5b4 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:20:01.203023 10571 raft_consensus.cc:3060] T e31b9971c15848dea59d4d4130141d9e P ccd8a4c3bfe3413cb2ae219b09aea832 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:20:01.098294 10760 consensus_queue.cc:237] T 2c240553ce044eedb41541d72b9475d7 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
W20260709 13:20:01.205277 10767 log.cc:927] Time spent T 34f36d59d88f40fe8a2805e604fc6c0a P cd75a17ab2604397adab03bb8b5fd75c: Append to log took a long time: real 0.242s	user 0.001s	sys 0.000s
I20260709 13:20:01.189284  6697 leader_election.cc:304] T 22ccee1b570c4ad3a57bd7aec085b1b4 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:20:01.206401  6725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3f13b31a1f84f0d89d007eadd57924c" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:20:01.159449 10524 raft_consensus.cc:3060] T 853ac0a8cbd64ce99457f170216d4d0f P b7ab4784c7344b939bc36f639286f377 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:20:01.207166  6725 raft_consensus.cc:2376] T b3f13b31a1f84f0d89d007eadd57924c P ccd8a4c3bfe3413cb2ae219b09aea832 [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in term 9. Re-sending same reply.
I20260709 13:20:01.208868  6697 leader_election.cc:304] T 8c7f33e544204fbaac4078e3e83bbf4e P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:20:01.179203 10421 raft_consensus.cc:2749] T f03d0dbf16864ca4bc1bb5e4c0334c0f P ccd8a4c3bfe3413cb2ae219b09aea832 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:20:01.180220 10537 raft_consensus.cc:2804] T 711ef6523deb4cbe8ef2ba61e1c21c98 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:20:01.175161 10704 raft_consensus.cc:2804] T d33d5ee8ef6f415593d8df52063161ad P cd75a17ab2604397adab03bb8b5fd75c [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:20:01.223862  6697 leader_election.cc:304] T 7a734b5ab7834e05a8c422208acc58b1 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:20:01.229509  7500 raft_consensus.cc:1240] T 24ee15416e3145beaa1b8183453729a3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 11 FOLLOWER]: Rejecting Update request from peer ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 10. Current term is 11. Ops: []
I20260709 13:20:01.230602 10557 leader_election.cc:290] T 404190ce4ce94cecbfcb6ea9d1dd8626 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 12 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:20:01.230912 10755 leader_election.cc:290] T 3a485a995abc4807b6e511e45419f737 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
W20260709 13:20:01.232563 10713 consensus_meta.cc:287] T 711ef6523deb4cbe8ef2ba61e1c21c98 P b7ab4784c7344b939bc36f639286f377: Time spent flushing consensus metadata: real 0.534s	user 0.000s	sys 0.011s
I20260709 13:20:01.233189 10734 raft_consensus.cc:2804] T 8c7f33e544204fbaac4078e3e83bbf4e P ccd8a4c3bfe3413cb2ae219b09aea832 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:20:01.234229  6875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ba5dac66ab5497e9e336f2a3c28cda5" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:01.246768  6875 raft_consensus.cc:2393] T 7ba5dac66ab5497e9e336f2a3c28cda5 P cd75a17ab2604397adab03bb8b5fd75c [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in current term 11: Already voted for candidate cd75a17ab2604397adab03bb8b5fd75c in this term.
W20260709 13:20:01.187427 10735 consensus_meta.cc:287] T b56bf91d90824c959e21e0cee5ba1816 P ccd8a4c3bfe3413cb2ae219b09aea832: Time spent flushing consensus metadata: real 0.658s	user 0.007s	sys 0.005s
I20260709 13:20:01.239995  6807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "713b5728a197487c9300b310ab94e5a3" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:01.180426 10649 raft_consensus.cc:515] T b56bf91d90824c959e21e0cee5ba1816 P cd75a17ab2604397adab03bb8b5fd75c [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
W20260709 13:20:01.244911 10698 consensus_meta.cc:287] T e77e330a82df4b43a745d57a68f6f057 P b7ab4784c7344b939bc36f639286f377: Time spent flushing consensus metadata: real 0.684s	user 0.013s	sys 0.001s
I20260709 13:20:01.188921 10580 raft_consensus.cc:493] T 44bde925b2e541b69890d70715b85176 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:20:01.174059 10387 raft_consensus.cc:515] T a1704639a875409b9959353527b3fd68 P cd75a17ab2604397adab03bb8b5fd75c [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
W20260709 13:20:01.252753 10700 consensus_meta.cc:287] T 9e326172347f45e99a0d482b5d8ef768 P ccd8a4c3bfe3413cb2ae219b09aea832: Time spent flushing consensus metadata: real 1.055s	user 0.001s	sys 0.013s
I20260709 13:20:01.206176 10762 raft_consensus.cc:697] T 95a75bfe094d4bdc963aba3f08dfcd25 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 11 LEADER]: Becoming Leader. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
I20260709 13:20:01.239065  6697 leader_election.cc:304] T fe20b4b48823486ca3b9c648db6ce8aa P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
W20260709 13:20:01.313970  6697 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 75064.7us
I20260709 13:20:01.247558 10537 raft_consensus.cc:697] T 711ef6523deb4cbe8ef2ba61e1c21c98 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 11 LEADER]: Becoming Leader. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
I20260709 13:20:01.253203  6807 raft_consensus.cc:2468] T 713b5728a197487c9300b310ab94e5a3 P b7ab4784c7344b939bc36f639286f377 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 11.
I20260709 13:20:01.181710 10711 raft_consensus.cc:2804] T d33d5ee8ef6f415593d8df52063161ad P ccd8a4c3bfe3413cb2ae219b09aea832 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:20:01.254606  6875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ba5dac66ab5497e9e336f2a3c28cda5" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:01.202090 10722 raft_consensus.cc:515] T 4f00a2e87e56452083b759f60d461ee3 P cd75a17ab2604397adab03bb8b5fd75c [term 11 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
W20260709 13:20:01.258502 10769 log.cc:927] Time spent T be1a92657f494cac8dd227d152f50151 P 7ba59cc884714e8aa5f3f0ecaed84cbb: Append to log took a long time: real 0.105s	user 0.000s	sys 0.000s
I20260709 13:20:01.321650  6801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c44c4849aa54f2b94d1f1bef9ed546f" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:01.226552 10727 raft_consensus.cc:2804] T 22ccee1b570c4ad3a57bd7aec085b1b4 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:20:01.182402 10575 raft_consensus.cc:2749] T fe20b4b48823486ca3b9c648db6ce8aa P cd75a17ab2604397adab03bb8b5fd75c [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:20:01.269424  6880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fa34c08b205435dba97346991aa1f92" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:01.238336 10704 raft_consensus.cc:493] T d33d5ee8ef6f415593d8df52063161ad P cd75a17ab2604397adab03bb8b5fd75c [term 10 FOLLOWER]: Starting leader election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:20:01.189600 10160 raft_consensus.cc:515] T 9e326172347f45e99a0d482b5d8ef768 P b7ab4784c7344b939bc36f639286f377 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:01.245867 10367 raft_consensus.cc:2804] T 7a734b5ab7834e05a8c422208acc58b1 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:20:01.233301 10707 leader_election.cc:290] T e77e330a82df4b43a745d57a68f6f057 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 13 election: Requested vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391)
I20260709 13:20:01.189284 10621 raft_consensus.cc:2749] T 711ef6523deb4cbe8ef2ba61e1c21c98 P cd75a17ab2604397adab03bb8b5fd75c [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:20:01.249414 10734 raft_consensus.cc:493] T 8c7f33e544204fbaac4078e3e83bbf4e P ccd8a4c3bfe3413cb2ae219b09aea832 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:01.251521  6799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a734b5ab7834e05a8c422208acc58b1" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:01.316075  6876 raft_consensus.cc:1240] T b56bf91d90824c959e21e0cee5ba1816 P cd75a17ab2604397adab03bb8b5fd75c [term 10 FOLLOWER]: Rejecting Update request from peer b7ab4784c7344b939bc36f639286f377 for earlier term 9. Current term is 10. Ops: [9.6-9.6]
I20260709 13:20:01.315765  6697 leader_election.cc:304] T de3186201e1a40d0b335eeb8b4e256e0 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377
I20260709 13:20:01.318380  6875 raft_consensus.cc:2393] T 7ba5dac66ab5497e9e336f2a3c28cda5 P cd75a17ab2604397adab03bb8b5fd75c [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in current term 11: Already voted for candidate cd75a17ab2604397adab03bb8b5fd75c in this term.
I20260709 13:20:01.325703  6880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b8cacb381b746da8d0049b0a83b41dd" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:01.334889  6880 raft_consensus.cc:2393] T 4b8cacb381b746da8d0049b0a83b41dd P cd75a17ab2604397adab03bb8b5fd75c [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in current term 10: Already voted for candidate cd75a17ab2604397adab03bb8b5fd75c in this term.
I20260709 13:20:01.317919 10711 raft_consensus.cc:493] T d33d5ee8ef6f415593d8df52063161ad P ccd8a4c3bfe3413cb2ae219b09aea832 [term 10 FOLLOWER]: Starting leader election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:20:01.259258 10735 raft_consensus.cc:515] T b56bf91d90824c959e21e0cee5ba1816 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:01.319705 10421 raft_consensus.cc:2804] T fe20b4b48823486ca3b9c648db6ce8aa P ccd8a4c3bfe3413cb2ae219b09aea832 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:20:01.325685 10704 raft_consensus.cc:3060] T d33d5ee8ef6f415593d8df52063161ad P cd75a17ab2604397adab03bb8b5fd75c [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:20:01.347062  6880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8cee0accdb8499c86d4414b72565a38" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:01.335603  6697 leader_election.cc:304] T 713b5728a197487c9300b310ab94e5a3 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:20:01.310879 10580 raft_consensus.cc:515] T 44bde925b2e541b69890d70715b85176 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:01.322203 10758 consensus_queue.cc:1048] T 9b3759de40694069b13c0f8bd40e5709 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.027s
I20260709 13:20:01.350189 10547 raft_consensus.cc:3055] T 4b8cacb381b746da8d0049b0a83b41dd P ccd8a4c3bfe3413cb2ae219b09aea832 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:20:01.350504 10547 raft_consensus.cc:740] T 4b8cacb381b746da8d0049b0a83b41dd P ccd8a4c3bfe3413cb2ae219b09aea832 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
I20260709 13:20:01.351218 10547 consensus_queue.cc:260] T 4b8cacb381b746da8d0049b0a83b41dd P ccd8a4c3bfe3413cb2ae219b09aea832 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:20:01.351454 10580 leader_election.cc:290] T 44bde925b2e541b69890d70715b85176 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:01.347025 10421 raft_consensus.cc:493] T fe20b4b48823486ca3b9c648db6ce8aa P ccd8a4c3bfe3413cb2ae219b09aea832 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 7ba59cc884714e8aa5f3f0ecaed84cbb)
I20260709 13:20:01.352785 10421 raft_consensus.cc:3060] T fe20b4b48823486ca3b9c648db6ce8aa P ccd8a4c3bfe3413cb2ae219b09aea832 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:20:01.352872 10762 consensus_queue.cc:237] T 95a75bfe094d4bdc963aba3f08dfcd25 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 10.4, Last appended by leader: 4, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:01.341039 10725 raft_consensus.cc:2804] T de3186201e1a40d0b335eeb8b4e256e0 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:20:01.340886 10696 consensus_queue.cc:1059] T e77e330a82df4b43a745d57a68f6f057 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: INVALID_TERM, Last received: 11.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:20:01.331986  6801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34f36d59d88f40fe8a2805e604fc6c0a" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:01.323426 10727 raft_consensus.cc:493] T 22ccee1b570c4ad3a57bd7aec085b1b4 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 8 FOLLOWER]: Starting leader election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:20:01.355530 10727 raft_consensus.cc:3060] T 22ccee1b570c4ad3a57bd7aec085b1b4 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:20:01.289443 10698 raft_consensus.cc:515] T e77e330a82df4b43a745d57a68f6f057 P b7ab4784c7344b939bc36f639286f377 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } }
I20260709 13:20:01.348021  6880 raft_consensus.cc:2468] T d8cee0accdb8499c86d4414b72565a38 P cd75a17ab2604397adab03bb8b5fd75c [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in term 9.
I20260709 13:20:01.349247  6881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24ee15416e3145beaa1b8183453729a3" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 11 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:20:01.352162 10547 raft_consensus.cc:3060] T 4b8cacb381b746da8d0049b0a83b41dd P ccd8a4c3bfe3413cb2ae219b09aea832 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:20:01.327804 10367 raft_consensus.cc:493] T 7a734b5ab7834e05a8c422208acc58b1 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 9 FOLLOWER]: Starting leader election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:20:01.340700 10734 raft_consensus.cc:3060] T 8c7f33e544204fbaac4078e3e83bbf4e P ccd8a4c3bfe3413cb2ae219b09aea832 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:20:01.319983 10755 consensus_queue.cc:1059] T 24ee15416e3145beaa1b8183453729a3 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.025s
I20260709 13:20:01.356940  6875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b8cacb381b746da8d0049b0a83b41dd" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:01.381867  6875 raft_consensus.cc:2393] T 4b8cacb381b746da8d0049b0a83b41dd P cd75a17ab2604397adab03bb8b5fd75c [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in current term 10: Already voted for candidate cd75a17ab2604397adab03bb8b5fd75c in this term.
I20260709 13:20:01.317101 10700 raft_consensus.cc:515] T 9e326172347f45e99a0d482b5d8ef768 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:01.361573  6801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab432e62819d499eaaf3dd55481dd930" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
W20260709 13:20:01.363015 10708 consensus_meta.cc:287] T be1a92657f494cac8dd227d152f50151 P b7ab4784c7344b939bc36f639286f377: Time spent flushing consensus metadata: real 0.657s	user 0.009s	sys 0.005s
I20260709 13:20:01.391093  6801 raft_consensus.cc:2393] T ab432e62819d499eaaf3dd55481dd930 P b7ab4784c7344b939bc36f639286f377 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ccd8a4c3bfe3413cb2ae219b09aea832 in current term 12: Already voted for candidate b7ab4784c7344b939bc36f639286f377 in this term.
I20260709 13:20:01.392154  6806 raft_consensus.cc:1240] T e77e330a82df4b43a745d57a68f6f057 P b7ab4784c7344b939bc36f639286f377 [term 13 FOLLOWER]: Rejecting Update request from peer ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 12. Current term is 13. Ops: [12.6-12.6]
I20260709 13:20:01.363216 10696 raft_consensus.cc:3055] T e77e330a82df4b43a745d57a68f6f057 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:20:01.364404 10723 raft_consensus.cc:515] T 9e326172347f45e99a0d482b5d8ef768 P cd75a17ab2604397adab03bb8b5fd75c [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:01.365252  6725 raft_consensus.cc:1275] T be1a92657f494cac8dd227d152f50151 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 13 FOLLOWER]: Refusing update from remote peer 7ba59cc884714e8aa5f3f0ecaed84cbb: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:20:01.365397 10580 raft_consensus.cc:2804] T 713b5728a197487c9300b310ab94e5a3 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:20:01.418457 10580 raft_consensus.cc:493] T 713b5728a197487c9300b310ab94e5a3 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:01.419080 10580 raft_consensus.cc:3060] T 713b5728a197487c9300b310ab94e5a3 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:20:01.359757 10725 raft_consensus.cc:697] T de3186201e1a40d0b335eeb8b4e256e0 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 11 LEADER]: Becoming Leader. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
I20260709 13:20:01.422281  6697 leader_election.cc:304] T 17587d6730594da4a56fa13a353232a1 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, b7ab4784c7344b939bc36f639286f377
I20260709 13:20:01.421985 10725 consensus_queue.cc:237] T de3186201e1a40d0b335eeb8b4e256e0 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:01.423604 10776 raft_consensus.cc:2749] T 17587d6730594da4a56fa13a353232a1 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:20:01.365949  6879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab432e62819d499eaaf3dd55481dd930" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:01.368727 10699 raft_consensus.cc:515] T a3022224cc81473690653a83d4e99470 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:01.427803  6879 raft_consensus.cc:2393] T ab432e62819d499eaaf3dd55481dd930 P cd75a17ab2604397adab03bb8b5fd75c [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ccd8a4c3bfe3413cb2ae219b09aea832 in current term 12: Already voted for candidate b7ab4784c7344b939bc36f639286f377 in this term.
W20260709 13:20:01.369009 10741 log.cc:927] Time spent T ce4f062dcd314d43a63ca74067cb5ee3 P b7ab4784c7344b939bc36f639286f377: Append to log took a long time: real 0.837s	user 0.003s	sys 0.004s
I20260709 13:20:01.369114  5625 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:20:01.429153  6879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44bde925b2e541b69890d70715b85176" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:01.370709 10160 leader_election.cc:290] T 9e326172347f45e99a0d482b5d8ef768 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 10 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:01.370836  6877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d65025eea89441290d85dd053810e31" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:01.345878 10711 raft_consensus.cc:3060] T d33d5ee8ef6f415593d8df52063161ad P ccd8a4c3bfe3413cb2ae219b09aea832 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:20:01.373339  6881 raft_consensus.cc:2393] T 24ee15416e3145beaa1b8183453729a3 P cd75a17ab2604397adab03bb8b5fd75c [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in current term 11: Already voted for candidate cd75a17ab2604397adab03bb8b5fd75c in this term.
I20260709 13:20:01.431896  6877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c37d41cd9164c15a6826ca62a851a69" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:01.432163  6881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f58dc08b12a2494bb9a1372837970ca2" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:01.432643  6877 raft_consensus.cc:2468] T 7c37d41cd9164c15a6826ca62a851a69 P cd75a17ab2604397adab03bb8b5fd75c [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 9.
I20260709 13:20:01.433254  6881 raft_consensus.cc:2468] T f58dc08b12a2494bb9a1372837970ca2 P cd75a17ab2604397adab03bb8b5fd75c [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 12.
I20260709 13:20:01.433962  6877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1704639a875409b9959353527b3fd68" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:20:01.434497  6881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b56bf91d90824c959e21e0cee5ba1816" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:20:01.392669 10735 leader_election.cc:290] T b56bf91d90824c959e21e0cee5ba1816 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 10 election: Requested vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:01.435585 10735 raft_consensus.cc:493] T 90d42e216d9741e190bca19a781291fd P ccd8a4c3bfe3413cb2ae219b09aea832 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:01.379240 10537 consensus_queue.cc:237] T 711ef6523deb4cbe8ef2ba61e1c21c98 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:01.415004 10696 raft_consensus.cc:740] T e77e330a82df4b43a745d57a68f6f057 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
I20260709 13:20:01.380667 10387 leader_election.cc:290] T a1704639a875409b9959353527b3fd68 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 11 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:20:01.443472  6799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1704639a875409b9959353527b3fd68" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:20:01.430253  6879 raft_consensus.cc:2468] T 44bde925b2e541b69890d70715b85176 P cd75a17ab2604397adab03bb8b5fd75c [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 10.
I20260709 13:20:01.434857  6877 raft_consensus.cc:2393] T a1704639a875409b9959353527b3fd68 P cd75a17ab2604397adab03bb8b5fd75c [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate ccd8a4c3bfe3413cb2ae219b09aea832 in current term 11: Already voted for candidate cd75a17ab2604397adab03bb8b5fd75c in this term.
I20260709 13:20:01.371752 10621 raft_consensus.cc:493] T bb7fa124c3bf4ef9ab65a407cb008441 P cd75a17ab2604397adab03bb8b5fd75c [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 7ba59cc884714e8aa5f3f0ecaed84cbb)
I20260709 13:20:01.447187  6801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbdf895bba214ff68685a24fd17dfb5d" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 10 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:01.429054 10699 leader_election.cc:290] T a3022224cc81473690653a83d4e99470 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 12 election: Requested vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:01.381057 10367 raft_consensus.cc:3060] T 7a734b5ab7834e05a8c422208acc58b1 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:20:01.397493 10731 consensus_meta.cc:287] T f3f9c2e2bf644115957398fe4c9459db P ccd8a4c3bfe3413cb2ae219b09aea832: Time spent flushing consensus metadata: real 0.714s	user 0.008s	sys 0.004s
I20260709 13:20:01.439451 10649 leader_election.cc:290] T b56bf91d90824c959e21e0cee5ba1816 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 10 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:20:01.437464  6875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a485a995abc4807b6e511e45419f737" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:01.436179 10735 raft_consensus.cc:515] T 90d42e216d9741e190bca19a781291fd P ccd8a4c3bfe3413cb2ae219b09aea832 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:01.445518  6881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3022224cc81473690653a83d4e99470" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:20:01.384181 10733 raft_consensus.cc:515] T 3411566abe2d4c9bb4b2adfdd05e6f17 P cd75a17ab2604397adab03bb8b5fd75c [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:01.447564  6880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d9def8b32fd443aa94ab1420b06837b" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 11 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:01.448289  6801 raft_consensus.cc:2393] T dbdf895bba214ff68685a24fd17dfb5d P b7ab4784c7344b939bc36f639286f377 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ccd8a4c3bfe3413cb2ae219b09aea832 in current term 10: Already voted for candidate b7ab4784c7344b939bc36f639286f377 in this term.
I20260709 13:20:01.451545  6799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c37d41cd9164c15a6826ca62a851a69" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:01.459702 10723 leader_election.cc:290] T 9e326172347f45e99a0d482b5d8ef768 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 9 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:20:01.462021  6807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d65025eea89441290d85dd053810e31" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:01.464092 10770 consensus_queue.cc:1048] T b3f13b31a1f84f0d89d007eadd57924c P 7ba59cc884714e8aa5f3f0ecaed84cbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.006s
W20260709 13:20:01.472064 10742 log.cc:927] Time spent T 404190ce4ce94cecbfcb6ea9d1dd8626 P ccd8a4c3bfe3413cb2ae219b09aea832: Append to log took a long time: real 0.910s	user 0.000s	sys 0.006s
I20260709 13:20:01.472888 10700 leader_election.cc:290] T 9e326172347f45e99a0d482b5d8ef768 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 10 election: Requested vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:01.473815  6724 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49744 (request call id 345) took 1720 ms. Trace:
I20260709 13:20:01.474329  6724 rpcz_store.cc:276] 0709 13:19:59.752953 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:59.816322 (+ 63369us) service_pool.cc:224] Handling call
0709 13:19:59.823761 (+  7439us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:59.976451 (+152690us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:59.976497 (+    46us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:59.977245 (+   748us) log.cc:844] Serialized 26 byte log entry
0709 13:20:00.200940 (+223695us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:20:00.200981 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:00.201054 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:01.471291 (+1270237us) spinlock_profiling.cc:243] Waited 5.46 ms on lock 0x7b4400022b4c. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0c745db1 00007fcc0c7e3c85 00007fcc0c7e46a2 00007fcc0f5561db 00007fcc0f551aaf 00007fcc0f54586e 00007fcc0f544bb6 00007fcc0f5447d8 00007fcc0f54e221 00007fcc0f54e1d9 00007fcc0f54e169
0709 13:20:01.473388 (+  2097us) raft_consensus.cc:1685] finished
0709 13:20:01.473420 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:01.473713 (+   293us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4386,"raft.queue_time_us":75716,"raft.run_cpu_time_us":98,"raft.run_wall_time_us":98,"spinlock_wait_cycles":12565760,"thread_start_us":248568,"threads_started":2,"wal-append.queue_time_us":195538}
I20260709 13:20:01.439389  6697 leader_election.cc:304] T 7c37d41cd9164c15a6826ca62a851a69 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:20:01.456511  6881 raft_consensus.cc:3060] T a3022224cc81473690653a83d4e99470 P cd75a17ab2604397adab03bb8b5fd75c [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:20:01.454177  6875 raft_consensus.cc:2468] T 3a485a995abc4807b6e511e45419f737 P cd75a17ab2604397adab03bb8b5fd75c [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 9.
I20260709 13:20:01.477844  6697 leader_election.cc:304] T f58dc08b12a2494bb9a1372837970ca2 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:20:01.464113 10696 consensus_queue.cc:260] T e77e330a82df4b43a745d57a68f6f057 P ccd8a4c3bfe3413cb2ae219b09aea832 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 12.6, Last appended by leader: 6, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } }
I20260709 13:20:01.480086 10696 raft_consensus.cc:3060] T e77e330a82df4b43a745d57a68f6f057 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:20:01.483434  6728 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49744 (request call id 350) took 1547 ms (client timeout 1797 ms). Trace:
W20260709 13:20:01.483932  6728 rpcz_store.cc:269] 0709 13:19:59.936302 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:59.968281 (+ 31979us) service_pool.cc:224] Handling call
0709 13:20:01.483242 (+1514961us) spinlock_profiling.cc:243] Waited 229 ms on lock 0x7b54000e4a54. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f9ae2fa 00007fcc1496fb17 00007fcc0deea6d4 00007fcc0deea662 00007fcc0deea591 00007fcc0deea50c 00007fcc0dee97c2 00007fcc0dce548c 00007fcc0dce48c6 00007fcc0dce426f
0709 13:20:01.483364 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":526502656}
W20260709 13:20:01.485330 10618 consensus_meta.cc:287] T 07a92dd554674067a83a9cb68c4773f2 P cd75a17ab2604397adab03bb8b5fd75c: Time spent flushing consensus metadata: real 0.820s	user 0.012s	sys 0.000s
I20260709 13:20:01.485652 10699 raft_consensus.cc:2804] T f58dc08b12a2494bb9a1372837970ca2 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 13:20:01.485749  6878 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53406 (request call id 1968) took 2347 ms (client timeout 1754 ms). Trace:
I20260709 13:20:01.486168 10699 raft_consensus.cc:493] T f58dc08b12a2494bb9a1372837970ca2 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 12 FOLLOWER]: Starting leader election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:20:01.446821 10776 consensus_queue.cc:1059] T 24ee15416e3145beaa1b8183453729a3 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.040s
I20260709 13:20:01.486743 10699 raft_consensus.cc:3060] T f58dc08b12a2494bb9a1372837970ca2 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:01.488111 10698 leader_election.cc:290] T e77e330a82df4b43a745d57a68f6f057 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 13 election: Requested vote from peers cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931), ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391)
I20260709 13:20:01.489156  6873 raft_consensus.cc:1275] T 07a92dd554674067a83a9cb68c4773f2 P cd75a17ab2604397adab03bb8b5fd75c [term 10 FOLLOWER]: Refusing update from remote peer b7ab4784c7344b939bc36f639286f377: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 10 index: 5. (term mismatch)
I20260709 13:20:01.489578  6873 pending_rounds.cc:85] T 07a92dd554674067a83a9cb68c4773f2 P cd75a17ab2604397adab03bb8b5fd75c: Aborting all ops after (but not including) 4
I20260709 13:20:01.489816  6873 pending_rounds.cc:107] T 07a92dd554674067a83a9cb68c4773f2 P cd75a17ab2604397adab03bb8b5fd75c: Aborting uncommitted NO_OP operation due to leader change: 9.5
I20260709 13:20:01.490113  6873 raft_consensus.cc:2889] T 07a92dd554674067a83a9cb68c4773f2 P cd75a17ab2604397adab03bb8b5fd75c [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:20:01.391932 10571 raft_consensus.cc:515] T e31b9971c15848dea59d4d4130141d9e P ccd8a4c3bfe3413cb2ae219b09aea832 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:01.474640 10752 raft_consensus.cc:515] T 7887766dc6784fcaa42b35c05fea7a99 P cd75a17ab2604397adab03bb8b5fd75c [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:01.492699 10571 leader_election.cc:290] T e31b9971c15848dea59d4d4130141d9e P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 8 election: Requested vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:01.396195 10765 raft_consensus.cc:515] T 3fa34c08b205435dba97346991aa1f92 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:20:01.454245 10731 raft_consensus.cc:515] T f3f9c2e2bf644115957398fe4c9459db P ccd8a4c3bfe3413cb2ae219b09aea832 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:01.495306 10765 leader_election.cc:290] T 3fa34c08b205435dba97346991aa1f92 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 12 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:01.450527 10621 raft_consensus.cc:515] T bb7fa124c3bf4ef9ab65a407cb008441 P cd75a17ab2604397adab03bb8b5fd75c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:20:01.496762  7502 raft_consensus.cc:1240] T 3fa34c08b205435dba97346991aa1f92 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 12 FOLLOWER]: Rejecting Update request from peer cd75a17ab2604397adab03bb8b5fd75c for earlier term 11. Current term is 12. Ops: []
I20260709 13:20:01.496963 10731 leader_election.cc:290] T f3f9c2e2bf644115957398fe4c9459db P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 10 election: Requested vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:01.497514  6802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d9def8b32fd443aa94ab1420b06837b" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 11 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:01.499745  6799 raft_consensus.cc:1275] T 1bf4668eeb70467fb3dc5a0289233b3c P b7ab4784c7344b939bc36f639286f377 [term 10 FOLLOWER]: Refusing update from remote peer ccd8a4c3bfe3413cb2ae219b09aea832: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:20:01.500183  6802 raft_consensus.cc:2468] T 4d9def8b32fd443aa94ab1420b06837b P b7ab4784c7344b939bc36f639286f377 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 10.
W20260709 13:20:01.486330  6878 rpcz_store.cc:269] 0709 13:19:59.138597 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:59.170539 (+ 31942us) service_pool.cc:224] Handling call
0709 13:20:01.485522 (+2314983us) spinlock_profiling.cc:243] Waited 1.39 s on lock 0x7b540042a754. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f9ae2fa 00007fcc1496fb17 00007fcc0deea6d4 00007fcc0deea662 00007fcc0deea591 00007fcc0deea50c 00007fcc0dee97c2 00007fcc0dce548c 00007fcc0dce48c6 00007fcc0dce426f
0709 13:20:01.485665 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3201163648}
I20260709 13:20:01.499152 10733 leader_election.cc:290] T 3411566abe2d4c9bb4b2adfdd05e6f17 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 9 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
W20260709 13:20:01.498066  6846 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:01.485384  6880 raft_consensus.cc:2410] T 4d9def8b32fd443aa94ab1420b06837b P cd75a17ab2604397adab03bb8b5fd75c [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ccd8a4c3bfe3413cb2ae219b09aea832 for term 11 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 4.
I20260709 13:20:01.445665  6879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbdf895bba214ff68685a24fd17dfb5d" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 10 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:01.504812  6802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a485a995abc4807b6e511e45419f737" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:01.506280  6879 raft_consensus.cc:2393] T dbdf895bba214ff68685a24fd17dfb5d P cd75a17ab2604397adab03bb8b5fd75c [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ccd8a4c3bfe3413cb2ae219b09aea832 in current term 10: Already voted for candidate cd75a17ab2604397adab03bb8b5fd75c in this term.
I20260709 13:20:01.506731  6881 raft_consensus.cc:2468] T a3022224cc81473690653a83d4e99470 P cd75a17ab2604397adab03bb8b5fd75c [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 12.
I20260709 13:20:01.507191  6878 raft_consensus.cc:1275] T f5be3a11b23d4ea9b08300a2789821c7 P cd75a17ab2604397adab03bb8b5fd75c [term 8 FOLLOWER]: Refusing update from remote peer ccd8a4c3bfe3413cb2ae219b09aea832: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:20:01.515182  6619 maintenance_manager.cc:419] P b3ae52d33b9a4273a42e5e2cf3b5d6b5: Scheduling FlushMRSOp(00000000000000000000000000000000): perf score=0.033381
I20260709 13:20:01.515552  6878 raft_consensus.cc:1240] T e77e330a82df4b43a745d57a68f6f057 P cd75a17ab2604397adab03bb8b5fd75c [term 13 FOLLOWER]: Rejecting Update request from peer ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 12. Current term is 13. Ops: [12.6-12.6]
I20260709 13:20:01.505115  6697 leader_election.cc:304] T 44bde925b2e541b69890d70715b85176 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
W20260709 13:20:01.509874 10778 log.cc:927] Time spent T de3186201e1a40d0b335eeb8b4e256e0 P ccd8a4c3bfe3413cb2ae219b09aea832: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260709 13:20:01.510025  6876 raft_consensus.cc:1240] T f4b8bd455d5a47c18a1380839c6e0d61 P cd75a17ab2604397adab03bb8b5fd75c [term 9 FOLLOWER]: Rejecting Update request from peer ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 8. Current term is 9. Ops: []
I20260709 13:20:01.511533  6875 raft_consensus.cc:1275] T d8292e16e5654be6bc408560cf256aaa P cd75a17ab2604397adab03bb8b5fd75c [term 13 FOLLOWER]: Refusing update from remote peer ccd8a4c3bfe3413cb2ae219b09aea832: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:20:01.512246  6801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f58dc08b12a2494bb9a1372837970ca2" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:01.510043 10487 raft_consensus.cc:3055] T 7c37d41cd9164c15a6826ca62a851a69 P b7ab4784c7344b939bc36f639286f377 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:20:01.518494 10777 raft_consensus.cc:2804] T 44bde925b2e541b69890d70715b85176 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:20:01.518936 10487 raft_consensus.cc:740] T 7c37d41cd9164c15a6826ca62a851a69 P b7ab4784c7344b939bc36f639286f377 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
I20260709 13:20:01.519064 10777 raft_consensus.cc:493] T 44bde925b2e541b69890d70715b85176 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 10 FOLLOWER]: Starting leader election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:20:01.519654 10777 raft_consensus.cc:3060] T 44bde925b2e541b69890d70715b85176 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:20:01.520130 10487 consensus_queue.cc:260] T 7c37d41cd9164c15a6826ca62a851a69 P b7ab4784c7344b939bc36f639286f377 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:01.526432  6799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44bde925b2e541b69890d70715b85176" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:01.529449 10775 raft_consensus.cc:3055] T 24ee15416e3145beaa1b8183453729a3 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:20:01.529520 10711 raft_consensus.cc:515] T d33d5ee8ef6f415593d8df52063161ad P ccd8a4c3bfe3413cb2ae219b09aea832 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:01.530239 10775 raft_consensus.cc:740] T 24ee15416e3145beaa1b8183453729a3 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
I20260709 13:20:01.500783 10752 leader_election.cc:290] T 7887766dc6784fcaa42b35c05fea7a99 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 11 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:20:01.544854  6798 raft_consensus.cc:1275] T d8292e16e5654be6bc408560cf256aaa P b7ab4784c7344b939bc36f639286f377 [term 13 FOLLOWER]: Refusing update from remote peer ccd8a4c3bfe3413cb2ae219b09aea832: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:20:01.545603  6800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3022224cc81473690653a83d4e99470" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:20:01.546442  6804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e326172347f45e99a0d482b5d8ef768" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:20:01.506105 10700 raft_consensus.cc:2804] T 7c37d41cd9164c15a6826ca62a851a69 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:20:01.547483  6799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b56bf91d90824c959e21e0cee5ba1816" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:20:01.530524  6807 raft_consensus.cc:1240] T 404190ce4ce94cecbfcb6ea9d1dd8626 P b7ab4784c7344b939bc36f639286f377 [term 12 FOLLOWER]: Rejecting Update request from peer 7ba59cc884714e8aa5f3f0ecaed84cbb for earlier term 11. Current term is 12. Ops: []
I20260709 13:20:01.486343 10735 leader_election.cc:290] T 90d42e216d9741e190bca19a781291fd P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:01.549906  6695 leader_election.cc:304] T 07a92dd554674067a83a9cb68c4773f2 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:20:01.560905  6798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90d42e216d9741e190bca19a781291fd" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:01.561630  6804 raft_consensus.cc:2393] T 9e326172347f45e99a0d482b5d8ef768 P b7ab4784c7344b939bc36f639286f377 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate ccd8a4c3bfe3413cb2ae219b09aea832 in current term 10: Already voted for candidate b7ab4784c7344b939bc36f639286f377 in this term.
I20260709 13:20:01.564993  6695 leader_election.cc:304] T c4db81d9d329422bb3b4160ca4ac2d1d P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:20:01.521651 10487 raft_consensus.cc:3060] T 7c37d41cd9164c15a6826ca62a851a69 P b7ab4784c7344b939bc36f639286f377 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:20:01.583843  6800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f9c2e2bf644115957398fe4c9459db" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:20:01.600979  6807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8cee0accdb8499c86d4414b72565a38" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:01.611799  6799 raft_consensus.cc:1240] T 20f6842e26174571996b8dea4151d4be P b7ab4784c7344b939bc36f639286f377 [term 12 FOLLOWER]: Rejecting Update request from peer ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 11. Current term is 12. Ops: [7.5-11.7]
I20260709 13:20:01.612360  6695 leader_election.cc:304] T 3411566abe2d4c9bb4b2adfdd05e6f17 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:20:01.581754 10770 consensus_queue.cc:1059] T 404190ce4ce94cecbfcb6ea9d1dd8626 P 7ba59cc884714e8aa5f3f0ecaed84cbb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.036s
I20260709 13:20:01.562529 10700 raft_consensus.cc:493] T 7c37d41cd9164c15a6826ca62a851a69 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:01.622284  6798 raft_consensus.cc:1275] T be1a92657f494cac8dd227d152f50151 P b7ab4784c7344b939bc36f639286f377 [term 13 FOLLOWER]: Refusing update from remote peer 7ba59cc884714e8aa5f3f0ecaed84cbb: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:20:01.522207 10525 raft_consensus.cc:493] T 1528ab62b6fe4e3099d08f141afee116 P b7ab4784c7344b939bc36f639286f377 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 7ba59cc884714e8aa5f3f0ecaed84cbb)
I20260709 13:20:01.562814 10447 raft_consensus.cc:493] T ce4f062dcd314d43a63ca74067cb5ee3 P b7ab4784c7344b939bc36f639286f377 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 7ba59cc884714e8aa5f3f0ecaed84cbb)
I20260709 13:20:01.555980 10421 raft_consensus.cc:515] T fe20b4b48823486ca3b9c648db6ce8aa P ccd8a4c3bfe3413cb2ae219b09aea832 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
W20260709 13:20:01.629868  6772 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:01.621287  6804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e31b9971c15848dea59d4d4130141d9e" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:20:01.646049  6695 leader_election.cc:304] T f09c2a98de1a4decabd0ff900dd44caa P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:20:01.559355 10524 raft_consensus.cc:515] T 853ac0a8cbd64ce99457f170216d4d0f P b7ab4784c7344b939bc36f639286f377 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
W20260709 13:20:01.632107 10706 consensus_meta.cc:287] T 95a75bfe094d4bdc963aba3f08dfcd25 P b7ab4784c7344b939bc36f639286f377: Time spent flushing consensus metadata: real 0.519s	user 0.011s	sys 0.001s
I20260709 13:20:01.654956  6695 leader_election.cc:304] T 7c44c4849aa54f2b94d1f1bef9ed546f P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:20:01.660782 10696 raft_consensus.cc:2749] T f09c2a98de1a4decabd0ff900dd44caa P ccd8a4c3bfe3413cb2ae219b09aea832 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:20:01.664237 10696 raft_consensus.cc:2749] T 7c44c4849aa54f2b94d1f1bef9ed546f P ccd8a4c3bfe3413cb2ae219b09aea832 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:20:01.665732 10692 consensus_queue.cc:260] T f4b8bd455d5a47c18a1380839c6e0d61 P ccd8a4c3bfe3413cb2ae219b09aea832 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:01.667089 10692 raft_consensus.cc:3060] T f4b8bd455d5a47c18a1380839c6e0d61 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:20:01.620869 10775 consensus_queue.cc:260] T 24ee15416e3145beaa1b8183453729a3 P ccd8a4c3bfe3413cb2ae219b09aea832 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:20:01.614171 10735 raft_consensus.cc:2749] T c4db81d9d329422bb3b4160ca4ac2d1d P ccd8a4c3bfe3413cb2ae219b09aea832 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:20:01.613838 10730 raft_consensus.cc:2749] T 07a92dd554674067a83a9cb68c4773f2 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:20:01.670667  6805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c240553ce044eedb41541d72b9475d7" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:01.681195  6805 raft_consensus.cc:2393] T 2c240553ce044eedb41541d72b9475d7 P b7ab4784c7344b939bc36f639286f377 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ccd8a4c3bfe3413cb2ae219b09aea832 in current term 12: Already voted for candidate b7ab4784c7344b939bc36f639286f377 in this term.
I20260709 13:20:01.672456  6695 leader_election.cc:304] T 34f36d59d88f40fe8a2805e604fc6c0a P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:20:01.649325 10731 raft_consensus.cc:2749] T 3411566abe2d4c9bb4b2adfdd05e6f17 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:20:01.669270 10775 raft_consensus.cc:3060] T 24ee15416e3145beaa1b8183453729a3 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:20:01.682901  6695 leader_election.cc:304] T ab432e62819d499eaaf3dd55481dd930 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:20:01.651206 10700 raft_consensus.cc:3060] T 7c37d41cd9164c15a6826ca62a851a69 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:20:01.684475  6803 raft_consensus.cc:2468] T 4275cf08e63345f993bce8664eada830 P b7ab4784c7344b939bc36f639286f377 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 11.
I20260709 13:20:01.688377  6695 leader_election.cc:304] T a1704639a875409b9959353527b3fd68 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:20:01.654976 10447 raft_consensus.cc:515] T ce4f062dcd314d43a63ca74067cb5ee3 P b7ab4784c7344b939bc36f639286f377 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } attrs { replace: true } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:20:01.717376 10447 leader_election.cc:290] T ce4f062dcd314d43a63ca74067cb5ee3 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:20:01.694507 10537 raft_consensus.cc:2749] T 34f36d59d88f40fe8a2805e604fc6c0a P ccd8a4c3bfe3413cb2ae219b09aea832 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:20:01.718628 10704 raft_consensus.cc:515] T d33d5ee8ef6f415593d8df52063161ad P cd75a17ab2604397adab03bb8b5fd75c [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:01.662148 10770 consensus_queue.cc:1048] T be1a92657f494cac8dd227d152f50151 P 7ba59cc884714e8aa5f3f0ecaed84cbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.054s
I20260709 13:20:01.731055  6695 leader_election.cc:304] T 3d65025eea89441290d85dd053810e31 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
W20260709 13:20:01.742367  6697 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:01.653625 10525 raft_consensus.cc:515] T 1528ab62b6fe4e3099d08f141afee116 P b7ab4784c7344b939bc36f639286f377 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:20:01.658330 10571 consensus_queue.cc:1048] T 9b3759de40694069b13c0f8bd40e5709 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.053s
I20260709 13:20:01.695086 10696 raft_consensus.cc:3060] T ab432e62819d499eaaf3dd55481dd930 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:20:01.751919  6695 leader_election.cc:304] T 4d9def8b32fd443aa94ab1420b06837b P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
I20260709 13:20:01.758008  6695 leader_election.cc:304] T b56bf91d90824c959e21e0cee5ba1816 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:20:01.759826 10704 leader_election.cc:290] T d33d5ee8ef6f415593d8df52063161ad P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 11 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:20:01.759800  6876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c7f33e544204fbaac4078e3e83bbf4e" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:20:01.760459  6872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bf4668eeb70467fb3dc5a0289233b3c" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:01.761015  6876 raft_consensus.cc:3060] T 8c7f33e544204fbaac4078e3e83bbf4e P cd75a17ab2604397adab03bb8b5fd75c [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:20:01.761050  6872 raft_consensus.cc:2468] T 1bf4668eeb70467fb3dc5a0289233b3c P cd75a17ab2604397adab03bb8b5fd75c [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 10.
I20260709 13:20:01.762778  6881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8292e16e5654be6bc408560cf256aaa" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:01.763417  6881 raft_consensus.cc:2468] T d8292e16e5654be6bc408560cf256aaa P cd75a17ab2604397adab03bb8b5fd75c [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 13.
I20260709 13:20:01.764662  7496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "404190ce4ce94cecbfcb6ea9d1dd8626" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb"
I20260709 13:20:01.743180 10730 raft_consensus.cc:2749] T a1704639a875409b9959353527b3fd68 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:20:01.746510 10731 raft_consensus.cc:2749] T 3d65025eea89441290d85dd053810e31 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:20:01.769309  6878 raft_consensus.cc:1240] T de3186201e1a40d0b335eeb8b4e256e0 P cd75a17ab2604397adab03bb8b5fd75c [term 11 FOLLOWER]: Rejecting Update request from peer b7ab4784c7344b939bc36f639286f377 for earlier term 10. Current term is 11. Ops: []
I20260709 13:20:01.772382  6881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c240553ce044eedb41541d72b9475d7" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:20:01.773180  6881 raft_consensus.cc:2393] T 2c240553ce044eedb41541d72b9475d7 P cd75a17ab2604397adab03bb8b5fd75c [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate b7ab4784c7344b939bc36f639286f377 in current term 12: Already voted for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in this term.
I20260709 13:20:01.776593  6878 raft_consensus.cc:1240] T d33d5ee8ef6f415593d8df52063161ad P cd75a17ab2604397adab03bb8b5fd75c [term 11 FOLLOWER]: Rejecting Update request from peer b7ab4784c7344b939bc36f639286f377 for earlier term 10. Current term is 11. Ops: []
I20260709 13:20:01.786917  7496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce4f062dcd314d43a63ca74067cb5ee3" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
W20260709 13:20:01.788641  6772 connection.cc:256] RPC call timeout handler was delayed by -1.0732069379998848s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1754s for a response
I20260709 13:20:01.790167  6802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d33d5ee8ef6f415593d8df52063161ad" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:20:01.764849 10735 raft_consensus.cc:2804] T 4d9def8b32fd443aa94ab1420b06837b P ccd8a4c3bfe3413cb2ae219b09aea832 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:20:01.792277 10735 raft_consensus.cc:493] T 4d9def8b32fd443aa94ab1420b06837b P ccd8a4c3bfe3413cb2ae219b09aea832 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:01.792886 10735 raft_consensus.cc:3060] T 4d9def8b32fd443aa94ab1420b06837b P ccd8a4c3bfe3413cb2ae219b09aea832 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:20:01.793668  6772 leader_election.cc:304] T bb7fa124c3bf4ef9ab65a407cb008441 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:20:01.795039  6772 leader_election.cc:304] T 4f00a2e87e56452083b759f60d461ee3 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, b7ab4784c7344b939bc36f639286f377; no voters: cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:20:01.795287 10713 raft_consensus.cc:2749] T bb7fa124c3bf4ef9ab65a407cb008441 P b7ab4784c7344b939bc36f639286f377 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:20:01.796293 10160 raft_consensus.cc:2804] T 4f00a2e87e56452083b759f60d461ee3 P b7ab4784c7344b939bc36f639286f377 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:20:01.797036 10160 raft_consensus.cc:493] T 4f00a2e87e56452083b759f60d461ee3 P b7ab4784c7344b939bc36f639286f377 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:01.797982 10160 raft_consensus.cc:3060] T 4f00a2e87e56452083b759f60d461ee3 P b7ab4784c7344b939bc36f639286f377 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:20:01.804960  6772 leader_election.cc:304] T ab432e62819d499eaaf3dd55481dd930 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:20:01.805892 10063 raft_consensus.cc:2804] T ab432e62819d499eaaf3dd55481dd930 P b7ab4784c7344b939bc36f639286f377 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:20:01.806463 10063 raft_consensus.cc:697] T ab432e62819d499eaaf3dd55481dd930 P b7ab4784c7344b939bc36f639286f377 [term 12 LEADER]: Becoming Leader. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
I20260709 13:20:01.807406 10063 consensus_queue.cc:237] T ab432e62819d499eaaf3dd55481dd930 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 5, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:01.809885 10722 leader_election.cc:290] T 4f00a2e87e56452083b759f60d461ee3 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 11 election: Requested vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:20:01.814204 10711 leader_election.cc:290] T d33d5ee8ef6f415593d8df52063161ad P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 11 election: Requested vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:01.763207 10770 raft_consensus.cc:493] T 427c124d773f483294511e80fe340075 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:20:01.815196 10770 raft_consensus.cc:515] T 427c124d773f483294511e80fe340075 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } attrs { replace: true } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:20:01.820598  6880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e326172347f45e99a0d482b5d8ef768" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:20:01.821519  6880 raft_consensus.cc:3060] T 9e326172347f45e99a0d482b5d8ef768 P cd75a17ab2604397adab03bb8b5fd75c [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:20:01.823765  6697 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:01.823765  6876 raft_consensus.cc:2468] T 8c7f33e544204fbaac4078e3e83bbf4e P cd75a17ab2604397adab03bb8b5fd75c [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 8.
I20260709 13:20:01.771129 10758 raft_consensus.cc:2749] T b56bf91d90824c959e21e0cee5ba1816 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:20:01.838371  6731 raft_consensus.cc:1240] T be1a92657f494cac8dd227d152f50151 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 13 FOLLOWER]: Rejecting Update request from peer b7ab4784c7344b939bc36f639286f377 for earlier term 12. Current term is 13. Ops: [12.10-12.10]
I20260709 13:20:01.840500  6723 raft_consensus.cc:1240] T de3186201e1a40d0b335eeb8b4e256e0 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 11 LEADER]: Rejecting Update request from peer b7ab4784c7344b939bc36f639286f377 for earlier term 10. Current term is 11. Ops: []
W20260709 13:20:01.841564  7468 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.5.126.67:42931 timed out after 1.678s (SENT) [suppressed 9 similar messages]
I20260709 13:20:01.764480 10591 consensus_queue.cc:1048] T 1bf4668eeb70467fb3dc5a0289233b3c P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.061s
I20260709 13:20:01.844177  6729 raft_consensus.cc:1275] T 07a92dd554674067a83a9cb68c4773f2 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 10 FOLLOWER]: Refusing update from remote peer b7ab4784c7344b939bc36f639286f377: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 10 index: 5. (index mismatch)
I20260709 13:20:01.764727 10751 consensus_queue.cc:1048] T d8292e16e5654be6bc408560cf256aaa P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.065s
I20260709 13:20:01.850329  6730 raft_consensus.cc:1240] T f3f9c2e2bf644115957398fe4c9459db P ccd8a4c3bfe3413cb2ae219b09aea832 [term 10 FOLLOWER]: Rejecting Update request from peer b7ab4784c7344b939bc36f639286f377 for earlier term 9. Current term is 10. Ops: [9.7-9.7]
I20260709 13:20:01.855321  6880 raft_consensus.cc:2468] T 9e326172347f45e99a0d482b5d8ef768 P cd75a17ab2604397adab03bb8b5fd75c [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 10.
I20260709 13:20:01.774266 10755 consensus_queue.cc:1059] T 20f6842e26174571996b8dea4151d4be P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.069s
I20260709 13:20:01.856738  6881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77e330a82df4b43a745d57a68f6f057" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:20:01.857463  6881 raft_consensus.cc:2393] T e77e330a82df4b43a745d57a68f6f057 P cd75a17ab2604397adab03bb8b5fd75c [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate b7ab4784c7344b939bc36f639286f377 in current term 13: Already voted for candidate cd75a17ab2604397adab03bb8b5fd75c in this term.
I20260709 13:20:01.862071  6876 raft_consensus.cc:1275] T bd6869f07b5a4885a0b99fbe60c3b175 P cd75a17ab2604397adab03bb8b5fd75c [term 11 FOLLOWER]: Refusing update from remote peer b7ab4784c7344b939bc36f639286f377: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 11 index: 5. (term mismatch)
I20260709 13:20:01.862520  6876 pending_rounds.cc:85] T bd6869f07b5a4885a0b99fbe60c3b175 P cd75a17ab2604397adab03bb8b5fd75c: Aborting all ops after (but not including) 4
I20260709 13:20:01.862802  6876 pending_rounds.cc:107] T bd6869f07b5a4885a0b99fbe60c3b175 P cd75a17ab2604397adab03bb8b5fd75c: Aborting uncommitted NO_OP operation due to leader change: 10.5
I20260709 13:20:01.863101  6876 raft_consensus.cc:2889] T bd6869f07b5a4885a0b99fbe60c3b175 P cd75a17ab2604397adab03bb8b5fd75c [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:20:01.868443 10534 consensus_queue.cc:1059] T b56bf91d90824c959e21e0cee5ba1816 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:20:01.869867 10534 raft_consensus.cc:3055] T b56bf91d90824c959e21e0cee5ba1816 P b7ab4784c7344b939bc36f639286f377 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:20:01.870301 10534 raft_consensus.cc:740] T b56bf91d90824c959e21e0cee5ba1816 P b7ab4784c7344b939bc36f639286f377 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
I20260709 13:20:01.785130 10727 raft_consensus.cc:515] T 22ccee1b570c4ad3a57bd7aec085b1b4 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:01.868489  6772 leader_election.cc:304] T 1bf4668eeb70467fb3dc5a0289233b3c P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:20:01.784669 10699 raft_consensus.cc:515] T f58dc08b12a2494bb9a1372837970ca2 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:01.881562  6872 raft_consensus.cc:1240] T a3022224cc81473690653a83d4e99470 P cd75a17ab2604397adab03bb8b5fd75c [term 12 FOLLOWER]: Rejecting Update request from peer b7ab4784c7344b939bc36f639286f377 for earlier term 11. Current term is 12. Ops: [11.6-11.6]
I20260709 13:20:01.882028  6881 raft_consensus.cc:1275] T 3a485a995abc4807b6e511e45419f737 P cd75a17ab2604397adab03bb8b5fd75c [term 9 FOLLOWER]: Refusing update from remote peer b7ab4784c7344b939bc36f639286f377: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:20:01.883424  6876 raft_consensus.cc:1240] T a1704639a875409b9959353527b3fd68 P cd75a17ab2604397adab03bb8b5fd75c [term 11 FOLLOWER]: Rejecting Update request from peer b7ab4784c7344b939bc36f639286f377 for earlier term 10. Current term is 11. Ops: []
I20260709 13:20:01.844148 10571 raft_consensus.cc:493] T 853ac0a8cbd64ce99457f170216d4d0f P ccd8a4c3bfe3413cb2ae219b09aea832 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:01.936331  6875 raft_consensus.cc:1275] T f4b8bd455d5a47c18a1380839c6e0d61 P cd75a17ab2604397adab03bb8b5fd75c [term 9 FOLLOWER]: Refusing update from remote peer b7ab4784c7344b939bc36f639286f377: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:20:01.896191  6880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce4f062dcd314d43a63ca74067cb5ee3" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
W20260709 13:20:01.936936  6772 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 68533.1us
I20260709 13:20:01.890944  6730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d9def8b32fd443aa94ab1420b06837b" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 11 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:01.950524  6772 leader_election.cc:304] T d8292e16e5654be6bc408560cf256aaa P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:20:01.951987 10571 raft_consensus.cc:515] T 853ac0a8cbd64ce99457f170216d4d0f P ccd8a4c3bfe3413cb2ae219b09aea832 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
W20260709 13:20:01.952852  6695 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:01.955293  6723 raft_consensus.cc:1240] T 22ccee1b570c4ad3a57bd7aec085b1b4 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 9 FOLLOWER]: Rejecting Update request from peer b7ab4784c7344b939bc36f639286f377 for earlier term 8. Current term is 9. Ops: []
I20260709 13:20:01.883682 10524 leader_election.cc:290] T 853ac0a8cbd64ce99457f170216d4d0f P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 8 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:01.887368 10755 consensus_queue.cc:1243] T 20f6842e26174571996b8dea4151d4be P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Peer b7ab4784c7344b939bc36f639286f377 log is divergent from this leader: its last log entry 6.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 13:20:01.871682 10534 consensus_queue.cc:260] T b56bf91d90824c959e21e0cee5ba1816 P b7ab4784c7344b939bc36f639286f377 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:01.974839  6732 raft_consensus.cc:1240] T f58dc08b12a2494bb9a1372837970ca2 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 13 FOLLOWER]: Rejecting Update request from peer b7ab4784c7344b939bc36f639286f377 for earlier term 12. Current term is 13. Ops: []
I20260709 13:20:01.950383 10249 raft_consensus.cc:2804] T 1bf4668eeb70467fb3dc5a0289233b3c P b7ab4784c7344b939bc36f639286f377 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:20:01.953936 10421 leader_election.cc:290] T fe20b4b48823486ca3b9c648db6ce8aa P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 9 election: Requested vote from peers cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:20:01.883597 10777 raft_consensus.cc:515] T 44bde925b2e541b69890d70715b85176 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:01.976493 10525 leader_election.cc:290] T 1528ab62b6fe4e3099d08f141afee116 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:20:02.002266  6723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab432e62819d499eaaf3dd55481dd930" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:20:02.003966  7496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe20b4b48823486ca3b9c648db6ce8aa" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb"
I20260709 13:20:01.988677 10063 raft_consensus.cc:2804] T d8292e16e5654be6bc408560cf256aaa P b7ab4784c7344b939bc36f639286f377 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:20:01.987504 10249 raft_consensus.cc:493] T 1bf4668eeb70467fb3dc5a0289233b3c P b7ab4784c7344b939bc36f639286f377 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:02.012933  6725 raft_consensus.cc:1240] T 44bde925b2e541b69890d70715b85176 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 11 FOLLOWER]: Rejecting Update request from peer b7ab4784c7344b939bc36f639286f377 for earlier term 10. Current term is 11. Ops: []
I20260709 13:20:01.971189 10367 raft_consensus.cc:515] T 7a734b5ab7834e05a8c422208acc58b1 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:02.001112 10534 raft_consensus.cc:3060] T b56bf91d90824c959e21e0cee5ba1816 P b7ab4784c7344b939bc36f639286f377 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:20:02.018392  6629 catalog_manager.cc:5697] T 4b8cacb381b746da8d0049b0a83b41dd P 7ba59cc884714e8aa5f3f0ecaed84cbb reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } } }
I20260709 13:20:02.018486  5625 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:20:02.029222  6629 catalog_manager.cc:5697] T fe20b4b48823486ca3b9c648db6ce8aa P 7ba59cc884714e8aa5f3f0ecaed84cbb reported cstate change: term changed from 6 to 8, leader changed from ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65) to 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68). New cstate: current_term: 8 leader_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:20:02.036018  6806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f00a2e87e56452083b759f60d461ee3" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:02.037051  6803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22ccee1b570c4ad3a57bd7aec085b1b4" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:02.038408  6798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a75bfe094d4bdc963aba3f08dfcd25" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 11 candidate_status { last_received { term: 10 index: 4 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:02.010938 10063 raft_consensus.cc:493] T d8292e16e5654be6bc408560cf256aaa P b7ab4784c7344b939bc36f639286f377 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:02.045866 10063 raft_consensus.cc:3060] T d8292e16e5654be6bc408560cf256aaa P b7ab4784c7344b939bc36f639286f377 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:02.014477 10249 raft_consensus.cc:3060] T 1bf4668eeb70467fb3dc5a0289233b3c P b7ab4784c7344b939bc36f639286f377 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:20:02.064404 10787 log.cc:927] Time spent T b3f13b31a1f84f0d89d007eadd57924c P b7ab4784c7344b939bc36f639286f377: Append to log took a long time: real 0.076s	user 0.001s	sys 0.000s
W20260709 13:20:02.066160 10792 log.cc:927] Time spent T 9b3759de40694069b13c0f8bd40e5709 P b7ab4784c7344b939bc36f639286f377: Append to log took a long time: real 0.063s	user 0.000s	sys 0.001s
I20260709 13:20:02.068630 10770 leader_election.cc:290] T 427c124d773f483294511e80fe340075 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:02.082818  6798 raft_consensus.cc:2468] T 95a75bfe094d4bdc963aba3f08dfcd25 P b7ab4784c7344b939bc36f639286f377 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 11.
I20260709 13:20:02.083271 10699 leader_election.cc:290] T f58dc08b12a2494bb9a1372837970ca2 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 13 election: Requested vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
W20260709 13:20:02.028466 10780 log.cc:927] Time spent T 427c124d773f483294511e80fe340075 P cd75a17ab2604397adab03bb8b5fd75c: Append to log took a long time: real 0.257s	user 0.000s	sys 0.001s
I20260709 13:20:02.084913  6803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3022224cc81473690653a83d4e99470" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:02.104470  6803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "853ac0a8cbd64ce99457f170216d4d0f" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:02.105353  6803 raft_consensus.cc:2368] T 853ac0a8cbd64ce99457f170216d4d0f P b7ab4784c7344b939bc36f639286f377 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c for earlier term 7. Current term is 8.
I20260709 13:20:02.086445  6799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c7f33e544204fbaac4078e3e83bbf4e" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:02.087486  6807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20f6842e26174571996b8dea4151d4be" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:20:02.092382  6801 raft_consensus.cc:1240] T 07a92dd554674067a83a9cb68c4773f2 P b7ab4784c7344b939bc36f639286f377 [term 10 LEADER]: Rejecting Update request from peer cd75a17ab2604397adab03bb8b5fd75c for earlier term 9. Current term is 10. Ops: [9.5-9.5]
I20260709 13:20:02.106722  6799 raft_consensus.cc:2393] T 8c7f33e544204fbaac4078e3e83bbf4e P b7ab4784c7344b939bc36f639286f377 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c in current term 8: Already voted for candidate b7ab4784c7344b939bc36f639286f377 in this term.
I20260709 13:20:02.106103  6803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7887766dc6784fcaa42b35c05fea7a99" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:20:02.107496  6799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b56bf91d90824c959e21e0cee5ba1816" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
W20260709 13:20:02.092964  6844 connection.cc:256] RPC call timeout handler was delayed by -1.4635129100001905s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1557s for a response
I20260709 13:20:02.096266  6804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ba5dac66ab5497e9e336f2a3c28cda5" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:02.096993 10571 leader_election.cc:290] T 853ac0a8cbd64ce99457f170216d4d0f P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:02.107800  6803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f9c2e2bf644115957398fe4c9459db" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:02.109447  6798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "427c124d773f483294511e80fe340075" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
W20260709 13:20:02.113255  6772 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 162858us
I20260709 13:20:02.111615 10696 raft_consensus.cc:2749] T ab432e62819d499eaaf3dd55481dd930 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:20:02.118562  6803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "427c124d773f483294511e80fe340075" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:02.124105  6798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f03d0dbf16864ca4bc1bb5e4c0334c0f" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:02.124425  6804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bf4668eeb70467fb3dc5a0289233b3c" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
W20260709 13:20:02.104280 10793 log.cc:927] Time spent T ab432e62819d499eaaf3dd55481dd930 P b7ab4784c7344b939bc36f639286f377: Append to log took a long time: real 0.085s	user 0.001s	sys 0.000s
I20260709 13:20:02.125717  6801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a734b5ab7834e05a8c422208acc58b1" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
W20260709 13:20:02.115902 10791 log.cc:927] Time spent T be1a92657f494cac8dd227d152f50151 P b7ab4784c7344b939bc36f639286f377: Append to log took a long time: real 0.078s	user 0.000s	sys 0.001s
I20260709 13:20:02.128738  6803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e326172347f45e99a0d482b5d8ef768" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:20:02.145902  6803 raft_consensus.cc:2368] T 9e326172347f45e99a0d482b5d8ef768 P b7ab4784c7344b939bc36f639286f377 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c for earlier term 9. Current term is 10.
I20260709 13:20:02.139817  6798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30e88460611e47b2ba16a46a30b5f416" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:02.152072  6807 raft_consensus.cc:2468] T 20f6842e26174571996b8dea4151d4be P b7ab4784c7344b939bc36f639286f377 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 12.
I20260709 13:20:02.105947  6678 placement_policy_util.cc:248] tablet 1528ab62b6fe4e3099d08f141afee116: not considering replicas for movement since the tablet's status is 'UNAVAILABLE'
I20260709 13:20:02.219614  6723 raft_consensus.cc:2468] T ab432e62819d499eaaf3dd55481dd930 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 12.
I20260709 13:20:02.218660  6801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d33d5ee8ef6f415593d8df52063161ad" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:20:02.131474 10446 consensus_queue.cc:1059] T de3186201e1a40d0b335eeb8b4e256e0 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.089s
W20260709 13:20:02.128577 10784 log.cc:927] Time spent T bb7fa124c3bf4ef9ab65a407cb008441 P b7ab4784c7344b939bc36f639286f377: Append to log took a long time: real 0.170s	user 0.001s	sys 0.000s
I20260709 13:20:02.219883  6798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4b8bd455d5a47c18a1380839c6e0d61" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:02.221431  6807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1704639a875409b9959353527b3fd68" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
W20260709 13:20:02.222404  7468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 380836us
I20260709 13:20:02.219888  6803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3411566abe2d4c9bb4b2adfdd05e6f17" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:20:02.115399 10249 raft_consensus.cc:515] T 1bf4668eeb70467fb3dc5a0289233b3c P b7ab4784c7344b939bc36f639286f377 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
W20260709 13:20:02.229683  6770 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 98832.3us
I20260709 13:20:02.229852  6801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f00a2e87e56452083b759f60d461ee3" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
W20260709 13:20:02.180320 10780 log.cc:927] Time spent T 427c124d773f483294511e80fe340075 P cd75a17ab2604397adab03bb8b5fd75c: Append to log took a long time: real 0.059s	user 0.000s	sys 0.001s
I20260709 13:20:02.232570  6807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ba5dac66ab5497e9e336f2a3c28cda5" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
W20260709 13:20:02.157196 10734 consensus_meta.cc:287] T 8c7f33e544204fbaac4078e3e83bbf4e P ccd8a4c3bfe3413cb2ae219b09aea832: Time spent flushing consensus metadata: real 0.776s	user 0.008s	sys 0.004s
W20260709 13:20:02.218362 10796 log.cc:927] Time spent T 90d42e216d9741e190bca19a781291fd P b7ab4784c7344b939bc36f639286f377: Append to log took a long time: real 0.104s	user 0.000s	sys 0.001s
I20260709 13:20:02.235214  6798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbdf895bba214ff68685a24fd17dfb5d" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:20:02.237152  6798 raft_consensus.cc:2393] T dbdf895bba214ff68685a24fd17dfb5d P b7ab4784c7344b939bc36f639286f377 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c in current term 10: Already voted for candidate b7ab4784c7344b939bc36f639286f377 in this term.
I20260709 13:20:02.236948  6800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b3759de40694069b13c0f8bd40e5709" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:02.239962  6803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb7fa124c3bf4ef9ab65a407cb008441" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:02.229242 10561 leader_election.cc:290] T dbdf895bba214ff68685a24fd17dfb5d P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 10 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:02.239341  7468 leader_election.cc:304] T 7ba5dac66ab5497e9e336f2a3c28cda5 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:20:02.245195  6801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77e330a82df4b43a745d57a68f6f057" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:20:02.269222  7496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f00a2e87e56452083b759f60d461ee3" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb"
I20260709 13:20:02.276914  7496 raft_consensus.cc:3060] T 4f00a2e87e56452083b759f60d461ee3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:20:02.272688  6804 raft_consensus.cc:2393] T 1bf4668eeb70467fb3dc5a0289233b3c P b7ab4784c7344b939bc36f639286f377 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c in current term 11: Already voted for candidate b7ab4784c7344b939bc36f639286f377 in this term.
I20260709 13:20:02.247438 10446 consensus_queue.cc:1243] T de3186201e1a40d0b335eeb8b4e256e0 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Peer ccd8a4c3bfe3413cb2ae219b09aea832 log is divergent from this leader: its last log entry 11.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 13:20:02.280579  6801 raft_consensus.cc:2393] T e77e330a82df4b43a745d57a68f6f057 P b7ab4784c7344b939bc36f639286f377 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c in current term 13: Already voted for candidate b7ab4784c7344b939bc36f639286f377 in this term.
I20260709 13:20:02.243690 10727 leader_election.cc:290] T 22ccee1b570c4ad3a57bd7aec085b1b4 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 9 election: Requested vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:02.287608  7502 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50756 (request call id 266) took 1218 ms. Trace:
W20260709 13:20:02.288333  7468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 49178.9us
I20260709 13:20:02.288007  7502 rpcz_store.cc:276] 0709 13:20:01.068924 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:01.069053 (+   129us) service_pool.cc:224] Handling call
0709 13:20:01.090397 (+ 21344us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:01.497292 (+406895us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:02.287383 (+790091us) spinlock_profiling.cc:243] Waited 406 ms on lock 0x7b54001ec8d4. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f9aae01 00007fcc0f9a983e 00007fcc1496e419 00007fcc0dee5bd4 00007fcc0dee5b62 00007fcc0dee5a91 00007fcc0dee5a0c 00007fcc0dee4cc2 00007fcc0dce548c 00007fcc0dce48c6
0709 13:20:02.287552 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":934050560}
I20260709 13:20:02.289422  7468 leader_election.cc:304] T d8cee0accdb8499c86d4414b72565a38 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377
I20260709 13:20:02.241557 10447 consensus_queue.cc:1048] T 07a92dd554674067a83a9cb68c4773f2 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.046s
I20260709 13:20:02.292608 10568 raft_consensus.cc:2804] T d8cee0accdb8499c86d4414b72565a38 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:20:02.293097 10568 raft_consensus.cc:493] T d8cee0accdb8499c86d4414b72565a38 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 9 FOLLOWER]: Starting leader election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:20:02.293521 10568 raft_consensus.cc:3060] T d8cee0accdb8499c86d4414b72565a38 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:20:02.299670  6873 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53406 (request call id 1980) took 2082 ms. Trace:
I20260709 13:20:02.300189  6873 rpcz_store.cc:276] 0709 13:20:00.216923 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:00.218939 (+  2016us) service_pool.cc:224] Handling call
0709 13:20:00.222377 (+  3438us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:01.490588 (+1268211us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:02.299374 (+808786us) spinlock_profiling.cc:243] Waited 1.27 s on lock 0x7b54001423d4. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f9aae01 00007fcc0f9a983e 00007fcc1496e419 00007fcc0dee5bd4 00007fcc0dee5b62 00007fcc0dee5a91 00007fcc0dee5a0c 00007fcc0dee4cc2 00007fcc0dce548c 00007fcc0dce48c6
0709 13:20:02.299591 (+   217us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2912233856}
I20260709 13:20:02.301033 10711 raft_consensus.cc:3055] T 20f6842e26174571996b8dea4151d4be P ccd8a4c3bfe3413cb2ae219b09aea832 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:20:02.301678 10711 raft_consensus.cc:740] T 20f6842e26174571996b8dea4151d4be P ccd8a4c3bfe3413cb2ae219b09aea832 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
I20260709 13:20:02.291277  7468 leader_election.cc:304] T 4b8cacb381b746da8d0049b0a83b41dd P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:20:02.302822 10770 raft_consensus.cc:3060] T 4b8cacb381b746da8d0049b0a83b41dd P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:20:02.302803 10711 consensus_queue.cc:260] T 20f6842e26174571996b8dea4151d4be P ccd8a4c3bfe3413cb2ae219b09aea832 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:02.308599 10803 consensus_queue.cc:1059] T f3f9c2e2bf644115957398fe4c9459db P b7ab4784c7344b939bc36f639286f377 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:20:02.310388  6724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8292e16e5654be6bc408560cf256aaa" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:02.285810 10765 raft_consensus.cc:3060] T 7ba5dac66ab5497e9e336f2a3c28cda5 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:20:02.312464 10571 raft_consensus.cc:493] T ce4f062dcd314d43a63ca74067cb5ee3 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 7ba59cc884714e8aa5f3f0ecaed84cbb)
I20260709 13:20:02.353252 10571 raft_consensus.cc:515] T ce4f062dcd314d43a63ca74067cb5ee3 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } attrs { replace: true } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:20:02.354658 10770 raft_consensus.cc:2749] T 4b8cacb381b746da8d0049b0a83b41dd P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:20:02.332690 10568 raft_consensus.cc:515] T d8cee0accdb8499c86d4414b72565a38 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:20:02.356284  6726 raft_consensus.cc:1240] T b56bf91d90824c959e21e0cee5ba1816 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 10 FOLLOWER]: Rejecting Update request from peer b7ab4784c7344b939bc36f639286f377 for earlier term 9. Current term is 10. Ops: [9.6-9.6]
I20260709 13:20:02.357321 10571 leader_election.cc:290] T ce4f062dcd314d43a63ca74067cb5ee3 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
W20260709 13:20:02.357888 10735 consensus_meta.cc:287] T 4d9def8b32fd443aa94ab1420b06837b P ccd8a4c3bfe3413cb2ae219b09aea832: Time spent flushing consensus metadata: real 0.564s	user 0.008s	sys 0.006s
I20260709 13:20:02.357944 10568 leader_election.cc:290] T d8cee0accdb8499c86d4414b72565a38 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 10 election: Requested vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:02.313338  6728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bf4668eeb70467fb3dc5a0289233b3c" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:02.358493 10735 raft_consensus.cc:515] T 4d9def8b32fd443aa94ab1420b06837b P ccd8a4c3bfe3413cb2ae219b09aea832 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:02.359643  6728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77e330a82df4b43a745d57a68f6f057" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:20:02.360314  6730 raft_consensus.cc:2393] T 4d9def8b32fd443aa94ab1420b06837b P ccd8a4c3bfe3413cb2ae219b09aea832 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7ab4784c7344b939bc36f639286f377 in current term 11: Already voted for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in this term.
I20260709 13:20:02.360523  6728 raft_consensus.cc:2410] T e77e330a82df4b43a745d57a68f6f057 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate b7ab4784c7344b939bc36f639286f377 for term 13 because replica has last-logged OpId of term: 12 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 5.
I20260709 13:20:02.314093  6731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c7f33e544204fbaac4078e3e83bbf4e" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:20:02.362500  6730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbdf895bba214ff68685a24fd17dfb5d" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 10 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:20:02.362691 10708 raft_consensus.cc:3055] T de3186201e1a40d0b335eeb8b4e256e0 P b7ab4784c7344b939bc36f639286f377 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:20:02.361523  6728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "404190ce4ce94cecbfcb6ea9d1dd8626" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:20:02.363148 10708 raft_consensus.cc:740] T de3186201e1a40d0b335eeb8b4e256e0 P b7ab4784c7344b939bc36f639286f377 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
I20260709 13:20:02.363713 10803 raft_consensus.cc:3055] T f3f9c2e2bf644115957398fe4c9459db P b7ab4784c7344b939bc36f639286f377 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:20:02.364146 10803 raft_consensus.cc:740] T f3f9c2e2bf644115957398fe4c9459db P b7ab4784c7344b939bc36f639286f377 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
I20260709 13:20:02.364302  6728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c240553ce044eedb41541d72b9475d7" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:20:02.364931 10803 consensus_queue.cc:260] T f3f9c2e2bf644115957398fe4c9459db P b7ab4784c7344b939bc36f639286f377 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:02.365588 10571 raft_consensus.cc:493] T 427c124d773f483294511e80fe340075 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:20:02.366456  6728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "853ac0a8cbd64ce99457f170216d4d0f" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:20:02.366287 10571 raft_consensus.cc:515] T 427c124d773f483294511e80fe340075 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } attrs { replace: true } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:20:02.367074  6728 raft_consensus.cc:3060] T 853ac0a8cbd64ce99457f170216d4d0f P ccd8a4c3bfe3413cb2ae219b09aea832 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:20:02.367273 10547 consensus_meta.cc:287] T 4b8cacb381b746da8d0049b0a83b41dd P ccd8a4c3bfe3413cb2ae219b09aea832: Time spent flushing consensus metadata: real 0.987s	user 0.010s	sys 0.004s
I20260709 13:20:02.367651  6874 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53406 (request call id 1985) took 2147 ms. Trace:
W20260709 13:20:02.368247 10801 log.cc:927] Time spent T c4db81d9d329422bb3b4160ca4ac2d1d P ccd8a4c3bfe3413cb2ae219b09aea832: Append to log took a long time: real 0.107s	user 0.001s	sys 0.000s
I20260709 13:20:02.288479 10777 leader_election.cc:290] T 44bde925b2e541b69890d70715b85176 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 11 election: Requested vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
W20260709 13:20:02.369539 10580 consensus_meta.cc:287] T 713b5728a197487c9300b310ab94e5a3 P ccd8a4c3bfe3413cb2ae219b09aea832: Time spent flushing consensus metadata: real 0.950s	user 0.008s	sys 0.007s
I20260709 13:20:02.369376 10571 leader_election.cc:290] T 427c124d773f483294511e80fe340075 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:20:02.369887 10580 raft_consensus.cc:515] T 713b5728a197487c9300b310ab94e5a3 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:02.278573 10367 leader_election.cc:290] T 7a734b5ab7834e05a8c422208acc58b1 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 10 election: Requested vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
W20260709 13:20:02.316272  6697 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:02.316658  7500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb7fa124c3bf4ef9ab65a407cb008441" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:20:02.323714  6799 raft_consensus.cc:2410] T b56bf91d90824c959e21e0cee5ba1816 P b7ab4784c7344b939bc36f639286f377 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c for term 10 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 13:20:02.290144 10525 consensus_queue.cc:1059] T de3186201e1a40d0b335eeb8b4e256e0 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.045s
W20260709 13:20:02.327993 10775 consensus_meta.cc:287] T 24ee15416e3145beaa1b8183453729a3 P ccd8a4c3bfe3413cb2ae219b09aea832: Time spent flushing consensus metadata: real 0.628s	user 0.008s	sys 0.000s
I20260709 13:20:02.349247  7496 raft_consensus.cc:2468] T 4f00a2e87e56452083b759f60d461ee3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 11.
W20260709 13:20:02.288125 10790 log.cc:927] Time spent T 3411566abe2d4c9bb4b2adfdd05e6f17 P b7ab4784c7344b939bc36f639286f377: Append to log took a long time: real 0.174s	user 0.000s	sys 0.001s
I20260709 13:20:02.334867  6723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1528ab62b6fe4e3099d08f141afee116" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:02.340775 10621 leader_election.cc:290] T bb7fa124c3bf4ef9ab65a407cb008441 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:20:02.352515  6724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce4f062dcd314d43a63ca74067cb5ee3" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:02.394232  6724 raft_consensus.cc:2468] T ce4f062dcd314d43a63ca74067cb5ee3 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 10.
I20260709 13:20:02.395704  6724 raft_consensus.cc:1240] T e31b9971c15848dea59d4d4130141d9e P ccd8a4c3bfe3413cb2ae219b09aea832 [term 8 FOLLOWER]: Rejecting Update request from peer b7ab4784c7344b939bc36f639286f377 for earlier term 7. Current term is 8. Ops: []
I20260709 13:20:02.373869  6697 leader_election.cc:304] T 3a485a995abc4807b6e511e45419f737 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377
I20260709 13:20:02.248617 10713 consensus_queue.cc:1059] T d33d5ee8ef6f415593d8df52063161ad P b7ab4784c7344b939bc36f639286f377 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.134s
I20260709 13:20:02.377051  6725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e326172347f45e99a0d482b5d8ef768" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:20:02.377288  6728 raft_consensus.cc:2468] T 853ac0a8cbd64ce99457f170216d4d0f P ccd8a4c3bfe3413cb2ae219b09aea832 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 8.
I20260709 13:20:02.403172  6725 raft_consensus.cc:2393] T 9e326172347f45e99a0d482b5d8ef768 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate b7ab4784c7344b939bc36f639286f377 in current term 10: Already voted for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in this term.
I20260709 13:20:02.363166  6730 raft_consensus.cc:3060] T dbdf895bba214ff68685a24fd17dfb5d P ccd8a4c3bfe3413cb2ae219b09aea832 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:20:02.241892 10734 raft_consensus.cc:515] T 8c7f33e544204fbaac4078e3e83bbf4e P ccd8a4c3bfe3413cb2ae219b09aea832 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:02.375291  6874 rpcz_store.cc:276] 0709 13:20:00.220099 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:00.220974 (+   875us) service_pool.cc:224] Handling call
0709 13:20:00.249807 (+ 28833us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:00.250031 (+   224us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:20:01.491808 (+1241777us) spinlock_profiling.cc:243] Waited 4.87 ms on lock 0x7b1800411e20. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc15785de1 00007fcc157925b1 00007fcc0f5524bc 00007fcc0c8a048b 00007fcc156faab9 00007fcc0c8bc69b 00007fcc0c8ba93f 00007fcc0c8ba455 00007fcc133a23c7 00007fcc0f9b49a7 00007fcc0f9c40bf
0709 13:20:01.491982 (+   174us) log.cc:844] Serialized 14 byte log entry
0709 13:20:01.632279 (+140297us) log.cc:844] Serialized 14 byte log entry
0709 13:20:01.798736 (+166457us) spinlock_profiling.cc:243] Waited 5.22 ms on lock 0x7b1800411e20. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc15785de1 00007fcc157925b1 00007fcc0c8bd522 00007fcc0c8bf7c1 00007fcc0c8bf779 00007fcc0c8bf709 00007fcc0c8bf6d1 00007fcc0c8be9cd 000000000038f354 000000000038f199 00007fcc0c8a083a
0709 13:20:02.367119 (+568383us) spinlock_profiling.cc:243] Waited 11.7 ms on lock 0x7b1800411e20. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc15785de1 00007fcc157925b1 00007fcc0c837c0a 00007fcc15f77219 00007fcc0c8bfa40 00007fcc0c8ba4e4 00007fcc0c8ba455 00007fcc0f9a2060 00007fcc0f9b4716 00007fcc0f9c5287 00007fcc0f9c5208
0709 13:20:02.367287 (+   168us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:20:02.367348 (+    61us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:20:02.367403 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:02.367474 (+    71us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:02.367591 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9929,"prepare.queue_time_us":318175,"prepare.run_cpu_time_us":127,"prepare.run_wall_time_us":7525,"raft.queue_time_us":738013,"raft.run_cpu_time_us":254,"raft.run_wall_time_us":10328,"spinlock_wait_cycles":49988608,"thread_start_us":351188,"threads_started":2,"wal-append.queue_time_us":236511}
W20260709 13:20:02.387701  6772 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 152787us
I20260709 13:20:02.389889  6723 raft_consensus.cc:1240] T f03d0dbf16864ca4bc1bb5e4c0334c0f P ccd8a4c3bfe3413cb2ae219b09aea832 [term 9 FOLLOWER]: Rejecting Update request from peer b7ab4784c7344b939bc36f639286f377 for earlier term 8. Current term is 9. Ops: []
I20260709 13:20:02.329535  7468 leader_election.cc:304] T 24ee15416e3145beaa1b8183453729a3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:20:02.398360  6697 leader_election.cc:304] T dbdf895bba214ff68685a24fd17dfb5d P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
W20260709 13:20:02.365762  6696 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:02.408701  6723 raft_consensus.cc:1240] T a3022224cc81473690653a83d4e99470 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 12 FOLLOWER]: Rejecting Update request from peer b7ab4784c7344b939bc36f639286f377 for earlier term 11. Current term is 12. Ops: [11.6-11.6]
I20260709 13:20:02.405764  6725 raft_consensus.cc:1275] T f09c2a98de1a4decabd0ff900dd44caa P ccd8a4c3bfe3413cb2ae219b09aea832 [term 12 FOLLOWER]: Refusing update from remote peer b7ab4784c7344b939bc36f639286f377: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:20:02.405296  6772 leader_election.cc:304] T 8c7f33e544204fbaac4078e3e83bbf4e P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:20:02.417017  6697 leader_election.cc:304] T a3022224cc81473690653a83d4e99470 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377
I20260709 13:20:02.383059 10704 raft_consensus.cc:493] T 3d65025eea89441290d85dd053810e31 P cd75a17ab2604397adab03bb8b5fd75c [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:20:02.399999  6724 raft_consensus.cc:1240] T d33d5ee8ef6f415593d8df52063161ad P ccd8a4c3bfe3413cb2ae219b09aea832 [term 11 FOLLOWER]: Rejecting Update request from peer b7ab4784c7344b939bc36f639286f377 for earlier term 10. Current term is 11. Ops: []
I20260709 13:20:02.366189 10803 raft_consensus.cc:3060] T f3f9c2e2bf644115957398fe4c9459db P b7ab4784c7344b939bc36f639286f377 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:20:02.331461 10160 consensus_meta.cc:287] T 4f00a2e87e56452083b759f60d461ee3 P b7ab4784c7344b939bc36f639286f377: Time spent flushing consensus metadata: real 0.533s	user 0.008s	sys 0.003s
W20260709 13:20:02.411486 10700 consensus_meta.cc:287] T 7c37d41cd9164c15a6826ca62a851a69 P ccd8a4c3bfe3413cb2ae219b09aea832: Time spent flushing consensus metadata: real 0.682s	user 0.010s	sys 0.002s
I20260709 13:20:02.412766  6725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20f6842e26174571996b8dea4151d4be" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:20:02.348956 10446 consensus_queue.cc:1059] T 22ccee1b570c4ad3a57bd7aec085b1b4 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.056s
I20260709 13:20:02.428979  6723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "853ac0a8cbd64ce99457f170216d4d0f" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:02.435273  6724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7887766dc6784fcaa42b35c05fea7a99" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:20:02.436213  6878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e326172347f45e99a0d482b5d8ef768" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:20:02.437342  6875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f9c2e2bf644115957398fe4c9459db" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:20:02.438153  6880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d33d5ee8ef6f415593d8df52063161ad" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:20:02.372598 10063 raft_consensus.cc:515] T d8292e16e5654be6bc408560cf256aaa P b7ab4784c7344b939bc36f639286f377 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:02.430807  6772 leader_election.cc:304] T 9e326172347f45e99a0d482b5d8ef768 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:20:02.450682  6878 raft_consensus.cc:2393] T 9e326172347f45e99a0d482b5d8ef768 P cd75a17ab2604397adab03bb8b5fd75c [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate ccd8a4c3bfe3413cb2ae219b09aea832 in current term 10: Already voted for candidate b7ab4784c7344b939bc36f639286f377 in this term.
I20260709 13:20:02.450047  6723 raft_consensus.cc:2368] T 853ac0a8cbd64ce99457f170216d4d0f P ccd8a4c3bfe3413cb2ae219b09aea832 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c for earlier term 7. Current term is 8.
I20260709 13:20:02.452702  6880 raft_consensus.cc:2393] T d33d5ee8ef6f415593d8df52063161ad P cd75a17ab2604397adab03bb8b5fd75c [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate ccd8a4c3bfe3413cb2ae219b09aea832 in current term 11: Already voted for candidate cd75a17ab2604397adab03bb8b5fd75c in this term.
I20260709 13:20:02.458127  6723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fa34c08b205435dba97346991aa1f92" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:20:02.458997  6723 raft_consensus.cc:3060] T 3fa34c08b205435dba97346991aa1f92 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:20:02.459461  6880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f58dc08b12a2494bb9a1372837970ca2" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:20:02.460347  6880 raft_consensus.cc:3060] T f58dc08b12a2494bb9a1372837970ca2 P cd75a17ab2604397adab03bb8b5fd75c [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:02.440964  6881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e31b9971c15848dea59d4d4130141d9e" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:20:02.442063  6873 raft_consensus.cc:1240] T 20f6842e26174571996b8dea4151d4be P cd75a17ab2604397adab03bb8b5fd75c [term 12 FOLLOWER]: Rejecting Update request from peer ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 11. Current term is 12. Ops: [11.7-11.7]
I20260709 13:20:02.418530  6731 raft_consensus.cc:2393] T 8c7f33e544204fbaac4078e3e83bbf4e P ccd8a4c3bfe3413cb2ae219b09aea832 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate b7ab4784c7344b939bc36f639286f377 in current term 8: Already voted for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in this term.
I20260709 13:20:02.438946  6876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe20b4b48823486ca3b9c648db6ce8aa" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:20:02.405341 10775 raft_consensus.cc:2804] T 3a485a995abc4807b6e511e45419f737 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 13:20:02.447499  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 338974us
W20260709 13:20:02.462858  6844 connection.cc:256] RPC call timeout handler was delayed by -1.4208229640000809s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15980000000000003s for a response
W20260709 13:20:02.463356  6844 connection.cc:256] RPC call timeout handler was delayed by -1.3691393840001638s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1905s for a response
W20260709 13:20:02.463742  6844 connection.cc:256] RPC call timeout handler was delayed by -1.3442217130002518s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1839s for a response
W20260709 13:20:02.464330  6844 connection.cc:256] RPC call timeout handler was delayed by -1.0165072240001791s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20430000000000004s for a response
I20260709 13:20:02.455958  6872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90d42e216d9741e190bca19a781291fd" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:02.452028  6875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a734b5ab7834e05a8c422208acc58b1" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:20:02.463749  6876 raft_consensus.cc:1275] T 95a75bfe094d4bdc963aba3f08dfcd25 P cd75a17ab2604397adab03bb8b5fd75c [term 11 FOLLOWER]: Refusing update from remote peer ccd8a4c3bfe3413cb2ae219b09aea832: Log matching property violated. Preceding OpId in replica: term: 10 index: 4. Preceding OpId from leader: term: 11 index: 5. (index mismatch)
I20260709 13:20:02.472872  6697 leader_election.cc:304] T f3f9c2e2bf644115957398fe4c9459db P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:20:02.473392  6874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22ccee1b570c4ad3a57bd7aec085b1b4" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:20:02.428855 10758 raft_consensus.cc:493] T bd6869f07b5a4885a0b99fbe60c3b175 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:02.469306  6873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44bde925b2e541b69890d70715b85176" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:20:02.457845  6878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "853ac0a8cbd64ce99457f170216d4d0f" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:02.474726  6697 leader_election.cc:304] T 9e326172347f45e99a0d482b5d8ef768 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
W20260709 13:20:02.475618  6772 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 44886.5us
I20260709 13:20:02.440647 10747 raft_consensus.cc:493] T 07a92dd554674067a83a9cb68c4773f2 P cd75a17ab2604397adab03bb8b5fd75c [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:02.445140 10621 raft_consensus.cc:493] T 4d9def8b32fd443aa94ab1420b06837b P cd75a17ab2604397adab03bb8b5fd75c [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:02.521351  6730 raft_consensus.cc:2468] T dbdf895bba214ff68685a24fd17dfb5d P ccd8a4c3bfe3413cb2ae219b09aea832 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 10.
I20260709 13:20:02.514703  6844 leader_election.cc:304] T de3186201e1a40d0b335eeb8b4e256e0 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:20:02.483383  6723 raft_consensus.cc:2468] T 3fa34c08b205435dba97346991aa1f92 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in term 12.
I20260709 13:20:02.518041  6875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce4f062dcd314d43a63ca74067cb5ee3" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:02.443868 10571 raft_consensus.cc:2804] T a3022224cc81473690653a83d4e99470 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:20:02.549214  6878 raft_consensus.cc:2468] T 853ac0a8cbd64ce99457f170216d4d0f P cd75a17ab2604397adab03bb8b5fd75c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 6.
I20260709 13:20:02.549898  6723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3022224cc81473690653a83d4e99470" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:02.550997  6878 raft_consensus.cc:1275] T 2c240553ce044eedb41541d72b9475d7 P cd75a17ab2604397adab03bb8b5fd75c [term 12 FOLLOWER]: Refusing update from remote peer ccd8a4c3bfe3413cb2ae219b09aea832: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:20:02.516433  6724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b56bf91d90824c959e21e0cee5ba1816" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:20:02.552335  6844 leader_election.cc:304] T 7c44c4849aa54f2b94d1f1bef9ed546f P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
W20260709 13:20:02.546792  6697 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 72156.7us
I20260709 13:20:02.487882  6876 raft_consensus.cc:1275] T 711ef6523deb4cbe8ef2ba61e1c21c98 P cd75a17ab2604397adab03bb8b5fd75c [term 11 FOLLOWER]: Refusing update from remote peer ccd8a4c3bfe3413cb2ae219b09aea832: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:20:02.513836  6881 raft_consensus.cc:1275] T de3186201e1a40d0b335eeb8b4e256e0 P cd75a17ab2604397adab03bb8b5fd75c [term 11 FOLLOWER]: Refusing update from remote peer ccd8a4c3bfe3413cb2ae219b09aea832: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:20:02.554291  6697 leader_election.cc:304] T d33d5ee8ef6f415593d8df52063161ad P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:20:02.558665  6697 leader_election.cc:304] T fe20b4b48823486ca3b9c648db6ce8aa P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:20:02.428552 10730 consensus_queue.cc:1048] T f5be3a11b23d4ea9b08300a2789821c7 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.058s
I20260709 13:20:02.449410 10715 raft_consensus.cc:493] T c4db81d9d329422bb3b4160ca4ac2d1d P cd75a17ab2604397adab03bb8b5fd75c [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:20:02.454998 10765 raft_consensus.cc:2749] T 7ba5dac66ab5497e9e336f2a3c28cda5 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:20:02.588107 10765 raft_consensus.cc:2749] T 24ee15416e3145beaa1b8183453729a3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:20:02.567746 10421 raft_consensus.cc:2749] T fe20b4b48823486ca3b9c648db6ce8aa P ccd8a4c3bfe3413cb2ae219b09aea832 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:20:02.446606 10802 raft_consensus.cc:2804] T 8c7f33e544204fbaac4078e3e83bbf4e P b7ab4784c7344b939bc36f639286f377 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:20:02.564141  6730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f9c2e2bf644115957398fe4c9459db" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:02.559202  6724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "427c124d773f483294511e80fe340075" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:02.557821  6873 raft_consensus.cc:1275] T 1bf4668eeb70467fb3dc5a0289233b3c P cd75a17ab2604397adab03bb8b5fd75c [term 10 FOLLOWER]: Refusing update from remote peer ccd8a4c3bfe3413cb2ae219b09aea832: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:20:02.592056  6732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c7f33e544204fbaac4078e3e83bbf4e" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:02.559653 10713 consensus_queue.cc:1048] T bd6869f07b5a4885a0b99fbe60c3b175 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 2, Time since last communication: 0.033s
I20260709 13:20:02.593534  6732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a734b5ab7834e05a8c422208acc58b1" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:02.594528  6732 raft_consensus.cc:2393] T 7a734b5ab7834e05a8c422208acc58b1 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c in current term 10: Already voted for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in this term.
I20260709 13:20:02.595469  6732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f03d0dbf16864ca4bc1bb5e4c0334c0f" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:02.554816  6880 raft_consensus.cc:2468] T f58dc08b12a2494bb9a1372837970ca2 P cd75a17ab2604397adab03bb8b5fd75c [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 13.
I20260709 13:20:02.563803 10695 consensus_queue.cc:1059] T a1704639a875409b9959353527b3fd68 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.004s
W20260709 13:20:02.567965 10800 log.cc:927] Time spent T 34f36d59d88f40fe8a2805e604fc6c0a P ccd8a4c3bfe3413cb2ae219b09aea832: Append to log took a long time: real 0.285s	user 0.000s	sys 0.001s
I20260709 13:20:02.597502 10734 leader_election.cc:290] T 8c7f33e544204fbaac4078e3e83bbf4e P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 8 election: Requested vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:02.483937 10591 raft_consensus.cc:2749] T f3f9c2e2bf644115957398fe4c9459db P ccd8a4c3bfe3413cb2ae219b09aea832 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:20:02.597550 10695 raft_consensus.cc:3055] T a1704639a875409b9959353527b3fd68 P b7ab4784c7344b939bc36f639286f377 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:20:02.598495 10695 raft_consensus.cc:740] T a1704639a875409b9959353527b3fd68 P b7ab4784c7344b939bc36f639286f377 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
I20260709 13:20:02.598728  6730 raft_consensus.cc:2393] T f3f9c2e2bf644115957398fe4c9459db P ccd8a4c3bfe3413cb2ae219b09aea832 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c in current term 10: Already voted for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in this term.
I20260709 13:20:02.599390 10695 consensus_queue.cc:260] T a1704639a875409b9959353527b3fd68 P b7ab4784c7344b939bc36f639286f377 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:02.600657 10695 raft_consensus.cc:3060] T a1704639a875409b9959353527b3fd68 P b7ab4784c7344b939bc36f639286f377 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:20:02.601475  6730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e326172347f45e99a0d482b5d8ef768" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:20:02.572968  6874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "427c124d773f483294511e80fe340075" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:02.602159 10802 raft_consensus.cc:697] T 8c7f33e544204fbaac4078e3e83bbf4e P b7ab4784c7344b939bc36f639286f377 [term 8 LEADER]: Becoming Leader. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
I20260709 13:20:02.602279  6874 raft_consensus.cc:2468] T 427c124d773f483294511e80fe340075 P cd75a17ab2604397adab03bb8b5fd75c [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 9.
I20260709 13:20:02.466969 10775 raft_consensus.cc:493] T 3a485a995abc4807b6e511e45419f737 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:02.603284 10775 raft_consensus.cc:3060] T 3a485a995abc4807b6e511e45419f737 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:20:02.603183 10802 consensus_queue.cc:237] T 8c7f33e544204fbaac4078e3e83bbf4e P b7ab4784c7344b939bc36f639286f377 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:02.606024 10063 leader_election.cc:290] T d8292e16e5654be6bc408560cf256aaa P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 14 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:02.467877 10770 consensus_queue.cc:1048] T be1a92657f494cac8dd227d152f50151 P 7ba59cc884714e8aa5f3f0ecaed84cbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.106s
I20260709 13:20:02.474087 10777 consensus_queue.cc:1048] T d8292e16e5654be6bc408560cf256aaa P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.107s
I20260709 13:20:02.560782 10752 raft_consensus.cc:2749] T de3186201e1a40d0b335eeb8b4e256e0 P cd75a17ab2604397adab03bb8b5fd75c [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:20:02.563146 10758 raft_consensus.cc:515] T bd6869f07b5a4885a0b99fbe60c3b175 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:02.577462 10571 raft_consensus.cc:697] T a3022224cc81473690653a83d4e99470 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 12 LEADER]: Becoming Leader. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
I20260709 13:20:02.448570 10160 raft_consensus.cc:515] T 4f00a2e87e56452083b759f60d461ee3 P b7ab4784c7344b939bc36f639286f377 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:20:02.608767 10571 consensus_queue.cc:237] T a3022224cc81473690653a83d4e99470 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.5, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:02.559962 10747 raft_consensus.cc:515] T 07a92dd554674067a83a9cb68c4773f2 P cd75a17ab2604397adab03bb8b5fd75c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:02.609666 10752 raft_consensus.cc:493] T 90d42e216d9741e190bca19a781291fd P cd75a17ab2604397adab03bb8b5fd75c [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:20:02.610302 10752 raft_consensus.cc:515] T 90d42e216d9741e190bca19a781291fd P cd75a17ab2604397adab03bb8b5fd75c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:02.611621  6806 raft_consensus.cc:2393] T 4f00a2e87e56452083b759f60d461ee3 P b7ab4784c7344b939bc36f639286f377 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c in current term 11: Already voted for candidate b7ab4784c7344b939bc36f639286f377 in this term.
I20260709 13:20:02.611650 10747 leader_election.cc:290] T 07a92dd554674067a83a9cb68c4773f2 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:20:02.581056 10524 consensus_queue.cc:1048] T f4b8bd455d5a47c18a1380839c6e0d61 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:20:02.578830 10711 raft_consensus.cc:3060] T 20f6842e26174571996b8dea4151d4be P ccd8a4c3bfe3413cb2ae219b09aea832 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:20:02.556682 10738 raft_consensus.cc:493] T bd6869f07b5a4885a0b99fbe60c3b175 P cd75a17ab2604397adab03bb8b5fd75c [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:02.580878 10708 consensus_queue.cc:260] T de3186201e1a40d0b335eeb8b4e256e0 P b7ab4784c7344b939bc36f639286f377 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:02.609506 10160 leader_election.cc:290] T 4f00a2e87e56452083b759f60d461ee3 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 11 election: Requested vote from peers cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:20:02.613747 10738 raft_consensus.cc:515] T bd6869f07b5a4885a0b99fbe60c3b175 P cd75a17ab2604397adab03bb8b5fd75c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:02.592056  6724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bf4668eeb70467fb3dc5a0289233b3c" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:02.609414 10758 leader_election.cc:290] T bd6869f07b5a4885a0b99fbe60c3b175 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:02.615437  6724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30e88460611e47b2ba16a46a30b5f416" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
W20260709 13:20:02.585952 10805 log.cc:927] Time spent T 7c44c4849aa54f2b94d1f1bef9ed546f P b7ab4784c7344b939bc36f639286f377: Append to log took a long time: real 0.235s	user 0.000s	sys 0.000s
I20260709 13:20:02.544535 10722 consensus_queue.cc:1059] T 3fa34c08b205435dba97346991aa1f92 P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.043s
I20260709 13:20:02.555541 10367 raft_consensus.cc:2749] T dbdf895bba214ff68685a24fd17dfb5d P ccd8a4c3bfe3413cb2ae219b09aea832 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:20:02.617775  6726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22ccee1b570c4ad3a57bd7aec085b1b4" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:02.618010 10785 raft_consensus.cc:3055] T d33d5ee8ef6f415593d8df52063161ad P b7ab4784c7344b939bc36f639286f377 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:20:02.593868 10446 consensus_queue.cc:1048] T 3a485a995abc4807b6e511e45419f737 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:20:02.618531 10785 raft_consensus.cc:740] T d33d5ee8ef6f415593d8df52063161ad P b7ab4784c7344b939bc36f639286f377 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
I20260709 13:20:02.618690  6726 raft_consensus.cc:2393] T 22ccee1b570c4ad3a57bd7aec085b1b4 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c in current term 9: Already voted for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in this term.
I20260709 13:20:02.593997 10808 consensus_queue.cc:1059] T a3022224cc81473690653a83d4e99470 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:20:02.559906 10794 raft_consensus.cc:2749] T 9e326172347f45e99a0d482b5d8ef768 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:20:02.513154 10418 raft_consensus.cc:2804] T 9e326172347f45e99a0d482b5d8ef768 P b7ab4784c7344b939bc36f639286f377 [term 10 FOLLOWER]: Leader election won for term 10
W20260709 13:20:02.603598  6630 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:53224 (request call id 156) took 59375 ms (client timeout 15000 ms). Trace:
I20260709 13:20:02.564990  6697 leader_election.cc:304] T 90d42e216d9741e190bca19a781291fd P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
W20260709 13:20:02.583902  6770 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:02.645886  6802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce4f062dcd314d43a63ca74067cb5ee3" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:02.616312 10650 raft_consensus.cc:3055] T 404190ce4ce94cecbfcb6ea9d1dd8626 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:20:02.580561 10626 raft_consensus.cc:2749] T 7c44c4849aa54f2b94d1f1bef9ed546f P cd75a17ab2604397adab03bb8b5fd75c [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:20:02.584308 10786 log.cc:927] Time spent T bb7fa124c3bf4ef9ab65a407cb008441 P cd75a17ab2604397adab03bb8b5fd75c: Append to log took a long time: real 0.825s	user 0.005s	sys 0.000s
W20260709 13:20:02.632934  6846 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:02.632071  6799 raft_consensus.cc:1240] T d8292e16e5654be6bc408560cf256aaa P b7ab4784c7344b939bc36f639286f377 [term 14 FOLLOWER]: Rejecting Update request from peer ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 13. Current term is 14. Ops: [13.8-13.8]
I20260709 13:20:02.444744 10704 raft_consensus.cc:515] T 3d65025eea89441290d85dd053810e31 P cd75a17ab2604397adab03bb8b5fd75c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:02.621946  6732 raft_consensus.cc:2393] T f03d0dbf16864ca4bc1bb5e4c0334c0f P ccd8a4c3bfe3413cb2ae219b09aea832 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c in current term 9: Already voted for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in this term.
I20260709 13:20:02.630544  6804 raft_consensus.cc:1275] T f5be3a11b23d4ea9b08300a2789821c7 P b7ab4784c7344b939bc36f639286f377 [term 8 FOLLOWER]: Refusing update from remote peer ccd8a4c3bfe3413cb2ae219b09aea832: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:20:02.663506  6730 raft_consensus.cc:2368] T 9e326172347f45e99a0d482b5d8ef768 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c for earlier term 9. Current term is 10.
I20260709 13:20:02.621162  6724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3411566abe2d4c9bb4b2adfdd05e6f17" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:20:02.631335  6801 raft_consensus.cc:1240] T 1bf4668eeb70467fb3dc5a0289233b3c P b7ab4784c7344b939bc36f639286f377 [term 11 FOLLOWER]: Rejecting Update request from peer ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 10. Current term is 11. Ops: [10.7-10.7]
I20260709 13:20:02.635970  6805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f58dc08b12a2494bb9a1372837970ca2" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
W20260709 13:20:02.664873  6697 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 99984.2us
I20260709 13:20:02.636706  6803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22ccee1b570c4ad3a57bd7aec085b1b4" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:20:02.636906  6807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "853ac0a8cbd64ce99457f170216d4d0f" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:02.564352 10727 raft_consensus.cc:2749] T d33d5ee8ef6f415593d8df52063161ad P ccd8a4c3bfe3413cb2ae219b09aea832 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:20:02.619668  6726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a75bfe094d4bdc963aba3f08dfcd25" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 11 candidate_status { last_received { term: 10 index: 4 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:02.619374 10785 consensus_queue.cc:260] T d33d5ee8ef6f415593d8df52063161ad P b7ab4784c7344b939bc36f639286f377 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:02.637431  6798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a734b5ab7834e05a8c422208acc58b1" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:20:02.638159  6800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44bde925b2e541b69890d70715b85176" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:20:02.652853  6770 leader_election.cc:304] T e77e330a82df4b43a745d57a68f6f057 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:20:02.513948 10580 leader_election.cc:290] T 713b5728a197487c9300b310ab94e5a3 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 12 election: Requested vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:02.677354  6731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d33d5ee8ef6f415593d8df52063161ad" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:20:02.587642 10715 raft_consensus.cc:515] T c4db81d9d329422bb3b4160ca4ac2d1d P cd75a17ab2604397adab03bb8b5fd75c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:02.675333  6805 raft_consensus.cc:1275] T 95a75bfe094d4bdc963aba3f08dfcd25 P b7ab4784c7344b939bc36f639286f377 [term 11 FOLLOWER]: Refusing update from remote peer ccd8a4c3bfe3413cb2ae219b09aea832: Log matching property violated. Preceding OpId in replica: term: 10 index: 4. Preceding OpId from leader: term: 11 index: 5. (index mismatch)
I20260709 13:20:02.698915  6697 leader_election.cc:304] T e31b9971c15848dea59d4d4130141d9e P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:20:02.699352  6803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6869f07b5a4885a0b99fbe60c3b175" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 12 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:02.656338  6802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "713b5728a197487c9300b310ab94e5a3" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
W20260709 13:20:02.562338 10692 consensus_meta.cc:287] T f4b8bd455d5a47c18a1380839c6e0d61 P ccd8a4c3bfe3413cb2ae219b09aea832: Time spent flushing consensus metadata: real 0.895s	user 0.013s	sys 0.001s
I20260709 13:20:02.486639 10735 leader_election.cc:290] T 4d9def8b32fd443aa94ab1420b06837b P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 11 election: Requested vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:02.456210 10700 raft_consensus.cc:515] T 7c37d41cd9164c15a6826ca62a851a69 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:02.666644  6807 raft_consensus.cc:2393] T 853ac0a8cbd64ce99457f170216d4d0f P b7ab4784c7344b939bc36f639286f377 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ccd8a4c3bfe3413cb2ae219b09aea832 in current term 8: Already voted for candidate b7ab4784c7344b939bc36f639286f377 in this term.
I20260709 13:20:02.710250 10735 raft_consensus.cc:2749] T e31b9971c15848dea59d4d4130141d9e P ccd8a4c3bfe3413cb2ae219b09aea832 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:20:02.708375 10762 raft_consensus.cc:493] T f4b8bd455d5a47c18a1380839c6e0d61 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:02.689985 10752 leader_election.cc:290] T 90d42e216d9741e190bca19a781291fd P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:20:02.708335 10557 raft_consensus.cc:2749] T e77e330a82df4b43a745d57a68f6f057 P b7ab4784c7344b939bc36f639286f377 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:20:02.717217 10762 raft_consensus.cc:515] T f4b8bd455d5a47c18a1380839c6e0d61 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:02.708338 10487 raft_consensus.cc:493] T 711ef6523deb4cbe8ef2ba61e1c21c98 P b7ab4784c7344b939bc36f639286f377 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:02.657243 10650 raft_consensus.cc:740] T 404190ce4ce94cecbfcb6ea9d1dd8626 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 7ba59cc884714e8aa5f3f0ecaed84cbb, State: Running, Role: LEADER
I20260709 13:20:02.692710 10738 leader_election.cc:290] T bd6869f07b5a4885a0b99fbe60c3b175 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:20:02.671868  6804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d9def8b32fd443aa94ab1420b06837b" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 11 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:20:02.617781 10722 raft_consensus.cc:3055] T 3fa34c08b205435dba97346991aa1f92 P cd75a17ab2604397adab03bb8b5fd75c [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:20:02.701191  6802 raft_consensus.cc:3060] T 713b5728a197487c9300b310ab94e5a3 P b7ab4784c7344b939bc36f639286f377 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:20:02.671572  6799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "427c124d773f483294511e80fe340075" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
W20260709 13:20:02.702663  6770 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 49981.1us
I20260709 13:20:02.672539  6801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c7f33e544204fbaac4078e3e83bbf4e" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:20:02.724303  6770 leader_election.cc:304] T 4d9def8b32fd443aa94ab1420b06837b P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:20:02.693922 10788 raft_consensus.cc:3055] T 22ccee1b570c4ad3a57bd7aec085b1b4 P b7ab4784c7344b939bc36f639286f377 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:20:02.694629  6877 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58592 (request call id 293) took 1507 ms. Trace:
I20260709 13:20:02.705859  6726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1704639a875409b9959353527b3fd68" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:20:02.718554 10487 raft_consensus.cc:515] T 711ef6523deb4cbe8ef2ba61e1c21c98 P b7ab4784c7344b939bc36f639286f377 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:02.567019 10621 raft_consensus.cc:515] T 4d9def8b32fd443aa94ab1420b06837b P cd75a17ab2604397adab03bb8b5fd75c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:02.693986 10775 raft_consensus.cc:515] T 3a485a995abc4807b6e511e45419f737 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:02.666934 10418 raft_consensus.cc:697] T 9e326172347f45e99a0d482b5d8ef768 P b7ab4784c7344b939bc36f639286f377 [term 10 LEADER]: Becoming Leader. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
I20260709 13:20:02.655203 10758 raft_consensus.cc:493] T 4275cf08e63345f993bce8664eada830 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:02.694410 10704 leader_election.cc:290] T 3d65025eea89441290d85dd053810e31 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
W20260709 13:20:02.721159  7466 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 347182us
I20260709 13:20:02.787321  7466 leader_election.cc:304] T 3fa34c08b205435dba97346991aa1f92 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
W20260709 13:20:02.645301  6630 rpcz_store.cc:269] 0709 13:19:03.228412 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:03.295559 (+ 67147us) service_pool.cc:224] Handling call
0709 13:19:03.885171 (+589612us) spinlock_profiling.cc:243] Waited 185 ms on lock 0x7b5400156154. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f914090 00007fcc0f9b2f3a 00007fcc157691cc 00007fcc1586737e 00007fcc13d282a4 00007fcc13d28232 00007fcc13d28161 00007fcc13d280dc 00007fcc13d27392 00007fcc0dce548c 00007fcc0dce48c6
0709 13:20:02.603486 (+58718315us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:19:56.676432 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:19:56.677138 (+   706us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:19:56.677199 (+    61us) write_op.cc:435] Acquired schema lock
0709 13:19:56.677232 (+    33us) tablet.cc:662] Decoding operations
0709 13:19:56.770075 (+ 92843us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:19:56.778632 (+  8557us) write_op.cc:641] Partition lock acquired for write op
0709 13:19:56.783559 (+  4927us) tablet.cc:685] Acquiring locks for 5 operations
0709 13:19:56.855943 (+ 72384us) tablet.cc:701] Row locks acquired
0709 13:19:56.855980 (+    37us) write_op.cc:260] PREPARE: finished
0709 13:19:56.856181 (+   201us) write_op.cc:270] Start()
0709 13:19:56.856341 (+   160us) write_op.cc:276] Timestamp: P: 1783603196856117 usec, L: 0
0709 13:19:56.856364 (+    23us) op_driver.cc:348] REPLICATION: starting
0709 13:19:56.857101 (+   737us) log.cc:844] Serialized 2078 byte log entry
0709 13:19:57.894168 (+1037067us) op_driver.cc:464] REPLICATION: finished
0709 13:19:58.242932 (+348764us) write_op.cc:301] APPLY: starting
0709 13:19:58.243049 (+   117us) tablet.cc:1367] starting BulkCheckPresence
0709 13:19:58.243252 (+   203us) tablet.cc:1370] finished BulkCheckPresence
0709 13:19:58.243403 (+   151us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:19:58.275631 (+ 32228us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:19:58.276006 (+   375us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=5
0709 13:19:58.276146 (+   140us) write_op.cc:312] APPLY: finished
0709 13:19:58.276585 (+   439us) log.cc:844] Serialized 46 byte log entry
0709 13:19:58.276844 (+   259us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:19:58.276999 (+   155us) write_op.cc:454] Released schema lock
0709 13:19:58.277061 (+    62us) write_op.cc:341] FINISH: Updating metrics
0709 13:19:58.300508 (+ 23447us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:19:58.302833 (+  2325us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":6949,"reported_tablets":46,"spinlock_wait_cycles":424634752,"child_traces":[["op",{"apply.queue_time_us":319662,"apply.run_cpu_time_us":4109,"apply.run_wall_time_us":56561,"num_ops":5,"prepare.queue_time_us":175687,"prepare.run_cpu_time_us":50459,"prepare.run_wall_time_us":343379,"raft.queue_time_us":162154,"raft.run_cpu_time_us":44973,"raft.run_wall_time_us":321347,"replication_time_us":1024166,"thread_start_us":575583,"threads_started":4,"wal-append.queue_time_us":221942,"wal-append.run_cpu_time_us":49004,"wal-append.run_wall_time_us":2236691}]]}
I20260709 13:20:02.788498  7466 leader_election.cc:304] T 427c124d773f483294511e80fe340075 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:20:02.657722 10708 raft_consensus.cc:3060] T de3186201e1a40d0b335eeb8b4e256e0 P b7ab4784c7344b939bc36f639286f377 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:20:02.722190  6731 raft_consensus.cc:2393] T d33d5ee8ef6f415593d8df52063161ad P ccd8a4c3bfe3413cb2ae219b09aea832 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c in current term 11: Already voted for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in this term.
W20260709 13:20:02.723481  7468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 394031us
I20260709 13:20:02.671675 10794 raft_consensus.cc:2749] T 90d42e216d9741e190bca19a781291fd P ccd8a4c3bfe3413cb2ae219b09aea832 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:20:02.794094  6730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "427c124d773f483294511e80fe340075" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:02.696085  6732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4b8bd455d5a47c18a1380839c6e0d61" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:02.726145  6770 leader_election.cc:304] T 404190ce4ce94cecbfcb6ea9d1dd8626 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:20:02.726387  6695 leader_election.cc:304] T 22ccee1b570c4ad3a57bd7aec085b1b4 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:20:02.724575  6697 leader_election.cc:304] T 853ac0a8cbd64ce99457f170216d4d0f P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:20:02.730149  6726 raft_consensus.cc:2393] T a1704639a875409b9959353527b3fd68 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c in current term 11: Already voted for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in this term.
I20260709 13:20:02.706835  6846 leader_election.cc:304] T 4f00a2e87e56452083b759f60d461ee3 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
W20260709 13:20:02.796691  6846 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.68:45071, user_credentials={real_user=slave}} blocked reactor thread for 89940.8us
I20260709 13:20:02.797118 10367 raft_consensus.cc:2749] T 22ccee1b570c4ad3a57bd7aec085b1b4 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:20:02.646885 10446 raft_consensus.cc:3055] T a3022224cc81473690653a83d4e99470 P b7ab4784c7344b939bc36f639286f377 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:20:02.777505  6728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbdf895bba214ff68685a24fd17dfb5d" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:20:02.798578  6728 raft_consensus.cc:2393] T dbdf895bba214ff68685a24fd17dfb5d P ccd8a4c3bfe3413cb2ae219b09aea832 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c in current term 10: Already voted for candidate b7ab4784c7344b939bc36f639286f377 in this term.
I20260709 13:20:02.797713 10418 consensus_queue.cc:237] T 9e326172347f45e99a0d482b5d8ef768 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:02.729184  6877 rpcz_store.cc:276] 0709 13:20:01.187686 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:01.448809 (+261123us) service_pool.cc:224] Handling call
0709 13:20:01.449086 (+   277us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:01.501746 (+ 52660us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:20:01.513254 (+ 11508us) log.cc:844] Serialized 14 byte log entry
0709 13:20:02.372293 (+859039us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:20:02.372344 (+    51us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:20:02.372395 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:02.583568 (+211173us) spinlock_profiling.cc:243] Waited 6.03 ms on lock 0x7b4400022b4c. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0c745db1 00007fcc0c7e3c85 00007fcc0c7e46a2 00007fcc0f5561db 00007fcc0f551aaf 00007fcc0f54586e 00007fcc0f544bb6 00007fcc0f5447d8 00007fcc0f54e221 00007fcc0f54e1d9 00007fcc0f54e169
0709 13:20:02.694347 (+110779us) spinlock_profiling.cc:243] Waited 52.4 ms on lock 0x7b5400141ed4. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f9aae01 00007fcc0f9a983e 00007fcc1496e419 00007fcc0dee5bd4 00007fcc0dee5b62 00007fcc0dee5a91 00007fcc0dee5a0c 00007fcc0dee4cc2 00007fcc0dce548c 00007fcc0dce48c6
0709 13:20:02.694400 (+    53us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:02.694567 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":651187,"prepare.queue_time_us":11047,"prepare.run_cpu_time_us":44,"prepare.run_wall_time_us":44,"raft.queue_time_us":629674,"raft.run_cpu_time_us":142,"raft.run_wall_time_us":7748,"spinlock_wait_cycles":134344320,"thread_start_us":245304,"threads_started":1,"wal-append.queue_time_us":246046}
I20260709 13:20:02.707926 10580 consensus_queue.cc:1048] T 95a75bfe094d4bdc963aba3f08dfcd25 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.017s
I20260709 13:20:02.728976 10788 raft_consensus.cc:740] T 22ccee1b570c4ad3a57bd7aec085b1b4 P b7ab4784c7344b939bc36f639286f377 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
W20260709 13:20:02.801163  6770 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 75101.5us
I20260709 13:20:02.800843 10788 consensus_queue.cc:260] T 22ccee1b570c4ad3a57bd7aec085b1b4 P b7ab4784c7344b939bc36f639286f377 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:02.802196  6770 leader_election.cc:304] T 2c240553ce044eedb41541d72b9475d7 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:20:02.802666 10788 raft_consensus.cc:3060] T 22ccee1b570c4ad3a57bd7aec085b1b4 P b7ab4784c7344b939bc36f639286f377 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:20:02.721215  6804 raft_consensus.cc:3060] T 4d9def8b32fd443aa94ab1420b06837b P b7ab4784c7344b939bc36f639286f377 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:20:02.722855 10722 raft_consensus.cc:740] T 3fa34c08b205435dba97346991aa1f92 P cd75a17ab2604397adab03bb8b5fd75c [term 11 LEADER]: Becoming Follower/Learner. State: Replica: cd75a17ab2604397adab03bb8b5fd75c, State: Running, Role: LEADER
I20260709 13:20:02.792667  6802 raft_consensus.cc:2468] T 713b5728a197487c9300b310ab94e5a3 P b7ab4784c7344b939bc36f639286f377 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 12.
I20260709 13:20:02.795703  6732 raft_consensus.cc:2468] T f4b8bd455d5a47c18a1380839c6e0d61 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 9.
W20260709 13:20:02.815724  6695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 89427.8us
I20260709 13:20:02.823539  6695 leader_election.cc:304] T 7a734b5ab7834e05a8c422208acc58b1 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:20:02.715446 10249 leader_election.cc:290] T 1bf4668eeb70467fb3dc5a0289233b3c P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 11 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:02.827703  6770 leader_election.cc:304] T 853ac0a8cbd64ce99457f170216d4d0f P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
I20260709 13:20:02.810544 10446 raft_consensus.cc:740] T a3022224cc81473690653a83d4e99470 P b7ab4784c7344b939bc36f639286f377 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
I20260709 13:20:02.814278 10650 consensus_queue.cc:260] T 404190ce4ce94cecbfcb6ea9d1dd8626 P 7ba59cc884714e8aa5f3f0ecaed84cbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:20:02.811748 10525 raft_consensus.cc:2749] T 2c240553ce044eedb41541d72b9475d7 P b7ab4784c7344b939bc36f639286f377 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:20:02.812338 10447 consensus_queue.cc:1059] T 44bde925b2e541b69890d70715b85176 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:20:02.813714 10487 leader_election.cc:290] T 711ef6523deb4cbe8ef2ba61e1c21c98 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:02.792455  6724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77e330a82df4b43a745d57a68f6f057" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
W20260709 13:20:02.796449  6697 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 71952us
I20260709 13:20:02.728415 10727 consensus_queue.cc:1059] T d8292e16e5654be6bc408560cf256aaa P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.099s
I20260709 13:20:02.810019 10704 raft_consensus.cc:2804] T 4f00a2e87e56452083b759f60d461ee3 P cd75a17ab2604397adab03bb8b5fd75c [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:20:02.775952 10692 consensus_queue.cc:1059] T 1bf4668eeb70467fb3dc5a0289233b3c P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.036s
I20260709 13:20:02.813906 10700 leader_election.cc:290] T 7c37d41cd9164c15a6826ca62a851a69 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 10 election: Requested vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:02.815933 10715 leader_election.cc:290] T c4db81d9d329422bb3b4160ca4ac2d1d P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:20:02.722957 10734 consensus_queue.cc:1048] T f5be3a11b23d4ea9b08300a2789821c7 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.086s
I20260709 13:20:02.811183 10560 raft_consensus.cc:2749] T 404190ce4ce94cecbfcb6ea9d1dd8626 P b7ab4784c7344b939bc36f639286f377 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:20:02.797860 10367 raft_consensus.cc:2764] T 853ac0a8cbd64ce99457f170216d4d0f P ccd8a4c3bfe3413cb2ae219b09aea832 [term 8 FOLLOWER]: Leader pre-election decision vote started in defunct term 7: won
I20260709 13:20:02.843765  6724 raft_consensus.cc:2410] T e77e330a82df4b43a745d57a68f6f057 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c for term 13 because replica has last-logged OpId of term: 12 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 5.
I20260709 13:20:02.843827  6697 leader_election.cc:304] T 44bde925b2e541b69890d70715b85176 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
W20260709 13:20:02.932669  6697 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 88936.2us
I20260709 13:20:02.862357 10752 raft_consensus.cc:493] T ce4f062dcd314d43a63ca74067cb5ee3 P cd75a17ab2604397adab03bb8b5fd75c [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 7ba59cc884714e8aa5f3f0ecaed84cbb)
I20260709 13:20:02.794235 10758 raft_consensus.cc:515] T 4275cf08e63345f993bce8664eada830 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:02.838670 10421 raft_consensus.cc:2749] T 7a734b5ab7834e05a8c422208acc58b1 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:20:02.838990 10249 raft_consensus.cc:2804] T 853ac0a8cbd64ce99457f170216d4d0f P b7ab4784c7344b939bc36f639286f377 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:20:02.838876 10777 raft_consensus.cc:493] T 404190ce4ce94cecbfcb6ea9d1dd8626 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 7ba59cc884714e8aa5f3f0ecaed84cbb)
I20260709 13:20:02.839112 10591 raft_consensus.cc:493] T b3f13b31a1f84f0d89d007eadd57924c P ccd8a4c3bfe3413cb2ae219b09aea832 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 7ba59cc884714e8aa5f3f0ecaed84cbb)
W20260709 13:20:02.867651  6773 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.628s	user 0.007s	sys 0.012s
W20260709 13:20:02.908360  6771 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:02.960534  6773 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.721s	user 0.008s	sys 0.012s
W20260709 13:20:02.960882  6771 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:02.852737 10650 raft_consensus.cc:3060] T 404190ce4ce94cecbfcb6ea9d1dd8626 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:20:02.852077 10770 consensus_queue.cc:1175] T 404190ce4ce94cecbfcb6ea9d1dd8626 P 7ba59cc884714e8aa5f3f0ecaed84cbb [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" responder_term: 11 status { last_received { term: 11 index: 9 } last_committed_idx: 8 last_received_current_leader { term: 11 index: 9 } }
W20260709 13:20:02.911996  6770 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 71470.9us
I20260709 13:20:02.840130 10580 consensus_queue.cc:1048] T 95a75bfe094d4bdc963aba3f08dfcd25 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.027s
W20260709 13:20:02.996948 10815 log.cc:927] Time spent T 427c124d773f483294511e80fe340075 P ccd8a4c3bfe3413cb2ae219b09aea832: Append to log took a long time: real 0.078s	user 0.000s	sys 0.000s
W20260709 13:20:02.998714 10812 log.cc:927] Time spent T f3f9c2e2bf644115957398fe4c9459db P cd75a17ab2604397adab03bb8b5fd75c: Append to log took a long time: real 0.138s	user 0.001s	sys 0.000s
W20260709 13:20:02.999677  7469 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:02.967712 10591 raft_consensus.cc:515] T b3f13b31a1f84f0d89d007eadd57924c P ccd8a4c3bfe3413cb2ae219b09aea832 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:20:02.849967 10698 consensus_queue.cc:1059] T f03d0dbf16864ca4bc1bb5e4c0334c0f P b7ab4784c7344b939bc36f639286f377 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.064s
I20260709 13:20:03.025213 10698 raft_consensus.cc:3055] T f03d0dbf16864ca4bc1bb5e4c0334c0f P b7ab4784c7344b939bc36f639286f377 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:20:03.025743 10698 raft_consensus.cc:740] T f03d0dbf16864ca4bc1bb5e4c0334c0f P b7ab4784c7344b939bc36f639286f377 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
I20260709 13:20:03.026801 10698 consensus_queue.cc:260] T f03d0dbf16864ca4bc1bb5e4c0334c0f P b7ab4784c7344b939bc36f639286f377 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:03.028581  6879 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53406 (request call id 1995) took 1271 ms. Trace:
I20260709 13:20:03.029110  6879 rpcz_store.cc:276] 0709 13:20:01.756808 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:01.756990 (+   182us) service_pool.cc:224] Handling call
0709 13:20:01.757351 (+   361us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:02.369978 (+612627us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:02.370011 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:20:02.370603 (+   592us) log.cc:844] Serialized 26 byte log entry
0709 13:20:02.453166 (+ 82563us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:20:02.453204 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:02.453284 (+    80us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:03.028221 (+574937us) raft_consensus.cc:1685] finished
0709 13:20:03.028253 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:03.028479 (+   226us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":656040,"raft.queue_time_us":628044,"raft.run_cpu_time_us":147,"raft.run_wall_time_us":9119,"thread_start_us":82120,"threads_started":1,"wal-append.queue_time_us":423302}
I20260709 13:20:03.032605 10738 raft_consensus.cc:493] T fe20b4b48823486ca3b9c648db6ce8aa P cd75a17ab2604397adab03bb8b5fd75c [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 7ba59cc884714e8aa5f3f0ecaed84cbb)
I20260709 13:20:03.033172 10738 raft_consensus.cc:515] T fe20b4b48823486ca3b9c648db6ce8aa P cd75a17ab2604397adab03bb8b5fd75c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:20:02.828799 10524 consensus_queue.cc:1059] T e31b9971c15848dea59d4d4130141d9e P b7ab4784c7344b939bc36f639286f377 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.033s
I20260709 13:20:03.035272 10738 leader_election.cc:290] T fe20b4b48823486ca3b9c648db6ce8aa P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:20:03.035590 10524 raft_consensus.cc:3055] T e31b9971c15848dea59d4d4130141d9e P b7ab4784c7344b939bc36f639286f377 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:20:03.035951 10524 raft_consensus.cc:740] T e31b9971c15848dea59d4d4130141d9e P b7ab4784c7344b939bc36f639286f377 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
I20260709 13:20:03.036614  6801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8cee0accdb8499c86d4414b72565a38" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:20:03.037072  7500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe20b4b48823486ca3b9c648db6ce8aa" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:20:03.036803 10524 consensus_queue.cc:260] T e31b9971c15848dea59d4d4130141d9e P b7ab4784c7344b939bc36f639286f377 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:03.038462 10524 raft_consensus.cc:3060] T e31b9971c15848dea59d4d4130141d9e P b7ab4784c7344b939bc36f639286f377 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:20:03.042038 10487 raft_consensus.cc:3055] T 44bde925b2e541b69890d70715b85176 P b7ab4784c7344b939bc36f639286f377 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:20:03.042615 10487 raft_consensus.cc:740] T 44bde925b2e541b69890d70715b85176 P b7ab4784c7344b939bc36f639286f377 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
I20260709 13:20:03.044903  6802 raft_consensus.cc:1240] T 404190ce4ce94cecbfcb6ea9d1dd8626 P b7ab4784c7344b939bc36f639286f377 [term 12 FOLLOWER]: Rejecting Update request from peer 7ba59cc884714e8aa5f3f0ecaed84cbb for earlier term 11. Current term is 12. Ops: []
W20260709 13:20:02.925431  6772 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 360462us
I20260709 13:20:02.852905  6730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bf4668eeb70467fb3dc5a0289233b3c" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:20:02.934986  6804 raft_consensus.cc:2468] T 4d9def8b32fd443aa94ab1420b06837b P b7ab4784c7344b939bc36f639286f377 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 11.
I20260709 13:20:03.050158  7500 raft_consensus.cc:1240] T d8cee0accdb8499c86d4414b72565a38 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 10 FOLLOWER]: Rejecting Update request from peer b7ab4784c7344b939bc36f639286f377 for earlier term 9. Current term is 10. Ops: []
I20260709 13:20:03.049914 10063 consensus_queue.cc:1048] T 07a92dd554674067a83a9cb68c4773f2 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:20:02.868239 10704 raft_consensus.cc:697] T 4f00a2e87e56452083b759f60d461ee3 P cd75a17ab2604397adab03bb8b5fd75c [term 11 LEADER]: Becoming Leader. State: Replica: cd75a17ab2604397adab03bb8b5fd75c, State: Running, Role: LEADER
I20260709 13:20:03.052543 10730 raft_consensus.cc:3055] T d8292e16e5654be6bc408560cf256aaa P ccd8a4c3bfe3413cb2ae219b09aea832 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:20:03.052968 10730 raft_consensus.cc:740] T d8292e16e5654be6bc408560cf256aaa P ccd8a4c3bfe3413cb2ae219b09aea832 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
I20260709 13:20:03.054942  6877 raft_consensus.cc:1240] T f58dc08b12a2494bb9a1372837970ca2 P cd75a17ab2604397adab03bb8b5fd75c [term 13 FOLLOWER]: Rejecting Update request from peer b7ab4784c7344b939bc36f639286f377 for earlier term 12. Current term is 13. Ops: []
I20260709 13:20:03.057494 10557 raft_consensus.cc:2749] T 4d9def8b32fd443aa94ab1420b06837b P b7ab4784c7344b939bc36f639286f377 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:20:02.913405 10715 raft_consensus.cc:493] T 4b8cacb381b746da8d0049b0a83b41dd P cd75a17ab2604397adab03bb8b5fd75c [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:03.058688 10715 raft_consensus.cc:515] T 4b8cacb381b746da8d0049b0a83b41dd P cd75a17ab2604397adab03bb8b5fd75c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:20:03.060530  6728 raft_consensus.cc:1240] T 3a485a995abc4807b6e511e45419f737 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 10 FOLLOWER]: Rejecting Update request from peer b7ab4784c7344b939bc36f639286f377 for earlier term 9. Current term is 10. Ops: []
I20260709 13:20:03.061944  6728 raft_consensus.cc:1240] T 7a734b5ab7834e05a8c422208acc58b1 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 10 FOLLOWER]: Rejecting Update request from peer b7ab4784c7344b939bc36f639286f377 for earlier term 9. Current term is 10. Ops: []
I20260709 13:20:02.953835  6697 leader_election.cc:304] T ce4f062dcd314d43a63ca74067cb5ee3 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:20:02.953819  6724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b3759de40694069b13c0f8bd40e5709" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
W20260709 13:20:03.062659  6697 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 108921us
I20260709 13:20:03.063094  6728 raft_consensus.cc:1275] T f4b8bd455d5a47c18a1380839c6e0d61 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 9 FOLLOWER]: Refusing update from remote peer b7ab4784c7344b939bc36f639286f377: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:20:03.063431  6724 raft_consensus.cc:1240] T 17587d6730594da4a56fa13a353232a1 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 14 FOLLOWER]: Rejecting Update request from peer b7ab4784c7344b939bc36f639286f377 for earlier term 13. Current term is 14. Ops: []
I20260709 13:20:02.955493  6726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24ee15416e3145beaa1b8183453729a3" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 11 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:20:02.958557  6732 raft_consensus.cc:1240] T 7c37d41cd9164c15a6826ca62a851a69 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 10 FOLLOWER]: Rejecting Update request from peer b7ab4784c7344b939bc36f639286f377 for earlier term 8. Current term is 10. Ops: []
I20260709 13:20:03.064765  6726 raft_consensus.cc:2410] T 24ee15416e3145beaa1b8183453729a3 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c for term 11 because replica has last-logged OpId of term: 10 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 13:20:03.065793  6726 raft_consensus.cc:1240] T fe20b4b48823486ca3b9c648db6ce8aa P ccd8a4c3bfe3413cb2ae219b09aea832 [term 9 FOLLOWER]: Rejecting Update request from peer 7ba59cc884714e8aa5f3f0ecaed84cbb for earlier term 8. Current term is 9. Ops: []
I20260709 13:20:02.916460 10802 consensus_queue.cc:1048] T f09c2a98de1a4decabd0ff900dd44caa P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.043s
I20260709 13:20:03.067178 10758 leader_election.cc:290] T 4275cf08e63345f993bce8664eada830 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:03.067333  6726 raft_consensus.cc:1240] T a1704639a875409b9959353527b3fd68 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 11 FOLLOWER]: Rejecting Update request from peer b7ab4784c7344b939bc36f639286f377 for earlier term 10. Current term is 11. Ops: []
I20260709 13:20:02.914463 10446 consensus_queue.cc:260] T a3022224cc81473690653a83d4e99470 P b7ab4784c7344b939bc36f639286f377 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:03.052433  7502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f00a2e87e56452083b759f60d461ee3" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 11 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb"
I20260709 13:20:03.065692 10571 raft_consensus.cc:2749] T ce4f062dcd314d43a63ca74067cb5ee3 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:20:02.949755 10547 raft_consensus.cc:2749] T 44bde925b2e541b69890d70715b85176 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:20:03.074271  7502 raft_consensus.cc:2393] T 4f00a2e87e56452083b759f60d461ee3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate b7ab4784c7344b939bc36f639286f377 in current term 11: Already voted for candidate cd75a17ab2604397adab03bb8b5fd75c in this term.
I20260709 13:20:02.976698  6695 leader_election.cc:304] T 713b5728a197487c9300b310ab94e5a3 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
I20260709 13:20:03.074949  6875 raft_consensus.cc:1240] T 3411566abe2d4c9bb4b2adfdd05e6f17 P cd75a17ab2604397adab03bb8b5fd75c [term 9 FOLLOWER]: Rejecting Update request from peer b7ab4784c7344b939bc36f639286f377 for earlier term 8. Current term is 9. Ops: []
I20260709 13:20:03.075111 10547 raft_consensus.cc:2804] T 713b5728a197487c9300b310ab94e5a3 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 12 FOLLOWER]: Leader election won for term 12
W20260709 13:20:03.075466  6846 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:03.075766 10547 raft_consensus.cc:697] T 713b5728a197487c9300b310ab94e5a3 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 12 LEADER]: Becoming Leader. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
I20260709 13:20:03.069389  7495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b8cacb381b746da8d0049b0a83b41dd" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:20:03.077386  6880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "853ac0a8cbd64ce99457f170216d4d0f" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:20:03.077579  7495 raft_consensus.cc:2468] T 4b8cacb381b746da8d0049b0a83b41dd P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 10.
I20260709 13:20:03.069679  6731 raft_consensus.cc:1275] T bd6869f07b5a4885a0b99fbe60c3b175 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 11 FOLLOWER]: Refusing update from remote peer b7ab4784c7344b939bc36f639286f377: Log matching property violated. Preceding OpId in replica: term: 9 index: 4. Preceding OpId from leader: term: 11 index: 5. (index mismatch)
I20260709 13:20:03.070268 10734 consensus_queue.cc:1048] T 1bf4668eeb70467fb3dc5a0289233b3c P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:20:03.079310  6846 leader_election.cc:304] T 4b8cacb381b746da8d0049b0a83b41dd P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:20:02.950199 10813 raft_consensus.cc:2804] T 3fa34c08b205435dba97346991aa1f92 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:20:03.077783  6697 leader_election.cc:304] T f58dc08b12a2494bb9a1372837970ca2 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377
W20260709 13:20:03.074945  6695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 98323.6us
I20260709 13:20:02.992820 10621 leader_election.cc:290] T 4d9def8b32fd443aa94ab1420b06837b P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:20:03.079209  6726 raft_consensus.cc:1275] T ab432e62819d499eaaf3dd55481dd930 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 12 FOLLOWER]: Refusing update from remote peer b7ab4784c7344b939bc36f639286f377: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 12 index: 6. (index mismatch)
I20260709 13:20:03.078049  6880 raft_consensus.cc:3060] T 853ac0a8cbd64ce99457f170216d4d0f P cd75a17ab2604397adab03bb8b5fd75c [term 6 FOLLOWER]: Advancing to term 8
I20260709 13:20:02.954560 10692 consensus_queue.cc:1048] T de3186201e1a40d0b335eeb8b4e256e0 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.132s
I20260709 13:20:02.961510 10700 consensus_queue.cc:1048] T 711ef6523deb4cbe8ef2ba61e1c21c98 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.132s
W20260709 13:20:03.077771  6770 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 84096.9us
I20260709 13:20:03.093755  6876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d9def8b32fd443aa94ab1420b06837b" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 11 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:20:03.097543  6876 raft_consensus.cc:3060] T 4d9def8b32fd443aa94ab1420b06837b P cd75a17ab2604397adab03bb8b5fd75c [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:20:03.080875  6728 raft_consensus.cc:1240] T 3fa34c08b205435dba97346991aa1f92 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 12 FOLLOWER]: Rejecting Update request from peer cd75a17ab2604397adab03bb8b5fd75c for earlier term 11. Current term is 12. Ops: [11.10-11.10]
I20260709 13:20:02.973886 10725 raft_consensus.cc:493] T 4b8cacb381b746da8d0049b0a83b41dd P ccd8a4c3bfe3413cb2ae219b09aea832 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:03.068542 10775 leader_election.cc:290] T 3a485a995abc4807b6e511e45419f737 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 10 election: Requested vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:02.963063 10249 raft_consensus.cc:697] T 853ac0a8cbd64ce99457f170216d4d0f P b7ab4784c7344b939bc36f639286f377 [term 8 LEADER]: Becoming Leader. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
I20260709 13:20:02.962438 10814 raft_consensus.cc:2749] T 427c124d773f483294511e80fe340075 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:20:03.109726  6802 raft_consensus.cc:1275] T 711ef6523deb4cbe8ef2ba61e1c21c98 P b7ab4784c7344b939bc36f639286f377 [term 11 FOLLOWER]: Refusing update from remote peer ccd8a4c3bfe3413cb2ae219b09aea832: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:20:03.103529  7500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1528ab62b6fe4e3099d08f141afee116" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:20:03.112238  6874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbdf895bba214ff68685a24fd17dfb5d" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 10 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:20:03.126840  6877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4275cf08e63345f993bce8664eada830" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:03.128012  6874 raft_consensus.cc:2393] T dbdf895bba214ff68685a24fd17dfb5d P cd75a17ab2604397adab03bb8b5fd75c [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate b7ab4784c7344b939bc36f639286f377 in current term 10: Already voted for candidate cd75a17ab2604397adab03bb8b5fd75c in this term.
I20260709 13:20:03.103063  6880 raft_consensus.cc:2468] T 853ac0a8cbd64ce99457f170216d4d0f P cd75a17ab2604397adab03bb8b5fd75c [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 8.
I20260709 13:20:03.130427  6880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "713b5728a197487c9300b310ab94e5a3" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:20:03.084832  6879 raft_consensus.cc:1240] T 7ba5dac66ab5497e9e336f2a3c28cda5 P cd75a17ab2604397adab03bb8b5fd75c [term 11 FOLLOWER]: Rejecting Update request from peer b7ab4784c7344b939bc36f639286f377 for earlier term 10. Current term is 11. Ops: []
I20260709 13:20:03.132238  6879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8292e16e5654be6bc408560cf256aaa" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:20:03.133055  6879 raft_consensus.cc:3060] T d8292e16e5654be6bc408560cf256aaa P cd75a17ab2604397adab03bb8b5fd75c [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:03.114568  6770 leader_election.cc:304] T dbdf895bba214ff68685a24fd17dfb5d P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
I20260709 13:20:02.973843 10765 raft_consensus.cc:493] T 17587d6730594da4a56fa13a353232a1 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:02.973958 10421 raft_consensus.cc:493] T bb3d8792045a4583ae2e965b1350a5b4 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader cd75a17ab2604397adab03bb8b5fd75c)
I20260709 13:20:03.127545  6877 raft_consensus.cc:2468] T 4275cf08e63345f993bce8664eada830 P cd75a17ab2604397adab03bb8b5fd75c [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 11.
I20260709 13:20:03.145432  6876 raft_consensus.cc:2410] T 4d9def8b32fd443aa94ab1420b06837b P cd75a17ab2604397adab03bb8b5fd75c [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate ccd8a4c3bfe3413cb2ae219b09aea832 for term 11 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 4.
I20260709 13:20:03.147114  6799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c37d41cd9164c15a6826ca62a851a69" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:20:03.147970  6799 raft_consensus.cc:3060] T 7c37d41cd9164c15a6826ca62a851a69 P b7ab4784c7344b939bc36f639286f377 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:20:03.148176  6807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a485a995abc4807b6e511e45419f737" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:20:03.151594  6803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4275cf08e63345f993bce8664eada830" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:03.154831  6805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3f13b31a1f84f0d89d007eadd57924c" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:03.155658  6805 raft_consensus.cc:2468] T b3f13b31a1f84f0d89d007eadd57924c P b7ab4784c7344b939bc36f639286f377 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 9.
I20260709 13:20:03.157049  6695 leader_election.cc:304] T 4d9def8b32fd443aa94ab1420b06837b P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
I20260709 13:20:02.966310 10777 raft_consensus.cc:515] T 404190ce4ce94cecbfcb6ea9d1dd8626 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
W20260709 13:20:03.163471 10711 consensus_meta.cc:287] T 20f6842e26174571996b8dea4151d4be P ccd8a4c3bfe3413cb2ae219b09aea832: Time spent flushing consensus metadata: real 0.551s	user 0.011s	sys 0.000s
I20260709 13:20:03.122427 10725 raft_consensus.cc:515] T 4b8cacb381b746da8d0049b0a83b41dd P ccd8a4c3bfe3413cb2ae219b09aea832 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:20:03.164103 10777 leader_election.cc:290] T 404190ce4ce94cecbfcb6ea9d1dd8626 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:20:03.076727 10547 consensus_queue.cc:237] T 713b5728a197487c9300b310ab94e5a3 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:02.959303 10752 raft_consensus.cc:515] T ce4f062dcd314d43a63ca74067cb5ee3 P cd75a17ab2604397adab03bb8b5fd75c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } attrs { replace: true } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:20:03.112910 10802 raft_consensus.cc:493] T f5be3a11b23d4ea9b08300a2789821c7 P b7ab4784c7344b939bc36f639286f377 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:03.152530  6803 raft_consensus.cc:2468] T 4275cf08e63345f993bce8664eada830 P b7ab4784c7344b939bc36f639286f377 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 11.
I20260709 13:20:03.171028  6695 leader_election.cc:304] T b3f13b31a1f84f0d89d007eadd57924c P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
I20260709 13:20:03.166527  6725 raft_consensus.cc:2410] T 20f6842e26174571996b8dea4151d4be P ccd8a4c3bfe3413cb2ae219b09aea832 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c for term 12 because replica has last-logged OpId of term: 11 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
I20260709 13:20:03.104156 10580 raft_consensus.cc:493] T 24ee15416e3145beaa1b8183453729a3 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:03.103781 10747 raft_consensus.cc:2804] T 4b8cacb381b746da8d0049b0a83b41dd P cd75a17ab2604397adab03bb8b5fd75c [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:20:03.096917 10794 raft_consensus.cc:2804] T f58dc08b12a2494bb9a1372837970ca2 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:20:03.184962  6803 raft_consensus.cc:1240] T 1bf4668eeb70467fb3dc5a0289233b3c P b7ab4784c7344b939bc36f639286f377 [term 11 FOLLOWER]: Rejecting Update request from peer ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 10. Current term is 11. Ops: [10.7-10.7]
I20260709 13:20:03.168892  6801 raft_consensus.cc:1275] T 2c240553ce044eedb41541d72b9475d7 P b7ab4784c7344b939bc36f639286f377 [term 12 FOLLOWER]: Refusing update from remote peer ccd8a4c3bfe3413cb2ae219b09aea832: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:20:03.166570  6802 raft_consensus.cc:1275] T de3186201e1a40d0b335eeb8b4e256e0 P b7ab4784c7344b939bc36f639286f377 [term 11 FOLLOWER]: Refusing update from remote peer ccd8a4c3bfe3413cb2ae219b09aea832: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
W20260709 13:20:03.171875  6844 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.618s	user 0.045s	sys 0.070s
W20260709 13:20:03.186304  6844 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.633s	user 0.046s	sys 0.070s
I20260709 13:20:03.086122 10715 leader_election.cc:290] T 4b8cacb381b746da8d0049b0a83b41dd P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:20:03.043730 10487 consensus_queue.cc:260] T 44bde925b2e541b69890d70715b85176 P b7ab4784c7344b939bc36f639286f377 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
W20260709 13:20:03.124338 10695 consensus_meta.cc:287] T a1704639a875409b9959353527b3fd68 P b7ab4784c7344b939bc36f639286f377: Time spent flushing consensus metadata: real 0.523s	user 0.005s	sys 0.005s
W20260709 13:20:03.178161  6770 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 63739us
I20260709 13:20:03.093583 10713 consensus_queue.cc:1059] T a3022224cc81473690653a83d4e99470 P b7ab4784c7344b939bc36f639286f377 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.071s
I20260709 13:20:03.195130  6801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "404190ce4ce94cecbfcb6ea9d1dd8626" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:03.068022 10758 consensus_queue.cc:1048] T 2c240553ce044eedb41541d72b9475d7 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 3, Time since last communication: 0.099s
I20260709 13:20:03.181252  6874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c7f33e544204fbaac4078e3e83bbf4e" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:20:03.207690  6874 raft_consensus.cc:2393] T 8c7f33e544204fbaac4078e3e83bbf4e P cd75a17ab2604397adab03bb8b5fd75c [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate ccd8a4c3bfe3413cb2ae219b09aea832 in current term 8: Already voted for candidate b7ab4784c7344b939bc36f639286f377 in this term.
I20260709 13:20:03.120873 10698 raft_consensus.cc:3060] T f03d0dbf16864ca4bc1bb5e4c0334c0f P b7ab4784c7344b939bc36f639286f377 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:20:03.122701 10738 raft_consensus.cc:493] T 713b5728a197487c9300b310ab94e5a3 P cd75a17ab2604397adab03bb8b5fd75c [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:20:03.186848  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 634626us
I20260709 13:20:03.202600  6877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b8cacb381b746da8d0049b0a83b41dd" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:03.205904  6872 raft_consensus.cc:1240] T 7887766dc6784fcaa42b35c05fea7a99 P cd75a17ab2604397adab03bb8b5fd75c [term 11 FOLLOWER]: Rejecting Update request from peer b7ab4784c7344b939bc36f639286f377 for earlier term 10. Current term is 11. Ops: []
I20260709 13:20:03.227046 10487 raft_consensus.cc:3060] T 44bde925b2e541b69890d70715b85176 P b7ab4784c7344b939bc36f639286f377 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:20:03.227521  6872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "711ef6523deb4cbe8ef2ba61e1c21c98" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:03.228166  6872 raft_consensus.cc:2468] T 711ef6523deb4cbe8ef2ba61e1c21c98 P cd75a17ab2604397adab03bb8b5fd75c [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 11.
I20260709 13:20:03.228966  6872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6869f07b5a4885a0b99fbe60c3b175" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 12 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:03.206491  6802 raft_consensus.cc:1240] T d8292e16e5654be6bc408560cf256aaa P b7ab4784c7344b939bc36f639286f377 [term 14 FOLLOWER]: Rejecting Update request from peer ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 13. Current term is 14. Ops: [13.8-13.8]
I20260709 13:20:03.177428 10775 raft_consensus.cc:2804] T 4d9def8b32fd443aa94ab1420b06837b P ccd8a4c3bfe3413cb2ae219b09aea832 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:20:03.247222  6799 raft_consensus.cc:2468] T 7c37d41cd9164c15a6826ca62a851a69 P b7ab4784c7344b939bc36f639286f377 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 10.
I20260709 13:20:03.121562 10818 consensus_queue.cc:1059] T d33d5ee8ef6f415593d8df52063161ad P b7ab4784c7344b939bc36f639286f377 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.083s
I20260709 13:20:03.249693  7500 raft_consensus.cc:1240] T 7ba5dac66ab5497e9e336f2a3c28cda5 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 11 FOLLOWER]: Rejecting Update request from peer b7ab4784c7344b939bc36f639286f377 for earlier term 10. Current term is 11. Ops: []
I20260709 13:20:03.188336 10708 raft_consensus.cc:2804] T dbdf895bba214ff68685a24fd17dfb5d P b7ab4784c7344b939bc36f639286f377 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:20:03.252265  5625 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:20:03.259476 10762 leader_election.cc:290] T f4b8bd455d5a47c18a1380839c6e0d61 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:03.169346 10421 raft_consensus.cc:515] T bb3d8792045a4583ae2e965b1350a5b4 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
W20260709 13:20:03.262971 10810 log.cc:927] Time spent T 3411566abe2d4c9bb4b2adfdd05e6f17 P ccd8a4c3bfe3413cb2ae219b09aea832: Append to log took a long time: real 0.400s	user 0.002s	sys 0.000s
W20260709 13:20:03.264638 10820 log.cc:927] Time spent T b3f13b31a1f84f0d89d007eadd57924c P 7ba59cc884714e8aa5f3f0ecaed84cbb: Append to log took a long time: real 0.077s	user 0.000s	sys 0.000s
I20260709 13:20:03.267284 10730 consensus_queue.cc:260] T d8292e16e5654be6bc408560cf256aaa P ccd8a4c3bfe3413cb2ae219b09aea832 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:03.268335 10730 raft_consensus.cc:3060] T d8292e16e5654be6bc408560cf256aaa P ccd8a4c3bfe3413cb2ae219b09aea832 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:03.180254 10802 raft_consensus.cc:515] T f5be3a11b23d4ea9b08300a2789821c7 P b7ab4784c7344b939bc36f639286f377 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:03.273922 10802 leader_election.cc:290] T f5be3a11b23d4ea9b08300a2789821c7 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:03.276652  6876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c37d41cd9164c15a6826ca62a851a69" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:20:03.277449  6876 raft_consensus.cc:3060] T 7c37d41cd9164c15a6826ca62a851a69 P cd75a17ab2604397adab03bb8b5fd75c [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:20:03.208837  6801 raft_consensus.cc:2393] T 404190ce4ce94cecbfcb6ea9d1dd8626 P b7ab4784c7344b939bc36f639286f377 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ccd8a4c3bfe3413cb2ae219b09aea832 in current term 12: Already voted for candidate b7ab4784c7344b939bc36f639286f377 in this term.
I20260709 13:20:03.189523  6695 leader_election.cc:304] T 4275cf08e63345f993bce8664eada830 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
I20260709 13:20:03.180120 10367 consensus_queue.cc:1048] T 711ef6523deb4cbe8ef2ba61e1c21c98 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.066s
I20260709 13:20:03.230084 10249 consensus_queue.cc:237] T 853ac0a8cbd64ce99457f170216d4d0f P b7ab4784c7344b939bc36f639286f377 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:03.075263 10704 consensus_queue.cc:237] T 4f00a2e87e56452083b759f60d461ee3 P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:20:03.306653 10708 raft_consensus.cc:697] T dbdf895bba214ff68685a24fd17dfb5d P b7ab4784c7344b939bc36f639286f377 [term 10 LEADER]: Becoming Leader. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
I20260709 13:20:03.307647 10708 consensus_queue.cc:237] T dbdf895bba214ff68685a24fd17dfb5d P b7ab4784c7344b939bc36f639286f377 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
W20260709 13:20:03.308904 10825 log.cc:927] Time spent T f09c2a98de1a4decabd0ff900dd44caa P b7ab4784c7344b939bc36f639286f377: Append to log took a long time: real 0.063s	user 0.000s	sys 0.001s
I20260709 13:20:03.184628 10747 raft_consensus.cc:493] T 4b8cacb381b746da8d0049b0a83b41dd P cd75a17ab2604397adab03bb8b5fd75c [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:03.247396 10738 raft_consensus.cc:515] T 713b5728a197487c9300b310ab94e5a3 P cd75a17ab2604397adab03bb8b5fd75c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
W20260709 13:20:03.312546  6695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 123137us
I20260709 13:20:03.205634 10777 raft_consensus.cc:493] T e77e330a82df4b43a745d57a68f6f057 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:03.277611  6874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a485a995abc4807b6e511e45419f737" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:20:03.323760  6801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4b8bd455d5a47c18a1380839c6e0d61" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:03.330228  6874 raft_consensus.cc:3060] T 3a485a995abc4807b6e511e45419f737 P cd75a17ab2604397adab03bb8b5fd75c [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:20:03.291849  7466 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.502s	user 0.004s	sys 0.011s
I20260709 13:20:03.204854 10794 raft_consensus.cc:697] T f58dc08b12a2494bb9a1372837970ca2 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 13 LEADER]: Becoming Leader. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
I20260709 13:20:03.169516 10765 raft_consensus.cc:515] T 17587d6730594da4a56fa13a353232a1 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:20:03.209777 10696 raft_consensus.cc:2804] T b3f13b31a1f84f0d89d007eadd57924c P ccd8a4c3bfe3413cb2ae219b09aea832 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:20:03.288594 10775 raft_consensus.cc:697] T 4d9def8b32fd443aa94ab1420b06837b P ccd8a4c3bfe3413cb2ae219b09aea832 [term 11 LEADER]: Becoming Leader. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
I20260709 13:20:03.304261  6729 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50004 (request call id 1926) took 1455 ms. Trace:
I20260709 13:20:03.241014  6844 leader_election.cc:400] T 3a485a995abc4807b6e511e45419f737 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 8 pre-election: Vote denied by peer b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817) with higher term. Message: Invalid argument: T 3a485a995abc4807b6e511e45419f737 P b7ab4784c7344b939bc36f639286f377 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c for earlier term 8. Current term is 9.
I20260709 13:20:03.185120 10580 raft_consensus.cc:515] T 24ee15416e3145beaa1b8183453729a3 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
W20260709 13:20:03.327322  6695 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:03.331046  6770 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 129094us
I20260709 13:20:03.341156  6880 raft_consensus.cc:3060] T 713b5728a197487c9300b310ab94e5a3 P cd75a17ab2604397adab03bb8b5fd75c [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:20:03.339385  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 98586.5us
W20260709 13:20:03.333359  7466 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.542s	user 0.005s	sys 0.011s
W20260709 13:20:03.335062  7468 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.544s	user 0.040s	sys 0.088s
W20260709 13:20:03.337458  6771 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:03.342896  7468 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.552s	user 0.041s	sys 0.088s
W20260709 13:20:03.343271  7468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 552312us
I20260709 13:20:03.343494  6844 leader_election.cc:304] T 7c37d41cd9164c15a6826ca62a851a69 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:20:03.344255  7498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "427c124d773f483294511e80fe340075" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:20:03.345665  6876 raft_consensus.cc:2468] T 7c37d41cd9164c15a6826ca62a851a69 P cd75a17ab2604397adab03bb8b5fd75c [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 10.
I20260709 13:20:03.346480  6876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bf4668eeb70467fb3dc5a0289233b3c" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:20:03.346973  6876 raft_consensus.cc:3060] T 1bf4668eeb70467fb3dc5a0289233b3c P cd75a17ab2604397adab03bb8b5fd75c [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:20:03.311091 10725 leader_election.cc:290] T 4b8cacb381b746da8d0049b0a83b41dd P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:20:03.348163  7500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce4f062dcd314d43a63ca74067cb5ee3" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
W20260709 13:20:03.328824 10803 consensus_meta.cc:287] T f3f9c2e2bf644115957398fe4c9459db P b7ab4784c7344b939bc36f639286f377: Time spent flushing consensus metadata: real 0.882s	user 0.012s	sys 0.000s
I20260709 13:20:03.338812  6729 rpcz_store.cc:276] 0709 13:20:01.848486 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:01.852684 (+  4198us) service_pool.cc:224] Handling call
0709 13:20:01.853067 (+   383us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:02.029490 (+176423us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:02.029530 (+    40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:20:02.092408 (+ 62878us) log.cc:844] Serialized 26 byte log entry
0709 13:20:02.535413 (+443005us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:20:02.535483 (+    70us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:02.535587 (+   104us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:03.262322 (+726735us) spinlock_profiling.cc:243] Waited 2.32 ms on lock 0x7b4400022b4c. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0c745db1 00007fcc0c7e3c85 00007fcc0c7e46a2 00007fcc0f5561db 00007fcc0f551aaf 00007fcc0f54586e 00007fcc0f544bb6 00007fcc0f5447d8 00007fcc0f54e221 00007fcc0f54e1d9 00007fcc0f54e169
0709 13:20:03.279102 (+ 16780us) raft_consensus.cc:1685] finished
0709 13:20:03.279122 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:03.304141 (+ 25019us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":447248,"raft.run_cpu_time_us":110,"raft.run_wall_time_us":113,"spinlock_wait_cycles":5337472,"thread_start_us":512671,"threads_started":2,"wal-append.queue_time_us":698017}
I20260709 13:20:03.350158  6844 leader_election.cc:400] T ab432e62819d499eaaf3dd55481dd930 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 11 election: Vote denied by peer b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817) with higher term. Message: Invalid argument: T ab432e62819d499eaaf3dd55481dd930 P b7ab4784c7344b939bc36f639286f377 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c for earlier term 11. Current term is 12.
I20260709 13:20:03.322752 10692 raft_consensus.cc:2804] T 4275cf08e63345f993bce8664eada830 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:20:03.320058 10747 raft_consensus.cc:3060] T 4b8cacb381b746da8d0049b0a83b41dd P cd75a17ab2604397adab03bb8b5fd75c [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:20:03.353502  6844 leader_election.cc:403] T ab432e62819d499eaaf3dd55481dd930 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 11 election: Cancelling election due to peer responding with higher term
I20260709 13:20:03.361656  6695 leader_election.cc:304] T 7c37d41cd9164c15a6826ca62a851a69 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
I20260709 13:20:03.363929 10626 raft_consensus.cc:2749] T ab432e62819d499eaaf3dd55481dd930 P cd75a17ab2604397adab03bb8b5fd75c [term 12 FOLLOWER]: Leader election lost for term 11. Reason: Vote denied by peer b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817) with higher term. Message: Invalid argument: T ab432e62819d499eaaf3dd55481dd930 P b7ab4784c7344b939bc36f639286f377 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c for earlier term 11. Current term is 12.
I20260709 13:20:03.365664 10421 leader_election.cc:290] T bb3d8792045a4583ae2e965b1350a5b4 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:20:03.365850 10580 leader_election.cc:290] T 24ee15416e3145beaa1b8183453729a3 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:20:03.368228 10765 leader_election.cc:290] T 17587d6730594da4a56fa13a353232a1 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:20:03.368374  7500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "404190ce4ce94cecbfcb6ea9d1dd8626" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:20:03.369289 10762 consensus_queue.cc:1048] T 2c240553ce044eedb41541d72b9475d7 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:20:03.370182 10752 leader_election.cc:290] T ce4f062dcd314d43a63ca74067cb5ee3 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:20:03.370672 10700 consensus_queue.cc:1048] T de3186201e1a40d0b335eeb8b4e256e0 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:20:03.340899 10804 consensus_queue.cc:1059] T f58dc08b12a2494bb9a1372837970ca2 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: INVALID_TERM, Last received: 12.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.030s
I20260709 13:20:03.337991 10696 raft_consensus.cc:493] T b3f13b31a1f84f0d89d007eadd57924c P ccd8a4c3bfe3413cb2ae219b09aea832 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 7ba59cc884714e8aa5f3f0ecaed84cbb)
I20260709 13:20:03.371933 10696 raft_consensus.cc:3060] T b3f13b31a1f84f0d89d007eadd57924c P ccd8a4c3bfe3413cb2ae219b09aea832 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:20:03.329499 10715 raft_consensus.cc:493] T 44bde925b2e541b69890d70715b85176 P cd75a17ab2604397adab03bb8b5fd75c [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:20:03.373289 10715 raft_consensus.cc:515] T 44bde925b2e541b69890d70715b85176 P cd75a17ab2604397adab03bb8b5fd75c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:03.373805 10785 raft_consensus.cc:3060] T d33d5ee8ef6f415593d8df52063161ad P b7ab4784c7344b939bc36f639286f377 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:20:03.364140  7502 raft_consensus.cc:1240] T 17587d6730594da4a56fa13a353232a1 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 14 FOLLOWER]: Rejecting Update request from peer b7ab4784c7344b939bc36f639286f377 for earlier term 13. Current term is 14. Ops: []
I20260709 13:20:03.351670 10621 raft_consensus.cc:2749] T 7c37d41cd9164c15a6826ca62a851a69 P cd75a17ab2604397adab03bb8b5fd75c [term 10 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:20:03.356925 10692 raft_consensus.cc:493] T 4275cf08e63345f993bce8664eada830 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:03.376366 10692 raft_consensus.cc:3060] T 4275cf08e63345f993bce8664eada830 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:20:03.378808 10591 leader_election.cc:290] T b3f13b31a1f84f0d89d007eadd57924c P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:20:03.357424 10776 consensus_queue.cc:1059] T 1bf4668eeb70467fb3dc5a0289233b3c P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.023s
I20260709 13:20:03.364027 10561 consensus_queue.cc:1059] T 3a485a995abc4807b6e511e45419f737 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.010s
I20260709 13:20:03.403978  6727 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50004 (request call id 1921) took 1572 ms. Trace:
I20260709 13:20:03.404384  6727 rpcz_store.cc:276] 0709 13:20:01.831172 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:01.831319 (+   147us) service_pool.cc:224] Handling call
0709 13:20:01.836967 (+  5648us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:01.837353 (+   386us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:20:02.300465 (+463112us) spinlock_profiling.cc:243] Waited 3.47 ms on lock 0x7b18004053a0. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc15785de1 00007fcc157925b1 00007fcc0c837c0a 00007fcc15f77219 00007fcc1387e58f 00007fcc0c8bd571 00007fcc0c8bf7c1 00007fcc0c8bf779 00007fcc0c8bf709 00007fcc0c8bf6d1 00007fcc0c8be9cd
0709 13:20:02.696500 (+396035us) spinlock_profiling.cc:243] Waited 6.26 ms on lock 0x7b18004053a0. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc15785de1 00007fcc157925b1 00007fcc0c89fe07 00007fcc156faab9 00007fcc0c8bc69b 00007fcc0c8ba93f 00007fcc0c8ba455 00007fcc133a23c7 00007fcc0f9b49a7 00007fcc0f9c40bf 00007fcc0f9c4038
0709 13:20:02.947519 (+251019us) log.cc:844] Serialized 14 byte log entry
0709 13:20:03.321998 (+374479us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:20:03.322736 (+   738us) log.cc:844] Serialized 26 byte log entry
0709 13:20:03.322920 (+   184us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:20:03.322965 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:03.323067 (+   102us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:03.403729 (+ 80662us) raft_consensus.cc:1685] finished
0709 13:20:03.403751 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:03.403909 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":40894,"prepare.queue_time_us":179637,"prepare.run_cpu_time_us":69,"prepare.run_wall_time_us":7062,"raft.queue_time_us":31290,"raft.run_cpu_time_us":405,"raft.run_wall_time_us":39248,"spinlock_wait_cycles":22383232,"thread_start_us":560489,"threads_started":2,"wal-append.queue_time_us":394271}
I20260709 13:20:03.370208  6872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f00a2e87e56452083b759f60d461ee3" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 11 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:20:03.382071  7498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce4f062dcd314d43a63ca74067cb5ee3" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:20:03.384627  6725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17587d6730594da4a56fa13a353232a1" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:03.407245  6725 raft_consensus.cc:2468] T 17587d6730594da4a56fa13a353232a1 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in term 14.
I20260709 13:20:03.389858  6801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17587d6730594da4a56fa13a353232a1" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:03.340510 10571 raft_consensus.cc:493] T c4db81d9d329422bb3b4160ca4ac2d1d P ccd8a4c3bfe3413cb2ae219b09aea832 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:20:03.400081 10738 leader_election.cc:290] T 713b5728a197487c9300b310ab94e5a3 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:20:03.400699 10446 raft_consensus.cc:3060] T a3022224cc81473690653a83d4e99470 P b7ab4784c7344b939bc36f639286f377 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:20:03.411360  7466 leader_election.cc:304] T 17587d6730594da4a56fa13a353232a1 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: b7ab4784c7344b939bc36f639286f377
W20260709 13:20:03.395509  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 45449.3us
I20260709 13:20:03.418617  6874 raft_consensus.cc:2468] T 3a485a995abc4807b6e511e45419f737 P cd75a17ab2604397adab03bb8b5fd75c [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 10.
I20260709 13:20:03.431277  6844 leader_election.cc:304] T f5be3a11b23d4ea9b08300a2789821c7 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:20:03.348680 10367 raft_consensus.cc:493] T f03d0dbf16864ca4bc1bb5e4c0334c0f P ccd8a4c3bfe3413cb2ae219b09aea832 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:03.402262 10775 consensus_queue.cc:237] T 4d9def8b32fd443aa94ab1420b06837b P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:03.345026 10813 raft_consensus.cc:697] T 3fa34c08b205435dba97346991aa1f92 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 12 LEADER]: Becoming Leader. State: Replica: 7ba59cc884714e8aa5f3f0ecaed84cbb, State: Running, Role: LEADER
I20260709 13:20:03.438069  6844 leader_election.cc:304] T 4275cf08e63345f993bce8664eada830 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:20:03.422089  6880 raft_consensus.cc:2468] T 713b5728a197487c9300b310ab94e5a3 P cd75a17ab2604397adab03bb8b5fd75c [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 12.
I20260709 13:20:03.442479  6876 raft_consensus.cc:2468] T 1bf4668eeb70467fb3dc5a0289233b3c P cd75a17ab2604397adab03bb8b5fd75c [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 11.
I20260709 13:20:03.408794 10758 raft_consensus.cc:2804] T 7c37d41cd9164c15a6826ca62a851a69 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:20:03.479259 10561 raft_consensus.cc:3055] T 3a485a995abc4807b6e511e45419f737 P b7ab4784c7344b939bc36f639286f377 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:20:03.479791 10561 raft_consensus.cc:740] T 3a485a995abc4807b6e511e45419f737 P b7ab4784c7344b939bc36f639286f377 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
I20260709 13:20:03.479984 10828 raft_consensus.cc:2804] T 17587d6730594da4a56fa13a353232a1 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:20:03.480482 10828 raft_consensus.cc:493] T 17587d6730594da4a56fa13a353232a1 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:03.480840 10828 raft_consensus.cc:3060] T 17587d6730594da4a56fa13a353232a1 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:03.480968 10561 consensus_queue.cc:260] T 3a485a995abc4807b6e511e45419f737 P b7ab4784c7344b939bc36f639286f377 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:03.338735 10777 raft_consensus.cc:515] T e77e330a82df4b43a745d57a68f6f057 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } }
W20260709 13:20:03.482115  6770 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 62614us
I20260709 13:20:03.482760 10713 consensus_queue.cc:1048] T bd6869f07b5a4885a0b99fbe60c3b175 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:20:03.409154 10700 raft_consensus.cc:493] T 3d65025eea89441290d85dd053810e31 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
W20260709 13:20:03.472971  6846 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:03.420307 10711 raft_consensus.cc:493] T 34f36d59d88f40fe8a2805e604fc6c0a P ccd8a4c3bfe3413cb2ae219b09aea832 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:20:03.408816 10525 consensus_queue.cc:1059] T 7a734b5ab7834e05a8c422208acc58b1 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: INVALID_TERM, Last received: 9.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.077s
I20260709 13:20:03.419889 10160 consensus_queue.cc:1048] T f4b8bd455d5a47c18a1380839c6e0d61 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.073s
I20260709 13:20:03.425082 10715 leader_election.cc:290] T 44bde925b2e541b69890d70715b85176 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:20:03.501845  6801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77e330a82df4b43a745d57a68f6f057" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:03.475009 10367 raft_consensus.cc:515] T f03d0dbf16864ca4bc1bb5e4c0334c0f P ccd8a4c3bfe3413cb2ae219b09aea832 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:03.469743 10738 raft_consensus.cc:2804] T f5be3a11b23d4ea9b08300a2789821c7 P cd75a17ab2604397adab03bb8b5fd75c [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:20:03.520730  6728 raft_consensus.cc:1240] T 44bde925b2e541b69890d70715b85176 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 11 FOLLOWER]: Rejecting Update request from peer b7ab4784c7344b939bc36f639286f377 for earlier term 10. Current term is 11. Ops: []
I20260709 13:20:03.538432  6728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5be3a11b23d4ea9b08300a2789821c7" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:03.519761  6725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "711ef6523deb4cbe8ef2ba61e1c21c98" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:03.526434  6727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8292e16e5654be6bc408560cf256aaa" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:20:03.472421 10752 raft_consensus.cc:493] T d8cee0accdb8499c86d4414b72565a38 P cd75a17ab2604397adab03bb8b5fd75c [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:20:03.528028  6801 raft_consensus.cc:2468] T e77e330a82df4b43a745d57a68f6f057 P b7ab4784c7344b939bc36f639286f377 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 13.
I20260709 13:20:03.476634 10626 raft_consensus.cc:493] T 2c240553ce044eedb41541d72b9475d7 P cd75a17ab2604397adab03bb8b5fd75c [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:03.432240 10818 consensus_queue.cc:1059] T 17587d6730594da4a56fa13a353232a1 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: INVALID_TERM, Last received: 13.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.068s
I20260709 13:20:03.402801 10794 consensus_queue.cc:237] T f58dc08b12a2494bb9a1372837970ca2 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.6, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:03.497853 10621 raft_consensus.cc:2804] T 4275cf08e63345f993bce8664eada830 P cd75a17ab2604397adab03bb8b5fd75c [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:20:03.431232 10571 raft_consensus.cc:515] T c4db81d9d329422bb3b4160ca4ac2d1d P ccd8a4c3bfe3413cb2ae219b09aea832 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:03.499802 10777 leader_election.cc:290] T e77e330a82df4b43a745d57a68f6f057 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:03.556576  6695 leader_election.cc:304] T e77e330a82df4b43a745d57a68f6f057 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
I20260709 13:20:03.526434 10561 raft_consensus.cc:3060] T 3a485a995abc4807b6e511e45419f737 P b7ab4784c7344b939bc36f639286f377 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:20:03.500296 10832 raft_consensus.cc:493] T 1528ab62b6fe4e3099d08f141afee116 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 7ba59cc884714e8aa5f3f0ecaed84cbb)
I20260709 13:20:03.560475  6732 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49744 (request call id 362) took 1081 ms. Trace:
I20260709 13:20:03.600700  6732 rpcz_store.cc:276] 0709 13:20:02.473785 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:03.065296 (+591511us) service_pool.cc:224] Handling call
0709 13:20:03.402099 (+336803us) spinlock_profiling.cc:243] Waited 9.59 ms on lock 0x7b5800000c98. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0c745db1 00007fcc0c885b71 00007fcc0c885eee 0000000000375939 00007fcc148f91e0 00007fcc149c20c4 00007fcc149c2131 00007fcc14983fc0 00007fcc1496e929 00007fcc1496e3d2 00007fcc0dee5bd4
0709 13:20:03.402269 (+   170us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:03.402490 (+   221us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:20:03.402798 (+   308us) log.cc:844] Serialized 14 byte log entry
0709 13:20:03.554969 (+152171us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:20:03.555022 (+    53us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:20:03.555080 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:03.555154 (+    74us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:03.555273 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2401,"prepare.queue_time_us":6480,"prepare.run_cpu_time_us":55,"prepare.run_wall_time_us":57,"raft.queue_time_us":1081,"raft.run_cpu_time_us":172,"raft.run_wall_time_us":10757,"spinlock_wait_cycles":22085120,"thread_start_us":150236,"threads_started":1}
I20260709 13:20:03.527290 10758 raft_consensus.cc:697] T 7c37d41cd9164c15a6826ca62a851a69 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 10 LEADER]: Becoming Leader. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
I20260709 13:20:03.500748 10770 consensus_queue.cc:1059] T fe20b4b48823486ca3b9c648db6ce8aa P 7ba59cc884714e8aa5f3f0ecaed84cbb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.060s
W20260709 13:20:03.589895  7468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 94157.8us
I20260709 13:20:03.547613 10738 raft_consensus.cc:493] T f5be3a11b23d4ea9b08300a2789821c7 P cd75a17ab2604397adab03bb8b5fd75c [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:03.527520 10711 raft_consensus.cc:515] T 34f36d59d88f40fe8a2805e604fc6c0a P ccd8a4c3bfe3413cb2ae219b09aea832 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:03.606858  6732 raft_consensus.cc:1275] T 9e326172347f45e99a0d482b5d8ef768 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 10 FOLLOWER]: Refusing update from remote peer b7ab4784c7344b939bc36f639286f377: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 10 index: 5. (index mismatch)
I20260709 13:20:03.522956 10700 raft_consensus.cc:515] T 3d65025eea89441290d85dd053810e31 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
W20260709 13:20:03.650787  6773 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:03.529448 10447 consensus_queue.cc:1048] T ab432e62819d499eaaf3dd55481dd930 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.054s
I20260709 13:20:03.614578  6879 raft_consensus.cc:2468] T d8292e16e5654be6bc408560cf256aaa P cd75a17ab2604397adab03bb8b5fd75c [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 14.
I20260709 13:20:03.660931  6875 raft_consensus.cc:1240] T d8292e16e5654be6bc408560cf256aaa P cd75a17ab2604397adab03bb8b5fd75c [term 14 FOLLOWER]: Rejecting Update request from peer ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 13. Current term is 14. Ops: [13.8-13.8]
I20260709 13:20:03.662762  6879 raft_consensus.cc:1240] T 3a485a995abc4807b6e511e45419f737 P cd75a17ab2604397adab03bb8b5fd75c [term 10 FOLLOWER]: Rejecting Update request from peer b7ab4784c7344b939bc36f639286f377 for earlier term 9. Current term is 10. Ops: [9.6-9.6]
I20260709 13:20:03.665153  6879 raft_consensus.cc:1240] T 1bf4668eeb70467fb3dc5a0289233b3c P cd75a17ab2604397adab03bb8b5fd75c [term 11 FOLLOWER]: Rejecting Update request from peer ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 10. Current term is 11. Ops: [10.7-10.7]
I20260709 13:20:03.674675  6879 raft_consensus.cc:1275] T ab432e62819d499eaaf3dd55481dd930 P cd75a17ab2604397adab03bb8b5fd75c [term 12 FOLLOWER]: Refusing update from remote peer b7ab4784c7344b939bc36f639286f377: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 12 index: 6. (index mismatch)
I20260709 13:20:03.682117  6730 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50004 (request call id 1945) took 1363 ms. Trace:
I20260709 13:20:03.689728  9836 raft_consensus.cc:493] T b56bf91d90824c959e21e0cee5ba1816 P b7ab4784c7344b939bc36f639286f377 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:03.690596  9836 raft_consensus.cc:515] T b56bf91d90824c959e21e0cee5ba1816 P b7ab4784c7344b939bc36f639286f377 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:03.595754 10621 raft_consensus.cc:697] T 4275cf08e63345f993bce8664eada830 P cd75a17ab2604397adab03bb8b5fd75c [term 11 LEADER]: Becoming Leader. State: Replica: cd75a17ab2604397adab03bb8b5fd75c, State: Running, Role: LEADER
I20260709 13:20:03.558514 10752 raft_consensus.cc:515] T d8cee0accdb8499c86d4414b72565a38 P cd75a17ab2604397adab03bb8b5fd75c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:20:03.613369 10725 raft_consensus.cc:2804] T e77e330a82df4b43a745d57a68f6f057 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:20:03.562644 10626 raft_consensus.cc:515] T 2c240553ce044eedb41541d72b9475d7 P cd75a17ab2604397adab03bb8b5fd75c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:03.683151  6730 rpcz_store.cc:276] 0709 13:20:02.318793 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:03.047422 (+728629us) service_pool.cc:224] Handling call
0709 13:20:03.047935 (+   513us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:03.076465 (+ 28530us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:03.076499 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:20:03.077027 (+   528us) log.cc:844] Serialized 26 byte log entry
0709 13:20:03.412513 (+335486us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:20:03.412576 (+    63us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:03.681452 (+268876us) spinlock_profiling.cc:243] Waited 28.1 ms on lock 0x7b54000e4054. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f9aae01 00007fcc0f9a983e 00007fcc1496e419 00007fcc0dee5bd4 00007fcc0dee5b62 00007fcc0dee5a91 00007fcc0dee5a0c 00007fcc0dee4cc2 00007fcc0dce548c 00007fcc0dce48c6
0709 13:20:03.681538 (+    86us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:03.681623 (+    85us) raft_consensus.cc:1685] finished
0709 13:20:03.681655 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:03.682010 (+   355us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":316,"raft.queue_time_us":1501,"raft.run_cpu_time_us":133,"raft.run_wall_time_us":10537,"spinlock_wait_cycles":64660352,"thread_start_us":322465,"threads_started":1,"wal-append.queue_time_us":392664}
I20260709 13:20:03.642789 10738 raft_consensus.cc:3060] T f5be3a11b23d4ea9b08300a2789821c7 P cd75a17ab2604397adab03bb8b5fd75c [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:20:03.714330 10777 raft_consensus.cc:493] T a1704639a875409b9959353527b3fd68 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:03.776371  9836 leader_election.cc:290] T b56bf91d90824c959e21e0cee5ba1816 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:03.738595 10725 raft_consensus.cc:493] T e77e330a82df4b43a745d57a68f6f057 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:03.714123 10534 consensus_queue.cc:1048] T 9e326172347f45e99a0d482b5d8ef768 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.063s
W20260709 13:20:03.799965  6771 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:03.799582  9836 raft_consensus.cc:493] T bb7fa124c3bf4ef9ab65a407cb008441 P b7ab4784c7344b939bc36f639286f377 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 7ba59cc884714e8aa5f3f0ecaed84cbb)
I20260709 13:20:03.801064  9836 raft_consensus.cc:515] T bb7fa124c3bf4ef9ab65a407cb008441 P b7ab4784c7344b939bc36f639286f377 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:20:03.803864  9836 leader_election.cc:290] T bb7fa124c3bf4ef9ab65a407cb008441 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
W20260709 13:20:03.806886  6773 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:03.593891 10813 consensus_queue.cc:237] T 3fa34c08b205435dba97346991aa1f92 P 7ba59cc884714e8aa5f3f0ecaed84cbb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:20:03.793418 10725 raft_consensus.cc:3060] T e77e330a82df4b43a745d57a68f6f057 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:03.853469 10560 raft_consensus.cc:3055] T f58dc08b12a2494bb9a1372837970ca2 P b7ab4784c7344b939bc36f639286f377 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:20:03.854360 10560 raft_consensus.cc:740] T f58dc08b12a2494bb9a1372837970ca2 P b7ab4784c7344b939bc36f639286f377 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
I20260709 13:20:03.883036 10804 raft_consensus.cc:3055] T 7a734b5ab7834e05a8c422208acc58b1 P b7ab4784c7344b939bc36f639286f377 [term 9 LEADER]: Stepping down as leader of term 9
W20260709 13:20:03.897725  6695 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:03.901002  6846 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:03.913759  7466 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 280211us
I20260709 13:20:03.737931 10722 consensus_queue.cc:260] T 3fa34c08b205435dba97346991aa1f92 P cd75a17ab2604397adab03bb8b5fd75c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
W20260709 13:20:03.846076 10839 log.cc:927] Time spent T 95a75bfe094d4bdc963aba3f08dfcd25 P b7ab4784c7344b939bc36f639286f377: Append to log took a long time: real 0.056s	user 0.001s	sys 0.000s
I20260709 13:20:03.781754 10777 raft_consensus.cc:515] T a1704639a875409b9959353527b3fd68 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
W20260709 13:20:03.933347 10841 log.cc:927] Time spent T 4f00a2e87e56452083b759f60d461ee3 P cd75a17ab2604397adab03bb8b5fd75c: Append to log took a long time: real 0.206s	user 0.001s	sys 0.000s
I20260709 13:20:03.934672 10711 leader_election.cc:290] T 34f36d59d88f40fe8a2805e604fc6c0a P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:03.883860 10804 raft_consensus.cc:740] T 7a734b5ab7834e05a8c422208acc58b1 P b7ab4784c7344b939bc36f639286f377 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
I20260709 13:20:03.948734  6772 leader_election.cc:304] T ce4f062dcd314d43a63ca74067cb5ee3 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:20:03.619120 10832 raft_consensus.cc:515] T 1528ab62b6fe4e3099d08f141afee116 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:20:03.965076  6772 leader_election.cc:304] T 1528ab62b6fe4e3099d08f141afee116 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, ccd8a4c3bfe3413cb2ae219b09aea832
W20260709 13:20:03.952203 10524 consensus_meta.cc:287] T e31b9971c15848dea59d4d4130141d9e P b7ab4784c7344b939bc36f639286f377: Time spent flushing consensus metadata: real 0.909s	user 0.013s	sys 0.002s
W20260709 13:20:03.967628 10830 log.cc:927] Time spent T 9e326172347f45e99a0d482b5d8ef768 P b7ab4784c7344b939bc36f639286f377: Append to log took a long time: real 0.420s	user 0.001s	sys 0.001s
W20260709 13:20:03.967873 10848 log.cc:927] Time spent T ce4f062dcd314d43a63ca74067cb5ee3 P ccd8a4c3bfe3413cb2ae219b09aea832: Append to log took a long time: real 0.142s	user 0.000s	sys 0.001s
I20260709 13:20:03.797916 10758 consensus_queue.cc:237] T 7c37d41cd9164c15a6826ca62a851a69 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:03.964214 10722 raft_consensus.cc:3060] T 3fa34c08b205435dba97346991aa1f92 P cd75a17ab2604397adab03bb8b5fd75c [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:20:03.975946 10534 raft_consensus.cc:2749] T ce4f062dcd314d43a63ca74067cb5ee3 P b7ab4784c7344b939bc36f639286f377 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:20:03.855741 10560 consensus_queue.cc:260] T f58dc08b12a2494bb9a1372837970ca2 P b7ab4784c7344b939bc36f639286f377 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.6, Last appended by leader: 6, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:03.979019 10367 leader_election.cc:290] T f03d0dbf16864ca4bc1bb5e4c0334c0f P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
W20260709 13:20:03.991055 10785 consensus_meta.cc:287] T d33d5ee8ef6f415593d8df52063161ad P b7ab4784c7344b939bc36f639286f377: Time spent flushing consensus metadata: real 0.617s	user 0.007s	sys 0.007s
W20260709 13:20:04.007956 10698 consensus_meta.cc:287] T f03d0dbf16864ca4bc1bb5e4c0334c0f P b7ab4784c7344b939bc36f639286f377: Time spent flushing consensus metadata: real 0.764s	user 0.011s	sys 0.000s
I20260709 13:20:04.033428  6790 tablet_service.cc:1558] Processing DeleteTablet for tablet 24ee15416e3145beaa1b8183453729a3 with delete_type TABLET_DATA_TOMBSTONED (Replica with old config index 2 (current committed config index is 7)) from {username='slave'} at 127.0.0.1:41714
I20260709 13:20:04.004215 10524 raft_consensus.cc:2749] T 1528ab62b6fe4e3099d08f141afee116 P b7ab4784c7344b939bc36f639286f377 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:20:04.035221 10853 log.cc:927] Time spent T 07a92dd554674067a83a9cb68c4773f2 P ccd8a4c3bfe3413cb2ae219b09aea832: Append to log took a long time: real 0.084s	user 0.000s	sys 0.001s
W20260709 13:20:04.059863  6844 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.583s	user 0.005s	sys 0.009s
W20260709 13:20:04.062302  6844 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.586s	user 0.005s	sys 0.009s
I20260709 13:20:03.899638 10621 consensus_queue.cc:237] T 4275cf08e63345f993bce8664eada830 P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
W20260709 13:20:04.034582 10849 log.cc:927] Time spent T f5be3a11b23d4ea9b08300a2789821c7 P b7ab4784c7344b939bc36f639286f377: Append to log took a long time: real 0.128s	user 0.001s	sys 0.000s
W20260709 13:20:04.069715  7469 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.632s	user 0.005s	sys 0.010s
I20260709 13:20:04.018144 10727 raft_consensus.cc:3055] T 1bf4668eeb70467fb3dc5a0289233b3c P ccd8a4c3bfe3413cb2ae219b09aea832 [term 10 LEADER]: Stepping down as leader of term 10
W20260709 13:20:04.070181  7469 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.633s	user 0.005s	sys 0.010s
I20260709 13:20:04.031441 10571 leader_election.cc:290] T c4db81d9d329422bb3b4160ca4ac2d1d P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:04.030637 10804 consensus_queue.cc:260] T 7a734b5ab7834e05a8c422208acc58b1 P b7ab4784c7344b939bc36f639286f377 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.4, Last appended by leader: 4, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
W20260709 13:20:04.095650 10487 consensus_meta.cc:287] T 44bde925b2e541b69890d70715b85176 P b7ab4784c7344b939bc36f639286f377: Time spent flushing consensus metadata: real 0.868s	user 0.007s	sys 0.006s
W20260709 13:20:04.097980 10855 log.cc:927] Time spent T f09c2a98de1a4decabd0ff900dd44caa P ccd8a4c3bfe3413cb2ae219b09aea832: Append to log took a long time: real 0.099s	user 0.000s	sys 0.000s
I20260709 13:20:04.030701 10695 consensus_queue.cc:1059] T 7ba5dac66ab5497e9e336f2a3c28cda5 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.057s
I20260709 13:20:04.074373 10727 raft_consensus.cc:740] T 1bf4668eeb70467fb3dc5a0289233b3c P ccd8a4c3bfe3413cb2ae219b09aea832 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
I20260709 13:20:04.111037 10727 consensus_queue.cc:260] T 1bf4668eeb70467fb3dc5a0289233b3c P ccd8a4c3bfe3413cb2ae219b09aea832 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:03.976222 10447 consensus_queue.cc:1059] T d8cee0accdb8499c86d4414b72565a38 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.047s
W20260709 13:20:04.035928 10846 log.cc:927] Time spent T be1a92657f494cac8dd227d152f50151 P b7ab4784c7344b939bc36f639286f377: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
W20260709 13:20:04.064904  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 626867us
W20260709 13:20:04.111819 10859 log.cc:927] Time spent T b3f13b31a1f84f0d89d007eadd57924c P b7ab4784c7344b939bc36f639286f377: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
W20260709 13:20:04.113197 10842 log.cc:927] Time spent T 7c44c4849aa54f2b94d1f1bef9ed546f P cd75a17ab2604397adab03bb8b5fd75c: Append to log took a long time: real 0.185s	user 0.000s	sys 0.000s
I20260709 13:20:04.121372  6844 leader_election.cc:304] T 95a75bfe094d4bdc963aba3f08dfcd25 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:20:04.131973  6844 leader_election.cc:400] T 853ac0a8cbd64ce99457f170216d4d0f P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 7 pre-election: Vote denied by peer b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817) with higher term. Message: Invalid argument: T 853ac0a8cbd64ce99457f170216d4d0f P b7ab4784c7344b939bc36f639286f377 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c for earlier term 7. Current term is 8.
I20260709 13:20:04.132447  6844 leader_election.cc:403] T 853ac0a8cbd64ce99457f170216d4d0f P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 7 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:20:04.088411 10560 raft_consensus.cc:3060] T f58dc08b12a2494bb9a1372837970ca2 P b7ab4784c7344b939bc36f639286f377 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:04.137107  6844 leader_election.cc:304] T 427c124d773f483294511e80fe340075 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, b7ab4784c7344b939bc36f639286f377
W20260709 13:20:04.128475 10845 log.cc:927] Time spent T be1a92657f494cac8dd227d152f50151 P ccd8a4c3bfe3413cb2ae219b09aea832: Append to log took a long time: real 0.353s	user 0.000s	sys 0.002s
W20260709 13:20:04.119534 10696 consensus_meta.cc:287] T b3f13b31a1f84f0d89d007eadd57924c P ccd8a4c3bfe3413cb2ae219b09aea832: Time spent flushing consensus metadata: real 0.747s	user 0.005s	sys 0.007s
W20260709 13:20:04.132352 10847 log.cc:927] Time spent T 00000000000000000000000000000000 P b3ae52d33b9a4273a42e5e2cf3b5d6b5: Append to log took a long time: real 0.109s	user 0.002s	sys 0.000s
I20260709 13:20:04.147439  6844 leader_election.cc:400] T 9e326172347f45e99a0d482b5d8ef768 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 9 election: Vote denied by peer b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817) with higher term. Message: Invalid argument: T 9e326172347f45e99a0d482b5d8ef768 P b7ab4784c7344b939bc36f639286f377 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c for earlier term 9. Current term is 10.
W20260709 13:20:04.134505 10856 log.cc:927] Time spent T f09c2a98de1a4decabd0ff900dd44caa P cd75a17ab2604397adab03bb8b5fd75c: Append to log took a long time: real 0.185s	user 0.000s	sys 0.001s
I20260709 13:20:04.119431 10626 leader_election.cc:290] T 2c240553ce044eedb41541d72b9475d7 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
W20260709 13:20:04.165841 10730 consensus_meta.cc:287] T d8292e16e5654be6bc408560cf256aaa P ccd8a4c3bfe3413cb2ae219b09aea832: Time spent flushing consensus metadata: real 0.897s	user 0.005s	sys 0.005s
I20260709 13:20:04.141664 10715 raft_consensus.cc:2749] T 853ac0a8cbd64ce99457f170216d4d0f P cd75a17ab2604397adab03bb8b5fd75c [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: Vote denied by peer b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817) with higher term. Message: Invalid argument: T 853ac0a8cbd64ce99457f170216d4d0f P b7ab4784c7344b939bc36f639286f377 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c for earlier term 7. Current term is 8.
W20260709 13:20:04.151178 10650 consensus_meta.cc:287] T 404190ce4ce94cecbfcb6ea9d1dd8626 P 7ba59cc884714e8aa5f3f0ecaed84cbb: Time spent flushing consensus metadata: real 1.066s	user 0.015s	sys 0.000s
I20260709 13:20:04.171582  7500 raft_consensus.cc:2468] T 404190ce4ce94cecbfcb6ea9d1dd8626 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 12.
W20260709 13:20:04.176549 10446 consensus_meta.cc:287] T a3022224cc81473690653a83d4e99470 P b7ab4784c7344b939bc36f639286f377: Time spent flushing consensus metadata: real 0.742s	user 0.010s	sys 0.005s
I20260709 13:20:04.158262 10696 raft_consensus.cc:515] T b3f13b31a1f84f0d89d007eadd57924c P ccd8a4c3bfe3413cb2ae219b09aea832 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
W20260709 13:20:04.177517 10692 consensus_meta.cc:287] T 4275cf08e63345f993bce8664eada830 P ccd8a4c3bfe3413cb2ae219b09aea832: Time spent flushing consensus metadata: real 0.801s	user 0.008s	sys 0.004s
I20260709 13:20:04.177934 10692 raft_consensus.cc:515] T 4275cf08e63345f993bce8664eada830 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:04.179157 10696 leader_election.cc:290] T b3f13b31a1f84f0d89d007eadd57924c P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 10 election: Requested vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:20:04.149858 10704 raft_consensus.cc:2749] T 427c124d773f483294511e80fe340075 P cd75a17ab2604397adab03bb8b5fd75c [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:20:04.187785 10561 consensus_meta.cc:287] T 3a485a995abc4807b6e511e45419f737 P b7ab4784c7344b939bc36f639286f377: Time spent flushing consensus metadata: real 0.574s	user 0.007s	sys 0.006s
I20260709 13:20:04.189143 10832 leader_election.cc:290] T 1528ab62b6fe4e3099d08f141afee116 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:20:04.150269 10752 leader_election.cc:290] T d8cee0accdb8499c86d4414b72565a38 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
W20260709 13:20:04.193051 10854 log.cc:927] Time spent T bd6869f07b5a4885a0b99fbe60c3b175 P cd75a17ab2604397adab03bb8b5fd75c: Append to log took a long time: real 0.120s	user 0.000s	sys 0.001s
I20260709 13:20:04.194219 10777 leader_election.cc:290] T a1704639a875409b9959353527b3fd68 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:04.156481 10804 raft_consensus.cc:3060] T 7a734b5ab7834e05a8c422208acc58b1 P b7ab4784c7344b939bc36f639286f377 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:20:04.156154 10727 raft_consensus.cc:3060] T 1bf4668eeb70467fb3dc5a0289233b3c P ccd8a4c3bfe3413cb2ae219b09aea832 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:20:04.197851 10692 leader_election.cc:290] T 4275cf08e63345f993bce8664eada830 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 12 election: Requested vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:04.171762 10700 leader_election.cc:290] T 3d65025eea89441290d85dd053810e31 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
W20260709 13:20:04.218637 10828 consensus_meta.cc:287] T 17587d6730594da4a56fa13a353232a1 P 7ba59cc884714e8aa5f3f0ecaed84cbb: Time spent flushing consensus metadata: real 0.737s	user 0.010s	sys 0.002s
W20260709 13:20:04.223327 10747 consensus_meta.cc:287] T 4b8cacb381b746da8d0049b0a83b41dd P cd75a17ab2604397adab03bb8b5fd75c: Time spent flushing consensus metadata: real 0.814s	user 0.011s	sys 0.001s
I20260709 13:20:04.223969 10747 raft_consensus.cc:515] T 4b8cacb381b746da8d0049b0a83b41dd P cd75a17ab2604397adab03bb8b5fd75c [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:20:04.219426 10828 raft_consensus.cc:515] T 17587d6730594da4a56fa13a353232a1 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:20:04.229801 10828 leader_election.cc:290] T 17587d6730594da4a56fa13a353232a1 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 15 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:20:04.271488  6727 raft_consensus.cc:2410] T d8292e16e5654be6bc408560cf256aaa P ccd8a4c3bfe3413cb2ae219b09aea832 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate b7ab4784c7344b939bc36f639286f377 for term 14 because replica has last-logged OpId of term: 13 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 7.
W20260709 13:20:04.272461  6698 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:04.273726  6723 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50004 (request call id 1956) took 1696 ms. Trace:
W20260709 13:20:04.051412  6799 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.505s	user 0.016s	sys 0.005s
W20260709 13:20:04.276732  6799 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.730s	user 0.016s	sys 0.005s
I20260709 13:20:04.281133  6724 raft_consensus.cc:1240] T b3f13b31a1f84f0d89d007eadd57924c P ccd8a4c3bfe3413cb2ae219b09aea832 [term 10 FOLLOWER]: Rejecting Update request from peer 7ba59cc884714e8aa5f3f0ecaed84cbb for earlier term 9. Current term is 10. Ops: []
I20260709 13:20:04.290889  6879 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53416 (request call id 2794) took 1123 ms. Trace:
I20260709 13:20:04.291483  6877 raft_consensus.cc:2393] T 4b8cacb381b746da8d0049b0a83b41dd P cd75a17ab2604397adab03bb8b5fd75c [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ccd8a4c3bfe3413cb2ae219b09aea832 in current term 11: Already voted for candidate cd75a17ab2604397adab03bb8b5fd75c in this term.
I20260709 13:20:04.293445  6881 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53406 (request call id 2027) took 1213 ms. Trace:
I20260709 13:20:04.156397  6844 leader_election.cc:403] T 9e326172347f45e99a0d482b5d8ef768 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 9 election: Cancelling election due to peer responding with higher term
W20260709 13:20:04.306665  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 159331us
I20260709 13:20:04.310231 10421 raft_consensus.cc:493] T 9e326172347f45e99a0d482b5d8ef768 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:04.201866 10725 raft_consensus.cc:515] T e77e330a82df4b43a745d57a68f6f057 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } }
I20260709 13:20:04.291868  6879 rpcz_store.cc:276] 0709 13:20:03.167302 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:03.677392 (+510090us) service_pool.cc:224] Handling call
0709 13:20:03.677697 (+   305us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:03.725823 (+ 48126us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:03.725865 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:20:03.745036 (+ 19171us) log.cc:844] Serialized 26 byte log entry
0709 13:20:04.119311 (+374275us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:20:04.119376 (+    65us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:04.119486 (+   110us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:04.289903 (+170417us) raft_consensus.cc:1685] finished
0709 13:20:04.289966 (+    63us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:04.290516 (+   550us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":47868,"raft.queue_time_us":93255,"raft.run_cpu_time_us":182,"raft.run_wall_time_us":9808,"thread_start_us":371314,"threads_started":1,"wal-append.queue_time_us":454081}
I20260709 13:20:04.325822 10421 raft_consensus.cc:515] T 9e326172347f45e99a0d482b5d8ef768 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:04.274387  6723 rpcz_store.cc:276] 0709 13:20:02.576959 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:03.065800 (+488841us) service_pool.cc:224] Handling call
0709 13:20:03.066166 (+   366us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:03.420264 (+354098us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:03.420293 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:20:03.430124 (+  9831us) log.cc:844] Serialized 26 byte log entry
0709 13:20:03.641020 (+210896us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:20:03.641062 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:03.641366 (+   304us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:04.272841 (+631475us) raft_consensus.cc:1685] finished
0709 13:20:04.272929 (+    88us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:04.273440 (+   511us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":5648,"raft.run_cpu_time_us":95,"raft.run_wall_time_us":96,"thread_start_us":493443,"threads_started":2,"wal-append.queue_time_us":369464}
I20260709 13:20:04.294080  6881 rpcz_store.cc:276] 0709 13:20:03.080232 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:03.080346 (+   114us) service_pool.cc:224] Handling call
0709 13:20:03.080612 (+   266us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:03.090420 (+  9808us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:20:03.504615 (+414195us) log.cc:844] Serialized 14 byte log entry
0709 13:20:03.794750 (+290135us) log.cc:844] Serialized 14 byte log entry
0709 13:20:03.795450 (+   700us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:20:03.798779 (+  3329us) log.cc:844] Serialized 26 byte log entry
0709 13:20:03.798923 (+   144us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:20:03.798957 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:03.799023 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:03.888244 (+ 89221us) spinlock_profiling.cc:243] Waited 2.74 ms on lock 0x7b180031d1a0. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc15785de1 00007fcc157925b1 00007fcc0c8bd522 00007fcc0c8bf7c1 00007fcc0c8bf779 00007fcc0c8bf709 00007fcc0c8bf6d1 00007fcc0c8be9cd 000000000038f354 000000000038f199 00007fcc0c8a083a
0709 13:20:04.292658 (+404414us) raft_consensus.cc:1685] finished
0709 13:20:04.292723 (+    65us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:04.293148 (+   425us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":20858,"prepare.queue_time_us":249628,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":80,"raft.queue_time_us":16699,"raft.run_cpu_time_us":483,"raft.run_wall_time_us":54893,"spinlock_wait_cycles":35875968,"thread_start_us":664266,"threads_started":2,"wal-append.queue_time_us":504358}
I20260709 13:20:04.329602  6844 leader_election.cc:304] T 20f6842e26174571996b8dea4151d4be P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
W20260709 13:20:04.507200  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 177985us
I20260709 13:20:04.507715 10621 raft_consensus.cc:2804] T 20f6842e26174571996b8dea4151d4be P cd75a17ab2604397adab03bb8b5fd75c [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:20:04.508726 10621 raft_consensus.cc:697] T 20f6842e26174571996b8dea4151d4be P cd75a17ab2604397adab03bb8b5fd75c [term 12 LEADER]: Becoming Leader. State: Replica: cd75a17ab2604397adab03bb8b5fd75c, State: Running, Role: LEADER
I20260709 13:20:04.510963 10621 consensus_queue.cc:237] T 20f6842e26174571996b8dea4151d4be P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:04.513808  6844 leader_election.cc:304] T 7ba5dac66ab5497e9e336f2a3c28cda5 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, b7ab4784c7344b939bc36f639286f377
I20260709 13:20:04.515537 10752 raft_consensus.cc:2749] T 7ba5dac66ab5497e9e336f2a3c28cda5 P cd75a17ab2604397adab03bb8b5fd75c [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:20:04.435256 10802 raft_consensus.cc:3055] T 17587d6730594da4a56fa13a353232a1 P b7ab4784c7344b939bc36f639286f377 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:20:04.516774 10802 raft_consensus.cc:740] T 17587d6730594da4a56fa13a353232a1 P b7ab4784c7344b939bc36f639286f377 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
W20260709 13:20:04.331835  6697 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 1.14209e+06us
I20260709 13:20:04.325953  7496 raft_consensus.cc:1240] T 3fa34c08b205435dba97346991aa1f92 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 12 LEADER]: Rejecting Update request from peer cd75a17ab2604397adab03bb8b5fd75c for earlier term 11. Current term is 12. Ops: []
I20260709 13:20:04.548496 10777 raft_consensus.cc:493] T ab432e62819d499eaaf3dd55481dd930 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:04.549443 10777 raft_consensus.cc:515] T ab432e62819d499eaaf3dd55481dd930 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
W20260709 13:20:04.552809  6771 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:04.502167 10858 log.cc:927] Time spent T 853ac0a8cbd64ce99457f170216d4d0f P b7ab4784c7344b939bc36f639286f377: Append to log took a long time: real 0.429s	user 0.005s	sys 0.000s
W20260709 13:20:04.562067  6770 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:04.344712 10738 consensus_meta.cc:287] T f5be3a11b23d4ea9b08300a2789821c7 P cd75a17ab2604397adab03bb8b5fd75c: Time spent flushing consensus metadata: real 0.569s	user 0.010s	sys 0.002s
W20260709 13:20:04.569175  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 49782.8us
I20260709 13:20:04.440878 10695 raft_consensus.cc:3055] T 7ba5dac66ab5497e9e336f2a3c28cda5 P b7ab4784c7344b939bc36f639286f377 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:20:04.325963 10722 raft_consensus.cc:2749] T 9e326172347f45e99a0d482b5d8ef768 P cd75a17ab2604397adab03bb8b5fd75c [term 10 FOLLOWER]: Leader election lost for term 9. Reason: Vote denied by peer b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817) with higher term. Message: Invalid argument: T 9e326172347f45e99a0d482b5d8ef768 P b7ab4784c7344b939bc36f639286f377 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c for earlier term 9. Current term is 10.
I20260709 13:20:04.442596 10447 raft_consensus.cc:3055] T d8cee0accdb8499c86d4414b72565a38 P b7ab4784c7344b939bc36f639286f377 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:20:04.574924 10447 raft_consensus.cc:740] T d8cee0accdb8499c86d4414b72565a38 P b7ab4784c7344b939bc36f639286f377 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
I20260709 13:20:04.575896 10421 leader_election.cc:290] T 9e326172347f45e99a0d482b5d8ef768 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:04.576617 10447 consensus_queue.cc:260] T d8cee0accdb8499c86d4414b72565a38 P b7ab4784c7344b939bc36f639286f377 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:20:04.577643  6844 leader_election.cc:304] T bb7fa124c3bf4ef9ab65a407cb008441 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, b7ab4784c7344b939bc36f639286f377
I20260709 13:20:04.578851 10722 raft_consensus.cc:2749] T bb7fa124c3bf4ef9ab65a407cb008441 P cd75a17ab2604397adab03bb8b5fd75c [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:20:04.403795 10487 raft_consensus.cc:493] T d33d5ee8ef6f415593d8df52063161ad P b7ab4784c7344b939bc36f639286f377 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:04.580247 10487 raft_consensus.cc:515] T d33d5ee8ef6f415593d8df52063161ad P b7ab4784c7344b939bc36f639286f377 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:04.581516 10747 leader_election.cc:290] T 4b8cacb381b746da8d0049b0a83b41dd P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 11 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:20:04.583287 10487 leader_election.cc:290] T d33d5ee8ef6f415593d8df52063161ad P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:04.572995 10725 leader_election.cc:290] T e77e330a82df4b43a745d57a68f6f057 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 14 election: Requested vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:04.412415 10063 consensus_queue.cc:1059] T 17587d6730594da4a56fa13a353232a1 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false }, Status: INVALID_TERM, Last received: 13.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.197s
I20260709 13:20:04.584220 10561 raft_consensus.cc:493] T f3f9c2e2bf644115957398fe4c9459db P b7ab4784c7344b939bc36f639286f377 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:04.585232 10561 raft_consensus.cc:515] T f3f9c2e2bf644115957398fe4c9459db P b7ab4784c7344b939bc36f639286f377 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:04.585986  6732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b56bf91d90824c959e21e0cee5ba1816" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:04.586726  6727 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50004 (request call id 1960) took 1070 ms. Trace:
I20260709 13:20:04.587168  6732 raft_consensus.cc:2468] T b56bf91d90824c959e21e0cee5ba1816 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 10.
W20260709 13:20:04.592664  6847 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:04.593490  6771 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:04.593230 10561 leader_election.cc:290] T f3f9c2e2bf644115957398fe4c9459db P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:04.596247  6807 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:32976 (request call id 2701) took 1419 ms. Trace:
I20260709 13:20:04.573812 10704 raft_consensus.cc:493] T f09c2a98de1a4decabd0ff900dd44caa P cd75a17ab2604397adab03bb8b5fd75c [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:20:04.572942 10738 raft_consensus.cc:515] T f5be3a11b23d4ea9b08300a2789821c7 P cd75a17ab2604397adab03bb8b5fd75c [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:04.596431  6802 raft_consensus.cc:1275] T 713b5728a197487c9300b310ab94e5a3 P b7ab4784c7344b939bc36f639286f377 [term 12 FOLLOWER]: Refusing update from remote peer ccd8a4c3bfe3413cb2ae219b09aea832: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:20:04.574047  6874 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53416 (request call id 2789) took 1454 ms. Trace:
I20260709 13:20:04.403800 10862 raft_consensus.cc:2764] T 95a75bfe094d4bdc963aba3f08dfcd25 P cd75a17ab2604397adab03bb8b5fd75c [term 11 FOLLOWER]: Leader pre-election decision vote started in defunct term 10: won
I20260709 13:20:04.562289 10752 raft_consensus.cc:493] T 3fa34c08b205435dba97346991aa1f92 P cd75a17ab2604397adab03bb8b5fd75c [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:04.587178  6727 rpcz_store.cc:276] 0709 13:20:03.516620 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:03.519322 (+  2702us) service_pool.cc:224] Handling call
0709 13:20:04.586405 (+1067083us) spinlock_profiling.cc:243] Waited 728 ms on lock 0x7b54003e6a54. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f9ae2fa 00007fcc1496fb17 00007fcc0deea6d4 00007fcc0deea662 00007fcc0deea591 00007fcc0deea50c 00007fcc0dee97c2 00007fcc0dce548c 00007fcc0dce48c6 00007fcc0dce426f
0709 13:20:04.586594 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1673670400}
I20260709 13:20:04.596241  6799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f03d0dbf16864ca4bc1bb5e4c0334c0f" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:04.612457 10752 raft_consensus.cc:515] T 3fa34c08b205435dba97346991aa1f92 P cd75a17ab2604397adab03bb8b5fd75c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:20:04.613154  6801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4db81d9d329422bb3b4160ca4ac2d1d" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:04.618314  6726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17587d6730594da4a56fa13a353232a1" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:20:04.619433  6726 raft_consensus.cc:3060] T 17587d6730594da4a56fa13a353232a1 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:20:04.622213  6773 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:04.623723 10446 raft_consensus.cc:493] T a1704639a875409b9959353527b3fd68 P b7ab4784c7344b939bc36f639286f377 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:04.624927 10446 raft_consensus.cc:515] T a1704639a875409b9959353527b3fd68 P b7ab4784c7344b939bc36f639286f377 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:04.626945  6804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34f36d59d88f40fe8a2805e604fc6c0a" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:04.628922  7502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b8cacb381b746da8d0049b0a83b41dd" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb"
I20260709 13:20:04.629576 10727 raft_consensus.cc:493] T 90d42e216d9741e190bca19a781291fd P ccd8a4c3bfe3413cb2ae219b09aea832 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:20:04.629771  7495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8cee0accdb8499c86d4414b72565a38" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:20:04.631059  7495 raft_consensus.cc:2393] T d8cee0accdb8499c86d4414b72565a38 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c in current term 10: Already voted for candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in this term.
I20260709 13:20:04.630721 10727 raft_consensus.cc:515] T 90d42e216d9741e190bca19a781291fd P ccd8a4c3bfe3413cb2ae219b09aea832 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:04.632393 10758 raft_consensus.cc:493] T 7a734b5ab7834e05a8c422208acc58b1 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:04.633188 10758 raft_consensus.cc:515] T 7a734b5ab7834e05a8c422208acc58b1 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:04.629972  7502 raft_consensus.cc:3060] T 4b8cacb381b746da8d0049b0a83b41dd P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:20:04.607069  6772 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.68:45071, user_credentials={real_user=slave}} blocked reactor thread for 369555us
I20260709 13:20:04.571729 10695 raft_consensus.cc:740] T 7ba5dac66ab5497e9e336f2a3c28cda5 P b7ab4784c7344b939bc36f639286f377 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
I20260709 13:20:04.637429 10695 consensus_queue.cc:260] T 7ba5dac66ab5497e9e336f2a3c28cda5 P b7ab4784c7344b939bc36f639286f377 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
W20260709 13:20:04.630913  7466 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 202035us
I20260709 13:20:04.641929  6799 raft_consensus.cc:2468] T f03d0dbf16864ca4bc1bb5e4c0334c0f P b7ab4784c7344b939bc36f639286f377 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 9.
I20260709 13:20:04.596918  6807 rpcz_store.cc:276] 0709 13:20:03.150063 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:03.150188 (+   125us) service_pool.cc:224] Handling call
0709 13:20:03.150544 (+   356us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:03.338194 (+187650us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:03.338227 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:20:03.348696 (+ 10469us) log.cc:844] Serialized 26 byte log entry
0709 13:20:03.578781 (+230085us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:20:03.578844 (+    63us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:04.283589 (+704745us) spinlock_profiling.cc:243] Waited 128 ms on lock 0x7b54002c8dd4. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f9aae01 00007fcc0f9a983e 00007fcc1496e419 00007fcc0dee5bd4 00007fcc0dee5b62 00007fcc0dee5a91 00007fcc0dee5a0c 00007fcc0dee4cc2 00007fcc0dce548c 00007fcc0dce48c6
0709 13:20:04.283698 (+   109us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:04.283816 (+   118us) raft_consensus.cc:1685] finished
0709 13:20:04.283835 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:04.569189 (+285354us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":106793,"raft.queue_time_us":62062,"raft.run_cpu_time_us":144,"raft.run_wall_time_us":8371,"spinlock_wait_cycles":293663104,"thread_start_us":154281,"threads_started":1,"wal-append.queue_time_us":393702}
I20260709 13:20:04.645017  6872 raft_consensus.cc:1240] T f5be3a11b23d4ea9b08300a2789821c7 P cd75a17ab2604397adab03bb8b5fd75c [term 9 FOLLOWER]: Rejecting Update request from peer ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 8. Current term is 9. Ops: [8.5-8.5]
I20260709 13:20:04.654579 10828 raft_consensus.cc:493] T 7ba5dac66ab5497e9e336f2a3c28cda5 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:04.655437 10828 raft_consensus.cc:515] T 7ba5dac66ab5497e9e336f2a3c28cda5 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:20:04.655789 10704 raft_consensus.cc:515] T f09c2a98de1a4decabd0ff900dd44caa P cd75a17ab2604397adab03bb8b5fd75c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:04.659287 10704 leader_election.cc:290] T f09c2a98de1a4decabd0ff900dd44caa P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:20:04.659502  6873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5be3a11b23d4ea9b08300a2789821c7" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:04.659919  7503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb7fa124c3bf4ef9ab65a407cb008441" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
W20260709 13:20:04.661177  6697 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 142533us
I20260709 13:20:04.662348  6697 leader_election.cc:304] T 8c7f33e544204fbaac4078e3e83bbf4e P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:20:04.652426 10446 leader_election.cc:290] T a1704639a875409b9959353527b3fd68 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:04.664798  6876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b56bf91d90824c959e21e0cee5ba1816" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:04.665793  6876 raft_consensus.cc:2468] T b56bf91d90824c959e21e0cee5ba1816 P cd75a17ab2604397adab03bb8b5fd75c [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 10.
I20260709 13:20:04.666977  6880 raft_consensus.cc:1275] T 9e326172347f45e99a0d482b5d8ef768 P cd75a17ab2604397adab03bb8b5fd75c [term 10 FOLLOWER]: Refusing update from remote peer b7ab4784c7344b939bc36f639286f377: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 10 index: 5. (index mismatch)
I20260709 13:20:04.572139 10777 leader_election.cc:290] T ab432e62819d499eaaf3dd55481dd930 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:04.602021 10561 raft_consensus.cc:493] T 713b5728a197487c9300b310ab94e5a3 P b7ab4784c7344b939bc36f639286f377 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:04.600625  6874 rpcz_store.cc:276] 0709 13:20:03.093253 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:03.623658 (+530405us) service_pool.cc:224] Handling call
0709 13:20:03.623999 (+   341us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:03.624350 (+   351us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:03.624378 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:20:03.624966 (+   588us) log.cc:844] Serialized 26 byte log entry
0709 13:20:04.075103 (+450137us) spinlock_profiling.cc:243] Waited 3.71 ms on lock 0x7b1800048160. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc15785de1 00007fcc157925b1 00007fcc0c89fe07 00007fcc156faab9 00007fcc0c8bc69b 00007fcc0c8ba93f 00007fcc0c8bcc02 00007fcc0f54420b 00007fcc0f549d23 00007fcc0f54a0d1 00007fcc0f965a0f
0709 13:20:04.290310 (+215207us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:20:04.290434 (+   124us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:04.290594 (+   160us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:04.505683 (+215089us) raft_consensus.cc:1685] finished
0709 13:20:04.505710 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:04.547848 (+ 42138us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":44253,"raft.run_cpu_time_us":177,"raft.run_wall_time_us":13589,"spinlock_wait_cycles":8544128,"thread_start_us":214456,"threads_started":1,"wal-append.queue_time_us":517263}
I20260709 13:20:04.605584 10621 raft_consensus.cc:493] T 7c44c4849aa54f2b94d1f1bef9ed546f P cd75a17ab2604397adab03bb8b5fd75c [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:20:04.647475 10725 raft_consensus.cc:493] T fe20b4b48823486ca3b9c648db6ce8aa P ccd8a4c3bfe3413cb2ae219b09aea832 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:04.696627 10725 raft_consensus.cc:515] T fe20b4b48823486ca3b9c648db6ce8aa P ccd8a4c3bfe3413cb2ae219b09aea832 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:20:04.697633 10063 raft_consensus.cc:493] T 22ccee1b570c4ad3a57bd7aec085b1b4 P b7ab4784c7344b939bc36f639286f377 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:20:04.698693  6773 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:04.699234 10725 leader_election.cc:290] T fe20b4b48823486ca3b9c648db6ce8aa P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:20:04.698722  6614 catalog_manager.cc:5028] TS b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817): tablet 24ee15416e3145beaa1b8183453729a3 (table test-workload [id=04f4d366747e43549980077479ed75b9]) successfully deleted
I20260709 13:20:04.700172 10561 raft_consensus.cc:515] T 713b5728a197487c9300b310ab94e5a3 P b7ab4784c7344b939bc36f639286f377 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:04.700680 10708 raft_consensus.cc:493] T e31b9971c15848dea59d4d4130141d9e P b7ab4784c7344b939bc36f639286f377 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:04.700853  6880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb7fa124c3bf4ef9ab65a407cb008441" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:04.701726  6880 raft_consensus.cc:2468] T bb7fa124c3bf4ef9ab65a407cb008441 P cd75a17ab2604397adab03bb8b5fd75c [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 10.
I20260709 13:20:04.701874 10695 raft_consensus.cc:3060] T 7ba5dac66ab5497e9e336f2a3c28cda5 P b7ab4784c7344b939bc36f639286f377 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:20:04.705768  6876 raft_consensus.cc:1275] T 853ac0a8cbd64ce99457f170216d4d0f P cd75a17ab2604397adab03bb8b5fd75c [term 8 FOLLOWER]: Refusing update from remote peer b7ab4784c7344b939bc36f639286f377: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:20:04.696458 10818 raft_consensus.cc:493] T 44bde925b2e541b69890d70715b85176 P b7ab4784c7344b939bc36f639286f377 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:04.708283 10447 raft_consensus.cc:3060] T d8cee0accdb8499c86d4414b72565a38 P b7ab4784c7344b939bc36f639286f377 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:20:04.708598  6873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d33d5ee8ef6f415593d8df52063161ad" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:04.708663 10818 raft_consensus.cc:515] T 44bde925b2e541b69890d70715b85176 P b7ab4784c7344b939bc36f639286f377 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:04.705680  6881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f9c2e2bf644115957398fe4c9459db" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:04.710069 10063 raft_consensus.cc:515] T 22ccee1b570c4ad3a57bd7aec085b1b4 P b7ab4784c7344b939bc36f639286f377 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:04.729249 10814 raft_consensus.cc:3055] T fe20b4b48823486ca3b9c648db6ce8aa P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:20:04.729807 10814 raft_consensus.cc:740] T fe20b4b48823486ca3b9c648db6ce8aa P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 7ba59cc884714e8aa5f3f0ecaed84cbb, State: Running, Role: LEADER
I20260709 13:20:04.729938  6806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77e330a82df4b43a745d57a68f6f057" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:20:04.730669 10063 leader_election.cc:290] T 22ccee1b570c4ad3a57bd7aec085b1b4 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:04.730965  6806 raft_consensus.cc:3060] T e77e330a82df4b43a745d57a68f6f057 P b7ab4784c7344b939bc36f639286f377 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:04.733757 10844 raft_consensus.cc:493] T 427c124d773f483294511e80fe340075 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:20:04.734826 10844 raft_consensus.cc:515] T 427c124d773f483294511e80fe340075 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } attrs { replace: true } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:20:04.696691 10758 leader_election.cc:290] T 7a734b5ab7834e05a8c422208acc58b1 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:04.710902  6802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3f13b31a1f84f0d89d007eadd57924c" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:20:04.721560  6803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1528ab62b6fe4e3099d08f141afee116" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:04.712394  6770 leader_election.cc:304] T b56bf91d90824c959e21e0cee5ba1816 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
I20260709 13:20:04.738396  6872 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53416 (request call id 2785) took 1646 ms. Trace:
I20260709 13:20:04.714165  6880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1704639a875409b9959353527b3fd68" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:04.738864  6872 rpcz_store.cc:276] 0709 13:20:03.092147 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:03.474562 (+382415us) service_pool.cc:224] Handling call
0709 13:20:03.511033 (+ 36471us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:04.692466 (+1181433us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:04.738109 (+ 45643us) spinlock_profiling.cc:243] Waited 1.13 s on lock 0x7b5400219dd4. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f9aae01 00007fcc0f9a983e 00007fcc1496e419 00007fcc0dee5bd4 00007fcc0dee5b62 00007fcc0dee5a91 00007fcc0dee5a0c 00007fcc0dee4cc2 00007fcc0dce548c 00007fcc0dce48c6
0709 13:20:04.738335 (+   226us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2604222720}
I20260709 13:20:04.740144  6873 raft_consensus.cc:2468] T d33d5ee8ef6f415593d8df52063161ad P cd75a17ab2604397adab03bb8b5fd75c [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 11.
I20260709 13:20:04.739481  6880 raft_consensus.cc:2468] T a1704639a875409b9959353527b3fd68 P cd75a17ab2604397adab03bb8b5fd75c [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 11.
W20260709 13:20:04.741664  6877 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53416 (request call id 2795) took 1567 ms (client timeout 2028 ms). Trace:
W20260709 13:20:04.742172  6877 rpcz_store.cc:269] 0709 13:20:03.174571 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:03.179327 (+  4756us) service_pool.cc:224] Handling call
0709 13:20:04.741408 (+1562081us) spinlock_profiling.cc:243] Waited 1.06 s on lock 0x7b54000a69d4. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f9ae2fa 00007fcc1496fb17 00007fcc0deea6d4 00007fcc0deea662 00007fcc0deea591 00007fcc0deea50c 00007fcc0dee97c2 00007fcc0dce548c 00007fcc0dce48c6 00007fcc0dce426f
0709 13:20:04.741583 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2447908736}
W20260709 13:20:04.718261  6697 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 56205.6us
I20260709 13:20:04.718534  6804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1704639a875409b9959353527b3fd68" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:04.742753  6881 raft_consensus.cc:2468] T f3f9c2e2bf644115957398fe4c9459db P cd75a17ab2604397adab03bb8b5fd75c [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 9.
I20260709 13:20:04.743319  6804 raft_consensus.cc:2468] T a1704639a875409b9959353527b3fd68 P b7ab4784c7344b939bc36f639286f377 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 11.
I20260709 13:20:04.731288 10814 consensus_queue.cc:260] T fe20b4b48823486ca3b9c648db6ce8aa P 7ba59cc884714e8aa5f3f0ecaed84cbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:20:04.744051  6724 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49744 (request call id 365) took 1386 ms. Trace:
I20260709 13:20:04.719575  6801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d65025eea89441290d85dd053810e31" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:04.745070 10814 raft_consensus.cc:3060] T fe20b4b48823486ca3b9c648db6ce8aa P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:20:04.746361  6728 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50004 (request call id 1965) took 1228 ms. Trace:
I20260709 13:20:04.746807  6728 rpcz_store.cc:276] 0709 13:20:03.518221 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:03.539516 (+ 21295us) service_pool.cc:224] Handling call
0709 13:20:03.539822 (+   306us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:03.726339 (+186517us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:03.726376 (+    37us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:20:03.726423 (+    47us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:20:03.726462 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:04.745833 (+1019371us) spinlock_profiling.cc:243] Waited 186 ms on lock 0x7b540031a1d4. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f9aae01 00007fcc0f9a983e 00007fcc1496e419 00007fcc0dee5bd4 00007fcc0dee5b62 00007fcc0dee5a91 00007fcc0dee5a0c 00007fcc0dee4cc2 00007fcc0dce548c 00007fcc0dce48c6
0709 13:20:04.745913 (+    80us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:04.746125 (+   212us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":428296960}
I20260709 13:20:04.744555  6724 rpcz_store.cc:276] 0709 13:20:03.357276 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:03.357435 (+   159us) service_pool.cc:224] Handling call
0709 13:20:03.364555 (+  7120us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:04.282102 (+917547us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:04.743754 (+461652us) spinlock_profiling.cc:243] Waited 916 ms on lock 0x7b54003b6ad4. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f9aae01 00007fcc0f9a983e 00007fcc1496e419 00007fcc0dee5bd4 00007fcc0dee5b62 00007fcc0dee5a91 00007fcc0dee5a0c 00007fcc0dee4cc2 00007fcc0dce548c 00007fcc0dce48c6
0709 13:20:04.743976 (+   222us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2105993600}
I20260709 13:20:04.748648  6728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d33d5ee8ef6f415593d8df52063161ad" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:04.748930  6724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22ccee1b570c4ad3a57bd7aec085b1b4" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:04.749498  6728 raft_consensus.cc:2468] T d33d5ee8ef6f415593d8df52063161ad P ccd8a4c3bfe3413cb2ae219b09aea832 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 11.
I20260709 13:20:04.749917  6724 raft_consensus.cc:2468] T 22ccee1b570c4ad3a57bd7aec085b1b4 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 9.
I20260709 13:20:04.750773  6728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1704639a875409b9959353527b3fd68" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:04.751289  6724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "427c124d773f483294511e80fe340075" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:04.744773 10160 raft_consensus.cc:2804] T b56bf91d90824c959e21e0cee5ba1816 P b7ab4784c7344b939bc36f639286f377 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:20:04.754209 10160 raft_consensus.cc:493] T b56bf91d90824c959e21e0cee5ba1816 P b7ab4784c7344b939bc36f639286f377 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:04.751649  6728 raft_consensus.cc:2468] T a1704639a875409b9959353527b3fd68 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 11.
I20260709 13:20:04.754631 10160 raft_consensus.cc:3060] T b56bf91d90824c959e21e0cee5ba1816 P b7ab4784c7344b939bc36f639286f377 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:20:04.755470  7496 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50756 (request call id 271) took 1774 ms. Trace:
I20260709 13:20:04.756325 10828 leader_election.cc:290] T 7ba5dac66ab5497e9e336f2a3c28cda5 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:04.755909  7496 rpcz_store.cc:276] 0709 13:20:02.981433 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:02.981645 (+   212us) service_pool.cc:224] Handling call
0709 13:20:02.982066 (+   421us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:04.518452 (+1536386us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:04.755016 (+236564us) spinlock_profiling.cc:243] Waited 1.33 s on lock 0x7b54001ec8d4. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f9aae01 00007fcc0f9a983e 00007fcc1496e419 00007fcc0dee5bd4 00007fcc0dee5b62 00007fcc0dee5a91 00007fcc0dee5a0c 00007fcc0dee4cc2 00007fcc0dce548c 00007fcc0dce48c6
0709 13:20:04.755314 (+   298us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3050556800}
I20260709 13:20:04.759109 10727 leader_election.cc:290] T 90d42e216d9741e190bca19a781291fd P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:04.753468 10813 consensus_queue.cc:1059] T b3f13b31a1f84f0d89d007eadd57924c P 7ba59cc884714e8aa5f3f0ecaed84cbb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.009s
I20260709 13:20:04.763700 10813 raft_consensus.cc:3055] T b3f13b31a1f84f0d89d007eadd57924c P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:20:04.764161 10813 raft_consensus.cc:740] T b3f13b31a1f84f0d89d007eadd57924c P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 7ba59cc884714e8aa5f3f0ecaed84cbb, State: Running, Role: LEADER
I20260709 13:20:04.765549 10813 consensus_queue.cc:260] T b3f13b31a1f84f0d89d007eadd57924c P 7ba59cc884714e8aa5f3f0ecaed84cbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:20:04.766464  6801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab432e62819d499eaaf3dd55481dd930" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 13 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:04.767198 10813 raft_consensus.cc:3060] T b3f13b31a1f84f0d89d007eadd57924c P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:20:04.768235  6803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e326172347f45e99a0d482b5d8ef768" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:04.768610  6802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a734b5ab7834e05a8c422208acc58b1" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 11 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:04.769477  6802 raft_consensus.cc:2468] T 7a734b5ab7834e05a8c422208acc58b1 P b7ab4784c7344b939bc36f639286f377 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 10.
I20260709 13:20:04.719841  6727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f9c2e2bf644115957398fe4c9459db" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:04.720609  6798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4275cf08e63345f993bce8664eada830" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:20:04.721539 10738 leader_election.cc:290] T f5be3a11b23d4ea9b08300a2789821c7 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 9 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:20:04.722450 10591 raft_consensus.cc:493] T f3f9c2e2bf644115957398fe4c9459db P ccd8a4c3bfe3413cb2ae219b09aea832 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:20:04.723671  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 127295us
I20260709 13:20:04.701395 10708 raft_consensus.cc:515] T e31b9971c15848dea59d4d4130141d9e P b7ab4784c7344b939bc36f639286f377 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:04.718883 10794 raft_consensus.cc:2749] T 8c7f33e544204fbaac4078e3e83bbf4e P ccd8a4c3bfe3413cb2ae219b09aea832 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:20:04.770452  7500 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50742 (request call id 410) took 1419 ms. Trace:
I20260709 13:20:04.802742  7500 rpcz_store.cc:276] 0709 13:20:03.351028 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:03.351153 (+   125us) service_pool.cc:224] Handling call
0709 13:20:04.769987 (+1418834us) spinlock_profiling.cc:243] Waited 802 ms on lock 0x7b5400570154. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f9ae2fa 00007fcc1496fb17 00007fcc0deea6d4 00007fcc0deea662 00007fcc0deea591 00007fcc0deea50c 00007fcc0dee97c2 00007fcc0dce548c 00007fcc0dce48c6 00007fcc0dce426f
0709 13:20:04.770222 (+   235us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1845478784}
I20260709 13:20:04.744683  6697 leader_election.cc:304] T bd6869f07b5a4885a0b99fbe60c3b175 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:20:04.777067  6798 raft_consensus.cc:3060] T 4275cf08e63345f993bce8664eada830 P b7ab4784c7344b939bc36f639286f377 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:20:04.805857  6806 raft_consensus.cc:2468] T e77e330a82df4b43a745d57a68f6f057 P b7ab4784c7344b939bc36f639286f377 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 14.
I20260709 13:20:04.751585 10561 leader_election.cc:290] T 713b5728a197487c9300b310ab94e5a3 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:04.814735  6726 raft_consensus.cc:2468] T 17587d6730594da4a56fa13a353232a1 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in term 15.
I20260709 13:20:04.825323  6802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90d42e216d9741e190bca19a781291fd" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:04.778147 10591 raft_consensus.cc:515] T f3f9c2e2bf644115957398fe4c9459db P ccd8a4c3bfe3413cb2ae219b09aea832 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
W20260709 13:20:04.822722  6770 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 47727.8us
I20260709 13:20:04.836647  6724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "713b5728a197487c9300b310ab94e5a3" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 13 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:04.847028 10844 leader_election.cc:290] T 427c124d773f483294511e80fe340075 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:04.849732 10788 consensus_queue.cc:1059] T 3411566abe2d4c9bb4b2adfdd05e6f17 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:20:04.850939 10788 raft_consensus.cc:3055] T 3411566abe2d4c9bb4b2adfdd05e6f17 P b7ab4784c7344b939bc36f639286f377 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:20:04.851298 10788 raft_consensus.cc:740] T 3411566abe2d4c9bb4b2adfdd05e6f17 P b7ab4784c7344b939bc36f639286f377 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
I20260709 13:20:04.851442 10818 leader_election.cc:290] T 44bde925b2e541b69890d70715b85176 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:04.854635 10708 leader_election.cc:290] T e31b9971c15848dea59d4d4130141d9e P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:04.855296  7500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fa34c08b205435dba97346991aa1f92" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:20:04.855623 10727 raft_consensus.cc:493] T d8292e16e5654be6bc408560cf256aaa P ccd8a4c3bfe3413cb2ae219b09aea832 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:04.856232 10727 raft_consensus.cc:515] T d8292e16e5654be6bc408560cf256aaa P ccd8a4c3bfe3413cb2ae219b09aea832 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
W20260709 13:20:04.858387  6697 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 113880us
I20260709 13:20:04.861498  6770 leader_election.cc:304] T d33d5ee8ef6f415593d8df52063161ad P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
I20260709 13:20:04.860361  6697 leader_election.cc:304] T 3a485a995abc4807b6e511e45419f737 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377
W20260709 13:20:04.869818  6698 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:04.874235  6801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17587d6730594da4a56fa13a353232a1" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:20:04.876917  6800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "427c124d773f483294511e80fe340075" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:04.877221 10788 consensus_queue.cc:260] T 3411566abe2d4c9bb4b2adfdd05e6f17 P b7ab4784c7344b939bc36f639286f377 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:04.879122  6803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ba5dac66ab5497e9e336f2a3c28cda5" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:04.879213 10788 raft_consensus.cc:3060] T 3411566abe2d4c9bb4b2adfdd05e6f17 P b7ab4784c7344b939bc36f639286f377 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:20:04.882337 10160 raft_consensus.cc:515] T b56bf91d90824c959e21e0cee5ba1816 P b7ab4784c7344b939bc36f639286f377 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
W20260709 13:20:04.891942  6770 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 56856.8us
I20260709 13:20:04.892231  7502 raft_consensus.cc:2468] T 4b8cacb381b746da8d0049b0a83b41dd P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 11.
I20260709 13:20:04.884963  6727 raft_consensus.cc:2468] T f3f9c2e2bf644115957398fe4c9459db P ccd8a4c3bfe3413cb2ae219b09aea832 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 10.
I20260709 13:20:04.832897 10758 raft_consensus.cc:2749] T bd6869f07b5a4885a0b99fbe60c3b175 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:20:04.898420  6732 raft_consensus.cc:1240] T 17587d6730594da4a56fa13a353232a1 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 15 FOLLOWER]: Rejecting Update request from peer b7ab4784c7344b939bc36f639286f377 for earlier term 13. Current term is 15. Ops: []
I20260709 13:20:04.895866  6770 leader_election.cc:304] T 22ccee1b570c4ad3a57bd7aec085b1b4 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
I20260709 13:20:04.904635  6803 raft_consensus.cc:2468] T 7ba5dac66ab5497e9e336f2a3c28cda5 P b7ab4784c7344b939bc36f639286f377 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in term 11.
I20260709 13:20:04.858438 10727 leader_election.cc:290] T d8292e16e5654be6bc408560cf256aaa P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:04.919675  6726 raft_consensus.cc:1275] T 8c7f33e544204fbaac4078e3e83bbf4e P ccd8a4c3bfe3413cb2ae219b09aea832 [term 8 FOLLOWER]: Refusing update from remote peer b7ab4784c7344b939bc36f639286f377: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:20:04.901062 10160 leader_election.cc:290] T b56bf91d90824c959e21e0cee5ba1816 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 11 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:04.860983 10752 leader_election.cc:290] T 3fa34c08b205435dba97346991aa1f92 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:20:04.926924 10777 raft_consensus.cc:2804] T 3a485a995abc4807b6e511e45419f737 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:20:04.934005  6695 leader_election.cc:304] T f03d0dbf16864ca4bc1bb5e4c0334c0f P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
I20260709 13:20:04.936209 10832 consensus_queue.cc:1048] T 713b5728a197487c9300b310ab94e5a3 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:20:04.938113 10832 raft_consensus.cc:2804] T f03d0dbf16864ca4bc1bb5e4c0334c0f P ccd8a4c3bfe3413cb2ae219b09aea832 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:20:04.938553 10832 raft_consensus.cc:493] T f03d0dbf16864ca4bc1bb5e4c0334c0f P ccd8a4c3bfe3413cb2ae219b09aea832 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:04.938979 10832 raft_consensus.cc:3060] T f03d0dbf16864ca4bc1bb5e4c0334c0f P ccd8a4c3bfe3413cb2ae219b09aea832 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:20:04.925491  6770 leader_election.cc:304] T a1704639a875409b9959353527b3fd68 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
I20260709 13:20:04.925843  6798 raft_consensus.cc:2468] T 4275cf08e63345f993bce8664eada830 P b7ab4784c7344b939bc36f639286f377 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 12.
I20260709 13:20:04.860741 10621 raft_consensus.cc:515] T 7c44c4849aa54f2b94d1f1bef9ed546f P cd75a17ab2604397adab03bb8b5fd75c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:04.893007 10487 raft_consensus.cc:493] T 9b3759de40694069b13c0f8bd40e5709 P b7ab4784c7344b939bc36f639286f377 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:20:04.921244 10708 raft_consensus.cc:2804] T d33d5ee8ef6f415593d8df52063161ad P b7ab4784c7344b939bc36f639286f377 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:20:04.961826  6772 leader_election.cc:304] T 711ef6523deb4cbe8ef2ba61e1c21c98 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:20:04.963075 10446 consensus_queue.cc:1059] T 7887766dc6784fcaa42b35c05fea7a99 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:20:04.964730 10446 raft_consensus.cc:3055] T 7887766dc6784fcaa42b35c05fea7a99 P b7ab4784c7344b939bc36f639286f377 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:20:04.965219 10446 raft_consensus.cc:740] T 7887766dc6784fcaa42b35c05fea7a99 P b7ab4784c7344b939bc36f639286f377 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
I20260709 13:20:04.966426 10446 consensus_queue.cc:260] T 7887766dc6784fcaa42b35c05fea7a99 P b7ab4784c7344b939bc36f639286f377 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:04.968353 10446 raft_consensus.cc:3060] T 7887766dc6784fcaa42b35c05fea7a99 P b7ab4784c7344b939bc36f639286f377 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:20:04.943925 10695 raft_consensus.cc:2804] T 22ccee1b570c4ad3a57bd7aec085b1b4 P b7ab4784c7344b939bc36f639286f377 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:20:04.976866 10695 raft_consensus.cc:493] T 22ccee1b570c4ad3a57bd7aec085b1b4 P b7ab4784c7344b939bc36f639286f377 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:04.977344 10591 leader_election.cc:290] T f3f9c2e2bf644115957398fe4c9459db P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:04.977375 10695 raft_consensus.cc:3060] T 22ccee1b570c4ad3a57bd7aec085b1b4 P b7ab4784c7344b939bc36f639286f377 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:20:04.984760  6770 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 62055.3us
I20260709 13:20:04.988339  6800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8292e16e5654be6bc408560cf256aaa" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
W20260709 13:20:04.993070  6695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 47369.7us
I20260709 13:20:04.998622 10249 raft_consensus.cc:2804] T a1704639a875409b9959353527b3fd68 P b7ab4784c7344b939bc36f639286f377 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:20:04.999195 10249 raft_consensus.cc:493] T a1704639a875409b9959353527b3fd68 P b7ab4784c7344b939bc36f639286f377 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:05.000468  6802 raft_consensus.cc:1275] T 7c37d41cd9164c15a6826ca62a851a69 P b7ab4784c7344b939bc36f639286f377 [term 10 FOLLOWER]: Refusing update from remote peer ccd8a4c3bfe3413cb2ae219b09aea832: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:20:04.999564 10249 raft_consensus.cc:3060] T a1704639a875409b9959353527b3fd68 P b7ab4784c7344b939bc36f639286f377 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:20:05.007834 10700 raft_consensus.cc:493] T ce4f062dcd314d43a63ca74067cb5ee3 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 7ba59cc884714e8aa5f3f0ecaed84cbb)
I20260709 13:20:04.952589 10777 raft_consensus.cc:697] T 3a485a995abc4807b6e511e45419f737 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 10 LEADER]: Becoming Leader. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
I20260709 13:20:04.988099 10708 raft_consensus.cc:493] T d33d5ee8ef6f415593d8df52063161ad P b7ab4784c7344b939bc36f639286f377 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:05.019680  6727 raft_consensus.cc:1275] T dbdf895bba214ff68685a24fd17dfb5d P ccd8a4c3bfe3413cb2ae219b09aea832 [term 10 FOLLOWER]: Refusing update from remote peer b7ab4784c7344b939bc36f639286f377: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 10 index: 4. (index mismatch)
I20260709 13:20:05.006127  6800 raft_consensus.cc:2468] T d8292e16e5654be6bc408560cf256aaa P b7ab4784c7344b939bc36f639286f377 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 14.
W20260709 13:20:05.025395  6697 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 165176us
I20260709 13:20:04.995508  6772 leader_election.cc:304] T 4f00a2e87e56452083b759f60d461ee3 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:20:05.034686  6798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a92dd554674067a83a9cb68c4773f2" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:05.027575  7466 leader_election.cc:304] T 7ba5dac66ab5497e9e336f2a3c28cda5 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, b7ab4784c7344b939bc36f639286f377; no voters: 
I20260709 13:20:05.016752 10708 raft_consensus.cc:3060] T d33d5ee8ef6f415593d8df52063161ad P b7ab4784c7344b939bc36f639286f377 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:20:05.004446 10561 raft_consensus.cc:493] T 30e88460611e47b2ba16a46a30b5f416 P b7ab4784c7344b939bc36f639286f377 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:20:05.044060  6724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44bde925b2e541b69890d70715b85176" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:05.045094  6803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90d42e216d9741e190bca19a781291fd" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:05.051393  7466 leader_election.cc:304] T 427c124d773f483294511e80fe340075 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:20:05.056063  6727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b56bf91d90824c959e21e0cee5ba1816" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:20:05.056692  6727 raft_consensus.cc:3060] T b56bf91d90824c959e21e0cee5ba1816 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:20:05.008617 10700 raft_consensus.cc:515] T ce4f062dcd314d43a63ca74067cb5ee3 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } attrs { replace: true } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:20:05.059970  6802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6869f07b5a4885a0b99fbe60c3b175" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 12 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:05.025915 10487 raft_consensus.cc:515] T 9b3759de40694069b13c0f8bd40e5709 P b7ab4784c7344b939bc36f639286f377 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:05.063148  7466 leader_election.cc:304] T 17587d6730594da4a56fa13a353232a1 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
I20260709 13:20:05.064689  6726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a92dd554674067a83a9cb68c4773f2" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:05.060263  6724 raft_consensus.cc:2468] T 44bde925b2e541b69890d70715b85176 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 11.
I20260709 13:20:05.075493  6798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d65025eea89441290d85dd053810e31" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:05.062577 10844 raft_consensus.cc:2749] T 427c124d773f483294511e80fe340075 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:20:05.080506  6846 leader_election.cc:304] T 4b8cacb381b746da8d0049b0a83b41dd P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:20:05.071622  6695 leader_election.cc:304] T a1704639a875409b9959353527b3fd68 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
W20260709 13:20:05.088346  6772 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 124361us
W20260709 13:20:05.091990  6846 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.68:45071, user_credentials={real_user=slave}} blocked reactor thread for 99186.2us
I20260709 13:20:05.095654  6798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4db81d9d329422bb3b4160ca4ac2d1d" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:05.097098  6726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6869f07b5a4885a0b99fbe60c3b175" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 12 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:05.099417 10692 raft_consensus.cc:2804] T a1704639a875409b9959353527b3fd68 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:20:05.075237 10063 raft_consensus.cc:2749] T 4f00a2e87e56452083b759f60d461ee3 P b7ab4784c7344b939bc36f639286f377 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
W20260709 13:20:05.082859 10560 consensus_meta.cc:287] T f58dc08b12a2494bb9a1372837970ca2 P b7ab4784c7344b939bc36f639286f377: Time spent flushing consensus metadata: real 0.840s	user 0.018s	sys 0.007s
I20260709 13:20:05.103901  6772 leader_election.cc:304] T 1bf4668eeb70467fb3dc5a0289233b3c P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:20:05.099762  6695 leader_election.cc:304] T 7a734b5ab7834e05a8c422208acc58b1 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
I20260709 13:20:05.100095 10725 raft_consensus.cc:493] T 07a92dd554674067a83a9cb68c4773f2 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:20:05.100275 10160 raft_consensus.cc:2804] T 711ef6523deb4cbe8ef2ba61e1c21c98 P b7ab4784c7344b939bc36f639286f377 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:20:05.112001  6724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90d42e216d9741e190bca19a781291fd" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:05.099637  6730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d65025eea89441290d85dd053810e31" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:05.108386  6725 raft_consensus.cc:1275] T 3fa34c08b205435dba97346991aa1f92 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 12 FOLLOWER]: Refusing update from remote peer 7ba59cc884714e8aa5f3f0ecaed84cbb: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:20:05.125609  6695 leader_election.cc:304] T e77e330a82df4b43a745d57a68f6f057 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
I20260709 13:20:05.133210  6804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8292e16e5654be6bc408560cf256aaa" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:05.106006 10692 raft_consensus.cc:493] T a1704639a875409b9959353527b3fd68 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:05.128216  6729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e31b9971c15848dea59d4d4130141d9e" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:05.089605 10561 raft_consensus.cc:515] T 30e88460611e47b2ba16a46a30b5f416 P b7ab4784c7344b939bc36f639286f377 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:05.139802  6806 raft_consensus.cc:1275] T f58dc08b12a2494bb9a1372837970ca2 P b7ab4784c7344b939bc36f639286f377 [term 13 FOLLOWER]: Refusing update from remote peer ccd8a4c3bfe3413cb2ae219b09aea832: Log matching property violated. Preceding OpId in replica: term: 12 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 13:20:05.141333 10752 raft_consensus.cc:493] T 3a485a995abc4807b6e511e45419f737 P cd75a17ab2604397adab03bb8b5fd75c [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:05.155877  6804 raft_consensus.cc:2368] T d8292e16e5654be6bc408560cf256aaa P b7ab4784c7344b939bc36f639286f377 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c for earlier term 13. Current term is 14.
W20260709 13:20:05.205179 10891 log.cc:927] Time spent T 9e326172347f45e99a0d482b5d8ef768 P ccd8a4c3bfe3413cb2ae219b09aea832: Append to log took a long time: real 0.080s	user 0.000s	sys 0.000s
I20260709 13:20:05.205946 10695 raft_consensus.cc:515] T 22ccee1b570c4ad3a57bd7aec085b1b4 P b7ab4784c7344b939bc36f639286f377 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:05.207100 10862 raft_consensus.cc:493] T ab432e62819d499eaaf3dd55481dd930 P cd75a17ab2604397adab03bb8b5fd75c [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:05.152509 10865 raft_consensus.cc:2804] T 7ba5dac66ab5497e9e336f2a3c28cda5 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 13:20:05.207288 10889 log.cc:927] Time spent T 3411566abe2d4c9bb4b2adfdd05e6f17 P ccd8a4c3bfe3413cb2ae219b09aea832: Append to log took a long time: real 0.111s	user 0.000s	sys 0.001s
I20260709 13:20:05.194221 10650 raft_consensus.cc:2804] T 17587d6730594da4a56fa13a353232a1 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:20:05.190696 10418 raft_consensus.cc:493] T 3a485a995abc4807b6e511e45419f737 P b7ab4784c7344b939bc36f639286f377 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:05.193604 10785 raft_consensus.cc:2804] T 1bf4668eeb70467fb3dc5a0289233b3c P b7ab4784c7344b939bc36f639286f377 [term 11 FOLLOWER]: Leader election won for term 11
W20260709 13:20:05.208438 10853 log.cc:927] Time spent T 07a92dd554674067a83a9cb68c4773f2 P ccd8a4c3bfe3413cb2ae219b09aea832: Append to log took a long time: real 0.055s	user 0.001s	sys 0.000s
W20260709 13:20:05.246553  7467 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:05.247455 10785 raft_consensus.cc:697] T 1bf4668eeb70467fb3dc5a0289233b3c P b7ab4784c7344b939bc36f639286f377 [term 11 LEADER]: Becoming Leader. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
I20260709 13:20:05.211568 10621 leader_election.cc:290] T 7c44c4849aa54f2b94d1f1bef9ed546f P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
W20260709 13:20:05.201164 10849 log.cc:927] Time spent T f5be3a11b23d4ea9b08300a2789821c7 P b7ab4784c7344b939bc36f639286f377: Append to log took a long time: real 0.070s	user 0.000s	sys 0.000s
I20260709 13:20:05.189983 10827 raft_consensus.cc:2804] T 4b8cacb381b746da8d0049b0a83b41dd P cd75a17ab2604397adab03bb8b5fd75c [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:20:05.212567  6878 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53406 (request call id 2030) took 2104 ms. Trace:
W20260709 13:20:05.214747  6844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:05.123682 10818 raft_consensus.cc:493] T a3022224cc81473690653a83d4e99470 P b7ab4784c7344b939bc36f639286f377 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:05.140138 10725 raft_consensus.cc:515] T 07a92dd554674067a83a9cb68c4773f2 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:05.219609 10802 consensus_queue.cc:260] T 17587d6730594da4a56fa13a353232a1 P b7ab4784c7344b939bc36f639286f377 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
W20260709 13:20:05.209278  6773 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:05.217957  6799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "713b5728a197487c9300b310ab94e5a3" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:05.218335  6802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44bde925b2e541b69890d70715b85176" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:06.243499  6802 raft_consensus.cc:2468] T 44bde925b2e541b69890d70715b85176 P b7ab4784c7344b939bc36f639286f377 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 11.
I20260709 13:20:06.244130  6802 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:32966 (request call id 1026) took 1026 ms. Trace:
I20260709 13:20:06.244455  6802 rpcz_store.cc:276] 0709 13:20:05.217796 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:05.217962 (+   166us) service_pool.cc:224] Handling call
0709 13:20:06.244065 (+1026103us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:20:06.245651  6802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5be3a11b23d4ea9b08300a2789821c7" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:20:06.247164  6802 raft_consensus.cc:1240] T 4275cf08e63345f993bce8664eada830 P b7ab4784c7344b939bc36f639286f377 [term 12 FOLLOWER]: Rejecting Update request from peer cd75a17ab2604397adab03bb8b5fd75c for earlier term 11. Current term is 12. Ops: []
I20260709 13:20:05.222576  6804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce4f062dcd314d43a63ca74067cb5ee3" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:05.221158  6805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8cee0accdb8499c86d4414b72565a38" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:06.250895  6805 raft_consensus.cc:2468] T d8cee0accdb8499c86d4414b72565a38 P b7ab4784c7344b939bc36f639286f377 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 10.
I20260709 13:20:06.251578  6805 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:32966 (request call id 1027) took 1031 ms. Trace:
I20260709 13:20:05.383498 10908 raft_consensus.cc:493] T 7c37d41cd9164c15a6826ca62a851a69 P cd75a17ab2604397adab03bb8b5fd75c [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:20:05.291081  6844 connection.cc:256] RPC call timeout handler was delayed by -2.2960199480000938s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15080000000000002s for a response
I20260709 13:20:05.253986  6878 rpcz_store.cc:276] 0709 13:20:03.109180 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:03.641242 (+532062us) service_pool.cc:224] Handling call
0709 13:20:03.641713 (+   471us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:03.986252 (+344539us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:03.986283 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:20:04.868593 (+882310us) spinlock_profiling.cc:243] Waited 2.75 ms on lock 0x7b2c001176f8. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0e2a3a11 00007fcc0e2b3372 00007fcc0f9e5a01 00007fcc0f9aa43a 00007fcc0f9a983e 00007fcc1496e419 00007fcc0dee5bd4 00007fcc0dee5b62 00007fcc0dee5a91 00007fcc0dee5a0c 00007fcc0dee4cc2
0709 13:20:04.872972 (+  4379us) log.cc:844] Serialized 26 byte log entry
0709 13:20:05.081516 (+208544us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:20:05.081581 (+    65us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:05.084910 (+  3329us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:05.212112 (+127202us) raft_consensus.cc:1685] finished
0709 13:20:05.212131 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:05.212399 (+   268us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":82972,"raft.run_cpu_time_us":399,"raft.run_wall_time_us":26319,"spinlock_wait_cycles":6333184,"thread_start_us":550950,"threads_started":2,"wal-append.queue_time_us":323966}
W20260709 13:20:06.259956  6695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 1.14226e+06us
I20260709 13:20:06.297245  6723 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50004 (request call id 1976) took 1677 ms. Trace:
I20260709 13:20:06.171403  6724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b8cacb381b746da8d0049b0a83b41dd" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:05.148726  6725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4db81d9d329422bb3b4160ca4ac2d1d" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:06.797956  6724 raft_consensus.cc:2468] T 4b8cacb381b746da8d0049b0a83b41dd P ccd8a4c3bfe3413cb2ae219b09aea832 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 10.
I20260709 13:20:06.798386  6725 raft_consensus.cc:2468] T c4db81d9d329422bb3b4160ca4ac2d1d P ccd8a4c3bfe3413cb2ae219b09aea832 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 9.
W20260709 13:20:06.798826  6725 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49998 (request call id 1000) took 1669 ms (client timeout 1972 ms). Trace:
W20260709 13:20:06.799140  6725 rpcz_store.cc:269] 0709 13:20:05.129637 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:05.129835 (+   198us) service_pool.cc:224] Handling call
0709 13:20:06.798766 (+1668931us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:20:06.169682  6726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe20b4b48823486ca3b9c648db6ce8aa" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:06.800928  6726 raft_consensus.cc:2393] T fe20b4b48823486ca3b9c648db6ce8aa P ccd8a4c3bfe3413cb2ae219b09aea832 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c in current term 9: Already voted for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in this term.
I20260709 13:20:06.796355  6723 rpcz_store.cc:276] 0709 13:20:04.620468 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:04.621018 (+   550us) service_pool.cc:224] Handling call
0709 13:20:04.621525 (+   507us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:04.622080 (+   555us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:04.622114 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:20:04.622765 (+   651us) log.cc:844] Serialized 26 byte log entry
0709 13:20:04.825469 (+202704us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:20:04.825522 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:04.825619 (+    97us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:06.296979 (+1471360us) raft_consensus.cc:1685] finished
0709 13:20:06.297003 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:06.297176 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1143,"raft.run_cpu_time_us":178,"raft.run_wall_time_us":179,"thread_start_us":156956,"threads_started":1,"wal-append.queue_time_us":439445,"wal-append.run_cpu_time_us":10061,"wal-append.run_wall_time_us":1471066}
I20260709 13:20:06.801726  6726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44bde925b2e541b69890d70715b85176" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:06.801862  6723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5be3a11b23d4ea9b08300a2789821c7" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:20:06.250936  6729 raft_consensus.cc:2468] T e31b9971c15848dea59d4d4130141d9e P ccd8a4c3bfe3413cb2ae219b09aea832 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 8.
I20260709 13:20:06.170620  6730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce4f062dcd314d43a63ca74067cb5ee3" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:06.168581  6731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d9def8b32fd443aa94ab1420b06837b" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:06.805641  6730 raft_consensus.cc:2468] T ce4f062dcd314d43a63ca74067cb5ee3 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 10.
I20260709 13:20:06.806684  6730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "713b5728a197487c9300b310ab94e5a3" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:06.806998  6731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c240553ce044eedb41541d72b9475d7" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 13 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:06.226012  6770 leader_election.cc:304] T f3f9c2e2bf644115957398fe4c9459db P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
W20260709 13:20:06.179385  6771 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:05.939416  6772 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 835558us
W20260709 13:20:06.124476  6773 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:06.029831  6798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d9def8b32fd443aa94ab1420b06837b" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:06.127573  6799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09c2a98de1a4decabd0ff900dd44caa" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:06.187564  6800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c240553ce044eedb41541d72b9475d7" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 13 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:06.250170  6804 raft_consensus.cc:2468] T ce4f062dcd314d43a63ca74067cb5ee3 P b7ab4784c7344b939bc36f639286f377 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 10.
I20260709 13:20:06.110129  6806 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:32976 (request call id 2733) took 1286 ms. Trace:
I20260709 13:20:06.251932  6805 rpcz_store.cc:276] 0709 13:20:05.220587 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:05.220742 (+   155us) service_pool.cc:224] Handling call
0709 13:20:06.251504 (+1030762us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:20:06.099624  6807 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.028s	user 0.007s	sys 0.044s
W20260709 13:20:06.253818  6844 connection.cc:256] RPC call timeout handler was delayed by -2.26901994800005s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15380000000000002s for a response
W20260709 13:20:06.864666  6844 connection.cc:256] RPC call timeout handler was delayed by -2.1979199479999352s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1617s for a response
W20260709 13:20:06.865074  6844 connection.cc:256] RPC call timeout handler was delayed by -2.1646199480001087s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1654s for a response
W20260709 13:20:06.865387  6844 connection.cc:256] RPC call timeout handler was delayed by -2.1358199480000621s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1686s for a response
W20260709 13:20:06.865677  6844 connection.cc:256] RPC call timeout handler was delayed by -2.1349199480000607s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16870000000000002s for a response
W20260709 13:20:06.865980  6844 connection.cc:256] RPC call timeout handler was delayed by -2.1214199480000389s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17020000000000002s for a response
W20260709 13:20:06.866295  6844 connection.cc:256] RPC call timeout handler was delayed by -2.1142199480000272s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.171s for a response
W20260709 13:20:06.866583  6844 connection.cc:256] RPC call timeout handler was delayed by -2.0710199479999574s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1758s for a response
W20260709 13:20:06.866879  6844 connection.cc:256] RPC call timeout handler was delayed by -2.0629199479999443s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1767s for a response
W20260709 13:20:06.867173  6844 connection.cc:256] RPC call timeout handler was delayed by -2.0593199479999384s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1771s for a response
W20260709 13:20:06.867465  6844 connection.cc:256] RPC call timeout handler was delayed by -1.9459199479999825s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1897s for a response
W20260709 13:20:06.867754  6844 connection.cc:256] RPC call timeout handler was delayed by -1.841519948000041s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2013s for a response
I20260709 13:20:06.363586 10922 raft_consensus.cc:493] T bb7fa124c3bf4ef9ab65a407cb008441 P cd75a17ab2604397adab03bb8b5fd75c [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 7ba59cc884714e8aa5f3f0ecaed84cbb)
W20260709 13:20:05.319110  7468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 267853us
W20260709 13:20:06.200028  7467 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:06.265575 10160 raft_consensus.cc:493] T 711ef6523deb4cbe8ef2ba61e1c21c98 P b7ab4784c7344b939bc36f639286f377 [term 11 FOLLOWER]: Starting leader election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:20:06.876006 10844 raft_consensus.cc:493] T 404190ce4ce94cecbfcb6ea9d1dd8626 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:06.876226 10160 raft_consensus.cc:3060] T 711ef6523deb4cbe8ef2ba61e1c21c98 P b7ab4784c7344b939bc36f639286f377 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:20:06.876916 10844 raft_consensus.cc:515] T 404190ce4ce94cecbfcb6ea9d1dd8626 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:20:06.879139 10844 leader_election.cc:290] T 404190ce4ce94cecbfcb6ea9d1dd8626 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:20:05.261277 10418 raft_consensus.cc:515] T 3a485a995abc4807b6e511e45419f737 P b7ab4784c7344b939bc36f639286f377 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:06.263453 10421 raft_consensus.cc:2804] T e77e330a82df4b43a745d57a68f6f057 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:20:06.882308 10421 raft_consensus.cc:697] T e77e330a82df4b43a745d57a68f6f057 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 14 LEADER]: Becoming Leader. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
I20260709 13:20:06.883399 10844 raft_consensus.cc:493] T fe20b4b48823486ca3b9c648db6ce8aa P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:05.272624 10708 raft_consensus.cc:515] T d33d5ee8ef6f415593d8df52063161ad P b7ab4784c7344b939bc36f639286f377 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:06.887491 10708 leader_election.cc:290] T d33d5ee8ef6f415593d8df52063161ad P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 12 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:06.270875 10725 leader_election.cc:290] T 07a92dd554674067a83a9cb68c4773f2 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:05.353505 10695 leader_election.cc:290] T 22ccee1b570c4ad3a57bd7aec085b1b4 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 10 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:06.273375 10696 raft_consensus.cc:493] T 3fa34c08b205435dba97346991aa1f92 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:06.891646 10696 raft_consensus.cc:515] T 3fa34c08b205435dba97346991aa1f92 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:20:06.893919 10696 leader_election.cc:290] T 3fa34c08b205435dba97346991aa1f92 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:20:05.222641 10700 leader_election.cc:290] T ce4f062dcd314d43a63ca74067cb5ee3 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:20:05.255870 10752 raft_consensus.cc:515] T 3a485a995abc4807b6e511e45419f737 P cd75a17ab2604397adab03bb8b5fd75c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:06.897405 10752 leader_election.cc:290] T 3a485a995abc4807b6e511e45419f737 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:20:05.127882 10727 raft_consensus.cc:2804] T 7a734b5ab7834e05a8c422208acc58b1 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:20:06.898521 10727 raft_consensus.cc:493] T 7a734b5ab7834e05a8c422208acc58b1 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:06.898921 10727 raft_consensus.cc:3060] T 7a734b5ab7834e05a8c422208acc58b1 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:20:06.274250 10758 raft_consensus.cc:493] T be1a92657f494cac8dd227d152f50151 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 7ba59cc884714e8aa5f3f0ecaed84cbb)
I20260709 13:20:05.426120 10770 raft_consensus.cc:493] T 4f00a2e87e56452083b759f60d461ee3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:05.113227 10777 consensus_queue.cc:237] T 3a485a995abc4807b6e511e45419f737 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:06.905908 10770 raft_consensus.cc:515] T 4f00a2e87e56452083b759f60d461ee3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:20:06.909431 10770 leader_election.cc:290] T 4f00a2e87e56452083b759f60d461ee3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:05.273593 10802 raft_consensus.cc:3060] T 17587d6730594da4a56fa13a353232a1 P b7ab4784c7344b939bc36f639286f377 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:06.914842 10727 raft_consensus.cc:515] T 7a734b5ab7834e05a8c422208acc58b1 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:05.273852 10818 raft_consensus.cc:515] T a3022224cc81473690653a83d4e99470 P b7ab4784c7344b939bc36f639286f377 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:06.917122 10727 leader_election.cc:290] T 7a734b5ab7834e05a8c422208acc58b1 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 11 election: Requested vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:05.226419 10249 raft_consensus.cc:515] T a1704639a875409b9959353527b3fd68 P b7ab4784c7344b939bc36f639286f377 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:05.274524 10827 raft_consensus.cc:697] T 4b8cacb381b746da8d0049b0a83b41dd P cd75a17ab2604397adab03bb8b5fd75c [term 11 LEADER]: Becoming Leader. State: Replica: cd75a17ab2604397adab03bb8b5fd75c, State: Running, Role: LEADER
I20260709 13:20:05.224130 10487 leader_election.cc:290] T 9b3759de40694069b13c0f8bd40e5709 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:05.347076 10561 leader_election.cc:290] T 30e88460611e47b2ba16a46a30b5f416 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:05.253198 10650 raft_consensus.cc:697] T 17587d6730594da4a56fa13a353232a1 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 15 LEADER]: Becoming Leader. State: Replica: 7ba59cc884714e8aa5f3f0ecaed84cbb, State: Running, Role: LEADER
I20260709 13:20:06.928438 10650 consensus_queue.cc:237] T 17587d6730594da4a56fa13a353232a1 P 7ba59cc884714e8aa5f3f0ecaed84cbb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:20:06.931293  6801 raft_consensus.cc:3060] T 17587d6730594da4a56fa13a353232a1 P b7ab4784c7344b939bc36f639286f377 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:05.142277 10692 raft_consensus.cc:3060] T a1704639a875409b9959353527b3fd68 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:20:05.295912 10738 raft_consensus.cc:493] T 34f36d59d88f40fe8a2805e604fc6c0a P cd75a17ab2604397adab03bb8b5fd75c [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:20:06.937547 10738 raft_consensus.cc:515] T 34f36d59d88f40fe8a2805e604fc6c0a P cd75a17ab2604397adab03bb8b5fd75c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:06.939150  6801 raft_consensus.cc:2468] T 17587d6730594da4a56fa13a353232a1 P b7ab4784c7344b939bc36f639286f377 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in term 15.
I20260709 13:20:05.330941 10785 consensus_queue.cc:237] T 1bf4668eeb70467fb3dc5a0289233b3c P b7ab4784c7344b939bc36f639286f377 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
W20260709 13:20:05.365085 10813 consensus_meta.cc:287] T b3f13b31a1f84f0d89d007eadd57924c P 7ba59cc884714e8aa5f3f0ecaed84cbb: Time spent flushing consensus metadata: real 0.597s	user 0.010s	sys 0.005s
I20260709 13:20:05.369627 10832 raft_consensus.cc:515] T f03d0dbf16864ca4bc1bb5e4c0334c0f P ccd8a4c3bfe3413cb2ae219b09aea832 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:06.402014 10860 raft_consensus.cc:493] T 4b8cacb381b746da8d0049b0a83b41dd P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:05.274197 10862 raft_consensus.cc:515] T ab432e62819d499eaaf3dd55481dd930 P cd75a17ab2604397adab03bb8b5fd75c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:05.238942 10865 raft_consensus.cc:493] T 7ba5dac66ab5497e9e336f2a3c28cda5 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:06.965384 10865 raft_consensus.cc:3060] T 7ba5dac66ab5497e9e336f2a3c28cda5 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:20:06.966210 10862 leader_election.cc:290] T ab432e62819d499eaaf3dd55481dd930 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:20:05.227084 10869 raft_consensus.cc:493] T 711ef6523deb4cbe8ef2ba61e1c21c98 P cd75a17ab2604397adab03bb8b5fd75c [term 11 FOLLOWER]: Starting pre-election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
W20260709 13:20:05.380461 10898 log.cc:927] Time spent T ab432e62819d499eaaf3dd55481dd930 P ccd8a4c3bfe3413cb2ae219b09aea832: Append to log took a long time: real 0.064s	user 0.004s	sys 0.001s
W20260709 13:20:05.980531 10904 log.cc:927] Time spent T f5be3a11b23d4ea9b08300a2789821c7 P ccd8a4c3bfe3413cb2ae219b09aea832: Append to log took a long time: real 0.637s	user 0.004s	sys 0.004s
I20260709 13:20:06.252764 10908 raft_consensus.cc:515] T 7c37d41cd9164c15a6826ca62a851a69 P cd75a17ab2604397adab03bb8b5fd75c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:06.106560 10910 raft_consensus.cc:493] T 853ac0a8cbd64ce99457f170216d4d0f P cd75a17ab2604397adab03bb8b5fd75c [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:06.125916 10913 raft_consensus.cc:493] T 427c124d773f483294511e80fe340075 P cd75a17ab2604397adab03bb8b5fd75c [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
W20260709 13:20:06.259135 10903 log.cc:927] Time spent T 713b5728a197487c9300b310ab94e5a3 P b7ab4784c7344b939bc36f639286f377: Append to log took a long time: real 0.916s	user 0.005s	sys 0.002s
I20260709 13:20:06.195142 10915 consensus_queue.cc:1048] T 3fa34c08b205435dba97346991aa1f92 P 7ba59cc884714e8aa5f3f0ecaed84cbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:20:06.252195 10914 raft_consensus.cc:493] T 7ba5dac66ab5497e9e336f2a3c28cda5 P cd75a17ab2604397adab03bb8b5fd75c [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:06.259476 10918 consensus_queue.cc:1048] T 8c7f33e544204fbaac4078e3e83bbf4e P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:20:06.358353 10921 raft_consensus.cc:493] T 95a75bfe094d4bdc963aba3f08dfcd25 P cd75a17ab2604397adab03bb8b5fd75c [term 11 FOLLOWER]: Starting pre-election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
W20260709 13:20:06.646181  6732 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.718s	user 0.031s	sys 0.035s
W20260709 13:20:06.691502  7466 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 43521.7us
I20260709 13:20:06.699523  6874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4b8bd455d5a47c18a1380839c6e0d61" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:06.701596  6881 raft_consensus.cc:1275] T a3022224cc81473690653a83d4e99470 P cd75a17ab2604397adab03bb8b5fd75c [term 12 FOLLOWER]: Refusing update from remote peer ccd8a4c3bfe3413cb2ae219b09aea832: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 12 index: 6. (index mismatch)
I20260709 13:20:06.706327  6880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3d8792045a4583ae2e965b1350a5b4" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:06.708164  6873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24ee15416e3145beaa1b8183453729a3" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:06.713092  6872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77e330a82df4b43a745d57a68f6f057" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:06.714751  6875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34f36d59d88f40fe8a2805e604fc6c0a" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:06.717154  6876 raft_consensus.cc:1275] T 713b5728a197487c9300b310ab94e5a3 P cd75a17ab2604397adab03bb8b5fd75c [term 12 FOLLOWER]: Refusing update from remote peer ccd8a4c3bfe3413cb2ae219b09aea832: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:20:06.732405 10794 consensus_queue.cc:1059] T f5be3a11b23d4ea9b08300a2789821c7 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:20:06.739437  6629 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:51654 (request call id 82) took 9987 ms. Trace:
I20260709 13:20:06.744833 10930 raft_consensus.cc:493] T 7887766dc6784fcaa42b35c05fea7a99 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:20:06.754871 10920 raft_consensus.cc:493] T 7c44c4849aa54f2b94d1f1bef9ed546f P ccd8a4c3bfe3413cb2ae219b09aea832 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:20:06.756213 10931 raft_consensus.cc:493] T bd6869f07b5a4885a0b99fbe60c3b175 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:20:06.759003  5625 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:20:06.771486  6877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d65025eea89441290d85dd053810e31" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:06.772455 10580 raft_consensus.cc:493] T dbdf895bba214ff68685a24fd17dfb5d P ccd8a4c3bfe3413cb2ae219b09aea832 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:20:06.778167  6828 debug-util.cc:398] Leaking SignalData structure 0x7b08000dc8a0 after lost signal to thread 5628
I20260709 13:20:06.778576  6618 maintenance_manager.cc:643] P b3ae52d33b9a4273a42e5e2cf3b5d6b5: FlushMRSOp(00000000000000000000000000000000) complete. Timing: real 5.262s	user 0.169s	sys 0.082s Metrics: {"bytes_written":29793,"cfile_init":1,"delete_count":0,"dirs.queue_time_us":8049,"dirs.run_cpu_time_us":562,"dirs.run_wall_time_us":6224,"drs_written":1,"lbm_read_time_us":405,"lbm_reads_lt_1ms":4,"lbm_write_time_us":65122,"lbm_writes_10-100_ms":2,"lbm_writes_lt_1ms":31,"peak_mem_usage":0,"reinsert_count":0,"rows_written":63,"thread_start_us":26690,"threads_started":2,"update_count":4,"wal-append.queue_time_us":19501}
I20260709 13:20:06.785614  6878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce4f062dcd314d43a63ca74067cb5ee3" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:06.788291 10928 raft_consensus.cc:493] T 20f6842e26174571996b8dea4151d4be P ccd8a4c3bfe3413cb2ae219b09aea832 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:06.796921  6879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90d42e216d9741e190bca19a781291fd" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:06.799216  6724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09c2a98de1a4decabd0ff900dd44caa" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:06.802481  6726 raft_consensus.cc:2393] T 44bde925b2e541b69890d70715b85176 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c in current term 11: Already voted for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in this term.
W20260709 13:20:05.849882  6727 consensus_meta.cc:287] T b56bf91d90824c959e21e0cee5ba1816 P ccd8a4c3bfe3413cb2ae219b09aea832: Time spent flushing consensus metadata: real 0.776s	user 0.016s	sys 0.000s
W20260709 13:20:06.126813  6728 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.274s	user 0.032s	sys 0.031s
I20260709 13:20:06.803387  6725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fa34c08b205435dba97346991aa1f92" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
W20260709 13:20:06.804574  6729 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50004 (request call id 1990) took 1790 ms (client timeout 2126 ms). Trace:
I20260709 13:20:06.807885  6730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b8cacb381b746da8d0049b0a83b41dd" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
W20260709 13:20:06.810389  6770 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 584910us
I20260709 13:20:06.811218 10534 raft_consensus.cc:2804] T f3f9c2e2bf644115957398fe4c9459db P b7ab4784c7344b939bc36f639286f377 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:20:06.813849 10938 raft_consensus.cc:493] T 7c37d41cd9164c15a6826ca62a851a69 P b7ab4784c7344b939bc36f639286f377 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:20:06.818751  6773 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:06.832317  6800 raft_consensus.cc:2410] T 2c240553ce044eedb41541d72b9475d7 P b7ab4784c7344b939bc36f639286f377 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c for term 13 because replica has last-logged OpId of term: 12 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
W20260709 13:20:06.832384  6799 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:32966 (request call id 1029) took 1611 ms (client timeout 1595 ms). Trace:
I20260709 13:20:06.832991  6798 raft_consensus.cc:2393] T 4d9def8b32fd443aa94ab1420b06837b P b7ab4784c7344b939bc36f639286f377 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c in current term 11: Already voted for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in this term.
W20260709 13:20:06.831481  6695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 46946.1us
W20260709 13:20:06.839349  6697 connection.cc:256] RPC call timeout handler was delayed by -2.8362052400000266s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15680000000000002s for a response
W20260709 13:20:06.847800  6804 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:32966 (request call id 1024) took 1631 ms (client timeout 1743 ms). Trace:
I20260709 13:20:06.848958 10936 raft_consensus.cc:493] T 8c7f33e544204fbaac4078e3e83bbf4e P ccd8a4c3bfe3413cb2ae219b09aea832 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:06.850356  6806 rpcz_store.cc:276] 0709 13:20:04.827278 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:04.831455 (+  4177us) service_pool.cc:224] Handling call
0709 13:20:04.836250 (+  4795us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:05.155772 (+319522us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:06.109732 (+953960us) spinlock_profiling.cc:243] Waited 288 ms on lock 0x7b54001d15d4. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f9aae01 00007fcc0f9a983e 00007fcc1496e419 00007fcc0dee5bd4 00007fcc0dee5b62 00007fcc0dee5a91 00007fcc0dee5a0c 00007fcc0dee4cc2 00007fcc0dce548c 00007fcc0dce48c6
0709 13:20:06.110022 (+   290us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":663152000}
W20260709 13:20:06.860191  6771 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:06.863196  6807 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.792s	user 0.009s	sys 0.044s
W20260709 13:20:06.868808  6844 connection.cc:256] RPC call timeout handler was delayed by -1.8406199480000396s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2014s for a response
I20260709 13:20:06.868489 10922 raft_consensus.cc:515] T bb7fa124c3bf4ef9ab65a407cb008441 P cd75a17ab2604397adab03bb8b5fd75c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:20:06.871491  6772 leader_election.cc:304] T d8292e16e5654be6bc408560cf256aaa P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: ccd8a4c3bfe3413cb2ae219b09aea832
W20260709 13:20:06.874003  7468 leader_election.cc:336] T 3fa34c08b205435dba97346991aa1f92 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931): Timed out: RequestConsensusVote RPC to 127.5.126.67:42931 timed out after 1.678s (SENT)
I20260709 13:20:05.290449 10621 raft_consensus.cc:493] T e31b9971c15848dea59d4d4130141d9e P cd75a17ab2604397adab03bb8b5fd75c [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:20:06.884354 10418 leader_election.cc:290] T 3a485a995abc4807b6e511e45419f737 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:06.883635 10421 consensus_queue.cc:237] T e77e330a82df4b43a745d57a68f6f057 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 12.6, Last appended by leader: 6, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } }
I20260709 13:20:06.889104 10160 raft_consensus.cc:515] T 711ef6523deb4cbe8ef2ba61e1c21c98 P b7ab4784c7344b939bc36f639286f377 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:06.890208 10844 raft_consensus.cc:515] T fe20b4b48823486ca3b9c648db6ce8aa P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:20:06.904934 10758 raft_consensus.cc:515] T be1a92657f494cac8dd227d152f50151 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:20:06.921352 10818 leader_election.cc:290] T a3022224cc81473690653a83d4e99470 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:06.923763 10249 leader_election.cc:290] T a1704639a875409b9959353527b3fd68 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 12 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:06.946532 10827 consensus_queue.cc:237] T 4b8cacb381b746da8d0049b0a83b41dd P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:20:06.948169 10738 leader_election.cc:290] T 34f36d59d88f40fe8a2805e604fc6c0a P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:20:06.952824 10912 raft_consensus.cc:493] T b3f13b31a1f84f0d89d007eadd57924c P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:20:06.956328  6801 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50550 (request call id 393) took 2083 ms (client timeout 2326 ms). Trace:
I20260709 13:20:06.962918 10860 raft_consensus.cc:515] T 4b8cacb381b746da8d0049b0a83b41dd P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:20:06.971467 10869 raft_consensus.cc:515] T 711ef6523deb4cbe8ef2ba61e1c21c98 P cd75a17ab2604397adab03bb8b5fd75c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
W20260709 13:20:07.232899  6800 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:32966 (request call id 1028) took 2012 ms (client timeout 2314 ms). Trace:
W20260709 13:20:07.233567  6828 debug-util.cc:398] Leaking SignalData structure 0x7b080009a840 after lost signal to thread 6664
I20260709 13:20:07.234440 10758 leader_election.cc:290] T be1a92657f494cac8dd227d152f50151 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:20:07.234931  6726 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49998 (request call id 1005) took 1068 ms. Trace:
W20260709 13:20:07.235344  6844 connection.cc:256] RPC call timeout handler was delayed by -1.8199199480000061s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2037s for a response
I20260709 13:20:07.235759 10910 raft_consensus.cc:515] T 853ac0a8cbd64ce99457f170216d4d0f P cd75a17ab2604397adab03bb8b5fd75c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:07.198673 10650 raft_consensus.cc:493] T 24ee15416e3145beaa1b8183453729a3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:07.122390 10865 raft_consensus.cc:515] T 7ba5dac66ab5497e9e336f2a3c28cda5 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:20:06.973702  6627 catalog_manager.cc:5697] T 30e88460611e47b2ba16a46a30b5f416 P ccd8a4c3bfe3413cb2ae219b09aea832 reported cstate change: term changed from 4 to 7, leader changed from b7ab4784c7344b939bc36f639286f377 (127.5.126.66) to ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65). New cstate: current_term: 7 leader_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:07.225116 10692 raft_consensus.cc:515] T a1704639a875409b9959353527b3fd68 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
W20260709 13:20:07.236004  6844 connection.cc:256] RPC call timeout handler was delayed by -1.8109199479999916s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20470000000000002s for a response
I20260709 13:20:07.255575 10928 raft_consensus.cc:515] T 20f6842e26174571996b8dea4151d4be P ccd8a4c3bfe3413cb2ae219b09aea832 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:07.260934 10921 raft_consensus.cc:515] T 95a75bfe094d4bdc963aba3f08dfcd25 P cd75a17ab2604397adab03bb8b5fd75c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:07.262660 10928 leader_election.cc:290] T 20f6842e26174571996b8dea4151d4be P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:07.110155 10832 leader_election.cc:290] T f03d0dbf16864ca4bc1bb5e4c0334c0f P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 10 election: Requested vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:07.238343 10844 leader_election.cc:290] T fe20b4b48823486ca3b9c648db6ce8aa P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
W20260709 13:20:07.255998  6844 connection.cc:256] RPC call timeout handler was delayed by -1.7434199480001098s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2122s for a response
I20260709 13:20:07.240538  6730 raft_consensus.cc:3060] T 4b8cacb381b746da8d0049b0a83b41dd P ccd8a4c3bfe3413cb2ae219b09aea832 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:20:07.235059 10930 raft_consensus.cc:515] T 7887766dc6784fcaa42b35c05fea7a99 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:07.244518 10794 raft_consensus.cc:3055] T f5be3a11b23d4ea9b08300a2789821c7 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:20:07.269371 10794 raft_consensus.cc:740] T f5be3a11b23d4ea9b08300a2789821c7 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
W20260709 13:20:07.260385  6798 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:32966 (request call id 1023) took 2107 ms (client timeout 1604 ms). Trace:
I20260709 13:20:07.205088 10777 raft_consensus.cc:493] T 17587d6730594da4a56fa13a353232a1 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:07.234007 10580 raft_consensus.cc:515] T dbdf895bba214ff68685a24fd17dfb5d P ccd8a4c3bfe3413cb2ae219b09aea832 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:07.270454 10794 consensus_queue.cc:260] T f5be3a11b23d4ea9b08300a2789821c7 P ccd8a4c3bfe3413cb2ae219b09aea832 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:07.246631 10931 raft_consensus.cc:515] T bd6869f07b5a4885a0b99fbe60c3b175 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:07.238153 10910 leader_election.cc:290] T 853ac0a8cbd64ce99457f170216d4d0f P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:20:07.240125 10160 leader_election.cc:290] T 711ef6523deb4cbe8ef2ba61e1c21c98 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 12 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:07.259593  6877 raft_consensus.cc:2468] T 3d65025eea89441290d85dd053810e31 P cd75a17ab2604397adab03bb8b5fd75c [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 9.
I20260709 13:20:07.264312 10913 raft_consensus.cc:515] T 427c124d773f483294511e80fe340075 P cd75a17ab2604397adab03bb8b5fd75c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } attrs { replace: true } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
W20260709 13:20:07.270825  6798 rpcz_store.cc:269] 0709 13:20:05.152819 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:05.153250 (+   431us) service_pool.cc:224] Handling call
0709 13:20:07.260271 (+2107021us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:20:07.234131  6828 debug-util.cc:398] Leaking SignalData structure 0x7b08000e2d80 after lost signal to thread 6678
I20260709 13:20:07.244553  6724 raft_consensus.cc:2468] T f09c2a98de1a4decabd0ff900dd44caa P ccd8a4c3bfe3413cb2ae219b09aea832 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 12.
I20260709 13:20:07.270991 10777 raft_consensus.cc:515] T 17587d6730594da4a56fa13a353232a1 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:20:07.244256  6725 raft_consensus.cc:2468] T 3fa34c08b205435dba97346991aa1f92 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 12.
W20260709 13:20:07.245559  6772 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 374183us
I20260709 13:20:07.245076  6874 raft_consensus.cc:2410] T f4b8bd455d5a47c18a1380839c6e0d61 P cd75a17ab2604397adab03bb8b5fd75c [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ccd8a4c3bfe3413cb2ae219b09aea832 for term 10 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 13:20:07.245604  6727 raft_consensus.cc:2468] T b56bf91d90824c959e21e0cee5ba1816 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 11.
I20260709 13:20:07.245988 10785 raft_consensus.cc:2804] T d8292e16e5654be6bc408560cf256aaa P b7ab4784c7344b939bc36f639286f377 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:20:07.246181 10802 raft_consensus.cc:493] T 2c240553ce044eedb41541d72b9475d7 P b7ab4784c7344b939bc36f639286f377 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:20:07.244848 10914 raft_consensus.cc:515] T 7ba5dac66ab5497e9e336f2a3c28cda5 P cd75a17ab2604397adab03bb8b5fd75c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:20:07.246464  6878 raft_consensus.cc:2468] T ce4f062dcd314d43a63ca74067cb5ee3 P cd75a17ab2604397adab03bb8b5fd75c [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 10.
W20260709 13:20:07.246253  6728 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 2.394s	user 0.038s	sys 0.036s
I20260709 13:20:07.247249 10561 raft_consensus.cc:493] T f58dc08b12a2494bb9a1372837970ca2 P b7ab4784c7344b939bc36f639286f377 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:07.247697 10487 raft_consensus.cc:493] T 4275cf08e63345f993bce8664eada830 P b7ab4784c7344b939bc36f639286f377 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:07.249312 10695 consensus_queue.cc:1048] T dbdf895bba214ff68685a24fd17dfb5d P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.027s
I20260709 13:20:07.252307  6872 raft_consensus.cc:2468] T e77e330a82df4b43a745d57a68f6f057 P cd75a17ab2604397adab03bb8b5fd75c [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 13.
I20260709 13:20:07.250690  6881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e326172347f45e99a0d482b5d8ef768" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:07.258803 10727 raft_consensus.cc:493] T 3411566abe2d4c9bb4b2adfdd05e6f17 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:20:07.264005 10869 leader_election.cc:290] T 711ef6523deb4cbe8ef2ba61e1c21c98 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:20:07.260648 10865 leader_election.cc:290] T 7ba5dac66ab5497e9e336f2a3c28cda5 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 12 election: Requested vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:07.277513  7498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3d8792045a4583ae2e965b1350a5b4" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
W20260709 13:20:07.257915  6801 rpcz_store.cc:269] 0709 13:20:04.872918 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:04.873966 (+  1048us) service_pool.cc:224] Handling call
0709 13:20:06.956063 (+2082097us) spinlock_profiling.cc:243] Waited 2.06 s on lock 0x7b54001d1fd4. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f9ae2fa 00007fcc1496fb17 00007fcc0deea6d4 00007fcc0deea662 00007fcc0deea591 00007fcc0deea50c 00007fcc0dee97c2 00007fcc0dce548c 00007fcc0dce48c6 00007fcc0dce426f
0709 13:20:06.956234 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4728535424}
I20260709 13:20:07.235401  6726 rpcz_store.cc:276] 0709 13:20:06.166512 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:06.801479 (+634967us) service_pool.cc:224] Handling call
0709 13:20:07.234769 (+433290us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:20:07.250931  6873 raft_consensus.cc:2468] T 24ee15416e3145beaa1b8183453729a3 P cd75a17ab2604397adab03bb8b5fd75c [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 11.
I20260709 13:20:07.251993  6876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8292e16e5654be6bc408560cf256aaa" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:07.254154  6875 raft_consensus.cc:2468] T 34f36d59d88f40fe8a2805e604fc6c0a P cd75a17ab2604397adab03bb8b5fd75c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 7.
I20260709 13:20:07.243371  6619 maintenance_manager.cc:419] P b3ae52d33b9a4273a42e5e2cf3b5d6b5: Scheduling UndoDeltaBlockGCOp(00000000000000000000000000000000): 6952 bytes on disk
I20260709 13:20:07.244171  7502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb7fa124c3bf4ef9ab65a407cb008441" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
W20260709 13:20:07.253911  6799 rpcz_store.cc:269] 0709 13:20:05.221308 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:06.127218 (+905910us) service_pool.cc:224] Handling call
0709 13:20:06.832302 (+705084us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:20:07.383634 10708 consensus_queue.cc:1048] T ab432e62819d499eaaf3dd55481dd930 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:20:07.252689 10534 raft_consensus.cc:493] T f3f9c2e2bf644115957398fe4c9459db P b7ab4784c7344b939bc36f639286f377 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:07.276593  7500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b8cacb381b746da8d0049b0a83b41dd" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:20:07.385063 10534 raft_consensus.cc:3060] T f3f9c2e2bf644115957398fe4c9459db P b7ab4784c7344b939bc36f639286f377 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:20:07.385531  7500 raft_consensus.cc:2393] T 4b8cacb381b746da8d0049b0a83b41dd P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ccd8a4c3bfe3413cb2ae219b09aea832 in current term 11: Already voted for candidate cd75a17ab2604397adab03bb8b5fd75c in this term.
I20260709 13:20:07.274755  6723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "404190ce4ce94cecbfcb6ea9d1dd8626" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:07.386430  6725 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49998 (request call id 1009) took 1218 ms. Trace:
I20260709 13:20:07.386600  6723 raft_consensus.cc:2468] T 404190ce4ce94cecbfcb6ea9d1dd8626 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in term 11.
I20260709 13:20:07.386827  6725 rpcz_store.cc:276] 0709 13:20:06.167631 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:06.800023 (+632392us) service_pool.cc:224] Handling call
0709 13:20:07.386359 (+586336us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:20:07.387710 10802 raft_consensus.cc:515] T 2c240553ce044eedb41541d72b9475d7 P b7ab4784c7344b939bc36f639286f377 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:07.258638  6807 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:32976 (request call id 2736) took 2309 ms. Trace:
I20260709 13:20:07.247946  6802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17587d6730594da4a56fa13a353232a1" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:20:07.389132  6802 raft_consensus.cc:2376] T 17587d6730594da4a56fa13a353232a1 P b7ab4784c7344b939bc36f639286f377 [term 15 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in term 15. Re-sending same reply.
I20260709 13:20:07.244983 10650 raft_consensus.cc:515] T 24ee15416e3145beaa1b8183453729a3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:20:07.283877 10418 raft_consensus.cc:493] T 4d9def8b32fd443aa94ab1420b06837b P b7ab4784c7344b939bc36f639286f377 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:07.390297 10802 leader_election.cc:290] T 2c240553ce044eedb41541d72b9475d7 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:07.390882 10418 raft_consensus.cc:515] T 4d9def8b32fd443aa94ab1420b06837b P b7ab4784c7344b939bc36f639286f377 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
W20260709 13:20:07.233652  6800 rpcz_store.cc:269] 0709 13:20:05.220946 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:06.187163 (+966217us) service_pool.cc:224] Handling call
0709 13:20:07.232791 (+1045628us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:20:07.258309  6732 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 2.330s	user 0.036s	sys 0.040s
I20260709 13:20:07.393170 10418 leader_election.cc:290] T 4d9def8b32fd443aa94ab1420b06837b P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
W20260709 13:20:07.267990  6844 connection.cc:256] RPC call timeout handler was delayed by -1.7272199480000836s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21400000000000002s for a response
I20260709 13:20:07.245993 10938 raft_consensus.cc:515] T 7c37d41cd9164c15a6826ca62a851a69 P b7ab4784c7344b939bc36f639286f377 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:07.396224  6728 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50004 (request call id 1977) took 2727 ms. Trace:
I20260709 13:20:07.250524  6770 leader_election.cc:304] T 44bde925b2e541b69890d70715b85176 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
I20260709 13:20:07.244269 10922 leader_election.cc:290] T bb7fa124c3bf4ef9ab65a407cb008441 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:20:07.396652  6732 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50004 (request call id 1983) took 2687 ms. Trace:
I20260709 13:20:07.396499 10938 leader_election.cc:290] T 7c37d41cd9164c15a6826ca62a851a69 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:07.397261  6881 raft_consensus.cc:2468] T 9e326172347f45e99a0d482b5d8ef768 P cd75a17ab2604397adab03bb8b5fd75c [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 10.
I20260709 13:20:07.245879 10908 leader_election.cc:290] T 7c37d41cd9164c15a6826ca62a851a69 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
W20260709 13:20:07.397895  6844 connection.cc:256] RPC call timeout handler was delayed by -1.7182199480000691s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.215s for a response
I20260709 13:20:07.253839 10936 raft_consensus.cc:515] T 8c7f33e544204fbaac4078e3e83bbf4e P ccd8a4c3bfe3413cb2ae219b09aea832 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:07.397406  6732 rpcz_store.cc:276] 0709 13:20:04.709668 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:04.926559 (+216891us) service_pool.cc:224] Handling call
0709 13:20:04.927017 (+   458us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:04.927374 (+   357us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:20:04.927726 (+   352us) log.cc:844] Serialized 14 byte log entry
0709 13:20:07.394643 (+2466917us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:20:07.394720 (+    77us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:20:07.394828 (+   108us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:07.396460 (+  1632us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:07.396588 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":2191,"prepare.run_cpu_time_us":34,"prepare.run_wall_time_us":35,"raft.queue_time_us":761,"raft.run_cpu_time_us":97,"raft.run_wall_time_us":98,"thread_start_us":2466471,"threads_started":1,"wal-append.queue_time_us":396138,"wal-append.run_cpu_time_us":4080,"wal-append.run_wall_time_us":1039868}
I20260709 13:20:07.249571 10920 raft_consensus.cc:515] T 7c44c4849aa54f2b94d1f1bef9ed546f P ccd8a4c3bfe3413cb2ae219b09aea832 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:07.320641  6730 raft_consensus.cc:2468] T 4b8cacb381b746da8d0049b0a83b41dd P ccd8a4c3bfe3413cb2ae219b09aea832 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 11.
I20260709 13:20:07.252557 10860 leader_election.cc:290] T 4b8cacb381b746da8d0049b0a83b41dd P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:07.400962  6730 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49998 (request call id 1008) took 1233 ms. Trace:
I20260709 13:20:07.401368  6730 rpcz_store.cc:276] 0709 13:20:06.167362 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:06.807597 (+640235us) service_pool.cc:224] Handling call
0709 13:20:07.400902 (+593305us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:20:07.236558  6879 raft_consensus.cc:2468] T 90d42e216d9741e190bca19a781291fd P cd75a17ab2604397adab03bb8b5fd75c [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 10.
I20260709 13:20:07.401837 10920 leader_election.cc:290] T 7c44c4849aa54f2b94d1f1bef9ed546f P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
W20260709 13:20:07.381420  6698 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:07.402521 10487 raft_consensus.cc:515] T 4275cf08e63345f993bce8664eada830 P b7ab4784c7344b939bc36f639286f377 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
W20260709 13:20:07.403537  6724 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49998 (request call id 1010) took 1235 ms (client timeout 1595 ms). Trace:
W20260709 13:20:07.406839  6724 rpcz_store.cc:269] 0709 13:20:06.167964 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:06.798944 (+630980us) service_pool.cc:224] Handling call
0709 13:20:07.403470 (+604526us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:20:07.389951  6807 rpcz_store.cc:276] 0709 13:20:04.948796 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:04.949006 (+   210us) service_pool.cc:224] Handling call
0709 13:20:04.987552 (+ 38546us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:20:05.010269 (+ 22717us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:05.010297 (+    28us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:20:05.046422 (+ 36125us) log.cc:844] Serialized 52 byte log entry
0709 13:20:06.258365 (+1211943us) spinlock_profiling.cc:243] Waited 5.74 ms on lock 0x7b4400022b4c. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0c745db1 00007fcc0c7e3c85 00007fcc0c7e46a2 00007fcc0f5561db 00007fcc0f551aaf 00007fcc0f54586e 00007fcc0f544bb6 00007fcc0f5447d8 00007fcc0f54e221 00007fcc0f54e1d9 00007fcc0f54e169
0709 13:20:07.246096 (+987731us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:20:07.246138 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:07.246224 (+    86us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:07.258331 (+ 12107us) raft_consensus.cc:1685] finished
0709 13:20:07.258348 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:07.258556 (+   208us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":8199,"raft.run_cpu_time_us":192,"raft.run_wall_time_us":13963,"spinlock_wait_cycles":13190912,"thread_start_us":2174381,"threads_started":1,"wal-append.queue_time_us":282732}
I20260709 13:20:07.407747 10931 leader_election.cc:290] T bd6869f07b5a4885a0b99fbe60c3b175 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:07.392612  6876 raft_consensus.cc:2468] T d8292e16e5654be6bc408560cf256aaa P cd75a17ab2604397adab03bb8b5fd75c [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 14.
W20260709 13:20:07.246693  6729 rpcz_store.cc:269] 0709 13:20:05.014470 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:05.018951 (+  4481us) service_pool.cc:224] Handling call
0709 13:20:06.804498 (+1785547us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:20:07.394256  6828 debug-util.cc:398] Leaking SignalData structure 0x7b080009d940 after lost signal to thread 6756
I20260709 13:20:07.396545 10727 raft_consensus.cc:515] T 3411566abe2d4c9bb4b2adfdd05e6f17 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:07.411850 10727 leader_election.cc:290] T 3411566abe2d4c9bb4b2adfdd05e6f17 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:07.257546 10621 raft_consensus.cc:515] T e31b9971c15848dea59d4d4130141d9e P cd75a17ab2604397adab03bb8b5fd75c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:07.381831  6875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77e330a82df4b43a745d57a68f6f057" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:20:07.412875  6875 raft_consensus.cc:3060] T e77e330a82df4b43a745d57a68f6f057 P cd75a17ab2604397adab03bb8b5fd75c [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:07.255373 10692 leader_election.cc:290] T a1704639a875409b9959353527b3fd68 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 12 election: Requested vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:07.413789 10621 leader_election.cc:290] T e31b9971c15848dea59d4d4130141d9e P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:20:07.270835 10930 leader_election.cc:290] T 7887766dc6784fcaa42b35c05fea7a99 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
W20260709 13:20:07.258873  6697 connection.cc:256] RPC call timeout handler was delayed by -2.4366052400000626s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20120000000000002s for a response
I20260709 13:20:07.245797 10912 raft_consensus.cc:515] T b3f13b31a1f84f0d89d007eadd57924c P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:20:07.401930 10777 leader_election.cc:290] T 17587d6730594da4a56fa13a353232a1 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:20:07.419203 10912 leader_election.cc:290] T b3f13b31a1f84f0d89d007eadd57924c P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
W20260709 13:20:07.249087  6773 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:07.394450  6727 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50004 (request call id 1992) took 2369 ms (client timeout 2185 ms). Trace:
W20260709 13:20:07.420603  6727 rpcz_store.cc:269] 0709 13:20:05.024687 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:05.042321 (+ 17634us) service_pool.cc:224] Handling call
0709 13:20:07.394346 (+2352025us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:20:07.428593 10534 raft_consensus.cc:515] T f3f9c2e2bf644115957398fe4c9459db P b7ab4784c7344b939bc36f639286f377 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:07.430357  6729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe20b4b48823486ca3b9c648db6ce8aa" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
W20260709 13:20:07.275635  6804 rpcz_store.cc:269] 0709 13:20:05.216835 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:05.222191 (+  5356us) service_pool.cc:224] Handling call
0709 13:20:06.847693 (+1625502us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:20:07.405253 10561 raft_consensus.cc:515] T f58dc08b12a2494bb9a1372837970ca2 P b7ab4784c7344b939bc36f639286f377 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
W20260709 13:20:07.258070  7468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 384089us
I20260709 13:20:07.290401 10794 raft_consensus.cc:3060] T f5be3a11b23d4ea9b08300a2789821c7 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:20:07.398391  6844 connection.cc:256] RPC call timeout handler was delayed by -1.6615199479999774s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22130000000000002s for a response
W20260709 13:20:07.432297  6844 connection.cc:256] RPC call timeout handler was delayed by -1.5121199479999632s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2379s for a response
W20260709 13:20:07.432643  6844 connection.cc:256] RPC call timeout handler was delayed by -1.3564199479999388s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.25520000000000004s for a response
I20260709 13:20:07.433033 10561 leader_election.cc:290] T f58dc08b12a2494bb9a1372837970ca2 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:07.431126 10534 leader_election.cc:290] T f3f9c2e2bf644115957398fe4c9459db P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 11 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:07.396624  6728 rpcz_store.cc:276] 0709 13:20:04.668815 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:04.755370 (+ 86555us) service_pool.cc:224] Handling call
0709 13:20:04.755805 (+   435us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:04.776568 (+ 20763us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:04.776615 (+    47us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:20:04.852337 (+ 75722us) log.cc:844] Serialized 26 byte log entry
0709 13:20:05.379528 (+527191us) spinlock_profiling.cc:243] Waited 28.7 ms on lock 0x7b4400022b4c. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0c745db1 00007fcc0c7e3c85 00007fcc0c7e46a2 00007fcc0f5561db 00007fcc0f551aaf 00007fcc0f54586e 00007fcc0f544bb6 00007fcc0f5447d8 00007fcc0f54e221 00007fcc0f54e1d9 00007fcc0f54e169
0709 13:20:07.395754 (+2016226us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:20:07.395815 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:07.395880 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:07.395922 (+    42us) raft_consensus.cc:1685] finished
0709 13:20:07.395939 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:07.396151 (+   212us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":15207,"raft.run_cpu_time_us":161,"raft.run_wall_time_us":3555,"spinlock_wait_cycles":65918336,"thread_start_us":2542956,"threads_started":1,"wal-append.queue_time_us":463995}
W20260709 13:20:07.421330  6828 debug-util.cc:398] Leaking SignalData structure 0x7b08003636e0 after lost signal to thread 6831
W20260709 13:20:07.435817  6770 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 185560us
W20260709 13:20:07.436277  6828 debug-util.cc:398] Leaking SignalData structure 0x7b08002309a0 after lost signal to thread 6832
W20260709 13:20:07.437470  6828 debug-util.cc:398] Leaking SignalData structure 0x7b0800333ca0 after lost signal to thread 6905
I20260709 13:20:07.437708  6770 leader_election.cc:304] T e31b9971c15848dea59d4d4130141d9e P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
W20260709 13:20:07.438614  6828 debug-util.cc:398] Leaking SignalData structure 0x7b0800381c80 after lost signal to thread 7527
W20260709 13:20:07.438932  6828 debug-util.cc:398] Leaking SignalData structure 0x7b080029e480 after lost signal to thread 7528
I20260709 13:20:07.399963 10936 leader_election.cc:290] T 8c7f33e544204fbaac4078e3e83bbf4e P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:07.422102  6807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "404190ce4ce94cecbfcb6ea9d1dd8626" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:07.440735  6807 raft_consensus.cc:2468] T 404190ce4ce94cecbfcb6ea9d1dd8626 P b7ab4784c7344b939bc36f639286f377 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in term 12.
I20260709 13:20:07.298137 10832 raft_consensus.cc:493] T d33d5ee8ef6f415593d8df52063161ad P ccd8a4c3bfe3413cb2ae219b09aea832 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:07.424175  7495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3f13b31a1f84f0d89d007eadd57924c" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:20:07.442239  7495 raft_consensus.cc:2468] T b3f13b31a1f84f0d89d007eadd57924c P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 10.
I20260709 13:20:07.425697  7500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1528ab62b6fe4e3099d08f141afee116" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:20:07.443905 10160 raft_consensus.cc:493] T 7a734b5ab7834e05a8c422208acc58b1 P b7ab4784c7344b939bc36f639286f377 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:07.431173  6729 raft_consensus.cc:2468] T fe20b4b48823486ca3b9c648db6ce8aa P ccd8a4c3bfe3413cb2ae219b09aea832 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in term 9.
I20260709 13:20:07.426868  7502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe20b4b48823486ca3b9c648db6ce8aa" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:20:07.444510 10160 raft_consensus.cc:515] T 7a734b5ab7834e05a8c422208acc58b1 P b7ab4784c7344b939bc36f639286f377 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:07.445032  7502 raft_consensus.cc:2468] T fe20b4b48823486ca3b9c648db6ce8aa P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 9.
I20260709 13:20:07.428081  7498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3f13b31a1f84f0d89d007eadd57924c" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb"
I20260709 13:20:07.428004  7503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce4f062dcd314d43a63ca74067cb5ee3" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:20:07.288976  6627 catalog_manager.cc:5697] T 7c44c4849aa54f2b94d1f1bef9ed546f P ccd8a4c3bfe3413cb2ae219b09aea832 reported cstate change: term changed from 8 to 9, leader changed from cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67) to ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65). New cstate: current_term: 9 leader_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:07.446808 10160 leader_election.cc:290] T 7a734b5ab7834e05a8c422208acc58b1 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:07.442067 10418 raft_consensus.cc:2804] T e31b9971c15848dea59d4d4130141d9e P b7ab4784c7344b939bc36f639286f377 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:20:07.447497 10418 raft_consensus.cc:493] T e31b9971c15848dea59d4d4130141d9e P b7ab4784c7344b939bc36f639286f377 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:07.447314  6627 catalog_manager.cc:5697] T 07a92dd554674067a83a9cb68c4773f2 P ccd8a4c3bfe3413cb2ae219b09aea832 reported cstate change: term changed from 3 to 8. New cstate: current_term: 8 leader_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:07.433872  6844 leader_election.cc:400] T 853ac0a8cbd64ce99457f170216d4d0f P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 7 pre-election: Vote denied by peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391) with higher term. Message: Invalid argument: T 853ac0a8cbd64ce99457f170216d4d0f P ccd8a4c3bfe3413cb2ae219b09aea832 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c for earlier term 7. Current term is 8.
I20260709 13:20:07.272938 10580 leader_election.cc:290] T dbdf895bba214ff68685a24fd17dfb5d P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:07.404570 10487 leader_election.cc:290] T 4275cf08e63345f993bce8664eada830 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:07.264356 10921 leader_election.cc:290] T 95a75bfe094d4bdc963aba3f08dfcd25 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:20:07.449545  6879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4db81d9d329422bb3b4160ca4ac2d1d" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:07.426139  6618 maintenance_manager.cc:643] P b3ae52d33b9a4273a42e5e2cf3b5d6b5: UndoDeltaBlockGCOp(00000000000000000000000000000000) complete. Timing: real 0.002s	user 0.001s	sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":444,"lbm_reads_lt_1ms":4}
W20260709 13:20:07.450150  6697 connection.cc:256] RPC call timeout handler was delayed by -1.3098164520001774s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2469s for a response
I20260709 13:20:07.438876 10938 raft_consensus.cc:2804] T 44bde925b2e541b69890d70715b85176 P b7ab4784c7344b939bc36f639286f377 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:20:07.438654  6770 leader_election.cc:304] T b56bf91d90824c959e21e0cee5ba1816 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
I20260709 13:20:07.451027 10938 raft_consensus.cc:493] T 44bde925b2e541b69890d70715b85176 P b7ab4784c7344b939bc36f639286f377 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:07.451536 10938 raft_consensus.cc:3060] T 44bde925b2e541b69890d70715b85176 P b7ab4784c7344b939bc36f639286f377 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:20:07.451833 10914 leader_election.cc:290] T 7ba5dac66ab5497e9e336f2a3c28cda5 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:20:07.452312  7503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ba5dac66ab5497e9e336f2a3c28cda5" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:20:07.453055  7503 raft_consensus.cc:2393] T 7ba5dac66ab5497e9e336f2a3c28cda5 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c in current term 12: Already voted for candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in this term.
I20260709 13:20:07.453320  6878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f03d0dbf16864ca4bc1bb5e4c0334c0f" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:07.453902  6878 raft_consensus.cc:2468] T f03d0dbf16864ca4bc1bb5e4c0334c0f P cd75a17ab2604397adab03bb8b5fd75c [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 8.
I20260709 13:20:07.454208 10487 raft_consensus.cc:2804] T b56bf91d90824c959e21e0cee5ba1816 P b7ab4784c7344b939bc36f639286f377 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:20:07.454643  6878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe20b4b48823486ca3b9c648db6ce8aa" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:07.449481  6844 leader_election.cc:304] T 7887766dc6784fcaa42b35c05fea7a99 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:20:07.454843 10487 raft_consensus.cc:697] T b56bf91d90824c959e21e0cee5ba1816 P b7ab4784c7344b939bc36f639286f377 [term 11 LEADER]: Becoming Leader. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
I20260709 13:20:07.456523  6844 leader_election.cc:304] T b56bf91d90824c959e21e0cee5ba1816 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:20:07.456303 10487 consensus_queue.cc:237] T b56bf91d90824c959e21e0cee5ba1816 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:07.458039  6844 leader_election.cc:304] T 8c7f33e544204fbaac4078e3e83bbf4e P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:20:07.458948 10621 raft_consensus.cc:2749] T 7887766dc6784fcaa42b35c05fea7a99 P cd75a17ab2604397adab03bb8b5fd75c [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:20:07.459436  6876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1704639a875409b9959353527b3fd68" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:07.459650 10621 raft_consensus.cc:2749] T b56bf91d90824c959e21e0cee5ba1816 P cd75a17ab2604397adab03bb8b5fd75c [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:20:07.460085  6876 raft_consensus.cc:2468] T a1704639a875409b9959353527b3fd68 P cd75a17ab2604397adab03bb8b5fd75c [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 11.
I20260709 13:20:07.460352 10621 raft_consensus.cc:2749] T 8c7f33e544204fbaac4078e3e83bbf4e P cd75a17ab2604397adab03bb8b5fd75c [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:20:07.460587  6697 leader_election.cc:304] T 427c124d773f483294511e80fe340075 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, b7ab4784c7344b939bc36f639286f377
I20260709 13:20:07.460965  6876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4275cf08e63345f993bce8664eada830" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:20:07.461856  6844 leader_election.cc:304] T 7a734b5ab7834e05a8c422208acc58b1 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:20:07.450269  6879 raft_consensus.cc:2468] T c4db81d9d329422bb3b4160ca4ac2d1d P cd75a17ab2604397adab03bb8b5fd75c [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 9.
I20260709 13:20:07.462263  6876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a734b5ab7834e05a8c422208acc58b1" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 11 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:07.462702 10914 raft_consensus.cc:3060] T 7a734b5ab7834e05a8c422208acc58b1 P cd75a17ab2604397adab03bb8b5fd75c [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:20:07.358857  7496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24ee15416e3145beaa1b8183453729a3" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:20:07.463801  6879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f9c2e2bf644115957398fe4c9459db" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:07.464679  6728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b3759de40694069b13c0f8bd40e5709" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:07.465022 10650 leader_election.cc:290] T 24ee15416e3145beaa1b8183453729a3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:07.447925 10418 raft_consensus.cc:3060] T e31b9971c15848dea59d4d4130141d9e P b7ab4784c7344b939bc36f639286f377 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:20:07.466727  6878 raft_consensus.cc:2468] T fe20b4b48823486ca3b9c648db6ce8aa P cd75a17ab2604397adab03bb8b5fd75c [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 8.
I20260709 13:20:07.467312 10580 raft_consensus.cc:2749] T 427c124d773f483294511e80fe340075 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:20:07.468369  6878 raft_consensus.cc:1275] T 4d9def8b32fd443aa94ab1420b06837b P cd75a17ab2604397adab03bb8b5fd75c [term 11 FOLLOWER]: Refusing update from remote peer ccd8a4c3bfe3413cb2ae219b09aea832: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 11 index: 5. (term mismatch)
I20260709 13:20:07.468892  6878 pending_rounds.cc:85] T 4d9def8b32fd443aa94ab1420b06837b P cd75a17ab2604397adab03bb8b5fd75c: Aborting all ops after (but not including) 4
I20260709 13:20:07.444425 10832 raft_consensus.cc:515] T d33d5ee8ef6f415593d8df52063161ad P ccd8a4c3bfe3413cb2ae219b09aea832 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:07.469352  6878 pending_rounds.cc:107] T 4d9def8b32fd443aa94ab1420b06837b P cd75a17ab2604397adab03bb8b5fd75c: Aborting uncommitted NO_OP operation due to leader change: 8.5
I20260709 13:20:07.469857  6878 raft_consensus.cc:2889] T 4d9def8b32fd443aa94ab1420b06837b P cd75a17ab2604397adab03bb8b5fd75c [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:20:07.471527 10832 leader_election.cc:290] T d33d5ee8ef6f415593d8df52063161ad P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
W20260709 13:20:07.431800  7468 connection.cc:256] RPC call timeout handler was delayed by -1.5246101840000392s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15100000000000002s for a response
W20260709 13:20:07.473672  7468 connection.cc:256] RPC call timeout handler was delayed by -1.3203738159998011s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1626s for a response
I20260709 13:20:07.474066  6724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22ccee1b570c4ad3a57bd7aec085b1b4" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:20:07.474926  6724 raft_consensus.cc:3060] T 22ccee1b570c4ad3a57bd7aec085b1b4 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:20:07.475441 10785 raft_consensus.cc:697] T d8292e16e5654be6bc408560cf256aaa P b7ab4784c7344b939bc36f639286f377 [term 14 LEADER]: Becoming Leader. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
W20260709 13:20:07.473134  7467 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:07.254225  6629 rpcz_store.cc:276] 0709 13:19:56.752301 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:56.752586 (+   285us) service_pool.cc:224] Handling call
0709 13:20:06.739167 (+9986581us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:20:03.125493 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:20:03.311536 (+186043us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:20:03.319554 (+  8018us) write_op.cc:435] Acquired schema lock
0709 13:20:03.319586 (+    32us) tablet.cc:662] Decoding operations
0709 13:20:03.399995 (+ 80409us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:20:03.400138 (+   143us) write_op.cc:641] Partition lock acquired for write op
0709 13:20:03.400185 (+    47us) tablet.cc:685] Acquiring locks for 4 operations
0709 13:20:03.400654 (+   469us) tablet.cc:701] Row locks acquired
0709 13:20:03.400680 (+    26us) write_op.cc:260] PREPARE: finished
0709 13:20:03.400866 (+   186us) write_op.cc:270] Start()
0709 13:20:03.400995 (+   129us) write_op.cc:276] Timestamp: P: 1783603203400809 usec, L: 0
0709 13:20:03.401023 (+    28us) op_driver.cc:348] REPLICATION: starting
0709 13:20:03.401895 (+   872us) log.cc:844] Serialized 1673 byte log entry
0709 13:20:04.617174 (+1215279us) op_driver.cc:464] REPLICATION: finished
0709 13:20:05.095859 (+478685us) write_op.cc:301] APPLY: starting
0709 13:20:05.122306 (+ 26447us) tablet.cc:1367] starting BulkCheckPresence
0709 13:20:05.123268 (+   962us) tablet.cc:1370] finished BulkCheckPresence
0709 13:20:05.150723 (+ 27455us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:20:05.151610 (+   887us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:20:05.152159 (+   549us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=8
0709 13:20:05.152272 (+   113us) write_op.cc:312] APPLY: finished
0709 13:20:05.232290 (+ 80018us) log.cc:844] Serialized 40 byte log entry
0709 13:20:05.334311 (+102021us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:20:05.343840 (+  9529us) write_op.cc:454] Released schema lock
0709 13:20:05.347696 (+  3856us) write_op.cc:341] FINISH: Updating metrics
0709 13:20:05.348377 (+   681us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:20:05.348409 (+    32us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":3340639,"reported_tablets":8,"child_traces":[["op",{"apply.queue_time_us":454606,"apply.run_cpu_time_us":9224,"apply.run_wall_time_us":264993,"num_ops":4,"prepare.queue_time_us":505950,"prepare.run_cpu_time_us":62675,"prepare.run_wall_time_us":502271,"raft.queue_time_us":407229,"raft.run_cpu_time_us":9583,"raft.run_wall_time_us":158301,"replication_time_us":1215688,"thread_start_us":754649,"threads_started":5,"wal-append.queue_time_us":687189,"wal-append.run_cpu_time_us":19351,"wal-append.run_wall_time_us":2253867}]]}
W20260709 13:20:07.476478  7468 leader_election.cc:336] T 3fa34c08b205435dba97346991aa1f92 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 12 election: RPC error from VoteRequest() call to peer cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931): Timed out: RequestConsensusVote RPC to 127.5.126.67:42931 timed out after 1.510s (SENT)
I20260709 13:20:07.259351  6695 leader_election.cc:304] T 4275cf08e63345f993bce8664eada830 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
W20260709 13:20:07.485440  6695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 226292us
W20260709 13:20:07.485684  7468 leader_election.cc:336] T 427c124d773f483294511e80fe340075 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931): Timed out: RequestConsensusVote RPC to 127.5.126.67:42931 timed out after 1.626s (SENT)
I20260709 13:20:07.465238  6879 raft_consensus.cc:2410] T f3f9c2e2bf644115957398fe4c9459db P cd75a17ab2604397adab03bb8b5fd75c [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ccd8a4c3bfe3413cb2ae219b09aea832 for term 11 because replica has last-logged OpId of term: 9 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 6.
W20260709 13:20:07.487040  7468 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.5.126.67:42931 timed out after 1.938s (SENT) [suppressed 5 similar messages]
I20260709 13:20:07.486970 10938 raft_consensus.cc:515] T 44bde925b2e541b69890d70715b85176 P b7ab4784c7344b939bc36f639286f377 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:07.468971  6844 leader_election.cc:304] T f3f9c2e2bf644115957398fe4c9459db P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:20:07.445583  6873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a92dd554674067a83a9cb68c4773f2" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:07.481455  6728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b8cacb381b746da8d0049b0a83b41dd" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:07.482434  6730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30e88460611e47b2ba16a46a30b5f416" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:07.488404  6627 catalog_manager.cc:5697] T c4db81d9d329422bb3b4160ca4ac2d1d P ccd8a4c3bfe3413cb2ae219b09aea832 reported cstate change: term changed from 1 to 8. New cstate: current_term: 8 leader_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:07.489383  6844 leader_election.cc:304] T 1bf4668eeb70467fb3dc5a0289233b3c P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:20:07.490192  6728 raft_consensus.cc:2468] T 4b8cacb381b746da8d0049b0a83b41dd P ccd8a4c3bfe3413cb2ae219b09aea832 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in term 11.
I20260709 13:20:07.464454  7496 raft_consensus.cc:2468] T 24ee15416e3145beaa1b8183453729a3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 11.
I20260709 13:20:07.476480 10914 raft_consensus.cc:2749] T 7a734b5ab7834e05a8c422208acc58b1 P cd75a17ab2604397adab03bb8b5fd75c [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:20:07.490489 10621 raft_consensus.cc:2749] T 1bf4668eeb70467fb3dc5a0289233b3c P cd75a17ab2604397adab03bb8b5fd75c [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:20:07.488694 10921 raft_consensus.cc:3060] T f3f9c2e2bf644115957398fe4c9459db P cd75a17ab2604397adab03bb8b5fd75c [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:20:07.492828  6873 raft_consensus.cc:2468] T 07a92dd554674067a83a9cb68c4773f2 P cd75a17ab2604397adab03bb8b5fd75c [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 10.
I20260709 13:20:07.498616  6876 raft_consensus.cc:2468] T 7a734b5ab7834e05a8c422208acc58b1 P cd75a17ab2604397adab03bb8b5fd75c [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 10.
I20260709 13:20:07.480369 10785 consensus_queue.cc:237] T d8292e16e5654be6bc408560cf256aaa P b7ab4784c7344b939bc36f639286f377 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:07.500083  6730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24ee15416e3145beaa1b8183453729a3" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 12 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:07.501377  6730 raft_consensus.cc:2410] T 24ee15416e3145beaa1b8183453729a3 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ba59cc884714e8aa5f3f0ecaed84cbb for term 12 because replica has last-logged OpId of term: 10 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 13:20:07.501901 10913 leader_election.cc:290] T 427c124d773f483294511e80fe340075 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:20:07.423339  6801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f00a2e87e56452083b759f60d461ee3" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 12 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:07.509318  6801 raft_consensus.cc:2468] T 4f00a2e87e56452083b759f60d461ee3 P b7ab4784c7344b939bc36f639286f377 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in term 11.
I20260709 13:20:07.253641  6880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab432e62819d499eaaf3dd55481dd930" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 13 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:07.510900  6880 raft_consensus.cc:2468] T ab432e62819d499eaaf3dd55481dd930 P cd75a17ab2604397adab03bb8b5fd75c [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 12.
I20260709 13:20:07.516353 10832 consensus_queue.cc:1048] T 7c37d41cd9164c15a6826ca62a851a69 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:20:07.434875  6875 raft_consensus.cc:2468] T e77e330a82df4b43a745d57a68f6f057 P cd75a17ab2604397adab03bb8b5fd75c [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 14.
I20260709 13:20:07.518224  6730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a485a995abc4807b6e511e45419f737" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:07.518745  6844 leader_election.cc:304] T 22ccee1b570c4ad3a57bd7aec085b1b4 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:20:07.520424  6844 leader_election.cc:304] T 30e88460611e47b2ba16a46a30b5f416 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:20:07.513434 10936 raft_consensus.cc:2804] T 4275cf08e63345f993bce8664eada830 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:20:07.521353 10936 raft_consensus.cc:697] T 4275cf08e63345f993bce8664eada830 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 12 LEADER]: Becoming Leader. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
I20260709 13:20:07.522598  6728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1704639a875409b9959353527b3fd68" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:20:07.522418 10936 consensus_queue.cc:237] T 4275cf08e63345f993bce8664eada830 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 5, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:07.513068  7496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "427c124d773f483294511e80fe340075" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:20:07.523381  6728 raft_consensus.cc:2393] T a1704639a875409b9959353527b3fd68 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate b7ab4784c7344b939bc36f639286f377 in current term 12: Already voted for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in this term.
I20260709 13:20:07.523783  7496 raft_consensus.cc:2468] T 427c124d773f483294511e80fe340075 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 9.
I20260709 13:20:07.522854 10913 raft_consensus.cc:3060] T 22ccee1b570c4ad3a57bd7aec085b1b4 P cd75a17ab2604397adab03bb8b5fd75c [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:20:07.520507  6730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d33d5ee8ef6f415593d8df52063161ad" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:20:07.524832  6730 raft_consensus.cc:3060] T d33d5ee8ef6f415593d8df52063161ad P ccd8a4c3bfe3413cb2ae219b09aea832 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:20:07.511677  6772 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 126189us
I20260709 13:20:07.514521  6695 leader_election.cc:304] T d8292e16e5654be6bc408560cf256aaa P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
I20260709 13:20:07.529058  6697 leader_election.cc:304] T 404190ce4ce94cecbfcb6ea9d1dd8626 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: b7ab4784c7344b939bc36f639286f377
I20260709 13:20:07.530089  7498 raft_consensus.cc:2468] T b3f13b31a1f84f0d89d007eadd57924c P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 10.
I20260709 13:20:07.511832  6801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ba5dac66ab5497e9e336f2a3c28cda5" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:20:07.532243  6801 raft_consensus.cc:3060] T 7ba5dac66ab5497e9e336f2a3c28cda5 P b7ab4784c7344b939bc36f639286f377 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:20:07.491031  6627 catalog_manager.cc:5697] T e31b9971c15848dea59d4d4130141d9e P ccd8a4c3bfe3413cb2ae219b09aea832 reported cstate change: term changed from 4 to 5, leader changed from b7ab4784c7344b939bc36f639286f377 (127.5.126.66) to ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65). New cstate: current_term: 5 leader_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } health_report { overall_health: HEALTHY } } }
I20260709 13:20:07.536991  6800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3f13b31a1f84f0d89d007eadd57924c" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:07.537788  6800 raft_consensus.cc:2468] T b3f13b31a1f84f0d89d007eadd57924c P b7ab4784c7344b939bc36f639286f377 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in term 9.
I20260709 13:20:07.544355  6730 raft_consensus.cc:2468] T d33d5ee8ef6f415593d8df52063161ad P ccd8a4c3bfe3413cb2ae219b09aea832 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 12.
I20260709 13:20:07.542107  6627 catalog_manager.cc:5697] T a3022224cc81473690653a83d4e99470 P ccd8a4c3bfe3413cb2ae219b09aea832 reported cstate change: term changed from 6 to 8, leader changed from b7ab4784c7344b939bc36f639286f377 (127.5.126.66) to ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65). New cstate: current_term: 8 leader_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:07.549242  6725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "711ef6523deb4cbe8ef2ba61e1c21c98" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:20:07.552771  7466 leader_election.cc:304] T 404190ce4ce94cecbfcb6ea9d1dd8626 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, b7ab4784c7344b939bc36f639286f377; no voters: 
I20260709 13:20:07.553784  7466 leader_election.cc:304] T 4f00a2e87e56452083b759f60d461ee3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, b7ab4784c7344b939bc36f639286f377; no voters: 
I20260709 13:20:07.554492 10865 raft_consensus.cc:2804] T 404190ce4ce94cecbfcb6ea9d1dd8626 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:20:07.554600  7466 leader_election.cc:304] T b3f13b31a1f84f0d89d007eadd57924c P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, b7ab4784c7344b939bc36f639286f377; no voters: 
I20260709 13:20:07.554939 10865 raft_consensus.cc:493] T 404190ce4ce94cecbfcb6ea9d1dd8626 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:07.555361 10865 raft_consensus.cc:3060] T 404190ce4ce94cecbfcb6ea9d1dd8626 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:07.556730  6772 leader_election.cc:304] T f5be3a11b23d4ea9b08300a2789821c7 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:20:07.558655  6728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3f13b31a1f84f0d89d007eadd57924c" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:07.562551  6728 raft_consensus.cc:2468] T b3f13b31a1f84f0d89d007eadd57924c P ccd8a4c3bfe3413cb2ae219b09aea832 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in term 10.
W20260709 13:20:07.565918  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 45570.2us
I20260709 13:20:07.564996  6727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3022224cc81473690653a83d4e99470" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:07.564486 10844 raft_consensus.cc:2804] T 4f00a2e87e56452083b759f60d461ee3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:20:07.573261 10844 raft_consensus.cc:493] T 4f00a2e87e56452083b759f60d461ee3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:07.573711 10844 raft_consensus.cc:3060] T 4f00a2e87e56452083b759f60d461ee3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:20:07.568140  7466 leader_election.cc:304] T 4b8cacb381b746da8d0049b0a83b41dd P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
I20260709 13:20:07.583959 10832 consensus_queue.cc:1048] T f58dc08b12a2494bb9a1372837970ca2 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:20:07.584635 10939 raft_consensus.cc:493] T 20f6842e26174571996b8dea4151d4be P b7ab4784c7344b939bc36f639286f377 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:07.585362 10939 raft_consensus.cc:515] T 20f6842e26174571996b8dea4151d4be P b7ab4784c7344b939bc36f639286f377 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:07.587705 10939 leader_election.cc:290] T 20f6842e26174571996b8dea4151d4be P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:07.548501 10727 raft_consensus.cc:2804] T 404190ce4ce94cecbfcb6ea9d1dd8626 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:20:07.589201  7466 leader_election.cc:304] T fe20b4b48823486ca3b9c648db6ce8aa P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
I20260709 13:20:07.548741 10580 raft_consensus.cc:2804] T d8292e16e5654be6bc408560cf256aaa P ccd8a4c3bfe3413cb2ae219b09aea832 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:20:07.548396 10914 raft_consensus.cc:2749] T 30e88460611e47b2ba16a46a30b5f416 P cd75a17ab2604397adab03bb8b5fd75c [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:20:07.564689 10860 raft_consensus.cc:2804] T b3f13b31a1f84f0d89d007eadd57924c P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:20:07.608640  6729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c240553ce044eedb41541d72b9475d7" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:07.588781 10802 raft_consensus.cc:2749] T f5be3a11b23d4ea9b08300a2789821c7 P b7ab4784c7344b939bc36f639286f377 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:20:07.625749  6902 debug-util.cc:398] Leaking SignalData structure 0x7b080033eba0 after lost signal to thread 5628
I20260709 13:20:07.605108 10727 raft_consensus.cc:493] T 404190ce4ce94cecbfcb6ea9d1dd8626 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 7ba59cc884714e8aa5f3f0ecaed84cbb)
I20260709 13:20:07.626430 10912 raft_consensus.cc:2804] T fe20b4b48823486ca3b9c648db6ce8aa P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:20:07.626971 10912 raft_consensus.cc:493] T fe20b4b48823486ca3b9c648db6ce8aa P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:20:07.627152  6902 debug-util.cc:398] Leaking SignalData structure 0x7b0800384420 after lost signal to thread 6664
I20260709 13:20:07.627498 10912 raft_consensus.cc:3060] T fe20b4b48823486ca3b9c648db6ce8aa P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:20:07.628510 10860 raft_consensus.cc:493] T b3f13b31a1f84f0d89d007eadd57924c P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:07.629005 10860 raft_consensus.cc:3060] T b3f13b31a1f84f0d89d007eadd57924c P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:20:07.627664  6902 debug-util.cc:398] Leaking SignalData structure 0x7b08002df9c0 after lost signal to thread 6678
I20260709 13:20:07.632165  6844 leader_election.cc:304] T f03d0dbf16864ca4bc1bb5e4c0334c0f P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
W20260709 13:20:07.633023  6902 debug-util.cc:398] Leaking SignalData structure 0x7b08003d58c0 after lost signal to thread 6756
I20260709 13:20:07.626556 10727 raft_consensus.cc:3060] T 404190ce4ce94cecbfcb6ea9d1dd8626 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:20:07.642202  6727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c37d41cd9164c15a6826ca62a851a69" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:07.588274 10915 raft_consensus.cc:2804] T 4b8cacb381b746da8d0049b0a83b41dd P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 13:20:07.637434  6772 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 91103us
I20260709 13:20:07.639153  6724 raft_consensus.cc:2468] T 22ccee1b570c4ad3a57bd7aec085b1b4 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 10.
W20260709 13:20:07.655520  6773 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:07.656876  6801 raft_consensus.cc:2468] T 7ba5dac66ab5497e9e336f2a3c28cda5 P b7ab4784c7344b939bc36f639286f377 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in term 12.
I20260709 13:20:07.593236  6627 catalog_manager.cc:5697] T 1bf4668eeb70467fb3dc5a0289233b3c P ccd8a4c3bfe3413cb2ae219b09aea832 reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:07.641621  6723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f9c2e2bf644115957398fe4c9459db" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
W20260709 13:20:07.634430  6902 debug-util.cc:398] Leaking SignalData structure 0x7b0800082040 after lost signal to thread 6831
W20260709 13:20:07.659511  6902 debug-util.cc:398] Leaking SignalData structure 0x7b08002e70a0 after lost signal to thread 6832
W20260709 13:20:07.661002  6902 debug-util.cc:398] Leaking SignalData structure 0x7b080024d420 after lost signal to thread 6905
W20260709 13:20:07.661711  6902 debug-util.cc:398] Leaking SignalData structure 0x7b08003e5900 after lost signal to thread 7468
I20260709 13:20:07.659631  6723 raft_consensus.cc:3060] T f3f9c2e2bf644115957398fe4c9459db P ccd8a4c3bfe3413cb2ae219b09aea832 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:20:07.663321  6902 debug-util.cc:398] Leaking SignalData structure 0x7b080013ffc0 after lost signal to thread 7527
I20260709 13:20:07.607635  6726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d9def8b32fd443aa94ab1420b06837b" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 12 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
W20260709 13:20:07.663741  6902 debug-util.cc:398] Leaking SignalData structure 0x7b0800353540 after lost signal to thread 7528
I20260709 13:20:07.604820 10580 raft_consensus.cc:493] T d8292e16e5654be6bc408560cf256aaa P ccd8a4c3bfe3413cb2ae219b09aea832 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:07.665503  6729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4275cf08e63345f993bce8664eada830" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 13 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
W20260709 13:20:07.666427  6902 debug-util.cc:398] Leaking SignalData structure 0x7b080004f660 after lost signal to thread 10249
W20260709 13:20:07.666806  6902 debug-util.cc:398] Leaking SignalData structure 0x7b08002ef980 after lost signal to thread 10418
W20260709 13:20:07.667163  6902 debug-util.cc:398] Leaking SignalData structure 0x7b08003adc60 after lost signal to thread 10487
W20260709 13:20:07.668480  6902 debug-util.cc:398] Leaking SignalData structure 0x7b080015cdc0 after lost signal to thread 10561
W20260709 13:20:07.669056  6902 debug-util.cc:398] Leaking SignalData structure 0x7b0800368420 after lost signal to thread 10621
W20260709 13:20:07.669340  6902 debug-util.cc:398] Leaking SignalData structure 0x7b08003080c0 after lost signal to thread 10650
I20260709 13:20:07.667724  6627 catalog_manager.cc:5697] T e77e330a82df4b43a745d57a68f6f057 P ccd8a4c3bfe3413cb2ae219b09aea832 reported cstate change: term changed from 6 to 9, leader changed from ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65) to b7ab4784c7344b939bc36f639286f377 (127.5.126.66). New cstate: current_term: 9 leader_uuid: "b7ab4784c7344b939bc36f639286f377" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } }
W20260709 13:20:07.671639  6902 debug-util.cc:398] Leaking SignalData structure 0x7b0800396dc0 after lost signal to thread 10692
W20260709 13:20:07.672248  6902 debug-util.cc:398] Leaking SignalData structure 0x7b080017a2e0 after lost signal to thread 10695
W20260709 13:20:07.673147  7466 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 84018.4us
W20260709 13:20:07.673729  6697 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.68:45071, user_credentials={real_user=slave}} blocked reactor thread for 209786us
W20260709 13:20:07.674713  6902 debug-util.cc:398] Leaking SignalData structure 0x7b08003768c0 after lost signal to thread 10700
W20260709 13:20:07.675091  6902 debug-util.cc:398] Leaking SignalData structure 0x7b08003a5320 after lost signal to thread 10708
W20260709 13:20:07.675354  6902 debug-util.cc:398] Leaking SignalData structure 0x7b08003c13a0 after lost signal to thread 10727
W20260709 13:20:07.676297  6902 debug-util.cc:398] Leaking SignalData structure 0x7b080037e6c0 after lost signal to thread 10738
I20260709 13:20:07.676683  6726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f58dc08b12a2494bb9a1372837970ca2" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:07.648752 10915 raft_consensus.cc:493] T 4b8cacb381b746da8d0049b0a83b41dd P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:07.665162 10580 raft_consensus.cc:3060] T d8292e16e5654be6bc408560cf256aaa P ccd8a4c3bfe3413cb2ae219b09aea832 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:07.669852 10621 raft_consensus.cc:3060] T f03d0dbf16864ca4bc1bb5e4c0334c0f P cd75a17ab2604397adab03bb8b5fd75c [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:20:07.681593  6807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a92dd554674067a83a9cb68c4773f2" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:07.680402  7466 leader_election.cc:304] T 7ba5dac66ab5497e9e336f2a3c28cda5 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, b7ab4784c7344b939bc36f639286f377; no voters: 
I20260709 13:20:07.682215  6772 leader_election.cc:304] T bb7fa124c3bf4ef9ab65a407cb008441 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
W20260709 13:20:07.679606  6902 debug-util.cc:398] Leaking SignalData structure 0x7b08003328c0 after lost signal to thread 10752
W20260709 13:20:07.686599  6902 debug-util.cc:398] Leaking SignalData structure 0x7b0800365da0 after lost signal to thread 10770
W20260709 13:20:07.687078  6902 debug-util.cc:398] Leaking SignalData structure 0x7b08002782a0 after lost signal to thread 10777
I20260709 13:20:07.689033  6806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be1a92657f494cac8dd227d152f50151" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:07.690428  6806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1704639a875409b9959353527b3fd68" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:20:07.691166  6806 raft_consensus.cc:2393] T a1704639a875409b9959353527b3fd68 P b7ab4784c7344b939bc36f639286f377 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate ccd8a4c3bfe3413cb2ae219b09aea832 in current term 12: Already voted for candidate b7ab4784c7344b939bc36f639286f377 in this term.
I20260709 13:20:07.692059  6805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f03d0dbf16864ca4bc1bb5e4c0334c0f" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:20:07.692616  6805 raft_consensus.cc:3060] T f03d0dbf16864ca4bc1bb5e4c0334c0f P b7ab4784c7344b939bc36f639286f377 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:20:07.692708 10938 leader_election.cc:290] T 44bde925b2e541b69890d70715b85176 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 12 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:07.676134 10920 raft_consensus.cc:493] T 1bf4668eeb70467fb3dc5a0289233b3c P ccd8a4c3bfe3413cb2ae219b09aea832 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:07.694427 10920 raft_consensus.cc:515] T 1bf4668eeb70467fb3dc5a0289233b3c P ccd8a4c3bfe3413cb2ae219b09aea832 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:07.695688  6724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20f6842e26174571996b8dea4151d4be" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 13 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:07.675297 10758 raft_consensus.cc:493] T 853ac0a8cbd64ce99457f170216d4d0f P ccd8a4c3bfe3413cb2ae219b09aea832 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:07.696542 10920 leader_election.cc:290] T 1bf4668eeb70467fb3dc5a0289233b3c P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:07.696413 10758 raft_consensus.cc:515] T 853ac0a8cbd64ce99457f170216d4d0f P ccd8a4c3bfe3413cb2ae219b09aea832 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:07.695458 10418 raft_consensus.cc:515] T e31b9971c15848dea59d4d4130141d9e P b7ab4784c7344b939bc36f639286f377 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:07.698217  6803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a734b5ab7834e05a8c422208acc58b1" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 11 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:20:07.698913  6803 raft_consensus.cc:3060] T 7a734b5ab7834e05a8c422208acc58b1 P b7ab4784c7344b939bc36f639286f377 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:20:07.699680 10418 leader_election.cc:290] T e31b9971c15848dea59d4d4130141d9e P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 9 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:07.696596  6724 raft_consensus.cc:2410] T 20f6842e26174571996b8dea4151d4be P ccd8a4c3bfe3413cb2ae219b09aea832 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7ab4784c7344b939bc36f639286f377 for term 13 because replica has last-logged OpId of term: 11 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 5.
I20260709 13:20:07.705459 10961 raft_consensus.cc:2804] T 7ba5dac66ab5497e9e336f2a3c28cda5 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:20:07.696882  6770 leader_election.cc:304] T d33d5ee8ef6f415593d8df52063161ad P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
I20260709 13:20:07.707901  6799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce4f062dcd314d43a63ca74067cb5ee3" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:07.687260  6729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a734b5ab7834e05a8c422208acc58b1" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 11 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:07.706775  6801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f9c2e2bf644115957398fe4c9459db" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:07.710274  6801 raft_consensus.cc:2393] T f3f9c2e2bf644115957398fe4c9459db P b7ab4784c7344b939bc36f639286f377 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ccd8a4c3bfe3413cb2ae219b09aea832 in current term 11: Already voted for candidate b7ab4784c7344b939bc36f639286f377 in this term.
I20260709 13:20:07.710147  6724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44bde925b2e541b69890d70715b85176" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:20:07.711105  6724 raft_consensus.cc:3060] T 44bde925b2e541b69890d70715b85176 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:20:07.718405  6802 raft_consensus.cc:1275] T a3022224cc81473690653a83d4e99470 P b7ab4784c7344b939bc36f639286f377 [term 12 FOLLOWER]: Refusing update from remote peer ccd8a4c3bfe3413cb2ae219b09aea832: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 12 index: 6. (term mismatch)
I20260709 13:20:07.718351  6723 raft_consensus.cc:2468] T f3f9c2e2bf644115957398fe4c9459db P ccd8a4c3bfe3413cb2ae219b09aea832 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 11.
W20260709 13:20:07.719583  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 119315us
W20260709 13:20:07.687377  6902 debug-util.cc:398] Leaking SignalData structure 0x7b08002af000 after lost signal to thread 10785
W20260709 13:20:07.720541  6902 debug-util.cc:398] Leaking SignalData structure 0x7b080005e560 after lost signal to thread 10802
W20260709 13:20:07.720858  6902 debug-util.cc:398] Leaking SignalData structure 0x7b0800379cc0 after lost signal to thread 10813
W20260709 13:20:07.721130  6902 debug-util.cc:398] Leaking SignalData structure 0x7b08002b7b00 after lost signal to thread 10818
W20260709 13:20:07.721442  6902 debug-util.cc:398] Leaking SignalData structure 0x7b080005e5e0 after lost signal to thread 10827
I20260709 13:20:07.728677  6729 raft_consensus.cc:2393] T 7a734b5ab7834e05a8c422208acc58b1 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7ab4784c7344b939bc36f639286f377 in current term 11: Already voted for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in this term.
W20260709 13:20:07.729867  6902 debug-util.cc:398] Leaking SignalData structure 0x7b0800340300 after lost signal to thread 10832
I20260709 13:20:07.759750  6876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fa34c08b205435dba97346991aa1f92" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
W20260709 13:20:07.730551  6902 debug-util.cc:398] Leaking SignalData structure 0x7b08003347c0 after lost signal to thread 10862
I20260709 13:20:07.681178 10915 raft_consensus.cc:3060] T 4b8cacb381b746da8d0049b0a83b41dd P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:20:07.726720  6627 catalog_manager.cc:5697] T 3411566abe2d4c9bb4b2adfdd05e6f17 P ccd8a4c3bfe3413cb2ae219b09aea832 reported cstate change: term changed from 5 to 6, leader changed from ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65) to b7ab4784c7344b939bc36f639286f377 (127.5.126.66). New cstate: current_term: 6 leader_uuid: "b7ab4784c7344b939bc36f639286f377" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } }
I20260709 13:20:07.770231  6876 raft_consensus.cc:2410] T 3fa34c08b205435dba97346991aa1f92 P cd75a17ab2604397adab03bb8b5fd75c [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ccd8a4c3bfe3413cb2ae219b09aea832 for term 13 because replica has last-logged OpId of term: 11 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 9.
I20260709 13:20:07.718916  6802 pending_rounds.cc:85] T a3022224cc81473690653a83d4e99470 P b7ab4784c7344b939bc36f639286f377: Aborting all ops after (but not including) 5
I20260709 13:20:07.772694  6802 pending_rounds.cc:107] T a3022224cc81473690653a83d4e99470 P b7ab4784c7344b939bc36f639286f377: Aborting uncommitted NO_OP operation due to leader change: 11.6
I20260709 13:20:07.773130  6802 raft_consensus.cc:2889] T a3022224cc81473690653a83d4e99470 P b7ab4784c7344b939bc36f639286f377 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:20:07.760706  6770 leader_election.cc:304] T 22ccee1b570c4ad3a57bd7aec085b1b4 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
I20260709 13:20:07.774461  6881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1704639a875409b9959353527b3fd68" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:20:07.775467  6881 raft_consensus.cc:3060] T a1704639a875409b9959353527b3fd68 P cd75a17ab2604397adab03bb8b5fd75c [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:20:07.776821  6873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a734b5ab7834e05a8c422208acc58b1" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 11 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:20:07.777540  6873 raft_consensus.cc:3060] T 7a734b5ab7834e05a8c422208acc58b1 P cd75a17ab2604397adab03bb8b5fd75c [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:20:07.762033  6902 debug-util.cc:398] Leaking SignalData structure 0x7b0800275c40 after lost signal to thread 10865
W20260709 13:20:07.778355  6902 debug-util.cc:398] Leaking SignalData structure 0x7b08003d4560 after lost signal to thread 10869
I20260709 13:20:07.778963  6799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7887766dc6784fcaa42b35c05fea7a99" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:07.780100  6799 raft_consensus.cc:2468] T 7887766dc6784fcaa42b35c05fea7a99 P b7ab4784c7344b939bc36f639286f377 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 11.
I20260709 13:20:07.762466  6879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f03d0dbf16864ca4bc1bb5e4c0334c0f" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:20:07.783051  6724 raft_consensus.cc:2468] T 44bde925b2e541b69890d70715b85176 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 12.
I20260709 13:20:07.784271  6798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbdf895bba214ff68685a24fd17dfb5d" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 11 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:07.786064  6874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20f6842e26174571996b8dea4151d4be" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:07.786449  6804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20f6842e26174571996b8dea4151d4be" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:07.787247  6878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c7f33e544204fbaac4078e3e83bbf4e" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
W20260709 13:20:07.788621  6902 debug-util.cc:398] Leaking SignalData structure 0x7b0800396ae0 after lost signal to thread 10898
I20260709 13:20:07.788925  6770 leader_election.cc:304] T f3f9c2e2bf644115957398fe4c9459db P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
I20260709 13:20:07.787971  6878 raft_consensus.cc:2468] T 8c7f33e544204fbaac4078e3e83bbf4e P cd75a17ab2604397adab03bb8b5fd75c [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 8.
I20260709 13:20:07.706111 10961 raft_consensus.cc:697] T 7ba5dac66ab5497e9e336f2a3c28cda5 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 12 LEADER]: Becoming Leader. State: Replica: 7ba59cc884714e8aa5f3f0ecaed84cbb, State: Running, Role: LEADER
I20260709 13:20:07.787539  6804 raft_consensus.cc:2468] T 20f6842e26174571996b8dea4151d4be P b7ab4784c7344b939bc36f639286f377 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 12.
I20260709 13:20:07.761059 10418 raft_consensus.cc:2804] T bb7fa124c3bf4ef9ab65a407cb008441 P b7ab4784c7344b939bc36f639286f377 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:20:07.804154  6877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbdf895bba214ff68685a24fd17dfb5d" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 11 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:07.813422  6877 raft_consensus.cc:2410] T dbdf895bba214ff68685a24fd17dfb5d P cd75a17ab2604397adab03bb8b5fd75c [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ccd8a4c3bfe3413cb2ae219b09aea832 for term 11 because replica has last-logged OpId of term: 7 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 3.
I20260709 13:20:07.686347 10695 consensus_queue.cc:1048] T 9e326172347f45e99a0d482b5d8ef768 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.104s
I20260709 13:20:07.767707 10160 raft_consensus.cc:2804] T d33d5ee8ef6f415593d8df52063161ad P b7ab4784c7344b939bc36f639286f377 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:20:07.817417  6799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c7f33e544204fbaac4078e3e83bbf4e" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:07.798182  6872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7887766dc6784fcaa42b35c05fea7a99" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:07.820626  6878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c44c4849aa54f2b94d1f1bef9ed546f" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:07.824615  6878 raft_consensus.cc:2468] T 7c44c4849aa54f2b94d1f1bef9ed546f P cd75a17ab2604397adab03bb8b5fd75c [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 12.
I20260709 13:20:07.785902 10802 raft_consensus.cc:2804] T 22ccee1b570c4ad3a57bd7aec085b1b4 P b7ab4784c7344b939bc36f639286f377 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:20:07.828613  6798 raft_consensus.cc:1275] T 3a485a995abc4807b6e511e45419f737 P b7ab4784c7344b939bc36f639286f377 [term 10 FOLLOWER]: Refusing update from remote peer ccd8a4c3bfe3413cb2ae219b09aea832: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 6. (term mismatch)
I20260709 13:20:07.829247  6872 raft_consensus.cc:2393] T 7887766dc6784fcaa42b35c05fea7a99 P cd75a17ab2604397adab03bb8b5fd75c [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ccd8a4c3bfe3413cb2ae219b09aea832 in current term 11: Already voted for candidate cd75a17ab2604397adab03bb8b5fd75c in this term.
I20260709 13:20:07.830008  6805 raft_consensus.cc:2468] T f03d0dbf16864ca4bc1bb5e4c0334c0f P b7ab4784c7344b939bc36f639286f377 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 10.
I20260709 13:20:07.759627 10939 consensus_queue.cc:1048] T 853ac0a8cbd64ce99457f170216d4d0f P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.058s
I20260709 13:20:07.833864  6802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c44c4849aa54f2b94d1f1bef9ed546f" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:07.828979  6798 pending_rounds.cc:85] T 3a485a995abc4807b6e511e45419f737 P b7ab4784c7344b939bc36f639286f377: Aborting all ops after (but not including) 5
I20260709 13:20:07.817878 10418 raft_consensus.cc:493] T bb7fa124c3bf4ef9ab65a407cb008441 P b7ab4784c7344b939bc36f639286f377 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 7ba59cc884714e8aa5f3f0ecaed84cbb)
I20260709 13:20:07.840056  6798 pending_rounds.cc:107] T 3a485a995abc4807b6e511e45419f737 P b7ab4784c7344b939bc36f639286f377: Aborting uncommitted NO_OP operation due to leader change: 9.6
I20260709 13:20:07.901779  6798 raft_consensus.cc:2889] T 3a485a995abc4807b6e511e45419f737 P b7ab4784c7344b939bc36f639286f377 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:20:07.862152  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 52455.1us
I20260709 13:20:07.838676  6627 catalog_manager.cc:5697] T 7c37d41cd9164c15a6826ca62a851a69 P ccd8a4c3bfe3413cb2ae219b09aea832 reported cstate change: term changed from 4 to 5, leader changed from b7ab4784c7344b939bc36f639286f377 (127.5.126.66) to cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67). New cstate: current_term: 5 leader_uuid: "cd75a17ab2604397adab03bb8b5fd75c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } }
I20260709 13:20:07.921838  6873 raft_consensus.cc:2468] T 7a734b5ab7834e05a8c422208acc58b1 P cd75a17ab2604397adab03bb8b5fd75c [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 11.
I20260709 13:20:07.827015 10818 raft_consensus.cc:2804] T f3f9c2e2bf644115957398fe4c9459db P b7ab4784c7344b939bc36f639286f377 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:20:07.922953  6873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22ccee1b570c4ad3a57bd7aec085b1b4" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:07.925520  6876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3411566abe2d4c9bb4b2adfdd05e6f17" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:07.826807 10758 leader_election.cc:290] T 853ac0a8cbd64ce99457f170216d4d0f P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:07.930430  7498 raft_consensus.cc:1240] T 17587d6730594da4a56fa13a353232a1 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 15 LEADER]: Rejecting Update request from peer b7ab4784c7344b939bc36f639286f377 for earlier term 13. Current term is 15. Ops: []
I20260709 13:20:07.930588  6876 raft_consensus.cc:2393] T 3411566abe2d4c9bb4b2adfdd05e6f17 P cd75a17ab2604397adab03bb8b5fd75c [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ccd8a4c3bfe3413cb2ae219b09aea832 in current term 9: Already voted for candidate cd75a17ab2604397adab03bb8b5fd75c in this term.
W20260709 13:20:07.857108 10956 log.cc:927] Time spent T b56bf91d90824c959e21e0cee5ba1816 P b7ab4784c7344b939bc36f639286f377: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
I20260709 13:20:07.932801  6799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17587d6730594da4a56fa13a353232a1" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:07.935915  6799 raft_consensus.cc:2468] T 17587d6730594da4a56fa13a353232a1 P b7ab4784c7344b939bc36f639286f377 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 15.
I20260709 13:20:07.934165  6844 leader_election.cc:304] T 3411566abe2d4c9bb4b2adfdd05e6f17 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:20:07.863997 10160 raft_consensus.cc:697] T d33d5ee8ef6f415593d8df52063161ad P b7ab4784c7344b939bc36f639286f377 [term 12 LEADER]: Becoming Leader. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
W20260709 13:20:07.945308  6772 connection.cc:256] RPC call timeout handler was delayed by -1.5573794340000404s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18220000000000003s for a response
I20260709 13:20:07.924510 10418 raft_consensus.cc:3060] T bb7fa124c3bf4ef9ab65a407cb008441 P b7ab4784c7344b939bc36f639286f377 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:20:07.922015 10802 raft_consensus.cc:697] T 22ccee1b570c4ad3a57bd7aec085b1b4 P b7ab4784c7344b939bc36f639286f377 [term 10 LEADER]: Becoming Leader. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
I20260709 13:20:07.952569  6627 catalog_manager.cc:5697] T d8292e16e5654be6bc408560cf256aaa P ccd8a4c3bfe3413cb2ae219b09aea832 reported cstate change: term changed from 1 to 8, leader changed from b7ab4784c7344b939bc36f639286f377 (127.5.126.66) to ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65). New cstate: current_term: 8 leader_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } health_report { overall_health: HEALTHY } } }
I20260709 13:20:07.952560  6876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44bde925b2e541b69890d70715b85176" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:07.949281  6697 leader_election.cc:304] T 34f36d59d88f40fe8a2805e604fc6c0a P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377
I20260709 13:20:07.960872  6876 raft_consensus.cc:2468] T 44bde925b2e541b69890d70715b85176 P cd75a17ab2604397adab03bb8b5fd75c [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 10.
I20260709 13:20:07.962419  6799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6869f07b5a4885a0b99fbe60c3b175" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
W20260709 13:20:07.963048  6770 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 174177us
W20260709 13:20:07.964243  7466 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 283913us
I20260709 13:20:07.998384  6627 catalog_manager.cc:5697] T de3186201e1a40d0b335eeb8b4e256e0 P ccd8a4c3bfe3413cb2ae219b09aea832 reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:07.950501 10921 raft_consensus.cc:2749] T f3f9c2e2bf644115957398fe4c9459db P cd75a17ab2604397adab03bb8b5fd75c [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:20:08.003302  6802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3411566abe2d4c9bb4b2adfdd05e6f17" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:07.951965 10869 raft_consensus.cc:2749] T 3411566abe2d4c9bb4b2adfdd05e6f17 P cd75a17ab2604397adab03bb8b5fd75c [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:20:07.848572 10961 consensus_queue.cc:237] T 7ba5dac66ab5497e9e336f2a3c28cda5 P 7ba59cc884714e8aa5f3f0ecaed84cbb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:20:08.003739  6627 catalog_manager.cc:5697] T b56bf91d90824c959e21e0cee5ba1816 P ccd8a4c3bfe3413cb2ae219b09aea832 reported cstate change: term changed from 4 to 8, leader changed from cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67) to ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65). New cstate: current_term: 8 leader_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:07.942667 10794 consensus_queue.cc:1048] T a3022224cc81473690653a83d4e99470 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.055s
I20260709 13:20:07.966709 10708 raft_consensus.cc:493] T d8cee0accdb8499c86d4414b72565a38 P b7ab4784c7344b939bc36f639286f377 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:08.007452  6802 raft_consensus.cc:2468] T 3411566abe2d4c9bb4b2adfdd05e6f17 P b7ab4784c7344b939bc36f639286f377 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 9.
I20260709 13:20:08.021373  7498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fa34c08b205435dba97346991aa1f92" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:20:08.021701  6732 raft_consensus.cc:1275] T 17587d6730594da4a56fa13a353232a1 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 15 FOLLOWER]: Refusing update from remote peer 7ba59cc884714e8aa5f3f0ecaed84cbb: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:20:08.018288  6844 leader_election.cc:400] T 9e326172347f45e99a0d482b5d8ef768 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 9 election: Vote denied by peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391) with higher term. Message: Invalid argument: T 9e326172347f45e99a0d482b5d8ef768 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c for earlier term 9. Current term is 10.
I20260709 13:20:07.944062 10758 consensus_queue.cc:1048] T 713b5728a197487c9300b310ab94e5a3 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.054s
I20260709 13:20:08.028481  6876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e31b9971c15848dea59d4d4130141d9e" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:08.028461  7496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be1a92657f494cac8dd227d152f50151" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:20:08.004110 10692 raft_consensus.cc:2804] T 34f36d59d88f40fe8a2805e604fc6c0a P ccd8a4c3bfe3413cb2ae219b09aea832 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 13:20:08.023998  6697 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 74748.1us
I20260709 13:20:08.019826  7503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17587d6730594da4a56fa13a353232a1" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:20:08.054426  6799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d33d5ee8ef6f415593d8df52063161ad" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:08.063097  6697 leader_election.cc:304] T 24ee15416e3145beaa1b8183453729a3 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:20:08.030928  6876 raft_consensus.cc:2468] T e31b9971c15848dea59d4d4130141d9e P cd75a17ab2604397adab03bb8b5fd75c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 7.
I20260709 13:20:08.069063  6770 leader_election.cc:304] T 44bde925b2e541b69890d70715b85176 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
I20260709 13:20:08.087172  6803 raft_consensus.cc:2468] T 7a734b5ab7834e05a8c422208acc58b1 P b7ab4784c7344b939bc36f639286f377 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 11.
I20260709 13:20:08.094700  6876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b3759de40694069b13c0f8bd40e5709" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:08.067330 10692 raft_consensus.cc:493] T 34f36d59d88f40fe8a2805e604fc6c0a P ccd8a4c3bfe3413cb2ae219b09aea832 [term 7 FOLLOWER]: Starting leader election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
W20260709 13:20:08.089799 10953 log.cc:927] Time spent T 3fa34c08b205435dba97346991aa1f92 P ccd8a4c3bfe3413cb2ae219b09aea832: Append to log took a long time: real 0.061s	user 0.001s	sys 0.000s
I20260709 13:20:08.028555 10708 raft_consensus.cc:515] T d8cee0accdb8499c86d4414b72565a38 P b7ab4784c7344b939bc36f639286f377 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:20:08.125715  6627 catalog_manager.cc:5697] T a1704639a875409b9959353527b3fd68 P ccd8a4c3bfe3413cb2ae219b09aea832 reported cstate change: term changed from 4 to 6, leader changed from cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67) to b7ab4784c7344b939bc36f639286f377 (127.5.126.66). New cstate: current_term: 6 leader_uuid: "b7ab4784c7344b939bc36f639286f377" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } }
I20260709 13:20:08.127125  6875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22ccee1b570c4ad3a57bd7aec085b1b4" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
W20260709 13:20:08.131736  6770 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 62799.5us
W20260709 13:20:08.145606  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 141287us
I20260709 13:20:08.147688  6877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30e88460611e47b2ba16a46a30b5f416" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:08.146950  6627 catalog_manager.cc:5697] T 2c240553ce044eedb41541d72b9475d7 P ccd8a4c3bfe3413cb2ae219b09aea832 reported cstate change: term changed from 5 to 8, leader changed from b7ab4784c7344b939bc36f639286f377 (127.5.126.66) to ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65). New cstate: current_term: 8 leader_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:08.148705  6872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b56bf91d90824c959e21e0cee5ba1816" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:20:08.149343  6872 raft_consensus.cc:3060] T b56bf91d90824c959e21e0cee5ba1816 P cd75a17ab2604397adab03bb8b5fd75c [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:20:08.150161  6876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "713b5728a197487c9300b310ab94e5a3" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 13 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:08.072551 10160 consensus_queue.cc:237] T d33d5ee8ef6f415593d8df52063161ad P b7ab4784c7344b939bc36f639286f377 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:08.119444 10692 raft_consensus.cc:3060] T 34f36d59d88f40fe8a2805e604fc6c0a P ccd8a4c3bfe3413cb2ae219b09aea832 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:20:08.197808  6627 catalog_manager.cc:5697] T be1a92657f494cac8dd227d152f50151 P ccd8a4c3bfe3413cb2ae219b09aea832 reported cstate change: term changed from 7 to 8, leader changed from 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68) to ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65). New cstate: current_term: 8 leader_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 13:20:08.144073 10844 consensus_meta.cc:287] T 4f00a2e87e56452083b759f60d461ee3 P 7ba59cc884714e8aa5f3f0ecaed84cbb: Time spent flushing consensus metadata: real 0.557s	user 0.017s	sys 0.000s
I20260709 13:20:08.230135  6727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e31b9971c15848dea59d4d4130141d9e" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:20:08.230949  6727 raft_consensus.cc:3060] T e31b9971c15848dea59d4d4130141d9e P ccd8a4c3bfe3413cb2ae219b09aea832 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:20:08.199545  6874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d33d5ee8ef6f415593d8df52063161ad" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:08.199640  6798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bf4668eeb70467fb3dc5a0289233b3c" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:08.152756  6876 raft_consensus.cc:2410] T 713b5728a197487c9300b310ab94e5a3 P cd75a17ab2604397adab03bb8b5fd75c [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7ab4784c7344b939bc36f639286f377 for term 13 because replica has last-logged OpId of term: 10 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 5.
I20260709 13:20:08.208362  6805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "853ac0a8cbd64ce99457f170216d4d0f" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:08.231974  6874 raft_consensus.cc:2468] T d33d5ee8ef6f415593d8df52063161ad P cd75a17ab2604397adab03bb8b5fd75c [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 11.
I20260709 13:20:08.131496 10818 raft_consensus.cc:697] T f3f9c2e2bf644115957398fe4c9459db P b7ab4784c7344b939bc36f639286f377 [term 11 LEADER]: Becoming Leader. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
I20260709 13:20:08.215667  6875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6869f07b5a4885a0b99fbe60c3b175" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:08.234942  6723 raft_consensus.cc:1275] T 853ac0a8cbd64ce99457f170216d4d0f P ccd8a4c3bfe3413cb2ae219b09aea832 [term 8 FOLLOWER]: Refusing update from remote peer b7ab4784c7344b939bc36f639286f377: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:20:08.235425  6875 raft_consensus.cc:2468] T bd6869f07b5a4885a0b99fbe60c3b175 P cd75a17ab2604397adab03bb8b5fd75c [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 11.
I20260709 13:20:08.119266 10938 raft_consensus.cc:2804] T 44bde925b2e541b69890d70715b85176 P b7ab4784c7344b939bc36f639286f377 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:20:08.123287 10802 consensus_queue.cc:237] T 22ccee1b570c4ad3a57bd7aec085b1b4 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:08.204501 10794 raft_consensus.cc:2804] T 24ee15416e3145beaa1b8183453729a3 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:20:08.238510  6803 raft_consensus.cc:1240] T 711ef6523deb4cbe8ef2ba61e1c21c98 P b7ab4784c7344b939bc36f639286f377 [term 12 FOLLOWER]: Rejecting Update request from peer ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 11. Current term is 12. Ops: []
I20260709 13:20:08.257784  6877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d33d5ee8ef6f415593d8df52063161ad" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:20:08.258801  6877 raft_consensus.cc:3060] T d33d5ee8ef6f415593d8df52063161ad P cd75a17ab2604397adab03bb8b5fd75c [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:20:08.240872  6804 raft_consensus.cc:1275] T 4d9def8b32fd443aa94ab1420b06837b P b7ab4784c7344b939bc36f639286f377 [term 11 FOLLOWER]: Refusing update from remote peer ccd8a4c3bfe3413cb2ae219b09aea832: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 11 index: 5. (index mismatch)
I20260709 13:20:08.248526  6807 raft_consensus.cc:1275] T 4275cf08e63345f993bce8664eada830 P b7ab4784c7344b939bc36f639286f377 [term 12 FOLLOWER]: Refusing update from remote peer ccd8a4c3bfe3413cb2ae219b09aea832: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 12 index: 6. (index mismatch)
W20260709 13:20:08.253755 10963 log.cc:927] Time spent T d8292e16e5654be6bc408560cf256aaa P b7ab4784c7344b939bc36f639286f377: Append to log took a long time: real 0.247s	user 0.001s	sys 0.000s
W20260709 13:20:08.254828 10965 log.cc:927] Time spent T bd6869f07b5a4885a0b99fbe60c3b175 P ccd8a4c3bfe3413cb2ae219b09aea832: Append to log took a long time: real 0.244s	user 0.000s	sys 0.001s
I20260709 13:20:08.262049  6874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3022224cc81473690653a83d4e99470" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:08.267557  6874 raft_consensus.cc:2468] T a3022224cc81473690653a83d4e99470 P cd75a17ab2604397adab03bb8b5fd75c [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 12.
I20260709 13:20:08.265993  6729 raft_consensus.cc:1275] T 1bf4668eeb70467fb3dc5a0289233b3c P ccd8a4c3bfe3413cb2ae219b09aea832 [term 11 FOLLOWER]: Refusing update from remote peer b7ab4784c7344b939bc36f639286f377: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 7. (term mismatch)
I20260709 13:20:08.269903  6876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a485a995abc4807b6e511e45419f737" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:08.270572  6876 raft_consensus.cc:2468] T 3a485a995abc4807b6e511e45419f737 P cd75a17ab2604397adab03bb8b5fd75c [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 10.
I20260709 13:20:08.273000 10984 consensus_queue.cc:1048] T 17587d6730594da4a56fa13a353232a1 P 7ba59cc884714e8aa5f3f0ecaed84cbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
W20260709 13:20:08.276592  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 71727.5us
I20260709 13:20:08.277683  6844 leader_election.cc:304] T d33d5ee8ef6f415593d8df52063161ad P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:20:08.279091  6844 leader_election.cc:304] T f4b8bd455d5a47c18a1380839c6e0d61 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377
I20260709 13:20:08.262034 10794 raft_consensus.cc:493] T 24ee15416e3145beaa1b8183453729a3 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:20:08.288592  6881 consensus_meta.cc:287] T a1704639a875409b9959353527b3fd68 P cd75a17ab2604397adab03bb8b5fd75c: Time spent flushing consensus metadata: real 0.512s	user 0.010s	sys 0.001s
I20260709 13:20:08.283608  7498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8cee0accdb8499c86d4414b72565a38" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:20:08.290264  6881 raft_consensus.cc:2468] T a1704639a875409b9959353527b3fd68 P cd75a17ab2604397adab03bb8b5fd75c [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 12.
I20260709 13:20:08.290902  7498 raft_consensus.cc:2468] T d8cee0accdb8499c86d4414b72565a38 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 10.
W20260709 13:20:08.280905 10912 consensus_meta.cc:287] T fe20b4b48823486ca3b9c648db6ce8aa P 7ba59cc884714e8aa5f3f0ecaed84cbb: Time spent flushing consensus metadata: real 0.620s	user 0.003s	sys 0.011s
I20260709 13:20:08.268638  6729 pending_rounds.cc:85] T 1bf4668eeb70467fb3dc5a0289233b3c P ccd8a4c3bfe3413cb2ae219b09aea832: Aborting all ops after (but not including) 6
I20260709 13:20:08.293990  6727 raft_consensus.cc:2468] T e31b9971c15848dea59d4d4130141d9e P ccd8a4c3bfe3413cb2ae219b09aea832 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 9.
I20260709 13:20:08.302174  6695 leader_election.cc:304] T 7887766dc6784fcaa42b35c05fea7a99 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
W20260709 13:20:08.295159  7466 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 160316us
I20260709 13:20:08.301666  6729 pending_rounds.cc:107] T 1bf4668eeb70467fb3dc5a0289233b3c P ccd8a4c3bfe3413cb2ae219b09aea832: Aborting uncommitted NO_OP operation due to leader change: 10.7
I20260709 13:20:08.303469  6729 raft_consensus.cc:2889] T 1bf4668eeb70467fb3dc5a0289233b3c P ccd8a4c3bfe3413cb2ae219b09aea832 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:20:08.312428  6772 leader_election.cc:304] T d8cee0accdb8499c86d4414b72565a38 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, b7ab4784c7344b939bc36f639286f377; no voters: 
I20260709 13:20:08.281530 10794 raft_consensus.cc:3060] T 24ee15416e3145beaa1b8183453729a3 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:20:08.269951 10960 log.cc:927] Time spent T f4b8bd455d5a47c18a1380839c6e0d61 P ccd8a4c3bfe3413cb2ae219b09aea832: Append to log took a long time: real 0.064s	user 0.001s	sys 0.000s
I20260709 13:20:08.316392  6695 leader_election.cc:304] T 20f6842e26174571996b8dea4151d4be P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
I20260709 13:20:08.282301 10708 leader_election.cc:290] T d8cee0accdb8499c86d4414b72565a38 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:20:08.242548 10844 raft_consensus.cc:515] T 4f00a2e87e56452083b759f60d461ee3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 12 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:20:08.338949  6876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1704639a875409b9959353527b3fd68" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:20:08.360253  6876 raft_consensus.cc:2393] T a1704639a875409b9959353527b3fd68 P cd75a17ab2604397adab03bb8b5fd75c [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate b7ab4784c7344b939bc36f639286f377 in current term 12: Already voted for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in this term.
I20260709 13:20:08.339946  6874 raft_consensus.cc:1275] T 8c7f33e544204fbaac4078e3e83bbf4e P cd75a17ab2604397adab03bb8b5fd75c [term 8 FOLLOWER]: Refusing update from remote peer b7ab4784c7344b939bc36f639286f377: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:20:08.347025 10249 raft_consensus.cc:2804] T d8cee0accdb8499c86d4414b72565a38 P b7ab4784c7344b939bc36f639286f377 [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 13:20:08.348232  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 69221.5us
W20260709 13:20:08.325878 10865 consensus_meta.cc:287] T 404190ce4ce94cecbfcb6ea9d1dd8626 P 7ba59cc884714e8aa5f3f0ecaed84cbb: Time spent flushing consensus metadata: real 0.761s	user 0.013s	sys 0.001s
I20260709 13:20:08.306653 10869 raft_consensus.cc:2804] T f4b8bd455d5a47c18a1380839c6e0d61 P cd75a17ab2604397adab03bb8b5fd75c [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:20:08.354370  6695 leader_election.cc:304] T f03d0dbf16864ca4bc1bb5e4c0334c0f P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
I20260709 13:20:08.293977 10938 raft_consensus.cc:697] T 44bde925b2e541b69890d70715b85176 P b7ab4784c7344b939bc36f639286f377 [term 12 LEADER]: Becoming Leader. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
I20260709 13:20:08.311726 10930 raft_consensus.cc:2804] T 7887766dc6784fcaa42b35c05fea7a99 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:20:08.371827  6881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "711ef6523deb4cbe8ef2ba61e1c21c98" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:20:08.363236 10249 raft_consensus.cc:493] T d8cee0accdb8499c86d4414b72565a38 P b7ab4784c7344b939bc36f639286f377 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:08.382067  6876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4275cf08e63345f993bce8664eada830" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 13 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:08.358491 10777 raft_consensus.cc:2804] T 20f6842e26174571996b8dea4151d4be P ccd8a4c3bfe3413cb2ae219b09aea832 [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 13:20:08.384876  7467 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:08.380803 10249 raft_consensus.cc:3060] T d8cee0accdb8499c86d4414b72565a38 P b7ab4784c7344b939bc36f639286f377 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:20:08.383488  6844 leader_election.cc:304] T dbdf895bba214ff68685a24fd17dfb5d P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:20:08.394322  6874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f58dc08b12a2494bb9a1372837970ca2" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:08.312552 10912 raft_consensus.cc:515] T fe20b4b48823486ca3b9c648db6ce8aa P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:20:08.376799 10869 raft_consensus.cc:493] T f4b8bd455d5a47c18a1380839c6e0d61 P cd75a17ab2604397adab03bb8b5fd75c [term 9 FOLLOWER]: Starting leader election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:20:08.396831  6874 raft_consensus.cc:2468] T f58dc08b12a2494bb9a1372837970ca2 P cd75a17ab2604397adab03bb8b5fd75c [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 13.
I20260709 13:20:08.400604  6876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c37d41cd9164c15a6826ca62a851a69" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:08.396783  6695 leader_election.cc:304] T 17587d6730594da4a56fa13a353232a1 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
W20260709 13:20:08.395288  6697 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 332297us
I20260709 13:20:08.365064 10920 consensus_queue.cc:1048] T a3022224cc81473690653a83d4e99470 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.030s
I20260709 13:20:08.397235  6881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a734b5ab7834e05a8c422208acc58b1" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 11 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:08.401319  6876 raft_consensus.cc:2468] T 7c37d41cd9164c15a6826ca62a851a69 P cd75a17ab2604397adab03bb8b5fd75c [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 10.
I20260709 13:20:08.382025 10930 raft_consensus.cc:493] T 7887766dc6784fcaa42b35c05fea7a99 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 10 FOLLOWER]: Starting leader election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:20:08.401964  6697 leader_election.cc:304] T 90d42e216d9741e190bca19a781291fd P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377
I20260709 13:20:08.403563  6881 raft_consensus.cc:2393] T 7a734b5ab7834e05a8c422208acc58b1 P cd75a17ab2604397adab03bb8b5fd75c [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7ab4784c7344b939bc36f639286f377 in current term 11: Already voted for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in this term.
I20260709 13:20:08.405896  6881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d9def8b32fd443aa94ab1420b06837b" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 12 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:08.406564  6881 raft_consensus.cc:2468] T 4d9def8b32fd443aa94ab1420b06837b P cd75a17ab2604397adab03bb8b5fd75c [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 11.
I20260709 13:20:08.375939 10865 raft_consensus.cc:515] T 404190ce4ce94cecbfcb6ea9d1dd8626 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
W20260709 13:20:08.408628 10971 log.cc:927] Time spent T dbdf895bba214ff68685a24fd17dfb5d P ccd8a4c3bfe3413cb2ae219b09aea832: Append to log took a long time: real 0.204s	user 0.001s	sys 0.000s
W20260709 13:20:08.409495 10621 consensus_meta.cc:287] T f03d0dbf16864ca4bc1bb5e4c0334c0f P cd75a17ab2604397adab03bb8b5fd75c: Time spent flushing consensus metadata: real 0.701s	user 0.012s	sys 0.000s
I20260709 13:20:08.410007 10621 raft_consensus.cc:2749] T f03d0dbf16864ca4bc1bb5e4c0334c0f P cd75a17ab2604397adab03bb8b5fd75c [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:20:08.410360 10912 leader_election.cc:290] T fe20b4b48823486ca3b9c648db6ce8aa P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 10 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:08.411031  6879 raft_consensus.cc:3060] T f03d0dbf16864ca4bc1bb5e4c0334c0f P cd75a17ab2604397adab03bb8b5fd75c [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:20:08.417234 10844 leader_election.cc:290] T 4f00a2e87e56452083b759f60d461ee3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 12 election: Requested vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:08.391908 10777 raft_consensus.cc:493] T 20f6842e26174571996b8dea4151d4be P ccd8a4c3bfe3413cb2ae219b09aea832 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:08.418098 10777 raft_consensus.cc:3060] T 20f6842e26174571996b8dea4151d4be P ccd8a4c3bfe3413cb2ae219b09aea832 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:08.418776 10865 leader_election.cc:290] T 404190ce4ce94cecbfcb6ea9d1dd8626 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 13 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
W20260709 13:20:08.420483 10727 consensus_meta.cc:287] T 404190ce4ce94cecbfcb6ea9d1dd8626 P ccd8a4c3bfe3413cb2ae219b09aea832: Time spent flushing consensus metadata: real 0.745s	user 0.016s	sys 0.000s
I20260709 13:20:08.421043  6844 leader_election.cc:304] T a1704639a875409b9959353527b3fd68 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:20:08.420990 10727 raft_consensus.cc:515] T 404190ce4ce94cecbfcb6ea9d1dd8626 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:20:08.384374 10983 raft_consensus.cc:2804] T f03d0dbf16864ca4bc1bb5e4c0334c0f P ccd8a4c3bfe3413cb2ae219b09aea832 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:20:08.428273  6695 leader_election.cc:304] T 3411566abe2d4c9bb4b2adfdd05e6f17 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
I20260709 13:20:08.403409 10869 raft_consensus.cc:3060] T f4b8bd455d5a47c18a1380839c6e0d61 P cd75a17ab2604397adab03bb8b5fd75c [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:20:08.425215 10930 raft_consensus.cc:3060] T 7887766dc6784fcaa42b35c05fea7a99 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:20:08.432456  6874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c240553ce044eedb41541d72b9475d7" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:08.433243  6874 raft_consensus.cc:2468] T 2c240553ce044eedb41541d72b9475d7 P cd75a17ab2604397adab03bb8b5fd75c [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 12.
W20260709 13:20:08.422636 10580 consensus_meta.cc:287] T d8292e16e5654be6bc408560cf256aaa P ccd8a4c3bfe3413cb2ae219b09aea832: Time spent flushing consensus metadata: real 0.681s	user 0.010s	sys 0.002s
W20260709 13:20:08.436327 10913 consensus_meta.cc:287] T 22ccee1b570c4ad3a57bd7aec085b1b4 P cd75a17ab2604397adab03bb8b5fd75c: Time spent flushing consensus metadata: real 0.892s	user 0.008s	sys 0.009s
I20260709 13:20:08.447850  6874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20f6842e26174571996b8dea4151d4be" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 13 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:08.449060  6876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f9c2e2bf644115957398fe4c9459db" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:20:08.431172 10990 raft_consensus.cc:2804] T 17587d6730594da4a56fa13a353232a1 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:20:08.446331 10580 raft_consensus.cc:515] T d8292e16e5654be6bc408560cf256aaa P ccd8a4c3bfe3413cb2ae219b09aea832 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:08.446764 10931 raft_consensus.cc:2804] T 3411566abe2d4c9bb4b2adfdd05e6f17 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:20:08.456651 10990 raft_consensus.cc:493] T 17587d6730594da4a56fa13a353232a1 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:20:08.463881 10979 log.cc:927] Time spent T 95a75bfe094d4bdc963aba3f08dfcd25 P cd75a17ab2604397adab03bb8b5fd75c: Append to log took a long time: real 0.083s	user 0.000s	sys 0.006s
I20260709 13:20:08.464076 10990 raft_consensus.cc:3060] T 17587d6730594da4a56fa13a353232a1 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:20:08.460387  7468 leader_election.cc:336] T d8cee0accdb8499c86d4414b72565a38 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931): Timed out: RequestConsensusVote RPC to 127.5.126.67:42931 timed out after 1.584s (SENT)
I20260709 13:20:08.466576 10727 leader_election.cc:290] T 404190ce4ce94cecbfcb6ea9d1dd8626 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 12 election: Requested vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:20:08.467206  7468 leader_election.cc:304] T d8cee0accdb8499c86d4414b72565a38 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:20:08.462572 10580 leader_election.cc:290] T d8292e16e5654be6bc408560cf256aaa P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 15 election: Requested vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:08.456243  6876 raft_consensus.cc:3060] T f3f9c2e2bf644115957398fe4c9459db P cd75a17ab2604397adab03bb8b5fd75c [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:20:08.383829 10818 consensus_queue.cc:237] T f3f9c2e2bf644115957398fe4c9459db P b7ab4784c7344b939bc36f639286f377 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:08.484579  6725 raft_consensus.cc:1240] T d8292e16e5654be6bc408560cf256aaa P ccd8a4c3bfe3413cb2ae219b09aea832 [term 15 FOLLOWER]: Rejecting Update request from peer b7ab4784c7344b939bc36f639286f377 for earlier term 14. Current term is 15. Ops: []
I20260709 13:20:08.463106 10931 raft_consensus.cc:493] T 3411566abe2d4c9bb4b2adfdd05e6f17 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 8 FOLLOWER]: Starting leader election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:20:08.485774 10931 raft_consensus.cc:3060] T 3411566abe2d4c9bb4b2adfdd05e6f17 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:20:08.430516 10914 raft_consensus.cc:2749] T dbdf895bba214ff68685a24fd17dfb5d P cd75a17ab2604397adab03bb8b5fd75c [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:20:08.454546  6695 leader_election.cc:304] T 7a734b5ab7834e05a8c422208acc58b1 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
W20260709 13:20:08.491026 10418 consensus_meta.cc:287] T bb7fa124c3bf4ef9ab65a407cb008441 P b7ab4784c7344b939bc36f639286f377: Time spent flushing consensus metadata: real 0.529s	user 0.010s	sys 0.002s
I20260709 13:20:08.491575 10418 raft_consensus.cc:515] T bb7fa124c3bf4ef9ab65a407cb008441 P b7ab4784c7344b939bc36f639286f377 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:20:08.492991  6807 raft_consensus.cc:1240] T bb7fa124c3bf4ef9ab65a407cb008441 P b7ab4784c7344b939bc36f639286f377 [term 11 FOLLOWER]: Rejecting Update request from peer 7ba59cc884714e8aa5f3f0ecaed84cbb for earlier term 10. Current term is 11. Ops: []
I20260709 13:20:08.403227 10988 consensus_queue.cc:1048] T 3a485a995abc4807b6e511e45419f737 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.095s
I20260709 13:20:08.451423 10938 consensus_queue.cc:237] T 44bde925b2e541b69890d70715b85176 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:08.497561  6880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44bde925b2e541b69890d70715b85176" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:20:08.498219  6880 raft_consensus.cc:3060] T 44bde925b2e541b69890d70715b85176 P cd75a17ab2604397adab03bb8b5fd75c [term 10 FOLLOWER]: Advancing to term 12
W20260709 13:20:08.500325  6695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 45928.3us
I20260709 13:20:08.502764  6876 raft_consensus.cc:2468] T f3f9c2e2bf644115957398fe4c9459db P cd75a17ab2604397adab03bb8b5fd75c [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 11.
I20260709 13:20:08.513532  6877 raft_consensus.cc:2468] T d33d5ee8ef6f415593d8df52063161ad P cd75a17ab2604397adab03bb8b5fd75c [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 12.
I20260709 13:20:08.514417 10921 raft_consensus.cc:2749] T d33d5ee8ef6f415593d8df52063161ad P cd75a17ab2604397adab03bb8b5fd75c [term 12 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
W20260709 13:20:08.515630  6697 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 90159.1us
I20260709 13:20:08.518252  6697 leader_election.cc:304] T c4db81d9d329422bb3b4160ca4ac2d1d P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377
I20260709 13:20:08.520329 10978 raft_consensus.cc:2804] T c4db81d9d329422bb3b4160ca4ac2d1d P ccd8a4c3bfe3413cb2ae219b09aea832 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:20:08.520831 10978 raft_consensus.cc:493] T c4db81d9d329422bb3b4160ca4ac2d1d P ccd8a4c3bfe3413cb2ae219b09aea832 [term 9 FOLLOWER]: Starting leader election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:20:08.521265 10978 raft_consensus.cc:3060] T c4db81d9d329422bb3b4160ca4ac2d1d P ccd8a4c3bfe3413cb2ae219b09aea832 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:20:08.513584  6879 raft_consensus.cc:2468] T f03d0dbf16864ca4bc1bb5e4c0334c0f P cd75a17ab2604397adab03bb8b5fd75c [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 10.
I20260709 13:20:08.521992 10930 raft_consensus.cc:515] T 7887766dc6784fcaa42b35c05fea7a99 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:08.523051 10794 raft_consensus.cc:515] T 24ee15416e3145beaa1b8183453729a3 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:20:08.524269  6697 leader_election.cc:304] T fe20b4b48823486ca3b9c648db6ce8aa P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:20:08.525197 10580 raft_consensus.cc:2804] T fe20b4b48823486ca3b9c648db6ce8aa P ccd8a4c3bfe3413cb2ae219b09aea832 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:20:08.525398 10869 raft_consensus.cc:515] T f4b8bd455d5a47c18a1380839c6e0d61 P cd75a17ab2604397adab03bb8b5fd75c [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:08.525794 10580 raft_consensus.cc:493] T fe20b4b48823486ca3b9c648db6ce8aa P ccd8a4c3bfe3413cb2ae219b09aea832 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:08.525738 10930 leader_election.cc:290] T 7887766dc6784fcaa42b35c05fea7a99 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 11 election: Requested vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:08.529783 10580 raft_consensus.cc:3060] T fe20b4b48823486ca3b9c648db6ce8aa P ccd8a4c3bfe3413cb2ae219b09aea832 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:20:08.528318 10920 consensus_queue.cc:1048] T 4d9def8b32fd443aa94ab1420b06837b P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:20:08.535746  6697 leader_election.cc:304] T 3d65025eea89441290d85dd053810e31 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377
I20260709 13:20:08.442081 10983 raft_consensus.cc:697] T f03d0dbf16864ca4bc1bb5e4c0334c0f P ccd8a4c3bfe3413cb2ae219b09aea832 [term 10 LEADER]: Becoming Leader. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
I20260709 13:20:08.538407  6874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e31b9971c15848dea59d4d4130141d9e" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:20:08.539258  6874 raft_consensus.cc:3060] T e31b9971c15848dea59d4d4130141d9e P cd75a17ab2604397adab03bb8b5fd75c [term 7 FOLLOWER]: Advancing to term 9
I20260709 13:20:08.540879  6876 raft_consensus.cc:1275] T 1bf4668eeb70467fb3dc5a0289233b3c P cd75a17ab2604397adab03bb8b5fd75c [term 11 FOLLOWER]: Refusing update from remote peer b7ab4784c7344b939bc36f639286f377: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:20:08.446996 10621 raft_consensus.cc:2749] T a1704639a875409b9959353527b3fd68 P cd75a17ab2604397adab03bb8b5fd75c [term 12 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:20:08.442664 10998 raft_consensus.cc:2804] T 90d42e216d9741e190bca19a781291fd P ccd8a4c3bfe3413cb2ae219b09aea832 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:20:08.500157 10913 raft_consensus.cc:2749] T 22ccee1b570c4ad3a57bd7aec085b1b4 P cd75a17ab2604397adab03bb8b5fd75c [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:20:08.483740 10692 raft_consensus.cc:515] T 34f36d59d88f40fe8a2805e604fc6c0a P ccd8a4c3bfe3413cb2ae219b09aea832 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:08.509160 10988 raft_consensus.cc:2804] T 7a734b5ab7834e05a8c422208acc58b1 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:20:08.567378  6724 raft_consensus.cc:1240] T 34f36d59d88f40fe8a2805e604fc6c0a P ccd8a4c3bfe3413cb2ae219b09aea832 [term 8 FOLLOWER]: Rejecting Update request from peer b7ab4784c7344b939bc36f639286f377 for earlier term 7. Current term is 8. Ops: []
I20260709 13:20:08.546617 10930 consensus_queue.cc:1059] T 711ef6523deb4cbe8ef2ba61e1c21c98 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.016s
I20260709 13:20:08.559377 10993 raft_consensus.cc:2749] T d8cee0accdb8499c86d4414b72565a38 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:20:08.548154 10998 raft_consensus.cc:493] T 90d42e216d9741e190bca19a781291fd P ccd8a4c3bfe3413cb2ae219b09aea832 [term 10 FOLLOWER]: Starting leader election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
W20260709 13:20:08.564826 10915 consensus_meta.cc:287] T 4b8cacb381b746da8d0049b0a83b41dd P 7ba59cc884714e8aa5f3f0ecaed84cbb: Time spent flushing consensus metadata: real 0.776s	user 0.010s	sys 0.008s
I20260709 13:20:08.565274 10692 leader_election.cc:290] T 34f36d59d88f40fe8a2805e604fc6c0a P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 8 election: Requested vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
W20260709 13:20:08.569144  7468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 108810us
I20260709 13:20:08.576946  6873 raft_consensus.cc:2468] T 22ccee1b570c4ad3a57bd7aec085b1b4 P cd75a17ab2604397adab03bb8b5fd75c [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 9.
W20260709 13:20:08.578474  6697 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 49087.3us
W20260709 13:20:08.570345 10860 consensus_meta.cc:287] T b3f13b31a1f84f0d89d007eadd57924c P 7ba59cc884714e8aa5f3f0ecaed84cbb: Time spent flushing consensus metadata: real 0.941s	user 0.001s	sys 0.014s
I20260709 13:20:08.559377 10832 raft_consensus.cc:2804] T 3d65025eea89441290d85dd053810e31 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:20:08.549995 10758 consensus_queue.cc:1048] T 4275cf08e63345f993bce8664eada830 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.036s
I20260709 13:20:08.547959 10920 consensus_queue.cc:1048] T 4d9def8b32fd443aa94ab1420b06837b P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.039s
I20260709 13:20:08.569262 10998 raft_consensus.cc:3060] T 90d42e216d9741e190bca19a781291fd P ccd8a4c3bfe3413cb2ae219b09aea832 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:20:08.605654  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 184704us
I20260709 13:20:08.605924  6697 leader_election.cc:304] T f4b8bd455d5a47c18a1380839c6e0d61 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:20:08.611631  6872 raft_consensus.cc:2468] T b56bf91d90824c959e21e0cee5ba1816 P cd75a17ab2604397adab03bb8b5fd75c [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 11.
I20260709 13:20:08.525445 10794 leader_election.cc:290] T 24ee15416e3145beaa1b8183453729a3 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 12 election: Requested vote from peers cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:20:08.591348 10832 raft_consensus.cc:493] T 3d65025eea89441290d85dd053810e31 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 9 FOLLOWER]: Starting leader election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:20:08.581285 10915 raft_consensus.cc:515] T 4b8cacb381b746da8d0049b0a83b41dd P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:20:08.618212 11010 raft_consensus.cc:2749] T f4b8bd455d5a47c18a1380839c6e0d61 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:20:08.597008 10869 leader_election.cc:290] T f4b8bd455d5a47c18a1380839c6e0d61 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 10 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:20:08.616585  6872 raft_consensus.cc:1240] T f4b8bd455d5a47c18a1380839c6e0d61 P cd75a17ab2604397adab03bb8b5fd75c [term 10 FOLLOWER]: Rejecting Update request from peer b7ab4784c7344b939bc36f639286f377 for earlier term 9. Current term is 10. Ops: []
W20260709 13:20:08.613597 10999 log.cc:927] Time spent T 22ccee1b570c4ad3a57bd7aec085b1b4 P b7ab4784c7344b939bc36f639286f377: Append to log took a long time: real 0.057s	user 0.000s	sys 0.001s
I20260709 13:20:08.584576 10990 raft_consensus.cc:515] T 17587d6730594da4a56fa13a353232a1 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:20:08.630529  6844 leader_election.cc:304] T e77e330a82df4b43a745d57a68f6f057 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:20:08.594666 10860 raft_consensus.cc:515] T b3f13b31a1f84f0d89d007eadd57924c P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
W20260709 13:20:08.636657 10970 log.cc:927] Time spent T 8c7f33e544204fbaac4078e3e83bbf4e P ccd8a4c3bfe3413cb2ae219b09aea832: Append to log took a long time: real 0.518s	user 0.004s	sys 0.000s
I20260709 13:20:08.638366  6730 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50004 (request call id 2006) took 1091 ms. Trace:
I20260709 13:20:08.638759  6730 rpcz_store.cc:276] 0709 13:20:07.546556 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:07.546722 (+   166us) service_pool.cc:224] Handling call
0709 13:20:07.547167 (+   445us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:07.583574 (+ 36407us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:07.583621 (+    47us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:20:07.604386 (+ 20765us) log.cc:844] Serialized 26 byte log entry
0709 13:20:07.958957 (+354571us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:20:07.959021 (+    64us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:07.962879 (+  3858us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:08.566934 (+604055us) spinlock_profiling.cc:243] Waited 16.2 ms on lock 0x7b4400022b4c. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0c745db1 00007fcc0c7e3c85 00007fcc0c7e46a2 00007fcc0f5561db 00007fcc0f551aaf 00007fcc0f54586e 00007fcc0f544bb6 00007fcc0f5447d8 00007fcc0f54e221 00007fcc0f54e1d9 00007fcc0f54e169
0709 13:20:08.638022 (+ 71088us) raft_consensus.cc:1685] finished
0709 13:20:08.638048 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:08.638296 (+   248us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6773,"raft.queue_time_us":123,"raft.run_cpu_time_us":140,"raft.run_wall_time_us":6770,"spinlock_wait_cycles":37270784,"thread_start_us":272867,"threads_started":1,"wal-append.queue_time_us":365844}
I20260709 13:20:08.614447 10983 consensus_queue.cc:237] T f03d0dbf16864ca4bc1bb5e4c0334c0f P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:08.642377 10990 leader_election.cc:290] T 17587d6730594da4a56fa13a353232a1 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 16 election: Requested vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:20:08.621095 10832 raft_consensus.cc:3060] T 3d65025eea89441290d85dd053810e31 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:20:08.644784  6695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 99870.5us
W20260709 13:20:08.653441  6697 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 51623.7us
I20260709 13:20:08.654685  6697 leader_election.cc:304] T 9e326172347f45e99a0d482b5d8ef768 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377
I20260709 13:20:08.657418  6697 leader_election.cc:304] T f3f9c2e2bf644115957398fe4c9459db P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:20:08.660184  6697 leader_election.cc:304] T 07a92dd554674067a83a9cb68c4773f2 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377
I20260709 13:20:08.660472  6872 raft_consensus.cc:1275] T d8292e16e5654be6bc408560cf256aaa P cd75a17ab2604397adab03bb8b5fd75c [term 14 FOLLOWER]: Refusing update from remote peer b7ab4784c7344b939bc36f639286f377: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:20:08.663086  6844 leader_election.cc:304] T 9b3759de40694069b13c0f8bd40e5709 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:20:08.664601  6844 leader_election.cc:304] T 24ee15416e3145beaa1b8183453729a3 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:20:08.665480 10913 raft_consensus.cc:2749] T 9b3759de40694069b13c0f8bd40e5709 P cd75a17ab2604397adab03bb8b5fd75c [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:20:08.666234 10913 raft_consensus.cc:2749] T 24ee15416e3145beaa1b8183453729a3 P cd75a17ab2604397adab03bb8b5fd75c [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:20:08.666106  6844 leader_election.cc:304] T a3022224cc81473690653a83d4e99470 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:20:08.667434 10913 raft_consensus.cc:2749] T a3022224cc81473690653a83d4e99470 P cd75a17ab2604397adab03bb8b5fd75c [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:20:08.646555 10777 raft_consensus.cc:515] T 20f6842e26174571996b8dea4151d4be P ccd8a4c3bfe3413cb2ae219b09aea832 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:08.672242  6872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8cee0accdb8499c86d4414b72565a38" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:08.672919  6872 raft_consensus.cc:2468] T d8cee0accdb8499c86d4414b72565a38 P cd75a17ab2604397adab03bb8b5fd75c [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 9.
I20260709 13:20:08.674420 10777 leader_election.cc:290] T 20f6842e26174571996b8dea4151d4be P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 13 election: Requested vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:08.674734 10920 raft_consensus.cc:2749] T f3f9c2e2bf644115957398fe4c9459db P ccd8a4c3bfe3413cb2ae219b09aea832 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:20:08.675482 10992 log.cc:927] Time spent T f58dc08b12a2494bb9a1372837970ca2 P b7ab4784c7344b939bc36f639286f377: Append to log took a long time: real 0.090s	user 0.001s	sys 0.000s
I20260709 13:20:08.671399  6844 leader_election.cc:304] T c4db81d9d329422bb3b4160ca4ac2d1d P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:20:08.639842 10249 raft_consensus.cc:515] T d8cee0accdb8499c86d4414b72565a38 P b7ab4784c7344b939bc36f639286f377 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:20:08.687402  6697 leader_election.cc:304] T ab432e62819d499eaaf3dd55481dd930 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377
I20260709 13:20:08.646811 11006 raft_consensus.cc:2749] T e77e330a82df4b43a745d57a68f6f057 P cd75a17ab2604397adab03bb8b5fd75c [term 14 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:20:08.662591 11010 raft_consensus.cc:2804] T 9e326172347f45e99a0d482b5d8ef768 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:20:08.687013  6844 leader_election.cc:304] T fe20b4b48823486ca3b9c648db6ce8aa P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:20:08.690377 10983 raft_consensus.cc:2804] T ab432e62819d499eaaf3dd55481dd930 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:20:08.701660 10983 raft_consensus.cc:493] T ab432e62819d499eaaf3dd55481dd930 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 12 FOLLOWER]: Starting leader election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:20:08.702139 10983 raft_consensus.cc:3060] T ab432e62819d499eaaf3dd55481dd930 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:08.676575 10978 raft_consensus.cc:515] T c4db81d9d329422bb3b4160ca4ac2d1d P ccd8a4c3bfe3413cb2ae219b09aea832 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:08.662086 10988 raft_consensus.cc:697] T 7a734b5ab7834e05a8c422208acc58b1 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 11 LEADER]: Becoming Leader. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
I20260709 13:20:08.697049  6881 raft_consensus.cc:1275] T b56bf91d90824c959e21e0cee5ba1816 P cd75a17ab2604397adab03bb8b5fd75c [term 11 FOLLOWER]: Refusing update from remote peer b7ab4784c7344b939bc36f639286f377: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:20:08.693501  6697 leader_election.cc:304] T 8c7f33e544204fbaac4078e3e83bbf4e P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377
I20260709 13:20:08.693564 10249 leader_election.cc:290] T d8cee0accdb8499c86d4414b72565a38 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 11 election: Requested vote from peers cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
W20260709 13:20:08.691674 10997 log.cc:927] Time spent T 7ba5dac66ab5497e9e336f2a3c28cda5 P 7ba59cc884714e8aa5f3f0ecaed84cbb: Append to log took a long time: real 0.091s	user 0.001s	sys 0.000s
I20260709 13:20:08.720671 10915 leader_election.cc:290] T 4b8cacb381b746da8d0049b0a83b41dd P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 12 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:08.721635 10580 raft_consensus.cc:515] T fe20b4b48823486ca3b9c648db6ce8aa P ccd8a4c3bfe3413cb2ae219b09aea832 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:20:08.687229 10777 raft_consensus.cc:2804] T 07a92dd554674067a83a9cb68c4773f2 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:20:08.707926  6772 leader_election.cc:304] T 9b3759de40694069b13c0f8bd40e5709 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:20:08.708609  6878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb7fa124c3bf4ef9ab65a407cb008441" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:20:08.723472  6878 raft_consensus.cc:3060] T bb7fa124c3bf4ef9ab65a407cb008441 P cd75a17ab2604397adab03bb8b5fd75c [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:20:08.706933 11010 raft_consensus.cc:493] T 9e326172347f45e99a0d482b5d8ef768 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 10 FOLLOWER]: Starting leader election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:20:08.710717 11012 raft_consensus.cc:2804] T 8c7f33e544204fbaac4078e3e83bbf4e P ccd8a4c3bfe3413cb2ae219b09aea832 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:20:08.690461 10869 raft_consensus.cc:2804] T c4db81d9d329422bb3b4160ca4ac2d1d P cd75a17ab2604397adab03bb8b5fd75c [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:20:08.712396  6697 leader_election.cc:304] T 7c44c4849aa54f2b94d1f1bef9ed546f P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377
I20260709 13:20:08.715080  6844 leader_election.cc:304] T 3fa34c08b205435dba97346991aa1f92 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb
I20260709 13:20:08.716266 11006 raft_consensus.cc:3060] T fe20b4b48823486ca3b9c648db6ce8aa P cd75a17ab2604397adab03bb8b5fd75c [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:20:08.716755 10860 leader_election.cc:290] T b3f13b31a1f84f0d89d007eadd57924c P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 11 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:20:08.709762  6880 raft_consensus.cc:2468] T 44bde925b2e541b69890d70715b85176 P cd75a17ab2604397adab03bb8b5fd75c [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 12.
I20260709 13:20:08.725797  6874 raft_consensus.cc:2468] T e31b9971c15848dea59d4d4130141d9e P cd75a17ab2604397adab03bb8b5fd75c [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 9.
I20260709 13:20:08.715452 10931 raft_consensus.cc:515] T 3411566abe2d4c9bb4b2adfdd05e6f17 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:08.724185 10777 raft_consensus.cc:493] T 07a92dd554674067a83a9cb68c4773f2 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 10 FOLLOWER]: Starting leader election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:20:08.726081 11010 raft_consensus.cc:3060] T 9e326172347f45e99a0d482b5d8ef768 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:20:08.733585 10978 leader_election.cc:290] T c4db81d9d329422bb3b4160ca4ac2d1d P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 10 election: Requested vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:08.739790 11008 raft_consensus.cc:2804] T 3fa34c08b205435dba97346991aa1f92 P cd75a17ab2604397adab03bb8b5fd75c [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:20:08.740347 11008 raft_consensus.cc:493] T 3fa34c08b205435dba97346991aa1f92 P cd75a17ab2604397adab03bb8b5fd75c [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:08.740743 11008 raft_consensus.cc:3060] T 3fa34c08b205435dba97346991aa1f92 P cd75a17ab2604397adab03bb8b5fd75c [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:08.741488 10931 leader_election.cc:290] T 3411566abe2d4c9bb4b2adfdd05e6f17 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 9 election: Requested vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:08.742754  6727 raft_consensus.cc:1275] T b56bf91d90824c959e21e0cee5ba1816 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 11 FOLLOWER]: Refusing update from remote peer b7ab4784c7344b939bc36f639286f377: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:20:08.745702 10700 raft_consensus.cc:2804] T 7c44c4849aa54f2b94d1f1bef9ed546f P ccd8a4c3bfe3413cb2ae219b09aea832 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:20:08.745909 10580 leader_election.cc:290] T fe20b4b48823486ca3b9c648db6ce8aa P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 10 election: Requested vote from peers cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:20:08.737782  6697 leader_election.cc:304] T dbdf895bba214ff68685a24fd17dfb5d P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:20:08.738268  6844 leader_election.cc:304] T f09c2a98de1a4decabd0ff900dd44caa P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:20:08.746816  7496 raft_consensus.cc:1240] T 4b8cacb381b746da8d0049b0a83b41dd P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 12 FOLLOWER]: Rejecting Update request from peer cd75a17ab2604397adab03bb8b5fd75c for earlier term 11. Current term is 12. Ops: []
I20260709 13:20:08.747104 10913 raft_consensus.cc:2804] T f09c2a98de1a4decabd0ff900dd44caa P cd75a17ab2604397adab03bb8b5fd75c [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:20:08.747740 10913 raft_consensus.cc:493] T f09c2a98de1a4decabd0ff900dd44caa P cd75a17ab2604397adab03bb8b5fd75c [term 12 FOLLOWER]: Starting leader election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:20:08.748416 10913 raft_consensus.cc:3060] T f09c2a98de1a4decabd0ff900dd44caa P cd75a17ab2604397adab03bb8b5fd75c [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:08.750829 10921 consensus_queue.cc:1059] T 4b8cacb381b746da8d0049b0a83b41dd P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:20:08.751816 10921 raft_consensus.cc:3055] T 4b8cacb381b746da8d0049b0a83b41dd P cd75a17ab2604397adab03bb8b5fd75c [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:20:08.752179 10921 raft_consensus.cc:740] T 4b8cacb381b746da8d0049b0a83b41dd P cd75a17ab2604397adab03bb8b5fd75c [term 11 LEADER]: Becoming Follower/Learner. State: Replica: cd75a17ab2604397adab03bb8b5fd75c, State: Running, Role: LEADER
I20260709 13:20:08.753073 10921 consensus_queue.cc:260] T 4b8cacb381b746da8d0049b0a83b41dd P cd75a17ab2604397adab03bb8b5fd75c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:20:08.754302 10921 raft_consensus.cc:3060] T 4b8cacb381b746da8d0049b0a83b41dd P cd75a17ab2604397adab03bb8b5fd75c [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:20:08.726361 11012 raft_consensus.cc:493] T 8c7f33e544204fbaac4078e3e83bbf4e P ccd8a4c3bfe3413cb2ae219b09aea832 [term 8 FOLLOWER]: Starting leader election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:20:08.756475 11012 raft_consensus.cc:3060] T 8c7f33e544204fbaac4078e3e83bbf4e P ccd8a4c3bfe3413cb2ae219b09aea832 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:20:08.758445  6880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8cee0accdb8499c86d4414b72565a38" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:20:08.759152  6880 raft_consensus.cc:3060] T d8cee0accdb8499c86d4414b72565a38 P cd75a17ab2604397adab03bb8b5fd75c [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:20:08.726687 10869 raft_consensus.cc:493] T c4db81d9d329422bb3b4160ca4ac2d1d P cd75a17ab2604397adab03bb8b5fd75c [term 9 FOLLOWER]: Starting leader election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:20:08.760445 10869 raft_consensus.cc:3060] T c4db81d9d329422bb3b4160ca4ac2d1d P cd75a17ab2604397adab03bb8b5fd75c [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:20:08.746228 10700 raft_consensus.cc:493] T 7c44c4849aa54f2b94d1f1bef9ed546f P ccd8a4c3bfe3413cb2ae219b09aea832 [term 12 FOLLOWER]: Starting leader election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:20:08.762017 10700 raft_consensus.cc:3060] T 7c44c4849aa54f2b94d1f1bef9ed546f P ccd8a4c3bfe3413cb2ae219b09aea832 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:08.763178 10418 leader_election.cc:290] T bb7fa124c3bf4ef9ab65a407cb008441 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 11 election: Requested vote from peers cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:20:08.768180  6877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "427c124d773f483294511e80fe340075" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:08.768468  6731 raft_consensus.cc:1240] T 17587d6730594da4a56fa13a353232a1 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 16 FOLLOWER]: Rejecting Update request from peer 7ba59cc884714e8aa5f3f0ecaed84cbb for earlier term 15. Current term is 16. Ops: [15.11-15.11]
I20260709 13:20:08.769920  6881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "427c124d773f483294511e80fe340075" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:08.771662  6726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3f13b31a1f84f0d89d007eadd57924c" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:20:08.767366  6697 leader_election.cc:304] T d33d5ee8ef6f415593d8df52063161ad P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377
I20260709 13:20:08.776460  6727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe20b4b48823486ca3b9c648db6ce8aa" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:20:08.786032  6726 raft_consensus.cc:3060] T b3f13b31a1f84f0d89d007eadd57924c P ccd8a4c3bfe3413cb2ae219b09aea832 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:20:08.786408  6727 raft_consensus.cc:2393] T fe20b4b48823486ca3b9c648db6ce8aa P ccd8a4c3bfe3413cb2ae219b09aea832 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in current term 10: Already voted for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in this term.
I20260709 13:20:08.777170  6876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fa34c08b205435dba97346991aa1f92" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:20:08.776612  6880 raft_consensus.cc:2468] T d8cee0accdb8499c86d4414b72565a38 P cd75a17ab2604397adab03bb8b5fd75c [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in term 10.
I20260709 13:20:08.786845  6697 leader_election.cc:304] T bd6869f07b5a4885a0b99fbe60c3b175 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377
I20260709 13:20:08.782012 10913 raft_consensus.cc:515] T f09c2a98de1a4decabd0ff900dd44caa P cd75a17ab2604397adab03bb8b5fd75c [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
W20260709 13:20:08.783136  6678 auto_rebalancer.cc:629] Failed to schedule move for tablet a1704639a875409b9959353527b3fd68: Illegal state: Replica cd75a17ab2604397adab03bb8b5fd75c is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 11 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } }
I20260709 13:20:08.784229  6873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fa34c08b205435dba97346991aa1f92" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:20:08.788074  6697 leader_election.cc:304] T a1704639a875409b9959353527b3fd68 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377
I20260709 13:20:08.792562  6874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fa34c08b205435dba97346991aa1f92" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:08.793613  6880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8cee0accdb8499c86d4414b72565a38" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:20:08.794153  6880 raft_consensus.cc:2376] T d8cee0accdb8499c86d4414b72565a38 P cd75a17ab2604397adab03bb8b5fd75c [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in term 10. Re-sending same reply.
I20260709 13:20:08.744185 10777 raft_consensus.cc:3060] T 07a92dd554674067a83a9cb68c4773f2 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:20:08.797063  6727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c44c4849aa54f2b94d1f1bef9ed546f" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:08.798053  6727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c37d41cd9164c15a6826ca62a851a69" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:08.798944  6727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "404190ce4ce94cecbfcb6ea9d1dd8626" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:20:08.799391  6727 raft_consensus.cc:3060] T 404190ce4ce94cecbfcb6ea9d1dd8626 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:08.796280  6873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "427c124d773f483294511e80fe340075" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:08.801714  6873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ba5dac66ab5497e9e336f2a3c28cda5" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:08.804589  6697 leader_election.cc:304] T 4b8cacb381b746da8d0049b0a83b41dd P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:20:08.804695  6873 raft_consensus.cc:2468] T 7ba5dac66ab5497e9e336f2a3c28cda5 P cd75a17ab2604397adab03bb8b5fd75c [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in term 11.
I20260709 13:20:08.802877 10650 consensus_queue.cc:1059] T bb7fa124c3bf4ef9ab65a407cb008441 P 7ba59cc884714e8aa5f3f0ecaed84cbb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.006s
I20260709 13:20:08.808328 11001 raft_consensus.cc:493] T de3186201e1a40d0b335eeb8b4e256e0 P cd75a17ab2604397adab03bb8b5fd75c [term 11 FOLLOWER]: Starting pre-election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:20:08.809141 11001 raft_consensus.cc:515] T de3186201e1a40d0b335eeb8b4e256e0 P cd75a17ab2604397adab03bb8b5fd75c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:08.810719  7496 raft_consensus.cc:1240] T 4f00a2e87e56452083b759f60d461ee3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 12 FOLLOWER]: Rejecting Update request from peer cd75a17ab2604397adab03bb8b5fd75c for earlier term 11. Current term is 12. Ops: []
I20260709 13:20:08.813203 10621 consensus_queue.cc:1059] T 4f00a2e87e56452083b759f60d461ee3 P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:20:08.813769  6724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "711ef6523deb4cbe8ef2ba61e1c21c98" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:08.814375 10621 raft_consensus.cc:3055] T 4f00a2e87e56452083b759f60d461ee3 P cd75a17ab2604397adab03bb8b5fd75c [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:20:08.814889 10621 raft_consensus.cc:740] T 4f00a2e87e56452083b759f60d461ee3 P cd75a17ab2604397adab03bb8b5fd75c [term 11 LEADER]: Becoming Follower/Learner. State: Replica: cd75a17ab2604397adab03bb8b5fd75c, State: Running, Role: LEADER
I20260709 13:20:08.815097  6724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b8cacb381b746da8d0049b0a83b41dd" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:20:08.809403 10650 raft_consensus.cc:3055] T bb7fa124c3bf4ef9ab65a407cb008441 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:20:08.815780  6724 raft_consensus.cc:3060] T 4b8cacb381b746da8d0049b0a83b41dd P ccd8a4c3bfe3413cb2ae219b09aea832 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:20:08.819089  6880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe20b4b48823486ca3b9c648db6ce8aa" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:20:08.809640  6877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe20b4b48823486ca3b9c648db6ce8aa" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:08.784883 10692 raft_consensus.cc:2749] T dbdf895bba214ff68685a24fd17dfb5d P ccd8a4c3bfe3413cb2ae219b09aea832 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:20:08.816697  6731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34f36d59d88f40fe8a2805e604fc6c0a" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:08.789197 10580 raft_consensus.cc:2764] T d33d5ee8ef6f415593d8df52063161ad P ccd8a4c3bfe3413cb2ae219b09aea832 [term 12 FOLLOWER]: Leader pre-election decision vote started in defunct term 11: won
I20260709 13:20:08.811744 11001 leader_election.cc:290] T de3186201e1a40d0b335eeb8b4e256e0 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:20:08.819419  6873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b8cacb381b746da8d0049b0a83b41dd" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:08.792438 10931 raft_consensus.cc:2804] T bd6869f07b5a4885a0b99fbe60c3b175 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:20:08.795950 10978 raft_consensus.cc:2804] T a1704639a875409b9959353527b3fd68 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:20:08.835564 10978 raft_consensus.cc:697] T a1704639a875409b9959353527b3fd68 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 12 LEADER]: Becoming Leader. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
I20260709 13:20:08.836918 10978 consensus_queue.cc:237] T a1704639a875409b9959353527b3fd68 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:08.824621  6881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "427c124d773f483294511e80fe340075" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:08.840545  6807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f00a2e87e56452083b759f60d461ee3" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 12 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:20:08.841303  6807 raft_consensus.cc:3060] T 4f00a2e87e56452083b759f60d461ee3 P b7ab4784c7344b939bc36f639286f377 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:20:08.841691  6881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f00a2e87e56452083b759f60d461ee3" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 12 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:08.830559  6874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ba5dac66ab5497e9e336f2a3c28cda5" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:08.842576  6874 raft_consensus.cc:2468] T 7ba5dac66ab5497e9e336f2a3c28cda5 P cd75a17ab2604397adab03bb8b5fd75c [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in term 11.
I20260709 13:20:08.834187 10931 raft_consensus.cc:493] T bd6869f07b5a4885a0b99fbe60c3b175 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 11 FOLLOWER]: Starting leader election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:20:08.844069 10931 raft_consensus.cc:3060] T bd6869f07b5a4885a0b99fbe60c3b175 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:20:08.844436  6802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "404190ce4ce94cecbfcb6ea9d1dd8626" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:20:08.845110  6802 raft_consensus.cc:3060] T 404190ce4ce94cecbfcb6ea9d1dd8626 P b7ab4784c7344b939bc36f639286f377 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:08.845099  6725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e31b9971c15848dea59d4d4130141d9e" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:08.846382  6804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8292e16e5654be6bc408560cf256aaa" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:20:08.847047  6725 raft_consensus.cc:2368] T e31b9971c15848dea59d4d4130141d9e P ccd8a4c3bfe3413cb2ae219b09aea832 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c for earlier term 8. Current term is 9.
I20260709 13:20:08.847838 10938 raft_consensus.cc:2749] T 9b3759de40694069b13c0f8bd40e5709 P b7ab4784c7344b939bc36f639286f377 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:20:08.847944  6772 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 140069us
I20260709 13:20:08.849500  6772 leader_election.cc:304] T 30e88460611e47b2ba16a46a30b5f416 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:20:08.849689  6803 raft_consensus.cc:1275] T 7ba5dac66ab5497e9e336f2a3c28cda5 P b7ab4784c7344b939bc36f639286f377 [term 12 FOLLOWER]: Refusing update from remote peer 7ba59cc884714e8aa5f3f0ecaed84cbb: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:20:08.847863  6725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4b8bd455d5a47c18a1380839c6e0d61" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:20:08.851035  6772 leader_election.cc:304] T 713b5728a197487c9300b310ab94e5a3 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:20:08.851838  6725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a485a995abc4807b6e511e45419f737" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:08.853001  6725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "427c124d773f483294511e80fe340075" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:08.854596  6874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f00a2e87e56452083b759f60d461ee3" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 12 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:20:08.854725  6804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3f13b31a1f84f0d89d007eadd57924c" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:20:08.855438  6804 raft_consensus.cc:3060] T b3f13b31a1f84f0d89d007eadd57924c P b7ab4784c7344b939bc36f639286f377 [term 9 FOLLOWER]: Advancing to term 11
I20260709 13:20:08.853902  6772 leader_election.cc:304] T a3022224cc81473690653a83d4e99470 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:20:08.857110  6803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "404190ce4ce94cecbfcb6ea9d1dd8626" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:20:08.857705  6731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a75bfe094d4bdc963aba3f08dfcd25" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
W20260709 13:20:08.859830  6697 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.68:45071, user_credentials={real_user=slave}} blocked reactor thread for 55336.4us
I20260709 13:20:08.860957  6697 leader_election.cc:304] T bb3d8792045a4583ae2e965b1350a5b4 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:20:08.822307 10650 raft_consensus.cc:740] T bb7fa124c3bf4ef9ab65a407cb008441 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 7ba59cc884714e8aa5f3f0ecaed84cbb, State: Running, Role: LEADER
I20260709 13:20:08.875497  6880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ba5dac66ab5497e9e336f2a3c28cda5" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:20:08.876603  6880 raft_consensus.cc:3060] T 7ba5dac66ab5497e9e336f2a3c28cda5 P cd75a17ab2604397adab03bb8b5fd75c [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:20:08.876884  6770 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 137595us
I20260709 13:20:08.876614  6877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24ee15416e3145beaa1b8183453729a3" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 12 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:08.878083  6877 raft_consensus.cc:2468] T 24ee15416e3145beaa1b8183453729a3 P cd75a17ab2604397adab03bb8b5fd75c [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in term 11.
W20260709 13:20:08.894182  7467 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:08.899398  6805 raft_consensus.cc:1275] T 17587d6730594da4a56fa13a353232a1 P b7ab4784c7344b939bc36f639286f377 [term 15 FOLLOWER]: Refusing update from remote peer 7ba59cc884714e8aa5f3f0ecaed84cbb: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:20:08.815929 10621 consensus_queue.cc:260] T 4f00a2e87e56452083b759f60d461ee3 P cd75a17ab2604397adab03bb8b5fd75c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:20:08.898710 10580 raft_consensus.cc:2749] T bb3d8792045a4583ae2e965b1350a5b4 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:20:08.913926 10972 consensus_queue.cc:1059] T 17587d6730594da4a56fa13a353232a1 P 7ba59cc884714e8aa5f3f0ecaed84cbb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: INVALID_TERM, Last received: 13.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.021s
I20260709 13:20:08.921857  6725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab432e62819d499eaaf3dd55481dd930" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 13 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:08.859601 10967 raft_consensus.cc:2749] T 30e88460611e47b2ba16a46a30b5f416 P b7ab4784c7344b939bc36f639286f377 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:20:08.883575 10785 raft_consensus.cc:2749] T 713b5728a197487c9300b310ab94e5a3 P b7ab4784c7344b939bc36f639286f377 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:20:08.893539 10160 consensus_queue.cc:1048] T 853ac0a8cbd64ce99457f170216d4d0f P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.055s
I20260709 13:20:08.948194  6770 leader_election.cc:304] T e31b9971c15848dea59d4d4130141d9e P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
I20260709 13:20:08.943882  6798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7887766dc6784fcaa42b35c05fea7a99" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:20:08.944896 10650 consensus_queue.cc:260] T bb7fa124c3bf4ef9ab65a407cb008441 P 7ba59cc884714e8aa5f3f0ecaed84cbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:20:08.985844  6731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "853ac0a8cbd64ce99457f170216d4d0f" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:08.986868  6731 raft_consensus.cc:2468] T 853ac0a8cbd64ce99457f170216d4d0f P ccd8a4c3bfe3413cb2ae219b09aea832 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 8.
I20260709 13:20:08.989931  6805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34f36d59d88f40fe8a2805e604fc6c0a" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:20:08.830140 10988 consensus_queue.cc:237] T 7a734b5ab7834e05a8c422208acc58b1 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.4, Last appended by leader: 4, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:09.000136  6726 raft_consensus.cc:2468] T b3f13b31a1f84f0d89d007eadd57924c P ccd8a4c3bfe3413cb2ae219b09aea832 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in term 11.
W20260709 13:20:08.996250  6772 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 142411us
W20260709 13:20:09.001407  6770 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 53315.4us
I20260709 13:20:09.004262  6772 leader_election.cc:304] T 3a485a995abc4807b6e511e45419f737 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:20:09.009790  6731 raft_consensus.cc:1240] T 4275cf08e63345f993bce8664eada830 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 12 LEADER]: Rejecting Update request from peer cd75a17ab2604397adab03bb8b5fd75c for earlier term 11. Current term is 12. Ops: []
I20260709 13:20:09.010459  6772 leader_election.cc:304] T a1704639a875409b9959353527b3fd68 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:20:09.015182  6732 raft_consensus.cc:1240] T 20f6842e26174571996b8dea4151d4be P ccd8a4c3bfe3413cb2ae219b09aea832 [term 13 FOLLOWER]: Rejecting Update request from peer cd75a17ab2604397adab03bb8b5fd75c for earlier term 12. Current term is 13. Ops: []
W20260709 13:20:09.016140  6697 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.68:45071, user_credentials={real_user=slave}} blocked reactor thread for 155295us
I20260709 13:20:09.018008  6772 leader_election.cc:304] T 711ef6523deb4cbe8ef2ba61e1c21c98 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:20:09.019678 10969 consensus_queue.cc:1048] T 1bf4668eeb70467fb3dc5a0289233b3c P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.009s
I20260709 13:20:09.019832  6805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17587d6730594da4a56fa13a353232a1" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:20:09.019760 10695 consensus_queue.cc:1048] T 8c7f33e544204fbaac4078e3e83bbf4e P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:20:09.019908 10708 raft_consensus.cc:2749] T a1704639a875409b9959353527b3fd68 P b7ab4784c7344b939bc36f639286f377 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:20:09.022991 10777 raft_consensus.cc:515] T 07a92dd554674067a83a9cb68c4773f2 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:09.023501 10487 consensus_queue.cc:1048] T b56bf91d90824c959e21e0cee5ba1816 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:20:09.023962 10700 raft_consensus.cc:515] T 7c44c4849aa54f2b94d1f1bef9ed546f P ccd8a4c3bfe3413cb2ae219b09aea832 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:09.009024 10650 raft_consensus.cc:3060] T bb7fa124c3bf4ef9ab65a407cb008441 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:20:09.026562  6724 raft_consensus.cc:2468] T 4b8cacb381b746da8d0049b0a83b41dd P ccd8a4c3bfe3413cb2ae219b09aea832 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in term 12.
I20260709 13:20:09.003562  6878 raft_consensus.cc:2468] T bb7fa124c3bf4ef9ab65a407cb008441 P cd75a17ab2604397adab03bb8b5fd75c [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 11.
W20260709 13:20:09.029163  6844 connection.cc:256] RPC call timeout handler was delayed by -2.4916151919999265s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1595s for a response
I20260709 13:20:09.029855  6727 raft_consensus.cc:2468] T 404190ce4ce94cecbfcb6ea9d1dd8626 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in term 13.
W20260709 13:20:09.052525  6844 connection.cc:256] RPC call timeout handler was delayed by -2.4835151919999134s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16040000000000001s for a response
I20260709 13:20:09.052675  6874 raft_consensus.cc:1240] T bb7fa124c3bf4ef9ab65a407cb008441 P cd75a17ab2604397adab03bb8b5fd75c [term 11 FOLLOWER]: Rejecting Update request from peer 7ba59cc884714e8aa5f3f0ecaed84cbb for earlier term 10. Current term is 11. Ops: []
I20260709 13:20:09.052793  6726 raft_consensus.cc:1240] T 4b8cacb381b746da8d0049b0a83b41dd P ccd8a4c3bfe3413cb2ae219b09aea832 [term 12 FOLLOWER]: Rejecting Update request from peer cd75a17ab2604397adab03bb8b5fd75c for earlier term 11. Current term is 12. Ops: []
I20260709 13:20:09.031177  6880 raft_consensus.cc:2468] T 7ba5dac66ab5497e9e336f2a3c28cda5 P cd75a17ab2604397adab03bb8b5fd75c [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in term 12.
I20260709 13:20:09.005292 10967 raft_consensus.cc:2804] T e31b9971c15848dea59d4d4130141d9e P b7ab4784c7344b939bc36f639286f377 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:20:09.033126  7466 leader_election.cc:304] T b3f13b31a1f84f0d89d007eadd57924c P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
I20260709 13:20:09.044144  6879 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53416 (request call id 2827) took 1334 ms. Trace:
I20260709 13:20:09.045717  6805 raft_consensus.cc:3060] T 17587d6730594da4a56fa13a353232a1 P b7ab4784c7344b939bc36f639286f377 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:09.018697 10621 raft_consensus.cc:3060] T 4f00a2e87e56452083b759f60d461ee3 P cd75a17ab2604397adab03bb8b5fd75c [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:20:09.052994  6844 connection.cc:256] RPC call timeout handler was delayed by -2.4412151920000724s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16510000000000002s for a response
I20260709 13:20:09.076339  6730 raft_consensus.cc:1240] T 07a92dd554674067a83a9cb68c4773f2 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 11 FOLLOWER]: Rejecting Update request from peer b7ab4784c7344b939bc36f639286f377 for earlier term 10. Current term is 11. Ops: []
W20260709 13:20:09.076504  6844 connection.cc:256] RPC call timeout handler was delayed by -2.3638151919999473s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17370000000000002s for a response
W20260709 13:20:09.076872  6844 connection.cc:256] RPC call timeout handler was delayed by -2.3584151919999385s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1743s for a response
W20260709 13:20:09.077188  6844 connection.cc:256] RPC call timeout handler was delayed by -2.2783151920000364s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18320000000000003s for a response
W20260709 13:20:09.077559  6844 connection.cc:256] RPC call timeout handler was delayed by -2.15231519200006s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19720000000000001s for a response
W20260709 13:20:09.077943  6844 connection.cc:256] RPC call timeout handler was delayed by -2.144215192000047s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19810000000000003s for a response
W20260709 13:20:09.078300  6844 connection.cc:256] RPC call timeout handler was delayed by -2.0902151919999596s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2041s for a response
W20260709 13:20:09.078671  6844 connection.cc:256] RPC call timeout handler was delayed by -2.0236151920000793s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21150000000000002s for a response
W20260709 13:20:09.079025  6844 connection.cc:256] RPC call timeout handler was delayed by -2.0083151920000546s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21320000000000003s for a response
W20260709 13:20:09.079306  6844 connection.cc:256] RPC call timeout handler was delayed by -1.9885151920000226s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2154s for a response
W20260709 13:20:09.079562  6844 connection.cc:256] RPC call timeout handler was delayed by -1.9606151919999775s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21850000000000003s for a response
I20260709 13:20:09.035367  6798 raft_consensus.cc:2468] T 7887766dc6784fcaa42b35c05fea7a99 P b7ab4784c7344b939bc36f639286f377 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 11.
I20260709 13:20:09.081013  6798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "711ef6523deb4cbe8ef2ba61e1c21c98" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:09.080897 10983 raft_consensus.cc:515] T ab432e62819d499eaaf3dd55481dd930 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:09.082463  6728 raft_consensus.cc:1240] T ab432e62819d499eaaf3dd55481dd930 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 13 FOLLOWER]: Rejecting Update request from peer b7ab4784c7344b939bc36f639286f377 for earlier term 12. Current term is 13. Ops: []
W20260709 13:20:09.083937  6697 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.68:45071, user_credentials={real_user=slave}} blocked reactor thread for 43924.6us
I20260709 13:20:09.072569  6879 rpcz_store.cc:276] 0709 13:20:07.709622 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:07.709767 (+   145us) service_pool.cc:224] Handling call
0709 13:20:09.043889 (+1334122us) spinlock_profiling.cc:243] Waited 629 ms on lock 0x7b5400218ed4. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f9ae2fa 00007fcc1496fb17 00007fcc0deea6d4 00007fcc0deea662 00007fcc0deea591 00007fcc0deea50c 00007fcc0dee97c2 00007fcc0dce548c 00007fcc0dce48c6 00007fcc0dce426f
0709 13:20:09.044062 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1447006080}
I20260709 13:20:09.086907  6803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20f6842e26174571996b8dea4151d4be" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:20:09.087163  6697 leader_election.cc:304] T 1528ab62b6fe4e3099d08f141afee116 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, b7ab4784c7344b939bc36f639286f377
I20260709 13:20:09.087549  6804 raft_consensus.cc:2468] T b3f13b31a1f84f0d89d007eadd57924c P b7ab4784c7344b939bc36f639286f377 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in term 11.
W20260709 13:20:09.079833  6844 connection.cc:256] RPC call timeout handler was delayed by -1.8445151920000171s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.23140000000000002s for a response
I20260709 13:20:09.089169  6806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c44c4849aa54f2b94d1f1bef9ed546f" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:09.088577  6803 raft_consensus.cc:3060] T 20f6842e26174571996b8dea4151d4be P b7ab4784c7344b939bc36f639286f377 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:09.088452  6844 leader_election.cc:304] T 07a92dd554674067a83a9cb68c4773f2 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:20:09.049384 10249 raft_consensus.cc:2749] T 711ef6523deb4cbe8ef2ba61e1c21c98 P b7ab4784c7344b939bc36f639286f377 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:20:09.090173  7466 leader_election.cc:304] T 4b8cacb381b746da8d0049b0a83b41dd P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
I20260709 13:20:09.095062  6804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34f36d59d88f40fe8a2805e604fc6c0a" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:09.066676 10930 raft_consensus.cc:2749] T 4b8cacb381b746da8d0049b0a83b41dd P ccd8a4c3bfe3413cb2ae219b09aea832 [term 12 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:20:09.095355  7466 leader_election.cc:304] T 404190ce4ce94cecbfcb6ea9d1dd8626 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
I20260709 13:20:09.069257 10913 leader_election.cc:290] T f09c2a98de1a4decabd0ff900dd44caa P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 13 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:20:09.101300  6697 leader_election.cc:304] T ce4f062dcd314d43a63ca74067cb5ee3 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, b7ab4784c7344b939bc36f639286f377
W20260709 13:20:09.104504  6846 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:09.050094 10534 consensus_queue.cc:1059] T d8292e16e5654be6bc408560cf256aaa P b7ab4784c7344b939bc36f639286f377 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.043s
I20260709 13:20:09.108759  6806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c37d41cd9164c15a6826ca62a851a69" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:09.105549  6697 leader_election.cc:304] T b3f13b31a1f84f0d89d007eadd57924c P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: b7ab4784c7344b939bc36f639286f377
I20260709 13:20:09.092440 10160 raft_consensus.cc:2804] T 3a485a995abc4807b6e511e45419f737 P b7ab4784c7344b939bc36f639286f377 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:20:09.099788 10936 raft_consensus.cc:2749] T 1528ab62b6fe4e3099d08f141afee116 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:20:09.093405 10860 raft_consensus.cc:2804] T b3f13b31a1f84f0d89d007eadd57924c P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:20:09.116809  6844 leader_election.cc:304] T 90d42e216d9741e190bca19a781291fd P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:20:09.084254 10418 consensus_queue.cc:1059] T 34f36d59d88f40fe8a2805e604fc6c0a P b7ab4784c7344b939bc36f639286f377 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.036s
I20260709 13:20:09.118880  6805 raft_consensus.cc:2468] T 17587d6730594da4a56fa13a353232a1 P b7ab4784c7344b939bc36f639286f377 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 16.
I20260709 13:20:09.076205 10985 consensus_queue.cc:1048] T 7ba5dac66ab5497e9e336f2a3c28cda5 P 7ba59cc884714e8aa5f3f0ecaed84cbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.219s
I20260709 13:20:09.129953  6802 raft_consensus.cc:2468] T 404190ce4ce94cecbfcb6ea9d1dd8626 P b7ab4784c7344b939bc36f639286f377 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in term 13.
I20260709 13:20:09.089934 10967 raft_consensus.cc:697] T e31b9971c15848dea59d4d4130141d9e P b7ab4784c7344b939bc36f639286f377 [term 9 LEADER]: Becoming Leader. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
I20260709 13:20:09.132025  6802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a75bfe094d4bdc963aba3f08dfcd25" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:09.125759  6873 raft_consensus.cc:2410] T 4b8cacb381b746da8d0049b0a83b41dd P cd75a17ab2604397adab03bb8b5fd75c [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ba59cc884714e8aa5f3f0ecaed84cbb for term 12 because replica has last-logged OpId of term: 11 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 9.
I20260709 13:20:09.133143 11006 raft_consensus.cc:2749] T fe20b4b48823486ca3b9c648db6ce8aa P cd75a17ab2604397adab03bb8b5fd75c [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:20:09.133657 10700 leader_election.cc:290] T 7c44c4849aa54f2b94d1f1bef9ed546f P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 13 election: Requested vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:09.133924  6802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3411566abe2d4c9bb4b2adfdd05e6f17" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:20:09.134321 10534 consensus_queue.cc:1243] T d8292e16e5654be6bc408560cf256aaa P b7ab4784c7344b939bc36f639286f377 [LEADER]: Peer ccd8a4c3bfe3413cb2ae219b09aea832 log is divergent from this leader: its last log entry 13.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:20:09.134912 10534 raft_consensus.cc:3055] T d8292e16e5654be6bc408560cf256aaa P b7ab4784c7344b939bc36f639286f377 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:20:09.135200 10534 raft_consensus.cc:740] T d8292e16e5654be6bc408560cf256aaa P b7ab4784c7344b939bc36f639286f377 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
I20260709 13:20:09.135926 10534 consensus_queue.cc:260] T d8292e16e5654be6bc408560cf256aaa P b7ab4784c7344b939bc36f639286f377 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:09.136137 10832 raft_consensus.cc:515] T 3d65025eea89441290d85dd053810e31 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:09.137111 10534 raft_consensus.cc:3060] T d8292e16e5654be6bc408560cf256aaa P b7ab4784c7344b939bc36f639286f377 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:09.138214 10832 leader_election.cc:290] T 3d65025eea89441290d85dd053810e31 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 10 election: Requested vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:09.138852  6723 raft_consensus.cc:1240] T 3d65025eea89441290d85dd053810e31 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 10 FOLLOWER]: Rejecting Update request from peer b7ab4784c7344b939bc36f639286f377 for earlier term 9. Current term is 10. Ops: []
I20260709 13:20:09.140655  6875 raft_consensus.cc:1240] T fe20b4b48823486ca3b9c648db6ce8aa P cd75a17ab2604397adab03bb8b5fd75c [term 9 FOLLOWER]: Rejecting Update request from peer 7ba59cc884714e8aa5f3f0ecaed84cbb for earlier term 8. Current term is 9. Ops: []
I20260709 13:20:09.132234 11022 raft_consensus.cc:2749] T 07a92dd554674067a83a9cb68c4773f2 P cd75a17ab2604397adab03bb8b5fd75c [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:20:09.108526 10794 raft_consensus.cc:2749] T ce4f062dcd314d43a63ca74067cb5ee3 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:20:09.125240  6695 leader_election.cc:304] T 7887766dc6784fcaa42b35c05fea7a99 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
I20260709 13:20:09.100080 10915 raft_consensus.cc:2804] T 4b8cacb381b746da8d0049b0a83b41dd P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 12 FOLLOWER]: Leader election won for term 12
W20260709 13:20:09.150053  6697 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.68:45071, user_credentials={real_user=slave}} blocked reactor thread for 44598.1us
I20260709 13:20:09.148528 10860 raft_consensus.cc:697] T b3f13b31a1f84f0d89d007eadd57924c P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 11 LEADER]: Becoming Leader. State: Replica: 7ba59cc884714e8aa5f3f0ecaed84cbb, State: Running, Role: LEADER
I20260709 13:20:09.142475  6802 raft_consensus.cc:2468] T 3411566abe2d4c9bb4b2adfdd05e6f17 P b7ab4784c7344b939bc36f639286f377 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 9.
I20260709 13:20:09.143448  6725 raft_consensus.cc:1275] T 22ccee1b570c4ad3a57bd7aec085b1b4 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 10 FOLLOWER]: Refusing update from remote peer b7ab4784c7344b939bc36f639286f377: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:20:09.141463  6807 raft_consensus.cc:2468] T 4f00a2e87e56452083b759f60d461ee3 P b7ab4784c7344b939bc36f639286f377 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in term 12.
I20260709 13:20:09.142704  6806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4db81d9d329422bb3b4160ca4ac2d1d" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:20:09.127324 10972 raft_consensus.cc:2804] T 404190ce4ce94cecbfcb6ea9d1dd8626 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:20:09.150122  6805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4b8bd455d5a47c18a1380839c6e0d61" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:20:09.154873  6725 raft_consensus.cc:1275] T d33d5ee8ef6f415593d8df52063161ad P ccd8a4c3bfe3413cb2ae219b09aea832 [term 12 FOLLOWER]: Refusing update from remote peer b7ab4784c7344b939bc36f639286f377: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:20:09.155926  6806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e31b9971c15848dea59d4d4130141d9e" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:09.157119  6807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a485a995abc4807b6e511e45419f737" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:09.157745  6802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb7fa124c3bf4ef9ab65a407cb008441" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:09.168967  6802 raft_consensus.cc:2393] T bb7fa124c3bf4ef9ab65a407cb008441 P b7ab4784c7344b939bc36f639286f377 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c in current term 11: Already voted for candidate b7ab4784c7344b939bc36f639286f377 in this term.
I20260709 13:20:09.153403  6697 leader_election.cc:304] T 3fa34c08b205435dba97346991aa1f92 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:20:09.165238  6803 raft_consensus.cc:2468] T 20f6842e26174571996b8dea4151d4be P b7ab4784c7344b939bc36f639286f377 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 13.
W20260709 13:20:09.172878  6695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 47736.7us
I20260709 13:20:09.173470  6803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "853ac0a8cbd64ce99457f170216d4d0f" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:09.173678  6807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab432e62819d499eaaf3dd55481dd930" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 13 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
W20260709 13:20:09.179530  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 62857.5us
I20260709 13:20:09.180514  6844 leader_election.cc:304] T bd6869f07b5a4885a0b99fbe60c3b175 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:20:09.181208  6697 leader_election.cc:304] T be1a92657f494cac8dd227d152f50151 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, b7ab4784c7344b939bc36f639286f377
W20260709 13:20:09.164507 10998 consensus_meta.cc:287] T 90d42e216d9741e190bca19a781291fd P ccd8a4c3bfe3413cb2ae219b09aea832: Time spent flushing consensus metadata: real 0.550s	user 0.005s	sys 0.019s
I20260709 13:20:09.183275  6805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "427c124d773f483294511e80fe340075" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:09.180286  6695 leader_election.cc:304] T 17587d6730594da4a56fa13a353232a1 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
I20260709 13:20:09.186648  6844 leader_election.cc:304] T 3d65025eea89441290d85dd053810e31 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:20:09.188864  6806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ba5dac66ab5497e9e336f2a3c28cda5" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:09.189723  6806 raft_consensus.cc:2393] T 7ba5dac66ab5497e9e336f2a3c28cda5 P b7ab4784c7344b939bc36f639286f377 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c in current term 12: Already voted for candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in this term.
I20260709 13:20:09.163852 11022 raft_consensus.cc:2749] T 90d42e216d9741e190bca19a781291fd P cd75a17ab2604397adab03bb8b5fd75c [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:20:09.158931 10972 raft_consensus.cc:697] T 404190ce4ce94cecbfcb6ea9d1dd8626 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 13 LEADER]: Becoming Leader. State: Replica: 7ba59cc884714e8aa5f3f0ecaed84cbb, State: Running, Role: LEADER
I20260709 13:20:09.161106 10727 raft_consensus.cc:3055] T 711ef6523deb4cbe8ef2ba61e1c21c98 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:20:09.194011  6872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "853ac0a8cbd64ce99457f170216d4d0f" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:09.142272 11012 raft_consensus.cc:515] T 8c7f33e544204fbaac4078e3e83bbf4e P ccd8a4c3bfe3413cb2ae219b09aea832 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:09.202914  6872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8292e16e5654be6bc408560cf256aaa" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:20:09.203501  6872 raft_consensus.cc:3060] T d8292e16e5654be6bc408560cf256aaa P cd75a17ab2604397adab03bb8b5fd75c [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:09.194352  6878 raft_consensus.cc:1275] T f58dc08b12a2494bb9a1372837970ca2 P cd75a17ab2604397adab03bb8b5fd75c [term 13 FOLLOWER]: Refusing update from remote peer ccd8a4c3bfe3413cb2ae219b09aea832: Log matching property violated. Preceding OpId in replica: term: 12 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 13:20:09.178582 10987 raft_consensus.cc:2804] T a3022224cc81473690653a83d4e99470 P b7ab4784c7344b939bc36f639286f377 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:20:09.170926 10915 raft_consensus.cc:697] T 4b8cacb381b746da8d0049b0a83b41dd P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 12 LEADER]: Becoming Leader. State: Replica: 7ba59cc884714e8aa5f3f0ecaed84cbb, State: Running, Role: LEADER
I20260709 13:20:09.208166  6878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24ee15416e3145beaa1b8183453729a3" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:20:09.208752  6878 raft_consensus.cc:3060] T 24ee15416e3145beaa1b8183453729a3 P cd75a17ab2604397adab03bb8b5fd75c [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:20:09.209021 10915 consensus_queue.cc:237] T 4b8cacb381b746da8d0049b0a83b41dd P 7ba59cc884714e8aa5f3f0ecaed84cbb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:20:09.208998  6872 raft_consensus.cc:2468] T d8292e16e5654be6bc408560cf256aaa P cd75a17ab2604397adab03bb8b5fd75c [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 15.
I20260709 13:20:09.214093  6872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7887766dc6784fcaa42b35c05fea7a99" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:20:09.216051  6872 raft_consensus.cc:2393] T 7887766dc6784fcaa42b35c05fea7a99 P cd75a17ab2604397adab03bb8b5fd75c [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate ccd8a4c3bfe3413cb2ae219b09aea832 in current term 11: Already voted for candidate cd75a17ab2604397adab03bb8b5fd75c in this term.
I20260709 13:20:09.164893 11023 raft_consensus.cc:2764] T b3f13b31a1f84f0d89d007eadd57924c P ccd8a4c3bfe3413cb2ae219b09aea832 [term 11 FOLLOWER]: Leader election decision vote started in defunct term 10: won
I20260709 13:20:09.217223  6878 raft_consensus.cc:2468] T 24ee15416e3145beaa1b8183453729a3 P cd75a17ab2604397adab03bb8b5fd75c [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 12.
I20260709 13:20:09.153004 10931 raft_consensus.cc:515] T bd6869f07b5a4885a0b99fbe60c3b175 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:09.186648 10936 raft_consensus.cc:2804] T 7887766dc6784fcaa42b35c05fea7a99 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:20:09.218405  6879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bf4668eeb70467fb3dc5a0289233b3c" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:09.203086 10921 raft_consensus.cc:2749] T 3d65025eea89441290d85dd053810e31 P cd75a17ab2604397adab03bb8b5fd75c [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:20:09.155792 11008 raft_consensus.cc:515] T 3fa34c08b205435dba97346991aa1f92 P cd75a17ab2604397adab03bb8b5fd75c [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:20:09.199168 10692 raft_consensus.cc:2804] T 17587d6730594da4a56fa13a353232a1 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:20:09.186127 11006 raft_consensus.cc:2749] T bd6869f07b5a4885a0b99fbe60c3b175 P cd75a17ab2604397adab03bb8b5fd75c [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:20:09.191016 10794 raft_consensus.cc:2749] T 3fa34c08b205435dba97346991aa1f92 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:20:09.188141 10998 raft_consensus.cc:515] T 90d42e216d9741e190bca19a781291fd P ccd8a4c3bfe3413cb2ae219b09aea832 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:09.203225 10727 raft_consensus.cc:740] T 711ef6523deb4cbe8ef2ba61e1c21c98 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
I20260709 13:20:09.131790 10967 consensus_queue.cc:237] T e31b9971c15848dea59d4d4130141d9e P b7ab4784c7344b939bc36f639286f377 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:09.234611  6879 raft_consensus.cc:2468] T 1bf4668eeb70467fb3dc5a0289233b3c P cd75a17ab2604397adab03bb8b5fd75c [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 11.
W20260709 13:20:09.232241  7468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 144217us
I20260709 13:20:09.183959 11010 raft_consensus.cc:515] T 9e326172347f45e99a0d482b5d8ef768 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
W20260709 13:20:09.347961  7467 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:09.190279  6803 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4275cf08e63345f993bce8664eada830"
dest_uuid: "b7ab4784c7344b939bc36f639286f377"
mode: GRACEFUL
new_leader_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
 from {username='slave'} at 127.0.0.1:38240
I20260709 13:20:09.674732  6803 raft_consensus.cc:606] T 4275cf08e63345f993bce8664eada830 P b7ab4784c7344b939bc36f639286f377 [term 12 FOLLOWER]: Received request to transfer leadership to TS cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:20:09.675149  6803 raft_consensus.cc:614] T 4275cf08e63345f993bce8664eada830 P b7ab4784c7344b939bc36f639286f377 [term 12 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:20:09.236737 10936 raft_consensus.cc:697] T 7887766dc6784fcaa42b35c05fea7a99 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 11 LEADER]: Becoming Leader. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
I20260709 13:20:09.280556 10777 leader_election.cc:290] T 07a92dd554674067a83a9cb68c4773f2 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 11 election: Requested vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
W20260709 13:20:09.503872  6773 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:09.676735  6806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c44c4849aa54f2b94d1f1bef9ed546f" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:20:09.540307 10692 raft_consensus.cc:697] T 17587d6730594da4a56fa13a353232a1 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 16 LEADER]: Becoming Leader. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
W20260709 13:20:09.539623  7466 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 444131us
I20260709 13:20:09.151937 10860 consensus_queue.cc:237] T b3f13b31a1f84f0d89d007eadd57924c P 7ba59cc884714e8aa5f3f0ecaed84cbb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:20:09.191977 10920 raft_consensus.cc:2749] T be1a92657f494cac8dd227d152f50151 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:20:09.496227 10972 consensus_queue.cc:237] T 404190ce4ce94cecbfcb6ea9d1dd8626 P 7ba59cc884714e8aa5f3f0ecaed84cbb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:20:09.669721  6876 raft_consensus.cc:2368] T 3fa34c08b205435dba97346991aa1f92 P cd75a17ab2604397adab03bb8b5fd75c [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 7ba59cc884714e8aa5f3f0ecaed84cbb for earlier term 12. Current term is 13.
I20260709 13:20:09.224777  6872 raft_consensus.cc:1275] T 7c37d41cd9164c15a6826ca62a851a69 P cd75a17ab2604397adab03bb8b5fd75c [term 10 FOLLOWER]: Refusing update from remote peer ccd8a4c3bfe3413cb2ae219b09aea832: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:20:09.237826  6844 leader_election.cc:400] T d8292e16e5654be6bc408560cf256aaa P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 13 pre-election: Vote denied by peer b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817) with higher term. Message: Invalid argument: T d8292e16e5654be6bc408560cf256aaa P b7ab4784c7344b939bc36f639286f377 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c for earlier term 13. Current term is 14.
I20260709 13:20:09.682513  6731 raft_consensus.cc:1240] T 90d42e216d9741e190bca19a781291fd P ccd8a4c3bfe3413cb2ae219b09aea832 [term 11 FOLLOWER]: Rejecting Update request from peer b7ab4784c7344b939bc36f639286f377 for earlier term 10. Current term is 11. Ops: []
W20260709 13:20:09.690361  7466 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:09.692814  6805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d65025eea89441290d85dd053810e31" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:20:09.693603 10986 raft_consensus.cc:3055] T 17587d6730594da4a56fa13a353232a1 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:20:09.693415  6806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a92dd554674067a83a9cb68c4773f2" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:20:09.694271  6874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4db81d9d329422bb3b4160ca4ac2d1d" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:20:09.695746  6726 raft_consensus.cc:1275] T f3f9c2e2bf644115957398fe4c9459db P ccd8a4c3bfe3413cb2ae219b09aea832 [term 11 FOLLOWER]: Refusing update from remote peer b7ab4784c7344b939bc36f639286f377: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
W20260709 13:20:09.696214 11028 log.cc:927] Time spent T a3022224cc81473690653a83d4e99470 P b7ab4784c7344b939bc36f639286f377: Append to log took a long time: real 0.416s	user 0.000s	sys 0.009s
I20260709 13:20:09.696622 10983 leader_election.cc:290] T ab432e62819d499eaaf3dd55481dd930 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 13 election: Requested vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:09.700582 11026 raft_consensus.cc:3055] T 34f36d59d88f40fe8a2805e604fc6c0a P b7ab4784c7344b939bc36f639286f377 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:20:09.704464  6879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34f36d59d88f40fe8a2805e604fc6c0a" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:20:09.709360 11030 raft_consensus.cc:493] T f5be3a11b23d4ea9b08300a2789821c7 P b7ab4784c7344b939bc36f639286f377 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:20:09.727070  6879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c44c4849aa54f2b94d1f1bef9ed546f" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:20:09.727527 10998 leader_election.cc:290] T 90d42e216d9741e190bca19a781291fd P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 11 election: Requested vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:09.727437 11030 raft_consensus.cc:515] T f5be3a11b23d4ea9b08300a2789821c7 P b7ab4784c7344b939bc36f639286f377 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:09.728689  6879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe20b4b48823486ca3b9c648db6ce8aa" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:20:09.713704  6732 raft_consensus.cc:1240] T 9e326172347f45e99a0d482b5d8ef768 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 11 FOLLOWER]: Rejecting Update request from peer b7ab4784c7344b939bc36f639286f377 for earlier term 10. Current term is 11. Ops: []
I20260709 13:20:09.714826  6803 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4f00a2e87e56452083b759f60d461ee3"
dest_uuid: "b7ab4784c7344b939bc36f639286f377"
mode: GRACEFUL
new_leader_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
 from {username='slave'} at 127.0.0.1:38240
I20260709 13:20:09.733263  6803 raft_consensus.cc:606] T 4f00a2e87e56452083b759f60d461ee3 P b7ab4784c7344b939bc36f639286f377 [term 12 FOLLOWER]: Received request to transfer leadership to TS cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:20:09.733671  6803 raft_consensus.cc:614] T 4f00a2e87e56452083b759f60d461ee3 P b7ab4784c7344b939bc36f639286f377 [term 12 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:20:09.715811  6844 leader_election.cc:403] T d8292e16e5654be6bc408560cf256aaa P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 13 pre-election: Cancelling election due to peer responding with higher term
W20260709 13:20:09.735605  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 511399us
I20260709 13:20:09.736615  6844 leader_election.cc:304] T 713b5728a197487c9300b310ab94e5a3 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:20:09.715909  6878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20f6842e26174571996b8dea4151d4be" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:20:09.712574 10727 consensus_queue.cc:260] T 711ef6523deb4cbe8ef2ba61e1c21c98 P ccd8a4c3bfe3413cb2ae219b09aea832 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:09.741987 10727 raft_consensus.cc:3060] T 711ef6523deb4cbe8ef2ba61e1c21c98 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:20:09.741077 10921 raft_consensus.cc:2749] T d8292e16e5654be6bc408560cf256aaa P cd75a17ab2604397adab03bb8b5fd75c [term 15 FOLLOWER]: Leader pre-election lost for term 13. Reason: Vote denied by peer b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817) with higher term. Message: Invalid argument: T d8292e16e5654be6bc408560cf256aaa P b7ab4784c7344b939bc36f639286f377 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c for earlier term 13. Current term is 14.
I20260709 13:20:09.748575  6728 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50004 (request call id 2032) took 1007 ms. Trace:
I20260709 13:20:09.749122  6728 rpcz_store.cc:276] 0709 13:20:08.741062 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:08.741190 (+   128us) service_pool.cc:224] Handling call
0709 13:20:08.741520 (+   330us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:09.082867 (+341347us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:09.748230 (+665363us) spinlock_profiling.cc:243] Waited 341 ms on lock 0x7b5400058a54. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f9aae01 00007fcc0f9a983e 00007fcc1496e419 00007fcc0dee5bd4 00007fcc0dee5b62 00007fcc0dee5a91 00007fcc0dee5a0c 00007fcc0dee4cc2 00007fcc0dce548c 00007fcc0dce48c6
0709 13:20:09.748480 (+   250us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":783683968}
I20260709 13:20:09.753157  6803 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a3022224cc81473690653a83d4e99470"
dest_uuid: "b7ab4784c7344b939bc36f639286f377"
mode: GRACEFUL
new_leader_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
 from {username='slave'} at 127.0.0.1:38240
I20260709 13:20:09.754019  6803 raft_consensus.cc:606] T a3022224cc81473690653a83d4e99470 P b7ab4784c7344b939bc36f639286f377 [term 12 FOLLOWER]: Received request to transfer leadership to TS cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:20:09.754446  6803 raft_consensus.cc:614] T a3022224cc81473690653a83d4e99470 P b7ab4784c7344b939bc36f639286f377 [term 12 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:20:09.754693  6873 raft_consensus.cc:1275] T 3a485a995abc4807b6e511e45419f737 P cd75a17ab2604397adab03bb8b5fd75c [term 10 FOLLOWER]: Refusing update from remote peer ccd8a4c3bfe3413cb2ae219b09aea832: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:20:09.756436  6873 raft_consensus.cc:1275] T e77e330a82df4b43a745d57a68f6f057 P cd75a17ab2604397adab03bb8b5fd75c [term 14 FOLLOWER]: Refusing update from remote peer ccd8a4c3bfe3413cb2ae219b09aea832: Log matching property violated. Preceding OpId in replica: term: 11 index: 5. Preceding OpId from leader: term: 14 index: 7. (index mismatch)
I20260709 13:20:09.760941 10160 raft_consensus.cc:493] T 3a485a995abc4807b6e511e45419f737 P b7ab4784c7344b939bc36f639286f377 [term 10 FOLLOWER]: Starting leader election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:20:09.761637 10160 raft_consensus.cc:3060] T 3a485a995abc4807b6e511e45419f737 P b7ab4784c7344b939bc36f639286f377 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:20:09.767632 11017 log.cc:927] Time spent T 07a92dd554674067a83a9cb68c4773f2 P cd75a17ab2604397adab03bb8b5fd75c: Append to log took a long time: real 0.818s	user 0.008s	sys 0.000s
I20260709 13:20:09.772158  6876 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58592 (request call id 304) took 1003 ms. Trace:
I20260709 13:20:09.772292  6877 raft_consensus.cc:1240] T 3fa34c08b205435dba97346991aa1f92 P cd75a17ab2604397adab03bb8b5fd75c [term 13 FOLLOWER]: Rejecting Update request from peer 7ba59cc884714e8aa5f3f0ecaed84cbb for earlier term 12. Current term is 13. Ops: []
W20260709 13:20:09.788338 11019 log.cc:927] Time spent T 7c37d41cd9164c15a6826ca62a851a69 P ccd8a4c3bfe3413cb2ae219b09aea832: Append to log took a long time: real 0.788s	user 0.004s	sys 0.006s
I20260709 13:20:09.719369  7496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "404190ce4ce94cecbfcb6ea9d1dd8626" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb"
I20260709 13:20:09.720750  7498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17587d6730594da4a56fa13a353232a1" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb"
I20260709 13:20:09.721730  7502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe20b4b48823486ca3b9c648db6ce8aa" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb"
I20260709 13:20:09.722718 10986 raft_consensus.cc:740] T 17587d6730594da4a56fa13a353232a1 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 7ba59cc884714e8aa5f3f0ecaed84cbb, State: Running, Role: LEADER
I20260709 13:20:09.723136 11036 consensus_queue.cc:1048] T 17587d6730594da4a56fa13a353232a1 P 7ba59cc884714e8aa5f3f0ecaed84cbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.076s
W20260709 13:20:09.713155 10869 consensus_meta.cc:287] T c4db81d9d329422bb3b4160ca4ac2d1d P cd75a17ab2604397adab03bb8b5fd75c: Time spent flushing consensus metadata: real 0.952s	user 0.022s	sys 0.032s
I20260709 13:20:09.804405  6798 raft_consensus.cc:2393] T 711ef6523deb4cbe8ef2ba61e1c21c98 P b7ab4784c7344b939bc36f639286f377 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c in current term 12: Already voted for candidate b7ab4784c7344b939bc36f639286f377 in this term.
I20260709 13:20:09.724642  6874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d65025eea89441290d85dd053810e31" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
W20260709 13:20:09.712764  6846 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:09.716964  6872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3411566abe2d4c9bb4b2adfdd05e6f17" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:20:09.719731  7503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24ee15416e3145beaa1b8183453729a3" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb"
I20260709 13:20:09.873512  6874 raft_consensus.cc:3060] T 3d65025eea89441290d85dd053810e31 P cd75a17ab2604397adab03bb8b5fd75c [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:20:09.873883  7503 raft_consensus.cc:3060] T 24ee15416e3145beaa1b8183453729a3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:20:09.710137 10692 consensus_queue.cc:237] T 17587d6730594da4a56fa13a353232a1 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
W20260709 13:20:09.685889 10621 consensus_meta.cc:287] T 4f00a2e87e56452083b759f60d461ee3 P cd75a17ab2604397adab03bb8b5fd75c: Time spent flushing consensus metadata: real 0.603s	user 0.011s	sys 0.007s
I20260709 13:20:09.724823  7466 leader_election.cc:304] T 4f00a2e87e56452083b759f60d461ee3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, b7ab4784c7344b939bc36f639286f377; no voters: 
W20260709 13:20:09.797248 11034 log.cc:927] Time spent T 4b8cacb381b746da8d0049b0a83b41dd P 7ba59cc884714e8aa5f3f0ecaed84cbb: Append to log took a long time: real 0.132s	user 0.000s	sys 0.001s
I20260709 13:20:09.873862  6872 raft_consensus.cc:2393] T 3411566abe2d4c9bb4b2adfdd05e6f17 P cd75a17ab2604397adab03bb8b5fd75c [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate ccd8a4c3bfe3413cb2ae219b09aea832 in current term 9: Already voted for candidate cd75a17ab2604397adab03bb8b5fd75c in this term.
I20260709 13:20:09.833038 11010 leader_election.cc:290] T 9e326172347f45e99a0d482b5d8ef768 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 11 election: Requested vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:09.845369  6876 rpcz_store.cc:276] 0709 13:20:08.768929 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:08.776835 (+  7906us) service_pool.cc:224] Handling call
0709 13:20:09.771908 (+995073us) spinlock_profiling.cc:243] Waited 572 ms on lock 0x7b54001428d4. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f9ae2fa 00007fcc1496fb17 00007fcc0deea6d4 00007fcc0deea662 00007fcc0deea591 00007fcc0deea50c 00007fcc0dee97c2 00007fcc0dce548c 00007fcc0dce48c6 00007fcc0dce426f
0709 13:20:09.772091 (+   183us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1315185408}
I20260709 13:20:09.726145 11026 raft_consensus.cc:740] T 34f36d59d88f40fe8a2805e604fc6c0a P b7ab4784c7344b939bc36f639286f377 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
W20260709 13:20:09.899398  6801 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.806s	user 0.002s	sys 0.014s
I20260709 13:20:09.897305  7502 raft_consensus.cc:2393] T fe20b4b48823486ca3b9c648db6ce8aa P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate ccd8a4c3bfe3413cb2ae219b09aea832 in current term 10: Already voted for candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in this term.
I20260709 13:20:09.708709 11006 raft_consensus.cc:493] T 7887766dc6784fcaa42b35c05fea7a99 P cd75a17ab2604397adab03bb8b5fd75c [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:20:09.942652  7466 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 217911us
W20260709 13:20:09.964003  6801 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.870s	user 0.002s	sys 0.020s
I20260709 13:20:09.964804  6881 raft_consensus.cc:2410] T 4f00a2e87e56452083b759f60d461ee3 P cd75a17ab2604397adab03bb8b5fd75c [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ba59cc884714e8aa5f3f0ecaed84cbb for term 12 because replica has last-logged OpId of term: 11 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 8.
I20260709 13:20:09.706809 11012 leader_election.cc:290] T 8c7f33e544204fbaac4078e3e83bbf4e P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 9 election: Requested vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:09.726215 11008 leader_election.cc:290] T 3fa34c08b205435dba97346991aa1f92 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 13 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:20:09.978506  6726 raft_consensus.cc:1240] T c4db81d9d329422bb3b4160ca4ac2d1d P ccd8a4c3bfe3413cb2ae219b09aea832 [term 10 FOLLOWER]: Rejecting Update request from peer b7ab4784c7344b939bc36f639286f377 for earlier term 9. Current term is 10. Ops: []
I20260709 13:20:09.983816  6724 raft_consensus.cc:1275] T 44bde925b2e541b69890d70715b85176 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 12 FOLLOWER]: Refusing update from remote peer b7ab4784c7344b939bc36f639286f377: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:20:09.941111 10869 raft_consensus.cc:515] T c4db81d9d329422bb3b4160ca4ac2d1d P cd75a17ab2604397adab03bb8b5fd75c [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:09.988749  6728 raft_consensus.cc:1240] T 7c44c4849aa54f2b94d1f1bef9ed546f P ccd8a4c3bfe3413cb2ae219b09aea832 [term 13 FOLLOWER]: Rejecting Update request from peer b7ab4784c7344b939bc36f639286f377 for earlier term 12. Current term is 13. Ops: []
W20260709 13:20:09.996708  6697 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.764s	user 0.015s	sys 0.009s
W20260709 13:20:09.997359  6697 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.765s	user 0.015s	sys 0.010s
I20260709 13:20:09.963930 10650 raft_consensus.cc:2804] T 4f00a2e87e56452083b759f60d461ee3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:20:10.005646  6728 raft_consensus.cc:1240] T 34f36d59d88f40fe8a2805e604fc6c0a P ccd8a4c3bfe3413cb2ae219b09aea832 [term 8 FOLLOWER]: Rejecting Update request from peer b7ab4784c7344b939bc36f639286f377 for earlier term 7. Current term is 8. Ops: []
I20260709 13:20:09.709537 10936 consensus_queue.cc:237] T 7887766dc6784fcaa42b35c05fea7a99 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:09.991135 11022 raft_consensus.cc:493] T 3411566abe2d4c9bb4b2adfdd05e6f17 P cd75a17ab2604397adab03bb8b5fd75c [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:09.990947 10915 raft_consensus.cc:493] T bb3d8792045a4583ae2e965b1350a5b4 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 9 FOLLOWER]: Starting pre-election (detected failure of leader cd75a17ab2604397adab03bb8b5fd75c)
I20260709 13:20:09.969416 10249 consensus_queue.cc:1048] T 22ccee1b570c4ad3a57bd7aec085b1b4 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.042s
I20260709 13:20:10.007243 11008 raft_consensus.cc:493] T 7a734b5ab7834e05a8c422208acc58b1 P cd75a17ab2604397adab03bb8b5fd75c [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:10.016525  6697 leader_election.cc:304] T 853ac0a8cbd64ce99457f170216d4d0f P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:20:09.968782 10785 consensus_queue.cc:1048] T d33d5ee8ef6f415593d8df52063161ad P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.042s
I20260709 13:20:09.983021 10818 consensus_queue.cc:1048] T f3f9c2e2bf644115957398fe4c9459db P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.029s
I20260709 13:20:09.982748 11006 raft_consensus.cc:515] T 7887766dc6784fcaa42b35c05fea7a99 P cd75a17ab2604397adab03bb8b5fd75c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
W20260709 13:20:10.026258  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 289847us
I20260709 13:20:10.011011 10650 raft_consensus.cc:697] T 4f00a2e87e56452083b759f60d461ee3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 12 LEADER]: Becoming Leader. State: Replica: 7ba59cc884714e8aa5f3f0ecaed84cbb, State: Running, Role: LEADER
I20260709 13:20:10.041435  6697 leader_election.cc:304] T d8292e16e5654be6bc408560cf256aaa P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377
I20260709 13:20:10.021124 10920 raft_consensus.cc:493] T f5be3a11b23d4ea9b08300a2789821c7 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:10.054121  6697 leader_election.cc:304] T 24ee15416e3145beaa1b8183453729a3 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:20:10.042488  6844 leader_election.cc:304] T 44bde925b2e541b69890d70715b85176 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: ccd8a4c3bfe3413cb2ae219b09aea832
W20260709 13:20:10.069214  6770 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 116018us
I20260709 13:20:10.073782  6844 leader_election.cc:304] T f5be3a11b23d4ea9b08300a2789821c7 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:20:10.010421 10418 consensus_queue.cc:1059] T ab432e62819d499eaaf3dd55481dd930 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: INVALID_TERM, Last received: 12.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.031s
I20260709 13:20:10.082938  6697 leader_election.cc:304] T 1bf4668eeb70467fb3dc5a0289233b3c P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377
I20260709 13:20:10.085026  6874 raft_consensus.cc:2468] T 3d65025eea89441290d85dd053810e31 P cd75a17ab2604397adab03bb8b5fd75c [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 10.
I20260709 13:20:10.042443 10980 raft_consensus.cc:2749] T 853ac0a8cbd64ce99457f170216d4d0f P ccd8a4c3bfe3413cb2ae219b09aea832 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:20:10.018554 11022 raft_consensus.cc:515] T 3411566abe2d4c9bb4b2adfdd05e6f17 P cd75a17ab2604397adab03bb8b5fd75c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:10.095258  6697 leader_election.cc:304] T 404190ce4ce94cecbfcb6ea9d1dd8626 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, b7ab4784c7344b939bc36f639286f377
I20260709 13:20:10.074477 10930 raft_consensus.cc:2804] T d8292e16e5654be6bc408560cf256aaa P ccd8a4c3bfe3413cb2ae219b09aea832 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:20:10.015550 11026 consensus_queue.cc:260] T 34f36d59d88f40fe8a2805e604fc6c0a P b7ab4784c7344b939bc36f639286f377 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:10.077517 10621 raft_consensus.cc:2764] T 44bde925b2e541b69890d70715b85176 P cd75a17ab2604397adab03bb8b5fd75c [term 12 FOLLOWER]: Leader pre-election decision vote started in defunct term 10: won
I20260709 13:20:10.040243 11008 raft_consensus.cc:515] T 7a734b5ab7834e05a8c422208acc58b1 P cd75a17ab2604397adab03bb8b5fd75c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:10.024379 10915 raft_consensus.cc:515] T bb3d8792045a4583ae2e965b1350a5b4 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:20:10.108086  6844 leader_election.cc:304] T d8cee0accdb8499c86d4414b72565a38 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb
W20260709 13:20:10.098479 11021 log.cc:927] Time spent T 00000000000000000000000000000000 P b3ae52d33b9a4273a42e5e2cf3b5d6b5: Append to log took a long time: real 0.105s	user 0.000s	sys 0.003s
I20260709 13:20:10.068725 11013 consensus_queue.cc:1048] T f58dc08b12a2494bb9a1372837970ca2 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.051s
I20260709 13:20:10.097612 10869 leader_election.cc:290] T c4db81d9d329422bb3b4160ca4ac2d1d P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 10 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:20:10.117899  6844 leader_election.cc:304] T 4d9def8b32fd443aa94ab1420b06837b P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
W20260709 13:20:10.103200 10534 consensus_meta.cc:287] T d8292e16e5654be6bc408560cf256aaa P b7ab4784c7344b939bc36f639286f377: Time spent flushing consensus metadata: real 0.966s	user 0.016s	sys 0.003s
I20260709 13:20:10.097081 11030 leader_election.cc:290] T f5be3a11b23d4ea9b08300a2789821c7 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:10.077821 10920 raft_consensus.cc:515] T f5be3a11b23d4ea9b08300a2789821c7 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:10.093730 10832 raft_consensus.cc:2804] T 24ee15416e3145beaa1b8183453729a3 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:20:10.042279 10986 consensus_queue.cc:260] T 17587d6730594da4a56fa13a353232a1 P 7ba59cc884714e8aa5f3f0ecaed84cbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.11, Last appended by leader: 11, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
W20260709 13:20:10.133770  6770 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 57781.2us
I20260709 13:20:10.134050  6728 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "de3186201e1a40d0b335eeb8b4e256e0"
dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
mode: GRACEFUL
new_leader_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
 from {username='slave'} at 127.0.0.1:38536
I20260709 13:20:10.111191 11047 raft_consensus.cc:2749] T f5be3a11b23d4ea9b08300a2789821c7 P cd75a17ab2604397adab03bb8b5fd75c [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:20:10.150974  6728 raft_consensus.cc:606] T de3186201e1a40d0b335eeb8b4e256e0 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 11 LEADER]: Received request to transfer leadership to TS cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:20:10.157049  6844 leader_election.cc:304] T ce4f062dcd314d43a63ca74067cb5ee3 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb
I20260709 13:20:10.161972  6844 leader_election.cc:304] T 2c240553ce044eedb41541d72b9475d7 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:20:10.163049  6874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a92dd554674067a83a9cb68c4773f2" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:20:10.163873  6874 raft_consensus.cc:3060] T 07a92dd554674067a83a9cb68c4773f2 P cd75a17ab2604397adab03bb8b5fd75c [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:20:10.120121 10930 raft_consensus.cc:697] T d8292e16e5654be6bc408560cf256aaa P ccd8a4c3bfe3413cb2ae219b09aea832 [term 15 LEADER]: Becoming Leader. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
I20260709 13:20:10.175292  6697 leader_election.cc:304] T 34f36d59d88f40fe8a2805e604fc6c0a P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
W20260709 13:20:10.185230  7468 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.505s	user 0.011s	sys 0.013s
W20260709 13:20:10.187885  7468 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.508s	user 0.011s	sys 0.014s
I20260709 13:20:10.138854 10972 raft_consensus.cc:493] T bb7fa124c3bf4ef9ab65a407cb008441 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:20:10.196798  7467 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:10.197412  7502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fa34c08b205435dba97346991aa1f92" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb"
I20260709 13:20:10.199522  6697 leader_election.cc:304] T fe20b4b48823486ca3b9c648db6ce8aa P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:20:10.200618  6726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5be3a11b23d4ea9b08300a2789821c7" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:10.159816 10869 raft_consensus.cc:2764] T d8cee0accdb8499c86d4414b72565a38 P cd75a17ab2604397adab03bb8b5fd75c [term 10 FOLLOWER]: Leader pre-election decision vote started in defunct term 9: won
I20260709 13:20:10.134280 10988 raft_consensus.cc:2749] T 404190ce4ce94cecbfcb6ea9d1dd8626 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 13 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:20:10.219236  6876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab432e62819d499eaaf3dd55481dd930" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:20:10.226372  6876 raft_consensus.cc:3060] T ab432e62819d499eaaf3dd55481dd930 P cd75a17ab2604397adab03bb8b5fd75c [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:10.140565 10621 consensus_queue.cc:1059] T 4275cf08e63345f993bce8664eada830 P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.065s
I20260709 13:20:10.163803 10832 raft_consensus.cc:697] T 24ee15416e3145beaa1b8183453729a3 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 12 LEADER]: Becoming Leader. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
I20260709 13:20:10.212853  6726 raft_consensus.cc:2468] T f5be3a11b23d4ea9b08300a2789821c7 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 9.
I20260709 13:20:10.172380 10785 consensus_queue.cc:1059] T c4db81d9d329422bb3b4160ca4ac2d1d P b7ab4784c7344b939bc36f639286f377 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.044s
I20260709 13:20:10.207053 10980 raft_consensus.cc:2749] T 34f36d59d88f40fe8a2805e604fc6c0a P ccd8a4c3bfe3413cb2ae219b09aea832 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:20:10.159566 11030 consensus_queue.cc:1059] T 90d42e216d9741e190bca19a781291fd P b7ab4784c7344b939bc36f639286f377 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.062s
I20260709 13:20:10.240489 11050 consensus_queue.cc:1059] T 34f36d59d88f40fe8a2805e604fc6c0a P b7ab4784c7344b939bc36f639286f377 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:20:10.242998 10931 leader_election.cc:290] T bd6869f07b5a4885a0b99fbe60c3b175 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 12 election: Requested vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:10.244386  6801 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:32976 (request call id 2776) took 1213 ms. Trace:
I20260709 13:20:10.246843  6798 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:32966 (request call id 1039) took 1177 ms. Trace:
I20260709 13:20:10.214946 11033 consensus_queue.cc:1048] T 3a485a995abc4807b6e511e45419f737 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.034s
W20260709 13:20:10.249019 11044 log.cc:927] Time spent T 3a485a995abc4807b6e511e45419f737 P ccd8a4c3bfe3413cb2ae219b09aea832: Append to log took a long time: real 0.094s	user 0.000s	sys 0.000s
I20260709 13:20:10.249634 10534 raft_consensus.cc:3055] T ab432e62819d499eaaf3dd55481dd930 P b7ab4784c7344b939bc36f639286f377 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:20:10.250393 10621 raft_consensus.cc:493] T 4b8cacb381b746da8d0049b0a83b41dd P cd75a17ab2604397adab03bb8b5fd75c [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:20:10.251700 11041 log.cc:927] Time spent T 7c37d41cd9164c15a6826ca62a851a69 P b7ab4784c7344b939bc36f639286f377: Append to log took a long time: real 0.134s	user 0.000s	sys 0.001s
I20260709 13:20:10.256574 11052 raft_consensus.cc:2804] T ce4f062dcd314d43a63ca74067cb5ee3 P cd75a17ab2604397adab03bb8b5fd75c [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:20:10.256865 11006 leader_election.cc:290] T 7887766dc6784fcaa42b35c05fea7a99 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:20:10.257367 10920 leader_election.cc:290] T f5be3a11b23d4ea9b08300a2789821c7 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
W20260709 13:20:10.257802  6697 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 58388.4us
I20260709 13:20:10.335908 11048 raft_consensus.cc:3055] T 4275cf08e63345f993bce8664eada830 P cd75a17ab2604397adab03bb8b5fd75c [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:20:10.249639 10832 consensus_queue.cc:237] T 24ee15416e3145beaa1b8183453729a3 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:20:10.257831 11038 raft_consensus.cc:2749] T fe20b4b48823486ca3b9c648db6ce8aa P ccd8a4c3bfe3413cb2ae219b09aea832 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:20:10.229480 10972 raft_consensus.cc:515] T bb7fa124c3bf4ef9ab65a407cb008441 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:20:10.229763 10418 consensus_queue.cc:1059] T 7c44c4849aa54f2b94d1f1bef9ed546f P b7ab4784c7344b939bc36f639286f377 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: INVALID_TERM, Last received: 12.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.031s
I20260709 13:20:10.261770 11008 leader_election.cc:290] T 7a734b5ab7834e05a8c422208acc58b1 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:20:10.262974 11022 leader_election.cc:290] T 3411566abe2d4c9bb4b2adfdd05e6f17 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
W20260709 13:20:10.263345  6773 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:10.234738  6874 raft_consensus.cc:2468] T 07a92dd554674067a83a9cb68c4773f2 P cd75a17ab2604397adab03bb8b5fd75c [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 11.
I20260709 13:20:10.283308  6801 rpcz_store.cc:276] 0709 13:20:09.031006 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:09.031149 (+   143us) service_pool.cc:224] Handling call
0709 13:20:09.047128 (+ 15979us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:09.073919 (+ 26791us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:09.073964 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:20:09.074524 (+   560us) log.cc:844] Serialized 26 byte log entry
0709 13:20:09.965119 (+890595us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:20:09.965165 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:09.965249 (+    84us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:10.244132 (+278883us) raft_consensus.cc:1685] finished
0709 13:20:10.244155 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:10.244318 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":14509,"raft.run_cpu_time_us":119,"raft.run_wall_time_us":119,"thread_start_us":892833,"threads_started":2,"wal-append.queue_time_us":1046132}
I20260709 13:20:10.283507  6798 rpcz_store.cc:276] 0709 13:20:09.069214 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:09.080730 (+ 11516us) service_pool.cc:224] Handling call
0709 13:20:10.246613 (+1165883us) spinlock_profiling.cc:243] Waited 722 ms on lock 0x7b54001b67d4. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f9ae2fa 00007fcc1496fb17 00007fcc0deea6d4 00007fcc0deea662 00007fcc0deea591 00007fcc0deea50c 00007fcc0dee97c2 00007fcc0dce548c 00007fcc0dce48c6 00007fcc0dce426f
0709 13:20:10.246773 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1660989312}
I20260709 13:20:10.281826  6876 raft_consensus.cc:2468] T ab432e62819d499eaaf3dd55481dd930 P cd75a17ab2604397adab03bb8b5fd75c [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 13.
I20260709 13:20:10.189375 10998 consensus_queue.cc:1048] T 7c37d41cd9164c15a6826ca62a851a69 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 3, Time since last communication: 0.084s
W20260709 13:20:10.295276  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 133108us
I20260709 13:20:10.215099 11010 consensus_queue.cc:1048] T e77e330a82df4b43a745d57a68f6f057 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.066s
I20260709 13:20:10.214644 10249 consensus_queue.cc:1048] T 44bde925b2e541b69890d70715b85176 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.066s
I20260709 13:20:10.164230 10650 consensus_queue.cc:237] T 4f00a2e87e56452083b759f60d461ee3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:20:10.390399  6874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e326172347f45e99a0d482b5d8ef768" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:20:10.390998  6874 raft_consensus.cc:3060] T 9e326172347f45e99a0d482b5d8ef768 P cd75a17ab2604397adab03bb8b5fd75c [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:20:10.361271 10976 raft_consensus.cc:493] T 427c124d773f483294511e80fe340075 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:20:10.320614 11062 raft_consensus.cc:3055] T c4db81d9d329422bb3b4160ca4ac2d1d P b7ab4784c7344b939bc36f639286f377 [term 9 LEADER]: Stepping down as leader of term 9
W20260709 13:20:10.321705 11045 log.cc:927] Time spent T b3f13b31a1f84f0d89d007eadd57924c P 7ba59cc884714e8aa5f3f0ecaed84cbb: Append to log took a long time: real 0.190s	user 0.000s	sys 0.001s
W20260709 13:20:10.326879 10727 consensus_meta.cc:287] T 711ef6523deb4cbe8ef2ba61e1c21c98 P ccd8a4c3bfe3413cb2ae219b09aea832: Time spent flushing consensus metadata: real 0.584s	user 0.011s	sys 0.000s
I20260709 13:20:10.330700  7503 raft_consensus.cc:2468] T 24ee15416e3145beaa1b8183453729a3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 12.
W20260709 13:20:10.333860  6696 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:10.405359  6730 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50004 (request call id 2031) took 1665 ms. Trace:
I20260709 13:20:10.255822 10160 raft_consensus.cc:515] T 3a485a995abc4807b6e511e45419f737 P b7ab4784c7344b939bc36f639286f377 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
W20260709 13:20:10.340426  7466 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:10.406229  6730 rpcz_store.cc:276] 0709 13:20:08.740199 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:08.740313 (+   114us) service_pool.cc:224] Handling call
0709 13:20:08.740602 (+   289us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:09.076855 (+336253us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:10.405065 (+1328210us) spinlock_profiling.cc:243] Waited 336 ms on lock 0x7b5400057154. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f9aae01 00007fcc0f9a983e 00007fcc1496e419 00007fcc0dee5bd4 00007fcc0dee5b62 00007fcc0dee5a91 00007fcc0dee5a0c 00007fcc0dee4cc2 00007fcc0dce548c 00007fcc0dce48c6
0709 13:20:10.405287 (+   222us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":771672960}
I20260709 13:20:10.258109 10930 consensus_queue.cc:237] T d8292e16e5654be6bc408560cf256aaa P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 13.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:10.343124  6697 leader_election.cc:304] T 3d65025eea89441290d85dd053810e31 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:20:10.360246 10983 raft_consensus.cc:2804] T 1bf4668eeb70467fb3dc5a0289233b3c P ccd8a4c3bfe3413cb2ae219b09aea832 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:20:10.295853 10534 raft_consensus.cc:740] T ab432e62819d499eaaf3dd55481dd930 P b7ab4784c7344b939bc36f639286f377 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
I20260709 13:20:10.413494  6874 raft_consensus.cc:2468] T 9e326172347f45e99a0d482b5d8ef768 P cd75a17ab2604397adab03bb8b5fd75c [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 11.
I20260709 13:20:10.314855 11052 raft_consensus.cc:493] T ce4f062dcd314d43a63ca74067cb5ee3 P cd75a17ab2604397adab03bb8b5fd75c [term 10 FOLLOWER]: Starting leader election (detected failure of leader 7ba59cc884714e8aa5f3f0ecaed84cbb)
I20260709 13:20:10.347729 11048 raft_consensus.cc:740] T 4275cf08e63345f993bce8664eada830 P cd75a17ab2604397adab03bb8b5fd75c [term 11 LEADER]: Becoming Follower/Learner. State: Replica: cd75a17ab2604397adab03bb8b5fd75c, State: Running, Role: LEADER
I20260709 13:20:10.391515  6844 leader_election.cc:304] T bb7fa124c3bf4ef9ab65a407cb008441 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, b7ab4784c7344b939bc36f639286f377
I20260709 13:20:10.392970  6876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90d42e216d9741e190bca19a781291fd" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:20:10.442601  6876 raft_consensus.cc:3060] T 90d42e216d9741e190bca19a781291fd P cd75a17ab2604397adab03bb8b5fd75c [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:20:10.318252 10987 raft_consensus.cc:493] T a3022224cc81473690653a83d4e99470 P b7ab4784c7344b939bc36f639286f377 [term 12 FOLLOWER]: Starting leader election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:20:10.314424 10621 raft_consensus.cc:515] T 4b8cacb381b746da8d0049b0a83b41dd P cd75a17ab2604397adab03bb8b5fd75c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:20:10.401865  6802 raft_consensus.cc:1275] T 404190ce4ce94cecbfcb6ea9d1dd8626 P b7ab4784c7344b939bc36f639286f377 [term 13 FOLLOWER]: Refusing update from remote peer 7ba59cc884714e8aa5f3f0ecaed84cbb: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:20:10.444432 10987 raft_consensus.cc:3060] T a3022224cc81473690653a83d4e99470 P b7ab4784c7344b939bc36f639286f377 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:10.404093  6873 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53416 (request call id 2845) took 1208 ms. Trace:
W20260709 13:20:10.374889  7468 leader_election.cc:336] T 427c124d773f483294511e80fe340075 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931): Timed out: RequestConsensusVote RPC to 127.5.126.67:42931 timed out after 1.938s (SENT)
I20260709 13:20:10.403179 10921 raft_consensus.cc:2749] T 713b5728a197487c9300b310ab94e5a3 P cd75a17ab2604397adab03bb8b5fd75c [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:20:10.435670  6727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3d8792045a4583ae2e965b1350a5b4" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:10.437043  6872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c7f33e544204fbaac4078e3e83bbf4e" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:20:10.449286  6872 raft_consensus.cc:3060] T 8c7f33e544204fbaac4078e3e83bbf4e P cd75a17ab2604397adab03bb8b5fd75c [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:20:10.451287  6727 raft_consensus.cc:1240] T 17587d6730594da4a56fa13a353232a1 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 16 LEADER]: Rejecting Update request from peer 7ba59cc884714e8aa5f3f0ecaed84cbb for earlier term 15. Current term is 16. Ops: [15.11-15.11]
I20260709 13:20:10.447216  6873 rpcz_store.cc:276] 0709 13:20:09.196133 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:09.757252 (+561119us) service_pool.cc:224] Handling call
0709 13:20:09.757524 (+   272us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:09.757758 (+   234us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:20:10.014210 (+256452us) log.cc:844] Serialized 14 byte log entry
0709 13:20:10.402725 (+388515us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:20:10.402787 (+    62us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:20:10.402850 (+    63us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:10.402926 (+    76us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:10.403987 (+  1061us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":469221,"prepare.run_cpu_time_us":62,"prepare.run_wall_time_us":4787,"raft.queue_time_us":1891,"raft.run_cpu_time_us":220,"raft.run_wall_time_us":29740,"thread_start_us":644062,"threads_started":2}
W20260709 13:20:10.431650  6697 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 88638.3us
I20260709 13:20:10.443840  6874 raft_consensus.cc:1275] T a1704639a875409b9959353527b3fd68 P cd75a17ab2604397adab03bb8b5fd75c [term 12 FOLLOWER]: Refusing update from remote peer ccd8a4c3bfe3413cb2ae219b09aea832: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
W20260709 13:20:10.446122  7468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 71317.7us
W20260709 13:20:10.459039  7468 leader_election.cc:336] T 7ba5dac66ab5497e9e336f2a3c28cda5 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931): Timed out: RequestConsensusVote RPC to 127.5.126.67:42931 timed out after 1.953s (SENT)
I20260709 13:20:10.402608 11062 raft_consensus.cc:740] T c4db81d9d329422bb3b4160ca4ac2d1d P b7ab4784c7344b939bc36f639286f377 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
I20260709 13:20:10.462749  6876 raft_consensus.cc:2468] T 90d42e216d9741e190bca19a781291fd P cd75a17ab2604397adab03bb8b5fd75c [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 11.
I20260709 13:20:10.403299 10976 raft_consensus.cc:515] T 427c124d773f483294511e80fe340075 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } attrs { replace: true } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:20:10.465129  6876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5be3a11b23d4ea9b08300a2789821c7" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:10.467689  6876 raft_consensus.cc:2468] T f5be3a11b23d4ea9b08300a2789821c7 P cd75a17ab2604397adab03bb8b5fd75c [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 9.
I20260709 13:20:10.411612 11033 raft_consensus.cc:493] T 44bde925b2e541b69890d70715b85176 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:10.438112 11008 raft_consensus.cc:493] T dbdf895bba214ff68685a24fd17dfb5d P cd75a17ab2604397adab03bb8b5fd75c [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:20:10.439275 11047 raft_consensus.cc:2749] T 4d9def8b32fd443aa94ab1420b06837b P cd75a17ab2604397adab03bb8b5fd75c [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:20:10.440802 11022 raft_consensus.cc:493] T 9b3759de40694069b13c0f8bd40e5709 P cd75a17ab2604397adab03bb8b5fd75c [term 10 FOLLOWER]: Starting pre-election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:20:10.438210 10727 raft_consensus.cc:493] T 427c124d773f483294511e80fe340075 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:20:10.440466 11052 raft_consensus.cc:3060] T ce4f062dcd314d43a63ca74067cb5ee3 P cd75a17ab2604397adab03bb8b5fd75c [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:20:10.495060 11051 raft_consensus.cc:2749] T 2c240553ce044eedb41541d72b9475d7 P cd75a17ab2604397adab03bb8b5fd75c [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:20:10.497736  6874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6869f07b5a4885a0b99fbe60c3b175" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:20:10.464354 10650 raft_consensus.cc:493] T d8cee0accdb8499c86d4414b72565a38 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:10.525053  6876 raft_consensus.cc:1275] T f03d0dbf16864ca4bc1bb5e4c0334c0f P cd75a17ab2604397adab03bb8b5fd75c [term 10 FOLLOWER]: Refusing update from remote peer ccd8a4c3bfe3413cb2ae219b09aea832: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:20:10.452492 11038 raft_consensus.cc:2804] T 3d65025eea89441290d85dd053810e31 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 10 FOLLOWER]: Leader election won for term 10
W20260709 13:20:10.494477  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 103064us
W20260709 13:20:10.513844  6846 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:10.466517 10915 leader_election.cc:290] T bb3d8792045a4583ae2e965b1350a5b4 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
W20260709 13:20:10.498333 11064 log.cc:927] Time spent T 713b5728a197487c9300b310ab94e5a3 P cd75a17ab2604397adab03bb8b5fd75c: Append to log took a long time: real 0.093s	user 0.000s	sys 0.000s
I20260709 13:20:10.528849  6874 raft_consensus.cc:3060] T bd6869f07b5a4885a0b99fbe60c3b175 P cd75a17ab2604397adab03bb8b5fd75c [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:20:10.530280  6695 leader_election.cc:304] T c4db81d9d329422bb3b4160ca4ac2d1d P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:20:10.533102  6844 leader_election.cc:304] T 7ba5dac66ab5497e9e336f2a3c28cda5 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, b7ab4784c7344b939bc36f639286f377
I20260709 13:20:10.488533 11006 raft_consensus.cc:2749] T bb7fa124c3bf4ef9ab65a407cb008441 P cd75a17ab2604397adab03bb8b5fd75c [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:20:10.533716  6872 raft_consensus.cc:2468] T 8c7f33e544204fbaac4078e3e83bbf4e P cd75a17ab2604397adab03bb8b5fd75c [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 9.
I20260709 13:20:10.529984 11010 raft_consensus.cc:493] T f09c2a98de1a4decabd0ff900dd44caa P ccd8a4c3bfe3413cb2ae219b09aea832 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:20:10.550710  6695 leader_election.cc:304] T 3411566abe2d4c9bb4b2adfdd05e6f17 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:20:10.495473 11033 raft_consensus.cc:515] T 44bde925b2e541b69890d70715b85176 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:10.498200 11048 consensus_queue.cc:260] T 4275cf08e63345f993bce8664eada830 P cd75a17ab2604397adab03bb8b5fd75c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:10.555802 11048 raft_consensus.cc:3060] T 4275cf08e63345f993bce8664eada830 P cd75a17ab2604397adab03bb8b5fd75c [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:20:10.556500  6879 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53416 (request call id 2849) took 1332 ms. Trace:
I20260709 13:20:10.497656 10727 raft_consensus.cc:515] T 427c124d773f483294511e80fe340075 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } attrs { replace: true } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:20:10.556974  6879 rpcz_store.cc:276] 0709 13:20:09.224242 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:09.833999 (+609757us) service_pool.cc:224] Handling call
0709 13:20:09.873120 (+ 39121us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:10.135157 (+262037us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:20:10.311467 (+176310us) log.cc:844] Serialized 14 byte log entry
0709 13:20:10.438169 (+126702us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:20:10.438791 (+   622us) log.cc:844] Serialized 26 byte log entry
0709 13:20:10.438957 (+   166us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:20:10.439001 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:10.439090 (+    89us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:10.556223 (+117133us) raft_consensus.cc:1685] finished
0709 13:20:10.556244 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:10.556436 (+   192us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":197776,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":39,"raft.queue_time_us":141207,"raft.run_cpu_time_us":318,"raft.run_wall_time_us":17761,"thread_start_us":403088,"threads_started":3,"wal-append.queue_time_us":170002}
I20260709 13:20:10.558046 11040 raft_consensus.cc:493] T bb3d8792045a4583ae2e965b1350a5b4 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader cd75a17ab2604397adab03bb8b5fd75c)
I20260709 13:20:10.466869 10534 consensus_queue.cc:260] T ab432e62819d499eaaf3dd55481dd930 P b7ab4784c7344b939bc36f639286f377 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.6, Last appended by leader: 6, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:10.558825 11040 raft_consensus.cc:515] T bb3d8792045a4583ae2e965b1350a5b4 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:20:10.559345 10534 raft_consensus.cc:3060] T ab432e62819d499eaaf3dd55481dd930 P b7ab4784c7344b939bc36f639286f377 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:20:10.559846  6772 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 1.54181e+06us
I20260709 13:20:10.551623 11062 consensus_queue.cc:260] T c4db81d9d329422bb3b4160ca4ac2d1d P b7ab4784c7344b939bc36f639286f377 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:10.560706  6772 leader_election.cc:304] T 4275cf08e63345f993bce8664eada830 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:20:10.557919 10621 leader_election.cc:290] T 4b8cacb381b746da8d0049b0a83b41dd P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:20:10.556995 11075 raft_consensus.cc:493] T a1704639a875409b9959353527b3fd68 P cd75a17ab2604397adab03bb8b5fd75c [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:10.534052 10650 raft_consensus.cc:515] T d8cee0accdb8499c86d4414b72565a38 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:20:10.541435 11038 raft_consensus.cc:697] T 3d65025eea89441290d85dd053810e31 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 10 LEADER]: Becoming Leader. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
I20260709 13:20:10.599908  6695 leader_election.cc:304] T 20f6842e26174571996b8dea4151d4be P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:20:10.523840 11022 raft_consensus.cc:515] T 9b3759de40694069b13c0f8bd40e5709 P cd75a17ab2604397adab03bb8b5fd75c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:10.609668  6729 raft_consensus.cc:1275] T 4b8cacb381b746da8d0049b0a83b41dd P ccd8a4c3bfe3413cb2ae219b09aea832 [term 12 FOLLOWER]: Refusing update from remote peer 7ba59cc884714e8aa5f3f0ecaed84cbb: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:20:10.622004  6723 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50004 (request call id 2030) took 1883 ms. Trace:
I20260709 13:20:10.601172  6772 leader_election.cc:304] T f58dc08b12a2494bb9a1372837970ca2 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:20:10.624001  6723 rpcz_store.cc:276] 0709 13:20:08.738961 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:08.739393 (+   432us) service_pool.cc:224] Handling call
0709 13:20:08.739715 (+   322us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:09.139250 (+399535us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:10.621362 (+1482112us) spinlock_profiling.cc:243] Waited 399 ms on lock 0x7b540031a1d4. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f9aae01 00007fcc0f9a983e 00007fcc1496e419 00007fcc0dee5bd4 00007fcc0dee5b62 00007fcc0dee5a91 00007fcc0dee5a0c 00007fcc0dee4cc2 00007fcc0dce548c 00007fcc0dce48c6
0709 13:20:10.621902 (+   540us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":917504768}
W20260709 13:20:10.604959  7468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 72476.1us
W20260709 13:20:10.628508  6773 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:10.498742 11008 raft_consensus.cc:515] T dbdf895bba214ff68685a24fd17dfb5d P cd75a17ab2604397adab03bb8b5fd75c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
W20260709 13:20:10.627835  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 94795.8us
I20260709 13:20:10.635833  6695 leader_election.cc:304] T 7c44c4849aa54f2b94d1f1bef9ed546f P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
W20260709 13:20:10.640856  6772 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 78894.7us
I20260709 13:20:10.642429  6772 leader_election.cc:304] T 7c37d41cd9164c15a6826ca62a851a69 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:20:10.643380  6874 raft_consensus.cc:2468] T bd6869f07b5a4885a0b99fbe60c3b175 P cd75a17ab2604397adab03bb8b5fd75c [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 12.
I20260709 13:20:10.646778  6807 raft_consensus.cc:1240] T 4f00a2e87e56452083b759f60d461ee3 P b7ab4784c7344b939bc36f639286f377 [term 12 FOLLOWER]: Rejecting Update request from peer cd75a17ab2604397adab03bb8b5fd75c for earlier term 11. Current term is 12. Ops: []
I20260709 13:20:10.650089  6807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4db81d9d329422bb3b4160ca4ac2d1d" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:20:10.650125  6803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09c2a98de1a4decabd0ff900dd44caa" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:20:10.658809  6803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb7fa124c3bf4ef9ab65a407cb008441" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:10.659052  6804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7887766dc6784fcaa42b35c05fea7a99" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:10.659610  6804 raft_consensus.cc:2468] T 7887766dc6784fcaa42b35c05fea7a99 P b7ab4784c7344b939bc36f639286f377 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 11.
I20260709 13:20:10.659547  6803 raft_consensus.cc:2468] T bb7fa124c3bf4ef9ab65a407cb008441 P b7ab4784c7344b939bc36f639286f377 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in term 11.
I20260709 13:20:10.662199  7466 leader_election.cc:304] T bb7fa124c3bf4ef9ab65a407cb008441 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, b7ab4784c7344b939bc36f639286f377; no voters: 
W20260709 13:20:10.604784 11064 log.cc:927] Time spent T 713b5728a197487c9300b310ab94e5a3 P cd75a17ab2604397adab03bb8b5fd75c: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 13:20:10.665091  6799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a734b5ab7834e05a8c422208acc58b1" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 12 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:10.665858  6799 raft_consensus.cc:2468] T 7a734b5ab7834e05a8c422208acc58b1 P b7ab4784c7344b939bc36f639286f377 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 11.
I20260709 13:20:10.600024 10418 raft_consensus.cc:2749] T 4275cf08e63345f993bce8664eada830 P b7ab4784c7344b939bc36f639286f377 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:20:10.665226 11082 consensus_queue.cc:1059] T 17587d6730594da4a56fa13a353232a1 P 7ba59cc884714e8aa5f3f0ecaed84cbb [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: INVALID_TERM, Last received: 13.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.035s
I20260709 13:20:10.615183 11075 raft_consensus.cc:515] T a1704639a875409b9959353527b3fd68 P cd75a17ab2604397adab03bb8b5fd75c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:10.599889 10700 raft_consensus.cc:2804] T 3411566abe2d4c9bb4b2adfdd05e6f17 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:20:10.549041 11010 raft_consensus.cc:515] T f09c2a98de1a4decabd0ff900dd44caa P ccd8a4c3bfe3413cb2ae219b09aea832 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:10.631771 10998 raft_consensus.cc:2804] T 20f6842e26174571996b8dea4151d4be P ccd8a4c3bfe3413cb2ae219b09aea832 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:20:10.664189 10785 raft_consensus.cc:493] T 17587d6730594da4a56fa13a353232a1 P b7ab4784c7344b939bc36f639286f377 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:10.601235 10920 raft_consensus.cc:2749] T c4db81d9d329422bb3b4160ca4ac2d1d P ccd8a4c3bfe3413cb2ae219b09aea832 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:20:10.655715 10915 consensus_queue.cc:1048] T 404190ce4ce94cecbfcb6ea9d1dd8626 P 7ba59cc884714e8aa5f3f0ecaed84cbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.025s
I20260709 13:20:10.686432  6802 raft_consensus.cc:1275] T b3f13b31a1f84f0d89d007eadd57924c P b7ab4784c7344b939bc36f639286f377 [term 11 FOLLOWER]: Refusing update from remote peer 7ba59cc884714e8aa5f3f0ecaed84cbb: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
W20260709 13:20:10.686653  6695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 61688.9us
I20260709 13:20:10.602288 10621 raft_consensus.cc:2749] T 7ba5dac66ab5497e9e336f2a3c28cda5 P cd75a17ab2604397adab03bb8b5fd75c [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:20:10.683595  6878 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53416 (request call id 2842) took 1488 ms. Trace:
I20260709 13:20:10.683866  6801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de3186201e1a40d0b335eeb8b4e256e0" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:10.666477  6772 leader_election.cc:304] T 7a734b5ab7834e05a8c422208acc58b1 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:20:10.693650  6772 leader_election.cc:304] T 4d9def8b32fd443aa94ab1420b06837b P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:20:10.675223  6798 raft_consensus.cc:1240] T 20f6842e26174571996b8dea4151d4be P b7ab4784c7344b939bc36f639286f377 [term 13 FOLLOWER]: Rejecting Update request from peer cd75a17ab2604397adab03bb8b5fd75c for earlier term 12. Current term is 13. Ops: []
I20260709 13:20:10.695603  6844 leader_election.cc:304] T 7c44c4849aa54f2b94d1f1bef9ed546f P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:20:10.700739  6729 raft_consensus.cc:1275] T 404190ce4ce94cecbfcb6ea9d1dd8626 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 13 FOLLOWER]: Refusing update from remote peer 7ba59cc884714e8aa5f3f0ecaed84cbb: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
W20260709 13:20:10.679304 11035 log.cc:927] Time spent T 853ac0a8cbd64ce99457f170216d4d0f P ccd8a4c3bfe3413cb2ae219b09aea832: Append to log took a long time: real 0.717s	user 0.004s	sys 0.001s
I20260709 13:20:10.702812  6844 leader_election.cc:304] T 7c37d41cd9164c15a6826ca62a851a69 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:20:10.706868  6801 raft_consensus.cc:2468] T de3186201e1a40d0b335eeb8b4e256e0 P b7ab4784c7344b939bc36f639286f377 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 11.
I20260709 13:20:10.711791 10700 raft_consensus.cc:697] T 3411566abe2d4c9bb4b2adfdd05e6f17 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 9 LEADER]: Becoming Leader. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
I20260709 13:20:10.712381 11038 consensus_queue.cc:237] T 3d65025eea89441290d85dd053810e31 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.4, Last appended by leader: 4, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:10.713039 10700 consensus_queue.cc:237] T 3411566abe2d4c9bb4b2adfdd05e6f17 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:10.671023 11065 raft_consensus.cc:2804] T f58dc08b12a2494bb9a1372837970ca2 P b7ab4784c7344b939bc36f639286f377 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:20:10.715623  6730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a485a995abc4807b6e511e45419f737" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:20:10.677557 11010 leader_election.cc:290] T f09c2a98de1a4decabd0ff900dd44caa P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:10.720335 11092 raft_consensus.cc:2749] T 7c44c4849aa54f2b94d1f1bef9ed546f P cd75a17ab2604397adab03bb8b5fd75c [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:20:10.681764 11022 leader_election.cc:290] T 9b3759de40694069b13c0f8bd40e5709 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:20:10.723675 10987 raft_consensus.cc:515] T a3022224cc81473690653a83d4e99470 P b7ab4784c7344b939bc36f639286f377 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:10.673950 11082 consensus_queue.cc:1243] T 17587d6730594da4a56fa13a353232a1 P 7ba59cc884714e8aa5f3f0ecaed84cbb [NON_LEADER]: Peer ccd8a4c3bfe3413cb2ae219b09aea832 log is divergent from this leader: its last log entry 16.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 10
I20260709 13:20:10.748731  6725 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50004 (request call id 2040) took 1692 ms. Trace:
I20260709 13:20:10.703109  6878 rpcz_store.cc:276] 0709 13:20:09.195298 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:09.738800 (+543502us) service_pool.cc:224] Handling call
0709 13:20:09.739212 (+   412us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:10.051175 (+311963us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:20:10.133857 (+ 82682us) log.cc:844] Serialized 14 byte log entry
0709 13:20:10.277597 (+143740us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:20:10.291905 (+ 14308us) log.cc:844] Serialized 26 byte log entry
0709 13:20:10.292568 (+   663us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:20:10.292783 (+   215us) log.cc:844] Serialized 14 byte log entry
0709 13:20:10.402097 (+109314us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:10.402281 (+   184us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:10.683352 (+281071us) raft_consensus.cc:1685] finished
0709 13:20:10.683383 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:10.683508 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2823,"prepare.queue_time_us":322246,"prepare.run_cpu_time_us":65,"prepare.run_wall_time_us":68,"raft.queue_time_us":388547,"raft.run_cpu_time_us":522,"raft.run_wall_time_us":39979,"spinlock_wait_cycles":1933696,"thread_start_us":613813,"threads_started":4,"wal-append.queue_time_us":249157}
I20260709 13:20:10.673126 11042 raft_consensus.cc:2804] T bb7fa124c3bf4ef9ab65a407cb008441 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:20:10.672852 11059 raft_consensus.cc:2804] T 7c37d41cd9164c15a6826ca62a851a69 P b7ab4784c7344b939bc36f639286f377 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:20:10.749274  6725 rpcz_store.cc:276] 0709 13:20:09.056656 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:09.169325 (+112669us) service_pool.cc:224] Handling call
0709 13:20:09.184718 (+ 15393us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:09.189586 (+  4868us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:09.189622 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:20:09.200050 (+ 10428us) log.cc:844] Serialized 26 byte log entry
0709 13:20:09.250613 (+ 50563us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:20:09.250663 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:09.250743 (+    80us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:10.678343 (+1427600us) spinlock_profiling.cc:243] Waited 7.46 ms on lock 0x7b4400022b4c. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0c745db1 00007fcc0c7e3c85 00007fcc0c7e46a2 00007fcc0f5561db 00007fcc0f551aaf 00007fcc0f54586e 00007fcc0f544bb6 00007fcc0f5447d8 00007fcc0f54e221 00007fcc0f54e1d9 00007fcc0f54e169
0709 13:20:10.725704 (+ 47361us) raft_consensus.cc:1685] finished
0709 13:20:10.725734 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:10.748632 (+ 22898us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":849,"raft.run_cpu_time_us":134,"raft.run_wall_time_us":10132,"spinlock_wait_cycles":17163008,"thread_start_us":29717,"threads_started":1,"wal-append.queue_time_us":455779}
I20260709 13:20:10.750388  6875 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58592 (request call id 303) took 1992 ms. Trace:
I20260709 13:20:10.715837 11065 raft_consensus.cc:493] T f58dc08b12a2494bb9a1372837970ca2 P b7ab4784c7344b939bc36f639286f377 [term 13 FOLLOWER]: Starting leader election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:20:10.678970 11061 raft_consensus.cc:493] T 30e88460611e47b2ba16a46a30b5f416 P b7ab4784c7344b939bc36f639286f377 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
W20260709 13:20:10.682830 11068 log.cc:927] Time spent T 1bf4668eeb70467fb3dc5a0289233b3c P ccd8a4c3bfe3413cb2ae219b09aea832: Append to log took a long time: real 0.184s	user 0.001s	sys 0.000s
I20260709 13:20:10.636430 11033 leader_election.cc:290] T 44bde925b2e541b69890d70715b85176 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:10.754281  6729 raft_consensus.cc:1240] T 90d42e216d9741e190bca19a781291fd P ccd8a4c3bfe3413cb2ae219b09aea832 [term 11 FOLLOWER]: Rejecting Update request from peer b7ab4784c7344b939bc36f639286f377 for earlier term 10. Current term is 11. Ops: []
W20260709 13:20:10.751878  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 49208.5us
I20260709 13:20:10.699103 10249 raft_consensus.cc:2749] T 7a734b5ab7834e05a8c422208acc58b1 P b7ab4784c7344b939bc36f639286f377 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:20:10.698040 11075 leader_election.cc:290] T a1704639a875409b9959353527b3fd68 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:20:10.705607 10967 raft_consensus.cc:2804] T 4d9def8b32fd443aa94ab1420b06837b P b7ab4784c7344b939bc36f639286f377 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:20:10.701787 10998 raft_consensus.cc:697] T 20f6842e26174571996b8dea4151d4be P ccd8a4c3bfe3413cb2ae219b09aea832 [term 13 LEADER]: Becoming Leader. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
I20260709 13:20:10.755730  6875 rpcz_store.cc:276] 0709 13:20:08.758014 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:08.764225 (+  6211us) service_pool.cc:224] Handling call
0709 13:20:08.764643 (+   418us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:09.141031 (+376388us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:10.750057 (+1609026us) spinlock_profiling.cc:243] Waited 376 ms on lock 0x7b54000a78d4. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f9aae01 00007fcc0f9a983e 00007fcc1496e419 00007fcc0dee5bd4 00007fcc0dee5b62 00007fcc0dee5a91 00007fcc0dee5a0c 00007fcc0dee4cc2 00007fcc0dce548c 00007fcc0dce48c6
0709 13:20:10.750318 (+   261us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":864294784}
I20260709 13:20:10.710213 10832 raft_consensus.cc:2749] T 7c44c4849aa54f2b94d1f1bef9ed546f P ccd8a4c3bfe3413cb2ae219b09aea832 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:20:10.723871 10708 raft_consensus.cc:3055] T 90d42e216d9741e190bca19a781291fd P b7ab4784c7344b939bc36f639286f377 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:20:10.678023 10785 raft_consensus.cc:515] T 17587d6730594da4a56fa13a353232a1 P b7ab4784c7344b939bc36f639286f377 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:20:10.778348  6844 leader_election.cc:304] T 711ef6523deb4cbe8ef2ba61e1c21c98 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:20:10.753418 11042 raft_consensus.cc:493] T bb7fa124c3bf4ef9ab65a407cb008441 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:10.754698 11047 raft_consensus.cc:2749] T 7c37d41cd9164c15a6826ca62a851a69 P cd75a17ab2604397adab03bb8b5fd75c [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:20:10.787174 11077 log.cc:927] Time spent T 7887766dc6784fcaa42b35c05fea7a99 P ccd8a4c3bfe3413cb2ae219b09aea832: Append to log took a long time: real 0.185s	user 0.001s	sys 0.001s
I20260709 13:20:10.755187 11059 raft_consensus.cc:493] T 7c37d41cd9164c15a6826ca62a851a69 P b7ab4784c7344b939bc36f639286f377 [term 10 FOLLOWER]: Starting leader election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:20:10.759943 11065 raft_consensus.cc:3060] T f58dc08b12a2494bb9a1372837970ca2 P b7ab4784c7344b939bc36f639286f377 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:10.795578  6844 leader_election.cc:304] T 34f36d59d88f40fe8a2805e604fc6c0a P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:20:10.796372  6728 raft_consensus.cc:1240] T 7c44c4849aa54f2b94d1f1bef9ed546f P ccd8a4c3bfe3413cb2ae219b09aea832 [term 13 FOLLOWER]: Rejecting Update request from peer b7ab4784c7344b939bc36f639286f377 for earlier term 12. Current term is 13. Ops: []
I20260709 13:20:10.844009  6877 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58592 (request call id 307) took 2074 ms. Trace:
W20260709 13:20:10.848867  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 53410.4us
I20260709 13:20:10.848766  6877 rpcz_store.cc:276] 0709 13:20:08.769923 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:08.895272 (+125349us) service_pool.cc:224] Handling call
0709 13:20:09.772073 (+876801us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:09.844857 (+ 72784us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:10.843820 (+998963us) spinlock_profiling.cc:243] Waited 834 ms on lock 0x7b54001428d0. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f9a98ad 00007fcc1496e419 00007fcc0dee5bd4 00007fcc0dee5b62 00007fcc0dee5a91 00007fcc0dee5a0c 00007fcc0dee4cc2 00007fcc0dce548c 00007fcc0dce48c6 00007fcc0dce426f
0709 13:20:10.843947 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1919048448}
I20260709 13:20:10.850013  6844 leader_election.cc:400] T e31b9971c15848dea59d4d4130141d9e P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 8 pre-election: Vote denied by peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391) with higher term. Message: Invalid argument: T e31b9971c15848dea59d4d4130141d9e P ccd8a4c3bfe3413cb2ae219b09aea832 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c for earlier term 8. Current term is 9.
W20260709 13:20:10.846851 11079 log.cc:927] Time spent T 2c240553ce044eedb41541d72b9475d7 P cd75a17ab2604397adab03bb8b5fd75c: Append to log took a long time: real 0.349s	user 0.005s	sys 0.000s
I20260709 13:20:10.850519 11006 raft_consensus.cc:2749] T 34f36d59d88f40fe8a2805e604fc6c0a P cd75a17ab2604397adab03bb8b5fd75c [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:20:10.847469  6732 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50004 (request call id 2037) took 1795 ms. Trace:
I20260709 13:20:10.851066 11008 leader_election.cc:290] T dbdf895bba214ff68685a24fd17dfb5d P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:20:10.806352  6729 raft_consensus.cc:1240] T 8c7f33e544204fbaac4078e3e83bbf4e P ccd8a4c3bfe3413cb2ae219b09aea832 [term 9 FOLLOWER]: Rejecting Update request from peer b7ab4784c7344b939bc36f639286f377 for earlier term 8. Current term is 9. Ops: []
I20260709 13:20:10.810676 10785 leader_election.cc:290] T 17587d6730594da4a56fa13a353232a1 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:20:10.785305 10967 raft_consensus.cc:493] T 4d9def8b32fd443aa94ab1420b06837b P b7ab4784c7344b939bc36f639286f377 [term 11 FOLLOWER]: Starting leader election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:20:10.852524 10967 raft_consensus.cc:3060] T 4d9def8b32fd443aa94ab1420b06837b P b7ab4784c7344b939bc36f639286f377 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:20:10.852170 10998 consensus_queue.cc:237] T 20f6842e26174571996b8dea4151d4be P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:10.856154 11059 raft_consensus.cc:3060] T 7c37d41cd9164c15a6826ca62a851a69 P b7ab4784c7344b939bc36f639286f377 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:20:10.842456 11052 raft_consensus.cc:515] T ce4f062dcd314d43a63ca74067cb5ee3 P cd75a17ab2604397adab03bb8b5fd75c [term 11 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } attrs { replace: true } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:20:10.766729 11061 raft_consensus.cc:515] T 30e88460611e47b2ba16a46a30b5f416 P b7ab4784c7344b939bc36f639286f377 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:10.799491 11042 raft_consensus.cc:3060] T bb7fa124c3bf4ef9ab65a407cb008441 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:20:10.816777 11040 leader_election.cc:290] T bb3d8792045a4583ae2e965b1350a5b4 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:20:10.824512 11086 raft_consensus.cc:3060] T 711ef6523deb4cbe8ef2ba61e1c21c98 P cd75a17ab2604397adab03bb8b5fd75c [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:20:10.788581 10708 raft_consensus.cc:740] T 90d42e216d9741e190bca19a781291fd P b7ab4784c7344b939bc36f639286f377 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
I20260709 13:20:10.826664 10987 leader_election.cc:290] T a3022224cc81473690653a83d4e99470 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 13 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
W20260709 13:20:10.827987 11073 log.cc:927] Time spent T 17587d6730594da4a56fa13a353232a1 P ccd8a4c3bfe3413cb2ae219b09aea832: Append to log took a long time: real 0.075s	user 0.001s	sys 0.000s
I20260709 13:20:10.820701  6881 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58592 (request call id 312) took 2049 ms. Trace:
I20260709 13:20:10.830621  6803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3411566abe2d4c9bb4b2adfdd05e6f17" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
W20260709 13:20:10.840796  6678 auto_rebalancer.cc:629] Failed to schedule move for tablet 1bf4668eeb70467fb3dc5a0289233b3c: Illegal state: Replica ccd8a4c3bfe3413cb2ae219b09aea832 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 11 leader_uuid: "b7ab4784c7344b939bc36f639286f377" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } }
I20260709 13:20:10.828384 11075 raft_consensus.cc:493] T f3f9c2e2bf644115957398fe4c9459db P cd75a17ab2604397adab03bb8b5fd75c [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:10.780751 10160 leader_election.cc:290] T 3a485a995abc4807b6e511e45419f737 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 11 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:10.851423  6732 rpcz_store.cc:276] 0709 13:20:09.051594 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:09.083967 (+ 32373us) service_pool.cc:224] Handling call
0709 13:20:09.100713 (+ 16746us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:09.834293 (+733580us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:10.847172 (+1012879us) spinlock_profiling.cc:243] Waited 613 ms on lock 0x7b5400058554. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f9aae01 00007fcc0f9a983e 00007fcc1496e419 00007fcc0dee5bd4 00007fcc0dee5b62 00007fcc0dee5a91 00007fcc0dee5a0c 00007fcc0dee4cc2 00007fcc0dce548c 00007fcc0dce48c6
0709 13:20:10.847399 (+   227us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1409198976}
I20260709 13:20:10.841861  6770 leader_election.cc:304] T f5be3a11b23d4ea9b08300a2789821c7 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
I20260709 13:20:10.859939 10818 raft_consensus.cc:3055] T 7c44c4849aa54f2b94d1f1bef9ed546f P b7ab4784c7344b939bc36f639286f377 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:20:10.873015 10818 raft_consensus.cc:740] T 7c44c4849aa54f2b94d1f1bef9ed546f P b7ab4784c7344b939bc36f639286f377 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
I20260709 13:20:10.866377 10918 raft_consensus.cc:493] T 9b3759de40694069b13c0f8bd40e5709 P b7ab4784c7344b939bc36f639286f377 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:20:10.873906 10818 consensus_queue.cc:260] T 7c44c4849aa54f2b94d1f1bef9ed546f P b7ab4784c7344b939bc36f639286f377 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
W20260709 13:20:10.860571 11078 log.cc:927] Time spent T 7ba5dac66ab5497e9e336f2a3c28cda5 P b7ab4784c7344b939bc36f639286f377: Append to log took a long time: real 0.258s	user 0.000s	sys 0.001s
I20260709 13:20:10.875454 10918 raft_consensus.cc:515] T 9b3759de40694069b13c0f8bd40e5709 P b7ab4784c7344b939bc36f639286f377 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:10.875721 10818 raft_consensus.cc:3060] T 7c44c4849aa54f2b94d1f1bef9ed546f P b7ab4784c7344b939bc36f639286f377 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:10.878104 10918 leader_election.cc:290] T 9b3759de40694069b13c0f8bd40e5709 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
W20260709 13:20:10.879906 11053 log.cc:927] Time spent T 404190ce4ce94cecbfcb6ea9d1dd8626 P 7ba59cc884714e8aa5f3f0ecaed84cbb: Append to log took a long time: real 0.545s	user 0.000s	sys 0.002s
I20260709 13:20:10.881147 10969 raft_consensus.cc:2804] T f5be3a11b23d4ea9b08300a2789821c7 P b7ab4784c7344b939bc36f639286f377 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:20:10.881613 10969 raft_consensus.cc:493] T f5be3a11b23d4ea9b08300a2789821c7 P b7ab4784c7344b939bc36f639286f377 [term 8 FOLLOWER]: Starting leader election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:20:10.881969 10969 raft_consensus.cc:3060] T f5be3a11b23d4ea9b08300a2789821c7 P b7ab4784c7344b939bc36f639286f377 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:20:10.882601 10487 consensus_queue.cc:1059] T 07a92dd554674067a83a9cb68c4773f2 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: INVALID_TERM, Last received: 10.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:20:10.885789 11043 consensus_queue.cc:1059] T 3d65025eea89441290d85dd053810e31 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: INVALID_TERM, Last received: 9.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
W20260709 13:20:10.866801  6771 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:10.869089 10708 consensus_queue.cc:260] T 90d42e216d9741e190bca19a781291fd P b7ab4784c7344b939bc36f639286f377 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:10.890079  6800 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f58dc08b12a2494bb9a1372837970ca2"
dest_uuid: "b7ab4784c7344b939bc36f639286f377"
mode: GRACEFUL
new_leader_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
 from {username='slave'} at 127.0.0.1:38240
I20260709 13:20:10.870347  6881 rpcz_store.cc:276] 0709 13:20:08.771366 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:08.841419 (+ 70053us) service_pool.cc:224] Handling call
0709 13:20:10.820416 (+1978997us) spinlock_profiling.cc:243] Waited 1.12 s on lock 0x7b5400217fd4. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f9ae2fa 00007fcc1496fb17 00007fcc0deea6d4 00007fcc0deea662 00007fcc0deea591 00007fcc0deea50c 00007fcc0dee97c2 00007fcc0dce548c 00007fcc0dce48c6 00007fcc0dce426f
0709 13:20:10.820621 (+   205us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2569175296}
I20260709 13:20:10.870628  6803 raft_consensus.cc:2468] T 3411566abe2d4c9bb4b2adfdd05e6f17 P b7ab4784c7344b939bc36f639286f377 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 9.
I20260709 13:20:10.891669  6802 raft_consensus.cc:1240] T 711ef6523deb4cbe8ef2ba61e1c21c98 P b7ab4784c7344b939bc36f639286f377 [term 12 FOLLOWER]: Rejecting Update request from peer ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 11. Current term is 12. Ops: []
I20260709 13:20:10.871166 11075 raft_consensus.cc:515] T f3f9c2e2bf644115957398fe4c9459db P cd75a17ab2604397adab03bb8b5fd75c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:10.874126 10983 raft_consensus.cc:493] T 1bf4668eeb70467fb3dc5a0289233b3c P ccd8a4c3bfe3413cb2ae219b09aea832 [term 11 FOLLOWER]: Starting leader election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:20:10.893960 10983 raft_consensus.cc:3060] T 1bf4668eeb70467fb3dc5a0289233b3c P ccd8a4c3bfe3413cb2ae219b09aea832 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:20:10.894829 11075 leader_election.cc:290] T f3f9c2e2bf644115957398fe4c9459db P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:20:10.896962 10695 raft_consensus.cc:3055] T 3d65025eea89441290d85dd053810e31 P b7ab4784c7344b939bc36f639286f377 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:20:10.897351 10695 raft_consensus.cc:740] T 3d65025eea89441290d85dd053810e31 P b7ab4784c7344b939bc36f639286f377 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
W20260709 13:20:10.897490  7467 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:10.898207 10695 consensus_queue.cc:260] T 3d65025eea89441290d85dd053810e31 P b7ab4784c7344b939bc36f639286f377 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.4, Last appended by leader: 4, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:10.899227  7503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b8cacb381b746da8d0049b0a83b41dd" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:20:10.899595 10695 raft_consensus.cc:3060] T 3d65025eea89441290d85dd053810e31 P b7ab4784c7344b939bc36f639286f377 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:20:10.900732  6803 raft_consensus.cc:1240] T 3a485a995abc4807b6e511e45419f737 P b7ab4784c7344b939bc36f639286f377 [term 11 FOLLOWER]: Rejecting Update request from peer ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 10. Current term is 11. Ops: []
I20260709 13:20:10.901078  7496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce4f062dcd314d43a63ca74067cb5ee3" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb"
I20260709 13:20:10.892990 10986 raft_consensus.cc:3060] T 17587d6730594da4a56fa13a353232a1 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:10.866255 11061 leader_election.cc:290] T 30e88460611e47b2ba16a46a30b5f416 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:10.904408 10727 leader_election.cc:290] T 427c124d773f483294511e80fe340075 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:20:10.907727  6697 leader_election.cc:304] T 07a92dd554674067a83a9cb68c4773f2 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377
I20260709 13:20:10.908658 10980 raft_consensus.cc:2804] T 07a92dd554674067a83a9cb68c4773f2 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:20:10.909089  6697 leader_election.cc:304] T ab432e62819d499eaaf3dd55481dd930 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:20:10.909529 10980 raft_consensus.cc:697] T 07a92dd554674067a83a9cb68c4773f2 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 11 LEADER]: Becoming Leader. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
I20260709 13:20:10.910624 10980 consensus_queue.cc:237] T 07a92dd554674067a83a9cb68c4773f2 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:10.911403  6881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44bde925b2e541b69890d70715b85176" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:10.912292  6872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3d8792045a4583ae2e965b1350a5b4" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:10.912557  6844 leader_election.cc:403] T e31b9971c15848dea59d4d4130141d9e P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 8 pre-election: Cancelling election due to peer responding with higher term
W20260709 13:20:10.913329  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 63485.4us
I20260709 13:20:10.913936  6872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "427c124d773f483294511e80fe340075" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:10.914085  6844 leader_election.cc:304] T f4b8bd455d5a47c18a1380839c6e0d61 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:20:10.914557  6872 raft_consensus.cc:2468] T 427c124d773f483294511e80fe340075 P cd75a17ab2604397adab03bb8b5fd75c [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 9.
I20260709 13:20:10.915479  6844 leader_election.cc:304] T 3a485a995abc4807b6e511e45419f737 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:20:10.912146  6881 raft_consensus.cc:2468] T 44bde925b2e541b69890d70715b85176 P cd75a17ab2604397adab03bb8b5fd75c [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 12.
I20260709 13:20:10.916934  6799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90d42e216d9741e190bca19a781291fd" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:20:10.918089  6803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c7f33e544204fbaac4078e3e83bbf4e" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:20:10.918354  6804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6869f07b5a4885a0b99fbe60c3b175" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:20:10.920581  6804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e326172347f45e99a0d482b5d8ef768" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:20:10.906721 11042 raft_consensus.cc:515] T bb7fa124c3bf4ef9ab65a407cb008441 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:20:10.932848  6872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09c2a98de1a4decabd0ff900dd44caa" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:10.933446  6873 raft_consensus.cc:1275] T 4275cf08e63345f993bce8664eada830 P cd75a17ab2604397adab03bb8b5fd75c [term 12 FOLLOWER]: Refusing update from remote peer ccd8a4c3bfe3413cb2ae219b09aea832: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 12 index: 6. (term mismatch)
I20260709 13:20:10.936395  6873 pending_rounds.cc:85] T 4275cf08e63345f993bce8664eada830 P cd75a17ab2604397adab03bb8b5fd75c: Aborting all ops after (but not including) 5
I20260709 13:20:10.936755  6873 pending_rounds.cc:107] T 4275cf08e63345f993bce8664eada830 P cd75a17ab2604397adab03bb8b5fd75c: Aborting uncommitted NO_OP operation due to leader change: 11.6
I20260709 13:20:10.937032  6873 raft_consensus.cc:2889] T 4275cf08e63345f993bce8664eada830 P cd75a17ab2604397adab03bb8b5fd75c [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:20:10.934755  7496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3d8792045a4583ae2e965b1350a5b4" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:20:10.935272  6844 leader_election.cc:304] T 427c124d773f483294511e80fe340075 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:20:10.941154  6877 raft_consensus.cc:1275] T 7a734b5ab7834e05a8c422208acc58b1 P cd75a17ab2604397adab03bb8b5fd75c [term 11 FOLLOWER]: Refusing update from remote peer ccd8a4c3bfe3413cb2ae219b09aea832: Log matching property violated. Preceding OpId in replica: term: 9 index: 4. Preceding OpId from leader: term: 11 index: 5. (index mismatch)
I20260709 13:20:10.941540  6803 raft_consensus.cc:1275] T f03d0dbf16864ca4bc1bb5e4c0334c0f P b7ab4784c7344b939bc36f639286f377 [term 10 FOLLOWER]: Refusing update from remote peer ccd8a4c3bfe3413cb2ae219b09aea832: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:20:10.943274  6872 raft_consensus.cc:2393] T f09c2a98de1a4decabd0ff900dd44caa P cd75a17ab2604397adab03bb8b5fd75c [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ccd8a4c3bfe3413cb2ae219b09aea832 in current term 13: Already voted for candidate cd75a17ab2604397adab03bb8b5fd75c in this term.
I20260709 13:20:10.945932  6697 leader_election.cc:304] T 9e326172347f45e99a0d482b5d8ef768 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
W20260709 13:20:10.946002  6773 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:10.947986  6773 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:10.951903  6844 leader_election.cc:304] T 95a75bfe094d4bdc963aba3f08dfcd25 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:20:10.953629  6844 leader_election.cc:304] T ab432e62819d499eaaf3dd55481dd930 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
W20260709 13:20:11.010064  6697 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 62635.8us
I20260709 13:20:11.011677  6697 leader_election.cc:304] T 90d42e216d9741e190bca19a781291fd P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:20:11.013130  6802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab432e62819d499eaaf3dd55481dd930" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:20:11.014806  6798 raft_consensus.cc:1275] T e77e330a82df4b43a745d57a68f6f057 P b7ab4784c7344b939bc36f639286f377 [term 14 FOLLOWER]: Refusing update from remote peer ccd8a4c3bfe3413cb2ae219b09aea832: Log matching property violated. Preceding OpId in replica: term: 11 index: 5. Preceding OpId from leader: term: 14 index: 7. (index mismatch)
I20260709 13:20:10.867072 11052 leader_election.cc:290] T ce4f062dcd314d43a63ca74067cb5ee3 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 11 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
W20260709 13:20:11.017372  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 63977.5us
I20260709 13:20:10.933281 10869 raft_consensus.cc:2749] T e31b9971c15848dea59d4d4130141d9e P cd75a17ab2604397adab03bb8b5fd75c [term 9 FOLLOWER]: Leader pre-election lost for term 8. Reason: Vote denied by peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391) with higher term. Message: Invalid argument: T e31b9971c15848dea59d4d4130141d9e P ccd8a4c3bfe3413cb2ae219b09aea832 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c for earlier term 8. Current term is 9.
I20260709 13:20:11.020882  6844 leader_election.cc:304] T 853ac0a8cbd64ce99457f170216d4d0f P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377
I20260709 13:20:10.935649 10727 raft_consensus.cc:2804] T ab432e62819d499eaaf3dd55481dd930 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:20:11.027014 10832 raft_consensus.cc:2804] T 9e326172347f45e99a0d482b5d8ef768 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:20:11.035543 10931 consensus_queue.cc:1048] T a1704639a875409b9959353527b3fd68 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.004s
I20260709 13:20:11.036453 11066 raft_consensus.cc:2749] T f4b8bd455d5a47c18a1380839c6e0d61 P cd75a17ab2604397adab03bb8b5fd75c [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
W20260709 13:20:11.038787  6695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 101641us
I20260709 13:20:11.016765 11075 raft_consensus.cc:493] T fe20b4b48823486ca3b9c648db6ce8aa P cd75a17ab2604397adab03bb8b5fd75c [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:11.040479 11075 raft_consensus.cc:515] T fe20b4b48823486ca3b9c648db6ce8aa P cd75a17ab2604397adab03bb8b5fd75c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:20:11.041628 10580 consensus_queue.cc:1059] T 3a485a995abc4807b6e511e45419f737 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:20:10.882664 10976 leader_election.cc:290] T 427c124d773f483294511e80fe340075 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:11.043182  6804 raft_consensus.cc:1275] T 17587d6730594da4a56fa13a353232a1 P b7ab4784c7344b939bc36f639286f377 [term 16 FOLLOWER]: Refusing update from remote peer ccd8a4c3bfe3413cb2ae219b09aea832: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:20:11.012666 11008 raft_consensus.cc:2749] T 427c124d773f483294511e80fe340075 P cd75a17ab2604397adab03bb8b5fd75c [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:20:11.046862  6880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b8cacb381b746da8d0049b0a83b41dd" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:11.047742  6881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe20b4b48823486ca3b9c648db6ce8aa" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:11.049772  6804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09c2a98de1a4decabd0ff900dd44caa" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:11.046077  6875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3d8792045a4583ae2e965b1350a5b4" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:11.057775  6881 raft_consensus.cc:2468] T fe20b4b48823486ca3b9c648db6ce8aa P cd75a17ab2604397adab03bb8b5fd75c [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in term 9.
I20260709 13:20:11.050375  6873 raft_consensus.cc:1275] T 7ba5dac66ab5497e9e336f2a3c28cda5 P cd75a17ab2604397adab03bb8b5fd75c [term 12 FOLLOWER]: Refusing update from remote peer 7ba59cc884714e8aa5f3f0ecaed84cbb: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:20:11.020613 11006 raft_consensus.cc:2749] T ab432e62819d499eaaf3dd55481dd930 P cd75a17ab2604397adab03bb8b5fd75c [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:20:11.053470  6876 raft_consensus.cc:1275] T 4b8cacb381b746da8d0049b0a83b41dd P cd75a17ab2604397adab03bb8b5fd75c [term 12 FOLLOWER]: Refusing update from remote peer 7ba59cc884714e8aa5f3f0ecaed84cbb: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 10. (term mismatch)
I20260709 13:20:11.065219  6876 pending_rounds.cc:85] T 4b8cacb381b746da8d0049b0a83b41dd P cd75a17ab2604397adab03bb8b5fd75c: Aborting all ops after (but not including) 9
I20260709 13:20:11.060204  6804 raft_consensus.cc:1275] T a1704639a875409b9959353527b3fd68 P b7ab4784c7344b939bc36f639286f377 [term 12 FOLLOWER]: Refusing update from remote peer ccd8a4c3bfe3413cb2ae219b09aea832: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:20:11.065490  6876 pending_rounds.cc:107] T 4b8cacb381b746da8d0049b0a83b41dd P cd75a17ab2604397adab03bb8b5fd75c: Aborting uncommitted NO_OP operation due to leader change: 11.10
I20260709 13:20:11.065750  6876 raft_consensus.cc:2889] T 4b8cacb381b746da8d0049b0a83b41dd P cd75a17ab2604397adab03bb8b5fd75c [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:20:11.063046  6878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe20b4b48823486ca3b9c648db6ce8aa" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:20:11.067178  6878 raft_consensus.cc:3060] T fe20b4b48823486ca3b9c648db6ce8aa P cd75a17ab2604397adab03bb8b5fd75c [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:20:11.063361  6805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "427c124d773f483294511e80fe340075" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
W20260709 13:20:11.050944  6773 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:11.071309  6773 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:11.075137  6844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:11.076450  6806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44bde925b2e541b69890d70715b85176" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:11.008294 11036 consensus_queue.cc:1048] T b3f13b31a1f84f0d89d007eadd57924c P 7ba59cc884714e8aa5f3f0ecaed84cbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.049s
I20260709 13:20:11.077286  6801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5be3a11b23d4ea9b08300a2789821c7" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
W20260709 13:20:11.080590  6697 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 69038.4us
I20260709 13:20:11.105952  6697 leader_election.cc:304] T f5be3a11b23d4ea9b08300a2789821c7 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:20:11.081530  6876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "427c124d773f483294511e80fe340075" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:11.108026  6876 raft_consensus.cc:2468] T 427c124d773f483294511e80fe340075 P cd75a17ab2604397adab03bb8b5fd75c [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in term 9.
I20260709 13:20:11.084462  6877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b8cacb381b746da8d0049b0a83b41dd" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:20:11.052443 11047 raft_consensus.cc:2804] T 853ac0a8cbd64ce99457f170216d4d0f P cd75a17ab2604397adab03bb8b5fd75c [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:20:11.086136  6880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24ee15416e3145beaa1b8183453729a3" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 12 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:11.110761  6880 raft_consensus.cc:2393] T 24ee15416e3145beaa1b8183453729a3 P cd75a17ab2604397adab03bb8b5fd75c [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in current term 12: Already voted for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in this term.
I20260709 13:20:11.078832 10727 raft_consensus.cc:697] T ab432e62819d499eaaf3dd55481dd930 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 13 LEADER]: Becoming Leader. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
I20260709 13:20:11.063087 11075 leader_election.cc:290] T fe20b4b48823486ca3b9c648db6ce8aa P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:20:11.057313 11066 raft_consensus.cc:493] T f03d0dbf16864ca4bc1bb5e4c0334c0f P cd75a17ab2604397adab03bb8b5fd75c [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:20:11.090399 11081 log.cc:927] Time spent T 4f00a2e87e56452083b759f60d461ee3 P 7ba59cc884714e8aa5f3f0ecaed84cbb: Append to log took a long time: real 0.593s	user 0.003s	sys 0.000s
W20260709 13:20:11.114876  6772 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 419680us
I20260709 13:20:11.116287  6772 leader_election.cc:304] T 2c240553ce044eedb41541d72b9475d7 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:20:11.055002 11052 consensus_queue.cc:1059] T 20f6842e26174571996b8dea4151d4be P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.047s
I20260709 13:20:11.113880  6798 raft_consensus.cc:1240] T a3022224cc81473690653a83d4e99470 P b7ab4784c7344b939bc36f639286f377 [term 13 FOLLOWER]: Rejecting Update request from peer ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 12. Current term is 13. Ops: []
I20260709 13:20:11.050765 11065 raft_consensus.cc:515] T f58dc08b12a2494bb9a1372837970ca2 P b7ab4784c7344b939bc36f639286f377 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:11.112291  6697 leader_election.cc:304] T 8c7f33e544204fbaac4078e3e83bbf4e P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:20:11.061116 10832 raft_consensus.cc:697] T 9e326172347f45e99a0d482b5d8ef768 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 11 LEADER]: Becoming Leader. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
I20260709 13:20:11.120149  6844 leader_election.cc:304] T 7887766dc6784fcaa42b35c05fea7a99 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:20:11.122284  6802 raft_consensus.cc:2468] T ab432e62819d499eaaf3dd55481dd930 P b7ab4784c7344b939bc36f639286f377 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 13.
I20260709 13:20:11.110046 10758 raft_consensus.cc:993] T de3186201e1a40d0b335eeb8b4e256e0 P ccd8a4c3bfe3413cb2ae219b09aea832: : Instructing follower cd75a17ab2604397adab03bb8b5fd75c to start an election
I20260709 13:20:11.133670  6772 leader_election.cc:304] T 20f6842e26174571996b8dea4151d4be P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:20:11.139242  6877 raft_consensus.cc:2468] T 4b8cacb381b746da8d0049b0a83b41dd P cd75a17ab2604397adab03bb8b5fd75c [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in term 12.
I20260709 13:20:11.105557 11040 raft_consensus.cc:2804] T 90d42e216d9741e190bca19a781291fd P ccd8a4c3bfe3413cb2ae219b09aea832 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:20:11.160490  6878 raft_consensus.cc:2468] T fe20b4b48823486ca3b9c648db6ce8aa P cd75a17ab2604397adab03bb8b5fd75c [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in term 10.
I20260709 13:20:11.112582 10936 raft_consensus.cc:2804] T f5be3a11b23d4ea9b08300a2789821c7 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:20:11.110314 11047 raft_consensus.cc:493] T 853ac0a8cbd64ce99457f170216d4d0f P cd75a17ab2604397adab03bb8b5fd75c [term 8 FOLLOWER]: Starting leader election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:20:11.192875 10936 raft_consensus.cc:493] T f5be3a11b23d4ea9b08300a2789821c7 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:11.193482 10936 raft_consensus.cc:3060] T f5be3a11b23d4ea9b08300a2789821c7 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:20:11.193127 10727 consensus_queue.cc:237] T ab432e62819d499eaaf3dd55481dd930 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.6, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:11.195281 10969 raft_consensus.cc:515] T f5be3a11b23d4ea9b08300a2789821c7 P b7ab4784c7344b939bc36f639286f377 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
W20260709 13:20:11.189797  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 85439.4us
I20260709 13:20:11.198638  6844 leader_election.cc:304] T 7a734b5ab7834e05a8c422208acc58b1 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:20:11.200146  6844 leader_election.cc:304] T de3186201e1a40d0b335eeb8b4e256e0 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:20:11.191478  6800 raft_consensus.cc:606] T f58dc08b12a2494bb9a1372837970ca2 P b7ab4784c7344b939bc36f639286f377 [term 14 FOLLOWER]: Received request to transfer leadership to TS cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:20:11.202574  6800 raft_consensus.cc:614] T f58dc08b12a2494bb9a1372837970ca2 P b7ab4784c7344b939bc36f639286f377 [term 14 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:20:11.140635 10534 raft_consensus.cc:2804] T 2c240553ce044eedb41541d72b9475d7 P b7ab4784c7344b939bc36f639286f377 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:20:11.223019 11093 raft_consensus.cc:2749] T 95a75bfe094d4bdc963aba3f08dfcd25 P cd75a17ab2604397adab03bb8b5fd75c [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:20:11.219408 10869 raft_consensus.cc:2804] T 7a734b5ab7834e05a8c422208acc58b1 P cd75a17ab2604397adab03bb8b5fd75c [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:20:11.224402 10869 raft_consensus.cc:493] T 7a734b5ab7834e05a8c422208acc58b1 P cd75a17ab2604397adab03bb8b5fd75c [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:11.133131 11066 raft_consensus.cc:515] T f03d0dbf16864ca4bc1bb5e4c0334c0f P cd75a17ab2604397adab03bb8b5fd75c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:11.224503 11062 raft_consensus.cc:3060] T c4db81d9d329422bb3b4160ca4ac2d1d P b7ab4784c7344b939bc36f639286f377 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:20:11.226337 11086 raft_consensus.cc:2749] T 711ef6523deb4cbe8ef2ba61e1c21c98 P cd75a17ab2604397adab03bb8b5fd75c [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:20:11.226574 11066 leader_election.cc:290] T f03d0dbf16864ca4bc1bb5e4c0334c0f P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:20:11.192584 11052 consensus_queue.cc:1243] T 20f6842e26174571996b8dea4151d4be P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Peer ccd8a4c3bfe3413cb2ae219b09aea832 log is divergent from this leader: its last log entry 11.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 13:20:11.197575 11075 raft_consensus.cc:2804] T 7887766dc6784fcaa42b35c05fea7a99 P cd75a17ab2604397adab03bb8b5fd75c [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:20:11.227559 11075 raft_consensus.cc:493] T 7887766dc6784fcaa42b35c05fea7a99 P cd75a17ab2604397adab03bb8b5fd75c [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:11.227591 11086 raft_consensus.cc:2804] T de3186201e1a40d0b335eeb8b4e256e0 P cd75a17ab2604397adab03bb8b5fd75c [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:20:11.228211 11075 raft_consensus.cc:3060] T 7887766dc6784fcaa42b35c05fea7a99 P cd75a17ab2604397adab03bb8b5fd75c [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:20:11.228300 11086 raft_consensus.cc:493] T de3186201e1a40d0b335eeb8b4e256e0 P cd75a17ab2604397adab03bb8b5fd75c [term 11 FOLLOWER]: Starting leader election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:20:11.228888 11086 raft_consensus.cc:3060] T de3186201e1a40d0b335eeb8b4e256e0 P cd75a17ab2604397adab03bb8b5fd75c [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:20:11.238933 10650 leader_election.cc:290] T d8cee0accdb8499c86d4414b72565a38 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:11.197693 11047 raft_consensus.cc:3060] T 853ac0a8cbd64ce99457f170216d4d0f P cd75a17ab2604397adab03bb8b5fd75c [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:20:11.197480 11059 raft_consensus.cc:515] T 7c37d41cd9164c15a6826ca62a851a69 P b7ab4784c7344b939bc36f639286f377 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:11.248534  6801 raft_consensus.cc:2468] T f5be3a11b23d4ea9b08300a2789821c7 P b7ab4784c7344b939bc36f639286f377 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 9.
I20260709 13:20:11.257952  6806 raft_consensus.cc:1240] T 7c37d41cd9164c15a6826ca62a851a69 P b7ab4784c7344b939bc36f639286f377 [term 11 FOLLOWER]: Rejecting Update request from peer ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 10. Current term is 11. Ops: []
W20260709 13:20:11.270411  6874 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.510s	user 0.032s	sys 0.045s
W20260709 13:20:11.271540  6874 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.512s	user 0.032s	sys 0.045s
I20260709 13:20:11.246145  6803 raft_consensus.cc:1275] T 7a734b5ab7834e05a8c422208acc58b1 P b7ab4784c7344b939bc36f639286f377 [term 11 FOLLOWER]: Refusing update from remote peer ccd8a4c3bfe3413cb2ae219b09aea832: Log matching property violated. Preceding OpId in replica: term: 9 index: 4. Preceding OpId from leader: term: 11 index: 5. (index mismatch)
I20260709 13:20:11.243975  7468 leader_election.cc:304] T bb3d8792045a4583ae2e965b1350a5b4 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:20:11.221956 10818 raft_consensus.cc:2749] T 20f6842e26174571996b8dea4151d4be P b7ab4784c7344b939bc36f639286f377 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:20:11.221056 10534 raft_consensus.cc:493] T 2c240553ce044eedb41541d72b9475d7 P b7ab4784c7344b939bc36f639286f377 [term 12 FOLLOWER]: Starting leader election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
W20260709 13:20:11.293255  7468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 49365.2us
I20260709 13:20:11.299218  6877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8cee0accdb8499c86d4414b72565a38" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:11.299381  6878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b8cacb381b746da8d0049b0a83b41dd" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:20:11.248555 10869 raft_consensus.cc:3060] T 7a734b5ab7834e05a8c422208acc58b1 P cd75a17ab2604397adab03bb8b5fd75c [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:20:11.299943  6878 raft_consensus.cc:2376] T 4b8cacb381b746da8d0049b0a83b41dd P cd75a17ab2604397adab03bb8b5fd75c [term 12 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in term 12. Re-sending same reply.
I20260709 13:20:11.299964  6877 raft_consensus.cc:2468] T d8cee0accdb8499c86d4414b72565a38 P cd75a17ab2604397adab03bb8b5fd75c [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in term 10.
I20260709 13:20:11.287546 11008 raft_consensus.cc:493] T d33d5ee8ef6f415593d8df52063161ad P cd75a17ab2604397adab03bb8b5fd75c [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:11.293191 11042 leader_election.cc:290] T bb7fa124c3bf4ef9ab65a407cb008441 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 12 election: Requested vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:11.296443 10534 raft_consensus.cc:3060] T 2c240553ce044eedb41541d72b9475d7 P b7ab4784c7344b939bc36f639286f377 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:11.305374 10860 consensus_queue.cc:1048] T 7ba5dac66ab5497e9e336f2a3c28cda5 P 7ba59cc884714e8aa5f3f0ecaed84cbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.018s
I20260709 13:20:11.321652 11086 raft_consensus.cc:515] T de3186201e1a40d0b335eeb8b4e256e0 P cd75a17ab2604397adab03bb8b5fd75c [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
W20260709 13:20:11.296535 10989 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.509s	user 0.006s	sys 0.042s
I20260709 13:20:11.298264 10915 raft_consensus.cc:2749] T bb3d8792045a4583ae2e965b1350a5b4 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:20:11.257578 11059 leader_election.cc:290] T 7c37d41cd9164c15a6826ca62a851a69 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 11 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:11.249727 10993 consensus_queue.cc:1059] T 3fa34c08b205435dba97346991aa1f92 P 7ba59cc884714e8aa5f3f0ecaed84cbb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.057s
I20260709 13:20:11.245676 10249 consensus_queue.cc:1048] T 1bf4668eeb70467fb3dc5a0289233b3c P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.060s
W20260709 13:20:11.354836  7468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 58638.2us
I20260709 13:20:11.298499 10921 raft_consensus.cc:493] T 22ccee1b570c4ad3a57bd7aec085b1b4 P cd75a17ab2604397adab03bb8b5fd75c [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:11.250387 11093 consensus_queue.cc:1059] T 20f6842e26174571996b8dea4151d4be P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.091s
I20260709 13:20:11.315276 10700 raft_consensus.cc:2804] T 8c7f33e544204fbaac4078e3e83bbf4e P ccd8a4c3bfe3413cb2ae219b09aea832 [term 9 FOLLOWER]: Leader election won for term 9
W20260709 13:20:11.426252  6730 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.696s	user 0.019s	sys 0.017s
W20260709 13:20:11.473423  6730 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.744s	user 0.020s	sys 0.017s
I20260709 13:20:11.447427  7468 leader_election.cc:304] T 24ee15416e3145beaa1b8183453729a3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
W20260709 13:20:11.444610 10998 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.583s	user 0.015s	sys 0.042s
I20260709 13:20:11.298971 11013 consensus_queue.cc:1048] T f03d0dbf16864ca4bc1bb5e4c0334c0f P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.078s
W20260709 13:20:11.426923 10989 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.639s	user 0.007s	sys 0.043s
I20260709 13:20:11.489456  7468 leader_election.cc:304] T fe20b4b48823486ca3b9c648db6ce8aa P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, cd75a17ab2604397adab03bb8b5fd75c; no voters: ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:20:11.496620  7468 leader_election.cc:304] T d8cee0accdb8499c86d4414b72565a38 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
W20260709 13:20:11.373587 10930 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.504s	user 0.014s	sys 0.013s
I20260709 13:20:11.338547 10818 consensus_queue.cc:1059] T f4b8bd455d5a47c18a1380839c6e0d61 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.134s
I20260709 13:20:11.514554 10860 raft_consensus.cc:2804] T fe20b4b48823486ca3b9c648db6ce8aa P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:20:11.515215 10860 raft_consensus.cc:697] T fe20b4b48823486ca3b9c648db6ce8aa P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 10 LEADER]: Becoming Leader. State: Replica: 7ba59cc884714e8aa5f3f0ecaed84cbb, State: Running, Role: LEADER
I20260709 13:20:11.516116 10860 consensus_queue.cc:237] T fe20b4b48823486ca3b9c648db6ce8aa P 7ba59cc884714e8aa5f3f0ecaed84cbb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:20:11.510234 11052 raft_consensus.cc:493] T d8292e16e5654be6bc408560cf256aaa P cd75a17ab2604397adab03bb8b5fd75c [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:11.518019 11075 raft_consensus.cc:515] T 7887766dc6784fcaa42b35c05fea7a99 P cd75a17ab2604397adab03bb8b5fd75c [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:11.518797 11026 raft_consensus.cc:3060] T 34f36d59d88f40fe8a2805e604fc6c0a P b7ab4784c7344b939bc36f639286f377 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:20:11.518992 11052 raft_consensus.cc:515] T d8292e16e5654be6bc408560cf256aaa P cd75a17ab2604397adab03bb8b5fd75c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:11.522127 11052 leader_election.cc:290] T d8292e16e5654be6bc408560cf256aaa P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:20:11.524784 10938 raft_consensus.cc:3055] T f4b8bd455d5a47c18a1380839c6e0d61 P b7ab4784c7344b939bc36f639286f377 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:20:11.525223 10938 raft_consensus.cc:740] T f4b8bd455d5a47c18a1380839c6e0d61 P b7ab4784c7344b939bc36f639286f377 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
I20260709 13:20:11.526094 10938 consensus_queue.cc:260] T f4b8bd455d5a47c18a1380839c6e0d61 P b7ab4784c7344b939bc36f639286f377 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:11.527313 10938 raft_consensus.cc:3060] T f4b8bd455d5a47c18a1380839c6e0d61 P b7ab4784c7344b939bc36f639286f377 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:20:11.532226 10993 raft_consensus.cc:2804] T d8cee0accdb8499c86d4414b72565a38 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:20:11.532415  7496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe20b4b48823486ca3b9c648db6ce8aa" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:20:11.532765 10993 raft_consensus.cc:493] T d8cee0accdb8499c86d4414b72565a38 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:11.533142 10993 raft_consensus.cc:3060] T d8cee0accdb8499c86d4414b72565a38 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:20:11.499155 11038 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.736s	user 0.018s	sys 0.039s
W20260709 13:20:11.535378 11038 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.773s	user 0.018s	sys 0.039s
I20260709 13:20:11.298650 10832 consensus_queue.cc:237] T 9e326172347f45e99a0d482b5d8ef768 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:11.537081 10976 raft_consensus.cc:3055] T 3fa34c08b205435dba97346991aa1f92 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:20:11.537539 10976 raft_consensus.cc:740] T 3fa34c08b205435dba97346991aa1f92 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 7ba59cc884714e8aa5f3f0ecaed84cbb, State: Running, Role: LEADER
I20260709 13:20:11.538381 10976 consensus_queue.cc:260] T 3fa34c08b205435dba97346991aa1f92 P 7ba59cc884714e8aa5f3f0ecaed84cbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:20:11.539598 10976 raft_consensus.cc:3060] T 3fa34c08b205435dba97346991aa1f92 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:11.541800 10708 raft_consensus.cc:3060] T 90d42e216d9741e190bca19a781291fd P b7ab4784c7344b939bc36f639286f377 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:20:11.542802 10969 leader_election.cc:290] T f5be3a11b23d4ea9b08300a2789821c7 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 9 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
W20260709 13:20:11.544191 11096 log.cc:927] Time spent T dbdf895bba214ff68685a24fd17dfb5d P ccd8a4c3bfe3413cb2ae219b09aea832: Append to log took a long time: real 0.056s	user 0.000s	sys 0.001s
W20260709 13:20:11.498751 10987 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.611s	user 0.002s	sys 0.015s
W20260709 13:20:11.546756 10987 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.659s	user 0.003s	sys 0.016s
I20260709 13:20:11.548177 10700 raft_consensus.cc:697] T 8c7f33e544204fbaac4078e3e83bbf4e P ccd8a4c3bfe3413cb2ae219b09aea832 [term 9 LEADER]: Becoming Leader. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
I20260709 13:20:11.549222 10700 consensus_queue.cc:237] T 8c7f33e544204fbaac4078e3e83bbf4e P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:11.376834 11036 consensus_queue.cc:1048] T 4b8cacb381b746da8d0049b0a83b41dd P 7ba59cc884714e8aa5f3f0ecaed84cbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.123s
I20260709 13:20:11.340341 11008 raft_consensus.cc:515] T d33d5ee8ef6f415593d8df52063161ad P cd75a17ab2604397adab03bb8b5fd75c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
W20260709 13:20:11.492730 10967 consensus_meta.cc:287] T 4d9def8b32fd443aa94ab1420b06837b P b7ab4784c7344b939bc36f639286f377: Time spent flushing consensus metadata: real 0.640s	user 0.011s	sys 0.000s
W20260709 13:20:11.488844 10998 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.627s	user 0.015s	sys 0.042s
W20260709 13:20:11.566847  6879 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.784s	user 0.008s	sys 0.038s
W20260709 13:20:11.498348 10487 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.615s	user 0.007s	sys 0.011s
W20260709 13:20:11.570137  6879 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.792s	user 0.009s	sys 0.038s
I20260709 13:20:11.487737 11093 consensus_queue.cc:1243] T 20f6842e26174571996b8dea4151d4be P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Peer b7ab4784c7344b939bc36f639286f377 log is divergent from this leader: its last log entry 6.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
W20260709 13:20:11.513662 10930 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.678s	user 0.017s	sys 0.017s
I20260709 13:20:11.495210 10915 raft_consensus.cc:2749] T 24ee15416e3145beaa1b8183453729a3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:20:11.510488 11059 raft_consensus.cc:493] T a1704639a875409b9959353527b3fd68 P b7ab4784c7344b939bc36f639286f377 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:20:11.583372  6770 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.701s	user 0.002s	sys 0.020s
I20260709 13:20:11.474238 10921 raft_consensus.cc:515] T 22ccee1b570c4ad3a57bd7aec085b1b4 P cd75a17ab2604397adab03bb8b5fd75c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
W20260709 13:20:11.591526  6696 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.549s	user 0.016s	sys 0.021s
W20260709 13:20:11.589617  6695 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.547s	user 0.004s	sys 0.035s
W20260709 13:20:11.598183  6695 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.556s	user 0.004s	sys 0.035s
W20260709 13:20:11.591145  6770 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.709s	user 0.002s	sys 0.020s
W20260709 13:20:11.598637  6695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 556469us
W20260709 13:20:11.600154  6770 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 718203us
W20260709 13:20:11.583653 10487 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.687s	user 0.007s	sys 0.011s
W20260709 13:20:11.599033  6696 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.556s	user 0.016s	sys 0.022s
W20260709 13:20:11.586577 10785 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.697s	user 0.013s	sys 0.005s
I20260709 13:20:11.590446 10998 raft_consensus.cc:1081] T de3186201e1a40d0b335eeb8b4e256e0 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 11 LEADER]: Signalling peer cd75a17ab2604397adab03bb8b5fd75c to start an election
W20260709 13:20:11.606463 10785 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.717s	user 0.013s	sys 0.006s
I20260709 13:20:11.592082 11065 leader_election.cc:290] T f58dc08b12a2494bb9a1372837970ca2 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 14 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
W20260709 13:20:11.606384 10920 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.511s	user 0.011s	sys 0.027s
I20260709 13:20:11.571336 10967 raft_consensus.cc:515] T 4d9def8b32fd443aa94ab1420b06837b P b7ab4784c7344b939bc36f639286f377 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
W20260709 13:20:11.616773  6772 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 460233us
W20260709 13:20:11.616384  6773 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:11.625289  6697 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 491630us
W20260709 13:20:11.608122 10580 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.566s	user 0.017s	sys 0.023s
I20260709 13:20:11.629182  6728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de3186201e1a40d0b335eeb8b4e256e0" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:11.630683  6724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09c2a98de1a4decabd0ff900dd44caa" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:20:11.645689  6724 raft_consensus.cc:3060] T f09c2a98de1a4decabd0ff900dd44caa P ccd8a4c3bfe3413cb2ae219b09aea832 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:11.631560  6727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fa34c08b205435dba97346991aa1f92" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:20:11.652321  6844 leader_election.cc:304] T 3411566abe2d4c9bb4b2adfdd05e6f17 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:20:11.655467  6726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b3759de40694069b13c0f8bd40e5709" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:11.657197  6803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1704639a875409b9959353527b3fd68" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:11.659332  6805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbdf895bba214ff68685a24fd17dfb5d" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 11 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:11.653463  6727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b8cacb381b746da8d0049b0a83b41dd" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:11.659550  6802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce4f062dcd314d43a63ca74067cb5ee3" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:20:11.660521  6802 raft_consensus.cc:3060] T ce4f062dcd314d43a63ca74067cb5ee3 P b7ab4784c7344b939bc36f639286f377 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:20:11.660526  6727 raft_consensus.cc:2468] T 4b8cacb381b746da8d0049b0a83b41dd P ccd8a4c3bfe3413cb2ae219b09aea832 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 12.
W20260709 13:20:11.615509 10918 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.555s	user 0.019s	sys 0.020s
W20260709 13:20:11.662483 10918 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.612s	user 0.019s	sys 0.020s
I20260709 13:20:11.638762  6697 leader_election.cc:304] T bd6869f07b5a4885a0b99fbe60c3b175 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377
W20260709 13:20:11.637785  6773 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:11.673144  6726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbdf895bba214ff68685a24fd17dfb5d" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 11 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:11.674360  6726 raft_consensus.cc:2410] T dbdf895bba214ff68685a24fd17dfb5d P ccd8a4c3bfe3413cb2ae219b09aea832 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c for term 11 because replica has last-logged OpId of term: 10 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 4.
I20260709 13:20:11.676121  6726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce4f062dcd314d43a63ca74067cb5ee3" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:20:11.676995  6804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "427c124d773f483294511e80fe340075" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:11.678447  6804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb7fa124c3bf4ef9ab65a407cb008441" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:20:11.678998  6804 raft_consensus.cc:3060] T bb7fa124c3bf4ef9ab65a407cb008441 P b7ab4784c7344b939bc36f639286f377 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:20:11.681384 10972 leader_election.cc:290] T bb7fa124c3bf4ef9ab65a407cb008441 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:11.681588  6726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f9c2e2bf644115957398fe4c9459db" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:11.683085  6726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe20b4b48823486ca3b9c648db6ce8aa" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:11.683805  6726 raft_consensus.cc:2393] T fe20b4b48823486ca3b9c648db6ce8aa P ccd8a4c3bfe3413cb2ae219b09aea832 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c in current term 10: Already voted for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in this term.
I20260709 13:20:11.685175  6872 raft_consensus.cc:1240] T ce4f062dcd314d43a63ca74067cb5ee3 P cd75a17ab2604397adab03bb8b5fd75c [term 11 FOLLOWER]: Rejecting Update request from peer 7ba59cc884714e8aa5f3f0ecaed84cbb for earlier term 10. Current term is 11. Ops: []
I20260709 13:20:11.685477 11010 consensus_queue.cc:1048] T f03d0dbf16864ca4bc1bb5e4c0334c0f P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:20:11.686844 11092 raft_consensus.cc:3055] T 20f6842e26174571996b8dea4151d4be P cd75a17ab2604397adab03bb8b5fd75c [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:20:11.687371  6877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb7fa124c3bf4ef9ab65a407cb008441" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:20:11.687759 11092 raft_consensus.cc:740] T 20f6842e26174571996b8dea4151d4be P cd75a17ab2604397adab03bb8b5fd75c [term 12 LEADER]: Becoming Follower/Learner. State: Replica: cd75a17ab2604397adab03bb8b5fd75c, State: Running, Role: LEADER
I20260709 13:20:11.688072  6877 raft_consensus.cc:3060] T bb7fa124c3bf4ef9ab65a407cb008441 P cd75a17ab2604397adab03bb8b5fd75c [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:20:11.689033 11092 consensus_queue.cc:260] T 20f6842e26174571996b8dea4151d4be P cd75a17ab2604397adab03bb8b5fd75c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:11.689714  6726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f03d0dbf16864ca4bc1bb5e4c0334c0f" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:11.690054 11092 raft_consensus.cc:3060] T 20f6842e26174571996b8dea4151d4be P cd75a17ab2604397adab03bb8b5fd75c [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:11.693902 11010 consensus_queue.cc:1048] T e77e330a82df4b43a745d57a68f6f057 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:20:11.694065  6800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f03d0dbf16864ca4bc1bb5e4c0334c0f" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:11.697212  6727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7887766dc6784fcaa42b35c05fea7a99" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:20:11.702633  6800 raft_consensus.cc:2468] T f03d0dbf16864ca4bc1bb5e4c0334c0f P b7ab4784c7344b939bc36f639286f377 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 10.
I20260709 13:20:11.704381  6800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8cee0accdb8499c86d4414b72565a38" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:11.706313  6800 raft_consensus.cc:2393] T d8cee0accdb8499c86d4414b72565a38 P b7ab4784c7344b939bc36f639286f377 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in current term 11: Already voted for candidate b7ab4784c7344b939bc36f639286f377 in this term.
I20260709 13:20:11.707824  6800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8292e16e5654be6bc408560cf256aaa" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 16 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:11.709079  6800 raft_consensus.cc:2410] T d8292e16e5654be6bc408560cf256aaa P b7ab4784c7344b939bc36f639286f377 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c for term 16 because replica has last-logged OpId of term: 14 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 7.
I20260709 13:20:11.710014 10160 raft_consensus.cc:3055] T 07a92dd554674067a83a9cb68c4773f2 P b7ab4784c7344b939bc36f639286f377 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:20:11.710438  6800 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f5be3a11b23d4ea9b08300a2789821c7"
dest_uuid: "b7ab4784c7344b939bc36f639286f377"
mode: GRACEFUL
new_leader_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
 from {username='slave'} at 127.0.0.1:38240
I20260709 13:20:11.710794 10160 raft_consensus.cc:740] T 07a92dd554674067a83a9cb68c4773f2 P b7ab4784c7344b939bc36f639286f377 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
I20260709 13:20:11.711194  6800 raft_consensus.cc:606] T f5be3a11b23d4ea9b08300a2789821c7 P b7ab4784c7344b939bc36f639286f377 [term 9 FOLLOWER]: Received request to transfer leadership to TS cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:20:11.711053 11023 consensus_queue.cc:1048] T 17587d6730594da4a56fa13a353232a1 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:20:11.711759  6800 raft_consensus.cc:614] T f5be3a11b23d4ea9b08300a2789821c7 P b7ab4784c7344b939bc36f639286f377 [term 9 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:20:11.712466 10160 consensus_queue.cc:260] T 07a92dd554674067a83a9cb68c4773f2 P b7ab4784c7344b939bc36f639286f377 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 5, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:11.714178  5625 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 13:20:11.714627 10930 raft_consensus.cc:493] T 4b8cacb381b746da8d0049b0a83b41dd P ccd8a4c3bfe3413cb2ae219b09aea832 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:11.714495 10160 raft_consensus.cc:3060] T 07a92dd554674067a83a9cb68c4773f2 P b7ab4784c7344b939bc36f639286f377 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:20:11.716492  5625 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:20:11.696651  6877 raft_consensus.cc:2468] T bb7fa124c3bf4ef9ab65a407cb008441 P cd75a17ab2604397adab03bb8b5fd75c [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in term 12.
I20260709 13:20:11.715272 10930 raft_consensus.cc:515] T 4b8cacb381b746da8d0049b0a83b41dd P ccd8a4c3bfe3413cb2ae219b09aea832 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:20:11.698786  6726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8292e16e5654be6bc408560cf256aaa" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 16 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:11.719827  6729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7887766dc6784fcaa42b35c05fea7a99" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:11.598403 11059 raft_consensus.cc:515] T a1704639a875409b9959353527b3fd68 P b7ab4784c7344b939bc36f639286f377 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:11.720918  6844 leader_election.cc:304] T f03d0dbf16864ca4bc1bb5e4c0334c0f P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:20:11.727080  6807 raft_consensus.cc:2468] T c4db81d9d329422bb3b4160ca4ac2d1d P b7ab4784c7344b939bc36f639286f377 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 10.
W20260709 13:20:11.634404 10920 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.533s	user 0.011s	sys 0.027s
W20260709 13:20:11.730906  7468 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:11.655133 10580 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.603s	user 0.017s	sys 0.023s
I20260709 13:20:11.733469  6880 raft_consensus.cc:1275] T 4f00a2e87e56452083b759f60d461ee3 P cd75a17ab2604397adab03bb8b5fd75c [term 12 FOLLOWER]: Refusing update from remote peer 7ba59cc884714e8aa5f3f0ecaed84cbb: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 9. (term mismatch)
I20260709 13:20:11.752319  6880 pending_rounds.cc:85] T 4f00a2e87e56452083b759f60d461ee3 P cd75a17ab2604397adab03bb8b5fd75c: Aborting all ops after (but not including) 8
I20260709 13:20:11.752677  6880 pending_rounds.cc:107] T 4f00a2e87e56452083b759f60d461ee3 P cd75a17ab2604397adab03bb8b5fd75c: Aborting uncommitted NO_OP operation due to leader change: 8.9
I20260709 13:20:11.752915  6880 raft_consensus.cc:2889] T 4f00a2e87e56452083b759f60d461ee3 P cd75a17ab2604397adab03bb8b5fd75c [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:20:11.753216  6880 pending_rounds.cc:107] T 4f00a2e87e56452083b759f60d461ee3 P cd75a17ab2604397adab03bb8b5fd75c: Aborting uncommitted NO_OP operation due to leader change: 11.10
I20260709 13:20:11.753418  6880 raft_consensus.cc:2889] T 4f00a2e87e56452083b759f60d461ee3 P cd75a17ab2604397adab03bb8b5fd75c [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:20:11.642872 10986 consensus_meta.cc:287] T 17587d6730594da4a56fa13a353232a1 P 7ba59cc884714e8aa5f3f0ecaed84cbb: Time spent flushing consensus metadata: real 0.741s	user 0.011s	sys 0.001s
I20260709 13:20:11.756263  6723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a734b5ab7834e05a8c422208acc58b1" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 12 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:11.703797  6804 raft_consensus.cc:2468] T bb7fa124c3bf4ef9ab65a407cb008441 P b7ab4784c7344b939bc36f639286f377 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in term 12.
I20260709 13:20:11.735538  6873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb7fa124c3bf4ef9ab65a407cb008441" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:11.736931  6807 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:32966 (request call id 1049) took 1087 ms. Trace:
I20260709 13:20:11.738286  6805 raft_consensus.cc:1240] T 17587d6730594da4a56fa13a353232a1 P b7ab4784c7344b939bc36f639286f377 [term 16 FOLLOWER]: Rejecting Update request from peer 7ba59cc884714e8aa5f3f0ecaed84cbb for earlier term 15. Current term is 16. Ops: [15.11-15.11]
I20260709 13:20:11.733230  6802 raft_consensus.cc:2468] T ce4f062dcd314d43a63ca74067cb5ee3 P b7ab4784c7344b939bc36f639286f377 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 11.
I20260709 13:20:11.744853  6726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "427c124d773f483294511e80fe340075" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:11.741005  6725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1704639a875409b9959353527b3fd68" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
W20260709 13:20:11.723109 10980 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.527s	user 0.005s	sys 0.013s
I20260709 13:20:11.749316  6801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b3759de40694069b13c0f8bd40e5709" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:11.641697 11040 raft_consensus.cc:697] T 90d42e216d9741e190bca19a781291fd P ccd8a4c3bfe3413cb2ae219b09aea832 [term 11 LEADER]: Becoming Leader. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
I20260709 13:20:11.729177 11051 raft_consensus.cc:493] T 24ee15416e3145beaa1b8183453729a3 P cd75a17ab2604397adab03bb8b5fd75c [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:20:11.782146  6772 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 145436us
I20260709 13:20:11.759768  6873 raft_consensus.cc:2376] T bb7fa124c3bf4ef9ab65a407cb008441 P cd75a17ab2604397adab03bb8b5fd75c [term 12 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in term 12. Re-sending same reply.
I20260709 13:20:11.737325 11013 raft_consensus.cc:2804] T bd6869f07b5a4885a0b99fbe60c3b175 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:20:11.761191  6805 raft_consensus.cc:1275] T 4f00a2e87e56452083b759f60d461ee3 P b7ab4784c7344b939bc36f639286f377 [term 12 FOLLOWER]: Refusing update from remote peer 7ba59cc884714e8aa5f3f0ecaed84cbb: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:20:11.761665  6807 rpcz_store.cc:276] 0709 13:20:10.649506 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:10.649703 (+   197us) service_pool.cc:224] Handling call
0709 13:20:11.736652 (+1086949us) spinlock_profiling.cc:243] Waited 982 ms on lock 0x7b54002da854. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f9ae2fa 00007fcc1496fb17 00007fcc0deea6d4 00007fcc0deea662 00007fcc0deea591 00007fcc0deea50c 00007fcc0dee97c2 00007fcc0dce548c 00007fcc0dce48c6 00007fcc0dce426f
0709 13:20:11.736837 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2259260800}
I20260709 13:20:11.626225 10936 raft_consensus.cc:515] T f5be3a11b23d4ea9b08300a2789821c7 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:11.760824  6726 raft_consensus.cc:2468] T 427c124d773f483294511e80fe340075 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in term 9.
I20260709 13:20:11.637771 10987 consensus_queue.cc:1059] T 8c7f33e544204fbaac4078e3e83bbf4e P b7ab4784c7344b939bc36f639286f377 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.129s
I20260709 13:20:11.633028 10915 consensus_queue.cc:1048] T 4b8cacb381b746da8d0049b0a83b41dd P 7ba59cc884714e8aa5f3f0ecaed84cbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.121s
I20260709 13:20:11.769939 11012 raft_consensus.cc:3055] T 3a485a995abc4807b6e511e45419f737 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:20:11.771298  6804 raft_consensus.cc:1240] T ce4f062dcd314d43a63ca74067cb5ee3 P b7ab4784c7344b939bc36f639286f377 [term 11 FOLLOWER]: Rejecting Update request from peer 7ba59cc884714e8aa5f3f0ecaed84cbb for earlier term 10. Current term is 11. Ops: []
I20260709 13:20:11.774708  6803 raft_consensus.cc:2468] T a1704639a875409b9959353527b3fd68 P b7ab4784c7344b939bc36f639286f377 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 12.
I20260709 13:20:11.754873  6731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3411566abe2d4c9bb4b2adfdd05e6f17" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:11.741276  6798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f9c2e2bf644115957398fe4c9459db" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:11.615926 10869 raft_consensus.cc:515] T 7a734b5ab7834e05a8c422208acc58b1 P cd75a17ab2604397adab03bb8b5fd75c [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:11.729993 10621 raft_consensus.cc:2804] T 3411566abe2d4c9bb4b2adfdd05e6f17 P cd75a17ab2604397adab03bb8b5fd75c [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 13:20:11.754729 10695 consensus_meta.cc:287] T 3d65025eea89441290d85dd053810e31 P b7ab4784c7344b939bc36f639286f377: Time spent flushing consensus metadata: real 0.821s	user 0.009s	sys 0.002s
W20260709 13:20:11.772425 10983 consensus_meta.cc:287] T 1bf4668eeb70467fb3dc5a0289233b3c P ccd8a4c3bfe3413cb2ae219b09aea832: Time spent flushing consensus metadata: real 0.878s	user 0.008s	sys 0.004s
I20260709 13:20:11.815785  6723 raft_consensus.cc:1275] T b3f13b31a1f84f0d89d007eadd57924c P ccd8a4c3bfe3413cb2ae219b09aea832 [term 11 FOLLOWER]: Refusing update from remote peer 7ba59cc884714e8aa5f3f0ecaed84cbb: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:20:11.816738 11040 consensus_queue.cc:237] T 90d42e216d9741e190bca19a781291fd P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:11.634920 11027 consensus_queue.cc:1059] T 9e326172347f45e99a0d482b5d8ef768 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: INVALID_TERM, Last received: 10.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.123s
I20260709 13:20:11.643406 11082 consensus_queue.cc:1048] T 404190ce4ce94cecbfcb6ea9d1dd8626 P 7ba59cc884714e8aa5f3f0ecaed84cbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.123s
W20260709 13:20:11.773959 10980 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.578s	user 0.005s	sys 0.013s
I20260709 13:20:11.941299 10921 leader_election.cc:290] T 22ccee1b570c4ad3a57bd7aec085b1b4 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
W20260709 13:20:11.941706 11095 log.cc:927] Time spent T e77e330a82df4b43a745d57a68f6f057 P cd75a17ab2604397adab03bb8b5fd75c: Append to log took a long time: real 0.299s	user 0.001s	sys 0.000s
I20260709 13:20:11.943614  6874 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53416 (request call id 2874) took 1445 ms. Trace:
I20260709 13:20:11.944099  6874 rpcz_store.cc:276] 0709 13:20:10.498393 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:10.644781 (+146388us) service_pool.cc:224] Handling call
0709 13:20:10.645211 (+   430us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:20:10.646139 (+   928us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:20:10.646225 (+    86us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:20:10.666723 (+ 20498us) log.cc:844] Serialized 52 byte log entry
0709 13:20:11.274910 (+608187us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:20:11.274976 (+    66us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:11.275088 (+   112us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:11.943289 (+668201us) raft_consensus.cc:1685] finished
0709 13:20:11.943321 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:11.943531 (+   210us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":34008,"raft.run_cpu_time_us":45,"raft.run_wall_time_us":46,"thread_start_us":514748,"threads_started":1,"wal-append.queue_time_us":836531}
I20260709 13:20:11.758648  6724 raft_consensus.cc:2468] T f09c2a98de1a4decabd0ff900dd44caa P ccd8a4c3bfe3413cb2ae219b09aea832 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 13.
I20260709 13:20:11.821588 10160 consensus_queue.cc:1048] T b56bf91d90824c959e21e0cee5ba1816 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.058s
I20260709 13:20:11.772702 11075 leader_election.cc:290] T 7887766dc6784fcaa42b35c05fea7a99 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 12 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:20:11.784152 11052 raft_consensus.cc:2804] T f03d0dbf16864ca4bc1bb5e4c0334c0f P cd75a17ab2604397adab03bb8b5fd75c [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:20:11.781968 10650 raft_consensus.cc:493] T 17587d6730594da4a56fa13a353232a1 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:20:11.930542  6678 auto_rebalancer.cc:629] Failed to schedule move for tablet 7a734b5ab7834e05a8c422208acc58b1: Illegal state: Replica b7ab4784c7344b939bc36f639286f377 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 11 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } }
I20260709 13:20:11.929411 10983 raft_consensus.cc:515] T 1bf4668eeb70467fb3dc5a0289233b3c P ccd8a4c3bfe3413cb2ae219b09aea832 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:11.937678 10869 leader_election.cc:290] T 7a734b5ab7834e05a8c422208acc58b1 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 12 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:20:11.912901 10621 raft_consensus.cc:493] T 3411566abe2d4c9bb4b2adfdd05e6f17 P cd75a17ab2604397adab03bb8b5fd75c [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:11.938295  6732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4db81d9d329422bb3b4160ca4ac2d1d" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:20:11.913591 11012 raft_consensus.cc:740] T 3a485a995abc4807b6e511e45419f737 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
I20260709 13:20:11.887724 11013 raft_consensus.cc:697] T bd6869f07b5a4885a0b99fbe60c3b175 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 12 LEADER]: Becoming Leader. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
I20260709 13:20:11.973536 10969 raft_consensus.cc:493] T be1a92657f494cac8dd227d152f50151 P b7ab4784c7344b939bc36f639286f377 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 7ba59cc884714e8aa5f3f0ecaed84cbb)
W20260709 13:20:12.023599  6772 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 239542us
I20260709 13:20:12.027072  6772 leader_election.cc:304] T bb7fa124c3bf4ef9ab65a407cb008441 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:20:12.032620  7503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb7fa124c3bf4ef9ab65a407cb008441" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb"
I20260709 13:20:12.033675  7503 raft_consensus.cc:2368] T bb7fa124c3bf4ef9ab65a407cb008441 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate b7ab4784c7344b939bc36f639286f377 for earlier term 11. Current term is 12.
W20260709 13:20:11.819221 11071 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.704s	user 0.011s	sys 0.021s
I20260709 13:20:11.988879  6732 raft_consensus.cc:2393] T c4db81d9d329422bb3b4160ca4ac2d1d P ccd8a4c3bfe3413cb2ae219b09aea832 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c in current term 10: Already voted for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in this term.
W20260709 13:20:11.968690 10692 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.707s	user 0.010s	sys 0.029s
I20260709 13:20:12.037681  6872 raft_consensus.cc:3060] T 22ccee1b570c4ad3a57bd7aec085b1b4 P cd75a17ab2604397adab03bb8b5fd75c [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:20:12.038146  6875 pending_rounds.cc:85] T dbdf895bba214ff68685a24fd17dfb5d P cd75a17ab2604397adab03bb8b5fd75c: Aborting all ops after (but not including) 3
I20260709 13:20:12.056864  6875 pending_rounds.cc:107] T dbdf895bba214ff68685a24fd17dfb5d P cd75a17ab2604397adab03bb8b5fd75c: Aborting uncommitted NO_OP operation due to leader change: 7.4
I20260709 13:20:12.057158  6875 raft_consensus.cc:2889] T dbdf895bba214ff68685a24fd17dfb5d P cd75a17ab2604397adab03bb8b5fd75c [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:20:12.049017  6877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a485a995abc4807b6e511e45419f737" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:20:12.049333  6880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5be3a11b23d4ea9b08300a2789821c7" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:12.060319  6880 raft_consensus.cc:2393] T f5be3a11b23d4ea9b08300a2789821c7 P cd75a17ab2604397adab03bb8b5fd75c [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7ab4784c7344b939bc36f639286f377 in current term 9: Already voted for candidate cd75a17ab2604397adab03bb8b5fd75c in this term.
I20260709 13:20:11.980247 11065 raft_consensus.cc:3055] T 9e326172347f45e99a0d482b5d8ef768 P b7ab4784c7344b939bc36f639286f377 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:20:11.880862 10785 raft_consensus.cc:493] T 34f36d59d88f40fe8a2805e604fc6c0a P b7ab4784c7344b939bc36f639286f377 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:12.066584  6881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30e88460611e47b2ba16a46a30b5f416" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:12.067684  6874 raft_consensus.cc:1275] T d33d5ee8ef6f415593d8df52063161ad P cd75a17ab2604397adab03bb8b5fd75c [term 12 FOLLOWER]: Refusing update from remote peer b7ab4784c7344b939bc36f639286f377: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:20:11.989408 10621 raft_consensus.cc:3060] T 3411566abe2d4c9bb4b2adfdd05e6f17 P cd75a17ab2604397adab03bb8b5fd75c [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:20:11.977720 11086 leader_election.cc:290] T de3186201e1a40d0b335eeb8b4e256e0 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 12 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:20:11.980393 10818 raft_consensus.cc:493] T 711ef6523deb4cbe8ef2ba61e1c21c98 P b7ab4784c7344b939bc36f639286f377 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:11.821269 11051 raft_consensus.cc:515] T 24ee15416e3145beaa1b8183453729a3 P cd75a17ab2604397adab03bb8b5fd75c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
W20260709 13:20:11.973889 11061 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.070s	user 0.007s	sys 0.034s
I20260709 13:20:12.044967 11008 leader_election.cc:290] T d33d5ee8ef6f415593d8df52063161ad P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
W20260709 13:20:12.061834 11030 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.150s	user 0.008s	sys 0.044s
W20260709 13:20:12.049533 11033 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.819s	user 0.009s	sys 0.038s
I20260709 13:20:12.067636  6881 raft_consensus.cc:2468] T 30e88460611e47b2ba16a46a30b5f416 P cd75a17ab2604397adab03bb8b5fd75c [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 9.
I20260709 13:20:12.074826  7503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17587d6730594da4a56fa13a353232a1" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 17 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:20:12.077111  7496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8cee0accdb8499c86d4414b72565a38" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb"
W20260709 13:20:12.048481 11071 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.935s	user 0.011s	sys 0.022s
W20260709 13:20:12.059686 10692 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.795s	user 0.010s	sys 0.029s
I20260709 13:20:12.044770 11075 raft_consensus.cc:493] T 4275cf08e63345f993bce8664eada830 P cd75a17ab2604397adab03bb8b5fd75c [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:11.974171 11052 raft_consensus.cc:493] T f03d0dbf16864ca4bc1bb5e4c0334c0f P cd75a17ab2604397adab03bb8b5fd75c [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:12.038847  6873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8cee0accdb8499c86d4414b72565a38" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
W20260709 13:20:12.062004 10758 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.865s	user 0.005s	sys 0.041s
W20260709 13:20:12.119561  6773 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:12.167691  6773 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:12.167805  6846 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:12.091928 10785 raft_consensus.cc:515] T 34f36d59d88f40fe8a2805e604fc6c0a P b7ab4784c7344b939bc36f639286f377 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:12.167994 11052 raft_consensus.cc:3060] T f03d0dbf16864ca4bc1bb5e4c0334c0f P cd75a17ab2604397adab03bb8b5fd75c [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:20:12.120469 10708 raft_consensus.cc:493] T e77e330a82df4b43a745d57a68f6f057 P b7ab4784c7344b939bc36f639286f377 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:11.989861 10650 raft_consensus.cc:515] T 17587d6730594da4a56fa13a353232a1 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:20:12.118360 10938 raft_consensus.cc:493] T 4f00a2e87e56452083b759f60d461ee3 P b7ab4784c7344b939bc36f639286f377 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:12.055091 10969 raft_consensus.cc:515] T be1a92657f494cac8dd227d152f50151 P b7ab4784c7344b939bc36f639286f377 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:20:12.070434 11065 raft_consensus.cc:740] T 9e326172347f45e99a0d482b5d8ef768 P b7ab4784c7344b939bc36f639286f377 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
I20260709 13:20:12.157001 11093 raft_consensus.cc:493] T f5be3a11b23d4ea9b08300a2789821c7 P cd75a17ab2604397adab03bb8b5fd75c [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:12.099493 10818 raft_consensus.cc:515] T 711ef6523deb4cbe8ef2ba61e1c21c98 P b7ab4784c7344b939bc36f639286f377 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:12.157464 10983 leader_election.cc:290] T 1bf4668eeb70467fb3dc5a0289233b3c P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 12 election: Requested vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:12.158648 11059 leader_election.cc:290] T a1704639a875409b9959353527b3fd68 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:12.089071 10869 raft_consensus.cc:493] T a3022224cc81473690653a83d4e99470 P cd75a17ab2604397adab03bb8b5fd75c [term 12 FOLLOWER]: Starting pre-election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:20:12.198302  7503 raft_consensus.cc:2410] T 17587d6730594da4a56fa13a353232a1 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7ab4784c7344b939bc36f639286f377 for term 17 because replica has last-logged OpId of term: 15 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 10.
I20260709 13:20:12.061758 11106 raft_consensus.cc:2764] T bb7fa124c3bf4ef9ab65a407cb008441 P b7ab4784c7344b939bc36f639286f377 [term 12 FOLLOWER]: Leader election decision vote started in defunct term 11: won
I20260709 13:20:12.126348 11013 consensus_queue.cc:237] T bd6869f07b5a4885a0b99fbe60c3b175 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.5, Last appended by leader: 5, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:12.127996  6877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3022224cc81473690653a83d4e99470" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:20:12.159221  6772 leader_election.cc:304] T 3a485a995abc4807b6e511e45419f737 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
W20260709 13:20:12.119071 11099 log.cc:927] Time spent T 3411566abe2d4c9bb4b2adfdd05e6f17 P ccd8a4c3bfe3413cb2ae219b09aea832: Append to log took a long time: real 0.502s	user 0.000s	sys 0.011s
I20260709 13:20:12.152328 10967 leader_election.cc:290] T 4d9def8b32fd443aa94ab1420b06837b P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 12 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
W20260709 13:20:12.154027 11100 log.cc:927] Time spent T 3d65025eea89441290d85dd053810e31 P ccd8a4c3bfe3413cb2ae219b09aea832: Append to log took a long time: real 0.101s	user 0.000s	sys 0.000s
W20260709 13:20:12.144852 11101 log.cc:927] Time spent T 44bde925b2e541b69890d70715b85176 P ccd8a4c3bfe3413cb2ae219b09aea832: Append to log took a long time: real 0.225s	user 0.000s	sys 0.000s
W20260709 13:20:12.117689 11107 log.cc:927] Time spent T b56bf91d90824c959e21e0cee5ba1816 P b7ab4784c7344b939bc36f639286f377: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
W20260709 13:20:12.096845 11061 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.191s	user 0.007s	sys 0.035s
I20260709 13:20:12.163893  6881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b3759de40694069b13c0f8bd40e5709" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:12.220381  6881 raft_consensus.cc:2468] T 9b3759de40694069b13c0f8bd40e5709 P cd75a17ab2604397adab03bb8b5fd75c [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 10.
I20260709 13:20:12.193122 10930 leader_election.cc:290] T 4b8cacb381b746da8d0049b0a83b41dd P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
W20260709 13:20:12.160195 11033 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.929s	user 0.009s	sys 0.038s
W20260709 13:20:12.168562 10758 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.977s	user 0.006s	sys 0.041s
I20260709 13:20:12.166991  6873 raft_consensus.cc:3060] T d8cee0accdb8499c86d4414b72565a38 P cd75a17ab2604397adab03bb8b5fd75c [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:20:12.172878  6872 raft_consensus.cc:1275] T 22ccee1b570c4ad3a57bd7aec085b1b4 P cd75a17ab2604397adab03bb8b5fd75c [term 10 FOLLOWER]: Refusing update from remote peer b7ab4784c7344b939bc36f639286f377: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
W20260709 13:20:12.217197 10832 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.679s	user 0.028s	sys 0.091s
W20260709 13:20:12.188715  6695 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.563s	user 0.010s	sys 0.045s
I20260709 13:20:12.104525 11012 consensus_queue.cc:260] T 3a485a995abc4807b6e511e45419f737 P ccd8a4c3bfe3413cb2ae219b09aea832 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:12.168145 11075 raft_consensus.cc:515] T 4275cf08e63345f993bce8664eada830 P cd75a17ab2604397adab03bb8b5fd75c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
W20260709 13:20:12.207170  6799 consensus_meta.cc:287] T 90d42e216d9741e190bca19a781291fd P b7ab4784c7344b939bc36f639286f377: Time spent flushing consensus metadata: real 0.590s	user 0.012s	sys 0.000s
W20260709 13:20:12.207911  6698 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.942s	user 0.016s	sys 0.041s
W20260709 13:20:12.284226  6698 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.018s	user 0.017s	sys 0.041s
I20260709 13:20:12.283663  6799 raft_consensus.cc:2468] T 90d42e216d9741e190bca19a781291fd P b7ab4784c7344b939bc36f639286f377 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 11.
W20260709 13:20:12.215389  6772 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 56251.7us
W20260709 13:20:12.106842 11030 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.195s	user 0.009s	sys 0.045s
I20260709 13:20:12.222973  6881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d9def8b32fd443aa94ab1420b06837b" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:20:12.198665 10936 leader_election.cc:290] T f5be3a11b23d4ea9b08300a2789821c7 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 10 election: Requested vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
W20260709 13:20:12.166332 11047 consensus_meta.cc:287] T 853ac0a8cbd64ce99457f170216d4d0f P cd75a17ab2604397adab03bb8b5fd75c: Time spent flushing consensus metadata: real 0.915s	user 0.014s	sys 0.000s
I20260709 13:20:12.187369 10708 raft_consensus.cc:515] T e77e330a82df4b43a745d57a68f6f057 P b7ab4784c7344b939bc36f639286f377 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } }
I20260709 13:20:12.250741  6872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f58dc08b12a2494bb9a1372837970ca2" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:20:12.299837  6872 raft_consensus.cc:3060] T f58dc08b12a2494bb9a1372837970ca2 P cd75a17ab2604397adab03bb8b5fd75c [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:12.217108 11059 raft_consensus.cc:2749] T 3a485a995abc4807b6e511e45419f737 P b7ab4784c7344b939bc36f639286f377 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
W20260709 13:20:12.268424 10860 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.724s	user 0.030s	sys 0.040s
W20260709 13:20:12.266839  7468 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:12.248585  6695 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.623s	user 0.011s	sys 0.045s
I20260709 13:20:12.286412  6881 raft_consensus.cc:3060] T 4d9def8b32fd443aa94ab1420b06837b P cd75a17ab2604397adab03bb8b5fd75c [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:20:12.191947 10938 raft_consensus.cc:515] T 4f00a2e87e56452083b759f60d461ee3 P b7ab4784c7344b939bc36f639286f377 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
W20260709 13:20:12.312134  6695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 687027us
I20260709 13:20:12.295521  6724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3022224cc81473690653a83d4e99470" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:20:12.212282 10869 raft_consensus.cc:515] T a3022224cc81473690653a83d4e99470 P cd75a17ab2604397adab03bb8b5fd75c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:12.192942 11093 raft_consensus.cc:515] T f5be3a11b23d4ea9b08300a2789821c7 P cd75a17ab2604397adab03bb8b5fd75c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:12.318204  6732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17587d6730594da4a56fa13a353232a1" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 17 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
W20260709 13:20:12.248469 10832 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.710s	user 0.028s	sys 0.091s
I20260709 13:20:12.290908  6772 leader_election.cc:400] T bb7fa124c3bf4ef9ab65a407cb008441 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 11 election: Vote denied by peer 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071) with higher term. Message: Invalid argument: T bb7fa124c3bf4ef9ab65a407cb008441 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate b7ab4784c7344b939bc36f639286f377 for earlier term 11. Current term is 12.
I20260709 13:20:12.321949  6872 raft_consensus.cc:2468] T f58dc08b12a2494bb9a1372837970ca2 P cd75a17ab2604397adab03bb8b5fd75c [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 14.
I20260709 13:20:12.322937  6872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c37d41cd9164c15a6826ca62a851a69" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:20:12.323453  6872 raft_consensus.cc:3060] T 7c37d41cd9164c15a6826ca62a851a69 P cd75a17ab2604397adab03bb8b5fd75c [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:20:12.329466  6732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30e88460611e47b2ba16a46a30b5f416" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:12.333114  6872 raft_consensus.cc:2468] T 7c37d41cd9164c15a6826ca62a851a69 P cd75a17ab2604397adab03bb8b5fd75c [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 11.
I20260709 13:20:12.334685  6724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b3759de40694069b13c0f8bd40e5709" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:12.334674  6872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5be3a11b23d4ea9b08300a2789821c7" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
W20260709 13:20:12.337925  7466 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.716s	user 0.010s	sys 0.018s
W20260709 13:20:12.338377  7466 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.717s	user 0.010s	sys 0.018s
W20260709 13:20:12.338673  7466 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 717038us
I20260709 13:20:12.290181 11092 raft_consensus.cc:493] T bd6869f07b5a4885a0b99fbe60c3b175 P cd75a17ab2604397adab03bb8b5fd75c [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:12.347899  7502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24ee15416e3145beaa1b8183453729a3" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 13 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:20:12.350592  6881 raft_consensus.cc:2468] T 4d9def8b32fd443aa94ab1420b06837b P cd75a17ab2604397adab03bb8b5fd75c [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 12.
W20260709 13:20:12.303078 11101 log.cc:927] Time spent T 44bde925b2e541b69890d70715b85176 P ccd8a4c3bfe3413cb2ae219b09aea832: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
W20260709 13:20:12.304129 10860 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.778s	user 0.031s	sys 0.040s
I20260709 13:20:12.353972  7502 raft_consensus.cc:2468] T 24ee15416e3145beaa1b8183453729a3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 12.
W20260709 13:20:12.310796 10700 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.759s	user 0.020s	sys 0.053s
I20260709 13:20:12.355198  6881 raft_consensus.cc:1275] T e31b9971c15848dea59d4d4130141d9e P cd75a17ab2604397adab03bb8b5fd75c [term 9 FOLLOWER]: Refusing update from remote peer b7ab4784c7344b939bc36f639286f377: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:20:12.358373  6846 leader_election.cc:304] T 24ee15416e3145beaa1b8183453729a3 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:20:12.367736  6877 raft_consensus.cc:3060] T a3022224cc81473690653a83d4e99470 P cd75a17ab2604397adab03bb8b5fd75c [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:12.369241  6881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34f36d59d88f40fe8a2805e604fc6c0a" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:12.369586  6872 raft_consensus.cc:2393] T f5be3a11b23d4ea9b08300a2789821c7 P cd75a17ab2604397adab03bb8b5fd75c [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate b7ab4784c7344b939bc36f639286f377 in current term 9: Already voted for candidate cd75a17ab2604397adab03bb8b5fd75c in this term.
I20260709 13:20:12.370115  6881 raft_consensus.cc:2468] T 34f36d59d88f40fe8a2805e604fc6c0a P cd75a17ab2604397adab03bb8b5fd75c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 7.
I20260709 13:20:12.320642 10580 raft_consensus.cc:493] T 34f36d59d88f40fe8a2805e604fc6c0a P ccd8a4c3bfe3413cb2ae219b09aea832 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:12.346397 10785 leader_election.cc:290] T 34f36d59d88f40fe8a2805e604fc6c0a P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
W20260709 13:20:12.376752  6876 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.642s	user 0.002s	sys 0.010s
W20260709 13:20:12.360060 10700 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.808s	user 0.020s	sys 0.053s
W20260709 13:20:12.424892  6876 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.701s	user 0.003s	sys 0.010s
W20260709 13:20:12.425987  6844 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.687s	user 0.000s	sys 0.011s
W20260709 13:20:12.427713  6844 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.689s	user 0.000s	sys 0.011s
W20260709 13:20:12.429267  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 708394us
I20260709 13:20:12.353024 11051 leader_election.cc:290] T 24ee15416e3145beaa1b8183453729a3 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:20:12.244801 11065 consensus_queue.cc:260] T 9e326172347f45e99a0d482b5d8ef768 P b7ab4784c7344b939bc36f639286f377 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 5, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:12.346594 11116 raft_consensus.cc:493] T 853ac0a8cbd64ce99457f170216d4d0f P ccd8a4c3bfe3413cb2ae219b09aea832 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:20:12.346778 11121 raft_consensus.cc:493] T ce4f062dcd314d43a63ca74067cb5ee3 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 7ba59cc884714e8aa5f3f0ecaed84cbb)
I20260709 13:20:12.372573 11006 raft_consensus.cc:2804] T 24ee15416e3145beaa1b8183453729a3 P cd75a17ab2604397adab03bb8b5fd75c [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:20:12.416208  6727 raft_consensus.cc:1240] T c4db81d9d329422bb3b4160ca4ac2d1d P ccd8a4c3bfe3413cb2ae219b09aea832 [term 10 FOLLOWER]: Rejecting Update request from peer b7ab4784c7344b939bc36f639286f377 for earlier term 9. Current term is 10. Ops: []
I20260709 13:20:12.453411  6727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f58dc08b12a2494bb9a1372837970ca2" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:20:12.454907  6727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c37d41cd9164c15a6826ca62a851a69" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:20:12.304605 11047 raft_consensus.cc:515] T 853ac0a8cbd64ce99457f170216d4d0f P cd75a17ab2604397adab03bb8b5fd75c [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:12.418286  6881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1704639a875409b9959353527b3fd68" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:12.456934  6730 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50004 (request call id 2054) took 2019 ms. Trace:
I20260709 13:20:12.457657  6881 raft_consensus.cc:2468] T a1704639a875409b9959353527b3fd68 P cd75a17ab2604397adab03bb8b5fd75c [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 12.
I20260709 13:20:12.457612  6730 rpcz_store.cc:276] 0709 13:20:10.437221 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:10.718071 (+280850us) service_pool.cc:224] Handling call
0709 13:20:10.718420 (+   349us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:10.718854 (+   434us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:20:10.725639 (+  6785us) log.cc:844] Serialized 14 byte log entry
0709 13:20:11.474576 (+748937us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:20:11.475225 (+   649us) log.cc:844] Serialized 26 byte log entry
0709 13:20:11.475402 (+   177us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:20:11.475452 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:11.475542 (+    90us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:12.456518 (+980976us) raft_consensus.cc:1685] finished
0709 13:20:12.456557 (+    39us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:12.456838 (+   281us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":5812,"prepare.run_cpu_time_us":43,"prepare.run_wall_time_us":45,"raft.queue_time_us":143151,"raft.run_cpu_time_us":203,"raft.run_wall_time_us":5868,"thread_start_us":744537,"threads_started":1,"wal-append.queue_time_us":1019195}
W20260709 13:20:12.367187 10993 consensus_meta.cc:287] T d8cee0accdb8499c86d4414b72565a38 P 7ba59cc884714e8aa5f3f0ecaed84cbb: Time spent flushing consensus metadata: real 0.834s	user 0.011s	sys 0.004s
I20260709 13:20:12.430471  6877 raft_consensus.cc:2468] T a3022224cc81473690653a83d4e99470 P cd75a17ab2604397adab03bb8b5fd75c [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 13.
W20260709 13:20:12.404167  6879 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.805s	user 0.002s	sys 0.015s
W20260709 13:20:12.404901 10727 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.135s	user 0.027s	sys 0.025s
W20260709 13:20:12.404961 10989 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.798s	user 0.007s	sys 0.010s
I20260709 13:20:12.434708  6873 raft_consensus.cc:2468] T d8cee0accdb8499c86d4414b72565a38 P cd75a17ab2604397adab03bb8b5fd75c [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 11.
I20260709 13:20:12.419238  7466 leader_election.cc:304] T bb7fa124c3bf4ef9ab65a407cb008441 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, b7ab4784c7344b939bc36f639286f377; no voters: 
W20260709 13:20:12.530158  6879 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.931s	user 0.010s	sys 0.023s
W20260709 13:20:12.530354  7466 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 111198us
I20260709 13:20:12.373390 11123 raft_consensus.cc:493] T 1528ab62b6fe4e3099d08f141afee116 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 7ba59cc884714e8aa5f3f0ecaed84cbb)
I20260709 13:20:12.360752 11092 raft_consensus.cc:515] T bd6869f07b5a4885a0b99fbe60c3b175 P cd75a17ab2604397adab03bb8b5fd75c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:12.451889 11006 raft_consensus.cc:493] T 24ee15416e3145beaa1b8183453729a3 P cd75a17ab2604397adab03bb8b5fd75c [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:20:12.448360  6695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 131453us
I20260709 13:20:12.439384  6844 leader_election.cc:304] T c4db81d9d329422bb3b4160ca4ac2d1d P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
W20260709 13:20:12.554119  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 114793us
I20260709 13:20:12.555094  6844 leader_election.cc:304] T a1704639a875409b9959353527b3fd68 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
W20260709 13:20:12.449643  6878 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.677s	user 0.013s	sys 0.013s
W20260709 13:20:12.404606  6697 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.741s	user 0.006s	sys 0.007s
W20260709 13:20:12.556507  6697 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.893s	user 0.007s	sys 0.007s
W20260709 13:20:12.556974  6697 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 893175us
W20260709 13:20:12.445966 10249 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.664s	user 0.014s	sys 0.010s
I20260709 13:20:12.559269  6697 leader_election.cc:304] T 44bde925b2e541b69890d70715b85176 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
W20260709 13:20:12.464764  6802 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.530s	user 0.000s	sys 0.019s
W20260709 13:20:12.560354  6802 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.625s	user 0.009s	sys 0.038s
I20260709 13:20:12.414587 10580 raft_consensus.cc:515] T 34f36d59d88f40fe8a2805e604fc6c0a P ccd8a4c3bfe3413cb2ae219b09aea832 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:12.523653  6727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d9def8b32fd443aa94ab1420b06837b" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
W20260709 13:20:12.527166 11109 log.cc:927] Time spent T f3f9c2e2bf644115957398fe4c9459db P b7ab4784c7344b939bc36f639286f377: Append to log took a long time: real 0.082s	user 0.000s	sys 0.000s
I20260709 13:20:12.527489  6730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5be3a11b23d4ea9b08300a2789821c7" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:20:12.587337  6802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a734b5ab7834e05a8c422208acc58b1" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 12 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:20:12.604801  6802 raft_consensus.cc:3060] T 7a734b5ab7834e05a8c422208acc58b1 P b7ab4784c7344b939bc36f639286f377 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:20:12.605633  6730 raft_consensus.cc:2368] T f5be3a11b23d4ea9b08300a2789821c7 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate b7ab4784c7344b939bc36f639286f377 for earlier term 9. Current term is 10.
I20260709 13:20:12.587610  6803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22ccee1b570c4ad3a57bd7aec085b1b4" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
W20260709 13:20:12.604604  6697 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 45419.6us
I20260709 13:20:12.608078  6805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d33d5ee8ef6f415593d8df52063161ad" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:12.609411  6798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de3186201e1a40d0b335eeb8b4e256e0" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:20:12.538534  6881 raft_consensus.cc:1240] T 8c7f33e544204fbaac4078e3e83bbf4e P cd75a17ab2604397adab03bb8b5fd75c [term 9 FOLLOWER]: Rejecting Update request from peer b7ab4784c7344b939bc36f639286f377 for earlier term 8. Current term is 9. Ops: [8.5-8.5]
I20260709 13:20:12.540856  6879 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53416 (request call id 2872) took 2082 ms. Trace:
W20260709 13:20:12.543156  6771 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:12.544026  6725 raft_consensus.cc:1240] T 1bf4668eeb70467fb3dc5a0289233b3c P ccd8a4c3bfe3413cb2ae219b09aea832 [term 12 FOLLOWER]: Rejecting Update request from peer b7ab4784c7344b939bc36f639286f377 for earlier term 11. Current term is 12. Ops: []
I20260709 13:20:12.546839  6873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "711ef6523deb4cbe8ef2ba61e1c21c98" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:12.449162 10785 raft_consensus.cc:493] T 95a75bfe094d4bdc963aba3f08dfcd25 P b7ab4784c7344b939bc36f639286f377 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
W20260709 13:20:12.431761 10534 consensus_meta.cc:287] T 2c240553ce044eedb41541d72b9475d7 P b7ab4784c7344b939bc36f639286f377: Time spent flushing consensus metadata: real 1.055s	user 0.010s	sys 0.005s
I20260709 13:20:12.557152  6772 leader_election.cc:304] T 30e88460611e47b2ba16a46a30b5f416 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
W20260709 13:20:12.556293  6878 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.784s	user 0.013s	sys 0.013s
W20260709 13:20:12.544626 10727 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.277s	user 0.027s	sys 0.025s
I20260709 13:20:12.559767  6804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7887766dc6784fcaa42b35c05fea7a99" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
W20260709 13:20:12.539717 10989 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.937s	user 0.007s	sys 0.010s
I20260709 13:20:12.796118  6804 raft_consensus.cc:3060] T 7887766dc6784fcaa42b35c05fea7a99 P b7ab4784c7344b939bc36f639286f377 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:20:12.803067  6773 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:12.803762  6773 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:12.529352 10818 leader_election.cc:290] T 711ef6523deb4cbe8ef2ba61e1c21c98 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:12.461010 11116 raft_consensus.cc:515] T 853ac0a8cbd64ce99457f170216d4d0f P ccd8a4c3bfe3413cb2ae219b09aea832 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
W20260709 13:20:12.626931  6846 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:12.640969  6879 rpcz_store.cc:276] 0709 13:20:10.458410 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:10.558749 (+100339us) service_pool.cc:224] Handling call
0709 13:20:10.669720 (+110971us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:10.728213 (+ 58493us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:10.728249 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:20:10.752345 (+ 24096us) log.cc:844] Serialized 26 byte log entry
0709 13:20:11.570993 (+818648us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:20:12.539551 (+968558us) log.cc:844] Serialized 14 byte log entry
0709 13:20:12.540416 (+   865us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:12.540520 (+   104us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:12.540586 (+    66us) raft_consensus.cc:1685] finished
0709 13:20:12.540606 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:12.540777 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":382,"raft.queue_time_us":17968,"raft.run_cpu_time_us":197,"raft.run_wall_time_us":15230,"thread_start_us":1781928,"threads_started":3,"wal-append.queue_time_us":1342312}
I20260709 13:20:12.502041 11121 raft_consensus.cc:515] T ce4f062dcd314d43a63ca74067cb5ee3 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } attrs { replace: true } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:20:12.607834 10700 consensus_queue.cc:1048] T a1704639a875409b9959353527b3fd68 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.045s
I20260709 13:20:12.610023  6798 raft_consensus.cc:3060] T de3186201e1a40d0b335eeb8b4e256e0 P b7ab4784c7344b939bc36f639286f377 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:20:12.770231  6697 leader_election.cc:304] T f09c2a98de1a4decabd0ff900dd44caa P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:20:12.770473  6873 raft_consensus.cc:2468] T 711ef6523deb4cbe8ef2ba61e1c21c98 P cd75a17ab2604397adab03bb8b5fd75c [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 12.
I20260709 13:20:12.823462  6873 raft_consensus.cc:1275] T f3f9c2e2bf644115957398fe4c9459db P cd75a17ab2604397adab03bb8b5fd75c [term 11 FOLLOWER]: Refusing update from remote peer b7ab4784c7344b939bc36f639286f377: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:20:12.611487 10860 consensus_queue.cc:1048] T 4f00a2e87e56452083b759f60d461ee3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.054s
I20260709 13:20:12.547531 10915 raft_consensus.cc:2804] T bb7fa124c3bf4ef9ab65a407cb008441 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:20:12.772593  6802 raft_consensus.cc:2468] T 7a734b5ab7834e05a8c422208acc58b1 P b7ab4784c7344b939bc36f639286f377 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 12.
I20260709 13:20:12.635589 11126 raft_consensus.cc:2804] T 44bde925b2e541b69890d70715b85176 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 13:20:12.774400  6695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 155517us
I20260709 13:20:12.547721 11051 raft_consensus.cc:493] T 3d65025eea89441290d85dd053810e31 P cd75a17ab2604397adab03bb8b5fd75c [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:12.522028 10993 raft_consensus.cc:515] T d8cee0accdb8499c86d4414b72565a38 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
W20260709 13:20:12.563048 10249 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.781s	user 0.015s	sys 0.011s
I20260709 13:20:12.540674 11083 raft_consensus.cc:2749] T 3a485a995abc4807b6e511e45419f737 P cd75a17ab2604397adab03bb8b5fd75c [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:20:12.572260 11086 raft_consensus.cc:2804] T c4db81d9d329422bb3b4160ca4ac2d1d P cd75a17ab2604397adab03bb8b5fd75c [term 10 FOLLOWER]: Leader election won for term 10
W20260709 13:20:12.863571  6695 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:12.560364 11065 raft_consensus.cc:3060] T 9e326172347f45e99a0d482b5d8ef768 P b7ab4784c7344b939bc36f639286f377 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:20:12.799402  6799 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:32976 (request call id 2793) took 1882 ms (client timeout 2076 ms). Trace:
W20260709 13:20:12.882231  6799 rpcz_store.cc:269] 0709 13:20:10.916565 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:10.916711 (+   146us) service_pool.cc:224] Handling call
0709 13:20:12.799143 (+1882432us) spinlock_profiling.cc:243] Waited 692 ms on lock 0x7b54001cacd4. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f9ae2fa 00007fcc1496fb17 00007fcc0deea6d4 00007fcc0deea662 00007fcc0deea591 00007fcc0deea50c 00007fcc0dee97c2 00007fcc0dce548c 00007fcc0dce48c6 00007fcc0dce426f
0709 13:20:12.799317 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1592655616}
I20260709 13:20:12.795284 11139 raft_consensus.cc:2804] T a1704639a875409b9959353527b3fd68 P cd75a17ab2604397adab03bb8b5fd75c [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 13:20:12.815559  6772 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 258473us
W20260709 13:20:12.792178 11120 log.cc:927] Time spent T 853ac0a8cbd64ce99457f170216d4d0f P b7ab4784c7344b939bc36f639286f377: Append to log took a long time: real 0.370s	user 0.000s	sys 0.005s
I20260709 13:20:12.643601 11075 leader_election.cc:290] T 4275cf08e63345f993bce8664eada830 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:20:12.832919  6730 raft_consensus.cc:1240] T bd6869f07b5a4885a0b99fbe60c3b175 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 12 LEADER]: Rejecting Update request from peer b7ab4784c7344b939bc36f639286f377 for earlier term 11. Current term is 12. Ops: []
W20260709 13:20:12.805570 11103 log.cc:927] Time spent T 3a485a995abc4807b6e511e45419f737 P cd75a17ab2604397adab03bb8b5fd75c: Append to log took a long time: real 0.200s	user 0.003s	sys 0.001s
W20260709 13:20:12.813669 11125 log.cc:927] Time spent T ab432e62819d499eaaf3dd55481dd930 P ccd8a4c3bfe3413cb2ae219b09aea832: Append to log took a long time: real 0.273s	user 0.000s	sys 0.005s
I20260709 13:20:12.848392  6879 raft_consensus.cc:1240] T bd6869f07b5a4885a0b99fbe60c3b175 P cd75a17ab2604397adab03bb8b5fd75c [term 12 FOLLOWER]: Rejecting Update request from peer b7ab4784c7344b939bc36f639286f377 for earlier term 11. Current term is 12. Ops: []
I20260709 13:20:12.850445  6725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34f36d59d88f40fe8a2805e604fc6c0a" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
W20260709 13:20:12.818826 11128 log.cc:927] Time spent T 9e326172347f45e99a0d482b5d8ef768 P ccd8a4c3bfe3413cb2ae219b09aea832: Append to log took a long time: real 0.397s	user 0.000s	sys 0.005s
W20260709 13:20:12.854662  6697 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 84532.4us
I20260709 13:20:12.859546 11124 consensus_queue.cc:1059] T 7c37d41cd9164c15a6826ca62a851a69 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.146s
I20260709 13:20:12.571249 10967 consensus_queue.cc:1048] T d33d5ee8ef6f415593d8df52063161ad P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.255s
I20260709 13:20:12.635479 10930 consensus_queue.cc:1059] T a3022224cc81473690653a83d4e99470 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: INVALID_TERM, Last received: 12.6, Next index: 7, Last known committed idx: 4, Time since last communication: 0.193s
I20260709 13:20:12.869511  5625 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:20:12.770951 10931 consensus_queue.cc:1048] T 7a734b5ab7834e05a8c422208acc58b1 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.065s
I20260709 13:20:12.810346 11106 raft_consensus.cc:493] T 7c44c4849aa54f2b94d1f1bef9ed546f P b7ab4784c7344b939bc36f639286f377 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:12.564600 11006 raft_consensus.cc:3060] T 24ee15416e3145beaa1b8183453729a3 P cd75a17ab2604397adab03bb8b5fd75c [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:12.883920  6799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5be3a11b23d4ea9b08300a2789821c7" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:20:13.037640  6799 raft_consensus.cc:3060] T f5be3a11b23d4ea9b08300a2789821c7 P b7ab4784c7344b939bc36f639286f377 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:20:12.886294  6803 raft_consensus.cc:1240] T 4d9def8b32fd443aa94ab1420b06837b P b7ab4784c7344b939bc36f639286f377 [term 12 FOLLOWER]: Rejecting Update request from peer ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 11. Current term is 12. Ops: []
I20260709 13:20:12.770773 11033 consensus_queue.cc:1048] T 4275cf08e63345f993bce8664eada830 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.076s
I20260709 13:20:12.553297 11123 raft_consensus.cc:515] T 1528ab62b6fe4e3099d08f141afee116 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:20:12.901211  7496 raft_consensus.cc:2393] T d8cee0accdb8499c86d4414b72565a38 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate b7ab4784c7344b939bc36f639286f377 in current term 11: Already voted for candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in this term.
I20260709 13:20:12.835772 10818 raft_consensus.cc:2804] T 30e88460611e47b2ba16a46a30b5f416 P b7ab4784c7344b939bc36f639286f377 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:20:12.898267  6772 leader_election.cc:304] T 9b3759de40694069b13c0f8bd40e5709 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:20:12.833673 10708 leader_election.cc:290] T e77e330a82df4b43a745d57a68f6f057 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931), ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391)
I20260709 13:20:12.833967 11126 raft_consensus.cc:493] T 44bde925b2e541b69890d70715b85176 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 12 FOLLOWER]: Starting leader election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:20:12.797137 10534 raft_consensus.cc:515] T 2c240553ce044eedb41541d72b9475d7 P b7ab4784c7344b939bc36f639286f377 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:12.943184  6725 raft_consensus.cc:2468] T 34f36d59d88f40fe8a2805e604fc6c0a P ccd8a4c3bfe3413cb2ae219b09aea832 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 8.
I20260709 13:20:12.853973 11093 leader_election.cc:290] T f5be3a11b23d4ea9b08300a2789821c7 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:20:12.796829 10785 raft_consensus.cc:515] T 95a75bfe094d4bdc963aba3f08dfcd25 P b7ab4784c7344b939bc36f639286f377 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:12.861554 10915 raft_consensus.cc:697] T bb7fa124c3bf4ef9ab65a407cb008441 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 12 LEADER]: Becoming Leader. State: Replica: 7ba59cc884714e8aa5f3f0ecaed84cbb, State: Running, Role: LEADER
I20260709 13:20:12.894600 10938 leader_election.cc:290] T 4f00a2e87e56452083b759f60d461ee3 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
W20260709 13:20:13.096096 11129 log.cc:927] Time spent T 8c7f33e544204fbaac4078e3e83bbf4e P ccd8a4c3bfe3413cb2ae219b09aea832: Append to log took a long time: real 0.302s	user 0.001s	sys 0.001s
I20260709 13:20:12.854573 11051 raft_consensus.cc:515] T 3d65025eea89441290d85dd053810e31 P cd75a17ab2604397adab03bb8b5fd75c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:12.846110 11132 consensus_queue.cc:1059] T ce4f062dcd314d43a63ca74067cb5ee3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: INVALID_TERM, Last received: 10.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.173s
I20260709 13:20:13.115159 11132 raft_consensus.cc:3055] T ce4f062dcd314d43a63ca74067cb5ee3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:20:13.115612 11132 raft_consensus.cc:740] T ce4f062dcd314d43a63ca74067cb5ee3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 7ba59cc884714e8aa5f3f0ecaed84cbb, State: Running, Role: LEADER
I20260709 13:20:13.115787 11116 leader_election.cc:290] T 853ac0a8cbd64ce99457f170216d4d0f P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:13.116627 11132 consensus_queue.cc:260] T ce4f062dcd314d43a63ca74067cb5ee3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } attrs { replace: true } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:20:13.118834 11132 raft_consensus.cc:3060] T ce4f062dcd314d43a63ca74067cb5ee3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:20:13.050846 10758 consensus_queue.cc:1048] T 7a734b5ab7834e05a8c422208acc58b1 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.074s
I20260709 13:20:12.935180 10869 leader_election.cc:290] T a3022224cc81473690653a83d4e99470 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:20:13.093319 11106 raft_consensus.cc:515] T 7c44c4849aa54f2b94d1f1bef9ed546f P b7ab4784c7344b939bc36f639286f377 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:13.120929 11051 leader_election.cc:290] T 3d65025eea89441290d85dd053810e31 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:20:13.105006 11093 raft_consensus.cc:493] T 44bde925b2e541b69890d70715b85176 P cd75a17ab2604397adab03bb8b5fd75c [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:13.122244 11106 leader_election.cc:290] T 7c44c4849aa54f2b94d1f1bef9ed546f P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:13.122099 11093 raft_consensus.cc:515] T 44bde925b2e541b69890d70715b85176 P cd75a17ab2604397adab03bb8b5fd75c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:13.124107  6800 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50550 (request call id 425) took 1458 ms. Trace:
I20260709 13:20:13.125535 11121 leader_election.cc:290] T ce4f062dcd314d43a63ca74067cb5ee3 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:20:13.124653  6800 rpcz_store.cc:276] 0709 13:20:11.665579 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:11.712871 (+ 47292us) service_pool.cc:224] Handling call
0709 13:20:11.713290 (+   419us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:12.066633 (+353343us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:12.066668 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:20:12.101091 (+ 34423us) log.cc:844] Serialized 26 byte log entry
0709 13:20:12.460771 (+359680us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:20:12.460812 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:12.460882 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:13.123771 (+662889us) raft_consensus.cc:1685] finished
0709 13:20:13.123799 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:13.124002 (+   203us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":361747,"raft.queue_time_us":364089,"raft.run_cpu_time_us":156,"raft.run_wall_time_us":8466,"thread_start_us":291813,"threads_started":1,"wal-append.queue_time_us":983488}
W20260709 13:20:13.126776 11052 consensus_meta.cc:287] T f03d0dbf16864ca4bc1bb5e4c0334c0f P cd75a17ab2604397adab03bb8b5fd75c: Time spent flushing consensus metadata: real 0.955s	user 0.003s	sys 0.012s
I20260709 13:20:13.128182 11052 raft_consensus.cc:515] T f03d0dbf16864ca4bc1bb5e4c0334c0f P cd75a17ab2604397adab03bb8b5fd75c [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:13.129077 10534 leader_election.cc:290] T 2c240553ce044eedb41541d72b9475d7 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 13 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:12.859755 10832 raft_consensus.cc:2749] T f09c2a98de1a4decabd0ff900dd44caa P ccd8a4c3bfe3413cb2ae219b09aea832 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:20:12.611284  6727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1704639a875409b9959353527b3fd68" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:13.092051 11008 raft_consensus.cc:493] T 2c240553ce044eedb41541d72b9475d7 P cd75a17ab2604397adab03bb8b5fd75c [term 12 FOLLOWER]: Starting pre-election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:20:13.101437 10727 raft_consensus.cc:493] T 711ef6523deb4cbe8ef2ba61e1c21c98 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:20:13.014405 11131 log.cc:927] Time spent T 8c7f33e544204fbaac4078e3e83bbf4e P b7ab4784c7344b939bc36f639286f377: Append to log took a long time: real 0.375s	user 0.000s	sys 0.001s
W20260709 13:20:13.015403 11127 log.cc:927] Time spent T fe20b4b48823486ca3b9c648db6ce8aa P 7ba59cc884714e8aa5f3f0ecaed84cbb: Append to log took a long time: real 0.453s	user 0.000s	sys 0.001s
W20260709 13:20:13.019660  7468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 460881us
I20260709 13:20:12.893848  6804 raft_consensus.cc:2468] T 7887766dc6784fcaa42b35c05fea7a99 P b7ab4784c7344b939bc36f639286f377 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 12.
I20260709 13:20:13.047056  6799 raft_consensus.cc:2468] T f5be3a11b23d4ea9b08300a2789821c7 P b7ab4784c7344b939bc36f639286f377 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 10.
W20260709 13:20:13.048851 11137 log.cc:927] Time spent T 1bf4668eeb70467fb3dc5a0289233b3c P b7ab4784c7344b939bc36f639286f377: Append to log took a long time: real 0.236s	user 0.000s	sys 0.001s
I20260709 13:20:13.095530  6803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bf4668eeb70467fb3dc5a0289233b3c" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:20:12.902163 11139 raft_consensus.cc:493] T a1704639a875409b9959353527b3fd68 P cd75a17ab2604397adab03bb8b5fd75c [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:13.108599  6725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d33d5ee8ef6f415593d8df52063161ad" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
W20260709 13:20:13.133076 10621 consensus_meta.cc:287] T 3411566abe2d4c9bb4b2adfdd05e6f17 P cd75a17ab2604397adab03bb8b5fd75c: Time spent flushing consensus metadata: real 1.035s	user 0.018s	sys 0.005s
I20260709 13:20:13.099444 11126 raft_consensus.cc:3060] T 44bde925b2e541b69890d70715b85176 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:13.095412 11040 raft_consensus.cc:3055] T 7c37d41cd9164c15a6826ca62a851a69 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:20:13.129691 11123 leader_election.cc:290] T 1528ab62b6fe4e3099d08f141afee116 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:20:12.935343 11075 raft_consensus.cc:493] T 713b5728a197487c9300b310ab94e5a3 P cd75a17ab2604397adab03bb8b5fd75c [term 12 FOLLOWER]: Starting pre-election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:20:13.099474 10818 raft_consensus.cc:493] T 30e88460611e47b2ba16a46a30b5f416 P b7ab4784c7344b939bc36f639286f377 [term 9 FOLLOWER]: Starting leader election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:20:13.132686 10869 raft_consensus.cc:493] T e31b9971c15848dea59d4d4130141d9e P cd75a17ab2604397adab03bb8b5fd75c [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:13.135426  6727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22ccee1b570c4ad3a57bd7aec085b1b4" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
W20260709 13:20:13.214743  6773 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:13.234817 11093 leader_election.cc:290] T 44bde925b2e541b69890d70715b85176 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:20:13.234966  6729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4275cf08e63345f993bce8664eada830" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 13 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:13.236665  6729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a734b5ab7834e05a8c422208acc58b1" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 12 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:20:13.237887  6729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24ee15416e3145beaa1b8183453729a3" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 13 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:13.238775 11006 raft_consensus.cc:515] T 24ee15416e3145beaa1b8183453729a3 P cd75a17ab2604397adab03bb8b5fd75c [term 13 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:20:13.240461  6729 raft_consensus.cc:1217] T 20f6842e26174571996b8dea4151d4be P ccd8a4c3bfe3413cb2ae219b09aea832 [term 13 LEADER]: Deduplicated request from leader. Original: 5.4->[7.5-12.7]   Dedup: 9.6->[12.7-12.7]
I20260709 13:20:13.169757 11160 raft_consensus.cc:493] T f4b8bd455d5a47c18a1380839c6e0d61 P cd75a17ab2604397adab03bb8b5fd75c [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:13.247931 11160 raft_consensus.cc:515] T f4b8bd455d5a47c18a1380839c6e0d61 P cd75a17ab2604397adab03bb8b5fd75c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:13.250919 11160 leader_election.cc:290] T f4b8bd455d5a47c18a1380839c6e0d61 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:20:13.170310 11071 consensus_queue.cc:1048] T 4f00a2e87e56452083b759f60d461ee3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
W20260709 13:20:13.171283  7468 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:13.172369  6799 raft_consensus.cc:1240] T 7887766dc6784fcaa42b35c05fea7a99 P b7ab4784c7344b939bc36f639286f377 [term 12 FOLLOWER]: Rejecting Update request from peer ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 11. Current term is 12. Ops: []
I20260709 13:20:13.130472 10938 raft_consensus.cc:2804] T 9b3759de40694069b13c0f8bd40e5709 P b7ab4784c7344b939bc36f639286f377 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:20:13.256139 10938 raft_consensus.cc:493] T 9b3759de40694069b13c0f8bd40e5709 P b7ab4784c7344b939bc36f639286f377 [term 10 FOLLOWER]: Starting leader election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:20:13.172780  6804 raft_consensus.cc:1275] T 3d65025eea89441290d85dd053810e31 P b7ab4784c7344b939bc36f639286f377 [term 10 FOLLOWER]: Refusing update from remote peer ccd8a4c3bfe3413cb2ae219b09aea832: Log matching property violated. Preceding OpId in replica: term: 9 index: 4. Preceding OpId from leader: term: 10 index: 5. (index mismatch)
I20260709 13:20:13.135075 10580 leader_election.cc:290] T 34f36d59d88f40fe8a2805e604fc6c0a P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:13.149230 10727 raft_consensus.cc:515] T 711ef6523deb4cbe8ef2ba61e1c21c98 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:13.259265 10727 leader_election.cc:290] T 711ef6523deb4cbe8ef2ba61e1c21c98 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:13.259943 10938 raft_consensus.cc:3060] T 9b3759de40694069b13c0f8bd40e5709 P b7ab4784c7344b939bc36f639286f377 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:20:13.178314 11139 raft_consensus.cc:3060] T a1704639a875409b9959353527b3fd68 P cd75a17ab2604397adab03bb8b5fd75c [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:13.241199 11052 leader_election.cc:290] T f03d0dbf16864ca4bc1bb5e4c0334c0f P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 11 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:20:13.265403 10785 leader_election.cc:290] T 95a75bfe094d4bdc963aba3f08dfcd25 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
W20260709 13:20:13.256350  6616 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 427c124d773f483294511e80fe340075 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER failed with leader 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 7ba59cc884714e8aa5f3f0ecaed84cbb is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 9 leader_uuid: "b7ab4784c7344b939bc36f639286f377" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } attrs { replace: true } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } } }
W20260709 13:20:13.325620  7466 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.772s	user 0.003s	sys 0.022s
W20260709 13:20:13.329958  7466 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.776s	user 0.003s	sys 0.023s
W20260709 13:20:13.330379  7466 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 776424us
I20260709 13:20:13.337791  6729 raft_consensus.cc:1240] T 20f6842e26174571996b8dea4151d4be P ccd8a4c3bfe3413cb2ae219b09aea832 [term 13 LEADER]: Rejecting Update request from peer cd75a17ab2604397adab03bb8b5fd75c for earlier term 12. Current term is 13. Ops: [7.5-12.7]
I20260709 13:20:13.170804 10915 consensus_queue.cc:237] T bb7fa124c3bf4ef9ab65a407cb008441 P 7ba59cc884714e8aa5f3f0ecaed84cbb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:20:13.178411 11040 raft_consensus.cc:740] T 7c37d41cd9164c15a6826ca62a851a69 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
W20260709 13:20:13.346871  6844 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.572s	user 0.035s	sys 0.034s
W20260709 13:20:13.359959  6844 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.585s	user 0.035s	sys 0.034s
I20260709 13:20:13.100752  6798 raft_consensus.cc:2468] T de3186201e1a40d0b335eeb8b4e256e0 P b7ab4784c7344b939bc36f639286f377 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 12.
I20260709 13:20:13.384951  6806 raft_consensus.cc:1240] T de3186201e1a40d0b335eeb8b4e256e0 P b7ab4784c7344b939bc36f639286f377 [term 12 FOLLOWER]: Rejecting Update request from peer ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 11. Current term is 12. Ops: []
W20260709 13:20:13.390484  6732 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.619s	user 0.015s	sys 0.030s
I20260709 13:20:13.189174 10818 raft_consensus.cc:3060] T 30e88460611e47b2ba16a46a30b5f416 P b7ab4784c7344b939bc36f639286f377 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:20:13.392937  6725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de3186201e1a40d0b335eeb8b4e256e0" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:20:13.140918 11008 raft_consensus.cc:515] T 2c240553ce044eedb41541d72b9475d7 P cd75a17ab2604397adab03bb8b5fd75c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:13.394275  7466 leader_election.cc:304] T 427c124d773f483294511e80fe340075 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377
W20260709 13:20:13.391041  6732 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.620s	user 0.015s	sys 0.030s
W20260709 13:20:13.399080  6773 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:13.413654  6844 leader_election.cc:304] T 3fa34c08b205435dba97346991aa1f92 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:20:13.344594 11071 raft_consensus.cc:493] T 3fa34c08b205435dba97346991aa1f92 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:13.180627 10621 raft_consensus.cc:515] T 3411566abe2d4c9bb4b2adfdd05e6f17 P cd75a17ab2604397adab03bb8b5fd75c [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
W20260709 13:20:13.358093  6616 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.5.126.68:45071, user_credentials={real_user=slave}} blocked reactor thread for 101963us
I20260709 13:20:13.269443 10869 raft_consensus.cc:515] T e31b9971c15848dea59d4d4130141d9e P cd75a17ab2604397adab03bb8b5fd75c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:13.429868 10869 leader_election.cc:290] T e31b9971c15848dea59d4d4130141d9e P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:20:13.430160 10650 leader_election.cc:290] T 17587d6730594da4a56fa13a353232a1 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:20:13.391750 11160 raft_consensus.cc:493] T 4f00a2e87e56452083b759f60d461ee3 P cd75a17ab2604397adab03bb8b5fd75c [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:13.189633 11075 raft_consensus.cc:515] T 713b5728a197487c9300b310ab94e5a3 P cd75a17ab2604397adab03bb8b5fd75c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
W20260709 13:20:13.434265  6878 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.600s	user 0.025s	sys 0.047s
I20260709 13:20:13.391417 11052 raft_consensus.cc:493] T 9e326172347f45e99a0d482b5d8ef768 P cd75a17ab2604397adab03bb8b5fd75c [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:20:13.452310  6878 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.618s	user 0.025s	sys 0.047s
I20260709 13:20:13.405092 10727 raft_consensus.cc:493] T 3fa34c08b205435dba97346991aa1f92 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 7ba59cc884714e8aa5f3f0ecaed84cbb)
I20260709 13:20:13.412194 11066 raft_consensus.cc:493] T e77e330a82df4b43a745d57a68f6f057 P cd75a17ab2604397adab03bb8b5fd75c [term 14 FOLLOWER]: Starting pre-election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:20:13.416602  6732 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50004 (request call id 2064) took 1081 ms. Trace:
I20260709 13:20:13.458469 10650 raft_consensus.cc:2804] T 427c124d773f483294511e80fe340075 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:20:13.547996 10650 raft_consensus.cc:493] T 427c124d773f483294511e80fe340075 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 9 FOLLOWER]: Starting leader election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:20:13.459010 10727 raft_consensus.cc:515] T 3fa34c08b205435dba97346991aa1f92 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:20:13.456362 11160 raft_consensus.cc:515] T 4f00a2e87e56452083b759f60d461ee3 P cd75a17ab2604397adab03bb8b5fd75c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:20:13.461354 10920 raft_consensus.cc:493] T 7c44c4849aa54f2b94d1f1bef9ed546f P ccd8a4c3bfe3413cb2ae219b09aea832 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:20:13.502123  6695 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.637s	user 0.010s	sys 0.034s
I20260709 13:20:13.432441 11071 raft_consensus.cc:515] T 3fa34c08b205435dba97346991aa1f92 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:20:13.456835 11052 raft_consensus.cc:515] T 9e326172347f45e99a0d482b5d8ef768 P cd75a17ab2604397adab03bb8b5fd75c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:13.462446 11066 raft_consensus.cc:515] T e77e330a82df4b43a745d57a68f6f057 P cd75a17ab2604397adab03bb8b5fd75c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } }
W20260709 13:20:13.517660  7503 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50744 (request call id 341) took 1443 ms (client timeout 1617 ms). Trace:
I20260709 13:20:13.454842 11040 consensus_queue.cc:260] T 7c37d41cd9164c15a6826ca62a851a69 P ccd8a4c3bfe3413cb2ae219b09aea832 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
W20260709 13:20:13.533782  6877 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53406 (request call id 2100) took 1483 ms (client timeout 1532 ms). Trace:
W20260709 13:20:13.569247  6877 rpcz_store.cc:269] 0709 13:20:12.050700 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:12.105988 (+ 55288us) service_pool.cc:224] Handling call
0709 13:20:13.533512 (+1427524us) spinlock_profiling.cc:243] Waited 156 ms on lock 0x7b5400217ad4. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f9ae2fa 00007fcc1496fb17 00007fcc0deea6d4 00007fcc0deea662 00007fcc0deea591 00007fcc0deea50c 00007fcc0dee97c2 00007fcc0dce548c 00007fcc0dce48c6 00007fcc0dce426f
0709 13:20:13.533699 (+   187us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":359274880}
I20260709 13:20:13.536716  7496 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50744 (request call id 340) took 1476 ms. Trace:
W20260709 13:20:13.549036  6875 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.749s	user 0.002s	sys 0.027s
I20260709 13:20:13.510779 10818 raft_consensus.cc:515] T 30e88460611e47b2ba16a46a30b5f416 P b7ab4784c7344b939bc36f639286f377 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:13.548504 10650 raft_consensus.cc:3060] T 427c124d773f483294511e80fe340075 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:20:13.526480 11006 leader_election.cc:290] T 24ee15416e3145beaa1b8183453729a3 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 13 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
W20260709 13:20:13.559870  6695 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.695s	user 0.011s	sys 0.034s
W20260709 13:20:13.562892  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 149334us
W20260709 13:20:13.565568  7503 rpcz_store.cc:269] 0709 13:20:12.074246 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:12.074476 (+   230us) service_pool.cc:224] Handling call
0709 13:20:13.517352 (+1442876us) spinlock_profiling.cc:243] Waited 37.1 ms on lock 0x7b5400537d54. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f9ae2fa 00007fcc1496fb17 00007fcc0deea6d4 00007fcc0deea662 00007fcc0deea591 00007fcc0deea50c 00007fcc0dee97c2 00007fcc0dce548c 00007fcc0dce48c6 00007fcc0dce426f
0709 13:20:13.517576 (+   224us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":85387648}
W20260709 13:20:13.571015  6875 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.772s	user 0.002s	sys 0.027s
I20260709 13:20:13.570854  7496 rpcz_store.cc:276] 0709 13:20:12.060410 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:12.060916 (+   506us) service_pool.cc:224] Handling call
0709 13:20:13.536430 (+1475514us) spinlock_profiling.cc:243] Waited 740 ms on lock 0x7b54005802d4. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f9ae2fa 00007fcc1496fb17 00007fcc0deea6d4 00007fcc0deea662 00007fcc0deea591 00007fcc0deea50c 00007fcc0dee97c2 00007fcc0dce548c 00007fcc0dce48c6 00007fcc0dce426f
0709 13:20:13.536631 (+   201us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1701342592}
I20260709 13:20:13.550137  6732 rpcz_store.cc:276] 0709 13:20:12.335152 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:12.336004 (+   852us) service_pool.cc:224] Handling call
0709 13:20:12.336377 (+   373us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:12.336616 (+   239us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:20:12.771236 (+434620us) log.cc:844] Serialized 14 byte log entry
0709 13:20:13.407192 (+635956us) log.cc:844] Serialized 14 byte log entry
0709 13:20:13.416026 (+  8834us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:20:13.416140 (+   114us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:20:13.416221 (+    81us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:13.416327 (+   106us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:13.416503 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":40206,"prepare.queue_time_us":671469,"prepare.run_cpu_time_us":50,"prepare.run_wall_time_us":51,"raft.queue_time_us":15899,"raft.run_cpu_time_us":204,"raft.run_wall_time_us":8776,"spinlock_wait_cycles":48080256,"thread_start_us":1069358,"threads_started":2}
I20260709 13:20:13.580755  6844 leader_election.cc:304] T 9b3759de40694069b13c0f8bd40e5709 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:20:13.567786 11156 raft_consensus.cc:2749] T 3fa34c08b205435dba97346991aa1f92 P cd75a17ab2604397adab03bb8b5fd75c [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:20:13.596807  6844 leader_election.cc:304] T 4b8cacb381b746da8d0049b0a83b41dd P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb
W20260709 13:20:13.597939  6695 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.5.126.66:42817 timed out after 2.076s (SENT) [suppressed 6 similar messages]
W20260709 13:20:13.599946  6872 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.989s	user 0.035s	sys 0.037s
W20260709 13:20:13.601212  6872 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.991s	user 0.036s	sys 0.037s
W20260709 13:20:13.585774 10249 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.579s	user 0.009s	sys 0.062s
W20260709 13:20:13.617825  6724 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.088s	user 0.023s	sys 0.024s
W20260709 13:20:13.618655  6724 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.096s	user 0.023s	sys 0.024s
I20260709 13:20:13.567914 10920 raft_consensus.cc:515] T 7c44c4849aa54f2b94d1f1bef9ed546f P ccd8a4c3bfe3413cb2ae219b09aea832 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:13.590487 11013 raft_consensus.cc:493] T b3f13b31a1f84f0d89d007eadd57924c P ccd8a4c3bfe3413cb2ae219b09aea832 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:20:13.617450  6807 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.713s	user 0.017s	sys 0.011s
W20260709 13:20:13.621722 10249 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.613s	user 0.009s	sys 0.062s
I20260709 13:20:13.590695 11116 raft_consensus.cc:493] T e31b9971c15848dea59d4d4130141d9e P ccd8a4c3bfe3413cb2ae219b09aea832 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:13.583096 11008 leader_election.cc:290] T 2c240553ce044eedb41541d72b9475d7 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:20:13.590521 11033 raft_consensus.cc:493] T c4db81d9d329422bb3b4160ca4ac2d1d P ccd8a4c3bfe3413cb2ae219b09aea832 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:13.617810 11075 leader_election.cc:290] T 713b5728a197487c9300b310ab94e5a3 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:20:13.614465 11157 raft_consensus.cc:2749] T 9b3759de40694069b13c0f8bd40e5709 P cd75a17ab2604397adab03bb8b5fd75c [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:20:13.616508  6697 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.521s	user 0.005s	sys 0.012s
W20260709 13:20:13.629114  6807 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.725s	user 0.017s	sys 0.011s
W20260709 13:20:13.612246 11117 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.605s	user 0.005s	sys 0.011s
W20260709 13:20:13.642083  6881 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.509s	user 0.012s	sys 0.009s
I20260709 13:20:13.593194 11121 raft_consensus.cc:493] T f4b8bd455d5a47c18a1380839c6e0d61 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
W20260709 13:20:13.619765 11065 consensus_meta.cc:287] T 9e326172347f45e99a0d482b5d8ef768 P b7ab4784c7344b939bc36f639286f377: Time spent flushing consensus metadata: real 0.724s	user 0.014s	sys 0.000s
I20260709 13:20:13.593755 10621 leader_election.cc:290] T 3411566abe2d4c9bb4b2adfdd05e6f17 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 10 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:20:13.593336 10938 raft_consensus.cc:515] T 9b3759de40694069b13c0f8bd40e5709 P b7ab4784c7344b939bc36f639286f377 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
W20260709 13:20:13.645076  6771 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.640s	user 0.014s	sys 0.015s
I20260709 13:20:13.627964  6844 leader_election.cc:304] T dbdf895bba214ff68685a24fd17dfb5d P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:20:13.617658 10869 raft_consensus.cc:2804] T 4b8cacb381b746da8d0049b0a83b41dd P cd75a17ab2604397adab03bb8b5fd75c [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 13:20:13.650321 11141 log.cc:927] Time spent T dbdf895bba214ff68685a24fd17dfb5d P cd75a17ab2604397adab03bb8b5fd75c: Append to log took a long time: real 0.768s	user 0.009s	sys 0.000s
I20260709 13:20:13.655962 11124 raft_consensus.cc:3055] T a3022224cc81473690653a83d4e99470 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 12 LEADER]: Stepping down as leader of term 12
W20260709 13:20:13.658686  6881 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.525s	user 0.012s	sys 0.009s
W20260709 13:20:13.659853  6697 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.565s	user 0.005s	sys 0.013s
I20260709 13:20:13.668677  6697 leader_election.cc:304] T bb3d8792045a4583ae2e965b1350a5b4 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, cd75a17ab2604397adab03bb8b5fd75c
W20260709 13:20:13.669435  6731 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.824s	user 0.005s	sys 0.025s
W20260709 13:20:13.658351 11117 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.655s	user 0.006s	sys 0.011s
I20260709 13:20:13.644726 11154 raft_consensus.cc:493] T bb3d8792045a4583ae2e965b1350a5b4 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 9 FOLLOWER]: Starting pre-election (detected failure of leader cd75a17ab2604397adab03bb8b5fd75c)
W20260709 13:20:13.683163  7466 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 288989us
W20260709 13:20:13.680895  6772 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.584s	user 0.009s	sys 0.016s
W20260709 13:20:13.685189  6772 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.588s	user 0.010s	sys 0.016s
W20260709 13:20:13.677634  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 49884.2us
I20260709 13:20:13.642387 11013 raft_consensus.cc:515] T b3f13b31a1f84f0d89d007eadd57924c P ccd8a4c3bfe3413cb2ae219b09aea832 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
W20260709 13:20:13.670588  6731 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.854s	user 0.005s	sys 0.026s
W20260709 13:20:13.669492 11086 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.735s	user 0.006s	sys 0.016s
I20260709 13:20:13.683163 10969 leader_election.cc:290] T be1a92657f494cac8dd227d152f50151 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:20:13.665653 11121 raft_consensus.cc:515] T f4b8bd455d5a47c18a1380839c6e0d61 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
W20260709 13:20:13.664387  6771 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.659s	user 0.014s	sys 0.015s
W20260709 13:20:13.722473  6845 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.828s	user 0.000s	sys 0.024s
I20260709 13:20:13.722903  7498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b8cacb381b746da8d0049b0a83b41dd" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 13 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:20:13.725561 10920 leader_election.cc:290] T 7c44c4849aa54f2b94d1f1bef9ed546f P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:13.688606  6844 leader_election.cc:304] T ce4f062dcd314d43a63ca74067cb5ee3 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, ccd8a4c3bfe3413cb2ae219b09aea832
W20260709 13:20:13.723038  6845 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.930s	user 0.000s	sys 0.025s
I20260709 13:20:13.727835  6731 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50004 (request call id 2065) took 1392 ms. Trace:
W20260709 13:20:13.664798  6723 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.787s	user 0.004s	sys 0.068s
I20260709 13:20:13.646183 11116 raft_consensus.cc:515] T e31b9971c15848dea59d4d4130141d9e P ccd8a4c3bfe3413cb2ae219b09aea832 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:13.677716 11163 raft_consensus.cc:2749] T bb3d8792045a4583ae2e965b1350a5b4 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:20:13.702595  7503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "427c124d773f483294511e80fe340075" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:20:13.667323 10869 raft_consensus.cc:493] T 4b8cacb381b746da8d0049b0a83b41dd P cd75a17ab2604397adab03bb8b5fd75c [term 12 FOLLOWER]: Starting leader election (detected failure of leader 7ba59cc884714e8aa5f3f0ecaed84cbb)
I20260709 13:20:13.667740 11124 raft_consensus.cc:740] T a3022224cc81473690653a83d4e99470 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
I20260709 13:20:13.703599  6799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8cee0accdb8499c86d4414b72565a38" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:20:13.742188  6799 raft_consensus.cc:2393] T d8cee0accdb8499c86d4414b72565a38 P b7ab4784c7344b939bc36f639286f377 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in current term 11: Already voted for candidate b7ab4784c7344b939bc36f639286f377 in this term.
I20260709 13:20:13.743260  6799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34f36d59d88f40fe8a2805e604fc6c0a" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:13.705080  7502 raft_consensus.cc:1275] T 17587d6730594da4a56fa13a353232a1 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 16 FOLLOWER]: Refusing update from remote peer ccd8a4c3bfe3413cb2ae219b09aea832: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 16 index: 11. (term mismatch)
I20260709 13:20:13.744220  7502 pending_rounds.cc:85] T 17587d6730594da4a56fa13a353232a1 P 7ba59cc884714e8aa5f3f0ecaed84cbb: Aborting all ops after (but not including) 10
I20260709 13:20:13.744549  7502 pending_rounds.cc:107] T 17587d6730594da4a56fa13a353232a1 P 7ba59cc884714e8aa5f3f0ecaed84cbb: Aborting uncommitted NO_OP operation due to leader change: 15.11
I20260709 13:20:13.744879  7502 raft_consensus.cc:2889] T 17587d6730594da4a56fa13a353232a1 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:20:13.747531  6773 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:13.688828 11042 consensus_queue.cc:1048] T b3f13b31a1f84f0d89d007eadd57924c P 7ba59cc884714e8aa5f3f0ecaed84cbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.045s
I20260709 13:20:13.681995 10621 raft_consensus.cc:2749] T dbdf895bba214ff68685a24fd17dfb5d P cd75a17ab2604397adab03bb8b5fd75c [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:20:13.714249  6804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17587d6730594da4a56fa13a353232a1" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:13.659392 11033 raft_consensus.cc:515] T c4db81d9d329422bb3b4160ca4ac2d1d P ccd8a4c3bfe3413cb2ae219b09aea832 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:13.683586 11117 raft_consensus.cc:3055] T 8c7f33e544204fbaac4078e3e83bbf4e P b7ab4784c7344b939bc36f639286f377 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:20:13.778934 11117 raft_consensus.cc:740] T 8c7f33e544204fbaac4078e3e83bbf4e P b7ab4784c7344b939bc36f639286f377 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
I20260709 13:20:13.734642 11008 raft_consensus.cc:493] T 7c44c4849aa54f2b94d1f1bef9ed546f P cd75a17ab2604397adab03bb8b5fd75c [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:20:13.779873 11117 consensus_queue.cc:260] T 8c7f33e544204fbaac4078e3e83bbf4e P b7ab4784c7344b939bc36f639286f377 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:13.780331 11008 raft_consensus.cc:515] T 7c44c4849aa54f2b94d1f1bef9ed546f P cd75a17ab2604397adab03bb8b5fd75c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:13.761629 11071 leader_election.cc:290] T 3fa34c08b205435dba97346991aa1f92 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:13.761363 10727 leader_election.cc:290] T 3fa34c08b205435dba97346991aa1f92 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:20:13.782482 11008 leader_election.cc:290] T 7c44c4849aa54f2b94d1f1bef9ed546f P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
W20260709 13:20:13.761103 11155 log.cc:927] Time spent T b56bf91d90824c959e21e0cee5ba1816 P ccd8a4c3bfe3413cb2ae219b09aea832: Append to log took a long time: real 0.050s	user 0.000s	sys 0.000s
W20260709 13:20:13.786654 11139 consensus_meta.cc:287] T a1704639a875409b9959353527b3fd68 P cd75a17ab2604397adab03bb8b5fd75c: Time spent flushing consensus metadata: real 0.525s	user 0.010s	sys 0.001s
W20260709 13:20:13.729898  6723 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.852s	user 0.004s	sys 0.068s
W20260709 13:20:13.700134 11132 consensus_meta.cc:287] T ce4f062dcd314d43a63ca74067cb5ee3 P 7ba59cc884714e8aa5f3f0ecaed84cbb: Time spent flushing consensus metadata: real 0.581s	user 0.004s	sys 0.013s
I20260709 13:20:13.789481 11033 leader_election.cc:290] T c4db81d9d329422bb3b4160ca4ac2d1d P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
W20260709 13:20:13.717504 11086 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.809s	user 0.006s	sys 0.017s
I20260709 13:20:13.790134 11052 leader_election.cc:290] T 9e326172347f45e99a0d482b5d8ef768 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:20:13.764309 11175 raft_consensus.cc:493] T 07a92dd554674067a83a9cb68c4773f2 P cd75a17ab2604397adab03bb8b5fd75c [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:13.748885 11156 raft_consensus.cc:2749] T ce4f062dcd314d43a63ca74067cb5ee3 P cd75a17ab2604397adab03bb8b5fd75c [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:20:13.765026 10818 leader_election.cc:290] T 30e88460611e47b2ba16a46a30b5f416 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 10 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:13.751205 11160 leader_election.cc:290] T 4f00a2e87e56452083b759f60d461ee3 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
W20260709 13:20:13.757725 11136 log.cc:927] Time spent T 7ba5dac66ab5497e9e336f2a3c28cda5 P cd75a17ab2604397adab03bb8b5fd75c: Append to log took a long time: real 0.746s	user 0.004s	sys 0.005s
I20260709 13:20:13.766816  6804 raft_consensus.cc:2468] T 17587d6730594da4a56fa13a353232a1 P b7ab4784c7344b939bc36f639286f377 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in term 16.
I20260709 13:20:13.795027  6804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce4f062dcd314d43a63ca74067cb5ee3" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:13.683728 11154 raft_consensus.cc:515] T bb3d8792045a4583ae2e965b1350a5b4 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:20:13.797914 11154 leader_election.cc:290] T bb3d8792045a4583ae2e965b1350a5b4 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
W20260709 13:20:13.733693 11159 log.cc:927] Time spent T d33d5ee8ef6f415593d8df52063161ad P ccd8a4c3bfe3413cb2ae219b09aea832: Append to log took a long time: real 0.185s	user 0.000s	sys 0.002s
I20260709 13:20:13.790171 11086 raft_consensus.cc:697] T c4db81d9d329422bb3b4160ca4ac2d1d P cd75a17ab2604397adab03bb8b5fd75c [term 10 LEADER]: Becoming Leader. State: Replica: cd75a17ab2604397adab03bb8b5fd75c, State: Running, Role: LEADER
I20260709 13:20:13.733567 11157 raft_consensus.cc:493] T 95a75bfe094d4bdc963aba3f08dfcd25 P cd75a17ab2604397adab03bb8b5fd75c [term 11 FOLLOWER]: Starting pre-election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:20:13.799691 11157 raft_consensus.cc:515] T 95a75bfe094d4bdc963aba3f08dfcd25 P cd75a17ab2604397adab03bb8b5fd75c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:13.799757 11086 consensus_queue.cc:237] T c4db81d9d329422bb3b4160ca4ac2d1d P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:13.802001  6881 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53406 (request call id 2109) took 1744 ms. Trace:
I20260709 13:20:13.752372  7500 raft_consensus.cc:1275] T 24ee15416e3145beaa1b8183453729a3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 12 FOLLOWER]: Refusing update from remote peer ccd8a4c3bfe3413cb2ae219b09aea832: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:20:13.768018  6875 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53406 (request call id 2096) took 1731 ms. Trace:
I20260709 13:20:13.787225 11139 raft_consensus.cc:515] T a1704639a875409b9959353527b3fd68 P cd75a17ab2604397adab03bb8b5fd75c [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:13.806833 11139 leader_election.cc:290] T a1704639a875409b9959353527b3fd68 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 13 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:20:13.809278  6730 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50004 (request call id 2074) took 1280 ms. Trace:
I20260709 13:20:13.809684  6730 rpcz_store.cc:276] 0709 13:20:12.528671 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:12.612164 (+ 83493us) service_pool.cc:224] Handling call
0709 13:20:12.772387 (+160223us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:12.920315 (+147928us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:13.808955 (+888640us) spinlock_profiling.cc:243] Waited 60.2 ms on lock 0x7b5400319cd4. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f9aae01 00007fcc0f9a983e 00007fcc1496e419 00007fcc0dee5bd4 00007fcc0dee5b62 00007fcc0dee5a91 00007fcc0dee5a0c 00007fcc0dee4cc2 00007fcc0dce548c 00007fcc0dce48c6
0709 13:20:13.809203 (+   248us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":138570496}
I20260709 13:20:13.741597 10869 raft_consensus.cc:3060] T 4b8cacb381b746da8d0049b0a83b41dd P cd75a17ab2604397adab03bb8b5fd75c [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:13.728615  6731 rpcz_store.cc:276] 0709 13:20:12.335548 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:12.335690 (+   142us) service_pool.cc:224] Handling call
0709 13:20:12.336027 (+   337us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:12.336322 (+   295us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:20:12.816742 (+480420us) log.cc:844] Serialized 14 byte log entry
0709 13:20:13.727445 (+910703us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:20:13.727505 (+    60us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:20:13.727559 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:13.727651 (+    92us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:13.727776 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5504,"prepare.queue_time_us":609664,"prepare.run_cpu_time_us":73,"prepare.run_wall_time_us":1656,"thread_start_us":1375420,"threads_started":2,"wal-append.queue_time_us":883158}
I20260709 13:20:13.743993  6799 raft_consensus.cc:2468] T 34f36d59d88f40fe8a2805e604fc6c0a P b7ab4784c7344b939bc36f639286f377 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 8.
I20260709 13:20:13.792073  6723 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50004 (request call id 2066) took 1456 ms. Trace:
I20260709 13:20:13.758157  7498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce4f062dcd314d43a63ca74067cb5ee3" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:20:13.813181  7498 raft_consensus.cc:2468] T ce4f062dcd314d43a63ca74067cb5ee3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 11.
I20260709 13:20:13.759356  7495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1528ab62b6fe4e3099d08f141afee116" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:20:13.734417 11075 raft_consensus.cc:493] T 20f6842e26174571996b8dea4151d4be P cd75a17ab2604397adab03bb8b5fd75c [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:13.740725 11065 raft_consensus.cc:493] T c4db81d9d329422bb3b4160ca4ac2d1d P b7ab4784c7344b939bc36f639286f377 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:13.770332 11066 leader_election.cc:290] T e77e330a82df4b43a745d57a68f6f057 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391)
I20260709 13:20:13.750835 11167 raft_consensus.cc:493] T bb7fa124c3bf4ef9ab65a407cb008441 P cd75a17ab2604397adab03bb8b5fd75c [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:13.773888 11116 leader_election.cc:290] T e31b9971c15848dea59d4d4130141d9e P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:13.777628 11013 leader_election.cc:290] T b3f13b31a1f84f0d89d007eadd57924c P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:20:13.791342 11175 raft_consensus.cc:515] T 07a92dd554674067a83a9cb68c4773f2 P cd75a17ab2604397adab03bb8b5fd75c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:13.757414  6803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1528ab62b6fe4e3099d08f141afee116" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:13.795847  6804 raft_consensus.cc:2393] T ce4f062dcd314d43a63ca74067cb5ee3 P b7ab4784c7344b939bc36f639286f377 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ccd8a4c3bfe3413cb2ae219b09aea832 in current term 11: Already voted for candidate cd75a17ab2604397adab03bb8b5fd75c in this term.
W20260709 13:20:13.736876  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 48391.1us
I20260709 13:20:13.812198  6723 rpcz_store.cc:276] 0709 13:20:12.335884 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:12.366577 (+ 30693us) service_pool.cc:224] Handling call
0709 13:20:12.418317 (+ 51740us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:12.418607 (+   290us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:20:12.608250 (+189643us) log.cc:844] Serialized 14 byte log entry
0709 13:20:13.790929 (+1182679us) log.cc:844] Serialized 14 byte log entry
0709 13:20:13.791576 (+   647us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:20:13.791647 (+    71us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:20:13.791735 (+    88us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:13.791829 (+    94us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:13.791986 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2006,"prepare.queue_time_us":600890,"prepare.run_cpu_time_us":88,"prepare.run_wall_time_us":92,"raft.queue_time_us":22993,"raft.run_cpu_time_us":354,"raft.run_wall_time_us":38025,"thread_start_us":1352439,"threads_started":3,"wal-append.queue_time_us":797382}
W20260709 13:20:13.695258  6772 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 797061us
I20260709 13:20:13.802397  6881 rpcz_store.cc:276] 0709 13:20:12.058045 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:12.795255 (+737210us) service_pool.cc:224] Handling call
0709 13:20:12.806814 (+ 11559us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:20:13.034250 (+227436us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:13.034566 (+   316us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:20:13.096360 (+ 61794us) log.cc:844] Serialized 52 byte log entry
0709 13:20:13.668009 (+571649us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:20:13.698845 (+ 30836us) log.cc:844] Serialized 14 byte log entry
0709 13:20:13.716994 (+ 18149us) log.cc:844] Serialized 14 byte log entry
0709 13:20:13.717209 (+   215us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:13.717286 (+    77us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:13.801755 (+ 84469us) raft_consensus.cc:1685] finished
0709 13:20:13.801781 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:13.801935 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":28287,"prepare.queue_time_us":63557,"prepare.run_cpu_time_us":127,"prepare.run_wall_time_us":4063,"raft.queue_time_us":348459,"raft.run_cpu_time_us":100,"raft.run_wall_time_us":102,"spinlock_wait_cycles":28295168,"thread_start_us":760995,"threads_started":2,"wal-append.queue_time_us":688781}
I20260709 13:20:13.803865  6875 rpcz_store.cc:276] 0709 13:20:12.036410 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:12.037464 (+  1054us) service_pool.cc:224] Handling call
0709 13:20:12.037892 (+   428us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:12.057687 (+ 19795us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:12.057717 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:20:12.058223 (+   506us) log.cc:844] Serialized 26 byte log entry
0709 13:20:12.457181 (+398958us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:20:12.797634 (+340453us) log.cc:844] Serialized 14 byte log entry
0709 13:20:13.578061 (+780427us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:13.578177 (+   116us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:13.649522 (+ 71345us) spinlock_profiling.cc:243] Waited 14 ms on lock 0x7b4400022b4c. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0c745db1 00007fcc0c7e3c85 00007fcc0c7e46a2 00007fcc0f5561db 00007fcc0f551aaf 00007fcc0f54586e 00007fcc0f544bb6 00007fcc0f5447d8 00007fcc0f54e221 00007fcc0f54e1d9 00007fcc0f54e169
0709 13:20:13.746274 (+ 96752us) raft_consensus.cc:1685] finished
0709 13:20:13.767777 (+ 21503us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:13.767945 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":657099,"prepare.run_cpu_time_us":47,"prepare.run_wall_time_us":49,"raft.queue_time_us":334120,"raft.run_cpu_time_us":219,"raft.run_wall_time_us":27962,"spinlock_wait_cycles":32232704,"thread_start_us":1400505,"threads_started":3,"wal-append.queue_time_us":547164}
W20260709 13:20:13.790788 11126 consensus_meta.cc:287] T 44bde925b2e541b69890d70715b85176 P ccd8a4c3bfe3413cb2ae219b09aea832: Time spent flushing consensus metadata: real 0.603s	user 0.010s	sys 0.002s
W20260709 13:20:13.816877  6695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 218962us
I20260709 13:20:13.818895  6799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "853ac0a8cbd64ce99457f170216d4d0f" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
W20260709 13:20:13.830070  6800 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.660s	user 0.011s	sys 0.018s
W20260709 13:20:13.867738  6800 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.698s	user 0.013s	sys 0.021s
I20260709 13:20:13.761790 11047 leader_election.cc:290] T 853ac0a8cbd64ce99457f170216d4d0f P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 9 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:20:13.866254  6844 leader_election.cc:304] T f3f9c2e2bf644115957398fe4c9459db P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
W20260709 13:20:13.869303  6773 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:13.878242  6844 leader_election.cc:304] T fe20b4b48823486ca3b9c648db6ce8aa P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:20:13.878573  6878 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58592 (request call id 334) took 2180 ms. Trace:
I20260709 13:20:13.878969  6878 rpcz_store.cc:276] 0709 13:20:11.687254 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:11.716087 (+ 28833us) service_pool.cc:224] Handling call
0709 13:20:11.716534 (+   447us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:11.722852 (+  6318us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:11.722886 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:20:11.772177 (+ 49291us) log.cc:844] Serialized 26 byte log entry
0709 13:20:12.793999 (+1021822us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:20:13.452780 (+658781us) log.cc:844] Serialized 14 byte log entry
0709 13:20:13.453069 (+   289us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:13.453159 (+    90us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:13.720528 (+267369us) spinlock_profiling.cc:243] Waited 15.1 ms on lock 0x7b4400022b4c. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0c745db1 00007fcc0c7e3c85 00007fcc0c7e46a2 00007fcc0f5561db 00007fcc0f551aaf 00007fcc0f54586e 00007fcc0f544bb6 00007fcc0f5447d8 00007fcc0f54e221 00007fcc0f54e1d9 00007fcc0f54e169
0709 13:20:13.850805 (+130277us) raft_consensus.cc:1685] finished
0709 13:20:13.867254 (+ 16449us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:13.867465 (+   211us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5845,"prepare.queue_time_us":320550,"prepare.run_cpu_time_us":30,"prepare.run_wall_time_us":31,"raft.queue_time_us":13288,"raft.run_cpu_time_us":307,"raft.run_wall_time_us":20033,"spinlock_wait_cycles":34639744,"thread_start_us":1640065,"threads_started":2,"wal-append.queue_time_us":1091981}
I20260709 13:20:13.872766  6772 leader_election.cc:304] T f58dc08b12a2494bb9a1372837970ca2 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:20:13.875715  6803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "711ef6523deb4cbe8ef2ba61e1c21c98" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:13.884707  6803 raft_consensus.cc:2468] T 711ef6523deb4cbe8ef2ba61e1c21c98 P b7ab4784c7344b939bc36f639286f377 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 12.
I20260709 13:20:13.886420  6803 raft_consensus.cc:1240] T f58dc08b12a2494bb9a1372837970ca2 P b7ab4784c7344b939bc36f639286f377 [term 14 FOLLOWER]: Rejecting Update request from peer ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 13. Current term is 14. Ops: []
I20260709 13:20:13.883103  6772 leader_election.cc:304] T 7c37d41cd9164c15a6826ca62a851a69 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:20:13.891649  6807 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:32976 (request call id 2811) took 1029 ms. Trace:
I20260709 13:20:13.900231 10160 raft_consensus.cc:2804] T 7c37d41cd9164c15a6826ca62a851a69 P b7ab4784c7344b939bc36f639286f377 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:20:13.900887 10160 raft_consensus.cc:697] T 7c37d41cd9164c15a6826ca62a851a69 P b7ab4784c7344b939bc36f639286f377 [term 11 LEADER]: Becoming Leader. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
I20260709 13:20:13.902335  6803 raft_consensus.cc:1240] T 2c240553ce044eedb41541d72b9475d7 P b7ab4784c7344b939bc36f639286f377 [term 13 FOLLOWER]: Rejecting Update request from peer ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 12. Current term is 13. Ops: []
I20260709 13:20:13.899858  6807 rpcz_store.cc:276] 0709 13:20:12.861872 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:12.861990 (+   118us) service_pool.cc:224] Handling call
0709 13:20:12.862292 (+   302us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:12.862501 (+   209us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:20:13.658307 (+795806us) log.cc:844] Serialized 14 byte log entry
0709 13:20:13.890779 (+232472us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:20:13.890850 (+    71us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:20:13.890925 (+    75us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:13.891033 (+   108us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:13.891549 (+   516us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":570,"prepare.queue_time_us":896181,"prepare.run_cpu_time_us":44,"prepare.run_wall_time_us":44,"raft.queue_time_us":770,"raft.run_cpu_time_us":115,"raft.run_wall_time_us":117,"thread_start_us":984025,"threads_started":2}
I20260709 13:20:13.906803  6844 leader_election.cc:304] T d8292e16e5654be6bc408560cf256aaa P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:20:13.887946  6695 leader_election.cc:304] T f5be3a11b23d4ea9b08300a2789821c7 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
I20260709 13:20:13.910514  6807 raft_consensus.cc:1275] T 3411566abe2d4c9bb4b2adfdd05e6f17 P b7ab4784c7344b939bc36f639286f377 [term 9 FOLLOWER]: Refusing update from remote peer ccd8a4c3bfe3413cb2ae219b09aea832: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:20:13.752744 11169 raft_consensus.cc:493] T fe20b4b48823486ca3b9c648db6ce8aa P ccd8a4c3bfe3413cb2ae219b09aea832 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:13.786558 10650 raft_consensus.cc:515] T 427c124d773f483294511e80fe340075 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 10 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } attrs { replace: true } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
W20260709 13:20:13.806988 11149 log.cc:927] Time spent T 90d42e216d9741e190bca19a781291fd P ccd8a4c3bfe3413cb2ae219b09aea832: Append to log took a long time: real 0.481s	user 0.004s	sys 0.004s
I20260709 13:20:13.900486  6772 leader_election.cc:304] T 4d9def8b32fd443aa94ab1420b06837b P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:20:13.915997  6844 leader_election.cc:304] T f09c2a98de1a4decabd0ff900dd44caa P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377
I20260709 13:20:13.918160 10160 consensus_queue.cc:237] T 7c37d41cd9164c15a6826ca62a851a69 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:13.909420 11173 raft_consensus.cc:493] T 9e326172347f45e99a0d482b5d8ef768 P b7ab4784c7344b939bc36f639286f377 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:13.903280 11066 raft_consensus.cc:2749] T f3f9c2e2bf644115957398fe4c9459db P cd75a17ab2604397adab03bb8b5fd75c [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:20:13.927129  7466 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 178718us
I20260709 13:20:13.929666  5625 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:20:13.843096 11065 raft_consensus.cc:515] T c4db81d9d329422bb3b4160ca4ac2d1d P b7ab4784c7344b939bc36f639286f377 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:13.933041  7466 leader_election.cc:304] T 17587d6730594da4a56fa13a353232a1 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, b7ab4784c7344b939bc36f639286f377; no voters: 
I20260709 13:20:13.911031 11156 raft_consensus.cc:2749] T fe20b4b48823486ca3b9c648db6ce8aa P cd75a17ab2604397adab03bb8b5fd75c [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:20:13.817267 11075 raft_consensus.cc:515] T 20f6842e26174571996b8dea4151d4be P cd75a17ab2604397adab03bb8b5fd75c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:13.936085  7503 raft_consensus.cc:2393] T 427c124d773f483294511e80fe340075 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ccd8a4c3bfe3413cb2ae219b09aea832 in current term 10: Already voted for candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in this term.
I20260709 13:20:13.943156  6695 leader_election.cc:304] T 34f36d59d88f40fe8a2805e604fc6c0a P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
I20260709 13:20:13.943756  6728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fa34c08b205435dba97346991aa1f92" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:13.943918 11163 consensus_queue.cc:1048] T 3d65025eea89441290d85dd053810e31 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:20:13.944507  6728 raft_consensus.cc:2468] T 3fa34c08b205435dba97346991aa1f92 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in term 12.
I20260709 13:20:13.945075  6695 leader_election.cc:304] T 711ef6523deb4cbe8ef2ba61e1c21c98 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
I20260709 13:20:13.946691  7466 leader_election.cc:304] T 3fa34c08b205435dba97346991aa1f92 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
I20260709 13:20:13.947413  6731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5be3a11b23d4ea9b08300a2789821c7" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:13.947674  6732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3d8792045a4583ae2e965b1350a5b4" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:13.947796  6725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3022224cc81473690653a83d4e99470" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:13.949144  6729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "853ac0a8cbd64ce99457f170216d4d0f" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:20:13.950785  6732 raft_consensus.cc:2468] T bb3d8792045a4583ae2e965b1350a5b4 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in term 9.
I20260709 13:20:13.951192  6729 raft_consensus.cc:3060] T 853ac0a8cbd64ce99457f170216d4d0f P ccd8a4c3bfe3413cb2ae219b09aea832 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:20:13.951864  6732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44bde925b2e541b69890d70715b85176" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:13.953040 11163 raft_consensus.cc:2804] T 34f36d59d88f40fe8a2805e604fc6c0a P ccd8a4c3bfe3413cb2ae219b09aea832 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:20:13.953516 11163 raft_consensus.cc:493] T 34f36d59d88f40fe8a2805e604fc6c0a P ccd8a4c3bfe3413cb2ae219b09aea832 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:13.953939 11163 raft_consensus.cc:3060] T 34f36d59d88f40fe8a2805e604fc6c0a P ccd8a4c3bfe3413cb2ae219b09aea832 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:20:13.949970 10832 raft_consensus.cc:493] T 404190ce4ce94cecbfcb6ea9d1dd8626 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 7ba59cc884714e8aa5f3f0ecaed84cbb)
I20260709 13:20:13.956750 10832 raft_consensus.cc:515] T 404190ce4ce94cecbfcb6ea9d1dd8626 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:20:13.959249 10832 leader_election.cc:290] T 404190ce4ce94cecbfcb6ea9d1dd8626 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:20:13.961246  6729 raft_consensus.cc:2468] T 853ac0a8cbd64ce99457f170216d4d0f P ccd8a4c3bfe3413cb2ae219b09aea832 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 9.
I20260709 13:20:13.962944  6729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e326172347f45e99a0d482b5d8ef768" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:13.919828 11047 raft_consensus.cc:2749] T d8292e16e5654be6bc408560cf256aaa P cd75a17ab2604397adab03bb8b5fd75c [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:20:13.965739  6881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3d8792045a4583ae2e965b1350a5b4" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:13.918366 10580 raft_consensus.cc:2804] T f5be3a11b23d4ea9b08300a2789821c7 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:20:13.967653  6844 leader_election.cc:304] T 853ac0a8cbd64ce99457f170216d4d0f P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:20:13.903026 11033 consensus_queue.cc:1059] T 4d9def8b32fd443aa94ab1420b06837b P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: INVALID_TERM, Last received: 11.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.032s
I20260709 13:20:13.982708  7466 leader_election.cc:304] T bb3d8792045a4583ae2e965b1350a5b4 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:20:13.926815 11160 raft_consensus.cc:2804] T f09c2a98de1a4decabd0ff900dd44caa P cd75a17ab2604397adab03bb8b5fd75c [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:20:13.868443 11126 raft_consensus.cc:515] T 44bde925b2e541b69890d70715b85176 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:13.925031 10818 raft_consensus.cc:2804] T 4d9def8b32fd443aa94ab1420b06837b P b7ab4784c7344b939bc36f639286f377 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:20:13.815922 11124 consensus_queue.cc:260] T a3022224cc81473690653a83d4e99470 P ccd8a4c3bfe3413cb2ae219b09aea832 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.6, Last appended by leader: 6, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:13.889333 11170 consensus_queue.cc:1048] T 22ccee1b570c4ad3a57bd7aec085b1b4 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.077s
I20260709 13:20:13.939255 10938 leader_election.cc:290] T 9b3759de40694069b13c0f8bd40e5709 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 11 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:13.871641 11167 raft_consensus.cc:515] T bb7fa124c3bf4ef9ab65a407cb008441 P cd75a17ab2604397adab03bb8b5fd75c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:20:13.931097 11111 consensus_queue.cc:1059] T 7887766dc6784fcaa42b35c05fea7a99 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.070s
W20260709 13:20:13.998641 11142 log.cc:927] Time spent T 404190ce4ce94cecbfcb6ea9d1dd8626 P b7ab4784c7344b939bc36f639286f377: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 13:20:13.938777 11093 raft_consensus.cc:493] T 1bf4668eeb70467fb3dc5a0289233b3c P cd75a17ab2604397adab03bb8b5fd75c [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:20:13.992859  6878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fa34c08b205435dba97346991aa1f92" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:13.972555 11132 raft_consensus.cc:2804] T 17587d6730594da4a56fa13a353232a1 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:20:14.019939  6878 raft_consensus.cc:2468] T 3fa34c08b205435dba97346991aa1f92 P cd75a17ab2604397adab03bb8b5fd75c [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in term 13.
I20260709 13:20:13.989521 11052 raft_consensus.cc:2804] T 853ac0a8cbd64ce99457f170216d4d0f P cd75a17ab2604397adab03bb8b5fd75c [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:20:13.989172 11010 raft_consensus.cc:2804] T 711ef6523deb4cbe8ef2ba61e1c21c98 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:20:14.002722 11071 raft_consensus.cc:2804] T 3fa34c08b205435dba97346991aa1f92 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:20:14.027616 11071 raft_consensus.cc:493] T 3fa34c08b205435dba97346991aa1f92 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:14.028167 11071 raft_consensus.cc:3060] T 3fa34c08b205435dba97346991aa1f92 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:14.030923 11052 raft_consensus.cc:697] T 853ac0a8cbd64ce99457f170216d4d0f P cd75a17ab2604397adab03bb8b5fd75c [term 9 LEADER]: Becoming Leader. State: Replica: cd75a17ab2604397adab03bb8b5fd75c, State: Running, Role: LEADER
I20260709 13:20:14.020437 11132 raft_consensus.cc:493] T 17587d6730594da4a56fa13a353232a1 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:14.032603 11132 raft_consensus.cc:3060] T 17587d6730594da4a56fa13a353232a1 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:14.037297 11065 leader_election.cc:290] T c4db81d9d329422bb3b4160ca4ac2d1d P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:14.037730 10993 leader_election.cc:290] T d8cee0accdb8499c86d4414b72565a38 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 11 election: Requested vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:14.039639 10650 leader_election.cc:290] T 427c124d773f483294511e80fe340075 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 10 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:14.053258  6806 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:32976 (request call id 2812) took 1191 ms. Trace:
I20260709 13:20:14.053828  6806 rpcz_store.cc:276] 0709 13:20:12.862130 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:12.862251 (+   121us) service_pool.cc:224] Handling call
0709 13:20:13.384708 (+522457us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:13.385781 (+  1073us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:14.052983 (+667202us) spinlock_profiling.cc:243] Waited 477 ms on lock 0x7b54001f6150. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f9a98ad 00007fcc1496e419 00007fcc0dee5bd4 00007fcc0dee5b62 00007fcc0dee5a91 00007fcc0dee5a0c 00007fcc0dee4cc2 00007fcc0dce548c 00007fcc0dce48c6 00007fcc0dce426f
0709 13:20:14.053177 (+   194us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1096057600}
I20260709 13:20:13.930310 11169 raft_consensus.cc:515] T fe20b4b48823486ca3b9c648db6ce8aa P ccd8a4c3bfe3413cb2ae219b09aea832 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:20:14.004104 10580 raft_consensus.cc:697] T f5be3a11b23d4ea9b08300a2789821c7 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 10 LEADER]: Becoming Leader. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
I20260709 13:20:14.069666  6881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "427c124d773f483294511e80fe340075" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:20:14.070464  6881 raft_consensus.cc:3060] T 427c124d773f483294511e80fe340075 P cd75a17ab2604397adab03bb8b5fd75c [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:20:14.027067 11010 raft_consensus.cc:493] T 711ef6523deb4cbe8ef2ba61e1c21c98 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:14.025087  6732 raft_consensus.cc:2393] T 44bde925b2e541b69890d70715b85176 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c in current term 13: Already voted for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in this term.
I20260709 13:20:14.062575  6875 raft_consensus.cc:1275] T bb7fa124c3bf4ef9ab65a407cb008441 P cd75a17ab2604397adab03bb8b5fd75c [term 12 FOLLOWER]: Refusing update from remote peer 7ba59cc884714e8aa5f3f0ecaed84cbb: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:20:14.016304 11160 raft_consensus.cc:697] T f09c2a98de1a4decabd0ff900dd44caa P cd75a17ab2604397adab03bb8b5fd75c [term 13 LEADER]: Becoming Leader. State: Replica: cd75a17ab2604397adab03bb8b5fd75c, State: Running, Role: LEADER
I20260709 13:20:14.018534 11042 raft_consensus.cc:2804] T bb3d8792045a4583ae2e965b1350a5b4 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:20:14.016391 10818 raft_consensus.cc:697] T 4d9def8b32fd443aa94ab1420b06837b P b7ab4784c7344b939bc36f639286f377 [term 12 LEADER]: Becoming Leader. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
I20260709 13:20:13.998185 11134 consensus_queue.cc:1059] T f58dc08b12a2494bb9a1372837970ca2 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: INVALID_TERM, Last received: 13.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.061s
W20260709 13:20:14.116325  6772 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 195714us
I20260709 13:20:13.972771 11166 consensus_queue.cc:1048] T e31b9971c15848dea59d4d4130141d9e P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.085s
I20260709 13:20:14.026079 11124 raft_consensus.cc:3060] T a3022224cc81473690653a83d4e99470 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:20:14.119227  6695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 114385us
I20260709 13:20:14.001053  6729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e31b9971c15848dea59d4d4130141d9e" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:14.140298  6729 raft_consensus.cc:2468] T e31b9971c15848dea59d4d4130141d9e P ccd8a4c3bfe3413cb2ae219b09aea832 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 9.
I20260709 13:20:14.124260  6878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8cee0accdb8499c86d4414b72565a38" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:20:14.142031  6878 raft_consensus.cc:2393] T d8cee0accdb8499c86d4414b72565a38 P cd75a17ab2604397adab03bb8b5fd75c [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in current term 11: Already voted for candidate b7ab4784c7344b939bc36f639286f377 in this term.
I20260709 13:20:14.126679  6772 leader_election.cc:304] T 34f36d59d88f40fe8a2805e604fc6c0a P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:20:13.967403 11173 raft_consensus.cc:515] T 9e326172347f45e99a0d482b5d8ef768 P b7ab4784c7344b939bc36f639286f377 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:14.132157  6723 raft_consensus.cc:1275] T fe20b4b48823486ca3b9c648db6ce8aa P ccd8a4c3bfe3413cb2ae219b09aea832 [term 10 FOLLOWER]: Refusing update from remote peer 7ba59cc884714e8aa5f3f0ecaed84cbb: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:20:14.147205  6772 leader_election.cc:304] T a1704639a875409b9959353527b3fd68 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:20:14.155184  6772 leader_election.cc:304] T d8cee0accdb8499c86d4414b72565a38 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:20:14.069199 11121 leader_election.cc:290] T f4b8bd455d5a47c18a1380839c6e0d61 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:14.118772 11010 raft_consensus.cc:3060] T 711ef6523deb4cbe8ef2ba61e1c21c98 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:14.023700 11093 raft_consensus.cc:515] T 1bf4668eeb70467fb3dc5a0289233b3c P cd75a17ab2604397adab03bb8b5fd75c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:14.172492  6844 leader_election.cc:304] T e31b9971c15848dea59d4d4130141d9e P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:20:14.120498 11042 raft_consensus.cc:493] T bb3d8792045a4583ae2e965b1350a5b4 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 9 FOLLOWER]: Starting leader election (detected failure of leader cd75a17ab2604397adab03bb8b5fd75c)
I20260709 13:20:14.174084  6881 raft_consensus.cc:2468] T 427c124d773f483294511e80fe340075 P cd75a17ab2604397adab03bb8b5fd75c [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in term 10.
I20260709 13:20:14.177104  6772 leader_election.cc:304] T 711ef6523deb4cbe8ef2ba61e1c21c98 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:20:14.187192 11121 consensus_queue.cc:1059] T de3186201e1a40d0b335eeb8b4e256e0 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
W20260709 13:20:14.189488 11184 log.cc:927] Time spent T 4275cf08e63345f993bce8664eada830 P b7ab4784c7344b939bc36f639286f377: Append to log took a long time: real 0.121s	user 0.000s	sys 0.000s
I20260709 13:20:14.189548 11157 leader_election.cc:290] T 95a75bfe094d4bdc963aba3f08dfcd25 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:20:14.190605 11134 raft_consensus.cc:3055] T de3186201e1a40d0b335eeb8b4e256e0 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:20:14.191188 11134 raft_consensus.cc:740] T de3186201e1a40d0b335eeb8b4e256e0 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
W20260709 13:20:14.192759 11176 log.cc:927] Time spent T f03d0dbf16864ca4bc1bb5e4c0334c0f P b7ab4784c7344b939bc36f639286f377: Append to log took a long time: real 0.213s	user 0.000s	sys 0.001s
I20260709 13:20:14.192432 11134 consensus_queue.cc:260] T de3186201e1a40d0b335eeb8b4e256e0 P ccd8a4c3bfe3413cb2ae219b09aea832 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:14.194372  6800 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:32976 (request call id 2813) took 1332 ms. Trace:
W20260709 13:20:14.194619 11185 log.cc:927] Time spent T 404190ce4ce94cecbfcb6ea9d1dd8626 P ccd8a4c3bfe3413cb2ae219b09aea832: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
I20260709 13:20:14.194834  6800 rpcz_store.cc:276] 0709 13:20:12.862405 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:13.126857 (+264452us) service_pool.cc:224] Handling call
0709 13:20:13.127446 (+   589us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:13.134122 (+  6676us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:13.134175 (+    53us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:20:13.164220 (+ 30045us) log.cc:844] Serialized 26 byte log entry
0709 13:20:13.868215 (+703995us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:20:13.868261 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:13.868344 (+    83us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:14.193996 (+325652us) raft_consensus.cc:1685] finished
0709 13:20:14.194040 (+    44us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:14.194293 (+   253us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":5920,"raft.run_cpu_time_us":185,"raft.run_wall_time_us":9576,"thread_start_us":698125,"threads_started":1,"wal-append.queue_time_us":747312}
W20260709 13:20:14.196659 11180 log.cc:927] Time spent T 4f00a2e87e56452083b759f60d461ee3 P cd75a17ab2604397adab03bb8b5fd75c: Append to log took a long time: real 0.171s	user 0.000s	sys 0.001s
I20260709 13:20:14.198414 11173 leader_election.cc:290] T 9e326172347f45e99a0d482b5d8ef768 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:14.198994  6724 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49744 (request call id 406) took 1859 ms. Trace:
I20260709 13:20:14.199329 11173 raft_consensus.cc:2804] T 711ef6523deb4cbe8ef2ba61e1c21c98 P b7ab4784c7344b939bc36f639286f377 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:20:14.190631 11157 raft_consensus.cc:493] T 30e88460611e47b2ba16a46a30b5f416 P cd75a17ab2604397adab03bb8b5fd75c [term 9 FOLLOWER]: Starting pre-election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:20:14.201484 11157 raft_consensus.cc:515] T 30e88460611e47b2ba16a46a30b5f416 P cd75a17ab2604397adab03bb8b5fd75c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:14.204382 11173 raft_consensus.cc:493] T 711ef6523deb4cbe8ef2ba61e1c21c98 P b7ab4784c7344b939bc36f639286f377 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:14.205025 11173 raft_consensus.cc:3060] T 711ef6523deb4cbe8ef2ba61e1c21c98 P b7ab4784c7344b939bc36f639286f377 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:14.183327 11139 raft_consensus.cc:2804] T e31b9971c15848dea59d4d4130141d9e P cd75a17ab2604397adab03bb8b5fd75c [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:20:14.136771 11066 raft_consensus.cc:493] T 90d42e216d9741e190bca19a781291fd P cd75a17ab2604397adab03bb8b5fd75c [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:14.207983  6727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1704639a875409b9959353527b3fd68" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:20:14.165621 11030 raft_consensus.cc:2804] T d8cee0accdb8499c86d4414b72565a38 P b7ab4784c7344b939bc36f639286f377 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:20:14.220862  6805 raft_consensus.cc:1275] T d8292e16e5654be6bc408560cf256aaa P b7ab4784c7344b939bc36f639286f377 [term 15 FOLLOWER]: Refusing update from remote peer ccd8a4c3bfe3413cb2ae219b09aea832: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:20:14.225209  7468 leader_election.cc:304] T d8cee0accdb8499c86d4414b72565a38 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:20:14.157507 11065 raft_consensus.cc:2804] T 34f36d59d88f40fe8a2805e604fc6c0a P b7ab4784c7344b939bc36f639286f377 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:20:14.215587  6729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4b8bd455d5a47c18a1380839c6e0d61" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:14.245464  6729 raft_consensus.cc:2468] T f4b8bd455d5a47c18a1380839c6e0d61 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 9.
I20260709 13:20:14.199401  6724 rpcz_store.cc:276] 0709 13:20:12.339909 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:12.340172 (+   263us) service_pool.cc:224] Handling call
0709 13:20:12.340639 (+   467us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:12.434081 (+ 93442us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:20:13.623066 (+1188985us) log.cc:844] Serialized 14 byte log entry
0709 13:20:13.926477 (+303411us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:20:13.927061 (+   584us) log.cc:844] Serialized 26 byte log entry
0709 13:20:13.927233 (+   172us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:20:13.927268 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:13.927344 (+    76us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:14.198742 (+271398us) raft_consensus.cc:1685] finished
0709 13:20:14.198764 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:14.198930 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":109371,"prepare.queue_time_us":661592,"prepare.run_cpu_time_us":78,"prepare.run_wall_time_us":2410,"raft.queue_time_us":105538,"raft.run_cpu_time_us":346,"raft.run_wall_time_us":16370,"thread_start_us":1354714,"threads_started":2,"wal-append.queue_time_us":374013}
I20260709 13:20:14.134917 10832 consensus_queue.cc:1059] T 2c240553ce044eedb41541d72b9475d7 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.080s
I20260709 13:20:14.258020  6800 raft_consensus.cc:1275] T 20f6842e26174571996b8dea4151d4be P b7ab4784c7344b939bc36f639286f377 [term 13 FOLLOWER]: Refusing update from remote peer ccd8a4c3bfe3413cb2ae219b09aea832: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:20:14.177229 11172 raft_consensus.cc:2804] T f58dc08b12a2494bb9a1372837970ca2 P b7ab4784c7344b939bc36f639286f377 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:20:14.253655  6806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c44c4849aa54f2b94d1f1bef9ed546f" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:14.265581  6806 raft_consensus.cc:2468] T 7c44c4849aa54f2b94d1f1bef9ed546f P b7ab4784c7344b939bc36f639286f377 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 13.
I20260709 13:20:14.251785  6805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3f13b31a1f84f0d89d007eadd57924c" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:14.213054 11139 raft_consensus.cc:493] T e31b9971c15848dea59d4d4130141d9e P cd75a17ab2604397adab03bb8b5fd75c [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:14.266592  6806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4db81d9d329422bb3b4160ca4ac2d1d" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:14.267181  6806 raft_consensus.cc:2468] T c4db81d9d329422bb3b4160ca4ac2d1d P b7ab4784c7344b939bc36f639286f377 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 10.
I20260709 13:20:14.183426 11042 raft_consensus.cc:3060] T bb3d8792045a4583ae2e965b1350a5b4 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:20:14.171931 10930 consensus_queue.cc:1048] T 3411566abe2d4c9bb4b2adfdd05e6f17 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.077s
I20260709 13:20:14.270753  6727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30e88460611e47b2ba16a46a30b5f416" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:14.273447 11139 raft_consensus.cc:3060] T e31b9971c15848dea59d4d4130141d9e P cd75a17ab2604397adab03bb8b5fd75c [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:20:14.273870  7466 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 291298us
W20260709 13:20:14.274744  6695 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:14.321990  6727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20f6842e26174571996b8dea4151d4be" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:14.125293 11052 consensus_queue.cc:237] T 853ac0a8cbd64ce99457f170216d4d0f P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:14.254685 11152 raft_consensus.cc:2749] T d8cee0accdb8499c86d4414b72565a38 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:20:14.248405 11065 raft_consensus.cc:493] T 34f36d59d88f40fe8a2805e604fc6c0a P b7ab4784c7344b939bc36f639286f377 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:14.282256  6729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a92dd554674067a83a9cb68c4773f2" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:14.249114 11023 raft_consensus.cc:493] T be1a92657f494cac8dd227d152f50151 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 7ba59cc884714e8aa5f3f0ecaed84cbb)
I20260709 13:20:14.255335 11175 leader_election.cc:290] T 07a92dd554674067a83a9cb68c4773f2 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:20:14.210642 10969 consensus_queue.cc:1059] T bd6869f07b5a4885a0b99fbe60c3b175 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: INVALID_TERM, Last received: 11.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.065s
I20260709 13:20:14.289247 11167 leader_election.cc:290] T bb7fa124c3bf4ef9ab65a407cb008441 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:20:14.291115 11134 raft_consensus.cc:3060] T de3186201e1a40d0b335eeb8b4e256e0 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:20:14.293897  6806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4b8bd455d5a47c18a1380839c6e0d61" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:14.299862 11126 leader_election.cc:290] T 44bde925b2e541b69890d70715b85176 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 13 election: Requested vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:14.209980 11105 consensus_queue.cc:1048] T f3f9c2e2bf644115957398fe4c9459db P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.068s
I20260709 13:20:14.284391  6800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e31b9971c15848dea59d4d4130141d9e" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:14.238168 11154 consensus_queue.cc:1048] T bb7fa124c3bf4ef9ab65a407cb008441 P 7ba59cc884714e8aa5f3f0ecaed84cbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.041s
I20260709 13:20:14.261372 11030 raft_consensus.cc:697] T d8cee0accdb8499c86d4414b72565a38 P b7ab4784c7344b939bc36f639286f377 [term 11 LEADER]: Becoming Leader. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
I20260709 13:20:14.242095 11066 raft_consensus.cc:515] T 90d42e216d9741e190bca19a781291fd P cd75a17ab2604397adab03bb8b5fd75c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:14.278443 11158 raft_consensus.cc:493] T 34f36d59d88f40fe8a2805e604fc6c0a P cd75a17ab2604397adab03bb8b5fd75c [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:20:14.241544 10580 consensus_queue.cc:237] T f5be3a11b23d4ea9b08300a2789821c7 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:14.325341  6727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d65025eea89441290d85dd053810e31" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 11 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:14.275565 10938 raft_consensus.cc:2804] T a1704639a875409b9959353527b3fd68 P b7ab4784c7344b939bc36f639286f377 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:20:14.336680 11023 raft_consensus.cc:515] T be1a92657f494cac8dd227d152f50151 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:20:14.352771 11023 leader_election.cc:290] T be1a92657f494cac8dd227d152f50151 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:20:14.212998 11160 consensus_queue.cc:237] T f09c2a98de1a4decabd0ff900dd44caa P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:14.327548  6695 leader_election.cc:304] T 7c44c4849aa54f2b94d1f1bef9ed546f P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
I20260709 13:20:14.302218 11075 leader_election.cc:290] T 20f6842e26174571996b8dea4151d4be P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:20:14.302620 11172 raft_consensus.cc:697] T f58dc08b12a2494bb9a1372837970ca2 P b7ab4784c7344b939bc36f639286f377 [term 14 LEADER]: Becoming Leader. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
I20260709 13:20:14.339903  6729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77e330a82df4b43a745d57a68f6f057" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:14.268986  6844 leader_election.cc:304] T f4b8bd455d5a47c18a1380839c6e0d61 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
W20260709 13:20:14.361328  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 92498.6us
I20260709 13:20:14.326835 11065 raft_consensus.cc:3060] T 34f36d59d88f40fe8a2805e604fc6c0a P b7ab4784c7344b939bc36f639286f377 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:20:14.342332  6806 raft_consensus.cc:2468] T f4b8bd455d5a47c18a1380839c6e0d61 P b7ab4784c7344b939bc36f639286f377 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 10.
W20260709 13:20:14.326124  6696 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:14.355703 11066 leader_election.cc:290] T 90d42e216d9741e190bca19a781291fd P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:20:14.360298  6727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "713b5728a197487c9300b310ab94e5a3" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:14.360340  6695 leader_election.cc:304] T c4db81d9d329422bb3b4160ca4ac2d1d P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
I20260709 13:20:14.369830  6727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f03d0dbf16864ca4bc1bb5e4c0334c0f" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:20:14.329619 10998 consensus_queue.cc:1048] T d8292e16e5654be6bc408560cf256aaa P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.030s
I20260709 13:20:14.347651 11169 leader_election.cc:290] T fe20b4b48823486ca3b9c648db6ce8aa P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:20:14.283236 10818 consensus_queue.cc:237] T 4d9def8b32fd443aa94ab1420b06837b P b7ab4784c7344b939bc36f639286f377 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 11.5, Last appended by leader: 5, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:14.375471  6729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c240553ce044eedb41541d72b9475d7" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:14.368818 11075 raft_consensus.cc:2804] T f4b8bd455d5a47c18a1380839c6e0d61 P cd75a17ab2604397adab03bb8b5fd75c [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:20:14.340544 10832 consensus_queue.cc:1048] T 20f6842e26174571996b8dea4151d4be P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 4, Time since last communication: 0.023s
I20260709 13:20:14.375609  6727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a75bfe094d4bdc963aba3f08dfcd25" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:14.385377  6875 raft_consensus.cc:1240] T 24ee15416e3145beaa1b8183453729a3 P cd75a17ab2604397adab03bb8b5fd75c [term 13 FOLLOWER]: Rejecting Update request from peer ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 12. Current term is 13. Ops: []
I20260709 13:20:14.406658  6729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "427c124d773f483294511e80fe340075" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:20:14.407383  6729 raft_consensus.cc:3060] T 427c124d773f483294511e80fe340075 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:20:14.385573  6800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90d42e216d9741e190bca19a781291fd" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:20:14.387447 11110 raft_consensus.cc:493] T f3f9c2e2bf644115957398fe4c9459db P ccd8a4c3bfe3413cb2ae219b09aea832 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:20:14.388216  6877 raft_consensus.cc:1240] T a1704639a875409b9959353527b3fd68 P cd75a17ab2604397adab03bb8b5fd75c [term 13 FOLLOWER]: Rejecting Update request from peer ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 12. Current term is 13. Ops: [12.8-12.8]
I20260709 13:20:14.373517 11172 consensus_queue.cc:237] T f58dc08b12a2494bb9a1372837970ca2 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:14.390931 11186 raft_consensus.cc:3055] T 7887766dc6784fcaa42b35c05fea7a99 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:20:14.392797 11030 consensus_queue.cc:237] T d8cee0accdb8499c86d4414b72565a38 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:20:14.397719  6880 raft_consensus.cc:1240] T 4d9def8b32fd443aa94ab1420b06837b P cd75a17ab2604397adab03bb8b5fd75c [term 12 FOLLOWER]: Rejecting Update request from peer ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 11. Current term is 12. Ops: []
I20260709 13:20:14.365116 11126 raft_consensus.cc:2804] T 7c44c4849aa54f2b94d1f1bef9ed546f P ccd8a4c3bfe3413cb2ae219b09aea832 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:20:14.421257 11126 raft_consensus.cc:493] T 7c44c4849aa54f2b94d1f1bef9ed546f P ccd8a4c3bfe3413cb2ae219b09aea832 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:14.421839 11126 raft_consensus.cc:3060] T 7c44c4849aa54f2b94d1f1bef9ed546f P ccd8a4c3bfe3413cb2ae219b09aea832 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:14.425184  7498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24ee15416e3145beaa1b8183453729a3" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 13 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb"
I20260709 13:20:14.426018  7498 raft_consensus.cc:3060] T 24ee15416e3145beaa1b8183453729a3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:14.405851  6875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b8cacb381b746da8d0049b0a83b41dd" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 13 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:14.429533  6879 raft_consensus.cc:1240] T f03d0dbf16864ca4bc1bb5e4c0334c0f P cd75a17ab2604397adab03bb8b5fd75c [term 11 FOLLOWER]: Rejecting Update request from peer ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 10. Current term is 11. Ops: [10.6-10.6]
I20260709 13:20:14.357800 11163 raft_consensus.cc:515] T 34f36d59d88f40fe8a2805e604fc6c0a P ccd8a4c3bfe3413cb2ae219b09aea832 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:14.412006  7496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb7fa124c3bf4ef9ab65a407cb008441" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:20:14.415691  6877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bf4668eeb70467fb3dc5a0289233b3c" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:20:14.416953  6878 raft_consensus.cc:1240] T 7887766dc6784fcaa42b35c05fea7a99 P cd75a17ab2604397adab03bb8b5fd75c [term 12 FOLLOWER]: Rejecting Update request from peer ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 11. Current term is 12. Ops: []
I20260709 13:20:14.420203  6880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5be3a11b23d4ea9b08300a2789821c7" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:20:14.374929 10998 consensus_queue.cc:1243] T d8292e16e5654be6bc408560cf256aaa P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Peer b7ab4784c7344b939bc36f639286f377 log is divergent from this leader: its last log entry 14.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 13:20:14.395040 11169 raft_consensus.cc:2804] T c4db81d9d329422bb3b4160ca4ac2d1d P ccd8a4c3bfe3413cb2ae219b09aea832 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:20:14.404027 11008 raft_consensus.cc:493] T 8c7f33e544204fbaac4078e3e83bbf4e P cd75a17ab2604397adab03bb8b5fd75c [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:14.445639  6729 raft_consensus.cc:2468] T 427c124d773f483294511e80fe340075 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in term 10.
I20260709 13:20:14.409060 10832 consensus_queue.cc:1243] T 20f6842e26174571996b8dea4151d4be P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Peer b7ab4784c7344b939bc36f639286f377 log is divergent from this leader: its last log entry 6.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 13:20:14.440636  6727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3411566abe2d4c9bb4b2adfdd05e6f17" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:20:14.441651  7500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f00a2e87e56452083b759f60d461ee3" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 13 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:20:14.441881  6877 raft_consensus.cc:1240] T a3022224cc81473690653a83d4e99470 P cd75a17ab2604397adab03bb8b5fd75c [term 13 FOLLOWER]: Rejecting Update request from peer ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 12. Current term is 13. Ops: []
W20260709 13:20:14.413084 11182 log.cc:927] Time spent T 1bf4668eeb70467fb3dc5a0289233b3c P cd75a17ab2604397adab03bb8b5fd75c: Append to log took a long time: real 0.088s	user 0.001s	sys 0.001s
I20260709 13:20:14.396267 11075 raft_consensus.cc:493] T f4b8bd455d5a47c18a1380839c6e0d61 P cd75a17ab2604397adab03bb8b5fd75c [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:14.395691 11027 raft_consensus.cc:493] T 90d42e216d9741e190bca19a781291fd P b7ab4784c7344b939bc36f639286f377 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:14.383474 11175 raft_consensus.cc:493] T ab432e62819d499eaaf3dd55481dd930 P cd75a17ab2604397adab03bb8b5fd75c [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:14.404501 11066 raft_consensus.cc:493] T 7ba5dac66ab5497e9e336f2a3c28cda5 P cd75a17ab2604397adab03bb8b5fd75c [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 7ba59cc884714e8aa5f3f0ecaed84cbb)
I20260709 13:20:14.434743  6880 raft_consensus.cc:3060] T f5be3a11b23d4ea9b08300a2789821c7 P cd75a17ab2604397adab03bb8b5fd75c [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:20:14.443389 11169 raft_consensus.cc:493] T c4db81d9d329422bb3b4160ca4ac2d1d P ccd8a4c3bfe3413cb2ae219b09aea832 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:14.486559  6879 raft_consensus.cc:1275] T d8292e16e5654be6bc408560cf256aaa P cd75a17ab2604397adab03bb8b5fd75c [term 15 FOLLOWER]: Refusing update from remote peer ccd8a4c3bfe3413cb2ae219b09aea832: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
W20260709 13:20:14.437106 11188 log.cc:927] Time spent T 4f00a2e87e56452083b759f60d461ee3 P b7ab4784c7344b939bc36f639286f377: Append to log took a long time: real 0.252s	user 0.001s	sys 0.000s
I20260709 13:20:14.369199 11158 raft_consensus.cc:515] T 34f36d59d88f40fe8a2805e604fc6c0a P cd75a17ab2604397adab03bb8b5fd75c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:14.461284  6877 raft_consensus.cc:1240] T de3186201e1a40d0b335eeb8b4e256e0 P cd75a17ab2604397adab03bb8b5fd75c [term 12 FOLLOWER]: Rejecting Update request from peer ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 11. Current term is 12. Ops: []
I20260709 13:20:14.462594  6729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c44c4849aa54f2b94d1f1bef9ed546f" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:14.428179  6875 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "de3186201e1a40d0b335eeb8b4e256e0"
dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
 from {username='slave'} at 127.0.0.1:53416
I20260709 13:20:14.499106  6875 raft_consensus.cc:493] T de3186201e1a40d0b335eeb8b4e256e0 P cd75a17ab2604397adab03bb8b5fd75c [term 12 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:20:14.499562  6875 raft_consensus.cc:3060] T de3186201e1a40d0b335eeb8b4e256e0 P cd75a17ab2604397adab03bb8b5fd75c [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:14.465574  6727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24ee15416e3145beaa1b8183453729a3" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 13 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:20:14.467263  6878 raft_consensus.cc:1275] T 20f6842e26174571996b8dea4151d4be P cd75a17ab2604397adab03bb8b5fd75c [term 13 FOLLOWER]: Refusing update from remote peer ccd8a4c3bfe3413cb2ae219b09aea832: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:20:14.418244 11186 raft_consensus.cc:740] T 7887766dc6784fcaa42b35c05fea7a99 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
I20260709 13:20:14.481230  7498 raft_consensus.cc:2468] T 24ee15416e3145beaa1b8183453729a3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 13.
W20260709 13:20:14.458523  6772 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 275494us
I20260709 13:20:14.502308  6772 leader_election.cc:304] T a3022224cc81473690653a83d4e99470 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: ccd8a4c3bfe3413cb2ae219b09aea832
W20260709 13:20:14.503449  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 141056us
I20260709 13:20:14.466595 11075 raft_consensus.cc:3060] T f4b8bd455d5a47c18a1380839c6e0d61 P cd75a17ab2604397adab03bb8b5fd75c [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:20:14.512099  6880 raft_consensus.cc:2468] T f5be3a11b23d4ea9b08300a2789821c7 P cd75a17ab2604397adab03bb8b5fd75c [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 10.
I20260709 13:20:14.493331  6881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "853ac0a8cbd64ce99457f170216d4d0f" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
W20260709 13:20:14.514818  6695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 154558us
I20260709 13:20:14.525470  6878 raft_consensus.cc:1240] T f58dc08b12a2494bb9a1372837970ca2 P cd75a17ab2604397adab03bb8b5fd75c [term 14 FOLLOWER]: Rejecting Update request from peer ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 13. Current term is 14. Ops: []
I20260709 13:20:14.496541 11169 raft_consensus.cc:3060] T c4db81d9d329422bb3b4160ca4ac2d1d P ccd8a4c3bfe3413cb2ae219b09aea832 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:20:14.459887 11008 raft_consensus.cc:515] T 8c7f33e544204fbaac4078e3e83bbf4e P cd75a17ab2604397adab03bb8b5fd75c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:14.533429  6875 raft_consensus.cc:515] T de3186201e1a40d0b335eeb8b4e256e0 P cd75a17ab2604397adab03bb8b5fd75c [term 13 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:14.537617  6875 leader_election.cc:290] T de3186201e1a40d0b335eeb8b4e256e0 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 13 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:20:14.538890  6875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30e88460611e47b2ba16a46a30b5f416" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:20:14.540302  6875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a75bfe094d4bdc963aba3f08dfcd25" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:14.541081  6875 raft_consensus.cc:2468] T 95a75bfe094d4bdc963aba3f08dfcd25 P cd75a17ab2604397adab03bb8b5fd75c [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 11.
I20260709 13:20:14.541100  7498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f00a2e87e56452083b759f60d461ee3" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 13 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:20:14.541297  6877 raft_consensus.cc:1275] T 3d65025eea89441290d85dd053810e31 P cd75a17ab2604397adab03bb8b5fd75c [term 10 FOLLOWER]: Refusing update from remote peer ccd8a4c3bfe3413cb2ae219b09aea832: Log matching property violated. Preceding OpId in replica: term: 9 index: 4. Preceding OpId from leader: term: 10 index: 5. (index mismatch)
I20260709 13:20:14.540014 11008 leader_election.cc:290] T 8c7f33e544204fbaac4078e3e83bbf4e P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:20:14.545253  6872 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53406 (request call id 2107) took 2492 ms. Trace:
I20260709 13:20:14.445346 11110 raft_consensus.cc:515] T f3f9c2e2bf644115957398fe4c9459db P ccd8a4c3bfe3413cb2ae219b09aea832 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
W20260709 13:20:14.548359  6772 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:14.545686  6872 rpcz_store.cc:276] 0709 13:20:12.052845 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:12.568561 (+515716us) service_pool.cc:224] Handling call
0709 13:20:12.568969 (+   408us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:13.602517 (+1033548us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:13.602564 (+    47us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:20:13.614084 (+ 11520us) log.cc:844] Serialized 26 byte log entry
0709 13:20:13.936468 (+322384us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:20:13.936504 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:13.936574 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:14.545028 (+608454us) raft_consensus.cc:1685] finished
0709 13:20:14.545050 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:14.545182 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":211307,"raft.run_cpu_time_us":232,"raft.run_wall_time_us":14742,"thread_start_us":1282092,"threads_started":2,"wal-append.queue_time_us":632752}
I20260709 13:20:14.553088  6878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce4f062dcd314d43a63ca74067cb5ee3" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:14.555337  6878 raft_consensus.cc:2393] T ce4f062dcd314d43a63ca74067cb5ee3 P cd75a17ab2604397adab03bb8b5fd75c [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ccd8a4c3bfe3413cb2ae219b09aea832 in current term 11: Already voted for candidate cd75a17ab2604397adab03bb8b5fd75c in this term.
W20260709 13:20:14.542238 11132 consensus_meta.cc:287] T 17587d6730594da4a56fa13a353232a1 P 7ba59cc884714e8aa5f3f0ecaed84cbb: Time spent flushing consensus metadata: real 0.509s	user 0.010s	sys 0.006s
I20260709 13:20:14.556712  6877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c44c4849aa54f2b94d1f1bef9ed546f" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:14.558542 11042 raft_consensus.cc:515] T bb3d8792045a4583ae2e965b1350a5b4 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:20:14.483023 11175 raft_consensus.cc:515] T ab432e62819d499eaaf3dd55481dd930 P cd75a17ab2604397adab03bb8b5fd75c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:14.560811  6877 raft_consensus.cc:2468] T 7c44c4849aa54f2b94d1f1bef9ed546f P cd75a17ab2604397adab03bb8b5fd75c [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 12.
I20260709 13:20:14.563678  6875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4db81d9d329422bb3b4160ca4ac2d1d" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:14.559942 11191 raft_consensus.cc:493] T d8292e16e5654be6bc408560cf256aaa P b7ab4784c7344b939bc36f639286f377 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:14.566632  7500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be1a92657f494cac8dd227d152f50151" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:20:14.493918 11066 raft_consensus.cc:515] T 7ba5dac66ab5497e9e336f2a3c28cda5 P cd75a17ab2604397adab03bb8b5fd75c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:20:14.527743 11198 raft_consensus.cc:2804] T a3022224cc81473690653a83d4e99470 P b7ab4784c7344b939bc36f639286f377 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:20:14.576651 11193 raft_consensus.cc:493] T 3d65025eea89441290d85dd053810e31 P b7ab4784c7344b939bc36f639286f377 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:14.550503 11105 raft_consensus.cc:493] T 3411566abe2d4c9bb4b2adfdd05e6f17 P b7ab4784c7344b939bc36f639286f377 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:14.472146 11027 raft_consensus.cc:515] T 90d42e216d9741e190bca19a781291fd P b7ab4784c7344b939bc36f639286f377 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:14.607918 11191 raft_consensus.cc:515] T d8292e16e5654be6bc408560cf256aaa P b7ab4784c7344b939bc36f639286f377 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
W20260709 13:20:14.609530 11196 log.cc:927] Time spent T b3f13b31a1f84f0d89d007eadd57924c P ccd8a4c3bfe3413cb2ae219b09aea832: Append to log took a long time: real 0.076s	user 0.000s	sys 0.001s
I20260709 13:20:14.599238 11199 raft_consensus.cc:493] T ce4f062dcd314d43a63ca74067cb5ee3 P b7ab4784c7344b939bc36f639286f377 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:20:14.627362 11194 log.cc:927] Time spent T 7c37d41cd9164c15a6826ca62a851a69 P b7ab4784c7344b939bc36f639286f377: Append to log took a long time: real 0.256s	user 0.000s	sys 0.002s
W20260709 13:20:14.646142 11071 consensus_meta.cc:287] T 3fa34c08b205435dba97346991aa1f92 P 7ba59cc884714e8aa5f3f0ecaed84cbb: Time spent flushing consensus metadata: real 0.617s	user 0.013s	sys 0.000s
W20260709 13:20:14.648479 11202 log.cc:927] Time spent T 17587d6730594da4a56fa13a353232a1 P b7ab4784c7344b939bc36f639286f377: Append to log took a long time: real 0.094s	user 0.001s	sys 0.000s
I20260709 13:20:14.649873 11042 leader_election.cc:290] T bb3d8792045a4583ae2e965b1350a5b4 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 10 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:14.553833 11186 consensus_queue.cc:260] T 7887766dc6784fcaa42b35c05fea7a99 P ccd8a4c3bfe3413cb2ae219b09aea832 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:14.578384 11132 raft_consensus.cc:515] T 17587d6730594da4a56fa13a353232a1 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:20:14.669788 11186 raft_consensus.cc:3060] T 7887766dc6784fcaa42b35c05fea7a99 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:20:14.626539 11198 raft_consensus.cc:697] T a3022224cc81473690653a83d4e99470 P b7ab4784c7344b939bc36f639286f377 [term 13 LEADER]: Becoming Leader. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
I20260709 13:20:14.627727 11193 raft_consensus.cc:515] T 3d65025eea89441290d85dd053810e31 P b7ab4784c7344b939bc36f639286f377 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:14.671921 11071 raft_consensus.cc:515] T 3fa34c08b205435dba97346991aa1f92 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:20:14.630448 11105 raft_consensus.cc:515] T 3411566abe2d4c9bb4b2adfdd05e6f17 P b7ab4784c7344b939bc36f639286f377 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:14.672319 11075 raft_consensus.cc:515] T f4b8bd455d5a47c18a1380839c6e0d61 P cd75a17ab2604397adab03bb8b5fd75c [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:14.755450  6805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "404190ce4ce94cecbfcb6ea9d1dd8626" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:14.776084 11065 raft_consensus.cc:515] T 34f36d59d88f40fe8a2805e604fc6c0a P b7ab4784c7344b939bc36f639286f377 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
W20260709 13:20:14.739308  6678 auto_rebalancer.cc:629] Failed to schedule move for tablet 22ccee1b570c4ad3a57bd7aec085b1b4: Illegal state: Replica ccd8a4c3bfe3413cb2ae219b09aea832 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 10 leader_uuid: "b7ab4784c7344b939bc36f639286f377" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } }
W20260709 13:20:14.743628  6698 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:14.747713  6772 connection.cc:256] RPC call timeout handler was delayed by -1.0440110059998915s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1617s for a response
I20260709 13:20:14.748886  6800 raft_consensus.cc:2376] T 90d42e216d9741e190bca19a781291fd P b7ab4784c7344b939bc36f639286f377 [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 11. Re-sending same reply.
I20260709 13:20:14.749766  6798 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50550 (request call id 439) took 1047 ms. Trace:
I20260709 13:20:14.599296  6878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e326172347f45e99a0d482b5d8ef768" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:14.684427 11126 raft_consensus.cc:515] T 7c44c4849aa54f2b94d1f1bef9ed546f P ccd8a4c3bfe3413cb2ae219b09aea832 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:14.755925  7495 raft_consensus.cc:1240] T bb3d8792045a4583ae2e965b1350a5b4 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 10 FOLLOWER]: Rejecting Update request from peer cd75a17ab2604397adab03bb8b5fd75c for earlier term 9. Current term is 10. Ops: []
I20260709 13:20:14.768989 11086 raft_consensus.cc:493] T 7c37d41cd9164c15a6826ca62a851a69 P cd75a17ab2604397adab03bb8b5fd75c [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:14.767105 11066 leader_election.cc:290] T 7ba5dac66ab5497e9e336f2a3c28cda5 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:20:14.647642 11139 raft_consensus.cc:515] T e31b9971c15848dea59d4d4130141d9e P cd75a17ab2604397adab03bb8b5fd75c [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:14.694052 11158 leader_election.cc:290] T 34f36d59d88f40fe8a2805e604fc6c0a P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:20:14.682783 11163 leader_election.cc:290] T 34f36d59d88f40fe8a2805e604fc6c0a P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 9 election: Requested vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:14.695673 11173 raft_consensus.cc:515] T 711ef6523deb4cbe8ef2ba61e1c21c98 P b7ab4784c7344b939bc36f639286f377 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:14.689566 11175 leader_election.cc:290] T ab432e62819d499eaaf3dd55481dd930 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:20:14.695818 11191 leader_election.cc:290] T d8292e16e5654be6bc408560cf256aaa P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:14.695305 11193 leader_election.cc:290] T 3d65025eea89441290d85dd053810e31 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:14.692404 11198 consensus_queue.cc:237] T a3022224cc81473690653a83d4e99470 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 12.6, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:14.667944 11199 raft_consensus.cc:515] T ce4f062dcd314d43a63ca74067cb5ee3 P b7ab4784c7344b939bc36f639286f377 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } attrs { replace: true } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:20:14.778174  6805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be1a92657f494cac8dd227d152f50151" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:14.831404  6803 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:32976 (request call id 2829) took 1093 ms. Trace:
I20260709 13:20:14.895387  6805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44bde925b2e541b69890d70715b85176" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:20:14.896437 11105 leader_election.cc:290] T 3411566abe2d4c9bb4b2adfdd05e6f17 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:14.898609 11173 leader_election.cc:290] T 711ef6523deb4cbe8ef2ba61e1c21c98 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 13 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:14.902529  6729 raft_consensus.cc:2368] T 7c44c4849aa54f2b94d1f1bef9ed546f P ccd8a4c3bfe3413cb2ae219b09aea832 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c for earlier term 13. Current term is 14.
W20260709 13:20:14.902601 10869 consensus_meta.cc:287] T 4b8cacb381b746da8d0049b0a83b41dd P cd75a17ab2604397adab03bb8b5fd75c: Time spent flushing consensus metadata: real 1.054s	user 0.011s	sys 0.006s
I20260709 13:20:14.903228 11199 leader_election.cc:290] T ce4f062dcd314d43a63ca74067cb5ee3 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:20:14.823609  6728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3d8792045a4583ae2e965b1350a5b4" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:20:14.903307 10869 raft_consensus.cc:515] T 4b8cacb381b746da8d0049b0a83b41dd P cd75a17ab2604397adab03bb8b5fd75c [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:20:14.827420  6723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fa34c08b205435dba97346991aa1f92" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:20:14.891253 11075 leader_election.cc:290] T f4b8bd455d5a47c18a1380839c6e0d61 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 11 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:20:14.819119 11071 leader_election.cc:290] T 3fa34c08b205435dba97346991aa1f92 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 14 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:14.931746  6802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34f36d59d88f40fe8a2805e604fc6c0a" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:20:14.818411 11027 leader_election.cc:290] T 90d42e216d9741e190bca19a781291fd P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:14.825848 11132 leader_election.cc:290] T 17587d6730594da4a56fa13a353232a1 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 17 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:20:14.939417  6802 raft_consensus.cc:2393] T 34f36d59d88f40fe8a2805e604fc6c0a P b7ab4784c7344b939bc36f639286f377 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate ccd8a4c3bfe3413cb2ae219b09aea832 in current term 9: Already voted for candidate b7ab4784c7344b939bc36f639286f377 in this term.
I20260709 13:20:14.816378 11211 raft_consensus.cc:493] T bb7fa124c3bf4ef9ab65a407cb008441 P b7ab4784c7344b939bc36f639286f377 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:14.821254 11110 leader_election.cc:290] T f3f9c2e2bf644115957398fe4c9459db P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:14.941321  6732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17587d6730594da4a56fa13a353232a1" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 17 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:20:14.947204 11126 leader_election.cc:290] T 7c44c4849aa54f2b94d1f1bef9ed546f P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 14 election: Requested vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:14.948096  6728 raft_consensus.cc:3060] T bb3d8792045a4583ae2e965b1350a5b4 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:20:14.950321 11139 leader_election.cc:290] T e31b9971c15848dea59d4d4130141d9e P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 10 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:20:14.950357  6874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "711ef6523deb4cbe8ef2ba61e1c21c98" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:14.904469 11086 raft_consensus.cc:515] T 7c37d41cd9164c15a6826ca62a851a69 P cd75a17ab2604397adab03bb8b5fd75c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:14.966629  6874 raft_consensus.cc:2468] T 711ef6523deb4cbe8ef2ba61e1c21c98 P cd75a17ab2604397adab03bb8b5fd75c [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 12.
I20260709 13:20:14.969477  6874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34f36d59d88f40fe8a2805e604fc6c0a" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:14.969758 11086 leader_election.cc:290] T 7c37d41cd9164c15a6826ca62a851a69 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:20:14.970568  6874 raft_consensus.cc:2468] T 34f36d59d88f40fe8a2805e604fc6c0a P cd75a17ab2604397adab03bb8b5fd75c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 7.
I20260709 13:20:14.957168 11175 raft_consensus.cc:493] T f58dc08b12a2494bb9a1372837970ca2 P cd75a17ab2604397adab03bb8b5fd75c [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:14.961694 10727 raft_consensus.cc:3055] T 4d9def8b32fd443aa94ab1420b06837b P ccd8a4c3bfe3413cb2ae219b09aea832 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:20:14.894797  6803 rpcz_store.cc:276] 0709 13:20:13.738226 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:13.909932 (+171706us) service_pool.cc:224] Handling call
0709 13:20:13.914219 (+  4287us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:14.248795 (+334576us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:14.248828 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:20:14.257527 (+  8699us) log.cc:844] Serialized 26 byte log entry
0709 13:20:14.830141 (+572614us) spinlock_profiling.cc:243] Waited 2.59 ms on lock 0x7b1800308bc0. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc15785de1 00007fcc157925b1 00007fcc0f5524bc 00007fcc0c8a048b 00007fcc156faab9 00007fcc0c8bc69b 00007fcc0c8ba93f 00007fcc0c8bcc02 00007fcc0f54420b 00007fcc0f549d23 00007fcc0f54a0d1
0709 13:20:14.830549 (+   408us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:20:14.830631 (+    82us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:14.830766 (+   135us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:14.830835 (+    69us) raft_consensus.cc:1685] finished
0709 13:20:14.830849 (+    14us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:14.831199 (+   350us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":17799,"raft.queue_time_us":85711,"raft.run_cpu_time_us":172,"raft.run_wall_time_us":10793,"spinlock_wait_cycles":5956480,"thread_start_us":506380,"threads_started":2,"wal-append.queue_time_us":232648}
I20260709 13:20:14.947667  6799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f9c2e2bf644115957398fe4c9459db" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:14.958086  6802 raft_consensus.cc:1275] T 07a92dd554674067a83a9cb68c4773f2 P b7ab4784c7344b939bc36f639286f377 [term 11 FOLLOWER]: Refusing update from remote peer ccd8a4c3bfe3413cb2ae219b09aea832: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:20:14.940291 11065 leader_election.cc:290] T 34f36d59d88f40fe8a2805e604fc6c0a P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 9 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:14.981897  6874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3d8792045a4583ae2e965b1350a5b4" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:20:14.985566  6723 raft_consensus.cc:3060] T 3fa34c08b205435dba97346991aa1f92 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 12 FOLLOWER]: Advancing to term 14
I20260709 13:20:14.985664 10983 raft_consensus.cc:493] T f09c2a98de1a4decabd0ff900dd44caa P ccd8a4c3bfe3413cb2ae219b09aea832 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:14.986260  6799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c44c4849aa54f2b94d1f1bef9ed546f" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:20:14.988408 10700 raft_consensus.cc:3055] T 2c240553ce044eedb41541d72b9475d7 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:20:14.989120 10700 raft_consensus.cc:740] T 2c240553ce044eedb41541d72b9475d7 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
I20260709 13:20:14.989226  6799 raft_consensus.cc:3060] T 7c44c4849aa54f2b94d1f1bef9ed546f P b7ab4784c7344b939bc36f639286f377 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:14.986828 10983 raft_consensus.cc:515] T f09c2a98de1a4decabd0ff900dd44caa P ccd8a4c3bfe3413cb2ae219b09aea832 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:14.908170  6798 rpcz_store.cc:276] 0709 13:20:13.701984 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:13.713177 (+ 11193us) service_pool.cc:224] Handling call
0709 13:20:13.714195 (+  1018us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:13.714681 (+   486us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:13.714725 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:20:13.715193 (+   468us) log.cc:844] Serialized 26 byte log entry
0709 13:20:13.937113 (+221920us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:20:13.937150 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:13.937519 (+   369us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:14.748826 (+811307us) raft_consensus.cc:1685] finished
0709 13:20:14.748886 (+    60us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:14.749329 (+   443us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":821,"raft.run_cpu_time_us":209,"raft.run_wall_time_us":20312,"thread_start_us":180725,"threads_started":1,"wal-append.queue_time_us":317157}
I20260709 13:20:14.981494 10727 raft_consensus.cc:740] T 4d9def8b32fd443aa94ab1420b06837b P ccd8a4c3bfe3413cb2ae219b09aea832 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
I20260709 13:20:14.992653 11175 raft_consensus.cc:515] T f58dc08b12a2494bb9a1372837970ca2 P cd75a17ab2604397adab03bb8b5fd75c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:15.001565 11092 leader_election.cc:290] T bd6869f07b5a4885a0b99fbe60c3b175 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:20:14.971585 11012 raft_consensus.cc:3060] T 3a485a995abc4807b6e511e45419f737 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:20:15.009228 11111 raft_consensus.cc:3055] T f58dc08b12a2494bb9a1372837970ca2 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:20:15.010143 11111 raft_consensus.cc:740] T f58dc08b12a2494bb9a1372837970ca2 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
W20260709 13:20:15.001812 11134 consensus_meta.cc:287] T de3186201e1a40d0b335eeb8b4e256e0 P ccd8a4c3bfe3413cb2ae219b09aea832: Time spent flushing consensus metadata: real 0.653s	user 0.017s	sys 0.002s
I20260709 13:20:15.012923 10727 consensus_queue.cc:260] T 4d9def8b32fd443aa94ab1420b06837b P ccd8a4c3bfe3413cb2ae219b09aea832 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.5, Last appended by leader: 5, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:15.022008 10727 raft_consensus.cc:3060] T 4d9def8b32fd443aa94ab1420b06837b P ccd8a4c3bfe3413cb2ae219b09aea832 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:20:15.017115 11117 raft_consensus.cc:3060] T 8c7f33e544204fbaac4078e3e83bbf4e P b7ab4784c7344b939bc36f639286f377 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:20:15.024802 10700 consensus_queue.cc:260] T 2c240553ce044eedb41541d72b9475d7 P ccd8a4c3bfe3413cb2ae219b09aea832 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:15.012007 11111 consensus_queue.cc:260] T f58dc08b12a2494bb9a1372837970ca2 P ccd8a4c3bfe3413cb2ae219b09aea832 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:15.015045 10983 leader_election.cc:290] T f09c2a98de1a4decabd0ff900dd44caa P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:15.002523 10869 leader_election.cc:290] T 4b8cacb381b746da8d0049b0a83b41dd P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 13 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
W20260709 13:20:15.039211 11148 log.cc:927] Time spent T bd6869f07b5a4885a0b99fbe60c3b175 P ccd8a4c3bfe3413cb2ae219b09aea832: Append to log took a long time: real 1.989s	user 0.004s	sys 0.009s
I20260709 13:20:15.039675  6874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c240553ce044eedb41541d72b9475d7" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:20:15.040848  6874 raft_consensus.cc:3060] T 2c240553ce044eedb41541d72b9475d7 P cd75a17ab2604397adab03bb8b5fd75c [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:15.039471 11111 raft_consensus.cc:3060] T f58dc08b12a2494bb9a1372837970ca2 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:15.045248  7496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ba5dac66ab5497e9e336f2a3c28cda5" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:20:15.046343  6731 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49998 (request call id 1052) took 1099 ms. Trace:
I20260709 13:20:15.046800  6731 rpcz_store.cc:276] 0709 13:20:13.946992 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:13.947153 (+   161us) service_pool.cc:224] Handling call
0709 13:20:15.045855 (+1098702us) spinlock_profiling.cc:243] Waited 830 ms on lock 0x7b540020c1d4. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f9ae2fa 00007fcc1496fb17 00007fcc0deea6d4 00007fcc0deea662 00007fcc0deea591 00007fcc0deea50c 00007fcc0dee97c2 00007fcc0dce548c 00007fcc0dce48c6 00007fcc0dce426f
0709 13:20:15.046084 (+   229us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1909568256}
I20260709 13:20:15.009387 11175 leader_election.cc:290] T f58dc08b12a2494bb9a1372837970ca2 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:20:15.028554 10700 raft_consensus.cc:3060] T 2c240553ce044eedb41541d72b9475d7 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:15.013911  6772 leader_election.cc:304] T 17587d6730594da4a56fa13a353232a1 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:20:15.064730  6873 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58592 (request call id 339) took 1635 ms. Trace:
W20260709 13:20:15.066733  6770 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 2.43614e+06us
I20260709 13:20:15.045274  7500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b8cacb381b746da8d0049b0a83b41dd" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb"
I20260709 13:20:15.069947  6878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b3759de40694069b13c0f8bd40e5709" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:20:15.071008  6878 raft_consensus.cc:3060] T 9b3759de40694069b13c0f8bd40e5709 P cd75a17ab2604397adab03bb8b5fd75c [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:20:15.065514  6873 rpcz_store.cc:276] 0709 13:20:13.412607 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:13.412747 (+   140us) service_pool.cc:224] Handling call
0709 13:20:13.413152 (+   405us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:13.587766 (+174614us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:13.587816 (+    50us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:20:13.589610 (+  1794us) log.cc:844] Serialized 26 byte log entry
0709 13:20:13.873536 (+283926us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:20:13.873594 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:15.047046 (+1173452us) spinlock_profiling.cc:243] Waited 165 ms on lock 0x7b5400217fd4. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f9aae01 00007fcc0f9a983e 00007fcc1496e419 00007fcc0dee5bd4 00007fcc0dee5b62 00007fcc0dee5a91 00007fcc0dee5a0c 00007fcc0dee4cc2 00007fcc0dce548c 00007fcc0dce48c6
0709 13:20:15.047127 (+    81us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:15.047193 (+    66us) raft_consensus.cc:1685] finished
0709 13:20:15.047250 (+    57us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:15.047602 (+   352us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5549,"raft.queue_time_us":13459,"raft.run_cpu_time_us":195,"raft.run_wall_time_us":21602,"spinlock_wait_cycles":378936704,"thread_start_us":254248,"threads_started":1,"wal-append.queue_time_us":390141}
I20260709 13:20:15.074002  6806 raft_consensus.cc:1240] T 7887766dc6784fcaa42b35c05fea7a99 P b7ab4784c7344b939bc36f639286f377 [term 12 FOLLOWER]: Rejecting Update request from peer ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 11. Current term is 12. Ops: [11.7-11.7]
I20260709 13:20:15.081079  6872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77e330a82df4b43a745d57a68f6f057" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 15 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:15.075697  6881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fa34c08b205435dba97346991aa1f92" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:20:15.083703  6872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f00a2e87e56452083b759f60d461ee3" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 13 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
W20260709 13:20:15.089318  7503 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50742 (request call id 427) took 1386 ms (client timeout 1690 ms). Trace:
W20260709 13:20:15.090049  7503 rpcz_store.cc:269] 0709 13:20:13.702224 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:13.702351 (+   127us) service_pool.cc:224] Handling call
0709 13:20:15.088676 (+1386325us) spinlock_profiling.cc:243] Waited 200 ms on lock 0x7b54005b1b54. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f9ae2fa 00007fcc1496fb17 00007fcc0deea6d4 00007fcc0deea662 00007fcc0deea591 00007fcc0deea50c 00007fcc0dee97c2 00007fcc0dce548c 00007fcc0dce48c6 00007fcc0dce426f
0709 13:20:15.089011 (+   335us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":460484864}
I20260709 13:20:15.072008  6804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09c2a98de1a4decabd0ff900dd44caa" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
W20260709 13:20:15.093086  6773 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:15.087128 11175 raft_consensus.cc:493] T d8cee0accdb8499c86d4414b72565a38 P cd75a17ab2604397adab03bb8b5fd75c [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:15.094923 11175 raft_consensus.cc:515] T d8cee0accdb8499c86d4414b72565a38 P cd75a17ab2604397adab03bb8b5fd75c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:20:15.095799  6881 raft_consensus.cc:3060] T 3fa34c08b205435dba97346991aa1f92 P cd75a17ab2604397adab03bb8b5fd75c [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:15.097344 11175 leader_election.cc:290] T d8cee0accdb8499c86d4414b72565a38 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:20:15.098959 11050 raft_consensus.cc:2749] T 17587d6730594da4a56fa13a353232a1 P b7ab4784c7344b939bc36f639286f377 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:20:15.098588  6772 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.68:45071, user_credentials={real_user=slave}} blocked reactor thread for 93341.8us
I20260709 13:20:15.101874  6846 leader_election.cc:304] T 24ee15416e3145beaa1b8183453729a3 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:20:15.102320 11051 raft_consensus.cc:493] T 3a485a995abc4807b6e511e45419f737 P cd75a17ab2604397adab03bb8b5fd75c [term 10 FOLLOWER]: Starting pre-election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:20:15.103197 11086 raft_consensus.cc:2804] T 24ee15416e3145beaa1b8183453729a3 P cd75a17ab2604397adab03bb8b5fd75c [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:20:15.105345 11086 raft_consensus.cc:697] T 24ee15416e3145beaa1b8183453729a3 P cd75a17ab2604397adab03bb8b5fd75c [term 13 LEADER]: Becoming Leader. State: Replica: cd75a17ab2604397adab03bb8b5fd75c, State: Running, Role: LEADER
I20260709 13:20:15.106861 11086 consensus_queue.cc:237] T 24ee15416e3145beaa1b8183453729a3 P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
W20260709 13:20:15.101943  6697 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:15.108994  6695 leader_election.cc:304] T f4b8bd455d5a47c18a1380839c6e0d61 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
W20260709 13:20:15.109484  6697 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:15.103114 11051 raft_consensus.cc:515] T 3a485a995abc4807b6e511e45419f737 P cd75a17ab2604397adab03bb8b5fd75c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:15.109977  6730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17587d6730594da4a56fa13a353232a1" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:15.111061  6730 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49744 (request call id 412) took 1167 ms. Trace:
I20260709 13:20:15.112169  6806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "427c124d773f483294511e80fe340075" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:20:15.114527  6872 raft_consensus.cc:1275] T 44bde925b2e541b69890d70715b85176 P cd75a17ab2604397adab03bb8b5fd75c [term 12 FOLLOWER]: Refusing update from remote peer b7ab4784c7344b939bc36f639286f377: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:20:15.117149 11126 raft_consensus.cc:2804] T f4b8bd455d5a47c18a1380839c6e0d61 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:20:15.117738 11126 raft_consensus.cc:493] T f4b8bd455d5a47c18a1380839c6e0d61 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 9 FOLLOWER]: Starting leader election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:20:15.118145 11126 raft_consensus.cc:3060] T f4b8bd455d5a47c18a1380839c6e0d61 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:20:15.113395  7500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8cee0accdb8499c86d4414b72565a38" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:20:15.120934  7500 raft_consensus.cc:2468] T d8cee0accdb8499c86d4414b72565a38 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 11.
W20260709 13:20:15.121531 11140 log.cc:927] Time spent T b3f13b31a1f84f0d89d007eadd57924c P b7ab4784c7344b939bc36f639286f377: Append to log took a long time: real 2.115s	user 0.005s	sys 0.005s
W20260709 13:20:15.125010 11143 log.cc:927] Time spent T 7ba5dac66ab5497e9e336f2a3c28cda5 P 7ba59cc884714e8aa5f3f0ecaed84cbb: Append to log took a long time: real 2.180s	user 0.007s	sys 0.003s
I20260709 13:20:15.126102 11051 leader_election.cc:290] T 3a485a995abc4807b6e511e45419f737 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:20:15.113473  7503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f00a2e87e56452083b759f60d461ee3" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 13 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:20:15.126199  6801 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50550 (request call id 434) took 3458 ms. Trace:
I20260709 13:20:15.012850 11211 raft_consensus.cc:515] T bb7fa124c3bf4ef9ab65a407cb008441 P b7ab4784c7344b939bc36f639286f377 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:20:15.111454  6730 rpcz_store.cc:276] 0709 13:20:13.943133 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:13.947145 (+  4012us) service_pool.cc:224] Handling call
0709 13:20:15.109621 (+1162476us) spinlock_profiling.cc:243] Waited 3.07 ms on lock 0x7b5800000c98. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0c745db1 00007fcc0c885b71 00007fcc0c885a22 00007fcc1579ec09 00007fcc148f8ee0 00007fcc149c20ab 00007fcc149c2131 00007fcc149700a0 00007fcc1496f984 00007fcc0deea6d4 00007fcc0deea662
0709 13:20:15.110992 (+  1371us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":7069440}
I20260709 13:20:15.113674  6806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17587d6730594da4a56fa13a353232a1" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 17 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:20:15.128949  6878 raft_consensus.cc:2468] T 9b3759de40694069b13c0f8bd40e5709 P cd75a17ab2604397adab03bb8b5fd75c [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 11.
I20260709 13:20:15.113741 11092 raft_consensus.cc:493] T b56bf91d90824c959e21e0cee5ba1816 P cd75a17ab2604397adab03bb8b5fd75c [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
W20260709 13:20:15.117311 11135 log.cc:927] Time spent T 4b8cacb381b746da8d0049b0a83b41dd P cd75a17ab2604397adab03bb8b5fd75c: Append to log took a long time: real 2.109s	user 0.000s	sys 0.010s
I20260709 13:20:15.131201  6801 rpcz_store.cc:276] 0709 13:20:11.667986 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:11.813703 (+145717us) service_pool.cc:224] Handling call
0709 13:20:11.881067 (+ 67364us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:11.995992 (+114925us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:11.996073 (+    81us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:20:12.046218 (+ 50145us) log.cc:844] Serialized 26 byte log entry
0709 13:20:12.541259 (+495041us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:20:12.541300 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:12.541366 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:15.120554 (+2579188us) spinlock_profiling.cc:243] Waited 23 ms on lock 0x7b4400022b4c. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0c745db1 00007fcc0c7e3c85 00007fcc0c7e46a2 00007fcc0f5561db 00007fcc0f551aaf 00007fcc0f54586e 00007fcc0f544bb6 00007fcc0f5447d8 00007fcc0f54e221 00007fcc0f54e1d9 00007fcc0f54e169
0709 13:20:15.125709 (+  5155us) raft_consensus.cc:1685] finished
0709 13:20:15.125730 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:15.125983 (+   253us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":126934,"raft.queue_time_us":141787,"raft.run_cpu_time_us":157,"raft.run_wall_time_us":11821,"spinlock_wait_cycles":52894464,"thread_start_us":429090,"threads_started":1,"wal-append.queue_time_us":751510}
I20260709 13:20:15.142053  6728 raft_consensus.cc:2468] T bb3d8792045a4583ae2e965b1350a5b4 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in term 10.
I20260709 13:20:15.147855  6846 leader_election.cc:304] T d8cee0accdb8499c86d4414b72565a38 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
W20260709 13:20:15.151527  6695 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:15.157243 11051 raft_consensus.cc:2804] T d8cee0accdb8499c86d4414b72565a38 P cd75a17ab2604397adab03bb8b5fd75c [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:20:15.189718 11051 raft_consensus.cc:493] T d8cee0accdb8499c86d4414b72565a38 P cd75a17ab2604397adab03bb8b5fd75c [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:15.190179 11051 raft_consensus.cc:3060] T d8cee0accdb8499c86d4414b72565a38 P cd75a17ab2604397adab03bb8b5fd75c [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:20:15.190274  6803 pending_rounds.cc:85] T d8292e16e5654be6bc408560cf256aaa P b7ab4784c7344b939bc36f639286f377: Aborting all ops after (but not including) 7
I20260709 13:20:15.190793  6803 pending_rounds.cc:107] T d8292e16e5654be6bc408560cf256aaa P b7ab4784c7344b939bc36f639286f377: Aborting uncommitted NO_OP operation due to leader change: 14.8
I20260709 13:20:15.191342  6803 raft_consensus.cc:2889] T d8292e16e5654be6bc408560cf256aaa P b7ab4784c7344b939bc36f639286f377 [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:20:15.196419  6799 raft_consensus.cc:2468] T 7c44c4849aa54f2b94d1f1bef9ed546f P b7ab4784c7344b939bc36f639286f377 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 14.
I20260709 13:20:15.200181  6881 raft_consensus.cc:2468] T 3fa34c08b205435dba97346991aa1f92 P cd75a17ab2604397adab03bb8b5fd75c [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in term 14.
I20260709 13:20:15.199230  6772 leader_election.cc:304] T 95a75bfe094d4bdc963aba3f08dfcd25 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
W20260709 13:20:15.203719  6695 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:15.210841  6695 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:15.190980 11211 leader_election.cc:290] T bb7fa124c3bf4ef9ab65a407cb008441 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
W20260709 13:20:15.214767  7466 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 46714.4us
W20260709 13:20:15.224280 11213 log.cc:927] Time spent T ab432e62819d499eaaf3dd55481dd930 P cd75a17ab2604397adab03bb8b5fd75c: Append to log took a long time: real 0.189s	user 0.001s	sys 0.000s
I20260709 13:20:15.226418  7503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce4f062dcd314d43a63ca74067cb5ee3" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
W20260709 13:20:15.226970 11169 consensus_meta.cc:287] T c4db81d9d329422bb3b4160ca4ac2d1d P ccd8a4c3bfe3413cb2ae219b09aea832: Time spent flushing consensus metadata: real 0.681s	user 0.007s	sys 0.008s
I20260709 13:20:15.227165  7503 raft_consensus.cc:2468] T ce4f062dcd314d43a63ca74067cb5ee3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 11.
I20260709 13:20:15.229486  6876 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58592 (request call id 336) took 3510 ms. Trace:
I20260709 13:20:15.227445 11169 raft_consensus.cc:515] T c4db81d9d329422bb3b4160ca4ac2d1d P ccd8a4c3bfe3413cb2ae219b09aea832 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:15.177543 11092 raft_consensus.cc:515] T b56bf91d90824c959e21e0cee5ba1816 P cd75a17ab2604397adab03bb8b5fd75c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:15.242995 11092 leader_election.cc:290] T b56bf91d90824c959e21e0cee5ba1816 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:20:15.165442 11134 consensus_queue.cc:1048] T 07a92dd554674067a83a9cb68c4773f2 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.045s
I20260709 13:20:15.223842  6875 raft_consensus.cc:1240] T e31b9971c15848dea59d4d4130141d9e P cd75a17ab2604397adab03bb8b5fd75c [term 10 FOLLOWER]: Rejecting Update request from peer b7ab4784c7344b939bc36f639286f377 for earlier term 9. Current term is 10. Ops: [9.6-9.6]
I20260709 13:20:15.263682  6874 raft_consensus.cc:2468] T 2c240553ce044eedb41541d72b9475d7 P cd75a17ab2604397adab03bb8b5fd75c [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 13.
W20260709 13:20:15.268357  6772 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 69267.1us
I20260709 13:20:15.230099  6876 rpcz_store.cc:276] 0709 13:20:11.719058 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:11.719498 (+   440us) service_pool.cc:224] Handling call
0709 13:20:11.719801 (+   303us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:11.723153 (+  3352us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:11.723180 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:20:11.723712 (+   532us) log.cc:844] Serialized 26 byte log entry
0709 13:20:12.283475 (+559763us) spinlock_profiling.cc:243] Waited 9.62 ms on lock 0x7b4800210258. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc148d3aa1 00007fcc148cab37 00007fcc148ca9ca 00007fcc149c226f 00007fcc149c1f37 00007fcc149d655c 00007fcc149d6508 00007fcc149d6488 00007fcc149d6443 00007fcc149d56ec 00007fcc138ffa96
0709 13:20:12.425686 (+142211us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:20:12.425749 (+    63us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:12.425851 (+   102us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:15.116173 (+2690322us) spinlock_profiling.cc:243] Waited 23 ms on lock 0x7b4400022b4c. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0c745db1 00007fcc0c7e3c85 00007fcc0c7e46a2 00007fcc0f5561db 00007fcc0f551aaf 00007fcc0f54586e 00007fcc0f544bb6 00007fcc0f5447d8 00007fcc0f54e221 00007fcc0f54e1d9 00007fcc0f54e169
0709 13:20:15.228844 (+112671us) raft_consensus.cc:1685] finished
0709 13:20:15.228882 (+    38us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:15.229211 (+   329us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2934,"raft.queue_time_us":14764,"raft.run_cpu_time_us":11498,"raft.run_wall_time_us":547813,"spinlock_wait_cycles":74988672,"thread_start_us":701579,"threads_started":1,"wal-append.queue_time_us":1157859}
I20260709 13:20:15.281546  7503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb7fa124c3bf4ef9ab65a407cb008441" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:20:15.282409  6873 raft_consensus.cc:1240] T 2c240553ce044eedb41541d72b9475d7 P cd75a17ab2604397adab03bb8b5fd75c [term 13 FOLLOWER]: Rejecting Update request from peer ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 12. Current term is 13. Ops: []
I20260709 13:20:15.293164  6802 pending_rounds.cc:85] T 20f6842e26174571996b8dea4151d4be P b7ab4784c7344b939bc36f639286f377: Aborting all ops after (but not including) 4
I20260709 13:20:15.293668  6802 pending_rounds.cc:107] T 20f6842e26174571996b8dea4151d4be P b7ab4784c7344b939bc36f639286f377: Aborting uncommitted NO_OP operation due to leader change: 6.5
I20260709 13:20:15.293936  6802 raft_consensus.cc:2889] T 20f6842e26174571996b8dea4151d4be P b7ab4784c7344b939bc36f639286f377 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:20:15.304718 11211 raft_consensus.cc:2804] T 95a75bfe094d4bdc963aba3f08dfcd25 P b7ab4784c7344b939bc36f639286f377 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:20:15.305862  6804 raft_consensus.cc:1275] T bb7fa124c3bf4ef9ab65a407cb008441 P b7ab4784c7344b939bc36f639286f377 [term 12 FOLLOWER]: Refusing update from remote peer 7ba59cc884714e8aa5f3f0ecaed84cbb: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:20:15.305986  6878 raft_consensus.cc:1240] T 427c124d773f483294511e80fe340075 P cd75a17ab2604397adab03bb8b5fd75c [term 10 FOLLOWER]: Rejecting Update request from peer b7ab4784c7344b939bc36f639286f377 for earlier term 9. Current term is 10. Ops: []
I20260709 13:20:15.307751  6878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fa34c08b205435dba97346991aa1f92" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:15.313207  6878 raft_consensus.cc:2368] T 3fa34c08b205435dba97346991aa1f92 P cd75a17ab2604397adab03bb8b5fd75c [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 13. Current term is 14.
W20260709 13:20:15.318634 11010 consensus_meta.cc:287] T 711ef6523deb4cbe8ef2ba61e1c21c98 P ccd8a4c3bfe3413cb2ae219b09aea832: Time spent flushing consensus metadata: real 1.132s	user 0.018s	sys 0.007s
I20260709 13:20:15.319264 11010 raft_consensus.cc:515] T 711ef6523deb4cbe8ef2ba61e1c21c98 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:15.323199  6881 raft_consensus.cc:1240] T f09c2a98de1a4decabd0ff900dd44caa P cd75a17ab2604397adab03bb8b5fd75c [term 13 LEADER]: Rejecting Update request from peer b7ab4784c7344b939bc36f639286f377 for earlier term 12. Current term is 13. Ops: []
I20260709 13:20:15.313136  6799 raft_consensus.cc:1240] T 7a734b5ab7834e05a8c422208acc58b1 P b7ab4784c7344b939bc36f639286f377 [term 12 FOLLOWER]: Rejecting Update request from peer ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 11. Current term is 12. Ops: [11.5-11.5]
W20260709 13:20:15.340224  7466 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 50245us
I20260709 13:20:15.362710  7503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fa34c08b205435dba97346991aa1f92" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:20:15.334969 11093 leader_election.cc:290] T 1bf4668eeb70467fb3dc5a0289233b3c P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:20:15.368978  6881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "711ef6523deb4cbe8ef2ba61e1c21c98" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:20:15.369503  6881 raft_consensus.cc:3060] T 711ef6523deb4cbe8ef2ba61e1c21c98 P cd75a17ab2604397adab03bb8b5fd75c [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:15.374771  7503 raft_consensus.cc:2368] T 3fa34c08b205435dba97346991aa1f92 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 13. Current term is 14.
I20260709 13:20:15.331177 11126 raft_consensus.cc:515] T f4b8bd455d5a47c18a1380839c6e0d61 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:15.358438 11169 leader_election.cc:290] T c4db81d9d329422bb3b4160ca4ac2d1d P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 11 election: Requested vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:15.376596  7500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3f13b31a1f84f0d89d007eadd57924c" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
W20260709 13:20:15.378868 11124 consensus_meta.cc:287] T a3022224cc81473690653a83d4e99470 P ccd8a4c3bfe3413cb2ae219b09aea832: Time spent flushing consensus metadata: real 1.221s	user 0.013s	sys 0.009s
W20260709 13:20:15.379963  6770 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 236602us
I20260709 13:20:15.380636  6875 raft_consensus.cc:1275] T 90d42e216d9741e190bca19a781291fd P cd75a17ab2604397adab03bb8b5fd75c [term 11 FOLLOWER]: Refusing update from remote peer ccd8a4c3bfe3413cb2ae219b09aea832: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:20:15.382216  7503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "404190ce4ce94cecbfcb6ea9d1dd8626" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:20:15.398554  6878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4b8bd455d5a47c18a1380839c6e0d61" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:15.400563  6878 raft_consensus.cc:2368] T f4b8bd455d5a47c18a1380839c6e0d61 P cd75a17ab2604397adab03bb8b5fd75c [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 10. Current term is 11.
I20260709 13:20:15.403034  6878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce4f062dcd314d43a63ca74067cb5ee3" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:15.404279 11126 leader_election.cc:290] T f4b8bd455d5a47c18a1380839c6e0d61 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 10 election: Requested vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:15.403883  6878 raft_consensus.cc:2468] T ce4f062dcd314d43a63ca74067cb5ee3 P cd75a17ab2604397adab03bb8b5fd75c [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 11.
I20260709 13:20:15.406469  6878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3411566abe2d4c9bb4b2adfdd05e6f17" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:15.407369  6878 raft_consensus.cc:2393] T 3411566abe2d4c9bb4b2adfdd05e6f17 P cd75a17ab2604397adab03bb8b5fd75c [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7ab4784c7344b939bc36f639286f377 in current term 10: Already voted for candidate cd75a17ab2604397adab03bb8b5fd75c in this term.
I20260709 13:20:15.408679  6878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d65025eea89441290d85dd053810e31" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 11 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:15.409425  6878 raft_consensus.cc:2468] T 3d65025eea89441290d85dd053810e31 P cd75a17ab2604397adab03bb8b5fd75c [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 10.
I20260709 13:20:15.410691  6878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44bde925b2e541b69890d70715b85176" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:20:15.411247  6878 raft_consensus.cc:3060] T 44bde925b2e541b69890d70715b85176 P cd75a17ab2604397adab03bb8b5fd75c [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:15.417117  6881 raft_consensus.cc:2468] T 711ef6523deb4cbe8ef2ba61e1c21c98 P cd75a17ab2604397adab03bb8b5fd75c [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 13.
I20260709 13:20:15.397513  6772 leader_election.cc:304] T 7c44c4849aa54f2b94d1f1bef9ed546f P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:20:15.420693  6770 leader_election.cc:400] T f5be3a11b23d4ea9b08300a2789821c7 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 9 election: Vote denied by peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391) with higher term. Message: Invalid argument: T f5be3a11b23d4ea9b08300a2789821c7 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate b7ab4784c7344b939bc36f639286f377 for earlier term 9. Current term is 10.
I20260709 13:20:15.421319  6770 leader_election.cc:403] T f5be3a11b23d4ea9b08300a2789821c7 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 9 election: Cancelling election due to peer responding with higher term
I20260709 13:20:15.424798  6723 raft_consensus.cc:2468] T 3fa34c08b205435dba97346991aa1f92 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in term 14.
I20260709 13:20:15.417347  6875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c44c4849aa54f2b94d1f1bef9ed546f" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:15.427989  6725 raft_consensus.cc:2468] T a3022224cc81473690653a83d4e99470 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 13.
I20260709 13:20:15.428738 11157 leader_election.cc:290] T 30e88460611e47b2ba16a46a30b5f416 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:20:15.430753  6725 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49998 (request call id 1053) took 1483 ms. Trace:
I20260709 13:20:15.433175  6723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90d42e216d9741e190bca19a781291fd" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:15.434767  6879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb7fa124c3bf4ef9ab65a407cb008441" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:15.436285  6878 raft_consensus.cc:2468] T 44bde925b2e541b69890d70715b85176 P cd75a17ab2604397adab03bb8b5fd75c [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 13.
I20260709 13:20:15.435746  6879 raft_consensus.cc:2468] T bb7fa124c3bf4ef9ab65a407cb008441 P cd75a17ab2604397adab03bb8b5fd75c [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 12.
I20260709 13:20:15.431310  6725 rpcz_store.cc:276] 0709 13:20:13.947308 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:13.947524 (+   216us) service_pool.cc:224] Handling call
0709 13:20:15.430363 (+1482839us) spinlock_profiling.cc:243] Waited 1.44 s on lock 0x7b54003b6fd4. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f9ae2fa 00007fcc1496fb17 00007fcc0deea6d4 00007fcc0deea662 00007fcc0deea591 00007fcc0deea50c 00007fcc0dee97c2 00007fcc0dce548c 00007fcc0dce48c6 00007fcc0dce426f
0709 13:20:15.430661 (+   298us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3314875776}
I20260709 13:20:15.455631  6881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90d42e216d9741e190bca19a781291fd" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:15.482190  6723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c7f33e544204fbaac4078e3e83bbf4e" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:15.477411  6878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8292e16e5654be6bc408560cf256aaa" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:15.486639  6881 raft_consensus.cc:2468] T 90d42e216d9741e190bca19a781291fd P cd75a17ab2604397adab03bb8b5fd75c [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 11.
W20260709 13:20:15.473309  6772 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 52144.8us
I20260709 13:20:15.424456 11097 raft_consensus.cc:2764] T 7c44c4849aa54f2b94d1f1bef9ed546f P b7ab4784c7344b939bc36f639286f377 [term 14 FOLLOWER]: Leader pre-election decision vote started in defunct term 13: won
W20260709 13:20:15.490417  7466 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 55505.2us
W20260709 13:20:15.507334  6698 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:15.470400  6875 raft_consensus.cc:2468] T 7c44c4849aa54f2b94d1f1bef9ed546f P cd75a17ab2604397adab03bb8b5fd75c [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 12.
W20260709 13:20:15.484179 11186 consensus_meta.cc:287] T 7887766dc6784fcaa42b35c05fea7a99 P ccd8a4c3bfe3413cb2ae219b09aea832: Time spent flushing consensus metadata: real 0.814s	user 0.016s	sys 0.004s
I20260709 13:20:15.520502  7500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be1a92657f494cac8dd227d152f50151" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:20:15.522478  7503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe20b4b48823486ca3b9c648db6ce8aa" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:20:15.523635  6878 raft_consensus.cc:2468] T d8292e16e5654be6bc408560cf256aaa P cd75a17ab2604397adab03bb8b5fd75c [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 15.
I20260709 13:20:15.522332  6879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe20b4b48823486ca3b9c648db6ce8aa" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:15.521775  6725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de3186201e1a40d0b335eeb8b4e256e0" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: true dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
W20260709 13:20:15.527590  6770 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 111969us
I20260709 13:20:15.533317  6725 raft_consensus.cc:3060] T de3186201e1a40d0b335eeb8b4e256e0 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:15.536594 10938 raft_consensus.cc:493] T a1704639a875409b9959353527b3fd68 P b7ab4784c7344b939bc36f639286f377 [term 12 FOLLOWER]: Starting leader election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:20:15.537286 10938 raft_consensus.cc:3060] T a1704639a875409b9959353527b3fd68 P b7ab4784c7344b939bc36f639286f377 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:15.539881 11010 leader_election.cc:290] T 711ef6523deb4cbe8ef2ba61e1c21c98 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 13 election: Requested vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:15.545624  6875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34f36d59d88f40fe8a2805e604fc6c0a" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:20:15.546617  6878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34f36d59d88f40fe8a2805e604fc6c0a" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:20:15.552982  6772 leader_election.cc:304] T 4f00a2e87e56452083b759f60d461ee3 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, cd75a17ab2604397adab03bb8b5fd75c
W20260709 13:20:15.558928 11226 log.cc:927] Time spent T ab432e62819d499eaaf3dd55481dd930 P ccd8a4c3bfe3413cb2ae219b09aea832: Append to log took a long time: real 0.134s	user 0.002s	sys 0.000s
I20260709 13:20:15.562463  6807 raft_consensus.cc:3055] T bd6869f07b5a4885a0b99fbe60c3b175 P b7ab4784c7344b939bc36f639286f377 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:20:15.563081  6807 raft_consensus.cc:740] T bd6869f07b5a4885a0b99fbe60c3b175 P b7ab4784c7344b939bc36f639286f377 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
I20260709 13:20:15.565670 11010 raft_consensus.cc:493] T d33d5ee8ef6f415593d8df52063161ad P ccd8a4c3bfe3413cb2ae219b09aea832 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:20:15.566506 11010 raft_consensus.cc:515] T d33d5ee8ef6f415593d8df52063161ad P ccd8a4c3bfe3413cb2ae219b09aea832 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:15.569949  6726 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49744 (request call id 407) took 3229 ms. Trace:
I20260709 13:20:15.569432  6875 raft_consensus.cc:3060] T 34f36d59d88f40fe8a2805e604fc6c0a P cd75a17ab2604397adab03bb8b5fd75c [term 7 FOLLOWER]: Advancing to term 9
I20260709 13:20:15.574990 11097 consensus_queue.cc:1059] T 1bf4668eeb70467fb3dc5a0289233b3c P b7ab4784c7344b939bc36f639286f377 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:20:15.576181 11097 raft_consensus.cc:3055] T 1bf4668eeb70467fb3dc5a0289233b3c P b7ab4784c7344b939bc36f639286f377 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:20:15.576659 11097 raft_consensus.cc:740] T 1bf4668eeb70467fb3dc5a0289233b3c P b7ab4784c7344b939bc36f639286f377 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
I20260709 13:20:15.578145 11097 consensus_queue.cc:260] T 1bf4668eeb70467fb3dc5a0289233b3c P b7ab4784c7344b939bc36f639286f377 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:15.580335 11097 raft_consensus.cc:3060] T 1bf4668eeb70467fb3dc5a0289233b3c P b7ab4784c7344b939bc36f639286f377 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:20:15.574909 10818 consensus_queue.cc:1048] T 44bde925b2e541b69890d70715b85176 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:20:15.580741 10989 raft_consensus.cc:2749] T f5be3a11b23d4ea9b08300a2789821c7 P b7ab4784c7344b939bc36f639286f377 [term 10 FOLLOWER]: Leader election lost for term 9. Reason: Vote denied by peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391) with higher term. Message: Invalid argument: T f5be3a11b23d4ea9b08300a2789821c7 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate b7ab4784c7344b939bc36f639286f377 for earlier term 9. Current term is 10.
I20260709 13:20:15.570492  6726 rpcz_store.cc:276] 0709 13:20:12.340882 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:12.341066 (+   184us) service_pool.cc:224] Handling call
0709 13:20:12.341461 (+   395us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:12.434369 (+ 92908us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:12.434403 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:20:12.444240 (+  9837us) log.cc:844] Serialized 26 byte log entry
0709 13:20:15.044955 (+2600715us) spinlock_profiling.cc:243] Waited 2.71 ms on lock 0x7b1800321760. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc15785de1 00007fcc157925b1 00007fcc0c89fe07 00007fcc156faab9 00007fcc0c8bc69b 00007fcc0c8ba93f 00007fcc0c8bcc02 00007fcc0f54420b 00007fcc0f549d23 00007fcc0f54a0d1 00007fcc0f965a0f
0709 13:20:15.208562 (+163607us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:20:15.212680 (+  4118us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:15.249929 (+ 37249us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:15.566446 (+316517us) spinlock_profiling.cc:243] Waited 6.84 ms on lock 0x7b540012faa0. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f91fdbe 00007fcc0f92a930 00007fcc0f92a8d8 00007fcc0f92a858 00007fcc0f92a813 00007fcc0f929a9c 00007fcc15815626 00007fcc1580fdd8 00007fcc0f9667cb 00007fcc0f9692c0
0709 13:20:15.568294 (+  1848us) raft_consensus.cc:1685] finished
0709 13:20:15.568323 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:15.569703 (+  1380us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":92463,"raft.queue_time_us":104058,"raft.run_cpu_time_us":250,"raft.run_wall_time_us":66132,"spinlock_wait_cycles":21965440,"thread_start_us":111914,"threads_started":1,"wal-append.queue_time_us":2735178}
I20260709 13:20:15.581425  6800 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:32976 (request call id 2844) took 1305 ms. Trace:
I20260709 13:20:15.600960  6725 raft_consensus.cc:2468] T de3186201e1a40d0b335eeb8b4e256e0 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 13.
I20260709 13:20:15.594138 11051 raft_consensus.cc:515] T d8cee0accdb8499c86d4414b72565a38 P cd75a17ab2604397adab03bb8b5fd75c [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:20:15.590520  6874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e31b9971c15848dea59d4d4130141d9e" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:15.601982  6874 raft_consensus.cc:2393] T e31b9971c15848dea59d4d4130141d9e P cd75a17ab2604397adab03bb8b5fd75c [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ccd8a4c3bfe3413cb2ae219b09aea832 in current term 10: Already voted for candidate cd75a17ab2604397adab03bb8b5fd75c in this term.
I20260709 13:20:15.573333  6876 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53406 (request call id 2131) took 1017 ms. Trace:
I20260709 13:20:15.572916 11117 raft_consensus.cc:2749] T 4f00a2e87e56452083b759f60d461ee3 P b7ab4784c7344b939bc36f639286f377 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:20:15.570892 11010 leader_election.cc:290] T d33d5ee8ef6f415593d8df52063161ad P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:15.600870  6800 rpcz_store.cc:276] 0709 13:20:14.276070 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:14.366602 (+ 90532us) service_pool.cc:224] Handling call
0709 13:20:15.581161 (+1214559us) spinlock_profiling.cc:243] Waited 339 ms on lock 0x7b54001cacd4. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f9ae2fa 00007fcc1496fb17 00007fcc0deea6d4 00007fcc0deea662 00007fcc0deea591 00007fcc0deea50c 00007fcc0dee97c2 00007fcc0dce548c 00007fcc0dce48c6 00007fcc0dce426f
0709 13:20:15.581334 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":778940160}
I20260709 13:20:15.602391  6876 rpcz_store.cc:276] 0709 13:20:14.551521 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:15.290042 (+738521us) service_pool.cc:224] Handling call
0709 13:20:15.373286 (+ 83244us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:15.412871 (+ 39585us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:20:15.413268 (+   397us) log.cc:844] Serialized 14 byte log entry
0709 13:20:15.489346 (+ 76078us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:20:15.524922 (+ 35576us) log.cc:844] Serialized 26 byte log entry
0709 13:20:15.528213 (+  3291us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:20:15.528509 (+   296us) log.cc:844] Serialized 14 byte log entry
0709 13:20:15.528709 (+   200us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:15.528779 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:15.568476 (+ 39697us) raft_consensus.cc:1685] finished
0709 13:20:15.568498 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:15.568661 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":63171,"prepare.queue_time_us":1691,"prepare.run_cpu_time_us":73,"prepare.run_wall_time_us":74,"raft.queue_time_us":81191,"raft.run_cpu_time_us":454,"raft.run_wall_time_us":20269,"thread_start_us":13691,"threads_started":1,"wal-append.queue_time_us":118354}
W20260709 13:20:15.611857  6697 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:15.613632  6878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f9c2e2bf644115957398fe4c9459db" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:15.617187  6876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09c2a98de1a4decabd0ff900dd44caa" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:15.617314  6874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c44c4849aa54f2b94d1f1bef9ed546f" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:20:15.618032  6772 leader_election.cc:304] T 9b3759de40694069b13c0f8bd40e5709 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:20:15.618228  6874 raft_consensus.cc:3060] T 7c44c4849aa54f2b94d1f1bef9ed546f P cd75a17ab2604397adab03bb8b5fd75c [term 12 FOLLOWER]: Advancing to term 14
I20260709 13:20:15.549726 11179 consensus_queue.cc:1048] T bb7fa124c3bf4ef9ab65a407cb008441 P 7ba59cc884714e8aa5f3f0ecaed84cbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.213s
W20260709 13:20:15.624941  6695 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:15.612344  6807 consensus_queue.cc:260] T bd6869f07b5a4885a0b99fbe60c3b175 P b7ab4784c7344b939bc36f639286f377 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.5, Last appended by leader: 5, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
W20260709 13:20:15.621393 11172 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.922s	user 0.020s	sys 0.042s
I20260709 13:20:15.634181  6878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4db81d9d329422bb3b4160ca4ac2d1d" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:15.622344 11010 raft_consensus.cc:493] T 3a485a995abc4807b6e511e45419f737 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:20:15.636456 11172 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.066s	user 0.020s	sys 0.043s
I20260709 13:20:15.644742  7466 leader_election.cc:304] T 427c124d773f483294511e80fe340075 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377
I20260709 13:20:15.649415  6876 raft_consensus.cc:1240] T 3411566abe2d4c9bb4b2adfdd05e6f17 P cd75a17ab2604397adab03bb8b5fd75c [term 10 FOLLOWER]: Rejecting Update request from peer ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 9. Current term is 10. Ops: []
I20260709 13:20:15.650499  6876 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53416 (request call id 2906) took 1081 ms. Trace:
I20260709 13:20:15.651110  6876 rpcz_store.cc:276] 0709 13:20:14.569244 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:15.640343 (+1071099us) service_pool.cc:224] Handling call
0709 13:20:15.648879 (+  8536us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:15.650168 (+  1289us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:15.650419 (+   251us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:20:15.655045 11038 raft_consensus.cc:493] T b56bf91d90824c959e21e0cee5ba1816 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:20:15.658725  6772 leader_election.cc:304] T 2c240553ce044eedb41541d72b9475d7 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:20:15.656504 10983 raft_consensus.cc:493] T dbdf895bba214ff68685a24fd17dfb5d P ccd8a4c3bfe3413cb2ae219b09aea832 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:20:15.647293 11186 raft_consensus.cc:493] T 22ccee1b570c4ad3a57bd7aec085b1b4 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:20:15.664675 11186 raft_consensus.cc:515] T 22ccee1b570c4ad3a57bd7aec085b1b4 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:15.665313  6798 raft_consensus.cc:1240] T f58dc08b12a2494bb9a1372837970ca2 P b7ab4784c7344b939bc36f639286f377 [term 14 LEADER]: Rejecting Update request from peer ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 13. Current term is 14. Ops: []
I20260709 13:20:15.668164  6729 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49998 (request call id 1066) took 1716 ms. Trace:
I20260709 13:20:15.672389 11118 raft_consensus.cc:2804] T 2c240553ce044eedb41541d72b9475d7 P b7ab4784c7344b939bc36f639286f377 [term 13 FOLLOWER]: Leader election won for term 13
W20260709 13:20:15.672844 11187 log.cc:927] Time spent T bb7fa124c3bf4ef9ab65a407cb008441 P 7ba59cc884714e8aa5f3f0ecaed84cbb: Append to log took a long time: real 1.501s	user 0.004s	sys 0.000s
I20260709 13:20:15.673910 11118 raft_consensus.cc:697] T 2c240553ce044eedb41541d72b9475d7 P b7ab4784c7344b939bc36f639286f377 [term 13 LEADER]: Becoming Leader. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
I20260709 13:20:15.674695 11132 raft_consensus.cc:2804] T 427c124d773f483294511e80fe340075 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:20:15.675767 10969 consensus_queue.cc:1059] T bd6869f07b5a4885a0b99fbe60c3b175 P b7ab4784c7344b939bc36f639286f377 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: INVALID_TERM, Last received: 11.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.048s
I20260709 13:20:15.675431 11118 consensus_queue.cc:237] T 2c240553ce044eedb41541d72b9475d7 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:15.676676 10969 consensus_queue.cc:1243] T bd6869f07b5a4885a0b99fbe60c3b175 P b7ab4784c7344b939bc36f639286f377 [NON_LEADER]: Peer ccd8a4c3bfe3413cb2ae219b09aea832 log is divergent from this leader: its last log entry 12.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 13:20:15.655977 11038 raft_consensus.cc:515] T b56bf91d90824c959e21e0cee5ba1816 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:15.656680 10989 raft_consensus.cc:2804] T 9b3759de40694069b13c0f8bd40e5709 P b7ab4784c7344b939bc36f639286f377 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:20:15.681186 10989 raft_consensus.cc:697] T 9b3759de40694069b13c0f8bd40e5709 P b7ab4784c7344b939bc36f639286f377 [term 11 LEADER]: Becoming Leader. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
I20260709 13:20:15.681710 11040 raft_consensus.cc:3060] T 7c37d41cd9164c15a6826ca62a851a69 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:20:15.682605 10989 consensus_queue.cc:237] T 9b3759de40694069b13c0f8bd40e5709 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:15.660509 10983 raft_consensus.cc:515] T dbdf895bba214ff68685a24fd17dfb5d P ccd8a4c3bfe3413cb2ae219b09aea832 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:15.642843 11010 raft_consensus.cc:515] T 3a485a995abc4807b6e511e45419f737 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:15.670648  6729 rpcz_store.cc:276] 0709 13:20:13.951636 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:14.462192 (+510556us) service_pool.cc:224] Handling call
0709 13:20:15.658045 (+1195853us) spinlock_profiling.cc:243] Waited 403 ms on lock 0x7b54003d5254. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f9ae2fa 00007fcc1496fb17 00007fcc0deea6d4 00007fcc0deea662 00007fcc0deea591 00007fcc0deea50c 00007fcc0dee97c2 00007fcc0dce548c 00007fcc0dce48c6 00007fcc0dce426f
0709 13:20:15.668081 (+ 10036us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":927345408}
I20260709 13:20:15.693804  6879 raft_consensus.cc:1275] T bd6869f07b5a4885a0b99fbe60c3b175 P cd75a17ab2604397adab03bb8b5fd75c [term 12 FOLLOWER]: Refusing update from remote peer ccd8a4c3bfe3413cb2ae219b09aea832: Log matching property violated. Preceding OpId in replica: term: 11 index: 5. Preceding OpId from leader: term: 12 index: 6. (index mismatch)
I20260709 13:20:15.707310 10931 consensus_queue.cc:1059] T 24ee15416e3145beaa1b8183453729a3 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:20:15.708514 10931 raft_consensus.cc:3055] T 24ee15416e3145beaa1b8183453729a3 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:20:15.708590 11186 leader_election.cc:290] T 22ccee1b570c4ad3a57bd7aec085b1b4 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:15.709034 10931 raft_consensus.cc:740] T 24ee15416e3145beaa1b8183453729a3 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
I20260709 13:20:15.710238 10931 consensus_queue.cc:260] T 24ee15416e3145beaa1b8183453729a3 P ccd8a4c3bfe3413cb2ae219b09aea832 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:20:15.711709 10931 raft_consensus.cc:3060] T 24ee15416e3145beaa1b8183453729a3 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:15.712567 11038 leader_election.cc:290] T b56bf91d90824c959e21e0cee5ba1816 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:15.712598  7495 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50756 (request call id 298) took 1331 ms. Trace:
W20260709 13:20:15.712977 11216 log.cc:927] Time spent T a3022224cc81473690653a83d4e99470 P b7ab4784c7344b939bc36f639286f377: Append to log took a long time: real 0.520s	user 0.000s	sys 0.003s
I20260709 13:20:15.715970  6876 raft_consensus.cc:1275] T 07a92dd554674067a83a9cb68c4773f2 P cd75a17ab2604397adab03bb8b5fd75c [term 11 FOLLOWER]: Refusing update from remote peer ccd8a4c3bfe3413cb2ae219b09aea832: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:20:15.719043  6876 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53416 (request call id 2909) took 1149 ms. Trace:
I20260709 13:20:15.715103  7495 rpcz_store.cc:276] 0709 13:20:14.381289 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:14.381514 (+   225us) service_pool.cc:224] Handling call
0709 13:20:14.388435 (+  6921us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:14.919232 (+530797us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:15.712274 (+793042us) spinlock_profiling.cc:243] Waited 367 ms on lock 0x7b54005a0354. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f9aae01 00007fcc0f9a983e 00007fcc1496e419 00007fcc0dee5bd4 00007fcc0dee5b62 00007fcc0dee5a91 00007fcc0dee5a0c 00007fcc0dee4cc2 00007fcc0dce548c 00007fcc0dce48c6
0709 13:20:15.712498 (+   224us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":843628800}
I20260709 13:20:15.719723  6876 rpcz_store.cc:276] 0709 13:20:14.573133 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:15.658716 (+1085583us) service_pool.cc:224] Handling call
0709 13:20:15.691837 (+ 33121us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:15.718106 (+ 26269us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:15.718939 (+   833us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:20:15.722771 11232 log.cc:927] Time spent T d8292e16e5654be6bc408560cf256aaa P b7ab4784c7344b939bc36f639286f377: Append to log took a long time: real 0.123s	user 0.000s	sys 0.001s
I20260709 13:20:15.723019  6697 leader_election.cc:304] T 1bf4668eeb70467fb3dc5a0289233b3c P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:20:15.724010 11012 raft_consensus.cc:2749] T 1bf4668eeb70467fb3dc5a0289233b3c P ccd8a4c3bfe3413cb2ae219b09aea832 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:20:15.720229 11198 consensus_queue.cc:1059] T 427c124d773f483294511e80fe340075 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: INVALID_TERM, Last received: 9.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.005s
I20260709 13:20:15.725692 11198 raft_consensus.cc:3055] T 427c124d773f483294511e80fe340075 P b7ab4784c7344b939bc36f639286f377 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:20:15.725903  6873 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53416 (request call id 2901) took 1216 ms. Trace:
I20260709 13:20:15.726145 11198 raft_consensus.cc:740] T 427c124d773f483294511e80fe340075 P b7ab4784c7344b939bc36f639286f377 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
I20260709 13:20:15.726420  6873 rpcz_store.cc:276] 0709 13:20:14.509764 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:15.083491 (+573727us) service_pool.cc:224] Handling call
0709 13:20:15.282158 (+198667us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:15.287899 (+  5741us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:15.725680 (+437781us) spinlock_profiling.cc:243] Waited 198 ms on lock 0x7b5400348350. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f9a98ad 00007fcc1496e419 00007fcc0dee5bd4 00007fcc0dee5b62 00007fcc0dee5a91 00007fcc0dee5a0c 00007fcc0dee4cc2 00007fcc0dce548c 00007fcc0dce48c6 00007fcc0dce426f
0709 13:20:15.725840 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":456049920}
I20260709 13:20:15.732049  6878 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53416 (request call id 2908) took 1162 ms. Trace:
W20260709 13:20:15.735241  7466 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 90602us
I20260709 13:20:15.732718  6878 rpcz_store.cc:276] 0709 13:20:14.569796 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:15.641531 (+1071735us) service_pool.cc:224] Handling call
0709 13:20:15.666743 (+ 25212us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:15.731600 (+ 64857us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:15.731643 (+    43us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:20:15.731701 (+    58us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:20:15.731747 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:15.731829 (+    82us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:15.731965 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:20:15.733985 10580 consensus_queue.cc:1048] T 20f6842e26174571996b8dea4151d4be P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:20:15.737082 10580 consensus_queue.cc:1243] T 20f6842e26174571996b8dea4151d4be P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Peer cd75a17ab2604397adab03bb8b5fd75c log is divergent from this leader: its last log entry 12.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 13:20:15.723611 11013 consensus_queue.cc:1059] T f03d0dbf16864ca4bc1bb5e4c0334c0f P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:20:15.744000 10580 raft_consensus.cc:3055] T f03d0dbf16864ca4bc1bb5e4c0334c0f P ccd8a4c3bfe3413cb2ae219b09aea832 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:20:15.731004 11038 consensus_queue.cc:1059] T a1704639a875409b9959353527b3fd68 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.013s
I20260709 13:20:15.744426 10580 raft_consensus.cc:740] T f03d0dbf16864ca4bc1bb5e4c0334c0f P ccd8a4c3bfe3413cb2ae219b09aea832 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
I20260709 13:20:15.744748 11038 raft_consensus.cc:3055] T a1704639a875409b9959353527b3fd68 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:20:15.745131 11038 raft_consensus.cc:740] T a1704639a875409b9959353527b3fd68 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
I20260709 13:20:15.745473 10580 consensus_queue.cc:260] T f03d0dbf16864ca4bc1bb5e4c0334c0f P ccd8a4c3bfe3413cb2ae219b09aea832 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:15.746279  6872 raft_consensus.cc:1240] T bd6869f07b5a4885a0b99fbe60c3b175 P cd75a17ab2604397adab03bb8b5fd75c [term 12 FOLLOWER]: Rejecting Update request from peer b7ab4784c7344b939bc36f639286f377 for earlier term 11. Current term is 12. Ops: []
I20260709 13:20:15.746061 11038 consensus_queue.cc:260] T a1704639a875409b9959353527b3fd68 P ccd8a4c3bfe3413cb2ae219b09aea832 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:15.710232 11010 leader_election.cc:290] T 3a485a995abc4807b6e511e45419f737 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:15.748608  6873 raft_consensus.cc:1240] T 7a734b5ab7834e05a8c422208acc58b1 P cd75a17ab2604397adab03bb8b5fd75c [term 12 FOLLOWER]: Rejecting Update request from peer ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 11. Current term is 12. Ops: [11.5-11.5]
I20260709 13:20:15.747057 10580 raft_consensus.cc:3060] T f03d0dbf16864ca4bc1bb5e4c0334c0f P ccd8a4c3bfe3413cb2ae219b09aea832 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:20:15.749821  6876 raft_consensus.cc:1240] T 9b3759de40694069b13c0f8bd40e5709 P cd75a17ab2604397adab03bb8b5fd75c [term 11 FOLLOWER]: Rejecting Update request from peer ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 10. Current term is 11. Ops: []
I20260709 13:20:15.743497  6697 leader_election.cc:304] T 853ac0a8cbd64ce99457f170216d4d0f P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:20:15.749943 11038 raft_consensus.cc:3060] T a1704639a875409b9959353527b3fd68 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:15.727330 11198 consensus_queue.cc:260] T 427c124d773f483294511e80fe340075 P b7ab4784c7344b939bc36f639286f377 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } attrs { replace: true } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:20:15.753997 11010 raft_consensus.cc:2749] T 853ac0a8cbd64ce99457f170216d4d0f P ccd8a4c3bfe3413cb2ae219b09aea832 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:20:15.764624  6878 raft_consensus.cc:1240] T 853ac0a8cbd64ce99457f170216d4d0f P cd75a17ab2604397adab03bb8b5fd75c [term 9 LEADER]: Rejecting Update request from peer b7ab4784c7344b939bc36f639286f377 for earlier term 8. Current term is 9. Ops: []
I20260709 13:20:15.765647  7466 leader_election.cc:304] T 17587d6730594da4a56fa13a353232a1 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:20:15.751880 11132 raft_consensus.cc:697] T 427c124d773f483294511e80fe340075 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 10 LEADER]: Becoming Leader. State: Replica: 7ba59cc884714e8aa5f3f0ecaed84cbb, State: Running, Role: LEADER
I20260709 13:20:15.771596  6872 raft_consensus.cc:1275] T 8c7f33e544204fbaac4078e3e83bbf4e P cd75a17ab2604397adab03bb8b5fd75c [term 9 FOLLOWER]: Refusing update from remote peer ccd8a4c3bfe3413cb2ae219b09aea832: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:20:15.735365 10818 consensus_queue.cc:1059] T e31b9971c15848dea59d4d4130141d9e P b7ab4784c7344b939bc36f639286f377 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.028s
I20260709 13:20:15.760160 11051 leader_election.cc:290] T d8cee0accdb8499c86d4414b72565a38 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 12 election: Requested vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:20:15.747943 11186 consensus_queue.cc:1048] T d8292e16e5654be6bc408560cf256aaa P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.022s
I20260709 13:20:15.739297 10938 raft_consensus.cc:515] T a1704639a875409b9959353527b3fd68 P b7ab4784c7344b939bc36f639286f377 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
W20260709 13:20:15.788601  6697 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 45216.5us
I20260709 13:20:15.808091  6874 raft_consensus.cc:2468] T 7c44c4849aa54f2b94d1f1bef9ed546f P cd75a17ab2604397adab03bb8b5fd75c [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 14.
I20260709 13:20:15.814361  6726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34f36d59d88f40fe8a2805e604fc6c0a" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:15.812386  6772 leader_election.cc:304] T ce4f062dcd314d43a63ca74067cb5ee3 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:20:15.820457  6725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab432e62819d499eaaf3dd55481dd930" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:15.765046 10708 consensus_queue.cc:1059] T f09c2a98de1a4decabd0ff900dd44caa P b7ab4784c7344b939bc36f639286f377 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.052s
I20260709 13:20:15.825511  6726 raft_consensus.cc:2368] T 34f36d59d88f40fe8a2805e604fc6c0a P ccd8a4c3bfe3413cb2ae219b09aea832 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c for earlier term 8. Current term is 9.
I20260709 13:20:15.817863 11092 raft_consensus.cc:493] T dbdf895bba214ff68685a24fd17dfb5d P cd75a17ab2604397adab03bb8b5fd75c [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:20:15.829403  6772 leader_election.cc:304] T 3d65025eea89441290d85dd053810e31 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:20:15.833841  6772 leader_election.cc:304] T 711ef6523deb4cbe8ef2ba61e1c21c98 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:20:15.823678 11051 raft_consensus.cc:493] T 4d9def8b32fd443aa94ab1420b06837b P cd75a17ab2604397adab03bb8b5fd75c [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:15.835237  6723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e31b9971c15848dea59d4d4130141d9e" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:20:15.828106 11061 raft_consensus.cc:2804] T ce4f062dcd314d43a63ca74067cb5ee3 P b7ab4784c7344b939bc36f639286f377 [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 13:20:15.838331 11241 log.cc:927] Time spent T fe20b4b48823486ca3b9c648db6ce8aa P 7ba59cc884714e8aa5f3f0ecaed84cbb: Append to log took a long time: real 0.080s	user 0.000s	sys 0.001s
I20260709 13:20:15.835223 11092 raft_consensus.cc:515] T dbdf895bba214ff68685a24fd17dfb5d P cd75a17ab2604397adab03bb8b5fd75c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
W20260709 13:20:15.838842 11243 log.cc:927] Time spent T 22ccee1b570c4ad3a57bd7aec085b1b4 P cd75a17ab2604397adab03bb8b5fd75c: Append to log took a long time: real 0.086s	user 0.001s	sys 0.000s
I20260709 13:20:15.837297 11117 raft_consensus.cc:2804] T 3d65025eea89441290d85dd053810e31 P b7ab4784c7344b939bc36f639286f377 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:20:15.840104 11246 raft_consensus.cc:2749] T 17587d6730594da4a56fa13a353232a1 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
W20260709 13:20:15.841269 11227 log.cc:927] Time spent T 17587d6730594da4a56fa13a353232a1 P ccd8a4c3bfe3413cb2ae219b09aea832: Append to log took a long time: real 0.438s	user 0.004s	sys 0.000s
I20260709 13:20:15.841687  6697 leader_election.cc:304] T ce4f062dcd314d43a63ca74067cb5ee3 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:20:15.842293 11010 consensus_queue.cc:1048] T 3d65025eea89441290d85dd053810e31 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
W20260709 13:20:15.843281  7468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 106091us
I20260709 13:20:15.843613 10969 raft_consensus.cc:2804] T 711ef6523deb4cbe8ef2ba61e1c21c98 P b7ab4784c7344b939bc36f639286f377 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:20:15.846588  6724 raft_consensus.cc:1240] T bb3d8792045a4583ae2e965b1350a5b4 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 10 FOLLOWER]: Rejecting Update request from peer cd75a17ab2604397adab03bb8b5fd75c for earlier term 9. Current term is 10. Ops: []
I20260709 13:20:15.848773  6725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4b8bd455d5a47c18a1380839c6e0d61" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:20:15.850492  6728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b8cacb381b746da8d0049b0a83b41dd" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:20:15.851414  6726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c37d41cd9164c15a6826ca62a851a69" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:15.866797  6725 raft_consensus.cc:3060] T f4b8bd455d5a47c18a1380839c6e0d61 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:20:15.855825  6875 raft_consensus.cc:2468] T 34f36d59d88f40fe8a2805e604fc6c0a P cd75a17ab2604397adab03bb8b5fd75c [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 9.
I20260709 13:20:15.856534 10938 leader_election.cc:290] T a1704639a875409b9959353527b3fd68 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 13 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:15.860203  6723 raft_consensus.cc:3060] T e31b9971c15848dea59d4d4130141d9e P ccd8a4c3bfe3413cb2ae219b09aea832 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:20:15.860395 11132 consensus_queue.cc:237] T 427c124d773f483294511e80fe340075 P 7ba59cc884714e8aa5f3f0ecaed84cbb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 10, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } attrs { replace: true } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:20:15.861682  6730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6869f07b5a4885a0b99fbe60c3b175" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:15.828496 11249 consensus_queue.cc:1048] T fe20b4b48823486ca3b9c648db6ce8aa P 7ba59cc884714e8aa5f3f0ecaed84cbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.030s
I20260709 13:20:15.851960 11061 raft_consensus.cc:493] T ce4f062dcd314d43a63ca74067cb5ee3 P b7ab4784c7344b939bc36f639286f377 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:15.850955 10708 consensus_queue.cc:1243] T f09c2a98de1a4decabd0ff900dd44caa P b7ab4784c7344b939bc36f639286f377 [LEADER]: Peer cd75a17ab2604397adab03bb8b5fd75c log is divergent from this leader: its last log entry 13.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 13:20:15.875512  6728 raft_consensus.cc:3060] T 4b8cacb381b746da8d0049b0a83b41dd P ccd8a4c3bfe3413cb2ae219b09aea832 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:15.870057  6731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f58dc08b12a2494bb9a1372837970ca2" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:15.876833  6732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a485a995abc4807b6e511e45419f737" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:15.877038  6731 raft_consensus.cc:2468] T f58dc08b12a2494bb9a1372837970ca2 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 14.
W20260709 13:20:15.877255  7466 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 61904.2us
I20260709 13:20:15.877588  6732 raft_consensus.cc:2468] T 3a485a995abc4807b6e511e45419f737 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 11.
I20260709 13:20:15.878186  7466 leader_election.cc:304] T bb3d8792045a4583ae2e965b1350a5b4 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:20:15.863736 11117 raft_consensus.cc:493] T 3d65025eea89441290d85dd053810e31 P b7ab4784c7344b939bc36f639286f377 [term 10 FOLLOWER]: Starting leader election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
W20260709 13:20:15.886425  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 123939us
I20260709 13:20:15.882920  7468 leader_election.cc:304] T 3fa34c08b205435dba97346991aa1f92 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:20:15.874739 11061 raft_consensus.cc:3060] T ce4f062dcd314d43a63ca74067cb5ee3 P b7ab4784c7344b939bc36f639286f377 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:20:15.891971  6772 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 58210.5us
I20260709 13:20:15.900086  6772 leader_election.cc:304] T bb7fa124c3bf4ef9ab65a407cb008441 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
W20260709 13:20:15.900533  6695 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:15.895015 11092 leader_election.cc:290] T dbdf895bba214ff68685a24fd17dfb5d P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:20:15.896234 11033 raft_consensus.cc:3060] T ce4f062dcd314d43a63ca74067cb5ee3 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:20:15.898677  6807 raft_consensus.cc:3060] T bd6869f07b5a4885a0b99fbe60c3b175 P b7ab4784c7344b939bc36f639286f377 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:20:15.870007 11051 raft_consensus.cc:515] T 4d9def8b32fd443aa94ab1420b06837b P cd75a17ab2604397adab03bb8b5fd75c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:15.875041 10969 raft_consensus.cc:697] T 711ef6523deb4cbe8ef2ba61e1c21c98 P b7ab4784c7344b939bc36f639286f377 [term 13 LEADER]: Becoming Leader. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
I20260709 13:20:15.905191  6731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bf4668eeb70467fb3dc5a0289233b3c" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:15.906906  6730 raft_consensus.cc:1240] T c4db81d9d329422bb3b4160ca4ac2d1d P ccd8a4c3bfe3413cb2ae219b09aea832 [term 11 FOLLOWER]: Rejecting Update request from peer cd75a17ab2604397adab03bb8b5fd75c for earlier term 10. Current term is 11. Ops: []
I20260709 13:20:15.909178  6732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b56bf91d90824c959e21e0cee5ba1816" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:15.909858  6732 raft_consensus.cc:2468] T b56bf91d90824c959e21e0cee5ba1816 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 11.
I20260709 13:20:15.884202 11117 raft_consensus.cc:3060] T 3d65025eea89441290d85dd053810e31 P b7ab4784c7344b939bc36f639286f377 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:20:15.888533 11246 raft_consensus.cc:2804] T bb3d8792045a4583ae2e965b1350a5b4 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:20:15.907117 11124 raft_consensus.cc:493] T 7887766dc6784fcaa42b35c05fea7a99 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:15.921770  6877 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53406 (request call id 2128) took 1373 ms. Trace:
I20260709 13:20:15.919904  6724 raft_consensus.cc:1275] T f09c2a98de1a4decabd0ff900dd44caa P ccd8a4c3bfe3413cb2ae219b09aea832 [term 13 FOLLOWER]: Refusing update from remote peer cd75a17ab2604397adab03bb8b5fd75c: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:20:15.926569 10938 raft_consensus.cc:493] T de3186201e1a40d0b335eeb8b4e256e0 P b7ab4784c7344b939bc36f639286f377 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:15.930591  6731 raft_consensus.cc:2393] T 1bf4668eeb70467fb3dc5a0289233b3c P ccd8a4c3bfe3413cb2ae219b09aea832 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c in current term 12: Already voted for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in this term.
I20260709 13:20:15.930733  6728 raft_consensus.cc:2468] T 4b8cacb381b746da8d0049b0a83b41dd P ccd8a4c3bfe3413cb2ae219b09aea832 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 13.
I20260709 13:20:15.944404 11170 raft_consensus.cc:3055] T e31b9971c15848dea59d4d4130141d9e P b7ab4784c7344b939bc36f639286f377 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:20:15.945015 11170 raft_consensus.cc:740] T e31b9971c15848dea59d4d4130141d9e P b7ab4784c7344b939bc36f639286f377 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
I20260709 13:20:15.946183 11170 consensus_queue.cc:260] T e31b9971c15848dea59d4d4130141d9e P b7ab4784c7344b939bc36f639286f377 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
W20260709 13:20:15.955663  6696 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:15.957695  6799 raft_consensus.cc:1240] T 30e88460611e47b2ba16a46a30b5f416 P b7ab4784c7344b939bc36f639286f377 [term 10 FOLLOWER]: Rejecting Update request from peer ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 9. Current term is 10. Ops: []
I20260709 13:20:15.958869 10983 leader_election.cc:290] T dbdf895bba214ff68685a24fd17dfb5d P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:15.958954  6804 raft_consensus.cc:1240] T a1704639a875409b9959353527b3fd68 P b7ab4784c7344b939bc36f639286f377 [term 13 FOLLOWER]: Rejecting Update request from peer ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 12. Current term is 13. Ops: []
I20260709 13:20:15.931973 11124 raft_consensus.cc:515] T 7887766dc6784fcaa42b35c05fea7a99 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:16.014258 11124 leader_election.cc:290] T 7887766dc6784fcaa42b35c05fea7a99 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:15.924274 11246 raft_consensus.cc:697] T bb3d8792045a4583ae2e965b1350a5b4 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 10 LEADER]: Becoming Leader. State: Replica: 7ba59cc884714e8aa5f3f0ecaed84cbb, State: Running, Role: LEADER
I20260709 13:20:15.963194 11240 raft_consensus.cc:2804] T 3fa34c08b205435dba97346991aa1f92 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:20:15.934916 11172 raft_consensus.cc:493] T 713b5728a197487c9300b310ab94e5a3 P b7ab4784c7344b939bc36f639286f377 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:20:16.016498 11240 raft_consensus.cc:697] T 3fa34c08b205435dba97346991aa1f92 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 14 LEADER]: Becoming Leader. State: Replica: 7ba59cc884714e8aa5f3f0ecaed84cbb, State: Running, Role: LEADER
I20260709 13:20:16.016656 11172 raft_consensus.cc:515] T 713b5728a197487c9300b310ab94e5a3 P b7ab4784c7344b939bc36f639286f377 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:16.017630 11240 consensus_queue.cc:237] T 3fa34c08b205435dba97346991aa1f92 P 7ba59cc884714e8aa5f3f0ecaed84cbb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:20:16.019366 11246 consensus_queue.cc:237] T bb3d8792045a4583ae2e965b1350a5b4 P 7ba59cc884714e8aa5f3f0ecaed84cbb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:20:16.021521  6801 raft_consensus.cc:1275] T 9e326172347f45e99a0d482b5d8ef768 P b7ab4784c7344b939bc36f639286f377 [term 11 FOLLOWER]: Refusing update from remote peer ccd8a4c3bfe3413cb2ae219b09aea832: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:20:16.024605  6802 raft_consensus.cc:1275] T 90d42e216d9741e190bca19a781291fd P b7ab4784c7344b939bc36f639286f377 [term 11 FOLLOWER]: Refusing update from remote peer ccd8a4c3bfe3413cb2ae219b09aea832: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
W20260709 13:20:15.965462 11233 log.cc:927] Time spent T 4275cf08e63345f993bce8664eada830 P cd75a17ab2604397adab03bb8b5fd75c: Append to log took a long time: real 0.361s	user 0.002s	sys 0.000s
I20260709 13:20:15.966429 11211 raft_consensus.cc:493] T 95a75bfe094d4bdc963aba3f08dfcd25 P b7ab4784c7344b939bc36f639286f377 [term 11 FOLLOWER]: Starting leader election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
W20260709 13:20:15.974352 11234 log.cc:927] Time spent T 4f00a2e87e56452083b759f60d461ee3 P 7ba59cc884714e8aa5f3f0ecaed84cbb: Append to log took a long time: real 0.565s	user 0.003s	sys 0.000s
I20260709 13:20:15.947762 11170 raft_consensus.cc:3060] T e31b9971c15848dea59d4d4130141d9e P b7ab4784c7344b939bc36f639286f377 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:20:15.997170  6800 raft_consensus.cc:1240] T 9b3759de40694069b13c0f8bd40e5709 P b7ab4784c7344b939bc36f639286f377 [term 11 LEADER]: Rejecting Update request from peer ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 10. Current term is 11. Ops: []
I20260709 13:20:16.001523  6725 raft_consensus.cc:2468] T f4b8bd455d5a47c18a1380839c6e0d61 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 11.
I20260709 13:20:16.002305  6723 raft_consensus.cc:2468] T e31b9971c15848dea59d4d4130141d9e P ccd8a4c3bfe3413cb2ae219b09aea832 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 10.
W20260709 13:20:16.005992  6773 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:16.052651  6874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1704639a875409b9959353527b3fd68" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:20:15.924497  6877 rpcz_store.cc:276] 0709 13:20:14.548862 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:15.215956 (+667094us) service_pool.cc:224] Handling call
0709 13:20:15.356715 (+140759us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:15.513737 (+157022us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:15.513779 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:20:15.529361 (+ 15582us) log.cc:844] Serialized 26 byte log entry
0709 13:20:15.629799 (+100438us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:20:15.630188 (+   389us) log.cc:844] Serialized 14 byte log entry
0709 13:20:15.630576 (+   388us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:15.630627 (+    51us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:15.921329 (+290702us) raft_consensus.cc:1685] finished
0709 13:20:15.921352 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:15.921531 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":210,"prepare.run_cpu_time_us":33,"prepare.run_wall_time_us":35,"raft.queue_time_us":67765,"raft.run_cpu_time_us":318,"raft.run_wall_time_us":5349,"thread_start_us":99038,"threads_started":1,"wal-append.queue_time_us":161539}
W20260709 13:20:16.033949  6697 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 152534us
I20260709 13:20:16.019619 11172 leader_election.cc:290] T 713b5728a197487c9300b310ab94e5a3 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:15.934145 10938 raft_consensus.cc:515] T de3186201e1a40d0b335eeb8b4e256e0 P b7ab4784c7344b939bc36f639286f377 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:16.051506  6875 raft_consensus.cc:1240] T 44bde925b2e541b69890d70715b85176 P cd75a17ab2604397adab03bb8b5fd75c [term 13 FOLLOWER]: Rejecting Update request from peer b7ab4784c7344b939bc36f639286f377 for earlier term 12. Current term is 13. Ops: [12.8-12.8]
I20260709 13:20:15.924206 11198 raft_consensus.cc:3060] T 427c124d773f483294511e80fe340075 P b7ab4784c7344b939bc36f639286f377 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:20:16.053798  6874 raft_consensus.cc:2393] T a1704639a875409b9959353527b3fd68 P cd75a17ab2604397adab03bb8b5fd75c [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate b7ab4784c7344b939bc36f639286f377 in current term 13: Already voted for candidate cd75a17ab2604397adab03bb8b5fd75c in this term.
I20260709 13:20:15.938366 10989 raft_consensus.cc:493] T 7a734b5ab7834e05a8c422208acc58b1 P b7ab4784c7344b939bc36f639286f377 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:16.065593  6801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4db81d9d329422bb3b4160ca4ac2d1d" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:20:16.004501 11051 leader_election.cc:290] T 4d9def8b32fd443aa94ab1420b06837b P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:20:16.068998  6804 raft_consensus.cc:1275] T f5be3a11b23d4ea9b08300a2789821c7 P b7ab4784c7344b939bc36f639286f377 [term 10 FOLLOWER]: Refusing update from remote peer ccd8a4c3bfe3413cb2ae219b09aea832: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
W20260709 13:20:16.072201  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 74083.9us
I20260709 13:20:16.080313  6802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4b8bd455d5a47c18a1380839c6e0d61" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:20:16.037433 11211 raft_consensus.cc:3060] T 95a75bfe094d4bdc963aba3f08dfcd25 P b7ab4784c7344b939bc36f639286f377 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:20:16.086292  7503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8cee0accdb8499c86d4414b72565a38" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb"
I20260709 13:20:16.087545  7503 raft_consensus.cc:3060] T d8cee0accdb8499c86d4414b72565a38 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:20:16.089676  6801 raft_consensus.cc:3060] T c4db81d9d329422bb3b4160ca4ac2d1d P b7ab4784c7344b939bc36f639286f377 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:20:16.090258  6697 leader_election.cc:400] T 3fa34c08b205435dba97346991aa1f92 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 13 pre-election: Vote denied by peer cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931) with higher term. Message: Invalid argument: T 3fa34c08b205435dba97346991aa1f92 P cd75a17ab2604397adab03bb8b5fd75c [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 13. Current term is 14.
I20260709 13:20:16.090557  6697 leader_election.cc:403] T 3fa34c08b205435dba97346991aa1f92 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 13 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:20:16.098563  6804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b56bf91d90824c959e21e0cee5ba1816" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:16.095966  6800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "711ef6523deb4cbe8ef2ba61e1c21c98" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:20:16.122851  6805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbdf895bba214ff68685a24fd17dfb5d" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 11 candidate_status { last_received { term: 10 index: 4 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:16.138831  7495 raft_consensus.cc:1275] T 24ee15416e3145beaa1b8183453729a3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 13 FOLLOWER]: Refusing update from remote peer cd75a17ab2604397adab03bb8b5fd75c: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:20:16.142047  6804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d33d5ee8ef6f415593d8df52063161ad" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:16.153138  6697 leader_election.cc:400] T f4b8bd455d5a47c18a1380839c6e0d61 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 10 pre-election: Vote denied by peer cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931) with higher term. Message: Invalid argument: T f4b8bd455d5a47c18a1380839c6e0d61 P cd75a17ab2604397adab03bb8b5fd75c [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 10. Current term is 11.
I20260709 13:20:16.086372 10989 raft_consensus.cc:515] T 7a734b5ab7834e05a8c422208acc58b1 P b7ab4784c7344b939bc36f639286f377 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:16.128371 11124 raft_consensus.cc:2749] T 3fa34c08b205435dba97346991aa1f92 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 14 FOLLOWER]: Leader pre-election lost for term 13. Reason: Vote denied by peer cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931) with higher term. Message: Invalid argument: T 3fa34c08b205435dba97346991aa1f92 P cd75a17ab2604397adab03bb8b5fd75c [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 13. Current term is 14.
W20260709 13:20:16.178843  6695 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:16.182976  6804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4275cf08e63345f993bce8664eada830" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 13 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
W20260709 13:20:16.211036  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 81841.4us
I20260709 13:20:16.216249  6805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22ccee1b570c4ad3a57bd7aec085b1b4" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:16.221202  6697 leader_election.cc:304] T 44bde925b2e541b69890d70715b85176 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377
I20260709 13:20:16.135368 11252 raft_consensus.cc:2804] T bb7fa124c3bf4ef9ab65a407cb008441 P b7ab4784c7344b939bc36f639286f377 [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 13:20:16.189010 11233 log.cc:927] Time spent T 4275cf08e63345f993bce8664eada830 P cd75a17ab2604397adab03bb8b5fd75c: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 13:20:16.232020  6800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a485a995abc4807b6e511e45419f737" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:16.168188 11033 raft_consensus.cc:2749] T ce4f062dcd314d43a63ca74067cb5ee3 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:20:16.164940 10989 leader_election.cc:290] T 7a734b5ab7834e05a8c422208acc58b1 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:16.175659 10708 raft_consensus.cc:493] T 7887766dc6784fcaa42b35c05fea7a99 P b7ab4784c7344b939bc36f639286f377 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:16.231144 11252 raft_consensus.cc:493] T bb7fa124c3bf4ef9ab65a407cb008441 P b7ab4784c7344b939bc36f639286f377 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:16.110512 10969 consensus_queue.cc:237] T 711ef6523deb4cbe8ef2ba61e1c21c98 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:16.171590 11051 consensus_queue.cc:1048] T 24ee15416e3145beaa1b8183453729a3 P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.073s
I20260709 13:20:16.260233  6804 raft_consensus.cc:1275] T 8c7f33e544204fbaac4078e3e83bbf4e P b7ab4784c7344b939bc36f639286f377 [term 9 FOLLOWER]: Refusing update from remote peer ccd8a4c3bfe3413cb2ae219b09aea832: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:20:16.260031  6803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5be3a11b23d4ea9b08300a2789821c7" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:16.188514 11010 consensus_queue.cc:1048] T 90d42e216d9741e190bca19a781291fd P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.057s
I20260709 13:20:16.237465 10818 raft_consensus.cc:3055] T f09c2a98de1a4decabd0ff900dd44caa P b7ab4784c7344b939bc36f639286f377 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:20:16.176965 11061 raft_consensus.cc:515] T ce4f062dcd314d43a63ca74067cb5ee3 P b7ab4784c7344b939bc36f639286f377 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } attrs { replace: true } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:20:16.259287  6844 leader_election.cc:304] T a3022224cc81473690653a83d4e99470 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:20:16.278576  6803 raft_consensus.cc:2393] T f5be3a11b23d4ea9b08300a2789821c7 P b7ab4784c7344b939bc36f639286f377 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c in current term 10: Already voted for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in this term.
I20260709 13:20:16.296967  6803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44bde925b2e541b69890d70715b85176" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:16.298539  6803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3022224cc81473690653a83d4e99470" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:16.300284  6880 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53416 (request call id 2903) took 1712 ms. Trace:
I20260709 13:20:16.301354  6803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d65025eea89441290d85dd053810e31" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 11 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:16.300954  6880 rpcz_store.cc:276] 0709 13:20:14.553329 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:15.290144 (+736815us) service_pool.cc:224] Handling call
0709 13:20:15.330007 (+ 39863us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:15.330576 (+   569us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:15.330603 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:20:15.331168 (+   565us) log.cc:844] Serialized 26 byte log entry
0709 13:20:15.376138 (+ 44970us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:20:15.400016 (+ 23878us) log.cc:844] Serialized 14 byte log entry
0709 13:20:15.400659 (+   643us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:15.400743 (+    84us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:15.965297 (+564554us) spinlock_profiling.cc:243] Waited 3.75 ms on lock 0x7b20001b9478. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f558b91 00007fcc0f57aa19 00007fcc0f5458c3 00007fcc0f544bb6 00007fcc0f5447d8 00007fcc0f54e221 00007fcc0f54e1d9 00007fcc0f54e169 00007fcc0f54e131 00007fcc0f54d42d 000000000038f354
0709 13:20:16.261309 (+296012us) raft_consensus.cc:1685] finished
0709 13:20:16.265389 (+  4080us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:16.265544 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":15355,"prepare.run_cpu_time_us":40,"prepare.run_wall_time_us":43,"raft.queue_time_us":9646,"raft.run_cpu_time_us":277,"raft.run_wall_time_us":19352,"spinlock_wait_cycles":8628480,"thread_start_us":53293,"threads_started":2,"wal-append.queue_time_us":194142}
I20260709 13:20:16.308737 11258 raft_consensus.cc:493] T 3a485a995abc4807b6e511e45419f737 P b7ab4784c7344b939bc36f639286f377 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:20:16.271759 11038 consensus_meta.cc:287] T a1704639a875409b9959353527b3fd68 P ccd8a4c3bfe3413cb2ae219b09aea832: Time spent flushing consensus metadata: real 0.510s	user 0.014s	sys 0.002s
W20260709 13:20:16.318080  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 81626.1us
I20260709 13:20:16.261507 11252 raft_consensus.cc:3060] T bb7fa124c3bf4ef9ab65a407cb008441 P b7ab4784c7344b939bc36f639286f377 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:16.263823 10580 raft_consensus.cc:2804] T 44bde925b2e541b69890d70715b85176 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:20:16.313989  6804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7887766dc6784fcaa42b35c05fea7a99" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:16.316289  6802 raft_consensus.cc:2468] T f4b8bd455d5a47c18a1380839c6e0d61 P b7ab4784c7344b939bc36f639286f377 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 10.
I20260709 13:20:16.328514  6801 raft_consensus.cc:2468] T c4db81d9d329422bb3b4160ca4ac2d1d P b7ab4784c7344b939bc36f639286f377 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 11.
I20260709 13:20:16.309284 11167 consensus_queue.cc:1059] T bb3d8792045a4583ae2e965b1350a5b4 P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.180s
I20260709 13:20:16.318490  7503 raft_consensus.cc:2468] T d8cee0accdb8499c86d4414b72565a38 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 12.
I20260709 13:20:16.323447 11175 raft_consensus.cc:2764] T a3022224cc81473690653a83d4e99470 P cd75a17ab2604397adab03bb8b5fd75c [term 13 FOLLOWER]: Leader pre-election decision vote started in defunct term 12: won
I20260709 13:20:16.265331 10818 raft_consensus.cc:740] T f09c2a98de1a4decabd0ff900dd44caa P b7ab4784c7344b939bc36f639286f377 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
I20260709 13:20:16.326531 10938 leader_election.cc:290] T de3186201e1a40d0b335eeb8b4e256e0 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:16.247293 10708 raft_consensus.cc:515] T 7887766dc6784fcaa42b35c05fea7a99 P b7ab4784c7344b939bc36f639286f377 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:16.253566 11118 raft_consensus.cc:493] T 07a92dd554674067a83a9cb68c4773f2 P b7ab4784c7344b939bc36f639286f377 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
W20260709 13:20:16.334998  6697 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 80442.9us
I20260709 13:20:16.331789  6844 leader_election.cc:304] T de3186201e1a40d0b335eeb8b4e256e0 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:20:16.336656  6697 leader_election.cc:304] T 34f36d59d88f40fe8a2805e604fc6c0a P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:20:16.335521  6805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f03d0dbf16864ca4bc1bb5e4c0334c0f" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:20:16.337447  6801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4b8bd455d5a47c18a1380839c6e0d61" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:16.338616  6801 raft_consensus.cc:2468] T f4b8bd455d5a47c18a1380839c6e0d61 P b7ab4784c7344b939bc36f639286f377 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 10.
W20260709 13:20:16.420576  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 88892.8us
I20260709 13:20:16.334275  6695 leader_election.cc:304] T 7c44c4849aa54f2b94d1f1bef9ed546f P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
I20260709 13:20:16.422096  6772 leader_election.cc:304] T 90d42e216d9741e190bca19a781291fd P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:20:16.451932  6846 leader_election.cc:304] T d8cee0accdb8499c86d4414b72565a38 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:20:16.451835  6772 leader_election.cc:304] T d8292e16e5654be6bc408560cf256aaa P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:20:16.457631  6880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "713b5728a197487c9300b310ab94e5a3" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:16.460920  6874 raft_consensus.cc:1275] T f58dc08b12a2494bb9a1372837970ca2 P cd75a17ab2604397adab03bb8b5fd75c [term 14 FOLLOWER]: Refusing update from remote peer b7ab4784c7344b939bc36f639286f377: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:20:16.333985 11265 raft_consensus.cc:493] T 8c7f33e544204fbaac4078e3e83bbf4e P b7ab4784c7344b939bc36f639286f377 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:16.465564  6879 raft_consensus.cc:1240] T d8cee0accdb8499c86d4414b72565a38 P cd75a17ab2604397adab03bb8b5fd75c [term 12 FOLLOWER]: Rejecting Update request from peer b7ab4784c7344b939bc36f639286f377 for earlier term 11. Current term is 12. Ops: []
I20260709 13:20:16.465958  6876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a734b5ab7834e05a8c422208acc58b1" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 13 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:16.467547  6804 raft_consensus.cc:2468] T 7887766dc6784fcaa42b35c05fea7a99 P b7ab4784c7344b939bc36f639286f377 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 12.
I20260709 13:20:16.465497 10938 raft_consensus.cc:2804] T d8292e16e5654be6bc408560cf256aaa P b7ab4784c7344b939bc36f639286f377 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:20:16.471343 10580 raft_consensus.cc:697] T 44bde925b2e541b69890d70715b85176 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 13 LEADER]: Becoming Leader. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
I20260709 13:20:16.471593 10938 raft_consensus.cc:493] T d8292e16e5654be6bc408560cf256aaa P b7ab4784c7344b939bc36f639286f377 [term 15 FOLLOWER]: Starting leader election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:20:16.472172 10938 raft_consensus.cc:3060] T d8292e16e5654be6bc408560cf256aaa P b7ab4784c7344b939bc36f639286f377 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:16.472659 10580 consensus_queue.cc:237] T 44bde925b2e541b69890d70715b85176 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:16.474541  6880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de3186201e1a40d0b335eeb8b4e256e0" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
W20260709 13:20:16.476862  6771 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:16.473027 11061 leader_election.cc:290] T ce4f062dcd314d43a63ca74067cb5ee3 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 12 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:20:16.485919 11167 raft_consensus.cc:2804] T d8cee0accdb8499c86d4414b72565a38 P cd75a17ab2604397adab03bb8b5fd75c [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:20:16.486689 11167 raft_consensus.cc:697] T d8cee0accdb8499c86d4414b72565a38 P cd75a17ab2604397adab03bb8b5fd75c [term 12 LEADER]: Becoming Leader. State: Replica: cd75a17ab2604397adab03bb8b5fd75c, State: Running, Role: LEADER
I20260709 13:20:16.488155 11167 consensus_queue.cc:237] T d8cee0accdb8499c86d4414b72565a38 P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:20:16.492558 11139 raft_consensus.cc:2804] T de3186201e1a40d0b335eeb8b4e256e0 P cd75a17ab2604397adab03bb8b5fd75c [term 13 FOLLOWER]: Leader election won for term 13
W20260709 13:20:16.493064  6695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 158851us
I20260709 13:20:16.493505 11139 raft_consensus.cc:697] T de3186201e1a40d0b335eeb8b4e256e0 P cd75a17ab2604397adab03bb8b5fd75c [term 13 LEADER]: Becoming Leader. State: Replica: cd75a17ab2604397adab03bb8b5fd75c, State: Running, Role: LEADER
I20260709 13:20:16.494364  6805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e31b9971c15848dea59d4d4130141d9e" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:16.494983 11139 consensus_queue.cc:237] T de3186201e1a40d0b335eeb8b4e256e0 P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:16.501796 11126 raft_consensus.cc:2804] T 7c44c4849aa54f2b94d1f1bef9ed546f P ccd8a4c3bfe3413cb2ae219b09aea832 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:20:16.502782 11126 raft_consensus.cc:697] T 7c44c4849aa54f2b94d1f1bef9ed546f P ccd8a4c3bfe3413cb2ae219b09aea832 [term 14 LEADER]: Becoming Leader. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
I20260709 13:20:16.328480 11258 raft_consensus.cc:515] T 3a485a995abc4807b6e511e45419f737 P b7ab4784c7344b939bc36f639286f377 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:16.503782 11126 consensus_queue.cc:237] T 7c44c4849aa54f2b94d1f1bef9ed546f P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:16.504580 10938 raft_consensus.cc:515] T d8292e16e5654be6bc408560cf256aaa P b7ab4784c7344b939bc36f639286f377 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:16.511317 11170 consensus_queue.cc:1059] T 853ac0a8cbd64ce99457f170216d4d0f P b7ab4784c7344b939bc36f639286f377 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
W20260709 13:20:16.510075 11040 consensus_meta.cc:287] T 7c37d41cd9164c15a6826ca62a851a69 P ccd8a4c3bfe3413cb2ae219b09aea832: Time spent flushing consensus metadata: real 0.828s	user 0.010s	sys 0.006s
I20260709 13:20:16.509924  6772 leader_election.cc:304] T 34f36d59d88f40fe8a2805e604fc6c0a P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:20:16.514899 10938 leader_election.cc:290] T d8292e16e5654be6bc408560cf256aaa P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 16 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:16.468955 10983 raft_consensus.cc:2749] T 34f36d59d88f40fe8a2805e604fc6c0a P ccd8a4c3bfe3413cb2ae219b09aea832 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:20:16.425014 11118 raft_consensus.cc:515] T 07a92dd554674067a83a9cb68c4773f2 P b7ab4784c7344b939bc36f639286f377 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
W20260709 13:20:16.516669  6697 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 180233us
W20260709 13:20:16.518217 11117 consensus_meta.cc:287] T 3d65025eea89441290d85dd053810e31 P b7ab4784c7344b939bc36f639286f377: Time spent flushing consensus metadata: real 0.597s	user 0.012s	sys 0.000s
W20260709 13:20:16.518306 11097 consensus_meta.cc:287] T 1bf4668eeb70467fb3dc5a0289233b3c P b7ab4784c7344b939bc36f639286f377: Time spent flushing consensus metadata: real 0.902s	user 0.013s	sys 0.000s
I20260709 13:20:16.461335 11172 raft_consensus.cc:2804] T 90d42e216d9741e190bca19a781291fd P b7ab4784c7344b939bc36f639286f377 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:20:16.521706 10708 leader_election.cc:290] T 7887766dc6784fcaa42b35c05fea7a99 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:16.522636  6844 leader_election.cc:400] T 7c44c4849aa54f2b94d1f1bef9ed546f P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 13 pre-election: Vote denied by peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391) with higher term. Message: Invalid argument: T 7c44c4849aa54f2b94d1f1bef9ed546f P ccd8a4c3bfe3413cb2ae219b09aea832 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c for earlier term 13. Current term is 14.
I20260709 13:20:16.571630  6844 leader_election.cc:403] T 7c44c4849aa54f2b94d1f1bef9ed546f P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 13 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:20:16.523145  6800 raft_consensus.cc:2468] T 3a485a995abc4807b6e511e45419f737 P b7ab4784c7344b939bc36f639286f377 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 11.
I20260709 13:20:16.524492 11010 consensus_queue.cc:1059] T 7a734b5ab7834e05a8c422208acc58b1 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: INVALID_TERM, Last received: 9.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:20:16.525158 11265 raft_consensus.cc:515] T 8c7f33e544204fbaac4078e3e83bbf4e P b7ab4784c7344b939bc36f639286f377 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:16.525933  6876 raft_consensus.cc:2468] T 7a734b5ab7834e05a8c422208acc58b1 P cd75a17ab2604397adab03bb8b5fd75c [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 12.
I20260709 13:20:16.527657  6805 raft_consensus.cc:2410] T e31b9971c15848dea59d4d4130141d9e P b7ab4784c7344b939bc36f639286f377 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c for term 10 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 13:20:16.529422  6802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3411566abe2d4c9bb4b2adfdd05e6f17" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:20:16.530066  6803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "713b5728a197487c9300b310ab94e5a3" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:16.530421  6801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c240553ce044eedb41541d72b9475d7" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:16.542263  6725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c240553ce044eedb41541d72b9475d7" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:20:16.544531  6729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be1a92657f494cac8dd227d152f50151" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:16.545450  6723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c44c4849aa54f2b94d1f1bef9ed546f" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:16.546548  6730 raft_consensus.cc:1240] T f09c2a98de1a4decabd0ff900dd44caa P ccd8a4c3bfe3413cb2ae219b09aea832 [term 13 FOLLOWER]: Rejecting Update request from peer b7ab4784c7344b939bc36f639286f377 for earlier term 12. Current term is 13. Ops: []
I20260709 13:20:16.548122  6728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77e330a82df4b43a745d57a68f6f057" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 15 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:16.549149  6732 raft_consensus.cc:1240] T e31b9971c15848dea59d4d4130141d9e P ccd8a4c3bfe3413cb2ae219b09aea832 [term 10 FOLLOWER]: Rejecting Update request from peer b7ab4784c7344b939bc36f639286f377 for earlier term 9. Current term is 10. Ops: []
I20260709 13:20:16.550971  6727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "711ef6523deb4cbe8ef2ba61e1c21c98" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:16.580811  6727 raft_consensus.cc:2393] T 711ef6523deb4cbe8ef2ba61e1c21c98 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7ab4784c7344b939bc36f639286f377 in current term 13: Already voted for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in this term.
I20260709 13:20:16.551875  6731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e326172347f45e99a0d482b5d8ef768" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
W20260709 13:20:16.553982 11253 log.cc:927] Time spent T 2c240553ce044eedb41541d72b9475d7 P b7ab4784c7344b939bc36f639286f377: Append to log took a long time: real 0.302s	user 0.000s	sys 0.001s
I20260709 13:20:16.507354 11258 leader_election.cc:290] T 3a485a995abc4807b6e511e45419f737 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:16.584297  6697 leader_election.cc:304] T e31b9971c15848dea59d4d4130141d9e P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
W20260709 13:20:16.559866  6807 consensus_meta.cc:287] T bd6869f07b5a4885a0b99fbe60c3b175 P b7ab4784c7344b939bc36f639286f377: Time spent flushing consensus metadata: real 0.654s	user 0.010s	sys 0.000s
I20260709 13:20:16.566280  6726 raft_consensus.cc:2468] T 7c37d41cd9164c15a6826ca62a851a69 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 11.
W20260709 13:20:16.573897  6772 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 64087.1us
I20260709 13:20:16.569417 11117 raft_consensus.cc:515] T 3d65025eea89441290d85dd053810e31 P b7ab4784c7344b939bc36f639286f377 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
W20260709 13:20:16.602118 11268 log.cc:927] Time spent T bb3d8792045a4583ae2e965b1350a5b4 P 7ba59cc884714e8aa5f3f0ecaed84cbb: Append to log took a long time: real 0.091s	user 0.004s	sys 0.000s
I20260709 13:20:16.604138 10727 raft_consensus.cc:493] T 7c37d41cd9164c15a6826ca62a851a69 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:16.569761 11172 raft_consensus.cc:493] T 90d42e216d9741e190bca19a781291fd P b7ab4784c7344b939bc36f639286f377 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:16.570112 11170 consensus_queue.cc:1243] T 853ac0a8cbd64ce99457f170216d4d0f P b7ab4784c7344b939bc36f639286f377 [LEADER]: Peer cd75a17ab2604397adab03bb8b5fd75c log is divergent from this leader: its last log entry 9.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 13:20:16.609344  6730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b3759de40694069b13c0f8bd40e5709" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
W20260709 13:20:16.605268  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 141612us
I20260709 13:20:16.616012  6725 raft_consensus.cc:2468] T 2c240553ce044eedb41541d72b9475d7 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 13.
I20260709 13:20:16.643996  6803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c7f33e544204fbaac4078e3e83bbf4e" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:16.646677  6803 raft_consensus.cc:2410] T 8c7f33e544204fbaac4078e3e83bbf4e P b7ab4784c7344b939bc36f639286f377 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c for term 10 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 13:20:16.646741  6800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f00a2e87e56452083b759f60d461ee3" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 13 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:16.644410  6804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34f36d59d88f40fe8a2805e604fc6c0a" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:16.648305  6801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a92dd554674067a83a9cb68c4773f2" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:16.645151  6729 raft_consensus.cc:2468] T be1a92657f494cac8dd227d152f50151 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 13.
I20260709 13:20:16.644876  6725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "711ef6523deb4cbe8ef2ba61e1c21c98" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:20:16.650074  6802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "853ac0a8cbd64ce99457f170216d4d0f" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:20:16.650457  6725 raft_consensus.cc:2393] T 711ef6523deb4cbe8ef2ba61e1c21c98 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate b7ab4784c7344b939bc36f639286f377 in current term 13: Already voted for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in this term.
I20260709 13:20:16.650635  6728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4db81d9d329422bb3b4160ca4ac2d1d" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:16.651139  6807 raft_consensus.cc:1275] T bd6869f07b5a4885a0b99fbe60c3b175 P b7ab4784c7344b939bc36f639286f377 [term 12 FOLLOWER]: Refusing update from remote peer ccd8a4c3bfe3413cb2ae219b09aea832: Log matching property violated. Preceding OpId in replica: term: 11 index: 5. Preceding OpId from leader: term: 12 index: 6. (index mismatch)
I20260709 13:20:16.651540  6728 raft_consensus.cc:2393] T c4db81d9d329422bb3b4160ca4ac2d1d P ccd8a4c3bfe3413cb2ae219b09aea832 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7ab4784c7344b939bc36f639286f377 in current term 11: Already voted for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in this term.
I20260709 13:20:16.583591 10938 raft_consensus.cc:2804] T 34f36d59d88f40fe8a2805e604fc6c0a P b7ab4784c7344b939bc36f639286f377 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:20:16.657600  6723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a75bfe094d4bdc963aba3f08dfcd25" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:16.657691  6844 leader_election.cc:400] T 34f36d59d88f40fe8a2805e604fc6c0a P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 8 pre-election: Vote denied by peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391) with higher term. Message: Invalid argument: T 34f36d59d88f40fe8a2805e604fc6c0a P ccd8a4c3bfe3413cb2ae219b09aea832 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c for earlier term 8. Current term is 9.
I20260709 13:20:16.658751  6844 leader_election.cc:403] T 34f36d59d88f40fe8a2805e604fc6c0a P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 8 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:20:16.654392  6727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30e88460611e47b2ba16a46a30b5f416" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:20:16.661156  6732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8292e16e5654be6bc408560cf256aaa" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:16.665251  6731 raft_consensus.cc:1240] T 8c7f33e544204fbaac4078e3e83bbf4e P ccd8a4c3bfe3413cb2ae219b09aea832 [term 9 LEADER]: Rejecting Update request from peer b7ab4784c7344b939bc36f639286f377 for earlier term 8. Current term is 9. Ops: []
I20260709 13:20:16.612957 11066 raft_consensus.cc:2749] T 7c44c4849aa54f2b94d1f1bef9ed546f P cd75a17ab2604397adab03bb8b5fd75c [term 14 FOLLOWER]: Leader pre-election lost for term 13. Reason: Vote denied by peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391) with higher term. Message: Invalid argument: T 7c44c4849aa54f2b94d1f1bef9ed546f P ccd8a4c3bfe3413cb2ae219b09aea832 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c for earlier term 13. Current term is 14.
W20260709 13:20:16.646415 11198 consensus_meta.cc:287] T 427c124d773f483294511e80fe340075 P b7ab4784c7344b939bc36f639286f377: Time spent flushing consensus metadata: real 0.578s	user 0.011s	sys 0.001s
W20260709 13:20:16.688438 11166 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 12 current term: 12 is higher.
I20260709 13:20:16.688794  6728 raft_consensus.cc:1240] T 853ac0a8cbd64ce99457f170216d4d0f P ccd8a4c3bfe3413cb2ae219b09aea832 [term 9 FOLLOWER]: Rejecting Update request from peer b7ab4784c7344b939bc36f639286f377 for earlier term 8. Current term is 9. Ops: []
I20260709 13:20:16.670010  6730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3411566abe2d4c9bb4b2adfdd05e6f17" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:16.690973  6624 catalog_manager.cc:5697] T 427c124d773f483294511e80fe340075 P 7ba59cc884714e8aa5f3f0ecaed84cbb reported cstate change: term changed from 5 to 9, leader changed from 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68) to b7ab4784c7344b939bc36f639286f377 (127.5.126.66). New cstate: current_term: 9 leader_uuid: "b7ab4784c7344b939bc36f639286f377" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } attrs { replace: true } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } } }
I20260709 13:20:16.692601  6727 raft_consensus.cc:1275] T bb3d8792045a4583ae2e965b1350a5b4 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 10 FOLLOWER]: Refusing update from remote peer 7ba59cc884714e8aa5f3f0ecaed84cbb: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:20:16.692471 11059 consensus_queue.cc:1059] T d8cee0accdb8499c86d4414b72565a38 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:20:16.693717 11059 raft_consensus.cc:3055] T d8cee0accdb8499c86d4414b72565a38 P b7ab4784c7344b939bc36f639286f377 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:20:16.691740  6730 raft_consensus.cc:1240] T 4b8cacb381b746da8d0049b0a83b41dd P ccd8a4c3bfe3413cb2ae219b09aea832 [term 13 FOLLOWER]: Rejecting Update request from peer 7ba59cc884714e8aa5f3f0ecaed84cbb for earlier term 12. Current term is 13. Ops: []
I20260709 13:20:16.679922  6725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90d42e216d9741e190bca19a781291fd" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:16.681541  6807 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:32976 (request call id 2835) took 2463 ms. Trace:
I20260709 13:20:16.682626  6800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30e88460611e47b2ba16a46a30b5f416" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:16.682888  6803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20f6842e26174571996b8dea4151d4be" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:16.678421 10938 raft_consensus.cc:697] T 34f36d59d88f40fe8a2805e604fc6c0a P b7ab4784c7344b939bc36f639286f377 [term 9 LEADER]: Becoming Leader. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
I20260709 13:20:16.584517 10818 consensus_queue.cc:260] T f09c2a98de1a4decabd0ff900dd44caa P b7ab4784c7344b939bc36f639286f377 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:16.653077 11040 raft_consensus.cc:3055] T 7a734b5ab7834e05a8c422208acc58b1 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:20:16.684180  6801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ba5dac66ab5497e9e336f2a3c28cda5" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:16.684296  6723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d65025eea89441290d85dd053810e31" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 11 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
W20260709 13:20:16.686967 11211 consensus_meta.cc:287] T 95a75bfe094d4bdc963aba3f08dfcd25 P b7ab4784c7344b939bc36f639286f377: Time spent flushing consensus metadata: real 0.589s	user 0.009s	sys 0.000s
I20260709 13:20:16.687513  6729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce4f062dcd314d43a63ca74067cb5ee3" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:16.687724  6732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34f36d59d88f40fe8a2805e604fc6c0a" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:20:16.690275  6728 raft_consensus.cc:1275] T a3022224cc81473690653a83d4e99470 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 13 FOLLOWER]: Refusing update from remote peer b7ab4784c7344b939bc36f639286f377: Log matching property violated. Preceding OpId in replica: term: 12 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 13:20:16.691622  6772 leader_election.cc:304] T 7a734b5ab7834e05a8c422208acc58b1 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:20:16.645445 11172 raft_consensus.cc:3060] T 90d42e216d9741e190bca19a781291fd P b7ab4784c7344b939bc36f639286f377 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:20:16.697196  6807 rpcz_store.cc:276] 0709 13:20:14.217840 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:14.239643 (+ 21803us) service_pool.cc:224] Handling call
0709 13:20:14.240111 (+   468us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:15.561895 (+1321784us) spinlock_profiling.cc:243] Waited 107 ms on lock 0x7b5400313e20. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f921dc0 00007fcc0f9ac1c0 00007fcc0f9ad231 00007fcc0f9a9d8f 00007fcc0f9a983e 00007fcc1496e419 00007fcc0dee5bd4 00007fcc0dee5b62 00007fcc0dee5a91 00007fcc0dee5a0c
0709 13:20:15.898172 (+336277us) spinlock_profiling.cc:243] Waited 40.8 ms on lock 0x7b5400313e20. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f91fa1d 00007fcc0f9061a4 00007fcc0f988447 00007fcc0f9a0fe7 00007fcc0f9a27de 00007fcc0f9acb49 00007fcc0f9ad416 00007fcc0f9a9d8f 00007fcc0f9a983e 00007fcc1496e419
0709 13:20:16.651642 (+753470us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:16.681459 (+ 29817us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":339382528}
I20260709 13:20:16.701125  6802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d33d5ee8ef6f415593d8df52063161ad" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:16.668172 11010 raft_consensus.cc:2749] T e31b9971c15848dea59d4d4130141d9e P ccd8a4c3bfe3413cb2ae219b09aea832 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:20:16.694113 11059 raft_consensus.cc:740] T d8cee0accdb8499c86d4414b72565a38 P b7ab4784c7344b939bc36f639286f377 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
I20260709 13:20:16.700776  6844 leader_election.cc:304] T f58dc08b12a2494bb9a1372837970ca2 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:20:16.705156  6800 raft_consensus.cc:2393] T 30e88460611e47b2ba16a46a30b5f416 P b7ab4784c7344b939bc36f639286f377 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c in current term 10: Already voted for candidate b7ab4784c7344b939bc36f639286f377 in this term.
I20260709 13:20:16.708578  6732 raft_consensus.cc:2393] T 34f36d59d88f40fe8a2805e604fc6c0a P ccd8a4c3bfe3413cb2ae219b09aea832 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate b7ab4784c7344b939bc36f639286f377 in current term 9: Already voted for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in this term.
I20260709 13:20:16.708678  6729 raft_consensus.cc:2468] T ce4f062dcd314d43a63ca74067cb5ee3 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 11.
I20260709 13:20:16.712644  6844 leader_election.cc:304] T 3a485a995abc4807b6e511e45419f737 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:20:16.716552  7503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce4f062dcd314d43a63ca74067cb5ee3" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb"
I20260709 13:20:16.717222  7503 raft_consensus.cc:3060] T ce4f062dcd314d43a63ca74067cb5ee3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:20:16.717672  6772 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:16.705745  6698 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:16.720680  6697 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 136462us
I20260709 13:20:16.721768  6697 leader_election.cc:304] T f3f9c2e2bf644115957398fe4c9459db P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
W20260709 13:20:16.722138  6695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 207131us
I20260709 13:20:16.642681 10727 raft_consensus.cc:515] T 7c37d41cd9164c15a6826ca62a851a69 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:16.734310  6807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6869f07b5a4885a0b99fbe60c3b175" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:16.735351  6807 raft_consensus.cc:2468] T bd6869f07b5a4885a0b99fbe60c3b175 P b7ab4784c7344b939bc36f639286f377 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 12.
W20260709 13:20:16.738368  6770 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:16.707173 11040 raft_consensus.cc:740] T 7a734b5ab7834e05a8c422208acc58b1 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
I20260709 13:20:16.693315  6624 catalog_manager.cc:5697] T b3f13b31a1f84f0d89d007eadd57924c P 7ba59cc884714e8aa5f3f0ecaed84cbb reported cstate change: term changed from 5 to 11. New cstate: current_term: 11 leader_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:20:16.743939  6875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a485a995abc4807b6e511e45419f737" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:16.744580  6881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8292e16e5654be6bc408560cf256aaa" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:20:16.747118  6876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce4f062dcd314d43a63ca74067cb5ee3" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:20:16.747314  6877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7887766dc6784fcaa42b35c05fea7a99" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:16.694795 11258 consensus_queue.cc:1059] T 44bde925b2e541b69890d70715b85176 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.049s
I20260709 13:20:16.703164 11066 raft_consensus.cc:2749] T 34f36d59d88f40fe8a2805e604fc6c0a P cd75a17ab2604397adab03bb8b5fd75c [term 9 FOLLOWER]: Leader pre-election lost for term 8. Reason: Vote denied by peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391) with higher term. Message: Invalid argument: T 34f36d59d88f40fe8a2805e604fc6c0a P ccd8a4c3bfe3413cb2ae219b09aea832 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c for earlier term 8. Current term is 9.
I20260709 13:20:16.761394  6881 raft_consensus.cc:3060] T d8292e16e5654be6bc408560cf256aaa P cd75a17ab2604397adab03bb8b5fd75c [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:16.758605  6803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8cee0accdb8499c86d4414b72565a38" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:16.761991  6876 raft_consensus.cc:3060] T ce4f062dcd314d43a63ca74067cb5ee3 P cd75a17ab2604397adab03bb8b5fd75c [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:20:16.774649 11167 raft_consensus.cc:2804] T f58dc08b12a2494bb9a1372837970ca2 P cd75a17ab2604397adab03bb8b5fd75c [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:20:16.775307 11167 raft_consensus.cc:493] T f58dc08b12a2494bb9a1372837970ca2 P cd75a17ab2604397adab03bb8b5fd75c [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:16.775743 11167 raft_consensus.cc:3060] T f58dc08b12a2494bb9a1372837970ca2 P cd75a17ab2604397adab03bb8b5fd75c [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:16.725358 11198 raft_consensus.cc:2804] T 7a734b5ab7834e05a8c422208acc58b1 P b7ab4784c7344b939bc36f639286f377 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:20:16.764461  6875 raft_consensus.cc:2468] T 3a485a995abc4807b6e511e45419f737 P cd75a17ab2604397adab03bb8b5fd75c [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 10.
I20260709 13:20:16.777575 11198 raft_consensus.cc:493] T 7a734b5ab7834e05a8c422208acc58b1 P b7ab4784c7344b939bc36f639286f377 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:16.770179  6807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e326172347f45e99a0d482b5d8ef768" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:16.778280 11198 raft_consensus.cc:3060] T 7a734b5ab7834e05a8c422208acc58b1 P b7ab4784c7344b939bc36f639286f377 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:16.778754  6807 raft_consensus.cc:2468] T 9e326172347f45e99a0d482b5d8ef768 P b7ab4784c7344b939bc36f639286f377 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 11.
I20260709 13:20:16.780279  6807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de3186201e1a40d0b335eeb8b4e256e0" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: true dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:20:16.784461  6807 raft_consensus.cc:3060] T de3186201e1a40d0b335eeb8b4e256e0 P b7ab4784c7344b939bc36f639286f377 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:16.700698 10708 consensus_queue.cc:1048] T f58dc08b12a2494bb9a1372837970ca2 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.049s
I20260709 13:20:16.795045  6806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22ccee1b570c4ad3a57bd7aec085b1b4" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
W20260709 13:20:16.748827 11266 log.cc:927] Time spent T b3f13b31a1f84f0d89d007eadd57924c P ccd8a4c3bfe3413cb2ae219b09aea832: Append to log took a long time: real 0.241s	user 0.001s	sys 0.002s
I20260709 13:20:16.707792 11247 consensus_queue.cc:1048] T bb3d8792045a4583ae2e965b1350a5b4 P 7ba59cc884714e8aa5f3f0ecaed84cbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.046s
I20260709 13:20:16.712661 11211 raft_consensus.cc:515] T 95a75bfe094d4bdc963aba3f08dfcd25 P b7ab4784c7344b939bc36f639286f377 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:16.799135  6876 raft_consensus.cc:2468] T ce4f062dcd314d43a63ca74067cb5ee3 P cd75a17ab2604397adab03bb8b5fd75c [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 12.
I20260709 13:20:16.799813  6877 raft_consensus.cc:2468] T 7887766dc6784fcaa42b35c05fea7a99 P cd75a17ab2604397adab03bb8b5fd75c [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 12.
I20260709 13:20:16.812318  6731 raft_consensus.cc:1240] T 44bde925b2e541b69890d70715b85176 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 13 LEADER]: Rejecting Update request from peer b7ab4784c7344b939bc36f639286f377 for earlier term 12. Current term is 13. Ops: []
W20260709 13:20:16.799719 11264 log.cc:927] Time spent T 07a92dd554674067a83a9cb68c4773f2 P b7ab4784c7344b939bc36f639286f377: Append to log took a long time: real 0.230s	user 0.000s	sys 0.002s
I20260709 13:20:16.815964  6806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bf4668eeb70467fb3dc5a0289233b3c" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:16.817119  6806 raft_consensus.cc:2468] T 1bf4668eeb70467fb3dc5a0289233b3c P b7ab4784c7344b939bc36f639286f377 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 12.
I20260709 13:20:16.810986 11175 raft_consensus.cc:2804] T 3a485a995abc4807b6e511e45419f737 P cd75a17ab2604397adab03bb8b5fd75c [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 13:20:16.825003  6724 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.642s	user 0.033s	sys 0.067s
I20260709 13:20:16.802174  7503 raft_consensus.cc:2468] T ce4f062dcd314d43a63ca74067cb5ee3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 12.
I20260709 13:20:16.831893  6881 raft_consensus.cc:2468] T d8292e16e5654be6bc408560cf256aaa P cd75a17ab2604397adab03bb8b5fd75c [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 16.
W20260709 13:20:16.829910  6724 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.647s	user 0.033s	sys 0.067s
I20260709 13:20:16.830451 11175 raft_consensus.cc:493] T 3a485a995abc4807b6e511e45419f737 P cd75a17ab2604397adab03bb8b5fd75c [term 10 FOLLOWER]: Starting leader election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:20:16.828754 11038 raft_consensus.cc:2749] T f3f9c2e2bf644115957398fe4c9459db P ccd8a4c3bfe3413cb2ae219b09aea832 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:20:16.850405  6806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de3186201e1a40d0b335eeb8b4e256e0" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:20:16.913508  6806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c37d41cd9164c15a6826ca62a851a69" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:16.920519  6799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f58dc08b12a2494bb9a1372837970ca2" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:16.830636 11040 consensus_queue.cc:260] T 7a734b5ab7834e05a8c422208acc58b1 P ccd8a4c3bfe3413cb2ae219b09aea832 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 11.5, Last appended by leader: 5, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:16.922309  6799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1704639a875409b9959353527b3fd68" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:20:16.923241  6799 raft_consensus.cc:2393] T a1704639a875409b9959353527b3fd68 P b7ab4784c7344b939bc36f639286f377 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c in current term 13: Already voted for candidate b7ab4784c7344b939bc36f639286f377 in this term.
I20260709 13:20:16.922971 11198 raft_consensus.cc:515] T 7a734b5ab7834e05a8c422208acc58b1 P b7ab4784c7344b939bc36f639286f377 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:16.888726 11175 raft_consensus.cc:3060] T 3a485a995abc4807b6e511e45419f737 P cd75a17ab2604397adab03bb8b5fd75c [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:20:16.926362 11198 leader_election.cc:290] T 7a734b5ab7834e05a8c422208acc58b1 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 13 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:16.818004 10938 consensus_queue.cc:237] T 34f36d59d88f40fe8a2805e604fc6c0a P b7ab4784c7344b939bc36f639286f377 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:16.880621  6807 raft_consensus.cc:2468] T de3186201e1a40d0b335eeb8b4e256e0 P b7ab4784c7344b939bc36f639286f377 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 13.
I20260709 13:20:16.943877  6806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab432e62819d499eaaf3dd55481dd930" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:16.945125  6799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77e330a82df4b43a745d57a68f6f057" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:16.946492  6807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a734b5ab7834e05a8c422208acc58b1" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 12 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
W20260709 13:20:16.947688  6846 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.68:45071, user_credentials={real_user=slave}} blocked reactor thread for 495904us
I20260709 13:20:16.949077  6806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4b8bd455d5a47c18a1380839c6e0d61" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:20:17.038856  6806 raft_consensus.cc:3060] T f4b8bd455d5a47c18a1380839c6e0d61 P b7ab4784c7344b939bc36f639286f377 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:20:16.914623 11265 leader_election.cc:290] T 8c7f33e544204fbaac4078e3e83bbf4e P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:17.030110  6799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a75bfe094d4bdc963aba3f08dfcd25" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:17.045033  6799 raft_consensus.cc:2393] T 95a75bfe094d4bdc963aba3f08dfcd25 P b7ab4784c7344b939bc36f639286f377 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c in current term 12: Already voted for candidate b7ab4784c7344b939bc36f639286f377 in this term.
I20260709 13:20:17.027272  6807 raft_consensus.cc:2368] T 7a734b5ab7834e05a8c422208acc58b1 P b7ab4784c7344b939bc36f639286f377 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c for earlier term 12. Current term is 13.
W20260709 13:20:17.027371  7495 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.566s	user 0.005s	sys 0.018s
W20260709 13:20:17.046062  7495 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.585s	user 0.006s	sys 0.018s
W20260709 13:20:17.031869  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 319330us
W20260709 13:20:17.031061 10969 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.531s	user 0.015s	sys 0.009s
I20260709 13:20:16.848150 11154 consensus_queue.cc:1059] T 4b8cacb381b746da8d0049b0a83b41dd P 7ba59cc884714e8aa5f3f0ecaed84cbb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.228s
I20260709 13:20:16.917264 11139 raft_consensus.cc:493] T f3f9c2e2bf644115957398fe4c9459db P cd75a17ab2604397adab03bb8b5fd75c [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
W20260709 13:20:17.024487 11259 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.501s	user 0.007s	sys 0.008s
W20260709 13:20:17.048525  6697 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 326849us
I20260709 13:20:17.067480  6697 leader_election.cc:304] T f09c2a98de1a4decabd0ff900dd44caa P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:20:17.051458  6723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "713b5728a197487c9300b310ab94e5a3" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:17.062528  6724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1704639a875409b9959353527b3fd68" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:20:17.065011  6807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8cee0accdb8499c86d4414b72565a38" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:20:17.068437  7503 raft_consensus.cc:1240] T bb3d8792045a4583ae2e965b1350a5b4 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 10 LEADER]: Rejecting Update request from peer cd75a17ab2604397adab03bb8b5fd75c for earlier term 9. Current term is 10. Ops: []
I20260709 13:20:17.070153  6799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b56bf91d90824c959e21e0cee5ba1816" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
W20260709 13:20:17.049317 10969 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.552s	user 0.015s	sys 0.009s
I20260709 13:20:17.077250  6728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de3186201e1a40d0b335eeb8b4e256e0" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:17.080085  6728 raft_consensus.cc:2393] T de3186201e1a40d0b335eeb8b4e256e0 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7ab4784c7344b939bc36f639286f377 in current term 13: Already voted for candidate cd75a17ab2604397adab03bb8b5fd75c in this term.
I20260709 13:20:17.077345  6729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a734b5ab7834e05a8c422208acc58b1" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 13 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:17.081612  6730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce4f062dcd314d43a63ca74067cb5ee3" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:20:17.085321  6730 raft_consensus.cc:3060] T ce4f062dcd314d43a63ca74067cb5ee3 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:20:17.067063 11259 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.587s	user 0.008s	sys 0.009s
W20260709 13:20:17.086115  6772 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 274920us
I20260709 13:20:17.093240  6881 raft_consensus.cc:1240] T d8cee0accdb8499c86d4414b72565a38 P cd75a17ab2604397adab03bb8b5fd75c [term 12 LEADER]: Rejecting Update request from peer b7ab4784c7344b939bc36f639286f377 for earlier term 11. Current term is 12. Ops: [11.10-11.10]
I20260709 13:20:17.097440  6723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7887766dc6784fcaa42b35c05fea7a99" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:17.098675  6723 raft_consensus.cc:2410] T 7887766dc6784fcaa42b35c05fea7a99 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7ab4784c7344b939bc36f639286f377 for term 13 because replica has last-logged OpId of term: 11 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 6.
I20260709 13:20:17.100314  6728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8292e16e5654be6bc408560cf256aaa" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
W20260709 13:20:17.100541 11279 log.cc:927] Time spent T 44bde925b2e541b69890d70715b85176 P ccd8a4c3bfe3413cb2ae219b09aea832: Append to log took a long time: real 0.067s	user 0.000s	sys 0.001s
W20260709 13:20:17.101861  6695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 378329us
I20260709 13:20:17.080188 11033 raft_consensus.cc:2749] T f09c2a98de1a4decabd0ff900dd44caa P ccd8a4c3bfe3413cb2ae219b09aea832 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:20:17.108469  6874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c7f33e544204fbaac4078e3e83bbf4e" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:17.110260 11286 raft_consensus.cc:493] T 9b3759de40694069b13c0f8bd40e5709 P cd75a17ab2604397adab03bb8b5fd75c [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:17.140799  6874 raft_consensus.cc:2468] T 8c7f33e544204fbaac4078e3e83bbf4e P cd75a17ab2604397adab03bb8b5fd75c [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 9.
I20260709 13:20:17.111382 11288 consensus_queue.cc:1048] T bd6869f07b5a4885a0b99fbe60c3b175 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:20:17.112959 11280 consensus_queue.cc:1059] T bb3d8792045a4583ae2e965b1350a5b4 P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:20:17.085165 11211 leader_election.cc:290] T 95a75bfe094d4bdc963aba3f08dfcd25 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 12 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:17.116984  6872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a734b5ab7834e05a8c422208acc58b1" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 13 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:20:17.144984  6872 raft_consensus.cc:3060] T 7a734b5ab7834e05a8c422208acc58b1 P cd75a17ab2604397adab03bb8b5fd75c [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:17.121759 11010 consensus_queue.cc:1048] T 07a92dd554674067a83a9cb68c4773f2 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:20:17.123943 11059 consensus_queue.cc:260] T d8cee0accdb8499c86d4414b72565a38 P b7ab4784c7344b939bc36f639286f377 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:20:17.128463 11038 consensus_queue.cc:1059] T 30e88460611e47b2ba16a46a30b5f416 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
W20260709 13:20:17.128969 11252 consensus_meta.cc:287] T bb7fa124c3bf4ef9ab65a407cb008441 P b7ab4784c7344b939bc36f639286f377: Time spent flushing consensus metadata: real 0.708s	user 0.009s	sys 0.004s
I20260709 13:20:17.129228 11272 consensus_queue.cc:1048] T 9e326172347f45e99a0d482b5d8ef768 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:20:17.131184 11259 raft_consensus.cc:493] T f03d0dbf16864ca4bc1bb5e4c0334c0f P b7ab4784c7344b939bc36f639286f377 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:20:17.131768 11167 raft_consensus.cc:515] T f58dc08b12a2494bb9a1372837970ca2 P cd75a17ab2604397adab03bb8b5fd75c [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:17.132413  6728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a485a995abc4807b6e511e45419f737" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:17.132840 11289 consensus_queue.cc:1059] T 3411566abe2d4c9bb4b2adfdd05e6f17 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.032s
I20260709 13:20:17.136633  6878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a75bfe094d4bdc963aba3f08dfcd25" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:20:17.137584 11051 raft_consensus.cc:3055] T bb3d8792045a4583ae2e965b1350a5b4 P cd75a17ab2604397adab03bb8b5fd75c [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:20:17.068730 11139 raft_consensus.cc:515] T f3f9c2e2bf644115957398fe4c9459db P cd75a17ab2604397adab03bb8b5fd75c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:17.140959 11286 raft_consensus.cc:515] T 9b3759de40694069b13c0f8bd40e5709 P cd75a17ab2604397adab03bb8b5fd75c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:17.195041  6799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a485a995abc4807b6e511e45419f737" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
W20260709 13:20:17.168776  6696 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:17.168514  6806 raft_consensus.cc:2468] T f4b8bd455d5a47c18a1380839c6e0d61 P b7ab4784c7344b939bc36f639286f377 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 11.
I20260709 13:20:17.210002  6806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c44c4849aa54f2b94d1f1bef9ed546f" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:17.210767  6806 raft_consensus.cc:2368] T 7c44c4849aa54f2b94d1f1bef9ed546f P b7ab4784c7344b939bc36f639286f377 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c for earlier term 13. Current term is 14.
I20260709 13:20:17.171310  6724 raft_consensus.cc:2468] T a1704639a875409b9959353527b3fd68 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 13.
I20260709 13:20:17.181435 11118 leader_election.cc:290] T 07a92dd554674067a83a9cb68c4773f2 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:17.212283  6799 raft_consensus.cc:2393] T 3a485a995abc4807b6e511e45419f737 P b7ab4784c7344b939bc36f639286f377 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c in current term 11: Already voted for candidate b7ab4784c7344b939bc36f639286f377 in this term.
I20260709 13:20:17.183370  6805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7887766dc6784fcaa42b35c05fea7a99" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:20:17.183329  6728 raft_consensus.cc:2468] T 3a485a995abc4807b6e511e45419f737 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 11.
I20260709 13:20:17.177682 10983 consensus_queue.cc:1059] T 9b3759de40694069b13c0f8bd40e5709 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.009s
I20260709 13:20:17.182021 11259 raft_consensus.cc:515] T f03d0dbf16864ca4bc1bb5e4c0334c0f P b7ab4784c7344b939bc36f639286f377 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:17.188796  6881 raft_consensus.cc:1240] T f58dc08b12a2494bb9a1372837970ca2 P cd75a17ab2604397adab03bb8b5fd75c [term 15 FOLLOWER]: Rejecting Update request from peer b7ab4784c7344b939bc36f639286f377 for earlier term 14. Current term is 15. Ops: [14.8-14.8]
I20260709 13:20:17.189684  6874 raft_consensus.cc:1275] T 4d9def8b32fd443aa94ab1420b06837b P cd75a17ab2604397adab03bb8b5fd75c [term 12 FOLLOWER]: Refusing update from remote peer b7ab4784c7344b939bc36f639286f377: Log matching property violated. Preceding OpId in replica: term: 11 index: 5. Preceding OpId from leader: term: 12 index: 6. (index mismatch)
I20260709 13:20:17.189142  6730 raft_consensus.cc:2468] T ce4f062dcd314d43a63ca74067cb5ee3 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 12.
W20260709 13:20:17.190708 11124 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.676s	user 0.011s	sys 0.006s
I20260709 13:20:17.173856 11033 consensus_queue.cc:1048] T 90d42e216d9741e190bca19a781291fd P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.022s
I20260709 13:20:17.184669 11059 raft_consensus.cc:3060] T d8cee0accdb8499c86d4414b72565a38 P b7ab4784c7344b939bc36f639286f377 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:20:17.191311 11051 raft_consensus.cc:740] T bb3d8792045a4583ae2e965b1350a5b4 P cd75a17ab2604397adab03bb8b5fd75c [term 9 LEADER]: Becoming Follower/Learner. State: Replica: cd75a17ab2604397adab03bb8b5fd75c, State: Running, Role: LEADER
I20260709 13:20:17.197876 11139 leader_election.cc:290] T f3f9c2e2bf644115957398fe4c9459db P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:20:17.186323 11245 raft_consensus.cc:3055] T 4b8cacb381b746da8d0049b0a83b41dd P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:20:17.260648 11245 raft_consensus.cc:740] T 4b8cacb381b746da8d0049b0a83b41dd P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 7ba59cc884714e8aa5f3f0ecaed84cbb, State: Running, Role: LEADER
I20260709 13:20:17.260936 11051 consensus_queue.cc:260] T bb3d8792045a4583ae2e965b1350a5b4 P cd75a17ab2604397adab03bb8b5fd75c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:20:17.198549 11287 raft_consensus.cc:3055] T 30e88460611e47b2ba16a46a30b5f416 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:20:17.262195 11287 raft_consensus.cc:740] T 30e88460611e47b2ba16a46a30b5f416 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
I20260709 13:20:17.261754 11245 consensus_queue.cc:260] T 4b8cacb381b746da8d0049b0a83b41dd P 7ba59cc884714e8aa5f3f0ecaed84cbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:20:17.263141 11245 raft_consensus.cc:3060] T 4b8cacb381b746da8d0049b0a83b41dd P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:17.263049 11287 consensus_queue.cc:260] T 30e88460611e47b2ba16a46a30b5f416 P ccd8a4c3bfe3413cb2ae219b09aea832 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:17.264354 11287 raft_consensus.cc:3060] T 30e88460611e47b2ba16a46a30b5f416 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:20:17.199047 11288 raft_consensus.cc:3055] T 3411566abe2d4c9bb4b2adfdd05e6f17 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:20:17.265775 11288 raft_consensus.cc:740] T 3411566abe2d4c9bb4b2adfdd05e6f17 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
I20260709 13:20:17.266759 11288 consensus_queue.cc:260] T 3411566abe2d4c9bb4b2adfdd05e6f17 P ccd8a4c3bfe3413cb2ae219b09aea832 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:17.198864 11289 consensus_queue.cc:1048] T f5be3a11b23d4ea9b08300a2789821c7 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:20:17.186239 11167 leader_election.cc:290] T f58dc08b12a2494bb9a1372837970ca2 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 15 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:20:17.199717 11117 leader_election.cc:290] T 3d65025eea89441290d85dd053810e31 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 11 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:17.201184 11267 raft_consensus.cc:3055] T 853ac0a8cbd64ce99457f170216d4d0f P b7ab4784c7344b939bc36f639286f377 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:20:17.269663 11267 raft_consensus.cc:740] T 853ac0a8cbd64ce99457f170216d4d0f P b7ab4784c7344b939bc36f639286f377 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
W20260709 13:20:17.156744  6772 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:17.206758  6872 raft_consensus.cc:2468] T 7a734b5ab7834e05a8c422208acc58b1 P cd75a17ab2604397adab03bb8b5fd75c [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 13.
I20260709 13:20:17.207811  6807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90d42e216d9741e190bca19a781291fd" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:17.270833 11267 consensus_queue.cc:260] T 853ac0a8cbd64ce99457f170216d4d0f P b7ab4784c7344b939bc36f639286f377 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
W20260709 13:20:17.212329  6697 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 111535us
I20260709 13:20:17.167945 11175 raft_consensus.cc:515] T 3a485a995abc4807b6e511e45419f737 P cd75a17ab2604397adab03bb8b5fd75c [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:17.214876  6806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e31b9971c15848dea59d4d4130141d9e" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:20:17.213447  6805 raft_consensus.cc:2376] T 7887766dc6784fcaa42b35c05fea7a99 P b7ab4784c7344b939bc36f639286f377 [term 12 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 12. Re-sending same reply.
I20260709 13:20:17.178025 11252 raft_consensus.cc:515] T bb7fa124c3bf4ef9ab65a407cb008441 P b7ab4784c7344b939bc36f639286f377 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
W20260709 13:20:17.253825 11124 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.740s	user 0.012s	sys 0.006s
I20260709 13:20:17.211014  6695 leader_election.cc:304] T f4b8bd455d5a47c18a1380839c6e0d61 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
I20260709 13:20:17.202059 11286 leader_election.cc:290] T 9b3759de40694069b13c0f8bd40e5709 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:20:17.279436 10983 consensus_queue.cc:1243] T 9b3759de40694069b13c0f8bd40e5709 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Peer b7ab4784c7344b939bc36f639286f377 log is divergent from this leader: its last log entry 11.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:20:17.281693 11040 raft_consensus.cc:3060] T 7a734b5ab7834e05a8c422208acc58b1 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:20:17.285264  6800 raft_consensus.cc:1275] T 427c124d773f483294511e80fe340075 P b7ab4784c7344b939bc36f639286f377 [term 10 FOLLOWER]: Refusing update from remote peer 7ba59cc884714e8aa5f3f0ecaed84cbb: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 13:20:17.285676  6770 leader_election.cc:304] T e77e330a82df4b43a745d57a68f6f057 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:20:17.286929  6874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d65025eea89441290d85dd053810e31" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:20:17.287593  6874 raft_consensus.cc:3060] T 3d65025eea89441290d85dd053810e31 P cd75a17ab2604397adab03bb8b5fd75c [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:20:17.289362  6798 raft_consensus.cc:1240] T bb7fa124c3bf4ef9ab65a407cb008441 P b7ab4784c7344b939bc36f639286f377 [term 13 FOLLOWER]: Rejecting Update request from peer 7ba59cc884714e8aa5f3f0ecaed84cbb for earlier term 12. Current term is 13. Ops: [12.10-12.10]
I20260709 13:20:17.234499 10727 leader_election.cc:290] T 7c37d41cd9164c15a6826ca62a851a69 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:17.273046  6872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a92dd554674067a83a9cb68c4773f2" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:17.274637  6772 leader_election.cc:304] T 3a485a995abc4807b6e511e45419f737 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:20:17.275635  6806 raft_consensus.cc:2410] T e31b9971c15848dea59d4d4130141d9e P b7ab4784c7344b939bc36f639286f377 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c for term 10 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 13:20:17.275274 11117 raft_consensus.cc:493] T 20f6842e26174571996b8dea4151d4be P b7ab4784c7344b939bc36f639286f377 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:20:17.277935  6875 raft_consensus.cc:1217] T 853ac0a8cbd64ce99457f170216d4d0f P cd75a17ab2604397adab03bb8b5fd75c [term 9 LEADER]: Deduplicated request from leader. Original: 6.4->[8.5-8.5]   Dedup: 8.5->[]
I20260709 13:20:17.278504 11259 leader_election.cc:290] T f03d0dbf16864ca4bc1bb5e4c0334c0f P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:17.273880 11298 consensus_queue.cc:1048] T 8c7f33e544204fbaac4078e3e83bbf4e P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.025s
I20260709 13:20:17.291461  6875 raft_consensus.cc:1240] T 853ac0a8cbd64ce99457f170216d4d0f P cd75a17ab2604397adab03bb8b5fd75c [term 9 LEADER]: Rejecting Update request from peer b7ab4784c7344b939bc36f639286f377 for earlier term 8. Current term is 9. Ops: [8.5-8.5]
I20260709 13:20:17.272541  6799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb7fa124c3bf4ef9ab65a407cb008441" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:17.296108  6772 leader_election.cc:304] T 7887766dc6784fcaa42b35c05fea7a99 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:20:17.300356  6872 raft_consensus.cc:2468] T 07a92dd554674067a83a9cb68c4773f2 P cd75a17ab2604397adab03bb8b5fd75c [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 11.
I20260709 13:20:17.304639 11292 raft_consensus.cc:2749] T e77e330a82df4b43a745d57a68f6f057 P b7ab4784c7344b939bc36f639286f377 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:20:17.305447 10938 raft_consensus.cc:2804] T 3a485a995abc4807b6e511e45419f737 P b7ab4784c7344b939bc36f639286f377 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:20:17.305948 10938 raft_consensus.cc:493] T 3a485a995abc4807b6e511e45419f737 P b7ab4784c7344b939bc36f639286f377 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:17.306380 10938 raft_consensus.cc:3060] T 3a485a995abc4807b6e511e45419f737 P b7ab4784c7344b939bc36f639286f377 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:20:17.267983 11288 raft_consensus.cc:3060] T 3411566abe2d4c9bb4b2adfdd05e6f17 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:20:17.312772 10708 raft_consensus.cc:2804] T 7887766dc6784fcaa42b35c05fea7a99 P b7ab4784c7344b939bc36f639286f377 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:20:17.313436 10708 raft_consensus.cc:493] T 7887766dc6784fcaa42b35c05fea7a99 P b7ab4784c7344b939bc36f639286f377 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:17.313865 10708 raft_consensus.cc:3060] T 7887766dc6784fcaa42b35c05fea7a99 P b7ab4784c7344b939bc36f639286f377 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:20:17.279874 11172 consensus_meta.cc:287] T 90d42e216d9741e190bca19a781291fd P b7ab4784c7344b939bc36f639286f377: Time spent flushing consensus metadata: real 0.536s	user 0.008s	sys 0.004s
I20260709 13:20:17.316696 11172 raft_consensus.cc:515] T 90d42e216d9741e190bca19a781291fd P b7ab4784c7344b939bc36f639286f377 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:17.318919  6807 raft_consensus.cc:2393] T 90d42e216d9741e190bca19a781291fd P b7ab4784c7344b939bc36f639286f377 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c in current term 12: Already voted for candidate b7ab4784c7344b939bc36f639286f377 in this term.
I20260709 13:20:17.319190 11172 leader_election.cc:290] T 90d42e216d9741e190bca19a781291fd P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 12 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:17.317281 11246 consensus_queue.cc:1048] T 427c124d773f483294511e80fe340075 P 7ba59cc884714e8aa5f3f0ecaed84cbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.004s
I20260709 13:20:17.322703 10818 raft_consensus.cc:3060] T f09c2a98de1a4decabd0ff900dd44caa P b7ab4784c7344b939bc36f639286f377 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:20:17.323028  6695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 112082us
I20260709 13:20:17.323912  6695 leader_election.cc:304] T c4db81d9d329422bb3b4160ca4ac2d1d P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
I20260709 13:20:17.324376  6772 leader_election.cc:304] T ce4f062dcd314d43a63ca74067cb5ee3 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:20:17.324819  6695 leader_election.cc:304] T 7887766dc6784fcaa42b35c05fea7a99 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
I20260709 13:20:17.325246  6772 leader_election.cc:304] T d8292e16e5654be6bc408560cf256aaa P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
W20260709 13:20:17.325814  6726 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49998 (request call id 1080) took 1491 ms (client timeout 1869 ms). Trace:
I20260709 13:20:17.326236 11258 raft_consensus.cc:2804] T ce4f062dcd314d43a63ca74067cb5ee3 P b7ab4784c7344b939bc36f639286f377 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:20:17.327065 11258 raft_consensus.cc:697] T ce4f062dcd314d43a63ca74067cb5ee3 P b7ab4784c7344b939bc36f639286f377 [term 12 LEADER]: Becoming Leader. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
I20260709 13:20:17.327415  6727 raft_consensus.cc:1275] T 7c37d41cd9164c15a6826ca62a851a69 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 11 FOLLOWER]: Refusing update from remote peer b7ab4784c7344b939bc36f639286f377: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:20:17.328675 10983 raft_consensus.cc:2804] T c4db81d9d329422bb3b4160ca4ac2d1d P ccd8a4c3bfe3413cb2ae219b09aea832 [term 11 FOLLOWER]: Leader election won for term 11
W20260709 13:20:17.326280  6726 rpcz_store.cc:269] 0709 13:20:15.834518 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:15.834650 (+   132us) service_pool.cc:224] Handling call
0709 13:20:17.325582 (+1490932us) spinlock_profiling.cc:243] Waited 699 ms on lock 0x7b5400099cd4. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f9ae2fa 00007fcc1496fb17 00007fcc0deea6d4 00007fcc0deea662 00007fcc0deea591 00007fcc0deea50c 00007fcc0dee97c2 00007fcc0dce548c 00007fcc0dce48c6 00007fcc0dce426f
0709 13:20:17.325725 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1607515904}
I20260709 13:20:17.328883  6695 leader_election.cc:304] T 3a485a995abc4807b6e511e45419f737 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
I20260709 13:20:17.340391  6772 leader_election.cc:304] T 8c7f33e544204fbaac4078e3e83bbf4e P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:20:17.278533 11175 leader_election.cc:290] T 3a485a995abc4807b6e511e45419f737 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 11 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
W20260709 13:20:17.343779  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 256101us
I20260709 13:20:17.345974  6803 raft_consensus.cc:2410] T d8cee0accdb8499c86d4414b72565a38 P b7ab4784c7344b939bc36f639286f377 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c for term 12 because replica has last-logged OpId of term: 11 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 9.
I20260709 13:20:17.328370 10700 raft_consensus.cc:2764] T f4b8bd455d5a47c18a1380839c6e0d61 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 11 FOLLOWER]: Leader election decision vote started in defunct term 10: won
I20260709 13:20:17.299710 11117 raft_consensus.cc:515] T 20f6842e26174571996b8dea4151d4be P b7ab4784c7344b939bc36f639286f377 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:17.342293 11038 raft_consensus.cc:2804] T 7887766dc6784fcaa42b35c05fea7a99 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:20:17.359711 11038 raft_consensus.cc:493] T 7887766dc6784fcaa42b35c05fea7a99 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:17.360108 11038 raft_consensus.cc:3060] T 7887766dc6784fcaa42b35c05fea7a99 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:17.360826 11117 leader_election.cc:290] T 20f6842e26174571996b8dea4151d4be P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:17.358801 10983 raft_consensus.cc:697] T c4db81d9d329422bb3b4160ca4ac2d1d P ccd8a4c3bfe3413cb2ae219b09aea832 [term 11 LEADER]: Becoming Leader. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
I20260709 13:20:17.363489 10983 consensus_queue.cc:237] T c4db81d9d329422bb3b4160ca4ac2d1d P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:17.364151 10989 consensus_queue.cc:1048] T 4d9def8b32fd443aa94ab1420b06837b P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:20:17.356539  6844 leader_election.cc:304] T b56bf91d90824c959e21e0cee5ba1816 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
W20260709 13:20:17.368892  6770 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 83306.5us
I20260709 13:20:17.368351  6844 leader_election.cc:304] T 4b8cacb381b746da8d0049b0a83b41dd P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb
I20260709 13:20:17.370911  6806 raft_consensus.cc:1240] T 95a75bfe094d4bdc963aba3f08dfcd25 P b7ab4784c7344b939bc36f639286f377 [term 12 FOLLOWER]: Rejecting Update request from peer ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 11. Current term is 12. Ops: []
I20260709 13:20:17.342178 11297 raft_consensus.cc:2804] T d8292e16e5654be6bc408560cf256aaa P b7ab4784c7344b939bc36f639286f377 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:20:17.351662  6772 leader_election.cc:304] T 7a734b5ab7834e05a8c422208acc58b1 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:20:17.344835 11259 raft_consensus.cc:2804] T 8c7f33e544204fbaac4078e3e83bbf4e P b7ab4784c7344b939bc36f639286f377 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:20:17.381649  6770 leader_election.cc:304] T 9e326172347f45e99a0d482b5d8ef768 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:20:17.328341 11258 consensus_queue.cc:237] T ce4f062dcd314d43a63ca74067cb5ee3 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 12, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } attrs { replace: true } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:20:17.384073  6844 leader_election.cc:304] T f4b8bd455d5a47c18a1380839c6e0d61 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:20:17.396996  6844 leader_election.cc:304] T e31b9971c15848dea59d4d4130141d9e P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:20:17.371274 10727 consensus_queue.cc:1048] T 8c7f33e544204fbaac4078e3e83bbf4e P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.029s
I20260709 13:20:17.368592 11298 consensus_queue.cc:1059] T 9b3759de40694069b13c0f8bd40e5709 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.046s
I20260709 13:20:17.402886 11259 raft_consensus.cc:493] T 8c7f33e544204fbaac4078e3e83bbf4e P b7ab4784c7344b939bc36f639286f377 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:17.403560 11259 raft_consensus.cc:3060] T 8c7f33e544204fbaac4078e3e83bbf4e P b7ab4784c7344b939bc36f639286f377 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:20:17.373943 11066 consensus_queue.cc:1048] T f09c2a98de1a4decabd0ff900dd44caa P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Connected to new peer: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.013s
W20260709 13:20:17.412552  6698 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:17.386497 11252 leader_election.cc:290] T bb7fa124c3bf4ef9ab65a407cb008441 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 13 election: Requested vote from peers cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:20:17.373467 11167 raft_consensus.cc:2804] T b56bf91d90824c959e21e0cee5ba1816 P cd75a17ab2604397adab03bb8b5fd75c [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:20:17.387172 11175 raft_consensus.cc:2804] T 4b8cacb381b746da8d0049b0a83b41dd P cd75a17ab2604397adab03bb8b5fd75c [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:20:17.386960 11277 consensus_queue.cc:1059] T f58dc08b12a2494bb9a1372837970ca2 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: INVALID_TERM, Last received: 13.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:20:17.390326 10708 raft_consensus.cc:515] T 7887766dc6784fcaa42b35c05fea7a99 P b7ab4784c7344b939bc36f639286f377 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:17.412377 11299 raft_consensus.cc:2804] T f4b8bd455d5a47c18a1380839c6e0d61 P cd75a17ab2604397adab03bb8b5fd75c [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:20:17.393251 11038 raft_consensus.cc:515] T 7887766dc6784fcaa42b35c05fea7a99 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:17.386833  6805 raft_consensus.cc:1275] T 7c44c4849aa54f2b94d1f1bef9ed546f P b7ab4784c7344b939bc36f639286f377 [term 14 FOLLOWER]: Refusing update from remote peer ccd8a4c3bfe3413cb2ae219b09aea832: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
W20260709 13:20:17.426098  6770 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 44557.7us
I20260709 13:20:17.368003 11267 raft_consensus.cc:3060] T 853ac0a8cbd64ce99457f170216d4d0f P b7ab4784c7344b939bc36f639286f377 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:20:17.431051  6805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c37d41cd9164c15a6826ca62a851a69" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:17.410917  6874 raft_consensus.cc:2468] T 3d65025eea89441290d85dd053810e31 P cd75a17ab2604397adab03bb8b5fd75c [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 11.
I20260709 13:20:17.373766 10580 raft_consensus.cc:2804] T 3a485a995abc4807b6e511e45419f737 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:20:17.405489 11172 raft_consensus.cc:2804] T 7a734b5ab7834e05a8c422208acc58b1 P b7ab4784c7344b939bc36f639286f377 [term 13 FOLLOWER]: Leader election won for term 13
W20260709 13:20:17.440702  6698 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:17.441074  6805 raft_consensus.cc:3055] T 44bde925b2e541b69890d70715b85176 P b7ab4784c7344b939bc36f639286f377 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:20:17.421399  6844 leader_election.cc:304] T 7c37d41cd9164c15a6826ca62a851a69 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:20:17.395435 11297 raft_consensus.cc:697] T d8292e16e5654be6bc408560cf256aaa P b7ab4784c7344b939bc36f639286f377 [term 16 LEADER]: Becoming Leader. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
I20260709 13:20:17.377388 11033 consensus_queue.cc:1048] T bd6869f07b5a4885a0b99fbe60c3b175 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.055s
I20260709 13:20:17.441679  6805 raft_consensus.cc:740] T 44bde925b2e541b69890d70715b85176 P b7ab4784c7344b939bc36f639286f377 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
I20260709 13:20:17.419094  6772 leader_election.cc:304] T 07a92dd554674067a83a9cb68c4773f2 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:20:17.373613 11139 consensus_queue.cc:1059] T c4db81d9d329422bb3b4160ca4ac2d1d P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.054s
I20260709 13:20:17.423262 11272 raft_consensus.cc:493] T 4d9def8b32fd443aa94ab1420b06837b P ccd8a4c3bfe3413cb2ae219b09aea832 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:17.428351 11061 raft_consensus.cc:493] T 7c44c4849aa54f2b94d1f1bef9ed546f P b7ab4784c7344b939bc36f639286f377 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:17.422833 11167 raft_consensus.cc:493] T b56bf91d90824c959e21e0cee5ba1816 P cd75a17ab2604397adab03bb8b5fd75c [term 11 FOLLOWER]: Starting leader election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:20:17.461238  6770 leader_election.cc:304] T be1a92657f494cac8dd227d152f50151 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb
I20260709 13:20:17.434051 10580 raft_consensus.cc:493] T 3a485a995abc4807b6e511e45419f737 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:17.445370 11059 raft_consensus.cc:2749] T 9e326172347f45e99a0d482b5d8ef768 P b7ab4784c7344b939bc36f639286f377 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:20:17.465082  6697 leader_election.cc:304] T 4b8cacb381b746da8d0049b0a83b41dd P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:20:17.445796 11252 raft_consensus.cc:3055] T f58dc08b12a2494bb9a1372837970ca2 P b7ab4784c7344b939bc36f639286f377 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:20:17.484269 10818 raft_consensus.cc:493] T f5be3a11b23d4ea9b08300a2789821c7 P b7ab4784c7344b939bc36f639286f377 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:20:17.484812  6772 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:17.451314 11287 raft_consensus.cc:493] T f03d0dbf16864ca4bc1bb5e4c0334c0f P ccd8a4c3bfe3413cb2ae219b09aea832 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:17.469621  6805 consensus_queue.cc:260] T 44bde925b2e541b69890d70715b85176 P b7ab4784c7344b939bc36f639286f377 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:17.512266 11312 raft_consensus.cc:493] T 711ef6523deb4cbe8ef2ba61e1c21c98 P cd75a17ab2604397adab03bb8b5fd75c [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:17.454099 11172 raft_consensus.cc:697] T 7a734b5ab7834e05a8c422208acc58b1 P b7ab4784c7344b939bc36f639286f377 [term 13 LEADER]: Becoming Leader. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
I20260709 13:20:17.514202  7495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb7fa124c3bf4ef9ab65a407cb008441" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb"
I20260709 13:20:17.464613 11272 raft_consensus.cc:515] T 4d9def8b32fd443aa94ab1420b06837b P ccd8a4c3bfe3413cb2ae219b09aea832 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:17.463558 10989 raft_consensus.cc:2804] T 07a92dd554674067a83a9cb68c4773f2 P b7ab4784c7344b939bc36f639286f377 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:20:17.533262 10989 raft_consensus.cc:493] T 07a92dd554674067a83a9cb68c4773f2 P b7ab4784c7344b939bc36f639286f377 [term 11 FOLLOWER]: Starting leader election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:20:17.533843 10989 raft_consensus.cc:3060] T 07a92dd554674067a83a9cb68c4773f2 P b7ab4784c7344b939bc36f639286f377 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:20:17.535674 11272 leader_election.cc:290] T 4d9def8b32fd443aa94ab1420b06837b P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:17.459925 11167 raft_consensus.cc:3060] T b56bf91d90824c959e21e0cee5ba1816 P cd75a17ab2604397adab03bb8b5fd75c [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:20:17.475052 10580 raft_consensus.cc:3060] T 3a485a995abc4807b6e511e45419f737 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:20:17.539204  6770 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 78109us
I20260709 13:20:17.464360 11309 raft_consensus.cc:2804] T e31b9971c15848dea59d4d4130141d9e P cd75a17ab2604397adab03bb8b5fd75c [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:20:17.508253 11252 raft_consensus.cc:740] T f58dc08b12a2494bb9a1372837970ca2 P b7ab4784c7344b939bc36f639286f377 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
I20260709 13:20:17.463001 11061 raft_consensus.cc:515] T 7c44c4849aa54f2b94d1f1bef9ed546f P b7ab4784c7344b939bc36f639286f377 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:17.472759 11298 consensus_queue.cc:1059] T 95a75bfe094d4bdc963aba3f08dfcd25 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: INVALID_TERM, Last received: 11.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.070s
I20260709 13:20:17.492421 10700 consensus_queue.cc:1048] T 7c44c4849aa54f2b94d1f1bef9ed546f P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.051s
I20260709 13:20:17.522507 11117 raft_consensus.cc:2804] T be1a92657f494cac8dd227d152f50151 P b7ab4784c7344b939bc36f639286f377 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:20:17.526018 11277 raft_consensus.cc:493] T 17587d6730594da4a56fa13a353232a1 P b7ab4784c7344b939bc36f639286f377 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
W20260709 13:20:17.612438  6697 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.68:45071, user_credentials={real_user=slave}} blocked reactor thread for 157268us
I20260709 13:20:17.521423 10818 raft_consensus.cc:515] T f5be3a11b23d4ea9b08300a2789821c7 P b7ab4784c7344b939bc36f639286f377 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:17.454005  6726 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3a485a995abc4807b6e511e45419f737"
dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
mode: GRACEFUL
new_leader_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
 from {username='slave'} at 127.0.0.1:38536
W20260709 13:20:17.665577  6698 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:17.544282 11175 raft_consensus.cc:697] T 4b8cacb381b746da8d0049b0a83b41dd P cd75a17ab2604397adab03bb8b5fd75c [term 13 LEADER]: Becoming Leader. State: Replica: cd75a17ab2604397adab03bb8b5fd75c, State: Running, Role: LEADER
W20260709 13:20:17.627372  7467 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:17.637773  6801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d9def8b32fd443aa94ab1420b06837b" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:17.538757 11311 raft_consensus.cc:2749] T 4b8cacb381b746da8d0049b0a83b41dd P ccd8a4c3bfe3413cb2ae219b09aea832 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:20:17.523397 11287 raft_consensus.cc:515] T f03d0dbf16864ca4bc1bb5e4c0334c0f P ccd8a4c3bfe3413cb2ae219b09aea832 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:17.618074 10727 raft_consensus.cc:493] T de3186201e1a40d0b335eeb8b4e256e0 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:20:17.636972 11305 log.cc:927] Time spent T bb3d8792045a4583ae2e965b1350a5b4 P ccd8a4c3bfe3413cb2ae219b09aea832: Append to log took a long time: real 0.095s	user 0.000s	sys 0.000s
W20260709 13:20:17.633313 11303 log.cc:927] Time spent T 3fa34c08b205435dba97346991aa1f92 P ccd8a4c3bfe3413cb2ae219b09aea832: Append to log took a long time: real 0.138s	user 0.001s	sys 0.000s
I20260709 13:20:17.625125 10708 leader_election.cc:290] T 7887766dc6784fcaa42b35c05fea7a99 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 13 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:17.620597 11309 raft_consensus.cc:697] T e31b9971c15848dea59d4d4130141d9e P cd75a17ab2604397adab03bb8b5fd75c [term 10 LEADER]: Becoming Leader. State: Replica: cd75a17ab2604397adab03bb8b5fd75c, State: Running, Role: LEADER
I20260709 13:20:17.625439 11117 raft_consensus.cc:493] T be1a92657f494cac8dd227d152f50151 P b7ab4784c7344b939bc36f639286f377 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 7ba59cc884714e8aa5f3f0ecaed84cbb)
I20260709 13:20:17.650606 11299 raft_consensus.cc:697] T f4b8bd455d5a47c18a1380839c6e0d61 P cd75a17ab2604397adab03bb8b5fd75c [term 11 LEADER]: Becoming Leader. State: Replica: cd75a17ab2604397adab03bb8b5fd75c, State: Running, Role: LEADER
I20260709 13:20:17.538376 11312 raft_consensus.cc:515] T 711ef6523deb4cbe8ef2ba61e1c21c98 P cd75a17ab2604397adab03bb8b5fd75c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:17.677678 11280 raft_consensus.cc:2804] T 7c37d41cd9164c15a6826ca62a851a69 P cd75a17ab2604397adab03bb8b5fd75c [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:20:17.625239 11297 consensus_queue.cc:237] T d8292e16e5654be6bc408560cf256aaa P b7ab4784c7344b939bc36f639286f377 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 15.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:17.667109 11277 raft_consensus.cc:515] T 17587d6730594da4a56fa13a353232a1 P b7ab4784c7344b939bc36f639286f377 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:20:17.832098 11249 raft_consensus.cc:493] T 17587d6730594da4a56fa13a353232a1 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:17.844911 11249 raft_consensus.cc:515] T 17587d6730594da4a56fa13a353232a1 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
W20260709 13:20:17.846624 11288 consensus_meta.cc:287] T 3411566abe2d4c9bb4b2adfdd05e6f17 P ccd8a4c3bfe3413cb2ae219b09aea832: Time spent flushing consensus metadata: real 0.537s	user 0.009s	sys 0.003s
I20260709 13:20:17.847282 11280 raft_consensus.cc:493] T 7c37d41cd9164c15a6826ca62a851a69 P cd75a17ab2604397adab03bb8b5fd75c [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:17.847723 11280 raft_consensus.cc:3060] T 7c37d41cd9164c15a6826ca62a851a69 P cd75a17ab2604397adab03bb8b5fd75c [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:20:17.848345 11249 leader_election.cc:290] T 17587d6730594da4a56fa13a353232a1 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:20:17.862010 10818 leader_election.cc:290] T f5be3a11b23d4ea9b08300a2789821c7 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:17.831627 11172 consensus_queue.cc:237] T 7a734b5ab7834e05a8c422208acc58b1 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.4, Last appended by leader: 4, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
W20260709 13:20:17.879912  6698 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:17.908217  6698 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:17.778741 10983 raft_consensus.cc:493] T a3022224cc81473690653a83d4e99470 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:17.808107 11117 raft_consensus.cc:3060] T be1a92657f494cac8dd227d152f50151 P b7ab4784c7344b939bc36f639286f377 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:17.779311 10700 raft_consensus.cc:493] T f58dc08b12a2494bb9a1372837970ca2 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:17.807785 11252 consensus_queue.cc:260] T f58dc08b12a2494bb9a1372837970ca2 P b7ab4784c7344b939bc36f639286f377 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:17.983695 10983 raft_consensus.cc:515] T a3022224cc81473690653a83d4e99470 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
W20260709 13:20:17.987681 11040 consensus_meta.cc:287] T 7a734b5ab7834e05a8c422208acc58b1 P ccd8a4c3bfe3413cb2ae219b09aea832: Time spent flushing consensus metadata: real 0.705s	user 0.013s	sys 0.000s
I20260709 13:20:17.817369 11175 consensus_queue.cc:237] T 4b8cacb381b746da8d0049b0a83b41dd P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:20:17.803983 11033 raft_consensus.cc:493] T 24ee15416e3145beaa1b8183453729a3 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:17.845870 11312 leader_election.cc:290] T 711ef6523deb4cbe8ef2ba61e1c21c98 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:20:17.833511 11287 leader_election.cc:290] T f03d0dbf16864ca4bc1bb5e4c0334c0f P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:17.786482 10727 raft_consensus.cc:515] T de3186201e1a40d0b335eeb8b4e256e0 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:18.069276  6729 raft_consensus.cc:2410] T 7a734b5ab7834e05a8c422208acc58b1 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7ab4784c7344b939bc36f639286f377 for term 13 because replica has last-logged OpId of term: 11 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 4.
W20260709 13:20:18.058106  6844 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.591s	user 0.043s	sys 0.063s
W20260709 13:20:18.105860  6844 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.639s	user 0.044s	sys 0.064s
I20260709 13:20:18.055023 11038 leader_election.cc:290] T 7887766dc6784fcaa42b35c05fea7a99 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 13 election: Requested vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:18.037317 10700 raft_consensus.cc:515] T f58dc08b12a2494bb9a1372837970ca2 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
W20260709 13:20:18.107062  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 685740us
W20260709 13:20:18.165223  6847 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.687s	user 0.008s	sys 0.002s
W20260709 13:20:18.219825  6847 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.793s	user 0.009s	sys 0.006s
W20260709 13:20:18.195020  7467 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:18.113000  6799 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.673s	user 0.007s	sys 0.002s
I20260709 13:20:18.220860 11038 raft_consensus.cc:493] T 2c240553ce044eedb41541d72b9475d7 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:18.110965 11252 raft_consensus.cc:3060] T f58dc08b12a2494bb9a1372837970ca2 P b7ab4784c7344b939bc36f639286f377 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:20:18.221233  6799 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.786s	user 0.009s	sys 0.006s
I20260709 13:20:18.222967  6874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f03d0dbf16864ca4bc1bb5e4c0334c0f" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:18.223893  6874 raft_consensus.cc:2393] T f03d0dbf16864ca4bc1bb5e4c0334c0f P cd75a17ab2604397adab03bb8b5fd75c [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7ab4784c7344b939bc36f639286f377 in current term 11: Already voted for candidate cd75a17ab2604397adab03bb8b5fd75c in this term.
I20260709 13:20:18.070936 11033 raft_consensus.cc:515] T 24ee15416e3145beaa1b8183453729a3 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:20:18.224602  6881 raft_consensus.cc:1275] T a3022224cc81473690653a83d4e99470 P cd75a17ab2604397adab03bb8b5fd75c [term 13 FOLLOWER]: Refusing update from remote peer b7ab4784c7344b939bc36f639286f377: Log matching property violated. Preceding OpId in replica: term: 12 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 13:20:18.224694  6697 leader_election.cc:304] T 1528ab62b6fe4e3099d08f141afee116 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, b7ab4784c7344b939bc36f639286f377
I20260709 13:20:17.835448 11299 consensus_queue.cc:237] T f4b8bd455d5a47c18a1380839c6e0d61 P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
W20260709 13:20:18.148208  6845 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.675s	user 0.002s	sys 0.007s
W20260709 13:20:18.241174  6845 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.808s	user 0.005s	sys 0.010s
I20260709 13:20:18.238638  6807 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:32966 (request call id 1087) took 1700 ms. Trace:
W20260709 13:20:18.228773  6770 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 686048us
I20260709 13:20:18.242659  6807 rpcz_store.cc:276] 0709 13:20:16.537918 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:17.189310 (+651392us) service_pool.cc:224] Handling call
0709 13:20:18.238358 (+1049048us) spinlock_profiling.cc:243] Waited 47.4 ms on lock 0x7b54001cacd4. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f9ae2fa 00007fcc1496fb17 00007fcc0deea6d4 00007fcc0deea662 00007fcc0deea591 00007fcc0deea50c 00007fcc0dee97c2 00007fcc0dce548c 00007fcc0dce48c6 00007fcc0dce426f
0709 13:20:18.238561 (+   203us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":109016448}
W20260709 13:20:18.166013  6800 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.748s	user 0.000s	sys 0.012s
W20260709 13:20:18.244192  6800 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.827s	user 0.002s	sys 0.013s
W20260709 13:20:18.228363  6772 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:18.245393  6772 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:18.185804 11126 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.502s	user 0.002s	sys 0.019s
I20260709 13:20:18.253269  6770 leader_election.cc:304] T c4db81d9d329422bb3b4160ca4ac2d1d P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:20:18.254784  6878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb7fa124c3bf4ef9ab65a407cb008441" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:20:18.255565  6878 raft_consensus.cc:3060] T bb7fa124c3bf4ef9ab65a407cb008441 P cd75a17ab2604397adab03bb8b5fd75c [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:18.255913  6807 raft_consensus.cc:1240] T 90d42e216d9741e190bca19a781291fd P b7ab4784c7344b939bc36f639286f377 [term 12 FOLLOWER]: Rejecting Update request from peer ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 11. Current term is 12. Ops: [11.7-11.7]
I20260709 13:20:18.233044  6678 placement_policy_util.cc:248] tablet 1528ab62b6fe4e3099d08f141afee116: not considering replicas for movement since the tablet's status is 'UNAVAILABLE'
I20260709 13:20:18.228284 10818 raft_consensus.cc:493] T e31b9971c15848dea59d4d4130141d9e P b7ab4784c7344b939bc36f639286f377 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:18.260306  6880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20f6842e26174571996b8dea4151d4be" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:18.226325 11033 leader_election.cc:290] T 24ee15416e3145beaa1b8183453729a3 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:20:18.258163  6881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90d42e216d9741e190bca19a781291fd" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:20:18.284013  6881 raft_consensus.cc:3060] T 90d42e216d9741e190bca19a781291fd P cd75a17ab2604397adab03bb8b5fd75c [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:20:18.263435  6698 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:18.247228 11051 raft_consensus.cc:3060] T bb3d8792045a4583ae2e965b1350a5b4 P cd75a17ab2604397adab03bb8b5fd75c [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:20:18.250455 10938 consensus_meta.cc:287] T 3a485a995abc4807b6e511e45419f737 P b7ab4784c7344b939bc36f639286f377: Time spent flushing consensus metadata: real 0.944s	user 0.014s	sys 0.000s
W20260709 13:20:18.269477 10580 consensus_meta.cc:287] T 3a485a995abc4807b6e511e45419f737 P ccd8a4c3bfe3413cb2ae219b09aea832: Time spent flushing consensus metadata: real 0.656s	user 0.010s	sys 0.000s
I20260709 13:20:18.271356 10700 leader_election.cc:290] T f58dc08b12a2494bb9a1372837970ca2 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:18.281106 10983 leader_election.cc:290] T a3022224cc81473690653a83d4e99470 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:18.259902 11288 raft_consensus.cc:2749] T 1528ab62b6fe4e3099d08f141afee116 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:20:18.240458 10969 raft_consensus.cc:493] T ab432e62819d499eaaf3dd55481dd930 P b7ab4784c7344b939bc36f639286f377 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:20:18.289265 10727 leader_election.cc:290] T de3186201e1a40d0b335eeb8b4e256e0 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:18.227705 11298 consensus_queue.cc:1048] T 17587d6730594da4a56fa13a353232a1 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.057s
I20260709 13:20:18.289935  6880 raft_consensus.cc:2468] T 20f6842e26174571996b8dea4151d4be P cd75a17ab2604397adab03bb8b5fd75c [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 13.
I20260709 13:20:18.279377 11117 raft_consensus.cc:515] T be1a92657f494cac8dd227d152f50151 P b7ab4784c7344b939bc36f639286f377 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
W20260709 13:20:18.291409  6698 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:18.291590  6772 leader_election.cc:304] T 3d65025eea89441290d85dd053810e31 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
W20260709 13:20:18.343642  6772 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 52396.3us
I20260709 13:20:18.221542 11038 raft_consensus.cc:515] T 2c240553ce044eedb41541d72b9475d7 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
W20260709 13:20:18.298545  6804 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.519s	user 0.040s	sys 0.026s
W20260709 13:20:18.361771  6804 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.582s	user 0.040s	sys 0.026s
I20260709 13:20:18.306255  6878 raft_consensus.cc:2410] T bb7fa124c3bf4ef9ab65a407cb008441 P cd75a17ab2604397adab03bb8b5fd75c [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate b7ab4784c7344b939bc36f639286f377 for term 13 because replica has last-logged OpId of term: 12 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 9.
W20260709 13:20:18.328168  6770 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 74989.4us
W20260709 13:20:18.304025  6697 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.68:45071, user_credentials={real_user=slave}} blocked reactor thread for 79457.3us
I20260709 13:20:18.285583 10818 raft_consensus.cc:515] T e31b9971c15848dea59d4d4130141d9e P b7ab4784c7344b939bc36f639286f377 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:18.286711 11211 raft_consensus.cc:2749] T c4db81d9d329422bb3b4160ca4ac2d1d P b7ab4784c7344b939bc36f639286f377 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:20:18.368335  6873 raft_consensus.cc:1275] T 427c124d773f483294511e80fe340075 P cd75a17ab2604397adab03bb8b5fd75c [term 10 FOLLOWER]: Refusing update from remote peer 7ba59cc884714e8aa5f3f0ecaed84cbb: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 13:20:18.369102  6880 raft_consensus.cc:1275] T 3fa34c08b205435dba97346991aa1f92 P cd75a17ab2604397adab03bb8b5fd75c [term 14 FOLLOWER]: Refusing update from remote peer 7ba59cc884714e8aa5f3f0ecaed84cbb: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:20:18.369320  6770 leader_election.cc:304] T 30e88460611e47b2ba16a46a30b5f416 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:20:18.373205  7503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17587d6730594da4a56fa13a353232a1" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:20:18.229118 11309 consensus_queue.cc:237] T e31b9971c15848dea59d4d4130141d9e P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:18.374379  7503 raft_consensus.cc:2393] T 17587d6730594da4a56fa13a353232a1 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7ab4784c7344b939bc36f639286f377 in current term 17: Already voted for candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in this term.
I20260709 13:20:18.310931 11277 leader_election.cc:290] T 17587d6730594da4a56fa13a353232a1 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:20:18.376096  6878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7887766dc6784fcaa42b35c05fea7a99" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:20:18.377344  7495 raft_consensus.cc:1275] T d8cee0accdb8499c86d4414b72565a38 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 12 FOLLOWER]: Refusing update from remote peer cd75a17ab2604397adab03bb8b5fd75c: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:20:18.359879  6881 raft_consensus.cc:2468] T 90d42e216d9741e190bca19a781291fd P cd75a17ab2604397adab03bb8b5fd75c [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 12.
I20260709 13:20:18.386067  6873 raft_consensus.cc:1240] T f58dc08b12a2494bb9a1372837970ca2 P cd75a17ab2604397adab03bb8b5fd75c [term 15 FOLLOWER]: Rejecting Update request from peer b7ab4784c7344b939bc36f639286f377 for earlier term 14. Current term is 15. Ops: [14.8-14.8]
I20260709 13:20:18.377684  6697 leader_election.cc:304] T 427c124d773f483294511e80fe340075 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, b7ab4784c7344b939bc36f639286f377
I20260709 13:20:18.303087 10580 raft_consensus.cc:515] T 3a485a995abc4807b6e511e45419f737 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:18.302642 10938 raft_consensus.cc:515] T 3a485a995abc4807b6e511e45419f737 P b7ab4784c7344b939bc36f639286f377 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
W20260709 13:20:18.371299 11280 consensus_meta.cc:287] T 7c37d41cd9164c15a6826ca62a851a69 P cd75a17ab2604397adab03bb8b5fd75c: Time spent flushing consensus metadata: real 0.523s	user 0.002s	sys 0.009s
I20260709 13:20:18.370338 11118 raft_consensus.cc:2804] T 3d65025eea89441290d85dd053810e31 P b7ab4784c7344b939bc36f639286f377 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:20:18.341495 10969 raft_consensus.cc:515] T ab432e62819d499eaaf3dd55481dd930 P b7ab4784c7344b939bc36f639286f377 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:18.386902 11059 raft_consensus.cc:2749] T 30e88460611e47b2ba16a46a30b5f416 P b7ab4784c7344b939bc36f639286f377 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:20:18.390878  6878 raft_consensus.cc:3060] T 7887766dc6784fcaa42b35c05fea7a99 P cd75a17ab2604397adab03bb8b5fd75c [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:20:18.390642  6844 connection.cc:256] RPC call timeout handler was delayed by -2.5826619079998636s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2034s for a response
W20260709 13:20:18.412696  6844 connection.cc:256] RPC call timeout handler was delayed by -2.5763619079998534s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2041s for a response
W20260709 13:20:18.413913  6844 connection.cc:256] RPC call timeout handler was delayed by -2.5574619079998229s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2062s for a response
W20260709 13:20:18.426167  6696 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.657s	user 0.019s	sys 0.020s
W20260709 13:20:18.427942  6696 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.659s	user 0.019s	sys 0.020s
I20260709 13:20:18.431562  6873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5be3a11b23d4ea9b08300a2789821c7" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:18.431999  6770 leader_election.cc:304] T 3411566abe2d4c9bb4b2adfdd05e6f17 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
W20260709 13:20:18.397209 11267 consensus_meta.cc:287] T 853ac0a8cbd64ce99457f170216d4d0f P b7ab4784c7344b939bc36f639286f377: Time spent flushing consensus metadata: real 0.957s	user 0.011s	sys 0.001s
W20260709 13:20:18.397294 11259 consensus_meta.cc:287] T 8c7f33e544204fbaac4078e3e83bbf4e P b7ab4784c7344b939bc36f639286f377: Time spent flushing consensus metadata: real 0.993s	user 0.011s	sys 0.003s
W20260709 13:20:18.409997 11167 consensus_meta.cc:287] T b56bf91d90824c959e21e0cee5ba1816 P cd75a17ab2604397adab03bb8b5fd75c: Time spent flushing consensus metadata: real 0.872s	user 0.010s	sys 0.003s
I20260709 13:20:18.436585  6726 raft_consensus.cc:606] T 3a485a995abc4807b6e511e45419f737 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 12 FOLLOWER]: Received request to transfer leadership to TS cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:20:18.453327  6726 raft_consensus.cc:614] T 3a485a995abc4807b6e511e45419f737 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 12 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:20:18.432315  6873 raft_consensus.cc:2468] T f5be3a11b23d4ea9b08300a2789821c7 P cd75a17ab2604397adab03bb8b5fd75c [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 10.
I20260709 13:20:18.443090  6879 raft_consensus.cc:1240] T 4b8cacb381b746da8d0049b0a83b41dd P cd75a17ab2604397adab03bb8b5fd75c [term 13 LEADER]: Rejecting Update request from peer 7ba59cc884714e8aa5f3f0ecaed84cbb for earlier term 12. Current term is 13. Ops: []
W20260709 13:20:18.445070  7468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 92688.9us
I20260709 13:20:18.408149 11288 raft_consensus.cc:2749] T 427c124d773f483294511e80fe340075 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:20:18.450783  6844 connection.cc:256] RPC call timeout handler was delayed by -2.5133619079999789s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21110000000000004s for a response
W20260709 13:20:18.461508  6844 connection.cc:256] RPC call timeout handler was delayed by -2.5124619079999775s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21120000000000003s for a response
W20260709 13:20:18.461920  6844 connection.cc:256] RPC call timeout handler was delayed by -2.4971619079999527s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2129s for a response
W20260709 13:20:18.462280  6844 connection.cc:256] RPC call timeout handler was delayed by -2.4872619079999367s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21400000000000002s for a response
W20260709 13:20:18.462620  6844 connection.cc:256] RPC call timeout handler was delayed by -2.4683619079999062s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21610000000000001s for a response
W20260709 13:20:18.462981  6844 connection.cc:256] RPC call timeout handler was delayed by -2.4539619079998829s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2177s for a response
I20260709 13:20:18.452199  6725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbdf895bba214ff68685a24fd17dfb5d" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 11 candidate_status { last_received { term: 10 index: 4 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:18.464315  6802 raft_consensus.cc:1275] T 853ac0a8cbd64ce99457f170216d4d0f P b7ab4784c7344b939bc36f639286f377 [term 9 FOLLOWER]: Refusing update from remote peer cd75a17ab2604397adab03bb8b5fd75c: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:20:18.456648  6723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f58dc08b12a2494bb9a1372837970ca2" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:20:18.465437  6723 raft_consensus.cc:3060] T f58dc08b12a2494bb9a1372837970ca2 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:18.464273  6725 raft_consensus.cc:2468] T dbdf895bba214ff68685a24fd17dfb5d P ccd8a4c3bfe3413cb2ae219b09aea832 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 10.
I20260709 13:20:18.429840 11118 raft_consensus.cc:697] T 3d65025eea89441290d85dd053810e31 P b7ab4784c7344b939bc36f639286f377 [term 11 LEADER]: Becoming Leader. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
I20260709 13:20:18.472738  6730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b3759de40694069b13c0f8bd40e5709" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:18.539723  6730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "711ef6523deb4cbe8ef2ba61e1c21c98" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:18.538671  6731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d9def8b32fd443aa94ab1420b06837b" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:18.540656  6730 raft_consensus.cc:2468] T 711ef6523deb4cbe8ef2ba61e1c21c98 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 13.
I20260709 13:20:18.541102  6731 raft_consensus.cc:2468] T 4d9def8b32fd443aa94ab1420b06837b P ccd8a4c3bfe3413cb2ae219b09aea832 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 12.
I20260709 13:20:18.539529  6727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f9c2e2bf644115957398fe4c9459db" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:18.542261  6727 raft_consensus.cc:2468] T f3f9c2e2bf644115957398fe4c9459db P ccd8a4c3bfe3413cb2ae219b09aea832 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 11.
W20260709 13:20:18.463776 10989 consensus_meta.cc:287] T 07a92dd554674067a83a9cb68c4773f2 P b7ab4784c7344b939bc36f639286f377: Time spent flushing consensus metadata: real 0.929s	user 0.016s	sys 0.000s
I20260709 13:20:18.543843  6725 raft_consensus.cc:1275] T 24ee15416e3145beaa1b8183453729a3 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 13 FOLLOWER]: Refusing update from remote peer cd75a17ab2604397adab03bb8b5fd75c: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 8. (term mismatch)
I20260709 13:20:18.409848 11280 raft_consensus.cc:515] T 7c37d41cd9164c15a6826ca62a851a69 P cd75a17ab2604397adab03bb8b5fd75c [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:18.438179 10727 raft_consensus.cc:493] T 853ac0a8cbd64ce99457f170216d4d0f P ccd8a4c3bfe3413cb2ae219b09aea832 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:18.551165  6725 pending_rounds.cc:85] T 24ee15416e3145beaa1b8183453729a3 P ccd8a4c3bfe3413cb2ae219b09aea832: Aborting all ops after (but not including) 7
I20260709 13:20:18.556064  6728 raft_consensus.cc:1275] T de3186201e1a40d0b335eeb8b4e256e0 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 13 FOLLOWER]: Refusing update from remote peer cd75a17ab2604397adab03bb8b5fd75c: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:20:18.562069  6725 pending_rounds.cc:107] T 24ee15416e3145beaa1b8183453729a3 P ccd8a4c3bfe3413cb2ae219b09aea832: Aborting uncommitted NO_OP operation due to leader change: 8.8
I20260709 13:20:18.559338  6724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a485a995abc4807b6e511e45419f737" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:20:18.564324  6724 raft_consensus.cc:2368] T 3a485a995abc4807b6e511e45419f737 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c for earlier term 11. Current term is 12.
I20260709 13:20:18.563380  6725 raft_consensus.cc:2889] T 24ee15416e3145beaa1b8183453729a3 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:20:18.566133  6725 pending_rounds.cc:107] T 24ee15416e3145beaa1b8183453729a3 P ccd8a4c3bfe3413cb2ae219b09aea832: Aborting uncommitted NO_OP operation due to leader change: 10.9
I20260709 13:20:18.566491  6725 raft_consensus.cc:2889] T 24ee15416e3145beaa1b8183453729a3 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:20:18.566856  6725 pending_rounds.cc:107] T 24ee15416e3145beaa1b8183453729a3 P ccd8a4c3bfe3413cb2ae219b09aea832: Aborting uncommitted NO_OP operation due to leader change: 12.10
I20260709 13:20:18.567135  6725 raft_consensus.cc:2889] T 24ee15416e3145beaa1b8183453729a3 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:20:18.496024 11317 raft_consensus.cc:493] T a3022224cc81473690653a83d4e99470 P cd75a17ab2604397adab03bb8b5fd75c [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:18.625335  6727 raft_consensus.cc:1240] T c4db81d9d329422bb3b4160ca4ac2d1d P ccd8a4c3bfe3413cb2ae219b09aea832 [term 11 LEADER]: Rejecting Update request from peer cd75a17ab2604397adab03bb8b5fd75c for earlier term 10. Current term is 11. Ops: [10.7-10.7]
I20260709 13:20:18.464141 11211 consensus_queue.cc:1048] T a3022224cc81473690653a83d4e99470 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.115s
I20260709 13:20:18.543677 10983 raft_consensus.cc:493] T 34f36d59d88f40fe8a2805e604fc6c0a P ccd8a4c3bfe3413cb2ae219b09aea832 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:18.461980 11167 raft_consensus.cc:515] T b56bf91d90824c959e21e0cee5ba1816 P cd75a17ab2604397adab03bb8b5fd75c [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:18.461691 11259 raft_consensus.cc:515] T 8c7f33e544204fbaac4078e3e83bbf4e P b7ab4784c7344b939bc36f639286f377 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:18.550449 11326 raft_consensus.cc:493] T 7a734b5ab7834e05a8c422208acc58b1 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:20:18.634619  7466 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 344933us
W20260709 13:20:18.651458  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 152731us
I20260709 13:20:18.652843  6878 raft_consensus.cc:2468] T 7887766dc6784fcaa42b35c05fea7a99 P cd75a17ab2604397adab03bb8b5fd75c [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 13.
W20260709 13:20:18.647311 11172 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.781s	user 0.028s	sys 0.024s
I20260709 13:20:18.499698 11315 consensus_queue.cc:1048] T d8cee0accdb8499c86d4414b72565a38 P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.185s
I20260709 13:20:18.557348 10989 raft_consensus.cc:515] T 07a92dd554674067a83a9cb68c4773f2 P b7ab4784c7344b939bc36f639286f377 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
W20260709 13:20:18.670528  7467 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:18.697678  6807 raft_consensus.cc:1240] T 8c7f33e544204fbaac4078e3e83bbf4e P b7ab4784c7344b939bc36f639286f377 [term 10 FOLLOWER]: Rejecting Update request from peer ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 9. Current term is 10. Ops: [9.6-9.6]
I20260709 13:20:18.642900 10727 raft_consensus.cc:515] T 853ac0a8cbd64ce99457f170216d4d0f P ccd8a4c3bfe3413cb2ae219b09aea832 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
W20260709 13:20:18.700026  6772 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 237613us
W20260709 13:20:18.682945  6832 heartbeater.cc:646] Failed to heartbeat to 127.5.126.126:34367 (2 consecutive failures): Timed out: Failed to send heartbeat to master: TSHeartbeat RPC to 127.5.126.126:34367 timed out after 15.000s (SENT)
W20260709 13:20:18.701413  6770 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 261722us
W20260709 13:20:18.701086  6844 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.5.126.66:42817 timed out after 1.806s (SENT) [suppressed 9 similar messages]
W20260709 13:20:18.687772 11172 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.821s	user 0.028s	sys 0.027s
W20260709 13:20:18.710847  6697 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.68:45071, user_credentials={real_user=slave}} blocked reactor thread for 333239us
I20260709 13:20:18.704957  6770 leader_election.cc:304] T 713b5728a197487c9300b310ab94e5a3 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:20:18.706005  6875 raft_consensus.cc:1240] T 7c37d41cd9164c15a6826ca62a851a69 P cd75a17ab2604397adab03bb8b5fd75c [term 12 FOLLOWER]: Rejecting Update request from peer b7ab4784c7344b939bc36f639286f377 for earlier term 11. Current term is 12. Ops: []
I20260709 13:20:18.701941  6723 raft_consensus.cc:2468] T f58dc08b12a2494bb9a1372837970ca2 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 15.
I20260709 13:20:18.711879  6697 leader_election.cc:400] T 3fa34c08b205435dba97346991aa1f92 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 13 pre-election: Vote denied by peer 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071) with higher term. Message: Invalid argument: T 3fa34c08b205435dba97346991aa1f92 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 13. Current term is 14.
I20260709 13:20:18.659211 11267 consensus_queue.cc:1048] T a3022224cc81473690653a83d4e99470 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.053s
I20260709 13:20:18.718768  6806 raft_consensus.cc:1240] T 7a734b5ab7834e05a8c422208acc58b1 P b7ab4784c7344b939bc36f639286f377 [term 13 LEADER]: Rejecting Update request from peer ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 11. Current term is 13. Ops: [11.5-11.5]
I20260709 13:20:18.718987  6697 leader_election.cc:304] T b3f13b31a1f84f0d89d007eadd57924c P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, b7ab4784c7344b939bc36f639286f377
I20260709 13:20:18.626556 11317 raft_consensus.cc:515] T a3022224cc81473690653a83d4e99470 P cd75a17ab2604397adab03bb8b5fd75c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:18.724179  6772 leader_election.cc:304] T 20f6842e26174571996b8dea4151d4be P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:20:18.720654 11298 raft_consensus.cc:2749] T b3f13b31a1f84f0d89d007eadd57924c P ccd8a4c3bfe3413cb2ae219b09aea832 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:20:18.726012 11324 log.cc:927] Time spent T 07a92dd554674067a83a9cb68c4773f2 P ccd8a4c3bfe3413cb2ae219b09aea832: Append to log took a long time: real 0.276s	user 0.000s	sys 0.001s
I20260709 13:20:18.727725 10989 leader_election.cc:290] T 07a92dd554674067a83a9cb68c4773f2 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 12 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:18.714035 11300 raft_consensus.cc:3055] T 9b3759de40694069b13c0f8bd40e5709 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:20:18.711195 11038 leader_election.cc:290] T 2c240553ce044eedb41541d72b9475d7 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:18.659945 10983 raft_consensus.cc:515] T 34f36d59d88f40fe8a2805e604fc6c0a P ccd8a4c3bfe3413cb2ae219b09aea832 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
W20260709 13:20:18.740094 11327 log.cc:927] Time spent T f4b8bd455d5a47c18a1380839c6e0d61 P cd75a17ab2604397adab03bb8b5fd75c: Append to log took a long time: real 0.053s	user 0.001s	sys 0.000s
W20260709 13:20:18.742110 11323 log.cc:927] Time spent T 9e326172347f45e99a0d482b5d8ef768 P b7ab4784c7344b939bc36f639286f377: Append to log took a long time: real 0.099s	user 0.000s	sys 0.001s
I20260709 13:20:18.742503 10983 leader_election.cc:290] T 34f36d59d88f40fe8a2805e604fc6c0a P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:18.743821 11259 leader_election.cc:290] T 8c7f33e544204fbaac4078e3e83bbf4e P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 10 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:18.687089 11326 raft_consensus.cc:515] T 7a734b5ab7834e05a8c422208acc58b1 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
W20260709 13:20:18.739949  6844 connection.cc:256] RPC call timeout handler was delayed by -2.1947619079999185s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2465s for a response
I20260709 13:20:18.714252 11288 raft_consensus.cc:493] T e31b9971c15848dea59d4d4130141d9e P ccd8a4c3bfe3413cb2ae219b09aea832 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:18.711040 11117 leader_election.cc:290] T be1a92657f494cac8dd227d152f50151 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 14 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:20:18.707854 10818 leader_election.cc:290] T e31b9971c15848dea59d4d4130141d9e P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
W20260709 13:20:18.747500  6698 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:18.732300 11342 raft_consensus.cc:2749] T 713b5728a197487c9300b310ab94e5a3 P b7ab4784c7344b939bc36f639286f377 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:20:18.753625  6772 leader_election.cc:304] T bb7fa124c3bf4ef9ab65a407cb008441 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, cd75a17ab2604397adab03bb8b5fd75c
W20260709 13:20:18.757089  6844 connection.cc:256] RPC call timeout handler was delayed by -2.070327941999949s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2275s for a response
W20260709 13:20:18.758427  6844 connection.cc:256] RPC call timeout handler was delayed by -1.7834619079999356s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2922s for a response
W20260709 13:20:18.758934  6844 connection.cc:256] RPC call timeout handler was delayed by -1.7312619079998512s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.298s for a response
W20260709 13:20:18.759347  6844 connection.cc:256] RPC call timeout handler was delayed by -1.544281354000077s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1517s for a response
W20260709 13:20:18.759748  6844 connection.cc:256] RPC call timeout handler was delayed by -1.5253813540000465s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15380000000000002s for a response
W20260709 13:20:18.760190  6844 connection.cc:256] RPC call timeout handler was delayed by -1.4902813539999897s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1577s for a response
W20260709 13:20:18.760588  6844 connection.cc:256] RPC call timeout handler was delayed by -1.3966813540000658s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16810000000000003s for a response
W20260709 13:20:18.760931  6844 connection.cc:256] RPC call timeout handler was delayed by -1.3705813540000236s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.171s for a response
W20260709 13:20:18.761339  6844 connection.cc:256] RPC call timeout handler was delayed by -1.3597813540000061s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17220000000000002s for a response
W20260709 13:20:18.761673  6844 connection.cc:256] RPC call timeout handler was delayed by -1.3399813539999741s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1744s for a response
W20260709 13:20:18.762099  6844 connection.cc:256] RPC call timeout handler was delayed by -1.3327813539999624s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17520000000000002s for a response
W20260709 13:20:18.762480  6844 connection.cc:256] RPC call timeout handler was delayed by -1.3111813539999275s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1776s for a response
W20260709 13:20:18.762841  6844 connection.cc:256] RPC call timeout handler was delayed by -1.2355813540000327s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18600000000000003s for a response
I20260709 13:20:18.763741 10580 leader_election.cc:290] T 3a485a995abc4807b6e511e45419f737 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 12 election: Requested vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:18.768782 11280 leader_election.cc:290] T 7c37d41cd9164c15a6826ca62a851a69 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 12 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
W20260709 13:20:18.763211  6844 connection.cc:256] RPC call timeout handler was delayed by -1.2274813540000196s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1869s for a response
W20260709 13:20:18.770793  6844 connection.cc:256] RPC call timeout handler was delayed by -1.2139813539999977s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1884s for a response
I20260709 13:20:18.722582 11334 raft_consensus.cc:493] T 4b8cacb381b746da8d0049b0a83b41dd P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:20:18.764374  7466 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 71614.5us
W20260709 13:20:18.771628  6844 connection.cc:256] RPC call timeout handler was delayed by -1.2112813539999934s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1887s for a response
I20260709 13:20:18.774758  6772 leader_election.cc:304] T 90d42e216d9741e190bca19a781291fd P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
W20260709 13:20:18.775303  6844 connection.cc:256] RPC call timeout handler was delayed by -1.1293813540000883s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1978s for a response
I20260709 13:20:18.732584 11167 leader_election.cc:290] T b56bf91d90824c959e21e0cee5ba1816 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 12 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:20:18.777164  6772 leader_election.cc:304] T f5be3a11b23d4ea9b08300a2789821c7 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:20:18.778980  6800 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:32976 (request call id 2884) took 1395 ms. Trace:
I20260709 13:20:18.737128 11300 raft_consensus.cc:740] T 9b3759de40694069b13c0f8bd40e5709 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
W20260709 13:20:18.787894  6697 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.68:45071, user_credentials={real_user=slave}} blocked reactor thread for 68977.9us
I20260709 13:20:18.757781 10938 leader_election.cc:290] T 3a485a995abc4807b6e511e45419f737 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 12 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:18.790227  6697 leader_election.cc:304] T 404190ce4ce94cecbfcb6ea9d1dd8626 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, b7ab4784c7344b939bc36f639286f377
I20260709 13:20:18.795532  7503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be1a92657f494cac8dd227d152f50151" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb"
I20260709 13:20:18.776770 10969 leader_election.cc:290] T ab432e62819d499eaaf3dd55481dd930 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:18.780092 11292 raft_consensus.cc:2749] T bb7fa124c3bf4ef9ab65a407cb008441 P b7ab4784c7344b939bc36f639286f377 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:20:18.782037 11117 raft_consensus.cc:2804] T 90d42e216d9741e190bca19a781291fd P b7ab4784c7344b939bc36f639286f377 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:20:18.764618 11288 raft_consensus.cc:515] T e31b9971c15848dea59d4d4130141d9e P ccd8a4c3bfe3413cb2ae219b09aea832 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:18.777297 11316 raft_consensus.cc:493] T 427c124d773f483294511e80fe340075 P cd75a17ab2604397adab03bb8b5fd75c [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:20:18.812027  6772 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:18.807582 11341 raft_consensus.cc:2804] T 20f6842e26174571996b8dea4151d4be P b7ab4784c7344b939bc36f639286f377 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:20:18.720232 11118 consensus_queue.cc:237] T 3d65025eea89441290d85dd053810e31 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 10.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:18.778987 10727 leader_election.cc:290] T 853ac0a8cbd64ce99457f170216d4d0f P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:18.786412 11259 raft_consensus.cc:2804] T f5be3a11b23d4ea9b08300a2789821c7 P b7ab4784c7344b939bc36f639286f377 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:20:18.803871  6844 leader_election.cc:304] T f5be3a11b23d4ea9b08300a2789821c7 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:20:18.782481 11334 raft_consensus.cc:515] T 4b8cacb381b746da8d0049b0a83b41dd P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:20:18.827361 11300 consensus_queue.cc:260] T 9b3759de40694069b13c0f8bd40e5709 P ccd8a4c3bfe3413cb2ae219b09aea832 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:18.830919 11317 leader_election.cc:290] T a3022224cc81473690653a83d4e99470 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:20:18.805109 11277 raft_consensus.cc:3060] T 3411566abe2d4c9bb4b2adfdd05e6f17 P b7ab4784c7344b939bc36f639286f377 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:20:18.799626 11298 raft_consensus.cc:2749] T 404190ce4ce94cecbfcb6ea9d1dd8626 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:20:18.782948  6800 rpcz_store.cc:276] 0709 13:20:17.369945 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:17.373802 (+  3857us) service_pool.cc:224] Handling call
0709 13:20:17.379135 (+  5333us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:17.379429 (+   294us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:20:18.244806 (+865377us) log.cc:844] Serialized 14 byte log entry
0709 13:20:18.567744 (+322938us) log.cc:844] Serialized 14 byte log entry
0709 13:20:18.627718 (+ 59974us) log.cc:844] Serialized 14 byte log entry
0709 13:20:18.697313 (+ 69595us) log.cc:844] Serialized 14 byte log entry
0709 13:20:18.764789 (+ 67476us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:20:18.764870 (+    81us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:20:18.764970 (+   100us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:18.765076 (+   106us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:18.765258 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":11276,"prepare.queue_time_us":1059172,"prepare.run_cpu_time_us":155,"prepare.run_wall_time_us":1856,"raft.queue_time_us":403856,"raft.run_cpu_time_us":191,"raft.run_wall_time_us":187,"spinlock_wait_cycles":42193920,"thread_start_us":1276288,"threads_started":4,"wal-append.queue_time_us":458897}
I20260709 13:20:18.862795  6729 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50004 (request call id 2105) took 1810 ms. Trace:
I20260709 13:20:18.818796  6803 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:32976 (request call id 2888) took 1441 ms. Trace:
W20260709 13:20:18.835151  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 45030.2us
I20260709 13:20:18.848654  6798 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50550 (request call id 452) took 2915 ms. Trace:
I20260709 13:20:18.819602 11172 raft_consensus.cc:493] T 1528ab62b6fe4e3099d08f141afee116 P b7ab4784c7344b939bc36f639286f377 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 7ba59cc884714e8aa5f3f0ecaed84cbb)
W20260709 13:20:18.818434 11252 consensus_meta.cc:287] T f58dc08b12a2494bb9a1372837970ca2 P b7ab4784c7344b939bc36f639286f377: Time spent flushing consensus metadata: real 0.596s	user 0.013s	sys 0.000s
I20260709 13:20:18.828751 11326 leader_election.cc:290] T 7a734b5ab7834e05a8c422208acc58b1 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:18.863066  6878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c7f33e544204fbaac4078e3e83bbf4e" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:20:18.879281  6878 raft_consensus.cc:3060] T 8c7f33e544204fbaac4078e3e83bbf4e P cd75a17ab2604397adab03bb8b5fd75c [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:20:18.800880  6799 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:32976 (request call id 2882) took 1431 ms. Trace:
I20260709 13:20:18.808223 11353 raft_consensus.cc:493] T bd6869f07b5a4885a0b99fbe60c3b175 P b7ab4784c7344b939bc36f639286f377 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:18.865176  6873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a485a995abc4807b6e511e45419f737" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:20:18.862032  6876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a92dd554674067a83a9cb68c4773f2" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:20:18.873447  6798 rpcz_store.cc:276] 0709 13:20:15.933270 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:15.943339 (+ 10069us) service_pool.cc:224] Handling call
0709 13:20:15.943709 (+   370us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:17.295649 (+1351940us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:18.848302 (+1552653us) spinlock_profiling.cc:243] Waited 1.35 s on lock 0x7b5400331b54. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f9aae01 00007fcc0f9a983e 00007fcc1496e419 00007fcc0dee5bd4 00007fcc0dee5b62 00007fcc0dee5a91 00007fcc0dee5a0c 00007fcc0dee4cc2 00007fcc0dce548c 00007fcc0dce48c6
0709 13:20:18.848574 (+   272us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3094174592}
I20260709 13:20:18.872660  6729 rpcz_store.cc:276] 0709 13:20:17.052077 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:17.052207 (+   130us) service_pool.cc:224] Handling call
0709 13:20:18.862516 (+1810309us) spinlock_profiling.cc:243] Waited 982 ms on lock 0x7b54000e4554. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f9ae2fa 00007fcc1496fb17 00007fcc0deea6d4 00007fcc0deea662 00007fcc0deea591 00007fcc0deea50c 00007fcc0dee97c2 00007fcc0dce548c 00007fcc0dce48c6 00007fcc0dce426f
0709 13:20:18.862724 (+   208us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2257540096}
I20260709 13:20:18.822763  6697 leader_election.cc:304] T be1a92657f494cac8dd227d152f50151 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, b7ab4784c7344b939bc36f639286f377
I20260709 13:20:18.875850  6803 rpcz_store.cc:276] 0709 13:20:17.377792 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:17.459234 (+ 81442us) service_pool.cc:224] Handling call
0709 13:20:17.503634 (+ 44400us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:17.539797 (+ 36163us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:17.539851 (+    54us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:20:17.540709 (+   858us) log.cc:844] Serialized 26 byte log entry
0709 13:20:18.112631 (+571922us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:20:18.112695 (+    64us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:18.800115 (+687420us) spinlock_profiling.cc:243] Waited 23.7 ms on lock 0x7b540028aad4. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f9aae01 00007fcc0f9a983e 00007fcc1496e419 00007fcc0dee5bd4 00007fcc0dee5b62 00007fcc0dee5a91 00007fcc0dee5a0c 00007fcc0dee4cc2 00007fcc0dce548c 00007fcc0dce48c6
0709 13:20:18.800166 (+    51us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:18.800298 (+   132us) raft_consensus.cc:1685] finished
0709 13:20:18.800319 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:18.818728 (+ 18409us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":15151,"raft.queue_time_us":12446,"raft.run_cpu_time_us":184,"raft.run_wall_time_us":66871,"spinlock_wait_cycles":54458752,"thread_start_us":475199,"threads_started":1,"wal-append.queue_time_us":832164}
I20260709 13:20:18.861483  6874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e31b9971c15848dea59d4d4130141d9e" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:18.881227  6873 raft_consensus.cc:3060] T 3a485a995abc4807b6e511e45419f737 P cd75a17ab2604397adab03bb8b5fd75c [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:20:18.831794 11300 raft_consensus.cc:3060] T 9b3759de40694069b13c0f8bd40e5709 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:20:18.833933 11332 log.cc:927] Time spent T 20f6842e26174571996b8dea4151d4be P b7ab4784c7344b939bc36f639286f377: Append to log took a long time: real 0.098s	user 0.000s	sys 0.001s
I20260709 13:20:18.828022 11316 raft_consensus.cc:515] T 427c124d773f483294511e80fe340075 P cd75a17ab2604397adab03bb8b5fd75c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } attrs { replace: true } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:20:18.927237  6876 raft_consensus.cc:3060] T 07a92dd554674067a83a9cb68c4773f2 P cd75a17ab2604397adab03bb8b5fd75c [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:20:18.927874  6881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab432e62819d499eaaf3dd55481dd930" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
W20260709 13:20:18.944689  6698 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:18.856699 11167 raft_consensus.cc:493] T 3fa34c08b205435dba97346991aa1f92 P cd75a17ab2604397adab03bb8b5fd75c [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:18.951129  6881 raft_consensus.cc:2468] T ab432e62819d499eaaf3dd55481dd930 P cd75a17ab2604397adab03bb8b5fd75c [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 13.
W20260709 13:20:18.955320  6770 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 250459us
W20260709 13:20:18.837697 11051 consensus_meta.cc:287] T bb3d8792045a4583ae2e965b1350a5b4 P cd75a17ab2604397adab03bb8b5fd75c: Time spent flushing consensus metadata: real 0.541s	user 0.007s	sys 0.004s
I20260709 13:20:18.956739  6770 leader_election.cc:304] T de3186201e1a40d0b335eeb8b4e256e0 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:20:18.831964 11334 leader_election.cc:290] T 4b8cacb381b746da8d0049b0a83b41dd P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:18.829192 10580 raft_consensus.cc:493] T bb3d8792045a4583ae2e965b1350a5b4 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 7ba59cc884714e8aa5f3f0ecaed84cbb)
I20260709 13:20:18.970523  6772 leader_election.cc:304] T 7887766dc6784fcaa42b35c05fea7a99 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:20:18.829368 11259 raft_consensus.cc:493] T f5be3a11b23d4ea9b08300a2789821c7 P b7ab4784c7344b939bc36f639286f377 [term 10 FOLLOWER]: Starting leader election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:20:18.855645 11288 leader_election.cc:290] T e31b9971c15848dea59d4d4130141d9e P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:18.880865  6799 rpcz_store.cc:276] 0709 13:20:17.369223 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:17.369806 (+   583us) service_pool.cc:224] Handling call
0709 13:20:17.379354 (+  9548us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:17.379606 (+   252us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:20:18.222460 (+842854us) log.cc:844] Serialized 14 byte log entry
0709 13:20:18.798269 (+575809us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:20:18.798373 (+   104us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:20:18.798423 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:18.798515 (+    92us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:18.800812 (+  2297us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":38032,"prepare.queue_time_us":1081026,"prepare.run_cpu_time_us":43,"prepare.run_wall_time_us":59,"raft.queue_time_us":88626,"raft.run_cpu_time_us":141,"raft.run_wall_time_us":142,"spinlock_wait_cycles":5524224,"thread_start_us":1362502,"threads_started":3,"wal-append.queue_time_us":583739}
W20260709 13:20:18.847892 11307 log.cc:927] Time spent T c4db81d9d329422bb3b4160ca4ac2d1d P ccd8a4c3bfe3413cb2ae219b09aea832: Append to log took a long time: real 1.235s	user 0.000s	sys 0.015s
I20260709 13:20:18.834412 11117 raft_consensus.cc:697] T 90d42e216d9741e190bca19a781291fd P b7ab4784c7344b939bc36f639286f377 [term 12 LEADER]: Becoming Leader. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
I20260709 13:20:18.973853  6877 raft_consensus.cc:1275] T bb3d8792045a4583ae2e965b1350a5b4 P cd75a17ab2604397adab03bb8b5fd75c [term 10 FOLLOWER]: Refusing update from remote peer 7ba59cc884714e8aa5f3f0ecaed84cbb: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:20:18.964586 11354 raft_consensus.cc:493] T 7ba5dac66ab5497e9e336f2a3c28cda5 P b7ab4784c7344b939bc36f639286f377 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 7ba59cc884714e8aa5f3f0ecaed84cbb)
I20260709 13:20:18.835700 11066 raft_consensus.cc:2749] T f5be3a11b23d4ea9b08300a2789821c7 P cd75a17ab2604397adab03bb8b5fd75c [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:20:18.976354  6878 raft_consensus.cc:2468] T 8c7f33e544204fbaac4078e3e83bbf4e P cd75a17ab2604397adab03bb8b5fd75c [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 10.
I20260709 13:20:18.909171 11351 raft_consensus.cc:493] T 24ee15416e3145beaa1b8183453729a3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 13 FOLLOWER]: Starting pre-election (detected failure of leader cd75a17ab2604397adab03bb8b5fd75c)
I20260709 13:20:18.982853  6800 raft_consensus.cc:1240] T 3d65025eea89441290d85dd053810e31 P b7ab4784c7344b939bc36f639286f377 [term 11 LEADER]: Rejecting Update request from peer ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 10. Current term is 11. Ops: []
I20260709 13:20:18.884064 10818 raft_consensus.cc:493] T b3f13b31a1f84f0d89d007eadd57924c P b7ab4784c7344b939bc36f639286f377 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 7ba59cc884714e8aa5f3f0ecaed84cbb)
I20260709 13:20:18.955039 11326 raft_consensus.cc:493] T 3411566abe2d4c9bb4b2adfdd05e6f17 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:18.989432  6844 leader_election.cc:304] T 3d65025eea89441290d85dd053810e31 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
W20260709 13:20:18.992422  6697 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.68:45071, user_credentials={real_user=slave}} blocked reactor thread for 169782us
I20260709 13:20:19.001861  6697 leader_election.cc:304] T fe20b4b48823486ca3b9c648db6ce8aa P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:20:18.965011 11252 raft_consensus.cc:493] T f4b8bd455d5a47c18a1380839c6e0d61 P b7ab4784c7344b939bc36f639286f377 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:18.994441  6772 leader_election.cc:304] T ab432e62819d499eaaf3dd55481dd930 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:20:18.977279 10989 raft_consensus.cc:2749] T de3186201e1a40d0b335eeb8b4e256e0 P b7ab4784c7344b939bc36f639286f377 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:20:19.045102  7500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "427c124d773f483294511e80fe340075" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:20:18.884423 11172 raft_consensus.cc:515] T 1528ab62b6fe4e3099d08f141afee116 P b7ab4784c7344b939bc36f639286f377 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:20:19.024538 11351 raft_consensus.cc:515] T 24ee15416e3145beaa1b8183453729a3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:20:19.029495  7503 raft_consensus.cc:1275] T 4b8cacb381b746da8d0049b0a83b41dd P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 13 FOLLOWER]: Refusing update from remote peer cd75a17ab2604397adab03bb8b5fd75c: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:20:19.029954 11288 raft_consensus.cc:2749] T fe20b4b48823486ca3b9c648db6ce8aa P ccd8a4c3bfe3413cb2ae219b09aea832 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:20:18.969954 11167 raft_consensus.cc:515] T 3fa34c08b205435dba97346991aa1f92 P cd75a17ab2604397adab03bb8b5fd75c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:20:19.034718 11314 raft_consensus.cc:3055] T c4db81d9d329422bb3b4160ca4ac2d1d P cd75a17ab2604397adab03bb8b5fd75c [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:20:19.036145 10818 raft_consensus.cc:515] T b3f13b31a1f84f0d89d007eadd57924c P b7ab4784c7344b939bc36f639286f377 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:20:18.990531 11342 raft_consensus.cc:493] T 404190ce4ce94cecbfcb6ea9d1dd8626 P b7ab4784c7344b939bc36f639286f377 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 7ba59cc884714e8aa5f3f0ecaed84cbb)
I20260709 13:20:19.169152  6873 raft_consensus.cc:2468] T 3a485a995abc4807b6e511e45419f737 P cd75a17ab2604397adab03bb8b5fd75c [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 12.
I20260709 13:20:18.993877 11118 raft_consensus.cc:493] T 427c124d773f483294511e80fe340075 P b7ab4784c7344b939bc36f639286f377 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 7ba59cc884714e8aa5f3f0ecaed84cbb)
I20260709 13:20:18.989547 11175 raft_consensus.cc:493] T bb3d8792045a4583ae2e965b1350a5b4 P cd75a17ab2604397adab03bb8b5fd75c [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:20:19.042428  6772 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 48162.4us
I20260709 13:20:18.977577 10580 raft_consensus.cc:515] T bb3d8792045a4583ae2e965b1350a5b4 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
W20260709 13:20:19.043291 11329 log.cc:927] Time spent T 3411566abe2d4c9bb4b2adfdd05e6f17 P b7ab4784c7344b939bc36f639286f377: Append to log took a long time: real 0.237s	user 0.000s	sys 0.000s
I20260709 13:20:19.043401 11316 leader_election.cc:290] T 427c124d773f483294511e80fe340075 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:20:19.044261 11292 raft_consensus.cc:2804] T ab432e62819d499eaaf3dd55481dd930 P b7ab4784c7344b939bc36f639286f377 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:20:19.029547  6844 leader_election.cc:304] T f03d0dbf16864ca4bc1bb5e4c0334c0f P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:20:18.978008 11259 raft_consensus.cc:3060] T f5be3a11b23d4ea9b08300a2789821c7 P b7ab4784c7344b939bc36f639286f377 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:20:19.031412 11326 raft_consensus.cc:515] T 3411566abe2d4c9bb4b2adfdd05e6f17 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:18.977159 11311 raft_consensus.cc:2749] T be1a92657f494cac8dd227d152f50151 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:20:19.033720 11286 raft_consensus.cc:2749] T 3d65025eea89441290d85dd053810e31 P cd75a17ab2604397adab03bb8b5fd75c [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:20:18.987716 11347 raft_consensus.cc:2804] T 7887766dc6784fcaa42b35c05fea7a99 P b7ab4784c7344b939bc36f639286f377 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:20:18.934778 11353 raft_consensus.cc:515] T bd6869f07b5a4885a0b99fbe60c3b175 P b7ab4784c7344b939bc36f639286f377 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:19.266800  6802 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:32966 (request call id 1107) took 2579 ms. Trace:
I20260709 13:20:19.267411  6802 rpcz_store.cc:276] 0709 13:20:16.687844 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:17.237298 (+549454us) service_pool.cc:224] Handling call
0709 13:20:17.237671 (+   373us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:18.465157 (+1227486us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:19.266432 (+801275us) spinlock_profiling.cc:243] Waited 1.21 s on lock 0x7b54001b53d4. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f9aae01 00007fcc0f9a983e 00007fcc1496e419 00007fcc0dee5bd4 00007fcc0dee5b62 00007fcc0dee5a91 00007fcc0dee5a0c 00007fcc0dee4cc2 00007fcc0dce548c 00007fcc0dce48c6
0709 13:20:19.266712 (+   280us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2793829120}
W20260709 13:20:19.186352  6697 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.68:45071, user_credentials={real_user=slave}} blocked reactor thread for 184556us
I20260709 13:20:19.198333  6772 leader_election.cc:304] T 8c7f33e544204fbaac4078e3e83bbf4e P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:20:19.219806  6876 raft_consensus.cc:2468] T 07a92dd554674067a83a9cb68c4773f2 P cd75a17ab2604397adab03bb8b5fd75c [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 12.
I20260709 13:20:19.036427 11252 raft_consensus.cc:515] T f4b8bd455d5a47c18a1380839c6e0d61 P b7ab4784c7344b939bc36f639286f377 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
W20260709 13:20:19.181617 11332 log.cc:927] Time spent T 20f6842e26174571996b8dea4151d4be P b7ab4784c7344b939bc36f639286f377: Append to log took a long time: real 0.135s	user 0.001s	sys 0.000s
I20260709 13:20:19.169130 11066 raft_consensus.cc:493] T 34f36d59d88f40fe8a2805e604fc6c0a P cd75a17ab2604397adab03bb8b5fd75c [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:19.171350 11298 raft_consensus.cc:493] T 30e88460611e47b2ba16a46a30b5f416 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:19.171599 10727 raft_consensus.cc:493] T a1704639a875409b9959353527b3fd68 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:19.168687 11314 raft_consensus.cc:740] T c4db81d9d329422bb3b4160ca4ac2d1d P cd75a17ab2604397adab03bb8b5fd75c [term 10 LEADER]: Becoming Follower/Learner. State: Replica: cd75a17ab2604397adab03bb8b5fd75c, State: Running, Role: LEADER
I20260709 13:20:19.215780 11309 raft_consensus.cc:493] T ce4f062dcd314d43a63ca74067cb5ee3 P cd75a17ab2604397adab03bb8b5fd75c [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:19.318151  7500 raft_consensus.cc:1240] T 17587d6730594da4a56fa13a353232a1 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 17 FOLLOWER]: Rejecting Update request from peer ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 16. Current term is 17. Ops: [16.11-16.11]
I20260709 13:20:19.280426  6876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4db81d9d329422bb3b4160ca4ac2d1d" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
W20260709 13:20:19.301679  6695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 73009.9us
I20260709 13:20:19.195814 11342 raft_consensus.cc:515] T 404190ce4ce94cecbfcb6ea9d1dd8626 P b7ab4784c7344b939bc36f639286f377 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:20:19.343010 11342 leader_election.cc:290] T 404190ce4ce94cecbfcb6ea9d1dd8626 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:20:19.349589 10818 leader_election.cc:290] T b3f13b31a1f84f0d89d007eadd57924c P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
W20260709 13:20:19.350767 11358 log.cc:927] Time spent T 3d65025eea89441290d85dd053810e31 P b7ab4784c7344b939bc36f639286f377: Append to log took a long time: real 0.074s	user 0.000s	sys 0.000s
I20260709 13:20:19.354417 11314 consensus_queue.cc:260] T c4db81d9d329422bb3b4160ca4ac2d1d P cd75a17ab2604397adab03bb8b5fd75c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:19.355538 11314 raft_consensus.cc:3060] T c4db81d9d329422bb3b4160ca4ac2d1d P cd75a17ab2604397adab03bb8b5fd75c [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:20:19.357051 11288 raft_consensus.cc:493] T f4b8bd455d5a47c18a1380839c6e0d61 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:19.269501 11117 consensus_queue.cc:237] T 90d42e216d9741e190bca19a781291fd P b7ab4784c7344b939bc36f639286f377 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:19.357554 11288 raft_consensus.cc:515] T f4b8bd455d5a47c18a1380839c6e0d61 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
W20260709 13:20:19.305545  6770 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 309737us
I20260709 13:20:18.998332 11354 raft_consensus.cc:515] T 7ba5dac66ab5497e9e336f2a3c28cda5 P b7ab4784c7344b939bc36f639286f377 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
W20260709 13:20:19.309005  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 279529us
I20260709 13:20:19.237527 11118 raft_consensus.cc:515] T 427c124d773f483294511e80fe340075 P b7ab4784c7344b939bc36f639286f377 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } attrs { replace: true } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
W20260709 13:20:19.310011  6772 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 111787us
I20260709 13:20:19.310436  7503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24ee15416e3145beaa1b8183453729a3" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:20:19.310770  6873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "711ef6523deb4cbe8ef2ba61e1c21c98" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:20:19.314314  6874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d33d5ee8ef6f415593d8df52063161ad" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:19.278038 11317 raft_consensus.cc:2749] T f03d0dbf16864ca4bc1bb5e4c0334c0f P cd75a17ab2604397adab03bb8b5fd75c [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:20:19.315716  6880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b56bf91d90824c959e21e0cee5ba1816" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:19.218466 11292 raft_consensus.cc:493] T ab432e62819d499eaaf3dd55481dd930 P b7ab4784c7344b939bc36f639286f377 [term 13 FOLLOWER]: Starting leader election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:20:19.216575 11175 raft_consensus.cc:515] T bb3d8792045a4583ae2e965b1350a5b4 P cd75a17ab2604397adab03bb8b5fd75c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:20:19.280160 11347 raft_consensus.cc:697] T 7887766dc6784fcaa42b35c05fea7a99 P b7ab4784c7344b939bc36f639286f377 [term 13 LEADER]: Becoming Leader. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
I20260709 13:20:19.283087  6878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4b8bd455d5a47c18a1380839c6e0d61" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:20:19.610332  6876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22ccee1b570c4ad3a57bd7aec085b1b4" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:19.679466  6878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7887766dc6784fcaa42b35c05fea7a99" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:19.680503  7503 raft_consensus.cc:2410] T 24ee15416e3145beaa1b8183453729a3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ccd8a4c3bfe3413cb2ae219b09aea832 for term 14 because replica has last-logged OpId of term: 13 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 10.
I20260709 13:20:19.679813  6873 raft_consensus.cc:2393] T 711ef6523deb4cbe8ef2ba61e1c21c98 P cd75a17ab2604397adab03bb8b5fd75c [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate ccd8a4c3bfe3413cb2ae219b09aea832 in current term 13: Already voted for candidate b7ab4784c7344b939bc36f639286f377 in this term.
I20260709 13:20:19.686861  6873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d9def8b32fd443aa94ab1420b06837b" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:19.679553  6772 leader_election.cc:304] T 3a485a995abc4807b6e511e45419f737 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:20:19.680789  6878 raft_consensus.cc:2393] T 7887766dc6784fcaa42b35c05fea7a99 P cd75a17ab2604397adab03bb8b5fd75c [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ccd8a4c3bfe3413cb2ae219b09aea832 in current term 13: Already voted for candidate b7ab4784c7344b939bc36f639286f377 in this term.
I20260709 13:20:19.485749  7495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3d8792045a4583ae2e965b1350a5b4" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:20:19.683101  6770 leader_election.cc:304] T a1704639a875409b9959353527b3fd68 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:20:19.712721  6880 raft_consensus.cc:2393] T b56bf91d90824c959e21e0cee5ba1816 P cd75a17ab2604397adab03bb8b5fd75c [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ccd8a4c3bfe3413cb2ae219b09aea832 in current term 12: Already voted for candidate cd75a17ab2604397adab03bb8b5fd75c in this term.
I20260709 13:20:19.716784  6878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c37d41cd9164c15a6826ca62a851a69" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:19.315027 10938 raft_consensus.cc:2804] T 8c7f33e544204fbaac4078e3e83bbf4e P b7ab4784c7344b939bc36f639286f377 [term 10 FOLLOWER]: Leader election won for term 10
W20260709 13:20:19.550848 11332 log.cc:927] Time spent T 20f6842e26174571996b8dea4151d4be P b7ab4784c7344b939bc36f639286f377: Append to log took a long time: real 0.239s	user 0.002s	sys 0.000s
W20260709 13:20:19.598645 11364 log.cc:927] Time spent T f09c2a98de1a4decabd0ff900dd44caa P ccd8a4c3bfe3413cb2ae219b09aea832: Append to log took a long time: real 0.134s	user 0.001s	sys 0.000s
W20260709 13:20:19.502602 11335 log.cc:927] Time spent T 4d9def8b32fd443aa94ab1420b06837b P cd75a17ab2604397adab03bb8b5fd75c: Append to log took a long time: real 0.190s	user 0.000s	sys 0.002s
I20260709 13:20:19.725696  6876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbdf895bba214ff68685a24fd17dfb5d" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 11 candidate_status { last_received { term: 10 index: 4 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
W20260709 13:20:19.713163 11300 consensus_meta.cc:287] T 9b3759de40694069b13c0f8bd40e5709 P ccd8a4c3bfe3413cb2ae219b09aea832: Time spent flushing consensus metadata: real 0.748s	user 0.011s	sys 0.000s
I20260709 13:20:19.358271 11326 leader_election.cc:290] T 3411566abe2d4c9bb4b2adfdd05e6f17 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:19.360374 11252 leader_election.cc:290] T f4b8bd455d5a47c18a1380839c6e0d61 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:19.311285 11066 raft_consensus.cc:515] T 34f36d59d88f40fe8a2805e604fc6c0a P cd75a17ab2604397adab03bb8b5fd75c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:19.681939 11292 raft_consensus.cc:3060] T ab432e62819d499eaaf3dd55481dd930 P b7ab4784c7344b939bc36f639286f377 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:19.360986 10580 leader_election.cc:290] T bb3d8792045a4583ae2e965b1350a5b4 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:20:19.481894 10818 raft_consensus.cc:493] T 9e326172347f45e99a0d482b5d8ef768 P b7ab4784c7344b939bc36f639286f377 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:20:19.362474 11353 leader_election.cc:290] T bd6869f07b5a4885a0b99fbe60c3b175 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
W20260709 13:20:19.727681  6772 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 48240.6us
W20260709 13:20:19.755693  6772 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:19.727097  6874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a485a995abc4807b6e511e45419f737" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:19.732152 11342 raft_consensus.cc:2804] T a1704639a875409b9959353527b3fd68 P b7ab4784c7344b939bc36f639286f377 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:20:19.758663  6874 raft_consensus.cc:2393] T 3a485a995abc4807b6e511e45419f737 P cd75a17ab2604397adab03bb8b5fd75c [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ccd8a4c3bfe3413cb2ae219b09aea832 in current term 12: Already voted for candidate b7ab4784c7344b939bc36f639286f377 in this term.
W20260709 13:20:19.758900  6697 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:19.733086  6880 raft_consensus.cc:1217] T 20f6842e26174571996b8dea4151d4be P cd75a17ab2604397adab03bb8b5fd75c [term 13 FOLLOWER]: Deduplicated request from leader. Original: 5.4->[7.5-13.8]   Dedup: 9.6->[11.7-13.8]
I20260709 13:20:19.314781 11298 raft_consensus.cc:515] T 30e88460611e47b2ba16a46a30b5f416 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:19.733642  6878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f03d0dbf16864ca4bc1bb5e4c0334c0f" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
W20260709 13:20:19.733912 11277 consensus_meta.cc:287] T 3411566abe2d4c9bb4b2adfdd05e6f17 P b7ab4784c7344b939bc36f639286f377: Time spent flushing consensus metadata: real 0.854s	user 0.012s	sys 0.000s
I20260709 13:20:19.759753  6880 pending_rounds.cc:85] T 20f6842e26174571996b8dea4151d4be P cd75a17ab2604397adab03bb8b5fd75c: Aborting all ops after (but not including) 6
I20260709 13:20:19.741067 11118 leader_election.cc:290] T 427c124d773f483294511e80fe340075 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:20:19.741904 11363 raft_consensus.cc:2804] T 3a485a995abc4807b6e511e45419f737 P b7ab4784c7344b939bc36f639286f377 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:20:19.743078  6844 leader_election.cc:304] T 2c240553ce044eedb41541d72b9475d7 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:20:19.743427  6876 raft_consensus.cc:1240] T d8292e16e5654be6bc408560cf256aaa P cd75a17ab2604397adab03bb8b5fd75c [term 16 FOLLOWER]: Rejecting Update request from peer ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 15. Current term is 16. Ops: [13.8-15.9]
I20260709 13:20:19.765061  7503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "404190ce4ce94cecbfcb6ea9d1dd8626" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:20:19.360657 11338 consensus_queue.cc:1059] T bb7fa124c3bf4ef9ab65a407cb008441 P 7ba59cc884714e8aa5f3f0ecaed84cbb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.367s
I20260709 13:20:19.317180 10727 raft_consensus.cc:515] T a1704639a875409b9959353527b3fd68 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
W20260709 13:20:19.727866  6770 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 44893.2us
I20260709 13:20:19.681744 11172 leader_election.cc:290] T 1528ab62b6fe4e3099d08f141afee116 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:20:19.358930 11309 raft_consensus.cc:515] T ce4f062dcd314d43a63ca74067cb5ee3 P cd75a17ab2604397adab03bb8b5fd75c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } attrs { replace: true } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:20:19.714336 11351 leader_election.cc:290] T 24ee15416e3145beaa1b8183453729a3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:19.761286  6878 raft_consensus.cc:2468] T f03d0dbf16864ca4bc1bb5e4c0334c0f P cd75a17ab2604397adab03bb8b5fd75c [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 11.
I20260709 13:20:19.762375  6880 pending_rounds.cc:107] T 20f6842e26174571996b8dea4151d4be P cd75a17ab2604397adab03bb8b5fd75c: Aborting uncommitted NO_OP operation due to leader change: 12.7
I20260709 13:20:19.773986  7495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3f13b31a1f84f0d89d007eadd57924c" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:20:19.784957  6880 raft_consensus.cc:2889] T 20f6842e26174571996b8dea4151d4be P cd75a17ab2604397adab03bb8b5fd75c [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:20:19.775743 10727 leader_election.cc:290] T a1704639a875409b9959353527b3fd68 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:19.769691  6874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7887766dc6784fcaa42b35c05fea7a99" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:20:19.782137  7500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1528ab62b6fe4e3099d08f141afee116" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:20:19.785583  6876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24ee15416e3145beaa1b8183453729a3" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:19.792363  6874 raft_consensus.cc:2393] T 7887766dc6784fcaa42b35c05fea7a99 P cd75a17ab2604397adab03bb8b5fd75c [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate ccd8a4c3bfe3413cb2ae219b09aea832 in current term 13: Already voted for candidate b7ab4784c7344b939bc36f639286f377 in this term.
I20260709 13:20:19.794354  6844 leader_election.cc:304] T 3411566abe2d4c9bb4b2adfdd05e6f17 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:20:19.796525  6878 raft_consensus.cc:1240] T 3d65025eea89441290d85dd053810e31 P cd75a17ab2604397adab03bb8b5fd75c [term 11 FOLLOWER]: Rejecting Update request from peer ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 10. Current term is 11. Ops: [10.5-10.5]
I20260709 13:20:19.763326 11277 raft_consensus.cc:2749] T 3411566abe2d4c9bb4b2adfdd05e6f17 P b7ab4784c7344b939bc36f639286f377 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:20:19.798748  6874 raft_consensus.cc:1240] T 90d42e216d9741e190bca19a781291fd P cd75a17ab2604397adab03bb8b5fd75c [term 12 FOLLOWER]: Rejecting Update request from peer ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 11. Current term is 12. Ops: [11.7-11.7]
I20260709 13:20:19.801508  6878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f58dc08b12a2494bb9a1372837970ca2" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:19.765098 11342 raft_consensus.cc:697] T a1704639a875409b9959353527b3fd68 P b7ab4784c7344b939bc36f639286f377 [term 13 LEADER]: Becoming Leader. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
I20260709 13:20:19.802956  7495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "427c124d773f483294511e80fe340075" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:20:19.769691 11319 raft_consensus.cc:493] T 7c44c4849aa54f2b94d1f1bef9ed546f P cd75a17ab2604397adab03bb8b5fd75c [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:19.803277  6732 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49998 (request call id 1096) took 1298 ms. Trace:
I20260709 13:20:19.779933 11317 raft_consensus.cc:2749] T 2c240553ce044eedb41541d72b9475d7 P cd75a17ab2604397adab03bb8b5fd75c [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:20:19.805729  6878 raft_consensus.cc:2393] T f58dc08b12a2494bb9a1372837970ca2 P cd75a17ab2604397adab03bb8b5fd75c [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ccd8a4c3bfe3413cb2ae219b09aea832 in current term 15: Already voted for candidate cd75a17ab2604397adab03bb8b5fd75c in this term.
I20260709 13:20:19.760805 10818 raft_consensus.cc:515] T 9e326172347f45e99a0d482b5d8ef768 P b7ab4784c7344b939bc36f639286f377 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:19.798055 11363 raft_consensus.cc:697] T 3a485a995abc4807b6e511e45419f737 P b7ab4784c7344b939bc36f639286f377 [term 12 LEADER]: Becoming Leader. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
I20260709 13:20:19.805310  6732 rpcz_store.cc:276] 0709 13:20:18.499331 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:18.499496 (+   165us) service_pool.cc:224] Handling call
0709 13:20:18.559673 (+ 60177us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:18.560178 (+   505us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:18.560212 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:20:18.618106 (+ 57894us) log.cc:844] Serialized 26 byte log entry
0709 13:20:18.865443 (+247337us) spinlock_profiling.cc:243] Waited 4.45 ms on lock 0x7b1800457600. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc15785de1 00007fcc157925b1 00007fcc0c89fe07 00007fcc156faab9 00007fcc0c8bc69b 00007fcc0c8ba93f 00007fcc0c8bcc02 00007fcc0f54420b 00007fcc0f549d23 00007fcc0f54a0d1 00007fcc0f965a0f
0709 13:20:19.271536 (+406093us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:20:19.271597 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:19.271702 (+   105us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:19.786689 (+514987us) raft_consensus.cc:1685] finished
0709 13:20:19.786718 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:19.797665 (+ 10947us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":6588,"raft.run_cpu_time_us":217,"raft.run_wall_time_us":5318,"spinlock_wait_cycles":10239744,"thread_start_us":405805,"threads_started":1,"wal-append.queue_time_us":717153}
I20260709 13:20:19.812988  6878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3022224cc81473690653a83d4e99470" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:19.813735  6878 raft_consensus.cc:2468] T a3022224cc81473690653a83d4e99470 P cd75a17ab2604397adab03bb8b5fd75c [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 13.
I20260709 13:20:19.814193  6844 leader_election.cc:304] T 713b5728a197487c9300b310ab94e5a3 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:20:19.806263 11319 raft_consensus.cc:515] T 7c44c4849aa54f2b94d1f1bef9ed546f P cd75a17ab2604397adab03bb8b5fd75c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:19.815825 11354 leader_election.cc:290] T 7ba5dac66ab5497e9e336f2a3c28cda5 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:20:19.816192  6874 raft_consensus.cc:1275] T 7c44c4849aa54f2b94d1f1bef9ed546f P cd75a17ab2604397adab03bb8b5fd75c [term 14 FOLLOWER]: Refusing update from remote peer ccd8a4c3bfe3413cb2ae219b09aea832: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:20:19.816881  6798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7887766dc6784fcaa42b35c05fea7a99" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:20:19.817365 11319 leader_election.cc:290] T 7c44c4849aa54f2b94d1f1bef9ed546f P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:20:19.818303  7500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ba5dac66ab5497e9e336f2a3c28cda5" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:20:19.823303 11309 leader_election.cc:290] T ce4f062dcd314d43a63ca74067cb5ee3 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:20:19.824533 11317 raft_consensus.cc:2749] T 713b5728a197487c9300b310ab94e5a3 P cd75a17ab2604397adab03bb8b5fd75c [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:20:19.826211 11175 leader_election.cc:290] T bb3d8792045a4583ae2e965b1350a5b4 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:20:19.829195 11286 raft_consensus.cc:2749] T 3411566abe2d4c9bb4b2adfdd05e6f17 P cd75a17ab2604397adab03bb8b5fd75c [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:20:19.830690  6803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f03d0dbf16864ca4bc1bb5e4c0334c0f" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:19.831555  6803 raft_consensus.cc:2468] T f03d0dbf16864ca4bc1bb5e4c0334c0f P b7ab4784c7344b939bc36f639286f377 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 10.
I20260709 13:20:19.769917 11347 consensus_queue.cc:237] T 7887766dc6784fcaa42b35c05fea7a99 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:19.832957  6803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f58dc08b12a2494bb9a1372837970ca2" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:19.837169  6803 raft_consensus.cc:2410] T f58dc08b12a2494bb9a1372837970ca2 P b7ab4784c7344b939bc36f639286f377 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ccd8a4c3bfe3413cb2ae219b09aea832 for term 15 because replica has last-logged OpId of term: 14 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 7.
I20260709 13:20:19.839108 11341 raft_consensus.cc:493] T 20f6842e26174571996b8dea4151d4be P b7ab4784c7344b939bc36f639286f377 [term 13 FOLLOWER]: Starting leader election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:20:19.839712 11341 raft_consensus.cc:3060] T 20f6842e26174571996b8dea4151d4be P b7ab4784c7344b939bc36f639286f377 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:19.839844  6803 raft_consensus.cc:1240] T 95a75bfe094d4bdc963aba3f08dfcd25 P b7ab4784c7344b939bc36f639286f377 [term 12 FOLLOWER]: Rejecting Update request from peer ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 11. Current term is 12. Ops: []
I20260709 13:20:19.851331 11298 leader_election.cc:290] T 30e88460611e47b2ba16a46a30b5f416 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:19.798466 10969 consensus_queue.cc:1048] T 7c37d41cd9164c15a6826ca62a851a69 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.050s
I20260709 13:20:19.851856  6877 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58592 (request call id 354) took 1589 ms. Trace:
I20260709 13:20:19.852523  6877 rpcz_store.cc:276] 0709 13:20:18.262247 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:18.276276 (+ 14029us) service_pool.cc:224] Handling call
0709 13:20:18.276843 (+   567us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:18.989277 (+712434us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:19.851560 (+862283us) spinlock_profiling.cc:243] Waited 695 ms on lock 0x7b540021a2d4. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f9aae01 00007fcc0f9a983e 00007fcc1496e419 00007fcc0dee5bd4 00007fcc0dee5b62 00007fcc0dee5a91 00007fcc0dee5a0c 00007fcc0dee4cc2 00007fcc0dce548c 00007fcc0dce48c6
0709 13:20:19.851769 (+   209us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1598562560}
I20260709 13:20:19.854177  6877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de3186201e1a40d0b335eeb8b4e256e0" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:19.855298 10818 leader_election.cc:290] T 9e326172347f45e99a0d482b5d8ef768 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:19.812193 11252 raft_consensus.cc:493] T 1bf4668eeb70467fb3dc5a0289233b3c P b7ab4784c7344b939bc36f639286f377 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:19.841300 11342 consensus_queue.cc:237] T a1704639a875409b9959353527b3fd68 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:19.813539 11326 raft_consensus.cc:493] T 4b8cacb381b746da8d0049b0a83b41dd P ccd8a4c3bfe3413cb2ae219b09aea832 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:19.855965  6877 raft_consensus.cc:1240] T 07a92dd554674067a83a9cb68c4773f2 P cd75a17ab2604397adab03bb8b5fd75c [term 12 FOLLOWER]: Rejecting Update request from peer ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 11. Current term is 12. Ops: [11.6-11.6]
I20260709 13:20:19.866561  6804 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:32976 (request call id 2890) took 2485 ms. Trace:
I20260709 13:20:19.875641  6800 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:32976 (request call id 2894) took 2439 ms. Trace:
I20260709 13:20:19.892781  6800 rpcz_store.cc:276] 0709 13:20:17.436601 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:18.878881 (+1442280us) service_pool.cc:224] Handling call
0709 13:20:18.939106 (+ 60225us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:19.001044 (+ 61938us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:19.875338 (+874294us) spinlock_profiling.cc:243] Waited 43.4 ms on lock 0x7b540028a5d4. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f9aae01 00007fcc0f9a983e 00007fcc1496e419 00007fcc0dee5bd4 00007fcc0dee5b62 00007fcc0dee5a91 00007fcc0dee5a0c 00007fcc0dee4cc2 00007fcc0dce548c 00007fcc0dce48c6
0709 13:20:19.875557 (+   219us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":99835264}
I20260709 13:20:19.876917  6881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c240553ce044eedb41541d72b9475d7" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:19.894807  6881 raft_consensus.cc:2468] T 2c240553ce044eedb41541d72b9475d7 P cd75a17ab2604397adab03bb8b5fd75c [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 13.
I20260709 13:20:19.877884  6872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3d8792045a4583ae2e965b1350a5b4" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:19.896643  6872 raft_consensus.cc:2468] T bb3d8792045a4583ae2e965b1350a5b4 P cd75a17ab2604397adab03bb8b5fd75c [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 10.
I20260709 13:20:19.878535 11353 raft_consensus.cc:493] T c4db81d9d329422bb3b4160ca4ac2d1d P b7ab4784c7344b939bc36f639286f377 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:19.898495 11353 raft_consensus.cc:515] T c4db81d9d329422bb3b4160ca4ac2d1d P b7ab4784c7344b939bc36f639286f377 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:19.879705 11061 leader_election.cc:290] T 7c44c4849aa54f2b94d1f1bef9ed546f P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:19.861657  6798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de3186201e1a40d0b335eeb8b4e256e0" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:19.856621 11363 consensus_queue.cc:237] T 3a485a995abc4807b6e511e45419f737 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:19.901736  6798 raft_consensus.cc:2468] T de3186201e1a40d0b335eeb8b4e256e0 P b7ab4784c7344b939bc36f639286f377 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 13.
I20260709 13:20:19.903106  6798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3022224cc81473690653a83d4e99470" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:19.793687 11118 consensus_queue.cc:1059] T 44bde925b2e541b69890d70715b85176 P b7ab4784c7344b939bc36f639286f377 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.020s
W20260709 13:20:19.904755  6698 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:19.913636  6731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24ee15416e3145beaa1b8183453729a3" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:19.914227  6872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a734b5ab7834e05a8c422208acc58b1" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:19.914724  6731 raft_consensus.cc:2468] T 24ee15416e3145beaa1b8183453729a3 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in term 13.
I20260709 13:20:19.908968  6798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34f36d59d88f40fe8a2805e604fc6c0a" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:19.909050  6729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17587d6730594da4a56fa13a353232a1" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 18 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:19.912381  6877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1704639a875409b9959353527b3fd68" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:19.919096  6731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a75bfe094d4bdc963aba3f08dfcd25" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:20:19.919802  6877 raft_consensus.cc:2468] T a1704639a875409b9959353527b3fd68 P cd75a17ab2604397adab03bb8b5fd75c [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 13.
I20260709 13:20:19.920775  6872 raft_consensus.cc:2393] T 7a734b5ab7834e05a8c422208acc58b1 P cd75a17ab2604397adab03bb8b5fd75c [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ccd8a4c3bfe3413cb2ae219b09aea832 in current term 13: Already voted for candidate b7ab4784c7344b939bc36f639286f377 in this term.
I20260709 13:20:19.904018 11371 raft_consensus.cc:493] T 1528ab62b6fe4e3099d08f141afee116 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 7ba59cc884714e8aa5f3f0ecaed84cbb)
I20260709 13:20:19.813823 11066 leader_election.cc:290] T 34f36d59d88f40fe8a2805e604fc6c0a P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:20:19.923574  6725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b8cacb381b746da8d0049b0a83b41dd" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:19.923959  6881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3411566abe2d4c9bb4b2adfdd05e6f17" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:19.929893  6881 raft_consensus.cc:2468] T 3411566abe2d4c9bb4b2adfdd05e6f17 P cd75a17ab2604397adab03bb8b5fd75c [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 10.
I20260709 13:20:19.932889  6807 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:32976 (request call id 2893) took 2496 ms. Trace:
I20260709 13:20:19.933516  6807 rpcz_store.cc:276] 0709 13:20:17.436155 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:18.336027 (+899872us) service_pool.cc:224] Handling call
0709 13:20:18.376459 (+ 40432us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:18.698608 (+322149us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:19.932439 (+1233831us) spinlock_profiling.cc:243] Waited 321 ms on lock 0x7b5400289bd4. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f9aae01 00007fcc0f9a983e 00007fcc1496e419 00007fcc0dee5bd4 00007fcc0dee5b62 00007fcc0dee5a91 00007fcc0dee5a0c 00007fcc0dee4cc2 00007fcc0dce548c 00007fcc0dce48c6
0709 13:20:19.932767 (+   328us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":738060160}
W20260709 13:20:19.876698 11259 consensus_meta.cc:287] T f5be3a11b23d4ea9b08300a2789821c7 P b7ab4784c7344b939bc36f639286f377: Time spent flushing consensus metadata: real 0.596s	user 0.011s	sys 0.002s
I20260709 13:20:19.923130  6800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c240553ce044eedb41541d72b9475d7" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:19.918412  7466 leader_election.cc:304] T 24ee15416e3145beaa1b8183453729a3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
I20260709 13:20:19.890868  6804 rpcz_store.cc:276] 0709 13:20:17.381263 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:17.532400 (+151137us) service_pool.cc:224] Handling call
0709 13:20:17.532840 (+   440us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:18.368763 (+835923us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:18.368805 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:20:18.384490 (+ 15685us) log.cc:844] Serialized 26 byte log entry
0709 13:20:18.723396 (+338906us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:20:18.723512 (+   116us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:19.866049 (+1142537us) spinlock_profiling.cc:243] Waited 246 ms on lock 0x7b54002c8dd4. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f9aae01 00007fcc0f9a983e 00007fcc1496e419 00007fcc0dee5bd4 00007fcc0dee5b62 00007fcc0dee5a91 00007fcc0dee5a0c 00007fcc0dee4cc2 00007fcc0dce548c 00007fcc0dce48c6
0709 13:20:19.866110 (+    61us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:19.866212 (+   102us) raft_consensus.cc:1685] finished
0709 13:20:19.866232 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:19.866485 (+   253us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":20370,"raft.run_cpu_time_us":168,"raft.run_wall_time_us":16460,"spinlock_wait_cycles":566374656,"thread_start_us":888702,"threads_started":2,"wal-append.queue_time_us":329119,"wal-append.run_cpu_time_us":2161,"wal-append.run_wall_time_us":1003523}
I20260709 13:20:19.927287  6872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "853ac0a8cbd64ce99457f170216d4d0f" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:19.936884  6801 raft_consensus.cc:1240] T d8292e16e5654be6bc408560cf256aaa P b7ab4784c7344b939bc36f639286f377 [term 16 LEADER]: Rejecting Update request from peer ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 15. Current term is 16. Ops: []
I20260709 13:20:19.870874 11059 raft_consensus.cc:493] T 4f00a2e87e56452083b759f60d461ee3 P b7ab4784c7344b939bc36f639286f377 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 7ba59cc884714e8aa5f3f0ecaed84cbb)
I20260709 13:20:19.938611  6798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "853ac0a8cbd64ce99457f170216d4d0f" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:19.945525  6798 raft_consensus.cc:2468] T 853ac0a8cbd64ce99457f170216d4d0f P b7ab4784c7344b939bc36f639286f377 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 9.
I20260709 13:20:19.921589 11353 leader_election.cc:290] T c4db81d9d329422bb3b4160ca4ac2d1d P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:19.940169  6803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a485a995abc4807b6e511e45419f737" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:20:19.946056  6724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be1a92657f494cac8dd227d152f50151" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:20:19.952627  6800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e31b9971c15848dea59d4d4130141d9e" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:19.926995 10938 raft_consensus.cc:697] T 8c7f33e544204fbaac4078e3e83bbf4e P b7ab4784c7344b939bc36f639286f377 [term 10 LEADER]: Becoming Leader. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
I20260709 13:20:19.939433  6731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f03d0dbf16864ca4bc1bb5e4c0334c0f" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:19.947265  6877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a485a995abc4807b6e511e45419f737" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:20:19.948354  6807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a734b5ab7834e05a8c422208acc58b1" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:19.964296  6731 raft_consensus.cc:2468] T f03d0dbf16864ca4bc1bb5e4c0334c0f P ccd8a4c3bfe3413cb2ae219b09aea832 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 11.
I20260709 13:20:19.964871  6800 raft_consensus.cc:2410] T e31b9971c15848dea59d4d4130141d9e P b7ab4784c7344b939bc36f639286f377 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ccd8a4c3bfe3413cb2ae219b09aea832 for term 11 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 13:20:19.961719  6697 leader_election.cc:304] T 711ef6523deb4cbe8ef2ba61e1c21c98 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:20:19.873052 11326 raft_consensus.cc:515] T 4b8cacb381b746da8d0049b0a83b41dd P ccd8a4c3bfe3413cb2ae219b09aea832 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:20:19.927102 11118 consensus_queue.cc:1243] T 44bde925b2e541b69890d70715b85176 P b7ab4784c7344b939bc36f639286f377 [NON_LEADER]: Peer ccd8a4c3bfe3413cb2ae219b09aea832 log is divergent from this leader: its last log entry 13.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 13:20:19.868680 11252 raft_consensus.cc:515] T 1bf4668eeb70467fb3dc5a0289233b3c P b7ab4784c7344b939bc36f639286f377 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:19.966185  6877 raft_consensus.cc:2393] T 3a485a995abc4807b6e511e45419f737 P cd75a17ab2604397adab03bb8b5fd75c [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate ccd8a4c3bfe3413cb2ae219b09aea832 in current term 12: Already voted for candidate b7ab4784c7344b939bc36f639286f377 in this term.
I20260709 13:20:19.952641  6881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e31b9971c15848dea59d4d4130141d9e" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:19.970311  6800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d9def8b32fd443aa94ab1420b06837b" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:19.966395  6731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90d42e216d9741e190bca19a781291fd" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:20:19.959074  6872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30e88460611e47b2ba16a46a30b5f416" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:19.918407 11298 consensus_queue.cc:1059] T 17587d6730594da4a56fa13a353232a1 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false }, Status: INVALID_TERM, Last received: 13.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.036s
I20260709 13:20:19.945042 11288 leader_election.cc:290] T f4b8bd455d5a47c18a1380839c6e0d61 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:19.976225  6800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1704639a875409b9959353527b3fd68" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:19.977298  6724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7887766dc6784fcaa42b35c05fea7a99" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:20:19.973994  6697 leader_election.cc:304] T 22ccee1b570c4ad3a57bd7aec085b1b4 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:20:19.979995  6731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e31b9971c15848dea59d4d4130141d9e" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:19.989039  6724 raft_consensus.cc:2393] T 7887766dc6784fcaa42b35c05fea7a99 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate b7ab4784c7344b939bc36f639286f377 in current term 13: Already voted for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in this term.
I20260709 13:20:19.989169  6731 raft_consensus.cc:2468] T e31b9971c15848dea59d4d4130141d9e P ccd8a4c3bfe3413cb2ae219b09aea832 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 10.
I20260709 13:20:19.990940  6731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17587d6730594da4a56fa13a353232a1" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:19.992921  6731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c7f33e544204fbaac4078e3e83bbf4e" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:19.994530  6800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de3186201e1a40d0b335eeb8b4e256e0" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:19.993172  6807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "853ac0a8cbd64ce99457f170216d4d0f" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:20:20.014070  6725 raft_consensus.cc:2468] T 4b8cacb381b746da8d0049b0a83b41dd P ccd8a4c3bfe3413cb2ae219b09aea832 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in term 13.
I20260709 13:20:20.014133  6697 leader_election.cc:304] T d33d5ee8ef6f415593d8df52063161ad P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:20:20.016095  6724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20f6842e26174571996b8dea4151d4be" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:20.017839  6798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "711ef6523deb4cbe8ef2ba61e1c21c98" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:19.995290  6800 raft_consensus.cc:2468] T de3186201e1a40d0b335eeb8b4e256e0 P b7ab4784c7344b939bc36f639286f377 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 13.
I20260709 13:20:20.023722  6879 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58592 (request call id 352) took 1796 ms. Trace:
I20260709 13:20:20.024334  6800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4b8bd455d5a47c18a1380839c6e0d61" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:20.027091  6697 leader_election.cc:304] T b56bf91d90824c959e21e0cee5ba1816 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:20:20.020079  6731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab432e62819d499eaaf3dd55481dd930" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:19.944419 11259 raft_consensus.cc:515] T f5be3a11b23d4ea9b08300a2789821c7 P b7ab4784c7344b939bc36f639286f377 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:20.019969  6803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f00a2e87e56452083b759f60d461ee3" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 13 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:20.032531  6881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4b8bd455d5a47c18a1380839c6e0d61" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:19.976889 11339 raft_consensus.cc:2804] T 24ee15416e3145beaa1b8183453729a3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:20:19.991142 11336 raft_consensus.cc:493] T ce4f062dcd314d43a63ca74067cb5ee3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:20.024257  6879 rpcz_store.cc:276] 0709 13:20:18.227392 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:18.246412 (+ 19020us) service_pool.cc:224] Handling call
0709 13:20:18.262084 (+ 15672us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:18.460883 (+198799us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:20.023435 (+1562552us) spinlock_profiling.cc:243] Waited 181 ms on lock 0x7b54000a69d4. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f9aae01 00007fcc0f9a983e 00007fcc1496e419 00007fcc0dee5bd4 00007fcc0dee5b62 00007fcc0dee5a91 00007fcc0dee5a0c 00007fcc0dee4cc2 00007fcc0dce548c 00007fcc0dce48c6
0709 13:20:20.023654 (+   219us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":415485312}
I20260709 13:20:19.997275 11369 raft_consensus.cc:2749] T 711ef6523deb4cbe8ef2ba61e1c21c98 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:20:20.043021  6731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a92dd554674067a83a9cb68c4773f2" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:20.038209  6724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a92dd554674067a83a9cb68c4773f2" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:20:20.023204 11353 raft_consensus.cc:493] T f09c2a98de1a4decabd0ff900dd44caa P b7ab4784c7344b939bc36f639286f377 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:20.020830 11300 raft_consensus.cc:493] T ce4f062dcd314d43a63ca74067cb5ee3 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:20.023046 11298 raft_consensus.cc:2749] T 22ccee1b570c4ad3a57bd7aec085b1b4 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:20:20.040585  6881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34f36d59d88f40fe8a2805e604fc6c0a" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:20.054947  6881 raft_consensus.cc:2468] T 34f36d59d88f40fe8a2805e604fc6c0a P cd75a17ab2604397adab03bb8b5fd75c [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 9.
I20260709 13:20:19.972980 11059 raft_consensus.cc:515] T 4f00a2e87e56452083b759f60d461ee3 P b7ab4784c7344b939bc36f639286f377 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:20:20.046878  6806 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:32976 (request call id 2885) took 2670 ms. Trace:
I20260709 13:20:20.056981  6798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f03d0dbf16864ca4bc1bb5e4c0334c0f" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:20.059645  6798 raft_consensus.cc:2468] T f03d0dbf16864ca4bc1bb5e4c0334c0f P b7ab4784c7344b939bc36f639286f377 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 10.
I20260709 13:20:20.035248 10727 raft_consensus.cc:2749] T d33d5ee8ef6f415593d8df52063161ad P ccd8a4c3bfe3413cb2ae219b09aea832 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:20:20.070955  6879 raft_consensus.cc:1240] T 8c7f33e544204fbaac4078e3e83bbf4e P cd75a17ab2604397adab03bb8b5fd75c [term 10 FOLLOWER]: Rejecting Update request from peer ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 9. Current term is 10. Ops: [8.5-9.6]
I20260709 13:20:20.071301  6731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "404190ce4ce94cecbfcb6ea9d1dd8626" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:20.058609  6806 rpcz_store.cc:276] 0709 13:20:17.376589 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:17.406022 (+ 29433us) service_pool.cc:224] Handling call
0709 13:20:17.406584 (+   562us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:18.719463 (+1312879us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:20.046574 (+1327111us) spinlock_profiling.cc:243] Waited 1.31 s on lock 0x7b54001b58d4. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f9aae01 00007fcc0f9a983e 00007fcc1496e419 00007fcc0dee5bd4 00007fcc0dee5b62 00007fcc0dee5a91 00007fcc0dee5a0c 00007fcc0dee4cc2 00007fcc0dce548c 00007fcc0dce48c6
0709 13:20:20.046816 (+   242us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3016742144}
I20260709 13:20:20.037508 11339 raft_consensus.cc:493] T 24ee15416e3145beaa1b8183453729a3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 13 FOLLOWER]: Starting leader election (detected failure of leader cd75a17ab2604397adab03bb8b5fd75c)
W20260709 13:20:20.074483  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 260337us
I20260709 13:20:20.076918  6844 leader_election.cc:304] T 8c7f33e544204fbaac4078e3e83bbf4e P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:20:20.077813  6724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c7f33e544204fbaac4078e3e83bbf4e" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:20:20.037660 11289 consensus_queue.cc:1059] T 90d42e216d9741e190bca19a781291fd P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.038s
I20260709 13:20:20.082978  6724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a485a995abc4807b6e511e45419f737" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:20:20.083468  6731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d65025eea89441290d85dd053810e31" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:20:20.089002  6803 raft_consensus.cc:2410] T 4f00a2e87e56452083b759f60d461ee3 P b7ab4784c7344b939bc36f639286f377 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c for term 13 because replica has last-logged OpId of term: 12 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 8.
I20260709 13:20:20.090442  6798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f9c2e2bf644115957398fe4c9459db" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:20.090595  6879 raft_consensus.cc:1275] T f5be3a11b23d4ea9b08300a2789821c7 P cd75a17ab2604397adab03bb8b5fd75c [term 10 FOLLOWER]: Refusing update from remote peer ccd8a4c3bfe3413cb2ae219b09aea832: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:20:20.091606  6724 raft_consensus.cc:2393] T 3a485a995abc4807b6e511e45419f737 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate b7ab4784c7344b939bc36f639286f377 in current term 12: Already voted for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in this term.
I20260709 13:20:20.093880  6731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3f13b31a1f84f0d89d007eadd57924c" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:20.074967 11288 raft_consensus.cc:3060] T b56bf91d90824c959e21e0cee5ba1816 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:20:20.080233 11339 raft_consensus.cc:3060] T 24ee15416e3145beaa1b8183453729a3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:20.059747 11353 raft_consensus.cc:515] T f09c2a98de1a4decabd0ff900dd44caa P b7ab4784c7344b939bc36f639286f377 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:20.095948  6800 raft_consensus.cc:2468] T f4b8bd455d5a47c18a1380839c6e0d61 P b7ab4784c7344b939bc36f639286f377 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 11.
I20260709 13:20:20.110172  6724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5be3a11b23d4ea9b08300a2789821c7" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:20.081460 11010 raft_consensus.cc:3055] T 95a75bfe094d4bdc963aba3f08dfcd25 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:20:20.104815  6731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a734b5ab7834e05a8c422208acc58b1" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 13 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:20:20.115301  6731 raft_consensus.cc:3060] T 7a734b5ab7834e05a8c422208acc58b1 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:20.112807  6798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f58dc08b12a2494bb9a1372837970ca2" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:20:20.113026  6800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30e88460611e47b2ba16a46a30b5f416" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:20.038776 10938 consensus_queue.cc:237] T 8c7f33e544204fbaac4078e3e83bbf4e P b7ab4784c7344b939bc36f639286f377 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:20.117544  6879 raft_consensus.cc:1275] T 44bde925b2e541b69890d70715b85176 P cd75a17ab2604397adab03bb8b5fd75c [term 13 FOLLOWER]: Refusing update from remote peer ccd8a4c3bfe3413cb2ae219b09aea832: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:20:20.121891  6798 raft_consensus.cc:2410] T f58dc08b12a2494bb9a1372837970ca2 P b7ab4784c7344b939bc36f639286f377 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c for term 15 because replica has last-logged OpId of term: 14 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 7.
I20260709 13:20:20.117722  6800 raft_consensus.cc:2468] T 30e88460611e47b2ba16a46a30b5f416 P b7ab4784c7344b939bc36f639286f377 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 10.
I20260709 13:20:20.121860  6724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4b8bd455d5a47c18a1380839c6e0d61" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:20.072979 11300 raft_consensus.cc:515] T ce4f062dcd314d43a63ca74067cb5ee3 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } attrs { replace: true } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:20:20.127611  6807 raft_consensus.cc:2468] T 853ac0a8cbd64ce99457f170216d4d0f P b7ab4784c7344b939bc36f639286f377 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 9.
I20260709 13:20:20.128719  6800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3411566abe2d4c9bb4b2adfdd05e6f17" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:20.125684  6724 raft_consensus.cc:2468] T f4b8bd455d5a47c18a1380839c6e0d61 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 11.
W20260709 13:20:20.133730  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 56939.9us
I20260709 13:20:20.129631  6800 raft_consensus.cc:2468] T 3411566abe2d4c9bb4b2adfdd05e6f17 P b7ab4784c7344b939bc36f639286f377 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 10.
I20260709 13:20:20.134941  6844 leader_election.cc:304] T 20f6842e26174571996b8dea4151d4be P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:20:20.136870  6800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d9def8b32fd443aa94ab1420b06837b" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:20.139215  6800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b3759de40694069b13c0f8bd40e5709" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:20.141085  6724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1528ab62b6fe4e3099d08f141afee116" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:20.114943 11010 raft_consensus.cc:740] T 95a75bfe094d4bdc963aba3f08dfcd25 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
I20260709 13:20:20.142829  6807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a485a995abc4807b6e511e45419f737" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
W20260709 13:20:20.145143  6697 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 118129us
I20260709 13:20:20.146008  6697 leader_election.cc:304] T 7c37d41cd9164c15a6826ca62a851a69 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:20:20.157104  6697 leader_election.cc:304] T dbdf895bba214ff68685a24fd17dfb5d P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:20:20.119270 11378 raft_consensus.cc:2749] T 8c7f33e544204fbaac4078e3e83bbf4e P cd75a17ab2604397adab03bb8b5fd75c [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:20:20.165141  6724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6869f07b5a4885a0b99fbe60c3b175" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:19.858736 11341 raft_consensus.cc:515] T 20f6842e26174571996b8dea4151d4be P b7ab4784c7344b939bc36f639286f377 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:19.962424 11371 raft_consensus.cc:515] T 1528ab62b6fe4e3099d08f141afee116 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:20:20.168612  6879 raft_consensus.cc:1275] T c4db81d9d329422bb3b4160ca4ac2d1d P cd75a17ab2604397adab03bb8b5fd75c [term 11 FOLLOWER]: Refusing update from remote peer ccd8a4c3bfe3413cb2ae219b09aea832: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 7. (term mismatch)
I20260709 13:20:20.175498  6879 pending_rounds.cc:85] T c4db81d9d329422bb3b4160ca4ac2d1d P cd75a17ab2604397adab03bb8b5fd75c: Aborting all ops after (but not including) 6
I20260709 13:20:20.175923  6879 pending_rounds.cc:107] T c4db81d9d329422bb3b4160ca4ac2d1d P cd75a17ab2604397adab03bb8b5fd75c: Aborting uncommitted NO_OP operation due to leader change: 10.7
I20260709 13:20:20.176617  6879 raft_consensus.cc:2889] T c4db81d9d329422bb3b4160ca4ac2d1d P cd75a17ab2604397adab03bb8b5fd75c [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:20:20.167945  6695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 141541us
I20260709 13:20:20.181345  6800 raft_consensus.cc:1275] T f09c2a98de1a4decabd0ff900dd44caa P b7ab4784c7344b939bc36f639286f377 [term 13 FOLLOWER]: Refusing update from remote peer cd75a17ab2604397adab03bb8b5fd75c: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:20:20.143141 11319 raft_consensus.cc:2749] T 20f6842e26174571996b8dea4151d4be P cd75a17ab2604397adab03bb8b5fd75c [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:20:20.184000  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 49170.3us
I20260709 13:20:20.185335  6844 leader_election.cc:304] T 7ba5dac66ab5497e9e336f2a3c28cda5 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, b7ab4784c7344b939bc36f639286f377
I20260709 13:20:20.186199  6697 leader_election.cc:304] T f03d0dbf16864ca4bc1bb5e4c0334c0f P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:20:20.187187  6800 raft_consensus.cc:1240] T c4db81d9d329422bb3b4160ca4ac2d1d P b7ab4784c7344b939bc36f639286f377 [term 11 FOLLOWER]: Rejecting Update request from peer cd75a17ab2604397adab03bb8b5fd75c for earlier term 10. Current term is 11. Ops: []
I20260709 13:20:20.186704  6728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "427c124d773f483294511e80fe340075" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:20.046818 11336 raft_consensus.cc:515] T ce4f062dcd314d43a63ca74067cb5ee3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } attrs { replace: true } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:20:20.188679  6728 raft_consensus.cc:2468] T 427c124d773f483294511e80fe340075 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 10.
I20260709 13:20:20.190426  6728 raft_consensus.cc:1240] T f58dc08b12a2494bb9a1372837970ca2 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 15 FOLLOWER]: Rejecting Update request from peer b7ab4784c7344b939bc36f639286f377 for earlier term 14. Current term is 15. Ops: []
I20260709 13:20:20.190896 11353 leader_election.cc:290] T f09c2a98de1a4decabd0ff900dd44caa P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
W20260709 13:20:20.191658 11375 log.cc:927] Time spent T 9e326172347f45e99a0d482b5d8ef768 P cd75a17ab2604397adab03bb8b5fd75c: Append to log took a long time: real 0.103s	user 0.000s	sys 0.001s
I20260709 13:20:20.173852 11373 raft_consensus.cc:493] T d8cee0accdb8499c86d4414b72565a38 P b7ab4784c7344b939bc36f639286f377 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:20.194394 11298 raft_consensus.cc:2749] T 7c37d41cd9164c15a6826ca62a851a69 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:20:20.194595  6728 raft_consensus.cc:1275] T 4d9def8b32fd443aa94ab1420b06837b P ccd8a4c3bfe3413cb2ae219b09aea832 [term 12 FOLLOWER]: Refusing update from remote peer b7ab4784c7344b939bc36f639286f377: Log matching property violated. Preceding OpId in replica: term: 11 index: 5. Preceding OpId from leader: term: 12 index: 6. (index mismatch)
I20260709 13:20:20.195526 11386 raft_consensus.cc:2749] T dbdf895bba214ff68685a24fd17dfb5d P ccd8a4c3bfe3413cb2ae219b09aea832 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:20:20.201720 11386 consensus_queue.cc:1059] T d8292e16e5654be6bc408560cf256aaa P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
W20260709 13:20:20.202569 11356 log.cc:927] Time spent T 427c124d773f483294511e80fe340075 P 7ba59cc884714e8aa5f3f0ecaed84cbb: Append to log took a long time: real 0.900s	user 0.000s	sys 0.014s
I20260709 13:20:20.202756 11386 raft_consensus.cc:2804] T f03d0dbf16864ca4bc1bb5e4c0334c0f P ccd8a4c3bfe3413cb2ae219b09aea832 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:20:20.203250 11386 raft_consensus.cc:493] T f03d0dbf16864ca4bc1bb5e4c0334c0f P ccd8a4c3bfe3413cb2ae219b09aea832 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:20.204321 11298 raft_consensus.cc:3055] T d8292e16e5654be6bc408560cf256aaa P ccd8a4c3bfe3413cb2ae219b09aea832 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:20:20.194721 11373 raft_consensus.cc:515] T d8cee0accdb8499c86d4414b72565a38 P b7ab4784c7344b939bc36f639286f377 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:20:20.204756 11298 raft_consensus.cc:740] T d8292e16e5654be6bc408560cf256aaa P ccd8a4c3bfe3413cb2ae219b09aea832 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
I20260709 13:20:20.206626 11373 leader_election.cc:290] T d8cee0accdb8499c86d4414b72565a38 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
W20260709 13:20:20.207253 11379 log.cc:927] Time spent T 7887766dc6784fcaa42b35c05fea7a99 P b7ab4784c7344b939bc36f639286f377: Append to log took a long time: real 0.074s	user 0.001s	sys 0.000s
I20260709 13:20:20.206857 11298 consensus_queue.cc:260] T d8292e16e5654be6bc408560cf256aaa P ccd8a4c3bfe3413cb2ae219b09aea832 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:20.210121 11300 leader_election.cc:290] T ce4f062dcd314d43a63ca74067cb5ee3 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:20:20.210819 11326 leader_election.cc:290] T 4b8cacb381b746da8d0049b0a83b41dd P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:20:20.212143  6724 raft_consensus.cc:1275] T 711ef6523deb4cbe8ef2ba61e1c21c98 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 13 FOLLOWER]: Refusing update from remote peer b7ab4784c7344b939bc36f639286f377: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:20:20.196689  6728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c44c4849aa54f2b94d1f1bef9ed546f" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:20.197906 11371 leader_election.cc:290] T 1528ab62b6fe4e3099d08f141afee116 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
W20260709 13:20:20.198761 11372 log.cc:927] Time spent T 90d42e216d9741e190bca19a781291fd P b7ab4784c7344b939bc36f639286f377: Append to log took a long time: real 0.138s	user 0.000s	sys 0.001s
W20260709 13:20:20.199622 11381 log.cc:927] Time spent T bd6869f07b5a4885a0b99fbe60c3b175 P b7ab4784c7344b939bc36f639286f377: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 13:20:20.220860 11336 leader_election.cc:290] T ce4f062dcd314d43a63ca74067cb5ee3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:20.186379 11252 leader_election.cc:290] T 1bf4668eeb70467fb3dc5a0289233b3c P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:20.203819 11386 raft_consensus.cc:3060] T f03d0dbf16864ca4bc1bb5e4c0334c0f P ccd8a4c3bfe3413cb2ae219b09aea832 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:20:20.213177  6844 leader_election.cc:304] T 30e88460611e47b2ba16a46a30b5f416 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:20:20.223486  6802 raft_consensus.cc:1275] T d8cee0accdb8499c86d4414b72565a38 P b7ab4784c7344b939bc36f639286f377 [term 12 FOLLOWER]: Refusing update from remote peer cd75a17ab2604397adab03bb8b5fd75c: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 10. (term mismatch)
I20260709 13:20:20.224179  6802 pending_rounds.cc:85] T d8cee0accdb8499c86d4414b72565a38 P b7ab4784c7344b939bc36f639286f377: Aborting all ops after (but not including) 9
I20260709 13:20:20.224565  6731 raft_consensus.cc:2410] T 7a734b5ab7834e05a8c422208acc58b1 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate b7ab4784c7344b939bc36f639286f377 for term 13 because replica has last-logged OpId of term: 11 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 4.
I20260709 13:20:20.224607  6802 pending_rounds.cc:107] T d8cee0accdb8499c86d4414b72565a38 P b7ab4784c7344b939bc36f639286f377: Aborting uncommitted NO_OP operation due to leader change: 11.10
I20260709 13:20:20.213204  6807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbdf895bba214ff68685a24fd17dfb5d" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 11 candidate_status { last_received { term: 10 index: 4 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:20.225659  6802 raft_consensus.cc:2889] T d8cee0accdb8499c86d4414b72565a38 P b7ab4784c7344b939bc36f639286f377 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:20:20.228307  6802 raft_consensus.cc:1275] T c4db81d9d329422bb3b4160ca4ac2d1d P b7ab4784c7344b939bc36f639286f377 [term 11 FOLLOWER]: Refusing update from remote peer ccd8a4c3bfe3413cb2ae219b09aea832: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:20:20.213725  6697 leader_election.cc:304] T 7887766dc6784fcaa42b35c05fea7a99 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:20:20.166447 11316 raft_consensus.cc:493] T d8292e16e5654be6bc408560cf256aaa P cd75a17ab2604397adab03bb8b5fd75c [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:20.215118 11341 leader_election.cc:290] T 20f6842e26174571996b8dea4151d4be P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 14 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:20.216316 11315 raft_consensus.cc:2749] T 7ba5dac66ab5497e9e336f2a3c28cda5 P cd75a17ab2604397adab03bb8b5fd75c [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:20:20.216671 11059 leader_election.cc:290] T 4f00a2e87e56452083b759f60d461ee3 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:20:20.217345 11010 consensus_queue.cc:260] T 95a75bfe094d4bdc963aba3f08dfcd25 P ccd8a4c3bfe3413cb2ae219b09aea832 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.5, Last appended by leader: 5, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:20.234961 11316 raft_consensus.cc:515] T d8292e16e5654be6bc408560cf256aaa P cd75a17ab2604397adab03bb8b5fd75c [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:20.218289 11292 raft_consensus.cc:515] T ab432e62819d499eaaf3dd55481dd930 P b7ab4784c7344b939bc36f639286f377 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:20.236481  6804 raft_consensus.cc:1240] T ab432e62819d499eaaf3dd55481dd930 P b7ab4784c7344b939bc36f639286f377 [term 14 FOLLOWER]: Rejecting Update request from peer ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 13. Current term is 14. Ops: []
I20260709 13:20:20.237341 11316 leader_election.cc:290] T d8292e16e5654be6bc408560cf256aaa P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
W20260709 13:20:20.238276  6698 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:20.237993 11339 raft_consensus.cc:515] T 24ee15416e3145beaa1b8183453729a3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 14 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:20:20.235715  6799 raft_consensus.cc:1240] T 07a92dd554674067a83a9cb68c4773f2 P b7ab4784c7344b939bc36f639286f377 [term 12 FOLLOWER]: Rejecting Update request from peer ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 11. Current term is 12. Ops: []
I20260709 13:20:20.238559 11292 leader_election.cc:290] T ab432e62819d499eaaf3dd55481dd930 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 14 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:20.235600 11010 raft_consensus.cc:3060] T 95a75bfe094d4bdc963aba3f08dfcd25 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:20:20.243328  6697 leader_election.cc:304] T 24ee15416e3145beaa1b8183453729a3 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:20:20.244781 11390 raft_consensus.cc:2749] T 7887766dc6784fcaa42b35c05fea7a99 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:20:20.245520 11390 raft_consensus.cc:2749] T 24ee15416e3145beaa1b8183453729a3 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:20:20.246380 11167 leader_election.cc:290] T 3fa34c08b205435dba97346991aa1f92 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:20:20.231915  6800 raft_consensus.cc:1275] T de3186201e1a40d0b335eeb8b4e256e0 P b7ab4784c7344b939bc36f639286f377 [term 13 FOLLOWER]: Refusing update from remote peer cd75a17ab2604397adab03bb8b5fd75c: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:20:20.250665  6844 leader_election.cc:304] T d33d5ee8ef6f415593d8df52063161ad P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:20:20.256418 11377 raft_consensus.cc:3060] T 30e88460611e47b2ba16a46a30b5f416 P cd75a17ab2604397adab03bb8b5fd75c [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:20:20.258628  6847 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:20.259076  6847 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:20.240649 11326 consensus_queue.cc:1059] T 3d65025eea89441290d85dd053810e31 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: INVALID_TERM, Last received: 9.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.027s
I20260709 13:20:20.267407 11326 raft_consensus.cc:3055] T 3d65025eea89441290d85dd053810e31 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:20:20.260699  6726 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:38536 (request call id 24) took 2829 ms. Trace:
I20260709 13:20:20.261070  6772 leader_election.cc:304] T 07a92dd554674067a83a9cb68c4773f2 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:20:20.261164  6878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4b8bd455d5a47c18a1380839c6e0d61" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:20.262104  6880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6869f07b5a4885a0b99fbe60c3b175" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:20.263006  6876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "427c124d773f483294511e80fe340075" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:20.264448  6873 raft_consensus.cc:1275] T 3d65025eea89441290d85dd053810e31 P cd75a17ab2604397adab03bb8b5fd75c [term 11 FOLLOWER]: Refusing update from remote peer b7ab4784c7344b939bc36f639286f377: Log matching property violated. Preceding OpId in replica: term: 9 index: 4. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:20:20.269559  6726 rpcz_store.cc:276] 0709 13:20:17.431290 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:17.431529 (+   239us) service_pool.cc:224] Handling call
0709 13:20:20.260487 (+2828958us) spinlock_profiling.cc:243] Waited 771 ms on lock 0x7b5400407254. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f9a4853 00007fcc1497260a 00007fcc0def87d4 00007fcc0def8762 00007fcc0def8691 00007fcc0def860c 00007fcc0def78c2 00007fcc0dce548c 00007fcc0dce48c6 00007fcc0dce426f
0709 13:20:20.260593 (+   106us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1773612800}
I20260709 13:20:20.271245  6873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c44c4849aa54f2b94d1f1bef9ed546f" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:20.273067  6876 raft_consensus.cc:2468] T 427c124d773f483294511e80fe340075 P cd75a17ab2604397adab03bb8b5fd75c [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 10.
I20260709 13:20:20.234542 11298 raft_consensus.cc:3060] T d8292e16e5654be6bc408560cf256aaa P ccd8a4c3bfe3413cb2ae219b09aea832 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:20.289424  6873 raft_consensus.cc:1275] T 711ef6523deb4cbe8ef2ba61e1c21c98 P cd75a17ab2604397adab03bb8b5fd75c [term 13 FOLLOWER]: Refusing update from remote peer b7ab4784c7344b939bc36f639286f377: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:20:20.277891  6728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bf4668eeb70467fb3dc5a0289233b3c" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:20.279342  6876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4db81d9d329422bb3b4160ca4ac2d1d" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:20.294904  6876 raft_consensus.cc:2468] T c4db81d9d329422bb3b4160ca4ac2d1d P cd75a17ab2604397adab03bb8b5fd75c [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 11.
I20260709 13:20:20.279973  6875 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53406 (request call id 2169) took 2057 ms. Trace:
I20260709 13:20:20.281647  6872 raft_consensus.cc:1240] T b56bf91d90824c959e21e0cee5ba1816 P cd75a17ab2604397adab03bb8b5fd75c [term 12 FOLLOWER]: Rejecting Update request from peer b7ab4784c7344b939bc36f639286f377 for earlier term 11. Current term is 12. Ops: []
I20260709 13:20:20.299523  6729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4db81d9d329422bb3b4160ca4ac2d1d" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:20.295986  6875 rpcz_store.cc:276] 0709 13:20:18.222742 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:18.222892 (+   150us) service_pool.cc:224] Handling call
0709 13:20:18.223322 (+   430us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:18.712507 (+489185us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:20.279649 (+1567142us) spinlock_profiling.cc:243] Waited 482 ms on lock 0x7b5400236ed4. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f9aae01 00007fcc0f9a983e 00007fcc1496e419 00007fcc0dee5bd4 00007fcc0dee5b62 00007fcc0dee5a91 00007fcc0dee5a0c 00007fcc0dee4cc2 00007fcc0dce548c 00007fcc0dce48c6
0709 13:20:20.279902 (+   253us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1109614464}
I20260709 13:20:20.298442  6728 raft_consensus.cc:2468] T 1bf4668eeb70467fb3dc5a0289233b3c P ccd8a4c3bfe3413cb2ae219b09aea832 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 12.
I20260709 13:20:20.243381 11362 raft_consensus.cc:3055] T bb7fa124c3bf4ef9ab65a407cb008441 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:20:20.267833 11326 raft_consensus.cc:740] T 3d65025eea89441290d85dd053810e31 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
I20260709 13:20:20.276305 11167 raft_consensus.cc:2749] T d33d5ee8ef6f415593d8df52063161ad P cd75a17ab2604397adab03bb8b5fd75c [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:20:20.321462  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 78742.1us
I20260709 13:20:20.322499  6844 leader_election.cc:304] T bd6869f07b5a4885a0b99fbe60c3b175 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:20:20.324718  6726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce4f062dcd314d43a63ca74067cb5ee3" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:20.312635  6728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e326172347f45e99a0d482b5d8ef768" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:20.314281  6772 leader_election.cc:304] T c4db81d9d329422bb3b4160ca4ac2d1d P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:20:20.315340  6878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e326172347f45e99a0d482b5d8ef768" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:20.284435 11345 raft_consensus.cc:2804] T 07a92dd554674067a83a9cb68c4773f2 P b7ab4784c7344b939bc36f639286f377 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:20:20.319926 11341 consensus_queue.cc:1048] T 711ef6523deb4cbe8ef2ba61e1c21c98 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.009s
I20260709 13:20:20.328646 11345 raft_consensus.cc:697] T 07a92dd554674067a83a9cb68c4773f2 P b7ab4784c7344b939bc36f639286f377 [term 12 LEADER]: Becoming Leader. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
I20260709 13:20:20.329824 11345 consensus_queue.cc:237] T 07a92dd554674067a83a9cb68c4773f2 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:20.330400 11316 raft_consensus.cc:2804] T bd6869f07b5a4885a0b99fbe60c3b175 P cd75a17ab2604397adab03bb8b5fd75c [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:20:20.331171 11316 raft_consensus.cc:493] T bd6869f07b5a4885a0b99fbe60c3b175 P cd75a17ab2604397adab03bb8b5fd75c [term 12 FOLLOWER]: Starting leader election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:20:20.267683 11300 consensus_queue.cc:1059] T 3d65025eea89441290d85dd053810e31 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: INVALID_TERM, Last received: 10.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.039s
I20260709 13:20:20.332240 11300 consensus_queue.cc:1243] T 3d65025eea89441290d85dd053810e31 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Peer b7ab4784c7344b939bc36f639286f377 log is divergent from this leader: its last log entry 11.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 13:20:20.314918  6879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ba5dac66ab5497e9e336f2a3c28cda5" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:20.328359  6729 raft_consensus.cc:1275] T 34f36d59d88f40fe8a2805e604fc6c0a P ccd8a4c3bfe3413cb2ae219b09aea832 [term 9 FOLLOWER]: Refusing update from remote peer b7ab4784c7344b939bc36f639286f377: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:20:20.333168  6879 raft_consensus.cc:2468] T 7ba5dac66ab5497e9e336f2a3c28cda5 P cd75a17ab2604397adab03bb8b5fd75c [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 12.
I20260709 13:20:20.334218  6729 raft_consensus.cc:1275] T 7a734b5ab7834e05a8c422208acc58b1 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 13 FOLLOWER]: Refusing update from remote peer b7ab4784c7344b939bc36f639286f377: Log matching property violated. Preceding OpId in replica: term: 11 index: 5. Preceding OpId from leader: term: 13 index: 5. (term mismatch)
I20260709 13:20:20.334602  6729 pending_rounds.cc:85] T 7a734b5ab7834e05a8c422208acc58b1 P ccd8a4c3bfe3413cb2ae219b09aea832: Aborting all ops after (but not including) 4
I20260709 13:20:20.334825  6729 pending_rounds.cc:107] T 7a734b5ab7834e05a8c422208acc58b1 P ccd8a4c3bfe3413cb2ae219b09aea832: Aborting uncommitted NO_OP operation due to leader change: 11.5
I20260709 13:20:20.307034 11117 consensus_queue.cc:1048] T 3d65025eea89441290d85dd053810e31 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.028s
I20260709 13:20:20.325857  6726 raft_consensus.cc:2468] T ce4f062dcd314d43a63ca74067cb5ee3 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in term 12.
I20260709 13:20:20.354043 11312 consensus_queue.cc:1048] T 4b8cacb381b746da8d0049b0a83b41dd P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:20:20.335062  6729 raft_consensus.cc:2889] T 7a734b5ab7834e05a8c422208acc58b1 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:20:20.357164 11179 raft_consensus.cc:493] T d8cee0accdb8499c86d4414b72565a38 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 12 FOLLOWER]: Starting pre-election (detected failure of leader cd75a17ab2604397adab03bb8b5fd75c)
I20260709 13:20:20.357724 11179 raft_consensus.cc:515] T d8cee0accdb8499c86d4414b72565a38 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:20:20.360486  7500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce4f062dcd314d43a63ca74067cb5ee3" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:20:20.337000 11292 consensus_queue.cc:1059] T b56bf91d90824c959e21e0cee5ba1816 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.024s
I20260709 13:20:20.361143  7500 raft_consensus.cc:2468] T ce4f062dcd314d43a63ca74067cb5ee3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 12.
I20260709 13:20:20.361927 11292 raft_consensus.cc:3055] T b56bf91d90824c959e21e0cee5ba1816 P b7ab4784c7344b939bc36f639286f377 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:20:20.362111  7503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3d8792045a4583ae2e965b1350a5b4" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:20:20.362305 11292 raft_consensus.cc:740] T b56bf91d90824c959e21e0cee5ba1816 P b7ab4784c7344b939bc36f639286f377 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
I20260709 13:20:20.363543  7496 raft_consensus.cc:1240] T 24ee15416e3145beaa1b8183453729a3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 14 FOLLOWER]: Rejecting Update request from peer cd75a17ab2604397adab03bb8b5fd75c for earlier term 13. Current term is 14. Ops: []
I20260709 13:20:20.337347 11252 consensus_queue.cc:1059] T 7c37d41cd9164c15a6826ca62a851a69 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.027s
I20260709 13:20:20.364637 11252 raft_consensus.cc:3055] T 7c37d41cd9164c15a6826ca62a851a69 P b7ab4784c7344b939bc36f639286f377 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:20:20.364976 11252 raft_consensus.cc:740] T 7c37d41cd9164c15a6826ca62a851a69 P b7ab4784c7344b939bc36f639286f377 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
I20260709 13:20:20.365952 11252 consensus_queue.cc:260] T 7c37d41cd9164c15a6826ca62a851a69 P b7ab4784c7344b939bc36f639286f377 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:20.336812 11117 raft_consensus.cc:2804] T c4db81d9d329422bb3b4160ca4ac2d1d P b7ab4784c7344b939bc36f639286f377 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:20:20.363162 11292 consensus_queue.cc:260] T b56bf91d90824c959e21e0cee5ba1816 P b7ab4784c7344b939bc36f639286f377 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:20.250442 11371 consensus_queue.cc:1059] T 8c7f33e544204fbaac4078e3e83bbf4e P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.064s
I20260709 13:20:20.311354 11362 raft_consensus.cc:740] T bb7fa124c3bf4ef9ab65a407cb008441 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 7ba59cc884714e8aa5f3f0ecaed84cbb, State: Running, Role: LEADER
W20260709 13:20:20.400283  7467 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:20.400508  6697 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 157249us
W20260709 13:20:20.376663  6695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 136128us
I20260709 13:20:20.377189  6844 leader_election.cc:304] T 22ccee1b570c4ad3a57bd7aec085b1b4 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:20:20.402235  6878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bf4668eeb70467fb3dc5a0289233b3c" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:20.402663  6875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f00a2e87e56452083b759f60d461ee3" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:20.403321  6875 raft_consensus.cc:2468] T 4f00a2e87e56452083b759f60d461ee3 P cd75a17ab2604397adab03bb8b5fd75c [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 12.
I20260709 13:20:20.381465  6874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09c2a98de1a4decabd0ff900dd44caa" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:20.403925  6695 leader_election.cc:304] T 853ac0a8cbd64ce99457f170216d4d0f P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
I20260709 13:20:20.406059  6807 raft_consensus.cc:1240] T be1a92657f494cac8dd227d152f50151 P b7ab4784c7344b939bc36f639286f377 [term 14 FOLLOWER]: Rejecting Update request from peer 7ba59cc884714e8aa5f3f0ecaed84cbb for earlier term 13. Current term is 14. Ops: []
I20260709 13:20:20.331728 11316 raft_consensus.cc:3060] T bd6869f07b5a4885a0b99fbe60c3b175 P cd75a17ab2604397adab03bb8b5fd75c [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:20.409363  7495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fa34c08b205435dba97346991aa1f92" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 15 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:20:20.410821 11292 raft_consensus.cc:3060] T b56bf91d90824c959e21e0cee5ba1816 P b7ab4784c7344b939bc36f639286f377 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:20:20.413441  7495 raft_consensus.cc:1275] T ce4f062dcd314d43a63ca74067cb5ee3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 12 FOLLOWER]: Refusing update from remote peer b7ab4784c7344b939bc36f639286f377: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:20:20.415555  6879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8cee0accdb8499c86d4414b72565a38" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:20.416401 11371 raft_consensus.cc:3055] T 8c7f33e544204fbaac4078e3e83bbf4e P ccd8a4c3bfe3413cb2ae219b09aea832 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:20:20.416848 11371 raft_consensus.cc:740] T 8c7f33e544204fbaac4078e3e83bbf4e P ccd8a4c3bfe3413cb2ae219b09aea832 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
I20260709 13:20:20.417827 11371 consensus_queue.cc:260] T 8c7f33e544204fbaac4078e3e83bbf4e P ccd8a4c3bfe3413cb2ae219b09aea832 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:20.419440 11371 raft_consensus.cc:3060] T 8c7f33e544204fbaac4078e3e83bbf4e P ccd8a4c3bfe3413cb2ae219b09aea832 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:20:20.422011  6770 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:20.390852 11252 raft_consensus.cc:3060] T 7c37d41cd9164c15a6826ca62a851a69 P b7ab4784c7344b939bc36f639286f377 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:20:20.344491 11311 raft_consensus.cc:3055] T 17587d6730594da4a56fa13a353232a1 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:20:20.426730 11311 raft_consensus.cc:740] T 17587d6730594da4a56fa13a353232a1 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
I20260709 13:20:20.427480 11326 consensus_queue.cc:260] T 3d65025eea89441290d85dd053810e31 P ccd8a4c3bfe3413cb2ae219b09aea832 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 5, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:20.428824 11326 raft_consensus.cc:3060] T 3d65025eea89441290d85dd053810e31 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:20:20.395627 11167 consensus_queue.cc:1059] T 24ee15416e3145beaa1b8183453729a3 P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.034s
I20260709 13:20:20.429718 11167 raft_consensus.cc:3055] T 24ee15416e3145beaa1b8183453729a3 P cd75a17ab2604397adab03bb8b5fd75c [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:20:20.430090 11167 raft_consensus.cc:740] T 24ee15416e3145beaa1b8183453729a3 P cd75a17ab2604397adab03bb8b5fd75c [term 13 LEADER]: Becoming Follower/Learner. State: Replica: cd75a17ab2604397adab03bb8b5fd75c, State: Running, Role: LEADER
I20260709 13:20:20.430900 11167 consensus_queue.cc:260] T 24ee15416e3145beaa1b8183453729a3 P cd75a17ab2604397adab03bb8b5fd75c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:20:20.431674  6725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09c2a98de1a4decabd0ff900dd44caa" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:20.432350 11362 consensus_queue.cc:260] T bb7fa124c3bf4ef9ab65a407cb008441 P 7ba59cc884714e8aa5f3f0ecaed84cbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:20:20.433440  6725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab432e62819d499eaaf3dd55481dd930" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:20:20.433470 11362 raft_consensus.cc:3060] T bb7fa124c3bf4ef9ab65a407cb008441 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:20.436498  6723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20f6842e26174571996b8dea4151d4be" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:20:20.386725 11117 raft_consensus.cc:493] T c4db81d9d329422bb3b4160ca4ac2d1d P b7ab4784c7344b939bc36f639286f377 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:20.437829 11117 raft_consensus.cc:3060] T c4db81d9d329422bb3b4160ca4ac2d1d P b7ab4784c7344b939bc36f639286f377 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:20:20.439544 10727 raft_consensus.cc:3055] T 90d42e216d9741e190bca19a781291fd P ccd8a4c3bfe3413cb2ae219b09aea832 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:20:20.440099 10727 raft_consensus.cc:740] T 90d42e216d9741e190bca19a781291fd P ccd8a4c3bfe3413cb2ae219b09aea832 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
I20260709 13:20:20.441061 10727 consensus_queue.cc:260] T 90d42e216d9741e190bca19a781291fd P ccd8a4c3bfe3413cb2ae219b09aea832 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:20.443411  6801 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:32976 (request call id 2891) took 3035 ms. Trace:
I20260709 13:20:20.443861  6801 rpcz_store.cc:276] 0709 13:20:17.408285 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:17.764839 (+356554us) service_pool.cc:224] Handling call
0709 13:20:17.805407 (+ 40568us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:19.942673 (+2137266us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:20.443128 (+500455us) spinlock_profiling.cc:243] Waited 2.13 s on lock 0x7b54002c92d4. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f9aae01 00007fcc0f9a983e 00007fcc1496e419 00007fcc0dee5bd4 00007fcc0dee5b62 00007fcc0dee5a91 00007fcc0dee5a0c 00007fcc0dee4cc2 00007fcc0dce548c 00007fcc0dce48c6
0709 13:20:20.443331 (+   203us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4901254912}
I20260709 13:20:20.403086  6878 raft_consensus.cc:2468] T 1bf4668eeb70467fb3dc5a0289233b3c P cd75a17ab2604397adab03bb8b5fd75c [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 11.
I20260709 13:20:20.446933  7500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f00a2e87e56452083b759f60d461ee3" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:20:20.450456  6770 leader_election.cc:304] T 95a75bfe094d4bdc963aba3f08dfcd25 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:20:20.453579  6874 raft_consensus.cc:1275] T 2c240553ce044eedb41541d72b9475d7 P cd75a17ab2604397adab03bb8b5fd75c [term 13 FOLLOWER]: Refusing update from remote peer b7ab4784c7344b939bc36f639286f377: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:20:20.454936  6727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5be3a11b23d4ea9b08300a2789821c7" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:20:20.359818 11179 leader_election.cc:290] T d8cee0accdb8499c86d4414b72565a38 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:20.387391  6799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17587d6730594da4a56fa13a353232a1" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 18 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:20.390776  6881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab432e62819d499eaaf3dd55481dd930" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:20:20.402132  7503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8cee0accdb8499c86d4414b72565a38" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:20:20.455933  6770 leader_election.cc:304] T f03d0dbf16864ca4bc1bb5e4c0334c0f P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:20:20.456583  6875 raft_consensus.cc:1275] T ce4f062dcd314d43a63ca74067cb5ee3 P cd75a17ab2604397adab03bb8b5fd75c [term 12 FOLLOWER]: Refusing update from remote peer b7ab4784c7344b939bc36f639286f377: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
W20260709 13:20:20.464790  6697 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 61614.5us
W20260709 13:20:20.465025  6695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 61188.9us
I20260709 13:20:20.466511  6697 leader_election.cc:304] T f58dc08b12a2494bb9a1372837970ca2 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:20:20.467666  6770 leader_election.cc:304] T be1a92657f494cac8dd227d152f50151 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:20:20.471153  6881 raft_consensus.cc:1275] T 90d42e216d9741e190bca19a781291fd P cd75a17ab2604397adab03bb8b5fd75c [term 12 FOLLOWER]: Refusing update from remote peer b7ab4784c7344b939bc36f639286f377: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:20:20.471289  6770 leader_election.cc:304] T e31b9971c15848dea59d4d4130141d9e P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:20:20.473143  6697 leader_election.cc:304] T a3022224cc81473690653a83d4e99470 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:20:20.472556  6695 leader_election.cc:304] T 4d9def8b32fd443aa94ab1420b06837b P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:20:20.475936  6723 raft_consensus.cc:1275] T 2c240553ce044eedb41541d72b9475d7 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 13 FOLLOWER]: Refusing update from remote peer b7ab4784c7344b939bc36f639286f377: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:20:20.476909  6770 leader_election.cc:304] T 17587d6730594da4a56fa13a353232a1 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:20:20.486694  6770 leader_election.cc:304] T 404190ce4ce94cecbfcb6ea9d1dd8626 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:20:20.489320  6881 raft_consensus.cc:1275] T 9b3759de40694069b13c0f8bd40e5709 P cd75a17ab2604397adab03bb8b5fd75c [term 11 FOLLOWER]: Refusing update from remote peer b7ab4784c7344b939bc36f639286f377: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:20:20.489689  6770 leader_election.cc:304] T b3f13b31a1f84f0d89d007eadd57924c P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:20:20.490024  6805 raft_consensus.cc:3060] T 44bde925b2e541b69890d70715b85176 P b7ab4784c7344b939bc36f639286f377 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:20.458834 11167 raft_consensus.cc:3060] T 24ee15416e3145beaa1b8183453729a3 P cd75a17ab2604397adab03bb8b5fd75c [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:20.458626 11325 raft_consensus.cc:2749] T 95a75bfe094d4bdc963aba3f08dfcd25 P b7ab4784c7344b939bc36f639286f377 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:20:20.466955 11312 raft_consensus.cc:2749] T 22ccee1b570c4ad3a57bd7aec085b1b4 P cd75a17ab2604397adab03bb8b5fd75c [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:20:20.502185  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 178187us
I20260709 13:20:20.503217  6844 leader_election.cc:304] T 1bf4668eeb70467fb3dc5a0289233b3c P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:20:20.480644 11363 raft_consensus.cc:2749] T be1a92657f494cac8dd227d152f50151 P b7ab4784c7344b939bc36f639286f377 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:20:20.479585 10700 consensus_queue.cc:1059] T 90d42e216d9741e190bca19a781291fd P ccd8a4c3bfe3413cb2ae219b09aea832 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.036s
I20260709 13:20:20.506045 11363 raft_consensus.cc:2749] T b3f13b31a1f84f0d89d007eadd57924c P b7ab4784c7344b939bc36f639286f377 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:20:20.481493 11061 raft_consensus.cc:2804] T f03d0dbf16864ca4bc1bb5e4c0334c0f P b7ab4784c7344b939bc36f639286f377 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:20:20.508273 11377 raft_consensus.cc:2749] T 30e88460611e47b2ba16a46a30b5f416 P cd75a17ab2604397adab03bb8b5fd75c [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:20:20.470136 11259 leader_election.cc:290] T f5be3a11b23d4ea9b08300a2789821c7 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 11 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:20.485046 11347 raft_consensus.cc:3060] T 17587d6730594da4a56fa13a353232a1 P b7ab4784c7344b939bc36f639286f377 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:20.481014 11326 raft_consensus.cc:2749] T f58dc08b12a2494bb9a1372837970ca2 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:20:20.520936  6695 leader_election.cc:304] T de3186201e1a40d0b335eeb8b4e256e0 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:20:20.479105 11394 raft_consensus.cc:2804] T 853ac0a8cbd64ce99457f170216d4d0f P ccd8a4c3bfe3413cb2ae219b09aea832 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:20:20.484565 11342 raft_consensus.cc:2804] T e31b9971c15848dea59d4d4130141d9e P b7ab4784c7344b939bc36f639286f377 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:20:20.515496  6799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce4f062dcd314d43a63ca74067cb5ee3" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:20.470288 11118 consensus_queue.cc:1048] T ce4f062dcd314d43a63ca74067cb5ee3 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.046s
I20260709 13:20:20.519744 11066 raft_consensus.cc:2804] T 1bf4668eeb70467fb3dc5a0289233b3c P cd75a17ab2604397adab03bb8b5fd75c [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:20:20.531103  6801 raft_consensus.cc:1240] T bb7fa124c3bf4ef9ab65a407cb008441 P b7ab4784c7344b939bc36f639286f377 [term 13 FOLLOWER]: Rejecting Update request from peer 7ba59cc884714e8aa5f3f0ecaed84cbb for earlier term 12. Current term is 13. Ops: [12.10-12.10]
I20260709 13:20:20.495951 10708 raft_consensus.cc:2749] T 404190ce4ce94cecbfcb6ea9d1dd8626 P b7ab4784c7344b939bc36f639286f377 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:20:20.501330 11010 raft_consensus.cc:2749] T 4d9def8b32fd443aa94ab1420b06837b P ccd8a4c3bfe3413cb2ae219b09aea832 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:20:20.513797 11339 leader_election.cc:290] T 24ee15416e3145beaa1b8183453729a3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 14 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:20.427559 11311 consensus_queue.cc:260] T 17587d6730594da4a56fa13a353232a1 P ccd8a4c3bfe3413cb2ae219b09aea832 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:20:20.535490  6844 leader_election.cc:304] T de3186201e1a40d0b335eeb8b4e256e0 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:20:20.519385 11377 raft_consensus.cc:493] T f5be3a11b23d4ea9b08300a2789821c7 P cd75a17ab2604397adab03bb8b5fd75c [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:20.533463  6697 leader_election.cc:304] T 2c240553ce044eedb41541d72b9475d7 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377
I20260709 13:20:20.508322 11061 raft_consensus.cc:493] T f03d0dbf16864ca4bc1bb5e4c0334c0f P b7ab4784c7344b939bc36f639286f377 [term 10 FOLLOWER]: Starting leader election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:20:20.526180  6695 leader_election.cc:304] T f4b8bd455d5a47c18a1380839c6e0d61 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
I20260709 13:20:20.556785  6697 leader_election.cc:304] T bb3d8792045a4583ae2e965b1350a5b4 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb
I20260709 13:20:20.526310 11342 raft_consensus.cc:493] T e31b9971c15848dea59d4d4130141d9e P b7ab4784c7344b939bc36f639286f377 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:20.525642 11394 raft_consensus.cc:493] T 853ac0a8cbd64ce99457f170216d4d0f P ccd8a4c3bfe3413cb2ae219b09aea832 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:20.561368  6695 leader_election.cc:304] T 30e88460611e47b2ba16a46a30b5f416 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
W20260709 13:20:20.571940  6698 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:20.573062  6698 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:20.572834  6695 leader_election.cc:304] T 3411566abe2d4c9bb4b2adfdd05e6f17 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
I20260709 13:20:20.534358 11393 consensus_queue.cc:1059] T 07a92dd554674067a83a9cb68c4773f2 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: INVALID_TERM, Last received: 10.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.112s
I20260709 13:20:20.653950 11393 raft_consensus.cc:3055] T 07a92dd554674067a83a9cb68c4773f2 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:20:20.654161  6801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8cee0accdb8499c86d4414b72565a38" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:20.654477 11393 raft_consensus.cc:740] T 07a92dd554674067a83a9cb68c4773f2 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
I20260709 13:20:20.654932  6801 raft_consensus.cc:2468] T d8cee0accdb8499c86d4414b72565a38 P b7ab4784c7344b939bc36f639286f377 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in term 12.
W20260709 13:20:20.656121  7469 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:20.656577  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 141428us
I20260709 13:20:20.657998  6844 leader_election.cc:304] T a1704639a875409b9959353527b3fd68 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:20:20.660284 11051 raft_consensus.cc:2749] T a1704639a875409b9959353527b3fd68 P cd75a17ab2604397adab03bb8b5fd75c [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:20:20.532548 11066 raft_consensus.cc:493] T 1bf4668eeb70467fb3dc5a0289233b3c P cd75a17ab2604397adab03bb8b5fd75c [term 11 FOLLOWER]: Starting leader election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:20:20.565701 11326 raft_consensus.cc:2804] T 2c240553ce044eedb41541d72b9475d7 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:20:20.565095 11061 raft_consensus.cc:3060] T f03d0dbf16864ca4bc1bb5e4c0334c0f P b7ab4784c7344b939bc36f639286f377 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:20:20.698132  6844 leader_election.cc:304] T ab432e62819d499eaaf3dd55481dd930 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:20:20.567997 11312 raft_consensus.cc:2749] T de3186201e1a40d0b335eeb8b4e256e0 P cd75a17ab2604397adab03bb8b5fd75c [term 13 LEADER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:20:20.655372 11393 consensus_queue.cc:260] T 07a92dd554674067a83a9cb68c4773f2 P ccd8a4c3bfe3413cb2ae219b09aea832 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:20.617712 11124 raft_consensus.cc:2804] T f4b8bd455d5a47c18a1380839c6e0d61 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:20:20.565939 11288 raft_consensus.cc:2749] T b56bf91d90824c959e21e0cee5ba1816 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:20:20.618669 11342 raft_consensus.cc:3060] T e31b9971c15848dea59d4d4130141d9e P b7ab4784c7344b939bc36f639286f377 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:20:20.641085 11126 raft_consensus.cc:2804] T 30e88460611e47b2ba16a46a30b5f416 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:20:20.697860 11311 raft_consensus.cc:3060] T 17587d6730594da4a56fa13a353232a1 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:20.641366 11394 raft_consensus.cc:3060] T 853ac0a8cbd64ce99457f170216d4d0f P ccd8a4c3bfe3413cb2ae219b09aea832 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:20:20.788868 11397 log.cc:927] Time spent T 9e326172347f45e99a0d482b5d8ef768 P ccd8a4c3bfe3413cb2ae219b09aea832: Append to log took a long time: real 0.224s	user 0.000s	sys 0.000s
I20260709 13:20:20.698943 11066 raft_consensus.cc:3060] T 1bf4668eeb70467fb3dc5a0289233b3c P cd75a17ab2604397adab03bb8b5fd75c [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:20:20.617389 11240 consensus_queue.cc:1059] T be1a92657f494cac8dd227d152f50151 P 7ba59cc884714e8aa5f3f0ecaed84cbb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.161s
I20260709 13:20:20.718699 11326 raft_consensus.cc:493] T 2c240553ce044eedb41541d72b9475d7 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:20:20.812871 11386 consensus_meta.cc:287] T f03d0dbf16864ca4bc1bb5e4c0334c0f P ccd8a4c3bfe3413cb2ae219b09aea832: Time spent flushing consensus metadata: real 0.584s	user 0.010s	sys 0.000s
W20260709 13:20:20.815474  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 117440us
I20260709 13:20:20.619288 11377 raft_consensus.cc:515] T f5be3a11b23d4ea9b08300a2789821c7 P cd75a17ab2604397adab03bb8b5fd75c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:20.781992 11051 raft_consensus.cc:2749] T ab432e62819d499eaaf3dd55481dd930 P cd75a17ab2604397adab03bb8b5fd75c [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:20:20.817611 11393 raft_consensus.cc:3060] T 07a92dd554674067a83a9cb68c4773f2 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:20:20.817456 11117 raft_consensus.cc:515] T c4db81d9d329422bb3b4160ca4ac2d1d P b7ab4784c7344b939bc36f639286f377 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:20.844852 11117 leader_election.cc:290] T c4db81d9d329422bb3b4160ca4ac2d1d P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 12 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:20.781875 11124 raft_consensus.cc:493] T f4b8bd455d5a47c18a1380839c6e0d61 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:20.845779 11124 raft_consensus.cc:3060] T f4b8bd455d5a47c18a1380839c6e0d61 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:20:20.781181 11289 raft_consensus.cc:2804] T a3022224cc81473690653a83d4e99470 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 13:20:20.818627 11396 log.cc:927] Time spent T a3022224cc81473690653a83d4e99470 P cd75a17ab2604397adab03bb8b5fd75c: Append to log took a long time: real 0.117s	user 0.001s	sys 0.000s
I20260709 13:20:20.819065  6731 raft_consensus.cc:1240] T b56bf91d90824c959e21e0cee5ba1816 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 12 FOLLOWER]: Rejecting Update request from peer b7ab4784c7344b939bc36f639286f377 for earlier term 11. Current term is 12. Ops: []
I20260709 13:20:20.819723 11126 raft_consensus.cc:493] T 30e88460611e47b2ba16a46a30b5f416 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:20.875365 11377 leader_election.cc:290] T f5be3a11b23d4ea9b08300a2789821c7 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:20:20.824554  6805 raft_consensus.cc:1275] T 44bde925b2e541b69890d70715b85176 P b7ab4784c7344b939bc36f639286f377 [term 13 FOLLOWER]: Refusing update from remote peer ccd8a4c3bfe3413cb2ae219b09aea832: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:20:20.834537 11326 raft_consensus.cc:3060] T 2c240553ce044eedb41541d72b9475d7 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:20.886366  6844 leader_election.cc:304] T e77e330a82df4b43a745d57a68f6f057 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
W20260709 13:20:20.895665  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 44532.2us
I20260709 13:20:20.620537  7466 leader_election.cc:304] T 17587d6730594da4a56fa13a353232a1 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:20:20.888265  6805 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:32976 (request call id 2887) took 3511 ms. Trace:
W20260709 13:20:20.890794  6695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 318073us
I20260709 13:20:20.530360 10700 raft_consensus.cc:2804] T de3186201e1a40d0b335eeb8b4e256e0 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 13:20:20.900003  6697 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 343328us
I20260709 13:20:20.937711  6697 leader_election.cc:304] T a1704639a875409b9959353527b3fd68 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377
W20260709 13:20:20.961452  7468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 308865us
I20260709 13:20:20.962445  6844 leader_election.cc:400] T 7a734b5ab7834e05a8c422208acc58b1 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 12 election: Vote denied by peer b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817) with higher term. Message: Invalid argument: T 7a734b5ab7834e05a8c422208acc58b1 P b7ab4784c7344b939bc36f639286f377 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c for earlier term 12. Current term is 13.
I20260709 13:20:20.963009  6844 leader_election.cc:403] T 7a734b5ab7834e05a8c422208acc58b1 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 12 election: Cancelling election due to peer responding with higher term
W20260709 13:20:20.951891  7466 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 331464us
I20260709 13:20:20.935879  6805 rpcz_store.cc:276] 0709 13:20:17.377459 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:17.440417 (+ 62958us) service_pool.cc:224] Handling call
0709 13:20:17.440883 (+   466us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:19.863715 (+2422832us) spinlock_profiling.cc:243] Waited 1.26 s on lock 0x7b58004d1bd0. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f9060aa 00007fcc0f988447 00007fcc0f9a0fe7 00007fcc0f9a27de 00007fcc0f9acb49 00007fcc0f9ad416 00007fcc0f9a9d8f 00007fcc0f9a983e 00007fcc1496e419 00007fcc0dee5bd4
0709 13:20:20.489271 (+625556us) spinlock_profiling.cc:243] Waited 109 ms on lock 0x7b54001782a0. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f91fa1d 00007fcc0f9061a4 00007fcc0f988447 00007fcc0f9a0fe7 00007fcc0f9a27de 00007fcc0f9acb49 00007fcc0f9ad416 00007fcc0f9a9d8f 00007fcc0f9a983e 00007fcc1496e419
0709 13:20:20.885643 (+396372us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:20.888173 (+  2530us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3138930304}
W20260709 13:20:20.937297 11400 log.cc:927] Time spent T 427c124d773f483294511e80fe340075 P ccd8a4c3bfe3413cb2ae219b09aea832: Append to log took a long time: real 0.067s	user 0.001s	sys 0.000s
I20260709 13:20:20.880661 11126 raft_consensus.cc:3060] T 30e88460611e47b2ba16a46a30b5f416 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:20:20.897614 11345 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.507s	user 0.001s	sys 0.033s
I20260709 13:20:20.965436  6697 leader_election.cc:304] T 7a734b5ab7834e05a8c422208acc58b1 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
W20260709 13:20:20.899066 11198 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 13 current term: 13 is higher.
I20260709 13:20:20.971946  7466 leader_election.cc:304] T d8cee0accdb8499c86d4414b72565a38 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, b7ab4784c7344b939bc36f639286f377; no voters: 
I20260709 13:20:20.851274 11386 raft_consensus.cc:515] T f03d0dbf16864ca4bc1bb5e4c0334c0f P ccd8a4c3bfe3413cb2ae219b09aea832 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
W20260709 13:20:20.974898  6770 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 485280us
I20260709 13:20:20.936281 10700 raft_consensus.cc:493] T de3186201e1a40d0b335eeb8b4e256e0 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:20.977053  6770 leader_election.cc:304] T f4b8bd455d5a47c18a1380839c6e0d61 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:20:20.938920 11377 raft_consensus.cc:2749] T e77e330a82df4b43a745d57a68f6f057 P cd75a17ab2604397adab03bb8b5fd75c [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:20:20.985057  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 46134.8us
I20260709 13:20:20.986279  6844 leader_election.cc:304] T 95a75bfe094d4bdc963aba3f08dfcd25 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:20:20.961287 11240 raft_consensus.cc:2749] T 17587d6730594da4a56fa13a353232a1 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:20:20.982343  7467 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:20.899518 11288 raft_consensus.cc:2804] T 3411566abe2d4c9bb4b2adfdd05e6f17 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 13:20:20.974406 11345 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.597s	user 0.002s	sys 0.034s
I20260709 13:20:20.857190 11316 raft_consensus.cc:515] T bd6869f07b5a4885a0b99fbe60c3b175 P cd75a17ab2604397adab03bb8b5fd75c [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:20.968993 11369 raft_consensus.cc:2804] T a1704639a875409b9959353527b3fd68 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:20:21.009902  6770 leader_election.cc:304] T 1528ab62b6fe4e3099d08f141afee116 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:20:20.971127 11051 raft_consensus.cc:2749] T 7a734b5ab7834e05a8c422208acc58b1 P cd75a17ab2604397adab03bb8b5fd75c [term 13 FOLLOWER]: Leader election lost for term 12. Reason: Vote denied by peer b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817) with higher term. Message: Invalid argument: T 7a734b5ab7834e05a8c422208acc58b1 P b7ab4784c7344b939bc36f639286f377 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c for earlier term 12. Current term is 13.
I20260709 13:20:20.963671 11010 consensus_queue.cc:1048] T c4db81d9d329422bb3b4160ca4ac2d1d P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.026s
I20260709 13:20:20.941179 11371 raft_consensus.cc:2804] T bb3d8792045a4583ae2e965b1350a5b4 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:20:20.983741 10700 raft_consensus.cc:3060] T de3186201e1a40d0b335eeb8b4e256e0 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:20.980620 10989 raft_consensus.cc:493] T 44bde925b2e541b69890d70715b85176 P b7ab4784c7344b939bc36f639286f377 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:20:21.060231  6695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 93656.4us
W20260709 13:20:21.054638 11252 consensus_meta.cc:287] T 7c37d41cd9164c15a6826ca62a851a69 P b7ab4784c7344b939bc36f639286f377: Time spent flushing consensus metadata: real 0.632s	user 0.010s	sys 0.002s
W20260709 13:20:21.070880  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 84751.4us
W20260709 13:20:21.072307 11292 consensus_meta.cc:287] T b56bf91d90824c959e21e0cee5ba1816 P b7ab4784c7344b939bc36f639286f377: Time spent flushing consensus metadata: real 0.661s	user 0.008s	sys 0.004s
I20260709 13:20:21.058339 11312 raft_consensus.cc:3060] T 95a75bfe094d4bdc963aba3f08dfcd25 P cd75a17ab2604397adab03bb8b5fd75c [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:20:21.054445 11354 raft_consensus.cc:2804] T f4b8bd455d5a47c18a1380839c6e0d61 P b7ab4784c7344b939bc36f639286f377 [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 13:20:21.085587  6697 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 120282us
W20260709 13:20:21.088148  6770 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 78389us
I20260709 13:20:21.068975 11288 raft_consensus.cc:493] T 3411566abe2d4c9bb4b2adfdd05e6f17 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:21.089056  6770 leader_election.cc:304] T bd6869f07b5a4885a0b99fbe60c3b175 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:20:21.080404 11369 raft_consensus.cc:493] T a1704639a875409b9959353527b3fd68 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:21.078243 11189 raft_consensus.cc:2804] T d8cee0accdb8499c86d4414b72565a38 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:20:21.094555  6770 leader_election.cc:304] T 427c124d773f483294511e80fe340075 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb
I20260709 13:20:21.091749  6697 leader_election.cc:304] T e31b9971c15848dea59d4d4130141d9e P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:20:21.098214  6770 leader_election.cc:304] T 7c44c4849aa54f2b94d1f1bef9ed546f P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
W20260709 13:20:21.099337  6698 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:21.100126  6698 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:21.080945 11371 raft_consensus.cc:493] T bb3d8792045a4583ae2e965b1350a5b4 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 7ba59cc884714e8aa5f3f0ecaed84cbb)
I20260709 13:20:21.106318 11363 consensus_queue.cc:1048] T 4d9def8b32fd443aa94ab1420b06837b P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:20:21.107805 11118 raft_consensus.cc:2749] T 7c44c4849aa54f2b94d1f1bef9ed546f P b7ab4784c7344b939bc36f639286f377 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:20:21.085268 10989 raft_consensus.cc:515] T 44bde925b2e541b69890d70715b85176 P b7ab4784c7344b939bc36f639286f377 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:21.106462 11010 consensus_queue.cc:1059] T ab432e62819d499eaaf3dd55481dd930 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: INVALID_TERM, Last received: 13.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:20:21.086468 11354 raft_consensus.cc:493] T f4b8bd455d5a47c18a1380839c6e0d61 P b7ab4784c7344b939bc36f639286f377 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:21.118575  6770 leader_election.cc:304] T 1bf4668eeb70467fb3dc5a0289233b3c P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
I20260709 13:20:21.094378 11292 raft_consensus.cc:2749] T 1528ab62b6fe4e3099d08f141afee116 P b7ab4784c7344b939bc36f639286f377 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:20:21.096597 11288 raft_consensus.cc:3060] T 3411566abe2d4c9bb4b2adfdd05e6f17 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:20:21.097424 11369 raft_consensus.cc:3060] T a1704639a875409b9959353527b3fd68 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:21.131016  6844 leader_election.cc:400] T 7c44c4849aa54f2b94d1f1bef9ed546f P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 13 pre-election: Vote denied by peer b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817) with higher term. Message: Invalid argument: T 7c44c4849aa54f2b94d1f1bef9ed546f P b7ab4784c7344b939bc36f639286f377 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c for earlier term 13. Current term is 14.
I20260709 13:20:21.097652 11345 raft_consensus.cc:2749] T bd6869f07b5a4885a0b99fbe60c3b175 P b7ab4784c7344b939bc36f639286f377 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:20:21.120100 11117 raft_consensus.cc:2804] T 427c124d773f483294511e80fe340075 P b7ab4784c7344b939bc36f639286f377 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:20:21.125204 11118 consensus_queue.cc:1048] T 711ef6523deb4cbe8ef2ba61e1c21c98 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.011s
I20260709 13:20:21.180971 11117 raft_consensus.cc:493] T 427c124d773f483294511e80fe340075 P b7ab4784c7344b939bc36f639286f377 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 7ba59cc884714e8aa5f3f0ecaed84cbb)
I20260709 13:20:21.181478 11117 raft_consensus.cc:3060] T 427c124d773f483294511e80fe340075 P b7ab4784c7344b939bc36f639286f377 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:20:21.130216 11010 raft_consensus.cc:2749] T 7a734b5ab7834e05a8c422208acc58b1 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:20:21.140842  6697 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 49178.2us
I20260709 13:20:21.183542  6697 leader_election.cc:304] T 3a485a995abc4807b6e511e45419f737 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:20:21.136098 11386 leader_election.cc:290] T f03d0dbf16864ca4bc1bb5e4c0334c0f P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 12 election: Requested vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:21.147181 10700 raft_consensus.cc:515] T de3186201e1a40d0b335eeb8b4e256e0 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:21.128968 10708 raft_consensus.cc:493] T bb7fa124c3bf4ef9ab65a407cb008441 P b7ab4784c7344b939bc36f639286f377 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:21.117348 11371 raft_consensus.cc:3060] T bb3d8792045a4583ae2e965b1350a5b4 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:20:21.154778 11414 raft_consensus.cc:2749] T e31b9971c15848dea59d4d4130141d9e P ccd8a4c3bfe3413cb2ae219b09aea832 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:20:21.156715 11387 raft_consensus.cc:3055] T ab432e62819d499eaaf3dd55481dd930 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 13 LEADER]: Stepping down as leader of term 13
W20260709 13:20:21.166678 11298 consensus_meta.cc:287] T d8292e16e5654be6bc408560cf256aaa P ccd8a4c3bfe3413cb2ae219b09aea832: Time spent flushing consensus metadata: real 0.872s	user 0.009s	sys 0.003s
I20260709 13:20:21.168592 11316 leader_election.cc:290] T bd6869f07b5a4885a0b99fbe60c3b175 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 13 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:20:21.127334 11354 raft_consensus.cc:3060] T f4b8bd455d5a47c18a1380839c6e0d61 P b7ab4784c7344b939bc36f639286f377 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:20:21.174803  6872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20f6842e26174571996b8dea4151d4be" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:20:21.176941 11403 raft_consensus.cc:2804] T 1bf4668eeb70467fb3dc5a0289233b3c P b7ab4784c7344b939bc36f639286f377 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:20:21.167326 11126 raft_consensus.cc:515] T 30e88460611e47b2ba16a46a30b5f416 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:21.171603 11312 raft_consensus.cc:2749] T 95a75bfe094d4bdc963aba3f08dfcd25 P cd75a17ab2604397adab03bb8b5fd75c [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:20:21.189812  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 59222.7us
W20260709 13:20:21.190969  6847 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:21.196367 10708 raft_consensus.cc:515] T bb7fa124c3bf4ef9ab65a407cb008441 P b7ab4784c7344b939bc36f639286f377 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:20:21.196640 11387 raft_consensus.cc:740] T ab432e62819d499eaaf3dd55481dd930 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
I20260709 13:20:21.199215  6731 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50004 (request call id 2145) took 1012 ms. Trace:
I20260709 13:20:21.218223  6731 rpcz_store.cc:276] 0709 13:20:20.187192 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:20.342785 (+155593us) service_pool.cc:224] Handling call
0709 13:20:20.343227 (+   442us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:20.853860 (+510633us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:21.198829 (+344969us) spinlock_profiling.cc:243] Waited 476 ms on lock 0x7b54003d5754. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f9aae01 00007fcc0f9a983e 00007fcc1496e419 00007fcc0dee5bd4 00007fcc0dee5b62 00007fcc0dee5a91 00007fcc0dee5a0c 00007fcc0dee4cc2 00007fcc0dce548c 00007fcc0dce48c6
0709 13:20:21.199116 (+   287us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1093792128}
W20260709 13:20:21.222645  6695 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:21.228288  6770 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 109821us
I20260709 13:20:21.208570 11414 raft_consensus.cc:2749] T 3a485a995abc4807b6e511e45419f737 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:20:21.172569 11066 raft_consensus.cc:515] T 1bf4668eeb70467fb3dc5a0289233b3c P cd75a17ab2604397adab03bb8b5fd75c [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:21.189131 11061 raft_consensus.cc:515] T f03d0dbf16864ca4bc1bb5e4c0334c0f P b7ab4784c7344b939bc36f639286f377 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:21.200063  6697 leader_election.cc:304] T 34f36d59d88f40fe8a2805e604fc6c0a P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377
W20260709 13:20:21.232306  6773 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:21.211185 11403 raft_consensus.cc:493] T 1bf4668eeb70467fb3dc5a0289233b3c P b7ab4784c7344b939bc36f639286f377 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:21.234782  6844 leader_election.cc:304] T 7887766dc6784fcaa42b35c05fea7a99 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:20:21.229966 11252 consensus_queue.cc:1048] T 34f36d59d88f40fe8a2805e604fc6c0a P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.012s
W20260709 13:20:21.247151  6847 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:21.198475 11342 raft_consensus.cc:515] T e31b9971c15848dea59d4d4130141d9e P b7ab4784c7344b939bc36f639286f377 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:21.230707 11415 raft_consensus.cc:493] T 9b3759de40694069b13c0f8bd40e5709 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:21.245765 11403 raft_consensus.cc:3060] T 1bf4668eeb70467fb3dc5a0289233b3c P b7ab4784c7344b939bc36f639286f377 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:21.246475 11386 raft_consensus.cc:2804] T 34f36d59d88f40fe8a2805e604fc6c0a P ccd8a4c3bfe3413cb2ae219b09aea832 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:20:21.258302 11312 raft_consensus.cc:2764] T 7887766dc6784fcaa42b35c05fea7a99 P cd75a17ab2604397adab03bb8b5fd75c [term 13 FOLLOWER]: Leader election decision vote started in defunct term 12: won
I20260709 13:20:21.269376 11126 leader_election.cc:290] T 30e88460611e47b2ba16a46a30b5f416 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 11 election: Requested vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:21.272142 11416 consensus_queue.cc:1048] T f5be3a11b23d4ea9b08300a2789821c7 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.007s
I20260709 13:20:21.279510 11010 raft_consensus.cc:493] T f09c2a98de1a4decabd0ff900dd44caa P ccd8a4c3bfe3413cb2ae219b09aea832 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader cd75a17ab2604397adab03bb8b5fd75c)
I20260709 13:20:21.280725 11010 raft_consensus.cc:515] T f09c2a98de1a4decabd0ff900dd44caa P ccd8a4c3bfe3413cb2ae219b09aea832 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:21.285038 11189 raft_consensus.cc:493] T d8cee0accdb8499c86d4414b72565a38 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 12 FOLLOWER]: Starting leader election (detected failure of leader cd75a17ab2604397adab03bb8b5fd75c)
I20260709 13:20:21.242784 11118 consensus_queue.cc:1048] T 7a734b5ab7834e05a8c422208acc58b1 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.020s
I20260709 13:20:21.260357 10700 leader_election.cc:290] T de3186201e1a40d0b335eeb8b4e256e0 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 14 election: Requested vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:21.317919  6872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5be3a11b23d4ea9b08300a2789821c7" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:20:21.318581  6872 raft_consensus.cc:3060] T f5be3a11b23d4ea9b08300a2789821c7 P cd75a17ab2604397adab03bb8b5fd75c [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:20:21.319721  6881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e31b9971c15848dea59d4d4130141d9e" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:20:21.256459 11387 consensus_queue.cc:260] T ab432e62819d499eaaf3dd55481dd930 P ccd8a4c3bfe3413cb2ae219b09aea832 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:21.243353 11292 consensus_queue.cc:1048] T 2c240553ce044eedb41541d72b9475d7 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.019s
I20260709 13:20:21.265048 11386 raft_consensus.cc:493] T 34f36d59d88f40fe8a2805e604fc6c0a P ccd8a4c3bfe3413cb2ae219b09aea832 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:21.295150 11061 leader_election.cc:290] T f03d0dbf16864ca4bc1bb5e4c0334c0f P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 11 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:21.326543  7466 leader_election.cc:304] T 4b8cacb381b746da8d0049b0a83b41dd P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
I20260709 13:20:21.298297 11124 raft_consensus.cc:515] T f4b8bd455d5a47c18a1380839c6e0d61 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:21.289692 11066 leader_election.cc:290] T 1bf4668eeb70467fb3dc5a0289233b3c P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 12 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
W20260709 13:20:21.302047  6696 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:21.305600 10708 leader_election.cc:290] T bb7fa124c3bf4ef9ab65a407cb008441 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
W20260709 13:20:21.310233 11374 log.cc:927] Time spent T d8292e16e5654be6bc408560cf256aaa P b7ab4784c7344b939bc36f639286f377: Append to log took a long time: real 1.221s	user 0.003s	sys 0.011s
I20260709 13:20:21.313009 11369 raft_consensus.cc:515] T a1704639a875409b9959353527b3fd68 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:21.291217 11342 leader_election.cc:290] T e31b9971c15848dea59d4d4130141d9e P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 11 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:21.315871 11189 raft_consensus.cc:3060] T d8cee0accdb8499c86d4414b72565a38 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:20:21.323482  6697 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 76508.8us
I20260709 13:20:21.324615  6873 raft_consensus.cc:1275] T a1704639a875409b9959353527b3fd68 P cd75a17ab2604397adab03bb8b5fd75c [term 13 FOLLOWER]: Refusing update from remote peer b7ab4784c7344b939bc36f639286f377: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
W20260709 13:20:21.329993  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 95297.5us
I20260709 13:20:21.336278  6874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb7fa124c3bf4ef9ab65a407cb008441" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 14 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:21.353108  6727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24ee15416e3145beaa1b8183453729a3" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:20:21.353802  6874 raft_consensus.cc:2410] T bb7fa124c3bf4ef9ab65a407cb008441 P cd75a17ab2604397adab03bb8b5fd75c [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7ab4784c7344b939bc36f639286f377 for term 14 because replica has last-logged OpId of term: 12 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 9.
I20260709 13:20:21.339689  6877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4db81d9d329422bb3b4160ca4ac2d1d" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:20:21.354262  6872 raft_consensus.cc:2468] T f5be3a11b23d4ea9b08300a2789821c7 P cd75a17ab2604397adab03bb8b5fd75c [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 11.
I20260709 13:20:21.354732  6877 raft_consensus.cc:3060] T c4db81d9d329422bb3b4160ca4ac2d1d P cd75a17ab2604397adab03bb8b5fd75c [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:20:21.341361  6878 raft_consensus.cc:1275] T 34f36d59d88f40fe8a2805e604fc6c0a P cd75a17ab2604397adab03bb8b5fd75c [term 9 FOLLOWER]: Refusing update from remote peer b7ab4784c7344b939bc36f639286f377: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:20:21.353821  6727 raft_consensus.cc:3060] T 24ee15416e3145beaa1b8183453729a3 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:21.337941  6772 leader_election.cc:304] T 7ba5dac66ab5497e9e336f2a3c28cda5 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb
I20260709 13:20:21.357741  6844 leader_election.cc:304] T bb7fa124c3bf4ef9ab65a407cb008441 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, b7ab4784c7344b939bc36f639286f377
I20260709 13:20:21.328791  6875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f03d0dbf16864ca4bc1bb5e4c0334c0f" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:20:21.357757  6772 leader_election.cc:304] T 9e326172347f45e99a0d482b5d8ef768 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:20:21.359364  6875 raft_consensus.cc:2393] T f03d0dbf16864ca4bc1bb5e4c0334c0f P cd75a17ab2604397adab03bb8b5fd75c [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate b7ab4784c7344b939bc36f639286f377 in current term 11: Already voted for candidate cd75a17ab2604397adab03bb8b5fd75c in this term.
I20260709 13:20:21.313712 11010 leader_election.cc:290] T f09c2a98de1a4decabd0ff900dd44caa P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:21.258103 11415 raft_consensus.cc:515] T 9b3759de40694069b13c0f8bd40e5709 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:21.364261  6772 leader_election.cc:304] T 4f00a2e87e56452083b759f60d461ee3 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:20:21.370358  6880 raft_consensus.cc:1275] T 3a485a995abc4807b6e511e45419f737 P cd75a17ab2604397adab03bb8b5fd75c [term 12 FOLLOWER]: Refusing update from remote peer b7ab4784c7344b939bc36f639286f377: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:20:21.336727 11386 raft_consensus.cc:3060] T 34f36d59d88f40fe8a2805e604fc6c0a P ccd8a4c3bfe3413cb2ae219b09aea832 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:20:21.374424  6772 leader_election.cc:304] T f09c2a98de1a4decabd0ff900dd44caa P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:20:21.292490 11326 raft_consensus.cc:515] T 2c240553ce044eedb41541d72b9475d7 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:21.376731 10989 leader_election.cc:290] T 44bde925b2e541b69890d70715b85176 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:21.390703  6772 leader_election.cc:304] T ab432e62819d499eaaf3dd55481dd930 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:20:21.347012 11362 raft_consensus.cc:2804] T 4b8cacb381b746da8d0049b0a83b41dd P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:20:21.379136 11418 raft_consensus.cc:2804] T 4f00a2e87e56452083b759f60d461ee3 P b7ab4784c7344b939bc36f639286f377 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:20:21.339285 10727 raft_consensus.cc:3060] T 90d42e216d9741e190bca19a781291fd P ccd8a4c3bfe3413cb2ae219b09aea832 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:20:21.367022 10708 raft_consensus.cc:2749] T 9e326172347f45e99a0d482b5d8ef768 P b7ab4784c7344b939bc36f639286f377 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:20:21.366567 11312 raft_consensus.cc:2749] T bb7fa124c3bf4ef9ab65a407cb008441 P cd75a17ab2604397adab03bb8b5fd75c [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:20:21.381979 11369 leader_election.cc:290] T a1704639a875409b9959353527b3fd68 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 14 election: Requested vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:21.382207 11010 consensus_queue.cc:1048] T c4db81d9d329422bb3b4160ca4ac2d1d P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:20:21.378224  6844 leader_election.cc:304] T 90d42e216d9741e190bca19a781291fd P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
W20260709 13:20:21.360325 11393 consensus_meta.cc:287] T 07a92dd554674067a83a9cb68c4773f2 P ccd8a4c3bfe3413cb2ae219b09aea832: Time spent flushing consensus metadata: real 0.518s	user 0.007s	sys 0.004s
I20260709 13:20:21.397118 11342 raft_consensus.cc:2749] T f09c2a98de1a4decabd0ff900dd44caa P b7ab4784c7344b939bc36f639286f377 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:20:21.435421  6799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce4f062dcd314d43a63ca74067cb5ee3" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:21.398815 11288 raft_consensus.cc:515] T 3411566abe2d4c9bb4b2adfdd05e6f17 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
W20260709 13:20:21.400884 11394 consensus_meta.cc:287] T 853ac0a8cbd64ce99457f170216d4d0f P ccd8a4c3bfe3413cb2ae219b09aea832: Time spent flushing consensus metadata: real 0.551s	user 0.008s	sys 0.003s
I20260709 13:20:21.402665 11326 leader_election.cc:290] T 2c240553ce044eedb41541d72b9475d7 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 14 election: Requested vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:21.404170 11417 consensus_queue.cc:1048] T ce4f062dcd314d43a63ca74067cb5ee3 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:20:21.404949 11345 raft_consensus.cc:2749] T ab432e62819d499eaaf3dd55481dd930 P b7ab4784c7344b939bc36f639286f377 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:20:21.406376 11363 consensus_queue.cc:1048] T 2c240553ce044eedb41541d72b9475d7 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:20:21.395854 11416 consensus_queue.cc:1048] T 7c44c4849aa54f2b94d1f1bef9ed546f P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.013s
I20260709 13:20:21.409006 10989 consensus_queue.cc:1048] T 90d42e216d9741e190bca19a781291fd P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:20:21.337587 11413 consensus_queue.cc:1048] T 44bde925b2e541b69890d70715b85176 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.075s
I20260709 13:20:21.367983 11061 raft_consensus.cc:2804] T 7ba5dac66ab5497e9e336f2a3c28cda5 P b7ab4784c7344b939bc36f639286f377 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:20:21.413777 11362 raft_consensus.cc:493] T 4b8cacb381b746da8d0049b0a83b41dd P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 13 FOLLOWER]: Starting leader election (detected failure of leader cd75a17ab2604397adab03bb8b5fd75c)
I20260709 13:20:21.455714 11362 raft_consensus.cc:3060] T 4b8cacb381b746da8d0049b0a83b41dd P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:21.445897 11394 raft_consensus.cc:515] T 853ac0a8cbd64ce99457f170216d4d0f P ccd8a4c3bfe3413cb2ae219b09aea832 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:21.452868 11061 raft_consensus.cc:493] T 7ba5dac66ab5497e9e336f2a3c28cda5 P b7ab4784c7344b939bc36f639286f377 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 7ba59cc884714e8aa5f3f0ecaed84cbb)
I20260709 13:20:21.457878 11061 raft_consensus.cc:3060] T 7ba5dac66ab5497e9e336f2a3c28cda5 P b7ab4784c7344b939bc36f639286f377 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:21.458719 11394 leader_election.cc:290] T 853ac0a8cbd64ce99457f170216d4d0f P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 10 election: Requested vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:21.444233 11252 raft_consensus.cc:493] T f58dc08b12a2494bb9a1372837970ca2 P b7ab4784c7344b939bc36f639286f377 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:20:21.419523 11406 log.cc:927] Time spent T 427c124d773f483294511e80fe340075 P b7ab4784c7344b939bc36f639286f377: Append to log took a long time: real 0.314s	user 0.000s	sys 0.001s
I20260709 13:20:21.446074 11066 raft_consensus.cc:2749] T 90d42e216d9741e190bca19a781291fd P cd75a17ab2604397adab03bb8b5fd75c [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:20:21.459450 11252 raft_consensus.cc:515] T f58dc08b12a2494bb9a1372837970ca2 P b7ab4784c7344b939bc36f639286f377 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
W20260709 13:20:21.459821  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 81715.1us
I20260709 13:20:21.425782 11124 leader_election.cc:290] T f4b8bd455d5a47c18a1380839c6e0d61 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 12 election: Requested vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:21.427793  6805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3022224cc81473690653a83d4e99470" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:21.427923  6806 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3d65025eea89441290d85dd053810e31"
dest_uuid: "b7ab4784c7344b939bc36f639286f377"
mode: GRACEFUL
new_leader_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
 from {username='slave'} at 127.0.0.1:38240
I20260709 13:20:21.461560 11288 leader_election.cc:290] T 3411566abe2d4c9bb4b2adfdd05e6f17 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 11 election: Requested vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:21.462162  6806 raft_consensus.cc:606] T 3d65025eea89441290d85dd053810e31 P b7ab4784c7344b939bc36f639286f377 [term 11 LEADER]: Received request to transfer leadership to TS cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:20:21.461601 11066 consensus_queue.cc:1048] T 853ac0a8cbd64ce99457f170216d4d0f P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:20:21.463450  6806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de3186201e1a40d0b335eeb8b4e256e0" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
W20260709 13:20:21.398185 11347 consensus_meta.cc:287] T 17587d6730594da4a56fa13a353232a1 P b7ab4784c7344b939bc36f639286f377: Time spent flushing consensus metadata: real 0.869s	user 0.011s	sys 0.001s
I20260709 13:20:21.464498 11347 raft_consensus.cc:2749] T 17587d6730594da4a56fa13a353232a1 P b7ab4784c7344b939bc36f639286f377 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:20:21.438798  6798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f03d0dbf16864ca4bc1bb5e4c0334c0f" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:20:21.466578  6798 raft_consensus.cc:3060] T f03d0dbf16864ca4bc1bb5e4c0334c0f P b7ab4784c7344b939bc36f639286f377 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:20:21.440985  6801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1528ab62b6fe4e3099d08f141afee116" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:21.469444  6801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4b8bd455d5a47c18a1380839c6e0d61" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:20:21.473623  6803 raft_consensus.cc:1240] T c4db81d9d329422bb3b4160ca4ac2d1d P b7ab4784c7344b939bc36f639286f377 [term 12 FOLLOWER]: Rejecting Update request from peer ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 11. Current term is 12. Ops: [11.7-11.7]
I20260709 13:20:21.474447 11289 raft_consensus.cc:493] T a3022224cc81473690653a83d4e99470 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 13 FOLLOWER]: Starting leader election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:20:21.475051 11289 raft_consensus.cc:3060] T a3022224cc81473690653a83d4e99470 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:21.475262  6803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30e88460611e47b2ba16a46a30b5f416" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:20:21.477443 11252 leader_election.cc:290] T f58dc08b12a2494bb9a1372837970ca2 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:21.479771 11415 leader_election.cc:290] T 9b3759de40694069b13c0f8bd40e5709 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:21.480471  6878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b8cacb381b746da8d0049b0a83b41dd" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:21.483352  6803 raft_consensus.cc:3060] T 30e88460611e47b2ba16a46a30b5f416 P b7ab4784c7344b939bc36f639286f377 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:20:21.484757  6872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce4f062dcd314d43a63ca74067cb5ee3" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:21.485498  6872 raft_consensus.cc:2468] T ce4f062dcd314d43a63ca74067cb5ee3 P cd75a17ab2604397adab03bb8b5fd75c [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 12.
I20260709 13:20:21.451519 11117 raft_consensus.cc:515] T 427c124d773f483294511e80fe340075 P b7ab4784c7344b939bc36f639286f377 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } attrs { replace: true } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:20:21.488423 11312 consensus_queue.cc:1048] T f09c2a98de1a4decabd0ff900dd44caa P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:20:21.488849  6878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de3186201e1a40d0b335eeb8b4e256e0" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:20:21.490538 11312 consensus_queue.cc:1048] T d8cee0accdb8499c86d4414b72565a38 P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:20:21.442709  6799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c240553ce044eedb41541d72b9475d7" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:20:21.494688  6799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3411566abe2d4c9bb4b2adfdd05e6f17" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:20:21.495358  6799 raft_consensus.cc:3060] T 3411566abe2d4c9bb4b2adfdd05e6f17 P b7ab4784c7344b939bc36f639286f377 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:20:21.444545  6807 raft_consensus.cc:1240] T f5be3a11b23d4ea9b08300a2789821c7 P b7ab4784c7344b939bc36f639286f377 [term 11 FOLLOWER]: Rejecting Update request from peer ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 10. Current term is 11. Ops: []
I20260709 13:20:21.497006  6807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1704639a875409b9959353527b3fd68" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:20:21.498149  6807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b3759de40694069b13c0f8bd40e5709" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:21.499174  6807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "853ac0a8cbd64ce99457f170216d4d0f" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:20:21.499687  6807 raft_consensus.cc:3060] T 853ac0a8cbd64ce99457f170216d4d0f P b7ab4784c7344b939bc36f639286f377 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:20:21.431162 11418 raft_consensus.cc:493] T 4f00a2e87e56452083b759f60d461ee3 P b7ab4784c7344b939bc36f639286f377 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 7ba59cc884714e8aa5f3f0ecaed84cbb)
I20260709 13:20:21.500313 11418 raft_consensus.cc:3060] T 4f00a2e87e56452083b759f60d461ee3 P b7ab4784c7344b939bc36f639286f377 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:20:21.438205 11167 consensus_meta.cc:287] T 24ee15416e3145beaa1b8183453729a3 P cd75a17ab2604397adab03bb8b5fd75c: Time spent flushing consensus metadata: real 0.940s	user 0.015s	sys 0.000s
I20260709 13:20:21.502038  6872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f03d0dbf16864ca4bc1bb5e4c0334c0f" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:20:21.502635  6872 raft_consensus.cc:3060] T f03d0dbf16864ca4bc1bb5e4c0334c0f P cd75a17ab2604397adab03bb8b5fd75c [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:20:21.443425 11315 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.035s	user 0.018s	sys 0.049s
W20260709 13:20:21.504545 11315 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.096s	user 0.018s	sys 0.049s
I20260709 13:20:21.505671  6877 raft_consensus.cc:2468] T c4db81d9d329422bb3b4160ca4ac2d1d P cd75a17ab2604397adab03bb8b5fd75c [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 12.
I20260709 13:20:21.414631  6727 raft_consensus.cc:2468] T 24ee15416e3145beaa1b8183453729a3 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in term 14.
I20260709 13:20:21.455466 10700 consensus_queue.cc:1048] T 44bde925b2e541b69890d70715b85176 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
W20260709 13:20:21.417090 11408 log.cc:927] Time spent T 3fa34c08b205435dba97346991aa1f92 P ccd8a4c3bfe3413cb2ae219b09aea832: Append to log took a long time: real 0.364s	user 0.001s	sys 0.001s
I20260709 13:20:21.462736  6805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09c2a98de1a4decabd0ff900dd44caa" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:21.488794 11117 leader_election.cc:290] T 427c124d773f483294511e80fe340075 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 11 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:20:21.508378  6805 raft_consensus.cc:2468] T f09c2a98de1a4decabd0ff900dd44caa P b7ab4784c7344b939bc36f639286f377 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 13.
I20260709 13:20:21.508890 11167 consensus_queue.cc:1048] T de3186201e1a40d0b335eeb8b4e256e0 P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:20:21.509742  6805 raft_consensus.cc:1240] T 20f6842e26174571996b8dea4151d4be P b7ab4784c7344b939bc36f639286f377 [term 14 FOLLOWER]: Rejecting Update request from peer ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 13. Current term is 14. Ops: []
I20260709 13:20:21.464028  6806 raft_consensus.cc:3060] T de3186201e1a40d0b335eeb8b4e256e0 P b7ab4784c7344b939bc36f639286f377 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:21.373402 11373 raft_consensus.cc:493] T 713b5728a197487c9300b310ab94e5a3 P b7ab4784c7344b939bc36f639286f377 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:20:21.511301  6844 leader_election.cc:304] T 4f00a2e87e56452083b759f60d461ee3 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, b7ab4784c7344b939bc36f639286f377
I20260709 13:20:21.511582 11373 raft_consensus.cc:515] T 713b5728a197487c9300b310ab94e5a3 P b7ab4784c7344b939bc36f639286f377 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:21.512293 11167 raft_consensus.cc:2749] T 4f00a2e87e56452083b759f60d461ee3 P cd75a17ab2604397adab03bb8b5fd75c [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:20:21.514071 11373 leader_election.cc:290] T 713b5728a197487c9300b310ab94e5a3 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
W20260709 13:20:21.514799 11395 log.cc:927] Time spent T f5be3a11b23d4ea9b08300a2789821c7 P ccd8a4c3bfe3413cb2ae219b09aea832: Append to log took a long time: real 1.092s	user 0.009s	sys 0.023s
I20260709 13:20:21.515133 11371 raft_consensus.cc:515] T bb3d8792045a4583ae2e965b1350a5b4 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
W20260709 13:20:21.516237 11405 log.cc:927] Time spent T 07a92dd554674067a83a9cb68c4773f2 P b7ab4784c7344b939bc36f639286f377: Append to log took a long time: real 0.454s	user 0.000s	sys 0.004s
I20260709 13:20:21.516340  6729 raft_consensus.cc:1240] T bb3d8792045a4583ae2e965b1350a5b4 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 11 FOLLOWER]: Rejecting Update request from peer 7ba59cc884714e8aa5f3f0ecaed84cbb for earlier term 10. Current term is 11. Ops: []
I20260709 13:20:21.520093 11071 consensus_queue.cc:1048] T 427c124d773f483294511e80fe340075 P 7ba59cc884714e8aa5f3f0ecaed84cbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:20:21.521477 11071 consensus_queue.cc:1048] T 3fa34c08b205435dba97346991aa1f92 P 7ba59cc884714e8aa5f3f0ecaed84cbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.000s
W20260709 13:20:21.524385  7467 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:21.529354 11410 log.cc:927] Time spent T a3022224cc81473690653a83d4e99470 P ccd8a4c3bfe3413cb2ae219b09aea832: Append to log took a long time: real 0.468s	user 0.002s	sys 0.000s
I20260709 13:20:21.533016  6725 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50004 (request call id 2156) took 1085 ms. Trace:
I20260709 13:20:21.534513  6724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4db81d9d329422bb3b4160ca4ac2d1d" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:20:21.533483  6725 rpcz_store.cc:276] 0709 13:20:20.447222 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:20.451387 (+  4165us) service_pool.cc:224] Handling call
0709 13:20:20.451839 (+   452us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:20.452302 (+   463us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:20.452333 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:20:20.453276 (+   943us) log.cc:844] Serialized 26 byte log entry
0709 13:20:20.748669 (+295393us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:20:20.748737 (+    68us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:20.748853 (+   116us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:21.528733 (+779880us) spinlock_profiling.cc:243] Waited 54.5 ms on lock 0x7b4400022b4c. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0c745db1 00007fcc0c7e3c85 00007fcc0c7e46a2 00007fcc0f5561db 00007fcc0f551aaf 00007fcc0f54586e 00007fcc0f544bb6 00007fcc0f5447d8 00007fcc0f54e221 00007fcc0f54e1d9 00007fcc0f54e169
0709 13:20:21.532712 (+  3979us) raft_consensus.cc:1685] finished
0709 13:20:21.532734 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:21.532944 (+   210us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":7358,"raft.run_cpu_time_us":134,"raft.run_wall_time_us":2827,"spinlock_wait_cycles":125275392,"thread_start_us":294876,"threads_started":1,"wal-append.queue_time_us":513250}
W20260709 13:20:21.535135  6695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 43623.4us
I20260709 13:20:21.535558  6729 raft_consensus.cc:1240] T a1704639a875409b9959353527b3fd68 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 14 FOLLOWER]: Rejecting Update request from peer b7ab4784c7344b939bc36f639286f377 for earlier term 13. Current term is 14. Ops: []
I20260709 13:20:21.535807 11124 consensus_queue.cc:1059] T c4db81d9d329422bb3b4160ca4ac2d1d P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:20:21.539707  6725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c37d41cd9164c15a6826ca62a851a69" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:20:21.544507  6806 raft_consensus.cc:2468] T de3186201e1a40d0b335eeb8b4e256e0 P b7ab4784c7344b939bc36f639286f377 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 14.
I20260709 13:20:21.544945  6727 raft_consensus.cc:1275] T 3a485a995abc4807b6e511e45419f737 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 12 FOLLOWER]: Refusing update from remote peer b7ab4784c7344b939bc36f639286f377: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:20:21.428944 11403 raft_consensus.cc:515] T 1bf4668eeb70467fb3dc5a0289233b3c P b7ab4784c7344b939bc36f639286f377 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:21.545383  6803 raft_consensus.cc:2468] T 30e88460611e47b2ba16a46a30b5f416 P b7ab4784c7344b939bc36f639286f377 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 11.
I20260709 13:20:21.550784  6873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30e88460611e47b2ba16a46a30b5f416" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:20:21.560695  6873 raft_consensus.cc:3060] T 30e88460611e47b2ba16a46a30b5f416 P cd75a17ab2604397adab03bb8b5fd75c [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:20:21.561444  6725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e31b9971c15848dea59d4d4130141d9e" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:20:21.552572  6875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09c2a98de1a4decabd0ff900dd44caa" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:21.562077  6725 raft_consensus.cc:3060] T e31b9971c15848dea59d4d4130141d9e P ccd8a4c3bfe3413cb2ae219b09aea832 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:20:21.562954  6875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3411566abe2d4c9bb4b2adfdd05e6f17" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:20:21.553864  6877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1704639a875409b9959353527b3fd68" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:20:21.564467  6877 raft_consensus.cc:3060] T a1704639a875409b9959353527b3fd68 P cd75a17ab2604397adab03bb8b5fd75c [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:21.559993  6724 raft_consensus.cc:1240] T 853ac0a8cbd64ce99457f170216d4d0f P ccd8a4c3bfe3413cb2ae219b09aea832 [term 10 FOLLOWER]: Rejecting Update request from peer cd75a17ab2604397adab03bb8b5fd75c for earlier term 9. Current term is 10. Ops: []
I20260709 13:20:21.563776  6875 raft_consensus.cc:3060] T 3411566abe2d4c9bb4b2adfdd05e6f17 P cd75a17ab2604397adab03bb8b5fd75c [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:20:21.572427  6874 raft_consensus.cc:1240] T f5be3a11b23d4ea9b08300a2789821c7 P cd75a17ab2604397adab03bb8b5fd75c [term 11 FOLLOWER]: Rejecting Update request from peer ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 10. Current term is 11. Ops: [8.5-10.6]
I20260709 13:20:21.573730  6874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4b8bd455d5a47c18a1380839c6e0d61" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:20:21.590478  6724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3022224cc81473690653a83d4e99470" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:21.590893  6731 raft_consensus.cc:1275] T 90d42e216d9741e190bca19a781291fd P ccd8a4c3bfe3413cb2ae219b09aea832 [term 12 FOLLOWER]: Refusing update from remote peer b7ab4784c7344b939bc36f639286f377: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 7. (term mismatch)
I20260709 13:20:21.591413  6731 pending_rounds.cc:85] T 90d42e216d9741e190bca19a781291fd P ccd8a4c3bfe3413cb2ae219b09aea832: Aborting all ops after (but not including) 6
I20260709 13:20:21.591741  6731 pending_rounds.cc:107] T 90d42e216d9741e190bca19a781291fd P ccd8a4c3bfe3413cb2ae219b09aea832: Aborting uncommitted NO_OP operation due to leader change: 11.7
I20260709 13:20:21.592056  6731 raft_consensus.cc:2889] T 90d42e216d9741e190bca19a781291fd P ccd8a4c3bfe3413cb2ae219b09aea832 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:20:21.574885  6729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b56bf91d90824c959e21e0cee5ba1816" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:20:21.596541  6723 raft_consensus.cc:1275] T 9b3759de40694069b13c0f8bd40e5709 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 11 FOLLOWER]: Refusing update from remote peer b7ab4784c7344b939bc36f639286f377: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:20:21.597990  6878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c240553ce044eedb41541d72b9475d7" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:20:21.598770  6878 raft_consensus.cc:3060] T 2c240553ce044eedb41541d72b9475d7 P cd75a17ab2604397adab03bb8b5fd75c [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:21.600937  6728 raft_consensus.cc:1275] T 07a92dd554674067a83a9cb68c4773f2 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 12 FOLLOWER]: Refusing update from remote peer b7ab4784c7344b939bc36f639286f377: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
W20260709 13:20:21.601851  6844 connection.cc:256] RPC call timeout handler was delayed by -1.5717520109999441s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1781s for a response
W20260709 13:20:21.602525  6844 connection.cc:256] RPC call timeout handler was delayed by -1.4880520110000361s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1874s for a response
W20260709 13:20:21.602988  6844 connection.cc:256] RPC call timeout handler was delayed by -1.42235201099993s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1947s for a response
W20260709 13:20:21.603381  6844 connection.cc:256] RPC call timeout handler was delayed by -1.1343520110001464s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2267s for a response
I20260709 13:20:21.603410  6724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44bde925b2e541b69890d70715b85176" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
W20260709 13:20:21.603883  6844 connection.cc:256] RPC call timeout handler was delayed by -1.0902520110000751s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2316s for a response
I20260709 13:20:21.605583  6844 leader_election.cc:304] T dbdf895bba214ff68685a24fd17dfb5d P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377
I20260709 13:20:21.614202  6803 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4275cf08e63345f993bce8664eada830"
dest_uuid: "b7ab4784c7344b939bc36f639286f377"
mode: GRACEFUL
new_leader_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
 from {username='slave'} at 127.0.0.1:38240
I20260709 13:20:21.614988  6803 raft_consensus.cc:606] T 4275cf08e63345f993bce8664eada830 P b7ab4784c7344b939bc36f639286f377 [term 12 FOLLOWER]: Received request to transfer leadership to TS cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:20:21.615383  6803 raft_consensus.cc:614] T 4275cf08e63345f993bce8664eada830 P b7ab4784c7344b939bc36f639286f377 [term 12 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:20:21.534108 11061 raft_consensus.cc:515] T 7ba5dac66ab5497e9e336f2a3c28cda5 P b7ab4784c7344b939bc36f639286f377 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:20:21.559588 11415 raft_consensus.cc:493] T 95a75bfe094d4bdc963aba3f08dfcd25 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:21.622241  6844 leader_election.cc:304] T 9b3759de40694069b13c0f8bd40e5709 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
W20260709 13:20:21.620256  6772 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 226116us
I20260709 13:20:21.572680 11373 raft_consensus.cc:493] T e77e330a82df4b43a745d57a68f6f057 P b7ab4784c7344b939bc36f639286f377 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:20:21.572897 11167 raft_consensus.cc:493] T 713b5728a197487c9300b310ab94e5a3 P cd75a17ab2604397adab03bb8b5fd75c [term 12 FOLLOWER]: Starting pre-election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
W20260709 13:20:21.622117 11390 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.585s	user 0.001s	sys 0.034s
I20260709 13:20:21.643069  6723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f03d0dbf16864ca4bc1bb5e4c0334c0f" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:20:21.628808  6874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "853ac0a8cbd64ce99457f170216d4d0f" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
W20260709 13:20:21.633577  6695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 88278.7us
I20260709 13:20:21.645275  6723 raft_consensus.cc:2368] T f03d0dbf16864ca4bc1bb5e4c0334c0f P ccd8a4c3bfe3413cb2ae219b09aea832 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate b7ab4784c7344b939bc36f639286f377 for earlier term 11. Current term is 12.
I20260709 13:20:21.632088 11315 raft_consensus.cc:2804] T dbdf895bba214ff68685a24fd17dfb5d P cd75a17ab2604397adab03bb8b5fd75c [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:20:21.629384  6772 leader_election.cc:304] T 20f6842e26174571996b8dea4151d4be P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:20:21.650689  6878 raft_consensus.cc:2468] T 2c240553ce044eedb41541d72b9475d7 P cd75a17ab2604397adab03bb8b5fd75c [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 14.
I20260709 13:20:21.675901  6695 leader_election.cc:304] T f09c2a98de1a4decabd0ff900dd44caa P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
W20260709 13:20:21.660262  7466 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 321653us
I20260709 13:20:21.623813 11339 raft_consensus.cc:3055] T be1a92657f494cac8dd227d152f50151 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:20:21.572785 11354 raft_consensus.cc:515] T f4b8bd455d5a47c18a1380839c6e0d61 P b7ab4784c7344b939bc36f639286f377 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:21.698912  6798 raft_consensus.cc:2468] T f03d0dbf16864ca4bc1bb5e4c0334c0f P b7ab4784c7344b939bc36f639286f377 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 12.
I20260709 13:20:21.682194  6695 leader_election.cc:304] T de3186201e1a40d0b335eeb8b4e256e0 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
I20260709 13:20:21.692288  6878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3d8792045a4583ae2e965b1350a5b4" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:20:21.633813 11415 raft_consensus.cc:515] T 95a75bfe094d4bdc963aba3f08dfcd25 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
W20260709 13:20:21.643227 11390 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.631s	user 0.001s	sys 0.035s
W20260709 13:20:21.695847  6772 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 66549.6us
I20260709 13:20:21.701526  6807 raft_consensus.cc:2468] T 853ac0a8cbd64ce99457f170216d4d0f P b7ab4784c7344b939bc36f639286f377 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 10.
I20260709 13:20:21.703971  6875 raft_consensus.cc:2468] T 3411566abe2d4c9bb4b2adfdd05e6f17 P cd75a17ab2604397adab03bb8b5fd75c [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 11.
I20260709 13:20:21.721321 11363 raft_consensus.cc:2749] T 20f6842e26174571996b8dea4151d4be P b7ab4784c7344b939bc36f639286f377 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:20:21.667411  6799 raft_consensus.cc:2468] T 3411566abe2d4c9bb4b2adfdd05e6f17 P b7ab4784c7344b939bc36f639286f377 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 11.
I20260709 13:20:21.713483  6874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b3759de40694069b13c0f8bd40e5709" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:21.713582  6723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34f36d59d88f40fe8a2805e604fc6c0a" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:21.614804 11386 raft_consensus.cc:515] T 34f36d59d88f40fe8a2805e604fc6c0a P ccd8a4c3bfe3413cb2ae219b09aea832 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
W20260709 13:20:21.716518  6847 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:21.680933  6873 raft_consensus.cc:2468] T 30e88460611e47b2ba16a46a30b5f416 P cd75a17ab2604397adab03bb8b5fd75c [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 11.
I20260709 13:20:21.713127  7466 leader_election.cc:304] T 24ee15416e3145beaa1b8183453729a3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
I20260709 13:20:21.678851 11373 raft_consensus.cc:515] T e77e330a82df4b43a745d57a68f6f057 P b7ab4784c7344b939bc36f639286f377 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } }
I20260709 13:20:21.673940 11315 raft_consensus.cc:493] T dbdf895bba214ff68685a24fd17dfb5d P cd75a17ab2604397adab03bb8b5fd75c [term 10 FOLLOWER]: Starting leader election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:20:21.682621 11288 raft_consensus.cc:2804] T f09c2a98de1a4decabd0ff900dd44caa P ccd8a4c3bfe3413cb2ae219b09aea832 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:20:21.726200  6803 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7a734b5ab7834e05a8c422208acc58b1"
dest_uuid: "b7ab4784c7344b939bc36f639286f377"
mode: GRACEFUL
new_leader_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
 from {username='slave'} at 127.0.0.1:38240
I20260709 13:20:21.778019  6803 raft_consensus.cc:606] T 7a734b5ab7834e05a8c422208acc58b1 P b7ab4784c7344b939bc36f639286f377 [term 13 LEADER]: Received request to transfer leadership to TS cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:20:21.779738  6803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34f36d59d88f40fe8a2805e604fc6c0a" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:21.781502  6803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3022224cc81473690653a83d4e99470" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:21.783057  6803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4275cf08e63345f993bce8664eada830" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 13 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:21.724763  6725 raft_consensus.cc:2468] T e31b9971c15848dea59d4d4130141d9e P ccd8a4c3bfe3413cb2ae219b09aea832 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 11.
I20260709 13:20:21.784940  6725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fa34c08b205435dba97346991aa1f92" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 15 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:21.735230  6801 raft_consensus.cc:2393] T f4b8bd455d5a47c18a1380839c6e0d61 P b7ab4784c7344b939bc36f639286f377 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate ccd8a4c3bfe3413cb2ae219b09aea832 in current term 12: Already voted for candidate b7ab4784c7344b939bc36f639286f377 in this term.
I20260709 13:20:21.691574 11339 raft_consensus.cc:740] T be1a92657f494cac8dd227d152f50151 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 7ba59cc884714e8aa5f3f0ecaed84cbb, State: Running, Role: LEADER
I20260709 13:20:21.642957 11118 consensus_queue.cc:1048] T 9b3759de40694069b13c0f8bd40e5709 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.079s
I20260709 13:20:21.698681 11371 leader_election.cc:290] T bb3d8792045a4583ae2e965b1350a5b4 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 11 election: Requested vote from peers cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:20:21.746188  6878 raft_consensus.cc:3060] T bb3d8792045a4583ae2e965b1350a5b4 P cd75a17ab2604397adab03bb8b5fd75c [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:20:21.787256  6805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e326172347f45e99a0d482b5d8ef768" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:21.653972  6877 raft_consensus.cc:2468] T a1704639a875409b9959353527b3fd68 P cd75a17ab2604397adab03bb8b5fd75c [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 14.
I20260709 13:20:21.675005 11124 consensus_queue.cc:1059] T f5be3a11b23d4ea9b08300a2789821c7 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.057s
I20260709 13:20:21.699800 11416 consensus_queue.cc:1059] T 20f6842e26174571996b8dea4151d4be P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.045s
W20260709 13:20:21.752712  6695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 70626.2us
I20260709 13:20:21.753358  6875 raft_consensus.cc:1240] T bd6869f07b5a4885a0b99fbe60c3b175 P cd75a17ab2604397adab03bb8b5fd75c [term 13 FOLLOWER]: Rejecting Update request from peer ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 12. Current term is 13. Ops: []
I20260709 13:20:21.675969  6872 raft_consensus.cc:2468] T f03d0dbf16864ca4bc1bb5e4c0334c0f P cd75a17ab2604397adab03bb8b5fd75c [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 12.
I20260709 13:20:21.725648 11403 leader_election.cc:290] T 1bf4668eeb70467fb3dc5a0289233b3c P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 13 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:21.681037 11167 raft_consensus.cc:515] T 713b5728a197487c9300b310ab94e5a3 P cd75a17ab2604397adab03bb8b5fd75c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:21.733615 11010 raft_consensus.cc:493] T d8292e16e5654be6bc408560cf256aaa P ccd8a4c3bfe3413cb2ae219b09aea832 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:21.802256  6695 leader_election.cc:304] T 30e88460611e47b2ba16a46a30b5f416 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
I20260709 13:20:21.728622 11066 raft_consensus.cc:2749] T 9b3759de40694069b13c0f8bd40e5709 P cd75a17ab2604397adab03bb8b5fd75c [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:20:21.761612  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 139496us
W20260709 13:20:21.759770  7468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 241218us
W20260709 13:20:21.764994  7466 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 51955.2us
I20260709 13:20:21.819092  6844 leader_election.cc:304] T 711ef6523deb4cbe8ef2ba61e1c21c98 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377
I20260709 13:20:21.765869  6772 leader_election.cc:304] T f5be3a11b23d4ea9b08300a2789821c7 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:20:21.764292  6873 raft_consensus.cc:1240] T c4db81d9d329422bb3b4160ca4ac2d1d P cd75a17ab2604397adab03bb8b5fd75c [term 12 FOLLOWER]: Rejecting Update request from peer ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 11. Current term is 12. Ops: [11.7-11.7]
I20260709 13:20:21.769446  6800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44bde925b2e541b69890d70715b85176" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:21.821082  6800 raft_consensus.cc:2410] T 44bde925b2e541b69890d70715b85176 P b7ab4784c7344b939bc36f639286f377 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c for term 13 because replica has last-logged OpId of term: 12 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 7.
I20260709 13:20:21.770414  6799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b56bf91d90824c959e21e0cee5ba1816" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:20:21.768450  6798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a92dd554674067a83a9cb68c4773f2" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:21.822160  6798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "427c124d773f483294511e80fe340075" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:21.740566 11326 raft_consensus.cc:493] T f3f9c2e2bf644115957398fe4c9459db P ccd8a4c3bfe3413cb2ae219b09aea832 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:20:21.788905  6807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c37d41cd9164c15a6826ca62a851a69" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:20:21.823122  6798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6869f07b5a4885a0b99fbe60c3b175" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:20:21.824055  6807 raft_consensus.cc:2410] T 7c37d41cd9164c15a6826ca62a851a69 P b7ab4784c7344b939bc36f639286f377 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c for term 12 because replica has last-logged OpId of term: 11 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 7.
I20260709 13:20:21.824993  6807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5be3a11b23d4ea9b08300a2789821c7" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 11 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:21.825693  6807 raft_consensus.cc:2393] T f5be3a11b23d4ea9b08300a2789821c7 P b7ab4784c7344b939bc36f639286f377 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c in current term 11: Already voted for candidate b7ab4784c7344b939bc36f639286f377 in this term.
I20260709 13:20:21.826459  6807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c44c4849aa54f2b94d1f1bef9ed546f" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:21.827216  6807 raft_consensus.cc:2410] T 7c44c4849aa54f2b94d1f1bef9ed546f P b7ab4784c7344b939bc36f639286f377 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c for term 15 because replica has last-logged OpId of term: 14 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 9.
I20260709 13:20:21.722211 11189 raft_consensus.cc:515] T d8cee0accdb8499c86d4414b72565a38 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:20:21.777741 11071 raft_consensus.cc:2804] T 24ee15416e3145beaa1b8183453729a3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:20:21.761029 11369 raft_consensus.cc:2804] T de3186201e1a40d0b335eeb8b4e256e0 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:20:21.776170 11315 raft_consensus.cc:3060] T dbdf895bba214ff68685a24fd17dfb5d P cd75a17ab2604397adab03bb8b5fd75c [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:20:21.832348  6723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce4f062dcd314d43a63ca74067cb5ee3" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:21.833091 11414 raft_consensus.cc:3055] T f5be3a11b23d4ea9b08300a2789821c7 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:20:21.833552 11414 raft_consensus.cc:740] T f5be3a11b23d4ea9b08300a2789821c7 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
I20260709 13:20:21.833700  6723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "427c124d773f483294511e80fe340075" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:21.834493 11414 consensus_queue.cc:260] T f5be3a11b23d4ea9b08300a2789821c7 P ccd8a4c3bfe3413cb2ae219b09aea832 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:21.834975  6723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bf4668eeb70467fb3dc5a0289233b3c" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:20:21.793431  6805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce4f062dcd314d43a63ca74067cb5ee3" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:21.794411 11061 leader_election.cc:290] T 7ba5dac66ab5497e9e336f2a3c28cda5 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 13 election: Requested vote from peers cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:20:21.794633 11373 leader_election.cc:290] T e77e330a82df4b43a745d57a68f6f057 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931), ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391)
I20260709 13:20:21.794744  6803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bf4668eeb70467fb3dc5a0289233b3c" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:20:21.835773  6723 raft_consensus.cc:2393] T 1bf4668eeb70467fb3dc5a0289233b3c P ccd8a4c3bfe3413cb2ae219b09aea832 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c in current term 12: Already voted for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in this term.
I20260709 13:20:21.837199  6803 raft_consensus.cc:2368] T 1bf4668eeb70467fb3dc5a0289233b3c P b7ab4784c7344b939bc36f639286f377 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c for earlier term 12. Current term is 13.
I20260709 13:20:21.786761 11288 raft_consensus.cc:493] T f09c2a98de1a4decabd0ff900dd44caa P ccd8a4c3bfe3413cb2ae219b09aea832 [term 13 FOLLOWER]: Starting leader election (detected failure of leader cd75a17ab2604397adab03bb8b5fd75c)
I20260709 13:20:21.797646  6726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3d8792045a4583ae2e965b1350a5b4" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:21.802795  6732 raft_consensus.cc:1240] T 34f36d59d88f40fe8a2805e604fc6c0a P ccd8a4c3bfe3413cb2ae219b09aea832 [term 10 FOLLOWER]: Rejecting Update request from peer b7ab4784c7344b939bc36f639286f377 for earlier term 9. Current term is 10. Ops: [9.6-9.6]
I20260709 13:20:21.806277  6878 raft_consensus.cc:2468] T bb3d8792045a4583ae2e965b1350a5b4 P cd75a17ab2604397adab03bb8b5fd75c [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 11.
I20260709 13:20:21.769003 11347 consensus_queue.cc:1059] T a1704639a875409b9959353527b3fd68 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.051s
W20260709 13:20:21.850638  6695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 48472.5us
I20260709 13:20:21.849972  6844 leader_election.cc:304] T 4d9def8b32fd443aa94ab1420b06837b P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377
I20260709 13:20:21.793617 11354 leader_election.cc:290] T f4b8bd455d5a47c18a1380839c6e0d61 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 12 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:21.857043  6726 raft_consensus.cc:2393] T bb3d8792045a4583ae2e965b1350a5b4 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c in current term 11: Already voted for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in this term.
I20260709 13:20:21.835770 11414 raft_consensus.cc:3060] T f5be3a11b23d4ea9b08300a2789821c7 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:20:21.828673 11240 consensus_queue.cc:1059] T bb3d8792045a4583ae2e965b1350a5b4 P 7ba59cc884714e8aa5f3f0ecaed84cbb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:20:21.863837  6803 raft_consensus.cc:1240] T 853ac0a8cbd64ce99457f170216d4d0f P b7ab4784c7344b939bc36f639286f377 [term 10 FOLLOWER]: Rejecting Update request from peer cd75a17ab2604397adab03bb8b5fd75c for earlier term 9. Current term is 10. Ops: [9.6-9.6]
I20260709 13:20:21.863921  6874 raft_consensus.cc:2468] T 9b3759de40694069b13c0f8bd40e5709 P cd75a17ab2604397adab03bb8b5fd75c [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 11.
I20260709 13:20:21.869432  6799 raft_consensus.cc:2468] T b56bf91d90824c959e21e0cee5ba1816 P b7ab4784c7344b939bc36f639286f377 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 12.
I20260709 13:20:21.873108 11071 raft_consensus.cc:697] T 24ee15416e3145beaa1b8183453729a3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 14 LEADER]: Becoming Leader. State: Replica: 7ba59cc884714e8aa5f3f0ecaed84cbb, State: Running, Role: LEADER
I20260709 13:20:21.874595 11071 consensus_queue.cc:237] T 24ee15416e3145beaa1b8183453729a3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:20:21.837873  6798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8292e16e5654be6bc408560cf256aaa" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 17 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:21.838162  6807 raft_consensus.cc:1240] T e31b9971c15848dea59d4d4130141d9e P b7ab4784c7344b939bc36f639286f377 [term 11 FOLLOWER]: Rejecting Update request from peer cd75a17ab2604397adab03bb8b5fd75c for earlier term 10. Current term is 11. Ops: []
I20260709 13:20:21.879889  6726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5be3a11b23d4ea9b08300a2789821c7" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 11 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:21.879791 11339 consensus_queue.cc:260] T be1a92657f494cac8dd227d152f50151 P 7ba59cc884714e8aa5f3f0ecaed84cbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:20:21.850950 11326 raft_consensus.cc:515] T f3f9c2e2bf644115957398fe4c9459db P ccd8a4c3bfe3413cb2ae219b09aea832 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:21.852734 11288 raft_consensus.cc:3060] T f09c2a98de1a4decabd0ff900dd44caa P ccd8a4c3bfe3413cb2ae219b09aea832 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:21.836763 11010 raft_consensus.cc:515] T d8292e16e5654be6bc408560cf256aaa P ccd8a4c3bfe3413cb2ae219b09aea832 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:21.885229 11415 leader_election.cc:290] T 95a75bfe094d4bdc963aba3f08dfcd25 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:21.887609 11316 raft_consensus.cc:2804] T 711ef6523deb4cbe8ef2ba61e1c21c98 P cd75a17ab2604397adab03bb8b5fd75c [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:20:21.861402 11371 raft_consensus.cc:2804] T 30e88460611e47b2ba16a46a30b5f416 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:20:21.888468  6695 leader_election.cc:304] T f03d0dbf16864ca4bc1bb5e4c0334c0f P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
I20260709 13:20:21.860385 11362 raft_consensus.cc:515] T 4b8cacb381b746da8d0049b0a83b41dd P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:20:21.889483  6723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6869f07b5a4885a0b99fbe60c3b175" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:20:21.893729 11289 raft_consensus.cc:515] T a3022224cc81473690653a83d4e99470 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
W20260709 13:20:21.895442  6696 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:21.897982 11312 raft_consensus.cc:2804] T 4d9def8b32fd443aa94ab1420b06837b P cd75a17ab2604397adab03bb8b5fd75c [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:20:21.861209 11418 raft_consensus.cc:515] T 4f00a2e87e56452083b759f60d461ee3 P b7ab4784c7344b939bc36f639286f377 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:20:21.898772  6725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c44c4849aa54f2b94d1f1bef9ed546f" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:21.860700 11369 raft_consensus.cc:697] T de3186201e1a40d0b335eeb8b4e256e0 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 14 LEADER]: Becoming Leader. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
I20260709 13:20:21.899528 11421 raft_consensus.cc:493] T fe20b4b48823486ca3b9c648db6ce8aa P ccd8a4c3bfe3413cb2ae219b09aea832 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 7ba59cc884714e8aa5f3f0ecaed84cbb)
I20260709 13:20:21.791077 11252 consensus_queue.cc:1048] T 3a485a995abc4807b6e511e45419f737 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.062s
I20260709 13:20:21.902441 11167 leader_election.cc:290] T 713b5728a197487c9300b310ab94e5a3 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:20:21.902966 11411 raft_consensus.cc:3055] T 20f6842e26174571996b8dea4151d4be P ccd8a4c3bfe3413cb2ae219b09aea832 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:20:21.903564  6730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8292e16e5654be6bc408560cf256aaa" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 17 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:21.919961 11371 raft_consensus.cc:697] T 30e88460611e47b2ba16a46a30b5f416 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 11 LEADER]: Becoming Leader. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
I20260709 13:20:21.907299  6729 raft_consensus.cc:2468] T b56bf91d90824c959e21e0cee5ba1816 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 12.
I20260709 13:20:21.902994 11386 leader_election.cc:290] T 34f36d59d88f40fe8a2805e604fc6c0a P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 10 election: Requested vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:21.916513  6695 leader_election.cc:304] T 853ac0a8cbd64ce99457f170216d4d0f P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
I20260709 13:20:21.927783 11312 raft_consensus.cc:493] T 4d9def8b32fd443aa94ab1420b06837b P cd75a17ab2604397adab03bb8b5fd75c [term 12 FOLLOWER]: Starting leader election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:20:21.922683  6727 raft_consensus.cc:1275] T d8292e16e5654be6bc408560cf256aaa P ccd8a4c3bfe3413cb2ae219b09aea832 [term 16 FOLLOWER]: Refusing update from remote peer b7ab4784c7344b939bc36f639286f377: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:20:21.924063  6803 raft_consensus.cc:1240] T de3186201e1a40d0b335eeb8b4e256e0 P b7ab4784c7344b939bc36f639286f377 [term 14 FOLLOWER]: Rejecting Update request from peer cd75a17ab2604397adab03bb8b5fd75c for earlier term 13. Current term is 14. Ops: [13.8-13.8]
I20260709 13:20:21.914733 11316 raft_consensus.cc:493] T 711ef6523deb4cbe8ef2ba61e1c21c98 P cd75a17ab2604397adab03bb8b5fd75c [term 13 FOLLOWER]: Starting leader election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:20:21.933542  6725 raft_consensus.cc:1275] T 4b8cacb381b746da8d0049b0a83b41dd P ccd8a4c3bfe3413cb2ae219b09aea832 [term 13 FOLLOWER]: Refusing update from remote peer cd75a17ab2604397adab03bb8b5fd75c: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:20:21.920506 11415 raft_consensus.cc:2804] T f03d0dbf16864ca4bc1bb5e4c0334c0f P ccd8a4c3bfe3413cb2ae219b09aea832 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:20:21.944229  7496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce4f062dcd314d43a63ca74067cb5ee3" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
W20260709 13:20:21.905503  6846 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.68:45071, user_credentials={real_user=slave}} blocked reactor thread for 278932us
I20260709 13:20:21.917436 11423 consensus_queue.cc:1048] T bb3d8792045a4583ae2e965b1350a5b4 P 7ba59cc884714e8aa5f3f0ecaed84cbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:20:21.955557 11421 raft_consensus.cc:515] T fe20b4b48823486ca3b9c648db6ce8aa P ccd8a4c3bfe3413cb2ae219b09aea832 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:20:21.987947 11393 raft_consensus.cc:493] T 3fa34c08b205435dba97346991aa1f92 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 7ba59cc884714e8aa5f3f0ecaed84cbb)
I20260709 13:20:21.988538 11393 raft_consensus.cc:515] T 3fa34c08b205435dba97346991aa1f92 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:20:21.989491 11421 leader_election.cc:290] T fe20b4b48823486ca3b9c648db6ce8aa P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:20:21.968413  7500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1528ab62b6fe4e3099d08f141afee116" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:20:21.990541 11393 leader_election.cc:290] T 3fa34c08b205435dba97346991aa1f92 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:20:21.990801 11316 raft_consensus.cc:3060] T 711ef6523deb4cbe8ef2ba61e1c21c98 P cd75a17ab2604397adab03bb8b5fd75c [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:21.991755  6803 raft_consensus.cc:1240] T 427c124d773f483294511e80fe340075 P b7ab4784c7344b939bc36f639286f377 [term 11 FOLLOWER]: Rejecting Update request from peer 7ba59cc884714e8aa5f3f0ecaed84cbb for earlier term 10. Current term is 11. Ops: []
I20260709 13:20:21.986022  6872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34f36d59d88f40fe8a2805e604fc6c0a" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:20:21.992748  6872 raft_consensus.cc:3060] T 34f36d59d88f40fe8a2805e604fc6c0a P cd75a17ab2604397adab03bb8b5fd75c [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:20:21.993019  6803 raft_consensus.cc:1240] T be1a92657f494cac8dd227d152f50151 P b7ab4784c7344b939bc36f639286f377 [term 14 FOLLOWER]: Rejecting Update request from peer 7ba59cc884714e8aa5f3f0ecaed84cbb for earlier term 13. Current term is 14. Ops: []
I20260709 13:20:21.994572 11126 raft_consensus.cc:493] T 427c124d773f483294511e80fe340075 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 7ba59cc884714e8aa5f3f0ecaed84cbb)
I20260709 13:20:21.995162 11126 raft_consensus.cc:515] T 427c124d773f483294511e80fe340075 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } attrs { replace: true } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:20:21.978556 11312 raft_consensus.cc:3060] T 4d9def8b32fd443aa94ab1420b06837b P cd75a17ab2604397adab03bb8b5fd75c [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:21.990643 11447 raft_consensus.cc:3055] T bb3d8792045a4583ae2e965b1350a5b4 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:20:21.996755 11289 leader_election.cc:290] T a3022224cc81473690653a83d4e99470 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 14 election: Requested vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:21.997027 11447 raft_consensus.cc:740] T bb3d8792045a4583ae2e965b1350a5b4 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 7ba59cc884714e8aa5f3f0ecaed84cbb, State: Running, Role: LEADER
I20260709 13:20:21.997898 11126 leader_election.cc:290] T 427c124d773f483294511e80fe340075 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:20:21.994777 11415 raft_consensus.cc:697] T f03d0dbf16864ca4bc1bb5e4c0334c0f P ccd8a4c3bfe3413cb2ae219b09aea832 [term 12 LEADER]: Becoming Leader. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
I20260709 13:20:21.968720  7503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b8cacb381b746da8d0049b0a83b41dd" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:20:21.958122 11369 consensus_queue.cc:237] T de3186201e1a40d0b335eeb8b4e256e0 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:21.960502 11371 consensus_queue.cc:237] T 30e88460611e47b2ba16a46a30b5f416 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:22.001565  7503 raft_consensus.cc:2393] T 4b8cacb381b746da8d0049b0a83b41dd P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ccd8a4c3bfe3413cb2ae219b09aea832 in current term 14: Already voted for candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in this term.
I20260709 13:20:22.002192  6697 leader_election.cc:304] T 2c240553ce044eedb41541d72b9475d7 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377
I20260709 13:20:21.970052  6729 raft_consensus.cc:1240] T f4b8bd455d5a47c18a1380839c6e0d61 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 12 FOLLOWER]: Rejecting Update request from peer cd75a17ab2604397adab03bb8b5fd75c for earlier term 11. Current term is 12. Ops: []
I20260709 13:20:21.970145  6730 raft_consensus.cc:1240] T e31b9971c15848dea59d4d4130141d9e P ccd8a4c3bfe3413cb2ae219b09aea832 [term 11 FOLLOWER]: Rejecting Update request from peer cd75a17ab2604397adab03bb8b5fd75c for earlier term 10. Current term is 11. Ops: []
I20260709 13:20:22.006924  6872 raft_consensus.cc:2468] T 34f36d59d88f40fe8a2805e604fc6c0a P cd75a17ab2604397adab03bb8b5fd75c [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 10.
W20260709 13:20:21.976488  7467 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:21.976924  7495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3d8792045a4583ae2e965b1350a5b4" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb"
I20260709 13:20:21.984205  6873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a75bfe094d4bdc963aba3f08dfcd25" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:22.008599  6873 raft_consensus.cc:2468] T 95a75bfe094d4bdc963aba3f08dfcd25 P cd75a17ab2604397adab03bb8b5fd75c [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 12.
I20260709 13:20:21.979295  7496 raft_consensus.cc:2468] T ce4f062dcd314d43a63ca74067cb5ee3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 12.
I20260709 13:20:21.985980 11189 leader_election.cc:290] T d8cee0accdb8499c86d4414b72565a38 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 13 election: Requested vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
W20260709 13:20:21.999150  7468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 178871us
I20260709 13:20:22.006878  6803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8cee0accdb8499c86d4414b72565a38" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:20:21.949631  6695 leader_election.cc:304] T 3411566abe2d4c9bb4b2adfdd05e6f17 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
I20260709 13:20:22.018018  6697 leader_election.cc:304] T a1704639a875409b9959353527b3fd68 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377
I20260709 13:20:21.945003 11411 raft_consensus.cc:740] T 20f6842e26174571996b8dea4151d4be P ccd8a4c3bfe3413cb2ae219b09aea832 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
W20260709 13:20:22.015682  6695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 66143.6us
I20260709 13:20:21.980232 11413 raft_consensus.cc:2804] T 853ac0a8cbd64ce99457f170216d4d0f P ccd8a4c3bfe3413cb2ae219b09aea832 [term 10 FOLLOWER]: Leader election won for term 10
W20260709 13:20:22.026690  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 175927us
I20260709 13:20:22.029799  7496 raft_consensus.cc:1240] T 4b8cacb381b746da8d0049b0a83b41dd P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 14 FOLLOWER]: Rejecting Update request from peer cd75a17ab2604397adab03bb8b5fd75c for earlier term 13. Current term is 14. Ops: []
I20260709 13:20:22.030900 11300 raft_consensus.cc:3055] T c4db81d9d329422bb3b4160ca4ac2d1d P ccd8a4c3bfe3413cb2ae219b09aea832 [term 11 LEADER]: Stepping down as leader of term 11
W20260709 13:20:22.015339 11438 log.cc:927] Time spent T 9e326172347f45e99a0d482b5d8ef768 P cd75a17ab2604397adab03bb8b5fd75c: Append to log took a long time: real 0.071s	user 0.000s	sys 0.005s
I20260709 13:20:22.055327  6844 leader_election.cc:304] T f3f9c2e2bf644115957398fe4c9459db P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377
I20260709 13:20:22.065699  6727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "427c124d773f483294511e80fe340075" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:20:22.081874  6727 raft_consensus.cc:3060] T 427c124d773f483294511e80fe340075 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:20:22.065217  6725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f58dc08b12a2494bb9a1372837970ca2" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:22.082876  6725 raft_consensus.cc:2468] T f58dc08b12a2494bb9a1372837970ca2 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 15.
I20260709 13:20:22.087357  6730 raft_consensus.cc:1275] T 7887766dc6784fcaa42b35c05fea7a99 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 13 FOLLOWER]: Refusing update from remote peer b7ab4784c7344b939bc36f639286f377: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 7. (term mismatch)
I20260709 13:20:22.025787 11289 raft_consensus.cc:2804] T 2c240553ce044eedb41541d72b9475d7 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:20:22.087975  6730 pending_rounds.cc:85] T 7887766dc6784fcaa42b35c05fea7a99 P ccd8a4c3bfe3413cb2ae219b09aea832: Aborting all ops after (but not including) 6
I20260709 13:20:22.092845  6725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "713b5728a197487c9300b310ab94e5a3" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:22.101250  6730 pending_rounds.cc:107] T 7887766dc6784fcaa42b35c05fea7a99 P ccd8a4c3bfe3413cb2ae219b09aea832: Aborting uncommitted NO_OP operation due to leader change: 11.7
W20260709 13:20:22.101879  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 46707.2us
I20260709 13:20:22.101734  6730 raft_consensus.cc:2889] T 7887766dc6784fcaa42b35c05fea7a99 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:20:22.102342  6725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77e330a82df4b43a745d57a68f6f057" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:22.026902 11126 raft_consensus.cc:2804] T 3411566abe2d4c9bb4b2adfdd05e6f17 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:20:22.101194  6727 raft_consensus.cc:2468] T 427c124d773f483294511e80fe340075 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 11.
I20260709 13:20:22.085191 11311 raft_consensus.cc:493] T be1a92657f494cac8dd227d152f50151 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 7ba59cc884714e8aa5f3f0ecaed84cbb)
I20260709 13:20:22.035570 11393 raft_consensus.cc:2804] T a1704639a875409b9959353527b3fd68 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:20:22.063330 11326 leader_election.cc:290] T f3f9c2e2bf644115957398fe4c9459db P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:22.105099  6725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4b8bd455d5a47c18a1380839c6e0d61" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:20:22.150362  6725 raft_consensus.cc:2393] T f4b8bd455d5a47c18a1380839c6e0d61 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate b7ab4784c7344b939bc36f639286f377 in current term 12: Already voted for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in this term.
I20260709 13:20:22.062667 11416 raft_consensus.cc:493] T 7c37d41cd9164c15a6826ca62a851a69 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:20:22.061998 11386 consensus_queue.cc:1059] T bd6869f07b5a4885a0b99fbe60c3b175 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: INVALID_TERM, Last received: 12.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.084s
I20260709 13:20:22.055799 11300 raft_consensus.cc:740] T c4db81d9d329422bb3b4160ca4ac2d1d P ccd8a4c3bfe3413cb2ae219b09aea832 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
I20260709 13:20:22.105062  6727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bf4668eeb70467fb3dc5a0289233b3c" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:20:22.176925  6727 raft_consensus.cc:3060] T 1bf4668eeb70467fb3dc5a0289233b3c P ccd8a4c3bfe3413cb2ae219b09aea832 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:20:22.147055  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 44473.1us
I20260709 13:20:22.090054 11394 raft_consensus.cc:493] T 3d65025eea89441290d85dd053810e31 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:22.090848 11390 raft_consensus.cc:493] T 17587d6730594da4a56fa13a353232a1 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:22.000855 11415 consensus_queue.cc:237] T f03d0dbf16864ca4bc1bb5e4c0334c0f P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:22.022161 11315 raft_consensus.cc:515] T dbdf895bba214ff68685a24fd17dfb5d P cd75a17ab2604397adab03bb8b5fd75c [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:22.091559 11413 raft_consensus.cc:697] T 853ac0a8cbd64ce99457f170216d4d0f P ccd8a4c3bfe3413cb2ae219b09aea832 [term 10 LEADER]: Becoming Leader. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
I20260709 13:20:22.180893  6844 leader_election.cc:400] T 3a485a995abc4807b6e511e45419f737 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 11 election: Vote denied by peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391) with higher term. Message: Invalid argument: T 3a485a995abc4807b6e511e45419f737 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c for earlier term 11. Current term is 12.
W20260709 13:20:22.180999  6847 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:22.203442  6844 leader_election.cc:403] T 3a485a995abc4807b6e511e45419f737 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 11 election: Cancelling election due to peer responding with higher term
I20260709 13:20:22.190438  6727 raft_consensus.cc:2468] T 1bf4668eeb70467fb3dc5a0289233b3c P ccd8a4c3bfe3413cb2ae219b09aea832 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 13.
I20260709 13:20:21.997910 11447 consensus_queue.cc:260] T bb3d8792045a4583ae2e965b1350a5b4 P 7ba59cc884714e8aa5f3f0ecaed84cbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:20:22.146250 11289 raft_consensus.cc:697] T 2c240553ce044eedb41541d72b9475d7 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 14 LEADER]: Becoming Leader. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
W20260709 13:20:22.215047  7466 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 193444us
I20260709 13:20:22.215229  6844 leader_election.cc:304] T f58dc08b12a2494bb9a1372837970ca2 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377
I20260709 13:20:22.104947 11167 consensus_queue.cc:1059] T 4b8cacb381b746da8d0049b0a83b41dd P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 9, Time since last communication: 0.089s
I20260709 13:20:22.092334 11451 consensus_queue.cc:1059] T 427c124d773f483294511e80fe340075 P 7ba59cc884714e8aa5f3f0ecaed84cbb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: INVALID_TERM, Last received: 10.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.118s
I20260709 13:20:22.152562 11455 raft_consensus.cc:2804] T f3f9c2e2bf644115957398fe4c9459db P cd75a17ab2604397adab03bb8b5fd75c [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:20:22.148272 11311 raft_consensus.cc:515] T be1a92657f494cac8dd227d152f50151 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:20:22.232432  6844 leader_election.cc:304] T 3fa34c08b205435dba97346991aa1f92 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, ccd8a4c3bfe3413cb2ae219b09aea832
W20260709 13:20:22.220160  6697 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 163830us
I20260709 13:20:22.169368 11445 raft_consensus.cc:493] T 24ee15416e3145beaa1b8183453729a3 P cd75a17ab2604397adab03bb8b5fd75c [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:22.218591 11439 raft_consensus.cc:2749] T 3a485a995abc4807b6e511e45419f737 P cd75a17ab2604397adab03bb8b5fd75c [term 12 FOLLOWER]: Leader election lost for term 11. Reason: Vote denied by peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391) with higher term. Message: Invalid argument: T 3a485a995abc4807b6e511e45419f737 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c for earlier term 11. Current term is 12.
I20260709 13:20:22.235550  6697 leader_election.cc:304] T bb3d8792045a4583ae2e965b1350a5b4 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:20:22.171327 11326 consensus_queue.cc:1059] T c4db81d9d329422bb3b4160ca4ac2d1d P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.051s
I20260709 13:20:22.202666 11010 leader_election.cc:290] T d8292e16e5654be6bc408560cf256aaa P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:22.161744 11442 consensus_queue.cc:1048] T de3186201e1a40d0b335eeb8b4e256e0 P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Connected to new peer: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.069s
I20260709 13:20:22.199460 11394 raft_consensus.cc:515] T 3d65025eea89441290d85dd053810e31 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:22.256637 11326 raft_consensus.cc:493] T 7887766dc6784fcaa42b35c05fea7a99 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:22.258306 11289 consensus_queue.cc:237] T 2c240553ce044eedb41541d72b9475d7 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
W20260709 13:20:22.260246 11440 log.cc:927] Time spent T 20f6842e26174571996b8dea4151d4be P cd75a17ab2604397adab03bb8b5fd75c: Append to log took a long time: real 0.249s	user 0.000s	sys 0.001s
I20260709 13:20:22.261584 11448 raft_consensus.cc:3055] T 427c124d773f483294511e80fe340075 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:20:22.263013 11452 consensus_queue.cc:1059] T 853ac0a8cbd64ce99457f170216d4d0f P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.011s
I20260709 13:20:22.265596 11413 consensus_queue.cc:237] T 853ac0a8cbd64ce99457f170216d4d0f P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:22.223816 11421 raft_consensus.cc:493] T 90d42e216d9741e190bca19a781291fd P ccd8a4c3bfe3413cb2ae219b09aea832 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:22.176770 11416 raft_consensus.cc:515] T 7c37d41cd9164c15a6826ca62a851a69 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:22.223958 11455 raft_consensus.cc:493] T f3f9c2e2bf644115957398fe4c9459db P cd75a17ab2604397adab03bb8b5fd75c [term 11 FOLLOWER]: Starting leader election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:20:22.222918 11450 raft_consensus.cc:2804] T f58dc08b12a2494bb9a1372837970ca2 P cd75a17ab2604397adab03bb8b5fd75c [term 15 FOLLOWER]: Leader election won for term 15
W20260709 13:20:22.281104  6697 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 45660.1us
I20260709 13:20:22.292874  7503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb7fa124c3bf4ef9ab65a407cb008441" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 14 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:20:22.251997 11167 raft_consensus.cc:2749] T 3fa34c08b205435dba97346991aa1f92 P cd75a17ab2604397adab03bb8b5fd75c [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:20:22.269627 11311 leader_election.cc:290] T be1a92657f494cac8dd227d152f50151 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:20:22.320402 11421 raft_consensus.cc:515] T 90d42e216d9741e190bca19a781291fd P ccd8a4c3bfe3413cb2ae219b09aea832 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:22.301206 11451 raft_consensus.cc:493] T bb7fa124c3bf4ef9ab65a407cb008441 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:22.320456 11211 raft_consensus.cc:993] T 3d65025eea89441290d85dd053810e31 P b7ab4784c7344b939bc36f639286f377: : Instructing follower cd75a17ab2604397adab03bb8b5fd75c to start an election
W20260709 13:20:22.328434 11454 log.cc:927] Time spent T 7a734b5ab7834e05a8c422208acc58b1 P ccd8a4c3bfe3413cb2ae219b09aea832: Append to log took a long time: real 0.077s	user 0.001s	sys 0.000s
I20260709 13:20:22.328084 11451 raft_consensus.cc:515] T bb7fa124c3bf4ef9ab65a407cb008441 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:20:22.329711 11421 leader_election.cc:290] T 90d42e216d9741e190bca19a781291fd P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:22.330598 11460 raft_consensus.cc:2804] T bb3d8792045a4583ae2e965b1350a5b4 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:20:22.323529 11455 raft_consensus.cc:3060] T f3f9c2e2bf644115957398fe4c9459db P cd75a17ab2604397adab03bb8b5fd75c [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:20:22.331490 11460 raft_consensus.cc:697] T bb3d8792045a4583ae2e965b1350a5b4 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 11 LEADER]: Becoming Leader. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
I20260709 13:20:22.332412  7503 raft_consensus.cc:2410] T bb7fa124c3bf4ef9ab65a407cb008441 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7ab4784c7344b939bc36f639286f377 for term 14 because replica has last-logged OpId of term: 12 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 9.
W20260709 13:20:22.334261 11441 log.cc:927] Time spent T 7c44c4849aa54f2b94d1f1bef9ed546f P cd75a17ab2604397adab03bb8b5fd75c: Append to log took a long time: real 0.113s	user 0.001s	sys 0.000s
I20260709 13:20:22.335042  6697 leader_election.cc:304] T 34f36d59d88f40fe8a2805e604fc6c0a P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:20:22.335484  6770 leader_election.cc:400] T f03d0dbf16864ca4bc1bb5e4c0334c0f P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 11 election: Vote denied by peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391) with higher term. Message: Invalid argument: T f03d0dbf16864ca4bc1bb5e4c0334c0f P ccd8a4c3bfe3413cb2ae219b09aea832 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate b7ab4784c7344b939bc36f639286f377 for earlier term 11. Current term is 12.
I20260709 13:20:22.171624 11411 consensus_queue.cc:260] T 20f6842e26174571996b8dea4151d4be P ccd8a4c3bfe3413cb2ae219b09aea832 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
W20260709 13:20:22.338485 11311 consensus_queue.cc:1175] T 20f6842e26174571996b8dea4151d4be P ccd8a4c3bfe3413cb2ae219b09aea832 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "cd75a17ab2604397adab03bb8b5fd75c" responder_term: 13 status { last_received { term: 13 index: 8 } last_committed_idx: 8 last_received_current_leader { term: 13 index: 8 } }
I20260709 13:20:22.339359 11311 raft_consensus.cc:2804] T 34f36d59d88f40fe8a2805e604fc6c0a P ccd8a4c3bfe3413cb2ae219b09aea832 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:20:22.336020  6697 leader_election.cc:304] T 95a75bfe094d4bdc963aba3f08dfcd25 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:20:22.271693 11386 raft_consensus.cc:3055] T bd6869f07b5a4885a0b99fbe60c3b175 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:20:22.301105 11126 raft_consensus.cc:697] T 3411566abe2d4c9bb4b2adfdd05e6f17 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 11 LEADER]: Becoming Leader. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
I20260709 13:20:22.203397 11390 raft_consensus.cc:515] T 17587d6730594da4a56fa13a353232a1 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:20:22.330659 11450 raft_consensus.cc:697] T f58dc08b12a2494bb9a1372837970ca2 P cd75a17ab2604397adab03bb8b5fd75c [term 15 LEADER]: Becoming Leader. State: Replica: cd75a17ab2604397adab03bb8b5fd75c, State: Running, Role: LEADER
I20260709 13:20:22.335876  6770 leader_election.cc:403] T f03d0dbf16864ca4bc1bb5e4c0334c0f P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 11 election: Cancelling election due to peer responding with higher term
I20260709 13:20:22.271258 11418 leader_election.cc:290] T 4f00a2e87e56452083b759f60d461ee3 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 13 election: Requested vote from peers cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:20:22.345606  6732 raft_consensus.cc:1275] T 3d65025eea89441290d85dd053810e31 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 11 FOLLOWER]: Refusing update from remote peer b7ab4784c7344b939bc36f639286f377: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:20:22.306981 11448 raft_consensus.cc:740] T 427c124d773f483294511e80fe340075 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 7ba59cc884714e8aa5f3f0ecaed84cbb, State: Running, Role: LEADER
W20260709 13:20:22.348549  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 116206us
I20260709 13:20:22.339902 11311 raft_consensus.cc:697] T 34f36d59d88f40fe8a2805e604fc6c0a P ccd8a4c3bfe3413cb2ae219b09aea832 [term 10 LEADER]: Becoming Leader. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
I20260709 13:20:22.350477  6770 leader_election.cc:304] T e31b9971c15848dea59d4d4130141d9e P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: cd75a17ab2604397adab03bb8b5fd75c
W20260709 13:20:22.350598  6772 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 584768us
I20260709 13:20:22.355983  6844 leader_election.cc:304] T 427c124d773f483294511e80fe340075 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:20:22.303548 11326 raft_consensus.cc:515] T 7887766dc6784fcaa42b35c05fea7a99 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:22.332901 11460 consensus_queue.cc:237] T bb3d8792045a4583ae2e965b1350a5b4 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:20:22.340161 11451 leader_election.cc:290] T bb7fa124c3bf4ef9ab65a407cb008441 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:22.344483 11386 raft_consensus.cc:740] T bd6869f07b5a4885a0b99fbe60c3b175 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
I20260709 13:20:22.341423 11393 raft_consensus.cc:697] T a1704639a875409b9959353527b3fd68 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 14 LEADER]: Becoming Leader. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
I20260709 13:20:22.362804  6844 leader_election.cc:304] T bb3d8792045a4583ae2e965b1350a5b4 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:20:22.249790 11445 raft_consensus.cc:515] T 24ee15416e3145beaa1b8183453729a3 P cd75a17ab2604397adab03bb8b5fd75c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:20:22.372639 11117 consensus_queue.cc:1048] T a1704639a875409b9959353527b3fd68 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.014s
I20260709 13:20:22.380932 11416 leader_election.cc:290] T 7c37d41cd9164c15a6826ca62a851a69 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:22.381596  6806 raft_consensus.cc:1240] T 4f00a2e87e56452083b759f60d461ee3 P b7ab4784c7344b939bc36f639286f377 [term 13 FOLLOWER]: Rejecting Update request from peer 7ba59cc884714e8aa5f3f0ecaed84cbb for earlier term 12. Current term is 13. Ops: []
I20260709 13:20:22.381750 11445 leader_election.cc:290] T 24ee15416e3145beaa1b8183453729a3 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:20:22.380831 11442 raft_consensus.cc:2749] T bb3d8792045a4583ae2e965b1350a5b4 P cd75a17ab2604397adab03bb8b5fd75c [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:20:22.375613  7468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 264029us
I20260709 13:20:22.382872 11277 raft_consensus.cc:493] T be1a92657f494cac8dd227d152f50151 P b7ab4784c7344b939bc36f639286f377 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:22.378225  6844 leader_election.cc:304] T b56bf91d90824c959e21e0cee5ba1816 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
W20260709 13:20:22.384159 11414 consensus_meta.cc:287] T f5be3a11b23d4ea9b08300a2789821c7 P ccd8a4c3bfe3413cb2ae219b09aea832: Time spent flushing consensus metadata: real 0.506s	user 0.008s	sys 0.005s
I20260709 13:20:22.383072  6804 raft_consensus.cc:1240] T 7ba5dac66ab5497e9e336f2a3c28cda5 P b7ab4784c7344b939bc36f639286f377 [term 13 FOLLOWER]: Rejecting Update request from peer 7ba59cc884714e8aa5f3f0ecaed84cbb for earlier term 12. Current term is 13. Ops: []
I20260709 13:20:22.384265 11211 raft_consensus.cc:1081] T 3d65025eea89441290d85dd053810e31 P b7ab4784c7344b939bc36f639286f377 [term 11 LEADER]: Signalling peer cd75a17ab2604397adab03bb8b5fd75c to start an election
I20260709 13:20:22.386296 11442 raft_consensus.cc:2804] T b56bf91d90824c959e21e0cee5ba1816 P cd75a17ab2604397adab03bb8b5fd75c [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:20:22.386955 11442 raft_consensus.cc:697] T b56bf91d90824c959e21e0cee5ba1816 P cd75a17ab2604397adab03bb8b5fd75c [term 12 LEADER]: Becoming Leader. State: Replica: cd75a17ab2604397adab03bb8b5fd75c, State: Running, Role: LEADER
I20260709 13:20:22.387187  6726 raft_consensus.cc:2410] T f5be3a11b23d4ea9b08300a2789821c7 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c for term 11 because replica has last-logged OpId of term: 10 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 4.
I20260709 13:20:22.388149 11442 consensus_queue.cc:237] T b56bf91d90824c959e21e0cee5ba1816 P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:22.390450 11445 consensus_queue.cc:1048] T 4b8cacb381b746da8d0049b0a83b41dd P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Connected to new peer: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:20:22.391999 11315 leader_election.cc:290] T dbdf895bba214ff68685a24fd17dfb5d P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 11 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:20:22.392779  6772 leader_election.cc:304] T c4db81d9d329422bb3b4160ca4ac2d1d P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:20:22.358083 11403 raft_consensus.cc:2804] T f5be3a11b23d4ea9b08300a2789821c7 P b7ab4784c7344b939bc36f639286f377 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:20:22.359022 11421 raft_consensus.cc:2804] T 95a75bfe094d4bdc963aba3f08dfcd25 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:20:22.339820 11258 consensus_queue.cc:1048] T 9b3759de40694069b13c0f8bd40e5709 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.025s
I20260709 13:20:22.406775  6801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34f36d59d88f40fe8a2805e604fc6c0a" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:20:22.396530  6877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fa34c08b205435dba97346991aa1f92" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:22.417815  6877 raft_consensus.cc:2468] T 3fa34c08b205435dba97346991aa1f92 P cd75a17ab2604397adab03bb8b5fd75c [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 14.
I20260709 13:20:22.419251  6877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c37d41cd9164c15a6826ca62a851a69" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:22.354104 11118 raft_consensus.cc:2749] T f03d0dbf16864ca4bc1bb5e4c0334c0f P b7ab4784c7344b939bc36f639286f377 [term 12 FOLLOWER]: Leader election lost for term 11. Reason: Vote denied by peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391) with higher term. Message: Invalid argument: T f03d0dbf16864ca4bc1bb5e4c0334c0f P ccd8a4c3bfe3413cb2ae219b09aea832 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate b7ab4784c7344b939bc36f639286f377 for earlier term 11. Current term is 12.
I20260709 13:20:22.398699  6695 leader_election.cc:304] T f4b8bd455d5a47c18a1380839c6e0d61 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:20:22.395771  6875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe20b4b48823486ca3b9c648db6ce8aa" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:22.404529  6881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "427c124d773f483294511e80fe340075" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:22.397558  6807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3022224cc81473690653a83d4e99470" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:20:22.402459  6806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a75bfe094d4bdc963aba3f08dfcd25" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:22.383489 11277 raft_consensus.cc:515] T be1a92657f494cac8dd227d152f50151 P b7ab4784c7344b939bc36f639286f377 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:20:22.413582  6803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "427c124d773f483294511e80fe340075" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:22.414549  6876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f9c2e2bf644115957398fe4c9459db" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:22.432247  6878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8292e16e5654be6bc408560cf256aaa" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
W20260709 13:20:22.434919  7469 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:22.435072  6878 raft_consensus.cc:2468] T d8292e16e5654be6bc408560cf256aaa P cd75a17ab2604397adab03bb8b5fd75c [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 16.
I20260709 13:20:22.435743  6806 raft_consensus.cc:2468] T 95a75bfe094d4bdc963aba3f08dfcd25 P b7ab4784c7344b939bc36f639286f377 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 12.
I20260709 13:20:22.420929  6877 raft_consensus.cc:2393] T 7c37d41cd9164c15a6826ca62a851a69 P cd75a17ab2604397adab03bb8b5fd75c [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ccd8a4c3bfe3413cb2ae219b09aea832 in current term 12: Already voted for candidate cd75a17ab2604397adab03bb8b5fd75c in this term.
I20260709 13:20:22.347568 11363 consensus_queue.cc:1048] T 07a92dd554674067a83a9cb68c4773f2 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.029s
I20260709 13:20:22.437963  6803 raft_consensus.cc:2393] T 427c124d773f483294511e80fe340075 P b7ab4784c7344b939bc36f639286f377 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ccd8a4c3bfe3413cb2ae219b09aea832 in current term 11: Already voted for candidate b7ab4784c7344b939bc36f639286f377 in this term.
I20260709 13:20:22.373162 11436 raft_consensus.cc:2749] T 427c124d773f483294511e80fe340075 P cd75a17ab2604397adab03bb8b5fd75c [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:20:22.439332  6875 raft_consensus.cc:2468] T fe20b4b48823486ca3b9c648db6ce8aa P cd75a17ab2604397adab03bb8b5fd75c [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 10.
I20260709 13:20:22.440907 11443 consensus_queue.cc:1059] T e31b9971c15848dea59d4d4130141d9e P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.029s
I20260709 13:20:22.441000 11450 consensus_queue.cc:237] T f58dc08b12a2494bb9a1372837970ca2 P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:22.442432 11198 raft_consensus.cc:2804] T c4db81d9d329422bb3b4160ca4ac2d1d P b7ab4784c7344b939bc36f639286f377 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:20:22.443894  7502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be1a92657f494cac8dd227d152f50151" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:20:22.415632 11421 raft_consensus.cc:493] T 95a75bfe094d4bdc963aba3f08dfcd25 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:22.445034 11464 consensus_queue.cc:1059] T 4f00a2e87e56452083b759f60d461ee3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: INVALID_TERM, Last received: 12.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
W20260709 13:20:22.446280  6770 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 95884.8us
I20260709 13:20:22.461644  6880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3022224cc81473690653a83d4e99470" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:20:22.474107  7503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe20b4b48823486ca3b9c648db6ce8aa" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:20:22.444063 11315 consensus_queue.cc:1059] T f4b8bd455d5a47c18a1380839c6e0d61 P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.008s
I20260709 13:20:22.470208 11198 raft_consensus.cc:697] T c4db81d9d329422bb3b4160ca4ac2d1d P b7ab4784c7344b939bc36f639286f377 [term 12 LEADER]: Becoming Leader. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
W20260709 13:20:22.449555 11440 log.cc:927] Time spent T 20f6842e26174571996b8dea4151d4be P cd75a17ab2604397adab03bb8b5fd75c: Append to log took a long time: real 0.054s	user 0.000s	sys 0.001s
I20260709 13:20:22.471398  6881 raft_consensus.cc:2468] T 427c124d773f483294511e80fe340075 P cd75a17ab2604397adab03bb8b5fd75c [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 10.
W20260709 13:20:22.475534  6695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 76950us
I20260709 13:20:22.486882  6878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8cee0accdb8499c86d4414b72565a38" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:20:22.445087 11466 raft_consensus.cc:493] T 22ccee1b570c4ad3a57bd7aec085b1b4 P cd75a17ab2604397adab03bb8b5fd75c [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
W20260709 13:20:22.488879  6696 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:22.490228  6801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c37d41cd9164c15a6826ca62a851a69" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:22.490988  7500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fa34c08b205435dba97346991aa1f92" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:20:22.487944  6770 leader_election.cc:304] T f58dc08b12a2494bb9a1372837970ca2 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
I20260709 13:20:22.373502 11316 raft_consensus.cc:515] T 711ef6523deb4cbe8ef2ba61e1c21c98 P cd75a17ab2604397adab03bb8b5fd75c [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:22.504338  6725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24ee15416e3145beaa1b8183453729a3" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:22.463989 11418 raft_consensus.cc:2804] T e31b9971c15848dea59d4d4130141d9e P b7ab4784c7344b939bc36f639286f377 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:20:22.461423 11403 raft_consensus.cc:697] T f5be3a11b23d4ea9b08300a2789821c7 P b7ab4784c7344b939bc36f639286f377 [term 11 LEADER]: Becoming Leader. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
I20260709 13:20:22.505100  6725 raft_consensus.cc:2468] T 24ee15416e3145beaa1b8183453729a3 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 14.
I20260709 13:20:22.505007  6724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "713b5728a197487c9300b310ab94e5a3" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:22.475641 11421 raft_consensus.cc:3060] T 95a75bfe094d4bdc963aba3f08dfcd25 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:22.502894  6844 leader_election.cc:304] T 34f36d59d88f40fe8a2805e604fc6c0a P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:20:22.433099 11345 consensus_queue.cc:1048] T 34f36d59d88f40fe8a2805e604fc6c0a P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.054s
I20260709 13:20:22.511984  6880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b8cacb381b746da8d0049b0a83b41dd" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:22.515539  6880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b8cacb381b746da8d0049b0a83b41dd" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:22.516793  6880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8cee0accdb8499c86d4414b72565a38" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:22.512243  6727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbdf895bba214ff68685a24fd17dfb5d" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 11 candidate_status { last_received { term: 10 index: 4 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:20:22.519187  6844 leader_election.cc:304] T a3022224cc81473690653a83d4e99470 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:20:22.438865 11373 consensus_queue.cc:1048] T 3a485a995abc4807b6e511e45419f737 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.051s
I20260709 13:20:22.490593 11369 raft_consensus.cc:2749] T f4b8bd455d5a47c18a1380839c6e0d61 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:20:22.553181  6844 leader_election.cc:304] T 4275cf08e63345f993bce8664eada830 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:20:22.553333  6878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90d42e216d9741e190bca19a781291fd" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:22.556973  6878 raft_consensus.cc:2468] T 90d42e216d9741e190bca19a781291fd P cd75a17ab2604397adab03bb8b5fd75c [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 12.
I20260709 13:20:22.561132  6880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce4f062dcd314d43a63ca74067cb5ee3" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:22.561887  6880 raft_consensus.cc:2468] T ce4f062dcd314d43a63ca74067cb5ee3 P cd75a17ab2604397adab03bb8b5fd75c [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in term 12.
I20260709 13:20:22.562233  6730 raft_consensus.cc:1240] T de3186201e1a40d0b335eeb8b4e256e0 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 14 LEADER]: Rejecting Update request from peer cd75a17ab2604397adab03bb8b5fd75c for earlier term 13. Current term is 14. Ops: [13.8-13.8]
I20260709 13:20:22.562743  6880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb7fa124c3bf4ef9ab65a407cb008441" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:22.563490  6880 raft_consensus.cc:2468] T bb7fa124c3bf4ef9ab65a407cb008441 P cd75a17ab2604397adab03bb8b5fd75c [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in term 13.
I20260709 13:20:22.566298  6880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24ee15416e3145beaa1b8183453729a3" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:20:22.511221 11442 raft_consensus.cc:3055] T f4b8bd455d5a47c18a1380839c6e0d61 P cd75a17ab2604397adab03bb8b5fd75c [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:20:22.462111 11126 consensus_queue.cc:237] T 3411566abe2d4c9bb4b2adfdd05e6f17 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:22.520602 11347 raft_consensus.cc:2804] T f58dc08b12a2494bb9a1372837970ca2 P b7ab4784c7344b939bc36f639286f377 [term 15 FOLLOWER]: Leader pre-election won for term 16
W20260709 13:20:22.576242  6678 auto_rebalancer.cc:629] Failed to schedule move for tablet 8c7f33e544204fbaac4078e3e83bbf4e: Illegal state: Replica cd75a17ab2604397adab03bb8b5fd75c is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 10 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } }
I20260709 13:20:22.521668 11394 leader_election.cc:290] T 3d65025eea89441290d85dd053810e31 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
W20260709 13:20:22.550457 11312 consensus_meta.cc:287] T 4d9def8b32fd443aa94ab1420b06837b P cd75a17ab2604397adab03bb8b5fd75c: Time spent flushing consensus metadata: real 0.554s	user 0.006s	sys 0.006s
I20260709 13:20:22.504318 11363 consensus_queue.cc:1048] T d8292e16e5654be6bc408560cf256aaa P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.068s
W20260709 13:20:22.589505  6695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 91198.9us
W20260709 13:20:22.571774 11440 log.cc:927] Time spent T 20f6842e26174571996b8dea4151d4be P cd75a17ab2604397adab03bb8b5fd75c: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
W20260709 13:20:22.595927  7467 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:22.660984  6878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24ee15416e3145beaa1b8183453729a3" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:22.520370 11252 consensus_queue.cc:1048] T 7887766dc6784fcaa42b35c05fea7a99 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.061s
I20260709 13:20:22.667040  6878 raft_consensus.cc:1240] T bb7fa124c3bf4ef9ab65a407cb008441 P cd75a17ab2604397adab03bb8b5fd75c [term 13 FOLLOWER]: Rejecting Update request from peer 7ba59cc884714e8aa5f3f0ecaed84cbb for earlier term 12. Current term is 13. Ops: []
I20260709 13:20:22.671146  7500 raft_consensus.cc:1240] T d8cee0accdb8499c86d4414b72565a38 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 13 FOLLOWER]: Rejecting Update request from peer cd75a17ab2604397adab03bb8b5fd75c for earlier term 12. Current term is 13. Ops: []
I20260709 13:20:22.492779 11311 consensus_queue.cc:237] T 34f36d59d88f40fe8a2805e604fc6c0a P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:22.675020  7498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "427c124d773f483294511e80fe340075" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:20:22.675661 11462 raft_consensus.cc:493] T 8c7f33e544204fbaac4078e3e83bbf4e P ccd8a4c3bfe3413cb2ae219b09aea832 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:22.676060 11458 consensus_queue.cc:1059] T 7ba5dac66ab5497e9e336f2a3c28cda5 P 7ba59cc884714e8aa5f3f0ecaed84cbb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.210s
I20260709 13:20:22.594429 11476 raft_consensus.cc:2749] T 34f36d59d88f40fe8a2805e604fc6c0a P cd75a17ab2604397adab03bb8b5fd75c [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:20:22.581583 11347 raft_consensus.cc:493] T f58dc08b12a2494bb9a1372837970ca2 P b7ab4784c7344b939bc36f639286f377 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:22.594571 11452 raft_consensus.cc:2749] T a3022224cc81473690653a83d4e99470 P cd75a17ab2604397adab03bb8b5fd75c [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:20:22.727651  6880 raft_consensus.cc:2468] T 24ee15416e3145beaa1b8183453729a3 P cd75a17ab2604397adab03bb8b5fd75c [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in term 14.
W20260709 13:20:22.677493 11407 log.cc:927] Time spent T 711ef6523deb4cbe8ef2ba61e1c21c98 P cd75a17ab2604397adab03bb8b5fd75c: Append to log took a long time: real 1.392s	user 0.006s	sys 0.000s
I20260709 13:20:22.677991  7501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24ee15416e3145beaa1b8183453729a3" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:20:22.678367 11277 leader_election.cc:290] T be1a92657f494cac8dd227d152f50151 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:20:22.678923 11463 raft_consensus.cc:493] T 07a92dd554674067a83a9cb68c4773f2 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:22.681723  6874 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53416 (request call id 2989) took 1057 ms. Trace:
W20260709 13:20:22.684864 11471 log.cc:927] Time spent T 30e88460611e47b2ba16a46a30b5f416 P ccd8a4c3bfe3413cb2ae219b09aea832: Append to log took a long time: real 0.113s	user 0.000s	sys 0.000s
I20260709 13:20:22.685938 11167 raft_consensus.cc:2749] T 4275cf08e63345f993bce8664eada830 P cd75a17ab2604397adab03bb8b5fd75c [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:20:22.575256 11442 raft_consensus.cc:740] T f4b8bd455d5a47c18a1380839c6e0d61 P cd75a17ab2604397adab03bb8b5fd75c [term 11 LEADER]: Becoming Follower/Learner. State: Replica: cd75a17ab2604397adab03bb8b5fd75c, State: Running, Role: LEADER
I20260709 13:20:22.502185 11393 consensus_queue.cc:237] T a1704639a875409b9959353527b3fd68 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:22.461810 11448 consensus_queue.cc:260] T 427c124d773f483294511e80fe340075 P 7ba59cc884714e8aa5f3f0ecaed84cbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } attrs { replace: true } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:20:22.513552 11466 raft_consensus.cc:515] T 22ccee1b570c4ad3a57bd7aec085b1b4 P cd75a17ab2604397adab03bb8b5fd75c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
W20260709 13:20:22.778980  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 225888us
I20260709 13:20:22.727339 11347 raft_consensus.cc:3060] T f58dc08b12a2494bb9a1372837970ca2 P b7ab4784c7344b939bc36f639286f377 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:22.687005 11424 raft_consensus.cc:493] T 7c37d41cd9164c15a6826ca62a851a69 P b7ab4784c7344b939bc36f639286f377 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:22.698529 11315 raft_consensus.cc:476] T de3186201e1a40d0b335eeb8b4e256e0 P cd75a17ab2604397adab03bb8b5fd75c [term 13 LEADER]: Not starting pre-election -- already a leader
I20260709 13:20:22.594012 11312 raft_consensus.cc:515] T 4d9def8b32fd443aa94ab1420b06837b P cd75a17ab2604397adab03bb8b5fd75c [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:22.775974  7500 raft_consensus.cc:1240] T 4b8cacb381b746da8d0049b0a83b41dd P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 14 FOLLOWER]: Rejecting Update request from peer cd75a17ab2604397adab03bb8b5fd75c for earlier term 13. Current term is 14. Ops: []
I20260709 13:20:22.740674  6874 rpcz_store.cc:276] 0709 13:20:21.624833 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:21.679314 (+ 54481us) service_pool.cc:224] Handling call
0709 13:20:22.681511 (+1002197us) spinlock_profiling.cc:243] Waited 106 ms on lock 0x7b54002193d4. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f9ae2fa 00007fcc1496fb17 00007fcc0deea6d4 00007fcc0deea662 00007fcc0deea591 00007fcc0deea50c 00007fcc0dee97c2 00007fcc0dce548c 00007fcc0dce48c6 00007fcc0dce426f
0709 13:20:22.681642 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":244487552}
W20260709 13:20:22.795233  6696 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:22.795192  6844 leader_election.cc:304] T 9e326172347f45e99a0d482b5d8ef768 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:20:22.729257 11390 leader_election.cc:290] T 17587d6730594da4a56fa13a353232a1 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
W20260709 13:20:22.748064  6770 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 242894us
W20260709 13:20:22.844477  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 49384.1us
I20260709 13:20:22.844764  6770 leader_election.cc:304] T 1bf4668eeb70467fb3dc5a0289233b3c P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
I20260709 13:20:22.845817  6844 leader_election.cc:304] T 07a92dd554674067a83a9cb68c4773f2 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:20:22.849745  6804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8292e16e5654be6bc408560cf256aaa" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
W20260709 13:20:22.851220  7496 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.562s	user 0.015s	sys 0.000s
W20260709 13:20:22.854635  7496 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.566s	user 0.016s	sys 0.000s
W20260709 13:20:22.810881  6772 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 418136us
I20260709 13:20:22.839818  6729 raft_consensus.cc:1240] T 2c240553ce044eedb41541d72b9475d7 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 14 LEADER]: Rejecting Update request from peer b7ab4784c7344b939bc36f639286f377 for earlier term 13. Current term is 14. Ops: [13.8-13.8]
I20260709 13:20:22.857352  6804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90d42e216d9741e190bca19a781291fd" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:22.696092 11198 consensus_queue.cc:237] T c4db81d9d329422bb3b4160ca4ac2d1d P b7ab4784c7344b939bc36f639286f377 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:22.701359 11403 consensus_queue.cc:237] T f5be3a11b23d4ea9b08300a2789821c7 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:22.872397  6697 leader_election.cc:304] T 1528ab62b6fe4e3099d08f141afee116 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, b7ab4784c7344b939bc36f639286f377
I20260709 13:20:22.873208  6772 leader_election.cc:304] T d8cee0accdb8499c86d4414b72565a38 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:20:22.827463 11373 raft_consensus.cc:493] T b3f13b31a1f84f0d89d007eadd57924c P b7ab4784c7344b939bc36f639286f377 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 7ba59cc884714e8aa5f3f0ecaed84cbb)
I20260709 13:20:22.875552  6879 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53406 (request call id 2209) took 2451 ms. Trace:
I20260709 13:20:22.745308 11455 raft_consensus.cc:515] T f3f9c2e2bf644115957398fe4c9459db P cd75a17ab2604397adab03bb8b5fd75c [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:22.905999  6697 leader_election.cc:304] T 4b8cacb381b746da8d0049b0a83b41dd P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:20:22.857609 11258 raft_consensus.cc:2804] T 1bf4668eeb70467fb3dc5a0289233b3c P b7ab4784c7344b939bc36f639286f377 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:20:22.908495  6772 leader_election.cc:304] T bb7fa124c3bf4ef9ab65a407cb008441 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:20:22.915120  6804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f9c2e2bf644115957398fe4c9459db" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:22.865952 11418 raft_consensus.cc:697] T e31b9971c15848dea59d4d4130141d9e P b7ab4784c7344b939bc36f639286f377 [term 11 LEADER]: Becoming Leader. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
I20260709 13:20:22.846530 11452 raft_consensus.cc:493] T ab432e62819d499eaaf3dd55481dd930 P cd75a17ab2604397adab03bb8b5fd75c [term 13 FOLLOWER]: Starting pre-election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:20:22.915498 11289 raft_consensus.cc:2749] T 1528ab62b6fe4e3099d08f141afee116 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:20:22.746793 11463 raft_consensus.cc:515] T 07a92dd554674067a83a9cb68c4773f2 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:22.715147 11462 raft_consensus.cc:515] T 8c7f33e544204fbaac4078e3e83bbf4e P ccd8a4c3bfe3413cb2ae219b09aea832 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:22.906562 11167 raft_consensus.cc:2749] T 07a92dd554674067a83a9cb68c4773f2 P cd75a17ab2604397adab03bb8b5fd75c [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:20:22.929623  6804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be1a92657f494cac8dd227d152f50151" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:22.929629  6697 leader_election.cc:304] T ce4f062dcd314d43a63ca74067cb5ee3 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377
I20260709 13:20:22.876003  6879 rpcz_store.cc:276] 0709 13:20:20.423777 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:20.455773 (+ 31996us) service_pool.cc:224] Handling call
0709 13:20:20.477142 (+ 21369us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:20.487006 (+  9864us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:20.487055 (+    49us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:20:20.499600 (+ 12545us) log.cc:844] Serialized 26 byte log entry
0709 13:20:20.700326 (+200726us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:20:20.700375 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:20.700460 (+    85us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:22.327902 (+1627442us) spinlock_profiling.cc:243] Waited 45.6 ms on lock 0x7b4400022b4c. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0c745db1 00007fcc0c7e3c85 00007fcc0c7e46a2 00007fcc0f5561db 00007fcc0f551aaf 00007fcc0f54586e 00007fcc0f544bb6 00007fcc0f5447d8 00007fcc0f54e221 00007fcc0f54e1d9 00007fcc0f54e169
0709 13:20:22.863107 (+535205us) raft_consensus.cc:1685] finished
0709 13:20:22.863130 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:22.875459 (+ 12329us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":149,"raft.run_cpu_time_us":171,"raft.run_wall_time_us":8391,"spinlock_wait_cycles":104900480,"thread_start_us":133269,"threads_started":1,"wal-append.queue_time_us":402054}
W20260709 13:20:22.934003 11288 consensus_meta.cc:287] T f09c2a98de1a4decabd0ff900dd44caa P ccd8a4c3bfe3413cb2ae219b09aea832: Time spent flushing consensus metadata: real 1.019s	user 0.005s	sys 0.010s
I20260709 13:20:22.865744 11059 consensus_queue.cc:1048] T 3d65025eea89441290d85dd053810e31 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.055s
I20260709 13:20:22.839239 11476 consensus_queue.cc:1059] T d8cee0accdb8499c86d4414b72565a38 P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.088s
W20260709 13:20:22.928364  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 82678.2us
I20260709 13:20:22.842798 11424 raft_consensus.cc:515] T 7c37d41cd9164c15a6826ca62a851a69 P b7ab4784c7344b939bc36f639286f377 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:22.949404  6876 raft_consensus.cc:2393] T f3f9c2e2bf644115957398fe4c9459db P cd75a17ab2604397adab03bb8b5fd75c [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ccd8a4c3bfe3413cb2ae219b09aea832 in current term 12: Already voted for candidate cd75a17ab2604397adab03bb8b5fd75c in this term.
I20260709 13:20:22.929394 11316 leader_election.cc:290] T 711ef6523deb4cbe8ef2ba61e1c21c98 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 14 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:20:22.904814 11373 raft_consensus.cc:515] T b3f13b31a1f84f0d89d007eadd57924c P b7ab4784c7344b939bc36f639286f377 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:20:22.925246 11443 raft_consensus.cc:2749] T 9e326172347f45e99a0d482b5d8ef768 P cd75a17ab2604397adab03bb8b5fd75c [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:20:22.935061 11465 raft_consensus.cc:3060] T 4b8cacb381b746da8d0049b0a83b41dd P ccd8a4c3bfe3413cb2ae219b09aea832 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:22.948009  6804 raft_consensus.cc:2393] T be1a92657f494cac8dd227d152f50151 P b7ab4784c7344b939bc36f639286f377 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ccd8a4c3bfe3413cb2ae219b09aea832 in current term 14: Already voted for candidate b7ab4784c7344b939bc36f639286f377 in this term.
I20260709 13:20:22.966805  6844 leader_election.cc:304] T 7c37d41cd9164c15a6826ca62a851a69 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
W20260709 13:20:22.973989 11483 log.cc:927] Time spent T 3d65025eea89441290d85dd053810e31 P b7ab4784c7344b939bc36f639286f377: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 13:20:22.973819 11418 consensus_queue.cc:237] T e31b9971c15848dea59d4d4130141d9e P b7ab4784c7344b939bc36f639286f377 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:22.936204 11486 raft_consensus.cc:2749] T d8cee0accdb8499c86d4414b72565a38 P b7ab4784c7344b939bc36f639286f377 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:20:22.985421  6772 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.68:45071, user_credentials={real_user=slave}} blocked reactor thread for 77046.3us
I20260709 13:20:22.955341 11289 raft_consensus.cc:2804] T ce4f062dcd314d43a63ca74067cb5ee3 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:20:22.989667  6804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbdf895bba214ff68685a24fd17dfb5d" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 11 candidate_status { last_received { term: 10 index: 4 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:20:22.944075 11452 raft_consensus.cc:515] T ab432e62819d499eaaf3dd55481dd930 P cd75a17ab2604397adab03bb8b5fd75c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:22.990829  6801 raft_consensus.cc:2468] T 7c37d41cd9164c15a6826ca62a851a69 P b7ab4784c7344b939bc36f639286f377 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 12.
I20260709 13:20:22.993917  6844 leader_election.cc:304] T bd6869f07b5a4885a0b99fbe60c3b175 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:20:23.001680  6844 leader_election.cc:304] T 7c44c4849aa54f2b94d1f1bef9ed546f P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:20:22.954339 11288 raft_consensus.cc:515] T f09c2a98de1a4decabd0ff900dd44caa P ccd8a4c3bfe3413cb2ae219b09aea832 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:23.008644  6804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "713b5728a197487c9300b310ab94e5a3" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:23.011368  6844 leader_election.cc:400] T 1bf4668eeb70467fb3dc5a0289233b3c P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 12 election: Vote denied by peer b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817) with higher term. Message: Invalid argument: T 1bf4668eeb70467fb3dc5a0289233b3c P b7ab4784c7344b939bc36f639286f377 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c for earlier term 12. Current term is 13.
I20260709 13:20:23.011723  6844 leader_election.cc:403] T 1bf4668eeb70467fb3dc5a0289233b3c P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 12 election: Cancelling election due to peer responding with higher term
I20260709 13:20:23.012790  6844 leader_election.cc:304] T 44bde925b2e541b69890d70715b85176 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:20:23.012825  7500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "427c124d773f483294511e80fe340075" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb"
I20260709 13:20:23.016462  6844 leader_election.cc:304] T ce4f062dcd314d43a63ca74067cb5ee3 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
W20260709 13:20:23.016782  7469 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:23.016975  7501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ba5dac66ab5497e9e336f2a3c28cda5" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb"
I20260709 13:20:22.992574 11289 raft_consensus.cc:493] T ce4f062dcd314d43a63ca74067cb5ee3 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 12 FOLLOWER]: Starting leader election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:20:23.001044 11443 raft_consensus.cc:2749] T 7c37d41cd9164c15a6826ca62a851a69 P cd75a17ab2604397adab03bb8b5fd75c [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:20:23.009320 11258 raft_consensus.cc:697] T 1bf4668eeb70467fb3dc5a0289233b3c P b7ab4784c7344b939bc36f639286f377 [term 13 LEADER]: Becoming Leader. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
I20260709 13:20:23.048768  6732 raft_consensus.cc:1240] T f09c2a98de1a4decabd0ff900dd44caa P ccd8a4c3bfe3413cb2ae219b09aea832 [term 14 FOLLOWER]: Rejecting Update request from peer cd75a17ab2604397adab03bb8b5fd75c for earlier term 13. Current term is 14. Ops: []
W20260709 13:20:23.041033  6697 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.68:45071, user_credentials={real_user=slave}} blocked reactor thread for 111472us
I20260709 13:20:23.050670  7501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be1a92657f494cac8dd227d152f50151" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:20:23.042068 11424 leader_election.cc:290] T 7c37d41cd9164c15a6826ca62a851a69 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:23.042563 11312 leader_election.cc:290] T 4d9def8b32fd443aa94ab1420b06837b P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 13 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:20:23.007423 11167 raft_consensus.cc:2749] T bd6869f07b5a4885a0b99fbe60c3b175 P cd75a17ab2604397adab03bb8b5fd75c [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:20:23.047381  6804 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7ba5dac66ab5497e9e336f2a3c28cda5"
dest_uuid: "b7ab4784c7344b939bc36f639286f377"
mode: GRACEFUL
new_leader_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
 from {username='slave'} at 127.0.0.1:38240
I20260709 13:20:23.057116  6804 raft_consensus.cc:606] T 7ba5dac66ab5497e9e336f2a3c28cda5 P b7ab4784c7344b939bc36f639286f377 [term 13 FOLLOWER]: Received request to transfer leadership to TS cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:20:23.057600  6804 raft_consensus.cc:614] T 7ba5dac66ab5497e9e336f2a3c28cda5 P b7ab4784c7344b939bc36f639286f377 [term 13 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:20:23.007237 11316 raft_consensus.cc:2749] T 7c44c4849aa54f2b94d1f1bef9ed546f P cd75a17ab2604397adab03bb8b5fd75c [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:20:23.060341 11475 log.cc:927] Time spent T b56bf91d90824c959e21e0cee5ba1816 P cd75a17ab2604397adab03bb8b5fd75c: Append to log took a long time: real 0.315s	user 0.001s	sys 0.000s
I20260709 13:20:23.046049 11289 raft_consensus.cc:3060] T ce4f062dcd314d43a63ca74067cb5ee3 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:23.049034 11315 raft_consensus.cc:3060] T 1bf4668eeb70467fb3dc5a0289233b3c P cd75a17ab2604397adab03bb8b5fd75c [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:23.043354 11059 raft_consensus.cc:2749] T bb7fa124c3bf4ef9ab65a407cb008441 P b7ab4784c7344b939bc36f639286f377 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:20:23.063819  7501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17587d6730594da4a56fa13a353232a1" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:20:23.053695  7503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f00a2e87e56452083b759f60d461ee3" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb"
I20260709 13:20:23.074901  6844 leader_election.cc:304] T d8292e16e5654be6bc408560cf256aaa P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
W20260709 13:20:23.060364 11472 log.cc:927] Time spent T d8cee0accdb8499c86d4414b72565a38 P b7ab4784c7344b939bc36f639286f377: Append to log took a long time: real 0.253s	user 0.001s	sys 0.000s
W20260709 13:20:23.080240 11477 log.cc:927] Time spent T f03d0dbf16864ca4bc1bb5e4c0334c0f P ccd8a4c3bfe3413cb2ae219b09aea832: Append to log took a long time: real 0.213s	user 0.002s	sys 0.000s
I20260709 13:20:23.081372 11503 raft_consensus.cc:2749] T 44bde925b2e541b69890d70715b85176 P cd75a17ab2604397adab03bb8b5fd75c [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:20:23.082351  6805 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:32966 (request call id 1140) took 1303 ms. Trace:
I20260709 13:20:23.079432  7501 raft_consensus.cc:2468] T 17587d6730594da4a56fa13a353232a1 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 17.
I20260709 13:20:23.056327 11311 raft_consensus.cc:493] T 4d9def8b32fd443aa94ab1420b06837b P ccd8a4c3bfe3413cb2ae219b09aea832 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:20:23.082913  6805 rpcz_store.cc:276] 0709 13:20:21.779343 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:21.844400 (+ 65057us) service_pool.cc:224] Handling call
0709 13:20:21.844991 (+   591us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:22.351651 (+506660us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:22.351709 (+    58us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:20:22.352343 (+   634us) log.cc:844] Serialized 26 byte log entry
0709 13:20:22.507034 (+154691us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:20:22.841235 (+334201us) log.cc:844] Serialized 14 byte log entry
0709 13:20:22.862469 (+ 21234us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:22.862558 (+    89us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:23.082034 (+219476us) raft_consensus.cc:1685] finished
0709 13:20:23.082075 (+    41us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:23.082274 (+   199us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":583905,"prepare.queue_time_us":287412,"prepare.run_cpu_time_us":41,"prepare.run_wall_time_us":42,"raft.queue_time_us":529887,"raft.run_cpu_time_us":139,"raft.run_wall_time_us":5639,"spinlock_wait_cycles":16110592,"thread_start_us":440186,"threads_started":2,"wal-append.queue_time_us":313776}
I20260709 13:20:23.102495  6880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ba5dac66ab5497e9e336f2a3c28cda5" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:20:23.090638  6805 raft_consensus.cc:1240] T f4b8bd455d5a47c18a1380839c6e0d61 P b7ab4784c7344b939bc36f639286f377 [term 12 FOLLOWER]: Rejecting Update request from peer cd75a17ab2604397adab03bb8b5fd75c for earlier term 11. Current term is 12. Ops: []
I20260709 13:20:23.112313  6880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44bde925b2e541b69890d70715b85176" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
W20260709 13:20:23.112877  7467 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:23.119202  6805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "711ef6523deb4cbe8ef2ba61e1c21c98" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:20:23.121481  6805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab432e62819d499eaaf3dd55481dd930" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:23.122648  6805 raft_consensus.cc:2393] T ab432e62819d499eaaf3dd55481dd930 P b7ab4784c7344b939bc36f639286f377 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c in current term 14: Already voted for candidate b7ab4784c7344b939bc36f639286f377 in this term.
I20260709 13:20:23.109440 11312 raft_consensus.cc:2749] T d8292e16e5654be6bc408560cf256aaa P cd75a17ab2604397adab03bb8b5fd75c [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:20:23.132503 11488 log.cc:927] Time spent T 7c44c4849aa54f2b94d1f1bef9ed546f P b7ab4784c7344b939bc36f639286f377: Append to log took a long time: real 0.087s	user 0.000s	sys 0.000s
I20260709 13:20:23.133103 11312 raft_consensus.cc:493] T 3d65025eea89441290d85dd053810e31 P cd75a17ab2604397adab03bb8b5fd75c [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
W20260709 13:20:23.134177 11473 log.cc:927] Time spent T 3a485a995abc4807b6e511e45419f737 P ccd8a4c3bfe3413cb2ae219b09aea832: Append to log took a long time: real 0.216s	user 0.001s	sys 0.000s
I20260709 13:20:23.135288 11373 leader_election.cc:290] T b3f13b31a1f84f0d89d007eadd57924c P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
W20260709 13:20:23.097905 11480 log.cc:927] Time spent T 853ac0a8cbd64ce99457f170216d4d0f P ccd8a4c3bfe3413cb2ae219b09aea832: Append to log took a long time: real 0.232s	user 0.001s	sys 0.000s
I20260709 13:20:23.109792 11311 raft_consensus.cc:515] T 4d9def8b32fd443aa94ab1420b06837b P ccd8a4c3bfe3413cb2ae219b09aea832 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:23.133742 11312 raft_consensus.cc:515] T 3d65025eea89441290d85dd053810e31 P cd75a17ab2604397adab03bb8b5fd75c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:23.141861  6880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "427c124d773f483294511e80fe340075" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:20:23.100697 11288 leader_election.cc:290] T f09c2a98de1a4decabd0ff900dd44caa P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 14 election: Requested vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:23.092695 11484 raft_consensus.cc:3055] T d8cee0accdb8499c86d4414b72565a38 P cd75a17ab2604397adab03bb8b5fd75c [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:20:23.146445  6697 leader_election.cc:304] T 3fa34c08b205435dba97346991aa1f92 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:20:23.150497  6804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d9def8b32fd443aa94ab1420b06837b" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:20:23.098623 11466 leader_election.cc:290] T 22ccee1b570c4ad3a57bd7aec085b1b4 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:20:23.099637 11462 leader_election.cc:290] T 8c7f33e544204fbaac4078e3e83bbf4e P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:23.081997 11316 consensus_queue.cc:1059] T e31b9971c15848dea59d4d4130141d9e P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.066s
I20260709 13:20:23.075924 11443 consensus_queue.cc:1059] T 853ac0a8cbd64ce99457f170216d4d0f P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.065s
I20260709 13:20:23.159626  6697 leader_election.cc:304] T d8292e16e5654be6bc408560cf256aaa P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:20:23.138609 11311 leader_election.cc:290] T 4d9def8b32fd443aa94ab1420b06837b P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:23.098981 11463 leader_election.cc:290] T 07a92dd554674067a83a9cb68c4773f2 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:23.163662  7503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3f13b31a1f84f0d89d007eadd57924c" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:20:23.144640  7468 leader_election.cc:304] T d8cee0accdb8499c86d4414b72565a38 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:20:23.098284 11452 leader_election.cc:290] T ab432e62819d499eaaf3dd55481dd930 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:20:23.130765 11450 raft_consensus.cc:493] T 7a734b5ab7834e05a8c422208acc58b1 P cd75a17ab2604397adab03bb8b5fd75c [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:23.151875 11484 raft_consensus.cc:740] T d8cee0accdb8499c86d4414b72565a38 P cd75a17ab2604397adab03bb8b5fd75c [term 12 LEADER]: Becoming Follower/Learner. State: Replica: cd75a17ab2604397adab03bb8b5fd75c, State: Running, Role: LEADER
I20260709 13:20:23.162396  6880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "713b5728a197487c9300b310ab94e5a3" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
W20260709 13:20:23.173521  6678 auto_rebalancer.cc:629] Failed to schedule move for tablet 3d65025eea89441290d85dd053810e31: Remote error: Service unavailable: leader transfer in progress
I20260709 13:20:23.193415  6772 leader_election.cc:304] T 7ba5dac66ab5497e9e336f2a3c28cda5 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:20:23.180480 11493 raft_consensus.cc:2749] T d8cee0accdb8499c86d4414b72565a38 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:20:23.180553 11510 raft_consensus.cc:493] T 8c7f33e544204fbaac4078e3e83bbf4e P cd75a17ab2604397adab03bb8b5fd75c [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:23.181603 11349 raft_consensus.cc:493] T 404190ce4ce94cecbfcb6ea9d1dd8626 P b7ab4784c7344b939bc36f639286f377 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 7ba59cc884714e8aa5f3f0ecaed84cbb)
I20260709 13:20:23.187817 11504 raft_consensus.cc:493] T bd6869f07b5a4885a0b99fbe60c3b175 P b7ab4784c7344b939bc36f639286f377 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:20:23.168991  6697 leader_election.cc:304] T fe20b4b48823486ca3b9c648db6ce8aa P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:20:23.165556 11288 raft_consensus.cc:2804] T 3fa34c08b205435dba97346991aa1f92 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:20:23.094727 11492 raft_consensus.cc:2749] T ce4f062dcd314d43a63ca74067cb5ee3 P cd75a17ab2604397adab03bb8b5fd75c [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:20:23.179556  7468 leader_election.cc:304] T bb7fa124c3bf4ef9ab65a407cb008441 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:20:23.194480  6805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22ccee1b570c4ad3a57bd7aec085b1b4" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:23.163712 11455 leader_election.cc:290] T f3f9c2e2bf644115957398fe4c9459db P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 12 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:20:23.197590  6772 leader_election.cc:304] T 44bde925b2e541b69890d70715b85176 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:20:23.175832 11316 consensus_queue.cc:1243] T e31b9971c15848dea59d4d4130141d9e P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Peer b7ab4784c7344b939bc36f639286f377 log is divergent from this leader: its last log entry 9.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 13:20:23.174485 11462 raft_consensus.cc:2804] T d8292e16e5654be6bc408560cf256aaa P ccd8a4c3bfe3413cb2ae219b09aea832 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:20:23.201936  6697 leader_election.cc:304] T 90d42e216d9741e190bca19a781291fd P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:20:23.207616  6880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c37d41cd9164c15a6826ca62a851a69" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:23.143991 11258 consensus_queue.cc:237] T 1bf4668eeb70467fb3dc5a0289233b3c P b7ab4784c7344b939bc36f639286f377 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:23.209527  6880 raft_consensus.cc:2468] T 7c37d41cd9164c15a6826ca62a851a69 P cd75a17ab2604397adab03bb8b5fd75c [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 12.
I20260709 13:20:23.114405 11503 consensus_queue.cc:1059] T de3186201e1a40d0b335eeb8b4e256e0 P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.086s
I20260709 13:20:23.196141 11452 raft_consensus.cc:493] T d33d5ee8ef6f415593d8df52063161ad P cd75a17ab2604397adab03bb8b5fd75c [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:20:23.204094  6844 leader_election.cc:304] T 24ee15416e3145beaa1b8183453729a3 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:20:23.200317 11443 raft_consensus.cc:493] T 20f6842e26174571996b8dea4151d4be P cd75a17ab2604397adab03bb8b5fd75c [term 13 FOLLOWER]: Starting pre-election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:20:23.210201 11336 raft_consensus.cc:2804] T bb7fa124c3bf4ef9ab65a407cb008441 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:20:23.204573 11311 raft_consensus.cc:2804] T fe20b4b48823486ca3b9c648db6ce8aa P ccd8a4c3bfe3413cb2ae219b09aea832 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:20:23.203620 11288 raft_consensus.cc:493] T 3fa34c08b205435dba97346991aa1f92 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 7ba59cc884714e8aa5f3f0ecaed84cbb)
W20260709 13:20:23.222321 11509 log.cc:927] Time spent T 34f36d59d88f40fe8a2805e604fc6c0a P ccd8a4c3bfe3413cb2ae219b09aea832: Append to log took a long time: real 0.054s	user 0.001s	sys 0.000s
I20260709 13:20:23.220320 11484 consensus_queue.cc:260] T d8cee0accdb8499c86d4414b72565a38 P cd75a17ab2604397adab03bb8b5fd75c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:20:23.217443 11452 raft_consensus.cc:515] T d33d5ee8ef6f415593d8df52063161ad P cd75a17ab2604397adab03bb8b5fd75c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
W20260709 13:20:23.225553 11421 consensus_meta.cc:287] T 95a75bfe094d4bdc963aba3f08dfcd25 P ccd8a4c3bfe3413cb2ae219b09aea832: Time spent flushing consensus metadata: real 0.670s	user 0.009s	sys 0.003s
I20260709 13:20:23.217099 11491 raft_consensus.cc:2804] T 90d42e216d9741e190bca19a781291fd P ccd8a4c3bfe3413cb2ae219b09aea832 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:20:23.219472 11336 raft_consensus.cc:493] T bb7fa124c3bf4ef9ab65a407cb008441 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:23.208637 11462 raft_consensus.cc:493] T d8292e16e5654be6bc408560cf256aaa P ccd8a4c3bfe3413cb2ae219b09aea832 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:23.253103 11462 raft_consensus.cc:3060] T d8292e16e5654be6bc408560cf256aaa P ccd8a4c3bfe3413cb2ae219b09aea832 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:23.256170 11507 raft_consensus.cc:493] T 4275cf08e63345f993bce8664eada830 P b7ab4784c7344b939bc36f639286f377 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:20:23.228201 11505 raft_consensus.cc:2749] T 7ba5dac66ab5497e9e336f2a3c28cda5 P b7ab4784c7344b939bc36f639286f377 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:20:23.208914 11349 raft_consensus.cc:515] T 404190ce4ce94cecbfcb6ea9d1dd8626 P b7ab4784c7344b939bc36f639286f377 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:20:23.232642 11311 raft_consensus.cc:493] T fe20b4b48823486ca3b9c648db6ce8aa P ccd8a4c3bfe3413cb2ae219b09aea832 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 7ba59cc884714e8aa5f3f0ecaed84cbb)
I20260709 13:20:23.239661 11288 raft_consensus.cc:3060] T 3fa34c08b205435dba97346991aa1f92 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:23.204227 11486 raft_consensus.cc:493] T 30e88460611e47b2ba16a46a30b5f416 P b7ab4784c7344b939bc36f639286f377 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:23.195492 11450 raft_consensus.cc:515] T 7a734b5ab7834e05a8c422208acc58b1 P cd75a17ab2604397adab03bb8b5fd75c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
W20260709 13:20:23.231693  7467 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:23.273219  7467 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:23.198231 11347 raft_consensus.cc:515] T f58dc08b12a2494bb9a1372837970ca2 P b7ab4784c7344b939bc36f639286f377 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:23.238886  6844 leader_election.cc:304] T 713b5728a197487c9300b310ab94e5a3 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
W20260709 13:20:23.244556  6678 auto_rebalancer.cc:629] Failed to schedule move for tablet e77e330a82df4b43a745d57a68f6f057: Illegal state: Replica b7ab4784c7344b939bc36f639286f377 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 14 leader_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } }
I20260709 13:20:23.242511 11059 raft_consensus.cc:2749] T 44bde925b2e541b69890d70715b85176 P b7ab4784c7344b939bc36f639286f377 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:20:23.250119 11336 raft_consensus.cc:3060] T bb7fa124c3bf4ef9ab65a407cb008441 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:23.257020 11507 raft_consensus.cc:515] T 4275cf08e63345f993bce8664eada830 P b7ab4784c7344b939bc36f639286f377 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:23.228204 11443 raft_consensus.cc:515] T 20f6842e26174571996b8dea4151d4be P cd75a17ab2604397adab03bb8b5fd75c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
W20260709 13:20:23.268206  6772 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 70743.9us
I20260709 13:20:23.209030 11510 raft_consensus.cc:515] T 8c7f33e544204fbaac4078e3e83bbf4e P cd75a17ab2604397adab03bb8b5fd75c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:23.245465 11316 raft_consensus.cc:2804] T 24ee15416e3145beaa1b8183453729a3 P cd75a17ab2604397adab03bb8b5fd75c [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:20:23.248661 11491 raft_consensus.cc:493] T 90d42e216d9741e190bca19a781291fd P ccd8a4c3bfe3413cb2ae219b09aea832 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:23.277545  6844 leader_election.cc:304] T dbdf895bba214ff68685a24fd17dfb5d P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:20:23.286513  6844 leader_election.cc:304] T f5be3a11b23d4ea9b08300a2789821c7 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:20:23.287231 11492 consensus_queue.cc:1059] T de3186201e1a40d0b335eeb8b4e256e0 P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:20:23.288254 11167 raft_consensus.cc:2749] T f5be3a11b23d4ea9b08300a2789821c7 P cd75a17ab2604397adab03bb8b5fd75c [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:20:23.286737  6772 leader_election.cc:304] T 427c124d773f483294511e80fe340075 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:20:23.288484 11492 consensus_queue.cc:1243] T de3186201e1a40d0b335eeb8b4e256e0 P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Peer ccd8a4c3bfe3413cb2ae219b09aea832 log is divergent from this leader: its last log entry 14.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 13:20:23.271903 11311 raft_consensus.cc:3060] T fe20b4b48823486ca3b9c648db6ce8aa P ccd8a4c3bfe3413cb2ae219b09aea832 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:20:23.292375  6772 leader_election.cc:304] T 713b5728a197487c9300b310ab94e5a3 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:20:23.274484 11452 leader_election.cc:290] T d33d5ee8ef6f415593d8df52063161ad P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:20:23.258265 11421 raft_consensus.cc:515] T 95a75bfe094d4bdc963aba3f08dfcd25 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:23.279973 11484 raft_consensus.cc:3060] T d8cee0accdb8499c86d4414b72565a38 P cd75a17ab2604397adab03bb8b5fd75c [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:23.281443 11503 raft_consensus.cc:2749] T 713b5728a197487c9300b310ab94e5a3 P cd75a17ab2604397adab03bb8b5fd75c [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:20:23.290655 11316 raft_consensus.cc:493] T 24ee15416e3145beaa1b8183453729a3 P cd75a17ab2604397adab03bb8b5fd75c [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:23.299510 11312 leader_election.cc:290] T 3d65025eea89441290d85dd053810e31 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:20:23.305100 11443 leader_election.cc:290] T 20f6842e26174571996b8dea4151d4be P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:20:23.297987 11198 raft_consensus.cc:2749] T 713b5728a197487c9300b310ab94e5a3 P b7ab4784c7344b939bc36f639286f377 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:20:23.292511 11362 leader_election.cc:290] T 4b8cacb381b746da8d0049b0a83b41dd P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 14 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:23.289086 11167 consensus_queue.cc:1059] T f4b8bd455d5a47c18a1380839c6e0d61 P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.019s
I20260709 13:20:23.310155 11387 raft_consensus.cc:3060] T ab432e62819d499eaaf3dd55481dd930 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:23.312664 11510 leader_election.cc:290] T 8c7f33e544204fbaac4078e3e83bbf4e P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:20:23.210482 11504 raft_consensus.cc:515] T bd6869f07b5a4885a0b99fbe60c3b175 P b7ab4784c7344b939bc36f639286f377 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:23.286361 11517 raft_consensus.cc:2749] T dbdf895bba214ff68685a24fd17dfb5d P cd75a17ab2604397adab03bb8b5fd75c [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:20:23.291712 11491 raft_consensus.cc:3060] T 90d42e216d9741e190bca19a781291fd P ccd8a4c3bfe3413cb2ae219b09aea832 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:23.276870 11486 raft_consensus.cc:515] T 30e88460611e47b2ba16a46a30b5f416 P b7ab4784c7344b939bc36f639286f377 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
W20260709 13:20:23.321053 11498 log.cc:927] Time spent T 44bde925b2e541b69890d70715b85176 P ccd8a4c3bfe3413cb2ae219b09aea832: Append to log took a long time: real 0.069s	user 0.001s	sys 0.000s
I20260709 13:20:23.336663 11349 leader_election.cc:290] T 404190ce4ce94cecbfcb6ea9d1dd8626 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:20:23.317248 11316 raft_consensus.cc:3060] T 24ee15416e3145beaa1b8183453729a3 P cd75a17ab2604397adab03bb8b5fd75c [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:23.347883  7503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "404190ce4ce94cecbfcb6ea9d1dd8626" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:20:23.354395  6731 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50004 (request call id 2160) took 1824 ms. Trace:
I20260709 13:20:23.354995  6731 rpcz_store.cc:276] 0709 13:20:21.529917 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:21.532151 (+  2234us) service_pool.cc:224] Handling call
0709 13:20:21.532542 (+   391us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:21.609786 (+ 77244us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:23.354068 (+1744282us) spinlock_profiling.cc:243] Waited 57.9 ms on lock 0x7b54000e4054. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f9aae01 00007fcc0f9a983e 00007fcc1496e419 00007fcc0dee5bd4 00007fcc0dee5b62 00007fcc0dee5a91 00007fcc0dee5a0c 00007fcc0dee4cc2 00007fcc0dce548c 00007fcc0dce48c6
0709 13:20:23.354306 (+   238us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":133240064}
W20260709 13:20:23.355731  7467 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:23.346549 11347 leader_election.cc:290] T f58dc08b12a2494bb9a1372837970ca2 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 16 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:23.370285 11289 raft_consensus.cc:515] T ce4f062dcd314d43a63ca74067cb5ee3 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } attrs { replace: true } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:20:23.358302 11507 leader_election.cc:290] T 4275cf08e63345f993bce8664eada830 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:23.375221 11289 leader_election.cc:290] T ce4f062dcd314d43a63ca74067cb5ee3 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 13 election: Requested vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:20:23.354401 11524 raft_consensus.cc:493] T 7887766dc6784fcaa42b35c05fea7a99 P cd75a17ab2604397adab03bb8b5fd75c [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:23.394609  7503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce4f062dcd314d43a63ca74067cb5ee3" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb"
W20260709 13:20:23.403028  6696 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:23.405021 11436 raft_consensus.cc:3055] T e31b9971c15848dea59d4d4130141d9e P cd75a17ab2604397adab03bb8b5fd75c [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:20:23.405627 11436 raft_consensus.cc:740] T e31b9971c15848dea59d4d4130141d9e P cd75a17ab2604397adab03bb8b5fd75c [term 10 LEADER]: Becoming Follower/Learner. State: Replica: cd75a17ab2604397adab03bb8b5fd75c, State: Running, Role: LEADER
I20260709 13:20:23.410969  6727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d9def8b32fd443aa94ab1420b06837b" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:20:23.411293  6724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22ccee1b570c4ad3a57bd7aec085b1b4" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:23.411844  6727 raft_consensus.cc:3060] T 4d9def8b32fd443aa94ab1420b06837b P ccd8a4c3bfe3413cb2ae219b09aea832 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:23.411900  6724 raft_consensus.cc:2468] T 22ccee1b570c4ad3a57bd7aec085b1b4 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 10.
I20260709 13:20:23.395232 11465 raft_consensus.cc:2749] T 4b8cacb381b746da8d0049b0a83b41dd P ccd8a4c3bfe3413cb2ae219b09aea832 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:20:23.413297  6728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "711ef6523deb4cbe8ef2ba61e1c21c98" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:20:23.413937  6728 raft_consensus.cc:3060] T 711ef6523deb4cbe8ef2ba61e1c21c98 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:23.416203 11481 raft_consensus.cc:3055] T 4f00a2e87e56452083b759f60d461ee3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:20:23.416735 11481 raft_consensus.cc:740] T 4f00a2e87e56452083b759f60d461ee3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 7ba59cc884714e8aa5f3f0ecaed84cbb, State: Running, Role: LEADER
I20260709 13:20:23.418505  6725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f9c2e2bf644115957398fe4c9459db" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:20:23.422138  6727 raft_consensus.cc:2468] T 4d9def8b32fd443aa94ab1420b06837b P ccd8a4c3bfe3413cb2ae219b09aea832 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 13.
I20260709 13:20:23.423247  6727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d33d5ee8ef6f415593d8df52063161ad" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:23.392835 11421 leader_election.cc:290] T 95a75bfe094d4bdc963aba3f08dfcd25 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 13 election: Requested vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:23.424651  6727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d65025eea89441290d85dd053810e31" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:23.426299  6727 raft_consensus.cc:2468] T 3d65025eea89441290d85dd053810e31 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 11.
I20260709 13:20:23.426604  6725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20f6842e26174571996b8dea4151d4be" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:23.428840  6726 raft_consensus.cc:1275] T b56bf91d90824c959e21e0cee5ba1816 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 12 FOLLOWER]: Refusing update from remote peer cd75a17ab2604397adab03bb8b5fd75c: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:20:23.430573  6731 raft_consensus.cc:1240] T 4b8cacb381b746da8d0049b0a83b41dd P ccd8a4c3bfe3413cb2ae219b09aea832 [term 14 FOLLOWER]: Rejecting Update request from peer cd75a17ab2604397adab03bb8b5fd75c for earlier term 13. Current term is 14. Ops: [13.11-13.11]
I20260709 13:20:23.432636  6730 raft_consensus.cc:1240] T f4b8bd455d5a47c18a1380839c6e0d61 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 12 FOLLOWER]: Rejecting Update request from peer cd75a17ab2604397adab03bb8b5fd75c for earlier term 11. Current term is 12. Ops: [11.7-11.7]
I20260709 13:20:23.397245 11513 raft_consensus.cc:2749] T 427c124d773f483294511e80fe340075 P b7ab4784c7344b939bc36f639286f377 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:20:23.433480  6723 raft_consensus.cc:1240] T 853ac0a8cbd64ce99457f170216d4d0f P ccd8a4c3bfe3413cb2ae219b09aea832 [term 10 LEADER]: Rejecting Update request from peer cd75a17ab2604397adab03bb8b5fd75c for earlier term 9. Current term is 10. Ops: [9.6-9.6]
I20260709 13:20:23.391987 11462 raft_consensus.cc:515] T d8292e16e5654be6bc408560cf256aaa P ccd8a4c3bfe3413cb2ae219b09aea832 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:23.437986  6728 raft_consensus.cc:2468] T 711ef6523deb4cbe8ef2ba61e1c21c98 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 14.
I20260709 13:20:23.438342  6724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab432e62819d499eaaf3dd55481dd930" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:23.430510 11315 raft_consensus.cc:2749] T 1bf4668eeb70467fb3dc5a0289233b3c P cd75a17ab2604397adab03bb8b5fd75c [term 13 FOLLOWER]: Leader election lost for term 12. Reason: Vote denied by peer b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817) with higher term. Message: Invalid argument: T 1bf4668eeb70467fb3dc5a0289233b3c P b7ab4784c7344b939bc36f639286f377 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c for earlier term 12. Current term is 13.
I20260709 13:20:23.428159 11517 raft_consensus.cc:493] T 4f00a2e87e56452083b759f60d461ee3 P cd75a17ab2604397adab03bb8b5fd75c [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 7ba59cc884714e8aa5f3f0ecaed84cbb)
I20260709 13:20:23.441649 11486 leader_election.cc:290] T 30e88460611e47b2ba16a46a30b5f416 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:23.441941 11300 consensus_queue.cc:260] T c4db81d9d329422bb3b4160ca4ac2d1d P ccd8a4c3bfe3413cb2ae219b09aea832 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:23.403028 11336 raft_consensus.cc:515] T bb7fa124c3bf4ef9ab65a407cb008441 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:20:23.406754 11436 consensus_queue.cc:260] T e31b9971c15848dea59d4d4130141d9e P cd75a17ab2604397adab03bb8b5fd75c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:23.443295 11300 raft_consensus.cc:3060] T c4db81d9d329422bb3b4160ca4ac2d1d P ccd8a4c3bfe3413cb2ae219b09aea832 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:20:23.430788 11316 raft_consensus.cc:515] T 24ee15416e3145beaa1b8183453729a3 P cd75a17ab2604397adab03bb8b5fd75c [term 15 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:20:23.443285 11481 consensus_queue.cc:260] T 4f00a2e87e56452083b759f60d461ee3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:20:23.444439 11517 raft_consensus.cc:515] T 4f00a2e87e56452083b759f60d461ee3 P cd75a17ab2604397adab03bb8b5fd75c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:20:23.454496  6624 catalog_manager.cc:5697] T 7ba5dac66ab5497e9e336f2a3c28cda5 P 7ba59cc884714e8aa5f3f0ecaed84cbb reported cstate change: term changed from 10 to 12, leader changed from b7ab4784c7344b939bc36f639286f377 (127.5.126.66) to 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68). New cstate: current_term: 12 leader_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:20:23.457113  6624 catalog_manager.cc:5697] T be1a92657f494cac8dd227d152f50151 P 7ba59cc884714e8aa5f3f0ecaed84cbb reported cstate change: term changed from 8 to 13, leader changed from ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65) to 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68). New cstate: current_term: 13 leader_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:20:23.450124 11481 raft_consensus.cc:3060] T 4f00a2e87e56452083b759f60d461ee3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:23.460142 11517 leader_election.cc:290] T 4f00a2e87e56452083b759f60d461ee3 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:20:23.463753  6727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c7f33e544204fbaac4078e3e83bbf4e" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 11 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:23.468642 11311 raft_consensus.cc:515] T fe20b4b48823486ca3b9c648db6ce8aa P ccd8a4c3bfe3413cb2ae219b09aea832 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:20:23.472959 11311 leader_election.cc:290] T fe20b4b48823486ca3b9c648db6ce8aa P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 11 election: Requested vote from peers cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:20:23.463230 11288 raft_consensus.cc:515] T 3fa34c08b205435dba97346991aa1f92 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:20:23.474759 11462 leader_election.cc:290] T d8292e16e5654be6bc408560cf256aaa P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 17 election: Requested vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:23.461329 11436 raft_consensus.cc:3060] T e31b9971c15848dea59d4d4130141d9e P cd75a17ab2604397adab03bb8b5fd75c [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:20:23.475222 11288 leader_election.cc:290] T 3fa34c08b205435dba97346991aa1f92 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 15 election: Requested vote from peers cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:20:23.470717 11336 leader_election.cc:290] T bb7fa124c3bf4ef9ab65a407cb008441 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 14 election: Requested vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:23.466892  6727 raft_consensus.cc:2410] T 8c7f33e544204fbaac4078e3e83bbf4e P ccd8a4c3bfe3413cb2ae219b09aea832 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c for term 11 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 13:20:23.459431  6624 catalog_manager.cc:5697] T 3fa34c08b205435dba97346991aa1f92 P 7ba59cc884714e8aa5f3f0ecaed84cbb reported cstate change: term changed from 10 to 12, leader changed from ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65) to 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68). New cstate: current_term: 12 leader_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:20:23.408694 11524 raft_consensus.cc:515] T 7887766dc6784fcaa42b35c05fea7a99 P cd75a17ab2604397adab03bb8b5fd75c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:23.481393  6802 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:32976 (request call id 2928) took 2047 ms. Trace:
I20260709 13:20:23.485065  7501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fa34c08b205435dba97346991aa1f92" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb"
I20260709 13:20:23.484367  7503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe20b4b48823486ca3b9c648db6ce8aa" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb"
I20260709 13:20:23.484985  6802 rpcz_store.cc:276] 0709 13:20:21.434101 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:21.434225 (+   124us) service_pool.cc:224] Handling call
0709 13:20:21.434546 (+   321us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:21.438047 (+  3501us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:20:21.682930 (+244883us) log.cc:844] Serialized 14 byte log entry
0709 13:20:22.347360 (+664430us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:20:22.347435 (+    75us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:20:22.347504 (+    69us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:23.481114 (+1133610us) spinlock_profiling.cc:243] Waited 3.27 ms on lock 0x7b540028aad4. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f9aae01 00007fcc0f9a983e 00007fcc1496e419 00007fcc0dee5bd4 00007fcc0dee5b62 00007fcc0dee5a91 00007fcc0dee5a0c 00007fcc0dee4cc2 00007fcc0dce548c 00007fcc0dce48c6
0709 13:20:23.481178 (+    64us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:23.481320 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":583496,"prepare.queue_time_us":291718,"prepare.run_cpu_time_us":66,"prepare.run_wall_time_us":4497,"raft.queue_time_us":540348,"raft.run_cpu_time_us":128,"raft.run_wall_time_us":3640,"spinlock_wait_cycles":7517440,"thread_start_us":360122,"threads_started":2,"wal-append.queue_time_us":256636,"wal-append.run_cpu_time_us":3814,"wal-append.run_wall_time_us":1092393}
I20260709 13:20:23.487336 11386 consensus_queue.cc:260] T bd6869f07b5a4885a0b99fbe60c3b175 P ccd8a4c3bfe3413cb2ae219b09aea832 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.6, Last appended by leader: 6, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:23.488657  6724 raft_consensus.cc:2468] T ab432e62819d499eaaf3dd55481dd930 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 14.
I20260709 13:20:23.488682 11386 raft_consensus.cc:3060] T bd6869f07b5a4885a0b99fbe60c3b175 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:23.490424 11316 leader_election.cc:290] T 24ee15416e3145beaa1b8183453729a3 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 15 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
W20260709 13:20:23.491454 11525 log.cc:927] Time spent T a3022224cc81473690653a83d4e99470 P b7ab4784c7344b939bc36f639286f377: Append to log took a long time: real 0.092s	user 0.001s	sys 0.000s
I20260709 13:20:23.497836 11442 consensus_queue.cc:260] T f4b8bd455d5a47c18a1380839c6e0d61 P cd75a17ab2604397adab03bb8b5fd75c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:23.490461 11450 leader_election.cc:290] T 7a734b5ab7834e05a8c422208acc58b1 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:20:23.500562 11442 raft_consensus.cc:3060] T f4b8bd455d5a47c18a1380839c6e0d61 P cd75a17ab2604397adab03bb8b5fd75c [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:20:23.499024 11211 raft_consensus.cc:493] T 1528ab62b6fe4e3099d08f141afee116 P b7ab4784c7344b939bc36f639286f377 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 7ba59cc884714e8aa5f3f0ecaed84cbb)
W20260709 13:20:23.499950 11526 log.cc:927] Time spent T 1bf4668eeb70467fb3dc5a0289233b3c P b7ab4784c7344b939bc36f639286f377: Append to log took a long time: real 0.064s	user 0.000s	sys 0.001s
W20260709 13:20:23.507972  6698 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:23.508791  6727 raft_consensus.cc:1275] T f58dc08b12a2494bb9a1372837970ca2 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 15 FOLLOWER]: Refusing update from remote peer cd75a17ab2604397adab03bb8b5fd75c: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 13:20:23.510258 11326 leader_election.cc:290] T 7887766dc6784fcaa42b35c05fea7a99 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:23.512786  6729 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50004 (request call id 2173) took 1449 ms. Trace:
I20260709 13:20:23.513146  6729 rpcz_store.cc:276] 0709 13:20:22.063080 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:22.069356 (+  6276us) service_pool.cc:224] Handling call
0709 13:20:22.069747 (+   391us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:22.857196 (+787449us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:23.512534 (+655338us) spinlock_profiling.cc:243] Waited 758 ms on lock 0x7b54003958d4. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f9aae01 00007fcc0f9a983e 00007fcc1496e419 00007fcc0dee5bd4 00007fcc0dee5b62 00007fcc0dee5a91 00007fcc0dee5a0c 00007fcc0dee4cc2 00007fcc0dce548c 00007fcc0dce48c6
0709 13:20:23.512730 (+   196us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1743396096}
I20260709 13:20:23.514139  6732 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49998 (request call id 1118) took 1011 ms. Trace:
I20260709 13:20:23.514734  6732 rpcz_store.cc:276] 0709 13:20:22.502828 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:22.512948 (+ 10120us) service_pool.cc:224] Handling call
0709 13:20:22.513369 (+   421us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:23.049268 (+535899us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:23.513859 (+464591us) spinlock_profiling.cc:243] Waited 535 ms on lock 0x7b5400098dd4. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f9aae01 00007fcc0f9a983e 00007fcc1496e419 00007fcc0dee5bd4 00007fcc0dee5b62 00007fcc0dee5a91 00007fcc0dee5a0c 00007fcc0dee4cc2 00007fcc0dce548c 00007fcc0dce48c6
0709 13:20:23.514066 (+   207us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1230811008}
I20260709 13:20:23.518715 11339 raft_consensus.cc:3060] T be1a92657f494cac8dd227d152f50151 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:23.518911 11118 raft_consensus.cc:493] T 9e326172347f45e99a0d482b5d8ef768 P b7ab4784c7344b939bc36f639286f377 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:20:23.519590 11118 raft_consensus.cc:515] T 9e326172347f45e99a0d482b5d8ef768 P b7ab4784c7344b939bc36f639286f377 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:23.521803  6876 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53416 (request call id 2999) took 1116 ms. Trace:
I20260709 13:20:23.523103  6802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d65025eea89441290d85dd053810e31" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:23.524734  6807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17587d6730594da4a56fa13a353232a1" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:23.522290 11118 leader_election.cc:290] T 9e326172347f45e99a0d482b5d8ef768 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:23.525385  6807 raft_consensus.cc:2468] T 17587d6730594da4a56fa13a353232a1 P b7ab4784c7344b939bc36f639286f377 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 17.
I20260709 13:20:23.521968 11300 raft_consensus.cc:493] T b3f13b31a1f84f0d89d007eadd57924c P ccd8a4c3bfe3413cb2ae219b09aea832 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 7ba59cc884714e8aa5f3f0ecaed84cbb)
I20260709 13:20:23.526244 11300 raft_consensus.cc:515] T b3f13b31a1f84f0d89d007eadd57924c P ccd8a4c3bfe3413cb2ae219b09aea832 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:20:23.526741 11172 raft_consensus.cc:493] T de3186201e1a40d0b335eeb8b4e256e0 P b7ab4784c7344b939bc36f639286f377 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:23.527506 11172 raft_consensus.cc:515] T de3186201e1a40d0b335eeb8b4e256e0 P b7ab4784c7344b939bc36f639286f377 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:23.530315 11252 consensus_queue.cc:1059] T 34f36d59d88f40fe8a2805e604fc6c0a P b7ab4784c7344b939bc36f639286f377 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:20:23.531638 11341 raft_consensus.cc:3055] T 34f36d59d88f40fe8a2805e604fc6c0a P b7ab4784c7344b939bc36f639286f377 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:20:23.532063 11341 raft_consensus.cc:740] T 34f36d59d88f40fe8a2805e604fc6c0a P b7ab4784c7344b939bc36f639286f377 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
I20260709 13:20:23.532898 11341 consensus_queue.cc:260] T 34f36d59d88f40fe8a2805e604fc6c0a P b7ab4784c7344b939bc36f639286f377 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:23.522295  6876 rpcz_store.cc:276] 0709 13:20:22.405431 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:22.405873 (+   442us) service_pool.cc:224] Handling call
0709 13:20:23.521539 (+1115666us) spinlock_profiling.cc:243] Waited 514 ms on lock 0x7b54000d1e54. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f9ae2fa 00007fcc1496fb17 00007fcc0deea6d4 00007fcc0deea662 00007fcc0deea591 00007fcc0deea50c 00007fcc0dee97c2 00007fcc0dce548c 00007fcc0dce48c6 00007fcc0dce426f
0709 13:20:23.521702 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1181405952}
I20260709 13:20:23.525532 11468 raft_consensus.cc:493] T f5be3a11b23d4ea9b08300a2789821c7 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:23.534155 11341 raft_consensus.cc:3060] T 34f36d59d88f40fe8a2805e604fc6c0a P b7ab4784c7344b939bc36f639286f377 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:20:23.536499  6876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b8cacb381b746da8d0049b0a83b41dd" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:20:23.537400  6732 raft_consensus.cc:1275] T 8c7f33e544204fbaac4078e3e83bbf4e P ccd8a4c3bfe3413cb2ae219b09aea832 [term 10 FOLLOWER]: Refusing update from remote peer b7ab4784c7344b939bc36f639286f377: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 6. (term mismatch)
I20260709 13:20:23.538017  6732 pending_rounds.cc:85] T 8c7f33e544204fbaac4078e3e83bbf4e P ccd8a4c3bfe3413cb2ae219b09aea832: Aborting all ops after (but not including) 5
I20260709 13:20:23.538338  6732 pending_rounds.cc:107] T 8c7f33e544204fbaac4078e3e83bbf4e P ccd8a4c3bfe3413cb2ae219b09aea832: Aborting uncommitted NO_OP operation due to leader change: 9.6
I20260709 13:20:23.538364  6799 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "853ac0a8cbd64ce99457f170216d4d0f"
dest_uuid: "b7ab4784c7344b939bc36f639286f377"
mode: GRACEFUL
new_leader_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
 from {username='slave'} at 127.0.0.1:38240
I20260709 13:20:23.539090  6732 raft_consensus.cc:2889] T 8c7f33e544204fbaac4078e3e83bbf4e P ccd8a4c3bfe3413cb2ae219b09aea832 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:20:23.539448  6799 raft_consensus.cc:606] T 853ac0a8cbd64ce99457f170216d4d0f P b7ab4784c7344b939bc36f639286f377 [term 10 FOLLOWER]: Received request to transfer leadership to TS cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:20:23.539872  6799 raft_consensus.cc:614] T 853ac0a8cbd64ce99457f170216d4d0f P b7ab4784c7344b939bc36f639286f377 [term 10 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:20:23.540993  6732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3f13b31a1f84f0d89d007eadd57924c" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:23.541961  6732 raft_consensus.cc:2468] T b3f13b31a1f84f0d89d007eadd57924c P ccd8a4c3bfe3413cb2ae219b09aea832 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 11.
I20260709 13:20:23.544064  6732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c37d41cd9164c15a6826ca62a851a69" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:23.530375 11172 leader_election.cc:290] T de3186201e1a40d0b335eeb8b4e256e0 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:23.534557 11468 raft_consensus.cc:515] T f5be3a11b23d4ea9b08300a2789821c7 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:23.546097  6732 raft_consensus.cc:2468] T 7c37d41cd9164c15a6826ca62a851a69 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 11.
I20260709 13:20:23.546288  6876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce4f062dcd314d43a63ca74067cb5ee3" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:23.547068  6876 raft_consensus.cc:2468] T ce4f062dcd314d43a63ca74067cb5ee3 P cd75a17ab2604397adab03bb8b5fd75c [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in term 12.
I20260709 13:20:23.550439  5625 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 13:20:23.550889  6875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77e330a82df4b43a745d57a68f6f057" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:23.560931  7503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3f13b31a1f84f0d89d007eadd57924c" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:20:23.559692 11300 leader_election.cc:290] T b3f13b31a1f84f0d89d007eadd57924c P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:20:23.566841  7502 raft_consensus.cc:2468] T be1a92657f494cac8dd227d152f50151 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 14.
I20260709 13:20:23.568302  6732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be1a92657f494cac8dd227d152f50151" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:23.585925  6873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f58dc08b12a2494bb9a1372837970ca2" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:23.573889  7468 leader_election.cc:304] T ce4f062dcd314d43a63ca74067cb5ee3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377
I20260709 13:20:23.586647  6732 raft_consensus.cc:2468] T be1a92657f494cac8dd227d152f50151 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 13.
I20260709 13:20:23.589242  6803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb7fa124c3bf4ef9ab65a407cb008441" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:23.590219  6803 raft_consensus.cc:2468] T bb7fa124c3bf4ef9ab65a407cb008441 P b7ab4784c7344b939bc36f639286f377 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in term 13.
I20260709 13:20:23.592314  6807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb7fa124c3bf4ef9ab65a407cb008441" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:20:23.593048  6807 raft_consensus.cc:3060] T bb7fa124c3bf4ef9ab65a407cb008441 P b7ab4784c7344b939bc36f639286f377 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:23.572175  6875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bf4668eeb70467fb3dc5a0289233b3c" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:20:23.594060  6799 raft_consensus.cc:1240] T 7ba5dac66ab5497e9e336f2a3c28cda5 P b7ab4784c7344b939bc36f639286f377 [term 13 FOLLOWER]: Rejecting Update request from peer 7ba59cc884714e8aa5f3f0ecaed84cbb for earlier term 12. Current term is 13. Ops: []
I20260709 13:20:23.594694  6876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8cee0accdb8499c86d4414b72565a38" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:23.596377  6802 raft_consensus.cc:1240] T 4f00a2e87e56452083b759f60d461ee3 P b7ab4784c7344b939bc36f639286f377 [term 13 FOLLOWER]: Rejecting Update request from peer 7ba59cc884714e8aa5f3f0ecaed84cbb for earlier term 12. Current term is 13. Ops: []
I20260709 13:20:23.592952  6697 leader_election.cc:304] T 17587d6730594da4a56fa13a353232a1 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
I20260709 13:20:23.595207  6876 raft_consensus.cc:2468] T d8cee0accdb8499c86d4414b72565a38 P cd75a17ab2604397adab03bb8b5fd75c [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in term 13.
I20260709 13:20:23.492970 11491 raft_consensus.cc:515] T 90d42e216d9741e190bca19a781291fd P ccd8a4c3bfe3413cb2ae219b09aea832 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:23.601692 11386 raft_consensus.cc:2804] T 17587d6730594da4a56fa13a353232a1 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:20:23.602242 11386 raft_consensus.cc:493] T 17587d6730594da4a56fa13a353232a1 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:23.602631 11386 raft_consensus.cc:3060] T 17587d6730594da4a56fa13a353232a1 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:20:23.574812  6844 leader_election.cc:304] T 22ccee1b570c4ad3a57bd7aec085b1b4 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:20:23.604950  6844 leader_election.cc:304] T 4d9def8b32fd443aa94ab1420b06837b P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377
I20260709 13:20:23.596208 11277 raft_consensus.cc:493] T b56bf91d90824c959e21e0cee5ba1816 P b7ab4784c7344b939bc36f639286f377 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:23.611311  6873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb7fa124c3bf4ef9ab65a407cb008441" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:20:23.612335  6873 raft_consensus.cc:3060] T bb7fa124c3bf4ef9ab65a407cb008441 P cd75a17ab2604397adab03bb8b5fd75c [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:23.550475 11468 leader_election.cc:290] T f5be3a11b23d4ea9b08300a2789821c7 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:23.536266 11211 raft_consensus.cc:515] T 1528ab62b6fe4e3099d08f141afee116 P b7ab4784c7344b939bc36f639286f377 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:20:23.587632 11336 raft_consensus.cc:493] T be1a92657f494cac8dd227d152f50151 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:23.587442 11450 raft_consensus.cc:493] T c4db81d9d329422bb3b4160ca4ac2d1d P cd75a17ab2604397adab03bb8b5fd75c [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:23.604081 11339 raft_consensus.cc:2804] T ce4f062dcd314d43a63ca74067cb5ee3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:20:23.608827 11316 raft_consensus.cc:2804] T 22ccee1b570c4ad3a57bd7aec085b1b4 P cd75a17ab2604397adab03bb8b5fd75c [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:20:23.609927 11517 raft_consensus.cc:2804] T 4d9def8b32fd443aa94ab1420b06837b P cd75a17ab2604397adab03bb8b5fd75c [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:20:23.620118 11277 raft_consensus.cc:515] T b56bf91d90824c959e21e0cee5ba1816 P b7ab4784c7344b939bc36f639286f377 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:23.625279  6807 raft_consensus.cc:2468] T bb7fa124c3bf4ef9ab65a407cb008441 P b7ab4784c7344b939bc36f639286f377 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in term 14.
I20260709 13:20:23.632980  7466 leader_election.cc:304] T bb7fa124c3bf4ef9ab65a407cb008441 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, b7ab4784c7344b939bc36f639286f377; no voters: 
I20260709 13:20:23.635473  6875 raft_consensus.cc:2468] T 1bf4668eeb70467fb3dc5a0289233b3c P cd75a17ab2604397adab03bb8b5fd75c [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 13.
I20260709 13:20:23.636569  6875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f00a2e87e56452083b759f60d461ee3" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:20:23.637080  6875 raft_consensus.cc:3060] T 4f00a2e87e56452083b759f60d461ee3 P cd75a17ab2604397adab03bb8b5fd75c [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:23.623359 11339 raft_consensus.cc:493] T ce4f062dcd314d43a63ca74067cb5ee3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 12 FOLLOWER]: Starting leader election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:20:23.627839 11316 raft_consensus.cc:493] T 22ccee1b570c4ad3a57bd7aec085b1b4 P cd75a17ab2604397adab03bb8b5fd75c [term 10 FOLLOWER]: Starting leader election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:20:23.649847  6873 raft_consensus.cc:2468] T bb7fa124c3bf4ef9ab65a407cb008441 P cd75a17ab2604397adab03bb8b5fd75c [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in term 14.
I20260709 13:20:23.623488 11450 raft_consensus.cc:515] T c4db81d9d329422bb3b4160ca4ac2d1d P cd75a17ab2604397adab03bb8b5fd75c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:23.623828 11336 raft_consensus.cc:515] T be1a92657f494cac8dd227d152f50151 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:20:23.654924  6875 raft_consensus.cc:2468] T 4f00a2e87e56452083b759f60d461ee3 P cd75a17ab2604397adab03bb8b5fd75c [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 13.
I20260709 13:20:23.609086 11423 consensus_queue.cc:1059] T 7ba5dac66ab5497e9e336f2a3c28cda5 P 7ba59cc884714e8aa5f3f0ecaed84cbb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.019s
I20260709 13:20:23.640755 11481 raft_consensus.cc:2804] T bb7fa124c3bf4ef9ab65a407cb008441 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:20:23.658344  6875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24ee15416e3145beaa1b8183453729a3" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:23.646615 11339 raft_consensus.cc:3060] T ce4f062dcd314d43a63ca74067cb5ee3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:23.647871 11524 leader_election.cc:290] T 7887766dc6784fcaa42b35c05fea7a99 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:20:23.686419  6874 raft_consensus.cc:1275] T 8c7f33e544204fbaac4078e3e83bbf4e P cd75a17ab2604397adab03bb8b5fd75c [term 10 FOLLOWER]: Refusing update from remote peer b7ab4784c7344b939bc36f639286f377: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:20:23.687736  6874 raft_consensus.cc:1275] T 7887766dc6784fcaa42b35c05fea7a99 P cd75a17ab2604397adab03bb8b5fd75c [term 13 FOLLOWER]: Refusing update from remote peer b7ab4784c7344b939bc36f639286f377: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 13:20:23.688438  6844 leader_election.cc:304] T 3d65025eea89441290d85dd053810e31 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:20:23.668609 11371 raft_consensus.cc:493] T dbdf895bba214ff68685a24fd17dfb5d P ccd8a4c3bfe3413cb2ae219b09aea832 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:20:23.689363  6844 leader_election.cc:304] T 711ef6523deb4cbe8ef2ba61e1c21c98 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377
I20260709 13:20:23.689424 11371 raft_consensus.cc:515] T dbdf895bba214ff68685a24fd17dfb5d P ccd8a4c3bfe3413cb2ae219b09aea832 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:23.690182 11436 raft_consensus.cc:2804] T 3d65025eea89441290d85dd053810e31 P cd75a17ab2604397adab03bb8b5fd75c [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:20:23.690573 11436 raft_consensus.cc:493] T 3d65025eea89441290d85dd053810e31 P cd75a17ab2604397adab03bb8b5fd75c [term 11 FOLLOWER]: Starting leader election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:20:23.683424 11066 raft_consensus.cc:3055] T 4b8cacb381b746da8d0049b0a83b41dd P cd75a17ab2604397adab03bb8b5fd75c [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:20:23.691370 11066 raft_consensus.cc:740] T 4b8cacb381b746da8d0049b0a83b41dd P cd75a17ab2604397adab03bb8b5fd75c [term 13 LEADER]: Becoming Follower/Learner. State: Replica: cd75a17ab2604397adab03bb8b5fd75c, State: Running, Role: LEADER
I20260709 13:20:23.639593 11517 raft_consensus.cc:697] T 4d9def8b32fd443aa94ab1420b06837b P cd75a17ab2604397adab03bb8b5fd75c [term 13 LEADER]: Becoming Leader. State: Replica: cd75a17ab2604397adab03bb8b5fd75c, State: Running, Role: LEADER
I20260709 13:20:23.648718 11316 raft_consensus.cc:3060] T 22ccee1b570c4ad3a57bd7aec085b1b4 P cd75a17ab2604397adab03bb8b5fd75c [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:20:23.696192 11517 consensus_queue.cc:237] T 4d9def8b32fd443aa94ab1420b06837b P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.6, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:23.699396 11524 consensus_queue.cc:1048] T b56bf91d90824c959e21e0cee5ba1816 P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Connected to new peer: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:20:23.690732 11476 raft_consensus.cc:2804] T 711ef6523deb4cbe8ef2ba61e1c21c98 P cd75a17ab2604397adab03bb8b5fd75c [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:20:23.701224 11476 raft_consensus.cc:697] T 711ef6523deb4cbe8ef2ba61e1c21c98 P cd75a17ab2604397adab03bb8b5fd75c [term 14 LEADER]: Becoming Leader. State: Replica: cd75a17ab2604397adab03bb8b5fd75c, State: Running, Role: LEADER
I20260709 13:20:23.669067  6873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24ee15416e3145beaa1b8183453729a3" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:20:23.677364 11450 leader_election.cc:290] T c4db81d9d329422bb3b4160ca4ac2d1d P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:20:23.677810 11481 raft_consensus.cc:697] T bb7fa124c3bf4ef9ab65a407cb008441 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 14 LEADER]: Becoming Leader. State: Replica: 7ba59cc884714e8aa5f3f0ecaed84cbb, State: Running, Role: LEADER
I20260709 13:20:23.678125 11211 leader_election.cc:290] T 1528ab62b6fe4e3099d08f141afee116 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:20:23.678874 11491 leader_election.cc:290] T 90d42e216d9741e190bca19a781291fd P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 13 election: Requested vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
W20260709 13:20:23.679536  6881 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53416 (request call id 2998) took 1275 ms (client timeout 1552 ms). Trace:
I20260709 13:20:23.682611 11439 raft_consensus.cc:3055] T 853ac0a8cbd64ce99457f170216d4d0f P cd75a17ab2604397adab03bb8b5fd75c [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:20:23.679561  7503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1528ab62b6fe4e3099d08f141afee116" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:20:23.683025  6872 raft_consensus.cc:1240] T 4f00a2e87e56452083b759f60d461ee3 P cd75a17ab2604397adab03bb8b5fd75c [term 13 FOLLOWER]: Rejecting Update request from peer 7ba59cc884714e8aa5f3f0ecaed84cbb for earlier term 12. Current term is 13. Ops: []
I20260709 13:20:23.683091  6729 raft_consensus.cc:1240] T d8292e16e5654be6bc408560cf256aaa P ccd8a4c3bfe3413cb2ae219b09aea832 [term 17 FOLLOWER]: Rejecting Update request from peer b7ab4784c7344b939bc36f639286f377 for earlier term 16. Current term is 17. Ops: [16.10-16.10]
I20260709 13:20:23.683857 11354 raft_consensus.cc:3055] T a1704639a875409b9959353527b3fd68 P b7ab4784c7344b939bc36f639286f377 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:20:23.690955 11436 raft_consensus.cc:3060] T 3d65025eea89441290d85dd053810e31 P cd75a17ab2604397adab03bb8b5fd75c [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:20:23.647322 11527 log.cc:927] Time spent T f09c2a98de1a4decabd0ff900dd44caa P b7ab4784c7344b939bc36f639286f377: Append to log took a long time: real 0.115s	user 0.001s	sys 0.000s
I20260709 13:20:23.692245 11066 consensus_queue.cc:260] T 4b8cacb381b746da8d0049b0a83b41dd P cd75a17ab2604397adab03bb8b5fd75c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:20:23.695583  6723 raft_consensus.cc:1240] T 3fa34c08b205435dba97346991aa1f92 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 15 FOLLOWER]: Rejecting Update request from peer 7ba59cc884714e8aa5f3f0ecaed84cbb for earlier term 14. Current term is 15. Ops: []
I20260709 13:20:23.700690  6874 raft_consensus.cc:1240] T f3f9c2e2bf644115957398fe4c9459db P cd75a17ab2604397adab03bb8b5fd75c [term 12 FOLLOWER]: Rejecting Update request from peer b7ab4784c7344b939bc36f639286f377 for earlier term 11. Current term is 12. Ops: []
I20260709 13:20:23.669024  6875 raft_consensus.cc:2368] T 24ee15416e3145beaa1b8183453729a3 P cd75a17ab2604397adab03bb8b5fd75c [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ba59cc884714e8aa5f3f0ecaed84cbb for earlier term 14. Current term is 15.
I20260709 13:20:23.713305 11524 consensus_queue.cc:1048] T f58dc08b12a2494bb9a1372837970ca2 P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Connected to new peer: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:20:23.733772  6875 raft_consensus.cc:1240] T dbdf895bba214ff68685a24fd17dfb5d P cd75a17ab2604397adab03bb8b5fd75c [term 11 FOLLOWER]: Rejecting Update request from peer b7ab4784c7344b939bc36f639286f377 for earlier term 10. Current term is 11. Ops: []
I20260709 13:20:23.734736  6874 raft_consensus.cc:1240] T 2c240553ce044eedb41541d72b9475d7 P cd75a17ab2604397adab03bb8b5fd75c [term 14 FOLLOWER]: Rejecting Update request from peer b7ab4784c7344b939bc36f639286f377 for earlier term 13. Current term is 14. Ops: [13.8-13.8]
I20260709 13:20:23.667840 11300 raft_consensus.cc:493] T bd6869f07b5a4885a0b99fbe60c3b175 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:23.725056  6872 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58592 (request call id 370) took 1231 ms. Trace:
I20260709 13:20:23.725831  6729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b8cacb381b746da8d0049b0a83b41dd" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
W20260709 13:20:23.721786  6881 rpcz_store.cc:269] 0709 13:20:22.403949 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:22.404183 (+   234us) service_pool.cc:224] Handling call
0709 13:20:23.679330 (+1275147us) spinlock_profiling.cc:243] Waited 37 ms on lock 0x7b540039add4. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f9ae2fa 00007fcc1496fb17 00007fcc0deea6d4 00007fcc0deea662 00007fcc0deea591 00007fcc0deea50c 00007fcc0dee97c2 00007fcc0dce548c 00007fcc0dce48c6 00007fcc0dce426f
0709 13:20:23.679466 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":85151488}
I20260709 13:20:23.737259  6872 rpcz_store.cc:276] 0709 13:20:22.493383 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:23.682507 (+1189124us) service_pool.cc:224] Handling call
0709 13:20:23.682839 (+   332us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:23.724730 (+ 41891us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:23.724989 (+   259us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:20:23.692811 11371 leader_election.cc:290] T dbdf895bba214ff68685a24fd17dfb5d P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:23.738602  6874 raft_consensus.cc:1275] T d8292e16e5654be6bc408560cf256aaa P cd75a17ab2604397adab03bb8b5fd75c [term 16 FOLLOWER]: Refusing update from remote peer b7ab4784c7344b939bc36f639286f377: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:20:23.742365  6874 raft_consensus.cc:1275] T 07a92dd554674067a83a9cb68c4773f2 P cd75a17ab2604397adab03bb8b5fd75c [term 12 FOLLOWER]: Refusing update from remote peer b7ab4784c7344b939bc36f639286f377: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:20:23.754982  6876 raft_consensus.cc:1275] T 7a734b5ab7834e05a8c422208acc58b1 P cd75a17ab2604397adab03bb8b5fd75c [term 13 FOLLOWER]: Refusing update from remote peer b7ab4784c7344b939bc36f639286f377: Log matching property violated. Preceding OpId in replica: term: 9 index: 4. Preceding OpId from leader: term: 13 index: 5. (index mismatch)
I20260709 13:20:23.756474  6800 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:32966 (request call id 1139) took 1977 ms. Trace:
I20260709 13:20:23.756260 11481 consensus_queue.cc:237] T bb7fa124c3bf4ef9ab65a407cb008441 P 7ba59cc884714e8aa5f3f0ecaed84cbb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:20:23.756891  6800 rpcz_store.cc:276] 0709 13:20:21.779050 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:21.844372 (+ 65322us) service_pool.cc:224] Handling call
0709 13:20:21.844940 (+   568us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:22.352238 (+507298us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:22.352265 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:20:22.352789 (+   524us) log.cc:844] Serialized 26 byte log entry
0709 13:20:23.339402 (+986613us) spinlock_profiling.cc:243] Waited 13.7 ms on lock 0x7b18002942e0. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc15785de1 00007fcc157925b1 00007fcc0c89fe07 00007fcc156faab9 00007fcc0c8bc69b 00007fcc0c8ba93f 00007fcc0c8bcc02 00007fcc0f54420b 00007fcc0f549d23 00007fcc0f54a0d1 00007fcc0f965a0f
0709 13:20:23.420700 (+ 81298us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:20:23.420743 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:23.420842 (+    99us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:23.756121 (+335279us) raft_consensus.cc:1685] finished
0709 13:20:23.756149 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:23.756401 (+   252us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":538093,"raft.queue_time_us":520582,"raft.run_cpu_time_us":152,"raft.run_wall_time_us":21678,"spinlock_wait_cycles":31535104,"thread_start_us":81090,"threads_started":1,"wal-append.queue_time_us":1087829}
I20260709 13:20:23.724285 11439 raft_consensus.cc:740] T 853ac0a8cbd64ce99457f170216d4d0f P cd75a17ab2604397adab03bb8b5fd75c [term 9 LEADER]: Becoming Follower/Learner. State: Replica: cd75a17ab2604397adab03bb8b5fd75c, State: Running, Role: LEADER
I20260709 13:20:23.711803 11466 consensus_queue.cc:1059] T 853ac0a8cbd64ce99457f170216d4d0f P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.028s
I20260709 13:20:23.759086 11466 consensus_queue.cc:1243] T 853ac0a8cbd64ce99457f170216d4d0f P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Peer ccd8a4c3bfe3413cb2ae219b09aea832 log is divergent from this leader: its last log entry 10.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 13:20:23.761420 11386 raft_consensus.cc:515] T 17587d6730594da4a56fa13a353232a1 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:20:23.761860 11423 consensus_queue.cc:1059] T 3fa34c08b205435dba97346991aa1f92 P 7ba59cc884714e8aa5f3f0ecaed84cbb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: INVALID_TERM, Last received: 14.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:20:23.762938 11240 raft_consensus.cc:3055] T 3fa34c08b205435dba97346991aa1f92 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:20:23.763326 11240 raft_consensus.cc:740] T 3fa34c08b205435dba97346991aa1f92 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 7ba59cc884714e8aa5f3f0ecaed84cbb, State: Running, Role: LEADER
I20260709 13:20:23.763870  7502 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50742 (request call id 448) took 1320 ms. Trace:
I20260709 13:20:23.764219 11240 consensus_queue.cc:260] T 3fa34c08b205435dba97346991aa1f92 P 7ba59cc884714e8aa5f3f0ecaed84cbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:20:23.765223 11240 raft_consensus.cc:3060] T 3fa34c08b205435dba97346991aa1f92 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:23.766038 11386 leader_election.cc:290] T 17587d6730594da4a56fa13a353232a1 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 18 election: Requested vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:20:23.765122  6727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4db81d9d329422bb3b4160ca4ac2d1d" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 13 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:23.767210  6727 raft_consensus.cc:2410] T c4db81d9d329422bb3b4160ca4ac2d1d P ccd8a4c3bfe3413cb2ae219b09aea832 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c for term 13 because replica has last-logged OpId of term: 11 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
I20260709 13:20:23.762632 11316 raft_consensus.cc:515] T 22ccee1b570c4ad3a57bd7aec085b1b4 P cd75a17ab2604397adab03bb8b5fd75c [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:23.759764  6723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24ee15416e3145beaa1b8183453729a3" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:20:23.702196 11476 consensus_queue.cc:237] T 711ef6523deb4cbe8ef2ba61e1c21c98 P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:23.768589  6723 raft_consensus.cc:3060] T 24ee15416e3145beaa1b8183453729a3 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:23.770216  6727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7887766dc6784fcaa42b35c05fea7a99" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 14 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:23.772004  6727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a734b5ab7834e05a8c422208acc58b1" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 14 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:23.772861  6727 raft_consensus.cc:2410] T 7a734b5ab7834e05a8c422208acc58b1 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c for term 14 because replica has last-logged OpId of term: 13 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 4.
I20260709 13:20:23.774417  6727 raft_consensus.cc:1240] T fe20b4b48823486ca3b9c648db6ce8aa P ccd8a4c3bfe3413cb2ae219b09aea832 [term 11 FOLLOWER]: Rejecting Update request from peer 7ba59cc884714e8aa5f3f0ecaed84cbb for earlier term 10. Current term is 11. Ops: []
I20260709 13:20:23.776412 11423 consensus_queue.cc:1059] T fe20b4b48823486ca3b9c648db6ce8aa P 7ba59cc884714e8aa5f3f0ecaed84cbb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:20:23.777524 11464 raft_consensus.cc:3055] T fe20b4b48823486ca3b9c648db6ce8aa P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:20:23.777952 11464 raft_consensus.cc:740] T fe20b4b48823486ca3b9c648db6ce8aa P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 7ba59cc884714e8aa5f3f0ecaed84cbb, State: Running, Role: LEADER
I20260709 13:20:23.779079 11464 consensus_queue.cc:260] T fe20b4b48823486ca3b9c648db6ce8aa P 7ba59cc884714e8aa5f3f0ecaed84cbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:20:23.740008 11503 consensus_queue.cc:1059] T 4b8cacb381b746da8d0049b0a83b41dd P cd75a17ab2604397adab03bb8b5fd75c [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.043s
I20260709 13:20:23.728250 11354 raft_consensus.cc:740] T a1704639a875409b9959353527b3fd68 P b7ab4784c7344b939bc36f639286f377 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
I20260709 13:20:23.781966 11354 consensus_queue.cc:260] T a1704639a875409b9959353527b3fd68 P b7ab4784c7344b939bc36f639286f377 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:23.783157 11354 raft_consensus.cc:3060] T a1704639a875409b9959353527b3fd68 P b7ab4784c7344b939bc36f639286f377 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:23.783476 11464 raft_consensus.cc:3060] T fe20b4b48823486ca3b9c648db6ce8aa P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:20:23.786947  6875 raft_consensus.cc:1240] T 22ccee1b570c4ad3a57bd7aec085b1b4 P cd75a17ab2604397adab03bb8b5fd75c [term 11 FOLLOWER]: Rejecting Update request from peer b7ab4784c7344b939bc36f639286f377 for earlier term 10. Current term is 11. Ops: []
I20260709 13:20:23.795504  6729 raft_consensus.cc:2468] T 4b8cacb381b746da8d0049b0a83b41dd P ccd8a4c3bfe3413cb2ae219b09aea832 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in term 14.
I20260709 13:20:23.730415 11510 consensus_queue.cc:1059] T f09c2a98de1a4decabd0ff900dd44caa P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.056s
I20260709 13:20:23.797833  7466 leader_election.cc:304] T 4b8cacb381b746da8d0049b0a83b41dd P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:20:23.798703  6872 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3d65025eea89441290d85dd053810e31"
dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
 from {username='slave'} at 127.0.0.1:53406
I20260709 13:20:23.799654 11277 leader_election.cc:290] T b56bf91d90824c959e21e0cee5ba1816 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
W20260709 13:20:23.801587 11496 log.cc:927] Time spent T ce4f062dcd314d43a63ca74067cb5ee3 P 7ba59cc884714e8aa5f3f0ecaed84cbb: Append to log took a long time: real 0.803s	user 0.003s	sys 0.000s
I20260709 13:20:23.804652  7496 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50744 (request call id 358) took 1532 ms. Trace:
W20260709 13:20:23.805359  6696 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:23.805052  7496 rpcz_store.cc:276] 0709 13:20:22.272349 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:22.286733 (+ 14384us) service_pool.cc:224] Handling call
0709 13:20:22.287303 (+   570us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:22.287778 (+   475us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:22.287823 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:20:22.288499 (+   676us) log.cc:844] Serialized 26 byte log entry
0709 13:20:22.856625 (+568126us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:20:22.856686 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:22.856806 (+   120us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:23.800978 (+944172us) spinlock_profiling.cc:243] Waited 1.31 ms on lock 0x7b4400022b4c. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0c745db1 00007fcc0c7e3c85 00007fcc0c7e46a2 00007fcc0f5561db 00007fcc0f551aaf 00007fcc0f54586e 00007fcc0f544bb6 00007fcc0f5447d8 00007fcc0f54e221 00007fcc0f54e1d9 00007fcc0f54e169
0709 13:20:23.804340 (+  3362us) raft_consensus.cc:1685] finished
0709 13:20:23.804360 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:23.804586 (+   226us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":124,"raft.run_cpu_time_us":107,"raft.run_wall_time_us":110,"spinlock_wait_cycles":3002624,"thread_start_us":567197,"threads_started":1,"wal-append.queue_time_us":654262}
I20260709 13:20:23.764250  7502 rpcz_store.cc:276] 0709 13:20:22.443217 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:22.443475 (+   258us) service_pool.cc:224] Handling call
0709 13:20:23.763696 (+1320221us) spinlock_profiling.cc:243] Waited 1.1 s on lock 0x7b5400604d54. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f9ae2fa 00007fcc1496fb17 00007fcc0deea6d4 00007fcc0deea662 00007fcc0deea591 00007fcc0deea50c 00007fcc0dee97c2 00007fcc0dce548c 00007fcc0dce48c6 00007fcc0dce426f
0709 13:20:23.763814 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2526219648}
I20260709 13:20:23.798014  6732 raft_consensus.cc:1240] T bb3d8792045a4583ae2e965b1350a5b4 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 11 LEADER]: Rejecting Update request from peer 7ba59cc884714e8aa5f3f0ecaed84cbb for earlier term 10. Current term is 11. Ops: []
I20260709 13:20:23.809898 11423 raft_consensus.cc:2804] T 4b8cacb381b746da8d0049b0a83b41dd P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:20:23.810542 11423 raft_consensus.cc:697] T 4b8cacb381b746da8d0049b0a83b41dd P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 14 LEADER]: Becoming Leader. State: Replica: 7ba59cc884714e8aa5f3f0ecaed84cbb, State: Running, Role: LEADER
I20260709 13:20:23.811560 11444 consensus_queue.cc:1059] T bb3d8792045a4583ae2e965b1350a5b4 P 7ba59cc884714e8aa5f3f0ecaed84cbb [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:20:23.798050 11510 raft_consensus.cc:3055] T f09c2a98de1a4decabd0ff900dd44caa P cd75a17ab2604397adab03bb8b5fd75c [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:20:23.812608 11510 raft_consensus.cc:740] T f09c2a98de1a4decabd0ff900dd44caa P cd75a17ab2604397adab03bb8b5fd75c [term 13 LEADER]: Becoming Follower/Learner. State: Replica: cd75a17ab2604397adab03bb8b5fd75c, State: Running, Role: LEADER
I20260709 13:20:23.812625 11444 consensus_queue.cc:1243] T bb3d8792045a4583ae2e965b1350a5b4 P 7ba59cc884714e8aa5f3f0ecaed84cbb [NON_LEADER]: Peer ccd8a4c3bfe3413cb2ae219b09aea832 log is divergent from this leader: its last log entry 11.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 10
I20260709 13:20:23.813405 11510 consensus_queue.cc:260] T f09c2a98de1a4decabd0ff900dd44caa P cd75a17ab2604397adab03bb8b5fd75c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:23.814703 11510 raft_consensus.cc:3060] T f09c2a98de1a4decabd0ff900dd44caa P cd75a17ab2604397adab03bb8b5fd75c [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:20:23.815392  6846 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:23.810169  6732 raft_consensus.cc:1240] T e31b9971c15848dea59d4d4130141d9e P ccd8a4c3bfe3413cb2ae219b09aea832 [term 11 FOLLOWER]: Rejecting Update request from peer cd75a17ab2604397adab03bb8b5fd75c for earlier term 10. Current term is 11. Ops: [10.6-10.6]
W20260709 13:20:23.815958  6846 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:23.820353  7503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24ee15416e3145beaa1b8183453729a3" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb"
I20260709 13:20:23.820442  7502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f00a2e87e56452083b759f60d461ee3" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:20:23.821982  7502 raft_consensus.cc:2468] T 4f00a2e87e56452083b759f60d461ee3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 13.
I20260709 13:20:23.824560  6881 raft_consensus.cc:1240] T 4d9def8b32fd443aa94ab1420b06837b P cd75a17ab2604397adab03bb8b5fd75c [term 13 LEADER]: Rejecting Update request from peer b7ab4784c7344b939bc36f639286f377 for earlier term 12. Current term is 13. Ops: []
I20260709 13:20:23.811481 11423 consensus_queue.cc:237] T 4b8cacb381b746da8d0049b0a83b41dd P 7ba59cc884714e8aa5f3f0ecaed84cbb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
W20260709 13:20:23.828841  7467 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:23.818856  6723 raft_consensus.cc:2468] T 24ee15416e3145beaa1b8183453729a3 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 15.
W20260709 13:20:23.830768  7467 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:23.830955  6727 raft_consensus.cc:1240] T 24ee15416e3145beaa1b8183453729a3 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 15 FOLLOWER]: Rejecting Update request from peer 7ba59cc884714e8aa5f3f0ecaed84cbb for earlier term 14. Current term is 15. Ops: []
I20260709 13:20:23.740929 11300 raft_consensus.cc:515] T bd6869f07b5a4885a0b99fbe60c3b175 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:23.854307 11300 leader_election.cc:290] T bd6869f07b5a4885a0b99fbe60c3b175 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
W20260709 13:20:23.855532 11469 log.cc:927] Time spent T f09c2a98de1a4decabd0ff900dd44caa P cd75a17ab2604397adab03bb8b5fd75c: Append to log took a long time: real 1.268s	user 0.004s	sys 0.000s
I20260709 13:20:23.849398 11436 raft_consensus.cc:515] T 3d65025eea89441290d85dd053810e31 P cd75a17ab2604397adab03bb8b5fd75c [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:23.862172 11436 leader_election.cc:290] T 3d65025eea89441290d85dd053810e31 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 12 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:20:23.863034  6872 raft_consensus.cc:493] T 3d65025eea89441290d85dd053810e31 P cd75a17ab2604397adab03bb8b5fd75c [term 12 FOLLOWER]: Starting forced leader election (received explicit request)
W20260709 13:20:23.864313  7467 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:23.865003  6801 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:32976 (request call id 2955) took 1463 ms (client timeout 1542 ms). Trace:
I20260709 13:20:23.863687 11339 raft_consensus.cc:515] T ce4f062dcd314d43a63ca74067cb5ee3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 13 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } attrs { replace: true } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
W20260709 13:20:23.865404  6801 rpcz_store.cc:269] 0709 13:20:22.401178 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:22.465109 (+ 63931us) service_pool.cc:224] Handling call
0709 13:20:23.864823 (+1399714us) spinlock_profiling.cc:243] Waited 488 ms on lock 0x7b540032ffd4. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f9ae2fa 00007fcc1496fb17 00007fcc0deea6d4 00007fcc0deea662 00007fcc0deea591 00007fcc0deea50c 00007fcc0dee97c2 00007fcc0dce548c 00007fcc0dce48c6 00007fcc0dce426f
0709 13:20:23.864947 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1122398592}
I20260709 13:20:23.870220 11061 raft_consensus.cc:493] T 20f6842e26174571996b8dea4151d4be P b7ab4784c7344b939bc36f639286f377 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:23.870810 11489 raft_consensus.cc:3055] T 7ba5dac66ab5497e9e336f2a3c28cda5 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:20:23.870759 11061 raft_consensus.cc:515] T 20f6842e26174571996b8dea4151d4be P b7ab4784c7344b939bc36f639286f377 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:23.871428 11489 raft_consensus.cc:740] T 7ba5dac66ab5497e9e336f2a3c28cda5 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 7ba59cc884714e8aa5f3f0ecaed84cbb, State: Running, Role: LEADER
I20260709 13:20:23.873303 11061 leader_election.cc:290] T 20f6842e26174571996b8dea4151d4be P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:23.872553 11489 consensus_queue.cc:260] T 7ba5dac66ab5497e9e336f2a3c28cda5 P 7ba59cc884714e8aa5f3f0ecaed84cbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:20:23.877918 11489 raft_consensus.cc:3060] T 7ba5dac66ab5497e9e336f2a3c28cda5 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:23.879719  6879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09c2a98de1a4decabd0ff900dd44caa" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:20:23.881264 11339 leader_election.cc:290] T ce4f062dcd314d43a63ca74067cb5ee3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 13 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:23.863651  6872 raft_consensus.cc:3060] T 3d65025eea89441290d85dd053810e31 P cd75a17ab2604397adab03bb8b5fd75c [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:23.849131  6846 leader_election.cc:304] T 4f00a2e87e56452083b759f60d461ee3 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:20:23.885566  6723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce4f062dcd314d43a63ca74067cb5ee3" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
W20260709 13:20:23.885936  7467 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:23.886490  6723 raft_consensus.cc:2393] T ce4f062dcd314d43a63ca74067cb5ee3 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in current term 13: Already voted for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in this term.
W20260709 13:20:23.890380  7467 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:23.891929  7502 raft_consensus.cc:1240] T ce4f062dcd314d43a63ca74067cb5ee3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 13 FOLLOWER]: Rejecting Update request from peer b7ab4784c7344b939bc36f639286f377 for earlier term 12. Current term is 13. Ops: []
W20260709 13:20:23.930698  6845 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:23.889912 11510 raft_consensus.cc:2764] T 4f00a2e87e56452083b759f60d461ee3 P cd75a17ab2604397adab03bb8b5fd75c [term 13 FOLLOWER]: Leader pre-election decision vote started in defunct term 12: won
W20260709 13:20:23.972882  6772 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:23.967033 11354 raft_consensus.cc:493] T 7c44c4849aa54f2b94d1f1bef9ed546f P b7ab4784c7344b939bc36f639286f377 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:20:23.981128 11341 consensus_queue.cc:1059] T ce4f062dcd314d43a63ca74067cb5ee3 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
W20260709 13:20:23.993095  6696 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:24.007781  6698 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:24.006429  6872 raft_consensus.cc:515] T 3d65025eea89441290d85dd053810e31 P cd75a17ab2604397adab03bb8b5fd75c [term 13 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:24.002957 11354 raft_consensus.cc:515] T 7c44c4849aa54f2b94d1f1bef9ed546f P b7ab4784c7344b939bc36f639286f377 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:24.042588  7468 leader_election.cc:400] T 24ee15416e3145beaa1b8183453729a3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 14 pre-election: Vote denied by peer cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931) with higher term. Message: Invalid argument: T 24ee15416e3145beaa1b8183453729a3 P cd75a17ab2604397adab03bb8b5fd75c [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ba59cc884714e8aa5f3f0ecaed84cbb for earlier term 14. Current term is 15.
I20260709 13:20:24.044771  6876 raft_consensus.cc:1240] T 3d65025eea89441290d85dd053810e31 P cd75a17ab2604397adab03bb8b5fd75c [term 13 FOLLOWER]: Rejecting Update request from peer b7ab4784c7344b939bc36f639286f377 for earlier term 11. Current term is 13. Ops: []
I20260709 13:20:24.050652  6879 raft_consensus.cc:2468] T f09c2a98de1a4decabd0ff900dd44caa P cd75a17ab2604397adab03bb8b5fd75c [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 14.
I20260709 13:20:24.082715  6879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d65025eea89441290d85dd053810e31" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
W20260709 13:20:24.107158  7468 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:24.108439  6879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce4f062dcd314d43a63ca74067cb5ee3" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:20:24.114331 11448 raft_consensus.cc:3060] T 427c124d773f483294511e80fe340075 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:20:24.116791  6879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d9def8b32fd443aa94ab1420b06837b" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:24.114571 11510 raft_consensus.cc:493] T 30e88460611e47b2ba16a46a30b5f416 P cd75a17ab2604397adab03bb8b5fd75c [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:24.117661 11424 raft_consensus.cc:493] T ab432e62819d499eaaf3dd55481dd930 P b7ab4784c7344b939bc36f639286f377 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:24.125631 11510 raft_consensus.cc:515] T 30e88460611e47b2ba16a46a30b5f416 P cd75a17ab2604397adab03bb8b5fd75c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:24.144402 11510 leader_election.cc:290] T 30e88460611e47b2ba16a46a30b5f416 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:20:24.150704  6880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c7f33e544204fbaac4078e3e83bbf4e" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:24.151624  6880 raft_consensus.cc:2468] T 8c7f33e544204fbaac4078e3e83bbf4e P cd75a17ab2604397adab03bb8b5fd75c [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 10.
W20260709 13:20:24.154343  6770 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:24.162694 11439 consensus_queue.cc:260] T 853ac0a8cbd64ce99457f170216d4d0f P cd75a17ab2604397adab03bb8b5fd75c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:24.172806  6879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fa34c08b205435dba97346991aa1f92" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:20:24.176844  6880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5be3a11b23d4ea9b08300a2789821c7" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:24.177613  6880 raft_consensus.cc:2468] T f5be3a11b23d4ea9b08300a2789821c7 P cd75a17ab2604397adab03bb8b5fd75c [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 11.
I20260709 13:20:24.182466  6770 leader_election.cc:304] T b3f13b31a1f84f0d89d007eadd57924c P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb
I20260709 13:20:24.179469 11292 raft_consensus.cc:493] T 853ac0a8cbd64ce99457f170216d4d0f P b7ab4784c7344b939bc36f639286f377 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:24.184283 11211 raft_consensus.cc:2804] T b3f13b31a1f84f0d89d007eadd57924c P b7ab4784c7344b939bc36f639286f377 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:20:24.184768 11211 raft_consensus.cc:493] T b3f13b31a1f84f0d89d007eadd57924c P b7ab4784c7344b939bc36f639286f377 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 7ba59cc884714e8aa5f3f0ecaed84cbb)
I20260709 13:20:24.184418 11292 raft_consensus.cc:515] T 853ac0a8cbd64ce99457f170216d4d0f P b7ab4784c7344b939bc36f639286f377 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:24.185247 11211 raft_consensus.cc:3060] T b3f13b31a1f84f0d89d007eadd57924c P b7ab4784c7344b939bc36f639286f377 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:20:24.186733 11292 leader_election.cc:290] T 853ac0a8cbd64ce99457f170216d4d0f P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:24.187263 11292 raft_consensus.cc:493] T f09c2a98de1a4decabd0ff900dd44caa P b7ab4784c7344b939bc36f639286f377 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader cd75a17ab2604397adab03bb8b5fd75c)
I20260709 13:20:24.187475  6801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce4f062dcd314d43a63ca74067cb5ee3" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:20:24.189306 11341 consensus_queue.cc:1048] T 8c7f33e544204fbaac4078e3e83bbf4e P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:20:24.187734 11292 raft_consensus.cc:515] T f09c2a98de1a4decabd0ff900dd44caa P b7ab4784c7344b939bc36f639286f377 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:24.192797  6877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4b8bd455d5a47c18a1380839c6e0d61" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:20:24.183434  6770 leader_election.cc:304] T 7c37d41cd9164c15a6826ca62a851a69 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
I20260709 13:20:24.193466  6877 raft_consensus.cc:2410] T f4b8bd455d5a47c18a1380839c6e0d61 P cd75a17ab2604397adab03bb8b5fd75c [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate b7ab4784c7344b939bc36f639286f377 for term 12 because replica has last-logged OpId of term: 11 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
I20260709 13:20:24.197091  6877 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53406 (request call id 2241) took 1153 ms. Trace:
W20260709 13:20:24.196396  6847 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:24.197729  6877 rpcz_store.cc:276] 0709 13:20:23.043174 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:23.561293 (+518119us) service_pool.cc:224] Handling call
0709 13:20:24.192626 (+631333us) spinlock_profiling.cc:243] Waited 10.9 ms on lock 0x7b5800147c98. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0c745db1 00007fcc0c885b71 00007fcc0c885a22 00007fcc1579ec09 00007fcc148f8ee0 00007fcc149c20ab 00007fcc149c2131 00007fcc149700a0 00007fcc1496f984 00007fcc0deea6d4 00007fcc0deea662
0709 13:20:24.197003 (+  4377us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":24968960}
I20260709 13:20:24.199380  6877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4275cf08e63345f993bce8664eada830" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:24.196663  7466 leader_election.cc:304] T ce4f062dcd314d43a63ca74067cb5ee3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:20:24.136595 11424 raft_consensus.cc:515] T ab432e62819d499eaaf3dd55481dd930 P b7ab4784c7344b939bc36f639286f377 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:24.200251  6877 raft_consensus.cc:2468] T 4275cf08e63345f993bce8664eada830 P cd75a17ab2604397adab03bb8b5fd75c [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 12.
I20260709 13:20:24.201339 11439 raft_consensus.cc:3060] T 853ac0a8cbd64ce99457f170216d4d0f P cd75a17ab2604397adab03bb8b5fd75c [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:20:24.203723 11485 raft_consensus.cc:2749] T ce4f062dcd314d43a63ca74067cb5ee3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:20:24.236315  6881 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53406 (request call id 2238) took 1193 ms. Trace:
I20260709 13:20:24.236948  6881 rpcz_store.cc:276] 0709 13:20:23.042433 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:23.738096 (+695663us) service_pool.cc:224] Handling call
0709 13:20:23.772984 (+ 34888us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:23.825669 (+ 52685us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:24.235902 (+410233us) spinlock_profiling.cc:243] Waited 50.9 ms on lock 0x7b54000a5fd4. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f9aae01 00007fcc0f9a983e 00007fcc1496e419 00007fcc0dee5bd4 00007fcc0dee5b62 00007fcc0dee5a91 00007fcc0dee5a0c 00007fcc0dee4cc2 00007fcc0dce548c 00007fcc0dce48c6
0709 13:20:24.236217 (+   315us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":117123456}
I20260709 13:20:24.176218 11071 consensus_queue.cc:1059] T 24ee15416e3145beaa1b8183453729a3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.037s
I20260709 13:20:24.224195 11521 raft_consensus.cc:2804] T 7c37d41cd9164c15a6826ca62a851a69 P b7ab4784c7344b939bc36f639286f377 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:20:24.229337  6880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a92dd554674067a83a9cb68c4773f2" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:24.244887  6879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20f6842e26174571996b8dea4151d4be" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:24.245520  6880 raft_consensus.cc:2468] T 07a92dd554674067a83a9cb68c4773f2 P cd75a17ab2604397adab03bb8b5fd75c [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 12.
I20260709 13:20:24.245949  6875 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53406 (request call id 2232) took 1234 ms. Trace:
I20260709 13:20:24.245543  6879 raft_consensus.cc:2468] T 20f6842e26174571996b8dea4151d4be P cd75a17ab2604397adab03bb8b5fd75c [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 13.
I20260709 13:20:24.246347  6875 rpcz_store.cc:276] 0709 13:20:23.011469 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:23.734504 (+723035us) service_pool.cc:224] Handling call
0709 13:20:23.734794 (+   290us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:23.787342 (+ 52548us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:24.245694 (+458352us) spinlock_profiling.cc:243] Waited 52 ms on lock 0x7b540042b154. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f9aae01 00007fcc0f9a983e 00007fcc1496e419 00007fcc0dee5bd4 00007fcc0dee5b62 00007fcc0dee5a91 00007fcc0dee5a0c 00007fcc0dee4cc2 00007fcc0dce548c 00007fcc0dce48c6
0709 13:20:24.245889 (+   195us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":119510272}
I20260709 13:20:24.203240  6770 leader_election.cc:304] T be1a92657f494cac8dd227d152f50151 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb
I20260709 13:20:24.233398  6877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e326172347f45e99a0d482b5d8ef768" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:24.240311 11503 raft_consensus.cc:493] T 3fa34c08b205435dba97346991aa1f92 P cd75a17ab2604397adab03bb8b5fd75c [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 7ba59cc884714e8aa5f3f0ecaed84cbb)
I20260709 13:20:24.181761 11403 consensus_queue.cc:1048] T 90d42e216d9741e190bca19a781291fd P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.057s
I20260709 13:20:24.247869  6877 raft_consensus.cc:2468] T 9e326172347f45e99a0d482b5d8ef768 P cd75a17ab2604397adab03bb8b5fd75c [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 11.
I20260709 13:20:24.249784  6877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe20b4b48823486ca3b9c648db6ce8aa" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:20:24.251066  6877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8292e16e5654be6bc408560cf256aaa" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
W20260709 13:20:24.250877  6770 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 47761.5us
I20260709 13:20:24.182066 11258 consensus_queue.cc:1059] T 2c240553ce044eedb41541d72b9475d7 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.058s
I20260709 13:20:24.251950  6877 raft_consensus.cc:3060] T d8292e16e5654be6bc408560cf256aaa P cd75a17ab2604397adab03bb8b5fd75c [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:24.255365  6881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "853ac0a8cbd64ce99457f170216d4d0f" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:24.256968 11424 leader_election.cc:290] T ab432e62819d499eaaf3dd55481dd930 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:24.244462 11521 raft_consensus.cc:493] T 7c37d41cd9164c15a6826ca62a851a69 P b7ab4784c7344b939bc36f639286f377 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:24.260238 11521 raft_consensus.cc:3060] T 7c37d41cd9164c15a6826ca62a851a69 P b7ab4784c7344b939bc36f639286f377 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:24.265268  6880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a75bfe094d4bdc963aba3f08dfcd25" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:20:24.266054  6880 raft_consensus.cc:3060] T 95a75bfe094d4bdc963aba3f08dfcd25 P cd75a17ab2604397adab03bb8b5fd75c [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:24.248557 11481 raft_consensus.cc:3055] T 24ee15416e3145beaa1b8183453729a3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 14 LEADER]: Stepping down as leader of term 14
W20260709 13:20:24.273345  7467 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:24.265836 11342 raft_consensus.cc:2804] T be1a92657f494cac8dd227d152f50151 P b7ab4784c7344b939bc36f639286f377 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:20:24.283599 11292 leader_election.cc:290] T f09c2a98de1a4decabd0ff900dd44caa P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:24.273712 11258 consensus_queue.cc:1243] T 2c240553ce044eedb41541d72b9475d7 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Peer ccd8a4c3bfe3413cb2ae219b09aea832 log is divergent from this leader: its last log entry 14.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 13:20:24.274821 11481 raft_consensus.cc:740] T 24ee15416e3145beaa1b8183453729a3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 7ba59cc884714e8aa5f3f0ecaed84cbb, State: Running, Role: LEADER
I20260709 13:20:24.259158 11503 raft_consensus.cc:515] T 3fa34c08b205435dba97346991aa1f92 P cd75a17ab2604397adab03bb8b5fd75c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:20:24.286073 11342 raft_consensus.cc:493] T be1a92657f494cac8dd227d152f50151 P b7ab4784c7344b939bc36f639286f377 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:24.306357  6880 raft_consensus.cc:2468] T 95a75bfe094d4bdc963aba3f08dfcd25 P cd75a17ab2604397adab03bb8b5fd75c [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 13.
I20260709 13:20:24.307363  6880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b56bf91d90824c959e21e0cee5ba1816" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:24.302565 11342 raft_consensus.cc:3060] T be1a92657f494cac8dd227d152f50151 P b7ab4784c7344b939bc36f639286f377 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:24.306139 11447 raft_consensus.cc:3060] T bb3d8792045a4583ae2e965b1350a5b4 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:20:24.312841  6880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c44c4849aa54f2b94d1f1bef9ed546f" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:24.317144  6880 raft_consensus.cc:2468] T 7c44c4849aa54f2b94d1f1bef9ed546f P cd75a17ab2604397adab03bb8b5fd75c [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 14.
W20260709 13:20:24.321149  7467 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:24.321234  6877 raft_consensus.cc:2468] T d8292e16e5654be6bc408560cf256aaa P cd75a17ab2604397adab03bb8b5fd75c [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 17.
W20260709 13:20:24.327090  7467 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:24.328866  6877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f58dc08b12a2494bb9a1372837970ca2" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
W20260709 13:20:24.330502  6770 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 78243.8us
I20260709 13:20:24.336455  6801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f9c2e2bf644115957398fe4c9459db" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:20:24.336946  6800 raft_consensus.cc:1275] T b56bf91d90824c959e21e0cee5ba1816 P b7ab4784c7344b939bc36f639286f377 [term 12 FOLLOWER]: Refusing update from remote peer cd75a17ab2604397adab03bb8b5fd75c: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:20:24.337505  6803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20f6842e26174571996b8dea4151d4be" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:24.338155  6799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d65025eea89441290d85dd053810e31" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:24.336992  6807 raft_consensus.cc:1240] T 853ac0a8cbd64ce99457f170216d4d0f P b7ab4784c7344b939bc36f639286f377 [term 10 FOLLOWER]: Rejecting Update request from peer cd75a17ab2604397adab03bb8b5fd75c for earlier term 9. Current term is 10. Ops: [9.6-9.6]
I20260709 13:20:24.339764  6806 raft_consensus.cc:1240] T de3186201e1a40d0b335eeb8b4e256e0 P b7ab4784c7344b939bc36f639286f377 [term 14 FOLLOWER]: Rejecting Update request from peer cd75a17ab2604397adab03bb8b5fd75c for earlier term 13. Current term is 14. Ops: [13.8-13.8]
I20260709 13:20:24.340372  6807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4db81d9d329422bb3b4160ca4ac2d1d" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 13 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:24.341534  6799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f00a2e87e56452083b759f60d461ee3" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:24.341828  6800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c7f33e544204fbaac4078e3e83bbf4e" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 11 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:24.341492  6798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7887766dc6784fcaa42b35c05fea7a99" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 14 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:24.342725  6799 raft_consensus.cc:2393] T 4f00a2e87e56452083b759f60d461ee3 P b7ab4784c7344b939bc36f639286f377 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c in current term 13: Already voted for candidate b7ab4784c7344b939bc36f639286f377 in this term.
I20260709 13:20:24.343385  6880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30e88460611e47b2ba16a46a30b5f416" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:24.337791  6802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d33d5ee8ef6f415593d8df52063161ad" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:24.344099  6880 raft_consensus.cc:2468] T 30e88460611e47b2ba16a46a30b5f416 P cd75a17ab2604397adab03bb8b5fd75c [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 11.
I20260709 13:20:24.345714  6803 raft_consensus.cc:2393] T 20f6842e26174571996b8dea4151d4be P b7ab4784c7344b939bc36f639286f377 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c in current term 14: Already voted for candidate b7ab4784c7344b939bc36f639286f377 in this term.
I20260709 13:20:24.351883  6805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a734b5ab7834e05a8c422208acc58b1" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 14 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:24.353322  6880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7887766dc6784fcaa42b35c05fea7a99" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 14 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:24.353971  6880 raft_consensus.cc:2468] T 7887766dc6784fcaa42b35c05fea7a99 P cd75a17ab2604397adab03bb8b5fd75c [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 13.
W20260709 13:20:24.354199  7467 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:24.358516  6878 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58592 (request call id 365) took 1915 ms. Trace:
I20260709 13:20:24.359014  6878 rpcz_store.cc:276] 0709 13:20:22.442888 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:22.669042 (+226154us) service_pool.cc:224] Handling call
0709 13:20:23.680054 (+1011012us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:23.680557 (+   503us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:23.680595 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:20:23.681262 (+   667us) log.cc:844] Serialized 26 byte log entry
0709 13:20:23.831195 (+149933us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:20:24.095397 (+264202us) log.cc:844] Serialized 14 byte log entry
0709 13:20:24.101813 (+  6416us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:24.101891 (+    78us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:24.101933 (+    42us) raft_consensus.cc:1685] finished
0709 13:20:24.101943 (+    10us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:24.358299 (+256356us) spinlock_profiling.cc:243] Waited 1.01 s on lock 0x7b540039add0. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f9a98ad 00007fcc1496e419 00007fcc0dee5bd4 00007fcc0dee5b62 00007fcc0dee5a91 00007fcc0dee5a0c 00007fcc0dee4cc2 00007fcc0dce548c 00007fcc0dce48c6 00007fcc0dce426f
0709 13:20:24.358444 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":348431,"prepare.run_cpu_time_us":47,"prepare.run_wall_time_us":47,"raft.queue_time_us":6897,"raft.run_cpu_time_us":265,"raft.run_wall_time_us":5043,"spinlock_wait_cycles":2324227968,"thread_start_us":405066,"threads_started":2,"wal-append.queue_time_us":306964}
I20260709 13:20:24.343382 11504 leader_election.cc:290] T bd6869f07b5a4885a0b99fbe60c3b175 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:24.335620 11349 consensus_queue.cc:1059] T d8292e16e5654be6bc408560cf256aaa P b7ab4784c7344b939bc36f639286f377 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: INVALID_TERM, Last received: 15.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.021s
I20260709 13:20:24.328954 11481 consensus_queue.cc:260] T 24ee15416e3145beaa1b8183453729a3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:20:24.370956 11424 raft_consensus.cc:3055] T 2c240553ce044eedb41541d72b9475d7 P b7ab4784c7344b939bc36f639286f377 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:20:24.369447  6880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de3186201e1a40d0b335eeb8b4e256e0" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 15 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:24.380760 11503 leader_election.cc:290] T 3fa34c08b205435dba97346991aa1f92 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:20:24.378765 11424 raft_consensus.cc:740] T 2c240553ce044eedb41541d72b9475d7 P b7ab4784c7344b939bc36f639286f377 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
I20260709 13:20:24.402444  6805 raft_consensus.cc:1275] T bb7fa124c3bf4ef9ab65a407cb008441 P b7ab4784c7344b939bc36f639286f377 [term 14 FOLLOWER]: Refusing update from remote peer 7ba59cc884714e8aa5f3f0ecaed84cbb: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:20:24.405876 11066 raft_consensus.cc:3060] T 4b8cacb381b746da8d0049b0a83b41dd P cd75a17ab2604397adab03bb8b5fd75c [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:24.410264  6624 catalog_manager.cc:5697] T 1528ab62b6fe4e3099d08f141afee116 P 7ba59cc884714e8aa5f3f0ecaed84cbb reported cstate change: term changed from 6 to 10, leader changed from <none> to 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68). New cstate: current_term: 10 leader_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:20:24.412137  5625 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:20:24.413808 11495 raft_consensus.cc:3055] T d8292e16e5654be6bc408560cf256aaa P b7ab4784c7344b939bc36f639286f377 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:20:24.414300 11495 raft_consensus.cc:740] T d8292e16e5654be6bc408560cf256aaa P b7ab4784c7344b939bc36f639286f377 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
I20260709 13:20:24.415233 11495 consensus_queue.cc:260] T d8292e16e5654be6bc408560cf256aaa P b7ab4784c7344b939bc36f639286f377 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 16.10, Last appended by leader: 10, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:24.385926 11481 raft_consensus.cc:3060] T 24ee15416e3145beaa1b8183453729a3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:24.422364  6730 raft_consensus.cc:1275] T 4b8cacb381b746da8d0049b0a83b41dd P ccd8a4c3bfe3413cb2ae219b09aea832 [term 14 FOLLOWER]: Refusing update from remote peer 7ba59cc884714e8aa5f3f0ecaed84cbb: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:20:24.438534  6730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e326172347f45e99a0d482b5d8ef768" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:24.439069 11449 consensus_queue.cc:1048] T 4b8cacb381b746da8d0049b0a83b41dd P 7ba59cc884714e8aa5f3f0ecaed84cbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:20:24.439839  6730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1528ab62b6fe4e3099d08f141afee116" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:24.440948  6730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20f6842e26174571996b8dea4151d4be" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
W20260709 13:20:24.428830 11540 log.cc:927] Time spent T ce4f062dcd314d43a63ca74067cb5ee3 P cd75a17ab2604397adab03bb8b5fd75c: Append to log took a long time: real 0.197s	user 0.002s	sys 0.000s
I20260709 13:20:24.442083  6730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b56bf91d90824c959e21e0cee5ba1816" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:24.442517  6873 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53406 (request call id 2228) took 1445 ms. Trace:
I20260709 13:20:24.443050  6730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de3186201e1a40d0b335eeb8b4e256e0" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 15 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:24.442871  6873 rpcz_store.cc:276] 0709 13:20:22.997273 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:23.714755 (+717482us) service_pool.cc:224] Handling call
0709 13:20:23.715239 (+   484us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:23.715726 (+   487us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:23.715767 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:20:23.716413 (+   646us) log.cc:844] Serialized 26 byte log entry
0709 13:20:24.044734 (+328321us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:20:24.044813 (+    79us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:24.044920 (+   107us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:24.428236 (+383316us) spinlock_profiling.cc:243] Waited 1.7 ms on lock 0x7b4400022b4c. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0c745db1 00007fcc0c7e3c85 00007fcc0c7e46a2 00007fcc0f5561db 00007fcc0f551aaf 00007fcc0f54586e 00007fcc0f544bb6 00007fcc0f5447d8 00007fcc0f54e221 00007fcc0f54e1d9 00007fcc0f54e169
0709 13:20:24.442268 (+ 14032us) raft_consensus.cc:1685] finished
0709 13:20:24.442288 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:24.442463 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":12564,"raft.run_cpu_time_us":134,"raft.run_wall_time_us":5351,"spinlock_wait_cycles":3919232,"thread_start_us":327845,"threads_started":1,"wal-append.queue_time_us":457448}
I20260709 13:20:24.445092  6873 raft_consensus.cc:1240] T 24ee15416e3145beaa1b8183453729a3 P cd75a17ab2604397adab03bb8b5fd75c [term 15 FOLLOWER]: Rejecting Update request from peer 7ba59cc884714e8aa5f3f0ecaed84cbb for earlier term 14. Current term is 15. Ops: []
I20260709 13:20:24.445577  6873 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58592 (request call id 372) took 1242 ms. Trace:
I20260709 13:20:24.445847  6873 rpcz_store.cc:276] 0709 13:20:23.203475 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:24.444628 (+1241153us) service_pool.cc:224] Handling call
0709 13:20:24.444931 (+   303us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:24.445397 (+   466us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:24.445533 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:20:24.447429  7495 raft_consensus.cc:2468] T bb3d8792045a4583ae2e965b1350a5b4 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 11.
I20260709 13:20:24.429316 11424 consensus_queue.cc:260] T 2c240553ce044eedb41541d72b9475d7 P b7ab4784c7344b939bc36f639286f377 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:24.429795  6731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "404190ce4ce94cecbfcb6ea9d1dd8626" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:24.430611  6723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4275cf08e63345f993bce8664eada830" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:24.429208  6729 raft_consensus.cc:1240] T 711ef6523deb4cbe8ef2ba61e1c21c98 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 14 FOLLOWER]: Rejecting Update request from peer b7ab4784c7344b939bc36f639286f377 for earlier term 13. Current term is 14. Ops: []
I20260709 13:20:24.431875  6728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f58dc08b12a2494bb9a1372837970ca2" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:20:24.431336  6732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30e88460611e47b2ba16a46a30b5f416" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:24.428491  6724 raft_consensus.cc:1240] T ce4f062dcd314d43a63ca74067cb5ee3 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 13 FOLLOWER]: Rejecting Update request from peer b7ab4784c7344b939bc36f639286f377 for earlier term 12. Current term is 13. Ops: []
I20260709 13:20:24.407369 11447 consensus_queue.cc:1048] T bb7fa124c3bf4ef9ab65a407cb008441 P 7ba59cc884714e8aa5f3f0ecaed84cbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.001s
W20260709 13:20:24.484114  6845 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:24.450562  6771 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:24.463297  6696 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:24.486519  6732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09c2a98de1a4decabd0ff900dd44caa" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:24.488685  6723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "853ac0a8cbd64ce99457f170216d4d0f" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:24.504477  6730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6869f07b5a4885a0b99fbe60c3b175" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:24.491928  6729 raft_consensus.cc:1240] T a3022224cc81473690653a83d4e99470 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 14 FOLLOWER]: Rejecting Update request from peer b7ab4784c7344b939bc36f639286f377 for earlier term 13. Current term is 14. Ops: []
W20260709 13:20:24.492414  6697 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.5.126.67:42931 timed out after 2.206s (SENT) [suppressed 11 similar messages]
I20260709 13:20:24.500236  6728 raft_consensus.cc:3060] T f58dc08b12a2494bb9a1372837970ca2 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:24.491575  6770 leader_election.cc:304] T 1528ab62b6fe4e3099d08f141afee116 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:20:24.505621  6732 raft_consensus.cc:2393] T f09c2a98de1a4decabd0ff900dd44caa P ccd8a4c3bfe3413cb2ae219b09aea832 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7ab4784c7344b939bc36f639286f377 in current term 14: Already voted for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in this term.
I20260709 13:20:24.447965  6873 raft_consensus.cc:1240] T c4db81d9d329422bb3b4160ca4ac2d1d P cd75a17ab2604397adab03bb8b5fd75c [term 12 FOLLOWER]: Rejecting Update request from peer ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 11. Current term is 12. Ops: [11.7-11.7]
I20260709 13:20:24.509752  6729 raft_consensus.cc:1275] T 1bf4668eeb70467fb3dc5a0289233b3c P ccd8a4c3bfe3413cb2ae219b09aea832 [term 13 FOLLOWER]: Refusing update from remote peer b7ab4784c7344b939bc36f639286f377: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:20:24.506101  6730 raft_consensus.cc:2468] T bd6869f07b5a4885a0b99fbe60c3b175 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 13.
I20260709 13:20:24.513883  7502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17587d6730594da4a56fa13a353232a1" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb"
I20260709 13:20:24.514510  7502 raft_consensus.cc:3060] T 17587d6730594da4a56fa13a353232a1 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:20:24.447867 11511 raft_consensus.cc:493] T bb3d8792045a4583ae2e965b1350a5b4 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:24.527117  6770 leader_election.cc:304] T 404190ce4ce94cecbfcb6ea9d1dd8626 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:20:24.447721 11211 raft_consensus.cc:515] T b3f13b31a1f84f0d89d007eadd57924c P b7ab4784c7344b939bc36f639286f377 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:20:24.519050  6724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c44c4849aa54f2b94d1f1bef9ed546f" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:24.433384 11521 raft_consensus.cc:515] T 7c37d41cd9164c15a6826ca62a851a69 P b7ab4784c7344b939bc36f639286f377 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:24.513837 11495 raft_consensus.cc:3060] T d8292e16e5654be6bc408560cf256aaa P b7ab4784c7344b939bc36f639286f377 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:24.533608  6728 raft_consensus.cc:2468] T f58dc08b12a2494bb9a1372837970ca2 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 16.
I20260709 13:20:24.508678 11494 raft_consensus.cc:2749] T 1528ab62b6fe4e3099d08f141afee116 P b7ab4784c7344b939bc36f639286f377 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:20:24.558593  6802 raft_consensus.cc:1240] T c4db81d9d329422bb3b4160ca4ac2d1d P b7ab4784c7344b939bc36f639286f377 [term 12 LEADER]: Rejecting Update request from peer ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 11. Current term is 12. Ops: [11.7-11.7]
I20260709 13:20:24.562626  6801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a92dd554674067a83a9cb68c4773f2" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:24.564361  6800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c7f33e544204fbaac4078e3e83bbf4e" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:24.566563  6807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09c2a98de1a4decabd0ff900dd44caa" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:20:24.566726 11390 raft_consensus.cc:493] T c4db81d9d329422bb3b4160ca4ac2d1d P ccd8a4c3bfe3413cb2ae219b09aea832 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:24.567478  6807 raft_consensus.cc:3060] T f09c2a98de1a4decabd0ff900dd44caa P b7ab4784c7344b939bc36f639286f377 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:24.567584 11390 raft_consensus.cc:515] T c4db81d9d329422bb3b4160ca4ac2d1d P ccd8a4c3bfe3413cb2ae219b09aea832 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:24.570847 11390 leader_election.cc:290] T c4db81d9d329422bb3b4160ca4ac2d1d P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
W20260709 13:20:24.571844  6695 connection.cc:256] RPC call timeout handler was delayed by -1.1341328609998982s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1552s for a response
I20260709 13:20:24.572937  6880 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53406 (request call id 2249) took 1404 ms. Trace:
I20260709 13:20:24.533139 11424 raft_consensus.cc:3060] T 2c240553ce044eedb41541d72b9475d7 P b7ab4784c7344b939bc36f639286f377 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:24.586292  6804 raft_consensus.cc:1240] T b3f13b31a1f84f0d89d007eadd57924c P b7ab4784c7344b939bc36f639286f377 [term 12 FOLLOWER]: Rejecting Update request from peer 7ba59cc884714e8aa5f3f0ecaed84cbb for earlier term 11. Current term is 12. Ops: []
I20260709 13:20:24.587899  6800 raft_consensus.cc:1275] T f03d0dbf16864ca4bc1bb5e4c0334c0f P b7ab4784c7344b939bc36f639286f377 [term 12 FOLLOWER]: Refusing update from remote peer ccd8a4c3bfe3413cb2ae219b09aea832: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:20:24.575076  6802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d9def8b32fd443aa94ab1420b06837b" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:24.573482  6880 rpcz_store.cc:276] 0709 13:20:23.168468 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:24.379612 (+1211144us) service_pool.cc:224] Handling call
0709 13:20:24.380096 (+   484us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:24.381170 (+  1074us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:24.381214 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:20:24.383016 (+  1802us) log.cc:844] Serialized 26 byte log entry
0709 13:20:24.538456 (+155440us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:20:24.538536 (+    80us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:24.538626 (+    90us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:24.572633 (+ 34007us) raft_consensus.cc:1685] finished
0709 13:20:24.572672 (+    39us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:24.572863 (+   191us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1156,"raft.run_cpu_time_us":180,"raft.run_wall_time_us":1028,"thread_start_us":134702,"threads_started":1,"wal-append.queue_time_us":181931}
I20260709 13:20:24.580760  6695 leader_election.cc:304] T a3022224cc81473690653a83d4e99470 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:20:24.591315  6806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5be3a11b23d4ea9b08300a2789821c7" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:24.582626  6801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce4f062dcd314d43a63ca74067cb5ee3" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:20:24.594084  6801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbdf895bba214ff68685a24fd17dfb5d" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 11 candidate_status { last_received { term: 10 index: 4 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:24.583364  6803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a75bfe094d4bdc963aba3f08dfcd25" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:20:24.595247  6726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be1a92657f494cac8dd227d152f50151" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:24.595357  6803 raft_consensus.cc:3060] T 95a75bfe094d4bdc963aba3f08dfcd25 P b7ab4784c7344b939bc36f639286f377 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:24.596239  6800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6869f07b5a4885a0b99fbe60c3b175" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:24.596532  6726 raft_consensus.cc:2468] T be1a92657f494cac8dd227d152f50151 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in term 13.
I20260709 13:20:24.597383  6726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30e88460611e47b2ba16a46a30b5f416" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:24.597440  6806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3f13b31a1f84f0d89d007eadd57924c" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:24.597851  6802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17587d6730594da4a56fa13a353232a1" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:20:24.598462  6802 raft_consensus.cc:3060] T 17587d6730594da4a56fa13a353232a1 P b7ab4784c7344b939bc36f639286f377 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:20:24.599184  6806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8292e16e5654be6bc408560cf256aaa" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:20:24.539530 11172 raft_consensus.cc:2749] T 404190ce4ce94cecbfcb6ea9d1dd8626 P b7ab4784c7344b939bc36f639286f377 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:20:24.609862  6726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22ccee1b570c4ad3a57bd7aec085b1b4" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:20:24.612140  6799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7887766dc6784fcaa42b35c05fea7a99" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 14 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:24.612759  6726 raft_consensus.cc:1240] T 4d9def8b32fd443aa94ab1420b06837b P ccd8a4c3bfe3413cb2ae219b09aea832 [term 13 FOLLOWER]: Rejecting Update request from peer b7ab4784c7344b939bc36f639286f377 for earlier term 12. Current term is 13. Ops: []
I20260709 13:20:24.537187 11316 leader_election.cc:290] T 22ccee1b570c4ad3a57bd7aec085b1b4 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 11 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
W20260709 13:20:24.610503  6697 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 118111us
I20260709 13:20:24.613911  6726 raft_consensus.cc:1240] T 90d42e216d9741e190bca19a781291fd P ccd8a4c3bfe3413cb2ae219b09aea832 [term 13 FOLLOWER]: Rejecting Update request from peer b7ab4784c7344b939bc36f639286f377 for earlier term 12. Current term is 13. Ops: [12.7-12.7]
I20260709 13:20:24.616134  6873 raft_consensus.cc:1275] T f03d0dbf16864ca4bc1bb5e4c0334c0f P cd75a17ab2604397adab03bb8b5fd75c [term 12 FOLLOWER]: Refusing update from remote peer ccd8a4c3bfe3413cb2ae219b09aea832: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:20:24.620198  6726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fa34c08b205435dba97346991aa1f92" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
W20260709 13:20:24.617072  6697 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:24.617734  7466 leader_election.cc:304] T be1a92657f494cac8dd227d152f50151 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
I20260709 13:20:24.584848 11510 raft_consensus.cc:493] T bb3d8792045a4583ae2e965b1350a5b4 P cd75a17ab2604397adab03bb8b5fd75c [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:20:24.622324  6697 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:24.585194 11524 raft_consensus.cc:493] T 7ba5dac66ab5497e9e336f2a3c28cda5 P cd75a17ab2604397adab03bb8b5fd75c [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 7ba59cc884714e8aa5f3f0ecaed84cbb)
I20260709 13:20:24.622735  6724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d65025eea89441290d85dd053810e31" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:20:24.625101  6726 raft_consensus.cc:2393] T 3fa34c08b205435dba97346991aa1f92 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c in current term 15: Already voted for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in this term.
I20260709 13:20:24.596300 11354 leader_election.cc:290] T 7c44c4849aa54f2b94d1f1bef9ed546f P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:24.621699 11510 raft_consensus.cc:515] T bb3d8792045a4583ae2e965b1350a5b4 P cd75a17ab2604397adab03bb8b5fd75c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:20:24.625989 11524 raft_consensus.cc:515] T 7ba5dac66ab5497e9e336f2a3c28cda5 P cd75a17ab2604397adab03bb8b5fd75c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:20:24.626797 11336 leader_election.cc:290] T be1a92657f494cac8dd227d152f50151 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:20:24.628270 11524 leader_election.cc:290] T 7ba5dac66ab5497e9e336f2a3c28cda5 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:20:24.628988 11524 raft_consensus.cc:493] T fe20b4b48823486ca3b9c648db6ce8aa P cd75a17ab2604397adab03bb8b5fd75c [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 7ba59cc884714e8aa5f3f0ecaed84cbb)
I20260709 13:20:24.629509 11524 raft_consensus.cc:515] T fe20b4b48823486ca3b9c648db6ce8aa P cd75a17ab2604397adab03bb8b5fd75c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:20:24.551285 11511 raft_consensus.cc:515] T bb3d8792045a4583ae2e965b1350a5b4 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:20:24.635708  6697 leader_election.cc:304] T f09c2a98de1a4decabd0ff900dd44caa P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:20:24.637492  6807 raft_consensus.cc:2468] T f09c2a98de1a4decabd0ff900dd44caa P b7ab4784c7344b939bc36f639286f377 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 14.
I20260709 13:20:24.638500 11342 raft_consensus.cc:515] T be1a92657f494cac8dd227d152f50151 P b7ab4784c7344b939bc36f639286f377 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:20:24.640312 11423 raft_consensus.cc:2804] T be1a92657f494cac8dd227d152f50151 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:20:24.640805 11423 raft_consensus.cc:493] T be1a92657f494cac8dd227d152f50151 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:20:24.641043 11548 log.cc:927] Time spent T 3a485a995abc4807b6e511e45419f737 P b7ab4784c7344b939bc36f639286f377: Append to log took a long time: real 0.121s	user 0.000s	sys 0.000s
I20260709 13:20:24.641368 11211 leader_election.cc:290] T b3f13b31a1f84f0d89d007eadd57924c P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 12 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
W20260709 13:20:24.641681  6770 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 88927.6us
I20260709 13:20:24.642083 11211 consensus_queue.cc:1059] T 711ef6523deb4cbe8ef2ba61e1c21c98 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:20:24.642524  6799 raft_consensus.cc:1275] T de3186201e1a40d0b335eeb8b4e256e0 P b7ab4784c7344b939bc36f639286f377 [term 14 FOLLOWER]: Refusing update from remote peer ccd8a4c3bfe3413cb2ae219b09aea832: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:20:24.645119 11494 raft_consensus.cc:3055] T 711ef6523deb4cbe8ef2ba61e1c21c98 P b7ab4784c7344b939bc36f639286f377 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:20:24.645290 11521 leader_election.cc:290] T 7c37d41cd9164c15a6826ca62a851a69 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 13 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:24.645547 11494 raft_consensus.cc:740] T 711ef6523deb4cbe8ef2ba61e1c21c98 P b7ab4784c7344b939bc36f639286f377 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
I20260709 13:20:24.646565 11494 consensus_queue.cc:260] T 711ef6523deb4cbe8ef2ba61e1c21c98 P b7ab4784c7344b939bc36f639286f377 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:24.575948 11436 raft_consensus.cc:493] T e77e330a82df4b43a745d57a68f6f057 P cd75a17ab2604397adab03bb8b5fd75c [term 14 FOLLOWER]: Starting pre-election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:20:24.647920  6881 raft_consensus.cc:2410] T 853ac0a8cbd64ce99457f170216d4d0f P cd75a17ab2604397adab03bb8b5fd75c [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7ab4784c7344b939bc36f639286f377 for term 11 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 13:20:24.630050  6878 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53406 (request call id 2248) took 1489 ms. Trace:
I20260709 13:20:24.652724  6802 raft_consensus.cc:2468] T 17587d6730594da4a56fa13a353232a1 P b7ab4784c7344b939bc36f639286f377 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 18.
I20260709 13:20:24.653626  6878 rpcz_store.cc:276] 0709 13:20:23.140465 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:24.360912 (+1220447us) service_pool.cc:224] Handling call
0709 13:20:24.361222 (+   310us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:24.366414 (+  5192us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:24.366451 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:20:24.368920 (+  2469us) log.cc:844] Serialized 26 byte log entry
0709 13:20:24.382860 (+ 13940us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:20:24.382898 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:24.382960 (+    62us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:24.629830 (+246870us) raft_consensus.cc:1685] finished
0709 13:20:24.629853 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:24.629989 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":127,"raft.run_cpu_time_us":204,"raft.run_wall_time_us":3415,"thread_start_us":11565,"threads_started":1,"wal-append.queue_time_us":149072}
I20260709 13:20:24.654834  6802 raft_consensus.cc:1275] T 34f36d59d88f40fe8a2805e604fc6c0a P b7ab4784c7344b939bc36f639286f377 [term 10 FOLLOWER]: Refusing update from remote peer ccd8a4c3bfe3413cb2ae219b09aea832: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 6. (term mismatch)
I20260709 13:20:24.655220  6802 pending_rounds.cc:85] T 34f36d59d88f40fe8a2805e604fc6c0a P b7ab4784c7344b939bc36f639286f377: Aborting all ops after (but not including) 5
I20260709 13:20:24.655434  6802 pending_rounds.cc:107] T 34f36d59d88f40fe8a2805e604fc6c0a P b7ab4784c7344b939bc36f639286f377: Aborting uncommitted NO_OP operation due to leader change: 9.6
I20260709 13:20:24.655659  6802 raft_consensus.cc:2889] T 34f36d59d88f40fe8a2805e604fc6c0a P b7ab4784c7344b939bc36f639286f377 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:20:24.655699  6878 raft_consensus.cc:1275] T bb3d8792045a4583ae2e965b1350a5b4 P cd75a17ab2604397adab03bb8b5fd75c [term 11 FOLLOWER]: Refusing update from remote peer ccd8a4c3bfe3413cb2ae219b09aea832: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 13:20:24.656158  6880 raft_consensus.cc:1275] T 30e88460611e47b2ba16a46a30b5f416 P cd75a17ab2604397adab03bb8b5fd75c [term 11 FOLLOWER]: Refusing update from remote peer ccd8a4c3bfe3413cb2ae219b09aea832: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:20:24.657260  6878 raft_consensus.cc:3055] T de3186201e1a40d0b335eeb8b4e256e0 P cd75a17ab2604397adab03bb8b5fd75c [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:20:24.657308  6802 raft_consensus.cc:1275] T 3411566abe2d4c9bb4b2adfdd05e6f17 P b7ab4784c7344b939bc36f639286f377 [term 11 FOLLOWER]: Refusing update from remote peer ccd8a4c3bfe3413cb2ae219b09aea832: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:20:24.657749  6878 raft_consensus.cc:740] T de3186201e1a40d0b335eeb8b4e256e0 P cd75a17ab2604397adab03bb8b5fd75c [term 13 LEADER]: Becoming Follower/Learner. State: Replica: cd75a17ab2604397adab03bb8b5fd75c, State: Running, Role: LEADER
I20260709 13:20:24.644021  6799 raft_consensus.cc:1275] T a1704639a875409b9959353527b3fd68 P b7ab4784c7344b939bc36f639286f377 [term 14 FOLLOWER]: Refusing update from remote peer ccd8a4c3bfe3413cb2ae219b09aea832: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 14 index: 9. (term mismatch)
I20260709 13:20:24.658919  6803 raft_consensus.cc:2468] T 95a75bfe094d4bdc963aba3f08dfcd25 P b7ab4784c7344b939bc36f639286f377 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 13.
I20260709 13:20:24.659749  6799 pending_rounds.cc:85] T a1704639a875409b9959353527b3fd68 P b7ab4784c7344b939bc36f639286f377: Aborting all ops after (but not including) 8
I20260709 13:20:24.658878  6802 raft_consensus.cc:1275] T 853ac0a8cbd64ce99457f170216d4d0f P b7ab4784c7344b939bc36f639286f377 [term 10 FOLLOWER]: Refusing update from remote peer ccd8a4c3bfe3413cb2ae219b09aea832: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:20:24.602536 11010 raft_consensus.cc:2749] T a3022224cc81473690653a83d4e99470 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:20:24.646864 11521 consensus_queue.cc:1059] T a3022224cc81473690653a83d4e99470 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: INVALID_TERM, Last received: 13.7, Next index: 8, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:20:24.658622  6878 consensus_queue.cc:260] T de3186201e1a40d0b335eeb8b4e256e0 P cd75a17ab2604397adab03bb8b5fd75c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:24.660164  6799 pending_rounds.cc:107] T a1704639a875409b9959353527b3fd68 P b7ab4784c7344b939bc36f639286f377: Aborting uncommitted NO_OP operation due to leader change: 13.9
I20260709 13:20:24.661862  6844 leader_election.cc:304] T c4db81d9d329422bb3b4160ca4ac2d1d P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:20:24.641160 11423 raft_consensus.cc:3060] T be1a92657f494cac8dd227d152f50151 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:24.666486  6878 raft_consensus.cc:3060] T de3186201e1a40d0b335eeb8b4e256e0 P cd75a17ab2604397adab03bb8b5fd75c [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:24.667564  6844 leader_election.cc:304] T 8c7f33e544204fbaac4078e3e83bbf4e P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:20:24.667629  6770 leader_election.cc:304] T bd6869f07b5a4885a0b99fbe60c3b175 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
W20260709 13:20:24.669793 11448 consensus_meta.cc:287] T 427c124d773f483294511e80fe340075 P 7ba59cc884714e8aa5f3f0ecaed84cbb: Time spent flushing consensus metadata: real 0.552s	user 0.014s	sys 0.000s
I20260709 13:20:24.628270 11510 leader_election.cc:290] T bb3d8792045a4583ae2e965b1350a5b4 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:20:24.672935 11510 raft_consensus.cc:2749] T c4db81d9d329422bb3b4160ca4ac2d1d P cd75a17ab2604397adab03bb8b5fd75c [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:20:24.673131  6731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab432e62819d499eaaf3dd55481dd930" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:24.673638 11510 raft_consensus.cc:2749] T 8c7f33e544204fbaac4078e3e83bbf4e P cd75a17ab2604397adab03bb8b5fd75c [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:20:24.675292  6799 raft_consensus.cc:2889] T a1704639a875409b9959353527b3fd68 P b7ab4784c7344b939bc36f639286f377 [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:20:24.676146 11444 raft_consensus.cc:493] T 427c124d773f483294511e80fe340075 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:24.676741 11444 raft_consensus.cc:515] T 427c124d773f483294511e80fe340075 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } attrs { replace: true } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:20:24.677908  6872 leader_election.cc:290] T 3d65025eea89441290d85dd053810e31 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 13 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:20:24.678525  6872 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RunLeaderElection from 127.0.0.1:53406 (request call id 2247) took 1563 ms. Trace:
I20260709 13:20:24.678838  6872 rpcz_store.cc:276] 0709 13:20:23.114773 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:23.798539 (+683766us) service_pool.cc:224] Handling call
0709 13:20:24.676630 (+878091us) spinlock_profiling.cc:243] Waited 63.6 ms on lock 0x7b54002198d4. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f9a1a3d 00007fcc14971cd0 00007fcc0def6254 00007fcc0def61e2 00007fcc0def6111 00007fcc0def608c 00007fcc0def5342 00007fcc0dce548c 00007fcc0dce48c6 00007fcc0dce426f
0709 13:20:24.678414 (+  1784us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":146377600}
I20260709 13:20:24.680315  7498 raft_consensus.cc:2468] T 427c124d773f483294511e80fe340075 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 11.
W20260709 13:20:24.681025  7495 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50742 (request call id 444) took 2704 ms (client timeout 2134 ms). Trace:
W20260709 13:20:24.681452  7495 rpcz_store.cc:269] 0709 13:20:21.976452 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:21.976621 (+   169us) service_pool.cc:224] Handling call
0709 13:20:24.680737 (+2704116us) spinlock_profiling.cc:243] Waited 2.4 s on lock 0x7b54005a0354. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f9ae2fa 00007fcc1496fb17 00007fcc0deea6d4 00007fcc0deea662 00007fcc0deea591 00007fcc0deea50c 00007fcc0dee97c2 00007fcc0dce548c 00007fcc0dce48c6 00007fcc0dce426f
0709 13:20:24.680900 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5526769408}
W20260709 13:20:24.681878  7498 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50742 (request call id 447) took 2239 ms (client timeout 1552 ms). Trace:
W20260709 13:20:24.682267  7498 rpcz_store.cc:269] 0709 13:20:22.442874 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:22.492878 (+ 50004us) service_pool.cc:224] Handling call
0709 13:20:24.681702 (+2188824us) spinlock_profiling.cc:243] Waited 1.99 s on lock 0x7b54005b1b54. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f9ae2fa 00007fcc1496fb17 00007fcc0deea6d4 00007fcc0deea662 00007fcc0deea591 00007fcc0deea50c 00007fcc0dee97c2 00007fcc0dce548c 00007fcc0dce48c6 00007fcc0dce426f
0709 13:20:24.681811 (+   109us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4578249600}
I20260709 13:20:24.684455  7496 raft_consensus.cc:1275] T bb3d8792045a4583ae2e965b1350a5b4 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 11 FOLLOWER]: Refusing update from remote peer ccd8a4c3bfe3413cb2ae219b09aea832: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 13:20:24.685503 11277 raft_consensus.cc:493] T f03d0dbf16864ca4bc1bb5e4c0334c0f P b7ab4784c7344b939bc36f639286f377 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:24.685715 11411 raft_consensus.cc:3060] T 20f6842e26174571996b8dea4151d4be P ccd8a4c3bfe3413cb2ae219b09aea832 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:24.686195 11277 raft_consensus.cc:515] T f03d0dbf16864ca4bc1bb5e4c0334c0f P b7ab4784c7344b939bc36f639286f377 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:24.664057 11172 consensus_queue.cc:1048] T 1bf4668eeb70467fb3dc5a0289233b3c P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.011s
I20260709 13:20:24.673913  6731 raft_consensus.cc:2468] T ab432e62819d499eaaf3dd55481dd930 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 14.
I20260709 13:20:24.692903  7502 raft_consensus.cc:2468] T 17587d6730594da4a56fa13a353232a1 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 18.
I20260709 13:20:24.600023 11547 consensus_queue.cc:1059] T ce4f062dcd314d43a63ca74067cb5ee3 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } attrs { replace: true }, Status: INVALID_TERM, Last received: 12.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.080s
I20260709 13:20:24.667270 11124 raft_consensus.cc:493] T 1bf4668eeb70467fb3dc5a0289233b3c P ccd8a4c3bfe3413cb2ae219b09aea832 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:24.666535 11494 raft_consensus.cc:3060] T 711ef6523deb4cbe8ef2ba61e1c21c98 P b7ab4784c7344b939bc36f639286f377 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:24.710548  6731 raft_consensus.cc:1275] T e31b9971c15848dea59d4d4130141d9e P ccd8a4c3bfe3413cb2ae219b09aea832 [term 11 FOLLOWER]: Refusing update from remote peer b7ab4784c7344b939bc36f639286f377: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:20:24.717337  6802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30e88460611e47b2ba16a46a30b5f416" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:24.717780  6803 raft_consensus.cc:1240] T f58dc08b12a2494bb9a1372837970ca2 P b7ab4784c7344b939bc36f639286f377 [term 16 FOLLOWER]: Rejecting Update request from peer cd75a17ab2604397adab03bb8b5fd75c for earlier term 15. Current term is 16. Ops: []
W20260709 13:20:24.717964  6847 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:24.718221  6802 raft_consensus.cc:2468] T 30e88460611e47b2ba16a46a30b5f416 P b7ab4784c7344b939bc36f639286f377 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 11.
I20260709 13:20:24.719049  6803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22ccee1b570c4ad3a57bd7aec085b1b4" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
W20260709 13:20:24.722131  7468 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:24.662029 11439 consensus_queue.cc:1048] T b56bf91d90824c959e21e0cee5ba1816 P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.047s
I20260709 13:20:24.661939 11436 raft_consensus.cc:515] T e77e330a82df4b43a745d57a68f6f057 P cd75a17ab2604397adab03bb8b5fd75c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } }
I20260709 13:20:24.730010  6731 raft_consensus.cc:1240] T f58dc08b12a2494bb9a1372837970ca2 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 16 FOLLOWER]: Rejecting Update request from peer cd75a17ab2604397adab03bb8b5fd75c for earlier term 15. Current term is 16. Ops: [15.8-15.8]
I20260709 13:20:24.720611 11458 raft_consensus.cc:493] T d8cee0accdb8499c86d4414b72565a38 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:24.733997 11521 raft_consensus.cc:3055] T a3022224cc81473690653a83d4e99470 P b7ab4784c7344b939bc36f639286f377 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:20:24.736850 11342 leader_election.cc:290] T be1a92657f494cac8dd227d152f50151 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 15 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:20:24.737736 11468 raft_consensus.cc:2804] T f09c2a98de1a4decabd0ff900dd44caa P ccd8a4c3bfe3413cb2ae219b09aea832 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:20:24.740424  6726 raft_consensus.cc:1275] T 4d9def8b32fd443aa94ab1420b06837b P ccd8a4c3bfe3413cb2ae219b09aea832 [term 13 FOLLOWER]: Refusing update from remote peer cd75a17ab2604397adab03bb8b5fd75c: Log matching property violated. Preceding OpId in replica: term: 12 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 13:20:24.742610 11524 leader_election.cc:290] T fe20b4b48823486ca3b9c648db6ce8aa P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
W20260709 13:20:24.744076  6772 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 555122us
I20260709 13:20:24.761322  6731 raft_consensus.cc:1240] T de3186201e1a40d0b335eeb8b4e256e0 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 14 LEADER]: Rejecting Update request from peer cd75a17ab2604397adab03bb8b5fd75c for earlier term 13. Current term is 14. Ops: [13.8-13.8]
I20260709 13:20:24.743927  6799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d65025eea89441290d85dd053810e31" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:20:24.761704  6772 leader_election.cc:304] T e77e330a82df4b43a745d57a68f6f057 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:20:24.713111 11341 raft_consensus.cc:2804] T bd6869f07b5a4885a0b99fbe60c3b175 P b7ab4784c7344b939bc36f639286f377 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:20:24.755048 11521 raft_consensus.cc:740] T a3022224cc81473690653a83d4e99470 P b7ab4784c7344b939bc36f639286f377 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
I20260709 13:20:24.765849  7498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ba5dac66ab5497e9e336f2a3c28cda5" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:20:24.766712  7498 raft_consensus.cc:2468] T 7ba5dac66ab5497e9e336f2a3c28cda5 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 13.
I20260709 13:20:24.767659  7502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fa34c08b205435dba97346991aa1f92" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:20:24.768615  7502 raft_consensus.cc:2468] T 3fa34c08b205435dba97346991aa1f92 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 15.
I20260709 13:20:24.721899 11124 raft_consensus.cc:515] T 1bf4668eeb70467fb3dc5a0289233b3c P ccd8a4c3bfe3413cb2ae219b09aea832 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:24.770884  7495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3d8792045a4583ae2e965b1350a5b4" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:20:24.766254 11521 consensus_queue.cc:260] T a3022224cc81473690653a83d4e99470 P b7ab4784c7344b939bc36f639286f377 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:24.763589 11341 raft_consensus.cc:493] T bd6869f07b5a4885a0b99fbe60c3b175 P b7ab4784c7344b939bc36f639286f377 [term 12 FOLLOWER]: Starting leader election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:20:24.772007  6772 leader_election.cc:304] T 4f00a2e87e56452083b759f60d461ee3 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb
I20260709 13:20:24.784711  7495 raft_consensus.cc:2410] T bb3d8792045a4583ae2e965b1350a5b4 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c for term 12 because replica has last-logged OpId of term: 10 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 9.
W20260709 13:20:24.791029  6697 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 155422us
I20260709 13:20:24.790949  6846 leader_election.cc:304] T 7ba5dac66ab5497e9e336f2a3c28cda5 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
W20260709 13:20:24.791934  6770 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:24.801270  6770 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:24.801540  6846 leader_election.cc:304] T 3fa34c08b205435dba97346991aa1f92 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
W20260709 13:20:24.802510  6770 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:24.803182  6770 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:24.802590  6697 leader_election.cc:304] T ce4f062dcd314d43a63ca74067cb5ee3 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:20:24.808178  7498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe20b4b48823486ca3b9c648db6ce8aa" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:20:24.809263  7498 raft_consensus.cc:2468] T fe20b4b48823486ca3b9c648db6ce8aa P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 11.
I20260709 13:20:24.769598 11342 raft_consensus.cc:2749] T e77e330a82df4b43a745d57a68f6f057 P b7ab4784c7344b939bc36f639286f377 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:20:24.811095  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 143616us
I20260709 13:20:24.816529  6844 leader_election.cc:304] T f3f9c2e2bf644115957398fe4c9459db P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:20:24.820658  6772 leader_election.cc:304] T f4b8bd455d5a47c18a1380839c6e0d61 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:20:24.824638 11292 raft_consensus.cc:2749] T f4b8bd455d5a47c18a1380839c6e0d61 P b7ab4784c7344b939bc36f639286f377 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:20:24.780773 11468 raft_consensus.cc:697] T f09c2a98de1a4decabd0ff900dd44caa P ccd8a4c3bfe3413cb2ae219b09aea832 [term 14 LEADER]: Becoming Leader. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
I20260709 13:20:24.797067 11277 leader_election.cc:290] T f03d0dbf16864ca4bc1bb5e4c0334c0f P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:24.827464  6881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbdf895bba214ff68685a24fd17dfb5d" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 11 candidate_status { last_received { term: 10 index: 4 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:24.804708 11341 raft_consensus.cc:3060] T bd6869f07b5a4885a0b99fbe60c3b175 P b7ab4784c7344b939bc36f639286f377 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:24.825109  6772 leader_election.cc:304] T 4275cf08e63345f993bce8664eada830 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:20:24.820526  6844 leader_election.cc:304] T 7887766dc6784fcaa42b35c05fea7a99 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:20:24.838227  6844 leader_election.cc:304] T d33d5ee8ef6f415593d8df52063161ad P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:20:24.814908  6872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6869f07b5a4885a0b99fbe60c3b175" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:24.839308  6872 raft_consensus.cc:2468] T bd6869f07b5a4885a0b99fbe60c3b175 P cd75a17ab2604397adab03bb8b5fd75c [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 13.
I20260709 13:20:24.841334  6872 raft_consensus.cc:1240] T a1704639a875409b9959353527b3fd68 P cd75a17ab2604397adab03bb8b5fd75c [term 14 FOLLOWER]: Rejecting Update request from peer b7ab4784c7344b939bc36f639286f377 for earlier term 13. Current term is 14. Ops: [12.8-13.9]
I20260709 13:20:24.843226  6872 raft_consensus.cc:1240] T 34f36d59d88f40fe8a2805e604fc6c0a P cd75a17ab2604397adab03bb8b5fd75c [term 10 FOLLOWER]: Rejecting Update request from peer b7ab4784c7344b939bc36f639286f377 for earlier term 9. Current term is 10. Ops: [9.6-9.6]
W20260709 13:20:24.826144  6695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 226522us
I20260709 13:20:24.759227 11458 raft_consensus.cc:515] T d8cee0accdb8499c86d4414b72565a38 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:20:24.810045 11524 raft_consensus.cc:2804] T 3fa34c08b205435dba97346991aa1f92 P cd75a17ab2604397adab03bb8b5fd75c [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:20:24.845728  6695 leader_election.cc:304] T f3f9c2e2bf644115957398fe4c9459db P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:20:24.846004  6844 leader_election.cc:304] T 7a734b5ab7834e05a8c422208acc58b1 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:20:24.847949  6872 raft_consensus.cc:1275] T f5be3a11b23d4ea9b08300a2789821c7 P cd75a17ab2604397adab03bb8b5fd75c [term 11 FOLLOWER]: Refusing update from remote peer b7ab4784c7344b939bc36f639286f377: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:20:24.848151  6877 raft_consensus.cc:1275] T 1bf4668eeb70467fb3dc5a0289233b3c P cd75a17ab2604397adab03bb8b5fd75c [term 13 FOLLOWER]: Refusing update from remote peer b7ab4784c7344b939bc36f639286f377: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:20:24.848194  6772 leader_election.cc:304] T 20f6842e26174571996b8dea4151d4be P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:20:24.849433  6877 raft_consensus.cc:1275] T e31b9971c15848dea59d4d4130141d9e P cd75a17ab2604397adab03bb8b5fd75c [term 11 FOLLOWER]: Refusing update from remote peer b7ab4784c7344b939bc36f639286f377: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:20:24.849820  6872 raft_consensus.cc:1275] T 34f36d59d88f40fe8a2805e604fc6c0a P cd75a17ab2604397adab03bb8b5fd75c [term 10 FOLLOWER]: Refusing update from remote peer ccd8a4c3bfe3413cb2ae219b09aea832: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:20:24.856997  6876 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53406 (request call id 2246) took 1770 ms. Trace:
I20260709 13:20:24.857583  6876 rpcz_store.cc:276] 0709 13:20:23.087054 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:23.755902 (+668848us) service_pool.cc:224] Handling call
0709 13:20:23.760200 (+  4298us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:24.057481 (+297281us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:24.856657 (+799176us) spinlock_profiling.cc:243] Waited 263 ms on lock 0x7b54002198d4. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f9aae01 00007fcc0f9a983e 00007fcc1496e419 00007fcc0dee5bd4 00007fcc0dee5b62 00007fcc0dee5a91 00007fcc0dee5a0c 00007fcc0dee4cc2 00007fcc0dce548c 00007fcc0dce48c6
0709 13:20:24.856916 (+   259us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":603954560}
I20260709 13:20:24.861027  6799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be1a92657f494cac8dd227d152f50151" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:24.832206  6846 leader_election.cc:304] T fe20b4b48823486ca3b9c648db6ce8aa P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:20:24.822474  6875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90d42e216d9741e190bca19a781291fd" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:20:24.834139  6881 raft_consensus.cc:2393] T dbdf895bba214ff68685a24fd17dfb5d P cd75a17ab2604397adab03bb8b5fd75c [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ccd8a4c3bfe3413cb2ae219b09aea832 in current term 11: Already voted for candidate cd75a17ab2604397adab03bb8b5fd75c in this term.
I20260709 13:20:24.806159 11439 raft_consensus.cc:2804] T 7ba5dac66ab5497e9e336f2a3c28cda5 P cd75a17ab2604397adab03bb8b5fd75c [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:20:24.864228  6799 raft_consensus.cc:2393] T be1a92657f494cac8dd227d152f50151 P b7ab4784c7344b939bc36f639286f377 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in current term 15: Already voted for candidate b7ab4784c7344b939bc36f639286f377 in this term.
I20260709 13:20:24.813958 11172 raft_consensus.cc:2804] T 4f00a2e87e56452083b759f60d461ee3 P b7ab4784c7344b939bc36f639286f377 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:20:24.818252 11521 raft_consensus.cc:3060] T a3022224cc81473690653a83d4e99470 P b7ab4784c7344b939bc36f639286f377 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:24.888788  6879 raft_consensus.cc:1275] T c4db81d9d329422bb3b4160ca4ac2d1d P cd75a17ab2604397adab03bb8b5fd75c [term 12 FOLLOWER]: Refusing update from remote peer b7ab4784c7344b939bc36f639286f377: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:20:24.826339 11510 raft_consensus.cc:2749] T f3f9c2e2bf644115957398fe4c9459db P cd75a17ab2604397adab03bb8b5fd75c [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:20:24.873548  6732 raft_consensus.cc:1275] T c4db81d9d329422bb3b4160ca4ac2d1d P ccd8a4c3bfe3413cb2ae219b09aea832 [term 12 FOLLOWER]: Refusing update from remote peer b7ab4784c7344b939bc36f639286f377: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 7. (term mismatch)
I20260709 13:20:24.894945  6732 pending_rounds.cc:85] T c4db81d9d329422bb3b4160ca4ac2d1d P ccd8a4c3bfe3413cb2ae219b09aea832: Aborting all ops after (but not including) 6
I20260709 13:20:24.895315  6732 pending_rounds.cc:107] T c4db81d9d329422bb3b4160ca4ac2d1d P ccd8a4c3bfe3413cb2ae219b09aea832: Aborting uncommitted NO_OP operation due to leader change: 11.7
I20260709 13:20:24.895648  6732 raft_consensus.cc:2889] T c4db81d9d329422bb3b4160ca4ac2d1d P ccd8a4c3bfe3413cb2ae219b09aea832 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:20:24.866411 11439 raft_consensus.cc:493] T 7ba5dac66ab5497e9e336f2a3c28cda5 P cd75a17ab2604397adab03bb8b5fd75c [term 12 FOLLOWER]: Starting leader election (detected failure of leader 7ba59cc884714e8aa5f3f0ecaed84cbb)
W20260709 13:20:24.666664 11316 consensus_queue.cc:1175] T de3186201e1a40d0b335eeb8b4e256e0 P cd75a17ab2604397adab03bb8b5fd75c [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "b7ab4784c7344b939bc36f639286f377" responder_term: 14 status { last_received { term: 11 index: 7 } last_committed_idx: 7 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer cd75a17ab2604397adab03bb8b5fd75c for earlier term 13. Current term is 14. Ops: [13.8-13.8]" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:20:24.871747  6880 raft_consensus.cc:1240] T 711ef6523deb4cbe8ef2ba61e1c21c98 P cd75a17ab2604397adab03bb8b5fd75c [term 14 LEADER]: Rejecting Update request from peer b7ab4784c7344b939bc36f639286f377 for earlier term 13. Current term is 14. Ops: []
I20260709 13:20:24.892386  6728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "427c124d773f483294511e80fe340075" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:24.901381  6728 raft_consensus.cc:2468] T 427c124d773f483294511e80fe340075 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in term 11.
W20260709 13:20:24.893404  6845 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:24.817034 11354 consensus_queue.cc:1048] T 8c7f33e544204fbaac4078e3e83bbf4e P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.063s
I20260709 13:20:24.862600 11524 raft_consensus.cc:493] T 3fa34c08b205435dba97346991aa1f92 P cd75a17ab2604397adab03bb8b5fd75c [term 14 FOLLOWER]: Starting leader election (detected failure of leader 7ba59cc884714e8aa5f3f0ecaed84cbb)
I20260709 13:20:24.819527 11547 consensus_queue.cc:1048] T 7887766dc6784fcaa42b35c05fea7a99 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.069s
I20260709 13:20:24.865715 11277 raft_consensus.cc:2804] T 4275cf08e63345f993bce8664eada830 P b7ab4784c7344b939bc36f639286f377 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:20:24.864457 11066 raft_consensus.cc:2749] T d33d5ee8ef6f415593d8df52063161ad P cd75a17ab2604397adab03bb8b5fd75c [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:20:24.892431 11536 log.cc:927] Time spent T 9b3759de40694069b13c0f8bd40e5709 P cd75a17ab2604397adab03bb8b5fd75c: Append to log took a long time: real 0.720s	user 0.006s	sys 0.000s
I20260709 13:20:24.911156  6800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90d42e216d9741e190bca19a781291fd" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
W20260709 13:20:24.912508  7467 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:24.826274 11504 consensus_queue.cc:1059] T f3f9c2e2bf644115957398fe4c9459db P b7ab4784c7344b939bc36f639286f377 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.068s
I20260709 13:20:24.867229 11403 raft_consensus.cc:2804] T 20f6842e26174571996b8dea4151d4be P b7ab4784c7344b939bc36f639286f377 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:20:24.834950 11211 consensus_queue.cc:1048] T 7a734b5ab7834e05a8c422208acc58b1 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.064s
W20260709 13:20:24.931015  6845 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:24.888342 11561 raft_consensus.cc:2749] T 7887766dc6784fcaa42b35c05fea7a99 P cd75a17ab2604397adab03bb8b5fd75c [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:20:24.868933 11292 consensus_queue.cc:1059] T 4d9def8b32fd443aa94ab1420b06837b P b7ab4784c7344b939bc36f639286f377 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: INVALID_TERM, Last received: 12.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.046s
I20260709 13:20:24.898264 11439 raft_consensus.cc:3060] T 7ba5dac66ab5497e9e336f2a3c28cda5 P cd75a17ab2604397adab03bb8b5fd75c [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:24.890278 11336 consensus_queue.cc:1059] T b3f13b31a1f84f0d89d007eadd57924c P 7ba59cc884714e8aa5f3f0ecaed84cbb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.053s
I20260709 13:20:24.912360 11524 raft_consensus.cc:3060] T 3fa34c08b205435dba97346991aa1f92 P cd75a17ab2604397adab03bb8b5fd75c [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:20:24.963418 11558 log.cc:927] Time spent T 4b8cacb381b746da8d0049b0a83b41dd P ccd8a4c3bfe3413cb2ae219b09aea832: Append to log took a long time: real 0.099s	user 0.000s	sys 0.000s
I20260709 13:20:24.964758 11354 raft_consensus.cc:493] T 3411566abe2d4c9bb4b2adfdd05e6f17 P b7ab4784c7344b939bc36f639286f377 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:24.965752 11567 raft_consensus.cc:2749] T ce4f062dcd314d43a63ca74067cb5ee3 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:20:24.966089 11563 raft_consensus.cc:3060] T f3f9c2e2bf644115957398fe4c9459db P ccd8a4c3bfe3413cb2ae219b09aea832 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:20:24.966624 11567 raft_consensus.cc:493] T f4b8bd455d5a47c18a1380839c6e0d61 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:24.939332 11373 consensus_queue.cc:1059] T 22ccee1b570c4ad3a57bd7aec085b1b4 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.028s
I20260709 13:20:24.967212 11567 raft_consensus.cc:515] T f4b8bd455d5a47c18a1380839c6e0d61 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:24.919371 11277 raft_consensus.cc:493] T 4275cf08e63345f993bce8664eada830 P b7ab4784c7344b939bc36f639286f377 [term 12 FOLLOWER]: Starting leader election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:20:24.968303 11277 raft_consensus.cc:3060] T 4275cf08e63345f993bce8664eada830 P b7ab4784c7344b939bc36f639286f377 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:24.969231  6874 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53406 (request call id 2240) took 1926 ms. Trace:
I20260709 13:20:24.969681  6874 rpcz_store.cc:276] 0709 13:20:23.042915 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:23.743399 (+700484us) service_pool.cc:224] Handling call
0709 13:20:23.743763 (+   364us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:23.785302 (+ 41539us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:23.785327 (+    25us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:20:23.785911 (+   584us) log.cc:844] Serialized 26 byte log entry
0709 13:20:24.077905 (+291994us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:20:24.077944 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:24.078009 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:24.855357 (+777348us) spinlock_profiling.cc:243] Waited 2.93 ms on lock 0x7b4400022b4c. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0c745db1 00007fcc0c7e3c85 00007fcc0c7e46a2 00007fcc0f5561db 00007fcc0f551aaf 00007fcc0f54586e 00007fcc0f544bb6 00007fcc0f5447d8 00007fcc0f54e221 00007fcc0f54e1d9 00007fcc0f54e169
0709 13:20:24.968799 (+113442us) raft_consensus.cc:1685] finished
0709 13:20:24.968824 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:24.969153 (+   329us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":142,"raft.run_cpu_time_us":139,"raft.run_wall_time_us":18429,"spinlock_wait_cycles":6729984,"thread_start_us":276833,"threads_started":1,"wal-append.queue_time_us":320047}
I20260709 13:20:24.946756 11423 raft_consensus.cc:515] T be1a92657f494cac8dd227d152f50151 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:20:24.973563 11423 leader_election.cc:290] T be1a92657f494cac8dd227d152f50151 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 15 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:20:24.975713  6878 raft_consensus.cc:1275] T de3186201e1a40d0b335eeb8b4e256e0 P cd75a17ab2604397adab03bb8b5fd75c [term 14 FOLLOWER]: Refusing update from remote peer ccd8a4c3bfe3413cb2ae219b09aea832: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 8. (term mismatch)
I20260709 13:20:24.976315  6878 pending_rounds.cc:85] T de3186201e1a40d0b335eeb8b4e256e0 P cd75a17ab2604397adab03bb8b5fd75c: Aborting all ops after (but not including) 7
I20260709 13:20:24.976578  6878 pending_rounds.cc:107] T de3186201e1a40d0b335eeb8b4e256e0 P cd75a17ab2604397adab03bb8b5fd75c: Aborting uncommitted NO_OP operation due to leader change: 13.8
I20260709 13:20:24.977178  6878 raft_consensus.cc:2889] T de3186201e1a40d0b335eeb8b4e256e0 P cd75a17ab2604397adab03bb8b5fd75c [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:20:24.888206 11549 consensus_queue.cc:1048] T 07a92dd554674067a83a9cb68c4773f2 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.113s
I20260709 13:20:24.887830 11556 consensus_queue.cc:1059] T dbdf895bba214ff68685a24fd17dfb5d P b7ab4784c7344b939bc36f639286f377 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: INVALID_TERM, Last received: 10.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.113s
I20260709 13:20:24.980249  6723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be1a92657f494cac8dd227d152f50151" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:20:24.981361  6723 raft_consensus.cc:3060] T be1a92657f494cac8dd227d152f50151 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 13 FOLLOWER]: Advancing to term 15
I20260709 13:20:24.965420 11354 raft_consensus.cc:515] T 3411566abe2d4c9bb4b2adfdd05e6f17 P b7ab4784c7344b939bc36f639286f377 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
W20260709 13:20:24.985694  6695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 140047us
I20260709 13:20:24.982797  6878 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53416 (request call id 3023) took 1157 ms. Trace:
I20260709 13:20:24.943058 11510 raft_consensus.cc:2749] T 7a734b5ab7834e05a8c422208acc58b1 P cd75a17ab2604397adab03bb8b5fd75c [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:20:24.988323  6878 rpcz_store.cc:276] 0709 13:20:23.825534 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:24.656858 (+831324us) service_pool.cc:224] Handling call
0709 13:20:24.657137 (+   279us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:24.975346 (+318209us) spinlock_profiling.cc:243] Waited 205 ms on lock 0x7b54000f7420. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f921dc0 00007fcc0f9acd87 00007fcc0f9ad470 00007fcc0f9a9d8f 00007fcc0f9a983e 00007fcc1496e419 00007fcc0dee5bd4 00007fcc0dee5b62 00007fcc0dee5a91 00007fcc0dee5a0c
0709 13:20:24.977707 (+  2361us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:24.982702 (+  4995us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":470572288}
I20260709 13:20:24.947959 11436 leader_election.cc:290] T e77e330a82df4b43a745d57a68f6f057 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391)
I20260709 13:20:24.947455 11403 raft_consensus.cc:493] T 20f6842e26174571996b8dea4151d4be P b7ab4784c7344b939bc36f639286f377 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:20:24.977957 11455 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 14 current term: 14 is higher.
W20260709 13:20:24.998430  6697 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 195891us
I20260709 13:20:24.999759  6697 leader_election.cc:304] T 8c7f33e544204fbaac4078e3e83bbf4e P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:20:25.004395  6695 leader_election.cc:304] T 3d65025eea89441290d85dd053810e31 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:20:25.008948  6873 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53416 (request call id 3015) took 1186 ms. Trace:
I20260709 13:20:25.010100  6725 raft_consensus.cc:2468] T 20f6842e26174571996b8dea4151d4be P ccd8a4c3bfe3413cb2ae219b09aea832 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 14.
I20260709 13:20:24.963919 11124 leader_election.cc:290] T 1bf4668eeb70467fb3dc5a0289233b3c P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:24.984932 11066 raft_consensus.cc:2804] T fe20b4b48823486ca3b9c648db6ce8aa P cd75a17ab2604397adab03bb8b5fd75c [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 13:20:24.999028 11560 log.cc:927] Time spent T 3a485a995abc4807b6e511e45419f737 P ccd8a4c3bfe3413cb2ae219b09aea832: Append to log took a long time: real 0.244s	user 0.001s	sys 0.000s
I20260709 13:20:25.017751  6723 raft_consensus.cc:2468] T be1a92657f494cac8dd227d152f50151 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in term 15.
I20260709 13:20:25.001230 11403 raft_consensus.cc:3060] T 20f6842e26174571996b8dea4151d4be P b7ab4784c7344b939bc36f639286f377 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:24.976456  6624 catalog_manager.cc:5697] T ce4f062dcd314d43a63ca74067cb5ee3 P 7ba59cc884714e8aa5f3f0ecaed84cbb reported cstate change: term changed from 6 to 10, leader changed from ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65) to 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68). New cstate: current_term: 10 leader_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:20:25.028262  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 166330us
I20260709 13:20:25.010874 11386 raft_consensus.cc:493] T 20f6842e26174571996b8dea4151d4be P ccd8a4c3bfe3413cb2ae219b09aea832 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:20:25.048827  6846 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.68:45071, user_credentials={real_user=slave}} blocked reactor thread for 216775us
W20260709 13:20:25.050884  6772 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 184834us
I20260709 13:20:25.010053  6873 rpcz_store.cc:276] 0709 13:20:23.822921 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:24.646260 (+823339us) service_pool.cc:224] Handling call
0709 13:20:24.646626 (+   366us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:24.646857 (+   231us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:20:24.647202 (+   345us) log.cc:844] Serialized 14 byte log entry
0709 13:20:24.994909 (+347707us) log.cc:844] Serialized 14 byte log entry
0709 13:20:25.008508 (+ 13599us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:20:25.008562 (+    54us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:20:25.008617 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:25.008716 (+    99us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:25.008842 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":15692,"prepare.queue_time_us":13751,"prepare.run_cpu_time_us":95,"prepare.run_wall_time_us":98,"raft.queue_time_us":37768,"raft.run_cpu_time_us":327,"raft.run_wall_time_us":17943,"spinlock_wait_cycles":12695424,"thread_start_us":305188,"threads_started":1,"wal-append.queue_time_us":367021}
I20260709 13:20:25.058470 11386 raft_consensus.cc:515] T 20f6842e26174571996b8dea4151d4be P ccd8a4c3bfe3413cb2ae219b09aea832 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:25.059320  6772 leader_election.cc:304] T 9e326172347f45e99a0d482b5d8ef768 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:20:25.059883 11588 raft_consensus.cc:3055] T f3f9c2e2bf644115957398fe4c9459db P b7ab4784c7344b939bc36f639286f377 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:20:25.060300 11588 raft_consensus.cc:740] T f3f9c2e2bf644115957398fe4c9459db P b7ab4784c7344b939bc36f639286f377 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
I20260709 13:20:25.061143 11588 consensus_queue.cc:260] T f3f9c2e2bf644115957398fe4c9459db P b7ab4784c7344b939bc36f639286f377 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:25.062528 11588 raft_consensus.cc:3060] T f3f9c2e2bf644115957398fe4c9459db P b7ab4784c7344b939bc36f639286f377 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:20:25.064276 11546 raft_consensus.cc:493] T 7ba5dac66ab5497e9e336f2a3c28cda5 P b7ab4784c7344b939bc36f639286f377 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:25.064905 11546 raft_consensus.cc:515] T 7ba5dac66ab5497e9e336f2a3c28cda5 P b7ab4784c7344b939bc36f639286f377 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:20:25.066905 11436 raft_consensus.cc:493] T f03d0dbf16864ca4bc1bb5e4c0334c0f P cd75a17ab2604397adab03bb8b5fd75c [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:25.067620 11436 raft_consensus.cc:515] T f03d0dbf16864ca4bc1bb5e4c0334c0f P cd75a17ab2604397adab03bb8b5fd75c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:25.070643 11448 raft_consensus.cc:3055] T b3f13b31a1f84f0d89d007eadd57924c P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:20:25.071126 11448 raft_consensus.cc:740] T b3f13b31a1f84f0d89d007eadd57924c P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 7ba59cc884714e8aa5f3f0ecaed84cbb, State: Running, Role: LEADER
I20260709 13:20:25.073681  6844 leader_election.cc:304] T 30e88460611e47b2ba16a46a30b5f416 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
W20260709 13:20:25.075099  6725 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49998 (request call id 1134) took 1650 ms (client timeout 1581 ms). Trace:
I20260709 13:20:25.077077 11561 raft_consensus.cc:2804] T 30e88460611e47b2ba16a46a30b5f416 P cd75a17ab2604397adab03bb8b5fd75c [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:20:25.077755 11561 raft_consensus.cc:493] T 30e88460611e47b2ba16a46a30b5f416 P cd75a17ab2604397adab03bb8b5fd75c [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:25.078269 11561 raft_consensus.cc:3060] T 30e88460611e47b2ba16a46a30b5f416 P cd75a17ab2604397adab03bb8b5fd75c [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:20:24.989864 11564 consensus_queue.cc:1059] T f58dc08b12a2494bb9a1372837970ca2 P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.051s
I20260709 13:20:25.081841 11564 consensus_queue.cc:1243] T f58dc08b12a2494bb9a1372837970ca2 P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Peer b7ab4784c7344b939bc36f639286f377 log is divergent from this leader: its last log entry 14.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 13:20:25.082408 11564 raft_consensus.cc:3055] T f58dc08b12a2494bb9a1372837970ca2 P cd75a17ab2604397adab03bb8b5fd75c [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:20:25.082749 11564 raft_consensus.cc:740] T f58dc08b12a2494bb9a1372837970ca2 P cd75a17ab2604397adab03bb8b5fd75c [term 15 LEADER]: Becoming Follower/Learner. State: Replica: cd75a17ab2604397adab03bb8b5fd75c, State: Running, Role: LEADER
I20260709 13:20:25.084844 11577 raft_consensus.cc:3055] T 22ccee1b570c4ad3a57bd7aec085b1b4 P b7ab4784c7344b939bc36f639286f377 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:20:25.085345 11577 raft_consensus.cc:740] T 22ccee1b570c4ad3a57bd7aec085b1b4 P b7ab4784c7344b939bc36f639286f377 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
I20260709 13:20:25.086320 11577 consensus_queue.cc:260] T 22ccee1b570c4ad3a57bd7aec085b1b4 P b7ab4784c7344b939bc36f639286f377 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:25.020843 11066 raft_consensus.cc:493] T fe20b4b48823486ca3b9c648db6ce8aa P cd75a17ab2604397adab03bb8b5fd75c [term 10 FOLLOWER]: Starting leader election (detected failure of leader 7ba59cc884714e8aa5f3f0ecaed84cbb)
I20260709 13:20:25.089195 11066 raft_consensus.cc:3060] T fe20b4b48823486ca3b9c648db6ce8aa P cd75a17ab2604397adab03bb8b5fd75c [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:20:25.094825  6772 leader_election.cc:304] T b56bf91d90824c959e21e0cee5ba1816 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:20:25.097205  6728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c37d41cd9164c15a6826ca62a851a69" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:20:25.097711  6732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be1a92657f494cac8dd227d152f50151" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:20:25.098824  6732 raft_consensus.cc:2393] T be1a92657f494cac8dd227d152f50151 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate b7ab4784c7344b939bc36f639286f377 in current term 15: Already voted for candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in this term.
I20260709 13:20:25.097986  6728 raft_consensus.cc:3060] T 7c37d41cd9164c15a6826ca62a851a69 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 11 FOLLOWER]: Advancing to term 13
I20260709 13:20:25.108590  6729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3f13b31a1f84f0d89d007eadd57924c" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
W20260709 13:20:25.075583  6725 rpcz_store.cc:269] 0709 13:20:23.424502 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:23.426344 (+  1842us) service_pool.cc:224] Handling call
0709 13:20:25.074872 (+1648528us) spinlock_profiling.cc:243] Waited 1.58 s on lock 0x7b54003d4d54. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f9ae2fa 00007fcc1496fb17 00007fcc0deea6d4 00007fcc0deea662 00007fcc0deea591 00007fcc0deea50c 00007fcc0dee97c2 00007fcc0dce548c 00007fcc0dce48c6 00007fcc0dce426f
0709 13:20:25.075011 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3636991232}
I20260709 13:20:24.957813 11468 consensus_queue.cc:237] T f09c2a98de1a4decabd0ff900dd44caa P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:25.116117  6874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce4f062dcd314d43a63ca74067cb5ee3" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:20:25.114056  6772 leader_election.cc:304] T 7c44c4849aa54f2b94d1f1bef9ed546f P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:20:25.125279  6731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f03d0dbf16864ca4bc1bb5e4c0334c0f" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:25.118765  7466 leader_election.cc:304] T be1a92657f494cac8dd227d152f50151 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
I20260709 13:20:25.077446 11354 leader_election.cc:290] T 3411566abe2d4c9bb4b2adfdd05e6f17 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
W20260709 13:20:25.136802  6771 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:25.131279  6772 leader_election.cc:304] T 30e88460611e47b2ba16a46a30b5f416 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:20:25.133881  6879 raft_consensus.cc:1275] T bb7fa124c3bf4ef9ab65a407cb008441 P cd75a17ab2604397adab03bb8b5fd75c [term 14 FOLLOWER]: Refusing update from remote peer 7ba59cc884714e8aa5f3f0ecaed84cbb: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:20:25.141194  6844 leader_election.cc:304] T 24ee15416e3145beaa1b8183453729a3 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb
I20260709 13:20:25.111706 11316 raft_consensus.cc:493] T dbdf895bba214ff68685a24fd17dfb5d P cd75a17ab2604397adab03bb8b5fd75c [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:25.026989 11444 leader_election.cc:290] T 427c124d773f483294511e80fe340075 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:25.143421  6770 leader_election.cc:304] T f58dc08b12a2494bb9a1372837970ca2 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:20:25.057551 11172 raft_consensus.cc:697] T 4f00a2e87e56452083b759f60d461ee3 P b7ab4784c7344b939bc36f639286f377 [term 13 LEADER]: Becoming Leader. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
I20260709 13:20:25.150013  6772 leader_election.cc:304] T de3186201e1a40d0b335eeb8b4e256e0 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:20:25.147495  6725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3411566abe2d4c9bb4b2adfdd05e6f17" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:25.151326  6844 leader_election.cc:304] T ab432e62819d499eaaf3dd55481dd930 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377
I20260709 13:20:25.151535  6874 raft_consensus.cc:1275] T 4b8cacb381b746da8d0049b0a83b41dd P cd75a17ab2604397adab03bb8b5fd75c [term 14 FOLLOWER]: Refusing update from remote peer 7ba59cc884714e8aa5f3f0ecaed84cbb: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:20:25.151954  6800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "427c124d773f483294511e80fe340075" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:25.153569  6801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8cee0accdb8499c86d4414b72565a38" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:25.159662  6728 raft_consensus.cc:2468] T 7c37d41cd9164c15a6826ca62a851a69 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 13.
I20260709 13:20:25.155850  6805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be1a92657f494cac8dd227d152f50151" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:20:25.161278  6805 raft_consensus.cc:2393] T be1a92657f494cac8dd227d152f50151 P b7ab4784c7344b939bc36f639286f377 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in current term 15: Already voted for candidate b7ab4784c7344b939bc36f639286f377 in this term.
I20260709 13:20:25.159122  6800 raft_consensus.cc:2468] T 427c124d773f483294511e80fe340075 P b7ab4784c7344b939bc36f639286f377 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in term 11.
W20260709 13:20:25.125038 11495 consensus_meta.cc:287] T d8292e16e5654be6bc408560cf256aaa P b7ab4784c7344b939bc36f639286f377: Time spent flushing consensus metadata: real 0.567s	user 0.013s	sys 0.000s
I20260709 13:20:25.152482  6879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "427c124d773f483294511e80fe340075" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:25.159804  6801 raft_consensus.cc:2468] T d8cee0accdb8499c86d4414b72565a38 P b7ab4784c7344b939bc36f639286f377 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in term 12.
I20260709 13:20:25.135684 11577 raft_consensus.cc:3060] T 22ccee1b570c4ad3a57bd7aec085b1b4 P b7ab4784c7344b939bc36f639286f377 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:20:25.136243 11010 raft_consensus.cc:2804] T 8c7f33e544204fbaac4078e3e83bbf4e P ccd8a4c3bfe3413cb2ae219b09aea832 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:20:25.175848  6806 raft_consensus.cc:2410] T d8292e16e5654be6bc408560cf256aaa P b7ab4784c7344b939bc36f639286f377 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate ccd8a4c3bfe3413cb2ae219b09aea832 for term 17 because replica has last-logged OpId of term: 16 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 9.
I20260709 13:20:25.115513 11458 leader_election.cc:290] T d8cee0accdb8499c86d4414b72565a38 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:25.141547 11547 raft_consensus.cc:3055] T dbdf895bba214ff68685a24fd17dfb5d P b7ab4784c7344b939bc36f639286f377 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:20:25.156931 11211 raft_consensus.cc:2749] T b56bf91d90824c959e21e0cee5ba1816 P b7ab4784c7344b939bc36f639286f377 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:20:25.150947 11549 raft_consensus.cc:2804] T 9e326172347f45e99a0d482b5d8ef768 P b7ab4784c7344b939bc36f639286f377 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:20:25.163175 11423 raft_consensus.cc:2804] T be1a92657f494cac8dd227d152f50151 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:20:25.169368 11354 raft_consensus.cc:2804] T 7c44c4849aa54f2b94d1f1bef9ed546f P b7ab4784c7344b939bc36f639286f377 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:20:25.162269 11510 raft_consensus.cc:2804] T 24ee15416e3145beaa1b8183453729a3 P cd75a17ab2604397adab03bb8b5fd75c [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:20:25.189963 11495 raft_consensus.cc:2804] T 30e88460611e47b2ba16a46a30b5f416 P b7ab4784c7344b939bc36f639286f377 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:20:25.161966 11316 raft_consensus.cc:515] T dbdf895bba214ff68685a24fd17dfb5d P cd75a17ab2604397adab03bb8b5fd75c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:25.117877 11448 consensus_queue.cc:260] T b3f13b31a1f84f0d89d007eadd57924c P 7ba59cc884714e8aa5f3f0ecaed84cbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:20:25.188705 11010 raft_consensus.cc:493] T 8c7f33e544204fbaac4078e3e83bbf4e P ccd8a4c3bfe3413cb2ae219b09aea832 [term 10 FOLLOWER]: Starting leader election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:20:25.187559 11583 raft_consensus.cc:493] T d8cee0accdb8499c86d4414b72565a38 P b7ab4784c7344b939bc36f639286f377 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader cd75a17ab2604397adab03bb8b5fd75c)
I20260709 13:20:25.207326 11061 raft_consensus.cc:3055] T ce4f062dcd314d43a63ca74067cb5ee3 P b7ab4784c7344b939bc36f639286f377 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:20:25.190809 11547 raft_consensus.cc:740] T dbdf895bba214ff68685a24fd17dfb5d P b7ab4784c7344b939bc36f639286f377 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
I20260709 13:20:25.193969 11549 raft_consensus.cc:493] T 9e326172347f45e99a0d482b5d8ef768 P b7ab4784c7344b939bc36f639286f377 [term 11 FOLLOWER]: Starting leader election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:20:25.201251 11354 raft_consensus.cc:493] T 7c44c4849aa54f2b94d1f1bef9ed546f P b7ab4784c7344b939bc36f639286f377 [term 14 FOLLOWER]: Starting leader election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
W20260709 13:20:25.230955  7466 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 81047.2us
W20260709 13:20:25.210570 11424 consensus_meta.cc:287] T 2c240553ce044eedb41541d72b9475d7 P b7ab4784c7344b939bc36f639286f377: Time spent flushing consensus metadata: real 0.608s	user 0.003s	sys 0.008s
I20260709 13:20:25.200280 11556 raft_consensus.cc:493] T 34f36d59d88f40fe8a2805e604fc6c0a P b7ab4784c7344b939bc36f639286f377 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:20:25.238072  6847 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:25.229477 11061 raft_consensus.cc:740] T ce4f062dcd314d43a63ca74067cb5ee3 P b7ab4784c7344b939bc36f639286f377 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
I20260709 13:20:25.207676 11423 raft_consensus.cc:697] T be1a92657f494cac8dd227d152f50151 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 15 LEADER]: Becoming Leader. State: Replica: 7ba59cc884714e8aa5f3f0ecaed84cbb, State: Running, Role: LEADER
I20260709 13:20:25.244740 11423 consensus_queue.cc:237] T be1a92657f494cac8dd227d152f50151 P 7ba59cc884714e8aa5f3f0ecaed84cbb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:20:25.245260 11316 leader_election.cc:290] T dbdf895bba214ff68685a24fd17dfb5d P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:20:25.213858 11495 raft_consensus.cc:493] T 30e88460611e47b2ba16a46a30b5f416 P b7ab4784c7344b939bc36f639286f377 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:25.229704 11211 raft_consensus.cc:2749] T de3186201e1a40d0b335eeb8b4e256e0 P b7ab4784c7344b939bc36f639286f377 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:20:25.246929 11495 raft_consensus.cc:3060] T 30e88460611e47b2ba16a46a30b5f416 P b7ab4784c7344b939bc36f639286f377 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:20:25.238248 11549 raft_consensus.cc:3060] T 9e326172347f45e99a0d482b5d8ef768 P b7ab4784c7344b939bc36f639286f377 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:20:25.253880 11436 leader_election.cc:290] T f03d0dbf16864ca4bc1bb5e4c0334c0f P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
W20260709 13:20:25.255411 11573 log.cc:927] Time spent T 8c7f33e544204fbaac4078e3e83bbf4e P ccd8a4c3bfe3413cb2ae219b09aea832: Append to log took a long time: real 0.082s	user 0.000s	sys 0.000s
I20260709 13:20:25.230070 11010 raft_consensus.cc:3060] T 8c7f33e544204fbaac4078e3e83bbf4e P ccd8a4c3bfe3413cb2ae219b09aea832 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:20:25.259693 11455 raft_consensus.cc:493] T f4b8bd455d5a47c18a1380839c6e0d61 P cd75a17ab2604397adab03bb8b5fd75c [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:25.260398 11455 raft_consensus.cc:515] T f4b8bd455d5a47c18a1380839c6e0d61 P cd75a17ab2604397adab03bb8b5fd75c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:25.260679 11556 raft_consensus.cc:515] T 34f36d59d88f40fe8a2805e604fc6c0a P b7ab4784c7344b939bc36f639286f377 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:25.262907 11455 leader_election.cc:290] T f4b8bd455d5a47c18a1380839c6e0d61 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:20:25.239518 11292 consensus_queue.cc:1243] T 4d9def8b32fd443aa94ab1420b06837b P b7ab4784c7344b939bc36f639286f377 [LEADER]: Peer cd75a17ab2604397adab03bb8b5fd75c log is divergent from this leader: its last log entry 13.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
W20260709 13:20:25.265252 11566 log.cc:927] Time spent T 44bde925b2e541b69890d70715b85176 P b7ab4784c7344b939bc36f639286f377: Append to log took a long time: real 0.293s	user 0.005s	sys 0.000s
I20260709 13:20:25.262916 11556 leader_election.cc:290] T 34f36d59d88f40fe8a2805e604fc6c0a P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:25.270260 11386 leader_election.cc:290] T 20f6842e26174571996b8dea4151d4be P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:25.271808 11504 raft_consensus.cc:3055] T 4d9def8b32fd443aa94ab1420b06837b P b7ab4784c7344b939bc36f639286f377 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:20:25.272353 11504 raft_consensus.cc:740] T 4d9def8b32fd443aa94ab1420b06837b P b7ab4784c7344b939bc36f639286f377 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
W20260709 13:20:25.275836 11494 consensus_meta.cc:287] T 711ef6523deb4cbe8ef2ba61e1c21c98 P b7ab4784c7344b939bc36f639286f377: Time spent flushing consensus metadata: real 0.555s	user 0.009s	sys 0.003s
W20260709 13:20:25.280572 11568 log.cc:927] Time spent T 9b3759de40694069b13c0f8bd40e5709 P ccd8a4c3bfe3413cb2ae219b09aea832: Append to log took a long time: real 0.269s	user 0.000s	sys 0.001s
I20260709 13:20:25.235602 11583 raft_consensus.cc:515] T d8cee0accdb8499c86d4414b72565a38 P b7ab4784c7344b939bc36f639286f377 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:20:25.284479 11564 consensus_queue.cc:260] T f58dc08b12a2494bb9a1372837970ca2 P cd75a17ab2604397adab03bb8b5fd75c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 15.8, Last appended by leader: 8, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:25.285825 11511 leader_election.cc:290] T bb3d8792045a4583ae2e965b1350a5b4 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:25.289242 11172 consensus_queue.cc:237] T 4f00a2e87e56452083b759f60d461ee3 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:20:25.298439 11010 raft_consensus.cc:515] T 8c7f33e544204fbaac4078e3e83bbf4e P ccd8a4c3bfe3413cb2ae219b09aea832 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
W20260709 13:20:25.300275  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 142249us
I20260709 13:20:25.301846  6844 leader_election.cc:304] T 22ccee1b570c4ad3a57bd7aec085b1b4 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:20:25.285605 11549 raft_consensus.cc:515] T 9e326172347f45e99a0d482b5d8ef768 P b7ab4784c7344b939bc36f639286f377 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:25.208073 11567 leader_election.cc:290] T f4b8bd455d5a47c18a1380839c6e0d61 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:25.229959 11578 raft_consensus.cc:2804] T f58dc08b12a2494bb9a1372837970ca2 P b7ab4784c7344b939bc36f639286f377 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:20:25.240154 11354 raft_consensus.cc:3060] T 7c44c4849aa54f2b94d1f1bef9ed546f P b7ab4784c7344b939bc36f639286f377 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:25.210807 11576 raft_consensus.cc:2804] T ab432e62819d499eaaf3dd55481dd930 P cd75a17ab2604397adab03bb8b5fd75c [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 13:20:25.323594  7468 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:25.214335 11546 leader_election.cc:290] T 7ba5dac66ab5497e9e336f2a3c28cda5 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:20:25.321023 11436 raft_consensus.cc:493] T 4b8cacb381b746da8d0049b0a83b41dd P cd75a17ab2604397adab03bb8b5fd75c [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:25.341430 11436 raft_consensus.cc:515] T 4b8cacb381b746da8d0049b0a83b41dd P cd75a17ab2604397adab03bb8b5fd75c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:20:25.320768 11575 raft_consensus.cc:2749] T 22ccee1b570c4ad3a57bd7aec085b1b4 P cd75a17ab2604397adab03bb8b5fd75c [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:20:25.344000 11436 leader_election.cc:290] T 4b8cacb381b746da8d0049b0a83b41dd P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:20:25.345155 11578 raft_consensus.cc:697] T f58dc08b12a2494bb9a1372837970ca2 P b7ab4784c7344b939bc36f639286f377 [term 16 LEADER]: Becoming Leader. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
I20260709 13:20:25.349006 11578 consensus_queue.cc:237] T f58dc08b12a2494bb9a1372837970ca2 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.8, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:25.317421 11455 raft_consensus.cc:493] T ce4f062dcd314d43a63ca74067cb5ee3 P cd75a17ab2604397adab03bb8b5fd75c [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
W20260709 13:20:25.406538  6697 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 406568us
I20260709 13:20:25.496767  6697 leader_election.cc:304] T f5be3a11b23d4ea9b08300a2789821c7 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:20:25.499363  6697 leader_election.cc:304] T 3fa34c08b205435dba97346991aa1f92 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, cd75a17ab2604397adab03bb8b5fd75c
W20260709 13:20:25.410632  6773 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:25.311093  6844 leader_election.cc:304] T 3d65025eea89441290d85dd053810e31 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
W20260709 13:20:25.415870  7467 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:25.417521  7466 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 178351us
I20260709 13:20:25.420734 11010 leader_election.cc:290] T 8c7f33e544204fbaac4078e3e83bbf4e P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 11 election: Requested vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:25.423018 11316 raft_consensus.cc:493] T a1704639a875409b9959353527b3fd68 P cd75a17ab2604397adab03bb8b5fd75c [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:25.357503 11547 consensus_queue.cc:260] T dbdf895bba214ff68685a24fd17dfb5d P b7ab4784c7344b939bc36f639286f377 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 10.4, Last appended by leader: 4, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:25.333948 11564 raft_consensus.cc:3060] T f58dc08b12a2494bb9a1372837970ca2 P cd75a17ab2604397adab03bb8b5fd75c [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:25.525511 11316 raft_consensus.cc:515] T a1704639a875409b9959353527b3fd68 P cd75a17ab2604397adab03bb8b5fd75c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:25.427277 11567 raft_consensus.cc:2749] T 3d65025eea89441290d85dd053810e31 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:20:25.367442 11583 leader_election.cc:290] T d8cee0accdb8499c86d4414b72565a38 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:20:25.333797 11576 raft_consensus.cc:493] T ab432e62819d499eaaf3dd55481dd930 P cd75a17ab2604397adab03bb8b5fd75c [term 13 FOLLOWER]: Starting leader election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:20:25.529844 11576 raft_consensus.cc:3060] T ab432e62819d499eaaf3dd55481dd930 P cd75a17ab2604397adab03bb8b5fd75c [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:25.531512  6731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3d8792045a4583ae2e965b1350a5b4" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:25.468567 11510 raft_consensus.cc:697] T 24ee15416e3145beaa1b8183453729a3 P cd75a17ab2604397adab03bb8b5fd75c [term 15 LEADER]: Becoming Leader. State: Replica: cd75a17ab2604397adab03bb8b5fd75c, State: Running, Role: LEADER
I20260709 13:20:25.302901 11349 consensus_queue.cc:1059] T 4d9def8b32fd443aa94ab1420b06837b P b7ab4784c7344b939bc36f639286f377 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: INVALID_TERM, Last received: 12.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.053s
W20260709 13:20:25.410391  6695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 405866us
I20260709 13:20:25.538440  6695 leader_election.cc:304] T 7c37d41cd9164c15a6826ca62a851a69 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:20:25.546411 11010 raft_consensus.cc:2764] T 7c37d41cd9164c15a6826ca62a851a69 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 13 FOLLOWER]: Leader pre-election decision vote started in defunct term 11: won
I20260709 13:20:25.499559 11455 raft_consensus.cc:515] T ce4f062dcd314d43a63ca74067cb5ee3 P cd75a17ab2604397adab03bb8b5fd75c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } attrs { replace: true } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:20:25.502625 11549 leader_election.cc:290] T 9e326172347f45e99a0d482b5d8ef768 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 12 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:25.505043 11468 raft_consensus.cc:2804] T f5be3a11b23d4ea9b08300a2789821c7 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 13:20:25.511600  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 200449us
I20260709 13:20:25.511646 11591 raft_consensus.cc:2749] T 3d65025eea89441290d85dd053810e31 P cd75a17ab2604397adab03bb8b5fd75c [term 13 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:20:25.556223 11468 raft_consensus.cc:493] T f5be3a11b23d4ea9b08300a2789821c7 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 11 FOLLOWER]: Starting leader election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:20:25.557049 11468 raft_consensus.cc:3060] T f5be3a11b23d4ea9b08300a2789821c7 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:20:25.556651 11495 raft_consensus.cc:515] T 30e88460611e47b2ba16a46a30b5f416 P b7ab4784c7344b939bc36f639286f377 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:25.560637 11495 leader_election.cc:290] T 30e88460611e47b2ba16a46a30b5f416 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 12 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:25.534799 11510 consensus_queue.cc:237] T 24ee15416e3145beaa1b8183453729a3 P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:20:25.561071 11591 consensus_queue.cc:1048] T 4d9def8b32fd443aa94ab1420b06837b P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Connected to new peer: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:20:25.514708  7496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b8cacb381b746da8d0049b0a83b41dd" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:20:25.567654  6844 leader_election.cc:304] T 20f6842e26174571996b8dea4151d4be P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377
I20260709 13:20:25.575920 11596 raft_consensus.cc:493] T 24ee15416e3145beaa1b8183453729a3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:25.577032 11596 raft_consensus.cc:515] T 24ee15416e3145beaa1b8183453729a3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
W20260709 13:20:25.580647  7466 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 50396.5us
I20260709 13:20:25.582233 11316 leader_election.cc:290] T a1704639a875409b9959353527b3fd68 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
W20260709 13:20:25.583362 11403 consensus_meta.cc:287] T 20f6842e26174571996b8dea4151d4be P b7ab4784c7344b939bc36f639286f377: Time spent flushing consensus metadata: real 0.527s	user 0.014s	sys 0.005s
W20260709 13:20:25.584420  6770 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 409488us
I20260709 13:20:25.586074  6770 leader_election.cc:304] T ab432e62819d499eaaf3dd55481dd930 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
I20260709 13:20:25.587268 11578 consensus_queue.cc:1059] T 90d42e216d9741e190bca19a781291fd P b7ab4784c7344b939bc36f639286f377 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:20:25.588667 11583 raft_consensus.cc:2804] T ab432e62819d499eaaf3dd55481dd930 P b7ab4784c7344b939bc36f639286f377 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:20:25.587903  7466 leader_election.cc:304] T 427c124d773f483294511e80fe340075 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
I20260709 13:20:25.589303 11583 raft_consensus.cc:493] T ab432e62819d499eaaf3dd55481dd930 P b7ab4784c7344b939bc36f639286f377 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:25.589848 11583 raft_consensus.cc:3060] T ab432e62819d499eaaf3dd55481dd930 P b7ab4784c7344b939bc36f639286f377 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:25.589478 11578 consensus_queue.cc:1048] T e31b9971c15848dea59d4d4130141d9e P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:20:25.591025 11590 raft_consensus.cc:2804] T 427c124d773f483294511e80fe340075 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:20:25.591648 11590 raft_consensus.cc:493] T 427c124d773f483294511e80fe340075 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:25.592116 11590 raft_consensus.cc:3060] T 427c124d773f483294511e80fe340075 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:20:25.587172  7496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce4f062dcd314d43a63ca74067cb5ee3" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:20:25.593770 11592 consensus_queue.cc:1048] T c4db81d9d329422bb3b4160ca4ac2d1d P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.003s
I20260709 13:20:25.597922  7496 raft_consensus.cc:2393] T ce4f062dcd314d43a63ca74067cb5ee3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c in current term 13: Already voted for candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in this term.
I20260709 13:20:25.598691 11593 raft_consensus.cc:3055] T 90d42e216d9741e190bca19a781291fd P b7ab4784c7344b939bc36f639286f377 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:20:25.600090 11593 raft_consensus.cc:740] T 90d42e216d9741e190bca19a781291fd P b7ab4784c7344b939bc36f639286f377 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
I20260709 13:20:25.601902 11593 consensus_queue.cc:260] T 90d42e216d9741e190bca19a781291fd P b7ab4784c7344b939bc36f639286f377 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:25.604444 11593 raft_consensus.cc:3060] T 90d42e216d9741e190bca19a781291fd P b7ab4784c7344b939bc36f639286f377 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:25.608671 11448 raft_consensus.cc:3060] T b3f13b31a1f84f0d89d007eadd57924c P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:20:25.597640 11524 consensus_meta.cc:287] T 3fa34c08b205435dba97346991aa1f92 P cd75a17ab2604397adab03bb8b5fd75c: Time spent flushing consensus metadata: real 0.548s	user 0.007s	sys 0.014s
I20260709 13:20:25.607438 11061 consensus_queue.cc:260] T ce4f062dcd314d43a63ca74067cb5ee3 P b7ab4784c7344b939bc36f639286f377 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } attrs { replace: true } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:20:25.581194 11596 leader_election.cc:290] T 24ee15416e3145beaa1b8183453729a3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
W20260709 13:20:25.629045 11597 log.cc:927] Time spent T b56bf91d90824c959e21e0cee5ba1816 P cd75a17ab2604397adab03bb8b5fd75c: Append to log took a long time: real 0.112s	user 0.000s	sys 0.004s
I20260709 13:20:25.630339 11567 raft_consensus.cc:2749] T 3fa34c08b205435dba97346991aa1f92 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
W20260709 13:20:25.632687  6697 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 133705us
I20260709 13:20:25.633965  6697 leader_election.cc:304] T 07a92dd554674067a83a9cb68c4773f2 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377
I20260709 13:20:25.635362 11354 raft_consensus.cc:515] T 7c44c4849aa54f2b94d1f1bef9ed546f P b7ab4784c7344b939bc36f639286f377 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:25.638197  7466 leader_election.cc:304] T d8cee0accdb8499c86d4414b72565a38 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, b7ab4784c7344b939bc36f639286f377; no voters: 
I20260709 13:20:25.639801 11444 raft_consensus.cc:2804] T d8cee0accdb8499c86d4414b72565a38 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:20:25.640440 11444 raft_consensus.cc:493] T d8cee0accdb8499c86d4414b72565a38 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:25.640897 11444 raft_consensus.cc:3060] T d8cee0accdb8499c86d4414b72565a38 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:20:25.645630 11598 log.cc:927] Time spent T be1a92657f494cac8dd227d152f50151 P 7ba59cc884714e8aa5f3f0ecaed84cbb: Append to log took a long time: real 0.108s	user 0.001s	sys 0.001s
I20260709 13:20:25.646075 11561 raft_consensus.cc:515] T 30e88460611e47b2ba16a46a30b5f416 P cd75a17ab2604397adab03bb8b5fd75c [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
W20260709 13:20:25.648975 11602 log.cc:927] Time spent T 1bf4668eeb70467fb3dc5a0289233b3c P ccd8a4c3bfe3413cb2ae219b09aea832: Append to log took a long time: real 0.136s	user 0.002s	sys 0.002s
W20260709 13:20:25.650290 11277 consensus_meta.cc:287] T 4275cf08e63345f993bce8664eada830 P b7ab4784c7344b939bc36f639286f377: Time spent flushing consensus metadata: real 0.681s	user 0.011s	sys 0.008s
W20260709 13:20:25.652771 11589 log.cc:927] Time spent T f5be3a11b23d4ea9b08300a2789821c7 P ccd8a4c3bfe3413cb2ae219b09aea832: Append to log took a long time: real 0.330s	user 0.000s	sys 0.002s
I20260709 13:20:25.655143 11510 raft_consensus.cc:493] T f09c2a98de1a4decabd0ff900dd44caa P cd75a17ab2604397adab03bb8b5fd75c [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:25.656104 11510 raft_consensus.cc:515] T f09c2a98de1a4decabd0ff900dd44caa P cd75a17ab2604397adab03bb8b5fd75c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:25.658756  6806 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:32976 (request call id 2971) took 1068 ms. Trace:
I20260709 13:20:25.658984 11510 leader_election.cc:290] T f09c2a98de1a4decabd0ff900dd44caa P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:20:25.583938 11403 raft_consensus.cc:515] T 20f6842e26174571996b8dea4151d4be P b7ab4784c7344b939bc36f639286f377 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:25.662298 11403 leader_election.cc:290] T 20f6842e26174571996b8dea4151d4be P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 15 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:25.662611 11576 raft_consensus.cc:515] T ab432e62819d499eaaf3dd55481dd930 P cd75a17ab2604397adab03bb8b5fd75c [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:25.666002 11576 leader_election.cc:290] T ab432e62819d499eaaf3dd55481dd930 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 14 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:20:25.669023 11010 raft_consensus.cc:493] T 711ef6523deb4cbe8ef2ba61e1c21c98 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:25.669883 11010 raft_consensus.cc:515] T 711ef6523deb4cbe8ef2ba61e1c21c98 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:25.672782 11591 raft_consensus.cc:2804] T 20f6842e26174571996b8dea4151d4be P cd75a17ab2604397adab03bb8b5fd75c [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:20:25.673368 11591 raft_consensus.cc:493] T 20f6842e26174571996b8dea4151d4be P cd75a17ab2604397adab03bb8b5fd75c [term 13 FOLLOWER]: Starting leader election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:20:25.673847 11591 raft_consensus.cc:3060] T 20f6842e26174571996b8dea4151d4be P cd75a17ab2604397adab03bb8b5fd75c [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:20:25.675808 11066 consensus_meta.cc:287] T fe20b4b48823486ca3b9c648db6ce8aa P cd75a17ab2604397adab03bb8b5fd75c: Time spent flushing consensus metadata: real 0.586s	user 0.015s	sys 0.014s
I20260709 13:20:25.676636 11066 raft_consensus.cc:515] T fe20b4b48823486ca3b9c648db6ce8aa P cd75a17ab2604397adab03bb8b5fd75c [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:20:25.678668  6878 raft_consensus.cc:1240] T fe20b4b48823486ca3b9c648db6ce8aa P cd75a17ab2604397adab03bb8b5fd75c [term 11 FOLLOWER]: Rejecting Update request from peer 7ba59cc884714e8aa5f3f0ecaed84cbb for earlier term 10. Current term is 11. Ops: []
W20260709 13:20:25.679979 11599 log.cc:927] Time spent T f09c2a98de1a4decabd0ff900dd44caa P ccd8a4c3bfe3413cb2ae219b09aea832: Append to log took a long time: real 0.162s	user 0.001s	sys 0.001s
I20260709 13:20:25.678678 11504 consensus_queue.cc:260] T 4d9def8b32fd443aa94ab1420b06837b P b7ab4784c7344b939bc36f639286f377 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.6, Last appended by leader: 6, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:25.686013 11547 raft_consensus.cc:3060] T dbdf895bba214ff68685a24fd17dfb5d P b7ab4784c7344b939bc36f639286f377 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:20:25.658900  6772 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 420177us
W20260709 13:20:25.689438 11601 log.cc:927] Time spent T f58dc08b12a2494bb9a1372837970ca2 P b7ab4784c7344b939bc36f639286f377: Append to log took a long time: real 0.137s	user 0.000s	sys 0.002s
I20260709 13:20:25.692422 11061 raft_consensus.cc:3060] T ce4f062dcd314d43a63ca74067cb5ee3 P b7ab4784c7344b939bc36f639286f377 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:25.692759  6772 leader_election.cc:304] T 853ac0a8cbd64ce99457f170216d4d0f P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:20:25.695588 11588 raft_consensus.cc:2749] T 853ac0a8cbd64ce99457f170216d4d0f P b7ab4784c7344b939bc36f639286f377 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:20:25.682375 11354 leader_election.cc:290] T 7c44c4849aa54f2b94d1f1bef9ed546f P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 15 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:25.697126 11010 leader_election.cc:290] T 711ef6523deb4cbe8ef2ba61e1c21c98 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:25.707589  6624 catalog_manager.cc:5697] T 17587d6730594da4a56fa13a353232a1 P 7ba59cc884714e8aa5f3f0ecaed84cbb reported cstate change: term changed from 8 to 15. New cstate: current_term: 15 leader_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:20:25.483376  5625 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:20:25.710981 11439 consensus_meta.cc:287] T 7ba5dac66ab5497e9e336f2a3c28cda5 P cd75a17ab2604397adab03bb8b5fd75c: Time spent flushing consensus metadata: real 0.720s	user 0.011s	sys 0.011s
I20260709 13:20:25.594554 11455 leader_election.cc:290] T ce4f062dcd314d43a63ca74067cb5ee3 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
W20260709 13:20:25.701593  6695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 136521us
W20260709 13:20:25.713889  7466 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 69310.5us
I20260709 13:20:25.659394  6806 rpcz_store.cc:276] 0709 13:20:24.589773 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:24.598892 (+  9119us) service_pool.cc:224] Handling call
0709 13:20:25.658181 (+1059289us) spinlock_profiling.cc:243] Waited 575 ms on lock 0x7b54002c92d4. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f9ae2fa 00007fcc1496fb17 00007fcc0deea6d4 00007fcc0deea662 00007fcc0deea591 00007fcc0deea50c 00007fcc0dee97c2 00007fcc0dce548c 00007fcc0dce48c6 00007fcc0dce426f
0709 13:20:25.658468 (+   287us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1322953472}
I20260709 13:20:25.686471 11504 raft_consensus.cc:3060] T 4d9def8b32fd443aa94ab1420b06837b P b7ab4784c7344b939bc36f639286f377 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:25.650945 11277 raft_consensus.cc:515] T 4275cf08e63345f993bce8664eada830 P b7ab4784c7344b939bc36f639286f377 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:25.711611 11439 raft_consensus.cc:515] T 7ba5dac66ab5497e9e336f2a3c28cda5 P cd75a17ab2604397adab03bb8b5fd75c [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:20:25.727033  6697 leader_election.cc:304] T fe20b4b48823486ca3b9c648db6ce8aa P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:20:25.621879 11524 raft_consensus.cc:515] T 3fa34c08b205435dba97346991aa1f92 P cd75a17ab2604397adab03bb8b5fd75c [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:20:25.745520 11386 raft_consensus.cc:2749] T fe20b4b48823486ca3b9c648db6ce8aa P ccd8a4c3bfe3413cb2ae219b09aea832 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:20:25.745550  6726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24ee15416e3145beaa1b8183453729a3" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:25.748457  6726 raft_consensus.cc:2468] T 24ee15416e3145beaa1b8183453729a3 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in term 15.
I20260709 13:20:25.739843 11503 raft_consensus.cc:493] T d8cee0accdb8499c86d4414b72565a38 P cd75a17ab2604397adab03bb8b5fd75c [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:25.751721 11590 raft_consensus.cc:515] T 427c124d773f483294511e80fe340075 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 12 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } attrs { replace: true } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
W20260709 13:20:25.755911  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 189178us
I20260709 13:20:25.765081 11277 leader_election.cc:290] T 4275cf08e63345f993bce8664eada830 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 13 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
W20260709 13:20:25.765815  7468 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:25.766005  6697 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 129491us
I20260709 13:20:25.767158  6770 leader_election.cc:304] T 7c37d41cd9164c15a6826ca62a851a69 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
W20260709 13:20:25.766986 11603 log.cc:927] Time spent T bb7fa124c3bf4ef9ab65a407cb008441 P b7ab4784c7344b939bc36f639286f377: Append to log took a long time: real 0.173s	user 0.000s	sys 0.002s
I20260709 13:20:25.766583 11503 raft_consensus.cc:515] T d8cee0accdb8499c86d4414b72565a38 P cd75a17ab2604397adab03bb8b5fd75c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:20:25.767683 11495 consensus_queue.cc:1048] T f5be3a11b23d4ea9b08300a2789821c7 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:20:25.769035  6723 raft_consensus.cc:1275] T be1a92657f494cac8dd227d152f50151 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 15 FOLLOWER]: Refusing update from remote peer 7ba59cc884714e8aa5f3f0ecaed84cbb: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:20:25.773010 11588 consensus_queue.cc:1048] T 1bf4668eeb70467fb3dc5a0289233b3c P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:20:25.764880  6880 raft_consensus.cc:1240] T 3fa34c08b205435dba97346991aa1f92 P cd75a17ab2604397adab03bb8b5fd75c [term 15 FOLLOWER]: Rejecting Update request from peer 7ba59cc884714e8aa5f3f0ecaed84cbb for earlier term 14. Current term is 15. Ops: []
I20260709 13:20:25.785938  6697 leader_election.cc:304] T 95a75bfe094d4bdc963aba3f08dfcd25 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:20:25.794782  7466 leader_election.cc:304] T 24ee15416e3145beaa1b8183453729a3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
I20260709 13:20:25.796706  6726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3d8792045a4583ae2e965b1350a5b4" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:25.786957 11561 leader_election.cc:290] T 30e88460611e47b2ba16a46a30b5f416 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 12 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:20:25.803766 11010 raft_consensus.cc:2804] T 95a75bfe094d4bdc963aba3f08dfcd25 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:20:25.803647 11584 consensus_queue.cc:1059] T 3d65025eea89441290d85dd053810e31 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:20:25.804765 11010 raft_consensus.cc:697] T 95a75bfe094d4bdc963aba3f08dfcd25 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 13 LEADER]: Becoming Leader. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
I20260709 13:20:25.805245 11584 raft_consensus.cc:3055] T 3d65025eea89441290d85dd053810e31 P b7ab4784c7344b939bc36f639286f377 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:20:25.805895 11584 raft_consensus.cc:740] T 3d65025eea89441290d85dd053810e31 P b7ab4784c7344b939bc36f639286f377 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
W20260709 13:20:25.807300  6846 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:25.804205 11511 raft_consensus.cc:2804] T 24ee15416e3145beaa1b8183453729a3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:20:25.808579 11511 raft_consensus.cc:493] T 24ee15416e3145beaa1b8183453729a3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:25.807859 11386 consensus_queue.cc:1048] T f03d0dbf16864ca4bc1bb5e4c0334c0f P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:20:25.809051 11511 raft_consensus.cc:3060] T 24ee15416e3145beaa1b8183453729a3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:25.809778  7496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8cee0accdb8499c86d4414b72565a38" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:20:25.810132  6728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d65025eea89441290d85dd053810e31" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: true dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:20:25.810927  6728 raft_consensus.cc:3060] T 3d65025eea89441290d85dd053810e31 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 11 FOLLOWER]: Advancing to term 13
I20260709 13:20:25.805099 11503 leader_election.cc:290] T d8cee0accdb8499c86d4414b72565a38 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:20:25.806234 11010 consensus_queue.cc:237] T 95a75bfe094d4bdc963aba3f08dfcd25 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.5, Last appended by leader: 5, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:25.807260 11584 consensus_queue.cc:260] T 3d65025eea89441290d85dd053810e31 P b7ab4784c7344b939bc36f639286f377 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:25.795439 11567 raft_consensus.cc:2804] T 07a92dd554674067a83a9cb68c4773f2 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:20:25.814679 11584 raft_consensus.cc:3060] T 3d65025eea89441290d85dd053810e31 P b7ab4784c7344b939bc36f639286f377 [term 11 FOLLOWER]: Advancing to term 13
I20260709 13:20:25.808482  6695 leader_election.cc:304] T 4d9def8b32fd443aa94ab1420b06837b P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:20:25.813591  6723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe20b4b48823486ca3b9c648db6ce8aa" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:25.816601  6697 leader_election.cc:304] T d8292e16e5654be6bc408560cf256aaa P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
W20260709 13:20:25.820940 11563 consensus_meta.cc:287] T f3f9c2e2bf644115957398fe4c9459db P ccd8a4c3bfe3413cb2ae219b09aea832: Time spent flushing consensus metadata: real 0.772s	user 0.006s	sys 0.018s
W20260709 13:20:25.827291  6627 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:53214 (request call id 177) took 47723 ms (client timeout 15000 ms). Trace:
I20260709 13:20:25.822451 11596 consensus_queue.cc:1048] T be1a92657f494cac8dd227d152f50151 P 7ba59cc884714e8aa5f3f0ecaed84cbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.005s
I20260709 13:20:25.802704 11061 consensus_queue.cc:1048] T e31b9971c15848dea59d4d4130141d9e P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.030s
I20260709 13:20:25.828698 11061 consensus_queue.cc:1243] T e31b9971c15848dea59d4d4130141d9e P b7ab4784c7344b939bc36f639286f377 [LEADER]: Peer cd75a17ab2604397adab03bb8b5fd75c log is divergent from this leader: its last log entry 10.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 13:20:25.831964 11563 raft_consensus.cc:2749] T f3f9c2e2bf644115957398fe4c9459db P ccd8a4c3bfe3413cb2ae219b09aea832 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:20:25.821549 11354 raft_consensus.cc:2804] T 7c37d41cd9164c15a6826ca62a851a69 P b7ab4784c7344b939bc36f639286f377 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:20:25.837706  6723 raft_consensus.cc:2393] T fe20b4b48823486ca3b9c648db6ce8aa P ccd8a4c3bfe3413cb2ae219b09aea832 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c in current term 11: Already voted for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in this term.
W20260709 13:20:25.844965  6773 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:25.845381  6729 raft_consensus.cc:1240] T f3f9c2e2bf644115957398fe4c9459db P ccd8a4c3bfe3413cb2ae219b09aea832 [term 12 FOLLOWER]: Rejecting Update request from peer b7ab4784c7344b939bc36f639286f377 for earlier term 11. Current term is 12. Ops: []
I20260709 13:20:25.846477 11458 raft_consensus.cc:493] T 4f00a2e87e56452083b759f60d461ee3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:25.855338 11503 raft_consensus.cc:493] T de3186201e1a40d0b335eeb8b4e256e0 P cd75a17ab2604397adab03bb8b5fd75c [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:25.856233  6726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77e330a82df4b43a745d57a68f6f057" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:25.833654 11583 raft_consensus.cc:515] T ab432e62819d499eaaf3dd55481dd930 P b7ab4784c7344b939bc36f639286f377 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:25.858741 11563 raft_consensus.cc:2749] T 4d9def8b32fd443aa94ab1420b06837b P ccd8a4c3bfe3413cb2ae219b09aea832 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:20:25.859843 11563 raft_consensus.cc:2804] T d8292e16e5654be6bc408560cf256aaa P ccd8a4c3bfe3413cb2ae219b09aea832 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:20:25.860620 11563 raft_consensus.cc:697] T d8292e16e5654be6bc408560cf256aaa P ccd8a4c3bfe3413cb2ae219b09aea832 [term 17 LEADER]: Becoming Leader. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
I20260709 13:20:25.856174 11503 raft_consensus.cc:515] T de3186201e1a40d0b335eeb8b4e256e0 P cd75a17ab2604397adab03bb8b5fd75c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:25.862004 11563 consensus_queue.cc:237] T d8292e16e5654be6bc408560cf256aaa P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:25.864216 11567 raft_consensus.cc:493] T 07a92dd554674067a83a9cb68c4773f2 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 12 FOLLOWER]: Starting leader election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:20:25.864802 11567 raft_consensus.cc:3060] T 07a92dd554674067a83a9cb68c4773f2 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:20:25.865924 11341 consensus_meta.cc:287] T bd6869f07b5a4885a0b99fbe60c3b175 P b7ab4784c7344b939bc36f639286f377: Time spent flushing consensus metadata: real 0.954s	user 0.001s	sys 0.021s
I20260709 13:20:25.866586 11341 raft_consensus.cc:515] T bd6869f07b5a4885a0b99fbe60c3b175 P b7ab4784c7344b939bc36f639286f377 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:25.869318 11341 leader_election.cc:290] T bd6869f07b5a4885a0b99fbe60c3b175 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 13 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
W20260709 13:20:25.827790  6627 rpcz_store.cc:269] 0709 13:19:38.100618 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:38.100841 (+   223us) service_pool.cc:224] Handling call
0709 13:20:25.822569 (+47721728us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:20:08.565351 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:20:08.565978 (+   627us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:20:08.566031 (+    53us) write_op.cc:435] Acquired schema lock
0709 13:20:08.566050 (+    19us) tablet.cc:662] Decoding operations
0709 13:20:08.740427 (+174377us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:20:08.740528 (+   101us) write_op.cc:641] Partition lock acquired for write op
0709 13:20:08.740565 (+    37us) tablet.cc:685] Acquiring locks for 16 operations
0709 13:20:08.742051 (+  1486us) tablet.cc:701] Row locks acquired
0709 13:20:08.742112 (+    61us) write_op.cc:260] PREPARE: finished
0709 13:20:08.742314 (+   202us) write_op.cc:270] Start()
0709 13:20:08.742475 (+   161us) write_op.cc:276] Timestamp: P: 1783603208742241 usec, L: 0
0709 13:20:08.742499 (+    24us) op_driver.cc:348] REPLICATION: starting
0709 13:20:08.860195 (+117696us) log.cc:844] Serialized 6300 byte log entry
0709 13:20:09.988623 (+1128428us) spinlock_profiling.cc:243] Waited 18.9 ms on lock 0x7b180044efc0. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc15785de1 00007fcc157925b1 00007fcc0c8bd3f3 00007fcc0c8bf7c1 00007fcc0c8bf779 00007fcc0c8bf709 00007fcc0c8bf6d1 00007fcc0c8be9cd 000000000038f354 000000000038f199 00007fcc0c8a083a
0709 13:20:10.405219 (+416596us) op_driver.cc:464] REPLICATION: finished
0709 13:20:11.303060 (+897841us) write_op.cc:301] APPLY: starting
0709 13:20:11.303161 (+   101us) tablet.cc:1367] starting BulkCheckPresence
0709 13:20:12.663675 (+1360514us) tablet.cc:1370] finished BulkCheckPresence
0709 13:20:12.793420 (+129745us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:20:14.976204 (+2182784us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:20:14.976852 (+   648us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=32,key_file_lookups=32,delta_file_lookups=32,mrs_lookups=0
0709 13:20:14.976957 (+   105us) write_op.cc:312] APPLY: finished
0709 13:20:14.994755 (+ 17798us) log.cc:844] Serialized 147 byte log entry
0709 13:20:15.236161 (+241406us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:20:15.238481 (+  2320us) write_op.cc:454] Released schema lock
0709 13:20:15.239309 (+   828us) write_op.cc:341] FINISH: Updating metrics
0709 13:20:15.358907 (+119598us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:20:15.360677 (+  1770us) write_op.cc:454] Released schema lock
0709 13:20:15.537392 (+176715us) spinlock_profiling.cc:243] Waited 5.51 ms on lock 0x7b180044efc0. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc15785de1 00007fcc157925b1 00007fcc0c8bd3f3 00007fcc0c8bf7c1 00007fcc0c8bf779 00007fcc0c8bf709 00007fcc0c8bf6d1 00007fcc0c8be9cd 000000000038f354 000000000038f199 00007fcc0c8a083a
Metrics: {"mutex_wait_us":37814,"reported_tablets":55,"child_traces":[["op",{"apply.queue_time_us":893095,"apply.run_cpu_time_us":81944,"apply.run_wall_time_us":3973076,"cfile_cache_hit":62,"cfile_cache_hit_bytes":64728,"cfile_cache_miss":4,"cfile_cache_miss_bytes":6215,"cfile_init":2,"lbm_read_time_us":196322,"lbm_reads_10-100_ms":5,"lbm_reads_lt_1ms":7,"num_ops":16,"prepare.queue_time_us":265570,"prepare.run_cpu_time_us":27125,"prepare.run_wall_time_us":478343,"raft.queue_time_us":134998,"raft.run_cpu_time_us":65200,"raft.run_wall_time_us":636341,"replication_time_us":1651594,"spinlock_wait_cycles":56118400,"thread_start_us":1134455,"threads_started":5,"wal-append.queue_time_us":523469,"wal-append.run_cpu_time_us":17796,"wal-append.run_wall_time_us":2386072}]]}
I20260709 13:20:25.864497 11593 consensus_queue.cc:1048] T c4db81d9d329422bb3b4160ca4ac2d1d P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.025s
I20260709 13:20:25.870463 11354 raft_consensus.cc:697] T 7c37d41cd9164c15a6826ca62a851a69 P b7ab4784c7344b939bc36f639286f377 [term 13 LEADER]: Becoming Leader. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
I20260709 13:20:25.901337 11354 consensus_queue.cc:237] T 7c37d41cd9164c15a6826ca62a851a69 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:25.904313  7502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3f13b31a1f84f0d89d007eadd57924c" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb"
I20260709 13:20:25.906306  6878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09c2a98de1a4decabd0ff900dd44caa" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:25.907208  6878 raft_consensus.cc:2393] T f09c2a98de1a4decabd0ff900dd44caa P cd75a17ab2604397adab03bb8b5fd75c [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7ab4784c7344b939bc36f639286f377 in current term 14: Already voted for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in this term.
I20260709 13:20:25.919102  6879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6869f07b5a4885a0b99fbe60c3b175" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:25.920537  6879 raft_consensus.cc:2393] T bd6869f07b5a4885a0b99fbe60c3b175 P cd75a17ab2604397adab03bb8b5fd75c [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7ab4784c7344b939bc36f639286f377 in current term 13: Already voted for candidate cd75a17ab2604397adab03bb8b5fd75c in this term.
I20260709 13:20:25.859735 11583 leader_election.cc:290] T ab432e62819d499eaaf3dd55481dd930 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 15 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:25.850327 11458 raft_consensus.cc:515] T 4f00a2e87e56452083b759f60d461ee3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:20:25.952685  7502 raft_consensus.cc:2468] T b3f13b31a1f84f0d89d007eadd57924c P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 12.
I20260709 13:20:25.933900 11511 raft_consensus.cc:515] T 24ee15416e3145beaa1b8183453729a3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 16 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:20:25.843005 11468 raft_consensus.cc:515] T f5be3a11b23d4ea9b08300a2789821c7 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:25.934913  7498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ba5dac66ab5497e9e336f2a3c28cda5" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb"
I20260709 13:20:25.887679 11444 raft_consensus.cc:515] T d8cee0accdb8499c86d4414b72565a38 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:20:25.922092 11439 leader_election.cc:290] T 7ba5dac66ab5497e9e336f2a3c28cda5 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 13 election: Requested vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:20:25.930433  6728 raft_consensus.cc:2468] T 3d65025eea89441290d85dd053810e31 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 13.
W20260709 13:20:25.969622  7467 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:25.957422  7466 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 139335us
I20260709 13:20:25.949041  6880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab432e62819d499eaaf3dd55481dd930" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:25.972640  6880 raft_consensus.cc:2468] T ab432e62819d499eaaf3dd55481dd930 P cd75a17ab2604397adab03bb8b5fd75c [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 14.
I20260709 13:20:25.988361 11503 leader_election.cc:290] T de3186201e1a40d0b335eeb8b4e256e0 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:20:25.989889 11458 leader_election.cc:290] T 4f00a2e87e56452083b759f60d461ee3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:25.988461  6723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "427c124d773f483294511e80fe340075" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
W20260709 13:20:25.992501  6773 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:25.994666  7496 raft_consensus.cc:2393] T d8cee0accdb8499c86d4414b72565a38 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c in current term 14: Already voted for candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in this term.
I20260709 13:20:26.009740  6878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f03d0dbf16864ca4bc1bb5e4c0334c0f" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:25.996433 11590 leader_election.cc:290] T 427c124d773f483294511e80fe340075 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 12 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
W20260709 13:20:26.013561  6695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 205272us
I20260709 13:20:26.020197 11478 consensus_queue.cc:1048] T 4b8cacb381b746da8d0049b0a83b41dd P 7ba59cc884714e8aa5f3f0ecaed84cbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.008s
I20260709 13:20:26.019510  7503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be1a92657f494cac8dd227d152f50151" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb"
I20260709 13:20:26.020211  6806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "427c124d773f483294511e80fe340075" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:20:26.037747 11386 raft_consensus.cc:493] T 3a485a995abc4807b6e511e45419f737 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:20:26.038110  6727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34f36d59d88f40fe8a2805e604fc6c0a" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:26.038844 11386 raft_consensus.cc:515] T 3a485a995abc4807b6e511e45419f737 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:26.042485  6729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f03d0dbf16864ca4bc1bb5e4c0334c0f" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 13 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:26.044597  6806 raft_consensus.cc:3060] T 427c124d773f483294511e80fe340075 P b7ab4784c7344b939bc36f639286f377 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:20:26.050941  6730 raft_consensus.cc:1275] T 711ef6523deb4cbe8ef2ba61e1c21c98 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 14 FOLLOWER]: Refusing update from remote peer cd75a17ab2604397adab03bb8b5fd75c: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:20:26.044704  6878 raft_consensus.cc:2468] T f03d0dbf16864ca4bc1bb5e4c0334c0f P cd75a17ab2604397adab03bb8b5fd75c [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 12.
I20260709 13:20:26.052122  6879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3411566abe2d4c9bb4b2adfdd05e6f17" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:26.052290  6695 leader_election.cc:304] T b3f13b31a1f84f0d89d007eadd57924c P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, b7ab4784c7344b939bc36f639286f377
I20260709 13:20:26.056412  6723 raft_consensus.cc:3060] T 427c124d773f483294511e80fe340075 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:20:26.003270 11458 consensus_queue.cc:1048] T bb7fa124c3bf4ef9ab65a407cb008441 P 7ba59cc884714e8aa5f3f0ecaed84cbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.041s
I20260709 13:20:26.061174  6879 raft_consensus.cc:2468] T 3411566abe2d4c9bb4b2adfdd05e6f17 P cd75a17ab2604397adab03bb8b5fd75c [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 11.
I20260709 13:20:26.064131  6874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c37d41cd9164c15a6826ca62a851a69" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:20:26.064544  6728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4b8bd455d5a47c18a1380839c6e0d61" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:26.013456 11591 raft_consensus.cc:515] T 20f6842e26174571996b8dea4151d4be P cd75a17ab2604397adab03bb8b5fd75c [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:26.069887  6726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbdf895bba214ff68685a24fd17dfb5d" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 12 candidate_status { last_received { term: 10 index: 4 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:26.074774  6874 raft_consensus.cc:3060] T 7c37d41cd9164c15a6826ca62a851a69 P cd75a17ab2604397adab03bb8b5fd75c [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:26.085600  6728 raft_consensus.cc:2468] T f4b8bd455d5a47c18a1380839c6e0d61 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 12.
I20260709 13:20:26.089720  6725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30e88460611e47b2ba16a46a30b5f416" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:20:26.092736  6732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e326172347f45e99a0d482b5d8ef768" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:20:26.045220 11439 raft_consensus.cc:493] T 9e326172347f45e99a0d482b5d8ef768 P cd75a17ab2604397adab03bb8b5fd75c [term 11 FOLLOWER]: Starting pre-election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:20:26.081168 11561 raft_consensus.cc:493] T 3a485a995abc4807b6e511e45419f737 P cd75a17ab2604397adab03bb8b5fd75c [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:20:26.098712  6730 raft_consensus.cc:1240] T ce4f062dcd314d43a63ca74067cb5ee3 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 13 FOLLOWER]: Rejecting Update request from peer b7ab4784c7344b939bc36f639286f377 for earlier term 12. Current term is 13. Ops: []
I20260709 13:20:26.098903 11561 raft_consensus.cc:515] T 3a485a995abc4807b6e511e45419f737 P cd75a17ab2604397adab03bb8b5fd75c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:26.101060 11561 leader_election.cc:290] T 3a485a995abc4807b6e511e45419f737 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:20:26.101655 11503 raft_consensus.cc:493] T 853ac0a8cbd64ce99457f170216d4d0f P cd75a17ab2604397adab03bb8b5fd75c [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:26.103360  6729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b8cacb381b746da8d0049b0a83b41dd" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
W20260709 13:20:26.105865  6770 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:26.105796  6806 raft_consensus.cc:2468] T 427c124d773f483294511e80fe340075 P b7ab4784c7344b939bc36f639286f377 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in term 12.
I20260709 13:20:26.102260 11503 raft_consensus.cc:515] T 853ac0a8cbd64ce99457f170216d4d0f P cd75a17ab2604397adab03bb8b5fd75c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:26.120680 11386 leader_election.cc:290] T 3a485a995abc4807b6e511e45419f737 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:26.121630  6801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f00a2e87e56452083b759f60d461ee3" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
W20260709 13:20:26.123708  6695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 87329us
I20260709 13:20:26.125653  6695 leader_election.cc:304] T 17587d6730594da4a56fa13a353232a1 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
I20260709 13:20:26.128522 11612 consensus_queue.cc:1048] T de3186201e1a40d0b335eeb8b4e256e0 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:20:26.129772 11504 raft_consensus.cc:493] T 713b5728a197487c9300b310ab94e5a3 P b7ab4784c7344b939bc36f639286f377 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:20:26.120832  6873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8cee0accdb8499c86d4414b72565a38" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:26.132572  6873 raft_consensus.cc:2468] T d8cee0accdb8499c86d4414b72565a38 P cd75a17ab2604397adab03bb8b5fd75c [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in term 13.
I20260709 13:20:26.095829 11439 raft_consensus.cc:515] T 9e326172347f45e99a0d482b5d8ef768 P cd75a17ab2604397adab03bb8b5fd75c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:26.141391  6723 raft_consensus.cc:2468] T 427c124d773f483294511e80fe340075 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in term 12.
I20260709 13:20:26.119760 11503 leader_election.cc:290] T 853ac0a8cbd64ce99457f170216d4d0f P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
W20260709 13:20:26.155793  6697 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 360092us
I20260709 13:20:26.109023 11563 raft_consensus.cc:2749] T b3f13b31a1f84f0d89d007eadd57924c P ccd8a4c3bfe3413cb2ae219b09aea832 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:20:26.158326  6873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24ee15416e3145beaa1b8183453729a3" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:26.160705 11066 leader_election.cc:290] T fe20b4b48823486ca3b9c648db6ce8aa P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 11 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:20:26.160871 11591 leader_election.cc:290] T 20f6842e26174571996b8dea4151d4be P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 14 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:20:26.162937 11444 leader_election.cc:290] T d8cee0accdb8499c86d4414b72565a38 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 14 election: Requested vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
W20260709 13:20:26.165736  7468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 140625us
I20260709 13:20:26.166679  6732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1704639a875409b9959353527b3fd68" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 15 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:26.171672  6806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8cee0accdb8499c86d4414b72565a38" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:20:26.182639 11354 raft_consensus.cc:493] T 44bde925b2e541b69890d70715b85176 P b7ab4784c7344b939bc36f639286f377 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:20:26.130432 11504 raft_consensus.cc:515] T 713b5728a197487c9300b310ab94e5a3 P b7ab4784c7344b939bc36f639286f377 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:26.182847 11172 raft_consensus.cc:493] T a1704639a875409b9959353527b3fd68 P b7ab4784c7344b939bc36f639286f377 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:26.184787  6806 raft_consensus.cc:3060] T d8cee0accdb8499c86d4414b72565a38 P b7ab4784c7344b939bc36f639286f377 [term 12 FOLLOWER]: Advancing to term 14
I20260709 13:20:26.145936 11468 leader_election.cc:290] T f5be3a11b23d4ea9b08300a2789821c7 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 12 election: Requested vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:26.138082 11567 raft_consensus.cc:515] T 07a92dd554674067a83a9cb68c4773f2 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:26.167721 11386 raft_consensus.cc:2804] T 17587d6730594da4a56fa13a353232a1 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:20:26.190215  7495 raft_consensus.cc:1240] T ce4f062dcd314d43a63ca74067cb5ee3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 13 FOLLOWER]: Rejecting Update request from peer b7ab4784c7344b939bc36f639286f377 for earlier term 12. Current term is 13. Ops: []
I20260709 13:20:26.190662  6804 raft_consensus.cc:1275] T be1a92657f494cac8dd227d152f50151 P b7ab4784c7344b939bc36f639286f377 [term 15 FOLLOWER]: Refusing update from remote peer 7ba59cc884714e8aa5f3f0ecaed84cbb: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:20:26.166388 11511 leader_election.cc:290] T 24ee15416e3145beaa1b8183453729a3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 16 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:26.184093  6881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3d8792045a4583ae2e965b1350a5b4" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:26.194571  6697 leader_election.cc:304] T 7887766dc6784fcaa42b35c05fea7a99 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377
I20260709 13:20:26.184841 11591 raft_consensus.cc:493] T 44bde925b2e541b69890d70715b85176 P cd75a17ab2604397adab03bb8b5fd75c [term 13 FOLLOWER]: Starting pre-election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:20:26.195482 11172 raft_consensus.cc:515] T a1704639a875409b9959353527b3fd68 P b7ab4784c7344b939bc36f639286f377 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:26.192391 11588 raft_consensus.cc:493] T 2c240553ce044eedb41541d72b9475d7 P b7ab4784c7344b939bc36f639286f377 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:26.206691 11588 raft_consensus.cc:515] T 2c240553ce044eedb41541d72b9475d7 P b7ab4784c7344b939bc36f639286f377 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:26.209448 11588 leader_election.cc:290] T 2c240553ce044eedb41541d72b9475d7 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:26.212939 11504 leader_election.cc:290] T 713b5728a197487c9300b310ab94e5a3 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:26.215126 11172 leader_election.cc:290] T a1704639a875409b9959353527b3fd68 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:26.201222 11576 raft_consensus.cc:493] T a3022224cc81473690653a83d4e99470 P cd75a17ab2604397adab03bb8b5fd75c [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:20:26.216281 11576 raft_consensus.cc:515] T a3022224cc81473690653a83d4e99470 P cd75a17ab2604397adab03bb8b5fd75c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:26.218838 11576 leader_election.cc:290] T a3022224cc81473690653a83d4e99470 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:20:26.183784 11354 raft_consensus.cc:515] T 44bde925b2e541b69890d70715b85176 P b7ab4784c7344b939bc36f639286f377 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:26.221258 11354 leader_election.cc:290] T 44bde925b2e541b69890d70715b85176 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:26.205541 11386 raft_consensus.cc:697] T 17587d6730594da4a56fa13a353232a1 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 18 LEADER]: Becoming Leader. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
W20260709 13:20:26.221765 11613 log.cc:927] Time spent T 95a75bfe094d4bdc963aba3f08dfcd25 P ccd8a4c3bfe3413cb2ae219b09aea832: Append to log took a long time: real 0.168s	user 0.002s	sys 0.000s
I20260709 13:20:26.213078 11439 leader_election.cc:290] T 9e326172347f45e99a0d482b5d8ef768 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
W20260709 13:20:26.226387 11615 log.cc:927] Time spent T f5be3a11b23d4ea9b08300a2789821c7 P b7ab4784c7344b939bc36f639286f377: Append to log took a long time: real 0.196s	user 0.001s	sys 0.000s
I20260709 13:20:26.228200 11591 raft_consensus.cc:515] T 44bde925b2e541b69890d70715b85176 P cd75a17ab2604397adab03bb8b5fd75c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:26.230494 11591 leader_election.cc:290] T 44bde925b2e541b69890d70715b85176 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:20:26.234740 11524 leader_election.cc:290] T 3fa34c08b205435dba97346991aa1f92 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 15 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:20:26.237689 11458 consensus_queue.cc:1048] T be1a92657f494cac8dd227d152f50151 P 7ba59cc884714e8aa5f3f0ecaed84cbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:20:26.238227  7503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe20b4b48823486ca3b9c648db6ce8aa" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb"
I20260709 13:20:26.240785  6729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce4f062dcd314d43a63ca74067cb5ee3" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
W20260709 13:20:26.241410  6846 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:26.241853  6729 raft_consensus.cc:2393] T ce4f062dcd314d43a63ca74067cb5ee3 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c in current term 13: Already voted for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in this term.
I20260709 13:20:26.242684  6879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ba5dac66ab5497e9e336f2a3c28cda5" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:26.243537  6879 raft_consensus.cc:2468] T 7ba5dac66ab5497e9e336f2a3c28cda5 P cd75a17ab2604397adab03bb8b5fd75c [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 13.
I20260709 13:20:26.243863  6727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c44c4849aa54f2b94d1f1bef9ed546f" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:20:26.245052  7495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fa34c08b205435dba97346991aa1f92" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb"
I20260709 13:20:26.245625 11524 raft_consensus.cc:493] T 4275cf08e63345f993bce8664eada830 P cd75a17ab2604397adab03bb8b5fd75c [term 12 FOLLOWER]: Starting pre-election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:20:26.246280 11524 raft_consensus.cc:515] T 4275cf08e63345f993bce8664eada830 P cd75a17ab2604397adab03bb8b5fd75c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:26.247510  6874 raft_consensus.cc:2468] T 7c37d41cd9164c15a6826ca62a851a69 P cd75a17ab2604397adab03bb8b5fd75c [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 13.
I20260709 13:20:26.248492  7496 raft_consensus.cc:1240] T 24ee15416e3145beaa1b8183453729a3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 16 FOLLOWER]: Rejecting Update request from peer cd75a17ab2604397adab03bb8b5fd75c for earlier term 15. Current term is 16. Ops: []
I20260709 13:20:26.248761 11524 leader_election.cc:290] T 4275cf08e63345f993bce8664eada830 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:20:26.249994  6731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab432e62819d499eaaf3dd55481dd930" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:20:26.251255  6731 raft_consensus.cc:3060] T ab432e62819d499eaaf3dd55481dd930 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:26.252624  6727 raft_consensus.cc:1240] T 3d65025eea89441290d85dd053810e31 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 13 FOLLOWER]: Rejecting Update request from peer b7ab4784c7344b939bc36f639286f377 for earlier term 11. Current term is 13. Ops: []
I20260709 13:20:26.254144  6727 raft_consensus.cc:1240] T f5be3a11b23d4ea9b08300a2789821c7 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 12 FOLLOWER]: Rejecting Update request from peer b7ab4784c7344b939bc36f639286f377 for earlier term 11. Current term is 12. Ops: []
I20260709 13:20:26.203125 11567 leader_election.cc:290] T 07a92dd554674067a83a9cb68c4773f2 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 13 election: Requested vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:26.198588 11563 raft_consensus.cc:2804] T 7887766dc6784fcaa42b35c05fea7a99 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:20:26.204562  6881 raft_consensus.cc:2468] T bb3d8792045a4583ae2e965b1350a5b4 P cd75a17ab2604397adab03bb8b5fd75c [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in term 11.
I20260709 13:20:26.232156  6723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20f6842e26174571996b8dea4151d4be" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:20:26.269273  6806 raft_consensus.cc:2468] T d8cee0accdb8499c86d4414b72565a38 P b7ab4784c7344b939bc36f639286f377 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in term 14.
I20260709 13:20:26.269953  7498 raft_consensus.cc:2468] T 7ba5dac66ab5497e9e336f2a3c28cda5 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 13.
I20260709 13:20:26.271366  6731 raft_consensus.cc:2468] T ab432e62819d499eaaf3dd55481dd930 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 15.
I20260709 13:20:26.249660  6729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4275cf08e63345f993bce8664eada830" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
W20260709 13:20:26.240800  6695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 85142.7us
I20260709 13:20:26.250481  6724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6869f07b5a4885a0b99fbe60c3b175" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
W20260709 13:20:26.287685 11615 log.cc:927] Time spent T f5be3a11b23d4ea9b08300a2789821c7 P b7ab4784c7344b939bc36f639286f377: Append to log took a long time: real 0.061s	user 0.000s	sys 0.012s
I20260709 13:20:26.288784  6723 raft_consensus.cc:3060] T 20f6842e26174571996b8dea4151d4be P ccd8a4c3bfe3413cb2ae219b09aea832 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:20:26.290768  6771 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:26.290942  6846 leader_election.cc:304] T 7ba5dac66ab5497e9e336f2a3c28cda5 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:20:26.292838 11591 raft_consensus.cc:2804] T 7ba5dac66ab5497e9e336f2a3c28cda5 P cd75a17ab2604397adab03bb8b5fd75c [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:20:26.293555 11591 raft_consensus.cc:697] T 7ba5dac66ab5497e9e336f2a3c28cda5 P cd75a17ab2604397adab03bb8b5fd75c [term 13 LEADER]: Becoming Leader. State: Replica: cd75a17ab2604397adab03bb8b5fd75c, State: Running, Role: LEADER
W20260709 13:20:26.296769  6697 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 104630us
I20260709 13:20:26.295689  6801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ba5dac66ab5497e9e336f2a3c28cda5" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:26.222509 11386 consensus_queue.cc:237] T 17587d6730594da4a56fa13a353232a1 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:20:26.311008  6731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09c2a98de1a4decabd0ff900dd44caa" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
W20260709 13:20:26.288543 11603 log.cc:927] Time spent T bb7fa124c3bf4ef9ab65a407cb008441 P b7ab4784c7344b939bc36f639286f377: Append to log took a long time: real 0.054s	user 0.005s	sys 0.005s
I20260709 13:20:26.318807  6801 raft_consensus.cc:2393] T 7ba5dac66ab5497e9e336f2a3c28cda5 P b7ab4784c7344b939bc36f639286f377 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c in current term 13: Already voted for candidate b7ab4784c7344b939bc36f639286f377 in this term.
I20260709 13:20:26.279286 11563 raft_consensus.cc:493] T 7887766dc6784fcaa42b35c05fea7a99 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 13 FOLLOWER]: Starting leader election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:20:26.330725  6798 raft_consensus.cc:1275] T 4d9def8b32fd443aa94ab1420b06837b P b7ab4784c7344b939bc36f639286f377 [term 13 FOLLOWER]: Refusing update from remote peer cd75a17ab2604397adab03bb8b5fd75c: Log matching property violated. Preceding OpId in replica: term: 12 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 13:20:26.334401  6800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77e330a82df4b43a745d57a68f6f057" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:26.335168  6800 raft_consensus.cc:2468] T e77e330a82df4b43a745d57a68f6f057 P b7ab4784c7344b939bc36f639286f377 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 14.
I20260709 13:20:26.336418  6802 raft_consensus.cc:1240] T f58dc08b12a2494bb9a1372837970ca2 P b7ab4784c7344b939bc36f639286f377 [term 16 LEADER]: Rejecting Update request from peer cd75a17ab2604397adab03bb8b5fd75c for earlier term 15. Current term is 16. Ops: [15.8-15.8]
I20260709 13:20:26.336987  6799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f03d0dbf16864ca4bc1bb5e4c0334c0f" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 13 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:26.337988  6799 raft_consensus.cc:2410] T f03d0dbf16864ca4bc1bb5e4c0334c0f P b7ab4784c7344b939bc36f639286f377 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c for term 13 because replica has last-logged OpId of term: 10 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 13:20:26.342139  6800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce4f062dcd314d43a63ca74067cb5ee3" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:26.342857  6800 raft_consensus.cc:2468] T ce4f062dcd314d43a63ca74067cb5ee3 P b7ab4784c7344b939bc36f639286f377 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 13.
I20260709 13:20:26.337733  6802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1704639a875409b9959353527b3fd68" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 15 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:26.340969  6798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d65025eea89441290d85dd053810e31" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: true dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:20:26.361106  6731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab432e62819d499eaaf3dd55481dd930" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:20:26.361946  6731 raft_consensus.cc:2368] T ab432e62819d499eaaf3dd55481dd930 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c for earlier term 14. Current term is 15.
I20260709 13:20:26.294313 11439 consensus_queue.cc:1059] T 24ee15416e3145beaa1b8183453729a3 P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.040s
I20260709 13:20:26.361069  6802 raft_consensus.cc:2410] T a1704639a875409b9959353527b3fd68 P b7ab4784c7344b939bc36f639286f377 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c for term 15 because replica has last-logged OpId of term: 12 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 7.
I20260709 13:20:26.326120 11563 raft_consensus.cc:3060] T 7887766dc6784fcaa42b35c05fea7a99 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:26.368479  6803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4b8bd455d5a47c18a1380839c6e0d61" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:26.368633  6807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbdf895bba214ff68685a24fd17dfb5d" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 12 candidate_status { last_received { term: 10 index: 4 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:26.369336  6803 raft_consensus.cc:2468] T f4b8bd455d5a47c18a1380839c6e0d61 P b7ab4784c7344b939bc36f639286f377 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 12.
I20260709 13:20:26.369450  6807 raft_consensus.cc:2468] T dbdf895bba214ff68685a24fd17dfb5d P b7ab4784c7344b939bc36f639286f377 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 11.
I20260709 13:20:26.370419 11439 consensus_queue.cc:1243] T 24ee15416e3145beaa1b8183453729a3 P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Peer 7ba59cc884714e8aa5f3f0ecaed84cbb log is divergent from this leader: its last log entry 14.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 13:20:26.370959 11439 raft_consensus.cc:3055] T 24ee15416e3145beaa1b8183453729a3 P cd75a17ab2604397adab03bb8b5fd75c [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:20:26.371270 11439 raft_consensus.cc:740] T 24ee15416e3145beaa1b8183453729a3 P cd75a17ab2604397adab03bb8b5fd75c [term 15 LEADER]: Becoming Follower/Learner. State: Replica: cd75a17ab2604397adab03bb8b5fd75c, State: Running, Role: LEADER
I20260709 13:20:26.373304  6801 raft_consensus.cc:1275] T 711ef6523deb4cbe8ef2ba61e1c21c98 P b7ab4784c7344b939bc36f639286f377 [term 14 FOLLOWER]: Refusing update from remote peer cd75a17ab2604397adab03bb8b5fd75c: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:20:26.410084  6800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09c2a98de1a4decabd0ff900dd44caa" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:26.409870  6731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30e88460611e47b2ba16a46a30b5f416" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:20:26.418032  7498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ba5dac66ab5497e9e336f2a3c28cda5" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:20:26.418578  6800 raft_consensus.cc:2468] T f09c2a98de1a4decabd0ff900dd44caa P b7ab4784c7344b939bc36f639286f377 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 14.
I20260709 13:20:26.418776  7498 raft_consensus.cc:2468] T 7ba5dac66ab5497e9e336f2a3c28cda5 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 13.
W20260709 13:20:26.420236  6695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 56210.3us
I20260709 13:20:26.419147  6804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab432e62819d499eaaf3dd55481dd930" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:20:26.429287  6729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe20b4b48823486ca3b9c648db6ce8aa" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:20:26.430436  6729 raft_consensus.cc:2393] T fe20b4b48823486ca3b9c648db6ce8aa P ccd8a4c3bfe3413cb2ae219b09aea832 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c in current term 11: Already voted for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in this term.
I20260709 13:20:26.453194  6804 raft_consensus.cc:2368] T ab432e62819d499eaaf3dd55481dd930 P b7ab4784c7344b939bc36f639286f377 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c for earlier term 14. Current term is 15.
I20260709 13:20:26.456949 11612 consensus_queue.cc:1048] T 3411566abe2d4c9bb4b2adfdd05e6f17 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:20:26.459406  6806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30e88460611e47b2ba16a46a30b5f416" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:20:26.460496  6806 raft_consensus.cc:2393] T 30e88460611e47b2ba16a46a30b5f416 P b7ab4784c7344b939bc36f639286f377 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c in current term 12: Already voted for candidate b7ab4784c7344b939bc36f639286f377 in this term.
I20260709 13:20:26.460878  6803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a485a995abc4807b6e511e45419f737" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:26.464614  6875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8cee0accdb8499c86d4414b72565a38" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:26.465394  6875 raft_consensus.cc:2468] T d8cee0accdb8499c86d4414b72565a38 P cd75a17ab2604397adab03bb8b5fd75c [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 13.
I20260709 13:20:26.467382 11576 raft_consensus.cc:493] T e31b9971c15848dea59d4d4130141d9e P cd75a17ab2604397adab03bb8b5fd75c [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:26.468016 11576 raft_consensus.cc:515] T e31b9971c15848dea59d4d4130141d9e P cd75a17ab2604397adab03bb8b5fd75c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:26.468473  6807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de3186201e1a40d0b335eeb8b4e256e0" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 15 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:26.469156  6807 raft_consensus.cc:2468] T de3186201e1a40d0b335eeb8b4e256e0 P b7ab4784c7344b939bc36f639286f377 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 14.
I20260709 13:20:26.470288 11576 leader_election.cc:290] T e31b9971c15848dea59d4d4130141d9e P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:20:26.471083  6881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34f36d59d88f40fe8a2805e604fc6c0a" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:26.471838  6881 raft_consensus.cc:2468] T 34f36d59d88f40fe8a2805e604fc6c0a P cd75a17ab2604397adab03bb8b5fd75c [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 10.
I20260709 13:20:26.479300 11468 consensus_queue.cc:1048] T 853ac0a8cbd64ce99457f170216d4d0f P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:20:26.481041 11468 consensus_queue.cc:1048] T a1704639a875409b9959353527b3fd68 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
W20260709 13:20:26.482334  6773 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:26.483084  6773 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:26.363484 11567 consensus_queue.cc:1048] T 34f36d59d88f40fe8a2805e604fc6c0a P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.062s
I20260709 13:20:26.484975 11458 raft_consensus.cc:493] T ce4f062dcd314d43a63ca74067cb5ee3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:26.485647 11504 raft_consensus.cc:493] T 711ef6523deb4cbe8ef2ba61e1c21c98 P b7ab4784c7344b939bc36f639286f377 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:26.485550 11458 raft_consensus.cc:515] T ce4f062dcd314d43a63ca74067cb5ee3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } attrs { replace: true } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:20:26.486197 11504 raft_consensus.cc:515] T 711ef6523deb4cbe8ef2ba61e1c21c98 P b7ab4784c7344b939bc36f639286f377 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:26.488930  6801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ba5dac66ab5497e9e336f2a3c28cda5" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:20:26.489849  6801 raft_consensus.cc:2393] T 7ba5dac66ab5497e9e336f2a3c28cda5 P b7ab4784c7344b939bc36f639286f377 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c in current term 13: Already voted for candidate b7ab4784c7344b939bc36f639286f377 in this term.
I20260709 13:20:26.492214  7498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8cee0accdb8499c86d4414b72565a38" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:20:26.415205 11439 consensus_queue.cc:260] T 24ee15416e3145beaa1b8183453729a3 P cd75a17ab2604397adab03bb8b5fd75c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:20:26.493027  7498 raft_consensus.cc:2368] T d8cee0accdb8499c86d4414b72565a38 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7ab4784c7344b939bc36f639286f377 for earlier term 13. Current term is 14.
I20260709 13:20:26.493310 11439 raft_consensus.cc:3060] T 24ee15416e3145beaa1b8183453729a3 P cd75a17ab2604397adab03bb8b5fd75c [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:26.495626  7498 raft_consensus.cc:1275] T 4f00a2e87e56452083b759f60d461ee3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 13 FOLLOWER]: Refusing update from remote peer b7ab4784c7344b939bc36f639286f377: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:20:26.496162  6874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20f6842e26174571996b8dea4151d4be" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:20:26.496935  6874 raft_consensus.cc:3060] T 20f6842e26174571996b8dea4151d4be P cd75a17ab2604397adab03bb8b5fd75c [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:26.498085  6772 leader_election.cc:304] T b3f13b31a1f84f0d89d007eadd57924c P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, b7ab4784c7344b939bc36f639286f377; no voters: ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:20:26.500490  6879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c44c4849aa54f2b94d1f1bef9ed546f" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:20:26.501116  6879 raft_consensus.cc:3060] T 7c44c4849aa54f2b94d1f1bef9ed546f P cd75a17ab2604397adab03bb8b5fd75c [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:26.503154  7503 raft_consensus.cc:2468] T fe20b4b48823486ca3b9c648db6ce8aa P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 11.
I20260709 13:20:26.504108 11504 leader_election.cc:290] T 711ef6523deb4cbe8ef2ba61e1c21c98 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:26.504334  6800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8cee0accdb8499c86d4414b72565a38" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:26.504628  6846 leader_election.cc:304] T fe20b4b48823486ca3b9c648db6ce8aa P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:20:26.505359  6800 raft_consensus.cc:2393] T d8cee0accdb8499c86d4414b72565a38 P b7ab4784c7344b939bc36f639286f377 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c in current term 14: Already voted for candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in this term.
I20260709 13:20:26.506742  6802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "853ac0a8cbd64ce99457f170216d4d0f" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:26.507653  6802 raft_consensus.cc:2468] T 853ac0a8cbd64ce99457f170216d4d0f P b7ab4784c7344b939bc36f639286f377 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 10.
I20260709 13:20:26.508267 11524 raft_consensus.cc:2804] T fe20b4b48823486ca3b9c648db6ce8aa P cd75a17ab2604397adab03bb8b5fd75c [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:20:26.508891 11524 raft_consensus.cc:697] T fe20b4b48823486ca3b9c648db6ce8aa P cd75a17ab2604397adab03bb8b5fd75c [term 11 LEADER]: Becoming Leader. State: Replica: cd75a17ab2604397adab03bb8b5fd75c, State: Running, Role: LEADER
I20260709 13:20:26.510517  6723 raft_consensus.cc:2468] T 20f6842e26174571996b8dea4151d4be P ccd8a4c3bfe3413cb2ae219b09aea832 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 15.
I20260709 13:20:26.510222 11524 consensus_queue.cc:237] T fe20b4b48823486ca3b9c648db6ce8aa P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:20:26.512842  6881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e326172347f45e99a0d482b5d8ef768" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:20:26.513000  6730 raft_consensus.cc:1275] T f58dc08b12a2494bb9a1372837970ca2 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 16 FOLLOWER]: Refusing update from remote peer b7ab4784c7344b939bc36f639286f377: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 13:20:26.513442  6881 raft_consensus.cc:3060] T 9e326172347f45e99a0d482b5d8ef768 P cd75a17ab2604397adab03bb8b5fd75c [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:20:26.339526 11591 consensus_queue.cc:237] T 7ba5dac66ab5497e9e336f2a3c28cda5 P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:20:26.514276  6798 raft_consensus.cc:2468] T 3d65025eea89441290d85dd053810e31 P b7ab4784c7344b939bc36f639286f377 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 13.
I20260709 13:20:26.516403  6875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30e88460611e47b2ba16a46a30b5f416" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:20:26.517352  6875 raft_consensus.cc:2393] T 30e88460611e47b2ba16a46a30b5f416 P cd75a17ab2604397adab03bb8b5fd75c [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate b7ab4784c7344b939bc36f639286f377 in current term 12: Already voted for candidate cd75a17ab2604397adab03bb8b5fd75c in this term.
I20260709 13:20:26.518435  7495 raft_consensus.cc:2468] T 3fa34c08b205435dba97346991aa1f92 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 15.
I20260709 13:20:26.519382  6875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6869f07b5a4885a0b99fbe60c3b175" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
W20260709 13:20:26.522601 11621 log.cc:927] Time spent T e31b9971c15848dea59d4d4130141d9e P ccd8a4c3bfe3413cb2ae219b09aea832: Append to log took a long time: real 0.085s	user 0.001s	sys 0.001s
I20260709 13:20:26.537114 11588 raft_consensus.cc:2804] T b3f13b31a1f84f0d89d007eadd57924c P b7ab4784c7344b939bc36f639286f377 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:20:26.504555  6876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4275cf08e63345f993bce8664eada830" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:20:26.526520  7466 leader_election.cc:304] T d8cee0accdb8499c86d4414b72565a38 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, b7ab4784c7344b939bc36f639286f377; no voters: 
I20260709 13:20:26.533814  6875 raft_consensus.cc:2393] T bd6869f07b5a4885a0b99fbe60c3b175 P cd75a17ab2604397adab03bb8b5fd75c [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate b7ab4784c7344b939bc36f639286f377 in current term 13: Already voted for candidate cd75a17ab2604397adab03bb8b5fd75c in this term.
I20260709 13:20:26.527650  6846 leader_election.cc:304] T 3fa34c08b205435dba97346991aa1f92 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:20:26.540613  6874 raft_consensus.cc:2468] T 20f6842e26174571996b8dea4151d4be P cd75a17ab2604397adab03bb8b5fd75c [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 15.
I20260709 13:20:26.555572  6726 raft_consensus.cc:1240] T 8c7f33e544204fbaac4078e3e83bbf4e P ccd8a4c3bfe3413cb2ae219b09aea832 [term 11 FOLLOWER]: Rejecting Update request from peer b7ab4784c7344b939bc36f639286f377 for earlier term 10. Current term is 11. Ops: []
I20260709 13:20:26.555857 11576 raft_consensus.cc:2804] T 3fa34c08b205435dba97346991aa1f92 P cd75a17ab2604397adab03bb8b5fd75c [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:20:26.556391  6876 raft_consensus.cc:3060] T 4275cf08e63345f993bce8664eada830 P cd75a17ab2604397adab03bb8b5fd75c [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:26.556525 11576 raft_consensus.cc:697] T 3fa34c08b205435dba97346991aa1f92 P cd75a17ab2604397adab03bb8b5fd75c [term 15 LEADER]: Becoming Leader. State: Replica: cd75a17ab2604397adab03bb8b5fd75c, State: Running, Role: LEADER
I20260709 13:20:26.558102  6731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fa34c08b205435dba97346991aa1f92" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:20:26.557812 11576 consensus_queue.cc:237] T 3fa34c08b205435dba97346991aa1f92 P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:20:26.559031  6731 raft_consensus.cc:2393] T 3fa34c08b205435dba97346991aa1f92 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c in current term 15: Already voted for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in this term.
W20260709 13:20:26.559840  6772 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.68:45071, user_credentials={real_user=slave}} blocked reactor thread for 61837.3us
I20260709 13:20:26.560694  6772 leader_election.cc:304] T be1a92657f494cac8dd227d152f50151 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:20:26.561977  6806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20f6842e26174571996b8dea4151d4be" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:20:26.562386 11458 leader_election.cc:290] T ce4f062dcd314d43a63ca74067cb5ee3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:26.562945  6806 raft_consensus.cc:2368] T 20f6842e26174571996b8dea4151d4be P b7ab4784c7344b939bc36f639286f377 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c for earlier term 14. Current term is 15.
W20260709 13:20:26.562023 11629 log.cc:927] Time spent T 8c7f33e544204fbaac4078e3e83bbf4e P cd75a17ab2604397adab03bb8b5fd75c: Append to log took a long time: real 0.081s	user 0.003s	sys 0.000s
I20260709 13:20:26.565261 11611 raft_consensus.cc:2804] T d8cee0accdb8499c86d4414b72565a38 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:20:26.565663  6802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce4f062dcd314d43a63ca74067cb5ee3" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:26.566557  6802 raft_consensus.cc:2468] T ce4f062dcd314d43a63ca74067cb5ee3 P b7ab4784c7344b939bc36f639286f377 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in term 13.
I20260709 13:20:26.568190 11588 raft_consensus.cc:697] T b3f13b31a1f84f0d89d007eadd57924c P b7ab4784c7344b939bc36f639286f377 [term 12 LEADER]: Becoming Leader. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
I20260709 13:20:26.569312 11588 consensus_queue.cc:237] T b3f13b31a1f84f0d89d007eadd57924c P b7ab4784c7344b939bc36f639286f377 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:20:26.565873 11611 raft_consensus.cc:697] T d8cee0accdb8499c86d4414b72565a38 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 14 LEADER]: Becoming Leader. State: Replica: 7ba59cc884714e8aa5f3f0ecaed84cbb, State: Running, Role: LEADER
I20260709 13:20:26.571220 11611 consensus_queue.cc:237] T d8cee0accdb8499c86d4414b72565a38 P 7ba59cc884714e8aa5f3f0ecaed84cbb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:20:26.575654  6844 leader_election.cc:304] T bb3d8792045a4583ae2e965b1350a5b4 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:20:26.577941  6879 raft_consensus.cc:2468] T 7c44c4849aa54f2b94d1f1bef9ed546f P cd75a17ab2604397adab03bb8b5fd75c [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 15.
I20260709 13:20:26.634341  6874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab432e62819d499eaaf3dd55481dd930" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:20:26.635197  6874 raft_consensus.cc:3060] T ab432e62819d499eaaf3dd55481dd930 P cd75a17ab2604397adab03bb8b5fd75c [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:20:26.640978  6846 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:26.576921  6724 raft_consensus.cc:2468] T bd6869f07b5a4885a0b99fbe60c3b175 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 13.
W20260709 13:20:26.657198  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 202212us
I20260709 13:20:26.645030  6879 pending_rounds.cc:85] T e31b9971c15848dea59d4d4130141d9e P cd75a17ab2604397adab03bb8b5fd75c: Aborting all ops after (but not including) 5
W20260709 13:20:26.655968  6772 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.68:45071, user_credentials={real_user=slave}} blocked reactor thread for 95335us
W20260709 13:20:26.656672  7466 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 79037.9us
W20260709 13:20:26.666291  6695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 203804us
W20260709 13:20:26.648003 11631 log.cc:927] Time spent T b56bf91d90824c959e21e0cee5ba1816 P ccd8a4c3bfe3413cb2ae219b09aea832: Append to log took a long time: real 0.167s	user 0.003s	sys 0.000s
W20260709 13:20:26.671180 11622 log.cc:927] Time spent T 7887766dc6784fcaa42b35c05fea7a99 P cd75a17ab2604397adab03bb8b5fd75c: Append to log took a long time: real 0.189s	user 0.003s	sys 0.000s
I20260709 13:20:26.658989  6879 pending_rounds.cc:107] T e31b9971c15848dea59d4d4130141d9e P cd75a17ab2604397adab03bb8b5fd75c: Aborting uncommitted NO_OP operation due to leader change: 10.6
I20260709 13:20:26.679665  6879 raft_consensus.cc:2889] T e31b9971c15848dea59d4d4130141d9e P cd75a17ab2604397adab03bb8b5fd75c [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:20:26.672070 11625 log.cc:927] Time spent T 00000000000000000000000000000000 P b3ae52d33b9a4273a42e5e2cf3b5d6b5: Append to log took a long time: real 0.192s	user 0.000s	sys 0.003s
I20260709 13:20:26.649971 11561 raft_consensus.cc:493] T 2c240553ce044eedb41541d72b9475d7 P cd75a17ab2604397adab03bb8b5fd75c [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:26.675488  6731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de3186201e1a40d0b335eeb8b4e256e0" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 15 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:26.634428 11066 raft_consensus.cc:2749] T bb3d8792045a4583ae2e965b1350a5b4 P cd75a17ab2604397adab03bb8b5fd75c [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:20:26.676368  6770 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 136635us
W20260709 13:20:26.664654 11626 log.cc:927] Time spent T 4d9def8b32fd443aa94ab1420b06837b P ccd8a4c3bfe3413cb2ae219b09aea832: Append to log took a long time: real 0.127s	user 0.000s	sys 0.002s
I20260709 13:20:26.691010  6876 raft_consensus.cc:2468] T 4275cf08e63345f993bce8664eada830 P cd75a17ab2604397adab03bb8b5fd75c [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 13.
I20260709 13:20:26.706746  6874 raft_consensus.cc:2468] T ab432e62819d499eaaf3dd55481dd930 P cd75a17ab2604397adab03bb8b5fd75c [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 15.
I20260709 13:20:26.709270  6844 leader_election.cc:304] T 3d65025eea89441290d85dd053810e31 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:20:26.712111  6731 raft_consensus.cc:1275] T 24ee15416e3145beaa1b8183453729a3 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 15 FOLLOWER]: Refusing update from remote peer cd75a17ab2604397adab03bb8b5fd75c: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:20:26.713613 11066 raft_consensus.cc:493] T f3f9c2e2bf644115957398fe4c9459db P cd75a17ab2604397adab03bb8b5fd75c [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:26.714301 11066 raft_consensus.cc:515] T f3f9c2e2bf644115957398fe4c9459db P cd75a17ab2604397adab03bb8b5fd75c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:26.716522  7468 leader_election.cc:304] T bb3d8792045a4583ae2e965b1350a5b4 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, cd75a17ab2604397adab03bb8b5fd75c; no voters: ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:20:26.717319 11503 raft_consensus.cc:2804] T 3d65025eea89441290d85dd053810e31 P cd75a17ab2604397adab03bb8b5fd75c [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:20:26.718436 11596 raft_consensus.cc:2804] T bb3d8792045a4583ae2e965b1350a5b4 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:20:26.719115 11596 raft_consensus.cc:493] T bb3d8792045a4583ae2e965b1350a5b4 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:26.719429 11596 raft_consensus.cc:3060] T bb3d8792045a4583ae2e965b1350a5b4 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:20:26.729432 11066 leader_election.cc:290] T f3f9c2e2bf644115957398fe4c9459db P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:20:26.731895  6724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "853ac0a8cbd64ce99457f170216d4d0f" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:26.732184  6731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a485a995abc4807b6e511e45419f737" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:26.733090  6731 raft_consensus.cc:2468] T 3a485a995abc4807b6e511e45419f737 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 12.
I20260709 13:20:26.733640 11561 raft_consensus.cc:515] T 2c240553ce044eedb41541d72b9475d7 P cd75a17ab2604397adab03bb8b5fd75c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:26.734212 11596 raft_consensus.cc:515] T bb3d8792045a4583ae2e965b1350a5b4 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:20:26.718341 11439 raft_consensus.cc:493] T 9b3759de40694069b13c0f8bd40e5709 P cd75a17ab2604397adab03bb8b5fd75c [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:20:26.737510  6770 leader_election.cc:304] T ab432e62819d499eaaf3dd55481dd930 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
I20260709 13:20:26.737713  6881 raft_consensus.cc:2468] T 9e326172347f45e99a0d482b5d8ef768 P cd75a17ab2604397adab03bb8b5fd75c [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 12.
I20260709 13:20:26.763048  6731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e326172347f45e99a0d482b5d8ef768" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:26.761230 11547 consensus_queue.cc:1059] T f5be3a11b23d4ea9b08300a2789821c7 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 5, Time since last communication: 0.012s
I20260709 13:20:26.773458 11504 raft_consensus.cc:3055] T f5be3a11b23d4ea9b08300a2789821c7 P b7ab4784c7344b939bc36f639286f377 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:20:26.773749  6726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20f6842e26174571996b8dea4151d4be" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:20:26.774130 11504 raft_consensus.cc:740] T f5be3a11b23d4ea9b08300a2789821c7 P b7ab4784c7344b939bc36f639286f377 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
I20260709 13:20:26.774910  6726 raft_consensus.cc:2368] T 20f6842e26174571996b8dea4151d4be P ccd8a4c3bfe3413cb2ae219b09aea832 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c for earlier term 14. Current term is 15.
I20260709 13:20:26.775396 11504 consensus_queue.cc:260] T f5be3a11b23d4ea9b08300a2789821c7 P b7ab4784c7344b939bc36f639286f377 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:26.778909 11504 raft_consensus.cc:3060] T f5be3a11b23d4ea9b08300a2789821c7 P b7ab4784c7344b939bc36f639286f377 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:20:26.782619 11561 leader_election.cc:290] T 2c240553ce044eedb41541d72b9475d7 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:20:26.783713 11439 raft_consensus.cc:515] T 9b3759de40694069b13c0f8bd40e5709 P cd75a17ab2604397adab03bb8b5fd75c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:26.787262 11439 leader_election.cc:290] T 9b3759de40694069b13c0f8bd40e5709 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
W20260709 13:20:26.787985  6695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 97190.4us
I20260709 13:20:26.790194  6732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44bde925b2e541b69890d70715b85176" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:26.792196  6802 raft_consensus.cc:1240] T 30e88460611e47b2ba16a46a30b5f416 P b7ab4784c7344b939bc36f639286f377 [term 12 FOLLOWER]: Rejecting Update request from peer ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 11. Current term is 12. Ops: []
I20260709 13:20:26.793202  6726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3022224cc81473690653a83d4e99470" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:26.794317  6726 raft_consensus.cc:2393] T a3022224cc81473690653a83d4e99470 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c in current term 14: Already voted for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in this term.
I20260709 13:20:26.796932  6876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1704639a875409b9959353527b3fd68" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:26.797536  6806 raft_consensus.cc:1275] T 2c240553ce044eedb41541d72b9475d7 P b7ab4784c7344b939bc36f639286f377 [term 14 FOLLOWER]: Refusing update from remote peer ccd8a4c3bfe3413cb2ae219b09aea832: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 8. (term mismatch)
I20260709 13:20:26.800563  6806 pending_rounds.cc:85] T 2c240553ce044eedb41541d72b9475d7 P b7ab4784c7344b939bc36f639286f377: Aborting all ops after (but not including) 7
I20260709 13:20:26.800858  6806 pending_rounds.cc:107] T 2c240553ce044eedb41541d72b9475d7 P b7ab4784c7344b939bc36f639286f377: Aborting uncommitted NO_OP operation due to leader change: 13.8
I20260709 13:20:26.801136  6806 raft_consensus.cc:2889] T 2c240553ce044eedb41541d72b9475d7 P b7ab4784c7344b939bc36f639286f377 [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:20:26.792296  6732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4275cf08e63345f993bce8664eada830" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:26.805976  6732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e31b9971c15848dea59d4d4130141d9e" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:26.807796  6876 raft_consensus.cc:2468] T a1704639a875409b9959353527b3fd68 P cd75a17ab2604397adab03bb8b5fd75c [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 14.
I20260709 13:20:26.807906  6802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4db81d9d329422bb3b4160ca4ac2d1d" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:26.809674  6876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c240553ce044eedb41541d72b9475d7" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:26.810595  6876 raft_consensus.cc:2468] T 2c240553ce044eedb41541d72b9475d7 P cd75a17ab2604397adab03bb8b5fd75c [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 14.
I20260709 13:20:26.750990 11563 raft_consensus.cc:515] T 7887766dc6784fcaa42b35c05fea7a99 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
W20260709 13:20:26.813482  6770 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 76092.6us
I20260709 13:20:26.813751  7466 leader_election.cc:304] T 427c124d773f483294511e80fe340075 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
I20260709 13:20:26.751454  6772 leader_election.cc:304] T 7ba5dac66ab5497e9e336f2a3c28cda5 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, b7ab4784c7344b939bc36f639286f377; no voters: 
I20260709 13:20:26.830056  6874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44bde925b2e541b69890d70715b85176" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:26.832118  6874 raft_consensus.cc:2468] T 44bde925b2e541b69890d70715b85176 P cd75a17ab2604397adab03bb8b5fd75c [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 13.
I20260709 13:20:26.812588  6876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "713b5728a197487c9300b310ab94e5a3" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:26.835389  6876 raft_consensus.cc:2468] T 713b5728a197487c9300b310ab94e5a3 P cd75a17ab2604397adab03bb8b5fd75c [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 12.
I20260709 13:20:26.854295  6806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3022224cc81473690653a83d4e99470" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:26.854882  6804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4275cf08e63345f993bce8664eada830" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:26.855103  6806 raft_consensus.cc:2468] T a3022224cc81473690653a83d4e99470 P b7ab4784c7344b939bc36f639286f377 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 14.
I20260709 13:20:26.867460  6804 raft_consensus.cc:2393] T 4275cf08e63345f993bce8664eada830 P b7ab4784c7344b939bc36f639286f377 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c in current term 13: Already voted for candidate b7ab4784c7344b939bc36f639286f377 in this term.
W20260709 13:20:26.868271  6772 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.68:45071, user_credentials={real_user=slave}} blocked reactor thread for 164802us
I20260709 13:20:26.870673 11547 raft_consensus.cc:2804] T 7ba5dac66ab5497e9e336f2a3c28cda5 P b7ab4784c7344b939bc36f639286f377 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:20:26.874598  6728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3d8792045a4583ae2e965b1350a5b4" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:20:26.875100  6802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e326172347f45e99a0d482b5d8ef768" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:26.881543  6731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24ee15416e3145beaa1b8183453729a3" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:20:26.882731  6731 raft_consensus.cc:3060] T 24ee15416e3145beaa1b8183453729a3 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:26.830011 11511 raft_consensus.cc:2804] T 427c124d773f483294511e80fe340075 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:20:26.885908  6772 leader_election.cc:400] T d8cee0accdb8499c86d4414b72565a38 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 13 pre-election: Vote denied by peer 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071) with higher term. Message: Invalid argument: T d8cee0accdb8499c86d4414b72565a38 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7ab4784c7344b939bc36f639286f377 for earlier term 13. Current term is 14.
I20260709 13:20:26.886462  6772 leader_election.cc:403] T d8cee0accdb8499c86d4414b72565a38 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 13 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:20:26.816722 11439 raft_consensus.cc:493] T f58dc08b12a2494bb9a1372837970ca2 P cd75a17ab2604397adab03bb8b5fd75c [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:26.874236  6725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce4f062dcd314d43a63ca74067cb5ee3" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:26.876662  6800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44bde925b2e541b69890d70715b85176" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:26.877825 11547 raft_consensus.cc:493] T 7ba5dac66ab5497e9e336f2a3c28cda5 P b7ab4784c7344b939bc36f639286f377 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:26.885324  6801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e31b9971c15848dea59d4d4130141d9e" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:26.824841 11354 raft_consensus.cc:2804] T ab432e62819d499eaaf3dd55481dd930 P b7ab4784c7344b939bc36f639286f377 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:20:26.888638  6725 raft_consensus.cc:2468] T ce4f062dcd314d43a63ca74067cb5ee3 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in term 13.
I20260709 13:20:26.888639  6802 raft_consensus.cc:2393] T 9e326172347f45e99a0d482b5d8ef768 P b7ab4784c7344b939bc36f639286f377 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c in current term 12: Already voted for candidate b7ab4784c7344b939bc36f639286f377 in this term.
I20260709 13:20:26.889393  6800 raft_consensus.cc:2468] T 44bde925b2e541b69890d70715b85176 P b7ab4784c7344b939bc36f639286f377 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 13.
I20260709 13:20:26.893240  6723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1704639a875409b9959353527b3fd68" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:26.774137 11596 leader_election.cc:290] T bb3d8792045a4583ae2e965b1350a5b4 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 12 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:26.871371 11561 raft_consensus.cc:493] T 4f00a2e87e56452083b759f60d461ee3 P cd75a17ab2604397adab03bb8b5fd75c [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:26.911530  6727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c240553ce044eedb41541d72b9475d7" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
W20260709 13:20:26.913487  6845 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:26.896379 11439 raft_consensus.cc:515] T f58dc08b12a2494bb9a1372837970ca2 P cd75a17ab2604397adab03bb8b5fd75c [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:26.914403  6725 raft_consensus.cc:1240] T 07a92dd554674067a83a9cb68c4773f2 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 13 FOLLOWER]: Rejecting Update request from peer b7ab4784c7344b939bc36f639286f377 for earlier term 12. Current term is 13. Ops: []
I20260709 13:20:26.915570  6725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "711ef6523deb4cbe8ef2ba61e1c21c98" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:26.908981 11511 raft_consensus.cc:697] T 427c124d773f483294511e80fe340075 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 12 LEADER]: Becoming Leader. State: Replica: 7ba59cc884714e8aa5f3f0ecaed84cbb, State: Running, Role: LEADER
I20260709 13:20:26.916504  6729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44bde925b2e541b69890d70715b85176" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:26.920322  6725 raft_consensus.cc:2468] T 711ef6523deb4cbe8ef2ba61e1c21c98 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 14.
I20260709 13:20:26.917670  6723 raft_consensus.cc:1275] T 7c37d41cd9164c15a6826ca62a851a69 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 13 FOLLOWER]: Refusing update from remote peer b7ab4784c7344b939bc36f639286f377: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:20:26.896522 11547 raft_consensus.cc:3060] T 7ba5dac66ab5497e9e336f2a3c28cda5 P b7ab4784c7344b939bc36f639286f377 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:26.924295  6878 raft_consensus.cc:1275] T f58dc08b12a2494bb9a1372837970ca2 P cd75a17ab2604397adab03bb8b5fd75c [term 16 FOLLOWER]: Refusing update from remote peer b7ab4784c7344b939bc36f639286f377: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 13:20:26.922389  6730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "713b5728a197487c9300b310ab94e5a3" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
W20260709 13:20:26.930079  6697 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 466698us
I20260709 13:20:26.915980 11439 leader_election.cc:290] T f58dc08b12a2494bb9a1372837970ca2 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:20:26.917199 11563 leader_election.cc:290] T 7887766dc6784fcaa42b35c05fea7a99 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 14 election: Requested vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
W20260709 13:20:26.929590  6873 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.636s	user 0.013s	sys 0.025s
W20260709 13:20:26.996964  6873 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.703s	user 0.013s	sys 0.025s
I20260709 13:20:27.017131  6731 raft_consensus.cc:2468] T 24ee15416e3145beaa1b8183453729a3 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in term 16.
I20260709 13:20:26.923681 11561 raft_consensus.cc:515] T 4f00a2e87e56452083b759f60d461ee3 P cd75a17ab2604397adab03bb8b5fd75c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:20:27.029170  6725 raft_consensus.cc:1240] T 7887766dc6784fcaa42b35c05fea7a99 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 14 FOLLOWER]: Rejecting Update request from peer b7ab4784c7344b939bc36f639286f377 for earlier term 13. Current term is 14. Ops: []
W20260709 13:20:27.025462 11629 log.cc:927] Time spent T 8c7f33e544204fbaac4078e3e83bbf4e P cd75a17ab2604397adab03bb8b5fd75c: Append to log took a long time: real 0.076s	user 0.001s	sys 0.000s
I20260709 13:20:26.918692 11511 consensus_queue.cc:237] T 427c124d773f483294511e80fe340075 P 7ba59cc884714e8aa5f3f0ecaed84cbb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 12, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } attrs { replace: true } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:20:27.082074  6880 raft_consensus.cc:1275] T 4f00a2e87e56452083b759f60d461ee3 P cd75a17ab2604397adab03bb8b5fd75c [term 13 FOLLOWER]: Refusing update from remote peer b7ab4784c7344b939bc36f639286f377: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:20:27.076924 11504 raft_consensus.cc:2749] T d8cee0accdb8499c86d4414b72565a38 P b7ab4784c7344b939bc36f639286f377 [term 14 FOLLOWER]: Leader pre-election lost for term 13. Reason: Vote denied by peer 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071) with higher term. Message: Invalid argument: T d8cee0accdb8499c86d4414b72565a38 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7ab4784c7344b939bc36f639286f377 for earlier term 13. Current term is 14.
W20260709 13:20:27.143733  6846 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:27.125109 11172 raft_consensus.cc:2749] T be1a92657f494cac8dd227d152f50151 P b7ab4784c7344b939bc36f639286f377 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:20:27.117571 11066 raft_consensus.cc:493] T 427c124d773f483294511e80fe340075 P cd75a17ab2604397adab03bb8b5fd75c [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 7ba59cc884714e8aa5f3f0ecaed84cbb)
I20260709 13:20:27.109076 11503 raft_consensus.cc:697] T 3d65025eea89441290d85dd053810e31 P cd75a17ab2604397adab03bb8b5fd75c [term 13 LEADER]: Becoming Leader. State: Replica: cd75a17ab2604397adab03bb8b5fd75c, State: Running, Role: LEADER
I20260709 13:20:27.126387 11588 raft_consensus.cc:493] T 22ccee1b570c4ad3a57bd7aec085b1b4 P b7ab4784c7344b939bc36f639286f377 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:20:27.214754  6771 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:27.208833 11524 raft_consensus.cc:493] T bb7fa124c3bf4ef9ab65a407cb008441 P cd75a17ab2604397adab03bb8b5fd75c [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:20:27.235105  6770 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 232296us
I20260709 13:20:27.236418  6770 leader_election.cc:304] T 20f6842e26174571996b8dea4151d4be P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
W20260709 13:20:27.245066  6697 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 164475us
I20260709 13:20:27.206463 11588 raft_consensus.cc:515] T 22ccee1b570c4ad3a57bd7aec085b1b4 P b7ab4784c7344b939bc36f639286f377 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:27.205062 11635 consensus_queue.cc:1048] T f03d0dbf16864ca4bc1bb5e4c0334c0f P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.040s
I20260709 13:20:27.253353  6802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bf4668eeb70467fb3dc5a0289233b3c" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:27.229153 11636 consensus_queue.cc:1048] T bb3d8792045a4583ae2e965b1350a5b4 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.019s
I20260709 13:20:27.209698 11066 raft_consensus.cc:515] T 427c124d773f483294511e80fe340075 P cd75a17ab2604397adab03bb8b5fd75c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } attrs { replace: true } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:20:27.265697  6801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4b8bd455d5a47c18a1380839c6e0d61" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 13 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:27.269004 11654 raft_consensus.cc:493] T 90d42e216d9741e190bca19a781291fd P b7ab4784c7344b939bc36f639286f377 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:27.269796 11654 raft_consensus.cc:515] T 90d42e216d9741e190bca19a781291fd P b7ab4784c7344b939bc36f639286f377 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:27.272367 11657 raft_consensus.cc:493] T 4d9def8b32fd443aa94ab1420b06837b P b7ab4784c7344b939bc36f639286f377 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:27.273073 11657 raft_consensus.cc:515] T 4d9def8b32fd443aa94ab1420b06837b P b7ab4784c7344b939bc36f639286f377 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:27.256592 11561 leader_election.cc:290] T 4f00a2e87e56452083b759f60d461ee3 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
W20260709 13:20:27.288894 11637 log.cc:927] Time spent T 07a92dd554674067a83a9cb68c4773f2 P cd75a17ab2604397adab03bb8b5fd75c: Append to log took a long time: real 0.084s	user 0.001s	sys 0.000s
I20260709 13:20:27.260756 11503 consensus_queue.cc:237] T 3d65025eea89441290d85dd053810e31 P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 11.6, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
W20260709 13:20:27.291980 11643 log.cc:927] Time spent T fe20b4b48823486ca3b9c648db6ce8aa P cd75a17ab2604397adab03bb8b5fd75c: Append to log took a long time: real 0.066s	user 0.000s	sys 0.000s
I20260709 13:20:27.257087 11650 consensus_queue.cc:1048] T 4d9def8b32fd443aa94ab1420b06837b P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.044s
I20260709 13:20:27.240993 11524 raft_consensus.cc:515] T bb7fa124c3bf4ef9ab65a407cb008441 P cd75a17ab2604397adab03bb8b5fd75c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
W20260709 13:20:27.293370  6678 auto_rebalancer.cc:629] Failed to schedule move for tablet ab432e62819d499eaaf3dd55481dd930: Illegal state: Replica ccd8a4c3bfe3413cb2ae219b09aea832 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 15 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } }
I20260709 13:20:27.267444  6801 raft_consensus.cc:2468] T f4b8bd455d5a47c18a1380839c6e0d61 P b7ab4784c7344b939bc36f639286f377 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 12.
I20260709 13:20:27.246022 11354 raft_consensus.cc:697] T ab432e62819d499eaaf3dd55481dd930 P b7ab4784c7344b939bc36f639286f377 [term 15 LEADER]: Becoming Leader. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
I20260709 13:20:27.297597 11066 leader_election.cc:290] T 427c124d773f483294511e80fe340075 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
W20260709 13:20:27.301528  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 153688us
I20260709 13:20:27.302330  6844 leader_election.cc:304] T e77e330a82df4b43a745d57a68f6f057 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:20:27.307209  7466 leader_election.cc:304] T ce4f062dcd314d43a63ca74067cb5ee3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
I20260709 13:20:27.312269  6802 raft_consensus.cc:1240] T 7c44c4849aa54f2b94d1f1bef9ed546f P b7ab4784c7344b939bc36f639286f377 [term 15 FOLLOWER]: Rejecting Update request from peer ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 14. Current term is 15. Ops: []
W20260709 13:20:27.313511  6697 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 49614.3us
I20260709 13:20:27.312136  6873 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53406 (request call id 2276) took 1092 ms. Trace:
I20260709 13:20:27.295917 11524 leader_election.cc:290] T bb7fa124c3bf4ef9ab65a407cb008441 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
W20260709 13:20:27.318408  6770 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 82099.4us
W20260709 13:20:27.320574  6845 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:27.315317  6873 rpcz_store.cc:276] 0709 13:20:26.214296 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:26.279048 (+ 64752us) service_pool.cc:224] Handling call
0709 13:20:26.292015 (+ 12967us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:20:26.292762 (+   747us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:26.292791 (+    29us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:20:26.293582 (+   791us) log.cc:844] Serialized 52 byte log entry
0709 13:20:26.997571 (+703989us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:20:27.026634 (+ 29063us) log.cc:844] Serialized 14 byte log entry
0709 13:20:27.027034 (+   400us) log.cc:844] Serialized 14 byte log entry
0709 13:20:27.027204 (+   170us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:27.027293 (+    89us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:27.281175 (+253882us) spinlock_profiling.cc:243] Waited 1.6 ms on lock 0x7b4800210258. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc148d3aa1 00007fcc148cab37 00007fcc148ca9ca 00007fcc149c226f 00007fcc149c1f37 00007fcc149d655c 00007fcc149d6508 00007fcc149d6488 00007fcc149d6443 00007fcc149d56ec 00007fcc138ffa96
0709 13:20:27.301023 (+ 19848us) raft_consensus.cc:1685] finished
0709 13:20:27.301066 (+    43us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:27.306636 (+  5570us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6324,"prepare.queue_time_us":160247,"prepare.run_cpu_time_us":88,"prepare.run_wall_time_us":1776,"raft.queue_time_us":7872,"raft.run_cpu_time_us":4082,"raft.run_wall_time_us":266061,"spinlock_wait_cycles":9900800,"thread_start_us":703462,"threads_started":1,"wal-append.queue_time_us":828488}
I20260709 13:20:27.287860 11547 raft_consensus.cc:515] T 7ba5dac66ab5497e9e336f2a3c28cda5 P b7ab4784c7344b939bc36f639286f377 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
W20260709 13:20:27.313002 11640 log.cc:927] Time spent T 3a485a995abc4807b6e511e45419f737 P cd75a17ab2604397adab03bb8b5fd75c: Append to log took a long time: real 0.072s	user 0.000s	sys 0.001s
I20260709 13:20:27.322732 11066 raft_consensus.cc:2804] T e77e330a82df4b43a745d57a68f6f057 P cd75a17ab2604397adab03bb8b5fd75c [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:20:27.323365 11066 raft_consensus.cc:493] T e77e330a82df4b43a745d57a68f6f057 P cd75a17ab2604397adab03bb8b5fd75c [term 14 FOLLOWER]: Starting leader election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:20:27.323784 11066 raft_consensus.cc:3060] T e77e330a82df4b43a745d57a68f6f057 P cd75a17ab2604397adab03bb8b5fd75c [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:27.323839  6802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20f6842e26174571996b8dea4151d4be" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:27.324292 11547 leader_election.cc:290] T 7ba5dac66ab5497e9e336f2a3c28cda5 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 14 election: Requested vote from peers cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:20:27.324721  6802 raft_consensus.cc:2393] T 20f6842e26174571996b8dea4151d4be P b7ab4784c7344b939bc36f639286f377 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ccd8a4c3bfe3413cb2ae219b09aea832 in current term 15: Already voted for candidate b7ab4784c7344b939bc36f639286f377 in this term.
I20260709 13:20:27.325233 11547 raft_consensus.cc:2804] T 20f6842e26174571996b8dea4151d4be P b7ab4784c7344b939bc36f639286f377 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:20:27.325727 11547 raft_consensus.cc:697] T 20f6842e26174571996b8dea4151d4be P b7ab4784c7344b939bc36f639286f377 [term 15 LEADER]: Becoming Leader. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
I20260709 13:20:27.326325 11636 consensus_queue.cc:1048] T 2c240553ce044eedb41541d72b9475d7 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:20:27.326943 11478 raft_consensus.cc:2804] T ce4f062dcd314d43a63ca74067cb5ee3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:20:27.326704 11547 consensus_queue.cc:237] T 20f6842e26174571996b8dea4151d4be P b7ab4784c7344b939bc36f639286f377 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:27.327385 11478 raft_consensus.cc:493] T ce4f062dcd314d43a63ca74067cb5ee3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:27.327744 11478 raft_consensus.cc:3060] T ce4f062dcd314d43a63ca74067cb5ee3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:27.328193 11659 consensus_queue.cc:1059] T 30e88460611e47b2ba16a46a30b5f416 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:20:27.329509  6844 leader_election.cc:304] T f4b8bd455d5a47c18a1380839c6e0d61 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:20:27.312695 11504 raft_consensus.cc:493] T 17587d6730594da4a56fa13a353232a1 P b7ab4784c7344b939bc36f639286f377 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:27.329442 11659 raft_consensus.cc:493] T a3022224cc81473690653a83d4e99470 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:20:27.351598  6772 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.68:45071, user_credentials={real_user=slave}} blocked reactor thread for 482094us
I20260709 13:20:27.354930  6697 leader_election.cc:304] T bd6869f07b5a4885a0b99fbe60c3b175 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377
I20260709 13:20:27.363243  6798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c7f33e544204fbaac4078e3e83bbf4e" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:20:27.365610 11661 raft_consensus.cc:2804] T f4b8bd455d5a47c18a1380839c6e0d61 P cd75a17ab2604397adab03bb8b5fd75c [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:20:27.366139 11661 raft_consensus.cc:493] T f4b8bd455d5a47c18a1380839c6e0d61 P cd75a17ab2604397adab03bb8b5fd75c [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:27.366472 11661 raft_consensus.cc:3060] T f4b8bd455d5a47c18a1380839c6e0d61 P cd75a17ab2604397adab03bb8b5fd75c [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:27.330727 11596 raft_consensus.cc:493] T 17587d6730594da4a56fa13a353232a1 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:27.370044  6844 leader_election.cc:304] T dbdf895bba214ff68685a24fd17dfb5d P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:20:27.375233 11657 leader_election.cc:290] T 4d9def8b32fd443aa94ab1420b06837b P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:27.363719 11658 consensus_queue.cc:1048] T f58dc08b12a2494bb9a1372837970ca2 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.027s
I20260709 13:20:27.383384 11524 raft_consensus.cc:2804] T dbdf895bba214ff68685a24fd17dfb5d P cd75a17ab2604397adab03bb8b5fd75c [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:20:27.383929 11524 raft_consensus.cc:493] T dbdf895bba214ff68685a24fd17dfb5d P cd75a17ab2604397adab03bb8b5fd75c [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:27.384336 11524 raft_consensus.cc:3060] T dbdf895bba214ff68685a24fd17dfb5d P cd75a17ab2604397adab03bb8b5fd75c [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:20:27.384640 11644 log.cc:927] Time spent T 17587d6730594da4a56fa13a353232a1 P ccd8a4c3bfe3413cb2ae219b09aea832: Append to log took a long time: real 0.233s	user 0.001s	sys 0.003s
I20260709 13:20:27.362022 11659 raft_consensus.cc:515] T a3022224cc81473690653a83d4e99470 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:27.386180 11066 raft_consensus.cc:515] T e77e330a82df4b43a745d57a68f6f057 P cd75a17ab2604397adab03bb8b5fd75c [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } }
I20260709 13:20:27.340984 11635 consensus_queue.cc:1048] T 30e88460611e47b2ba16a46a30b5f416 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.040s
I20260709 13:20:27.368623 11596 raft_consensus.cc:515] T 17587d6730594da4a56fa13a353232a1 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:20:27.389499  6844 leader_election.cc:304] T f09c2a98de1a4decabd0ff900dd44caa P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:20:27.393966  6844 leader_election.cc:304] T de3186201e1a40d0b335eeb8b4e256e0 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:20:27.359969 11563 raft_consensus.cc:493] T 22ccee1b570c4ad3a57bd7aec085b1b4 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:20:27.397310 11439 raft_consensus.cc:2804] T de3186201e1a40d0b335eeb8b4e256e0 P cd75a17ab2604397adab03bb8b5fd75c [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:20:27.397610 11659 leader_election.cc:290] T a3022224cc81473690653a83d4e99470 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:27.401142  6798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "711ef6523deb4cbe8ef2ba61e1c21c98" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:27.401564  6844 leader_election.cc:400] T ab432e62819d499eaaf3dd55481dd930 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 14 election: Vote denied by peer b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817) with higher term. Message: Invalid argument: T ab432e62819d499eaaf3dd55481dd930 P b7ab4784c7344b939bc36f639286f377 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c for earlier term 14. Current term is 15.
I20260709 13:20:27.409720  6798 raft_consensus.cc:2468] T 711ef6523deb4cbe8ef2ba61e1c21c98 P b7ab4784c7344b939bc36f639286f377 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 14.
I20260709 13:20:27.410382  6844 leader_election.cc:403] T ab432e62819d499eaaf3dd55481dd930 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 14 election: Cancelling election due to peer responding with higher term
I20260709 13:20:27.322844 11354 consensus_queue.cc:237] T ab432e62819d499eaaf3dd55481dd930 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
W20260709 13:20:27.414407  6770 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 60598.4us
W20260709 13:20:27.413978  7466 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 106842us
I20260709 13:20:27.417629  7466 leader_election.cc:304] T 24ee15416e3145beaa1b8183453729a3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
I20260709 13:20:27.356879 11504 raft_consensus.cc:515] T 17587d6730594da4a56fa13a353232a1 P b7ab4784c7344b939bc36f639286f377 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:20:27.418663  6770 leader_election.cc:304] T bd6869f07b5a4885a0b99fbe60c3b175 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
I20260709 13:20:27.403090 11561 raft_consensus.cc:2804] T f09c2a98de1a4decabd0ff900dd44caa P cd75a17ab2604397adab03bb8b5fd75c [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:20:27.402949 11439 raft_consensus.cc:493] T de3186201e1a40d0b335eeb8b4e256e0 P cd75a17ab2604397adab03bb8b5fd75c [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:20:27.432565  6772 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.68:45071, user_credentials={real_user=slave}} blocked reactor thread for 78818us
I20260709 13:20:27.413468 11649 consensus_queue.cc:1048] T 711ef6523deb4cbe8ef2ba61e1c21c98 P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.029s
I20260709 13:20:27.420324 11659 raft_consensus.cc:2804] T bd6869f07b5a4885a0b99fbe60c3b175 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:20:27.406394 11563 raft_consensus.cc:515] T 22ccee1b570c4ad3a57bd7aec085b1b4 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:27.434513 11561 raft_consensus.cc:493] T f09c2a98de1a4decabd0ff900dd44caa P cd75a17ab2604397adab03bb8b5fd75c [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:20:27.463061  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 67137.8us
I20260709 13:20:27.436501 11439 raft_consensus.cc:3060] T de3186201e1a40d0b335eeb8b4e256e0 P cd75a17ab2604397adab03bb8b5fd75c [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:27.418479 11657 consensus_queue.cc:1048] T 4f00a2e87e56452083b759f60d461ee3 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.035s
I20260709 13:20:27.433772 11458 raft_consensus.cc:2804] T 24ee15416e3145beaa1b8183453729a3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:20:27.454309 11659 raft_consensus.cc:493] T bd6869f07b5a4885a0b99fbe60c3b175 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:27.465804  6844 leader_election.cc:304] T d8cee0accdb8499c86d4414b72565a38 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, b7ab4784c7344b939bc36f639286f377
I20260709 13:20:27.421509 11658 consensus_queue.cc:1059] T 8c7f33e544204fbaac4078e3e83bbf4e P b7ab4784c7344b939bc36f639286f377 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.036s
I20260709 13:20:27.485489  6802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5be3a11b23d4ea9b08300a2789821c7" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:20:27.475773  6844 leader_election.cc:304] T 853ac0a8cbd64ce99457f170216d4d0f P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:20:27.487550 11654 leader_election.cc:290] T 90d42e216d9741e190bca19a781291fd P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
W20260709 13:20:27.488430  6772 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 52981.1us
I20260709 13:20:27.455186 11066 leader_election.cc:290] T e77e330a82df4b43a745d57a68f6f057 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 15 election: Requested vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391)
W20260709 13:20:27.466796 11638 log.cc:927] Time spent T 1bf4668eeb70467fb3dc5a0289233b3c P cd75a17ab2604397adab03bb8b5fd75c: Append to log took a long time: real 0.213s	user 0.000s	sys 0.002s
I20260709 13:20:27.465138 11561 raft_consensus.cc:3060] T f09c2a98de1a4decabd0ff900dd44caa P cd75a17ab2604397adab03bb8b5fd75c [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:27.488478 11671 raft_consensus.cc:2804] T bd6869f07b5a4885a0b99fbe60c3b175 P b7ab4784c7344b939bc36f639286f377 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:20:27.465229 11576 raft_consensus.cc:2749] T ab432e62819d499eaaf3dd55481dd930 P cd75a17ab2604397adab03bb8b5fd75c [term 15 FOLLOWER]: Leader election lost for term 14. Reason: Vote denied by peer b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817) with higher term. Message: Invalid argument: T ab432e62819d499eaaf3dd55481dd930 P b7ab4784c7344b939bc36f639286f377 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c for earlier term 14. Current term is 15.
I20260709 13:20:27.486090 11659 raft_consensus.cc:3060] T bd6869f07b5a4885a0b99fbe60c3b175 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:20:27.500161  7466 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 47202.5us
I20260709 13:20:27.488708 11596 leader_election.cc:290] T 17587d6730594da4a56fa13a353232a1 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:20:27.501540  6772 leader_election.cc:304] T f09c2a98de1a4decabd0ff900dd44caa P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:20:27.507005  6844 leader_election.cc:400] T 20f6842e26174571996b8dea4151d4be P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 14 election: Vote denied by peer b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817) with higher term. Message: Invalid argument: T 20f6842e26174571996b8dea4151d4be P b7ab4784c7344b939bc36f639286f377 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c for earlier term 14. Current term is 15.
I20260709 13:20:27.507411  6844 leader_election.cc:403] T 20f6842e26174571996b8dea4151d4be P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 14 election: Cancelling election due to peer responding with higher term
I20260709 13:20:27.485029 11612 consensus_queue.cc:1048] T 34f36d59d88f40fe8a2805e604fc6c0a P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.018s
I20260709 13:20:27.495188 11588 leader_election.cc:290] T 22ccee1b570c4ad3a57bd7aec085b1b4 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:27.495903 11503 raft_consensus.cc:3060] T d8cee0accdb8499c86d4414b72565a38 P cd75a17ab2604397adab03bb8b5fd75c [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:27.499809 11669 raft_consensus.cc:493] T 3fa34c08b205435dba97346991aa1f92 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:20:27.549579  6770 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 96172us
I20260709 13:20:27.549957  6844 leader_election.cc:304] T a3022224cc81473690653a83d4e99470 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:20:27.504628 11676 raft_consensus.cc:2804] T 853ac0a8cbd64ce99457f170216d4d0f P cd75a17ab2604397adab03bb8b5fd75c [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:20:27.508945 11671 raft_consensus.cc:697] T bd6869f07b5a4885a0b99fbe60c3b175 P b7ab4784c7344b939bc36f639286f377 [term 13 LEADER]: Becoming Leader. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
W20260709 13:20:27.531433 11662 log.cc:927] Time spent T 9b3759de40694069b13c0f8bd40e5709 P cd75a17ab2604397adab03bb8b5fd75c: Append to log took a long time: real 0.150s	user 0.001s	sys 0.001s
I20260709 13:20:27.558499  6800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a92dd554674067a83a9cb68c4773f2" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:20:27.509413 11654 consensus_queue.cc:1059] T 07a92dd554674067a83a9cb68c4773f2 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.050s
I20260709 13:20:27.559825  6770 leader_election.cc:304] T 711ef6523deb4cbe8ef2ba61e1c21c98 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
I20260709 13:20:27.514976 11066 raft_consensus.cc:2749] T 20f6842e26174571996b8dea4151d4be P cd75a17ab2604397adab03bb8b5fd75c [term 15 FOLLOWER]: Leader election lost for term 14. Reason: Vote denied by peer b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817) with higher term. Message: Invalid argument: T 20f6842e26174571996b8dea4151d4be P b7ab4784c7344b939bc36f639286f377 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c for earlier term 14. Current term is 15.
I20260709 13:20:27.557699 11458 raft_consensus.cc:697] T 24ee15416e3145beaa1b8183453729a3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 16 LEADER]: Becoming Leader. State: Replica: 7ba59cc884714e8aa5f3f0ecaed84cbb, State: Running, Role: LEADER
I20260709 13:20:27.560322  6805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a485a995abc4807b6e511e45419f737" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
W20260709 13:20:27.560818  6772 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 66547.1us
I20260709 13:20:27.568181  6802 raft_consensus.cc:2468] T f5be3a11b23d4ea9b08300a2789821c7 P b7ab4784c7344b939bc36f639286f377 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 12.
I20260709 13:20:27.595481  6799 raft_consensus.cc:1275] T 95a75bfe094d4bdc963aba3f08dfcd25 P b7ab4784c7344b939bc36f639286f377 [term 13 FOLLOWER]: Refusing update from remote peer ccd8a4c3bfe3413cb2ae219b09aea832: Log matching property violated. Preceding OpId in replica: term: 11 index: 5. Preceding OpId from leader: term: 13 index: 6. (index mismatch)
I20260709 13:20:27.598770 11066 raft_consensus.cc:2804] T a3022224cc81473690653a83d4e99470 P cd75a17ab2604397adab03bb8b5fd75c [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:20:27.599232 11458 consensus_queue.cc:237] T 24ee15416e3145beaa1b8183453729a3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:20:27.601037  6805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7887766dc6784fcaa42b35c05fea7a99" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:20:27.603034  6695 leader_election.cc:304] T f4b8bd455d5a47c18a1380839c6e0d61 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
I20260709 13:20:27.558511 11676 raft_consensus.cc:493] T 853ac0a8cbd64ce99457f170216d4d0f P cd75a17ab2604397adab03bb8b5fd75c [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:27.569159 11657 raft_consensus.cc:2749] T f09c2a98de1a4decabd0ff900dd44caa P b7ab4784c7344b939bc36f639286f377 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:20:27.568197 11504 leader_election.cc:290] T 17587d6730594da4a56fa13a353232a1 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
W20260709 13:20:27.608914  6770 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 49157.9us
I20260709 13:20:27.621286  6802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3022224cc81473690653a83d4e99470" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:27.622900  6802 raft_consensus.cc:2468] T a3022224cc81473690653a83d4e99470 P b7ab4784c7344b939bc36f639286f377 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 14.
W20260709 13:20:27.631129  6697 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 230164us
I20260709 13:20:27.632207  6697 leader_election.cc:304] T 90d42e216d9741e190bca19a781291fd P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:20:27.642170  6772 leader_election.cc:304] T f03d0dbf16864ca4bc1bb5e4c0334c0f P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: ccd8a4c3bfe3413cb2ae219b09aea832
W20260709 13:20:27.642812  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 92894.4us
I20260709 13:20:27.609232 11066 raft_consensus.cc:493] T a3022224cc81473690653a83d4e99470 P cd75a17ab2604397adab03bb8b5fd75c [term 13 FOLLOWER]: Starting leader election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:20:27.643911  6844 leader_election.cc:304] T 44bde925b2e541b69890d70715b85176 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:20:27.617455 11676 raft_consensus.cc:3060] T 853ac0a8cbd64ce99457f170216d4d0f P cd75a17ab2604397adab03bb8b5fd75c [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:20:27.630299 11468 raft_consensus.cc:2804] T f4b8bd455d5a47c18a1380839c6e0d61 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:20:27.625483 11664 raft_consensus.cc:3055] T 07a92dd554674067a83a9cb68c4773f2 P b7ab4784c7344b939bc36f639286f377 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:20:27.553680 11669 raft_consensus.cc:515] T 3fa34c08b205435dba97346991aa1f92 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
W20260709 13:20:27.641911 11665 log.cc:927] Time spent T 427c124d773f483294511e80fe340075 P 7ba59cc884714e8aa5f3f0ecaed84cbb: Append to log took a long time: real 0.171s	user 0.000s	sys 0.001s
I20260709 13:20:27.649057  6873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f00a2e87e56452083b759f60d461ee3" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:27.661657  6695 leader_election.cc:304] T 711ef6523deb4cbe8ef2ba61e1c21c98 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
I20260709 13:20:27.663007  6880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "427c124d773f483294511e80fe340075" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:20:27.667481  6880 raft_consensus.cc:3060] T 427c124d773f483294511e80fe340075 P cd75a17ab2604397adab03bb8b5fd75c [term 10 FOLLOWER]: Advancing to term 12
I20260709 13:20:27.666666  6873 raft_consensus.cc:2468] T 4f00a2e87e56452083b759f60d461ee3 P cd75a17ab2604397adab03bb8b5fd75c [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in term 13.
I20260709 13:20:27.668576  6723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22ccee1b570c4ad3a57bd7aec085b1b4" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:27.672606  6723 raft_consensus.cc:2468] T 22ccee1b570c4ad3a57bd7aec085b1b4 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 10.
I20260709 13:20:27.669030  6727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17587d6730594da4a56fa13a353232a1" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 19 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:27.669591  6729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90d42e216d9741e190bca19a781291fd" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:27.675716  6730 raft_consensus.cc:3060] T b3f13b31a1f84f0d89d007eadd57924c P ccd8a4c3bfe3413cb2ae219b09aea832 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:20:27.645000 11066 raft_consensus.cc:3060] T a3022224cc81473690653a83d4e99470 P cd75a17ab2604397adab03bb8b5fd75c [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:27.668434  6725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d9def8b32fd443aa94ab1420b06837b" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:27.678483  6878 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53406 (request call id 2294) took 1182 ms. Trace:
I20260709 13:20:27.678973  6878 rpcz_store.cc:276] 0709 13:20:26.495709 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:26.870807 (+375098us) service_pool.cc:224] Handling call
0709 13:20:26.888712 (+ 17905us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:26.926021 (+ 37309us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:27.670557 (+744536us) spinlock_profiling.cc:243] Waited 31.8 ms on lock 0x7b54002175d4. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f9aae01 00007fcc0f9a983e 00007fcc1496e419 00007fcc0dee5bd4 00007fcc0dee5b62 00007fcc0dee5a91 00007fcc0dee5a0c 00007fcc0dee4cc2 00007fcc0dce548c 00007fcc0dce48c6
0709 13:20:27.678419 (+  7862us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":73251584}
W20260709 13:20:27.681097  6697 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 49066.2us
I20260709 13:20:27.646958 11684 raft_consensus.cc:2804] T 711ef6523deb4cbe8ef2ba61e1c21c98 P b7ab4784c7344b939bc36f639286f377 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:20:27.687332  6772 leader_election.cc:304] T 3411566abe2d4c9bb4b2adfdd05e6f17 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:20:27.689258  6799 raft_consensus.cc:1275] T 17587d6730594da4a56fa13a353232a1 P b7ab4784c7344b939bc36f639286f377 [term 18 FOLLOWER]: Refusing update from remote peer ccd8a4c3bfe3413cb2ae219b09aea832: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 13:20:27.655682 11468 raft_consensus.cc:493] T f4b8bd455d5a47c18a1380839c6e0d61 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:27.685523  6695 leader_election.cc:304] T f5be3a11b23d4ea9b08300a2789821c7 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
I20260709 13:20:27.652271 11670 consensus_queue.cc:1048] T 7c37d41cd9164c15a6826ca62a851a69 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.032s
W20260709 13:20:27.697073  6845 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:27.694362  6878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24ee15416e3145beaa1b8183453729a3" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:20:27.661870 11664 raft_consensus.cc:740] T 07a92dd554674067a83a9cb68c4773f2 P b7ab4784c7344b939bc36f639286f377 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
I20260709 13:20:27.676397 11563 leader_election.cc:290] T 22ccee1b570c4ad3a57bd7aec085b1b4 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:27.655869 11504 consensus_queue.cc:1059] T 7887766dc6784fcaa42b35c05fea7a99 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: INVALID_TERM, Last received: 13.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.032s
I20260709 13:20:27.735597  6873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8cee0accdb8499c86d4414b72565a38" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:20:27.733071  6697 leader_election.cc:304] T dbdf895bba214ff68685a24fd17dfb5d P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:20:27.740763  6878 raft_consensus.cc:2410] T 24ee15416e3145beaa1b8183453729a3 P cd75a17ab2604397adab03bb8b5fd75c [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 7ba59cc884714e8aa5f3f0ecaed84cbb for term 16 because replica has last-logged OpId of term: 15 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 9.
W20260709 13:20:27.747421  6772 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 67123.1us
I20260709 13:20:27.667716 11682 raft_consensus.cc:2749] T 90d42e216d9741e190bca19a781291fd P ccd8a4c3bfe3413cb2ae219b09aea832 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:20:27.687685 11684 raft_consensus.cc:493] T 711ef6523deb4cbe8ef2ba61e1c21c98 P b7ab4784c7344b939bc36f639286f377 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:27.691290 11636 raft_consensus.cc:2804] T 711ef6523deb4cbe8ef2ba61e1c21c98 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:20:27.699061 11468 raft_consensus.cc:3060] T f4b8bd455d5a47c18a1380839c6e0d61 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:27.670861 11678 consensus_queue.cc:1059] T 7c44c4849aa54f2b94d1f1bef9ed546f P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: INVALID_TERM, Last received: 14.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.090s
I20260709 13:20:27.696339 11688 raft_consensus.cc:2804] T 44bde925b2e541b69890d70715b85176 P cd75a17ab2604397adab03bb8b5fd75c [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:20:27.782348  6729 raft_consensus.cc:2468] T 90d42e216d9741e190bca19a781291fd P ccd8a4c3bfe3413cb2ae219b09aea832 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 13.
W20260709 13:20:27.819828  6697 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 121698us
I20260709 13:20:27.764276 11563 raft_consensus.cc:3060] T dbdf895bba214ff68685a24fd17dfb5d P ccd8a4c3bfe3413cb2ae219b09aea832 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:20:27.765960 11636 raft_consensus.cc:493] T 711ef6523deb4cbe8ef2ba61e1c21c98 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:27.786813 11688 raft_consensus.cc:493] T 44bde925b2e541b69890d70715b85176 P cd75a17ab2604397adab03bb8b5fd75c [term 13 FOLLOWER]: Starting leader election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:20:27.834671  6879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce4f062dcd314d43a63ca74067cb5ee3" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:27.838048  6879 raft_consensus.cc:2468] T ce4f062dcd314d43a63ca74067cb5ee3 P cd75a17ab2604397adab03bb8b5fd75c [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in term 12.
I20260709 13:20:27.768426 11684 raft_consensus.cc:3060] T 711ef6523deb4cbe8ef2ba61e1c21c98 P b7ab4784c7344b939bc36f639286f377 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:27.785265 11657 raft_consensus.cc:3055] T 7887766dc6784fcaa42b35c05fea7a99 P b7ab4784c7344b939bc36f639286f377 [term 13 LEADER]: Stepping down as leader of term 13
W20260709 13:20:27.839745 11673 log.cc:927] Time spent T 3fa34c08b205435dba97346991aa1f92 P cd75a17ab2604397adab03bb8b5fd75c: Append to log took a long time: real 0.232s	user 0.002s	sys 0.000s
W20260709 13:20:27.851099  6695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 165669us
I20260709 13:20:27.678826 11671 consensus_queue.cc:237] T bd6869f07b5a4885a0b99fbe60c3b175 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.6, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:27.842629 11636 raft_consensus.cc:3060] T 711ef6523deb4cbe8ef2ba61e1c21c98 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:27.873908 11670 raft_consensus.cc:493] T b56bf91d90824c959e21e0cee5ba1816 P b7ab4784c7344b939bc36f639286f377 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader cd75a17ab2604397adab03bb8b5fd75c)
I20260709 13:20:27.882982  6723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f9c2e2bf644115957398fe4c9459db" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:27.883752  6879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3d8792045a4583ae2e965b1350a5b4" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:20:27.884127  6723 raft_consensus.cc:2468] T f3f9c2e2bf644115957398fe4c9459db P ccd8a4c3bfe3413cb2ae219b09aea832 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 12.
I20260709 13:20:27.884720  6879 raft_consensus.cc:3060] T bb3d8792045a4583ae2e965b1350a5b4 P cd75a17ab2604397adab03bb8b5fd75c [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:20:27.839831 11688 raft_consensus.cc:3060] T 44bde925b2e541b69890d70715b85176 P cd75a17ab2604397adab03bb8b5fd75c [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:20:27.854899 11478 consensus_meta.cc:287] T ce4f062dcd314d43a63ca74067cb5ee3 P 7ba59cc884714e8aa5f3f0ecaed84cbb: Time spent flushing consensus metadata: real 0.505s	user 0.013s	sys 0.000s
I20260709 13:20:27.849440 11657 raft_consensus.cc:740] T 7887766dc6784fcaa42b35c05fea7a99 P b7ab4784c7344b939bc36f639286f377 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
I20260709 13:20:27.895824  7468 leader_election.cc:304] T 4f00a2e87e56452083b759f60d461ee3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377
I20260709 13:20:27.898888  6723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c240553ce044eedb41541d72b9475d7" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:27.918725  7498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "427c124d773f483294511e80fe340075" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:20:27.919907  7495 raft_consensus.cc:1275] T 7ba5dac66ab5497e9e336f2a3c28cda5 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 13 FOLLOWER]: Refusing update from remote peer cd75a17ab2604397adab03bb8b5fd75c: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:20:27.921885  7503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f00a2e87e56452083b759f60d461ee3" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:20:27.923363  7496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb7fa124c3bf4ef9ab65a407cb008441" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:20:27.788448 11664 consensus_queue.cc:260] T 07a92dd554674067a83a9cb68c4773f2 P b7ab4784c7344b939bc36f639286f377 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:27.850579 11674 consensus_queue.cc:1048] T de3186201e1a40d0b335eeb8b4e256e0 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.055s
I20260709 13:20:27.911357 11667 raft_consensus.cc:2804] T 4f00a2e87e56452083b759f60d461ee3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:20:27.982010  6723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77e330a82df4b43a745d57a68f6f057" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:20:27.877539 11678 consensus_queue.cc:1048] T 95a75bfe094d4bdc963aba3f08dfcd25 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.075s
I20260709 13:20:27.980701  6879 raft_consensus.cc:2468] T bb3d8792045a4583ae2e965b1350a5b4 P cd75a17ab2604397adab03bb8b5fd75c [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in term 12.
I20260709 13:20:27.909705 11668 raft_consensus.cc:493] T b3f13b31a1f84f0d89d007eadd57924c P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:20:27.977131  6771 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:28.001456  6697 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 135038us
I20260709 13:20:27.954252 11683 raft_consensus.cc:2804] T f5be3a11b23d4ea9b08300a2789821c7 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:20:27.962497 11685 raft_consensus.cc:2804] T 3411566abe2d4c9bb4b2adfdd05e6f17 P b7ab4784c7344b939bc36f639286f377 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:20:27.887069 11670 raft_consensus.cc:515] T b56bf91d90824c959e21e0cee5ba1816 P b7ab4784c7344b939bc36f639286f377 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:27.981918 11667 raft_consensus.cc:493] T 4f00a2e87e56452083b759f60d461ee3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:27.906656 11478 raft_consensus.cc:515] T ce4f062dcd314d43a63ca74067cb5ee3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 14 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } attrs { replace: true } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:20:27.999514 11591 raft_consensus.cc:493] T d33d5ee8ef6f415593d8df52063161ad P cd75a17ab2604397adab03bb8b5fd75c [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:20:28.041613  6801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22ccee1b570c4ad3a57bd7aec085b1b4" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:28.042695  6723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f58dc08b12a2494bb9a1372837970ca2" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:28.045050  6801 raft_consensus.cc:2468] T 22ccee1b570c4ad3a57bd7aec085b1b4 P b7ab4784c7344b939bc36f639286f377 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 11.
W20260709 13:20:28.040088 11659 consensus_meta.cc:287] T bd6869f07b5a4885a0b99fbe60c3b175 P ccd8a4c3bfe3413cb2ae219b09aea832: Time spent flushing consensus metadata: real 0.534s	user 0.011s	sys 0.000s
I20260709 13:20:28.034029 11685 raft_consensus.cc:493] T 3411566abe2d4c9bb4b2adfdd05e6f17 P b7ab4784c7344b939bc36f639286f377 [term 11 FOLLOWER]: Starting leader election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:20:28.057688  6697 leader_election.cc:304] T be1a92657f494cac8dd227d152f50151 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: b7ab4784c7344b939bc36f639286f377
I20260709 13:20:28.062409 11659 raft_consensus.cc:515] T bd6869f07b5a4885a0b99fbe60c3b175 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
W20260709 13:20:28.063324 11694 log.cc:927] Time spent T 24ee15416e3145beaa1b8183453729a3 P 7ba59cc884714e8aa5f3f0ecaed84cbb: Append to log took a long time: real 0.078s	user 0.001s	sys 0.000s
I20260709 13:20:28.064425 11700 raft_consensus.cc:493] T 22ccee1b570c4ad3a57bd7aec085b1b4 P cd75a17ab2604397adab03bb8b5fd75c [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:20:28.064855 11691 log.cc:927] Time spent T 3411566abe2d4c9bb4b2adfdd05e6f17 P b7ab4784c7344b939bc36f639286f377: Append to log took a long time: real 0.202s	user 0.000s	sys 0.001s
I20260709 13:20:28.065912 11696 raft_consensus.cc:493] T b56bf91d90824c959e21e0cee5ba1816 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader cd75a17ab2604397adab03bb8b5fd75c)
I20260709 13:20:28.040292 11667 raft_consensus.cc:3060] T 4f00a2e87e56452083b759f60d461ee3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:28.038708 11576 raft_consensus.cc:493] T 07a92dd554674067a83a9cb68c4773f2 P cd75a17ab2604397adab03bb8b5fd75c [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:20:28.071174  6723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b3759de40694069b13c0f8bd40e5709" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:28.072346  6880 raft_consensus.cc:2468] T 427c124d773f483294511e80fe340075 P cd75a17ab2604397adab03bb8b5fd75c [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in term 12.
I20260709 13:20:28.041239 11669 leader_election.cc:290] T 3fa34c08b205435dba97346991aa1f92 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
W20260709 13:20:28.113443  6804 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.545s	user 0.026s	sys 0.041s
I20260709 13:20:27.999570 11657 consensus_queue.cc:260] T 7887766dc6784fcaa42b35c05fea7a99 P b7ab4784c7344b939bc36f639286f377 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
W20260709 13:20:28.114871 11661 consensus_meta.cc:287] T f4b8bd455d5a47c18a1380839c6e0d61 P cd75a17ab2604397adab03bb8b5fd75c: Time spent flushing consensus metadata: real 0.748s	user 0.015s	sys 0.000s
I20260709 13:20:28.070664 11685 raft_consensus.cc:3060] T 3411566abe2d4c9bb4b2adfdd05e6f17 P b7ab4784c7344b939bc36f639286f377 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:20:28.142247  7496 raft_consensus.cc:1275] T fe20b4b48823486ca3b9c648db6ce8aa P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 11 FOLLOWER]: Refusing update from remote peer cd75a17ab2604397adab03bb8b5fd75c: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:20:28.053042 11591 raft_consensus.cc:515] T d33d5ee8ef6f415593d8df52063161ad P cd75a17ab2604397adab03bb8b5fd75c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:28.130523 11700 raft_consensus.cc:515] T 22ccee1b570c4ad3a57bd7aec085b1b4 P cd75a17ab2604397adab03bb8b5fd75c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:28.151697 11681 raft_consensus.cc:493] T 3fa34c08b205435dba97346991aa1f92 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:28.152299 11681 raft_consensus.cc:515] T 3fa34c08b205435dba97346991aa1f92 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:20:28.154132 11700 leader_election.cc:290] T 22ccee1b570c4ad3a57bd7aec085b1b4 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:20:28.154398 11681 leader_election.cc:290] T 3fa34c08b205435dba97346991aa1f92 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:28.156273 11704 raft_consensus.cc:493] T 90d42e216d9741e190bca19a781291fd P cd75a17ab2604397adab03bb8b5fd75c [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:20:28.156947 11704 raft_consensus.cc:515] T 90d42e216d9741e190bca19a781291fd P cd75a17ab2604397adab03bb8b5fd75c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:28.159440 11704 leader_election.cc:290] T 90d42e216d9741e190bca19a781291fd P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:20:28.161640 11478 leader_election.cc:290] T ce4f062dcd314d43a63ca74067cb5ee3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 14 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:28.165076 11670 leader_election.cc:290] T b56bf91d90824c959e21e0cee5ba1816 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:28.166373 11698 raft_consensus.cc:493] T 7a734b5ab7834e05a8c422208acc58b1 P cd75a17ab2604397adab03bb8b5fd75c [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:20:28.166718  7495 raft_consensus.cc:1275] T 3fa34c08b205435dba97346991aa1f92 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 15 FOLLOWER]: Refusing update from remote peer cd75a17ab2604397adab03bb8b5fd75c: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 13:20:28.167122 11698 raft_consensus.cc:515] T 7a734b5ab7834e05a8c422208acc58b1 P cd75a17ab2604397adab03bb8b5fd75c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:28.168499 11692 raft_consensus.cc:2804] T f03d0dbf16864ca4bc1bb5e4c0334c0f P b7ab4784c7344b939bc36f639286f377 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:20:28.169044 11713 raft_consensus.cc:493] T 8c7f33e544204fbaac4078e3e83bbf4e P cd75a17ab2604397adab03bb8b5fd75c [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:20:28.169613 11713 raft_consensus.cc:515] T 8c7f33e544204fbaac4078e3e83bbf4e P cd75a17ab2604397adab03bb8b5fd75c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:28.170428 11657 raft_consensus.cc:3060] T 7887766dc6784fcaa42b35c05fea7a99 P b7ab4784c7344b939bc36f639286f377 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:28.173398 11711 consensus_queue.cc:1048] T 7ba5dac66ab5497e9e336f2a3c28cda5 P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:20:28.175043 11711 raft_consensus.cc:493] T bd6869f07b5a4885a0b99fbe60c3b175 P cd75a17ab2604397adab03bb8b5fd75c [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:20:28.150125  6697 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.68:45071, user_credentials={real_user=slave}} blocked reactor thread for 109386us
I20260709 13:20:28.175509 11711 raft_consensus.cc:515] T bd6869f07b5a4885a0b99fbe60c3b175 P cd75a17ab2604397adab03bb8b5fd75c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:28.029395 11668 raft_consensus.cc:515] T b3f13b31a1f84f0d89d007eadd57924c P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
W20260709 13:20:28.196696  6845 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:28.150892 11524 consensus_meta.cc:287] T dbdf895bba214ff68685a24fd17dfb5d P cd75a17ab2604397adab03bb8b5fd75c: Time spent flushing consensus metadata: real 0.764s	user 0.012s	sys 0.002s
I20260709 13:20:28.171799 11713 leader_election.cc:290] T 8c7f33e544204fbaac4078e3e83bbf4e P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
W20260709 13:20:28.155850 11439 consensus_meta.cc:287] T de3186201e1a40d0b335eeb8b4e256e0 P cd75a17ab2604397adab03bb8b5fd75c: Time spent flushing consensus metadata: real 0.670s	user 0.010s	sys 0.001s
W20260709 13:20:28.191331  6772 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 442296us
I20260709 13:20:28.192847  6723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "427c124d773f483294511e80fe340075" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:28.224673  6723 raft_consensus.cc:2368] T 427c124d773f483294511e80fe340075 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c for earlier term 11. Current term is 12.
W20260709 13:20:28.134193  6804 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.566s	user 0.026s	sys 0.041s
I20260709 13:20:28.200848  6803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6869f07b5a4885a0b99fbe60c3b175" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
W20260709 13:20:28.222038  6730 consensus_meta.cc:287] T b3f13b31a1f84f0d89d007eadd57924c P ccd8a4c3bfe3413cb2ae219b09aea832: Time spent flushing consensus metadata: real 0.544s	user 0.012s	sys 0.000s
I20260709 13:20:28.227022  6730 raft_consensus.cc:1275] T b3f13b31a1f84f0d89d007eadd57924c P ccd8a4c3bfe3413cb2ae219b09aea832 [term 12 FOLLOWER]: Refusing update from remote peer b7ab4784c7344b939bc36f639286f377: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:20:28.228128 11700 consensus_queue.cc:1048] T fe20b4b48823486ca3b9c648db6ce8aa P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:20:28.225875 11704 consensus_queue.cc:1048] T 3fa34c08b205435dba97346991aa1f92 P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.003s
I20260709 13:20:28.246505 11709 raft_consensus.cc:493] T 95a75bfe094d4bdc963aba3f08dfcd25 P cd75a17ab2604397adab03bb8b5fd75c [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:28.227810 11439 raft_consensus.cc:515] T de3186201e1a40d0b335eeb8b4e256e0 P cd75a17ab2604397adab03bb8b5fd75c [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:28.247188 11709 raft_consensus.cc:515] T 95a75bfe094d4bdc963aba3f08dfcd25 P cd75a17ab2604397adab03bb8b5fd75c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:28.247609 11668 leader_election.cc:290] T b3f13b31a1f84f0d89d007eadd57924c P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:20:28.248461  6697 leader_election.cc:304] T 427c124d773f483294511e80fe340075 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377
I20260709 13:20:28.249167 11439 leader_election.cc:290] T de3186201e1a40d0b335eeb8b4e256e0 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 15 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:20:28.237320  6772 leader_election.cc:304] T 34f36d59d88f40fe8a2805e604fc6c0a P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:20:28.250830  6772 leader_election.cc:304] T 30e88460611e47b2ba16a46a30b5f416 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:20:28.165278 11659 leader_election.cc:290] T bd6869f07b5a4885a0b99fbe60c3b175 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 14 election: Requested vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:28.196947 11669 raft_consensus.cc:2764] T be1a92657f494cac8dd227d152f50151 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 15 FOLLOWER]: Leader pre-election decision vote started in defunct term 13: won
I20260709 13:20:28.249539 11709 leader_election.cc:290] T 95a75bfe094d4bdc963aba3f08dfcd25 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:20:28.265426  6772 leader_election.cc:304] T 7c44c4849aa54f2b94d1f1bef9ed546f P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:20:28.208418 11698 leader_election.cc:290] T 7a734b5ab7834e05a8c422208acc58b1 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:20:28.143959 11661 raft_consensus.cc:515] T f4b8bd455d5a47c18a1380839c6e0d61 P cd75a17ab2604397adab03bb8b5fd75c [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:28.260777 11706 raft_consensus.cc:493] T 7887766dc6784fcaa42b35c05fea7a99 P cd75a17ab2604397adab03bb8b5fd75c [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:20:28.266930 11660 raft_consensus.cc:3055] T 30e88460611e47b2ba16a46a30b5f416 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:20:28.267282 11725 raft_consensus.cc:2804] T 34f36d59d88f40fe8a2805e604fc6c0a P b7ab4784c7344b939bc36f639286f377 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:20:28.231786 11066 raft_consensus.cc:515] T a3022224cc81473690653a83d4e99470 P cd75a17ab2604397adab03bb8b5fd75c [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:28.272572 11591 leader_election.cc:290] T d33d5ee8ef6f415593d8df52063161ad P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:20:28.215533 11524 raft_consensus.cc:515] T dbdf895bba214ff68685a24fd17dfb5d P cd75a17ab2604397adab03bb8b5fd75c [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:28.274327 11504 raft_consensus.cc:2749] T 30e88460611e47b2ba16a46a30b5f416 P b7ab4784c7344b939bc36f639286f377 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:20:28.139569 11576 raft_consensus.cc:515] T 07a92dd554674067a83a9cb68c4773f2 P cd75a17ab2604397adab03bb8b5fd75c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:28.134635 11696 raft_consensus.cc:515] T b56bf91d90824c959e21e0cee5ba1816 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
W20260709 13:20:28.286514  6773 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:28.287279  6772 leader_election.cc:304] T 4275cf08e63345f993bce8664eada830 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:20:28.250823 11707 raft_consensus.cc:493] T b3f13b31a1f84f0d89d007eadd57924c P ccd8a4c3bfe3413cb2ae219b09aea832 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:28.276346 11678 raft_consensus.cc:493] T 7c37d41cd9164c15a6826ca62a851a69 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:28.285261 11660 raft_consensus.cc:740] T 30e88460611e47b2ba16a46a30b5f416 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
W20260709 13:20:28.294170 11503 consensus_meta.cc:287] T d8cee0accdb8499c86d4414b72565a38 P cd75a17ab2604397adab03bb8b5fd75c: Time spent flushing consensus metadata: real 0.758s	user 0.009s	sys 0.004s
I20260709 13:20:28.302481  6799 raft_consensus.cc:1240] T 30e88460611e47b2ba16a46a30b5f416 P b7ab4784c7344b939bc36f639286f377 [term 12 FOLLOWER]: Rejecting Update request from peer ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 11. Current term is 12. Ops: [11.6-11.6]
I20260709 13:20:28.286159 11725 raft_consensus.cc:493] T 34f36d59d88f40fe8a2805e604fc6c0a P b7ab4784c7344b939bc36f639286f377 [term 10 FOLLOWER]: Starting leader election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:20:28.306126  6772 leader_election.cc:304] T a1704639a875409b9959353527b3fd68 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:20:28.307070  6772 leader_election.cc:304] T 2c240553ce044eedb41541d72b9475d7 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:20:28.294991 11671 raft_consensus.cc:2804] T 7c44c4849aa54f2b94d1f1bef9ed546f P b7ab4784c7344b939bc36f639286f377 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:20:28.317205  6844 leader_election.cc:304] T f03d0dbf16864ca4bc1bb5e4c0334c0f P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:20:28.320009 11714 raft_consensus.cc:493] T 24ee15416e3145beaa1b8183453729a3 P cd75a17ab2604397adab03bb8b5fd75c [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:28.317788 11684 raft_consensus.cc:515] T 711ef6523deb4cbe8ef2ba61e1c21c98 P b7ab4784c7344b939bc36f639286f377 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:28.320645 11714 raft_consensus.cc:515] T 24ee15416e3145beaa1b8183453729a3 P cd75a17ab2604397adab03bb8b5fd75c [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
W20260709 13:20:28.321559 11715 log.cc:927] Time spent T c4db81d9d329422bb3b4160ca4ac2d1d P b7ab4784c7344b939bc36f639286f377: Append to log took a long time: real 0.125s	user 0.000s	sys 0.001s
W20260709 13:20:28.322295  6697 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.68:45071, user_credentials={real_user=slave}} blocked reactor thread for 115489us
I20260709 13:20:28.322836 11684 leader_election.cc:290] T 711ef6523deb4cbe8ef2ba61e1c21c98 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 15 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:28.323532 11714 leader_election.cc:290] T 24ee15416e3145beaa1b8183453729a3 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:20:28.320243 11710 raft_consensus.cc:2764] T 427c124d773f483294511e80fe340075 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 12 FOLLOWER]: Leader pre-election decision vote started in defunct term 10: won
W20260709 13:20:28.304518 11561 consensus_meta.cc:287] T f09c2a98de1a4decabd0ff900dd44caa P cd75a17ab2604397adab03bb8b5fd75c: Time spent flushing consensus metadata: real 0.795s	user 0.005s	sys 0.008s
I20260709 13:20:28.326192  6772 leader_election.cc:304] T 9e326172347f45e99a0d482b5d8ef768 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:20:28.296727 11683 raft_consensus.cc:697] T f5be3a11b23d4ea9b08300a2789821c7 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 12 LEADER]: Becoming Leader. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
I20260709 13:20:28.336658  7502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24ee15416e3145beaa1b8183453729a3" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:20:28.316840 11354 raft_consensus.cc:2804] T 4275cf08e63345f993bce8664eada830 P b7ab4784c7344b939bc36f639286f377 [term 13 FOLLOWER]: Leader election won for term 13
W20260709 13:20:27.698072  7466 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 195029us
I20260709 13:20:28.317772 11547 raft_consensus.cc:2804] T 2c240553ce044eedb41541d72b9475d7 P b7ab4784c7344b939bc36f639286f377 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:20:28.325309 11503 raft_consensus.cc:2749] T d8cee0accdb8499c86d4414b72565a38 P cd75a17ab2604397adab03bb8b5fd75c [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:20:28.309054 11725 raft_consensus.cc:3060] T 34f36d59d88f40fe8a2805e604fc6c0a P b7ab4784c7344b939bc36f639286f377 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:20:28.356305  6880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4db81d9d329422bb3b4160ca4ac2d1d" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:28.357270  6772 leader_election.cc:304] T 713b5728a197487c9300b310ab94e5a3 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:20:28.334946 11671 raft_consensus.cc:697] T 7c44c4849aa54f2b94d1f1bef9ed546f P b7ab4784c7344b939bc36f639286f377 [term 15 LEADER]: Becoming Leader. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
I20260709 13:20:28.324201 11667 raft_consensus.cc:515] T 4f00a2e87e56452083b759f60d461ee3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 14 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:20:28.291934 11706 raft_consensus.cc:515] T 7887766dc6784fcaa42b35c05fea7a99 P cd75a17ab2604397adab03bb8b5fd75c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:28.320020 11591 consensus_queue.cc:1048] T 711ef6523deb4cbe8ef2ba61e1c21c98 P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Connected to new peer: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.028s
I20260709 13:20:28.360100  6772 leader_election.cc:304] T 44bde925b2e541b69890d70715b85176 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:20:28.362711 11670 raft_consensus.cc:2804] T 713b5728a197487c9300b310ab94e5a3 P b7ab4784c7344b939bc36f639286f377 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:20:28.385831 11670 raft_consensus.cc:493] T 713b5728a197487c9300b310ab94e5a3 P b7ab4784c7344b939bc36f639286f377 [term 12 FOLLOWER]: Starting leader election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:20:28.386267 11670 raft_consensus.cc:3060] T 713b5728a197487c9300b310ab94e5a3 P b7ab4784c7344b939bc36f639286f377 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:28.386503  6727 raft_consensus.cc:1275] T 427c124d773f483294511e80fe340075 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 12 FOLLOWER]: Refusing update from remote peer 7ba59cc884714e8aa5f3f0ecaed84cbb: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:20:28.387593  6802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b56bf91d90824c959e21e0cee5ba1816" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
W20260709 13:20:28.373449 11653 log.cc:927] Time spent T be1a92657f494cac8dd227d152f50151 P ccd8a4c3bfe3413cb2ae219b09aea832: Append to log took a long time: real 1.025s	user 0.000s	sys 0.007s
I20260709 13:20:28.362560  6728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17587d6730594da4a56fa13a353232a1" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 19 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:28.363387  6731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3f13b31a1f84f0d89d007eadd57924c" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:28.364383  6732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce4f062dcd314d43a63ca74067cb5ee3" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:20:28.366451 11696 leader_election.cc:290] T b56bf91d90824c959e21e0cee5ba1816 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:28.344408 11563 raft_consensus.cc:2749] T dbdf895bba214ff68685a24fd17dfb5d P ccd8a4c3bfe3413cb2ae219b09aea832 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:20:28.362605 11661 leader_election.cc:290] T f4b8bd455d5a47c18a1380839c6e0d61 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 13 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:20:28.368661  6723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fa34c08b205435dba97346991aa1f92" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:28.353835 11547 raft_consensus.cc:493] T 2c240553ce044eedb41541d72b9475d7 P b7ab4784c7344b939bc36f639286f377 [term 14 FOLLOWER]: Starting leader election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:20:28.369524  6800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17587d6730594da4a56fa13a353232a1" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 19 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:28.370581 11711 leader_election.cc:290] T bd6869f07b5a4885a0b99fbe60c3b175 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:20:28.371775  6695 leader_election.cc:304] T a3022224cc81473690653a83d4e99470 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
I20260709 13:20:28.372011 11576 leader_election.cc:290] T 07a92dd554674067a83a9cb68c4773f2 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:20:28.302348 11678 raft_consensus.cc:515] T 7c37d41cd9164c15a6826ca62a851a69 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:28.338006 11561 raft_consensus.cc:515] T f09c2a98de1a4decabd0ff900dd44caa P cd75a17ab2604397adab03bb8b5fd75c [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:28.356376 11354 raft_consensus.cc:697] T 4275cf08e63345f993bce8664eada830 P b7ab4784c7344b939bc36f639286f377 [term 13 LEADER]: Becoming Leader. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
I20260709 13:20:28.344622 11714 raft_consensus.cc:2749] T f03d0dbf16864ca4bc1bb5e4c0334c0f P cd75a17ab2604397adab03bb8b5fd75c [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:20:28.348073 11687 raft_consensus.cc:2804] T 9e326172347f45e99a0d482b5d8ef768 P b7ab4784c7344b939bc36f639286f377 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:20:28.376556 11066 leader_election.cc:290] T a3022224cc81473690653a83d4e99470 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 14 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:20:28.382273 11667 leader_election.cc:290] T 4f00a2e87e56452083b759f60d461ee3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 14 election: Requested vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
W20260709 13:20:28.387972 11676 consensus_meta.cc:287] T 853ac0a8cbd64ce99457f170216d4d0f P cd75a17ab2604397adab03bb8b5fd75c: Time spent flushing consensus metadata: real 0.713s	user 0.011s	sys 0.000s
I20260709 13:20:28.348251 11636 raft_consensus.cc:515] T 711ef6523deb4cbe8ef2ba61e1c21c98 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
W20260709 13:20:28.382613  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 43578.7us
I20260709 13:20:28.403396  6844 leader_election.cc:304] T 4b8cacb381b746da8d0049b0a83b41dd P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:20:28.404500 11636 leader_election.cc:290] T 711ef6523deb4cbe8ef2ba61e1c21c98 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 15 election: Requested vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:28.405350 11714 raft_consensus.cc:2749] T 4b8cacb381b746da8d0049b0a83b41dd P cd75a17ab2604397adab03bb8b5fd75c [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:20:28.410159 11688 raft_consensus.cc:515] T 44bde925b2e541b69890d70715b85176 P cd75a17ab2604397adab03bb8b5fd75c [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:28.411425 11588 raft_consensus.cc:3055] T 8c7f33e544204fbaac4078e3e83bbf4e P b7ab4784c7344b939bc36f639286f377 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:20:28.411964 11588 raft_consensus.cc:740] T 8c7f33e544204fbaac4078e3e83bbf4e P b7ab4784c7344b939bc36f639286f377 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
I20260709 13:20:28.402068 11676 raft_consensus.cc:515] T 853ac0a8cbd64ce99457f170216d4d0f P cd75a17ab2604397adab03bb8b5fd75c [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:28.410038  6803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce4f062dcd314d43a63ca74067cb5ee3" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:20:28.413115  6803 raft_consensus.cc:3060] T ce4f062dcd314d43a63ca74067cb5ee3 P b7ab4784c7344b939bc36f639286f377 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:28.412914 11588 consensus_queue.cc:260] T 8c7f33e544204fbaac4078e3e83bbf4e P b7ab4784c7344b939bc36f639286f377 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:28.377092 11660 consensus_queue.cc:260] T 30e88460611e47b2ba16a46a30b5f416 P ccd8a4c3bfe3413cb2ae219b09aea832 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:28.416649 11650 raft_consensus.cc:493] T d8292e16e5654be6bc408560cf256aaa P cd75a17ab2604397adab03bb8b5fd75c [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:28.388270  6802 raft_consensus.cc:2468] T b56bf91d90824c959e21e0cee5ba1816 P b7ab4784c7344b939bc36f639286f377 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 12.
I20260709 13:20:28.417419 11650 raft_consensus.cc:515] T d8292e16e5654be6bc408560cf256aaa P cd75a17ab2604397adab03bb8b5fd75c [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:28.389276 11524 leader_election.cc:290] T dbdf895bba214ff68685a24fd17dfb5d P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 12 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:20:28.418713 11664 raft_consensus.cc:3060] T 07a92dd554674067a83a9cb68c4773f2 P b7ab4784c7344b939bc36f639286f377 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:28.415836 11670 raft_consensus.cc:515] T 713b5728a197487c9300b310ab94e5a3 P b7ab4784c7344b939bc36f639286f377 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:28.422119  6802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3f13b31a1f84f0d89d007eadd57924c" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:28.423588  6802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f00a2e87e56452083b759f60d461ee3" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:20:28.413239  6876 raft_consensus.cc:1240] T 853ac0a8cbd64ce99457f170216d4d0f P cd75a17ab2604397adab03bb8b5fd75c [term 11 FOLLOWER]: Rejecting Update request from peer ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 10. Current term is 11. Ops: []
I20260709 13:20:28.390574  6732 raft_consensus.cc:3060] T ce4f062dcd314d43a63ca74067cb5ee3 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:28.427462  6805 raft_consensus.cc:1275] T 427c124d773f483294511e80fe340075 P b7ab4784c7344b939bc36f639286f377 [term 12 FOLLOWER]: Refusing update from remote peer 7ba59cc884714e8aa5f3f0ecaed84cbb: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:20:28.324220 11669 consensus_queue.cc:1048] T bb3d8792045a4583ae2e965b1350a5b4 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.027s
W20260709 13:20:28.428684 11645 log.cc:927] Time spent T f5be3a11b23d4ea9b08300a2789821c7 P cd75a17ab2604397adab03bb8b5fd75c: Append to log took a long time: real 1.107s	user 0.001s	sys 0.008s
I20260709 13:20:28.430567  6879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b3759de40694069b13c0f8bd40e5709" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:28.430816  6872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bf4668eeb70467fb3dc5a0289233b3c" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:28.391474 11547 raft_consensus.cc:3060] T 2c240553ce044eedb41541d72b9475d7 P b7ab4784c7344b939bc36f639286f377 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:28.431838  6879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c7f33e544204fbaac4078e3e83bbf4e" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:20:28.432422  6879 raft_consensus.cc:3060] T 8c7f33e544204fbaac4078e3e83bbf4e P cd75a17ab2604397adab03bb8b5fd75c [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:20:28.391499  6723 raft_consensus.cc:2468] T 3fa34c08b205435dba97346991aa1f92 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in term 15.
I20260709 13:20:28.392086  6800 raft_consensus.cc:2410] T 17587d6730594da4a56fa13a353232a1 P b7ab4784c7344b939bc36f639286f377 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ba59cc884714e8aa5f3f0ecaed84cbb for term 19 because replica has last-logged OpId of term: 16 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 10.
I20260709 13:20:28.393886 11696 raft_consensus.cc:2804] T a3022224cc81473690653a83d4e99470 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:20:28.435549 11696 raft_consensus.cc:493] T a3022224cc81473690653a83d4e99470 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:28.435895 11696 raft_consensus.cc:3060] T a3022224cc81473690653a83d4e99470 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:28.389317 11663 raft_consensus.cc:2804] T 44bde925b2e541b69890d70715b85176 P b7ab4784c7344b939bc36f639286f377 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:20:28.438843  6872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "711ef6523deb4cbe8ef2ba61e1c21c98" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:28.404734  6844 leader_election.cc:304] T a1704639a875409b9959353527b3fd68 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:20:28.395589  6695 leader_election.cc:304] T 22ccee1b570c4ad3a57bd7aec085b1b4 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
I20260709 13:20:28.461207  7466 leader_election.cc:304] T 3fa34c08b205435dba97346991aa1f92 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
W20260709 13:20:28.461750  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 57108.5us
W20260709 13:20:28.461167  6695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 65660us
I20260709 13:20:28.303246 11707 raft_consensus.cc:515] T b3f13b31a1f84f0d89d007eadd57924c P ccd8a4c3bfe3413cb2ae219b09aea832 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:20:28.382593  7503 raft_consensus.cc:2393] T 4f00a2e87e56452083b759f60d461ee3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c in current term 14: Already voted for candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in this term.
I20260709 13:20:28.382333 11706 leader_election.cc:290] T 7887766dc6784fcaa42b35c05fea7a99 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:20:28.390077  6726 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49744 (request call id 493) took 1542 ms. Trace:
I20260709 13:20:28.394563 11678 leader_election.cc:290] T 7c37d41cd9164c15a6826ca62a851a69 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:28.397193 11728 consensus_queue.cc:1048] T 17587d6730594da4a56fa13a353232a1 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.051s
I20260709 13:20:28.397187 11478 consensus_queue.cc:1048] T 427c124d773f483294511e80fe340075 P 7ba59cc884714e8aa5f3f0ecaed84cbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.052s
W20260709 13:20:28.399497 11468 consensus_meta.cc:287] T f4b8bd455d5a47c18a1380839c6e0d61 P ccd8a4c3bfe3413cb2ae219b09aea832: Time spent flushing consensus metadata: real 0.577s	user 0.010s	sys 0.000s
I20260709 13:20:28.451077  6875 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53406 (request call id 2289) took 1956 ms. Trace:
I20260709 13:20:28.451062 11650 leader_election.cc:290] T d8292e16e5654be6bc408560cf256aaa P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:20:28.398182 11354 consensus_queue.cc:237] T 4275cf08e63345f993bce8664eada830 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.6, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
W20260709 13:20:28.467824  6770 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:28.468555  6872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a485a995abc4807b6e511e45419f737" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:28.469527  6879 raft_consensus.cc:2468] T 8c7f33e544204fbaac4078e3e83bbf4e P cd75a17ab2604397adab03bb8b5fd75c [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 11.
W20260709 13:20:28.470126  6772 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 85023.1us
I20260709 13:20:28.501425  6872 raft_consensus.cc:2468] T 3a485a995abc4807b6e511e45419f737 P cd75a17ab2604397adab03bb8b5fd75c [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 12.
I20260709 13:20:28.445075  6732 raft_consensus.cc:2468] T ce4f062dcd314d43a63ca74067cb5ee3 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in term 14.
I20260709 13:20:28.474519  6844 leader_election.cc:304] T ce4f062dcd314d43a63ca74067cb5ee3 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:20:28.437366 11386 raft_consensus.cc:493] T 4d9def8b32fd443aa94ab1420b06837b P ccd8a4c3bfe3413cb2ae219b09aea832 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader cd75a17ab2604397adab03bb8b5fd75c)
I20260709 13:20:28.463503 11659 raft_consensus.cc:493] T 404190ce4ce94cecbfcb6ea9d1dd8626 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 7ba59cc884714e8aa5f3f0ecaed84cbb)
I20260709 13:20:28.475189 11524 raft_consensus.cc:2749] T a1704639a875409b9959353527b3fd68 P cd75a17ab2604397adab03bb8b5fd75c [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:20:28.456452 11612 raft_consensus.cc:493] T ab432e62819d499eaaf3dd55481dd930 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:28.495569  7502 raft_consensus.cc:1275] T 17587d6730594da4a56fa13a353232a1 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 18 FOLLOWER]: Refusing update from remote peer ccd8a4c3bfe3413cb2ae219b09aea832: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 13:20:28.457098 11663 raft_consensus.cc:493] T 44bde925b2e541b69890d70715b85176 P b7ab4784c7344b939bc36f639286f377 [term 13 FOLLOWER]: Starting leader election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:20:28.530323 11663 raft_consensus.cc:3060] T 44bde925b2e541b69890d70715b85176 P b7ab4784c7344b939bc36f639286f377 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:28.532181 11172 raft_consensus.cc:493] T 427c124d773f483294511e80fe340075 P b7ab4784c7344b939bc36f639286f377 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:28.532829  6728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "711ef6523deb4cbe8ef2ba61e1c21c98" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:20:28.532882 11172 raft_consensus.cc:515] T 427c124d773f483294511e80fe340075 P b7ab4784c7344b939bc36f639286f377 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } attrs { replace: true } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:20:28.474248  6726 rpcz_store.cc:276] 0709 13:20:26.847249 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:26.867438 (+ 20189us) service_pool.cc:224] Handling call
0709 13:20:26.878680 (+ 11242us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:26.914589 (+ 35909us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:26.914628 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:20:26.915237 (+   609us) log.cc:844] Serialized 26 byte log entry
0709 13:20:27.208486 (+293249us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:20:27.208551 (+    65us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:27.208662 (+   111us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:28.029444 (+820782us) spinlock_profiling.cc:243] Waited 2.07 ms on lock 0x7b48003300d8. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc148d3aa1 00007fcc148cab37 00007fcc148ca9ca 00007fcc149c226f 00007fcc149c1f37 00007fcc149d655c 00007fcc149d6508 00007fcc149d6488 00007fcc149d6443 00007fcc149d56ec 00007fcc138ffa96
0709 13:20:28.372760 (+343316us) spinlock_profiling.cc:243] Waited 2.73 ms on lock 0x7b4400022b4c. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0c745db1 00007fcc0c7e3c85 00007fcc0c7e46a2 00007fcc0f5561db 00007fcc0f551aaf 00007fcc0f54586e 00007fcc0f544bb6 00007fcc0f5447d8 00007fcc0f54e221 00007fcc0f54e1d9 00007fcc0f54e169
0709 13:20:28.389868 (+ 17108us) raft_consensus.cc:1685] finished
0709 13:20:28.389887 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:28.390001 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":12866,"raft.queue_time_us":25473,"raft.run_cpu_time_us":4120,"raft.run_wall_time_us":1108621,"spinlock_wait_cycles":11043456,"thread_start_us":292773,"threads_started":1,"wal-append.queue_time_us":344899}
I20260709 13:20:28.534572  6695 leader_election.cc:304] T b56bf91d90824c959e21e0cee5ba1816 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
I20260709 13:20:28.535125  6804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f58dc08b12a2494bb9a1372837970ca2" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:28.536731 11666 consensus_queue.cc:1048] T 4f00a2e87e56452083b759f60d461ee3 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:20:28.538022 11634 raft_consensus.cc:2804] T b56bf91d90824c959e21e0cee5ba1816 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:20:28.538470 11634 raft_consensus.cc:493] T b56bf91d90824c959e21e0cee5ba1816 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 12 FOLLOWER]: Starting leader election (detected failure of leader cd75a17ab2604397adab03bb8b5fd75c)
I20260709 13:20:28.415828 11676 leader_election.cc:290] T 853ac0a8cbd64ce99457f170216d4d0f P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 11 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:20:28.538862 11634 raft_consensus.cc:3060] T b56bf91d90824c959e21e0cee5ba1816 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:28.496511  6875 rpcz_store.cc:276] 0709 13:20:26.494157 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:26.607492 (+113335us) service_pool.cc:224] Handling call
0709 13:20:26.655725 (+ 48233us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 13:20:26.671909 (+ 16184us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:26.671941 (+    32us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 13:20:26.672830 (+   889us) log.cc:844] Serialized 78 byte log entry
0709 13:20:27.030315 (+357485us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:20:27.103732 (+ 73417us) log.cc:844] Serialized 14 byte log entry
0709 13:20:27.111503 (+  7771us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:27.111629 (+   126us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:28.428123 (+1316494us) spinlock_profiling.cc:243] Waited 13.8 ms on lock 0x7b24002c3198. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0c745db1 00007fcc0c7439c4 00007fcc0c741acb 00007fcc0c8fcdc9 00007fcc0c8fca55 00007fcc0c8fc09d 00007fcc0f52e10e 00007fcc0f54588c 00007fcc0f544bb6 00007fcc0f5447d8 00007fcc0f54e221
0709 13:20:28.437719 (+  9596us) raft_consensus.cc:1685] finished
0709 13:20:28.450806 (+ 13087us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:28.451004 (+   198us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9354,"prepare.queue_time_us":76465,"prepare.run_cpu_time_us":70,"prepare.run_wall_time_us":1884,"raft.queue_time_us":88723,"raft.run_cpu_time_us":237,"raft.run_wall_time_us":1753,"spinlock_wait_cycles":31659392,"thread_start_us":357025,"threads_started":1,"wal-append.queue_time_us":595045}
I20260709 13:20:28.501269  7496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3d8792045a4583ae2e965b1350a5b4" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb"
I20260709 13:20:28.459801  6873 raft_consensus.cc:2468] T d8cee0accdb8499c86d4414b72565a38 P cd75a17ab2604397adab03bb8b5fd75c [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in term 14.
I20260709 13:20:28.396729 11561 leader_election.cc:290] T f09c2a98de1a4decabd0ff900dd44caa P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 15 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:20:28.466470 11563 raft_consensus.cc:493] T 3d65025eea89441290d85dd053810e31 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:28.509704  6879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7887766dc6784fcaa42b35c05fea7a99" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:20:28.542662  6879 raft_consensus.cc:3060] T 7887766dc6784fcaa42b35c05fea7a99 P cd75a17ab2604397adab03bb8b5fd75c [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:28.503041  6731 raft_consensus.cc:2468] T b3f13b31a1f84f0d89d007eadd57924c P ccd8a4c3bfe3413cb2ae219b09aea832 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in term 12.
I20260709 13:20:28.400406 11687 raft_consensus.cc:697] T 9e326172347f45e99a0d482b5d8ef768 P b7ab4784c7344b939bc36f639286f377 [term 12 LEADER]: Becoming Leader. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
I20260709 13:20:28.513710  6872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5be3a11b23d4ea9b08300a2789821c7" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:20:28.475414 11010 raft_consensus.cc:2804] T 22ccee1b570c4ad3a57bd7aec085b1b4 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:20:28.515000  6800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c240553ce044eedb41541d72b9475d7" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:28.519013  6727 raft_consensus.cc:1275] T 20f6842e26174571996b8dea4151d4be P ccd8a4c3bfe3413cb2ae219b09aea832 [term 15 FOLLOWER]: Refusing update from remote peer b7ab4784c7344b939bc36f639286f377: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
W20260709 13:20:28.521075  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 46663.9us
I20260709 13:20:28.521983  6724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b56bf91d90824c959e21e0cee5ba1816" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:28.551692  7502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ba5dac66ab5497e9e336f2a3c28cda5" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb"
I20260709 13:20:28.523181 11547 raft_consensus.cc:515] T 2c240553ce044eedb41541d72b9475d7 P b7ab4784c7344b939bc36f639286f377 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:28.524483  6799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f9c2e2bf644115957398fe4c9459db" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
W20260709 13:20:28.525895 11732 log.cc:927] Time spent T be1a92657f494cac8dd227d152f50151 P 7ba59cc884714e8aa5f3f0ecaed84cbb: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
I20260709 13:20:28.528210  6805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b3759de40694069b13c0f8bd40e5709" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:28.503475 11611 raft_consensus.cc:2804] T 3fa34c08b205435dba97346991aa1f92 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:20:28.498335 11468 raft_consensus.cc:515] T f4b8bd455d5a47c18a1380839c6e0d61 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:28.529533 11612 raft_consensus.cc:515] T ab432e62819d499eaaf3dd55481dd930 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:28.534022  6728 raft_consensus.cc:2393] T 711ef6523deb4cbe8ef2ba61e1c21c98 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate b7ab4784c7344b939bc36f639286f377 in current term 15: Already voted for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in this term.
W20260709 13:20:28.511072  6697 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:28.545730  6878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20f6842e26174571996b8dea4151d4be" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:28.546273  7496 raft_consensus.cc:2368] T bb3d8792045a4583ae2e965b1350a5b4 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 11. Current term is 12.
I20260709 13:20:28.523706 11650 raft_consensus.cc:3060] T ce4f062dcd314d43a63ca74067cb5ee3 P cd75a17ab2604397adab03bb8b5fd75c [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:28.552839  6844 leader_election.cc:400] T ab432e62819d499eaaf3dd55481dd930 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 14 election: Vote denied by peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391) with higher term. Message: Invalid argument: T ab432e62819d499eaaf3dd55481dd930 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c for earlier term 14. Current term is 15.
I20260709 13:20:28.554219  6804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c37d41cd9164c15a6826ca62a851a69" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:28.383455 11671 consensus_queue.cc:237] T 7c44c4849aa54f2b94d1f1bef9ed546f P b7ab4784c7344b939bc36f639286f377 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:28.559492  7466 leader_election.cc:304] T 17587d6730594da4a56fa13a353232a1 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:20:28.561781  6800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "711ef6523deb4cbe8ef2ba61e1c21c98" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:20:28.583678  6800 raft_consensus.cc:2393] T 711ef6523deb4cbe8ef2ba61e1c21c98 P b7ab4784c7344b939bc36f639286f377 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate ccd8a4c3bfe3413cb2ae219b09aea832 in current term 15: Already voted for candidate b7ab4784c7344b939bc36f639286f377 in this term.
I20260709 13:20:28.562645  6799 raft_consensus.cc:2468] T f3f9c2e2bf644115957398fe4c9459db P b7ab4784c7344b939bc36f639286f377 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 12.
I20260709 13:20:28.570099  6872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a92dd554674067a83a9cb68c4773f2" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:20:28.578575  6878 raft_consensus.cc:2393] T 20f6842e26174571996b8dea4151d4be P cd75a17ab2604397adab03bb8b5fd75c [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ccd8a4c3bfe3413cb2ae219b09aea832 in current term 15: Already voted for candidate b7ab4784c7344b939bc36f639286f377 in this term.
I20260709 13:20:28.585688  6872 raft_consensus.cc:3060] T 07a92dd554674067a83a9cb68c4773f2 P cd75a17ab2604397adab03bb8b5fd75c [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:28.601100  6805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f00a2e87e56452083b759f60d461ee3" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:28.604312  6844 leader_election.cc:304] T 30e88460611e47b2ba16a46a30b5f416 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:20:28.606460  6875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22ccee1b570c4ad3a57bd7aec085b1b4" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:28.607304  6875 raft_consensus.cc:2468] T 22ccee1b570c4ad3a57bd7aec085b1b4 P cd75a17ab2604397adab03bb8b5fd75c [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 11.
I20260709 13:20:28.550801 11010 raft_consensus.cc:493] T 22ccee1b570c4ad3a57bd7aec085b1b4 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 10 FOLLOWER]: Starting leader election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:20:28.613168  6878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "711ef6523deb4cbe8ef2ba61e1c21c98" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:28.608963  6799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "427c124d773f483294511e80fe340075" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:28.611619  7495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17587d6730594da4a56fa13a353232a1" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 19 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:20:28.604792  6678 placement_policy_util.cc:248] tablet 1528ab62b6fe4e3099d08f141afee116: not considering replicas for movement since the tablet's status is 'UNAVAILABLE'
I20260709 13:20:28.615861  6799 raft_consensus.cc:2368] T 427c124d773f483294511e80fe340075 P b7ab4784c7344b939bc36f639286f377 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c for earlier term 11. Current term is 12.
I20260709 13:20:28.623492  6844 leader_election.cc:304] T 3a485a995abc4807b6e511e45419f737 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377
I20260709 13:20:28.515983 11386 raft_consensus.cc:515] T 4d9def8b32fd443aa94ab1420b06837b P ccd8a4c3bfe3413cb2ae219b09aea832 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:28.628923  6799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb7fa124c3bf4ef9ab65a407cb008441" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:28.630833  6804 raft_consensus.cc:1275] T d8292e16e5654be6bc408560cf256aaa P b7ab4784c7344b939bc36f639286f377 [term 17 FOLLOWER]: Refusing update from remote peer ccd8a4c3bfe3413cb2ae219b09aea832: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 17 index: 10. (term mismatch)
I20260709 13:20:28.540905 11685 raft_consensus.cc:515] T 3411566abe2d4c9bb4b2adfdd05e6f17 P b7ab4784c7344b939bc36f639286f377 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:28.540334 11659 raft_consensus.cc:515] T 404190ce4ce94cecbfcb6ea9d1dd8626 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:20:28.630438  6844 leader_election.cc:304] T 9e326172347f45e99a0d482b5d8ef768 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:20:28.640672  6697 leader_election.cc:304] T c4db81d9d329422bb3b4160ca4ac2d1d P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:20:28.549273 11563 raft_consensus.cc:515] T 3d65025eea89441290d85dd053810e31 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:28.634433  6804 pending_rounds.cc:85] T d8292e16e5654be6bc408560cf256aaa P b7ab4784c7344b939bc36f639286f377: Aborting all ops after (but not including) 9
I20260709 13:20:28.643997  6804 pending_rounds.cc:107] T d8292e16e5654be6bc408560cf256aaa P b7ab4784c7344b939bc36f639286f377: Aborting uncommitted NO_OP operation due to leader change: 16.10
I20260709 13:20:28.551244 11618 consensus_queue.cc:1059] T 30e88460611e47b2ba16a46a30b5f416 P ccd8a4c3bfe3413cb2ae219b09aea832 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.064s
I20260709 13:20:28.653204  6875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90d42e216d9741e190bca19a781291fd" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:28.653970  6770 leader_election.cc:304] T 22ccee1b570c4ad3a57bd7aec085b1b4 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
I20260709 13:20:28.644194  6844 leader_election.cc:400] T 20f6842e26174571996b8dea4151d4be P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 14 election: Vote denied by peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391) with higher term. Message: Invalid argument: T 20f6842e26174571996b8dea4151d4be P ccd8a4c3bfe3413cb2ae219b09aea832 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c for earlier term 14. Current term is 15.
I20260709 13:20:28.644274  6804 raft_consensus.cc:2889] T d8292e16e5654be6bc408560cf256aaa P b7ab4784c7344b939bc36f639286f377 [term 17 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:20:28.649257 11687 consensus_queue.cc:237] T 9e326172347f45e99a0d482b5d8ef768 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
W20260709 13:20:28.650909 11737 log.cc:927] Time spent T 95a75bfe094d4bdc963aba3f08dfcd25 P b7ab4784c7344b939bc36f639286f377: Append to log took a long time: real 0.070s	user 0.000s	sys 0.000s
I20260709 13:20:28.562410 11681 consensus_queue.cc:1048] T 427c124d773f483294511e80fe340075 P 7ba59cc884714e8aa5f3f0ecaed84cbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.058s
I20260709 13:20:28.615375 11010 raft_consensus.cc:3060] T 22ccee1b570c4ad3a57bd7aec085b1b4 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:20:28.611197 11668 raft_consensus.cc:2749] T 17587d6730594da4a56fa13a353232a1 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:20:28.653913  6875 raft_consensus.cc:2468] T 90d42e216d9741e190bca19a781291fd P cd75a17ab2604397adab03bb8b5fd75c [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 12.
I20260709 13:20:28.499876 11683 consensus_queue.cc:237] T f5be3a11b23d4ea9b08300a2789821c7 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
W20260709 13:20:28.660907  7466 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 101522us
I20260709 13:20:28.664614  6799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77e330a82df4b43a745d57a68f6f057" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:20:28.678962  6799 raft_consensus.cc:3060] T e77e330a82df4b43a745d57a68f6f057 P b7ab4784c7344b939bc36f639286f377 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:28.635372 11576 raft_consensus.cc:2749] T 30e88460611e47b2ba16a46a30b5f416 P cd75a17ab2604397adab03bb8b5fd75c [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:20:28.641511 11561 raft_consensus.cc:2804] T 3a485a995abc4807b6e511e45419f737 P cd75a17ab2604397adab03bb8b5fd75c [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:20:28.643326 11714 raft_consensus.cc:2749] T 9e326172347f45e99a0d482b5d8ef768 P cd75a17ab2604397adab03bb8b5fd75c [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:20:28.683861  6879 raft_consensus.cc:2468] T 7887766dc6784fcaa42b35c05fea7a99 P cd75a17ab2604397adab03bb8b5fd75c [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 14.
I20260709 13:20:28.685391  6879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b56bf91d90824c959e21e0cee5ba1816" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:28.687208  6803 raft_consensus.cc:2468] T ce4f062dcd314d43a63ca74067cb5ee3 P b7ab4784c7344b939bc36f639286f377 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in term 14.
I20260709 13:20:28.682724  6844 leader_election.cc:304] T 4275cf08e63345f993bce8664eada830 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:20:28.652696 11172 leader_election.cc:290] T 427c124d773f483294511e80fe340075 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:20:28.692162  7502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fa34c08b205435dba97346991aa1f92" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:20:28.666193 11654 raft_consensus.cc:2804] T 22ccee1b570c4ad3a57bd7aec085b1b4 P b7ab4784c7344b939bc36f639286f377 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:20:28.705749  6875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d9def8b32fd443aa94ab1420b06837b" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:28.709513  6801 raft_consensus.cc:1240] T 2c240553ce044eedb41541d72b9475d7 P b7ab4784c7344b939bc36f639286f377 [term 15 FOLLOWER]: Rejecting Update request from peer ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 14. Current term is 15. Ops: []
I20260709 13:20:28.708884  6844 leader_election.cc:304] T e31b9971c15848dea59d4d4130141d9e P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:20:28.716863  6879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "711ef6523deb4cbe8ef2ba61e1c21c98" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:20:28.676959 11688 leader_election.cc:290] T 44bde925b2e541b69890d70715b85176 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 14 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:20:28.721726  7495 raft_consensus.cc:2468] T 17587d6730594da4a56fa13a353232a1 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 18.
I20260709 13:20:28.723076 11702 consensus_queue.cc:1048] T f58dc08b12a2494bb9a1372837970ca2 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.170s
I20260709 13:20:28.723609 11468 leader_election.cc:290] T f4b8bd455d5a47c18a1380839c6e0d61 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 13 election: Requested vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:28.724027 11702 consensus_queue.cc:1243] T f58dc08b12a2494bb9a1372837970ca2 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Peer cd75a17ab2604397adab03bb8b5fd75c log is divergent from this leader: its last log entry 15.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 13:20:28.724506 11692 raft_consensus.cc:493] T f03d0dbf16864ca4bc1bb5e4c0334c0f P b7ab4784c7344b939bc36f639286f377 [term 12 FOLLOWER]: Starting leader election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:20:28.725189 11692 raft_consensus.cc:3060] T f03d0dbf16864ca4bc1bb5e4c0334c0f P b7ab4784c7344b939bc36f639286f377 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:28.726049 11696 raft_consensus.cc:515] T a3022224cc81473690653a83d4e99470 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:28.728710 11725 raft_consensus.cc:515] T 34f36d59d88f40fe8a2805e604fc6c0a P b7ab4784c7344b939bc36f639286f377 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:28.729864 11588 raft_consensus.cc:3060] T 8c7f33e544204fbaac4078e3e83bbf4e P b7ab4784c7344b939bc36f639286f377 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:20:28.731006 11725 leader_election.cc:290] T 34f36d59d88f40fe8a2805e604fc6c0a P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 11 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:28.691519 11561 raft_consensus.cc:493] T 3a485a995abc4807b6e511e45419f737 P cd75a17ab2604397adab03bb8b5fd75c [term 12 FOLLOWER]: Starting leader election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
W20260709 13:20:28.756759  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 48004.2us
W20260709 13:20:28.758052  6771 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:28.757974  6844 leader_election.cc:304] T f3f9c2e2bf644115957398fe4c9459db P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:20:28.709949 11654 raft_consensus.cc:493] T 22ccee1b570c4ad3a57bd7aec085b1b4 P b7ab4784c7344b939bc36f639286f377 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:28.702402 11670 leader_election.cc:290] T 713b5728a197487c9300b310ab94e5a3 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 13 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:28.766906  6879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3022224cc81473690653a83d4e99470" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:28.767022  6875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ba5dac66ab5497e9e336f2a3c28cda5" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:20:28.767814  6879 raft_consensus.cc:2468] T a3022224cc81473690653a83d4e99470 P cd75a17ab2604397adab03bb8b5fd75c [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 14.
W20260709 13:20:28.769922  6770 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 79826.1us
I20260709 13:20:28.721235 11576 raft_consensus.cc:2749] T 4275cf08e63345f993bce8664eada830 P cd75a17ab2604397adab03bb8b5fd75c [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:20:28.770943  6770 leader_election.cc:304] T 90d42e216d9741e190bca19a781291fd P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
I20260709 13:20:28.775184  6844 leader_election.cc:400] T 427c124d773f483294511e80fe340075 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 11 pre-election: Vote denied by peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391) with higher term. Message: Invalid argument: T 427c124d773f483294511e80fe340075 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c for earlier term 11. Current term is 12.
I20260709 13:20:28.708851 11172 consensus_queue.cc:1048] T b3f13b31a1f84f0d89d007eadd57924c P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.055s
I20260709 13:20:28.777510  6844 leader_election.cc:403] T 427c124d773f483294511e80fe340075 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 11 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:20:28.756340 11561 raft_consensus.cc:3060] T 3a485a995abc4807b6e511e45419f737 P cd75a17ab2604397adab03bb8b5fd75c [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:28.760066 11710 raft_consensus.cc:2749] T c4db81d9d329422bb3b4160ca4ac2d1d P ccd8a4c3bfe3413cb2ae219b09aea832 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:20:28.761174 11725 raft_consensus.cc:493] T 3d65025eea89441290d85dd053810e31 P b7ab4784c7344b939bc36f639286f377 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:28.765894 11706 raft_consensus.cc:2749] T e31b9971c15848dea59d4d4130141d9e P cd75a17ab2604397adab03bb8b5fd75c [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:20:28.764776 11654 raft_consensus.cc:3060] T 22ccee1b570c4ad3a57bd7aec085b1b4 P b7ab4784c7344b939bc36f639286f377 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:20:28.794255  6879 raft_consensus.cc:1240] T f09c2a98de1a4decabd0ff900dd44caa P cd75a17ab2604397adab03bb8b5fd75c [term 15 FOLLOWER]: Rejecting Update request from peer ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 14. Current term is 15. Ops: []
I20260709 13:20:28.796446  7500 raft_consensus.cc:1240] T bb3d8792045a4583ae2e965b1350a5b4 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 12 FOLLOWER]: Rejecting Update request from peer ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 11. Current term is 12. Ops: [11.11-11.11]
I20260709 13:20:28.796769 11742 raft_consensus.cc:2804] T 90d42e216d9741e190bca19a781291fd P b7ab4784c7344b939bc36f639286f377 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:20:28.797260 11742 raft_consensus.cc:493] T 90d42e216d9741e190bca19a781291fd P b7ab4784c7344b939bc36f639286f377 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:28.797605 11742 raft_consensus.cc:3060] T 90d42e216d9741e190bca19a781291fd P b7ab4784c7344b939bc36f639286f377 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:28.798106  6726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "713b5728a197487c9300b310ab94e5a3" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:20:28.798823  6879 raft_consensus.cc:1275] T 2c240553ce044eedb41541d72b9475d7 P cd75a17ab2604397adab03bb8b5fd75c [term 14 FOLLOWER]: Refusing update from remote peer ccd8a4c3bfe3413cb2ae219b09aea832: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:20:28.799731 11685 leader_election.cc:290] T 3411566abe2d4c9bb4b2adfdd05e6f17 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 12 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:28.801033 11563 leader_election.cc:290] T 3d65025eea89441290d85dd053810e31 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
W20260709 13:20:28.801579 11738 log.cc:927] Time spent T 3fa34c08b205435dba97346991aa1f92 P 7ba59cc884714e8aa5f3f0ecaed84cbb: Append to log took a long time: real 0.130s	user 0.000s	sys 0.000s
I20260709 13:20:28.795682 11696 leader_election.cc:290] T a3022224cc81473690653a83d4e99470 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 15 election: Requested vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:28.762452 11722 raft_consensus.cc:493] T 7a734b5ab7834e05a8c422208acc58b1 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:20:28.808915  6803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22ccee1b570c4ad3a57bd7aec085b1b4" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:28.777894 11688 raft_consensus.cc:2804] T f3f9c2e2bf644115957398fe4c9459db P cd75a17ab2604397adab03bb8b5fd75c [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:20:28.818580  6728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "427c124d773f483294511e80fe340075" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:28.819358  6728 raft_consensus.cc:2468] T 427c124d773f483294511e80fe340075 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 12.
I20260709 13:20:28.774590 11707 leader_election.cc:290] T b3f13b31a1f84f0d89d007eadd57924c P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:20:28.804524 11722 raft_consensus.cc:515] T 7a734b5ab7834e05a8c422208acc58b1 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:28.826742  5625 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:20:28.827479  6726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34f36d59d88f40fe8a2805e604fc6c0a" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:20:28.788196 11700 raft_consensus.cc:2749] T 427c124d773f483294511e80fe340075 P cd75a17ab2604397adab03bb8b5fd75c [term 12 FOLLOWER]: Leader pre-election lost for term 11. Reason: Vote denied by peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391) with higher term. Message: Invalid argument: T 427c124d773f483294511e80fe340075 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c for earlier term 11. Current term is 12.
I20260709 13:20:28.813340  6844 leader_election.cc:304] T f58dc08b12a2494bb9a1372837970ca2 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:20:28.794974 11547 leader_election.cc:290] T 2c240553ce044eedb41541d72b9475d7 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 15 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:28.859576  6875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22ccee1b570c4ad3a57bd7aec085b1b4" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:28.865525  6875 raft_consensus.cc:2393] T 22ccee1b570c4ad3a57bd7aec085b1b4 P cd75a17ab2604397adab03bb8b5fd75c [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ccd8a4c3bfe3413cb2ae219b09aea832 in current term 11: Already voted for candidate cd75a17ab2604397adab03bb8b5fd75c in this term.
I20260709 13:20:28.820571 11688 raft_consensus.cc:493] T f3f9c2e2bf644115957398fe4c9459db P cd75a17ab2604397adab03bb8b5fd75c [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:20:28.867997  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 54763.1us
I20260709 13:20:28.869240  6844 leader_election.cc:304] T 2c240553ce044eedb41541d72b9475d7 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:20:28.876641  6730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c240553ce044eedb41541d72b9475d7" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:20:28.792578 11725 raft_consensus.cc:515] T 3d65025eea89441290d85dd053810e31 P b7ab4784c7344b939bc36f639286f377 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:28.885277  6844 leader_election.cc:304] T 9b3759de40694069b13c0f8bd40e5709 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:20:28.890487 11706 raft_consensus.cc:2749] T 9b3759de40694069b13c0f8bd40e5709 P cd75a17ab2604397adab03bb8b5fd75c [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:20:28.904053  6881 raft_consensus.cc:1275] T d8cee0accdb8499c86d4414b72565a38 P cd75a17ab2604397adab03bb8b5fd75c [term 14 FOLLOWER]: Refusing update from remote peer 7ba59cc884714e8aa5f3f0ecaed84cbb: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:20:28.906227  6844 leader_election.cc:400] T 427c124d773f483294511e80fe340075 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 11 pre-election: Vote denied by peer b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817) with higher term. Message: Invalid argument: T 427c124d773f483294511e80fe340075 P b7ab4784c7344b939bc36f639286f377 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c for earlier term 11. Current term is 12.
I20260709 13:20:28.907672  6875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fa34c08b205435dba97346991aa1f92" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:28.882158 11733 raft_consensus.cc:2749] T f58dc08b12a2494bb9a1372837970ca2 P cd75a17ab2604397adab03bb8b5fd75c [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:20:28.909866  6873 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58592 (request call id 391) took 1170 ms. Trace:
I20260709 13:20:28.913872  6873 rpcz_store.cc:276] 0709 13:20:27.732240 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:27.735314 (+  3074us) service_pool.cc:224] Handling call
0709 13:20:28.902648 (+1167334us) spinlock_profiling.cc:243] Waited 650 ms on lock 0x7b54002382d4. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f9ae2fa 00007fcc1496fb17 00007fcc0deea6d4 00007fcc0deea662 00007fcc0deea591 00007fcc0deea50c 00007fcc0dee97c2 00007fcc0dce548c 00007fcc0dce48c6 00007fcc0dce426f
0709 13:20:28.902846 (+   198us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1494923520}
I20260709 13:20:28.875921 11688 raft_consensus.cc:3060] T f3f9c2e2bf644115957398fe4c9459db P cd75a17ab2604397adab03bb8b5fd75c [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:28.914315  6806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de3186201e1a40d0b335eeb8b4e256e0" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 15 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:20:28.917402  6844 leader_election.cc:304] T bb7fa124c3bf4ef9ab65a407cb008441 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, b7ab4784c7344b939bc36f639286f377
I20260709 13:20:28.922089  6801 raft_consensus.cc:1275] T 3d65025eea89441290d85dd053810e31 P b7ab4784c7344b939bc36f639286f377 [term 13 FOLLOWER]: Refusing update from remote peer cd75a17ab2604397adab03bb8b5fd75c: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 13:20:28.881784 11612 leader_election.cc:290] T ab432e62819d499eaaf3dd55481dd930 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:28.906553 11711 raft_consensus.cc:2749] T 2c240553ce044eedb41541d72b9475d7 P cd75a17ab2604397adab03bb8b5fd75c [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:20:28.926065  6806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a92dd554674067a83a9cb68c4773f2" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:28.942091 11547 raft_consensus.cc:493] T dbdf895bba214ff68685a24fd17dfb5d P b7ab4784c7344b939bc36f639286f377 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:28.942770 11547 raft_consensus.cc:515] T dbdf895bba214ff68685a24fd17dfb5d P b7ab4784c7344b939bc36f639286f377 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:28.945142 11547 leader_election.cc:290] T dbdf895bba214ff68685a24fd17dfb5d P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:28.949304 11725 leader_election.cc:290] T 3d65025eea89441290d85dd053810e31 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
W20260709 13:20:28.950167 11747 log.cc:927] Time spent T fe20b4b48823486ca3b9c648db6ce8aa P cd75a17ab2604397adab03bb8b5fd75c: Append to log took a long time: real 0.234s	user 0.000s	sys 0.001s
I20260709 13:20:28.954828 11663 raft_consensus.cc:515] T 44bde925b2e541b69890d70715b85176 P b7ab4784c7344b939bc36f639286f377 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:28.956331  6807 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:32976 (request call id 3000) took 1442 ms. Trace:
W20260709 13:20:28.957183 11743 log.cc:927] Time spent T 7c37d41cd9164c15a6826ca62a851a69 P ccd8a4c3bfe3413cb2ae219b09aea832: Append to log took a long time: real 0.223s	user 0.001s	sys 0.000s
I20260709 13:20:28.963286  6799 raft_consensus.cc:2468] T e77e330a82df4b43a745d57a68f6f057 P b7ab4784c7344b939bc36f639286f377 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 15.
W20260709 13:20:28.932204  6697 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 286458us
I20260709 13:20:28.956794  6807 rpcz_store.cc:276] 0709 13:20:27.513714 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:27.530527 (+ 16813us) service_pool.cc:224] Handling call
0709 13:20:27.594815 (+ 64288us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:27.654974 (+ 60159us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:20:28.410078 (+755104us) spinlock_profiling.cc:243] Waited 11 ms on lock 0x7b180039e020. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc15785de1 00007fcc157925b1 00007fcc0c8bd3f3 00007fcc0c8bf7c1 00007fcc0c8bf779 00007fcc0c8bf709 00007fcc0c8bf6d1 00007fcc0c8be9cd 000000000038f354 000000000038f199 00007fcc0c8a083a
0709 13:20:28.727854 (+317776us) spinlock_profiling.cc:243] Waited 1.39 ms on lock 0x7b180039e020. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc15785de1 00007fcc157925b1 00007fcc0c89fe07 00007fcc156faab9 00007fcc0c8bc69b 00007fcc0c8ba93f 00007fcc0c8ba455 00007fcc133a23c7 00007fcc0f9b49a7 00007fcc0f9c40bf 00007fcc0f9c4038
0709 13:20:28.855103 (+127249us) log.cc:844] Serialized 14 byte log entry
0709 13:20:28.918374 (+ 63271us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:20:28.919679 (+  1305us) log.cc:844] Serialized 26 byte log entry
0709 13:20:28.919875 (+   196us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:20:28.919925 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:28.920148 (+   223us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:28.956027 (+ 35879us) raft_consensus.cc:1685] finished
0709 13:20:28.956071 (+    44us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:28.956236 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":78815,"prepare.queue_time_us":20435,"prepare.run_cpu_time_us":88,"prepare.run_wall_time_us":4810,"raft.queue_time_us":79084,"raft.run_cpu_time_us":193,"raft.run_wall_time_us":198,"spinlock_wait_cycles":28508160,"thread_start_us":157553,"threads_started":2,"wal-append.queue_time_us":81404}
I20260709 13:20:28.965384  6875 raft_consensus.cc:1275] T a1704639a875409b9959353527b3fd68 P cd75a17ab2604397adab03bb8b5fd75c [term 14 FOLLOWER]: Refusing update from remote peer ccd8a4c3bfe3413cb2ae219b09aea832: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:20:28.916090 11659 leader_election.cc:290] T 404190ce4ce94cecbfcb6ea9d1dd8626 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:20:28.968061  6697 leader_election.cc:304] T 9b3759de40694069b13c0f8bd40e5709 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:20:28.969770  6799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d33d5ee8ef6f415593d8df52063161ad" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:28.974669  6799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a734b5ab7834e05a8c422208acc58b1" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 14 candidate_status { last_received { term: 13 index: 5 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:28.925616 11504 raft_consensus.cc:2804] T a1704639a875409b9959353527b3fd68 P b7ab4784c7344b939bc36f639286f377 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:20:28.969389  6876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6869f07b5a4885a0b99fbe60c3b175" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:20:28.945289 11722 leader_election.cc:290] T 7a734b5ab7834e05a8c422208acc58b1 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:29.000996  6799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09c2a98de1a4decabd0ff900dd44caa" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:20:29.006657  6799 raft_consensus.cc:3060] T f09c2a98de1a4decabd0ff900dd44caa P b7ab4784c7344b939bc36f639286f377 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:28.994851  6872 raft_consensus.cc:2468] T 07a92dd554674067a83a9cb68c4773f2 P cd75a17ab2604397adab03bb8b5fd75c [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 13.
I20260709 13:20:28.962984 11733 raft_consensus.cc:2749] T bb7fa124c3bf4ef9ab65a407cb008441 P cd75a17ab2604397adab03bb8b5fd75c [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:20:29.004122  6876 raft_consensus.cc:3060] T bd6869f07b5a4885a0b99fbe60c3b175 P cd75a17ab2604397adab03bb8b5fd75c [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:29.008230  6872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce4f062dcd314d43a63ca74067cb5ee3" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:20:29.010938  6875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b56bf91d90824c959e21e0cee5ba1816" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:29.019547  6874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4b8bd455d5a47c18a1380839c6e0d61" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 13 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:29.020491  6874 raft_consensus.cc:2393] T f4b8bd455d5a47c18a1380839c6e0d61 P cd75a17ab2604397adab03bb8b5fd75c [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ccd8a4c3bfe3413cb2ae219b09aea832 in current term 13: Already voted for candidate cd75a17ab2604397adab03bb8b5fd75c in this term.
I20260709 13:20:29.021085  6805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4b8bd455d5a47c18a1380839c6e0d61" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:20:29.021405  6874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c37d41cd9164c15a6826ca62a851a69" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:29.021785  6805 raft_consensus.cc:3060] T f4b8bd455d5a47c18a1380839c6e0d61 P b7ab4784c7344b939bc36f639286f377 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:29.022130  6874 raft_consensus.cc:2468] T 7c37d41cd9164c15a6826ca62a851a69 P cd75a17ab2604397adab03bb8b5fd75c [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 13.
I20260709 13:20:29.023113  6874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fa34c08b205435dba97346991aa1f92" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:29.019570  6880 raft_consensus.cc:1240] T e77e330a82df4b43a745d57a68f6f057 P cd75a17ab2604397adab03bb8b5fd75c [term 15 FOLLOWER]: Rejecting Update request from peer ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 14. Current term is 15. Ops: []
I20260709 13:20:29.025607  6880 raft_consensus.cc:1240] T bb3d8792045a4583ae2e965b1350a5b4 P cd75a17ab2604397adab03bb8b5fd75c [term 12 FOLLOWER]: Rejecting Update request from peer ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 11. Current term is 12. Ops: [10.10-11.11]
I20260709 13:20:29.030445  6807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90d42e216d9741e190bca19a781291fd" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:29.033339  6844 leader_election.cc:304] T e77e330a82df4b43a745d57a68f6f057 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:20:28.962304 11692 raft_consensus.cc:515] T f03d0dbf16864ca4bc1bb5e4c0334c0f P b7ab4784c7344b939bc36f639286f377 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:29.037813  6799 raft_consensus.cc:2468] T f09c2a98de1a4decabd0ff900dd44caa P b7ab4784c7344b939bc36f639286f377 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 15.
I20260709 13:20:29.007434 11659 raft_consensus.cc:2749] T 9b3759de40694069b13c0f8bd40e5709 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:20:29.038947  7468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 133051us
I20260709 13:20:29.106482  7468 leader_election.cc:304] T bb3d8792045a4583ae2e965b1350a5b4 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, cd75a17ab2604397adab03bb8b5fd75c; no voters: ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:20:29.107486  6800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c7f33e544204fbaac4078e3e83bbf4e" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:29.107880 11679 raft_consensus.cc:2804] T bb3d8792045a4583ae2e965b1350a5b4 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:20:29.050076  6876 raft_consensus.cc:2468] T bd6869f07b5a4885a0b99fbe60c3b175 P cd75a17ab2604397adab03bb8b5fd75c [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 14.
I20260709 13:20:29.108454 11679 raft_consensus.cc:697] T bb3d8792045a4583ae2e965b1350a5b4 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 12 LEADER]: Becoming Leader. State: Replica: 7ba59cc884714e8aa5f3f0ecaed84cbb, State: Running, Role: LEADER
I20260709 13:20:29.109400  6876 raft_consensus.cc:1275] T d8292e16e5654be6bc408560cf256aaa P cd75a17ab2604397adab03bb8b5fd75c [term 17 FOLLOWER]: Refusing update from remote peer ccd8a4c3bfe3413cb2ae219b09aea832: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 13:20:29.110849  6876 raft_consensus.cc:1275] T 95a75bfe094d4bdc963aba3f08dfcd25 P cd75a17ab2604397adab03bb8b5fd75c [term 13 FOLLOWER]: Refusing update from remote peer ccd8a4c3bfe3413cb2ae219b09aea832: Log matching property violated. Preceding OpId in replica: term: 11 index: 5. Preceding OpId from leader: term: 13 index: 6. (index mismatch)
I20260709 13:20:29.116462  6728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90d42e216d9741e190bca19a781291fd" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:29.117340  6728 raft_consensus.cc:2393] T 90d42e216d9741e190bca19a781291fd P ccd8a4c3bfe3413cb2ae219b09aea832 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c in current term 13: Already voted for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in this term.
I20260709 13:20:29.117877  6726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22ccee1b570c4ad3a57bd7aec085b1b4" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:29.118304  6728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de3186201e1a40d0b335eeb8b4e256e0" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 15 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:20:29.119526  6728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24ee15416e3145beaa1b8183453729a3" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:29.119675  6727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a92dd554674067a83a9cb68c4773f2" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:29.120517  6727 raft_consensus.cc:2393] T 07a92dd554674067a83a9cb68c4773f2 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c in current term 13: Already voted for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in this term.
I20260709 13:20:29.121357  6727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d33d5ee8ef6f415593d8df52063161ad" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:29.124312  7496 raft_consensus.cc:1275] T b3f13b31a1f84f0d89d007eadd57924c P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 12 FOLLOWER]: Refusing update from remote peer b7ab4784c7344b939bc36f639286f377: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
W20260709 13:20:29.126950 11634 consensus_meta.cc:287] T b56bf91d90824c959e21e0cee5ba1816 P ccd8a4c3bfe3413cb2ae219b09aea832: Time spent flushing consensus metadata: real 0.588s	user 0.013s	sys 0.000s
I20260709 13:20:29.127434 11634 raft_consensus.cc:515] T b56bf91d90824c959e21e0cee5ba1816 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:29.055959  6879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f00a2e87e56452083b759f60d461ee3" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:20:29.154645  6879 raft_consensus.cc:3060] T 4f00a2e87e56452083b759f60d461ee3 P cd75a17ab2604397adab03bb8b5fd75c [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:20:29.156491  6697 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 188566us
I20260709 13:20:29.157737  6697 leader_election.cc:304] T 1bf4668eeb70467fb3dc5a0289233b3c P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:20:29.041738  6880 raft_consensus.cc:1275] T 3411566abe2d4c9bb4b2adfdd05e6f17 P cd75a17ab2604397adab03bb8b5fd75c [term 11 FOLLOWER]: Refusing update from remote peer ccd8a4c3bfe3413cb2ae219b09aea832: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:20:29.101822  6723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3411566abe2d4c9bb4b2adfdd05e6f17" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:20:29.102247  6798 raft_consensus.cc:1240] T 4275cf08e63345f993bce8664eada830 P b7ab4784c7344b939bc36f639286f377 [term 13 LEADER]: Rejecting Update request from peer ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 12. Current term is 13. Ops: []
I20260709 13:20:29.039911  6875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "711ef6523deb4cbe8ef2ba61e1c21c98" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:20:29.110532 11654 raft_consensus.cc:515] T 22ccee1b570c4ad3a57bd7aec085b1b4 P b7ab4784c7344b939bc36f639286f377 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:29.128847  6877 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53406 (request call id 2288) took 2634 ms. Trace:
W20260709 13:20:29.129452 11664 consensus_meta.cc:287] T 07a92dd554674067a83a9cb68c4773f2 P b7ab4784c7344b939bc36f639286f377: Time spent flushing consensus metadata: real 0.710s	user 0.010s	sys 0.003s
I20260709 13:20:29.129585  6801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7887766dc6784fcaa42b35c05fea7a99" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:29.134187 11386 leader_election.cc:290] T 4d9def8b32fd443aa94ab1420b06837b P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:29.137735  6725 raft_consensus.cc:1240] T bd6869f07b5a4885a0b99fbe60c3b175 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 14 FOLLOWER]: Rejecting Update request from peer b7ab4784c7344b939bc36f639286f377 for earlier term 13. Current term is 14. Ops: []
I20260709 13:20:29.138116  6881 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58592 (request call id 395) took 1257 ms. Trace:
I20260709 13:20:29.138540 11742 raft_consensus.cc:515] T 90d42e216d9741e190bca19a781291fd P b7ab4784c7344b939bc36f639286f377 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:29.139201 11663 leader_election.cc:290] T 44bde925b2e541b69890d70715b85176 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 14 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
W20260709 13:20:29.140977 11755 log.cc:927] Time spent T 34f36d59d88f40fe8a2805e604fc6c0a P ccd8a4c3bfe3413cb2ae219b09aea832: Append to log took a long time: real 0.134s	user 0.000s	sys 0.000s
I20260709 13:20:29.036830 11714 raft_consensus.cc:2804] T e77e330a82df4b43a745d57a68f6f057 P cd75a17ab2604397adab03bb8b5fd75c [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:20:29.141732  7503 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50756 (request call id 339) took 1224 ms. Trace:
I20260709 13:20:29.198787  6803 raft_consensus.cc:2393] T 22ccee1b570c4ad3a57bd7aec085b1b4 P b7ab4784c7344b939bc36f639286f377 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c in current term 12: Already voted for candidate b7ab4784c7344b939bc36f639286f377 in this term.
I20260709 13:20:29.198701  6725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbdf895bba214ff68685a24fd17dfb5d" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 12 candidate_status { last_received { term: 10 index: 4 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:29.161598  6877 rpcz_store.cc:276] 0709 13:20:26.493818 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:26.505004 (+ 11186us) service_pool.cc:224] Handling call
0709 13:20:26.505342 (+   338us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:26.505823 (+   481us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:26.505849 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:20:26.506559 (+   710us) log.cc:844] Serialized 26 byte log entry
0709 13:20:27.034005 (+527446us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:20:27.034085 (+    80us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:27.034179 (+    94us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:28.979346 (+1945167us) spinlock_profiling.cc:243] Waited 5.37 ms on lock 0x7b24002c3198. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0c745db1 00007fcc0c7439c4 00007fcc0c741acb 00007fcc0c8fcdc9 00007fcc0c8fca55 00007fcc0c8fbfb0 00007fcc0f572488 00007fcc0f572be8 00007fcc0f54a398 00007fcc0f54576a 00007fcc0f544bb6
0709 13:20:29.128419 (+149073us) raft_consensus.cc:1685] finished
0709 13:20:29.128443 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:29.128665 (+   222us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":6456,"raft.run_cpu_time_us":100,"raft.run_wall_time_us":101,"spinlock_wait_cycles":12340480,"thread_start_us":496176,"threads_started":1,"wal-append.queue_time_us":718410}
I20260709 13:20:29.199563  6725 raft_consensus.cc:2468] T dbdf895bba214ff68685a24fd17dfb5d P ccd8a4c3bfe3413cb2ae219b09aea832 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 11.
I20260709 13:20:29.099759  6799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "853ac0a8cbd64ce99457f170216d4d0f" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:20:29.200802  6799 raft_consensus.cc:3060] T 853ac0a8cbd64ce99457f170216d4d0f P b7ab4784c7344b939bc36f639286f377 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:20:29.202948  6771 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:29.035808 11660 raft_consensus.cc:3060] T 30e88460611e47b2ba16a46a30b5f416 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:20:29.142127  7501 raft_consensus.cc:1240] T 4f00a2e87e56452083b759f60d461ee3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 14 FOLLOWER]: Rejecting Update request from peer b7ab4784c7344b939bc36f639286f377 for earlier term 13. Current term is 14. Ops: [13.10-13.10]
I20260709 13:20:29.142204 11611 raft_consensus.cc:493] T 3fa34c08b205435dba97346991aa1f92 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 15 FOLLOWER]: Starting leader election (detected failure of leader cd75a17ab2604397adab03bb8b5fd75c)
I20260709 13:20:29.144212 11010 raft_consensus.cc:515] T 22ccee1b570c4ad3a57bd7aec085b1b4 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:29.099997  6844 leader_election.cc:304] T f09c2a98de1a4decabd0ff900dd44caa P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:20:29.146467  6876 raft_consensus.cc:1240] T 9e326172347f45e99a0d482b5d8ef768 P cd75a17ab2604397adab03bb8b5fd75c [term 12 FOLLOWER]: Rejecting Update request from peer ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 11. Current term is 12. Ops: []
I20260709 13:20:29.147531  6728 raft_consensus.cc:2468] T 24ee15416e3145beaa1b8183453729a3 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 16.
W20260709 13:20:29.211920  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 169907us
I20260709 13:20:29.148521  6800 raft_consensus.cc:2468] T 8c7f33e544204fbaac4078e3e83bbf4e P b7ab4784c7344b939bc36f639286f377 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 11.
I20260709 13:20:29.122623  6727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a734b5ab7834e05a8c422208acc58b1" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 14 candidate_status { last_received { term: 13 index: 5 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:29.213255  6727 raft_consensus.cc:2468] T 7a734b5ab7834e05a8c422208acc58b1 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 13.
I20260709 13:20:29.177874 11659 raft_consensus.cc:2749] T 1bf4668eeb70467fb3dc5a0289233b3c P ccd8a4c3bfe3413cb2ae219b09aea832 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:20:29.164963  6801 raft_consensus.cc:2468] T 7887766dc6784fcaa42b35c05fea7a99 P b7ab4784c7344b939bc36f639286f377 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 14.
I20260709 13:20:29.174957  6881 rpcz_store.cc:276] 0709 13:20:27.881049 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:27.881277 (+   228us) service_pool.cc:224] Handling call
0709 13:20:28.903573 (+1022296us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:28.904682 (+  1109us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:29.137914 (+233232us) spinlock_profiling.cc:243] Waited 999 ms on lock 0x7b54002382d0. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f9a98ad 00007fcc1496e419 00007fcc0dee5bd4 00007fcc0dee5b62 00007fcc0dee5a91 00007fcc0dee5a0c 00007fcc0dee4cc2 00007fcc0dce548c 00007fcc0dce48c6 00007fcc0dce426f
0709 13:20:29.138055 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2296764800}
I20260709 13:20:29.178416  6806 raft_consensus.cc:2468] T 07a92dd554674067a83a9cb68c4773f2 P b7ab4784c7344b939bc36f639286f377 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 13.
I20260709 13:20:29.191192  6724 raft_consensus.cc:2393] T b56bf91d90824c959e21e0cee5ba1816 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7ab4784c7344b939bc36f639286f377 in current term 13: Already voted for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in this term.
W20260709 13:20:29.191892  6846 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.68:45071, user_credentials={real_user=slave}} blocked reactor thread for 184491us
I20260709 13:20:29.142225 11692 leader_election.cc:290] T f03d0dbf16864ca4bc1bb5e4c0334c0f P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 13 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:29.197652  6805 raft_consensus.cc:2468] T f4b8bd455d5a47c18a1380839c6e0d61 P b7ab4784c7344b939bc36f639286f377 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 13.
I20260709 13:20:29.225358  6727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c7f33e544204fbaac4078e3e83bbf4e" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:29.199950  7503 rpcz_store.cc:276] 0709 13:20:27.917621 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:27.921496 (+  3875us) service_pool.cc:224] Handling call
0709 13:20:29.141494 (+1219998us) spinlock_profiling.cc:243] Waited 460 ms on lock 0x7b540046fad4. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f9ae2fa 00007fcc1496fb17 00007fcc0deea6d4 00007fcc0deea662 00007fcc0deea591 00007fcc0deea50c 00007fcc0dee97c2 00007fcc0dce548c 00007fcc0dce48c6 00007fcc0dce426f
0709 13:20:29.141639 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1056965504}
I20260709 13:20:29.207293  6880 raft_consensus.cc:1275] T 427c124d773f483294511e80fe340075 P cd75a17ab2604397adab03bb8b5fd75c [term 12 FOLLOWER]: Refusing update from remote peer 7ba59cc884714e8aa5f3f0ecaed84cbb: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:20:29.207931  6799 raft_consensus.cc:2410] T 853ac0a8cbd64ce99457f170216d4d0f P b7ab4784c7344b939bc36f639286f377 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c for term 11 because replica has last-logged OpId of term: 10 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
I20260709 13:20:29.209614  6725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "853ac0a8cbd64ce99457f170216d4d0f" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:20:29.209676  7498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "427c124d773f483294511e80fe340075" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:20:29.228523  6727 raft_consensus.cc:2393] T 8c7f33e544204fbaac4078e3e83bbf4e P ccd8a4c3bfe3413cb2ae219b09aea832 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c in current term 11: Already voted for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in this term.
I20260709 13:20:29.210381  6723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09c2a98de1a4decabd0ff900dd44caa" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:20:29.215867  6875 raft_consensus.cc:1240] T de3186201e1a40d0b335eeb8b4e256e0 P cd75a17ab2604397adab03bb8b5fd75c [term 15 FOLLOWER]: Rejecting Update request from peer ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 14. Current term is 15. Ops: [14.8-14.8]
I20260709 13:20:29.213342  6772 leader_election.cc:304] T 17587d6730594da4a56fa13a353232a1 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, b7ab4784c7344b939bc36f639286f377; no voters: ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:20:29.167493  6697 leader_election.cc:304] T 8c7f33e544204fbaac4078e3e83bbf4e P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377
I20260709 13:20:29.218807  6807 raft_consensus.cc:2368] T 90d42e216d9741e190bca19a781291fd P b7ab4784c7344b939bc36f639286f377 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c for earlier term 13. Current term is 14.
W20260709 13:20:29.198220  7468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 90627.2us
I20260709 13:20:29.232708  6772 leader_election.cc:304] T 4d9def8b32fd443aa94ab1420b06837b P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:20:29.234246  6880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f03d0dbf16864ca4bc1bb5e4c0334c0f" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:20:29.250226  6881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "427c124d773f483294511e80fe340075" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:29.255286  6881 raft_consensus.cc:2468] T 427c124d773f483294511e80fe340075 P cd75a17ab2604397adab03bb8b5fd75c [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 12.
I20260709 13:20:29.255890  6846 leader_election.cc:304] T 4f00a2e87e56452083b759f60d461ee3 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, b7ab4784c7344b939bc36f639286f377
I20260709 13:20:29.235160  6723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7887766dc6784fcaa42b35c05fea7a99" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:29.235067  6876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbdf895bba214ff68685a24fd17dfb5d" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 12 candidate_status { last_received { term: 10 index: 4 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:29.242024  6725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6869f07b5a4885a0b99fbe60c3b175" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:29.242969  6728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4b8bd455d5a47c18a1380839c6e0d61" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:20:29.257978  6877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34f36d59d88f40fe8a2805e604fc6c0a" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:20:29.234766 11066 consensus_queue.cc:1048] T 3d65025eea89441290d85dd053810e31 P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:20:29.245818  6875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44bde925b2e541b69890d70715b85176" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:20:29.249558 11010 leader_election.cc:290] T 22ccee1b570c4ad3a57bd7aec085b1b4 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 11 election: Requested vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:29.250226  6770 leader_election.cc:304] T 711ef6523deb4cbe8ef2ba61e1c21c98 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:20:29.250737  6801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6869f07b5a4885a0b99fbe60c3b175" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:29.256125  6726 raft_consensus.cc:2468] T 22ccee1b570c4ad3a57bd7aec085b1b4 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 11.
I20260709 13:20:29.258445  6876 raft_consensus.cc:2393] T dbdf895bba214ff68685a24fd17dfb5d P cd75a17ab2604397adab03bb8b5fd75c [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7ab4784c7344b939bc36f639286f377 in current term 12: Already voted for candidate cd75a17ab2604397adab03bb8b5fd75c in this term.
I20260709 13:20:29.244872  6727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44bde925b2e541b69890d70715b85176" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:20:29.243489  6874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c240553ce044eedb41541d72b9475d7" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:20:29.258023  6723 raft_consensus.cc:2393] T 7887766dc6784fcaa42b35c05fea7a99 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c in current term 14: Already voted for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in this term.
I20260709 13:20:29.119539 11679 consensus_queue.cc:237] T bb3d8792045a4583ae2e965b1350a5b4 P 7ba59cc884714e8aa5f3f0ecaed84cbb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:20:29.262398  6772 leader_election.cc:304] T 7ba5dac66ab5497e9e336f2a3c28cda5 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, cd75a17ab2604397adab03bb8b5fd75c
W20260709 13:20:29.263995  6697 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 96601.9us
I20260709 13:20:29.214816 11611 raft_consensus.cc:3060] T 3fa34c08b205435dba97346991aa1f92 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:29.265496  6880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "713b5728a197487c9300b310ab94e5a3" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:20:29.265589  6728 raft_consensus.cc:2393] T f4b8bd455d5a47c18a1380839c6e0d61 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c in current term 13: Already voted for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in this term.
I20260709 13:20:29.269440  6725 raft_consensus.cc:2393] T bd6869f07b5a4885a0b99fbe60c3b175 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c in current term 14: Already voted for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in this term.
I20260709 13:20:29.215611 11663 raft_consensus.cc:493] T d8292e16e5654be6bc408560cf256aaa P b7ab4784c7344b939bc36f639286f377 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:29.259775  6877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d65025eea89441290d85dd053810e31" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:29.272903  6727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f03d0dbf16864ca4bc1bb5e4c0334c0f" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:20:29.273325  6874 raft_consensus.cc:3060] T 2c240553ce044eedb41541d72b9475d7 P cd75a17ab2604397adab03bb8b5fd75c [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:29.275105  6723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3022224cc81473690653a83d4e99470" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:20:29.274641  6875 raft_consensus.cc:2393] T 44bde925b2e541b69890d70715b85176 P cd75a17ab2604397adab03bb8b5fd75c [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate b7ab4784c7344b939bc36f639286f377 in current term 14: Already voted for candidate cd75a17ab2604397adab03bb8b5fd75c in this term.
I20260709 13:20:29.279368  6770 leader_election.cc:304] T dbdf895bba214ff68685a24fd17dfb5d P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
I20260709 13:20:29.254117 11695 raft_consensus.cc:2804] T f09c2a98de1a4decabd0ff900dd44caa P cd75a17ab2604397adab03bb8b5fd75c [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:20:29.302019  6727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44bde925b2e541b69890d70715b85176" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:20:29.292307  6723 raft_consensus.cc:2368] T a3022224cc81473690653a83d4e99470 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c for earlier term 14. Current term is 15.
I20260709 13:20:29.280843  6881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3411566abe2d4c9bb4b2adfdd05e6f17" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:20:29.304162  6881 raft_consensus.cc:3060] T 3411566abe2d4c9bb4b2adfdd05e6f17 P cd75a17ab2604397adab03bb8b5fd75c [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:20:29.218890 11693 consensus_queue.cc:1048] T b3f13b31a1f84f0d89d007eadd57924c P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.061s
I20260709 13:20:29.270008 11354 raft_consensus.cc:2749] T 4d9def8b32fd443aa94ab1420b06837b P b7ab4784c7344b939bc36f639286f377 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:20:29.312682  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 98916.4us
I20260709 13:20:29.314607  6723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbdf895bba214ff68685a24fd17dfb5d" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 12 candidate_status { last_received { term: 10 index: 4 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:20:29.315541  6723 raft_consensus.cc:3060] T dbdf895bba214ff68685a24fd17dfb5d P ccd8a4c3bfe3413cb2ae219b09aea832 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:20:29.317447  6801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3022224cc81473690653a83d4e99470" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:20:29.317591  6727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a75bfe094d4bdc963aba3f08dfcd25" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 14 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:29.314917  6697 leader_election.cc:304] T 3a485a995abc4807b6e511e45419f737 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377
I20260709 13:20:29.322245  6728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d65025eea89441290d85dd053810e31" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:29.323014  6728 raft_consensus.cc:2468] T 3d65025eea89441290d85dd053810e31 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 13.
I20260709 13:20:29.278985 11692 raft_consensus.cc:2749] T 711ef6523deb4cbe8ef2ba61e1c21c98 P b7ab4784c7344b939bc36f639286f377 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:20:29.269295 11767 raft_consensus.cc:2804] T 8c7f33e544204fbaac4078e3e83bbf4e P ccd8a4c3bfe3413cb2ae219b09aea832 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:20:29.334474  6727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8292e16e5654be6bc408560cf256aaa" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 18 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:29.335033  6881 raft_consensus.cc:2468] T 3411566abe2d4c9bb4b2adfdd05e6f17 P cd75a17ab2604397adab03bb8b5fd75c [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 12.
I20260709 13:20:29.337119  6876 raft_consensus.cc:1240] T 7c44c4849aa54f2b94d1f1bef9ed546f P cd75a17ab2604397adab03bb8b5fd75c [term 15 FOLLOWER]: Rejecting Update request from peer ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 14. Current term is 15. Ops: []
I20260709 13:20:29.337862  6697 leader_election.cc:304] T 20f6842e26174571996b8dea4151d4be P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:20:29.281999 11634 leader_election.cc:290] T b56bf91d90824c959e21e0cee5ba1816 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 13 election: Requested vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:29.339828  6725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22ccee1b570c4ad3a57bd7aec085b1b4" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:20:29.342231  6874 raft_consensus.cc:2468] T 2c240553ce044eedb41541d72b9475d7 P cd75a17ab2604397adab03bb8b5fd75c [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 15.
I20260709 13:20:29.269234 11749 consensus_queue.cc:1048] T 20f6842e26174571996b8dea4151d4be P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.048s
I20260709 13:20:29.347898  6727 raft_consensus.cc:1275] T 3d65025eea89441290d85dd053810e31 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 13 FOLLOWER]: Refusing update from remote peer cd75a17ab2604397adab03bb8b5fd75c: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 13:20:29.314857 11547 raft_consensus.cc:2804] T 17587d6730594da4a56fa13a353232a1 P b7ab4784c7344b939bc36f639286f377 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:20:29.344318 11659 raft_consensus.cc:2804] T 3a485a995abc4807b6e511e45419f737 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:20:29.312099 11695 raft_consensus.cc:697] T f09c2a98de1a4decabd0ff900dd44caa P cd75a17ab2604397adab03bb8b5fd75c [term 15 LEADER]: Becoming Leader. State: Replica: cd75a17ab2604397adab03bb8b5fd75c, State: Running, Role: LEADER
I20260709 13:20:29.361348  6727 raft_consensus.cc:1240] T 711ef6523deb4cbe8ef2ba61e1c21c98 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 15 FOLLOWER]: Rejecting Update request from peer cd75a17ab2604397adab03bb8b5fd75c for earlier term 14. Current term is 15. Ops: [14.9-14.9]
I20260709 13:20:29.365878  6879 raft_consensus.cc:2468] T 4f00a2e87e56452083b759f60d461ee3 P cd75a17ab2604397adab03bb8b5fd75c [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in term 14.
I20260709 13:20:29.367230  6881 raft_consensus.cc:1240] T 4f00a2e87e56452083b759f60d461ee3 P cd75a17ab2604397adab03bb8b5fd75c [term 14 FOLLOWER]: Rejecting Update request from peer b7ab4784c7344b939bc36f639286f377 for earlier term 13. Current term is 14. Ops: [13.10-13.10]
I20260709 13:20:29.379244  6879 raft_consensus.cc:1240] T bd6869f07b5a4885a0b99fbe60c3b175 P cd75a17ab2604397adab03bb8b5fd75c [term 14 FOLLOWER]: Rejecting Update request from peer b7ab4784c7344b939bc36f639286f377 for earlier term 13. Current term is 14. Ops: []
I20260709 13:20:29.364619 11700 raft_consensus.cc:493] T 7c44c4849aa54f2b94d1f1bef9ed546f P cd75a17ab2604397adab03bb8b5fd75c [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:29.389048 11772 raft_consensus.cc:2749] T 4f00a2e87e56452083b759f60d461ee3 P cd75a17ab2604397adab03bb8b5fd75c [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:20:29.303400 11663 raft_consensus.cc:515] T d8292e16e5654be6bc408560cf256aaa P b7ab4784c7344b939bc36f639286f377 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:29.393647 11656 raft_consensus.cc:2804] T dbdf895bba214ff68685a24fd17dfb5d P b7ab4784c7344b939bc36f639286f377 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:20:29.394192 11656 raft_consensus.cc:493] T dbdf895bba214ff68685a24fd17dfb5d P b7ab4784c7344b939bc36f639286f377 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:29.394539 11656 raft_consensus.cc:3060] T dbdf895bba214ff68685a24fd17dfb5d P b7ab4784c7344b939bc36f639286f377 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:20:29.396253 11688 raft_consensus.cc:515] T f3f9c2e2bf644115957398fe4c9459db P cd75a17ab2604397adab03bb8b5fd75c [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:29.391924 11663 leader_election.cc:290] T d8292e16e5654be6bc408560cf256aaa P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:29.398416 11688 leader_election.cc:290] T f3f9c2e2bf644115957398fe4c9459db P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 13 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:20:29.306893 11670 consensus_queue.cc:1059] T bd6869f07b5a4885a0b99fbe60c3b175 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.049s
I20260709 13:20:29.401000 11670 raft_consensus.cc:3055] T bd6869f07b5a4885a0b99fbe60c3b175 P b7ab4784c7344b939bc36f639286f377 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:20:29.401363 11670 raft_consensus.cc:740] T bd6869f07b5a4885a0b99fbe60c3b175 P b7ab4784c7344b939bc36f639286f377 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
I20260709 13:20:29.402168 11670 consensus_queue.cc:260] T bd6869f07b5a4885a0b99fbe60c3b175 P b7ab4784c7344b939bc36f639286f377 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 13.7, Last appended by leader: 7, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:29.403338 11670 raft_consensus.cc:3060] T bd6869f07b5a4885a0b99fbe60c3b175 P b7ab4784c7344b939bc36f639286f377 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:20:29.404410 11734 log.cc:927] Time spent T 7ba5dac66ab5497e9e336f2a3c28cda5 P 7ba59cc884714e8aa5f3f0ecaed84cbb: Append to log took a long time: real 0.050s	user 0.000s	sys 0.000s
I20260709 13:20:29.410668  6801 raft_consensus.cc:2468] T a3022224cc81473690653a83d4e99470 P b7ab4784c7344b939bc36f639286f377 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 14.
I20260709 13:20:29.412119  6801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44bde925b2e541b69890d70715b85176" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
W20260709 13:20:29.412513 11650 consensus_meta.cc:287] T ce4f062dcd314d43a63ca74067cb5ee3 P cd75a17ab2604397adab03bb8b5fd75c: Time spent flushing consensus metadata: real 0.802s	user 0.013s	sys 0.000s
W20260709 13:20:29.412788  6697 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 75003.8us
I20260709 13:20:29.413061 11650 raft_consensus.cc:2749] T ce4f062dcd314d43a63ca74067cb5ee3 P cd75a17ab2604397adab03bb8b5fd75c [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:20:29.413302  6801 raft_consensus.cc:2393] T 44bde925b2e541b69890d70715b85176 P b7ab4784c7344b939bc36f639286f377 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c in current term 14: Already voted for candidate b7ab4784c7344b939bc36f639286f377 in this term.
I20260709 13:20:29.388741 11700 raft_consensus.cc:515] T 7c44c4849aa54f2b94d1f1bef9ed546f P cd75a17ab2604397adab03bb8b5fd75c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:29.414451  6728 raft_consensus.cc:3055] T 4275cf08e63345f993bce8664eada830 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:20:29.415509 11695 consensus_queue.cc:237] T f09c2a98de1a4decabd0ff900dd44caa P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:29.445874  6728 raft_consensus.cc:740] T 4275cf08e63345f993bce8664eada830 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
I20260709 13:20:29.413548  6697 leader_election.cc:304] T 7887766dc6784fcaa42b35c05fea7a99 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377
I20260709 13:20:29.358963  6876 pending_rounds.cc:85] T f58dc08b12a2494bb9a1372837970ca2 P cd75a17ab2604397adab03bb8b5fd75c: Aborting all ops after (but not including) 7
I20260709 13:20:29.449838  6876 pending_rounds.cc:107] T f58dc08b12a2494bb9a1372837970ca2 P cd75a17ab2604397adab03bb8b5fd75c: Aborting uncommitted NO_OP operation due to leader change: 15.8
I20260709 13:20:29.450196  6876 raft_consensus.cc:2889] T f58dc08b12a2494bb9a1372837970ca2 P cd75a17ab2604397adab03bb8b5fd75c [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:20:29.415592 11761 log.cc:927] Time spent T f03d0dbf16864ca4bc1bb5e4c0334c0f P ccd8a4c3bfe3413cb2ae219b09aea832: Append to log took a long time: real 0.149s	user 0.000s	sys 0.000s
I20260709 13:20:29.414225 11742 leader_election.cc:290] T 90d42e216d9741e190bca19a781291fd P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 14 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:29.413779  6872 raft_consensus.cc:3060] T ce4f062dcd314d43a63ca74067cb5ee3 P cd75a17ab2604397adab03bb8b5fd75c [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:29.324697 11478 consensus_queue.cc:1048] T d8cee0accdb8499c86d4414b72565a38 P 7ba59cc884714e8aa5f3f0ecaed84cbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.092s
I20260709 13:20:29.457876  6727 raft_consensus.cc:1275] T 3fa34c08b205435dba97346991aa1f92 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 15 FOLLOWER]: Refusing update from remote peer cd75a17ab2604397adab03bb8b5fd75c: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 13:20:29.463522  6723 raft_consensus.cc:2468] T dbdf895bba214ff68685a24fd17dfb5d P ccd8a4c3bfe3413cb2ae219b09aea832 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 12.
I20260709 13:20:29.353339 11725 raft_consensus.cc:2749] T 7ba5dac66ab5497e9e336f2a3c28cda5 P b7ab4784c7344b939bc36f639286f377 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:20:29.361179 11547 raft_consensus.cc:493] T 17587d6730594da4a56fa13a353232a1 P b7ab4784c7344b939bc36f639286f377 [term 18 FOLLOWER]: Starting leader election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:20:29.353192 11511 consensus_queue.cc:1048] T 427c124d773f483294511e80fe340075 P 7ba59cc884714e8aa5f3f0ecaed84cbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.071s
I20260709 13:20:29.473575  6728 consensus_queue.cc:260] T 4275cf08e63345f993bce8664eada830 P ccd8a4c3bfe3413cb2ae219b09aea832 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.6, Last appended by leader: 6, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:29.475244 11767 raft_consensus.cc:697] T 8c7f33e544204fbaac4078e3e83bbf4e P ccd8a4c3bfe3413cb2ae219b09aea832 [term 11 LEADER]: Becoming Leader. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
I20260709 13:20:29.360906 11659 raft_consensus.cc:493] T 3a485a995abc4807b6e511e45419f737 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 12 FOLLOWER]: Starting leader election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:20:29.412230 11634 raft_consensus.cc:2749] T 20f6842e26174571996b8dea4151d4be P ccd8a4c3bfe3413cb2ae219b09aea832 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:20:29.484300  6872 raft_consensus.cc:2468] T ce4f062dcd314d43a63ca74067cb5ee3 P cd75a17ab2604397adab03bb8b5fd75c [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in term 14.
I20260709 13:20:29.496078  6804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbdf895bba214ff68685a24fd17dfb5d" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 12 candidate_status { last_received { term: 10 index: 4 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:20:29.497601  6727 raft_consensus.cc:3055] T 7c44c4849aa54f2b94d1f1bef9ed546f P ccd8a4c3bfe3413cb2ae219b09aea832 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:20:29.504514  6801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a75bfe094d4bdc963aba3f08dfcd25" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 14 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
W20260709 13:20:29.505070  6697 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 91593.8us
I20260709 13:20:29.488349 11547 raft_consensus.cc:3060] T 17587d6730594da4a56fa13a353232a1 P b7ab4784c7344b939bc36f639286f377 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:20:29.507128  6727 raft_consensus.cc:740] T 7c44c4849aa54f2b94d1f1bef9ed546f P ccd8a4c3bfe3413cb2ae219b09aea832 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
I20260709 13:20:29.517390  6844 leader_election.cc:304] T 7887766dc6784fcaa42b35c05fea7a99 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:20:29.519011  6728 raft_consensus.cc:3060] T 4275cf08e63345f993bce8664eada830 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:29.507594 11660 raft_consensus.cc:493] T f3f9c2e2bf644115957398fe4c9459db P ccd8a4c3bfe3413cb2ae219b09aea832 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:29.524744 11660 raft_consensus.cc:515] T f3f9c2e2bf644115957398fe4c9459db P ccd8a4c3bfe3413cb2ae219b09aea832 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:29.527379 11660 leader_election.cc:290] T f3f9c2e2bf644115957398fe4c9459db P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:29.511963 11674 raft_consensus.cc:2804] T 7887766dc6784fcaa42b35c05fea7a99 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:20:29.520550 11386 consensus_queue.cc:1059] T f09c2a98de1a4decabd0ff900dd44caa P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:20:29.500557 11659 raft_consensus.cc:3060] T 3a485a995abc4807b6e511e45419f737 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:29.521770 11675 consensus_queue.cc:1048] T 2c240553ce044eedb41541d72b9475d7 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:20:29.531111  6801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8292e16e5654be6bc408560cf256aaa" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 18 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:29.534137  6801 raft_consensus.cc:2410] T d8292e16e5654be6bc408560cf256aaa P b7ab4784c7344b939bc36f639286f377 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c for term 18 because replica has last-logged OpId of term: 15 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 7.
I20260709 13:20:29.535586  6801 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3d65025eea89441290d85dd053810e31"
dest_uuid: "b7ab4784c7344b939bc36f639286f377"
mode: GRACEFUL
new_leader_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
 from {username='slave'} at 127.0.0.1:38240
I20260709 13:20:29.536712  6801 raft_consensus.cc:606] T 3d65025eea89441290d85dd053810e31 P b7ab4784c7344b939bc36f639286f377 [term 13 FOLLOWER]: Received request to transfer leadership to TS cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:20:29.537144  6801 raft_consensus.cc:614] T 3d65025eea89441290d85dd053810e31 P b7ab4784c7344b939bc36f639286f377 [term 13 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 13:20:29.521147 11760 log.cc:927] Time spent T c4db81d9d329422bb3b4160ca4ac2d1d P cd75a17ab2604397adab03bb8b5fd75c: Append to log took a long time: real 0.294s	user 0.000s	sys 0.001s
I20260709 13:20:29.539554  6728 raft_consensus.cc:1275] T 4275cf08e63345f993bce8664eada830 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 13 FOLLOWER]: Refusing update from remote peer b7ab4784c7344b939bc36f639286f377: Log matching property violated. Preceding OpId in replica: term: 12 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
W20260709 13:20:29.542824  6695 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:29.541337  6697 leader_election.cc:304] T 07a92dd554674067a83a9cb68c4773f2 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377
I20260709 13:20:29.552281  6844 leader_election.cc:304] T f4b8bd455d5a47c18a1380839c6e0d61 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:20:29.538610  6727 consensus_queue.cc:260] T 7c44c4849aa54f2b94d1f1bef9ed546f P ccd8a4c3bfe3413cb2ae219b09aea832 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:29.558684  6844 leader_election.cc:304] T a3022224cc81473690653a83d4e99470 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:20:29.530486 11674 raft_consensus.cc:697] T 7887766dc6784fcaa42b35c05fea7a99 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 14 LEADER]: Becoming Leader. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
W20260709 13:20:29.549361 11561 consensus_meta.cc:287] T 3a485a995abc4807b6e511e45419f737 P cd75a17ab2604397adab03bb8b5fd75c: Time spent flushing consensus metadata: real 0.750s	user 0.015s	sys 0.000s
I20260709 13:20:29.567898  7468 leader_election.cc:304] T 4f00a2e87e56452083b759f60d461ee3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377
I20260709 13:20:29.591199  6727 raft_consensus.cc:3060] T 7c44c4849aa54f2b94d1f1bef9ed546f P ccd8a4c3bfe3413cb2ae219b09aea832 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:29.592576  6844 leader_election.cc:304] T de3186201e1a40d0b335eeb8b4e256e0 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:20:29.597587  6844 leader_election.cc:304] T d33d5ee8ef6f415593d8df52063161ad P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:20:29.597285  6697 leader_election.cc:304] T 7c37d41cd9164c15a6826ca62a851a69 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377
I20260709 13:20:29.547921 11010 consensus_queue.cc:1059] T 853ac0a8cbd64ce99457f170216d4d0f P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.045s
I20260709 13:20:29.592653 11777 raft_consensus.cc:2804] T a3022224cc81473690653a83d4e99470 P cd75a17ab2604397adab03bb8b5fd75c [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:20:29.557964 11706 raft_consensus.cc:2764] T 7887766dc6784fcaa42b35c05fea7a99 P cd75a17ab2604397adab03bb8b5fd75c [term 14 FOLLOWER]: Leader pre-election decision vote started in defunct term 13: won
I20260709 13:20:29.561213 11636 raft_consensus.cc:493] T d33d5ee8ef6f415593d8df52063161ad P ccd8a4c3bfe3413cb2ae219b09aea832 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:20:29.602013  6875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "427c124d773f483294511e80fe340075" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:20:29.566792 11650 raft_consensus.cc:2804] T f4b8bd455d5a47c18a1380839c6e0d61 P cd75a17ab2604397adab03bb8b5fd75c [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:20:29.566887 11386 raft_consensus.cc:2804] T 07a92dd554674067a83a9cb68c4773f2 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:20:29.552618 11683 consensus_queue.cc:1048] T a1704639a875409b9959353527b3fd68 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.041s
I20260709 13:20:29.561869 11700 leader_election.cc:290] T 7c44c4849aa54f2b94d1f1bef9ed546f P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:20:29.604866  6875 raft_consensus.cc:2376] T 427c124d773f483294511e80fe340075 P cd75a17ab2604397adab03bb8b5fd75c [term 12 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in term 12. Re-sending same reply.
I20260709 13:20:29.600574  6844 leader_election.cc:304] T 24ee15416e3145beaa1b8183453729a3 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb
I20260709 13:20:29.610417 11688 raft_consensus.cc:2749] T de3186201e1a40d0b335eeb8b4e256e0 P cd75a17ab2604397adab03bb8b5fd75c [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:20:29.600627 11756 consensus_queue.cc:1048] T d8292e16e5654be6bc408560cf256aaa P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.022s
W20260709 13:20:29.621469  6772 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 359090us
I20260709 13:20:29.597658 11511 raft_consensus.cc:2804] T 4f00a2e87e56452083b759f60d461ee3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:20:29.567056 11728 raft_consensus.cc:493] T f58dc08b12a2494bb9a1372837970ca2 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:20:29.604085 11010 consensus_queue.cc:1243] T 853ac0a8cbd64ce99457f170216d4d0f P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Peer cd75a17ab2604397adab03bb8b5fd75c log is divergent from this leader: its last log entry 9.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 13:20:29.650556  6801 raft_consensus.cc:1240] T 7ba5dac66ab5497e9e336f2a3c28cda5 P b7ab4784c7344b939bc36f639286f377 [term 14 FOLLOWER]: Rejecting Update request from peer cd75a17ab2604397adab03bb8b5fd75c for earlier term 13. Current term is 14. Ops: []
I20260709 13:20:29.598230 11751 consensus_queue.cc:1059] T 2c240553ce044eedb41541d72b9475d7 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: INVALID_TERM, Last received: 14.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.036s
I20260709 13:20:29.629343 11706 raft_consensus.cc:2749] T d33d5ee8ef6f415593d8df52063161ad P cd75a17ab2604397adab03bb8b5fd75c [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:20:29.647707  6772 leader_election.cc:304] T f03d0dbf16864ca4bc1bb5e4c0334c0f P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:20:29.633282 11650 raft_consensus.cc:697] T f4b8bd455d5a47c18a1380839c6e0d61 P cd75a17ab2604397adab03bb8b5fd75c [term 13 LEADER]: Becoming Leader. State: Replica: cd75a17ab2604397adab03bb8b5fd75c, State: Running, Role: LEADER
I20260709 13:20:29.569994 11561 raft_consensus.cc:515] T 3a485a995abc4807b6e511e45419f737 P cd75a17ab2604397adab03bb8b5fd75c [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:29.655107  6772 leader_election.cc:304] T 427c124d773f483294511e80fe340075 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:20:29.642156 11588 raft_consensus.cc:493] T 853ac0a8cbd64ce99457f170216d4d0f P b7ab4784c7344b939bc36f639286f377 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:29.621093 11636 raft_consensus.cc:515] T d33d5ee8ef6f415593d8df52063161ad P ccd8a4c3bfe3413cb2ae219b09aea832 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:29.663542  6772 leader_election.cc:304] T 34f36d59d88f40fe8a2805e604fc6c0a P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:20:29.667985  6801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4b8bd455d5a47c18a1380839c6e0d61" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 13 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:20:29.669050  6801 raft_consensus.cc:2393] T f4b8bd455d5a47c18a1380839c6e0d61 P b7ab4784c7344b939bc36f639286f377 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate ccd8a4c3bfe3413cb2ae219b09aea832 in current term 13: Already voted for candidate cd75a17ab2604397adab03bb8b5fd75c in this term.
I20260709 13:20:29.651360 11688 raft_consensus.cc:493] T f5be3a11b23d4ea9b08300a2789821c7 P cd75a17ab2604397adab03bb8b5fd75c [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:20:29.606838 11767 consensus_queue.cc:237] T 8c7f33e544204fbaac4078e3e83bbf4e P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:29.659399 11663 raft_consensus.cc:2749] T f03d0dbf16864ca4bc1bb5e4c0334c0f P b7ab4784c7344b939bc36f639286f377 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
W20260709 13:20:29.727700 11766 log.cc:927] Time spent T 4275cf08e63345f993bce8664eada830 P b7ab4784c7344b939bc36f639286f377: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
I20260709 13:20:29.662674 11511 raft_consensus.cc:697] T 4f00a2e87e56452083b759f60d461ee3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 14 LEADER]: Becoming Leader. State: Replica: 7ba59cc884714e8aa5f3f0ecaed84cbb, State: Running, Role: LEADER
I20260709 13:20:29.732210  6801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab432e62819d499eaaf3dd55481dd930" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:29.664461 11700 raft_consensus.cc:2804] T 24ee15416e3145beaa1b8183453729a3 P cd75a17ab2604397adab03bb8b5fd75c [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:20:29.733573  6801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3022224cc81473690653a83d4e99470" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:20:29.664954 11714 raft_consensus.cc:697] T e77e330a82df4b43a745d57a68f6f057 P cd75a17ab2604397adab03bb8b5fd75c [term 15 LEADER]: Becoming Leader. State: Replica: cd75a17ab2604397adab03bb8b5fd75c, State: Running, Role: LEADER
I20260709 13:20:29.736532  6801 raft_consensus.cc:3060] T a3022224cc81473690653a83d4e99470 P b7ab4784c7344b939bc36f639286f377 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:29.694844 11687 raft_consensus.cc:2804] T 427c124d773f483294511e80fe340075 P b7ab4784c7344b939bc36f639286f377 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:20:29.655380 11728 raft_consensus.cc:515] T f58dc08b12a2494bb9a1372837970ca2 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:29.734742 11751 raft_consensus.cc:2804] T 7c37d41cd9164c15a6826ca62a851a69 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:20:29.666301 11588 raft_consensus.cc:515] T 853ac0a8cbd64ce99457f170216d4d0f P b7ab4784c7344b939bc36f639286f377 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
W20260709 13:20:29.756222  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 155761us
I20260709 13:20:29.757969 11636 leader_election.cc:290] T d33d5ee8ef6f415593d8df52063161ad P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:29.736191 11700 raft_consensus.cc:493] T 24ee15416e3145beaa1b8183453729a3 P cd75a17ab2604397adab03bb8b5fd75c [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:29.765960  6844 leader_election.cc:304] T 7a734b5ab7834e05a8c422208acc58b1 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377
I20260709 13:20:29.651166 11674 consensus_queue.cc:237] T 7887766dc6784fcaa42b35c05fea7a99 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:29.745353 11687 raft_consensus.cc:493] T 427c124d773f483294511e80fe340075 P b7ab4784c7344b939bc36f639286f377 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:29.770805  6844 leader_election.cc:304] T 853ac0a8cbd64ce99457f170216d4d0f P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:20:29.744786 11782 raft_consensus.cc:2749] T 34f36d59d88f40fe8a2805e604fc6c0a P b7ab4784c7344b939bc36f639286f377 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:20:29.729285 11688 raft_consensus.cc:515] T f5be3a11b23d4ea9b08300a2789821c7 P cd75a17ab2604397adab03bb8b5fd75c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:29.779019  6844 leader_election.cc:304] T bd6869f07b5a4885a0b99fbe60c3b175 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:20:29.779631  6727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c44c4849aa54f2b94d1f1bef9ed546f" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:29.803417  6727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f9c2e2bf644115957398fe4c9459db" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:20:29.804337  6727 raft_consensus.cc:3060] T f3f9c2e2bf644115957398fe4c9459db P ccd8a4c3bfe3413cb2ae219b09aea832 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:29.805930  6801 raft_consensus.cc:2468] T a3022224cc81473690653a83d4e99470 P b7ab4784c7344b939bc36f639286f377 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 15.
I20260709 13:20:29.761271 11751 raft_consensus.cc:493] T 7c37d41cd9164c15a6826ca62a851a69 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 13 FOLLOWER]: Starting leader election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:20:29.807233  6844 leader_election.cc:400] T a3022224cc81473690653a83d4e99470 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 14 election: Vote denied by peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391) with higher term. Message: Invalid argument: T a3022224cc81473690653a83d4e99470 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c for earlier term 14. Current term is 15.
I20260709 13:20:29.809412  6801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d9def8b32fd443aa94ab1420b06837b" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
W20260709 13:20:29.776980 11682 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 15 current term: 15 is higher.
I20260709 13:20:29.810604  6801 raft_consensus.cc:2468] T 4d9def8b32fd443aa94ab1420b06837b P b7ab4784c7344b939bc36f639286f377 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 13.
I20260709 13:20:29.808703  6695 leader_election.cc:304] T a3022224cc81473690653a83d4e99470 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
I20260709 13:20:29.771948 11700 raft_consensus.cc:3060] T 24ee15416e3145beaa1b8183453729a3 P cd75a17ab2604397adab03bb8b5fd75c [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:29.816280  6801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d33d5ee8ef6f415593d8df52063161ad" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:29.776786 11781 raft_consensus.cc:2804] T 7a734b5ab7834e05a8c422208acc58b1 P cd75a17ab2604397adab03bb8b5fd75c [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:20:29.779415 11687 raft_consensus.cc:3060] T 427c124d773f483294511e80fe340075 P b7ab4784c7344b939bc36f639286f377 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:29.818027  6801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f9c2e2bf644115957398fe4c9459db" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:29.787743 11636 raft_consensus.cc:493] T 30e88460611e47b2ba16a46a30b5f416 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:29.823239  6695 leader_election.cc:304] T 4d9def8b32fd443aa94ab1420b06837b P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
I20260709 13:20:29.778491 11777 raft_consensus.cc:697] T a3022224cc81473690653a83d4e99470 P cd75a17ab2604397adab03bb8b5fd75c [term 14 LEADER]: Becoming Leader. State: Replica: cd75a17ab2604397adab03bb8b5fd75c, State: Running, Role: LEADER
I20260709 13:20:29.824697  6801 raft_consensus.cc:2468] T f3f9c2e2bf644115957398fe4c9459db P b7ab4784c7344b939bc36f639286f377 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 12.
I20260709 13:20:29.804702 11386 raft_consensus.cc:697] T 07a92dd554674067a83a9cb68c4773f2 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 13 LEADER]: Becoming Leader. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
I20260709 13:20:29.812947 11751 raft_consensus.cc:3060] T 7c37d41cd9164c15a6826ca62a851a69 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:29.833561  6801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3f13b31a1f84f0d89d007eadd57924c" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:29.819690 11797 raft_consensus.cc:2749] T 853ac0a8cbd64ce99457f170216d4d0f P cd75a17ab2604397adab03bb8b5fd75c [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
W20260709 13:20:29.829953 11776 log.cc:927] Time spent T f5be3a11b23d4ea9b08300a2789821c7 P ccd8a4c3bfe3413cb2ae219b09aea832: Append to log took a long time: real 0.194s	user 0.000s	sys 0.001s
I20260709 13:20:29.769778 11650 consensus_queue.cc:237] T f4b8bd455d5a47c18a1380839c6e0d61 P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:29.772850 11611 raft_consensus.cc:515] T 3fa34c08b205435dba97346991aa1f92 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:20:29.832697 11706 raft_consensus.cc:2749] T bd6869f07b5a4885a0b99fbe60c3b175 P cd75a17ab2604397adab03bb8b5fd75c [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:20:29.823293 11781 raft_consensus.cc:493] T 7a734b5ab7834e05a8c422208acc58b1 P cd75a17ab2604397adab03bb8b5fd75c [term 13 FOLLOWER]: Starting leader election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:20:29.829993 11793 raft_consensus.cc:2804] T a3022224cc81473690653a83d4e99470 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:20:29.839146  6695 leader_election.cc:304] T f3f9c2e2bf644115957398fe4c9459db P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
I20260709 13:20:29.847494 11666 raft_consensus.cc:493] T 95a75bfe094d4bdc963aba3f08dfcd25 P b7ab4784c7344b939bc36f639286f377 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:20:29.833738 11636 raft_consensus.cc:515] T 30e88460611e47b2ba16a46a30b5f416 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:29.837325 11782 raft_consensus.cc:493] T 30e88460611e47b2ba16a46a30b5f416 P b7ab4784c7344b939bc36f639286f377 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:29.861073  6727 raft_consensus.cc:2468] T f3f9c2e2bf644115957398fe4c9459db P ccd8a4c3bfe3413cb2ae219b09aea832 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 13.
W20260709 13:20:29.874804  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 57263.7us
I20260709 13:20:29.842614 11795 raft_consensus.cc:2804] T 4d9def8b32fd443aa94ab1420b06837b P ccd8a4c3bfe3413cb2ae219b09aea832 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:20:29.881060  6801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "404190ce4ce94cecbfcb6ea9d1dd8626" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:29.883330  6844 leader_election.cc:304] T dbdf895bba214ff68685a24fd17dfb5d P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:20:29.841503 11742 consensus_queue.cc:1059] T 4f00a2e87e56452083b759f60d461ee3 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.034s
I20260709 13:20:29.850438 11561 leader_election.cc:290] T 3a485a995abc4807b6e511e45419f737 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 13 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:20:29.885742  7501 raft_consensus.cc:1240] T 3fa34c08b205435dba97346991aa1f92 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 16 FOLLOWER]: Rejecting Update request from peer cd75a17ab2604397adab03bb8b5fd75c for earlier term 15. Current term is 16. Ops: []
I20260709 13:20:29.864444 11790 consensus_queue.cc:1048] T 3d65025eea89441290d85dd053810e31 P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Connected to new peer: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.032s
I20260709 13:20:29.890885  6844 leader_election.cc:304] T f3f9c2e2bf644115957398fe4c9459db P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:20:29.827266 11511 consensus_queue.cc:237] T 4f00a2e87e56452083b759f60d461ee3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:20:29.825484 11714 consensus_queue.cc:237] T e77e330a82df4b43a745d57a68f6f057 P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.7, Last appended by leader: 7, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } }
W20260709 13:20:29.909941 11783 log.cc:927] Time spent T e31b9971c15848dea59d4d4130141d9e P cd75a17ab2604397adab03bb8b5fd75c: Append to log took a long time: real 0.150s	user 0.000s	sys 0.001s
I20260709 13:20:29.910168 11798 raft_consensus.cc:3055] T 4f00a2e87e56452083b759f60d461ee3 P b7ab4784c7344b939bc36f639286f377 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:20:29.911165 11792 raft_consensus.cc:2764] T f3f9c2e2bf644115957398fe4c9459db P ccd8a4c3bfe3413cb2ae219b09aea832 [term 13 FOLLOWER]: Leader pre-election decision vote started in defunct term 12: won
I20260709 13:20:29.879523 11670 raft_consensus.cc:493] T 404190ce4ce94cecbfcb6ea9d1dd8626 P b7ab4784c7344b939bc36f639286f377 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 7ba59cc884714e8aa5f3f0ecaed84cbb)
I20260709 13:20:29.880005 11781 raft_consensus.cc:3060] T 7a734b5ab7834e05a8c422208acc58b1 P cd75a17ab2604397adab03bb8b5fd75c [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:20:29.916222  6695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 70680.6us
W20260709 13:20:29.918481 11785 log.cc:927] Time spent T bb3d8792045a4583ae2e965b1350a5b4 P 7ba59cc884714e8aa5f3f0ecaed84cbb: Append to log took a long time: real 0.080s	user 0.000s	sys 0.001s
I20260709 13:20:29.908926 11706 raft_consensus.cc:2804] T dbdf895bba214ff68685a24fd17dfb5d P cd75a17ab2604397adab03bb8b5fd75c [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:20:29.921164 11688 leader_election.cc:290] T f5be3a11b23d4ea9b08300a2789821c7 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:20:29.883867 11666 raft_consensus.cc:515] T 95a75bfe094d4bdc963aba3f08dfcd25 P b7ab4784c7344b939bc36f639286f377 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:29.886401 11795 raft_consensus.cc:493] T 4d9def8b32fd443aa94ab1420b06837b P ccd8a4c3bfe3413cb2ae219b09aea832 [term 13 FOLLOWER]: Starting leader election (detected failure of leader cd75a17ab2604397adab03bb8b5fd75c)
I20260709 13:20:29.956554  6729 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50004 (request call id 2279) took 1445 ms. Trace:
W20260709 13:20:29.908835  6697 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 312325us
I20260709 13:20:29.935040 11670 raft_consensus.cc:515] T 404190ce4ce94cecbfcb6ea9d1dd8626 P b7ab4784c7344b939bc36f639286f377 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:20:29.886849 11782 raft_consensus.cc:515] T 30e88460611e47b2ba16a46a30b5f416 P b7ab4784c7344b939bc36f639286f377 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:29.963557  6801 raft_consensus.cc:2468] T 404190ce4ce94cecbfcb6ea9d1dd8626 P b7ab4784c7344b939bc36f639286f377 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 13.
I20260709 13:20:29.927806 11798 raft_consensus.cc:740] T 4f00a2e87e56452083b759f60d461ee3 P b7ab4784c7344b939bc36f639286f377 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
I20260709 13:20:29.927527 11561 raft_consensus.cc:2804] T f3f9c2e2bf644115957398fe4c9459db P cd75a17ab2604397adab03bb8b5fd75c [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:20:29.881699 11797 consensus_queue.cc:1059] T 711ef6523deb4cbe8ef2ba61e1c21c98 P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.046s
I20260709 13:20:29.906458 11777 consensus_queue.cc:237] T a3022224cc81473690653a83d4e99470 P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
W20260709 13:20:29.921921 11656 consensus_meta.cc:287] T dbdf895bba214ff68685a24fd17dfb5d P b7ab4784c7344b939bc36f639286f377: Time spent flushing consensus metadata: real 0.527s	user 0.013s	sys 0.000s
I20260709 13:20:29.972627 11656 raft_consensus.cc:515] T dbdf895bba214ff68685a24fd17dfb5d P b7ab4784c7344b939bc36f639286f377 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:29.973949  6804 raft_consensus.cc:2393] T dbdf895bba214ff68685a24fd17dfb5d P b7ab4784c7344b939bc36f639286f377 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c in current term 12: Already voted for candidate b7ab4784c7344b939bc36f639286f377 in this term.
I20260709 13:20:29.975338 11797 raft_consensus.cc:3055] T 711ef6523deb4cbe8ef2ba61e1c21c98 P cd75a17ab2604397adab03bb8b5fd75c [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:20:29.975979 11797 raft_consensus.cc:740] T 711ef6523deb4cbe8ef2ba61e1c21c98 P cd75a17ab2604397adab03bb8b5fd75c [term 14 LEADER]: Becoming Follower/Learner. State: Replica: cd75a17ab2604397adab03bb8b5fd75c, State: Running, Role: LEADER
I20260709 13:20:29.975481 11781 raft_consensus.cc:515] T 7a734b5ab7834e05a8c422208acc58b1 P cd75a17ab2604397adab03bb8b5fd75c [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:29.977006 11797 consensus_queue.cc:260] T 711ef6523deb4cbe8ef2ba61e1c21c98 P cd75a17ab2604397adab03bb8b5fd75c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:29.978446 11797 raft_consensus.cc:3060] T 711ef6523deb4cbe8ef2ba61e1c21c98 P cd75a17ab2604397adab03bb8b5fd75c [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:20:29.978863 11788 log.cc:927] Time spent T f58dc08b12a2494bb9a1372837970ca2 P cd75a17ab2604397adab03bb8b5fd75c: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 13:20:29.980285 11781 leader_election.cc:290] T 7a734b5ab7834e05a8c422208acc58b1 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 14 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:20:29.912528 11634 raft_consensus.cc:493] T 1528ab62b6fe4e3099d08f141afee116 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 7ba59cc884714e8aa5f3f0ecaed84cbb)
I20260709 13:20:29.987901 11634 raft_consensus.cc:515] T 1528ab62b6fe4e3099d08f141afee116 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
W20260709 13:20:29.989643 11768 log.cc:927] Time spent T 9e326172347f45e99a0d482b5d8ef768 P b7ab4784c7344b939bc36f639286f377: Append to log took a long time: real 0.736s	user 0.001s	sys 0.003s
I20260709 13:20:29.989655 11810 consensus_queue.cc:1059] T e77e330a82df4b43a745d57a68f6f057 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: INVALID_TERM, Last received: 14.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:20:29.957140  6729 rpcz_store.cc:276] 0709 13:20:28.511349 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:28.512693 (+  1344us) service_pool.cc:224] Handling call
0709 13:20:28.526617 (+ 13924us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:28.907499 (+380882us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:28.907539 (+    40us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:20:28.907588 (+    49us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:20:28.907636 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:29.956184 (+1048548us) spinlock_profiling.cc:243] Waited 93.5 ms on lock 0x7b5400058a54. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f9aae01 00007fcc0f9a983e 00007fcc1496e419 00007fcc0dee5bd4 00007fcc0dee5b62 00007fcc0dee5a91 00007fcc0dee5a0c 00007fcc0dee4cc2 00007fcc0dce548c 00007fcc0dce48c6
0709 13:20:29.956272 (+    88us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:29.956465 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":52219,"raft.queue_time_us":93849,"raft.run_cpu_time_us":207,"raft.run_wall_time_us":5213,"spinlock_wait_cycles":214994688,"thread_start_us":232765,"threads_started":1}
I20260709 13:20:29.928094 11742 raft_consensus.cc:493] T be1a92657f494cac8dd227d152f50151 P b7ab4784c7344b939bc36f639286f377 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 7ba59cc884714e8aa5f3f0ecaed84cbb)
I20260709 13:20:29.909953 11803 consensus_queue.cc:1048] T 3fa34c08b205435dba97346991aa1f92 P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Connected to new peer: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.036s
I20260709 13:20:29.959452 11706 raft_consensus.cc:697] T dbdf895bba214ff68685a24fd17dfb5d P cd75a17ab2604397adab03bb8b5fd75c [term 12 LEADER]: Becoming Leader. State: Replica: cd75a17ab2604397adab03bb8b5fd75c, State: Running, Role: LEADER
I20260709 13:20:29.945439 11728 leader_election.cc:290] T f58dc08b12a2494bb9a1372837970ca2 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:29.994669  6729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a485a995abc4807b6e511e45419f737" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:20:29.994155 11742 raft_consensus.cc:515] T be1a92657f494cac8dd227d152f50151 P b7ab4784c7344b939bc36f639286f377 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:20:29.948459 11793 raft_consensus.cc:697] T a3022224cc81473690653a83d4e99470 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 15 LEADER]: Becoming Leader. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
I20260709 13:20:29.970827 11798 consensus_queue.cc:260] T 4f00a2e87e56452083b759f60d461ee3 P b7ab4784c7344b939bc36f639286f377 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.10, Last appended by leader: 10, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:20:29.995596 11706 consensus_queue.cc:237] T dbdf895bba214ff68685a24fd17dfb5d P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 10.4, Last appended by leader: 4, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:29.994426 11810 raft_consensus.cc:3055] T e77e330a82df4b43a745d57a68f6f057 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:20:29.995990  6729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5be3a11b23d4ea9b08300a2789821c7" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:29.996480  6697 leader_election.cc:304] T bd6869f07b5a4885a0b99fbe60c3b175 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377
I20260709 13:20:29.997362  6806 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:32966 (request call id 1212) took 1178 ms. Trace:
I20260709 13:20:29.999917  6802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1528ab62b6fe4e3099d08f141afee116" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:30.007467  6806 rpcz_store.cc:276] 0709 13:20:28.818481 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:28.925710 (+107229us) service_pool.cc:224] Handling call
0709 13:20:29.997203 (+1071493us) spinlock_profiling.cc:243] Waited 249 ms on lock 0x7b54001b44d4. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f9ae2fa 00007fcc1496fb17 00007fcc0deea6d4 00007fcc0deea662 00007fcc0deea591 00007fcc0deea50c 00007fcc0dee97c2 00007fcc0dce548c 00007fcc0dce48c6 00007fcc0dce426f
0709 13:20:29.997306 (+   103us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":573664000}
I20260709 13:20:30.008587  6802 raft_consensus.cc:2468] T 1528ab62b6fe4e3099d08f141afee116 P b7ab4784c7344b939bc36f639286f377 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 10.
I20260709 13:20:29.957793 11588 leader_election.cc:290] T 853ac0a8cbd64ce99457f170216d4d0f P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:30.038550  6806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a734b5ab7834e05a8c422208acc58b1" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 14 candidate_status { last_received { term: 13 index: 5 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:29.959754 11795 raft_consensus.cc:3060] T 4d9def8b32fd443aa94ab1420b06837b P ccd8a4c3bfe3413cb2ae219b09aea832 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:29.997882 11798 raft_consensus.cc:3060] T 4f00a2e87e56452083b759f60d461ee3 P b7ab4784c7344b939bc36f639286f377 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:30.047032  6697 leader_election.cc:304] T 711ef6523deb4cbe8ef2ba61e1c21c98 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:20:30.055331  6806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d65025eea89441290d85dd053810e31" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:29.997120 11634 leader_election.cc:290] T 1528ab62b6fe4e3099d08f141afee116 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:20:29.930011 11386 consensus_queue.cc:237] T 07a92dd554674067a83a9cb68c4773f2 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:30.005932 11810 raft_consensus.cc:740] T e77e330a82df4b43a745d57a68f6f057 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
I20260709 13:20:30.047142 11675 raft_consensus.cc:2804] T bd6869f07b5a4885a0b99fbe60c3b175 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:20:30.063808  6802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f58dc08b12a2494bb9a1372837970ca2" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:30.066586  6729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a734b5ab7834e05a8c422208acc58b1" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 14 candidate_status { last_received { term: 13 index: 5 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:20:30.044649 11666 leader_election.cc:290] T 95a75bfe094d4bdc963aba3f08dfcd25 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:30.041498 11561 raft_consensus.cc:697] T f3f9c2e2bf644115957398fe4c9459db P cd75a17ab2604397adab03bb8b5fd75c [term 13 LEADER]: Becoming Leader. State: Replica: cd75a17ab2604397adab03bb8b5fd75c, State: Running, Role: LEADER
I20260709 13:20:30.056095  6806 raft_consensus.cc:2468] T 3d65025eea89441290d85dd053810e31 P b7ab4784c7344b939bc36f639286f377 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 13.
I20260709 13:20:30.060141 11722 raft_consensus.cc:2749] T 711ef6523deb4cbe8ef2ba61e1c21c98 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:20:30.069819 11809 consensus_queue.cc:1059] T 9e326172347f45e99a0d482b5d8ef768 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.004s
W20260709 13:20:30.071847  6695 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:30.077821 11504 raft_consensus.cc:493] T a1704639a875409b9959353527b3fd68 P b7ab4784c7344b939bc36f639286f377 [term 14 FOLLOWER]: Starting leader election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:20:30.075613 11710 consensus_queue.cc:1059] T de3186201e1a40d0b335eeb8b4e256e0 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.015s
I20260709 13:20:29.996861 11808 consensus_queue.cc:1059] T bb3d8792045a4583ae2e965b1350a5b4 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.072s
I20260709 13:20:30.098850  6806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30e88460611e47b2ba16a46a30b5f416" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:30.050222 11756 consensus_queue.cc:1048] T 95a75bfe094d4bdc963aba3f08dfcd25 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.041s
I20260709 13:20:30.105211  6806 raft_consensus.cc:2468] T 30e88460611e47b2ba16a46a30b5f416 P b7ab4784c7344b939bc36f639286f377 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 12.
I20260709 13:20:30.054699 11728 consensus_queue.cc:1048] T 3411566abe2d4c9bb4b2adfdd05e6f17 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.040s
I20260709 13:20:30.107609  6806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b56bf91d90824c959e21e0cee5ba1816" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:20:30.058060 11802 consensus_queue.cc:1048] T d8292e16e5654be6bc408560cf256aaa P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 6, Time since last communication: 0.050s
I20260709 13:20:30.109289  6802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22ccee1b570c4ad3a57bd7aec085b1b4" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
W20260709 13:20:30.096004 11711 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.845s	user 0.038s	sys 0.051s
W20260709 13:20:30.118214  6731 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49744 (request call id 502) took 1750 ms (client timeout 1798 ms). Trace:
I20260709 13:20:30.099923 11504 raft_consensus.cc:3060] T a1704639a875409b9959353527b3fd68 P b7ab4784c7344b939bc36f639286f377 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:30.095204 11675 raft_consensus.cc:697] T bd6869f07b5a4885a0b99fbe60c3b175 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 14 LEADER]: Becoming Leader. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
W20260709 13:20:30.118958  6731 rpcz_store.cc:269] 0709 13:20:28.361421 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:28.361596 (+   175us) service_pool.cc:224] Handling call
0709 13:20:30.111614 (+1750018us) spinlock_profiling.cc:243] Waited 113 ms on lock 0x7b54003b6ad4. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f9ae2fa 00007fcc1496fb17 00007fcc0deea6d4 00007fcc0deea662 00007fcc0deea591 00007fcc0deea50c 00007fcc0dee97c2 00007fcc0dce548c 00007fcc0dce48c6 00007fcc0dce426f
0709 13:20:30.111800 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":259032448}
W20260709 13:20:30.116251 11801 log.cc:927] Time spent T b3f13b31a1f84f0d89d007eadd57924c P 7ba59cc884714e8aa5f3f0ecaed84cbb: Append to log took a long time: real 0.139s	user 0.001s	sys 0.000s
I20260709 13:20:30.120622  6806 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "427c124d773f483294511e80fe340075"
dest_uuid: "b7ab4784c7344b939bc36f639286f377"
mode: GRACEFUL
new_leader_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
 from {username='slave'} at 127.0.0.1:38240
I20260709 13:20:30.123567  6729 raft_consensus.cc:1275] T 24ee15416e3145beaa1b8183453729a3 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 16 FOLLOWER]: Refusing update from remote peer 7ba59cc884714e8aa5f3f0ecaed84cbb: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:20:30.108512 11611 leader_election.cc:290] T 3fa34c08b205435dba97346991aa1f92 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 16 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
W20260709 13:20:30.118260 11711 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.867s	user 0.038s	sys 0.051s
I20260709 13:20:30.118963 11670 leader_election.cc:290] T 404190ce4ce94cecbfcb6ea9d1dd8626 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:20:30.137133 11675 consensus_queue.cc:237] T bd6869f07b5a4885a0b99fbe60c3b175 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.6, Last appended by leader: 6, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
W20260709 13:20:30.137979 11547 consensus_meta.cc:287] T 17587d6730594da4a56fa13a353232a1 P b7ab4784c7344b939bc36f639286f377: Time spent flushing consensus metadata: real 0.607s	user 0.013s	sys 0.000s
I20260709 13:20:30.138538 11547 raft_consensus.cc:515] T 17587d6730594da4a56fa13a353232a1 P b7ab4784c7344b939bc36f639286f377 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:20:30.141776 11742 leader_election.cc:290] T be1a92657f494cac8dd227d152f50151 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:20:30.144935 11654 leader_election.cc:290] T 22ccee1b570c4ad3a57bd7aec085b1b4 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 12 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:30.147801 11547 leader_election.cc:290] T 17587d6730594da4a56fa13a353232a1 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 19 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:20:30.148559  6803 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:32966 (request call id 1201) took 1340 ms. Trace:
I20260709 13:20:30.149084  6803 rpcz_store.cc:276] 0709 13:20:28.808446 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:28.808588 (+   142us) service_pool.cc:224] Handling call
0709 13:20:30.148356 (+1339768us) spinlock_profiling.cc:243] Waited 389 ms on lock 0x7b54001a40d4. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f9ae2fa 00007fcc1496fb17 00007fcc0deea6d4 00007fcc0deea662 00007fcc0deea591 00007fcc0deea50c 00007fcc0dee97c2 00007fcc0dce548c 00007fcc0dce48c6 00007fcc0dce426f
0709 13:20:30.148491 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":893866880}
I20260709 13:20:30.150718  6803 raft_consensus.cc:1240] T 7c44c4849aa54f2b94d1f1bef9ed546f P b7ab4784c7344b939bc36f639286f377 [term 15 LEADER]: Rejecting Update request from peer ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 14. Current term is 15. Ops: []
I20260709 13:20:30.160539  6844 leader_election.cc:304] T 44bde925b2e541b69890d70715b85176 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:20:30.162413 11789 raft_consensus.cc:2749] T 44bde925b2e541b69890d70715b85176 P cd75a17ab2604397adab03bb8b5fd75c [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:20:30.145089  6801 raft_consensus.cc:1240] T 711ef6523deb4cbe8ef2ba61e1c21c98 P b7ab4784c7344b939bc36f639286f377 [term 15 FOLLOWER]: Rejecting Update request from peer cd75a17ab2604397adab03bb8b5fd75c for earlier term 14. Current term is 15. Ops: [14.9-14.9]
I20260709 13:20:30.183709  6801 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:32966 (request call id 1220) took 1161 ms. Trace:
W20260709 13:20:30.130878 11794 log.cc:927] Time spent T fe20b4b48823486ca3b9c648db6ce8aa P ccd8a4c3bfe3413cb2ae219b09aea832: Append to log took a long time: real 0.073s	user 0.000s	sys 0.001s
I20260709 13:20:30.182219  6844 leader_election.cc:304] T 95a75bfe094d4bdc963aba3f08dfcd25 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:20:30.186635  6844 leader_election.cc:304] T d8292e16e5654be6bc408560cf256aaa P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:20:30.182879  6803 raft_consensus.cc:1240] T 3411566abe2d4c9bb4b2adfdd05e6f17 P b7ab4784c7344b939bc36f639286f377 [term 12 FOLLOWER]: Rejecting Update request from peer ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 11. Current term is 12. Ops: []
I20260709 13:20:30.184273  6801 rpcz_store.cc:276] 0709 13:20:29.022829 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:30.144547 (+1121718us) service_pool.cc:224] Handling call
0709 13:20:30.144867 (+   320us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:30.183331 (+ 38464us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:30.183635 (+   304us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:20:30.127667 11722 raft_consensus.cc:3055] T bb3d8792045a4583ae2e965b1350a5b4 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:20:30.197402  6801 raft_consensus.cc:1240] T 34f36d59d88f40fe8a2805e604fc6c0a P b7ab4784c7344b939bc36f639286f377 [term 11 FOLLOWER]: Rejecting Update request from peer ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 10. Current term is 11. Ops: []
I20260709 13:20:30.196977  6844 leader_election.cc:304] T 07a92dd554674067a83a9cb68c4773f2 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:20:30.199981  6801 raft_consensus.cc:1240] T 713b5728a197487c9300b310ab94e5a3 P b7ab4784c7344b939bc36f639286f377 [term 13 FOLLOWER]: Rejecting Update request from peer ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 12. Current term is 13. Ops: []
I20260709 13:20:30.201221  6801 raft_consensus.cc:1240] T f03d0dbf16864ca4bc1bb5e4c0334c0f P b7ab4784c7344b939bc36f639286f377 [term 13 FOLLOWER]: Rejecting Update request from peer ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 12. Current term is 13. Ops: []
I20260709 13:20:30.202018  6803 raft_consensus.cc:1240] T 853ac0a8cbd64ce99457f170216d4d0f P b7ab4784c7344b939bc36f639286f377 [term 11 FOLLOWER]: Rejecting Update request from peer ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 10. Current term is 11. Ops: []
I20260709 13:20:30.203110  6803 raft_consensus.cc:1240] T 44bde925b2e541b69890d70715b85176 P b7ab4784c7344b939bc36f639286f377 [term 14 FOLLOWER]: Rejecting Update request from peer ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 13. Current term is 14. Ops: []
I20260709 13:20:30.194651 11809 raft_consensus.cc:493] T 90d42e216d9741e190bca19a781291fd P ccd8a4c3bfe3413cb2ae219b09aea832 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:30.204480 11809 raft_consensus.cc:515] T 90d42e216d9741e190bca19a781291fd P ccd8a4c3bfe3413cb2ae219b09aea832 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:30.198982 11722 raft_consensus.cc:740] T bb3d8792045a4583ae2e965b1350a5b4 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
I20260709 13:20:30.206748 11809 leader_election.cc:290] T 90d42e216d9741e190bca19a781291fd P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:30.207253 11722 consensus_queue.cc:260] T bb3d8792045a4583ae2e965b1350a5b4 P ccd8a4c3bfe3413cb2ae219b09aea832 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:20:30.208693 11722 raft_consensus.cc:3060] T bb3d8792045a4583ae2e965b1350a5b4 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:20:30.109472 11793 consensus_queue.cc:237] T a3022224cc81473690653a83d4e99470 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 13.7, Last appended by leader: 7, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
W20260709 13:20:30.209950  6724 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50004 (request call id 2278) took 1698 ms (client timeout 2112 ms). Trace:
W20260709 13:20:30.210393  6724 rpcz_store.cc:269] 0709 13:20:28.511039 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:28.521626 (+ 10587us) service_pool.cc:224] Handling call
0709 13:20:30.209725 (+1688099us) spinlock_profiling.cc:243] Waited 639 ms on lock 0x7b54003d5754. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f9ae2fa 00007fcc1496fb17 00007fcc0deea6d4 00007fcc0deea662 00007fcc0deea591 00007fcc0deea50c 00007fcc0dee97c2 00007fcc0dce548c 00007fcc0dce48c6 00007fcc0dce426f
0709 13:20:30.209886 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1468660608}
I20260709 13:20:30.212297  6732 raft_consensus.cc:1240] T b56bf91d90824c959e21e0cee5ba1816 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 13 FOLLOWER]: Rejecting Update request from peer cd75a17ab2604397adab03bb8b5fd75c for earlier term 12. Current term is 13. Ops: []
I20260709 13:20:30.220960 11687 raft_consensus.cc:515] T 427c124d773f483294511e80fe340075 P b7ab4784c7344b939bc36f639286f377 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } attrs { replace: true } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:20:30.224133 11635 raft_consensus.cc:3055] T 853ac0a8cbd64ce99457f170216d4d0f P ccd8a4c3bfe3413cb2ae219b09aea832 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:20:30.224545 11635 raft_consensus.cc:740] T 853ac0a8cbd64ce99457f170216d4d0f P ccd8a4c3bfe3413cb2ae219b09aea832 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
I20260709 13:20:30.224718 11676 raft_consensus.cc:2764] T 07a92dd554674067a83a9cb68c4773f2 P cd75a17ab2604397adab03bb8b5fd75c [term 13 FOLLOWER]: Leader pre-election decision vote started in defunct term 12: won
I20260709 13:20:30.225421 11635 consensus_queue.cc:260] T 853ac0a8cbd64ce99457f170216d4d0f P ccd8a4c3bfe3413cb2ae219b09aea832 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:30.226471 11635 raft_consensus.cc:3060] T 853ac0a8cbd64ce99457f170216d4d0f P ccd8a4c3bfe3413cb2ae219b09aea832 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:20:30.222015 11656 leader_election.cc:290] T dbdf895bba214ff68685a24fd17dfb5d P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 12 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:30.229106 11504 raft_consensus.cc:515] T a1704639a875409b9959353527b3fd68 P b7ab4784c7344b939bc36f639286f377 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
W20260709 13:20:30.230490  6697 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 159592us
I20260709 13:20:30.231966 11504 leader_election.cc:290] T a1704639a875409b9959353527b3fd68 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 15 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:30.233928  6806 raft_consensus.cc:606] T 427c124d773f483294511e80fe340075 P b7ab4784c7344b939bc36f639286f377 [term 13 FOLLOWER]: Received request to transfer leadership to TS cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:20:30.234362  6805 raft_consensus.cc:1240] T 17587d6730594da4a56fa13a353232a1 P b7ab4784c7344b939bc36f639286f377 [term 19 FOLLOWER]: Rejecting Update request from peer ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 18. Current term is 19. Ops: []
I20260709 13:20:30.236317  6806 raft_consensus.cc:614] T 427c124d773f483294511e80fe340075 P b7ab4784c7344b939bc36f639286f377 [term 13 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:20:30.239147  6872 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58592 (request call id 398) took 1237 ms. Trace:
I20260709 13:20:30.239656  6872 rpcz_store.cc:276] 0709 13:20:29.002111 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:29.007939 (+  5828us) service_pool.cc:224] Handling call
0709 13:20:30.238975 (+1231036us) spinlock_profiling.cc:243] Waited 404 ms on lock 0x7b54002189d4. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f9ae2fa 00007fcc1496fb17 00007fcc0deea6d4 00007fcc0deea662 00007fcc0deea591 00007fcc0deea50c 00007fcc0dee97c2 00007fcc0dce548c 00007fcc0dce48c6 00007fcc0dce426f
0709 13:20:30.239083 (+   108us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":930088320}
I20260709 13:20:30.242307  6872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4b8bd455d5a47c18a1380839c6e0d61" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 13 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:20:30.242985  7498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17587d6730594da4a56fa13a353232a1" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb"
I20260709 13:20:30.243703  7498 raft_consensus.cc:3060] T 17587d6730594da4a56fa13a353232a1 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:20:30.205101 11751 raft_consensus.cc:515] T 7c37d41cd9164c15a6826ca62a851a69 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:30.245721  6872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3022224cc81473690653a83d4e99470" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:20:30.246731  6726 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49998 (request call id 1184) took 1133 ms. Trace:
I20260709 13:20:30.247174  6726 rpcz_store.cc:276] 0709 13:20:29.112904 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:29.117600 (+  4696us) service_pool.cc:224] Handling call
0709 13:20:30.246572 (+1128972us) spinlock_profiling.cc:243] Waited 138 ms on lock 0x7b540008e154. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f9ae2fa 00007fcc1496fb17 00007fcc0deea6d4 00007fcc0deea662 00007fcc0deea591 00007fcc0deea50c 00007fcc0dee97c2 00007fcc0dce548c 00007fcc0dce48c6 00007fcc0dce426f
0709 13:20:30.246670 (+    98us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":316294400}
I20260709 13:20:30.250038  7466 leader_election.cc:304] T ce4f062dcd314d43a63ca74067cb5ee3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
I20260709 13:20:30.251183 11611 raft_consensus.cc:2804] T ce4f062dcd314d43a63ca74067cb5ee3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:20:30.251806 11611 raft_consensus.cc:697] T ce4f062dcd314d43a63ca74067cb5ee3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 14 LEADER]: Becoming Leader. State: Replica: 7ba59cc884714e8aa5f3f0ecaed84cbb, State: Running, Role: LEADER
I20260709 13:20:30.252842  6872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d65025eea89441290d85dd053810e31" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:30.252962 11611 consensus_queue.cc:237] T ce4f062dcd314d43a63ca74067cb5ee3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.9, Last appended by leader: 9, Current term: 14, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } attrs { replace: true } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:20:30.253666 11687 leader_election.cc:290] T 427c124d773f483294511e80fe340075 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 13 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:20:30.256958  6872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab432e62819d499eaaf3dd55481dd930" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:30.257776  6872 raft_consensus.cc:2468] T ab432e62819d499eaaf3dd55481dd930 P cd75a17ab2604397adab03bb8b5fd75c [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 15.
I20260709 13:20:30.261976  7500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "404190ce4ce94cecbfcb6ea9d1dd8626" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:20:30.262319 11782 leader_election.cc:290] T 30e88460611e47b2ba16a46a30b5f416 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:30.262532  6800 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:32966 (request call id 1203) took 1448 ms. Trace:
I20260709 13:20:30.267520  6877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d9def8b32fd443aa94ab1420b06837b" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:30.270241  6876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22ccee1b570c4ad3a57bd7aec085b1b4" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:20:30.270578  6874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b56bf91d90824c959e21e0cee5ba1816" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:20:30.271260  6876 raft_consensus.cc:2393] T 22ccee1b570c4ad3a57bd7aec085b1b4 P cd75a17ab2604397adab03bb8b5fd75c [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate ccd8a4c3bfe3413cb2ae219b09aea832 in current term 11: Already voted for candidate cd75a17ab2604397adab03bb8b5fd75c in this term.
I20260709 13:20:30.273514  6874 raft_consensus.cc:3060] T f5be3a11b23d4ea9b08300a2789821c7 P cd75a17ab2604397adab03bb8b5fd75c [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:20:30.264796  6800 rpcz_store.cc:276] 0709 13:20:28.815813 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:29.107211 (+291398us) service_pool.cc:224] Handling call
0709 13:20:30.262353 (+1155142us) spinlock_profiling.cc:243] Waited 40.1 ms on lock 0x7b5400289bd4. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f9ae2fa 00007fcc1496fb17 00007fcc0deea6d4 00007fcc0deea662 00007fcc0deea591 00007fcc0deea50c 00007fcc0dee97c2 00007fcc0dce548c 00007fcc0dce48c6 00007fcc0dce426f
0709 13:20:30.262474 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":92339456}
I20260709 13:20:30.276966  6800 raft_consensus.cc:1240] T 2c240553ce044eedb41541d72b9475d7 P b7ab4784c7344b939bc36f639286f377 [term 15 FOLLOWER]: Rejecting Update request from peer ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 14. Current term is 15. Ops: []
I20260709 13:20:30.276988  6878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f58dc08b12a2494bb9a1372837970ca2" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:30.281023  6876 raft_consensus.cc:1240] T f09c2a98de1a4decabd0ff900dd44caa P cd75a17ab2604397adab03bb8b5fd75c [term 15 LEADER]: Rejecting Update request from peer ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 14. Current term is 15. Ops: [14.9-14.9]
I20260709 13:20:30.283210  7498 raft_consensus.cc:2468] T 17587d6730594da4a56fa13a353232a1 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 19.
I20260709 13:20:30.192251 11808 raft_consensus.cc:493] T 4b8cacb381b746da8d0049b0a83b41dd P ccd8a4c3bfe3413cb2ae219b09aea832 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 7ba59cc884714e8aa5f3f0ecaed84cbb)
I20260709 13:20:30.306903  6873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d33d5ee8ef6f415593d8df52063161ad" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:30.301149  7495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be1a92657f494cac8dd227d152f50151" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:20:30.302284  7503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "404190ce4ce94cecbfcb6ea9d1dd8626" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:20:30.304637  6805 raft_consensus.cc:1275] T f5be3a11b23d4ea9b08300a2789821c7 P b7ab4784c7344b939bc36f639286f377 [term 12 FOLLOWER]: Refusing update from remote peer ccd8a4c3bfe3413cb2ae219b09aea832: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:20:30.305476  7496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3f13b31a1f84f0d89d007eadd57924c" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:20:30.242301 11772 raft_consensus.cc:493] T a1704639a875409b9959353527b3fd68 P cd75a17ab2604397adab03bb8b5fd75c [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:30.239327 11789 raft_consensus.cc:2749] T d8292e16e5654be6bc408560cf256aaa P cd75a17ab2604397adab03bb8b5fd75c [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:20:30.241472 11524 raft_consensus.cc:2749] T 95a75bfe094d4bdc963aba3f08dfcd25 P cd75a17ab2604397adab03bb8b5fd75c [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:20:30.312328  6770 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:30.319000  6875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f9c2e2bf644115957398fe4c9459db" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:30.312614  6877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30e88460611e47b2ba16a46a30b5f416" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
W20260709 13:20:30.301452  7466 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.5.126.65:44391 timed out after 1.798s (SENT) [suppressed 2 similar messages]
I20260709 13:20:30.317170  6772 leader_election.cc:304] T 17587d6730594da4a56fa13a353232a1 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, b7ab4784c7344b939bc36f639286f377; no voters: 
I20260709 13:20:30.320125  6877 raft_consensus.cc:2468] T 30e88460611e47b2ba16a46a30b5f416 P cd75a17ab2604397adab03bb8b5fd75c [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 12.
I20260709 13:20:30.120086 11810 consensus_queue.cc:260] T e77e330a82df4b43a745d57a68f6f057 P ccd8a4c3bfe3413cb2ae219b09aea832 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.7, Last appended by leader: 7, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } }
I20260709 13:20:30.325173  6872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a734b5ab7834e05a8c422208acc58b1" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 14 candidate_status { last_received { term: 13 index: 5 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:30.326359  6872 raft_consensus.cc:2393] T 7a734b5ab7834e05a8c422208acc58b1 P cd75a17ab2604397adab03bb8b5fd75c [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ccd8a4c3bfe3413cb2ae219b09aea832 in current term 14: Already voted for candidate cd75a17ab2604397adab03bb8b5fd75c in this term.
I20260709 13:20:30.332228  6800 raft_consensus.cc:1240] T 427c124d773f483294511e80fe340075 P b7ab4784c7344b939bc36f639286f377 [term 13 FOLLOWER]: Rejecting Update request from peer 7ba59cc884714e8aa5f3f0ecaed84cbb for earlier term 12. Current term is 13. Ops: [12.9-12.9]
I20260709 13:20:30.316919  6874 raft_consensus.cc:1275] T f5be3a11b23d4ea9b08300a2789821c7 P cd75a17ab2604397adab03bb8b5fd75c [term 12 FOLLOWER]: Refusing update from remote peer ccd8a4c3bfe3413cb2ae219b09aea832: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:20:30.239202 11777 consensus_queue.cc:1059] T 7ba5dac66ab5497e9e336f2a3c28cda5 P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.076s
I20260709 13:20:30.177181 11561 consensus_queue.cc:237] T f3f9c2e2bf644115957398fe4c9459db P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:30.311913 11803 raft_consensus.cc:493] T 20f6842e26174571996b8dea4151d4be P cd75a17ab2604397adab03bb8b5fd75c [term 15 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:20:30.404192  6725 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49744 (request call id 509) took 1033 ms. Trace:
I20260709 13:20:30.318578 11588 raft_consensus.cc:493] T de3186201e1a40d0b335eeb8b4e256e0 P b7ab4784c7344b939bc36f639286f377 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:20:30.365307 11066 raft_consensus.cc:493] T 713b5728a197487c9300b310ab94e5a3 P cd75a17ab2604397adab03bb8b5fd75c [term 12 FOLLOWER]: Starting pre-election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:20:30.369220 11749 raft_consensus.cc:493] T f5be3a11b23d4ea9b08300a2789821c7 P b7ab4784c7344b939bc36f639286f377 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:20:30.372242  6772 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.68:45071, user_credentials={real_user=slave}} blocked reactor thread for 55154.8us
I20260709 13:20:30.384070  6874 raft_consensus.cc:1240] T 2c240553ce044eedb41541d72b9475d7 P cd75a17ab2604397adab03bb8b5fd75c [term 15 FOLLOWER]: Rejecting Update request from peer ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 14. Current term is 15. Ops: [14.8-14.8]
I20260709 13:20:30.374370  6844 leader_election.cc:304] T 8c7f33e544204fbaac4078e3e83bbf4e P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: ccd8a4c3bfe3413cb2ae219b09aea832
W20260709 13:20:30.397616 11678 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.861s	user 0.013s	sys 0.016s
I20260709 13:20:30.366952 11657 raft_consensus.cc:493] T d8cee0accdb8499c86d4414b72565a38 P b7ab4784c7344b939bc36f639286f377 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 7ba59cc884714e8aa5f3f0ecaed84cbb)
I20260709 13:20:30.401479  6878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90d42e216d9741e190bca19a781291fd" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 14 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:30.417328  6878 raft_consensus.cc:2410] T 90d42e216d9741e190bca19a781291fd P cd75a17ab2604397adab03bb8b5fd75c [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ccd8a4c3bfe3413cb2ae219b09aea832 for term 14 because replica has last-logged OpId of term: 12 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 6.
I20260709 13:20:30.406275  6875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fa34c08b205435dba97346991aa1f92" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:20:30.327970 11576 raft_consensus.cc:493] T 4b8cacb381b746da8d0049b0a83b41dd P cd75a17ab2604397adab03bb8b5fd75c [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 7ba59cc884714e8aa5f3f0ecaed84cbb)
I20260709 13:20:30.422294  6874 raft_consensus.cc:1217] T 853ac0a8cbd64ce99457f170216d4d0f P cd75a17ab2604397adab03bb8b5fd75c [term 11 FOLLOWER]: Deduplicated request from leader. Original: 6.4->[8.5-10.6]   Dedup: 8.5->[10.6-10.6]
I20260709 13:20:30.407593 11752 raft_consensus.cc:2804] T 17587d6730594da4a56fa13a353232a1 P b7ab4784c7344b939bc36f639286f377 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:20:30.433570  6874 raft_consensus.cc:1240] T 853ac0a8cbd64ce99457f170216d4d0f P cd75a17ab2604397adab03bb8b5fd75c [term 11 FOLLOWER]: Rejecting Update request from peer ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 10. Current term is 11. Ops: [8.5-10.6]
I20260709 13:20:30.370539  6800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c44c4849aa54f2b94d1f1bef9ed546f" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
W20260709 13:20:30.416302 11678 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.879s	user 0.014s	sys 0.017s
I20260709 13:20:30.434263  6801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a485a995abc4807b6e511e45419f737" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:20:30.391955 11666 raft_consensus.cc:493] T bb7fa124c3bf4ef9ab65a407cb008441 P b7ab4784c7344b939bc36f639286f377 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 7ba59cc884714e8aa5f3f0ecaed84cbb)
I20260709 13:20:30.440626  6800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5be3a11b23d4ea9b08300a2789821c7" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
W20260709 13:20:30.443626  7466 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 142211us
I20260709 13:20:30.376904  6770 leader_election.cc:304] T 3d65025eea89441290d85dd053810e31 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
W20260709 13:20:30.447084  6770 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 70280.2us
W20260709 13:20:30.450555  6697 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:30.420950 11524 raft_consensus.cc:2764] T 8c7f33e544204fbaac4078e3e83bbf4e P cd75a17ab2604397adab03bb8b5fd75c [term 11 FOLLOWER]: Leader pre-election decision vote started in defunct term 10: won
I20260709 13:20:30.481441  6801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a734b5ab7834e05a8c422208acc58b1" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 14 candidate_status { last_received { term: 13 index: 5 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:20:30.497984  6875 raft_consensus.cc:1240] T 3411566abe2d4c9bb4b2adfdd05e6f17 P cd75a17ab2604397adab03bb8b5fd75c [term 12 FOLLOWER]: Rejecting Update request from peer ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 11. Current term is 12. Ops: [9.6-11.7]
I20260709 13:20:30.430840 11777 raft_consensus.cc:493] T c4db81d9d329422bb3b4160ca4ac2d1d P cd75a17ab2604397adab03bb8b5fd75c [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
W20260709 13:20:30.499723  6695 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:30.438189 11797 raft_consensus.cc:493] T f03d0dbf16864ca4bc1bb5e4c0334c0f P cd75a17ab2604397adab03bb8b5fd75c [term 12 FOLLOWER]: Starting pre-election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:20:30.416498 11588 raft_consensus.cc:515] T de3186201e1a40d0b335eeb8b4e256e0 P b7ab4784c7344b939bc36f639286f377 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
W20260709 13:20:30.505268  7466 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 48783.8us
W20260709 13:20:30.507004  6770 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 58623.3us
I20260709 13:20:30.421482 11066 raft_consensus.cc:515] T 713b5728a197487c9300b310ab94e5a3 P cd75a17ab2604397adab03bb8b5fd75c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:30.508927  6697 leader_election.cc:400] T bb3d8792045a4583ae2e965b1350a5b4 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 11 election: Vote denied by peer 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071) with higher term. Message: Invalid argument: T bb3d8792045a4583ae2e965b1350a5b4 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 11. Current term is 12.
I20260709 13:20:30.454629 11752 raft_consensus.cc:697] T 17587d6730594da4a56fa13a353232a1 P b7ab4784c7344b939bc36f639286f377 [term 19 LEADER]: Becoming Leader. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
I20260709 13:20:30.457432 11547 raft_consensus.cc:2804] T 3d65025eea89441290d85dd053810e31 P b7ab4784c7344b939bc36f639286f377 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:20:30.430636 11657 raft_consensus.cc:515] T d8cee0accdb8499c86d4414b72565a38 P b7ab4784c7344b939bc36f639286f377 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:20:30.516644  6801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f9c2e2bf644115957398fe4c9459db" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:20:30.435467 11576 raft_consensus.cc:515] T 4b8cacb381b746da8d0049b0a83b41dd P cd75a17ab2604397adab03bb8b5fd75c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
W20260709 13:20:30.525597 11659 consensus_meta.cc:287] T 3a485a995abc4807b6e511e45419f737 P ccd8a4c3bfe3413cb2ae219b09aea832: Time spent flushing consensus metadata: real 0.976s	user 0.012s	sys 0.005s
I20260709 13:20:30.454617 11774 consensus_queue.cc:1059] T 427c124d773f483294511e80fe340075 P 7ba59cc884714e8aa5f3f0ecaed84cbb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: INVALID_TERM, Last received: 10.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.063s
I20260709 13:20:30.585748  7495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1528ab62b6fe4e3099d08f141afee116" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
W20260709 13:20:30.589206  6698 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:30.453706 11666 raft_consensus.cc:515] T bb7fa124c3bf4ef9ab65a407cb008441 P b7ab4784c7344b939bc36f639286f377 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:20:30.593873  6844 leader_election.cc:304] T 7c44c4849aa54f2b94d1f1bef9ed546f P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:20:30.596832  6801 raft_consensus.cc:3060] T f3f9c2e2bf644115957398fe4c9459db P b7ab4784c7344b939bc36f639286f377 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:30.514525 11675 raft_consensus.cc:3055] T 2c240553ce044eedb41541d72b9475d7 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 14 LEADER]: Stepping down as leader of term 14
W20260709 13:20:30.602569  6678 auto_rebalancer.cc:629] Failed to schedule move for tablet f3f9c2e2bf644115957398fe4c9459db: Illegal state: Replica b7ab4784c7344b939bc36f639286f377 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 12 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } }
W20260709 13:20:30.605263 11700 consensus_meta.cc:287] T 24ee15416e3145beaa1b8183453729a3 P cd75a17ab2604397adab03bb8b5fd75c: Time spent flushing consensus metadata: real 0.782s	user 0.011s	sys 0.000s
I20260709 13:20:30.423709 11749 raft_consensus.cc:515] T f5be3a11b23d4ea9b08300a2789821c7 P b7ab4784c7344b939bc36f639286f377 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:30.607286 11576 leader_election.cc:290] T 4b8cacb381b746da8d0049b0a83b41dd P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
W20260709 13:20:30.607946 11828 log.cc:927] Time spent T ce4f062dcd314d43a63ca74067cb5ee3 P 7ba59cc884714e8aa5f3f0ecaed84cbb: Append to log took a long time: real 0.102s	user 0.001s	sys 0.000s
W20260709 13:20:30.608924 11821 log.cc:927] Time spent T be1a92657f494cac8dd227d152f50151 P ccd8a4c3bfe3413cb2ae219b09aea832: Append to log took a long time: real 0.097s	user 0.000s	sys 0.000s
I20260709 13:20:30.610378  6802 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:32966 (request call id 1209) took 1792 ms. Trace:
I20260709 13:20:30.501226 11815 consensus_queue.cc:1048] T 17587d6730594da4a56fa13a353232a1 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.094s
I20260709 13:20:30.612066 11751 leader_election.cc:290] T 7c37d41cd9164c15a6826ca62a851a69 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 14 election: Requested vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
W20260709 13:20:30.614054 11825 log.cc:927] Time spent T 95a75bfe094d4bdc963aba3f08dfcd25 P b7ab4784c7344b939bc36f639286f377: Append to log took a long time: real 0.177s	user 0.000s	sys 0.001s
I20260709 13:20:30.621471 11066 leader_election.cc:290] T 713b5728a197487c9300b310ab94e5a3 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
W20260709 13:20:30.626147  6773 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:30.593233 11670 consensus_queue.cc:1048] T 4275cf08e63345f993bce8664eada830 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.035s
I20260709 13:20:30.628005  6727 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49744 (request call id 505) took 1279 ms. Trace:
W20260709 13:20:30.632455  6697 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.68:45071, user_credentials={real_user=slave}} blocked reactor thread for 176911us
I20260709 13:20:30.636052 11657 leader_election.cc:290] T d8cee0accdb8499c86d4414b72565a38 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:20:30.583343 11777 raft_consensus.cc:515] T c4db81d9d329422bb3b4160ca4ac2d1d P cd75a17ab2604397adab03bb8b5fd75c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
W20260709 13:20:30.642217 11798 consensus_meta.cc:287] T 4f00a2e87e56452083b759f60d461ee3 P b7ab4784c7344b939bc36f639286f377: Time spent flushing consensus metadata: real 0.582s	user 0.010s	sys 0.000s
I20260709 13:20:30.733645  6729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "853ac0a8cbd64ce99457f170216d4d0f" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:30.734555  6729 raft_consensus.cc:2468] T 853ac0a8cbd64ce99457f170216d4d0f P ccd8a4c3bfe3413cb2ae219b09aea832 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 11.
I20260709 13:20:30.735769  6729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be1a92657f494cac8dd227d152f50151" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:30.737162  6729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "404190ce4ce94cecbfcb6ea9d1dd8626" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:30.737978 11777 leader_election.cc:290] T c4db81d9d329422bb3b4160ca4ac2d1d P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:20:30.661080 11659 raft_consensus.cc:515] T 3a485a995abc4807b6e511e45419f737 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:30.738404  6729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a75bfe094d4bdc963aba3f08dfcd25" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:30.739677  6729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "427c124d773f483294511e80fe340075" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:20:30.740267 11659 leader_election.cc:290] T 3a485a995abc4807b6e511e45419f737 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 13 election: Requested vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:30.740801  6729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbdf895bba214ff68685a24fd17dfb5d" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 12 candidate_status { last_received { term: 10 index: 4 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:20:30.741640  7501 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50756 (request call id 350) took 1471 ms. Trace:
I20260709 13:20:30.742190  7501 rpcz_store.cc:276] 0709 13:20:29.270458 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:29.278783 (+  8325us) service_pool.cc:224] Handling call
0709 13:20:29.309681 (+ 30898us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:29.891155 (+581474us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:30.741342 (+850187us) spinlock_profiling.cc:243] Waited 575 ms on lock 0x7b54001ec8d4. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f9aae01 00007fcc0f9a983e 00007fcc1496e419 00007fcc0dee5bd4 00007fcc0dee5b62 00007fcc0dee5a91 00007fcc0dee5a0c 00007fcc0dee4cc2 00007fcc0dce548c 00007fcc0dce48c6
0709 13:20:30.741556 (+   214us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1321648000}
W20260709 13:20:30.743108 11795 consensus_meta.cc:287] T 4d9def8b32fd443aa94ab1420b06837b P ccd8a4c3bfe3413cb2ae219b09aea832: Time spent flushing consensus metadata: real 0.685s	user 0.011s	sys 0.000s
I20260709 13:20:30.588506 11711 raft_consensus.cc:493] T 1bf4668eeb70467fb3dc5a0289233b3c P cd75a17ab2604397adab03bb8b5fd75c [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:20:30.684427 11675 raft_consensus.cc:740] T 2c240553ce044eedb41541d72b9475d7 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
I20260709 13:20:30.591189 11547 raft_consensus.cc:493] T 3d65025eea89441290d85dd053810e31 P b7ab4784c7344b939bc36f639286f377 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:20:30.644227 11816 log.cc:927] Time spent T dbdf895bba214ff68685a24fd17dfb5d P cd75a17ab2604397adab03bb8b5fd75c: Append to log took a long time: real 0.138s	user 0.000s	sys 0.000s
I20260709 13:20:30.645076 11636 leader_election.cc:290] T 30e88460611e47b2ba16a46a30b5f416 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
W20260709 13:20:30.652855  6695 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:30.655686  6772 leader_election.cc:304] T 44bde925b2e541b69890d70715b85176 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:20:30.316968 11808 raft_consensus.cc:515] T 4b8cacb381b746da8d0049b0a83b41dd P ccd8a4c3bfe3413cb2ae219b09aea832 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:20:30.411474 11803 raft_consensus.cc:515] T 20f6842e26174571996b8dea4151d4be P cd75a17ab2604397adab03bb8b5fd75c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
W20260709 13:20:30.679064  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 85324.4us
I20260709 13:20:30.680481  6876 raft_consensus.cc:1275] T ab432e62819d499eaaf3dd55481dd930 P cd75a17ab2604397adab03bb8b5fd75c [term 15 FOLLOWER]: Refusing update from remote peer b7ab4784c7344b939bc36f639286f377: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 13:20:30.764292  6876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90d42e216d9741e190bca19a781291fd" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
W20260709 13:20:30.764561  6772 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 108962us
I20260709 13:20:30.764875  6876 raft_consensus.cc:3060] T 90d42e216d9741e190bca19a781291fd P cd75a17ab2604397adab03bb8b5fd75c [term 12 FOLLOWER]: Advancing to term 14
I20260709 13:20:30.323971 11772 raft_consensus.cc:515] T a1704639a875409b9959353527b3fd68 P cd75a17ab2604397adab03bb8b5fd75c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:30.690325  6724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90d42e216d9741e190bca19a781291fd" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:20:30.773120  6724 raft_consensus.cc:3060] T 90d42e216d9741e190bca19a781291fd P ccd8a4c3bfe3413cb2ae219b09aea832 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:30.660215 11504 raft_consensus.cc:493] T ce4f062dcd314d43a63ca74067cb5ee3 P b7ab4784c7344b939bc36f639286f377 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:30.691118  6726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17587d6730594da4a56fa13a353232a1" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:20:30.661206 11781 raft_consensus.cc:493] T 4275cf08e63345f993bce8664eada830 P cd75a17ab2604397adab03bb8b5fd75c [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:30.691918 11700 raft_consensus.cc:515] T 24ee15416e3145beaa1b8183453729a3 P cd75a17ab2604397adab03bb8b5fd75c [term 17 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:20:30.693758  6728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8292e16e5654be6bc408560cf256aaa" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:30.618273 11752 consensus_queue.cc:237] T 17587d6730594da4a56fa13a353232a1 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.12, Last appended by leader: 12, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
W20260709 13:20:30.700218  6807 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:32966 (request call id 1202) took 1889 ms (client timeout 1895 ms). Trace:
W20260709 13:20:30.831974  6807 rpcz_store.cc:269] 0709 13:20:28.814040 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:29.016443 (+202403us) service_pool.cc:224] Handling call
0709 13:20:30.699880 (+1683437us) spinlock_profiling.cc:243] Waited 180 ms on lock 0x7b54001cacd4. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f9ae2fa 00007fcc1496fb17 00007fcc0deea6d4 00007fcc0deea662 00007fcc0deea591 00007fcc0deea50c 00007fcc0dee97c2 00007fcc0dce548c 00007fcc0dce48c6 00007fcc0dce426f
0709 13:20:30.700130 (+   250us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":414262528}
I20260709 13:20:30.711292  6802 rpcz_store.cc:276] 0709 13:20:28.817611 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:30.127521 (+1309910us) service_pool.cc:224] Handling call
0709 13:20:30.140454 (+ 12933us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:30.140870 (+   416us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:30.140903 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:20:30.141486 (+   583us) log.cc:844] Serialized 26 byte log entry
0709 13:20:30.451914 (+310428us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:20:30.452082 (+   168us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:30.452354 (+   272us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:30.610005 (+157651us) raft_consensus.cc:1685] finished
0709 13:20:30.610035 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:30.610292 (+   257us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":132,"raft.run_cpu_time_us":98,"raft.run_wall_time_us":101,"thread_start_us":309190,"threads_started":1,"wal-append.queue_time_us":443948}
I20260709 13:20:30.714635  6877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "853ac0a8cbd64ce99457f170216d4d0f" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:30.723230  6697 leader_election.cc:304] T 3fa34c08b205435dba97346991aa1f92 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:20:30.724730  6800 raft_consensus.cc:2393] T f5be3a11b23d4ea9b08300a2789821c7 P b7ab4784c7344b939bc36f639286f377 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c in current term 12: Already voted for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in this term.
I20260709 13:20:30.684662 11561 raft_consensus.cc:2749] T 7c44c4849aa54f2b94d1f1bef9ed546f P cd75a17ab2604397adab03bb8b5fd75c [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:20:30.834131  6877 raft_consensus.cc:2468] T 853ac0a8cbd64ce99457f170216d4d0f P cd75a17ab2604397adab03bb8b5fd75c [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 11.
I20260709 13:20:30.722033  6727 rpcz_store.cc:276] 0709 13:20:29.348809 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:30.113043 (+764234us) service_pool.cc:224] Handling call
0709 13:20:30.113293 (+   250us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:30.129946 (+ 16653us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:30.129993 (+    47us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:20:30.192999 (+ 63006us) log.cc:844] Serialized 26 byte log entry
0709 13:20:30.511894 (+318895us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:20:30.511934 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:30.512002 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:30.627650 (+115648us) raft_consensus.cc:1685] finished
0709 13:20:30.627683 (+    33us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:30.627910 (+   227us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":16261,"raft.queue_time_us":19598,"raft.run_cpu_time_us":134,"raft.run_wall_time_us":31608,"thread_start_us":211088,"threads_started":1,"wal-append.queue_time_us":382492}
I20260709 13:20:30.835264  6727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30e88460611e47b2ba16a46a30b5f416" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 13 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
W20260709 13:20:30.746850  6770 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:30.836143  6727 raft_consensus.cc:2410] T 30e88460611e47b2ba16a46a30b5f416 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7ab4784c7344b939bc36f639286f377 for term 13 because replica has last-logged OpId of term: 11 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 5.
I20260709 13:20:30.841270 11675 consensus_queue.cc:260] T 2c240553ce044eedb41541d72b9475d7 P ccd8a4c3bfe3413cb2ae219b09aea832 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:30.842656 11675 raft_consensus.cc:3060] T 2c240553ce044eedb41541d72b9475d7 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:30.593940 11797 raft_consensus.cc:515] T f03d0dbf16864ca4bc1bb5e4c0334c0f P cd75a17ab2604397adab03bb8b5fd75c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:30.741645  6729 raft_consensus.cc:2393] T dbdf895bba214ff68685a24fd17dfb5d P ccd8a4c3bfe3413cb2ae219b09aea832 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate b7ab4784c7344b939bc36f639286f377 in current term 12: Already voted for candidate cd75a17ab2604397adab03bb8b5fd75c in this term.
I20260709 13:20:30.845899  6729 raft_consensus.cc:3055] T 9e326172347f45e99a0d482b5d8ef768 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:20:30.846385  6729 raft_consensus.cc:740] T 9e326172347f45e99a0d482b5d8ef768 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
I20260709 13:20:30.847038 11797 leader_election.cc:290] T f03d0dbf16864ca4bc1bb5e4c0334c0f P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:20:30.765367  6772 leader_election.cc:304] T 713b5728a197487c9300b310ab94e5a3 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:20:30.713632 11588 leader_election.cc:290] T de3186201e1a40d0b335eeb8b4e256e0 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
W20260709 13:20:30.848269  6772 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 82983us
I20260709 13:20:30.848491 11588 raft_consensus.cc:2749] T 713b5728a197487c9300b310ab94e5a3 P b7ab4784c7344b939bc36f639286f377 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:20:30.849036  6875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22ccee1b570c4ad3a57bd7aec085b1b4" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:20:30.849715  6875 raft_consensus.cc:3060] T 22ccee1b570c4ad3a57bd7aec085b1b4 P cd75a17ab2604397adab03bb8b5fd75c [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:20:30.849936  6772 leader_election.cc:304] T 3411566abe2d4c9bb4b2adfdd05e6f17 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:20:30.851215  6772 leader_election.cc:304] T 2c240553ce044eedb41541d72b9475d7 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:20:30.743849 11711 raft_consensus.cc:515] T 1bf4668eeb70467fb3dc5a0289233b3c P cd75a17ab2604397adab03bb8b5fd75c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:30.847373  6729 consensus_queue.cc:260] T 9e326172347f45e99a0d482b5d8ef768 P ccd8a4c3bfe3413cb2ae219b09aea832 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:30.853042  6729 raft_consensus.cc:3060] T 9e326172347f45e99a0d482b5d8ef768 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:20:30.721530 11774 consensus_queue.cc:1048] T 24ee15416e3145beaa1b8183453729a3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.051s
I20260709 13:20:30.853427 11808 leader_election.cc:290] T 4b8cacb381b746da8d0049b0a83b41dd P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:20:30.779345 11798 raft_consensus.cc:2749] T 44bde925b2e541b69890d70715b85176 P b7ab4784c7344b939bc36f639286f377 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:20:30.815826 11504 raft_consensus.cc:515] T ce4f062dcd314d43a63ca74067cb5ee3 P b7ab4784c7344b939bc36f639286f377 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } attrs { replace: true } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:20:30.757333 11547 raft_consensus.cc:3060] T 3d65025eea89441290d85dd053810e31 P b7ab4784c7344b939bc36f639286f377 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:30.835178  6877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8292e16e5654be6bc408560cf256aaa" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
W20260709 13:20:30.841913  6696 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:30.853101  6802 raft_consensus.cc:1275] T f09c2a98de1a4decabd0ff900dd44caa P b7ab4784c7344b939bc36f639286f377 [term 15 FOLLOWER]: Refusing update from remote peer cd75a17ab2604397adab03bb8b5fd75c: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:20:30.743639 11795 raft_consensus.cc:515] T 4d9def8b32fd443aa94ab1420b06837b P ccd8a4c3bfe3413cb2ae219b09aea832 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:30.860651  6881 raft_consensus.cc:1240] T 24ee15416e3145beaa1b8183453729a3 P cd75a17ab2604397adab03bb8b5fd75c [term 17 FOLLOWER]: Rejecting Update request from peer 7ba59cc884714e8aa5f3f0ecaed84cbb for earlier term 16. Current term is 17. Ops: []
I20260709 13:20:30.673518 11786 raft_consensus.cc:493] T 9e326172347f45e99a0d482b5d8ef768 P cd75a17ab2604397adab03bb8b5fd75c [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:30.830197  6726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1704639a875409b9959353527b3fd68" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:20:30.880084  6801 raft_consensus.cc:2468] T f3f9c2e2bf644115957398fe4c9459db P b7ab4784c7344b939bc36f639286f377 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 13.
I20260709 13:20:30.886713  6877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8cee0accdb8499c86d4414b72565a38" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:30.889189  6728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de3186201e1a40d0b335eeb8b4e256e0" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:30.890694  6801 raft_consensus.cc:1275] T 4f00a2e87e56452083b759f60d461ee3 P b7ab4784c7344b939bc36f639286f377 [term 14 FOLLOWER]: Refusing update from remote peer 7ba59cc884714e8aa5f3f0ecaed84cbb: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 14 index: 10. (term mismatch)
I20260709 13:20:30.891285  6801 pending_rounds.cc:85] T 4f00a2e87e56452083b759f60d461ee3 P b7ab4784c7344b939bc36f639286f377: Aborting all ops after (but not including) 9
I20260709 13:20:30.891752  6801 pending_rounds.cc:107] T 4f00a2e87e56452083b759f60d461ee3 P b7ab4784c7344b939bc36f639286f377: Aborting uncommitted NO_OP operation due to leader change: 13.10
I20260709 13:20:30.892663  6801 raft_consensus.cc:2889] T 4f00a2e87e56452083b759f60d461ee3 P b7ab4784c7344b939bc36f639286f377 [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:20:30.893013  6874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a75bfe094d4bdc963aba3f08dfcd25" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:30.901168 11803 leader_election.cc:290] T 20f6842e26174571996b8dea4151d4be P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:20:30.862399  6803 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:32976 (request call id 3039) took 1104 ms. Trace:
I20260709 13:20:30.861965  6876 raft_consensus.cc:2468] T 90d42e216d9741e190bca19a781291fd P cd75a17ab2604397adab03bb8b5fd75c [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 14.
I20260709 13:20:30.905330  6876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbdf895bba214ff68685a24fd17dfb5d" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 12 candidate_status { last_received { term: 10 index: 4 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:20:30.853441 11711 leader_election.cc:290] T 1bf4668eeb70467fb3dc5a0289233b3c P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:20:30.935148  7495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8cee0accdb8499c86d4414b72565a38" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:20:30.861925  6724 raft_consensus.cc:2468] T 90d42e216d9741e190bca19a781291fd P ccd8a4c3bfe3413cb2ae219b09aea832 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 14.
I20260709 13:20:30.929034  6880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30e88460611e47b2ba16a46a30b5f416" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 13 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:30.938715  6874 raft_consensus.cc:1240] T 3a485a995abc4807b6e511e45419f737 P cd75a17ab2604397adab03bb8b5fd75c [term 13 FOLLOWER]: Rejecting Update request from peer b7ab4784c7344b939bc36f639286f377 for earlier term 12. Current term is 13. Ops: []
I20260709 13:20:30.907824  6876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1704639a875409b9959353527b3fd68" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:20:30.830997 11781 raft_consensus.cc:515] T 4275cf08e63345f993bce8664eada830 P cd75a17ab2604397adab03bb8b5fd75c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:30.913434  6772 leader_election.cc:304] T 853ac0a8cbd64ce99457f170216d4d0f P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:20:30.921214  6728 raft_consensus.cc:1240] T 3a485a995abc4807b6e511e45419f737 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 13 FOLLOWER]: Rejecting Update request from peer b7ab4784c7344b939bc36f639286f377 for earlier term 12. Current term is 13. Ops: []
I20260709 13:20:30.921837 11657 consensus_queue.cc:1048] T ab432e62819d499eaaf3dd55481dd930 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:20:30.923298 11749 leader_election.cc:290] T f5be3a11b23d4ea9b08300a2789821c7 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:30.940711  6803 rpcz_store.cc:276] 0709 13:20:29.757624 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:30.203746 (+446122us) service_pool.cc:224] Handling call
0709 13:20:30.204023 (+   277us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:30.265463 (+ 61440us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:20:30.323101 (+ 57638us) log.cc:844] Serialized 14 byte log entry
0709 13:20:30.824271 (+501170us) log.cc:844] Serialized 14 byte log entry
0709 13:20:30.825267 (+   996us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:20:30.825964 (+   697us) log.cc:844] Serialized 26 byte log entry
0709 13:20:30.826163 (+   199us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:20:30.826212 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:30.826319 (+   107us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:30.862080 (+ 35761us) raft_consensus.cc:1685] finished
0709 13:20:30.862109 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:30.862317 (+   208us) inbound_call.cc:177] Queueing success response
0709 13:20:30.898668 (+ 36351us) spinlock_profiling.cc:243] Waited 6.37 ms on lock 0x7b4800061ed8. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc148d3aa1 00007fcc148cab37 00007fcc148ca9ca 00007fcc149c226f 00007fcc149c1f37 00007fcc149d655c 00007fcc149d6508 00007fcc149d6488 00007fcc149d6443 00007fcc149d56ec 00007fcc138ffa96
0709 13:20:30.922602 (+ 23934us) spinlock_profiling.cc:243] Waited 28.3 ms on lock 0x7b4800061ed8. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc148d3aa1 00007fcc148cab37 00007fcc148ca9ca 00007fcc149c226f 00007fcc149c1f37 00007fcc149d655c 00007fcc149d6508 00007fcc149d6488 00007fcc149d6443 00007fcc149d56ec 00007fcc138ffa96
Metrics: {"mutex_wait_us":99846,"prepare.queue_time_us":37996,"prepare.run_cpu_time_us":95,"prepare.run_wall_time_us":100,"raft.queue_time_us":105345,"raft.run_cpu_time_us":4239,"raft.run_wall_time_us":804713,"spinlock_wait_cycles":79816704,"thread_start_us":356939,"threads_started":2,"wal-append.queue_time_us":353022}
I20260709 13:20:30.951746  7495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b8cacb381b746da8d0049b0a83b41dd" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:20:30.912709 11795 leader_election.cc:290] T 4d9def8b32fd443aa94ab1420b06837b P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 14 election: Requested vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:30.896271 11786 raft_consensus.cc:515] T 9e326172347f45e99a0d482b5d8ef768 P cd75a17ab2604397adab03bb8b5fd75c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:30.927950  6804 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:32966 (request call id 1215) took 2047 ms. Trace:
I20260709 13:20:30.957564  6726 raft_consensus.cc:1240] T 7c37d41cd9164c15a6826ca62a851a69 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 14 FOLLOWER]: Rejecting Update request from peer b7ab4784c7344b939bc36f639286f377 for earlier term 13. Current term is 14. Ops: []
I20260709 13:20:30.928983 11666 leader_election.cc:290] T bb7fa124c3bf4ef9ab65a407cb008441 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:20:30.930387  7501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "427c124d773f483294511e80fe340075" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb"
W20260709 13:20:30.957768  6772 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 44418.1us
I20260709 13:20:30.930594 11634 raft_consensus.cc:3055] T de3186201e1a40d0b335eeb8b4e256e0 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:20:30.875160 11692 raft_consensus.cc:2804] T 3411566abe2d4c9bb4b2adfdd05e6f17 P b7ab4784c7344b939bc36f639286f377 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:20:30.903062  6877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "427c124d773f483294511e80fe340075" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:20:30.940883  6876 raft_consensus.cc:3060] T a1704639a875409b9959353527b3fd68 P cd75a17ab2604397adab03bb8b5fd75c [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:30.942174  6874 raft_consensus.cc:1275] T 7c37d41cd9164c15a6826ca62a851a69 P cd75a17ab2604397adab03bb8b5fd75c [term 13 FOLLOWER]: Refusing update from remote peer b7ab4784c7344b939bc36f639286f377: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:20:30.873692 11670 raft_consensus.cc:2804] T 2c240553ce044eedb41541d72b9475d7 P b7ab4784c7344b939bc36f639286f377 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:20:30.938328  6880 raft_consensus.cc:2468] T 30e88460611e47b2ba16a46a30b5f416 P cd75a17ab2604397adab03bb8b5fd75c [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 12.
I20260709 13:20:30.959437  6772 leader_election.cc:304] T 90d42e216d9741e190bca19a781291fd P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:20:30.957993  6804 rpcz_store.cc:276] 0709 13:20:28.880312 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:29.487648 (+607336us) service_pool.cc:224] Handling call
0709 13:20:30.927739 (+1440091us) spinlock_profiling.cc:243] Waited 468 ms on lock 0x7b5400353754. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f9ae2fa 00007fcc1496fb17 00007fcc0deea6d4 00007fcc0deea662 00007fcc0deea591 00007fcc0deea50c 00007fcc0dee97c2 00007fcc0dce548c 00007fcc0dce48c6 00007fcc0dce426f
0709 13:20:30.927877 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1075622272}
I20260709 13:20:30.982486  6772 leader_election.cc:304] T 30e88460611e47b2ba16a46a30b5f416 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:20:30.987601  6874 raft_consensus.cc:1275] T 4275cf08e63345f993bce8664eada830 P cd75a17ab2604397adab03bb8b5fd75c [term 13 FOLLOWER]: Refusing update from remote peer b7ab4784c7344b939bc36f639286f377: Log matching property violated. Preceding OpId in replica: term: 12 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 13:20:30.990419  6876 raft_consensus.cc:2468] T a1704639a875409b9959353527b3fd68 P cd75a17ab2604397adab03bb8b5fd75c [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 15.
I20260709 13:20:31.026588  7495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb7fa124c3bf4ef9ab65a407cb008441" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
W20260709 13:20:31.029109  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 266024us
W20260709 13:20:30.975216  6770 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 137201us
I20260709 13:20:31.033579  6876 raft_consensus.cc:1240] T 7a734b5ab7834e05a8c422208acc58b1 P cd75a17ab2604397adab03bb8b5fd75c [term 14 FOLLOWER]: Rejecting Update request from peer b7ab4784c7344b939bc36f639286f377 for earlier term 13. Current term is 14. Ops: []
I20260709 13:20:30.966171 11803 raft_consensus.cc:493] T bb3d8792045a4583ae2e965b1350a5b4 P cd75a17ab2604397adab03bb8b5fd75c [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:31.036769  7495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24ee15416e3145beaa1b8183453729a3" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb"
I20260709 13:20:30.963245 11733 raft_consensus.cc:493] T e31b9971c15848dea59d4d4130141d9e P cd75a17ab2604397adab03bb8b5fd75c [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:20:30.969455 11656 raft_consensus.cc:2804] T 853ac0a8cbd64ce99457f170216d4d0f P b7ab4784c7344b939bc36f639286f377 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:20:30.970033 11634 raft_consensus.cc:740] T de3186201e1a40d0b335eeb8b4e256e0 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
I20260709 13:20:31.051043  6770 leader_election.cc:304] T 95a75bfe094d4bdc963aba3f08dfcd25 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:20:31.041188  6844 leader_election.cc:304] T 22ccee1b570c4ad3a57bd7aec085b1b4 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377
I20260709 13:20:31.055904  6772 leader_election.cc:304] T be1a92657f494cac8dd227d152f50151 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:20:31.011510 11782 raft_consensus.cc:2804] T 90d42e216d9741e190bca19a781291fd P b7ab4784c7344b939bc36f639286f377 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:20:31.074203  6772 leader_election.cc:304] T 404190ce4ce94cecbfcb6ea9d1dd8626 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:20:30.989249  6801 consensus_queue.cc:237] T 7a734b5ab7834e05a8c422208acc58b1 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 13.5, Last appended by leader: 4, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } attrs { replace: true } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: NON_VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: true } }
I20260709 13:20:31.031085 11700 leader_election.cc:290] T 24ee15416e3145beaa1b8183453729a3 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 17 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
W20260709 13:20:31.085479  6770 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:31.096071  6876 raft_consensus.cc:1275] T 4f00a2e87e56452083b759f60d461ee3 P cd75a17ab2604397adab03bb8b5fd75c [term 14 FOLLOWER]: Refusing update from remote peer 7ba59cc884714e8aa5f3f0ecaed84cbb: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:20:30.976620 11066 consensus_queue.cc:1059] T 3fa34c08b205435dba97346991aa1f92 P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false }, Status: INVALID_TERM, Last received: 15.13, Next index: 14, Last known committed idx: 12, Time since last communication: 0.081s
I20260709 13:20:31.043787 11693 raft_consensus.cc:2804] T 30e88460611e47b2ba16a46a30b5f416 P b7ab4784c7344b939bc36f639286f377 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:20:31.045300 11504 leader_election.cc:290] T ce4f062dcd314d43a63ca74067cb5ee3 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:20:31.058421 11656 raft_consensus.cc:493] T 853ac0a8cbd64ce99457f170216d4d0f P b7ab4784c7344b939bc36f639286f377 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:31.041818 11692 raft_consensus.cc:697] T 3411566abe2d4c9bb4b2adfdd05e6f17 P b7ab4784c7344b939bc36f639286f377 [term 12 LEADER]: Becoming Leader. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
I20260709 13:20:31.040387 11670 raft_consensus.cc:697] T 2c240553ce044eedb41541d72b9475d7 P b7ab4784c7344b939bc36f639286f377 [term 15 LEADER]: Becoming Leader. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
I20260709 13:20:31.071077 11847 raft_consensus.cc:493] T 8c7f33e544204fbaac4078e3e83bbf4e P b7ab4784c7344b939bc36f639286f377 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:31.093672 11658 raft_consensus.cc:2749] T be1a92657f494cac8dd227d152f50151 P b7ab4784c7344b939bc36f639286f377 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:20:31.041339 11354 consensus_queue.cc:1059] T 3a485a995abc4807b6e511e45419f737 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.068s
I20260709 13:20:31.041568 11666 consensus_queue.cc:1048] T 7c37d41cd9164c15a6826ca62a851a69 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.061s
W20260709 13:20:31.119835  6772 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.68:45071, user_credentials={real_user=slave}} blocked reactor thread for 45760us
I20260709 13:20:31.120414  6880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce4f062dcd314d43a63ca74067cb5ee3" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:20:31.057350 11803 raft_consensus.cc:515] T bb3d8792045a4583ae2e965b1350a5b4 P cd75a17ab2604397adab03bb8b5fd75c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:20:31.103346 11693 raft_consensus.cc:493] T 30e88460611e47b2ba16a46a30b5f416 P b7ab4784c7344b939bc36f639286f377 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:31.142396 11693 raft_consensus.cc:3060] T 30e88460611e47b2ba16a46a30b5f416 P b7ab4784c7344b939bc36f639286f377 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:31.144099 11803 leader_election.cc:290] T bb3d8792045a4583ae2e965b1350a5b4 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:20:31.129141  6844 leader_election.cc:304] T 3a485a995abc4807b6e511e45419f737 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
W20260709 13:20:31.122432 11840 log.cc:927] Time spent T f58dc08b12a2494bb9a1372837970ca2 P b7ab4784c7344b939bc36f639286f377: Append to log took a long time: real 0.221s	user 0.001s	sys 0.002s
I20260709 13:20:31.148073  6844 leader_election.cc:304] T 7a734b5ab7834e05a8c422208acc58b1 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:20:31.149756  7495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3d8792045a4583ae2e965b1350a5b4" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 13 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:20:31.135666  6880 raft_consensus.cc:2376] T ce4f062dcd314d43a63ca74067cb5ee3 P cd75a17ab2604397adab03bb8b5fd75c [term 14 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in term 14. Re-sending same reply.
I20260709 13:20:31.151681  6880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5be3a11b23d4ea9b08300a2789821c7" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:31.100580 11798 raft_consensus.cc:2749] T 95a75bfe094d4bdc963aba3f08dfcd25 P b7ab4784c7344b939bc36f639286f377 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:20:31.152293 11803 raft_consensus.cc:2749] T 3a485a995abc4807b6e511e45419f737 P cd75a17ab2604397adab03bb8b5fd75c [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:20:31.153126 11803 raft_consensus.cc:2749] T 7a734b5ab7834e05a8c422208acc58b1 P cd75a17ab2604397adab03bb8b5fd75c [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:20:31.152354  6880 raft_consensus.cc:2468] T f5be3a11b23d4ea9b08300a2789821c7 P cd75a17ab2604397adab03bb8b5fd75c [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 12.
I20260709 13:20:31.155325  6880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb7fa124c3bf4ef9ab65a407cb008441" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:31.129997 11782 raft_consensus.cc:697] T 90d42e216d9741e190bca19a781291fd P b7ab4784c7344b939bc36f639286f377 [term 14 LEADER]: Becoming Leader. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
I20260709 13:20:31.156605 11846 raft_consensus.cc:493] T e77e330a82df4b43a745d57a68f6f057 P b7ab4784c7344b939bc36f639286f377 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:31.157377 11782 consensus_queue.cc:237] T 90d42e216d9741e190bca19a781291fd P b7ab4784c7344b939bc36f639286f377 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:31.158627 11354 raft_consensus.cc:3055] T 3a485a995abc4807b6e511e45419f737 P b7ab4784c7344b939bc36f639286f377 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:20:31.159432 11354 raft_consensus.cc:740] T 3a485a995abc4807b6e511e45419f737 P b7ab4784c7344b939bc36f639286f377 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
I20260709 13:20:31.157498 11846 raft_consensus.cc:515] T e77e330a82df4b43a745d57a68f6f057 P b7ab4784c7344b939bc36f639286f377 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } }
I20260709 13:20:31.161733  6729 raft_consensus.cc:1275] T 9e326172347f45e99a0d482b5d8ef768 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 12 FOLLOWER]: Refusing update from remote peer b7ab4784c7344b939bc36f639286f377: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:20:31.070087 11733 raft_consensus.cc:515] T e31b9971c15848dea59d4d4130141d9e P cd75a17ab2604397adab03bb8b5fd75c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:31.118808 11656 raft_consensus.cc:3060] T 853ac0a8cbd64ce99457f170216d4d0f P b7ab4784c7344b939bc36f639286f377 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:20:31.163813  6880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de3186201e1a40d0b335eeb8b4e256e0" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:31.140837  6875 raft_consensus.cc:2468] T 22ccee1b570c4ad3a57bd7aec085b1b4 P cd75a17ab2604397adab03bb8b5fd75c [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 12.
I20260709 13:20:31.164014  6876 raft_consensus.cc:1275] T bb3d8792045a4583ae2e965b1350a5b4 P cd75a17ab2604397adab03bb8b5fd75c [term 12 FOLLOWER]: Refusing update from remote peer 7ba59cc884714e8aa5f3f0ecaed84cbb: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:20:31.161454  6772 leader_election.cc:304] T d8cee0accdb8499c86d4414b72565a38 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:20:31.167172  6880 raft_consensus.cc:2393] T de3186201e1a40d0b335eeb8b4e256e0 P cd75a17ab2604397adab03bb8b5fd75c [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7ab4784c7344b939bc36f639286f377 in current term 15: Already voted for candidate cd75a17ab2604397adab03bb8b5fd75c in this term.
I20260709 13:20:31.166765  6875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce4f062dcd314d43a63ca74067cb5ee3" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:31.169358  6875 raft_consensus.cc:2468] T ce4f062dcd314d43a63ca74067cb5ee3 P cd75a17ab2604397adab03bb8b5fd75c [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 14.
I20260709 13:20:31.155144 11803 consensus_queue.cc:1048] T f09c2a98de1a4decabd0ff900dd44caa P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:20:31.124329 11749 raft_consensus.cc:2749] T 404190ce4ce94cecbfcb6ea9d1dd8626 P b7ab4784c7344b939bc36f639286f377 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:20:31.179636 11849 raft_consensus.cc:493] T bd6869f07b5a4885a0b99fbe60c3b175 P b7ab4784c7344b939bc36f639286f377 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:31.179761 11670 consensus_queue.cc:237] T 2c240553ce044eedb41541d72b9475d7 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:31.180480 11849 raft_consensus.cc:515] T bd6869f07b5a4885a0b99fbe60c3b175 P b7ab4784c7344b939bc36f639286f377 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:31.181754 11666 raft_consensus.cc:493] T f09c2a98de1a4decabd0ff900dd44caa P b7ab4784c7344b939bc36f639286f377 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:31.182600 11666 raft_consensus.cc:515] T f09c2a98de1a4decabd0ff900dd44caa P b7ab4784c7344b939bc36f639286f377 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:31.183531 11849 leader_election.cc:290] T bd6869f07b5a4885a0b99fbe60c3b175 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:31.184223 11658 raft_consensus.cc:493] T 7887766dc6784fcaa42b35c05fea7a99 P b7ab4784c7344b939bc36f639286f377 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:31.184918 11657 raft_consensus.cc:493] T f4b8bd455d5a47c18a1380839c6e0d61 P b7ab4784c7344b939bc36f639286f377 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:31.184717 11658 raft_consensus.cc:515] T 7887766dc6784fcaa42b35c05fea7a99 P b7ab4784c7344b939bc36f639286f377 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:31.185640 11657 raft_consensus.cc:515] T f4b8bd455d5a47c18a1380839c6e0d61 P b7ab4784c7344b939bc36f639286f377 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:31.187341 11658 leader_election.cc:290] T 7887766dc6784fcaa42b35c05fea7a99 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
W20260709 13:20:31.168607 11767 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 12 current term: 12 is higher.
I20260709 13:20:31.188212 11504 raft_consensus.cc:2749] T d8cee0accdb8499c86d4414b72565a38 P b7ab4784c7344b939bc36f639286f377 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:20:31.189448  6772 leader_election.cc:304] T 427c124d773f483294511e80fe340075 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:20:31.189570  6798 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:32976 (request call id 3017) took 2631 ms. Trace:
I20260709 13:20:31.137084 11688 raft_consensus.cc:493] T f58dc08b12a2494bb9a1372837970ca2 P cd75a17ab2604397adab03bb8b5fd75c [term 16 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:20:31.192853  6798 rpcz_store.cc:276] 0709 13:20:28.541266 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:28.612756 (+ 71490us) service_pool.cc:224] Handling call
0709 13:20:28.613054 (+   298us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:29.160561 (+547507us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:31.172765 (+2012204us) spinlock_profiling.cc:243] Waited 489 ms on lock 0x7b54002c97d4. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f9aae01 00007fcc0f9a983e 00007fcc1496e419 00007fcc0dee5bd4 00007fcc0dee5b62 00007fcc0dee5a91 00007fcc0dee5a0c 00007fcc0dee4cc2 00007fcc0dce548c 00007fcc0dce48c6
0709 13:20:31.173061 (+   296us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1124454784}
I20260709 13:20:31.199630  6772 leader_election.cc:304] T a1704639a875409b9959353527b3fd68 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:20:31.165494 11700 raft_consensus.cc:2764] T 22ccee1b570c4ad3a57bd7aec085b1b4 P cd75a17ab2604397adab03bb8b5fd75c [term 12 FOLLOWER]: Leader pre-election decision vote started in defunct term 11: won
I20260709 13:20:31.164284 11772 leader_election.cc:290] T a1704639a875409b9959353527b3fd68 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:20:31.207690  6772 leader_election.cc:304] T f5be3a11b23d4ea9b08300a2789821c7 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:20:31.212989  6772 leader_election.cc:304] T bb7fa124c3bf4ef9ab65a407cb008441 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:20:31.215130  6772 leader_election.cc:304] T 22ccee1b570c4ad3a57bd7aec085b1b4 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:20:31.187922 11657 leader_election.cc:290] T f4b8bd455d5a47c18a1380839c6e0d61 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:31.219359  7495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce4f062dcd314d43a63ca74067cb5ee3" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:20:31.225199  6875 raft_consensus.cc:1275] T ce4f062dcd314d43a63ca74067cb5ee3 P cd75a17ab2604397adab03bb8b5fd75c [term 14 FOLLOWER]: Refusing update from remote peer 7ba59cc884714e8aa5f3f0ecaed84cbb: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:20:31.202236 11749 raft_consensus.cc:2749] T 427c124d773f483294511e80fe340075 P b7ab4784c7344b939bc36f639286f377 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:20:31.234156  6879 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58592 (request call id 401) took 1642 ms. Trace:
I20260709 13:20:31.203348 11777 raft_consensus.cc:493] T d33d5ee8ef6f415593d8df52063161ad P cd75a17ab2604397adab03bb8b5fd75c [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:20:31.127244 11847 raft_consensus.cc:515] T 8c7f33e544204fbaac4078e3e83bbf4e P b7ab4784c7344b939bc36f639286f377 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:31.234576  6879 rpcz_store.cc:276] 0709 13:20:29.591683 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:29.591805 (+   122us) service_pool.cc:224] Handling call
0709 13:20:29.599448 (+  7643us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:30.723389 (+1123941us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 13:20:30.723655 (+   266us) log.cc:844] Serialized 14 byte log entry
0709 13:20:30.827050 (+103395us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:20:30.827112 (+    62us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:20:30.827176 (+    64us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:31.233972 (+406796us) spinlock_profiling.cc:243] Waited 1.12 s on lock 0x7b5400141ed4. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f9aae01 00007fcc0f9a983e 00007fcc1496e419 00007fcc0dee5bd4 00007fcc0dee5b62 00007fcc0dee5a91 00007fcc0dee5a0c 00007fcc0dee4cc2 00007fcc0dce548c 00007fcc0dce48c6
0709 13:20:31.234017 (+    45us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:31.234109 (+    92us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":1285,"prepare.run_cpu_time_us":40,"prepare.run_wall_time_us":43,"raft.queue_time_us":123,"raft.run_cpu_time_us":120,"raft.run_wall_time_us":121,"spinlock_wait_cycles":2638912640,"thread_start_us":102627,"threads_started":1,"wal-append.queue_time_us":161477}
I20260709 13:20:31.220621 11504 raft_consensus.cc:2749] T bb7fa124c3bf4ef9ab65a407cb008441 P b7ab4784c7344b939bc36f639286f377 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:20:31.210561 11688 raft_consensus.cc:515] T f58dc08b12a2494bb9a1372837970ca2 P cd75a17ab2604397adab03bb8b5fd75c [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:31.262459  6873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7887766dc6784fcaa42b35c05fea7a99" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:31.263128  6873 raft_consensus.cc:2468] T 7887766dc6784fcaa42b35c05fea7a99 P cd75a17ab2604397adab03bb8b5fd75c [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 14.
I20260709 13:20:31.264125 11688 leader_election.cc:290] T f58dc08b12a2494bb9a1372837970ca2 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:20:31.204864 11849 raft_consensus.cc:2804] T a1704639a875409b9959353527b3fd68 P b7ab4784c7344b939bc36f639286f377 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:20:31.245152 11657 raft_consensus.cc:493] T 07a92dd554674067a83a9cb68c4773f2 P b7ab4784c7344b939bc36f639286f377 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:31.241977 11781 leader_election.cc:290] T 4275cf08e63345f993bce8664eada830 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:20:31.265933 11786 leader_election.cc:290] T 9e326172347f45e99a0d482b5d8ef768 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:20:31.267390 11846 leader_election.cc:290] T e77e330a82df4b43a745d57a68f6f057 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931), ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391)
I20260709 13:20:31.232801 11692 consensus_queue.cc:237] T 3411566abe2d4c9bb4b2adfdd05e6f17 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:31.223510 11798 raft_consensus.cc:2804] T f5be3a11b23d4ea9b08300a2789821c7 P b7ab4784c7344b939bc36f639286f377 [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 13:20:31.246546 11856 log.cc:927] Time spent T 1bf4668eeb70467fb3dc5a0289233b3c P cd75a17ab2604397adab03bb8b5fd75c: Append to log took a long time: real 0.086s	user 0.001s	sys 0.000s
I20260709 13:20:31.223296 11752 raft_consensus.cc:2804] T 22ccee1b570c4ad3a57bd7aec085b1b4 P b7ab4784c7344b939bc36f639286f377 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:20:31.256764 11789 raft_consensus.cc:3055] T 7ba5dac66ab5497e9e336f2a3c28cda5 P cd75a17ab2604397adab03bb8b5fd75c [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:20:31.270195 11789 raft_consensus.cc:740] T 7ba5dac66ab5497e9e336f2a3c28cda5 P cd75a17ab2604397adab03bb8b5fd75c [term 13 LEADER]: Becoming Follower/Learner. State: Replica: cd75a17ab2604397adab03bb8b5fd75c, State: Running, Role: LEADER
W20260709 13:20:31.272197  6695 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:31.247272 11693 raft_consensus.cc:515] T 30e88460611e47b2ba16a46a30b5f416 P b7ab4784c7344b939bc36f639286f377 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:31.256734 11777 raft_consensus.cc:515] T d33d5ee8ef6f415593d8df52063161ad P cd75a17ab2604397adab03bb8b5fd75c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:31.273591 11786 raft_consensus.cc:493] T 3411566abe2d4c9bb4b2adfdd05e6f17 P cd75a17ab2604397adab03bb8b5fd75c [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:31.274134 11786 raft_consensus.cc:515] T 3411566abe2d4c9bb4b2adfdd05e6f17 P cd75a17ab2604397adab03bb8b5fd75c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:31.275580 11777 leader_election.cc:290] T d33d5ee8ef6f415593d8df52063161ad P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:20:31.256265 11733 leader_election.cc:290] T e31b9971c15848dea59d4d4130141d9e P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:20:31.260200  6730 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50004 (request call id 2290) took 2211 ms. Trace:
I20260709 13:20:31.276648 11659 raft_consensus.cc:493] T ce4f062dcd314d43a63ca74067cb5ee3 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:31.277820 11659 raft_consensus.cc:515] T ce4f062dcd314d43a63ca74067cb5ee3 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } attrs { replace: true } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:20:31.279228 11722 raft_consensus.cc:2749] T 3fa34c08b205435dba97346991aa1f92 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:20:31.264964 11849 raft_consensus.cc:697] T a1704639a875409b9959353527b3fd68 P b7ab4784c7344b939bc36f639286f377 [term 15 LEADER]: Becoming Leader. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
I20260709 13:20:31.282328 11849 consensus_queue.cc:237] T a1704639a875409b9959353527b3fd68 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:31.283120  6728 raft_consensus.cc:1275] T bb3d8792045a4583ae2e965b1350a5b4 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 12 FOLLOWER]: Refusing update from remote peer 7ba59cc884714e8aa5f3f0ecaed84cbb: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 12 index: 11. (term mismatch)
I20260709 13:20:31.283751  6728 pending_rounds.cc:85] T bb3d8792045a4583ae2e965b1350a5b4 P ccd8a4c3bfe3413cb2ae219b09aea832: Aborting all ops after (but not including) 10
I20260709 13:20:31.284014  6728 pending_rounds.cc:107] T bb3d8792045a4583ae2e965b1350a5b4 P ccd8a4c3bfe3413cb2ae219b09aea832: Aborting uncommitted NO_OP operation due to leader change: 11.11
I20260709 13:20:31.284329  6728 raft_consensus.cc:2889] T bb3d8792045a4583ae2e965b1350a5b4 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:20:31.284502  6729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fa34c08b205435dba97346991aa1f92" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
W20260709 13:20:31.276440  6697 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.68:45071, user_credentials={real_user=slave}} blocked reactor thread for 553265us
I20260709 13:20:31.284793  6726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3f13b31a1f84f0d89d007eadd57924c" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:31.136243 11634 consensus_queue.cc:260] T de3186201e1a40d0b335eeb8b4e256e0 P ccd8a4c3bfe3413cb2ae219b09aea832 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:31.286674  6728 raft_consensus.cc:1275] T ce4f062dcd314d43a63ca74067cb5ee3 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 14 FOLLOWER]: Refusing update from remote peer 7ba59cc884714e8aa5f3f0ecaed84cbb: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:20:31.287216  6697 leader_election.cc:304] T b3f13b31a1f84f0d89d007eadd57924c P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, b7ab4784c7344b939bc36f639286f377
I20260709 13:20:31.270253 11752 raft_consensus.cc:697] T 22ccee1b570c4ad3a57bd7aec085b1b4 P b7ab4784c7344b939bc36f639286f377 [term 12 LEADER]: Becoming Leader. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
I20260709 13:20:31.265973 11657 raft_consensus.cc:515] T 07a92dd554674067a83a9cb68c4773f2 P b7ab4784c7344b939bc36f639286f377 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
W20260709 13:20:31.273187  6695 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:31.287065  6729 raft_consensus.cc:3055] T f09c2a98de1a4decabd0ff900dd44caa P ccd8a4c3bfe3413cb2ae219b09aea832 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:20:31.293308  6772 leader_election.cc:304] T 7887766dc6784fcaa42b35c05fea7a99 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
W20260709 13:20:31.295270  6695 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:31.296559  6729 raft_consensus.cc:740] T f09c2a98de1a4decabd0ff900dd44caa P ccd8a4c3bfe3413cb2ae219b09aea832 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
W20260709 13:20:31.296890  6695 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:31.266815 11354 consensus_queue.cc:260] T 3a485a995abc4807b6e511e45419f737 P b7ab4784c7344b939bc36f639286f377 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:31.258836  6731 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49998 (request call id 1213) took 1260 ms. Trace:
I20260709 13:20:31.301030 11354 raft_consensus.cc:3060] T 3a485a995abc4807b6e511e45419f737 P b7ab4784c7344b939bc36f639286f377 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:31.301362 11693 leader_election.cc:290] T 30e88460611e47b2ba16a46a30b5f416 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 13 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:31.255123  6872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6869f07b5a4885a0b99fbe60c3b175" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:31.304432  6872 raft_consensus.cc:2468] T bd6869f07b5a4885a0b99fbe60c3b175 P cd75a17ab2604397adab03bb8b5fd75c [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 14.
I20260709 13:20:31.305616 11659 leader_election.cc:290] T ce4f062dcd314d43a63ca74067cb5ee3 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:20:31.305738  6872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c7f33e544204fbaac4078e3e83bbf4e" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:31.306473  6872 raft_consensus.cc:2468] T 8c7f33e544204fbaac4078e3e83bbf4e P cd75a17ab2604397adab03bb8b5fd75c [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 11.
I20260709 13:20:31.307394  6872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09c2a98de1a4decabd0ff900dd44caa" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:31.310482 11657 leader_election.cc:290] T 07a92dd554674067a83a9cb68c4773f2 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:31.298938  6875 raft_consensus.cc:1275] T 9e326172347f45e99a0d482b5d8ef768 P cd75a17ab2604397adab03bb8b5fd75c [term 12 FOLLOWER]: Refusing update from remote peer b7ab4784c7344b939bc36f639286f377: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:20:31.297554  6729 consensus_queue.cc:260] T f09c2a98de1a4decabd0ff900dd44caa P ccd8a4c3bfe3413cb2ae219b09aea832 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:31.305142 11817 raft_consensus.cc:493] T fe20b4b48823486ca3b9c648db6ce8aa P ccd8a4c3bfe3413cb2ae219b09aea832 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader cd75a17ab2604397adab03bb8b5fd75c)
I20260709 13:20:31.276507  6730 rpcz_store.cc:276] 0709 13:20:29.049039 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:29.116937 (+ 67898us) service_pool.cc:224] Handling call
0709 13:20:30.111779 (+994842us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:30.123866 (+ 12087us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:30.123903 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:20:30.132285 (+  8382us) log.cc:844] Serialized 26 byte log entry
0709 13:20:30.451841 (+319556us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:20:30.451989 (+   148us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:30.452414 (+   425us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:30.617660 (+165246us) raft_consensus.cc:1685] finished
0709 13:20:30.617691 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:31.259716 (+642025us) spinlock_profiling.cc:243] Waited 994 ms on lock 0x7b54003b6ad0. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f9a98ad 00007fcc1496e419 00007fcc0dee5bd4 00007fcc0dee5b62 00007fcc0dee5a91 00007fcc0dee5a0c 00007fcc0dee4cc2 00007fcc0dce548c 00007fcc0dce48c6 00007fcc0dce426f
0709 13:20:31.260100 (+   384us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":11684,"raft.queue_time_us":13903,"raft.run_cpu_time_us":176,"raft.run_wall_time_us":3280,"spinlock_wait_cycles":2286971136,"thread_start_us":298288,"threads_started":1,"wal-append.queue_time_us":304263}
I20260709 13:20:31.268551 11798 raft_consensus.cc:493] T f5be3a11b23d4ea9b08300a2789821c7 P b7ab4784c7344b939bc36f639286f377 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:31.292398  6770 leader_election.cc:304] T dbdf895bba214ff68685a24fd17dfb5d P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:20:31.300859  6731 rpcz_store.cc:276] 0709 13:20:29.997971 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:30.182049 (+184078us) service_pool.cc:224] Handling call
0709 13:20:30.239008 (+ 56959us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:30.268558 (+ 29550us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:30.268589 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:20:30.311098 (+ 42509us) log.cc:844] Serialized 26 byte log entry
0709 13:20:30.507600 (+196502us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:20:30.520884 (+ 13284us) log.cc:844] Serialized 14 byte log entry
0709 13:20:30.835043 (+314159us) spinlock_profiling.cc:243] Waited 34.2 ms on lock 0x7b1800403720. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc15785de1 00007fcc157925b1 00007fcc0c8bd3f3 00007fcc0c8bf7c1 00007fcc0c8bf779 00007fcc0c8bf709 00007fcc0c8bf6d1 00007fcc0c8be9cd 000000000038f354 000000000038f199 00007fcc0c8a083a
0709 13:20:31.258023 (+422980us) spinlock_profiling.cc:243] Waited 1.56 ms on lock 0x7b1800403720. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc15785de1 00007fcc157925b1 00007fcc0c837c0a 00007fcc15f77219 00007fcc0c8bfa40 00007fcc0c8ba4e4 00007fcc0c8ba455 00007fcc0f9a2060 00007fcc0f9b4716 00007fcc0f9c5287 00007fcc0f9c5208
0709 13:20:31.258460 (+   437us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:31.258551 (+    91us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:31.258599 (+    48us) raft_consensus.cc:1685] finished
0709 13:20:31.258616 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:31.258756 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":38622,"prepare.queue_time_us":17980,"prepare.run_cpu_time_us":44,"prepare.run_wall_time_us":45,"raft.queue_time_us":800395,"raft.run_cpu_time_us":514,"raft.run_wall_time_us":8021,"spinlock_wait_cycles":82269952,"thread_start_us":107808,"threads_started":1,"wal-append.queue_time_us":297759}
I20260709 13:20:31.319679  6879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4b8bd455d5a47c18a1380839c6e0d61" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 14 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
W20260709 13:20:31.335203  6698 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:31.324385  6729 raft_consensus.cc:3060] T f09c2a98de1a4decabd0ff900dd44caa P ccd8a4c3bfe3413cb2ae219b09aea832 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:20:31.336864  6698 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:31.316787  6878 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53416 (request call id 3080) took 1011 ms. Trace:
W20260709 13:20:31.339170  6770 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 46879.2us
I20260709 13:20:31.340256  6770 leader_election.cc:304] T de3186201e1a40d0b335eeb8b4e256e0 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
W20260709 13:20:31.331760  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 181429us
W20260709 13:20:31.346186  6772 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 52992.9us
W20260709 13:20:31.346524  6698 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:31.299248 11634 raft_consensus.cc:3060] T de3186201e1a40d0b335eeb8b4e256e0 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:31.356352  6877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d9def8b32fd443aa94ab1420b06837b" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:20:31.339227  6878 rpcz_store.cc:276] 0709 13:20:30.305019 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:30.440286 (+135267us) service_pool.cc:224] Handling call
0709 13:20:30.497190 (+ 56904us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:30.513690 (+ 16500us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:30.513725 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:20:30.920721 (+406996us) spinlock_profiling.cc:243] Waited 2.48 ms on lock 0x7b2c001176f8. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0e2a3a11 00007fcc0e2b3372 00007fcc0f9e5a01 00007fcc0f9aa43a 00007fcc0f9a983e 00007fcc1496e419 00007fcc0dee5bd4 00007fcc0dee5b62 00007fcc0dee5a91 00007fcc0dee5a0c 00007fcc0dee4cc2
0709 13:20:30.921645 (+   924us) log.cc:844] Serialized 26 byte log entry
0709 13:20:31.038986 (+117341us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:20:31.293915 (+254929us) log.cc:844] Serialized 14 byte log entry
0709 13:20:31.294187 (+   272us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:31.294268 (+    81us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:31.294312 (+    44us) raft_consensus.cc:1685] finished
0709 13:20:31.316330 (+ 22018us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:31.316701 (+   371us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5218,"prepare.queue_time_us":53964,"prepare.run_cpu_time_us":42,"prepare.run_wall_time_us":43,"raft.queue_time_us":16250,"raft.run_cpu_time_us":276,"raft.run_wall_time_us":12847,"spinlock_wait_cycles":5698816,"thread_start_us":318280,"threads_started":2,"wal-append.queue_time_us":216048}
I20260709 13:20:31.357838  6697 leader_election.cc:304] T f4b8bd455d5a47c18a1380839c6e0d61 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:20:31.358525  6729 raft_consensus.cc:1275] T f09c2a98de1a4decabd0ff900dd44caa P ccd8a4c3bfe3413cb2ae219b09aea832 [term 15 FOLLOWER]: Refusing update from remote peer cd75a17ab2604397adab03bb8b5fd75c: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 9. (term mismatch)
I20260709 13:20:31.358913  6729 pending_rounds.cc:85] T f09c2a98de1a4decabd0ff900dd44caa P ccd8a4c3bfe3413cb2ae219b09aea832: Aborting all ops after (but not including) 8
I20260709 13:20:31.359151  6729 pending_rounds.cc:107] T f09c2a98de1a4decabd0ff900dd44caa P ccd8a4c3bfe3413cb2ae219b09aea832: Aborting uncommitted NO_OP operation due to leader change: 14.9
I20260709 13:20:31.359376  6729 raft_consensus.cc:2889] T f09c2a98de1a4decabd0ff900dd44caa P ccd8a4c3bfe3413cb2ae219b09aea832 [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:20:31.375919  6872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c37d41cd9164c15a6826ca62a851a69" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
W20260709 13:20:31.379336  6695 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:31.380084  6872 raft_consensus.cc:3060] T 7c37d41cd9164c15a6826ca62a851a69 P cd75a17ab2604397adab03bb8b5fd75c [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:31.371819  6697 leader_election.cc:304] T ab432e62819d499eaaf3dd55481dd930 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377
I20260709 13:20:31.385424  6697 leader_election.cc:304] T 30e88460611e47b2ba16a46a30b5f416 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:20:31.333667 11798 raft_consensus.cc:3060] T f5be3a11b23d4ea9b08300a2789821c7 P b7ab4784c7344b939bc36f639286f377 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:31.398445  6878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a485a995abc4807b6e511e45419f737" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:20:31.401698  6878 raft_consensus.cc:2393] T 3a485a995abc4807b6e511e45419f737 P cd75a17ab2604397adab03bb8b5fd75c [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate ccd8a4c3bfe3413cb2ae219b09aea832 in current term 13: Already voted for candidate cd75a17ab2604397adab03bb8b5fd75c in this term.
I20260709 13:20:31.324234 11822 raft_consensus.cc:2749] T b3f13b31a1f84f0d89d007eadd57924c P ccd8a4c3bfe3413cb2ae219b09aea832 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:20:31.399287 11511 raft_consensus.cc:493] T 7ba5dac66ab5497e9e336f2a3c28cda5 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 13 FOLLOWER]: Starting pre-election (detected failure of leader cd75a17ab2604397adab03bb8b5fd75c)
W20260709 13:20:31.393365  6770 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 47915.5us
I20260709 13:20:31.386650 11567 raft_consensus.cc:2804] T 30e88460611e47b2ba16a46a30b5f416 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:20:31.394397 11636 raft_consensus.cc:2804] T ab432e62819d499eaaf3dd55481dd930 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:20:31.375105 11658 raft_consensus.cc:3060] T de3186201e1a40d0b335eeb8b4e256e0 P b7ab4784c7344b939bc36f639286f377 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:31.355791 11693 raft_consensus.cc:2749] T dbdf895bba214ff68685a24fd17dfb5d P b7ab4784c7344b939bc36f639286f377 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:20:31.387655  6697 leader_election.cc:304] T d33d5ee8ef6f415593d8df52063161ad P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:20:31.409653  6731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90d42e216d9741e190bca19a781291fd" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:20:31.365703 11749 raft_consensus.cc:2804] T 7887766dc6784fcaa42b35c05fea7a99 P b7ab4784c7344b939bc36f639286f377 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:20:31.376968 11674 raft_consensus.cc:2749] T f4b8bd455d5a47c18a1380839c6e0d61 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:20:31.388240 11786 leader_election.cc:290] T 3411566abe2d4c9bb4b2adfdd05e6f17 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:20:31.425004  6731 raft_consensus.cc:2376] T 90d42e216d9741e190bca19a781291fd P ccd8a4c3bfe3413cb2ae219b09aea832 [term 14 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 14. Re-sending same reply.
I20260709 13:20:31.427219  6878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b8cacb381b746da8d0049b0a83b41dd" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:31.417237 11567 raft_consensus.cc:493] T 30e88460611e47b2ba16a46a30b5f416 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:31.375546 11752 consensus_queue.cc:237] T 22ccee1b570c4ad3a57bd7aec085b1b4 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:31.436380  6878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce4f062dcd314d43a63ca74067cb5ee3" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:31.437304  6878 raft_consensus.cc:2468] T ce4f062dcd314d43a63ca74067cb5ee3 P cd75a17ab2604397adab03bb8b5fd75c [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 14.
I20260709 13:20:31.345804 11547 raft_consensus.cc:515] T 3d65025eea89441290d85dd053810e31 P b7ab4784c7344b939bc36f639286f377 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:31.334023 11789 consensus_queue.cc:260] T 7ba5dac66ab5497e9e336f2a3c28cda5 P cd75a17ab2604397adab03bb8b5fd75c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:20:31.438395  6878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77e330a82df4b43a745d57a68f6f057" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:31.455454 11576 raft_consensus.cc:3055] T 3fa34c08b205435dba97346991aa1f92 P cd75a17ab2604397adab03bb8b5fd75c [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:20:31.334895 11817 raft_consensus.cc:515] T fe20b4b48823486ca3b9c648db6ce8aa P ccd8a4c3bfe3413cb2ae219b09aea832 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:20:31.430058 11846 consensus_queue.cc:1059] T 7c37d41cd9164c15a6826ca62a851a69 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: INVALID_TERM, Last received: 13.9, Next index: 10, Last known committed idx: 7, Time since last communication: 0.014s
I20260709 13:20:31.424445 11636 raft_consensus.cc:493] T ab432e62819d499eaaf3dd55481dd930 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 15 FOLLOWER]: Starting leader election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:20:31.438448  6872 raft_consensus.cc:2468] T 7c37d41cd9164c15a6826ca62a851a69 P cd75a17ab2604397adab03bb8b5fd75c [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 14.
I20260709 13:20:31.426813 11749 raft_consensus.cc:493] T 7887766dc6784fcaa42b35c05fea7a99 P b7ab4784c7344b939bc36f639286f377 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:31.431388 11660 raft_consensus.cc:2749] T d33d5ee8ef6f415593d8df52063161ad P ccd8a4c3bfe3413cb2ae219b09aea832 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:20:31.437942 11567 raft_consensus.cc:3060] T 30e88460611e47b2ba16a46a30b5f416 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:31.455997 11576 raft_consensus.cc:740] T 3fa34c08b205435dba97346991aa1f92 P cd75a17ab2604397adab03bb8b5fd75c [term 15 LEADER]: Becoming Follower/Learner. State: Replica: cd75a17ab2604397adab03bb8b5fd75c, State: Running, Role: LEADER
I20260709 13:20:31.465757 11749 raft_consensus.cc:3060] T 7887766dc6784fcaa42b35c05fea7a99 P b7ab4784c7344b939bc36f639286f377 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:31.467739 11636 raft_consensus.cc:3060] T ab432e62819d499eaaf3dd55481dd930 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:31.421629 11511 raft_consensus.cc:515] T 7ba5dac66ab5497e9e336f2a3c28cda5 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:20:31.479840  6802 raft_consensus.cc:1240] T 3d65025eea89441290d85dd053810e31 P b7ab4784c7344b939bc36f639286f377 [term 14 FOLLOWER]: Rejecting Update request from peer cd75a17ab2604397adab03bb8b5fd75c for earlier term 13. Current term is 14. Ops: [13.7-13.7]
I20260709 13:20:31.482026  6731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8292e16e5654be6bc408560cf256aaa" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:31.486938  6872 raft_consensus.cc:1240] T 7c37d41cd9164c15a6826ca62a851a69 P cd75a17ab2604397adab03bb8b5fd75c [term 14 FOLLOWER]: Rejecting Update request from peer b7ab4784c7344b939bc36f639286f377 for earlier term 13. Current term is 14. Ops: [11.8-13.9]
I20260709 13:20:31.447453 11693 consensus_queue.cc:1048] T 9e326172347f45e99a0d482b5d8ef768 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.042s
I20260709 13:20:31.439194 11722 consensus_queue.cc:1059] T 3411566abe2d4c9bb4b2adfdd05e6f17 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.052s
I20260709 13:20:31.437337 11822 consensus_queue.cc:1048] T f5be3a11b23d4ea9b08300a2789821c7 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.055s
W20260709 13:20:31.499138  6770 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 73274.4us
W20260709 13:20:31.492260 11757 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 15 current term: 15 is higher.
I20260709 13:20:31.503005 11817 leader_election.cc:290] T fe20b4b48823486ca3b9c648db6ce8aa P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:20:31.505168  6770 leader_election.cc:304] T d8292e16e5654be6bc408560cf256aaa P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
W20260709 13:20:31.507936 11862 log.cc:927] Time spent T 3411566abe2d4c9bb4b2adfdd05e6f17 P b7ab4784c7344b939bc36f639286f377: Append to log took a long time: real 0.067s	user 0.001s	sys 0.000s
I20260709 13:20:31.508934 11656 raft_consensus.cc:515] T 853ac0a8cbd64ce99457f170216d4d0f P b7ab4784c7344b939bc36f639286f377 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:31.513551  6731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c7f33e544204fbaac4078e3e83bbf4e" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:31.522486  6801 raft_consensus.cc:1275] T e77e330a82df4b43a745d57a68f6f057 P b7ab4784c7344b939bc36f639286f377 [term 15 FOLLOWER]: Refusing update from remote peer cd75a17ab2604397adab03bb8b5fd75c: Log matching property violated. Preceding OpId in replica: term: 14 index: 7. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 13:20:31.524386  6801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4db81d9d329422bb3b4160ca4ac2d1d" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:31.526975  6807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "713b5728a197487c9300b310ab94e5a3" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:31.527770  6807 raft_consensus.cc:2393] T 713b5728a197487c9300b310ab94e5a3 P b7ab4784c7344b939bc36f639286f377 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c in current term 13: Already voted for candidate b7ab4784c7344b939bc36f639286f377 in this term.
I20260709 13:20:31.511335 11656 leader_election.cc:290] T 853ac0a8cbd64ce99457f170216d4d0f P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 12 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:31.528988  6801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f03d0dbf16864ca4bc1bb5e4c0334c0f" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:31.530347  6798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bf4668eeb70467fb3dc5a0289233b3c" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:31.530702  6799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20f6842e26174571996b8dea4151d4be" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:31.513504 11849 raft_consensus.cc:2749] T d8292e16e5654be6bc408560cf256aaa P b7ab4784c7344b939bc36f639286f377 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:20:31.541365  6798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1704639a875409b9959353527b3fd68" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 15 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:31.543519  6801 raft_consensus.cc:2393] T f03d0dbf16864ca4bc1bb5e4c0334c0f P b7ab4784c7344b939bc36f639286f377 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c in current term 13: Already voted for candidate b7ab4784c7344b939bc36f639286f377 in this term.
I20260709 13:20:31.548257 11810 raft_consensus.cc:3060] T e77e330a82df4b43a745d57a68f6f057 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:31.552902 11547 leader_election.cc:290] T 3d65025eea89441290d85dd053810e31 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 14 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:31.554379  6804 raft_consensus.cc:1275] T ce4f062dcd314d43a63ca74067cb5ee3 P b7ab4784c7344b939bc36f639286f377 [term 14 FOLLOWER]: Refusing update from remote peer 7ba59cc884714e8aa5f3f0ecaed84cbb: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:20:31.557001  6731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "853ac0a8cbd64ce99457f170216d4d0f" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:20:31.557677  6731 raft_consensus.cc:3060] T 853ac0a8cbd64ce99457f170216d4d0f P ccd8a4c3bfe3413cb2ae219b09aea832 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:20:31.559957 11567 raft_consensus.cc:515] T 30e88460611e47b2ba16a46a30b5f416 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:31.562554  6802 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:32966 (request call id 1228) took 1191 ms. Trace:
I20260709 13:20:31.563001  6802 rpcz_store.cc:276] 0709 13:20:30.371339 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:30.866945 (+495606us) service_pool.cc:224] Handling call
0709 13:20:30.897005 (+ 30060us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:31.492356 (+595351us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:31.562247 (+ 69891us) spinlock_profiling.cc:243] Waited 579 ms on lock 0x7b540028a5d4. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f9aae01 00007fcc0f9a983e 00007fcc1496e419 00007fcc0dee5bd4 00007fcc0dee5b62 00007fcc0dee5a91 00007fcc0dee5a0c 00007fcc0dee4cc2 00007fcc0dce548c 00007fcc0dce48c6
0709 13:20:31.562486 (+   239us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1332326144}
W20260709 13:20:31.555832  6846 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:31.570236  6803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90d42e216d9741e190bca19a781291fd" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:31.583037  6731 raft_consensus.cc:2468] T 853ac0a8cbd64ce99457f170216d4d0f P ccd8a4c3bfe3413cb2ae219b09aea832 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 12.
I20260709 13:20:31.583271  6798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e31b9971c15848dea59d4d4130141d9e" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
W20260709 13:20:31.584612  6695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 72228us
I20260709 13:20:31.584856  6807 raft_consensus.cc:1275] T dbdf895bba214ff68685a24fd17dfb5d P b7ab4784c7344b939bc36f639286f377 [term 12 FOLLOWER]: Refusing update from remote peer cd75a17ab2604397adab03bb8b5fd75c: Log matching property violated. Preceding OpId in replica: term: 10 index: 4. Preceding OpId from leader: term: 12 index: 5. (index mismatch)
W20260709 13:20:31.586941 11869 log.cc:927] Time spent T 4275cf08e63345f993bce8664eada830 P ccd8a4c3bfe3413cb2ae219b09aea832: Append to log took a long time: real 0.074s	user 0.000s	sys 0.001s
I20260709 13:20:31.588482  6801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d33d5ee8ef6f415593d8df52063161ad" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:31.588861  6726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6869f07b5a4885a0b99fbe60c3b175" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:31.590241  6726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5be3a11b23d4ea9b08300a2789821c7" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:31.588485  6804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f58dc08b12a2494bb9a1372837970ca2" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:31.591328  6726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b56bf91d90824c959e21e0cee5ba1816" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:31.591399  6807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e326172347f45e99a0d482b5d8ef768" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:31.592278  6726 raft_consensus.cc:2393] T b56bf91d90824c959e21e0cee5ba1816 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7ab4784c7344b939bc36f639286f377 in current term 13: Already voted for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in this term.
I20260709 13:20:31.590727  6799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3411566abe2d4c9bb4b2adfdd05e6f17" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 13 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:31.593310  6726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7887766dc6784fcaa42b35c05fea7a99" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:31.594732  6726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce4f062dcd314d43a63ca74067cb5ee3" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:31.595372  6726 raft_consensus.cc:2468] T ce4f062dcd314d43a63ca74067cb5ee3 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 14.
I20260709 13:20:31.597275  6803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4275cf08e63345f993bce8664eada830" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:31.600620  6770 leader_election.cc:304] T 853ac0a8cbd64ce99457f170216d4d0f P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
W20260709 13:20:31.601047  7468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 77629us
I20260709 13:20:31.603039 11774 consensus_queue.cc:1048] T 4f00a2e87e56452083b759f60d461ee3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:20:31.603221  6726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a92dd554674067a83a9cb68c4773f2" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:31.606153  6770 leader_election.cc:304] T b56bf91d90824c959e21e0cee5ba1816 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:20:31.606266  6726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d65025eea89441290d85dd053810e31" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:20:31.608517  6726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30e88460611e47b2ba16a46a30b5f416" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 13 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:20:31.605293 11752 raft_consensus.cc:2804] T 853ac0a8cbd64ce99457f170216d4d0f P b7ab4784c7344b939bc36f639286f377 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:20:31.609205  6731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4b8bd455d5a47c18a1380839c6e0d61" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 14 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:31.612955  6731 raft_consensus.cc:2468] T f4b8bd455d5a47c18a1380839c6e0d61 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 13.
I20260709 13:20:31.614053  6726 raft_consensus.cc:2393] T 30e88460611e47b2ba16a46a30b5f416 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate b7ab4784c7344b939bc36f639286f377 in current term 13: Already voted for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in this term.
I20260709 13:20:31.609222  6770 leader_election.cc:304] T ce4f062dcd314d43a63ca74067cb5ee3 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb
I20260709 13:20:31.604281 11658 raft_consensus.cc:2749] T de3186201e1a40d0b335eeb8b4e256e0 P b7ab4784c7344b939bc36f639286f377 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:20:31.618652  6695 leader_election.cc:304] T f58dc08b12a2494bb9a1372837970ca2 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:20:31.614645 11588 raft_consensus.cc:3060] T b56bf91d90824c959e21e0cee5ba1816 P b7ab4784c7344b939bc36f639286f377 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:31.647889 11722 raft_consensus.cc:3055] T 3411566abe2d4c9bb4b2adfdd05e6f17 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:20:31.648414 11722 raft_consensus.cc:740] T 3411566abe2d4c9bb4b2adfdd05e6f17 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
I20260709 13:20:31.649246 11722 consensus_queue.cc:260] T 3411566abe2d4c9bb4b2adfdd05e6f17 P ccd8a4c3bfe3413cb2ae219b09aea832 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:31.650524 11722 raft_consensus.cc:3060] T 3411566abe2d4c9bb4b2adfdd05e6f17 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:20:31.654533  6697 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 92474.2us
I20260709 13:20:31.655184 11668 raft_consensus.cc:3055] T 427c124d773f483294511e80fe340075 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:20:31.655747 11668 raft_consensus.cc:740] T 427c124d773f483294511e80fe340075 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 7ba59cc884714e8aa5f3f0ecaed84cbb, State: Running, Role: LEADER
I20260709 13:20:31.641505 11567 leader_election.cc:290] T 30e88460611e47b2ba16a46a30b5f416 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 13 election: Requested vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:31.658447  6697 leader_election.cc:304] T 7c37d41cd9164c15a6826ca62a851a69 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
W20260709 13:20:31.660943  7468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 44610.6us
W20260709 13:20:31.663046  6770 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 53900.4us
W20260709 13:20:31.671761  6695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 53249.3us
I20260709 13:20:31.672727  6695 leader_election.cc:304] T 3d65025eea89441290d85dd053810e31 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:20:31.674309  6695 leader_election.cc:304] T b56bf91d90824c959e21e0cee5ba1816 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:20:31.674368  6731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09c2a98de1a4decabd0ff900dd44caa" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:31.675027  6731 raft_consensus.cc:2468] T f09c2a98de1a4decabd0ff900dd44caa P ccd8a4c3bfe3413cb2ae219b09aea832 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 15.
I20260709 13:20:31.664824  6770 leader_election.cc:304] T f4b8bd455d5a47c18a1380839c6e0d61 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
I20260709 13:20:31.675696  6732 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49998 (request call id 1206) took 2300 ms. Trace:
I20260709 13:20:31.674913  6881 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58592 (request call id 402) took 1409 ms. Trace:
I20260709 13:20:31.676837  6732 rpcz_store.cc:276] 0709 13:20:29.375831 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:30.158011 (+782180us) service_pool.cc:224] Handling call
0709 13:20:30.212121 (+ 54110us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:30.212691 (+   570us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:31.675446 (+1462755us) spinlock_profiling.cc:243] Waited 53.7 ms on lock 0x7b54003d5750. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f9a98ad 00007fcc1496e419 00007fcc0dee5bd4 00007fcc0dee5b62 00007fcc0dee5a91 00007fcc0dee5a0c 00007fcc0dee4cc2 00007fcc0dce548c 00007fcc0dce48c6 00007fcc0dce426f
0709 13:20:31.675619 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":123578752}
I20260709 13:20:31.677347  6881 rpcz_store.cc:276] 0709 13:20:30.265314 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:30.265583 (+   269us) service_pool.cc:224] Handling call
0709 13:20:30.311098 (+ 45515us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:30.867728 (+556630us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:31.674540 (+806812us) spinlock_profiling.cc:243] Waited 549 ms on lock 0x7b5400237dd4. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f9aae01 00007fcc0f9a983e 00007fcc1496e419 00007fcc0dee5bd4 00007fcc0dee5b62 00007fcc0dee5a91 00007fcc0dee5a0c 00007fcc0dee4cc2 00007fcc0dce548c 00007fcc0dce48c6
0709 13:20:31.674821 (+   281us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1263220480}
I20260709 13:20:31.623605 11752 raft_consensus.cc:697] T 853ac0a8cbd64ce99457f170216d4d0f P b7ab4784c7344b939bc36f639286f377 [term 12 LEADER]: Becoming Leader. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
I20260709 13:20:31.683552  6799 raft_consensus.cc:1275] T 8c7f33e544204fbaac4078e3e83bbf4e P b7ab4784c7344b939bc36f639286f377 [term 11 FOLLOWER]: Refusing update from remote peer ccd8a4c3bfe3413cb2ae219b09aea832: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:20:31.675700 11687 raft_consensus.cc:2804] T ce4f062dcd314d43a63ca74067cb5ee3 P b7ab4784c7344b939bc36f639286f377 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:20:31.670672 11802 raft_consensus.cc:2804] T 7c37d41cd9164c15a6826ca62a851a69 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 14 FOLLOWER]: Leader election won for term 14
W20260709 13:20:31.692682  6697 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:31.693595  6804 raft_consensus.cc:1240] T 9e326172347f45e99a0d482b5d8ef768 P b7ab4784c7344b939bc36f639286f377 [term 12 LEADER]: Rejecting Update request from peer ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 11. Current term is 12. Ops: []
I20260709 13:20:31.656728 11668 consensus_queue.cc:260] T 427c124d773f483294511e80fe340075 P 7ba59cc884714e8aa5f3f0ecaed84cbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } attrs { replace: true } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
W20260709 13:20:31.695092  6697 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:31.703055  6697 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:31.692308  6770 leader_election.cc:304] T f09c2a98de1a4decabd0ff900dd44caa P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
I20260709 13:20:31.677747 11634 raft_consensus.cc:2749] T f58dc08b12a2494bb9a1372837970ca2 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:20:31.711014  6732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77e330a82df4b43a745d57a68f6f057" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:31.708943  6802 raft_consensus.cc:1240] T de3186201e1a40d0b335eeb8b4e256e0 P b7ab4784c7344b939bc36f639286f377 [term 15 FOLLOWER]: Rejecting Update request from peer ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 14. Current term is 15. Ops: []
I20260709 13:20:31.695735  6804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a485a995abc4807b6e511e45419f737" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:20:31.699918  6798 raft_consensus.cc:1240] T a1704639a875409b9959353527b3fd68 P b7ab4784c7344b939bc36f639286f377 [term 15 LEADER]: Rejecting Update request from peer ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 14. Current term is 15. Ops: []
I20260709 13:20:31.713388  6807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c37d41cd9164c15a6826ca62a851a69" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:20:31.630035 11875 consensus_queue.cc:1048] T ce4f062dcd314d43a63ca74067cb5ee3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.065s
I20260709 13:20:31.715620  6803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90d42e216d9741e190bca19a781291fd" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 14 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:31.710779 11757 consensus_queue.cc:1059] T 34f36d59d88f40fe8a2805e604fc6c0a P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.020s
I20260709 13:20:31.682560 11567 raft_consensus.cc:493] T c4db81d9d329422bb3b4160ca4ac2d1d P ccd8a4c3bfe3413cb2ae219b09aea832 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:20:31.685070 11687 raft_consensus.cc:493] T ce4f062dcd314d43a63ca74067cb5ee3 P b7ab4784c7344b939bc36f639286f377 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:31.748659 11687 raft_consensus.cc:3060] T ce4f062dcd314d43a63ca74067cb5ee3 P b7ab4784c7344b939bc36f639286f377 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:31.688024 11796 raft_consensus.cc:2749] T b56bf91d90824c959e21e0cee5ba1816 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:20:31.752178 11567 raft_consensus.cc:515] T c4db81d9d329422bb3b4160ca4ac2d1d P ccd8a4c3bfe3413cb2ae219b09aea832 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:31.755280 11710 consensus_queue.cc:1059] T 44bde925b2e541b69890d70715b85176 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: INVALID_TERM, Last received: 13.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:20:31.736619 11511 leader_election.cc:290] T 7ba5dac66ab5497e9e336f2a3c28cda5 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:31.756450 11710 raft_consensus.cc:3055] T 44bde925b2e541b69890d70715b85176 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:20:31.756819 11710 raft_consensus.cc:740] T 44bde925b2e541b69890d70715b85176 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
I20260709 13:20:31.757342 11567 leader_election.cc:290] T c4db81d9d329422bb3b4160ca4ac2d1d P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:31.685699 11822 raft_consensus.cc:2804] T 3d65025eea89441290d85dd053810e31 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:20:31.757593 11710 consensus_queue.cc:260] T 44bde925b2e541b69890d70715b85176 P ccd8a4c3bfe3413cb2ae219b09aea832 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:31.758255 11822 raft_consensus.cc:493] T 3d65025eea89441290d85dd053810e31 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 13 FOLLOWER]: Starting leader election (detected failure of leader cd75a17ab2604397adab03bb8b5fd75c)
I20260709 13:20:31.758702 11822 raft_consensus.cc:3060] T 3d65025eea89441290d85dd053810e31 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:31.758910 11710 raft_consensus.cc:3060] T 44bde925b2e541b69890d70715b85176 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:31.724176 11817 consensus_queue.cc:1059] T 713b5728a197487c9300b310ab94e5a3 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.008s
I20260709 13:20:31.760175 11817 raft_consensus.cc:3055] T 713b5728a197487c9300b310ab94e5a3 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:20:31.760509 11817 raft_consensus.cc:740] T 713b5728a197487c9300b310ab94e5a3 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
I20260709 13:20:31.685288 11692 raft_consensus.cc:493] T f03d0dbf16864ca4bc1bb5e4c0334c0f P b7ab4784c7344b939bc36f639286f377 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:31.761118 11692 raft_consensus.cc:515] T f03d0dbf16864ca4bc1bb5e4c0334c0f P b7ab4784c7344b939bc36f639286f377 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:31.689244 11664 raft_consensus.cc:493] T 4f00a2e87e56452083b759f60d461ee3 P b7ab4784c7344b939bc36f639286f377 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:31.740458 11752 consensus_queue.cc:237] T 853ac0a8cbd64ce99457f170216d4d0f P b7ab4784c7344b939bc36f639286f377 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:31.740628 11636 raft_consensus.cc:515] T ab432e62819d499eaaf3dd55481dd930 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:31.741972 11660 raft_consensus.cc:3055] T 34f36d59d88f40fe8a2805e604fc6c0a P ccd8a4c3bfe3413cb2ae219b09aea832 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:20:31.693981 11658 raft_consensus.cc:493] T 711ef6523deb4cbe8ef2ba61e1c21c98 P b7ab4784c7344b939bc36f639286f377 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:31.745155 11668 raft_consensus.cc:3060] T 427c124d773f483294511e80fe340075 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:31.700801 11870 raft_consensus.cc:2804] T f4b8bd455d5a47c18a1380839c6e0d61 P b7ab4784c7344b939bc36f639286f377 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:20:31.755149  6807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d9def8b32fd443aa94ab1420b06837b" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:20:31.765990 11870 raft_consensus.cc:493] T f4b8bd455d5a47c18a1380839c6e0d61 P b7ab4784c7344b939bc36f639286f377 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:31.766449 11870 raft_consensus.cc:3060] T f4b8bd455d5a47c18a1380839c6e0d61 P b7ab4784c7344b939bc36f639286f377 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:31.767661 11692 leader_election.cc:290] T f03d0dbf16864ca4bc1bb5e4c0334c0f P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:31.762287  6803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30e88460611e47b2ba16a46a30b5f416" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:20:31.768388 11660 raft_consensus.cc:740] T 34f36d59d88f40fe8a2805e604fc6c0a P ccd8a4c3bfe3413cb2ae219b09aea832 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
I20260709 13:20:31.768913  6803 raft_consensus.cc:2393] T 30e88460611e47b2ba16a46a30b5f416 P b7ab4784c7344b939bc36f639286f377 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate ccd8a4c3bfe3413cb2ae219b09aea832 in current term 13: Already voted for candidate b7ab4784c7344b939bc36f639286f377 in this term.
I20260709 13:20:31.769428 11660 consensus_queue.cc:260] T 34f36d59d88f40fe8a2805e604fc6c0a P ccd8a4c3bfe3413cb2ae219b09aea832 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:31.770088  6803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce4f062dcd314d43a63ca74067cb5ee3" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:31.770841 11660 raft_consensus.cc:3060] T 34f36d59d88f40fe8a2805e604fc6c0a P ccd8a4c3bfe3413cb2ae219b09aea832 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:20:31.771462 11789 raft_consensus.cc:3060] T 7ba5dac66ab5497e9e336f2a3c28cda5 P cd75a17ab2604397adab03bb8b5fd75c [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:31.774179 11636 leader_election.cc:290] T ab432e62819d499eaaf3dd55481dd930 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 16 election: Requested vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:31.776693  6730 raft_consensus.cc:1240] T ab432e62819d499eaaf3dd55481dd930 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 16 FOLLOWER]: Rejecting Update request from peer b7ab4784c7344b939bc36f639286f377 for earlier term 15. Current term is 16. Ops: [15.8-15.8]
I20260709 13:20:31.761293 11817 consensus_queue.cc:260] T 713b5728a197487c9300b310ab94e5a3 P ccd8a4c3bfe3413cb2ae219b09aea832 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:31.720530 11802 raft_consensus.cc:697] T 7c37d41cd9164c15a6826ca62a851a69 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 14 LEADER]: Becoming Leader. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
W20260709 13:20:31.753528  6698 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:30.404714  6725 rpcz_store.cc:276] 0709 13:20:29.370634 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:30.156005 (+785371us) service_pool.cc:224] Handling call
0709 13:20:30.156420 (+   415us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:30.156729 (+   309us) raft_consensus.cc:1534] Early marking committed up to index 12
0709 13:20:30.157122 (+   393us) log.cc:844] Serialized 14 byte log entry
0709 13:20:30.403762 (+246640us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:20:30.403820 (+    58us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:20:30.403876 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:30.403946 (+    70us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:30.404119 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":108792,"prepare.queue_time_us":1635,"prepare.run_cpu_time_us":59,"prepare.run_wall_time_us":60,"raft.queue_time_us":119066,"thread_start_us":127227,"threads_started":1}
I20260709 13:20:31.764914  6723 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50004 (request call id 2297) took 2518 ms. Trace:
I20260709 13:20:31.781186  6723 rpcz_store.cc:276] 0709 13:20:29.246873 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:29.490880 (+244007us) service_pool.cc:224] Handling call
0709 13:20:29.515201 (+ 24321us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:30.076539 (+561338us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:30.076574 (+    35us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:20:30.076619 (+    45us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:20:30.076673 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:31.764570 (+1687897us) spinlock_profiling.cc:243] Waited 561 ms on lock 0x7b540009a1d4. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f9aae01 00007fcc0f9a983e 00007fcc1496e419 00007fcc0dee5bd4 00007fcc0dee5b62 00007fcc0dee5a91 00007fcc0dee5a0c 00007fcc0dee4cc2 00007fcc0dce548c 00007fcc0dce48c6
0709 13:20:31.764647 (+    77us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:31.764837 (+   190us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1290392448}
W20260709 13:20:31.800261  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 203484us
I20260709 13:20:31.803433  6723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f03d0dbf16864ca4bc1bb5e4c0334c0f" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:31.807018 11797 consensus_queue.cc:1048] T e77e330a82df4b43a745d57a68f6f057 P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:20:31.807128 11802 consensus_queue.cc:237] T 7c37d41cd9164c15a6826ca62a851a69 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:31.808424 11772 raft_consensus.cc:493] T 711ef6523deb4cbe8ef2ba61e1c21c98 P cd75a17ab2604397adab03bb8b5fd75c [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:31.809010 11772 raft_consensus.cc:515] T 711ef6523deb4cbe8ef2ba61e1c21c98 P cd75a17ab2604397adab03bb8b5fd75c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:31.810078  6873 raft_consensus.cc:1240] T de3186201e1a40d0b335eeb8b4e256e0 P cd75a17ab2604397adab03bb8b5fd75c [term 15 FOLLOWER]: Rejecting Update request from peer ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 14. Current term is 15. Ops: [14.8-14.8]
I20260709 13:20:31.811610  6873 raft_consensus.cc:1240] T 44bde925b2e541b69890d70715b85176 P cd75a17ab2604397adab03bb8b5fd75c [term 14 FOLLOWER]: Rejecting Update request from peer ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 13. Current term is 14. Ops: []
I20260709 13:20:31.813570  6873 raft_consensus.cc:1275] T bd6869f07b5a4885a0b99fbe60c3b175 P cd75a17ab2604397adab03bb8b5fd75c [term 14 FOLLOWER]: Refusing update from remote peer ccd8a4c3bfe3413cb2ae219b09aea832: Log matching property violated. Preceding OpId in replica: term: 12 index: 6. Preceding OpId from leader: term: 14 index: 7. (index mismatch)
I20260709 13:20:31.814491  6873 raft_consensus.cc:1275] T 7887766dc6784fcaa42b35c05fea7a99 P cd75a17ab2604397adab03bb8b5fd75c [term 14 FOLLOWER]: Refusing update from remote peer ccd8a4c3bfe3413cb2ae219b09aea832: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:20:31.815567  6873 raft_consensus.cc:1275] T 07a92dd554674067a83a9cb68c4773f2 P cd75a17ab2604397adab03bb8b5fd75c [term 13 FOLLOWER]: Refusing update from remote peer ccd8a4c3bfe3413cb2ae219b09aea832: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:20:31.832799  6807 raft_consensus.cc:1275] T 07a92dd554674067a83a9cb68c4773f2 P b7ab4784c7344b939bc36f639286f377 [term 13 FOLLOWER]: Refusing update from remote peer ccd8a4c3bfe3413cb2ae219b09aea832: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:20:31.835704  6873 raft_consensus.cc:1275] T 8c7f33e544204fbaac4078e3e83bbf4e P cd75a17ab2604397adab03bb8b5fd75c [term 11 FOLLOWER]: Refusing update from remote peer ccd8a4c3bfe3413cb2ae219b09aea832: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:20:31.838109  6732 raft_consensus.cc:2468] T e77e330a82df4b43a745d57a68f6f057 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 15.
I20260709 13:20:31.788296 11588 raft_consensus.cc:2749] T b56bf91d90824c959e21e0cee5ba1816 P b7ab4784c7344b939bc36f639286f377 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:20:31.835390 11744 raft_consensus.cc:2804] T f09c2a98de1a4decabd0ff900dd44caa P b7ab4784c7344b939bc36f639286f377 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:20:31.762346 11796 consensus_queue.cc:1059] T f03d0dbf16864ca4bc1bb5e4c0334c0f P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.086s
I20260709 13:20:31.783738 11658 raft_consensus.cc:515] T 711ef6523deb4cbe8ef2ba61e1c21c98 P b7ab4784c7344b939bc36f639286f377 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:31.800136 11636 consensus_queue.cc:1059] T 17587d6730594da4a56fa13a353232a1 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: INVALID_TERM, Last received: 18.12, Next index: 13, Last known committed idx: 11, Time since last communication: 0.055s
I20260709 13:20:31.785200 11664 raft_consensus.cc:515] T 4f00a2e87e56452083b759f60d461ee3 P b7ab4784c7344b939bc36f639286f377 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:20:31.839512 11649 raft_consensus.cc:493] T d8cee0accdb8499c86d4414b72565a38 P cd75a17ab2604397adab03bb8b5fd75c [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 7ba59cc884714e8aa5f3f0ecaed84cbb)
I20260709 13:20:31.866366  6844 leader_election.cc:304] T 90d42e216d9741e190bca19a781291fd P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:20:31.870438  6873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab432e62819d499eaaf3dd55481dd930" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:20:31.810920 11798 raft_consensus.cc:515] T f5be3a11b23d4ea9b08300a2789821c7 P b7ab4784c7344b939bc36f639286f377 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:31.874322  6881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4db81d9d329422bb3b4160ca4ac2d1d" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:31.839176 11793 consensus_queue.cc:1048] T f5be3a11b23d4ea9b08300a2789821c7 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.034s
I20260709 13:20:31.886794  7501 raft_consensus.cc:1240] T 3fa34c08b205435dba97346991aa1f92 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 16 FOLLOWER]: Rejecting Update request from peer cd75a17ab2604397adab03bb8b5fd75c for earlier term 15. Current term is 16. Ops: []
I20260709 13:20:31.886806  6881 raft_consensus.cc:2468] T c4db81d9d329422bb3b4160ca4ac2d1d P cd75a17ab2604397adab03bb8b5fd75c [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 12.
I20260709 13:20:31.873014 11817 raft_consensus.cc:3060] T 713b5728a197487c9300b310ab94e5a3 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:31.857956 11757 consensus_queue.cc:1048] T 8c7f33e544204fbaac4078e3e83bbf4e P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.026s
I20260709 13:20:31.870941 11803 consensus_queue.cc:1059] T 3d65025eea89441290d85dd053810e31 P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.022s
I20260709 13:20:31.871505 11749 raft_consensus.cc:515] T 7887766dc6784fcaa42b35c05fea7a99 P b7ab4784c7344b939bc36f639286f377 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:31.882272 11795 consensus_queue.cc:1048] T bd6869f07b5a4885a0b99fbe60c3b175 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.055s
I20260709 13:20:31.900942 11810 raft_consensus.cc:3055] T f03d0dbf16864ca4bc1bb5e4c0334c0f P ccd8a4c3bfe3413cb2ae219b09aea832 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:20:31.898016 11786 raft_consensus.cc:2749] T 90d42e216d9741e190bca19a781291fd P cd75a17ab2604397adab03bb8b5fd75c [term 14 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:20:31.984401  6875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30e88460611e47b2ba16a46a30b5f416" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:20:31.904273 11683 raft_consensus.cc:3055] T 17587d6730594da4a56fa13a353232a1 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 18 LEADER]: Stepping down as leader of term 18
W20260709 13:20:31.979298 11869 log.cc:927] Time spent T 4275cf08e63345f993bce8664eada830 P ccd8a4c3bfe3413cb2ae219b09aea832: Append to log took a long time: real 0.082s	user 0.000s	sys 0.000s
I20260709 13:20:31.996073  6875 raft_consensus.cc:3060] T 30e88460611e47b2ba16a46a30b5f416 P cd75a17ab2604397adab03bb8b5fd75c [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:31.942054 11772 leader_election.cc:290] T 711ef6523deb4cbe8ef2ba61e1c21c98 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:20:31.898564 11674 consensus_queue.cc:1048] T 7887766dc6784fcaa42b35c05fea7a99 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.095s
I20260709 13:20:31.998384  6807 raft_consensus.cc:1240] T 7887766dc6784fcaa42b35c05fea7a99 P b7ab4784c7344b939bc36f639286f377 [term 15 FOLLOWER]: Rejecting Update request from peer ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 14. Current term is 15. Ops: []
W20260709 13:20:31.977515 11742 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.457s	user 0.025s	sys 0.041s
I20260709 13:20:31.899335 11567 consensus_queue.cc:1048] T 07a92dd554674067a83a9cb68c4773f2 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.086s
I20260709 13:20:31.996663  6806 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:38240 (request call id 11) took 2232 ms. Trace:
I20260709 13:20:31.890255 11649 raft_consensus.cc:515] T d8cee0accdb8499c86d4414b72565a38 P cd75a17ab2604397adab03bb8b5fd75c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:20:31.978397 11636 consensus_queue.cc:1048] T 8c7f33e544204fbaac4078e3e83bbf4e P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.041s
W20260709 13:20:32.002699 11880 log.cc:927] Time spent T 9e326172347f45e99a0d482b5d8ef768 P ccd8a4c3bfe3413cb2ae219b09aea832: Append to log took a long time: real 0.103s	user 0.000s	sys 0.000s
I20260709 13:20:32.025159 11649 leader_election.cc:290] T d8cee0accdb8499c86d4414b72565a38 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:20:31.962935 11711 consensus_queue.cc:1059] T 3fa34c08b205435dba97346991aa1f92 P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false }, Status: INVALID_TERM, Last received: 15.13, Next index: 14, Last known committed idx: 12, Time since last communication: 0.048s
I20260709 13:20:32.010780  6806 rpcz_store.cc:276] 0709 13:20:29.759793 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:30.120522 (+360729us) service_pool.cc:224] Handling call
0709 13:20:31.991954 (+1871432us) spinlock_profiling.cc:243] Waited 112 ms on lock 0x7b54001f7f54. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f9a4853 00007fcc1497260a 00007fcc0def87d4 00007fcc0def8762 00007fcc0def8691 00007fcc0def860c 00007fcc0def78c2 00007fcc0dce548c 00007fcc0dce48c6 00007fcc0dce426f
0709 13:20:31.992143 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":256453504}
I20260709 13:20:31.992833 11810 raft_consensus.cc:740] T f03d0dbf16864ca4bc1bb5e4c0334c0f P ccd8a4c3bfe3413cb2ae219b09aea832 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
W20260709 13:20:32.002610 11879 log.cc:927] Time spent T a3022224cc81473690653a83d4e99470 P ccd8a4c3bfe3413cb2ae219b09aea832: Append to log took a long time: real 0.099s	user 0.000s	sys 0.000s
I20260709 13:20:31.937434 11860 consensus_queue.cc:1048] T dbdf895bba214ff68685a24fd17dfb5d P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.105s
W20260709 13:20:32.011420 11742 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.490s	user 0.026s	sys 0.041s
I20260709 13:20:32.043252  6875 raft_consensus.cc:2468] T 30e88460611e47b2ba16a46a30b5f416 P cd75a17ab2604397adab03bb8b5fd75c [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 13.
I20260709 13:20:32.048774 11664 leader_election.cc:290] T 4f00a2e87e56452083b759f60d461ee3 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
W20260709 13:20:32.049403 11883 log.cc:927] Time spent T b3f13b31a1f84f0d89d007eadd57924c P ccd8a4c3bfe3413cb2ae219b09aea832: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 13:20:32.053375  6875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe20b4b48823486ca3b9c648db6ce8aa" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:32.054994  6875 raft_consensus.cc:1240] T a1704639a875409b9959353527b3fd68 P cd75a17ab2604397adab03bb8b5fd75c [term 15 FOLLOWER]: Rejecting Update request from peer ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 14. Current term is 15. Ops: [12.8-14.9]
I20260709 13:20:32.035351  6806 raft_consensus.cc:1275] T bd6869f07b5a4885a0b99fbe60c3b175 P b7ab4784c7344b939bc36f639286f377 [term 14 FOLLOWER]: Refusing update from remote peer ccd8a4c3bfe3413cb2ae219b09aea832: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 14 index: 7. (term mismatch)
I20260709 13:20:32.001699 11683 raft_consensus.cc:740] T 17587d6730594da4a56fa13a353232a1 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
I20260709 13:20:32.062350  6731 raft_consensus.cc:1240] T 7c37d41cd9164c15a6826ca62a851a69 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 14 LEADER]: Rejecting Update request from peer b7ab4784c7344b939bc36f639286f377 for earlier term 13. Current term is 14. Ops: []
I20260709 13:20:32.069705  6804 raft_consensus.cc:2468] T 3a485a995abc4807b6e511e45419f737 P b7ab4784c7344b939bc36f639286f377 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 13.
I20260709 13:20:32.071821  6806 pending_rounds.cc:85] T bd6869f07b5a4885a0b99fbe60c3b175 P b7ab4784c7344b939bc36f639286f377: Aborting all ops after (but not including) 6
I20260709 13:20:32.072750  6806 pending_rounds.cc:107] T bd6869f07b5a4885a0b99fbe60c3b175 P b7ab4784c7344b939bc36f639286f377: Aborting uncommitted NO_OP operation due to leader change: 13.7
I20260709 13:20:32.073089  6806 raft_consensus.cc:2889] T bd6869f07b5a4885a0b99fbe60c3b175 P b7ab4784c7344b939bc36f639286f377 [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:20:32.084497 11683 consensus_queue.cc:260] T 17587d6730594da4a56fa13a353232a1 P ccd8a4c3bfe3413cb2ae219b09aea832 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 12, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:20:32.086092 11683 raft_consensus.cc:3060] T 17587d6730594da4a56fa13a353232a1 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:20:32.086850 11870 raft_consensus.cc:515] T f4b8bd455d5a47c18a1380839c6e0d61 P b7ab4784c7344b939bc36f639286f377 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
W20260709 13:20:32.093794  7466 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:32.098852 11658 leader_election.cc:290] T 711ef6523deb4cbe8ef2ba61e1c21c98 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:32.100523  6806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ba5dac66ab5497e9e336f2a3c28cda5" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:32.103035  7495 raft_consensus.cc:1240] T 17587d6730594da4a56fa13a353232a1 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 19 FOLLOWER]: Rejecting Update request from peer ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 18. Current term is 19. Ops: [16.11-18.12]
I20260709 13:20:32.105666  6806 raft_consensus.cc:2393] T 7ba5dac66ab5497e9e336f2a3c28cda5 P b7ab4784c7344b939bc36f639286f377 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in current term 14: Already voted for candidate b7ab4784c7344b939bc36f639286f377 in this term.
W20260709 13:20:32.092654 11868 log.cc:927] Time spent T 7c44c4849aa54f2b94d1f1bef9ed546f P ccd8a4c3bfe3413cb2ae219b09aea832: Append to log took a long time: real 0.651s	user 0.003s	sys 0.001s
I20260709 13:20:32.099172 11774 consensus_queue.cc:1048] T ce4f062dcd314d43a63ca74067cb5ee3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.012s
I20260709 13:20:32.110910  7503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe20b4b48823486ca3b9c648db6ce8aa" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:20:32.118712  6799 raft_consensus.cc:1240] T f09c2a98de1a4decabd0ff900dd44caa P b7ab4784c7344b939bc36f639286f377 [term 15 FOLLOWER]: Rejecting Update request from peer ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 14. Current term is 15. Ops: []
I20260709 13:20:32.119307  7495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce4f062dcd314d43a63ca74067cb5ee3" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:20:32.116940  7501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b8cacb381b746da8d0049b0a83b41dd" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:20:32.119685  7466 leader_election.cc:304] T 3fa34c08b205435dba97346991aa1f92 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:20:32.121701  7466 leader_election.cc:304] T b3f13b31a1f84f0d89d007eadd57924c P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:20:32.105435 11687 raft_consensus.cc:515] T ce4f062dcd314d43a63ca74067cb5ee3 P b7ab4784c7344b939bc36f639286f377 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } attrs { replace: true } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:20:32.123418 11798 leader_election.cc:290] T f5be3a11b23d4ea9b08300a2789821c7 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 13 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:32.101055 11875 consensus_queue.cc:1048] T 4f00a2e87e56452083b759f60d461ee3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.024s
I20260709 13:20:32.126041  6803 raft_consensus.cc:2393] T ce4f062dcd314d43a63ca74067cb5ee3 P b7ab4784c7344b939bc36f639286f377 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ccd8a4c3bfe3413cb2ae219b09aea832 in current term 15: Already voted for candidate b7ab4784c7344b939bc36f639286f377 in this term.
W20260709 13:20:32.126757  6697 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:32.096315 11810 consensus_queue.cc:260] T f03d0dbf16864ca4bc1bb5e4c0334c0f P ccd8a4c3bfe3413cb2ae219b09aea832 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:32.128080 11810 raft_consensus.cc:3060] T f03d0dbf16864ca4bc1bb5e4c0334c0f P ccd8a4c3bfe3413cb2ae219b09aea832 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:32.128196 11878 raft_consensus.cc:2749] T 3fa34c08b205435dba97346991aa1f92 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:20:32.129755 11668 consensus_queue.cc:1048] T bb3d8792045a4583ae2e965b1350a5b4 P 7ba59cc884714e8aa5f3f0ecaed84cbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:20:32.125540 11687 leader_election.cc:290] T ce4f062dcd314d43a63ca74067cb5ee3 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 15 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
W20260709 13:20:32.134753 11865 log.cc:927] Time spent T f58dc08b12a2494bb9a1372837970ca2 P cd75a17ab2604397adab03bb8b5fd75c: Append to log took a long time: real 0.685s	user 0.004s	sys 0.000s
W20260709 13:20:32.137101 11864 log.cc:927] Time spent T 20f6842e26174571996b8dea4151d4be P ccd8a4c3bfe3413cb2ae219b09aea832: Append to log took a long time: real 0.695s	user 0.000s	sys 0.011s
I20260709 13:20:32.138788  6727 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50004 (request call id 2304) took 1476 ms. Trace:
I20260709 13:20:32.139207  6727 rpcz_store.cc:276] 0709 13:20:30.662555 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:30.836685 (+174130us) service_pool.cc:224] Handling call
0709 13:20:30.836989 (+   304us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:31.277124 (+440135us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:31.277159 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:20:31.277773 (+   614us) log.cc:844] Serialized 26 byte log entry
0709 13:20:31.393108 (+115335us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:20:31.393158 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:31.393376 (+   218us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:32.136479 (+743103us) spinlock_profiling.cc:243] Waited 2.29 ms on lock 0x7b4400022b4c. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0c745db1 00007fcc0c7e3c85 00007fcc0c7e46a2 00007fcc0f5561db 00007fcc0f551aaf 00007fcc0f54586e 00007fcc0f544bb6 00007fcc0f5447d8 00007fcc0f54e221 00007fcc0f54e1d9 00007fcc0f54e169
0709 13:20:32.138371 (+  1892us) raft_consensus.cc:1685] finished
0709 13:20:32.138397 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:32.138716 (+   319us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":439699,"raft.queue_time_us":442008,"raft.run_cpu_time_us":99,"raft.run_wall_time_us":98,"spinlock_wait_cycles":5268736,"thread_start_us":114727,"threads_started":1,"wal-append.queue_time_us":163414}
W20260709 13:20:32.141644  6800 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:32966 (request call id 1225) took 1771 ms (client timeout 1990 ms). Trace:
W20260709 13:20:32.142159  6800 rpcz_store.cc:269] 0709 13:20:30.370492 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:30.440307 (+ 69815us) service_pool.cc:224] Handling call
0709 13:20:32.141441 (+1701134us) spinlock_profiling.cc:243] Waited 280 ms on lock 0x7b54002c8dd4. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f9ae2fa 00007fcc1496fb17 00007fcc0deea6d4 00007fcc0deea662 00007fcc0deea591 00007fcc0deea50c 00007fcc0dee97c2 00007fcc0dce548c 00007fcc0dce48c6 00007fcc0dce426f
0709 13:20:32.141578 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":645140352}
I20260709 13:20:32.143654 11511 raft_consensus.cc:2749] T b3f13b31a1f84f0d89d007eadd57924c P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:20:32.144991 11845 log.cc:927] Time spent T bb7fa124c3bf4ef9ab65a407cb008441 P cd75a17ab2604397adab03bb8b5fd75c: Append to log took a long time: real 1.243s	user 0.004s	sys 0.030s
I20260709 13:20:32.145411 11837 consensus_queue.cc:1048] T ce4f062dcd314d43a63ca74067cb5ee3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:20:32.146466 11649 raft_consensus.cc:493] T 427c124d773f483294511e80fe340075 P cd75a17ab2604397adab03bb8b5fd75c [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 7ba59cc884714e8aa5f3f0ecaed84cbb)
W20260709 13:20:32.147238  6772 consensus_peers.cc:597] T 7a734b5ab7834e05a8c422208acc58b1 P b7ab4784c7344b939bc36f639286f377 -> Peer 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071): Couldn't send request to peer 7ba59cc884714e8aa5f3f0ecaed84cbb. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 7a734b5ab7834e05a8c422208acc58b1. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:32.147039 11649 raft_consensus.cc:515] T 427c124d773f483294511e80fe340075 P cd75a17ab2604397adab03bb8b5fd75c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } attrs { replace: true } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
W20260709 13:20:32.147749  6772 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.68:45071, user_credentials={real_user=slave}} blocked reactor thread for 800094us
I20260709 13:20:32.148547  6772 leader_election.cc:304] T bd6869f07b5a4885a0b99fbe60c3b175 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:20:32.148978  6697 leader_election.cc:304] T 4b8cacb381b746da8d0049b0a83b41dd P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:20:32.149816  6772 leader_election.cc:304] T 8c7f33e544204fbaac4078e3e83bbf4e P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:20:32.152323 11666 leader_election.cc:290] T f09c2a98de1a4decabd0ff900dd44caa P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:32.153091 11710 raft_consensus.cc:2749] T 4b8cacb381b746da8d0049b0a83b41dd P ccd8a4c3bfe3413cb2ae219b09aea832 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:20:32.152359 11882 log.cc:927] Time spent T d8292e16e5654be6bc408560cf256aaa P ccd8a4c3bfe3413cb2ae219b09aea832: Append to log took a long time: real 0.089s	user 0.000s	sys 0.001s
I20260709 13:20:32.108575 11700 raft_consensus.cc:493] T 4f00a2e87e56452083b759f60d461ee3 P cd75a17ab2604397adab03bb8b5fd75c [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:32.154541 11700 raft_consensus.cc:515] T 4f00a2e87e56452083b759f60d461ee3 P cd75a17ab2604397adab03bb8b5fd75c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:20:32.155107  6876 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58592 (request call id 408) took 1050 ms. Trace:
I20260709 13:20:32.155542  6876 rpcz_store.cc:276] 0709 13:20:31.104974 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:31.105211 (+   237us) service_pool.cc:224] Handling call
0709 13:20:31.105628 (+   417us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:31.165582 (+ 59954us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:32.154817 (+989235us) spinlock_profiling.cc:243] Waited 58 ms on lock 0x7b540021a2d4. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f9aae01 00007fcc0f9a983e 00007fcc1496e419 00007fcc0dee5bd4 00007fcc0dee5b62 00007fcc0dee5a91 00007fcc0dee5a0c 00007fcc0dee4cc2 00007fcc0dce548c 00007fcc0dce48c6
0709 13:20:32.155037 (+   220us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":133462272}
I20260709 13:20:32.156157  6803 raft_consensus.cc:1240] T ce4f062dcd314d43a63ca74067cb5ee3 P b7ab4784c7344b939bc36f639286f377 [term 15 FOLLOWER]: Rejecting Update request from peer 7ba59cc884714e8aa5f3f0ecaed84cbb for earlier term 14. Current term is 15. Ops: [14.10-14.10]
I20260709 13:20:32.158201 11649 leader_election.cc:290] T 427c124d773f483294511e80fe340075 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:20:32.161109 11798 raft_consensus.cc:2804] T bd6869f07b5a4885a0b99fbe60c3b175 P b7ab4784c7344b939bc36f639286f377 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:20:32.161616 11798 raft_consensus.cc:493] T bd6869f07b5a4885a0b99fbe60c3b175 P b7ab4784c7344b939bc36f639286f377 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:32.161983 11798 raft_consensus.cc:3060] T bd6869f07b5a4885a0b99fbe60c3b175 P b7ab4784c7344b939bc36f639286f377 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:32.163748  6805 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50550 (request call id 539) took 1795 ms. Trace:
I20260709 13:20:32.158006 11774 consensus_queue.cc:1059] T ce4f062dcd314d43a63ca74067cb5ee3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: INVALID_TERM, Last received: 12.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:20:32.164218  6805 rpcz_store.cc:276] 0709 13:20:30.368782 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:30.591106 (+222324us) service_pool.cc:224] Handling call
0709 13:20:30.620445 (+ 29339us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:30.653624 (+ 33179us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 13:20:30.712919 (+ 59295us) log.cc:844] Serialized 14 byte log entry
0709 13:20:30.915695 (+202776us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:20:30.915767 (+    72us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:20:30.915821 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:32.163513 (+1247692us) spinlock_profiling.cc:243] Waited 32.8 ms on lock 0x7b54001cb6d4. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f9aae01 00007fcc0f9a983e 00007fcc1496e419 00007fcc0dee5bd4 00007fcc0dee5b62 00007fcc0dee5a91 00007fcc0dee5a0c 00007fcc0dee4cc2 00007fcc0dce548c 00007fcc0dce48c6
0709 13:20:32.163560 (+    47us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:32.163689 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":45231,"prepare.queue_time_us":60533,"prepare.run_cpu_time_us":41,"prepare.run_wall_time_us":43,"raft.queue_time_us":53799,"raft.run_cpu_time_us":102,"raft.run_wall_time_us":103,"spinlock_wait_cycles":75521280,"thread_start_us":155950,"threads_started":1,"wal-append.queue_time_us":245715,"wal-append.run_cpu_time_us":2032,"wal-append.run_wall_time_us":1180921}
I20260709 13:20:32.167729  6874 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53406 (request call id 2331) took 1495 ms. Trace:
I20260709 13:20:32.171546  6874 rpcz_store.cc:276] 0709 13:20:30.672749 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:30.974527 (+301778us) service_pool.cc:224] Handling call
0709 13:20:30.974921 (+   394us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:30.988170 (+ 13249us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:32.167450 (+1179280us) spinlock_profiling.cc:243] Waited 12.2 ms on lock 0x7b54000b3bd4. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f9aae01 00007fcc0f9a983e 00007fcc1496e419 00007fcc0dee5bd4 00007fcc0dee5b62 00007fcc0dee5a91 00007fcc0dee5a0c 00007fcc0dee4cc2 00007fcc0dce548c 00007fcc0dce48c6
0709 13:20:32.167655 (+   205us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":28122880}
I20260709 13:20:32.175011  7501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce4f062dcd314d43a63ca74067cb5ee3" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb"
I20260709 13:20:32.175591 11654 raft_consensus.cc:3055] T 7c37d41cd9164c15a6826ca62a851a69 P b7ab4784c7344b939bc36f639286f377 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:20:32.170445 11658 raft_consensus.cc:2804] T 8c7f33e544204fbaac4078e3e83bbf4e P b7ab4784c7344b939bc36f639286f377 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:20:32.176766 11658 raft_consensus.cc:493] T 8c7f33e544204fbaac4078e3e83bbf4e P b7ab4784c7344b939bc36f639286f377 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:32.177232 11658 raft_consensus.cc:3060] T 8c7f33e544204fbaac4078e3e83bbf4e P b7ab4784c7344b939bc36f639286f377 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:20:32.177276  7495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f00a2e87e56452083b759f60d461ee3" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:20:32.178406  6874 raft_consensus.cc:3055] T a3022224cc81473690653a83d4e99470 P cd75a17ab2604397adab03bb8b5fd75c [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:20:32.179049  6874 raft_consensus.cc:740] T a3022224cc81473690653a83d4e99470 P cd75a17ab2604397adab03bb8b5fd75c [term 14 LEADER]: Becoming Follower/Learner. State: Replica: cd75a17ab2604397adab03bb8b5fd75c, State: Running, Role: LEADER
I20260709 13:20:32.179203 11700 leader_election.cc:290] T 4f00a2e87e56452083b759f60d461ee3 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:20:32.179906 11837 raft_consensus.cc:3055] T ce4f062dcd314d43a63ca74067cb5ee3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:20:32.180299 11837 raft_consensus.cc:740] T ce4f062dcd314d43a63ca74067cb5ee3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 7ba59cc884714e8aa5f3f0ecaed84cbb, State: Running, Role: LEADER
I20260709 13:20:32.176108 11654 raft_consensus.cc:740] T 7c37d41cd9164c15a6826ca62a851a69 P b7ab4784c7344b939bc36f639286f377 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
I20260709 13:20:32.181022 11870 leader_election.cc:290] T f4b8bd455d5a47c18a1380839c6e0d61 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 14 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:32.181839  6874 consensus_queue.cc:260] T a3022224cc81473690653a83d4e99470 P cd75a17ab2604397adab03bb8b5fd75c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:32.197654 11693 raft_consensus.cc:493] T 34f36d59d88f40fe8a2805e604fc6c0a P b7ab4784c7344b939bc36f639286f377 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:32.198098 11725 raft_consensus.cc:493] T a3022224cc81473690653a83d4e99470 P b7ab4784c7344b939bc36f639286f377 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:32.181216 11837 consensus_queue.cc:260] T ce4f062dcd314d43a63ca74067cb5ee3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.10, Last appended by leader: 10, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } attrs { replace: true } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:20:32.223006 11837 raft_consensus.cc:3060] T ce4f062dcd314d43a63ca74067cb5ee3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:20:32.224175  7467 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:32.236613  6876 raft_consensus.cc:1275] T 7c37d41cd9164c15a6826ca62a851a69 P cd75a17ab2604397adab03bb8b5fd75c [term 14 FOLLOWER]: Refusing update from remote peer ccd8a4c3bfe3413cb2ae219b09aea832: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:20:32.242326 11749 leader_election.cc:290] T 7887766dc6784fcaa42b35c05fea7a99 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 15 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:32.206869 11822 raft_consensus.cc:515] T 3d65025eea89441290d85dd053810e31 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:32.225178 11725 raft_consensus.cc:515] T a3022224cc81473690653a83d4e99470 P b7ab4784c7344b939bc36f639286f377 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:32.252907 11725 leader_election.cc:290] T a3022224cc81473690653a83d4e99470 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:32.225795 11693 raft_consensus.cc:515] T 34f36d59d88f40fe8a2805e604fc6c0a P b7ab4784c7344b939bc36f639286f377 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:32.256757 11822 leader_election.cc:290] T 3d65025eea89441290d85dd053810e31 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 14 election: Requested vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:32.258194 11693 leader_election.cc:290] T 34f36d59d88f40fe8a2805e604fc6c0a P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:32.265775  6876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d65025eea89441290d85dd053810e31" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:20:32.269126  6695 leader_election.cc:304] T 90d42e216d9741e190bca19a781291fd P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:20:32.231946 11798 raft_consensus.cc:515] T bd6869f07b5a4885a0b99fbe60c3b175 P b7ab4784c7344b939bc36f639286f377 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:32.274458  6695 leader_election.cc:304] T 4d9def8b32fd443aa94ab1420b06837b P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:20:32.274972  6728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "711ef6523deb4cbe8ef2ba61e1c21c98" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:32.275792  6727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce4f062dcd314d43a63ca74067cb5ee3" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:20:32.226146 11654 consensus_queue.cc:260] T 7c37d41cd9164c15a6826ca62a851a69 P b7ab4784c7344b939bc36f639286f377 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:32.275180  6726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7887766dc6784fcaa42b35c05fea7a99" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:20:32.280880  6878 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53406 (request call id 2349) took 1062 ms. Trace:
I20260709 13:20:32.276752  6876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30e88460611e47b2ba16a46a30b5f416" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 13 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:20:32.278267  6770 leader_election.cc:304] T e77e330a82df4b43a745d57a68f6f057 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
I20260709 13:20:32.278821  6727 raft_consensus.cc:3060] T ce4f062dcd314d43a63ca74067cb5ee3 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:32.281599  6878 rpcz_store.cc:276] 0709 13:20:31.218791 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:31.442918 (+224127us) service_pool.cc:224] Handling call
0709 13:20:31.443303 (+   385us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:31.775136 (+331833us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:31.775173 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:20:31.775919 (+   746us) log.cc:844] Serialized 26 byte log entry
0709 13:20:32.094645 (+318726us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:20:32.094712 (+    67us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:32.094820 (+   108us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:32.280627 (+185807us) raft_consensus.cc:1685] finished
0709 13:20:32.280653 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:32.280810 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":346487,"raft.queue_time_us":341103,"raft.run_cpu_time_us":149,"raft.run_wall_time_us":23355,"thread_start_us":318148,"threads_started":1,"wal-append.queue_time_us":434862}
I20260709 13:20:32.288482  6878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f00a2e87e56452083b759f60d461ee3" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:32.289036  6726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4b8bd455d5a47c18a1380839c6e0d61" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 14 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:20:32.289695  6726 raft_consensus.cc:3060] T f4b8bd455d5a47c18a1380839c6e0d61 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:32.289211  6878 raft_consensus.cc:2468] T 4f00a2e87e56452083b759f60d461ee3 P cd75a17ab2604397adab03bb8b5fd75c [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 14.
I20260709 13:20:32.292285  6878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d65025eea89441290d85dd053810e31" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:20:32.292428  6875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "853ac0a8cbd64ce99457f170216d4d0f" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:20:32.293123  6875 raft_consensus.cc:3060] T 853ac0a8cbd64ce99457f170216d4d0f P cd75a17ab2604397adab03bb8b5fd75c [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:20:32.285205  6695 leader_election.cc:304] T 3a485a995abc4807b6e511e45419f737 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:20:32.283514  6876 raft_consensus.cc:2393] T 30e88460611e47b2ba16a46a30b5f416 P cd75a17ab2604397adab03bb8b5fd75c [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate b7ab4784c7344b939bc36f639286f377 in current term 13: Already voted for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in this term.
I20260709 13:20:32.295666  6727 raft_consensus.cc:2468] T ce4f062dcd314d43a63ca74067cb5ee3 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 15.
I20260709 13:20:32.296429  6732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5be3a11b23d4ea9b08300a2789821c7" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:20:32.299515  6878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a92dd554674067a83a9cb68c4773f2" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:32.300964 11664 raft_consensus.cc:2804] T e77e330a82df4b43a745d57a68f6f057 P b7ab4784c7344b939bc36f639286f377 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:20:32.301453 11664 raft_consensus.cc:493] T e77e330a82df4b43a745d57a68f6f057 P b7ab4784c7344b939bc36f639286f377 [term 15 FOLLOWER]: Starting leader election (detected failure of leader cd75a17ab2604397adab03bb8b5fd75c)
I20260709 13:20:32.301859 11664 raft_consensus.cc:3060] T e77e330a82df4b43a745d57a68f6f057 P b7ab4784c7344b939bc36f639286f377 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:32.286835 11757 raft_consensus.cc:2749] T 4d9def8b32fd443aa94ab1420b06837b P ccd8a4c3bfe3413cb2ae219b09aea832 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:20:32.280625 11700 raft_consensus.cc:493] T de3186201e1a40d0b335eeb8b4e256e0 P cd75a17ab2604397adab03bb8b5fd75c [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:32.303473 11700 raft_consensus.cc:515] T de3186201e1a40d0b335eeb8b4e256e0 P cd75a17ab2604397adab03bb8b5fd75c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:32.301640 11710 consensus_queue.cc:1048] T bd6869f07b5a4885a0b99fbe60c3b175 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:20:32.304692 11817 raft_consensus.cc:2804] T 3a485a995abc4807b6e511e45419f737 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:20:32.305265 11817 raft_consensus.cc:697] T 3a485a995abc4807b6e511e45419f737 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 13 LEADER]: Becoming Leader. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
I20260709 13:20:32.306095 11700 leader_election.cc:290] T de3186201e1a40d0b335eeb8b4e256e0 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:20:32.305471 11576 consensus_queue.cc:260] T 3fa34c08b205435dba97346991aa1f92 P cd75a17ab2604397adab03bb8b5fd75c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:20:32.272622 11822 raft_consensus.cc:493] T be1a92657f494cac8dd227d152f50151 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 7ba59cc884714e8aa5f3f0ecaed84cbb)
I20260709 13:20:32.307152 11822 raft_consensus.cc:515] T be1a92657f494cac8dd227d152f50151 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:20:32.286634 11889 raft_consensus.cc:493] T 711ef6523deb4cbe8ef2ba61e1c21c98 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:32.309181 11889 raft_consensus.cc:515] T 711ef6523deb4cbe8ef2ba61e1c21c98 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:32.309650 11822 leader_election.cc:290] T be1a92657f494cac8dd227d152f50151 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:20:32.312512 11889 leader_election.cc:290] T 711ef6523deb4cbe8ef2ba61e1c21c98 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:32.276630 11635 raft_consensus.cc:2749] T 90d42e216d9741e190bca19a781291fd P ccd8a4c3bfe3413cb2ae219b09aea832 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:20:32.286376 11634 consensus_queue.cc:1048] T 07a92dd554674067a83a9cb68c4773f2 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.028s
I20260709 13:20:32.317420  6732 raft_consensus.cc:1275] T 3411566abe2d4c9bb4b2adfdd05e6f17 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 12 FOLLOWER]: Refusing update from remote peer b7ab4784c7344b939bc36f639286f377: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:20:32.317687  7495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be1a92657f494cac8dd227d152f50151" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:20:32.318651  6728 raft_consensus.cc:2468] T 711ef6523deb4cbe8ef2ba61e1c21c98 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 15.
I20260709 13:20:32.297614  6695 leader_election.cc:304] T ce4f062dcd314d43a63ca74067cb5ee3 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, b7ab4784c7344b939bc36f639286f377
I20260709 13:20:32.323313  6878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5be3a11b23d4ea9b08300a2789821c7" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
W20260709 13:20:32.323443  6845 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:32.324522  6876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "711ef6523deb4cbe8ef2ba61e1c21c98" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:32.325345  6876 raft_consensus.cc:2410] T 711ef6523deb4cbe8ef2ba61e1c21c98 P cd75a17ab2604397adab03bb8b5fd75c [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7ab4784c7344b939bc36f639286f377 for term 16 because replica has last-logged OpId of term: 14 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 8.
I20260709 13:20:32.325675  6800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "404190ce4ce94cecbfcb6ea9d1dd8626" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:32.328025  6805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1528ab62b6fe4e3099d08f141afee116" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:32.328357  6803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22ccee1b570c4ad3a57bd7aec085b1b4" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:20:32.328678  6801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4db81d9d329422bb3b4160ca4ac2d1d" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:32.330425  6800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab432e62819d499eaaf3dd55481dd930" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:20:32.328433  6729 raft_consensus.cc:1275] T 17587d6730594da4a56fa13a353232a1 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 19 FOLLOWER]: Refusing update from remote peer b7ab4784c7344b939bc36f639286f377: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260709 13:20:32.333559  6806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d65025eea89441290d85dd053810e31" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
W20260709 13:20:32.319965 11834 log.cc:927] Time spent T 7887766dc6784fcaa42b35c05fea7a99 P ccd8a4c3bfe3413cb2ae219b09aea832: Append to log took a long time: real 1.557s	user 0.006s	sys 0.000s
I20260709 13:20:32.346107  6732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34f36d59d88f40fe8a2805e604fc6c0a" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:32.370074  6801 raft_consensus.cc:1240] T bd6869f07b5a4885a0b99fbe60c3b175 P b7ab4784c7344b939bc36f639286f377 [term 15 FOLLOWER]: Rejecting Update request from peer ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 14. Current term is 15. Ops: [14.7-14.7]
I20260709 13:20:32.370078  6732 raft_consensus.cc:2468] T 34f36d59d88f40fe8a2805e604fc6c0a P ccd8a4c3bfe3413cb2ae219b09aea832 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 11.
I20260709 13:20:32.347613  6803 raft_consensus.cc:1240] T f5be3a11b23d4ea9b08300a2789821c7 P b7ab4784c7344b939bc36f639286f377 [term 13 FOLLOWER]: Rejecting Update request from peer ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 12. Current term is 13. Ops: [12.8-12.8]
I20260709 13:20:32.335764  6727 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "713b5728a197487c9300b310ab94e5a3"
dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
mode: GRACEFUL
new_leader_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
 from {username='slave'} at 127.0.0.1:38536
I20260709 13:20:32.335765  6725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3022224cc81473690653a83d4e99470" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:32.335995  6806 raft_consensus.cc:2393] T 3d65025eea89441290d85dd053810e31 P b7ab4784c7344b939bc36f639286f377 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate ccd8a4c3bfe3413cb2ae219b09aea832 in current term 14: Already voted for candidate b7ab4784c7344b939bc36f639286f377 in this term.
I20260709 13:20:32.366241  6878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "711ef6523deb4cbe8ef2ba61e1c21c98" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:32.270457 11792 consensus_queue.cc:1059] T a1704639a875409b9959353527b3fd68 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: INVALID_TERM, Last received: 14.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.055s
I20260709 13:20:32.372215  6727 raft_consensus.cc:606] T 713b5728a197487c9300b310ab94e5a3 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 13 FOLLOWER]: Received request to transfer leadership to TS cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:20:32.368258  6798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a734b5ab7834e05a8c422208acc58b1" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 14 candidate_status { last_received { term: 13 index: 5 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:32.376358  6727 raft_consensus.cc:614] T 713b5728a197487c9300b310ab94e5a3 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 13 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:20:32.374248  6801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "711ef6523deb4cbe8ef2ba61e1c21c98" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:32.376921  6801 raft_consensus.cc:2468] T 711ef6523deb4cbe8ef2ba61e1c21c98 P b7ab4784c7344b939bc36f639286f377 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 15.
I20260709 13:20:32.373270  6803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be1a92657f494cac8dd227d152f50151" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:32.377758  6878 raft_consensus.cc:2410] T 711ef6523deb4cbe8ef2ba61e1c21c98 P cd75a17ab2604397adab03bb8b5fd75c [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ccd8a4c3bfe3413cb2ae219b09aea832 for term 16 because replica has last-logged OpId of term: 14 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 8.
I20260709 13:20:32.320335 11654 raft_consensus.cc:3060] T 7c37d41cd9164c15a6826ca62a851a69 P b7ab4784c7344b939bc36f639286f377 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:32.378070  6875 raft_consensus.cc:2468] T 853ac0a8cbd64ce99457f170216d4d0f P cd75a17ab2604397adab03bb8b5fd75c [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 12.
I20260709 13:20:32.395293  6875 raft_consensus.cc:1240] T 7a734b5ab7834e05a8c422208acc58b1 P cd75a17ab2604397adab03bb8b5fd75c [term 14 FOLLOWER]: Rejecting Update request from peer b7ab4784c7344b939bc36f639286f377 for earlier term 13. Current term is 14. Ops: []
I20260709 13:20:32.373317  6695 leader_election.cc:304] T 1528ab62b6fe4e3099d08f141afee116 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, b7ab4784c7344b939bc36f639286f377
I20260709 13:20:32.395838  6876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce4f062dcd314d43a63ca74067cb5ee3" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:20:32.396770  6876 raft_consensus.cc:3060] T ce4f062dcd314d43a63ca74067cb5ee3 P cd75a17ab2604397adab03bb8b5fd75c [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:32.332512 11784 raft_consensus.cc:493] T 7ba5dac66ab5497e9e336f2a3c28cda5 P b7ab4784c7344b939bc36f639286f377 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:32.408921  6878 raft_consensus.cc:1275] T 22ccee1b570c4ad3a57bd7aec085b1b4 P cd75a17ab2604397adab03bb8b5fd75c [term 12 FOLLOWER]: Refusing update from remote peer b7ab4784c7344b939bc36f639286f377: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:20:32.412297  6878 raft_consensus.cc:1275] T 90d42e216d9741e190bca19a781291fd P cd75a17ab2604397adab03bb8b5fd75c [term 14 FOLLOWER]: Refusing update from remote peer b7ab4784c7344b939bc36f639286f377: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:20:32.379813  6881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f03d0dbf16864ca4bc1bb5e4c0334c0f" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:32.329449 11757 raft_consensus.cc:2749] T ce4f062dcd314d43a63ca74067cb5ee3 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:20:32.371475 11700 raft_consensus.cc:3055] T 3d65025eea89441290d85dd053810e31 P cd75a17ab2604397adab03bb8b5fd75c [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:20:32.299031 11658 raft_consensus.cc:515] T 8c7f33e544204fbaac4078e3e83bbf4e P b7ab4784c7344b939bc36f639286f377 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:32.416519  6695 leader_election.cc:304] T 22ccee1b570c4ad3a57bd7aec085b1b4 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:20:32.376863 11576 raft_consensus.cc:3060] T 3fa34c08b205435dba97346991aa1f92 P cd75a17ab2604397adab03bb8b5fd75c [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:20:32.418309  6772 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 87513.7us
I20260709 13:20:32.429360  7495 raft_consensus.cc:1275] T 17587d6730594da4a56fa13a353232a1 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 19 FOLLOWER]: Refusing update from remote peer b7ab4784c7344b939bc36f639286f377: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260709 13:20:32.419113  6878 raft_consensus.cc:1275] T 7c44c4849aa54f2b94d1f1bef9ed546f P cd75a17ab2604397adab03bb8b5fd75c [term 15 FOLLOWER]: Refusing update from remote peer b7ab4784c7344b939bc36f639286f377: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:20:32.431545  6878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7887766dc6784fcaa42b35c05fea7a99" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:20:32.434468  6695 leader_election.cc:304] T 404190ce4ce94cecbfcb6ea9d1dd8626 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, b7ab4784c7344b939bc36f639286f377
I20260709 13:20:32.435416  6876 raft_consensus.cc:2468] T ce4f062dcd314d43a63ca74067cb5ee3 P cd75a17ab2604397adab03bb8b5fd75c [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 15.
I20260709 13:20:32.306385 11817 consensus_queue.cc:237] T 3a485a995abc4807b6e511e45419f737 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:32.430270  6875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4b8bd455d5a47c18a1380839c6e0d61" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 14 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:20:32.375298 11742 consensus_queue.cc:1048] T 9e326172347f45e99a0d482b5d8ef768 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.053s
I20260709 13:20:32.446973  6872 raft_consensus.cc:1275] T a1704639a875409b9959353527b3fd68 P cd75a17ab2604397adab03bb8b5fd75c [term 15 FOLLOWER]: Refusing update from remote peer b7ab4784c7344b939bc36f639286f377: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:20:32.447923  6876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34f36d59d88f40fe8a2805e604fc6c0a" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:32.449903  6876 raft_consensus.cc:1275] T 3411566abe2d4c9bb4b2adfdd05e6f17 P cd75a17ab2604397adab03bb8b5fd75c [term 12 FOLLOWER]: Refusing update from remote peer b7ab4784c7344b939bc36f639286f377: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:20:32.410017 11792 consensus_queue.cc:1243] T a1704639a875409b9959353527b3fd68 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Peer b7ab4784c7344b939bc36f639286f377 log is divergent from this leader: its last log entry 15.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 13:20:32.401551 11810 raft_consensus.cc:493] T de3186201e1a40d0b335eeb8b4e256e0 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:20:32.462981  6770 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 131481us
I20260709 13:20:32.442889  6875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3022224cc81473690653a83d4e99470" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:32.457104  6726 raft_consensus.cc:2468] T f4b8bd455d5a47c18a1380839c6e0d61 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 14.
I20260709 13:20:32.393829 11878 consensus_queue.cc:1059] T 24ee15416e3145beaa1b8183453729a3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.043s
I20260709 13:20:32.469655  6800 raft_consensus.cc:1240] T 8c7f33e544204fbaac4078e3e83bbf4e P b7ab4784c7344b939bc36f639286f377 [term 12 FOLLOWER]: Rejecting Update request from peer ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 11. Current term is 12. Ops: [11.7-11.7]
I20260709 13:20:32.401312 11889 raft_consensus.cc:493] T dbdf895bba214ff68685a24fd17dfb5d P ccd8a4c3bfe3413cb2ae219b09aea832 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:32.421172 11700 raft_consensus.cc:740] T 3d65025eea89441290d85dd053810e31 P cd75a17ab2604397adab03bb8b5fd75c [term 13 LEADER]: Becoming Follower/Learner. State: Replica: cd75a17ab2604397adab03bb8b5fd75c, State: Running, Role: LEADER
I20260709 13:20:32.428174 11822 raft_consensus.cc:2749] T 1528ab62b6fe4e3099d08f141afee116 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:20:32.439956 11636 raft_consensus.cc:2749] T 22ccee1b570c4ad3a57bd7aec085b1b4 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
W20260709 13:20:32.442027  6624 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:51654 (request call id 83) took 21197 ms (client timeout 15000 ms). Trace:
I20260709 13:20:32.441748 11798 leader_election.cc:290] T bd6869f07b5a4885a0b99fbe60c3b175 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 15 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:32.453122 11634 raft_consensus.cc:493] T 427c124d773f483294511e80fe340075 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 7ba59cc884714e8aa5f3f0ecaed84cbb)
I20260709 13:20:32.495102  6695 leader_election.cc:304] T 711ef6523deb4cbe8ef2ba61e1c21c98 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
I20260709 13:20:32.502396  6770 leader_election.cc:304] T 34f36d59d88f40fe8a2805e604fc6c0a P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
I20260709 13:20:32.418427 11784 raft_consensus.cc:515] T 7ba5dac66ab5497e9e336f2a3c28cda5 P b7ab4784c7344b939bc36f639286f377 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:20:32.471233 11635 raft_consensus.cc:2749] T 404190ce4ce94cecbfcb6ea9d1dd8626 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:20:32.444553 11742 consensus_queue.cc:1048] T 4275cf08e63345f993bce8664eada830 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.051s
I20260709 13:20:32.518390  6875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6869f07b5a4885a0b99fbe60c3b175" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 15 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:20:32.516986  6695 leader_election.cc:304] T 7a734b5ab7834e05a8c422208acc58b1 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:20:32.524406  6695 leader_election.cc:304] T be1a92657f494cac8dd227d152f50151 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, b7ab4784c7344b939bc36f639286f377
I20260709 13:20:32.525674 11817 raft_consensus.cc:2749] T be1a92657f494cac8dd227d152f50151 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:20:32.477033 11757 consensus_queue.cc:1059] T bd6869f07b5a4885a0b99fbe60c3b175 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: INVALID_TERM, Last received: 12.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.046s
I20260709 13:20:32.469223 11810 raft_consensus.cc:515] T de3186201e1a40d0b335eeb8b4e256e0 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:32.492955 11889 raft_consensus.cc:515] T dbdf895bba214ff68685a24fd17dfb5d P ccd8a4c3bfe3413cb2ae219b09aea832 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:32.522094 11796 raft_consensus.cc:2804] T 711ef6523deb4cbe8ef2ba61e1c21c98 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:20:32.506821 11792 consensus_queue.cc:1059] T f5be3a11b23d4ea9b08300a2789821c7 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.036s
I20260709 13:20:32.536154 11822 raft_consensus.cc:3060] T 7a734b5ab7834e05a8c422208acc58b1 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:20:32.564744  7466 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 94814.2us
I20260709 13:20:32.543826 11635 raft_consensus.cc:493] T 2c240553ce044eedb41541d72b9475d7 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:32.549150 11878 consensus_queue.cc:1243] T 24ee15416e3145beaa1b8183453729a3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [LEADER]: Peer cd75a17ab2604397adab03bb8b5fd75c log is divergent from this leader: its last log entry 15.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
W20260709 13:20:32.557168 11898 log.cc:927] Time spent T 7887766dc6784fcaa42b35c05fea7a99 P cd75a17ab2604397adab03bb8b5fd75c: Append to log took a long time: real 0.262s	user 0.000s	sys 0.001s
W20260709 13:20:32.572510 11896 log.cc:927] Time spent T 3d65025eea89441290d85dd053810e31 P cd75a17ab2604397adab03bb8b5fd75c: Append to log took a long time: real 0.182s	user 0.000s	sys 0.001s
I20260709 13:20:32.573462 11784 leader_election.cc:290] T 7ba5dac66ab5497e9e336f2a3c28cda5 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:20:32.543239 11849 consensus_queue.cc:1048] T 3411566abe2d4c9bb4b2adfdd05e6f17 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.032s
I20260709 13:20:32.538885 11700 consensus_queue.cc:260] T 3d65025eea89441290d85dd053810e31 P cd75a17ab2604397adab03bb8b5fd75c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:32.580621 11904 raft_consensus.cc:493] T 1528ab62b6fe4e3099d08f141afee116 P b7ab4784c7344b939bc36f639286f377 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 7ba59cc884714e8aa5f3f0ecaed84cbb)
I20260709 13:20:32.508625 11634 raft_consensus.cc:515] T 427c124d773f483294511e80fe340075 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } attrs { replace: true } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:20:32.555181 11796 raft_consensus.cc:493] T 711ef6523deb4cbe8ef2ba61e1c21c98 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:32.607317 11796 raft_consensus.cc:3060] T 711ef6523deb4cbe8ef2ba61e1c21c98 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:32.550294 11798 consensus_queue.cc:1048] T 17587d6730594da4a56fa13a353232a1 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.041s
I20260709 13:20:32.605726 11904 raft_consensus.cc:515] T 1528ab62b6fe4e3099d08f141afee116 P b7ab4784c7344b939bc36f639286f377 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:20:32.606359 11664 raft_consensus.cc:515] T e77e330a82df4b43a745d57a68f6f057 P b7ab4784c7344b939bc36f639286f377 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } }
I20260709 13:20:32.562480 11911 raft_consensus.cc:2804] T 34f36d59d88f40fe8a2805e604fc6c0a P b7ab4784c7344b939bc36f639286f377 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:20:32.593576 11710 raft_consensus.cc:3055] T f5be3a11b23d4ea9b08300a2789821c7 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 12 LEADER]: Stepping down as leader of term 12
W20260709 13:20:32.622061  6845 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:32.612915 11700 raft_consensus.cc:3060] T 3d65025eea89441290d85dd053810e31 P cd75a17ab2604397adab03bb8b5fd75c [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:32.589308 11635 raft_consensus.cc:515] T 2c240553ce044eedb41541d72b9475d7 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
W20260709 13:20:32.633193  6772 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 113505us
I20260709 13:20:32.635020  6772 leader_election.cc:304] T 4f00a2e87e56452083b759f60d461ee3 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb
I20260709 13:20:32.618428 11911 raft_consensus.cc:493] T 34f36d59d88f40fe8a2805e604fc6c0a P b7ab4784c7344b939bc36f639286f377 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:32.638808  6772 leader_election.cc:304] T 30e88460611e47b2ba16a46a30b5f416 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:20:32.638810  6874 raft_consensus.cc:3060] T a3022224cc81473690653a83d4e99470 P cd75a17ab2604397adab03bb8b5fd75c [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:32.618952 11710 raft_consensus.cc:740] T f5be3a11b23d4ea9b08300a2789821c7 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
I20260709 13:20:32.647707  6772 leader_election.cc:304] T 3d65025eea89441290d85dd053810e31 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
W20260709 13:20:32.651087  7469 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:32.631201 11658 leader_election.cc:290] T 8c7f33e544204fbaac4078e3e83bbf4e P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 12 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:32.652773  6772 leader_election.cc:304] T 07a92dd554674067a83a9cb68c4773f2 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:20:32.658742  6772 leader_election.cc:304] T f5be3a11b23d4ea9b08300a2789821c7 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:20:32.617817 11900 consensus_queue.cc:1048] T 17587d6730594da4a56fa13a353232a1 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 10, Time since last communication: 0.036s
I20260709 13:20:32.641088 11725 raft_consensus.cc:2804] T 4f00a2e87e56452083b759f60d461ee3 P b7ab4784c7344b939bc36f639286f377 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:20:32.663370 11725 raft_consensus.cc:493] T 4f00a2e87e56452083b759f60d461ee3 P b7ab4784c7344b939bc36f639286f377 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 7ba59cc884714e8aa5f3f0ecaed84cbb)
I20260709 13:20:32.663658 11654 raft_consensus.cc:2749] T 07a92dd554674067a83a9cb68c4773f2 P b7ab4784c7344b939bc36f639286f377 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:20:32.663818 11725 raft_consensus.cc:3060] T 4f00a2e87e56452083b759f60d461ee3 P b7ab4784c7344b939bc36f639286f377 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:32.666940  6799 raft_consensus.cc:1275] T 7c37d41cd9164c15a6826ca62a851a69 P b7ab4784c7344b939bc36f639286f377 [term 14 FOLLOWER]: Refusing update from remote peer ccd8a4c3bfe3413cb2ae219b09aea832: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:20:32.639650 11911 raft_consensus.cc:3060] T 34f36d59d88f40fe8a2805e604fc6c0a P b7ab4784c7344b939bc36f639286f377 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:20:32.668329 11664 leader_election.cc:290] T e77e330a82df4b43a745d57a68f6f057 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 16 election: Requested vote from peers cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931), ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391)
I20260709 13:20:32.668771 11847 leader_election.cc:290] T 8c7f33e544204fbaac4078e3e83bbf4e P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:32.669948  6724 raft_consensus.cc:3055] T a1704639a875409b9959353527b3fd68 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:20:32.749900  6724 raft_consensus.cc:740] T a1704639a875409b9959353527b3fd68 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
I20260709 13:20:32.750811  6799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbdf895bba214ff68685a24fd17dfb5d" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 13 candidate_status { last_received { term: 10 index: 4 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:32.751627  6799 raft_consensus.cc:2468] T dbdf895bba214ff68685a24fd17dfb5d P b7ab4784c7344b939bc36f639286f377 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 12.
I20260709 13:20:32.751155  6724 consensus_queue.cc:260] T a1704639a875409b9959353527b3fd68 P ccd8a4c3bfe3413cb2ae219b09aea832 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:32.752873  6724 raft_consensus.cc:3060] T a1704639a875409b9959353527b3fd68 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:32.655028 11784 raft_consensus.cc:2749] T 30e88460611e47b2ba16a46a30b5f416 P b7ab4784c7344b939bc36f639286f377 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:20:32.672614 11901 raft_consensus.cc:2749] T f5be3a11b23d4ea9b08300a2789821c7 P b7ab4784c7344b939bc36f639286f377 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
W20260709 13:20:32.673437  6773 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:32.676852  6730 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50004 (request call id 2322) took 1329 ms. Trace:
I20260709 13:20:32.677445 11904 leader_election.cc:290] T 1528ab62b6fe4e3099d08f141afee116 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:20:32.680305 11658 consensus_queue.cc:1059] T 7a734b5ab7834e05a8c422208acc58b1 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:20:32.754714 11683 consensus_queue.cc:1048] T 7c37d41cd9164c15a6826ca62a851a69 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:20:32.757217 11904 raft_consensus.cc:3055] T 7a734b5ab7834e05a8c422208acc58b1 P b7ab4784c7344b939bc36f639286f377 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:20:32.757697 11904 raft_consensus.cc:740] T 7a734b5ab7834e05a8c422208acc58b1 P b7ab4784c7344b939bc36f639286f377 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
I20260709 13:20:32.760439  6695 leader_election.cc:304] T dbdf895bba214ff68685a24fd17dfb5d P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
I20260709 13:20:32.681330 11635 leader_election.cc:290] T 2c240553ce044eedb41541d72b9475d7 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:32.768388 11911 raft_consensus.cc:515] T 34f36d59d88f40fe8a2805e604fc6c0a P b7ab4784c7344b939bc36f639286f377 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:32.770769 11911 leader_election.cc:290] T 34f36d59d88f40fe8a2805e604fc6c0a P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 12 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:32.772147  6724 raft_consensus.cc:1275] T a1704639a875409b9959353527b3fd68 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 15 FOLLOWER]: Refusing update from remote peer b7ab4784c7344b939bc36f639286f377: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
W20260709 13:20:32.774152 11808 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 15 current term: 15 is higher.
I20260709 13:20:32.779080  6724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4db81d9d329422bb3b4160ca4ac2d1d" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:32.783555  6724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20f6842e26174571996b8dea4151d4be" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:32.786659  6728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24ee15416e3145beaa1b8183453729a3" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:20:32.788524  6724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f03d0dbf16864ca4bc1bb5e4c0334c0f" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:32.790126  6724 raft_consensus.cc:2468] T f03d0dbf16864ca4bc1bb5e4c0334c0f P ccd8a4c3bfe3413cb2ae219b09aea832 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 13.
W20260709 13:20:32.682420  7467 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:32.655496 11666 raft_consensus.cc:2749] T 3d65025eea89441290d85dd053810e31 P b7ab4784c7344b939bc36f639286f377 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:20:32.682934  6801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c240553ce044eedb41541d72b9475d7" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:32.684785  6772 leader_election.cc:304] T f03d0dbf16864ca4bc1bb5e4c0334c0f P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
W20260709 13:20:32.685475 11894 log.cc:927] Time spent T 07a92dd554674067a83a9cb68c4773f2 P cd75a17ab2604397adab03bb8b5fd75c: Append to log took a long time: real 0.337s	user 0.000s	sys 0.002s
I20260709 13:20:32.816231 11878 consensus_queue.cc:1048] T bb3d8792045a4583ae2e965b1350a5b4 P 7ba59cc884714e8aa5f3f0ecaed84cbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:20:32.685649 11654 consensus_queue.cc:1048] T 22ccee1b570c4ad3a57bd7aec085b1b4 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
W20260709 13:20:32.817219  6772 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 132506us
I20260709 13:20:32.817526 11744 raft_consensus.cc:493] T f09c2a98de1a4decabd0ff900dd44caa P b7ab4784c7344b939bc36f639286f377 [term 15 FOLLOWER]: Starting leader election (detected failure of leader cd75a17ab2604397adab03bb8b5fd75c)
I20260709 13:20:32.818095 11744 raft_consensus.cc:3060] T f09c2a98de1a4decabd0ff900dd44caa P b7ab4784c7344b939bc36f639286f377 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:32.818856 11658 raft_consensus.cc:2749] T f03d0dbf16864ca4bc1bb5e4c0334c0f P b7ab4784c7344b939bc36f639286f377 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:20:32.819298 11654 consensus_queue.cc:1048] T 90d42e216d9741e190bca19a781291fd P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:20:32.819535 11658 consensus_queue.cc:1048] T 7c44c4849aa54f2b94d1f1bef9ed546f P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:20:32.682526  6731 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50004 (request call id 2339) took 1084 ms. Trace:
I20260709 13:20:32.687633 11796 raft_consensus.cc:515] T 711ef6523deb4cbe8ef2ba61e1c21c98 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:32.688719 11822 raft_consensus.cc:2749] T 7a734b5ab7834e05a8c422208acc58b1 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:20:32.690572  6726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6869f07b5a4885a0b99fbe60c3b175" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 15 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:20:32.690889 11757 raft_consensus.cc:493] T bb3d8792045a4583ae2e965b1350a5b4 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:32.691525  6770 leader_election.cc:304] T f4b8bd455d5a47c18a1380839c6e0d61 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
I20260709 13:20:32.694657  6725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1528ab62b6fe4e3099d08f141afee116" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:32.714399 11634 leader_election.cc:290] T 427c124d773f483294511e80fe340075 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:20:32.717916 11710 consensus_queue.cc:260] T f5be3a11b23d4ea9b08300a2789821c7 P ccd8a4c3bfe3413cb2ae219b09aea832 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:32.722388 11700 raft_consensus.cc:493] T 3a485a995abc4807b6e511e45419f737 P cd75a17ab2604397adab03bb8b5fd75c [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:32.833253 11700 raft_consensus.cc:515] T 3a485a995abc4807b6e511e45419f737 P cd75a17ab2604397adab03bb8b5fd75c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:32.733767  6800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "427c124d773f483294511e80fe340075" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:32.671129  6798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de3186201e1a40d0b335eeb8b4e256e0" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:32.834854  6798 raft_consensus.cc:2468] T de3186201e1a40d0b335eeb8b4e256e0 P b7ab4784c7344b939bc36f639286f377 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 15.
I20260709 13:20:32.835139  6800 raft_consensus.cc:2393] T 427c124d773f483294511e80fe340075 P b7ab4784c7344b939bc36f639286f377 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ccd8a4c3bfe3413cb2ae219b09aea832 in current term 13: Already voted for candidate b7ab4784c7344b939bc36f639286f377 in this term.
I20260709 13:20:32.755002  6730 rpcz_store.cc:276] 0709 13:20:31.347528 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:31.347722 (+   194us) service_pool.cc:224] Handling call
0709 13:20:31.394920 (+ 47198us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:31.777164 (+382244us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:32.676597 (+899433us) spinlock_profiling.cc:243] Waited 381 ms on lock 0x7b5400058a54. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f9aae01 00007fcc0f9a983e 00007fcc1496e419 00007fcc0dee5bd4 00007fcc0dee5b62 00007fcc0dee5a91 00007fcc0dee5a0c 00007fcc0dee4cc2 00007fcc0dce548c 00007fcc0dce48c6
0709 13:20:32.676787 (+   190us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":877358336}
I20260709 13:20:32.758615 11904 consensus_queue.cc:260] T 7a734b5ab7834e05a8c422208acc58b1 P b7ab4784c7344b939bc36f639286f377 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 13.6, Last appended by leader: 6, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } attrs { replace: true } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: NON_VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: true } }
I20260709 13:20:32.739303 11010 consensus_queue.cc:1059] T 8c7f33e544204fbaac4078e3e83bbf4e P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:20:32.765527 11683 raft_consensus.cc:2804] T dbdf895bba214ff68685a24fd17dfb5d P ccd8a4c3bfe3413cb2ae219b09aea832 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:20:32.836495 11683 raft_consensus.cc:493] T dbdf895bba214ff68685a24fd17dfb5d P ccd8a4c3bfe3413cb2ae219b09aea832 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:32.682340 11889 leader_election.cc:290] T dbdf895bba214ff68685a24fd17dfb5d P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:32.799644  6729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bf4668eeb70467fb3dc5a0289233b3c" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:32.836900  6726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e31b9971c15848dea59d4d4130141d9e" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:32.837371  6695 leader_election.cc:304] T de3186201e1a40d0b335eeb8b4e256e0 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
I20260709 13:20:32.838119  6729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b8cacb381b746da8d0049b0a83b41dd" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:32.838289  6726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e326172347f45e99a0d482b5d8ef768" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:32.839469  6729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4275cf08e63345f993bce8664eada830" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:32.803642  6728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "713b5728a197487c9300b310ab94e5a3" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
W20260709 13:20:32.495437  6624 rpcz_store.cc:269] 0709 13:20:11.244246 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:11.244939 (+   693us) service_pool.cc:224] Handling call
0709 13:20:32.441909 (+21196970us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:20:25.836157 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:20:25.984281 (+148124us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:20:25.984342 (+    61us) write_op.cc:435] Acquired schema lock
0709 13:20:25.984366 (+    24us) tablet.cc:662] Decoding operations
0709 13:20:26.099457 (+115091us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:20:26.099612 (+   155us) write_op.cc:641] Partition lock acquired for write op
0709 13:20:26.099654 (+    42us) tablet.cc:685] Acquiring locks for 8 operations
0709 13:20:26.100910 (+  1256us) tablet.cc:701] Row locks acquired
0709 13:20:26.100979 (+    69us) write_op.cc:260] PREPARE: finished
0709 13:20:26.101286 (+   307us) write_op.cc:270] Start()
0709 13:20:26.101537 (+   251us) write_op.cc:276] Timestamp: P: 1783603226101187 usec, L: 0
0709 13:20:26.101588 (+    51us) op_driver.cc:348] REPLICATION: starting
0709 13:20:26.168928 (+ 67340us) log.cc:844] Serialized 3313 byte log entry
0709 13:20:26.660544 (+491616us) spinlock_profiling.cc:243] Waited 2.8 ms on lock 0x7b4400022b4c. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0c745db1 00007fcc0c7e3c85 00007fcc0c7e46a2 00007fcc0f5561db 00007fcc0f551aaf 00007fcc0f54586e 00007fcc0f544bb6 00007fcc0f5447d8 00007fcc0f54e221 00007fcc0f54e1d9 00007fcc0f54e169
0709 13:20:27.360104 (+699560us) op_driver.cc:464] REPLICATION: finished
0709 13:20:27.588835 (+228731us) write_op.cc:301] APPLY: starting
0709 13:20:27.597269 (+  8434us) tablet.cc:1367] starting BulkCheckPresence
0709 13:20:28.235873 (+638604us) tablet.cc:1370] finished BulkCheckPresence
0709 13:20:28.235935 (+    62us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:20:28.452361 (+216426us) spinlock_profiling.cc:243] Waited 7.35 ms on lock 0x7b18004326a0. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc15785de1 00007fcc157925b1 00007fcc0c8bd557 00007fcc0c8bf7c1 00007fcc0c8bf779 00007fcc0c8bf709 00007fcc0c8bf6d1 00007fcc0c8be9cd 000000000038f354 000000000038f199 00007fcc0c8a083a
0709 13:20:28.732363 (+280002us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:20:28.732800 (+   437us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=16,key_file_lookups=16,delta_file_lookups=16,mrs_lookups=0
0709 13:20:28.732875 (+    75us) write_op.cc:312] APPLY: finished
0709 13:20:28.733340 (+   465us) log.cc:844] Serialized 80 byte log entry
0709 13:20:28.887228 (+153888us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:20:28.887426 (+   198us) write_op.cc:454] Released schema lock
0709 13:20:28.887531 (+   105us) write_op.cc:341] FINISH: Updating metrics
0709 13:20:28.888108 (+   577us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:20:28.888150 (+    42us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":8704423,"reported_tablets":12,"child_traces":[["op",{"apply.queue_time_us":154534,"apply.run_cpu_time_us":35395,"apply.run_wall_time_us":1338777,"cfile_cache_hit":34,"cfile_cache_hit_bytes":37535,"num_ops":8,"prepare.queue_time_us":31159,"prepare.run_cpu_time_us":32467,"prepare.run_wall_time_us":555751,"raft.queue_time_us":549933,"raft.run_cpu_time_us":20328,"raft.run_wall_time_us":150752,"replication_time_us":1247108,"spinlock_wait_cycles":23350016,"thread_start_us":827619,"threads_started":5,"wal-append.queue_time_us":567136,"wal-append.run_cpu_time_us":53726,"wal-append.run_wall_time_us":2861811}]]}
I20260709 13:20:32.807449  6878 raft_consensus.cc:1240] T ce4f062dcd314d43a63ca74067cb5ee3 P cd75a17ab2604397adab03bb8b5fd75c [term 15 FOLLOWER]: Rejecting Update request from peer 7ba59cc884714e8aa5f3f0ecaed84cbb for earlier term 14. Current term is 15. Ops: [14.10-14.10]
I20260709 13:20:32.820984  7501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8cee0accdb8499c86d4414b72565a38" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:20:32.820963  6731 rpcz_store.cc:276] 0709 13:20:31.597861 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:31.690622 (+ 92761us) service_pool.cc:224] Handling call
0709 13:20:31.691044 (+   422us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:32.067388 (+376344us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:32.682268 (+614880us) spinlock_profiling.cc:243] Waited 371 ms on lock 0x7b5400099cd4. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f9aae01 00007fcc0f9a983e 00007fcc1496e419 00007fcc0dee5bd4 00007fcc0dee5b62 00007fcc0dee5a91 00007fcc0dee5a0c 00007fcc0dee4cc2 00007fcc0dce548c 00007fcc0dce48c6
0709 13:20:32.682449 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":853362560}
I20260709 13:20:32.767751 11810 leader_election.cc:290] T de3186201e1a40d0b335eeb8b4e256e0 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
W20260709 13:20:32.824841  6770 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 133386us
I20260709 13:20:32.825850  7496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f00a2e87e56452083b759f60d461ee3" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:20:32.828783  7503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "427c124d773f483294511e80fe340075" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:20:32.856897  7503 raft_consensus.cc:2468] T 427c124d773f483294511e80fe340075 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 13.
I20260709 13:20:32.824998  6725 raft_consensus.cc:2468] T 1528ab62b6fe4e3099d08f141afee116 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 10.
I20260709 13:20:32.858374  6731 raft_consensus.cc:1240] T ce4f062dcd314d43a63ca74067cb5ee3 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 15 FOLLOWER]: Rejecting Update request from peer 7ba59cc884714e8aa5f3f0ecaed84cbb for earlier term 14. Current term is 15. Ops: [14.10-14.10]
I20260709 13:20:32.833598  6724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c7f33e544204fbaac4078e3e83bbf4e" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:20:32.792701  6877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ba5dac66ab5497e9e336f2a3c28cda5" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:32.861310  6877 raft_consensus.cc:2468] T 7ba5dac66ab5497e9e336f2a3c28cda5 P cd75a17ab2604397adab03bb8b5fd75c [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in term 14.
I20260709 13:20:32.862020  6731 raft_consensus.cc:1240] T 4d9def8b32fd443aa94ab1420b06837b P ccd8a4c3bfe3413cb2ae219b09aea832 [term 14 FOLLOWER]: Rejecting Update request from peer cd75a17ab2604397adab03bb8b5fd75c for earlier term 13. Current term is 14. Ops: []
I20260709 13:20:32.839809  6726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1704639a875409b9959353527b3fd68" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 15 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:32.862416  6803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "427c124d773f483294511e80fe340075" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:32.863049  6726 raft_consensus.cc:2410] T a1704639a875409b9959353527b3fd68 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c for term 15 because replica has last-logged OpId of term: 14 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 7.
I20260709 13:20:32.840842  6729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3d8792045a4583ae2e965b1350a5b4" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 13 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:32.827417 11666 raft_consensus.cc:2804] T f4b8bd455d5a47c18a1380839c6e0d61 P b7ab4784c7344b939bc36f639286f377 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:20:32.854665  6728 raft_consensus.cc:2468] T 713b5728a197487c9300b310ab94e5a3 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 13.
I20260709 13:20:32.863166  6803 raft_consensus.cc:2393] T 427c124d773f483294511e80fe340075 P b7ab4784c7344b939bc36f639286f377 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c in current term 13: Already voted for candidate b7ab4784c7344b939bc36f639286f377 in this term.
I20260709 13:20:32.863315  6731 raft_consensus.cc:1275] T 90d42e216d9741e190bca19a781291fd P ccd8a4c3bfe3413cb2ae219b09aea832 [term 14 FOLLOWER]: Refusing update from remote peer b7ab4784c7344b939bc36f639286f377: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:20:32.864491  6801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8cee0accdb8499c86d4414b72565a38" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
W20260709 13:20:32.896130  6695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 58867.1us
I20260709 13:20:32.897436  6801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de3186201e1a40d0b335eeb8b4e256e0" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 16 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:32.836935 11683 raft_consensus.cc:3060] T dbdf895bba214ff68685a24fd17dfb5d P ccd8a4c3bfe3413cb2ae219b09aea832 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:32.866707  6724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f58dc08b12a2494bb9a1372837970ca2" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
W20260709 13:20:32.894795  6773 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:32.902803  6800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "711ef6523deb4cbe8ef2ba61e1c21c98" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:32.915720  6800 raft_consensus.cc:2468] T 711ef6523deb4cbe8ef2ba61e1c21c98 P b7ab4784c7344b939bc36f639286f377 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 15.
I20260709 13:20:32.906795  6728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34f36d59d88f40fe8a2805e604fc6c0a" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:20:32.903203 11822 raft_consensus.cc:2804] T de3186201e1a40d0b335eeb8b4e256e0 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:20:32.905030  6803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f00a2e87e56452083b759f60d461ee3" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:32.918110  6770 leader_election.cc:304] T 711ef6523deb4cbe8ef2ba61e1c21c98 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:20:32.898927 11710 raft_consensus.cc:3060] T f5be3a11b23d4ea9b08300a2789821c7 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:32.922304  6728 raft_consensus.cc:3060] T 34f36d59d88f40fe8a2805e604fc6c0a P ccd8a4c3bfe3413cb2ae219b09aea832 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:20:32.829439 11757 raft_consensus.cc:515] T bb3d8792045a4583ae2e965b1350a5b4 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:20:32.912175  6801 raft_consensus.cc:2410] T de3186201e1a40d0b335eeb8b4e256e0 P b7ab4784c7344b939bc36f639286f377 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c for term 16 because replica has last-logged OpId of term: 14 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 7.
I20260709 13:20:32.857518 11700 leader_election.cc:290] T 3a485a995abc4807b6e511e45419f737 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:20:32.913326  6731 raft_consensus.cc:1275] T 853ac0a8cbd64ce99457f170216d4d0f P ccd8a4c3bfe3413cb2ae219b09aea832 [term 12 FOLLOWER]: Refusing update from remote peer b7ab4784c7344b939bc36f639286f377: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:20:32.866608 11010 raft_consensus.cc:3055] T 8c7f33e544204fbaac4078e3e83bbf4e P ccd8a4c3bfe3413cb2ae219b09aea832 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:20:32.941847  6801 raft_consensus.cc:1240] T 3d65025eea89441290d85dd053810e31 P b7ab4784c7344b939bc36f639286f377 [term 14 FOLLOWER]: Rejecting Update request from peer cd75a17ab2604397adab03bb8b5fd75c for earlier term 13. Current term is 14. Ops: [13.7-13.7]
I20260709 13:20:32.943359  6724 raft_consensus.cc:1275] T e77e330a82df4b43a745d57a68f6f057 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 15 FOLLOWER]: Refusing update from remote peer cd75a17ab2604397adab03bb8b5fd75c: Log matching property violated. Preceding OpId in replica: term: 14 index: 7. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 13:20:32.943569  6801 raft_consensus.cc:1240] T b56bf91d90824c959e21e0cee5ba1816 P b7ab4784c7344b939bc36f639286f377 [term 13 FOLLOWER]: Rejecting Update request from peer cd75a17ab2604397adab03bb8b5fd75c for earlier term 12. Current term is 13. Ops: []
I20260709 13:20:32.945231  6724 raft_consensus.cc:1275] T f3f9c2e2bf644115957398fe4c9459db P ccd8a4c3bfe3413cb2ae219b09aea832 [term 13 FOLLOWER]: Refusing update from remote peer cd75a17ab2604397adab03bb8b5fd75c: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:20:32.947208  6731 raft_consensus.cc:1240] T f4b8bd455d5a47c18a1380839c6e0d61 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 14 FOLLOWER]: Rejecting Update request from peer cd75a17ab2604397adab03bb8b5fd75c for earlier term 13. Current term is 14. Ops: []
I20260709 13:20:32.920872 11822 raft_consensus.cc:493] T de3186201e1a40d0b335eeb8b4e256e0 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:32.914819 11666 raft_consensus.cc:697] T f4b8bd455d5a47c18a1380839c6e0d61 P b7ab4784c7344b939bc36f639286f377 [term 14 LEADER]: Becoming Leader. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
I20260709 13:20:32.956825  6801 raft_consensus.cc:1275] T f3f9c2e2bf644115957398fe4c9459db P b7ab4784c7344b939bc36f639286f377 [term 13 FOLLOWER]: Refusing update from remote peer cd75a17ab2604397adab03bb8b5fd75c: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:20:32.963732  6732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d33d5ee8ef6f415593d8df52063161ad" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:32.925947 11911 raft_consensus.cc:2804] T 711ef6523deb4cbe8ef2ba61e1c21c98 P b7ab4784c7344b939bc36f639286f377 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:20:32.973865  6731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3411566abe2d4c9bb4b2adfdd05e6f17" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 13 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
W20260709 13:20:32.975175  6847 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:32.981451  6847 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:32.983636  6728 raft_consensus.cc:2468] T 34f36d59d88f40fe8a2805e604fc6c0a P ccd8a4c3bfe3413cb2ae219b09aea832 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 12.
I20260709 13:20:32.988552  6728 raft_consensus.cc:1240] T 3d65025eea89441290d85dd053810e31 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 14 FOLLOWER]: Rejecting Update request from peer cd75a17ab2604397adab03bb8b5fd75c for earlier term 13. Current term is 14. Ops: []
I20260709 13:20:32.924332 11870 consensus_queue.cc:1048] T a1704639a875409b9959353527b3fd68 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.053s
I20260709 13:20:32.940672 11010 raft_consensus.cc:740] T 8c7f33e544204fbaac4078e3e83bbf4e P ccd8a4c3bfe3413cb2ae219b09aea832 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
I20260709 13:20:32.950635 11700 raft_consensus.cc:493] T 7c44c4849aa54f2b94d1f1bef9ed546f P cd75a17ab2604397adab03bb8b5fd75c [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:32.965986 11822 raft_consensus.cc:3060] T de3186201e1a40d0b335eeb8b4e256e0 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:32.977245 11911 raft_consensus.cc:493] T 711ef6523deb4cbe8ef2ba61e1c21c98 P b7ab4784c7344b939bc36f639286f377 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:33.006547 11010 consensus_queue.cc:260] T 8c7f33e544204fbaac4078e3e83bbf4e P ccd8a4c3bfe3413cb2ae219b09aea832 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:33.021975  6807 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:32976 (request call id 3058) took 1325 ms. Trace:
I20260709 13:20:33.035648  6807 rpcz_store.cc:276] 0709 13:20:31.696270 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:31.834009 (+137739us) service_pool.cc:224] Handling call
0709 13:20:31.856583 (+ 22574us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:32.005970 (+149387us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:33.021603 (+1015633us) spinlock_profiling.cc:243] Waited 142 ms on lock 0x7b5400288cd4. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f9aae01 00007fcc0f9a983e 00007fcc1496e419 00007fcc0dee5bd4 00007fcc0dee5b62 00007fcc0dee5a91 00007fcc0dee5a0c 00007fcc0dee4cc2 00007fcc0dce548c 00007fcc0dce48c6
0709 13:20:33.021882 (+   279us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":325617920}
I20260709 13:20:33.042253  6732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "711ef6523deb4cbe8ef2ba61e1c21c98" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:33.045586  6732 raft_consensus.cc:2393] T 711ef6523deb4cbe8ef2ba61e1c21c98 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c in current term 16: Already voted for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in this term.
I20260709 13:20:33.053617 11636 raft_consensus.cc:3055] T bd6869f07b5a4885a0b99fbe60c3b175 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:20:33.054203 11636 raft_consensus.cc:740] T bd6869f07b5a4885a0b99fbe60c3b175 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
I20260709 13:20:33.055176 11636 consensus_queue.cc:260] T bd6869f07b5a4885a0b99fbe60c3b175 P ccd8a4c3bfe3413cb2ae219b09aea832 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 14.7, Last appended by leader: 7, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:33.056907 11511 raft_consensus.cc:3055] T 24ee15416e3145beaa1b8183453729a3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 16 LEADER]: Stepping down as leader of term 16
W20260709 13:20:33.058383 11892 log.cc:927] Time spent T e77e330a82df4b43a745d57a68f6f057 P b7ab4784c7344b939bc36f639286f377: Append to log took a long time: real 0.771s	user 0.001s	sys 0.003s
W20260709 13:20:33.058444  6616 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet ce4f062dcd314d43a63ca74067cb5ee3 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER failed with leader 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 7ba59cc884714e8aa5f3f0ecaed84cbb is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 15 committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } attrs { replace: true } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } } }
I20260709 13:20:33.034909 11911 raft_consensus.cc:3060] T 711ef6523deb4cbe8ef2ba61e1c21c98 P b7ab4784c7344b939bc36f639286f377 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:33.070124  6725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "427c124d773f483294511e80fe340075" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:33.078260  6725 raft_consensus.cc:2468] T 427c124d773f483294511e80fe340075 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 12.
W20260709 13:20:33.082945  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 267971us
I20260709 13:20:33.032020 11700 raft_consensus.cc:515] T 7c44c4849aa54f2b94d1f1bef9ed546f P cd75a17ab2604397adab03bb8b5fd75c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:33.070569 11010 raft_consensus.cc:3060] T 8c7f33e544204fbaac4078e3e83bbf4e P ccd8a4c3bfe3413cb2ae219b09aea832 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:20:33.084374  6725 raft_consensus.cc:1240] T a3022224cc81473690653a83d4e99470 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 15 LEADER]: Rejecting Update request from peer cd75a17ab2604397adab03bb8b5fd75c for earlier term 14. Current term is 15. Ops: []
I20260709 13:20:33.074934 11511 raft_consensus.cc:740] T 24ee15416e3145beaa1b8183453729a3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 7ba59cc884714e8aa5f3f0ecaed84cbb, State: Running, Role: LEADER
I20260709 13:20:33.087184 11803 raft_consensus.cc:493] T 2c240553ce044eedb41541d72b9475d7 P cd75a17ab2604397adab03bb8b5fd75c [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:33.103976  6725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de3186201e1a40d0b335eeb8b4e256e0" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 16 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:33.088688 11636 raft_consensus.cc:3060] T bd6869f07b5a4885a0b99fbe60c3b175 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:33.096748 11781 raft_consensus.cc:493] T 44bde925b2e541b69890d70715b85176 P cd75a17ab2604397adab03bb8b5fd75c [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:33.117972  6723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77e330a82df4b43a745d57a68f6f057" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:20:33.072623 11666 consensus_queue.cc:237] T f4b8bd455d5a47c18a1380839c6e0d61 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:33.136896  6804 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:32966 (request call id 1246) took 1241 ms. Trace:
I20260709 13:20:33.140787 11635 raft_consensus.cc:493] T 3fa34c08b205435dba97346991aa1f92 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader cd75a17ab2604397adab03bb8b5fd75c)
I20260709 13:20:33.095564 11576 raft_consensus.cc:493] T 95a75bfe094d4bdc963aba3f08dfcd25 P cd75a17ab2604397adab03bb8b5fd75c [term 13 FOLLOWER]: Starting pre-election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:20:33.147050  6804 rpcz_store.cc:276] 0709 13:20:31.895997 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:32.070648 (+174651us) service_pool.cc:224] Handling call
0709 13:20:32.071028 (+   380us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:32.095754 (+ 24726us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:32.095788 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:20:32.098727 (+  2939us) log.cc:844] Serialized 26 byte log entry
0709 13:20:32.204680 (+105953us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:20:32.204756 (+    76us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:32.204858 (+   102us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:33.057503 (+852645us) spinlock_profiling.cc:243] Waited 23.1 ms on lock 0x7b4400022b4c. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0c745db1 00007fcc0c7e3c85 00007fcc0c7e46a2 00007fcc0f5561db 00007fcc0f551aaf 00007fcc0f54586e 00007fcc0f544bb6 00007fcc0f5447d8 00007fcc0f54e221 00007fcc0f54e1d9 00007fcc0f54e169
0709 13:20:33.128530 (+ 71027us) raft_consensus.cc:1685] finished
0709 13:20:33.128552 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:33.136827 (+  8275us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":12622,"raft.run_cpu_time_us":121,"raft.run_wall_time_us":124,"spinlock_wait_cycles":53234048,"thread_start_us":104119,"threads_started":1,"wal-append.queue_time_us":147438}
I20260709 13:20:33.149642  6723 raft_consensus.cc:3060] T e77e330a82df4b43a745d57a68f6f057 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:20:33.152581  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 58572.9us
W20260709 13:20:33.157244  6846 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:33.158576  6845 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:33.159245 11725 raft_consensus.cc:515] T 4f00a2e87e56452083b759f60d461ee3 P b7ab4784c7344b939bc36f639286f377 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:20:33.163136  6805 raft_consensus.cc:1240] T 4f00a2e87e56452083b759f60d461ee3 P b7ab4784c7344b939bc36f639286f377 [term 15 FOLLOWER]: Rejecting Update request from peer 7ba59cc884714e8aa5f3f0ecaed84cbb for earlier term 14. Current term is 15. Ops: []
W20260709 13:20:33.166498 11916 log.cc:927] Time spent T 9e326172347f45e99a0d482b5d8ef768 P cd75a17ab2604397adab03bb8b5fd75c: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 13:20:33.145712 11757 leader_election.cc:290] T bb3d8792045a4583ae2e965b1350a5b4 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
W20260709 13:20:33.175714  6772 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 357075us
I20260709 13:20:33.112170 11803 raft_consensus.cc:515] T 2c240553ce044eedb41541d72b9475d7 P cd75a17ab2604397adab03bb8b5fd75c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:33.176623  6772 leader_election.cc:304] T ce4f062dcd314d43a63ca74067cb5ee3 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb
I20260709 13:20:33.177891 11803 leader_election.cc:290] T 2c240553ce044eedb41541d72b9475d7 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:20:33.179586  6800 raft_consensus.cc:1240] T a3022224cc81473690653a83d4e99470 P b7ab4784c7344b939bc36f639286f377 [term 15 FOLLOWER]: Rejecting Update request from peer cd75a17ab2604397adab03bb8b5fd75c for earlier term 14. Current term is 15. Ops: []
I20260709 13:20:33.181066 11700 leader_election.cc:290] T 7c44c4849aa54f2b94d1f1bef9ed546f P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:20:33.162591 11635 raft_consensus.cc:515] T 3fa34c08b205435dba97346991aa1f92 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:20:33.181851 11700 consensus_queue.cc:1059] T b56bf91d90824c959e21e0cee5ba1816 P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:20:33.184077 11511 consensus_queue.cc:260] T 24ee15416e3145beaa1b8183453729a3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:20:33.185442 11511 raft_consensus.cc:3060] T 24ee15416e3145beaa1b8183453729a3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:33.127244 11781 raft_consensus.cc:515] T 44bde925b2e541b69890d70715b85176 P cd75a17ab2604397adab03bb8b5fd75c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:33.189949 11781 leader_election.cc:290] T 44bde925b2e541b69890d70715b85176 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:20:33.190483  7495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "427c124d773f483294511e80fe340075" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:20:33.191135  7495 raft_consensus.cc:2468] T 427c124d773f483294511e80fe340075 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 13.
I20260709 13:20:33.191510 11781 raft_consensus.cc:3055] T b56bf91d90824c959e21e0cee5ba1816 P cd75a17ab2604397adab03bb8b5fd75c [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:20:33.178503 11803 consensus_queue.cc:1048] T f09c2a98de1a4decabd0ff900dd44caa P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Connected to new peer: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.014s
W20260709 13:20:33.192221 11909 consensus_queue.cc:1175] T 24ee15416e3145beaa1b8183453729a3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" responder_term: 16 status { last_received { term: 16 index: 10 } last_committed_idx: 10 last_received_current_leader { term: 16 index: 10 } }
W20260709 13:20:33.198060  6695 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:33.201467  6697 leader_election.cc:304] T ab432e62819d499eaaf3dd55481dd930 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:20:33.204943 11904 raft_consensus.cc:3060] T 7a734b5ab7834e05a8c422208acc58b1 P b7ab4784c7344b939bc36f639286f377 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:33.206049 11810 consensus_queue.cc:1059] T 7887766dc6784fcaa42b35c05fea7a99 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:20:33.207617 11634 raft_consensus.cc:3055] T 7887766dc6784fcaa42b35c05fea7a99 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:20:33.208086 11634 raft_consensus.cc:740] T 7887766dc6784fcaa42b35c05fea7a99 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
I20260709 13:20:33.208945 11634 consensus_queue.cc:260] T 7887766dc6784fcaa42b35c05fea7a99 P ccd8a4c3bfe3413cb2ae219b09aea832 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:33.210167 11634 raft_consensus.cc:3060] T 7887766dc6784fcaa42b35c05fea7a99 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:20:33.219611  7467 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:33.221194  6697 leader_election.cc:304] T c4db81d9d329422bb3b4160ca4ac2d1d P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377
I20260709 13:20:33.238484  6697 leader_election.cc:304] T 30e88460611e47b2ba16a46a30b5f416 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377
I20260709 13:20:33.206874 11683 raft_consensus.cc:515] T dbdf895bba214ff68685a24fd17dfb5d P ccd8a4c3bfe3413cb2ae219b09aea832 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:33.249570 11683 leader_election.cc:290] T dbdf895bba214ff68685a24fd17dfb5d P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 13 election: Requested vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:33.250443  6724 raft_consensus.cc:1240] T dbdf895bba214ff68685a24fd17dfb5d P ccd8a4c3bfe3413cb2ae219b09aea832 [term 13 FOLLOWER]: Rejecting Update request from peer cd75a17ab2604397adab03bb8b5fd75c for earlier term 12. Current term is 13. Ops: []
I20260709 13:20:33.191921 11781 raft_consensus.cc:740] T b56bf91d90824c959e21e0cee5ba1816 P cd75a17ab2604397adab03bb8b5fd75c [term 12 LEADER]: Becoming Follower/Learner. State: Replica: cd75a17ab2604397adab03bb8b5fd75c, State: Running, Role: LEADER
I20260709 13:20:33.258064  6723 raft_consensus.cc:2468] T e77e330a82df4b43a745d57a68f6f057 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 16.
I20260709 13:20:33.260186  6805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "711ef6523deb4cbe8ef2ba61e1c21c98" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:20:33.262939  6804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbdf895bba214ff68685a24fd17dfb5d" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 13 candidate_status { last_received { term: 10 index: 4 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
W20260709 13:20:33.264850  6773 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:33.183826 11635 leader_election.cc:290] T 3fa34c08b205435dba97346991aa1f92 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
W20260709 13:20:33.254776  6698 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:33.255298  6730 raft_consensus.cc:1240] T 7a734b5ab7834e05a8c422208acc58b1 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 14 FOLLOWER]: Rejecting Update request from peer b7ab4784c7344b939bc36f639286f377 for earlier term 13. Current term is 14. Ops: []
I20260709 13:20:33.268487  7503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3d8792045a4583ae2e965b1350a5b4" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:20:33.201498 11725 leader_election.cc:290] T 4f00a2e87e56452083b759f60d461ee3 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 15 election: Requested vote from peers cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
W20260709 13:20:33.275759  6770 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 72921.3us
I20260709 13:20:33.278753  6770 leader_election.cc:304] T 1528ab62b6fe4e3099d08f141afee116 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
I20260709 13:20:33.226715 11656 raft_consensus.cc:2804] T ce4f062dcd314d43a63ca74067cb5ee3 P b7ab4784c7344b939bc36f639286f377 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:20:33.226518 11757 raft_consensus.cc:2749] T ab432e62819d499eaaf3dd55481dd930 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:20:33.245711 11792 raft_consensus.cc:2804] T c4db81d9d329422bb3b4160ca4ac2d1d P ccd8a4c3bfe3413cb2ae219b09aea832 [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 13:20:33.282192  6772 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 67729.9us
I20260709 13:20:33.287846  6772 leader_election.cc:304] T a3022224cc81473690653a83d4e99470 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:20:33.283308  6806 raft_consensus.cc:1275] T 3a485a995abc4807b6e511e45419f737 P b7ab4784c7344b939bc36f639286f377 [term 13 FOLLOWER]: Refusing update from remote peer ccd8a4c3bfe3413cb2ae219b09aea832: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:20:33.213934 11576 raft_consensus.cc:515] T 95a75bfe094d4bdc963aba3f08dfcd25 P cd75a17ab2604397adab03bb8b5fd75c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:33.273773 11683 raft_consensus.cc:2804] T 30e88460611e47b2ba16a46a30b5f416 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:20:33.244798 11912 consensus_queue.cc:1059] T 4f00a2e87e56452083b759f60d461ee3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: INVALID_TERM, Last received: 14.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.044s
I20260709 13:20:33.243806 11670 consensus_queue.cc:1048] T a1704639a875409b9959353527b3fd68 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.046s
I20260709 13:20:33.253023 11744 raft_consensus.cc:515] T f09c2a98de1a4decabd0ff900dd44caa P b7ab4784c7344b939bc36f639286f377 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:33.294977 11792 raft_consensus.cc:493] T c4db81d9d329422bb3b4160ca4ac2d1d P ccd8a4c3bfe3413cb2ae219b09aea832 [term 12 FOLLOWER]: Starting leader election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:20:33.295205 11915 consensus_queue.cc:1059] T ab432e62819d499eaaf3dd55481dd930 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: INVALID_TERM, Last received: 13.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.029s
I20260709 13:20:33.318337 11683 raft_consensus.cc:697] T 30e88460611e47b2ba16a46a30b5f416 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 13 LEADER]: Becoming Leader. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
I20260709 13:20:33.326079 11792 raft_consensus.cc:3060] T c4db81d9d329422bb3b4160ca4ac2d1d P ccd8a4c3bfe3413cb2ae219b09aea832 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:20:33.353478  6770 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 74845.3us
I20260709 13:20:33.305766 11910 consensus_queue.cc:1048] T 3411566abe2d4c9bb4b2adfdd05e6f17 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 4, Time since last communication: 0.050s
I20260709 13:20:33.364658 11899 raft_consensus.cc:2804] T 1528ab62b6fe4e3099d08f141afee116 P b7ab4784c7344b939bc36f639286f377 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:20:33.366389 11846 raft_consensus.cc:2749] T a3022224cc81473690653a83d4e99470 P b7ab4784c7344b939bc36f639286f377 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:20:33.365790  6772 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 78093.1us
I20260709 13:20:33.386097  6772 leader_election.cc:304] T 7887766dc6784fcaa42b35c05fea7a99 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:20:33.369387 11900 consensus_queue.cc:1048] T 90d42e216d9741e190bca19a781291fd P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
W20260709 13:20:33.378047  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 220362us
I20260709 13:20:33.388864  6844 leader_election.cc:304] T c4db81d9d329422bb3b4160ca4ac2d1d P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:20:33.347622 11656 raft_consensus.cc:697] T ce4f062dcd314d43a63ca74067cb5ee3 P b7ab4784c7344b939bc36f639286f377 [term 15 LEADER]: Becoming Leader. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
I20260709 13:20:33.392144  6876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c240553ce044eedb41541d72b9475d7" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:33.393746  6872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbdf895bba214ff68685a24fd17dfb5d" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 13 candidate_status { last_received { term: 10 index: 4 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:33.392959  6876 raft_consensus.cc:2468] T 2c240553ce044eedb41541d72b9475d7 P cd75a17ab2604397adab03bb8b5fd75c [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 15.
I20260709 13:20:33.396389  6873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "427c124d773f483294511e80fe340075" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:33.398756  6844 leader_election.cc:304] T 20f6842e26174571996b8dea4151d4be P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:20:33.400767  6876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3d8792045a4583ae2e965b1350a5b4" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:33.401484  6876 raft_consensus.cc:2468] T bb3d8792045a4583ae2e965b1350a5b4 P cd75a17ab2604397adab03bb8b5fd75c [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 12.
I20260709 13:20:33.397387  6873 raft_consensus.cc:2468] T 427c124d773f483294511e80fe340075 P cd75a17ab2604397adab03bb8b5fd75c [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 12.
I20260709 13:20:33.319192 11781 consensus_queue.cc:260] T b56bf91d90824c959e21e0cee5ba1816 P cd75a17ab2604397adab03bb8b5fd75c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:33.407445  6798 raft_consensus.cc:1240] T f4b8bd455d5a47c18a1380839c6e0d61 P b7ab4784c7344b939bc36f639286f377 [term 14 LEADER]: Rejecting Update request from peer cd75a17ab2604397adab03bb8b5fd75c for earlier term 13. Current term is 14. Ops: []
I20260709 13:20:33.378743 11899 raft_consensus.cc:493] T 1528ab62b6fe4e3099d08f141afee116 P b7ab4784c7344b939bc36f639286f377 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 7ba59cc884714e8aa5f3f0ecaed84cbb)
W20260709 13:20:33.409695  6773 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:33.412444  6872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de3186201e1a40d0b335eeb8b4e256e0" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:33.415633  6872 raft_consensus.cc:2468] T de3186201e1a40d0b335eeb8b4e256e0 P cd75a17ab2604397adab03bb8b5fd75c [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 15.
I20260709 13:20:33.420161 11781 raft_consensus.cc:3060] T b56bf91d90824c959e21e0cee5ba1816 P cd75a17ab2604397adab03bb8b5fd75c [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:33.396625 11803 raft_consensus.cc:493] T ab432e62819d499eaaf3dd55481dd930 P cd75a17ab2604397adab03bb8b5fd75c [term 15 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
W20260709 13:20:33.424877  6847 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:33.415104 11899 raft_consensus.cc:3060] T 1528ab62b6fe4e3099d08f141afee116 P b7ab4784c7344b939bc36f639286f377 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:20:33.413560 11933 raft_consensus.cc:493] T 3fa34c08b205435dba97346991aa1f92 P cd75a17ab2604397adab03bb8b5fd75c [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:33.411495 11656 consensus_queue.cc:237] T ce4f062dcd314d43a63ca74067cb5ee3 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 15, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } attrs { replace: true } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:20:33.429183 11909 raft_consensus.cc:3055] T 4f00a2e87e56452083b759f60d461ee3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 14 LEADER]: Stepping down as leader of term 14
W20260709 13:20:33.460415  6697 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 222031us
W20260709 13:20:33.462199  6770 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 88623.2us
I20260709 13:20:33.465375  6697 leader_election.cc:304] T fe20b4b48823486ca3b9c648db6ce8aa P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:20:33.472594 11010 raft_consensus.cc:2749] T fe20b4b48823486ca3b9c648db6ce8aa P ccd8a4c3bfe3413cb2ae219b09aea832 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:20:33.475065  6697 leader_election.cc:304] T 3d65025eea89441290d85dd053810e31 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:20:33.422711 11683 consensus_queue.cc:237] T 30e88460611e47b2ba16a46a30b5f416 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.6, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:33.453233 11909 raft_consensus.cc:740] T 4f00a2e87e56452083b759f60d461ee3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 7ba59cc884714e8aa5f3f0ecaed84cbb, State: Running, Role: LEADER
I20260709 13:20:33.441465 11803 raft_consensus.cc:515] T ab432e62819d499eaaf3dd55481dd930 P cd75a17ab2604397adab03bb8b5fd75c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
W20260709 13:20:33.485284  6772 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 99363.2us
W20260709 13:20:33.500185  6847 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:33.487339 11710 raft_consensus.cc:2749] T 3d65025eea89441290d85dd053810e31 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:20:33.482628 11576 leader_election.cc:290] T 95a75bfe094d4bdc963aba3f08dfcd25 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:20:33.453734 11933 raft_consensus.cc:515] T 3fa34c08b205435dba97346991aa1f92 P cd75a17ab2604397adab03bb8b5fd75c [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:20:33.521461  6770 leader_election.cc:304] T 34f36d59d88f40fe8a2805e604fc6c0a P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
W20260709 13:20:33.522908  7466 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 281271us
I20260709 13:20:33.488405 11846 raft_consensus.cc:2749] T 7887766dc6784fcaa42b35c05fea7a99 P b7ab4784c7344b939bc36f639286f377 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:20:33.494333 11636 raft_consensus.cc:493] T 853ac0a8cbd64ce99457f170216d4d0f P ccd8a4c3bfe3413cb2ae219b09aea832 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:33.474323 11010 consensus_queue.cc:1048] T 7c37d41cd9164c15a6826ca62a851a69 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.042s
I20260709 13:20:33.490599 11744 leader_election.cc:290] T f09c2a98de1a4decabd0ff900dd44caa P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 16 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:33.510802 11837 raft_consensus.cc:493] T 17587d6730594da4a56fa13a353232a1 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:33.517382 11937 raft_consensus.cc:2749] T c4db81d9d329422bb3b4160ca4ac2d1d P cd75a17ab2604397adab03bb8b5fd75c [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:20:33.531153  6770 leader_election.cc:304] T e77e330a82df4b43a745d57a68f6f057 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
I20260709 13:20:33.524812  6772 leader_election.cc:304] T bd6869f07b5a4885a0b99fbe60c3b175 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
W20260709 13:20:33.545506 11934 log.cc:927] Time spent T d8cee0accdb8499c86d4414b72565a38 P cd75a17ab2604397adab03bb8b5fd75c: Append to log took a long time: real 0.062s	user 0.001s	sys 0.000s
I20260709 13:20:33.497287 11687 consensus_queue.cc:1048] T 853ac0a8cbd64ce99457f170216d4d0f P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.032s
I20260709 13:20:33.523643 11938 raft_consensus.cc:2749] T 20f6842e26174571996b8dea4151d4be P cd75a17ab2604397adab03bb8b5fd75c [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:20:33.557179  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 158557us
I20260709 13:20:33.537744 11915 raft_consensus.cc:2804] T 34f36d59d88f40fe8a2805e604fc6c0a P b7ab4784c7344b939bc36f639286f377 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:20:33.521421 11822 raft_consensus.cc:515] T de3186201e1a40d0b335eeb8b4e256e0 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:33.559888  6844 leader_election.cc:304] T 24ee15416e3145beaa1b8183453729a3 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:20:33.570226  6876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c7f33e544204fbaac4078e3e83bbf4e" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:20:33.571862  6874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77e330a82df4b43a745d57a68f6f057" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:20:33.592898  6844 leader_election.cc:304] T f03d0dbf16864ca4bc1bb5e4c0334c0f P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377
I20260709 13:20:33.577301  6881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34f36d59d88f40fe8a2805e604fc6c0a" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:20:33.593983  6881 raft_consensus.cc:3060] T 34f36d59d88f40fe8a2805e604fc6c0a P cd75a17ab2604397adab03bb8b5fd75c [term 10 FOLLOWER]: Advancing to term 12
I20260709 13:20:33.596789  6876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f00a2e87e56452083b759f60d461ee3" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:20:33.597925  6880 raft_consensus.cc:1275] T 853ac0a8cbd64ce99457f170216d4d0f P cd75a17ab2604397adab03bb8b5fd75c [term 12 FOLLOWER]: Refusing update from remote peer b7ab4784c7344b939bc36f639286f377: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:20:33.586481  6879 raft_consensus.cc:1275] T 2c240553ce044eedb41541d72b9475d7 P cd75a17ab2604397adab03bb8b5fd75c [term 15 FOLLOWER]: Refusing update from remote peer b7ab4784c7344b939bc36f639286f377: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:20:33.604753 11822 leader_election.cc:290] T de3186201e1a40d0b335eeb8b4e256e0 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 16 election: Requested vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
W20260709 13:20:33.606207 11911 consensus_meta.cc:287] T 711ef6523deb4cbe8ef2ba61e1c21c98 P b7ab4784c7344b939bc36f639286f377: Time spent flushing consensus metadata: real 0.520s	user 0.008s	sys 0.003s
I20260709 13:20:33.606810 11911 raft_consensus.cc:515] T 711ef6523deb4cbe8ef2ba61e1c21c98 P b7ab4784c7344b939bc36f639286f377 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:33.607686  6872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ba5dac66ab5497e9e336f2a3c28cda5" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:33.608789  6872 raft_consensus.cc:2410] T 7ba5dac66ab5497e9e336f2a3c28cda5 P cd75a17ab2604397adab03bb8b5fd75c [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7ab4784c7344b939bc36f639286f377 for term 15 because replica has last-logged OpId of term: 13 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 10.
W20260709 13:20:33.611423 11931 log.cc:927] Time spent T dbdf895bba214ff68685a24fd17dfb5d P b7ab4784c7344b939bc36f639286f377: Append to log took a long time: real 0.095s	user 0.000s	sys 0.001s
I20260709 13:20:33.553234 11909 consensus_queue.cc:260] T 4f00a2e87e56452083b759f60d461ee3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:20:33.557993 11900 raft_consensus.cc:2804] T e77e330a82df4b43a745d57a68f6f057 P b7ab4784c7344b939bc36f639286f377 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:20:33.613260 11909 raft_consensus.cc:3060] T 4f00a2e87e56452083b759f60d461ee3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:33.616142 11938 raft_consensus.cc:2749] T 24ee15416e3145beaa1b8183453729a3 P cd75a17ab2604397adab03bb8b5fd75c [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:20:33.621423 11803 leader_election.cc:290] T ab432e62819d499eaaf3dd55481dd930 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:20:33.557336 11725 raft_consensus.cc:2749] T bd6869f07b5a4885a0b99fbe60c3b175 P b7ab4784c7344b939bc36f639286f377 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:20:33.624225  6805 raft_consensus.cc:2393] T 711ef6523deb4cbe8ef2ba61e1c21c98 P b7ab4784c7344b939bc36f639286f377 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate ccd8a4c3bfe3413cb2ae219b09aea832 in current term 16: Already voted for candidate b7ab4784c7344b939bc36f639286f377 in this term.
I20260709 13:20:33.626474  6725 raft_consensus.cc:2393] T de3186201e1a40d0b335eeb8b4e256e0 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c in current term 16: Already voted for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in this term.
I20260709 13:20:33.603650  6730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09c2a98de1a4decabd0ff900dd44caa" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:20:33.634796  6730 raft_consensus.cc:3060] T f09c2a98de1a4decabd0ff900dd44caa P ccd8a4c3bfe3413cb2ae219b09aea832 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:33.637717  6874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09c2a98de1a4decabd0ff900dd44caa" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:20:33.642398  7503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ba5dac66ab5497e9e336f2a3c28cda5" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
W20260709 13:20:33.645010  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 53018.8us
I20260709 13:20:33.646132  6844 leader_election.cc:304] T 1bf4668eeb70467fb3dc5a0289233b3c P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:20:33.647668  6844 leader_election.cc:304] T e31b9971c15848dea59d4d4130141d9e P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:20:33.655009  7503 raft_consensus.cc:2410] T 7ba5dac66ab5497e9e336f2a3c28cda5 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7ab4784c7344b939bc36f639286f377 for term 15 because replica has last-logged OpId of term: 13 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 10.
I20260709 13:20:33.549510 11636 raft_consensus.cc:515] T 853ac0a8cbd64ce99457f170216d4d0f P ccd8a4c3bfe3413cb2ae219b09aea832 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:33.661695 11576 raft_consensus.cc:2749] T 1bf4668eeb70467fb3dc5a0289233b3c P cd75a17ab2604397adab03bb8b5fd75c [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:20:33.552627 11837 raft_consensus.cc:515] T 17587d6730594da4a56fa13a353232a1 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
W20260709 13:20:33.702461 11511 consensus_meta.cc:287] T 24ee15416e3145beaa1b8183453729a3 P 7ba59cc884714e8aa5f3f0ecaed84cbb: Time spent flushing consensus metadata: real 0.517s	user 0.008s	sys 0.005s
W20260709 13:20:33.705302 11928 log.cc:927] Time spent T 3411566abe2d4c9bb4b2adfdd05e6f17 P ccd8a4c3bfe3413cb2ae219b09aea832: Append to log took a long time: real 0.399s	user 0.003s	sys 0.000s
I20260709 13:20:33.706964 11796 leader_election.cc:290] T 711ef6523deb4cbe8ef2ba61e1c21c98 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 16 election: Requested vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:33.676868  7496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1528ab62b6fe4e3099d08f141afee116" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:20:33.709019 11933 leader_election.cc:290] T 3fa34c08b205435dba97346991aa1f92 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:20:33.715055 11899 raft_consensus.cc:515] T 1528ab62b6fe4e3099d08f141afee116 P b7ab4784c7344b939bc36f639286f377 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:20:33.640650 11911 leader_election.cc:290] T 711ef6523deb4cbe8ef2ba61e1c21c98 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 16 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
W20260709 13:20:33.718838  6845 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:33.766108  6726 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50004 (request call id 2369) took 1073 ms. Trace:
I20260709 13:20:33.725154  7503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f00a2e87e56452083b759f60d461ee3" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb"
I20260709 13:20:33.641706 11900 raft_consensus.cc:697] T e77e330a82df4b43a745d57a68f6f057 P b7ab4784c7344b939bc36f639286f377 [term 16 LEADER]: Becoming Leader. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
I20260709 13:20:33.766655  6726 rpcz_store.cc:276] 0709 13:20:32.693084 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:32.864121 (+171037us) service_pool.cc:224] Handling call
0709 13:20:32.864461 (+   340us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:32.896631 (+ 32170us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:32.896668 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:20:32.897218 (+   550us) log.cc:844] Serialized 26 byte log entry
0709 13:20:33.116234 (+219016us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:20:33.116276 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:33.116345 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:33.704636 (+588291us) spinlock_profiling.cc:243] Waited 3.91 ms on lock 0x7b4400022b4c. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0c745db1 00007fcc0c7e3c85 00007fcc0c7e46a2 00007fcc0f5561db 00007fcc0f551aaf 00007fcc0f54586e 00007fcc0f544bb6 00007fcc0f5447d8 00007fcc0f54e221 00007fcc0f54e1d9 00007fcc0f54e169
0709 13:20:33.724342 (+ 19706us) raft_consensus.cc:1685] finished
0709 13:20:33.724376 (+    34us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:33.765994 (+ 41618us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2230,"raft.run_cpu_time_us":160,"raft.run_wall_time_us":3052,"spinlock_wait_cycles":9000704,"thread_start_us":218596,"threads_started":1,"wal-append.queue_time_us":372293}
I20260709 13:20:33.668215 11937 raft_consensus.cc:2804] T f03d0dbf16864ca4bc1bb5e4c0334c0f P cd75a17ab2604397adab03bb8b5fd75c [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 13:20:33.816941  6846 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:33.817323 11938 raft_consensus.cc:493] T 7a734b5ab7834e05a8c422208acc58b1 P cd75a17ab2604397adab03bb8b5fd75c [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:33.820785 11938 raft_consensus.cc:515] T 7a734b5ab7834e05a8c422208acc58b1 P cd75a17ab2604397adab03bb8b5fd75c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:33.822988 11792 raft_consensus.cc:515] T c4db81d9d329422bb3b4160ca4ac2d1d P ccd8a4c3bfe3413cb2ae219b09aea832 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:33.824239 11900 consensus_queue.cc:237] T e77e330a82df4b43a745d57a68f6f057 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 15.8, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } }
I20260709 13:20:33.765666 11576 raft_consensus.cc:2749] T e31b9971c15848dea59d4d4130141d9e P cd75a17ab2604397adab03bb8b5fd75c [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:20:33.778268 11937 raft_consensus.cc:493] T f03d0dbf16864ca4bc1bb5e4c0334c0f P cd75a17ab2604397adab03bb8b5fd75c [term 12 FOLLOWER]: Starting leader election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:20:33.830582 11937 raft_consensus.cc:3060] T f03d0dbf16864ca4bc1bb5e4c0334c0f P cd75a17ab2604397adab03bb8b5fd75c [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:20:33.835453 11634 consensus_meta.cc:287] T 7887766dc6784fcaa42b35c05fea7a99 P ccd8a4c3bfe3413cb2ae219b09aea832: Time spent flushing consensus metadata: real 0.625s	user 0.012s	sys 0.004s
I20260709 13:20:33.836474 11837 leader_election.cc:290] T 17587d6730594da4a56fa13a353232a1 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
W20260709 13:20:33.837340 11904 consensus_meta.cc:287] T 7a734b5ab7834e05a8c422208acc58b1 P b7ab4784c7344b939bc36f639286f377: Time spent flushing consensus metadata: real 0.632s	user 0.013s	sys 0.000s
I20260709 13:20:33.847193 11792 leader_election.cc:290] T c4db81d9d329422bb3b4160ca4ac2d1d P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 13 election: Requested vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:33.823498 11938 leader_election.cc:290] T 7a734b5ab7834e05a8c422208acc58b1 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
W20260709 13:20:33.856935  7468 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:33.870082  6881 raft_consensus.cc:2468] T 34f36d59d88f40fe8a2805e604fc6c0a P cd75a17ab2604397adab03bb8b5fd75c [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 12.
I20260709 13:20:33.877434  6730 raft_consensus.cc:2468] T f09c2a98de1a4decabd0ff900dd44caa P ccd8a4c3bfe3413cb2ae219b09aea832 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 16.
I20260709 13:20:33.891206 11752 raft_consensus.cc:3055] T ab432e62819d499eaaf3dd55481dd930 P b7ab4784c7344b939bc36f639286f377 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:20:33.925261  7503 raft_consensus.cc:2468] T 4f00a2e87e56452083b759f60d461ee3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 15.
I20260709 13:20:33.908164 11668 raft_consensus.cc:493] T 3fa34c08b205435dba97346991aa1f92 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:20:33.960254  6847 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:33.917994 11752 raft_consensus.cc:740] T ab432e62819d499eaaf3dd55481dd930 P b7ab4784c7344b939bc36f639286f377 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
I20260709 13:20:33.991474  6724 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49998 (request call id 1227) took 1185 ms. Trace:
I20260709 13:20:33.930972  6629 catalog_manager.cc:5697] T ab432e62819d499eaaf3dd55481dd930 P ccd8a4c3bfe3413cb2ae219b09aea832 reported cstate change: term changed from 1 to 12, leader changed from ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65) to b7ab4784c7344b939bc36f639286f377 (127.5.126.66). New cstate: current_term: 12 leader_uuid: "b7ab4784c7344b939bc36f639286f377" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } }
W20260709 13:20:33.991449  6697 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 482372us
I20260709 13:20:33.928834 11781 raft_consensus.cc:493] T 8c7f33e544204fbaac4078e3e83bbf4e P cd75a17ab2604397adab03bb8b5fd75c [term 11 FOLLOWER]: Starting pre-election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:20:34.005868  6726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17587d6730594da4a56fa13a353232a1" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 20 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:34.028275 11846 raft_consensus.cc:493] T b56bf91d90824c959e21e0cee5ba1816 P b7ab4784c7344b939bc36f639286f377 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:34.001674 11634 raft_consensus.cc:493] T b56bf91d90824c959e21e0cee5ba1816 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:34.021215  6731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1528ab62b6fe4e3099d08f141afee116" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:20:34.001338 11757 raft_consensus.cc:493] T 44bde925b2e541b69890d70715b85176 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:34.054095  6727 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49744 (request call id 518) took 1362 ms. Trace:
W20260709 13:20:34.030845  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 383267us
I20260709 13:20:34.055956  6844 leader_election.cc:304] T 4b8cacb381b746da8d0049b0a83b41dd P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:20:34.054719  6727 rpcz_store.cc:276] 0709 13:20:32.691262 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:32.691578 (+   316us) service_pool.cc:224] Handling call
0709 13:20:32.693222 (+  1644us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:32.974346 (+281124us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:32.974379 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:20:32.974952 (+   573us) log.cc:844] Serialized 26 byte log entry
0709 13:20:33.211119 (+236167us) spinlock_profiling.cc:243] Waited 1.81 ms on lock 0x7b1800403720. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc15785de1 00007fcc157925b1 00007fcc0c89fe07 00007fcc156faab9 00007fcc0c8bc69b 00007fcc0c8ba93f 00007fcc0c8bcc02 00007fcc0f54420b 00007fcc0f549d23 00007fcc0f54a0d1 00007fcc0f965a0f
0709 13:20:33.530914 (+319795us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:20:33.530962 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:34.053635 (+522673us) spinlock_profiling.cc:243] Waited 281 ms on lock 0x7b54000e4a54. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f9aae01 00007fcc0f9a983e 00007fcc1496e419 00007fcc0dee5bd4 00007fcc0dee5b62 00007fcc0dee5a91 00007fcc0dee5a0c 00007fcc0dee4cc2 00007fcc0dce548c 00007fcc0dce48c6
0709 13:20:34.053708 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:34.053775 (+    67us) raft_consensus.cc:1685] finished
0709 13:20:34.053796 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:34.054013 (+   217us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1341,"raft.queue_time_us":876,"raft.run_cpu_time_us":184,"raft.run_wall_time_us":12641,"spinlock_wait_cycles":649603584,"thread_start_us":319586,"threads_started":1,"wal-append.queue_time_us":664884}
I20260709 13:20:34.057989  6844 leader_election.cc:304] T 9e326172347f45e99a0d482b5d8ef768 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
W20260709 13:20:34.032869  6773 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:34.035367  6803 raft_consensus.cc:1240] T 1528ab62b6fe4e3099d08f141afee116 P b7ab4784c7344b939bc36f639286f377 [term 11 FOLLOWER]: Rejecting Update request from peer 7ba59cc884714e8aa5f3f0ecaed84cbb for earlier term 10. Current term is 11. Ops: []
I20260709 13:20:34.020476 11938 raft_consensus.cc:493] T 3d65025eea89441290d85dd053810e31 P cd75a17ab2604397adab03bb8b5fd75c [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:34.023231 11904 raft_consensus.cc:493] T 3a485a995abc4807b6e511e45419f737 P b7ab4784c7344b939bc36f639286f377 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:20:34.070748  7467 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:34.024765 11636 leader_election.cc:290] T 853ac0a8cbd64ce99457f170216d4d0f P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:34.044288  6697 leader_election.cc:304] T 2c240553ce044eedb41541d72b9475d7 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377
I20260709 13:20:34.067473  6844 leader_election.cc:304] T 4275cf08e63345f993bce8664eada830 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:20:34.075371  6697 leader_election.cc:304] T bb3d8792045a4583ae2e965b1350a5b4 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:20:34.043036  6724 rpcz_store.cc:276] 0709 13:20:32.805673 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:32.946154 (+140481us) service_pool.cc:224] Handling call
0709 13:20:32.946469 (+   315us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:33.250983 (+304514us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:33.991048 (+740065us) spinlock_profiling.cc:243] Waited 304 ms on lock 0x7b540020bcd4. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f9aae01 00007fcc0f9a983e 00007fcc1496e419 00007fcc0dee5bd4 00007fcc0dee5b62 00007fcc0dee5a91 00007fcc0dee5a0c 00007fcc0dee4cc2 00007fcc0dce548c 00007fcc0dce48c6
0709 13:20:33.991380 (+   332us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":698528128}
I20260709 13:20:34.043001  6800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17587d6730594da4a56fa13a353232a1" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 20 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:34.054749 11846 raft_consensus.cc:515] T b56bf91d90824c959e21e0cee5ba1816 P b7ab4784c7344b939bc36f639286f377 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:34.049471  6731 raft_consensus.cc:1275] T 2c240553ce044eedb41541d72b9475d7 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 15 FOLLOWER]: Refusing update from remote peer b7ab4784c7344b939bc36f639286f377: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:20:34.048727  6629 catalog_manager.cc:5697] T 30e88460611e47b2ba16a46a30b5f416 P ccd8a4c3bfe3413cb2ae219b09aea832 reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } health_report { overall_health: HEALTHY } } }
I20260709 13:20:34.039427 11915 raft_consensus.cc:697] T 34f36d59d88f40fe8a2805e604fc6c0a P b7ab4784c7344b939bc36f639286f377 [term 12 LEADER]: Becoming Leader. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
I20260709 13:20:34.054145  6729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "711ef6523deb4cbe8ef2ba61e1c21c98" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:20:34.033852 11899 leader_election.cc:290] T 1528ab62b6fe4e3099d08f141afee116 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 11 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:20:34.070904  6726 raft_consensus.cc:1240] T ab432e62819d499eaaf3dd55481dd930 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 16 FOLLOWER]: Rejecting Update request from peer b7ab4784c7344b939bc36f639286f377 for earlier term 15. Current term is 16. Ops: [15.8-15.8]
W20260709 13:20:34.040446  6847 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:34.043262 11576 raft_consensus.cc:493] T d8292e16e5654be6bc408560cf256aaa P cd75a17ab2604397adab03bb8b5fd75c [term 17 FOLLOWER]: Starting pre-election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:20:34.036885 11810 consensus_queue.cc:1048] T 3a485a995abc4807b6e511e45419f737 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.033s
I20260709 13:20:34.063001 11946 raft_consensus.cc:493] T f5be3a11b23d4ea9b08300a2789821c7 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:34.080193  6629 catalog_manager.cc:5697] T 9b3759de40694069b13c0f8bd40e5709 P ccd8a4c3bfe3413cb2ae219b09aea832 reported cstate change: term changed from 6 to 10. New cstate: current_term: 10 leader_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } health_report { overall_health: HEALTHY } } }
I20260709 13:20:34.082249  6729 raft_consensus.cc:2393] T 711ef6523deb4cbe8ef2ba61e1c21c98 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate b7ab4784c7344b939bc36f639286f377 in current term 16: Already voted for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in this term.
I20260709 13:20:34.076563  6844 leader_election.cc:304] T a1704639a875409b9959353527b3fd68 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
W20260709 13:20:34.088188  7467 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:34.103996  7495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fa34c08b205435dba97346991aa1f92" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:20:34.068804 11700 raft_consensus.cc:2749] T 4b8cacb381b746da8d0049b0a83b41dd P cd75a17ab2604397adab03bb8b5fd75c [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:20:34.120997  6726 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ce4f062dcd314d43a63ca74067cb5ee3"
dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
mode: GRACEFUL
new_leader_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
 from {username='slave'} at 127.0.0.1:38536
W20260709 13:20:34.121047  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 44596us
I20260709 13:20:34.121788  6726 raft_consensus.cc:606] T ce4f062dcd314d43a63ca74067cb5ee3 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 15 FOLLOWER]: Received request to transfer leadership to TS cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:20:34.121980  6878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fa34c08b205435dba97346991aa1f92" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:34.122380  6844 leader_election.cc:304] T bb3d8792045a4583ae2e965b1350a5b4 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:20:34.122658  6878 raft_consensus.cc:2468] T 3fa34c08b205435dba97346991aa1f92 P cd75a17ab2604397adab03bb8b5fd75c [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 16.
I20260709 13:20:34.122218  6726 raft_consensus.cc:614] T ce4f062dcd314d43a63ca74067cb5ee3 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 15 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:20:34.045631 11668 raft_consensus.cc:515] T 3fa34c08b205435dba97346991aa1f92 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:20:34.128872  6878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbdf895bba214ff68685a24fd17dfb5d" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 13 candidate_status { last_received { term: 10 index: 4 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:20:34.130328  6881 raft_consensus.cc:1275] T 3a485a995abc4807b6e511e45419f737 P cd75a17ab2604397adab03bb8b5fd75c [term 13 FOLLOWER]: Refusing update from remote peer ccd8a4c3bfe3413cb2ae219b09aea832: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:20:34.072402 11944 raft_consensus.cc:2749] T 9e326172347f45e99a0d482b5d8ef768 P cd75a17ab2604397adab03bb8b5fd75c [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:20:34.133430  6881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de3186201e1a40d0b335eeb8b4e256e0" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:20:34.134045  6881 raft_consensus.cc:3060] T de3186201e1a40d0b335eeb8b4e256e0 P cd75a17ab2604397adab03bb8b5fd75c [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:34.054205 11781 raft_consensus.cc:515] T 8c7f33e544204fbaac4078e3e83bbf4e P cd75a17ab2604397adab03bb8b5fd75c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:34.142107  6844 leader_election.cc:304] T 713b5728a197487c9300b310ab94e5a3 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377
I20260709 13:20:34.081918 11941 raft_consensus.cc:2804] T 2c240553ce044eedb41541d72b9475d7 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:20:34.063719 11634 raft_consensus.cc:515] T b56bf91d90824c959e21e0cee5ba1816 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:34.147670  7500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fa34c08b205435dba97346991aa1f92" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:20:34.150184  6697 leader_election.cc:304] T 427c124d773f483294511e80fe340075 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377
I20260709 13:20:34.068583 11757 raft_consensus.cc:515] T 44bde925b2e541b69890d70715b85176 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:34.074205 11938 raft_consensus.cc:515] T 3d65025eea89441290d85dd053810e31 P cd75a17ab2604397adab03bb8b5fd75c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:34.169121  7495 raft_consensus.cc:2468] T 3fa34c08b205435dba97346991aa1f92 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 16.
I20260709 13:20:34.076962 11803 consensus_queue.cc:1059] T 4d9def8b32fd443aa94ab1420b06837b P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: INVALID_TERM, Last received: 13.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.067s
I20260709 13:20:34.133335 11837 raft_consensus.cc:493] T ce4f062dcd314d43a63ca74067cb5ee3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:34.125442 11933 raft_consensus.cc:2749] T 4275cf08e63345f993bce8664eada830 P cd75a17ab2604397adab03bb8b5fd75c [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:20:34.161314  6697 leader_election.cc:304] T 3fa34c08b205435dba97346991aa1f92 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:20:34.077586 11904 raft_consensus.cc:515] T 3a485a995abc4807b6e511e45419f737 P b7ab4784c7344b939bc36f639286f377 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
W20260709 13:20:34.147637 11932 log.cc:927] Time spent T a1704639a875409b9959353527b3fd68 P ccd8a4c3bfe3413cb2ae219b09aea832: Append to log took a long time: real 0.052s	user 0.001s	sys 0.000s
I20260709 13:20:34.160446  6629 catalog_manager.cc:5697] T 3d65025eea89441290d85dd053810e31 P ccd8a4c3bfe3413cb2ae219b09aea832 reported cstate change: term changed from 6 to 9. New cstate: current_term: 9 leader_uuid: "b7ab4784c7344b939bc36f639286f377" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } }
I20260709 13:20:34.096457 11576 raft_consensus.cc:515] T d8292e16e5654be6bc408560cf256aaa P cd75a17ab2604397adab03bb8b5fd75c [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:34.151450 11941 raft_consensus.cc:493] T 2c240553ce044eedb41541d72b9475d7 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:34.126565 11909 consensus_queue.cc:1059] T 1528ab62b6fe4e3099d08f141afee116 P 7ba59cc884714e8aa5f3f0ecaed84cbb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.051s
I20260709 13:20:34.193989  6697 leader_election.cc:304] T dbdf895bba214ff68685a24fd17dfb5d P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:20:34.164908 11796 raft_consensus.cc:493] T 4d9def8b32fd443aa94ab1420b06837b P ccd8a4c3bfe3413cb2ae219b09aea832 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:34.167233 11010 raft_consensus.cc:2804] T 427c124d773f483294511e80fe340075 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:20:34.203120  6629 catalog_manager.cc:5697] T 404190ce4ce94cecbfcb6ea9d1dd8626 P ccd8a4c3bfe3413cb2ae219b09aea832 reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } } }
I20260709 13:20:34.106920 11752 consensus_queue.cc:260] T ab432e62819d499eaaf3dd55481dd930 P b7ab4784c7344b939bc36f639286f377 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:34.209133  6726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fa34c08b205435dba97346991aa1f92" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:34.118580 11946 raft_consensus.cc:515] T f5be3a11b23d4ea9b08300a2789821c7 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
W20260709 13:20:34.216660  6770 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 153146us
I20260709 13:20:34.220887  6881 raft_consensus.cc:2468] T de3186201e1a40d0b335eeb8b4e256e0 P cd75a17ab2604397adab03bb8b5fd75c [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 16.
I20260709 13:20:34.227787  6881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "853ac0a8cbd64ce99457f170216d4d0f" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:34.228837  6881 raft_consensus.cc:2468] T 853ac0a8cbd64ce99457f170216d4d0f P cd75a17ab2604397adab03bb8b5fd75c [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 12.
I20260709 13:20:34.251770 11668 leader_election.cc:290] T 3fa34c08b205435dba97346991aa1f92 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:34.252507  6629 catalog_manager.cc:5697] T 7c44c4849aa54f2b94d1f1bef9ed546f P ccd8a4c3bfe3413cb2ae219b09aea832 reported cstate change: term changed from 9 to 12, leader changed from ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65) to b7ab4784c7344b939bc36f639286f377 (127.5.126.66). New cstate: current_term: 12 leader_uuid: "b7ab4784c7344b939bc36f639286f377" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } }
I20260709 13:20:34.204342 11941 raft_consensus.cc:3060] T 2c240553ce044eedb41541d72b9475d7 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:34.229033  6770 leader_election.cc:304] T f09c2a98de1a4decabd0ff900dd44caa P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
W20260709 13:20:34.314908  6770 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 86027.1us
I20260709 13:20:34.260679 11803 raft_consensus.cc:3055] T 4d9def8b32fd443aa94ab1420b06837b P cd75a17ab2604397adab03bb8b5fd75c [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:20:34.198591 11636 consensus_queue.cc:1048] T 3a485a995abc4807b6e511e45419f737 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.070s
W20260709 13:20:34.269186 11949 log.cc:927] Time spent T ce4f062dcd314d43a63ca74067cb5ee3 P b7ab4784c7344b939bc36f639286f377: Append to log took a long time: real 0.198s	user 0.001s	sys 0.001s
I20260709 13:20:34.270452 11781 leader_election.cc:290] T 8c7f33e544204fbaac4078e3e83bbf4e P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:20:34.220932 11956 raft_consensus.cc:2749] T bb3d8792045a4583ae2e965b1350a5b4 P cd75a17ab2604397adab03bb8b5fd75c [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:20:34.271724 11567 raft_consensus.cc:2749] T dbdf895bba214ff68685a24fd17dfb5d P ccd8a4c3bfe3413cb2ae219b09aea832 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:20:34.272919 11938 leader_election.cc:290] T 3d65025eea89441290d85dd053810e31 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:20:34.273892 11846 leader_election.cc:290] T b56bf91d90824c959e21e0cee5ba1816 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:34.372393  7495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1528ab62b6fe4e3099d08f141afee116" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb"
I20260709 13:20:34.220688 11010 raft_consensus.cc:493] T 427c124d773f483294511e80fe340075 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 7ba59cc884714e8aa5f3f0ecaed84cbb)
I20260709 13:20:34.373238 11010 raft_consensus.cc:3060] T 427c124d773f483294511e80fe340075 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:34.373610 11955 ts_tablet_manager.cc:933] T 7a734b5ab7834e05a8c422208acc58b1 P 7ba59cc884714e8aa5f3f0ecaed84cbb: Initiating tablet copy from peer b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:20:34.275298  6725 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49998 (request call id 1239) took 1172 ms. Trace:
I20260709 13:20:34.375330  6725 rpcz_store.cc:276] 0709 13:20:33.102547 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:33.103591 (+  1044us) service_pool.cc:224] Handling call
0709 13:20:34.275092 (+1171501us) spinlock_profiling.cc:243] Waited 513 ms on lock 0x7b540020b7d4. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f9ae2fa 00007fcc1496fb17 00007fcc0deea6d4 00007fcc0deea662 00007fcc0deea591 00007fcc0deea50c 00007fcc0dee97c2 00007fcc0dce548c 00007fcc0dce48c6 00007fcc0dce426f
0709 13:20:34.275236 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1180271872}
I20260709 13:20:34.275508 11634 leader_election.cc:290] T b56bf91d90824c959e21e0cee5ba1816 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
W20260709 13:20:34.212299 11940 log.cc:927] Time spent T 7c37d41cd9164c15a6826ca62a851a69 P ccd8a4c3bfe3413cb2ae219b09aea832: Append to log took a long time: real 0.183s	user 0.000s	sys 0.001s
I20260709 13:20:34.385968  6876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a485a995abc4807b6e511e45419f737" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:34.221225 11796 raft_consensus.cc:515] T 4d9def8b32fd443aa94ab1420b06837b P ccd8a4c3bfe3413cb2ae219b09aea832 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:34.276360  6803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de3186201e1a40d0b335eeb8b4e256e0" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:20:34.395077  6803 raft_consensus.cc:3060] T de3186201e1a40d0b335eeb8b4e256e0 P b7ab4784c7344b939bc36f639286f377 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:34.386806  6772 leader_election.cc:304] T 4f00a2e87e56452083b759f60d461ee3 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, b7ab4784c7344b939bc36f639286f377; no voters: 
I20260709 13:20:34.260584 11752 raft_consensus.cc:3060] T ab432e62819d499eaaf3dd55481dd930 P b7ab4784c7344b939bc36f639286f377 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:34.210988 11810 raft_consensus.cc:493] T b3f13b31a1f84f0d89d007eadd57924c P ccd8a4c3bfe3413cb2ae219b09aea832 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:20:34.196512 11915 consensus_queue.cc:237] T 34f36d59d88f40fe8a2805e604fc6c0a P b7ab4784c7344b939bc36f639286f377 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:34.277947  6806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4db81d9d329422bb3b4160ca4ac2d1d" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:20:34.278635  6799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "853ac0a8cbd64ce99457f170216d4d0f" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:34.424283  6772 leader_election.cc:304] T 1528ab62b6fe4e3099d08f141afee116 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:20:34.281242 11904 leader_election.cc:290] T 3a485a995abc4807b6e511e45419f737 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:34.190621 11837 raft_consensus.cc:515] T ce4f062dcd314d43a63ca74067cb5ee3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } attrs { replace: true } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
W20260709 13:20:34.282109 11965 log.cc:927] Time spent T 7c44c4849aa54f2b94d1f1bef9ed546f P cd75a17ab2604397adab03bb8b5fd75c: Append to log took a long time: real 0.071s	user 0.000s	sys 0.001s
I20260709 13:20:34.197926 11683 raft_consensus.cc:2804] T 3fa34c08b205435dba97346991aa1f92 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:20:34.125774 11947 raft_consensus.cc:2804] T bb3d8792045a4583ae2e965b1350a5b4 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:20:34.279603 11937 raft_consensus.cc:515] T f03d0dbf16864ca4bc1bb5e4c0334c0f P cd75a17ab2604397adab03bb8b5fd75c [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:34.322453  6805 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:32976 (request call id 3088) took 1064 ms. Trace:
I20260709 13:20:34.230072  6881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "711ef6523deb4cbe8ef2ba61e1c21c98" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:20:34.332595  6629 catalog_manager.cc:5697] T 07a92dd554674067a83a9cb68c4773f2 P ccd8a4c3bfe3413cb2ae219b09aea832 reported cstate change: term changed from 8 to 10, leader changed from ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65) to b7ab4784c7344b939bc36f639286f377 (127.5.126.66). New cstate: current_term: 10 leader_uuid: "b7ab4784c7344b939bc36f639286f377" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } }
W20260709 13:20:34.309820 11966 log.cc:927] Time spent T 17587d6730594da4a56fa13a353232a1 P 7ba59cc884714e8aa5f3f0ecaed84cbb: Append to log took a long time: real 0.090s	user 0.000s	sys 0.001s
I20260709 13:20:34.342463  6802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b56bf91d90824c959e21e0cee5ba1816" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
W20260709 13:20:34.346618  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 204574us
W20260709 13:20:34.356227  6845 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:34.318531 11967 log.cc:927] Time spent T 17587d6730594da4a56fa13a353232a1 P b7ab4784c7344b939bc36f639286f377: Append to log took a long time: real 0.280s	user 0.003s	sys 0.000s
I20260709 13:20:34.319820 11803 raft_consensus.cc:740] T 4d9def8b32fd443aa94ab1420b06837b P cd75a17ab2604397adab03bb8b5fd75c [term 13 LEADER]: Becoming Follower/Learner. State: Replica: cd75a17ab2604397adab03bb8b5fd75c, State: Running, Role: LEADER
I20260709 13:20:34.359200 11870 raft_consensus.cc:493] T 44bde925b2e541b69890d70715b85176 P b7ab4784c7344b939bc36f639286f377 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:34.352566 11944 raft_consensus.cc:2749] T a1704639a875409b9959353527b3fd68 P cd75a17ab2604397adab03bb8b5fd75c [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:20:34.363135 11899 raft_consensus.cc:493] T f3f9c2e2bf644115957398fe4c9459db P b7ab4784c7344b939bc36f639286f377 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:34.360447 11951 raft_consensus.cc:493] T 427c124d773f483294511e80fe340075 P b7ab4784c7344b939bc36f639286f377 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:34.363799 11910 raft_consensus.cc:493] T 713b5728a197487c9300b310ab94e5a3 P b7ab4784c7344b939bc36f639286f377 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:34.317131 11950 raft_consensus.cc:2804] T f09c2a98de1a4decabd0ff900dd44caa P b7ab4784c7344b939bc36f639286f377 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:20:34.475932 11757 leader_election.cc:290] T 44bde925b2e541b69890d70715b85176 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:34.476658 11710 raft_consensus.cc:493] T f58dc08b12a2494bb9a1372837970ca2 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:20:34.477614 11710 raft_consensus.cc:515] T f58dc08b12a2494bb9a1372837970ca2 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
W20260709 13:20:34.366891  7468 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:34.481208 11837 leader_election.cc:290] T ce4f062dcd314d43a63ca74067cb5ee3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:34.367087 11889 raft_consensus.cc:493] T 404190ce4ce94cecbfcb6ea9d1dd8626 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 7ba59cc884714e8aa5f3f0ecaed84cbb)
W20260709 13:20:34.318776 11961 log.cc:927] Time spent T 90d42e216d9741e190bca19a781291fd P ccd8a4c3bfe3413cb2ae219b09aea832: Append to log took a long time: real 0.058s	user 0.002s	sys 0.001s
I20260709 13:20:34.483371 11889 raft_consensus.cc:515] T 404190ce4ce94cecbfcb6ea9d1dd8626 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:20:34.368947 11781 raft_consensus.cc:493] T a3022224cc81473690653a83d4e99470 P cd75a17ab2604397adab03bb8b5fd75c [term 15 FOLLOWER]: Starting pre-election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:20:34.484736 11937 leader_election.cc:290] T f03d0dbf16864ca4bc1bb5e4c0334c0f P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 13 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:20:34.386845  6876 raft_consensus.cc:2468] T 3a485a995abc4807b6e511e45419f737 P cd75a17ab2604397adab03bb8b5fd75c [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 13.
I20260709 13:20:34.369946 11666 raft_consensus.cc:493] T f03d0dbf16864ca4bc1bb5e4c0334c0f P b7ab4784c7344b939bc36f639286f377 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:34.486023  6876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "711ef6523deb4cbe8ef2ba61e1c21c98" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:20:34.486393 11889 leader_election.cc:290] T 404190ce4ce94cecbfcb6ea9d1dd8626 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:20:34.486670 11666 raft_consensus.cc:515] T f03d0dbf16864ca4bc1bb5e4c0334c0f P b7ab4784c7344b939bc36f639286f377 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:34.487326  6876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b56bf91d90824c959e21e0cee5ba1816" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:34.488090  6876 raft_consensus.cc:2468] T b56bf91d90824c959e21e0cee5ba1816 P cd75a17ab2604397adab03bb8b5fd75c [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 13.
I20260709 13:20:34.489257 11666 leader_election.cc:290] T f03d0dbf16864ca4bc1bb5e4c0334c0f P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:34.491017 11576 leader_election.cc:290] T d8292e16e5654be6bc408560cf256aaa P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:20:34.491731  6880 raft_consensus.cc:3055] T f4b8bd455d5a47c18a1380839c6e0d61 P cd75a17ab2604397adab03bb8b5fd75c [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:20:34.492202  6880 raft_consensus.cc:740] T f4b8bd455d5a47c18a1380839c6e0d61 P cd75a17ab2604397adab03bb8b5fd75c [term 13 LEADER]: Becoming Follower/Learner. State: Replica: cd75a17ab2604397adab03bb8b5fd75c, State: Running, Role: LEADER
I20260709 13:20:34.492414 11899 raft_consensus.cc:515] T f3f9c2e2bf644115957398fe4c9459db P b7ab4784c7344b939bc36f639286f377 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:34.492988  6880 consensus_queue.cc:260] T f4b8bd455d5a47c18a1380839c6e0d61 P cd75a17ab2604397adab03bb8b5fd75c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:34.493950  6880 raft_consensus.cc:3060] T f4b8bd455d5a47c18a1380839c6e0d61 P cd75a17ab2604397adab03bb8b5fd75c [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:34.426752 11810 raft_consensus.cc:515] T b3f13b31a1f84f0d89d007eadd57924c P ccd8a4c3bfe3413cb2ae219b09aea832 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
W20260709 13:20:34.417490  6697 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 223590us
I20260709 13:20:34.496850 11810 leader_election.cc:290] T b3f13b31a1f84f0d89d007eadd57924c P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:20:34.348212 11959 raft_consensus.cc:2804] T 713b5728a197487c9300b310ab94e5a3 P cd75a17ab2604397adab03bb8b5fd75c [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:20:34.497676 11959 raft_consensus.cc:493] T 713b5728a197487c9300b310ab94e5a3 P cd75a17ab2604397adab03bb8b5fd75c [term 12 FOLLOWER]: Starting leader election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:20:34.498143 11567 raft_consensus.cc:493] T f3f9c2e2bf644115957398fe4c9459db P ccd8a4c3bfe3413cb2ae219b09aea832 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:34.378880 11846 raft_consensus.cc:493] T f5be3a11b23d4ea9b08300a2789821c7 P b7ab4784c7344b939bc36f639286f377 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:20:34.418267  6846 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.68:45071, user_credentials={real_user=slave}} blocked reactor thread for 224718us
I20260709 13:20:34.498849 11846 raft_consensus.cc:515] T f5be3a11b23d4ea9b08300a2789821c7 P b7ab4784c7344b939bc36f639286f377 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:34.445573  6844 leader_election.cc:304] T f58dc08b12a2494bb9a1372837970ca2 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:20:34.431958  6806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5be3a11b23d4ea9b08300a2789821c7" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:34.440229 11683 raft_consensus.cc:493] T 3fa34c08b205435dba97346991aa1f92 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 15 FOLLOWER]: Starting leader election (detected failure of leader cd75a17ab2604397adab03bb8b5fd75c)
W20260709 13:20:34.500341  6846 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:34.500816 11683 raft_consensus.cc:3060] T 3fa34c08b205435dba97346991aa1f92 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:20:34.501407  6846 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:34.502633 11968 log.cc:927] Time spent T 853ac0a8cbd64ce99457f170216d4d0f P ccd8a4c3bfe3413cb2ae219b09aea832: Append to log took a long time: real 0.125s	user 0.002s	sys 0.000s
I20260709 13:20:34.503152  6846 leader_election.cc:304] T 3fa34c08b205435dba97346991aa1f92 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:20:34.437131  6875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4db81d9d329422bb3b4160ca4ac2d1d" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:20:34.443287 11687 raft_consensus.cc:493] T dbdf895bba214ff68685a24fd17dfb5d P b7ab4784c7344b939bc36f639286f377 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader cd75a17ab2604397adab03bb8b5fd75c)
I20260709 13:20:34.505228  6875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44bde925b2e541b69890d70715b85176" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:34.505919  6875 raft_consensus.cc:2468] T 44bde925b2e541b69890d70715b85176 P cd75a17ab2604397adab03bb8b5fd75c [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 14.
I20260709 13:20:34.433250  6772 leader_election.cc:304] T 8c7f33e544204fbaac4078e3e83bbf4e P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:20:34.445390  6802 raft_consensus.cc:2468] T b56bf91d90824c959e21e0cee5ba1816 P b7ab4784c7344b939bc36f639286f377 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 13.
I20260709 13:20:34.392982 11973 consensus_queue.cc:1048] T 2c240553ce044eedb41541d72b9475d7 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.086s
I20260709 13:20:34.429483 11911 raft_consensus.cc:2804] T 4f00a2e87e56452083b759f60d461ee3 P b7ab4784c7344b939bc36f639286f377 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:20:34.436371 11953 raft_consensus.cc:2749] T 1528ab62b6fe4e3099d08f141afee116 P b7ab4784c7344b939bc36f639286f377 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:20:34.455058  6629 catalog_manager.cc:5697] T c4db81d9d329422bb3b4160ca4ac2d1d P ccd8a4c3bfe3413cb2ae219b09aea832 reported cstate change: term changed from 8 to 9, leader changed from ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65) to b7ab4784c7344b939bc36f639286f377 (127.5.126.66). New cstate: current_term: 9 leader_uuid: "b7ab4784c7344b939bc36f639286f377" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } }
I20260709 13:20:34.471953 11946 leader_election.cc:290] T f5be3a11b23d4ea9b08300a2789821c7 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:34.473894 11910 raft_consensus.cc:515] T 713b5728a197487c9300b310ab94e5a3 P b7ab4784c7344b939bc36f639286f377 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:34.484640 11781 raft_consensus.cc:515] T a3022224cc81473690653a83d4e99470 P cd75a17ab2604397adab03bb8b5fd75c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:34.494606 11899 leader_election.cc:290] T f3f9c2e2bf644115957398fe4c9459db P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:34.498368 11951 raft_consensus.cc:515] T 427c124d773f483294511e80fe340075 P b7ab4784c7344b939bc36f639286f377 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } attrs { replace: true } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:20:34.500834 11933 raft_consensus.cc:2749] T f58dc08b12a2494bb9a1372837970ca2 P cd75a17ab2604397adab03bb8b5fd75c [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:20:34.527032 11666 raft_consensus.cc:2749] T 8c7f33e544204fbaac4078e3e83bbf4e P b7ab4784c7344b939bc36f639286f377 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:20:34.541880 11951 leader_election.cc:290] T 427c124d773f483294511e80fe340075 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:20:34.512535 11810 raft_consensus.cc:493] T 22ccee1b570c4ad3a57bd7aec085b1b4 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:34.544211 11810 raft_consensus.cc:515] T 22ccee1b570c4ad3a57bd7aec085b1b4 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:34.544582 11710 leader_election.cc:290] T f58dc08b12a2494bb9a1372837970ca2 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:34.546362 11810 leader_election.cc:290] T 22ccee1b570c4ad3a57bd7aec085b1b4 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:34.548467 11910 leader_election.cc:290] T 713b5728a197487c9300b310ab94e5a3 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:34.515954 11889 raft_consensus.cc:493] T 9e326172347f45e99a0d482b5d8ef768 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:20:34.550520 11781 leader_election.cc:290] T a3022224cc81473690653a83d4e99470 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:20:34.552197  6875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b56bf91d90824c959e21e0cee5ba1816" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
W20260709 13:20:34.500252  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 54765.6us
I20260709 13:20:34.552971  6875 raft_consensus.cc:2468] T b56bf91d90824c959e21e0cee5ba1816 P cd75a17ab2604397adab03bb8b5fd75c [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 13.
I20260709 13:20:34.554672  6844 leader_election.cc:304] T d33d5ee8ef6f415593d8df52063161ad P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:20:34.447170  6805 rpcz_store.cc:276] 0709 13:20:33.257916 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:33.259801 (+  1885us) service_pool.cc:224] Handling call
0709 13:20:34.322204 (+1062403us) spinlock_profiling.cc:243] Waited 363 ms on lock 0x7b54001b67d4. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f9ae2fa 00007fcc1496fb17 00007fcc0deea6d4 00007fcc0deea662 00007fcc0deea591 00007fcc0deea50c 00007fcc0dee97c2 00007fcc0dce548c 00007fcc0dce48c6 00007fcc0dce426f
0709 13:20:34.322379 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":834536704}
I20260709 13:20:34.445348  6881 raft_consensus.cc:3060] T 711ef6523deb4cbe8ef2ba61e1c21c98 P cd75a17ab2604397adab03bb8b5fd75c [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:34.507459  6723 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "de3186201e1a40d0b335eeb8b4e256e0"
dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
mode: GRACEFUL
new_leader_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
 from {username='slave'} at 127.0.0.1:38536
I20260709 13:20:34.560420  6880 raft_consensus.cc:1275] T f4b8bd455d5a47c18a1380839c6e0d61 P cd75a17ab2604397adab03bb8b5fd75c [term 14 FOLLOWER]: Refusing update from remote peer b7ab4784c7344b939bc36f639286f377: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 7. (term mismatch)
I20260709 13:20:34.508853  6799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "404190ce4ce94cecbfcb6ea9d1dd8626" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:34.560873  6880 pending_rounds.cc:85] T f4b8bd455d5a47c18a1380839c6e0d61 P cd75a17ab2604397adab03bb8b5fd75c: Aborting all ops after (but not including) 6
I20260709 13:20:34.450068  6803 raft_consensus.cc:2468] T de3186201e1a40d0b335eeb8b4e256e0 P b7ab4784c7344b939bc36f639286f377 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 16.
I20260709 13:20:34.500423  6806 raft_consensus.cc:2468] T f5be3a11b23d4ea9b08300a2789821c7 P b7ab4784c7344b939bc36f639286f377 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 13.
I20260709 13:20:34.508214  6697 leader_election.cc:304] T de3186201e1a40d0b335eeb8b4e256e0 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:20:34.446034 11947 raft_consensus.cc:493] T bb3d8792045a4583ae2e965b1350a5b4 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 7ba59cc884714e8aa5f3f0ecaed84cbb)
I20260709 13:20:34.513856  6801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3f13b31a1f84f0d89d007eadd57924c" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:34.514984 11957 raft_consensus.cc:493] T 7ba5dac66ab5497e9e336f2a3c28cda5 P cd75a17ab2604397adab03bb8b5fd75c [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:20:34.520068  6772 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 86889.2us
W20260709 13:20:34.564483  6697 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 56365us
I20260709 13:20:34.524184  6629 catalog_manager.cc:5697] T bd6869f07b5a4885a0b99fbe60c3b175 P ccd8a4c3bfe3413cb2ae219b09aea832 reported cstate change: term changed from 5 to 11. New cstate: current_term: 11 leader_uuid: "b7ab4784c7344b939bc36f639286f377" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } }
I20260709 13:20:34.522531  6800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44bde925b2e541b69890d70715b85176" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:34.526840  6802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f58dc08b12a2494bb9a1372837970ca2" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:34.527632  6695 leader_election.cc:304] T b56bf91d90824c959e21e0cee5ba1816 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
I20260709 13:20:34.560618  6723 raft_consensus.cc:606] T de3186201e1a40d0b335eeb8b4e256e0 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 16 FOLLOWER]: Received request to transfer leadership to TS cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:20:34.520754 11937 raft_consensus.cc:2804] T 3fa34c08b205435dba97346991aa1f92 P cd75a17ab2604397adab03bb8b5fd75c [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:20:34.468058 11803 consensus_queue.cc:260] T 4d9def8b32fd443aa94ab1420b06837b P cd75a17ab2604397adab03bb8b5fd75c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:34.511102 11670 raft_consensus.cc:493] T 7a734b5ab7834e05a8c422208acc58b1 P b7ab4784c7344b939bc36f639286f377 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:34.511197 11950 raft_consensus.cc:697] T f09c2a98de1a4decabd0ff900dd44caa P b7ab4784c7344b939bc36f639286f377 [term 16 LEADER]: Becoming Leader. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
I20260709 13:20:34.510893 11757 raft_consensus.cc:493] T bd6869f07b5a4885a0b99fbe60c3b175 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:34.533550 11846 leader_election.cc:290] T f5be3a11b23d4ea9b08300a2789821c7 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:34.515076 11567 raft_consensus.cc:515] T f3f9c2e2bf644115957398fe4c9459db P ccd8a4c3bfe3413cb2ae219b09aea832 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:34.458244 11870 raft_consensus.cc:515] T 44bde925b2e541b69890d70715b85176 P b7ab4784c7344b939bc36f639286f377 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:34.536085 11634 raft_consensus.cc:493] T 7c44c4849aa54f2b94d1f1bef9ed546f P ccd8a4c3bfe3413cb2ae219b09aea832 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:20:34.516491 11914 raft_consensus.cc:493] T 24ee15416e3145beaa1b8183453729a3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:34.511405 11954 raft_consensus.cc:493] T 3d65025eea89441290d85dd053810e31 P b7ab4784c7344b939bc36f639286f377 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:34.537806  6872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5be3a11b23d4ea9b08300a2789821c7" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:34.498174 11959 raft_consensus.cc:3060] T 713b5728a197487c9300b310ab94e5a3 P cd75a17ab2604397adab03bb8b5fd75c [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:34.504565 11687 raft_consensus.cc:515] T dbdf895bba214ff68685a24fd17dfb5d P b7ab4784c7344b939bc36f639286f377 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:34.539383 11796 leader_election.cc:290] T 4d9def8b32fd443aa94ab1420b06837b P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:34.561170  6880 pending_rounds.cc:107] T f4b8bd455d5a47c18a1380839c6e0d61 P cd75a17ab2604397adab03bb8b5fd75c: Aborting uncommitted NO_OP operation due to leader change: 11.7
I20260709 13:20:34.563431  6876 pending_rounds.cc:85] T a3022224cc81473690653a83d4e99470 P cd75a17ab2604397adab03bb8b5fd75c: Aborting all ops after (but not including) 7
I20260709 13:20:34.565186  6697 leader_election.cc:304] T 853ac0a8cbd64ce99457f170216d4d0f P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377
I20260709 13:20:34.566489  6723 raft_consensus.cc:614] T de3186201e1a40d0b335eeb8b4e256e0 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 16 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:20:34.529088 11911 raft_consensus.cc:697] T 4f00a2e87e56452083b759f60d461ee3 P b7ab4784c7344b939bc36f639286f377 [term 15 LEADER]: Becoming Leader. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
W20260709 13:20:34.566653  7466 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 288069us
I20260709 13:20:34.569573  6801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d9def8b32fd443aa94ab1420b06837b" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:34.711812  6801 raft_consensus.cc:2468] T 4d9def8b32fd443aa94ab1420b06837b P b7ab4784c7344b939bc36f639286f377 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 13.
W20260709 13:20:34.570240  7467 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:34.568522  6695 leader_election.cc:304] T f5be3a11b23d4ea9b08300a2789821c7 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
I20260709 13:20:34.573115  6802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22ccee1b570c4ad3a57bd7aec085b1b4" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:34.574311  6728 raft_consensus.cc:1240] T c4db81d9d329422bb3b4160ca4ac2d1d P ccd8a4c3bfe3413cb2ae219b09aea832 [term 13 FOLLOWER]: Rejecting Update request from peer b7ab4784c7344b939bc36f639286f377 for earlier term 12. Current term is 13. Ops: []
W20260709 13:20:34.590794  6847 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:34.591537  6772 leader_election.cc:304] T 7ba5dac66ab5497e9e336f2a3c28cda5 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, cd75a17ab2604397adab03bb8b5fd75c
W20260709 13:20:34.715884  6772 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 124484us
I20260709 13:20:34.716092  6880 raft_consensus.cc:2889] T f4b8bd455d5a47c18a1380839c6e0d61 P cd75a17ab2604397adab03bb8b5fd75c [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:20:34.717298  6880 pending_rounds.cc:107] T f4b8bd455d5a47c18a1380839c6e0d61 P cd75a17ab2604397adab03bb8b5fd75c: Aborting uncommitted NO_OP operation due to leader change: 13.8
I20260709 13:20:34.717564  6880 raft_consensus.cc:2889] T f4b8bd455d5a47c18a1380839c6e0d61 P cd75a17ab2604397adab03bb8b5fd75c [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:20:34.575760  6844 leader_election.cc:304] T 3411566abe2d4c9bb4b2adfdd05e6f17 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:20:34.670365  6725 raft_consensus.cc:1275] T f4b8bd455d5a47c18a1380839c6e0d61 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 14 FOLLOWER]: Refusing update from remote peer b7ab4784c7344b939bc36f639286f377: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 14 index: 7. (index mismatch)
I20260709 13:20:34.672551  6731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b56bf91d90824c959e21e0cee5ba1816" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:34.673159  6729 raft_consensus.cc:3060] T 22ccee1b570c4ad3a57bd7aec085b1b4 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:20:34.674160  6773 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:34.704299  6800 raft_consensus.cc:2468] T 44bde925b2e541b69890d70715b85176 P b7ab4784c7344b939bc36f639286f377 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 14.
I20260709 13:20:34.571432 11937 raft_consensus.cc:493] T 3fa34c08b205435dba97346991aa1f92 P cd75a17ab2604397adab03bb8b5fd75c [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:34.675251  6872 raft_consensus.cc:2468] T f5be3a11b23d4ea9b08300a2789821c7 P cd75a17ab2604397adab03bb8b5fd75c [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 12.
I20260709 13:20:34.719449  7466 leader_election.cc:304] T 17587d6730594da4a56fa13a353232a1 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:20:34.692251  6727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a485a995abc4807b6e511e45419f737" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:34.570636 11810 raft_consensus.cc:493] T 713b5728a197487c9300b310ab94e5a3 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:34.564343 11710 raft_consensus.cc:493] T 20f6842e26174571996b8dea4151d4be P ccd8a4c3bfe3413cb2ae219b09aea832 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:20:34.697624  6629 catalog_manager.cc:5697] T 3a485a995abc4807b6e511e45419f737 P ccd8a4c3bfe3413cb2ae219b09aea832 reported cstate change: term changed from 5 to 10. New cstate: current_term: 10 leader_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:34.701833  6724 raft_consensus.cc:1275] T ce4f062dcd314d43a63ca74067cb5ee3 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 15 FOLLOWER]: Refusing update from remote peer b7ab4784c7344b939bc36f639286f377: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:20:34.571672 11933 consensus_queue.cc:1048] T e77e330a82df4b43a745d57a68f6f057 P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Connected to new peer: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.132s
I20260709 13:20:34.575376 11792 raft_consensus.cc:2804] T b56bf91d90824c959e21e0cee5ba1816 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:20:34.564945 11947 raft_consensus.cc:3060] T bb3d8792045a4583ae2e965b1350a5b4 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:34.588970 11666 consensus_queue.cc:1048] T 853ac0a8cbd64ce99457f170216d4d0f P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.125s
I20260709 13:20:34.741637  6725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce4f062dcd314d43a63ca74067cb5ee3" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:34.716490  6876 pending_rounds.cc:107] T a3022224cc81473690653a83d4e99470 P cd75a17ab2604397adab03bb8b5fd75c: Aborting uncommitted NO_OP operation due to leader change: 14.8
I20260709 13:20:34.719583  7495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3f13b31a1f84f0d89d007eadd57924c" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
W20260709 13:20:34.721406  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 145764us
W20260709 13:20:34.722702  7467 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:34.724130  6695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 155694us
I20260709 13:20:34.724350  7501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "404190ce4ce94cecbfcb6ea9d1dd8626" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:20:34.590067 11781 consensus_queue.cc:1048] T f3f9c2e2bf644115957398fe4c9459db P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Connected to new peer: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.119s
I20260709 13:20:34.690815 11914 raft_consensus.cc:515] T 24ee15416e3145beaa1b8183453729a3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
W20260709 13:20:34.749627  6697 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 184528us
I20260709 13:20:34.743083  6629 catalog_manager.cc:5697] T a3022224cc81473690653a83d4e99470 P ccd8a4c3bfe3413cb2ae219b09aea832 reported cstate change: term changed from 8 to 12. New cstate: current_term: 12 leader_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:34.741106  6803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce4f062dcd314d43a63ca74067cb5ee3" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:34.744817  6876 raft_consensus.cc:2889] T a3022224cc81473690653a83d4e99470 P cd75a17ab2604397adab03bb8b5fd75c [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:20:34.550458 11889 raft_consensus.cc:515] T 9e326172347f45e99a0d482b5d8ef768 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:34.673611 11975 raft_consensus.cc:2749] T d33d5ee8ef6f415593d8df52063161ad P cd75a17ab2604397adab03bb8b5fd75c [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:20:34.739351 11973 raft_consensus.cc:493] T 404190ce4ce94cecbfcb6ea9d1dd8626 P b7ab4784c7344b939bc36f639286f377 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 7ba59cc884714e8aa5f3f0ecaed84cbb)
I20260709 13:20:34.756006  6881 raft_consensus.cc:2410] T 711ef6523deb4cbe8ef2ba61e1c21c98 P cd75a17ab2604397adab03bb8b5fd75c [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate ccd8a4c3bfe3413cb2ae219b09aea832 for term 16 because replica has last-logged OpId of term: 14 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 8.
I20260709 13:20:34.756239  6772 leader_election.cc:304] T 3a485a995abc4807b6e511e45419f737 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:20:34.671461 11757 raft_consensus.cc:515] T bd6869f07b5a4885a0b99fbe60c3b175 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:34.668849 11670 raft_consensus.cc:515] T 7a734b5ab7834e05a8c422208acc58b1 P b7ab4784c7344b939bc36f639286f377 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } attrs { replace: true } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: NON_VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: true } }
I20260709 13:20:34.748603  6844 leader_election.cc:304] T 427c124d773f483294511e80fe340075 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:20:34.672490 11951 consensus_queue.cc:1048] T 2c240553ce044eedb41541d72b9475d7 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.068s
W20260709 13:20:34.743956  7468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 262214us
I20260709 13:20:34.733446 11937 raft_consensus.cc:3060] T 3fa34c08b205435dba97346991aa1f92 P cd75a17ab2604397adab03bb8b5fd75c [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:34.743798  6725 raft_consensus.cc:2468] T ce4f062dcd314d43a63ca74067cb5ee3 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in term 15.
I20260709 13:20:34.674829 11634 raft_consensus.cc:515] T 7c44c4849aa54f2b94d1f1bef9ed546f P ccd8a4c3bfe3413cb2ae219b09aea832 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:34.698421 11954 raft_consensus.cc:515] T 3d65025eea89441290d85dd053810e31 P b7ab4784c7344b939bc36f639286f377 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:34.734771 11956 raft_consensus.cc:2749] T 3411566abe2d4c9bb4b2adfdd05e6f17 P cd75a17ab2604397adab03bb8b5fd75c [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:20:34.769894  6729 raft_consensus.cc:1275] T 22ccee1b570c4ad3a57bd7aec085b1b4 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 12 FOLLOWER]: Refusing update from remote peer b7ab4784c7344b939bc36f639286f377: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:20:34.575884 11957 raft_consensus.cc:515] T 7ba5dac66ab5497e9e336f2a3c28cda5 P cd75a17ab2604397adab03bb8b5fd75c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:20:34.733693 11796 raft_consensus.cc:493] T e31b9971c15848dea59d4d4130141d9e P ccd8a4c3bfe3413cb2ae219b09aea832 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:20:34.760847  6629 catalog_manager.cc:5697] T 9e326172347f45e99a0d482b5d8ef768 P ccd8a4c3bfe3413cb2ae219b09aea832 reported cstate change: term changed from 5 to 10, leader changed from ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65) to b7ab4784c7344b939bc36f639286f377 (127.5.126.66). New cstate: current_term: 10 leader_uuid: "b7ab4784c7344b939bc36f639286f377" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } }
W20260709 13:20:34.804814  7466 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 62775.3us
I20260709 13:20:34.734673 11899 raft_consensus.cc:2749] T 7ba5dac66ab5497e9e336f2a3c28cda5 P b7ab4784c7344b939bc36f639286f377 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:20:34.734508 11668 raft_consensus.cc:2749] T 17587d6730594da4a56fa13a353232a1 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:20:34.740603 11792 raft_consensus.cc:493] T b56bf91d90824c959e21e0cee5ba1816 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:20:34.807091  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 58580.2us
W20260709 13:20:34.904300  6845 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:34.903092  6697 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 152626us
I20260709 13:20:34.750345 11666 consensus_queue.cc:1243] T 853ac0a8cbd64ce99457f170216d4d0f P b7ab4784c7344b939bc36f639286f377 [LEADER]: Peer cd75a17ab2604397adab03bb8b5fd75c log is divergent from this leader: its last log entry 9.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 13:20:34.742870 11979 raft_consensus.cc:493] T 1bf4668eeb70467fb3dc5a0289233b3c P ccd8a4c3bfe3413cb2ae219b09aea832 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
W20260709 13:20:34.823166  6847 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:34.733999 11946 raft_consensus.cc:2804] T de3186201e1a40d0b335eeb8b4e256e0 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:20:34.828536  6725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f03d0dbf16864ca4bc1bb5e4c0334c0f" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:34.838842  6723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f9c2e2bf644115957398fe4c9459db" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:34.921557  6725 raft_consensus.cc:2468] T f03d0dbf16864ca4bc1bb5e4c0334c0f P ccd8a4c3bfe3413cb2ae219b09aea832 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 13.
I20260709 13:20:34.846475  6724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5be3a11b23d4ea9b08300a2789821c7" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
W20260709 13:20:34.864327  7468 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:34.901600  6877 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53406 (request call id 2388) took 1328 ms. Trace:
I20260709 13:20:34.743700 11710 raft_consensus.cc:515] T 20f6842e26174571996b8dea4151d4be P ccd8a4c3bfe3413cb2ae219b09aea832 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
W20260709 13:20:34.900839  6695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 154466us
I20260709 13:20:34.905251  6697 leader_election.cc:304] T c4db81d9d329422bb3b4160ca4ac2d1d P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:20:34.822844 11700 raft_consensus.cc:2804] T 427c124d773f483294511e80fe340075 P cd75a17ab2604397adab03bb8b5fd75c [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:20:34.745235 11810 raft_consensus.cc:515] T 713b5728a197487c9300b310ab94e5a3 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:34.823136 11915 raft_consensus.cc:2804] T 3a485a995abc4807b6e511e45419f737 P b7ab4784c7344b939bc36f639286f377 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:20:34.919276  6729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "427c124d773f483294511e80fe340075" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 14 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:34.921617  6723 raft_consensus.cc:2468] T f3f9c2e2bf644115957398fe4c9459db P ccd8a4c3bfe3413cb2ae219b09aea832 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 13.
W20260709 13:20:34.914559 11941 consensus_meta.cc:287] T 2c240553ce044eedb41541d72b9475d7 P ccd8a4c3bfe3413cb2ae219b09aea832: Time spent flushing consensus metadata: real 0.570s	user 0.011s	sys 0.000s
I20260709 13:20:34.758322 11991 raft_consensus.cc:2804] T f5be3a11b23d4ea9b08300a2789821c7 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 13:20:35.062134 11986 log.cc:927] Time spent T a3022224cc81473690653a83d4e99470 P b7ab4784c7344b939bc36f639286f377: Append to log took a long time: real 0.243s	user 0.001s	sys 0.000s
I20260709 13:20:35.062206 11991 raft_consensus.cc:493] T f5be3a11b23d4ea9b08300a2789821c7 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:35.055748 11915 raft_consensus.cc:493] T 3a485a995abc4807b6e511e45419f737 P b7ab4784c7344b939bc36f639286f377 [term 13 FOLLOWER]: Starting leader election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:20:35.063746 11915 raft_consensus.cc:3060] T 3a485a995abc4807b6e511e45419f737 P b7ab4784c7344b939bc36f639286f377 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:35.065048 11889 leader_election.cc:290] T 9e326172347f45e99a0d482b5d8ef768 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:35.066723 11889 raft_consensus.cc:493] T 7a734b5ab7834e05a8c422208acc58b1 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:34.879004 11955 tablet_copy_client.cc:323] T 7a734b5ab7834e05a8c422208acc58b1 P 7ba59cc884714e8aa5f3f0ecaed84cbb: tablet copy: Beginning tablet copy session from remote peer at address 127.5.126.66:42817
I20260709 13:20:34.925132  6844 leader_election.cc:304] T d8cee0accdb8499c86d4414b72565a38 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, b7ab4784c7344b939bc36f639286f377
I20260709 13:20:34.956115  7503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ba5dac66ab5497e9e336f2a3c28cda5" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:20:35.068895 11567 leader_election.cc:290] T f3f9c2e2bf644115957398fe4c9459db P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:34.958879 11687 leader_election.cc:290] T dbdf895bba214ff68685a24fd17dfb5d P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:34.939503 12001 raft_consensus.cc:2804] T 853ac0a8cbd64ce99457f170216d4d0f P ccd8a4c3bfe3413cb2ae219b09aea832 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:20:35.069805 12001 raft_consensus.cc:493] T 853ac0a8cbd64ce99457f170216d4d0f P ccd8a4c3bfe3413cb2ae219b09aea832 [term 12 FOLLOWER]: Starting leader election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:20:35.069811 11944 raft_consensus.cc:2749] T d8cee0accdb8499c86d4414b72565a38 P cd75a17ab2604397adab03bb8b5fd75c [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:20:34.956640 11957 leader_election.cc:290] T 7ba5dac66ab5497e9e336f2a3c28cda5 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:20:34.854387 11911 consensus_queue.cc:237] T 4f00a2e87e56452083b759f60d461ee3 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.10, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:20:35.070243 12001 raft_consensus.cc:3060] T 853ac0a8cbd64ce99457f170216d4d0f P ccd8a4c3bfe3413cb2ae219b09aea832 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:35.070808 11567 raft_consensus.cc:2749] T c4db81d9d329422bb3b4160ca4ac2d1d P ccd8a4c3bfe3413cb2ae219b09aea832 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:20:35.056221 11700 raft_consensus.cc:493] T 427c124d773f483294511e80fe340075 P cd75a17ab2604397adab03bb8b5fd75c [term 12 FOLLOWER]: Starting leader election (detected failure of leader 7ba59cc884714e8aa5f3f0ecaed84cbb)
I20260709 13:20:35.072507 11700 raft_consensus.cc:3060] T 427c124d773f483294511e80fe340075 P cd75a17ab2604397adab03bb8b5fd75c [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:34.955214 11914 leader_election.cc:290] T 24ee15416e3145beaa1b8183453729a3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:34.965727 11670 leader_election.cc:290] T 7a734b5ab7834e05a8c422208acc58b1 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
W20260709 13:20:34.969383  6616 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet ce4f062dcd314d43a63ca74067cb5ee3 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER failed with leader 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 7ba59cc884714e8aa5f3f0ecaed84cbb is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 15 committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } attrs { replace: true } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } } }
I20260709 13:20:34.964308 11942 raft_consensus.cc:3055] T 1528ab62b6fe4e3099d08f141afee116 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:20:34.809823 11950 consensus_queue.cc:237] T f09c2a98de1a4decabd0ff900dd44caa P b7ab4784c7344b939bc36f639286f377 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:34.805809 11973 raft_consensus.cc:515] T 404190ce4ce94cecbfcb6ea9d1dd8626 P b7ab4784c7344b939bc36f639286f377 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:20:34.961951 11757 leader_election.cc:290] T bd6869f07b5a4885a0b99fbe60c3b175 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:35.050998  6629 catalog_manager.cc:5697] T 95a75bfe094d4bdc963aba3f08dfcd25 P ccd8a4c3bfe3413cb2ae219b09aea832 reported cstate change: term changed from 7 to 11. New cstate: current_term: 11 leader_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:34.951432 11683 raft_consensus.cc:515] T 3fa34c08b205435dba97346991aa1f92 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:20:35.072815 11941 raft_consensus.cc:515] T 2c240553ce044eedb41541d72b9475d7 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:34.922791  6877 rpcz_store.cc:276] 0709 13:20:33.572743 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:33.572885 (+   142us) service_pool.cc:224] Handling call
0709 13:20:33.573193 (+   308us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:33.590758 (+ 17565us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:20:33.674046 (+ 83288us) log.cc:844] Serialized 14 byte log entry
0709 13:20:34.323457 (+649411us) spinlock_profiling.cc:243] Waited 2.68 ms on lock 0x7b1800202840. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc15785de1 00007fcc157925b1 00007fcc0c89fe07 00007fcc156faab9 00007fcc0c8bc69b 00007fcc0c8ba93f 00007fcc0c8bcc02 00007fcc0f54420b 00007fcc0f549d23 00007fcc0f54a23a 00007fcc0f9b4a2a
0709 13:20:34.721250 (+397793us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:20:34.721325 (+    75us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:20:34.721390 (+    65us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:34.901278 (+179888us) spinlock_profiling.cc:243] Waited 14.5 ms on lock 0x7b5400235fd4. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f9aae01 00007fcc0f9a983e 00007fcc1496e419 00007fcc0dee5bd4 00007fcc0dee5b62 00007fcc0dee5a91 00007fcc0dee5a0c 00007fcc0dee4cc2 00007fcc0dce548c 00007fcc0dce48c6
0709 13:20:34.901358 (+    80us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:34.901536 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":53222,"prepare.queue_time_us":81211,"prepare.run_cpu_time_us":59,"prepare.run_wall_time_us":62,"raft.queue_time_us":4851,"raft.run_cpu_time_us":161,"raft.run_wall_time_us":9493,"spinlock_wait_cycles":39397888,"thread_start_us":396393,"threads_started":1}
W20260709 13:20:35.055478  6770 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 172927us
W20260709 13:20:35.059398  6697 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 154227us
I20260709 13:20:35.063036 11991 raft_consensus.cc:3060] T f5be3a11b23d4ea9b08300a2789821c7 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:20:35.069299  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 144508us
I20260709 13:20:34.922909  6725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "713b5728a197487c9300b310ab94e5a3" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:35.069243  7503 raft_consensus.cc:2468] T 7ba5dac66ab5497e9e336f2a3c28cda5 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 13.
I20260709 13:20:34.907936 11792 raft_consensus.cc:3060] T b56bf91d90824c959e21e0cee5ba1816 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:20:35.052361 11983 log.cc:927] Time spent T 3411566abe2d4c9bb4b2adfdd05e6f17 P b7ab4784c7344b939bc36f639286f377: Append to log took a long time: real 0.155s	user 0.002s	sys 0.000s
I20260709 13:20:35.098801  6725 raft_consensus.cc:2468] T 713b5728a197487c9300b310ab94e5a3 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 13.
W20260709 13:20:34.989395 11010 consensus_meta.cc:287] T 427c124d773f483294511e80fe340075 P ccd8a4c3bfe3413cb2ae219b09aea832: Time spent flushing consensus metadata: real 0.615s	user 0.006s	sys 0.007s
W20260709 13:20:35.022367  6695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 86525.9us
I20260709 13:20:34.982138 11870 leader_election.cc:290] T 44bde925b2e541b69890d70715b85176 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:34.915637 11796 raft_consensus.cc:515] T e31b9971c15848dea59d4d4130141d9e P ccd8a4c3bfe3413cb2ae219b09aea832 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:34.979976 11710 leader_election.cc:290] T 20f6842e26174571996b8dea4151d4be P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
W20260709 13:20:35.116115 11988 log.cc:927] Time spent T 07a92dd554674067a83a9cb68c4773f2 P cd75a17ab2604397adab03bb8b5fd75c: Append to log took a long time: real 0.201s	user 0.001s	sys 0.001s
I20260709 13:20:35.119908 11944 raft_consensus.cc:493] T c4db81d9d329422bb3b4160ca4ac2d1d P cd75a17ab2604397adab03bb8b5fd75c [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:20:35.099473  6844 leader_election.cc:304] T 711ef6523deb4cbe8ef2ba61e1c21c98 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: ccd8a4c3bfe3413cb2ae219b09aea832
W20260709 13:20:35.095569  6772 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 339387us
I20260709 13:20:35.100518  6846 leader_election.cc:304] T 7ba5dac66ab5497e9e336f2a3c28cda5 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:20:35.095463  6697 leader_election.cc:304] T 44bde925b2e541b69890d70715b85176 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:20:34.964232 11954 leader_election.cc:290] T 3d65025eea89441290d85dd053810e31 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:35.101147  6629 catalog_manager.cc:5697] T e77e330a82df4b43a745d57a68f6f057 P ccd8a4c3bfe3413cb2ae219b09aea832 reported cstate change: term changed from 9 to 14, leader changed from b7ab4784c7344b939bc36f639286f377 (127.5.126.66) to ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65). New cstate: current_term: 14 leader_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } health_report { overall_health: HEALTHY } } }
I20260709 13:20:35.067629 11889 raft_consensus.cc:515] T 7a734b5ab7834e05a8c422208acc58b1 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:35.107136  6695 leader_election.cc:304] T 4d9def8b32fd443aa94ab1420b06837b P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
I20260709 13:20:34.926967 11933 consensus_queue.cc:1059] T dbdf895bba214ff68685a24fd17dfb5d P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.169s
I20260709 13:20:34.927700 11979 raft_consensus.cc:515] T 1bf4668eeb70467fb3dc5a0289233b3c P ccd8a4c3bfe3413cb2ae219b09aea832 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:35.114326  6728 raft_consensus.cc:1240] T 2c240553ce044eedb41541d72b9475d7 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 16 FOLLOWER]: Rejecting Update request from peer b7ab4784c7344b939bc36f639286f377 for earlier term 15. Current term is 16. Ops: [15.9-15.9]
I20260709 13:20:35.080981 11942 raft_consensus.cc:740] T 1528ab62b6fe4e3099d08f141afee116 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 7ba59cc884714e8aa5f3f0ecaed84cbb, State: Running, Role: LEADER
I20260709 13:20:35.161688 11942 consensus_queue.cc:260] T 1528ab62b6fe4e3099d08f141afee116 P 7ba59cc884714e8aa5f3f0ecaed84cbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:20:35.162513 11979 leader_election.cc:290] T 1bf4668eeb70467fb3dc5a0289233b3c P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:35.114859  6726 raft_consensus.cc:2468] T 3fa34c08b205435dba97346991aa1f92 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in term 16.
I20260709 13:20:35.112468  6770 leader_election.cc:304] T f03d0dbf16864ca4bc1bb5e4c0334c0f P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
W20260709 13:20:35.100660  6847 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:35.084092  6616 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.5.126.68:45071, user_credentials={real_user=slave}} blocked reactor thread for 114779us
I20260709 13:20:35.123705  6844 leader_election.cc:304] T 4f00a2e87e56452083b759f60d461ee3 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, b7ab4784c7344b939bc36f639286f377
W20260709 13:20:35.164660  6770 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 54886.8us
W20260709 13:20:35.125840  7466 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 220863us
I20260709 13:20:35.126112  6772 leader_election.cc:304] T 711ef6523deb4cbe8ef2ba61e1c21c98 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:20:35.128358  6629 catalog_manager.cc:5697] T f09c2a98de1a4decabd0ff900dd44caa P ccd8a4c3bfe3413cb2ae219b09aea832 reported cstate change: term changed from 7 to 12, leader changed from ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65) to b7ab4784c7344b939bc36f639286f377 (127.5.126.66). New cstate: current_term: 12 leader_uuid: "b7ab4784c7344b939bc36f639286f377" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } }
I20260709 13:20:35.104378 11757 raft_consensus.cc:493] T e77e330a82df4b43a745d57a68f6f057 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:20:35.170616  6695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 63579.6us
I20260709 13:20:35.094877 11975 raft_consensus.cc:493] T 20f6842e26174571996b8dea4151d4be P cd75a17ab2604397adab03bb8b5fd75c [term 15 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:20:35.159293  6697 leader_election.cc:304] T 711ef6523deb4cbe8ef2ba61e1c21c98 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:20:35.178467  6732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24ee15416e3145beaa1b8183453729a3" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:35.175683 11793 raft_consensus.cc:2804] T 4d9def8b32fd443aa94ab1420b06837b P ccd8a4c3bfe3413cb2ae219b09aea832 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:20:35.175372 11757 raft_consensus.cc:515] T e77e330a82df4b43a745d57a68f6f057 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } }
W20260709 13:20:35.181324 11992 log.cc:927] Time spent T 7c37d41cd9164c15a6826ca62a851a69 P cd75a17ab2604397adab03bb8b5fd75c: Append to log took a long time: real 0.100s	user 0.000s	sys 0.000s
I20260709 13:20:35.181068  6629 catalog_manager.cc:5697] T 3411566abe2d4c9bb4b2adfdd05e6f17 P ccd8a4c3bfe3413cb2ae219b09aea832 reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "b7ab4784c7344b939bc36f639286f377" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } }
I20260709 13:20:35.124948 11781 raft_consensus.cc:2764] T 711ef6523deb4cbe8ef2ba61e1c21c98 P cd75a17ab2604397adab03bb8b5fd75c [term 16 FOLLOWER]: Leader pre-election decision vote started in defunct term 15: won
I20260709 13:20:35.185091  6732 raft_consensus.cc:2468] T 24ee15416e3145beaa1b8183453729a3 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in term 16.
I20260709 13:20:35.158546 11636 raft_consensus.cc:493] T f4b8bd455d5a47c18a1380839c6e0d61 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:35.188580  6629 catalog_manager.cc:5697] T 713b5728a197487c9300b310ab94e5a3 P ccd8a4c3bfe3413cb2ae219b09aea832 reported cstate change: term changed from 3 to 12. New cstate: current_term: 12 leader_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } health_report { overall_health: UNKNOWN } } }
W20260709 13:20:35.183354  6772 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 57359.5us
I20260709 13:20:35.114081 11504 consensus_queue.cc:1048] T 22ccee1b570c4ad3a57bd7aec085b1b4 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.069s
I20260709 13:20:35.196789  6772 leader_election.cc:304] T b56bf91d90824c959e21e0cee5ba1816 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:20:35.106284 11670 consensus_queue.cc:1059] T c4db81d9d329422bb3b4160ca4ac2d1d P b7ab4784c7344b939bc36f639286f377 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.065s
W20260709 13:20:35.176476 11983 log.cc:927] Time spent T 3411566abe2d4c9bb4b2adfdd05e6f17 P b7ab4784c7344b939bc36f639286f377: Append to log took a long time: real 0.063s	user 0.001s	sys 0.000s
I20260709 13:20:35.106647 11904 consensus_queue.cc:1048] T ce4f062dcd314d43a63ca74067cb5ee3 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.071s
I20260709 13:20:35.187418 11793 raft_consensus.cc:493] T 4d9def8b32fd443aa94ab1420b06837b P ccd8a4c3bfe3413cb2ae219b09aea832 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:35.106475 11687 consensus_queue.cc:1048] T f4b8bd455d5a47c18a1380839c6e0d61 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.066s
I20260709 13:20:35.193076 11975 raft_consensus.cc:515] T 20f6842e26174571996b8dea4151d4be P cd75a17ab2604397adab03bb8b5fd75c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:35.165926 11994 raft_consensus.cc:2804] T 44bde925b2e541b69890d70715b85176 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:20:35.201965 12002 raft_consensus.cc:493] T 8c7f33e544204fbaac4078e3e83bbf4e P ccd8a4c3bfe3413cb2ae219b09aea832 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:35.228705  6726 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49744 (request call id 526) took 1020 ms. Trace:
I20260709 13:20:35.229004 12002 raft_consensus.cc:515] T 8c7f33e544204fbaac4078e3e83bbf4e P ccd8a4c3bfe3413cb2ae219b09aea832 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:35.229182  6726 rpcz_store.cc:276] 0709 13:20:34.208533 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:34.208722 (+   189us) service_pool.cc:224] Handling call
0709 13:20:35.228541 (+1019819us) spinlock_profiling.cc:243] Waited 902 ms on lock 0x7b54003b83d4. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f9ae2fa 00007fcc1496fb17 00007fcc0deea6d4 00007fcc0deea662 00007fcc0deea591 00007fcc0deea50c 00007fcc0dee97c2 00007fcc0dce548c 00007fcc0dce48c6 00007fcc0dce426f
0709 13:20:35.228646 (+   105us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2074588416}
I20260709 13:20:35.231555 12002 leader_election.cc:290] T 8c7f33e544204fbaac4078e3e83bbf4e P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:35.231875 11576 raft_consensus.cc:2749] T 4f00a2e87e56452083b759f60d461ee3 P cd75a17ab2604397adab03bb8b5fd75c [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:20:35.204363 11636 raft_consensus.cc:515] T f4b8bd455d5a47c18a1380839c6e0d61 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:35.205844 11793 raft_consensus.cc:3060] T 4d9def8b32fd443aa94ab1420b06837b P ccd8a4c3bfe3413cb2ae219b09aea832 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:35.237979 11910 raft_consensus.cc:3055] T c4db81d9d329422bb3b4160ca4ac2d1d P b7ab4784c7344b939bc36f639286f377 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:20:35.238359 11910 raft_consensus.cc:740] T c4db81d9d329422bb3b4160ca4ac2d1d P b7ab4784c7344b939bc36f639286f377 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
I20260709 13:20:35.239326 11910 consensus_queue.cc:260] T c4db81d9d329422bb3b4160ca4ac2d1d P b7ab4784c7344b939bc36f639286f377 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
W20260709 13:20:35.240813 11995 log.cc:927] Time spent T 7c37d41cd9164c15a6826ca62a851a69 P b7ab4784c7344b939bc36f639286f377: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
W20260709 13:20:35.216282  7467 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:35.225487  6877 raft_consensus.cc:1275] T ce4f062dcd314d43a63ca74067cb5ee3 P cd75a17ab2604397adab03bb8b5fd75c [term 15 FOLLOWER]: Refusing update from remote peer b7ab4784c7344b939bc36f639286f377: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
W20260709 13:20:35.248698  7468 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:35.227242  6872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f9c2e2bf644115957398fe4c9459db" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:35.250631  6872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d65025eea89441290d85dd053810e31" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 15 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:35.251601  6872 raft_consensus.cc:2410] T 3d65025eea89441290d85dd053810e31 P cd75a17ab2604397adab03bb8b5fd75c [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7ab4784c7344b939bc36f639286f377 for term 15 because replica has last-logged OpId of term: 13 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 6.
I20260709 13:20:35.227514  6880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5be3a11b23d4ea9b08300a2789821c7" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:35.252991  6880 raft_consensus.cc:2410] T f5be3a11b23d4ea9b08300a2789821c7 P cd75a17ab2604397adab03bb8b5fd75c [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7ab4784c7344b939bc36f639286f377 for term 14 because replica has last-logged OpId of term: 12 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 7.
I20260709 13:20:35.201534  7466 leader_election.cc:304] T 24ee15416e3145beaa1b8183453729a3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
I20260709 13:20:35.237219  6879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbdf895bba214ff68685a24fd17dfb5d" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 13 candidate_status { last_received { term: 12 index: 5 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:35.227838  6875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "427c124d773f483294511e80fe340075" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 14 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:35.226961  6881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f03d0dbf16864ca4bc1bb5e4c0334c0f" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:35.255815  6881 raft_consensus.cc:2468] T f03d0dbf16864ca4bc1bb5e4c0334c0f P cd75a17ab2604397adab03bb8b5fd75c [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 13.
I20260709 13:20:35.228164  6874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "713b5728a197487c9300b310ab94e5a3" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:35.253995  6880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a734b5ab7834e05a8c422208acc58b1" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 15 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:35.258081  6880 raft_consensus.cc:2468] T 7a734b5ab7834e05a8c422208acc58b1 P cd75a17ab2604397adab03bb8b5fd75c [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 14.
W20260709 13:20:35.253954  7466 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 52540us
I20260709 13:20:35.259783  7466 leader_election.cc:304] T 3fa34c08b205435dba97346991aa1f92 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
I20260709 13:20:35.211910  6878 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53416 (request call id 3124) took 1086 ms. Trace:
I20260709 13:20:35.285982  6877 raft_consensus.cc:1275] T 34f36d59d88f40fe8a2805e604fc6c0a P cd75a17ab2604397adab03bb8b5fd75c [term 12 FOLLOWER]: Refusing update from remote peer b7ab4784c7344b939bc36f639286f377: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:20:35.286725  6772 leader_election.cc:304] T 7a734b5ab7834e05a8c422208acc58b1 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:20:35.293470  6879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44bde925b2e541b69890d70715b85176" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:35.294502  6879 raft_consensus.cc:2468] T 44bde925b2e541b69890d70715b85176 P cd75a17ab2604397adab03bb8b5fd75c [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 14.
W20260709 13:20:35.296667  6771 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.527s	user 0.000s	sys 0.016s
W20260709 13:20:35.297362  6771 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.527s	user 0.000s	sys 0.016s
I20260709 13:20:35.192512 11899 raft_consensus.cc:2749] T 711ef6523deb4cbe8ef2ba61e1c21c98 P b7ab4784c7344b939bc36f639286f377 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:20:35.120540 11944 raft_consensus.cc:515] T c4db81d9d329422bb3b4160ca4ac2d1d P cd75a17ab2604397adab03bb8b5fd75c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
W20260709 13:20:35.306977  7468 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:35.114301 11010 raft_consensus.cc:515] T 427c124d773f483294511e80fe340075 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } attrs { replace: true } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:20:35.286039  6878 rpcz_store.cc:276] 0709 13:20:34.125820 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:34.142116 (+ 16296us) service_pool.cc:224] Handling call
0709 13:20:34.142489 (+   373us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 13:20:34.316783 (+174294us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:34.316827 (+    44us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 13:20:34.317644 (+   817us) log.cc:844] Serialized 78 byte log entry
0709 13:20:34.893383 (+575739us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:20:34.912505 (+ 19122us) log.cc:844] Serialized 14 byte log entry
0709 13:20:35.082759 (+170254us) log.cc:844] Serialized 14 byte log entry
0709 13:20:35.083236 (+   477us) log.cc:844] Serialized 14 byte log entry
0709 13:20:35.083447 (+   211us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:35.083559 (+   112us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:35.211677 (+128118us) raft_consensus.cc:1685] finished
0709 13:20:35.211696 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:35.211844 (+   148us) inbound_call.cc:177] Queueing success response
0709 13:20:35.234811 (+ 22967us) spinlock_profiling.cc:243] Waited 6.81 ms on lock 0x7b180041d760. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc15785de1 00007fcc157925b1 00007fcc0c8bd522 00007fcc0c8bf7c1 00007fcc0c8bf779 00007fcc0c8bf709 00007fcc0c8bf6d1 00007fcc0c8be9cd 000000000038f354 000000000038f199 00007fcc0c8a083a
0709 13:20:35.236263 (+  1452us) spinlock_profiling.cc:243] Waited 4.66 ms on lock 0x7b180041d760. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc15785de1 00007fcc157925b1 00007fcc0c8bd522 00007fcc0c8bf7c1 00007fcc0c8bf779 00007fcc0c8bf709 00007fcc0c8bf6d1 00007fcc0c8be9cd 000000000038f354 000000000038f199 00007fcc0c8a083a
Metrics: {"mutex_wait_us":164170,"prepare.queue_time_us":615969,"prepare.run_cpu_time_us":73,"prepare.run_wall_time_us":74,"raft.queue_time_us":158279,"raft.run_cpu_time_us":550,"raft.run_wall_time_us":18598,"spinlock_wait_cycles":26377344,"thread_start_us":671303,"threads_started":2,"wal-append.queue_time_us":587859}
W20260709 13:20:35.309193  6845 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:35.211771 11994 raft_consensus.cc:493] T 44bde925b2e541b69890d70715b85176 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:35.315620  6772 leader_election.cc:304] T 44bde925b2e541b69890d70715b85176 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:20:35.213330 11504 raft_consensus.cc:2804] T b56bf91d90824c959e21e0cee5ba1816 P b7ab4784c7344b939bc36f639286f377 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:20:35.207715 11757 leader_election.cc:290] T e77e330a82df4b43a745d57a68f6f057 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:35.221367 11980 raft_consensus.cc:2804] T 7ba5dac66ab5497e9e336f2a3c28cda5 P cd75a17ab2604397adab03bb8b5fd75c [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:20:35.224622 11683 leader_election.cc:290] T 3fa34c08b205435dba97346991aa1f92 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 16 election: Requested vote from peers cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:20:35.213022 11796 leader_election.cc:290] T e31b9971c15848dea59d4d4130141d9e P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
W20260709 13:20:35.326152  6773 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:35.328428  6804 raft_consensus.cc:1240] T 1528ab62b6fe4e3099d08f141afee116 P b7ab4784c7344b939bc36f639286f377 [term 11 FOLLOWER]: Rejecting Update request from peer 7ba59cc884714e8aa5f3f0ecaed84cbb for earlier term 10. Current term is 11. Ops: []
I20260709 13:20:35.244271 11634 leader_election.cc:290] T 7c44c4849aa54f2b94d1f1bef9ed546f P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
W20260709 13:20:35.302192 11978 log.cc:927] Time spent T a3022224cc81473690653a83d4e99470 P ccd8a4c3bfe3413cb2ae219b09aea832: Append to log took a long time: real 0.096s	user 0.000s	sys 0.001s
I20260709 13:20:35.296356 11668 raft_consensus.cc:2804] T 24ee15416e3145beaa1b8183453729a3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:20:35.299165 11954 raft_consensus.cc:2804] T 7a734b5ab7834e05a8c422208acc58b1 P b7ab4784c7344b939bc36f639286f377 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:20:35.296057 11912 raft_consensus.cc:2804] T 3fa34c08b205435dba97346991aa1f92 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:20:35.297772 11946 raft_consensus.cc:697] T de3186201e1a40d0b335eeb8b4e256e0 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 16 LEADER]: Becoming Leader. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
I20260709 13:20:35.209321 11975 leader_election.cc:290] T 20f6842e26174571996b8dea4151d4be P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:20:35.341459  6803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20f6842e26174571996b8dea4151d4be" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:35.217962 11900 consensus_queue.cc:1048] T f4b8bd455d5a47c18a1380839c6e0d61 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.104s
I20260709 13:20:35.394099  6629 catalog_manager.cc:5697] T 7887766dc6784fcaa42b35c05fea7a99 P ccd8a4c3bfe3413cb2ae219b09aea832 reported cstate change: term changed from 2 to 10, leader changed from cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67) to b7ab4784c7344b939bc36f639286f377 (127.5.126.66). New cstate: current_term: 10 leader_uuid: "b7ab4784c7344b939bc36f639286f377" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } }
W20260709 13:20:35.397431  6697 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 206814us
I20260709 13:20:35.398228  6800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6869f07b5a4885a0b99fbe60c3b175" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:35.339198  6729 raft_consensus.cc:2410] T 427c124d773f483294511e80fe340075 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7ab4784c7344b939bc36f639286f377 for term 14 because replica has last-logged OpId of term: 12 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 8.
I20260709 13:20:35.401134  6800 raft_consensus.cc:2468] T bd6869f07b5a4885a0b99fbe60c3b175 P b7ab4784c7344b939bc36f639286f377 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 15.
I20260709 13:20:35.378039  6802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c44c4849aa54f2b94d1f1bef9ed546f" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:35.365443  6798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f9c2e2bf644115957398fe4c9459db" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:35.413615  6798 raft_consensus.cc:2468] T f3f9c2e2bf644115957398fe4c9459db P b7ab4784c7344b939bc36f639286f377 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 13.
I20260709 13:20:35.406724  7503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fa34c08b205435dba97346991aa1f92" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb"
I20260709 13:20:35.358510  6804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e326172347f45e99a0d482b5d8ef768" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
W20260709 13:20:35.357290  7468 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:35.343354  6872 raft_consensus.cc:3055] T e77e330a82df4b43a745d57a68f6f057 P cd75a17ab2604397adab03bb8b5fd75c [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:20:35.420226  6872 raft_consensus.cc:740] T e77e330a82df4b43a745d57a68f6f057 P cd75a17ab2604397adab03bb8b5fd75c [term 15 LEADER]: Becoming Follower/Learner. State: Replica: cd75a17ab2604397adab03bb8b5fd75c, State: Running, Role: LEADER
I20260709 13:20:35.299325 11870 consensus_queue.cc:1048] T ce4f062dcd314d43a63ca74067cb5ee3 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.040s
I20260709 13:20:35.285188 11915 raft_consensus.cc:515] T 3a485a995abc4807b6e511e45419f737 P b7ab4784c7344b939bc36f639286f377 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
W20260709 13:20:35.428750  6773 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:35.430197  6803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bf4668eeb70467fb3dc5a0289233b3c" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
W20260709 13:20:35.344332  7467 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:35.424844  6845 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:35.424638  6629 catalog_manager.cc:5697] T de3186201e1a40d0b335eeb8b4e256e0 P ccd8a4c3bfe3413cb2ae219b09aea832 reported cstate change: term changed from 7 to 11. New cstate: current_term: 11 leader_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:35.421567  6872 consensus_queue.cc:260] T e77e330a82df4b43a745d57a68f6f057 P cd75a17ab2604397adab03bb8b5fd75c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 15.8, Last appended by leader: 8, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } }
I20260709 13:20:35.241808 12006 raft_consensus.cc:2804] T f03d0dbf16864ca4bc1bb5e4c0334c0f P b7ab4784c7344b939bc36f639286f377 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:20:35.322630 11994 raft_consensus.cc:3060] T 44bde925b2e541b69890d70715b85176 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:35.435249  6872 raft_consensus.cc:3060] T e77e330a82df4b43a745d57a68f6f057 P cd75a17ab2604397adab03bb8b5fd75c [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:35.319025 11910 raft_consensus.cc:3060] T c4db81d9d329422bb3b4160ca4ac2d1d P b7ab4784c7344b939bc36f639286f377 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:35.337548 11912 raft_consensus.cc:493] T 3fa34c08b205435dba97346991aa1f92 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:35.397050 11846 raft_consensus.cc:2804] T 44bde925b2e541b69890d70715b85176 P b7ab4784c7344b939bc36f639286f377 [term 14 FOLLOWER]: Leader pre-election won for term 15
W20260709 13:20:35.437304  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 313705us
I20260709 13:20:35.428288  5625 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
W20260709 13:20:35.422557 11960 log.cc:927] Time spent T a1704639a875409b9959353527b3fd68 P cd75a17ab2604397adab03bb8b5fd75c: Append to log took a long time: real 0.088s	user 0.001s	sys 0.000s
I20260709 13:20:35.324476 11980 raft_consensus.cc:493] T 7ba5dac66ab5497e9e336f2a3c28cda5 P cd75a17ab2604397adab03bb8b5fd75c [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:35.397681 11979 raft_consensus.cc:2749] T 711ef6523deb4cbe8ef2ba61e1c21c98 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:20:35.320732 11504 raft_consensus.cc:493] T b56bf91d90824c959e21e0cee5ba1816 P b7ab4784c7344b939bc36f639286f377 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:35.334501 11668 raft_consensus.cc:493] T 24ee15416e3145beaa1b8183453729a3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:35.461380  6844 leader_election.cc:304] T de3186201e1a40d0b335eeb8b4e256e0 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:20:35.453022  5625 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:20:35.420751 11878 raft_consensus.cc:493] T b3f13b31a1f84f0d89d007eadd57924c P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:20:35.334056 11954 raft_consensus.cc:493] T 7a734b5ab7834e05a8c422208acc58b1 P b7ab4784c7344b939bc36f639286f377 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:35.439522 12006 raft_consensus.cc:493] T f03d0dbf16864ca4bc1bb5e4c0334c0f P b7ab4784c7344b939bc36f639286f377 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:35.483023  7495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "427c124d773f483294511e80fe340075" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 14 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:20:35.481348  6629 catalog_manager.cc:5697] T 34f36d59d88f40fe8a2805e604fc6c0a P ccd8a4c3bfe3413cb2ae219b09aea832 reported cstate change: term changed from 3 to 7, leader changed from ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65) to b7ab4784c7344b939bc36f639286f377 (127.5.126.66). New cstate: current_term: 7 leader_uuid: "b7ab4784c7344b939bc36f639286f377" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } }
I20260709 13:20:35.483042  6770 leader_election.cc:304] T f3f9c2e2bf644115957398fe4c9459db P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: cd75a17ab2604397adab03bb8b5fd75c
W20260709 13:20:35.472535  6846 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.68:45071, user_credentials={real_user=slave}} blocked reactor thread for 372059us
W20260709 13:20:35.491410  6846 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:35.492761 12009 log.cc:927] Time spent T 3411566abe2d4c9bb4b2adfdd05e6f17 P ccd8a4c3bfe3413cb2ae219b09aea832: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 13:20:35.493325  6697 leader_election.cc:304] T 404190ce4ce94cecbfcb6ea9d1dd8626 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, b7ab4784c7344b939bc36f639286f377
I20260709 13:20:35.494652  6697 leader_election.cc:304] T b3f13b31a1f84f0d89d007eadd57924c P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, b7ab4784c7344b939bc36f639286f377
I20260709 13:20:35.494807 11792 raft_consensus.cc:515] T b56bf91d90824c959e21e0cee5ba1816 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:35.491899  6817 tablet_copy_service.cc:140] P b7ab4784c7344b939bc36f639286f377: Received BeginTabletCopySession request for tablet 7a734b5ab7834e05a8c422208acc58b1 from peer 7ba59cc884714e8aa5f3f0ecaed84cbb ({username='slave'} at 127.0.0.1:50550)
I20260709 13:20:35.495358 12013 raft_consensus.cc:493] T ab432e62819d499eaaf3dd55481dd930 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:35.495783  6817 tablet_copy_service.cc:161] P b7ab4784c7344b939bc36f639286f377: Beginning new tablet copy session on tablet 7a734b5ab7834e05a8c422208acc58b1 from peer 7ba59cc884714e8aa5f3f0ecaed84cbb at {username='slave'} at 127.0.0.1:50550: session id = 7ba59cc884714e8aa5f3f0ecaed84cbb-7a734b5ab7834e05a8c422208acc58b1
I20260709 13:20:35.496068  6731 raft_consensus.cc:2393] T b56bf91d90824c959e21e0cee5ba1816 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7ab4784c7344b939bc36f639286f377 in current term 14: Already voted for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in this term.
I20260709 13:20:35.497736  6727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbdf895bba214ff68685a24fd17dfb5d" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 13 candidate_status { last_received { term: 12 index: 5 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:35.493430 12002 raft_consensus.cc:493] T 90d42e216d9741e190bca19a781291fd P ccd8a4c3bfe3413cb2ae219b09aea832 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:20:35.499943  7500 raft_consensus.cc:1275] T ce4f062dcd314d43a63ca74067cb5ee3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 15 FOLLOWER]: Refusing update from remote peer b7ab4784c7344b939bc36f639286f377: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 15 index: 10. (term mismatch)
I20260709 13:20:35.505044  7500 pending_rounds.cc:85] T ce4f062dcd314d43a63ca74067cb5ee3 P 7ba59cc884714e8aa5f3f0ecaed84cbb: Aborting all ops after (but not including) 9
I20260709 13:20:35.505336  7500 pending_rounds.cc:107] T ce4f062dcd314d43a63ca74067cb5ee3 P 7ba59cc884714e8aa5f3f0ecaed84cbb: Aborting uncommitted NO_OP operation due to leader change: 14.10
I20260709 13:20:35.505568  7500 raft_consensus.cc:2889] T ce4f062dcd314d43a63ca74067cb5ee3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:20:35.437288 11810 leader_election.cc:290] T 713b5728a197487c9300b310ab94e5a3 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:35.454677 11912 raft_consensus.cc:3060] T 3fa34c08b205435dba97346991aa1f92 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:35.502192  6728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a734b5ab7834e05a8c422208acc58b1" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 15 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:35.502378  6726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44bde925b2e541b69890d70715b85176" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:35.503424  6727 raft_consensus.cc:2393] T dbdf895bba214ff68685a24fd17dfb5d P ccd8a4c3bfe3413cb2ae219b09aea832 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7ab4784c7344b939bc36f639286f377 in current term 13: Already voted for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in this term.
I20260709 13:20:35.451015 11846 raft_consensus.cc:493] T 44bde925b2e541b69890d70715b85176 P b7ab4784c7344b939bc36f639286f377 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:35.506858  6728 raft_consensus.cc:2468] T 7a734b5ab7834e05a8c422208acc58b1 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 14.
I20260709 13:20:35.465101 11504 raft_consensus.cc:3060] T b56bf91d90824c959e21e0cee5ba1816 P b7ab4784c7344b939bc36f639286f377 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:35.471130 11668 raft_consensus.cc:3060] T 24ee15416e3145beaa1b8183453729a3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:20:35.470503 11980 raft_consensus.cc:3060] T 7ba5dac66ab5497e9e336f2a3c28cda5 P cd75a17ab2604397adab03bb8b5fd75c [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:35.473951 11837 raft_consensus.cc:493] T 427c124d773f483294511e80fe340075 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:35.520462  6872 raft_consensus.cc:1275] T e77e330a82df4b43a745d57a68f6f057 P cd75a17ab2604397adab03bb8b5fd75c [term 16 FOLLOWER]: Refusing update from remote peer b7ab4784c7344b939bc36f639286f377: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 13:20:35.521703  6872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e326172347f45e99a0d482b5d8ef768" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:35.507020  6629 catalog_manager.cc:5697] T 711ef6523deb4cbe8ef2ba61e1c21c98 P ccd8a4c3bfe3413cb2ae219b09aea832 reported cstate change: term changed from 4 to 11, leader changed from cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67) to ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65). New cstate: current_term: 11 leader_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:35.523422  6804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e31b9971c15848dea59d4d4130141d9e" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:35.523936  6803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77e330a82df4b43a745d57a68f6f057" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 17 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:35.525640  6798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c7f33e544204fbaac4078e3e83bbf4e" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:35.475680 12010 raft_consensus.cc:493] T 7887766dc6784fcaa42b35c05fea7a99 P b7ab4784c7344b939bc36f639286f377 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:35.526697  6798 raft_consensus.cc:2468] T 8c7f33e544204fbaac4078e3e83bbf4e P b7ab4784c7344b939bc36f639286f377 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 12.
I20260709 13:20:35.525719  6730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d65025eea89441290d85dd053810e31" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 15 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:35.549263  6730 raft_consensus.cc:2410] T 3d65025eea89441290d85dd053810e31 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7ab4784c7344b939bc36f639286f377 for term 15 because replica has last-logged OpId of term: 13 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 6.
I20260709 13:20:35.531039  6802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a734b5ab7834e05a8c422208acc58b1" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 15 candidate_status { last_received { term: 13 index: 5 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:35.488940 11796 raft_consensus.cc:493] T 34f36d59d88f40fe8a2805e604fc6c0a P ccd8a4c3bfe3413cb2ae219b09aea832 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:35.530591  6803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c240553ce044eedb41541d72b9475d7" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:20:35.526826  6770 leader_election.cc:304] T 713b5728a197487c9300b310ab94e5a3 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
I20260709 13:20:35.529954  6804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "713b5728a197487c9300b310ab94e5a3" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:35.527877 11911 raft_consensus.cc:2804] T f3f9c2e2bf644115957398fe4c9459db P b7ab4784c7344b939bc36f639286f377 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:20:35.526861 11973 leader_election.cc:290] T 404190ce4ce94cecbfcb6ea9d1dd8626 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:20:35.527990 11971 raft_consensus.cc:493] T ab432e62819d499eaaf3dd55481dd930 P b7ab4784c7344b939bc36f639286f377 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:35.526539 11979 raft_consensus.cc:2749] T 404190ce4ce94cecbfcb6ea9d1dd8626 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:20:35.592825  6697 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.68:45071, user_credentials={real_user=slave}} blocked reactor thread for 98257.1us
I20260709 13:20:35.481772 11954 raft_consensus.cc:3060] T 7a734b5ab7834e05a8c422208acc58b1 P b7ab4784c7344b939bc36f639286f377 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:20:35.656993  6770 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 130266us
I20260709 13:20:35.579254 11946 consensus_queue.cc:237] T de3186201e1a40d0b335eeb8b4e256e0 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
W20260709 13:20:35.513780 12003 log.cc:927] Time spent T a3022224cc81473690653a83d4e99470 P cd75a17ab2604397adab03bb8b5fd75c: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 13:20:35.510375 11941 leader_election.cc:290] T 2c240553ce044eedb41541d72b9475d7 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 16 election: Requested vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:35.515000 11846 raft_consensus.cc:3060] T 44bde925b2e541b69890d70715b85176 P b7ab4784c7344b939bc36f639286f377 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:35.506960 12006 raft_consensus.cc:3060] T f03d0dbf16864ca4bc1bb5e4c0334c0f P b7ab4784c7344b939bc36f639286f377 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:35.675987  6629 catalog_manager.cc:5697] T 90d42e216d9741e190bca19a781291fd P ccd8a4c3bfe3413cb2ae219b09aea832 reported cstate change: term changed from 4 to 10. New cstate: current_term: 10 leader_uuid: "b7ab4784c7344b939bc36f639286f377" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } }
I20260709 13:20:35.677868  6872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bf4668eeb70467fb3dc5a0289233b3c" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:35.752676  6730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "404190ce4ce94cecbfcb6ea9d1dd8626" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:35.753111  6872 raft_consensus.cc:2468] T 1bf4668eeb70467fb3dc5a0289233b3c P cd75a17ab2604397adab03bb8b5fd75c [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 13.
W20260709 13:20:35.681001  7467 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:35.684976  6880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fa34c08b205435dba97346991aa1f92" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:20:35.691911  6877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20f6842e26174571996b8dea4151d4be" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:35.755354  6877 raft_consensus.cc:2468] T 20f6842e26174571996b8dea4151d4be P cd75a17ab2604397adab03bb8b5fd75c [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 15.
I20260709 13:20:35.683579 11942 raft_consensus.cc:3060] T 1528ab62b6fe4e3099d08f141afee116 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:20:35.666772 11889 leader_election.cc:290] T 7a734b5ab7834e05a8c422208acc58b1 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
W20260709 13:20:35.667349 11960 log.cc:927] Time spent T a1704639a875409b9959353527b3fd68 P cd75a17ab2604397adab03bb8b5fd75c: Append to log took a long time: real 0.153s	user 0.001s	sys 0.000s
W20260709 13:20:35.666610 11981 log.cc:927] Time spent T 90d42e216d9741e190bca19a781291fd P cd75a17ab2604397adab03bb8b5fd75c: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
W20260709 13:20:35.800825 12012 log.cc:927] Time spent T bb3d8792045a4583ae2e965b1350a5b4 P 7ba59cc884714e8aa5f3f0ecaed84cbb: Append to log took a long time: real 0.085s	user 0.000s	sys 0.001s
I20260709 13:20:35.593884 11683 raft_consensus.cc:493] T 9b3759de40694069b13c0f8bd40e5709 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:20:35.801604 11683 raft_consensus.cc:515] T 9b3759de40694069b13c0f8bd40e5709 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:35.657330 11757 raft_consensus.cc:2749] T b3f13b31a1f84f0d89d007eadd57924c P ccd8a4c3bfe3413cb2ae219b09aea832 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:20:35.658634 11990 raft_consensus.cc:493] T 7887766dc6784fcaa42b35c05fea7a99 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:35.495947 12013 raft_consensus.cc:515] T ab432e62819d499eaaf3dd55481dd930 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:35.481678 11878 raft_consensus.cc:515] T b3f13b31a1f84f0d89d007eadd57924c P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:20:35.759191  6881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22ccee1b570c4ad3a57bd7aec085b1b4" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:35.706362 11870 raft_consensus.cc:2804] T 713b5728a197487c9300b310ab94e5a3 P b7ab4784c7344b939bc36f639286f377 [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 13:20:35.718065  6772 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.68:45071, user_credentials={real_user=slave}} blocked reactor thread for 43991.6us
I20260709 13:20:35.514626 12002 raft_consensus.cc:515] T 90d42e216d9741e190bca19a781291fd P ccd8a4c3bfe3413cb2ae219b09aea832 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:35.716814 11911 raft_consensus.cc:493] T f3f9c2e2bf644115957398fe4c9459db P b7ab4784c7344b939bc36f639286f377 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:20:35.742564 11937 consensus_meta.cc:287] T 3fa34c08b205435dba97346991aa1f92 P cd75a17ab2604397adab03bb8b5fd75c: Time spent flushing consensus metadata: real 0.889s	user 0.012s	sys 0.001s
I20260709 13:20:35.785362 11010 leader_election.cc:290] T 427c124d773f483294511e80fe340075 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 13 election: Requested vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
W20260709 13:20:35.788864 12016 log.cc:927] Time spent T 4f00a2e87e56452083b759f60d461ee3 P b7ab4784c7344b939bc36f639286f377: Append to log took a long time: real 0.121s	user 0.000s	sys 0.000s
W20260709 13:20:35.790670  6770 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 53760.3us
W20260709 13:20:35.800207  7468 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:35.803759 11792 leader_election.cc:290] T b56bf91d90824c959e21e0cee5ba1816 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 14 election: Requested vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
W20260709 13:20:35.833210  6773 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:35.811949 11700 consensus_meta.cc:287] T 427c124d773f483294511e80fe340075 P cd75a17ab2604397adab03bb8b5fd75c: Time spent flushing consensus metadata: real 0.739s	user 0.007s	sys 0.006s
I20260709 13:20:35.554755 11837 raft_consensus.cc:515] T 427c124d773f483294511e80fe340075 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } attrs { replace: true } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:20:35.667210 11796 raft_consensus.cc:515] T 34f36d59d88f40fe8a2805e604fc6c0a P ccd8a4c3bfe3413cb2ae219b09aea832 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:35.803929 11683 leader_election.cc:290] T 9b3759de40694069b13c0f8bd40e5709 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:35.807334 11636 leader_election.cc:290] T f4b8bd455d5a47c18a1380839c6e0d61 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:35.746019 11656 consensus_queue.cc:1048] T ce4f062dcd314d43a63ca74067cb5ee3 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.101s
I20260709 13:20:35.592645 12010 raft_consensus.cc:515] T 7887766dc6784fcaa42b35c05fea7a99 P b7ab4784c7344b939bc36f639286f377 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:35.831636 11870 raft_consensus.cc:493] T 713b5728a197487c9300b310ab94e5a3 P b7ab4784c7344b939bc36f639286f377 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:35.804515 11803 raft_consensus.cc:3060] T 4d9def8b32fd443aa94ab1420b06837b P cd75a17ab2604397adab03bb8b5fd75c [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:35.843938 11911 raft_consensus.cc:3060] T f3f9c2e2bf644115957398fe4c9459db P b7ab4784c7344b939bc36f639286f377 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:35.851811 11744 raft_consensus.cc:493] T a3022224cc81473690653a83d4e99470 P b7ab4784c7344b939bc36f639286f377 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:20:35.866353 11944 leader_election.cc:290] T c4db81d9d329422bb3b4160ca4ac2d1d P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:20:35.846889 11973 consensus_queue.cc:1048] T 34f36d59d88f40fe8a2805e604fc6c0a P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.036s
I20260709 13:20:35.854025 11725 consensus_queue.cc:1048] T e77e330a82df4b43a745d57a68f6f057 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.030s
W20260709 13:20:35.898088 11959 consensus_meta.cc:287] T 713b5728a197487c9300b310ab94e5a3 P cd75a17ab2604397adab03bb8b5fd75c: Time spent flushing consensus metadata: real 1.186s	user 0.010s	sys 0.002s
I20260709 13:20:35.898643 11959 raft_consensus.cc:515] T 713b5728a197487c9300b310ab94e5a3 P cd75a17ab2604397adab03bb8b5fd75c [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
W20260709 13:20:35.901521 11947 consensus_meta.cc:287] T bb3d8792045a4583ae2e965b1350a5b4 P ccd8a4c3bfe3413cb2ae219b09aea832: Time spent flushing consensus metadata: real 1.149s	user 0.015s	sys 0.003s
I20260709 13:20:35.902019 11947 raft_consensus.cc:515] T bb3d8792045a4583ae2e965b1350a5b4 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:20:35.905164 11878 leader_election.cc:290] T b3f13b31a1f84f0d89d007eadd57924c P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:20:35.904421 12013 leader_election.cc:290] T ab432e62819d499eaaf3dd55481dd930 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:35.906140 12006 raft_consensus.cc:515] T f03d0dbf16864ca4bc1bb5e4c0334c0f P b7ab4784c7344b939bc36f639286f377 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:35.909498 12010 leader_election.cc:290] T 7887766dc6784fcaa42b35c05fea7a99 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:35.910123 11846 raft_consensus.cc:515] T 44bde925b2e541b69890d70715b85176 P b7ab4784c7344b939bc36f639286f377 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:35.872740 11700 raft_consensus.cc:515] T 427c124d773f483294511e80fe340075 P cd75a17ab2604397adab03bb8b5fd75c [term 13 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } attrs { replace: true } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:20:35.890931 11744 raft_consensus.cc:515] T a3022224cc81473690653a83d4e99470 P b7ab4784c7344b939bc36f639286f377 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:35.885738 11915 leader_election.cc:290] T 3a485a995abc4807b6e511e45419f737 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 14 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:35.852720 11937 raft_consensus.cc:515] T 3fa34c08b205435dba97346991aa1f92 P cd75a17ab2604397adab03bb8b5fd75c [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:20:35.914913 11744 leader_election.cc:290] T a3022224cc81473690653a83d4e99470 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:35.857148 11752 consensus_queue.cc:1059] T 2c240553ce044eedb41541d72b9475d7 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: INVALID_TERM, Last received: 14.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.030s
I20260709 13:20:35.915323 11700 leader_election.cc:290] T 427c124d773f483294511e80fe340075 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 13 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:20:35.915915 11752 raft_consensus.cc:3055] T 2c240553ce044eedb41541d72b9475d7 P b7ab4784c7344b939bc36f639286f377 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:20:35.916373 11752 raft_consensus.cc:740] T 2c240553ce044eedb41541d72b9475d7 P b7ab4784c7344b939bc36f639286f377 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
I20260709 13:20:35.916682 11937 leader_election.cc:290] T 3fa34c08b205435dba97346991aa1f92 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 17 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:20:35.917101 12002 leader_election.cc:290] T 90d42e216d9741e190bca19a781291fd P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:35.885162 11870 raft_consensus.cc:3060] T 713b5728a197487c9300b310ab94e5a3 P b7ab4784c7344b939bc36f639286f377 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:35.917344 11752 consensus_queue.cc:260] T 2c240553ce044eedb41541d72b9475d7 P b7ab4784c7344b939bc36f639286f377 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:35.918599 11752 raft_consensus.cc:3060] T 2c240553ce044eedb41541d72b9475d7 P b7ab4784c7344b939bc36f639286f377 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:35.831660 11990 raft_consensus.cc:515] T 7887766dc6784fcaa42b35c05fea7a99 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:35.896601 11796 leader_election.cc:290] T 34f36d59d88f40fe8a2805e604fc6c0a P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
W20260709 13:20:35.896718 11793 consensus_meta.cc:287] T 4d9def8b32fd443aa94ab1420b06837b P ccd8a4c3bfe3413cb2ae219b09aea832: Time spent flushing consensus metadata: real 0.659s	user 0.022s	sys 0.000s
I20260709 13:20:35.741922 11971 raft_consensus.cc:515] T ab432e62819d499eaaf3dd55481dd930 P b7ab4784c7344b939bc36f639286f377 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:35.920607 11793 raft_consensus.cc:515] T 4d9def8b32fd443aa94ab1420b06837b P ccd8a4c3bfe3413cb2ae219b09aea832 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:35.921223 11990 leader_election.cc:290] T 7887766dc6784fcaa42b35c05fea7a99 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:35.922252 11971 leader_election.cc:290] T ab432e62819d499eaaf3dd55481dd930 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:35.922571 11793 leader_election.cc:290] T 4d9def8b32fd443aa94ab1420b06837b P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 15 election: Requested vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
W20260709 13:20:35.912942 11991 consensus_meta.cc:287] T f5be3a11b23d4ea9b08300a2789821c7 P ccd8a4c3bfe3413cb2ae219b09aea832: Time spent flushing consensus metadata: real 0.801s	user 0.013s	sys 0.003s
I20260709 13:20:35.922647 11912 raft_consensus.cc:515] T 3fa34c08b205435dba97346991aa1f92 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
W20260709 13:20:35.930667 12001 consensus_meta.cc:287] T 853ac0a8cbd64ce99457f170216d4d0f P ccd8a4c3bfe3413cb2ae219b09aea832: Time spent flushing consensus metadata: real 0.859s	user 0.006s	sys 0.011s
I20260709 13:20:35.926479 11994 raft_consensus.cc:515] T 44bde925b2e541b69890d70715b85176 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:35.923460 11991 raft_consensus.cc:515] T f5be3a11b23d4ea9b08300a2789821c7 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:35.935016 12006 leader_election.cc:290] T f03d0dbf16864ca4bc1bb5e4c0334c0f P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 14 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:35.934509 12001 raft_consensus.cc:515] T 853ac0a8cbd64ce99457f170216d4d0f P ccd8a4c3bfe3413cb2ae219b09aea832 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:35.939487 12001 leader_election.cc:290] T 853ac0a8cbd64ce99457f170216d4d0f P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 13 election: Requested vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:35.941769 11991 leader_election.cc:290] T f5be3a11b23d4ea9b08300a2789821c7 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 14 election: Requested vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:35.752683  6629 catalog_manager.cc:5697] T 2c240553ce044eedb41541d72b9475d7 P ccd8a4c3bfe3413cb2ae219b09aea832 reported cstate change: term changed from 8 to 12. New cstate: current_term: 12 leader_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } health_report { overall_health: UNKNOWN } } }
W20260709 13:20:35.982111  6695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 459911us
I20260709 13:20:35.986271  6723 raft_consensus.cc:1240] T bb3d8792045a4583ae2e965b1350a5b4 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 13 FOLLOWER]: Rejecting Update request from peer 7ba59cc884714e8aa5f3f0ecaed84cbb for earlier term 12. Current term is 13. Ops: []
I20260709 13:20:35.986277  6725 raft_consensus.cc:1240] T 853ac0a8cbd64ce99457f170216d4d0f P ccd8a4c3bfe3413cb2ae219b09aea832 [term 13 FOLLOWER]: Rejecting Update request from peer b7ab4784c7344b939bc36f639286f377 for earlier term 12. Current term is 13. Ops: []
I20260709 13:20:35.987686  6726 raft_consensus.cc:2393] T 44bde925b2e541b69890d70715b85176 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7ab4784c7344b939bc36f639286f377 in current term 15: Already voted for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in this term.
I20260709 13:20:35.990792  6695 leader_election.cc:304] T bd6869f07b5a4885a0b99fbe60c3b175 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
I20260709 13:20:35.987740  6724 raft_consensus.cc:2393] T f5be3a11b23d4ea9b08300a2789821c7 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7ab4784c7344b939bc36f639286f377 in current term 14: Already voted for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in this term.
I20260709 13:20:35.987947  6728 raft_consensus.cc:1275] T 34f36d59d88f40fe8a2805e604fc6c0a P ccd8a4c3bfe3413cb2ae219b09aea832 [term 12 FOLLOWER]: Refusing update from remote peer b7ab4784c7344b939bc36f639286f377: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:20:35.993530  6695 leader_election.cc:304] T f3f9c2e2bf644115957398fe4c9459db P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
I20260709 13:20:35.995395  6695 leader_election.cc:304] T 9e326172347f45e99a0d482b5d8ef768 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:20:36.000481  6695 leader_election.cc:304] T 8c7f33e544204fbaac4078e3e83bbf4e P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
I20260709 13:20:36.006811  6803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4b8bd455d5a47c18a1380839c6e0d61" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 15 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:35.984995  6629 catalog_manager.cc:5697] T f58dc08b12a2494bb9a1372837970ca2 P ccd8a4c3bfe3413cb2ae219b09aea832 reported cstate change: term changed from 5 to 13, leader changed from b7ab4784c7344b939bc36f639286f377 (127.5.126.66) to ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65). New cstate: current_term: 13 leader_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } health_report { overall_health: UNKNOWN } } }
W20260709 13:20:36.012502  6773 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:36.014310  6803 raft_consensus.cc:1275] T 30e88460611e47b2ba16a46a30b5f416 P b7ab4784c7344b939bc36f639286f377 [term 13 FOLLOWER]: Refusing update from remote peer ccd8a4c3bfe3413cb2ae219b09aea832: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 13:20:36.017573  6803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "427c124d773f483294511e80fe340075" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:20:36.018816  6803 raft_consensus.cc:2393] T 427c124d773f483294511e80fe340075 P b7ab4784c7344b939bc36f639286f377 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate ccd8a4c3bfe3413cb2ae219b09aea832 in current term 13: Already voted for candidate b7ab4784c7344b939bc36f639286f377 in this term.
I20260709 13:20:36.022532  6803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b56bf91d90824c959e21e0cee5ba1816" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:20:36.019094  6629 catalog_manager.cc:5697] T f5be3a11b23d4ea9b08300a2789821c7 P ccd8a4c3bfe3413cb2ae219b09aea832 reported cstate change: term changed from 5 to 8, leader changed from b7ab4784c7344b939bc36f639286f377 (127.5.126.66) to ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65). New cstate: current_term: 8 leader_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:36.025684  6798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b3759de40694069b13c0f8bd40e5709" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:35.861976  6872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77e330a82df4b43a745d57a68f6f057" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 17 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:36.028993  6800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34f36d59d88f40fe8a2805e604fc6c0a" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:36.029438  6872 raft_consensus.cc:2410] T e77e330a82df4b43a745d57a68f6f057 P cd75a17ab2604397adab03bb8b5fd75c [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ccd8a4c3bfe3413cb2ae219b09aea832 for term 17 because replica has last-logged OpId of term: 15 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 7.
I20260709 13:20:36.031903  6872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c7f33e544204fbaac4078e3e83bbf4e" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:36.033092  6872 raft_consensus.cc:2468] T 8c7f33e544204fbaac4078e3e83bbf4e P cd75a17ab2604397adab03bb8b5fd75c [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 11.
I20260709 13:20:36.033257  6800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab432e62819d499eaaf3dd55481dd930" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 17 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:36.034842  6800 raft_consensus.cc:2410] T ab432e62819d499eaaf3dd55481dd930 P b7ab4784c7344b939bc36f639286f377 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ccd8a4c3bfe3413cb2ae219b09aea832 for term 17 because replica has last-logged OpId of term: 15 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 7.
I20260709 13:20:36.034749  6872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c44c4849aa54f2b94d1f1bef9ed546f" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:36.035709  6872 raft_consensus.cc:2468] T 7c44c4849aa54f2b94d1f1bef9ed546f P cd75a17ab2604397adab03bb8b5fd75c [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 15.
I20260709 13:20:36.037402  6872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e31b9971c15848dea59d4d4130141d9e" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:35.869935  6873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6869f07b5a4885a0b99fbe60c3b175" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:36.043514  6873 raft_consensus.cc:2468] T bd6869f07b5a4885a0b99fbe60c3b175 P cd75a17ab2604397adab03bb8b5fd75c [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 14.
I20260709 13:20:36.044893  6799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "853ac0a8cbd64ce99457f170216d4d0f" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:20:36.045372  6873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f58dc08b12a2494bb9a1372837970ca2" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:36.047299  6873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d9def8b32fd443aa94ab1420b06837b" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:36.038353  6800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90d42e216d9741e190bca19a781291fd" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:36.038643  6874 raft_consensus.cc:2468] T 713b5728a197487c9300b310ab94e5a3 P cd75a17ab2604397adab03bb8b5fd75c [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 13.
I20260709 13:20:36.040200  6875 raft_consensus.cc:2410] T 427c124d773f483294511e80fe340075 P cd75a17ab2604397adab03bb8b5fd75c [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7ab4784c7344b939bc36f639286f377 for term 14 because replica has last-logged OpId of term: 12 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 8.
I20260709 13:20:36.040695  6798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7887766dc6784fcaa42b35c05fea7a99" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:36.048978  6799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5be3a11b23d4ea9b08300a2789821c7" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:20:36.049662  6798 raft_consensus.cc:2468] T 7887766dc6784fcaa42b35c05fea7a99 P b7ab4784c7344b939bc36f639286f377 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 15.
I20260709 13:20:36.050035  6799 raft_consensus.cc:3060] T f5be3a11b23d4ea9b08300a2789821c7 P b7ab4784c7344b939bc36f639286f377 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:36.041297  6880 raft_consensus.cc:2368] T 3fa34c08b205435dba97346991aa1f92 P cd75a17ab2604397adab03bb8b5fd75c [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 16. Current term is 17.
I20260709 13:20:36.045516  6801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d9def8b32fd443aa94ab1420b06837b" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:20:36.051999  6801 raft_consensus.cc:3060] T 4d9def8b32fd443aa94ab1420b06837b P b7ab4784c7344b939bc36f639286f377 [term 13 FOLLOWER]: Advancing to term 15
I20260709 13:20:36.056548  6798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "427c124d773f483294511e80fe340075" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:36.056190  6800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3f13b31a1f84f0d89d007eadd57924c" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:36.057439  6798 raft_consensus.cc:2468] T 427c124d773f483294511e80fe340075 P b7ab4784c7344b939bc36f639286f377 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in term 13.
I20260709 13:20:36.060494  6872 raft_consensus.cc:2468] T e31b9971c15848dea59d4d4130141d9e P cd75a17ab2604397adab03bb8b5fd75c [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 11.
I20260709 13:20:36.062058  6872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f9c2e2bf644115957398fe4c9459db" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
W20260709 13:20:36.063622  6773 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:35.881559  7495 raft_consensus.cc:2410] T 427c124d773f483294511e80fe340075 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7ab4784c7344b939bc36f639286f377 for term 14 because replica has last-logged OpId of term: 12 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 8.
I20260709 13:20:36.065589  7503 raft_consensus.cc:2368] T 3fa34c08b205435dba97346991aa1f92 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 16. Current term is 17.
W20260709 13:20:36.067924 11504 consensus_meta.cc:287] T b56bf91d90824c959e21e0cee5ba1816 P b7ab4784c7344b939bc36f639286f377: Time spent flushing consensus metadata: real 0.520s	user 0.008s	sys 0.003s
I20260709 13:20:36.080838 11710 raft_consensus.cc:2804] T bd6869f07b5a4885a0b99fbe60c3b175 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:20:36.082532 11710 raft_consensus.cc:493] T bd6869f07b5a4885a0b99fbe60c3b175 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:36.083077 11710 raft_consensus.cc:3060] T bd6869f07b5a4885a0b99fbe60c3b175 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:36.068707 11504 raft_consensus.cc:515] T b56bf91d90824c959e21e0cee5ba1816 P b7ab4784c7344b939bc36f639286f377 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:36.087265 11504 leader_election.cc:290] T b56bf91d90824c959e21e0cee5ba1816 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 14 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
W20260709 13:20:36.089833  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 628423us
I20260709 13:20:36.090879  6803 raft_consensus.cc:2393] T b56bf91d90824c959e21e0cee5ba1816 P b7ab4784c7344b939bc36f639286f377 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate ccd8a4c3bfe3413cb2ae219b09aea832 in current term 14: Already voted for candidate b7ab4784c7344b939bc36f639286f377 in this term.
W20260709 13:20:36.093510  6845 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:36.094826  6845 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:36.095451  6845 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:36.109817 11796 raft_consensus.cc:2749] T 9e326172347f45e99a0d482b5d8ef768 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:20:36.111287 11796 raft_consensus.cc:2804] T 8c7f33e544204fbaac4078e3e83bbf4e P ccd8a4c3bfe3413cb2ae219b09aea832 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:20:36.113538 11912 leader_election.cc:290] T 3fa34c08b205435dba97346991aa1f92 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 17 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:36.115263 11946 raft_consensus.cc:493] T f09c2a98de1a4decabd0ff900dd44caa P ccd8a4c3bfe3413cb2ae219b09aea832 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:36.096441 11781 raft_consensus.cc:493] T ce4f062dcd314d43a63ca74067cb5ee3 P cd75a17ab2604397adab03bb8b5fd75c [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:36.109840 11846 leader_election.cc:290] T 44bde925b2e541b69890d70715b85176 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 15 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:36.119747 11793 raft_consensus.cc:2804] T f3f9c2e2bf644115957398fe4c9459db P ccd8a4c3bfe3413cb2ae219b09aea832 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:20:36.111865 11796 raft_consensus.cc:493] T 8c7f33e544204fbaac4078e3e83bbf4e P ccd8a4c3bfe3413cb2ae219b09aea832 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:36.124807  6801 raft_consensus.cc:2468] T 4d9def8b32fd443aa94ab1420b06837b P b7ab4784c7344b939bc36f639286f377 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 15.
I20260709 13:20:36.125021  6799 raft_consensus.cc:2468] T f5be3a11b23d4ea9b08300a2789821c7 P b7ab4784c7344b939bc36f639286f377 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 14.
I20260709 13:20:36.120509 11793 raft_consensus.cc:493] T f3f9c2e2bf644115957398fe4c9459db P ccd8a4c3bfe3413cb2ae219b09aea832 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:36.136703 12002 consensus_queue.cc:1048] T 30e88460611e47b2ba16a46a30b5f416 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
W20260709 13:20:36.141840 11980 consensus_meta.cc:287] T 7ba5dac66ab5497e9e336f2a3c28cda5 P cd75a17ab2604397adab03bb8b5fd75c: Time spent flushing consensus metadata: real 0.560s	user 0.009s	sys 0.003s
I20260709 13:20:36.142735  6873 raft_consensus.cc:2468] T 4d9def8b32fd443aa94ab1420b06837b P cd75a17ab2604397adab03bb8b5fd75c [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 14.
I20260709 13:20:36.142546 11980 raft_consensus.cc:515] T 7ba5dac66ab5497e9e336f2a3c28cda5 P cd75a17ab2604397adab03bb8b5fd75c [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:20:36.120648 11796 raft_consensus.cc:3060] T 8c7f33e544204fbaac4078e3e83bbf4e P ccd8a4c3bfe3413cb2ae219b09aea832 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:36.120946 11781 raft_consensus.cc:515] T ce4f062dcd314d43a63ca74067cb5ee3 P cd75a17ab2604397adab03bb8b5fd75c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } attrs { replace: true } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:20:36.153509 11959 leader_election.cc:290] T 713b5728a197487c9300b310ab94e5a3 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 13 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:20:36.126801 11994 leader_election.cc:290] T 44bde925b2e541b69890d70715b85176 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 15 election: Requested vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:36.157431  6881 raft_consensus.cc:1217] T 853ac0a8cbd64ce99457f170216d4d0f P cd75a17ab2604397adab03bb8b5fd75c [term 12 FOLLOWER]: Deduplicated request from leader. Original: 6.4->[8.5-12.7]   Dedup: 8.5->[10.6-12.7]
I20260709 13:20:36.164407  6880 raft_consensus.cc:1275] T 30e88460611e47b2ba16a46a30b5f416 P cd75a17ab2604397adab03bb8b5fd75c [term 13 FOLLOWER]: Refusing update from remote peer ccd8a4c3bfe3413cb2ae219b09aea832: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 13:20:36.166409 11700 raft_consensus.cc:2749] T de3186201e1a40d0b335eeb8b4e256e0 P cd75a17ab2604397adab03bb8b5fd75c [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:20:36.167694 11700 raft_consensus.cc:493] T 24ee15416e3145beaa1b8183453729a3 P cd75a17ab2604397adab03bb8b5fd75c [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:20:36.168020  6846 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:36.173766 11937 raft_consensus.cc:493] T 7c37d41cd9164c15a6826ca62a851a69 P cd75a17ab2604397adab03bb8b5fd75c [term 14 FOLLOWER]: Starting pre-election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
W20260709 13:20:36.172771  7467 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:36.161336  6881 pending_rounds.cc:85] T 853ac0a8cbd64ce99457f170216d4d0f P cd75a17ab2604397adab03bb8b5fd75c: Aborting all ops after (but not including) 5
W20260709 13:20:36.183058  6770 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 313090us
I20260709 13:20:36.183219  6874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "713b5728a197487c9300b310ab94e5a3" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:36.184716  6874 raft_consensus.cc:2468] T 713b5728a197487c9300b310ab94e5a3 P cd75a17ab2604397adab03bb8b5fd75c [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 13.
I20260709 13:20:36.126124 11946 raft_consensus.cc:515] T f09c2a98de1a4decabd0ff900dd44caa P ccd8a4c3bfe3413cb2ae219b09aea832 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:36.135033 11793 raft_consensus.cc:3060] T f3f9c2e2bf644115957398fe4c9459db P ccd8a4c3bfe3413cb2ae219b09aea832 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:36.179092  6881 pending_rounds.cc:107] T 853ac0a8cbd64ce99457f170216d4d0f P cd75a17ab2604397adab03bb8b5fd75c: Aborting uncommitted NO_OP operation due to leader change: 9.6
I20260709 13:20:36.189916  6881 raft_consensus.cc:2889] T 853ac0a8cbd64ce99457f170216d4d0f P cd75a17ab2604397adab03bb8b5fd75c [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:20:36.199923 12041 log.cc:927] Time spent T f4b8bd455d5a47c18a1380839c6e0d61 P ccd8a4c3bfe3413cb2ae219b09aea832: Append to log took a long time: real 0.059s	user 0.001s	sys 0.001s
W20260709 13:20:36.200548  7467 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:36.202447 11576 raft_consensus.cc:3055] T dbdf895bba214ff68685a24fd17dfb5d P cd75a17ab2604397adab03bb8b5fd75c [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:20:36.202986 11576 raft_consensus.cc:740] T dbdf895bba214ff68685a24fd17dfb5d P cd75a17ab2604397adab03bb8b5fd75c [term 12 LEADER]: Becoming Follower/Learner. State: Replica: cd75a17ab2604397adab03bb8b5fd75c, State: Running, Role: LEADER
I20260709 13:20:36.203725  7503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "427c124d773f483294511e80fe340075" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb"
I20260709 13:20:36.206360  6731 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50004 (request call id 2404) took 1534 ms. Trace:
I20260709 13:20:36.206841  6731 rpcz_store.cc:276] 0709 13:20:34.671716 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:34.672173 (+   457us) service_pool.cc:224] Handling call
0709 13:20:36.205826 (+1533653us) spinlock_profiling.cc:243] Waited 777 ms on lock 0x7b54003d5754. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f9ae2fa 00007fcc1496fb17 00007fcc0deea6d4 00007fcc0deea662 00007fcc0deea591 00007fcc0deea50c 00007fcc0dee97c2 00007fcc0dce548c 00007fcc0dce48c6 00007fcc0dce426f
0709 13:20:36.206129 (+   303us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1787512064}
I20260709 13:20:36.208968  6695 leader_election.cc:304] T 7887766dc6784fcaa42b35c05fea7a99 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
I20260709 13:20:36.210330  6695 leader_election.cc:304] T 4d9def8b32fd443aa94ab1420b06837b P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
I20260709 13:20:36.210711 12022 consensus_queue.cc:1048] T f3f9c2e2bf644115957398fe4c9459db P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:20:36.211549  6695 leader_election.cc:304] T f5be3a11b23d4ea9b08300a2789821c7 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
W20260709 13:20:36.210348  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 99039.5us
I20260709 13:20:36.214481 11991 raft_consensus.cc:2804] T 4d9def8b32fd443aa94ab1420b06837b P ccd8a4c3bfe3413cb2ae219b09aea832 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:20:36.215221 11991 raft_consensus.cc:697] T 4d9def8b32fd443aa94ab1420b06837b P ccd8a4c3bfe3413cb2ae219b09aea832 [term 15 LEADER]: Becoming Leader. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
I20260709 13:20:36.215432  6724 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50004 (request call id 2413) took 1371 ms. Trace:
I20260709 13:20:36.216609 11991 consensus_queue.cc:237] T 4d9def8b32fd443aa94ab1420b06837b P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 13.7, Last appended by leader: 7, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:36.208669  7495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fa34c08b205435dba97346991aa1f92" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb"
I20260709 13:20:36.215237 11946 leader_election.cc:290] T f09c2a98de1a4decabd0ff900dd44caa P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:36.210467 11636 raft_consensus.cc:2804] T 7887766dc6784fcaa42b35c05fea7a99 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:20:36.203907  6729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "427c124d773f483294511e80fe340075" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:36.221988  7495 raft_consensus.cc:2393] T 3fa34c08b205435dba97346991aa1f92 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c in current term 17: Already voted for candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in this term.
I20260709 13:20:36.215898  6724 rpcz_store.cc:276] 0709 13:20:34.844266 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:34.846184 (+  1918us) service_pool.cc:224] Handling call
0709 13:20:36.215132 (+1368948us) spinlock_profiling.cc:243] Waited 1.06 s on lock 0x7b540020c1d4. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f9ae2fa 00007fcc1496fb17 00007fcc0deea6d4 00007fcc0deea662 00007fcc0deea591 00007fcc0deea50c 00007fcc0dee97c2 00007fcc0dce548c 00007fcc0dce48c6 00007fcc0dce426f
0709 13:20:36.215347 (+   215us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2447277952}
I20260709 13:20:36.239205  6731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3f13b31a1f84f0d89d007eadd57924c" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:36.240644  6731 raft_consensus.cc:2468] T b3f13b31a1f84f0d89d007eadd57924c P ccd8a4c3bfe3413cb2ae219b09aea832 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in term 12.
I20260709 13:20:36.240854  6723 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49744 (request call id 532) took 1062 ms. Trace:
I20260709 13:20:36.241272  6723 rpcz_store.cc:276] 0709 13:20:35.178482 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:35.179701 (+  1219us) service_pool.cc:224] Handling call
0709 13:20:35.179975 (+   274us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:35.989190 (+809215us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:36.240450 (+251260us) spinlock_profiling.cc:243] Waited 805 ms on lock 0x7b54000e4a54. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f9aae01 00007fcc0f9a983e 00007fcc1496e419 00007fcc0dee5bd4 00007fcc0dee5b62 00007fcc0dee5a91 00007fcc0dee5a0c 00007fcc0dee4cc2 00007fcc0dce548c 00007fcc0dce48c6
0709 13:20:36.240758 (+   308us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1852232064}
I20260709 13:20:36.242039  6731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fa34c08b205435dba97346991aa1f92" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:20:36.242987  6731 raft_consensus.cc:3060] T 3fa34c08b205435dba97346991aa1f92 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:20:36.244272 11668 consensus_meta.cc:287] T 24ee15416e3145beaa1b8183453729a3 P 7ba59cc884714e8aa5f3f0ecaed84cbb: Time spent flushing consensus metadata: real 0.631s	user 0.001s	sys 0.021s
I20260709 13:20:36.244935 11668 raft_consensus.cc:515] T 24ee15416e3145beaa1b8183453729a3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 18 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:20:36.245265 11994 raft_consensus.cc:493] T 4b8cacb381b746da8d0049b0a83b41dd P ccd8a4c3bfe3413cb2ae219b09aea832 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 7ba59cc884714e8aa5f3f0ecaed84cbb)
I20260709 13:20:36.246325 11994 raft_consensus.cc:515] T 4b8cacb381b746da8d0049b0a83b41dd P ccd8a4c3bfe3413cb2ae219b09aea832 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:20:36.174786 11937 raft_consensus.cc:515] T 7c37d41cd9164c15a6826ca62a851a69 P cd75a17ab2604397adab03bb8b5fd75c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:36.246691 11947 leader_election.cc:290] T bb3d8792045a4583ae2e965b1350a5b4 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 13 election: Requested vote from peers cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:20:36.245417  7466 leader_election.cc:304] T b3f13b31a1f84f0d89d007eadd57924c P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: b7ab4784c7344b939bc36f639286f377
I20260709 13:20:36.248522  6729 raft_consensus.cc:2468] T 427c124d773f483294511e80fe340075 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in term 13.
I20260709 13:20:36.243973  6723 raft_consensus.cc:1275] T e77e330a82df4b43a745d57a68f6f057 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 16 FOLLOWER]: Refusing update from remote peer b7ab4784c7344b939bc36f639286f377: Log matching property violated. Preceding OpId in replica: term: 14 index: 7. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 13:20:36.229395 11636 raft_consensus.cc:493] T 7887766dc6784fcaa42b35c05fea7a99 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:36.260362 11636 raft_consensus.cc:3060] T 7887766dc6784fcaa42b35c05fea7a99 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:36.247594 11576 consensus_queue.cc:260] T dbdf895bba214ff68685a24fd17dfb5d P cd75a17ab2604397adab03bb8b5fd75c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 12.5, Last appended by leader: 5, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:36.261786 11576 raft_consensus.cc:3060] T dbdf895bba214ff68685a24fd17dfb5d P cd75a17ab2604397adab03bb8b5fd75c [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:20:36.264139 11959 consensus_queue.cc:1175] T dbdf895bba214ff68685a24fd17dfb5d P cd75a17ab2604397adab03bb8b5fd75c [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "b7ab4784c7344b939bc36f639286f377" responder_term: 12 status { last_received { term: 12 index: 5 } last_committed_idx: 4 last_received_current_leader { term: 12 index: 5 } }
I20260709 13:20:36.265852  6874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a734b5ab7834e05a8c422208acc58b1" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 15 candidate_status { last_received { term: 13 index: 5 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:36.267150  6874 raft_consensus.cc:2468] T 7a734b5ab7834e05a8c422208acc58b1 P cd75a17ab2604397adab03bb8b5fd75c [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 14.
I20260709 13:20:36.268554  6770 leader_election.cc:304] T dbdf895bba214ff68685a24fd17dfb5d P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:20:36.251955 11994 leader_election.cc:290] T 4b8cacb381b746da8d0049b0a83b41dd P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:20:36.168486 11700 raft_consensus.cc:515] T 24ee15416e3145beaa1b8183453729a3 P cd75a17ab2604397adab03bb8b5fd75c [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:20:36.279111 11700 leader_election.cc:290] T 24ee15416e3145beaa1b8183453729a3 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:20:36.249733  6880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c240553ce044eedb41541d72b9475d7" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:20:36.281420 11846 raft_consensus.cc:3060] T dbdf895bba214ff68685a24fd17dfb5d P b7ab4784c7344b939bc36f639286f377 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:36.271624 11937 leader_election.cc:290] T 7c37d41cd9164c15a6826ca62a851a69 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:20:36.290882 11810 raft_consensus.cc:2804] T f5be3a11b23d4ea9b08300a2789821c7 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:20:36.291775 11810 raft_consensus.cc:697] T f5be3a11b23d4ea9b08300a2789821c7 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 14 LEADER]: Becoming Leader. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
W20260709 13:20:36.292536 11954 consensus_meta.cc:287] T 7a734b5ab7834e05a8c422208acc58b1 P b7ab4784c7344b939bc36f639286f377: Time spent flushing consensus metadata: real 0.513s	user 0.003s	sys 0.014s
I20260709 13:20:36.293497 11668 leader_election.cc:290] T 24ee15416e3145beaa1b8183453729a3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 18 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:36.293282 11810 consensus_queue.cc:237] T f5be3a11b23d4ea9b08300a2789821c7 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
W20260709 13:20:36.272681 12038 log.cc:927] Time spent T ce4f062dcd314d43a63ca74067cb5ee3 P ccd8a4c3bfe3413cb2ae219b09aea832: Append to log took a long time: real 0.089s	user 0.000s	sys 0.002s
I20260709 13:20:36.293413 11954 raft_consensus.cc:515] T 7a734b5ab7834e05a8c422208acc58b1 P b7ab4784c7344b939bc36f639286f377 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } attrs { replace: true } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: NON_VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: true } }
I20260709 13:20:36.311247  6802 raft_consensus.cc:2393] T 7a734b5ab7834e05a8c422208acc58b1 P b7ab4784c7344b939bc36f639286f377 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ccd8a4c3bfe3413cb2ae219b09aea832 in current term 15: Already voted for candidate b7ab4784c7344b939bc36f639286f377 in this term.
I20260709 13:20:36.312084  6770 leader_election.cc:304] T 3d65025eea89441290d85dd053810e31 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:20:36.313851 11899 raft_consensus.cc:2749] T 3d65025eea89441290d85dd053810e31 P b7ab4784c7344b939bc36f639286f377 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:20:36.314484 12039 log.cc:927] Time spent T 22ccee1b570c4ad3a57bd7aec085b1b4 P ccd8a4c3bfe3413cb2ae219b09aea832: Append to log took a long time: real 0.181s	user 0.000s	sys 0.003s
I20260709 13:20:36.308597  6872 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53406 (request call id 2429) took 1073 ms. Trace:
I20260709 13:20:36.323302  6730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c240553ce044eedb41541d72b9475d7" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 16 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:36.324250 11937 raft_consensus.cc:493] T 30e88460611e47b2ba16a46a30b5f416 P cd75a17ab2604397adab03bb8b5fd75c [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:36.322857  6872 rpcz_store.cc:276] 0709 13:20:35.234775 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:36.063210 (+828435us) service_pool.cc:224] Handling call
0709 13:20:36.179284 (+116074us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:36.250984 (+ 71700us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:36.251027 (+    43us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:20:36.255394 (+  4367us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:20:36.308237 (+ 52843us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:36.308324 (+    87us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:36.308494 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:20:36.291388  6695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 80009.4us
I20260709 13:20:36.324285  6878 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53406 (request call id 2427) took 1090 ms. Trace:
I20260709 13:20:36.340484  6730 raft_consensus.cc:2393] T 2c240553ce044eedb41541d72b9475d7 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c in current term 16: Already voted for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in this term.
I20260709 13:20:36.339407  7503 raft_consensus.cc:2468] T 427c124d773f483294511e80fe340075 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 13.
I20260709 13:20:36.319355 11870 raft_consensus.cc:515] T 713b5728a197487c9300b310ab94e5a3 P b7ab4784c7344b939bc36f639286f377 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:36.324740 11954 leader_election.cc:290] T 7a734b5ab7834e05a8c422208acc58b1 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 15 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:36.319989 11781 leader_election.cc:290] T ce4f062dcd314d43a63ca74067cb5ee3 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:20:36.313874 11911 raft_consensus.cc:515] T f3f9c2e2bf644115957398fe4c9459db P b7ab4784c7344b939bc36f639286f377 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:36.367069  6803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44bde925b2e541b69890d70715b85176" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:20:36.373112  6801 raft_consensus.cc:1240] T 3a485a995abc4807b6e511e45419f737 P b7ab4784c7344b939bc36f639286f377 [term 14 FOLLOWER]: Rejecting Update request from peer ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 13. Current term is 14. Ops: []
I20260709 13:20:36.380098  7503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24ee15416e3145beaa1b8183453729a3" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:20:36.381196  7503 raft_consensus.cc:2393] T 24ee15416e3145beaa1b8183453729a3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c in current term 18: Already voted for candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in this term.
I20260709 13:20:36.341878 11937 raft_consensus.cc:515] T 30e88460611e47b2ba16a46a30b5f416 P cd75a17ab2604397adab03bb8b5fd75c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:36.386116  6727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a485a995abc4807b6e511e45419f737" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:36.386675  6804 raft_consensus.cc:2393] T 713b5728a197487c9300b310ab94e5a3 P b7ab4784c7344b939bc36f639286f377 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ccd8a4c3bfe3413cb2ae219b09aea832 in current term 14: Already voted for candidate b7ab4784c7344b939bc36f639286f377 in this term.
I20260709 13:20:36.387182  6803 raft_consensus.cc:2393] T 44bde925b2e541b69890d70715b85176 P b7ab4784c7344b939bc36f639286f377 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate ccd8a4c3bfe3413cb2ae219b09aea832 in current term 15: Already voted for candidate b7ab4784c7344b939bc36f639286f377 in this term.
W20260709 13:20:36.387508  6770 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 75747us
I20260709 13:20:36.387734  6800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09c2a98de1a4decabd0ff900dd44caa" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 17 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:36.388581  6770 leader_election.cc:304] T 427c124d773f483294511e80fe340075 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:20:36.389138 11870 leader_election.cc:290] T 713b5728a197487c9300b310ab94e5a3 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 14 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:36.389915 11870 raft_consensus.cc:2749] T 427c124d773f483294511e80fe340075 P b7ab4784c7344b939bc36f639286f377 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:20:36.386234 11567 raft_consensus.cc:493] T d33d5ee8ef6f415593d8df52063161ad P ccd8a4c3bfe3413cb2ae219b09aea832 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:20:36.392642 11567 raft_consensus.cc:515] T d33d5ee8ef6f415593d8df52063161ad P ccd8a4c3bfe3413cb2ae219b09aea832 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:36.387681 11937 leader_election.cc:290] T 30e88460611e47b2ba16a46a30b5f416 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:20:36.395383 11567 leader_election.cc:290] T d33d5ee8ef6f415593d8df52063161ad P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:36.399457 11837 leader_election.cc:290] T 427c124d773f483294511e80fe340075 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:36.402410  7495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce4f062dcd314d43a63ca74067cb5ee3" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 16 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:20:36.403324  7495 raft_consensus.cc:2468] T ce4f062dcd314d43a63ca74067cb5ee3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 15.
I20260709 13:20:36.403399  6817 tablet_copy_source_session.cc:215] T 7a734b5ab7834e05a8c422208acc58b1 P b7ab4784c7344b939bc36f639286f377: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:20:36.404405  6880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b56bf91d90824c959e21e0cee5ba1816" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:20:36.404842  6873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "427c124d773f483294511e80fe340075" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:20:36.403784  6872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4b8bd455d5a47c18a1380839c6e0d61" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 15 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
W20260709 13:20:36.413056  6773 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:36.330693  6878 rpcz_store.cc:276] 0709 13:20:35.234051 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:35.313826 (+ 79775us) service_pool.cc:224] Handling call
0709 13:20:35.314273 (+   447us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:35.314574 (+   301us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:20:35.336266 (+ 21692us) log.cc:844] Serialized 14 byte log entry
0709 13:20:35.418806 (+ 82540us) log.cc:844] Serialized 14 byte log entry
0709 13:20:36.255765 (+836959us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:20:36.323560 (+ 67795us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:20:36.323676 (+   116us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:36.323807 (+   131us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:36.323976 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1598749,"prepare.queue_time_us":882117,"prepare.run_cpu_time_us":67,"prepare.run_wall_time_us":69,"raft.queue_time_us":821195,"raft.run_cpu_time_us":352,"raft.run_wall_time_us":5060,"thread_start_us":33467,"threads_started":1}
I20260709 13:20:36.427409  6880 raft_consensus.cc:3060] T b56bf91d90824c959e21e0cee5ba1816 P cd75a17ab2604397adab03bb8b5fd75c [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:36.427599  6874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b3759de40694069b13c0f8bd40e5709" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:36.436110  6872 raft_consensus.cc:2468] T f4b8bd455d5a47c18a1380839c6e0d61 P cd75a17ab2604397adab03bb8b5fd75c [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 14.
I20260709 13:20:36.436570  6731 raft_consensus.cc:2468] T 3fa34c08b205435dba97346991aa1f92 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in term 17.
I20260709 13:20:36.449062  6873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7887766dc6784fcaa42b35c05fea7a99" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:36.451436  6872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "853ac0a8cbd64ce99457f170216d4d0f" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:20:36.454370  6878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d9def8b32fd443aa94ab1420b06837b" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:20:36.455309  6878 raft_consensus.cc:3060] T 4d9def8b32fd443aa94ab1420b06837b P cd75a17ab2604397adab03bb8b5fd75c [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:36.459295  6877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34f36d59d88f40fe8a2805e604fc6c0a" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:36.460310  6877 raft_consensus.cc:2468] T 34f36d59d88f40fe8a2805e604fc6c0a P cd75a17ab2604397adab03bb8b5fd75c [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 12.
W20260709 13:20:36.465066  6770 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 74594.9us
I20260709 13:20:36.425067 11567 raft_consensus.cc:493] T fe20b4b48823486ca3b9c648db6ce8aa P ccd8a4c3bfe3413cb2ae219b09aea832 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader cd75a17ab2604397adab03bb8b5fd75c)
I20260709 13:20:36.472745 11567 raft_consensus.cc:515] T fe20b4b48823486ca3b9c648db6ce8aa P ccd8a4c3bfe3413cb2ae219b09aea832 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:20:36.478219  6875 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53406 (request call id 2413) took 1254 ms. Trace:
I20260709 13:20:36.478685  6875 rpcz_store.cc:276] 0709 13:20:35.224179 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:35.227582 (+  3403us) service_pool.cc:224] Handling call
0709 13:20:36.477925 (+1250343us) spinlock_profiling.cc:243] Waited 784 ms on lock 0x7b540039add4. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f9ae2fa 00007fcc1496fb17 00007fcc0deea6d4 00007fcc0deea662 00007fcc0deea591 00007fcc0deea50c 00007fcc0dee97c2 00007fcc0dce548c 00007fcc0dce48c6 00007fcc0dce426f
0709 13:20:36.478134 (+   209us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1803545472}
I20260709 13:20:36.481963 12044 raft_consensus.cc:493] T 4275cf08e63345f993bce8664eada830 P cd75a17ab2604397adab03bb8b5fd75c [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:20:36.482939 12044 raft_consensus.cc:515] T 4275cf08e63345f993bce8664eada830 P cd75a17ab2604397adab03bb8b5fd75c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:36.467759  6879 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53406 (request call id 2426) took 1108 ms. Trace:
I20260709 13:20:36.467833  6874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90d42e216d9741e190bca19a781291fd" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:36.467078 11994 consensus_queue.cc:1059] T 3a485a995abc4807b6e511e45419f737 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.003s
I20260709 13:20:36.470638  6801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d33d5ee8ef6f415593d8df52063161ad" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:36.470813  5625 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:20:36.489048  6872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab432e62819d499eaaf3dd55481dd930" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 17 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
W20260709 13:20:36.490741 11752 consensus_meta.cc:287] T 2c240553ce044eedb41541d72b9475d7 P b7ab4784c7344b939bc36f639286f377: Time spent flushing consensus metadata: real 0.572s	user 0.019s	sys 0.004s
I20260709 13:20:36.459964 12042 raft_consensus.cc:493] T d33d5ee8ef6f415593d8df52063161ad P cd75a17ab2604397adab03bb8b5fd75c [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:20:36.475855 11567 leader_election.cc:290] T fe20b4b48823486ca3b9c648db6ce8aa P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:20:36.506913 11945 raft_consensus.cc:493] T 4f00a2e87e56452083b759f60d461ee3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:36.508363 11636 raft_consensus.cc:515] T 7887766dc6784fcaa42b35c05fea7a99 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:36.508747  6875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5be3a11b23d4ea9b08300a2789821c7" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:20:36.506145 11911 leader_election.cc:290] T f3f9c2e2bf644115957398fe4c9459db P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 14 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
W20260709 13:20:36.511168  6845 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:36.514850  6880 raft_consensus.cc:2468] T b56bf91d90824c959e21e0cee5ba1816 P cd75a17ab2604397adab03bb8b5fd75c [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 14.
I20260709 13:20:36.514122  6874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a485a995abc4807b6e511e45419f737" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:20:36.514111  6873 raft_consensus.cc:2468] T 7887766dc6784fcaa42b35c05fea7a99 P cd75a17ab2604397adab03bb8b5fd75c [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 14.
W20260709 13:20:36.518137  6773 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:36.519346  6875 raft_consensus.cc:3060] T f5be3a11b23d4ea9b08300a2789821c7 P cd75a17ab2604397adab03bb8b5fd75c [term 12 FOLLOWER]: Advancing to term 14
I20260709 13:20:36.527418 11946 raft_consensus.cc:493] T 3d65025eea89441290d85dd053810e31 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:36.484828  6879 rpcz_store.cc:276] 0709 13:20:35.233764 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:35.313116 (+ 79352us) service_pool.cc:224] Handling call
0709 13:20:35.338299 (+ 25183us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:35.338551 (+   252us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:20:35.661029 (+322478us) log.cc:844] Serialized 14 byte log entry
0709 13:20:36.195279 (+534250us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:20:36.231694 (+ 36415us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:20:36.297819 (+ 66125us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:36.336145 (+ 38326us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:36.342445 (+  6300us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":119387,"prepare.queue_time_us":443531,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":35,"raft.queue_time_us":132194,"raft.run_cpu_time_us":127,"raft.run_wall_time_us":119,"thread_start_us":645683,"threads_started":3,"wal-append.queue_time_us":283597}
I20260709 13:20:36.528005  6697 leader_election.cc:400] T 3fa34c08b205435dba97346991aa1f92 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 16 election: Vote denied by peer 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071) with higher term. Message: Invalid argument: T 3fa34c08b205435dba97346991aa1f92 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 16. Current term is 17.
I20260709 13:20:36.530901  6697 leader_election.cc:403] T 3fa34c08b205435dba97346991aa1f92 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 16 election: Cancelling election due to peer responding with higher term
I20260709 13:20:36.528129 11796 raft_consensus.cc:515] T 8c7f33e544204fbaac4078e3e83bbf4e P ccd8a4c3bfe3413cb2ae219b09aea832 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:36.528362 11946 raft_consensus.cc:515] T 3d65025eea89441290d85dd053810e31 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:36.533762 12011 raft_consensus.cc:3055] T 3a485a995abc4807b6e511e45419f737 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:20:36.534168 12011 raft_consensus.cc:740] T 3a485a995abc4807b6e511e45419f737 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
I20260709 13:20:36.534463 11946 leader_election.cc:290] T 3d65025eea89441290d85dd053810e31 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:36.537137 11796 leader_election.cc:290] T 8c7f33e544204fbaac4078e3e83bbf4e P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 13 election: Requested vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:36.540392  6801 raft_consensus.cc:1275] T de3186201e1a40d0b335eeb8b4e256e0 P b7ab4784c7344b939bc36f639286f377 [term 16 FOLLOWER]: Refusing update from remote peer ccd8a4c3bfe3413cb2ae219b09aea832: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 13:20:36.541127  6798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d65025eea89441290d85dd053810e31" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:36.542071  6798 raft_consensus.cc:2468] T 3d65025eea89441290d85dd053810e31 P b7ab4784c7344b939bc36f639286f377 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 14.
I20260709 13:20:36.529058  6879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3d8792045a4583ae2e965b1350a5b4" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
W20260709 13:20:36.544610  7468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 325596us
I20260709 13:20:36.545050  6876 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53416 (request call id 3125) took 2414 ms. Trace:
W20260709 13:20:36.546445  7468 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:36.547322  7468 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.5.126.67:42931 timed out after 1.558s (SENT) [suppressed 11 similar messages]
W20260709 13:20:36.548695  7466 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 303513us
I20260709 13:20:36.549068 11980 leader_election.cc:290] T 7ba5dac66ab5497e9e336f2a3c28cda5 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 15 election: Requested vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:20:36.550127  7466 leader_election.cc:304] T 427c124d773f483294511e80fe340075 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
I20260709 13:20:36.545588  6876 rpcz_store.cc:276] 0709 13:20:34.130112 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:34.488687 (+358575us) service_pool.cc:224] Handling call
0709 13:20:34.489026 (+   339us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:34.753775 (+264749us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:34.753818 (+    43us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:20:34.754301 (+   483us) log.cc:844] Serialized 26 byte log entry
0709 13:20:34.906286 (+151985us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:20:35.423835 (+517549us) log.cc:844] Serialized 14 byte log entry
0709 13:20:36.392506 (+968671us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:36.544363 (+151857us) spinlock_profiling.cc:243] Waited 74.1 ms on lock 0x7b5400217ad4. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f9aae01 00007fcc0f9a983e 00007fcc1496e419 00007fcc0dee5bd4 00007fcc0dee5b62 00007fcc0dee5a91 00007fcc0dee5a0c 00007fcc0dee4cc2 00007fcc0dce548c 00007fcc0dce48c6
0709 13:20:36.544431 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:36.544505 (+    74us) raft_consensus.cc:1685] finished
0709 13:20:36.544610 (+   105us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:36.544784 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":691193,"prepare.queue_time_us":328602,"prepare.run_cpu_time_us":44,"prepare.run_wall_time_us":40,"raft.queue_time_us":748342,"raft.run_cpu_time_us":331,"raft.run_wall_time_us":331,"spinlock_wait_cycles":170519808,"thread_start_us":694020,"threads_started":3,"wal-append.queue_time_us":372883}
I20260709 13:20:36.496838  6817 rpcz_store.cc:275] Call kudu.tserver.TabletCopyService.BeginTabletCopySession from 127.0.0.1:50550 (request call id 568) took 1176 ms. Trace:
I20260709 13:20:36.552022  6876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7887766dc6784fcaa42b35c05fea7a99" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:36.552230  6817 rpcz_store.cc:276] 0709 13:20:35.307767 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:35.429259 (+121492us) service_pool.cc:224] Handling call
0709 13:20:36.402719 (+973460us) spinlock_profiling.cc:243] Waited 120 ms on lock 0x7b54001b58d4. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f9b43f7 00007fcc1494a036 00007fcc14953a3e 00007fcc0c21727b 00007fcc149539ba 00007fcc1494eacc 00007fcc14949c7b 00007fcc1493e8d1 00007fcc139f24b4 00007fcc139f2442
0709 13:20:36.461286 (+ 58567us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":277079808}
I20260709 13:20:36.553099  6876 raft_consensus.cc:2410] T 7887766dc6784fcaa42b35c05fea7a99 P cd75a17ab2604397adab03bb8b5fd75c [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7ab4784c7344b939bc36f639286f377 for term 16 because replica has last-logged OpId of term: 14 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 7.
I20260709 13:20:36.553563 11668 consensus_queue.cc:1059] T bb3d8792045a4583ae2e965b1350a5b4 P 7ba59cc884714e8aa5f3f0ecaed84cbb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:20:36.554594 11668 raft_consensus.cc:2804] T 427c124d773f483294511e80fe340075 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:20:36.554987 11668 raft_consensus.cc:493] T 427c124d773f483294511e80fe340075 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:36.527412 11945 raft_consensus.cc:515] T 4f00a2e87e56452083b759f60d461ee3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:20:36.556494  6728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c44c4849aa54f2b94d1f1bef9ed546f" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:36.557169 11774 raft_consensus.cc:3055] T bb3d8792045a4583ae2e965b1350a5b4 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:20:36.557652 11774 raft_consensus.cc:740] T bb3d8792045a4583ae2e965b1350a5b4 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 7ba59cc884714e8aa5f3f0ecaed84cbb, State: Running, Role: LEADER
I20260709 13:20:36.558102  6725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44bde925b2e541b69890d70715b85176" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:36.558830  6725 raft_consensus.cc:2393] T 44bde925b2e541b69890d70715b85176 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c in current term 15: Already voted for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in this term.
I20260709 13:20:36.558627 11774 consensus_queue.cc:260] T bb3d8792045a4583ae2e965b1350a5b4 P 7ba59cc884714e8aa5f3f0ecaed84cbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:20:36.561075  6872 raft_consensus.cc:2410] T ab432e62819d499eaaf3dd55481dd930 P cd75a17ab2604397adab03bb8b5fd75c [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ccd8a4c3bfe3413cb2ae219b09aea832 for term 17 because replica has last-logged OpId of term: 15 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 7.
I20260709 13:20:36.557686  6728 raft_consensus.cc:2410] T 7c44c4849aa54f2b94d1f1bef9ed546f P ccd8a4c3bfe3413cb2ae219b09aea832 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c for term 16 because replica has last-logged OpId of term: 15 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 10.
I20260709 13:20:36.543844  6879 raft_consensus.cc:3060] T bb3d8792045a4583ae2e965b1350a5b4 P cd75a17ab2604397adab03bb8b5fd75c [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:36.568408  6880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44bde925b2e541b69890d70715b85176" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:20:36.553247 11878 raft_consensus.cc:2804] T b3f13b31a1f84f0d89d007eadd57924c P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:20:36.572472 11878 raft_consensus.cc:493] T b3f13b31a1f84f0d89d007eadd57924c P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 12 FOLLOWER]: Starting leader election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:20:36.572883 11878 raft_consensus.cc:3060] T b3f13b31a1f84f0d89d007eadd57924c P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:36.555346 11668 raft_consensus.cc:3060] T 427c124d773f483294511e80fe340075 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:36.529695 11567 raft_consensus.cc:493] T 3411566abe2d4c9bb4b2adfdd05e6f17 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:20:36.576896 11567 raft_consensus.cc:515] T 3411566abe2d4c9bb4b2adfdd05e6f17 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:36.567118 11947 raft_consensus.cc:2749] T 3fa34c08b205435dba97346991aa1f92 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 17 FOLLOWER]: Leader election lost for term 16. Reason: Vote denied by peer 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071) with higher term. Message: Invalid argument: T 3fa34c08b205435dba97346991aa1f92 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 16. Current term is 17.
I20260709 13:20:36.580402  7503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "427c124d773f483294511e80fe340075" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb"
I20260709 13:20:36.583096  6804 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:32976 (request call id 3121) took 1053 ms. Trace:
W20260709 13:20:36.584233  7467 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:36.601718  6875 raft_consensus.cc:2468] T f5be3a11b23d4ea9b08300a2789821c7 P cd75a17ab2604397adab03bb8b5fd75c [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 14.
I20260709 13:20:36.593312  7495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3d8792045a4583ae2e965b1350a5b4" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb"
I20260709 13:20:36.584638  6725 raft_consensus.cc:1240] T f09c2a98de1a4decabd0ff900dd44caa P ccd8a4c3bfe3413cb2ae219b09aea832 [term 16 FOLLOWER]: Rejecting Update request from peer cd75a17ab2604397adab03bb8b5fd75c for earlier term 15. Current term is 16. Ops: [15.9-15.9]
W20260709 13:20:36.584916 11710 consensus_meta.cc:287] T bd6869f07b5a4885a0b99fbe60c3b175 P ccd8a4c3bfe3413cb2ae219b09aea832: Time spent flushing consensus metadata: real 0.501s	user 0.000s	sys 0.015s
I20260709 13:20:36.606907 11710 raft_consensus.cc:515] T bd6869f07b5a4885a0b99fbe60c3b175 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:36.609510 11710 leader_election.cc:290] T bd6869f07b5a4885a0b99fbe60c3b175 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 16 election: Requested vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:36.582187  7501 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50744 (request call id 402) took 1095 ms. Trace:
I20260709 13:20:36.581405  6732 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50004 (request call id 2423) took 1082 ms. Trace:
I20260709 13:20:36.599946  6804 rpcz_store.cc:276] 0709 13:20:35.529442 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:35.529657 (+   215us) service_pool.cc:224] Handling call
0709 13:20:36.582804 (+1053147us) spinlock_profiling.cc:243] Waited 701 ms on lock 0x7b54001d1ad4. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f9ae2fa 00007fcc1496fb17 00007fcc0deea6d4 00007fcc0deea662 00007fcc0deea591 00007fcc0deea50c 00007fcc0dee97c2 00007fcc0dce548c 00007fcc0dce48c6 00007fcc0dce426f
0709 13:20:36.583002 (+   198us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1613108992}
I20260709 13:20:36.585075  6697 leader_election.cc:304] T 1bf4668eeb70467fb3dc5a0289233b3c P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377
I20260709 13:20:36.559489 11945 leader_election.cc:290] T 4f00a2e87e56452083b759f60d461ee3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
W20260709 13:20:36.625494  7467 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:36.628870  6879 raft_consensus.cc:2468] T bb3d8792045a4583ae2e965b1350a5b4 P cd75a17ab2604397adab03bb8b5fd75c [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 13.
I20260709 13:20:36.581414  7496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "404190ce4ce94cecbfcb6ea9d1dd8626" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:20:36.611325  7501 rpcz_store.cc:276] 0709 13:20:35.486756 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:35.486919 (+   163us) service_pool.cc:224] Handling call
0709 13:20:35.487284 (+   365us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:35.846867 (+359583us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:35.846913 (+    46us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:20:35.846974 (+    61us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:20:35.847032 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:36.581677 (+734645us) spinlock_profiling.cc:243] Waited 359 ms on lock 0x7b540032d2d4. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f9aae01 00007fcc0f9a983e 00007fcc1496e419 00007fcc0dee5bd4 00007fcc0dee5b62 00007fcc0dee5a91 00007fcc0dee5a0c 00007fcc0dee4cc2 00007fcc0dce548c 00007fcc0dce48c6
0709 13:20:36.581757 (+    80us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:36.581978 (+   221us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":826195328}
I20260709 13:20:36.586788  6695 leader_election.cc:304] T 3d65025eea89441290d85dd053810e31 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
I20260709 13:20:36.635381 11955 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7a734b5ab7834e05a8c422208acc58b1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:36.641045  6799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f00a2e87e56452083b759f60d461ee3" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:36.585525 11774 raft_consensus.cc:3060] T bb3d8792045a4583ae2e965b1350a5b4 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:36.579973 11567 leader_election.cc:290] T 3411566abe2d4c9bb4b2adfdd05e6f17 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:36.656540 11710 raft_consensus.cc:2804] T 1bf4668eeb70467fb3dc5a0289233b3c P ccd8a4c3bfe3413cb2ae219b09aea832 [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 13:20:36.656716  6697 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 71773.9us
I20260709 13:20:36.657076 11710 raft_consensus.cc:493] T 1bf4668eeb70467fb3dc5a0289233b3c P ccd8a4c3bfe3413cb2ae219b09aea832 [term 13 FOLLOWER]: Starting leader election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:20:36.657508 11710 raft_consensus.cc:3060] T 1bf4668eeb70467fb3dc5a0289233b3c P ccd8a4c3bfe3413cb2ae219b09aea832 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:36.657608  6697 leader_election.cc:304] T 22ccee1b570c4ad3a57bd7aec085b1b4 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:20:36.659134  6697 leader_election.cc:304] T 20f6842e26174571996b8dea4151d4be P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377
I20260709 13:20:36.662830  6879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09c2a98de1a4decabd0ff900dd44caa" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 17 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
W20260709 13:20:36.662878  6695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 76213.2us
W20260709 13:20:36.587906  6616 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet ce4f062dcd314d43a63ca74067cb5ee3 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER failed with leader 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 7ba59cc884714e8aa5f3f0ecaed84cbb is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 15 committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } attrs { replace: true } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } } }
I20260709 13:20:36.612251  6732 rpcz_store.cc:276] 0709 13:20:35.498484 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:35.498646 (+   162us) service_pool.cc:224] Handling call
0709 13:20:35.498983 (+   337us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:35.990334 (+491351us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:20:35.991148 (+   814us) log.cc:844] Serialized 14 byte log entry
0709 13:20:36.191689 (+200541us) log.cc:844] Serialized 14 byte log entry
0709 13:20:36.191959 (+   270us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:20:36.192021 (+    62us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:20:36.194375 (+  2354us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:36.580893 (+386518us) spinlock_profiling.cc:243] Waited 490 ms on lock 0x7b54000e4054. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f9aae01 00007fcc0f9a983e 00007fcc1496e419 00007fcc0dee5bd4 00007fcc0dee5b62 00007fcc0dee5a91 00007fcc0dee5a0c 00007fcc0dee4cc2 00007fcc0dce548c 00007fcc0dce48c6
0709 13:20:36.580961 (+    68us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:36.581182 (+   221us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":113730,"prepare.run_cpu_time_us":289,"prepare.run_wall_time_us":9217,"raft.queue_time_us":12437,"raft.run_cpu_time_us":458,"raft.run_wall_time_us":45737,"spinlock_wait_cycles":1127627008,"thread_start_us":183826,"threads_started":1,"wal-append.queue_time_us":281743}
W20260709 13:20:36.665931  6616 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.5.126.68:45071, user_credentials={real_user=slave}} blocked reactor thread for 78296.6us
I20260709 13:20:36.580819 11846 raft_consensus.cc:2749] T dbdf895bba214ff68685a24fd17dfb5d P b7ab4784c7344b939bc36f639286f377 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:20:36.668170  6881 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53406 (request call id 2430) took 1236 ms. Trace:
I20260709 13:20:36.676116  6881 rpcz_store.cc:276] 0709 13:20:35.424537 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:36.147890 (+723353us) service_pool.cc:224] Handling call
0709 13:20:36.156721 (+  8831us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 13:20:36.256663 (+ 99942us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:20:36.257246 (+   583us) log.cc:844] Serialized 14 byte log entry
0709 13:20:36.365573 (+108327us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:20:36.392893 (+ 27320us) log.cc:844] Serialized 52 byte log entry
0709 13:20:36.393055 (+   162us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:20:36.393551 (+   496us) log.cc:844] Serialized 14 byte log entry
0709 13:20:36.402263 (+  8712us) log.cc:844] Serialized 14 byte log entry
0709 13:20:36.402474 (+   211us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:36.402549 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:36.660878 (+258329us) raft_consensus.cc:1685] finished
0709 13:20:36.660907 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:36.661074 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":14281,"prepare.queue_time_us":2772,"prepare.run_cpu_time_us":131,"prepare.run_wall_time_us":134,"raft.queue_time_us":28100,"raft.run_cpu_time_us":591,"raft.run_wall_time_us":17433,"thread_start_us":107677,"threads_started":1,"wal-append.queue_time_us":334900}
I20260709 13:20:36.678892  6881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b8cacb381b746da8d0049b0a83b41dd" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:36.679641  6881 raft_consensus.cc:2468] T 4b8cacb381b746da8d0049b0a83b41dd P cd75a17ab2604397adab03bb8b5fd75c [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 14.
I20260709 13:20:36.587530 11990 consensus_queue.cc:1048] T de3186201e1a40d0b335eeb8b4e256e0 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.093s
I20260709 13:20:36.668253  6880 raft_consensus.cc:3060] T 44bde925b2e541b69890d70715b85176 P cd75a17ab2604397adab03bb8b5fd75c [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:20:36.687934  6773 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:36.675496  6872 raft_consensus.cc:3060] T 4f00a2e87e56452083b759f60d461ee3 P cd75a17ab2604397adab03bb8b5fd75c [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:36.544641 11793 raft_consensus.cc:515] T f3f9c2e2bf644115957398fe4c9459db P ccd8a4c3bfe3413cb2ae219b09aea832 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:36.694092  6728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab432e62819d499eaaf3dd55481dd930" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:36.694473  6727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a75bfe094d4bdc963aba3f08dfcd25" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
W20260709 13:20:36.708027  6770 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 211237us
I20260709 13:20:36.687417 11947 raft_consensus.cc:2804] T 3d65025eea89441290d85dd053810e31 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:20:36.667956 11994 raft_consensus.cc:2749] T 22ccee1b570c4ad3a57bd7aec085b1b4 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:20:36.724660  7500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b8cacb381b746da8d0049b0a83b41dd" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:20:36.727309  6731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c7f33e544204fbaac4078e3e83bbf4e" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:36.728564  6731 raft_consensus.cc:2368] T 8c7f33e544204fbaac4078e3e83bbf4e P ccd8a4c3bfe3413cb2ae219b09aea832 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c for earlier term 12. Current term is 13.
I20260709 13:20:36.728950  6798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3411566abe2d4c9bb4b2adfdd05e6f17" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:36.592166 12042 raft_consensus.cc:515] T d33d5ee8ef6f415593d8df52063161ad P cd75a17ab2604397adab03bb8b5fd75c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:36.735775  6804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c7f33e544204fbaac4078e3e83bbf4e" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
W20260709 13:20:36.736544  6697 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 77507.9us
I20260709 13:20:36.699640 11567 raft_consensus.cc:2804] T 20f6842e26174571996b8dea4151d4be P ccd8a4c3bfe3413cb2ae219b09aea832 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:20:36.732525  6725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fa34c08b205435dba97346991aa1f92" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:36.744777  6881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab432e62819d499eaaf3dd55481dd930" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:36.745517  6881 raft_consensus.cc:2468] T ab432e62819d499eaaf3dd55481dd930 P cd75a17ab2604397adab03bb8b5fd75c [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 15.
W20260709 13:20:36.738626  6846 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:36.739351  6728 raft_consensus.cc:2393] T ab432e62819d499eaaf3dd55481dd930 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c in current term 16: Already voted for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in this term.
I20260709 13:20:36.752813  6725 raft_consensus.cc:2393] T 3fa34c08b205435dba97346991aa1f92 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c in current term 17: Already voted for candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in this term.
I20260709 13:20:36.754431  7466 leader_election.cc:304] T 3fa34c08b205435dba97346991aa1f92 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
I20260709 13:20:36.757071  7502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ba5dac66ab5497e9e336f2a3c28cda5" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb"
I20260709 13:20:36.757546  6800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6869f07b5a4885a0b99fbe60c3b175" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:20:36.757968  7502 raft_consensus.cc:3060] T 7ba5dac66ab5497e9e336f2a3c28cda5 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 13 FOLLOWER]: Advancing to term 15
I20260709 13:20:36.758018 11878 raft_consensus.cc:515] T b3f13b31a1f84f0d89d007eadd57924c P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:20:36.758581  6730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d65025eea89441290d85dd053810e31" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:36.760852 11636 leader_election.cc:290] T 7887766dc6784fcaa42b35c05fea7a99 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 16 election: Requested vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:36.762102  6697 leader_election.cc:304] T e77e330a82df4b43a745d57a68f6f057 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:20:36.765113  7498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe20b4b48823486ca3b9c648db6ce8aa" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:20:36.766189  6770 leader_election.cc:304] T f5be3a11b23d4ea9b08300a2789821c7 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:20:36.768005 11666 consensus_queue.cc:1048] T 34f36d59d88f40fe8a2805e604fc6c0a P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:20:36.727674 11947 raft_consensus.cc:493] T 3d65025eea89441290d85dd053810e31 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:36.769456  7502 raft_consensus.cc:2468] T 7ba5dac66ab5497e9e336f2a3c28cda5 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 15.
I20260709 13:20:36.777343  6879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3022224cc81473690653a83d4e99470" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:36.777571  6846 leader_election.cc:304] T 7ba5dac66ab5497e9e336f2a3c28cda5 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:20:36.769915  6726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a734b5ab7834e05a8c422208acc58b1" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 15 candidate_status { last_received { term: 13 index: 5 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:36.770733  6727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f03d0dbf16864ca4bc1bb5e4c0334c0f" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:20:36.784854  6877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d33d5ee8ef6f415593d8df52063161ad" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:36.769587  6697 leader_election.cc:304] T 7c44c4849aa54f2b94d1f1bef9ed546f P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377
I20260709 13:20:36.787418  6800 raft_consensus.cc:3060] T bd6869f07b5a4885a0b99fbe60c3b175 P b7ab4784c7344b939bc36f639286f377 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:36.789022  6881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe20b4b48823486ca3b9c648db6ce8aa" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:36.785624  6877 raft_consensus.cc:2468] T d33d5ee8ef6f415593d8df52063161ad P cd75a17ab2604397adab03bb8b5fd75c [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 12.
I20260709 13:20:36.794667  6879 raft_consensus.cc:2468] T a3022224cc81473690653a83d4e99470 P cd75a17ab2604397adab03bb8b5fd75c [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 15.
I20260709 13:20:36.798384  6731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8292e16e5654be6bc408560cf256aaa" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:36.802335 11990 raft_consensus.cc:493] T be1a92657f494cac8dd227d152f50151 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 7ba59cc884714e8aa5f3f0ecaed84cbb)
I20260709 13:20:36.802660  6726 raft_consensus.cc:2468] T 7a734b5ab7834e05a8c422208acc58b1 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 14.
I20260709 13:20:36.803112 11990 raft_consensus.cc:515] T be1a92657f494cac8dd227d152f50151 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:20:36.803660 11576 raft_consensus.cc:2804] T 7ba5dac66ab5497e9e336f2a3c28cda5 P cd75a17ab2604397adab03bb8b5fd75c [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:20:36.804299 11576 raft_consensus.cc:697] T 7ba5dac66ab5497e9e336f2a3c28cda5 P cd75a17ab2604397adab03bb8b5fd75c [term 15 LEADER]: Becoming Leader. State: Replica: cd75a17ab2604397adab03bb8b5fd75c, State: Running, Role: LEADER
I20260709 13:20:36.805737 11990 leader_election.cc:290] T be1a92657f494cac8dd227d152f50151 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:20:36.805451 11576 consensus_queue.cc:237] T 7ba5dac66ab5497e9e336f2a3c28cda5 P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:20:36.810246 11911 consensus_queue.cc:1048] T e77e330a82df4b43a745d57a68f6f057 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:20:36.814457 11994 raft_consensus.cc:493] T 17587d6730594da4a56fa13a353232a1 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:20:36.815910 11878 leader_election.cc:290] T b3f13b31a1f84f0d89d007eadd57924c P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 13 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:20:36.817605  6726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24ee15416e3145beaa1b8183453729a3" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:20:36.818468  6726 raft_consensus.cc:3060] T 24ee15416e3145beaa1b8183453729a3 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 16 FOLLOWER]: Advancing to term 18
I20260709 13:20:36.796993 11937 raft_consensus.cc:493] T f58dc08b12a2494bb9a1372837970ca2 P cd75a17ab2604397adab03bb8b5fd75c [term 16 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:20:36.820917  6804 raft_consensus.cc:3060] T 8c7f33e544204fbaac4078e3e83bbf4e P b7ab4784c7344b939bc36f639286f377 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:36.820727 11937 raft_consensus.cc:515] T f58dc08b12a2494bb9a1372837970ca2 P cd75a17ab2604397adab03bb8b5fd75c [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:36.823019 11937 leader_election.cc:290] T f58dc08b12a2494bb9a1372837970ca2 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
W20260709 13:20:36.820760  6697 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 56763us
I20260709 13:20:36.815500 11994 raft_consensus.cc:515] T 17587d6730594da4a56fa13a353232a1 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:20:36.741333 11567 raft_consensus.cc:493] T 20f6842e26174571996b8dea4151d4be P ccd8a4c3bfe3413cb2ae219b09aea832 [term 15 FOLLOWER]: Starting leader election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:20:36.836890  6879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f03d0dbf16864ca4bc1bb5e4c0334c0f" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:20:36.784868 11947 raft_consensus.cc:3060] T 3d65025eea89441290d85dd053810e31 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:36.758623 12042 leader_election.cc:290] T d33d5ee8ef6f415593d8df52063161ad P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:20:36.793491 11945 raft_consensus.cc:2804] T 3fa34c08b205435dba97346991aa1f92 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:20:36.784511 11846 raft_consensus.cc:2749] T f5be3a11b23d4ea9b08300a2789821c7 P b7ab4784c7344b939bc36f639286f377 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:20:36.844897  6798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3f13b31a1f84f0d89d007eadd57924c" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:20:36.796871 11636 raft_consensus.cc:2749] T e77e330a82df4b43a745d57a68f6f057 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:20:36.845163  6724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3f13b31a1f84f0d89d007eadd57924c" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:20:36.793174 11959 raft_consensus.cc:493] T 3411566abe2d4c9bb4b2adfdd05e6f17 P cd75a17ab2604397adab03bb8b5fd75c [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:20:36.853093  6728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3022224cc81473690653a83d4e99470" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:36.855332  6724 raft_consensus.cc:3060] T b3f13b31a1f84f0d89d007eadd57924c P ccd8a4c3bfe3413cb2ae219b09aea832 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:36.854539  6732 raft_consensus.cc:1240] T f3f9c2e2bf644115957398fe4c9459db P ccd8a4c3bfe3413cb2ae219b09aea832 [term 14 FOLLOWER]: Rejecting Update request from peer cd75a17ab2604397adab03bb8b5fd75c for earlier term 13. Current term is 14. Ops: [13.9-13.9]
I20260709 13:20:36.844002 11937 raft_consensus.cc:493] T 22ccee1b570c4ad3a57bd7aec085b1b4 P cd75a17ab2604397adab03bb8b5fd75c [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:20:36.840304 12043 raft_consensus.cc:493] T 9e326172347f45e99a0d482b5d8ef768 P cd75a17ab2604397adab03bb8b5fd75c [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:20:36.833035 11946 raft_consensus.cc:493] T dbdf895bba214ff68685a24fd17dfb5d P ccd8a4c3bfe3413cb2ae219b09aea832 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:36.856541 11634 raft_consensus.cc:2804] T 7c44c4849aa54f2b94d1f1bef9ed546f P ccd8a4c3bfe3413cb2ae219b09aea832 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:20:36.849251 11990 raft_consensus.cc:493] T 1528ab62b6fe4e3099d08f141afee116 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 7ba59cc884714e8aa5f3f0ecaed84cbb)
I20260709 13:20:36.859948  6879 raft_consensus.cc:3060] T f03d0dbf16864ca4bc1bb5e4c0334c0f P cd75a17ab2604397adab03bb8b5fd75c [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:36.842058 11567 raft_consensus.cc:3060] T 20f6842e26174571996b8dea4151d4be P ccd8a4c3bfe3413cb2ae219b09aea832 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:36.836602 11781 raft_consensus.cc:493] T a1704639a875409b9959353527b3fd68 P cd75a17ab2604397adab03bb8b5fd75c [term 15 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:20:36.867899  6805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7887766dc6784fcaa42b35c05fea7a99" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:20:36.872524  6723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20f6842e26174571996b8dea4151d4be" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:36.872931 11990 raft_consensus.cc:515] T 1528ab62b6fe4e3099d08f141afee116 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:20:36.875245  6879 raft_consensus.cc:2468] T f03d0dbf16864ca4bc1bb5e4c0334c0f P cd75a17ab2604397adab03bb8b5fd75c [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 14.
I20260709 13:20:36.907697  6805 raft_consensus.cc:3060] T 7887766dc6784fcaa42b35c05fea7a99 P b7ab4784c7344b939bc36f639286f377 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:36.864284 11634 raft_consensus.cc:493] T 7c44c4849aa54f2b94d1f1bef9ed546f P ccd8a4c3bfe3413cb2ae219b09aea832 [term 15 FOLLOWER]: Starting leader election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:20:36.878422 11870 raft_consensus.cc:493] T 1528ab62b6fe4e3099d08f141afee116 P b7ab4784c7344b939bc36f639286f377 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:36.882424  6729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a485a995abc4807b6e511e45419f737" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:20:36.924338  6800 raft_consensus.cc:2468] T bd6869f07b5a4885a0b99fbe60c3b175 P b7ab4784c7344b939bc36f639286f377 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 16.
I20260709 13:20:36.884176 12043 raft_consensus.cc:515] T 9e326172347f45e99a0d482b5d8ef768 P cd75a17ab2604397adab03bb8b5fd75c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:36.859519 12011 consensus_queue.cc:260] T 3a485a995abc4807b6e511e45419f737 P ccd8a4c3bfe3413cb2ae219b09aea832 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:36.889137 12047 raft_consensus.cc:493] T d8cee0accdb8499c86d4414b72565a38 P cd75a17ab2604397adab03bb8b5fd75c [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 7ba59cc884714e8aa5f3f0ecaed84cbb)
I20260709 13:20:36.897723  6772 leader_election.cc:304] T 404190ce4ce94cecbfcb6ea9d1dd8626 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:20:36.879866 11954 consensus_queue.cc:1059] T 853ac0a8cbd64ce99457f170216d4d0f P b7ab4784c7344b939bc36f639286f377 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 5, Time since last communication: 0.021s
I20260709 13:20:36.902132 11994 leader_election.cc:290] T 17587d6730594da4a56fa13a353232a1 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:20:36.902421  6881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f9c2e2bf644115957398fe4c9459db" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:20:36.903230 11793 leader_election.cc:290] T f3f9c2e2bf644115957398fe4c9459db P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 14 election: Requested vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:36.906476  6875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b56bf91d90824c959e21e0cee5ba1816" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:20:36.915474  6726 raft_consensus.cc:2468] T 24ee15416e3145beaa1b8183453729a3 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in term 18.
I20260709 13:20:36.921828  6725 raft_consensus.cc:1240] T e77e330a82df4b43a745d57a68f6f057 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 16 FOLLOWER]: Rejecting Update request from peer cd75a17ab2604397adab03bb8b5fd75c for earlier term 15. Current term is 16. Ops: [15.8-15.8]
I20260709 13:20:36.924957  6880 raft_consensus.cc:2468] T 44bde925b2e541b69890d70715b85176 P cd75a17ab2604397adab03bb8b5fd75c [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 15.
I20260709 13:20:36.927462  6804 raft_consensus.cc:2468] T 8c7f33e544204fbaac4078e3e83bbf4e P b7ab4784c7344b939bc36f639286f377 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 13.
I20260709 13:20:36.865939 11945 raft_consensus.cc:697] T 3fa34c08b205435dba97346991aa1f92 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 17 LEADER]: Becoming Leader. State: Replica: 7ba59cc884714e8aa5f3f0ecaed84cbb, State: Running, Role: LEADER
I20260709 13:20:36.927578  6879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a734b5ab7834e05a8c422208acc58b1" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 15 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:20:36.942355  6875 raft_consensus.cc:2393] T b56bf91d90824c959e21e0cee5ba1816 P cd75a17ab2604397adab03bb8b5fd75c [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate b7ab4784c7344b939bc36f639286f377 in current term 14: Already voted for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in this term.
I20260709 13:20:36.935034  6878 raft_consensus.cc:2468] T 4d9def8b32fd443aa94ab1420b06837b P cd75a17ab2604397adab03bb8b5fd75c [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 15.
I20260709 13:20:36.923642 11634 raft_consensus.cc:3060] T 7c44c4849aa54f2b94d1f1bef9ed546f P ccd8a4c3bfe3413cb2ae219b09aea832 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:20:36.942555  6845 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:36.859652 12044 leader_election.cc:290] T 4275cf08e63345f993bce8664eada830 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
W20260709 13:20:36.949628  6697 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 99128.9us
I20260709 13:20:36.935678  6727 raft_consensus.cc:2468] T f03d0dbf16864ca4bc1bb5e4c0334c0f P ccd8a4c3bfe3413cb2ae219b09aea832 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 13.
I20260709 13:20:36.953713  6880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "713b5728a197487c9300b310ab94e5a3" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:20:36.958113  6880 raft_consensus.cc:3060] T 713b5728a197487c9300b310ab94e5a3 P cd75a17ab2604397adab03bb8b5fd75c [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:36.944655  7466 leader_election.cc:304] T 24ee15416e3145beaa1b8183453729a3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
I20260709 13:20:36.959327  6726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44bde925b2e541b69890d70715b85176" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:20:36.927649 11878 raft_consensus.cc:493] T 1528ab62b6fe4e3099d08f141afee116 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:36.960477  6726 raft_consensus.cc:2393] T 44bde925b2e541b69890d70715b85176 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate b7ab4784c7344b939bc36f639286f377 in current term 15: Already voted for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in this term.
I20260709 13:20:36.861972 11937 raft_consensus.cc:515] T 22ccee1b570c4ad3a57bd7aec085b1b4 P cd75a17ab2604397adab03bb8b5fd75c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:36.958735  6724 raft_consensus.cc:2468] T b3f13b31a1f84f0d89d007eadd57924c P ccd8a4c3bfe3413cb2ae219b09aea832 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in term 13.
I20260709 13:20:36.964771  6728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7887766dc6784fcaa42b35c05fea7a99" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:36.965333  6879 raft_consensus.cc:3060] T 7a734b5ab7834e05a8c422208acc58b1 P cd75a17ab2604397adab03bb8b5fd75c [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:36.970079  6732 raft_consensus.cc:1240] T b3f13b31a1f84f0d89d007eadd57924c P ccd8a4c3bfe3413cb2ae219b09aea832 [term 13 FOLLOWER]: Rejecting Update request from peer b7ab4784c7344b939bc36f639286f377 for earlier term 12. Current term is 13. Ops: []
I20260709 13:20:36.970005  6728 raft_consensus.cc:2393] T 7887766dc6784fcaa42b35c05fea7a99 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7ab4784c7344b939bc36f639286f377 in current term 16: Already voted for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in this term.
I20260709 13:20:36.982508  6726 raft_consensus.cc:1240] T 4d9def8b32fd443aa94ab1420b06837b P ccd8a4c3bfe3413cb2ae219b09aea832 [term 15 LEADER]: Rejecting Update request from peer cd75a17ab2604397adab03bb8b5fd75c for earlier term 13. Current term is 15. Ops: []
W20260709 13:20:36.984091  6773 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:36.954212 12047 raft_consensus.cc:515] T d8cee0accdb8499c86d4414b72565a38 P cd75a17ab2604397adab03bb8b5fd75c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:20:36.988641 12047 leader_election.cc:290] T d8cee0accdb8499c86d4414b72565a38 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:20:36.991163  7502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8cee0accdb8499c86d4414b72565a38" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
W20260709 13:20:36.997684  7466 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 53207.2us
I20260709 13:20:37.000423 11837 raft_consensus.cc:2804] T 24ee15416e3145beaa1b8183453729a3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:20:37.001143 11837 raft_consensus.cc:697] T 24ee15416e3145beaa1b8183453729a3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 18 LEADER]: Becoming Leader. State: Replica: 7ba59cc884714e8aa5f3f0ecaed84cbb, State: Running, Role: LEADER
I20260709 13:20:37.002105 11837 consensus_queue.cc:237] T 24ee15416e3145beaa1b8183453729a3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 16.10, Last appended by leader: 10, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:20:37.004801 11752 raft_consensus.cc:3055] T 853ac0a8cbd64ce99457f170216d4d0f P b7ab4784c7344b939bc36f639286f377 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:20:37.005388 11752 raft_consensus.cc:740] T 853ac0a8cbd64ce99457f170216d4d0f P b7ab4784c7344b939bc36f639286f377 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
I20260709 13:20:37.006595 11752 consensus_queue.cc:260] T 853ac0a8cbd64ce99457f170216d4d0f P b7ab4784c7344b939bc36f639286f377 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:36.999543  7466 leader_election.cc:304] T b3f13b31a1f84f0d89d007eadd57924c P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: b7ab4784c7344b939bc36f639286f377
W20260709 13:20:37.012441  6773 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:37.016283  6727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3022224cc81473690653a83d4e99470" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:36.930706 11959 raft_consensus.cc:515] T 3411566abe2d4c9bb4b2adfdd05e6f17 P cd75a17ab2604397adab03bb8b5fd75c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:37.018747  6879 raft_consensus.cc:2468] T 7a734b5ab7834e05a8c422208acc58b1 P cd75a17ab2604397adab03bb8b5fd75c [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 15.
I20260709 13:20:37.027503  6875 raft_consensus.cc:3055] T f09c2a98de1a4decabd0ff900dd44caa P cd75a17ab2604397adab03bb8b5fd75c [term 15 LEADER]: Stepping down as leader of term 15
W20260709 13:20:37.033452  7467 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:36.932130 11781 raft_consensus.cc:515] T a1704639a875409b9959353527b3fd68 P cd75a17ab2604397adab03bb8b5fd75c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:36.935461 11946 raft_consensus.cc:515] T dbdf895bba214ff68685a24fd17dfb5d P ccd8a4c3bfe3413cb2ae219b09aea832 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:37.031235  6726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4db81d9d329422bb3b4160ca4ac2d1d" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:36.969986 11666 raft_consensus.cc:2749] T 404190ce4ce94cecbfcb6ea9d1dd8626 P b7ab4784c7344b939bc36f639286f377 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:20:37.029150  6772 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.68:45071, user_credentials={real_user=slave}} blocked reactor thread for 131649us
I20260709 13:20:36.948923 11870 raft_consensus.cc:515] T 1528ab62b6fe4e3099d08f141afee116 P b7ab4784c7344b939bc36f639286f377 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:20:37.033211  6875 raft_consensus.cc:740] T f09c2a98de1a4decabd0ff900dd44caa P cd75a17ab2604397adab03bb8b5fd75c [term 15 LEADER]: Becoming Follower/Learner. State: Replica: cd75a17ab2604397adab03bb8b5fd75c, State: Running, Role: LEADER
I20260709 13:20:37.034363  6732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab432e62819d499eaaf3dd55481dd930" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:37.043223 12047 raft_consensus.cc:493] T 711ef6523deb4cbe8ef2ba61e1c21c98 P cd75a17ab2604397adab03bb8b5fd75c [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:37.050077  6697 leader_election.cc:304] T f58dc08b12a2494bb9a1372837970ca2 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:20:37.050695 12047 raft_consensus.cc:515] T 711ef6523deb4cbe8ef2ba61e1c21c98 P cd75a17ab2604397adab03bb8b5fd75c [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
W20260709 13:20:37.051631  6697 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 75208.6us
I20260709 13:20:37.052668  6697 leader_election.cc:304] T e31b9971c15848dea59d4d4130141d9e P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377
I20260709 13:20:37.053596  6727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f03d0dbf16864ca4bc1bb5e4c0334c0f" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:20:37.054126  6878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44bde925b2e541b69890d70715b85176" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:20:37.054425  6727 raft_consensus.cc:3060] T f03d0dbf16864ca4bc1bb5e4c0334c0f P ccd8a4c3bfe3413cb2ae219b09aea832 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:37.055061  6878 raft_consensus.cc:2393] T 44bde925b2e541b69890d70715b85176 P cd75a17ab2604397adab03bb8b5fd75c [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate b7ab4784c7344b939bc36f639286f377 in current term 15: Already voted for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in this term.
I20260709 13:20:37.056164  6726 raft_consensus.cc:2393] T c4db81d9d329422bb3b4160ca4ac2d1d P ccd8a4c3bfe3413cb2ae219b09aea832 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c in current term 13: Already voted for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in this term.
I20260709 13:20:37.071754  6726 raft_consensus.cc:1275] T f09c2a98de1a4decabd0ff900dd44caa P ccd8a4c3bfe3413cb2ae219b09aea832 [term 16 FOLLOWER]: Refusing update from remote peer b7ab4784c7344b939bc36f639286f377: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:20:37.058533  6732 raft_consensus.cc:2468] T ab432e62819d499eaaf3dd55481dd930 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 16.
I20260709 13:20:37.036724 11752 raft_consensus.cc:3060] T 853ac0a8cbd64ce99457f170216d4d0f P b7ab4784c7344b939bc36f639286f377 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:36.973883 11878 raft_consensus.cc:515] T 1528ab62b6fe4e3099d08f141afee116 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:20:37.079141  6880 raft_consensus.cc:2468] T 713b5728a197487c9300b310ab94e5a3 P cd75a17ab2604397adab03bb8b5fd75c [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 14.
W20260709 13:20:37.080746  7468 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.512s	user 0.034s	sys 0.071s
W20260709 13:20:37.091799  6847 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:37.094635  7468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 547319us
I20260709 13:20:37.060402 12011 raft_consensus.cc:3060] T 3a485a995abc4807b6e511e45419f737 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:37.100811  6726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "427c124d773f483294511e80fe340075" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:20:37.076399 11793 raft_consensus.cc:2749] T f58dc08b12a2494bb9a1372837970ca2 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:20:37.110549  6697 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 57963us
I20260709 13:20:37.113023  6726 raft_consensus.cc:2393] T 427c124d773f483294511e80fe340075 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c in current term 13: Already voted for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in this term.
W20260709 13:20:37.113700  6873 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.538s	user 0.035s	sys 0.033s
W20260709 13:20:37.117653  6873 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.542s	user 0.035s	sys 0.033s
I20260709 13:20:37.124222  6875 consensus_queue.cc:260] T f09c2a98de1a4decabd0ff900dd44caa P cd75a17ab2604397adab03bb8b5fd75c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:37.136762 11909 raft_consensus.cc:2804] T b3f13b31a1f84f0d89d007eadd57924c P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:20:37.139864 11959 leader_election.cc:290] T 3411566abe2d4c9bb4b2adfdd05e6f17 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:20:37.146292 12047 leader_election.cc:290] T 711ef6523deb4cbe8ef2ba61e1c21c98 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
W20260709 13:20:37.150609  7468 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:37.151073 11668 consensus_meta.cc:287] T 427c124d773f483294511e80fe340075 P 7ba59cc884714e8aa5f3f0ecaed84cbb: Time spent flushing consensus metadata: real 0.577s	user 0.013s	sys 0.002s
I20260709 13:20:37.154220 11990 leader_election.cc:290] T 1528ab62b6fe4e3099d08f141afee116 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:20:37.155803 11945 consensus_queue.cc:237] T 3fa34c08b205435dba97346991aa1f92 P 7ba59cc884714e8aa5f3f0ecaed84cbb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.13, Last appended by leader: 13, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:20:37.156672  6726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b56bf91d90824c959e21e0cee5ba1816" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:20:37.157790  6726 raft_consensus.cc:2393] T b56bf91d90824c959e21e0cee5ba1816 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate b7ab4784c7344b939bc36f639286f377 in current term 14: Already voted for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in this term.
I20260709 13:20:37.158773  6726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f9c2e2bf644115957398fe4c9459db" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:20:37.159749  6726 raft_consensus.cc:2393] T f3f9c2e2bf644115957398fe4c9459db P ccd8a4c3bfe3413cb2ae219b09aea832 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate b7ab4784c7344b939bc36f639286f377 in current term 14: Already voted for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in this term.
I20260709 13:20:37.160466  6728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a734b5ab7834e05a8c422208acc58b1" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 15 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:20:37.161273 11946 leader_election.cc:290] T dbdf895bba214ff68685a24fd17dfb5d P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:37.161237  6728 raft_consensus.cc:3060] T 7a734b5ab7834e05a8c422208acc58b1 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:37.173135  6805 raft_consensus.cc:2468] T 7887766dc6784fcaa42b35c05fea7a99 P b7ab4784c7344b939bc36f639286f377 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 16.
I20260709 13:20:37.160321  6697 leader_election.cc:400] T 3fa34c08b205435dba97346991aa1f92 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 16 election: Vote denied by peer cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931) with higher term. Message: Invalid argument: T 3fa34c08b205435dba97346991aa1f92 P cd75a17ab2604397adab03bb8b5fd75c [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 16. Current term is 17.
W20260709 13:20:37.188745  6846 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:37.194833  6872 raft_consensus.cc:1275] T 4f00a2e87e56452083b759f60d461ee3 P cd75a17ab2604397adab03bb8b5fd75c [term 15 FOLLOWER]: Refusing update from remote peer b7ab4784c7344b939bc36f639286f377: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:20:37.128542 11994 raft_consensus.cc:2804] T e31b9971c15848dea59d4d4130141d9e P ccd8a4c3bfe3413cb2ae219b09aea832 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:20:37.201913  6726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "713b5728a197487c9300b310ab94e5a3" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
W20260709 13:20:37.208849  6844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:37.209955  6772 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 56244.9us
I20260709 13:20:37.151638 11668 raft_consensus.cc:515] T 427c124d773f483294511e80fe340075 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 14 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } attrs { replace: true } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:20:37.215098 12043 leader_election.cc:290] T 9e326172347f45e99a0d482b5d8ef768 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
W20260709 13:20:37.216135  6696 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:37.225363  6725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fa34c08b205435dba97346991aa1f92" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:20:37.226401  6725 raft_consensus.cc:2393] T 3fa34c08b205435dba97346991aa1f92 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c in current term 17: Already voted for candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in this term.
I20260709 13:20:37.227248  6725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "713b5728a197487c9300b310ab94e5a3" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:20:37.235347 11870 leader_election.cc:290] T 1528ab62b6fe4e3099d08f141afee116 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:20:37.198664 11946 raft_consensus.cc:493] T a1704639a875409b9959353527b3fd68 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:20:37.236552 11937 leader_election.cc:290] T 22ccee1b570c4ad3a57bd7aec085b1b4 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:20:37.236756 11946 raft_consensus.cc:515] T a1704639a875409b9959353527b3fd68 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:37.240583 11911 raft_consensus.cc:493] T 2c240553ce044eedb41541d72b9475d7 P b7ab4784c7344b939bc36f639286f377 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:37.241315 11911 raft_consensus.cc:515] T 2c240553ce044eedb41541d72b9475d7 P b7ab4784c7344b939bc36f639286f377 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:37.247054  6875 raft_consensus.cc:3060] T f09c2a98de1a4decabd0ff900dd44caa P cd75a17ab2604397adab03bb8b5fd75c [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:37.252812  6728 raft_consensus.cc:2468] T 7a734b5ab7834e05a8c422208acc58b1 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 15.
I20260709 13:20:37.112509 11710 raft_consensus.cc:515] T 1bf4668eeb70467fb3dc5a0289233b3c P ccd8a4c3bfe3413cb2ae219b09aea832 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:37.202868 11994 raft_consensus.cc:493] T e31b9971c15848dea59d4d4130141d9e P ccd8a4c3bfe3413cb2ae219b09aea832 [term 11 FOLLOWER]: Starting leader election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:20:37.275553  7503 raft_consensus.cc:2368] T 427c124d773f483294511e80fe340075 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 13. Current term is 14.
I20260709 13:20:37.277715  6879 raft_consensus.cc:1240] T bb3d8792045a4583ae2e965b1350a5b4 P cd75a17ab2604397adab03bb8b5fd75c [term 13 FOLLOWER]: Rejecting Update request from peer 7ba59cc884714e8aa5f3f0ecaed84cbb for earlier term 12. Current term is 13. Ops: [10.10-12.11]
I20260709 13:20:37.275138  6726 raft_consensus.cc:3060] T 713b5728a197487c9300b310ab94e5a3 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:37.286286  6725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce4f062dcd314d43a63ca74067cb5ee3" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 16 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:37.258030 11937 raft_consensus.cc:493] T 90d42e216d9741e190bca19a781291fd P cd75a17ab2604397adab03bb8b5fd75c [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:20:37.295300  6732 raft_consensus.cc:1240] T 1bf4668eeb70467fb3dc5a0289233b3c P ccd8a4c3bfe3413cb2ae219b09aea832 [term 14 FOLLOWER]: Rejecting Update request from peer b7ab4784c7344b939bc36f639286f377 for earlier term 13. Current term is 14. Ops: []
I20260709 13:20:37.293884  6872 raft_consensus.cc:1240] T 24ee15416e3145beaa1b8183453729a3 P cd75a17ab2604397adab03bb8b5fd75c [term 17 FOLLOWER]: Rejecting Update request from peer 7ba59cc884714e8aa5f3f0ecaed84cbb for earlier term 16. Current term is 17. Ops: [14.9-16.10]
I20260709 13:20:37.298787 11911 leader_election.cc:290] T 2c240553ce044eedb41541d72b9475d7 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
W20260709 13:20:37.301736 11774 consensus_meta.cc:287] T bb3d8792045a4583ae2e965b1350a5b4 P 7ba59cc884714e8aa5f3f0ecaed84cbb: Time spent flushing consensus metadata: real 0.649s	user 0.012s	sys 0.002s
I20260709 13:20:37.304631 11947 raft_consensus.cc:515] T 3d65025eea89441290d85dd053810e31 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:37.306093  6730 raft_consensus.cc:2393] T 3d65025eea89441290d85dd053810e31 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c in current term 15: Already voted for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in this term.
I20260709 13:20:37.306847 11947 leader_election.cc:290] T 3d65025eea89441290d85dd053810e31 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 15 election: Requested vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:37.276012 11634 raft_consensus.cc:515] T 7c44c4849aa54f2b94d1f1bef9ed546f P ccd8a4c3bfe3413cb2ae219b09aea832 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:37.315433 11634 leader_election.cc:290] T 7c44c4849aa54f2b94d1f1bef9ed546f P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 16 election: Requested vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:37.316366  6881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fa34c08b205435dba97346991aa1f92" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:37.317297  6731 raft_consensus.cc:1240] T 7c44c4849aa54f2b94d1f1bef9ed546f P ccd8a4c3bfe3413cb2ae219b09aea832 [term 16 FOLLOWER]: Rejecting Update request from peer b7ab4784c7344b939bc36f639286f377 for earlier term 15. Current term is 16. Ops: []
I20260709 13:20:37.271930 11946 leader_election.cc:290] T a1704639a875409b9959353527b3fd68 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:37.274142 11994 raft_consensus.cc:3060] T e31b9971c15848dea59d4d4130141d9e P ccd8a4c3bfe3413cb2ae219b09aea832 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:20:37.320253  6727 raft_consensus.cc:2468] T f03d0dbf16864ca4bc1bb5e4c0334c0f P ccd8a4c3bfe3413cb2ae219b09aea832 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 14.
I20260709 13:20:37.322882  6872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce4f062dcd314d43a63ca74067cb5ee3" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:37.268462 11990 consensus_queue.cc:1048] T 30e88460611e47b2ba16a46a30b5f416 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.051s
W20260709 13:20:37.337857  6877 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.523s	user 0.004s	sys 0.012s
I20260709 13:20:37.324450  6726 raft_consensus.cc:2468] T 713b5728a197487c9300b310ab94e5a3 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 14.
W20260709 13:20:37.338411  6877 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.523s	user 0.004s	sys 0.012s
I20260709 13:20:37.324546  6697 leader_election.cc:304] T 713b5728a197487c9300b310ab94e5a3 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:20:37.281652 11793 raft_consensus.cc:493] T c4db81d9d329422bb3b4160ca4ac2d1d P ccd8a4c3bfe3413cb2ae219b09aea832 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:37.340471  6872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24ee15416e3145beaa1b8183453729a3" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:37.341836  6872 raft_consensus.cc:2468] T 24ee15416e3145beaa1b8183453729a3 P cd75a17ab2604397adab03bb8b5fd75c [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in term 17.
I20260709 13:20:37.275020 11567 raft_consensus.cc:515] T 20f6842e26174571996b8dea4151d4be P ccd8a4c3bfe3413cb2ae219b09aea832 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
W20260709 13:20:37.341111  7500 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.508s	user 0.006s	sys 0.011s
W20260709 13:20:37.351553  7500 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.519s	user 0.006s	sys 0.011s
I20260709 13:20:37.353206  6881 raft_consensus.cc:2393] T 3fa34c08b205435dba97346991aa1f92 P cd75a17ab2604397adab03bb8b5fd75c [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in current term 17: Already voted for candidate cd75a17ab2604397adab03bb8b5fd75c in this term.
I20260709 13:20:37.354163  6725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1528ab62b6fe4e3099d08f141afee116" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:37.354758  6725 raft_consensus.cc:2468] T 1528ab62b6fe4e3099d08f141afee116 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in term 10.
I20260709 13:20:37.360196  7495 raft_consensus.cc:2468] T bb3d8792045a4583ae2e965b1350a5b4 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 13.
I20260709 13:20:37.364579  6697 leader_election.cc:304] T 7a734b5ab7834e05a8c422208acc58b1 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377
I20260709 13:20:37.367439  6875 raft_consensus.cc:1275] T f09c2a98de1a4decabd0ff900dd44caa P cd75a17ab2604397adab03bb8b5fd75c [term 16 FOLLOWER]: Refusing update from remote peer b7ab4784c7344b939bc36f639286f377: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
W20260709 13:20:37.367697  7468 leader_election.cc:336] T 7ba5dac66ab5497e9e336f2a3c28cda5 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931): Timed out: RequestConsensusVote RPC to 127.5.126.67:42931 timed out after 2.070s (SENT)
I20260709 13:20:37.346853 11793 raft_consensus.cc:515] T c4db81d9d329422bb3b4160ca4ac2d1d P ccd8a4c3bfe3413cb2ae219b09aea832 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
W20260709 13:20:37.375303  6771 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:37.376526  6805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a485a995abc4807b6e511e45419f737" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:37.377425  6805 raft_consensus.cc:2393] T 3a485a995abc4807b6e511e45419f737 P b7ab4784c7344b939bc36f639286f377 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c in current term 14: Already voted for candidate b7ab4784c7344b939bc36f639286f377 in this term.
I20260709 13:20:37.382210  6879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ba5dac66ab5497e9e336f2a3c28cda5" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:37.352351 11846 raft_consensus.cc:493] T c4db81d9d329422bb3b4160ca4ac2d1d P b7ab4784c7344b939bc36f639286f377 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:20:37.388325  6874 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.530s	user 0.015s	sys 0.012s
I20260709 13:20:37.388494  6723 raft_consensus.cc:2393] T 20f6842e26174571996b8dea4151d4be P ccd8a4c3bfe3413cb2ae219b09aea832 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c in current term 16: Already voted for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in this term.
W20260709 13:20:37.388850  6874 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.546s	user 0.015s	sys 0.012s
I20260709 13:20:37.385512  7468 leader_election.cc:304] T 7ba5dac66ab5497e9e336f2a3c28cda5 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:20:37.351091 11634 raft_consensus.cc:2764] T 713b5728a197487c9300b310ab94e5a3 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 14 FOLLOWER]: Leader pre-election decision vote started in defunct term 13: won
I20260709 13:20:37.333861 11937 raft_consensus.cc:515] T 90d42e216d9741e190bca19a781291fd P cd75a17ab2604397adab03bb8b5fd75c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
W20260709 13:20:37.411384  6695 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.564s	user 0.013s	sys 0.024s
W20260709 13:20:37.411839  6695 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.569s	user 0.013s	sys 0.024s
W20260709 13:20:37.418679  6802 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.549s	user 0.015s	sys 0.030s
W20260709 13:20:37.419503  6802 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.550s	user 0.015s	sys 0.030s
W20260709 13:20:37.422320  6697 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 57841.9us
I20260709 13:20:37.390535 11946 raft_consensus.cc:2764] T 7a734b5ab7834e05a8c422208acc58b1 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 15 FOLLOWER]: Leader pre-election decision vote started in defunct term 14: won
I20260709 13:20:37.436110  6875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fa34c08b205435dba97346991aa1f92" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
W20260709 13:20:37.436497  6772 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 87196.8us
I20260709 13:20:37.437510  6875 raft_consensus.cc:2393] T 3fa34c08b205435dba97346991aa1f92 P cd75a17ab2604397adab03bb8b5fd75c [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in current term 17: Already voted for candidate cd75a17ab2604397adab03bb8b5fd75c in this term.
I20260709 13:20:37.416898 12017 raft_consensus.cc:2749] T 7ba5dac66ab5497e9e336f2a3c28cda5 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 15 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:20:37.441442  6805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5be3a11b23d4ea9b08300a2789821c7" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:37.441872  6800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c240553ce044eedb41541d72b9475d7" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 16 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:37.442554  6805 raft_consensus.cc:2368] T f5be3a11b23d4ea9b08300a2789821c7 P b7ab4784c7344b939bc36f639286f377 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c for earlier term 12. Current term is 14.
I20260709 13:20:37.442981  6800 raft_consensus.cc:2410] T 2c240553ce044eedb41541d72b9475d7 P b7ab4784c7344b939bc36f639286f377 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c for term 16 because replica has last-logged OpId of term: 15 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 7.
I20260709 13:20:37.443148  6875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24ee15416e3145beaa1b8183453729a3" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:20:37.443863  6697 leader_election.cc:304] T 2c240553ce044eedb41541d72b9475d7 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:20:37.444304  6875 raft_consensus.cc:3060] T 24ee15416e3145beaa1b8183453729a3 P cd75a17ab2604397adab03bb8b5fd75c [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:20:37.448930  6872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f00a2e87e56452083b759f60d461ee3" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:37.432637 12047 raft_consensus.cc:493] T 4f00a2e87e56452083b759f60d461ee3 P cd75a17ab2604397adab03bb8b5fd75c [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:20:37.451874  7468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 94430.3us
I20260709 13:20:37.469245  6800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c44c4849aa54f2b94d1f1bef9ed546f" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:37.440973 11909 raft_consensus.cc:697] T b3f13b31a1f84f0d89d007eadd57924c P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 13 LEADER]: Becoming Leader. State: Replica: 7ba59cc884714e8aa5f3f0ecaed84cbb, State: Running, Role: LEADER
I20260709 13:20:37.433527 11846 raft_consensus.cc:515] T c4db81d9d329422bb3b4160ca4ac2d1d P b7ab4784c7344b939bc36f639286f377 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:37.481953  6805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44bde925b2e541b69890d70715b85176" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:37.488441  6805 raft_consensus.cc:2393] T 44bde925b2e541b69890d70715b85176 P b7ab4784c7344b939bc36f639286f377 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c in current term 15: Already voted for candidate b7ab4784c7344b939bc36f639286f377 in this term.
I20260709 13:20:37.507792  6875 raft_consensus.cc:2468] T 24ee15416e3145beaa1b8183453729a3 P cd75a17ab2604397adab03bb8b5fd75c [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in term 18.
W20260709 13:20:37.510461  7468 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:37.487957 12059 log.cc:927] Time spent T f4b8bd455d5a47c18a1380839c6e0d61 P b7ab4784c7344b939bc36f639286f377: Append to log took a long time: real 0.098s	user 0.000s	sys 0.001s
I20260709 13:20:37.478657 11946 raft_consensus.cc:2749] T 2c240553ce044eedb41541d72b9475d7 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:20:37.526727  6772 leader_election.cc:304] T ab432e62819d499eaaf3dd55481dd930 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:20:37.528183  6805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a75bfe094d4bdc963aba3f08dfcd25" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:37.494881 11710 leader_election.cc:290] T 1bf4668eeb70467fb3dc5a0289233b3c P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 14 election: Requested vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:37.470320 12047 raft_consensus.cc:515] T 4f00a2e87e56452083b759f60d461ee3 P cd75a17ab2604397adab03bb8b5fd75c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:20:37.539104  6772 leader_election.cc:304] T a3022224cc81473690653a83d4e99470 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
W20260709 13:20:37.540652  6847 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:37.545902  6695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 106111us
I20260709 13:20:37.549113  6695 leader_election.cc:304] T bd6869f07b5a4885a0b99fbe60c3b175 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
I20260709 13:20:37.550271  6805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab432e62819d499eaaf3dd55481dd930" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:37.527251 11793 leader_election.cc:290] T c4db81d9d329422bb3b4160ca4ac2d1d P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:37.551970  6695 leader_election.cc:304] T 8c7f33e544204fbaac4078e3e83bbf4e P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
I20260709 13:20:37.554683  6695 leader_election.cc:304] T 7887766dc6784fcaa42b35c05fea7a99 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
I20260709 13:20:37.555845  6872 raft_consensus.cc:2468] T 4f00a2e87e56452083b759f60d461ee3 P cd75a17ab2604397adab03bb8b5fd75c [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in term 15.
I20260709 13:20:37.537907 11954 raft_consensus.cc:2804] T ab432e62819d499eaaf3dd55481dd930 P b7ab4784c7344b939bc36f639286f377 [term 16 FOLLOWER]: Leader pre-election won for term 17
W20260709 13:20:37.567773  6845 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:37.568179  6805 raft_consensus.cc:2468] T ab432e62819d499eaaf3dd55481dd930 P b7ab4784c7344b939bc36f639286f377 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 16.
W20260709 13:20:37.569540  6697 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 62973.4us
I20260709 13:20:37.564425  6772 leader_election.cc:304] T f03d0dbf16864ca4bc1bb5e4c0334c0f P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
W20260709 13:20:37.558624 12057 log.cc:927] Time spent T e77e330a82df4b43a745d57a68f6f057 P cd75a17ab2604397adab03bb8b5fd75c: Append to log took a long time: real 0.130s	user 0.002s	sys 0.000s
I20260709 13:20:37.548679 12043 raft_consensus.cc:493] T 9b3759de40694069b13c0f8bd40e5709 P cd75a17ab2604397adab03bb8b5fd75c [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:20:37.575628  6697 leader_election.cc:304] T 427c124d773f483294511e80fe340075 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:20:37.555773 11946 raft_consensus.cc:2804] T bd6869f07b5a4885a0b99fbe60c3b175 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:20:37.577509  6800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a734b5ab7834e05a8c422208acc58b1" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 15 candidate_status { last_received { term: 13 index: 5 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:37.579174  6800 raft_consensus.cc:2393] T 7a734b5ab7834e05a8c422208acc58b1 P b7ab4784c7344b939bc36f639286f377 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c in current term 15: Already voted for candidate b7ab4784c7344b939bc36f639286f377 in this term.
I20260709 13:20:37.563146 12037 raft_consensus.cc:2804] T a3022224cc81473690653a83d4e99470 P b7ab4784c7344b939bc36f639286f377 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:20:37.596889  6697 leader_election.cc:304] T f4b8bd455d5a47c18a1380839c6e0d61 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377
I20260709 13:20:37.582684 11909 consensus_queue.cc:237] T b3f13b31a1f84f0d89d007eadd57924c P 7ba59cc884714e8aa5f3f0ecaed84cbb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:20:37.586843  6874 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53406 (request call id 2435) took 1107 ms. Trace:
W20260709 13:20:37.596669  6846 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:37.567232 11793 raft_consensus.cc:2804] T 7887766dc6784fcaa42b35c05fea7a99 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:20:37.558669 11710 raft_consensus.cc:2804] T 8c7f33e544204fbaac4078e3e83bbf4e P ccd8a4c3bfe3413cb2ae219b09aea832 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:20:37.598346  6772 leader_election.cc:304] T 7a734b5ab7834e05a8c422208acc58b1 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:20:37.568817 11954 raft_consensus.cc:493] T ab432e62819d499eaaf3dd55481dd930 P b7ab4784c7344b939bc36f639286f377 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:37.601524 12072 raft_consensus.cc:2749] T 427c124d773f483294511e80fe340075 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:20:37.605020 11954 raft_consensus.cc:3060] T ab432e62819d499eaaf3dd55481dd930 P b7ab4784c7344b939bc36f639286f377 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:37.598237  6874 rpcz_store.cc:276] 0709 13:20:36.479195 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:36.553813 (+ 74618us) service_pool.cc:224] Handling call
0709 13:20:36.554234 (+   421us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:36.554777 (+   543us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:20:36.842787 (+288010us) log.cc:844] Serialized 14 byte log entry
0709 13:20:37.389416 (+546629us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:20:37.406637 (+ 17221us) log.cc:844] Serialized 26 byte log entry
0709 13:20:37.406831 (+   194us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:20:37.406862 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:37.406936 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:37.586521 (+179585us) raft_consensus.cc:1685] finished
0709 13:20:37.586551 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:37.586760 (+   209us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":16234,"prepare.run_cpu_time_us":31,"prepare.run_wall_time_us":32,"raft.queue_time_us":358,"raft.run_cpu_time_us":297,"raft.run_wall_time_us":22467,"spinlock_wait_cycles":60288,"thread_start_us":824559,"threads_started":2,"wal-append.queue_time_us":707946}
I20260709 13:20:37.586735 11911 raft_consensus.cc:2804] T f03d0dbf16864ca4bc1bb5e4c0334c0f P b7ab4784c7344b939bc36f639286f377 [term 14 FOLLOWER]: Leader election won for term 14
W20260709 13:20:37.607992 12061 log.cc:927] Time spent T 34f36d59d88f40fe8a2805e604fc6c0a P cd75a17ab2604397adab03bb8b5fd75c: Append to log took a long time: real 0.096s	user 0.000s	sys 0.001s
W20260709 13:20:37.608026 12060 log.cc:927] Time spent T de3186201e1a40d0b335eeb8b4e256e0 P b7ab4784c7344b939bc36f639286f377: Append to log took a long time: real 0.058s	user 0.000s	sys 0.001s
I20260709 13:20:37.603529 12043 raft_consensus.cc:515] T 9b3759de40694069b13c0f8bd40e5709 P cd75a17ab2604397adab03bb8b5fd75c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:37.608474  6876 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53406 (request call id 2434) took 1129 ms. Trace:
I20260709 13:20:37.630623 12043 leader_election.cc:290] T 9b3759de40694069b13c0f8bd40e5709 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:20:37.599958 11668 leader_election.cc:290] T 427c124d773f483294511e80fe340075 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 14 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:37.600289 11937 leader_election.cc:290] T 90d42e216d9741e190bca19a781291fd P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:20:37.631791  6877 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53406 (request call id 2439) took 1116 ms. Trace:
I20260709 13:20:37.600654 11946 raft_consensus.cc:697] T bd6869f07b5a4885a0b99fbe60c3b175 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 16 LEADER]: Becoming Leader. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
I20260709 13:20:37.632262  6877 rpcz_store.cc:276] 0709 13:20:36.515317 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:36.813005 (+297688us) service_pool.cc:224] Handling call
0709 13:20:36.813418 (+   413us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:36.813989 (+   571us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:36.814023 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:20:36.814599 (+   576us) log.cc:844] Serialized 26 byte log entry
0709 13:20:37.338943 (+524344us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:20:37.339004 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:37.339099 (+    95us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:37.631541 (+292442us) raft_consensus.cc:1685] finished
0709 13:20:37.631575 (+    34us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:37.631726 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":9676,"raft.run_cpu_time_us":126,"raft.run_wall_time_us":126,"thread_start_us":523808,"threads_started":1,"wal-append.queue_time_us":635310}
I20260709 13:20:37.633143 11946 consensus_queue.cc:237] T bd6869f07b5a4885a0b99fbe60c3b175 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 14.7, Last appended by leader: 7, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:37.638074  7503 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50742 (request call id 474) took 1069 ms. Trace:
I20260709 13:20:37.638584  7503 rpcz_store.cc:276] 0709 13:20:36.569357 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:36.580125 (+ 10768us) service_pool.cc:224] Handling call
0709 13:20:37.637788 (+1057663us) spinlock_profiling.cc:243] Waited 676 ms on lock 0x7b54005b1b54. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f9ae2fa 00007fcc1496fb17 00007fcc0deea6d4 00007fcc0deea662 00007fcc0deea591 00007fcc0deea50c 00007fcc0dee97c2 00007fcc0dce548c 00007fcc0dce48c6 00007fcc0dce426f
0709 13:20:37.637971 (+   183us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1555886848}
W20260709 13:20:37.641332  6697 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 44553.1us
I20260709 13:20:37.617076 11666 raft_consensus.cc:2804] T 7a734b5ab7834e05a8c422208acc58b1 P b7ab4784c7344b939bc36f639286f377 [term 15 FOLLOWER]: Leader election won for term 15
W20260709 13:20:37.633186  6773 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:37.642791 11666 raft_consensus.cc:697] T 7a734b5ab7834e05a8c422208acc58b1 P b7ab4784c7344b939bc36f639286f377 [term 15 LEADER]: Becoming Leader. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
I20260709 13:20:37.617854  6772 leader_election.cc:304] T 713b5728a197487c9300b310ab94e5a3 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:20:37.644415 11666 consensus_queue.cc:237] T 7a734b5ab7834e05a8c422208acc58b1 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 13.6, Last appended by leader: 6, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } attrs { replace: true } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: NON_VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: true } }
I20260709 13:20:37.645687 11899 raft_consensus.cc:2804] T 713b5728a197487c9300b310ab94e5a3 P b7ab4784c7344b939bc36f639286f377 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:20:37.597450 12037 raft_consensus.cc:493] T a3022224cc81473690653a83d4e99470 P b7ab4784c7344b939bc36f639286f377 [term 15 FOLLOWER]: Starting leader election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:20:37.646368 12037 raft_consensus.cc:3060] T a3022224cc81473690653a83d4e99470 P b7ab4784c7344b939bc36f639286f377 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:37.649165  6802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "427c124d773f483294511e80fe340075" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:20:37.649770  6802 raft_consensus.cc:3060] T 427c124d773f483294511e80fe340075 P b7ab4784c7344b939bc36f639286f377 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:37.651271  6804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1528ab62b6fe4e3099d08f141afee116" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:37.651877  6804 raft_consensus.cc:2468] T 1528ab62b6fe4e3099d08f141afee116 P b7ab4784c7344b939bc36f639286f377 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in term 11.
I20260709 13:20:37.618985 11567 leader_election.cc:290] T 20f6842e26174571996b8dea4151d4be P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 16 election: Requested vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:37.622090 12047 leader_election.cc:290] T 4f00a2e87e56452083b759f60d461ee3 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:20:37.622617 11911 raft_consensus.cc:697] T f03d0dbf16864ca4bc1bb5e4c0334c0f P b7ab4784c7344b939bc36f639286f377 [term 14 LEADER]: Becoming Leader. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
I20260709 13:20:37.655514 11911 consensus_queue.cc:237] T f03d0dbf16864ca4bc1bb5e4c0334c0f P b7ab4784c7344b939bc36f639286f377 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:37.623579 11878 leader_election.cc:290] T 1528ab62b6fe4e3099d08f141afee116 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:20:37.656837  7466 leader_election.cc:304] T 1528ab62b6fe4e3099d08f141afee116 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
I20260709 13:20:37.625100  7502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f00a2e87e56452083b759f60d461ee3" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
W20260709 13:20:37.613166 12064 log.cc:927] Time spent T 7ba5dac66ab5497e9e336f2a3c28cda5 P cd75a17ab2604397adab03bb8b5fd75c: Append to log took a long time: real 0.130s	user 0.000s	sys 0.001s
I20260709 13:20:37.658692  7502 raft_consensus.cc:2468] T 4f00a2e87e56452083b759f60d461ee3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 15.
I20260709 13:20:37.642668  6879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "427c124d773f483294511e80fe340075" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:37.630422  6876 rpcz_store.cc:276] 0709 13:20:36.478933 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:36.553810 (+ 74877us) service_pool.cc:224] Handling call
0709 13:20:36.554234 (+   424us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:36.555453 (+  1219us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:20:36.861488 (+306035us) log.cc:844] Serialized 14 byte log entry
0709 13:20:37.447196 (+585708us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:20:37.457272 (+ 10076us) log.cc:844] Serialized 26 byte log entry
0709 13:20:37.457514 (+   242us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:20:37.457579 (+    65us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:37.457692 (+   113us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:37.608201 (+150509us) raft_consensus.cc:1685] finished
0709 13:20:37.608225 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:37.608402 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":863,"prepare.queue_time_us":15790,"prepare.run_cpu_time_us":32,"prepare.run_wall_time_us":32,"raft.queue_time_us":17673,"raft.run_cpu_time_us":276,"raft.run_wall_time_us":8933,"spinlock_wait_cycles":22656,"thread_start_us":654047,"threads_started":2,"wal-append.queue_time_us":484067}
W20260709 13:20:37.663780  6846 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:37.642678  6697 leader_election.cc:304] T 9b3759de40694069b13c0f8bd40e5709 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:20:37.608997  6873 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53406 (request call id 2438) took 1129 ms. Trace:
I20260709 13:20:37.664409  6802 raft_consensus.cc:2468] T 427c124d773f483294511e80fe340075 P b7ab4784c7344b939bc36f639286f377 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in term 14.
I20260709 13:20:37.670362  6725 raft_consensus.cc:1240] T dbdf895bba214ff68685a24fd17dfb5d P ccd8a4c3bfe3413cb2ae219b09aea832 [term 13 FOLLOWER]: Rejecting Update request from peer cd75a17ab2604397adab03bb8b5fd75c for earlier term 12. Current term is 13. Ops: [12.5-12.5]
I20260709 13:20:37.671512  6725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4275cf08e63345f993bce8664eada830" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:37.676447  6844 leader_election.cc:400] T 8c7f33e544204fbaac4078e3e83bbf4e P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 12 pre-election: Vote denied by peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391) with higher term. Message: Invalid argument: T 8c7f33e544204fbaac4078e3e83bbf4e P ccd8a4c3bfe3413cb2ae219b09aea832 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c for earlier term 12. Current term is 13.
I20260709 13:20:37.677016  6844 leader_election.cc:403] T 8c7f33e544204fbaac4078e3e83bbf4e P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 12 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:20:37.679232  6800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c7f33e544204fbaac4078e3e83bbf4e" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:37.680449  6800 raft_consensus.cc:2368] T 8c7f33e544204fbaac4078e3e83bbf4e P b7ab4784c7344b939bc36f639286f377 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c for earlier term 12. Current term is 13.
I20260709 13:20:37.681666  6879 raft_consensus.cc:2468] T 427c124d773f483294511e80fe340075 P cd75a17ab2604397adab03bb8b5fd75c [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in term 13.
I20260709 13:20:37.665076  6873 rpcz_store.cc:276] 0709 13:20:36.479994 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:36.573314 (+ 93320us) service_pool.cc:224] Handling call
0709 13:20:36.573663 (+   349us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:36.574242 (+   579us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:20:36.574272 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:20:36.574859 (+   587us) log.cc:844] Serialized 26 byte log entry
0709 13:20:37.161986 (+587127us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:20:37.162046 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:37.162135 (+    89us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:37.608726 (+446591us) raft_consensus.cc:1685] finished
0709 13:20:37.608747 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:37.608933 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1363,"raft.run_cpu_time_us":103,"raft.run_wall_time_us":104,"thread_start_us":542976,"threads_started":1,"wal-append.queue_time_us":782765}
I20260709 13:20:37.667595  6730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30e88460611e47b2ba16a46a30b5f416" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 14 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:37.690573 11994 raft_consensus.cc:515] T e31b9971c15848dea59d4d4130141d9e P ccd8a4c3bfe3413cb2ae219b09aea832 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:37.657985 11668 raft_consensus.cc:2804] T 1528ab62b6fe4e3099d08f141afee116 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:20:37.692705 12072 raft_consensus.cc:2749] T 9b3759de40694069b13c0f8bd40e5709 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:20:37.692728  6731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24ee15416e3145beaa1b8183453729a3" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:37.695019  6731 raft_consensus.cc:2393] T 24ee15416e3145beaa1b8183453729a3 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c in current term 18: Already voted for candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in this term.
I20260709 13:20:37.678494 11710 raft_consensus.cc:697] T 8c7f33e544204fbaac4078e3e83bbf4e P ccd8a4c3bfe3413cb2ae219b09aea832 [term 13 LEADER]: Becoming Leader. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
I20260709 13:20:37.699663 11710 consensus_queue.cc:237] T 8c7f33e544204fbaac4078e3e83bbf4e P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
W20260709 13:20:37.701082 12011 consensus_meta.cc:287] T 3a485a995abc4807b6e511e45419f737 P ccd8a4c3bfe3413cb2ae219b09aea832: Time spent flushing consensus metadata: real 0.585s	user 0.014s	sys 0.000s
I20260709 13:20:37.704684  6727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c37d41cd9164c15a6826ca62a851a69" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
W20260709 13:20:37.710505  6697 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 67914.4us
I20260709 13:20:37.711730  6697 leader_election.cc:304] T 853ac0a8cbd64ce99457f170216d4d0f P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:20:37.626657 11781 leader_election.cc:290] T a1704639a875409b9959353527b3fd68 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
W20260709 13:20:37.715591  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 44504.3us
I20260709 13:20:37.620852 11846 leader_election.cc:290] T c4db81d9d329422bb3b4160ca4ac2d1d P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:37.717547  6800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d65025eea89441290d85dd053810e31" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:37.661254 11793 raft_consensus.cc:697] T 7887766dc6784fcaa42b35c05fea7a99 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 16 LEADER]: Becoming Leader. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
I20260709 13:20:37.719835  6731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d33d5ee8ef6f415593d8df52063161ad" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:37.720533  6724 raft_consensus.cc:1240] T 20f6842e26174571996b8dea4151d4be P ccd8a4c3bfe3413cb2ae219b09aea832 [term 16 FOLLOWER]: Rejecting Update request from peer b7ab4784c7344b939bc36f639286f377 for earlier term 15. Current term is 16. Ops: []
I20260709 13:20:37.733541  7495 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50742 (request call id 475) took 1141 ms. Trace:
I20260709 13:20:37.735239  6800 raft_consensus.cc:2468] T 3d65025eea89441290d85dd053810e31 P b7ab4784c7344b939bc36f639286f377 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 14.
I20260709 13:20:37.675719 11567 raft_consensus.cc:493] T ce4f062dcd314d43a63ca74067cb5ee3 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:20:37.747053  6723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f58dc08b12a2494bb9a1372837970ca2" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:37.626302 11954 raft_consensus.cc:515] T ab432e62819d499eaaf3dd55481dd930 P b7ab4784c7344b939bc36f639286f377 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:37.751699  6798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1528ab62b6fe4e3099d08f141afee116" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:37.754611  6799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f03d0dbf16864ca4bc1bb5e4c0334c0f" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:20:37.717918 12047 raft_consensus.cc:3060] T 8c7f33e544204fbaac4078e3e83bbf4e P cd75a17ab2604397adab03bb8b5fd75c [term 11 FOLLOWER]: Advancing to term 13
I20260709 13:20:37.734097  7495 rpcz_store.cc:276] 0709 13:20:36.592433 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:36.592986 (+   553us) service_pool.cc:224] Handling call
0709 13:20:37.733335 (+1140349us) spinlock_profiling.cc:243] Waited 699 ms on lock 0x7b54005a0354. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f9ae2fa 00007fcc1496fb17 00007fcc0deea6d4 00007fcc0deea662 00007fcc0deea591 00007fcc0deea50c 00007fcc0dee97c2 00007fcc0dce548c 00007fcc0dce48c6 00007fcc0dce426f
0709 13:20:37.733467 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1607148800}
I20260709 13:20:37.707374 11668 raft_consensus.cc:493] T 1528ab62b6fe4e3099d08f141afee116 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:37.760999  6802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be1a92657f494cac8dd227d152f50151" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:37.761555  6798 raft_consensus.cc:2393] T 1528ab62b6fe4e3099d08f141afee116 P b7ab4784c7344b939bc36f639286f377 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ccd8a4c3bfe3413cb2ae219b09aea832 in current term 11: Already voted for candidate b7ab4784c7344b939bc36f639286f377 in this term.
I20260709 13:20:37.761018  6804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17587d6730594da4a56fa13a353232a1" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:37.742741  6729 raft_consensus.cc:2468] T 3a485a995abc4807b6e511e45419f737 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 14.
I20260709 13:20:37.750238  6803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f9c2e2bf644115957398fe4c9459db" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
W20260709 13:20:37.763326  6697 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 51744.1us
I20260709 13:20:37.763648  6803 raft_consensus.cc:2393] T f3f9c2e2bf644115957398fe4c9459db P b7ab4784c7344b939bc36f639286f377 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate ccd8a4c3bfe3413cb2ae219b09aea832 in current term 14: Already voted for candidate b7ab4784c7344b939bc36f639286f377 in this term.
I20260709 13:20:37.764081  6697 leader_election.cc:304] T 34f36d59d88f40fe8a2805e604fc6c0a P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377
I20260709 13:20:37.765419  6805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbdf895bba214ff68685a24fd17dfb5d" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 14 candidate_status { last_received { term: 10 index: 4 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:37.766428  6805 raft_consensus.cc:2410] T dbdf895bba214ff68685a24fd17dfb5d P b7ab4784c7344b939bc36f639286f377 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ccd8a4c3bfe3413cb2ae219b09aea832 for term 14 because replica has last-logged OpId of term: 12 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 4.
I20260709 13:20:37.766757  6799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8292e16e5654be6bc408560cf256aaa" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
W20260709 13:20:37.772895  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 53266.2us
I20260709 13:20:37.775034  6801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1704639a875409b9959353527b3fd68" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:37.775233  6731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "711ef6523deb4cbe8ef2ba61e1c21c98" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:37.781165  6697 leader_election.cc:304] T 90d42e216d9741e190bca19a781291fd P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
W20260709 13:20:37.773602 11955 consensus_meta.cc:287] T 7a734b5ab7834e05a8c422208acc58b1 P 7ba59cc884714e8aa5f3f0ecaed84cbb: Time spent flushing consensus metadata: real 0.600s	user 0.013s	sys 0.003s
I20260709 13:20:37.765622 11947 raft_consensus.cc:2804] T f4b8bd455d5a47c18a1380839c6e0d61 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:20:37.763512 11668 raft_consensus.cc:3060] T 1528ab62b6fe4e3099d08f141afee116 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:20:37.763181 11781 raft_consensus.cc:493] T 853ac0a8cbd64ce99457f170216d4d0f P cd75a17ab2604397adab03bb8b5fd75c [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:20:37.784940  6723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3411566abe2d4c9bb4b2adfdd05e6f17" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:37.789279  6799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3022224cc81473690653a83d4e99470" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:37.774832 11634 raft_consensus.cc:2804] T 34f36d59d88f40fe8a2805e604fc6c0a P ccd8a4c3bfe3413cb2ae219b09aea832 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:20:37.786965 11899 raft_consensus.cc:697] T 713b5728a197487c9300b310ab94e5a3 P b7ab4784c7344b939bc36f639286f377 [term 14 LEADER]: Becoming Leader. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
I20260709 13:20:37.798061  6800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d65025eea89441290d85dd053810e31" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:20:37.798695  6800 raft_consensus.cc:3060] T 3d65025eea89441290d85dd053810e31 P b7ab4784c7344b939bc36f639286f377 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:37.794430  6697 leader_election.cc:304] T b56bf91d90824c959e21e0cee5ba1816 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377
I20260709 13:20:37.796134  6732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e326172347f45e99a0d482b5d8ef768" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:37.796924  6844 leader_election.cc:304] T 7a734b5ab7834e05a8c422208acc58b1 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:20:37.799335  6730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22ccee1b570c4ad3a57bd7aec085b1b4" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:37.792220  6723 raft_consensus.cc:2468] T 3411566abe2d4c9bb4b2adfdd05e6f17 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 12.
I20260709 13:20:37.800125  6730 raft_consensus.cc:2468] T 22ccee1b570c4ad3a57bd7aec085b1b4 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 12.
I20260709 13:20:37.802035  6731 raft_consensus.cc:2468] T 711ef6523deb4cbe8ef2ba61e1c21c98 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 16.
I20260709 13:20:37.807277  6799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c44c4849aa54f2b94d1f1bef9ed546f" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:20:37.790831 12011 raft_consensus.cc:2749] T 90d42e216d9741e190bca19a781291fd P ccd8a4c3bfe3413cb2ae219b09aea832 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:20:37.811079  6772 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 165790us
I20260709 13:20:37.737912 11793 consensus_queue.cc:237] T 7887766dc6784fcaa42b35c05fea7a99 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.8, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:37.795446 11634 raft_consensus.cc:493] T 34f36d59d88f40fe8a2805e604fc6c0a P ccd8a4c3bfe3413cb2ae219b09aea832 [term 12 FOLLOWER]: Starting leader election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:20:37.806329 12043 raft_consensus.cc:2764] T 7a734b5ab7834e05a8c422208acc58b1 P cd75a17ab2604397adab03bb8b5fd75c [term 15 FOLLOWER]: Leader pre-election decision vote started in defunct term 14: won
W20260709 13:20:37.803323 12070 log.cc:927] Time spent T ce4f062dcd314d43a63ca74067cb5ee3 P 7ba59cc884714e8aa5f3f0ecaed84cbb: Append to log took a long time: real 0.116s	user 0.002s	sys 0.000s
I20260709 13:20:37.828590  5625 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:20:37.829842  7500 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50744 (request call id 405) took 1099 ms. Trace:
I20260709 13:20:37.799129 11781 raft_consensus.cc:515] T 853ac0a8cbd64ce99457f170216d4d0f P cd75a17ab2604397adab03bb8b5fd75c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:37.830305  7500 rpcz_store.cc:276] 0709 13:20:36.730306 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:36.730482 (+   176us) service_pool.cc:224] Handling call
0709 13:20:36.738623 (+  8141us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:36.832243 (+ 93620us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:20:37.361560 (+529317us) log.cc:844] Serialized 14 byte log entry
0709 13:20:37.560481 (+198921us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:20:37.575094 (+ 14613us) log.cc:844] Serialized 26 byte log entry
0709 13:20:37.575257 (+   163us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:20:37.575290 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:37.575383 (+    93us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:37.829617 (+254234us) raft_consensus.cc:1685] finished
0709 13:20:37.829642 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:37.829778 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":621516,"prepare.run_cpu_time_us":80,"prepare.run_wall_time_us":2287,"raft.queue_time_us":42318,"raft.run_cpu_time_us":436,"raft.run_wall_time_us":22409,"thread_start_us":687092,"threads_started":2,"wal-append.queue_time_us":312358}
I20260709 13:20:37.817282  6730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "427c124d773f483294511e80fe340075" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:20:37.832559  6730 raft_consensus.cc:3060] T 427c124d773f483294511e80fe340075 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:37.832667 11781 leader_election.cc:290] T 853ac0a8cbd64ce99457f170216d4d0f P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:20:37.836524  6802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bf4668eeb70467fb3dc5a0289233b3c" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:20:37.785730 11567 raft_consensus.cc:515] T ce4f062dcd314d43a63ca74067cb5ee3 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } attrs { replace: true } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:20:37.840161 11994 leader_election.cc:290] T e31b9971c15848dea59d4d4130141d9e P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 12 election: Requested vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:37.840564 11567 leader_election.cc:290] T ce4f062dcd314d43a63ca74067cb5ee3 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:20:37.821604 12063 raft_consensus.cc:2749] T 853ac0a8cbd64ce99457f170216d4d0f P ccd8a4c3bfe3413cb2ae219b09aea832 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:20:37.822139 11990 raft_consensus.cc:2804] T b56bf91d90824c959e21e0cee5ba1816 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:20:37.820282 11634 raft_consensus.cc:3060] T 34f36d59d88f40fe8a2805e604fc6c0a P ccd8a4c3bfe3413cb2ae219b09aea832 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:37.825057 11954 leader_election.cc:290] T ab432e62819d499eaaf3dd55481dd930 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 17 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:37.827050 12079 consensus_queue.cc:1048] T 4f00a2e87e56452083b759f60d461ee3 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:20:37.836858 11955 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.StartTabletCopy from 127.0.0.1:50744 (request call id 395) took 4247 ms. Trace:
I20260709 13:20:37.818748  6799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ba5dac66ab5497e9e336f2a3c28cda5" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:37.840632  6723 raft_consensus.cc:1275] T 3fa34c08b205435dba97346991aa1f92 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 17 FOLLOWER]: Refusing update from remote peer 7ba59cc884714e8aa5f3f0ecaed84cbb: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 13:20:37.849651  6844 leader_election.cc:304] T f03d0dbf16864ca4bc1bb5e4c0334c0f P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:20:37.862634  6802 raft_consensus.cc:1240] T f09c2a98de1a4decabd0ff900dd44caa P b7ab4784c7344b939bc36f639286f377 [term 16 LEADER]: Rejecting Update request from peer cd75a17ab2604397adab03bb8b5fd75c for earlier term 15. Current term is 16. Ops: []
W20260709 13:20:37.863693  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 43863.3us
I20260709 13:20:37.868402  6801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4db81d9d329422bb3b4160ca4ac2d1d" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
W20260709 13:20:37.868839  6772 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 56476.7us
I20260709 13:20:37.869657  6801 raft_consensus.cc:2468] T c4db81d9d329422bb3b4160ca4ac2d1d P b7ab4784c7344b939bc36f639286f377 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 13.
I20260709 13:20:37.872679  6799 raft_consensus.cc:2468] T 7ba5dac66ab5497e9e336f2a3c28cda5 P b7ab4784c7344b939bc36f639286f377 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 14.
I20260709 13:20:37.874756  6799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20f6842e26174571996b8dea4151d4be" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:20:37.884344  6846 leader_election.cc:304] T 4f00a2e87e56452083b759f60d461ee3 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:20:37.885264 11781 raft_consensus.cc:2804] T 4f00a2e87e56452083b759f60d461ee3 P cd75a17ab2604397adab03bb8b5fd75c [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:20:37.885643 11781 raft_consensus.cc:493] T 4f00a2e87e56452083b759f60d461ee3 P cd75a17ab2604397adab03bb8b5fd75c [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:37.885982 11781 raft_consensus.cc:3060] T 4f00a2e87e56452083b759f60d461ee3 P cd75a17ab2604397adab03bb8b5fd75c [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:37.840870 11576 consensus_queue.cc:1059] T f3f9c2e2bf644115957398fe4c9459db P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.023s
I20260709 13:20:37.865952 12043 raft_consensus.cc:2764] T f03d0dbf16864ca4bc1bb5e4c0334c0f P cd75a17ab2604397adab03bb8b5fd75c [term 14 FOLLOWER]: Leader election decision vote started in defunct term 13: won
I20260709 13:20:37.889798  6729 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50004 (request call id 2436) took 1009 ms. Trace:
I20260709 13:20:37.890309  6729 rpcz_store.cc:276] 0709 13:20:36.880381 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:36.882150 (+  1769us) service_pool.cc:224] Handling call
0709 13:20:37.889584 (+1007434us) spinlock_profiling.cc:243] Waited 778 ms on lock 0x7b5400407254. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f9ae2fa 00007fcc1496fb17 00007fcc0deea6d4 00007fcc0deea662 00007fcc0deea591 00007fcc0deea50c 00007fcc0dee97c2 00007fcc0dce548c 00007fcc0dce48c6 00007fcc0dce426f
0709 13:20:37.889723 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1788531456}
I20260709 13:20:37.891511 11990 raft_consensus.cc:697] T b56bf91d90824c959e21e0cee5ba1816 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 14 LEADER]: Becoming Leader. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
I20260709 13:20:37.891716 11774 consensus_queue.cc:1048] T 3fa34c08b205435dba97346991aa1f92 P 7ba59cc884714e8aa5f3f0ecaed84cbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:20:37.892740 11990 consensus_queue.cc:237] T b56bf91d90824c959e21e0cee5ba1816 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:37.896581  6697 leader_election.cc:304] T ab432e62819d499eaaf3dd55481dd930 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:20:37.897938 11636 raft_consensus.cc:2749] T ab432e62819d499eaaf3dd55481dd930 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:20:37.900213  6697 leader_election.cc:304] T bb3d8792045a4583ae2e965b1350a5b4 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:20:37.901180  6804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4db81d9d329422bb3b4160ca4ac2d1d" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:37.901456 11567 raft_consensus.cc:2804] T bb3d8792045a4583ae2e965b1350a5b4 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:20:37.901830  6802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "713b5728a197487c9300b310ab94e5a3" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:20:37.901994  6804 raft_consensus.cc:2468] T c4db81d9d329422bb3b4160ca4ac2d1d P b7ab4784c7344b939bc36f639286f377 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 13.
I20260709 13:20:37.903250  6697 leader_election.cc:304] T f09c2a98de1a4decabd0ff900dd44caa P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:20:37.903316  6804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30e88460611e47b2ba16a46a30b5f416" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 14 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:37.904855  6806 raft_consensus.cc:1240] T f3f9c2e2bf644115957398fe4c9459db P b7ab4784c7344b939bc36f639286f377 [term 14 FOLLOWER]: Rejecting Update request from peer cd75a17ab2604397adab03bb8b5fd75c for earlier term 13. Current term is 14. Ops: [13.9-13.9]
I20260709 13:20:37.905450 12011 raft_consensus.cc:2749] T f09c2a98de1a4decabd0ff900dd44caa P ccd8a4c3bfe3413cb2ae219b09aea832 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:20:37.905876  6806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d33d5ee8ef6f415593d8df52063161ad" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:37.906770  6697 leader_election.cc:304] T 4b8cacb381b746da8d0049b0a83b41dd P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:20:37.907045  6806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c37d41cd9164c15a6826ca62a851a69" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:37.907312  6807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce4f062dcd314d43a63ca74067cb5ee3" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 16 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:37.857178 11955 rpcz_store.cc:276] 0709 13:20:33.602891 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:33.628202 (+ 25311us) service_pool.cc:224] Handling call
0709 13:20:34.374005 (+745803us) ts_tablet_manager.cc:934] T 7a734b5ab7834e05a8c422208acc58b1 P 7ba59cc884714e8aa5f3f0ecaed84cbb: Initiating tablet copy from peer b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
0709 13:20:36.632488 (+2258483us) tablet_copy_client.cc:368] Tablet copy session begun
0709 13:20:37.165618 (+533130us) tablet_metadata.cc:665] Metadata flushed
0709 13:20:37.165787 (+   169us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 13:20:37.801215 (+635428us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 13:20:37.836165 (+ 34950us) tablet_replica.cc:206] Creating consensus instance
0709 13:20:37.836612 (+   447us) ts_tablet_manager.cc:989] Replica registered.
0709 13:20:37.836745 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":102280,"tablet-copy.queue_time_us":744656,"thread_start_us":832573,"threads_started":2}
I20260709 13:20:37.909024 12011 raft_consensus.cc:2804] T 4b8cacb381b746da8d0049b0a83b41dd P ccd8a4c3bfe3413cb2ae219b09aea832 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:20:37.909472 11955 tablet_copy_client.cc:806] T 7a734b5ab7834e05a8c422208acc58b1 P 7ba59cc884714e8aa5f3f0ecaed84cbb: tablet copy: Starting download of 0 data blocks...
I20260709 13:20:37.909495 12011 raft_consensus.cc:493] T 4b8cacb381b746da8d0049b0a83b41dd P ccd8a4c3bfe3413cb2ae219b09aea832 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 7ba59cc884714e8aa5f3f0ecaed84cbb)
I20260709 13:20:37.910480 12011 raft_consensus.cc:3060] T 4b8cacb381b746da8d0049b0a83b41dd P ccd8a4c3bfe3413cb2ae219b09aea832 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:37.910686 11955 tablet_copy_client.cc:670] T 7a734b5ab7834e05a8c422208acc58b1 P 7ba59cc884714e8aa5f3f0ecaed84cbb: tablet copy: Starting download of 1 WAL segments...
I20260709 13:20:37.912995  6802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e31b9971c15848dea59d4d4130141d9e" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
W20260709 13:20:37.914042 12074 log.cc:927] Time spent T 00000000000000000000000000000000 P b3ae52d33b9a4273a42e5e2cf3b5d6b5: Append to log took a long time: real 0.098s	user 0.000s	sys 0.001s
I20260709 13:20:37.914466  6802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f58dc08b12a2494bb9a1372837970ca2" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:37.902071 11567 raft_consensus.cc:697] T bb3d8792045a4583ae2e965b1350a5b4 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 13 LEADER]: Becoming Leader. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
I20260709 13:20:37.917647  6730 raft_consensus.cc:2468] T 427c124d773f483294511e80fe340075 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in term 14.
I20260709 13:20:37.914714  6804 raft_consensus.cc:2410] T 30e88460611e47b2ba16a46a30b5f416 P b7ab4784c7344b939bc36f639286f377 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c for term 14 because replica has last-logged OpId of term: 13 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 5.
I20260709 13:20:37.915714  6802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce4f062dcd314d43a63ca74067cb5ee3" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
W20260709 13:20:37.922013  6772 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 52302.4us
I20260709 13:20:37.928318 11567 consensus_queue.cc:237] T bb3d8792045a4583ae2e965b1350a5b4 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:20:37.930447  6695 leader_election.cc:304] T c4db81d9d329422bb3b4160ca4ac2d1d P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
I20260709 13:20:37.930676 11955 tablet_copy_client.cc:538] T 7a734b5ab7834e05a8c422208acc58b1 P 7ba59cc884714e8aa5f3f0ecaed84cbb: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:20:37.932377  6806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ba5dac66ab5497e9e336f2a3c28cda5" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:20:37.933131  6806 raft_consensus.cc:3060] T 7ba5dac66ab5497e9e336f2a3c28cda5 P b7ab4784c7344b939bc36f639286f377 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:20:37.934684  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 65970.9us
I20260709 13:20:37.935817  6799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20f6842e26174571996b8dea4151d4be" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:37.943764  6802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3411566abe2d4c9bb4b2adfdd05e6f17" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:37.948848  6804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4275cf08e63345f993bce8664eada830" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:37.953742  6801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "427c124d773f483294511e80fe340075" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:20:37.951741  6844 leader_election.cc:304] T 3fa34c08b205435dba97346991aa1f92 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:20:37.954531  6801 raft_consensus.cc:2368] T 427c124d773f483294511e80fe340075 P b7ab4784c7344b939bc36f639286f377 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c for earlier term 13. Current term is 14.
I20260709 13:20:37.955317  6801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "711ef6523deb4cbe8ef2ba61e1c21c98" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:37.957041  6807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8cee0accdb8499c86d4414b72565a38" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:37.906929 11668 raft_consensus.cc:515] T 1528ab62b6fe4e3099d08f141afee116 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 12 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:20:37.964404  6801 raft_consensus.cc:2468] T 711ef6523deb4cbe8ef2ba61e1c21c98 P b7ab4784c7344b939bc36f639286f377 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 16.
I20260709 13:20:37.963346  6800 raft_consensus.cc:2468] T 3d65025eea89441290d85dd053810e31 P b7ab4784c7344b939bc36f639286f377 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 15.
I20260709 13:20:37.965526  6801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e326172347f45e99a0d482b5d8ef768" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:37.948189 11946 raft_consensus.cc:2804] T c4db81d9d329422bb3b4160ca4ac2d1d P ccd8a4c3bfe3413cb2ae219b09aea832 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:20:37.966985  6695 leader_election.cc:304] T 3d65025eea89441290d85dd053810e31 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
I20260709 13:20:37.973362  6697 leader_election.cc:304] T d33d5ee8ef6f415593d8df52063161ad P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377
W20260709 13:20:37.988452  6772 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 52813.6us
I20260709 13:20:37.991281  6807 raft_consensus.cc:1275] T f5be3a11b23d4ea9b08300a2789821c7 P b7ab4784c7344b939bc36f639286f377 [term 14 FOLLOWER]: Refusing update from remote peer ccd8a4c3bfe3413cb2ae219b09aea832: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:20:37.971454 11946 raft_consensus.cc:493] T c4db81d9d329422bb3b4160ca4ac2d1d P ccd8a4c3bfe3413cb2ae219b09aea832 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:37.996239  6844 leader_election.cc:304] T 24ee15416e3145beaa1b8183453729a3 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:20:37.976281 11937 raft_consensus.cc:2749] T 3fa34c08b205435dba97346991aa1f92 P cd75a17ab2604397adab03bb8b5fd75c [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:20:38.003086  6697 leader_election.cc:304] T 44bde925b2e541b69890d70715b85176 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377
I20260709 13:20:37.979254 11990 raft_consensus.cc:2804] T d33d5ee8ef6f415593d8df52063161ad P ccd8a4c3bfe3413cb2ae219b09aea832 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:20:37.989169 11994 raft_consensus.cc:2804] T 3d65025eea89441290d85dd053810e31 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:20:38.006937  6804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22ccee1b570c4ad3a57bd7aec085b1b4" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:37.998108 11946 raft_consensus.cc:3060] T c4db81d9d329422bb3b4160ca4ac2d1d P ccd8a4c3bfe3413cb2ae219b09aea832 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:37.951727 11899 consensus_queue.cc:237] T 713b5728a197487c9300b310ab94e5a3 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:38.047653  7500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be1a92657f494cac8dd227d152f50151" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:20:38.048149  7495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17587d6730594da4a56fa13a353232a1" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:20:38.040514 11567 raft_consensus.cc:2804] T 44bde925b2e541b69890d70715b85176 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:20:38.050765 11567 raft_consensus.cc:697] T 44bde925b2e541b69890d70715b85176 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 15 LEADER]: Becoming Leader. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
I20260709 13:20:38.052577  6730 raft_consensus.cc:1275] T b3f13b31a1f84f0d89d007eadd57924c P ccd8a4c3bfe3413cb2ae219b09aea832 [term 13 FOLLOWER]: Refusing update from remote peer 7ba59cc884714e8aa5f3f0ecaed84cbb: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 13:20:38.006879 11990 raft_consensus.cc:493] T d33d5ee8ef6f415593d8df52063161ad P ccd8a4c3bfe3413cb2ae219b09aea832 [term 12 FOLLOWER]: Starting leader election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:20:38.056494 11990 raft_consensus.cc:3060] T d33d5ee8ef6f415593d8df52063161ad P ccd8a4c3bfe3413cb2ae219b09aea832 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:38.043126 11994 raft_consensus.cc:697] T 3d65025eea89441290d85dd053810e31 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 15 LEADER]: Becoming Leader. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
I20260709 13:20:38.058022 11994 consensus_queue.cc:237] T 3d65025eea89441290d85dd053810e31 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 13.7, Last appended by leader: 7, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:38.062876  6806 raft_consensus.cc:2468] T 7ba5dac66ab5497e9e336f2a3c28cda5 P b7ab4784c7344b939bc36f639286f377 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 15.
I20260709 13:20:38.063977  6807 raft_consensus.cc:1275] T 7ba5dac66ab5497e9e336f2a3c28cda5 P b7ab4784c7344b939bc36f639286f377 [term 15 FOLLOWER]: Refusing update from remote peer cd75a17ab2604397adab03bb8b5fd75c: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:20:37.978694 12085 consensus_queue.cc:1048] T f09c2a98de1a4decabd0ff900dd44caa P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.067s
I20260709 13:20:38.063977  6844 leader_election.cc:304] T 3411566abe2d4c9bb4b2adfdd05e6f17 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:20:38.091602  6844 leader_election.cc:304] T 711ef6523deb4cbe8ef2ba61e1c21c98 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:20:38.049489 12086 raft_consensus.cc:2749] T 24ee15416e3145beaa1b8183453729a3 P cd75a17ab2604397adab03bb8b5fd75c [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:20:38.101541  6844 leader_election.cc:304] T 22ccee1b570c4ad3a57bd7aec085b1b4 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:20:38.065428 11576 raft_consensus.cc:493] T f4b8bd455d5a47c18a1380839c6e0d61 P cd75a17ab2604397adab03bb8b5fd75c [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:20:38.039479 11781 raft_consensus.cc:515] T 4f00a2e87e56452083b759f60d461ee3 P cd75a17ab2604397adab03bb8b5fd75c [term 16 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:20:38.105932  7500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce4f062dcd314d43a63ca74067cb5ee3" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:20:38.031852 12037 raft_consensus.cc:515] T a3022224cc81473690653a83d4e99470 P b7ab4784c7344b939bc36f639286f377 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:38.108793 12097 raft_consensus.cc:2804] T 711ef6523deb4cbe8ef2ba61e1c21c98 P cd75a17ab2604397adab03bb8b5fd75c [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:20:38.109326 12097 raft_consensus.cc:493] T 711ef6523deb4cbe8ef2ba61e1c21c98 P cd75a17ab2604397adab03bb8b5fd75c [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:38.109715 12097 raft_consensus.cc:3060] T 711ef6523deb4cbe8ef2ba61e1c21c98 P cd75a17ab2604397adab03bb8b5fd75c [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:38.110682 12037 leader_election.cc:290] T a3022224cc81473690653a83d4e99470 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 16 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:38.114084 11781 leader_election.cc:290] T 4f00a2e87e56452083b759f60d461ee3 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 16 election: Requested vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:20:38.115108 11781 raft_consensus.cc:2804] T 22ccee1b570c4ad3a57bd7aec085b1b4 P cd75a17ab2604397adab03bb8b5fd75c [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:20:38.115504 11781 raft_consensus.cc:493] T 22ccee1b570c4ad3a57bd7aec085b1b4 P cd75a17ab2604397adab03bb8b5fd75c [term 12 FOLLOWER]: Starting leader election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
W20260709 13:20:38.107282  6695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 72628.2us
I20260709 13:20:38.116359  6800 raft_consensus.cc:1240] T a3022224cc81473690653a83d4e99470 P b7ab4784c7344b939bc36f639286f377 [term 16 FOLLOWER]: Rejecting Update request from peer ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 15. Current term is 16. Ops: []
W20260709 13:20:38.118531  6772 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 122903us
I20260709 13:20:38.119475  7495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1528ab62b6fe4e3099d08f141afee116" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:20:38.120301  7495 raft_consensus.cc:2368] T 1528ab62b6fe4e3099d08f141afee116 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 11. Current term is 12.
I20260709 13:20:38.051761 11567 consensus_queue.cc:237] T 44bde925b2e541b69890d70715b85176 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:38.123020  6697 leader_election.cc:304] T fe20b4b48823486ca3b9c648db6ce8aa P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:20:38.101800 11937 raft_consensus.cc:2804] T 3411566abe2d4c9bb4b2adfdd05e6f17 P cd75a17ab2604397adab03bb8b5fd75c [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:20:38.125717  6697 leader_election.cc:400] T 427c124d773f483294511e80fe340075 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 13 election: Vote denied by peer 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071) with higher term. Message: Invalid argument: T 427c124d773f483294511e80fe340075 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 13. Current term is 14.
I20260709 13:20:38.127091  6723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1528ab62b6fe4e3099d08f141afee116" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:20:38.127789  6723 raft_consensus.cc:3060] T 1528ab62b6fe4e3099d08f141afee116 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 10 FOLLOWER]: Advancing to term 12
W20260709 13:20:38.132288 12091 log.cc:927] Time spent T b56bf91d90824c959e21e0cee5ba1816 P ccd8a4c3bfe3413cb2ae219b09aea832: Append to log took a long time: real 0.143s	user 0.001s	sys 0.000s
W20260709 13:20:38.133862 12087 log.cc:927] Time spent T de3186201e1a40d0b335eeb8b4e256e0 P ccd8a4c3bfe3413cb2ae219b09aea832: Append to log took a long time: real 0.095s	user 0.000s	sys 0.000s
I20260709 13:20:38.125212  6730 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "22ccee1b570c4ad3a57bd7aec085b1b4"
dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
mode: GRACEFUL
new_leader_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
 from {username='slave'} at 127.0.0.1:38536
I20260709 13:20:38.138773  6730 raft_consensus.cc:606] T 22ccee1b570c4ad3a57bd7aec085b1b4 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 12 FOLLOWER]: Received request to transfer leadership to TS cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:20:38.139036 11951 raft_consensus.cc:493] T 7c37d41cd9164c15a6826ca62a851a69 P b7ab4784c7344b939bc36f639286f377 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:20:38.126956 12082 raft_consensus.cc:2749] T fe20b4b48823486ca3b9c648db6ce8aa P ccd8a4c3bfe3413cb2ae219b09aea832 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:20:38.139948 11668 leader_election.cc:290] T 1528ab62b6fe4e3099d08f141afee116 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 12 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:20:38.128434 11937 raft_consensus.cc:493] T 3411566abe2d4c9bb4b2adfdd05e6f17 P cd75a17ab2604397adab03bb8b5fd75c [term 12 FOLLOWER]: Starting leader election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:20:38.125468 11710 consensus_queue.cc:1048] T f5be3a11b23d4ea9b08300a2789821c7 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.018s
I20260709 13:20:38.141430 11937 raft_consensus.cc:3060] T 3411566abe2d4c9bb4b2adfdd05e6f17 P cd75a17ab2604397adab03bb8b5fd75c [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:38.142412 11946 raft_consensus.cc:515] T c4db81d9d329422bb3b4160ca4ac2d1d P ccd8a4c3bfe3413cb2ae219b09aea832 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:38.144135 12043 raft_consensus.cc:3055] T f3f9c2e2bf644115957398fe4c9459db P cd75a17ab2604397adab03bb8b5fd75c [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:20:38.144610 12043 raft_consensus.cc:740] T f3f9c2e2bf644115957398fe4c9459db P cd75a17ab2604397adab03bb8b5fd75c [term 13 LEADER]: Becoming Follower/Learner. State: Replica: cd75a17ab2604397adab03bb8b5fd75c, State: Running, Role: LEADER
I20260709 13:20:38.145512 12043 consensus_queue.cc:260] T f3f9c2e2bf644115957398fe4c9459db P cd75a17ab2604397adab03bb8b5fd75c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
W20260709 13:20:38.147822  6616 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet ce4f062dcd314d43a63ca74067cb5ee3 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER failed with leader 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 7ba59cc884714e8aa5f3f0ecaed84cbb is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 15 leader_uuid: "b7ab4784c7344b939bc36f639286f377" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } attrs { replace: true } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } } }
I20260709 13:20:38.153141 11955 tablet_bootstrap.cc:492] T 7a734b5ab7834e05a8c422208acc58b1 P 7ba59cc884714e8aa5f3f0ecaed84cbb: Bootstrap starting.
I20260709 13:20:38.158401  6732 raft_consensus.cc:1240] T e31b9971c15848dea59d4d4130141d9e P ccd8a4c3bfe3413cb2ae219b09aea832 [term 12 FOLLOWER]: Rejecting Update request from peer b7ab4784c7344b939bc36f639286f377 for earlier term 11. Current term is 12. Ops: []
I20260709 13:20:38.160082  6727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1528ab62b6fe4e3099d08f141afee116" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:38.161497 11946 leader_election.cc:290] T c4db81d9d329422bb3b4160ca4ac2d1d P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 14 election: Requested vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:38.152799 11634 raft_consensus.cc:515] T 34f36d59d88f40fe8a2805e604fc6c0a P ccd8a4c3bfe3413cb2ae219b09aea832 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:38.155514 12011 raft_consensus.cc:515] T 4b8cacb381b746da8d0049b0a83b41dd P ccd8a4c3bfe3413cb2ae219b09aea832 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:20:38.173200  6725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c240553ce044eedb41541d72b9475d7" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:38.174127  6725 raft_consensus.cc:2468] T 2c240553ce044eedb41541d72b9475d7 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 16.
I20260709 13:20:38.175992 12047 raft_consensus.cc:2749] T 8c7f33e544204fbaac4078e3e83bbf4e P cd75a17ab2604397adab03bb8b5fd75c [term 13 FOLLOWER]: Leader pre-election lost for term 12. Reason: Vote denied by peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391) with higher term. Message: Invalid argument: T 8c7f33e544204fbaac4078e3e83bbf4e P ccd8a4c3bfe3413cb2ae219b09aea832 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c for earlier term 12. Current term is 13.
I20260709 13:20:38.177163 11634 leader_election.cc:290] T 34f36d59d88f40fe8a2805e604fc6c0a P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 13 election: Requested vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:38.116168 11576 raft_consensus.cc:515] T f4b8bd455d5a47c18a1380839c6e0d61 P cd75a17ab2604397adab03bb8b5fd75c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:38.180778 12011 leader_election.cc:290] T 4b8cacb381b746da8d0049b0a83b41dd P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 15 election: Requested vote from peers cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:20:38.181579 11947 raft_consensus.cc:493] T f4b8bd455d5a47c18a1380839c6e0d61 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 14 FOLLOWER]: Starting leader election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:20:38.182206 11947 raft_consensus.cc:3060] T f4b8bd455d5a47c18a1380839c6e0d61 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:20:38.183025  6772 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 55365.8us
I20260709 13:20:38.116007 11781 raft_consensus.cc:3060] T 22ccee1b570c4ad3a57bd7aec085b1b4 P cd75a17ab2604397adab03bb8b5fd75c [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:38.139261  6730 raft_consensus.cc:614] T 22ccee1b570c4ad3a57bd7aec085b1b4 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 12 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:20:38.191640  6873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c240553ce044eedb41541d72b9475d7" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:38.194252  6727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab432e62819d499eaaf3dd55481dd930" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:20:38.195061  6727 raft_consensus.cc:3060] T ab432e62819d499eaaf3dd55481dd930 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:20:38.233731  6773 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:38.232201  6873 raft_consensus.cc:2468] T 2c240553ce044eedb41541d72b9475d7 P cd75a17ab2604397adab03bb8b5fd75c [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 15.
W20260709 13:20:38.231772  6697 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.68:45071, user_credentials={real_user=slave}} blocked reactor thread for 106162us
W20260709 13:20:38.237437  6770 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 235845us
I20260709 13:20:38.238970  6697 leader_election.cc:304] T be1a92657f494cac8dd227d152f50151 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, b7ab4784c7344b939bc36f639286f377
I20260709 13:20:38.232605  6725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4db81d9d329422bb3b4160ca4ac2d1d" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
W20260709 13:20:38.240831  7466 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 48006.8us
I20260709 13:20:38.242460  7466 leader_election.cc:304] T 427c124d773f483294511e80fe340075 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
I20260709 13:20:38.244234  6875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab432e62819d499eaaf3dd55481dd930" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:20:38.244915  6875 raft_consensus.cc:3060] T ab432e62819d499eaaf3dd55481dd930 P cd75a17ab2604397adab03bb8b5fd75c [term 15 FOLLOWER]: Advancing to term 17
I20260709 13:20:38.244803  6697 leader_election.cc:304] T 17587d6730594da4a56fa13a353232a1 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, b7ab4784c7344b939bc36f639286f377
I20260709 13:20:38.246618  6873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3022224cc81473690653a83d4e99470" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:20:38.247251  6873 raft_consensus.cc:3060] T a3022224cc81473690653a83d4e99470 P cd75a17ab2604397adab03bb8b5fd75c [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:38.248272  6725 raft_consensus.cc:2393] T c4db81d9d329422bb3b4160ca4ac2d1d P ccd8a4c3bfe3413cb2ae219b09aea832 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7ab4784c7344b939bc36f639286f377 in current term 14: Already voted for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in this term.
I20260709 13:20:38.250802  6874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4db81d9d329422bb3b4160ca4ac2d1d" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:38.251377  6874 raft_consensus.cc:2468] T c4db81d9d329422bb3b4160ca4ac2d1d P cd75a17ab2604397adab03bb8b5fd75c [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 12.
I20260709 13:20:38.259653  6697 leader_election.cc:400] T 1528ab62b6fe4e3099d08f141afee116 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 11 pre-election: Vote denied by peer 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071) with higher term. Message: Invalid argument: T 1528ab62b6fe4e3099d08f141afee116 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 11. Current term is 12.
I20260709 13:20:38.260164  6697 leader_election.cc:403] T 1528ab62b6fe4e3099d08f141afee116 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 11 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:20:38.261389  6770 leader_election.cc:304] T 44bde925b2e541b69890d70715b85176 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:20:38.273355  6697 leader_election.cc:304] T ce4f062dcd314d43a63ca74067cb5ee3 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, b7ab4784c7344b939bc36f639286f377
I20260709 13:20:38.273959  6806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4db81d9d329422bb3b4160ca4ac2d1d" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:20:38.274632  6806 raft_consensus.cc:3060] T c4db81d9d329422bb3b4160ca4ac2d1d P b7ab4784c7344b939bc36f639286f377 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:38.274755  7495 raft_consensus.cc:1275] T 4f00a2e87e56452083b759f60d461ee3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 15 FOLLOWER]: Refusing update from remote peer b7ab4784c7344b939bc36f639286f377: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:20:38.277158  7502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1528ab62b6fe4e3099d08f141afee116" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:20:38.278019  7502 raft_consensus.cc:2393] T 1528ab62b6fe4e3099d08f141afee116 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7ab4784c7344b939bc36f639286f377 in current term 12: Already voted for candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in this term.
I20260709 13:20:38.280342  6879 raft_consensus.cc:1240] T 4f00a2e87e56452083b759f60d461ee3 P cd75a17ab2604397adab03bb8b5fd75c [term 16 FOLLOWER]: Rejecting Update request from peer b7ab4784c7344b939bc36f639286f377 for earlier term 15. Current term is 16. Ops: [15.11-15.11]
I20260709 13:20:38.283784  6872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c7f33e544204fbaac4078e3e83bbf4e" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:20:38.289050  6727 raft_consensus.cc:2468] T ab432e62819d499eaaf3dd55481dd930 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 17.
I20260709 13:20:38.139883 11951 raft_consensus.cc:515] T 7c37d41cd9164c15a6826ca62a851a69 P b7ab4784c7344b939bc36f639286f377 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:38.295456  6877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3411566abe2d4c9bb4b2adfdd05e6f17" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:38.298964  7503 raft_consensus.cc:1240] T b3f13b31a1f84f0d89d007eadd57924c P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 13 LEADER]: Rejecting Update request from peer b7ab4784c7344b939bc36f639286f377 for earlier term 12. Current term is 13. Ops: []
I20260709 13:20:38.256699 12043 raft_consensus.cc:3060] T f3f9c2e2bf644115957398fe4c9459db P cd75a17ab2604397adab03bb8b5fd75c [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:38.254551 11774 raft_consensus.cc:2804] T 427c124d773f483294511e80fe340075 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:20:38.303005  6806 raft_consensus.cc:2468] T c4db81d9d329422bb3b4160ca4ac2d1d P b7ab4784c7344b939bc36f639286f377 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 14.
I20260709 13:20:38.299141  6874 raft_consensus.cc:1275] T de3186201e1a40d0b335eeb8b4e256e0 P cd75a17ab2604397adab03bb8b5fd75c [term 16 FOLLOWER]: Refusing update from remote peer ccd8a4c3bfe3413cb2ae219b09aea832: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 13:20:38.311333  6881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d65025eea89441290d85dd053810e31" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:38.309037  6804 raft_consensus.cc:1275] T 8c7f33e544204fbaac4078e3e83bbf4e P b7ab4784c7344b939bc36f639286f377 [term 13 FOLLOWER]: Refusing update from remote peer ccd8a4c3bfe3413cb2ae219b09aea832: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:20:38.297569  6798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34f36d59d88f40fe8a2805e604fc6c0a" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:20:38.312160  6881 raft_consensus.cc:2468] T 3d65025eea89441290d85dd053810e31 P cd75a17ab2604397adab03bb8b5fd75c [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 14.
W20260709 13:20:38.314435  6770 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 53143.4us
I20260709 13:20:38.315327  6770 leader_election.cc:304] T 7887766dc6784fcaa42b35c05fea7a99 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:20:38.256223 12095 raft_consensus.cc:2749] T be1a92657f494cac8dd227d152f50151 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:20:38.318528  6876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6869f07b5a4885a0b99fbe60c3b175" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:20:38.319423  6876 raft_consensus.cc:3060] T bd6869f07b5a4885a0b99fbe60c3b175 P cd75a17ab2604397adab03bb8b5fd75c [term 14 FOLLOWER]: Advancing to term 16
I20260709 13:20:38.273837 12047 raft_consensus.cc:493] T e77e330a82df4b43a745d57a68f6f057 P cd75a17ab2604397adab03bb8b5fd75c [term 16 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:20:38.276789 12072 raft_consensus.cc:2749] T 17587d6730594da4a56fa13a353232a1 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:20:38.321604  6874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1704639a875409b9959353527b3fd68" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:38.322259  6879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7887766dc6784fcaa42b35c05fea7a99" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:20:38.292882 11634 raft_consensus.cc:2749] T ce4f062dcd314d43a63ca74067cb5ee3 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:20:38.325628  6879 raft_consensus.cc:3060] T 7887766dc6784fcaa42b35c05fea7a99 P cd75a17ab2604397adab03bb8b5fd75c [term 14 FOLLOWER]: Advancing to term 16
I20260709 13:20:38.339732  6881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d65025eea89441290d85dd053810e31" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:20:38.340656  6881 raft_consensus.cc:3060] T 3d65025eea89441290d85dd053810e31 P cd75a17ab2604397adab03bb8b5fd75c [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:38.341382  6877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bf4668eeb70467fb3dc5a0289233b3c" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:20:38.342119  6877 raft_consensus.cc:3060] T 1bf4668eeb70467fb3dc5a0289233b3c P cd75a17ab2604397adab03bb8b5fd75c [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:38.345151  6875 raft_consensus.cc:2468] T ab432e62819d499eaaf3dd55481dd930 P cd75a17ab2604397adab03bb8b5fd75c [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 17.
I20260709 13:20:38.348775  6772 leader_election.cc:304] T 2c240553ce044eedb41541d72b9475d7 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:20:38.364549  6872 raft_consensus.cc:2468] T 8c7f33e544204fbaac4078e3e83bbf4e P cd75a17ab2604397adab03bb8b5fd75c [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 13.
I20260709 13:20:38.366370  6872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20f6842e26174571996b8dea4151d4be" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:20:38.368443  6872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce4f062dcd314d43a63ca74067cb5ee3" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:38.369750  6874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e31b9971c15848dea59d4d4130141d9e" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
W20260709 13:20:38.373457  6770 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 58253.3us
I20260709 13:20:38.377295  6875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c44c4849aa54f2b94d1f1bef9ed546f" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:20:38.378939  6723 raft_consensus.cc:2468] T 1528ab62b6fe4e3099d08f141afee116 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in term 12.
I20260709 13:20:38.323566 11870 raft_consensus.cc:2749] T 44bde925b2e541b69890d70715b85176 P b7ab4784c7344b939bc36f639286f377 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:20:38.327282 11774 raft_consensus.cc:697] T 427c124d773f483294511e80fe340075 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 14 LEADER]: Becoming Leader. State: Replica: 7ba59cc884714e8aa5f3f0ecaed84cbb, State: Running, Role: LEADER
I20260709 13:20:38.390973  6772 leader_election.cc:304] T c4db81d9d329422bb3b4160ca4ac2d1d P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:20:38.392777  6872 raft_consensus.cc:2468] T ce4f062dcd314d43a63ca74067cb5ee3 P cd75a17ab2604397adab03bb8b5fd75c [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 15.
I20260709 13:20:38.314348 11990 raft_consensus.cc:515] T d33d5ee8ef6f415593d8df52063161ad P ccd8a4c3bfe3413cb2ae219b09aea832 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:38.353063 11576 leader_election.cc:290] T f4b8bd455d5a47c18a1380839c6e0d61 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:20:38.395380  6872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4db81d9d329422bb3b4160ca4ac2d1d" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:38.397277  6872 raft_consensus.cc:2468] T c4db81d9d329422bb3b4160ca4ac2d1d P cd75a17ab2604397adab03bb8b5fd75c [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 12.
I20260709 13:20:38.384958  6878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f9c2e2bf644115957398fe4c9459db" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:20:38.399171  6872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbdf895bba214ff68685a24fd17dfb5d" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 14 candidate_status { last_received { term: 10 index: 4 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:38.390033 11954 raft_consensus.cc:2749] T 7887766dc6784fcaa42b35c05fea7a99 P b7ab4784c7344b939bc36f639286f377 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:20:38.401278  6874 raft_consensus.cc:1275] T 4d9def8b32fd443aa94ab1420b06837b P cd75a17ab2604397adab03bb8b5fd75c [term 15 FOLLOWER]: Refusing update from remote peer ccd8a4c3bfe3413cb2ae219b09aea832: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 13:20:38.402403 11774 consensus_queue.cc:237] T 427c124d773f483294511e80fe340075 P 7ba59cc884714e8aa5f3f0ecaed84cbb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.9, Last appended by leader: 9, Current term: 14, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } attrs { replace: true } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:20:38.403180 11947 raft_consensus.cc:515] T f4b8bd455d5a47c18a1380839c6e0d61 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:38.335362 12047 raft_consensus.cc:515] T e77e330a82df4b43a745d57a68f6f057 P cd75a17ab2604397adab03bb8b5fd75c [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } }
W20260709 13:20:38.409502  6695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 101439us
I20260709 13:20:38.397384 12098 raft_consensus.cc:2804] T 2c240553ce044eedb41541d72b9475d7 P b7ab4784c7344b939bc36f639286f377 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:20:38.411785 11752 consensus_queue.cc:1059] T b3f13b31a1f84f0d89d007eadd57924c P b7ab4784c7344b939bc36f639286f377 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:20:38.349442 11937 raft_consensus.cc:515] T 3411566abe2d4c9bb4b2adfdd05e6f17 P cd75a17ab2604397adab03bb8b5fd75c [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:38.413240  6875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4db81d9d329422bb3b4160ca4ac2d1d" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:20:38.497306  6875 raft_consensus.cc:3060] T c4db81d9d329422bb3b4160ca4ac2d1d P cd75a17ab2604397adab03bb8b5fd75c [term 12 FOLLOWER]: Advancing to term 14
I20260709 13:20:38.422160  6723 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "713b5728a197487c9300b310ab94e5a3"
dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
mode: GRACEFUL
new_leader_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
 from {username='slave'} at 127.0.0.1:38536
I20260709 13:20:38.424409  7503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f00a2e87e56452083b759f60d461ee3" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb"
I20260709 13:20:38.499032  7503 raft_consensus.cc:3060] T 4f00a2e87e56452083b759f60d461ee3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:38.500023  6723 raft_consensus.cc:606] T 713b5728a197487c9300b310ab94e5a3 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 14 FOLLOWER]: Received request to transfer leadership to TS cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:20:38.500535  6723 raft_consensus.cc:614] T 713b5728a197487c9300b310ab94e5a3 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 14 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:20:38.424749  6879 raft_consensus.cc:2468] T 7887766dc6784fcaa42b35c05fea7a99 P cd75a17ab2604397adab03bb8b5fd75c [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 16.
I20260709 13:20:38.426136 11951 leader_election.cc:290] T 7c37d41cd9164c15a6826ca62a851a69 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
W20260709 13:20:38.427335 12109 log.cc:927] Time spent T ce4f062dcd314d43a63ca74067cb5ee3 P b7ab4784c7344b939bc36f639286f377: Append to log took a long time: real 0.091s	user 0.000s	sys 0.000s
I20260709 13:20:38.437335 11846 raft_consensus.cc:2764] T c4db81d9d329422bb3b4160ca4ac2d1d P b7ab4784c7344b939bc36f639286f377 [term 14 FOLLOWER]: Leader pre-election decision vote started in defunct term 13: won
I20260709 13:20:38.428076  6873 raft_consensus.cc:2468] T a3022224cc81473690653a83d4e99470 P cd75a17ab2604397adab03bb8b5fd75c [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 16.
I20260709 13:20:38.430802 11781 raft_consensus.cc:515] T 22ccee1b570c4ad3a57bd7aec085b1b4 P cd75a17ab2604397adab03bb8b5fd75c [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:38.434018  6881 raft_consensus.cc:2468] T 3d65025eea89441290d85dd053810e31 P cd75a17ab2604397adab03bb8b5fd75c [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 15.
I20260709 13:20:38.394321 11793 raft_consensus.cc:2749] T 1528ab62b6fe4e3099d08f141afee116 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 12 FOLLOWER]: Leader pre-election lost for term 11. Reason: Vote denied by peer 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071) with higher term. Message: Invalid argument: T 1528ab62b6fe4e3099d08f141afee116 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 11. Current term is 12.
I20260709 13:20:38.518338 11781 leader_election.cc:290] T 22ccee1b570c4ad3a57bd7aec085b1b4 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 13 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:20:38.438423  6770 leader_election.cc:304] T b56bf91d90824c959e21e0cee5ba1816 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:20:38.440506  6876 raft_consensus.cc:2468] T bd6869f07b5a4885a0b99fbe60c3b175 P cd75a17ab2604397adab03bb8b5fd75c [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 16.
I20260709 13:20:38.521700  6880 raft_consensus.cc:1240] T 22ccee1b570c4ad3a57bd7aec085b1b4 P cd75a17ab2604397adab03bb8b5fd75c [term 13 FOLLOWER]: Rejecting Update request from peer b7ab4784c7344b939bc36f639286f377 for earlier term 12. Current term is 13. Ops: []
I20260709 13:20:38.410992  6872 raft_consensus.cc:2410] T dbdf895bba214ff68685a24fd17dfb5d P cd75a17ab2604397adab03bb8b5fd75c [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ccd8a4c3bfe3413cb2ae219b09aea832 for term 14 because replica has last-logged OpId of term: 12 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 4.
I20260709 13:20:38.491362  6874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34f36d59d88f40fe8a2805e604fc6c0a" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
W20260709 13:20:38.491220  6772 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 52807.6us
I20260709 13:20:38.491328  6877 raft_consensus.cc:2468] T 1bf4668eeb70467fb3dc5a0289233b3c P cd75a17ab2604397adab03bb8b5fd75c [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 14.
I20260709 13:20:38.443327 11954 consensus_queue.cc:1048] T f09c2a98de1a4decabd0ff900dd44caa P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.060s
I20260709 13:20:38.431941 12097 raft_consensus.cc:515] T 711ef6523deb4cbe8ef2ba61e1c21c98 P cd75a17ab2604397adab03bb8b5fd75c [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:38.444614 12098 raft_consensus.cc:493] T 2c240553ce044eedb41541d72b9475d7 P b7ab4784c7344b939bc36f639286f377 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:38.505326 11752 raft_consensus.cc:3055] T b3f13b31a1f84f0d89d007eadd57924c P b7ab4784c7344b939bc36f639286f377 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:20:38.531509  6879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b8cacb381b746da8d0049b0a83b41dd" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:20:38.551210  6874 raft_consensus.cc:1275] T bd6869f07b5a4885a0b99fbe60c3b175 P cd75a17ab2604397adab03bb8b5fd75c [term 16 FOLLOWER]: Refusing update from remote peer ccd8a4c3bfe3413cb2ae219b09aea832: Log matching property violated. Preceding OpId in replica: term: 14 index: 7. Preceding OpId from leader: term: 16 index: 8. (index mismatch)
I20260709 13:20:38.546579  6875 raft_consensus.cc:2468] T c4db81d9d329422bb3b4160ca4ac2d1d P cd75a17ab2604397adab03bb8b5fd75c [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 14.
W20260709 13:20:38.541126  6770 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 102803us
I20260709 13:20:38.554021  6770 leader_election.cc:304] T f3f9c2e2bf644115957398fe4c9459db P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:20:38.555140 11899 raft_consensus.cc:2749] T f3f9c2e2bf644115957398fe4c9459db P b7ab4784c7344b939bc36f639286f377 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:20:38.556322 11951 consensus_queue.cc:1059] T 4f00a2e87e56452083b759f60d461ee3 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: INVALID_TERM, Last received: 14.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:20:38.557344 11951 raft_consensus.cc:3055] T 4f00a2e87e56452083b759f60d461ee3 P b7ab4784c7344b939bc36f639286f377 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:20:38.557700 11951 raft_consensus.cc:740] T 4f00a2e87e56452083b759f60d461ee3 P b7ab4784c7344b939bc36f639286f377 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
I20260709 13:20:38.558688 11951 consensus_queue.cc:260] T 4f00a2e87e56452083b759f60d461ee3 P b7ab4784c7344b939bc36f639286f377 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.11, Last appended by leader: 11, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
W20260709 13:20:38.549961 12096 log.cc:927] Time spent T 7887766dc6784fcaa42b35c05fea7a99 P ccd8a4c3bfe3413cb2ae219b09aea832: Append to log took a long time: real 0.221s	user 0.001s	sys 0.000s
W20260709 13:20:38.567849  7466 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 315464us
I20260709 13:20:38.569475  6874 raft_consensus.cc:1275] T f5be3a11b23d4ea9b08300a2789821c7 P cd75a17ab2604397adab03bb8b5fd75c [term 14 FOLLOWER]: Refusing update from remote peer ccd8a4c3bfe3413cb2ae219b09aea832: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:20:38.569787 11990 leader_election.cc:290] T d33d5ee8ef6f415593d8df52063161ad P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 13 election: Requested vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:38.573099 12047 leader_election.cc:290] T e77e330a82df4b43a745d57a68f6f057 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391)
I20260709 13:20:38.573709  7503 raft_consensus.cc:2468] T 4f00a2e87e56452083b759f60d461ee3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 16.
I20260709 13:20:38.574746 12097 leader_election.cc:290] T 711ef6523deb4cbe8ef2ba61e1c21c98 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 17 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:20:38.577312  6697 leader_election.cc:304] T 3411566abe2d4c9bb4b2adfdd05e6f17 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:20:38.582074  6697 leader_election.cc:304] T a1704639a875409b9959353527b3fd68 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:20:38.546128 12098 raft_consensus.cc:3060] T 2c240553ce044eedb41541d72b9475d7 P b7ab4784c7344b939bc36f639286f377 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:38.587464  6874 raft_consensus.cc:1275] T bb3d8792045a4583ae2e965b1350a5b4 P cd75a17ab2604397adab03bb8b5fd75c [term 13 FOLLOWER]: Refusing update from remote peer ccd8a4c3bfe3413cb2ae219b09aea832: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 13:20:38.586203  7466 leader_election.cc:304] T 1528ab62b6fe4e3099d08f141afee116 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
I20260709 13:20:38.584911  6772 leader_election.cc:304] T ab432e62819d499eaaf3dd55481dd930 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:20:38.549081 11752 raft_consensus.cc:740] T b3f13b31a1f84f0d89d007eadd57924c P b7ab4784c7344b939bc36f639286f377 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
W20260709 13:20:38.586664  6846 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:38.615038  6874 raft_consensus.cc:1275] T 8c7f33e544204fbaac4078e3e83bbf4e P cd75a17ab2604397adab03bb8b5fd75c [term 13 FOLLOWER]: Refusing update from remote peer ccd8a4c3bfe3413cb2ae219b09aea832: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:20:38.615628  6846 leader_election.cc:304] T 4f00a2e87e56452083b759f60d461ee3 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:20:38.595525  6802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4b8bd455d5a47c18a1380839c6e0d61" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:20:38.602999  6799 raft_consensus.cc:1275] T bd6869f07b5a4885a0b99fbe60c3b175 P b7ab4784c7344b939bc36f639286f377 [term 16 FOLLOWER]: Refusing update from remote peer ccd8a4c3bfe3413cb2ae219b09aea832: Log matching property violated. Preceding OpId in replica: term: 12 index: 6. Preceding OpId from leader: term: 16 index: 8. (index mismatch)
I20260709 13:20:38.617609  6697 leader_election.cc:304] T 20f6842e26174571996b8dea4151d4be P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:20:38.552623 12085 raft_consensus.cc:2749] T b56bf91d90824c959e21e0cee5ba1816 P b7ab4784c7344b939bc36f639286f377 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
W20260709 13:20:38.585507  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 484017us
I20260709 13:20:38.621692  7503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b8cacb381b746da8d0049b0a83b41dd" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb"
I20260709 13:20:38.622989  6874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce4f062dcd314d43a63ca74067cb5ee3" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:38.623543  6697 leader_election.cc:304] T 7c44c4849aa54f2b94d1f1bef9ed546f P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:20:38.624593  6772 leader_election.cc:304] T a3022224cc81473690653a83d4e99470 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:20:38.626295 12090 raft_consensus.cc:2804] T a3022224cc81473690653a83d4e99470 P b7ab4784c7344b939bc36f639286f377 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:20:38.626444  6873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24ee15416e3145beaa1b8183453729a3" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:38.626902 12090 raft_consensus.cc:697] T a3022224cc81473690653a83d4e99470 P b7ab4784c7344b939bc36f639286f377 [term 16 LEADER]: Becoming Leader. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
I20260709 13:20:38.628115 12090 consensus_queue.cc:237] T a3022224cc81473690653a83d4e99470 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:38.637449  6874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fa34c08b205435dba97346991aa1f92" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:38.640885  6804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d33d5ee8ef6f415593d8df52063161ad" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:20:38.632385  6873 raft_consensus.cc:2376] T 24ee15416e3145beaa1b8183453729a3 P cd75a17ab2604397adab03bb8b5fd75c [term 18 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in term 18. Re-sending same reply.
I20260709 13:20:38.645272  6873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "427c124d773f483294511e80fe340075" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:20:38.645363  6727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "853ac0a8cbd64ce99457f170216d4d0f" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:38.575804 11951 raft_consensus.cc:3060] T 4f00a2e87e56452083b759f60d461ee3 P b7ab4784c7344b939bc36f639286f377 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:38.645889  6873 raft_consensus.cc:3060] T 427c124d773f483294511e80fe340075 P cd75a17ab2604397adab03bb8b5fd75c [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:38.648984  6697 leader_election.cc:304] T e31b9971c15848dea59d4d4130141d9e P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:20:38.650336  6806 raft_consensus.cc:1275] T b56bf91d90824c959e21e0cee5ba1816 P b7ab4784c7344b939bc36f639286f377 [term 14 FOLLOWER]: Refusing update from remote peer ccd8a4c3bfe3413cb2ae219b09aea832: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:20:38.587196 12072 raft_consensus.cc:2749] T 3411566abe2d4c9bb4b2adfdd05e6f17 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:20:38.651417  6874 raft_consensus.cc:2393] T 3fa34c08b205435dba97346991aa1f92 P cd75a17ab2604397adab03bb8b5fd75c [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in current term 17: Already voted for candidate cd75a17ab2604397adab03bb8b5fd75c in this term.
I20260709 13:20:38.652926  6730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77e330a82df4b43a745d57a68f6f057" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:38.654446  6731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "711ef6523deb4cbe8ef2ba61e1c21c98" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:20:38.695472  6732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22ccee1b570c4ad3a57bd7aec085b1b4" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:20:38.696797  6723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b3759de40694069b13c0f8bd40e5709" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:38.697660  6723 raft_consensus.cc:2468] T 9b3759de40694069b13c0f8bd40e5709 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 11.
I20260709 13:20:38.692119  6728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4b8bd455d5a47c18a1380839c6e0d61" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:38.656507  6727 raft_consensus.cc:2393] T 853ac0a8cbd64ce99457f170216d4d0f P ccd8a4c3bfe3413cb2ae219b09aea832 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c in current term 13: Already voted for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in this term.
I20260709 13:20:38.600512 12097 raft_consensus.cc:493] T b56bf91d90824c959e21e0cee5ba1816 P cd75a17ab2604397adab03bb8b5fd75c [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:38.695709  6731 raft_consensus.cc:3060] T 711ef6523deb4cbe8ef2ba61e1c21c98 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:38.644577  6725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1704639a875409b9959353527b3fd68" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:38.702139  6729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90d42e216d9741e190bca19a781291fd" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:38.705452  6729 raft_consensus.cc:2468] T 90d42e216d9741e190bca19a781291fd P ccd8a4c3bfe3413cb2ae219b09aea832 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 14.
I20260709 13:20:38.702725  6874 raft_consensus.cc:1275] T 3fa34c08b205435dba97346991aa1f92 P cd75a17ab2604397adab03bb8b5fd75c [term 17 FOLLOWER]: Refusing update from remote peer 7ba59cc884714e8aa5f3f0ecaed84cbb: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 13:20:38.708097  6874 raft_consensus.cc:1275] T 24ee15416e3145beaa1b8183453729a3 P cd75a17ab2604397adab03bb8b5fd75c [term 18 FOLLOWER]: Refusing update from remote peer 7ba59cc884714e8aa5f3f0ecaed84cbb: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:20:38.701512 12082 raft_consensus.cc:2749] T e31b9971c15848dea59d4d4130141d9e P ccd8a4c3bfe3413cb2ae219b09aea832 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:20:38.709518 12095 consensus_queue.cc:1048] T 4d9def8b32fd443aa94ab1420b06837b P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:20:38.637692 11666 raft_consensus.cc:2804] T ab432e62819d499eaaf3dd55481dd930 P b7ab4784c7344b939bc36f639286f377 [term 17 FOLLOWER]: Leader election won for term 17
W20260709 13:20:38.652617  6844 connection.cc:256] RPC call timeout handler was delayed by -1.0571720140001162s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1502s for a response
I20260709 13:20:38.637609 12047 raft_consensus.cc:2804] T 4f00a2e87e56452083b759f60d461ee3 P cd75a17ab2604397adab03bb8b5fd75c [term 16 FOLLOWER]: Leader election won for term 16
W20260709 13:20:38.715391  6844 connection.cc:256] RPC call timeout handler was delayed by -1.001372014000026s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1564s for a response
I20260709 13:20:38.717164  6697 leader_election.cc:304] T dbdf895bba214ff68685a24fd17dfb5d P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:20:38.590337 11990 consensus_queue.cc:1048] T de3186201e1a40d0b335eeb8b4e256e0 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.102s
I20260709 13:20:38.645474 11567 raft_consensus.cc:2749] T 20f6842e26174571996b8dea4151d4be P ccd8a4c3bfe3413cb2ae219b09aea832 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
W20260709 13:20:38.718282  7468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 219583us
I20260709 13:20:38.587045 11899 consensus_queue.cc:1059] T 7c44c4849aa54f2b94d1f1bef9ed546f P b7ab4784c7344b939bc36f639286f377 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: INVALID_TERM, Last received: 15.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.109s
I20260709 13:20:38.650108 12011 raft_consensus.cc:2749] T 7c44c4849aa54f2b94d1f1bef9ed546f P ccd8a4c3bfe3413cb2ae219b09aea832 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:20:38.602749 12112 consensus_queue.cc:1048] T b3f13b31a1f84f0d89d007eadd57924c P 7ba59cc884714e8aa5f3f0ecaed84cbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.101s
I20260709 13:20:38.742444  6873 raft_consensus.cc:2468] T 427c124d773f483294511e80fe340075 P cd75a17ab2604397adab03bb8b5fd75c [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in term 14.
W20260709 13:20:38.727891  6844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:38.756469  6723 raft_consensus.cc:1240] T 4b8cacb381b746da8d0049b0a83b41dd P ccd8a4c3bfe3413cb2ae219b09aea832 [term 15 FOLLOWER]: Rejecting Update request from peer 7ba59cc884714e8aa5f3f0ecaed84cbb for earlier term 14. Current term is 15. Ops: []
I20260709 13:20:38.753613  6844 leader_election.cc:304] T 3a485a995abc4807b6e511e45419f737 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:20:38.758028  6697 leader_election.cc:304] T 1bf4668eeb70467fb3dc5a0289233b3c P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377
W20260709 13:20:38.752955  6772 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 124897us
I20260709 13:20:38.752444  7468 leader_election.cc:304] T 4f00a2e87e56452083b759f60d461ee3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377
I20260709 13:20:38.761560  6731 raft_consensus.cc:2468] T 711ef6523deb4cbe8ef2ba61e1c21c98 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 17.
I20260709 13:20:38.759214 11634 raft_consensus.cc:2749] T dbdf895bba214ff68685a24fd17dfb5d P ccd8a4c3bfe3413cb2ae219b09aea832 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:20:38.765427  6770 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 119444us
I20260709 13:20:38.767374  6770 leader_election.cc:304] T 3a485a995abc4807b6e511e45419f737 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:20:38.733736 11666 raft_consensus.cc:697] T ab432e62819d499eaaf3dd55481dd930 P b7ab4784c7344b939bc36f639286f377 [term 17 LEADER]: Becoming Leader. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
I20260709 13:20:38.759740 12047 raft_consensus.cc:697] T 4f00a2e87e56452083b759f60d461ee3 P cd75a17ab2604397adab03bb8b5fd75c [term 16 LEADER]: Becoming Leader. State: Replica: cd75a17ab2604397adab03bb8b5fd75c, State: Running, Role: LEADER
I20260709 13:20:38.725997 12097 raft_consensus.cc:515] T b56bf91d90824c959e21e0cee5ba1816 P cd75a17ab2604397adab03bb8b5fd75c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:38.764245 12086 raft_consensus.cc:3060] T 3a485a995abc4807b6e511e45419f737 P cd75a17ab2604397adab03bb8b5fd75c [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:20:38.857354  6772 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 86316.2us
I20260709 13:20:38.861608  6844 leader_election.cc:400] T f5be3a11b23d4ea9b08300a2789821c7 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 12 pre-election: Vote denied by peer b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817) with higher term. Message: Invalid argument: T f5be3a11b23d4ea9b08300a2789821c7 P b7ab4784c7344b939bc36f639286f377 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c for earlier term 12. Current term is 14.
I20260709 13:20:38.862105  6844 leader_election.cc:403] T f5be3a11b23d4ea9b08300a2789821c7 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 12 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:20:38.770112 11567 raft_consensus.cc:2804] T 1bf4668eeb70467fb3dc5a0289233b3c P ccd8a4c3bfe3413cb2ae219b09aea832 [term 14 FOLLOWER]: Leader election won for term 14
W20260709 13:20:38.863004 12088 log.cc:927] Time spent T 3fa34c08b205435dba97346991aa1f92 P ccd8a4c3bfe3413cb2ae219b09aea832: Append to log took a long time: real 0.087s	user 0.001s	sys 0.000s
W20260709 13:20:38.893255 12126 log.cc:927] Time spent T 30e88460611e47b2ba16a46a30b5f416 P cd75a17ab2604397adab03bb8b5fd75c: Append to log took a long time: real 0.060s	user 0.001s	sys 0.000s
W20260709 13:20:38.894676  6770 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 111225us
I20260709 13:20:38.891093 12114 raft_consensus.cc:2749] T a1704639a875409b9959353527b3fd68 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:20:38.892244 12100 consensus_queue.cc:1059] T 20f6842e26174571996b8dea4151d4be P b7ab4784c7344b939bc36f639286f377 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: INVALID_TERM, Last received: 15.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.200s
I20260709 13:20:38.781446  6697 leader_election.cc:304] T c4db81d9d329422bb3b4160ca4ac2d1d P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
W20260709 13:20:38.926391  6846 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.68:45071, user_credentials={real_user=slave}} blocked reactor thread for 57395.5us
W20260709 13:20:38.925839  6697 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 144507us
W20260709 13:20:38.923142  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 149695us
I20260709 13:20:38.856601 11937 leader_election.cc:290] T 3411566abe2d4c9bb4b2adfdd05e6f17 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 13 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:20:38.866278 11954 raft_consensus.cc:2804] T 3a485a995abc4807b6e511e45419f737 P b7ab4784c7344b939bc36f639286f377 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:20:38.991890 11634 raft_consensus.cc:2804] T c4db81d9d329422bb3b4160ca4ac2d1d P ccd8a4c3bfe3413cb2ae219b09aea832 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:20:38.770870 12082 consensus_queue.cc:1048] T bd6869f07b5a4885a0b99fbe60c3b175 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.154s
I20260709 13:20:38.866633 12113 raft_consensus.cc:2804] T 1528ab62b6fe4e3099d08f141afee116 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:20:38.895677 11576 raft_consensus.cc:2749] T f5be3a11b23d4ea9b08300a2789821c7 P cd75a17ab2604397adab03bb8b5fd75c [term 14 FOLLOWER]: Leader pre-election lost for term 12. Reason: Vote denied by peer b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817) with higher term. Message: Invalid argument: T f5be3a11b23d4ea9b08300a2789821c7 P b7ab4784c7344b939bc36f639286f377 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c for earlier term 12. Current term is 14.
I20260709 13:20:38.858444 11994 consensus_queue.cc:1048] T f5be3a11b23d4ea9b08300a2789821c7 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.211s
I20260709 13:20:38.925205 11567 raft_consensus.cc:697] T 1bf4668eeb70467fb3dc5a0289233b3c P ccd8a4c3bfe3413cb2ae219b09aea832 [term 14 LEADER]: Becoming Leader. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
I20260709 13:20:38.922195 12017 raft_consensus.cc:2764] T 4f00a2e87e56452083b759f60d461ee3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 16 FOLLOWER]: Leader pre-election decision vote started in defunct term 15: won
I20260709 13:20:38.879199 12078 consensus_queue.cc:1059] T 1bf4668eeb70467fb3dc5a0289233b3c P b7ab4784c7344b939bc36f639286f377 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.381s
I20260709 13:20:38.997653 11634 raft_consensus.cc:697] T c4db81d9d329422bb3b4160ca4ac2d1d P ccd8a4c3bfe3413cb2ae219b09aea832 [term 14 LEADER]: Becoming Leader. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
W20260709 13:20:39.020197  6770 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 111731us
I20260709 13:20:39.022145  6770 leader_election.cc:304] T 1528ab62b6fe4e3099d08f141afee116 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:20:39.023976  6844 leader_election.cc:304] T 2c240553ce044eedb41541d72b9475d7 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
W20260709 13:20:39.013165 12119 log.cc:927] Time spent T 44bde925b2e541b69890d70715b85176 P ccd8a4c3bfe3413cb2ae219b09aea832: Append to log took a long time: real 0.156s	user 0.001s	sys 0.000s
I20260709 13:20:39.029981 11846 consensus_queue.cc:1059] T e31b9971c15848dea59d4d4130141d9e P b7ab4784c7344b939bc36f639286f377 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:20:39.032155 11954 raft_consensus.cc:697] T 3a485a995abc4807b6e511e45419f737 P b7ab4784c7344b939bc36f639286f377 [term 14 LEADER]: Becoming Leader. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
I20260709 13:20:39.033356 11899 raft_consensus.cc:3055] T 1bf4668eeb70467fb3dc5a0289233b3c P b7ab4784c7344b939bc36f639286f377 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:20:39.032847 11634 consensus_queue.cc:237] T c4db81d9d329422bb3b4160ca4ac2d1d P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:39.040673 12100 raft_consensus.cc:3060] T 1528ab62b6fe4e3099d08f141afee116 P b7ab4784c7344b939bc36f639286f377 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:20:39.041006  6844 leader_election.cc:304] T 7c44c4849aa54f2b94d1f1bef9ed546f P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:20:39.041816 11576 raft_consensus.cc:3060] T 2c240553ce044eedb41541d72b9475d7 P cd75a17ab2604397adab03bb8b5fd75c [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:39.047452 12080 raft_consensus.cc:493] T dbdf895bba214ff68685a24fd17dfb5d P b7ab4784c7344b939bc36f639286f377 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:38.925582 11666 consensus_queue.cc:237] T ab432e62819d499eaaf3dd55481dd930 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
W20260709 13:20:39.056998  6697 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 67841us
I20260709 13:20:39.072836  6844 leader_election.cc:304] T 44bde925b2e541b69890d70715b85176 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:20:39.053509 11899 raft_consensus.cc:740] T 1bf4668eeb70467fb3dc5a0289233b3c P b7ab4784c7344b939bc36f639286f377 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
I20260709 13:20:39.097958 11899 consensus_queue.cc:260] T 1bf4668eeb70467fb3dc5a0289233b3c P b7ab4784c7344b939bc36f639286f377 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:39.077829 12082 consensus_queue.cc:1048] T bb3d8792045a4583ae2e965b1350a5b4 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 9, Time since last communication: 0.021s
I20260709 13:20:39.099763 11899 raft_consensus.cc:3060] T 1bf4668eeb70467fb3dc5a0289233b3c P b7ab4784c7344b939bc36f639286f377 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:39.073760 12080 raft_consensus.cc:515] T dbdf895bba214ff68685a24fd17dfb5d P b7ab4784c7344b939bc36f639286f377 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:39.102495 12080 leader_election.cc:290] T dbdf895bba214ff68685a24fd17dfb5d P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
W20260709 13:20:39.106077 12043 consensus_meta.cc:287] T f3f9c2e2bf644115957398fe4c9459db P cd75a17ab2604397adab03bb8b5fd75c: Time spent flushing consensus metadata: real 0.789s	user 0.011s	sys 0.002s
I20260709 13:20:39.107232 12128 raft_consensus.cc:3055] T 20f6842e26174571996b8dea4151d4be P b7ab4784c7344b939bc36f639286f377 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:20:39.107558  6878 raft_consensus.cc:2410] T f3f9c2e2bf644115957398fe4c9459db P cd75a17ab2604397adab03bb8b5fd75c [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate ccd8a4c3bfe3413cb2ae219b09aea832 for term 14 because replica has last-logged OpId of term: 13 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 8.
I20260709 13:20:39.064833 12017 raft_consensus.cc:493] T bb3d8792045a4583ae2e965b1350a5b4 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:39.108738 11567 consensus_queue.cc:237] T 1bf4668eeb70467fb3dc5a0289233b3c P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:39.109279 12017 raft_consensus.cc:515] T bb3d8792045a4583ae2e965b1350a5b4 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:20:39.111717 12017 leader_election.cc:290] T bb3d8792045a4583ae2e965b1350a5b4 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:39.112223 12121 raft_consensus.cc:2749] T 44bde925b2e541b69890d70715b85176 P cd75a17ab2604397adab03bb8b5fd75c [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:20:39.115120 11994 consensus_queue.cc:1048] T 8c7f33e544204fbaac4078e3e83bbf4e P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:20:39.118985  6876 raft_consensus.cc:1240] T 3411566abe2d4c9bb4b2adfdd05e6f17 P cd75a17ab2604397adab03bb8b5fd75c [term 13 FOLLOWER]: Rejecting Update request from peer b7ab4784c7344b939bc36f639286f377 for earlier term 12. Current term is 13. Ops: []
I20260709 13:20:39.119593  6880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c37d41cd9164c15a6826ca62a851a69" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
W20260709 13:20:39.120980  6846 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:39.124524 11954 consensus_queue.cc:237] T 3a485a995abc4807b6e511e45419f737 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:39.126766 11947 leader_election.cc:290] T f4b8bd455d5a47c18a1380839c6e0d61 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 15 election: Requested vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
W20260709 13:20:39.128618 12084 log.cc:927] Time spent T 24ee15416e3145beaa1b8183453729a3 P 7ba59cc884714e8aa5f3f0ecaed84cbb: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 13:20:39.129972 11994 raft_consensus.cc:493] T 4275cf08e63345f993bce8664eada830 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:20:39.128595  6697 leader_election.cc:304] T 4b8cacb381b746da8d0049b0a83b41dd P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:20:39.121029  6874 raft_consensus.cc:1275] T f03d0dbf16864ca4bc1bb5e4c0334c0f P cd75a17ab2604397adab03bb8b5fd75c [term 14 FOLLOWER]: Refusing update from remote peer b7ab4784c7344b939bc36f639286f377: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:20:39.068632 11937 raft_consensus.cc:2749] T 7c44c4849aa54f2b94d1f1bef9ed546f P cd75a17ab2604397adab03bb8b5fd75c [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:20:39.146448  7468 leader_election.cc:336] T ce4f062dcd314d43a63ca74067cb5ee3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931): Timed out: RequestConsensusVote RPC to 127.5.126.67:42931 timed out after 1.558s (SENT)
I20260709 13:20:39.151189  7468 leader_election.cc:304] T ce4f062dcd314d43a63ca74067cb5ee3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:20:39.107790 12128 raft_consensus.cc:740] T 20f6842e26174571996b8dea4151d4be P b7ab4784c7344b939bc36f639286f377 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
I20260709 13:20:39.163031  6725 raft_consensus.cc:1240] T 34f36d59d88f40fe8a2805e604fc6c0a P ccd8a4c3bfe3413cb2ae219b09aea832 [term 13 FOLLOWER]: Rejecting Update request from peer b7ab4784c7344b939bc36f639286f377 for earlier term 12. Current term is 13. Ops: []
I20260709 13:20:39.020124 12047 consensus_queue.cc:237] T 4f00a2e87e56452083b759f60d461ee3 P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.10, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
W20260709 13:20:39.163115  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 90365.8us
I20260709 13:20:39.167232  6844 leader_election.cc:304] T 95a75bfe094d4bdc963aba3f08dfcd25 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:20:39.082683 12078 raft_consensus.cc:3055] T e31b9971c15848dea59d4d4130141d9e P b7ab4784c7344b939bc36f639286f377 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:20:39.170974  6728 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e31b9971c15848dea59d4d4130141d9e"
dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
mode: GRACEFUL
new_leader_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
 from {username='slave'} at 127.0.0.1:38536
I20260709 13:20:39.171942  6728 raft_consensus.cc:606] T e31b9971c15848dea59d4d4130141d9e P ccd8a4c3bfe3413cb2ae219b09aea832 [term 12 FOLLOWER]: Received request to transfer leadership to TS cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:20:39.172449  6728 raft_consensus.cc:614] T e31b9971c15848dea59d4d4130141d9e P ccd8a4c3bfe3413cb2ae219b09aea832 [term 12 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:20:39.174347  7503 raft_consensus.cc:1275] T bb3d8792045a4583ae2e965b1350a5b4 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 13 FOLLOWER]: Refusing update from remote peer ccd8a4c3bfe3413cb2ae219b09aea832: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 13:20:39.175194  6729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c37d41cd9164c15a6826ca62a851a69" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:39.174433 12138 raft_consensus.cc:493] T 9e326172347f45e99a0d482b5d8ef768 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:20:39.179133 12138 raft_consensus.cc:515] T 9e326172347f45e99a0d482b5d8ef768 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:39.181545 11576 raft_consensus.cc:2749] T 2c240553ce044eedb41541d72b9475d7 P cd75a17ab2604397adab03bb8b5fd75c [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:20:39.142028 12113 raft_consensus.cc:697] T 1528ab62b6fe4e3099d08f141afee116 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 12 LEADER]: Becoming Leader. State: Replica: 7ba59cc884714e8aa5f3f0ecaed84cbb, State: Running, Role: LEADER
I20260709 13:20:39.184377 12138 leader_election.cc:290] T 9e326172347f45e99a0d482b5d8ef768 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:39.149170 12011 raft_consensus.cc:2749] T 4b8cacb381b746da8d0049b0a83b41dd P ccd8a4c3bfe3413cb2ae219b09aea832 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:20:39.191803  6724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3022224cc81473690653a83d4e99470" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
W20260709 13:20:39.198504  6770 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:39.130630 11994 raft_consensus.cc:515] T 4275cf08e63345f993bce8664eada830 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:39.183274 12113 consensus_queue.cc:237] T 1528ab62b6fe4e3099d08f141afee116 P 7ba59cc884714e8aa5f3f0ecaed84cbb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:20:39.170420 12078 raft_consensus.cc:740] T e31b9971c15848dea59d4d4130141d9e P b7ab4784c7344b939bc36f639286f377 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
I20260709 13:20:39.177332 12097 leader_election.cc:290] T b56bf91d90824c959e21e0cee5ba1816 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:20:39.203110 11937 raft_consensus.cc:2749] T 95a75bfe094d4bdc963aba3f08dfcd25 P cd75a17ab2604397adab03bb8b5fd75c [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:20:39.223650  6844 leader_election.cc:400] T 8c7f33e544204fbaac4078e3e83bbf4e P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 12 pre-election: Vote denied by peer b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817) with higher term. Message: Invalid argument: T 8c7f33e544204fbaac4078e3e83bbf4e P b7ab4784c7344b939bc36f639286f377 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c for earlier term 12. Current term is 13.
I20260709 13:20:39.232227  6844 leader_election.cc:304] T 3d65025eea89441290d85dd053810e31 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:20:39.252404  6877 raft_consensus.cc:1275] T 713b5728a197487c9300b310ab94e5a3 P cd75a17ab2604397adab03bb8b5fd75c [term 14 FOLLOWER]: Refusing update from remote peer b7ab4784c7344b939bc36f639286f377: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:20:39.252624  6844 leader_election.cc:304] T ab432e62819d499eaaf3dd55481dd930 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:20:39.229297 12143 raft_consensus.cc:2749] T ce4f062dcd314d43a63ca74067cb5ee3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:20:39.256983  6874 raft_consensus.cc:1275] T 7a734b5ab7834e05a8c422208acc58b1 P cd75a17ab2604397adab03bb8b5fd75c [term 15 FOLLOWER]: Refusing update from remote peer b7ab4784c7344b939bc36f639286f377: Log matching property violated. Preceding OpId in replica: term: 13 index: 5. Preceding OpId from leader: term: 15 index: 7. (index mismatch)
I20260709 13:20:39.248131 11937 raft_consensus.cc:2764] T 3d65025eea89441290d85dd053810e31 P cd75a17ab2604397adab03bb8b5fd75c [term 15 FOLLOWER]: Leader pre-election decision vote started in defunct term 14: won
I20260709 13:20:39.264434 11994 leader_election.cc:290] T 4275cf08e63345f993bce8664eada830 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:39.263728  6807 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f3f9c2e2bf644115957398fe4c9459db"
dest_uuid: "b7ab4784c7344b939bc36f639286f377"
mode: GRACEFUL
new_leader_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
 from {username='slave'} at 127.0.0.1:38240
I20260709 13:20:39.268666  6807 raft_consensus.cc:606] T f3f9c2e2bf644115957398fe4c9459db P b7ab4784c7344b939bc36f639286f377 [term 14 FOLLOWER]: Received request to transfer leadership to TS cd75a17ab2604397adab03bb8b5fd75c
W20260709 13:20:39.268900 12098 consensus_meta.cc:287] T 2c240553ce044eedb41541d72b9475d7 P b7ab4784c7344b939bc36f639286f377: Time spent flushing consensus metadata: real 0.627s	user 0.008s	sys 0.004s
I20260709 13:20:39.269140  6807 raft_consensus.cc:614] T f3f9c2e2bf644115957398fe4c9459db P b7ab4784c7344b939bc36f639286f377 [term 14 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:20:39.269474 12098 raft_consensus.cc:515] T 2c240553ce044eedb41541d72b9475d7 P b7ab4784c7344b939bc36f639286f377 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:39.271637 12098 leader_election.cc:290] T 2c240553ce044eedb41541d72b9475d7 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 17 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:39.272090 12097 raft_consensus.cc:2764] T ab432e62819d499eaaf3dd55481dd930 P cd75a17ab2604397adab03bb8b5fd75c [term 17 FOLLOWER]: Leader pre-election decision vote started in defunct term 15: won
I20260709 13:20:39.273171  6877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbdf895bba214ff68685a24fd17dfb5d" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 14 candidate_status { last_received { term: 12 index: 5 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:39.280131  6877 raft_consensus.cc:2468] T dbdf895bba214ff68685a24fd17dfb5d P cd75a17ab2604397adab03bb8b5fd75c [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 13.
I20260709 13:20:39.256685 12078 consensus_queue.cc:260] T e31b9971c15848dea59d4d4130141d9e P b7ab4784c7344b939bc36f639286f377 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:39.290733 12092 raft_consensus.cc:493] T be1a92657f494cac8dd227d152f50151 P b7ab4784c7344b939bc36f639286f377 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 7ba59cc884714e8aa5f3f0ecaed84cbb)
I20260709 13:20:39.291980 12078 raft_consensus.cc:3060] T e31b9971c15848dea59d4d4130141d9e P b7ab4784c7344b939bc36f639286f377 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:20:39.294155 12117 log.cc:927] Time spent T 22ccee1b570c4ad3a57bd7aec085b1b4 P ccd8a4c3bfe3413cb2ae219b09aea832: Append to log took a long time: real 0.573s	user 0.001s	sys 0.000s
W20260709 13:20:39.278272 11951 consensus_meta.cc:287] T 4f00a2e87e56452083b759f60d461ee3 P b7ab4784c7344b939bc36f639286f377: Time spent flushing consensus metadata: real 0.588s	user 0.009s	sys 0.001s
I20260709 13:20:39.291476 12092 raft_consensus.cc:515] T be1a92657f494cac8dd227d152f50151 P b7ab4784c7344b939bc36f639286f377 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:20:39.310798  6807 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f5be3a11b23d4ea9b08300a2789821c7"
dest_uuid: "b7ab4784c7344b939bc36f639286f377"
mode: GRACEFUL
new_leader_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
 from {username='slave'} at 127.0.0.1:38240
I20260709 13:20:39.318357  6807 raft_consensus.cc:606] T f5be3a11b23d4ea9b08300a2789821c7 P b7ab4784c7344b939bc36f639286f377 [term 14 FOLLOWER]: Received request to transfer leadership to TS cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:20:39.318926  6807 raft_consensus.cc:614] T f5be3a11b23d4ea9b08300a2789821c7 P b7ab4784c7344b939bc36f639286f377 [term 14 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 13:20:39.315575  7468 leader_election.cc:336] T 24ee15416e3145beaa1b8183453729a3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931): Timed out: RequestConsensusVote RPC to 127.5.126.67:42931 timed out after 1.714s (SENT)
I20260709 13:20:39.321266  6844 leader_election.cc:304] T d8292e16e5654be6bc408560cf256aaa P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:20:39.324331 12097 raft_consensus.cc:493] T 7a734b5ab7834e05a8c422208acc58b1 P cd75a17ab2604397adab03bb8b5fd75c [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:39.324954 12097 raft_consensus.cc:515] T 7a734b5ab7834e05a8c422208acc58b1 P cd75a17ab2604397adab03bb8b5fd75c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:39.325851 12092 leader_election.cc:290] T be1a92657f494cac8dd227d152f50151 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:20:39.327000 12097 leader_election.cc:290] T 7a734b5ab7834e05a8c422208acc58b1 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
W20260709 13:20:39.330997 11668 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.937s	user 0.013s	sys 0.025s
W20260709 13:20:39.331604 11668 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.943s	user 0.014s	sys 0.026s
I20260709 13:20:39.337394  6844 leader_election.cc:304] T a3022224cc81473690653a83d4e99470 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:20:39.338822 11937 raft_consensus.cc:2749] T a3022224cc81473690653a83d4e99470 P cd75a17ab2604397adab03bb8b5fd75c [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:20:39.335652  5625 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:20:39.341418  5625 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:20:39.332759 12100 raft_consensus.cc:2749] T 1528ab62b6fe4e3099d08f141afee116 P b7ab4784c7344b939bc36f639286f377 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:20:39.334661 12097 raft_consensus.cc:2749] T d8292e16e5654be6bc408560cf256aaa P cd75a17ab2604397adab03bb8b5fd75c [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:20:39.352666  6806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1528ab62b6fe4e3099d08f141afee116" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:20:39.354283 12037 consensus_queue.cc:1059] T 22ccee1b570c4ad3a57bd7aec085b1b4 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:20:39.355859 11951 consensus_queue.cc:1059] T 3411566abe2d4c9bb4b2adfdd05e6f17 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
W20260709 13:20:39.357170 12129 log.cc:927] Time spent T f09c2a98de1a4decabd0ff900dd44caa P cd75a17ab2604397adab03bb8b5fd75c: Append to log took a long time: real 0.429s	user 0.003s	sys 0.000s
I20260709 13:20:39.367066  6798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90d42e216d9741e190bca19a781291fd" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:39.377717  6801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4b8bd455d5a47c18a1380839c6e0d61" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:39.414462  6799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f00a2e87e56452083b759f60d461ee3" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:39.417737  6806 raft_consensus.cc:2468] T 1528ab62b6fe4e3099d08f141afee116 P b7ab4784c7344b939bc36f639286f377 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in term 12.
I20260709 13:20:39.419627  6799 raft_consensus.cc:2410] T 4f00a2e87e56452083b759f60d461ee3 P b7ab4784c7344b939bc36f639286f377 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c for term 16 because replica has last-logged OpId of term: 15 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 10.
I20260709 13:20:39.428411  6801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22ccee1b570c4ad3a57bd7aec085b1b4" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:20:39.427306 12092 raft_consensus.cc:493] T 853ac0a8cbd64ce99457f170216d4d0f P b7ab4784c7344b939bc36f639286f377 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:39.433044 12092 raft_consensus.cc:515] T 853ac0a8cbd64ce99457f170216d4d0f P b7ab4784c7344b939bc36f639286f377 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:39.436908  6872 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53406 (request call id 2473) took 1081 ms. Trace:
I20260709 13:20:39.437573  6872 rpcz_store.cc:276] 0709 13:20:38.355273 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:38.535516 (+180243us) service_pool.cc:224] Handling call
0709 13:20:38.535780 (+   264us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:38.537130 (+  1350us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:38.537163 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:20:38.564737 (+ 27574us) log.cc:844] Serialized 26 byte log entry
0709 13:20:38.712384 (+147647us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:20:38.712430 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:38.712500 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:39.337128 (+624628us) spinlock_profiling.cc:243] Waited 61.4 ms on lock 0x7b4400022b4c. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0c745db1 00007fcc0c7e3c85 00007fcc0c7e46a2 00007fcc0f5561db 00007fcc0f551aaf 00007fcc0f54586e 00007fcc0f544bb6 00007fcc0f5447d8 00007fcc0f54e221 00007fcc0f54e1d9 00007fcc0f54e169
0709 13:20:39.436580 (+ 99452us) raft_consensus.cc:1685] finished
0709 13:20:39.436620 (+    40us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:39.436845 (+   225us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1920,"raft.run_cpu_time_us":175,"raft.run_wall_time_us":8910,"spinlock_wait_cycles":141290368,"thread_start_us":110622,"threads_started":1,"wal-append.queue_time_us":189576}
I20260709 13:20:39.438084  6799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "853ac0a8cbd64ce99457f170216d4d0f" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:39.441491  6874 raft_consensus.cc:1275] T b56bf91d90824c959e21e0cee5ba1816 P cd75a17ab2604397adab03bb8b5fd75c [term 14 FOLLOWER]: Refusing update from remote peer ccd8a4c3bfe3413cb2ae219b09aea832: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:20:39.379069 11567 raft_consensus.cc:493] T f03d0dbf16864ca4bc1bb5e4c0334c0f P ccd8a4c3bfe3413cb2ae219b09aea832 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:39.440533  6872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d33d5ee8ef6f415593d8df52063161ad" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:20:39.440955  6799 raft_consensus.cc:2468] T 853ac0a8cbd64ce99457f170216d4d0f P b7ab4784c7344b939bc36f639286f377 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 13.
I20260709 13:20:39.446969  6874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e326172347f45e99a0d482b5d8ef768" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
W20260709 13:20:39.424633 12103 log.cc:927] Time spent T 30e88460611e47b2ba16a46a30b5f416 P b7ab4784c7344b939bc36f639286f377: Append to log took a long time: real 1.038s	user 0.015s	sys 0.004s
I20260709 13:20:39.451603  6877 raft_consensus.cc:1275] T 44bde925b2e541b69890d70715b85176 P cd75a17ab2604397adab03bb8b5fd75c [term 15 FOLLOWER]: Refusing update from remote peer ccd8a4c3bfe3413cb2ae219b09aea832: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:20:39.451678  6801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f00a2e87e56452083b759f60d461ee3" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:20:39.458564  6880 raft_consensus.cc:1275] T 7887766dc6784fcaa42b35c05fea7a99 P cd75a17ab2604397adab03bb8b5fd75c [term 16 FOLLOWER]: Refusing update from remote peer ccd8a4c3bfe3413cb2ae219b09aea832: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 13:20:39.459602  6801 raft_consensus.cc:2410] T 4f00a2e87e56452083b759f60d461ee3 P b7ab4784c7344b939bc36f639286f377 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c for term 16 because replica has last-logged OpId of term: 15 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 10.
I20260709 13:20:39.460760  6801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b3759de40694069b13c0f8bd40e5709" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:39.460920  6881 raft_consensus.cc:1275] T 3d65025eea89441290d85dd053810e31 P cd75a17ab2604397adab03bb8b5fd75c [term 15 FOLLOWER]: Refusing update from remote peer ccd8a4c3bfe3413cb2ae219b09aea832: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 13:20:39.462021  6801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1704639a875409b9959353527b3fd68" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:39.463126  6801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77e330a82df4b43a745d57a68f6f057" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:39.463726 12072 consensus_queue.cc:1048] T b56bf91d90824c959e21e0cee5ba1816 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:20:39.452136  6879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4b8bd455d5a47c18a1380839c6e0d61" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:20:39.417176 12102 raft_consensus.cc:493] T d8cee0accdb8499c86d4414b72565a38 P b7ab4784c7344b939bc36f639286f377 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 7ba59cc884714e8aa5f3f0ecaed84cbb)
I20260709 13:20:39.470276  6799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "711ef6523deb4cbe8ef2ba61e1c21c98" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:20:39.449246  6872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4275cf08e63345f993bce8664eada830" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
W20260709 13:20:39.503226  7468 leader_election.cc:336] T 3fa34c08b205435dba97346991aa1f92 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931): Timed out: RequestConsensusVote RPC to 127.5.126.67:42931 timed out after 1.990s (SENT)
W20260709 13:20:39.504248  6772 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 143550us
I20260709 13:20:39.504882  6799 raft_consensus.cc:3060] T 711ef6523deb4cbe8ef2ba61e1c21c98 P b7ab4784c7344b939bc36f639286f377 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:39.436004 12092 leader_election.cc:290] T 853ac0a8cbd64ce99457f170216d4d0f P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:39.474920 11710 consensus_queue.cc:1048] T 44bde925b2e541b69890d70715b85176 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.036s
I20260709 13:20:39.506258 11946 consensus_queue.cc:1048] T 3d65025eea89441290d85dd053810e31 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.009s
I20260709 13:20:39.519496 12011 raft_consensus.cc:493] T 24ee15416e3145beaa1b8183453729a3 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 7ba59cc884714e8aa5f3f0ecaed84cbb)
I20260709 13:20:39.520303 12148 raft_consensus.cc:493] T bb7fa124c3bf4ef9ab65a407cb008441 P b7ab4784c7344b939bc36f639286f377 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 7ba59cc884714e8aa5f3f0ecaed84cbb)
I20260709 13:20:39.527935  6878 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53416 (request call id 3180) took 1236 ms. Trace:
I20260709 13:20:39.530160  6878 rpcz_store.cc:276] 0709 13:20:38.291472 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:38.384589 (+ 93117us) service_pool.cc:224] Handling call
0709 13:20:39.522162 (+1137573us) spinlock_profiling.cc:243] Waited 708 ms on lock 0x7b54000d1e54. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f9ae2fa 00007fcc1496fb17 00007fcc0deea6d4 00007fcc0deea662 00007fcc0deea591 00007fcc0deea50c 00007fcc0dee97c2 00007fcc0dce548c 00007fcc0dce48c6 00007fcc0dce426f
0709 13:20:39.527858 (+  5696us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1628576512}
W20260709 13:20:39.533514  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 156890us
I20260709 13:20:39.534617  6844 leader_election.cc:304] T c4db81d9d329422bb3b4160ca4ac2d1d P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: ccd8a4c3bfe3413cb2ae219b09aea832
W20260709 13:20:39.573206  6772 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 48983.4us
W20260709 13:20:39.572983  6770 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 49540.1us
I20260709 13:20:39.580082  6697 leader_election.cc:304] T f3f9c2e2bf644115957398fe4c9459db P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:20:39.503140 11634 consensus_queue.cc:1048] T 7887766dc6784fcaa42b35c05fea7a99 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.037s
I20260709 13:20:39.578208  6772 leader_election.cc:304] T dbdf895bba214ff68685a24fd17dfb5d P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:20:39.447254 12150 consensus_queue.cc:1059] T b3f13b31a1f84f0d89d007eadd57924c P b7ab4784c7344b939bc36f639286f377 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.294s
I20260709 13:20:39.469466 11567 raft_consensus.cc:515] T f03d0dbf16864ca4bc1bb5e4c0334c0f P ccd8a4c3bfe3413cb2ae219b09aea832 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:39.589681  6728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3d8792045a4583ae2e965b1350a5b4" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:39.590031  6801 raft_consensus.cc:1275] T 427c124d773f483294511e80fe340075 P b7ab4784c7344b939bc36f639286f377 [term 14 FOLLOWER]: Refusing update from remote peer 7ba59cc884714e8aa5f3f0ecaed84cbb: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
W20260709 13:20:39.582649 11955 log.cc:927] Time spent T 7a734b5ab7834e05a8c422208acc58b1 P 7ba59cc884714e8aa5f3f0ecaed84cbb: Append to log took a long time: real 0.055s	user 0.001s	sys 0.000s
I20260709 13:20:39.529402 12100 consensus_queue.cc:1048] T f03d0dbf16864ca4bc1bb5e4c0334c0f P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.060s
W20260709 13:20:39.618882  6772 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 44468.6us
I20260709 13:20:39.527717 12011 raft_consensus.cc:515] T 24ee15416e3145beaa1b8183453729a3 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:20:39.587471 12047 raft_consensus.cc:493] T f3f9c2e2bf644115957398fe4c9459db P cd75a17ab2604397adab03bb8b5fd75c [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:39.634653  6799 raft_consensus.cc:2468] T 711ef6523deb4cbe8ef2ba61e1c21c98 P b7ab4784c7344b939bc36f639286f377 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 17.
I20260709 13:20:39.588425 11899 raft_consensus.cc:493] T de3186201e1a40d0b335eeb8b4e256e0 P b7ab4784c7344b939bc36f639286f377 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:20:39.604244 11946 raft_consensus.cc:2749] T f3f9c2e2bf644115957398fe4c9459db P ccd8a4c3bfe3413cb2ae219b09aea832 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:20:39.537269 12102 raft_consensus.cc:515] T d8cee0accdb8499c86d4414b72565a38 P b7ab4784c7344b939bc36f639286f377 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:20:39.583187 12138 consensus_queue.cc:1048] T bb3d8792045a4583ae2e965b1350a5b4 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.050s
I20260709 13:20:39.588224 12092 consensus_queue.cc:1048] T 7a734b5ab7834e05a8c422208acc58b1 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.054s
I20260709 13:20:39.668375  7495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be1a92657f494cac8dd227d152f50151" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:20:39.610838 12121 raft_consensus.cc:2764] T c4db81d9d329422bb3b4160ca4ac2d1d P cd75a17ab2604397adab03bb8b5fd75c [term 14 FOLLOWER]: Leader pre-election decision vote started in defunct term 12: won
I20260709 13:20:39.639236 12131 raft_consensus.cc:493] T 8c7f33e544204fbaac4078e3e83bbf4e P b7ab4784c7344b939bc36f639286f377 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:39.577445 12148 raft_consensus.cc:515] T bb7fa124c3bf4ef9ab65a407cb008441 P b7ab4784c7344b939bc36f639286f377 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:20:39.622655 11774 consensus_queue.cc:1048] T 427c124d773f483294511e80fe340075 P 7ba59cc884714e8aa5f3f0ecaed84cbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.057s
I20260709 13:20:39.708477 11899 raft_consensus.cc:515] T de3186201e1a40d0b335eeb8b4e256e0 P b7ab4784c7344b939bc36f639286f377 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:39.713310 12139 consensus_queue.cc:1048] T 713b5728a197487c9300b310ab94e5a3 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.184s
I20260709 13:20:39.624218 12137 consensus_queue.cc:1059] T 34f36d59d88f40fe8a2805e604fc6c0a P b7ab4784c7344b939bc36f639286f377 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 5, Time since last communication: 0.071s
I20260709 13:20:39.676158 12150 consensus_queue.cc:1243] T b3f13b31a1f84f0d89d007eadd57924c P b7ab4784c7344b939bc36f639286f377 [LEADER]: Peer 7ba59cc884714e8aa5f3f0ecaed84cbb log is divergent from this leader: its last log entry 13.12 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 11
I20260709 13:20:39.724858  6875 raft_consensus.cc:1240] T a3022224cc81473690653a83d4e99470 P cd75a17ab2604397adab03bb8b5fd75c [term 16 FOLLOWER]: Rejecting Update request from peer ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 15. Current term is 16. Ops: []
I20260709 13:20:39.650117 12047 raft_consensus.cc:515] T f3f9c2e2bf644115957398fe4c9459db P cd75a17ab2604397adab03bb8b5fd75c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:39.735140  6875 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53416 (request call id 3199) took 1165 ms. Trace:
I20260709 13:20:39.737835  6875 rpcz_store.cc:276] 0709 13:20:38.569305 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:38.573109 (+  3804us) service_pool.cc:224] Handling call
0709 13:20:39.724354 (+1151245us) spinlock_profiling.cc:243] Waited 1.47 ms on lock 0x7b5800147c98. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0c745db1 00007fcc0c885b71 00007fcc0c885a22 00007fcc1579ec09 00007fcc148f8ee0 00007fcc149c20ab 00007fcc149c2131 00007fcc14983fc0 00007fcc1496e929 00007fcc1496e3d2 00007fcc0dee5bd4
0709 13:20:39.724617 (+   263us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:39.734715 (+ 10098us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:39.735055 (+   340us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3388288}
I20260709 13:20:39.739933 12158 raft_consensus.cc:2804] T dbdf895bba214ff68685a24fd17dfb5d P b7ab4784c7344b939bc36f639286f377 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:20:39.740559 12158 raft_consensus.cc:493] T dbdf895bba214ff68685a24fd17dfb5d P b7ab4784c7344b939bc36f639286f377 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:39.740965 12158 raft_consensus.cc:3060] T dbdf895bba214ff68685a24fd17dfb5d P b7ab4784c7344b939bc36f639286f377 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:39.742502 12011 leader_election.cc:290] T 24ee15416e3145beaa1b8183453729a3 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:20:39.744975 12133 raft_consensus.cc:493] T 7ba5dac66ab5497e9e336f2a3c28cda5 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:39.718228 12131 raft_consensus.cc:515] T 8c7f33e544204fbaac4078e3e83bbf4e P b7ab4784c7344b939bc36f639286f377 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:39.745632 12133 raft_consensus.cc:515] T 7ba5dac66ab5497e9e336f2a3c28cda5 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:20:39.746963 12098 raft_consensus.cc:493] T 30e88460611e47b2ba16a46a30b5f416 P b7ab4784c7344b939bc36f639286f377 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:20:39.747653 12098 raft_consensus.cc:515] T 30e88460611e47b2ba16a46a30b5f416 P b7ab4784c7344b939bc36f639286f377 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
W20260709 13:20:39.734139 12086 consensus_meta.cc:287] T 3a485a995abc4807b6e511e45419f737 P cd75a17ab2604397adab03bb8b5fd75c: Time spent flushing consensus metadata: real 0.835s	user 0.016s	sys 0.001s
W20260709 13:20:39.748001 12154 log.cc:927] Time spent T f09c2a98de1a4decabd0ff900dd44caa P ccd8a4c3bfe3413cb2ae219b09aea832: Append to log took a long time: real 0.381s	user 0.001s	sys 0.000s
I20260709 13:20:39.751097 11951 raft_consensus.cc:493] T 4d9def8b32fd443aa94ab1420b06837b P b7ab4784c7344b939bc36f639286f377 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:20:39.772540  6875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c240553ce044eedb41541d72b9475d7" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:20:39.814905  6875 raft_consensus.cc:3060] T 2c240553ce044eedb41541d72b9475d7 P cd75a17ab2604397adab03bb8b5fd75c [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:39.758807 12086 raft_consensus.cc:2749] T 3a485a995abc4807b6e511e45419f737 P cd75a17ab2604397adab03bb8b5fd75c [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:20:39.813771 12078 consensus_meta.cc:287] T e31b9971c15848dea59d4d4130141d9e P b7ab4784c7344b939bc36f639286f377: Time spent flushing consensus metadata: real 0.521s	user 0.010s	sys 0.005s
I20260709 13:20:39.839238  6875 raft_consensus.cc:2468] T 2c240553ce044eedb41541d72b9475d7 P cd75a17ab2604397adab03bb8b5fd75c [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 17.
W20260709 13:20:39.851889 12120 log.cc:927] Time spent T f5be3a11b23d4ea9b08300a2789821c7 P b7ab4784c7344b939bc36f639286f377: Append to log took a long time: real 1.107s	user 0.000s	sys 0.004s
I20260709 13:20:39.852692  6875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "853ac0a8cbd64ce99457f170216d4d0f" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:39.853317  6875 raft_consensus.cc:2468] T 853ac0a8cbd64ce99457f170216d4d0f P cd75a17ab2604397adab03bb8b5fd75c [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 12.
W20260709 13:20:39.837829 12160 log.cc:927] Time spent T 4f00a2e87e56452083b759f60d461ee3 P cd75a17ab2604397adab03bb8b5fd75c: Append to log took a long time: real 0.306s	user 0.001s	sys 0.000s
I20260709 13:20:39.864166  6803 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:32976 (request call id 3178) took 1597 ms. Trace:
I20260709 13:20:39.824375 11951 raft_consensus.cc:515] T 4d9def8b32fd443aa94ab1420b06837b P b7ab4784c7344b939bc36f639286f377 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:39.841183 11567 leader_election.cc:290] T f03d0dbf16864ca4bc1bb5e4c0334c0f P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:39.864753  6803 rpcz_store.cc:276] 0709 13:20:38.263447 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:38.282464 (+ 19017us) service_pool.cc:224] Handling call
0709 13:20:38.311154 (+ 28690us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:20:38.338324 (+ 27170us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:38.338356 (+    32us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:20:38.375015 (+ 36659us) log.cc:844] Serialized 52 byte log entry
0709 13:20:38.532814 (+157799us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:20:38.532873 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:38.532957 (+    84us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:39.851108 (+1318151us) spinlock_profiling.cc:243] Waited 5.15 ms on lock 0x7b4400022b4c. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0c745db1 00007fcc0c7e3c85 00007fcc0c7e46a2 00007fcc0f5561db 00007fcc0f551aaf 00007fcc0f54586e 00007fcc0f544bb6 00007fcc0f5447d8 00007fcc0f54e221 00007fcc0f54e1d9 00007fcc0f54e169
0709 13:20:39.854252 (+  3144us) raft_consensus.cc:1685] finished
0709 13:20:39.854281 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:39.860682 (+  6401us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":26672,"raft.queue_time_us":68271,"raft.run_cpu_time_us":199,"raft.run_wall_time_us":15925,"spinlock_wait_cycles":11855616,"thread_start_us":118076,"threads_started":1,"wal-append.queue_time_us":247691}
W20260709 13:20:39.913905 12155 log.cc:927] Time spent T 1bf4668eeb70467fb3dc5a0289233b3c P ccd8a4c3bfe3413cb2ae219b09aea832: Append to log took a long time: real 0.325s	user 0.001s	sys 0.000s
I20260709 13:20:39.886117 11774 raft_consensus.cc:493] T 17587d6730594da4a56fa13a353232a1 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 19 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
W20260709 13:20:39.934692 12168 log.cc:927] Time spent T 1528ab62b6fe4e3099d08f141afee116 P 7ba59cc884714e8aa5f3f0ecaed84cbb: Append to log took a long time: real 0.072s	user 0.000s	sys 0.000s
W20260709 13:20:39.935563 12179 log.cc:927] Time spent T bd6869f07b5a4885a0b99fbe60c3b175 P cd75a17ab2604397adab03bb8b5fd75c: Append to log took a long time: real 0.085s	user 0.000s	sys 0.001s
W20260709 13:20:39.945976  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 411453us
I20260709 13:20:39.948179  6772 leader_election.cc:304] T 2c240553ce044eedb41541d72b9475d7 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:20:39.918691 12098 leader_election.cc:290] T 30e88460611e47b2ba16a46a30b5f416 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:39.952772  6844 leader_election.cc:304] T d33d5ee8ef6f415593d8df52063161ad P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:20:39.984781  6770 leader_election.cc:304] T 7c37d41cd9164c15a6826ca62a851a69 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:20:39.978541  6844 leader_election.cc:304] T 7c37d41cd9164c15a6826ca62a851a69 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:20:39.989988  6844 leader_election.cc:304] T ce4f062dcd314d43a63ca74067cb5ee3 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:20:39.944897 11899 leader_election.cc:290] T de3186201e1a40d0b335eeb8b4e256e0 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
W20260709 13:20:39.991806 12171 log.cc:927] Time spent T bb3d8792045a4583ae2e965b1350a5b4 P cd75a17ab2604397adab03bb8b5fd75c: Append to log took a long time: real 0.074s	user 0.000s	sys 0.000s
I20260709 13:20:39.964551 12133 leader_election.cc:290] T 7ba5dac66ab5497e9e336f2a3c28cda5 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:39.966934 12047 leader_election.cc:290] T f3f9c2e2bf644115957398fe4c9459db P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:20:40.013188 12169 raft_consensus.cc:2749] T 7c37d41cd9164c15a6826ca62a851a69 P cd75a17ab2604397adab03bb8b5fd75c [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:20:40.013275 11951 leader_election.cc:290] T 4d9def8b32fd443aa94ab1420b06837b P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:40.015419 12137 raft_consensus.cc:493] T bd6869f07b5a4885a0b99fbe60c3b175 P b7ab4784c7344b939bc36f639286f377 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:40.016008 12137 raft_consensus.cc:515] T bd6869f07b5a4885a0b99fbe60c3b175 P b7ab4784c7344b939bc36f639286f377 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:40.018213 12137 leader_election.cc:290] T bd6869f07b5a4885a0b99fbe60c3b175 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:40.020689 11955 tablet_bootstrap.cc:492] T 7a734b5ab7834e05a8c422208acc58b1 P 7ba59cc884714e8aa5f3f0ecaed84cbb: Bootstrap replayed 1/1 log segments. Stats: ops{read=6 overwritten=0 applied=5 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 1 replicates
W20260709 13:20:40.010532  6772 consensus_peers.cc:597] T 7a734b5ab7834e05a8c422208acc58b1 P b7ab4784c7344b939bc36f639286f377 -> Peer 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071): Couldn't send request to peer 7ba59cc884714e8aa5f3f0ecaed84cbb. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:39.987644 12139 raft_consensus.cc:493] T 07a92dd554674067a83a9cb68c4773f2 P b7ab4784c7344b939bc36f639286f377 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:20:39.998198  7503 raft_consensus.cc:1240] T b3f13b31a1f84f0d89d007eadd57924c P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 13 LEADER]: Rejecting Update request from peer b7ab4784c7344b939bc36f639286f377 for earlier term 12. Current term is 13. Ops: []
I20260709 13:20:40.000377 12098 raft_consensus.cc:2804] T 2c240553ce044eedb41541d72b9475d7 P b7ab4784c7344b939bc36f639286f377 [term 17 FOLLOWER]: Leader election won for term 17
W20260709 13:20:39.952854 12164 log.cc:927] Time spent T e77e330a82df4b43a745d57a68f6f057 P ccd8a4c3bfe3413cb2ae219b09aea832: Append to log took a long time: real 0.120s	user 0.000s	sys 0.001s
I20260709 13:20:39.995425  7500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8cee0accdb8499c86d4414b72565a38" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:20:40.008376  7502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb7fa124c3bf4ef9ab65a407cb008441" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:20:40.008445  6844 leader_election.cc:304] T 713b5728a197487c9300b310ab94e5a3 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
W20260709 13:20:39.996073 12166 log.cc:927] Time spent T de3186201e1a40d0b335eeb8b4e256e0 P cd75a17ab2604397adab03bb8b5fd75c: Append to log took a long time: real 0.229s	user 0.002s	sys 0.000s
I20260709 13:20:40.006917 12086 raft_consensus.cc:2749] T ce4f062dcd314d43a63ca74067cb5ee3 P cd75a17ab2604397adab03bb8b5fd75c [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:20:40.045921  6844 leader_election.cc:304] T f58dc08b12a2494bb9a1372837970ca2 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
W20260709 13:20:40.012104 12170 log.cc:927] Time spent T 4d9def8b32fd443aa94ab1420b06837b P cd75a17ab2604397adab03bb8b5fd75c: Append to log took a long time: real 0.107s	user 0.000s	sys 0.000s
I20260709 13:20:39.943604 11774 raft_consensus.cc:515] T 17587d6730594da4a56fa13a353232a1 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:20:39.984124 12180 raft_consensus.cc:2749] T d33d5ee8ef6f415593d8df52063161ad P cd75a17ab2604397adab03bb8b5fd75c [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:20:40.034235  7503 raft_consensus.cc:1275] T 4f00a2e87e56452083b759f60d461ee3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 16 FOLLOWER]: Refusing update from remote peer cd75a17ab2604397adab03bb8b5fd75c: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
W20260709 13:20:40.006572 12163 log.cc:927] Time spent T 3fa34c08b205435dba97346991aa1f92 P 7ba59cc884714e8aa5f3f0ecaed84cbb: Append to log took a long time: real 0.161s	user 0.001s	sys 0.001s
I20260709 13:20:40.004909 12037 raft_consensus.cc:2749] T 7c37d41cd9164c15a6826ca62a851a69 P b7ab4784c7344b939bc36f639286f377 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:20:40.048864  6872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f03d0dbf16864ca4bc1bb5e4c0334c0f" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:40.051043  6875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24ee15416e3145beaa1b8183453729a3" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:40.055012  6872 raft_consensus.cc:2468] T f03d0dbf16864ca4bc1bb5e4c0334c0f P cd75a17ab2604397adab03bb8b5fd75c [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 14.
I20260709 13:20:40.033416 12098 raft_consensus.cc:697] T 2c240553ce044eedb41541d72b9475d7 P b7ab4784c7344b939bc36f639286f377 [term 17 LEADER]: Becoming Leader. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
I20260709 13:20:40.055663  6875 raft_consensus.cc:2468] T 24ee15416e3145beaa1b8183453729a3 P cd75a17ab2604397adab03bb8b5fd75c [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 18.
I20260709 13:20:40.047551 12121 raft_consensus.cc:2749] T 713b5728a197487c9300b310ab94e5a3 P cd75a17ab2604397adab03bb8b5fd75c [term 14 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:20:40.033209 12139 raft_consensus.cc:515] T 07a92dd554674067a83a9cb68c4773f2 P b7ab4784c7344b939bc36f639286f377 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:40.070358 12086 raft_consensus.cc:2749] T f58dc08b12a2494bb9a1372837970ca2 P cd75a17ab2604397adab03bb8b5fd75c [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:20:40.100329  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 54491.1us
I20260709 13:20:40.101258  6844 leader_election.cc:304] T 30e88460611e47b2ba16a46a30b5f416 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:20:40.103161  6844 leader_election.cc:304] T 20f6842e26174571996b8dea4151d4be P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:20:40.062808 12128 consensus_queue.cc:260] T 20f6842e26174571996b8dea4151d4be P b7ab4784c7344b939bc36f639286f377 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:40.057216 12186 consensus_queue.cc:1059] T b3f13b31a1f84f0d89d007eadd57924c P b7ab4784c7344b939bc36f639286f377 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.046s
I20260709 13:20:40.106912 11955 tablet_bootstrap.cc:492] T 7a734b5ab7834e05a8c422208acc58b1 P 7ba59cc884714e8aa5f3f0ecaed84cbb: Bootstrap complete.
I20260709 13:20:40.116752 11774 leader_election.cc:290] T 17587d6730594da4a56fa13a353232a1 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:20:40.117803 12098 consensus_queue.cc:237] T 2c240553ce044eedb41541d72b9475d7 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 15.9, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:40.120954 11955 ts_tablet_manager.cc:1403] T 7a734b5ab7834e05a8c422208acc58b1 P 7ba59cc884714e8aa5f3f0ecaed84cbb: Time spent bootstrapping tablet: real 1.968s	user 0.027s	sys 0.030s
I20260709 13:20:40.097198 12180 consensus_queue.cc:1048] T 4f00a2e87e56452083b759f60d461ee3 P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.018s
I20260709 13:20:40.097561 12158 raft_consensus.cc:515] T dbdf895bba214ff68685a24fd17dfb5d P b7ab4784c7344b939bc36f639286f377 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:40.159389 12139 leader_election.cc:290] T 07a92dd554674067a83a9cb68c4773f2 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:40.160454 12121 raft_consensus.cc:3060] T 20f6842e26174571996b8dea4151d4be P cd75a17ab2604397adab03bb8b5fd75c [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:40.195000 12158 leader_election.cc:290] T dbdf895bba214ff68685a24fd17dfb5d P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 14 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
W20260709 13:20:40.161226  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 58148.2us
W20260709 13:20:40.160481  6846 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.68:45071, user_credentials={real_user=slave}} blocked reactor thread for 50726.4us
I20260709 13:20:40.196638  6844 leader_election.cc:400] T 427c124d773f483294511e80fe340075 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 13 election: Vote denied by peer b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817) with higher term. Message: Invalid argument: T 427c124d773f483294511e80fe340075 P b7ab4784c7344b939bc36f639286f377 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c for earlier term 13. Current term is 14.
I20260709 13:20:40.196978  6844 leader_election.cc:403] T 427c124d773f483294511e80fe340075 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 13 election: Cancelling election due to peer responding with higher term
I20260709 13:20:40.115921 12186 consensus_queue.cc:1243] T b3f13b31a1f84f0d89d007eadd57924c P b7ab4784c7344b939bc36f639286f377 [LEADER]: Peer 7ba59cc884714e8aa5f3f0ecaed84cbb log is divergent from this leader: its last log entry 13.12 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 11
I20260709 13:20:40.161309 12130 raft_consensus.cc:493] T d8292e16e5654be6bc408560cf256aaa P b7ab4784c7344b939bc36f639286f377 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:20:40.173735  6731 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50004 (request call id 2472) took 1022 ms. Trace:
I20260709 13:20:40.177124 12157 raft_consensus.cc:493] T 95a75bfe094d4bdc963aba3f08dfcd25 P b7ab4784c7344b939bc36f639286f377 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
W20260709 13:20:40.186847  6697 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 140434us
I20260709 13:20:40.187426 11567 consensus_queue.cc:1059] T a3022224cc81473690653a83d4e99470 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: INVALID_TERM, Last received: 15.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:20:40.162771 12156 raft_consensus.cc:3055] T 22ccee1b570c4ad3a57bd7aec085b1b4 P b7ab4784c7344b939bc36f639286f377 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:20:40.195849  6732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbdf895bba214ff68685a24fd17dfb5d" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 14 candidate_status { last_received { term: 12 index: 5 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:40.208055  6731 rpcz_store.cc:276] 0709 13:20:39.151114 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:39.151881 (+   767us) service_pool.cc:224] Handling call
0709 13:20:39.152199 (+   318us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:39.152479 (+   280us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:20:39.503758 (+351279us) log.cc:844] Serialized 14 byte log entry
0709 13:20:39.708861 (+205103us) log.cc:844] Serialized 14 byte log entry
0709 13:20:40.172938 (+464077us) spinlock_profiling.cc:243] Waited 5.02 ms on lock 0x7b18002a13c0. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc15785de1 00007fcc157925b1 00007fcc0c837c0a 00007fcc15f77219 00007fcc0c8bfa40 00007fcc0c8ba4e4 00007fcc0c8ba455 00007fcc0f9a2060 00007fcc0f9b4716 00007fcc0f9c5287 00007fcc0f9c5208
0709 13:20:40.173199 (+   261us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:20:40.173273 (+    74us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:20:40.173353 (+    80us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:40.173479 (+   126us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:40.173647 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":537131,"prepare.queue_time_us":125964,"prepare.run_cpu_time_us":94,"prepare.run_wall_time_us":98,"raft.queue_time_us":471768,"raft.run_cpu_time_us":325,"raft.run_wall_time_us":23080,"spinlock_wait_cycles":11539712,"thread_start_us":447012,"threads_started":2,"wal-append.queue_time_us":257418}
I20260709 13:20:40.204684  6726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be1a92657f494cac8dd227d152f50151" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:40.206194  7503 raft_consensus.cc:1275] T 7ba5dac66ab5497e9e336f2a3c28cda5 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 15 FOLLOWER]: Refusing update from remote peer cd75a17ab2604397adab03bb8b5fd75c: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:20:40.211468  6723 raft_consensus.cc:1240] T 7c44c4849aa54f2b94d1f1bef9ed546f P ccd8a4c3bfe3413cb2ae219b09aea832 [term 16 FOLLOWER]: Rejecting Update request from peer b7ab4784c7344b939bc36f639286f377 for earlier term 15. Current term is 16. Ops: []
I20260709 13:20:40.215939  6732 raft_consensus.cc:2468] T dbdf895bba214ff68685a24fd17dfb5d P ccd8a4c3bfe3413cb2ae219b09aea832 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 13.
I20260709 13:20:40.213688 12138 raft_consensus.cc:493] T 7a734b5ab7834e05a8c422208acc58b1 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:40.223282  6728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "853ac0a8cbd64ce99457f170216d4d0f" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:40.223373 12138 raft_consensus.cc:515] T 7a734b5ab7834e05a8c422208acc58b1 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:40.209455 11781 raft_consensus.cc:493] T 3fa34c08b205435dba97346991aa1f92 P cd75a17ab2604397adab03bb8b5fd75c [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:40.223981  6728 raft_consensus.cc:2468] T 853ac0a8cbd64ce99457f170216d4d0f P ccd8a4c3bfe3413cb2ae219b09aea832 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 13.
W20260709 13:20:40.227308  6773 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:40.228291  6724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c240553ce044eedb41541d72b9475d7" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:20:40.229934  6731 raft_consensus.cc:1275] T 7a734b5ab7834e05a8c422208acc58b1 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 15 FOLLOWER]: Refusing update from remote peer b7ab4784c7344b939bc36f639286f377: Log matching property violated. Preceding OpId in replica: term: 13 index: 5. Preceding OpId from leader: term: 15 index: 7. (index mismatch)
I20260709 13:20:40.230258  6724 raft_consensus.cc:3060] T 2c240553ce044eedb41541d72b9475d7 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:40.209679 12079 raft_consensus.cc:3055] T 7c44c4849aa54f2b94d1f1bef9ed546f P b7ab4784c7344b939bc36f639286f377 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:20:40.232878  6729 raft_consensus.cc:3055] T a3022224cc81473690653a83d4e99470 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:20:40.225519 11781 raft_consensus.cc:515] T 3fa34c08b205435dba97346991aa1f92 P cd75a17ab2604397adab03bb8b5fd75c [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:20:40.234776  6729 raft_consensus.cc:740] T a3022224cc81473690653a83d4e99470 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
I20260709 13:20:40.219106 12156 raft_consensus.cc:740] T 22ccee1b570c4ad3a57bd7aec085b1b4 P b7ab4784c7344b939bc36f639286f377 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
I20260709 13:20:40.219448 12080 raft_consensus.cc:493] T c4db81d9d329422bb3b4160ca4ac2d1d P b7ab4784c7344b939bc36f639286f377 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:40.228577 12043 consensus_queue.cc:1048] T 7ba5dac66ab5497e9e336f2a3c28cda5 P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.050s
I20260709 13:20:40.219799 12130 raft_consensus.cc:515] T d8292e16e5654be6bc408560cf256aaa P b7ab4784c7344b939bc36f639286f377 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:40.220235 12157 raft_consensus.cc:515] T 95a75bfe094d4bdc963aba3f08dfcd25 P b7ab4784c7344b939bc36f639286f377 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:40.345592  5625 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:20:40.344450  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 147937us
I20260709 13:20:40.441947  6844 leader_election.cc:304] T 4275cf08e63345f993bce8664eada830 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:20:40.443682  6844 leader_election.cc:304] T d8cee0accdb8499c86d4414b72565a38 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, b7ab4784c7344b939bc36f639286f377
I20260709 13:20:40.286278  6724 raft_consensus.cc:2468] T 2c240553ce044eedb41541d72b9475d7 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 17.
I20260709 13:20:40.445142  6844 leader_election.cc:304] T 9e326172347f45e99a0d482b5d8ef768 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:20:40.234172 12169 raft_consensus.cc:2749] T 30e88460611e47b2ba16a46a30b5f416 P cd75a17ab2604397adab03bb8b5fd75c [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:20:40.457845  6723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de3186201e1a40d0b335eeb8b4e256e0" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:40.473420  6724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d9def8b32fd443aa94ab1420b06837b" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:40.259387  6729 consensus_queue.cc:260] T a3022224cc81473690653a83d4e99470 P ccd8a4c3bfe3413cb2ae219b09aea832 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:40.484952  7502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fa34c08b205435dba97346991aa1f92" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 18 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:20:40.234607 12079 raft_consensus.cc:740] T 7c44c4849aa54f2b94d1f1bef9ed546f P b7ab4784c7344b939bc36f639286f377 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
I20260709 13:20:40.395227 12137 raft_consensus.cc:493] T f3f9c2e2bf644115957398fe4c9459db P b7ab4784c7344b939bc36f639286f377 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:40.313988 11781 leader_election.cc:290] T 3fa34c08b205435dba97346991aa1f92 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:20:40.455753 12180 raft_consensus.cc:2749] T 4275cf08e63345f993bce8664eada830 P cd75a17ab2604397adab03bb8b5fd75c [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:20:40.495844  6729 raft_consensus.cc:3060] T a3022224cc81473690653a83d4e99470 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:20:40.497547  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 52485us
I20260709 13:20:40.275940 11954 raft_consensus.cc:493] T 4f00a2e87e56452083b759f60d461ee3 P b7ab4784c7344b939bc36f639286f377 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:40.418532 12167 raft_consensus.cc:2749] T 427c124d773f483294511e80fe340075 P cd75a17ab2604397adab03bb8b5fd75c [term 14 FOLLOWER]: Leader election lost for term 13. Reason: Vote denied by peer b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817) with higher term. Message: Invalid argument: T 427c124d773f483294511e80fe340075 P b7ab4784c7344b939bc36f639286f377 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c for earlier term 13. Current term is 14.
I20260709 13:20:40.470974 12194 raft_consensus.cc:2749] T d8cee0accdb8499c86d4414b72565a38 P cd75a17ab2604397adab03bb8b5fd75c [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:20:40.509007 12138 leader_election.cc:290] T 7a734b5ab7834e05a8c422208acc58b1 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:40.509294 11781 consensus_queue.cc:1048] T 7ba5dac66ab5497e9e336f2a3c28cda5 P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:20:40.486076 12080 raft_consensus.cc:515] T c4db81d9d329422bb3b4160ca4ac2d1d P b7ab4784c7344b939bc36f639286f377 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:40.514421  6844 leader_election.cc:304] T 853ac0a8cbd64ce99457f170216d4d0f P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
W20260709 13:20:40.503484 12177 log.cc:927] Time spent T b56bf91d90824c959e21e0cee5ba1816 P cd75a17ab2604397adab03bb8b5fd75c: Append to log took a long time: real 0.501s	user 0.000s	sys 0.013s
I20260709 13:20:40.516165  6723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6869f07b5a4885a0b99fbe60c3b175" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 17 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:40.517685  6844 leader_election.cc:304] T 711ef6523deb4cbe8ef2ba61e1c21c98 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:20:40.498421 12104 raft_consensus.cc:493] T e31b9971c15848dea59d4d4130141d9e P b7ab4784c7344b939bc36f639286f377 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:40.509672 12131 leader_election.cc:290] T 8c7f33e544204fbaac4078e3e83bbf4e P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:40.525255  6727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3411566abe2d4c9bb4b2adfdd05e6f17" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:20:40.500962 12197 raft_consensus.cc:2749] T 9e326172347f45e99a0d482b5d8ef768 P cd75a17ab2604397adab03bb8b5fd75c [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:20:40.432674 12156 consensus_queue.cc:260] T 22ccee1b570c4ad3a57bd7aec085b1b4 P b7ab4784c7344b939bc36f639286f377 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
W20260709 13:20:40.527577  6697 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 311991us
I20260709 13:20:40.547572  6697 leader_election.cc:304] T f03d0dbf16864ca4bc1bb5e4c0334c0f P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:20:40.549127  6723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a92dd554674067a83a9cb68c4773f2" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:40.529531  6729 raft_consensus.cc:1275] T a3022224cc81473690653a83d4e99470 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 16 FOLLOWER]: Refusing update from remote peer b7ab4784c7344b939bc36f639286f377: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 13:20:40.516363 12180 raft_consensus.cc:2804] T 853ac0a8cbd64ce99457f170216d4d0f P cd75a17ab2604397adab03bb8b5fd75c [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:20:40.551620  6729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fa34c08b205435dba97346991aa1f92" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 18 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:40.552490  6729 raft_consensus.cc:2410] T 3fa34c08b205435dba97346991aa1f92 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c for term 18 because replica has last-logged OpId of term: 17 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 13.
I20260709 13:20:40.498827 12137 raft_consensus.cc:515] T f3f9c2e2bf644115957398fe4c9459db P b7ab4784c7344b939bc36f639286f377 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:40.539665  6727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f9c2e2bf644115957398fe4c9459db" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:40.552853  6697 leader_election.cc:304] T 24ee15416e3145beaa1b8183453729a3 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:20:40.555631  6727 raft_consensus.cc:2468] T f3f9c2e2bf644115957398fe4c9459db P ccd8a4c3bfe3413cb2ae219b09aea832 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 14.
I20260709 13:20:40.526157 11781 raft_consensus.cc:2804] T 711ef6523deb4cbe8ef2ba61e1c21c98 P cd75a17ab2604397adab03bb8b5fd75c [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:20:40.554646  6724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b56bf91d90824c959e21e0cee5ba1816" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:40.522065 12104 raft_consensus.cc:515] T e31b9971c15848dea59d4d4130141d9e P b7ab4784c7344b939bc36f639286f377 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:40.514237 11954 raft_consensus.cc:515] T 4f00a2e87e56452083b759f60d461ee3 P b7ab4784c7344b939bc36f639286f377 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:20:40.504750 11955 raft_consensus.cc:359] T 7a734b5ab7834e05a8c422208acc58b1 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 15 NON_PARTICIPANT]: Replica starting. Triggering 1 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:40.566385  6873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3d8792045a4583ae2e965b1350a5b4" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:40.547036 12194 raft_consensus.cc:493] T 1bf4668eeb70467fb3dc5a0289233b3c P cd75a17ab2604397adab03bb8b5fd75c [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:40.567664  6844 leader_election.cc:304] T e77e330a82df4b43a745d57a68f6f057 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:20:40.554493 12138 raft_consensus.cc:2804] T f03d0dbf16864ca4bc1bb5e4c0334c0f P ccd8a4c3bfe3413cb2ae219b09aea832 [term 14 FOLLOWER]: Leader pre-election won for term 15
W20260709 13:20:40.559684 11994 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 16 current term: 16 is higher.
I20260709 13:20:40.555048 12180 raft_consensus.cc:493] T 853ac0a8cbd64ce99457f170216d4d0f P cd75a17ab2604397adab03bb8b5fd75c [term 12 FOLLOWER]: Starting leader election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:20:40.571918  6873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "427c124d773f483294511e80fe340075" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:20:40.572957  6881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ba5dac66ab5497e9e336f2a3c28cda5" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:40.574846  6877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "427c124d773f483294511e80fe340075" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:40.575502 12150 raft_consensus.cc:493] T 3d65025eea89441290d85dd053810e31 P b7ab4784c7344b939bc36f639286f377 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:40.576658  6872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24ee15416e3145beaa1b8183453729a3" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:20:40.592620  6872 raft_consensus.cc:2376] T 24ee15416e3145beaa1b8183453729a3 P cd75a17ab2604397adab03bb8b5fd75c [term 18 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in term 18. Re-sending same reply.
I20260709 13:20:40.561633 12195 raft_consensus.cc:493] T bb7fa124c3bf4ef9ab65a407cb008441 P cd75a17ab2604397adab03bb8b5fd75c [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 7ba59cc884714e8aa5f3f0ecaed84cbb)
I20260709 13:20:40.584280  6844 leader_election.cc:304] T 9b3759de40694069b13c0f8bd40e5709 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377
I20260709 13:20:40.575884  6876 raft_consensus.cc:1275] T 427c124d773f483294511e80fe340075 P cd75a17ab2604397adab03bb8b5fd75c [term 14 FOLLOWER]: Refusing update from remote peer 7ba59cc884714e8aa5f3f0ecaed84cbb: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:20:40.557763 12080 leader_election.cc:290] T c4db81d9d329422bb3b4160ca4ac2d1d P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:40.509007 12079 consensus_queue.cc:260] T 7c44c4849aa54f2b94d1f1bef9ed546f P b7ab4784c7344b939bc36f639286f377 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:40.571043 12156 raft_consensus.cc:3060] T 22ccee1b570c4ad3a57bd7aec085b1b4 P b7ab4784c7344b939bc36f639286f377 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:40.571516 12167 raft_consensus.cc:493] T 4b8cacb381b746da8d0049b0a83b41dd P cd75a17ab2604397adab03bb8b5fd75c [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 7ba59cc884714e8aa5f3f0ecaed84cbb)
I20260709 13:20:40.567055 11781 raft_consensus.cc:697] T 711ef6523deb4cbe8ef2ba61e1c21c98 P cd75a17ab2604397adab03bb8b5fd75c [term 17 LEADER]: Becoming Leader. State: Replica: cd75a17ab2604397adab03bb8b5fd75c, State: Running, Role: LEADER
I20260709 13:20:40.588871 12047 raft_consensus.cc:2749] T e77e330a82df4b43a745d57a68f6f057 P cd75a17ab2604397adab03bb8b5fd75c [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:20:40.591364 12180 raft_consensus.cc:3060] T 853ac0a8cbd64ce99457f170216d4d0f P cd75a17ab2604397adab03bb8b5fd75c [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:40.597131  6844 leader_election.cc:304] T 90d42e216d9741e190bca19a781291fd P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377
I20260709 13:20:40.594177  6729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a734b5ab7834e05a8c422208acc58b1" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 16 candidate_status { last_received { term: 13 index: 5 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:40.597433  6723 raft_consensus.cc:1275] T 713b5728a197487c9300b310ab94e5a3 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 14 FOLLOWER]: Refusing update from remote peer b7ab4784c7344b939bc36f639286f377: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:20:40.573423 12138 raft_consensus.cc:493] T f03d0dbf16864ca4bc1bb5e4c0334c0f P ccd8a4c3bfe3413cb2ae219b09aea832 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:40.593209 12201 raft_consensus.cc:2804] T 24ee15416e3145beaa1b8183453729a3 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:20:40.629102 12201 raft_consensus.cc:493] T 24ee15416e3145beaa1b8183453729a3 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 7ba59cc884714e8aa5f3f0ecaed84cbb)
I20260709 13:20:40.629702 12201 raft_consensus.cc:3060] T 24ee15416e3145beaa1b8183453729a3 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:20:40.632194 12138 raft_consensus.cc:3060] T f03d0dbf16864ca4bc1bb5e4c0334c0f P ccd8a4c3bfe3413cb2ae219b09aea832 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:40.595116 11774 consensus_queue.cc:1048] T 3fa34c08b205435dba97346991aa1f92 P 7ba59cc884714e8aa5f3f0ecaed84cbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.038s
I20260709 13:20:40.601881 12167 raft_consensus.cc:515] T 4b8cacb381b746da8d0049b0a83b41dd P cd75a17ab2604397adab03bb8b5fd75c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:20:40.636837 12167 leader_election.cc:290] T 4b8cacb381b746da8d0049b0a83b41dd P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
W20260709 13:20:40.636986 12198 log.cc:927] Time spent T 2c240553ce044eedb41541d72b9475d7 P b7ab4784c7344b939bc36f639286f377: Append to log took a long time: real 0.083s	user 0.000s	sys 0.000s
I20260709 13:20:40.637704 12167 raft_consensus.cc:2804] T 90d42e216d9741e190bca19a781291fd P cd75a17ab2604397adab03bb8b5fd75c [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:20:40.638199 12167 raft_consensus.cc:493] T 90d42e216d9741e190bca19a781291fd P cd75a17ab2604397adab03bb8b5fd75c [term 14 FOLLOWER]: Starting leader election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:20:40.638645 12167 raft_consensus.cc:3060] T 90d42e216d9741e190bca19a781291fd P cd75a17ab2604397adab03bb8b5fd75c [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:40.640230 12079 raft_consensus.cc:3060] T 7c44c4849aa54f2b94d1f1bef9ed546f P b7ab4784c7344b939bc36f639286f377 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:40.656850 11781 consensus_queue.cc:237] T 711ef6523deb4cbe8ef2ba61e1c21c98 P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.9, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:40.600211 12197 raft_consensus.cc:2804] T 9b3759de40694069b13c0f8bd40e5709 P cd75a17ab2604397adab03bb8b5fd75c [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:20:40.658891 12197 raft_consensus.cc:493] T 9b3759de40694069b13c0f8bd40e5709 P cd75a17ab2604397adab03bb8b5fd75c [term 11 FOLLOWER]: Starting leader election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:20:40.659474 12197 raft_consensus.cc:3060] T 9b3759de40694069b13c0f8bd40e5709 P cd75a17ab2604397adab03bb8b5fd75c [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:20:40.664271 12157 leader_election.cc:290] T 95a75bfe094d4bdc963aba3f08dfcd25 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:40.585194 12194 raft_consensus.cc:515] T 1bf4668eeb70467fb3dc5a0289233b3c P cd75a17ab2604397adab03bb8b5fd75c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:40.594849 12150 raft_consensus.cc:515] T 3d65025eea89441290d85dd053810e31 P b7ab4784c7344b939bc36f639286f377 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:40.670042 12150 leader_election.cc:290] T 3d65025eea89441290d85dd053810e31 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:40.603681 12195 raft_consensus.cc:515] T bb7fa124c3bf4ef9ab65a407cb008441 P cd75a17ab2604397adab03bb8b5fd75c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:20:40.671958 12104 leader_election.cc:290] T e31b9971c15848dea59d4d4130141d9e P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:40.674652 12195 leader_election.cc:290] T bb7fa124c3bf4ef9ab65a407cb008441 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
W20260709 13:20:40.681411  6771 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:40.693859  6729 raft_consensus.cc:1275] T ab432e62819d499eaaf3dd55481dd930 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 17 FOLLOWER]: Refusing update from remote peer b7ab4784c7344b939bc36f639286f377: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 17 index: 9. (index mismatch)
I20260709 13:20:40.695381  6729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbdf895bba214ff68685a24fd17dfb5d" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 14 candidate_status { last_received { term: 12 index: 5 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
W20260709 13:20:40.699520  6773 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:40.699414  6729 raft_consensus.cc:3060] T dbdf895bba214ff68685a24fd17dfb5d P ccd8a4c3bfe3413cb2ae219b09aea832 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:20:40.708599  7468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 172030us
I20260709 13:20:40.712870 11955 raft_consensus.cc:740] T 7a734b5ab7834e05a8c422208acc58b1 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 15 LEARNER]: Becoming Follower/Learner. State: Replica: 7ba59cc884714e8aa5f3f0ecaed84cbb, State: Initialized, Role: LEARNER
I20260709 13:20:40.719871  6723 raft_consensus.cc:1240] T 34f36d59d88f40fe8a2805e604fc6c0a P ccd8a4c3bfe3413cb2ae219b09aea832 [term 13 FOLLOWER]: Rejecting Update request from peer b7ab4784c7344b939bc36f639286f377 for earlier term 12. Current term is 13. Ops: []
W20260709 13:20:40.722440  6697 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 163996us
W20260709 13:20:40.716750 12121 consensus_meta.cc:287] T 20f6842e26174571996b8dea4151d4be P cd75a17ab2604397adab03bb8b5fd75c: Time spent flushing consensus metadata: real 0.524s	user 0.006s	sys 0.005s
I20260709 13:20:40.733238  6729 raft_consensus.cc:2468] T dbdf895bba214ff68685a24fd17dfb5d P ccd8a4c3bfe3413cb2ae219b09aea832 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 14.
I20260709 13:20:40.736661 12138 raft_consensus.cc:515] T f03d0dbf16864ca4bc1bb5e4c0334c0f P ccd8a4c3bfe3413cb2ae219b09aea832 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:40.718645 12204 raft_consensus.cc:493] T be1a92657f494cac8dd227d152f50151 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 7ba59cc884714e8aa5f3f0ecaed84cbb)
I20260709 13:20:40.744170 12208 consensus_queue.cc:1048] T 24ee15416e3145beaa1b8183453729a3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:20:40.745678 12092 raft_consensus.cc:3055] T 34f36d59d88f40fe8a2805e604fc6c0a P b7ab4784c7344b939bc36f639286f377 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:20:40.746394 12011 raft_consensus.cc:493] T 3a485a995abc4807b6e511e45419f737 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:40.746491 12194 leader_election.cc:290] T 1bf4668eeb70467fb3dc5a0289233b3c P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
W20260709 13:20:40.749075 12188 log.cc:927] Time spent T 44bde925b2e541b69890d70715b85176 P cd75a17ab2604397adab03bb8b5fd75c: Append to log took a long time: real 0.747s	user 0.014s	sys 0.001s
I20260709 13:20:40.752588 12095 consensus_queue.cc:1048] T 8c7f33e544204fbaac4078e3e83bbf4e P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:20:40.758057  6876 raft_consensus.cc:1275] T 1bf4668eeb70467fb3dc5a0289233b3c P cd75a17ab2604397adab03bb8b5fd75c [term 14 FOLLOWER]: Refusing update from remote peer ccd8a4c3bfe3413cb2ae219b09aea832: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:20:40.759255  6874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a734b5ab7834e05a8c422208acc58b1" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 16 candidate_status { last_received { term: 13 index: 5 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
W20260709 13:20:40.783576  7468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 72933.7us
I20260709 13:20:40.784108  6873 raft_consensus.cc:1275] T a3022224cc81473690653a83d4e99470 P cd75a17ab2604397adab03bb8b5fd75c [term 16 FOLLOWER]: Refusing update from remote peer b7ab4784c7344b939bc36f639286f377: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 13:20:40.730705 12121 raft_consensus.cc:2749] T 20f6842e26174571996b8dea4151d4be P cd75a17ab2604397adab03bb8b5fd75c [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:20:40.801465  6771 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:40.805764  6874 raft_consensus.cc:2468] T 7a734b5ab7834e05a8c422208acc58b1 P cd75a17ab2604397adab03bb8b5fd75c [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 15.
I20260709 13:20:40.823622  6874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8cee0accdb8499c86d4414b72565a38" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
W20260709 13:20:40.829638  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 232561us
I20260709 13:20:40.824483  6874 raft_consensus.cc:2468] T d8cee0accdb8499c86d4414b72565a38 P cd75a17ab2604397adab03bb8b5fd75c [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 14.
I20260709 13:20:40.831452  6844 leader_election.cc:304] T 22ccee1b570c4ad3a57bd7aec085b1b4 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
W20260709 13:20:40.831615  6806 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50550 (request call id 592) took 1483 ms (client timeout 1525 ms). Trace:
I20260709 13:20:40.831868  6874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de3186201e1a40d0b335eeb8b4e256e0" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:40.808568 12204 raft_consensus.cc:515] T be1a92657f494cac8dd227d152f50151 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:20:40.837082 12204 leader_election.cc:290] T be1a92657f494cac8dd227d152f50151 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:20:40.830088  6876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb7fa124c3bf4ef9ab65a407cb008441" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
W20260709 13:20:40.832458  6806 rpcz_store.cc:269] 0709 13:20:39.348396 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:39.348570 (+   174us) service_pool.cc:224] Handling call
0709 13:20:40.831419 (+1482849us) spinlock_profiling.cc:243] Waited 16.6 ms on lock 0x7b54001b4ed4. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f9ae2fa 00007fcc1496fb17 00007fcc0deea6d4 00007fcc0deea662 00007fcc0deea591 00007fcc0deea50c 00007fcc0dee97c2 00007fcc0dce548c 00007fcc0dce48c6 00007fcc0dce426f
0709 13:20:40.831550 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":38240512}
I20260709 13:20:40.838909  6873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30e88460611e47b2ba16a46a30b5f416" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:40.797302 12208 consensus_queue.cc:1243] T 24ee15416e3145beaa1b8183453729a3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [LEADER]: Peer cd75a17ab2604397adab03bb8b5fd75c log is divergent from this leader: its last log entry 15.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 13:20:40.854084  6877 raft_consensus.cc:1240] T 3411566abe2d4c9bb4b2adfdd05e6f17 P cd75a17ab2604397adab03bb8b5fd75c [term 13 FOLLOWER]: Rejecting Update request from peer b7ab4784c7344b939bc36f639286f377 for earlier term 12. Current term is 13. Ops: []
I20260709 13:20:40.857854  6877 raft_consensus.cc:1240] T 22ccee1b570c4ad3a57bd7aec085b1b4 P cd75a17ab2604397adab03bb8b5fd75c [term 13 FOLLOWER]: Rejecting Update request from peer b7ab4784c7344b939bc36f639286f377 for earlier term 12. Current term is 13. Ops: []
I20260709 13:20:40.860057  6844 leader_election.cc:304] T f4b8bd455d5a47c18a1380839c6e0d61 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:20:40.861110 11781 raft_consensus.cc:2749] T 22ccee1b570c4ad3a57bd7aec085b1b4 P cd75a17ab2604397adab03bb8b5fd75c [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:20:40.795887 12092 raft_consensus.cc:740] T 34f36d59d88f40fe8a2805e604fc6c0a P b7ab4784c7344b939bc36f639286f377 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
I20260709 13:20:40.863775  6844 leader_election.cc:304] T a1704639a875409b9959353527b3fd68 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:20:40.865979  6876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c7f33e544204fbaac4078e3e83bbf4e" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 14 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:40.869975  5625 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:20:40.807544 12011 raft_consensus.cc:515] T 3a485a995abc4807b6e511e45419f737 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:40.867516 12090 raft_consensus.cc:493] T 1bf4668eeb70467fb3dc5a0289233b3c P b7ab4784c7344b939bc36f639286f377 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:20:40.891958  6695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 164796us
I20260709 13:20:40.847774 12206 raft_consensus.cc:493] T 3fa34c08b205435dba97346991aa1f92 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 7ba59cc884714e8aa5f3f0ecaed84cbb)
I20260709 13:20:40.894563  6876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d9def8b32fd443aa94ab1420b06837b" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:40.863611 12204 raft_consensus.cc:493] T 404190ce4ce94cecbfcb6ea9d1dd8626 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 7ba59cc884714e8aa5f3f0ecaed84cbb)
I20260709 13:20:40.880060 11781 raft_consensus.cc:2749] T a1704639a875409b9959353527b3fd68 P cd75a17ab2604397adab03bb8b5fd75c [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:20:40.913089 12138 leader_election.cc:290] T f03d0dbf16864ca4bc1bb5e4c0334c0f P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 15 election: Requested vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:40.913898 12196 raft_consensus.cc:2749] T f4b8bd455d5a47c18a1380839c6e0d61 P cd75a17ab2604397adab03bb8b5fd75c [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:20:40.786969 11955 consensus_queue.cc:260] T 7a734b5ab7834e05a8c422208acc58b1 P 7ba59cc884714e8aa5f3f0ecaed84cbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 5, Last appended: 13.6, Last appended by leader: 6, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } attrs { replace: true } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: NON_VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: true } }
I20260709 13:20:40.917805 11955 ts_tablet_manager.cc:1434] T 7a734b5ab7834e05a8c422208acc58b1 P 7ba59cc884714e8aa5f3f0ecaed84cbb: Time spent starting tablet: real 0.707s	user 0.012s	sys 0.003s
W20260709 13:20:40.918268 11955 ts_tablet_manager.cc:1467] T 7a734b5ab7834e05a8c422208acc58b1 P 7ba59cc884714e8aa5f3f0ecaed84cbb: Tablet startup took 761ms
I20260709 13:20:40.918401 12167 raft_consensus.cc:515] T 90d42e216d9741e190bca19a781291fd P cd75a17ab2604397adab03bb8b5fd75c [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:40.909871 12011 leader_election.cc:290] T 3a485a995abc4807b6e511e45419f737 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:40.925577  6879 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53416 (request call id 3218) took 1401 ms. Trace:
I20260709 13:20:40.931223  6879 rpcz_store.cc:276] 0709 13:20:39.524478 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:39.536382 (+ 11904us) service_pool.cc:224] Handling call
0709 13:20:39.536878 (+   496us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:39.762552 (+225674us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:39.762609 (+    57us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:20:39.823573 (+ 60964us) log.cc:844] Serialized 26 byte log entry
0709 13:20:39.951329 (+127756us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:20:39.951373 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:39.951456 (+    83us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:40.748183 (+796727us) spinlock_profiling.cc:243] Waited 5.1 ms on lock 0x7b4400022b4c. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0c745db1 00007fcc0c7e3c85 00007fcc0c7e46a2 00007fcc0f5561db 00007fcc0f551aaf 00007fcc0f54586e 00007fcc0f544bb6 00007fcc0f5447d8 00007fcc0f54e221 00007fcc0f54e1d9 00007fcc0f54e169
0709 13:20:40.899336 (+151153us) raft_consensus.cc:1685] finished
0709 13:20:40.899374 (+    38us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:40.925466 (+ 26092us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":40638,"raft.queue_time_us":57402,"raft.run_cpu_time_us":208,"raft.run_wall_time_us":28573,"spinlock_wait_cycles":11730176,"thread_start_us":273841,"threads_started":2,"wal-append.queue_time_us":162480}
I20260709 13:20:40.898720 12213 consensus_queue.cc:1048] T 427c124d773f483294511e80fe340075 P 7ba59cc884714e8aa5f3f0ecaed84cbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.035s
I20260709 13:20:40.928200 12204 raft_consensus.cc:515] T 404190ce4ce94cecbfcb6ea9d1dd8626 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:20:40.930182  6877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6869f07b5a4885a0b99fbe60c3b175" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 17 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:40.892050 11710 raft_consensus.cc:493] T e77e330a82df4b43a745d57a68f6f057 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:20:40.938563  6879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a92dd554674067a83a9cb68c4773f2" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:40.935390 12167 leader_election.cc:290] T 90d42e216d9741e190bca19a781291fd P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 15 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:20:40.940917  6878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbdf895bba214ff68685a24fd17dfb5d" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 14 candidate_status { last_received { term: 12 index: 5 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:20:40.898279  6695 leader_election.cc:304] T 34f36d59d88f40fe8a2805e604fc6c0a P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:20:40.943647  6878 raft_consensus.cc:3060] T dbdf895bba214ff68685a24fd17dfb5d P cd75a17ab2604397adab03bb8b5fd75c [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:20:40.944396  6695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 46283.8us
I20260709 13:20:40.953032  6877 raft_consensus.cc:1275] T ab432e62819d499eaaf3dd55481dd930 P cd75a17ab2604397adab03bb8b5fd75c [term 17 FOLLOWER]: Refusing update from remote peer b7ab4784c7344b939bc36f639286f377: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 17 index: 9. (index mismatch)
I20260709 13:20:40.954577  6877 pending_rounds.cc:85] T 24ee15416e3145beaa1b8183453729a3 P cd75a17ab2604397adab03bb8b5fd75c: Aborting all ops after (but not including) 8
I20260709 13:20:40.954890  6877 pending_rounds.cc:107] T 24ee15416e3145beaa1b8183453729a3 P cd75a17ab2604397adab03bb8b5fd75c: Aborting uncommitted NO_OP operation due to leader change: 15.9
I20260709 13:20:40.955155  6877 raft_consensus.cc:2889] T 24ee15416e3145beaa1b8183453729a3 P cd75a17ab2604397adab03bb8b5fd75c [term 18 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:20:40.958037  6880 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53416 (request call id 3213) took 1515 ms. Trace:
I20260709 13:20:40.958257 11710 raft_consensus.cc:515] T e77e330a82df4b43a745d57a68f6f057 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } }
I20260709 13:20:40.960952 11710 leader_election.cc:290] T e77e330a82df4b43a745d57a68f6f057 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:40.938066 12092 consensus_queue.cc:260] T 34f36d59d88f40fe8a2805e604fc6c0a P b7ab4784c7344b939bc36f639286f377 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:40.962529 12092 raft_consensus.cc:3060] T 34f36d59d88f40fe8a2805e604fc6c0a P b7ab4784c7344b939bc36f639286f377 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:40.963893  6732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30e88460611e47b2ba16a46a30b5f416" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:40.961818 12102 leader_election.cc:290] T d8cee0accdb8499c86d4414b72565a38 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:20:40.967031  6805 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50550 (request call id 593) took 1600 ms. Trace:
I20260709 13:20:40.972220  6728 raft_consensus.cc:1240] T b3f13b31a1f84f0d89d007eadd57924c P ccd8a4c3bfe3413cb2ae219b09aea832 [term 13 FOLLOWER]: Rejecting Update request from peer b7ab4784c7344b939bc36f639286f377 for earlier term 12. Current term is 13. Ops: []
I20260709 13:20:40.975986 12148 leader_election.cc:290] T bb7fa124c3bf4ef9ab65a407cb008441 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
W20260709 13:20:40.977106  6773 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:40.967582  6805 rpcz_store.cc:276] 0709 13:20:39.367081 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:39.367219 (+   138us) service_pool.cc:224] Handling call
0709 13:20:39.367594 (+   375us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:39.731176 (+363582us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:39.731223 (+    47us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:20:39.731277 (+    54us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:20:39.731333 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:40.966714 (+1235381us) spinlock_profiling.cc:243] Waited 363 ms on lock 0x7b5400331b54. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f9aae01 00007fcc0f9a983e 00007fcc1496e419 00007fcc0dee5bd4 00007fcc0dee5b62 00007fcc0dee5a91 00007fcc0dee5a0c 00007fcc0dee4cc2 00007fcc0dce548c 00007fcc0dce48c6
0709 13:20:40.966779 (+    65us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:40.966951 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":835630976}
W20260709 13:20:40.978999  6616 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet ce4f062dcd314d43a63ca74067cb5ee3 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER failed with leader 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 7ba59cc884714e8aa5f3f0ecaed84cbb is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 15 leader_uuid: "b7ab4784c7344b939bc36f639286f377" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } attrs { replace: true } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } } }
I20260709 13:20:40.925206 12206 raft_consensus.cc:515] T 3fa34c08b205435dba97346991aa1f92 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:20:40.981997  6798 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50550 (request call id 594) took 1613 ms. Trace:
I20260709 13:20:40.924824 12090 raft_consensus.cc:515] T 1bf4668eeb70467fb3dc5a0289233b3c P b7ab4784c7344b939bc36f639286f377 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:40.982498  6798 rpcz_store.cc:276] 0709 13:20:39.368450 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:39.369476 (+  1026us) service_pool.cc:224] Handling call
0709 13:20:39.423030 (+ 53554us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:39.717479 (+294449us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:39.717522 (+    43us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:20:39.717576 (+    54us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:20:39.717624 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:40.981703 (+1264079us) spinlock_profiling.cc:243] Waited 294 ms on lock 0x7b54001cb6d4. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f9aae01 00007fcc0f9a983e 00007fcc1496e419 00007fcc0dee5bd4 00007fcc0dee5b62 00007fcc0dee5a91 00007fcc0dee5a0c 00007fcc0dee4cc2 00007fcc0dce548c 00007fcc0dce48c6
0709 13:20:40.981764 (+    61us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:40.981909 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":676601728}
I20260709 13:20:40.985219  7503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b8cacb381b746da8d0049b0a83b41dd" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:20:40.984932 12090 leader_election.cc:290] T 1bf4668eeb70467fb3dc5a0289233b3c P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:40.988149 12204 leader_election.cc:290] T 404190ce4ce94cecbfcb6ea9d1dd8626 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
W20260709 13:20:40.989706  6695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 44368.5us
I20260709 13:20:41.012939  6728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b8cacb381b746da8d0049b0a83b41dd" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:41.014171  6728 raft_consensus.cc:2393] T 4b8cacb381b746da8d0049b0a83b41dd P ccd8a4c3bfe3413cb2ae219b09aea832 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c in current term 15: Already voted for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in this term.
I20260709 13:20:41.016048  6723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90d42e216d9741e190bca19a781291fd" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:20:40.936730 12138 raft_consensus.cc:493] T ab432e62819d499eaaf3dd55481dd930 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:41.023063  6732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bf4668eeb70467fb3dc5a0289233b3c" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:40.958586  6880 rpcz_store.cc:276] 0709 13:20:39.443034 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:39.459778 (+ 16744us) service_pool.cc:224] Handling call
0709 13:20:39.468559 (+  8781us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 13:20:39.571990 (+103431us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:39.572025 (+    35us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 13:20:39.582669 (+ 10644us) log.cc:844] Serialized 78 byte log entry
0709 13:20:39.755549 (+172880us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:20:39.763430 (+  7881us) log.cc:844] Serialized 14 byte log entry
0709 13:20:39.764668 (+  1238us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:39.764806 (+   138us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:40.735298 (+970492us) spinlock_profiling.cc:243] Waited 2.85 ms on lock 0x7b4800210258. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc148d3aa1 00007fcc148cab37 00007fcc148ca9ca 00007fcc149c226f 00007fcc149c1f37 00007fcc149d655c 00007fcc149d6508 00007fcc149d6488 00007fcc149d6443 00007fcc149d56ec 00007fcc138ffa96
0709 13:20:40.956231 (+220933us) spinlock_profiling.cc:243] Waited 11.9 ms on lock 0x7b24002c2fe8. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0c745db1 00007fcc0c7439c4 00007fcc0c741acb 00007fcc0c8fcdc9 00007fcc0c8fca55 00007fcc0c8fbfb0 00007fcc0f572488 00007fcc0f572be8 00007fcc0f54a398 00007fcc0f54576a 00007fcc0f544bb6
0709 13:20:40.957732 (+  1501us) raft_consensus.cc:1685] finished
0709 13:20:40.957758 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:40.957963 (+   205us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":28255,"prepare.queue_time_us":7640,"prepare.run_cpu_time_us":52,"prepare.run_wall_time_us":55,"raft.queue_time_us":73077,"raft.run_cpu_time_us":10737,"raft.run_wall_time_us":1158532,"spinlock_wait_cycles":33831552,"thread_start_us":131084,"threads_started":1,"wal-append.queue_time_us":255110}
I20260709 13:20:41.025629  6844 leader_election.cc:304] T 3fa34c08b205435dba97346991aa1f92 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:20:41.030491  6878 raft_consensus.cc:2468] T dbdf895bba214ff68685a24fd17dfb5d P cd75a17ab2604397adab03bb8b5fd75c [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 14.
I20260709 13:20:41.031030  7502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb7fa124c3bf4ef9ab65a407cb008441" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:20:41.031770  6878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fa34c08b205435dba97346991aa1f92" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:41.032754  6878 raft_consensus.cc:2468] T 3fa34c08b205435dba97346991aa1f92 P cd75a17ab2604397adab03bb8b5fd75c [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 17.
I20260709 13:20:41.034886  6878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f03d0dbf16864ca4bc1bb5e4c0334c0f" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:20:41.035640  6878 raft_consensus.cc:3060] T f03d0dbf16864ca4bc1bb5e4c0334c0f P cd75a17ab2604397adab03bb8b5fd75c [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:40.982498 12206 leader_election.cc:290] T 3fa34c08b205435dba97346991aa1f92 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:20:41.036568  6880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a485a995abc4807b6e511e45419f737" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:41.037298  6880 raft_consensus.cc:2468] T 3a485a995abc4807b6e511e45419f737 P cd75a17ab2604397adab03bb8b5fd75c [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 14.
I20260709 13:20:41.022609 12218 raft_consensus.cc:2749] T 34f36d59d88f40fe8a2805e604fc6c0a P ccd8a4c3bfe3413cb2ae219b09aea832 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:20:41.040658  6844 leader_election.cc:304] T f3f9c2e2bf644115957398fe4c9459db P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:20:41.045077  6844 leader_election.cc:304] T 4b8cacb381b746da8d0049b0a83b41dd P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:20:41.028923 12043 raft_consensus.cc:493] T e31b9971c15848dea59d4d4130141d9e P cd75a17ab2604397adab03bb8b5fd75c [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:20:41.085115  6880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77e330a82df4b43a745d57a68f6f057" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:41.039700 12214 raft_consensus.cc:493] T fe20b4b48823486ca3b9c648db6ce8aa P ccd8a4c3bfe3413cb2ae219b09aea832 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader cd75a17ab2604397adab03bb8b5fd75c)
I20260709 13:20:41.040753 11710 raft_consensus.cc:493] T 17587d6730594da4a56fa13a353232a1 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:20:41.065094 12167 raft_consensus.cc:2749] T 3fa34c08b205435dba97346991aa1f92 P cd75a17ab2604397adab03bb8b5fd75c [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:20:41.030138 12138 raft_consensus.cc:515] T ab432e62819d499eaaf3dd55481dd930 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:41.072197 11576 raft_consensus.cc:2804] T f3f9c2e2bf644115957398fe4c9459db P cd75a17ab2604397adab03bb8b5fd75c [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:20:41.069204 11937 raft_consensus.cc:3060] T 4b8cacb381b746da8d0049b0a83b41dd P cd75a17ab2604397adab03bb8b5fd75c [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:20:41.099467  6695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 75726us
I20260709 13:20:41.032649 12180 raft_consensus.cc:515] T 853ac0a8cbd64ce99457f170216d4d0f P cd75a17ab2604397adab03bb8b5fd75c [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:41.026994 12197 raft_consensus.cc:515] T 9b3759de40694069b13c0f8bd40e5709 P cd75a17ab2604397adab03bb8b5fd75c [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:41.101466  6695 leader_election.cc:304] T f4b8bd455d5a47c18a1380839c6e0d61 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:20:41.101773  6878 raft_consensus.cc:2468] T f03d0dbf16864ca4bc1bb5e4c0334c0f P cd75a17ab2604397adab03bb8b5fd75c [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 15.
W20260709 13:20:41.104099  6697 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 97382.5us
I20260709 13:20:41.091725 11576 raft_consensus.cc:493] T f3f9c2e2bf644115957398fe4c9459db P cd75a17ab2604397adab03bb8b5fd75c [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:20:41.099910 12207 log.cc:927] Time spent T bd6869f07b5a4885a0b99fbe60c3b175 P ccd8a4c3bfe3413cb2ae219b09aea832: Append to log took a long time: real 0.210s	user 0.001s	sys 0.003s
I20260709 13:20:41.088369 12043 raft_consensus.cc:515] T e31b9971c15848dea59d4d4130141d9e P cd75a17ab2604397adab03bb8b5fd75c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:41.120640 11576 raft_consensus.cc:3060] T f3f9c2e2bf644115957398fe4c9459db P cd75a17ab2604397adab03bb8b5fd75c [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:41.091605 11710 raft_consensus.cc:515] T 17587d6730594da4a56fa13a353232a1 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
W20260709 13:20:41.138787  6773 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:41.140800  6695 leader_election.cc:304] T d33d5ee8ef6f415593d8df52063161ad P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
W20260709 13:20:41.146478  6770 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:41.092118 12214 raft_consensus.cc:515] T fe20b4b48823486ca3b9c648db6ce8aa P ccd8a4c3bfe3413cb2ae219b09aea832 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:20:41.152204  6770 leader_election.cc:304] T be1a92657f494cac8dd227d152f50151 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:20:41.105304 12224 consensus_queue.cc:1048] T bd6869f07b5a4885a0b99fbe60c3b175 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.035s
I20260709 13:20:41.154794 12011 raft_consensus.cc:2749] T f4b8bd455d5a47c18a1380839c6e0d61 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:20:41.153653 12156 raft_consensus.cc:493] T b56bf91d90824c959e21e0cee5ba1816 P b7ab4784c7344b939bc36f639286f377 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:41.195516  6872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d65025eea89441290d85dd053810e31" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 16 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:41.198711  6876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bf4668eeb70467fb3dc5a0289233b3c" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:41.198935  6732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e31b9971c15848dea59d4d4130141d9e" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:41.199244  6873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4db81d9d329422bb3b4160ca4ac2d1d" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:41.199923  6873 raft_consensus.cc:2468] T c4db81d9d329422bb3b4160ca4ac2d1d P cd75a17ab2604397adab03bb8b5fd75c [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 14.
I20260709 13:20:41.201936  6731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "853ac0a8cbd64ce99457f170216d4d0f" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:20:41.186864  6726 raft_consensus.cc:1240] T f03d0dbf16864ca4bc1bb5e4c0334c0f P ccd8a4c3bfe3413cb2ae219b09aea832 [term 15 FOLLOWER]: Rejecting Update request from peer b7ab4784c7344b939bc36f639286f377 for earlier term 14. Current term is 15. Ops: []
I20260709 13:20:41.202706  6731 raft_consensus.cc:2393] T 853ac0a8cbd64ce99457f170216d4d0f P ccd8a4c3bfe3413cb2ae219b09aea832 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c in current term 13: Already voted for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in this term.
W20260709 13:20:41.203899  6772 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:41.199414  6876 raft_consensus.cc:2468] T 1bf4668eeb70467fb3dc5a0289233b3c P cd75a17ab2604397adab03bb8b5fd75c [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 14.
I20260709 13:20:41.195262  6878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a75bfe094d4bdc963aba3f08dfcd25" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:41.185056  6730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c7f33e544204fbaac4078e3e83bbf4e" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 14 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:41.201620  6881 raft_consensus.cc:1275] T 3a485a995abc4807b6e511e45419f737 P cd75a17ab2604397adab03bb8b5fd75c [term 14 FOLLOWER]: Refusing update from remote peer b7ab4784c7344b939bc36f639286f377: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:20:41.209550  6732 raft_consensus.cc:2393] T e31b9971c15848dea59d4d4130141d9e P ccd8a4c3bfe3413cb2ae219b09aea832 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c in current term 12: Already voted for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in this term.
I20260709 13:20:41.205613  6876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f00a2e87e56452083b759f60d461ee3" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:41.218269  6874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8292e16e5654be6bc408560cf256aaa" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:41.162709 12142 raft_consensus.cc:2749] T be1a92657f494cac8dd227d152f50151 P b7ab4784c7344b939bc36f639286f377 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:20:41.228963  6873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e31b9971c15848dea59d4d4130141d9e" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:41.229594  6873 raft_consensus.cc:2468] T e31b9971c15848dea59d4d4130141d9e P cd75a17ab2604397adab03bb8b5fd75c [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 11.
I20260709 13:20:41.223908  6878 raft_consensus.cc:1240] T 9b3759de40694069b13c0f8bd40e5709 P cd75a17ab2604397adab03bb8b5fd75c [term 12 FOLLOWER]: Rejecting Update request from peer b7ab4784c7344b939bc36f639286f377 for earlier term 11. Current term is 12. Ops: []
I20260709 13:20:41.225483  6881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f9c2e2bf644115957398fe4c9459db" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 15 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
W20260709 13:20:41.181278 12210 log.cc:927] Time spent T 3d65025eea89441290d85dd053810e31 P ccd8a4c3bfe3413cb2ae219b09aea832: Append to log took a long time: real 0.338s	user 0.002s	sys 0.000s
W20260709 13:20:41.203970 12201 consensus_meta.cc:287] T 24ee15416e3145beaa1b8183453729a3 P ccd8a4c3bfe3413cb2ae219b09aea832: Time spent flushing consensus metadata: real 0.574s	user 0.013s	sys 0.002s
I20260709 13:20:41.228511  6772 leader_election.cc:304] T 853ac0a8cbd64ce99457f170216d4d0f P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:20:41.248167  6729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b3759de40694069b13c0f8bd40e5709" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:20:41.250239  6872 raft_consensus.cc:1275] T 2c240553ce044eedb41541d72b9475d7 P cd75a17ab2604397adab03bb8b5fd75c [term 17 FOLLOWER]: Refusing update from remote peer b7ab4784c7344b939bc36f639286f377: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 13:20:41.180450 11710 leader_election.cc:290] T 17587d6730594da4a56fa13a353232a1 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:20:41.185441 12043 leader_election.cc:290] T e31b9971c15848dea59d4d4130141d9e P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:20:41.189465 12138 leader_election.cc:290] T ab432e62819d499eaaf3dd55481dd930 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:41.187884 12137 leader_election.cc:290] T f3f9c2e2bf644115957398fe4c9459db P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:41.185333 12130 leader_election.cc:290] T d8292e16e5654be6bc408560cf256aaa P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:41.192294 12197 leader_election.cc:290] T 9b3759de40694069b13c0f8bd40e5709 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 12 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:20:41.185642 12229 raft_consensus.cc:2749] T d33d5ee8ef6f415593d8df52063161ad P ccd8a4c3bfe3413cb2ae219b09aea832 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
W20260709 13:20:41.264706  6697 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 126469us
I20260709 13:20:41.186864 12180 leader_election.cc:290] T 853ac0a8cbd64ce99457f170216d4d0f P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 13 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:20:41.190310 11954 leader_election.cc:290] T 4f00a2e87e56452083b759f60d461ee3 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:20:41.210623 12209 raft_consensus.cc:493] T 1528ab62b6fe4e3099d08f141afee116 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:41.250600 12186 raft_consensus.cc:493] T 44bde925b2e541b69890d70715b85176 P b7ab4784c7344b939bc36f639286f377 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:41.258912 12227 raft_consensus.cc:493] T 7c44c4849aa54f2b94d1f1bef9ed546f P ccd8a4c3bfe3413cb2ae219b09aea832 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:20:41.274329  6695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 115707us
I20260709 13:20:41.250097 12011 raft_consensus.cc:493] T 20f6842e26174571996b8dea4151d4be P ccd8a4c3bfe3413cb2ae219b09aea832 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:41.192912 12156 raft_consensus.cc:515] T b56bf91d90824c959e21e0cee5ba1816 P b7ab4784c7344b939bc36f639286f377 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:41.268342 12232 raft_consensus.cc:493] T 427c124d773f483294511e80fe340075 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 7ba59cc884714e8aa5f3f0ecaed84cbb)
I20260709 13:20:41.259017 12079 raft_consensus.cc:493] T 7887766dc6784fcaa42b35c05fea7a99 P b7ab4784c7344b939bc36f639286f377 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:41.256362 12141 raft_consensus.cc:493] T 404190ce4ce94cecbfcb6ea9d1dd8626 P b7ab4784c7344b939bc36f639286f377 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 7ba59cc884714e8aa5f3f0ecaed84cbb)
I20260709 13:20:41.179342 11752 consensus_queue.cc:260] T b3f13b31a1f84f0d89d007eadd57924c P b7ab4784c7344b939bc36f639286f377 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:20:41.277661  6697 leader_election.cc:304] T 7a734b5ab7834e05a8c422208acc58b1 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:20:41.278404 12102 raft_consensus.cc:2804] T 853ac0a8cbd64ce99457f170216d4d0f P b7ab4784c7344b939bc36f639286f377 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:20:41.262367 12201 raft_consensus.cc:515] T 24ee15416e3145beaa1b8183453729a3 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:20:41.308665  6802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e326172347f45e99a0d482b5d8ef768" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:41.309345  6799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f03d0dbf16864ca4bc1bb5e4c0334c0f" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
W20260709 13:20:41.315819  6772 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 43911.9us
W20260709 13:20:40.930742 11955 ts_tablet_manager.cc:1469] T 7a734b5ab7834e05a8c422208acc58b1 P 7ba59cc884714e8aa5f3f0ecaed84cbb: Trace:
0709 13:20:33.602891 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:33.628202 (+ 25311us) service_pool.cc:224] Handling call
0709 13:20:34.374005 (+745803us) ts_tablet_manager.cc:934] T 7a734b5ab7834e05a8c422208acc58b1 P 7ba59cc884714e8aa5f3f0ecaed84cbb: Initiating tablet copy from peer b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
0709 13:20:36.632488 (+2258483us) tablet_copy_client.cc:368] Tablet copy session begun
0709 13:20:37.165618 (+533130us) tablet_metadata.cc:665] Metadata flushed
0709 13:20:37.165787 (+   169us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 13:20:37.801215 (+635428us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 13:20:37.836165 (+ 34950us) tablet_replica.cc:206] Creating consensus instance
0709 13:20:37.836612 (+   447us) ts_tablet_manager.cc:989] Replica registered.
0709 13:20:37.836745 (+   133us) inbound_call.cc:177] Queueing success response
0709 13:20:38.152645 (+315900us) ts_tablet_manager.cc:1379] Bootstrapping tablet
0709 13:20:40.210574 (+2057929us) ts_tablet_manager.cc:1435] Starting tablet replica
0709 13:20:40.487486 (+276912us) tablet_replica.cc:261] Starting instrumentation
0709 13:20:40.502649 (+ 15163us) tablet_replica.cc:280] Starting consensus
Metrics: {"dns_us":102280,"raft.queue_time_us":7414,"raft.run_cpu_time_us":131,"raft.run_wall_time_us":132,"tablet-copy.queue_time_us":744656,"tablet-download-pool.queue_time_us":334,"tablet-download-pool.run_cpu_time_us":1271,"tablet-download-pool.run_wall_time_us":18965,"thread_start_us":832573,"threads_started":2}
I20260709 13:20:41.313884  6804 raft_consensus.cc:1275] T c4db81d9d329422bb3b4160ca4ac2d1d P b7ab4784c7344b939bc36f639286f377 [term 14 FOLLOWER]: Refusing update from remote peer ccd8a4c3bfe3413cb2ae219b09aea832: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:20:41.313923  6805 raft_consensus.cc:1275] T 3d65025eea89441290d85dd053810e31 P b7ab4784c7344b939bc36f639286f377 [term 15 FOLLOWER]: Refusing update from remote peer ccd8a4c3bfe3413cb2ae219b09aea832: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
W20260709 13:20:41.318634  7466 connection.cc:256] RPC call timeout handler was delayed by -1.1792656370000714s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1525s for a response
I20260709 13:20:41.324306  6800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4275cf08e63345f993bce8664eada830" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:41.324388  6803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a734b5ab7834e05a8c422208acc58b1" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 16 candidate_status { last_received { term: 13 index: 5 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:41.280706 12138 consensus_queue.cc:1048] T 1bf4668eeb70467fb3dc5a0289233b3c P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.034s
I20260709 13:20:41.337489  6799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be1a92657f494cac8dd227d152f50151" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:41.339403  6799 raft_consensus.cc:2468] T be1a92657f494cac8dd227d152f50151 P b7ab4784c7344b939bc36f639286f377 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 15.
I20260709 13:20:41.295500 12011 raft_consensus.cc:515] T 20f6842e26174571996b8dea4151d4be P ccd8a4c3bfe3413cb2ae219b09aea832 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:41.342267  6729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17587d6730594da4a56fa13a353232a1" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:41.342976  6729 raft_consensus.cc:2468] T 17587d6730594da4a56fa13a353232a1 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in term 19.
I20260709 13:20:41.314070 12180 raft_consensus.cc:493] T a3022224cc81473690653a83d4e99470 P cd75a17ab2604397adab03bb8b5fd75c [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:41.315565 12102 raft_consensus.cc:493] T 853ac0a8cbd64ce99457f170216d4d0f P b7ab4784c7344b939bc36f639286f377 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:41.347234  6799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f03d0dbf16864ca4bc1bb5e4c0334c0f" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:20:41.314707 12141 raft_consensus.cc:515] T 404190ce4ce94cecbfcb6ea9d1dd8626 P b7ab4784c7344b939bc36f639286f377 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
W20260709 13:20:41.354663 12244 log.cc:927] Time spent T 8c7f33e544204fbaac4078e3e83bbf4e P ccd8a4c3bfe3413cb2ae219b09aea832: Append to log took a long time: real 0.061s	user 0.000s	sys 0.001s
I20260709 13:20:41.365186 12141 leader_election.cc:290] T 404190ce4ce94cecbfcb6ea9d1dd8626 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
W20260709 13:20:41.371910 12236 log.cc:927] Time spent T 8c7f33e544204fbaac4078e3e83bbf4e P cd75a17ab2604397adab03bb8b5fd75c: Append to log took a long time: real 0.084s	user 0.001s	sys 0.000s
I20260709 13:20:41.371978  6800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77e330a82df4b43a745d57a68f6f057" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:41.295058 12209 raft_consensus.cc:515] T 1528ab62b6fe4e3099d08f141afee116 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
W20260709 13:20:41.356915  6697 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 79332.8us
I20260709 13:20:41.297194 12227 raft_consensus.cc:515] T 7c44c4849aa54f2b94d1f1bef9ed546f P ccd8a4c3bfe3413cb2ae219b09aea832 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:41.360272  6772 leader_election.cc:304] T d8cee0accdb8499c86d4414b72565a38 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb
I20260709 13:20:41.360929 11666 consensus_queue.cc:1048] T a3022224cc81473690653a83d4e99470 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:20:41.291157 12186 raft_consensus.cc:515] T 44bde925b2e541b69890d70715b85176 P b7ab4784c7344b939bc36f639286f377 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:41.305838 12079 raft_consensus.cc:515] T 7887766dc6784fcaa42b35c05fea7a99 P b7ab4784c7344b939bc36f639286f377 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:41.315822 12231 consensus_queue.cc:1048] T b56bf91d90824c959e21e0cee5ba1816 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.040s
I20260709 13:20:41.394876  6725 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49744 (request call id 559) took 1803 ms. Trace:
W20260709 13:20:41.409142  6772 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 48946.6us
I20260709 13:20:41.379760  6803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a485a995abc4807b6e511e45419f737" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:41.312325 12232 raft_consensus.cc:515] T 427c124d773f483294511e80fe340075 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } attrs { replace: true } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:20:41.411863  6725 rpcz_store.cc:276] 0709 13:20:39.591093 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:39.591240 (+   147us) service_pool.cc:224] Handling call
0709 13:20:39.591546 (+   306us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:39.671586 (+ 80040us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 13:20:39.711934 (+ 40348us) log.cc:844] Serialized 14 byte log entry
0709 13:20:40.183761 (+471827us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:20:40.183825 (+    64us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:20:40.183873 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:41.394462 (+1210589us) spinlock_profiling.cc:243] Waited 79.7 ms on lock 0x7b54003e6554. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f9aae01 00007fcc0f9a983e 00007fcc1496e419 00007fcc0dee5bd4 00007fcc0dee5b62 00007fcc0dee5a91 00007fcc0dee5a0c 00007fcc0dee4cc2 00007fcc0dce548c 00007fcc0dce48c6
0709 13:20:41.394529 (+    67us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:41.394772 (+   243us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":272193,"prepare.queue_time_us":37253,"prepare.run_cpu_time_us":69,"prepare.run_wall_time_us":4477,"raft.queue_time_us":272691,"raft.run_cpu_time_us":91,"raft.run_wall_time_us":92,"spinlock_wait_cycles":183221504,"thread_start_us":198644,"threads_started":1,"wal-append.queue_time_us":232701,"wal-append.run_cpu_time_us":1491,"wal-append.run_wall_time_us":1069946}
W20260709 13:20:41.376122 12233 log.cc:927] Time spent T 24ee15416e3145beaa1b8183453729a3 P cd75a17ab2604397adab03bb8b5fd75c: Append to log took a long time: real 0.119s	user 0.001s	sys 0.000s
I20260709 13:20:41.358897 12102 raft_consensus.cc:3060] T 853ac0a8cbd64ce99457f170216d4d0f P b7ab4784c7344b939bc36f639286f377 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:41.374714 11793 raft_consensus.cc:2804] T 7a734b5ab7834e05a8c422208acc58b1 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:20:41.435731  6806 raft_consensus.cc:1275] T 44bde925b2e541b69890d70715b85176 P b7ab4784c7344b939bc36f639286f377 [term 15 FOLLOWER]: Refusing update from remote peer ccd8a4c3bfe3413cb2ae219b09aea832: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:20:41.436444  6800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "404190ce4ce94cecbfcb6ea9d1dd8626" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:41.437263  6800 raft_consensus.cc:2468] T 404190ce4ce94cecbfcb6ea9d1dd8626 P b7ab4784c7344b939bc36f639286f377 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 13.
I20260709 13:20:41.438726  6798 raft_consensus.cc:1275] T 7887766dc6784fcaa42b35c05fea7a99 P b7ab4784c7344b939bc36f639286f377 [term 16 FOLLOWER]: Refusing update from remote peer ccd8a4c3bfe3413cb2ae219b09aea832: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 13:20:41.440860  6799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17587d6730594da4a56fa13a353232a1" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:41.443207  6697 leader_election.cc:304] T 3fa34c08b205435dba97346991aa1f92 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:20:41.410212 12187 raft_consensus.cc:2804] T d8cee0accdb8499c86d4414b72565a38 P b7ab4784c7344b939bc36f639286f377 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:20:41.448791  6697 leader_election.cc:304] T 3a485a995abc4807b6e511e45419f737 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:20:41.374118 12180 raft_consensus.cc:515] T a3022224cc81473690653a83d4e99470 P cd75a17ab2604397adab03bb8b5fd75c [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:41.432449 12152 raft_consensus.cc:3055] T 3411566abe2d4c9bb4b2adfdd05e6f17 P b7ab4784c7344b939bc36f639286f377 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:20:41.453572  6799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab432e62819d499eaaf3dd55481dd930" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 18 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:41.438512 11793 raft_consensus.cc:493] T 7a734b5ab7834e05a8c422208acc58b1 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:20:41.458981  7466 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 96533us
I20260709 13:20:41.453500 12229 raft_consensus.cc:2804] T 3fa34c08b205435dba97346991aa1f92 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:20:41.450289 12187 raft_consensus.cc:493] T d8cee0accdb8499c86d4414b72565a38 P b7ab4784c7344b939bc36f639286f377 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 7ba59cc884714e8aa5f3f0ecaed84cbb)
I20260709 13:20:41.465788  6772 leader_election.cc:304] T bb7fa124c3bf4ef9ab65a407cb008441 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:20:41.455155 12152 raft_consensus.cc:740] T 3411566abe2d4c9bb4b2adfdd05e6f17 P b7ab4784c7344b939bc36f639286f377 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
I20260709 13:20:41.461329 11793 raft_consensus.cc:3060] T 7a734b5ab7834e05a8c422208acc58b1 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:41.464398 12181 consensus_queue.cc:1059] T 3411566abe2d4c9bb4b2adfdd05e6f17 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.009s
I20260709 13:20:41.467509 12229 raft_consensus.cc:493] T 3fa34c08b205435dba97346991aa1f92 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 7ba59cc884714e8aa5f3f0ecaed84cbb)
I20260709 13:20:41.473642 12187 raft_consensus.cc:3060] T d8cee0accdb8499c86d4414b72565a38 P b7ab4784c7344b939bc36f639286f377 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:41.492635  6697 leader_election.cc:304] T f03d0dbf16864ca4bc1bb5e4c0334c0f P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:20:41.505558 12237 raft_consensus.cc:2804] T f03d0dbf16864ca4bc1bb5e4c0334c0f P ccd8a4c3bfe3413cb2ae219b09aea832 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:20:41.506206 11666 consensus_queue.cc:1048] T ab432e62819d499eaaf3dd55481dd930 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:20:41.506315 12237 raft_consensus.cc:697] T f03d0dbf16864ca4bc1bb5e4c0334c0f P ccd8a4c3bfe3413cb2ae219b09aea832 [term 15 LEADER]: Becoming Leader. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
I20260709 13:20:41.507903 12186 leader_election.cc:290] T 44bde925b2e541b69890d70715b85176 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:41.508423 12237 consensus_queue.cc:237] T f03d0dbf16864ca4bc1bb5e4c0334c0f P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:41.512378 11781 raft_consensus.cc:493] T 7c44c4849aa54f2b94d1f1bef9ed546f P cd75a17ab2604397adab03bb8b5fd75c [term 15 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:20:41.513047 11781 raft_consensus.cc:515] T 7c44c4849aa54f2b94d1f1bef9ed546f P cd75a17ab2604397adab03bb8b5fd75c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:41.513228 12209 leader_election.cc:290] T 1528ab62b6fe4e3099d08f141afee116 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:20:41.515466 11781 leader_election.cc:290] T 7c44c4849aa54f2b94d1f1bef9ed546f P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:20:41.494689 12138 raft_consensus.cc:493] T 713b5728a197487c9300b310ab94e5a3 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:41.521806 12227 leader_election.cc:290] T 7c44c4849aa54f2b94d1f1bef9ed546f P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:41.523056 12201 leader_election.cc:290] T 24ee15416e3145beaa1b8183453729a3 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 19 election: Requested vote from peers cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:20:41.485668 12231 raft_consensus.cc:2804] T 3a485a995abc4807b6e511e45419f737 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:20:41.529138 12231 raft_consensus.cc:493] T 3a485a995abc4807b6e511e45419f737 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:41.529587 12231 raft_consensus.cc:3060] T 3a485a995abc4807b6e511e45419f737 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:41.530004 12232 leader_election.cc:290] T 427c124d773f483294511e80fe340075 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:20:41.530459 12228 raft_consensus.cc:493] T e31b9971c15848dea59d4d4130141d9e P ccd8a4c3bfe3413cb2ae219b09aea832 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:41.531126 12228 raft_consensus.cc:515] T e31b9971c15848dea59d4d4130141d9e P ccd8a4c3bfe3413cb2ae219b09aea832 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
W20260709 13:20:41.532928  6771 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:41.521466 12138 raft_consensus.cc:515] T 713b5728a197487c9300b310ab94e5a3 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:41.534466  6725 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2c240553ce044eedb41541d72b9475d7"
dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
mode: GRACEFUL
new_leader_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
 from {username='slave'} at 127.0.0.1:38536
I20260709 13:20:41.545197  6878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44bde925b2e541b69890d70715b85176" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:41.542966  7495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f00a2e87e56452083b759f60d461ee3" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:20:41.545521  6725 raft_consensus.cc:606] T 2c240553ce044eedb41541d72b9475d7 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 17 FOLLOWER]: Received request to transfer leadership to TS cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:20:41.548311  6725 raft_consensus.cc:614] T 2c240553ce044eedb41541d72b9475d7 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 17 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:20:41.536306  6872 raft_consensus.cc:1240] T f03d0dbf16864ca4bc1bb5e4c0334c0f P cd75a17ab2604397adab03bb8b5fd75c [term 15 FOLLOWER]: Rejecting Update request from peer b7ab4784c7344b939bc36f639286f377 for earlier term 14. Current term is 15. Ops: [14.8-14.8]
I20260709 13:20:41.568898  7500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "404190ce4ce94cecbfcb6ea9d1dd8626" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:20:41.499200 12229 raft_consensus.cc:3060] T 3fa34c08b205435dba97346991aa1f92 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:20:41.488718 12246 raft_consensus.cc:2749] T bb7fa124c3bf4ef9ab65a407cb008441 P b7ab4784c7344b939bc36f639286f377 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:20:41.520696 12011 leader_election.cc:290] T 20f6842e26174571996b8dea4151d4be P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:41.531872 12252 consensus_queue.cc:1059] T 4b8cacb381b746da8d0049b0a83b41dd P 7ba59cc884714e8aa5f3f0ecaed84cbb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: INVALID_TERM, Last received: 14.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:20:41.582365  6801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c44c4849aa54f2b94d1f1bef9ed546f" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:41.584297  6802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20f6842e26174571996b8dea4151d4be" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:41.583535  6804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1528ab62b6fe4e3099d08f141afee116" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:41.585366  6804 raft_consensus.cc:2468] T 1528ab62b6fe4e3099d08f141afee116 P b7ab4784c7344b939bc36f639286f377 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 12.
I20260709 13:20:41.584766  6801 raft_consensus.cc:2468] T 7c44c4849aa54f2b94d1f1bef9ed546f P b7ab4784c7344b939bc36f639286f377 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 16.
I20260709 13:20:41.590418  6695 leader_election.cc:304] T 9e326172347f45e99a0d482b5d8ef768 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:20:41.568616 12156 leader_election.cc:290] T b56bf91d90824c959e21e0cee5ba1816 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:41.595605  6804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "427c124d773f483294511e80fe340075" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:41.596506  6804 raft_consensus.cc:2410] T 427c124d773f483294511e80fe340075 P b7ab4784c7344b939bc36f639286f377 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ccd8a4c3bfe3413cb2ae219b09aea832 for term 15 because replica has last-logged OpId of term: 14 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 9.
I20260709 13:20:41.597084  6874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b56bf91d90824c959e21e0cee5ba1816" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:41.569360 12209 raft_consensus.cc:493] T f09c2a98de1a4decabd0ff900dd44caa P ccd8a4c3bfe3413cb2ae219b09aea832 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
W20260709 13:20:41.599309  7466 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 118340us
I20260709 13:20:41.580817 12232 raft_consensus.cc:493] T b3f13b31a1f84f0d89d007eadd57924c P ccd8a4c3bfe3413cb2ae219b09aea832 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 7ba59cc884714e8aa5f3f0ecaed84cbb)
I20260709 13:20:41.610160  6804 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "427c124d773f483294511e80fe340075"
dest_uuid: "b7ab4784c7344b939bc36f639286f377"
mode: GRACEFUL
new_leader_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
 from {username='slave'} at 127.0.0.1:38240
I20260709 13:20:41.610997  6804 raft_consensus.cc:606] T 427c124d773f483294511e80fe340075 P b7ab4784c7344b939bc36f639286f377 [term 14 FOLLOWER]: Received request to transfer leadership to TS cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:20:41.611449  6804 raft_consensus.cc:614] T 427c124d773f483294511e80fe340075 P b7ab4784c7344b939bc36f639286f377 [term 14 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:20:41.594358 11937 raft_consensus.cc:2749] T 4b8cacb381b746da8d0049b0a83b41dd P cd75a17ab2604397adab03bb8b5fd75c [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:20:41.599207 12011 raft_consensus.cc:2749] T 9e326172347f45e99a0d482b5d8ef768 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:20:41.641708  6878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7887766dc6784fcaa42b35c05fea7a99" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 17 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:41.642910  6878 raft_consensus.cc:2410] T 7887766dc6784fcaa42b35c05fea7a99 P cd75a17ab2604397adab03bb8b5fd75c [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7ab4784c7344b939bc36f639286f377 for term 17 because replica has last-logged OpId of term: 16 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 7.
I20260709 13:20:41.620103 11994 consensus_queue.cc:1048] T 3d65025eea89441290d85dd053810e31 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.015s
I20260709 13:20:41.628012 12180 leader_election.cc:290] T a3022224cc81473690653a83d4e99470 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:20:41.609383 12209 raft_consensus.cc:515] T f09c2a98de1a4decabd0ff900dd44caa P ccd8a4c3bfe3413cb2ae219b09aea832 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:41.640234 12252 raft_consensus.cc:3055] T 4b8cacb381b746da8d0049b0a83b41dd P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 14 LEADER]: Stepping down as leader of term 14
W20260709 13:20:41.676855  6695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 79715.3us
I20260709 13:20:41.620143 12232 raft_consensus.cc:515] T b3f13b31a1f84f0d89d007eadd57924c P ccd8a4c3bfe3413cb2ae219b09aea832 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:20:41.616564 12254 consensus_queue.cc:1048] T c4db81d9d329422bb3b4160ca4ac2d1d P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.036s
I20260709 13:20:41.647629 12079 leader_election.cc:290] T 7887766dc6784fcaa42b35c05fea7a99 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
W20260709 13:20:41.679747  7466 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 73216.3us
I20260709 13:20:41.679879  6695 leader_election.cc:304] T 4275cf08e63345f993bce8664eada830 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:20:41.678524 12252 raft_consensus.cc:740] T 4b8cacb381b746da8d0049b0a83b41dd P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 7ba59cc884714e8aa5f3f0ecaed84cbb, State: Running, Role: LEADER
I20260709 13:20:41.684818  6695 leader_election.cc:304] T be1a92657f494cac8dd227d152f50151 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
I20260709 13:20:41.691824  6695 leader_election.cc:304] T e77e330a82df4b43a745d57a68f6f057 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:20:41.684003 12227 raft_consensus.cc:2749] T 4275cf08e63345f993bce8664eada830 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:20:41.684003 12130 raft_consensus.cc:493] T 427c124d773f483294511e80fe340075 P b7ab4784c7344b939bc36f639286f377 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 7ba59cc884714e8aa5f3f0ecaed84cbb)
I20260709 13:20:41.687688 12228 leader_election.cc:290] T e31b9971c15848dea59d4d4130141d9e P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
W20260709 13:20:41.694130 11576 consensus_meta.cc:287] T f3f9c2e2bf644115957398fe4c9459db P cd75a17ab2604397adab03bb8b5fd75c: Time spent flushing consensus metadata: real 0.549s	user 0.016s	sys 0.000s
I20260709 13:20:41.696527  6695 leader_election.cc:304] T 404190ce4ce94cecbfcb6ea9d1dd8626 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
W20260709 13:20:41.695921 12255 log.cc:927] Time spent T 427c124d773f483294511e80fe340075 P 7ba59cc884714e8aa5f3f0ecaed84cbb: Append to log took a long time: real 0.057s	user 0.000s	sys 0.001s
I20260709 13:20:41.715992 12251 raft_consensus.cc:493] T 3411566abe2d4c9bb4b2adfdd05e6f17 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:20:41.724190 12130 raft_consensus.cc:515] T 427c124d773f483294511e80fe340075 P b7ab4784c7344b939bc36f639286f377 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } attrs { replace: true } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:20:41.729805  6695 leader_election.cc:304] T 1528ab62b6fe4e3099d08f141afee116 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
I20260709 13:20:41.692378 12253 raft_consensus.cc:493] T fe20b4b48823486ca3b9c648db6ce8aa P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 11 FOLLOWER]: Starting pre-election (detected failure of leader cd75a17ab2604397adab03bb8b5fd75c)
I20260709 13:20:41.739603  6804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e31b9971c15848dea59d4d4130141d9e" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:41.741487  6804 raft_consensus.cc:2468] T e31b9971c15848dea59d4d4130141d9e P b7ab4784c7344b939bc36f639286f377 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 12.
I20260709 13:20:41.705714 12138 leader_election.cc:290] T 713b5728a197487c9300b310ab94e5a3 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:41.700753 12238 raft_consensus.cc:2749] T e77e330a82df4b43a745d57a68f6f057 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:20:41.710785 12237 raft_consensus.cc:493] T 9b3759de40694069b13c0f8bd40e5709 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:20:41.755471 12237 raft_consensus.cc:515] T 9b3759de40694069b13c0f8bd40e5709 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:41.745195  6804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "713b5728a197487c9300b310ab94e5a3" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:41.696421 12261 raft_consensus.cc:2804] T be1a92657f494cac8dd227d152f50151 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:20:41.705065 12201 raft_consensus.cc:493] T ce4f062dcd314d43a63ca74067cb5ee3 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
W20260709 13:20:41.747985  7466 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 58083.2us
I20260709 13:20:41.736227 12228 raft_consensus.cc:2804] T 404190ce4ce94cecbfcb6ea9d1dd8626 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:20:41.763291  6804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09c2a98de1a4decabd0ff900dd44caa" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:41.746379 12102 raft_consensus.cc:515] T 853ac0a8cbd64ce99457f170216d4d0f P b7ab4784c7344b939bc36f639286f377 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:41.734175 11576 raft_consensus.cc:515] T f3f9c2e2bf644115957398fe4c9459db P cd75a17ab2604397adab03bb8b5fd75c [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:41.762355  7466 leader_election.cc:304] T bb3d8792045a4583ae2e965b1350a5b4 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:20:41.766465 12201 raft_consensus.cc:515] T ce4f062dcd314d43a63ca74067cb5ee3 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } attrs { replace: true } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:20:41.774835 12128 raft_consensus.cc:3060] T 20f6842e26174571996b8dea4151d4be P b7ab4784c7344b939bc36f639286f377 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:41.779542  6772 leader_election.cc:304] T dbdf895bba214ff68685a24fd17dfb5d P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:20:41.744146 12227 raft_consensus.cc:2804] T 1528ab62b6fe4e3099d08f141afee116 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:20:41.787452  7466 leader_election.cc:304] T 17587d6730594da4a56fa13a353232a1 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
I20260709 13:20:41.802577 12249 raft_consensus.cc:2804] T 17587d6730594da4a56fa13a353232a1 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:20:41.803063 12249 raft_consensus.cc:493] T 17587d6730594da4a56fa13a353232a1 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 19 FOLLOWER]: Starting leader election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:20:41.803437 12249 raft_consensus.cc:3060] T 17587d6730594da4a56fa13a353232a1 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:20:41.760444 12261 raft_consensus.cc:493] T be1a92657f494cac8dd227d152f50151 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 7ba59cc884714e8aa5f3f0ecaed84cbb)
I20260709 13:20:41.807402  6881 raft_consensus.cc:2393] T f3f9c2e2bf644115957398fe4c9459db P cd75a17ab2604397adab03bb8b5fd75c [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7ab4784c7344b939bc36f639286f377 in current term 15: Already voted for candidate cd75a17ab2604397adab03bb8b5fd75c in this term.
I20260709 13:20:41.778432 12228 raft_consensus.cc:493] T 404190ce4ce94cecbfcb6ea9d1dd8626 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 7ba59cc884714e8aa5f3f0ecaed84cbb)
I20260709 13:20:41.786983 12209 leader_election.cc:290] T f09c2a98de1a4decabd0ff900dd44caa P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:41.755667 12187 raft_consensus.cc:515] T d8cee0accdb8499c86d4414b72565a38 P b7ab4784c7344b939bc36f639286f377 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:20:41.795125 12227 raft_consensus.cc:493] T 1528ab62b6fe4e3099d08f141afee116 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:41.795497 12213 raft_consensus.cc:2749] T bb3d8792045a4583ae2e965b1350a5b4 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:20:41.814196 12227 raft_consensus.cc:3060] T 1528ab62b6fe4e3099d08f141afee116 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:41.820179  6875 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58592 (request call id 439) took 1254 ms. Trace:
I20260709 13:20:41.820624  6875 rpcz_store.cc:276] 0709 13:20:40.565903 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:40.572648 (+  6745us) service_pool.cc:224] Handling call
0709 13:20:40.592862 (+ 20214us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:40.676435 (+ 83573us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:40.676488 (+    53us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:20:40.676549 (+    61us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:20:40.676602 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:41.819920 (+1143318us) spinlock_profiling.cc:243] Waited 83.3 ms on lock 0x7b5400141ed4. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f9aae01 00007fcc0f9a983e 00007fcc1496e419 00007fcc0dee5bd4 00007fcc0dee5b62 00007fcc0dee5a91 00007fcc0dee5a0c 00007fcc0dee4cc2 00007fcc0dce548c 00007fcc0dce48c6
0709 13:20:41.819972 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:41.820116 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":191521152}
I20260709 13:20:41.824927 12102 leader_election.cc:290] T 853ac0a8cbd64ce99457f170216d4d0f P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 14 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:41.826102 11576 leader_election.cc:290] T f3f9c2e2bf644115957398fe4c9459db P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 15 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:20:41.826841  6806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b3759de40694069b13c0f8bd40e5709" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:41.827579 12201 leader_election.cc:290] T ce4f062dcd314d43a63ca74067cb5ee3 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:20:41.829716  6772 leader_election.cc:304] T c4db81d9d329422bb3b4160ca4ac2d1d P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:20:41.833779  6806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3f13b31a1f84f0d89d007eadd57924c" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:41.833892  6800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce4f062dcd314d43a63ca74067cb5ee3" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:41.740682 12251 raft_consensus.cc:515] T 3411566abe2d4c9bb4b2adfdd05e6f17 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:41.832402 12139 raft_consensus.cc:2804] T dbdf895bba214ff68685a24fd17dfb5d P b7ab4784c7344b939bc36f639286f377 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:20:41.838927 12139 raft_consensus.cc:697] T dbdf895bba214ff68685a24fd17dfb5d P b7ab4784c7344b939bc36f639286f377 [term 14 LEADER]: Becoming Leader. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
I20260709 13:20:41.839630 12251 leader_election.cc:290] T 3411566abe2d4c9bb4b2adfdd05e6f17 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:41.839262 11870 raft_consensus.cc:2955] T 7a734b5ab7834e05a8c422208acc58b1 P b7ab4784c7344b939bc36f639286f377 [term 15 LEADER]: Committing config change with OpId 13.6: config changed from index -1 to 6, NON_VOTER 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68) added. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } attrs { replace: true } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: NON_VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: true } } }
I20260709 13:20:41.810056 12261 raft_consensus.cc:3060] T be1a92657f494cac8dd227d152f50151 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:41.841531  6806 raft_consensus.cc:1275] T 1bf4668eeb70467fb3dc5a0289233b3c P b7ab4784c7344b939bc36f639286f377 [term 14 FOLLOWER]: Refusing update from remote peer ccd8a4c3bfe3413cb2ae219b09aea832: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:20:41.746800 12253 raft_consensus.cc:515] T fe20b4b48823486ca3b9c648db6ce8aa P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:20:41.827597 12187 leader_election.cc:290] T d8cee0accdb8499c86d4414b72565a38 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 15 election: Requested vote from peers cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:20:41.840004 12139 consensus_queue.cc:237] T dbdf895bba214ff68685a24fd17dfb5d P b7ab4784c7344b939bc36f639286f377 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 12.5, Last appended by leader: 5, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:41.797479 12231 raft_consensus.cc:515] T 3a485a995abc4807b6e511e45419f737 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:41.811690 12228 raft_consensus.cc:3060] T 404190ce4ce94cecbfcb6ea9d1dd8626 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:41.845248  6806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3411566abe2d4c9bb4b2adfdd05e6f17" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:41.843621  6772 leader_election.cc:304] T 1bf4668eeb70467fb3dc5a0289233b3c P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:20:41.818949 12130 leader_election.cc:290] T 427c124d773f483294511e80fe340075 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:20:41.832322 11793 raft_consensus.cc:515] T 7a734b5ab7834e05a8c422208acc58b1 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:41.848272 12079 raft_consensus.cc:2804] T 1bf4668eeb70467fb3dc5a0289233b3c P b7ab4784c7344b939bc36f639286f377 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:20:41.844705 11576 raft_consensus.cc:493] T f58dc08b12a2494bb9a1372837970ca2 P cd75a17ab2604397adab03bb8b5fd75c [term 16 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:20:41.851577 11576 raft_consensus.cc:515] T f58dc08b12a2494bb9a1372837970ca2 P cd75a17ab2604397adab03bb8b5fd75c [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:41.850878 12079 raft_consensus.cc:493] T 1bf4668eeb70467fb3dc5a0289233b3c P b7ab4784c7344b939bc36f639286f377 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:41.852349 12231 leader_election.cc:290] T 3a485a995abc4807b6e511e45419f737 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 15 election: Requested vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:41.852511 12079 raft_consensus.cc:3060] T 1bf4668eeb70467fb3dc5a0289233b3c P b7ab4784c7344b939bc36f639286f377 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:20:41.853238  6770 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 623554us
I20260709 13:20:41.854664  6770 leader_election.cc:304] T de3186201e1a40d0b335eeb8b4e256e0 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:20:41.859490 12253 leader_election.cc:290] T fe20b4b48823486ca3b9c648db6ce8aa P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:41.859400 11576 leader_election.cc:290] T f58dc08b12a2494bb9a1372837970ca2 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
W20260709 13:20:41.866887  6773 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:41.864355  6695 leader_election.cc:304] T 7c44c4849aa54f2b94d1f1bef9ed546f P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
I20260709 13:20:41.867822  6801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a485a995abc4807b6e511e45419f737" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:20:41.902256  6770 leader_election.cc:304] T 4d9def8b32fd443aa94ab1420b06837b P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
W20260709 13:20:41.904891  7466 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 103595us
I20260709 13:20:41.910320  6695 leader_election.cc:304] T e31b9971c15848dea59d4d4130141d9e P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
I20260709 13:20:41.900821 11567 raft_consensus.cc:2804] T 7c44c4849aa54f2b94d1f1bef9ed546f P ccd8a4c3bfe3413cb2ae219b09aea832 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:20:41.916603  7500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24ee15416e3145beaa1b8183453729a3" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:20:41.916975  7498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be1a92657f494cac8dd227d152f50151" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:20:41.904583 11666 raft_consensus.cc:2749] T de3186201e1a40d0b335eeb8b4e256e0 P b7ab4784c7344b939bc36f639286f377 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:20:41.931226  7498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fa34c08b205435dba97346991aa1f92" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:20:41.924592 12201 raft_consensus.cc:2804] T e31b9971c15848dea59d4d4130141d9e P ccd8a4c3bfe3413cb2ae219b09aea832 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:20:41.935333 12201 raft_consensus.cc:493] T e31b9971c15848dea59d4d4130141d9e P ccd8a4c3bfe3413cb2ae219b09aea832 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:41.935770 12201 raft_consensus.cc:3060] T e31b9971c15848dea59d4d4130141d9e P ccd8a4c3bfe3413cb2ae219b09aea832 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:41.938231 12214 leader_election.cc:290] T fe20b4b48823486ca3b9c648db6ce8aa P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:20:41.933270 12138 consensus_queue.cc:1048] T 44bde925b2e541b69890d70715b85176 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.007s
I20260709 13:20:41.944283  7498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "404190ce4ce94cecbfcb6ea9d1dd8626" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:20:41.955015  6877 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58592 (request call id 444) took 1039 ms. Trace:
I20260709 13:20:41.955559 11634 consensus_queue.cc:1048] T 1bf4668eeb70467fb3dc5a0289233b3c P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:20:41.956769  6877 rpcz_store.cc:276] 0709 13:20:40.915774 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:40.953958 (+ 38184us) service_pool.cc:224] Handling call
0709 13:20:40.954350 (+   392us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 13:20:41.020810 (+ 66460us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:41.020846 (+    36us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 13:20:41.024339 (+  3493us) log.cc:844] Serialized 78 byte log entry
0709 13:20:41.106200 (+ 81861us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:20:41.150291 (+ 44091us) log.cc:844] Serialized 14 byte log entry
0709 13:20:41.953522 (+803231us) spinlock_profiling.cc:243] Waited 8.57 ms on lock 0x7b18003c44e0. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc15785de1 00007fcc157925b1 00007fcc0c837c0a 00007fcc15f77219 00007fcc0c8bfa40 00007fcc0c8ba4e4 00007fcc0c8ba455 00007fcc133a23c7 00007fcc0f9b49a7 00007fcc0f9c40bf 00007fcc0f9c4038
0709 13:20:41.953802 (+   280us) log.cc:844] Serialized 14 byte log entry
0709 13:20:41.954184 (+   382us) log.cc:844] Serialized 14 byte log entry
0709 13:20:41.954499 (+   315us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:41.954676 (+   177us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:41.954732 (+    56us) raft_consensus.cc:1685] finished
0709 13:20:41.954746 (+    14us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:41.954937 (+   191us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":102403,"prepare.queue_time_us":51664,"prepare.run_cpu_time_us":58,"prepare.run_wall_time_us":61,"raft.queue_time_us":74827,"raft.run_cpu_time_us":486,"raft.run_wall_time_us":10026,"spinlock_wait_cycles":19719936,"thread_start_us":65572,"threads_started":1,"wal-append.queue_time_us":115176}
I20260709 13:20:41.961351 12249 raft_consensus.cc:515] T 17587d6730594da4a56fa13a353232a1 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:20:41.972306 11951 consensus_queue.cc:1048] T 3a485a995abc4807b6e511e45419f737 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:20:41.986850  7498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17587d6730594da4a56fa13a353232a1" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:20:41.990669 11634 raft_consensus.cc:493] T 90d42e216d9741e190bca19a781291fd P ccd8a4c3bfe3413cb2ae219b09aea832 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:20:41.974622 12261 raft_consensus.cc:515] T be1a92657f494cac8dd227d152f50151 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:20:41.926391 12037 raft_consensus.cc:2804] T c4db81d9d329422bb3b4160ca4ac2d1d P b7ab4784c7344b939bc36f639286f377 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:20:41.993567 11576 raft_consensus.cc:493] T 7c37d41cd9164c15a6826ca62a851a69 P cd75a17ab2604397adab03bb8b5fd75c [term 14 FOLLOWER]: Starting pre-election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:20:41.997985 11576 raft_consensus.cc:515] T 7c37d41cd9164c15a6826ca62a851a69 P cd75a17ab2604397adab03bb8b5fd75c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:41.997877 12248 raft_consensus.cc:493] T 22ccee1b570c4ad3a57bd7aec085b1b4 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:20:41.976868 12228 raft_consensus.cc:515] T 404190ce4ce94cecbfcb6ea9d1dd8626 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:20:41.918984 11567 raft_consensus.cc:493] T 7c44c4849aa54f2b94d1f1bef9ed546f P ccd8a4c3bfe3413cb2ae219b09aea832 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:41.951387 12079 raft_consensus.cc:515] T 1bf4668eeb70467fb3dc5a0289233b3c P b7ab4784c7344b939bc36f639286f377 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:41.991328 11634 raft_consensus.cc:515] T 90d42e216d9741e190bca19a781291fd P ccd8a4c3bfe3413cb2ae219b09aea832 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:41.975749 12232 leader_election.cc:290] T b3f13b31a1f84f0d89d007eadd57924c P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:20:41.993891 12261 leader_election.cc:290] T be1a92657f494cac8dd227d152f50151 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 16 election: Requested vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
W20260709 13:20:42.022817  6770 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 120681us
I20260709 13:20:42.023751  7498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1528ab62b6fe4e3099d08f141afee116" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:20:42.028642 11793 leader_election.cc:290] T 7a734b5ab7834e05a8c422208acc58b1 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 16 election: Requested vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:42.031684  6770 leader_election.cc:304] T bd6869f07b5a4885a0b99fbe60c3b175 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:20:42.000133 12248 raft_consensus.cc:515] T 22ccee1b570c4ad3a57bd7aec085b1b4 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:42.037714  6725 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a3022224cc81473690653a83d4e99470"
dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
mode: GRACEFUL
new_leader_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
 from {username='slave'} at 127.0.0.1:38536
I20260709 13:20:42.040261  6770 leader_election.cc:304] T 07a92dd554674067a83a9cb68c4773f2 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:20:42.040962 12181 consensus_queue.cc:1048] T a3022224cc81473690653a83d4e99470 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:20:42.046279 11666 raft_consensus.cc:2749] T bd6869f07b5a4885a0b99fbe60c3b175 P b7ab4784c7344b939bc36f639286f377 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:20:42.046700 12181 raft_consensus.cc:2749] T 07a92dd554674067a83a9cb68c4773f2 P b7ab4784c7344b939bc36f639286f377 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:20:42.050551 12181 consensus_queue.cc:1048] T 713b5728a197487c9300b310ab94e5a3 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:20:42.052304 12232 raft_consensus.cc:493] T a1704639a875409b9959353527b3fd68 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:20:42.053143 12232 raft_consensus.cc:515] T a1704639a875409b9959353527b3fd68 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:42.054039 12181 consensus_queue.cc:1048] T ab432e62819d499eaaf3dd55481dd930 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:20:42.057964 12229 raft_consensus.cc:515] T 3fa34c08b205435dba97346991aa1f92 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:20:42.011125 12206 raft_consensus.cc:493] T a3022224cc81473690653a83d4e99470 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:42.059374  6770 leader_election.cc:304] T 30e88460611e47b2ba16a46a30b5f416 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:20:42.061347 11634 leader_election.cc:290] T 90d42e216d9741e190bca19a781291fd P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:42.064458 11752 raft_consensus.cc:3060] T b3f13b31a1f84f0d89d007eadd57924c P b7ab4784c7344b939bc36f639286f377 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:42.011919 11567 raft_consensus.cc:3060] T 7c44c4849aa54f2b94d1f1bef9ed546f P ccd8a4c3bfe3413cb2ae219b09aea832 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:42.068632  6727 raft_consensus.cc:1275] T 711ef6523deb4cbe8ef2ba61e1c21c98 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 17 FOLLOWER]: Refusing update from remote peer cd75a17ab2604397adab03bb8b5fd75c: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 13:20:42.069957  6724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c44c4849aa54f2b94d1f1bef9ed546f" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:42.070885  6729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3022224cc81473690653a83d4e99470" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:42.071776  6731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f9c2e2bf644115957398fe4c9459db" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:20:42.072361  6731 raft_consensus.cc:3060] T f3f9c2e2bf644115957398fe4c9459db P ccd8a4c3bfe3413cb2ae219b09aea832 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:42.074849 12159 raft_consensus.cc:493] T b3f13b31a1f84f0d89d007eadd57924c P b7ab4784c7344b939bc36f639286f377 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:42.075383 12159 raft_consensus.cc:515] T b3f13b31a1f84f0d89d007eadd57924c P b7ab4784c7344b939bc36f639286f377 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:20:42.076370  6732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f58dc08b12a2494bb9a1372837970ca2" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:42.076613  6807 raft_consensus.cc:1275] T b3f13b31a1f84f0d89d007eadd57924c P b7ab4784c7344b939bc36f639286f377 [term 13 FOLLOWER]: Refusing update from remote peer 7ba59cc884714e8aa5f3f0ecaed84cbb: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 13:20:42.076937 12237 leader_election.cc:290] T 9b3759de40694069b13c0f8bd40e5709 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:42.078266  6726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c37d41cd9164c15a6826ca62a851a69" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:42.082688  7498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24ee15416e3145beaa1b8183453729a3" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb"
I20260709 13:20:42.083150  7500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "427c124d773f483294511e80fe340075" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:20:42.084087  7498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe20b4b48823486ca3b9c648db6ce8aa" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:20:42.084362 12181 raft_consensus.cc:2749] T 30e88460611e47b2ba16a46a30b5f416 P b7ab4784c7344b939bc36f639286f377 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:20:42.084753  7498 raft_consensus.cc:2468] T fe20b4b48823486ca3b9c648db6ce8aa P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 11.
I20260709 13:20:42.085079 12181 consensus_queue.cc:1048] T 7a734b5ab7834e05a8c422208acc58b1 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:20:42.087076 12181 consensus_queue.cc:1059] T f03d0dbf16864ca4bc1bb5e4c0334c0f P b7ab4784c7344b939bc36f639286f377 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:20:42.087932 11666 raft_consensus.cc:3055] T f03d0dbf16864ca4bc1bb5e4c0334c0f P b7ab4784c7344b939bc36f639286f377 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:20:42.088526 11666 raft_consensus.cc:740] T f03d0dbf16864ca4bc1bb5e4c0334c0f P b7ab4784c7344b939bc36f639286f377 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
I20260709 13:20:42.088847 12037 raft_consensus.cc:493] T c4db81d9d329422bb3b4160ca4ac2d1d P b7ab4784c7344b939bc36f639286f377 [term 14 FOLLOWER]: Starting leader election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:20:42.089414 12037 raft_consensus.cc:3060] T c4db81d9d329422bb3b4160ca4ac2d1d P b7ab4784c7344b939bc36f639286f377 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:42.090142  7503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3f13b31a1f84f0d89d007eadd57924c" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:20:42.091478  7496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce4f062dcd314d43a63ca74067cb5ee3" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:20:42.070566 12152 consensus_queue.cc:260] T 3411566abe2d4c9bb4b2adfdd05e6f17 P b7ab4784c7344b939bc36f639286f377 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:42.093334 12152 raft_consensus.cc:3060] T 3411566abe2d4c9bb4b2adfdd05e6f17 P b7ab4784c7344b939bc36f639286f377 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:42.020201 11576 leader_election.cc:290] T 7c37d41cd9164c15a6826ca62a851a69 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:20:42.065738 12206 raft_consensus.cc:515] T a3022224cc81473690653a83d4e99470 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:42.098048  6725 raft_consensus.cc:606] T a3022224cc81473690653a83d4e99470 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 16 FOLLOWER]: Received request to transfer leadership to TS cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:20:42.098603  6725 raft_consensus.cc:614] T a3022224cc81473690653a83d4e99470 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 16 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:20:42.100447  6729 raft_consensus.cc:2468] T a3022224cc81473690653a83d4e99470 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 16.
I20260709 13:20:42.103418  6732 raft_consensus.cc:2468] T f58dc08b12a2494bb9a1372837970ca2 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 16.
I20260709 13:20:42.103879 11576 raft_consensus.cc:493] T de3186201e1a40d0b335eeb8b4e256e0 P cd75a17ab2604397adab03bb8b5fd75c [term 16 FOLLOWER]: Starting pre-election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:20:42.104661 11576 raft_consensus.cc:515] T de3186201e1a40d0b335eeb8b4e256e0 P cd75a17ab2604397adab03bb8b5fd75c [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:42.109014 11576 leader_election.cc:290] T de3186201e1a40d0b335eeb8b4e256e0 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:20:42.112293 12252 consensus_queue.cc:260] T 4b8cacb381b746da8d0049b0a83b41dd P 7ba59cc884714e8aa5f3f0ecaed84cbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:20:42.114223  6726 raft_consensus.cc:1240] T 4b8cacb381b746da8d0049b0a83b41dd P ccd8a4c3bfe3413cb2ae219b09aea832 [term 15 FOLLOWER]: Rejecting Update request from peer 7ba59cc884714e8aa5f3f0ecaed84cbb for earlier term 14. Current term is 15. Ops: []
I20260709 13:20:42.114290 11994 raft_consensus.cc:493] T 711ef6523deb4cbe8ef2ba61e1c21c98 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:42.115348  6727 raft_consensus.cc:1240] T 404190ce4ce94cecbfcb6ea9d1dd8626 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 14 FOLLOWER]: Rejecting Update request from peer 7ba59cc884714e8aa5f3f0ecaed84cbb for earlier term 13. Current term is 14. Ops: []
I20260709 13:20:42.115890 12159 leader_election.cc:290] T b3f13b31a1f84f0d89d007eadd57924c P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:20:42.126813  6881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab432e62819d499eaaf3dd55481dd930" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 18 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
W20260709 13:20:42.129647  6771 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:42.163053  6801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90d42e216d9741e190bca19a781291fd" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:42.132414  6731 raft_consensus.cc:2468] T f3f9c2e2bf644115957398fe4c9459db P ccd8a4c3bfe3413cb2ae219b09aea832 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 15.
I20260709 13:20:42.126295  6697 leader_election.cc:304] T 17587d6730594da4a56fa13a353232a1 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, b7ab4784c7344b939bc36f639286f377
I20260709 13:20:42.137384  6726 raft_consensus.cc:1240] T be1a92657f494cac8dd227d152f50151 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 16 FOLLOWER]: Rejecting Update request from peer 7ba59cc884714e8aa5f3f0ecaed84cbb for earlier term 15. Current term is 16. Ops: []
I20260709 13:20:42.142107  6878 raft_consensus.cc:1240] T 4b8cacb381b746da8d0049b0a83b41dd P cd75a17ab2604397adab03bb8b5fd75c [term 15 FOLLOWER]: Rejecting Update request from peer 7ba59cc884714e8aa5f3f0ecaed84cbb for earlier term 14. Current term is 15. Ops: []
I20260709 13:20:42.166704  6731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de3186201e1a40d0b335eeb8b4e256e0" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:42.169541  6728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe20b4b48823486ca3b9c648db6ce8aa" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:42.170395  6731 raft_consensus.cc:1240] T 24ee15416e3145beaa1b8183453729a3 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 19 FOLLOWER]: Rejecting Update request from peer 7ba59cc884714e8aa5f3f0ecaed84cbb for earlier term 18. Current term is 19. Ops: []
I20260709 13:20:42.145589  6727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17587d6730594da4a56fa13a353232a1" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:20:42.172534  6727 raft_consensus.cc:3060] T 17587d6730594da4a56fa13a353232a1 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:20:42.175299  6805 raft_consensus.cc:1240] T 1bf4668eeb70467fb3dc5a0289233b3c P b7ab4784c7344b939bc36f639286f377 [term 15 FOLLOWER]: Rejecting Update request from peer ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 14. Current term is 15. Ops: [14.9-14.9]
I20260709 13:20:42.176805  6805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a734b5ab7834e05a8c422208acc58b1" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 16 candidate_status { last_received { term: 13 index: 5 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:20:42.182497  6881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24ee15416e3145beaa1b8183453729a3" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:20:42.170644  6844 leader_election.cc:304] T f58dc08b12a2494bb9a1372837970ca2 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:20:42.192337  7496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be1a92657f494cac8dd227d152f50151" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb"
I20260709 13:20:42.088874  6770 leader_election.cc:304] T 8c7f33e544204fbaac4078e3e83bbf4e P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:20:42.198402  6876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe20b4b48823486ca3b9c648db6ce8aa" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
W20260709 13:20:42.198526  6770 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 109735us
I20260709 13:20:42.207442  6803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be1a92657f494cac8dd227d152f50151" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
W20260709 13:20:42.207753  6697 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.68:45071, user_credentials={real_user=slave}} blocked reactor thread for 81561.7us
I20260709 13:20:42.209815  6697 leader_election.cc:304] T 427c124d773f483294511e80fe340075 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, b7ab4784c7344b939bc36f639286f377
I20260709 13:20:42.208189  6803 raft_consensus.cc:3060] T be1a92657f494cac8dd227d152f50151 P b7ab4784c7344b939bc36f639286f377 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:42.212666  6697 leader_election.cc:304] T fe20b4b48823486ca3b9c648db6ce8aa P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
W20260709 13:20:42.213542  6772 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 366249us
I20260709 13:20:42.217178  6801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3411566abe2d4c9bb4b2adfdd05e6f17" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:20:42.135823 12097 raft_consensus.cc:493] T 44bde925b2e541b69890d70715b85176 P cd75a17ab2604397adab03bb8b5fd75c [term 15 FOLLOWER]: Starting pre-election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:20:42.218264  6697 leader_election.cc:304] T b3f13b31a1f84f0d89d007eadd57924c P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, b7ab4784c7344b939bc36f639286f377
I20260709 13:20:42.223155  6697 leader_election.cc:304] T ce4f062dcd314d43a63ca74067cb5ee3 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, b7ab4784c7344b939bc36f639286f377
I20260709 13:20:42.157585 11576 raft_consensus.cc:493] T 34f36d59d88f40fe8a2805e604fc6c0a P cd75a17ab2604397adab03bb8b5fd75c [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:20:42.157984 12194 raft_consensus.cc:493] T 7887766dc6784fcaa42b35c05fea7a99 P cd75a17ab2604397adab03bb8b5fd75c [term 16 FOLLOWER]: Starting pre-election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:20:42.229398  6876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20f6842e26174571996b8dea4151d4be" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:42.221045  6772 leader_election.cc:304] T e31b9971c15848dea59d4d4130141d9e P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:20:42.226804  6878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "427c124d773f483294511e80fe340075" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:42.228545  7496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fa34c08b205435dba97346991aa1f92" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb"
I20260709 13:20:42.230613  6876 raft_consensus.cc:2468] T 20f6842e26174571996b8dea4151d4be P cd75a17ab2604397adab03bb8b5fd75c [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 16.
I20260709 13:20:42.236349  6875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c44c4849aa54f2b94d1f1bef9ed546f" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:42.237181  6875 raft_consensus.cc:2468] T 7c44c4849aa54f2b94d1f1bef9ed546f P cd75a17ab2604397adab03bb8b5fd75c [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 15.
I20260709 13:20:42.208509 12138 raft_consensus.cc:493] T 853ac0a8cbd64ce99457f170216d4d0f P ccd8a4c3bfe3413cb2ae219b09aea832 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:42.252836  6772 leader_election.cc:304] T 4f00a2e87e56452083b759f60d461ee3 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:20:42.212378 12181 raft_consensus.cc:2749] T 8c7f33e544204fbaac4078e3e83bbf4e P b7ab4784c7344b939bc36f639286f377 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:20:42.135520 12227 raft_consensus.cc:515] T 1528ab62b6fe4e3099d08f141afee116 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:20:42.224642 12011 raft_consensus.cc:2804] T fe20b4b48823486ca3b9c648db6ce8aa P ccd8a4c3bfe3413cb2ae219b09aea832 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:20:42.291617  6805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a734b5ab7834e05a8c422208acc58b1" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 16 candidate_status { last_received { term: 13 index: 5 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:42.185752 12247 consensus_queue.cc:1059] T 4b8cacb381b746da8d0049b0a83b41dd P 7ba59cc884714e8aa5f3f0ecaed84cbb [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: INVALID_TERM, Last received: 14.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.065s
I20260709 13:20:42.301720  6805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f9c2e2bf644115957398fe4c9459db" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:42.089357 11666 consensus_queue.cc:260] T f03d0dbf16864ca4bc1bb5e4c0334c0f P b7ab4784c7344b939bc36f639286f377 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:42.281059  6726 raft_consensus.cc:1240] T 3fa34c08b205435dba97346991aa1f92 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 18 FOLLOWER]: Rejecting Update request from peer 7ba59cc884714e8aa5f3f0ecaed84cbb for earlier term 17. Current term is 18. Ops: []
I20260709 13:20:42.302615  6805 raft_consensus.cc:2468] T f3f9c2e2bf644115957398fe4c9459db P b7ab4784c7344b939bc36f639286f377 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 14.
I20260709 13:20:42.308279  6805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb7fa124c3bf4ef9ab65a407cb008441" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:42.308949  6805 raft_consensus.cc:2468] T bb7fa124c3bf4ef9ab65a407cb008441 P b7ab4784c7344b939bc36f639286f377 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 14.
I20260709 13:20:42.203212 11634 consensus_queue.cc:1048] T 7887766dc6784fcaa42b35c05fea7a99 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.049s
I20260709 13:20:42.173738 11994 raft_consensus.cc:515] T 711ef6523deb4cbe8ef2ba61e1c21c98 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:42.207687 12265 consensus_queue.cc:1059] T 404190ce4ce94cecbfcb6ea9d1dd8626 P 7ba59cc884714e8aa5f3f0ecaed84cbb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: INVALID_TERM, Last received: 13.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.088s
I20260709 13:20:42.229395 12238 raft_consensus.cc:2749] T ce4f062dcd314d43a63ca74067cb5ee3 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:20:42.230032 12249 leader_election.cc:290] T 17587d6730594da4a56fa13a353232a1 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 20 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:20:42.229064 12229 leader_election.cc:290] T 3fa34c08b205435dba97346991aa1f92 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 18 election: Requested vote from peers cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:20:42.252521 12159 raft_consensus.cc:2804] T e31b9971c15848dea59d4d4130141d9e P b7ab4784c7344b939bc36f639286f377 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:20:42.202142 12086 consensus_queue.cc:1048] T 711ef6523deb4cbe8ef2ba61e1c21c98 P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Connected to new peer: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.048s
I20260709 13:20:42.250154 12232 leader_election.cc:290] T a1704639a875409b9959353527b3fd68 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:42.220430 12253 consensus_queue.cc:1059] T 24ee15416e3145beaa1b8183453729a3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: INVALID_TERM, Last received: 18.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.080s
I20260709 13:20:42.218174 12240 consensus_queue.cc:1059] T 1bf4668eeb70467fb3dc5a0289233b3c P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.079s
I20260709 13:20:42.420621 12240 raft_consensus.cc:3055] T 1bf4668eeb70467fb3dc5a0289233b3c P ccd8a4c3bfe3413cb2ae219b09aea832 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:20:42.421021 12240 raft_consensus.cc:740] T 1bf4668eeb70467fb3dc5a0289233b3c P ccd8a4c3bfe3413cb2ae219b09aea832 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
I20260709 13:20:42.421834 12240 consensus_queue.cc:260] T 1bf4668eeb70467fb3dc5a0289233b3c P ccd8a4c3bfe3413cb2ae219b09aea832 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:42.422935 12240 raft_consensus.cc:3060] T 1bf4668eeb70467fb3dc5a0289233b3c P ccd8a4c3bfe3413cb2ae219b09aea832 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:42.423595  6803 raft_consensus.cc:2468] T be1a92657f494cac8dd227d152f50151 P b7ab4784c7344b939bc36f639286f377 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 16.
I20260709 13:20:42.333669  6801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b56bf91d90824c959e21e0cee5ba1816" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:42.424917  6801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ba5dac66ab5497e9e336f2a3c28cda5" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:42.425204  6803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de3186201e1a40d0b335eeb8b4e256e0" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:42.334867  6805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90d42e216d9741e190bca19a781291fd" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:20:42.425276  6807 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50550 (request call id 591) took 3077 ms. Trace:
I20260709 13:20:42.336179  6878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "713b5728a197487c9300b310ab94e5a3" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:42.426385  6805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3022224cc81473690653a83d4e99470" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:42.427726  6805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f9c2e2bf644115957398fe4c9459db" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:20:42.428248  6805 raft_consensus.cc:3060] T f3f9c2e2bf644115957398fe4c9459db P b7ab4784c7344b939bc36f639286f377 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:20:42.341217  6772 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:42.351330  6732 raft_consensus.cc:1240] T 1528ab62b6fe4e3099d08f141afee116 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 13 FOLLOWER]: Rejecting Update request from peer 7ba59cc884714e8aa5f3f0ecaed84cbb for earlier term 12. Current term is 13. Ops: []
I20260709 13:20:42.300622 12011 raft_consensus.cc:493] T fe20b4b48823486ca3b9c648db6ce8aa P ccd8a4c3bfe3413cb2ae219b09aea832 [term 11 FOLLOWER]: Starting leader election (detected failure of leader cd75a17ab2604397adab03bb8b5fd75c)
I20260709 13:20:42.432960 12011 raft_consensus.cc:3060] T fe20b4b48823486ca3b9c648db6ce8aa P ccd8a4c3bfe3413cb2ae219b09aea832 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:20:42.435348 12228 leader_election.cc:290] T 404190ce4ce94cecbfcb6ea9d1dd8626 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 14 election: Requested vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:20:42.356472  6727 raft_consensus.cc:2468] T 17587d6730594da4a56fa13a353232a1 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in term 20.
I20260709 13:20:42.252276 11576 raft_consensus.cc:515] T 34f36d59d88f40fe8a2805e604fc6c0a P cd75a17ab2604397adab03bb8b5fd75c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:42.361802  7498 raft_consensus.cc:1240] T b3f13b31a1f84f0d89d007eadd57924c P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 13 LEADER]: Rejecting Update request from peer b7ab4784c7344b939bc36f639286f377 for earlier term 12. Current term is 13. Ops: []
I20260709 13:20:42.448935  6875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09c2a98de1a4decabd0ff900dd44caa" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:42.217787 12271 consensus_queue.cc:1059] T be1a92657f494cac8dd227d152f50151 P 7ba59cc884714e8aa5f3f0ecaed84cbb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: INVALID_TERM, Last received: 15.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.084s
I20260709 13:20:42.305424 11899 raft_consensus.cc:2749] T 4f00a2e87e56452083b759f60d461ee3 P b7ab4784c7344b939bc36f639286f377 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:20:42.251614 11846 consensus_queue.cc:1059] T 9b3759de40694069b13c0f8bd40e5709 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.097s
I20260709 13:20:42.228821 12097 raft_consensus.cc:515] T 44bde925b2e541b69890d70715b85176 P cd75a17ab2604397adab03bb8b5fd75c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:42.375743 12079 leader_election.cc:290] T 1bf4668eeb70467fb3dc5a0289233b3c P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 15 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:42.312486 11911 consensus_queue.cc:1048] T 2c240553ce044eedb41541d72b9475d7 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.071s
I20260709 13:20:42.383293 11937 raft_consensus.cc:2804] T f58dc08b12a2494bb9a1372837970ca2 P cd75a17ab2604397adab03bb8b5fd75c [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:20:42.383464  7503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8cee0accdb8499c86d4414b72565a38" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb"
I20260709 13:20:42.384359 12086 raft_consensus.cc:493] T f5be3a11b23d4ea9b08300a2789821c7 P cd75a17ab2604397adab03bb8b5fd75c [term 14 FOLLOWER]: Starting pre-election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:20:42.393875  7500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3f13b31a1f84f0d89d007eadd57924c" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:20:42.367043 12206 leader_election.cc:290] T a3022224cc81473690653a83d4e99470 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:42.403810  7501 raft_consensus.cc:1240] T 17587d6730594da4a56fa13a353232a1 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 20 FOLLOWER]: Rejecting Update request from peer b7ab4784c7344b939bc36f639286f377 for earlier term 19. Current term is 20. Ops: []
I20260709 13:20:42.347570 12156 raft_consensus.cc:493] T 22ccee1b570c4ad3a57bd7aec085b1b4 P b7ab4784c7344b939bc36f639286f377 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:42.406975 12181 raft_consensus.cc:493] T 34f36d59d88f40fe8a2805e604fc6c0a P b7ab4784c7344b939bc36f639286f377 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:42.408515 12227 leader_election.cc:290] T 1528ab62b6fe4e3099d08f141afee116 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 13 election: Requested vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:20:42.370141 11666 raft_consensus.cc:3060] T f03d0dbf16864ca4bc1bb5e4c0334c0f P b7ab4784c7344b939bc36f639286f377 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:42.252184 12194 raft_consensus.cc:515] T 7887766dc6784fcaa42b35c05fea7a99 P cd75a17ab2604397adab03bb8b5fd75c [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:42.281416 12138 raft_consensus.cc:515] T 853ac0a8cbd64ce99457f170216d4d0f P ccd8a4c3bfe3413cb2ae219b09aea832 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
W20260709 13:20:42.412930 12128 consensus_meta.cc:287] T 20f6842e26174571996b8dea4151d4be P b7ab4784c7344b939bc36f639286f377: Time spent flushing consensus metadata: real 0.614s	user 0.006s	sys 0.005s
I20260709 13:20:42.414887  7494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1528ab62b6fe4e3099d08f141afee116" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb"
I20260709 13:20:42.407003  6817 tablet_copy_service.cc:342] P b7ab4784c7344b939bc36f639286f377: Request end of tablet copy session 7ba59cc884714e8aa5f3f0ecaed84cbb-7a734b5ab7834e05a8c422208acc58b1 received from {username='slave'} at 127.0.0.1:50550
I20260709 13:20:42.426805  6878 raft_consensus.cc:2410] T 713b5728a197487c9300b310ab94e5a3 P cd75a17ab2604397adab03bb8b5fd75c [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ccd8a4c3bfe3413cb2ae219b09aea832 for term 15 because replica has last-logged OpId of term: 14 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 7.
I20260709 13:20:42.337132  7496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "427c124d773f483294511e80fe340075" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:20:42.425896  6807 rpcz_store.cc:276] 0709 13:20:39.347787 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:39.347964 (+   177us) service_pool.cc:224] Handling call
0709 13:20:39.352641 (+  4677us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:42.077086 (+2724445us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:42.424863 (+347777us) spinlock_profiling.cc:243] Waited 2.72 s on lock 0x7b54002c74d4. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f9aae01 00007fcc0f9a983e 00007fcc1496e419 00007fcc0dee5bd4 00007fcc0dee5b62 00007fcc0dee5a91 00007fcc0dee5a0c 00007fcc0dee4cc2 00007fcc0dce548c 00007fcc0dce48c6
0709 13:20:42.425144 (+   281us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6263701376}
W20260709 13:20:42.432667  7468 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:42.437966  6803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bf4668eeb70467fb3dc5a0289233b3c" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:42.438201  7466 leader_election.cc:304] T 17587d6730594da4a56fa13a353232a1 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
I20260709 13:20:42.363813  6876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e31b9971c15848dea59d4d4130141d9e" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:42.551580  6803 raft_consensus.cc:2393] T 1bf4668eeb70467fb3dc5a0289233b3c P b7ab4784c7344b939bc36f639286f377 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c in current term 15: Already voted for candidate b7ab4784c7344b939bc36f639286f377 in this term.
I20260709 13:20:42.551721  6876 raft_consensus.cc:2468] T e31b9971c15848dea59d4d4130141d9e P cd75a17ab2604397adab03bb8b5fd75c [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 11.
I20260709 13:20:42.552917  6876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b3759de40694069b13c0f8bd40e5709" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:42.449829  6875 raft_consensus.cc:2468] T f09c2a98de1a4decabd0ff900dd44caa P cd75a17ab2604397adab03bb8b5fd75c [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 16.
I20260709 13:20:42.425536  6801 raft_consensus.cc:2468] T 7ba5dac66ab5497e9e336f2a3c28cda5 P b7ab4784c7344b939bc36f639286f377 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in term 15.
I20260709 13:20:42.452584  6805 raft_consensus.cc:2468] T f3f9c2e2bf644115957398fe4c9459db P b7ab4784c7344b939bc36f639286f377 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 15.
I20260709 13:20:42.372455 12159 raft_consensus.cc:493] T e31b9971c15848dea59d4d4130141d9e P b7ab4784c7344b939bc36f639286f377 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:42.508227 12209 raft_consensus.cc:2749] T 427c124d773f483294511e80fe340075 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:20:42.432642 11994 leader_election.cc:290] T 711ef6523deb4cbe8ef2ba61e1c21c98 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
W20260709 13:20:42.508846  6696 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:42.366420 12208 consensus_queue.cc:1059] T 3fa34c08b205435dba97346991aa1f92 P 7ba59cc884714e8aa5f3f0ecaed84cbb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: INVALID_TERM, Last received: 17.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.101s
I20260709 13:20:42.448416 11710 raft_consensus.cc:2749] T 17587d6730594da4a56fa13a353232a1 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:20:42.548525  6877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce4f062dcd314d43a63ca74067cb5ee3" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:42.555433  6805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "404190ce4ce94cecbfcb6ea9d1dd8626" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:20:42.603729  6805 raft_consensus.cc:3060] T 404190ce4ce94cecbfcb6ea9d1dd8626 P b7ab4784c7344b939bc36f639286f377 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:42.469954  6695 leader_election.cc:304] T be1a92657f494cac8dd227d152f50151 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb
I20260709 13:20:42.548820 12227 raft_consensus.cc:493] T dbdf895bba214ff68685a24fd17dfb5d P ccd8a4c3bfe3413cb2ae219b09aea832 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:42.544771 12261 raft_consensus.cc:2749] T b3f13b31a1f84f0d89d007eadd57924c P ccd8a4c3bfe3413cb2ae219b09aea832 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:20:42.614384 11576 leader_election.cc:290] T 34f36d59d88f40fe8a2805e604fc6c0a P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:20:42.612517  6807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17587d6730594da4a56fa13a353232a1" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:20:42.617354  6807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f58dc08b12a2494bb9a1372837970ca2" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
W20260709 13:20:42.618263  6695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 148410us
W20260709 13:20:42.622413 12152 consensus_meta.cc:287] T 3411566abe2d4c9bb4b2adfdd05e6f17 P b7ab4784c7344b939bc36f639286f377: Time spent flushing consensus metadata: real 0.528s	user 0.011s	sys 0.001s
I20260709 13:20:42.623190 12278 raft_consensus.cc:3055] T 9b3759de40694069b13c0f8bd40e5709 P b7ab4784c7344b939bc36f639286f377 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:20:42.623449  6806 raft_consensus.cc:2468] T 3411566abe2d4c9bb4b2adfdd05e6f17 P b7ab4784c7344b939bc36f639286f377 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 13.
I20260709 13:20:42.473825 11937 raft_consensus.cc:493] T f58dc08b12a2494bb9a1372837970ca2 P cd75a17ab2604397adab03bb8b5fd75c [term 16 FOLLOWER]: Starting leader election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:20:42.602424  6803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e31b9971c15848dea59d4d4130141d9e" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:42.596155  6875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8cee0accdb8499c86d4414b72565a38" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:20:42.604561  6878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "427c124d773f483294511e80fe340075" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:42.605347  6877 raft_consensus.cc:2468] T ce4f062dcd314d43a63ca74067cb5ee3 P cd75a17ab2604397adab03bb8b5fd75c [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 15.
I20260709 13:20:42.472775 12254 raft_consensus.cc:493] T 4b8cacb381b746da8d0049b0a83b41dd P ccd8a4c3bfe3413cb2ae219b09aea832 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:42.604749 11774 raft_consensus.cc:2804] T 17587d6730594da4a56fa13a353232a1 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:20:42.598976  6817 tablet_copy_service.cc:434] P b7ab4784c7344b939bc36f639286f377: ending tablet copy session 7ba59cc884714e8aa5f3f0ecaed84cbb-7a734b5ab7834e05a8c422208acc58b1 on tablet 7a734b5ab7834e05a8c422208acc58b1 with peer 7ba59cc884714e8aa5f3f0ecaed84cbb
I20260709 13:20:42.612372 12248 leader_election.cc:290] T 22ccee1b570c4ad3a57bd7aec085b1b4 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:42.477535 12251 raft_consensus.cc:493] T 2c240553ce044eedb41541d72b9475d7 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:42.752787  6728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8292e16e5654be6bc408560cf256aaa" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
W20260709 13:20:42.753106  6881 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.526s	user 0.000s	sys 0.033s
I20260709 13:20:42.612917 12227 raft_consensus.cc:515] T dbdf895bba214ff68685a24fd17dfb5d P ccd8a4c3bfe3413cb2ae219b09aea832 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
W20260709 13:20:42.361727 12187 consensus_queue.cc:1175] T f03d0dbf16864ca4bc1bb5e4c0334c0f P b7ab4784c7344b939bc36f639286f377 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "cd75a17ab2604397adab03bb8b5fd75c" responder_term: 15 status { last_received { term: 12 index: 7 } last_committed_idx: 7 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer b7ab4784c7344b939bc36f639286f377 for earlier term 14. Current term is 15. Ops: [14.8-14.8]" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:20:42.618543  6807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b3759de40694069b13c0f8bd40e5709" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:20:42.623710 12278 raft_consensus.cc:740] T 9b3759de40694069b13c0f8bd40e5709 P b7ab4784c7344b939bc36f639286f377 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
I20260709 13:20:42.548534 11567 raft_consensus.cc:515] T 7c44c4849aa54f2b94d1f1bef9ed546f P ccd8a4c3bfe3413cb2ae219b09aea832 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
W20260709 13:20:42.558341  7466 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 120189us
I20260709 13:20:42.558292  6876 raft_consensus.cc:2393] T 9b3759de40694069b13c0f8bd40e5709 P cd75a17ab2604397adab03bb8b5fd75c [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ccd8a4c3bfe3413cb2ae219b09aea832 in current term 12: Already voted for candidate cd75a17ab2604397adab03bb8b5fd75c in this term.
I20260709 13:20:42.554040 12174 raft_consensus.cc:493] T 20f6842e26174571996b8dea4151d4be P b7ab4784c7344b939bc36f639286f377 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:42.596516 12159 raft_consensus.cc:3060] T e31b9971c15848dea59d4d4130141d9e P b7ab4784c7344b939bc36f639286f377 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:42.709755  7502 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50744 (request call id 420) took 1519 ms. Trace:
I20260709 13:20:42.713054  6798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "853ac0a8cbd64ce99457f170216d4d0f" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:20:42.714200  6730 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b56bf91d90824c959e21e0cee5ba1816"
dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
mode: GRACEFUL
new_leader_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
 from {username='slave'} at 127.0.0.1:38536
I20260709 13:20:42.513657 12156 raft_consensus.cc:515] T 22ccee1b570c4ad3a57bd7aec085b1b4 P b7ab4784c7344b939bc36f639286f377 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:42.513371 12181 raft_consensus.cc:515] T 34f36d59d88f40fe8a2805e604fc6c0a P b7ab4784c7344b939bc36f639286f377 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:42.510943 12086 raft_consensus.cc:515] T f5be3a11b23d4ea9b08300a2789821c7 P cd75a17ab2604397adab03bb8b5fd75c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
W20260709 13:20:42.719218  6771 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:42.837694  6772 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:42.720463 12254 raft_consensus.cc:515] T 4b8cacb381b746da8d0049b0a83b41dd P ccd8a4c3bfe3413cb2ae219b09aea832 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:20:42.599383 12264 raft_consensus.cc:493] T 4f00a2e87e56452083b759f60d461ee3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 16 FOLLOWER]: Starting pre-election (detected failure of leader cd75a17ab2604397adab03bb8b5fd75c)
I20260709 13:20:42.714228 11994 raft_consensus.cc:2804] T be1a92657f494cac8dd227d152f50151 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:20:42.732597 12290 raft_consensus.cc:493] T ce4f062dcd314d43a63ca74067cb5ee3 P cd75a17ab2604397adab03bb8b5fd75c [term 15 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:20:42.909750 12290 raft_consensus.cc:515] T ce4f062dcd314d43a63ca74067cb5ee3 P cd75a17ab2604397adab03bb8b5fd75c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } attrs { replace: true } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:20:42.911021 12086 leader_election.cc:290] T f5be3a11b23d4ea9b08300a2789821c7 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:20:42.911238 12265 consensus_queue.cc:1048] T b3f13b31a1f84f0d89d007eadd57924c P 7ba59cc884714e8aa5f3f0ecaed84cbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.011s
I20260709 13:20:42.913594 12290 leader_election.cc:290] T ce4f062dcd314d43a63ca74067cb5ee3 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:20:42.742702  6727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4db81d9d329422bb3b4160ca4ac2d1d" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:42.915943  6727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d65025eea89441290d85dd053810e31" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 16 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:42.917702  6727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e31b9971c15848dea59d4d4130141d9e" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:42.743402  6726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a75bfe094d4bdc963aba3f08dfcd25" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:42.920159  6726 raft_consensus.cc:1240] T 24ee15416e3145beaa1b8183453729a3 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 19 FOLLOWER]: Rejecting Update request from peer 7ba59cc884714e8aa5f3f0ecaed84cbb for earlier term 18. Current term is 19. Ops: []
I20260709 13:20:42.730116 12194 leader_election.cc:290] T 7887766dc6784fcaa42b35c05fea7a99 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:20:42.921756 12194 raft_consensus.cc:493] T 3d65025eea89441290d85dd053810e31 P cd75a17ab2604397adab03bb8b5fd75c [term 15 FOLLOWER]: Starting pre-election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:20:42.922467 12194 raft_consensus.cc:515] T 3d65025eea89441290d85dd053810e31 P cd75a17ab2604397adab03bb8b5fd75c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
W20260709 13:20:42.753587  6881 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.531s	user 0.000s	sys 0.033s
I20260709 13:20:42.881743 12138 leader_election.cc:290] T 853ac0a8cbd64ce99457f170216d4d0f P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:42.928615 12290 raft_consensus.cc:493] T 2c240553ce044eedb41541d72b9475d7 P cd75a17ab2604397adab03bb8b5fd75c [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:42.928910 12097 leader_election.cc:290] T 44bde925b2e541b69890d70715b85176 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:20:42.929440 12290 raft_consensus.cc:515] T 2c240553ce044eedb41541d72b9475d7 P cd75a17ab2604397adab03bb8b5fd75c [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:42.930913  6881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fa34c08b205435dba97346991aa1f92" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:20:42.881671 12174 raft_consensus.cc:515] T 20f6842e26174571996b8dea4151d4be P b7ab4784c7344b939bc36f639286f377 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
W20260709 13:20:42.753520 12201 consensus_meta.cc:287] T e31b9971c15848dea59d4d4130141d9e P ccd8a4c3bfe3413cb2ae219b09aea832: Time spent flushing consensus metadata: real 0.817s	user 0.011s	sys 0.001s
W20260709 13:20:42.776626 11870 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.545s	user 0.012s	sys 0.024s
W20260709 13:20:42.793614  6844 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.602s	user 0.012s	sys 0.027s
I20260709 13:20:42.768294 11774 raft_consensus.cc:697] T 17587d6730594da4a56fa13a353232a1 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 20 LEADER]: Becoming Leader. State: Replica: 7ba59cc884714e8aa5f3f0ecaed84cbb, State: Running, Role: LEADER
I20260709 13:20:42.939232 12181 leader_election.cc:290] T 34f36d59d88f40fe8a2805e604fc6c0a P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:42.939651 11774 consensus_queue.cc:237] T 17587d6730594da4a56fa13a353232a1 P 7ba59cc884714e8aa5f3f0ecaed84cbb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 19.13, Last appended by leader: 13, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:20:42.943600 12254 leader_election.cc:290] T 4b8cacb381b746da8d0049b0a83b41dd P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:20:42.885457  6876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3022224cc81473690653a83d4e99470" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
W20260709 13:20:42.767573  6879 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.596s	user 0.008s	sys 0.027s
W20260709 13:20:42.944686  6879 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.773s	user 0.012s	sys 0.034s
I20260709 13:20:42.945611  6876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe20b4b48823486ca3b9c648db6ce8aa" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
W20260709 13:20:42.755682  6800 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.542s	user 0.000s	sys 0.032s
W20260709 13:20:42.946322  6800 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.736s	user 0.000s	sys 0.046s
I20260709 13:20:42.890239  6730 raft_consensus.cc:606] T b56bf91d90824c959e21e0cee5ba1816 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 14 LEADER]: Received request to transfer leadership to TS cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:20:42.946897  6876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "853ac0a8cbd64ce99457f170216d4d0f" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:20:42.947575  6876 raft_consensus.cc:3060] T 853ac0a8cbd64ce99457f170216d4d0f P cd75a17ab2604397adab03bb8b5fd75c [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:42.789786  6728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f9c2e2bf644115957398fe4c9459db" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 15 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:42.753697  6725 raft_consensus.cc:1240] T f4b8bd455d5a47c18a1380839c6e0d61 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 15 FOLLOWER]: Rejecting Update request from peer b7ab4784c7344b939bc36f639286f377 for earlier term 14. Current term is 15. Ops: []
I20260709 13:20:42.949061 12238 raft_consensus.cc:493] T f4b8bd455d5a47c18a1380839c6e0d61 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:20:42.949836 12037 consensus_meta.cc:287] T c4db81d9d329422bb3b4160ca4ac2d1d P b7ab4784c7344b939bc36f639286f377: Time spent flushing consensus metadata: real 0.860s	user 0.007s	sys 0.005s
I20260709 13:20:42.949573 12238 raft_consensus.cc:515] T f4b8bd455d5a47c18a1380839c6e0d61 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:42.950296 12037 raft_consensus.cc:515] T c4db81d9d329422bb3b4160ca4ac2d1d P b7ab4784c7344b939bc36f639286f377 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:42.952412 11994 raft_consensus.cc:697] T be1a92657f494cac8dd227d152f50151 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 16 LEADER]: Becoming Leader. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
I20260709 13:20:42.953522 11994 consensus_queue.cc:237] T be1a92657f494cac8dd227d152f50151 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:20:42.954483 12238 leader_election.cc:290] T f4b8bd455d5a47c18a1380839c6e0d61 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:42.719570 11937 raft_consensus.cc:3060] T f58dc08b12a2494bb9a1372837970ca2 P cd75a17ab2604397adab03bb8b5fd75c [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:42.891381  6798 raft_consensus.cc:2368] T 853ac0a8cbd64ce99457f170216d4d0f P b7ab4784c7344b939bc36f639286f377 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c for earlier term 13. Current term is 14.
I20260709 13:20:42.957212  6798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1704639a875409b9959353527b3fd68" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:42.958456  6798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22ccee1b570c4ad3a57bd7aec085b1b4" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:42.786748  6875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a485a995abc4807b6e511e45419f737" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:20:42.959369  6875 raft_consensus.cc:3060] T 3a485a995abc4807b6e511e45419f737 P cd75a17ab2604397adab03bb8b5fd75c [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:42.775318  6729 raft_consensus.cc:1240] T 3a485a995abc4807b6e511e45419f737 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 15 FOLLOWER]: Rejecting Update request from peer b7ab4784c7344b939bc36f639286f377 for earlier term 14. Current term is 15. Ops: []
I20260709 13:20:42.888109  6805 raft_consensus.cc:2468] T 404190ce4ce94cecbfcb6ea9d1dd8626 P b7ab4784c7344b939bc36f639286f377 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 14.
W20260709 13:20:42.961450  6773 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:42.891624  7502 rpcz_store.cc:276] 0709 13:20:41.190677 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:41.191487 (+   810us) service_pool.cc:224] Handling call
0709 13:20:41.954691 (+763204us) spinlock_profiling.cc:243] Waited 3.93 ms on lock 0x7b5800123f98. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0c745db1 00007fcc0c885b71 00007fcc0c885eee 0000000000375939 00007fcc148f91e0 00007fcc149c20c4 00007fcc149c2131 00007fcc14983fc0 00007fcc1496e929 00007fcc1496e3d2 00007fcc0dee5bd4
0709 13:20:41.954869 (+   178us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:41.955268 (+   399us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:20:41.955310 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:20:41.955756 (+   446us) log.cc:844] Serialized 26 byte log entry
0709 13:20:42.289295 (+333539us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:20:42.289355 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:42.289457 (+   102us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:42.671914 (+382457us) raft_consensus.cc:1685] finished
0709 13:20:42.671934 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:42.709653 (+ 37719us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2603,"raft.run_cpu_time_us":106,"raft.run_wall_time_us":106,"spinlock_wait_cycles":9047552,"thread_start_us":333151,"threads_started":1,"wal-append.queue_time_us":554749}
I20260709 13:20:42.898433  7466 leader_election.cc:304] T 7ba5dac66ab5497e9e336f2a3c28cda5 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, b7ab4784c7344b939bc36f639286f377; no voters: cd75a17ab2604397adab03bb8b5fd75c
W20260709 13:20:42.902463  6771 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:42.963690  6800 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:32976 (request call id 3224) took 1145 ms. Trace:
I20260709 13:20:42.739791 11576 raft_consensus.cc:493] T 7a734b5ab7834e05a8c422208acc58b1 P cd75a17ab2604397adab03bb8b5fd75c [term 15 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:20:42.741744  6877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90d42e216d9741e190bca19a781291fd" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
W20260709 13:20:42.911089 12282 log.cc:927] Time spent T bb3d8792045a4583ae2e965b1350a5b4 P 7ba59cc884714e8aa5f3f0ecaed84cbb: Append to log took a long time: real 0.192s	user 0.000s	sys 0.001s
I20260709 13:20:42.935794  6724 raft_consensus.cc:2368] T 7c44c4849aa54f2b94d1f1bef9ed546f P ccd8a4c3bfe3413cb2ae219b09aea832 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c for earlier term 16. Current term is 17.
I20260709 13:20:42.972313  7495 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50742 (request call id 485) took 1061 ms. Trace:
I20260709 13:20:42.972708  7495 rpcz_store.cc:276] 0709 13:20:41.910963 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:41.911114 (+   151us) service_pool.cc:224] Handling call
0709 13:20:41.927532 (+ 16418us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:41.981554 (+ 54022us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:41.981583 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:20:41.982015 (+   432us) log.cc:844] Serialized 26 byte log entry
0709 13:20:42.321224 (+339209us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:20:42.321278 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:42.321382 (+   104us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:42.972020 (+650638us) raft_consensus.cc:1685] finished
0709 13:20:42.972065 (+    45us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:42.972225 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8091,"raft.queue_time_us":13463,"raft.run_cpu_time_us":119,"raft.run_wall_time_us":2195,"thread_start_us":296266,"threads_started":1,"wal-append.queue_time_us":551469}
W20260709 13:20:42.937206 11870 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.712s	user 0.012s	sys 0.034s
I20260709 13:20:42.972123 12265 raft_consensus.cc:2804] T 7ba5dac66ab5497e9e336f2a3c28cda5 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:20:42.978109 12265 raft_consensus.cc:493] T 7ba5dac66ab5497e9e336f2a3c28cda5 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 15 FOLLOWER]: Starting leader election (detected failure of leader cd75a17ab2604397adab03bb8b5fd75c)
I20260709 13:20:42.978454 11870 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.BulkChangeConfig from 127.0.0.1:52106 (request call id 5) took 12259 ms. Trace:
I20260709 13:20:42.937572  6802 raft_consensus.cc:2468] T 20f6842e26174571996b8dea4151d4be P b7ab4784c7344b939bc36f639286f377 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 16.
I20260709 13:20:42.978981 12265 raft_consensus.cc:3060] T 7ba5dac66ab5497e9e336f2a3c28cda5 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:42.937529 12201 raft_consensus.cc:515] T e31b9971c15848dea59d4d4130141d9e P ccd8a4c3bfe3413cb2ae219b09aea832 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:42.961159  6805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17587d6730594da4a56fa13a353232a1" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:42.981066 12156 leader_election.cc:290] T 22ccee1b570c4ad3a57bd7aec085b1b4 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:42.981487  6805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "711ef6523deb4cbe8ef2ba61e1c21c98" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 18 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:42.982100  6727 raft_consensus.cc:2393] T e31b9971c15848dea59d4d4130141d9e P ccd8a4c3bfe3413cb2ae219b09aea832 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7ab4784c7344b939bc36f639286f377 in current term 13: Already voted for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in this term.
I20260709 13:20:42.982240  6805 raft_consensus.cc:2468] T 711ef6523deb4cbe8ef2ba61e1c21c98 P b7ab4784c7344b939bc36f639286f377 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 17.
I20260709 13:20:42.983366  6805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3022224cc81473690653a83d4e99470" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:42.985211  6805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c37d41cd9164c15a6826ca62a851a69" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
W20260709 13:20:42.969236  7466 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 73893.6us
W20260709 13:20:42.893865  6799 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.561s	user 0.018s	sys 0.027s
W20260709 13:20:42.987928  6799 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.673s	user 0.018s	sys 0.027s
I20260709 13:20:42.969292  6728 raft_consensus.cc:2393] T f3f9c2e2bf644115957398fe4c9459db P ccd8a4c3bfe3413cb2ae219b09aea832 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7ab4784c7344b939bc36f639286f377 in current term 15: Already voted for candidate cd75a17ab2604397adab03bb8b5fd75c in this term.
W20260709 13:20:42.936837  6844 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.745s	user 0.012s	sys 0.035s
W20260709 13:20:42.989178  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 818537us
I20260709 13:20:42.974550  6881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bf4668eeb70467fb3dc5a0289233b3c" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:20:42.972543  6877 raft_consensus.cc:2393] T 90d42e216d9741e190bca19a781291fd P cd75a17ab2604397adab03bb8b5fd75c [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ccd8a4c3bfe3413cb2ae219b09aea832 in current term 15: Already voted for candidate cd75a17ab2604397adab03bb8b5fd75c in this term.
I20260709 13:20:42.977082  6807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c44c4849aa54f2b94d1f1bef9ed546f" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:42.981225 12037 leader_election.cc:290] T c4db81d9d329422bb3b4160ca4ac2d1d P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 15 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:42.964322  6800 rpcz_store.cc:276] 0709 13:20:41.818112 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:41.837490 (+ 19378us) service_pool.cc:224] Handling call
0709 13:20:41.887405 (+ 49915us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:41.887656 (+   251us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:20:42.210535 (+322879us) log.cc:844] Serialized 14 byte log entry
0709 13:20:42.963266 (+752731us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:20:42.963339 (+    73us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:20:42.963424 (+    85us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:42.963521 (+    97us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:42.963632 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":32997,"prepare.queue_time_us":45982,"prepare.run_cpu_time_us":47,"prepare.run_wall_time_us":48,"thread_start_us":1032287,"threads_started":2}
I20260709 13:20:42.992959  6807 raft_consensus.cc:2468] T 7c44c4849aa54f2b94d1f1bef9ed546f P b7ab4784c7344b939bc36f639286f377 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 16.
W20260709 13:20:42.995693  6844 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.5.126.66:42817 timed out after 1.509s (SENT) [suppressed 5 similar messages]
I20260709 13:20:42.965867  6798 raft_consensus.cc:2468] T 22ccee1b570c4ad3a57bd7aec085b1b4 P b7ab4784c7344b939bc36f639286f377 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 13.
I20260709 13:20:42.960628  6876 raft_consensus.cc:2468] T 853ac0a8cbd64ce99457f170216d4d0f P cd75a17ab2604397adab03bb8b5fd75c [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 14.
I20260709 13:20:43.035195  6800 raft_consensus.cc:1275] T 4f00a2e87e56452083b759f60d461ee3 P b7ab4784c7344b939bc36f639286f377 [term 16 FOLLOWER]: Refusing update from remote peer cd75a17ab2604397adab03bb8b5fd75c: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 16 index: 11. (term mismatch)
I20260709 13:20:43.036054  6876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22ccee1b570c4ad3a57bd7aec085b1b4" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:43.036667  6800 pending_rounds.cc:85] T 4f00a2e87e56452083b759f60d461ee3 P b7ab4784c7344b939bc36f639286f377: Aborting all ops after (but not including) 10
I20260709 13:20:43.036859  7502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b8cacb381b746da8d0049b0a83b41dd" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:20:43.031922  6726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bf4668eeb70467fb3dc5a0289233b3c" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:43.003762  6881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3411566abe2d4c9bb4b2adfdd05e6f17" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:43.037683  6729 raft_consensus.cc:1240] T d33d5ee8ef6f415593d8df52063161ad P ccd8a4c3bfe3413cb2ae219b09aea832 [term 13 FOLLOWER]: Rejecting Update request from peer b7ab4784c7344b939bc36f639286f377 for earlier term 12. Current term is 13. Ops: []
I20260709 13:20:42.990739  7468 leader_election.cc:304] T fe20b4b48823486ca3b9c648db6ce8aa P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:20:43.036973  6876 raft_consensus.cc:2468] T 22ccee1b570c4ad3a57bd7aec085b1b4 P cd75a17ab2604397adab03bb8b5fd75c [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 13.
I20260709 13:20:42.968516 12246 raft_consensus.cc:2749] T 4d9def8b32fd443aa94ab1420b06837b P b7ab4784c7344b939bc36f639286f377 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:20:42.767325 12251 raft_consensus.cc:515] T 2c240553ce044eedb41541d72b9475d7 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:43.039775  6876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34f36d59d88f40fe8a2805e604fc6c0a" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:42.952427 12247 raft_consensus.cc:3055] T 404190ce4ce94cecbfcb6ea9d1dd8626 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:20:43.038502  6881 raft_consensus.cc:2393] T 3411566abe2d4c9bb4b2adfdd05e6f17 P cd75a17ab2604397adab03bb8b5fd75c [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ccd8a4c3bfe3413cb2ae219b09aea832 in current term 13: Already voted for candidate cd75a17ab2604397adab03bb8b5fd75c in this term.
I20260709 13:20:42.978045 11576 raft_consensus.cc:515] T 7a734b5ab7834e05a8c422208acc58b1 P cd75a17ab2604397adab03bb8b5fd75c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } attrs { replace: true } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: NON_VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: true } }
I20260709 13:20:43.137584  6876 raft_consensus.cc:2468] T 34f36d59d88f40fe8a2805e604fc6c0a P cd75a17ab2604397adab03bb8b5fd75c [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 12.
I20260709 13:20:43.138137  6805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1528ab62b6fe4e3099d08f141afee116" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:20:43.138760  6876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4db81d9d329422bb3b4160ca4ac2d1d" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:20:42.933022 12264 raft_consensus.cc:515] T 4f00a2e87e56452083b759f60d461ee3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:20:43.148818  6805 raft_consensus.cc:3060] T 1528ab62b6fe4e3099d08f141afee116 P b7ab4784c7344b939bc36f639286f377 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:43.138758  6729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44bde925b2e541b69890d70715b85176" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:43.143432  6804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "853ac0a8cbd64ce99457f170216d4d0f" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:43.037052  6800 pending_rounds.cc:107] T 4f00a2e87e56452083b759f60d461ee3 P b7ab4784c7344b939bc36f639286f377: Aborting uncommitted NO_OP operation due to leader change: 15.11
I20260709 13:20:43.162150  6800 raft_consensus.cc:2889] T 4f00a2e87e56452083b759f60d461ee3 P b7ab4784c7344b939bc36f639286f377 [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:20:43.163167  6873 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.603s	user 0.017s	sys 0.037s
I20260709 13:20:43.096451  7495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "404190ce4ce94cecbfcb6ea9d1dd8626" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb"
I20260709 13:20:43.146704  6876 raft_consensus.cc:3060] T c4db81d9d329422bb3b4160ca4ac2d1d P cd75a17ab2604397adab03bb8b5fd75c [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:43.164000  6800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4b8bd455d5a47c18a1380839c6e0d61" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
W20260709 13:20:43.164264  6873 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.608s	user 0.018s	sys 0.037s
W20260709 13:20:43.051332 12102 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.620s	user 0.016s	sys 0.020s
W20260709 13:20:43.171247 12102 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.740s	user 0.018s	sys 0.023s
I20260709 13:20:43.147336 12247 raft_consensus.cc:740] T 404190ce4ce94cecbfcb6ea9d1dd8626 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 7ba59cc884714e8aa5f3f0ecaed84cbb, State: Running, Role: LEADER
I20260709 13:20:43.172179 12264 leader_election.cc:290] T 4f00a2e87e56452083b759f60d461ee3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:43.172904 12264 raft_consensus.cc:2749] T fe20b4b48823486ca3b9c648db6ce8aa P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:20:43.060238  6730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34f36d59d88f40fe8a2805e604fc6c0a" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:43.181515  6877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1704639a875409b9959353527b3fd68" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:43.181118  6729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c240553ce044eedb41541d72b9475d7" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:43.182179  6877 raft_consensus.cc:2468] T a1704639a875409b9959353527b3fd68 P cd75a17ab2604397adab03bb8b5fd75c [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 15.
I20260709 13:20:43.081560  6728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7887766dc6784fcaa42b35c05fea7a99" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:43.178750  6806 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:32976 (request call id 3227) took 1337 ms. Trace:
I20260709 13:20:43.183797  6806 rpcz_store.cc:276] 0709 13:20:41.840984 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:41.842787 (+  1803us) service_pool.cc:224] Handling call
0709 13:20:43.178547 (+1335760us) spinlock_profiling.cc:243] Waited 777 ms on lock 0x7b5400070b54. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f9ae2fa 00007fcc1496fb17 00007fcc0deea6d4 00007fcc0deea662 00007fcc0deea591 00007fcc0deea50c 00007fcc0dee97c2 00007fcc0dce548c 00007fcc0dce48c6 00007fcc0dce426f
0709 13:20:43.178675 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1787109632}
I20260709 13:20:43.184317  6804 raft_consensus.cc:2393] T 853ac0a8cbd64ce99457f170216d4d0f P b7ab4784c7344b939bc36f639286f377 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ccd8a4c3bfe3413cb2ae219b09aea832 in current term 14: Already voted for candidate b7ab4784c7344b939bc36f639286f377 in this term.
W20260709 13:20:43.134615 11666 consensus_meta.cc:287] T f03d0dbf16864ca4bc1bb5e4c0334c0f P b7ab4784c7344b939bc36f639286f377: Time spent flushing consensus metadata: real 0.618s	user 0.009s	sys 0.005s
I20260709 13:20:43.204394  6802 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:32976 (request call id 3211) took 1622 ms. Trace:
I20260709 13:20:43.204787  6802 rpcz_store.cc:276] 0709 13:20:41.581571 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:41.584010 (+  2439us) service_pool.cc:224] Handling call
0709 13:20:43.204241 (+1620231us) spinlock_profiling.cc:243] Waited 1.35 s on lock 0x7b54001a36d4. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f9ae2fa 00007fcc1496fb17 00007fcc0deea6d4 00007fcc0deea662 00007fcc0deea591 00007fcc0deea50c 00007fcc0dee97c2 00007fcc0dce548c 00007fcc0dce48c6 00007fcc0dce426f
0709 13:20:43.204338 (+    97us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3110357376}
I20260709 13:20:43.177803 11576 leader_election.cc:290] T 7a734b5ab7834e05a8c422208acc58b1 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:20:43.207710 11576 raft_consensus.cc:493] T f4b8bd455d5a47c18a1380839c6e0d61 P cd75a17ab2604397adab03bb8b5fd75c [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:20:42.979009 11870 rpcz_store.cc:276] 0709 13:20:30.719060 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:30.947970 (+228910us) service_pool.cc:224] Handling call
0709 13:20:31.123436 (+175466us) log.cc:844] Serialized 499 byte log entry
0709 13:20:31.535548 (+412112us) spinlock_profiling.cc:243] Waited 24.6 ms on lock 0x7b4c0030a880. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0dc76a20 00007fcc0dc87a29 00007fcc0dc8813f 00007fcc0dc4c2ab 00007fcc0dc79f3c 00007fcc0dc7a3fe 00007fcc0df0750b 00007fcc0f906381 00007fcc0f90426b 00007fcc0f90ad53 00007fcc0f90acd9
0709 13:20:32.540452 (+1004904us) spinlock_profiling.cc:243] Waited 5.88 ms on lock 0x7b5400312f20. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f923142 00007fcc0f903eaa 00007fcc0f90ad53 00007fcc0f90acd9 00007fcc0f90ac69 00007fcc0f90ac31 00007fcc0f909dfd 000000000038f354 000000000038f199 00007fcc0c8bd475
0709 13:20:33.194568 (+654116us) spinlock_profiling.cc:243] Waited 8.49 ms on lock 0x7b5400312f20. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f92ab26 00007fcc0f92449a 00007fcc0f923714 00007fcc0f903eaa 00007fcc0f90ad53 00007fcc0f90acd9 00007fcc0f90ac69 00007fcc0f90ac31 00007fcc0f909dfd 000000000038f354
0709 13:20:42.978208 (+9783640us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":129270,"raft.queue_time_us":97522,"raft.run_cpu_time_us":26552,"raft.run_wall_time_us":2208108,"spinlock_wait_cycles":89769600,"thread_start_us":47265,"threads_started":1,"wal-append.queue_time_us":238807,"wal-append.run_cpu_time_us":2578,"wal-append.run_wall_time_us":1064192}
I20260709 13:20:43.208250 11576 raft_consensus.cc:515] T f4b8bd455d5a47c18a1380839c6e0d61 P cd75a17ab2604397adab03bb8b5fd75c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
W20260709 13:20:43.099241 12285 log.cc:927] Time spent T b3f13b31a1f84f0d89d007eadd57924c P ccd8a4c3bfe3413cb2ae219b09aea832: Append to log took a long time: real 0.116s	user 0.000s	sys 0.000s
W20260709 13:20:43.134306 12284 log.cc:927] Time spent T 713b5728a197487c9300b310ab94e5a3 P b7ab4784c7344b939bc36f639286f377: Append to log took a long time: real 0.395s	user 0.000s	sys 0.003s
I20260709 13:20:43.183730  6881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a734b5ab7834e05a8c422208acc58b1" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 16 candidate_status { last_received { term: 13 index: 5 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:20:43.191227  6730 raft_consensus.cc:2393] T 34f36d59d88f40fe8a2805e604fc6c0a P ccd8a4c3bfe3413cb2ae219b09aea832 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c in current term 13: Already voted for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in this term.
I20260709 13:20:43.173079 12247 consensus_queue.cc:260] T 404190ce4ce94cecbfcb6ea9d1dd8626 P 7ba59cc884714e8aa5f3f0ecaed84cbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:20:43.192503 12252 raft_consensus.cc:3060] T 4b8cacb381b746da8d0049b0a83b41dd P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:43.193588 12249 raft_consensus.cc:3055] T be1a92657f494cac8dd227d152f50151 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:20:43.196890 12227 leader_election.cc:290] T dbdf895bba214ff68685a24fd17dfb5d P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:43.197419 12194 leader_election.cc:290] T 3d65025eea89441290d85dd053810e31 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:20:43.198941 12174 leader_election.cc:290] T 20f6842e26174571996b8dea4151d4be P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:43.199615 12296 raft_consensus.cc:493] T 9e326172347f45e99a0d482b5d8ef768 P cd75a17ab2604397adab03bb8b5fd75c [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:20:43.190135  6805 raft_consensus.cc:2468] T 1528ab62b6fe4e3099d08f141afee116 P b7ab4784c7344b939bc36f639286f377 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 13.
I20260709 13:20:43.266386  6805 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "dbdf895bba214ff68685a24fd17dfb5d"
dest_uuid: "b7ab4784c7344b939bc36f639286f377"
mode: GRACEFUL
new_leader_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
 from {username='slave'} at 127.0.0.1:38240
I20260709 13:20:43.202458  6727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce4f062dcd314d43a63ca74067cb5ee3" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:43.203510  6724 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49998 (request call id 1298) took 1137 ms. Trace:
I20260709 13:20:43.267692  6724 rpcz_store.cc:276] 0709 13:20:42.065888 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:42.069678 (+  3790us) service_pool.cc:224] Handling call
0709 13:20:43.203319 (+1133641us) spinlock_profiling.cc:243] Waited 865 ms on lock 0x7b54003d5254. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f9ae2fa 00007fcc1496fb17 00007fcc0deea6d4 00007fcc0deea662 00007fcc0deea591 00007fcc0deea50c 00007fcc0dee97c2 00007fcc0dce548c 00007fcc0dce48c6 00007fcc0dce426f
0709 13:20:43.203451 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1989495040}
I20260709 13:20:43.270437  6727 raft_consensus.cc:2468] T ce4f062dcd314d43a63ca74067cb5ee3 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 15.
I20260709 13:20:43.271517  6807 raft_consensus.cc:1240] T 1528ab62b6fe4e3099d08f141afee116 P b7ab4784c7344b939bc36f639286f377 [term 13 FOLLOWER]: Rejecting Update request from peer 7ba59cc884714e8aa5f3f0ecaed84cbb for earlier term 12. Current term is 13. Ops: []
W20260709 13:20:43.136184 12280 log.cc:927] Time spent T 44bde925b2e541b69890d70715b85176 P ccd8a4c3bfe3413cb2ae219b09aea832: Append to log took a long time: real 0.422s	user 0.000s	sys 0.002s
W20260709 13:20:43.210461  6696 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:43.187541 12253 consensus_queue.cc:1059] T 1528ab62b6fe4e3099d08f141afee116 P 7ba59cc884714e8aa5f3f0ecaed84cbb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.079s
I20260709 13:20:43.216986  6877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "711ef6523deb4cbe8ef2ba61e1c21c98" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 18 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:43.217036  6731 raft_consensus.cc:1275] T 2c240553ce044eedb41541d72b9475d7 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 17 FOLLOWER]: Refusing update from remote peer b7ab4784c7344b939bc36f639286f377: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
W20260709 13:20:43.169656 12240 consensus_meta.cc:287] T 1bf4668eeb70467fb3dc5a0289233b3c P ccd8a4c3bfe3413cb2ae219b09aea832: Time spent flushing consensus metadata: real 0.746s	user 0.009s	sys 0.003s
I20260709 13:20:43.222219  6881 raft_consensus.cc:3060] T 7a734b5ab7834e05a8c422208acc58b1 P cd75a17ab2604397adab03bb8b5fd75c [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:43.235935  6875 raft_consensus.cc:2468] T 3a485a995abc4807b6e511e45419f737 P cd75a17ab2604397adab03bb8b5fd75c [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 15.
I20260709 13:20:43.098321 11567 leader_election.cc:290] T 7c44c4849aa54f2b94d1f1bef9ed546f P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 17 election: Requested vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:43.116535 12037 raft_consensus.cc:493] T 7c37d41cd9164c15a6826ca62a851a69 P b7ab4784c7344b939bc36f639286f377 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
W20260709 13:20:43.248706 12011 consensus_meta.cc:287] T fe20b4b48823486ca3b9c648db6ce8aa P ccd8a4c3bfe3413cb2ae219b09aea832: Time spent flushing consensus metadata: real 0.811s	user 0.017s	sys 0.003s
I20260709 13:20:43.249229 12247 raft_consensus.cc:3060] T 404190ce4ce94cecbfcb6ea9d1dd8626 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:43.238881 12297 raft_consensus.cc:493] T d33d5ee8ef6f415593d8df52063161ad P cd75a17ab2604397adab03bb8b5fd75c [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:20:43.250461 11576 leader_election.cc:290] T f4b8bd455d5a47c18a1380839c6e0d61 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:20:43.251279  6806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c44c4849aa54f2b94d1f1bef9ed546f" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:20:43.301760  6806 raft_consensus.cc:3060] T 7c44c4849aa54f2b94d1f1bef9ed546f P b7ab4784c7344b939bc36f639286f377 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:43.254184 12251 leader_election.cc:290] T 2c240553ce044eedb41541d72b9475d7 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
W20260709 13:20:43.228907 12208 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.619s	user 0.013s	sys 0.006s
W20260709 13:20:43.264187  6846 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.592s	user 0.005s	sys 0.024s
W20260709 13:20:43.264884  6874 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.592s	user 0.012s	sys 0.017s
W20260709 13:20:43.308238  6874 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.636s	user 0.012s	sys 0.017s
I20260709 13:20:43.276587  6805 raft_consensus.cc:606] T dbdf895bba214ff68685a24fd17dfb5d P b7ab4784c7344b939bc36f639286f377 [term 14 LEADER]: Received request to transfer leadership to TS cd75a17ab2604397adab03bb8b5fd75c
W20260709 13:20:43.048380 12204 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.594s	user 0.022s	sys 0.027s
I20260709 13:20:43.276572  6876 raft_consensus.cc:2468] T c4db81d9d329422bb3b4160ca4ac2d1d P cd75a17ab2604397adab03bb8b5fd75c [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 15.
I20260709 13:20:43.243872 12249 raft_consensus.cc:740] T be1a92657f494cac8dd227d152f50151 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 7ba59cc884714e8aa5f3f0ecaed84cbb, State: Running, Role: LEADER
I20260709 13:20:43.279764  6728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5be3a11b23d4ea9b08300a2789821c7" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:43.247717 12290 leader_election.cc:290] T 2c240553ce044eedb41541d72b9475d7 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:20:43.254912 12201 leader_election.cc:290] T e31b9971c15848dea59d4d4130141d9e P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 13 election: Requested vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:43.259511 12264 consensus_queue.cc:1059] T 24ee15416e3145beaa1b8183453729a3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: INVALID_TERM, Last received: 18.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.017s
I20260709 13:20:43.288384  6726 raft_consensus.cc:2410] T 1bf4668eeb70467fb3dc5a0289233b3c P ccd8a4c3bfe3413cb2ae219b09aea832 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7ab4784c7344b939bc36f639286f377 for term 15 because replica has last-logged OpId of term: 14 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 8.
I20260709 13:20:43.308483 12253 raft_consensus.cc:3055] T 1528ab62b6fe4e3099d08f141afee116 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:20:43.312423  6877 raft_consensus.cc:1240] T c4db81d9d329422bb3b4160ca4ac2d1d P cd75a17ab2604397adab03bb8b5fd75c [term 15 FOLLOWER]: Rejecting Update request from peer ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 14. Current term is 15. Ops: []
I20260709 13:20:43.317031  6724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "404190ce4ce94cecbfcb6ea9d1dd8626" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:43.104171 12278 consensus_queue.cc:260] T 9b3759de40694069b13c0f8bd40e5709 P b7ab4784c7344b939bc36f639286f377 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:43.327256  6881 raft_consensus.cc:2410] T 7a734b5ab7834e05a8c422208acc58b1 P cd75a17ab2604397adab03bb8b5fd75c [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate ccd8a4c3bfe3413cb2ae219b09aea832 for term 16 because replica has last-logged OpId of term: 15 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 5.
I20260709 13:20:43.274925 12296 raft_consensus.cc:515] T 9e326172347f45e99a0d482b5d8ef768 P cd75a17ab2604397adab03bb8b5fd75c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
W20260709 13:20:43.307904  6846 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.635s	user 0.005s	sys 0.024s
W20260709 13:20:43.346715  6846 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.68:45071, user_credentials={real_user=slave}} blocked reactor thread for 734100us
I20260709 13:20:43.339748  6728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "427c124d773f483294511e80fe340075" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
W20260709 13:20:43.307677 12208 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.698s	user 0.013s	sys 0.007s
W20260709 13:20:43.310993 12204 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.860s	user 0.022s	sys 0.035s
I20260709 13:20:43.357064  6724 raft_consensus.cc:2393] T 404190ce4ce94cecbfcb6ea9d1dd8626 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7ab4784c7344b939bc36f639286f377 in current term 14: Already voted for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in this term.
I20260709 13:20:43.360155 12290 raft_consensus.cc:493] T 4b8cacb381b746da8d0049b0a83b41dd P cd75a17ab2604397adab03bb8b5fd75c [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:43.360783 12290 raft_consensus.cc:515] T 4b8cacb381b746da8d0049b0a83b41dd P cd75a17ab2604397adab03bb8b5fd75c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:20:43.361133 12278 raft_consensus.cc:3060] T 9b3759de40694069b13c0f8bd40e5709 P b7ab4784c7344b939bc36f639286f377 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:20:43.361889  6805 raft_consensus.cc:1240] T be1a92657f494cac8dd227d152f50151 P b7ab4784c7344b939bc36f639286f377 [term 16 FOLLOWER]: Rejecting Update request from peer 7ba59cc884714e8aa5f3f0ecaed84cbb for earlier term 15. Current term is 16. Ops: []
I20260709 13:20:43.362689  6805 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50550 (request call id 602) took 1027 ms. Trace:
I20260709 13:20:43.362991  6805 rpcz_store.cc:276] 0709 13:20:42.334904 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:43.339902 (+1004998us) service_pool.cc:224] Handling call
0709 13:20:43.361727 (+ 21825us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:43.362450 (+   723us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:43.362636 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:20:43.295598 12037 raft_consensus.cc:515] T 7c37d41cd9164c15a6826ca62a851a69 P b7ab4784c7344b939bc36f639286f377 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:43.364378  6876 raft_consensus.cc:1240] T 7a734b5ab7834e05a8c422208acc58b1 P cd75a17ab2604397adab03bb8b5fd75c [term 16 FOLLOWER]: Rejecting Update request from peer b7ab4784c7344b939bc36f639286f377 for earlier term 15. Current term is 16. Ops: []
I20260709 13:20:43.361915  6695 leader_election.cc:304] T 404190ce4ce94cecbfcb6ea9d1dd8626 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
I20260709 13:20:43.364885  6881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22ccee1b570c4ad3a57bd7aec085b1b4" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:43.299340 12011 raft_consensus.cc:515] T fe20b4b48823486ca3b9c648db6ce8aa P ccd8a4c3bfe3413cb2ae219b09aea832 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:20:43.368274  6728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44bde925b2e541b69890d70715b85176" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:43.371819  6881 raft_consensus.cc:2393] T 22ccee1b570c4ad3a57bd7aec085b1b4 P cd75a17ab2604397adab03bb8b5fd75c [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ccd8a4c3bfe3413cb2ae219b09aea832 in current term 13: Already voted for candidate cd75a17ab2604397adab03bb8b5fd75c in this term.
I20260709 13:20:43.372833  6695 leader_election.cc:304] T 711ef6523deb4cbe8ef2ba61e1c21c98 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
I20260709 13:20:43.377647  6724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "853ac0a8cbd64ce99457f170216d4d0f" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:20:43.378535  6724 raft_consensus.cc:3060] T 853ac0a8cbd64ce99457f170216d4d0f P ccd8a4c3bfe3413cb2ae219b09aea832 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:43.379541  6805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c240553ce044eedb41541d72b9475d7" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 18 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:43.381022  7495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce4f062dcd314d43a63ca74067cb5ee3" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:20:43.307873 12297 raft_consensus.cc:515] T d33d5ee8ef6f415593d8df52063161ad P cd75a17ab2604397adab03bb8b5fd75c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:43.342897 12253 raft_consensus.cc:740] T 1528ab62b6fe4e3099d08f141afee116 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 7ba59cc884714e8aa5f3f0ecaed84cbb, State: Running, Role: LEADER
W20260709 13:20:43.384248  6880 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.767s	user 0.008s	sys 0.029s
I20260709 13:20:43.385703  6881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b8cacb381b746da8d0049b0a83b41dd" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:43.394424  6881 raft_consensus.cc:2468] T 4b8cacb381b746da8d0049b0a83b41dd P cd75a17ab2604397adab03bb8b5fd75c [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 15.
I20260709 13:20:43.388067  6806 raft_consensus.cc:2468] T 7c44c4849aa54f2b94d1f1bef9ed546f P b7ab4784c7344b939bc36f639286f377 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 17.
I20260709 13:20:43.389788  6695 leader_election.cc:304] T 3411566abe2d4c9bb4b2adfdd05e6f17 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
I20260709 13:20:43.396576  6806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbdf895bba214ff68685a24fd17dfb5d" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 15 candidate_status { last_received { term: 10 index: 4 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
W20260709 13:20:43.398265  6880 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.781s	user 0.009s	sys 0.029s
I20260709 13:20:43.399588  6727 raft_consensus.cc:1240] T fe20b4b48823486ca3b9c648db6ce8aa P ccd8a4c3bfe3413cb2ae219b09aea832 [term 12 FOLLOWER]: Rejecting Update request from peer cd75a17ab2604397adab03bb8b5fd75c for earlier term 11. Current term is 12. Ops: []
I20260709 13:20:43.402849  6881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "853ac0a8cbd64ce99457f170216d4d0f" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:43.372457 12204 raft_consensus.cc:493] T 34f36d59d88f40fe8a2805e604fc6c0a P ccd8a4c3bfe3413cb2ae219b09aea832 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:43.403710  6881 raft_consensus.cc:2393] T 853ac0a8cbd64ce99457f170216d4d0f P cd75a17ab2604397adab03bb8b5fd75c [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ccd8a4c3bfe3413cb2ae219b09aea832 in current term 14: Already voted for candidate b7ab4784c7344b939bc36f639286f377 in this term.
I20260709 13:20:43.405092  6881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4b8bd455d5a47c18a1380839c6e0d61" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:43.406162  6881 raft_consensus.cc:2468] T f4b8bd455d5a47c18a1380839c6e0d61 P cd75a17ab2604397adab03bb8b5fd75c [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 14.
I20260709 13:20:43.405114  6805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e31b9971c15848dea59d4d4130141d9e" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:20:43.408727  6728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b56bf91d90824c959e21e0cee5ba1816" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:43.375290 12251 raft_consensus.cc:2804] T 404190ce4ce94cecbfcb6ea9d1dd8626 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:20:43.374662 11576 raft_consensus.cc:493] T e77e330a82df4b43a745d57a68f6f057 P cd75a17ab2604397adab03bb8b5fd75c [term 16 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:20:43.418251  6881 raft_consensus.cc:1240] T 3411566abe2d4c9bb4b2adfdd05e6f17 P cd75a17ab2604397adab03bb8b5fd75c [term 13 FOLLOWER]: Rejecting Update request from peer b7ab4784c7344b939bc36f639286f377 for earlier term 12. Current term is 13. Ops: []
I20260709 13:20:43.419893 12204 raft_consensus.cc:515] T 34f36d59d88f40fe8a2805e604fc6c0a P ccd8a4c3bfe3413cb2ae219b09aea832 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
W20260709 13:20:43.420751 12301 log.cc:927] Time spent T c4db81d9d329422bb3b4160ca4ac2d1d P ccd8a4c3bfe3413cb2ae219b09aea832: Append to log took a long time: real 0.099s	user 0.001s	sys 0.000s
W20260709 13:20:43.422540 12299 log.cc:927] Time spent T 7a734b5ab7834e05a8c422208acc58b1 P b7ab4784c7344b939bc36f639286f377: Append to log took a long time: real 0.142s	user 0.001s	sys 0.000s
I20260709 13:20:43.424230 12251 raft_consensus.cc:697] T 404190ce4ce94cecbfcb6ea9d1dd8626 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 14 LEADER]: Becoming Leader. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
I20260709 13:20:43.425731 12251 consensus_queue.cc:237] T 404190ce4ce94cecbfcb6ea9d1dd8626 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:20:43.422734 12204 leader_election.cc:290] T 34f36d59d88f40fe8a2805e604fc6c0a P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:43.404479 12227 raft_consensus.cc:2804] T 3411566abe2d4c9bb4b2adfdd05e6f17 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:20:43.428959 12227 raft_consensus.cc:493] T 3411566abe2d4c9bb4b2adfdd05e6f17 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 12 FOLLOWER]: Starting leader election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:20:43.429497 12227 raft_consensus.cc:3060] T 3411566abe2d4c9bb4b2adfdd05e6f17 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:43.429579 12011 leader_election.cc:290] T fe20b4b48823486ca3b9c648db6ce8aa P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 12 election: Requested vote from peers cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:20:43.430938 12265 raft_consensus.cc:515] T 7ba5dac66ab5497e9e336f2a3c28cda5 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:20:43.431519  6728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bf4668eeb70467fb3dc5a0289233b3c" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:20:43.433030  6728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3f13b31a1f84f0d89d007eadd57924c" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:43.433728 12267 raft_consensus.cc:3055] T 24ee15416e3145beaa1b8183453729a3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:20:43.434566 12267 raft_consensus.cc:740] T 24ee15416e3145beaa1b8183453729a3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 7ba59cc884714e8aa5f3f0ecaed84cbb, State: Running, Role: LEADER
I20260709 13:20:43.435032  6728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7887766dc6784fcaa42b35c05fea7a99" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 17 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:43.437577  6878 raft_consensus.cc:1240] T 90d42e216d9741e190bca19a781291fd P cd75a17ab2604397adab03bb8b5fd75c [term 15 FOLLOWER]: Rejecting Update request from peer b7ab4784c7344b939bc36f639286f377 for earlier term 14. Current term is 15. Ops: []
W20260709 13:20:43.441013 12286 log.cc:927] Time spent T 427c124d773f483294511e80fe340075 P ccd8a4c3bfe3413cb2ae219b09aea832: Append to log took a long time: real 0.713s	user 0.002s	sys 0.000s
I20260709 13:20:43.404850 11937 raft_consensus.cc:515] T f58dc08b12a2494bb9a1372837970ca2 P cd75a17ab2604397adab03bb8b5fd75c [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:43.447252 11937 leader_election.cc:290] T f58dc08b12a2494bb9a1372837970ca2 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 17 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:20:43.444587  6728 raft_consensus.cc:1240] T 20f6842e26174571996b8dea4151d4be P ccd8a4c3bfe3413cb2ae219b09aea832 [term 16 FOLLOWER]: Rejecting Update request from peer b7ab4784c7344b939bc36f639286f377 for earlier term 15. Current term is 16. Ops: []
I20260709 13:20:43.449363  6728 raft_consensus.cc:1240] T 17587d6730594da4a56fa13a353232a1 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 20 FOLLOWER]: Rejecting Update request from peer b7ab4784c7344b939bc36f639286f377 for earlier term 19. Current term is 20. Ops: []
I20260709 13:20:43.452508  5625 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:20:43.453649  6695 leader_election.cc:304] T 20f6842e26174571996b8dea4151d4be P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
I20260709 13:20:43.455000  6695 leader_election.cc:304] T 1528ab62b6fe4e3099d08f141afee116 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb
I20260709 13:20:43.455677 12238 raft_consensus.cc:2804] T 20f6842e26174571996b8dea4151d4be P ccd8a4c3bfe3413cb2ae219b09aea832 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:20:43.456166 12238 raft_consensus.cc:493] T 20f6842e26174571996b8dea4151d4be P ccd8a4c3bfe3413cb2ae219b09aea832 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:43.456519 12238 raft_consensus.cc:3060] T 20f6842e26174571996b8dea4151d4be P ccd8a4c3bfe3413cb2ae219b09aea832 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:43.458110 12218 raft_consensus.cc:2804] T 1528ab62b6fe4e3099d08f141afee116 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:20:43.458745 12218 raft_consensus.cc:697] T 1528ab62b6fe4e3099d08f141afee116 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 13 LEADER]: Becoming Leader. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
I20260709 13:20:43.459777 12218 consensus_queue.cc:237] T 1528ab62b6fe4e3099d08f141afee116 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:20:43.465930  6695 leader_election.cc:304] T 7c44c4849aa54f2b94d1f1bef9ed546f P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
I20260709 13:20:43.467434  6723 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49744 (request call id 566) took 1351 ms. Trace:
I20260709 13:20:43.467986  6723 rpcz_store.cc:276] 0709 13:20:42.116628 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:42.117675 (+  1047us) service_pool.cc:224] Handling call
0709 13:20:42.117982 (+   307us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:42.118252 (+   270us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:20:42.118579 (+   327us) log.cc:844] Serialized 14 byte log entry
0709 13:20:42.436922 (+318343us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:20:42.465483 (+ 28561us) log.cc:844] Serialized 26 byte log entry
0709 13:20:42.465673 (+   190us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:20:42.466048 (+   375us) log.cc:844] Serialized 14 byte log entry
0709 13:20:42.504679 (+ 38631us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:42.504845 (+   166us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:42.956921 (+452076us) spinlock_profiling.cc:243] Waited 5.46 ms on lock 0x7b18004337e0. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc15785de1 00007fcc157925b1 00007fcc0c8bd3f3 00007fcc0c8bf7c1 00007fcc0c8bf779 00007fcc0c8bf709 00007fcc0c8bf6d1 00007fcc0c8be9cd 000000000038f354 000000000038f199 00007fcc0c8a083a
0709 13:20:42.957622 (+   701us) spinlock_profiling.cc:243] Waited 3.11 ms on lock 0x7b18004337e0. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc15785de1 00007fcc157925b1 00007fcc0c8bd3f3 00007fcc0c8bf7c1 00007fcc0c8bf779 00007fcc0c8bf709 00007fcc0c8bf6d1 00007fcc0c8be9cd 000000000038f354 000000000038f199 00007fcc0c8a083a
0709 13:20:43.440292 (+482670us) spinlock_profiling.cc:243] Waited 5.73 ms on lock 0x7b4400022b4c. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0c745db1 00007fcc0c7e3c85 00007fcc0c7e46a2 00007fcc0f5561db 00007fcc0f551aaf 00007fcc0f54586e 00007fcc0f544bb6 00007fcc0f5447d8 00007fcc0f54e221 00007fcc0f54e1d9 00007fcc0f54e169
0709 13:20:43.467132 (+ 26840us) raft_consensus.cc:1685] finished
0709 13:20:43.467166 (+    34us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:43.467356 (+   190us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":38057,"prepare.queue_time_us":3540,"prepare.run_cpu_time_us":127,"prepare.run_wall_time_us":14339,"raft.queue_time_us":50241,"raft.run_cpu_time_us":245,"raft.run_wall_time_us":8843,"spinlock_wait_cycles":32877824,"thread_start_us":317604,"threads_started":1,"wal-append.queue_time_us":432356}
W20260709 13:20:43.399628 12298 log.cc:927] Time spent T 4d9def8b32fd443aa94ab1420b06837b P b7ab4784c7344b939bc36f639286f377: Append to log took a long time: real 0.147s	user 0.002s	sys 0.000s
I20260709 13:20:43.475034  6806 raft_consensus.cc:1240] T 404190ce4ce94cecbfcb6ea9d1dd8626 P b7ab4784c7344b939bc36f639286f377 [term 14 FOLLOWER]: Rejecting Update request from peer 7ba59cc884714e8aa5f3f0ecaed84cbb for earlier term 13. Current term is 14. Ops: []
I20260709 13:20:43.476099  6806 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50550 (request call id 603) took 1126 ms. Trace:
I20260709 13:20:43.476681  6806 rpcz_store.cc:276] 0709 13:20:42.349427 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:43.407186 (+1057759us) service_pool.cc:224] Handling call
0709 13:20:43.474772 (+ 67586us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:43.475736 (+   964us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:43.476004 (+   268us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:20:43.477867  6878 raft_consensus.cc:1240] T f58dc08b12a2494bb9a1372837970ca2 P cd75a17ab2604397adab03bb8b5fd75c [term 17 FOLLOWER]: Rejecting Update request from peer b7ab4784c7344b939bc36f639286f377 for earlier term 16. Current term is 17. Ops: []
I20260709 13:20:43.481213  6881 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53406 (request call id 2538) took 1011 ms. Trace:
I20260709 13:20:43.481822  6881 rpcz_store.cc:276] 0709 13:20:42.469577 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:43.417453 (+947876us) service_pool.cc:224] Handling call
0709 13:20:43.417948 (+   495us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:43.480813 (+ 62865us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:43.481136 (+   323us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:20:43.482668  6805 raft_consensus.cc:1275] T 711ef6523deb4cbe8ef2ba61e1c21c98 P b7ab4784c7344b939bc36f639286f377 [term 17 FOLLOWER]: Refusing update from remote peer cd75a17ab2604397adab03bb8b5fd75c: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 13:20:43.483731  6805 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:32966 (request call id 1319) took 1113 ms. Trace:
I20260709 13:20:43.484252  6805 rpcz_store.cc:276] 0709 13:20:42.370504 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:43.412135 (+1041631us) service_pool.cc:224] Handling call
0709 13:20:43.482155 (+ 70020us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:43.483338 (+  1183us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:43.483647 (+   309us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:20:43.489578 12238 raft_consensus.cc:515] T 20f6842e26174571996b8dea4151d4be P ccd8a4c3bfe3413cb2ae219b09aea832 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:43.492414  6801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7887766dc6784fcaa42b35c05fea7a99" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:43.493247  6801 raft_consensus.cc:2468] T 7887766dc6784fcaa42b35c05fea7a99 P b7ab4784c7344b939bc36f639286f377 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 16.
I20260709 13:20:43.509949 12296 leader_election.cc:290] T 9e326172347f45e99a0d482b5d8ef768 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:20:43.513242  6731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22ccee1b570c4ad3a57bd7aec085b1b4" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:43.521706  6731 raft_consensus.cc:2468] T 22ccee1b570c4ad3a57bd7aec085b1b4 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 12.
I20260709 13:20:43.516395 12253 consensus_queue.cc:260] T 1528ab62b6fe4e3099d08f141afee116 P 7ba59cc884714e8aa5f3f0ecaed84cbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:20:43.524394 12253 raft_consensus.cc:3060] T 1528ab62b6fe4e3099d08f141afee116 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:43.518186 12290 leader_election.cc:290] T 4b8cacb381b746da8d0049b0a83b41dd P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
W20260709 13:20:43.529597 12302 log.cc:927] Time spent T 44bde925b2e541b69890d70715b85176 P cd75a17ab2604397adab03bb8b5fd75c: Append to log took a long time: real 0.153s	user 0.000s	sys 0.001s
I20260709 13:20:43.390018 12249 consensus_queue.cc:260] T be1a92657f494cac8dd227d152f50151 P 7ba59cc884714e8aa5f3f0ecaed84cbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:20:43.531564 12249 raft_consensus.cc:3060] T be1a92657f494cac8dd227d152f50151 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:43.474228 11576 raft_consensus.cc:515] T e77e330a82df4b43a745d57a68f6f057 P cd75a17ab2604397adab03bb8b5fd75c [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } }
I20260709 13:20:43.534420 11576 leader_election.cc:290] T e77e330a82df4b43a745d57a68f6f057 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391)
I20260709 13:20:43.435762 12267 consensus_queue.cc:260] T 24ee15416e3145beaa1b8183453729a3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:20:43.547977  7495 raft_consensus.cc:1240] T 7ba5dac66ab5497e9e336f2a3c28cda5 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 16 FOLLOWER]: Rejecting Update request from peer cd75a17ab2604397adab03bb8b5fd75c for earlier term 15. Current term is 16. Ops: []
I20260709 13:20:43.519582  7500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b8cacb381b746da8d0049b0a83b41dd" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:20:43.522900  6732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20f6842e26174571996b8dea4151d4be" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
W20260709 13:20:43.535940  6771 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:43.549613  6732 raft_consensus.cc:2393] T 20f6842e26174571996b8dea4151d4be P ccd8a4c3bfe3413cb2ae219b09aea832 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7ab4784c7344b939bc36f639286f377 in current term 17: Already voted for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in this term.
W20260709 13:20:43.549944  6771 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:43.529743  6731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34f36d59d88f40fe8a2805e604fc6c0a" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:43.552583  6731 raft_consensus.cc:2468] T 34f36d59d88f40fe8a2805e604fc6c0a P ccd8a4c3bfe3413cb2ae219b09aea832 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 13.
I20260709 13:20:43.515324 12238 leader_election.cc:290] T 20f6842e26174571996b8dea4151d4be P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 17 election: Requested vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
W20260709 13:20:43.538717  6772 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:43.425621 12037 leader_election.cc:290] T 7c37d41cd9164c15a6826ca62a851a69 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
W20260709 13:20:43.560766  6799 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.501s	user 0.016s	sys 0.018s
I20260709 13:20:43.556380  6724 raft_consensus.cc:2468] T 853ac0a8cbd64ce99457f170216d4d0f P ccd8a4c3bfe3413cb2ae219b09aea832 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 14.
I20260709 13:20:43.562322  6724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4db81d9d329422bb3b4160ca4ac2d1d" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:20:43.563491  6772 leader_election.cc:304] T 853ac0a8cbd64ce99457f170216d4d0f P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:20:43.564610  7502 raft_consensus.cc:2468] T 4b8cacb381b746da8d0049b0a83b41dd P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 15.
I20260709 13:20:43.555385 12011 raft_consensus.cc:2804] T 7c44c4849aa54f2b94d1f1bef9ed546f P ccd8a4c3bfe3413cb2ae219b09aea832 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:20:43.564271  6724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c37d41cd9164c15a6826ca62a851a69" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
W20260709 13:20:43.566118  7466 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.527s	user 0.069s	sys 0.139s
W20260709 13:20:43.559537 12292 log.cc:927] Time spent T 427c124d773f483294511e80fe340075 P cd75a17ab2604397adab03bb8b5fd75c: Append to log took a long time: real 0.386s	user 0.002s	sys 0.003s
W20260709 13:20:43.567004  7466 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.528s	user 0.069s	sys 0.139s
I20260709 13:20:43.566887  6805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34f36d59d88f40fe8a2805e604fc6c0a" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:43.564457 11710 raft_consensus.cc:493] T d33d5ee8ef6f415593d8df52063161ad P ccd8a4c3bfe3413cb2ae219b09aea832 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:43.572335 11710 raft_consensus.cc:515] T d33d5ee8ef6f415593d8df52063161ad P ccd8a4c3bfe3413cb2ae219b09aea832 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:43.574520 11710 leader_election.cc:290] T d33d5ee8ef6f415593d8df52063161ad P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:43.569772 12037 raft_consensus.cc:2804] T 853ac0a8cbd64ce99457f170216d4d0f P b7ab4784c7344b939bc36f639286f377 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:20:43.575304 12037 raft_consensus.cc:697] T 853ac0a8cbd64ce99457f170216d4d0f P b7ab4784c7344b939bc36f639286f377 [term 14 LEADER]: Becoming Leader. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
I20260709 13:20:43.576232 12037 consensus_queue.cc:237] T 853ac0a8cbd64ce99457f170216d4d0f P b7ab4784c7344b939bc36f639286f377 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:43.579659  6805 raft_consensus.cc:2468] T 34f36d59d88f40fe8a2805e604fc6c0a P b7ab4784c7344b939bc36f639286f377 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 13.
I20260709 13:20:43.579880  6804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34f36d59d88f40fe8a2805e604fc6c0a" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:43.566248  6806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44bde925b2e541b69890d70715b85176" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
W20260709 13:20:43.582829  7466 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 545450us
I20260709 13:20:43.597046  6805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce4f062dcd314d43a63ca74067cb5ee3" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:43.582752  6772 leader_election.cc:304] T 22ccee1b570c4ad3a57bd7aec085b1b4 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
W20260709 13:20:43.598317  7467 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:43.599839  6799 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:32976 (request call id 3229) took 1440 ms. Trace:
I20260709 13:20:43.600822  6805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5be3a11b23d4ea9b08300a2789821c7" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:43.601387  6804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d33d5ee8ef6f415593d8df52063161ad" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:43.599267  6772 leader_election.cc:304] T 34f36d59d88f40fe8a2805e604fc6c0a P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:20:43.624555  6772 leader_election.cc:304] T c4db81d9d329422bb3b4160ca4ac2d1d P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
W20260709 13:20:43.625984  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 630305us
I20260709 13:20:43.630270  6804 raft_consensus.cc:1275] T f03d0dbf16864ca4bc1bb5e4c0334c0f P b7ab4784c7344b939bc36f639286f377 [term 15 FOLLOWER]: Refusing update from remote peer ccd8a4c3bfe3413cb2ae219b09aea832: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 15 index: 8. (term mismatch)
I20260709 13:20:43.630872  6804 pending_rounds.cc:85] T f03d0dbf16864ca4bc1bb5e4c0334c0f P b7ab4784c7344b939bc36f639286f377: Aborting all ops after (but not including) 7
I20260709 13:20:43.631157  6804 pending_rounds.cc:107] T f03d0dbf16864ca4bc1bb5e4c0334c0f P b7ab4784c7344b939bc36f639286f377: Aborting uncommitted NO_OP operation due to leader change: 14.8
I20260709 13:20:43.631425  6804 raft_consensus.cc:2889] T f03d0dbf16864ca4bc1bb5e4c0334c0f P b7ab4784c7344b939bc36f639286f377 [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:20:43.632788  6804 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:32976 (request call id 3239) took 1232 ms. Trace:
I20260709 13:20:43.633276  6804 rpcz_store.cc:276] 0709 13:20:42.400764 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:43.629324 (+1228560us) service_pool.cc:224] Handling call
0709 13:20:43.629788 (+   464us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:43.631985 (+  2197us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:43.632710 (+   725us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:20:43.607805 11576 raft_consensus.cc:493] T 4275cf08e63345f993bce8664eada830 P cd75a17ab2604397adab03bb8b5fd75c [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:20:43.636217  6878 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53406 (request call id 2541) took 1165 ms. Trace:
I20260709 13:20:43.636751  6878 rpcz_store.cc:276] 0709 13:20:42.470320 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:43.439506 (+969186us) service_pool.cc:224] Handling call
0709 13:20:43.439789 (+   283us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:43.485498 (+ 45709us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:43.635865 (+150367us) spinlock_profiling.cc:243] Waited 32.5 ms on lock 0x7b54002175d4. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f9aae01 00007fcc0f9a983e 00007fcc1496e419 00007fcc0dee5bd4 00007fcc0dee5b62 00007fcc0dee5a91 00007fcc0dee5a0c 00007fcc0dee4cc2 00007fcc0dce548c 00007fcc0dce48c6
0709 13:20:43.636136 (+   271us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":74784640}
I20260709 13:20:43.597994 12011 raft_consensus.cc:697] T 7c44c4849aa54f2b94d1f1bef9ed546f P ccd8a4c3bfe3413cb2ae219b09aea832 [term 17 LEADER]: Becoming Leader. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
I20260709 13:20:43.621801  6799 rpcz_store.cc:276] 0709 13:20:42.159928 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:42.160121 (+   193us) service_pool.cc:224] Handling call
0709 13:20:42.169300 (+  9179us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:20:42.193785 (+ 24485us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:42.193833 (+    48us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:20:42.215011 (+ 21178us) log.cc:844] Serialized 52 byte log entry
0709 13:20:42.988578 (+773567us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:20:43.561427 (+572849us) log.cc:844] Serialized 14 byte log entry
0709 13:20:43.586818 (+ 25391us) log.cc:844] Serialized 14 byte log entry
0709 13:20:43.599273 (+ 12455us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:43.599394 (+   121us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:43.599458 (+    64us) raft_consensus.cc:1685] finished
0709 13:20:43.599557 (+    99us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:43.599762 (+   205us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":43798,"prepare.queue_time_us":140233,"prepare.run_cpu_time_us":77,"prepare.run_wall_time_us":79,"raft.queue_time_us":62286,"raft.run_cpu_time_us":288,"raft.run_wall_time_us":29263,"spinlock_wait_cycles":5855744,"thread_start_us":1174680,"threads_started":2,"wal-append.queue_time_us":1030955}
I20260709 13:20:43.615061 12187 raft_consensus.cc:2804] T 22ccee1b570c4ad3a57bd7aec085b1b4 P b7ab4784c7344b939bc36f639286f377 [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 13:20:43.614230  7468 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.575s	user 0.013s	sys 0.022s
W20260709 13:20:43.645232  7468 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.606s	user 0.013s	sys 0.022s
I20260709 13:20:43.621428  5625 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:20:43.647449  6805 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:32976 (request call id 3240) took 1246 ms. Trace:
I20260709 13:20:43.642518  6844 leader_election.cc:304] T 3411566abe2d4c9bb4b2adfdd05e6f17 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:20:43.616703  6806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20f6842e26174571996b8dea4151d4be" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
W20260709 13:20:43.618335  6697 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 580723us
I20260709 13:20:43.648072  6805 rpcz_store.cc:276] 0709 13:20:42.401046 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:43.632193 (+1231147us) service_pool.cc:224] Handling call
0709 13:20:43.646757 (+ 14564us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:43.647018 (+   261us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:43.647056 (+    38us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:20:43.647115 (+    59us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:20:43.647161 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:43.647232 (+    71us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:43.647374 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:20:43.649302  6806 raft_consensus.cc:3060] T 20f6842e26174571996b8dea4151d4be P b7ab4784c7344b939bc36f639286f377 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:20:43.647398  7468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 656706us
W20260709 13:20:43.653734  7468 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:43.664270  6844 leader_election.cc:304] T 7a734b5ab7834e05a8c422208acc58b1 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:20:43.642495 11666 raft_consensus.cc:2804] T c4db81d9d329422bb3b4160ca4ac2d1d P b7ab4784c7344b939bc36f639286f377 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:20:43.670189 11666 raft_consensus.cc:697] T c4db81d9d329422bb3b4160ca4ac2d1d P b7ab4784c7344b939bc36f639286f377 [term 15 LEADER]: Becoming Leader. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
I20260709 13:20:43.670620 11994 consensus_queue.cc:1048] T f03d0dbf16864ca4bc1bb5e4c0334c0f P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:20:43.671628 12297 leader_election.cc:290] T d33d5ee8ef6f415593d8df52063161ad P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
W20260709 13:20:43.642705 12159 consensus_meta.cc:287] T e31b9971c15848dea59d4d4130141d9e P b7ab4784c7344b939bc36f639286f377: Time spent flushing consensus metadata: real 0.758s	user 0.014s	sys 0.000s
I20260709 13:20:43.615530 12227 raft_consensus.cc:515] T 3411566abe2d4c9bb4b2adfdd05e6f17 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:43.636022 12174 raft_consensus.cc:2804] T 34f36d59d88f40fe8a2805e604fc6c0a P b7ab4784c7344b939bc36f639286f377 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:20:43.641789 11937 raft_consensus.cc:493] T dbdf895bba214ff68685a24fd17dfb5d P cd75a17ab2604397adab03bb8b5fd75c [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:43.641485 12290 raft_consensus.cc:493] T 8c7f33e544204fbaac4078e3e83bbf4e P cd75a17ab2604397adab03bb8b5fd75c [term 13 FOLLOWER]: Starting pre-election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:20:43.644330 12187 raft_consensus.cc:493] T 22ccee1b570c4ad3a57bd7aec085b1b4 P b7ab4784c7344b939bc36f639286f377 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:43.662902 12097 raft_consensus.cc:493] T f03d0dbf16864ca4bc1bb5e4c0334c0f P cd75a17ab2604397adab03bb8b5fd75c [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:43.689203  6804 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:32976 (request call id 3242) took 1287 ms. Trace:
I20260709 13:20:43.689989  7495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe20b4b48823486ca3b9c648db6ce8aa" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb"
I20260709 13:20:43.706492  7495 raft_consensus.cc:3060] T fe20b4b48823486ca3b9c648db6ce8aa P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:20:43.646061 12306 raft_consensus.cc:493] T 24ee15416e3145beaa1b8183453729a3 P cd75a17ab2604397adab03bb8b5fd75c [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 7ba59cc884714e8aa5f3f0ecaed84cbb)
I20260709 13:20:43.665817 12296 raft_consensus.cc:493] T d8cee0accdb8499c86d4414b72565a38 P cd75a17ab2604397adab03bb8b5fd75c [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 7ba59cc884714e8aa5f3f0ecaed84cbb)
I20260709 13:20:43.706080  6804 rpcz_store.cc:276] 0709 13:20:42.401524 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:43.667333 (+1265809us) service_pool.cc:224] Handling call
0709 13:20:43.688535 (+ 21202us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:43.688768 (+   233us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:43.688804 (+    36us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:20:43.688859 (+    55us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:20:43.688901 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:43.688972 (+    71us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:43.689129 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:20:43.672559 12086 raft_consensus.cc:2749] T 3411566abe2d4c9bb4b2adfdd05e6f17 P cd75a17ab2604397adab03bb8b5fd75c [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:20:43.692747  6878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20f6842e26174571996b8dea4151d4be" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:43.722657  6878 raft_consensus.cc:2468] T 20f6842e26174571996b8dea4151d4be P cd75a17ab2604397adab03bb8b5fd75c [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 16.
I20260709 13:20:43.726845  6806 raft_consensus.cc:2468] T 20f6842e26174571996b8dea4151d4be P b7ab4784c7344b939bc36f639286f377 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 17.
I20260709 13:20:43.729091  6806 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50550 (request call id 608) took 1323 ms. Trace:
I20260709 13:20:43.732376  6726 raft_consensus.cc:1240] T 3411566abe2d4c9bb4b2adfdd05e6f17 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 13 FOLLOWER]: Rejecting Update request from peer b7ab4784c7344b939bc36f639286f377 for earlier term 12. Current term is 13. Ops: []
I20260709 13:20:43.719480 11634 raft_consensus.cc:493] T 9e326172347f45e99a0d482b5d8ef768 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:20:43.690960 12174 raft_consensus.cc:493] T 34f36d59d88f40fe8a2805e604fc6c0a P b7ab4784c7344b939bc36f639286f377 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:43.674046 11951 consensus_queue.cc:1059] T 90d42e216d9741e190bca19a781291fd P b7ab4784c7344b939bc36f639286f377 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: INVALID_TERM, Last received: 14.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.044s
W20260709 13:20:43.735242  6696 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:43.663606 11576 raft_consensus.cc:515] T 4275cf08e63345f993bce8664eada830 P cd75a17ab2604397adab03bb8b5fd75c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:43.701023 12187 raft_consensus.cc:3060] T 22ccee1b570c4ad3a57bd7aec085b1b4 P b7ab4784c7344b939bc36f639286f377 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:43.671463 11666 consensus_queue.cc:237] T c4db81d9d329422bb3b4160ca4ac2d1d P b7ab4784c7344b939bc36f639286f377 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:43.742807  6804 raft_consensus.cc:1240] T d8cee0accdb8499c86d4414b72565a38 P b7ab4784c7344b939bc36f639286f377 [term 15 FOLLOWER]: Rejecting Update request from peer 7ba59cc884714e8aa5f3f0ecaed84cbb for earlier term 14. Current term is 15. Ops: []
I20260709 13:20:43.731676 12306 raft_consensus.cc:515] T 24ee15416e3145beaa1b8183453729a3 P cd75a17ab2604397adab03bb8b5fd75c [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:20:43.759325  6806 rpcz_store.cc:276] 0709 13:20:42.405787 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:43.728095 (+1322308us) service_pool.cc:224] Handling call
0709 13:20:43.728478 (+   383us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:43.728695 (+   217us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:43.728733 (+    38us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:20:43.728788 (+    55us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:20:43.728831 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:43.728899 (+    68us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:43.729019 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:20:43.742084  6772 leader_election.cc:304] T 20f6842e26174571996b8dea4151d4be P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:20:43.683226 12159 raft_consensus.cc:515] T e31b9971c15848dea59d4d4130141d9e P b7ab4784c7344b939bc36f639286f377 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:43.689751 12297 consensus_queue.cc:1059] T 7ba5dac66ab5497e9e336f2a3c28cda5 P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false }, Status: INVALID_TERM, Last received: 15.12, Next index: 13, Last known committed idx: 11, Time since last communication: 0.049s
I20260709 13:20:43.749373  6878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c37d41cd9164c15a6826ca62a851a69" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:43.778287  6878 raft_consensus.cc:2468] T 7c37d41cd9164c15a6826ca62a851a69 P cd75a17ab2604397adab03bb8b5fd75c [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 14.
I20260709 13:20:43.700273 11937 raft_consensus.cc:515] T dbdf895bba214ff68685a24fd17dfb5d P cd75a17ab2604397adab03bb8b5fd75c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:43.711041 12290 raft_consensus.cc:515] T 8c7f33e544204fbaac4078e3e83bbf4e P cd75a17ab2604397adab03bb8b5fd75c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:43.742033 12305 raft_consensus.cc:2749] T 7a734b5ab7834e05a8c422208acc58b1 P cd75a17ab2604397adab03bb8b5fd75c [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:20:43.757097  7495 raft_consensus.cc:2468] T fe20b4b48823486ca3b9c648db6ce8aa P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 12.
I20260709 13:20:43.720968 12097 raft_consensus.cc:515] T f03d0dbf16864ca4bc1bb5e4c0334c0f P cd75a17ab2604397adab03bb8b5fd75c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:43.787918 12097 leader_election.cc:290] T f03d0dbf16864ca4bc1bb5e4c0334c0f P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:20:43.762625  6877 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53416 (request call id 3259) took 1385 ms. Trace:
I20260709 13:20:43.788712  6877 rpcz_store.cc:276] 0709 13:20:42.377075 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:43.288238 (+911163us) service_pool.cc:224] Handling call
0709 13:20:43.312134 (+ 23896us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:43.356674 (+ 44540us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:43.762294 (+405620us) spinlock_profiling.cc:243] Waited 23.4 ms on lock 0x7b54001e8cd0. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f9a98ad 00007fcc1496e419 00007fcc0dee5bd4 00007fcc0dee5b62 00007fcc0dee5a91 00007fcc0dee5a0c 00007fcc0dee4cc2 00007fcc0dce548c 00007fcc0dce48c6 00007fcc0dce426f
0709 13:20:43.762534 (+   240us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":53874048}
I20260709 13:20:43.790542  6877 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53406 (request call id 2544) took 1319 ms. Trace:
I20260709 13:20:43.766434 11634 raft_consensus.cc:515] T 9e326172347f45e99a0d482b5d8ef768 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:43.790884  6877 rpcz_store.cc:276] 0709 13:20:42.471065 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:43.789684 (+1318619us) service_pool.cc:224] Handling call
0709 13:20:43.790048 (+   364us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:43.790230 (+   182us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:43.790255 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:20:43.790298 (+    43us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:20:43.790333 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:43.790389 (+    56us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:43.790483 (+    94us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:20:43.733681 12296 raft_consensus.cc:515] T d8cee0accdb8499c86d4414b72565a38 P cd75a17ab2604397adab03bb8b5fd75c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:20:43.764314 12174 raft_consensus.cc:3060] T 34f36d59d88f40fe8a2805e604fc6c0a P b7ab4784c7344b939bc36f639286f377 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:43.792326 12288 raft_consensus.cc:493] T bb3d8792045a4583ae2e965b1350a5b4 P cd75a17ab2604397adab03bb8b5fd75c [term 13 FOLLOWER]: Starting pre-election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:20:43.793282 12296 leader_election.cc:290] T d8cee0accdb8499c86d4414b72565a38 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:20:43.781615 12148 raft_consensus.cc:2764] T 20f6842e26174571996b8dea4151d4be P b7ab4784c7344b939bc36f639286f377 [term 17 FOLLOWER]: Leader pre-election decision vote started in defunct term 16: won
I20260709 13:20:43.768599  6804 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50550 (request call id 606) took 1363 ms. Trace:
I20260709 13:20:43.797044  6804 rpcz_store.cc:276] 0709 13:20:42.405050 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:43.730667 (+1325617us) service_pool.cc:224] Handling call
0709 13:20:43.742626 (+ 11959us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:43.768192 (+ 25566us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:43.768523 (+   331us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:20:43.799304  6804 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:32976 (request call id 3248) took 1356 ms. Trace:
I20260709 13:20:43.688004 12102 consensus_queue.cc:1059] T f58dc08b12a2494bb9a1372837970ca2 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: INVALID_TERM, Last received: 16.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.050s
I20260709 13:20:43.801121 12102 raft_consensus.cc:3055] T f58dc08b12a2494bb9a1372837970ca2 P b7ab4784c7344b939bc36f639286f377 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:20:43.801569 12102 raft_consensus.cc:740] T f58dc08b12a2494bb9a1372837970ca2 P b7ab4784c7344b939bc36f639286f377 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
I20260709 13:20:43.802670 12102 consensus_queue.cc:260] T f58dc08b12a2494bb9a1372837970ca2 P b7ab4784c7344b939bc36f639286f377 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:43.745114 12011 consensus_queue.cc:237] T 7c44c4849aa54f2b94d1f1bef9ed546f P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:43.805570 12227 leader_election.cc:290] T 3411566abe2d4c9bb4b2adfdd05e6f17 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 13 election: Requested vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:43.807883  6803 raft_consensus.cc:2368] T e31b9971c15848dea59d4d4130141d9e P b7ab4784c7344b939bc36f639286f377 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c for earlier term 12. Current term is 13.
I20260709 13:20:43.809249 12159 leader_election.cc:290] T e31b9971c15848dea59d4d4130141d9e P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 13 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
W20260709 13:20:43.809597  6803 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:32966 (request call id 1311) took 1500 ms (client timeout 1898 ms). Trace:
W20260709 13:20:43.810199  6803 rpcz_store.cc:269] 0709 13:20:42.308786 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:42.602154 (+293368us) service_pool.cc:224] Handling call
0709 13:20:43.809329 (+1207175us) spinlock_profiling.cc:243] Waited 1.09 s on lock 0x7b54001b3fd4. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f9ae2fa 00007fcc1496fb17 00007fcc0deea6d4 00007fcc0deea662 00007fcc0deea591 00007fcc0deea50c 00007fcc0dee97c2 00007fcc0dce548c 00007fcc0dce48c6 00007fcc0dce426f
0709 13:20:43.809525 (+   196us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2510923008}
I20260709 13:20:43.811758 11937 leader_election.cc:290] T dbdf895bba214ff68685a24fd17dfb5d P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:20:43.812763 12097 raft_consensus.cc:493] T d8292e16e5654be6bc408560cf256aaa P cd75a17ab2604397adab03bb8b5fd75c [term 17 FOLLOWER]: Starting pre-election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:20:43.813297 12097 raft_consensus.cc:515] T d8292e16e5654be6bc408560cf256aaa P cd75a17ab2604397adab03bb8b5fd75c [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:43.814358  6807 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50550 (request call id 600) took 1513 ms. Trace:
I20260709 13:20:43.770352 11576 leader_election.cc:290] T 4275cf08e63345f993bce8664eada830 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:20:43.764647 12265 leader_election.cc:290] T 7ba5dac66ab5497e9e336f2a3c28cda5 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 16 election: Requested vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:43.815356 12097 leader_election.cc:290] T d8292e16e5654be6bc408560cf256aaa P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:20:43.771463 11951 raft_consensus.cc:3055] T 90d42e216d9741e190bca19a781291fd P b7ab4784c7344b939bc36f639286f377 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:20:43.814882  6807 rpcz_store.cc:276] 0709 13:20:42.301296 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:43.049559 (+748263us) service_pool.cc:224] Handling call
0709 13:20:43.267466 (+217907us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:43.271927 (+  4461us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:43.814071 (+542144us) spinlock_profiling.cc:243] Waited 98.6 ms on lock 0x7b54001b4ed0. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f9a98ad 00007fcc1496e419 00007fcc0dee5bd4 00007fcc0dee5b62 00007fcc0dee5a91 00007fcc0dee5a0c 00007fcc0dee4cc2 00007fcc0dce548c 00007fcc0dce48c6 00007fcc0dce426f
0709 13:20:43.814275 (+   204us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":226776448}
I20260709 13:20:43.816802  6807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3411566abe2d4c9bb4b2adfdd05e6f17" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:20:43.816941 11634 leader_election.cc:290] T 9e326172347f45e99a0d482b5d8ef768 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
W20260709 13:20:43.774083 12307 log.cc:927] Time spent T 17587d6730594da4a56fa13a353232a1 P 7ba59cc884714e8aa5f3f0ecaed84cbb: Append to log took a long time: real 0.055s	user 0.000s	sys 0.001s
W20260709 13:20:43.774910 12308 log.cc:927] Time spent T 3fa34c08b205435dba97346991aa1f92 P cd75a17ab2604397adab03bb8b5fd75c: Append to log took a long time: real 0.064s	user 0.000s	sys 0.001s
I20260709 13:20:43.821379  6879 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58592 (request call id 448) took 1682 ms. Trace:
I20260709 13:20:43.815927 11951 raft_consensus.cc:740] T 90d42e216d9741e190bca19a781291fd P b7ab4784c7344b939bc36f639286f377 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
I20260709 13:20:43.821785  6879 rpcz_store.cc:276] 0709 13:20:42.138623 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:42.140028 (+  1405us) service_pool.cc:224] Handling call
0709 13:20:42.140566 (+   538us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:42.945096 (+804530us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:42.945130 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:20:42.945682 (+   552us) log.cc:844] Serialized 26 byte log entry
0709 13:20:43.316053 (+370371us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:20:43.742090 (+426037us) log.cc:844] Serialized 14 byte log entry
0709 13:20:43.742319 (+   229us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:43.742396 (+    77us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:43.821131 (+ 78735us) raft_consensus.cc:1685] finished
0709 13:20:43.821163 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:43.821309 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":30286,"prepare.queue_time_us":258548,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":36,"raft.queue_time_us":209745,"raft.run_cpu_time_us":254,"raft.run_wall_time_us":9762,"thread_start_us":1528825,"threads_started":3,"wal-append.queue_time_us":696518}
I20260709 13:20:43.822731 11951 consensus_queue.cc:260] T 90d42e216d9741e190bca19a781291fd P b7ab4784c7344b939bc36f639286f377 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:43.823942  6879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e31b9971c15848dea59d4d4130141d9e" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:20:43.824167 11951 raft_consensus.cc:3060] T 90d42e216d9741e190bca19a781291fd P b7ab4784c7344b939bc36f639286f377 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:43.824570  6879 raft_consensus.cc:3060] T e31b9971c15848dea59d4d4130141d9e P cd75a17ab2604397adab03bb8b5fd75c [term 11 FOLLOWER]: Advancing to term 13
I20260709 13:20:43.824704  6727 raft_consensus.cc:1240] T 7a734b5ab7834e05a8c422208acc58b1 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 16 FOLLOWER]: Rejecting Update request from peer b7ab4784c7344b939bc36f639286f377 for earlier term 15. Current term is 16. Ops: [13.6-15.7]
I20260709 13:20:43.775100  6876 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53406 (request call id 2535) took 1306 ms. Trace:
I20260709 13:20:43.827217  6876 rpcz_store.cc:276] 0709 13:20:42.468802 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:43.312371 (+843569us) service_pool.cc:224] Handling call
0709 13:20:43.364204 (+ 51833us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:43.368901 (+  4697us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:43.774869 (+405968us) spinlock_profiling.cc:243] Waited 51.4 ms on lock 0x7b54002373d0. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f9a98ad 00007fcc1496e419 00007fcc0dee5bd4 00007fcc0dee5b62 00007fcc0dee5a91 00007fcc0dee5a0c 00007fcc0dee4cc2 00007fcc0dce548c 00007fcc0dce48c6 00007fcc0dce426f
0709 13:20:43.775027 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":118303104}
I20260709 13:20:43.828222  6798 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:32976 (request call id 3241) took 1426 ms. Trace:
I20260709 13:20:43.828744  6798 rpcz_store.cc:276] 0709 13:20:42.401289 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:42.958234 (+556945us) service_pool.cc:224] Handling call
0709 13:20:43.827973 (+869739us) spinlock_profiling.cc:243] Waited 6.68 ms on lock 0x7b54001a40d4. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f9ae2fa 00007fcc1496fb17 00007fcc0deea6d4 00007fcc0deea662 00007fcc0deea591 00007fcc0deea50c 00007fcc0dee97c2 00007fcc0dce548c 00007fcc0dce48c6 00007fcc0dce426f
0709 13:20:43.828141 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":15360896}
I20260709 13:20:43.799769  6804 rpcz_store.cc:276] 0709 13:20:42.442397 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:43.798015 (+1355618us) service_pool.cc:224] Handling call
0709 13:20:43.798458 (+   443us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:43.798838 (+   380us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:43.798882 (+    44us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:20:43.798943 (+    61us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:20:43.798995 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:43.799071 (+    76us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:43.799232 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:20:43.836297 12102 raft_consensus.cc:3060] T f58dc08b12a2494bb9a1372837970ca2 P b7ab4784c7344b939bc36f639286f377 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:43.838441 12267 raft_consensus.cc:3060] T 24ee15416e3145beaa1b8183453729a3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:20:43.845868  6773 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:43.846524  6773 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:43.819823  6805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e326172347f45e99a0d482b5d8ef768" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:43.855417  6772 leader_election.cc:304] T 7c37d41cd9164c15a6826ca62a851a69 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:20:43.851951 12275 raft_consensus.cc:493] T bd6869f07b5a4885a0b99fbe60c3b175 P b7ab4784c7344b939bc36f639286f377 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:20:43.827268  6727 raft_consensus.cc:1275] T dbdf895bba214ff68685a24fd17dfb5d P ccd8a4c3bfe3413cb2ae219b09aea832 [term 14 FOLLOWER]: Refusing update from remote peer b7ab4784c7344b939bc36f639286f377: Log matching property violated. Preceding OpId in replica: term: 10 index: 4. Preceding OpId from leader: term: 12 index: 5. (index mismatch)
W20260709 13:20:43.874325  6872 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.614s	user 0.012s	sys 0.065s
I20260709 13:20:43.857429  6695 leader_election.cc:304] T 20f6842e26174571996b8dea4151d4be P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
I20260709 13:20:43.876951  6798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f00a2e87e56452083b759f60d461ee3" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
W20260709 13:20:43.877961  6872 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.622s	user 0.013s	sys 0.065s
I20260709 13:20:43.782186 12246 raft_consensus.cc:493] T 30e88460611e47b2ba16a46a30b5f416 P b7ab4784c7344b939bc36f639286f377 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:20:43.877775  6798 raft_consensus.cc:2468] T 4f00a2e87e56452083b759f60d461ee3 P b7ab4784c7344b939bc36f639286f377 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in term 16.
I20260709 13:20:43.879899  6695 leader_election.cc:304] T 22ccee1b570c4ad3a57bd7aec085b1b4 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
I20260709 13:20:43.881676  6772 leader_election.cc:304] T d8cee0accdb8499c86d4414b72565a38 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:20:43.896409  6878 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53416 (request call id 3265) took 1383 ms. Trace:
I20260709 13:20:43.897046  6798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ba5dac66ab5497e9e336f2a3c28cda5" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:20:43.896999  6878 rpcz_store.cc:276] 0709 13:20:42.513283 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:43.854683 (+1341400us) service_pool.cc:224] Handling call
0709 13:20:43.895730 (+ 41047us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:43.895990 (+   260us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:43.896020 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:20:43.896115 (+    95us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:20:43.896150 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:43.896208 (+    58us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:43.896341 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:20:43.898806  7466 leader_election.cc:304] T 4f00a2e87e56452083b759f60d461ee3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, b7ab4784c7344b939bc36f639286f377; no voters: 
I20260709 13:20:43.910293  6879 raft_consensus.cc:2468] T e31b9971c15848dea59d4d4130141d9e P cd75a17ab2604397adab03bb8b5fd75c [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 13.
I20260709 13:20:43.918496  6772 leader_election.cc:304] T 427c124d773f483294511e80fe340075 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:20:43.876608 11870 raft_consensus.cc:2804] T 7c37d41cd9164c15a6826ca62a851a69 P b7ab4784c7344b939bc36f639286f377 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:20:43.932075  6878 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53416 (request call id 3268) took 1374 ms. Trace:
I20260709 13:20:43.932662  6878 rpcz_store.cc:276] 0709 13:20:42.558105 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:43.898989 (+1340884us) service_pool.cc:224] Handling call
0709 13:20:43.931496 (+ 32507us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:43.931701 (+   205us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:43.931730 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:20:43.931775 (+    45us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:20:43.931807 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:43.931878 (+    71us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:43.931993 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:20:43.934139  6879 raft_consensus.cc:1275] T f03d0dbf16864ca4bc1bb5e4c0334c0f P cd75a17ab2604397adab03bb8b5fd75c [term 15 FOLLOWER]: Refusing update from remote peer ccd8a4c3bfe3413cb2ae219b09aea832: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
W20260709 13:20:43.899564 12090 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.516s	user 0.014s	sys 0.035s
I20260709 13:20:43.914561 12148 raft_consensus.cc:2749] T d8cee0accdb8499c86d4414b72565a38 P b7ab4784c7344b939bc36f639286f377 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
W20260709 13:20:43.940392 12278 consensus_meta.cc:287] T 9b3759de40694069b13c0f8bd40e5709 P b7ab4784c7344b939bc36f639286f377: Time spent flushing consensus metadata: real 0.567s	user 0.006s	sys 0.005s
I20260709 13:20:43.896554 12209 raft_consensus.cc:2804] T 20f6842e26174571996b8dea4151d4be P ccd8a4c3bfe3413cb2ae219b09aea832 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:20:43.793241 12288 raft_consensus.cc:515] T bb3d8792045a4583ae2e965b1350a5b4 P cd75a17ab2604397adab03bb8b5fd75c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
W20260709 13:20:43.963429  7466 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:43.866817 12187 raft_consensus.cc:515] T 22ccee1b570c4ad3a57bd7aec085b1b4 P b7ab4784c7344b939bc36f639286f377 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
W20260709 13:20:43.954121  6874 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.642s	user 0.021s	sys 0.037s
I20260709 13:20:43.864717 12275 raft_consensus.cc:515] T bd6869f07b5a4885a0b99fbe60c3b175 P b7ab4784c7344b939bc36f639286f377 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
W20260709 13:20:43.943423 12090 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.569s	user 0.015s	sys 0.035s
I20260709 13:20:43.924844 11994 raft_consensus.cc:2804] T 22ccee1b570c4ad3a57bd7aec085b1b4 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 13:20:43.969342  6874 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.661s	user 0.022s	sys 0.037s
I20260709 13:20:43.941623 11870 raft_consensus.cc:493] T 7c37d41cd9164c15a6826ca62a851a69 P b7ab4784c7344b939bc36f639286f377 [term 14 FOLLOWER]: Starting leader election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:20:43.919616 12247 consensus_queue.cc:1059] T d8cee0accdb8499c86d4414b72565a38 P 7ba59cc884714e8aa5f3f0ecaed84cbb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: INVALID_TERM, Last received: 14.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.055s
I20260709 13:20:43.915328 12246 raft_consensus.cc:515] T 30e88460611e47b2ba16a46a30b5f416 P b7ab4784c7344b939bc36f639286f377 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:43.985306  6730 raft_consensus.cc:1275] T 17587d6730594da4a56fa13a353232a1 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 20 FOLLOWER]: Refusing update from remote peer 7ba59cc884714e8aa5f3f0ecaed84cbb: Log matching property violated. Preceding OpId in replica: term: 19 index: 13. Preceding OpId from leader: term: 20 index: 14. (index mismatch)
I20260709 13:20:43.988468  6874 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58592 (request call id 450) took 1845 ms. Trace:
W20260709 13:20:43.972674  6880 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.560s	user 0.014s	sys 0.010s
W20260709 13:20:44.030345  6880 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.631s	user 0.015s	sys 0.010s
I20260709 13:20:43.955696 12265 raft_consensus.cc:2804] T 4f00a2e87e56452083b759f60d461ee3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:20:44.031942 12288 leader_election.cc:290] T bb3d8792045a4583ae2e965b1350a5b4 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
W20260709 13:20:44.033299 12249 consensus_meta.cc:287] T be1a92657f494cac8dd227d152f50151 P 7ba59cc884714e8aa5f3f0ecaed84cbb: Time spent flushing consensus metadata: real 0.501s	user 0.010s	sys 0.004s
I20260709 13:20:44.035545 12246 leader_election.cc:290] T 30e88460611e47b2ba16a46a30b5f416 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:44.031749 12265 raft_consensus.cc:493] T 4f00a2e87e56452083b759f60d461ee3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 16 FOLLOWER]: Starting leader election (detected failure of leader cd75a17ab2604397adab03bb8b5fd75c)
I20260709 13:20:44.040560 12265 raft_consensus.cc:3060] T 4f00a2e87e56452083b759f60d461ee3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:44.041811 12275 leader_election.cc:290] T bd6869f07b5a4885a0b99fbe60c3b175 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:44.025838  6874 rpcz_store.cc:276] 0709 13:20:42.142948 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:42.143117 (+   169us) service_pool.cc:224] Handling call
0709 13:20:42.197404 (+ 54287us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:42.197715 (+   311us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:20:42.251598 (+ 53883us) log.cc:844] Serialized 14 byte log entry
0709 13:20:43.523453 (+1271855us) spinlock_profiling.cc:243] Waited 7.09 ms on lock 0x7b4400022b4c. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0c745db1 00007fcc0c7e3c85 00007fcc0c7e46a2 00007fcc0f5561db 00007fcc0f551aaf 00007fcc0f54586e 00007fcc0f544bb6 00007fcc0f5447d8 00007fcc0f54e221 00007fcc0f54e1d9 00007fcc0f54e169
0709 13:20:43.987642 (+464189us) log.cc:844] Serialized 14 byte log entry
0709 13:20:43.987992 (+   350us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:20:43.988077 (+    85us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:20:43.988137 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:43.988233 (+    96us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:43.988399 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":24778,"prepare.queue_time_us":323074,"prepare.run_cpu_time_us":136,"prepare.run_wall_time_us":4394,"raft.queue_time_us":299506,"raft.run_cpu_time_us":361,"raft.run_wall_time_us":53392,"spinlock_wait_cycles":16302976,"thread_start_us":1666859,"threads_started":3,"wal-append.queue_time_us":848235}
I20260709 13:20:44.045918  6874 raft_consensus.cc:1275] T dbdf895bba214ff68685a24fd17dfb5d P cd75a17ab2604397adab03bb8b5fd75c [term 14 FOLLOWER]: Refusing update from remote peer b7ab4784c7344b939bc36f639286f377: Log matching property violated. Preceding OpId in replica: term: 12 index: 5. Preceding OpId from leader: term: 14 index: 6. (index mismatch)
I20260709 13:20:44.046375 12306 leader_election.cc:290] T 24ee15416e3145beaa1b8183453729a3 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:20:44.046746  6874 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53406 (request call id 2547) took 1317 ms. Trace:
I20260709 13:20:43.978150 12209 raft_consensus.cc:697] T 20f6842e26174571996b8dea4151d4be P ccd8a4c3bfe3413cb2ae219b09aea832 [term 17 LEADER]: Becoming Leader. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
I20260709 13:20:43.943678 12159 consensus_queue.cc:1059] T 17587d6730594da4a56fa13a353232a1 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false }, Status: INVALID_TERM, Last received: 19.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.037s
I20260709 13:20:44.009773  6798 raft_consensus.cc:1275] T be1a92657f494cac8dd227d152f50151 P b7ab4784c7344b939bc36f639286f377 [term 16 FOLLOWER]: Refusing update from remote peer ccd8a4c3bfe3413cb2ae219b09aea832: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:20:43.996135 11994 raft_consensus.cc:493] T 22ccee1b570c4ad3a57bd7aec085b1b4 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 12 FOLLOWER]: Starting leader election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:20:43.975425  6879 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53416 (request call id 3270) took 1364 ms. Trace:
I20260709 13:20:44.048427  6800 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:32966 (request call id 1307) took 1743 ms. Trace:
I20260709 13:20:44.047364  6874 rpcz_store.cc:276] 0709 13:20:42.729746 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:44.044995 (+1315249us) service_pool.cc:224] Handling call
0709 13:20:44.045434 (+   439us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:44.046420 (+   986us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:44.046674 (+   254us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:20:43.782055  6697 leader_election.cc:304] T ab432e62819d499eaaf3dd55481dd930 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:20:44.010404 11870 raft_consensus.cc:3060] T 7c37d41cd9164c15a6826ca62a851a69 P b7ab4784c7344b939bc36f639286f377 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:44.023763  6807 raft_consensus.cc:2468] T 3411566abe2d4c9bb4b2adfdd05e6f17 P b7ab4784c7344b939bc36f639286f377 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 13.
W20260709 13:20:44.059899  6697 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 277935us
I20260709 13:20:44.058519  6800 rpcz_store.cc:276] 0709 13:20:42.305524 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:43.165195 (+859671us) service_pool.cc:224] Handling call
0709 13:20:43.165669 (+   474us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:20:43.166538 (+   869us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:43.166577 (+    39us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:20:43.167431 (+   854us) log.cc:844] Serialized 52 byte log entry
0709 13:20:43.645567 (+478136us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:20:43.701397 (+ 55830us) log.cc:844] Serialized 14 byte log entry
0709 13:20:43.701722 (+   325us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:43.701815 (+    93us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:44.048123 (+346308us) raft_consensus.cc:1685] finished
0709 13:20:44.048155 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:44.048351 (+   196us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":30246,"prepare.queue_time_us":54390,"prepare.run_cpu_time_us":46,"prepare.run_wall_time_us":49,"raft.queue_time_us":11019,"raft.run_cpu_time_us":277,"raft.run_wall_time_us":17932,"thread_start_us":477581,"threads_started":1,"wal-append.queue_time_us":827735}
I20260709 13:20:44.060758  6879 rpcz_store.cc:276] 0709 13:20:42.611372 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:43.931555 (+1320183us) service_pool.cc:224] Handling call
0709 13:20:43.933778 (+  2223us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:43.974772 (+ 40994us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:43.975325 (+   553us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:20:44.065843 12159 raft_consensus.cc:3055] T 17587d6730594da4a56fa13a353232a1 P b7ab4784c7344b939bc36f639286f377 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:20:44.066323 12159 raft_consensus.cc:740] T 17587d6730594da4a56fa13a353232a1 P b7ab4784c7344b939bc36f639286f377 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
I20260709 13:20:44.068456 12290 leader_election.cc:290] T 8c7f33e544204fbaac4078e3e83bbf4e P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:20:44.067265 12159 consensus_queue.cc:260] T 17587d6730594da4a56fa13a353232a1 P b7ab4784c7344b939bc36f639286f377 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 19.13, Last appended by leader: 13, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
W20260709 13:20:44.054936 12253 consensus_meta.cc:287] T 1528ab62b6fe4e3099d08f141afee116 P 7ba59cc884714e8aa5f3f0ecaed84cbb: Time spent flushing consensus metadata: real 0.528s	user 0.010s	sys 0.005s
I20260709 13:20:44.062541 11994 raft_consensus.cc:3060] T 22ccee1b570c4ad3a57bd7aec085b1b4 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:20:44.083846  6802 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.635s	user 0.019s	sys 0.003s
W20260709 13:20:44.085184  6802 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.636s	user 0.019s	sys 0.003s
W20260709 13:20:44.084276  6729 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.626s	user 0.005s	sys 0.018s
I20260709 13:20:44.085309  6874 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53406 (request call id 2549) took 1172 ms. Trace:
I20260709 13:20:44.081480  6879 raft_consensus.cc:1240] T 3a485a995abc4807b6e511e45419f737 P cd75a17ab2604397adab03bb8b5fd75c [term 15 FOLLOWER]: Rejecting Update request from peer b7ab4784c7344b939bc36f639286f377 for earlier term 14. Current term is 15. Ops: [14.9-14.9]
I20260709 13:20:44.088493  6879 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53406 (request call id 2548) took 1176 ms. Trace:
I20260709 13:20:44.089056  6879 rpcz_store.cc:276] 0709 13:20:42.912341 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:44.075796 (+1163455us) service_pool.cc:224] Handling call
0709 13:20:44.076311 (+   515us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:44.088110 (+ 11799us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:44.088417 (+   307us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:20:44.090593  6874 rpcz_store.cc:276] 0709 13:20:42.912671 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:44.076090 (+1163419us) service_pool.cc:224] Handling call
0709 13:20:44.084743 (+  8653us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:44.084970 (+   227us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:44.085005 (+    35us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:20:44.085053 (+    48us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:20:44.085091 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:44.085139 (+    48us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:44.085253 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:20:44.078874 12251 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.578s	user 0.024s	sys 0.026s
W20260709 13:20:44.094570  6729 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.636s	user 0.005s	sys 0.018s
I20260709 13:20:44.084452  6697 leader_election.cc:304] T f09c2a98de1a4decabd0ff900dd44caa P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377
I20260709 13:20:44.100131  6802 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50550 (request call id 605) took 1729 ms. Trace:
I20260709 13:20:44.091749  6879 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53406 (request call id 2550) took 1156 ms. Trace:
I20260709 13:20:44.109030  6879 rpcz_store.cc:276] 0709 13:20:42.935564 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:44.090732 (+1155168us) service_pool.cc:224] Handling call
0709 13:20:44.091111 (+   379us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:44.091351 (+   240us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:44.091387 (+    36us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:20:44.091440 (+    53us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:20:44.091486 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:44.091558 (+    72us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:44.091681 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:20:44.102576  6874 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53406 (request call id 2552) took 1122 ms. Trace:
I20260709 13:20:44.125478  6874 rpcz_store.cc:276] 0709 13:20:42.980523 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:44.101499 (+1120976us) service_pool.cc:224] Handling call
0709 13:20:44.101897 (+   398us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:44.102159 (+   262us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:44.102192 (+    33us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:20:44.102252 (+    60us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:20:44.102298 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:44.102368 (+    70us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:44.102506 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:20:44.096758 12159 raft_consensus.cc:3060] T 17587d6730594da4a56fa13a353232a1 P b7ab4784c7344b939bc36f639286f377 [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:20:44.134287  7467 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:44.101137 12148 raft_consensus.cc:2749] T 427c124d773f483294511e80fe340075 P b7ab4784c7344b939bc36f639286f377 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:20:44.079221 12311 consensus_queue.cc:1048] T 17587d6730594da4a56fa13a353232a1 P 7ba59cc884714e8aa5f3f0ecaed84cbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.020s
W20260709 13:20:44.136950 12037 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.558s	user 0.019s	sys 0.037s
W20260709 13:20:44.098639 12251 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.595s	user 0.024s	sys 0.026s
I20260709 13:20:44.104441  6802 rpcz_store.cc:276] 0709 13:20:42.371119 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:43.447663 (+1076544us) service_pool.cc:224] Handling call
0709 13:20:43.448018 (+   355us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:43.448268 (+   250us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:20:43.448628 (+   360us) log.cc:844] Serialized 14 byte log entry
0709 13:20:44.086608 (+637980us) log.cc:844] Serialized 14 byte log entry
0709 13:20:44.099570 (+ 12962us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:20:44.099652 (+    82us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:20:44.099725 (+    73us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:44.099829 (+   104us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:44.100023 (+   194us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":11810,"prepare.queue_time_us":840,"prepare.run_cpu_time_us":87,"prepare.run_wall_time_us":92,"raft.queue_time_us":15968,"spinlock_wait_cycles":10351488,"thread_start_us":637372,"threads_started":1}
W20260709 13:20:44.144429  6724 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.504s	user 0.008s	sys 0.034s
W20260709 13:20:44.165271  6724 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.539s	user 0.009s	sys 0.035s
I20260709 13:20:44.123729 12187 leader_election.cc:290] T 22ccee1b570c4ad3a57bd7aec085b1b4 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 14 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
W20260709 13:20:44.121949  6881 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.551s	user 0.011s	sys 0.023s
W20260709 13:20:44.167362  6881 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.597s	user 0.011s	sys 0.023s
W20260709 13:20:44.171384  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 507158us
I20260709 13:20:44.172781  6844 leader_election.cc:304] T bb7fa124c3bf4ef9ab65a407cb008441 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb
W20260709 13:20:44.164503 12037 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.568s	user 0.019s	sys 0.038s
W20260709 13:20:44.180140  6846 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.514s	user 0.005s	sys 0.023s
W20260709 13:20:44.180756  6846 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.515s	user 0.005s	sys 0.023s
W20260709 13:20:44.181094  6846 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.68:45071, user_credentials={real_user=slave}} blocked reactor thread for 515677us
W20260709 13:20:44.185480  6728 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.734s	user 0.009s	sys 0.018s
W20260709 13:20:44.186038  6728 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.735s	user 0.009s	sys 0.018s
I20260709 13:20:44.186333  6770 leader_election.cc:304] T d8292e16e5654be6bc408560cf256aaa P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
W20260709 13:20:44.187234  6725 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.614s	user 0.004s	sys 0.012s
W20260709 13:20:44.187553  6725 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.615s	user 0.004s	sys 0.012s
I20260709 13:20:44.188836  6770 leader_election.cc:304] T 3d65025eea89441290d85dd053810e31 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:20:44.190666  6873 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53416 (request call id 3249) took 1982 ms. Trace:
I20260709 13:20:44.191536  6770 leader_election.cc:304] T 95a75bfe094d4bdc963aba3f08dfcd25 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:20:44.191306  6873 rpcz_store.cc:276] 0709 13:20:42.207894 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:42.208052 (+   158us) service_pool.cc:224] Handling call
0709 13:20:42.225464 (+ 17412us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:42.514164 (+288700us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:20:42.555492 (+ 41328us) log.cc:844] Serialized 14 byte log entry
0709 13:20:43.239714 (+684222us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:20:43.239791 (+    77us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:20:43.239851 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:43.528903 (+289052us) spinlock_profiling.cc:243] Waited 3.98 ms on lock 0x7b4400022b4c. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0c745db1 00007fcc0c7e3c85 00007fcc0c7e46a2 00007fcc0f5561db 00007fcc0f551aaf 00007fcc0f54586e 00007fcc0f544bb6 00007fcc0f5447d8 00007fcc0f54e221 00007fcc0f54e1d9 00007fcc0f54e169
0709 13:20:44.190266 (+661363us) spinlock_profiling.cc:243] Waited 288 ms on lock 0x7b54001e7dd4. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f9aae01 00007fcc0f9a983e 00007fcc1496e419 00007fcc0dee5bd4 00007fcc0dee5b62 00007fcc0dee5a91 00007fcc0dee5a0c 00007fcc0dee4cc2 00007fcc0dce548c 00007fcc0dce48c6
0709 13:20:44.190351 (+    85us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:44.190561 (+   210us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":50490,"prepare.queue_time_us":43730,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":38,"raft.queue_time_us":100529,"raft.run_cpu_time_us":177,"raft.run_wall_time_us":9531,"spinlock_wait_cycles":672375296,"thread_start_us":609545,"threads_started":1,"wal-append.queue_time_us":784101}
I20260709 13:20:44.213581  6844 leader_election.cc:304] T 90d42e216d9741e190bca19a781291fd P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
W20260709 13:20:44.214010  6772 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.68:45071, user_credentials={real_user=slave}} blocked reactor thread for 286903us
W20260709 13:20:44.188779 12218 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.725s	user 0.000s	sys 0.024s
W20260709 13:20:44.215354 12218 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.751s	user 0.000s	sys 0.025s
I20260709 13:20:44.219045 12306 raft_consensus.cc:2749] T 90d42e216d9741e190bca19a781291fd P cd75a17ab2604397adab03bb8b5fd75c [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:20:44.127077 12209 consensus_queue.cc:237] T 20f6842e26174571996b8dea4151d4be P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:44.222339  7495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8cee0accdb8499c86d4414b72565a38" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:20:44.222735  6770 leader_election.cc:304] T f3f9c2e2bf644115957398fe4c9459db P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:20:44.228585  6803 raft_consensus.cc:1240] T c4db81d9d329422bb3b4160ca4ac2d1d P b7ab4784c7344b939bc36f639286f377 [term 15 LEADER]: Rejecting Update request from peer ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 14. Current term is 15. Ops: []
I20260709 13:20:44.227526  6844 leader_election.cc:304] T f3f9c2e2bf644115957398fe4c9459db P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:20:44.233642  6844 leader_election.cc:304] T 1bf4668eeb70467fb3dc5a0289233b3c P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:20:44.212267 11567 raft_consensus.cc:2804] T 711ef6523deb4cbe8ef2ba61e1c21c98 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:20:44.250291  6770 leader_election.cc:304] T 404190ce4ce94cecbfcb6ea9d1dd8626 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:20:44.212451 12275 raft_consensus.cc:2749] T 3d65025eea89441290d85dd053810e31 P b7ab4784c7344b939bc36f639286f377 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:20:44.212069 12187 raft_consensus.cc:2749] T d8292e16e5654be6bc408560cf256aaa P b7ab4784c7344b939bc36f639286f377 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:20:44.261492  6875 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.511s	user 0.002s	sys 0.014s
W20260709 13:20:44.263020  6875 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.520s	user 0.002s	sys 0.015s
I20260709 13:20:44.222275 12290 raft_consensus.cc:2804] T bb7fa124c3bf4ef9ab65a407cb008441 P cd75a17ab2604397adab03bb8b5fd75c [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:20:44.251681  6844 leader_election.cc:304] T 9b3759de40694069b13c0f8bd40e5709 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:20:44.262434  7501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3d8792045a4583ae2e965b1350a5b4" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:20:44.234295 12090 raft_consensus.cc:2749] T 95a75bfe094d4bdc963aba3f08dfcd25 P b7ab4784c7344b939bc36f639286f377 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:20:44.277034  6844 leader_election.cc:400] T 853ac0a8cbd64ce99457f170216d4d0f P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 13 election: Vote denied by peer b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817) with higher term. Message: Invalid argument: T 853ac0a8cbd64ce99457f170216d4d0f P b7ab4784c7344b939bc36f639286f377 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c for earlier term 13. Current term is 14.
I20260709 13:20:44.277709  6844 leader_election.cc:403] T 853ac0a8cbd64ce99457f170216d4d0f P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 13 election: Cancelling election due to peer responding with higher term
I20260709 13:20:44.221262 12174 raft_consensus.cc:515] T 34f36d59d88f40fe8a2805e604fc6c0a P b7ab4784c7344b939bc36f639286f377 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:44.254326 12288 raft_consensus.cc:493] T 95a75bfe094d4bdc963aba3f08dfcd25 P cd75a17ab2604397adab03bb8b5fd75c [term 13 FOLLOWER]: Starting pre-election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:20:44.297292 12305 raft_consensus.cc:493] T 427c124d773f483294511e80fe340075 P cd75a17ab2604397adab03bb8b5fd75c [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 7ba59cc884714e8aa5f3f0ecaed84cbb)
I20260709 13:20:44.305465 12305 raft_consensus.cc:515] T 427c124d773f483294511e80fe340075 P cd75a17ab2604397adab03bb8b5fd75c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } attrs { replace: true } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
W20260709 13:20:44.305935 12321 log.cc:927] Time spent T ab432e62819d499eaaf3dd55481dd930 P b7ab4784c7344b939bc36f639286f377: Append to log took a long time: real 0.128s	user 0.001s	sys 0.001s
I20260709 13:20:44.307168  6873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c44c4849aa54f2b94d1f1bef9ed546f" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:20:44.273866 12275 raft_consensus.cc:2749] T f3f9c2e2bf644115957398fe4c9459db P b7ab4784c7344b939bc36f639286f377 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:20:44.308065  6873 raft_consensus.cc:3060] T 7c44c4849aa54f2b94d1f1bef9ed546f P cd75a17ab2604397adab03bb8b5fd75c [term 15 FOLLOWER]: Advancing to term 17
I20260709 13:20:44.308800 12275 raft_consensus.cc:2749] T 404190ce4ce94cecbfcb6ea9d1dd8626 P b7ab4784c7344b939bc36f639286f377 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:20:44.268777 12290 raft_consensus.cc:493] T bb7fa124c3bf4ef9ab65a407cb008441 P cd75a17ab2604397adab03bb8b5fd75c [term 14 FOLLOWER]: Starting leader election (detected failure of leader 7ba59cc884714e8aa5f3f0ecaed84cbb)
I20260709 13:20:44.291525  6874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c240553ce044eedb41541d72b9475d7" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 18 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:44.319470  6874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe20b4b48823486ca3b9c648db6ce8aa" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:20:44.292248  6844 leader_election.cc:304] T 7c37d41cd9164c15a6826ca62a851a69 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:20:44.292908  6875 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53406 (request call id 2536) took 1823 ms. Trace:
W20260709 13:20:44.293759  6773 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:44.291335  6877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbdf895bba214ff68685a24fd17dfb5d" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 15 candidate_status { last_received { term: 10 index: 4 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:44.292785  6879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e31b9971c15848dea59d4d4130141d9e" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:20:44.320828  6874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20f6842e26174571996b8dea4151d4be" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:20:44.256807 12306 raft_consensus.cc:2804] T f3f9c2e2bf644115957398fe4c9459db P cd75a17ab2604397adab03bb8b5fd75c [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:20:44.256573 12086 raft_consensus.cc:3060] T 1bf4668eeb70467fb3dc5a0289233b3c P cd75a17ab2604397adab03bb8b5fd75c [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:44.321098  6875 rpcz_store.cc:276] 0709 13:20:42.469071 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:43.328569 (+859498us) service_pool.cc:224] Handling call
0709 13:20:43.348766 (+ 20197us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:43.349096 (+   330us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:20:43.742731 (+393635us) log.cc:844] Serialized 14 byte log entry
0709 13:20:44.290002 (+547271us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:20:44.290094 (+    92us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:20:44.290168 (+    74us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:44.290290 (+   122us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:44.292838 (+  2548us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":33314,"prepare.queue_time_us":225769,"prepare.run_cpu_time_us":30,"prepare.run_wall_time_us":31,"raft.queue_time_us":52573,"thread_start_us":905673,"threads_started":2}
I20260709 13:20:44.295586  7495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24ee15416e3145beaa1b8183453729a3" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:20:44.279196  6878 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53406 (request call id 2545) took 1663 ms. Trace:
I20260709 13:20:44.295188 12097 raft_consensus.cc:2749] T 9b3759de40694069b13c0f8bd40e5709 P cd75a17ab2604397adab03bb8b5fd75c [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
W20260709 13:20:44.302438 12326 log.cc:927] Time spent T a3022224cc81473690653a83d4e99470 P ccd8a4c3bfe3413cb2ae219b09aea832: Append to log took a long time: real 0.074s	user 0.001s	sys 0.001s
I20260709 13:20:44.310283 12305 leader_election.cc:290] T 427c124d773f483294511e80fe340075 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:20:44.254654 11666 consensus_queue.cc:1059] T 3a485a995abc4807b6e511e45419f737 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.046s
I20260709 13:20:44.321287  6877 raft_consensus.cc:2410] T dbdf895bba214ff68685a24fd17dfb5d P cd75a17ab2604397adab03bb8b5fd75c [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ccd8a4c3bfe3413cb2ae219b09aea832 for term 15 because replica has last-logged OpId of term: 12 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 4.
W20260709 13:20:44.289431  6696 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:44.321388  6879 raft_consensus.cc:2393] T e31b9971c15848dea59d4d4130141d9e P cd75a17ab2604397adab03bb8b5fd75c [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate ccd8a4c3bfe3413cb2ae219b09aea832 in current term 13: Already voted for candidate b7ab4784c7344b939bc36f639286f377 in this term.
I20260709 13:20:44.321444  6874 raft_consensus.cc:3060] T 20f6842e26174571996b8dea4151d4be P cd75a17ab2604397adab03bb8b5fd75c [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:44.333072  6878 rpcz_store.cc:276] 0709 13:20:42.615923 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:43.933821 (+1317898us) service_pool.cc:224] Handling call
0709 13:20:43.970944 (+ 37123us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:43.971252 (+   308us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:20:43.983737 (+ 12485us) log.cc:844] Serialized 14 byte log entry
0709 13:20:44.278656 (+294919us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:20:44.278744 (+    88us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:20:44.278815 (+    71us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:44.278923 (+   108us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:44.279109 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":12394,"prepare.run_cpu_time_us":42,"prepare.run_wall_time_us":44,"raft.queue_time_us":122,"raft.run_cpu_time_us":208,"raft.run_wall_time_us":12954,"thread_start_us":294379,"threads_started":1}
I20260709 13:20:44.297395 12296 raft_consensus.cc:493] T 30e88460611e47b2ba16a46a30b5f416 P cd75a17ab2604397adab03bb8b5fd75c [term 13 FOLLOWER]: Starting pre-election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:20:44.329176 12290 raft_consensus.cc:3060] T bb7fa124c3bf4ef9ab65a407cb008441 P cd75a17ab2604397adab03bb8b5fd75c [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:44.363829  6877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d33d5ee8ef6f415593d8df52063161ad" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
W20260709 13:20:44.339531  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 47359.6us
W20260709 13:20:44.339612  7466 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 281751us
I20260709 13:20:44.249119 12037 consensus_queue.cc:1059] T f4b8bd455d5a47c18a1380839c6e0d61 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: INVALID_TERM, Last received: 14.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.050s
I20260709 13:20:44.313887 12271 raft_consensus.cc:3055] T 3fa34c08b205435dba97346991aa1f92 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 17 LEADER]: Stepping down as leader of term 17
W20260709 13:20:44.337224 12332 log.cc:927] Time spent T 713b5728a197487c9300b310ab94e5a3 P ccd8a4c3bfe3413cb2ae219b09aea832: Append to log took a long time: real 0.083s	user 0.000s	sys 0.001s
I20260709 13:20:44.330593 12249 raft_consensus.cc:493] T bb3d8792045a4583ae2e965b1350a5b4 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 13 FOLLOWER]: Starting pre-election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:20:44.357896  6879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34f36d59d88f40fe8a2805e604fc6c0a" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:44.338986  6873 raft_consensus.cc:2468] T 7c44c4849aa54f2b94d1f1bef9ed546f P cd75a17ab2604397adab03bb8b5fd75c [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 17.
W20260709 13:20:44.399959  6773 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:44.303454 12187 consensus_queue.cc:1059] T d33d5ee8ef6f415593d8df52063161ad P b7ab4784c7344b939bc36f639286f377 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.061s
W20260709 13:20:44.393157  7466 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:44.431864  6879 raft_consensus.cc:2468] T 34f36d59d88f40fe8a2805e604fc6c0a P cd75a17ab2604397adab03bb8b5fd75c [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 12.
I20260709 13:20:44.354142 12306 raft_consensus.cc:697] T f3f9c2e2bf644115957398fe4c9459db P cd75a17ab2604397adab03bb8b5fd75c [term 15 LEADER]: Becoming Leader. State: Replica: cd75a17ab2604397adab03bb8b5fd75c, State: Running, Role: LEADER
I20260709 13:20:44.365862  6844 leader_election.cc:304] T 7c44c4849aa54f2b94d1f1bef9ed546f P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:20:44.329001 12288 raft_consensus.cc:515] T 95a75bfe094d4bdc963aba3f08dfcd25 P cd75a17ab2604397adab03bb8b5fd75c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:44.344751 12335 raft_consensus.cc:2749] T 853ac0a8cbd64ce99457f170216d4d0f P cd75a17ab2604397adab03bb8b5fd75c [term 14 FOLLOWER]: Leader election lost for term 13. Reason: Vote denied by peer b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817) with higher term. Message: Invalid argument: T 853ac0a8cbd64ce99457f170216d4d0f P b7ab4784c7344b939bc36f639286f377 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c for earlier term 13. Current term is 14.
W20260709 13:20:44.433627  6697 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 349241us
W20260709 13:20:44.436681  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 70940.5us
I20260709 13:20:44.354923 11576 raft_consensus.cc:2749] T 7c37d41cd9164c15a6826ca62a851a69 P cd75a17ab2604397adab03bb8b5fd75c [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:20:44.438864  6881 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53406 (request call id 2543) took 1968 ms. Trace:
I20260709 13:20:44.439693  6729 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50004 (request call id 2526) took 1118 ms. Trace:
I20260709 13:20:44.443372  6875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f00a2e87e56452083b759f60d461ee3" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:44.392804 12271 raft_consensus.cc:740] T 3fa34c08b205435dba97346991aa1f92 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 7ba59cc884714e8aa5f3f0ecaed84cbb, State: Running, Role: LEADER
I20260709 13:20:44.443655  6729 rpcz_store.cc:276] 0709 13:20:43.320819 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:43.457021 (+136202us) service_pool.cc:224] Handling call
0709 13:20:43.457310 (+   289us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:43.457677 (+   367us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:43.457707 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:20:43.458268 (+   561us) log.cc:844] Serialized 26 byte log entry
0709 13:20:44.095909 (+637641us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:20:44.095983 (+    74us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:44.096105 (+   122us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:44.439397 (+343292us) raft_consensus.cc:1685] finished
0709 13:20:44.439425 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:44.439618 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":44028,"raft.queue_time_us":7298,"raft.run_cpu_time_us":195,"raft.run_wall_time_us":37301,"thread_start_us":637189,"threads_started":1,"wal-append.queue_time_us":769987}
I20260709 13:20:44.448253  6697 leader_election.cc:304] T 713b5728a197487c9300b310ab94e5a3 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:20:44.464727  6697 leader_election.cc:304] T 9b3759de40694069b13c0f8bd40e5709 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:20:44.473140  6873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ba5dac66ab5497e9e336f2a3c28cda5" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
W20260709 13:20:44.444149 12267 consensus_meta.cc:287] T 24ee15416e3145beaa1b8183453729a3 P 7ba59cc884714e8aa5f3f0ecaed84cbb: Time spent flushing consensus metadata: real 0.601s	user 0.016s	sys 0.000s
I20260709 13:20:44.366755 12296 raft_consensus.cc:515] T 30e88460611e47b2ba16a46a30b5f416 P cd75a17ab2604397adab03bb8b5fd75c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:44.490717  7495 raft_consensus.cc:2468] T 24ee15416e3145beaa1b8183453729a3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 19.
I20260709 13:20:44.481400  6844 leader_election.cc:304] T de3186201e1a40d0b335eeb8b4e256e0 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
W20260709 13:20:44.485193  6770 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 234971us
I20260709 13:20:44.437566 12011 raft_consensus.cc:493] T 1bf4668eeb70467fb3dc5a0289233b3c P ccd8a4c3bfe3413cb2ae219b09aea832 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:44.496348 12011 raft_consensus.cc:515] T 1bf4668eeb70467fb3dc5a0289233b3c P ccd8a4c3bfe3413cb2ae219b09aea832 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:44.498790 12011 leader_election.cc:290] T 1bf4668eeb70467fb3dc5a0289233b3c P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:44.443117 12227 raft_consensus.cc:2749] T ab432e62819d499eaaf3dd55481dd930 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:20:44.442807 12305 raft_consensus.cc:2764] T 7c44c4849aa54f2b94d1f1bef9ed546f P cd75a17ab2604397adab03bb8b5fd75c [term 17 FOLLOWER]: Leader pre-election decision vote started in defunct term 15: won
I20260709 13:20:44.439038 12342 raft_consensus.cc:493] T 9b3759de40694069b13c0f8bd40e5709 P b7ab4784c7344b939bc36f639286f377 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:44.471607 12251 raft_consensus.cc:2749] T 713b5728a197487c9300b310ab94e5a3 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:20:44.470562 11666 raft_consensus.cc:493] T be1a92657f494cac8dd227d152f50151 P b7ab4784c7344b939bc36f639286f377 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:44.414528 12249 raft_consensus.cc:515] T bb3d8792045a4583ae2e965b1350a5b4 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
W20260709 13:20:44.506439 12324 log.cc:927] Time spent T 427c124d773f483294511e80fe340075 P b7ab4784c7344b939bc36f639286f377: Append to log took a long time: real 0.194s	user 0.000s	sys 0.001s
W20260709 13:20:44.491906 12317 log.cc:927] Time spent T 1bf4668eeb70467fb3dc5a0289233b3c P cd75a17ab2604397adab03bb8b5fd75c: Append to log took a long time: real 0.305s	user 0.000s	sys 0.001s
I20260709 13:20:44.510578  6723 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50004 (request call id 2527) took 1186 ms. Trace:
W20260709 13:20:44.511857  6772 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.68:45071, user_credentials={real_user=slave}} blocked reactor thread for 296965us
I20260709 13:20:44.513583  6723 rpcz_store.cc:276] 0709 13:20:43.323865 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:43.471194 (+147329us) service_pool.cc:224] Handling call
0709 13:20:43.471702 (+   508us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:43.564739 (+ 93037us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:43.564778 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:20:43.565287 (+   509us) log.cc:844] Serialized 26 byte log entry
0709 13:20:43.983165 (+417878us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:20:44.366453 (+383288us) log.cc:844] Serialized 14 byte log entry
0709 13:20:44.366855 (+   402us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:44.366959 (+   104us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:44.510296 (+143337us) raft_consensus.cc:1685] finished
0709 13:20:44.510322 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:44.510500 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":122709,"prepare.queue_time_us":509397,"raft.queue_time_us":94357,"raft.run_cpu_time_us":285,"raft.run_wall_time_us":18027,"thread_start_us":672743,"threads_started":2,"wal-append.queue_time_us":582366}
W20260709 13:20:44.515887  6772 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:44.517309  6873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30e88460611e47b2ba16a46a30b5f416" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:44.517611  6875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6869f07b5a4885a0b99fbe60c3b175" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:44.518746 11666 raft_consensus.cc:515] T be1a92657f494cac8dd227d152f50151 P b7ab4784c7344b939bc36f639286f377 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
W20260709 13:20:44.519492 12333 log.cc:927] Time spent T ab432e62819d499eaaf3dd55481dd930 P ccd8a4c3bfe3413cb2ae219b09aea832: Append to log took a long time: real 0.123s	user 0.000s	sys 0.001s
I20260709 13:20:44.521409 11666 leader_election.cc:290] T be1a92657f494cac8dd227d152f50151 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:20:44.522898  6724 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50004 (request call id 2528) took 1182 ms. Trace:
I20260709 13:20:44.523234  6878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22ccee1b570c4ad3a57bd7aec085b1b4" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:20:44.524125  6878 raft_consensus.cc:3060] T 22ccee1b570c4ad3a57bd7aec085b1b4 P cd75a17ab2604397adab03bb8b5fd75c [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:44.523402  6724 rpcz_store.cc:276] 0709 13:20:43.340530 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:43.566685 (+226155us) service_pool.cc:224] Handling call
0709 13:20:43.567042 (+   357us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:20:43.567577 (+   535us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:43.567615 (+    38us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:20:43.625512 (+ 57897us) log.cc:844] Serialized 52 byte log entry
0709 13:20:44.165810 (+540298us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:20:44.437987 (+272177us) log.cc:844] Serialized 14 byte log entry
0709 13:20:44.438340 (+   353us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:44.438501 (+   161us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:44.522633 (+ 84132us) raft_consensus.cc:1685] finished
0709 13:20:44.522654 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:44.522829 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":32752,"raft.queue_time_us":188,"raft.run_cpu_time_us":250,"raft.run_wall_time_us":24880,"thread_start_us":801087,"threads_started":2,"wal-append.queue_time_us":706556}
W20260709 13:20:44.529173 12331 log.cc:927] Time spent T 853ac0a8cbd64ce99457f170216d4d0f P b7ab4784c7344b939bc36f639286f377: Append to log took a long time: real 0.136s	user 0.000s	sys 0.000s
I20260709 13:20:44.529287  6772 leader_election.cc:304] T e31b9971c15848dea59d4d4130141d9e P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
W20260709 13:20:44.530843 12328 log.cc:927] Time spent T 404190ce4ce94cecbfcb6ea9d1dd8626 P ccd8a4c3bfe3413cb2ae219b09aea832: Append to log took a long time: real 0.218s	user 0.000s	sys 0.000s
W20260709 13:20:44.536800  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 55503.6us
I20260709 13:20:44.489857 12335 raft_consensus.cc:493] T 3fa34c08b205435dba97346991aa1f92 P cd75a17ab2604397adab03bb8b5fd75c [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 7ba59cc884714e8aa5f3f0ecaed84cbb)
W20260709 13:20:44.542124  6697 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 77498.2us
W20260709 13:20:44.574728  6772 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 44124.1us
I20260709 13:20:44.574949  6844 leader_election.cc:304] T a3022224cc81473690653a83d4e99470 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377
I20260709 13:20:44.475495 12334 consensus_queue.cc:1048] T 4f00a2e87e56452083b759f60d461ee3 P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.073s
I20260709 13:20:44.575672  6697 leader_election.cc:304] T a3022224cc81473690653a83d4e99470 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:20:44.508479  6770 leader_election.cc:304] T 44bde925b2e541b69890d70715b85176 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:20:44.577260 12334 raft_consensus.cc:2804] T a3022224cc81473690653a83d4e99470 P cd75a17ab2604397adab03bb8b5fd75c [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:20:44.577850  6844 leader_election.cc:400] T 7c44c4849aa54f2b94d1f1bef9ed546f P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 16 pre-election: Vote denied by peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391) with higher term. Message: Invalid argument: T 7c44c4849aa54f2b94d1f1bef9ed546f P ccd8a4c3bfe3413cb2ae219b09aea832 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c for earlier term 16. Current term is 17.
I20260709 13:20:44.577987 12334 raft_consensus.cc:493] T a3022224cc81473690653a83d4e99470 P cd75a17ab2604397adab03bb8b5fd75c [term 16 FOLLOWER]: Starting leader election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:20:44.578653 12251 raft_consensus.cc:2749] T a3022224cc81473690653a83d4e99470 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:20:44.578740 12334 raft_consensus.cc:3060] T a3022224cc81473690653a83d4e99470 P cd75a17ab2604397adab03bb8b5fd75c [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:44.579562 11937 consensus_queue.cc:1059] T fe20b4b48823486ca3b9c648db6ce8aa P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:20:44.581418 11937 raft_consensus.cc:3055] T fe20b4b48823486ca3b9c648db6ce8aa P cd75a17ab2604397adab03bb8b5fd75c [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:20:44.577318  6697 leader_election.cc:304] T 3fa34c08b205435dba97346991aa1f92 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:20:44.585283  6697 leader_election.cc:304] T 90d42e216d9741e190bca19a781291fd P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:20:44.585422 12348 raft_consensus.cc:2749] T 3fa34c08b205435dba97346991aa1f92 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:20:44.541587 12305 raft_consensus.cc:2749] T de3186201e1a40d0b335eeb8b4e256e0 P cd75a17ab2604397adab03bb8b5fd75c [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:20:44.552575 12296 leader_election.cc:290] T 30e88460611e47b2ba16a46a30b5f416 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:20:44.547197 12011 raft_consensus.cc:3060] T 9b3759de40694069b13c0f8bd40e5709 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:20:44.541314 11666 consensus_queue.cc:1059] T 7a734b5ab7834e05a8c422208acc58b1 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: INVALID_TERM, Last received: 15.7, Next index: 8, Last known committed idx: 5, Time since last communication: 0.015s
W20260709 13:20:44.558934 12102 consensus_meta.cc:287] T f58dc08b12a2494bb9a1372837970ca2 P b7ab4784c7344b939bc36f639286f377: Time spent flushing consensus metadata: real 0.722s	user 0.010s	sys 0.003s
I20260709 13:20:44.559887  6800 raft_consensus.cc:1275] T 17587d6730594da4a56fa13a353232a1 P b7ab4784c7344b939bc36f639286f377 [term 20 FOLLOWER]: Refusing update from remote peer 7ba59cc884714e8aa5f3f0ecaed84cbb: Log matching property violated. Preceding OpId in replica: term: 19 index: 13. Preceding OpId from leader: term: 20 index: 14. (index mismatch)
I20260709 13:20:44.560556  6872 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53416 (request call id 3244) took 2426 ms. Trace:
I20260709 13:20:44.593194  6872 rpcz_store.cc:276] 0709 13:20:42.134201 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:42.134319 (+   118us) service_pool.cc:224] Handling call
0709 13:20:42.189133 (+ 54814us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:42.471452 (+282319us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:42.471491 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:20:43.153771 (+682280us) spinlock_profiling.cc:243] Waited 6.91 ms on lock 0x7b2c001176f8. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0e2a3a11 00007fcc0e2b3372 00007fcc0f9e5a01 00007fcc0f9aa43a 00007fcc0f9a983e 00007fcc1496e419 00007fcc0dee5bd4 00007fcc0dee5b62 00007fcc0dee5a91 00007fcc0dee5a0c 00007fcc0dee4cc2
0709 13:20:43.188283 (+ 34512us) log.cc:844] Serialized 26 byte log entry
0709 13:20:43.890717 (+702434us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:20:43.890771 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:43.890874 (+   103us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:44.560124 (+669250us) raft_consensus.cc:1685] finished
0709 13:20:44.560147 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:44.560451 (+   304us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":169728,"raft.run_cpu_time_us":139,"raft.run_wall_time_us":3409,"spinlock_wait_cycles":15904000,"thread_start_us":917291,"threads_started":2,"wal-append.queue_time_us":896377}
I20260709 13:20:44.594626  7468 leader_election.cc:304] T 7ba5dac66ab5497e9e336f2a3c28cda5 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:20:44.561766 12288 leader_election.cc:290] T 95a75bfe094d4bdc963aba3f08dfcd25 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:20:44.563140 12340 raft_consensus.cc:2804] T e31b9971c15848dea59d4d4130141d9e P b7ab4784c7344b939bc36f639286f377 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:20:44.514424 12265 raft_consensus.cc:515] T 4f00a2e87e56452083b759f60d461ee3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 17 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:20:44.596385 11666 consensus_queue.cc:1059] T 3a485a995abc4807b6e511e45419f737 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:20:44.597081  7502 raft_consensus.cc:1240] T 4f00a2e87e56452083b759f60d461ee3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 17 FOLLOWER]: Rejecting Update request from peer cd75a17ab2604397adab03bb8b5fd75c for earlier term 16. Current term is 17. Ops: []
I20260709 13:20:44.597867 12265 leader_election.cc:290] T 4f00a2e87e56452083b759f60d461ee3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 17 election: Requested vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
W20260709 13:20:44.564857 12339 log.cc:927] Time spent T 7c44c4849aa54f2b94d1f1bef9ed546f P ccd8a4c3bfe3413cb2ae219b09aea832: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 13:20:44.548266  6878 raft_consensus.cc:2468] T 22ccee1b570c4ad3a57bd7aec085b1b4 P cd75a17ab2604397adab03bb8b5fd75c [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 14.
W20260709 13:20:44.569172 12330 log.cc:927] Time spent T 711ef6523deb4cbe8ef2ba61e1c21c98 P ccd8a4c3bfe3413cb2ae219b09aea832: Append to log took a long time: real 0.108s	user 0.001s	sys 0.000s
I20260709 13:20:44.601095  6804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f00a2e87e56452083b759f60d461ee3" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:20:44.572664  6728 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50004 (request call id 2516) took 1315 ms. Trace:
I20260709 13:20:44.602053  6728 rpcz_store.cc:276] 0709 13:20:43.257070 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:43.450123 (+193053us) service_pool.cc:224] Handling call
0709 13:20:43.450422 (+   299us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:43.450630 (+   208us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:20:43.451146 (+   516us) log.cc:844] Serialized 14 byte log entry
0709 13:20:44.571700 (+1120554us) log.cc:844] Serialized 14 byte log entry
0709 13:20:44.572159 (+   459us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:20:44.572236 (+    77us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:20:44.572336 (+   100us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:44.572450 (+   114us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:44.572595 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":345932,"prepare.run_cpu_time_us":69,"prepare.run_wall_time_us":70,"raft.queue_time_us":3683,"raft.run_cpu_time_us":151,"raft.run_wall_time_us":9271,"spinlock_wait_cycles":16964352,"thread_start_us":1119543,"threads_started":2,"wal-append.queue_time_us":937962}
I20260709 13:20:44.574873 12335 raft_consensus.cc:515] T 3fa34c08b205435dba97346991aa1f92 P cd75a17ab2604397adab03bb8b5fd75c [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:20:44.521497 12086 raft_consensus.cc:2749] T 1bf4668eeb70467fb3dc5a0289233b3c P cd75a17ab2604397adab03bb8b5fd75c [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:20:44.604650 12251 raft_consensus.cc:3060] T 90d42e216d9741e190bca19a781291fd P ccd8a4c3bfe3413cb2ae219b09aea832 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:44.604497 12340 raft_consensus.cc:697] T e31b9971c15848dea59d4d4130141d9e P b7ab4784c7344b939bc36f639286f377 [term 13 LEADER]: Becoming Leader. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
I20260709 13:20:44.595557 12267 raft_consensus.cc:2749] T 7ba5dac66ab5497e9e336f2a3c28cda5 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:20:44.511394 12342 raft_consensus.cc:515] T 9b3759de40694069b13c0f8bd40e5709 P b7ab4784c7344b939bc36f639286f377 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:44.602077  6804 raft_consensus.cc:3060] T 4f00a2e87e56452083b759f60d461ee3 P b7ab4784c7344b939bc36f639286f377 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:44.601197  6725 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49998 (request call id 1305) took 1603 ms. Trace:
I20260709 13:20:44.610062 12342 leader_election.cc:290] T 9b3759de40694069b13c0f8bd40e5709 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:44.608424  6697 leader_election.cc:304] T a1704639a875409b9959353527b3fd68 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377
I20260709 13:20:44.610811 12342 raft_consensus.cc:2749] T 44bde925b2e541b69890d70715b85176 P b7ab4784c7344b939bc36f639286f377 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:20:44.610659 12335 leader_election.cc:290] T 3fa34c08b205435dba97346991aa1f92 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:20:44.572026  6874 raft_consensus.cc:2468] T 20f6842e26174571996b8dea4151d4be P cd75a17ab2604397adab03bb8b5fd75c [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 17.
I20260709 13:20:44.608382  6725 rpcz_store.cc:276] 0709 13:20:42.998165 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:43.030353 (+ 32188us) service_pool.cc:224] Handling call
0709 13:20:43.030762 (+   409us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:20:43.101038 (+ 70276us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:20:43.101088 (+    50us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:20:43.169109 (+ 68021us) log.cc:844] Serialized 52 byte log entry
0709 13:20:43.572612 (+403503us) spinlock_profiling.cc:243] Waited 12 ms on lock 0x7b18002ef660. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc15785de1 00007fcc157925b1 00007fcc0c89fe07 00007fcc156faab9 00007fcc0c8bc69b 00007fcc0c8ba93f 00007fcc0c8bcc02 00007fcc0f54420b 00007fcc0f549d23 00007fcc0f54a0d1 00007fcc0f965a0f
0709 13:20:44.187885 (+615273us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:20:44.187929 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:44.188009 (+    80us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:44.600765 (+412756us) raft_consensus.cc:1685] finished
0709 13:20:44.600797 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:44.601111 (+   314us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":129,"raft.run_cpu_time_us":175,"raft.run_wall_time_us":30776,"spinlock_wait_cycles":27648768,"thread_start_us":615059,"threads_started":1,"wal-append.queue_time_us":1186946}
W20260709 13:20:44.617219 12327 log.cc:927] Time spent T 1528ab62b6fe4e3099d08f141afee116 P ccd8a4c3bfe3413cb2ae219b09aea832: Append to log took a long time: real 0.184s	user 0.000s	sys 0.000s
W20260709 13:20:44.619472 12337 log.cc:927] Time spent T 7887766dc6784fcaa42b35c05fea7a99 P b7ab4784c7344b939bc36f639286f377: Append to log took a long time: real 0.075s	user 0.000s	sys 0.000s
I20260709 13:20:44.616222  6697 leader_election.cc:304] T 3a485a995abc4807b6e511e45419f737 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377
I20260709 13:20:44.621017 12348 raft_consensus.cc:2804] T 3a485a995abc4807b6e511e45419f737 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:20:44.621578 12348 raft_consensus.cc:697] T 3a485a995abc4807b6e511e45419f737 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 15 LEADER]: Becoming Leader. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
I20260709 13:20:44.621789  6697 leader_election.cc:304] T 7a734b5ab7834e05a8c422208acc58b1 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:20:44.622605 12348 consensus_queue.cc:237] T 3a485a995abc4807b6e511e45419f737 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
W20260709 13:20:44.625105 11870 consensus_meta.cc:287] T 7c37d41cd9164c15a6826ca62a851a69 P b7ab4784c7344b939bc36f639286f377: Time spent flushing consensus metadata: real 0.548s	user 0.008s	sys 0.004s
I20260709 13:20:44.625590 11870 raft_consensus.cc:515] T 7c37d41cd9164c15a6826ca62a851a69 P b7ab4784c7344b939bc36f639286f377 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:44.612142 12306 consensus_queue.cc:237] T f3f9c2e2bf644115957398fe4c9459db P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:44.628908 12037 raft_consensus.cc:3055] T d33d5ee8ef6f415593d8df52063161ad P b7ab4784c7344b939bc36f639286f377 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:20:44.629364 12037 raft_consensus.cc:740] T d33d5ee8ef6f415593d8df52063161ad P b7ab4784c7344b939bc36f639286f377 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
I20260709 13:20:44.630234 12037 consensus_queue.cc:260] T d33d5ee8ef6f415593d8df52063161ad P b7ab4784c7344b939bc36f639286f377 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:44.631692 12037 raft_consensus.cc:3060] T d33d5ee8ef6f415593d8df52063161ad P b7ab4784c7344b939bc36f639286f377 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:44.631950 12347 raft_consensus.cc:2804] T a1704639a875409b9959353527b3fd68 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:20:44.632210 12228 raft_consensus.cc:2749] T 7a734b5ab7834e05a8c422208acc58b1 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:20:44.612591 12174 leader_election.cc:290] T 34f36d59d88f40fe8a2805e604fc6c0a P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 14 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:44.612203 12159 consensus_queue.cc:1048] T dbdf895bba214ff68685a24fd17dfb5d P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.022s
I20260709 13:20:44.612085 12293 raft_consensus.cc:2804] T f09c2a98de1a4decabd0ff900dd44caa P ccd8a4c3bfe3413cb2ae219b09aea832 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:20:44.619172 12340 consensus_queue.cc:237] T e31b9971c15848dea59d4d4130141d9e P b7ab4784c7344b939bc36f639286f377 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:44.635382 12293 raft_consensus.cc:493] T f09c2a98de1a4decabd0ff900dd44caa P ccd8a4c3bfe3413cb2ae219b09aea832 [term 16 FOLLOWER]: Starting leader election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:20:44.582504 11937 raft_consensus.cc:740] T fe20b4b48823486ca3b9c648db6ce8aa P cd75a17ab2604397adab03bb8b5fd75c [term 11 LEADER]: Becoming Follower/Learner. State: Replica: cd75a17ab2604397adab03bb8b5fd75c, State: Running, Role: LEADER
I20260709 13:20:44.637888  6697 leader_election.cc:304] T 4b8cacb381b746da8d0049b0a83b41dd P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
W20260709 13:20:44.651346  6770 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 145142us
I20260709 13:20:44.654125  6804 raft_consensus.cc:2468] T 4f00a2e87e56452083b759f60d461ee3 P b7ab4784c7344b939bc36f639286f377 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in term 17.
I20260709 13:20:44.654409  6770 leader_election.cc:304] T b56bf91d90824c959e21e0cee5ba1816 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:20:44.611660 12342 raft_consensus.cc:3055] T 7a734b5ab7834e05a8c422208acc58b1 P b7ab4784c7344b939bc36f639286f377 [term 15 LEADER]: Stepping down as leader of term 15
W20260709 13:20:44.637812 12349 log.cc:927] Time spent T a3022224cc81473690653a83d4e99470 P cd75a17ab2604397adab03bb8b5fd75c: Append to log took a long time: real 0.069s	user 0.000s	sys 0.001s
I20260709 13:20:44.670049  6801 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:32976 (request call id 3245) took 2260 ms. Trace:
I20260709 13:20:44.657383  6697 leader_election.cc:304] T 853ac0a8cbd64ce99457f170216d4d0f P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:20:44.656240  7466 leader_election.cc:304] T 4f00a2e87e56452083b759f60d461ee3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, b7ab4784c7344b939bc36f639286f377; no voters: 
I20260709 13:20:44.632568 12347 raft_consensus.cc:493] T a1704639a875409b9959353527b3fd68 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 15 FOLLOWER]: Starting leader election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:20:44.671252 12267 raft_consensus.cc:2804] T 4f00a2e87e56452083b759f60d461ee3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:20:44.671531 12347 raft_consensus.cc:3060] T a1704639a875409b9959353527b3fd68 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:44.671845 12267 raft_consensus.cc:697] T 4f00a2e87e56452083b759f60d461ee3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 17 LEADER]: Becoming Leader. State: Replica: 7ba59cc884714e8aa5f3f0ecaed84cbb, State: Running, Role: LEADER
I20260709 13:20:44.672894 12267 consensus_queue.cc:237] T 4f00a2e87e56452083b759f60d461ee3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:20:44.670522  6801 rpcz_store.cc:276] 0709 13:20:42.409953 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:43.771044 (+1361091us) service_pool.cc:224] Handling call
0709 13:20:43.771509 (+   465us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:20:43.771952 (+   443us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:43.771985 (+    33us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:20:43.772694 (+   709us) log.cc:844] Serialized 52 byte log entry
0709 13:20:44.225306 (+452612us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:20:44.297981 (+ 72675us) log.cc:844] Serialized 14 byte log entry
0709 13:20:44.300155 (+  2174us) log.cc:844] Serialized 14 byte log entry
0709 13:20:44.300565 (+   410us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:44.300688 (+   123us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:44.669795 (+369107us) raft_consensus.cc:1685] finished
0709 13:20:44.669815 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:44.669972 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":875,"prepare.queue_time_us":71858,"prepare.run_cpu_time_us":98,"prepare.run_wall_time_us":102,"raft.queue_time_us":22388,"raft.run_cpu_time_us":224,"raft.run_wall_time_us":225,"thread_start_us":452142,"threads_started":1,"wal-append.queue_time_us":715196}
I20260709 13:20:44.681234 12249 leader_election.cc:290] T bb3d8792045a4583ae2e965b1350a5b4 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:44.638749 12011 raft_consensus.cc:2749] T 9b3759de40694069b13c0f8bd40e5709 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:20:44.660984 12201 raft_consensus.cc:2804] T 4b8cacb381b746da8d0049b0a83b41dd P ccd8a4c3bfe3413cb2ae219b09aea832 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:20:44.635860 12293 raft_consensus.cc:3060] T f09c2a98de1a4decabd0ff900dd44caa P ccd8a4c3bfe3413cb2ae219b09aea832 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:44.663826 11870 leader_election.cc:290] T 7c37d41cd9164c15a6826ca62a851a69 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 15 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:44.664404 12102 raft_consensus.cc:2749] T b56bf91d90824c959e21e0cee5ba1816 P b7ab4784c7344b939bc36f639286f377 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:20:44.664721 11937 consensus_queue.cc:260] T fe20b4b48823486ca3b9c648db6ce8aa P cd75a17ab2604397adab03bb8b5fd75c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:20:44.684445 12240 raft_consensus.cc:2749] T 853ac0a8cbd64ce99457f170216d4d0f P ccd8a4c3bfe3413cb2ae219b09aea832 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:20:44.687757 11937 raft_consensus.cc:3060] T fe20b4b48823486ca3b9c648db6ce8aa P cd75a17ab2604397adab03bb8b5fd75c [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:20:44.683805 12201 raft_consensus.cc:493] T 4b8cacb381b746da8d0049b0a83b41dd P ccd8a4c3bfe3413cb2ae219b09aea832 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:44.696081 12201 raft_consensus.cc:3060] T 4b8cacb381b746da8d0049b0a83b41dd P ccd8a4c3bfe3413cb2ae219b09aea832 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:44.682260  6770 leader_election.cc:304] T 1bf4668eeb70467fb3dc5a0289233b3c P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:20:44.698796 12238 raft_consensus.cc:993] T b56bf91d90824c959e21e0cee5ba1816 P ccd8a4c3bfe3413cb2ae219b09aea832: : Instructing follower cd75a17ab2604397adab03bb8b5fd75c to start an election
I20260709 13:20:44.699414 12238 raft_consensus.cc:1081] T b56bf91d90824c959e21e0cee5ba1816 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 14 LEADER]: Signalling peer cd75a17ab2604397adab03bb8b5fd75c to start an election
I20260709 13:20:44.704934  6803 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:32976 (request call id 3251) took 1674 ms. Trace:
I20260709 13:20:44.705415  6803 rpcz_store.cc:276] 0709 13:20:43.030661 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:43.811189 (+780528us) service_pool.cc:224] Handling call
0709 13:20:43.811564 (+   375us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:44.229216 (+417652us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:44.704525 (+475309us) spinlock_profiling.cc:243] Waited 417 ms on lock 0x7b54002da854. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f9aae01 00007fcc0f9a983e 00007fcc1496e419 00007fcc0dee5bd4 00007fcc0dee5b62 00007fcc0dee5a91 00007fcc0dee5a0c 00007fcc0dee4cc2 00007fcc0dce548c 00007fcc0dce48c6
0709 13:20:44.704751 (+   226us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":958460800}
I20260709 13:20:44.685652  6697 leader_election.cc:304] T f4b8bd455d5a47c18a1380839c6e0d61 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377
W20260709 13:20:44.710412  6771 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:44.711719  6771 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:44.716645  6806 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:32976 (request call id 3247) took 2274 ms. Trace:
I20260709 13:20:44.717024  6806 rpcz_store.cc:276] 0709 13:20:42.442070 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:43.776640 (+1334570us) service_pool.cc:224] Handling call
0709 13:20:43.867360 (+ 90720us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:44.021359 (+153999us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:44.021396 (+    37us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:20:44.021547 (+   151us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:20:44.021602 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:44.716413 (+694811us) spinlock_profiling.cc:243] Waited 154 ms on lock 0x7b54001f6b54. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f9aae01 00007fcc0f9a983e 00007fcc1496e419 00007fcc0dee5bd4 00007fcc0dee5b62 00007fcc0dee5a91 00007fcc0dee5a0c 00007fcc0dee4cc2 00007fcc0dce548c 00007fcc0dce48c6
0709 13:20:44.716459 (+    46us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:44.716590 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":353552768}
I20260709 13:20:44.713069  6770 leader_election.cc:304] T b3f13b31a1f84f0d89d007eadd57924c P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:20:44.722680 12090 raft_consensus.cc:3055] T 3a485a995abc4807b6e511e45419f737 P b7ab4784c7344b939bc36f639286f377 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:20:44.723114 12090 raft_consensus.cc:740] T 3a485a995abc4807b6e511e45419f737 P b7ab4784c7344b939bc36f639286f377 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
I20260709 13:20:44.724274  6695 leader_election.cc:304] T 3411566abe2d4c9bb4b2adfdd05e6f17 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
I20260709 13:20:44.725224 12227 consensus_queue.cc:1048] T be1a92657f494cac8dd227d152f50151 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:20:44.725286 12174 raft_consensus.cc:2749] T 1bf4668eeb70467fb3dc5a0289233b3c P b7ab4784c7344b939bc36f639286f377 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:20:44.539006 12271 consensus_queue.cc:260] T 3fa34c08b205435dba97346991aa1f92 P 7ba59cc884714e8aa5f3f0ecaed84cbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.14, Last appended by leader: 14, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:20:44.721138 12252 raft_consensus.cc:3055] T d8cee0accdb8499c86d4414b72565a38 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:20:44.734017  6799 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:32976 (request call id 3264) took 1179 ms. Trace:
I20260709 13:20:44.748699  6799 rpcz_store.cc:276] 0709 13:20:43.554413 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:43.832723 (+278310us) service_pool.cc:224] Handling call
0709 13:20:43.833071 (+   348us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:44.049249 (+216178us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:44.049285 (+    36us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:20:44.049333 (+    48us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:20:44.049366 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:44.733662 (+684296us) spinlock_profiling.cc:243] Waited 216 ms on lock 0x7b54001f5754. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f9aae01 00007fcc0f9a983e 00007fcc1496e419 00007fcc0dee5bd4 00007fcc0dee5b62 00007fcc0dee5a91 00007fcc0dee5a0c 00007fcc0dee4cc2 00007fcc0dce548c 00007fcc0dce48c6
0709 13:20:44.733729 (+    67us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:44.733943 (+   214us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":496660736}
W20260709 13:20:44.735421  6773 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:44.737772  6770 leader_election.cc:304] T 7887766dc6784fcaa42b35c05fea7a99 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:20:44.732932  7501 raft_consensus.cc:1240] T fe20b4b48823486ca3b9c648db6ce8aa P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 12 FOLLOWER]: Rejecting Update request from peer cd75a17ab2604397adab03bb8b5fd75c for earlier term 11. Current term is 12. Ops: []
I20260709 13:20:44.734232  7500 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50742 (request call id 502) took 1037 ms. Trace:
I20260709 13:20:44.728364  6846 leader_election.cc:304] T 24ee15416e3145beaa1b8183453729a3 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
W20260709 13:20:44.752844  6846 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:44.734360 11994 consensus_meta.cc:287] T 22ccee1b570c4ad3a57bd7aec085b1b4 P ccd8a4c3bfe3413cb2ae219b09aea832: Time spent flushing consensus metadata: real 0.641s	user 0.010s	sys 0.003s
I20260709 13:20:44.752127  7500 rpcz_store.cc:276] 0709 13:20:43.696446 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:43.696627 (+   181us) service_pool.cc:224] Handling call
0709 13:20:43.729971 (+ 33344us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:44.054435 (+324464us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:44.054471 (+    36us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:20:44.054522 (+    51us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:20:44.054567 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:44.734006 (+679439us) spinlock_profiling.cc:243] Waited 319 ms on lock 0x7b5400604d54. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f9aae01 00007fcc0f9a983e 00007fcc1496e419 00007fcc0dee5bd4 00007fcc0dee5b62 00007fcc0dee5a91 00007fcc0dee5a0c 00007fcc0dee4cc2 00007fcc0dce548c 00007fcc0dce48c6
0709 13:20:44.734058 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:44.734176 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5170,"raft.queue_time_us":5590,"raft.run_cpu_time_us":146,"raft.run_wall_time_us":12627,"spinlock_wait_cycles":733164416}
I20260709 13:20:44.715312 12240 raft_consensus.cc:2804] T f4b8bd455d5a47c18a1380839c6e0d61 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 15 FOLLOWER]: Leader pre-election won for term 16
W20260709 13:20:44.734313 12304 log.cc:927] Time spent T 7887766dc6784fcaa42b35c05fea7a99 P cd75a17ab2604397adab03bb8b5fd75c: Append to log took a long time: real 1.015s	user 0.003s	sys 0.004s
I20260709 13:20:44.767638  7495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "427c124d773f483294511e80fe340075" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:20:44.767459  6727 consensus_queue.cc:237] T 95a75bfe094d4bdc963aba3f08dfcd25 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 13.6, Last appended by leader: 5, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } attrs { replace: true } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: NON_VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: true } }
I20260709 13:20:44.662127 12342 raft_consensus.cc:740] T 7a734b5ab7834e05a8c422208acc58b1 P b7ab4784c7344b939bc36f639286f377 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
I20260709 13:20:44.728015 12227 raft_consensus.cc:2804] T 3411566abe2d4c9bb4b2adfdd05e6f17 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 13 FOLLOWER]: Leader election won for term 13
W20260709 13:20:44.734467 12253 consensus_queue.cc:1175] T 3fa34c08b205435dba97346991aa1f92 P 7ba59cc884714e8aa5f3f0ecaed84cbb [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "cd75a17ab2604397adab03bb8b5fd75c" responder_term: 17 status { last_received { term: 17 index: 14 } last_committed_idx: 14 last_received_current_leader { term: 17 index: 14 } }
I20260709 13:20:44.732354 12214 consensus_queue.cc:1059] T c4db81d9d329422bb3b4160ca4ac2d1d P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: INVALID_TERM, Last received: 14.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.055s
I20260709 13:20:44.748513 12252 raft_consensus.cc:740] T d8cee0accdb8499c86d4414b72565a38 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 7ba59cc884714e8aa5f3f0ecaed84cbb, State: Running, Role: LEADER
I20260709 13:20:44.751262 12353 raft_consensus.cc:2749] T b3f13b31a1f84f0d89d007eadd57924c P b7ab4784c7344b939bc36f639286f377 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:20:44.798285 12252 consensus_queue.cc:260] T d8cee0accdb8499c86d4414b72565a38 P 7ba59cc884714e8aa5f3f0ecaed84cbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:20:44.723872 12090 consensus_queue.cc:260] T 3a485a995abc4807b6e511e45419f737 P b7ab4784c7344b939bc36f639286f377 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:44.804313 11567 raft_consensus.cc:493] T 711ef6523deb4cbe8ef2ba61e1c21c98 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 17 FOLLOWER]: Starting leader election (detected failure of leader cd75a17ab2604397adab03bb8b5fd75c)
I20260709 13:20:44.805217 11567 raft_consensus.cc:3060] T 711ef6523deb4cbe8ef2ba61e1c21c98 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:20:44.804962 12342 consensus_queue.cc:260] T 7a734b5ab7834e05a8c422208acc58b1 P b7ab4784c7344b939bc36f639286f377 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 15.7, Last appended by leader: 7, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } attrs { replace: true } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: NON_VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: true } }
I20260709 13:20:44.806571 12342 raft_consensus.cc:3060] T 7a734b5ab7834e05a8c422208acc58b1 P b7ab4784c7344b939bc36f639286f377 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:44.751569 12247 consensus_queue.cc:1048] T 17587d6730594da4a56fa13a353232a1 P 7ba59cc884714e8aa5f3f0ecaed84cbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.045s
I20260709 13:20:44.791867 12218 consensus_queue.cc:1048] T f03d0dbf16864ca4bc1bb5e4c0334c0f P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.011s
I20260709 13:20:44.762392 12297 consensus_queue.cc:1059] T 4f00a2e87e56452083b759f60d461ee3 P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false }, Status: INVALID_TERM, Last received: 16.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.051s
I20260709 13:20:44.813908  6880 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53416 (request call id 3242) took 2686 ms. Trace:
I20260709 13:20:44.814093 12297 raft_consensus.cc:3055] T 4f00a2e87e56452083b759f60d461ee3 P cd75a17ab2604397adab03bb8b5fd75c [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:20:44.762240 12335 raft_consensus.cc:2804] T 24ee15416e3145beaa1b8183453729a3 P cd75a17ab2604397adab03bb8b5fd75c [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:20:44.818548  6804 raft_consensus.cc:1240] T d8cee0accdb8499c86d4414b72565a38 P b7ab4784c7344b939bc36f639286f377 [term 15 FOLLOWER]: Rejecting Update request from peer 7ba59cc884714e8aa5f3f0ecaed84cbb for earlier term 14. Current term is 15. Ops: []
W20260709 13:20:44.823148  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 232109us
I20260709 13:20:44.814332  6880 rpcz_store.cc:276] 0709 13:20:42.127731 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:42.127879 (+   148us) service_pool.cc:224] Handling call
0709 13:20:42.171608 (+ 43729us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:42.597213 (+425605us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:20:42.617045 (+ 19832us) log.cc:844] Serialized 14 byte log entry
0709 13:20:44.030886 (+1413841us) log.cc:844] Serialized 14 byte log entry
0709 13:20:44.031135 (+   249us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:20:44.031204 (+    69us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:20:44.031267 (+    63us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:44.733567 (+702300us) spinlock_profiling.cc:243] Waited 15.8 ms on lock 0x7b4400022b4c. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0c745db1 00007fcc0c7e3c85 00007fcc0c7e46a2 00007fcc0f5561db 00007fcc0f551aaf 00007fcc0f54586e 00007fcc0f544bb6 00007fcc0f5447d8 00007fcc0f54e221 00007fcc0f54e1d9 00007fcc0f54e169
0709 13:20:44.813684 (+ 80117us) spinlock_profiling.cc:243] Waited 388 ms on lock 0x7b5400347e54. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f9aae01 00007fcc0f9a983e 00007fcc1496e419 00007fcc0dee5bd4 00007fcc0dee5b62 00007fcc0dee5a91 00007fcc0dee5a0c 00007fcc0dee4cc2 00007fcc0dce548c 00007fcc0dce48c6
0709 13:20:44.813738 (+    54us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:44.813856 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":204052,"prepare.run_cpu_time_us":91,"prepare.run_wall_time_us":94,"raft.queue_time_us":50875,"raft.run_cpu_time_us":275,"raft.run_wall_time_us":43676,"spinlock_wait_cycles":928139392,"thread_start_us":1413048,"threads_started":2,"wal-append.queue_time_us":1049412}
I20260709 13:20:44.767114 12240 raft_consensus.cc:493] T f4b8bd455d5a47c18a1380839c6e0d61 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:44.763446 12359 raft_consensus.cc:2749] T 7887766dc6784fcaa42b35c05fea7a99 P b7ab4784c7344b939bc36f639286f377 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:20:44.850828  6880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f00a2e87e56452083b759f60d461ee3" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:20:44.816977  7494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fa34c08b205435dba97346991aa1f92" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:20:44.854647  6874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3d8792045a4583ae2e965b1350a5b4" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:44.825197 12297 raft_consensus.cc:740] T 4f00a2e87e56452083b759f60d461ee3 P cd75a17ab2604397adab03bb8b5fd75c [term 16 LEADER]: Becoming Follower/Learner. State: Replica: cd75a17ab2604397adab03bb8b5fd75c, State: Running, Role: LEADER
I20260709 13:20:44.858690  6874 raft_consensus.cc:2468] T bb3d8792045a4583ae2e965b1350a5b4 P cd75a17ab2604397adab03bb8b5fd75c [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in term 13.
I20260709 13:20:44.825255 12335 raft_consensus.cc:493] T 24ee15416e3145beaa1b8183453729a3 P cd75a17ab2604397adab03bb8b5fd75c [term 18 FOLLOWER]: Starting leader election (detected failure of leader 7ba59cc884714e8aa5f3f0ecaed84cbb)
I20260709 13:20:44.861462  7468 leader_election.cc:304] T bb3d8792045a4583ae2e965b1350a5b4 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:20:44.839212 12227 raft_consensus.cc:697] T 3411566abe2d4c9bb4b2adfdd05e6f17 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 13 LEADER]: Becoming Leader. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
I20260709 13:20:44.844954 12240 raft_consensus.cc:3060] T f4b8bd455d5a47c18a1380839c6e0d61 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:20:44.869709  6697 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 81678.3us
I20260709 13:20:44.782137 11994 raft_consensus.cc:515] T 22ccee1b570c4ad3a57bd7aec085b1b4 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
W20260709 13:20:44.856189 12343 log.cc:927] Time spent T ab432e62819d499eaaf3dd55481dd930 P cd75a17ab2604397adab03bb8b5fd75c: Append to log took a long time: real 0.419s	user 0.004s	sys 0.000s
I20260709 13:20:44.852638 12228 raft_consensus.cc:493] T 17587d6730594da4a56fa13a353232a1 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:44.873667  6697 leader_election.cc:304] T 2c240553ce044eedb41541d72b9475d7 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:20:44.852769 12086 raft_consensus.cc:493] T 07a92dd554674067a83a9cb68c4773f2 P cd75a17ab2604397adab03bb8b5fd75c [term 13 FOLLOWER]: Starting pre-election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:20:44.857612 12288 raft_consensus.cc:493] T 713b5728a197487c9300b310ab94e5a3 P cd75a17ab2604397adab03bb8b5fd75c [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
W20260709 13:20:44.883736  6772 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 307652us
I20260709 13:20:44.868717 12335 raft_consensus.cc:3060] T 24ee15416e3145beaa1b8183453729a3 P cd75a17ab2604397adab03bb8b5fd75c [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:20:44.843364 12290 raft_consensus.cc:515] T bb7fa124c3bf4ef9ab65a407cb008441 P cd75a17ab2604397adab03bb8b5fd75c [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:20:44.871572 12249 raft_consensus.cc:2804] T bb3d8792045a4583ae2e965b1350a5b4 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:20:44.883412 12214 consensus_queue.cc:1243] T c4db81d9d329422bb3b4160ca4ac2d1d P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Peer b7ab4784c7344b939bc36f639286f377 log is divergent from this leader: its last log entry 15.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 13:20:44.915916  6879 raft_consensus.cc:1240] T bb7fa124c3bf4ef9ab65a407cb008441 P cd75a17ab2604397adab03bb8b5fd75c [term 15 FOLLOWER]: Rejecting Update request from peer 7ba59cc884714e8aa5f3f0ecaed84cbb for earlier term 14. Current term is 15. Ops: []
I20260709 13:20:44.871408 12159 consensus_queue.cc:1048] T 2c240553ce044eedb41541d72b9475d7 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.028s
I20260709 13:20:44.884315 12228 raft_consensus.cc:515] T 17587d6730594da4a56fa13a353232a1 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
W20260709 13:20:44.923931  7469 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:44.928435  6772 leader_election.cc:304] T 22ccee1b570c4ad3a57bd7aec085b1b4 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:20:44.948477  6731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be1a92657f494cac8dd227d152f50151" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:44.948716  6874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34f36d59d88f40fe8a2805e604fc6c0a" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:20:44.949476  6723 raft_consensus.cc:1275] T 853ac0a8cbd64ce99457f170216d4d0f P ccd8a4c3bfe3413cb2ae219b09aea832 [term 14 FOLLOWER]: Refusing update from remote peer b7ab4784c7344b939bc36f639286f377: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:20:44.932575 12227 consensus_queue.cc:237] T 3411566abe2d4c9bb4b2adfdd05e6f17 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:44.951040  6729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34f36d59d88f40fe8a2805e604fc6c0a" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:20:44.951658  6729 raft_consensus.cc:3060] T 34f36d59d88f40fe8a2805e604fc6c0a P ccd8a4c3bfe3413cb2ae219b09aea832 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:44.932395 12297 consensus_queue.cc:260] T 4f00a2e87e56452083b759f60d461ee3 P cd75a17ab2604397adab03bb8b5fd75c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:20:44.940527 12261 consensus_queue.cc:1059] T c4db81d9d329422bb3b4160ca4ac2d1d P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.034s
I20260709 13:20:44.954681 12148 raft_consensus.cc:2804] T 22ccee1b570c4ad3a57bd7aec085b1b4 P b7ab4784c7344b939bc36f639286f377 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:20:44.956400  7495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be1a92657f494cac8dd227d152f50151" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:20:44.956795 12290 leader_election.cc:290] T bb7fa124c3bf4ef9ab65a407cb008441 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 15 election: Requested vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:20:44.957401 12290 consensus_queue.cc:1048] T 711ef6523deb4cbe8ef2ba61e1c21c98 P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:20:44.942382 12252 raft_consensus.cc:3060] T d8cee0accdb8499c86d4414b72565a38 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:44.958817 12353 consensus_queue.cc:1048] T dbdf895bba214ff68685a24fd17dfb5d P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:20:44.949548  6874 raft_consensus.cc:3060] T 34f36d59d88f40fe8a2805e604fc6c0a P cd75a17ab2604397adab03bb8b5fd75c [term 12 FOLLOWER]: Advancing to term 14
I20260709 13:20:44.963724 12159 raft_consensus.cc:493] T 7ba5dac66ab5497e9e336f2a3c28cda5 P b7ab4784c7344b939bc36f639286f377 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader cd75a17ab2604397adab03bb8b5fd75c)
I20260709 13:20:44.964563  6723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b3759de40694069b13c0f8bd40e5709" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:44.964401 12159 raft_consensus.cc:515] T 7ba5dac66ab5497e9e336f2a3c28cda5 P b7ab4784c7344b939bc36f639286f377 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:20:44.942999 12228 leader_election.cc:290] T 17587d6730594da4a56fa13a353232a1 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:20:44.966933 12159 leader_election.cc:290] T 7ba5dac66ab5497e9e336f2a3c28cda5 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:20:44.967748 12148 raft_consensus.cc:697] T 22ccee1b570c4ad3a57bd7aec085b1b4 P b7ab4784c7344b939bc36f639286f377 [term 14 LEADER]: Becoming Leader. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
I20260709 13:20:44.887838 12086 raft_consensus.cc:515] T 07a92dd554674067a83a9cb68c4773f2 P cd75a17ab2604397adab03bb8b5fd75c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:44.968871 12148 consensus_queue.cc:237] T 22ccee1b570c4ad3a57bd7aec085b1b4 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:44.969906  7500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ba5dac66ab5497e9e336f2a3c28cda5" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:20:44.970767  7500 raft_consensus.cc:2393] T 7ba5dac66ab5497e9e336f2a3c28cda5 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7ab4784c7344b939bc36f639286f377 in current term 16: Already voted for candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in this term.
I20260709 13:20:44.970805 12086 leader_election.cc:290] T 07a92dd554674067a83a9cb68c4773f2 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:20:44.972499 11994 leader_election.cc:290] T 22ccee1b570c4ad3a57bd7aec085b1b4 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 13 election: Requested vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:44.943100  6844 leader_election.cc:304] T 34f36d59d88f40fe8a2805e604fc6c0a P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:20:44.944216  6726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e31b9971c15848dea59d4d4130141d9e" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:20:44.974792  6726 raft_consensus.cc:2393] T e31b9971c15848dea59d4d4130141d9e P ccd8a4c3bfe3413cb2ae219b09aea832 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate b7ab4784c7344b939bc36f639286f377 in current term 13: Already voted for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in this term.
I20260709 13:20:44.974599  6844 leader_election.cc:304] T 44bde925b2e541b69890d70715b85176 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:20:44.975478  6880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b3759de40694069b13c0f8bd40e5709" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:44.976086  6844 leader_election.cc:304] T ce4f062dcd314d43a63ca74067cb5ee3 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, b7ab4784c7344b939bc36f639286f377
I20260709 13:20:44.944566  6725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30e88460611e47b2ba16a46a30b5f416" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:44.944978  6728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6869f07b5a4885a0b99fbe60c3b175" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:44.977715  6844 leader_election.cc:304] T f5be3a11b23d4ea9b08300a2789821c7 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:20:44.977912  6873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ba5dac66ab5497e9e336f2a3c28cda5" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:44.948716  6724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22ccee1b570c4ad3a57bd7aec085b1b4" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:20:44.979501  6724 raft_consensus.cc:3060] T 22ccee1b570c4ad3a57bd7aec085b1b4 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:44.979979  6877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c37d41cd9164c15a6826ca62a851a69" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:20:44.976194  6880 raft_consensus.cc:2468] T 9b3759de40694069b13c0f8bd40e5709 P cd75a17ab2604397adab03bb8b5fd75c [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 12.
I20260709 13:20:44.981086  6877 raft_consensus.cc:3060] T 7c37d41cd9164c15a6826ca62a851a69 P cd75a17ab2604397adab03bb8b5fd75c [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:44.972987 12090 raft_consensus.cc:3060] T 3a485a995abc4807b6e511e45419f737 P b7ab4784c7344b939bc36f639286f377 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:44.979758  6772 leader_election.cc:304] T 7ba5dac66ab5497e9e336f2a3c28cda5 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:20:44.927572 12214 raft_consensus.cc:2749] T 2c240553ce044eedb41541d72b9475d7 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:20:44.995736  6770 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:44.995913  6772 leader_election.cc:304] T 9b3759de40694069b13c0f8bd40e5709 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:20:44.996920  7500 raft_consensus.cc:1240] T 7ba5dac66ab5497e9e336f2a3c28cda5 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 16 FOLLOWER]: Rejecting Update request from peer cd75a17ab2604397adab03bb8b5fd75c for earlier term 15. Current term is 16. Ops: []
I20260709 13:20:44.899573 12249 raft_consensus.cc:493] T bb3d8792045a4583ae2e965b1350a5b4 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 13 FOLLOWER]: Starting leader election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:20:45.018249  6804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a734b5ab7834e05a8c422208acc58b1" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:45.020401  6799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c240553ce044eedb41541d72b9475d7" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:45.013093  6874 raft_consensus.cc:2468] T 34f36d59d88f40fe8a2805e604fc6c0a P cd75a17ab2604397adab03bb8b5fd75c [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 14.
I20260709 13:20:45.023813  6799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4b8bd455d5a47c18a1380839c6e0d61" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:45.023928  6803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f58dc08b12a2494bb9a1372837970ca2" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:20:45.032563  6844 leader_election.cc:304] T 2c240553ce044eedb41541d72b9475d7 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:20:45.034515  6724 raft_consensus.cc:2468] T 22ccee1b570c4ad3a57bd7aec085b1b4 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 14.
I20260709 13:20:45.027840  6772 leader_election.cc:304] T 34f36d59d88f40fe8a2805e604fc6c0a P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:20:44.890410 12288 raft_consensus.cc:515] T 713b5728a197487c9300b310ab94e5a3 P cd75a17ab2604397adab03bb8b5fd75c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
W20260709 13:20:45.055900  6695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 186103us
I20260709 13:20:45.034618  6770 leader_election.cc:304] T be1a92657f494cac8dd227d152f50151 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:20:45.036653  7495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb7fa124c3bf4ef9ab65a407cb008441" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb"
I20260709 13:20:45.014489 12296 raft_consensus.cc:2749] T 44bde925b2e541b69890d70715b85176 P cd75a17ab2604397adab03bb8b5fd75c [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:20:44.922078 12251 raft_consensus.cc:2749] T 90d42e216d9741e190bca19a781291fd P ccd8a4c3bfe3413cb2ae219b09aea832 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:20:45.052279  6802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e326172347f45e99a0d482b5d8ef768" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:45.053141  6798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77e330a82df4b43a745d57a68f6f057" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:45.057924  6801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d65025eea89441290d85dd053810e31" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:45.042992  6726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c37d41cd9164c15a6826ca62a851a69" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:20:45.059413  6799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f9c2e2bf644115957398fe4c9459db" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:45.014459 12290 raft_consensus.cc:2749] T ce4f062dcd314d43a63ca74067cb5ee3 P cd75a17ab2604397adab03bb8b5fd75c [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:20:45.014302 12310 raft_consensus.cc:493] T 1528ab62b6fe4e3099d08f141afee116 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:20:45.061244  6697 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 188467us
I20260709 13:20:45.020560 12246 raft_consensus.cc:3060] T 7ba5dac66ab5497e9e336f2a3c28cda5 P b7ab4784c7344b939bc36f639286f377 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:45.014407 12011 raft_consensus.cc:493] T 4275cf08e63345f993bce8664eada830 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:20:45.084472 12011 raft_consensus.cc:515] T 4275cf08e63345f993bce8664eada830 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:45.086917  6806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bf4668eeb70467fb3dc5a0289233b3c" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:45.087378 12011 leader_election.cc:290] T 4275cf08e63345f993bce8664eada830 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:45.019692 12305 raft_consensus.cc:2749] T f5be3a11b23d4ea9b08300a2789821c7 P cd75a17ab2604397adab03bb8b5fd75c [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:20:45.020138 12249 raft_consensus.cc:3060] T bb3d8792045a4583ae2e965b1350a5b4 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:45.027511 12356 raft_consensus.cc:2764] T 34f36d59d88f40fe8a2805e604fc6c0a P cd75a17ab2604397adab03bb8b5fd75c [term 14 FOLLOWER]: Leader pre-election decision vote started in defunct term 12: won
I20260709 13:20:45.067688  6801 raft_consensus.cc:2468] T 3d65025eea89441290d85dd053810e31 P b7ab4784c7344b939bc36f639286f377 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 15.
I20260709 13:20:45.093995  6806 raft_consensus.cc:2468] T 1bf4668eeb70467fb3dc5a0289233b3c P b7ab4784c7344b939bc36f639286f377 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 15.
W20260709 13:20:45.095921 12364 log.cc:927] Time spent T 3a485a995abc4807b6e511e45419f737 P ccd8a4c3bfe3413cb2ae219b09aea832: Append to log took a long time: real 0.160s	user 0.000s	sys 0.000s
I20260709 13:20:45.094053  6801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30e88460611e47b2ba16a46a30b5f416" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:45.096447  6806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a92dd554674067a83a9cb68c4773f2" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:45.097518  6801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b56bf91d90824c959e21e0cee5ba1816" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:45.098218  6806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbdf895bba214ff68685a24fd17dfb5d" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 15 candidate_status { last_received { term: 12 index: 5 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:45.099395  6801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a75bfe094d4bdc963aba3f08dfcd25" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:45.102936  6624 catalog_manager.cc:5697] T bb3d8792045a4583ae2e965b1350a5b4 P 7ba59cc884714e8aa5f3f0ecaed84cbb reported cstate change: term changed from 9 to 12, leader changed from cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67) to 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68). New cstate: current_term: 12 leader_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:20:45.069501  6799 raft_consensus.cc:2376] T f3f9c2e2bf644115957398fe4c9459db P b7ab4784c7344b939bc36f639286f377 [term 15 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 15. Re-sending same reply.
I20260709 13:20:45.105015  6624 catalog_manager.cc:5697] T d8cee0accdb8499c86d4414b72565a38 P 7ba59cc884714e8aa5f3f0ecaed84cbb reported cstate change: term changed from 9 to 14, leader changed from b7ab4784c7344b939bc36f639286f377 (127.5.126.66) to 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68). New cstate: current_term: 14 leader_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:20:45.106237  6799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d33d5ee8ef6f415593d8df52063161ad" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:45.106871  6624 catalog_manager.cc:5697] T 4f00a2e87e56452083b759f60d461ee3 P 7ba59cc884714e8aa5f3f0ecaed84cbb reported cstate change: term changed from 7 to 14, leader changed from b7ab4784c7344b939bc36f639286f377 (127.5.126.66) to 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68). New cstate: current_term: 14 leader_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:20:44.648201  5625 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:20:45.099826  6806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8292e16e5654be6bc408560cf256aaa" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:44.935681 12334 raft_consensus.cc:515] T a3022224cc81473690653a83d4e99470 P cd75a17ab2604397adab03bb8b5fd75c [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:45.036643 12247 raft_consensus.cc:493] T 404190ce4ce94cecbfcb6ea9d1dd8626 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:45.124892  6801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "427c124d773f483294511e80fe340075" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:45.054957 11951 raft_consensus.cc:2804] T 9b3759de40694069b13c0f8bd40e5709 P b7ab4784c7344b939bc36f639286f377 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:20:45.130648  6877 raft_consensus.cc:2468] T 7c37d41cd9164c15a6826ca62a851a69 P cd75a17ab2604397adab03bb8b5fd75c [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 15.
I20260709 13:20:45.118868  6729 raft_consensus.cc:2468] T 34f36d59d88f40fe8a2805e604fc6c0a P ccd8a4c3bfe3413cb2ae219b09aea832 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 14.
I20260709 13:20:45.106920  6799 raft_consensus.cc:2468] T d33d5ee8ef6f415593d8df52063161ad P b7ab4784c7344b939bc36f639286f377 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 13.
I20260709 13:20:45.172353  6799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e31b9971c15848dea59d4d4130141d9e" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:45.173456  6799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c7f33e544204fbaac4078e3e83bbf4e" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:45.133064 11951 raft_consensus.cc:493] T 9b3759de40694069b13c0f8bd40e5709 P b7ab4784c7344b939bc36f639286f377 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:20:45.113780  6770 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 79296.9us
I20260709 13:20:45.177925  6803 raft_consensus.cc:2468] T f58dc08b12a2494bb9a1372837970ca2 P b7ab4784c7344b939bc36f639286f377 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 17.
W20260709 13:20:45.154912 12326 log.cc:927] Time spent T a3022224cc81473690653a83d4e99470 P ccd8a4c3bfe3413cb2ae219b09aea832: Append to log took a long time: real 0.083s	user 0.000s	sys 0.000s
I20260709 13:20:45.020428 12201 raft_consensus.cc:515] T 4b8cacb381b746da8d0049b0a83b41dd P ccd8a4c3bfe3413cb2ae219b09aea832 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
W20260709 13:20:45.146064  7466 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:45.029500 12347 raft_consensus.cc:515] T a1704639a875409b9959353527b3fd68 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:45.148488  6802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7887766dc6784fcaa42b35c05fea7a99" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:45.148671  6801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb7fa124c3bf4ef9ab65a407cb008441" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:20:45.036406 12097 consensus_queue.cc:1059] T 7ba5dac66ab5497e9e336f2a3c28cda5 P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false }, Status: INVALID_TERM, Last received: 15.12, Next index: 13, Last known committed idx: 11, Time since last communication: 0.089s
W20260709 13:20:45.153563  6695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 95388.9us
W20260709 13:20:45.158341  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 125890us
I20260709 13:20:45.125938 12278 raft_consensus.cc:2749] T be1a92657f494cac8dd227d152f50151 P b7ab4784c7344b939bc36f639286f377 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:20:45.070888 12358 raft_consensus.cc:2804] T 34f36d59d88f40fe8a2805e604fc6c0a P b7ab4784c7344b939bc36f639286f377 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:20:45.112084  6697 leader_election.cc:304] T e31b9971c15848dea59d4d4130141d9e P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:20:45.133716  6798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8cee0accdb8499c86d4414b72565a38" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:45.179697  6803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f03d0dbf16864ca4bc1bb5e4c0334c0f" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 16 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:45.179883  6770 leader_election.cc:304] T bd6869f07b5a4885a0b99fbe60c3b175 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:20:45.175215  6772 leader_election.cc:304] T 7c37d41cd9164c15a6826ca62a851a69 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
W20260709 13:20:45.183559  6616 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet ce4f062dcd314d43a63ca74067cb5ee3 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER failed with leader 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 7ba59cc884714e8aa5f3f0ecaed84cbb is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 15 leader_uuid: "b7ab4784c7344b939bc36f639286f377" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } attrs { replace: true } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } } }
I20260709 13:20:45.182040 11951 raft_consensus.cc:3060] T 9b3759de40694069b13c0f8bd40e5709 P b7ab4784c7344b939bc36f639286f377 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:45.216764  6770 leader_election.cc:304] T 30e88460611e47b2ba16a46a30b5f416 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:20:45.194330  6806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4275cf08e63345f993bce8664eada830" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:45.156904 11576 raft_consensus.cc:2749] T 2c240553ce044eedb41541d72b9475d7 P cd75a17ab2604397adab03bb8b5fd75c [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:20:45.122277 12310 raft_consensus.cc:515] T 1528ab62b6fe4e3099d08f141afee116 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:20:45.266708 12310 leader_election.cc:290] T 1528ab62b6fe4e3099d08f141afee116 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
W20260709 13:20:45.268678 12333 log.cc:927] Time spent T ab432e62819d499eaaf3dd55481dd930 P ccd8a4c3bfe3413cb2ae219b09aea832: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 13:20:45.270248 12347 leader_election.cc:290] T a1704639a875409b9959353527b3fd68 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 16 election: Requested vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:45.280599 12201 leader_election.cc:290] T 4b8cacb381b746da8d0049b0a83b41dd P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 16 election: Requested vote from peers cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
W20260709 13:20:45.284641  6695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 81372.5us
I20260709 13:20:44.443041  6881 rpcz_store.cc:276] 0709 13:20:42.470777 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:43.568188 (+1097411us) service_pool.cc:224] Handling call
0709 13:20:43.568588 (+   400us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:43.568822 (+   234us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:20:44.167862 (+599040us) log.cc:844] Serialized 14 byte log entry
0709 13:20:44.438487 (+270625us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:20:44.438539 (+    52us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:20:44.438598 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:44.438658 (+    60us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:44.438807 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":6598,"prepare.run_cpu_time_us":36,"prepare.run_wall_time_us":36,"raft.queue_time_us":148,"raft.run_cpu_time_us":153,"raft.run_wall_time_us":6611,"thread_start_us":842130,"threads_started":2}
I20260709 13:20:45.292234  6695 leader_election.cc:304] T 1bf4668eeb70467fb3dc5a0289233b3c P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
I20260709 13:20:45.294426 12251 raft_consensus.cc:2804] T 1bf4668eeb70467fb3dc5a0289233b3c P ccd8a4c3bfe3413cb2ae219b09aea832 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:20:45.295045 12251 raft_consensus.cc:493] T 1bf4668eeb70467fb3dc5a0289233b3c P ccd8a4c3bfe3413cb2ae219b09aea832 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:45.295475 12251 raft_consensus.cc:3060] T 1bf4668eeb70467fb3dc5a0289233b3c P ccd8a4c3bfe3413cb2ae219b09aea832 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:45.298305 12334 leader_election.cc:290] T a3022224cc81473690653a83d4e99470 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 17 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:20:45.301617 12246 raft_consensus.cc:2749] T 7ba5dac66ab5497e9e336f2a3c28cda5 P b7ab4784c7344b939bc36f639286f377 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:20:45.212415  6798 raft_consensus.cc:2393] T d8cee0accdb8499c86d4414b72565a38 P b7ab4784c7344b939bc36f639286f377 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c in current term 15: Already voted for candidate b7ab4784c7344b939bc36f639286f377 in this term.
I20260709 13:20:45.145085 12247 raft_consensus.cc:515] T 404190ce4ce94cecbfcb6ea9d1dd8626 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
W20260709 13:20:45.312973  6697 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 202031us
I20260709 13:20:45.314319 12368 raft_consensus.cc:2749] T e31b9971c15848dea59d4d4130141d9e P ccd8a4c3bfe3413cb2ae219b09aea832 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:20:45.317245 12247 leader_election.cc:290] T 404190ce4ce94cecbfcb6ea9d1dd8626 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:20:45.184638  6799 raft_consensus.cc:1240] T 4f00a2e87e56452083b759f60d461ee3 P b7ab4784c7344b939bc36f639286f377 [term 17 FOLLOWER]: Rejecting Update request from peer cd75a17ab2604397adab03bb8b5fd75c for earlier term 16. Current term is 17. Ops: [16.11-16.11]
I20260709 13:20:45.220260 12358 raft_consensus.cc:697] T 34f36d59d88f40fe8a2805e604fc6c0a P b7ab4784c7344b939bc36f639286f377 [term 14 LEADER]: Becoming Leader. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
I20260709 13:20:45.214813 11567 raft_consensus.cc:515] T 711ef6523deb4cbe8ef2ba61e1c21c98 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:45.320519 12358 consensus_queue.cc:237] T 34f36d59d88f40fe8a2805e604fc6c0a P b7ab4784c7344b939bc36f639286f377 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:45.322293 11567 leader_election.cc:290] T 711ef6523deb4cbe8ef2ba61e1c21c98 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 18 election: Requested vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:45.219712 12278 raft_consensus.cc:2749] T bd6869f07b5a4885a0b99fbe60c3b175 P b7ab4784c7344b939bc36f639286f377 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:20:45.302599 12271 raft_consensus.cc:3060] T 3fa34c08b205435dba97346991aa1f92 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:20:45.256735 12363 log.cc:927] Time spent T 4f00a2e87e56452083b759f60d461ee3 P 7ba59cc884714e8aa5f3f0ecaed84cbb: Append to log took a long time: real 0.147s	user 0.000s	sys 0.001s
W20260709 13:20:45.309926 12369 log.cc:927] Time spent T 95a75bfe094d4bdc963aba3f08dfcd25 P ccd8a4c3bfe3413cb2ae219b09aea832: Append to log took a long time: real 0.132s	user 0.001s	sys 0.000s
W20260709 13:20:45.305970 12362 log.cc:927] Time spent T f3f9c2e2bf644115957398fe4c9459db P cd75a17ab2604397adab03bb8b5fd75c: Append to log took a long time: real 0.337s	user 0.002s	sys 0.000s
I20260709 13:20:45.195091 12148 consensus_queue.cc:1048] T 853ac0a8cbd64ce99457f170216d4d0f P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.146s
W20260709 13:20:45.328224 12342 consensus_meta.cc:287] T 7a734b5ab7834e05a8c422208acc58b1 P b7ab4784c7344b939bc36f639286f377: Time spent flushing consensus metadata: real 0.521s	user 0.008s	sys 0.005s
I20260709 13:20:45.364620  6876 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53406 (request call id 2546) took 2635 ms. Trace:
I20260709 13:20:45.366211  6804 raft_consensus.cc:2468] T 7a734b5ab7834e05a8c422208acc58b1 P b7ab4784c7344b939bc36f639286f377 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 16.
I20260709 13:20:45.366801  6876 rpcz_store.cc:276] 0709 13:20:42.729378 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:43.959346 (+1229968us) service_pool.cc:224] Handling call
0709 13:20:43.959695 (+   349us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:43.960140 (+   445us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:20:43.960172 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:20:43.960711 (+   539us) log.cc:844] Serialized 26 byte log entry
0709 13:20:44.940799 (+980088us) spinlock_profiling.cc:243] Waited 19.8 ms on lock 0x7b18003ba5e0. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc15785de1 00007fcc157925b1 00007fcc0c89fe07 00007fcc156faab9 00007fcc0c8bc69b 00007fcc0c8ba93f 00007fcc0c8bcc02 00007fcc0f54420b 00007fcc0f549d23 00007fcc0f54a0d1 00007fcc0f965a0f
0709 13:20:45.155162 (+214363us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:20:45.155210 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:45.155302 (+    92us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:45.339305 (+184003us) raft_consensus.cc:1685] finished
0709 13:20:45.339335 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:45.364528 (+ 25193us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":143,"raft.run_cpu_time_us":237,"raft.run_wall_time_us":22259,"spinlock_wait_cycles":45541760,"thread_start_us":214135,"threads_started":1,"wal-append.queue_time_us":1365034}
I20260709 13:20:45.342787  6697 leader_election.cc:304] T dbdf895bba214ff68685a24fd17dfb5d P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:20:45.372058  6697 leader_election.cc:304] T d33d5ee8ef6f415593d8df52063161ad P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:20:45.334779 12377 raft_consensus.cc:493] T c4db81d9d329422bb3b4160ca4ac2d1d P cd75a17ab2604397adab03bb8b5fd75c [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:45.373430 12377 raft_consensus.cc:515] T c4db81d9d329422bb3b4160ca4ac2d1d P cd75a17ab2604397adab03bb8b5fd75c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:45.374460 12371 raft_consensus.cc:2749] T d33d5ee8ef6f415593d8df52063161ad P ccd8a4c3bfe3413cb2ae219b09aea832 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:20:45.374945  7469 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:45.380065  6772 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 204944us
W20260709 13:20:45.381001 12293 consensus_meta.cc:287] T f09c2a98de1a4decabd0ff900dd44caa P ccd8a4c3bfe3413cb2ae219b09aea832: Time spent flushing consensus metadata: real 0.693s	user 0.015s	sys 0.000s
I20260709 13:20:45.379845 12214 raft_consensus.cc:2749] T dbdf895bba214ff68685a24fd17dfb5d P ccd8a4c3bfe3413cb2ae219b09aea832 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:20:45.402519  6697 leader_election.cc:304] T 34f36d59d88f40fe8a2805e604fc6c0a P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377
I20260709 13:20:45.389282 12359 raft_consensus.cc:2804] T 7c37d41cd9164c15a6826ca62a851a69 P b7ab4784c7344b939bc36f639286f377 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:20:45.419798  6876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3411566abe2d4c9bb4b2adfdd05e6f17" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:20:45.421025  6876 raft_consensus.cc:2393] T 3411566abe2d4c9bb4b2adfdd05e6f17 P cd75a17ab2604397adab03bb8b5fd75c [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate ccd8a4c3bfe3413cb2ae219b09aea832 in current term 13: Already voted for candidate cd75a17ab2604397adab03bb8b5fd75c in this term.
I20260709 13:20:45.422986  6881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e326172347f45e99a0d482b5d8ef768" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:45.424696  6877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "427c124d773f483294511e80fe340075" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:45.402328 12293 raft_consensus.cc:515] T f09c2a98de1a4decabd0ff900dd44caa P ccd8a4c3bfe3413cb2ae219b09aea832 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:45.421011 11634 raft_consensus.cc:2764] T 34f36d59d88f40fe8a2805e604fc6c0a P ccd8a4c3bfe3413cb2ae219b09aea832 [term 14 FOLLOWER]: Leader pre-election decision vote started in defunct term 13: won
I20260709 13:20:45.428464 12293 leader_election.cc:290] T f09c2a98de1a4decabd0ff900dd44caa P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 17 election: Requested vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:45.428541 11951 raft_consensus.cc:515] T 9b3759de40694069b13c0f8bd40e5709 P b7ab4784c7344b939bc36f639286f377 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:45.431061 11951 leader_election.cc:290] T 9b3759de40694069b13c0f8bd40e5709 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 13 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
W20260709 13:20:45.428541 12325 log.cc:927] Time spent T f09c2a98de1a4decabd0ff900dd44caa P ccd8a4c3bfe3413cb2ae219b09aea832: Append to log took a long time: real 0.986s	user 0.000s	sys 0.003s
I20260709 13:20:45.420830 12377 leader_election.cc:290] T c4db81d9d329422bb3b4160ca4ac2d1d P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:20:45.435540  7494 raft_consensus.cc:2468] T 3fa34c08b205435dba97346991aa1f92 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 18.
I20260709 13:20:45.439581 12288 leader_election.cc:290] T 713b5728a197487c9300b310ab94e5a3 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:20:45.441402 12194 raft_consensus.cc:3055] T 7ba5dac66ab5497e9e336f2a3c28cda5 P cd75a17ab2604397adab03bb8b5fd75c [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:20:45.441828 12194 raft_consensus.cc:740] T 7ba5dac66ab5497e9e336f2a3c28cda5 P cd75a17ab2604397adab03bb8b5fd75c [term 15 LEADER]: Becoming Follower/Learner. State: Replica: cd75a17ab2604397adab03bb8b5fd75c, State: Running, Role: LEADER
I20260709 13:20:45.445430  6876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24ee15416e3145beaa1b8183453729a3" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:20:45.445890  6881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bf4668eeb70467fb3dc5a0289233b3c" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:45.446518  6877 raft_consensus.cc:1240] T 7c37d41cd9164c15a6826ca62a851a69 P cd75a17ab2604397adab03bb8b5fd75c [term 15 FOLLOWER]: Rejecting Update request from peer ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 14. Current term is 15. Ops: []
I20260709 13:20:45.449432  7501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17587d6730594da4a56fa13a353232a1" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:20:45.450697  6877 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b56bf91d90824c959e21e0cee5ba1816"
dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
 from {username='slave'} at 127.0.0.1:53416
I20260709 13:20:45.451371  6877 raft_consensus.cc:493] T b56bf91d90824c959e21e0cee5ba1816 P cd75a17ab2604397adab03bb8b5fd75c [term 14 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:20:45.451726  6877 raft_consensus.cc:3060] T b56bf91d90824c959e21e0cee5ba1816 P cd75a17ab2604397adab03bb8b5fd75c [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:45.453130  6881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22ccee1b570c4ad3a57bd7aec085b1b4" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:20:45.453467  6880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4275cf08e63345f993bce8664eada830" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:45.453148  6874 raft_consensus.cc:1275] T 95a75bfe094d4bdc963aba3f08dfcd25 P cd75a17ab2604397adab03bb8b5fd75c [term 13 FOLLOWER]: Refusing update from remote peer ccd8a4c3bfe3413cb2ae219b09aea832: Log matching property violated. Preceding OpId in replica: term: 13 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 13:20:45.455111 12194 consensus_queue.cc:260] T 7ba5dac66ab5497e9e336f2a3c28cda5 P cd75a17ab2604397adab03bb8b5fd75c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:20:45.456269 12194 raft_consensus.cc:3060] T 7ba5dac66ab5497e9e336f2a3c28cda5 P cd75a17ab2604397adab03bb8b5fd75c [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:45.458372  7502 raft_consensus.cc:1240] T 7ba5dac66ab5497e9e336f2a3c28cda5 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 16 FOLLOWER]: Rejecting Update request from peer cd75a17ab2604397adab03bb8b5fd75c for earlier term 15. Current term is 16. Ops: []
W20260709 13:20:45.461908 12240 consensus_meta.cc:287] T f4b8bd455d5a47c18a1380839c6e0d61 P ccd8a4c3bfe3413cb2ae219b09aea832: Time spent flushing consensus metadata: real 0.584s	user 0.012s	sys 0.000s
I20260709 13:20:45.462492 12240 raft_consensus.cc:515] T f4b8bd455d5a47c18a1380839c6e0d61 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:45.466822  6880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b8cacb381b746da8d0049b0a83b41dd" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:20:45.467514  6880 raft_consensus.cc:3060] T 4b8cacb381b746da8d0049b0a83b41dd P cd75a17ab2604397adab03bb8b5fd75c [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:45.468886  6881 raft_consensus.cc:2368] T 22ccee1b570c4ad3a57bd7aec085b1b4 P cd75a17ab2604397adab03bb8b5fd75c [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 13. Current term is 14.
I20260709 13:20:45.466704  6874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1704639a875409b9959353527b3fd68" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:20:45.470089  6873 raft_consensus.cc:1275] T 20f6842e26174571996b8dea4151d4be P cd75a17ab2604397adab03bb8b5fd75c [term 17 FOLLOWER]: Refusing update from remote peer ccd8a4c3bfe3413cb2ae219b09aea832: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 13:20:45.468698  6697 leader_election.cc:304] T fe20b4b48823486ca3b9c648db6ce8aa P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:20:45.470942  6875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "711ef6523deb4cbe8ef2ba61e1c21c98" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:20:45.471391  6874 raft_consensus.cc:1275] T 3411566abe2d4c9bb4b2adfdd05e6f17 P cd75a17ab2604397adab03bb8b5fd75c [term 13 FOLLOWER]: Refusing update from remote peer ccd8a4c3bfe3413cb2ae219b09aea832: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:20:45.473546  7500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b8cacb381b746da8d0049b0a83b41dd" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb"
I20260709 13:20:45.474371  7500 raft_consensus.cc:3060] T 4b8cacb381b746da8d0049b0a83b41dd P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:45.471863  6877 raft_consensus.cc:515] T b56bf91d90824c959e21e0cee5ba1816 P cd75a17ab2604397adab03bb8b5fd75c [term 15 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:45.405194 12335 raft_consensus.cc:515] T 24ee15416e3145beaa1b8183453729a3 P cd75a17ab2604397adab03bb8b5fd75c [term 19 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:20:45.477696  6879 raft_consensus.cc:1275] T 3a485a995abc4807b6e511e45419f737 P cd75a17ab2604397adab03bb8b5fd75c [term 15 FOLLOWER]: Refusing update from remote peer ccd8a4c3bfe3413cb2ae219b09aea832: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:20:45.405483 12249 raft_consensus.cc:515] T bb3d8792045a4583ae2e965b1350a5b4 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:20:45.473034 12347 raft_consensus.cc:493] T 427c124d773f483294511e80fe340075 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 7ba59cc884714e8aa5f3f0ecaed84cbb)
W20260709 13:20:45.495419  6697 consensus_peers.cc:597] T 95a75bfe094d4bdc963aba3f08dfcd25 P ccd8a4c3bfe3413cb2ae219b09aea832 -> Peer 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071): Couldn't send request to peer 7ba59cc884714e8aa5f3f0ecaed84cbb. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 95a75bfe094d4bdc963aba3f08dfcd25. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:45.503836  6879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09c2a98de1a4decabd0ff900dd44caa" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:20:45.505445  6877 leader_election.cc:290] T b56bf91d90824c959e21e0cee5ba1816 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 15 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:20:45.435542 12271 consensus_queue.cc:1059] T bb7fa124c3bf4ef9ab65a407cb008441 P 7ba59cc884714e8aa5f3f0ecaed84cbb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: INVALID_TERM, Last received: 14.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.046s
I20260709 13:20:45.507431  6725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a734b5ab7834e05a8c422208acc58b1" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:45.508183  7495 raft_consensus.cc:1240] T bb3d8792045a4583ae2e965b1350a5b4 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 14 FOLLOWER]: Rejecting Update request from peer ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 13. Current term is 14. Ops: []
I20260709 13:20:45.507366  7501 raft_consensus.cc:1275] T 1528ab62b6fe4e3099d08f141afee116 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 13 FOLLOWER]: Refusing update from remote peer ccd8a4c3bfe3413cb2ae219b09aea832: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 10. (term mismatch)
I20260709 13:20:45.508708  6725 raft_consensus.cc:2393] T 7a734b5ab7834e05a8c422208acc58b1 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c in current term 16: Already voted for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in this term.
I20260709 13:20:45.509006  7501 pending_rounds.cc:85] T 1528ab62b6fe4e3099d08f141afee116 P 7ba59cc884714e8aa5f3f0ecaed84cbb: Aborting all ops after (but not including) 9
I20260709 13:20:45.509374  7501 pending_rounds.cc:107] T 1528ab62b6fe4e3099d08f141afee116 P 7ba59cc884714e8aa5f3f0ecaed84cbb: Aborting uncommitted NO_OP operation due to leader change: 12.10
I20260709 13:20:45.509117  6731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d65025eea89441290d85dd053810e31" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:45.509678  7501 raft_consensus.cc:2889] T 1528ab62b6fe4e3099d08f141afee116 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:20:45.513486  6725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f58dc08b12a2494bb9a1372837970ca2" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:20:45.513746  6697 leader_election.cc:304] T 9e326172347f45e99a0d482b5d8ef768 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:20:45.514693  6725 raft_consensus.cc:3060] T f58dc08b12a2494bb9a1372837970ca2 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:45.515568  6880 raft_consensus.cc:2468] T 4b8cacb381b746da8d0049b0a83b41dd P cd75a17ab2604397adab03bb8b5fd75c [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 16.
I20260709 13:20:45.511327 11994 raft_consensus.cc:493] T e77e330a82df4b43a745d57a68f6f057 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:20:45.517040 11994 raft_consensus.cc:515] T e77e330a82df4b43a745d57a68f6f057 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } }
I20260709 13:20:45.519208 11994 leader_election.cc:290] T e77e330a82df4b43a745d57a68f6f057 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:45.520345  6728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4b8bd455d5a47c18a1380839c6e0d61" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:45.526064 12297 raft_consensus.cc:3060] T 4f00a2e87e56452083b759f60d461ee3 P cd75a17ab2604397adab03bb8b5fd75c [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:45.529688  6728 raft_consensus.cc:2368] T f4b8bd455d5a47c18a1380839c6e0d61 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c for earlier term 15. Current term is 16.
I20260709 13:20:45.533208  7500 raft_consensus.cc:2468] T 4b8cacb381b746da8d0049b0a83b41dd P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 16.
I20260709 13:20:45.535082  6697 leader_election.cc:304] T 24ee15416e3145beaa1b8183453729a3 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:20:45.536646 12238 raft_consensus.cc:2749] T 9e326172347f45e99a0d482b5d8ef768 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:20:45.537751 12335 leader_election.cc:290] T 24ee15416e3145beaa1b8183453729a3 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 19 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
W20260709 13:20:45.538638  6770 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 321983us
I20260709 13:20:45.542243  6731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b8cacb381b746da8d0049b0a83b41dd" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:45.543053  6731 raft_consensus.cc:2393] T 4b8cacb381b746da8d0049b0a83b41dd P ccd8a4c3bfe3413cb2ae219b09aea832 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c in current term 16: Already voted for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in this term.
I20260709 13:20:45.482326 12370 raft_consensus.cc:2804] T fe20b4b48823486ca3b9c648db6ce8aa P ccd8a4c3bfe3413cb2ae219b09aea832 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:20:45.555735  7500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24ee15416e3145beaa1b8183453729a3" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb"
I20260709 13:20:45.557929 12238 raft_consensus.cc:2749] T 24ee15416e3145beaa1b8183453729a3 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:20:45.559355  6728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e326172347f45e99a0d482b5d8ef768" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:45.560382  6728 raft_consensus.cc:2468] T 9e326172347f45e99a0d482b5d8ef768 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 12.
I20260709 13:20:45.562068  6731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d33d5ee8ef6f415593d8df52063161ad" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:45.563210  6731 raft_consensus.cc:2393] T d33d5ee8ef6f415593d8df52063161ad P ccd8a4c3bfe3413cb2ae219b09aea832 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c in current term 13: Already voted for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in this term.
I20260709 13:20:45.564126 12267 raft_consensus.cc:493] T be1a92657f494cac8dd227d152f50151 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 16 FOLLOWER]: Starting pre-election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:20:45.565958 12246 raft_consensus.cc:2749] T 30e88460611e47b2ba16a46a30b5f416 P b7ab4784c7344b939bc36f639286f377 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:20:45.568997 12267 raft_consensus.cc:515] T be1a92657f494cac8dd227d152f50151 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:20:45.571593 12267 leader_election.cc:290] T be1a92657f494cac8dd227d152f50151 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
W20260709 13:20:45.572050  6846 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:45.572528  6727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77e330a82df4b43a745d57a68f6f057" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:45.574126 12359 raft_consensus.cc:697] T 7c37d41cd9164c15a6826ca62a851a69 P b7ab4784c7344b939bc36f639286f377 [term 15 LEADER]: Becoming Leader. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
I20260709 13:20:45.573969  6804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22ccee1b570c4ad3a57bd7aec085b1b4" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:20:45.574765  6727 raft_consensus.cc:2468] T e77e330a82df4b43a745d57a68f6f057 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 16.
I20260709 13:20:45.575752  6800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1704639a875409b9959353527b3fd68" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:20:45.575387 12359 consensus_queue.cc:237] T 7c37d41cd9164c15a6826ca62a851a69 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:45.573585  6801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17587d6730594da4a56fa13a353232a1" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:45.576396  6799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4275cf08e63345f993bce8664eada830" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:45.577296  6798 raft_consensus.cc:1217] T c4db81d9d329422bb3b4160ca4ac2d1d P b7ab4784c7344b939bc36f639286f377 [term 15 LEADER]: Deduplicated request from leader. Original: 12.7->[14.8-14.8]   Dedup: 14.8->[]
I20260709 13:20:45.577797  6798 raft_consensus.cc:1240] T c4db81d9d329422bb3b4160ca4ac2d1d P b7ab4784c7344b939bc36f639286f377 [term 15 LEADER]: Rejecting Update request from peer ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 14. Current term is 15. Ops: [14.8-14.8]
I20260709 13:20:45.580773  6805 raft_consensus.cc:1275] T 95a75bfe094d4bdc963aba3f08dfcd25 P b7ab4784c7344b939bc36f639286f377 [term 13 FOLLOWER]: Refusing update from remote peer ccd8a4c3bfe3413cb2ae219b09aea832: Log matching property violated. Preceding OpId in replica: term: 13 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 13:20:45.574004 12340 raft_consensus.cc:493] T 7c44c4849aa54f2b94d1f1bef9ed546f P b7ab4784c7344b939bc36f639286f377 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:45.581995 12340 raft_consensus.cc:515] T 7c44c4849aa54f2b94d1f1bef9ed546f P b7ab4784c7344b939bc36f639286f377 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:45.582650  6807 raft_consensus.cc:1275] T 3a485a995abc4807b6e511e45419f737 P b7ab4784c7344b939bc36f639286f377 [term 15 FOLLOWER]: Refusing update from remote peer ccd8a4c3bfe3413cb2ae219b09aea832: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 9. (term mismatch)
I20260709 13:20:45.583182  6807 pending_rounds.cc:85] T 3a485a995abc4807b6e511e45419f737 P b7ab4784c7344b939bc36f639286f377: Aborting all ops after (but not including) 8
I20260709 13:20:45.583463  6807 pending_rounds.cc:107] T 3a485a995abc4807b6e511e45419f737 P b7ab4784c7344b939bc36f639286f377: Aborting uncommitted NO_OP operation due to leader change: 14.9
I20260709 13:20:45.587556  6799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09c2a98de1a4decabd0ff900dd44caa" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
W20260709 13:20:45.591984 12382 log.cc:927] Time spent T dbdf895bba214ff68685a24fd17dfb5d P cd75a17ab2604397adab03bb8b5fd75c: Append to log took a long time: real 0.086s	user 0.000s	sys 0.000s
I20260709 13:20:45.593487  6877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b3759de40694069b13c0f8bd40e5709" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:20:45.594326  6877 raft_consensus.cc:3060] T 9b3759de40694069b13c0f8bd40e5709 P cd75a17ab2604397adab03bb8b5fd75c [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:20:45.595381  7466 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:45.596240  6880 raft_consensus.cc:1275] T e31b9971c15848dea59d4d4130141d9e P cd75a17ab2604397adab03bb8b5fd75c [term 13 FOLLOWER]: Refusing update from remote peer b7ab4784c7344b939bc36f639286f377: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:20:45.596479  6805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "711ef6523deb4cbe8ef2ba61e1c21c98" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:20:45.583761  6807 raft_consensus.cc:2889] T 3a485a995abc4807b6e511e45419f737 P b7ab4784c7344b939bc36f639286f377 [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:20:45.536692 12275 raft_consensus.cc:3055] T f4b8bd455d5a47c18a1380839c6e0d61 P b7ab4784c7344b939bc36f639286f377 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:20:45.607693  6801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1528ab62b6fe4e3099d08f141afee116" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:45.551065 12367 raft_consensus.cc:493] T b3f13b31a1f84f0d89d007eadd57924c P ccd8a4c3bfe3413cb2ae219b09aea832 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 7ba59cc884714e8aa5f3f0ecaed84cbb)
I20260709 13:20:45.615904  6801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "404190ce4ce94cecbfcb6ea9d1dd8626" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:45.607788  6731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f03d0dbf16864ca4bc1bb5e4c0334c0f" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 16 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:45.615983  6877 raft_consensus.cc:2468] T 9b3759de40694069b13c0f8bd40e5709 P cd75a17ab2604397adab03bb8b5fd75c [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 13.
I20260709 13:20:45.623917  6798 raft_consensus.cc:1275] T 3411566abe2d4c9bb4b2adfdd05e6f17 P b7ab4784c7344b939bc36f639286f377 [term 13 FOLLOWER]: Refusing update from remote peer ccd8a4c3bfe3413cb2ae219b09aea832: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:20:45.626176  6729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8292e16e5654be6bc408560cf256aaa" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:45.605258 12275 raft_consensus.cc:740] T f4b8bd455d5a47c18a1380839c6e0d61 P b7ab4784c7344b939bc36f639286f377 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
I20260709 13:20:45.607843  6697 leader_election.cc:400] T 22ccee1b570c4ad3a57bd7aec085b1b4 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 13 election: Vote denied by peer cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931) with higher term. Message: Invalid argument: T 22ccee1b570c4ad3a57bd7aec085b1b4 P cd75a17ab2604397adab03bb8b5fd75c [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 13. Current term is 14.
I20260709 13:20:45.648151  6697 leader_election.cc:403] T 22ccee1b570c4ad3a57bd7aec085b1b4 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 13 election: Cancelling election due to peer responding with higher term
I20260709 13:20:45.630460  6805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77e330a82df4b43a745d57a68f6f057" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
W20260709 13:20:45.631929  6770 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 83287.1us
W20260709 13:20:45.650290  6697 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 46977.3us
I20260709 13:20:45.567896 12370 raft_consensus.cc:697] T fe20b4b48823486ca3b9c648db6ce8aa P ccd8a4c3bfe3413cb2ae219b09aea832 [term 12 LEADER]: Becoming Leader. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
I20260709 13:20:45.634014  6728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbdf895bba214ff68685a24fd17dfb5d" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 15 candidate_status { last_received { term: 12 index: 5 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:45.528905 12347 raft_consensus.cc:515] T 427c124d773f483294511e80fe340075 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } attrs { replace: true } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:20:45.664106  6728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24ee15416e3145beaa1b8183453729a3" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:45.626573  6727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4275cf08e63345f993bce8664eada830" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:45.667647  6727 raft_consensus.cc:2468] T 4275cf08e63345f993bce8664eada830 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 13.
I20260709 13:20:45.669361  6728 raft_consensus.cc:2393] T 24ee15416e3145beaa1b8183453729a3 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c in current term 19: Already voted for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in this term.
I20260709 13:20:45.653777  6807 raft_consensus.cc:1275] T 4f00a2e87e56452083b759f60d461ee3 P b7ab4784c7344b939bc36f639286f377 [term 17 FOLLOWER]: Refusing update from remote peer 7ba59cc884714e8aa5f3f0ecaed84cbb: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 13:20:45.655196  6726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c7f33e544204fbaac4078e3e83bbf4e" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:45.661989  6724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b3759de40694069b13c0f8bd40e5709" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:20:45.661978  6844 leader_election.cc:304] T 3d65025eea89441290d85dd053810e31 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:20:45.671056  6724 raft_consensus.cc:3060] T 9b3759de40694069b13c0f8bd40e5709 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:45.672644  6844 leader_election.cc:304] T b56bf91d90824c959e21e0cee5ba1816 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:20:45.610775  7500 raft_consensus.cc:2468] T 24ee15416e3145beaa1b8183453729a3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 19.
I20260709 13:20:45.674964  6846 leader_election.cc:304] T 24ee15416e3145beaa1b8183453729a3 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
W20260709 13:20:45.642335  6772 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.68:45071, user_credentials={real_user=slave}} blocked reactor thread for 47916.8us
I20260709 13:20:45.681770  6724 raft_consensus.cc:2468] T 9b3759de40694069b13c0f8bd40e5709 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 13.
I20260709 13:20:45.631585 12194 raft_consensus.cc:493] T f09c2a98de1a4decabd0ff900dd44caa P cd75a17ab2604397adab03bb8b5fd75c [term 16 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:20:45.688820  6697 leader_election.cc:304] T 4b8cacb381b746da8d0049b0a83b41dd P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:20:45.624863 12011 consensus_queue.cc:1048] T 20f6842e26174571996b8dea4151d4be P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.039s
I20260709 13:20:45.610940 12293 consensus_queue.cc:1059] T 7c37d41cd9164c15a6826ca62a851a69 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: INVALID_TERM, Last received: 14.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.044s
I20260709 13:20:45.726233  6879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77e330a82df4b43a745d57a68f6f057" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:45.726979  6878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4b8bd455d5a47c18a1380839c6e0d61" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:20:45.733587  6727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c44c4849aa54f2b94d1f1bef9ed546f" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 18 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:45.736300  6728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "427c124d773f483294511e80fe340075" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:45.729501  6804 raft_consensus.cc:1240] T 7ba5dac66ab5497e9e336f2a3c28cda5 P b7ab4784c7344b939bc36f639286f377 [term 16 FOLLOWER]: Rejecting Update request from peer cd75a17ab2604397adab03bb8b5fd75c for earlier term 15. Current term is 16. Ops: []
I20260709 13:20:45.737653  6724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30e88460611e47b2ba16a46a30b5f416" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:45.738379  6805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3022224cc81473690653a83d4e99470" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:20:45.739464  6804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "713b5728a197487c9300b310ab94e5a3" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:45.693557  6729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3d8792045a4583ae2e965b1350a5b4" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:45.740527  6804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b56bf91d90824c959e21e0cee5ba1816" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: true dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:20:45.730379  6730 raft_consensus.cc:1275] T e31b9971c15848dea59d4d4130141d9e P ccd8a4c3bfe3413cb2ae219b09aea832 [term 13 FOLLOWER]: Refusing update from remote peer b7ab4784c7344b939bc36f639286f377: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:20:45.741050  6804 raft_consensus.cc:3060] T b56bf91d90824c959e21e0cee5ba1816 P b7ab4784c7344b939bc36f639286f377 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:45.686405  6844 leader_election.cc:304] T 427c124d773f483294511e80fe340075 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, b7ab4784c7344b939bc36f639286f377
W20260709 13:20:45.742162  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 55829.2us
I20260709 13:20:45.743007  6844 leader_election.cc:304] T d33d5ee8ef6f415593d8df52063161ad P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:20:45.687145  6800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be1a92657f494cac8dd227d152f50151" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:45.651753 12240 leader_election.cc:290] T f4b8bd455d5a47c18a1380839c6e0d61 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 16 election: Requested vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:45.695797  6801 raft_consensus.cc:1275] T 7c44c4849aa54f2b94d1f1bef9ed546f P b7ab4784c7344b939bc36f639286f377 [term 17 FOLLOWER]: Refusing update from remote peer ccd8a4c3bfe3413cb2ae219b09aea832: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 13:20:45.692940  6798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4b8bd455d5a47c18a1380839c6e0d61" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:20:45.611130 11634 consensus_queue.cc:1048] T 95a75bfe094d4bdc963aba3f08dfcd25 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.039s
I20260709 13:20:45.743842  6844 leader_election.cc:304] T e31b9971c15848dea59d4d4130141d9e P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:20:45.750619  6844 leader_election.cc:304] T f58dc08b12a2494bb9a1372837970ca2 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:20:45.751147 12086 raft_consensus.cc:2749] T e31b9971c15848dea59d4d4130141d9e P cd75a17ab2604397adab03bb8b5fd75c [term 13 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:20:45.745465  6728 raft_consensus.cc:2468] T 427c124d773f483294511e80fe340075 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 14.
I20260709 13:20:45.751947 12086 raft_consensus.cc:2804] T f58dc08b12a2494bb9a1372837970ca2 P cd75a17ab2604397adab03bb8b5fd75c [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:20:45.709141  6695 leader_election.cc:304] T a1704639a875409b9959353527b3fd68 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:20:45.753415  6802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4db81d9d329422bb3b4160ca4ac2d1d" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 16 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:45.655614 12373 raft_consensus.cc:2749] T 22ccee1b570c4ad3a57bd7aec085b1b4 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 14 FOLLOWER]: Leader election lost for term 13. Reason: Vote denied by peer cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931) with higher term. Message: Invalid argument: T 22ccee1b570c4ad3a57bd7aec085b1b4 P cd75a17ab2604397adab03bb8b5fd75c [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 13. Current term is 14.
I20260709 13:20:45.724910 12335 raft_consensus.cc:2804] T 3d65025eea89441290d85dd053810e31 P cd75a17ab2604397adab03bb8b5fd75c [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:20:45.752558 12086 raft_consensus.cc:697] T f58dc08b12a2494bb9a1372837970ca2 P cd75a17ab2604397adab03bb8b5fd75c [term 17 LEADER]: Becoming Leader. State: Replica: cd75a17ab2604397adab03bb8b5fd75c, State: Running, Role: LEADER
I20260709 13:20:45.728595 12377 raft_consensus.cc:2804] T 24ee15416e3145beaa1b8183453729a3 P cd75a17ab2604397adab03bb8b5fd75c [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:20:45.734738 12238 raft_consensus.cc:2804] T 4b8cacb381b746da8d0049b0a83b41dd P ccd8a4c3bfe3413cb2ae219b09aea832 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:20:45.767387  6730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a75bfe094d4bdc963aba3f08dfcd25" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:45.783600  6804 raft_consensus.cc:2468] T b56bf91d90824c959e21e0cee5ba1816 P b7ab4784c7344b939bc36f639286f377 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 15.
I20260709 13:20:45.725180 12334 raft_consensus.cc:2749] T b56bf91d90824c959e21e0cee5ba1816 P cd75a17ab2604397adab03bb8b5fd75c [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:20:45.774148  6807 raft_consensus.cc:1275] T f3f9c2e2bf644115957398fe4c9459db P b7ab4784c7344b939bc36f639286f377 [term 15 FOLLOWER]: Refusing update from remote peer cd75a17ab2604397adab03bb8b5fd75c: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:20:45.687744 11994 consensus_queue.cc:1048] T 3411566abe2d4c9bb4b2adfdd05e6f17 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.075s
I20260709 13:20:45.756546 12306 raft_consensus.cc:2804] T d33d5ee8ef6f415593d8df52063161ad P cd75a17ab2604397adab03bb8b5fd75c [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:20:45.754956 12288 raft_consensus.cc:2749] T 427c124d773f483294511e80fe340075 P cd75a17ab2604397adab03bb8b5fd75c [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:20:45.830034  6695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 121007us
I20260709 13:20:45.830878  6695 leader_election.cc:304] T 17587d6730594da4a56fa13a353232a1 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, b7ab4784c7344b939bc36f639286f377
I20260709 13:20:45.746771 12246 consensus_queue.cc:1048] T e31b9971c15848dea59d4d4130141d9e P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.051s
I20260709 13:20:45.746090 12201 consensus_queue.cc:1048] T 1528ab62b6fe4e3099d08f141afee116 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.051s
I20260709 13:20:45.693269 11567 consensus_queue.cc:1048] T 3a485a995abc4807b6e511e45419f737 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.079s
I20260709 13:20:45.840004  6732 raft_consensus.cc:3055] T c4db81d9d329422bb3b4160ca4ac2d1d P ccd8a4c3bfe3413cb2ae219b09aea832 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:20:45.842396  6732 raft_consensus.cc:740] T c4db81d9d329422bb3b4160ca4ac2d1d P ccd8a4c3bfe3413cb2ae219b09aea832 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
I20260709 13:20:45.843158  6732 consensus_queue.cc:260] T c4db81d9d329422bb3b4160ca4ac2d1d P ccd8a4c3bfe3413cb2ae219b09aea832 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:45.844341  6732 raft_consensus.cc:3060] T c4db81d9d329422bb3b4160ca4ac2d1d P ccd8a4c3bfe3413cb2ae219b09aea832 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:45.801555  6729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fa34c08b205435dba97346991aa1f92" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
W20260709 13:20:45.848258 12366 log.cc:927] Time spent T f03d0dbf16864ca4bc1bb5e4c0334c0f P ccd8a4c3bfe3413cb2ae219b09aea832: Append to log took a long time: real 0.875s	user 0.004s	sys 0.000s
I20260709 13:20:45.848773  6729 raft_consensus.cc:2393] T 3fa34c08b205435dba97346991aa1f92 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c in current term 18: Already voted for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in this term.
I20260709 13:20:45.849673  6729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3d8792045a4583ae2e965b1350a5b4" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
W20260709 13:20:45.850028 12387 log.cc:927] Time spent T f03d0dbf16864ca4bc1bb5e4c0334c0f P cd75a17ab2604397adab03bb8b5fd75c: Append to log took a long time: real 0.292s	user 0.001s	sys 0.001s
I20260709 13:20:45.850684  6729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3d8792045a4583ae2e965b1350a5b4" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:20:45.655970 12367 raft_consensus.cc:515] T b3f13b31a1f84f0d89d007eadd57924c P ccd8a4c3bfe3413cb2ae219b09aea832 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:20:45.853633 12367 leader_election.cc:290] T b3f13b31a1f84f0d89d007eadd57924c P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:20:45.807664 12265 raft_consensus.cc:3055] T bb7fa124c3bf4ef9ab65a407cb008441 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:20:45.854178 12265 raft_consensus.cc:740] T bb7fa124c3bf4ef9ab65a407cb008441 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 7ba59cc884714e8aa5f3f0ecaed84cbb, State: Running, Role: LEADER
I20260709 13:20:45.855130 12265 consensus_queue.cc:260] T bb7fa124c3bf4ef9ab65a407cb008441 P 7ba59cc884714e8aa5f3f0ecaed84cbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
W20260709 13:20:45.856869  6846 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:45.809863 12391 log.cc:927] Time spent T 7c37d41cd9164c15a6826ca62a851a69 P b7ab4784c7344b939bc36f639286f377: Append to log took a long time: real 0.075s	user 0.000s	sys 0.000s
I20260709 13:20:45.810266  6727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a92dd554674067a83a9cb68c4773f2" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:45.858433 12288 raft_consensus.cc:493] T 3411566abe2d4c9bb4b2adfdd05e6f17 P cd75a17ab2604397adab03bb8b5fd75c [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:45.810686 12086 consensus_queue.cc:237] T f58dc08b12a2494bb9a1372837970ca2 P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:45.812711  7494 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50756 (request call id 403) took 1083 ms. Trace:
I20260709 13:20:45.817982 12293 raft_consensus.cc:3055] T 7c37d41cd9164c15a6826ca62a851a69 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:20:45.880563  7494 rpcz_store.cc:276] 0709 13:20:44.729750 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:44.747322 (+ 17572us) service_pool.cc:224] Handling call
0709 13:20:45.812506 (+1065184us) spinlock_profiling.cc:243] Waited 575 ms on lock 0x7b54001ec8d4. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f9ae2fa 00007fcc1496fb17 00007fcc0deea6d4 00007fcc0deea662 00007fcc0deea591 00007fcc0deea50c 00007fcc0dee97c2 00007fcc0dce548c 00007fcc0dce48c6 00007fcc0dce426f
0709 13:20:45.812633 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1321728768}
I20260709 13:20:45.804327 12370 consensus_queue.cc:237] T fe20b4b48823486ca3b9c648db6ce8aa P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:20:45.732328 12194 raft_consensus.cc:515] T f09c2a98de1a4decabd0ff900dd44caa P cd75a17ab2604397adab03bb8b5fd75c [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:45.794349 11937 raft_consensus.cc:493] T fe20b4b48823486ca3b9c648db6ce8aa P cd75a17ab2604397adab03bb8b5fd75c [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:45.763506 12340 leader_election.cc:290] T 7c44c4849aa54f2b94d1f1bef9ed546f P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:45.797268 12377 raft_consensus.cc:697] T 24ee15416e3145beaa1b8183453729a3 P cd75a17ab2604397adab03bb8b5fd75c [term 19 LEADER]: Becoming Leader. State: Replica: cd75a17ab2604397adab03bb8b5fd75c, State: Running, Role: LEADER
I20260709 13:20:45.884565 11937 raft_consensus.cc:515] T fe20b4b48823486ca3b9c648db6ce8aa P cd75a17ab2604397adab03bb8b5fd75c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:20:45.885507 12377 consensus_queue.cc:237] T 24ee15416e3145beaa1b8183453729a3 P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:20:45.763935 12335 raft_consensus.cc:493] T 3d65025eea89441290d85dd053810e31 P cd75a17ab2604397adab03bb8b5fd75c [term 15 FOLLOWER]: Starting leader election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:20:45.888468 12335 raft_consensus.cc:3060] T 3d65025eea89441290d85dd053810e31 P cd75a17ab2604397adab03bb8b5fd75c [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:45.889047 11937 leader_election.cc:290] T fe20b4b48823486ca3b9c648db6ce8aa P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:20:45.890125 12288 raft_consensus.cc:515] T 3411566abe2d4c9bb4b2adfdd05e6f17 P cd75a17ab2604397adab03bb8b5fd75c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:45.892318 12288 leader_election.cc:290] T 3411566abe2d4c9bb4b2adfdd05e6f17 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:20:45.824443  6730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3022224cc81473690653a83d4e99470" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:20:45.825695  6726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "713b5728a197487c9300b310ab94e5a3" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:45.832773 12240 raft_consensus.cc:2749] T a1704639a875409b9959353527b3fd68 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
W20260709 13:20:45.904059  6695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 73247.1us
I20260709 13:20:45.904892  6695 leader_election.cc:304] T 4275cf08e63345f993bce8664eada830 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:20:45.838490 12347 leader_election.cc:290] T 427c124d773f483294511e80fe340075 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:20:45.803185 12249 leader_election.cc:290] T bb3d8792045a4583ae2e965b1350a5b4 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 14 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:45.827770 12306 raft_consensus.cc:493] T d33d5ee8ef6f415593d8df52063161ad P cd75a17ab2604397adab03bb8b5fd75c [term 12 FOLLOWER]: Starting leader election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
W20260709 13:20:45.894870 12251 consensus_meta.cc:287] T 1bf4668eeb70467fb3dc5a0289233b3c P ccd8a4c3bfe3413cb2ae219b09aea832: Time spent flushing consensus metadata: real 0.599s	user 0.013s	sys 0.002s
I20260709 13:20:45.747195 12247 consensus_queue.cc:1048] T 4f00a2e87e56452083b759f60d461ee3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 9, Time since last communication: 0.050s
W20260709 13:20:45.934190  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 183617us
I20260709 13:20:45.865392  6727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b56bf91d90824c959e21e0cee5ba1816" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: true dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:20:45.936430  6727 raft_consensus.cc:3055] T b56bf91d90824c959e21e0cee5ba1816 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 14 LEADER]: Stepping down as leader of term 14
W20260709 13:20:45.873718 12383 log.cc:927] Time spent T 2c240553ce044eedb41541d72b9475d7 P ccd8a4c3bfe3413cb2ae219b09aea832: Append to log took a long time: real 0.348s	user 0.000s	sys 0.002s
I20260709 13:20:45.878830 12238 raft_consensus.cc:697] T 4b8cacb381b746da8d0049b0a83b41dd P ccd8a4c3bfe3413cb2ae219b09aea832 [term 16 LEADER]: Becoming Leader. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
I20260709 13:20:45.881095 12293 raft_consensus.cc:740] T 7c37d41cd9164c15a6826ca62a851a69 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
I20260709 13:20:45.908527 12218 raft_consensus.cc:2749] T 17587d6730594da4a56fa13a353232a1 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 13:20:45.908263  6772 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 231447us
W20260709 13:20:45.909358  6697 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.68:45071, user_credentials={real_user=slave}} blocked reactor thread for 183951us
I20260709 13:20:45.870836 12275 consensus_queue.cc:260] T f4b8bd455d5a47c18a1380839c6e0d61 P b7ab4784c7344b939bc36f639286f377 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.7, Last appended by leader: 7, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:45.919610  6730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be1a92657f494cac8dd227d152f50151" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:45.936932  6844 leader_election.cc:304] T bb7fa124c3bf4ef9ab65a407cb008441 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, b7ab4784c7344b939bc36f639286f377
I20260709 13:20:45.938951  6727 raft_consensus.cc:740] T b56bf91d90824c959e21e0cee5ba1816 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
I20260709 13:20:45.918910 12306 raft_consensus.cc:3060] T d33d5ee8ef6f415593d8df52063161ad P cd75a17ab2604397adab03bb8b5fd75c [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:45.832712  6725 raft_consensus.cc:2468] T f58dc08b12a2494bb9a1372837970ca2 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 17.
W20260709 13:20:45.951995  6770 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 211908us
I20260709 13:20:45.884583 12194 leader_election.cc:290] T f09c2a98de1a4decabd0ff900dd44caa P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:20:45.954682  6726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1528ab62b6fe4e3099d08f141afee116" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:45.941845  6695 leader_election.cc:304] T f09c2a98de1a4decabd0ff900dd44caa P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:20:45.953445 12265 raft_consensus.cc:3060] T bb7fa124c3bf4ef9ab65a407cb008441 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:46.015340  6872 raft_consensus.cc:1275] T 4f00a2e87e56452083b759f60d461ee3 P cd75a17ab2604397adab03bb8b5fd75c [term 17 FOLLOWER]: Refusing update from remote peer 7ba59cc884714e8aa5f3f0ecaed84cbb: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 13:20:45.974746  6724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4db81d9d329422bb3b4160ca4ac2d1d" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 16 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:46.010612  7494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe20b4b48823486ca3b9c648db6ce8aa" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:20:45.901055  6846 leader_election.cc:304] T 3fa34c08b205435dba97346991aa1f92 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
W20260709 13:20:46.023559  6846 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.68:45071, user_credentials={real_user=slave}} blocked reactor thread for 122556us
W20260709 13:20:45.995005  7466 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:45.932730 11567 raft_consensus.cc:2749] T 4275cf08e63345f993bce8664eada830 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:20:46.024974  7466 leader_election.cc:304] T be1a92657f494cac8dd227d152f50151 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:20:45.851734  6729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "404190ce4ce94cecbfcb6ea9d1dd8626" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
W20260709 13:20:46.026576  6846 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:46.007787  6732 raft_consensus.cc:1275] T c4db81d9d329422bb3b4160ca4ac2d1d P ccd8a4c3bfe3413cb2ae219b09aea832 [term 15 FOLLOWER]: Refusing update from remote peer b7ab4784c7344b939bc36f639286f377: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:20:46.027801  6732 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50004 (request call id 2551) took 1079 ms. Trace:
W20260709 13:20:46.011749  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 74939.6us
I20260709 13:20:46.030457  6844 leader_election.cc:304] T 7887766dc6784fcaa42b35c05fea7a99 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:20:46.009404  6772 leader_election.cc:304] T 9b3759de40694069b13c0f8bd40e5709 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:20:46.012856  6725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24ee15416e3145beaa1b8183453729a3" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:20:46.024082  6724 raft_consensus.cc:1240] T 711ef6523deb4cbe8ef2ba61e1c21c98 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 18 FOLLOWER]: Rejecting Update request from peer cd75a17ab2604397adab03bb8b5fd75c for earlier term 17. Current term is 18. Ops: []
I20260709 13:20:46.033424  6725 raft_consensus.cc:2393] T 24ee15416e3145beaa1b8183453729a3 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c in current term 19: Already voted for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in this term.
W20260709 13:20:46.025306  6695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 83745us
I20260709 13:20:46.028368  6732 rpcz_store.cc:276] 0709 13:20:44.948316 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:44.952658 (+  4342us) service_pool.cc:224] Handling call
0709 13:20:44.952978 (+   320us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:45.839913 (+886935us) spinlock_profiling.cc:243] Waited 2.28 ms on lock 0x7b5400287420. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f921dc0 00007fcc0f9ac1c0 00007fcc0f9ad231 00007fcc0f9a9d8f 00007fcc0f9a983e 00007fcc1496e419 00007fcc0dee5bd4 00007fcc0dee5b62 00007fcc0dee5a91 00007fcc0dee5a0c
0709 13:20:46.027346 (+187433us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:46.027708 (+   362us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5252864}
I20260709 13:20:46.035835  6725 raft_consensus.cc:1240] T 3fa34c08b205435dba97346991aa1f92 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 18 FOLLOWER]: Rejecting Update request from peer 7ba59cc884714e8aa5f3f0ecaed84cbb for earlier term 17. Current term is 18. Ops: []
I20260709 13:20:46.037623  6725 raft_consensus.cc:1240] T a1704639a875409b9959353527b3fd68 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 16 FOLLOWER]: Rejecting Update request from peer b7ab4784c7344b939bc36f639286f377 for earlier term 15. Current term is 16. Ops: []
I20260709 13:20:46.048060  7466 leader_election.cc:304] T 1528ab62b6fe4e3099d08f141afee116 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:20:45.935148 12240 consensus_queue.cc:1048] T 95a75bfe094d4bdc963aba3f08dfcd25 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.087s
I20260709 13:20:46.014436 11937 raft_consensus.cc:2749] T bb7fa124c3bf4ef9ab65a407cb008441 P cd75a17ab2604397adab03bb8b5fd75c [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:20:46.021485 12275 raft_consensus.cc:3060] T f4b8bd455d5a47c18a1380839c6e0d61 P b7ab4784c7344b939bc36f639286f377 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:20:46.014529 12372 log.cc:927] Time spent T 1528ab62b6fe4e3099d08f141afee116 P b7ab4784c7344b939bc36f639286f377: Append to log took a long time: real 0.083s	user 0.001s	sys 0.000s
I20260709 13:20:46.050215  6730 raft_consensus.cc:1275] T f3f9c2e2bf644115957398fe4c9459db P ccd8a4c3bfe3413cb2ae219b09aea832 [term 15 FOLLOWER]: Refusing update from remote peer cd75a17ab2604397adab03bb8b5fd75c: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:20:46.050289  6844 leader_election.cc:304] T d8cee0accdb8499c86d4414b72565a38 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, b7ab4784c7344b939bc36f639286f377
I20260709 13:20:46.063599  7502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3f13b31a1f84f0d89d007eadd57924c" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:20:46.048399  7494 raft_consensus.cc:2468] T fe20b4b48823486ca3b9c648db6ce8aa P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 12.
I20260709 13:20:46.055783 12218 raft_consensus.cc:2749] T f09c2a98de1a4decabd0ff900dd44caa P ccd8a4c3bfe3413cb2ae219b09aea832 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:20:46.053305 12297 raft_consensus.cc:2749] T 7887766dc6784fcaa42b35c05fea7a99 P cd75a17ab2604397adab03bb8b5fd75c [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:20:46.052615 12209 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 15 current term: 15 is higher.
I20260709 13:20:46.053766 12342 raft_consensus.cc:2804] T 9b3759de40694069b13c0f8bd40e5709 P b7ab4784c7344b939bc36f639286f377 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:20:45.933362 12251 raft_consensus.cc:515] T 1bf4668eeb70467fb3dc5a0289233b3c P ccd8a4c3bfe3413cb2ae219b09aea832 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:46.081135  6844 leader_election.cc:304] T 7a734b5ab7834e05a8c422208acc58b1 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:20:46.082240  7495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "427c124d773f483294511e80fe340075" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:20:46.048825 12288 raft_consensus.cc:2804] T 3fa34c08b205435dba97346991aa1f92 P cd75a17ab2604397adab03bb8b5fd75c [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:20:46.045643 12373 consensus_queue.cc:1059] T bb3d8792045a4583ae2e965b1350a5b4 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false }, Status: INVALID_TERM, Last received: 13.12, Next index: 13, Last known committed idx: 10, Time since last communication: 0.059s
I20260709 13:20:46.083561 12297 raft_consensus.cc:3060] T d8cee0accdb8499c86d4414b72565a38 P cd75a17ab2604397adab03bb8b5fd75c [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:46.059161 12293 consensus_queue.cc:260] T 7c37d41cd9164c15a6826ca62a851a69 P ccd8a4c3bfe3413cb2ae219b09aea832 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:46.090094 12342 raft_consensus.cc:697] T 9b3759de40694069b13c0f8bd40e5709 P b7ab4784c7344b939bc36f639286f377 [term 13 LEADER]: Becoming Leader. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
I20260709 13:20:46.090049 12238 consensus_queue.cc:237] T 4b8cacb381b746da8d0049b0a83b41dd P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:20:46.054358 12271 raft_consensus.cc:2749] T 1528ab62b6fe4e3099d08f141afee116 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:20:46.099897  6846 leader_election.cc:304] T fe20b4b48823486ca3b9c648db6ce8aa P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:20:46.103065  7466 leader_election.cc:304] T 404190ce4ce94cecbfcb6ea9d1dd8626 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:20:46.107172  6723 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50004 (request call id 2556) took 1075 ms. Trace:
I20260709 13:20:46.127439  6723 rpcz_store.cc:276] 0709 13:20:45.032120 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:45.032264 (+   144us) service_pool.cc:224] Handling call
0709 13:20:45.032660 (+   396us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:20:45.044267 (+ 11607us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:45.044297 (+    30us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:20:45.058295 (+ 13998us) log.cc:844] Serialized 52 byte log entry
0709 13:20:45.100868 (+ 42573us) spinlock_profiling.cc:243] Waited 6.02 ms on lock 0x7b48003300d8. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc148d3aa1 00007fcc148cab37 00007fcc148ca9ca 00007fcc149c226f 00007fcc149c1f37 00007fcc149d655c 00007fcc149d6508 00007fcc149d6488 00007fcc149d6443 00007fcc149d56ec 00007fcc138ffa96
0709 13:20:45.422909 (+322041us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:20:45.422962 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:45.423061 (+    99us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:45.873025 (+449964us) spinlock_profiling.cc:243] Waited 9.15 ms on lock 0x7b4400022b4c. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0c745db1 00007fcc0c7e3c85 00007fcc0c7e46a2 00007fcc0f5561db 00007fcc0f551aaf 00007fcc0f54586e 00007fcc0f544bb6 00007fcc0f5447d8 00007fcc0f54e221 00007fcc0f54e1d9 00007fcc0f54e169
0709 13:20:46.106731 (+233706us) raft_consensus.cc:1685] finished
0709 13:20:46.106774 (+    43us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:46.107075 (+   301us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":86708,"raft.queue_time_us":144,"raft.run_cpu_time_us":2688,"raft.run_wall_time_us":62194,"spinlock_wait_cycles":34885248,"thread_start_us":290282,"threads_started":1,"wal-append.queue_time_us":407968}
I20260709 13:20:46.130515  6723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3411566abe2d4c9bb4b2adfdd05e6f17" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:46.118330  6844 leader_election.cc:400] T f4b8bd455d5a47c18a1380839c6e0d61 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 15 pre-election: Vote denied by peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391) with higher term. Message: Invalid argument: T f4b8bd455d5a47c18a1380839c6e0d61 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c for earlier term 15. Current term is 16.
I20260709 13:20:46.118616  6873 raft_consensus.cc:1275] T c4db81d9d329422bb3b4160ca4ac2d1d P cd75a17ab2604397adab03bb8b5fd75c [term 15 FOLLOWER]: Refusing update from remote peer b7ab4784c7344b939bc36f639286f377: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:20:46.134055  6873 raft_consensus.cc:1240] T a3022224cc81473690653a83d4e99470 P cd75a17ab2604397adab03bb8b5fd75c [term 17 FOLLOWER]: Rejecting Update request from peer b7ab4784c7344b939bc36f639286f377 for earlier term 16. Current term is 17. Ops: []
I20260709 13:20:46.142328  6844 leader_election.cc:403] T f4b8bd455d5a47c18a1380839c6e0d61 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 15 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:20:46.084991 12247 raft_consensus.cc:493] T d8cee0accdb8499c86d4414b72565a38 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:46.110611  6725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe20b4b48823486ca3b9c648db6ce8aa" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:46.144248  6873 raft_consensus.cc:1275] T 853ac0a8cbd64ce99457f170216d4d0f P cd75a17ab2604397adab03bb8b5fd75c [term 14 FOLLOWER]: Refusing update from remote peer b7ab4784c7344b939bc36f639286f377: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:20:46.152278  6729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09c2a98de1a4decabd0ff900dd44caa" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
W20260709 13:20:46.147581  7466 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 44638.1us
I20260709 13:20:46.092502 12288 raft_consensus.cc:493] T 3fa34c08b205435dba97346991aa1f92 P cd75a17ab2604397adab03bb8b5fd75c [term 17 FOLLOWER]: Starting leader election (detected failure of leader 7ba59cc884714e8aa5f3f0ecaed84cbb)
I20260709 13:20:46.159065  6729 raft_consensus.cc:2393] T f09c2a98de1a4decabd0ff900dd44caa P ccd8a4c3bfe3413cb2ae219b09aea832 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c in current term 17: Already voted for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in this term.
I20260709 13:20:46.121307 12194 raft_consensus.cc:2764] T 7a734b5ab7834e05a8c422208acc58b1 P cd75a17ab2604397adab03bb8b5fd75c [term 16 FOLLOWER]: Leader pre-election decision vote started in defunct term 15: won
I20260709 13:20:46.123286 12102 raft_consensus.cc:493] T 3411566abe2d4c9bb4b2adfdd05e6f17 P b7ab4784c7344b939bc36f639286f377 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:46.123386 12334 raft_consensus.cc:493] T ab432e62819d499eaaf3dd55481dd930 P cd75a17ab2604397adab03bb8b5fd75c [term 17 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:20:46.155228 12345 raft_consensus.cc:2749] T 404190ce4ce94cecbfcb6ea9d1dd8626 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:20:46.288803  6771 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:46.207159  7469 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:46.179991 12288 raft_consensus.cc:3060] T 3fa34c08b205435dba97346991aa1f92 P cd75a17ab2604397adab03bb8b5fd75c [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:20:46.180706 12371 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.661s	user 0.028s	sys 0.022s
W20260709 13:20:46.194253 12374 log.cc:927] Time spent T 17587d6730594da4a56fa13a353232a1 P b7ab4784c7344b939bc36f639286f377: Append to log took a long time: real 0.070s	user 0.000s	sys 0.000s
W20260709 13:20:46.343832  7501 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.541s	user 0.022s	sys 0.051s
I20260709 13:20:46.183431 12398 raft_consensus.cc:493] T 3a485a995abc4807b6e511e45419f737 P b7ab4784c7344b939bc36f639286f377 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:20:46.390059  6846 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.68:45071, user_credentials={real_user=slave}} blocked reactor thread for 290267us
W20260709 13:20:46.333860 12376 log.cc:927] Time spent T 2c240553ce044eedb41541d72b9475d7 P cd75a17ab2604397adab03bb8b5fd75c: Append to log took a long time: real 0.177s	user 0.001s	sys 0.000s
W20260709 13:20:46.394765  7501 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.592s	user 0.023s	sys 0.051s
I20260709 13:20:46.182204 12335 raft_consensus.cc:515] T 3d65025eea89441290d85dd053810e31 P cd75a17ab2604397adab03bb8b5fd75c [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:46.156410 12247 raft_consensus.cc:515] T d8cee0accdb8499c86d4414b72565a38 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
W20260709 13:20:46.404320  6695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 369648us
W20260709 13:20:46.412444  6770 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 400222us
I20260709 13:20:46.194729 12397 raft_consensus.cc:493] T a1704639a875409b9959353527b3fd68 P cd75a17ab2604397adab03bb8b5fd75c [term 15 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:20:46.311816 12102 raft_consensus.cc:515] T 3411566abe2d4c9bb4b2adfdd05e6f17 P b7ab4784c7344b939bc36f639286f377 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:46.403407 12086 raft_consensus.cc:2804] T fe20b4b48823486ca3b9c648db6ce8aa P cd75a17ab2604397adab03bb8b5fd75c [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:20:46.431623 12086 raft_consensus.cc:493] T fe20b4b48823486ca3b9c648db6ce8aa P cd75a17ab2604397adab03bb8b5fd75c [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:46.432384 12086 raft_consensus.cc:3060] T fe20b4b48823486ca3b9c648db6ce8aa P cd75a17ab2604397adab03bb8b5fd75c [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:46.433749 11576 raft_consensus.cc:3060] T f4b8bd455d5a47c18a1380839c6e0d61 P cd75a17ab2604397adab03bb8b5fd75c [term 14 FOLLOWER]: Advancing to term 16
W20260709 13:20:46.395092 12371 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.871s	user 0.028s	sys 0.026s
I20260709 13:20:46.336524 12334 raft_consensus.cc:515] T ab432e62819d499eaaf3dd55481dd930 P cd75a17ab2604397adab03bb8b5fd75c [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:46.348899 11937 raft_consensus.cc:493] T 7a734b5ab7834e05a8c422208acc58b1 P cd75a17ab2604397adab03bb8b5fd75c [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:20:46.455619 12382 log.cc:927] Time spent T dbdf895bba214ff68685a24fd17dfb5d P cd75a17ab2604397adab03bb8b5fd75c: Append to log took a long time: real 0.059s	user 0.001s	sys 0.000s
I20260709 13:20:46.469811 12218 consensus_queue.cc:1048] T 3a485a995abc4807b6e511e45419f737 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.019s
I20260709 13:20:46.489012 12247 leader_election.cc:290] T d8cee0accdb8499c86d4414b72565a38 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:46.452234 12397 raft_consensus.cc:515] T a1704639a875409b9959353527b3fd68 P cd75a17ab2604397adab03bb8b5fd75c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:46.494789 12358 raft_consensus.cc:493] T 90d42e216d9741e190bca19a781291fd P b7ab4784c7344b939bc36f639286f377 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:46.462769 12090 raft_consensus.cc:493] T 20f6842e26174571996b8dea4151d4be P b7ab4784c7344b939bc36f639286f377 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:46.501947 12090 raft_consensus.cc:515] T 20f6842e26174571996b8dea4151d4be P b7ab4784c7344b939bc36f639286f377 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:46.390764 12342 consensus_queue.cc:237] T 9b3759de40694069b13c0f8bd40e5709 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:46.508560 12159 consensus_queue.cc:1048] T c4db81d9d329422bb3b4160ca4ac2d1d P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:20:46.509056 12278 consensus_queue.cc:1059] T a3022224cc81473690653a83d4e99470 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: INVALID_TERM, Last received: 16.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:20:46.509790 11870 consensus_queue.cc:1048] T 853ac0a8cbd64ce99457f170216d4d0f P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:20:46.510592 12159 raft_consensus.cc:3055] T a3022224cc81473690653a83d4e99470 P b7ab4784c7344b939bc36f639286f377 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:20:46.510994 12159 raft_consensus.cc:740] T a3022224cc81473690653a83d4e99470 P b7ab4784c7344b939bc36f639286f377 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
I20260709 13:20:46.513177 12367 raft_consensus.cc:3055] T bb3d8792045a4583ae2e965b1350a5b4 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:20:46.466923 12246 raft_consensus.cc:493] T d8cee0accdb8499c86d4414b72565a38 P b7ab4784c7344b939bc36f639286f377 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:46.513703 12367 raft_consensus.cc:740] T bb3d8792045a4583ae2e965b1350a5b4 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
I20260709 13:20:46.513935 12246 raft_consensus.cc:515] T d8cee0accdb8499c86d4414b72565a38 P b7ab4784c7344b939bc36f639286f377 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:20:46.514631 12367 consensus_queue.cc:260] T bb3d8792045a4583ae2e965b1350a5b4 P ccd8a4c3bfe3413cb2ae219b09aea832 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:20:46.517002  6878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "427c124d773f483294511e80fe340075" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:46.512681 12159 consensus_queue.cc:260] T a3022224cc81473690653a83d4e99470 P b7ab4784c7344b939bc36f639286f377 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:46.520478 12159 raft_consensus.cc:3060] T a3022224cc81473690653a83d4e99470 P b7ab4784c7344b939bc36f639286f377 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:46.522578  6799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8cee0accdb8499c86d4414b72565a38" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:46.523990  6799 raft_consensus.cc:2468] T d8cee0accdb8499c86d4414b72565a38 P b7ab4784c7344b939bc36f639286f377 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in term 15.
I20260709 13:20:46.524891 12102 leader_election.cc:290] T 3411566abe2d4c9bb4b2adfdd05e6f17 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:46.454396 11951 raft_consensus.cc:493] T bb7fa124c3bf4ef9ab65a407cb008441 P b7ab4784c7344b939bc36f639286f377 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 7ba59cc884714e8aa5f3f0ecaed84cbb)
I20260709 13:20:46.527881  7466 leader_election.cc:304] T d8cee0accdb8499c86d4414b72565a38 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, b7ab4784c7344b939bc36f639286f377; no voters: 
I20260709 13:20:46.442029 12340 consensus_queue.cc:1048] T e31b9971c15848dea59d4d4130141d9e P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.043s
I20260709 13:20:46.399763 12398 raft_consensus.cc:515] T 3a485a995abc4807b6e511e45419f737 P b7ab4784c7344b939bc36f639286f377 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:46.495641 12358 raft_consensus.cc:515] T 90d42e216d9741e190bca19a781291fd P b7ab4784c7344b939bc36f639286f377 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
W20260709 13:20:46.532320 12405 log.cc:927] Time spent T 2c240553ce044eedb41541d72b9475d7 P b7ab4784c7344b939bc36f639286f377: Append to log took a long time: real 0.069s	user 0.000s	sys 0.001s
I20260709 13:20:46.532267 12174 raft_consensus.cc:493] T 95a75bfe094d4bdc963aba3f08dfcd25 P b7ab4784c7344b939bc36f639286f377 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:20:46.538712 12267 raft_consensus.cc:2804] T d8cee0accdb8499c86d4414b72565a38 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:20:46.542585 12397 leader_election.cc:290] T a1704639a875409b9959353527b3fd68 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:20:46.581741 12251 leader_election.cc:290] T 1bf4668eeb70467fb3dc5a0289233b3c P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 16 election: Requested vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:46.580554 12090 leader_election.cc:290] T 20f6842e26174571996b8dea4151d4be P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:46.474985 11937 raft_consensus.cc:515] T 7a734b5ab7834e05a8c422208acc58b1 P cd75a17ab2604397adab03bb8b5fd75c [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } attrs { replace: true } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: NON_VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: true } }
I20260709 13:20:46.586462 12398 leader_election.cc:290] T 3a485a995abc4807b6e511e45419f737 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:46.583271 12267 raft_consensus.cc:493] T d8cee0accdb8499c86d4414b72565a38 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:46.588167 12358 leader_election.cc:290] T 90d42e216d9741e190bca19a781291fd P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:46.588315 12267 raft_consensus.cc:3060] T d8cee0accdb8499c86d4414b72565a38 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:46.589550 12334 leader_election.cc:290] T ab432e62819d499eaaf3dd55481dd930 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:20:46.535317 11951 raft_consensus.cc:515] T bb7fa124c3bf4ef9ab65a407cb008441 P b7ab4784c7344b939bc36f639286f377 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:20:46.591485 12335 leader_election.cc:290] T 3d65025eea89441290d85dd053810e31 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 16 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:20:46.591476 12297 raft_consensus.cc:2749] T d8cee0accdb8499c86d4414b72565a38 P cd75a17ab2604397adab03bb8b5fd75c [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:20:46.593384 11951 leader_election.cc:290] T bb7fa124c3bf4ef9ab65a407cb008441 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:20:46.544891 12187 raft_consensus.cc:493] T 8c7f33e544204fbaac4078e3e83bbf4e P b7ab4784c7344b939bc36f639286f377 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:20:46.597993 12246 leader_election.cc:290] T d8cee0accdb8499c86d4414b72565a38 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:20:46.584692 12174 raft_consensus.cc:515] T 95a75bfe094d4bdc963aba3f08dfcd25 P b7ab4784c7344b939bc36f639286f377 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:46.598973 12187 raft_consensus.cc:515] T 8c7f33e544204fbaac4078e3e83bbf4e P b7ab4784c7344b939bc36f639286f377 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:46.662910  6731 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50004 (request call id 2558) took 1003 ms. Trace:
I20260709 13:20:46.666960  6731 rpcz_store.cc:276] 0709 13:20:45.659618 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:45.660158 (+   540us) service_pool.cc:224] Handling call
0709 13:20:45.688122 (+ 27964us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:45.688613 (+   491us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:20:45.735504 (+ 46891us) log.cc:844] Serialized 14 byte log entry
0709 13:20:45.815993 (+ 80489us) spinlock_profiling.cc:243] Waited 4.27 ms on lock 0x7b18003f4840. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc15785de1 00007fcc157925b1 00007fcc0c837c0a 00007fcc15f77219 00007fcc1387e58f 00007fcc0c8bd571 00007fcc0c8bf7c1 00007fcc0c8bf779 00007fcc0c8bf709 00007fcc0c8bf6d1 00007fcc0c8be9cd
0709 13:20:46.147234 (+331241us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:20:46.154889 (+  7655us) log.cc:844] Serialized 26 byte log entry
0709 13:20:46.155046 (+   157us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:20:46.155075 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:46.155140 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:46.661442 (+506302us) raft_consensus.cc:1685] finished
0709 13:20:46.661765 (+   323us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:46.662501 (+   736us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":29199,"prepare.queue_time_us":50194,"prepare.run_cpu_time_us":91,"prepare.run_wall_time_us":6392,"raft.queue_time_us":41737,"raft.run_cpu_time_us":373,"raft.run_wall_time_us":67080,"spinlock_wait_cycles":9817856,"thread_start_us":309130,"threads_started":1,"wal-append.queue_time_us":699316}
I20260709 13:20:46.673146  6799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3411566abe2d4c9bb4b2adfdd05e6f17" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:46.665282  6800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09c2a98de1a4decabd0ff900dd44caa" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:46.674538  6799 raft_consensus.cc:2468] T 3411566abe2d4c9bb4b2adfdd05e6f17 P b7ab4784c7344b939bc36f639286f377 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 13.
W20260709 13:20:46.676251  6844 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.531s	user 0.003s	sys 0.007s
W20260709 13:20:46.676821  6844 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.532s	user 0.004s	sys 0.007s
W20260709 13:20:46.679207  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 561066us
I20260709 13:20:46.680863  6844 leader_election.cc:304] T 4b8cacb381b746da8d0049b0a83b41dd P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:20:46.684176  6844 leader_election.cc:304] T 9e326172347f45e99a0d482b5d8ef768 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377
W20260709 13:20:46.692852  6874 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.541s	user 0.005s	sys 0.006s
W20260709 13:20:46.693512  6874 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.564s	user 0.005s	sys 0.006s
I20260709 13:20:46.700654 11870 raft_consensus.cc:493] T f5be3a11b23d4ea9b08300a2789821c7 P b7ab4784c7344b939bc36f639286f377 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:20:46.702157 11870 raft_consensus.cc:515] T f5be3a11b23d4ea9b08300a2789821c7 P b7ab4784c7344b939bc36f639286f377 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:46.707002 11870 leader_election.cc:290] T f5be3a11b23d4ea9b08300a2789821c7 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:46.710089 12086 raft_consensus.cc:515] T fe20b4b48823486ca3b9c648db6ce8aa P cd75a17ab2604397adab03bb8b5fd75c [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:20:46.712436  6875 raft_consensus.cc:1240] T fe20b4b48823486ca3b9c648db6ce8aa P cd75a17ab2604397adab03bb8b5fd75c [term 13 FOLLOWER]: Rejecting Update request from peer ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 12. Current term is 13. Ops: []
W20260709 13:20:46.716495  6771 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:46.722922  6697 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 257533us
I20260709 13:20:46.723418 12102 raft_consensus.cc:493] T 711ef6523deb4cbe8ef2ba61e1c21c98 P b7ab4784c7344b939bc36f639286f377 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader cd75a17ab2604397adab03bb8b5fd75c)
I20260709 13:20:46.724452 12102 raft_consensus.cc:515] T 711ef6523deb4cbe8ef2ba61e1c21c98 P b7ab4784c7344b939bc36f639286f377 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:46.724979 12174 leader_election.cc:290] T 95a75bfe094d4bdc963aba3f08dfcd25 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:46.727391 12102 leader_election.cc:290] T 711ef6523deb4cbe8ef2ba61e1c21c98 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:46.727952 12187 leader_election.cc:290] T 8c7f33e544204fbaac4078e3e83bbf4e P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:46.722956 12238 raft_consensus.cc:493] T 3fa34c08b205435dba97346991aa1f92 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:46.729370 12238 raft_consensus.cc:515] T 3fa34c08b205435dba97346991aa1f92 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:20:46.724771 11937 leader_election.cc:290] T 7a734b5ab7834e05a8c422208acc58b1 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:20:46.722119 12086 leader_election.cc:290] T fe20b4b48823486ca3b9c648db6ce8aa P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 13 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:20:46.733543 11937 raft_consensus.cc:2749] T 4b8cacb381b746da8d0049b0a83b41dd P cd75a17ab2604397adab03bb8b5fd75c [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:20:46.733925  6878 raft_consensus.cc:1275] T 7c44c4849aa54f2b94d1f1bef9ed546f P cd75a17ab2604397adab03bb8b5fd75c [term 17 FOLLOWER]: Refusing update from remote peer ccd8a4c3bfe3413cb2ae219b09aea832: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 13:20:46.734452 12086 raft_consensus.cc:2804] T 9e326172347f45e99a0d482b5d8ef768 P cd75a17ab2604397adab03bb8b5fd75c [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:20:46.734556 11937 raft_consensus.cc:493] T 90d42e216d9741e190bca19a781291fd P cd75a17ab2604397adab03bb8b5fd75c [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:46.735278 12086 raft_consensus.cc:493] T 9e326172347f45e99a0d482b5d8ef768 P cd75a17ab2604397adab03bb8b5fd75c [term 12 FOLLOWER]: Starting leader election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:20:46.737486  7501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe20b4b48823486ca3b9c648db6ce8aa" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb"
I20260709 13:20:46.738552  7501 raft_consensus.cc:3060] T fe20b4b48823486ca3b9c648db6ce8aa P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:46.740880  6844 leader_election.cc:304] T e77e330a82df4b43a745d57a68f6f057 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377
I20260709 13:20:46.735823 12086 raft_consensus.cc:3060] T 9e326172347f45e99a0d482b5d8ef768 P cd75a17ab2604397adab03bb8b5fd75c [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:20:46.757344  7469 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:46.758020  6844 leader_election.cc:304] T f03d0dbf16864ca4bc1bb5e4c0334c0f P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:20:46.747468  6727 consensus_queue.cc:260] T b56bf91d90824c959e21e0cee5ba1816 P ccd8a4c3bfe3413cb2ae219b09aea832 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:46.763710  6624 catalog_manager.cc:5697] T 24ee15416e3145beaa1b8183453729a3 P 7ba59cc884714e8aa5f3f0ecaed84cbb reported cstate change: term changed from 6 to 16. New cstate: current_term: 16 leader_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:20:46.767418 12252 raft_consensus.cc:2749] T be1a92657f494cac8dd227d152f50151 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:20:46.769913 12297 raft_consensus.cc:493] T 4f00a2e87e56452083b759f60d461ee3 P cd75a17ab2604397adab03bb8b5fd75c [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:46.772369 12097 raft_consensus.cc:493] T 853ac0a8cbd64ce99457f170216d4d0f P cd75a17ab2604397adab03bb8b5fd75c [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:46.773406 12097 raft_consensus.cc:515] T 853ac0a8cbd64ce99457f170216d4d0f P cd75a17ab2604397adab03bb8b5fd75c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:46.776077  6878 raft_consensus.cc:1240] T 3d65025eea89441290d85dd053810e31 P cd75a17ab2604397adab03bb8b5fd75c [term 16 FOLLOWER]: Rejecting Update request from peer ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 15. Current term is 16. Ops: []
I20260709 13:20:46.771080 12297 raft_consensus.cc:515] T 4f00a2e87e56452083b759f60d461ee3 P cd75a17ab2604397adab03bb8b5fd75c [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:20:46.782754 12297 leader_election.cc:290] T 4f00a2e87e56452083b759f60d461ee3 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:20:46.660007  5625 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:20:46.803139 12271 raft_consensus.cc:493] T 7ba5dac66ab5497e9e336f2a3c28cda5 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:46.804667 12271 raft_consensus.cc:515] T 7ba5dac66ab5497e9e336f2a3c28cda5 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:20:46.810177  7494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f00a2e87e56452083b759f60d461ee3" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:20:46.813475  6799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ba5dac66ab5497e9e336f2a3c28cda5" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:46.814891  6799 raft_consensus.cc:2468] T 7ba5dac66ab5497e9e336f2a3c28cda5 P b7ab4784c7344b939bc36f639286f377 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in term 16.
I20260709 13:20:46.816730  7466 leader_election.cc:304] T 7ba5dac66ab5497e9e336f2a3c28cda5 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, b7ab4784c7344b939bc36f639286f377; no voters: 
I20260709 13:20:46.816989 12293 raft_consensus.cc:3060] T 7c37d41cd9164c15a6826ca62a851a69 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:46.735839 11937 raft_consensus.cc:515] T 90d42e216d9741e190bca19a781291fd P cd75a17ab2604397adab03bb8b5fd75c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:46.820860 12097 leader_election.cc:290] T 853ac0a8cbd64ce99457f170216d4d0f P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:20:46.821120 11937 leader_election.cc:290] T 90d42e216d9741e190bca19a781291fd P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:20:46.821467  6872 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58592 (request call id 461) took 1486 ms. Trace:
I20260709 13:20:46.826093  6872 rpcz_store.cc:276] 0709 13:20:45.335020 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:45.335224 (+   204us) service_pool.cc:224] Handling call
0709 13:20:45.335885 (+   661us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:46.021934 (+686049us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:46.820857 (+798923us) spinlock_profiling.cc:243] Waited 679 ms on lock 0x7b5400217fd4. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f9aae01 00007fcc0f9a983e 00007fcc1496e419 00007fcc0dee5bd4 00007fcc0dee5b62 00007fcc0dee5a91 00007fcc0dee5a0c 00007fcc0dee4cc2 00007fcc0dce548c 00007fcc0dce48c6
0709 13:20:46.821223 (+   366us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1561745792}
I20260709 13:20:46.853088 12397 raft_consensus.cc:493] T 7c37d41cd9164c15a6826ca62a851a69 P cd75a17ab2604397adab03bb8b5fd75c [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:46.854509 12397 raft_consensus.cc:515] T 7c37d41cd9164c15a6826ca62a851a69 P cd75a17ab2604397adab03bb8b5fd75c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:46.856577 12417 raft_consensus.cc:493] T 7ba5dac66ab5497e9e336f2a3c28cda5 P cd75a17ab2604397adab03bb8b5fd75c [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:46.857877 12417 raft_consensus.cc:515] T 7ba5dac66ab5497e9e336f2a3c28cda5 P cd75a17ab2604397adab03bb8b5fd75c [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:20:46.791569  6624 catalog_manager.cc:5697] T b3f13b31a1f84f0d89d007eadd57924c P 7ba59cc884714e8aa5f3f0ecaed84cbb reported cstate change: term changed from 11 to 12, leader changed from 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68) to b7ab4784c7344b939bc36f639286f377 (127.5.126.66). New cstate: current_term: 12 leader_uuid: "b7ab4784c7344b939bc36f639286f377" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } } }
I20260709 13:20:46.861508 12377 raft_consensus.cc:493] T 1bf4668eeb70467fb3dc5a0289233b3c P cd75a17ab2604397adab03bb8b5fd75c [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:46.862555 12377 raft_consensus.cc:515] T 1bf4668eeb70467fb3dc5a0289233b3c P cd75a17ab2604397adab03bb8b5fd75c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
W20260709 13:20:46.865604 12306 consensus_meta.cc:287] T d33d5ee8ef6f415593d8df52063161ad P cd75a17ab2604397adab03bb8b5fd75c: Time spent flushing consensus metadata: real 0.841s	user 0.013s	sys 0.002s
I20260709 13:20:46.866582 12306 raft_consensus.cc:515] T d33d5ee8ef6f415593d8df52063161ad P cd75a17ab2604397adab03bb8b5fd75c [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:46.868945 12334 raft_consensus.cc:2804] T e77e330a82df4b43a745d57a68f6f057 P cd75a17ab2604397adab03bb8b5fd75c [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:20:46.870039 12334 raft_consensus.cc:493] T e77e330a82df4b43a745d57a68f6f057 P cd75a17ab2604397adab03bb8b5fd75c [term 16 FOLLOWER]: Starting leader election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:20:46.870908 12334 raft_consensus.cc:3060] T e77e330a82df4b43a745d57a68f6f057 P cd75a17ab2604397adab03bb8b5fd75c [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:46.874955 12335 raft_consensus.cc:2749] T f03d0dbf16864ca4bc1bb5e4c0334c0f P cd75a17ab2604397adab03bb8b5fd75c [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:20:46.877903  6727 raft_consensus.cc:3060] T b56bf91d90824c959e21e0cee5ba1816 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:20:46.879634  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 121932us
I20260709 13:20:46.862622 12345 raft_consensus.cc:2804] T 7ba5dac66ab5497e9e336f2a3c28cda5 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:20:46.886981 12345 raft_consensus.cc:493] T 7ba5dac66ab5497e9e336f2a3c28cda5 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:46.887571 12345 raft_consensus.cc:3060] T 7ba5dac66ab5497e9e336f2a3c28cda5 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:46.889487  6728 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49998 (request call id 1328) took 1163 ms. Trace:
I20260709 13:20:46.890076  6728 rpcz_store.cc:276] 0709 13:20:45.725580 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:45.736073 (+ 10493us) service_pool.cc:224] Handling call
0709 13:20:46.888764 (+1152691us) spinlock_profiling.cc:243] Waited 8.44 ms on lock 0x7b5400395dd4. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f9ae2fa 00007fcc1496fb17 00007fcc0deea6d4 00007fcc0deea662 00007fcc0deea591 00007fcc0deea50c 00007fcc0dee97c2 00007fcc0dce548c 00007fcc0dce48c6 00007fcc0dce426f
0709 13:20:46.889170 (+   406us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":19418368}
W20260709 13:20:46.875020 12265 consensus_meta.cc:287] T bb7fa124c3bf4ef9ab65a407cb008441 P 7ba59cc884714e8aa5f3f0ecaed84cbb: Time spent flushing consensus metadata: real 0.850s	user 0.014s	sys 0.005s
I20260709 13:20:46.890352 12086 raft_consensus.cc:515] T 9e326172347f45e99a0d482b5d8ef768 P cd75a17ab2604397adab03bb8b5fd75c [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:46.900717 12238 leader_election.cc:290] T 3fa34c08b205435dba97346991aa1f92 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:20:46.922434  6727 raft_consensus.cc:2468] T b56bf91d90824c959e21e0cee5ba1816 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 15.
I20260709 13:20:46.929162 12377 leader_election.cc:290] T 1bf4668eeb70467fb3dc5a0289233b3c P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:20:46.917840  6872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bf4668eeb70467fb3dc5a0289233b3c" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
W20260709 13:20:46.930796  6772 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 422672us
I20260709 13:20:46.936697  6872 raft_consensus.cc:3060] T 1bf4668eeb70467fb3dc5a0289233b3c P cd75a17ab2604397adab03bb8b5fd75c [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:46.949410  6872 raft_consensus.cc:2468] T 1bf4668eeb70467fb3dc5a0289233b3c P cd75a17ab2604397adab03bb8b5fd75c [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 16.
I20260709 13:20:46.953876  6844 leader_election.cc:304] T d8292e16e5654be6bc408560cf256aaa P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:20:46.950244  6727 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49998 (request call id 1337) took 1127 ms. Trace:
I20260709 13:20:46.956388  6727 rpcz_store.cc:276] 0709 13:20:45.816550 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:45.864915 (+ 48365us) service_pool.cc:224] Handling call
0709 13:20:46.746033 (+881118us) spinlock_profiling.cc:243] Waited 4.35 ms on lock 0x7b4c001d8100. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0dc76a20 00007fcc0dc87a29 00007fcc0dc4d644 00007fcc0dc74f2d 00007fcc0dc74b93 00007fcc0f9a518b 00007fcc0f9a5cb5 00007fcc0f9a0f30 00007fcc0f9a27de 00007fcc0f9ae27c 00007fcc1496fb17
0709 13:20:46.877400 (+131367us) spinlock_profiling.cc:243] Waited 36.2 ms on lock 0x7b58009713d0. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f9060aa 00007fcc0f988447 00007fcc0f9a0fe7 00007fcc0f9a27de 00007fcc0f9ae27c 00007fcc1496fb17 00007fcc0deea6d4 00007fcc0deea662 00007fcc0deea591 00007fcc0deea50c
0709 13:20:46.944414 (+ 67014us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":93190656}
I20260709 13:20:46.962713 12422 raft_consensus.cc:493] T ce4f062dcd314d43a63ca74067cb5ee3 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:20:46.926636 12271 leader_election.cc:290] T 7ba5dac66ab5497e9e336f2a3c28cda5 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:46.966320  6874 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53406 (request call id 2575) took 1371 ms. Trace:
I20260709 13:20:46.970715 12425 raft_consensus.cc:2749] T d8292e16e5654be6bc408560cf256aaa P cd75a17ab2604397adab03bb8b5fd75c [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:20:46.947880 12238 raft_consensus.cc:493] T ab432e62819d499eaaf3dd55481dd930 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:20:46.963721 12422 raft_consensus.cc:515] T ce4f062dcd314d43a63ca74067cb5ee3 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } attrs { replace: true } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
W20260709 13:20:46.974929 11576 consensus_meta.cc:287] T f4b8bd455d5a47c18a1380839c6e0d61 P cd75a17ab2604397adab03bb8b5fd75c: Time spent flushing consensus metadata: real 0.511s	user 0.011s	sys 0.014s
I20260709 13:20:47.015962 11576 raft_consensus.cc:2749] T f4b8bd455d5a47c18a1380839c6e0d61 P cd75a17ab2604397adab03bb8b5fd75c [term 16 FOLLOWER]: Leader pre-election lost for term 15. Reason: Vote denied by peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391) with higher term. Message: Invalid argument: T f4b8bd455d5a47c18a1380839c6e0d61 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c for earlier term 15. Current term is 16.
W20260709 13:20:46.984280 12402 log.cc:927] Time spent T 404190ce4ce94cecbfcb6ea9d1dd8626 P 7ba59cc884714e8aa5f3f0ecaed84cbb: Append to log took a long time: real 0.508s	user 0.005s	sys 0.000s
I20260709 13:20:46.969319  6874 rpcz_store.cc:276] 0709 13:20:45.595336 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:45.598579 (+  3243us) service_pool.cc:224] Handling call
0709 13:20:45.598862 (+   283us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:45.599149 (+   287us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:20:46.121991 (+522842us) log.cc:844] Serialized 14 byte log entry
0709 13:20:46.932566 (+810575us) log.cc:844] Serialized 14 byte log entry
0709 13:20:46.958986 (+ 26420us) log.cc:844] Serialized 14 byte log entry
0709 13:20:46.965576 (+  6590us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:20:46.965674 (+    98us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:20:46.965859 (+   185us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:46.966024 (+   165us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:46.966246 (+   222us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":274382,"prepare.queue_time_us":513238,"prepare.run_cpu_time_us":182,"prepare.run_wall_time_us":1603,"raft.queue_time_us":319188,"raft.run_cpu_time_us":368,"raft.run_wall_time_us":10429,"thread_start_us":1060903,"threads_started":2}
I20260709 13:20:47.017381  6724 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49744 (request call id 575) took 1199 ms. Trace:
W20260709 13:20:46.986089  6698 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:47.018219  6724 rpcz_store.cc:276] 0709 13:20:45.817296 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:46.033867 (+216571us) service_pool.cc:224] Handling call
0709 13:20:46.904675 (+870808us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:46.905316 (+   641us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:46.905364 (+    48us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:20:46.905445 (+    81us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:20:46.905509 (+    64us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:46.905607 (+    98us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:47.016870 (+111263us) spinlock_profiling.cc:243] Waited 856 ms on lock 0x7b5400395dd0. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f9a98ad 00007fcc1496e419 00007fcc0dee5bd4 00007fcc0dee5b62 00007fcc0dee5a91 00007fcc0dee5a0c 00007fcc0dee4cc2 00007fcc0dce548c 00007fcc0dce48c6 00007fcc0dce426f
0709 13:20:47.017111 (+   241us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1969922304}
I20260709 13:20:46.992928 12306 leader_election.cc:290] T d33d5ee8ef6f415593d8df52063161ad P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 13 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:20:46.992379 12238 raft_consensus.cc:515] T ab432e62819d499eaaf3dd55481dd930 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
W20260709 13:20:47.004623 12401 log.cc:927] Time spent T 711ef6523deb4cbe8ef2ba61e1c21c98 P cd75a17ab2604397adab03bb8b5fd75c: Append to log took a long time: real 0.665s	user 0.000s	sys 0.002s
I20260709 13:20:47.003623  6624 catalog_manager.cc:5697] T 7ba5dac66ab5497e9e336f2a3c28cda5 P 7ba59cc884714e8aa5f3f0ecaed84cbb reported cstate change: term changed from 12 to 13, leader changed from 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68) to cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67). New cstate: current_term: 13 leader_uuid: "cd75a17ab2604397adab03bb8b5fd75c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } } }
W20260709 13:20:47.005470 12275 consensus_meta.cc:287] T f4b8bd455d5a47c18a1380839c6e0d61 P b7ab4784c7344b939bc36f639286f377: Time spent flushing consensus metadata: real 0.926s	user 0.019s	sys 0.004s
W20260709 13:20:47.014459 12288 consensus_meta.cc:287] T 3fa34c08b205435dba97346991aa1f92 P cd75a17ab2604397adab03bb8b5fd75c: Time spent flushing consensus metadata: real 0.622s	user 0.013s	sys 0.005s
I20260709 13:20:46.986722 12397 leader_election.cc:290] T 7c37d41cd9164c15a6826ca62a851a69 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:20:47.037062 12288 raft_consensus.cc:515] T 3fa34c08b205435dba97346991aa1f92 P cd75a17ab2604397adab03bb8b5fd75c [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:20:47.039774 12288 leader_election.cc:290] T 3fa34c08b205435dba97346991aa1f92 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 18 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:20:47.041308  6881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c44c4849aa54f2b94d1f1bef9ed546f" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 18 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:47.042583  6881 raft_consensus.cc:2468] T 7c44c4849aa54f2b94d1f1bef9ed546f P cd75a17ab2604397adab03bb8b5fd75c [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 17.
I20260709 13:20:47.043298  6881 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53406 (request call id 2578) took 1008 ms. Trace:
I20260709 13:20:47.043843  7500 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50742 (request call id 509) took 1319 ms. Trace:
I20260709 13:20:47.044303  7500 rpcz_store.cc:276] 0709 13:20:45.727242 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:45.727840 (+   598us) service_pool.cc:224] Handling call
0709 13:20:45.729218 (+  1378us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:45.729418 (+   200us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:45.729443 (+    25us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:20:45.744720 (+ 15277us) log.cc:844] Serialized 26 byte log entry
0709 13:20:46.108189 (+363469us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:20:46.108240 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:46.108335 (+    95us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:46.983069 (+874734us) spinlock_profiling.cc:243] Waited 3.07 ms on lock 0x7b4400022b4c. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0c745db1 00007fcc0c7e3c85 00007fcc0c7e46a2 00007fcc0f5561db 00007fcc0f551aaf 00007fcc0f54586e 00007fcc0f544bb6 00007fcc0f5447d8 00007fcc0f54e221 00007fcc0f54e1d9 00007fcc0f54e169
0709 13:20:47.043309 (+ 60240us) raft_consensus.cc:1685] finished
0709 13:20:47.043331 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:47.043639 (+   308us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":7071872,"thread_start_us":314891,"threads_started":1,"wal-append.queue_time_us":644983}
I20260709 13:20:47.050868 12427 raft_consensus.cc:493] T d33d5ee8ef6f415593d8df52063161ad P b7ab4784c7344b939bc36f639286f377 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:47.050585 12334 raft_consensus.cc:515] T e77e330a82df4b43a745d57a68f6f057 P cd75a17ab2604397adab03bb8b5fd75c [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } }
I20260709 13:20:47.051570 12427 raft_consensus.cc:515] T d33d5ee8ef6f415593d8df52063161ad P b7ab4784c7344b939bc36f639286f377 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:47.054080 12427 leader_election.cc:290] T d33d5ee8ef6f415593d8df52063161ad P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:47.060503 12275 raft_consensus.cc:493] T 44bde925b2e541b69890d70715b85176 P b7ab4784c7344b939bc36f639286f377 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:20:47.061904 12275 raft_consensus.cc:515] T 44bde925b2e541b69890d70715b85176 P b7ab4784c7344b939bc36f639286f377 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:47.061170  6624 catalog_manager.cc:5697] T bb7fa124c3bf4ef9ab65a407cb008441 P 7ba59cc884714e8aa5f3f0ecaed84cbb reported cstate change: term changed from 8 to 14, leader changed from b7ab4784c7344b939bc36f639286f377 (127.5.126.66) to 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68). New cstate: current_term: 14 leader_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:20:47.064544 12275 leader_election.cc:290] T 44bde925b2e541b69890d70715b85176 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:47.065150  6878 raft_consensus.cc:1275] T 22ccee1b570c4ad3a57bd7aec085b1b4 P cd75a17ab2604397adab03bb8b5fd75c [term 14 FOLLOWER]: Refusing update from remote peer b7ab4784c7344b939bc36f639286f377: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:20:47.068310  6878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8cee0accdb8499c86d4414b72565a38" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:47.069311  6878 raft_consensus.cc:2468] T d8cee0accdb8499c86d4414b72565a38 P cd75a17ab2604397adab03bb8b5fd75c [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 15.
I20260709 13:20:47.069849 12159 raft_consensus.cc:493] T f03d0dbf16864ca4bc1bb5e4c0334c0f P b7ab4784c7344b939bc36f639286f377 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:20:47.069860 12275 consensus_queue.cc:1048] T c4db81d9d329422bb3b4160ca4ac2d1d P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:20:47.070894 12159 raft_consensus.cc:515] T f03d0dbf16864ca4bc1bb5e4c0334c0f P b7ab4784c7344b939bc36f639286f377 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:47.073814 12159 leader_election.cc:290] T f03d0dbf16864ca4bc1bb5e4c0334c0f P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
W20260709 13:20:47.034065 12416 log.cc:927] Time spent T 20f6842e26174571996b8dea4151d4be P cd75a17ab2604397adab03bb8b5fd75c: Append to log took a long time: real 0.448s	user 0.001s	sys 0.001s
I20260709 13:20:47.080255 12417 leader_election.cc:290] T 7ba5dac66ab5497e9e336f2a3c28cda5 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:20:47.080646  6879 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53416 (request call id 3317) took 1052 ms. Trace:
I20260709 13:20:47.081010 12422 leader_election.cc:290] T ce4f062dcd314d43a63ca74067cb5ee3 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
W20260709 13:20:47.074440  6877 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.513s	user 0.007s	sys 0.012s
W20260709 13:20:47.082051  6877 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.685s	user 0.007s	sys 0.012s
I20260709 13:20:47.080966  6879 rpcz_store.cc:276] 0709 13:20:46.027983 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:46.049218 (+ 21235us) service_pool.cc:224] Handling call
0709 13:20:46.049564 (+   346us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:46.049882 (+   318us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:46.049909 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:20:46.055133 (+  5224us) log.cc:844] Serialized 26 byte log entry
0709 13:20:46.457962 (+402829us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:20:46.458102 (+   140us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:46.458284 (+   182us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:47.032897 (+574613us) spinlock_profiling.cc:243] Waited 1.97 ms on lock 0x7b4400022b4c. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0c745db1 00007fcc0c7e3c85 00007fcc0c7e46a2 00007fcc0f5561db 00007fcc0f551aaf 00007fcc0f54586e 00007fcc0f544bb6 00007fcc0f5447d8 00007fcc0f54e221 00007fcc0f54e1d9 00007fcc0f54e169
0709 13:20:47.080196 (+ 47299us) raft_consensus.cc:1685] finished
0709 13:20:47.080218 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:47.080472 (+   254us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":501,"raft.run_cpu_time_us":134,"raft.run_wall_time_us":4631,"spinlock_wait_cycles":4539776,"thread_start_us":360067,"threads_started":1,"wal-append.queue_time_us":481936}
I20260709 13:20:47.083016 12194 raft_consensus.cc:493] T 3a485a995abc4807b6e511e45419f737 P cd75a17ab2604397adab03bb8b5fd75c [term 15 FOLLOWER]: Starting pre-election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:20:47.084070 12159 raft_consensus.cc:493] T 404190ce4ce94cecbfcb6ea9d1dd8626 P b7ab4784c7344b939bc36f639286f377 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:20:47.070153 12361 consensus_queue.cc:1059] T a1704639a875409b9959353527b3fd68 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: INVALID_TERM, Last received: 15.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.006s
I20260709 13:20:47.076951 12367 raft_consensus.cc:3060] T bb3d8792045a4583ae2e965b1350a5b4 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:47.088425 12371 raft_consensus.cc:493] T a3022224cc81473690653a83d4e99470 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:20:47.089429 12159 raft_consensus.cc:515] T 404190ce4ce94cecbfcb6ea9d1dd8626 P b7ab4784c7344b939bc36f639286f377 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:20:47.083900 12194 raft_consensus.cc:515] T 3a485a995abc4807b6e511e45419f737 P cd75a17ab2604397adab03bb8b5fd75c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
W20260709 13:20:47.097965 12267 consensus_meta.cc:287] T d8cee0accdb8499c86d4414b72565a38 P 7ba59cc884714e8aa5f3f0ecaed84cbb: Time spent flushing consensus metadata: real 0.509s	user 0.004s	sys 0.016s
I20260709 13:20:47.098608 12267 raft_consensus.cc:515] T d8cee0accdb8499c86d4414b72565a38 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:20:47.027565 12086 leader_election.cc:290] T 9e326172347f45e99a0d482b5d8ef768 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 13 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:20:47.101022  7500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ba5dac66ab5497e9e336f2a3c28cda5" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:20:47.101128  7502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb7fa124c3bf4ef9ab65a407cb008441" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:20:47.100207 12347 raft_consensus.cc:2955] T 95a75bfe094d4bdc963aba3f08dfcd25 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 13 LEADER]: Committing config change with OpId 13.7: config changed from index -1 to 7, NON_VOTER 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68) added. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } attrs { replace: true } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: NON_VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: true } } }
I20260709 13:20:47.101996  7502 raft_consensus.cc:2468] T bb7fa124c3bf4ef9ab65a407cb008441 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 15.
I20260709 13:20:47.088567 12361 raft_consensus.cc:3055] T a1704639a875409b9959353527b3fd68 P b7ab4784c7344b939bc36f639286f377 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:20:47.102177  7494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8cee0accdb8499c86d4414b72565a38" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:20:47.102676 12361 raft_consensus.cc:740] T a1704639a875409b9959353527b3fd68 P b7ab4784c7344b939bc36f639286f377 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
I20260709 13:20:47.103123  7494 raft_consensus.cc:2393] T d8cee0accdb8499c86d4414b72565a38 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7ab4784c7344b939bc36f639286f377 in current term 16: Already voted for candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in this term.
I20260709 13:20:47.103835 12432 ts_tablet_manager.cc:933] T 95a75bfe094d4bdc963aba3f08dfcd25 P 7ba59cc884714e8aa5f3f0ecaed84cbb: Initiating tablet copy from peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391)
I20260709 13:20:47.104344 12361 consensus_queue.cc:260] T a1704639a875409b9959353527b3fd68 P b7ab4784c7344b939bc36f639286f377 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:47.089591 12371 raft_consensus.cc:515] T a3022224cc81473690653a83d4e99470 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:47.090793 12278 raft_consensus.cc:493] T 30e88460611e47b2ba16a46a30b5f416 P b7ab4784c7344b939bc36f639286f377 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:20:47.043614  6881 rpcz_store.cc:276] 0709 13:20:46.035299 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:46.037465 (+  2166us) service_pool.cc:224] Handling call
0709 13:20:47.040806 (+1003341us) spinlock_profiling.cc:243] Waited 6.14 ms on lock 0x7b5800147c98. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0c745db1 00007fcc0c885b71 00007fcc0c885a22 00007fcc1579ec09 00007fcc148f8ee0 00007fcc149c20ab 00007fcc149c2131 00007fcc149700a0 00007fcc1496f984 00007fcc0deea6d4 00007fcc0deea662
0709 13:20:47.043187 (+  2381us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":14122752}
I20260709 13:20:47.112345  6872 raft_consensus.cc:1275] T 7c37d41cd9164c15a6826ca62a851a69 P cd75a17ab2604397adab03bb8b5fd75c [term 15 FOLLOWER]: Refusing update from remote peer b7ab4784c7344b939bc36f639286f377: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:20:47.093096  6724 raft_consensus.cc:1275] T 34f36d59d88f40fe8a2805e604fc6c0a P ccd8a4c3bfe3413cb2ae219b09aea832 [term 14 FOLLOWER]: Refusing update from remote peer b7ab4784c7344b939bc36f639286f377: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:20:47.095571  6727 raft_consensus.cc:1240] T f4b8bd455d5a47c18a1380839c6e0d61 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 16 FOLLOWER]: Rejecting Update request from peer b7ab4784c7344b939bc36f639286f377 for earlier term 14. Current term is 16. Ops: []
I20260709 13:20:47.100719 12194 leader_election.cc:290] T 3a485a995abc4807b6e511e45419f737 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:20:47.085462  6877 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53416 (request call id 3320) took 1056 ms. Trace:
I20260709 13:20:47.063957  6624 catalog_manager.cc:5697] T be1a92657f494cac8dd227d152f50151 P 7ba59cc884714e8aa5f3f0ecaed84cbb reported cstate change: term changed from 13 to 15. New cstate: current_term: 15 leader_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:20:47.121522  6772 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:47.028322  7501 raft_consensus.cc:2468] T fe20b4b48823486ca3b9c648db6ce8aa P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 13.
I20260709 13:20:47.077795 12238 leader_election.cc:290] T ab432e62819d499eaaf3dd55481dd930 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:47.117666  7503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fa34c08b205435dba97346991aa1f92" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb"
I20260709 13:20:47.126770 12361 raft_consensus.cc:3060] T a1704639a875409b9959353527b3fd68 P b7ab4784c7344b939bc36f639286f377 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:47.128306  6880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3411566abe2d4c9bb4b2adfdd05e6f17" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:47.129299  6881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a75bfe094d4bdc963aba3f08dfcd25" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:47.129938  6880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90d42e216d9741e190bca19a781291fd" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:47.130585  6880 raft_consensus.cc:2468] T 90d42e216d9741e190bca19a781291fd P cd75a17ab2604397adab03bb8b5fd75c [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 15.
I20260709 13:20:47.131259 12278 raft_consensus.cc:515] T 30e88460611e47b2ba16a46a30b5f416 P b7ab4784c7344b939bc36f639286f377 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:47.118263  6877 rpcz_store.cc:276] 0709 13:20:46.044749 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:46.120500 (+ 75751us) service_pool.cc:224] Handling call
0709 13:20:46.120830 (+   330us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:46.395607 (+274777us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:46.395648 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:20:46.396565 (+   917us) log.cc:844] Serialized 26 byte log entry
0709 13:20:47.082620 (+686055us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:20:47.082696 (+    76us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:47.085024 (+  2328us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:47.085103 (+    79us) raft_consensus.cc:1685] finished
0709 13:20:47.085126 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:47.085374 (+   248us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3727,"raft.queue_time_us":262443,"raft.run_cpu_time_us":176,"raft.run_wall_time_us":11259,"thread_start_us":956110,"threads_started":2,"wal-append.queue_time_us":543766}
I20260709 13:20:47.133785 12278 leader_election.cc:290] T 30e88460611e47b2ba16a46a30b5f416 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
W20260709 13:20:47.134222  6695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 520799us
I20260709 13:20:47.135165 12345 raft_consensus.cc:515] T 7ba5dac66ab5497e9e336f2a3c28cda5 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:20:47.138830  6695 leader_election.cc:304] T 711ef6523deb4cbe8ef2ba61e1c21c98 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
W20260709 13:20:47.136154 12342 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.503s	user 0.050s	sys 0.040s
W20260709 13:20:47.139585 12342 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.539s	user 0.050s	sys 0.041s
I20260709 13:20:47.135640 12159 leader_election.cc:290] T 404190ce4ce94cecbfcb6ea9d1dd8626 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:20:47.136469  6878 raft_consensus.cc:1275] T 34f36d59d88f40fe8a2805e604fc6c0a P cd75a17ab2604397adab03bb8b5fd75c [term 14 FOLLOWER]: Refusing update from remote peer b7ab4784c7344b939bc36f639286f377: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:20:47.128374  7496 raft_consensus.cc:1275] T 24ee15416e3145beaa1b8183453729a3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 19 FOLLOWER]: Refusing update from remote peer cd75a17ab2604397adab03bb8b5fd75c: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260709 13:20:47.141597 12371 leader_election.cc:290] T a3022224cc81473690653a83d4e99470 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:47.143206 12214 raft_consensus.cc:2749] T 711ef6523deb4cbe8ef2ba61e1c21c98 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:20:47.145193 12194 consensus_queue.cc:1048] T 24ee15416e3145beaa1b8183453729a3 P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:20:47.137737  6697 leader_election.cc:304] T 427c124d773f483294511e80fe340075 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:20:47.139109  7500 raft_consensus.cc:2393] T 7ba5dac66ab5497e9e336f2a3c28cda5 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c in current term 17: Already voted for candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in this term.
W20260709 13:20:47.136016  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 228150us
I20260709 13:20:47.130625  6881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb7fa124c3bf4ef9ab65a407cb008441" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:47.152472  6846 leader_election.cc:304] T fe20b4b48823486ca3b9c648db6ce8aa P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:20:47.156113 12359 raft_consensus.cc:493] T be1a92657f494cac8dd227d152f50151 P b7ab4784c7344b939bc36f639286f377 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:20:47.157121 12359 raft_consensus.cc:515] T be1a92657f494cac8dd227d152f50151 P b7ab4784c7344b939bc36f639286f377 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
W20260709 13:20:47.163794  7469 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:47.161405  6878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "711ef6523deb4cbe8ef2ba61e1c21c98" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:47.167028  6872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a485a995abc4807b6e511e45419f737" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:47.171535 12427 raft_consensus.cc:493] T 1528ab62b6fe4e3099d08f141afee116 P b7ab4784c7344b939bc36f639286f377 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:20:47.177141  6881 raft_consensus.cc:2393] T bb7fa124c3bf4ef9ab65a407cb008441 P cd75a17ab2604397adab03bb8b5fd75c [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7ab4784c7344b939bc36f639286f377 in current term 15: Already voted for candidate cd75a17ab2604397adab03bb8b5fd75c in this term.
I20260709 13:20:47.172577 12427 raft_consensus.cc:515] T 1528ab62b6fe4e3099d08f141afee116 P b7ab4784c7344b939bc36f639286f377 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:20:47.160746 12194 raft_consensus.cc:2804] T fe20b4b48823486ca3b9c648db6ce8aa P cd75a17ab2604397adab03bb8b5fd75c [term 13 FOLLOWER]: Leader election won for term 13
W20260709 13:20:47.185542  6696 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:47.187108 12427 leader_election.cc:290] T 1528ab62b6fe4e3099d08f141afee116 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:20:47.187882  6844 leader_election.cc:304] T dbdf895bba214ff68685a24fd17dfb5d P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:20:47.195200  7503 raft_consensus.cc:2468] T 3fa34c08b205435dba97346991aa1f92 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 18.
I20260709 13:20:47.173622 12159 raft_consensus.cc:493] T d8292e16e5654be6bc408560cf256aaa P b7ab4784c7344b939bc36f639286f377 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:20:47.192201 12345 leader_election.cc:290] T 7ba5dac66ab5497e9e336f2a3c28cda5 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 17 election: Requested vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:47.196919  6878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c7f33e544204fbaac4078e3e83bbf4e" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:47.173905 12238 raft_consensus.cc:2749] T 427c124d773f483294511e80fe340075 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:20:47.226364  6800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ba5dac66ab5497e9e336f2a3c28cda5" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:20:47.227207  6800 raft_consensus.cc:3060] T 7ba5dac66ab5497e9e336f2a3c28cda5 P b7ab4784c7344b939bc36f639286f377 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:47.229387  6844 leader_election.cc:304] T 4275cf08e63345f993bce8664eada830 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377
I20260709 13:20:47.230960  6844 leader_election.cc:304] T 8c7f33e544204fbaac4078e3e83bbf4e P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:20:47.232580 12334 leader_election.cc:290] T e77e330a82df4b43a745d57a68f6f057 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 17 election: Requested vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391)
I20260709 13:20:47.232722 12422 consensus_queue.cc:1048] T 7c44c4849aa54f2b94d1f1bef9ed546f P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.019s
I20260709 13:20:47.233340 12240 consensus_queue.cc:1059] T 3d65025eea89441290d85dd053810e31 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: INVALID_TERM, Last received: 15.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.009s
I20260709 13:20:47.241231  6624 catalog_manager.cc:5697] T 404190ce4ce94cecbfcb6ea9d1dd8626 P 7ba59cc884714e8aa5f3f0ecaed84cbb reported cstate change: term changed from 11 to 13. New cstate: current_term: 13 leader_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:20:47.242969 12240 raft_consensus.cc:3055] T 3d65025eea89441290d85dd053810e31 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:20:47.235193 12335 raft_consensus.cc:2804] T 4275cf08e63345f993bce8664eada830 P cd75a17ab2604397adab03bb8b5fd75c [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:20:47.245211  6724 raft_consensus.cc:1275] T 7c37d41cd9164c15a6826ca62a851a69 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 15 FOLLOWER]: Refusing update from remote peer b7ab4784c7344b939bc36f639286f377: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:20:47.235479 11994 consensus_queue.cc:1059] T fe20b4b48823486ca3b9c648db6ce8aa P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.011s
I20260709 13:20:47.246759 11994 raft_consensus.cc:3055] T fe20b4b48823486ca3b9c648db6ce8aa P ccd8a4c3bfe3413cb2ae219b09aea832 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:20:47.247179 11994 raft_consensus.cc:740] T fe20b4b48823486ca3b9c648db6ce8aa P ccd8a4c3bfe3413cb2ae219b09aea832 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
I20260709 13:20:47.235838 12427 raft_consensus.cc:493] T f58dc08b12a2494bb9a1372837970ca2 P b7ab4784c7344b939bc36f639286f377 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:47.248864  6879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5be3a11b23d4ea9b08300a2789821c7" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:47.236096 12358 raft_consensus.cc:493] T 07a92dd554674067a83a9cb68c4773f2 P b7ab4784c7344b939bc36f639286f377 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:20:47.250411 12358 raft_consensus.cc:515] T 07a92dd554674067a83a9cb68c4773f2 P b7ab4784c7344b939bc36f639286f377 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:47.252430 12342 raft_consensus.cc:493] T 3d65025eea89441290d85dd053810e31 P b7ab4784c7344b939bc36f639286f377 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:20:47.252880  6727 raft_consensus.cc:1240] T f09c2a98de1a4decabd0ff900dd44caa P ccd8a4c3bfe3413cb2ae219b09aea832 [term 17 FOLLOWER]: Rejecting Update request from peer b7ab4784c7344b939bc36f639286f377 for earlier term 16. Current term is 17. Ops: []
I20260709 13:20:47.245970 12340 raft_consensus.cc:493] T de3186201e1a40d0b335eeb8b4e256e0 P b7ab4784c7344b939bc36f639286f377 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:20:47.253557 12340 raft_consensus.cc:515] T de3186201e1a40d0b335eeb8b4e256e0 P b7ab4784c7344b939bc36f639286f377 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:47.253883 12371 raft_consensus.cc:493] T c4db81d9d329422bb3b4160ca4ac2d1d P ccd8a4c3bfe3413cb2ae219b09aea832 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:47.248780 12427 raft_consensus.cc:515] T f58dc08b12a2494bb9a1372837970ca2 P b7ab4784c7344b939bc36f639286f377 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:47.255472  6846 leader_election.cc:304] T 3fa34c08b205435dba97346991aa1f92 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:20:47.236354  6876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20f6842e26174571996b8dea4151d4be" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:47.234962  6697 leader_election.cc:304] T 1bf4668eeb70467fb3dc5a0289233b3c P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:20:47.238474  6695 leader_election.cc:304] T e77e330a82df4b43a745d57a68f6f057 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:20:47.254535 12371 raft_consensus.cc:515] T c4db81d9d329422bb3b4160ca4ac2d1d P ccd8a4c3bfe3413cb2ae219b09aea832 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:47.265291  6800 raft_consensus.cc:2468] T 7ba5dac66ab5497e9e336f2a3c28cda5 P b7ab4784c7344b939bc36f639286f377 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in term 17.
I20260709 13:20:47.201586 12086 raft_consensus.cc:2749] T dbdf895bba214ff68685a24fd17dfb5d P cd75a17ab2604397adab03bb8b5fd75c [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:20:47.243623 12240 raft_consensus.cc:740] T 3d65025eea89441290d85dd053810e31 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
I20260709 13:20:47.222626 12278 raft_consensus.cc:493] T bd6869f07b5a4885a0b99fbe60c3b175 P b7ab4784c7344b939bc36f639286f377 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
W20260709 13:20:47.280051  6846 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.68:45071, user_credentials={real_user=slave}} blocked reactor thread for 52140.7us
I20260709 13:20:47.196930 11937 raft_consensus.cc:493] T 9b3759de40694069b13c0f8bd40e5709 P cd75a17ab2604397adab03bb8b5fd75c [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:47.238750 12417 raft_consensus.cc:2749] T 8c7f33e544204fbaac4078e3e83bbf4e P cd75a17ab2604397adab03bb8b5fd75c [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:20:47.200641 12306 raft_consensus.cc:493] T 2c240553ce044eedb41541d72b9475d7 P cd75a17ab2604397adab03bb8b5fd75c [term 17 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:20:47.196835 12194 raft_consensus.cc:697] T fe20b4b48823486ca3b9c648db6ce8aa P cd75a17ab2604397adab03bb8b5fd75c [term 13 LEADER]: Becoming Leader. State: Replica: cd75a17ab2604397adab03bb8b5fd75c, State: Running, Role: LEADER
I20260709 13:20:47.238724  6803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8cee0accdb8499c86d4414b72565a38" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:20:47.296980  6803 raft_consensus.cc:3060] T d8cee0accdb8499c86d4414b72565a38 P b7ab4784c7344b939bc36f639286f377 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:47.245304 12335 raft_consensus.cc:493] T 4275cf08e63345f993bce8664eada830 P cd75a17ab2604397adab03bb8b5fd75c [term 13 FOLLOWER]: Starting leader election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:20:47.237324 12267 leader_election.cc:290] T d8cee0accdb8499c86d4414b72565a38 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 16 election: Requested vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:47.299851 12335 raft_consensus.cc:3060] T 4275cf08e63345f993bce8664eada830 P cd75a17ab2604397adab03bb8b5fd75c [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:47.307060 12358 leader_election.cc:290] T 07a92dd554674067a83a9cb68c4773f2 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
W20260709 13:20:47.308748  6771 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:47.316895  6697 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 82023us
I20260709 13:20:47.253077 12342 raft_consensus.cc:515] T 3d65025eea89441290d85dd053810e31 P b7ab4784c7344b939bc36f639286f377 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:47.252434 12227 consensus_queue.cc:1048] T 3411566abe2d4c9bb4b2adfdd05e6f17 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.072s
I20260709 13:20:47.295056 12334 raft_consensus.cc:2804] T 3fa34c08b205435dba97346991aa1f92 P cd75a17ab2604397adab03bb8b5fd75c [term 18 FOLLOWER]: Leader election won for term 18
W20260709 13:20:47.324869  6772 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 50720.9us
I20260709 13:20:47.330140 12306 raft_consensus.cc:515] T 2c240553ce044eedb41541d72b9475d7 P cd75a17ab2604397adab03bb8b5fd75c [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:47.331209 12432 tablet_copy_client.cc:323] T 95a75bfe094d4bdc963aba3f08dfcd25 P 7ba59cc884714e8aa5f3f0ecaed84cbb: tablet copy: Beginning tablet copy session from remote peer at address 127.5.126.65:44391
I20260709 13:20:47.332202 11994 consensus_queue.cc:260] T fe20b4b48823486ca3b9c648db6ce8aa P ccd8a4c3bfe3413cb2ae219b09aea832 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:20:47.333643 12340 leader_election.cc:290] T de3186201e1a40d0b335eeb8b4e256e0 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
W20260709 13:20:47.334257  6695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 95923.2us
I20260709 13:20:47.324412 11937 raft_consensus.cc:515] T 9b3759de40694069b13c0f8bd40e5709 P cd75a17ab2604397adab03bb8b5fd75c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
W20260709 13:20:47.335956  6629 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:53214 (request call id 178) took 39483 ms (client timeout 15000 ms). Trace:
I20260709 13:20:47.336500  6695 leader_election.cc:304] T f4b8bd455d5a47c18a1380839c6e0d61 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:20:47.337972 12359 leader_election.cc:290] T be1a92657f494cac8dd227d152f50151 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:20:47.325213 12422 raft_consensus.cc:2804] T 1bf4668eeb70467fb3dc5a0289233b3c P ccd8a4c3bfe3413cb2ae219b09aea832 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:20:47.319844 12246 raft_consensus.cc:493] T f4b8bd455d5a47c18a1380839c6e0d61 P b7ab4784c7344b939bc36f639286f377 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:47.339430 12246 raft_consensus.cc:515] T f4b8bd455d5a47c18a1380839c6e0d61 P b7ab4784c7344b939bc36f639286f377 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:47.341770 12427 leader_election.cc:290] T f58dc08b12a2494bb9a1372837970ca2 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:47.342367 12246 leader_election.cc:290] T f4b8bd455d5a47c18a1380839c6e0d61 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:47.344215 12371 leader_election.cc:290] T c4db81d9d329422bb3b4160ca4ac2d1d P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:47.346110 11634 consensus_queue.cc:1048] T 7c44c4849aa54f2b94d1f1bef9ed546f P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:20:47.347069  6730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a485a995abc4807b6e511e45419f737" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:47.346293  6724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3411566abe2d4c9bb4b2adfdd05e6f17" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:47.350728  7466 leader_election.cc:304] T 7ba5dac66ab5497e9e336f2a3c28cda5 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, b7ab4784c7344b939bc36f639286f377; no voters: 
I20260709 13:20:47.351869  6726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20f6842e26174571996b8dea4151d4be" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:47.353264 12271 raft_consensus.cc:2804] T 7ba5dac66ab5497e9e336f2a3c28cda5 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:20:47.353860 12271 raft_consensus.cc:697] T 7ba5dac66ab5497e9e336f2a3c28cda5 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 17 LEADER]: Becoming Leader. State: Replica: 7ba59cc884714e8aa5f3f0ecaed84cbb, State: Running, Role: LEADER
I20260709 13:20:47.354540 12267 raft_consensus.cc:493] T 4b8cacb381b746da8d0049b0a83b41dd P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:47.354867 12271 consensus_queue.cc:237] T 7ba5dac66ab5497e9e336f2a3c28cda5 P 7ba59cc884714e8aa5f3f0ecaed84cbb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.12, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:20:47.347677  6729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90d42e216d9741e190bca19a781291fd" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:47.357322  6729 raft_consensus.cc:2468] T 90d42e216d9741e190bca19a781291fd P ccd8a4c3bfe3413cb2ae219b09aea832 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 15.
I20260709 13:20:47.358523 12267 raft_consensus.cc:515] T 4b8cacb381b746da8d0049b0a83b41dd P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:20:47.361080  6772 leader_election.cc:304] T d8cee0accdb8499c86d4414b72565a38 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:20:47.362021 12342 leader_election.cc:290] T 3d65025eea89441290d85dd053810e31 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:47.362493  6772 leader_election.cc:304] T 7c44c4849aa54f2b94d1f1bef9ed546f P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:20:47.363839 12352 consensus_queue.cc:1048] T 22ccee1b570c4ad3a57bd7aec085b1b4 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:20:47.364389  6878 raft_consensus.cc:2468] T 8c7f33e544204fbaac4078e3e83bbf4e P cd75a17ab2604397adab03bb8b5fd75c [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 13.
I20260709 13:20:47.366806 12240 consensus_queue.cc:260] T 3d65025eea89441290d85dd053810e31 P ccd8a4c3bfe3413cb2ae219b09aea832 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:47.368381 12240 raft_consensus.cc:3060] T 3d65025eea89441290d85dd053810e31 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:47.332706 12306 leader_election.cc:290] T 2c240553ce044eedb41541d72b9475d7 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:20:47.280884 12159 raft_consensus.cc:515] T d8292e16e5654be6bc408560cf256aaa P b7ab4784c7344b939bc36f639286f377 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:47.376325 12422 raft_consensus.cc:697] T 1bf4668eeb70467fb3dc5a0289233b3c P ccd8a4c3bfe3413cb2ae219b09aea832 [term 16 LEADER]: Becoming Leader. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
I20260709 13:20:47.317318 12288 raft_consensus.cc:493] T 44bde925b2e541b69890d70715b85176 P cd75a17ab2604397adab03bb8b5fd75c [term 15 FOLLOWER]: Starting pre-election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:20:47.323045 12275 raft_consensus.cc:493] T 7887766dc6784fcaa42b35c05fea7a99 P b7ab4784c7344b939bc36f639286f377 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:20:47.347623 11634 raft_consensus.cc:2749] T f4b8bd455d5a47c18a1380839c6e0d61 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:20:47.393837  6772 leader_election.cc:304] T 90d42e216d9741e190bca19a781291fd P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:20:47.320603 12238 raft_consensus.cc:2749] T e77e330a82df4b43a745d57a68f6f057 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:20:47.333745 11994 raft_consensus.cc:3060] T fe20b4b48823486ca3b9c648db6ce8aa P ccd8a4c3bfe3413cb2ae219b09aea832 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:47.381093 12334 raft_consensus.cc:697] T 3fa34c08b205435dba97346991aa1f92 P cd75a17ab2604397adab03bb8b5fd75c [term 18 LEADER]: Becoming Leader. State: Replica: cd75a17ab2604397adab03bb8b5fd75c, State: Running, Role: LEADER
I20260709 13:20:47.416877  6729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5be3a11b23d4ea9b08300a2789821c7" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:47.329026 12278 raft_consensus.cc:515] T bd6869f07b5a4885a0b99fbe60c3b175 P b7ab4784c7344b939bc36f639286f377 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:47.429140  6726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a75bfe094d4bdc963aba3f08dfcd25" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:47.401875 12288 raft_consensus.cc:515] T 44bde925b2e541b69890d70715b85176 P cd75a17ab2604397adab03bb8b5fd75c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:47.374719  6624 catalog_manager.cc:5697] T 4b8cacb381b746da8d0049b0a83b41dd P 7ba59cc884714e8aa5f3f0ecaed84cbb reported cstate change: term changed from 9 to 14, leader changed from ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65) to 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68). New cstate: current_term: 14 leader_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:20:47.449677 12340 consensus_queue.cc:1048] T 34f36d59d88f40fe8a2805e604fc6c0a P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:20:47.366854 12352 consensus_queue.cc:1048] T 7c37d41cd9164c15a6826ca62a851a69 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.068s
I20260709 13:20:47.456123 12398 raft_consensus.cc:2804] T 90d42e216d9741e190bca19a781291fd P b7ab4784c7344b939bc36f639286f377 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:20:47.461189  6732 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49744 (request call id 579) took 1642 ms. Trace:
I20260709 13:20:47.463310 12278 leader_election.cc:290] T bd6869f07b5a4885a0b99fbe60c3b175 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:47.488752  6800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "427c124d773f483294511e80fe340075" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:47.419910 12275 raft_consensus.cc:515] T 7887766dc6784fcaa42b35c05fea7a99 P b7ab4784c7344b939bc36f639286f377 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:47.496426  6803 raft_consensus.cc:2468] T d8cee0accdb8499c86d4414b72565a38 P b7ab4784c7344b939bc36f639286f377 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in term 16.
W20260709 13:20:47.501245  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 221716us
I20260709 13:20:47.517472  6727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "711ef6523deb4cbe8ef2ba61e1c21c98" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:47.521953 12347 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.BulkChangeConfig from 127.0.0.1:49742 (request call id 15) took 4160 ms. Trace:
I20260709 13:20:47.522466 12347 rpcz_store.cc:276] 0709 13:20:43.361153 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:44.027020 (+665867us) service_pool.cc:224] Handling call
0709 13:20:44.703226 (+676206us) spinlock_profiling.cc:243] Waited 476 ms on lock 0x7b5400285620. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f927520 00007fcc0f9b0b42 00007fcc0f9af800 00007fcc14970d29 00007fcc0deef1d4 00007fcc0deef162 00007fcc0deef091 00007fcc0deef00c 00007fcc0deee2c2 00007fcc0dce548c
0709 13:20:44.802346 (+ 99120us) log.cc:844] Serialized 499 byte log entry
0709 13:20:47.521755 (+2719409us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":148943,"raft.queue_time_us":148676,"raft.run_cpu_time_us":4235,"raft.run_wall_time_us":81912,"spinlock_wait_cycles":1096405120,"thread_start_us":305615,"threads_started":2,"wal-append.queue_time_us":270939,"wal-append.run_cpu_time_us":6664,"wal-append.run_wall_time_us":1255465}
I20260709 13:20:47.524194 12278 raft_consensus.cc:493] T f3f9c2e2bf644115957398fe4c9459db P b7ab4784c7344b939bc36f639286f377 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:47.524947 12278 raft_consensus.cc:515] T f3f9c2e2bf644115957398fe4c9459db P b7ab4784c7344b939bc36f639286f377 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:47.527249 12278 leader_election.cc:290] T f3f9c2e2bf644115957398fe4c9459db P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:47.523741  7466 leader_election.cc:304] T d8cee0accdb8499c86d4414b72565a38 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, b7ab4784c7344b939bc36f639286f377; no voters: 
I20260709 13:20:47.528420 12345 raft_consensus.cc:2804] T d8cee0accdb8499c86d4414b72565a38 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:20:47.528939 12345 raft_consensus.cc:697] T d8cee0accdb8499c86d4414b72565a38 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 16 LEADER]: Becoming Leader. State: Replica: 7ba59cc884714e8aa5f3f0ecaed84cbb, State: Running, Role: LEADER
I20260709 13:20:47.529922 12345 consensus_queue.cc:237] T d8cee0accdb8499c86d4414b72565a38 P 7ba59cc884714e8aa5f3f0ecaed84cbb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:20:47.532570  6844 leader_election.cc:304] T 30e88460611e47b2ba16a46a30b5f416 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:20:47.534195  6844 leader_election.cc:304] T bb3d8792045a4583ae2e965b1350a5b4 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:20:47.535379 12306 raft_consensus.cc:2749] T 30e88460611e47b2ba16a46a30b5f416 P cd75a17ab2604397adab03bb8b5fd75c [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:20:47.489372 12238 raft_consensus.cc:493] T 713b5728a197487c9300b310ab94e5a3 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:20:47.509125  6732 rpcz_store.cc:276] 0709 13:20:45.818289 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:46.035368 (+217079us) service_pool.cc:224] Handling call
0709 13:20:46.035670 (+   302us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:46.400292 (+364622us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:46.400375 (+    83us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:20:47.011454 (+611079us) spinlock_profiling.cc:243] Waited 7.34 ms on lock 0x7b2c00000f48. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0e2a3a11 00007fcc0e2b3372 00007fcc0f9e5a01 00007fcc0f9aa43a 00007fcc0f9a983e 00007fcc1496e419 00007fcc0dee5bd4 00007fcc0dee5b62 00007fcc0dee5a91 00007fcc0dee5a0c 00007fcc0dee4cc2
0709 13:20:47.041566 (+ 30112us) log.cc:844] Serialized 26 byte log entry
0709 13:20:47.266688 (+225122us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:20:47.275575 (+  8887us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:47.292450 (+ 16875us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:47.460740 (+168290us) raft_consensus.cc:1685] finished
0709 13:20:47.460760 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:47.460978 (+   218us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":20338,"raft.queue_time_us":69815,"raft.run_cpu_time_us":266,"raft.run_wall_time_us":42737,"spinlock_wait_cycles":16908544,"thread_start_us":562180,"threads_started":2,"wal-append.queue_time_us":384383}
I20260709 13:20:47.441293 12422 consensus_queue.cc:237] T 1bf4668eeb70467fb3dc5a0289233b3c P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:47.491628 12371 raft_consensus.cc:493] T 34f36d59d88f40fe8a2805e604fc6c0a P ccd8a4c3bfe3413cb2ae219b09aea832 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:20:47.336468  6629 rpcz_store.cc:269] 0709 13:20:07.852903 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:07.853211 (+   308us) service_pool.cc:224] Handling call
0709 13:20:47.335646 (+39482435us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:20:36.965926 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:20:37.020310 (+ 54384us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:20:37.020397 (+    87us) write_op.cc:435] Acquired schema lock
0709 13:20:37.020449 (+    52us) tablet.cc:662] Decoding operations
0709 13:20:37.107450 (+ 87001us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:20:37.107585 (+   135us) write_op.cc:641] Partition lock acquired for write op
0709 13:20:37.107611 (+    26us) tablet.cc:685] Acquiring locks for 25 operations
0709 13:20:37.380124 (+272513us) tablet.cc:701] Row locks acquired
0709 13:20:37.380188 (+    64us) write_op.cc:260] PREPARE: finished
0709 13:20:37.380403 (+   215us) write_op.cc:270] Start()
0709 13:20:37.380620 (+   217us) write_op.cc:276] Timestamp: P: 1783603237380327 usec, L: 0
0709 13:20:37.380667 (+    47us) op_driver.cc:348] REPLICATION: starting
0709 13:20:37.445291 (+ 64624us) log.cc:844] Serialized 9769 byte log entry
0709 13:20:38.146516 (+701225us) op_driver.cc:464] REPLICATION: finished
0709 13:20:38.370318 (+223802us) write_op.cc:301] APPLY: starting
0709 13:20:38.370434 (+   116us) tablet.cc:1367] starting BulkCheckPresence
0709 13:20:39.434316 (+1063882us) spinlock_profiling.cc:243] Waited 3.01 ms on lock 0x7b1800196300. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc15785de1 00007fcc157925b1 00007fcc0c8bd522 00007fcc0c8bf7c1 00007fcc0c8bf779 00007fcc0c8bf709 00007fcc0c8bf6d1 00007fcc0c8be9cd 000000000038f354 000000000038f199 00007fcc0c8a083a
0709 13:20:39.589128 (+154812us) tablet.cc:1370] finished BulkCheckPresence
0709 13:20:39.610779 (+ 21651us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:20:40.921379 (+1310600us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:20:40.921960 (+   581us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=50,key_file_lookups=50,delta_file_lookups=50,mrs_lookups=0
0709 13:20:40.922022 (+    62us) write_op.cc:312] APPLY: finished
0709 13:20:40.922772 (+   750us) log.cc:844] Serialized 219 byte log entry
0709 13:20:41.279541 (+356769us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:20:41.287080 (+  7539us) write_op.cc:454] Released schema lock
0709 13:20:41.317269 (+ 30189us) write_op.cc:341] FINISH: Updating metrics
0709 13:20:41.377051 (+ 59782us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:20:41.396326 (+ 19275us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":75365,"reported_tablets":55,"child_traces":[["op",{"apply.queue_time_us":188318,"apply.run_cpu_time_us":81316,"apply.run_wall_time_us":2995403,"cfile_cache_hit":102,"cfile_cache_hit_bytes":108527,"num_ops":25,"prepare.queue_time_us":393019,"prepare.run_cpu_time_us":34458,"prepare.run_wall_time_us":747451,"raft.queue_time_us":214452,"raft.run_cpu_time_us":9681,"raft.run_wall_time_us":107471,"replication_time_us":765650,"spinlock_wait_cycles":6923648,"thread_start_us":922673,"threads_started":5,"wal-append.queue_time_us":742034,"wal-append.run_cpu_time_us":28134,"wal-append.run_wall_time_us":2377616}]]}
I20260709 13:20:47.536005  6844 leader_election.cc:304] T 95a75bfe094d4bdc963aba3f08dfcd25 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:20:47.582177  6724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d33d5ee8ef6f415593d8df52063161ad" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:47.584412  6730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f03d0dbf16864ca4bc1bb5e4c0334c0f" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:47.584614  6729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c7f33e544204fbaac4078e3e83bbf4e" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:47.586364  6723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44bde925b2e541b69890d70715b85176" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:47.600879  6724 raft_consensus.cc:2468] T d33d5ee8ef6f415593d8df52063161ad P ccd8a4c3bfe3413cb2ae219b09aea832 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 13.
I20260709 13:20:47.550544  6807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3f13b31a1f84f0d89d007eadd57924c" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:47.580827 12371 raft_consensus.cc:515] T 34f36d59d88f40fe8a2805e604fc6c0a P ccd8a4c3bfe3413cb2ae219b09aea832 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
W20260709 13:20:47.605417  6772 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 109580us
W20260709 13:20:47.610502  6697 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 246236us
I20260709 13:20:47.508962 12398 raft_consensus.cc:493] T 90d42e216d9741e190bca19a781291fd P b7ab4784c7344b939bc36f639286f377 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:47.617414  6727 raft_consensus.cc:2393] T 711ef6523deb4cbe8ef2ba61e1c21c98 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7ab4784c7344b939bc36f639286f377 in current term 18: Already voted for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in this term.
I20260709 13:20:47.536661 12306 raft_consensus.cc:2749] T bb3d8792045a4583ae2e965b1350a5b4 P cd75a17ab2604397adab03bb8b5fd75c [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:20:47.604723 12438 log.cc:927] Time spent T c4db81d9d329422bb3b4160ca4ac2d1d P cd75a17ab2604397adab03bb8b5fd75c: Append to log took a long time: real 0.201s	user 0.000s	sys 0.001s
I20260709 13:20:47.540330 12159 leader_election.cc:290] T d8292e16e5654be6bc408560cf256aaa P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:47.627199  6732 raft_consensus.cc:1275] T 22ccee1b570c4ad3a57bd7aec085b1b4 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 14 FOLLOWER]: Refusing update from remote peer b7ab4784c7344b939bc36f639286f377: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:20:47.580279  6624 catalog_manager.cc:5697] T fe20b4b48823486ca3b9c648db6ce8aa P 7ba59cc884714e8aa5f3f0ecaed84cbb reported cstate change: term changed from 8 to 11, leader changed from 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68) to cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67). New cstate: current_term: 11 leader_uuid: "cd75a17ab2604397adab03bb8b5fd75c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } } }
I20260709 13:20:47.632839  6723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30e88460611e47b2ba16a46a30b5f416" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:47.633602 12267 leader_election.cc:290] T 4b8cacb381b746da8d0049b0a83b41dd P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:47.536731 12238 raft_consensus.cc:515] T 713b5728a197487c9300b310ab94e5a3 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:47.633805  6624 catalog_manager.cc:5697] T ce4f062dcd314d43a63ca74067cb5ee3 P 7ba59cc884714e8aa5f3f0ecaed84cbb reported cstate change: term changed from 10 to 14. New cstate: current_term: 14 leader_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:20:47.635891 12238 leader_election.cc:290] T 713b5728a197487c9300b310ab94e5a3 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:47.629726 12396 raft_consensus.cc:2804] T 7c44c4849aa54f2b94d1f1bef9ed546f P b7ab4784c7344b939bc36f639286f377 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:20:47.636620 12396 raft_consensus.cc:493] T 7c44c4849aa54f2b94d1f1bef9ed546f P b7ab4784c7344b939bc36f639286f377 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:47.637046 12396 raft_consensus.cc:3060] T 7c44c4849aa54f2b94d1f1bef9ed546f P b7ab4784c7344b939bc36f639286f377 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:20:47.637642  6873 raft_consensus.cc:1240] T b56bf91d90824c959e21e0cee5ba1816 P cd75a17ab2604397adab03bb8b5fd75c [term 15 FOLLOWER]: Rejecting Update request from peer ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 14. Current term is 15. Ops: []
I20260709 13:20:47.637753  7500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fa34c08b205435dba97346991aa1f92" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:20:47.638377  7500 raft_consensus.cc:2468] T 3fa34c08b205435dba97346991aa1f92 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 18.
I20260709 13:20:47.639271  6878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fa34c08b205435dba97346991aa1f92" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:47.640549  7503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce4f062dcd314d43a63ca74067cb5ee3" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:20:47.641355  6872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab432e62819d499eaaf3dd55481dd930" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:47.641551 12288 leader_election.cc:290] T 44bde925b2e541b69890d70715b85176 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:20:47.643961  6873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce4f062dcd314d43a63ca74067cb5ee3" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
W20260709 13:20:47.647481 12444 log.cc:927] Time spent T 853ac0a8cbd64ce99457f170216d4d0f P cd75a17ab2604397adab03bb8b5fd75c: Append to log took a long time: real 0.071s	user 0.001s	sys 0.001s
W20260709 13:20:47.648523  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 112654us
I20260709 13:20:47.649652 12275 leader_election.cc:290] T 7887766dc6784fcaa42b35c05fea7a99 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:47.650208  6844 leader_election.cc:304] T 07a92dd554674067a83a9cb68c4773f2 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:20:47.651130 12288 raft_consensus.cc:2749] T 07a92dd554674067a83a9cb68c4773f2 P cd75a17ab2604397adab03bb8b5fd75c [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:20:47.657371 12306 raft_consensus.cc:493] T 427c124d773f483294511e80fe340075 P cd75a17ab2604397adab03bb8b5fd75c [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 7ba59cc884714e8aa5f3f0ecaed84cbb)
I20260709 13:20:47.658195 12306 raft_consensus.cc:515] T 427c124d773f483294511e80fe340075 P cd75a17ab2604397adab03bb8b5fd75c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } attrs { replace: true } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:20:47.659572  6806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bf4668eeb70467fb3dc5a0289233b3c" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:20:47.617218 12398 raft_consensus.cc:3060] T 90d42e216d9741e190bca19a781291fd P b7ab4784c7344b939bc36f639286f377 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:47.660358  6806 raft_consensus.cc:3060] T 1bf4668eeb70467fb3dc5a0289233b3c P b7ab4784c7344b939bc36f639286f377 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:47.661381  6807 raft_consensus.cc:1275] T 20f6842e26174571996b8dea4151d4be P b7ab4784c7344b939bc36f639286f377 [term 17 FOLLOWER]: Refusing update from remote peer ccd8a4c3bfe3413cb2ae219b09aea832: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 13:20:47.662421  6807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4db81d9d329422bb3b4160ca4ac2d1d" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:47.662693  6801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab432e62819d499eaaf3dd55481dd930" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:47.664249  6805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3022224cc81473690653a83d4e99470" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:47.664915  6805 raft_consensus.cc:2468] T a3022224cc81473690653a83d4e99470 P b7ab4784c7344b939bc36f639286f377 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 17.
I20260709 13:20:47.651739  6729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "404190ce4ce94cecbfcb6ea9d1dd8626" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:47.665055  6772 leader_election.cc:304] T 8c7f33e544204fbaac4078e3e83bbf4e P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:20:47.612072 11937 leader_election.cc:290] T 9b3759de40694069b13c0f8bd40e5709 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:20:47.442400 12194 consensus_queue.cc:237] T fe20b4b48823486ca3b9c648db6ce8aa P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:20:47.699079  6880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44bde925b2e541b69890d70715b85176" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:47.700800  6880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30e88460611e47b2ba16a46a30b5f416" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:47.702260  6880 raft_consensus.cc:1240] T 9e326172347f45e99a0d482b5d8ef768 P cd75a17ab2604397adab03bb8b5fd75c [term 13 FOLLOWER]: Rejecting Update request from peer b7ab4784c7344b939bc36f639286f377 for earlier term 12. Current term is 13. Ops: []
I20260709 13:20:47.703647  6877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f03d0dbf16864ca4bc1bb5e4c0334c0f" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:47.704273  6877 raft_consensus.cc:2468] T f03d0dbf16864ca4bc1bb5e4c0334c0f P cd75a17ab2604397adab03bb8b5fd75c [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 15.
I20260709 13:20:47.705211  6877 raft_consensus.cc:1240] T e77e330a82df4b43a745d57a68f6f057 P cd75a17ab2604397adab03bb8b5fd75c [term 17 FOLLOWER]: Rejecting Update request from peer b7ab4784c7344b939bc36f639286f377 for earlier term 16. Current term is 17. Ops: []
I20260709 13:20:47.706265 12342 raft_consensus.cc:2804] T 8c7f33e544204fbaac4078e3e83bbf4e P b7ab4784c7344b939bc36f639286f377 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:20:47.706709 12342 raft_consensus.cc:493] T 8c7f33e544204fbaac4078e3e83bbf4e P b7ab4784c7344b939bc36f639286f377 [term 13 FOLLOWER]: Starting leader election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:20:47.707043 12342 raft_consensus.cc:3060] T 8c7f33e544204fbaac4078e3e83bbf4e P b7ab4784c7344b939bc36f639286f377 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:47.698170  6876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d33d5ee8ef6f415593d8df52063161ad" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:47.713176  6876 raft_consensus.cc:2468] T d33d5ee8ef6f415593d8df52063161ad P cd75a17ab2604397adab03bb8b5fd75c [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 13.
I20260709 13:20:47.729275  6731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1528ab62b6fe4e3099d08f141afee116" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:47.627104 12097 raft_consensus.cc:2749] T 95a75bfe094d4bdc963aba3f08dfcd25 P cd75a17ab2604397adab03bb8b5fd75c [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:20:47.730841  7469 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:47.733315  6723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a92dd554674067a83a9cb68c4773f2" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:47.736123  6877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4db81d9d329422bb3b4160ca4ac2d1d" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:47.741565  6879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3022224cc81473690653a83d4e99470" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:47.750010  6800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce4f062dcd314d43a63ca74067cb5ee3" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:47.768510  6724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4b8bd455d5a47c18a1380839c6e0d61" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:47.774878  6724 raft_consensus.cc:2393] T f4b8bd455d5a47c18a1380839c6e0d61 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7ab4784c7344b939bc36f639286f377 in current term 16: Already voted for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in this term.
W20260709 13:20:47.775207  6697 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:47.774009  7503 raft_consensus.cc:1240] T fe20b4b48823486ca3b9c648db6ce8aa P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 13 FOLLOWER]: Rejecting Update request from peer ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 12. Current term is 13. Ops: []
I20260709 13:20:47.778793  6723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d65025eea89441290d85dd053810e31" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:47.779467  7501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1528ab62b6fe4e3099d08f141afee116" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:20:47.781147  7500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "404190ce4ce94cecbfcb6ea9d1dd8626" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:20:47.789234  6731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de3186201e1a40d0b335eeb8b4e256e0" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:47.789698  6879 raft_consensus.cc:2393] T a3022224cc81473690653a83d4e99470 P cd75a17ab2604397adab03bb8b5fd75c [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ccd8a4c3bfe3413cb2ae219b09aea832 in current term 17: Already voted for candidate cd75a17ab2604397adab03bb8b5fd75c in this term.
I20260709 13:20:47.789942  6727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f58dc08b12a2494bb9a1372837970ca2" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:47.749279 11937 raft_consensus.cc:493] T b56bf91d90824c959e21e0cee5ba1816 P cd75a17ab2604397adab03bb8b5fd75c [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:47.811156  6732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be1a92657f494cac8dd227d152f50151" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:47.788055  6875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a92dd554674067a83a9cb68c4773f2" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:47.788256  6881 raft_consensus.cc:2955] T 95a75bfe094d4bdc963aba3f08dfcd25 P cd75a17ab2604397adab03bb8b5fd75c [term 13 FOLLOWER]: Committing config change with OpId 13.7: config changed from index -1 to 7, NON_VOTER 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68) added. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } attrs { replace: true } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: NON_VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: true } } }
I20260709 13:20:47.798527  6874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4b8bd455d5a47c18a1380839c6e0d61" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:47.800812 12353 raft_consensus.cc:2764] T d8cee0accdb8499c86d4414b72565a38 P b7ab4784c7344b939bc36f639286f377 [term 16 FOLLOWER]: Leader pre-election decision vote started in defunct term 15: won
I20260709 13:20:47.802626  6726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7887766dc6784fcaa42b35c05fea7a99" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:47.792663 12275 raft_consensus.cc:493] T 4d9def8b32fd443aa94ab1420b06837b P b7ab4784c7344b939bc36f639286f377 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:20:47.808245 12086 consensus_queue.cc:1059] T 711ef6523deb4cbe8ef2ba61e1c21c98 P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: INVALID_TERM, Last received: 17.10, Next index: 11, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:20:47.821184  6876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de3186201e1a40d0b335eeb8b4e256e0" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:47.813476  6724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6869f07b5a4885a0b99fbe60c3b175" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
W20260709 13:20:47.834883  6697 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:47.814863  6874 raft_consensus.cc:2468] T f4b8bd455d5a47c18a1380839c6e0d61 P cd75a17ab2604397adab03bb8b5fd75c [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 16.
I20260709 13:20:47.621635 12334 consensus_queue.cc:237] T 3fa34c08b205435dba97346991aa1f92 P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.14, Last appended by leader: 14, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:20:47.833007  6806 raft_consensus.cc:2468] T 1bf4668eeb70467fb3dc5a0289233b3c P b7ab4784c7344b939bc36f639286f377 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 16.
I20260709 13:20:47.814343  6723 raft_consensus.cc:2468] T 3d65025eea89441290d85dd053810e31 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 16.
I20260709 13:20:47.836460  6729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8292e16e5654be6bc408560cf256aaa" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:47.842202  6877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8292e16e5654be6bc408560cf256aaa" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:47.840363  7503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be1a92657f494cac8dd227d152f50151" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:20:47.843272  7503 raft_consensus.cc:2468] T be1a92657f494cac8dd227d152f50151 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 16.
I20260709 13:20:47.850554  6731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f9c2e2bf644115957398fe4c9459db" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 16 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
W20260709 13:20:47.854297  7468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 112441us
I20260709 13:20:47.857754  6727 raft_consensus.cc:2468] T f58dc08b12a2494bb9a1372837970ca2 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 17.
I20260709 13:20:47.785131 12159 consensus_queue.cc:1048] T 34f36d59d88f40fe8a2805e604fc6c0a P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.062s
I20260709 13:20:47.862694  6874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f58dc08b12a2494bb9a1372837970ca2" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
W20260709 13:20:47.736994  6614 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 427c124d773f483294511e80fe340075 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER failed with leader b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica b7ab4784c7344b939bc36f639286f377 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 14 leader_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } attrs { replace: true } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } } }
I20260709 13:20:47.855181 12278 raft_consensus.cc:493] T 7a734b5ab7834e05a8c422208acc58b1 P b7ab4784c7344b939bc36f639286f377 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:47.869869  6879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d65025eea89441290d85dd053810e31" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:47.897100  6879 raft_consensus.cc:2393] T 3d65025eea89441290d85dd053810e31 P cd75a17ab2604397adab03bb8b5fd75c [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7ab4784c7344b939bc36f639286f377 in current term 16: Already voted for candidate cd75a17ab2604397adab03bb8b5fd75c in this term.
I20260709 13:20:47.871750  6875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6869f07b5a4885a0b99fbe60c3b175" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:47.839903 12396 raft_consensus.cc:515] T 7c44c4849aa54f2b94d1f1bef9ed546f P b7ab4784c7344b939bc36f639286f377 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:47.839668 12275 raft_consensus.cc:515] T 4d9def8b32fd443aa94ab1420b06837b P b7ab4784c7344b939bc36f639286f377 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
W20260709 13:20:47.901836  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 101144us
W20260709 13:20:47.902855  6614 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 166099us
I20260709 13:20:47.848011 11937 raft_consensus.cc:515] T b56bf91d90824c959e21e0cee5ba1816 P cd75a17ab2604397adab03bb8b5fd75c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:47.857582 12340 consensus_queue.cc:1048] T 7c37d41cd9164c15a6826ca62a851a69 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.039s
I20260709 13:20:47.908509  6731 raft_consensus.cc:2468] T f3f9c2e2bf644115957398fe4c9459db P ccd8a4c3bfe3413cb2ae219b09aea832 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 15.
I20260709 13:20:47.913861  6878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7887766dc6784fcaa42b35c05fea7a99" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
W20260709 13:20:47.907281 12335 consensus_meta.cc:287] T 4275cf08e63345f993bce8664eada830 P cd75a17ab2604397adab03bb8b5fd75c: Time spent flushing consensus metadata: real 0.607s	user 0.013s	sys 0.000s
I20260709 13:20:47.902062 12371 leader_election.cc:290] T 34f36d59d88f40fe8a2805e604fc6c0a P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:47.982319  6805 raft_consensus.cc:1240] T 7c44c4849aa54f2b94d1f1bef9ed546f P b7ab4784c7344b939bc36f639286f377 [term 18 FOLLOWER]: Rejecting Update request from peer ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 17. Current term is 18. Ops: [17.12-17.12]
I20260709 13:20:47.911080  6875 raft_consensus.cc:2468] T bd6869f07b5a4885a0b99fbe60c3b175 P cd75a17ab2604397adab03bb8b5fd75c [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 16.
I20260709 13:20:47.945551 12306 leader_election.cc:290] T 427c124d773f483294511e80fe340075 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:20:47.889567 12246 consensus_queue.cc:1059] T f09c2a98de1a4decabd0ff900dd44caa P b7ab4784c7344b939bc36f639286f377 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: INVALID_TERM, Last received: 16.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.091s
I20260709 13:20:47.959138  7496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "427c124d773f483294511e80fe340075" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:20:47.961071  6772 leader_election.cc:304] T bb7fa124c3bf4ef9ab65a407cb008441 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, b7ab4784c7344b939bc36f639286f377; no voters: cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:20:47.981173  6878 raft_consensus.cc:2468] T 7887766dc6784fcaa42b35c05fea7a99 P cd75a17ab2604397adab03bb8b5fd75c [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 16.
I20260709 13:20:47.985854  6727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b8cacb381b746da8d0049b0a83b41dd" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:47.990290  6879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f9c2e2bf644115957398fe4c9459db" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 16 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
W20260709 13:20:48.049567  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 116937us
I20260709 13:20:48.057370  6741 tablet_copy_service.cc:140] P ccd8a4c3bfe3413cb2ae219b09aea832: Received BeginTabletCopySession request for tablet 95a75bfe094d4bdc963aba3f08dfcd25 from peer 7ba59cc884714e8aa5f3f0ecaed84cbb ({username='slave'} at 127.0.0.1:49744)
I20260709 13:20:48.058512  6741 tablet_copy_service.cc:161] P ccd8a4c3bfe3413cb2ae219b09aea832: Beginning new tablet copy session on tablet 95a75bfe094d4bdc963aba3f08dfcd25 from peer 7ba59cc884714e8aa5f3f0ecaed84cbb at {username='slave'} at 127.0.0.1:49744: session id = 7ba59cc884714e8aa5f3f0ecaed84cbb-95a75bfe094d4bdc963aba3f08dfcd25
W20260709 13:20:48.058952  6770 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 79583.5us
I20260709 13:20:48.060215  6770 leader_election.cc:304] T 3a485a995abc4807b6e511e45419f737 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:20:48.061908  6770 leader_election.cc:304] T 3411566abe2d4c9bb4b2adfdd05e6f17 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:20:48.064395 12353 raft_consensus.cc:2804] T bb7fa124c3bf4ef9ab65a407cb008441 P b7ab4784c7344b939bc36f639286f377 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:20:48.065115 12353 raft_consensus.cc:493] T bb7fa124c3bf4ef9ab65a407cb008441 P b7ab4784c7344b939bc36f639286f377 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 7ba59cc884714e8aa5f3f0ecaed84cbb)
I20260709 13:20:48.065608 12353 raft_consensus.cc:3060] T bb7fa124c3bf4ef9ab65a407cb008441 P b7ab4784c7344b939bc36f639286f377 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:48.068594 12367 raft_consensus.cc:493] T 24ee15416e3145beaa1b8183453729a3 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:48.069274 12367 raft_consensus.cc:515] T 24ee15416e3145beaa1b8183453729a3 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:20:48.077369 12288 raft_consensus.cc:3055] T 711ef6523deb4cbe8ef2ba61e1c21c98 P cd75a17ab2604397adab03bb8b5fd75c [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:20:48.077950 12288 raft_consensus.cc:740] T 711ef6523deb4cbe8ef2ba61e1c21c98 P cd75a17ab2604397adab03bb8b5fd75c [term 17 LEADER]: Becoming Follower/Learner. State: Replica: cd75a17ab2604397adab03bb8b5fd75c, State: Running, Role: LEADER
I20260709 13:20:48.078956 12288 consensus_queue.cc:260] T 711ef6523deb4cbe8ef2ba61e1c21c98 P cd75a17ab2604397adab03bb8b5fd75c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:48.000941 12246 raft_consensus.cc:3055] T f09c2a98de1a4decabd0ff900dd44caa P b7ab4784c7344b939bc36f639286f377 [term 16 LEADER]: Stepping down as leader of term 16
W20260709 13:20:48.091185  6772 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.68:45071, user_credentials={real_user=slave}} blocked reactor thread for 130210us
I20260709 13:20:48.011168 12417 raft_consensus.cc:493] T ce4f062dcd314d43a63ca74067cb5ee3 P cd75a17ab2604397adab03bb8b5fd75c [term 15 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:20:47.982497 12335 raft_consensus.cc:515] T 4275cf08e63345f993bce8664eada830 P cd75a17ab2604397adab03bb8b5fd75c [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:48.083988 12306 consensus_queue.cc:1048] T f3f9c2e2bf644115957398fe4c9459db P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Connected to new peer: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.053s
I20260709 13:20:48.138952 12335 leader_election.cc:290] T 4275cf08e63345f993bce8664eada830 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 14 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
W20260709 13:20:48.140820  6698 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:47.933600 12278 raft_consensus.cc:515] T 7a734b5ab7834e05a8c422208acc58b1 P b7ab4784c7344b939bc36f639286f377 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } attrs { replace: true } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: NON_VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: true } }
I20260709 13:20:48.113631 12417 raft_consensus.cc:515] T ce4f062dcd314d43a63ca74067cb5ee3 P cd75a17ab2604397adab03bb8b5fd75c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } attrs { replace: true } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:20:48.120744 12240 raft_consensus.cc:493] T 22ccee1b570c4ad3a57bd7aec085b1b4 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:48.122974 12452 raft_consensus.cc:493] T f09c2a98de1a4decabd0ff900dd44caa P ccd8a4c3bfe3413cb2ae219b09aea832 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:48.126940  6844 leader_election.cc:304] T b56bf91d90824c959e21e0cee5ba1816 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:20:48.128536  6798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34f36d59d88f40fe8a2805e604fc6c0a" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:48.129554 11937 leader_election.cc:290] T b56bf91d90824c959e21e0cee5ba1816 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:20:48.131263 12275 leader_election.cc:290] T 4d9def8b32fd443aa94ab1420b06837b P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:48.133698 12396 leader_election.cc:290] T 7c44c4849aa54f2b94d1f1bef9ed546f P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 18 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:48.095239 12246 raft_consensus.cc:740] T f09c2a98de1a4decabd0ff900dd44caa P b7ab4784c7344b939bc36f639286f377 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
I20260709 13:20:48.102659 12398 raft_consensus.cc:515] T 90d42e216d9741e190bca19a781291fd P b7ab4784c7344b939bc36f639286f377 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:48.111243  6805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "713b5728a197487c9300b310ab94e5a3" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:48.145174  6875 raft_consensus.cc:1240] T 4275cf08e63345f993bce8664eada830 P cd75a17ab2604397adab03bb8b5fd75c [term 14 FOLLOWER]: Rejecting Update request from peer b7ab4784c7344b939bc36f639286f377 for earlier term 13. Current term is 14. Ops: []
W20260709 13:20:48.150053  6770 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 88263us
W20260709 13:20:48.148681 12271 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.610s	user 0.083s	sys 0.115s
I20260709 13:20:48.094858 12367 leader_election.cc:290] T 24ee15416e3145beaa1b8183453729a3 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
W20260709 13:20:48.163007  6772 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.68:45071, user_credentials={real_user=slave}} blocked reactor thread for 67115.4us
I20260709 13:20:48.179836  6770 leader_election.cc:304] T 20f6842e26174571996b8dea4151d4be P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:20:48.107968 12427 raft_consensus.cc:2749] T 3411566abe2d4c9bb4b2adfdd05e6f17 P b7ab4784c7344b939bc36f639286f377 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:20:48.181581  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 54798.1us
I20260709 13:20:48.211833  6772 leader_election.cc:304] T be1a92657f494cac8dd227d152f50151 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, b7ab4784c7344b939bc36f639286f377; no voters: 
W20260709 13:20:48.189591 12271 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.650s	user 0.083s	sys 0.116s
W20260709 13:20:48.227911  6770 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 48214.5us
W20260709 13:20:48.229425  6697 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.68:45071, user_credentials={real_user=slave}} blocked reactor thread for 73210.8us
I20260709 13:20:48.191882 12288 raft_consensus.cc:3060] T 711ef6523deb4cbe8ef2ba61e1c21c98 P cd75a17ab2604397adab03bb8b5fd75c [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:20:48.192899 12335 raft_consensus.cc:2804] T b56bf91d90824c959e21e0cee5ba1816 P cd75a17ab2604397adab03bb8b5fd75c [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:20:48.171689 12240 raft_consensus.cc:515] T 22ccee1b570c4ad3a57bd7aec085b1b4 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:48.241547 12311 raft_consensus.cc:493] T 404190ce4ce94cecbfcb6ea9d1dd8626 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 14 FOLLOWER]: Starting pre-election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:20:48.217588 12227 raft_consensus.cc:493] T bb3d8792045a4583ae2e965b1350a5b4 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:48.226701 12352 raft_consensus.cc:2749] T 3a485a995abc4807b6e511e45419f737 P b7ab4784c7344b939bc36f639286f377 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:20:48.247543  6877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d9def8b32fd443aa94ab1420b06837b" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:48.250602  6878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c44c4849aa54f2b94d1f1bef9ed546f" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 18 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:20:48.226521 12340 raft_consensus.cc:2749] T 20f6842e26174571996b8dea4151d4be P b7ab4784c7344b939bc36f639286f377 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:20:48.231523 12347 raft_consensus.cc:493] T 7c37d41cd9164c15a6826ca62a851a69 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:48.226776 12451 raft_consensus.cc:493] T 17587d6730594da4a56fa13a353232a1 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 7ba59cc884714e8aa5f3f0ecaed84cbb)
W20260709 13:20:48.254437  7468 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.5.126.67:42931 timed out after 1.751s (SENT) [suppressed 6 similar messages]
W20260709 13:20:48.247628 12342 consensus_meta.cc:287] T 8c7f33e544204fbaac4078e3e83bbf4e P b7ab4784c7344b939bc36f639286f377: Time spent flushing consensus metadata: real 0.540s	user 0.011s	sys 0.002s
W20260709 13:20:48.272773  6770 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 44068us
W20260709 13:20:48.279343  6696 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:48.192224 12452 raft_consensus.cc:515] T f09c2a98de1a4decabd0ff900dd44caa P ccd8a4c3bfe3413cb2ae219b09aea832 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:48.274323  6770 leader_election.cc:304] T 95a75bfe094d4bdc963aba3f08dfcd25 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:20:48.245832 12397 raft_consensus.cc:493] T f5be3a11b23d4ea9b08300a2789821c7 P cd75a17ab2604397adab03bb8b5fd75c [term 14 FOLLOWER]: Starting pre-election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:20:48.229332  6806 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "34f36d59d88f40fe8a2805e604fc6c0a"
dest_uuid: "b7ab4784c7344b939bc36f639286f377"
mode: GRACEFUL
new_leader_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
 from {username='slave'} at 127.0.0.1:38240
I20260709 13:20:48.290269  6697 leader_election.cc:304] T 3fa34c08b205435dba97346991aa1f92 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
I20260709 13:20:48.290786  6806 raft_consensus.cc:606] T 34f36d59d88f40fe8a2805e604fc6c0a P b7ab4784c7344b939bc36f639286f377 [term 14 LEADER]: Received request to transfer leadership to TS cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:20:48.286374  6877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3d8792045a4583ae2e965b1350a5b4" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:20:48.288098 12342 raft_consensus.cc:515] T 8c7f33e544204fbaac4078e3e83bbf4e P b7ab4784c7344b939bc36f639286f377 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:48.298767 12342 leader_election.cc:290] T 8c7f33e544204fbaac4078e3e83bbf4e P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 14 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:48.300712 12417 leader_election.cc:290] T ce4f062dcd314d43a63ca74067cb5ee3 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:20:48.306097 12240 leader_election.cc:290] T 22ccee1b570c4ad3a57bd7aec085b1b4 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:48.308239 12398 leader_election.cc:290] T 90d42e216d9741e190bca19a781291fd P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 16 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:48.251317 12246 consensus_queue.cc:260] T f09c2a98de1a4decabd0ff900dd44caa P b7ab4784c7344b939bc36f639286f377 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:48.309957 12246 raft_consensus.cc:3060] T f09c2a98de1a4decabd0ff900dd44caa P b7ab4784c7344b939bc36f639286f377 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:48.307940  7496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce4f062dcd314d43a63ca74067cb5ee3" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
W20260709 13:20:48.321650  6695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 67442.9us
I20260709 13:20:48.322860  6807 raft_consensus.cc:1275] T d8cee0accdb8499c86d4414b72565a38 P b7ab4784c7344b939bc36f639286f377 [term 16 FOLLOWER]: Refusing update from remote peer 7ba59cc884714e8aa5f3f0ecaed84cbb: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:20:48.326119 12451 raft_consensus.cc:515] T 17587d6730594da4a56fa13a353232a1 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:20:48.289909 11634 raft_consensus.cc:493] T 7a734b5ab7834e05a8c422208acc58b1 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:48.328260 12238 raft_consensus.cc:2804] T 3fa34c08b205435dba97346991aa1f92 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:20:48.328722 12238 raft_consensus.cc:493] T 3fa34c08b205435dba97346991aa1f92 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:48.329104 12238 raft_consensus.cc:3060] T 3fa34c08b205435dba97346991aa1f92 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:20:48.332870 12462 log.cc:927] Time spent T 3a485a995abc4807b6e511e45419f737 P ccd8a4c3bfe3413cb2ae219b09aea832: Append to log took a long time: real 0.070s	user 0.000s	sys 0.000s
W20260709 13:20:48.336848 12468 log.cc:927] Time spent T 2c240553ce044eedb41541d72b9475d7 P ccd8a4c3bfe3413cb2ae219b09aea832: Append to log took a long time: real 0.094s	user 0.000s	sys 0.000s
I20260709 13:20:48.340561 12397 raft_consensus.cc:515] T f5be3a11b23d4ea9b08300a2789821c7 P cd75a17ab2604397adab03bb8b5fd75c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
W20260709 13:20:48.351141  7469 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:48.260027 12335 raft_consensus.cc:697] T b56bf91d90824c959e21e0cee5ba1816 P cd75a17ab2604397adab03bb8b5fd75c [term 15 LEADER]: Becoming Leader. State: Replica: cd75a17ab2604397adab03bb8b5fd75c, State: Running, Role: LEADER
I20260709 13:20:48.353056 12335 consensus_queue.cc:237] T b56bf91d90824c959e21e0cee5ba1816 P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
W20260709 13:20:48.354143 12453 log.cc:927] Time spent T 3411566abe2d4c9bb4b2adfdd05e6f17 P ccd8a4c3bfe3413cb2ae219b09aea832: Append to log took a long time: real 0.367s	user 0.003s	sys 0.000s
W20260709 13:20:48.355923 12437 log.cc:927] Time spent T e31b9971c15848dea59d4d4130141d9e P cd75a17ab2604397adab03bb8b5fd75c: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
I20260709 13:20:48.357491 12278 leader_election.cc:290] T 7a734b5ab7834e05a8c422208acc58b1 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
W20260709 13:20:48.358731 12467 log.cc:927] Time spent T 7ba5dac66ab5497e9e336f2a3c28cda5 P 7ba59cc884714e8aa5f3f0ecaed84cbb: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
I20260709 13:20:48.360167  6695 leader_election.cc:304] T b3f13b31a1f84f0d89d007eadd57924c P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, b7ab4784c7344b939bc36f639286f377
I20260709 13:20:48.361106  6875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "713b5728a197487c9300b310ab94e5a3" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:48.362731  6875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8cee0accdb8499c86d4414b72565a38" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
W20260709 13:20:48.364796  6770 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 90590.4us
I20260709 13:20:48.366344  6770 leader_election.cc:304] T f5be3a11b23d4ea9b08300a2789821c7 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:20:48.364769  6875 raft_consensus.cc:2468] T d8cee0accdb8499c86d4414b72565a38 P cd75a17ab2604397adab03bb8b5fd75c [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in term 15.
W20260709 13:20:48.369383  6772 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 122633us
I20260709 13:20:48.271226 12367 raft_consensus.cc:493] T a1704639a875409b9959353527b3fd68 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:48.370373  6772 leader_election.cc:304] T f03d0dbf16864ca4bc1bb5e4c0334c0f P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:20:48.373369  6877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ba5dac66ab5497e9e336f2a3c28cda5" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:48.380887  6697 leader_election.cc:304] T ce4f062dcd314d43a63ca74067cb5ee3 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:20:48.378352  6877 raft_consensus.cc:2468] T 7ba5dac66ab5497e9e336f2a3c28cda5 P cd75a17ab2604397adab03bb8b5fd75c [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in term 16.
I20260709 13:20:48.386674  6877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ba5dac66ab5497e9e336f2a3c28cda5" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:20:48.387626  6877 raft_consensus.cc:3060] T 7ba5dac66ab5497e9e336f2a3c28cda5 P cd75a17ab2604397adab03bb8b5fd75c [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:48.263959 12347 raft_consensus.cc:515] T 7c37d41cd9164c15a6826ca62a851a69 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:48.260433 12227 raft_consensus.cc:515] T bb3d8792045a4583ae2e965b1350a5b4 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:20:48.407750  6875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24ee15416e3145beaa1b8183453729a3" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:48.407289  6772 leader_election.cc:304] T d33d5ee8ef6f415593d8df52063161ad P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:20:48.406337 12278 raft_consensus.cc:493] T a1704639a875409b9959353527b3fd68 P b7ab4784c7344b939bc36f639286f377 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:48.378504 12398 raft_consensus.cc:2749] T 95a75bfe094d4bdc963aba3f08dfcd25 P b7ab4784c7344b939bc36f639286f377 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:20:48.377777 12159 raft_consensus.cc:2749] T f5be3a11b23d4ea9b08300a2789821c7 P b7ab4784c7344b939bc36f639286f377 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:20:48.285871 12311 raft_consensus.cc:515] T 404190ce4ce94cecbfcb6ea9d1dd8626 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
W20260709 13:20:48.430038 12469 log.cc:927] Time spent T 7c44c4849aa54f2b94d1f1bef9ed546f P cd75a17ab2604397adab03bb8b5fd75c: Append to log took a long time: real 0.091s	user 0.002s	sys 0.000s
I20260709 13:20:48.433462 12347 leader_election.cc:290] T 7c37d41cd9164c15a6826ca62a851a69 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:48.433920 12370 raft_consensus.cc:2749] T b3f13b31a1f84f0d89d007eadd57924c P ccd8a4c3bfe3413cb2ae219b09aea832 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:20:48.434573  6695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 74540.9us
I20260709 13:20:48.435549 12397 leader_election.cc:290] T f5be3a11b23d4ea9b08300a2789821c7 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:20:48.425827 12342 raft_consensus.cc:2804] T f03d0dbf16864ca4bc1bb5e4c0334c0f P b7ab4784c7344b939bc36f639286f377 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:20:48.440611 12451 leader_election.cc:290] T 17587d6730594da4a56fa13a353232a1 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:20:48.441457  6741 tablet_copy_source_session.cc:215] T 95a75bfe094d4bdc963aba3f08dfcd25 P ccd8a4c3bfe3413cb2ae219b09aea832: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:20:48.391291 12449 raft_consensus.cc:2749] T ce4f062dcd314d43a63ca74067cb5ee3 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:20:48.443373  6770 leader_election.cc:304] T 44bde925b2e541b69890d70715b85176 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:20:48.446096  6875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b8cacb381b746da8d0049b0a83b41dd" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:48.445830 12278 raft_consensus.cc:515] T a1704639a875409b9959353527b3fd68 P b7ab4784c7344b939bc36f639286f377 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:48.447041 12345 consensus_queue.cc:1048] T 4f00a2e87e56452083b759f60d461ee3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:20:48.371474 12275 consensus_queue.cc:1059] T 9e326172347f45e99a0d482b5d8ef768 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.039s
I20260709 13:20:48.395080 11634 raft_consensus.cc:515] T 7a734b5ab7834e05a8c422208acc58b1 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
W20260709 13:20:48.454276  6772 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 47071.4us
I20260709 13:20:48.489953 12396 raft_consensus.cc:2804] T be1a92657f494cac8dd227d152f50151 P b7ab4784c7344b939bc36f639286f377 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:20:48.478642  6729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe20b4b48823486ca3b9c648db6ce8aa" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:20:48.517590  6729 raft_consensus.cc:2410] T fe20b4b48823486ca3b9c648db6ce8aa P ccd8a4c3bfe3413cb2ae219b09aea832 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c for term 13 because replica has last-logged OpId of term: 12 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 10.
I20260709 13:20:48.518471 11634 leader_election.cc:290] T 7a734b5ab7834e05a8c422208acc58b1 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:48.518373  6878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3d8792045a4583ae2e965b1350a5b4" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:20:48.399362 12367 raft_consensus.cc:515] T a1704639a875409b9959353527b3fd68 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:48.519902  6878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8cee0accdb8499c86d4414b72565a38" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:20:48.520504  6878 raft_consensus.cc:3060] T d8cee0accdb8499c86d4414b72565a38 P cd75a17ab2604397adab03bb8b5fd75c [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:48.521945 12367 leader_election.cc:290] T a1704639a875409b9959353527b3fd68 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:48.486454  6730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1704639a875409b9959353527b3fd68" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:48.523036  6730 raft_consensus.cc:2393] T a1704639a875409b9959353527b3fd68 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c in current term 16: Already voted for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in this term.
I20260709 13:20:48.522980  6881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c37d41cd9164c15a6826ca62a851a69" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:48.486625  6728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab432e62819d499eaaf3dd55481dd930" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:48.433521 12227 leader_election.cc:290] T bb3d8792045a4583ae2e965b1350a5b4 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:20:48.494990  6727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a734b5ab7834e05a8c422208acc58b1" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 17 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:48.524791  6727 raft_consensus.cc:2468] T 7a734b5ab7834e05a8c422208acc58b1 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 16.
I20260709 13:20:48.507064 12358 raft_consensus.cc:2749] T 44bde925b2e541b69890d70715b85176 P b7ab4784c7344b939bc36f639286f377 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:20:48.530944 12452 leader_election.cc:290] T f09c2a98de1a4decabd0ff900dd44caa P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:48.480844 12484 raft_consensus.cc:2804] T d33d5ee8ef6f415593d8df52063161ad P b7ab4784c7344b939bc36f639286f377 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:20:48.532397 12484 raft_consensus.cc:493] T d33d5ee8ef6f415593d8df52063161ad P b7ab4784c7344b939bc36f639286f377 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:20:48.532563 12470 log.cc:927] Time spent T 3411566abe2d4c9bb4b2adfdd05e6f17 P cd75a17ab2604397adab03bb8b5fd75c: Append to log took a long time: real 0.199s	user 0.002s	sys 0.000s
I20260709 13:20:48.532873 12484 raft_consensus.cc:3060] T d33d5ee8ef6f415593d8df52063161ad P b7ab4784c7344b939bc36f639286f377 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:48.533917  6878 raft_consensus.cc:2468] T d8cee0accdb8499c86d4414b72565a38 P cd75a17ab2604397adab03bb8b5fd75c [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in term 16.
I20260709 13:20:48.534111  6875 raft_consensus.cc:2468] T 4b8cacb381b746da8d0049b0a83b41dd P cd75a17ab2604397adab03bb8b5fd75c [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in term 16.
I20260709 13:20:48.535145  6878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22ccee1b570c4ad3a57bd7aec085b1b4" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:48.539172 12396 raft_consensus.cc:493] T be1a92657f494cac8dd227d152f50151 P b7ab4784c7344b939bc36f639286f377 [term 16 FOLLOWER]: Starting leader election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:20:48.539769 12396 raft_consensus.cc:3060] T be1a92657f494cac8dd227d152f50151 P b7ab4784c7344b939bc36f639286f377 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:48.543210 12275 raft_consensus.cc:3055] T 9e326172347f45e99a0d482b5d8ef768 P b7ab4784c7344b939bc36f639286f377 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:20:48.543785 12275 raft_consensus.cc:740] T 9e326172347f45e99a0d482b5d8ef768 P b7ab4784c7344b939bc36f639286f377 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
I20260709 13:20:48.544857 12275 consensus_queue.cc:260] T 9e326172347f45e99a0d482b5d8ef768 P b7ab4784c7344b939bc36f639286f377 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:48.494509 12334 raft_consensus.cc:493] T 20f6842e26174571996b8dea4151d4be P cd75a17ab2604397adab03bb8b5fd75c [term 17 FOLLOWER]: Starting pre-election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:20:48.504405  6731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90d42e216d9741e190bca19a781291fd" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
W20260709 13:20:48.504766  6770 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 61471.3us
I20260709 13:20:48.455261 12427 consensus_queue.cc:1059] T e77e330a82df4b43a745d57a68f6f057 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: INVALID_TERM, Last received: 16.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.039s
I20260709 13:20:48.503940  6726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "853ac0a8cbd64ce99457f170216d4d0f" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
W20260709 13:20:48.444489  7466 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 69124.7us
I20260709 13:20:48.508912  6725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d65025eea89441290d85dd053810e31" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:20:48.510027 12451 consensus_queue.cc:1048] T 20f6842e26174571996b8dea4151d4be P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:20:48.510435 12278 leader_election.cc:290] T a1704639a875409b9959353527b3fd68 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:48.492606 12342 raft_consensus.cc:493] T f03d0dbf16864ca4bc1bb5e4c0334c0f P b7ab4784c7344b939bc36f639286f377 [term 15 FOLLOWER]: Starting leader election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:20:48.513245 12311 leader_election.cc:290] T 404190ce4ce94cecbfcb6ea9d1dd8626 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:20:48.513932  6873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3d8792045a4583ae2e965b1350a5b4" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:48.545549  7496 raft_consensus.cc:1275] T fe20b4b48823486ca3b9c648db6ce8aa P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 13 FOLLOWER]: Refusing update from remote peer cd75a17ab2604397adab03bb8b5fd75c: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:20:48.515918  6872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8cee0accdb8499c86d4414b72565a38" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:48.546663  6731 raft_consensus.cc:2468] T 90d42e216d9741e190bca19a781291fd P ccd8a4c3bfe3413cb2ae219b09aea832 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 15.
I20260709 13:20:48.510072  6695 leader_election.cc:304] T c4db81d9d329422bb3b4160ca4ac2d1d P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:20:48.499570  6723 raft_consensus.cc:1275] T 24ee15416e3145beaa1b8183453729a3 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 19 FOLLOWER]: Refusing update from remote peer cd75a17ab2604397adab03bb8b5fd75c: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260709 13:20:48.552382  6881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34f36d59d88f40fe8a2805e604fc6c0a" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:48.548919  6770 leader_election.cc:304] T 711ef6523deb4cbe8ef2ba61e1c21c98 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
W20260709 13:20:48.556792  6695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 46792.8us
I20260709 13:20:48.559458  6695 leader_election.cc:304] T ab432e62819d499eaaf3dd55481dd930 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:20:48.559593  6770 leader_election.cc:304] T 30e88460611e47b2ba16a46a30b5f416 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:20:48.555756  6872 raft_consensus.cc:2376] T d8cee0accdb8499c86d4414b72565a38 P cd75a17ab2604397adab03bb8b5fd75c [term 16 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in term 16. Re-sending same reply.
I20260709 13:20:48.562297  6695 leader_election.cc:304] T a3022224cc81473690653a83d4e99470 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:20:48.565790  6879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a734b5ab7834e05a8c422208acc58b1" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 17 candidate_status { last_received { term: 13 index: 5 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:48.566874  6726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bf4668eeb70467fb3dc5a0289233b3c" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:48.568373  6723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e326172347f45e99a0d482b5d8ef768" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:20:48.570096  6872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1704639a875409b9959353527b3fd68" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:48.570670  6872 raft_consensus.cc:2468] T a1704639a875409b9959353527b3fd68 P cd75a17ab2604397adab03bb8b5fd75c [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 15.
I20260709 13:20:48.571771 12485 raft_consensus.cc:3055] T e77e330a82df4b43a745d57a68f6f057 P b7ab4784c7344b939bc36f639286f377 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:20:48.558211 12452 raft_consensus.cc:2749] T c4db81d9d329422bb3b4160ca4ac2d1d P ccd8a4c3bfe3413cb2ae219b09aea832 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:20:48.572337 12485 raft_consensus.cc:740] T e77e330a82df4b43a745d57a68f6f057 P b7ab4784c7344b939bc36f639286f377 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
I20260709 13:20:48.573076  6697 leader_election.cc:304] T a1704639a875409b9959353527b3fd68 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:20:48.573397 12485 consensus_queue.cc:260] T e77e330a82df4b43a745d57a68f6f057 P b7ab4784c7344b939bc36f639286f377 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } }
I20260709 13:20:48.574728 12485 raft_consensus.cc:3060] T e77e330a82df4b43a745d57a68f6f057 P b7ab4784c7344b939bc36f639286f377 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:48.576339  6881 raft_consensus.cc:1240] T bb7fa124c3bf4ef9ab65a407cb008441 P cd75a17ab2604397adab03bb8b5fd75c [term 15 FOLLOWER]: Rejecting Update request from peer 7ba59cc884714e8aa5f3f0ecaed84cbb for earlier term 14. Current term is 15. Ops: []
W20260709 13:20:48.576640 12477 log.cc:927] Time spent T 22ccee1b570c4ad3a57bd7aec085b1b4 P cd75a17ab2604397adab03bb8b5fd75c: Append to log took a long time: real 0.142s	user 0.000s	sys 0.001s
I20260709 13:20:48.577071 12311 consensus_queue.cc:1048] T d8cee0accdb8499c86d4414b72565a38 P 7ba59cc884714e8aa5f3f0ecaed84cbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:20:48.573930 12451 raft_consensus.cc:2804] T a1704639a875409b9959353527b3fd68 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:20:48.578563 12340 raft_consensus.cc:2749] T 30e88460611e47b2ba16a46a30b5f416 P b7ab4784c7344b939bc36f639286f377 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:20:48.578919 12451 raft_consensus.cc:493] T a1704639a875409b9959353527b3fd68 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:48.579421  6881 raft_consensus.cc:1275] T 4b8cacb381b746da8d0049b0a83b41dd P cd75a17ab2604397adab03bb8b5fd75c [term 16 FOLLOWER]: Refusing update from remote peer ccd8a4c3bfe3413cb2ae219b09aea832: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:20:48.581329 12275 raft_consensus.cc:3060] T 9e326172347f45e99a0d482b5d8ef768 P b7ab4784c7344b939bc36f639286f377 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:48.581715 12398 raft_consensus.cc:3060] T 711ef6523deb4cbe8ef2ba61e1c21c98 P b7ab4784c7344b939bc36f639286f377 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:20:48.584211  6873 raft_consensus.cc:1275] T 1bf4668eeb70467fb3dc5a0289233b3c P cd75a17ab2604397adab03bb8b5fd75c [term 16 FOLLOWER]: Refusing update from remote peer ccd8a4c3bfe3413cb2ae219b09aea832: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:20:48.584867  6770 leader_election.cc:304] T 1528ab62b6fe4e3099d08f141afee116 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:20:48.588429  6875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09c2a98de1a4decabd0ff900dd44caa" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:48.579500 12451 raft_consensus.cc:3060] T a1704639a875409b9959353527b3fd68 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:48.602203  6801 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7a734b5ab7834e05a8c422208acc58b1"
dest_uuid: "b7ab4784c7344b939bc36f639286f377"
mode: GRACEFUL
new_leader_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
 from {username='slave'} at 127.0.0.1:38240
I20260709 13:20:48.616866  6801 raft_consensus.cc:606] T 7a734b5ab7834e05a8c422208acc58b1 P b7ab4784c7344b939bc36f639286f377 [term 16 FOLLOWER]: Received request to transfer leadership to TS cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:20:48.617465  6801 raft_consensus.cc:614] T 7a734b5ab7834e05a8c422208acc58b1 P b7ab4784c7344b939bc36f639286f377 [term 16 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:20:48.608117  6877 raft_consensus.cc:2468] T 7ba5dac66ab5497e9e336f2a3c28cda5 P cd75a17ab2604397adab03bb8b5fd75c [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in term 17.
I20260709 13:20:48.608462  6879 raft_consensus.cc:2410] T 7a734b5ab7834e05a8c422208acc58b1 P cd75a17ab2604397adab03bb8b5fd75c [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ccd8a4c3bfe3413cb2ae219b09aea832 for term 17 because replica has last-logged OpId of term: 15 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 5.
I20260709 13:20:48.557610 12342 raft_consensus.cc:3060] T f03d0dbf16864ca4bc1bb5e4c0334c0f P b7ab4784c7344b939bc36f639286f377 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:48.615837  6770 leader_election.cc:304] T 404190ce4ce94cecbfcb6ea9d1dd8626 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:20:48.616075  6723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c37d41cd9164c15a6826ca62a851a69" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:48.624027  6723 raft_consensus.cc:2468] T 7c37d41cd9164c15a6826ca62a851a69 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 15.
I20260709 13:20:48.564793 12370 raft_consensus.cc:2749] T ab432e62819d499eaaf3dd55481dd930 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:20:48.568202 12227 raft_consensus.cc:2804] T a3022224cc81473690653a83d4e99470 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 16 FOLLOWER]: Leader pre-election won for term 17
W20260709 13:20:48.565757  6844 connection.cc:256] RPC call timeout handler was delayed by -1.5552489619999506s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17210000000000003s for a response
W20260709 13:20:48.639787  6844 connection.cc:256] RPC call timeout handler was delayed by -1.4375206919999073s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1733s for a response
I20260709 13:20:48.640821  6723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d33d5ee8ef6f415593d8df52063161ad" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
W20260709 13:20:48.641273  6844 connection.cc:256] RPC call timeout handler was delayed by -1.3399576589999924s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1867s for a response
W20260709 13:20:48.618582 12353 consensus_meta.cc:287] T bb7fa124c3bf4ef9ab65a407cb008441 P b7ab4784c7344b939bc36f639286f377: Time spent flushing consensus metadata: real 0.550s	user 0.007s	sys 0.011s
W20260709 13:20:48.637061  6695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 69431.6us
I20260709 13:20:48.646504 12484 raft_consensus.cc:515] T d33d5ee8ef6f415593d8df52063161ad P b7ab4784c7344b939bc36f639286f377 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:48.635887  6770 leader_election.cc:304] T f58dc08b12a2494bb9a1372837970ca2 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
W20260709 13:20:48.653898  6773 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:48.610363 11634 raft_consensus.cc:493] T dbdf895bba214ff68685a24fd17dfb5d P ccd8a4c3bfe3413cb2ae219b09aea832 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:20:48.567092 12278 consensus_queue.cc:1048] T 22ccee1b570c4ad3a57bd7aec085b1b4 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.069s
W20260709 13:20:48.665351  6844 connection.cc:256] RPC call timeout handler was delayed by -1.1592159930000889s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19690000000000002s for a response
I20260709 13:20:48.658270  6770 leader_election.cc:304] T f3f9c2e2bf644115957398fe4c9459db P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
W20260709 13:20:48.660393  7466 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 102564us
I20260709 13:20:48.564968 12334 raft_consensus.cc:515] T 20f6842e26174571996b8dea4151d4be P cd75a17ab2604397adab03bb8b5fd75c [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:48.568957 12238 raft_consensus.cc:515] T 3fa34c08b205435dba97346991aa1f92 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:20:48.667557  6770 leader_election.cc:304] T 3d65025eea89441290d85dd053810e31 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
I20260709 13:20:48.670118  6723 raft_consensus.cc:2393] T d33d5ee8ef6f415593d8df52063161ad P ccd8a4c3bfe3413cb2ae219b09aea832 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c in current term 13: Already voted for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in this term.
I20260709 13:20:48.635401 12246 raft_consensus.cc:2749] T 1528ab62b6fe4e3099d08f141afee116 P b7ab4784c7344b939bc36f639286f377 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:20:48.634968 12267 raft_consensus.cc:493] T ce4f062dcd314d43a63ca74067cb5ee3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 15 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:20:48.643481 12352 raft_consensus.cc:2749] T 404190ce4ce94cecbfcb6ea9d1dd8626 P b7ab4784c7344b939bc36f639286f377 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:20:48.610464 12288 consensus_queue.cc:1048] T fe20b4b48823486ca3b9c648db6ce8aa P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.050s
I20260709 13:20:48.639648 12227 raft_consensus.cc:493] T a3022224cc81473690653a83d4e99470 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 16 FOLLOWER]: Starting leader election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:20:48.681288  6723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fa34c08b205435dba97346991aa1f92" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:20:48.681622  6844 leader_election.cc:304] T 713b5728a197487c9300b310ab94e5a3 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:20:48.671044 12335 raft_consensus.cc:493] T bb7fa124c3bf4ef9ab65a407cb008441 P cd75a17ab2604397adab03bb8b5fd75c [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:48.663215 12159 raft_consensus.cc:2804] T f58dc08b12a2494bb9a1372837970ca2 P b7ab4784c7344b939bc36f639286f377 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:20:48.704197  6726 raft_consensus.cc:1275] T f58dc08b12a2494bb9a1372837970ca2 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 17 FOLLOWER]: Refusing update from remote peer cd75a17ab2604397adab03bb8b5fd75c: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 13:20:48.726382  6803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "404190ce4ce94cecbfcb6ea9d1dd8626" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:48.707032  6723 raft_consensus.cc:2368] T 3fa34c08b205435dba97346991aa1f92 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c for earlier term 18. Current term is 19.
W20260709 13:20:48.725158  6695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 73535.8us
I20260709 13:20:48.731437 12397 raft_consensus.cc:2749] T 713b5728a197487c9300b310ab94e5a3 P cd75a17ab2604397adab03bb8b5fd75c [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:20:48.732460  7503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24ee15416e3145beaa1b8183453729a3" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:20:48.660667 12353 raft_consensus.cc:515] T bb7fa124c3bf4ef9ab65a407cb008441 P b7ab4784c7344b939bc36f639286f377 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
W20260709 13:20:48.744997  6770 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 77338.3us
I20260709 13:20:48.749814  6695 leader_election.cc:304] T 34f36d59d88f40fe8a2805e604fc6c0a P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
W20260709 13:20:48.788192  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 106705us
I20260709 13:20:48.660312 11994 consensus_queue.cc:1059] T 7c44c4849aa54f2b94d1f1bef9ed546f P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: INVALID_TERM, Last received: 15.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.047s
W20260709 13:20:48.705628  6772 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 193183us
W20260709 13:20:48.706164 12489 log.cc:927] Time spent T 3411566abe2d4c9bb4b2adfdd05e6f17 P b7ab4784c7344b939bc36f639286f377: Append to log took a long time: real 0.098s	user 0.000s	sys 0.001s
I20260709 13:20:48.673960 12367 consensus_queue.cc:1048] T 4b8cacb381b746da8d0049b0a83b41dd P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.112s
I20260709 13:20:48.794334  7502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17587d6730594da4a56fa13a353232a1" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:20:48.793517  6772 leader_election.cc:304] T f4b8bd455d5a47c18a1380839c6e0d61 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:20:48.697585 12481 raft_consensus.cc:493] T 1528ab62b6fe4e3099d08f141afee116 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 13 FOLLOWER]: Starting pre-election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:20:48.742259 12159 raft_consensus.cc:493] T f58dc08b12a2494bb9a1372837970ca2 P b7ab4784c7344b939bc36f639286f377 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:48.704485 12227 raft_consensus.cc:3060] T a3022224cc81473690653a83d4e99470 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:20:48.806126  6695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 56430.9us
I20260709 13:20:48.821938  6695 leader_election.cc:304] T 713b5728a197487c9300b310ab94e5a3 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:20:48.676375 11634 raft_consensus.cc:515] T dbdf895bba214ff68685a24fd17dfb5d P ccd8a4c3bfe3413cb2ae219b09aea832 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
W20260709 13:20:48.814424  6697 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 171185us
I20260709 13:20:48.814862  6731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a485a995abc4807b6e511e45419f737" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
W20260709 13:20:48.814884  7469 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:48.786865  7501 raft_consensus.cc:1275] T 4b8cacb381b746da8d0049b0a83b41dd P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 16 FOLLOWER]: Refusing update from remote peer ccd8a4c3bfe3413cb2ae219b09aea832: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:20:48.741008 12352 raft_consensus.cc:2804] T 3d65025eea89441290d85dd053810e31 P b7ab4784c7344b939bc36f639286f377 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:20:48.822811  6844 leader_election.cc:304] T a3022224cc81473690653a83d4e99470 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:20:48.820852  6772 leader_election.cc:304] T 07a92dd554674067a83a9cb68c4773f2 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:20:48.837510  6729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a734b5ab7834e05a8c422208acc58b1" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 17 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:48.838142  6729 raft_consensus.cc:2468] T 7a734b5ab7834e05a8c422208acc58b1 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 16.
I20260709 13:20:48.733184 12246 raft_consensus.cc:2804] T f3f9c2e2bf644115957398fe4c9459db P b7ab4784c7344b939bc36f639286f377 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:20:48.844734  6731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90d42e216d9741e190bca19a781291fd" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:20:48.845446  6731 raft_consensus.cc:3060] T 90d42e216d9741e190bca19a781291fd P ccd8a4c3bfe3413cb2ae219b09aea832 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:48.847859  6723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1704639a875409b9959353527b3fd68" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:48.821257 12159 raft_consensus.cc:3060] T f58dc08b12a2494bb9a1372837970ca2 P b7ab4784c7344b939bc36f639286f377 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:20:48.855672  6727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d9def8b32fd443aa94ab1420b06837b" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:48.696986 12267 raft_consensus.cc:515] T ce4f062dcd314d43a63ca74067cb5ee3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } attrs { replace: true } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:20:48.855693  6729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77e330a82df4b43a745d57a68f6f057" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:20:48.858836  6732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c7f33e544204fbaac4078e3e83bbf4e" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:20:48.859758  6730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c44c4849aa54f2b94d1f1bef9ed546f" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 18 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:20:48.818775  7494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3d8792045a4583ae2e965b1350a5b4" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:20:48.745081 12335 raft_consensus.cc:515] T bb7fa124c3bf4ef9ab65a407cb008441 P cd75a17ab2604397adab03bb8b5fd75c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:20:48.831576 12352 raft_consensus.cc:493] T 3d65025eea89441290d85dd053810e31 P b7ab4784c7344b939bc36f639286f377 [term 15 FOLLOWER]: Starting leader election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
W20260709 13:20:48.885275  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 68096.6us
I20260709 13:20:48.828161 12340 raft_consensus.cc:2804] T f4b8bd455d5a47c18a1380839c6e0d61 P b7ab4784c7344b939bc36f639286f377 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:20:48.842128 12449 raft_consensus.cc:2749] T 34f36d59d88f40fe8a2805e604fc6c0a P ccd8a4c3bfe3413cb2ae219b09aea832 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:20:48.896874 12238 leader_election.cc:290] T 3fa34c08b205435dba97346991aa1f92 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 19 election: Requested vote from peers cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:20:48.902088 12353 leader_election.cc:290] T bb7fa124c3bf4ef9ab65a407cb008441 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 15 election: Requested vote from peers cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:20:48.903887 11634 leader_election.cc:290] T dbdf895bba214ff68685a24fd17dfb5d P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:48.904794 12499 raft_consensus.cc:493] T b56bf91d90824c959e21e0cee5ba1816 P b7ab4784c7344b939bc36f639286f377 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:20:48.905107 12488 log.cc:927] Time spent T 7c37d41cd9164c15a6826ca62a851a69 P cd75a17ab2604397adab03bb8b5fd75c: Append to log took a long time: real 0.164s	user 0.001s	sys 0.000s
I20260709 13:20:48.855747 12397 raft_consensus.cc:2749] T a3022224cc81473690653a83d4e99470 P cd75a17ab2604397adab03bb8b5fd75c [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:20:48.845573 11994 raft_consensus.cc:2749] T 713b5728a197487c9300b310ab94e5a3 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:20:48.913057  6844 leader_election.cc:304] T c4db81d9d329422bb3b4160ca4ac2d1d P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:20:48.920965  6729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c240553ce044eedb41541d72b9475d7" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:48.823380 12481 raft_consensus.cc:515] T 1528ab62b6fe4e3099d08f141afee116 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
W20260709 13:20:48.925194  6695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 82345.4us
I20260709 13:20:48.908389 12278 raft_consensus.cc:2749] T 07a92dd554674067a83a9cb68c4773f2 P b7ab4784c7344b939bc36f639286f377 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:20:48.841214 12246 raft_consensus.cc:493] T f3f9c2e2bf644115957398fe4c9459db P b7ab4784c7344b939bc36f639286f377 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:48.909371 12352 raft_consensus.cc:3060] T 3d65025eea89441290d85dd053810e31 P b7ab4784c7344b939bc36f639286f377 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:48.909111 12340 raft_consensus.cc:493] T f4b8bd455d5a47c18a1380839c6e0d61 P b7ab4784c7344b939bc36f639286f377 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:48.862100 12422 consensus_queue.cc:1048] T 1bf4668eeb70467fb3dc5a0289233b3c P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.060s
I20260709 13:20:48.962875  6801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce4f062dcd314d43a63ca74067cb5ee3" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:48.964661  6727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b3759de40694069b13c0f8bd40e5709" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:48.909082  7494 raft_consensus.cc:2468] T bb3d8792045a4583ae2e965b1350a5b4 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 14.
W20260709 13:20:48.969403  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 56471us
I20260709 13:20:48.908465 12267 leader_election.cc:290] T ce4f062dcd314d43a63ca74067cb5ee3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
W20260709 13:20:48.975598  6697 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 133302us
I20260709 13:20:48.979378  6806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1704639a875409b9959353527b3fd68" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:48.980149  6806 raft_consensus.cc:2468] T a1704639a875409b9959353527b3fd68 P b7ab4784c7344b939bc36f639286f377 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 16.
I20260709 13:20:48.960079 12246 raft_consensus.cc:3060] T f3f9c2e2bf644115957398fe4c9459db P b7ab4784c7344b939bc36f639286f377 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:48.962100 12417 raft_consensus.cc:2749] T c4db81d9d329422bb3b4160ca4ac2d1d P cd75a17ab2604397adab03bb8b5fd75c [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:20:48.962806 12340 raft_consensus.cc:3060] T f4b8bd455d5a47c18a1380839c6e0d61 P b7ab4784c7344b939bc36f639286f377 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:48.993047  6800 raft_consensus.cc:1275] T 1bf4668eeb70467fb3dc5a0289233b3c P b7ab4784c7344b939bc36f639286f377 [term 16 FOLLOWER]: Refusing update from remote peer ccd8a4c3bfe3413cb2ae219b09aea832: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:20:48.994124  6727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44bde925b2e541b69890d70715b85176" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:48.968642 12345 raft_consensus.cc:493] T fe20b4b48823486ca3b9c648db6ce8aa P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:48.975924 12496 raft_consensus.cc:493] T bb7fa124c3bf4ef9ab65a407cb008441 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:49.004179  6806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbdf895bba214ff68685a24fd17dfb5d" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 15 candidate_status { last_received { term: 14 index: 6 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
W20260709 13:20:49.010871  6772 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 190100us
I20260709 13:20:49.012121  6772 leader_election.cc:304] T d8292e16e5654be6bc408560cf256aaa P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:20:49.013957  6772 leader_election.cc:304] T de3186201e1a40d0b335eeb8b4e256e0 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:20:49.009279  6876 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53406 (request call id 2628) took 1185 ms. Trace:
I20260709 13:20:48.938863 12499 raft_consensus.cc:515] T b56bf91d90824c959e21e0cee5ba1816 P b7ab4784c7344b939bc36f639286f377 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:49.019850  6729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "427c124d773f483294511e80fe340075" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:49.026691  6802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17587d6730594da4a56fa13a353232a1" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:49.027456 12240 raft_consensus.cc:493] T b56bf91d90824c959e21e0cee5ba1816 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:49.037143  6800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab432e62819d499eaaf3dd55481dd930" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:49.015118  6876 rpcz_store.cc:276] 0709 13:20:47.823936 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:47.970517 (+146581us) service_pool.cc:224] Handling call
0709 13:20:47.970919 (+   402us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:48.009298 (+ 38379us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:48.009348 (+    50us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:20:48.094640 (+ 85292us) log.cc:844] Serialized 26 byte log entry
0709 13:20:48.485223 (+390583us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:20:48.485274 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:48.485362 (+    88us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:49.008987 (+523625us) raft_consensus.cc:1685] finished
0709 13:20:49.009011 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:49.009214 (+   203us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":52045,"raft.queue_time_us":39081,"raft.run_cpu_time_us":238,"raft.run_wall_time_us":48700,"thread_start_us":340749,"threads_started":1,"wal-append.queue_time_us":494476}
I20260709 13:20:49.008406 12334 leader_election.cc:290] T 20f6842e26174571996b8dea4151d4be P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:20:49.042147  6727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b56bf91d90824c959e21e0cee5ba1816" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:49.022540 12353 raft_consensus.cc:2749] T d8292e16e5654be6bc408560cf256aaa P b7ab4784c7344b939bc36f639286f377 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:20:49.047379  6844 leader_election.cc:304] T f09c2a98de1a4decabd0ff900dd44caa P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:20:49.048808  6772 leader_election.cc:304] T bd6869f07b5a4885a0b99fbe60c3b175 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:20:49.051406 12504 consensus_queue.cc:1048] T 1bf4668eeb70467fb3dc5a0289233b3c P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:20:49.052198  6806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f00a2e87e56452083b759f60d461ee3" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:49.053508  6806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c37d41cd9164c15a6826ca62a851a69" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:49.054559  6806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09c2a98de1a4decabd0ff900dd44caa" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:49.055106  6806 raft_consensus.cc:2468] T f09c2a98de1a4decabd0ff900dd44caa P b7ab4784c7344b939bc36f639286f377 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 17.
I20260709 13:20:49.057662 12499 leader_election.cc:290] T b56bf91d90824c959e21e0cee5ba1816 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:49.010622 12496 raft_consensus.cc:515] T bb7fa124c3bf4ef9ab65a407cb008441 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:20:49.064334 12246 raft_consensus.cc:515] T f3f9c2e2bf644115957398fe4c9459db P b7ab4784c7344b939bc36f639286f377 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:49.007064 12345 raft_consensus.cc:515] T fe20b4b48823486ca3b9c648db6ce8aa P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:20:49.066332 12496 leader_election.cc:290] T bb7fa124c3bf4ef9ab65a407cb008441 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:49.066843 12246 leader_election.cc:290] T f3f9c2e2bf644115957398fe4c9459db P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 16 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:49.067721 12345 leader_election.cc:290] T fe20b4b48823486ca3b9c648db6ce8aa P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:49.040661 12417 consensus_queue.cc:1048] T f3f9c2e2bf644115957398fe4c9459db P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.028s
I20260709 13:20:49.064841 12335 leader_election.cc:290] T bb7fa124c3bf4ef9ab65a407cb008441 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:20:49.070381 12398 raft_consensus.cc:2749] T 711ef6523deb4cbe8ef2ba61e1c21c98 P b7ab4784c7344b939bc36f639286f377 [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:20:49.075726  6678 auto_rebalancer.cc:629] Failed to schedule move for tablet f58dc08b12a2494bb9a1372837970ca2: Illegal state: Replica ccd8a4c3bfe3413cb2ae219b09aea832 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 17 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } }
I20260709 13:20:49.078912  6881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fa34c08b205435dba97346991aa1f92" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:20:49.042527 12240 raft_consensus.cc:515] T b56bf91d90824c959e21e0cee5ba1816 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:49.080483  7494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fa34c08b205435dba97346991aa1f92" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb"
I20260709 13:20:49.081125  7494 raft_consensus.cc:3060] T 3fa34c08b205435dba97346991aa1f92 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:20:49.081169  7500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb7fa124c3bf4ef9ab65a407cb008441" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:20:49.081970  7500 raft_consensus.cc:2468] T bb7fa124c3bf4ef9ab65a407cb008441 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 15.
I20260709 13:20:49.082842  6805 raft_consensus.cc:1240] T 711ef6523deb4cbe8ef2ba61e1c21c98 P b7ab4784c7344b939bc36f639286f377 [term 18 FOLLOWER]: Rejecting Update request from peer cd75a17ab2604397adab03bb8b5fd75c for earlier term 17. Current term is 18. Ops: []
W20260709 13:20:49.071779 12396 consensus_meta.cc:287] T be1a92657f494cac8dd227d152f50151 P b7ab4784c7344b939bc36f639286f377: Time spent flushing consensus metadata: real 0.532s	user 0.008s	sys 0.001s
I20260709 13:20:49.082136  6727 raft_consensus.cc:2468] T b56bf91d90824c959e21e0cee5ba1816 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 15.
I20260709 13:20:49.092440 12481 leader_election.cc:290] T 1528ab62b6fe4e3099d08f141afee116 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:20:49.095558  6807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bf4668eeb70467fb3dc5a0289233b3c" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
W20260709 13:20:49.087088  6725 consensus_meta.cc:287] T 3d65025eea89441290d85dd053810e31 P ccd8a4c3bfe3413cb2ae219b09aea832: Time spent flushing consensus metadata: real 0.537s	user 0.004s	sys 0.006s
I20260709 13:20:49.109506  6725 raft_consensus.cc:2468] T 3d65025eea89441290d85dd053810e31 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 16.
I20260709 13:20:49.087476  6724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4275cf08e63345f993bce8664eada830" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:20:49.078687 12159 raft_consensus.cc:515] T f58dc08b12a2494bb9a1372837970ca2 P b7ab4784c7344b939bc36f639286f377 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
W20260709 13:20:49.098028 12493 log.cc:927] Time spent T b56bf91d90824c959e21e0cee5ba1816 P cd75a17ab2604397adab03bb8b5fd75c: Append to log took a long time: real 0.274s	user 0.005s	sys 0.000s
I20260709 13:20:49.085628  6731 raft_consensus.cc:2468] T 90d42e216d9741e190bca19a781291fd P ccd8a4c3bfe3413cb2ae219b09aea832 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 16.
W20260709 13:20:49.100666  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 61715.5us
I20260709 13:20:49.101264 12335 raft_consensus.cc:3060] T f09c2a98de1a4decabd0ff900dd44caa P cd75a17ab2604397adab03bb8b5fd75c [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:49.102365  6876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbdf895bba214ff68685a24fd17dfb5d" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 15 candidate_status { last_received { term: 14 index: 6 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:49.040992 12506 raft_consensus.cc:2749] T de3186201e1a40d0b335eeb8b4e256e0 P b7ab4784c7344b939bc36f639286f377 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:20:49.124894 12396 raft_consensus.cc:515] T be1a92657f494cac8dd227d152f50151 P b7ab4784c7344b939bc36f639286f377 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:20:49.055850  6806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90d42e216d9741e190bca19a781291fd" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:49.124210  6807 raft_consensus.cc:2393] T 1bf4668eeb70467fb3dc5a0289233b3c P b7ab4784c7344b939bc36f639286f377 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c in current term 16: Already voted for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in this term.
I20260709 13:20:49.081771 12240 leader_election.cc:290] T b56bf91d90824c959e21e0cee5ba1816 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
W20260709 13:20:49.125797  6772 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 77039.1us
W20260709 13:20:49.128818 12511 log.cc:927] Time spent T e31b9971c15848dea59d4d4130141d9e P ccd8a4c3bfe3413cb2ae219b09aea832: Append to log took a long time: real 0.051s	user 0.001s	sys 0.000s
I20260709 13:20:49.129997  6799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ba5dac66ab5497e9e336f2a3c28cda5" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:49.133692 12159 leader_election.cc:290] T f58dc08b12a2494bb9a1372837970ca2 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 18 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:49.086802  6800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d65025eea89441290d85dd053810e31" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:20:49.165568  6806 raft_consensus.cc:2393] T 90d42e216d9741e190bca19a781291fd P b7ab4784c7344b939bc36f639286f377 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c in current term 16: Already voted for candidate b7ab4784c7344b939bc36f639286f377 in this term.
I20260709 13:20:49.133742 12342 raft_consensus.cc:515] T f03d0dbf16864ca4bc1bb5e4c0334c0f P b7ab4784c7344b939bc36f639286f377 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:49.166726  6806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77e330a82df4b43a745d57a68f6f057" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:20:49.167579 12484 leader_election.cc:290] T d33d5ee8ef6f415593d8df52063161ad P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 14 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:49.167723 12342 leader_election.cc:290] T f03d0dbf16864ca4bc1bb5e4c0334c0f P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 16 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:49.139207  6844 leader_election.cc:304] T 3411566abe2d4c9bb4b2adfdd05e6f17 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: ccd8a4c3bfe3413cb2ae219b09aea832
W20260709 13:20:49.170393 12495 log.cc:927] Time spent T 3a485a995abc4807b6e511e45419f737 P cd75a17ab2604397adab03bb8b5fd75c: Append to log took a long time: real 0.329s	user 0.001s	sys 0.000s
I20260709 13:20:49.141413 12370 raft_consensus.cc:493] T e77e330a82df4b43a745d57a68f6f057 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:20:49.142032  6697 leader_election.cc:304] T 24ee15416e3145beaa1b8183453729a3 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:20:49.142361 11634 raft_consensus.cc:493] T fe20b4b48823486ca3b9c648db6ce8aa P ccd8a4c3bfe3413cb2ae219b09aea832 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:49.144244 12353 raft_consensus.cc:2804] T bd6869f07b5a4885a0b99fbe60c3b175 P b7ab4784c7344b939bc36f639286f377 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:20:49.148563  6725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce4f062dcd314d43a63ca74067cb5ee3" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:49.178340  6725 raft_consensus.cc:2468] T ce4f062dcd314d43a63ca74067cb5ee3 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 15.
I20260709 13:20:49.149643  6724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5be3a11b23d4ea9b08300a2789821c7" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:49.155191  6772 leader_election.cc:304] T 7887766dc6784fcaa42b35c05fea7a99 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:20:49.158645 12417 raft_consensus.cc:493] T bb3d8792045a4583ae2e965b1350a5b4 P cd75a17ab2604397adab03bb8b5fd75c [term 13 FOLLOWER]: Starting pre-election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:20:49.160189 12432 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 95a75bfe094d4bdc963aba3f08dfcd25. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:49.177525  7468 leader_election.cc:304] T bb3d8792045a4583ae2e965b1350a5b4 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:20:49.163480  6807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e326172347f45e99a0d482b5d8ef768" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:20:49.165189  6802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb7fa124c3bf4ef9ab65a407cb008441" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:49.188663  6802 raft_consensus.cc:2468] T bb7fa124c3bf4ef9ab65a407cb008441 P b7ab4784c7344b939bc36f639286f377 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in term 15.
I20260709 13:20:49.171738  6803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1528ab62b6fe4e3099d08f141afee116" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
W20260709 13:20:49.174130  6844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:49.175901 12370 raft_consensus.cc:515] T e77e330a82df4b43a745d57a68f6f057 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } }
I20260709 13:20:49.194001 12396 leader_election.cc:290] T be1a92657f494cac8dd227d152f50151 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 17 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:20:49.199026 12335 raft_consensus.cc:2749] T f09c2a98de1a4decabd0ff900dd44caa P cd75a17ab2604397adab03bb8b5fd75c [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:20:49.202996  7466 leader_election.cc:304] T bb7fa124c3bf4ef9ab65a407cb008441 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, b7ab4784c7344b939bc36f639286f377; no voters: 
I20260709 13:20:49.176980 12334 raft_consensus.cc:2804] T 3411566abe2d4c9bb4b2adfdd05e6f17 P cd75a17ab2604397adab03bb8b5fd75c [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:20:49.215868 12334 raft_consensus.cc:493] T 3411566abe2d4c9bb4b2adfdd05e6f17 P cd75a17ab2604397adab03bb8b5fd75c [term 13 FOLLOWER]: Starting leader election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:20:49.216266  7494 raft_consensus.cc:2468] T 3fa34c08b205435dba97346991aa1f92 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 19.
I20260709 13:20:49.218294  7468 leader_election.cc:304] T 4b8cacb381b746da8d0049b0a83b41dd P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, cd75a17ab2604397adab03bb8b5fd75c; no voters: ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:20:49.218693  6726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe20b4b48823486ca3b9c648db6ce8aa" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:49.219614 12481 raft_consensus.cc:2749] T bb3d8792045a4583ae2e965b1350a5b4 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:20:49.187240  6697 leader_election.cc:304] T bb3d8792045a4583ae2e965b1350a5b4 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:20:49.220795 12367 raft_consensus.cc:2804] T bb3d8792045a4583ae2e965b1350a5b4 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:20:49.221333 12367 raft_consensus.cc:493] T bb3d8792045a4583ae2e965b1350a5b4 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:49.221876 12367 raft_consensus.cc:3060] T bb3d8792045a4583ae2e965b1350a5b4 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:49.208279  6803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b3759de40694069b13c0f8bd40e5709" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:49.224324  6732 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "95a75bfe094d4bdc963aba3f08dfcd25"
dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
mode: GRACEFUL
new_leader_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
 from {username='slave'} at 127.0.0.1:38536
I20260709 13:20:49.186758 11634 raft_consensus.cc:515] T fe20b4b48823486ca3b9c648db6ce8aa P ccd8a4c3bfe3413cb2ae219b09aea832 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:20:49.225044  6732 raft_consensus.cc:606] T 95a75bfe094d4bdc963aba3f08dfcd25 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 13 LEADER]: Received request to transfer leadership to TS cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:20:49.225288  6803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "427c124d773f483294511e80fe340075" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:49.178109 12353 raft_consensus.cc:493] T bd6869f07b5a4885a0b99fbe60c3b175 P b7ab4784c7344b939bc36f639286f377 [term 16 FOLLOWER]: Starting leader election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:20:49.226257 12353 raft_consensus.cc:3060] T bd6869f07b5a4885a0b99fbe60c3b175 P b7ab4784c7344b939bc36f639286f377 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:49.205696  6801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d33d5ee8ef6f415593d8df52063161ad" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:20:49.226595  6803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c37d41cd9164c15a6826ca62a851a69" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:49.227023  6801 raft_consensus.cc:2368] T d33d5ee8ef6f415593d8df52063161ad P b7ab4784c7344b939bc36f639286f377 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c for earlier term 13. Current term is 14.
I20260709 13:20:49.209381  6730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "404190ce4ce94cecbfcb6ea9d1dd8626" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:49.212646 11937 raft_consensus.cc:493] T 8c7f33e544204fbaac4078e3e83bbf4e P cd75a17ab2604397adab03bb8b5fd75c [term 13 FOLLOWER]: Starting pre-election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:20:49.228902 11937 raft_consensus.cc:515] T 8c7f33e544204fbaac4078e3e83bbf4e P cd75a17ab2604397adab03bb8b5fd75c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:49.229396 12448 raft_consensus.cc:2749] T 24ee15416e3145beaa1b8183453729a3 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:20:49.211952 12497 raft_consensus.cc:493] T d33d5ee8ef6f415593d8df52063161ad P ccd8a4c3bfe3413cb2ae219b09aea832 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:49.204465 12484 raft_consensus.cc:2804] T 7887766dc6784fcaa42b35c05fea7a99 P b7ab4784c7344b939bc36f639286f377 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:20:49.136763 12340 raft_consensus.cc:515] T f4b8bd455d5a47c18a1380839c6e0d61 P b7ab4784c7344b939bc36f639286f377 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:49.230559 12484 raft_consensus.cc:493] T 7887766dc6784fcaa42b35c05fea7a99 P b7ab4784c7344b939bc36f639286f377 [term 16 FOLLOWER]: Starting leader election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:20:49.230602 12497 raft_consensus.cc:515] T d33d5ee8ef6f415593d8df52063161ad P ccd8a4c3bfe3413cb2ae219b09aea832 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:49.213110 12417 raft_consensus.cc:515] T bb3d8792045a4583ae2e965b1350a5b4 P cd75a17ab2604397adab03bb8b5fd75c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:20:49.231359  6799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c240553ce044eedb41541d72b9475d7" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:49.231564  6804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a485a995abc4807b6e511e45419f737" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:49.216423 12334 raft_consensus.cc:3060] T 3411566abe2d4c9bb4b2adfdd05e6f17 P cd75a17ab2604397adab03bb8b5fd75c [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:49.211397 12352 raft_consensus.cc:515] T 3d65025eea89441290d85dd053810e31 P b7ab4784c7344b939bc36f639286f377 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:49.221138 12238 consensus_queue.cc:1048] T 4b8cacb381b746da8d0049b0a83b41dd P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:20:49.233853  6802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44bde925b2e541b69890d70715b85176" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:49.231171 12484 raft_consensus.cc:3060] T 7887766dc6784fcaa42b35c05fea7a99 P b7ab4784c7344b939bc36f639286f377 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:49.234511  6802 raft_consensus.cc:2468] T 44bde925b2e541b69890d70715b85176 P b7ab4784c7344b939bc36f639286f377 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 15.
I20260709 13:20:49.234822  6800 raft_consensus.cc:2393] T 3d65025eea89441290d85dd053810e31 P b7ab4784c7344b939bc36f639286f377 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c in current term 16: Already voted for candidate b7ab4784c7344b939bc36f639286f377 in this term.
I20260709 13:20:49.232270  6804 raft_consensus.cc:2468] T 3a485a995abc4807b6e511e45419f737 P b7ab4784c7344b939bc36f639286f377 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 15.
I20260709 13:20:49.235613  6802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a734b5ab7834e05a8c422208acc58b1" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 17 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:49.186363 12240 raft_consensus.cc:493] T 711ef6523deb4cbe8ef2ba61e1c21c98 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:49.236061  6804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a734b5ab7834e05a8c422208acc58b1" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 17 candidate_status { last_received { term: 13 index: 5 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
W20260709 13:20:49.236478  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 44379us
I20260709 13:20:49.266368  6844 leader_election.cc:304] T 7a734b5ab7834e05a8c422208acc58b1 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:20:49.194293 12370 leader_election.cc:290] T e77e330a82df4b43a745d57a68f6f057 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:49.239724  6876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b56bf91d90824c959e21e0cee5ba1816" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:49.241075  6874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c7f33e544204fbaac4078e3e83bbf4e" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:20:49.267995  6874 raft_consensus.cc:3060] T 8c7f33e544204fbaac4078e3e83bbf4e P cd75a17ab2604397adab03bb8b5fd75c [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:49.242857  7501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb7fa124c3bf4ef9ab65a407cb008441" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb"
I20260709 13:20:49.243315 12275 consensus_queue.cc:1059] T 4275cf08e63345f993bce8664eada830 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: INVALID_TERM, Last received: 13.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:20:49.244756 12159 raft_consensus.cc:993] T 34f36d59d88f40fe8a2805e604fc6c0a P b7ab4784c7344b939bc36f639286f377: : Instructing follower cd75a17ab2604397adab03bb8b5fd75c to start an election
I20260709 13:20:49.245581  6872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1704639a875409b9959353527b3fd68" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:49.272133  6872 raft_consensus.cc:2468] T a1704639a875409b9959353527b3fd68 P cd75a17ab2604397adab03bb8b5fd75c [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 15.
I20260709 13:20:49.247326  6881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90d42e216d9741e190bca19a781291fd" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:20:49.273039  6881 raft_consensus.cc:3060] T 90d42e216d9741e190bca19a781291fd P cd75a17ab2604397adab03bb8b5fd75c [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:49.248165  6879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a734b5ab7834e05a8c422208acc58b1" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 17 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:49.226912  6798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1704639a875409b9959353527b3fd68" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:49.274261  6879 raft_consensus.cc:2468] T 7a734b5ab7834e05a8c422208acc58b1 P cd75a17ab2604397adab03bb8b5fd75c [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 16.
I20260709 13:20:49.213526  6725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce4f062dcd314d43a63ca74067cb5ee3" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:49.275141  6725 raft_consensus.cc:2468] T ce4f062dcd314d43a63ca74067cb5ee3 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in term 15.
I20260709 13:20:49.252887  6726 raft_consensus.cc:2410] T fe20b4b48823486ca3b9c648db6ce8aa P ccd8a4c3bfe3413cb2ae219b09aea832 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ba59cc884714e8aa5f3f0ecaed84cbb for term 14 because replica has last-logged OpId of term: 12 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 10.
I20260709 13:20:49.252725  6802 raft_consensus.cc:2468] T 7a734b5ab7834e05a8c422208acc58b1 P b7ab4784c7344b939bc36f639286f377 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 16.
I20260709 13:20:49.185537  6806 raft_consensus.cc:2468] T e77e330a82df4b43a745d57a68f6f057 P b7ab4784c7344b939bc36f639286f377 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 17.
I20260709 13:20:49.227744  6803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "853ac0a8cbd64ce99457f170216d4d0f" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:49.227996  6801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22ccee1b570c4ad3a57bd7aec085b1b4" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
W20260709 13:20:49.264331  7466 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 61456.8us
I20260709 13:20:49.210988 12498 raft_consensus.cc:493] T 9b3759de40694069b13c0f8bd40e5709 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:20:49.278738  6844 leader_election.cc:304] T 90d42e216d9741e190bca19a781291fd P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:20:49.274413  6798 raft_consensus.cc:2468] T a1704639a875409b9959353527b3fd68 P b7ab4784c7344b939bc36f639286f377 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 16.
I20260709 13:20:49.224363  6805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b56bf91d90824c959e21e0cee5ba1816" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:49.284623  6872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb7fa124c3bf4ef9ab65a407cb008441" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:20:49.282619  6805 raft_consensus.cc:2468] T b56bf91d90824c959e21e0cee5ba1816 P b7ab4784c7344b939bc36f639286f377 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 15.
I20260709 13:20:49.322609  6695 leader_election.cc:304] T dbdf895bba214ff68685a24fd17dfb5d P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:20:49.301298  6730 raft_consensus.cc:1240] T 3fa34c08b205435dba97346991aa1f92 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 19 FOLLOWER]: Rejecting Update request from peer cd75a17ab2604397adab03bb8b5fd75c for earlier term 18. Current term is 19. Ops: []
I20260709 13:20:49.321676  6729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1528ab62b6fe4e3099d08f141afee116" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:49.320416  6732 raft_consensus.cc:1275] T b56bf91d90824c959e21e0cee5ba1816 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 15 FOLLOWER]: Refusing update from remote peer cd75a17ab2604397adab03bb8b5fd75c: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:20:49.319962  6876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77e330a82df4b43a745d57a68f6f057" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:49.326932  6876 raft_consensus.cc:2393] T e77e330a82df4b43a745d57a68f6f057 P cd75a17ab2604397adab03bb8b5fd75c [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ccd8a4c3bfe3413cb2ae219b09aea832 in current term 17: Already voted for candidate cd75a17ab2604397adab03bb8b5fd75c in this term.
I20260709 13:20:49.327930  6876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b56bf91d90824c959e21e0cee5ba1816" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:49.325824  6872 raft_consensus.cc:2393] T bb7fa124c3bf4ef9ab65a407cb008441 P cd75a17ab2604397adab03bb8b5fd75c [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate b7ab4784c7344b939bc36f639286f377 in current term 15: Already voted for candidate cd75a17ab2604397adab03bb8b5fd75c in this term.
I20260709 13:20:49.325618  6695 leader_election.cc:304] T 17587d6730594da4a56fa13a353232a1 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, b7ab4784c7344b939bc36f639286f377
I20260709 13:20:49.303923  6846 leader_election.cc:304] T bb7fa124c3bf4ef9ab65a407cb008441 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:20:49.336335  6872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f9c2e2bf644115957398fe4c9459db" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 16 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:20:49.271853 12481 raft_consensus.cc:2804] T 4b8cacb381b746da8d0049b0a83b41dd P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:20:49.339468  7466 leader_election.cc:304] T 404190ce4ce94cecbfcb6ea9d1dd8626 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:20:49.340248  6804 raft_consensus.cc:1240] T f58dc08b12a2494bb9a1372837970ca2 P b7ab4784c7344b939bc36f639286f377 [term 18 FOLLOWER]: Rejecting Update request from peer cd75a17ab2604397adab03bb8b5fd75c for earlier term 17. Current term is 18. Ops: []
I20260709 13:20:49.342010 12011 raft_consensus.cc:2749] T dbdf895bba214ff68685a24fd17dfb5d P ccd8a4c3bfe3413cb2ae219b09aea832 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:20:49.342259  6804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b56bf91d90824c959e21e0cee5ba1816" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:49.342904 12348 raft_consensus.cc:493] T 2c240553ce044eedb41541d72b9475d7 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:20:49.343425 12348 raft_consensus.cc:515] T 2c240553ce044eedb41541d72b9475d7 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:49.345625  6798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77e330a82df4b43a745d57a68f6f057" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:49.346694  6798 raft_consensus.cc:2393] T e77e330a82df4b43a745d57a68f6f057 P b7ab4784c7344b939bc36f639286f377 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ccd8a4c3bfe3413cb2ae219b09aea832 in current term 17: Already voted for candidate cd75a17ab2604397adab03bb8b5fd75c in this term.
W20260709 13:20:49.348248  7468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 97879.8us
I20260709 13:20:49.350204 12370 raft_consensus.cc:3055] T 7c44c4849aa54f2b94d1f1bef9ed546f P ccd8a4c3bfe3413cb2ae219b09aea832 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:20:49.330197 12240 raft_consensus.cc:515] T 711ef6523deb4cbe8ef2ba61e1c21c98 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:49.350646 12370 raft_consensus.cc:740] T 7c44c4849aa54f2b94d1f1bef9ed546f P ccd8a4c3bfe3413cb2ae219b09aea832 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
I20260709 13:20:49.351519 12370 consensus_queue.cc:260] T 7c44c4849aa54f2b94d1f1bef9ed546f P ccd8a4c3bfe3413cb2ae219b09aea832 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 12, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:49.325519 12335 consensus_queue.cc:1048] T 24ee15416e3145beaa1b8183453729a3 P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Connected to new peer: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.028s
I20260709 13:20:49.354005 11634 leader_election.cc:290] T fe20b4b48823486ca3b9c648db6ce8aa P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:20:49.354768 12497 leader_election.cc:290] T d33d5ee8ef6f415593d8df52063161ad P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:49.234524 12352 leader_election.cc:290] T 3d65025eea89441290d85dd053810e31 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 16 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:49.356555  7502 raft_consensus.cc:1240] T 3fa34c08b205435dba97346991aa1f92 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 19 FOLLOWER]: Rejecting Update request from peer cd75a17ab2604397adab03bb8b5fd75c for earlier term 18. Current term is 19. Ops: []
I20260709 13:20:49.303669 12498 raft_consensus.cc:515] T 9b3759de40694069b13c0f8bd40e5709 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:49.355839  6725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20f6842e26174571996b8dea4151d4be" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:49.277484 11994 raft_consensus.cc:493] T 853ac0a8cbd64ce99457f170216d4d0f P ccd8a4c3bfe3413cb2ae219b09aea832 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:20:49.346625 12417 leader_election.cc:290] T bb3d8792045a4583ae2e965b1350a5b4 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:20:49.363262 12011 raft_consensus.cc:993] T 95a75bfe094d4bdc963aba3f08dfcd25 P ccd8a4c3bfe3413cb2ae219b09aea832: : Instructing follower cd75a17ab2604397adab03bb8b5fd75c to start an election
I20260709 13:20:49.367460  6726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d33d5ee8ef6f415593d8df52063161ad" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:20:49.390033  6726 raft_consensus.cc:3060] T d33d5ee8ef6f415593d8df52063161ad P ccd8a4c3bfe3413cb2ae219b09aea832 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:49.367669 11634 raft_consensus.cc:493] T 9e326172347f45e99a0d482b5d8ef768 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:20:49.367843  6697 leader_election.cc:304] T 3fa34c08b205435dba97346991aa1f92 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:20:49.355767  7494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be1a92657f494cac8dd227d152f50151" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb"
I20260709 13:20:49.356727 12481 raft_consensus.cc:493] T 4b8cacb381b746da8d0049b0a83b41dd P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:49.368957  6695 leader_election.cc:304] T 7c37d41cd9164c15a6826ca62a851a69 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:20:49.370519  6727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b56bf91d90824c959e21e0cee5ba1816" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:49.339426  6802 raft_consensus.cc:2955] T 95a75bfe094d4bdc963aba3f08dfcd25 P b7ab4784c7344b939bc36f639286f377 [term 13 FOLLOWER]: Committing config change with OpId 13.7: config changed from index -1 to 7, NON_VOTER 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68) added. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } attrs { replace: true } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: NON_VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: true } } }
I20260709 13:20:49.342844  6804 raft_consensus.cc:2468] T b56bf91d90824c959e21e0cee5ba1816 P b7ab4784c7344b939bc36f639286f377 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 15.
I20260709 13:20:49.376507  6805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4275cf08e63345f993bce8664eada830" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:20:49.378630  6803 raft_consensus.cc:1240] T 8c7f33e544204fbaac4078e3e83bbf4e P b7ab4784c7344b939bc36f639286f377 [term 14 FOLLOWER]: Rejecting Update request from peer ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 13. Current term is 14. Ops: []
I20260709 13:20:49.377676  6724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f03d0dbf16864ca4bc1bb5e4c0334c0f" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:20:49.324928 12288 raft_consensus.cc:2804] T 7a734b5ab7834e05a8c422208acc58b1 P cd75a17ab2604397adab03bb8b5fd75c [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:20:49.395593  6727 raft_consensus.cc:2468] T b56bf91d90824c959e21e0cee5ba1816 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 15.
I20260709 13:20:49.389392  6880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f58dc08b12a2494bb9a1372837970ca2" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:20:49.393337  6872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d33d5ee8ef6f415593d8df52063161ad" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:20:49.399636  6872 raft_consensus.cc:3060] T d33d5ee8ef6f415593d8df52063161ad P cd75a17ab2604397adab03bb8b5fd75c [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:49.332274 12340 leader_election.cc:290] T f4b8bd455d5a47c18a1380839c6e0d61 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 16 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:49.403414  6807 raft_consensus.cc:2468] T 9e326172347f45e99a0d482b5d8ef768 P b7ab4784c7344b939bc36f639286f377 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 13.
I20260709 13:20:49.404524  6807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20f6842e26174571996b8dea4151d4be" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:49.405745  6807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5be3a11b23d4ea9b08300a2789821c7" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:49.406368  6807 raft_consensus.cc:2468] T f5be3a11b23d4ea9b08300a2789821c7 P b7ab4784c7344b939bc36f639286f377 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 14.
I20260709 13:20:49.407120  6807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb7fa124c3bf4ef9ab65a407cb008441" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:49.407622  6807 raft_consensus.cc:2468] T bb7fa124c3bf4ef9ab65a407cb008441 P b7ab4784c7344b939bc36f639286f377 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 15.
I20260709 13:20:49.408320  6807 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a1704639a875409b9959353527b3fd68"
dest_uuid: "b7ab4784c7344b939bc36f639286f377"
mode: GRACEFUL
new_leader_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
 from {username='slave'} at 127.0.0.1:38240
I20260709 13:20:49.408795  6807 raft_consensus.cc:606] T a1704639a875409b9959353527b3fd68 P b7ab4784c7344b939bc36f639286f377 [term 16 FOLLOWER]: Received request to transfer leadership to TS cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:20:49.409090  6807 raft_consensus.cc:614] T a1704639a875409b9959353527b3fd68 P b7ab4784c7344b939bc36f639286f377 [term 16 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:20:49.410320  6881 raft_consensus.cc:2468] T 90d42e216d9741e190bca19a781291fd P cd75a17ab2604397adab03bb8b5fd75c [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 16.
I20260709 13:20:49.411194  7503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe20b4b48823486ca3b9c648db6ce8aa" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
W20260709 13:20:49.413250  6697 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.68:45071, user_credentials={real_user=slave}} blocked reactor thread for 45481.4us
I20260709 13:20:49.436280  6727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be1a92657f494cac8dd227d152f50151" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:20:49.435052  6724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f9c2e2bf644115957398fe4c9459db" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 16 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:20:49.451148  6725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f58dc08b12a2494bb9a1372837970ca2" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:20:49.507869  6880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f03d0dbf16864ca4bc1bb5e4c0334c0f" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
W20260709 13:20:49.411396 12451 consensus_meta.cc:287] T a1704639a875409b9959353527b3fd68 P ccd8a4c3bfe3413cb2ae219b09aea832: Time spent flushing consensus metadata: real 0.771s	user 0.013s	sys 0.000s
I20260709 13:20:49.486137  6798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce4f062dcd314d43a63ca74067cb5ee3" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:49.548348  6725 raft_consensus.cc:3060] T f58dc08b12a2494bb9a1372837970ca2 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:20:49.399230 12481 raft_consensus.cc:3060] T 4b8cacb381b746da8d0049b0a83b41dd P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:49.380993 12398 raft_consensus.cc:1081] T 34f36d59d88f40fe8a2805e604fc6c0a P b7ab4784c7344b939bc36f639286f377 [term 14 LEADER]: Signalling peer cd75a17ab2604397adab03bb8b5fd75c to start an election
I20260709 13:20:49.389739 12448 raft_consensus.cc:2749] T 17587d6730594da4a56fa13a353232a1 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:20:49.379186 12345 raft_consensus.cc:2749] T 404190ce4ce94cecbfcb6ea9d1dd8626 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:20:49.554579  7501 raft_consensus.cc:2468] T bb7fa124c3bf4ef9ab65a407cb008441 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 15.
W20260709 13:20:49.561041  6695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 192131us
I20260709 13:20:49.578989  6732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4b8bd455d5a47c18a1380839c6e0d61" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:20:49.580054  6695 leader_election.cc:304] T f09c2a98de1a4decabd0ff900dd44caa P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:20:49.583501  6807 raft_consensus.cc:1240] T 7c44c4849aa54f2b94d1f1bef9ed546f P b7ab4784c7344b939bc36f639286f377 [term 18 FOLLOWER]: Rejecting Update request from peer ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 17. Current term is 18. Ops: [17.12-17.12]
W20260709 13:20:49.561851  6697 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.68:45071, user_credentials={real_user=slave}} blocked reactor thread for 147562us
I20260709 13:20:49.399144 12288 raft_consensus.cc:493] T 7a734b5ab7834e05a8c422208acc58b1 P cd75a17ab2604397adab03bb8b5fd75c [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:20:49.570192  6770 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 192393us
I20260709 13:20:49.600286  6732 raft_consensus.cc:2393] T f4b8bd455d5a47c18a1380839c6e0d61 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate b7ab4784c7344b939bc36f639286f377 in current term 16: Already voted for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in this term.
I20260709 13:20:49.599879  6798 raft_consensus.cc:1240] T f03d0dbf16864ca4bc1bb5e4c0334c0f P b7ab4784c7344b939bc36f639286f377 [term 16 FOLLOWER]: Rejecting Update request from peer ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 15. Current term is 16. Ops: []
I20260709 13:20:49.600653  6770 leader_election.cc:304] T 7a734b5ab7834e05a8c422208acc58b1 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
I20260709 13:20:49.438959 12011 raft_consensus.cc:1081] T 95a75bfe094d4bdc963aba3f08dfcd25 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 13 LEADER]: Signalling peer cd75a17ab2604397adab03bb8b5fd75c to start an election
I20260709 13:20:49.412200 12397 raft_consensus.cc:2764] T 90d42e216d9741e190bca19a781291fd P cd75a17ab2604397adab03bb8b5fd75c [term 16 FOLLOWER]: Leader pre-election decision vote started in defunct term 15: won
I20260709 13:20:49.612169  6695 leader_election.cc:304] T 7a734b5ab7834e05a8c422208acc58b1 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:20:49.612527 12214 raft_consensus.cc:2804] T f09c2a98de1a4decabd0ff900dd44caa P ccd8a4c3bfe3413cb2ae219b09aea832 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:20:49.613086 12214 raft_consensus.cc:493] T f09c2a98de1a4decabd0ff900dd44caa P ccd8a4c3bfe3413cb2ae219b09aea832 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:49.613441 12214 raft_consensus.cc:3060] T f09c2a98de1a4decabd0ff900dd44caa P ccd8a4c3bfe3413cb2ae219b09aea832 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:20:49.614341  6695 leader_election.cc:304] T 22ccee1b570c4ad3a57bd7aec085b1b4 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:20:49.584465  6880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d65025eea89441290d85dd053810e31" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:20:49.616364  6880 raft_consensus.cc:2393] T 3d65025eea89441290d85dd053810e31 P cd75a17ab2604397adab03bb8b5fd75c [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate b7ab4784c7344b939bc36f639286f377 in current term 16: Already voted for candidate cd75a17ab2604397adab03bb8b5fd75c in this term.
I20260709 13:20:49.567330 11937 leader_election.cc:290] T 8c7f33e544204fbaac4078e3e83bbf4e P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:20:49.601154  6807 raft_consensus.cc:1240] T be1a92657f494cac8dd227d152f50151 P b7ab4784c7344b939bc36f639286f377 [term 17 FOLLOWER]: Rejecting Update request from peer ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 16. Current term is 17. Ops: []
I20260709 13:20:49.621534  6732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d65025eea89441290d85dd053810e31" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:20:49.554610 12417 raft_consensus.cc:2804] T bb7fa124c3bf4ef9ab65a407cb008441 P cd75a17ab2604397adab03bb8b5fd75c [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:20:49.596690 12490 raft_consensus.cc:2804] T bb7fa124c3bf4ef9ab65a407cb008441 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 15 FOLLOWER]: Leader pre-election won for term 16
W20260709 13:20:49.563198  6772 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.68:45071, user_credentials={real_user=slave}} blocked reactor thread for 316462us
I20260709 13:20:49.411645 11994 raft_consensus.cc:515] T 853ac0a8cbd64ce99457f170216d4d0f P ccd8a4c3bfe3413cb2ae219b09aea832 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:49.567066 12497 raft_consensus.cc:2804] T 3fa34c08b205435dba97346991aa1f92 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 19 FOLLOWER]: Leader election won for term 19
W20260709 13:20:49.619071  6697 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:49.629679  6732 raft_consensus.cc:2393] T 3d65025eea89441290d85dd053810e31 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate b7ab4784c7344b939bc36f639286f377 in current term 16: Already voted for candidate cd75a17ab2604397adab03bb8b5fd75c in this term.
I20260709 13:20:49.452461 11634 raft_consensus.cc:515] T 9e326172347f45e99a0d482b5d8ef768 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:49.637627 12370 raft_consensus.cc:3060] T 7c44c4849aa54f2b94d1f1bef9ed546f P ccd8a4c3bfe3413cb2ae219b09aea832 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:20:49.640842  6770 leader_election.cc:304] T 7c44c4849aa54f2b94d1f1bef9ed546f P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:20:49.587173 12238 raft_consensus.cc:2749] T 7c37d41cd9164c15a6826ca62a851a69 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:20:49.642815  6770 leader_election.cc:304] T 4d9def8b32fd443aa94ab1420b06837b P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:20:49.664661  6726 raft_consensus.cc:2468] T d33d5ee8ef6f415593d8df52063161ad P ccd8a4c3bfe3413cb2ae219b09aea832 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 14.
I20260709 13:20:49.606462 12288 raft_consensus.cc:3060] T 7a734b5ab7834e05a8c422208acc58b1 P cd75a17ab2604397adab03bb8b5fd75c [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:49.670794  6872 raft_consensus.cc:2468] T d33d5ee8ef6f415593d8df52063161ad P cd75a17ab2604397adab03bb8b5fd75c [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 14.
I20260709 13:20:49.576390 12451 raft_consensus.cc:515] T a1704639a875409b9959353527b3fd68 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:49.682351 12293 raft_consensus.cc:493] T f4b8bd455d5a47c18a1380839c6e0d61 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:49.703862  6872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4b8bd455d5a47c18a1380839c6e0d61" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:20:49.707474  6725 raft_consensus.cc:2468] T f58dc08b12a2494bb9a1372837970ca2 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 18.
I20260709 13:20:49.626955 12417 raft_consensus.cc:493] T bb7fa124c3bf4ef9ab65a407cb008441 P cd75a17ab2604397adab03bb8b5fd75c [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:49.641907 12505 raft_consensus.cc:2749] T 7a734b5ab7834e05a8c422208acc58b1 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:20:49.699311  6772 leader_election.cc:304] T a1704639a875409b9959353527b3fd68 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
W20260709 13:20:49.776933  6770 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 134218us
I20260709 13:20:49.648425 12448 raft_consensus.cc:2749] T 22ccee1b570c4ad3a57bd7aec085b1b4 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:20:49.782235  6846 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.68:45071, user_credentials={real_user=slave}} blocked reactor thread for 478438us
W20260709 13:20:49.787308  6772 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 88092.2us
I20260709 13:20:49.685735 12358 raft_consensus.cc:2804] T 7a734b5ab7834e05a8c422208acc58b1 P b7ab4784c7344b939bc36f639286f377 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:20:49.682621 12396 raft_consensus.cc:2749] T 7c44c4849aa54f2b94d1f1bef9ed546f P b7ab4784c7344b939bc36f639286f377 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:20:49.794682  6723 raft_consensus.cc:2393] T a1704639a875409b9959353527b3fd68 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7ab4784c7344b939bc36f639286f377 in current term 17: Already voted for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in this term.
I20260709 13:20:49.797204  6772 leader_election.cc:304] T 90d42e216d9741e190bca19a781291fd P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:20:49.847983  6872 raft_consensus.cc:2468] T f4b8bd455d5a47c18a1380839c6e0d61 P cd75a17ab2604397adab03bb8b5fd75c [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 16.
I20260709 13:20:49.802819  6798 raft_consensus.cc:1275] T b56bf91d90824c959e21e0cee5ba1816 P b7ab4784c7344b939bc36f639286f377 [term 15 FOLLOWER]: Refusing update from remote peer cd75a17ab2604397adab03bb8b5fd75c: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:20:49.779114 12417 raft_consensus.cc:3060] T bb7fa124c3bf4ef9ab65a407cb008441 P cd75a17ab2604397adab03bb8b5fd75c [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:20:49.851253  6874 consensus_meta.cc:287] T 8c7f33e544204fbaac4078e3e83bbf4e P cd75a17ab2604397adab03bb8b5fd75c: Time spent flushing consensus metadata: real 0.574s	user 0.011s	sys 0.000s
I20260709 13:20:49.851718  6874 raft_consensus.cc:2468] T 8c7f33e544204fbaac4078e3e83bbf4e P cd75a17ab2604397adab03bb8b5fd75c [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 14.
I20260709 13:20:49.852237  6798 raft_consensus.cc:1240] T f3f9c2e2bf644115957398fe4c9459db P b7ab4784c7344b939bc36f639286f377 [term 16 FOLLOWER]: Rejecting Update request from peer cd75a17ab2604397adab03bb8b5fd75c for earlier term 15. Current term is 16. Ops: [13.9-15.10]
I20260709 13:20:49.854116  6875 raft_consensus.cc:1240] T 8c7f33e544204fbaac4078e3e83bbf4e P cd75a17ab2604397adab03bb8b5fd75c [term 14 FOLLOWER]: Rejecting Update request from peer ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 13. Current term is 14. Ops: []
I20260709 13:20:49.787580 12398 raft_consensus.cc:2749] T 4d9def8b32fd443aa94ab1420b06837b P b7ab4784c7344b939bc36f639286f377 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:20:49.792166 12358 raft_consensus.cc:493] T 7a734b5ab7834e05a8c422208acc58b1 P b7ab4784c7344b939bc36f639286f377 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:49.797777 12499 raft_consensus.cc:2804] T a1704639a875409b9959353527b3fd68 P b7ab4784c7344b939bc36f639286f377 [term 16 FOLLOWER]: Leader pre-election won for term 17
W20260709 13:20:49.880321  6844 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.587s	user 0.015s	sys 0.051s
W20260709 13:20:49.889412  6844 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.596s	user 0.015s	sys 0.051s
W20260709 13:20:49.889755  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 596975us
I20260709 13:20:49.890987  6844 leader_election.cc:304] T 7c37d41cd9164c15a6826ca62a851a69 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:20:49.782618 12293 raft_consensus.cc:515] T f4b8bd455d5a47c18a1380839c6e0d61 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:49.858373  6876 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "34f36d59d88f40fe8a2805e604fc6c0a"
dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
 from {username='slave'} at 127.0.0.1:53406
I20260709 13:20:49.868275 12340 raft_consensus.cc:2804] T 90d42e216d9741e190bca19a781291fd P b7ab4784c7344b939bc36f639286f377 [term 16 FOLLOWER]: Leader election won for term 16
W20260709 13:20:49.897280 12227 consensus_meta.cc:287] T a3022224cc81473690653a83d4e99470 P ccd8a4c3bfe3413cb2ae219b09aea832: Time spent flushing consensus metadata: real 1.060s	user 0.009s	sys 0.004s
I20260709 13:20:49.879771 11994 leader_election.cc:290] T 853ac0a8cbd64ce99457f170216d4d0f P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:49.890904 12358 raft_consensus.cc:3060] T 7a734b5ab7834e05a8c422208acc58b1 P b7ab4784c7344b939bc36f639286f377 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:20:49.927367  6772 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 129872us
I20260709 13:20:49.893915 12499 raft_consensus.cc:493] T a1704639a875409b9959353527b3fd68 P b7ab4784c7344b939bc36f639286f377 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:49.895681 12498 leader_election.cc:290] T 9b3759de40694069b13c0f8bd40e5709 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:49.983022  6876 raft_consensus.cc:493] T 34f36d59d88f40fe8a2805e604fc6c0a P cd75a17ab2604397adab03bb8b5fd75c [term 14 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:20:49.983771  6876 raft_consensus.cc:3060] T 34f36d59d88f40fe8a2805e604fc6c0a P cd75a17ab2604397adab03bb8b5fd75c [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:49.977218 12499 raft_consensus.cc:3060] T a1704639a875409b9959353527b3fd68 P b7ab4784c7344b939bc36f639286f377 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:20:49.984596 12510 log.cc:927] Time spent T 7ba5dac66ab5497e9e336f2a3c28cda5 P b7ab4784c7344b939bc36f639286f377: Append to log took a long time: real 0.070s	user 0.001s	sys 0.000s
W20260709 13:20:50.003851  6770 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 207379us
I20260709 13:20:50.007110  6770 leader_election.cc:304] T b56bf91d90824c959e21e0cee5ba1816 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:20:49.966914 12227 raft_consensus.cc:515] T a3022224cc81473690653a83d4e99470 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
W20260709 13:20:50.003644 12518 log.cc:927] Time spent T f3f9c2e2bf644115957398fe4c9459db P ccd8a4c3bfe3413cb2ae219b09aea832: Append to log took a long time: real 0.387s	user 0.001s	sys 0.000s
I20260709 13:20:50.044251 12342 raft_consensus.cc:3055] T 4275cf08e63345f993bce8664eada830 P b7ab4784c7344b939bc36f639286f377 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:20:50.044800 12342 raft_consensus.cc:740] T 4275cf08e63345f993bce8664eada830 P b7ab4784c7344b939bc36f639286f377 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
W20260709 13:20:50.045233 12523 log.cc:927] Time spent T 9b3759de40694069b13c0f8bd40e5709 P cd75a17ab2604397adab03bb8b5fd75c: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
I20260709 13:20:50.045706 12342 consensus_queue.cc:260] T 4275cf08e63345f993bce8664eada830 P b7ab4784c7344b939bc36f639286f377 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:50.047358 12342 raft_consensus.cc:3060] T 4275cf08e63345f993bce8664eada830 P b7ab4784c7344b939bc36f639286f377 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:20:50.018921 12521 log.cc:927] Time spent T c4db81d9d329422bb3b4160ca4ac2d1d P cd75a17ab2604397adab03bb8b5fd75c: Append to log took a long time: real 0.152s	user 0.001s	sys 0.000s
I20260709 13:20:50.048808  6723 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50004 (request call id 2617) took 1213 ms. Trace:
I20260709 13:20:50.051481 12490 raft_consensus.cc:493] T bb7fa124c3bf4ef9ab65a407cb008441 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:50.052079 12490 raft_consensus.cc:3060] T bb7fa124c3bf4ef9ab65a407cb008441 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:50.041102  6876 raft_consensus.cc:515] T 34f36d59d88f40fe8a2805e604fc6c0a P cd75a17ab2604397adab03bb8b5fd75c [term 15 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:50.049336  6723 rpcz_store.cc:276] 0709 13:20:48.847251 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:48.847474 (+   223us) service_pool.cc:224] Handling call
0709 13:20:50.048590 (+1201116us) spinlock_profiling.cc:243] Waited 946 ms on lock 0x7b54003b88d4. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f9ae2fa 00007fcc1496fb17 00007fcc0deea6d4 00007fcc0deea662 00007fcc0deea591 00007fcc0deea50c 00007fcc0dee97c2 00007fcc0dce548c 00007fcc0dce48c6 00007fcc0dce426f
0709 13:20:50.048742 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2174673792}
W20260709 13:20:50.019930 12520 log.cc:927] Time spent T 7c37d41cd9164c15a6826ca62a851a69 P b7ab4784c7344b939bc36f639286f377: Append to log took a long time: real 0.116s	user 0.000s	sys 0.000s
W20260709 13:20:50.048872 12524 log.cc:927] Time spent T 4b8cacb381b746da8d0049b0a83b41dd P cd75a17ab2604397adab03bb8b5fd75c: Append to log took a long time: real 0.066s	user 0.001s	sys 0.000s
W20260709 13:20:50.099717  6772 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 132403us
W20260709 13:20:50.058930 12367 consensus_meta.cc:287] T bb3d8792045a4583ae2e965b1350a5b4 P ccd8a4c3bfe3413cb2ae219b09aea832: Time spent flushing consensus metadata: real 0.836s	user 0.006s	sys 0.006s
W20260709 13:20:50.101364  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 210441us
I20260709 13:20:50.102298  6772 leader_election.cc:304] T f03d0dbf16864ca4bc1bb5e4c0334c0f P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:20:50.015564 12529 raft_consensus.cc:493] T e31b9971c15848dea59d4d4130141d9e P cd75a17ab2604397adab03bb8b5fd75c [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:20:50.111578  6772 leader_election.cc:304] T d33d5ee8ef6f415593d8df52063161ad P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
W20260709 13:20:50.114684  6696 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:50.099699 12451 leader_election.cc:290] T a1704639a875409b9959353527b3fd68 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 17 election: Requested vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:50.097280 12340 raft_consensus.cc:697] T 90d42e216d9741e190bca19a781291fd P b7ab4784c7344b939bc36f639286f377 [term 16 LEADER]: Becoming Leader. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
W20260709 13:20:50.113304 12334 consensus_meta.cc:287] T 3411566abe2d4c9bb4b2adfdd05e6f17 P cd75a17ab2604397adab03bb8b5fd75c: Time spent flushing consensus metadata: real 0.880s	user 0.004s	sys 0.011s
W20260709 13:20:50.118546 12484 consensus_meta.cc:287] T 7887766dc6784fcaa42b35c05fea7a99 P b7ab4784c7344b939bc36f639286f377: Time spent flushing consensus metadata: real 0.884s	user 0.011s	sys 0.004s
W20260709 13:20:50.144074  6802 consensus_meta.cc:287] T 95a75bfe094d4bdc963aba3f08dfcd25 P b7ab4784c7344b939bc36f639286f377: Time spent flushing consensus metadata: real 0.743s	user 0.013s	sys 0.000s
I20260709 13:20:50.149214  6844 leader_election.cc:400] T 3fa34c08b205435dba97346991aa1f92 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 18 election: Vote denied by peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391) with higher term. Message: Invalid argument: T 3fa34c08b205435dba97346991aa1f92 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c for earlier term 18. Current term is 19.
W20260709 13:20:50.150650  6770 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 143659us
I20260709 13:20:50.151916  6844 leader_election.cc:304] T 427c124d773f483294511e80fe340075 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, ccd8a4c3bfe3413cb2ae219b09aea832
W20260709 13:20:50.156009  6846 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.68:45071, user_credentials={real_user=slave}} blocked reactor thread for 369492us
I20260709 13:20:50.157626  6770 leader_election.cc:304] T f3f9c2e2bf644115957398fe4c9459db P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:20:50.105075 12499 raft_consensus.cc:515] T a1704639a875409b9959353527b3fd68 P b7ab4784c7344b939bc36f639286f377 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:50.159658  6844 leader_election.cc:304] T 3d65025eea89441290d85dd053810e31 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:20:50.144595 12293 leader_election.cc:290] T f4b8bd455d5a47c18a1380839c6e0d61 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:50.113240 12367 raft_consensus.cc:515] T bb3d8792045a4583ae2e965b1350a5b4 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:20:50.128579 12542 raft_consensus.cc:2749] T f03d0dbf16864ca4bc1bb5e4c0334c0f P b7ab4784c7344b939bc36f639286f377 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:20:50.158180  6799 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:32976 (request call id 3346) took 1182 ms. Trace:
I20260709 13:20:50.147593 12484 raft_consensus.cc:515] T 7887766dc6784fcaa42b35c05fea7a99 P b7ab4784c7344b939bc36f639286f377 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:50.169400 12396 raft_consensus.cc:2749] T f3f9c2e2bf644115957398fe4c9459db P b7ab4784c7344b939bc36f639286f377 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:20:50.169776  6800 raft_consensus.cc:1240] T 7887766dc6784fcaa42b35c05fea7a99 P b7ab4784c7344b939bc36f639286f377 [term 17 FOLLOWER]: Rejecting Update request from peer ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 16. Current term is 17. Ops: []
I20260709 13:20:50.118072 12529 raft_consensus.cc:515] T e31b9971c15848dea59d4d4130141d9e P cd75a17ab2604397adab03bb8b5fd75c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:50.121090 12497 raft_consensus.cc:697] T 3fa34c08b205435dba97346991aa1f92 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 19 LEADER]: Becoming Leader. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
I20260709 13:20:50.155768 12506 raft_consensus.cc:2804] T b56bf91d90824c959e21e0cee5ba1816 P b7ab4784c7344b939bc36f639286f377 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:20:50.157074 12275 raft_consensus.cc:2804] T d33d5ee8ef6f415593d8df52063161ad P b7ab4784c7344b939bc36f639286f377 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:20:50.145397 12334 raft_consensus.cc:515] T 3411566abe2d4c9bb4b2adfdd05e6f17 P cd75a17ab2604397adab03bb8b5fd75c [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:50.171484 12484 leader_election.cc:290] T 7887766dc6784fcaa42b35c05fea7a99 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 17 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:50.185861 12506 raft_consensus.cc:493] T b56bf91d90824c959e21e0cee5ba1816 P b7ab4784c7344b939bc36f639286f377 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:50.195425 12506 raft_consensus.cc:3060] T b56bf91d90824c959e21e0cee5ba1816 P b7ab4784c7344b939bc36f639286f377 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:50.175657 12544 raft_consensus.cc:493] T d8292e16e5654be6bc408560cf256aaa P cd75a17ab2604397adab03bb8b5fd75c [term 17 FOLLOWER]: Starting pre-election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:20:50.208024 12334 leader_election.cc:290] T 3411566abe2d4c9bb4b2adfdd05e6f17 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 14 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:20:50.208189 12552 consensus_queue.cc:1048] T f58dc08b12a2494bb9a1372837970ca2 P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Connected to new peer: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:20:50.208846 12334 raft_consensus.cc:2749] T 427c124d773f483294511e80fe340075 P cd75a17ab2604397adab03bb8b5fd75c [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:20:50.209695 12552 raft_consensus.cc:2804] T 3d65025eea89441290d85dd053810e31 P cd75a17ab2604397adab03bb8b5fd75c [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:20:50.210186 12552 raft_consensus.cc:697] T 3d65025eea89441290d85dd053810e31 P cd75a17ab2604397adab03bb8b5fd75c [term 16 LEADER]: Becoming Leader. State: Replica: cd75a17ab2604397adab03bb8b5fd75c, State: Running, Role: LEADER
W20260709 13:20:50.217706  6846 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.68:45071, user_credentials={real_user=slave}} blocked reactor thread for 60915.6us
I20260709 13:20:50.200408 12275 raft_consensus.cc:697] T d33d5ee8ef6f415593d8df52063161ad P b7ab4784c7344b939bc36f639286f377 [term 14 LEADER]: Becoming Leader. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
W20260709 13:20:50.230129  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 70589.6us
I20260709 13:20:50.211001 12529 leader_election.cc:290] T e31b9971c15848dea59d4d4130141d9e P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:20:50.233426  6802 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:32976 (request call id 3348) took 1254 ms. Trace:
I20260709 13:20:50.237490  6844 leader_election.cc:304] T b56bf91d90824c959e21e0cee5ba1816 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
W20260709 13:20:50.314956  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 77562.4us
W20260709 13:20:50.314931  6772 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 153021us
I20260709 13:20:50.233984  6802 rpcz_store.cc:276] 0709 13:20:48.978819 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:49.317083 (+338264us) service_pool.cc:224] Handling call
0709 13:20:49.339071 (+ 21988us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:49.339311 (+   240us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:20:50.146744 (+807433us) log.cc:844] Serialized 14 byte log entry
0709 13:20:50.232939 (+ 86195us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:20:50.233030 (+    91us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:20:50.233096 (+    66us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:50.233192 (+    96us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:50.233356 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":82335,"threads_started":1}
I20260709 13:20:50.317484  6772 leader_election.cc:304] T f4b8bd455d5a47c18a1380839c6e0d61 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:20:50.339538  6772 leader_election.cc:304] T 8c7f33e544204fbaac4078e3e83bbf4e P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:20:50.221256 12545 raft_consensus.cc:2804] T 7c37d41cd9164c15a6826ca62a851a69 P cd75a17ab2604397adab03bb8b5fd75c [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:20:50.341145 12535 raft_consensus.cc:493] T ab432e62819d499eaaf3dd55481dd930 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:20:50.397992 12535 raft_consensus.cc:515] T ab432e62819d499eaaf3dd55481dd930 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:50.400705 12499 leader_election.cc:290] T a1704639a875409b9959353527b3fd68 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 17 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:50.236518 12227 leader_election.cc:290] T a3022224cc81473690653a83d4e99470 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 17 election: Requested vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:50.335726 12529 consensus_queue.cc:1059] T 3fa34c08b205435dba97346991aa1f92 P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.073s
I20260709 13:20:50.214666 12544 raft_consensus.cc:515] T d8292e16e5654be6bc408560cf256aaa P cd75a17ab2604397adab03bb8b5fd75c [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:50.410789 12544 leader_election.cc:290] T d8292e16e5654be6bc408560cf256aaa P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
W20260709 13:20:50.412815 12546 log.cc:927] Time spent T 34f36d59d88f40fe8a2805e604fc6c0a P b7ab4784c7344b939bc36f639286f377: Append to log took a long time: real 0.191s	user 0.000s	sys 0.000s
I20260709 13:20:50.412550 12275 consensus_queue.cc:237] T d33d5ee8ef6f415593d8df52063161ad P b7ab4784c7344b939bc36f639286f377 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
W20260709 13:20:50.315945 12288 consensus_meta.cc:287] T 7a734b5ab7834e05a8c422208acc58b1 P cd75a17ab2604397adab03bb8b5fd75c: Time spent flushing consensus metadata: real 0.538s	user 0.011s	sys 0.000s
I20260709 13:20:50.417239 12288 raft_consensus.cc:515] T 7a734b5ab7834e05a8c422208acc58b1 P cd75a17ab2604397adab03bb8b5fd75c [term 17 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } attrs { replace: true } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: NON_VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: true } }
W20260709 13:20:50.418813 12353 consensus_meta.cc:287] T bd6869f07b5a4885a0b99fbe60c3b175 P b7ab4784c7344b939bc36f639286f377: Time spent flushing consensus metadata: real 1.192s	user 0.008s	sys 0.008s
I20260709 13:20:50.419306 12353 raft_consensus.cc:515] T bd6869f07b5a4885a0b99fbe60c3b175 P b7ab4784c7344b939bc36f639286f377 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
W20260709 13:20:50.420397 12214 consensus_meta.cc:287] T f09c2a98de1a4decabd0ff900dd44caa P ccd8a4c3bfe3413cb2ae219b09aea832: Time spent flushing consensus metadata: real 0.806s	user 0.013s	sys 0.000s
I20260709 13:20:50.420849 12214 raft_consensus.cc:515] T f09c2a98de1a4decabd0ff900dd44caa P ccd8a4c3bfe3413cb2ae219b09aea832 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:50.423183 12214 leader_election.cc:290] T f09c2a98de1a4decabd0ff900dd44caa P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 18 election: Requested vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:50.343247  7494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3d8792045a4583ae2e965b1350a5b4" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:20:50.428870  7494 raft_consensus.cc:2393] T bb3d8792045a4583ae2e965b1350a5b4 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c in current term 14: Already voted for candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in this term.
I20260709 13:20:50.430341 12557 consensus_queue.cc:1048] T b56bf91d90824c959e21e0cee5ba1816 P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Connected to new peer: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:20:50.436436 12503 raft_consensus.cc:2804] T 8c7f33e544204fbaac4078e3e83bbf4e P b7ab4784c7344b939bc36f639286f377 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:20:50.437036 12503 raft_consensus.cc:697] T 8c7f33e544204fbaac4078e3e83bbf4e P b7ab4784c7344b939bc36f639286f377 [term 14 LEADER]: Becoming Leader. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
I20260709 13:20:50.437855 12503 consensus_queue.cc:237] T 8c7f33e544204fbaac4078e3e83bbf4e P b7ab4784c7344b939bc36f639286f377 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:50.440119 12352 raft_consensus.cc:2804] T f4b8bd455d5a47c18a1380839c6e0d61 P b7ab4784c7344b939bc36f639286f377 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:20:50.440683 12352 raft_consensus.cc:697] T f4b8bd455d5a47c18a1380839c6e0d61 P b7ab4784c7344b939bc36f639286f377 [term 16 LEADER]: Becoming Leader. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
I20260709 13:20:50.441614 12352 consensus_queue.cc:237] T f4b8bd455d5a47c18a1380839c6e0d61 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.7, Last appended by leader: 7, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:50.197206 12340 consensus_queue.cc:237] T 90d42e216d9741e190bca19a781291fd P b7ab4784c7344b939bc36f639286f377 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
W20260709 13:20:50.447788  6772 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 104921us
W20260709 13:20:50.452183  6770 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 286611us
I20260709 13:20:50.210999 12552 consensus_queue.cc:237] T 3d65025eea89441290d85dd053810e31 P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:50.510604  6807 raft_consensus.cc:1240] T bd6869f07b5a4885a0b99fbe60c3b175 P b7ab4784c7344b939bc36f639286f377 [term 17 FOLLOWER]: Rejecting Update request from peer ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 16. Current term is 17. Ops: []
I20260709 13:20:50.419844 12288 leader_election.cc:290] T 7a734b5ab7834e05a8c422208acc58b1 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 17 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
W20260709 13:20:50.520799  6770 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 67197.4us
I20260709 13:20:50.521792  6770 leader_election.cc:304] T 3d65025eea89441290d85dd053810e31 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:20:50.523289  6877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe20b4b48823486ca3b9c648db6ce8aa" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:50.523816  6881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d33d5ee8ef6f415593d8df52063161ad" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
W20260709 13:20:50.505716 12358 consensus_meta.cc:287] T 7a734b5ab7834e05a8c422208acc58b1 P b7ab4784c7344b939bc36f639286f377: Time spent flushing consensus metadata: real 0.507s	user 0.008s	sys 0.004s
I20260709 13:20:50.527124  6877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c240553ce044eedb41541d72b9475d7" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:50.529264  6879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "711ef6523deb4cbe8ef2ba61e1c21c98" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
W20260709 13:20:50.530813  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 214331us
I20260709 13:20:50.545799  6872 raft_consensus.cc:1275] T d8cee0accdb8499c86d4414b72565a38 P cd75a17ab2604397adab03bb8b5fd75c [term 16 FOLLOWER]: Refusing update from remote peer 7ba59cc884714e8aa5f3f0ecaed84cbb: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:20:50.547964  6881 raft_consensus.cc:2393] T d33d5ee8ef6f415593d8df52063161ad P cd75a17ab2604397adab03bb8b5fd75c [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ccd8a4c3bfe3413cb2ae219b09aea832 in current term 14: Already voted for candidate b7ab4784c7344b939bc36f639286f377 in this term.
I20260709 13:20:50.516661 12544 raft_consensus.cc:3055] T 3fa34c08b205435dba97346991aa1f92 P cd75a17ab2604397adab03bb8b5fd75c [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:20:50.566139  6872 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "95a75bfe094d4bdc963aba3f08dfcd25"
dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
 from {username='slave'} at 127.0.0.1:53416
I20260709 13:20:50.566927  6872 raft_consensus.cc:493] T 95a75bfe094d4bdc963aba3f08dfcd25 P cd75a17ab2604397adab03bb8b5fd75c [term 13 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:20:50.567579  6872 raft_consensus.cc:3060] T 95a75bfe094d4bdc963aba3f08dfcd25 P cd75a17ab2604397adab03bb8b5fd75c [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:50.557449  6881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce4f062dcd314d43a63ca74067cb5ee3" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:50.560459  6877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb7fa124c3bf4ef9ab65a407cb008441" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:50.523995 12367 leader_election.cc:290] T bb3d8792045a4583ae2e965b1350a5b4 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 15 election: Requested vote from peers cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
W20260709 13:20:50.549342 12417 consensus_meta.cc:287] T bb7fa124c3bf4ef9ab65a407cb008441 P cd75a17ab2604397adab03bb8b5fd75c: Time spent flushing consensus metadata: real 0.667s	user 0.011s	sys 0.000s
I20260709 13:20:50.525768 12529 raft_consensus.cc:493] T 711ef6523deb4cbe8ef2ba61e1c21c98 P cd75a17ab2604397adab03bb8b5fd75c [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:50.588850 12536 raft_consensus.cc:493] T e31b9971c15848dea59d4d4130141d9e P ccd8a4c3bfe3413cb2ae219b09aea832 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:20:50.589860 12249 raft_consensus.cc:493] T be1a92657f494cac8dd227d152f50151 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 16 FOLLOWER]: Starting pre-election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:20:50.590644 12249 raft_consensus.cc:515] T be1a92657f494cac8dd227d152f50151 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:20:50.591065 12545 raft_consensus.cc:493] T 7c37d41cd9164c15a6826ca62a851a69 P cd75a17ab2604397adab03bb8b5fd75c [term 15 FOLLOWER]: Starting leader election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:20:50.591684 12545 raft_consensus.cc:3060] T 7c37d41cd9164c15a6826ca62a851a69 P cd75a17ab2604397adab03bb8b5fd75c [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:50.553483 12535 leader_election.cc:290] T ab432e62819d499eaaf3dd55481dd930 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:50.549331 12358 raft_consensus.cc:515] T 7a734b5ab7834e05a8c422208acc58b1 P b7ab4784c7344b939bc36f639286f377 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } attrs { replace: true } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: NON_VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: true } }
I20260709 13:20:50.595176 12535 raft_consensus.cc:493] T 34f36d59d88f40fe8a2805e604fc6c0a P ccd8a4c3bfe3413cb2ae219b09aea832 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:20:50.595852 12535 raft_consensus.cc:515] T 34f36d59d88f40fe8a2805e604fc6c0a P ccd8a4c3bfe3413cb2ae219b09aea832 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:50.597892 12358 leader_election.cc:290] T 7a734b5ab7834e05a8c422208acc58b1 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 17 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:50.598210 12535 leader_election.cc:290] T 34f36d59d88f40fe8a2805e604fc6c0a P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:50.600785 12249 leader_election.cc:290] T be1a92657f494cac8dd227d152f50151 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:20:50.516932 12557 consensus_queue.cc:1059] T 3fa34c08b205435dba97346991aa1f92 P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: INVALID_TERM, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.051s
I20260709 13:20:50.589669 12536 raft_consensus.cc:515] T e31b9971c15848dea59d4d4130141d9e P ccd8a4c3bfe3413cb2ae219b09aea832 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:50.603813  6873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe20b4b48823486ca3b9c648db6ce8aa" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:50.604729  6880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "853ac0a8cbd64ce99457f170216d4d0f" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:50.503911 12497 consensus_queue.cc:237] T 3fa34c08b205435dba97346991aa1f92 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.14, Last appended by leader: 14, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:20:50.562775 12544 raft_consensus.cc:740] T 3fa34c08b205435dba97346991aa1f92 P cd75a17ab2604397adab03bb8b5fd75c [term 18 LEADER]: Becoming Follower/Learner. State: Replica: cd75a17ab2604397adab03bb8b5fd75c, State: Running, Role: LEADER
I20260709 13:20:50.646446  6723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c7f33e544204fbaac4078e3e83bbf4e" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:50.647286  6731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3d8792045a4583ae2e965b1350a5b4" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:50.647814  6727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3411566abe2d4c9bb4b2adfdd05e6f17" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:20:50.648013  6724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e31b9971c15848dea59d4d4130141d9e" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:50.649078  6725 raft_consensus.cc:1240] T f58dc08b12a2494bb9a1372837970ca2 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 18 FOLLOWER]: Rejecting Update request from peer cd75a17ab2604397adab03bb8b5fd75c for earlier term 17. Current term is 18. Ops: [17.10-17.10]
I20260709 13:20:50.650341  6726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8292e16e5654be6bc408560cf256aaa" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:50.653666  6731 raft_consensus.cc:2368] T bb3d8792045a4583ae2e965b1350a5b4 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c for earlier term 14. Current term is 15.
I20260709 13:20:50.661806  6724 raft_consensus.cc:2468] T e31b9971c15848dea59d4d4130141d9e P ccd8a4c3bfe3413cb2ae219b09aea832 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 13.
I20260709 13:20:50.665827  6874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7887766dc6784fcaa42b35c05fea7a99" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
W20260709 13:20:50.628731 12481 consensus_meta.cc:287] T 4b8cacb381b746da8d0049b0a83b41dd P 7ba59cc884714e8aa5f3f0ecaed84cbb: Time spent flushing consensus metadata: real 1.039s	user 0.011s	sys 0.001s
W20260709 13:20:50.667810  6696 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:50.670559  6730 raft_consensus.cc:1275] T fe20b4b48823486ca3b9c648db6ce8aa P ccd8a4c3bfe3413cb2ae219b09aea832 [term 13 FOLLOWER]: Refusing update from remote peer cd75a17ab2604397adab03bb8b5fd75c: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 11. (term mismatch)
I20260709 13:20:50.671379  6730 pending_rounds.cc:85] T fe20b4b48823486ca3b9c648db6ce8aa P ccd8a4c3bfe3413cb2ae219b09aea832: Aborting all ops after (but not including) 10
I20260709 13:20:50.673818  6880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b3759de40694069b13c0f8bd40e5709" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:50.671715  6730 pending_rounds.cc:107] T fe20b4b48823486ca3b9c648db6ce8aa P ccd8a4c3bfe3413cb2ae219b09aea832: Aborting uncommitted NO_OP operation due to leader change: 12.11
I20260709 13:20:50.664238  6872 raft_consensus.cc:515] T 95a75bfe094d4bdc963aba3f08dfcd25 P cd75a17ab2604397adab03bb8b5fd75c [term 14 FOLLOWER]: Starting forced leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } attrs { replace: true } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: NON_VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: true } }
I20260709 13:20:50.691213  6730 raft_consensus.cc:2889] T fe20b4b48823486ca3b9c648db6ce8aa P ccd8a4c3bfe3413cb2ae219b09aea832 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:20:50.617192 12417 raft_consensus.cc:515] T bb7fa124c3bf4ef9ab65a407cb008441 P cd75a17ab2604397adab03bb8b5fd75c [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:20:50.616138 12529 raft_consensus.cc:515] T 711ef6523deb4cbe8ef2ba61e1c21c98 P cd75a17ab2604397adab03bb8b5fd75c [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:50.699458  6880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a734b5ab7834e05a8c422208acc58b1" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 17 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:20:50.716143  6880 raft_consensus.cc:2393] T 7a734b5ab7834e05a8c422208acc58b1 P cd75a17ab2604397adab03bb8b5fd75c [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate b7ab4784c7344b939bc36f639286f377 in current term 17: Already voted for candidate cd75a17ab2604397adab03bb8b5fd75c in this term.
I20260709 13:20:50.728888 12417 leader_election.cc:290] T bb7fa124c3bf4ef9ab65a407cb008441 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 16 election: Requested vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:20:50.730122 12353 leader_election.cc:290] T bd6869f07b5a4885a0b99fbe60c3b175 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 17 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:50.732713  6877 raft_consensus.cc:2393] T bb7fa124c3bf4ef9ab65a407cb008441 P cd75a17ab2604397adab03bb8b5fd75c [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in current term 16: Already voted for candidate cd75a17ab2604397adab03bb8b5fd75c in this term.
I20260709 13:20:50.737428 12240 leader_election.cc:290] T 711ef6523deb4cbe8ef2ba61e1c21c98 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
W20260709 13:20:50.751487 12490 consensus_meta.cc:287] T bb7fa124c3bf4ef9ab65a407cb008441 P 7ba59cc884714e8aa5f3f0ecaed84cbb: Time spent flushing consensus metadata: real 0.699s	user 0.013s	sys 0.000s
I20260709 13:20:50.752312 12490 raft_consensus.cc:515] T bb7fa124c3bf4ef9ab65a407cb008441 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:20:50.757629 12490 leader_election.cc:290] T bb7fa124c3bf4ef9ab65a407cb008441 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 16 election: Requested vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:50.758450 12348 leader_election.cc:290] T 2c240553ce044eedb41541d72b9475d7 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:50.758613  6844 leader_election.cc:304] T a1704639a875409b9959353527b3fd68 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:20:50.765614  6875 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53416 (request call id 3378) took 1498 ms. Trace:
I20260709 13:20:50.766130 12557 raft_consensus.cc:2804] T a1704639a875409b9959353527b3fd68 P cd75a17ab2604397adab03bb8b5fd75c [term 15 FOLLOWER]: Leader pre-election won for term 16
W20260709 13:20:50.766350  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 53873.1us
I20260709 13:20:50.766657 12557 raft_consensus.cc:493] T a1704639a875409b9959353527b3fd68 P cd75a17ab2604397adab03bb8b5fd75c [term 15 FOLLOWER]: Starting leader election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:20:50.767061 12557 raft_consensus.cc:3060] T a1704639a875409b9959353527b3fd68 P cd75a17ab2604397adab03bb8b5fd75c [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:50.767256  6844 leader_election.cc:304] T ab432e62819d499eaaf3dd55481dd930 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:20:50.687057 12481 raft_consensus.cc:515] T 4b8cacb381b746da8d0049b0a83b41dd P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:20:50.769014 12485 raft_consensus.cc:493] T d8292e16e5654be6bc408560cf256aaa P b7ab4784c7344b939bc36f639286f377 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:20:50.769557 12485 raft_consensus.cc:515] T d8292e16e5654be6bc408560cf256aaa P b7ab4784c7344b939bc36f639286f377 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:50.770030 12481 leader_election.cc:290] T 4b8cacb381b746da8d0049b0a83b41dd P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 17 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:50.770774  7500 raft_consensus.cc:1240] T 4b8cacb381b746da8d0049b0a83b41dd P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 17 FOLLOWER]: Rejecting Update request from peer ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 16. Current term is 17. Ops: [16.13-16.13]
I20260709 13:20:50.771551 12485 leader_election.cc:290] T d8292e16e5654be6bc408560cf256aaa P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:50.771975  7500 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50742 (request call id 526) took 1389 ms. Trace:
I20260709 13:20:50.772368  7500 rpcz_store.cc:276] 0709 13:20:49.382679 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:49.382872 (+   193us) service_pool.cc:224] Handling call
0709 13:20:49.383371 (+   499us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:50.771155 (+1387784us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:50.771734 (+   579us) spinlock_profiling.cc:243] Waited 1.39 s on lock 0x7b54006040d4. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f9aae01 00007fcc0f9a983e 00007fcc1496e419 00007fcc0dee5bd4 00007fcc0dee5b62 00007fcc0dee5a91 00007fcc0dee5a0c 00007fcc0dee4cc2 00007fcc0dce548c 00007fcc0dce48c6
0709 13:20:50.771919 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3190188288}
I20260709 13:20:50.773015  6874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1704639a875409b9959353527b3fd68" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:20:50.800856  7500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb7fa124c3bf4ef9ab65a407cb008441" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb"
I20260709 13:20:50.779992  6877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6869f07b5a4885a0b99fbe60c3b175" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
W20260709 13:20:50.802455  6770 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 278858us
I20260709 13:20:50.803694  6770 leader_election.cc:304] T f58dc08b12a2494bb9a1372837970ca2 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:20:50.766145  6875 rpcz_store.cc:276] 0709 13:20:49.267660 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:49.276606 (+  8946us) service_pool.cc:224] Handling call
0709 13:20:49.852323 (+575717us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:49.878232 (+ 25909us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:50.765340 (+887108us) spinlock_profiling.cc:243] Waited 575 ms on lock 0x7b54001e82d0. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f9a98ad 00007fcc1496e419 00007fcc0dee5bd4 00007fcc0dee5b62 00007fcc0dee5a91 00007fcc0dee5a0c 00007fcc0dee4cc2 00007fcc0dce548c 00007fcc0dce48c6 00007fcc0dce426f
0709 13:20:50.765537 (+   197us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1323152768}
I20260709 13:20:50.807024  6875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1704639a875409b9959353527b3fd68" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:20:50.809233  7500 raft_consensus.cc:2393] T bb7fa124c3bf4ef9ab65a407cb008441 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c in current term 16: Already voted for candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in this term.
I20260709 13:20:50.806900  6879 raft_consensus.cc:2468] T 711ef6523deb4cbe8ef2ba61e1c21c98 P cd75a17ab2604397adab03bb8b5fd75c [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 18.
I20260709 13:20:50.808805  6872 leader_election.cc:290] T 95a75bfe094d4bdc963aba3f08dfcd25 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 14 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:20:50.814800  6875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8292e16e5654be6bc408560cf256aaa" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:50.799499 12397 raft_consensus.cc:2749] T ab432e62819d499eaaf3dd55481dd930 P cd75a17ab2604397adab03bb8b5fd75c [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:20:50.774227 12367 raft_consensus.cc:493] T 427c124d773f483294511e80fe340075 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 7ba59cc884714e8aa5f3f0ecaed84cbb)
I20260709 13:20:50.833091  6880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4b8bd455d5a47c18a1380839c6e0d61" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 17 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:50.836831  6880 raft_consensus.cc:2468] T f4b8bd455d5a47c18a1380839c6e0d61 P cd75a17ab2604397adab03bb8b5fd75c [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 16.
I20260709 13:20:50.841495  6726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7887766dc6784fcaa42b35c05fea7a99" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:20:50.832684  6695 leader_election.cc:304] T b56bf91d90824c959e21e0cee5ba1816 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:20:50.835036 12503 raft_consensus.cc:2804] T f58dc08b12a2494bb9a1372837970ca2 P b7ab4784c7344b939bc36f639286f377 [term 18 FOLLOWER]: Leader election won for term 18
W20260709 13:20:50.837646 12526 log.cc:927] Time spent T c4db81d9d329422bb3b4160ca4ac2d1d P ccd8a4c3bfe3413cb2ae219b09aea832: Append to log took a long time: real 0.735s	user 0.000s	sys 0.014s
I20260709 13:20:50.844429 12238 raft_consensus.cc:2804] T b56bf91d90824c959e21e0cee5ba1816 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:20:50.845176 12238 raft_consensus.cc:493] T b56bf91d90824c959e21e0cee5ba1816 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:50.845369 12563 raft_consensus.cc:493] T f03d0dbf16864ca4bc1bb5e4c0334c0f P cd75a17ab2604397adab03bb8b5fd75c [term 15 FOLLOWER]: Starting pre-election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:20:50.845634 12238 raft_consensus.cc:3060] T b56bf91d90824c959e21e0cee5ba1816 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:50.846251 12563 raft_consensus.cc:515] T f03d0dbf16864ca4bc1bb5e4c0334c0f P cd75a17ab2604397adab03bb8b5fd75c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:50.837468 12562 raft_consensus.cc:493] T a3022224cc81473690653a83d4e99470 P cd75a17ab2604397adab03bb8b5fd75c [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:20:50.848203 12516 log.cc:927] Time spent T 1bf4668eeb70467fb3dc5a0289233b3c P cd75a17ab2604397adab03bb8b5fd75c: Append to log took a long time: real 1.406s	user 0.006s	sys 0.000s
I20260709 13:20:50.848531 12562 raft_consensus.cc:515] T a3022224cc81473690653a83d4e99470 P cd75a17ab2604397adab03bb8b5fd75c [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:50.850001 12358 raft_consensus.cc:493] T 95a75bfe094d4bdc963aba3f08dfcd25 P b7ab4784c7344b939bc36f639286f377 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:20:50.850658 12358 raft_consensus.cc:515] T 95a75bfe094d4bdc963aba3f08dfcd25 P b7ab4784c7344b939bc36f639286f377 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } attrs { replace: true } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: NON_VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: true } }
I20260709 13:20:50.852742  6730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1704639a875409b9959353527b3fd68" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:20:50.853643  6730 raft_consensus.cc:2393] T a1704639a875409b9959353527b3fd68 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate b7ab4784c7344b939bc36f639286f377 in current term 17: Already voted for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in this term.
I20260709 13:20:50.853876 12238 raft_consensus.cc:515] T b56bf91d90824c959e21e0cee5ba1816 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:50.853986 12367 raft_consensus.cc:515] T 427c124d773f483294511e80fe340075 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } attrs { replace: true } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:20:50.854727  6878 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53416 (request call id 3369) took 1770 ms. Trace:
I20260709 13:20:50.855193  6878 rpcz_store.cc:276] 0709 13:20:49.084133 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:49.084354 (+   221us) service_pool.cc:224] Handling call
0709 13:20:49.084682 (+   328us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:49.108881 (+ 24199us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:20:49.108927 (+    46us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:20:49.134082 (+ 25155us) log.cc:844] Serialized 26 byte log entry
0709 13:20:49.204915 (+ 70833us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:20:49.204969 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:49.205052 (+    83us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:50.755505 (+1550453us) spinlock_profiling.cc:243] Waited 22.4 ms on lock 0x7b4400022b4c. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0c745db1 00007fcc0c7e3c85 00007fcc0c7e46a2 00007fcc0f5561db 00007fcc0f551aaf 00007fcc0f54586e 00007fcc0f544bb6 00007fcc0f5447d8 00007fcc0f54e221 00007fcc0f54e1d9 00007fcc0f54e169
0709 13:20:50.854384 (+ 98879us) raft_consensus.cc:1685] finished
0709 13:20:50.854409 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:50.854646 (+   237us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":138,"raft.run_cpu_time_us":122,"raft.run_wall_time_us":126,"spinlock_wait_cycles":51463552,"thread_start_us":57879,"threads_started":1,"wal-append.queue_time_us":215314}
I20260709 13:20:50.861709  6880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a75bfe094d4bdc963aba3f08dfcd25" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:50.870672  6844 leader_election.cc:304] T 4f00a2e87e56452083b759f60d461ee3 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, b7ab4784c7344b939bc36f639286f377
I20260709 13:20:50.888736  6880 raft_consensus.cc:2393] T 95a75bfe094d4bdc963aba3f08dfcd25 P cd75a17ab2604397adab03bb8b5fd75c [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7ab4784c7344b939bc36f639286f377 in current term 14: Already voted for candidate cd75a17ab2604397adab03bb8b5fd75c in this term.
I20260709 13:20:50.889055  6844 leader_election.cc:304] T 1bf4668eeb70467fb3dc5a0289233b3c P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:20:50.892091  6880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34f36d59d88f40fe8a2805e604fc6c0a" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:50.706614 12544 consensus_queue.cc:260] T 3fa34c08b205435dba97346991aa1f92 P cd75a17ab2604397adab03bb8b5fd75c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.15, Last appended by leader: 15, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:20:50.895632  6844 leader_election.cc:304] T 7ba5dac66ab5497e9e336f2a3c28cda5 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, b7ab4784c7344b939bc36f639286f377
W20260709 13:20:50.857199 12506 consensus_meta.cc:287] T b56bf91d90824c959e21e0cee5ba1816 P b7ab4784c7344b939bc36f639286f377: Time spent flushing consensus metadata: real 0.661s	user 0.012s	sys 0.000s
W20260709 13:20:50.865320 12519 log.cc:927] Time spent T 17587d6730594da4a56fa13a353232a1 P ccd8a4c3bfe3413cb2ae219b09aea832: Append to log took a long time: real 0.883s	user 0.007s	sys 0.006s
I20260709 13:20:50.901615  6802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c240553ce044eedb41541d72b9475d7" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:50.899438  6880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3d8792045a4583ae2e965b1350a5b4" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:20:50.903967  6805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "711ef6523deb4cbe8ef2ba61e1c21c98" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:50.904861  6805 raft_consensus.cc:2468] T 711ef6523deb4cbe8ef2ba61e1c21c98 P b7ab4784c7344b939bc36f639286f377 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 18.
I20260709 13:20:50.857471 12352 raft_consensus.cc:493] T 7ba5dac66ab5497e9e336f2a3c28cda5 P b7ab4784c7344b939bc36f639286f377 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 7ba59cc884714e8aa5f3f0ecaed84cbb)
I20260709 13:20:50.860209 12358 leader_election.cc:290] T 95a75bfe094d4bdc963aba3f08dfcd25 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:50.907011  6872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab432e62819d499eaaf3dd55481dd930" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:50.856973 12367 leader_election.cc:290] T 427c124d773f483294511e80fe340075 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:20:50.904808  6801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d33d5ee8ef6f415593d8df52063161ad" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
W20260709 13:20:50.885506 12553 log.cc:927] Time spent T 7c37d41cd9164c15a6826ca62a851a69 P cd75a17ab2604397adab03bb8b5fd75c: Append to log took a long time: real 0.059s	user 0.000s	sys 0.002s
W20260709 13:20:50.885789 12559 log.cc:927] Time spent T fe20b4b48823486ca3b9c648db6ce8aa P cd75a17ab2604397adab03bb8b5fd75c: Append to log took a long time: real 0.198s	user 0.001s	sys 0.001s
I20260709 13:20:50.858282 12503 raft_consensus.cc:697] T f58dc08b12a2494bb9a1372837970ca2 P b7ab4784c7344b939bc36f639286f377 [term 18 LEADER]: Becoming Leader. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
I20260709 13:20:50.858436 12238 leader_election.cc:290] T b56bf91d90824c959e21e0cee5ba1816 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 16 election: Requested vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:50.934216  6844 leader_election.cc:304] T 9b3759de40694069b13c0f8bd40e5709 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:20:50.857610 12485 raft_consensus.cc:493] T 17587d6730594da4a56fa13a353232a1 P b7ab4784c7344b939bc36f639286f377 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 7ba59cc884714e8aa5f3f0ecaed84cbb)
I20260709 13:20:50.894236 12499 raft_consensus.cc:493] T a3022224cc81473690653a83d4e99470 P b7ab4784c7344b939bc36f639286f377 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:50.865124 12555 raft_consensus.cc:2749] T 3d65025eea89441290d85dd053810e31 P b7ab4784c7344b939bc36f639286f377 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:20:50.929129  6802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b3759de40694069b13c0f8bd40e5709" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:50.865633 12334 raft_consensus.cc:493] T 7887766dc6784fcaa42b35c05fea7a99 P cd75a17ab2604397adab03bb8b5fd75c [term 16 FOLLOWER]: Starting pre-election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:20:50.862614 12517 consensus_queue.cc:1059] T 8c7f33e544204fbaac4078e3e83bbf4e P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.071s
I20260709 13:20:50.928289  6798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "853ac0a8cbd64ce99457f170216d4d0f" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:50.946044  6802 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "dbdf895bba214ff68685a24fd17dfb5d"
dest_uuid: "b7ab4784c7344b939bc36f639286f377"
mode: GRACEFUL
new_leader_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
 from {username='slave'} at 127.0.0.1:38240
I20260709 13:20:50.934859  6801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1704639a875409b9959353527b3fd68" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:20:50.947104  6802 raft_consensus.cc:606] T dbdf895bba214ff68685a24fd17dfb5d P b7ab4784c7344b939bc36f639286f377 [term 14 LEADER]: Received request to transfer leadership to TS cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:20:50.927305  6872 raft_consensus.cc:2468] T ab432e62819d499eaaf3dd55481dd930 P cd75a17ab2604397adab03bb8b5fd75c [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 17.
I20260709 13:20:50.947896  6801 raft_consensus.cc:2393] T a1704639a875409b9959353527b3fd68 P b7ab4784c7344b939bc36f639286f377 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate ccd8a4c3bfe3413cb2ae219b09aea832 in current term 17: Already voted for candidate b7ab4784c7344b939bc36f639286f377 in this term.
I20260709 13:20:50.907441 12342 raft_consensus.cc:493] T 20f6842e26174571996b8dea4151d4be P b7ab4784c7344b939bc36f639286f377 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:20:50.910166 12566 raft_consensus.cc:493] T de3186201e1a40d0b335eeb8b4e256e0 P b7ab4784c7344b939bc36f639286f377 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:20:50.855957 12557 raft_consensus.cc:515] T a1704639a875409b9959353527b3fd68 P cd75a17ab2604397adab03bb8b5fd75c [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:50.938808  6844 leader_election.cc:400] T d33d5ee8ef6f415593d8df52063161ad P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 13 election: Vote denied by peer b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817) with higher term. Message: Invalid argument: T d33d5ee8ef6f415593d8df52063161ad P b7ab4784c7344b939bc36f639286f377 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c for earlier term 13. Current term is 14.
I20260709 13:20:50.953200  6844 leader_election.cc:403] T d33d5ee8ef6f415593d8df52063161ad P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 13 election: Cancelling election due to peer responding with higher term
I20260709 13:20:50.908193 12397 raft_consensus.cc:2749] T 1bf4668eeb70467fb3dc5a0289233b3c P cd75a17ab2604397adab03bb8b5fd75c [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:20:50.948544  6872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b56bf91d90824c959e21e0cee5ba1816" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:20:50.856598 12545 raft_consensus.cc:515] T 7c37d41cd9164c15a6826ca62a851a69 P cd75a17ab2604397adab03bb8b5fd75c [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:50.926369 12543 raft_consensus.cc:493] T f09c2a98de1a4decabd0ff900dd44caa P cd75a17ab2604397adab03bb8b5fd75c [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:50.960588 12529 leader_election.cc:290] T 711ef6523deb4cbe8ef2ba61e1c21c98 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:20:50.899438 12214 consensus_queue.cc:1059] T f03d0dbf16864ca4bc1bb5e4c0334c0f P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: INVALID_TERM, Last received: 15.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.043s
I20260709 13:20:50.955298 12503 consensus_queue.cc:237] T f58dc08b12a2494bb9a1372837970ca2 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:50.930838 12422 raft_consensus.cc:493] T 713b5728a197487c9300b310ab94e5a3 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:20:50.957008  6874 raft_consensus.cc:3060] T a1704639a875409b9959353527b3fd68 P cd75a17ab2604397adab03bb8b5fd75c [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:50.899725 12547 consensus_queue.cc:1059] T be1a92657f494cac8dd227d152f50151 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: INVALID_TERM, Last received: 16.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.046s
I20260709 13:20:50.944360 12548 raft_consensus.cc:2749] T 9b3759de40694069b13c0f8bd40e5709 P cd75a17ab2604397adab03bb8b5fd75c [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:20:50.905230  6880 raft_consensus.cc:3060] T bb3d8792045a4583ae2e965b1350a5b4 P cd75a17ab2604397adab03bb8b5fd75c [term 13 FOLLOWER]: Advancing to term 15
I20260709 13:20:50.962687  6872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "427c124d773f483294511e80fe340075" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:50.910569 12506 raft_consensus.cc:515] T b56bf91d90824c959e21e0cee5ba1816 P b7ab4784c7344b939bc36f639286f377 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:50.930260 12352 raft_consensus.cc:515] T 7ba5dac66ab5497e9e336f2a3c28cda5 P b7ab4784c7344b939bc36f639286f377 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:20:50.953341 12334 raft_consensus.cc:515] T 7887766dc6784fcaa42b35c05fea7a99 P cd75a17ab2604397adab03bb8b5fd75c [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:50.959129 12566 raft_consensus.cc:515] T de3186201e1a40d0b335eeb8b4e256e0 P b7ab4784c7344b939bc36f639286f377 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:50.970597 12557 leader_election.cc:290] T a1704639a875409b9959353527b3fd68 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 16 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:20:50.958035 12342 raft_consensus.cc:515] T 20f6842e26174571996b8dea4151d4be P b7ab4784c7344b939bc36f639286f377 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:50.972529  6872 raft_consensus.cc:2468] T 427c124d773f483294511e80fe340075 P cd75a17ab2604397adab03bb8b5fd75c [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 14.
I20260709 13:20:50.944965 12485 raft_consensus.cc:515] T 17587d6730594da4a56fa13a353232a1 P b7ab4784c7344b939bc36f639286f377 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
W20260709 13:20:50.962859 12370 consensus_meta.cc:287] T 7c44c4849aa54f2b94d1f1bef9ed546f P ccd8a4c3bfe3413cb2ae219b09aea832: Time spent flushing consensus metadata: real 1.292s	user 0.005s	sys 0.009s
I20260709 13:20:50.975152  6802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c7f33e544204fbaac4078e3e83bbf4e" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:50.961256 12529 raft_consensus.cc:2749] T d33d5ee8ef6f415593d8df52063161ad P cd75a17ab2604397adab03bb8b5fd75c [term 14 FOLLOWER]: Leader election lost for term 13. Reason: Vote denied by peer b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817) with higher term. Message: Invalid argument: T d33d5ee8ef6f415593d8df52063161ad P b7ab4784c7344b939bc36f639286f377 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c for earlier term 13. Current term is 14.
W20260709 13:20:50.978876  7468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 174913us
I20260709 13:20:50.972415 12562 leader_election.cc:290] T a3022224cc81473690653a83d4e99470 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:20:50.982296  6801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3411566abe2d4c9bb4b2adfdd05e6f17" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:20:50.961047 12543 raft_consensus.cc:515] T f09c2a98de1a4decabd0ff900dd44caa P cd75a17ab2604397adab03bb8b5fd75c [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:50.964279 12238 raft_consensus.cc:3055] T 8c7f33e544204fbaac4078e3e83bbf4e P ccd8a4c3bfe3413cb2ae219b09aea832 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:20:50.965382 12278 raft_consensus.cc:493] T 30e88460611e47b2ba16a46a30b5f416 P b7ab4784c7344b939bc36f639286f377 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
W20260709 13:20:50.976197 12492 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.621s	user 0.013s	sys 0.023s
I20260709 13:20:50.968945 12563 leader_election.cc:290] T f03d0dbf16864ca4bc1bb5e4c0334c0f P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:20:50.966828 12555 raft_consensus.cc:493] T 3411566abe2d4c9bb4b2adfdd05e6f17 P b7ab4784c7344b939bc36f639286f377 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:20:50.945686 12499 raft_consensus.cc:515] T a3022224cc81473690653a83d4e99470 P b7ab4784c7344b939bc36f639286f377 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:50.968724 12556 raft_consensus.cc:493] T 427c124d773f483294511e80fe340075 P b7ab4784c7344b939bc36f639286f377 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 7ba59cc884714e8aa5f3f0ecaed84cbb)
I20260709 13:20:50.977560  6770 leader_election.cc:304] T 7887766dc6784fcaa42b35c05fea7a99 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:20:50.999060  6874 raft_consensus.cc:2468] T a1704639a875409b9959353527b3fd68 P cd75a17ab2604397adab03bb8b5fd75c [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 17.
W20260709 13:20:51.007699  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 69123.2us
I20260709 13:20:50.980177 12353 raft_consensus.cc:493] T 07a92dd554674067a83a9cb68c4773f2 P b7ab4784c7344b939bc36f639286f377 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:20:51.005256  7468 leader_election.cc:304] T fe20b4b48823486ca3b9c648db6ce8aa P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
W20260709 13:20:51.041016 12492 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.689s	user 0.013s	sys 0.023s
I20260709 13:20:51.016599  6802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e31b9971c15848dea59d4d4130141d9e" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:50.981262 11937 raft_consensus.cc:493] T c4db81d9d329422bb3b4160ca4ac2d1d P cd75a17ab2604397adab03bb8b5fd75c [term 15 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:20:50.987579 12536 leader_election.cc:290] T e31b9971c15848dea59d4d4130141d9e P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:50.978430 12422 raft_consensus.cc:515] T 713b5728a197487c9300b310ab94e5a3 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:50.993521 12561 raft_consensus.cc:493] T 4b8cacb381b746da8d0049b0a83b41dd P cd75a17ab2604397adab03bb8b5fd75c [term 16 FOLLOWER]: Starting pre-election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:20:51.088058 12417 raft_consensus.cc:2749] T 7ba5dac66ab5497e9e336f2a3c28cda5 P cd75a17ab2604397adab03bb8b5fd75c [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:20:51.018740 12564 log.cc:927] Time spent T d33d5ee8ef6f415593d8df52063161ad P b7ab4784c7344b939bc36f639286f377: Append to log took a long time: real 0.051s	user 0.000s	sys 0.001s
W20260709 13:20:51.024513  6695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 133446us
I20260709 13:20:51.110932  6881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09c2a98de1a4decabd0ff900dd44caa" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:20:51.111618  6881 raft_consensus.cc:3060] T f09c2a98de1a4decabd0ff900dd44caa P cd75a17ab2604397adab03bb8b5fd75c [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:20:51.112362  6695 leader_election.cc:304] T 711ef6523deb4cbe8ef2ba61e1c21c98 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
I20260709 13:20:51.028069  6731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6869f07b5a4885a0b99fbe60c3b175" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:20:51.030890  6803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a734b5ab7834e05a8c422208acc58b1" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 17 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:20:51.114769  6803 raft_consensus.cc:2393] T 7a734b5ab7834e05a8c422208acc58b1 P b7ab4784c7344b939bc36f639286f377 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c in current term 17: Already voted for candidate b7ab4784c7344b939bc36f639286f377 in this term.
I20260709 13:20:51.031097 12545 leader_election.cc:290] T 7c37d41cd9164c15a6826ca62a851a69 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 16 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:20:51.036636  6728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8292e16e5654be6bc408560cf256aaa" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:51.037431 12352 leader_election.cc:290] T 7ba5dac66ab5497e9e336f2a3c28cda5 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
W20260709 13:20:51.082705  6770 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 105288us
W20260709 13:20:51.084124  7468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 78986.3us
I20260709 13:20:51.017338  6801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8292e16e5654be6bc408560cf256aaa" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:51.085126  6844 leader_election.cc:304] T 44bde925b2e541b69890d70715b85176 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:20:51.084156  6730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a734b5ab7834e05a8c422208acc58b1" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 17 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:20:51.022114 12238 raft_consensus.cc:740] T 8c7f33e544204fbaac4078e3e83bbf4e P ccd8a4c3bfe3413cb2ae219b09aea832 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
I20260709 13:20:51.082508 12396 raft_consensus.cc:493] T f5be3a11b23d4ea9b08300a2789821c7 P b7ab4784c7344b939bc36f639286f377 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:20:51.097571 12558 raft_consensus.cc:2749] T 4f00a2e87e56452083b759f60d461ee3 P cd75a17ab2604397adab03bb8b5fd75c [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:20:51.138350 12396 raft_consensus.cc:515] T f5be3a11b23d4ea9b08300a2789821c7 P b7ab4784c7344b939bc36f639286f377 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:51.085985 12353 raft_consensus.cc:515] T 07a92dd554674067a83a9cb68c4773f2 P b7ab4784c7344b939bc36f639286f377 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
W20260709 13:20:51.099305 12570 log.cc:927] Time spent T 8c7f33e544204fbaac4078e3e83bbf4e P b7ab4784c7344b939bc36f639286f377: Append to log took a long time: real 0.075s	user 0.000s	sys 0.000s
I20260709 13:20:51.104295 12499 leader_election.cc:290] T a3022224cc81473690653a83d4e99470 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:51.021086 12567 consensus_queue.cc:1048] T d8cee0accdb8499c86d4414b72565a38 P 7ba59cc884714e8aa5f3f0ecaed84cbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.077s
I20260709 13:20:51.105142 12485 leader_election.cc:290] T 17587d6730594da4a56fa13a353232a1 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:20:51.105630 12506 leader_election.cc:290] T b56bf91d90824c959e21e0cee5ba1816 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 16 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:51.086838 12555 raft_consensus.cc:515] T 3411566abe2d4c9bb4b2adfdd05e6f17 P b7ab4784c7344b939bc36f639286f377 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:51.106561 12334 leader_election.cc:290] T 7887766dc6784fcaa42b35c05fea7a99 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:20:51.107765 12342 leader_election.cc:290] T 20f6842e26174571996b8dea4151d4be P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:51.108227 12481 raft_consensus.cc:2749] T fe20b4b48823486ca3b9c648db6ce8aa P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:20:51.113798 12422 leader_election.cc:290] T 713b5728a197487c9300b310ab94e5a3 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:51.115125  6731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a75bfe094d4bdc963aba3f08dfcd25" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:51.084597 12358 raft_consensus.cc:2749] T 7887766dc6784fcaa42b35c05fea7a99 P b7ab4784c7344b939bc36f639286f377 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:20:51.122092  6881 raft_consensus.cc:2468] T f09c2a98de1a4decabd0ff900dd44caa P cd75a17ab2604397adab03bb8b5fd75c [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 18.
I20260709 13:20:51.171609  6731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b56bf91d90824c959e21e0cee5ba1816" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:20:51.172911  6731 raft_consensus.cc:2393] T b56bf91d90824c959e21e0cee5ba1816 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate b7ab4784c7344b939bc36f639286f377 in current term 16: Already voted for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in this term.
I20260709 13:20:51.134814  6730 raft_consensus.cc:3060] T 7a734b5ab7834e05a8c422208acc58b1 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:20:51.135888  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 50865us
I20260709 13:20:51.135946  6880 raft_consensus.cc:2468] T bb3d8792045a4583ae2e965b1350a5b4 P cd75a17ab2604397adab03bb8b5fd75c [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 15.
I20260709 13:20:51.092725 12543 leader_election.cc:290] T f09c2a98de1a4decabd0ff900dd44caa P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:20:51.150705 12497 raft_consensus.cc:493] T c4db81d9d329422bb3b4160ca4ac2d1d P ccd8a4c3bfe3413cb2ae219b09aea832 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:20:51.107797 12566 leader_election.cc:290] T de3186201e1a40d0b335eeb8b4e256e0 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
W20260709 13:20:51.146790 12522 log.cc:927] Time spent T 22ccee1b570c4ad3a57bd7aec085b1b4 P ccd8a4c3bfe3413cb2ae219b09aea832: Append to log took a long time: real 1.354s	user 0.004s	sys 0.000s
I20260709 13:20:51.126876 12345 raft_consensus.cc:493] T bb3d8792045a4583ae2e965b1350a5b4 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:51.167922 12484 raft_consensus.cc:493] T d8cee0accdb8499c86d4414b72565a38 P b7ab4784c7344b939bc36f639286f377 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 7ba59cc884714e8aa5f3f0ecaed84cbb)
I20260709 13:20:51.126567 12214 raft_consensus.cc:2804] T 711ef6523deb4cbe8ef2ba61e1c21c98 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:20:51.126160 12275 raft_consensus.cc:493] T 3a485a995abc4807b6e511e45419f737 P b7ab4784c7344b939bc36f639286f377 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:20:51.149124 12352 raft_consensus.cc:493] T 9e326172347f45e99a0d482b5d8ef768 P b7ab4784c7344b939bc36f639286f377 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:51.208630 12352 raft_consensus.cc:515] T 9e326172347f45e99a0d482b5d8ef768 P b7ab4784c7344b939bc36f639286f377 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:51.211520 12352 leader_election.cc:290] T 9e326172347f45e99a0d482b5d8ef768 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:51.217551 12568 raft_consensus.cc:493] T 1bf4668eeb70467fb3dc5a0289233b3c P b7ab4784c7344b939bc36f639286f377 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:20:51.218545 12568 raft_consensus.cc:515] T 1bf4668eeb70467fb3dc5a0289233b3c P b7ab4784c7344b939bc36f639286f377 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:51.148452 12563 raft_consensus.cc:2804] T 44bde925b2e541b69890d70715b85176 P cd75a17ab2604397adab03bb8b5fd75c [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:20:51.222450 12563 raft_consensus.cc:493] T 44bde925b2e541b69890d70715b85176 P cd75a17ab2604397adab03bb8b5fd75c [term 15 FOLLOWER]: Starting leader election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:20:51.222934 12563 raft_consensus.cc:3060] T 44bde925b2e541b69890d70715b85176 P cd75a17ab2604397adab03bb8b5fd75c [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:51.096006 11937 raft_consensus.cc:515] T c4db81d9d329422bb3b4160ca4ac2d1d P cd75a17ab2604397adab03bb8b5fd75c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:51.174837  6731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3022224cc81473690653a83d4e99470" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:51.224576  6731 raft_consensus.cc:2468] T a3022224cc81473690653a83d4e99470 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 17.
I20260709 13:20:51.225929  6731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17587d6730594da4a56fa13a353232a1" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:51.226298 11937 leader_election.cc:290] T c4db81d9d329422bb3b4160ca4ac2d1d P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:20:51.226620  6731 raft_consensus.cc:2468] T 17587d6730594da4a56fa13a353232a1 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 20.
I20260709 13:20:51.227643  6731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de3186201e1a40d0b335eeb8b4e256e0" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:51.177366  6881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3022224cc81473690653a83d4e99470" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:20:51.128961 12561 raft_consensus.cc:515] T 4b8cacb381b746da8d0049b0a83b41dd P cd75a17ab2604397adab03bb8b5fd75c [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:20:51.228492  6881 raft_consensus.cc:2393] T a3022224cc81473690653a83d4e99470 P cd75a17ab2604397adab03bb8b5fd75c [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate ccd8a4c3bfe3413cb2ae219b09aea832 in current term 17: Already voted for candidate cd75a17ab2604397adab03bb8b5fd75c in this term.
I20260709 13:20:51.208520 12275 raft_consensus.cc:515] T 3a485a995abc4807b6e511e45419f737 P b7ab4784c7344b939bc36f639286f377 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:51.229527  6881 raft_consensus.cc:1240] T 95a75bfe094d4bdc963aba3f08dfcd25 P cd75a17ab2604397adab03bb8b5fd75c [term 14 FOLLOWER]: Rejecting Update request from peer ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 13. Current term is 14. Ops: []
I20260709 13:20:51.231158 12275 leader_election.cc:290] T 3a485a995abc4807b6e511e45419f737 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:51.041682 12278 raft_consensus.cc:515] T 30e88460611e47b2ba16a46a30b5f416 P b7ab4784c7344b939bc36f639286f377 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:51.178722  6844 leader_election.cc:304] T 3a485a995abc4807b6e511e45419f737 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: ccd8a4c3bfe3413cb2ae219b09aea832
W20260709 13:20:51.235918  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 57342.8us
I20260709 13:20:51.236807  6844 leader_election.cc:304] T 2c240553ce044eedb41541d72b9475d7 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:20:51.237632 12396 leader_election.cc:290] T f5be3a11b23d4ea9b08300a2789821c7 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:51.159551 12499 raft_consensus.cc:493] T 1528ab62b6fe4e3099d08f141afee116 P b7ab4784c7344b939bc36f639286f377 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:20:51.265285 12499 raft_consensus.cc:515] T 1528ab62b6fe4e3099d08f141afee116 P b7ab4784c7344b939bc36f639286f377 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:20:51.265867  6806 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50550 (request call id 652) took 2114 ms. Trace:
I20260709 13:20:51.266019 12535 raft_consensus.cc:3055] T be1a92657f494cac8dd227d152f50151 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:20:51.267556 12499 leader_election.cc:290] T 1528ab62b6fe4e3099d08f141afee116 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:20:51.094022 12556 raft_consensus.cc:515] T 427c124d773f483294511e80fe340075 P b7ab4784c7344b939bc36f639286f377 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } attrs { replace: true } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:20:51.207088 12345 raft_consensus.cc:515] T bb3d8792045a4583ae2e965b1350a5b4 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:20:51.270138 12345 leader_election.cc:290] T bb3d8792045a4583ae2e965b1350a5b4 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:51.270258 12556 leader_election.cc:290] T 427c124d773f483294511e80fe340075 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:20:51.181434  6728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20f6842e26174571996b8dea4151d4be" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:51.253371 12484 raft_consensus.cc:515] T d8cee0accdb8499c86d4414b72565a38 P b7ab4784c7344b939bc36f639286f377 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:20:51.242584  6729 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50004 (request call id 2620) took 1878 ms. Trace:
I20260709 13:20:51.266853 12535 raft_consensus.cc:740] T be1a92657f494cac8dd227d152f50151 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
I20260709 13:20:51.273794 12535 consensus_queue.cc:260] T be1a92657f494cac8dd227d152f50151 P ccd8a4c3bfe3413cb2ae219b09aea832 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:20:51.274590 12484 leader_election.cc:290] T d8cee0accdb8499c86d4414b72565a38 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:20:51.243116 12246 raft_consensus.cc:493] T 404190ce4ce94cecbfcb6ea9d1dd8626 P b7ab4784c7344b939bc36f639286f377 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:20:51.277540 12246 raft_consensus.cc:515] T 404190ce4ce94cecbfcb6ea9d1dd8626 P b7ab4784c7344b939bc36f639286f377 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:20:51.279026  6876 leader_election.cc:290] T 34f36d59d88f40fe8a2805e604fc6c0a P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 15 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:20:51.279587  6876 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RunLeaderElection from 127.0.0.1:53406 (request call id 2657) took 1619 ms. Trace:
I20260709 13:20:51.245203 12278 leader_election.cc:290] T 30e88460611e47b2ba16a46a30b5f416 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:51.243780 12340 raft_consensus.cc:493] T f09c2a98de1a4decabd0ff900dd44caa P b7ab4784c7344b939bc36f639286f377 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:20:51.245726 12578 log.cc:927] Time spent T 7ba5dac66ab5497e9e336f2a3c28cda5 P cd75a17ab2604397adab03bb8b5fd75c: Append to log took a long time: real 0.060s	user 0.001s	sys 0.000s
I20260709 13:20:51.247810  6801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb7fa124c3bf4ef9ab65a407cb008441" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:20:51.300263  6801 raft_consensus.cc:3060] T bb7fa124c3bf4ef9ab65a407cb008441 P b7ab4784c7344b939bc36f639286f377 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:51.193075 12238 consensus_queue.cc:260] T 8c7f33e544204fbaac4078e3e83bbf4e P ccd8a4c3bfe3413cb2ae219b09aea832 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:51.254686  6804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be1a92657f494cac8dd227d152f50151" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:51.251883 11937 raft_consensus.cc:2749] T 2c240553ce044eedb41541d72b9475d7 P cd75a17ab2604397adab03bb8b5fd75c [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:20:51.239933 12531 log.cc:927] Time spent T 9b3759de40694069b13c0f8bd40e5709 P ccd8a4c3bfe3413cb2ae219b09aea832: Append to log took a long time: real 0.061s	user 0.001s	sys 0.000s
I20260709 13:20:51.256806 12353 leader_election.cc:290] T 07a92dd554674067a83a9cb68c4773f2 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
W20260709 13:20:51.258244 12432 consensus_meta.cc:287] T 95a75bfe094d4bdc963aba3f08dfcd25 P 7ba59cc884714e8aa5f3f0ecaed84cbb: Time spent flushing consensus metadata: real 0.852s	user 0.008s	sys 0.008s
I20260709 13:20:51.258738 12561 leader_election.cc:290] T 4b8cacb381b746da8d0049b0a83b41dd P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:20:51.261014 12555 leader_election.cc:290] T 3411566abe2d4c9bb4b2adfdd05e6f17 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:51.261876 12580 raft_consensus.cc:493] T 3d65025eea89441290d85dd053810e31 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:51.241017  6844 leader_election.cc:304] T e77e330a82df4b43a745d57a68f6f057 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:20:51.314184 12580 raft_consensus.cc:515] T 3d65025eea89441290d85dd053810e31 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
W20260709 13:20:51.314851  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 73919.5us
I20260709 13:20:51.315368 12335 raft_consensus.cc:2804] T e77e330a82df4b43a745d57a68f6f057 P cd75a17ab2604397adab03bb8b5fd75c [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:20:51.266305  6806 rpcz_store.cc:276] 0709 13:20:49.151421 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:49.299715 (+148294us) service_pool.cc:224] Handling call
0709 13:20:49.300192 (+   477us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:49.380508 (+ 80316us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:49.380553 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:20:49.393647 (+ 13094us) log.cc:844] Serialized 26 byte log entry
0709 13:20:51.039001 (+1645354us) spinlock_profiling.cc:243] Waited 2.32 ms on lock 0x7b18000a6f60. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc15785de1 00007fcc157925b1 00007fcc0c89fe07 00007fcc156faab9 00007fcc0c8bc69b 00007fcc0c8ba93f 00007fcc0c8bcc02 00007fcc0f54420b 00007fcc0f549d23 00007fcc0f54a0d1 00007fcc0f965a0f
0709 13:20:51.165126 (+126125us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:20:51.165194 (+    68us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:51.165327 (+   133us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:51.265531 (+100204us) raft_consensus.cc:1685] finished
0709 13:20:51.265555 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:51.265803 (+   248us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":238077,"raft.queue_time_us":80009,"raft.run_cpu_time_us":93,"raft.run_wall_time_us":9771,"spinlock_wait_cycles":5347200,"thread_start_us":125831,"threads_started":1,"wal-append.queue_time_us":1812493}
I20260709 13:20:51.315933 12335 raft_consensus.cc:697] T e77e330a82df4b43a745d57a68f6f057 P cd75a17ab2604397adab03bb8b5fd75c [term 17 LEADER]: Becoming Leader. State: Replica: cd75a17ab2604397adab03bb8b5fd75c, State: Running, Role: LEADER
I20260709 13:20:51.201563 12214 raft_consensus.cc:493] T 711ef6523deb4cbe8ef2ba61e1c21c98 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:51.316725 12214 raft_consensus.cc:3060] T 711ef6523deb4cbe8ef2ba61e1c21c98 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:20:51.317121 12580 leader_election.cc:290] T 3d65025eea89441290d85dd053810e31 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:51.316968 12335 consensus_queue.cc:237] T e77e330a82df4b43a745d57a68f6f057 P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } }
I20260709 13:20:51.243196  6807 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:32976 (request call id 3363) took 1899 ms. Trace:
I20260709 13:20:51.320618  6807 rpcz_store.cc:276] 0709 13:20:49.343667 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:49.639982 (+296315us) service_pool.cc:224] Handling call
0709 13:20:49.640412 (+   430us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:50.511258 (+870846us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:51.242902 (+731644us) spinlock_profiling.cc:243] Waited 870 ms on lock 0x7b54001f6b54. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f9aae01 00007fcc0f9a983e 00007fcc1496e419 00007fcc0dee5bd4 00007fcc0dee5b62 00007fcc0dee5a91 00007fcc0dee5a0c 00007fcc0dee4cc2 00007fcc0dce548c 00007fcc0dce48c6
0709 13:20:51.243101 (+   199us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2000524160}
I20260709 13:20:51.271857  6729 rpcz_store.cc:276] 0709 13:20:49.364575 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:49.368642 (+  4067us) service_pool.cc:224] Handling call
0709 13:20:49.369010 (+   368us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:49.369365 (+   355us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:49.369411 (+    46us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:20:49.369925 (+   514us) log.cc:844] Serialized 26 byte log entry
0709 13:20:49.553239 (+183314us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:20:49.553313 (+    74us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:49.553438 (+   125us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:51.116618 (+1563180us) spinlock_profiling.cc:243] Waited 3.13 ms on lock 0x7b4400022b4c. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0c745db1 00007fcc0c7e3c85 00007fcc0c7e46a2 00007fcc0f5561db 00007fcc0f551aaf 00007fcc0f54586e 00007fcc0f544bb6 00007fcc0f5447d8 00007fcc0f54e221 00007fcc0f54e1d9 00007fcc0f54e169
0709 13:20:51.242210 (+125592us) raft_consensus.cc:1685] finished
0709 13:20:51.242241 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:51.242509 (+   268us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":37815,"raft.queue_time_us":2005,"raft.run_cpu_time_us":153,"raft.run_wall_time_us":14505,"spinlock_wait_cycles":8295936,"thread_start_us":114847,"threads_started":1,"wal-append.queue_time_us":226919}
I20260709 13:20:51.275465 12551 raft_consensus.cc:493] T b3f13b31a1f84f0d89d007eadd57924c P ccd8a4c3bfe3413cb2ae219b09aea832 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 7ba59cc884714e8aa5f3f0ecaed84cbb)
I20260709 13:20:51.322758 12551 raft_consensus.cc:515] T b3f13b31a1f84f0d89d007eadd57924c P ccd8a4c3bfe3413cb2ae219b09aea832 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:20:51.325537 12551 leader_election.cc:290] T b3f13b31a1f84f0d89d007eadd57924c P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:20:51.276757 12517 raft_consensus.cc:3055] T f03d0dbf16864ca4bc1bb5e4c0334c0f P ccd8a4c3bfe3413cb2ae219b09aea832 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:20:51.326340 12517 raft_consensus.cc:740] T f03d0dbf16864ca4bc1bb5e4c0334c0f P ccd8a4c3bfe3413cb2ae219b09aea832 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
I20260709 13:20:51.327409 12517 consensus_queue.cc:260] T f03d0dbf16864ca4bc1bb5e4c0334c0f P ccd8a4c3bfe3413cb2ae219b09aea832 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:51.301311 12340 raft_consensus.cc:515] T f09c2a98de1a4decabd0ff900dd44caa P b7ab4784c7344b939bc36f639286f377 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:51.328727 12517 raft_consensus.cc:3060] T f03d0dbf16864ca4bc1bb5e4c0334c0f P ccd8a4c3bfe3413cb2ae219b09aea832 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:51.330344 12340 leader_election.cc:290] T f09c2a98de1a4decabd0ff900dd44caa P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:51.315755  6844 leader_election.cc:304] T 853ac0a8cbd64ce99457f170216d4d0f P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:20:51.241644 12527 raft_consensus.cc:2804] T 3a485a995abc4807b6e511e45419f737 P cd75a17ab2604397adab03bb8b5fd75c [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:20:51.331938 12561 raft_consensus.cc:2749] T 853ac0a8cbd64ce99457f170216d4d0f P cd75a17ab2604397adab03bb8b5fd75c [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:20:51.279971  6876 rpcz_store.cc:276] 0709 13:20:49.660005 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:49.849043 (+189038us) service_pool.cc:224] Handling call
0709 13:20:51.277754 (+1428711us) spinlock_profiling.cc:243] Waited 84.7 ms on lock 0x7b540005b4d4. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f9a1a3d 00007fcc14971cd0 00007fcc0def6254 00007fcc0def61e2 00007fcc0def6111 00007fcc0def608c 00007fcc0def5342 00007fcc0dce548c 00007fcc0dce48c6 00007fcc0dce426f
0709 13:20:51.279479 (+  1725us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":194745600}
I20260709 13:20:51.311578  7494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b8cacb381b746da8d0049b0a83b41dd" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:20:51.307077 12547 raft_consensus.cc:493] T f58dc08b12a2494bb9a1372837970ca2 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:51.337000  7494 raft_consensus.cc:2393] T 4b8cacb381b746da8d0049b0a83b41dd P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c in current term 17: Already voted for candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in this term.
I20260709 13:20:51.299345 12422 raft_consensus.cc:493] T 4275cf08e63345f993bce8664eada830 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:20:51.339161 12422 raft_consensus.cc:515] T 4275cf08e63345f993bce8664eada830 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:51.281507  6727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b8cacb381b746da8d0049b0a83b41dd" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:20:51.341064 12568 leader_election.cc:290] T 1bf4668eeb70467fb3dc5a0289233b3c P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:51.341323  6844 leader_election.cc:304] T 9e326172347f45e99a0d482b5d8ef768 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:20:51.341732  6727 raft_consensus.cc:1240] T b56bf91d90824c959e21e0cee5ba1816 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 16 FOLLOWER]: Rejecting Update request from peer cd75a17ab2604397adab03bb8b5fd75c for earlier term 15. Current term is 16. Ops: [15.10-15.10]
I20260709 13:20:51.342281 11937 consensus_queue.cc:1059] T f58dc08b12a2494bb9a1372837970ca2 P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:20:51.343030 12561 raft_consensus.cc:2804] T 9e326172347f45e99a0d482b5d8ef768 P cd75a17ab2604397adab03bb8b5fd75c [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:20:51.343266 11937 raft_consensus.cc:3055] T f58dc08b12a2494bb9a1372837970ca2 P cd75a17ab2604397adab03bb8b5fd75c [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:20:51.343590 12561 raft_consensus.cc:697] T 9e326172347f45e99a0d482b5d8ef768 P cd75a17ab2604397adab03bb8b5fd75c [term 13 LEADER]: Becoming Leader. State: Replica: cd75a17ab2604397adab03bb8b5fd75c, State: Running, Role: LEADER
I20260709 13:20:51.279757 12246 leader_election.cc:290] T 404190ce4ce94cecbfcb6ea9d1dd8626 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:20:50.166668  6799 rpcz_store.cc:276] 0709 13:20:48.976064 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:49.236573 (+260509us) service_pool.cc:224] Handling call
0709 13:20:49.236940 (+   367us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:49.381177 (+144237us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:49.381226 (+    49us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:20:49.393404 (+ 12178us) log.cc:844] Serialized 26 byte log entry
0709 13:20:49.769733 (+376329us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:20:50.153285 (+383552us) log.cc:844] Serialized 14 byte log entry
0709 13:20:50.157768 (+  4483us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:50.157881 (+   113us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:50.157939 (+    58us) raft_consensus.cc:1685] finished
0709 13:20:50.157956 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:50.158106 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":301502,"prepare.queue_time_us":290521,"prepare.run_cpu_time_us":28,"prepare.run_wall_time_us":28,"raft.queue_time_us":122479,"raft.run_cpu_time_us":349,"raft.run_wall_time_us":13728,"thread_start_us":554526,"threads_started":2,"wal-append.queue_time_us":391788}
I20260709 13:20:51.344751 12561 consensus_queue.cc:237] T 9e326172347f45e99a0d482b5d8ef768 P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:51.337574 12547 raft_consensus.cc:515] T f58dc08b12a2494bb9a1372837970ca2 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:51.313830 12238 raft_consensus.cc:3060] T 8c7f33e544204fbaac4078e3e83bbf4e P ccd8a4c3bfe3413cb2ae219b09aea832 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:51.295171  6728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be1a92657f494cac8dd227d152f50151" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:51.296998  6697 leader_election.cc:304] T e77e330a82df4b43a745d57a68f6f057 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:20:51.342496  6844 leader_election.cc:304] T 20f6842e26174571996b8dea4151d4be P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:20:51.343626 11937 raft_consensus.cc:740] T f58dc08b12a2494bb9a1372837970ca2 P cd75a17ab2604397adab03bb8b5fd75c [term 17 LEADER]: Becoming Follower/Learner. State: Replica: cd75a17ab2604397adab03bb8b5fd75c, State: Running, Role: LEADER
I20260709 13:20:51.194639 12497 raft_consensus.cc:515] T c4db81d9d329422bb3b4160ca4ac2d1d P ccd8a4c3bfe3413cb2ae219b09aea832 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:51.302259 12535 raft_consensus.cc:3060] T be1a92657f494cac8dd227d152f50151 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:51.347033  6725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a734b5ab7834e05a8c422208acc58b1" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 17 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:20:51.307915  6804 raft_consensus.cc:2393] T be1a92657f494cac8dd227d152f50151 P b7ab4784c7344b939bc36f639286f377 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in current term 17: Already voted for candidate b7ab4784c7344b939bc36f639286f377 in this term.
W20260709 13:20:51.354406  6697 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 57558.9us
I20260709 13:20:51.331596 12432 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.StartTabletCopy from 127.0.0.1:50742 (request call id 513) took 4585 ms. Trace:
I20260709 13:20:51.347903 12527 raft_consensus.cc:493] T 3a485a995abc4807b6e511e45419f737 P cd75a17ab2604397adab03bb8b5fd75c [term 15 FOLLOWER]: Starting leader election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:20:51.356184 12367 consensus_queue.cc:1059] T bd6869f07b5a4885a0b99fbe60c3b175 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: INVALID_TERM, Last received: 16.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:20:51.353822 12490 raft_consensus.cc:493] T 3fa34c08b205435dba97346991aa1f92 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:51.358404 12551 raft_consensus.cc:3060] T e77e330a82df4b43a745d57a68f6f057 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:51.360767 11634 leader_election.cc:290] T 9e326172347f45e99a0d482b5d8ef768 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:51.361529 12484 raft_consensus.cc:493] T 44bde925b2e541b69890d70715b85176 P b7ab4784c7344b939bc36f639286f377 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:20:51.364920  6877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ba5dac66ab5497e9e336f2a3c28cda5" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:51.365330  6876 raft_consensus.cc:1240] T 34f36d59d88f40fe8a2805e604fc6c0a P cd75a17ab2604397adab03bb8b5fd75c [term 15 FOLLOWER]: Rejecting Update request from peer b7ab4784c7344b939bc36f639286f377 for earlier term 14. Current term is 15. Ops: []
I20260709 13:20:51.395524  7466 leader_election.cc:304] T 1528ab62b6fe4e3099d08f141afee116 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:20:51.352469 12334 raft_consensus.cc:2749] T 20f6842e26174571996b8dea4151d4be P cd75a17ab2604397adab03bb8b5fd75c [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:20:51.354709  6844 leader_election.cc:304] T f5be3a11b23d4ea9b08300a2789821c7 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:20:51.395812  6876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20f6842e26174571996b8dea4151d4be" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:51.391709  6804 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f09c2a98de1a4decabd0ff900dd44caa"
dest_uuid: "b7ab4784c7344b939bc36f639286f377"
mode: GRACEFUL
new_leader_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
 from {username='slave'} at 127.0.0.1:38240
I20260709 13:20:51.396996  6804 raft_consensus.cc:606] T f09c2a98de1a4decabd0ff900dd44caa P b7ab4784c7344b939bc36f639286f377 [term 17 FOLLOWER]: Received request to transfer leadership to TS cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:20:51.397343  6804 raft_consensus.cc:614] T f09c2a98de1a4decabd0ff900dd44caa P b7ab4784c7344b939bc36f639286f377 [term 17 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:20:51.397718  6844 leader_election.cc:304] T 4275cf08e63345f993bce8664eada830 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:20:51.375392  6881 raft_consensus.cc:1275] T 90d42e216d9741e190bca19a781291fd P cd75a17ab2604397adab03bb8b5fd75c [term 16 FOLLOWER]: Refusing update from remote peer b7ab4784c7344b939bc36f639286f377: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 13:20:51.399115  6844 leader_election.cc:304] T ce4f062dcd314d43a63ca74067cb5ee3 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, b7ab4784c7344b939bc36f639286f377
I20260709 13:20:51.399176  6806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3022224cc81473690653a83d4e99470" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:20:51.376212  6875 raft_consensus.cc:1240] T 7c37d41cd9164c15a6826ca62a851a69 P cd75a17ab2604397adab03bb8b5fd75c [term 16 FOLLOWER]: Rejecting Update request from peer b7ab4784c7344b939bc36f639286f377 for earlier term 15. Current term is 16. Ops: []
I20260709 13:20:51.382400  6770 leader_election.cc:304] T a3022224cc81473690653a83d4e99470 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
I20260709 13:20:51.369470  7500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ba5dac66ab5497e9e336f2a3c28cda5" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:20:51.385424  7501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17587d6730594da4a56fa13a353232a1" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:20:51.398061  6807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4b8bd455d5a47c18a1380839c6e0d61" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 17 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:51.404893  6877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e326172347f45e99a0d482b5d8ef768" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:51.406740  7501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "427c124d773f483294511e80fe340075" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:20:51.408663  6730 raft_consensus.cc:2468] T 7a734b5ab7834e05a8c422208acc58b1 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 17.
I20260709 13:20:51.386831  6772 leader_election.cc:304] T bb7fa124c3bf4ef9ab65a407cb008441 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, b7ab4784c7344b939bc36f639286f377; no voters: cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:20:51.389557  6880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b56bf91d90824c959e21e0cee5ba1816" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:20:51.390975 12367 raft_consensus.cc:3055] T bd6869f07b5a4885a0b99fbe60c3b175 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:20:51.393592  7496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3d8792045a4583ae2e965b1350a5b4" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb"
I20260709 13:20:51.414429  7496 raft_consensus.cc:3060] T bb3d8792045a4583ae2e965b1350a5b4 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:51.394130  6799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e326172347f45e99a0d482b5d8ef768" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:51.366358  6873 raft_consensus.cc:1275] T d33d5ee8ef6f415593d8df52063161ad P cd75a17ab2604397adab03bb8b5fd75c [term 14 FOLLOWER]: Refusing update from remote peer b7ab4784c7344b939bc36f639286f377: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:20:51.400904  6881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3022224cc81473690653a83d4e99470" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:51.416006  6881 raft_consensus.cc:2468] T a3022224cc81473690653a83d4e99470 P cd75a17ab2604397adab03bb8b5fd75c [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 17.
I20260709 13:20:51.416939  6876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5be3a11b23d4ea9b08300a2789821c7" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:51.417670  6881 raft_consensus.cc:1275] T f4b8bd455d5a47c18a1380839c6e0d61 P cd75a17ab2604397adab03bb8b5fd75c [term 16 FOLLOWER]: Refusing update from remote peer b7ab4784c7344b939bc36f639286f377: Log matching property violated. Preceding OpId in replica: term: 14 index: 7. Preceding OpId from leader: term: 16 index: 8. (index mismatch)
W20260709 13:20:51.418862 12592 log.cc:927] Time spent T 34f36d59d88f40fe8a2805e604fc6c0a P ccd8a4c3bfe3413cb2ae219b09aea832: Append to log took a long time: real 0.108s	user 0.001s	sys 0.000s
W20260709 13:20:51.421093  6697 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 61939.2us
I20260709 13:20:51.376880 12527 raft_consensus.cc:3060] T 3a485a995abc4807b6e511e45419f737 P cd75a17ab2604397adab03bb8b5fd75c [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:51.422369  6875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a485a995abc4807b6e511e45419f737" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:51.423437  6799 raft_consensus.cc:2393] T 9e326172347f45e99a0d482b5d8ef768 P b7ab4784c7344b939bc36f639286f377 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ccd8a4c3bfe3413cb2ae219b09aea832 in current term 13: Already voted for candidate cd75a17ab2604397adab03bb8b5fd75c in this term.
I20260709 13:20:51.425648  6802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab432e62819d499eaaf3dd55481dd930" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:51.428640  6731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3022224cc81473690653a83d4e99470" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:51.429507  6731 raft_consensus.cc:2468] T a3022224cc81473690653a83d4e99470 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 17.
I20260709 13:20:51.430606 12581 consensus_queue.cc:1059] T f3f9c2e2bf644115957398fe4c9459db P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:20:51.431533  6732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "711ef6523deb4cbe8ef2ba61e1c21c98" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:51.432457 12396 raft_consensus.cc:493] T b3f13b31a1f84f0d89d007eadd57924c P b7ab4784c7344b939bc36f639286f377 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 7ba59cc884714e8aa5f3f0ecaed84cbb)
I20260709 13:20:51.430606  6731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c37d41cd9164c15a6826ca62a851a69" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:20:51.433280 12544 raft_consensus.cc:3060] T 3fa34c08b205435dba97346991aa1f92 P cd75a17ab2604397adab03bb8b5fd75c [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:20:51.433223 12396 raft_consensus.cc:515] T b3f13b31a1f84f0d89d007eadd57924c P b7ab4784c7344b939bc36f639286f377 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:20:51.434228  6731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4db81d9d329422bb3b4160ca4ac2d1d" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:51.435519  6731 raft_consensus.cc:2468] T c4db81d9d329422bb3b4160ca4ac2d1d P ccd8a4c3bfe3413cb2ae219b09aea832 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 15.
I20260709 13:20:51.410272 12417 raft_consensus.cc:2804] T f5be3a11b23d4ea9b08300a2789821c7 P cd75a17ab2604397adab03bb8b5fd75c [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:20:51.391875 12490 raft_consensus.cc:515] T 3fa34c08b205435dba97346991aa1f92 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:20:51.403594 12397 raft_consensus.cc:2749] T 4275cf08e63345f993bce8664eada830 P cd75a17ab2604397adab03bb8b5fd75c [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:20:51.420755  6730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f03d0dbf16864ca4bc1bb5e4c0334c0f" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
W20260709 13:20:51.419273 12513 thread.cc:641] apply [worker] (thread pool) Time spent creating pthread: real 2.070s	user 0.006s	sys 0.016s
W20260709 13:20:51.445417  6770 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 63123.3us
I20260709 13:20:51.445854  6874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb7fa124c3bf4ef9ab65a407cb008441" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
W20260709 13:20:51.442008  6772 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.68:45071, user_credentials={real_user=slave}} blocked reactor thread for 55250.8us
I20260709 13:20:51.446350  7500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8cee0accdb8499c86d4414b72565a38" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:20:51.448506  6770 leader_election.cc:304] T 17587d6730594da4a56fa13a353232a1 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
I20260709 13:20:51.448776  6772 leader_election.cc:304] T be1a92657f494cac8dd227d152f50151 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:20:51.442493  6877 raft_consensus.cc:1275] T 8c7f33e544204fbaac4078e3e83bbf4e P cd75a17ab2604397adab03bb8b5fd75c [term 14 FOLLOWER]: Refusing update from remote peer b7ab4784c7344b939bc36f639286f377: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:20:51.443002  6880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de3186201e1a40d0b335eeb8b4e256e0" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:51.437072  6731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7887766dc6784fcaa42b35c05fea7a99" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:51.448621  6874 raft_consensus.cc:2393] T bb7fa124c3bf4ef9ab65a407cb008441 P cd75a17ab2604397adab03bb8b5fd75c [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in current term 16: Already voted for candidate cd75a17ab2604397adab03bb8b5fd75c in this term.
I20260709 13:20:51.451152  7503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "427c124d773f483294511e80fe340075" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:20:51.453814  6725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a75bfe094d4bdc963aba3f08dfcd25" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: true dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:20:51.454627  6725 raft_consensus.cc:3055] T 95a75bfe094d4bdc963aba3f08dfcd25 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:20:51.455019  6725 raft_consensus.cc:740] T 95a75bfe094d4bdc963aba3f08dfcd25 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
I20260709 13:20:51.436468 12417 raft_consensus.cc:493] T f5be3a11b23d4ea9b08300a2789821c7 P cd75a17ab2604397adab03bb8b5fd75c [term 14 FOLLOWER]: Starting leader election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:20:51.436529 12422 leader_election.cc:290] T 4275cf08e63345f993bce8664eada830 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:51.456832 12417 raft_consensus.cc:3060] T f5be3a11b23d4ea9b08300a2789821c7 P cd75a17ab2604397adab03bb8b5fd75c [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:51.436767 11937 consensus_queue.cc:260] T f58dc08b12a2494bb9a1372837970ca2 P cd75a17ab2604397adab03bb8b5fd75c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.10, Last appended by leader: 10, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:51.458271 11937 raft_consensus.cc:3060] T f58dc08b12a2494bb9a1372837970ca2 P cd75a17ab2604397adab03bb8b5fd75c [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:20:51.459648  6881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8cee0accdb8499c86d4414b72565a38" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:51.438905 12490 leader_election.cc:290] T 3fa34c08b205435dba97346991aa1f92 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:51.460290  6881 raft_consensus.cc:2468] T d8cee0accdb8499c86d4414b72565a38 P cd75a17ab2604397adab03bb8b5fd75c [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 16.
I20260709 13:20:51.461231  6881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bf4668eeb70467fb3dc5a0289233b3c" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:51.368391 12432 rpcz_store.cc:276] 0709 13:20:46.746322 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:46.746644 (+   322us) service_pool.cc:224] Handling call
0709 13:20:47.104321 (+357677us) ts_tablet_manager.cc:934] T 95a75bfe094d4bdc963aba3f08dfcd25 P 7ba59cc884714e8aa5f3f0ecaed84cbb: Initiating tablet copy from peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391)
0709 13:20:49.152796 (+2048475us) tablet_copy_client.cc:368] Tablet copy session begun
0709 13:20:50.405594 (+1252798us) tablet_metadata.cc:665] Metadata flushed
0709 13:20:50.405733 (+   139us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 13:20:51.330608 (+924875us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 13:20:51.331005 (+   397us) tablet_replica.cc:206] Creating consensus instance
0709 13:20:51.331352 (+   347us) ts_tablet_manager.cc:989] Replica registered.
0709 13:20:51.331407 (+    55us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":44030,"tablet-copy.queue_time_us":220923,"thread_start_us":314432,"threads_started":2}
I20260709 13:20:51.462296  6881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09c2a98de1a4decabd0ff900dd44caa" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:51.462641 12432 tablet_copy_client.cc:806] T 95a75bfe094d4bdc963aba3f08dfcd25 P 7ba59cc884714e8aa5f3f0ecaed84cbb: tablet copy: Starting download of 0 data blocks...
I20260709 13:20:51.462978  6881 raft_consensus.cc:2393] T f09c2a98de1a4decabd0ff900dd44caa P cd75a17ab2604397adab03bb8b5fd75c [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7ab4784c7344b939bc36f639286f377 in current term 18: Already voted for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in this term.
I20260709 13:20:51.463271 12432 tablet_copy_client.cc:670] T 95a75bfe094d4bdc963aba3f08dfcd25 P 7ba59cc884714e8aa5f3f0ecaed84cbb: tablet copy: Starting download of 1 WAL segments...
I20260709 13:20:51.411137 12568 raft_consensus.cc:493] T 4f00a2e87e56452083b759f60d461ee3 P b7ab4784c7344b939bc36f639286f377 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 7ba59cc884714e8aa5f3f0ecaed84cbb)
I20260709 13:20:51.465102  7500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "404190ce4ce94cecbfcb6ea9d1dd8626" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:20:51.465768  6880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a92dd554674067a83a9cb68c4773f2" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:51.466466  6877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3411566abe2d4c9bb4b2adfdd05e6f17" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:51.466651  6880 raft_consensus.cc:2468] T 07a92dd554674067a83a9cb68c4773f2 P cd75a17ab2604397adab03bb8b5fd75c [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 13.
I20260709 13:20:51.468722  6772 leader_election.cc:304] T bd6869f07b5a4885a0b99fbe60c3b175 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:20:51.471958  6877 raft_consensus.cc:2393] T 3411566abe2d4c9bb4b2adfdd05e6f17 P cd75a17ab2604397adab03bb8b5fd75c [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7ab4784c7344b939bc36f639286f377 in current term 14: Already voted for candidate cd75a17ab2604397adab03bb8b5fd75c in this term.
I20260709 13:20:51.402876 12267 raft_consensus.cc:2749] T 1528ab62b6fe4e3099d08f141afee116 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:20:51.423930 12246 raft_consensus.cc:493] T e77e330a82df4b43a745d57a68f6f057 P b7ab4784c7344b939bc36f639286f377 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:51.412180 12545 raft_consensus.cc:2749] T ce4f062dcd314d43a63ca74067cb5ee3 P cd75a17ab2604397adab03bb8b5fd75c [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:20:51.413975 12367 raft_consensus.cc:740] T bd6869f07b5a4885a0b99fbe60c3b175 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
I20260709 13:20:51.431439 12543 consensus_queue.cc:1048] T b56bf91d90824c959e21e0cee5ba1816 P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.047s
I20260709 13:20:51.413558 12484 raft_consensus.cc:515] T 44bde925b2e541b69890d70715b85176 P b7ab4784c7344b939bc36f639286f377 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:51.509344  6772 leader_election.cc:304] T d8292e16e5654be6bc408560cf256aaa P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:20:51.435995 12396 leader_election.cc:290] T b3f13b31a1f84f0d89d007eadd57924c P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:20:51.500140  6806 raft_consensus.cc:2468] T a3022224cc81473690653a83d4e99470 P b7ab4784c7344b939bc36f639286f377 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 17.
I20260709 13:20:51.506587  6874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "427c124d773f483294511e80fe340075" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:51.517578  6724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5be3a11b23d4ea9b08300a2789821c7" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:51.516968  6844 leader_election.cc:400] T bb3d8792045a4583ae2e965b1350a5b4 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 14 pre-election: Vote denied by peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391) with higher term. Message: Invalid argument: T bb3d8792045a4583ae2e965b1350a5b4 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c for earlier term 14. Current term is 15.
I20260709 13:20:51.576323  6844 leader_election.cc:403] T bb3d8792045a4583ae2e965b1350a5b4 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 14 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:20:51.475560  6801 raft_consensus.cc:2468] T bb7fa124c3bf4ef9ab65a407cb008441 P b7ab4784c7344b939bc36f639286f377 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in term 16.
I20260709 13:20:51.493201  6873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30e88460611e47b2ba16a46a30b5f416" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:51.512445  6798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09c2a98de1a4decabd0ff900dd44caa" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:20:51.535177  6803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34f36d59d88f40fe8a2805e604fc6c0a" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
W20260709 13:20:51.578539  6772 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 69305.4us
I20260709 13:20:51.513123  6804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "427c124d773f483294511e80fe340075" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:51.517510  6877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b8cacb381b746da8d0049b0a83b41dd" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:20:51.580433  6804 raft_consensus.cc:2468] T 427c124d773f483294511e80fe340075 P b7ab4784c7344b939bc36f639286f377 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 14.
I20260709 13:20:51.516997  6881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce4f062dcd314d43a63ca74067cb5ee3" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:51.585477  6772 leader_election.cc:304] T 95a75bfe094d4bdc963aba3f08dfcd25 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:20:51.586218  6881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb7fa124c3bf4ef9ab65a407cb008441" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:51.589267  6881 raft_consensus.cc:2393] T bb7fa124c3bf4ef9ab65a407cb008441 P cd75a17ab2604397adab03bb8b5fd75c [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in current term 16: Already voted for candidate cd75a17ab2604397adab03bb8b5fd75c in this term.
I20260709 13:20:51.578305  6798 raft_consensus.cc:3060] T f09c2a98de1a4decabd0ff900dd44caa P b7ab4784c7344b939bc36f639286f377 [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:20:51.582280  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 65479.9us
I20260709 13:20:51.593302  6844 leader_election.cc:304] T d8292e16e5654be6bc408560cf256aaa P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:20:51.594789  6844 leader_election.cc:304] T 8c7f33e544204fbaac4078e3e83bbf4e P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:20:51.583158 12540 raft_consensus.cc:2749] T d8292e16e5654be6bc408560cf256aaa P b7ab4784c7344b939bc36f639286f377 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:20:51.583966  6800 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:32976 (request call id 3347) took 2596 ms. Trace:
W20260709 13:20:51.505167  7466 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 53355.2us
I20260709 13:20:51.596351  6844 leader_election.cc:304] T 3411566abe2d4c9bb4b2adfdd05e6f17 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:20:51.581285  6806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b56bf91d90824c959e21e0cee5ba1816" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:20:51.473459 12397 raft_consensus.cc:3055] T f3f9c2e2bf644115957398fe4c9459db P cd75a17ab2604397adab03bb8b5fd75c [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:20:51.596451  6800 rpcz_store.cc:276] 0709 13:20:48.978563 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:49.236687 (+258124us) service_pool.cc:224] Handling call
0709 13:20:49.268814 (+ 32127us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:50.170122 (+901308us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:51.574745 (+1404623us) spinlock_profiling.cc:243] Waited 901 ms on lock 0x7b5400288cd4. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f9aae01 00007fcc0f9a983e 00007fcc1496e419 00007fcc0dee5bd4 00007fcc0dee5b62 00007fcc0dee5a91 00007fcc0dee5a0c 00007fcc0dee4cc2 00007fcc0dce548c 00007fcc0dce48c6
0709 13:20:51.574986 (+   241us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2071550848}
I20260709 13:20:51.598547  6801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e31b9971c15848dea59d4d4130141d9e" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:51.599053  6874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fa34c08b205435dba97346991aa1f92" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 20 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:51.538360  7495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1528ab62b6fe4e3099d08f141afee116" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:20:51.541555  6731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1528ab62b6fe4e3099d08f141afee116" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:51.582993 12246 raft_consensus.cc:515] T e77e330a82df4b43a745d57a68f6f057 P b7ab4784c7344b939bc36f639286f377 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } }
I20260709 13:20:51.587106  6804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d65025eea89441290d85dd053810e31" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
W20260709 13:20:51.449451 12513 thread.cc:608] apply [worker] (thread pool) Time spent starting thread: real 2.100s	user 0.007s	sys 0.016s
I20260709 13:20:51.580579  6877 raft_consensus.cc:3060] T 4b8cacb381b746da8d0049b0a83b41dd P cd75a17ab2604397adab03bb8b5fd75c [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:20:51.539906 12597 log.cc:927] Time spent T 24ee15416e3145beaa1b8183453729a3 P ccd8a4c3bfe3413cb2ae219b09aea832: Append to log took a long time: real 0.112s	user 0.001s	sys 0.000s
I20260709 13:20:51.599817  6806 raft_consensus.cc:2393] T b56bf91d90824c959e21e0cee5ba1816 P b7ab4784c7344b939bc36f639286f377 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate ccd8a4c3bfe3413cb2ae219b09aea832 in current term 16: Already voted for candidate b7ab4784c7344b939bc36f639286f377 in this term.
I20260709 13:20:51.600768  6724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34f36d59d88f40fe8a2805e604fc6c0a" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: true dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:20:51.602983  6879 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53416 (request call id 3388) took 1060 ms. Trace:
I20260709 13:20:51.471655 12503 raft_consensus.cc:2749] T be1a92657f494cac8dd227d152f50151 P b7ab4784c7344b939bc36f639286f377 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:20:51.476020 12542 raft_consensus.cc:2804] T 17587d6730594da4a56fa13a353232a1 P b7ab4784c7344b939bc36f639286f377 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:20:51.596932  7466 leader_election.cc:304] T bb7fa124c3bf4ef9ab65a407cb008441 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, b7ab4784c7344b939bc36f639286f377; no voters: 
W20260709 13:20:51.656503  6772 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 50730.2us
I20260709 13:20:51.603780 12334 raft_consensus.cc:2749] T 3411566abe2d4c9bb4b2adfdd05e6f17 P cd75a17ab2604397adab03bb8b5fd75c [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:20:51.639894  6873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3d8792045a4583ae2e965b1350a5b4" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:51.659935 12246 leader_election.cc:290] T e77e330a82df4b43a745d57a68f6f057 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931), ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391)
I20260709 13:20:51.603612  6804 raft_consensus.cc:2468] T 3d65025eea89441290d85dd053810e31 P b7ab4784c7344b939bc36f639286f377 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 16.
W20260709 13:20:51.662781  6695 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:51.663021  6804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4275cf08e63345f993bce8664eada830" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:51.641530  6879 rpcz_store.cc:276] 0709 13:20:50.528638 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:50.528931 (+   293us) service_pool.cc:224] Handling call
0709 13:20:51.588707 (+1059776us) spinlock_profiling.cc:243] Waited 277 ms on lock 0x7b54001e96d4. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f9ae2fa 00007fcc1496fb17 00007fcc0deea6d4 00007fcc0deea662 00007fcc0deea591 00007fcc0deea50c 00007fcc0dee97c2 00007fcc0dce548c 00007fcc0dce48c6 00007fcc0dce426f
0709 13:20:51.588847 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":636523904}
I20260709 13:20:51.641883  6803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "713b5728a197487c9300b310ab94e5a3" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:51.643158  6724 raft_consensus.cc:3060] T 34f36d59d88f40fe8a2805e604fc6c0a P ccd8a4c3bfe3413cb2ae219b09aea832 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:51.580299 12278 raft_consensus.cc:2764] T bb7fa124c3bf4ef9ab65a407cb008441 P b7ab4784c7344b939bc36f639286f377 [term 16 FOLLOWER]: Leader election decision vote started in defunct term 15: won
I20260709 13:20:51.583735 12555 raft_consensus.cc:2804] T a3022224cc81473690653a83d4e99470 P b7ab4784c7344b939bc36f639286f377 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:20:51.495126 12568 raft_consensus.cc:515] T 4f00a2e87e56452083b759f60d461ee3 P b7ab4784c7344b939bc36f639286f377 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:20:51.514552 12427 raft_consensus.cc:2749] T bd6869f07b5a4885a0b99fbe60c3b175 P b7ab4784c7344b939bc36f639286f377 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:20:51.652943  6806 raft_consensus.cc:1240] T f03d0dbf16864ca4bc1bb5e4c0334c0f P b7ab4784c7344b939bc36f639286f377 [term 16 FOLLOWER]: Rejecting Update request from peer ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 15. Current term is 16. Ops: []
I20260709 13:20:51.606806  6800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3f13b31a1f84f0d89d007eadd57924c" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
W20260709 13:20:51.657727  7466 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 60854.4us
I20260709 13:20:51.751375  6800 raft_consensus.cc:2468] T b3f13b31a1f84f0d89d007eadd57924c P b7ab4784c7344b939bc36f639286f377 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 13.
I20260709 13:20:51.598119 12397 raft_consensus.cc:740] T f3f9c2e2bf644115957398fe4c9459db P cd75a17ab2604397adab03bb8b5fd75c [term 15 LEADER]: Becoming Follower/Learner. State: Replica: cd75a17ab2604397adab03bb8b5fd75c, State: Running, Role: LEADER
I20260709 13:20:51.663910  6804 raft_consensus.cc:2468] T 4275cf08e63345f993bce8664eada830 P b7ab4784c7344b939bc36f639286f377 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 14.
I20260709 13:20:51.753805 12397 consensus_queue.cc:260] T f3f9c2e2bf644115957398fe4c9459db P cd75a17ab2604397adab03bb8b5fd75c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
W20260709 13:20:51.736477  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 134839us
I20260709 13:20:51.600329 12335 raft_consensus.cc:2749] T bb3d8792045a4583ae2e965b1350a5b4 P cd75a17ab2604397adab03bb8b5fd75c [term 15 FOLLOWER]: Leader pre-election lost for term 14. Reason: Vote denied by peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391) with higher term. Message: Invalid argument: T bb3d8792045a4583ae2e965b1350a5b4 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c for earlier term 14. Current term is 15.
I20260709 13:20:51.598551 12275 raft_consensus.cc:3060] T 95a75bfe094d4bdc963aba3f08dfcd25 P b7ab4784c7344b939bc36f639286f377 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:51.599447 12558 raft_consensus.cc:2749] T 8c7f33e544204fbaac4078e3e83bbf4e P cd75a17ab2604397adab03bb8b5fd75c [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:20:51.747994  6772 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 86238.7us
I20260709 13:20:51.756310  6844 leader_election.cc:304] T 7a734b5ab7834e05a8c422208acc58b1 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:20:51.599617 12581 raft_consensus.cc:2749] T d8292e16e5654be6bc408560cf256aaa P cd75a17ab2604397adab03bb8b5fd75c [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:20:51.759807  6844 leader_election.cc:304] T a3022224cc81473690653a83d4e99470 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:20:51.758459  5625 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 13:20:51.666735 12542 raft_consensus.cc:493] T 17587d6730594da4a56fa13a353232a1 P b7ab4784c7344b939bc36f639286f377 [term 20 FOLLOWER]: Starting leader election (detected failure of leader 7ba59cc884714e8aa5f3f0ecaed84cbb)
W20260709 13:20:51.771696  6697 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 318851us
I20260709 13:20:51.767922  6727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3f13b31a1f84f0d89d007eadd57924c" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:51.772701  6697 leader_election.cc:304] T d33d5ee8ef6f415593d8df52063161ad P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:20:51.705097 12267 raft_consensus.cc:2804] T bb7fa124c3bf4ef9ab65a407cb008441 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:20:51.606796 12552 consensus_queue.cc:1048] T fe20b4b48823486ca3b9c648db6ce8aa P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Connected to new peer: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.145s
I20260709 13:20:51.769547  6844 leader_election.cc:304] T c4db81d9d329422bb3b4160ca4ac2d1d P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:20:51.767666  6806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4db81d9d329422bb3b4160ca4ac2d1d" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:51.778426  6697 leader_election.cc:304] T 2c240553ce044eedb41541d72b9475d7 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:20:51.771186  6731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a92dd554674067a83a9cb68c4773f2" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:51.774102 12340 raft_consensus.cc:993] T dbdf895bba214ff68685a24fd17dfb5d P b7ab4784c7344b939bc36f639286f377: : Instructing follower cd75a17ab2604397adab03bb8b5fd75c to start an election
I20260709 13:20:51.773998 12246 consensus_queue.cc:1059] T 34f36d59d88f40fe8a2805e604fc6c0a P b7ab4784c7344b939bc36f639286f377 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: INVALID_TERM, Last received: 14.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:20:51.774102  6772 leader_election.cc:304] T 20f6842e26174571996b8dea4151d4be P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:20:51.770269  5625 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:20:51.786195  6873 raft_consensus.cc:2393] T bb3d8792045a4583ae2e965b1350a5b4 P cd75a17ab2604397adab03bb8b5fd75c [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in current term 15: Already voted for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in this term.
I20260709 13:20:51.776746  6803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f58dc08b12a2494bb9a1372837970ca2" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:51.648692 12545 consensus_queue.cc:1059] T b56bf91d90824c959e21e0cee5ba1816 P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: INVALID_TERM, Last received: 14.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.118s
I20260709 13:20:51.787619  6723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30e88460611e47b2ba16a46a30b5f416" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
W20260709 13:20:51.793982  6847 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:51.799882  6877 raft_consensus.cc:2410] T 4b8cacb381b746da8d0049b0a83b41dd P cd75a17ab2604397adab03bb8b5fd75c [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 7ba59cc884714e8aa5f3f0ecaed84cbb for term 17 because replica has last-logged OpId of term: 16 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 12.
I20260709 13:20:51.769218 12334 raft_consensus.cc:2749] T 7a734b5ab7834e05a8c422208acc58b1 P cd75a17ab2604397adab03bb8b5fd75c [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:20:51.760949 12497 leader_election.cc:290] T c4db81d9d329422bb3b4160ca4ac2d1d P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:51.769583 12594 raft_consensus.cc:493] T 7c44c4849aa54f2b94d1f1bef9ed546f P ccd8a4c3bfe3413cb2ae219b09aea832 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:51.776106 12542 raft_consensus.cc:3060] T 17587d6730594da4a56fa13a353232a1 P b7ab4784c7344b939bc36f639286f377 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:20:51.739948 12563 raft_consensus.cc:515] T 44bde925b2e541b69890d70715b85176 P cd75a17ab2604397adab03bb8b5fd75c [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:51.806111  6729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fa34c08b205435dba97346991aa1f92" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 20 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:51.778139 12397 raft_consensus.cc:3060] T f3f9c2e2bf644115957398fe4c9459db P cd75a17ab2604397adab03bb8b5fd75c [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:51.779801 12543 raft_consensus.cc:2804] T a3022224cc81473690653a83d4e99470 P cd75a17ab2604397adab03bb8b5fd75c [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:20:51.810495  6727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "404190ce4ce94cecbfcb6ea9d1dd8626" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:51.774251 12484 leader_election.cc:290] T 44bde925b2e541b69890d70715b85176 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:51.792726 12267 raft_consensus.cc:697] T bb7fa124c3bf4ef9ab65a407cb008441 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 16 LEADER]: Becoming Leader. State: Replica: 7ba59cc884714e8aa5f3f0ecaed84cbb, State: Running, Role: LEADER
I20260709 13:20:51.814426  6731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e326172347f45e99a0d482b5d8ef768" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:51.784094 12547 leader_election.cc:290] T f58dc08b12a2494bb9a1372837970ca2 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:51.816524  6723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b8cacb381b746da8d0049b0a83b41dd" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:51.818676  6772 leader_election.cc:304] T b56bf91d90824c959e21e0cee5ba1816 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:20:51.901250  6798 raft_consensus.cc:2468] T f09c2a98de1a4decabd0ff900dd44caa P b7ab4784c7344b939bc36f639286f377 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 18.
W20260709 13:20:51.901769  6772 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 83248.9us
I20260709 13:20:51.672569 12367 consensus_queue.cc:260] T bd6869f07b5a4885a0b99fbe60c3b175 P ccd8a4c3bfe3413cb2ae219b09aea832 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 16.8, Last appended by leader: 8, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:51.808377 12396 consensus_queue.cc:1048] T 90d42e216d9741e190bca19a781291fd P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.024s
I20260709 13:20:51.807430 12334 raft_consensus.cc:2804] T c4db81d9d329422bb3b4160ca4ac2d1d P cd75a17ab2604397adab03bb8b5fd75c [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:20:51.820021 12606 raft_consensus.cc:2749] T d33d5ee8ef6f415593d8df52063161ad P ccd8a4c3bfe3413cb2ae219b09aea832 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:20:51.823490 12594 raft_consensus.cc:515] T 7c44c4849aa54f2b94d1f1bef9ed546f P ccd8a4c3bfe3413cb2ae219b09aea832 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:51.823666 12497 raft_consensus.cc:2749] T 2c240553ce044eedb41541d72b9475d7 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:20:51.836655 12417 raft_consensus.cc:515] T f5be3a11b23d4ea9b08300a2789821c7 P cd75a17ab2604397adab03bb8b5fd75c [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
W20260709 13:20:51.836874 12214 consensus_meta.cc:287] T 711ef6523deb4cbe8ef2ba61e1c21c98 P ccd8a4c3bfe3413cb2ae219b09aea832: Time spent flushing consensus metadata: real 0.519s	user 0.010s	sys 0.003s
I20260709 13:20:51.882900 12543 raft_consensus.cc:493] T a3022224cc81473690653a83d4e99470 P cd75a17ab2604397adab03bb8b5fd75c [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:51.844178 12342 consensus_queue.cc:1059] T 7c37d41cd9164c15a6826ca62a851a69 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: INVALID_TERM, Last received: 15.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.016s
I20260709 13:20:51.841400  7496 raft_consensus.cc:2468] T bb3d8792045a4583ae2e965b1350a5b4 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 15.
I20260709 13:20:51.806109  6844 leader_election.cc:304] T e31b9971c15848dea59d4d4130141d9e P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377
I20260709 13:20:51.883138  6724 raft_consensus.cc:2468] T 34f36d59d88f40fe8a2805e604fc6c0a P ccd8a4c3bfe3413cb2ae219b09aea832 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 15.
W20260709 13:20:51.884238  6697 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 98756.6us
I20260709 13:20:51.884843  6731 raft_consensus.cc:2468] T 9e326172347f45e99a0d482b5d8ef768 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 12.
I20260709 13:20:51.802983 12499 raft_consensus.cc:1081] T dbdf895bba214ff68685a24fd17dfb5d P b7ab4784c7344b939bc36f639286f377 [term 14 LEADER]: Signalling peer cd75a17ab2604397adab03bb8b5fd75c to start an election
I20260709 13:20:51.792968 12427 raft_consensus.cc:2749] T 20f6842e26174571996b8dea4151d4be P b7ab4784c7344b939bc36f639286f377 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:20:51.908090  6772 leader_election.cc:304] T a1704639a875409b9959353527b3fd68 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: ccd8a4c3bfe3413cb2ae219b09aea832
W20260709 13:20:51.955197  6772 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 47226.5us
W20260709 13:20:51.863164 12517 consensus_meta.cc:287] T f03d0dbf16864ca4bc1bb5e4c0334c0f P ccd8a4c3bfe3413cb2ae219b09aea832: Time spent flushing consensus metadata: real 0.534s	user 0.007s	sys 0.005s
I20260709 13:20:51.960059  6876 raft_consensus.cc:2393] T f5be3a11b23d4ea9b08300a2789821c7 P cd75a17ab2604397adab03bb8b5fd75c [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7ab4784c7344b939bc36f639286f377 in current term 15: Already voted for candidate cd75a17ab2604397adab03bb8b5fd75c in this term.
W20260709 13:20:51.865109 12535 consensus_meta.cc:287] T be1a92657f494cac8dd227d152f50151 P ccd8a4c3bfe3413cb2ae219b09aea832: Time spent flushing consensus metadata: real 0.501s	user 0.007s	sys 0.004s
I20260709 13:20:51.912959 12334 raft_consensus.cc:493] T c4db81d9d329422bb3b4160ca4ac2d1d P cd75a17ab2604397adab03bb8b5fd75c [term 15 FOLLOWER]: Starting leader election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
W20260709 13:20:51.862540 12238 consensus_meta.cc:287] T 8c7f33e544204fbaac4078e3e83bbf4e P ccd8a4c3bfe3413cb2ae219b09aea832: Time spent flushing consensus metadata: real 0.510s	user 0.010s	sys 0.001s
I20260709 13:20:51.914487  6872 raft_consensus.cc:1240] T 44bde925b2e541b69890d70715b85176 P cd75a17ab2604397adab03bb8b5fd75c [term 16 FOLLOWER]: Rejecting Update request from peer ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 15. Current term is 16. Ops: []
I20260709 13:20:51.916090  6727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a485a995abc4807b6e511e45419f737" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:51.966568  6731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09c2a98de1a4decabd0ff900dd44caa" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:51.918408  6729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "427c124d773f483294511e80fe340075" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
W20260709 13:20:51.905073 12597 log.cc:927] Time spent T 24ee15416e3145beaa1b8183453729a3 P ccd8a4c3bfe3413cb2ae219b09aea832: Append to log took a long time: real 0.082s	user 0.000s	sys 0.000s
I20260709 13:20:51.862962 12568 leader_election.cc:290] T 4f00a2e87e56452083b759f60d461ee3 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
W20260709 13:20:51.840812 12609 log.cc:927] Time spent T 9e326172347f45e99a0d482b5d8ef768 P cd75a17ab2604397adab03bb8b5fd75c: Append to log took a long time: real 0.187s	user 0.001s	sys 0.000s
I20260709 13:20:51.917238 12503 consensus_queue.cc:1048] T f4b8bd455d5a47c18a1380839c6e0d61 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.010s
I20260709 13:20:52.005698 12267 consensus_queue.cc:237] T bb7fa124c3bf4ef9ab65a407cb008441 P 7ba59cc884714e8aa5f3f0ecaed84cbb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:20:52.007884 12517 raft_consensus.cc:493] T 90d42e216d9741e190bca19a781291fd P ccd8a4c3bfe3413cb2ae219b09aea832 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:20:52.008389 12601 log.cc:927] Time spent T e77e330a82df4b43a745d57a68f6f057 P cd75a17ab2604397adab03bb8b5fd75c: Append to log took a long time: real 0.225s	user 0.004s	sys 0.000s
I20260709 13:20:52.008723 12478 consensus_queue.cc:1048] T 8c7f33e544204fbaac4078e3e83bbf4e P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:20:51.937970  6724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3411566abe2d4c9bb4b2adfdd05e6f17" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
W20260709 13:20:51.938115  6695 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:51.949481  6697 leader_election.cc:304] T 853ac0a8cbd64ce99457f170216d4d0f P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
W20260709 13:20:51.940958  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 134922us
I20260709 13:20:51.910420 12484 raft_consensus.cc:2749] T b56bf91d90824c959e21e0cee5ba1816 P b7ab4784c7344b939bc36f639286f377 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:20:51.916289  6723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1704639a875409b9959353527b3fd68" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:20:52.011601  6723 raft_consensus.cc:2368] T a1704639a875409b9959353527b3fd68 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c for earlier term 16. Current term is 17.
I20260709 13:20:51.967594  6729 raft_consensus.cc:2468] T 427c124d773f483294511e80fe340075 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 14.
I20260709 13:20:51.995045  6730 raft_consensus.cc:2468] T f03d0dbf16864ca4bc1bb5e4c0334c0f P ccd8a4c3bfe3413cb2ae219b09aea832 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 16.
I20260709 13:20:51.967702  6731 raft_consensus.cc:2393] T f09c2a98de1a4decabd0ff900dd44caa P ccd8a4c3bfe3413cb2ae219b09aea832 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7ab4784c7344b939bc36f639286f377 in current term 18: Already voted for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in this term.
I20260709 13:20:51.937811 12543 raft_consensus.cc:3060] T a3022224cc81473690653a83d4e99470 P cd75a17ab2604397adab03bb8b5fd75c [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:20:51.968477  6728 raft_consensus.cc:2468] T be1a92657f494cac8dd227d152f50151 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in term 17.
I20260709 13:20:52.008641 12517 raft_consensus.cc:515] T 90d42e216d9741e190bca19a781291fd P ccd8a4c3bfe3413cb2ae219b09aea832 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:51.932904 12340 raft_consensus.cc:3055] T 34f36d59d88f40fe8a2805e604fc6c0a P b7ab4784c7344b939bc36f639286f377 [term 14 LEADER]: Stepping down as leader of term 14
W20260709 13:20:52.032863  6847 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:52.032088  6723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3d8792045a4583ae2e965b1350a5b4" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:52.038913  6727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bf4668eeb70467fb3dc5a0289233b3c" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:52.013618  6724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09c2a98de1a4decabd0ff900dd44caa" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:52.039156  6723 raft_consensus.cc:2393] T bb3d8792045a4583ae2e965b1350a5b4 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in current term 15: Already voted for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in this term.
W20260709 13:20:52.040853  6697 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 91458.2us
I20260709 13:20:52.041632  6697 leader_election.cc:304] T 9b3759de40694069b13c0f8bd40e5709 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:20:51.962203 12246 raft_consensus.cc:2804] T a1704639a875409b9959353527b3fd68 P b7ab4784c7344b939bc36f639286f377 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:20:51.920171 12569 consensus_queue.cc:1048] T d33d5ee8ef6f415593d8df52063161ad P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.053s
I20260709 13:20:51.996426 12367 raft_consensus.cc:3060] T bd6869f07b5a4885a0b99fbe60c3b175 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:52.076771  6723 raft_consensus.cc:1275] T d33d5ee8ef6f415593d8df52063161ad P ccd8a4c3bfe3413cb2ae219b09aea832 [term 14 FOLLOWER]: Refusing update from remote peer b7ab4784c7344b939bc36f639286f377: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:20:51.922829 12214 raft_consensus.cc:515] T 711ef6523deb4cbe8ef2ba61e1c21c98 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:51.960479 12610 raft_consensus.cc:2804] T e31b9971c15848dea59d4d4130141d9e P cd75a17ab2604397adab03bb8b5fd75c [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 13:20:52.081151  6695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 47277.1us
W20260709 13:20:52.078059  6772 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 121807us
I20260709 13:20:51.967757 12334 raft_consensus.cc:3060] T c4db81d9d329422bb3b4160ca4ac2d1d P cd75a17ab2604397adab03bb8b5fd75c [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:52.084102  6697 leader_election.cc:304] T a1704639a875409b9959353527b3fd68 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:20:52.085095  6731 raft_consensus.cc:1275] T f4b8bd455d5a47c18a1380839c6e0d61 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 16 FOLLOWER]: Refusing update from remote peer b7ab4784c7344b939bc36f639286f377: Log matching property violated. Preceding OpId in replica: term: 14 index: 7. Preceding OpId from leader: term: 16 index: 8. (index mismatch)
I20260709 13:20:52.089282  6695 leader_election.cc:304] T a3022224cc81473690653a83d4e99470 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
I20260709 13:20:52.090881  6772 leader_election.cc:304] T de3186201e1a40d0b335eeb8b4e256e0 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:20:52.038839 12340 raft_consensus.cc:740] T 34f36d59d88f40fe8a2805e604fc6c0a P b7ab4784c7344b939bc36f639286f377 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
I20260709 13:20:52.049897 12536 raft_consensus.cc:2749] T 853ac0a8cbd64ce99457f170216d4d0f P ccd8a4c3bfe3413cb2ae219b09aea832 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:20:52.104453  6727 raft_consensus.cc:1275] T 8c7f33e544204fbaac4078e3e83bbf4e P ccd8a4c3bfe3413cb2ae219b09aea832 [term 14 FOLLOWER]: Refusing update from remote peer b7ab4784c7344b939bc36f639286f377: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:20:52.092517  6772 leader_election.cc:304] T d8cee0accdb8499c86d4414b72565a38 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
W20260709 13:20:52.151156  6697 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 67184.8us
W20260709 13:20:52.151804  6772 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 59363.3us
I20260709 13:20:52.152000  6697 leader_election.cc:304] T f4b8bd455d5a47c18a1380839c6e0d61 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377
W20260709 13:20:52.156117  6695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 70130.8us
I20260709 13:20:52.157996  6732 raft_consensus.cc:2393] T 711ef6523deb4cbe8ef2ba61e1c21c98 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c in current term 19: Already voted for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in this term.
I20260709 13:20:52.152998  6772 leader_election.cc:304] T 07a92dd554674067a83a9cb68c4773f2 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:20:52.162117  6879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77e330a82df4b43a745d57a68f6f057" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:52.163741  6881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44bde925b2e541b69890d70715b85176" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:52.082089 12246 raft_consensus.cc:697] T a1704639a875409b9959353527b3fd68 P b7ab4784c7344b939bc36f639286f377 [term 17 LEADER]: Becoming Leader. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
I20260709 13:20:52.163828  6878 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "dbdf895bba214ff68685a24fd17dfb5d"
dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
 from {username='slave'} at 127.0.0.1:53406
I20260709 13:20:52.085577 12610 raft_consensus.cc:493] T e31b9971c15848dea59d4d4130141d9e P cd75a17ab2604397adab03bb8b5fd75c [term 13 FOLLOWER]: Starting leader election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:20:52.088617 12606 raft_consensus.cc:2749] T 9b3759de40694069b13c0f8bd40e5709 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:20:52.088541 12275 raft_consensus.cc:2749] T 95a75bfe094d4bdc963aba3f08dfcd25 P b7ab4784c7344b939bc36f639286f377 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:20:52.168859  6878 raft_consensus.cc:493] T dbdf895bba214ff68685a24fd17dfb5d P cd75a17ab2604397adab03bb8b5fd75c [term 14 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:20:52.170703  6877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f00a2e87e56452083b759f60d461ee3" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:52.171682  6878 raft_consensus.cc:3060] T dbdf895bba214ff68685a24fd17dfb5d P cd75a17ab2604397adab03bb8b5fd75c [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:52.171933  7495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f00a2e87e56452083b759f60d461ee3" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:20:52.172068  6877 raft_consensus.cc:2468] T 4f00a2e87e56452083b759f60d461ee3 P cd75a17ab2604397adab03bb8b5fd75c [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 17.
I20260709 13:20:52.149277 11937 raft_consensus.cc:493] T 90d42e216d9741e190bca19a781291fd P cd75a17ab2604397adab03bb8b5fd75c [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:52.174304  7496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3f13b31a1f84f0d89d007eadd57924c" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:20:52.160396 12499 raft_consensus.cc:2804] T d8cee0accdb8499c86d4414b72565a38 P b7ab4784c7344b939bc36f639286f377 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:20:52.149763 12484 raft_consensus.cc:2749] T de3186201e1a40d0b335eeb8b4e256e0 P b7ab4784c7344b939bc36f639286f377 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:20:52.176739  7467 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.576s	user 0.007s	sys 0.016s
W20260709 13:20:52.187323  7467 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.723s	user 0.008s	sys 0.016s
I20260709 13:20:52.179930 12517 leader_election.cc:290] T 90d42e216d9741e190bca19a781291fd P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:52.170831 12602 raft_consensus.cc:2804] T f4b8bd455d5a47c18a1380839c6e0d61 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:20:52.168078 12620 raft_consensus.cc:2804] T 07a92dd554674067a83a9cb68c4773f2 P b7ab4784c7344b939bc36f639286f377 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:20:52.174721  6695 leader_election.cc:304] T 3d65025eea89441290d85dd053810e31 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
I20260709 13:20:52.159493 12535 raft_consensus.cc:2749] T a1704639a875409b9959353527b3fd68 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:20:52.181618  6804 raft_consensus.cc:1240] T 95a75bfe094d4bdc963aba3f08dfcd25 P b7ab4784c7344b939bc36f639286f377 [term 14 FOLLOWER]: Rejecting Update request from peer ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 13. Current term is 14. Ops: []
I20260709 13:20:52.174472  6697 leader_election.cc:304] T 34f36d59d88f40fe8a2805e604fc6c0a P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:20:52.164657 12613 raft_consensus.cc:2804] T a3022224cc81473690653a83d4e99470 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:20:52.192754  6806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb7fa124c3bf4ef9ab65a407cb008441" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:20:52.208727  6806 raft_consensus.cc:2393] T bb7fa124c3bf4ef9ab65a407cb008441 P b7ab4784c7344b939bc36f639286f377 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c in current term 16: Already voted for candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in this term.
I20260709 13:20:52.172502 12610 raft_consensus.cc:3060] T e31b9971c15848dea59d4d4130141d9e P cd75a17ab2604397adab03bb8b5fd75c [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:52.203158 12432 tablet_copy_client.cc:538] T 95a75bfe094d4bdc963aba3f08dfcd25 P 7ba59cc884714e8aa5f3f0ecaed84cbb: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:20:52.216857  6695 leader_election.cc:304] T b3f13b31a1f84f0d89d007eadd57924c P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
I20260709 13:20:52.218092  6802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34f36d59d88f40fe8a2805e604fc6c0a" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: true dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:20:52.218099  6695 leader_election.cc:304] T 4275cf08e63345f993bce8664eada830 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
I20260709 13:20:52.218895 12348 raft_consensus.cc:2804] T b3f13b31a1f84f0d89d007eadd57924c P ccd8a4c3bfe3413cb2ae219b09aea832 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:20:52.219421 12348 raft_consensus.cc:493] T b3f13b31a1f84f0d89d007eadd57924c P ccd8a4c3bfe3413cb2ae219b09aea832 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 7ba59cc884714e8aa5f3f0ecaed84cbb)
I20260709 13:20:52.219544 12606 raft_consensus.cc:2804] T 4275cf08e63345f993bce8664eada830 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:20:52.219908 12348 raft_consensus.cc:3060] T b3f13b31a1f84f0d89d007eadd57924c P ccd8a4c3bfe3413cb2ae219b09aea832 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:52.220121 12606 raft_consensus.cc:493] T 4275cf08e63345f993bce8664eada830 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 13 FOLLOWER]: Starting leader election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:20:52.220669 12606 raft_consensus.cc:3060] T 4275cf08e63345f993bce8664eada830 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:52.175093 12342 raft_consensus.cc:493] T 7c44c4849aa54f2b94d1f1bef9ed546f P b7ab4784c7344b939bc36f639286f377 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:52.224177 12342 raft_consensus.cc:515] T 7c44c4849aa54f2b94d1f1bef9ed546f P b7ab4784c7344b939bc36f639286f377 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:52.174770 12503 raft_consensus.cc:493] T 4d9def8b32fd443aa94ab1420b06837b P b7ab4784c7344b939bc36f639286f377 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:20:52.186782 11937 raft_consensus.cc:515] T 90d42e216d9741e190bca19a781291fd P cd75a17ab2604397adab03bb8b5fd75c [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:52.224606  6805 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:32976 (request call id 3371) took 1321 ms. Trace:
I20260709 13:20:52.225762 12214 leader_election.cc:290] T 711ef6523deb4cbe8ef2ba61e1c21c98 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 19 election: Requested vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:52.226600 11937 leader_election.cc:290] T 90d42e216d9741e190bca19a781291fd P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:20:52.210264 12238 raft_consensus.cc:2749] T 34f36d59d88f40fe8a2805e604fc6c0a P ccd8a4c3bfe3413cb2ae219b09aea832 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:20:52.227069 12594 leader_election.cc:290] T 7c44c4849aa54f2b94d1f1bef9ed546f P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
W20260709 13:20:52.209652 12544 consensus_meta.cc:287] T 3fa34c08b205435dba97346991aa1f92 P cd75a17ab2604397adab03bb8b5fd75c: Time spent flushing consensus metadata: real 0.776s	user 0.013s	sys 0.002s
I20260709 13:20:52.187136 12499 raft_consensus.cc:493] T d8cee0accdb8499c86d4414b72565a38 P b7ab4784c7344b939bc36f639286f377 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 7ba59cc884714e8aa5f3f0ecaed84cbb)
I20260709 13:20:52.228760 12499 raft_consensus.cc:3060] T d8cee0accdb8499c86d4414b72565a38 P b7ab4784c7344b939bc36f639286f377 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:52.229107  6874 raft_consensus.cc:2410] T 3fa34c08b205435dba97346991aa1f92 P cd75a17ab2604397adab03bb8b5fd75c [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ba59cc884714e8aa5f3f0ecaed84cbb for term 20 because replica has last-logged OpId of term: 18 index: 15, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 14.
I20260709 13:20:52.231732 12417 leader_election.cc:290] T f5be3a11b23d4ea9b08300a2789821c7 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 15 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:20:52.183198 12536 consensus_queue.cc:1059] T 7887766dc6784fcaa42b35c05fea7a99 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: INVALID_TERM, Last received: 16.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.030s
W20260709 13:20:52.232542 12551 consensus_meta.cc:287] T e77e330a82df4b43a745d57a68f6f057 P ccd8a4c3bfe3413cb2ae219b09aea832: Time spent flushing consensus metadata: real 0.824s	user 0.010s	sys 0.004s
I20260709 13:20:52.233024 12551 raft_consensus.cc:2749] T e77e330a82df4b43a745d57a68f6f057 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:20:52.211118  6697 leader_election.cc:304] T ab432e62819d499eaaf3dd55481dd930 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377
I20260709 13:20:52.233057 12536 raft_consensus.cc:3055] T 7887766dc6784fcaa42b35c05fea7a99 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:20:52.234144 12536 raft_consensus.cc:740] T 7887766dc6784fcaa42b35c05fea7a99 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
I20260709 13:20:52.214052 12517 raft_consensus.cc:2804] T 3d65025eea89441290d85dd053810e31 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:20:52.225301  6805 rpcz_store.cc:276] 0709 13:20:50.903007 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:50.909668 (+  6661us) service_pool.cc:224] Handling call
0709 13:20:50.911305 (+  1637us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:50.995014 (+ 83709us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:50.995048 (+    34us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:20:50.995096 (+    48us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:20:50.995132 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:52.224280 (+1229148us) spinlock_profiling.cc:243] Waited 83.4 ms on lock 0x7b54001f6154. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f9aae01 00007fcc0f9a983e 00007fcc1496e419 00007fcc0dee5bd4 00007fcc0dee5b62 00007fcc0dee5a91 00007fcc0dee5a0c 00007fcc0dee4cc2 00007fcc0dce548c 00007fcc0dce48c6
0709 13:20:52.224338 (+    58us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:52.224497 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":191914752}
I20260709 13:20:52.191287  6725 consensus_queue.cc:260] T 95a75bfe094d4bdc963aba3f08dfcd25 P ccd8a4c3bfe3413cb2ae219b09aea832 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } attrs { replace: true } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: NON_VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: true } }
I20260709 13:20:52.239180  6805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "711ef6523deb4cbe8ef2ba61e1c21c98" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:52.239918  6725 raft_consensus.cc:3060] T 95a75bfe094d4bdc963aba3f08dfcd25 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:52.240082  6805 raft_consensus.cc:2468] T 711ef6523deb4cbe8ef2ba61e1c21c98 P b7ab4784c7344b939bc36f639286f377 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 18.
I20260709 13:20:52.208163  6878 raft_consensus.cc:515] T dbdf895bba214ff68685a24fd17dfb5d P cd75a17ab2604397adab03bb8b5fd75c [term 15 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:52.235050 12536 consensus_queue.cc:260] T 7887766dc6784fcaa42b35c05fea7a99 P ccd8a4c3bfe3413cb2ae219b09aea832 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:52.241326 12517 raft_consensus.cc:493] T 3d65025eea89441290d85dd053810e31 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:52.240340  6806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f03d0dbf16864ca4bc1bb5e4c0334c0f" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:52.242405  6805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a75bfe094d4bdc963aba3f08dfcd25" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: true dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:20:52.244472  6806 raft_consensus.cc:2393] T f03d0dbf16864ca4bc1bb5e4c0334c0f P b7ab4784c7344b939bc36f639286f377 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c in current term 16: Already voted for candidate b7ab4784c7344b939bc36f639286f377 in this term.
I20260709 13:20:52.244740  6697 leader_election.cc:304] T b56bf91d90824c959e21e0cee5ba1816 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:20:52.245373  6806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c37d41cd9164c15a6826ca62a851a69" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:20:52.224699  6695 leader_election.cc:304] T f09c2a98de1a4decabd0ff900dd44caa P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
I20260709 13:20:52.247535  6805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7887766dc6784fcaa42b35c05fea7a99" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:52.186414 12340 consensus_queue.cc:260] T 34f36d59d88f40fe8a2805e604fc6c0a P b7ab4784c7344b939bc36f639286f377 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
W20260709 13:20:52.269289  6695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 44654.1us
I20260709 13:20:52.192219 12602 raft_consensus.cc:493] T f4b8bd455d5a47c18a1380839c6e0d61 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:52.250250  6878 leader_election.cc:290] T dbdf895bba214ff68685a24fd17dfb5d P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 15 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:20:52.242275 12503 raft_consensus.cc:515] T 4d9def8b32fd443aa94ab1420b06837b P b7ab4784c7344b939bc36f639286f377 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:52.249274 12551 raft_consensus.cc:2804] T ab432e62819d499eaaf3dd55481dd930 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:20:52.253183 12542 raft_consensus.cc:515] T 17587d6730594da4a56fa13a353232a1 P b7ab4784c7344b939bc36f639286f377 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:20:52.260246 12334 raft_consensus.cc:515] T c4db81d9d329422bb3b4160ca4ac2d1d P cd75a17ab2604397adab03bb8b5fd75c [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:52.261132 12342 leader_election.cc:290] T 7c44c4849aa54f2b94d1f1bef9ed546f P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:52.267490  6804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1704639a875409b9959353527b3fd68" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:20:52.205188 12620 raft_consensus.cc:493] T 07a92dd554674067a83a9cb68c4773f2 P b7ab4784c7344b939bc36f639286f377 [term 13 FOLLOWER]: Starting leader election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:20:52.250077  6805 raft_consensus.cc:2393] T 7887766dc6784fcaa42b35c05fea7a99 P b7ab4784c7344b939bc36f639286f377 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c in current term 17: Already voted for candidate b7ab4784c7344b939bc36f639286f377 in this term.
I20260709 13:20:52.243255 12517 raft_consensus.cc:3060] T 3d65025eea89441290d85dd053810e31 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:52.246750 12536 raft_consensus.cc:3060] T 7887766dc6784fcaa42b35c05fea7a99 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:52.270010  6697 leader_election.cc:304] T 427c124d773f483294511e80fe340075 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:20:52.290987  6803 raft_consensus.cc:1240] T 17587d6730594da4a56fa13a353232a1 P b7ab4784c7344b939bc36f639286f377 [term 21 FOLLOWER]: Rejecting Update request from peer 7ba59cc884714e8aa5f3f0ecaed84cbb for earlier term 20. Current term is 21. Ops: []
I20260709 13:20:52.290900  6725 raft_consensus.cc:2468] T 95a75bfe094d4bdc963aba3f08dfcd25 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 14.
I20260709 13:20:52.251549  6770 leader_election.cc:304] T 7a734b5ab7834e05a8c422208acc58b1 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:20:52.243247 12613 raft_consensus.cc:697] T a3022224cc81473690653a83d4e99470 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 17 LEADER]: Becoming Leader. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
I20260709 13:20:52.294178  6697 leader_election.cc:304] T bb3d8792045a4583ae2e965b1350a5b4 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:20:52.296824  6806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4db81d9d329422bb3b4160ca4ac2d1d" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:52.294569  6805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3022224cc81473690653a83d4e99470" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:52.299767  6804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09c2a98de1a4decabd0ff900dd44caa" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:52.296473  6770 leader_election.cc:304] T 30e88460611e47b2ba16a46a30b5f416 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:20:52.300614  6804 raft_consensus.cc:2393] T f09c2a98de1a4decabd0ff900dd44caa P b7ab4784c7344b939bc36f639286f377 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c in current term 18: Already voted for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in this term.
W20260709 13:20:52.302652  6698 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:52.304021  6770 leader_election.cc:304] T 9e326172347f45e99a0d482b5d8ef768 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:20:52.247890 12563 leader_election.cc:290] T 44bde925b2e541b69890d70715b85176 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 16 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
W20260709 13:20:52.307044  6695 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:52.307813  6695 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:52.300427  6805 raft_consensus.cc:2468] T a3022224cc81473690653a83d4e99470 P b7ab4784c7344b939bc36f639286f377 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 17.
I20260709 13:20:52.276854 12602 raft_consensus.cc:3060] T f4b8bd455d5a47c18a1380839c6e0d61 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:52.313838  6732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44bde925b2e541b69890d70715b85176" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:52.277673 12497 raft_consensus.cc:2804] T f09c2a98de1a4decabd0ff900dd44caa P ccd8a4c3bfe3413cb2ae219b09aea832 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:20:52.275624 11634 raft_consensus.cc:2749] T b56bf91d90824c959e21e0cee5ba1816 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:20:52.315400  6770 leader_election.cc:304] T 3411566abe2d4c9bb4b2adfdd05e6f17 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:20:52.317135  6724 raft_consensus.cc:1275] T f58dc08b12a2494bb9a1372837970ca2 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 18 FOLLOWER]: Refusing update from remote peer b7ab4784c7344b939bc36f639286f377: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
I20260709 13:20:52.275542 12551 raft_consensus.cc:493] T ab432e62819d499eaaf3dd55481dd930 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 17 FOLLOWER]: Starting leader election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:20:52.317813  6725 raft_consensus.cc:1275] T 90d42e216d9741e190bca19a781291fd P ccd8a4c3bfe3413cb2ae219b09aea832 [term 16 FOLLOWER]: Refusing update from remote peer b7ab4784c7344b939bc36f639286f377: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 13:20:52.323035  6732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77e330a82df4b43a745d57a68f6f057" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:52.324831  6732 raft_consensus.cc:2468] T e77e330a82df4b43a745d57a68f6f057 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 17.
I20260709 13:20:52.329174  6770 leader_election.cc:304] T f09c2a98de1a4decabd0ff900dd44caa P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:20:52.304833 12342 raft_consensus.cc:2804] T 7a734b5ab7834e05a8c422208acc58b1 P b7ab4784c7344b939bc36f639286f377 [term 17 FOLLOWER]: Leader election won for term 17
W20260709 13:20:52.342099 12619 log.cc:927] Time spent T d8cee0accdb8499c86d4414b72565a38 P cd75a17ab2604397adab03bb8b5fd75c: Append to log took a long time: real 0.106s	user 0.001s	sys 0.000s
I20260709 13:20:52.349380 12503 leader_election.cc:290] T 4d9def8b32fd443aa94ab1420b06837b P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:52.350188 12503 raft_consensus.cc:2749] T f09c2a98de1a4decabd0ff900dd44caa P b7ab4784c7344b939bc36f639286f377 [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:20:52.352875 12618 log.cc:927] Time spent T 4b8cacb381b746da8d0049b0a83b41dd P ccd8a4c3bfe3413cb2ae219b09aea832: Append to log took a long time: real 0.105s	user 0.000s	sys 0.000s
I20260709 13:20:52.319661 12398 raft_consensus.cc:2804] T 9e326172347f45e99a0d482b5d8ef768 P b7ab4784c7344b939bc36f639286f377 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:20:52.354641 12398 raft_consensus.cc:493] T 9e326172347f45e99a0d482b5d8ef768 P b7ab4784c7344b939bc36f639286f377 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:52.355027 12398 raft_consensus.cc:3060] T 9e326172347f45e99a0d482b5d8ef768 P b7ab4784c7344b939bc36f639286f377 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:52.336653 12484 raft_consensus.cc:3060] T 3411566abe2d4c9bb4b2adfdd05e6f17 P b7ab4784c7344b939bc36f639286f377 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:52.356853 12542 leader_election.cc:290] T 17587d6730594da4a56fa13a353232a1 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 21 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:20:52.335073 12551 raft_consensus.cc:3060] T ab432e62819d499eaaf3dd55481dd930 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:20:52.316783 12556 raft_consensus.cc:2749] T 30e88460611e47b2ba16a46a30b5f416 P b7ab4784c7344b939bc36f639286f377 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:20:52.374123 12527 consensus_meta.cc:287] T 3a485a995abc4807b6e511e45419f737 P cd75a17ab2604397adab03bb8b5fd75c: Time spent flushing consensus metadata: real 0.906s	user 0.001s	sys 0.011s
I20260709 13:20:52.374574 12563 raft_consensus.cc:493] T 3fa34c08b205435dba97346991aa1f92 P cd75a17ab2604397adab03bb8b5fd75c [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:52.291715 12620 raft_consensus.cc:3060] T 07a92dd554674067a83a9cb68c4773f2 P b7ab4784c7344b939bc36f639286f377 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:52.329663 12271 raft_consensus.cc:493] T 24ee15416e3145beaa1b8183453729a3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 19 FOLLOWER]: Starting pre-election (detected failure of leader cd75a17ab2604397adab03bb8b5fd75c)
I20260709 13:20:52.302161 12594 raft_consensus.cc:2804] T 427c124d773f483294511e80fe340075 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:20:52.249539 12246 consensus_queue.cc:237] T a1704639a875409b9959353527b3fd68 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:52.399119 12271 raft_consensus.cc:515] T 24ee15416e3145beaa1b8183453729a3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:20:52.402904 12348 raft_consensus.cc:515] T b3f13b31a1f84f0d89d007eadd57924c P ccd8a4c3bfe3413cb2ae219b09aea832 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:20:52.374661 12527 raft_consensus.cc:515] T 3a485a995abc4807b6e511e45419f737 P cd75a17ab2604397adab03bb8b5fd75c [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:52.403898 12271 leader_election.cc:290] T 24ee15416e3145beaa1b8183453729a3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:52.405378 12334 leader_election.cc:290] T c4db81d9d329422bb3b4160ca4ac2d1d P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 16 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:20:52.405578 12527 leader_election.cc:290] T 3a485a995abc4807b6e511e45419f737 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 16 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:20:52.360847 12613 consensus_queue.cc:237] T a3022224cc81473690653a83d4e99470 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:52.412544  6875 raft_consensus.cc:2393] T 3a485a995abc4807b6e511e45419f737 P cd75a17ab2604397adab03bb8b5fd75c [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7ab4784c7344b939bc36f639286f377 in current term 16: Already voted for candidate cd75a17ab2604397adab03bb8b5fd75c in this term.
I20260709 13:20:52.422829 12348 leader_election.cc:290] T b3f13b31a1f84f0d89d007eadd57924c P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 14 election: Requested vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:20:52.378147 12594 raft_consensus.cc:493] T 427c124d773f483294511e80fe340075 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 7ba59cc884714e8aa5f3f0ecaed84cbb)
I20260709 13:20:52.380776 12535 raft_consensus.cc:2804] T bb3d8792045a4583ae2e965b1350a5b4 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:20:52.432771  7494 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50744 (request call id 447) took 1080 ms. Trace:
W20260709 13:20:52.442323  7468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 130154us
W20260709 13:20:52.470597  6697 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 176466us
I20260709 13:20:52.445349 12527 raft_consensus.cc:493] T 95a75bfe094d4bdc963aba3f08dfcd25 P cd75a17ab2604397adab03bb8b5fd75c [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:52.445502 12594 raft_consensus.cc:3060] T 427c124d773f483294511e80fe340075 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:52.444797 12497 raft_consensus.cc:697] T f09c2a98de1a4decabd0ff900dd44caa P ccd8a4c3bfe3413cb2ae219b09aea832 [term 18 LEADER]: Becoming Leader. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
I20260709 13:20:52.386817 12563 raft_consensus.cc:515] T 3fa34c08b205435dba97346991aa1f92 P cd75a17ab2604397adab03bb8b5fd75c [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:20:52.479180  6725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24ee15416e3145beaa1b8183453729a3" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:52.454198 12342 raft_consensus.cc:697] T 7a734b5ab7834e05a8c422208acc58b1 P b7ab4784c7344b939bc36f639286f377 [term 17 LEADER]: Becoming Leader. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
I20260709 13:20:52.465139 12535 raft_consensus.cc:697] T bb3d8792045a4583ae2e965b1350a5b4 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 15 LEADER]: Becoming Leader. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
I20260709 13:20:52.498140 12535 consensus_queue.cc:237] T bb3d8792045a4583ae2e965b1350a5b4 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:20:52.500484 12566 raft_consensus.cc:3055] T 7c37d41cd9164c15a6826ca62a851a69 P b7ab4784c7344b939bc36f639286f377 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:20:52.501092 12566 raft_consensus.cc:740] T 7c37d41cd9164c15a6826ca62a851a69 P b7ab4784c7344b939bc36f639286f377 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
I20260709 13:20:52.502077 12566 consensus_queue.cc:260] T 7c37d41cd9164c15a6826ca62a851a69 P b7ab4784c7344b939bc36f639286f377 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:52.505515 12563 leader_election.cc:290] T 3fa34c08b205435dba97346991aa1f92 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:20:52.448388  7494 rpcz_store.cc:276] 0709 13:20:51.352526 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:51.354358 (+  1832us) service_pool.cc:224] Handling call
0709 13:20:52.431658 (+1077300us) spinlock_profiling.cc:243] Waited 4.33 ms on lock 0x7b5800123f98. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0c745db1 00007fcc0c885f8c 00007fcc0c885ef6 0000000000375939 00007fcc148f91e0 00007fcc149c20c4 00007fcc149c2131 00007fcc14983fc0 00007fcc1496e929 00007fcc1496e3d2 00007fcc0dee5bd4
0709 13:20:52.431858 (+   200us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:52.432207 (+   349us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:52.432251 (+    44us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:20:52.432328 (+    77us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:20:52.432411 (+    83us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:52.432496 (+    85us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:52.432679 (+   183us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":9950080}
I20260709 13:20:52.464551 12398 raft_consensus.cc:515] T 9e326172347f45e99a0d482b5d8ef768 P b7ab4784c7344b939bc36f639286f377 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:52.512812 12342 consensus_queue.cc:237] T 7a734b5ab7834e05a8c422208acc58b1 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 15.7, Last appended by leader: 7, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } attrs { replace: true } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: NON_VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: true } }
I20260709 13:20:52.514025 12432 tablet_bootstrap.cc:492] T 95a75bfe094d4bdc963aba3f08dfcd25 P 7ba59cc884714e8aa5f3f0ecaed84cbb: Bootstrap starting.
I20260709 13:20:52.503463 12566 raft_consensus.cc:3060] T 7c37d41cd9164c15a6826ca62a851a69 P b7ab4784c7344b939bc36f639286f377 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:52.522737 12620 raft_consensus.cc:515] T 07a92dd554674067a83a9cb68c4773f2 P b7ab4784c7344b939bc36f639286f377 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:52.524673 12497 consensus_queue.cc:237] T f09c2a98de1a4decabd0ff900dd44caa P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:52.482837 12527 raft_consensus.cc:515] T 95a75bfe094d4bdc963aba3f08dfcd25 P cd75a17ab2604397adab03bb8b5fd75c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } attrs { replace: true } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: NON_VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: true } }
I20260709 13:20:52.511719 12398 leader_election.cc:290] T 9e326172347f45e99a0d482b5d8ef768 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 14 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:52.527926 12499 raft_consensus.cc:515] T d8cee0accdb8499c86d4414b72565a38 P b7ab4784c7344b939bc36f639286f377 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:20:52.538877  6798 raft_consensus.cc:1240] T d8cee0accdb8499c86d4414b72565a38 P b7ab4784c7344b939bc36f639286f377 [term 17 FOLLOWER]: Rejecting Update request from peer 7ba59cc884714e8aa5f3f0ecaed84cbb for earlier term 16. Current term is 17. Ops: []
I20260709 13:20:52.539507 12620 leader_election.cc:290] T 07a92dd554674067a83a9cb68c4773f2 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 14 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:52.540246 12527 leader_election.cc:290] T 95a75bfe094d4bdc963aba3f08dfcd25 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:20:52.541046  6876 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53406 (request call id 2685) took 1144 ms. Trace:
I20260709 13:20:52.530529 12606 raft_consensus.cc:515] T 4275cf08e63345f993bce8664eada830 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:52.541649  6876 rpcz_store.cc:276] 0709 13:20:51.396437 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:51.416555 (+ 20118us) service_pool.cc:224] Handling call
0709 13:20:52.540825 (+1124270us) spinlock_profiling.cc:243] Waited 542 ms on lock 0x7b5400219dd4. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f9ae2fa 00007fcc1496fb17 00007fcc0deea6d4 00007fcc0deea662 00007fcc0deea591 00007fcc0deea50c 00007fcc0dee97c2 00007fcc0dce548c 00007fcc0dce48c6 00007fcc0dce426f
0709 13:20:52.540980 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1246674816}
I20260709 13:20:52.542699 12551 raft_consensus.cc:515] T ab432e62819d499eaaf3dd55481dd930 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:52.544112 12606 leader_election.cc:290] T 4275cf08e63345f993bce8664eada830 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 14 election: Requested vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:52.544059  6732 raft_consensus.cc:1240] T ab432e62819d499eaaf3dd55481dd930 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 18 FOLLOWER]: Rejecting Update request from peer b7ab4784c7344b939bc36f639286f377 for earlier term 17. Current term is 18. Ops: []
I20260709 13:20:52.504022 12610 raft_consensus.cc:515] T e31b9971c15848dea59d4d4130141d9e P cd75a17ab2604397adab03bb8b5fd75c [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:52.546240 12340 raft_consensus.cc:3060] T 34f36d59d88f40fe8a2805e604fc6c0a P b7ab4784c7344b939bc36f639286f377 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:52.533339 12484 raft_consensus.cc:2749] T 3411566abe2d4c9bb4b2adfdd05e6f17 P b7ab4784c7344b939bc36f639286f377 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:20:52.532357 12517 raft_consensus.cc:515] T 3d65025eea89441290d85dd053810e31 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:52.537559 12602 raft_consensus.cc:515] T f4b8bd455d5a47c18a1380839c6e0d61 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:52.534463 12543 raft_consensus.cc:515] T a3022224cc81473690653a83d4e99470 P cd75a17ab2604397adab03bb8b5fd75c [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:52.555431 12335 raft_consensus.cc:3055] T b56bf91d90824c959e21e0cee5ba1816 P cd75a17ab2604397adab03bb8b5fd75c [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:20:52.555907 12335 raft_consensus.cc:740] T b56bf91d90824c959e21e0cee5ba1816 P cd75a17ab2604397adab03bb8b5fd75c [term 15 LEADER]: Becoming Follower/Learner. State: Replica: cd75a17ab2604397adab03bb8b5fd75c, State: Running, Role: LEADER
I20260709 13:20:52.556809 12335 consensus_queue.cc:260] T b56bf91d90824c959e21e0cee5ba1816 P cd75a17ab2604397adab03bb8b5fd75c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:52.557852 12335 raft_consensus.cc:3060] T b56bf91d90824c959e21e0cee5ba1816 P cd75a17ab2604397adab03bb8b5fd75c [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:52.560707 12517 leader_election.cc:290] T 3d65025eea89441290d85dd053810e31 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 17 election: Requested vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:52.547799 12610 leader_election.cc:290] T e31b9971c15848dea59d4d4130141d9e P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 14 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:20:52.562392 12602 leader_election.cc:290] T f4b8bd455d5a47c18a1380839c6e0d61 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 17 election: Requested vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
W20260709 13:20:52.563159  6697 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 78595.5us
I20260709 13:20:52.564499  6872 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53416 (request call id 3405) took 1668 ms. Trace:
I20260709 13:20:52.564851  6872 rpcz_store.cc:276] 0709 13:20:50.896327 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:51.248531 (+352204us) service_pool.cc:224] Handling call
0709 13:20:51.248781 (+   250us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:51.966596 (+717815us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:52.564258 (+597662us) spinlock_profiling.cc:243] Waited 665 ms on lock 0x7b54001e7dd4. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f9aae01 00007fcc0f9a983e 00007fcc1496e419 00007fcc0dee5bd4 00007fcc0dee5b62 00007fcc0dee5a91 00007fcc0dee5a0c 00007fcc0dee4cc2 00007fcc0dce548c 00007fcc0dce48c6
0709 13:20:52.564433 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1530358656}
I20260709 13:20:52.567518  6878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d65025eea89441290d85dd053810e31" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:52.568439  6873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4275cf08e63345f993bce8664eada830" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:52.568773  6874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e326172347f45e99a0d482b5d8ef768" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:52.569589  6873 raft_consensus.cc:2393] T 4275cf08e63345f993bce8664eada830 P cd75a17ab2604397adab03bb8b5fd75c [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ccd8a4c3bfe3413cb2ae219b09aea832 in current term 14: Already voted for candidate cd75a17ab2604397adab03bb8b5fd75c in this term.
W20260709 13:20:52.569746  6697 connection.cc:256] RPC call timeout handler was delayed by -1.5157923199999459s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18730000000000002s for a response
I20260709 13:20:52.570657  6697 leader_election.cc:304] T fe20b4b48823486ca3b9c648db6ce8aa P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:20:52.571359  6874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4db81d9d329422bb3b4160ca4ac2d1d" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:52.536324  6726 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50004 (request call id 2637) took 1509 ms. Trace:
I20260709 13:20:52.573704  6877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90d42e216d9741e190bca19a781291fd" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:52.574007  6729 raft_consensus.cc:1240] T 3d65025eea89441290d85dd053810e31 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 17 FOLLOWER]: Rejecting Update request from peer cd75a17ab2604397adab03bb8b5fd75c for earlier term 16. Current term is 17. Ops: []
I20260709 13:20:52.574358  6877 raft_consensus.cc:2468] T 90d42e216d9741e190bca19a781291fd P cd75a17ab2604397adab03bb8b5fd75c [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 16.
I20260709 13:20:52.575192  6877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c44c4849aa54f2b94d1f1bef9ed546f" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:52.575377  6729 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49998 (request call id 1389) took 1153 ms. Trace:
I20260709 13:20:52.573362  6726 rpcz_store.cc:276] 0709 13:20:51.026526 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:51.026712 (+   186us) service_pool.cc:224] Handling call
0709 13:20:51.517714 (+491002us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:51.517941 (+   227us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:51.517969 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:20:51.518017 (+    48us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:20:51.518052 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:51.518114 (+    62us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:52.536152 (+1018038us) spinlock_profiling.cc:243] Waited 491 ms on lock 0x7b54000983d0. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f9a98ad 00007fcc1496e419 00007fcc0dee5bd4 00007fcc0dee5b62 00007fcc0dee5a91 00007fcc0dee5a0c 00007fcc0dee4cc2 00007fcc0dce548c 00007fcc0dce48c6 00007fcc0dce426f
0709 13:20:52.536264 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1128211328}
W20260709 13:20:52.576327  6771 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:52.574035  6881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "711ef6523deb4cbe8ef2ba61e1c21c98" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:20:52.577598  6881 raft_consensus.cc:3060] T 711ef6523deb4cbe8ef2ba61e1c21c98 P cd75a17ab2604397adab03bb8b5fd75c [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:20:52.577636  6873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4275cf08e63345f993bce8664eada830" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:20:52.578739  6873 raft_consensus.cc:2393] T 4275cf08e63345f993bce8664eada830 P cd75a17ab2604397adab03bb8b5fd75c [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate ccd8a4c3bfe3413cb2ae219b09aea832 in current term 14: Already voted for candidate cd75a17ab2604397adab03bb8b5fd75c in this term.
I20260709 13:20:52.578878  6879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "713b5728a197487c9300b310ab94e5a3" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:52.571965  6880 raft_consensus.cc:1240] T 3411566abe2d4c9bb4b2adfdd05e6f17 P cd75a17ab2604397adab03bb8b5fd75c [term 14 FOLLOWER]: Rejecting Update request from peer ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 13. Current term is 14. Ops: []
I20260709 13:20:52.580598  6874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f58dc08b12a2494bb9a1372837970ca2" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:52.581601  6874 raft_consensus.cc:2410] T f58dc08b12a2494bb9a1372837970ca2 P cd75a17ab2604397adab03bb8b5fd75c [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ccd8a4c3bfe3413cb2ae219b09aea832 for term 19 because replica has last-logged OpId of term: 17 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 9.
I20260709 13:20:52.582288  6880 raft_consensus.cc:1240] T 4b8cacb381b746da8d0049b0a83b41dd P cd75a17ab2604397adab03bb8b5fd75c [term 17 FOLLOWER]: Rejecting Update request from peer ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 16. Current term is 17. Ops: []
I20260709 13:20:52.583284  6874 raft_consensus.cc:1275] T 3fa34c08b205435dba97346991aa1f92 P cd75a17ab2604397adab03bb8b5fd75c [term 19 FOLLOWER]: Refusing update from remote peer ccd8a4c3bfe3413cb2ae219b09aea832: Log matching property violated. Preceding OpId in replica: term: 18 index: 15. Preceding OpId from leader: term: 19 index: 15. (term mismatch)
I20260709 13:20:52.583467 12484 raft_consensus.cc:493] T f03d0dbf16864ca4bc1bb5e4c0334c0f P b7ab4784c7344b939bc36f639286f377 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:52.583916 12427 raft_consensus.cc:493] T f3f9c2e2bf644115957398fe4c9459db P b7ab4784c7344b939bc36f639286f377 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:52.584203 12484 raft_consensus.cc:515] T f03d0dbf16864ca4bc1bb5e4c0334c0f P b7ab4784c7344b939bc36f639286f377 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:52.584570 12427 raft_consensus.cc:515] T f3f9c2e2bf644115957398fe4c9459db P b7ab4784c7344b939bc36f639286f377 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:52.585346  6876 raft_consensus.cc:1240] T f5be3a11b23d4ea9b08300a2789821c7 P cd75a17ab2604397adab03bb8b5fd75c [term 15 FOLLOWER]: Rejecting Update request from peer ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 14. Current term is 15. Ops: []
I20260709 13:20:52.586339 12484 leader_election.cc:290] T f03d0dbf16864ca4bc1bb5e4c0334c0f P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:52.583731  6874 pending_rounds.cc:85] T 3fa34c08b205435dba97346991aa1f92 P cd75a17ab2604397adab03bb8b5fd75c: Aborting all ops after (but not including) 14
I20260709 13:20:52.586968  6874 pending_rounds.cc:107] T 3fa34c08b205435dba97346991aa1f92 P cd75a17ab2604397adab03bb8b5fd75c: Aborting uncommitted NO_OP operation due to leader change: 18.15
I20260709 13:20:52.586624  7496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3f13b31a1f84f0d89d007eadd57924c" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:20:52.587267  6874 raft_consensus.cc:2889] T 3fa34c08b205435dba97346991aa1f92 P cd75a17ab2604397adab03bb8b5fd75c [term 19 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:20:52.587594 12427 leader_election.cc:290] T f3f9c2e2bf644115957398fe4c9459db P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:52.540346 12499 leader_election.cc:290] T d8cee0accdb8499c86d4414b72565a38 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 17 election: Requested vote from peers cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:20:52.588578  7500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3f13b31a1f84f0d89d007eadd57924c" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb"
I20260709 13:20:52.575712  6729 rpcz_store.cc:276] 0709 13:20:51.422027 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:52.032470 (+610443us) service_pool.cc:224] Handling call
0709 13:20:52.526789 (+494319us) spinlock_profiling.cc:243] Waited 1.15 ms on lock 0x7b5800000c98. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0c745db1 00007fcc0c885b71 00007fcc0c885a22 00007fcc1579ec09 00007fcc148f8ee0 00007fcc149c20ab 00007fcc149c2131 00007fcc14983fc0 00007fcc1496e929 00007fcc1496e3d2 00007fcc0dee5bd4
0709 13:20:52.526994 (+   205us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:52.574396 (+ 47402us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:52.575166 (+   770us) spinlock_profiling.cc:243] Waited 46.8 ms on lock 0x7b540031a1d4. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f9aae01 00007fcc0f9a983e 00007fcc1496e419 00007fcc0dee5bd4 00007fcc0dee5b62 00007fcc0dee5a91 00007fcc0dee5a0c 00007fcc0dee4cc2 00007fcc0dce548c 00007fcc0dce48c6
0709 13:20:52.575327 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":110348416}
I20260709 13:20:52.590255 12543 leader_election.cc:290] T a3022224cc81473690653a83d4e99470 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 18 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:20:52.579665  6873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d65025eea89441290d85dd053810e31" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:20:52.591265 12603 consensus_queue.cc:1059] T d8cee0accdb8499c86d4414b72565a38 P 7ba59cc884714e8aa5f3f0ecaed84cbb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: INVALID_TERM, Last received: 16.12, Next index: 13, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:20:52.592308 12616 raft_consensus.cc:3055] T d8cee0accdb8499c86d4414b72565a38 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:20:52.592686 12616 raft_consensus.cc:740] T d8cee0accdb8499c86d4414b72565a38 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 7ba59cc884714e8aa5f3f0ecaed84cbb, State: Running, Role: LEADER
I20260709 13:20:52.593351 12602 raft_consensus.cc:2749] T fe20b4b48823486ca3b9c648db6ce8aa P ccd8a4c3bfe3413cb2ae219b09aea832 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:20:52.593551 12616 consensus_queue.cc:260] T d8cee0accdb8499c86d4414b72565a38 P 7ba59cc884714e8aa5f3f0ecaed84cbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:20:52.593900  6803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90d42e216d9741e190bca19a781291fd" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:52.588071  7495 raft_consensus.cc:1275] T 3fa34c08b205435dba97346991aa1f92 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 19 FOLLOWER]: Refusing update from remote peer ccd8a4c3bfe3413cb2ae219b09aea832: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
I20260709 13:20:52.552901  6728 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49744 (request call id 598) took 1298 ms. Trace:
I20260709 13:20:52.596129  6798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c44c4849aa54f2b94d1f1bef9ed546f" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:52.596406  6728 rpcz_store.cc:276] 0709 13:20:51.280615 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:51.294800 (+ 14185us) service_pool.cc:224] Handling call
0709 13:20:52.552741 (+1257941us) spinlock_profiling.cc:243] Waited 620 ms on lock 0x7b540008d254. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f9ae2fa 00007fcc1496fb17 00007fcc0deea6d4 00007fcc0deea662 00007fcc0deea591 00007fcc0deea50c 00007fcc0dee97c2 00007fcc0dce548c 00007fcc0dce48c6 00007fcc0dce426f
0709 13:20:52.552840 (+    99us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1425116032}
I20260709 13:20:52.597152  6798 raft_consensus.cc:2468] T 7c44c4849aa54f2b94d1f1bef9ed546f P b7ab4784c7344b939bc36f639286f377 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 18.
W20260709 13:20:52.600464  6847 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:52.602712  7494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fa34c08b205435dba97346991aa1f92" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:20:52.603611  7494 raft_consensus.cc:2468] T 3fa34c08b205435dba97346991aa1f92 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 19.
I20260709 13:20:52.653970  6729 raft_consensus.cc:1240] T b56bf91d90824c959e21e0cee5ba1816 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 16 FOLLOWER]: Rejecting Update request from peer cd75a17ab2604397adab03bb8b5fd75c for earlier term 15. Current term is 16. Ops: [15.10-15.10]
I20260709 13:20:52.528740  6730 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49998 (request call id 1383) took 1108 ms. Trace:
I20260709 13:20:52.604274 12606 consensus_queue.cc:1059] T 4b8cacb381b746da8d0049b0a83b41dd P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false }, Status: INVALID_TERM, Last received: 14.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:20:52.654958  6730 rpcz_store.cc:276] 0709 13:20:51.420255 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:51.420397 (+   142us) service_pool.cc:224] Handling call
0709 13:20:52.528545 (+1108148us) spinlock_profiling.cc:243] Waited 551 ms on lock 0x7b540027b854. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f9ae2fa 00007fcc1496fb17 00007fcc0deea6d4 00007fcc0deea662 00007fcc0deea591 00007fcc0deea50c 00007fcc0dee97c2 00007fcc0dce548c 00007fcc0dce48c6 00007fcc0dce426f
0709 13:20:52.528670 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1266891648}
I20260709 13:20:52.655405 12606 raft_consensus.cc:3055] T 4b8cacb381b746da8d0049b0a83b41dd P ccd8a4c3bfe3413cb2ae219b09aea832 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:20:52.604723  6804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "711ef6523deb4cbe8ef2ba61e1c21c98" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:20:52.655781 12606 raft_consensus.cc:740] T 4b8cacb381b746da8d0049b0a83b41dd P ccd8a4c3bfe3413cb2ae219b09aea832 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
I20260709 13:20:52.656384  6804 raft_consensus.cc:3060] T 711ef6523deb4cbe8ef2ba61e1c21c98 P b7ab4784c7344b939bc36f639286f377 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:20:52.656688 12606 consensus_queue.cc:260] T 4b8cacb381b746da8d0049b0a83b41dd P ccd8a4c3bfe3413cb2ae219b09aea832 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:20:52.657861 12606 raft_consensus.cc:3060] T 4b8cacb381b746da8d0049b0a83b41dd P ccd8a4c3bfe3413cb2ae219b09aea832 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:52.605804  6872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e31b9971c15848dea59d4d4130141d9e" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:52.588574  6879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4b8bd455d5a47c18a1380839c6e0d61" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 17 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:20:52.660861  6846 leader_election.cc:304] T 3fa34c08b205435dba97346991aa1f92 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:20:52.575726  6877 raft_consensus.cc:2468] T 7c44c4849aa54f2b94d1f1bef9ed546f P cd75a17ab2604397adab03bb8b5fd75c [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 17.
I20260709 13:20:52.663494  6730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5be3a11b23d4ea9b08300a2789821c7" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:20:52.664407 12581 raft_consensus.cc:2804] T 3fa34c08b205435dba97346991aa1f92 P cd75a17ab2604397adab03bb8b5fd75c [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:20:52.665169 12581 raft_consensus.cc:493] T 3fa34c08b205435dba97346991aa1f92 P cd75a17ab2604397adab03bb8b5fd75c [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:52.665766 12581 raft_consensus.cc:3060] T 3fa34c08b205435dba97346991aa1f92 P cd75a17ab2604397adab03bb8b5fd75c [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:20:52.674095  7466 leader_election.cc:304] T be1a92657f494cac8dd227d152f50151 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: b7ab4784c7344b939bc36f639286f377
I20260709 13:20:52.677562  6730 raft_consensus.cc:1240] T b3f13b31a1f84f0d89d007eadd57924c P ccd8a4c3bfe3413cb2ae219b09aea832 [term 14 FOLLOWER]: Rejecting Update request from peer 7ba59cc884714e8aa5f3f0ecaed84cbb for earlier term 13. Current term is 14. Ops: []
I20260709 13:20:52.600590 12543 raft_consensus.cc:493] T d33d5ee8ef6f415593d8df52063161ad P cd75a17ab2604397adab03bb8b5fd75c [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:52.610008  6798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3f13b31a1f84f0d89d007eadd57924c" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:20:52.701480  6798 raft_consensus.cc:3060] T b3f13b31a1f84f0d89d007eadd57924c P b7ab4784c7344b939bc36f639286f377 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:52.611092  6806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4275cf08e63345f993bce8664eada830" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:20:52.695852  6730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90d42e216d9741e190bca19a781291fd" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:52.614112  6807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab432e62819d499eaaf3dd55481dd930" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:20:52.703205 12311 raft_consensus.cc:2804] T be1a92657f494cac8dd227d152f50151 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:20:52.703689 12311 raft_consensus.cc:493] T be1a92657f494cac8dd227d152f50151 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 16 FOLLOWER]: Starting leader election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:20:52.703891  6724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fa34c08b205435dba97346991aa1f92" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:52.617282  6695 leader_election.cc:304] T 7c44c4849aa54f2b94d1f1bef9ed546f P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
W20260709 13:20:52.704857  6695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 87664.4us
I20260709 13:20:52.705130  6725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a485a995abc4807b6e511e45419f737" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:20:52.618490 12624 consensus_queue.cc:1059] T 44bde925b2e541b69890d70715b85176 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: INVALID_TERM, Last received: 15.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:20:52.707589  6799 raft_consensus.cc:1275] T bb7fa124c3bf4ef9ab65a407cb008441 P b7ab4784c7344b939bc36f639286f377 [term 16 FOLLOWER]: Refusing update from remote peer 7ba59cc884714e8aa5f3f0ecaed84cbb: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:20:52.619007 12555 raft_consensus.cc:493] T a3022224cc81473690653a83d4e99470 P b7ab4784c7344b939bc36f639286f377 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:52.708477 12555 raft_consensus.cc:3060] T a3022224cc81473690653a83d4e99470 P b7ab4784c7344b939bc36f639286f377 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:20:52.621627 12594 raft_consensus.cc:515] T 427c124d773f483294511e80fe340075 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } attrs { replace: true } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:20:52.619956  6697 leader_election.cc:304] T 9e326172347f45e99a0d482b5d8ef768 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:20:52.710286 12240 raft_consensus.cc:3060] T 9e326172347f45e99a0d482b5d8ef768 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:52.638844  7468 leader_election.cc:304] T ce4f062dcd314d43a63ca74067cb5ee3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:20:52.711759  6807 raft_consensus.cc:1240] T 3411566abe2d4c9bb4b2adfdd05e6f17 P b7ab4784c7344b939bc36f639286f377 [term 14 FOLLOWER]: Rejecting Update request from peer ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 13. Current term is 14. Ops: []
I20260709 13:20:52.590462 12271 consensus_queue.cc:1059] T 17587d6730594da4a56fa13a353232a1 P 7ba59cc884714e8aa5f3f0ecaed84cbb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: INVALID_TERM, Last received: 20.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.060s
I20260709 13:20:52.621660  6875 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53406 (request call id 2684) took 1229 ms. Trace:
I20260709 13:20:52.712648  6804 raft_consensus.cc:2468] T 711ef6523deb4cbe8ef2ba61e1c21c98 P b7ab4784c7344b939bc36f639286f377 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 19.
I20260709 13:20:52.654488  6732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44bde925b2e541b69890d70715b85176" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:20:52.713042  6875 rpcz_store.cc:276] 0709 13:20:51.392186 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:51.422089 (+ 29903us) service_pool.cc:224] Handling call
0709 13:20:52.621436 (+1199347us) spinlock_profiling.cc:243] Waited 989 ms on lock 0x7b54000a64d4. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f9ae2fa 00007fcc1496fb17 00007fcc0deea6d4 00007fcc0deea662 00007fcc0deea591 00007fcc0deea50c 00007fcc0dee97c2 00007fcc0dce548c 00007fcc0dce48c6 00007fcc0dce426f
0709 13:20:52.621590 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2274645376}
I20260709 13:20:52.696789  6729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbdf895bba214ff68685a24fd17dfb5d" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 15 candidate_status { last_received { term: 14 index: 6 } } ignore_live_leader: true dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
W20260709 13:20:52.713654  6697 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 93775.5us
I20260709 13:20:52.714227  6729 raft_consensus.cc:3060] T dbdf895bba214ff68685a24fd17dfb5d P ccd8a4c3bfe3413cb2ae219b09aea832 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:52.697973  6726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4db81d9d329422bb3b4160ca4ac2d1d" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:20:52.627857  6772 leader_election.cc:304] T 427c124d773f483294511e80fe340075 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:20:52.704114 12311 raft_consensus.cc:3060] T be1a92657f494cac8dd227d152f50151 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:52.711460 12594 leader_election.cc:290] T 427c124d773f483294511e80fe340075 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 15 election: Requested vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:20:52.705375 11937 raft_consensus.cc:493] T 9b3759de40694069b13c0f8bd40e5709 P cd75a17ab2604397adab03bb8b5fd75c [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:20:52.630797 12551 leader_election.cc:290] T ab432e62819d499eaaf3dd55481dd930 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 18 election: Requested vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:52.741700  6725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e31b9971c15848dea59d4d4130141d9e" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:20:52.712482  6723 raft_consensus.cc:1240] T 427c124d773f483294511e80fe340075 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 15 FOLLOWER]: Rejecting Update request from peer 7ba59cc884714e8aa5f3f0ecaed84cbb for earlier term 14. Current term is 15. Ops: []
W20260709 13:20:52.712301  7468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 73558.2us
I20260709 13:20:52.743396  7468 leader_election.cc:304] T bb3d8792045a4583ae2e965b1350a5b4 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:20:52.744817  7468 leader_election.cc:304] T 3fa34c08b205435dba97346991aa1f92 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:20:52.712371  6881 raft_consensus.cc:2468] T 711ef6523deb4cbe8ef2ba61e1c21c98 P cd75a17ab2604397adab03bb8b5fd75c [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 19.
I20260709 13:20:52.612596  6801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d65025eea89441290d85dd053810e31" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:20:52.746182  6801 raft_consensus.cc:3060] T 3d65025eea89441290d85dd053810e31 P b7ab4784c7344b939bc36f639286f377 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:52.715508  6697 leader_election.cc:304] T c4db81d9d329422bb3b4160ca4ac2d1d P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
W20260709 13:20:52.716202  6772 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.68:45071, user_credentials={real_user=slave}} blocked reactor thread for 88412.5us
I20260709 13:20:52.747465  6772 leader_election.cc:304] T 7ba5dac66ab5497e9e336f2a3c28cda5 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, cd75a17ab2604397adab03bb8b5fd75c
W20260709 13:20:52.617128 12628 log.cc:927] Time spent T 22ccee1b570c4ad3a57bd7aec085b1b4 P ccd8a4c3bfe3413cb2ae219b09aea832: Append to log took a long time: real 0.147s	user 0.004s	sys 0.000s
W20260709 13:20:52.719620  6847 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:52.749217  6806 raft_consensus.cc:2468] T 4275cf08e63345f993bce8664eada830 P b7ab4784c7344b939bc36f639286f377 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 14.
I20260709 13:20:52.719022  6800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4b8bd455d5a47c18a1380839c6e0d61" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 17 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:20:52.687971 12432 tablet_bootstrap.cc:492] T 95a75bfe094d4bdc963aba3f08dfcd25 P 7ba59cc884714e8aa5f3f0ecaed84cbb: Bootstrap replayed 1/1 log segments. Stats: ops{read=8 overwritten=1 applied=7 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:20:52.756261 12432 tablet_bootstrap.cc:492] T 95a75bfe094d4bdc963aba3f08dfcd25 P 7ba59cc884714e8aa5f3f0ecaed84cbb: Bootstrap complete.
I20260709 13:20:52.756261 12490 raft_consensus.cc:2749] T 3fa34c08b205435dba97346991aa1f92 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:20:52.757222 12432 ts_tablet_manager.cc:1403] T 95a75bfe094d4bdc963aba3f08dfcd25 P 7ba59cc884714e8aa5f3f0ecaed84cbb: Time spent bootstrapping tablet: real 0.244s	user 0.034s	sys 0.005s
I20260709 13:20:52.723994  6730 raft_consensus.cc:2468] T 90d42e216d9741e190bca19a781291fd P ccd8a4c3bfe3413cb2ae219b09aea832 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 16.
I20260709 13:20:52.725062  6732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a75bfe094d4bdc963aba3f08dfcd25" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:52.728605 11937 raft_consensus.cc:515] T 9b3759de40694069b13c0f8bd40e5709 P cd75a17ab2604397adab03bb8b5fd75c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:52.728996 12345 consensus_queue.cc:1059] T b3f13b31a1f84f0d89d007eadd57924c P 7ba59cc884714e8aa5f3f0ecaed84cbb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: INVALID_TERM, Last received: 13.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:20:52.726332 12478 raft_consensus.cc:2749] T 427c124d773f483294511e80fe340075 P b7ab4784c7344b939bc36f639286f377 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:20:52.733901 12249 raft_consensus.cc:3055] T 17587d6730594da4a56fa13a353232a1 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:20:52.769079 12624 raft_consensus.cc:2749] T c4db81d9d329422bb3b4160ca4ac2d1d P ccd8a4c3bfe3413cb2ae219b09aea832 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:20:52.769368 12249 raft_consensus.cc:740] T 17587d6730594da4a56fa13a353232a1 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 7ba59cc884714e8aa5f3f0ecaed84cbb, State: Running, Role: LEADER
I20260709 13:20:52.705243 12227 raft_consensus.cc:2804] T 7c44c4849aa54f2b94d1f1bef9ed546f P ccd8a4c3bfe3413cb2ae219b09aea832 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:20:52.770200 12227 raft_consensus.cc:493] T 7c44c4849aa54f2b94d1f1bef9ed546f P ccd8a4c3bfe3413cb2ae219b09aea832 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:52.770640 12227 raft_consensus.cc:3060] T 7c44c4849aa54f2b94d1f1bef9ed546f P ccd8a4c3bfe3413cb2ae219b09aea832 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:20:52.770430 12249 consensus_queue.cc:260] T 17587d6730594da4a56fa13a353232a1 P 7ba59cc884714e8aa5f3f0ecaed84cbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 20.14, Last appended by leader: 14, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:20:52.772053 12249 raft_consensus.cc:3060] T 17587d6730594da4a56fa13a353232a1 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:20:52.735797 12267 consensus_queue.cc:1048] T bb7fa124c3bf4ef9ab65a407cb008441 P 7ba59cc884714e8aa5f3f0ecaed84cbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:20:52.738006 12581 raft_consensus.cc:515] T 3fa34c08b205435dba97346991aa1f92 P cd75a17ab2604397adab03bb8b5fd75c [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:20:52.777259 12552 raft_consensus.cc:493] T 22ccee1b570c4ad3a57bd7aec085b1b4 P cd75a17ab2604397adab03bb8b5fd75c [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:20:52.777829 12552 raft_consensus.cc:515] T 22ccee1b570c4ad3a57bd7aec085b1b4 P cd75a17ab2604397adab03bb8b5fd75c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:52.739645  6798 raft_consensus.cc:2468] T b3f13b31a1f84f0d89d007eadd57924c P b7ab4784c7344b939bc36f639286f377 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 14.
I20260709 13:20:52.725059 12603 raft_consensus.cc:2749] T ce4f062dcd314d43a63ca74067cb5ee3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:20:52.780622  6878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b8cacb381b746da8d0049b0a83b41dd" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:20:52.780820  6877 raft_consensus.cc:1275] T bb7fa124c3bf4ef9ab65a407cb008441 P cd75a17ab2604397adab03bb8b5fd75c [term 16 FOLLOWER]: Refusing update from remote peer 7ba59cc884714e8aa5f3f0ecaed84cbb: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:20:52.781539  6878 raft_consensus.cc:2410] T 4b8cacb381b746da8d0049b0a83b41dd P cd75a17ab2604397adab03bb8b5fd75c [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 7ba59cc884714e8aa5f3f0ecaed84cbb for term 17 because replica has last-logged OpId of term: 16 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 12.
I20260709 13:20:52.782003  6844 leader_election.cc:304] T 4b8cacb381b746da8d0049b0a83b41dd P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:20:52.782418 12544 raft_consensus.cc:493] T 34f36d59d88f40fe8a2805e604fc6c0a P cd75a17ab2604397adab03bb8b5fd75c [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:52.782701 12581 leader_election.cc:290] T 3fa34c08b205435dba97346991aa1f92 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 20 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:20:52.783032 12544 raft_consensus.cc:515] T 34f36d59d88f40fe8a2805e604fc6c0a P cd75a17ab2604397adab03bb8b5fd75c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:52.784524  6728 raft_consensus.cc:1275] T e77e330a82df4b43a745d57a68f6f057 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 17 FOLLOWER]: Refusing update from remote peer cd75a17ab2604397adab03bb8b5fd75c: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 13:20:52.785266 12544 leader_election.cc:290] T 34f36d59d88f40fe8a2805e604fc6c0a P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:20:52.776391 12561 raft_consensus.cc:493] T de3186201e1a40d0b335eeb8b4e256e0 P cd75a17ab2604397adab03bb8b5fd75c [term 16 FOLLOWER]: Starting pre-election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:20:52.786042 12370 raft_consensus.cc:493] T 8c7f33e544204fbaac4078e3e83bbf4e P ccd8a4c3bfe3413cb2ae219b09aea832 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:52.786473 12561 raft_consensus.cc:515] T de3186201e1a40d0b335eeb8b4e256e0 P cd75a17ab2604397adab03bb8b5fd75c [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:52.786653 12370 raft_consensus.cc:515] T 8c7f33e544204fbaac4078e3e83bbf4e P ccd8a4c3bfe3413cb2ae219b09aea832 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
W20260709 13:20:52.748185  7466 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:52.753531  6772 leader_election.cc:304] T 404190ce4ce94cecbfcb6ea9d1dd8626 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:20:52.754400  6724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3022224cc81473690653a83d4e99470" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:20:52.754833 12422 raft_consensus.cc:3055] T 44bde925b2e541b69890d70715b85176 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:20:52.758807  6732 raft_consensus.cc:2468] T 95a75bfe094d4bdc963aba3f08dfcd25 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 14.
W20260709 13:20:52.760609  6770 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 426673us
I20260709 13:20:52.793320  6770 leader_election.cc:304] T 1bf4668eeb70467fb3dc5a0289233b3c P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
W20260709 13:20:52.763192  6697 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 47790.9us
I20260709 13:20:52.793701  6801 raft_consensus.cc:2468] T 3d65025eea89441290d85dd053810e31 P b7ab4784c7344b939bc36f639286f377 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 17.
I20260709 13:20:52.794322  6697 leader_election.cc:304] T 90d42e216d9741e190bca19a781291fd P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377
I20260709 13:20:52.766597 12551 consensus_queue.cc:1059] T 3411566abe2d4c9bb4b2adfdd05e6f17 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: INVALID_TERM, Last received: 13.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:20:52.767661 11937 leader_election.cc:290] T 9b3759de40694069b13c0f8bd40e5709 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:20:52.775883 12345 raft_consensus.cc:3055] T b3f13b31a1f84f0d89d007eadd57924c P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:20:52.761581  6695 leader_election.cc:304] T 711ef6523deb4cbe8ef2ba61e1c21c98 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
I20260709 13:20:52.776331 12558 raft_consensus.cc:493] T 4d9def8b32fd443aa94ab1420b06837b P cd75a17ab2604397adab03bb8b5fd75c [term 15 FOLLOWER]: Starting pre-election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:20:52.761930 12492 raft_consensus.cc:2749] T 7ba5dac66ab5497e9e336f2a3c28cda5 P b7ab4784c7344b939bc36f639286f377 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:20:52.786787 12311 raft_consensus.cc:515] T be1a92657f494cac8dd227d152f50151 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:20:52.789690  6844 leader_election.cc:304] T 34f36d59d88f40fe8a2805e604fc6c0a P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:20:52.790573  6772 leader_election.cc:304] T 1528ab62b6fe4e3099d08f141afee116 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:20:52.748858 12271 raft_consensus.cc:2749] T bb3d8792045a4583ae2e965b1350a5b4 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:20:52.791718  6730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b3759de40694069b13c0f8bd40e5709" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:52.842000  6730 raft_consensus.cc:2468] T 9b3759de40694069b13c0f8bd40e5709 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 13.
I20260709 13:20:52.722121 12543 raft_consensus.cc:515] T d33d5ee8ef6f415593d8df52063161ad P cd75a17ab2604397adab03bb8b5fd75c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:52.801651  6697 leader_election.cc:304] T 713b5728a197487c9300b310ab94e5a3 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
W20260709 13:20:52.788995 12635 log.cc:927] Time spent T bb3d8792045a4583ae2e965b1350a5b4 P ccd8a4c3bfe3413cb2ae219b09aea832: Append to log took a long time: real 0.061s	user 0.000s	sys 0.001s
I20260709 13:20:52.832072 12159 consensus_queue.cc:1048] T d33d5ee8ef6f415593d8df52063161ad P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:20:52.836337 12561 leader_election.cc:290] T de3186201e1a40d0b335eeb8b4e256e0 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:20:52.843842 12535 raft_consensus.cc:2804] T 711ef6523deb4cbe8ef2ba61e1c21c98 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:20:52.852742 12563 raft_consensus.cc:2804] T 34f36d59d88f40fe8a2805e604fc6c0a P cd75a17ab2604397adab03bb8b5fd75c [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:20:52.852939 12535 raft_consensus.cc:697] T 711ef6523deb4cbe8ef2ba61e1c21c98 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 19 LEADER]: Becoming Leader. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
I20260709 13:20:52.853610 12563 raft_consensus.cc:697] T 34f36d59d88f40fe8a2805e604fc6c0a P cd75a17ab2604397adab03bb8b5fd75c [term 15 LEADER]: Becoming Leader. State: Replica: cd75a17ab2604397adab03bb8b5fd75c, State: Running, Role: LEADER
I20260709 13:20:52.854063 12535 consensus_queue.cc:237] T 711ef6523deb4cbe8ef2ba61e1c21c98 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 17.10, Last appended by leader: 10, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:52.854887 12563 consensus_queue.cc:237] T 34f36d59d88f40fe8a2805e604fc6c0a P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:52.832664 12246 consensus_queue.cc:1048] T f4b8bd455d5a47c18a1380839c6e0d61 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:20:52.845373 12581 raft_consensus.cc:493] T f58dc08b12a2494bb9a1372837970ca2 P cd75a17ab2604397adab03bb8b5fd75c [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:52.857131 12581 raft_consensus.cc:515] T f58dc08b12a2494bb9a1372837970ca2 P cd75a17ab2604397adab03bb8b5fd75c [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:52.833449 12620 consensus_queue.cc:1048] T 8c7f33e544204fbaac4078e3e83bbf4e P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:20:52.858106 12432 raft_consensus.cc:359] T 95a75bfe094d4bdc963aba3f08dfcd25 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 13 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } attrs { replace: true } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: NON_VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: true } }
I20260709 13:20:52.859009 12432 raft_consensus.cc:740] T 95a75bfe094d4bdc963aba3f08dfcd25 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 13 LEARNER]: Becoming Follower/Learner. State: Replica: 7ba59cc884714e8aa5f3f0ecaed84cbb, State: Initialized, Role: LEARNER
I20260709 13:20:52.835211  6770 leader_election.cc:304] T e77e330a82df4b43a745d57a68f6f057 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
W20260709 13:20:52.836308  6845 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:52.837117  6729 raft_consensus.cc:2468] T dbdf895bba214ff68685a24fd17dfb5d P ccd8a4c3bfe3413cb2ae219b09aea832 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 15.
I20260709 13:20:52.779884 12552 leader_election.cc:290] T 22ccee1b570c4ad3a57bd7aec085b1b4 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:20:52.795840 12478 raft_consensus.cc:2749] T 404190ce4ce94cecbfcb6ea9d1dd8626 P b7ab4784c7344b939bc36f639286f377 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:20:52.840452  6695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 78946.9us
I20260709 13:20:52.861372  6695 leader_election.cc:304] T 4275cf08e63345f993bce8664eada830 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:20:52.862881  6695 leader_election.cc:304] T b3f13b31a1f84f0d89d007eadd57924c P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb
I20260709 13:20:52.864261 12352 raft_consensus.cc:2804] T e77e330a82df4b43a745d57a68f6f057 P b7ab4784c7344b939bc36f639286f377 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:20:52.864723 12352 raft_consensus.cc:493] T e77e330a82df4b43a745d57a68f6f057 P b7ab4784c7344b939bc36f639286f377 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:52.865078 12352 raft_consensus.cc:3060] T e77e330a82df4b43a745d57a68f6f057 P b7ab4784c7344b939bc36f639286f377 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:20:52.865130 12227 raft_consensus.cc:515] T 7c44c4849aa54f2b94d1f1bef9ed546f P ccd8a4c3bfe3413cb2ae219b09aea832 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:52.866099 12484 consensus_queue.cc:1048] T 90d42e216d9741e190bca19a781291fd P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:20:52.868624 12613 raft_consensus.cc:2804] T 4275cf08e63345f993bce8664eada830 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:20:52.869199 12613 raft_consensus.cc:697] T 4275cf08e63345f993bce8664eada830 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 14 LEADER]: Becoming Leader. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
I20260709 13:20:52.869102 12484 consensus_queue.cc:1059] T ab432e62819d499eaaf3dd55481dd930 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: INVALID_TERM, Last received: 17.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:20:52.870162 12159 raft_consensus.cc:3055] T ab432e62819d499eaaf3dd55481dd930 P b7ab4784c7344b939bc36f639286f377 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:20:52.870656 12624 raft_consensus.cc:2804] T b3f13b31a1f84f0d89d007eadd57924c P ccd8a4c3bfe3413cb2ae219b09aea832 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:20:52.871064 12159 raft_consensus.cc:740] T ab432e62819d499eaaf3dd55481dd930 P b7ab4784c7344b939bc36f639286f377 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
I20260709 13:20:52.871317 12624 raft_consensus.cc:697] T b3f13b31a1f84f0d89d007eadd57924c P ccd8a4c3bfe3413cb2ae219b09aea832 [term 14 LEADER]: Becoming Leader. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
I20260709 13:20:52.792470 12422 raft_consensus.cc:740] T 44bde925b2e541b69890d70715b85176 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
I20260709 13:20:52.872160 12159 consensus_queue.cc:260] T ab432e62819d499eaaf3dd55481dd930 P b7ab4784c7344b939bc36f639286f377 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.9, Last appended by leader: 9, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:52.870862 12561 raft_consensus.cc:493] T 853ac0a8cbd64ce99457f170216d4d0f P cd75a17ab2604397adab03bb8b5fd75c [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:20:52.872720 12422 consensus_queue.cc:260] T 44bde925b2e541b69890d70715b85176 P ccd8a4c3bfe3413cb2ae219b09aea832 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:52.863977  6695 leader_election.cc:304] T 3d65025eea89441290d85dd053810e31 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
I20260709 13:20:52.874290 12517 raft_consensus.cc:2804] T 3d65025eea89441290d85dd053810e31 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:20:52.874346 12422 raft_consensus.cc:3060] T 44bde925b2e541b69890d70715b85176 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:52.874917 12517 raft_consensus.cc:697] T 3d65025eea89441290d85dd053810e31 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 17 LEADER]: Becoming Leader. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
I20260709 13:20:52.847105  7494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fa34c08b205435dba97346991aa1f92" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 20 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb"
I20260709 13:20:52.875612  7494 raft_consensus.cc:3060] T 3fa34c08b205435dba97346991aa1f92 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:20:52.875797 12616 raft_consensus.cc:3060] T d8cee0accdb8499c86d4414b72565a38 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:52.876163 12246 raft_consensus.cc:2749] T 1528ab62b6fe4e3099d08f141afee116 P b7ab4784c7344b939bc36f639286f377 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:20:52.829898 12544 raft_consensus.cc:2749] T 4b8cacb381b746da8d0049b0a83b41dd P cd75a17ab2604397adab03bb8b5fd75c [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:20:52.828299 12345 raft_consensus.cc:740] T b3f13b31a1f84f0d89d007eadd57924c P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 7ba59cc884714e8aa5f3f0ecaed84cbb, State: Running, Role: LEADER
I20260709 13:20:52.879890  6723 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49744 (request call id 600) took 1127 ms. Trace:
I20260709 13:20:52.848711  5625 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:20:52.845084 12492 consensus_queue.cc:1048] T f58dc08b12a2494bb9a1372837970ca2 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.005s
I20260709 13:20:52.880309  6723 rpcz_store.cc:276] 0709 13:20:51.752638 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:52.079166 (+326528us) service_pool.cc:224] Handling call
0709 13:20:52.633583 (+554417us) spinlock_profiling.cc:243] Waited 1.78 ms on lock 0x7b5800000c98. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0c745db1 00007fcc0c885b71 00007fcc0c885a22 00007fcc1579ec09 00007fcc148f8ee0 00007fcc149c20ab 00007fcc149c2131 00007fcc14983fc0 00007fcc1496e929 00007fcc1496e3d2 00007fcc0dee5bd4
0709 13:20:52.633810 (+   227us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:52.745633 (+111823us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:52.879650 (+134017us) spinlock_profiling.cc:243] Waited 78.5 ms on lock 0x7b5400395dd4. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f9aae01 00007fcc0f9a983e 00007fcc1496e419 00007fcc0dee5bd4 00007fcc0dee5b62 00007fcc0dee5a91 00007fcc0dee5a0c 00007fcc0dee4cc2 00007fcc0dce548c 00007fcc0dce48c6
0709 13:20:52.879833 (+   183us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":184546560}
I20260709 13:20:52.846051 12240 raft_consensus.cc:2749] T 9e326172347f45e99a0d482b5d8ef768 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:20:52.884869  6728 raft_consensus.cc:1275] T 9e326172347f45e99a0d482b5d8ef768 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 13 FOLLOWER]: Refusing update from remote peer cd75a17ab2604397adab03bb8b5fd75c: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:20:52.886195  6803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "427c124d773f483294511e80fe340075" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:20:52.856310 12497 raft_consensus.cc:493] T 24ee15416e3145beaa1b8183453729a3 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader cd75a17ab2604397adab03bb8b5fd75c)
I20260709 13:20:52.888368 12497 raft_consensus.cc:515] T 24ee15416e3145beaa1b8183453729a3 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:20:52.889539 12543 leader_election.cc:290] T d33d5ee8ef6f415593d8df52063161ad P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:20:52.873251 12561 raft_consensus.cc:515] T 853ac0a8cbd64ce99457f170216d4d0f P cd75a17ab2604397adab03bb8b5fd75c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:52.912600  6730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a92dd554674067a83a9cb68c4773f2" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:20:52.839648  6802 raft_consensus.cc:2468] T 34f36d59d88f40fe8a2805e604fc6c0a P b7ab4784c7344b939bc36f639286f377 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 15.
I20260709 13:20:52.914069 12561 leader_election.cc:290] T 853ac0a8cbd64ce99457f170216d4d0f P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
W20260709 13:20:52.874723  6772 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.68:45071, user_credentials={real_user=slave}} blocked reactor thread for 84195.4us
I20260709 13:20:52.840857 12558 raft_consensus.cc:515] T 4d9def8b32fd443aa94ab1420b06837b P cd75a17ab2604397adab03bb8b5fd75c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:52.915989  6772 leader_election.cc:304] T b3f13b31a1f84f0d89d007eadd57924c P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:20:52.917382  6804 raft_consensus.cc:1240] T b56bf91d90824c959e21e0cee5ba1816 P b7ab4784c7344b939bc36f639286f377 [term 16 FOLLOWER]: Rejecting Update request from peer cd75a17ab2604397adab03bb8b5fd75c for earlier term 15. Current term is 16. Ops: [15.10-15.10]
I20260709 13:20:52.917665 12558 leader_election.cc:290] T 4d9def8b32fd443aa94ab1420b06837b P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:20:52.859233 12581 leader_election.cc:290] T f58dc08b12a2494bb9a1372837970ca2 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:20:52.875865 12517 consensus_queue.cc:237] T 3d65025eea89441290d85dd053810e31 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
W20260709 13:20:52.918946  6773 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:52.888664  6805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c7f33e544204fbaac4078e3e83bbf4e" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:52.895251 12603 raft_consensus.cc:493] T 404190ce4ce94cecbfcb6ea9d1dd8626 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 14 FOLLOWER]: Starting pre-election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:20:52.872323 12624 consensus_queue.cc:237] T b3f13b31a1f84f0d89d007eadd57924c P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:20:52.896701  6806 raft_consensus.cc:1240] T 07a92dd554674067a83a9cb68c4773f2 P b7ab4784c7344b939bc36f639286f377 [term 14 FOLLOWER]: Rejecting Update request from peer ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 13. Current term is 14. Ops: []
I20260709 13:20:52.880316 12345 consensus_queue.cc:260] T b3f13b31a1f84f0d89d007eadd57924c P 7ba59cc884714e8aa5f3f0ecaed84cbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:20:52.792228 12610 raft_consensus.cc:493] T bd6869f07b5a4885a0b99fbe60c3b175 P cd75a17ab2604397adab03bb8b5fd75c [term 16 FOLLOWER]: Starting pre-election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:20:52.899030  6729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c44c4849aa54f2b94d1f1bef9ed546f" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 19 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
W20260709 13:20:52.933730  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 144090us
I20260709 13:20:52.798736 12568 raft_consensus.cc:2749] T 1bf4668eeb70467fb3dc5a0289233b3c P b7ab4784c7344b939bc36f639286f377 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:20:52.870280 12613 consensus_queue.cc:237] T 4275cf08e63345f993bce8664eada830 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:52.900600 12602 raft_consensus.cc:493] T f3f9c2e2bf644115957398fe4c9459db P ccd8a4c3bfe3413cb2ae219b09aea832 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader cd75a17ab2604397adab03bb8b5fd75c)
I20260709 13:20:52.943382  7500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8cee0accdb8499c86d4414b72565a38" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb"
I20260709 13:20:52.902987 12497 leader_election.cc:290] T 24ee15416e3145beaa1b8183453729a3 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:20:52.904495  6732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d9def8b32fd443aa94ab1420b06837b" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:52.904969 12249 consensus_queue.cc:1059] T 427c124d773f483294511e80fe340075 P 7ba59cc884714e8aa5f3f0ecaed84cbb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } attrs { replace: true }, Status: INVALID_TERM, Last received: 14.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:20:52.905881  6726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e326172347f45e99a0d482b5d8ef768" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:20:52.950268  6802 raft_consensus.cc:1240] T 3d65025eea89441290d85dd053810e31 P b7ab4784c7344b939bc36f639286f377 [term 17 FOLLOWER]: Rejecting Update request from peer cd75a17ab2604397adab03bb8b5fd75c for earlier term 16. Current term is 17. Ops: []
I20260709 13:20:52.951323  6726 raft_consensus.cc:3060] T 9e326172347f45e99a0d482b5d8ef768 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:52.906791  6724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be1a92657f494cac8dd227d152f50151" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:20:52.907254  6727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f03d0dbf16864ca4bc1bb5e4c0334c0f" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:52.952739  6727 raft_consensus.cc:2468] T f03d0dbf16864ca4bc1bb5e4c0334c0f P ccd8a4c3bfe3413cb2ae219b09aea832 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 16.
I20260709 13:20:52.910215  6723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17587d6730594da4a56fa13a353232a1" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:20:52.904496 12370 leader_election.cc:290] T 8c7f33e544204fbaac4078e3e83bbf4e P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:52.898324  6798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be1a92657f494cac8dd227d152f50151" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:20:52.799154  6725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fa34c08b205435dba97346991aa1f92" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 20 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:20:52.954186  6798 raft_consensus.cc:2393] T be1a92657f494cac8dd227d152f50151 P b7ab4784c7344b939bc36f639286f377 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in current term 17: Already voted for candidate b7ab4784c7344b939bc36f639286f377 in this term.
I20260709 13:20:52.898804 12311 leader_election.cc:290] T be1a92657f494cac8dd227d152f50151 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 17 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:20:52.922411  6875 raft_consensus.cc:1275] T f58dc08b12a2494bb9a1372837970ca2 P cd75a17ab2604397adab03bb8b5fd75c [term 18 FOLLOWER]: Refusing update from remote peer b7ab4784c7344b939bc36f639286f377: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 18 index: 10. (term mismatch)
I20260709 13:20:52.966668  6875 pending_rounds.cc:85] T f58dc08b12a2494bb9a1372837970ca2 P cd75a17ab2604397adab03bb8b5fd75c: Aborting all ops after (but not including) 9
I20260709 13:20:52.966972  6875 pending_rounds.cc:107] T f58dc08b12a2494bb9a1372837970ca2 P cd75a17ab2604397adab03bb8b5fd75c: Aborting uncommitted NO_OP operation due to leader change: 17.10
I20260709 13:20:52.967229  6875 raft_consensus.cc:2889] T f58dc08b12a2494bb9a1372837970ca2 P cd75a17ab2604397adab03bb8b5fd75c [term 18 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:20:52.846009  6801 raft_consensus.cc:1240] T b3f13b31a1f84f0d89d007eadd57924c P b7ab4784c7344b939bc36f639286f377 [term 14 FOLLOWER]: Rejecting Update request from peer 7ba59cc884714e8aa5f3f0ecaed84cbb for earlier term 13. Current term is 14. Ops: []
W20260709 13:20:52.924017  7468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 179259us
I20260709 13:20:52.925585  6877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c44c4849aa54f2b94d1f1bef9ed546f" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 19 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:52.972149  6772 leader_election.cc:304] T 44bde925b2e541b69890d70715b85176 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:20:52.972820  6877 raft_consensus.cc:2410] T 7c44c4849aa54f2b94d1f1bef9ed546f P cd75a17ab2604397adab03bb8b5fd75c [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7ab4784c7344b939bc36f639286f377 for term 19 because replica has last-logged OpId of term: 17 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 11.
I20260709 13:20:52.926618  6879 raft_consensus.cc:1240] T c4db81d9d329422bb3b4160ca4ac2d1d P cd75a17ab2604397adab03bb8b5fd75c [term 16 FOLLOWER]: Rejecting Update request from peer b7ab4784c7344b939bc36f639286f377 for earlier term 15. Current term is 16. Ops: []
I20260709 13:20:52.965621 12345 raft_consensus.cc:3060] T b3f13b31a1f84f0d89d007eadd57924c P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:52.974753 12249 raft_consensus.cc:3055] T 427c124d773f483294511e80fe340075 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:20:52.975180 12249 raft_consensus.cc:740] T 427c124d773f483294511e80fe340075 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 7ba59cc884714e8aa5f3f0ecaed84cbb, State: Running, Role: LEADER
I20260709 13:20:52.936777 12603 raft_consensus.cc:515] T 404190ce4ce94cecbfcb6ea9d1dd8626 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:20:52.969149 12478 raft_consensus.cc:2749] T b3f13b31a1f84f0d89d007eadd57924c P b7ab4784c7344b939bc36f639286f377 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:20:52.979693 12603 leader_election.cc:290] T 404190ce4ce94cecbfcb6ea9d1dd8626 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:20:52.928709  6730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f9c2e2bf644115957398fe4c9459db" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 17 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:52.801877 12547 raft_consensus.cc:493] T bd6869f07b5a4885a0b99fbe60c3b175 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:52.798478 12551 raft_consensus.cc:3055] T 3411566abe2d4c9bb4b2adfdd05e6f17 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:20:52.933032  7494 raft_consensus.cc:2468] T 3fa34c08b205435dba97346991aa1f92 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 20.
W20260709 13:20:52.933585  6697 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 132233us
I20260709 13:20:52.800846 12606 raft_consensus.cc:2804] T 90d42e216d9741e190bca19a781291fd P ccd8a4c3bfe3413cb2ae219b09aea832 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:20:52.791149  6880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24ee15416e3145beaa1b8183453729a3" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:52.934485  7495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17587d6730594da4a56fa13a353232a1" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb"
I20260709 13:20:52.934553  6729 raft_consensus.cc:2393] T 7c44c4849aa54f2b94d1f1bef9ed546f P ccd8a4c3bfe3413cb2ae219b09aea832 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7ab4784c7344b939bc36f639286f377 in current term 19: Already voted for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in this term.
I20260709 13:20:52.936725  6806 raft_consensus.cc:1240] T 9e326172347f45e99a0d482b5d8ef768 P b7ab4784c7344b939bc36f639286f377 [term 14 FOLLOWER]: Rejecting Update request from peer cd75a17ab2604397adab03bb8b5fd75c for earlier term 13. Current term is 14. Ops: []
I20260709 13:20:52.938839  6876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e326172347f45e99a0d482b5d8ef768" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:20:53.019665  6846 leader_election.cc:304] T 3fa34c08b205435dba97346991aa1f92 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:20:52.938866  6874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d9def8b32fd443aa94ab1420b06837b" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:52.961619  6844 leader_election.cc:400] T a1704639a875409b9959353527b3fd68 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 16 election: Vote denied by peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391) with higher term. Message: Invalid argument: T a1704639a875409b9959353527b3fd68 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c for earlier term 16. Current term is 17.
I20260709 13:20:52.963737  6802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90d42e216d9741e190bca19a781291fd" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:53.020709  6874 raft_consensus.cc:2468] T 4d9def8b32fd443aa94ab1420b06837b P cd75a17ab2604397adab03bb8b5fd75c [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 15.
I20260709 13:20:53.022095  6802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b3759de40694069b13c0f8bd40e5709" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:52.965143  6804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5be3a11b23d4ea9b08300a2789821c7" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:20:53.024501  6804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a485a995abc4807b6e511e45419f737" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:20:52.965885  6803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44bde925b2e541b69890d70715b85176" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:20:52.936995 12610 raft_consensus.cc:515] T bd6869f07b5a4885a0b99fbe60c3b175 P cd75a17ab2604397adab03bb8b5fd75c [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:52.985411 12227 leader_election.cc:290] T 7c44c4849aa54f2b94d1f1bef9ed546f P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 19 election: Requested vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:53.028174 12606 raft_consensus.cc:493] T 90d42e216d9741e190bca19a781291fd P ccd8a4c3bfe3413cb2ae219b09aea832 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:53.053897 12606 raft_consensus.cc:3060] T 90d42e216d9741e190bca19a781291fd P ccd8a4c3bfe3413cb2ae219b09aea832 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:53.060896  6874 raft_consensus.cc:1240] T dbdf895bba214ff68685a24fd17dfb5d P cd75a17ab2604397adab03bb8b5fd75c [term 15 FOLLOWER]: Rejecting Update request from peer b7ab4784c7344b939bc36f639286f377 for earlier term 14. Current term is 15. Ops: []
I20260709 13:20:52.985816 12555 raft_consensus.cc:515] T a3022224cc81473690653a83d4e99470 P b7ab4784c7344b939bc36f639286f377 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:52.957171 12602 raft_consensus.cc:515] T f3f9c2e2bf644115957398fe4c9459db P ccd8a4c3bfe3413cb2ae219b09aea832 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:52.988297 12340 raft_consensus.cc:2749] T 44bde925b2e541b69890d70715b85176 P b7ab4784c7344b939bc36f639286f377 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:20:53.064927 12602 leader_election.cc:290] T f3f9c2e2bf644115957398fe4c9459db P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:52.936983 12608 raft_consensus.cc:2749] T 713b5728a197487c9300b310ab94e5a3 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:20:52.989878  6872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8cee0accdb8499c86d4414b72565a38" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:20:52.991135  6772 leader_election.cc:304] T 4f00a2e87e56452083b759f60d461ee3 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb
I20260709 13:20:52.859757 12432 consensus_queue.cc:260] T 95a75bfe094d4bdc963aba3f08dfcd25 P 7ba59cc884714e8aa5f3f0ecaed84cbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } attrs { replace: true } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: NON_VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: true } }
I20260709 13:20:53.066608  6730 raft_consensus.cc:2410] T f3f9c2e2bf644115957398fe4c9459db P ccd8a4c3bfe3413cb2ae219b09aea832 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7ab4784c7344b939bc36f639286f377 for term 17 because replica has last-logged OpId of term: 15 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 8.
W20260709 13:20:53.066648  6772 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 75627us
I20260709 13:20:53.069119 12432 ts_tablet_manager.cc:1434] T 95a75bfe094d4bdc963aba3f08dfcd25 P 7ba59cc884714e8aa5f3f0ecaed84cbb: Time spent starting tablet: real 0.312s	user 0.004s	sys 0.006s
I20260709 13:20:53.069671 12631 raft_consensus.cc:2804] T 4f00a2e87e56452083b759f60d461ee3 P b7ab4784c7344b939bc36f639286f377 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:20:53.070366 12631 raft_consensus.cc:493] T 4f00a2e87e56452083b759f60d461ee3 P b7ab4784c7344b939bc36f639286f377 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 7ba59cc884714e8aa5f3f0ecaed84cbb)
I20260709 13:20:53.070914 12631 raft_consensus.cc:3060] T 4f00a2e87e56452083b759f60d461ee3 P b7ab4784c7344b939bc36f639286f377 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:20:52.938685 12159 raft_consensus.cc:3060] T ab432e62819d499eaaf3dd55481dd930 P b7ab4784c7344b939bc36f639286f377 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:20:52.993229  6801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a75bfe094d4bdc963aba3f08dfcd25" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:52.997085  6875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a92dd554674067a83a9cb68c4773f2" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:20:53.072608  6772 leader_election.cc:304] T f5be3a11b23d4ea9b08300a2789821c7 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
W20260709 13:20:53.000284  6624 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:51654 (request call id 84) took 19826 ms (client timeout 15000 ms). Trace:
I20260709 13:20:52.976331 12249 consensus_queue.cc:260] T 427c124d773f483294511e80fe340075 P 7ba59cc884714e8aa5f3f0ecaed84cbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } attrs { replace: true } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:20:52.973645  6807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbdf895bba214ff68685a24fd17dfb5d" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 15 candidate_status { last_received { term: 14 index: 6 } } ignore_live_leader: true dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:20:53.088801  6807 raft_consensus.cc:3055] T dbdf895bba214ff68685a24fd17dfb5d P b7ab4784c7344b939bc36f639286f377 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:20:53.089298  6807 raft_consensus.cc:740] T dbdf895bba214ff68685a24fd17dfb5d P b7ab4784c7344b939bc36f639286f377 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
I20260709 13:20:53.011355  6726 raft_consensus.cc:2468] T 9e326172347f45e99a0d482b5d8ef768 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 14.
I20260709 13:20:53.014838  6724 raft_consensus.cc:2468] T be1a92657f494cac8dd227d152f50151 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in term 17.
I20260709 13:20:52.926828  6728 raft_consensus.cc:1240] T f4b8bd455d5a47c18a1380839c6e0d61 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 17 FOLLOWER]: Rejecting Update request from peer b7ab4784c7344b939bc36f639286f377 for earlier term 16. Current term is 17. Ops: [16.8-16.8]
I20260709 13:20:53.092490  6772 leader_election.cc:304] T 3a485a995abc4807b6e511e45419f737 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:20:53.026008  6844 leader_election.cc:403] T a1704639a875409b9959353527b3fd68 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 16 election: Cancelling election due to peer responding with higher term
W20260709 13:20:53.094432  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 159768us
I20260709 13:20:53.094729  7495 raft_consensus.cc:2468] T 17587d6730594da4a56fa13a353232a1 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 21.
I20260709 13:20:53.095660  6844 leader_election.cc:304] T 95a75bfe094d4bdc963aba3f08dfcd25 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:20:53.027872  6806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e31b9971c15848dea59d4d4130141d9e" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:20:53.030628  6803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c44c4849aa54f2b94d1f1bef9ed546f" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:20:53.097148  6803 raft_consensus.cc:3060] T 7c44c4849aa54f2b94d1f1bef9ed546f P b7ab4784c7344b939bc36f639286f377 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:20:53.013377  6770 leader_election.cc:304] T f03d0dbf16864ca4bc1bb5e4c0334c0f P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
I20260709 13:20:53.018322 12551 raft_consensus.cc:740] T 3411566abe2d4c9bb4b2adfdd05e6f17 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
I20260709 13:20:53.104280 12492 raft_consensus.cc:2804] T f03d0dbf16864ca4bc1bb5e4c0334c0f P b7ab4784c7344b939bc36f639286f377 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:20:53.033092  6802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "404190ce4ce94cecbfcb6ea9d1dd8626" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
W20260709 13:20:53.033443 12566 consensus_meta.cc:287] T 7c37d41cd9164c15a6826ca62a851a69 P b7ab4784c7344b939bc36f639286f377: Time spent flushing consensus metadata: real 0.517s	user 0.008s	sys 0.000s
I20260709 13:20:53.003634 12352 raft_consensus.cc:515] T e77e330a82df4b43a745d57a68f6f057 P b7ab4784c7344b939bc36f639286f377 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } }
W20260709 13:20:53.105614  6770 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 92335.5us
I20260709 13:20:53.039454  6727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "404190ce4ce94cecbfcb6ea9d1dd8626" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:53.009387 12543 raft_consensus.cc:493] T 427c124d773f483294511e80fe340075 P cd75a17ab2604397adab03bb8b5fd75c [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 7ba59cc884714e8aa5f3f0ecaed84cbb)
I20260709 13:20:53.106948 12543 raft_consensus.cc:515] T 427c124d773f483294511e80fe340075 P cd75a17ab2604397adab03bb8b5fd75c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } attrs { replace: true } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:20:53.109791 12543 leader_election.cc:290] T 427c124d773f483294511e80fe340075 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:20:53.026959 12547 raft_consensus.cc:515] T bd6869f07b5a4885a0b99fbe60c3b175 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:53.041929  6799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3022224cc81473690653a83d4e99470" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:20:53.112526  6799 raft_consensus.cc:2393] T a3022224cc81473690653a83d4e99470 P b7ab4784c7344b939bc36f639286f377 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c in current term 18: Already voted for candidate b7ab4784c7344b939bc36f639286f377 in this term.
I20260709 13:20:52.950217 12582 consensus_queue.cc:1059] T 07a92dd554674067a83a9cb68c4773f2 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.079s
I20260709 13:20:53.046482  6876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f03d0dbf16864ca4bc1bb5e4c0334c0f" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:53.017885 12558 raft_consensus.cc:493] T d8cee0accdb8499c86d4414b72565a38 P cd75a17ab2604397adab03bb8b5fd75c [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 7ba59cc884714e8aa5f3f0ecaed84cbb)
I20260709 13:20:53.113572  6876 raft_consensus.cc:2468] T f03d0dbf16864ca4bc1bb5e4c0334c0f P cd75a17ab2604397adab03bb8b5fd75c [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 15.
I20260709 13:20:53.047971  6880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f9c2e2bf644115957398fe4c9459db" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 17 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:53.113940 12558 raft_consensus.cc:515] T d8cee0accdb8499c86d4414b72565a38 P cd75a17ab2604397adab03bb8b5fd75c [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:20:53.115058  6880 raft_consensus.cc:2410] T f3f9c2e2bf644115957398fe4c9459db P cd75a17ab2604397adab03bb8b5fd75c [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7ab4784c7344b939bc36f639286f377 for term 17 because replica has last-logged OpId of term: 15 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 8.
I20260709 13:20:53.051189  6877 raft_consensus.cc:1240] T e31b9971c15848dea59d4d4130141d9e P cd75a17ab2604397adab03bb8b5fd75c [term 14 FOLLOWER]: Rejecting Update request from peer b7ab4784c7344b939bc36f639286f377 for earlier term 13. Current term is 14. Ops: []
I20260709 13:20:53.072726  6801 raft_consensus.cc:2468] T 95a75bfe094d4bdc963aba3f08dfcd25 P b7ab4784c7344b939bc36f639286f377 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 14.
I20260709 13:20:53.103255 12478 raft_consensus.cc:3060] T 3a485a995abc4807b6e511e45419f737 P b7ab4784c7344b939bc36f639286f377 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:53.111790 12547 leader_election.cc:290] T bd6869f07b5a4885a0b99fbe60c3b175 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:53.103543 12561 raft_consensus.cc:2804] T 95a75bfe094d4bdc963aba3f08dfcd25 P cd75a17ab2604397adab03bb8b5fd75c [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:20:53.104745 12492 raft_consensus.cc:493] T f03d0dbf16864ca4bc1bb5e4c0334c0f P b7ab4784c7344b939bc36f639286f377 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:53.072897 12581 raft_consensus.cc:2804] T 3fa34c08b205435dba97346991aa1f92 P cd75a17ab2604397adab03bb8b5fd75c [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:20:53.139554  6772 leader_election.cc:304] T 4d9def8b32fd443aa94ab1420b06837b P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:20:53.119990  6872 raft_consensus.cc:3060] T d8cee0accdb8499c86d4414b72565a38 P cd75a17ab2604397adab03bb8b5fd75c [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:53.127272  7500 raft_consensus.cc:2468] T d8cee0accdb8499c86d4414b72565a38 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 17.
I20260709 13:20:53.119472  6805 raft_consensus.cc:1240] T e77e330a82df4b43a745d57a68f6f057 P b7ab4784c7344b939bc36f639286f377 [term 18 FOLLOWER]: Rejecting Update request from peer cd75a17ab2604397adab03bb8b5fd75c for earlier term 17. Current term is 18. Ops: []
I20260709 13:20:53.038755  6798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4db81d9d329422bb3b4160ca4ac2d1d" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:20:53.101526  6807 consensus_queue.cc:260] T dbdf895bba214ff68685a24fd17dfb5d P b7ab4784c7344b939bc36f639286f377 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 14.6, Last appended by leader: 6, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:53.138057  7495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "427c124d773f483294511e80fe340075" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:20:53.155471  6728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3022224cc81473690653a83d4e99470" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:20:53.119107 12552 raft_consensus.cc:2749] T a1704639a875409b9959353527b3fd68 P cd75a17ab2604397adab03bb8b5fd75c [term 17 FOLLOWER]: Leader election lost for term 16. Reason: Vote denied by peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391) with higher term. Message: Invalid argument: T a1704639a875409b9959353527b3fd68 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c for earlier term 16. Current term is 17.
I20260709 13:20:53.107010 12352 leader_election.cc:290] T e77e330a82df4b43a745d57a68f6f057 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 18 election: Requested vote from peers cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931), ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391)
W20260709 13:20:53.159384  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 61102.6us
I20260709 13:20:53.160984  6770 leader_election.cc:304] T 7c44c4849aa54f2b94d1f1bef9ed546f P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:20:53.118602 12555 leader_election.cc:290] T a3022224cc81473690653a83d4e99470 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 18 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:53.164831  6727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77e330a82df4b43a745d57a68f6f057" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:20:53.171980  6803 raft_consensus.cc:2468] T 7c44c4849aa54f2b94d1f1bef9ed546f P b7ab4784c7344b939bc36f639286f377 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 19.
I20260709 13:20:53.176283  6727 raft_consensus.cc:3060] T e77e330a82df4b43a745d57a68f6f057 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:20:53.166908  6844 leader_election.cc:304] T f03d0dbf16864ca4bc1bb5e4c0334c0f P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:20:53.173157  6772 leader_election.cc:304] T 07a92dd554674067a83a9cb68c4773f2 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:20:53.138967 12492 raft_consensus.cc:3060] T f03d0dbf16864ca4bc1bb5e4c0334c0f P b7ab4784c7344b939bc36f639286f377 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:53.134639 12345 raft_consensus.cc:493] T 1528ab62b6fe4e3099d08f141afee116 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 13 FOLLOWER]: Starting pre-election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:20:53.119252 12275 raft_consensus.cc:3060] T f5be3a11b23d4ea9b08300a2789821c7 P b7ab4784c7344b939bc36f639286f377 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:53.142865 12610 leader_election.cc:290] T bd6869f07b5a4885a0b99fbe60c3b175 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
W20260709 13:20:53.187819  7466 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:53.150956 12427 raft_consensus.cc:2804] T 4d9def8b32fd443aa94ab1420b06837b P b7ab4784c7344b939bc36f639286f377 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:20:53.195739  6724 raft_consensus.cc:1275] T 7a734b5ab7834e05a8c422208acc58b1 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 17 FOLLOWER]: Refusing update from remote peer b7ab4784c7344b939bc36f639286f377: Log matching property violated. Preceding OpId in replica: term: 13 index: 5. Preceding OpId from leader: term: 17 index: 8. (index mismatch)
I20260709 13:20:53.143250 12561 raft_consensus.cc:697] T 95a75bfe094d4bdc963aba3f08dfcd25 P cd75a17ab2604397adab03bb8b5fd75c [term 14 LEADER]: Becoming Leader. State: Replica: cd75a17ab2604397adab03bb8b5fd75c, State: Running, Role: LEADER
I20260709 13:20:53.158656 12581 raft_consensus.cc:697] T 3fa34c08b205435dba97346991aa1f92 P cd75a17ab2604397adab03bb8b5fd75c [term 20 LEADER]: Becoming Leader. State: Replica: cd75a17ab2604397adab03bb8b5fd75c, State: Running, Role: LEADER
I20260709 13:20:53.205493  6844 leader_election.cc:304] T 90d42e216d9741e190bca19a781291fd P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:20:53.175498 12558 leader_election.cc:290] T d8cee0accdb8499c86d4414b72565a38 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:20:53.146318 12568 consensus_queue.cc:1048] T f58dc08b12a2494bb9a1372837970ca2 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.056s
I20260709 13:20:53.150758 12246 consensus_queue.cc:1059] T c4db81d9d329422bb3b4160ca4ac2d1d P b7ab4784c7344b939bc36f639286f377 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: INVALID_TERM, Last received: 15.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.057s
I20260709 13:20:53.202309 12544 raft_consensus.cc:2804] T f03d0dbf16864ca4bc1bb5e4c0334c0f P cd75a17ab2604397adab03bb8b5fd75c [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:20:53.233477  6727 raft_consensus.cc:2468] T e77e330a82df4b43a745d57a68f6f057 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 18.
I20260709 13:20:53.104820 12551 consensus_queue.cc:260] T 3411566abe2d4c9bb4b2adfdd05e6f17 P ccd8a4c3bfe3413cb2ae219b09aea832 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:53.229024  6844 leader_election.cc:304] T 95a75bfe094d4bdc963aba3f08dfcd25 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:20:53.247871  7500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8cee0accdb8499c86d4414b72565a38" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:20:53.174242 11937 consensus_queue.cc:1059] T 3d65025eea89441290d85dd053810e31 P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.051s
I20260709 13:20:53.249221  7500 raft_consensus.cc:2393] T d8cee0accdb8499c86d4414b72565a38 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c in current term 17: Already voted for candidate b7ab4784c7344b939bc36f639286f377 in this term.
I20260709 13:20:53.206354 12427 raft_consensus.cc:493] T 4d9def8b32fd443aa94ab1420b06837b P b7ab4784c7344b939bc36f639286f377 [term 15 FOLLOWER]: Starting leader election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:20:53.218652 12566 raft_consensus.cc:2749] T 07a92dd554674067a83a9cb68c4773f2 P b7ab4784c7344b939bc36f639286f377 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:20:53.254154  6872 raft_consensus.cc:2468] T d8cee0accdb8499c86d4414b72565a38 P cd75a17ab2604397adab03bb8b5fd75c [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 17.
I20260709 13:20:53.212080 12352 raft_consensus.cc:2749] T 7c44c4849aa54f2b94d1f1bef9ed546f P b7ab4784c7344b939bc36f639286f377 [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:20:53.248116  6844 leader_election.cc:304] T 9b3759de40694069b13c0f8bd40e5709 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:20:53.235718 12563 raft_consensus.cc:2804] T 90d42e216d9741e190bca19a781291fd P cd75a17ab2604397adab03bb8b5fd75c [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:20:53.205446 12345 raft_consensus.cc:515] T 1528ab62b6fe4e3099d08f141afee116 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:20:53.235076 12545 consensus_queue.cc:1048] T e77e330a82df4b43a745d57a68f6f057 P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Connected to new peer: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.036s
I20260709 13:20:53.238888 12544 raft_consensus.cc:493] T f03d0dbf16864ca4bc1bb5e4c0334c0f P cd75a17ab2604397adab03bb8b5fd75c [term 15 FOLLOWER]: Starting leader election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:20:53.259053 12427 raft_consensus.cc:3060] T 4d9def8b32fd443aa94ab1420b06837b P b7ab4784c7344b939bc36f639286f377 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:53.271322 12527 raft_consensus.cc:3055] T 3d65025eea89441290d85dd053810e31 P cd75a17ab2604397adab03bb8b5fd75c [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:20:53.318763 12527 raft_consensus.cc:740] T 3d65025eea89441290d85dd053810e31 P cd75a17ab2604397adab03bb8b5fd75c [term 16 LEADER]: Becoming Follower/Learner. State: Replica: cd75a17ab2604397adab03bb8b5fd75c, State: Running, Role: LEADER
W20260709 13:20:53.289079  6847 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:53.290975 12552 raft_consensus.cc:493] T f3f9c2e2bf644115957398fe4c9459db P cd75a17ab2604397adab03bb8b5fd75c [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:20:53.291973  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 44013.7us
I20260709 13:20:53.321436  6844 leader_election.cc:304] T dbdf895bba214ff68685a24fd17dfb5d P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:20:53.293429 12558 raft_consensus.cc:2804] T 9b3759de40694069b13c0f8bd40e5709 P cd75a17ab2604397adab03bb8b5fd75c [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:20:53.274369 12581 consensus_queue.cc:237] T 3fa34c08b205435dba97346991aa1f92 P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.14, Last appended by leader: 15, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:20:53.270479 12563 raft_consensus.cc:493] T 90d42e216d9741e190bca19a781291fd P cd75a17ab2604397adab03bb8b5fd75c [term 16 FOLLOWER]: Starting leader election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:20:53.303550  6807 raft_consensus.cc:3060] T dbdf895bba214ff68685a24fd17dfb5d P b7ab4784c7344b939bc36f639286f377 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:20:53.305497  6698 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:53.240954 12561 consensus_queue.cc:237] T 95a75bfe094d4bdc963aba3f08dfcd25 P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } attrs { replace: true } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: NON_VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: true } }
I20260709 13:20:53.316078 12544 raft_consensus.cc:3060] T f03d0dbf16864ca4bc1bb5e4c0334c0f P cd75a17ab2604397adab03bb8b5fd75c [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:53.325268  7468 leader_election.cc:304] T 4b8cacb381b746da8d0049b0a83b41dd P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
W20260709 13:20:53.329838  6698 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:53.263721 12240 consensus_queue.cc:1059] T 3411566abe2d4c9bb4b2adfdd05e6f17 P ccd8a4c3bfe3413cb2ae219b09aea832 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: INVALID_TERM, Last received: 13.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.063s
I20260709 13:20:53.334367  7468 leader_election.cc:304] T 24ee15416e3145beaa1b8183453729a3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:20:53.328402 11937 raft_consensus.cc:2804] T dbdf895bba214ff68685a24fd17dfb5d P cd75a17ab2604397adab03bb8b5fd75c [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:20:53.337206 12249 raft_consensus.cc:3060] T 427c124d773f483294511e80fe340075 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:53.337471 11937 raft_consensus.cc:697] T dbdf895bba214ff68685a24fd17dfb5d P cd75a17ab2604397adab03bb8b5fd75c [term 15 LEADER]: Becoming Leader. State: Replica: cd75a17ab2604397adab03bb8b5fd75c, State: Running, Role: LEADER
I20260709 13:20:53.338557 11937 consensus_queue.cc:237] T dbdf895bba214ff68685a24fd17dfb5d P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 14.6, Last appended by leader: 6, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:53.299918 12631 raft_consensus.cc:515] T 4f00a2e87e56452083b759f60d461ee3 P b7ab4784c7344b939bc36f639286f377 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:20:53.343204 12631 leader_election.cc:290] T 4f00a2e87e56452083b759f60d461ee3 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 18 election: Requested vote from peers cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:20:53.328200 12271 consensus_queue.cc:1048] T bb7fa124c3bf4ef9ab65a407cb008441 P 7ba59cc884714e8aa5f3f0ecaed84cbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.016s
I20260709 13:20:53.329113 12563 raft_consensus.cc:3060] T 90d42e216d9741e190bca19a781291fd P cd75a17ab2604397adab03bb8b5fd75c [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:53.326591 12558 raft_consensus.cc:493] T 9b3759de40694069b13c0f8bd40e5709 P cd75a17ab2604397adab03bb8b5fd75c [term 13 FOLLOWER]: Starting leader election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:20:53.345716 12558 raft_consensus.cc:3060] T 9b3759de40694069b13c0f8bd40e5709 P cd75a17ab2604397adab03bb8b5fd75c [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:53.348228 12616 raft_consensus.cc:2749] T 4b8cacb381b746da8d0049b0a83b41dd P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:20:53.352133 12484 raft_consensus.cc:3055] T c4db81d9d329422bb3b4160ca4ac2d1d P b7ab4784c7344b939bc36f639286f377 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:20:53.352677 12484 raft_consensus.cc:740] T c4db81d9d329422bb3b4160ca4ac2d1d P b7ab4784c7344b939bc36f639286f377 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
I20260709 13:20:53.353116 12610 raft_consensus.cc:493] T 7a734b5ab7834e05a8c422208acc58b1 P cd75a17ab2604397adab03bb8b5fd75c [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:53.353536 12484 consensus_queue.cc:260] T c4db81d9d329422bb3b4160ca4ac2d1d P b7ab4784c7344b939bc36f639286f377 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:53.353747 12610 raft_consensus.cc:515] T 7a734b5ab7834e05a8c422208acc58b1 P cd75a17ab2604397adab03bb8b5fd75c [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } attrs { replace: true } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: NON_VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: true } }
I20260709 13:20:53.355026 12484 raft_consensus.cc:3060] T c4db81d9d329422bb3b4160ca4ac2d1d P b7ab4784c7344b939bc36f639286f377 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:53.360286  6844 leader_election.cc:304] T bb7fa124c3bf4ef9ab65a407cb008441 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, b7ab4784c7344b939bc36f639286f377
W20260709 13:20:53.320327  6697 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 301446us
W20260709 13:20:53.363278  6695 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:53.371750  6807 raft_consensus.cc:2468] T dbdf895bba214ff68685a24fd17dfb5d P b7ab4784c7344b939bc36f639286f377 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 15.
I20260709 13:20:53.386329  6697 leader_election.cc:304] T f58dc08b12a2494bb9a1372837970ca2 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
W20260709 13:20:53.384150  6770 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 223293us
I20260709 13:20:53.410641  6770 leader_election.cc:304] T 9e326172347f45e99a0d482b5d8ef768 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:20:53.327868 12545 consensus_queue.cc:1048] T 9e326172347f45e99a0d482b5d8ef768 P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Connected to new peer: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.052s
I20260709 13:20:53.326917 12552 raft_consensus.cc:515] T f3f9c2e2bf644115957398fe4c9459db P cd75a17ab2604397adab03bb8b5fd75c [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:53.402702 12631 raft_consensus.cc:493] T be1a92657f494cac8dd227d152f50151 P b7ab4784c7344b939bc36f639286f377 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:20:53.076324  6624 rpcz_store.cc:269] 0709 13:20:33.174409 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:33.174593 (+   184us) service_pool.cc:224] Handling call
0709 13:20:53.000183 (+19825590us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:20:48.363087 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:20:48.428583 (+ 65496us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:20:48.428653 (+    70us) write_op.cc:435] Acquired schema lock
0709 13:20:48.428672 (+    19us) tablet.cc:662] Decoding operations
0709 13:20:48.429860 (+  1188us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:20:48.429959 (+    99us) write_op.cc:641] Partition lock acquired for write op
0709 13:20:48.429991 (+    32us) tablet.cc:685] Acquiring locks for 12 operations
0709 13:20:48.431210 (+  1219us) tablet.cc:701] Row locks acquired
0709 13:20:48.431257 (+    47us) write_op.cc:260] PREPARE: finished
0709 13:20:48.431443 (+   186us) write_op.cc:270] Start()
0709 13:20:48.431627 (+   184us) write_op.cc:276] Timestamp: P: 1783603248431364 usec, L: 0
0709 13:20:48.431660 (+    33us) op_driver.cc:348] REPLICATION: starting
0709 13:20:48.492328 (+ 60668us) log.cc:844] Serialized 4771 byte log entry
0709 13:20:49.348787 (+856459us) op_driver.cc:464] REPLICATION: finished
0709 13:20:51.344364 (+1995577us) spinlock_profiling.cc:243] Waited 31 ms on lock 0x7b4400022b4c. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0c745db1 00007fcc0c7e3c85 00007fcc0c7e46a2 00007fcc0f5561db 00007fcc0f551aaf 00007fcc0c8a00ac 00007fcc156faab9 00007fcc0c8bc69b 00007fcc0c8ba93f 00007fcc0c8bcc02 00007fcc133e0ef0
0709 13:20:51.426058 (+ 81694us) write_op.cc:301] APPLY: starting
0709 13:20:51.426204 (+   146us) tablet.cc:1367] starting BulkCheckPresence
0709 13:20:52.263491 (+837287us) spinlock_profiling.cc:243] Waited 11.1 ms on lock 0x7b1800161560. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc15785de1 00007fcc157925b1 00007fcc0f5524bc 00007fcc0c8a048b 00007fcc156faab9 00007fcc0c8bc69b 00007fcc0c8ba93f 00007fcc0c8bcc02 00007fcc133e0ef0 00007fcc133e1489 00007fcc133e371a
0709 13:20:52.340621 (+ 77130us) tablet.cc:1370] finished BulkCheckPresence
0709 13:20:52.340677 (+    56us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:20:52.361634 (+ 20957us) spinlock_profiling.cc:243] Waited 19.4 ms on lock 0x7b5400156154. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f9a732a 00007fcc0f92cf14 00007fcc0f92cec3 00007fcc0f92ce38 00007fcc0f92cdf3 00007fcc0f92c0dc 00007fcc0f955e16 00007fcc0f93dcbb 00007fcc0f92839d 00007fcc0f92bd75
0709 13:20:52.449257 (+ 87623us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:20:52.501060 (+ 51803us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=24,key_file_lookups=24,delta_file_lookups=24,mrs_lookups=0
0709 13:20:52.501131 (+    71us) write_op.cc:312] APPLY: finished
0709 13:20:52.501680 (+   549us) log.cc:844] Serialized 112 byte log entry
0709 13:20:52.843995 (+342315us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:20:52.861629 (+ 17634us) write_op.cc:454] Released schema lock
0709 13:20:52.861709 (+    80us) write_op.cc:341] FINISH: Updating metrics
0709 13:20:52.862176 (+   467us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:20:52.862205 (+    29us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":1997570,"reported_tablets":16,"child_traces":[["op",{"apply.queue_time_us":2070925,"apply.run_cpu_time_us":56605,"apply.run_wall_time_us":1436154,"cfile_cache_hit":50,"cfile_cache_hit_bytes":54239,"num_ops":12,"prepare.queue_time_us":235259,"prepare.run_cpu_time_us":32180,"prepare.run_wall_time_us":307566,"raft.queue_time_us":448480,"raft.run_cpu_time_us":87453,"raft.run_wall_time_us":3080575,"replication_time_us":906275,"spinlock_wait_cycles":141602176,"thread_start_us":3093997,"threads_started":5,"wal-append.queue_time_us":579082,"wal-append.run_cpu_time_us":33072,"wal-append.run_wall_time_us":1480212}]]}
I20260709 13:20:53.379626 12603 raft_consensus.cc:2749] T 24ee15416e3145beaa1b8183453729a3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:20:53.394016  6695 leader_election.cc:304] T 7c44c4849aa54f2b94d1f1bef9ed546f P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
I20260709 13:20:53.359632 12610 leader_election.cc:290] T 7a734b5ab7834e05a8c422208acc58b1 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:20:53.386749 12335 raft_consensus.cc:493] T 30e88460611e47b2ba16a46a30b5f416 P cd75a17ab2604397adab03bb8b5fd75c [term 13 FOLLOWER]: Starting pre-election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:20:53.426000  7466 leader_election.cc:304] T be1a92657f494cac8dd227d152f50151 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: b7ab4784c7344b939bc36f639286f377
I20260709 13:20:53.427361  6697 leader_election.cc:304] T e31b9971c15848dea59d4d4130141d9e P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:20:53.433661  6727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22ccee1b570c4ad3a57bd7aec085b1b4" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:53.435312  6728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de3186201e1a40d0b335eeb8b4e256e0" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:53.442551  6723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "853ac0a8cbd64ce99457f170216d4d0f" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:53.441824  6726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f58dc08b12a2494bb9a1372837970ca2" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
W20260709 13:20:53.476148  7466 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 50288us
I20260709 13:20:53.422375 12227 raft_consensus.cc:3055] T 07a92dd554674067a83a9cb68c4773f2 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:20:53.478103  6726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "427c124d773f483294511e80fe340075" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:53.478814  6726 raft_consensus.cc:2393] T 427c124d773f483294511e80fe340075 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c in current term 15: Already voted for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in this term.
I20260709 13:20:53.479084  6723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d9def8b32fd443aa94ab1420b06837b" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
W20260709 13:20:53.482159  6697 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 54939.4us
I20260709 13:20:53.483783  6697 leader_election.cc:304] T f4b8bd455d5a47c18a1380839c6e0d61 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:20:53.442095  6730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d33d5ee8ef6f415593d8df52063161ad" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:53.496345  6803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6869f07b5a4885a0b99fbe60c3b175" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:53.496807  6807 raft_consensus.cc:1240] T a3022224cc81473690653a83d4e99470 P b7ab4784c7344b939bc36f639286f377 [term 18 FOLLOWER]: Rejecting Update request from peer ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 17. Current term is 18. Ops: []
I20260709 13:20:53.497442  6803 raft_consensus.cc:2468] T bd6869f07b5a4885a0b99fbe60c3b175 P b7ab4784c7344b939bc36f639286f377 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 17.
I20260709 13:20:53.480114  7466 leader_election.cc:304] T 404190ce4ce94cecbfcb6ea9d1dd8626 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:20:53.477661  6770 leader_election.cc:304] T e77e330a82df4b43a745d57a68f6f057 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
I20260709 13:20:53.421000 12535 consensus_queue.cc:1059] T f5be3a11b23d4ea9b08300a2789821c7 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: INVALID_TERM, Last received: 14.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.056s
I20260709 13:20:53.518353  6800 raft_consensus.cc:1275] T f09c2a98de1a4decabd0ff900dd44caa P b7ab4784c7344b939bc36f639286f377 [term 18 FOLLOWER]: Refusing update from remote peer ccd8a4c3bfe3413cb2ae219b09aea832: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 13:20:53.431825 12478 raft_consensus.cc:2749] T 3a485a995abc4807b6e511e45419f737 P b7ab4784c7344b939bc36f639286f377 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:20:53.424893 12422 consensus_queue.cc:1048] T 3fa34c08b205435dba97346991aa1f92 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.060s
I20260709 13:20:53.477855 12610 raft_consensus.cc:493] T 3411566abe2d4c9bb4b2adfdd05e6f17 P cd75a17ab2604397adab03bb8b5fd75c [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:53.506749  6727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6869f07b5a4885a0b99fbe60c3b175" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:53.534986  6727 raft_consensus.cc:2468] T bd6869f07b5a4885a0b99fbe60c3b175 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 17.
I20260709 13:20:53.516664  6803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34f36d59d88f40fe8a2805e604fc6c0a" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:53.536201  6803 raft_consensus.cc:2468] T 34f36d59d88f40fe8a2805e604fc6c0a P b7ab4784c7344b939bc36f639286f377 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 15.
I20260709 13:20:53.516714  6807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22ccee1b570c4ad3a57bd7aec085b1b4" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:53.508582  6724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34f36d59d88f40fe8a2805e604fc6c0a" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:53.537101  6802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de3186201e1a40d0b335eeb8b4e256e0" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:53.537806  6724 raft_consensus.cc:2468] T 34f36d59d88f40fe8a2805e604fc6c0a P ccd8a4c3bfe3413cb2ae219b09aea832 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 15.
I20260709 13:20:53.511354  6730 raft_consensus.cc:1240] T e77e330a82df4b43a745d57a68f6f057 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 18 FOLLOWER]: Rejecting Update request from peer cd75a17ab2604397adab03bb8b5fd75c for earlier term 17. Current term is 18. Ops: [17.10-17.10]
I20260709 13:20:53.398530 12527 consensus_queue.cc:260] T 3d65025eea89441290d85dd053810e31 P cd75a17ab2604397adab03bb8b5fd75c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 16.9, Last appended by leader: 9, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:53.522042  6805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f9c2e2bf644115957398fe4c9459db" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:53.505141 12271 raft_consensus.cc:2804] T be1a92657f494cac8dd227d152f50151 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:20:53.520793  6741 tablet_copy_service.cc:342] P ccd8a4c3bfe3413cb2ae219b09aea832: Request end of tablet copy session 7ba59cc884714e8aa5f3f0ecaed84cbb-95a75bfe094d4bdc963aba3f08dfcd25 received from {username='slave'} at 127.0.0.1:49744
I20260709 13:20:53.555176  6741 tablet_copy_service.cc:434] P ccd8a4c3bfe3413cb2ae219b09aea832: ending tablet copy session 7ba59cc884714e8aa5f3f0ecaed84cbb-95a75bfe094d4bdc963aba3f08dfcd25 on tablet 95a75bfe094d4bdc963aba3f08dfcd25 with peer 7ba59cc884714e8aa5f3f0ecaed84cbb
I20260709 13:20:53.556385  6801 raft_consensus.cc:1275] T 3d65025eea89441290d85dd053810e31 P b7ab4784c7344b939bc36f639286f377 [term 17 FOLLOWER]: Refusing update from remote peer ccd8a4c3bfe3413cb2ae219b09aea832: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 17 index: 9. (index mismatch)
I20260709 13:20:53.559695  6804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f58dc08b12a2494bb9a1372837970ca2" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:53.518544 12566 raft_consensus.cc:2804] T e77e330a82df4b43a745d57a68f6f057 P b7ab4784c7344b939bc36f639286f377 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:20:53.539265  6803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d33d5ee8ef6f415593d8df52063161ad" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:53.481307 12503 consensus_queue.cc:1059] T f4b8bd455d5a47c18a1380839c6e0d61 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: INVALID_TERM, Last received: 14.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.068s
I20260709 13:20:53.541193  6807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d9def8b32fd443aa94ab1420b06837b" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:53.545157  6799 raft_consensus.cc:1240] T 4f00a2e87e56452083b759f60d461ee3 P b7ab4784c7344b939bc36f639286f377 [term 18 FOLLOWER]: Rejecting Update request from peer 7ba59cc884714e8aa5f3f0ecaed84cbb for earlier term 17. Current term is 18. Ops: []
I20260709 13:20:53.546404  6805 raft_consensus.cc:2393] T f3f9c2e2bf644115957398fe4c9459db P b7ab4784c7344b939bc36f639286f377 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ccd8a4c3bfe3413cb2ae219b09aea832 in current term 16: Already voted for candidate b7ab4784c7344b939bc36f639286f377 in this term.
I20260709 13:20:53.476878 12624 raft_consensus.cc:2804] T 7c44c4849aa54f2b94d1f1bef9ed546f P ccd8a4c3bfe3413cb2ae219b09aea832 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:20:53.484200 12227 raft_consensus.cc:740] T 07a92dd554674067a83a9cb68c4773f2 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
I20260709 13:20:53.551872  6802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "427c124d773f483294511e80fe340075" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:53.545326 12370 raft_consensus.cc:2749] T f58dc08b12a2494bb9a1372837970ca2 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:20:53.476001 12159 raft_consensus.cc:2804] T 9e326172347f45e99a0d482b5d8ef768 P b7ab4784c7344b939bc36f639286f377 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:20:53.430186 12631 raft_consensus.cc:515] T be1a92657f494cac8dd227d152f50151 P b7ab4784c7344b939bc36f639286f377 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:20:53.540167  6806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "853ac0a8cbd64ce99457f170216d4d0f" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:53.506424  6728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1528ab62b6fe4e3099d08f141afee116" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:53.574468  6800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8cee0accdb8499c86d4414b72565a38" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:53.616319  6800 raft_consensus.cc:2393] T d8cee0accdb8499c86d4414b72565a38 P b7ab4784c7344b939bc36f639286f377 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c in current term 17: Already voted for candidate b7ab4784c7344b939bc36f639286f377 in this term.
W20260709 13:20:53.616945 12646 log.cc:927] Time spent T d33d5ee8ef6f415593d8df52063161ad P ccd8a4c3bfe3413cb2ae219b09aea832: Append to log took a long time: real 0.135s	user 0.000s	sys 0.000s
I20260709 13:20:53.570780  6799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6869f07b5a4885a0b99fbe60c3b175" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:53.618076  6799 raft_consensus.cc:2393] T bd6869f07b5a4885a0b99fbe60c3b175 P b7ab4784c7344b939bc36f639286f377 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c in current term 17: Already voted for candidate b7ab4784c7344b939bc36f639286f377 in this term.
I20260709 13:20:53.520449 12640 raft_consensus.cc:2749] T 404190ce4ce94cecbfcb6ea9d1dd8626 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:20:53.505153 12568 consensus_queue.cc:1048] T 7a734b5ab7834e05a8c422208acc58b1 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.052s
I20260709 13:20:53.622483 12427 raft_consensus.cc:515] T 4d9def8b32fd443aa94ab1420b06837b P b7ab4784c7344b939bc36f639286f377 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:53.481921 12335 raft_consensus.cc:515] T 30e88460611e47b2ba16a46a30b5f416 P cd75a17ab2604397adab03bb8b5fd75c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:53.582414 12227 consensus_queue.cc:260] T 07a92dd554674067a83a9cb68c4773f2 P ccd8a4c3bfe3413cb2ae219b09aea832 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:53.583302 12275 raft_consensus.cc:2749] T f5be3a11b23d4ea9b08300a2789821c7 P b7ab4784c7344b939bc36f639286f377 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:20:53.633631  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 273408us
I20260709 13:20:53.608695 12535 raft_consensus.cc:2749] T f4b8bd455d5a47c18a1380839c6e0d61 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:20:53.601086 12616 consensus_queue.cc:1059] T 4f00a2e87e56452083b759f60d461ee3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: INVALID_TERM, Last received: 17.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:20:53.602978 12563 raft_consensus.cc:515] T 90d42e216d9741e190bca19a781291fd P cd75a17ab2604397adab03bb8b5fd75c [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:53.578368 12566 raft_consensus.cc:697] T e77e330a82df4b43a745d57a68f6f057 P b7ab4784c7344b939bc36f639286f377 [term 18 LEADER]: Becoming Leader. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
W20260709 13:20:53.629721  6847 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:53.566879 12651 raft_consensus.cc:2749] T e31b9971c15848dea59d4d4130141d9e P ccd8a4c3bfe3413cb2ae219b09aea832 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:20:53.578150 12527 raft_consensus.cc:3060] T 3d65025eea89441290d85dd053810e31 P cd75a17ab2604397adab03bb8b5fd75c [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:53.634688  6844 leader_election.cc:304] T 711ef6523deb4cbe8ef2ba61e1c21c98 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:20:53.636874  6806 raft_consensus.cc:1240] T 4d9def8b32fd443aa94ab1420b06837b P b7ab4784c7344b939bc36f639286f377 [term 16 FOLLOWER]: Rejecting Update request from peer ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 15. Current term is 16. Ops: []
W20260709 13:20:53.583847 12606 consensus_meta.cc:287] T 90d42e216d9741e190bca19a781291fd P ccd8a4c3bfe3413cb2ae219b09aea832: Time spent flushing consensus metadata: real 0.529s	user 0.008s	sys 0.005s
I20260709 13:20:53.580544 12345 leader_election.cc:290] T 1528ab62b6fe4e3099d08f141afee116 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:20:53.551651 12610 raft_consensus.cc:515] T 3411566abe2d4c9bb4b2adfdd05e6f17 P cd75a17ab2604397adab03bb8b5fd75c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:53.627035 12159 raft_consensus.cc:697] T 9e326172347f45e99a0d482b5d8ef768 P b7ab4784c7344b939bc36f639286f377 [term 14 LEADER]: Becoming Leader. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
I20260709 13:20:53.633965 12653 raft_consensus.cc:3055] T f5be3a11b23d4ea9b08300a2789821c7 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:20:53.671590  7495 raft_consensus.cc:2468] T 427c124d773f483294511e80fe340075 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 15.
I20260709 13:20:53.673014  6695 leader_election.cc:304] T bd6869f07b5a4885a0b99fbe60c3b175 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
I20260709 13:20:53.657413 12624 raft_consensus.cc:697] T 7c44c4849aa54f2b94d1f1bef9ed546f P ccd8a4c3bfe3413cb2ae219b09aea832 [term 19 LEADER]: Becoming Leader. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
W20260709 13:20:53.661837  6616 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet ce4f062dcd314d43a63ca74067cb5ee3 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER failed with leader 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 7ba59cc884714e8aa5f3f0ecaed84cbb is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 15 leader_uuid: "b7ab4784c7344b939bc36f639286f377" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } attrs { replace: true } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } } }
I20260709 13:20:53.664903 12610 leader_election.cc:290] T 3411566abe2d4c9bb4b2adfdd05e6f17 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:20:53.668864 12427 leader_election.cc:290] T 4d9def8b32fd443aa94ab1420b06837b P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 16 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:53.670909 12249 raft_consensus.cc:3055] T 4f00a2e87e56452083b759f60d461ee3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:20:53.654731  6800 raft_consensus.cc:1275] T 711ef6523deb4cbe8ef2ba61e1c21c98 P b7ab4784c7344b939bc36f639286f377 [term 19 FOLLOWER]: Refusing update from remote peer ccd8a4c3bfe3413cb2ae219b09aea832: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
W20260709 13:20:53.674834  6698 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:53.664947 12563 leader_election.cc:290] T 90d42e216d9741e190bca19a781291fd P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 17 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:20:53.680248 12249 raft_consensus.cc:740] T 4f00a2e87e56452083b759f60d461ee3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 7ba59cc884714e8aa5f3f0ecaed84cbb, State: Running, Role: LEADER
I20260709 13:20:53.656733 12606 raft_consensus.cc:515] T 90d42e216d9741e190bca19a781291fd P ccd8a4c3bfe3413cb2ae219b09aea832 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:53.700941 12249 consensus_queue.cc:260] T 4f00a2e87e56452083b759f60d461ee3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 12, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:20:53.702100  6732 raft_consensus.cc:1240] T 90d42e216d9741e190bca19a781291fd P ccd8a4c3bfe3413cb2ae219b09aea832 [term 17 FOLLOWER]: Rejecting Update request from peer b7ab4784c7344b939bc36f639286f377 for earlier term 16. Current term is 17. Ops: [16.9-16.9]
W20260709 13:20:53.705680 12492 consensus_meta.cc:287] T f03d0dbf16864ca4bc1bb5e4c0334c0f P b7ab4784c7344b939bc36f639286f377: Time spent flushing consensus metadata: real 0.500s	user 0.003s	sys 0.009s
I20260709 13:20:53.706044 12558 raft_consensus.cc:515] T 9b3759de40694069b13c0f8bd40e5709 P cd75a17ab2604397adab03bb8b5fd75c [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:53.674436 12653 raft_consensus.cc:740] T f5be3a11b23d4ea9b08300a2789821c7 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
W20260709 13:20:53.707829  6697 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 224143us
I20260709 13:20:53.704149 12566 consensus_queue.cc:237] T e77e330a82df4b43a745d57a68f6f057 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } }
I20260709 13:20:53.706164 12492 raft_consensus.cc:515] T f03d0dbf16864ca4bc1bb5e4c0334c0f P b7ab4784c7344b939bc36f639286f377 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:53.747848  6725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d9def8b32fd443aa94ab1420b06837b" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:20:53.748911  6731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be1a92657f494cac8dd227d152f50151" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:53.751066  6731 raft_consensus.cc:2468] T be1a92657f494cac8dd227d152f50151 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 17.
W20260709 13:20:53.757750  6772 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.573s	user 0.012s	sys 0.028s
W20260709 13:20:53.758533  6772 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.574s	user 0.012s	sys 0.028s
I20260709 13:20:53.690819 12552 leader_election.cc:290] T f3f9c2e2bf644115957398fe4c9459db P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:20:53.676723 12544 raft_consensus.cc:515] T f03d0dbf16864ca4bc1bb5e4c0334c0f P cd75a17ab2604397adab03bb8b5fd75c [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
W20260709 13:20:53.785049  6698 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:53.790042  6770 leader_election.cc:304] T be1a92657f494cac8dd227d152f50151 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
I20260709 13:20:53.680697 12651 consensus_queue.cc:1059] T a3022224cc81473690653a83d4e99470 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.069s
I20260709 13:20:53.797690  6875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24ee15416e3145beaa1b8183453729a3" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:53.798660  6879 raft_consensus.cc:1240] T a3022224cc81473690653a83d4e99470 P cd75a17ab2604397adab03bb8b5fd75c [term 18 FOLLOWER]: Rejecting Update request from peer ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 17. Current term is 18. Ops: []
I20260709 13:20:53.806385  6877 raft_consensus.cc:1240] T 44bde925b2e541b69890d70715b85176 P cd75a17ab2604397adab03bb8b5fd75c [term 16 FOLLOWER]: Rejecting Update request from peer ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 15. Current term is 16. Ops: []
I20260709 13:20:53.743579 12610 raft_consensus.cc:493] T 4275cf08e63345f993bce8664eada830 P cd75a17ab2604397adab03bb8b5fd75c [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:53.800395  6878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab432e62819d499eaaf3dd55481dd930" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:20:53.800576  6881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "427c124d773f483294511e80fe340075" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:20:53.808898  6878 raft_consensus.cc:3060] T ab432e62819d499eaaf3dd55481dd930 P cd75a17ab2604397adab03bb8b5fd75c [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:20:53.801909  6876 raft_consensus.cc:1240] T 3a485a995abc4807b6e511e45419f737 P cd75a17ab2604397adab03bb8b5fd75c [term 16 FOLLOWER]: Rejecting Update request from peer ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 15. Current term is 16. Ops: []
W20260709 13:20:53.794567  6772 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 621481us
I20260709 13:20:53.750209 12594 raft_consensus.cc:2804] T bd6869f07b5a4885a0b99fbe60c3b175 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 17 FOLLOWER]: Leader pre-election won for term 18
W20260709 13:20:53.814307  7466 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 243230us
W20260709 13:20:53.815827  7466 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:53.817018  6807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1528ab62b6fe4e3099d08f141afee116" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:53.818547  6772 leader_election.cc:304] T f3f9c2e2bf644115957398fe4c9459db P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:20:53.820317 12568 raft_consensus.cc:2749] T f3f9c2e2bf644115957398fe4c9459db P b7ab4784c7344b939bc36f639286f377 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:20:53.820726 12658 consensus_queue.cc:1059] T e31b9971c15848dea59d4d4130141d9e P b7ab4784c7344b939bc36f639286f377 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:20:53.822662  6874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c7f33e544204fbaac4078e3e83bbf4e" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:53.791474 12657 raft_consensus.cc:2804] T be1a92657f494cac8dd227d152f50151 P b7ab4784c7344b939bc36f639286f377 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:20:53.817239  7495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "427c124d773f483294511e80fe340075" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb"
I20260709 13:20:53.837999  6872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6869f07b5a4885a0b99fbe60c3b175" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:53.842180  6872 raft_consensus.cc:2468] T bd6869f07b5a4885a0b99fbe60c3b175 P cd75a17ab2604397adab03bb8b5fd75c [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 16.
I20260709 13:20:53.843436  6872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c44c4849aa54f2b94d1f1bef9ed546f" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:20:53.844303  6872 raft_consensus.cc:3060] T 7c44c4849aa54f2b94d1f1bef9ed546f P cd75a17ab2604397adab03bb8b5fd75c [term 17 FOLLOWER]: Advancing to term 19
I20260709 13:20:53.791704 12631 leader_election.cc:290] T be1a92657f494cac8dd227d152f50151 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
W20260709 13:20:53.860229  6698 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:53.848714  6695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 64415.2us
I20260709 13:20:53.865576  7494 raft_consensus.cc:1275] T bb3d8792045a4583ae2e965b1350a5b4 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 15 FOLLOWER]: Refusing update from remote peer ccd8a4c3bfe3413cb2ae219b09aea832: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 13:20:53.870645  7495 raft_consensus.cc:2468] T 427c124d773f483294511e80fe340075 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 15.
I20260709 13:20:53.871145  6878 raft_consensus.cc:2468] T ab432e62819d499eaaf3dd55481dd930 P cd75a17ab2604397adab03bb8b5fd75c [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 18.
I20260709 13:20:53.874078  7466 leader_election.cc:304] T 1528ab62b6fe4e3099d08f141afee116 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:20:53.874506  7500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24ee15416e3145beaa1b8183453729a3" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:20:53.826627 12594 raft_consensus.cc:493] T bd6869f07b5a4885a0b99fbe60c3b175 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:53.793136 12602 consensus_queue.cc:1048] T f09c2a98de1a4decabd0ff900dd44caa P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.064s
I20260709 13:20:53.810870 12663 raft_consensus.cc:493] T 20f6842e26174571996b8dea4151d4be P cd75a17ab2604397adab03bb8b5fd75c [term 17 FOLLOWER]: Starting pre-election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:20:53.813499 12662 raft_consensus.cc:2764] T 711ef6523deb4cbe8ef2ba61e1c21c98 P cd75a17ab2604397adab03bb8b5fd75c [term 19 FOLLOWER]: Leader pre-election decision vote started in defunct term 18: won
I20260709 13:20:53.836452 12497 raft_consensus.cc:3055] T a3022224cc81473690653a83d4e99470 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:20:53.837318 12581 raft_consensus.cc:493] T f4b8bd455d5a47c18a1380839c6e0d61 P cd75a17ab2604397adab03bb8b5fd75c [term 16 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:20:53.794637 12582 consensus_queue.cc:1048] T 3d65025eea89441290d85dd053810e31 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.070s
I20260709 13:20:53.849792 12561 raft_consensus.cc:493] T bb3d8792045a4583ae2e965b1350a5b4 P cd75a17ab2604397adab03bb8b5fd75c [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:53.839103 12657 raft_consensus.cc:493] T be1a92657f494cac8dd227d152f50151 P b7ab4784c7344b939bc36f639286f377 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:20:53.923816  6695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 60592.2us
I20260709 13:20:53.924067  7495 raft_consensus.cc:1275] T b3f13b31a1f84f0d89d007eadd57924c P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 14 FOLLOWER]: Refusing update from remote peer ccd8a4c3bfe3413cb2ae219b09aea832: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
I20260709 13:20:53.925539  6874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f9c2e2bf644115957398fe4c9459db" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:53.935170  6874 raft_consensus.cc:2468] T f3f9c2e2bf644115957398fe4c9459db P cd75a17ab2604397adab03bb8b5fd75c [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 16.
I20260709 13:20:53.813961 12275 consensus_queue.cc:1059] T 90d42e216d9741e190bca19a781291fd P b7ab4784c7344b939bc36f639286f377 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: INVALID_TERM, Last received: 14.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.066s
I20260709 13:20:53.936326  6872 raft_consensus.cc:2468] T 7c44c4849aa54f2b94d1f1bef9ed546f P cd75a17ab2604397adab03bb8b5fd75c [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 19.
W20260709 13:20:53.940573  6698 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:53.870718 12631 raft_consensus.cc:3055] T e31b9971c15848dea59d4d4130141d9e P b7ab4784c7344b939bc36f639286f377 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:20:53.783823 12624 consensus_queue.cc:237] T 7c44c4849aa54f2b94d1f1bef9ed546f P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 12, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:53.791661 12159 consensus_queue.cc:237] T 9e326172347f45e99a0d482b5d8ef768 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:53.954718  6806 raft_consensus.cc:1240] T 07a92dd554674067a83a9cb68c4773f2 P b7ab4784c7344b939bc36f639286f377 [term 14 FOLLOWER]: Rejecting Update request from peer ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 13. Current term is 14. Ops: []
I20260709 13:20:53.955785  6807 raft_consensus.cc:1240] T 3a485a995abc4807b6e511e45419f737 P b7ab4784c7344b939bc36f639286f377 [term 16 FOLLOWER]: Rejecting Update request from peer ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 15. Current term is 16. Ops: []
I20260709 13:20:53.957109  6799 raft_consensus.cc:1275] T 4275cf08e63345f993bce8664eada830 P b7ab4784c7344b939bc36f639286f377 [term 14 FOLLOWER]: Refusing update from remote peer ccd8a4c3bfe3413cb2ae219b09aea832: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:20:53.813787 12610 raft_consensus.cc:515] T 4275cf08e63345f993bce8664eada830 P cd75a17ab2604397adab03bb8b5fd75c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:53.877226 12552 raft_consensus.cc:493] T ab432e62819d499eaaf3dd55481dd930 P cd75a17ab2604397adab03bb8b5fd75c [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:20:53.965361  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 330757us
I20260709 13:20:53.992312  6874 raft_consensus.cc:1275] T f09c2a98de1a4decabd0ff900dd44caa P cd75a17ab2604397adab03bb8b5fd75c [term 18 FOLLOWER]: Refusing update from remote peer ccd8a4c3bfe3413cb2ae219b09aea832: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 13:20:54.046744  6803 raft_consensus.cc:1275] T b3f13b31a1f84f0d89d007eadd57924c P b7ab4784c7344b939bc36f639286f377 [term 14 FOLLOWER]: Refusing update from remote peer ccd8a4c3bfe3413cb2ae219b09aea832: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
I20260709 13:20:54.047626  6844 leader_election.cc:304] T 7c37d41cd9164c15a6826ca62a851a69 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:20:54.049482  6800 raft_consensus.cc:1240] T f5be3a11b23d4ea9b08300a2789821c7 P b7ab4784c7344b939bc36f639286f377 [term 15 FOLLOWER]: Rejecting Update request from peer ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 14. Current term is 15. Ops: []
I20260709 13:20:53.897450 12594 raft_consensus.cc:3060] T bd6869f07b5a4885a0b99fbe60c3b175 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:20:54.007643  6695 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:53.926874 12497 raft_consensus.cc:740] T a3022224cc81473690653a83d4e99470 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
I20260709 13:20:54.058395  6798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90d42e216d9741e190bca19a781291fd" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:20:54.067515  6874 raft_consensus.cc:1275] T 711ef6523deb4cbe8ef2ba61e1c21c98 P cd75a17ab2604397adab03bb8b5fd75c [term 19 FOLLOWER]: Refusing update from remote peer ccd8a4c3bfe3413cb2ae219b09aea832: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
I20260709 13:20:53.950870 12271 raft_consensus.cc:697] T be1a92657f494cac8dd227d152f50151 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 17 LEADER]: Becoming Leader. State: Replica: 7ba59cc884714e8aa5f3f0ecaed84cbb, State: Running, Role: LEADER
I20260709 13:20:54.063037  6844 leader_election.cc:304] T 7887766dc6784fcaa42b35c05fea7a99 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:20:53.944967 12666 raft_consensus.cc:493] T b56bf91d90824c959e21e0cee5ba1816 P cd75a17ab2604397adab03bb8b5fd75c [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:54.081619  6844 leader_election.cc:304] T f09c2a98de1a4decabd0ff900dd44caa P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:20:53.958616 12631 raft_consensus.cc:740] T e31b9971c15848dea59d4d4130141d9e P b7ab4784c7344b939bc36f639286f377 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
I20260709 13:20:54.045068 12535 raft_consensus.cc:493] T 22ccee1b570c4ad3a57bd7aec085b1b4 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:20:53.958217 12657 raft_consensus.cc:3060] T be1a92657f494cac8dd227d152f50151 P b7ab4784c7344b939bc36f639286f377 [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:20:54.086308  7468 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.504s	user 0.046s	sys 0.073s
I20260709 13:20:53.949867 12335 leader_election.cc:290] T 30e88460611e47b2ba16a46a30b5f416 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
W20260709 13:20:54.090126  6697 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.68:45071, user_credentials={real_user=slave}} blocked reactor thread for 240530us
I20260709 13:20:53.965962 12608 raft_consensus.cc:493] T 7c37d41cd9164c15a6826ca62a851a69 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
W20260709 13:20:54.095909  7468 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.514s	user 0.046s	sys 0.073s
I20260709 13:20:53.960813 12668 consensus_queue.cc:1048] T 3fa34c08b205435dba97346991aa1f92 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.144s
I20260709 13:20:53.943521 12547 consensus_queue.cc:1059] T 4d9def8b32fd443aa94ab1420b06837b P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: INVALID_TERM, Last received: 15.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.140s
I20260709 13:20:54.042734 12603 raft_consensus.cc:2749] T 1528ab62b6fe4e3099d08f141afee116 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:20:54.103857  6844 leader_election.cc:304] T f5be3a11b23d4ea9b08300a2789821c7 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:20:54.078222 11937 raft_consensus.cc:2749] T 7c37d41cd9164c15a6826ca62a851a69 P cd75a17ab2604397adab03bb8b5fd75c [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:20:53.899211 12653 consensus_queue.cc:260] T f5be3a11b23d4ea9b08300a2789821c7 P ccd8a4c3bfe3413cb2ae219b09aea832 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:54.045651 12625 consensus_queue.cc:1048] T 711ef6523deb4cbe8ef2ba61e1c21c98 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 7, Time since last communication: 0.050s
I20260709 13:20:54.078676 12545 raft_consensus.cc:2749] T bb7fa124c3bf4ef9ab65a407cb008441 P cd75a17ab2604397adab03bb8b5fd75c [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:20:53.929136 12663 raft_consensus.cc:515] T 20f6842e26174571996b8dea4151d4be P cd75a17ab2604397adab03bb8b5fd75c [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:54.108485 12335 raft_consensus.cc:3060] T 7887766dc6784fcaa42b35c05fea7a99 P cd75a17ab2604397adab03bb8b5fd75c [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:54.144371 12492 leader_election.cc:290] T f03d0dbf16864ca4bc1bb5e4c0334c0f P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 17 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:54.099800 12606 leader_election.cc:290] T 90d42e216d9741e190bca19a781291fd P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 17 election: Requested vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:54.061698 12552 raft_consensus.cc:515] T ab432e62819d499eaaf3dd55481dd930 P cd75a17ab2604397adab03bb8b5fd75c [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:54.121697  6879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90d42e216d9741e190bca19a781291fd" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:20:54.126073 12678 raft_consensus.cc:2749] T f5be3a11b23d4ea9b08300a2789821c7 P cd75a17ab2604397adab03bb8b5fd75c [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:20:54.126767 12631 consensus_queue.cc:260] T e31b9971c15848dea59d4d4130141d9e P b7ab4784c7344b939bc36f639286f377 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:53.958002 12561 raft_consensus.cc:515] T bb3d8792045a4583ae2e965b1350a5b4 P cd75a17ab2604397adab03bb8b5fd75c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:20:54.180284 12561 leader_election.cc:290] T bb3d8792045a4583ae2e965b1350a5b4 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:20:54.133514  6844 leader_election.cc:304] T 44bde925b2e541b69890d70715b85176 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
W20260709 13:20:54.181576  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 48176us
I20260709 13:20:54.182497  6844 leader_election.cc:304] T 3a485a995abc4807b6e511e45419f737 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
W20260709 13:20:54.184614  6698 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:54.161482 12558 leader_election.cc:290] T 9b3759de40694069b13c0f8bd40e5709 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 14 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:20:54.134196 12679 consensus_queue.cc:1059] T 9e326172347f45e99a0d482b5d8ef768 P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:20:54.185525 12558 raft_consensus.cc:2749] T 3a485a995abc4807b6e511e45419f737 P cd75a17ab2604397adab03bb8b5fd75c [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:20:54.185909 12679 raft_consensus.cc:3055] T 9e326172347f45e99a0d482b5d8ef768 P cd75a17ab2604397adab03bb8b5fd75c [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:20:54.186363 12679 raft_consensus.cc:740] T 9e326172347f45e99a0d482b5d8ef768 P cd75a17ab2604397adab03bb8b5fd75c [term 13 LEADER]: Becoming Follower/Learner. State: Replica: cd75a17ab2604397adab03bb8b5fd75c, State: Running, Role: LEADER
I20260709 13:20:54.186457 12249 raft_consensus.cc:3060] T 4f00a2e87e56452083b759f60d461ee3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:20:54.187156 12544 leader_election.cc:290] T f03d0dbf16864ca4bc1bb5e4c0334c0f P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 16 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:20:54.134895 12497 consensus_queue.cc:260] T a3022224cc81473690653a83d4e99470 P ccd8a4c3bfe3413cb2ae219b09aea832 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.10, Last appended by leader: 10, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:54.090376 12666 raft_consensus.cc:515] T b56bf91d90824c959e21e0cee5ba1816 P cd75a17ab2604397adab03bb8b5fd75c [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:54.184491  6878 raft_consensus.cc:1275] T bb3d8792045a4583ae2e965b1350a5b4 P cd75a17ab2604397adab03bb8b5fd75c [term 15 FOLLOWER]: Refusing update from remote peer ccd8a4c3bfe3413cb2ae219b09aea832: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
W20260709 13:20:54.188412 12517 consensus_queue.cc:1175] T a3022224cc81473690653a83d4e99470 P ccd8a4c3bfe3413cb2ae219b09aea832 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "cd75a17ab2604397adab03bb8b5fd75c" responder_term: 18 status { last_received { term: 16 index: 9 } last_committed_idx: 9 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 17. Current term is 18. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:20:54.189862 12666 leader_election.cc:290] T b56bf91d90824c959e21e0cee5ba1816 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:20:54.181577 12610 leader_election.cc:290] T 4275cf08e63345f993bce8664eada830 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:20:54.119156 12664 raft_consensus.cc:2749] T f09c2a98de1a4decabd0ff900dd44caa P cd75a17ab2604397adab03bb8b5fd75c [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:20:54.187398 12679 consensus_queue.cc:260] T 9e326172347f45e99a0d482b5d8ef768 P cd75a17ab2604397adab03bb8b5fd75c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:53.948137 12581 raft_consensus.cc:515] T f4b8bd455d5a47c18a1380839c6e0d61 P cd75a17ab2604397adab03bb8b5fd75c [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:54.147470 12271 consensus_queue.cc:237] T be1a92657f494cac8dd227d152f50151 P 7ba59cc884714e8aa5f3f0ecaed84cbb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:20:54.183768  6844 leader_election.cc:304] T e31b9971c15848dea59d4d4130141d9e P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:20:54.193593  6844 leader_election.cc:304] T a3022224cc81473690653a83d4e99470 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:20:54.194139 11937 raft_consensus.cc:2749] T e31b9971c15848dea59d4d4130141d9e P cd75a17ab2604397adab03bb8b5fd75c [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:20:54.157346 12370 raft_consensus.cc:493] T fe20b4b48823486ca3b9c648db6ce8aa P ccd8a4c3bfe3413cb2ae219b09aea832 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader cd75a17ab2604397adab03bb8b5fd75c)
I20260709 13:20:54.159108 12555 raft_consensus.cc:3055] T 90d42e216d9741e190bca19a781291fd P b7ab4784c7344b939bc36f639286f377 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:20:54.184473 12662 raft_consensus.cc:2749] T 44bde925b2e541b69890d70715b85176 P cd75a17ab2604397adab03bb8b5fd75c [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:20:54.110397 12608 raft_consensus.cc:515] T 7c37d41cd9164c15a6826ca62a851a69 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:54.140605 12657 raft_consensus.cc:515] T be1a92657f494cac8dd227d152f50151 P b7ab4784c7344b939bc36f639286f377 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:20:54.192090 12679 raft_consensus.cc:3060] T 9e326172347f45e99a0d482b5d8ef768 P cd75a17ab2604397adab03bb8b5fd75c [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:54.137775  6874 raft_consensus.cc:1240] T 3fa34c08b205435dba97346991aa1f92 P cd75a17ab2604397adab03bb8b5fd75c [term 20 LEADER]: Rejecting Update request from peer ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 19. Current term is 20. Ops: [19.15-19.15]
I20260709 13:20:54.099858 12535 raft_consensus.cc:515] T 22ccee1b570c4ad3a57bd7aec085b1b4 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:54.219884 12594 raft_consensus.cc:515] T bd6869f07b5a4885a0b99fbe60c3b175 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:54.222862 12594 leader_election.cc:290] T bd6869f07b5a4885a0b99fbe60c3b175 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 18 election: Requested vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:54.210000  6727 raft_consensus.cc:2955] T 7a734b5ab7834e05a8c422208acc58b1 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 17 FOLLOWER]: Committing config change with OpId 13.6: config changed from index -1 to 6, NON_VOTER 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68) added. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } attrs { replace: true } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: NON_VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: true } } }
I20260709 13:20:54.196393  6844 leader_election.cc:304] T c4db81d9d329422bb3b4160ca4ac2d1d P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
W20260709 13:20:54.165308 12484 consensus_meta.cc:287] T c4db81d9d329422bb3b4160ca4ac2d1d P b7ab4784c7344b939bc36f639286f377: Time spent flushing consensus metadata: real 0.810s	user 0.014s	sys 0.001s
I20260709 13:20:54.200616 12370 raft_consensus.cc:515] T fe20b4b48823486ca3b9c648db6ce8aa P ccd8a4c3bfe3413cb2ae219b09aea832 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:20:54.229027 12561 raft_consensus.cc:2749] T c4db81d9d329422bb3b4160ca4ac2d1d P cd75a17ab2604397adab03bb8b5fd75c [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:20:54.230633 12370 leader_election.cc:290] T fe20b4b48823486ca3b9c648db6ce8aa P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:20:54.198134 12555 raft_consensus.cc:740] T 90d42e216d9741e190bca19a781291fd P b7ab4784c7344b939bc36f639286f377 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
I20260709 13:20:54.231302 12561 consensus_queue.cc:1059] T e77e330a82df4b43a745d57a68f6f057 P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:20:54.232154 12555 consensus_queue.cc:260] T 90d42e216d9741e190bca19a781291fd P b7ab4784c7344b939bc36f639286f377 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:54.233083 12664 raft_consensus.cc:3055] T e77e330a82df4b43a745d57a68f6f057 P cd75a17ab2604397adab03bb8b5fd75c [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:20:54.233671 12664 raft_consensus.cc:740] T e77e330a82df4b43a745d57a68f6f057 P cd75a17ab2604397adab03bb8b5fd75c [term 17 LEADER]: Becoming Follower/Learner. State: Replica: cd75a17ab2604397adab03bb8b5fd75c, State: Running, Role: LEADER
I20260709 13:20:54.203219 12497 raft_consensus.cc:3060] T a3022224cc81473690653a83d4e99470 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:20:54.238214  6844 leader_election.cc:304] T 34f36d59d88f40fe8a2805e604fc6c0a P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:20:54.204211 11937 raft_consensus.cc:2749] T a3022224cc81473690653a83d4e99470 P cd75a17ab2604397adab03bb8b5fd75c [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:20:54.234930 12664 consensus_queue.cc:260] T e77e330a82df4b43a745d57a68f6f057 P cd75a17ab2604397adab03bb8b5fd75c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.10, Last appended by leader: 10, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } }
I20260709 13:20:54.241174 12664 raft_consensus.cc:3060] T e77e330a82df4b43a745d57a68f6f057 P cd75a17ab2604397adab03bb8b5fd75c [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:20:54.248556  7466 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:54.264662  6698 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:54.206339 12657 leader_election.cc:290] T be1a92657f494cac8dd227d152f50151 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 18 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
W20260709 13:20:54.280789  6847 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:54.301409  6844 leader_election.cc:304] T d8cee0accdb8499c86d4414b72565a38 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, b7ab4784c7344b939bc36f639286f377
I20260709 13:20:54.211033 12663 leader_election.cc:290] T 20f6842e26174571996b8dea4151d4be P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:20:54.216774 12581 leader_election.cc:290] T f4b8bd455d5a47c18a1380839c6e0d61 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:20:54.216073 12608 leader_election.cc:290] T 7c37d41cd9164c15a6826ca62a851a69 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
W20260709 13:20:54.311100 12527 consensus_meta.cc:287] T 3d65025eea89441290d85dd053810e31 P cd75a17ab2604397adab03bb8b5fd75c: Time spent flushing consensus metadata: real 0.656s	user 0.005s	sys 0.006s
I20260709 13:20:54.311772 12631 raft_consensus.cc:3060] T e31b9971c15848dea59d4d4130141d9e P b7ab4784c7344b939bc36f639286f377 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:54.310935 12666 raft_consensus.cc:493] T 7ba5dac66ab5497e9e336f2a3c28cda5 P cd75a17ab2604397adab03bb8b5fd75c [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 7ba59cc884714e8aa5f3f0ecaed84cbb)
I20260709 13:20:54.349889 12624 raft_consensus.cc:493] T 7887766dc6784fcaa42b35c05fea7a99 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:54.350847 12624 raft_consensus.cc:515] T 7887766dc6784fcaa42b35c05fea7a99 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
W20260709 13:20:54.330104  6730 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.505s	user 0.010s	sys 0.033s
W20260709 13:20:54.352294  6730 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.539s	user 0.010s	sys 0.034s
I20260709 13:20:54.352433  6805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6869f07b5a4885a0b99fbe60c3b175" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:20:54.353128  6805 raft_consensus.cc:3060] T bd6869f07b5a4885a0b99fbe60c3b175 P b7ab4784c7344b939bc36f639286f377 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:20:54.348052  6872 raft_consensus.cc:1275] T 3d65025eea89441290d85dd053810e31 P cd75a17ab2604397adab03bb8b5fd75c [term 17 FOLLOWER]: Refusing update from remote peer ccd8a4c3bfe3413cb2ae219b09aea832: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 17 index: 9. (term mismatch)
I20260709 13:20:54.353756  6872 pending_rounds.cc:85] T 3d65025eea89441290d85dd053810e31 P cd75a17ab2604397adab03bb8b5fd75c: Aborting all ops after (but not including) 8
I20260709 13:20:54.354045  6872 pending_rounds.cc:107] T 3d65025eea89441290d85dd053810e31 P cd75a17ab2604397adab03bb8b5fd75c: Aborting uncommitted NO_OP operation due to leader change: 16.9
I20260709 13:20:54.354302  6872 raft_consensus.cc:2889] T 3d65025eea89441290d85dd053810e31 P cd75a17ab2604397adab03bb8b5fd75c [term 17 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:20:54.351660 12370 raft_consensus.cc:493] T 44bde925b2e541b69890d70715b85176 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:54.355459 12370 raft_consensus.cc:515] T 44bde925b2e541b69890d70715b85176 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:54.355459  6802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c37d41cd9164c15a6826ca62a851a69" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:54.357475  6802 raft_consensus.cc:2468] T 7c37d41cd9164c15a6826ca62a851a69 P b7ab4784c7344b939bc36f639286f377 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 16.
I20260709 13:20:54.313503 12345 raft_consensus.cc:493] T ce4f062dcd314d43a63ca74067cb5ee3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 15 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
W20260709 13:20:54.360957  6697 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 250335us
W20260709 13:20:54.365300  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 85351.9us
W20260709 13:20:54.366344  6772 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 545624us
I20260709 13:20:54.368207 12606 consensus_queue.cc:1048] T 4275cf08e63345f993bce8664eada830 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:20:54.370051  6724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be1a92657f494cac8dd227d152f50151" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:20:54.370636  6724 raft_consensus.cc:3060] T be1a92657f494cac8dd227d152f50151 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:20:54.370726  6730 raft_consensus.cc:1240] T f4b8bd455d5a47c18a1380839c6e0d61 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 17 FOLLOWER]: Rejecting Update request from peer b7ab4784c7344b939bc36f639286f377 for earlier term 16. Current term is 17. Ops: [16.8-16.8]
I20260709 13:20:54.373869  6729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f03d0dbf16864ca4bc1bb5e4c0334c0f" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:20:54.375039  6729 raft_consensus.cc:3060] T f03d0dbf16864ca4bc1bb5e4c0334c0f P ccd8a4c3bfe3413cb2ae219b09aea832 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:54.365904  6697 leader_election.cc:304] T 427c124d773f483294511e80fe340075 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:20:54.318799 12687 raft_consensus.cc:493] T 17587d6730594da4a56fa13a353232a1 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 7ba59cc884714e8aa5f3f0ecaed84cbb)
W20260709 13:20:54.376349  6698 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:54.373430  6695 leader_election.cc:304] T 7c37d41cd9164c15a6826ca62a851a69 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
I20260709 13:20:54.328570 12497 raft_consensus.cc:493] T 4b8cacb381b746da8d0049b0a83b41dd P ccd8a4c3bfe3413cb2ae219b09aea832 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:54.384105  6697 leader_election.cc:304] T 8c7f33e544204fbaac4078e3e83bbf4e P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:20:54.384502  6802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7887766dc6784fcaa42b35c05fea7a99" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:54.357844 12624 leader_election.cc:290] T 7887766dc6784fcaa42b35c05fea7a99 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:54.388445  6802 raft_consensus.cc:2468] T 7887766dc6784fcaa42b35c05fea7a99 P b7ab4784c7344b939bc36f639286f377 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 17.
I20260709 13:20:54.386866  6772 leader_election.cc:304] T d8cee0accdb8499c86d4414b72565a38 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:20:54.393776  6802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22ccee1b570c4ad3a57bd7aec085b1b4" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:54.358126 12370 leader_election.cc:290] T 44bde925b2e541b69890d70715b85176 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:54.360044 12620 raft_consensus.cc:493] T bb7fa124c3bf4ef9ab65a407cb008441 P b7ab4784c7344b939bc36f639286f377 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 7ba59cc884714e8aa5f3f0ecaed84cbb)
I20260709 13:20:54.358853 12594 consensus_queue.cc:1048] T b3f13b31a1f84f0d89d007eadd57924c P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.024s
I20260709 13:20:54.406203  6804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44bde925b2e541b69890d70715b85176" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:54.406970  6804 raft_consensus.cc:2468] T 44bde925b2e541b69890d70715b85176 P b7ab4784c7344b939bc36f639286f377 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 15.
I20260709 13:20:54.404331  6803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a734b5ab7834e05a8c422208acc58b1" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 18 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:54.410180  6803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b56bf91d90824c959e21e0cee5ba1816" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:54.372412 12527 raft_consensus.cc:2749] T d8cee0accdb8499c86d4414b72565a38 P cd75a17ab2604397adab03bb8b5fd75c [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:20:54.412421  6874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77e330a82df4b43a745d57a68f6f057" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:20:54.417037  6874 raft_consensus.cc:2410] T e77e330a82df4b43a745d57a68f6f057 P cd75a17ab2604397adab03bb8b5fd75c [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate b7ab4784c7344b939bc36f639286f377 for term 18 because replica has last-logged OpId of term: 17 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 9.
I20260709 13:20:54.413450  6881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d9def8b32fd443aa94ab1420b06837b" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
W20260709 13:20:54.418802  6773 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:54.413637  6873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3022224cc81473690653a83d4e99470" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:20:54.414023  6879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f00a2e87e56452083b759f60d461ee3" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:20:54.420284  6879 raft_consensus.cc:3060] T 4f00a2e87e56452083b759f60d461ee3 P cd75a17ab2604397adab03bb8b5fd75c [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:20:54.411607  6695 leader_election.cc:304] T 7887766dc6784fcaa42b35c05fea7a99 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
I20260709 13:20:54.384902 12551 raft_consensus.cc:3060] T 3411566abe2d4c9bb4b2adfdd05e6f17 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:54.386547 12582 raft_consensus.cc:2749] T 427c124d773f483294511e80fe340075 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:20:54.391384 12668 raft_consensus.cc:2804] T 7c37d41cd9164c15a6826ca62a851a69 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:20:54.430811  7496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f00a2e87e56452083b759f60d461ee3" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb"
I20260709 13:20:54.434697  6874 raft_consensus.cc:1240] T 9b3759de40694069b13c0f8bd40e5709 P cd75a17ab2604397adab03bb8b5fd75c [term 14 FOLLOWER]: Rejecting Update request from peer b7ab4784c7344b939bc36f639286f377 for earlier term 13. Current term is 14. Ops: []
I20260709 13:20:54.364315 12608 consensus_queue.cc:1059] T f5be3a11b23d4ea9b08300a2789821c7 P ccd8a4c3bfe3413cb2ae219b09aea832 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: INVALID_TERM, Last received: 14.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.044s
I20260709 13:20:54.435945  6801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3411566abe2d4c9bb4b2adfdd05e6f17" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:54.364223 12602 consensus_queue.cc:1059] T 3a485a995abc4807b6e511e45419f737 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: INVALID_TERM, Last received: 15.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.041s
I20260709 13:20:54.362567 12666 raft_consensus.cc:515] T 7ba5dac66ab5497e9e336f2a3c28cda5 P cd75a17ab2604397adab03bb8b5fd75c [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:20:54.430464  6873 raft_consensus.cc:2393] T a3022224cc81473690653a83d4e99470 P cd75a17ab2604397adab03bb8b5fd75c [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate b7ab4784c7344b939bc36f639286f377 in current term 18: Already voted for candidate cd75a17ab2604397adab03bb8b5fd75c in this term.
I20260709 13:20:54.500270  6801 raft_consensus.cc:2468] T 3411566abe2d4c9bb4b2adfdd05e6f17 P b7ab4784c7344b939bc36f639286f377 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 14.
I20260709 13:20:54.540139  6804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30e88460611e47b2ba16a46a30b5f416" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
W20260709 13:20:54.505672  6697 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.68:45071, user_credentials={real_user=slave}} blocked reactor thread for 105816us
I20260709 13:20:54.405037 12492 raft_consensus.cc:493] T b56bf91d90824c959e21e0cee5ba1816 P b7ab4784c7344b939bc36f639286f377 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:54.541482 12492 raft_consensus.cc:515] T b56bf91d90824c959e21e0cee5ba1816 P b7ab4784c7344b939bc36f639286f377 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:54.507949  7500 raft_consensus.cc:3060] T 7a734b5ab7834e05a8c422208acc58b1 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 15 LEARNER]: Advancing to term 17
I20260709 13:20:54.507457  6874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f03d0dbf16864ca4bc1bb5e4c0334c0f" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:20:54.499197  6844 leader_election.cc:304] T f58dc08b12a2494bb9a1372837970ca2 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:20:54.509375  7501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be1a92657f494cac8dd227d152f50151" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb"
I20260709 13:20:54.544505  6874 raft_consensus.cc:3060] T f03d0dbf16864ca4bc1bb5e4c0334c0f P cd75a17ab2604397adab03bb8b5fd75c [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:54.513461  7503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be1a92657f494cac8dd227d152f50151" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:20:54.371402 12345 raft_consensus.cc:515] T ce4f062dcd314d43a63ca74067cb5ee3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } attrs { replace: true } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:20:54.547235  6803 raft_consensus.cc:2468] T b56bf91d90824c959e21e0cee5ba1816 P b7ab4784c7344b939bc36f639286f377 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 16.
I20260709 13:20:54.548633 12492 leader_election.cc:290] T b56bf91d90824c959e21e0cee5ba1816 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:54.433601 12271 raft_consensus.cc:493] T b3f13b31a1f84f0d89d007eadd57924c P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:54.552927  6697 leader_election.cc:304] T 24ee15416e3145beaa1b8183453729a3 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:20:54.430291 12626 raft_consensus.cc:2804] T d8cee0accdb8499c86d4414b72565a38 P b7ab4784c7344b939bc36f639286f377 [term 17 FOLLOWER]: Leader election won for term 17
W20260709 13:20:54.551823  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 52785.4us
I20260709 13:20:54.439311 12535 leader_election.cc:290] T 22ccee1b570c4ad3a57bd7aec085b1b4 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:54.399035 12497 raft_consensus.cc:515] T 4b8cacb381b746da8d0049b0a83b41dd P ccd8a4c3bfe3413cb2ae219b09aea832 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:20:54.437837 12668 raft_consensus.cc:493] T 7c37d41cd9164c15a6826ca62a851a69 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 15 FOLLOWER]: Starting leader election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:20:54.558786  6729 raft_consensus.cc:2468] T f03d0dbf16864ca4bc1bb5e4c0334c0f P ccd8a4c3bfe3413cb2ae219b09aea832 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 17.
I20260709 13:20:54.559361  6844 leader_election.cc:304] T 853ac0a8cbd64ce99457f170216d4d0f P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:20:54.558645  6724 raft_consensus.cc:2468] T be1a92657f494cac8dd227d152f50151 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 18.
W20260709 13:20:54.567682  7468 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:54.576205  6844 leader_election.cc:304] T 22ccee1b570c4ad3a57bd7aec085b1b4 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:20:54.504679 11937 raft_consensus.cc:493] T 713b5728a197487c9300b310ab94e5a3 P cd75a17ab2604397adab03bb8b5fd75c [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:20:54.501385 12694 raft_consensus.cc:2749] T 8c7f33e544204fbaac4078e3e83bbf4e P ccd8a4c3bfe3413cb2ae219b09aea832 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:20:54.580458  6801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20f6842e26174571996b8dea4151d4be" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:54.508219 12686 raft_consensus.cc:493] T 8c7f33e544204fbaac4078e3e83bbf4e P cd75a17ab2604397adab03bb8b5fd75c [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:20:54.419437 12620 raft_consensus.cc:515] T bb7fa124c3bf4ef9ab65a407cb008441 P b7ab4784c7344b939bc36f639286f377 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:20:54.582268  7500 raft_consensus.cc:1275] T 7a734b5ab7834e05a8c422208acc58b1 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 17 LEARNER]: Refusing update from remote peer b7ab4784c7344b939bc36f639286f377: Log matching property violated. Preceding OpId in replica: term: 15 index: 7. Preceding OpId from leader: term: 17 index: 8. (index mismatch)
I20260709 13:20:54.584693  6844 leader_election.cc:304] T de3186201e1a40d0b335eeb8b4e256e0 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:20:54.582625  6805 raft_consensus.cc:2468] T bd6869f07b5a4885a0b99fbe60c3b175 P b7ab4784c7344b939bc36f639286f377 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 18.
I20260709 13:20:54.616575  6874 raft_consensus.cc:2468] T f03d0dbf16864ca4bc1bb5e4c0334c0f P cd75a17ab2604397adab03bb8b5fd75c [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 17.
I20260709 13:20:54.616871  6805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90d42e216d9741e190bca19a781291fd" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:20:54.588711  7496 raft_consensus.cc:2468] T 4f00a2e87e56452083b759f60d461ee3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 18.
I20260709 13:20:54.389947 12687 raft_consensus.cc:515] T 17587d6730594da4a56fa13a353232a1 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:20:54.548826 12345 leader_election.cc:290] T ce4f062dcd314d43a63ca74067cb5ee3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:54.626464  6804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f9c2e2bf644115957398fe4c9459db" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:54.627540  6804 raft_consensus.cc:2468] T f3f9c2e2bf644115957398fe4c9459db P b7ab4784c7344b939bc36f639286f377 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 16.
W20260709 13:20:54.620565  6697 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.68:45071, user_credentials={real_user=slave}} blocked reactor thread for 67701.8us
I20260709 13:20:54.623004  6844 leader_election.cc:304] T 427c124d773f483294511e80fe340075 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:20:54.636709  6844 leader_election.cc:304] T d33d5ee8ef6f415593d8df52063161ad P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:20:54.583467 12668 raft_consensus.cc:3060] T 7c37d41cd9164c15a6826ca62a851a69 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:54.608655 12678 raft_consensus.cc:2749] T 22ccee1b570c4ad3a57bd7aec085b1b4 P cd75a17ab2604397adab03bb8b5fd75c [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:20:54.658212  6873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c37d41cd9164c15a6826ca62a851a69" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:54.608352 12527 raft_consensus.cc:2749] T 853ac0a8cbd64ce99457f170216d4d0f P cd75a17ab2604397adab03bb8b5fd75c [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:20:54.660616  6844 leader_election.cc:304] T 4d9def8b32fd443aa94ab1420b06837b P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:20:54.660730  6874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6869f07b5a4885a0b99fbe60c3b175" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:20:54.672889  6873 raft_consensus.cc:2393] T 7c37d41cd9164c15a6826ca62a851a69 P cd75a17ab2604397adab03bb8b5fd75c [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ccd8a4c3bfe3413cb2ae219b09aea832 in current term 16: Already voted for candidate cd75a17ab2604397adab03bb8b5fd75c in this term.
I20260709 13:20:54.633455 12543 raft_consensus.cc:2749] T de3186201e1a40d0b335eeb8b4e256e0 P cd75a17ab2604397adab03bb8b5fd75c [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:20:54.661981  6804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b3759de40694069b13c0f8bd40e5709" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:20:54.583743 12626 raft_consensus.cc:697] T d8cee0accdb8499c86d4414b72565a38 P b7ab4784c7344b939bc36f639286f377 [term 17 LEADER]: Becoming Leader. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
W20260709 13:20:54.671103  6695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 259554us
I20260709 13:20:54.674949  6874 raft_consensus.cc:3060] T bd6869f07b5a4885a0b99fbe60c3b175 P cd75a17ab2604397adab03bb8b5fd75c [term 16 FOLLOWER]: Advancing to term 18
I20260709 13:20:54.678547  6873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe20b4b48823486ca3b9c648db6ce8aa" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
W20260709 13:20:54.659134  6770 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 221681us
I20260709 13:20:54.660495  6801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4b8bd455d5a47c18a1380839c6e0d61" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:54.560132 12545 raft_consensus.cc:493] T ce4f062dcd314d43a63ca74067cb5ee3 P cd75a17ab2604397adab03bb8b5fd75c [term 15 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:20:54.624588 12370 raft_consensus.cc:2804] T 7887766dc6784fcaa42b35c05fea7a99 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:20:54.657696 12544 raft_consensus.cc:2749] T d33d5ee8ef6f415593d8df52063161ad P cd75a17ab2604397adab03bb8b5fd75c [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:20:54.573634 12271 raft_consensus.cc:515] T b3f13b31a1f84f0d89d007eadd57924c P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:20:54.686815  6873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22ccee1b570c4ad3a57bd7aec085b1b4" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:54.659808 12582 raft_consensus.cc:2749] T 24ee15416e3145beaa1b8183453729a3 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:20:54.666206 12581 raft_consensus.cc:3060] T 427c124d773f483294511e80fe340075 P cd75a17ab2604397adab03bb8b5fd75c [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:54.634449 12624 consensus_queue.cc:1059] T 3a485a995abc4807b6e511e45419f737 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: INVALID_TERM, Last received: 15.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.054s
I20260709 13:20:54.699432  6804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4275cf08e63345f993bce8664eada830" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:54.619369 11937 raft_consensus.cc:515] T 713b5728a197487c9300b310ab94e5a3 P cd75a17ab2604397adab03bb8b5fd75c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:54.694481  6873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7887766dc6784fcaa42b35c05fea7a99" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:54.700628  6801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f03d0dbf16864ca4bc1bb5e4c0334c0f" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:20:54.701849  6801 raft_consensus.cc:2368] T f03d0dbf16864ca4bc1bb5e4c0334c0f P b7ab4784c7344b939bc36f639286f377 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c for earlier term 16. Current term is 17.
I20260709 13:20:54.700723  6874 raft_consensus.cc:2468] T bd6869f07b5a4885a0b99fbe60c3b175 P cd75a17ab2604397adab03bb8b5fd75c [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 18.
I20260709 13:20:54.677596 12558 raft_consensus.cc:2749] T 4d9def8b32fd443aa94ab1420b06837b P cd75a17ab2604397adab03bb8b5fd75c [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:20:54.633633 12697 consensus_queue.cc:1048] T bb3d8792045a4583ae2e965b1350a5b4 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 10, Time since last communication: 0.070s
I20260709 13:20:54.706771  6874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44bde925b2e541b69890d70715b85176" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:54.688560 12370 raft_consensus.cc:493] T 7887766dc6784fcaa42b35c05fea7a99 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:54.694211 12547 raft_consensus.cc:493] T b56bf91d90824c959e21e0cee5ba1816 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:20:54.709056 12688 log.cc:927] Time spent T d33d5ee8ef6f415593d8df52063161ad P b7ab4784c7344b939bc36f639286f377: Append to log took a long time: real 0.270s	user 0.000s	sys 0.001s
I20260709 13:20:54.698624 12689 raft_consensus.cc:493] T d33d5ee8ef6f415593d8df52063161ad P ccd8a4c3bfe3413cb2ae219b09aea832 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:20:54.719810  6801 raft_consensus.cc:1275] T dbdf895bba214ff68685a24fd17dfb5d P b7ab4784c7344b939bc36f639286f377 [term 15 FOLLOWER]: Refusing update from remote peer cd75a17ab2604397adab03bb8b5fd75c: Log matching property violated. Preceding OpId in replica: term: 14 index: 6. Preceding OpId from leader: term: 15 index: 7. (index mismatch)
W20260709 13:20:54.724812  6695 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:54.727957  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 52317.4us
I20260709 13:20:54.629974 12686 raft_consensus.cc:515] T 8c7f33e544204fbaac4078e3e83bbf4e P cd75a17ab2604397adab03bb8b5fd75c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:54.707862 12661 raft_consensus.cc:493] T c4db81d9d329422bb3b4160ca4ac2d1d P b7ab4784c7344b939bc36f639286f377 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:54.701997 12545 raft_consensus.cc:515] T ce4f062dcd314d43a63ca74067cb5ee3 P cd75a17ab2604397adab03bb8b5fd75c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } attrs { replace: true } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
W20260709 13:20:54.735561  6847 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:54.735874  6844 leader_election.cc:304] T bd6869f07b5a4885a0b99fbe60c3b175 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377
I20260709 13:20:54.714695 12345 raft_consensus.cc:493] T 3fa34c08b205435dba97346991aa1f92 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:54.717978 12370 raft_consensus.cc:3060] T 7887766dc6784fcaa42b35c05fea7a99 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:20:54.746652  6844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:54.753778  6844 leader_election.cc:304] T 3411566abe2d4c9bb4b2adfdd05e6f17 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:20:54.705717 12566 consensus_queue.cc:1059] T f4b8bd455d5a47c18a1380839c6e0d61 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: INVALID_TERM, Last received: 14.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.030s
I20260709 13:20:54.755442  6880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b8cacb381b746da8d0049b0a83b41dd" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:54.764565  6880 raft_consensus.cc:2468] T 4b8cacb381b746da8d0049b0a83b41dd P cd75a17ab2604397adab03bb8b5fd75c [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 17.
I20260709 13:20:54.758353  6844 leader_election.cc:304] T f3f9c2e2bf644115957398fe4c9459db P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:20:54.767174  6844 leader_election.cc:400] T f03d0dbf16864ca4bc1bb5e4c0334c0f P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 16 election: Vote denied by peer b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817) with higher term. Message: Invalid argument: T f03d0dbf16864ca4bc1bb5e4c0334c0f P b7ab4784c7344b939bc36f639286f377 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c for earlier term 16. Current term is 17.
I20260709 13:20:54.767616  6844 leader_election.cc:403] T f03d0dbf16864ca4bc1bb5e4c0334c0f P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 16 election: Cancelling election due to peer responding with higher term
I20260709 13:20:54.772583 12544 raft_consensus.cc:2804] T 3411566abe2d4c9bb4b2adfdd05e6f17 P cd75a17ab2604397adab03bb8b5fd75c [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:20:54.773232 12544 raft_consensus.cc:493] T 3411566abe2d4c9bb4b2adfdd05e6f17 P cd75a17ab2604397adab03bb8b5fd75c [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:54.773607 12544 raft_consensus.cc:3060] T 3411566abe2d4c9bb4b2adfdd05e6f17 P cd75a17ab2604397adab03bb8b5fd75c [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:54.749794 12345 raft_consensus.cc:515] T 3fa34c08b205435dba97346991aa1f92 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:20:54.778518 12345 leader_election.cc:290] T 3fa34c08b205435dba97346991aa1f92 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:54.780417 12673 raft_consensus.cc:493] T fe20b4b48823486ca3b9c648db6ce8aa P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 13 FOLLOWER]: Starting pre-election (detected failure of leader cd75a17ab2604397adab03bb8b5fd75c)
I20260709 13:20:54.781354 12673 raft_consensus.cc:515] T fe20b4b48823486ca3b9c648db6ce8aa P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:20:54.784415  6880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce4f062dcd314d43a63ca74067cb5ee3" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:54.791909  6879 raft_consensus.cc:2468] T 4f00a2e87e56452083b759f60d461ee3 P cd75a17ab2604397adab03bb8b5fd75c [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 18.
I20260709 13:20:54.796244  6879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fa34c08b205435dba97346991aa1f92" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 21 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:54.796865  6801 raft_consensus.cc:1275] T 95a75bfe094d4bdc963aba3f08dfcd25 P b7ab4784c7344b939bc36f639286f377 [term 14 FOLLOWER]: Refusing update from remote peer cd75a17ab2604397adab03bb8b5fd75c: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:20:54.746021 12678 raft_consensus.cc:2764] T bd6869f07b5a4885a0b99fbe60c3b175 P cd75a17ab2604397adab03bb8b5fd75c [term 18 FOLLOWER]: Leader pre-election decision vote started in defunct term 16: won
I20260709 13:20:54.822157  6879 raft_consensus.cc:1240] T 4f00a2e87e56452083b759f60d461ee3 P cd75a17ab2604397adab03bb8b5fd75c [term 18 FOLLOWER]: Rejecting Update request from peer 7ba59cc884714e8aa5f3f0ecaed84cbb for earlier term 17. Current term is 18. Ops: []
I20260709 13:20:54.730770 12547 raft_consensus.cc:515] T b56bf91d90824c959e21e0cee5ba1816 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:54.820725 12497 leader_election.cc:290] T 4b8cacb381b746da8d0049b0a83b41dd P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:20:54.817601 12686 leader_election.cc:290] T 8c7f33e544204fbaac4078e3e83bbf4e P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:20:54.823143  6880 raft_consensus.cc:2468] T ce4f062dcd314d43a63ca74067cb5ee3 P cd75a17ab2604397adab03bb8b5fd75c [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in term 15.
I20260709 13:20:54.734819 12689 raft_consensus.cc:515] T d33d5ee8ef6f415593d8df52063161ad P ccd8a4c3bfe3413cb2ae219b09aea832 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
W20260709 13:20:54.832185 12702 log.cc:927] Time spent T be1a92657f494cac8dd227d152f50151 P 7ba59cc884714e8aa5f3f0ecaed84cbb: Append to log took a long time: real 0.273s	user 0.000s	sys 0.001s
I20260709 13:20:54.797820 12527 raft_consensus.cc:2804] T f3f9c2e2bf644115957398fe4c9459db P cd75a17ab2604397adab03bb8b5fd75c [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:20:54.833637 12552 leader_election.cc:290] T ab432e62819d499eaaf3dd55481dd930 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:20:54.838685 12545 leader_election.cc:290] T ce4f062dcd314d43a63ca74067cb5ee3 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:20:54.842356 12558 raft_consensus.cc:2749] T f03d0dbf16864ca4bc1bb5e4c0334c0f P cd75a17ab2604397adab03bb8b5fd75c [term 17 FOLLOWER]: Leader election lost for term 16. Reason: Vote denied by peer b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817) with higher term. Message: Invalid argument: T f03d0dbf16864ca4bc1bb5e4c0334c0f P b7ab4784c7344b939bc36f639286f377 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c for earlier term 16. Current term is 17.
I20260709 13:20:54.750386 12626 consensus_queue.cc:237] T d8cee0accdb8499c86d4414b72565a38 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.12, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:20:54.846868 12544 raft_consensus.cc:515] T 3411566abe2d4c9bb4b2adfdd05e6f17 P cd75a17ab2604397adab03bb8b5fd75c [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
W20260709 13:20:54.848212 12701 log.cc:927] Time spent T 7c44c4849aa54f2b94d1f1bef9ed546f P ccd8a4c3bfe3413cb2ae219b09aea832: Append to log took a long time: real 0.173s	user 0.001s	sys 0.000s
I20260709 13:20:54.745451 12661 raft_consensus.cc:515] T c4db81d9d329422bb3b4160ca4ac2d1d P b7ab4784c7344b939bc36f639286f377 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:54.827484 12345 raft_consensus.cc:493] T d8cee0accdb8499c86d4414b72565a38 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:20:54.877316 12696 log.cc:927] Time spent T 8c7f33e544204fbaac4078e3e83bbf4e P b7ab4784c7344b939bc36f639286f377: Append to log took a long time: real 0.091s	user 0.000s	sys 0.000s
I20260709 13:20:54.877591 12687 leader_election.cc:290] T 17587d6730594da4a56fa13a353232a1 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:20:54.878141  6806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17587d6730594da4a56fa13a353232a1" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:54.878648 12689 leader_election.cc:290] T d33d5ee8ef6f415593d8df52063161ad P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:54.879194  6806 raft_consensus.cc:2393] T 17587d6730594da4a56fa13a353232a1 P b7ab4784c7344b939bc36f639286f377 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ccd8a4c3bfe3413cb2ae219b09aea832 in current term 21: Already voted for candidate b7ab4784c7344b939bc36f639286f377 in this term.
W20260709 13:20:54.879941 12631 consensus_meta.cc:287] T e31b9971c15848dea59d4d4130141d9e P b7ab4784c7344b939bc36f639286f377: Time spent flushing consensus metadata: real 0.532s	user 0.011s	sys 0.000s
W20260709 13:20:54.881383 12679 consensus_meta.cc:287] T 9e326172347f45e99a0d482b5d8ef768 P cd75a17ab2604397adab03bb8b5fd75c: Time spent flushing consensus metadata: real 0.615s	user 0.011s	sys 0.001s
I20260709 13:20:54.883497 12544 leader_election.cc:290] T 3411566abe2d4c9bb4b2adfdd05e6f17 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 15 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:20:54.849359 12581 raft_consensus.cc:2749] T 427c124d773f483294511e80fe340075 P cd75a17ab2604397adab03bb8b5fd75c [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:20:54.850041 11937 leader_election.cc:290] T 713b5728a197487c9300b310ab94e5a3 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
W20260709 13:20:54.850492 12699 log.cc:927] Time spent T e77e330a82df4b43a745d57a68f6f057 P b7ab4784c7344b939bc36f639286f377: Append to log took a long time: real 0.337s	user 0.002s	sys 0.000s
I20260709 13:20:54.853901 12427 raft_consensus.cc:493] T 07a92dd554674067a83a9cb68c4773f2 P b7ab4784c7344b939bc36f639286f377 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:54.795034 12685 raft_consensus.cc:493] T 427c124d773f483294511e80fe340075 P b7ab4784c7344b939bc36f639286f377 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 7ba59cc884714e8aa5f3f0ecaed84cbb)
I20260709 13:20:54.851405 12370 raft_consensus.cc:515] T 7887766dc6784fcaa42b35c05fea7a99 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:54.857673  6879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe20b4b48823486ca3b9c648db6ce8aa" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
W20260709 13:20:54.843532 12335 consensus_meta.cc:287] T 7887766dc6784fcaa42b35c05fea7a99 P cd75a17ab2604397adab03bb8b5fd75c: Time spent flushing consensus metadata: real 0.700s	user 0.006s	sys 0.003s
I20260709 13:20:54.863924  6695 leader_election.cc:304] T 44bde925b2e541b69890d70715b85176 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
I20260709 13:20:54.829015 12271 leader_election.cc:290] T b3f13b31a1f84f0d89d007eadd57924c P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:20:54.830133 12673 leader_election.cc:290] T fe20b4b48823486ca3b9c648db6ce8aa P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:54.866801 12666 leader_election.cc:290] T 7ba5dac66ab5497e9e336f2a3c28cda5 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:20:54.870419 12527 raft_consensus.cc:493] T f3f9c2e2bf644115957398fe4c9459db P cd75a17ab2604397adab03bb8b5fd75c [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:54.906688  6879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d33d5ee8ef6f415593d8df52063161ad" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:54.904714  6695 leader_election.cc:304] T bd6869f07b5a4885a0b99fbe60c3b175 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
I20260709 13:20:54.892457 12616 raft_consensus.cc:493] T 17587d6730594da4a56fa13a353232a1 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:54.917631  6879 raft_consensus.cc:2468] T d33d5ee8ef6f415593d8df52063161ad P cd75a17ab2604397adab03bb8b5fd75c [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 14.
I20260709 13:20:54.929596  6772 leader_election.cc:304] T 17587d6730594da4a56fa13a353232a1 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, b7ab4784c7344b939bc36f639286f377; no voters: ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:20:54.911980 12335 raft_consensus.cc:2749] T 7887766dc6784fcaa42b35c05fea7a99 P cd75a17ab2604397adab03bb8b5fd75c [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:20:54.960623  6799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d33d5ee8ef6f415593d8df52063161ad" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:54.911886 12691 raft_consensus.cc:2804] T 44bde925b2e541b69890d70715b85176 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:20:54.917286 12527 raft_consensus.cc:3060] T f3f9c2e2bf644115957398fe4c9459db P cd75a17ab2604397adab03bb8b5fd75c [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:54.911034 12610 raft_consensus.cc:2749] T f58dc08b12a2494bb9a1372837970ca2 P cd75a17ab2604397adab03bb8b5fd75c [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:20:54.894819 12345 raft_consensus.cc:515] T d8cee0accdb8499c86d4414b72565a38 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:20:54.969825  6873 raft_consensus.cc:2468] T 7887766dc6784fcaa42b35c05fea7a99 P cd75a17ab2604397adab03bb8b5fd75c [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 17.
I20260709 13:20:54.956364 12159 raft_consensus.cc:493] T ab432e62819d499eaaf3dd55481dd930 P b7ab4784c7344b939bc36f639286f377 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:54.911098 12427 raft_consensus.cc:515] T 07a92dd554674067a83a9cb68c4773f2 P b7ab4784c7344b939bc36f639286f377 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:54.924542 12689 raft_consensus.cc:2804] T bd6869f07b5a4885a0b99fbe60c3b175 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:20:54.965976 12691 raft_consensus.cc:493] T 44bde925b2e541b69890d70715b85176 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:54.919661 12620 leader_election.cc:290] T bb7fa124c3bf4ef9ab65a407cb008441 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:20:54.966612 12692 raft_consensus.cc:2804] T 17587d6730594da4a56fa13a353232a1 P b7ab4784c7344b939bc36f639286f377 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:20:54.924762 12616 raft_consensus.cc:515] T 17587d6730594da4a56fa13a353232a1 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:20:54.911782 12685 raft_consensus.cc:515] T 427c124d773f483294511e80fe340075 P b7ab4784c7344b939bc36f639286f377 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } attrs { replace: true } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:20:54.989379 12712 consensus_queue.cc:1048] T 7a734b5ab7834e05a8c422208acc58b1 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: NON_VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.027s
W20260709 13:20:54.990427  6773 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:55.010087  6727 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50004 (request call id 2704) took 1303 ms. Trace:
I20260709 13:20:55.038403  6772 leader_election.cc:304] T 4d9def8b32fd443aa94ab1420b06837b P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:20:55.037470  6727 rpcz_store.cc:276] 0709 13:20:53.707241 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:53.708497 (+  1256us) service_pool.cc:224] Handling call
0709 13:20:53.711672 (+  3175us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 13:20:53.712493 (+   821us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:53.712537 (+    44us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 13:20:53.743677 (+ 31140us) log.cc:844] Serialized 551 byte log entry
0709 13:20:54.209856 (+466179us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:20:54.302439 (+ 92583us) log.cc:844] Serialized 14 byte log entry
0709 13:20:54.400764 (+ 98325us) log.cc:844] Serialized 14 byte log entry
0709 13:20:54.572715 (+171951us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:54.573786 (+  1071us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:54.900368 (+326582us) spinlock_profiling.cc:243] Waited 5.12 ms on lock 0x7b18003f44e0. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc15785de1 00007fcc157925b1 00007fcc0c8bd3f3 00007fcc0c8bf7c1 00007fcc0c8bf779 00007fcc0c8bf709 00007fcc0c8bf6d1 00007fcc0c8be9cd 000000000038f354 000000000038f199 00007fcc0c8a083a
0709 13:20:55.009816 (+109448us) raft_consensus.cc:1685] finished
0709 13:20:55.009842 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:55.010020 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":237047,"prepare.queue_time_us":11523,"prepare.run_wall_time_us":51,"raft.queue_time_us":319820,"raft.run_cpu_time_us":873,"raft.run_wall_time_us":29446,"spinlock_wait_cycles":154707584,"thread_start_us":554454,"threads_started":2,"wal-append.queue_time_us":767093}
I20260709 13:20:55.040127  7494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb7fa124c3bf4ef9ab65a407cb008441" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:20:55.007745 12661 leader_election.cc:290] T c4db81d9d329422bb3b4160ca4ac2d1d P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:55.012749 12275 raft_consensus.cc:3055] T f4b8bd455d5a47c18a1380839c6e0d61 P b7ab4784c7344b939bc36f639286f377 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:20:55.014660 12427 leader_election.cc:290] T 07a92dd554674067a83a9cb68c4773f2 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:54.983560 12691 raft_consensus.cc:3060] T 44bde925b2e541b69890d70715b85176 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:55.016805 12370 leader_election.cc:290] T 7887766dc6784fcaa42b35c05fea7a99 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 18 election: Requested vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:55.012871  6875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b56bf91d90824c959e21e0cee5ba1816" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:55.050557  6875 raft_consensus.cc:2410] T b56bf91d90824c959e21e0cee5ba1816 P cd75a17ab2604397adab03bb8b5fd75c [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ccd8a4c3bfe3413cb2ae219b09aea832 for term 17 because replica has last-logged OpId of term: 15 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 9.
I20260709 13:20:55.017529 12692 raft_consensus.cc:697] T 17587d6730594da4a56fa13a353232a1 P b7ab4784c7344b939bc36f639286f377 [term 21 LEADER]: Becoming Leader. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
I20260709 13:20:54.978029 12159 raft_consensus.cc:515] T ab432e62819d499eaaf3dd55481dd930 P b7ab4784c7344b939bc36f639286f377 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:55.026543 12668 raft_consensus.cc:515] T 7c37d41cd9164c15a6826ca62a851a69 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:55.028263 12689 raft_consensus.cc:697] T bd6869f07b5a4885a0b99fbe60c3b175 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 18 LEADER]: Becoming Leader. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
I20260709 13:20:54.991088  6877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b56bf91d90824c959e21e0cee5ba1816" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:55.056660  6877 raft_consensus.cc:2410] T b56bf91d90824c959e21e0cee5ba1816 P cd75a17ab2604397adab03bb8b5fd75c [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7ab4784c7344b939bc36f639286f377 for term 17 because replica has last-logged OpId of term: 15 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 9.
I20260709 13:20:54.997879 12345 leader_election.cc:290] T d8cee0accdb8499c86d4414b72565a38 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:54.999280  6879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8cee0accdb8499c86d4414b72565a38" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:55.066882  6879 raft_consensus.cc:2468] T d8cee0accdb8499c86d4414b72565a38 P cd75a17ab2604397adab03bb8b5fd75c [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in term 17.
I20260709 13:20:55.000933 12547 leader_election.cc:290] T b56bf91d90824c959e21e0cee5ba1816 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:55.002856  6799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7887766dc6784fcaa42b35c05fea7a99" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:20:55.070461  6799 raft_consensus.cc:3060] T 7887766dc6784fcaa42b35c05fea7a99 P b7ab4784c7344b939bc36f639286f377 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:20:55.003229  6806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b56bf91d90824c959e21e0cee5ba1816" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:55.071588  6806 raft_consensus.cc:2468] T b56bf91d90824c959e21e0cee5ba1816 P b7ab4784c7344b939bc36f639286f377 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 16.
I20260709 13:20:55.045365  6801 raft_consensus.cc:1240] T 4d9def8b32fd443aa94ab1420b06837b P b7ab4784c7344b939bc36f639286f377 [term 16 FOLLOWER]: Rejecting Update request from peer ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 15. Current term is 16. Ops: []
I20260709 13:20:55.035548 12658 raft_consensus.cc:493] T 4275cf08e63345f993bce8664eada830 P b7ab4784c7344b939bc36f639286f377 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:20:55.054369  6772 leader_election.cc:304] T a3022224cc81473690653a83d4e99470 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:20:55.047709 12275 raft_consensus.cc:740] T f4b8bd455d5a47c18a1380839c6e0d61 P b7ab4784c7344b939bc36f639286f377 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
I20260709 13:20:55.083735  7468 leader_election.cc:304] T d8cee0accdb8499c86d4414b72565a38 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:20:55.084300 12658 raft_consensus.cc:515] T 4275cf08e63345f993bce8664eada830 P b7ab4784c7344b939bc36f639286f377 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:55.084901 12345 raft_consensus.cc:2804] T d8cee0accdb8499c86d4414b72565a38 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:20:55.085433 12345 raft_consensus.cc:493] T d8cee0accdb8499c86d4414b72565a38 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:55.085793 12345 raft_consensus.cc:3060] T d8cee0accdb8499c86d4414b72565a38 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:20:55.080179  6875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7887766dc6784fcaa42b35c05fea7a99" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:20:55.083812  6879 raft_consensus.cc:1275] T a1704639a875409b9959353527b3fd68 P cd75a17ab2604397adab03bb8b5fd75c [term 17 FOLLOWER]: Refusing update from remote peer b7ab4784c7344b939bc36f639286f377: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:20:55.088802 12427 raft_consensus.cc:2749] T 4d9def8b32fd443aa94ab1420b06837b P b7ab4784c7344b939bc36f639286f377 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:20:55.083490 12275 consensus_queue.cc:260] T f4b8bd455d5a47c18a1380839c6e0d61 P b7ab4784c7344b939bc36f639286f377 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 16.8, Last appended by leader: 8, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:55.089847  6875 raft_consensus.cc:1275] T e77e330a82df4b43a745d57a68f6f057 P cd75a17ab2604397adab03bb8b5fd75c [term 18 FOLLOWER]: Refusing update from remote peer b7ab4784c7344b939bc36f639286f377: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 18 index: 10. (term mismatch)
I20260709 13:20:55.090287  6875 pending_rounds.cc:85] T e77e330a82df4b43a745d57a68f6f057 P cd75a17ab2604397adab03bb8b5fd75c: Aborting all ops after (but not including) 9
I20260709 13:20:55.090627  6875 pending_rounds.cc:107] T e77e330a82df4b43a745d57a68f6f057 P cd75a17ab2604397adab03bb8b5fd75c: Aborting uncommitted NO_OP operation due to leader change: 17.10
I20260709 13:20:55.090868  6875 raft_consensus.cc:2889] T e77e330a82df4b43a745d57a68f6f057 P cd75a17ab2604397adab03bb8b5fd75c [term 18 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:20:55.091440 12668 leader_election.cc:290] T 7c37d41cd9164c15a6826ca62a851a69 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 16 election: Requested vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:55.081306  6877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb7fa124c3bf4ef9ab65a407cb008441" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
W20260709 13:20:55.089906 12690 log.cc:927] Time spent T bb7fa124c3bf4ef9ab65a407cb008441 P 7ba59cc884714e8aa5f3f0ecaed84cbb: Append to log took a long time: real 0.548s	user 0.010s	sys 0.004s
I20260709 13:20:55.093231 12159 leader_election.cc:290] T ab432e62819d499eaaf3dd55481dd930 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:55.090322 12275 raft_consensus.cc:3060] T f4b8bd455d5a47c18a1380839c6e0d61 P b7ab4784c7344b939bc36f639286f377 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:55.094338 12689 consensus_queue.cc:237] T bd6869f07b5a4885a0b99fbe60c3b175 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 16.8, Last appended by leader: 8, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:55.098228  6799 raft_consensus.cc:2468] T 7887766dc6784fcaa42b35c05fea7a99 P b7ab4784c7344b939bc36f639286f377 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 18.
I20260709 13:20:55.098798 12616 leader_election.cc:290] T 17587d6730594da4a56fa13a353232a1 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:20:55.099601  6772 leader_election.cc:304] T f03d0dbf16864ca4bc1bb5e4c0334c0f P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:20:55.099738 12692 consensus_queue.cc:237] T 17587d6730594da4a56fa13a353232a1 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 20.14, Last appended by leader: 14, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:20:55.100831 12345 raft_consensus.cc:515] T d8cee0accdb8499c86d4414b72565a38 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:20:55.103451  6695 leader_election.cc:304] T b56bf91d90824c959e21e0cee5ba1816 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
I20260709 13:20:55.048559 12698 raft_consensus.cc:493] T de3186201e1a40d0b335eeb8b4e256e0 P b7ab4784c7344b939bc36f639286f377 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:20:55.106346  6772 leader_election.cc:304] T 4f00a2e87e56452083b759f60d461ee3 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:20:55.125932  6881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8cee0accdb8499c86d4414b72565a38" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:20:55.126731  6881 raft_consensus.cc:3060] T d8cee0accdb8499c86d4414b72565a38 P cd75a17ab2604397adab03bb8b5fd75c [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:20:55.134835  6695 leader_election.cc:304] T 7887766dc6784fcaa42b35c05fea7a99 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
I20260709 13:20:55.104803 12661 raft_consensus.cc:2749] T a3022224cc81473690653a83d4e99470 P b7ab4784c7344b939bc36f639286f377 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:20:55.176708  6772 leader_election.cc:304] T bb7fa124c3bf4ef9ab65a407cb008441 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:20:55.117184 12668 raft_consensus.cc:2804] T b56bf91d90824c959e21e0cee5ba1816 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:20:55.179025  6877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4db81d9d329422bb3b4160ca4ac2d1d" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:55.181329  5625 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:20:55.130209 12626 consensus_queue.cc:1048] T a1704639a875409b9959353527b3fd68 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.050s
W20260709 13:20:55.184231  6695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 53732.5us
I20260709 13:20:55.114130 12620 raft_consensus.cc:2804] T f03d0dbf16864ca4bc1bb5e4c0334c0f P b7ab4784c7344b939bc36f639286f377 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:20:55.065793 12712 consensus_queue.cc:1059] T 9b3759de40694069b13c0f8bd40e5709 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.065s
I20260709 13:20:55.114210 12345 leader_election.cc:290] T d8cee0accdb8499c86d4414b72565a38 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 18 election: Requested vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:55.224454  6879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a92dd554674067a83a9cb68c4773f2" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:55.221277  6875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c37d41cd9164c15a6826ca62a851a69" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:20:55.128681 12503 raft_consensus.cc:2804] T 4f00a2e87e56452083b759f60d461ee3 P b7ab4784c7344b939bc36f639286f377 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:20:55.194443  6881 raft_consensus.cc:2468] T d8cee0accdb8499c86d4414b72565a38 P cd75a17ab2604397adab03bb8b5fd75c [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in term 18.
I20260709 13:20:55.222688  7494 raft_consensus.cc:2955] T 7a734b5ab7834e05a8c422208acc58b1 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 17 LEARNER]: Committing config change with OpId 13.6: config changed from index -1 to 6, NON_VOTER 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68) added. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } attrs { replace: true } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: NON_VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: true } } }
I20260709 13:20:55.228404  6877 raft_consensus.cc:2468] T c4db81d9d329422bb3b4160ca4ac2d1d P cd75a17ab2604397adab03bb8b5fd75c [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 16.
I20260709 13:20:55.240680  7468 leader_election.cc:304] T d8cee0accdb8499c86d4414b72565a38 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:20:55.175077 12535 consensus_queue.cc:1059] T 4d9def8b32fd443aa94ab1420b06837b P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: INVALID_TERM, Last received: 15.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.059s
I20260709 13:20:55.242156 12685 leader_election.cc:290] T 427c124d773f483294511e80fe340075 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:20:55.242578 12527 raft_consensus.cc:515] T f3f9c2e2bf644115957398fe4c9459db P cd75a17ab2604397adab03bb8b5fd75c [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:55.137442 12568 consensus_queue.cc:1048] T e77e330a82df4b43a745d57a68f6f057 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.092s
I20260709 13:20:55.242291 12708 raft_consensus.cc:493] T f58dc08b12a2494bb9a1372837970ca2 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:20:55.220461 12668 raft_consensus.cc:493] T b56bf91d90824c959e21e0cee5ba1816 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:55.185557 12707 raft_consensus.cc:493] T 404190ce4ce94cecbfcb6ea9d1dd8626 P b7ab4784c7344b939bc36f639286f377 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:20:55.223784 12370 raft_consensus.cc:2804] T 7887766dc6784fcaa42b35c05fea7a99 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:20:55.252259  6875 raft_consensus.cc:2393] T 7c37d41cd9164c15a6826ca62a851a69 P cd75a17ab2604397adab03bb8b5fd75c [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate ccd8a4c3bfe3413cb2ae219b09aea832 in current term 16: Already voted for candidate cd75a17ab2604397adab03bb8b5fd75c in this term.
I20260709 13:20:55.256243 12673 raft_consensus.cc:2804] T d8cee0accdb8499c86d4414b72565a38 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:20:55.259871  6802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c37d41cd9164c15a6826ca62a851a69" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:20:55.263773  6881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab432e62819d499eaaf3dd55481dd930" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:55.234139 12661 raft_consensus.cc:493] T 1528ab62b6fe4e3099d08f141afee116 P b7ab4784c7344b939bc36f639286f377 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:20:55.268250  6881 raft_consensus.cc:2468] T ab432e62819d499eaaf3dd55481dd930 P cd75a17ab2604397adab03bb8b5fd75c [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 18.
I20260709 13:20:55.117805 12698 raft_consensus.cc:515] T de3186201e1a40d0b335eeb8b4e256e0 P b7ab4784c7344b939bc36f639286f377 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:55.260165 12668 raft_consensus.cc:3060] T b56bf91d90824c959e21e0cee5ba1816 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:55.265887 12707 raft_consensus.cc:515] T 404190ce4ce94cecbfcb6ea9d1dd8626 P b7ab4784c7344b939bc36f639286f377 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:20:55.283130  6878 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53416 (request call id 3439) took 1484 ms. Trace:
I20260709 13:20:55.283749  6878 rpcz_store.cc:276] 0709 13:20:53.798487 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:53.872591 (+ 74104us) service_pool.cc:224] Handling call
0709 13:20:53.872933 (+   342us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:54.189257 (+316324us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:55.282804 (+1093547us) spinlock_profiling.cc:243] Waited 311 ms on lock 0x7b540021a2d4. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f9aae01 00007fcc0f9a983e 00007fcc1496e419 00007fcc0dee5bd4 00007fcc0dee5b62 00007fcc0dee5a91 00007fcc0dee5a0c 00007fcc0dee4cc2 00007fcc0dce548c 00007fcc0dce48c6
0709 13:20:55.283048 (+   244us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":715600768}
I20260709 13:20:55.286806  6879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "427c124d773f483294511e80fe340075" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:55.287777  6879 raft_consensus.cc:2468] T 427c124d773f483294511e80fe340075 P cd75a17ab2604397adab03bb8b5fd75c [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 15.
I20260709 13:20:55.265245 12712 raft_consensus.cc:2749] T bb7fa124c3bf4ef9ab65a407cb008441 P b7ab4784c7344b939bc36f639286f377 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:20:55.267449 12370 raft_consensus.cc:697] T 7887766dc6784fcaa42b35c05fea7a99 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 18 LEADER]: Becoming Leader. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
I20260709 13:20:55.253041 12708 raft_consensus.cc:515] T f58dc08b12a2494bb9a1372837970ca2 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:55.306427  6802 raft_consensus.cc:2468] T 7c37d41cd9164c15a6826ca62a851a69 P b7ab4784c7344b939bc36f639286f377 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 16.
I20260709 13:20:55.272006 12673 raft_consensus.cc:697] T d8cee0accdb8499c86d4414b72565a38 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 18 LEADER]: Becoming Leader. State: Replica: 7ba59cc884714e8aa5f3f0ecaed84cbb, State: Running, Role: LEADER
W20260709 13:20:55.307507 12718 log.cc:927] Time spent T 8c7f33e544204fbaac4078e3e83bbf4e P cd75a17ab2604397adab03bb8b5fd75c: Append to log took a long time: real 0.077s	user 0.001s	sys 0.000s
I20260709 13:20:55.309024  6872 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53416 (request call id 3444) took 1509 ms. Trace:
I20260709 13:20:55.326109  6872 rpcz_store.cc:276] 0709 13:20:53.799883 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:53.939403 (+139520us) service_pool.cc:224] Handling call
0709 13:20:53.939717 (+   314us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:54.354789 (+415072us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:55.308721 (+953932us) spinlock_profiling.cc:243] Waited 408 ms on lock 0x7b54002198d4. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f9aae01 00007fcc0f9a983e 00007fcc1496e419 00007fcc0dee5bd4 00007fcc0dee5b62 00007fcc0dee5a91 00007fcc0dee5a0c 00007fcc0dee4cc2 00007fcc0dce548c 00007fcc0dce48c6
0709 13:20:55.308949 (+   228us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":938078464}
W20260709 13:20:55.311259  6698 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:55.312945 12580 raft_consensus.cc:3055] T 3a485a995abc4807b6e511e45419f737 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 15 LEADER]: Stepping down as leader of term 15
W20260709 13:20:55.320832 12721 log.cc:927] Time spent T f09c2a98de1a4decabd0ff900dd44caa P ccd8a4c3bfe3413cb2ae219b09aea832: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 13:20:55.273702 12661 raft_consensus.cc:515] T 1528ab62b6fe4e3099d08f141afee116 P b7ab4784c7344b939bc36f639286f377 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:20:55.346838  6727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b56bf91d90824c959e21e0cee5ba1816" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:55.347667  6729 raft_consensus.cc:1275] T a1704639a875409b9959353527b3fd68 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 17 FOLLOWER]: Refusing update from remote peer b7ab4784c7344b939bc36f639286f377: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
W20260709 13:20:55.352403  6772 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.68:45071, user_credentials={real_user=slave}} blocked reactor thread for 175787us
I20260709 13:20:55.354362  7495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "427c124d773f483294511e80fe340075" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:20:55.355362  7495 raft_consensus.cc:2393] T 427c124d773f483294511e80fe340075 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7ab4784c7344b939bc36f639286f377 in current term 15: Already voted for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in this term.
I20260709 13:20:55.365667  6697 leader_election.cc:304] T ab432e62819d499eaaf3dd55481dd930 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377
W20260709 13:20:55.366628  6844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:55.342831 12624 raft_consensus.cc:493] T 3411566abe2d4c9bb4b2adfdd05e6f17 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:55.392788  6697 leader_election.cc:304] T f3f9c2e2bf644115957398fe4c9459db P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377
I20260709 13:20:55.339133 12580 raft_consensus.cc:740] T 3a485a995abc4807b6e511e45419f737 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
I20260709 13:20:55.395046 12503 raft_consensus.cc:697] T 4f00a2e87e56452083b759f60d461ee3 P b7ab4784c7344b939bc36f639286f377 [term 18 LEADER]: Becoming Leader. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
I20260709 13:20:55.341962 12535 raft_consensus.cc:493] T 2c240553ce044eedb41541d72b9475d7 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:20:55.348971 12689 raft_consensus.cc:493] T 7a734b5ab7834e05a8c422208acc58b1 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:20:55.368346 12568 raft_consensus.cc:493] T 7ba5dac66ab5497e9e336f2a3c28cda5 P b7ab4784c7344b939bc36f639286f377 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 7ba59cc884714e8aa5f3f0ecaed84cbb)
I20260709 13:20:55.390240 12271 raft_consensus.cc:493] T 404190ce4ce94cecbfcb6ea9d1dd8626 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 14 FOLLOWER]: Starting pre-election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:20:55.403043 12547 raft_consensus.cc:2804] T ab432e62819d499eaaf3dd55481dd930 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:20:55.428401  7500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3d8792045a4583ae2e965b1350a5b4" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 16 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:20:55.429121  7500 raft_consensus.cc:2468] T bb3d8792045a4583ae2e965b1350a5b4 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 15.
I20260709 13:20:55.432574  7503 raft_consensus.cc:3060] T 95a75bfe094d4bdc963aba3f08dfcd25 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 13 LEARNER]: Advancing to term 14
I20260709 13:20:55.435557 12555 raft_consensus.cc:3060] T 90d42e216d9741e190bca19a781291fd P b7ab4784c7344b939bc36f639286f377 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:55.418051 12535 raft_consensus.cc:515] T 2c240553ce044eedb41541d72b9475d7 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:55.437959 12535 leader_election.cc:290] T 2c240553ce044eedb41541d72b9475d7 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:55.425804 12227 raft_consensus.cc:3060] T 07a92dd554674067a83a9cb68c4773f2 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:55.423332 12625 raft_consensus.cc:2804] T f3f9c2e2bf644115957398fe4c9459db P ccd8a4c3bfe3413cb2ae219b09aea832 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:20:55.440876 12625 raft_consensus.cc:493] T f3f9c2e2bf644115957398fe4c9459db P ccd8a4c3bfe3413cb2ae219b09aea832 [term 15 FOLLOWER]: Starting leader election (detected failure of leader cd75a17ab2604397adab03bb8b5fd75c)
I20260709 13:20:55.441303 12625 raft_consensus.cc:3060] T f3f9c2e2bf644115957398fe4c9459db P ccd8a4c3bfe3413cb2ae219b09aea832 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:55.441542  7503 raft_consensus.cc:1275] T 95a75bfe094d4bdc963aba3f08dfcd25 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 14 LEARNER]: Refusing update from remote peer cd75a17ab2604397adab03bb8b5fd75c: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:20:55.409708 12370 consensus_queue.cc:237] T 7887766dc6784fcaa42b35c05fea7a99 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:55.444470 12727 raft_consensus.cc:3055] T 9b3759de40694069b13c0f8bd40e5709 P b7ab4784c7344b939bc36f639286f377 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:20:55.444952 12727 raft_consensus.cc:740] T 9b3759de40694069b13c0f8bd40e5709 P b7ab4784c7344b939bc36f639286f377 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
I20260709 13:20:55.445420  6874 raft_consensus.cc:2468] T 44bde925b2e541b69890d70715b85176 P cd75a17ab2604397adab03bb8b5fd75c [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 16.
I20260709 13:20:55.450127  6846 leader_election.cc:304] T bb3d8792045a4583ae2e965b1350a5b4 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:20:55.464964  7500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce4f062dcd314d43a63ca74067cb5ee3" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:20:55.466421  7501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ba5dac66ab5497e9e336f2a3c28cda5" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:20:55.468636  7495 raft_consensus.cc:1275] T 3fa34c08b205435dba97346991aa1f92 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 20 FOLLOWER]: Refusing update from remote peer cd75a17ab2604397adab03bb8b5fd75c: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 20 index: 15. (index mismatch)
I20260709 13:20:55.481190 12662 consensus_queue.cc:1048] T 95a75bfe094d4bdc963aba3f08dfcd25 P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: NON_VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:20:55.461346 12547 raft_consensus.cc:697] T ab432e62819d499eaaf3dd55481dd930 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 18 LEADER]: Becoming Leader. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
I20260709 13:20:55.484781 12547 consensus_queue.cc:237] T ab432e62819d499eaaf3dd55481dd930 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.9, Last appended by leader: 9, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:55.488952 12708 leader_election.cc:290] T f58dc08b12a2494bb9a1372837970ca2 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:55.445901 12727 consensus_queue.cc:260] T 9b3759de40694069b13c0f8bd40e5709 P b7ab4784c7344b939bc36f639286f377 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:55.491251 12727 raft_consensus.cc:3060] T 9b3759de40694069b13c0f8bd40e5709 P b7ab4784c7344b939bc36f639286f377 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:55.408464 12624 raft_consensus.cc:515] T 3411566abe2d4c9bb4b2adfdd05e6f17 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:55.480459 12335 raft_consensus.cc:2804] T bb3d8792045a4583ae2e965b1350a5b4 P cd75a17ab2604397adab03bb8b5fd75c [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:20:55.474442 12620 raft_consensus.cc:697] T f03d0dbf16864ca4bc1bb5e4c0334c0f P b7ab4784c7344b939bc36f639286f377 [term 17 LEADER]: Becoming Leader. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
I20260709 13:20:55.425719 12568 raft_consensus.cc:515] T 7ba5dac66ab5497e9e336f2a3c28cda5 P b7ab4784c7344b939bc36f639286f377 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:20:55.525372  7494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe20b4b48823486ca3b9c648db6ce8aa" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:20:55.422106 12689 raft_consensus.cc:515] T 7a734b5ab7834e05a8c422208acc58b1 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } attrs { replace: true } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: NON_VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: true } }
I20260709 13:20:55.429061 12271 raft_consensus.cc:515] T 404190ce4ce94cecbfcb6ea9d1dd8626 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:20:55.527143  6802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce4f062dcd314d43a63ca74067cb5ee3" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:55.537600  6802 raft_consensus.cc:1240] T be1a92657f494cac8dd227d152f50151 P b7ab4784c7344b939bc36f639286f377 [term 18 FOLLOWER]: Rejecting Update request from peer 7ba59cc884714e8aa5f3f0ecaed84cbb for earlier term 17. Current term is 18. Ops: []
I20260709 13:20:55.528210  6806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c240553ce044eedb41541d72b9475d7" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:55.541667  6802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3f13b31a1f84f0d89d007eadd57924c" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:55.529130  6695 leader_election.cc:304] T 7c37d41cd9164c15a6826ca62a851a69 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
I20260709 13:20:55.508201 12335 raft_consensus.cc:493] T bb3d8792045a4583ae2e965b1350a5b4 P cd75a17ab2604397adab03bb8b5fd75c [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:55.535063  7503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b8cacb381b746da8d0049b0a83b41dd" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:20:55.423985 12673 consensus_queue.cc:237] T d8cee0accdb8499c86d4414b72565a38 P 7ba59cc884714e8aa5f3f0ecaed84cbb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:20:55.545279  7503 raft_consensus.cc:2468] T 4b8cacb381b746da8d0049b0a83b41dd P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 17.
I20260709 13:20:55.535674  7500 raft_consensus.cc:1240] T 3fa34c08b205435dba97346991aa1f92 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 20 FOLLOWER]: Rejecting Update request from peer ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 19. Current term is 20. Ops: [19.15-19.15]
I20260709 13:20:55.548059 12517 raft_consensus.cc:2804] T 7c37d41cd9164c15a6826ca62a851a69 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:20:55.551855 12517 raft_consensus.cc:697] T 7c37d41cd9164c15a6826ca62a851a69 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 16 LEADER]: Becoming Leader. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
I20260709 13:20:55.552943 12517 consensus_queue.cc:237] T 7c37d41cd9164c15a6826ca62a851a69 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
W20260709 13:20:55.554406 12695 log.cc:927] Time spent T 9e326172347f45e99a0d482b5d8ef768 P b7ab4784c7344b939bc36f639286f377: Append to log took a long time: real 0.881s	user 0.000s	sys 0.002s
I20260709 13:20:55.555045 12271 leader_election.cc:290] T 404190ce4ce94cecbfcb6ea9d1dd8626 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:20:55.558636 12658 leader_election.cc:290] T 4275cf08e63345f993bce8664eada830 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:55.559902 12620 consensus_queue.cc:237] T f03d0dbf16864ca4bc1bb5e4c0334c0f P b7ab4784c7344b939bc36f639286f377 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:55.530339 12563 raft_consensus.cc:493] T 3d65025eea89441290d85dd053810e31 P cd75a17ab2604397adab03bb8b5fd75c [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:55.564940 12580 consensus_queue.cc:260] T 3a485a995abc4807b6e511e45419f737 P ccd8a4c3bfe3413cb2ae219b09aea832 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:55.565412 12563 raft_consensus.cc:515] T 3d65025eea89441290d85dd053810e31 P cd75a17ab2604397adab03bb8b5fd75c [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:55.566233 12580 raft_consensus.cc:3060] T 3a485a995abc4807b6e511e45419f737 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:55.567675 12563 leader_election.cc:290] T 3d65025eea89441290d85dd053810e31 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
W20260709 13:20:55.569092 12736 log.cc:927] Time spent T 4275cf08e63345f993bce8664eada830 P ccd8a4c3bfe3413cb2ae219b09aea832: Append to log took a long time: real 0.173s	user 0.001s	sys 0.000s
I20260709 13:20:55.571266 12624 leader_election.cc:290] T 3411566abe2d4c9bb4b2adfdd05e6f17 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
W20260709 13:20:55.571831  6847 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:55.575390  7498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17587d6730594da4a56fa13a353232a1" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:20:55.577533 12707 leader_election.cc:290] T 404190ce4ce94cecbfcb6ea9d1dd8626 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:20:55.581380  6802 raft_consensus.cc:1240] T 3a485a995abc4807b6e511e45419f737 P b7ab4784c7344b939bc36f639286f377 [term 16 FOLLOWER]: Rejecting Update request from peer ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 15. Current term is 16. Ops: []
I20260709 13:20:55.547214 12335 raft_consensus.cc:3060] T bb3d8792045a4583ae2e965b1350a5b4 P cd75a17ab2604397adab03bb8b5fd75c [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:55.546419 12708 raft_consensus.cc:493] T a3022224cc81473690653a83d4e99470 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:55.585439  6804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8cee0accdb8499c86d4414b72565a38" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:20:55.584857 12563 raft_consensus.cc:493] T a1704639a875409b9959353527b3fd68 P cd75a17ab2604397adab03bb8b5fd75c [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:55.596881 12563 raft_consensus.cc:515] T a1704639a875409b9959353527b3fd68 P cd75a17ab2604397adab03bb8b5fd75c [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:55.597707 12568 leader_election.cc:290] T 7ba5dac66ab5497e9e336f2a3c28cda5 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
W20260709 13:20:55.587318  6846 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.68:45071, user_credentials={real_user=slave}} blocked reactor thread for 111120us
I20260709 13:20:55.599251 12563 leader_election.cc:290] T a1704639a875409b9959353527b3fd68 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
W20260709 13:20:55.601245 12693 log.cc:927] Time spent T f58dc08b12a2494bb9a1372837970ca2 P b7ab4784c7344b939bc36f639286f377: Append to log took a long time: real 1.089s	user 0.000s	sys 0.004s
I20260709 13:20:55.601142 12625 raft_consensus.cc:515] T f3f9c2e2bf644115957398fe4c9459db P ccd8a4c3bfe3413cb2ae219b09aea832 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:55.522439 12503 consensus_queue.cc:237] T 4f00a2e87e56452083b759f60d461ee3 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 12, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:20:55.603253 12653 raft_consensus.cc:3060] T f5be3a11b23d4ea9b08300a2789821c7 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:20:55.607038 12691 consensus_meta.cc:287] T 44bde925b2e541b69890d70715b85176 P ccd8a4c3bfe3413cb2ae219b09aea832: Time spent flushing consensus metadata: real 0.550s	user 0.011s	sys 0.000s
I20260709 13:20:55.608582 12708 raft_consensus.cc:515] T a3022224cc81473690653a83d4e99470 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:55.599844 12563 raft_consensus.cc:493] T 711ef6523deb4cbe8ef2ba61e1c21c98 P cd75a17ab2604397adab03bb8b5fd75c [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:55.609805 12689 leader_election.cc:290] T 7a734b5ab7834e05a8c422208acc58b1 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:55.610452 12661 leader_election.cc:290] T 1528ab62b6fe4e3099d08f141afee116 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:20:55.612435  6804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "404190ce4ce94cecbfcb6ea9d1dd8626" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:55.613159  6804 raft_consensus.cc:2468] T 404190ce4ce94cecbfcb6ea9d1dd8626 P b7ab4784c7344b939bc36f639286f377 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in term 14.
I20260709 13:20:55.614014  6804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f58dc08b12a2494bb9a1372837970ca2" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
W20260709 13:20:55.587495  6697 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 194850us
I20260709 13:20:55.591621  7498 raft_consensus.cc:2393] T 17587d6730594da4a56fa13a353232a1 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ccd8a4c3bfe3413cb2ae219b09aea832 in current term 21: Already voted for candidate b7ab4784c7344b939bc36f639286f377 in this term.
I20260709 13:20:55.621995  6805 raft_consensus.cc:2468] T 90d42e216d9741e190bca19a781291fd P b7ab4784c7344b939bc36f639286f377 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 17.
I20260709 13:20:55.625437  6804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3411566abe2d4c9bb4b2adfdd05e6f17" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:55.609766 12563 raft_consensus.cc:515] T 711ef6523deb4cbe8ef2ba61e1c21c98 P cd75a17ab2604397adab03bb8b5fd75c [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:55.603590 12625 leader_election.cc:290] T f3f9c2e2bf644115957398fe4c9459db P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 16 election: Requested vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:55.607510 12691 raft_consensus.cc:515] T 44bde925b2e541b69890d70715b85176 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:55.632151 12563 leader_election.cc:290] T 711ef6523deb4cbe8ef2ba61e1c21c98 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:20:55.632947 12563 raft_consensus.cc:493] T d8292e16e5654be6bc408560cf256aaa P cd75a17ab2604397adab03bb8b5fd75c [term 17 FOLLOWER]: Starting pre-election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:20:55.628464 12626 raft_consensus.cc:493] T 90d42e216d9741e190bca19a781291fd P b7ab4784c7344b939bc36f639286f377 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:55.633459 12563 raft_consensus.cc:515] T d8292e16e5654be6bc408560cf256aaa P cd75a17ab2604397adab03bb8b5fd75c [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:55.634095 12691 leader_election.cc:290] T 44bde925b2e541b69890d70715b85176 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 17 election: Requested vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:55.590642 12271 consensus_queue.cc:1059] T be1a92657f494cac8dd227d152f50151 P 7ba59cc884714e8aa5f3f0ecaed84cbb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: INVALID_TERM, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.044s
I20260709 13:20:55.635598 12271 raft_consensus.cc:3055] T be1a92657f494cac8dd227d152f50151 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:20:55.636793 12563 leader_election.cc:290] T d8292e16e5654be6bc408560cf256aaa P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:20:55.611006 12708 leader_election.cc:290] T a3022224cc81473690653a83d4e99470 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:55.641530  6798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17587d6730594da4a56fa13a353232a1" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:55.642828  6798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f9c2e2bf644115957398fe4c9459db" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:20:55.642675 12668 raft_consensus.cc:515] T b56bf91d90824c959e21e0cee5ba1816 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:55.643673  6798 raft_consensus.cc:2393] T f3f9c2e2bf644115957398fe4c9459db P b7ab4784c7344b939bc36f639286f377 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate ccd8a4c3bfe3413cb2ae219b09aea832 in current term 16: Already voted for candidate b7ab4784c7344b939bc36f639286f377 in this term.
I20260709 13:20:55.644088 12271 raft_consensus.cc:740] T be1a92657f494cac8dd227d152f50151 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 7ba59cc884714e8aa5f3f0ecaed84cbb, State: Running, Role: LEADER
I20260709 13:20:55.645480 12271 consensus_queue.cc:260] T be1a92657f494cac8dd227d152f50151 P 7ba59cc884714e8aa5f3f0ecaed84cbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.14, Last appended by leader: 14, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:20:55.647023 12271 raft_consensus.cc:3060] T be1a92657f494cac8dd227d152f50151 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:20:55.649019  6802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8cee0accdb8499c86d4414b72565a38" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:55.654388 12668 leader_election.cc:290] T b56bf91d90824c959e21e0cee5ba1816 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 17 election: Requested vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:55.656366  6727 raft_consensus.cc:2393] T b56bf91d90824c959e21e0cee5ba1816 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7ab4784c7344b939bc36f639286f377 in current term 17: Already voted for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in this term.
I20260709 13:20:55.629112  6804 raft_consensus.cc:2468] T 3411566abe2d4c9bb4b2adfdd05e6f17 P b7ab4784c7344b939bc36f639286f377 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 14.
I20260709 13:20:55.633831 12626 raft_consensus.cc:515] T 90d42e216d9741e190bca19a781291fd P b7ab4784c7344b939bc36f639286f377 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:55.657773  6804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a734b5ab7834e05a8c422208acc58b1" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 18 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:55.659010  6804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3022224cc81473690653a83d4e99470" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:55.661191  6804 raft_consensus.cc:2468] T a3022224cc81473690653a83d4e99470 P b7ab4784c7344b939bc36f639286f377 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 18.
I20260709 13:20:55.662892 12625 raft_consensus.cc:493] T c4db81d9d329422bb3b4160ca4ac2d1d P ccd8a4c3bfe3413cb2ae219b09aea832 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:20:55.663614 12625 raft_consensus.cc:515] T c4db81d9d329422bb3b4160ca4ac2d1d P ccd8a4c3bfe3413cb2ae219b09aea832 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:55.666944 12561 consensus_queue.cc:1048] T dbdf895bba214ff68685a24fd17dfb5d P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:20:55.672859 12626 leader_election.cc:290] T 90d42e216d9741e190bca19a781291fd P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:55.630023  7466 leader_election.cc:304] T 404190ce4ce94cecbfcb6ea9d1dd8626 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, b7ab4784c7344b939bc36f639286f377; no voters: 
W20260709 13:20:55.678300  6697 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 49311.7us
I20260709 13:20:55.678484  6729 raft_consensus.cc:1275] T 9e326172347f45e99a0d482b5d8ef768 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 14 FOLLOWER]: Refusing update from remote peer b7ab4784c7344b939bc36f639286f377: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
W20260709 13:20:55.680483  7466 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 50549.1us
I20260709 13:20:55.686422  6730 raft_consensus.cc:1275] T e77e330a82df4b43a745d57a68f6f057 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 18 FOLLOWER]: Refusing update from remote peer b7ab4784c7344b939bc36f639286f377: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
I20260709 13:20:55.680835  6844 leader_election.cc:304] T b56bf91d90824c959e21e0cee5ba1816 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:20:55.686877  6802 raft_consensus.cc:1240] T 4d9def8b32fd443aa94ab1420b06837b P b7ab4784c7344b939bc36f639286f377 [term 16 FOLLOWER]: Rejecting Update request from peer ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 15. Current term is 16. Ops: []
W20260709 13:20:55.690210  6695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 60098.4us
I20260709 13:20:55.686329  6697 leader_election.cc:304] T 90d42e216d9741e190bca19a781291fd P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:20:55.700441  6770 leader_election.cc:304] T be1a92657f494cac8dd227d152f50151 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb
I20260709 13:20:55.710109  6729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4db81d9d329422bb3b4160ca4ac2d1d" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:55.711098  6729 raft_consensus.cc:2468] T c4db81d9d329422bb3b4160ca4ac2d1d P ccd8a4c3bfe3413cb2ae219b09aea832 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 15.
I20260709 13:20:55.717119  6731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a734b5ab7834e05a8c422208acc58b1" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 18 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:55.718377  6731 raft_consensus.cc:2410] T 7a734b5ab7834e05a8c422208acc58b1 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c for term 18 because replica has last-logged OpId of term: 17 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 7.
I20260709 13:20:55.718629  6728 raft_consensus.cc:1240] T 9e326172347f45e99a0d482b5d8ef768 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 14 FOLLOWER]: Rejecting Update request from peer cd75a17ab2604397adab03bb8b5fd75c for earlier term 13. Current term is 14. Ops: [13.8-13.8]
I20260709 13:20:55.720180  6723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3411566abe2d4c9bb4b2adfdd05e6f17" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:55.721107  6723 raft_consensus.cc:2468] T 3411566abe2d4c9bb4b2adfdd05e6f17 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 14.
I20260709 13:20:55.713850  6729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a92dd554674067a83a9cb68c4773f2" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:55.723063  6729 raft_consensus.cc:2468] T 07a92dd554674067a83a9cb68c4773f2 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 14.
I20260709 13:20:55.675509 12335 raft_consensus.cc:515] T bb3d8792045a4583ae2e965b1350a5b4 P cd75a17ab2604397adab03bb8b5fd75c [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:20:55.728965 12631 consensus_queue.cc:1048] T a1704639a875409b9959353527b3fd68 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:20:55.732563  6729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab432e62819d499eaaf3dd55481dd930" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:55.732996  6695 leader_election.cc:304] T 3411566abe2d4c9bb4b2adfdd05e6f17 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
I20260709 13:20:55.733397  6723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90d42e216d9741e190bca19a781291fd" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:20:55.742444  6799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab432e62819d499eaaf3dd55481dd930" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:55.734488  6728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30e88460611e47b2ba16a46a30b5f416" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:55.730535  6732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "427c124d773f483294511e80fe340075" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:55.742564  6729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f03d0dbf16864ca4bc1bb5e4c0334c0f" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:20:55.744314  6729 raft_consensus.cc:2368] T f03d0dbf16864ca4bc1bb5e4c0334c0f P ccd8a4c3bfe3413cb2ae219b09aea832 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c for earlier term 16. Current term is 17.
I20260709 13:20:55.744274  6728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "404190ce4ce94cecbfcb6ea9d1dd8626" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:55.697232 12616 raft_consensus.cc:2804] T 404190ce4ce94cecbfcb6ea9d1dd8626 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:20:55.747607  6732 raft_consensus.cc:2393] T 427c124d773f483294511e80fe340075 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7ab4784c7344b939bc36f639286f377 in current term 15: Already voted for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in this term.
I20260709 13:20:55.748698  6731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de3186201e1a40d0b335eeb8b4e256e0" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
W20260709 13:20:55.758451  6697 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 57400.7us
I20260709 13:20:55.762202  6804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c7f33e544204fbaac4078e3e83bbf4e" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:55.762466  6801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce4f062dcd314d43a63ca74067cb5ee3" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:55.713480 12594 raft_consensus.cc:493] T 95a75bfe094d4bdc963aba3f08dfcd25 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:55.751333  6728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20f6842e26174571996b8dea4151d4be" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:55.713699 12661 raft_consensus.cc:493] T e31b9971c15848dea59d4d4130141d9e P b7ab4784c7344b939bc36f639286f377 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:55.770738  6770 leader_election.cc:304] T c4db81d9d329422bb3b4160ca4ac2d1d P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
I20260709 13:20:55.771833  6728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90d42e216d9741e190bca19a781291fd" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:55.753767  6798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3411566abe2d4c9bb4b2adfdd05e6f17" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:20:55.753988  6726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f9c2e2bf644115957398fe4c9459db" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:55.772440  6732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4275cf08e63345f993bce8664eada830" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:55.773313  6726 raft_consensus.cc:2468] T f3f9c2e2bf644115957398fe4c9459db P ccd8a4c3bfe3413cb2ae219b09aea832 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 16.
I20260709 13:20:55.713462 12561 raft_consensus.cc:2804] T b56bf91d90824c959e21e0cee5ba1816 P cd75a17ab2604397adab03bb8b5fd75c [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:20:55.762202  6725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b3759de40694069b13c0f8bd40e5709" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:20:55.764091  6695 leader_election.cc:304] T a3022224cc81473690653a83d4e99470 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
I20260709 13:20:55.779805  6874 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53416 (request call id 3455) took 1099 ms. Trace:
I20260709 13:20:55.764693  6697 leader_election.cc:304] T 22ccee1b570c4ad3a57bd7aec085b1b4 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:20:55.765928  6802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ba5dac66ab5497e9e336f2a3c28cda5" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:55.766758 12667 raft_consensus.cc:2804] T 3411566abe2d4c9bb4b2adfdd05e6f17 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:20:55.713146 12738 consensus_queue.cc:1048] T f09c2a98de1a4decabd0ff900dd44caa P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.071s
I20260709 13:20:55.708745 12664 consensus_queue.cc:1048] T 95a75bfe094d4bdc963aba3f08dfcd25 P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.065s
I20260709 13:20:55.745915 12655 raft_consensus.cc:493] T 7c44c4849aa54f2b94d1f1bef9ed546f P b7ab4784c7344b939bc36f639286f377 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:55.754184 12555 consensus_queue.cc:1048] T 9e326172347f45e99a0d482b5d8ef768 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.015s
I20260709 13:20:55.742375 12708 raft_consensus.cc:2749] T 90d42e216d9741e190bca19a781291fd P ccd8a4c3bfe3413cb2ae219b09aea832 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:20:55.713992 12626 raft_consensus.cc:493] T 34f36d59d88f40fe8a2805e604fc6c0a P b7ab4784c7344b939bc36f639286f377 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:55.731281 12692 raft_consensus.cc:2804] T be1a92657f494cac8dd227d152f50151 P b7ab4784c7344b939bc36f639286f377 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:20:55.780110 12563 raft_consensus.cc:493] T f09c2a98de1a4decabd0ff900dd44caa P cd75a17ab2604397adab03bb8b5fd75c [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:55.774614  6798 raft_consensus.cc:3060] T 3411566abe2d4c9bb4b2adfdd05e6f17 P b7ab4784c7344b939bc36f639286f377 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:55.750205  6799 raft_consensus.cc:2468] T ab432e62819d499eaaf3dd55481dd930 P b7ab4784c7344b939bc36f639286f377 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 18.
I20260709 13:20:55.779533 12561 raft_consensus.cc:493] T b56bf91d90824c959e21e0cee5ba1816 P cd75a17ab2604397adab03bb8b5fd75c [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:55.708559 12668 consensus_queue.cc:1048] T 711ef6523deb4cbe8ef2ba61e1c21c98 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.056s
I20260709 13:20:55.781082  6874 rpcz_store.cc:276] 0709 13:20:54.680783 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:54.706486 (+ 25703us) service_pool.cc:224] Handling call
0709 13:20:55.779650 (+1073164us) spinlock_profiling.cc:243] Waited 732 ms on lock 0x7b54001e7dd4. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f9ae2fa 00007fcc1496fb17 00007fcc0deea6d4 00007fcc0deea662 00007fcc0deea591 00007fcc0deea50c 00007fcc0dee97c2 00007fcc0dce548c 00007fcc0dce48c6 00007fcc0dce426f
0709 13:20:55.779746 (+    96us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1683284224}
I20260709 13:20:55.745851 12535 raft_consensus.cc:493] T dbdf895bba214ff68685a24fd17dfb5d P ccd8a4c3bfe3413cb2ae219b09aea832 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:55.876936 12535 raft_consensus.cc:515] T dbdf895bba214ff68685a24fd17dfb5d P ccd8a4c3bfe3413cb2ae219b09aea832 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:55.879065 12535 leader_election.cc:290] T dbdf895bba214ff68685a24fd17dfb5d P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:55.741526 12691 raft_consensus.cc:493] T 07a92dd554674067a83a9cb68c4773f2 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:55.783242  6724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3d8792045a4583ae2e965b1350a5b4" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 16 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:55.779634  6770 leader_election.cc:304] T 07a92dd554674067a83a9cb68c4773f2 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
I20260709 13:20:55.879949  6729 raft_consensus.cc:1275] T dbdf895bba214ff68685a24fd17dfb5d P ccd8a4c3bfe3413cb2ae219b09aea832 [term 15 FOLLOWER]: Refusing update from remote peer cd75a17ab2604397adab03bb8b5fd75c: Log matching property violated. Preceding OpId in replica: term: 14 index: 6. Preceding OpId from leader: term: 15 index: 7. (index mismatch)
I20260709 13:20:55.789029 12345 raft_consensus.cc:493] T 427c124d773f483294511e80fe340075 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:55.753159 12625 leader_election.cc:290] T c4db81d9d329422bb3b4160ca4ac2d1d P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:55.745949 12602 raft_consensus.cc:493] T e31b9971c15848dea59d4d4130141d9e P ccd8a4c3bfe3413cb2ae219b09aea832 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:20:55.786500 12580 consensus_queue.cc:1059] T 3fa34c08b205435dba97346991aa1f92 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: INVALID_TERM, Last received: 17.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.023s
I20260709 13:20:55.757686 12616 raft_consensus.cc:493] T 404190ce4ce94cecbfcb6ea9d1dd8626 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 14 FOLLOWER]: Starting leader election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:20:55.803975  6726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4275cf08e63345f993bce8664eada830" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:55.894676  6724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c7f33e544204fbaac4078e3e83bbf4e" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
W20260709 13:20:55.824443  7469 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:55.835875  6804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "713b5728a197487c9300b310ab94e5a3" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:55.770449 12662 raft_consensus.cc:493] T 9e326172347f45e99a0d482b5d8ef768 P cd75a17ab2604397adab03bb8b5fd75c [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:55.838961  6723 raft_consensus.cc:2393] T 90d42e216d9741e190bca19a781291fd P ccd8a4c3bfe3413cb2ae219b09aea832 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c in current term 17: Already voted for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in this term.
I20260709 13:20:55.731380 12370 raft_consensus.cc:493] T a1704639a875409b9959353527b3fd68 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:55.836196  6697 leader_election.cc:304] T 4b8cacb381b746da8d0049b0a83b41dd P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:20:55.846479 12563 raft_consensus.cc:515] T f09c2a98de1a4decabd0ff900dd44caa P cd75a17ab2604397adab03bb8b5fd75c [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:55.849073  6725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b56bf91d90824c959e21e0cee5ba1816" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:55.849167 12626 raft_consensus.cc:515] T 34f36d59d88f40fe8a2805e604fc6c0a P b7ab4784c7344b939bc36f639286f377 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:55.858665  6798 raft_consensus.cc:2468] T 3411566abe2d4c9bb4b2adfdd05e6f17 P b7ab4784c7344b939bc36f639286f377 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 15.
I20260709 13:20:55.780491 12741 raft_consensus.cc:493] T 07a92dd554674067a83a9cb68c4773f2 P cd75a17ab2604397adab03bb8b5fd75c [term 13 FOLLOWER]: Starting pre-election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:20:55.788239 12651 raft_consensus.cc:2804] T a3022224cc81473690653a83d4e99470 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:20:55.787565 12667 raft_consensus.cc:493] T 3411566abe2d4c9bb4b2adfdd05e6f17 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:55.866727  6844 leader_election.cc:304] T 30e88460611e47b2ba16a46a30b5f416 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:20:55.787168  7496 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50744 (request call id 460) took 1349 ms. Trace:
I20260709 13:20:55.886665  6732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3411566abe2d4c9bb4b2adfdd05e6f17" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:20:55.835559 12547 raft_consensus.cc:2749] T 22ccee1b570c4ad3a57bd7aec085b1b4 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:20:55.910650  7496 rpcz_store.cc:276] 0709 13:20:54.430107 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:54.430492 (+   385us) service_pool.cc:224] Handling call
0709 13:20:55.779195 (+1348703us) spinlock_profiling.cc:243] Waited 69.6 ms on lock 0x7b540046fad4. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f9ae2fa 00007fcc1496fb17 00007fcc0deea6d4 00007fcc0deea662 00007fcc0deea591 00007fcc0deea50c 00007fcc0dee97c2 00007fcc0dce548c 00007fcc0dce48c6 00007fcc0dce426f
0709 13:20:55.779311 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":160066944}
I20260709 13:20:55.897970 12616 raft_consensus.cc:3060] T 404190ce4ce94cecbfcb6ea9d1dd8626 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:20:55.901378  6697 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 65327.6us
I20260709 13:20:55.783325 12661 raft_consensus.cc:515] T e31b9971c15848dea59d4d4130141d9e P b7ab4784c7344b939bc36f639286f377 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:55.920329 12661 leader_election.cc:290] T e31b9971c15848dea59d4d4130141d9e P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:55.903007 12662 raft_consensus.cc:515] T 9e326172347f45e99a0d482b5d8ef768 P cd75a17ab2604397adab03bb8b5fd75c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:55.788393 12594 raft_consensus.cc:515] T 95a75bfe094d4bdc963aba3f08dfcd25 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } attrs { replace: true } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: NON_VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: true } }
I20260709 13:20:55.922618 12662 leader_election.cc:290] T 9e326172347f45e99a0d482b5d8ef768 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:20:55.908460 12651 raft_consensus.cc:493] T a3022224cc81473690653a83d4e99470 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:55.923573 12594 leader_election.cc:290] T 95a75bfe094d4bdc963aba3f08dfcd25 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:55.883388 12704 raft_consensus.cc:493] T 9b3759de40694069b13c0f8bd40e5709 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:20:55.803503 12655 raft_consensus.cc:515] T 7c44c4849aa54f2b94d1f1bef9ed546f P b7ab4784c7344b939bc36f639286f377 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:55.895370 12742 raft_consensus.cc:493] T f5be3a11b23d4ea9b08300a2789821c7 P cd75a17ab2604397adab03bb8b5fd75c [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:55.786969 12729 consensus_queue.cc:1048] T e77e330a82df4b43a745d57a68f6f057 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.096s
I20260709 13:20:55.968075 12335 leader_election.cc:290] T bb3d8792045a4583ae2e965b1350a5b4 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 16 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:20:55.969810 12594 consensus_queue.cc:1059] T 4d9def8b32fd443aa94ab1420b06837b P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: INVALID_TERM, Last received: 15.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
W20260709 13:20:55.959520 12751 log.cc:927] Time spent T bb7fa124c3bf4ef9ab65a407cb008441 P b7ab4784c7344b939bc36f639286f377: Append to log took a long time: real 0.077s	user 0.000s	sys 0.006s
I20260709 13:20:55.881453 12561 raft_consensus.cc:3060] T b56bf91d90824c959e21e0cee5ba1816 P cd75a17ab2604397adab03bb8b5fd75c [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:55.959748 12704 raft_consensus.cc:515] T 9b3759de40694069b13c0f8bd40e5709 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
W20260709 13:20:55.900607 12720 log.cc:927] Time spent T 3d65025eea89441290d85dd053810e31 P ccd8a4c3bfe3413cb2ae219b09aea832: Append to log took a long time: real 0.720s	user 0.001s	sys 0.005s
I20260709 13:20:55.916805  6726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "404190ce4ce94cecbfcb6ea9d1dd8626" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:55.917346  6697 leader_election.cc:304] T d33d5ee8ef6f415593d8df52063161ad P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377
I20260709 13:20:55.906211  6725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce4f062dcd314d43a63ca74067cb5ee3" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:55.923916 12651 raft_consensus.cc:3060] T a3022224cc81473690653a83d4e99470 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:20:55.893746 12345 raft_consensus.cc:515] T 427c124d773f483294511e80fe340075 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } attrs { replace: true } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:20:55.885537 12691 raft_consensus.cc:515] T 07a92dd554674067a83a9cb68c4773f2 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:55.924870  6799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b56bf91d90824c959e21e0cee5ba1816" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:20:55.993641  6799 raft_consensus.cc:3060] T b56bf91d90824c959e21e0cee5ba1816 P b7ab4784c7344b939bc36f639286f377 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:55.995069 12691 leader_election.cc:290] T 07a92dd554674067a83a9cb68c4773f2 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:55.995633 12345 leader_election.cc:290] T 427c124d773f483294511e80fe340075 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:55.957269  6804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4db81d9d329422bb3b4160ca4ac2d1d" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:56.019904  6804 raft_consensus.cc:2468] T c4db81d9d329422bb3b4160ca4ac2d1d P b7ab4784c7344b939bc36f639286f377 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 16.
I20260709 13:20:56.021579  6804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b3759de40694069b13c0f8bd40e5709" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:56.022493  6804 raft_consensus.cc:2468] T 9b3759de40694069b13c0f8bd40e5709 P b7ab4784c7344b939bc36f639286f377 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 14.
I20260709 13:20:55.905292 12580 consensus_queue.cc:1243] T 3fa34c08b205435dba97346991aa1f92 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Peer cd75a17ab2604397adab03bb8b5fd75c log is divergent from this leader: its last log entry 20.15 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 14
I20260709 13:20:55.908620 12517 raft_consensus.cc:2804] T 4b8cacb381b746da8d0049b0a83b41dd P ccd8a4c3bfe3413cb2ae219b09aea832 [term 17 FOLLOWER]: Leader pre-election won for term 18
W20260709 13:20:55.963338 12713 log.cc:927] Time spent T f58dc08b12a2494bb9a1372837970ca2 P cd75a17ab2604397adab03bb8b5fd75c: Append to log took a long time: real 0.052s	user 0.000s	sys 0.004s
I20260709 13:20:55.905877 12370 raft_consensus.cc:515] T a1704639a875409b9959353527b3fd68 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:55.965838 12742 raft_consensus.cc:515] T f5be3a11b23d4ea9b08300a2789821c7 P cd75a17ab2604397adab03bb8b5fd75c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:56.042249 12742 leader_election.cc:290] T f5be3a11b23d4ea9b08300a2789821c7 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:20:55.965416 12563 leader_election.cc:290] T f09c2a98de1a4decabd0ff900dd44caa P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:20:55.957489 12746 consensus_queue.cc:1048] T 3fa34c08b205435dba97346991aa1f92 P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.048s
I20260709 13:20:55.913754 12667 raft_consensus.cc:3060] T 3411566abe2d4c9bb4b2adfdd05e6f17 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:55.896173 12602 raft_consensus.cc:515] T e31b9971c15848dea59d4d4130141d9e P ccd8a4c3bfe3413cb2ae219b09aea832 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:56.050338 12602 leader_election.cc:290] T e31b9971c15848dea59d4d4130141d9e P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:55.977763  6725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "713b5728a197487c9300b310ab94e5a3" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:55.960130 12664 raft_consensus.cc:2749] T 30e88460611e47b2ba16a46a30b5f416 P cd75a17ab2604397adab03bb8b5fd75c [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:20:55.982201  6697 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 64946.8us
I20260709 13:20:56.052490  6725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17587d6730594da4a56fa13a353232a1" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:56.053404  6725 raft_consensus.cc:2468] T 17587d6730594da4a56fa13a353232a1 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in term 20.
I20260709 13:20:56.054531  6725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "427c124d773f483294511e80fe340075" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:56.055276  6725 raft_consensus.cc:2468] T 427c124d773f483294511e80fe340075 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in term 15.
I20260709 13:20:55.983103 12653 raft_consensus.cc:2804] T d33d5ee8ef6f415593d8df52063161ad P ccd8a4c3bfe3413cb2ae219b09aea832 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:20:56.056286 12653 raft_consensus.cc:493] T d33d5ee8ef6f415593d8df52063161ad P ccd8a4c3bfe3413cb2ae219b09aea832 [term 14 FOLLOWER]: Starting leader election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:20:56.056785 12653 raft_consensus.cc:3060] T d33d5ee8ef6f415593d8df52063161ad P ccd8a4c3bfe3413cb2ae219b09aea832 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:56.058933  6724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3f13b31a1f84f0d89d007eadd57924c" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:56.059737 12580 consensus_queue.cc:1048] T bb3d8792045a4583ae2e965b1350a5b4 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:20:55.984306  6726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe20b4b48823486ca3b9c648db6ce8aa" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:56.060328 12422 raft_consensus.cc:3055] T 4d9def8b32fd443aa94ab1420b06837b P ccd8a4c3bfe3413cb2ae219b09aea832 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:20:56.060842 12422 raft_consensus.cc:740] T 4d9def8b32fd443aa94ab1420b06837b P ccd8a4c3bfe3413cb2ae219b09aea832 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
I20260709 13:20:56.060953  6726 raft_consensus.cc:2468] T fe20b4b48823486ca3b9c648db6ce8aa P ccd8a4c3bfe3413cb2ae219b09aea832 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in term 13.
I20260709 13:20:56.061838  6726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fa34c08b205435dba97346991aa1f92" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 21 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:56.061666 12422 consensus_queue.cc:260] T 4d9def8b32fd443aa94ab1420b06837b P ccd8a4c3bfe3413cb2ae219b09aea832 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:56.062656 12422 raft_consensus.cc:3060] T 4d9def8b32fd443aa94ab1420b06837b P ccd8a4c3bfe3413cb2ae219b09aea832 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:56.056805 12517 raft_consensus.cc:493] T 4b8cacb381b746da8d0049b0a83b41dd P ccd8a4c3bfe3413cb2ae219b09aea832 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:56.064585 12517 raft_consensus.cc:3060] T 4b8cacb381b746da8d0049b0a83b41dd P ccd8a4c3bfe3413cb2ae219b09aea832 [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:20:55.988834 12750 log.cc:927] Time spent T 7c37d41cd9164c15a6826ca62a851a69 P ccd8a4c3bfe3413cb2ae219b09aea832: Append to log took a long time: real 0.073s	user 0.000s	sys 0.000s
I20260709 13:20:55.927150  6798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44bde925b2e541b69890d70715b85176" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:20:56.068497  6798 raft_consensus.cc:3060] T 44bde925b2e541b69890d70715b85176 P b7ab4784c7344b939bc36f639286f377 [term 15 FOLLOWER]: Advancing to term 17
I20260709 13:20:56.069159 12735 raft_consensus.cc:2804] T c4db81d9d329422bb3b4160ca4ac2d1d P b7ab4784c7344b939bc36f639286f377 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:20:56.060434 12691 consensus_queue.cc:1048] T 3d65025eea89441290d85dd053810e31 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.009s
W20260709 13:20:56.070194  6770 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 290671us
I20260709 13:20:56.070632 12246 raft_consensus.cc:2804] T 07a92dd554674067a83a9cb68c4773f2 P b7ab4784c7344b939bc36f639286f377 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:20:56.071048 12246 raft_consensus.cc:493] T 07a92dd554674067a83a9cb68c4773f2 P b7ab4784c7344b939bc36f639286f377 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:56.071388 12246 raft_consensus.cc:3060] T 07a92dd554674067a83a9cb68c4773f2 P b7ab4784c7344b939bc36f639286f377 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:55.997787 12626 leader_election.cc:290] T 34f36d59d88f40fe8a2805e604fc6c0a P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:56.072247  6770 leader_election.cc:304] T 427c124d773f483294511e80fe340075 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:20:55.999872  6731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1528ab62b6fe4e3099d08f141afee116" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:56.000166 12704 leader_election.cc:290] T 9b3759de40694069b13c0f8bd40e5709 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:55.911967 12741 raft_consensus.cc:515] T 07a92dd554674067a83a9cb68c4773f2 P cd75a17ab2604397adab03bb8b5fd75c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:56.073719 12692 raft_consensus.cc:697] T be1a92657f494cac8dd227d152f50151 P b7ab4784c7344b939bc36f639286f377 [term 18 LEADER]: Becoming Leader. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
I20260709 13:20:56.074813  6731 raft_consensus.cc:1240] T be1a92657f494cac8dd227d152f50151 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 18 FOLLOWER]: Rejecting Update request from peer 7ba59cc884714e8aa5f3f0ecaed84cbb for earlier term 17. Current term is 18. Ops: []
I20260709 13:20:56.074991 12741 leader_election.cc:290] T 07a92dd554674067a83a9cb68c4773f2 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
W20260709 13:20:56.007426  6805 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:32966 (request call id 1429) took 1604 ms (client timeout 2105 ms). Trace:
I20260709 13:20:56.075521 12620 raft_consensus.cc:3060] T 427c124d773f483294511e80fe340075 P b7ab4784c7344b939bc36f639286f377 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:56.069756 12735 raft_consensus.cc:493] T c4db81d9d329422bb3b4160ca4ac2d1d P b7ab4784c7344b939bc36f639286f377 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:56.076643 12735 raft_consensus.cc:3060] T c4db81d9d329422bb3b4160ca4ac2d1d P b7ab4784c7344b939bc36f639286f377 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:56.077193 12698 leader_election.cc:290] T de3186201e1a40d0b335eeb8b4e256e0 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:56.009956  6799 raft_consensus.cc:2468] T b56bf91d90824c959e21e0cee5ba1816 P b7ab4784c7344b939bc36f639286f377 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 17.
I20260709 13:20:56.080643  6799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "427c124d773f483294511e80fe340075" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:56.005889  6730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab432e62819d499eaaf3dd55481dd930" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:56.063858  6802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a75bfe094d4bdc963aba3f08dfcd25" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:56.083214  6802 raft_consensus.cc:2468] T 95a75bfe094d4bdc963aba3f08dfcd25 P b7ab4784c7344b939bc36f639286f377 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 14.
I20260709 13:20:56.084444 12527 leader_election.cc:290] T f3f9c2e2bf644115957398fe4c9459db P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 17 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:20:56.084671  6802 raft_consensus.cc:1275] T 7c44c4849aa54f2b94d1f1bef9ed546f P b7ab4784c7344b939bc36f639286f377 [term 19 FOLLOWER]: Refusing update from remote peer ccd8a4c3bfe3413cb2ae219b09aea832: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260709 13:20:56.085744  6802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e31b9971c15848dea59d4d4130141d9e" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:56.086383  6802 raft_consensus.cc:2468] T e31b9971c15848dea59d4d4130141d9e P b7ab4784c7344b939bc36f639286f377 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 14.
I20260709 13:20:55.992694 12655 leader_election.cc:290] T 7c44c4849aa54f2b94d1f1bef9ed546f P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:56.088807  6803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1704639a875409b9959353527b3fd68" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:56.090070  6724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce4f062dcd314d43a63ca74067cb5ee3" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:56.069715  6807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a92dd554674067a83a9cb68c4773f2" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:56.039662 12370 leader_election.cc:290] T a1704639a875409b9959353527b3fd68 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:56.087853  6695 leader_election.cc:304] T c4db81d9d329422bb3b4160ca4ac2d1d P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
I20260709 13:20:56.074662 12692 consensus_queue.cc:237] T be1a92657f494cac8dd227d152f50151 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:20:56.093327  6695 leader_election.cc:304] T 9b3759de40694069b13c0f8bd40e5709 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
I20260709 13:20:56.093473 12602 raft_consensus.cc:2804] T c4db81d9d329422bb3b4160ca4ac2d1d P ccd8a4c3bfe3413cb2ae219b09aea832 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:20:56.093961 12602 raft_consensus.cc:493] T c4db81d9d329422bb3b4160ca4ac2d1d P ccd8a4c3bfe3413cb2ae219b09aea832 [term 15 FOLLOWER]: Starting leader election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:20:56.116701 12602 raft_consensus.cc:3060] T c4db81d9d329422bb3b4160ca4ac2d1d P ccd8a4c3bfe3413cb2ae219b09aea832 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:56.072613  7466 leader_election.cc:304] T 17587d6730594da4a56fa13a353232a1 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: b7ab4784c7344b939bc36f639286f377
I20260709 13:20:56.119601 12345 raft_consensus.cc:2804] T 17587d6730594da4a56fa13a353232a1 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:20:56.120322 12345 raft_consensus.cc:493] T 17587d6730594da4a56fa13a353232a1 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:56.120864 12345 raft_consensus.cc:3060] T 17587d6730594da4a56fa13a353232a1 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:20:56.122278  6874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de3186201e1a40d0b335eeb8b4e256e0" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:56.124365  6872 raft_consensus.cc:1240] T d8cee0accdb8499c86d4414b72565a38 P cd75a17ab2604397adab03bb8b5fd75c [term 18 FOLLOWER]: Rejecting Update request from peer b7ab4784c7344b939bc36f639286f377 for earlier term 17. Current term is 18. Ops: []
I20260709 13:20:56.127082  7496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1528ab62b6fe4e3099d08f141afee116" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:20:56.127187  7498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ba5dac66ab5497e9e336f2a3c28cda5" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:20:56.129040  7494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "404190ce4ce94cecbfcb6ea9d1dd8626" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:20:56.115000 12246 raft_consensus.cc:515] T 07a92dd554674067a83a9cb68c4773f2 P b7ab4784c7344b939bc36f639286f377 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:56.133117  6807 raft_consensus.cc:2393] T 07a92dd554674067a83a9cb68c4773f2 P b7ab4784c7344b939bc36f639286f377 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ccd8a4c3bfe3413cb2ae219b09aea832 in current term 15: Already voted for candidate b7ab4784c7344b939bc36f639286f377 in this term.
I20260709 13:20:56.135658 12246 leader_election.cc:290] T 07a92dd554674067a83a9cb68c4773f2 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 15 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:56.094658  6726 raft_consensus.cc:1275] T 95a75bfe094d4bdc963aba3f08dfcd25 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 14 FOLLOWER]: Refusing update from remote peer cd75a17ab2604397adab03bb8b5fd75c: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:20:56.094534 12370 raft_consensus.cc:2804] T 9b3759de40694069b13c0f8bd40e5709 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:20:56.148218 12370 raft_consensus.cc:493] T 9b3759de40694069b13c0f8bd40e5709 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 13 FOLLOWER]: Starting leader election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:20:56.148850 12370 raft_consensus.cc:3060] T 9b3759de40694069b13c0f8bd40e5709 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:20:56.097765  6698 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:56.102034  6803 raft_consensus.cc:1275] T 7887766dc6784fcaa42b35c05fea7a99 P b7ab4784c7344b939bc36f639286f377 [term 18 FOLLOWER]: Refusing update from remote peer ccd8a4c3bfe3413cb2ae219b09aea832: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
W20260709 13:20:56.075711  6805 rpcz_store.cc:269] 0709 13:20:54.402517 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:54.616601 (+214084us) service_pool.cc:224] Handling call
0709 13:20:56.007166 (+1390565us) spinlock_profiling.cc:243] Waited 986 ms on lock 0x7b54001cacd4. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f9ae2fa 00007fcc1496fb17 00007fcc0deea6d4 00007fcc0deea662 00007fcc0deea591 00007fcc0deea50c 00007fcc0dee97c2 00007fcc0dce548c 00007fcc0dce48c6 00007fcc0dce426f
0709 13:20:56.007310 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2268658560}
I20260709 13:20:56.156445  6725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4b8bd455d5a47c18a1380839c6e0d61" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
W20260709 13:20:56.157151 12745 log.cc:927] Time spent T e77e330a82df4b43a745d57a68f6f057 P cd75a17ab2604397adab03bb8b5fd75c: Append to log took a long time: real 0.186s	user 0.003s	sys 0.000s
I20260709 13:20:56.110059 12735 raft_consensus.cc:515] T c4db81d9d329422bb3b4160ca4ac2d1d P b7ab4784c7344b939bc36f639286f377 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:56.107635 12620 raft_consensus.cc:2749] T 427c124d773f483294511e80fe340075 P b7ab4784c7344b939bc36f639286f377 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:20:56.115830  6806 raft_consensus.cc:1240] T 4d9def8b32fd443aa94ab1420b06837b P b7ab4784c7344b939bc36f639286f377 [term 16 FOLLOWER]: Rejecting Update request from peer ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 15. Current term is 16. Ops: []
I20260709 13:20:56.136358  6880 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58592 (request call id 497) took 1397 ms. Trace:
W20260709 13:20:56.141294 12726 log.cc:927] Time spent T 711ef6523deb4cbe8ef2ba61e1c21c98 P ccd8a4c3bfe3413cb2ae219b09aea832: Append to log took a long time: real 0.960s	user 0.004s	sys 0.000s
I20260709 13:20:56.158943  6799 raft_consensus.cc:2468] T 427c124d773f483294511e80fe340075 P b7ab4784c7344b939bc36f639286f377 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in term 15.
I20260709 13:20:56.159557 12735 leader_election.cc:290] T c4db81d9d329422bb3b4160ca4ac2d1d P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 17 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:56.140960  6728 raft_consensus.cc:3055] T 3fa34c08b205435dba97346991aa1f92 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:20:56.082661  6800 raft_consensus.cc:1275] T bd6869f07b5a4885a0b99fbe60c3b175 P b7ab4784c7344b939bc36f639286f377 [term 18 FOLLOWER]: Refusing update from remote peer ccd8a4c3bfe3413cb2ae219b09aea832: Log matching property violated. Preceding OpId in replica: term: 16 index: 8. Preceding OpId from leader: term: 18 index: 9. (index mismatch)
I20260709 13:20:56.160372  6728 raft_consensus.cc:740] T 3fa34c08b205435dba97346991aa1f92 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
I20260709 13:20:55.979099 12663 raft_consensus.cc:493] T 7c37d41cd9164c15a6826ca62a851a69 P cd75a17ab2604397adab03bb8b5fd75c [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:56.169305 12663 raft_consensus.cc:515] T 7c37d41cd9164c15a6826ca62a851a69 P cd75a17ab2604397adab03bb8b5fd75c [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:56.023628  6804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbdf895bba214ff68685a24fd17dfb5d" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 16 candidate_status { last_received { term: 14 index: 6 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:56.172513  6804 raft_consensus.cc:2468] T dbdf895bba214ff68685a24fd17dfb5d P b7ab4784c7344b939bc36f639286f377 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 15.
I20260709 13:20:56.178114  7494 raft_consensus.cc:1240] T d8cee0accdb8499c86d4414b72565a38 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 18 LEADER]: Rejecting Update request from peer b7ab4784c7344b939bc36f639286f377 for earlier term 17. Current term is 18. Ops: []
I20260709 13:20:56.179769 12735 raft_consensus.cc:493] T f5be3a11b23d4ea9b08300a2789821c7 P b7ab4784c7344b939bc36f639286f377 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:56.180430 12735 raft_consensus.cc:515] T f5be3a11b23d4ea9b08300a2789821c7 P b7ab4784c7344b939bc36f639286f377 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:56.181216 12246 raft_consensus.cc:493] T 3a485a995abc4807b6e511e45419f737 P b7ab4784c7344b939bc36f639286f377 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:56.181682 12246 raft_consensus.cc:515] T 3a485a995abc4807b6e511e45419f737 P b7ab4784c7344b939bc36f639286f377 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:56.094174  6695 leader_election.cc:304] T b56bf91d90824c959e21e0cee5ba1816 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
W20260709 13:20:56.191551  6695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 97442.9us
I20260709 13:20:56.191733 12497 raft_consensus.cc:2804] T b56bf91d90824c959e21e0cee5ba1816 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:20:56.192626 12497 raft_consensus.cc:697] T b56bf91d90824c959e21e0cee5ba1816 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 17 LEADER]: Becoming Leader. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
I20260709 13:20:56.192473  6695 leader_election.cc:304] T 95a75bfe094d4bdc963aba3f08dfcd25 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
I20260709 13:20:56.194283 12497 consensus_queue.cc:237] T b56bf91d90824c959e21e0cee5ba1816 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:56.196099 12582 raft_consensus.cc:2804] T 95a75bfe094d4bdc963aba3f08dfcd25 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:20:56.196612 12582 raft_consensus.cc:493] T 95a75bfe094d4bdc963aba3f08dfcd25 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:56.197142 12582 raft_consensus.cc:3060] T 95a75bfe094d4bdc963aba3f08dfcd25 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:56.157518  6725 raft_consensus.cc:2393] T f4b8bd455d5a47c18a1380839c6e0d61 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c in current term 17: Already voted for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in this term.
I20260709 13:20:56.203785  6873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4275cf08e63345f993bce8664eada830" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:56.204491  6873 raft_consensus.cc:2468] T 4275cf08e63345f993bce8664eada830 P cd75a17ab2604397adab03bb8b5fd75c [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 14.
I20260709 13:20:56.205266  6798 raft_consensus.cc:2468] T 44bde925b2e541b69890d70715b85176 P b7ab4784c7344b939bc36f639286f377 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 17.
I20260709 13:20:56.206067  6723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e31b9971c15848dea59d4d4130141d9e" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:56.208602  6723 raft_consensus.cc:2468] T e31b9971c15848dea59d4d4130141d9e P ccd8a4c3bfe3413cb2ae219b09aea832 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 13.
W20260709 13:20:56.206143  7466 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 133614us
I20260709 13:20:56.206981  6873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ba5dac66ab5497e9e336f2a3c28cda5" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:56.221381  6873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b3759de40694069b13c0f8bd40e5709" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:56.210106  6872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90d42e216d9741e190bca19a781291fd" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:56.222381  6872 raft_consensus.cc:2468] T 90d42e216d9741e190bca19a781291fd P cd75a17ab2604397adab03bb8b5fd75c [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 17.
I20260709 13:20:56.223234  6872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f58dc08b12a2494bb9a1372837970ca2" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:56.224349  6872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3411566abe2d4c9bb4b2adfdd05e6f17" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:56.225046  6872 raft_consensus.cc:2393] T 3411566abe2d4c9bb4b2adfdd05e6f17 P cd75a17ab2604397adab03bb8b5fd75c [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ccd8a4c3bfe3413cb2ae219b09aea832 in current term 15: Already voted for candidate cd75a17ab2604397adab03bb8b5fd75c in this term.
I20260709 13:20:56.158953  6880 rpcz_store.cc:276] 0709 13:20:54.738925 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:54.765420 (+ 26495us) service_pool.cc:224] Handling call
0709 13:20:56.136118 (+1370698us) spinlock_profiling.cc:243] Waited 37.9 ms on lock 0x7b54002189d4. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f9ae2fa 00007fcc1496fb17 00007fcc0deea6d4 00007fcc0deea662 00007fcc0deea591 00007fcc0deea50c 00007fcc0dee97c2 00007fcc0dce548c 00007fcc0dce48c6 00007fcc0dce426f
0709 13:20:56.136271 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":87156992}
I20260709 13:20:56.211436  6874 raft_consensus.cc:1275] T 9e326172347f45e99a0d482b5d8ef768 P cd75a17ab2604397adab03bb8b5fd75c [term 14 FOLLOWER]: Refusing update from remote peer b7ab4784c7344b939bc36f639286f377: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 8. (term mismatch)
I20260709 13:20:56.213425  6878 raft_consensus.cc:1240] T 3a485a995abc4807b6e511e45419f737 P cd75a17ab2604397adab03bb8b5fd75c [term 16 FOLLOWER]: Rejecting Update request from peer ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 15. Current term is 16. Ops: []
I20260709 13:20:56.225741  6874 pending_rounds.cc:85] T 9e326172347f45e99a0d482b5d8ef768 P cd75a17ab2604397adab03bb8b5fd75c: Aborting all ops after (but not including) 7
I20260709 13:20:56.226212  6874 pending_rounds.cc:107] T 9e326172347f45e99a0d482b5d8ef768 P cd75a17ab2604397adab03bb8b5fd75c: Aborting uncommitted NO_OP operation due to leader change: 13.8
I20260709 13:20:56.226581  6874 raft_consensus.cc:2889] T 9e326172347f45e99a0d482b5d8ef768 P cd75a17ab2604397adab03bb8b5fd75c [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:20:56.226681  6878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a75bfe094d4bdc963aba3f08dfcd25" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:56.226922  7466 leader_election.cc:304] T b3f13b31a1f84f0d89d007eadd57924c P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:20:56.227819  6878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbdf895bba214ff68685a24fd17dfb5d" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 16 candidate_status { last_received { term: 14 index: 6 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:56.228132  6874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a92dd554674067a83a9cb68c4773f2" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:56.229115  6878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44bde925b2e541b69890d70715b85176" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:20:56.230018  6876 raft_consensus.cc:1275] T 7a734b5ab7834e05a8c422208acc58b1 P cd75a17ab2604397adab03bb8b5fd75c [term 17 FOLLOWER]: Refusing update from remote peer b7ab4784c7344b939bc36f639286f377: Log matching property violated. Preceding OpId in replica: term: 15 index: 7. Preceding OpId from leader: term: 17 index: 8. (index mismatch)
I20260709 13:20:56.230204  6878 raft_consensus.cc:3060] T 44bde925b2e541b69890d70715b85176 P cd75a17ab2604397adab03bb8b5fd75c [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:56.216749  6723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c44c4849aa54f2b94d1f1bef9ed546f" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 20 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:56.217667  6730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34f36d59d88f40fe8a2805e604fc6c0a" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:56.231400  6731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a92dd554674067a83a9cb68c4773f2" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:20:56.232347  6731 raft_consensus.cc:3060] T 07a92dd554674067a83a9cb68c4773f2 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:56.231333  6770 leader_election.cc:304] T b56bf91d90824c959e21e0cee5ba1816 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:20:56.232933  6723 raft_consensus.cc:3060] T 17587d6730594da4a56fa13a353232a1 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:20:56.233600  7494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3d8792045a4583ae2e965b1350a5b4" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 16 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb"
I20260709 13:20:56.234301  6873 raft_consensus.cc:2393] T 9b3759de40694069b13c0f8bd40e5709 P cd75a17ab2604397adab03bb8b5fd75c [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ccd8a4c3bfe3413cb2ae219b09aea832 in current term 14: Already voted for candidate cd75a17ab2604397adab03bb8b5fd75c in this term.
I20260709 13:20:56.234867  6695 leader_election.cc:304] T e31b9971c15848dea59d4d4130141d9e P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
I20260709 13:20:56.219442  6772 leader_election.cc:304] T ab432e62819d499eaaf3dd55481dd930 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:20:56.239790  7466 leader_election.cc:304] T fe20b4b48823486ca3b9c648db6ce8aa P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:20:56.240478  6876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c44c4849aa54f2b94d1f1bef9ed546f" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 20 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:56.241720  6876 raft_consensus.cc:2410] T 7c44c4849aa54f2b94d1f1bef9ed546f P cd75a17ab2604397adab03bb8b5fd75c [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7ab4784c7344b939bc36f639286f377 for term 20 because replica has last-logged OpId of term: 17 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 11.
I20260709 13:20:56.229074  6874 raft_consensus.cc:2468] T 07a92dd554674067a83a9cb68c4773f2 P cd75a17ab2604397adab03bb8b5fd75c [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 13.
I20260709 13:20:56.247404  6874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c240553ce044eedb41541d72b9475d7" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:56.249600  6873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34f36d59d88f40fe8a2805e604fc6c0a" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:56.251088  6873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3022224cc81473690653a83d4e99470" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:56.238633  6730 raft_consensus.cc:2468] T 34f36d59d88f40fe8a2805e604fc6c0a P ccd8a4c3bfe3413cb2ae219b09aea832 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 15.
I20260709 13:20:56.254709  6876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4db81d9d329422bb3b4160ca4ac2d1d" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:56.255025  6770 leader_election.cc:304] T e31b9971c15848dea59d4d4130141d9e P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
I20260709 13:20:56.254858  6730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4db81d9d329422bb3b4160ca4ac2d1d" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:20:56.255829  6876 raft_consensus.cc:2393] T c4db81d9d329422bb3b4160ca4ac2d1d P cd75a17ab2604397adab03bb8b5fd75c [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ccd8a4c3bfe3413cb2ae219b09aea832 in current term 16: Already voted for candidate cd75a17ab2604397adab03bb8b5fd75c in this term.
I20260709 13:20:56.257120  6872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b56bf91d90824c959e21e0cee5ba1816" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:20:56.258656  6874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a734b5ab7834e05a8c422208acc58b1" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 18 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:56.259501  6874 raft_consensus.cc:2468] T 7a734b5ab7834e05a8c422208acc58b1 P cd75a17ab2604397adab03bb8b5fd75c [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 17.
I20260709 13:20:56.207804  6728 consensus_queue.cc:260] T 3fa34c08b205435dba97346991aa1f92 P ccd8a4c3bfe3413cb2ae219b09aea832 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.15, Last appended by leader: 15, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:20:56.261801  6874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e31b9971c15848dea59d4d4130141d9e" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:56.262161  6728 raft_consensus.cc:3060] T 3fa34c08b205435dba97346991aa1f92 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:20:56.262676  6874 raft_consensus.cc:2393] T e31b9971c15848dea59d4d4130141d9e P cd75a17ab2604397adab03bb8b5fd75c [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ccd8a4c3bfe3413cb2ae219b09aea832 in current term 14: Already voted for candidate cd75a17ab2604397adab03bb8b5fd75c in this term.
I20260709 13:20:56.251830  6873 raft_consensus.cc:2468] T a3022224cc81473690653a83d4e99470 P cd75a17ab2604397adab03bb8b5fd75c [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 18.
W20260709 13:20:56.263779  6772 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 46890.5us
I20260709 13:20:56.264880  6873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1704639a875409b9959353527b3fd68" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:56.266360  7466 leader_election.cc:304] T 3fa34c08b205435dba97346991aa1f92 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:20:56.269670  6880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f9c2e2bf644115957398fe4c9459db" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:20:56.270972  6880 raft_consensus.cc:2368] T f3f9c2e2bf644115957398fe4c9459db P cd75a17ab2604397adab03bb8b5fd75c [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 16. Current term is 17.
I20260709 13:20:56.273164 12246 leader_election.cc:290] T 3a485a995abc4807b6e511e45419f737 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:56.276428 12757 raft_consensus.cc:2749] T 3fa34c08b205435dba97346991aa1f92 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:20:56.277477 12704 raft_consensus.cc:493] T be1a92657f494cac8dd227d152f50151 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:56.278152 12704 raft_consensus.cc:515] T be1a92657f494cac8dd227d152f50151 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:20:56.278488  6878 raft_consensus.cc:2468] T 44bde925b2e541b69890d70715b85176 P cd75a17ab2604397adab03bb8b5fd75c [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 17.
I20260709 13:20:56.258145 12606 consensus_queue.cc:1048] T 7c44c4849aa54f2b94d1f1bef9ed546f P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.023s
I20260709 13:20:56.281527  6697 leader_election.cc:304] T fe20b4b48823486ca3b9c648db6ce8aa P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:20:56.283350 12694 consensus_queue.cc:1048] T b3f13b31a1f84f0d89d007eadd57924c P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:20:56.267457 12620 raft_consensus.cc:2749] T b56bf91d90824c959e21e0cee5ba1816 P b7ab4784c7344b939bc36f639286f377 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:20:56.166807  6626 catalog_manager.cc:5697] T d33d5ee8ef6f415593d8df52063161ad P b7ab4784c7344b939bc36f639286f377 reported cstate change: term changed from 4 to 8, leader changed from ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65) to b7ab4784c7344b939bc36f639286f377 (127.5.126.66). New cstate: current_term: 8 leader_uuid: "b7ab4784c7344b939bc36f639286f377" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:56.287892  7466 leader_election.cc:304] T ce4f062dcd314d43a63ca74067cb5ee3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:20:56.288337  6879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e31b9971c15848dea59d4d4130141d9e" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:56.296902  6772 leader_election.cc:304] T de3186201e1a40d0b335eeb8b4e256e0 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:20:56.289225  6879 raft_consensus.cc:2468] T e31b9971c15848dea59d4d4130141d9e P cd75a17ab2604397adab03bb8b5fd75c [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 14.
W20260709 13:20:56.310853  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 444154us
I20260709 13:20:56.325407  6697 leader_election.cc:304] T 17587d6730594da4a56fa13a353232a1 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, b7ab4784c7344b939bc36f639286f377
W20260709 13:20:56.325843  6696 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:56.325766  6844 leader_election.cc:400] T f03d0dbf16864ca4bc1bb5e4c0334c0f P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 16 election: Vote denied by peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391) with higher term. Message: Invalid argument: T f03d0dbf16864ca4bc1bb5e4c0334c0f P ccd8a4c3bfe3413cb2ae219b09aea832 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c for earlier term 16. Current term is 17.
I20260709 13:20:56.329995  6844 leader_election.cc:304] T 7a734b5ab7834e05a8c422208acc58b1 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:20:56.338650  6844 leader_election.cc:304] T 20f6842e26174571996b8dea4151d4be P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:20:56.301702 12757 raft_consensus.cc:2749] T ce4f062dcd314d43a63ca74067cb5ee3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:20:56.332474  6770 leader_election.cc:304] T 34f36d59d88f40fe8a2805e604fc6c0a P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
I20260709 13:20:56.286695 12673 raft_consensus.cc:2804] T fe20b4b48823486ca3b9c648db6ce8aa P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:20:56.378247  6876 raft_consensus.cc:1275] T ab432e62819d499eaaf3dd55481dd930 P cd75a17ab2604397adab03bb8b5fd75c [term 18 FOLLOWER]: Refusing update from remote peer ccd8a4c3bfe3413cb2ae219b09aea832: Log matching property violated. Preceding OpId in replica: term: 17 index: 9. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
W20260709 13:20:56.382295  6697 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.68:45071, user_credentials={real_user=slave}} blocked reactor thread for 57036.4us
I20260709 13:20:56.385247  6731 raft_consensus.cc:2468] T 07a92dd554674067a83a9cb68c4773f2 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 15.
I20260709 13:20:56.387008  6731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5be3a11b23d4ea9b08300a2789821c7" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:56.387698  6731 raft_consensus.cc:2468] T f5be3a11b23d4ea9b08300a2789821c7 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 15.
I20260709 13:20:56.340713  6772 leader_election.cc:304] T 4275cf08e63345f993bce8664eada830 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:20:56.294978 12271 raft_consensus.cc:2749] T b3f13b31a1f84f0d89d007eadd57924c P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:20:56.303103 12738 raft_consensus.cc:2749] T fe20b4b48823486ca3b9c648db6ce8aa P ccd8a4c3bfe3413cb2ae219b09aea832 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:20:56.337853  6695 leader_election.cc:304] T dbdf895bba214ff68685a24fd17dfb5d P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
I20260709 13:20:56.350095  6844 leader_election.cc:304] T 9b3759de40694069b13c0f8bd40e5709 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
W20260709 13:20:56.409617  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 63027.6us
I20260709 13:20:56.342133 12666 raft_consensus.cc:2749] T 7a734b5ab7834e05a8c422208acc58b1 P cd75a17ab2604397adab03bb8b5fd75c [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:20:56.411432  6844 leader_election.cc:304] T 4275cf08e63345f993bce8664eada830 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:20:56.334944 12620 raft_consensus.cc:2749] T de3186201e1a40d0b335eeb8b4e256e0 P b7ab4784c7344b939bc36f639286f377 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:20:56.399677  6697 leader_election.cc:304] T f58dc08b12a2494bb9a1372837970ca2 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:20:56.345685 12240 consensus_queue.cc:1048] T bd6869f07b5a4885a0b99fbe60c3b175 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.059s
I20260709 13:20:56.404338  6725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a485a995abc4807b6e511e45419f737" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:56.349360 12730 raft_consensus.cc:2804] T ab432e62819d499eaaf3dd55481dd930 P b7ab4784c7344b939bc36f639286f377 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:20:56.295917 12613 raft_consensus.cc:2804] T e31b9971c15848dea59d4d4130141d9e P ccd8a4c3bfe3413cb2ae219b09aea832 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:20:56.413434  6881 raft_consensus.cc:1275] T 7c44c4849aa54f2b94d1f1bef9ed546f P cd75a17ab2604397adab03bb8b5fd75c [term 19 FOLLOWER]: Refusing update from remote peer ccd8a4c3bfe3413cb2ae219b09aea832: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260709 13:20:56.424891  6844 leader_election.cc:304] T ce4f062dcd314d43a63ca74067cb5ee3 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, ccd8a4c3bfe3413cb2ae219b09aea832
W20260709 13:20:56.397310  6772 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 56683.2us
I20260709 13:20:56.426415  6697 leader_election.cc:304] T 07a92dd554674067a83a9cb68c4773f2 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377
I20260709 13:20:56.351099 12543 raft_consensus.cc:2749] T 20f6842e26174571996b8dea4151d4be P cd75a17ab2604397adab03bb8b5fd75c [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:20:56.416865  6725 raft_consensus.cc:2468] T 3a485a995abc4807b6e511e45419f737 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 16.
I20260709 13:20:56.417258  6876 raft_consensus.cc:1240] T bb3d8792045a4583ae2e965b1350a5b4 P cd75a17ab2604397adab03bb8b5fd75c [term 16 FOLLOWER]: Rejecting Update request from peer ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 15. Current term is 16. Ops: [15.13-15.13]
I20260709 13:20:56.349915 12689 raft_consensus.cc:493] T f03d0dbf16864ca4bc1bb5e4c0334c0f P ccd8a4c3bfe3413cb2ae219b09aea832 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:20:56.419777  6695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 82022.8us
I20260709 13:20:56.380136 12340 raft_consensus.cc:493] T f4b8bd455d5a47c18a1380839c6e0d61 P b7ab4784c7344b939bc36f639286f377 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:56.342443 12698 consensus_queue.cc:1059] T d8cee0accdb8499c86d4414b72565a38 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.076s
I20260709 13:20:56.396592 12631 raft_consensus.cc:2804] T 34f36d59d88f40fe8a2805e604fc6c0a P b7ab4784c7344b939bc36f639286f377 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:20:56.386844 12673 raft_consensus.cc:493] T fe20b4b48823486ca3b9c648db6ce8aa P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 13 FOLLOWER]: Starting leader election (detected failure of leader cd75a17ab2604397adab03bb8b5fd75c)
I20260709 13:20:56.433032  6626 catalog_manager.cc:5697] T 22ccee1b570c4ad3a57bd7aec085b1b4 P b7ab4784c7344b939bc36f639286f377 reported cstate change: term changed from 1 to 6, leader changed from ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65) to b7ab4784c7344b939bc36f639286f377 (127.5.126.66). New cstate: current_term: 6 leader_uuid: "b7ab4784c7344b939bc36f639286f377" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:56.454250  6723 raft_consensus.cc:1275] T 17587d6730594da4a56fa13a353232a1 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 21 FOLLOWER]: Refusing update from remote peer b7ab4784c7344b939bc36f639286f377: Log matching property violated. Preceding OpId in replica: term: 20 index: 14. Preceding OpId from leader: term: 21 index: 15. (index mismatch)
I20260709 13:20:56.409965 12246 raft_consensus.cc:2804] T 4275cf08e63345f993bce8664eada830 P b7ab4784c7344b939bc36f639286f377 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:20:56.435847 12497 raft_consensus.cc:2764] T 07a92dd554674067a83a9cb68c4773f2 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 15 FOLLOWER]: Leader pre-election decision vote started in defunct term 14: won
I20260709 13:20:56.422734 12613 raft_consensus.cc:493] T e31b9971c15848dea59d4d4130141d9e P ccd8a4c3bfe3413cb2ae219b09aea832 [term 13 FOLLOWER]: Starting leader election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:20:56.436545 12653 raft_consensus.cc:515] T d33d5ee8ef6f415593d8df52063161ad P ccd8a4c3bfe3413cb2ae219b09aea832 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:56.436874  6697 leader_election.cc:304] T 2c240553ce044eedb41541d72b9475d7 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:20:56.433744  6695 leader_election.cc:304] T 44bde925b2e541b69890d70715b85176 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
I20260709 13:20:56.433256 12551 raft_consensus.cc:2749] T f58dc08b12a2494bb9a1372837970ca2 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:20:56.440618 12704 leader_election.cc:290] T be1a92657f494cac8dd227d152f50151 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:20:56.441923 12663 leader_election.cc:290] T 7c37d41cd9164c15a6826ca62a851a69 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
W20260709 13:20:56.444447  7466 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 149151us
I20260709 13:20:56.478879  7466 leader_election.cc:304] T 427c124d773f483294511e80fe340075 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
I20260709 13:20:56.345917 12697 consensus_queue.cc:1048] T 7887766dc6784fcaa42b35c05fea7a99 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.079s
I20260709 13:20:56.406749 12735 leader_election.cc:290] T f5be3a11b23d4ea9b08300a2789821c7 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:56.454617  6879 raft_consensus.cc:1240] T 3fa34c08b205435dba97346991aa1f92 P cd75a17ab2604397adab03bb8b5fd75c [term 20 LEADER]: Rejecting Update request from peer ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 19. Current term is 20. Ops: [19.15-19.15]
I20260709 13:20:56.485150  6807 raft_consensus.cc:3055] T d8cee0accdb8499c86d4414b72565a38 P b7ab4784c7344b939bc36f639286f377 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:20:56.485585  6807 raft_consensus.cc:740] T d8cee0accdb8499c86d4414b72565a38 P b7ab4784c7344b939bc36f639286f377 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
I20260709 13:20:56.486568  6807 consensus_queue.cc:260] T d8cee0accdb8499c86d4414b72565a38 P b7ab4784c7344b939bc36f639286f377 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.13, Last appended by leader: 13, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:20:56.357875 12561 raft_consensus.cc:515] T b56bf91d90824c959e21e0cee5ba1816 P cd75a17ab2604397adab03bb8b5fd75c [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:56.458141 12673 raft_consensus.cc:3060] T fe20b4b48823486ca3b9c648db6ce8aa P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:56.461328 12246 raft_consensus.cc:493] T 4275cf08e63345f993bce8664eada830 P b7ab4784c7344b939bc36f639286f377 [term 14 FOLLOWER]: Starting leader election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:20:56.435276 12742 raft_consensus.cc:2749] T 4275cf08e63345f993bce8664eada830 P cd75a17ab2604397adab03bb8b5fd75c [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:20:56.433425 12746 raft_consensus.cc:2749] T ce4f062dcd314d43a63ca74067cb5ee3 P cd75a17ab2604397adab03bb8b5fd75c [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:20:56.473680  6799 raft_consensus.cc:1275] T 7c37d41cd9164c15a6826ca62a851a69 P b7ab4784c7344b939bc36f639286f377 [term 16 FOLLOWER]: Refusing update from remote peer ccd8a4c3bfe3413cb2ae219b09aea832: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:20:56.429819 12756 raft_consensus.cc:2749] T 9b3759de40694069b13c0f8bd40e5709 P cd75a17ab2604397adab03bb8b5fd75c [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:20:56.453372 12631 raft_consensus.cc:493] T 34f36d59d88f40fe8a2805e604fc6c0a P b7ab4784c7344b939bc36f639286f377 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:20:56.482357  6697 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 45584.5us
I20260709 13:20:56.518932  6872 raft_consensus.cc:2393] T b56bf91d90824c959e21e0cee5ba1816 P cd75a17ab2604397adab03bb8b5fd75c [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate ccd8a4c3bfe3413cb2ae219b09aea832 in current term 17: Already voted for candidate cd75a17ab2604397adab03bb8b5fd75c in this term.
I20260709 13:20:56.520401  6697 leader_election.cc:304] T 7a734b5ab7834e05a8c422208acc58b1 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377
I20260709 13:20:56.452149 12689 raft_consensus.cc:515] T f03d0dbf16864ca4bc1bb5e4c0334c0f P ccd8a4c3bfe3413cb2ae219b09aea832 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:56.492148  6807 raft_consensus.cc:3060] T d8cee0accdb8499c86d4414b72565a38 P b7ab4784c7344b939bc36f639286f377 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:20:56.449738 12527 consensus_queue.cc:1048] T dbdf895bba214ff68685a24fd17dfb5d P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Connected to new peer: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.016s
I20260709 13:20:56.459324  6772 leader_election.cc:304] T 90d42e216d9741e190bca19a781291fd P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:20:56.496312  6800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be1a92657f494cac8dd227d152f50151" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 19 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:56.476235 12594 raft_consensus.cc:2804] T 44bde925b2e541b69890d70715b85176 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:20:56.499655 12497 raft_consensus.cc:2749] T 2c240553ce044eedb41541d72b9475d7 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:20:56.498930  6626 catalog_manager.cc:5697] T 4d9def8b32fd443aa94ab1420b06837b P b7ab4784c7344b939bc36f639286f377 reported cstate change: term changed from 6 to 7, leader changed from cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67) to b7ab4784c7344b939bc36f639286f377 (127.5.126.66). New cstate: current_term: 7 leader_uuid: "b7ab4784c7344b939bc36f639286f377" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:56.458503 12668 raft_consensus.cc:2749] T 17587d6730594da4a56fa13a353232a1 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:20:56.503383 12608 raft_consensus.cc:493] T 9e326172347f45e99a0d482b5d8ef768 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:20:56.463943 12613 raft_consensus.cc:3060] T e31b9971c15848dea59d4d4130141d9e P ccd8a4c3bfe3413cb2ae219b09aea832 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:56.451102 12340 raft_consensus.cc:515] T f4b8bd455d5a47c18a1380839c6e0d61 P b7ab4784c7344b939bc36f639286f377 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:56.419562 12730 raft_consensus.cc:493] T ab432e62819d499eaaf3dd55481dd930 P b7ab4784c7344b939bc36f639286f377 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:20:56.507110 12651 consensus_meta.cc:287] T a3022224cc81473690653a83d4e99470 P ccd8a4c3bfe3413cb2ae219b09aea832: Time spent flushing consensus metadata: real 0.502s	user 0.005s	sys 0.006s
I20260709 13:20:56.525794  6697 leader_election.cc:304] T a1704639a875409b9959353527b3fd68 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:20:56.463665 12543 consensus_queue.cc:1048] T 95a75bfe094d4bdc963aba3f08dfcd25 P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Connected to new peer: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.045s
I20260709 13:20:56.500771 12271 raft_consensus.cc:2804] T 427c124d773f483294511e80fe340075 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:20:56.538372  6879 raft_consensus.cc:1275] T bd6869f07b5a4885a0b99fbe60c3b175 P cd75a17ab2604397adab03bb8b5fd75c [term 18 FOLLOWER]: Refusing update from remote peer ccd8a4c3bfe3413cb2ae219b09aea832: Log matching property violated. Preceding OpId in replica: term: 16 index: 8. Preceding OpId from leader: term: 18 index: 9. (index mismatch)
W20260709 13:20:56.538599  6772 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 79356.8us
I20260709 13:20:56.459681  6844 leader_election.cc:304] T f4b8bd455d5a47c18a1380839c6e0d61 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:20:56.509462 12246 raft_consensus.cc:3060] T 4275cf08e63345f993bce8664eada830 P b7ab4784c7344b939bc36f639286f377 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:20:56.600323  6695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 102985us
I20260709 13:20:56.604858  6807 raft_consensus.cc:1275] T d8cee0accdb8499c86d4414b72565a38 P b7ab4784c7344b939bc36f639286f377 [term 18 FOLLOWER]: Refusing update from remote peer 7ba59cc884714e8aa5f3f0ecaed84cbb: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 18 index: 13. (term mismatch)
I20260709 13:20:56.711846  6807 pending_rounds.cc:85] T d8cee0accdb8499c86d4414b72565a38 P b7ab4784c7344b939bc36f639286f377: Aborting all ops after (but not including) 12
I20260709 13:20:56.712122  6807 pending_rounds.cc:107] T d8cee0accdb8499c86d4414b72565a38 P b7ab4784c7344b939bc36f639286f377: Aborting uncommitted NO_OP operation due to leader change: 17.13
I20260709 13:20:56.712371  6807 raft_consensus.cc:2889] T d8cee0accdb8499c86d4414b72565a38 P b7ab4784c7344b939bc36f639286f377 [term 18 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:20:56.607894  6770 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:56.523301 12631 raft_consensus.cc:3060] T 34f36d59d88f40fe8a2805e604fc6c0a P b7ab4784c7344b939bc36f639286f377 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:56.654685  6723 raft_consensus.cc:1275] T f03d0dbf16864ca4bc1bb5e4c0334c0f P ccd8a4c3bfe3413cb2ae219b09aea832 [term 17 FOLLOWER]: Refusing update from remote peer b7ab4784c7344b939bc36f639286f377: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 17 index: 9. (index mismatch)
I20260709 13:20:56.514864 12667 raft_consensus.cc:515] T 3411566abe2d4c9bb4b2adfdd05e6f17 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:56.517902 12714 raft_consensus.cc:2804] T e31b9971c15848dea59d4d4130141d9e P b7ab4784c7344b939bc36f639286f377 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:20:56.670181 12756 raft_consensus.cc:493] T bd6869f07b5a4885a0b99fbe60c3b175 P cd75a17ab2604397adab03bb8b5fd75c [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:56.670657 12652 raft_consensus.cc:2804] T dbdf895bba214ff68685a24fd17dfb5d P ccd8a4c3bfe3413cb2ae219b09aea832 [term 15 FOLLOWER]: Leader pre-election won for term 16
W20260709 13:20:56.671917 12759 log.cc:927] Time spent T 95a75bfe094d4bdc963aba3f08dfcd25 P 7ba59cc884714e8aa5f3f0ecaed84cbb: Append to log took a long time: real 0.219s	user 0.000s	sys 0.000s
I20260709 13:20:56.525306 12345 raft_consensus.cc:515] T 17587d6730594da4a56fa13a353232a1 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:20:56.682512 12653 leader_election.cc:290] T d33d5ee8ef6f415593d8df52063161ad P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 15 election: Requested vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:56.687688 12626 consensus_queue.cc:1048] T 9e326172347f45e99a0d482b5d8ef768 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
W20260709 13:20:56.688776  6697 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 163077us
I20260709 13:20:56.688831  6772 leader_election.cc:304] T 7c44c4849aa54f2b94d1f1bef9ed546f P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:20:56.689469 12551 raft_consensus.cc:2749] T a1704639a875409b9959353527b3fd68 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:20:56.606693 12608 raft_consensus.cc:515] T 9e326172347f45e99a0d482b5d8ef768 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:56.687789 12492 consensus_queue.cc:1048] T 7a734b5ab7834e05a8c422208acc58b1 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.004s
W20260709 13:20:56.692183 12764 log.cc:927] Time spent T 7a734b5ab7834e05a8c422208acc58b1 P b7ab4784c7344b939bc36f639286f377: Append to log took a long time: real 0.054s	user 0.001s	sys 0.000s
I20260709 13:20:56.693773 12561 leader_election.cc:290] T b56bf91d90824c959e21e0cee5ba1816 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 17 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
W20260709 13:20:56.696717  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 237124us
I20260709 13:20:56.698294 12527 raft_consensus.cc:3060] T f4b8bd455d5a47c18a1380839c6e0d61 P cd75a17ab2604397adab03bb8b5fd75c [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:56.704767 12340 leader_election.cc:290] T f4b8bd455d5a47c18a1380839c6e0d61 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:56.709121 12271 raft_consensus.cc:493] T 427c124d773f483294511e80fe340075 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:56.714107  6728 raft_consensus.cc:1275] T 3fa34c08b205435dba97346991aa1f92 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 20 FOLLOWER]: Refusing update from remote peer cd75a17ab2604397adab03bb8b5fd75c: Log matching property violated. Preceding OpId in replica: term: 19 index: 15. Preceding OpId from leader: term: 20 index: 15. (term mismatch)
I20260709 13:20:56.759974  6728 pending_rounds.cc:85] T 3fa34c08b205435dba97346991aa1f92 P ccd8a4c3bfe3413cb2ae219b09aea832: Aborting all ops after (but not including) 14
I20260709 13:20:56.760370  6728 pending_rounds.cc:107] T 3fa34c08b205435dba97346991aa1f92 P ccd8a4c3bfe3413cb2ae219b09aea832: Aborting uncommitted NO_OP operation due to leader change: 19.15
I20260709 13:20:56.715420  6770 leader_election.cc:304] T 07a92dd554674067a83a9cb68c4773f2 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
W20260709 13:20:56.532460 12616 consensus_meta.cc:287] T 404190ce4ce94cecbfcb6ea9d1dd8626 P 7ba59cc884714e8aa5f3f0ecaed84cbb: Time spent flushing consensus metadata: real 0.573s	user 0.010s	sys 0.001s
I20260709 13:20:56.586546 12766 raft_consensus.cc:493] T 4f00a2e87e56452083b759f60d461ee3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:56.764568  6844 leader_election.cc:304] T 8c7f33e544204fbaac4078e3e83bbf4e P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:20:56.660622 12730 raft_consensus.cc:3060] T ab432e62819d499eaaf3dd55481dd930 P b7ab4784c7344b939bc36f639286f377 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:20:56.597506 12620 raft_consensus.cc:2804] T 90d42e216d9741e190bca19a781291fd P b7ab4784c7344b939bc36f639286f377 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:20:56.770112 12620 raft_consensus.cc:493] T 90d42e216d9741e190bca19a781291fd P b7ab4784c7344b939bc36f639286f377 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:56.770637 12620 raft_consensus.cc:3060] T 90d42e216d9741e190bca19a781291fd P b7ab4784c7344b939bc36f639286f377 [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:20:56.716965 12370 consensus_meta.cc:287] T 9b3759de40694069b13c0f8bd40e5709 P ccd8a4c3bfe3413cb2ae219b09aea832: Time spent flushing consensus metadata: real 0.567s	user 0.015s	sys 0.006s
I20260709 13:20:56.732007  6697 leader_election.cc:400] T f3f9c2e2bf644115957398fe4c9459db P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 16 election: Vote denied by peer cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931) with higher term. Message: Invalid argument: T f3f9c2e2bf644115957398fe4c9459db P cd75a17ab2604397adab03bb8b5fd75c [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 16. Current term is 17.
I20260709 13:20:56.533033 12517 raft_consensus.cc:515] T 4b8cacb381b746da8d0049b0a83b41dd P ccd8a4c3bfe3413cb2ae219b09aea832 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
W20260709 13:20:56.734864  6772 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 46114us
I20260709 13:20:56.738344  6732 raft_consensus.cc:2393] T 3411566abe2d4c9bb4b2adfdd05e6f17 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c in current term 15: Already voted for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in this term.
I20260709 13:20:56.607546 12594 raft_consensus.cc:697] T 44bde925b2e541b69890d70715b85176 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 17 LEADER]: Becoming Leader. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
I20260709 13:20:56.748118  6725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1704639a875409b9959353527b3fd68" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:56.748540  6724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f9c2e2bf644115957398fe4c9459db" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:20:56.780099  6724 raft_consensus.cc:3060] T f3f9c2e2bf644115957398fe4c9459db P ccd8a4c3bfe3413cb2ae219b09aea832 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:56.748741  6731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "711ef6523deb4cbe8ef2ba61e1c21c98" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:56.725098 12714 raft_consensus.cc:493] T e31b9971c15848dea59d4d4130141d9e P b7ab4784c7344b939bc36f639286f377 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:56.711249 12651 raft_consensus.cc:515] T a3022224cc81473690653a83d4e99470 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:56.749811  7498 raft_consensus.cc:1240] T 17587d6730594da4a56fa13a353232a1 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 22 FOLLOWER]: Rejecting Update request from peer b7ab4784c7344b939bc36f639286f377 for earlier term 21. Current term is 22. Ops: []
I20260709 13:20:56.814328  6772 leader_election.cc:304] T 1528ab62b6fe4e3099d08f141afee116 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:20:56.723771 12652 raft_consensus.cc:493] T dbdf895bba214ff68685a24fd17dfb5d P ccd8a4c3bfe3413cb2ae219b09aea832 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:56.816320 12652 raft_consensus.cc:3060] T dbdf895bba214ff68685a24fd17dfb5d P ccd8a4c3bfe3413cb2ae219b09aea832 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:56.757427  6727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d65025eea89441290d85dd053810e31" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 18 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:56.760715  6728 raft_consensus.cc:2889] T 3fa34c08b205435dba97346991aa1f92 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 20 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:20:56.817871  6728 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49998 (request call id 1433) took 1028 ms. Trace:
I20260709 13:20:56.818264  6772 leader_election.cc:304] T 7ba5dac66ab5497e9e336f2a3c28cda5 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:20:56.818302  6728 rpcz_store.cc:276] 0709 13:20:55.789927 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:55.791780 (+  1853us) service_pool.cc:224] Handling call
0709 13:20:55.792228 (+   448us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:56.140835 (+348607us) spinlock_profiling.cc:243] Waited 242 ms on lock 0x7b5400282420. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f921dc0 00007fcc0f9ac1c0 00007fcc0f9ad231 00007fcc0f9a9d8f 00007fcc0f9a983e 00007fcc1496e419 00007fcc0dee5bd4 00007fcc0dee5b62 00007fcc0dee5a91 00007fcc0dee5a0c
0709 13:20:56.817595 (+676760us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:56.817807 (+   212us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":556497664}
W20260709 13:20:56.762878  6770 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 47544.1us
I20260709 13:20:56.762215 12610 raft_consensus.cc:493] T 7c44c4849aa54f2b94d1f1bef9ed546f P cd75a17ab2604397adab03bb8b5fd75c [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:56.820333  6770 leader_election.cc:304] T f5be3a11b23d4ea9b08300a2789821c7 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
I20260709 13:20:56.767592  6844 leader_election.cc:304] T 7ba5dac66ab5497e9e336f2a3c28cda5 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, b7ab4784c7344b939bc36f639286f377
I20260709 13:20:56.773324  6697 leader_election.cc:403] T f3f9c2e2bf644115957398fe4c9459db P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 16 election: Cancelling election due to peer responding with higher term
I20260709 13:20:56.782244  6731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8292e16e5654be6bc408560cf256aaa" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:56.755743 12543 raft_consensus.cc:493] T 3a485a995abc4807b6e511e45419f737 P cd75a17ab2604397adab03bb8b5fd75c [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:56.749806 12624 raft_consensus.cc:493] T e77e330a82df4b43a745d57a68f6f057 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:20:56.723474 12775 consensus_queue.cc:1048] T 7c37d41cd9164c15a6826ca62a851a69 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.047s
I20260709 13:20:56.727130 12756 raft_consensus.cc:515] T bd6869f07b5a4885a0b99fbe60c3b175 P cd75a17ab2604397adab03bb8b5fd75c [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:56.762918 12271 raft_consensus.cc:3060] T 427c124d773f483294511e80fe340075 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:56.717502 12757 consensus_queue.cc:1048] T d8cee0accdb8499c86d4414b72565a38 P 7ba59cc884714e8aa5f3f0ecaed84cbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.024s
I20260709 13:20:56.766856 12616 raft_consensus.cc:515] T 404190ce4ce94cecbfcb6ea9d1dd8626 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:20:56.824704  6770 leader_election.cc:304] T 3a485a995abc4807b6e511e45419f737 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
I20260709 13:20:56.778677 12370 raft_consensus.cc:515] T 9b3759de40694069b13c0f8bd40e5709 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
W20260709 13:20:56.826809  6697 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 97322.5us
I20260709 13:20:56.833684  6725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e326172347f45e99a0d482b5d8ef768" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:56.887326  6725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b56bf91d90824c959e21e0cee5ba1816" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:20:56.776201 12561 raft_consensus.cc:2749] T 8c7f33e544204fbaac4078e3e83bbf4e P cd75a17ab2604397adab03bb8b5fd75c [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:20:56.774029 12662 raft_consensus.cc:493] T 1bf4668eeb70467fb3dc5a0289233b3c P cd75a17ab2604397adab03bb8b5fd75c [term 16 FOLLOWER]: Starting pre-election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:20:56.811619 12714 raft_consensus.cc:3060] T e31b9971c15848dea59d4d4130141d9e P b7ab4784c7344b939bc36f639286f377 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:56.834549 12624 raft_consensus.cc:515] T e77e330a82df4b43a745d57a68f6f057 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } }
W20260709 13:20:56.829185 12625 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 20 current term: 20 is higher.
I20260709 13:20:56.822939 12735 raft_consensus.cc:2749] T 1528ab62b6fe4e3099d08f141afee116 P b7ab4784c7344b939bc36f639286f377 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:20:56.835011 12543 raft_consensus.cc:515] T 3a485a995abc4807b6e511e45419f737 P cd75a17ab2604397adab03bb8b5fd75c [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:56.833051 12728 raft_consensus.cc:2804] T f5be3a11b23d4ea9b08300a2789821c7 P b7ab4784c7344b939bc36f639286f377 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:20:56.774281 12340 raft_consensus.cc:2804] T 07a92dd554674067a83a9cb68c4773f2 P b7ab4784c7344b939bc36f639286f377 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:20:56.866163 12563 raft_consensus.cc:493] T bb7fa124c3bf4ef9ab65a407cb008441 P cd75a17ab2604397adab03bb8b5fd75c [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 7ba59cc884714e8aa5f3f0ecaed84cbb)
I20260709 13:20:56.832949 12610 raft_consensus.cc:515] T 7c44c4849aa54f2b94d1f1bef9ed546f P cd75a17ab2604397adab03bb8b5fd75c [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:56.895645  6725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5be3a11b23d4ea9b08300a2789821c7" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:56.912930 12499 raft_consensus.cc:1064] T 7a734b5ab7834e05a8c422208acc58b1 P b7ab4784c7344b939bc36f639286f377: attempting to promote NON_VOTER 7ba59cc884714e8aa5f3f0ecaed84cbb to VOTER
I20260709 13:20:56.876662 12663 raft_consensus.cc:2749] T 7ba5dac66ab5497e9e336f2a3c28cda5 P cd75a17ab2604397adab03bb8b5fd75c [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:20:56.775192 12766 raft_consensus.cc:515] T 4f00a2e87e56452083b759f60d461ee3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
W20260709 13:20:56.875424 12582 consensus_meta.cc:287] T 95a75bfe094d4bdc963aba3f08dfcd25 P ccd8a4c3bfe3413cb2ae219b09aea832: Time spent flushing consensus metadata: real 0.676s	user 0.005s	sys 0.008s
I20260709 13:20:56.873409 12492 raft_consensus.cc:2749] T 7ba5dac66ab5497e9e336f2a3c28cda5 P b7ab4784c7344b939bc36f639286f377 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:20:56.821511 12761 raft_consensus.cc:493] T f03d0dbf16864ca4bc1bb5e4c0334c0f P cd75a17ab2604397adab03bb8b5fd75c [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:20:56.935415  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 167886us
W20260709 13:20:56.935647  6772 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.68:45071, user_credentials={real_user=slave}} blocked reactor thread for 117536us
I20260709 13:20:56.980531  6772 leader_election.cc:304] T 404190ce4ce94cecbfcb6ea9d1dd8626 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:20:56.980531  6844 leader_election.cc:304] T ab432e62819d499eaaf3dd55481dd930 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:20:56.912397  6724 raft_consensus.cc:2468] T f3f9c2e2bf644115957398fe4c9459db P ccd8a4c3bfe3413cb2ae219b09aea832 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 17.
W20260709 13:20:56.897356  6770 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 72761.2us
I20260709 13:20:56.957739  6725 raft_consensus.cc:2468] T f5be3a11b23d4ea9b08300a2789821c7 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 15.
I20260709 13:20:56.983026  6724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a92dd554674067a83a9cb68c4773f2" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:56.981942  6879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f03d0dbf16864ca4bc1bb5e4c0334c0f" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 18 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:56.983759  6724 raft_consensus.cc:2368] T 07a92dd554674067a83a9cb68c4773f2 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c for earlier term 14. Current term is 15.
I20260709 13:20:56.983647  6725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09c2a98de1a4decabd0ff900dd44caa" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:56.985240  6724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3d8792045a4583ae2e965b1350a5b4" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 16 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:20:56.961982  7502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be1a92657f494cac8dd227d152f50151" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 19 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:20:56.987403  7502 raft_consensus.cc:2410] T be1a92657f494cac8dd227d152f50151 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ccd8a4c3bfe3413cb2ae219b09aea832 for term 19 because replica has last-logged OpId of term: 17 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 13.
I20260709 13:20:56.902505 12694 consensus_queue.cc:1048] T ab432e62819d499eaaf3dd55481dd930 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.066s
I20260709 13:20:56.965505  6876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d33d5ee8ef6f415593d8df52063161ad" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:20:56.998667  6844 leader_election.cc:304] T 713b5728a197487c9300b310ab94e5a3 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:20:56.913491 12555 raft_consensus.cc:2804] T 3a485a995abc4807b6e511e45419f737 P b7ab4784c7344b939bc36f639286f377 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:20:56.930254 12484 raft_consensus.cc:2749] T 7c44c4849aa54f2b94d1f1bef9ed546f P b7ab4784c7344b939bc36f639286f377 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:20:56.930238 12728 raft_consensus.cc:493] T f5be3a11b23d4ea9b08300a2789821c7 P b7ab4784c7344b939bc36f639286f377 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:56.931854 12689 leader_election.cc:290] T f03d0dbf16864ca4bc1bb5e4c0334c0f P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
W20260709 13:20:56.970718 12602 consensus_meta.cc:287] T c4db81d9d329422bb3b4160ca4ac2d1d P ccd8a4c3bfe3413cb2ae219b09aea832: Time spent flushing consensus metadata: real 0.853s	user 0.012s	sys 0.003s
I20260709 13:20:56.964600  7501 raft_consensus.cc:1240] T 404190ce4ce94cecbfcb6ea9d1dd8626 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 15 FOLLOWER]: Rejecting Update request from peer ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 14. Current term is 15. Ops: []
I20260709 13:20:56.996178  6873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a92dd554674067a83a9cb68c4773f2" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:20:57.070721  6873 raft_consensus.cc:3060] T 07a92dd554674067a83a9cb68c4773f2 P cd75a17ab2604397adab03bb8b5fd75c [term 13 FOLLOWER]: Advancing to term 15
I20260709 13:20:56.997165  6874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4db81d9d329422bb3b4160ca4ac2d1d" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:20:57.001281  6799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1704639a875409b9959353527b3fd68" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:57.001958  6798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8292e16e5654be6bc408560cf256aaa" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:57.071429  6874 raft_consensus.cc:3060] T c4db81d9d329422bb3b4160ca4ac2d1d P cd75a17ab2604397adab03bb8b5fd75c [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:57.072525  6799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17587d6730594da4a56fa13a353232a1" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:20:57.072623  6798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f9c2e2bf644115957398fe4c9459db" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:20:57.073333  6798 raft_consensus.cc:3060] T f3f9c2e2bf644115957398fe4c9459db P b7ab4784c7344b939bc36f639286f377 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:57.073729  6799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b56bf91d90824c959e21e0cee5ba1816" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:20:57.074528  6799 raft_consensus.cc:2393] T b56bf91d90824c959e21e0cee5ba1816 P b7ab4784c7344b939bc36f639286f377 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c in current term 17: Already voted for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in this term.
I20260709 13:20:56.986313  6724 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "30e88460611e47b2ba16a46a30b5f416"
dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
mode: GRACEFUL
new_leader_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
 from {username='slave'} at 127.0.0.1:38536
I20260709 13:20:57.005187  7502 raft_consensus.cc:1275] T 4f00a2e87e56452083b759f60d461ee3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 18 FOLLOWER]: Refusing update from remote peer b7ab4784c7344b939bc36f639286f377: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 13:20:57.007231  6876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4b8bd455d5a47c18a1380839c6e0d61" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:57.076354  6724 raft_consensus.cc:606] T 30e88460611e47b2ba16a46a30b5f416 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 13 LEADER]: Received request to transfer leadership to TS cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:20:56.907413 12662 raft_consensus.cc:515] T 1bf4668eeb70467fb3dc5a0289233b3c P cd75a17ab2604397adab03bb8b5fd75c [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:56.931289 12738 consensus_queue.cc:1048] T 7c44c4849aa54f2b94d1f1bef9ed546f P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.055s
I20260709 13:20:56.970628 12340 raft_consensus.cc:697] T 07a92dd554674067a83a9cb68c4773f2 P b7ab4784c7344b939bc36f639286f377 [term 15 LEADER]: Becoming Leader. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
I20260709 13:20:57.019968  6844 leader_election.cc:304] T 3411566abe2d4c9bb4b2adfdd05e6f17 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:20:56.901562 12594 consensus_queue.cc:237] T 44bde925b2e541b69890d70715b85176 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:57.058962  6725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c37d41cd9164c15a6826ca62a851a69" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:56.930701 12653 consensus_queue.cc:1059] T bb3d8792045a4583ae2e965b1350a5b4 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: INVALID_TERM, Last received: 13.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.058s
I20260709 13:20:57.085947  6874 raft_consensus.cc:2468] T c4db81d9d329422bb3b4160ca4ac2d1d P cd75a17ab2604397adab03bb8b5fd75c [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 17.
I20260709 13:20:57.064386  6802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "711ef6523deb4cbe8ef2ba61e1c21c98" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:57.092244  6798 raft_consensus.cc:2468] T f3f9c2e2bf644115957398fe4c9459db P b7ab4784c7344b939bc36f639286f377 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 17.
I20260709 13:20:56.977021 12667 leader_election.cc:290] T 3411566abe2d4c9bb4b2adfdd05e6f17 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 15 election: Requested vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:57.002451  6803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e326172347f45e99a0d482b5d8ef768" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:56.957572 12613 raft_consensus.cc:515] T e31b9971c15848dea59d4d4130141d9e P ccd8a4c3bfe3413cb2ae219b09aea832 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
W20260709 13:20:57.131457  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 111526us
I20260709 13:20:57.062533  7500 raft_consensus.cc:1275] T be1a92657f494cac8dd227d152f50151 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 18 FOLLOWER]: Refusing update from remote peer b7ab4784c7344b939bc36f639286f377: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 18 index: 14. (term mismatch)
I20260709 13:20:57.065330  6800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d65025eea89441290d85dd053810e31" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 18 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:57.134703  7500 pending_rounds.cc:85] T be1a92657f494cac8dd227d152f50151 P 7ba59cc884714e8aa5f3f0ecaed84cbb: Aborting all ops after (but not including) 13
I20260709 13:20:57.094545  6799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5be3a11b23d4ea9b08300a2789821c7" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:57.126573  6874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a485a995abc4807b6e511e45419f737" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:57.135141  6844 leader_election.cc:304] T 90d42e216d9741e190bca19a781291fd P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:20:57.135746  6874 raft_consensus.cc:2468] T 3a485a995abc4807b6e511e45419f737 P cd75a17ab2604397adab03bb8b5fd75c [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 16.
I20260709 13:20:56.967638 12563 raft_consensus.cc:515] T bb7fa124c3bf4ef9ab65a407cb008441 P cd75a17ab2604397adab03bb8b5fd75c [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:20:56.974136 12775 consensus_queue.cc:1048] T bd6869f07b5a4885a0b99fbe60c3b175 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.093s
I20260709 13:20:56.989641 12497 raft_consensus.cc:2749] T f3f9c2e2bf644115957398fe4c9459db P ccd8a4c3bfe3413cb2ae219b09aea832 [term 17 FOLLOWER]: Leader election lost for term 16. Reason: Vote denied by peer cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931) with higher term. Message: Invalid argument: T f3f9c2e2bf644115957398fe4c9459db P cd75a17ab2604397adab03bb8b5fd75c [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 16. Current term is 17.
I20260709 13:20:57.135052  7500 pending_rounds.cc:107] T be1a92657f494cac8dd227d152f50151 P 7ba59cc884714e8aa5f3f0ecaed84cbb: Aborting uncommitted NO_OP operation due to leader change: 17.14
I20260709 13:20:57.069821 12345 leader_election.cc:290] T 17587d6730594da4a56fa13a353232a1 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 22 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:20:56.998335 12427 raft_consensus.cc:2749] T 404190ce4ce94cecbfcb6ea9d1dd8626 P b7ab4784c7344b939bc36f639286f377 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:20:57.085839 12663 raft_consensus.cc:493] T 7887766dc6784fcaa42b35c05fea7a99 P cd75a17ab2604397adab03bb8b5fd75c [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:57.007800 12555 raft_consensus.cc:493] T 3a485a995abc4807b6e511e45419f737 P b7ab4784c7344b939bc36f639286f377 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:57.066524 12728 raft_consensus.cc:3060] T f5be3a11b23d4ea9b08300a2789821c7 P b7ab4784c7344b939bc36f639286f377 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:57.163826 12517 leader_election.cc:290] T 4b8cacb381b746da8d0049b0a83b41dd P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 18 election: Requested vote from peers cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:20:57.015789 12741 raft_consensus.cc:2804] T ab432e62819d499eaaf3dd55481dd930 P cd75a17ab2604397adab03bb8b5fd75c [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:20:57.010275 12492 raft_consensus.cc:493] T 711ef6523deb4cbe8ef2ba61e1c21c98 P b7ab4784c7344b939bc36f639286f377 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:20:57.153978  7500 raft_consensus.cc:2889] T be1a92657f494cac8dd227d152f50151 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 18 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:20:57.068514 12692 raft_consensus.cc:493] T 4d9def8b32fd443aa94ab1420b06837b P b7ab4784c7344b939bc36f639286f377 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:56.977365 12582 raft_consensus.cc:515] T 95a75bfe094d4bdc963aba3f08dfcd25 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } attrs { replace: true } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: NON_VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: true } }
I20260709 13:20:57.068796 12704 raft_consensus.cc:2804] T 7a734b5ab7834e05a8c422208acc58b1 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:20:57.085773 12788 raft_consensus.cc:2749] T 713b5728a197487c9300b310ab94e5a3 P cd75a17ab2604397adab03bb8b5fd75c [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:20:57.137301  6874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5be3a11b23d4ea9b08300a2789821c7" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:56.990819 12761 raft_consensus.cc:515] T f03d0dbf16864ca4bc1bb5e4c0334c0f P cd75a17ab2604397adab03bb8b5fd75c [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:57.194548 12794 raft_consensus.cc:493] T 1528ab62b6fe4e3099d08f141afee116 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 13 FOLLOWER]: Starting pre-election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:20:57.007742 12626 consensus_queue.cc:1048] T 17587d6730594da4a56fa13a353232a1 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.146s
I20260709 13:20:57.149333 12790 raft_consensus.cc:493] T 427c124d773f483294511e80fe340075 P cd75a17ab2604397adab03bb8b5fd75c [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:57.122177 12602 raft_consensus.cc:515] T c4db81d9d329422bb3b4160ca4ac2d1d P ccd8a4c3bfe3413cb2ae219b09aea832 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:57.161221 12791 raft_consensus.cc:493] T 7887766dc6784fcaa42b35c05fea7a99 P b7ab4784c7344b939bc36f639286f377 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:57.174067 12555 raft_consensus.cc:3060] T 3a485a995abc4807b6e511e45419f737 P b7ab4784c7344b939bc36f639286f377 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:57.136960 12746 raft_consensus.cc:2804] T 3411566abe2d4c9bb4b2adfdd05e6f17 P cd75a17ab2604397adab03bb8b5fd75c [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:20:57.188069 12345 raft_consensus.cc:493] T bb3d8792045a4583ae2e965b1350a5b4 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 15 FOLLOWER]: Starting pre-election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:20:57.195006 12499 consensus_queue.cc:237] T 7a734b5ab7834e05a8c422208acc58b1 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 17.8, Last appended by leader: 7, Current term: 17, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } attrs { replace: true } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:20:57.233537 12746 raft_consensus.cc:697] T 3411566abe2d4c9bb4b2adfdd05e6f17 P cd75a17ab2604397adab03bb8b5fd75c [term 15 LEADER]: Becoming Leader. State: Replica: cd75a17ab2604397adab03bb8b5fd75c, State: Running, Role: LEADER
I20260709 13:20:57.234567 12746 consensus_queue.cc:237] T 3411566abe2d4c9bb4b2adfdd05e6f17 P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:57.191551 12340 consensus_queue.cc:237] T 07a92dd554674067a83a9cb68c4773f2 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:57.193590 12563 leader_election.cc:290] T bb7fa124c3bf4ef9ab65a407cb008441 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:20:57.224850 12610 leader_election.cc:290] T 7c44c4849aa54f2b94d1f1bef9ed546f P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:20:57.235934 12728 raft_consensus.cc:515] T f5be3a11b23d4ea9b08300a2789821c7 P b7ab4784c7344b939bc36f639286f377 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:57.223384 12794 raft_consensus.cc:515] T 1528ab62b6fe4e3099d08f141afee116 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:20:57.175745 12741 raft_consensus.cc:493] T ab432e62819d499eaaf3dd55481dd930 P cd75a17ab2604397adab03bb8b5fd75c [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:20:57.196498 12779 log.cc:927] Time spent T 4275cf08e63345f993bce8664eada830 P cd75a17ab2604397adab03bb8b5fd75c: Append to log took a long time: real 0.130s	user 0.000s	sys 0.001s
I20260709 13:20:57.196249 12370 leader_election.cc:290] T 9b3759de40694069b13c0f8bd40e5709 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 14 election: Requested vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
W20260709 13:20:57.227234 12773 log.cc:927] Time spent T 3fa34c08b205435dba97346991aa1f92 P 7ba59cc884714e8aa5f3f0ecaed84cbb: Append to log took a long time: real 0.167s	user 0.000s	sys 0.001s
I20260709 13:20:57.228861 12613 leader_election.cc:290] T e31b9971c15848dea59d4d4130141d9e P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 14 election: Requested vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:57.224972 12561 raft_consensus.cc:2804] T 90d42e216d9741e190bca19a781291fd P cd75a17ab2604397adab03bb8b5fd75c [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:20:57.223237 12616 leader_election.cc:290] T 404190ce4ce94cecbfcb6ea9d1dd8626 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 15 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:20:57.172101 12478 raft_consensus.cc:493] T bb7fa124c3bf4ef9ab65a407cb008441 P b7ab4784c7344b939bc36f639286f377 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 7ba59cc884714e8aa5f3f0ecaed84cbb)
I20260709 13:20:57.246351 12478 raft_consensus.cc:515] T bb7fa124c3bf4ef9ab65a407cb008441 P b7ab4784c7344b939bc36f639286f377 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:20:57.245829 12561 raft_consensus.cc:697] T 90d42e216d9741e190bca19a781291fd P cd75a17ab2604397adab03bb8b5fd75c [term 17 LEADER]: Becoming Leader. State: Replica: cd75a17ab2604397adab03bb8b5fd75c, State: Running, Role: LEADER
I20260709 13:20:57.249629 12478 leader_election.cc:290] T bb7fa124c3bf4ef9ab65a407cb008441 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:20:57.250553 12651 leader_election.cc:290] T a3022224cc81473690653a83d4e99470 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 19 election: Requested vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:57.248998 12561 consensus_queue.cc:237] T 90d42e216d9741e190bca19a781291fd P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 16.9, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:57.248083 12741 raft_consensus.cc:3060] T ab432e62819d499eaaf3dd55481dd930 P cd75a17ab2604397adab03bb8b5fd75c [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:20:57.190467 12692 raft_consensus.cc:515] T 4d9def8b32fd443aa94ab1420b06837b P b7ab4784c7344b939bc36f639286f377 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:57.196323 12246 raft_consensus.cc:515] T 4275cf08e63345f993bce8664eada830 P b7ab4784c7344b939bc36f639286f377 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:57.242789 12728 leader_election.cc:290] T f5be3a11b23d4ea9b08300a2789821c7 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 16 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:57.173664 12663 raft_consensus.cc:515] T 7887766dc6784fcaa42b35c05fea7a99 P cd75a17ab2604397adab03bb8b5fd75c [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:57.264322 12761 leader_election.cc:290] T f03d0dbf16864ca4bc1bb5e4c0334c0f P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:20:57.197309 12631 raft_consensus.cc:515] T 34f36d59d88f40fe8a2805e604fc6c0a P b7ab4784c7344b939bc36f639286f377 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:57.265043 12663 leader_election.cc:290] T 7887766dc6784fcaa42b35c05fea7a99 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:20:57.190181 12492 raft_consensus.cc:515] T 711ef6523deb4cbe8ef2ba61e1c21c98 P b7ab4784c7344b939bc36f639286f377 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:57.260890 12527 raft_consensus.cc:2749] T f4b8bd455d5a47c18a1380839c6e0d61 P cd75a17ab2604397adab03bb8b5fd75c [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:20:57.260648 12652 raft_consensus.cc:515] T dbdf895bba214ff68685a24fd17dfb5d P ccd8a4c3bfe3413cb2ae219b09aea832 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:57.261376 12602 leader_election.cc:290] T c4db81d9d329422bb3b4160ca4ac2d1d P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 16 election: Requested vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:57.261662 12662 leader_election.cc:290] T 1bf4668eeb70467fb3dc5a0289233b3c P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:20:57.262823 12582 leader_election.cc:290] T 95a75bfe094d4bdc963aba3f08dfcd25 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 15 election: Requested vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
W20260709 13:20:57.240027 12673 consensus_meta.cc:287] T fe20b4b48823486ca3b9c648db6ce8aa P 7ba59cc884714e8aa5f3f0ecaed84cbb: Time spent flushing consensus metadata: real 0.725s	user 0.001s	sys 0.010s
I20260709 13:20:57.263450 12555 raft_consensus.cc:515] T 3a485a995abc4807b6e511e45419f737 P b7ab4784c7344b939bc36f639286f377 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:57.224705 12791 raft_consensus.cc:515] T 7887766dc6784fcaa42b35c05fea7a99 P b7ab4784c7344b939bc36f639286f377 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:57.279227 12652 leader_election.cc:290] T dbdf895bba214ff68685a24fd17dfb5d P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 16 election: Requested vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:57.279091 12673 raft_consensus.cc:515] T fe20b4b48823486ca3b9c648db6ce8aa P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
W20260709 13:20:57.283394 12778 log.cc:927] Time spent T b3f13b31a1f84f0d89d007eadd57924c P 7ba59cc884714e8aa5f3f0ecaed84cbb: Append to log took a long time: real 0.307s	user 0.000s	sys 0.002s
I20260709 13:20:57.264340 12794 leader_election.cc:290] T 1528ab62b6fe4e3099d08f141afee116 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
W20260709 13:20:57.281136 12620 consensus_meta.cc:287] T 90d42e216d9741e190bca19a781291fd P b7ab4784c7344b939bc36f639286f377: Time spent flushing consensus metadata: real 0.510s	user 0.012s	sys 0.000s
I20260709 13:20:57.225327 12790 raft_consensus.cc:515] T 427c124d773f483294511e80fe340075 P cd75a17ab2604397adab03bb8b5fd75c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } attrs { replace: true } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:20:57.292217 12766 leader_election.cc:290] T 4f00a2e87e56452083b759f60d461ee3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:57.302752 12791 leader_election.cc:290] T 7887766dc6784fcaa42b35c05fea7a99 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:57.304658 12790 leader_election.cc:290] T 427c124d773f483294511e80fe340075 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:20:57.345229  6729 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50004 (request call id 2738) took 1137 ms. Trace:
I20260709 13:20:57.346439  6729 rpcz_store.cc:276] 0709 13:20:56.207892 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:56.208056 (+   164us) service_pool.cc:224] Handling call
0709 13:20:56.208431 (+   375us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:56.210509 (+  2078us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:56.210543 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:20:56.211143 (+   600us) log.cc:844] Serialized 26 byte log entry
0709 13:20:56.745618 (+534475us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:20:56.745668 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:56.745745 (+    77us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:57.344089 (+598344us) raft_consensus.cc:1685] finished
0709 13:20:57.344199 (+   110us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:57.344827 (+   628us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1691,"raft.queue_time_us":21373,"raft.run_cpu_time_us":137,"raft.run_wall_time_us":14975,"thread_start_us":423239,"threads_started":1,"wal-append.queue_time_us":904070}
I20260709 13:20:57.126963  6798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a92dd554674067a83a9cb68c4773f2" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:57.154994  6803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09c2a98de1a4decabd0ff900dd44caa" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:57.347012  6724 raft_consensus.cc:1240] T 95a75bfe094d4bdc963aba3f08dfcd25 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 15 FOLLOWER]: Rejecting Update request from peer cd75a17ab2604397adab03bb8b5fd75c for earlier term 14. Current term is 15. Ops: [14.8-14.8]
I20260709 13:20:57.354955  6803 raft_consensus.cc:1240] T 34f36d59d88f40fe8a2805e604fc6c0a P b7ab4784c7344b939bc36f639286f377 [term 16 FOLLOWER]: Rejecting Update request from peer cd75a17ab2604397adab03bb8b5fd75c for earlier term 15. Current term is 16. Ops: []
I20260709 13:20:57.356532  6799 raft_consensus.cc:2393] T f5be3a11b23d4ea9b08300a2789821c7 P b7ab4784c7344b939bc36f639286f377 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c in current term 16: Already voted for candidate b7ab4784c7344b939bc36f639286f377 in this term.
I20260709 13:20:57.356947  6800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c37d41cd9164c15a6826ca62a851a69" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:57.358580  6800 raft_consensus.cc:2468] T 7c37d41cd9164c15a6826ca62a851a69 P b7ab4784c7344b939bc36f639286f377 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 16.
W20260709 13:20:57.360402  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 225358us
I20260709 13:20:57.350245  6726 raft_consensus.cc:1275] T 34f36d59d88f40fe8a2805e604fc6c0a P ccd8a4c3bfe3413cb2ae219b09aea832 [term 15 FOLLOWER]: Refusing update from remote peer cd75a17ab2604397adab03bb8b5fd75c: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:20:57.347707  6730 raft_consensus.cc:3060] T c4db81d9d329422bb3b4160ca4ac2d1d P ccd8a4c3bfe3413cb2ae219b09aea832 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:20:57.370318  6844 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.5.126.65:44391 timed out after 1.531s (SENT) [suppressed 3 similar messages]
I20260709 13:20:57.347795  6725 raft_consensus.cc:1240] T dbdf895bba214ff68685a24fd17dfb5d P ccd8a4c3bfe3413cb2ae219b09aea832 [term 16 FOLLOWER]: Rejecting Update request from peer cd75a17ab2604397adab03bb8b5fd75c for earlier term 15. Current term is 16. Ops: [15.7-15.7]
I20260709 13:20:57.374698  6876 raft_consensus.cc:2468] T f4b8bd455d5a47c18a1380839c6e0d61 P cd75a17ab2604397adab03bb8b5fd75c [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 17.
I20260709 13:20:57.376062  6879 raft_consensus.cc:2468] T f03d0dbf16864ca4bc1bb5e4c0334c0f P cd75a17ab2604397adab03bb8b5fd75c [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 17.
I20260709 13:20:57.373490  6874 raft_consensus.cc:2468] T f5be3a11b23d4ea9b08300a2789821c7 P cd75a17ab2604397adab03bb8b5fd75c [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 15.
I20260709 13:20:57.379099  6874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "427c124d773f483294511e80fe340075" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:57.381476  6874 raft_consensus.cc:2468] T 427c124d773f483294511e80fe340075 P cd75a17ab2604397adab03bb8b5fd75c [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in term 15.
W20260709 13:20:57.387152  7468 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.636s	user 0.004s	sys 0.008s
I20260709 13:20:57.387910  7495 raft_consensus.cc:1240] T fe20b4b48823486ca3b9c648db6ce8aa P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 14 FOLLOWER]: Rejecting Update request from peer cd75a17ab2604397adab03bb8b5fd75c for earlier term 13. Current term is 14. Ops: []
I20260709 13:20:57.391322  7496 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50756 (request call id 450) took 1105 ms. Trace:
I20260709 13:20:57.391973  7496 rpcz_store.cc:276] 0709 13:20:56.285573 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:56.302039 (+ 16466us) service_pool.cc:224] Handling call
0709 13:20:56.302387 (+   348us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:56.458041 (+155654us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:56.458074 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:20:56.462983 (+  4909us) log.cc:844] Serialized 26 byte log entry
0709 13:20:56.753775 (+290792us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:20:56.753833 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:56.753937 (+   104us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:57.390456 (+636519us) raft_consensus.cc:1685] finished
0709 13:20:57.390498 (+    42us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:57.390888 (+   390us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":109641,"raft.run_cpu_time_us":148,"raft.run_wall_time_us":11750,"thread_start_us":415461,"threads_started":2,"wal-append.queue_time_us":437817}
W20260709 13:20:57.388021  7468 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.637s	user 0.004s	sys 0.008s
W20260709 13:20:57.395612  7468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 645081us
I20260709 13:20:57.394789  7500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b8cacb381b746da8d0049b0a83b41dd" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb"
I20260709 13:20:57.400539  7500 raft_consensus.cc:3060] T 4b8cacb381b746da8d0049b0a83b41dd P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:20:57.405834 12246 leader_election.cc:290] T 4275cf08e63345f993bce8664eada830 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 15 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:57.258343 12345 raft_consensus.cc:515] T bb3d8792045a4583ae2e965b1350a5b4 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:20:57.423837  6802 raft_consensus.cc:2410] T 711ef6523deb4cbe8ef2ba61e1c21c98 P b7ab4784c7344b939bc36f639286f377 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c for term 20 because replica has last-logged OpId of term: 19 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 10.
I20260709 13:20:57.425318 12492 leader_election.cc:290] T 711ef6523deb4cbe8ef2ba61e1c21c98 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
W20260709 13:20:57.423848  6732 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49998 (request call id 1442) took 1572 ms (client timeout 1531 ms). Trace:
W20260709 13:20:57.428280  6732 rpcz_store.cc:269] 0709 13:20:55.850882 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:55.882735 (+ 31853us) service_pool.cc:224] Handling call
0709 13:20:57.423132 (+1540397us) spinlock_profiling.cc:243] Waited 824 ms on lock 0x7b540031a6d4. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f9ae2fa 00007fcc1496fb17 00007fcc0deea6d4 00007fcc0deea662 00007fcc0deea591 00007fcc0deea50c 00007fcc0dee97c2 00007fcc0dce548c 00007fcc0dce48c6 00007fcc0dce426f
0709 13:20:57.423557 (+   425us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1894082944}
I20260709 13:20:57.466632 12620 raft_consensus.cc:515] T 90d42e216d9741e190bca19a781291fd P b7ab4784c7344b939bc36f639286f377 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:57.470197 12620 leader_election.cc:290] T 90d42e216d9741e190bca19a781291fd P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 18 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:57.470920 12631 leader_election.cc:290] T 34f36d59d88f40fe8a2805e604fc6c0a P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 16 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:57.471989 12345 leader_election.cc:290] T bb3d8792045a4583ae2e965b1350a5b4 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
W20260709 13:20:57.473497 12730 consensus_meta.cc:287] T ab432e62819d499eaaf3dd55481dd930 P b7ab4784c7344b939bc36f639286f377: Time spent flushing consensus metadata: real 0.704s	user 0.012s	sys 0.000s
I20260709 13:20:57.474026 12730 raft_consensus.cc:515] T ab432e62819d499eaaf3dd55481dd930 P b7ab4784c7344b939bc36f639286f377 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:57.475381 12555 leader_election.cc:290] T 3a485a995abc4807b6e511e45419f737 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 17 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:57.501536  6872 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53416 (request call id 3474) took 1286 ms. Trace:
I20260709 13:20:57.502190  6872 rpcz_store.cc:276] 0709 13:20:56.215067 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:56.256781 (+ 41714us) service_pool.cc:224] Handling call
0709 13:20:57.500797 (+1244016us) spinlock_profiling.cc:243] Waited 261 ms on lock 0x7b54000a7dd4. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f9ae2fa 00007fcc1496fb17 00007fcc0deea6d4 00007fcc0deea662 00007fcc0deea591 00007fcc0deea50c 00007fcc0dee97c2 00007fcc0dce548c 00007fcc0dce48c6 00007fcc0dce426f
0709 13:20:57.501226 (+   429us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":599651584}
I20260709 13:20:57.478276  6800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1528ab62b6fe4e3099d08f141afee116" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:57.509820  7500 raft_consensus.cc:2468] T 4b8cacb381b746da8d0049b0a83b41dd P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 18.
I20260709 13:20:57.474016  7498 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50744 (request call id 471) took 1296 ms. Trace:
I20260709 13:20:57.477986  6798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "404190ce4ce94cecbfcb6ea9d1dd8626" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:20:57.481141 12608 leader_election.cc:290] T 9e326172347f45e99a0d482b5d8ef768 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:57.485906 12624 leader_election.cc:290] T e77e330a82df4b43a745d57a68f6f057 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
W20260709 13:20:57.529690  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 159441us
I20260709 13:20:57.511721  7498 rpcz_store.cc:276] 0709 13:20:56.177268 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:56.177459 (+   191us) service_pool.cc:224] Handling call
0709 13:20:56.177981 (+   522us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:56.816556 (+638575us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:57.473391 (+656835us) spinlock_profiling.cc:243] Waited 572 ms on lock 0x7b5400537d54. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f9aae01 00007fcc0f9a983e 00007fcc1496e419 00007fcc0dee5bd4 00007fcc0dee5b62 00007fcc0dee5a91 00007fcc0dee5a0c 00007fcc0dee4cc2 00007fcc0dce548c 00007fcc0dce48c6
0709 13:20:57.473765 (+   374us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1314551168}
I20260709 13:20:57.525665  6873 raft_consensus.cc:2468] T 07a92dd554674067a83a9cb68c4773f2 P cd75a17ab2604397adab03bb8b5fd75c [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 15.
I20260709 13:20:57.479027 12673 leader_election.cc:290] T fe20b4b48823486ca3b9c648db6ce8aa P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 14 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:57.481583 12802 raft_consensus.cc:493] T be1a92657f494cac8dd227d152f50151 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:57.476845 12692 leader_election.cc:290] T 4d9def8b32fd443aa94ab1420b06837b P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:57.559244  6800 raft_consensus.cc:2468] T 1528ab62b6fe4e3099d08f141afee116 P b7ab4784c7344b939bc36f639286f377 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in term 13.
I20260709 13:20:57.563519  6798 raft_consensus.cc:3060] T 404190ce4ce94cecbfcb6ea9d1dd8626 P b7ab4784c7344b939bc36f639286f377 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:20:57.572746  6770 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:57.573073  6878 raft_consensus.cc:1275] T b56bf91d90824c959e21e0cee5ba1816 P cd75a17ab2604397adab03bb8b5fd75c [term 17 FOLLOWER]: Refusing update from remote peer ccd8a4c3bfe3413cb2ae219b09aea832: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 17 index: 10. (term mismatch)
I20260709 13:20:57.573396  6878 pending_rounds.cc:85] T b56bf91d90824c959e21e0cee5ba1816 P cd75a17ab2604397adab03bb8b5fd75c: Aborting all ops after (but not including) 9
I20260709 13:20:57.573626  6878 pending_rounds.cc:107] T b56bf91d90824c959e21e0cee5ba1816 P cd75a17ab2604397adab03bb8b5fd75c: Aborting uncommitted NO_OP operation due to leader change: 15.10
I20260709 13:20:57.573889  6878 raft_consensus.cc:2889] T b56bf91d90824c959e21e0cee5ba1816 P cd75a17ab2604397adab03bb8b5fd75c [term 17 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:20:57.574891  6803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f00a2e87e56452083b759f60d461ee3" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:57.576242  6803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "427c124d773f483294511e80fe340075" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:57.577210  6803 raft_consensus.cc:2468] T 427c124d773f483294511e80fe340075 P b7ab4784c7344b939bc36f639286f377 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 15.
I20260709 13:20:57.578770  6803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bf4668eeb70467fb3dc5a0289233b3c" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:57.580384  6877 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53416 (request call id 3490) took 1108 ms. Trace:
I20260709 13:20:57.580853  6877 rpcz_store.cc:276] 0709 13:20:56.402556 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:56.479015 (+ 76459us) service_pool.cc:224] Handling call
0709 13:20:56.479417 (+   402us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:56.520168 (+ 40751us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:56.520218 (+    50us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:20:56.527457 (+  7239us) log.cc:844] Serialized 26 byte log entry
0709 13:20:56.773463 (+246006us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:20:56.810947 (+ 37484us) log.cc:844] Serialized 14 byte log entry
0709 13:20:56.821722 (+ 10775us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:57.507091 (+685369us) spinlock_profiling.cc:243] Waited 40.4 ms on lock 0x7b54000b3bd4. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f9aae01 00007fcc0f9a983e 00007fcc1496e419 00007fcc0dee5bd4 00007fcc0dee5b62 00007fcc0dee5a91 00007fcc0dee5a0c 00007fcc0dee4cc2 00007fcc0dce548c 00007fcc0dce48c6
0709 13:20:57.507214 (+   123us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:57.507365 (+   151us) raft_consensus.cc:1685] finished
0709 13:20:57.507559 (+   194us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:57.511031 (+  3472us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":10402,"prepare.queue_time_us":39992,"prepare.run_cpu_time_us":56,"prepare.run_wall_time_us":56,"raft.queue_time_us":43243,"raft.run_cpu_time_us":202,"raft.run_wall_time_us":205,"spinlock_wait_cycles":92979072,"thread_start_us":236025,"threads_started":1,"wal-append.queue_time_us":419800}
I20260709 13:20:57.584890  6800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb7fa124c3bf4ef9ab65a407cb008441" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:57.586532  6800 raft_consensus.cc:2468] T bb7fa124c3bf4ef9ab65a407cb008441 P b7ab4784c7344b939bc36f639286f377 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 16.
I20260709 13:20:57.593768  7466 leader_election.cc:304] T 1528ab62b6fe4e3099d08f141afee116 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, b7ab4784c7344b939bc36f639286f377; no voters: 
I20260709 13:20:57.595218  6697 leader_election.cc:304] T 4b8cacb381b746da8d0049b0a83b41dd P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
I20260709 13:20:57.595435 12673 raft_consensus.cc:2804] T 1528ab62b6fe4e3099d08f141afee116 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:20:57.596160 12673 raft_consensus.cc:493] T 1528ab62b6fe4e3099d08f141afee116 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 13 FOLLOWER]: Starting leader election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:20:57.596642 12673 raft_consensus.cc:3060] T 1528ab62b6fe4e3099d08f141afee116 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:57.596865 12739 consensus_queue.cc:1059] T 404190ce4ce94cecbfcb6ea9d1dd8626 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false }, Status: INVALID_TERM, Last received: 14.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:20:57.599627 12739 raft_consensus.cc:3055] T 404190ce4ce94cecbfcb6ea9d1dd8626 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:20:57.601365 12802 raft_consensus.cc:515] T be1a92657f494cac8dd227d152f50151 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:20:57.606031 12756 leader_election.cc:290] T bd6869f07b5a4885a0b99fbe60c3b175 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:20:57.608158  6800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f03d0dbf16864ca4bc1bb5e4c0334c0f" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 18 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:57.608741 12673 raft_consensus.cc:515] T 1528ab62b6fe4e3099d08f141afee116 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 14 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:20:57.610097  6800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7887766dc6784fcaa42b35c05fea7a99" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:57.611140 12730 leader_election.cc:290] T ab432e62819d499eaaf3dd55481dd930 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 19 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:57.611485  6800 raft_consensus.cc:2393] T 7887766dc6784fcaa42b35c05fea7a99 P b7ab4784c7344b939bc36f639286f377 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c in current term 18: Already voted for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in this term.
I20260709 13:20:57.623242  6802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a485a995abc4807b6e511e45419f737" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:57.628854 12739 raft_consensus.cc:740] T 404190ce4ce94cecbfcb6ea9d1dd8626 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
I20260709 13:20:57.630043  6799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1528ab62b6fe4e3099d08f141afee116" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:20:57.630993  6799 raft_consensus.cc:3060] T 1528ab62b6fe4e3099d08f141afee116 P b7ab4784c7344b939bc36f639286f377 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:57.630668 12739 consensus_queue.cc:260] T 404190ce4ce94cecbfcb6ea9d1dd8626 P ccd8a4c3bfe3413cb2ae219b09aea832 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:20:57.633955  6802 raft_consensus.cc:2393] T 3a485a995abc4807b6e511e45419f737 P b7ab4784c7344b939bc36f639286f377 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c in current term 17: Already voted for candidate b7ab4784c7344b939bc36f639286f377 in this term.
I20260709 13:20:57.632139 12689 raft_consensus.cc:3055] T bb3d8792045a4583ae2e965b1350a5b4 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 15 LEADER]: Stepping down as leader of term 15
W20260709 13:20:57.611748 12763 log.cc:927] Time spent T d33d5ee8ef6f415593d8df52063161ad P cd75a17ab2604397adab03bb8b5fd75c: Append to log took a long time: real 1.074s	user 0.003s	sys 0.000s
I20260709 13:20:57.643971 12689 raft_consensus.cc:740] T bb3d8792045a4583ae2e965b1350a5b4 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
I20260709 13:20:57.645751 12802 leader_election.cc:290] T be1a92657f494cac8dd227d152f50151 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
W20260709 13:20:57.647749  6771 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:57.645644  6772 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.536s	user 0.000s	sys 0.028s
I20260709 13:20:57.651670  6730 raft_consensus.cc:2468] T c4db81d9d329422bb3b4160ca4ac2d1d P ccd8a4c3bfe3413cb2ae219b09aea832 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 17.
I20260709 13:20:57.652554  6803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c44c4849aa54f2b94d1f1bef9ed546f" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 20 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
W20260709 13:20:57.654747  6772 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.644s	user 0.000s	sys 0.029s
I20260709 13:20:57.639467 12631 consensus_queue.cc:1048] T f03d0dbf16864ca4bc1bb5e4c0334c0f P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
W20260709 13:20:57.658360  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 89150.6us
I20260709 13:20:57.640950 12673 leader_election.cc:290] T 1528ab62b6fe4e3099d08f141afee116 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 14 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
W20260709 13:20:57.659724  6697 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.68:45071, user_credentials={real_user=slave}} blocked reactor thread for 64818.2us
I20260709 13:20:57.647156 12689 consensus_queue.cc:260] T bb3d8792045a4583ae2e965b1350a5b4 P ccd8a4c3bfe3413cb2ae219b09aea832 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:20:57.667445 12689 raft_consensus.cc:3060] T bb3d8792045a4583ae2e965b1350a5b4 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:57.678035 12760 raft_consensus.cc:1064] T 95a75bfe094d4bdc963aba3f08dfcd25 P cd75a17ab2604397adab03bb8b5fd75c: attempting to promote NON_VOTER 7ba59cc884714e8aa5f3f0ecaed84cbb to VOTER
W20260709 13:20:57.678790 12760 raft_consensus.cc:1068] T 95a75bfe094d4bdc963aba3f08dfcd25 P cd75a17ab2604397adab03bb8b5fd75c: Unable to promote non-voter 7ba59cc884714e8aa5f3f0ecaed84cbb: Illegal state: Leader has not yet committed an operation in its own term
I20260709 13:20:57.679337 12760 raft_consensus.cc:493] T d33d5ee8ef6f415593d8df52063161ad P cd75a17ab2604397adab03bb8b5fd75c [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:20:57.684170 12555 raft_consensus.cc:493] T 3d65025eea89441290d85dd053810e31 P b7ab4784c7344b939bc36f639286f377 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:20:57.685122  7503 raft_consensus.cc:1240] T 1528ab62b6fe4e3099d08f141afee116 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 14 FOLLOWER]: Rejecting Update request from peer ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 13. Current term is 14. Ops: []
I20260709 13:20:57.684983 12555 raft_consensus.cc:515] T 3d65025eea89441290d85dd053810e31 P b7ab4784c7344b939bc36f639286f377 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
W20260709 13:20:57.684187  6807 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.515s	user 0.010s	sys 0.021s
W20260709 13:20:57.688205  6807 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.554s	user 0.011s	sys 0.021s
W20260709 13:20:57.692047  6801 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.504s	user 0.007s	sys 0.014s
I20260709 13:20:57.692888 12741 raft_consensus.cc:515] T ab432e62819d499eaaf3dd55481dd930 P cd75a17ab2604397adab03bb8b5fd75c [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:57.698571 12551 raft_consensus.cc:2804] T 4b8cacb381b746da8d0049b0a83b41dd P ccd8a4c3bfe3413cb2ae219b09aea832 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:20:57.698750 12760 raft_consensus.cc:515] T d33d5ee8ef6f415593d8df52063161ad P cd75a17ab2604397adab03bb8b5fd75c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:57.701222  6802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be1a92657f494cac8dd227d152f50151" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 19 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:57.695688 12741 leader_election.cc:290] T ab432e62819d499eaaf3dd55481dd930 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 19 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:20:57.708124 12691 raft_consensus.cc:493] T 8c7f33e544204fbaac4078e3e83bbf4e P ccd8a4c3bfe3413cb2ae219b09aea832 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:20:57.709105 12691 raft_consensus.cc:515] T 8c7f33e544204fbaac4078e3e83bbf4e P ccd8a4c3bfe3413cb2ae219b09aea832 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:57.712791  6876 raft_consensus.cc:1275] T d8cee0accdb8499c86d4414b72565a38 P cd75a17ab2604397adab03bb8b5fd75c [term 18 FOLLOWER]: Refusing update from remote peer 7ba59cc884714e8aa5f3f0ecaed84cbb: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 13:20:57.714164  6881 raft_consensus.cc:2955] T 7a734b5ab7834e05a8c422208acc58b1 P cd75a17ab2604397adab03bb8b5fd75c [term 17 FOLLOWER]: Committing config change with OpId 13.6: config changed from index -1 to 6, NON_VOTER 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68) added. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } attrs { replace: true } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: NON_VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: true } } }
I20260709 13:20:57.719359  6799 raft_consensus.cc:2468] T 1528ab62b6fe4e3099d08f141afee116 P b7ab4784c7344b939bc36f639286f377 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in term 14.
I20260709 13:20:57.687381 12555 leader_election.cc:290] T 3d65025eea89441290d85dd053810e31 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:57.734052  7466 leader_election.cc:304] T 1528ab62b6fe4e3099d08f141afee116 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, b7ab4784c7344b939bc36f639286f377; no voters: 
W20260709 13:20:57.707157 12777 log.cc:927] Time spent T bb3d8792045a4583ae2e965b1350a5b4 P ccd8a4c3bfe3413cb2ae219b09aea832: Append to log took a long time: real 0.837s	user 0.002s	sys 0.000s
I20260709 13:20:57.739688  6798 raft_consensus.cc:2468] T 404190ce4ce94cecbfcb6ea9d1dd8626 P b7ab4784c7344b939bc36f639286f377 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in term 15.
I20260709 13:20:57.717115 12691 leader_election.cc:290] T 8c7f33e544204fbaac4078e3e83bbf4e P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:57.757797  6876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5be3a11b23d4ea9b08300a2789821c7" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:20:57.758687  6876 raft_consensus.cc:3060] T f5be3a11b23d4ea9b08300a2789821c7 P cd75a17ab2604397adab03bb8b5fd75c [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:57.743005 12345 raft_consensus.cc:2804] T 1528ab62b6fe4e3099d08f141afee116 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:20:57.754522  6695 leader_election.cc:304] T be1a92657f494cac8dd227d152f50151 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, b7ab4784c7344b939bc36f639286f377
I20260709 13:20:57.744001 12551 raft_consensus.cc:697] T 4b8cacb381b746da8d0049b0a83b41dd P ccd8a4c3bfe3413cb2ae219b09aea832 [term 18 LEADER]: Becoming Leader. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
I20260709 13:20:57.766662  6727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5be3a11b23d4ea9b08300a2789821c7" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:20:57.767725  6727 raft_consensus.cc:3060] T f5be3a11b23d4ea9b08300a2789821c7 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:20:57.767838 12780 log.cc:927] Time spent T 7c44c4849aa54f2b94d1f1bef9ed546f P b7ab4784c7344b939bc36f639286f377: Append to log took a long time: real 0.898s	user 0.000s	sys 0.004s
I20260709 13:20:57.772614  6804 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:32976 (request call id 3506) took 1304 ms. Trace:
I20260709 13:20:57.773054  6804 rpcz_store.cc:276] 0709 13:20:56.468236 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:56.468431 (+   195us) service_pool.cc:224] Handling call
0709 13:20:56.468898 (+   467us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:20:56.483353 (+ 14455us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:56.483400 (+    47us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:20:56.500448 (+ 17048us) log.cc:844] Serialized 52 byte log entry
0709 13:20:56.716556 (+216108us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:20:56.917823 (+201267us) log.cc:844] Serialized 14 byte log entry
0709 13:20:56.928725 (+ 10902us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:56.928864 (+   139us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:57.244940 (+316076us) spinlock_profiling.cc:243] Waited 3.91 ms on lock 0x7b4800061ed8. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc148d3aa1 00007fcc148cab37 00007fcc148ca9ca 00007fcc149c226f 00007fcc149c1f37 00007fcc149d655c 00007fcc149d6508 00007fcc149d6488 00007fcc149d6443 00007fcc149d56ec 00007fcc138ffa96
0709 13:20:57.729822 (+484882us) spinlock_profiling.cc:243] Waited 189 ms on lock 0x7b4400022b4c. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0c745db1 00007fcc0c7e3c85 00007fcc0c7e46a2 00007fcc0f5561db 00007fcc0f551aaf 00007fcc0f54586e 00007fcc0f544bb6 00007fcc0f5447d8 00007fcc0f54e221 00007fcc0f54e1d9 00007fcc0f54e169
0709 13:20:57.772140 (+ 42318us) raft_consensus.cc:1685] finished
0709 13:20:57.772170 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:57.772409 (+   239us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":24451,"prepare.queue_time_us":254517,"prepare.run_cpu_time_us":68,"prepare.run_wall_time_us":8082,"raft.queue_time_us":28171,"raft.run_cpu_time_us":13913,"raft.run_wall_time_us":776603,"spinlock_wait_cycles":444670592,"thread_start_us":359597,"threads_started":2,"wal-append.queue_time_us":251598}
I20260709 13:20:57.775127  6806 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:32976 (request call id 3509) took 1305 ms. Trace:
I20260709 13:20:57.775652  6806 rpcz_store.cc:276] 0709 13:20:56.469328 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:56.474379 (+  5051us) service_pool.cc:224] Handling call
0709 13:20:56.474801 (+   422us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:56.483985 (+  9184us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:56.484020 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:20:56.484509 (+   489us) log.cc:844] Serialized 26 byte log entry
0709 13:20:57.237334 (+752825us) spinlock_profiling.cc:243] Waited 2.27 ms on lock 0x7b4800061ed8. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc148d3aa1 00007fcc148cab37 00007fcc148ca9ca 00007fcc149c226f 00007fcc149c1f37 00007fcc149d655c 00007fcc149d6508 00007fcc149d6488 00007fcc149d6443 00007fcc149d56ec 00007fcc138ffa96
0709 13:20:57.504963 (+267629us) spinlock_profiling.cc:243] Waited 8.04 ms on lock 0x7b1800455c80. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc15785de1 00007fcc157925b1 00007fcc0c89fe07 00007fcc156faab9 00007fcc0c8bc69b 00007fcc0c8ba93f 00007fcc0c8bcc02 00007fcc0f54420b 00007fcc0f549d23 00007fcc0f54a0d1 00007fcc0f965a0f
0709 13:20:57.721432 (+216469us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:20:57.723900 (+  2468us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:57.737838 (+ 13938us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:57.774644 (+ 36806us) raft_consensus.cc:1685] finished
0709 13:20:57.774668 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:57.774895 (+   227us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8648,"raft.queue_time_us":18497,"raft.run_cpu_time_us":10685,"raft.run_wall_time_us":737984,"spinlock_wait_cycles":23722496,"thread_start_us":122329,"threads_started":1,"wal-append.queue_time_us":1251247}
I20260709 13:20:57.777489  6874 raft_consensus.cc:1275] T f03d0dbf16864ca4bc1bb5e4c0334c0f P cd75a17ab2604397adab03bb8b5fd75c [term 17 FOLLOWER]: Refusing update from remote peer b7ab4784c7344b939bc36f639286f377: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 17 index: 9. (index mismatch)
I20260709 13:20:57.781998 12594 consensus_queue.cc:1059] T 1528ab62b6fe4e3099d08f141afee116 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false }, Status: INVALID_TERM, Last received: 13.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:20:57.784096 12668 raft_consensus.cc:3055] T 1528ab62b6fe4e3099d08f141afee116 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:20:57.784576 12668 raft_consensus.cc:740] T 1528ab62b6fe4e3099d08f141afee116 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
I20260709 13:20:57.786019 12704 raft_consensus.cc:493] T 7a734b5ab7834e05a8c422208acc58b1 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 17 FOLLOWER]: Starting leader election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:20:57.785959 12668 consensus_queue.cc:260] T 1528ab62b6fe4e3099d08f141afee116 P ccd8a4c3bfe3413cb2ae219b09aea832 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:20:57.786917  6876 raft_consensus.cc:2468] T f5be3a11b23d4ea9b08300a2789821c7 P cd75a17ab2604397adab03bb8b5fd75c [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 16.
W20260709 13:20:57.796023  6730 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50004 (request call id 2748) took 1542 ms (client timeout 1988 ms). Trace:
W20260709 13:20:57.796540  6730 rpcz_store.cc:269] 0709 13:20:56.253263 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:56.254593 (+  1330us) service_pool.cc:224] Handling call
0709 13:20:57.795695 (+1541102us) spinlock_profiling.cc:243] Waited 1.09 s on lock 0x7b540009a1d4. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f9ae2fa 00007fcc1496fb17 00007fcc0deea6d4 00007fcc0deea662 00007fcc0deea591 00007fcc0deea50c 00007fcc0dee97c2 00007fcc0dce548c 00007fcc0dce48c6 00007fcc0dce426f
0709 13:20:57.795921 (+   226us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2509896576}
W20260709 13:20:57.745980 12657 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.830s	user 0.013s	sys 0.007s
I20260709 13:20:57.758821 12785 raft_consensus.cc:493] T 24ee15416e3145beaa1b8183453729a3 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader cd75a17ab2604397adab03bb8b5fd75c)
I20260709 13:20:57.786798 12704 raft_consensus.cc:3060] T 7a734b5ab7834e05a8c422208acc58b1 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:20:57.761229 12739 raft_consensus.cc:3060] T 404190ce4ce94cecbfcb6ea9d1dd8626 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:57.789947 12668 raft_consensus.cc:3060] T 1528ab62b6fe4e3099d08f141afee116 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:57.828785  7498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb7fa124c3bf4ef9ab65a407cb008441" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:20:57.831707  7496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "427c124d773f483294511e80fe340075" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:20:57.833554 12785 raft_consensus.cc:515] T 24ee15416e3145beaa1b8183453729a3 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
W20260709 13:20:57.840857 12685 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 18 current term: 18 is higher.
W20260709 13:20:57.846597  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 44045.9us
I20260709 13:20:57.848457  6728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4b8bd455d5a47c18a1380839c6e0d61" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:57.849205  6844 leader_election.cc:304] T f3f9c2e2bf644115957398fe4c9459db P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:20:57.849776  6728 raft_consensus.cc:2468] T f4b8bd455d5a47c18a1380839c6e0d61 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 17.
W20260709 13:20:57.851049 12771 log.cc:927] Time spent T 711ef6523deb4cbe8ef2ba61e1c21c98 P cd75a17ab2604397adab03bb8b5fd75c: Append to log took a long time: real 0.849s	user 0.005s	sys 0.000s
I20260709 13:20:57.852813  7495 raft_consensus.cc:1275] T 7a734b5ab7834e05a8c422208acc58b1 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 17 LEARNER]: Refusing update from remote peer b7ab4784c7344b939bc36f639286f377: Log matching property violated. Preceding OpId in replica: term: 17 index: 8. Preceding OpId from leader: term: 17 index: 9. (index mismatch)
I20260709 13:20:57.853770  6875 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53416 (request call id 3476) took 1638 ms. Trace:
I20260709 13:20:57.854091  7498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb7fa124c3bf4ef9ab65a407cb008441" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:20:57.854131  6875 rpcz_store.cc:276] 0709 13:20:56.215484 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:56.338408 (+122924us) service_pool.cc:224] Handling call
0709 13:20:56.371692 (+ 33284us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:56.406722 (+ 35030us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:56.406765 (+    43us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:20:56.407227 (+   462us) log.cc:844] Serialized 26 byte log entry
0709 13:20:56.719112 (+311885us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:20:56.730032 (+ 10920us) log.cc:844] Serialized 14 byte log entry
0709 13:20:56.730298 (+   266us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:56.730382 (+    84us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:57.700312 (+969930us) spinlock_profiling.cc:243] Waited 158 ms on lock 0x7b4400022b4c. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0c745db1 00007fcc0c7e3c85 00007fcc0c7e46a2 00007fcc0f5561db 00007fcc0f551aaf 00007fcc0f54586e 00007fcc0f544bb6 00007fcc0f5447d8 00007fcc0f54e221 00007fcc0f54e1d9 00007fcc0f54e169
0709 13:20:57.853306 (+152994us) raft_consensus.cc:1685] finished
0709 13:20:57.853406 (+   100us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:57.853594 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":47892,"prepare.queue_time_us":9658,"prepare.run_cpu_time_us":46,"prepare.run_wall_time_us":49,"raft.queue_time_us":37576,"raft.run_cpu_time_us":279,"raft.run_wall_time_us":13529,"spinlock_wait_cycles":362414336,"thread_start_us":263483,"threads_started":1,"wal-append.queue_time_us":390875}
W20260709 13:20:57.860950 12714 consensus_meta.cc:287] T e31b9971c15848dea59d4d4130141d9e P b7ab4784c7344b939bc36f639286f377: Time spent flushing consensus metadata: real 0.948s	user 0.009s	sys 0.009s
I20260709 13:20:57.861481 12714 raft_consensus.cc:515] T e31b9971c15848dea59d4d4130141d9e P b7ab4784c7344b939bc36f639286f377 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:57.862977  6880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb7fa124c3bf4ef9ab65a407cb008441" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
W20260709 13:20:57.819563 12657 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.922s	user 0.014s	sys 0.007s
I20260709 13:20:57.863937  6880 raft_consensus.cc:2468] T bb7fa124c3bf4ef9ab65a407cb008441 P cd75a17ab2604397adab03bb8b5fd75c [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 16.
I20260709 13:20:57.750649  6802 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7a734b5ab7834e05a8c422208acc58b1"
dest_uuid: "b7ab4784c7344b939bc36f639286f377"
mode: GRACEFUL
new_leader_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
 from {username='slave'} at 127.0.0.1:38240
I20260709 13:20:57.867167  6876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4275cf08e63345f993bce8664eada830" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:20:57.870465  6874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "711ef6523deb4cbe8ef2ba61e1c21c98" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:57.867072  6727 raft_consensus.cc:2468] T f5be3a11b23d4ea9b08300a2789821c7 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 16.
I20260709 13:20:57.863785 12714 leader_election.cc:290] T e31b9971c15848dea59d4d4130141d9e P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 15 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:57.868831  6802 raft_consensus.cc:606] T 7a734b5ab7834e05a8c422208acc58b1 P b7ab4784c7344b939bc36f639286f377 [term 17 LEADER]: Received request to transfer leadership to TS cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:20:57.890110  6877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34f36d59d88f40fe8a2805e604fc6c0a" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
W20260709 13:20:57.865694 12271 consensus_meta.cc:287] T 427c124d773f483294511e80fe340075 P 7ba59cc884714e8aa5f3f0ecaed84cbb: Time spent flushing consensus metadata: real 0.995s	user 0.010s	sys 0.010s
I20260709 13:20:57.817199 12345 raft_consensus.cc:697] T 1528ab62b6fe4e3099d08f141afee116 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 14 LEADER]: Becoming Leader. State: Replica: 7ba59cc884714e8aa5f3f0ecaed84cbb, State: Running, Role: LEADER
I20260709 13:20:57.894723 12543 leader_election.cc:290] T 3a485a995abc4807b6e511e45419f737 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:20:57.895272 12625 raft_consensus.cc:2749] T be1a92657f494cac8dd227d152f50151 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:20:57.895887  6872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a485a995abc4807b6e511e45419f737" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:20:57.962608  6872 raft_consensus.cc:3060] T 3a485a995abc4807b6e511e45419f737 P cd75a17ab2604397adab03bb8b5fd75c [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:57.889192  6878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90d42e216d9741e190bca19a781291fd" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:20:57.900803 12756 raft_consensus.cc:493] T f58dc08b12a2494bb9a1372837970ca2 P cd75a17ab2604397adab03bb8b5fd75c [term 18 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:20:57.901216 12801 raft_consensus.cc:493] T 4d9def8b32fd443aa94ab1420b06837b P cd75a17ab2604397adab03bb8b5fd75c [term 15 FOLLOWER]: Starting pre-election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:20:57.901484 12685 consensus_queue.cc:1048] T 4f00a2e87e56452083b759f60d461ee3 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:20:57.902225  6697 leader_election.cc:304] T f03d0dbf16864ca4bc1bb5e4c0334c0f P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:20:57.903064 12527 consensus_queue.cc:1059] T fe20b4b48823486ca3b9c648db6ce8aa P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:20:57.860980 12785 leader_election.cc:290] T 24ee15416e3145beaa1b8183453729a3 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:20:57.904577 12561 raft_consensus.cc:1064] T 95a75bfe094d4bdc963aba3f08dfcd25 P cd75a17ab2604397adab03bb8b5fd75c: attempting to promote NON_VOTER 7ba59cc884714e8aa5f3f0ecaed84cbb to VOTER
I20260709 13:20:57.909106  6728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34f36d59d88f40fe8a2805e604fc6c0a" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:20:57.910111  6723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7887766dc6784fcaa42b35c05fea7a99" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:57.910362  6732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4275cf08e63345f993bce8664eada830" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:20:57.911041  6725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "711ef6523deb4cbe8ef2ba61e1c21c98" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:57.911654  6724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a485a995abc4807b6e511e45419f737" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:20:57.912128  6729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab432e62819d499eaaf3dd55481dd930" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
W20260709 13:20:57.914642  6696 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:57.917985  6730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d9def8b32fd443aa94ab1420b06837b" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:57.918527 12663 consensus_queue.cc:1059] T 34f36d59d88f40fe8a2805e604fc6c0a P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:20:57.919217  6726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90d42e216d9741e190bca19a781291fd" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:20:57.919597  6844 leader_election.cc:304] T 7c37d41cd9164c15a6826ca62a851a69 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:20:57.877281 12760 leader_election.cc:290] T d33d5ee8ef6f415593d8df52063161ad P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:20:57.925065  6799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d33d5ee8ef6f415593d8df52063161ad" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:20:57.926103  6807 raft_consensus.cc:1240] T 4275cf08e63345f993bce8664eada830 P b7ab4784c7344b939bc36f639286f377 [term 15 FOLLOWER]: Rejecting Update request from peer ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 14. Current term is 15. Ops: []
I20260709 13:20:57.928295 12698 raft_consensus.cc:493] T f09c2a98de1a4decabd0ff900dd44caa P b7ab4784c7344b939bc36f639286f377 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:20:57.929154  6880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7887766dc6784fcaa42b35c05fea7a99" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:57.767769 12551 consensus_queue.cc:237] T 4b8cacb381b746da8d0049b0a83b41dd P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:20:57.930465 12741 raft_consensus.cc:2804] T f3f9c2e2bf644115957398fe4c9459db P cd75a17ab2604397adab03bb8b5fd75c [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:20:57.931454 12800 raft_consensus.cc:493] T 4b8cacb381b746da8d0049b0a83b41dd P cd75a17ab2604397adab03bb8b5fd75c [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:57.935408  6873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab432e62819d499eaaf3dd55481dd930" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:20:57.936285  6879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d65025eea89441290d85dd053810e31" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
W20260709 13:20:57.939208  6695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 202213us
I20260709 13:20:57.940937  6803 raft_consensus.cc:1275] T b56bf91d90824c959e21e0cee5ba1816 P b7ab4784c7344b939bc36f639286f377 [term 17 FOLLOWER]: Refusing update from remote peer ccd8a4c3bfe3413cb2ae219b09aea832: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 13:20:57.948997  6802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f03d0dbf16864ca4bc1bb5e4c0334c0f" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 18 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:57.950150 12746 raft_consensus.cc:493] T d8cee0accdb8499c86d4414b72565a38 P cd75a17ab2604397adab03bb8b5fd75c [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:20:57.957312  6770 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:57.960623  7466 leader_election.cc:304] T 404190ce4ce94cecbfcb6ea9d1dd8626 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, b7ab4784c7344b939bc36f639286f377; no voters: 
I20260709 13:20:57.965863  6874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d9def8b32fd443aa94ab1420b06837b" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
W20260709 13:20:57.964509  6772 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.68:45071, user_credentials={real_user=slave}} blocked reactor thread for 73046us
W20260709 13:20:57.975237  6697 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 73148.7us
I20260709 13:20:57.971905 12767 raft_consensus.cc:493] T 3fa34c08b205435dba97346991aa1f92 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 20 FOLLOWER]: Starting pre-election (detected failure of leader cd75a17ab2604397adab03bb8b5fd75c)
W20260709 13:20:58.002099  6696 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:57.989765  6798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3411566abe2d4c9bb4b2adfdd05e6f17" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:20:57.998322  6873 raft_consensus.cc:2393] T ab432e62819d499eaaf3dd55481dd930 P cd75a17ab2604397adab03bb8b5fd75c [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate b7ab4784c7344b939bc36f639286f377 in current term 19: Already voted for candidate cd75a17ab2604397adab03bb8b5fd75c in this term.
I20260709 13:20:57.988353  6728 raft_consensus.cc:3060] T 34f36d59d88f40fe8a2805e604fc6c0a P ccd8a4c3bfe3413cb2ae219b09aea832 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:20:58.004736  7468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 258566us
I20260709 13:20:58.011320  6724 raft_consensus.cc:3060] T 3a485a995abc4807b6e511e45419f737 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:57.976753 12631 raft_consensus.cc:493] T 1bf4668eeb70467fb3dc5a0289233b3c P b7ab4784c7344b939bc36f639286f377 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
W20260709 13:20:57.987450 12561 raft_consensus.cc:1068] T 95a75bfe094d4bdc963aba3f08dfcd25 P cd75a17ab2604397adab03bb8b5fd75c: Unable to promote non-voter 7ba59cc884714e8aa5f3f0ecaed84cbb: Illegal state: Leader has not yet committed an operation in its own term
I20260709 13:20:58.019938  6726 raft_consensus.cc:3060] T 90d42e216d9741e190bca19a781291fd P ccd8a4c3bfe3413cb2ae219b09aea832 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:20:57.974746 12714 consensus_queue.cc:1048] T be1a92657f494cac8dd227d152f50151 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.028s
I20260709 13:20:57.997004 12625 raft_consensus.cc:2804] T f03d0dbf16864ca4bc1bb5e4c0334c0f P ccd8a4c3bfe3413cb2ae219b09aea832 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:20:58.032629  6723 raft_consensus.cc:1275] T be1a92657f494cac8dd227d152f50151 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 18 FOLLOWER]: Refusing update from remote peer b7ab4784c7344b939bc36f639286f377: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 13:20:57.972442 12271 raft_consensus.cc:515] T 427c124d773f483294511e80fe340075 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 16 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } attrs { replace: true } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
W20260709 13:20:58.027558  7466 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 156132us
I20260709 13:20:58.040470  6730 raft_consensus.cc:2468] T 4d9def8b32fd443aa94ab1420b06837b P ccd8a4c3bfe3413cb2ae219b09aea832 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 16.
I20260709 13:20:58.032800  6879 raft_consensus.cc:2468] T 3d65025eea89441290d85dd053810e31 P cd75a17ab2604397adab03bb8b5fd75c [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 17.
I20260709 13:20:58.045849  6880 raft_consensus.cc:2468] T 7887766dc6784fcaa42b35c05fea7a99 P cd75a17ab2604397adab03bb8b5fd75c [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 17.
I20260709 13:20:58.000695 12555 raft_consensus.cc:493] T bd6869f07b5a4885a0b99fbe60c3b175 P b7ab4784c7344b939bc36f639286f377 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:20:57.994397 12801 raft_consensus.cc:515] T 4d9def8b32fd443aa94ab1420b06837b P cd75a17ab2604397adab03bb8b5fd75c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:58.036828 12625 raft_consensus.cc:493] T f03d0dbf16864ca4bc1bb5e4c0334c0f P ccd8a4c3bfe3413cb2ae219b09aea832 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:58.066973  6798 raft_consensus.cc:2393] T 3411566abe2d4c9bb4b2adfdd05e6f17 P b7ab4784c7344b939bc36f639286f377 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate ccd8a4c3bfe3413cb2ae219b09aea832 in current term 15: Already voted for candidate cd75a17ab2604397adab03bb8b5fd75c in this term.
I20260709 13:20:58.031050 12741 raft_consensus.cc:697] T f3f9c2e2bf644115957398fe4c9459db P cd75a17ab2604397adab03bb8b5fd75c [term 17 LEADER]: Becoming Leader. State: Replica: cd75a17ab2604397adab03bb8b5fd75c, State: Running, Role: LEADER
I20260709 13:20:58.063627  6803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3022224cc81473690653a83d4e99470" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:20:58.069378  7496 raft_consensus.cc:2393] T 427c124d773f483294511e80fe340075 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c in current term 16: Already voted for candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in this term.
I20260709 13:20:58.077092  6732 raft_consensus.cc:1240] T d33d5ee8ef6f415593d8df52063161ad P ccd8a4c3bfe3413cb2ae219b09aea832 [term 15 FOLLOWER]: Rejecting Update request from peer b7ab4784c7344b939bc36f639286f377 for earlier term 14. Current term is 15. Ops: []
I20260709 13:20:58.077255 12555 raft_consensus.cc:515] T bd6869f07b5a4885a0b99fbe60c3b175 P b7ab4784c7344b939bc36f639286f377 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:58.029757 12767 raft_consensus.cc:515] T 3fa34c08b205435dba97346991aa1f92 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:20:58.039443 12746 raft_consensus.cc:515] T d8cee0accdb8499c86d4414b72565a38 P cd75a17ab2604397adab03bb8b5fd75c [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:20:58.017366 12756 raft_consensus.cc:515] T f58dc08b12a2494bb9a1372837970ca2 P cd75a17ab2604397adab03bb8b5fd75c [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:58.073222 12625 raft_consensus.cc:3060] T f03d0dbf16864ca4bc1bb5e4c0334c0f P ccd8a4c3bfe3413cb2ae219b09aea832 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:20:58.071336  7503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24ee15416e3145beaa1b8183453729a3" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:20:58.051705 12631 raft_consensus.cc:515] T 1bf4668eeb70467fb3dc5a0289233b3c P b7ab4784c7344b939bc36f639286f377 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:58.024483 12698 raft_consensus.cc:515] T f09c2a98de1a4decabd0ff900dd44caa P b7ab4784c7344b939bc36f639286f377 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:58.060688 12800 raft_consensus.cc:515] T 4b8cacb381b746da8d0049b0a83b41dd P cd75a17ab2604397adab03bb8b5fd75c [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
W20260709 13:20:58.080220  6846 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.68:45071, user_credentials={real_user=slave}} blocked reactor thread for 69942.7us
I20260709 13:20:58.097925  6730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d65025eea89441290d85dd053810e31" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:58.124739  6730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e31b9971c15848dea59d4d4130141d9e" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:20:58.125401  6730 raft_consensus.cc:3060] T e31b9971c15848dea59d4d4130141d9e P ccd8a4c3bfe3413cb2ae219b09aea832 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:58.079572 12271 leader_election.cc:290] T 427c124d773f483294511e80fe340075 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 16 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:58.128855  6802 raft_consensus.cc:1240] T ab432e62819d499eaaf3dd55481dd930 P b7ab4784c7344b939bc36f639286f377 [term 19 FOLLOWER]: Rejecting Update request from peer ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 18. Current term is 19. Ops: []
I20260709 13:20:58.096285 12766 raft_consensus.cc:493] T b3f13b31a1f84f0d89d007eadd57924c P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 14 FOLLOWER]: Starting pre-election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:20:58.085347 12801 leader_election.cc:290] T 4d9def8b32fd443aa94ab1420b06837b P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:20:58.084621 12787 raft_consensus.cc:493] T 20f6842e26174571996b8dea4151d4be P b7ab4784c7344b939bc36f639286f377 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:20:58.131692 12801 raft_consensus.cc:493] T de3186201e1a40d0b335eeb8b4e256e0 P cd75a17ab2604397adab03bb8b5fd75c [term 16 FOLLOWER]: Starting pre-election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:20:58.131911 12787 raft_consensus.cc:515] T 20f6842e26174571996b8dea4151d4be P b7ab4784c7344b939bc36f639286f377 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:58.132633 12801 raft_consensus.cc:515] T de3186201e1a40d0b335eeb8b4e256e0 P cd75a17ab2604397adab03bb8b5fd75c [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:58.085621  6874 raft_consensus.cc:2468] T 4d9def8b32fd443aa94ab1420b06837b P cd75a17ab2604397adab03bb8b5fd75c [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 15.
I20260709 13:20:58.130541 12766 raft_consensus.cc:515] T b3f13b31a1f84f0d89d007eadd57924c P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:20:58.106351  6803 raft_consensus.cc:3060] T a3022224cc81473690653a83d4e99470 P b7ab4784c7344b939bc36f639286f377 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:20:58.112633  6724 raft_consensus.cc:2468] T 3a485a995abc4807b6e511e45419f737 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 17.
I20260709 13:20:58.106540  6798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b3759de40694069b13c0f8bd40e5709" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:20:58.118997  6729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6869f07b5a4885a0b99fbe60c3b175" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:58.113561  6770 leader_election.cc:304] T c4db81d9d329422bb3b4160ca4ac2d1d P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
I20260709 13:20:58.158982  6724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "427c124d773f483294511e80fe340075" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:58.164816  6726 raft_consensus.cc:2468] T 90d42e216d9741e190bca19a781291fd P ccd8a4c3bfe3413cb2ae219b09aea832 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 18.
I20260709 13:20:58.166123  6726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17587d6730594da4a56fa13a353232a1" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:20:58.080299 12802 raft_consensus.cc:2804] T 404190ce4ce94cecbfcb6ea9d1dd8626 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:20:58.094959 12543 raft_consensus.cc:2804] T 7c37d41cd9164c15a6826ca62a851a69 P cd75a17ab2604397adab03bb8b5fd75c [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:20:58.084597 12756 leader_election.cc:290] T f58dc08b12a2494bb9a1372837970ca2 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:20:58.079574 12555 leader_election.cc:290] T bd6869f07b5a4885a0b99fbe60c3b175 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:58.082320 12746 leader_election.cc:290] T d8cee0accdb8499c86d4414b72565a38 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:20:58.112169 12631 leader_election.cc:290] T 1bf4668eeb70467fb3dc5a0289233b3c P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:58.107167 12767 leader_election.cc:290] T 3fa34c08b205435dba97346991aa1f92 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:58.115078 12698 leader_election.cc:290] T f09c2a98de1a4decabd0ff900dd44caa P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:58.181457  6800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e326172347f45e99a0d482b5d8ef768" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:58.194072  6873 raft_consensus.cc:1240] T ab432e62819d499eaaf3dd55481dd930 P cd75a17ab2604397adab03bb8b5fd75c [term 19 FOLLOWER]: Rejecting Update request from peer ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 18. Current term is 19. Ops: [18.10-18.10]
I20260709 13:20:58.087267 12741 consensus_queue.cc:237] T f3f9c2e2bf644115957398fe4c9459db P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:58.084285 12566 consensus_queue.cc:1059] T 17587d6730594da4a56fa13a353232a1 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.100s
I20260709 13:20:58.178411  6728 raft_consensus.cc:2468] T 34f36d59d88f40fe8a2805e604fc6c0a P ccd8a4c3bfe3413cb2ae219b09aea832 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 16.
I20260709 13:20:58.179204  6724 raft_consensus.cc:2468] T 427c124d773f483294511e80fe340075 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 15.
I20260709 13:20:58.203953  6724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe20b4b48823486ca3b9c648db6ce8aa" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:20:58.204955  6724 raft_consensus.cc:3060] T fe20b4b48823486ca3b9c648db6ce8aa P ccd8a4c3bfe3413cb2ae219b09aea832 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:58.203788  6728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bf4668eeb70467fb3dc5a0289233b3c" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:58.206527  6728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "404190ce4ce94cecbfcb6ea9d1dd8626" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:20:58.180123  6879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b8cacb381b746da8d0049b0a83b41dd" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:20:58.208771  6879 raft_consensus.cc:3060] T 4b8cacb381b746da8d0049b0a83b41dd P cd75a17ab2604397adab03bb8b5fd75c [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:20:58.205133  6726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1528ab62b6fe4e3099d08f141afee116" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:58.210675  6726 raft_consensus.cc:2468] T 1528ab62b6fe4e3099d08f141afee116 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in term 14.
I20260709 13:20:58.181874 12668 raft_consensus.cc:493] T 3fa34c08b205435dba97346991aa1f92 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:58.214649  6802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e31b9971c15848dea59d4d4130141d9e" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:20:58.176465 12543 raft_consensus.cc:493] T 7c37d41cd9164c15a6826ca62a851a69 P cd75a17ab2604397adab03bb8b5fd75c [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:58.117997 12800 leader_election.cc:290] T 4b8cacb381b746da8d0049b0a83b41dd P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:20:58.181875  6806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4db81d9d329422bb3b4160ca4ac2d1d" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:20:58.080363 12662 raft_consensus.cc:493] T 20f6842e26174571996b8dea4151d4be P cd75a17ab2604397adab03bb8b5fd75c [term 17 FOLLOWER]: Starting pre-election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:20:58.183619  6880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3411566abe2d4c9bb4b2adfdd05e6f17" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
W20260709 13:20:58.188277  6770 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 74884.8us
I20260709 13:20:58.181114  6807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a75bfe094d4bdc963aba3f08dfcd25" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:20:58.213570  6874 raft_consensus.cc:3060] T 7887766dc6784fcaa42b35c05fea7a99 P cd75a17ab2604397adab03bb8b5fd75c [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:20:58.226920  6802 raft_consensus.cc:2368] T e31b9971c15848dea59d4d4130141d9e P b7ab4784c7344b939bc36f639286f377 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 14. Current term is 15.
I20260709 13:20:58.219862  6730 raft_consensus.cc:2468] T e31b9971c15848dea59d4d4130141d9e P ccd8a4c3bfe3413cb2ae219b09aea832 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 15.
I20260709 13:20:58.224448 12543 raft_consensus.cc:3060] T 7c37d41cd9164c15a6826ca62a851a69 P cd75a17ab2604397adab03bb8b5fd75c [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:58.234750  6729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be1a92657f494cac8dd227d152f50151" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 19 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:58.105378 12345 consensus_queue.cc:237] T 1528ab62b6fe4e3099d08f141afee116 P 7ba59cc884714e8aa5f3f0ecaed84cbb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:20:58.246237  6878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3022224cc81473690653a83d4e99470" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:20:58.244009  6729 raft_consensus.cc:2468] T be1a92657f494cac8dd227d152f50151 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in term 18.
I20260709 13:20:58.253917  6803 raft_consensus.cc:2468] T a3022224cc81473690653a83d4e99470 P b7ab4784c7344b939bc36f639286f377 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 19.
I20260709 13:20:58.211108 12802 raft_consensus.cc:697] T 404190ce4ce94cecbfcb6ea9d1dd8626 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 15 LEADER]: Becoming Leader. State: Replica: 7ba59cc884714e8aa5f3f0ecaed84cbb, State: Running, Role: LEADER
I20260709 13:20:58.262439  6730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1528ab62b6fe4e3099d08f141afee116" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:20:58.263381  6800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77e330a82df4b43a745d57a68f6f057" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:58.258432  6878 raft_consensus.cc:3060] T a3022224cc81473690653a83d4e99470 P cd75a17ab2604397adab03bb8b5fd75c [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:20:58.271659  6802 raft_consensus.cc:1240] T 404190ce4ce94cecbfcb6ea9d1dd8626 P b7ab4784c7344b939bc36f639286f377 [term 15 FOLLOWER]: Rejecting Update request from peer ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 14. Current term is 15. Ops: []
I20260709 13:20:58.228392 12566 raft_consensus.cc:3055] T 17587d6730594da4a56fa13a353232a1 P b7ab4784c7344b939bc36f639286f377 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:20:58.238703 12555 raft_consensus.cc:2804] T c4db81d9d329422bb3b4160ca4ac2d1d P b7ab4784c7344b939bc36f639286f377 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:20:58.270560  6726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20f6842e26174571996b8dea4151d4be" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:58.179307 12810 consensus_queue.cc:1048] T 7a734b5ab7834e05a8c422208acc58b1 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.091s
I20260709 13:20:58.277464  6807 raft_consensus.cc:1240] T 1528ab62b6fe4e3099d08f141afee116 P b7ab4784c7344b939bc36f639286f377 [term 14 FOLLOWER]: Rejecting Update request from peer ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 13. Current term is 14. Ops: []
I20260709 13:20:58.243258 12787 leader_election.cc:290] T 20f6842e26174571996b8dea4151d4be P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:58.309064  6726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3d8792045a4583ae2e965b1350a5b4" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:58.309949  6729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c44c4849aa54f2b94d1f1bef9ed546f" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 20 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:58.274509 12566 raft_consensus.cc:740] T 17587d6730594da4a56fa13a353232a1 P b7ab4784c7344b939bc36f639286f377 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
I20260709 13:20:58.314417  6726 raft_consensus.cc:2468] T bb3d8792045a4583ae2e965b1350a5b4 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in term 16.
W20260709 13:20:58.337745  6772 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 109554us
I20260709 13:20:58.233290 12704 raft_consensus.cc:515] T 7a734b5ab7834e05a8c422208acc58b1 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } attrs { replace: true } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: NON_VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: true } }
I20260709 13:20:58.346591  6800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c7f33e544204fbaac4078e3e83bbf4e" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:58.370342  6724 raft_consensus.cc:2468] T fe20b4b48823486ca3b9c648db6ce8aa P ccd8a4c3bfe3413cb2ae219b09aea832 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in term 14.
I20260709 13:20:58.371912  6877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b3759de40694069b13c0f8bd40e5709" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:20:58.313493 12555 raft_consensus.cc:697] T c4db81d9d329422bb3b4160ca4ac2d1d P b7ab4784c7344b939bc36f639286f377 [term 17 LEADER]: Becoming Leader. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
I20260709 13:20:58.394059  6729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bf4668eeb70467fb3dc5a0289233b3c" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:58.308358 12625 raft_consensus.cc:515] T f03d0dbf16864ca4bc1bb5e4c0334c0f P ccd8a4c3bfe3413cb2ae219b09aea832 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:58.274549 12668 raft_consensus.cc:515] T 3fa34c08b205435dba97346991aa1f92 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:20:58.390611  6770 leader_election.cc:304] T f4b8bd455d5a47c18a1380839c6e0d61 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
I20260709 13:20:58.400471  6877 raft_consensus.cc:2393] T 9b3759de40694069b13c0f8bd40e5709 P cd75a17ab2604397adab03bb8b5fd75c [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate ccd8a4c3bfe3413cb2ae219b09aea832 in current term 14: Already voted for candidate cd75a17ab2604397adab03bb8b5fd75c in this term.
I20260709 13:20:58.406591  6724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09c2a98de1a4decabd0ff900dd44caa" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:58.267897 12662 raft_consensus.cc:515] T 20f6842e26174571996b8dea4151d4be P cd75a17ab2604397adab03bb8b5fd75c [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:58.424773  6805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbdf895bba214ff68685a24fd17dfb5d" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 16 candidate_status { last_received { term: 14 index: 6 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:20:58.437752 12631 raft_consensus.cc:2804] T f4b8bd455d5a47c18a1380839c6e0d61 P b7ab4784c7344b939bc36f639286f377 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:20:58.438179  6729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f03d0dbf16864ca4bc1bb5e4c0334c0f" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 18 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:58.439136  6729 raft_consensus.cc:2393] T f03d0dbf16864ca4bc1bb5e4c0334c0f P ccd8a4c3bfe3413cb2ae219b09aea832 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c in current term 18: Already voted for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in this term.
I20260709 13:20:58.438439 12631 raft_consensus.cc:493] T f4b8bd455d5a47c18a1380839c6e0d61 P b7ab4784c7344b939bc36f639286f377 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:58.439621 12631 raft_consensus.cc:3060] T f4b8bd455d5a47c18a1380839c6e0d61 P b7ab4784c7344b939bc36f639286f377 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:20:58.404596 12801 leader_election.cc:290] T de3186201e1a40d0b335eeb8b4e256e0 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:20:58.440009  6729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7887766dc6784fcaa42b35c05fea7a99" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
W20260709 13:20:58.439961  6770 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 126958us
I20260709 13:20:58.430372  6798 raft_consensus.cc:2468] T 9b3759de40694069b13c0f8bd40e5709 P b7ab4784c7344b939bc36f639286f377 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 14.
I20260709 13:20:58.450086  6731 raft_consensus.cc:1240] T 7a734b5ab7834e05a8c422208acc58b1 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 18 FOLLOWER]: Rejecting Update request from peer b7ab4784c7344b939bc36f639286f377 for earlier term 17. Current term is 18. Ops: []
I20260709 13:20:58.451519  6877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e31b9971c15848dea59d4d4130141d9e" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:20:58.438201 12766 leader_election.cc:290] T b3f13b31a1f84f0d89d007eadd57924c P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
W20260709 13:20:58.473369 12823 log.cc:927] Time spent T 95a75bfe094d4bdc963aba3f08dfcd25 P b7ab4784c7344b939bc36f639286f377: Append to log took a long time: real 0.085s	user 0.000s	sys 0.000s
I20260709 13:20:58.475338  6801 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:32966 (request call id 1452) took 1473 ms. Trace:
I20260709 13:20:58.475865  6801 rpcz_store.cc:276] 0709 13:20:57.002393 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:57.004320 (+  1927us) service_pool.cc:224] Handling call
0709 13:20:57.063173 (+ 58853us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:57.236631 (+173458us) spinlock_profiling.cc:243] Waited 25.6 ms on lock 0x7b4800061ed8. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc148d3aa1 00007fcc148cab37 00007fcc148ca9ca 00007fcc149c226f 00007fcc149c1f37 00007fcc149d655c 00007fcc149d6508 00007fcc149d6488 00007fcc149d6443 00007fcc149d56ec 00007fcc138ffa96
0709 13:20:57.693042 (+456411us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:57.693106 (+    64us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:20:57.693962 (+   856us) log.cc:844] Serialized 26 byte log entry
0709 13:20:57.872131 (+178169us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:20:57.872198 (+    67us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:57.883145 (+ 10947us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:58.474891 (+591746us) raft_consensus.cc:1685] finished
0709 13:20:58.474921 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:58.475261 (+   340us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4166,"raft.queue_time_us":123368,"raft.run_cpu_time_us":959,"raft.run_wall_time_us":48329,"spinlock_wait_cycles":58785536,"thread_start_us":802600,"threads_started":2,"wal-append.queue_time_us":573444}
I20260709 13:20:58.478732 12662 leader_election.cc:290] T 20f6842e26174571996b8dea4151d4be P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:20:58.481487  6801 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "90d42e216d9741e190bca19a781291fd"
dest_uuid: "b7ab4784c7344b939bc36f639286f377"
mode: GRACEFUL
new_leader_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
 from {username='slave'} at 127.0.0.1:38240
I20260709 13:20:58.482403  6801 raft_consensus.cc:606] T 90d42e216d9741e190bca19a781291fd P b7ab4784c7344b939bc36f639286f377 [term 18 FOLLOWER]: Received request to transfer leadership to TS cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:20:58.483067  6801 raft_consensus.cc:614] T 90d42e216d9741e190bca19a781291fd P b7ab4784c7344b939bc36f639286f377 [term 18 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 13:20:58.486625  6872 consensus_meta.cc:287] T 3a485a995abc4807b6e511e45419f737 P cd75a17ab2604397adab03bb8b5fd75c: Time spent flushing consensus metadata: real 0.521s	user 0.009s	sys 0.001s
I20260709 13:20:58.487272  6872 raft_consensus.cc:2468] T 3a485a995abc4807b6e511e45419f737 P cd75a17ab2604397adab03bb8b5fd75c [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 17.
I20260709 13:20:58.489051  6872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77e330a82df4b43a745d57a68f6f057" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:58.494123 12555 consensus_queue.cc:237] T c4db81d9d329422bb3b4160ca4ac2d1d P b7ab4784c7344b939bc36f639286f377 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:58.495586  6872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbdf895bba214ff68685a24fd17dfb5d" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 16 candidate_status { last_received { term: 14 index: 6 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:20:58.497076  6872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c7f33e544204fbaac4078e3e83bbf4e" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:58.498354  6872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e326172347f45e99a0d482b5d8ef768" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:58.499534  6872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a75bfe094d4bdc963aba3f08dfcd25" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:20:58.493170  6798 raft_consensus.cc:1275] T 44bde925b2e541b69890d70715b85176 P b7ab4784c7344b939bc36f639286f377 [term 17 FOLLOWER]: Refusing update from remote peer ccd8a4c3bfe3413cb2ae219b09aea832: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:20:58.493865  6801 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a1704639a875409b9959353527b3fd68"
dest_uuid: "b7ab4784c7344b939bc36f639286f377"
mode: GRACEFUL
new_leader_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
 from {username='slave'} at 127.0.0.1:38240
I20260709 13:20:58.501571  6801 raft_consensus.cc:606] T a1704639a875409b9959353527b3fd68 P b7ab4784c7344b939bc36f639286f377 [term 17 LEADER]: Received request to transfer leadership to TS cd75a17ab2604397adab03bb8b5fd75c
W20260709 13:20:58.503296  6696 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:58.503724 12802 consensus_queue.cc:237] T 404190ce4ce94cecbfcb6ea9d1dd8626 P 7ba59cc884714e8aa5f3f0ecaed84cbb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:20:58.505012  6874 raft_consensus.cc:1275] T 7887766dc6784fcaa42b35c05fea7a99 P cd75a17ab2604397adab03bb8b5fd75c [term 18 FOLLOWER]: Refusing update from remote peer ccd8a4c3bfe3413cb2ae219b09aea832: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
I20260709 13:20:58.506268  6874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4db81d9d329422bb3b4160ca4ac2d1d" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:20:58.507200  6874 raft_consensus.cc:2368] T c4db81d9d329422bb3b4160ca4ac2d1d P cd75a17ab2604397adab03bb8b5fd75c [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 16. Current term is 17.
W20260709 13:20:58.507498  6772 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 50203.7us
I20260709 13:20:58.508844  6801 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c4db81d9d329422bb3b4160ca4ac2d1d"
dest_uuid: "b7ab4784c7344b939bc36f639286f377"
mode: GRACEFUL
new_leader_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
 from {username='slave'} at 127.0.0.1:38240
I20260709 13:20:58.512219 12668 leader_election.cc:290] T 3fa34c08b205435dba97346991aa1f92 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:20:58.514096  6874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24ee15416e3145beaa1b8183453729a3" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:58.534040  6877 raft_consensus.cc:2393] T e31b9971c15848dea59d4d4130141d9e P cd75a17ab2604397adab03bb8b5fd75c [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate ccd8a4c3bfe3413cb2ae219b09aea832 in current term 14: Already voted for candidate cd75a17ab2604397adab03bb8b5fd75c in this term.
I20260709 13:20:58.540490  6729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a485a995abc4807b6e511e45419f737" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:58.549885  6770 leader_election.cc:304] T f5be3a11b23d4ea9b08300a2789821c7 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
I20260709 13:20:58.552421  6729 raft_consensus.cc:2393] T 3a485a995abc4807b6e511e45419f737 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c in current term 17: Already voted for candidate b7ab4784c7344b939bc36f639286f377 in this term.
I20260709 13:20:58.555104  6730 raft_consensus.cc:2468] T 1528ab62b6fe4e3099d08f141afee116 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in term 14.
I20260709 13:20:58.562398  6728 raft_consensus.cc:2468] T 404190ce4ce94cecbfcb6ea9d1dd8626 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in term 15.
W20260709 13:20:58.578857  7466 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 479530us
I20260709 13:20:58.578955  6726 raft_consensus.cc:1240] T f03d0dbf16864ca4bc1bb5e4c0334c0f P ccd8a4c3bfe3413cb2ae219b09aea832 [term 18 FOLLOWER]: Rejecting Update request from peer b7ab4784c7344b939bc36f639286f377 for earlier term 17. Current term is 18. Ops: [17.9-17.9]
W20260709 13:20:58.558985 12663 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.533s	user 0.018s	sys 0.020s
I20260709 13:20:58.586403  6872 raft_consensus.cc:1275] T 44bde925b2e541b69890d70715b85176 P cd75a17ab2604397adab03bb8b5fd75c [term 17 FOLLOWER]: Refusing update from remote peer ccd8a4c3bfe3413cb2ae219b09aea832: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:20:58.591543 12594 consensus_queue.cc:1048] T b56bf91d90824c959e21e0cee5ba1816 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
W20260709 13:20:58.592199  6845 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.514s	user 0.011s	sys 0.043s
W20260709 13:20:58.631268  6845 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.576s	user 0.011s	sys 0.043s
I20260709 13:20:58.593904  6877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fa34c08b205435dba97346991aa1f92" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 21 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:58.594462 12625 leader_election.cc:290] T f03d0dbf16864ca4bc1bb5e4c0334c0f P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 18 election: Requested vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:58.597972  7496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8cee0accdb8499c86d4414b72565a38" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 19 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:20:58.598804 12543 raft_consensus.cc:515] T 7c37d41cd9164c15a6826ca62a851a69 P cd75a17ab2604397adab03bb8b5fd75c [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:58.599259 12566 consensus_queue.cc:260] T 17587d6730594da4a56fa13a353232a1 P b7ab4784c7344b939bc36f639286f377 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 21.15, Last appended by leader: 15, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:20:58.605464  7498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b8cacb381b746da8d0049b0a83b41dd" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:20:58.606110 12739 consensus_queue.cc:1059] T ab432e62819d499eaaf3dd55481dd930 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: INVALID_TERM, Last received: 17.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:20:58.608513 12478 raft_consensus.cc:2804] T f5be3a11b23d4ea9b08300a2789821c7 P b7ab4784c7344b939bc36f639286f377 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:20:58.610020 12704 leader_election.cc:290] T 7a734b5ab7834e05a8c422208acc58b1 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 18 election: Requested vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:58.612190 12787 consensus_queue.cc:1048] T f03d0dbf16864ca4bc1bb5e4c0334c0f P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:20:58.613119 12785 consensus_queue.cc:1048] T 7887766dc6784fcaa42b35c05fea7a99 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:20:58.640578 12478 raft_consensus.cc:697] T f5be3a11b23d4ea9b08300a2789821c7 P b7ab4784c7344b939bc36f639286f377 [term 16 LEADER]: Becoming Leader. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
I20260709 13:20:58.641728 12478 consensus_queue.cc:237] T f5be3a11b23d4ea9b08300a2789821c7 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:58.642951  6730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3f13b31a1f84f0d89d007eadd57924c" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:58.645030 12566 raft_consensus.cc:3060] T 17587d6730594da4a56fa13a353232a1 P b7ab4784c7344b939bc36f639286f377 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:20:58.648587  7498 raft_consensus.cc:2393] T 4b8cacb381b746da8d0049b0a83b41dd P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c in current term 18: Already voted for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in this term.
I20260709 13:20:58.654062 12631 raft_consensus.cc:515] T f4b8bd455d5a47c18a1380839c6e0d61 P b7ab4784c7344b939bc36f639286f377 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:58.619666  6697 leader_election.cc:400] T c4db81d9d329422bb3b4160ca4ac2d1d P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 16 election: Vote denied by peer cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931) with higher term. Message: Invalid argument: T c4db81d9d329422bb3b4160ca4ac2d1d P cd75a17ab2604397adab03bb8b5fd75c [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 16. Current term is 17.
I20260709 13:20:58.624315  6879 raft_consensus.cc:2468] T 4b8cacb381b746da8d0049b0a83b41dd P cd75a17ab2604397adab03bb8b5fd75c [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 18.
I20260709 13:20:58.625394  6800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "427c124d773f483294511e80fe340075" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:20:58.667217  6697 leader_election.cc:403] T c4db81d9d329422bb3b4160ca4ac2d1d P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 16 election: Cancelling election due to peer responding with higher term
W20260709 13:20:58.631786 12663 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.615s	user 0.018s	sys 0.021s
I20260709 13:20:58.661836 12657 raft_consensus.cc:993] T a1704639a875409b9959353527b3fd68 P b7ab4784c7344b939bc36f639286f377: : Instructing follower cd75a17ab2604397adab03bb8b5fd75c to start an election
I20260709 13:20:58.662379 12739 raft_consensus.cc:3055] T ab432e62819d499eaaf3dd55481dd930 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:20:58.622843  6726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "427c124d773f483294511e80fe340075" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:20:58.672379  6873 raft_consensus.cc:1240] T 7c37d41cd9164c15a6826ca62a851a69 P cd75a17ab2604397adab03bb8b5fd75c [term 17 FOLLOWER]: Rejecting Update request from peer ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 16. Current term is 17. Ops: []
W20260709 13:20:58.666306  6723 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.585s	user 0.047s	sys 0.070s
I20260709 13:20:58.667151  6800 raft_consensus.cc:3060] T 427c124d773f483294511e80fe340075 P b7ab4784c7344b939bc36f639286f377 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:58.582832 12668 raft_consensus.cc:493] T 07a92dd554674067a83a9cb68c4773f2 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:20:58.670567  6696 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:58.670751  6878 raft_consensus.cc:2468] T a3022224cc81473690653a83d4e99470 P cd75a17ab2604397adab03bb8b5fd75c [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 19.
W20260709 13:20:58.676120  6723 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.595s	user 0.047s	sys 0.070s
I20260709 13:20:58.677354  6726 raft_consensus.cc:3060] T 427c124d773f483294511e80fe340075 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:58.677654  6805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3f13b31a1f84f0d89d007eadd57924c" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:58.677300  6728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fa34c08b205435dba97346991aa1f92" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:58.679095  6728 raft_consensus.cc:2468] T 3fa34c08b205435dba97346991aa1f92 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in term 20.
W20260709 13:20:58.674770  6725 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.576s	user 0.000s	sys 0.017s
W20260709 13:20:58.680792  6725 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.582s	user 0.000s	sys 0.017s
W20260709 13:20:58.680492  6844 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.668s	user 0.010s	sys 0.041s
W20260709 13:20:58.691191  6844 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.679s	user 0.010s	sys 0.042s
W20260709 13:20:58.691957  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 772466us
I20260709 13:20:58.700644  7466 leader_election.cc:304] T 17587d6730594da4a56fa13a353232a1 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
W20260709 13:20:58.701659  6881 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.586s	user 0.005s	sys 0.013s
W20260709 13:20:58.702785  6881 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.590s	user 0.005s	sys 0.013s
I20260709 13:20:58.674964 12739 raft_consensus.cc:740] T ab432e62819d499eaaf3dd55481dd930 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
I20260709 13:20:58.680315 12730 raft_consensus.cc:1081] T a1704639a875409b9959353527b3fd68 P b7ab4784c7344b939bc36f639286f377 [term 17 LEADER]: Signalling peer cd75a17ab2604397adab03bb8b5fd75c to start an election
W20260709 13:20:58.737684  6697 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 118290us
W20260709 13:20:58.748610  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 55744.7us
I20260709 13:20:58.765173  6697 leader_election.cc:304] T 24ee15416e3145beaa1b8183453729a3 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:20:58.741698 12714 raft_consensus.cc:493] T 44bde925b2e541b69890d70715b85176 P b7ab4784c7344b939bc36f639286f377 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:58.781975  6844 leader_election.cc:304] T bb7fa124c3bf4ef9ab65a407cb008441 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb
I20260709 13:20:58.746649 12594 raft_consensus.cc:2749] T c4db81d9d329422bb3b4160ca4ac2d1d P ccd8a4c3bfe3413cb2ae219b09aea832 [term 17 FOLLOWER]: Leader election lost for term 16. Reason: Vote denied by peer cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931) with higher term. Message: Invalid argument: T c4db81d9d329422bb3b4160ca4ac2d1d P cd75a17ab2604397adab03bb8b5fd75c [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 16. Current term is 17.
I20260709 13:20:58.694556 12668 raft_consensus.cc:515] T 07a92dd554674067a83a9cb68c4773f2 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:58.759745 12662 raft_consensus.cc:493] T 7ba5dac66ab5497e9e336f2a3c28cda5 P cd75a17ab2604397adab03bb8b5fd75c [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 7ba59cc884714e8aa5f3f0ecaed84cbb)
W20260709 13:20:58.791541 12527 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.814s	user 0.031s	sys 0.100s
I20260709 13:20:58.784682 12704 raft_consensus.cc:2749] T 24ee15416e3145beaa1b8183453729a3 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:20:58.764473 12673 raft_consensus.cc:2749] T 17587d6730594da4a56fa13a353232a1 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
W20260709 13:20:58.832998  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 52167.4us
I20260709 13:20:58.833320  6729 raft_consensus.cc:1275] T 07a92dd554674067a83a9cb68c4773f2 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 15 FOLLOWER]: Refusing update from remote peer b7ab4784c7344b939bc36f639286f377: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
W20260709 13:20:58.834204  6695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 436546us
I20260709 13:20:58.843842  6844 leader_election.cc:304] T 711ef6523deb4cbe8ef2ba61e1c21c98 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
W20260709 13:20:58.832944  7466 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 132534us
I20260709 13:20:58.800493 12714 raft_consensus.cc:515] T 44bde925b2e541b69890d70715b85176 P b7ab4784c7344b939bc36f639286f377 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
W20260709 13:20:58.827418 12527 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.851s	user 0.032s	sys 0.101s
W20260709 13:20:58.895335  6772 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 337735us
W20260709 13:20:58.923947  7466 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 68627.9us
I20260709 13:20:58.925134  7466 leader_election.cc:304] T be1a92657f494cac8dd227d152f50151 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: b7ab4784c7344b939bc36f639286f377
W20260709 13:20:58.824800 12767 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.597s	user 0.010s	sys 0.019s
I20260709 13:20:58.837648 12662 raft_consensus.cc:515] T 7ba5dac66ab5497e9e336f2a3c28cda5 P cd75a17ab2604397adab03bb8b5fd75c [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:20:58.896580 12543 leader_election.cc:290] T 7c37d41cd9164c15a6826ca62a851a69 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 17 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:20:58.933548  6772 leader_election.cc:304] T bb7fa124c3bf4ef9ab65a407cb008441 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb
I20260709 13:20:58.936657  6726 raft_consensus.cc:2468] T 427c124d773f483294511e80fe340075 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in term 16.
I20260709 13:20:58.839726 12739 consensus_queue.cc:260] T ab432e62819d499eaaf3dd55481dd930 P ccd8a4c3bfe3413cb2ae219b09aea832 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 18.10, Last appended by leader: 10, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:58.926761  7466 leader_election.cc:304] T fe20b4b48823486ca3b9c648db6ce8aa P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
I20260709 13:20:58.899884 12631 leader_election.cc:290] T f4b8bd455d5a47c18a1380839c6e0d61 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 18 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
W20260709 13:20:58.945523 12767 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.710s	user 0.011s	sys 0.021s
I20260709 13:20:58.954720  7466 leader_election.cc:304] T bb3d8792045a4583ae2e965b1350a5b4 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
W20260709 13:20:58.955049  6696 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:58.956414  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 112745us
I20260709 13:20:58.935570 12673 raft_consensus.cc:2804] T be1a92657f494cac8dd227d152f50151 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 18 FOLLOWER]: Leader pre-election won for term 19
W20260709 13:20:58.959843  6770 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 438789us
I20260709 13:20:58.961445 12834 raft_consensus.cc:2804] T bb7fa124c3bf4ef9ab65a407cb008441 P cd75a17ab2604397adab03bb8b5fd75c [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:20:58.959646 12673 raft_consensus.cc:493] T be1a92657f494cac8dd227d152f50151 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:58.988171  6770 leader_election.cc:304] T 4d9def8b32fd443aa94ab1420b06837b P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
I20260709 13:20:58.964744 12835 raft_consensus.cc:2804] T bb3d8792045a4583ae2e965b1350a5b4 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:20:58.961841 12802 raft_consensus.cc:2804] T fe20b4b48823486ca3b9c648db6ce8aa P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:20:58.978052 12834 raft_consensus.cc:493] T bb7fa124c3bf4ef9ab65a407cb008441 P cd75a17ab2604397adab03bb8b5fd75c [term 16 FOLLOWER]: Starting leader election (detected failure of leader 7ba59cc884714e8aa5f3f0ecaed84cbb)
I20260709 13:20:58.979852 12543 raft_consensus.cc:493] T 22ccee1b570c4ad3a57bd7aec085b1b4 P cd75a17ab2604397adab03bb8b5fd75c [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:20:58.980562 12698 raft_consensus.cc:2804] T bb7fa124c3bf4ef9ab65a407cb008441 P b7ab4784c7344b939bc36f639286f377 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:20:59.004163  6770 leader_election.cc:304] T 3a485a995abc4807b6e511e45419f737 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
W20260709 13:20:59.001670  6772 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 68226.1us
I20260709 13:20:58.984525 12673 raft_consensus.cc:3060] T be1a92657f494cac8dd227d152f50151 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:20:59.015003  7466 leader_election.cc:304] T 3fa34c08b205435dba97346991aa1f92 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
W20260709 13:20:59.020153  6846 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.68:45071, user_credentials={real_user=slave}} blocked reactor thread for 283654us
I20260709 13:20:58.995131 12835 raft_consensus.cc:493] T bb3d8792045a4583ae2e965b1350a5b4 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 15 FOLLOWER]: Starting leader election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:20:59.030507  6770 leader_election.cc:304] T 90d42e216d9741e190bca19a781291fd P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
W20260709 13:20:59.016444 12841 log.cc:927] Time spent T 7a734b5ab7834e05a8c422208acc58b1 P cd75a17ab2604397adab03bb8b5fd75c: Append to log took a long time: real 0.059s	user 0.001s	sys 0.001s
I20260709 13:20:59.035163  7496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fa34c08b205435dba97346991aa1f92" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 21 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:20:59.003396 12834 raft_consensus.cc:3060] T bb7fa124c3bf4ef9ab65a407cb008441 P cd75a17ab2604397adab03bb8b5fd75c [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:59.015372 12739 raft_consensus.cc:3060] T ab432e62819d499eaaf3dd55481dd930 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:20:59.055755  6730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3411566abe2d4c9bb4b2adfdd05e6f17" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:20:59.048938  6772 leader_election.cc:304] T 4275cf08e63345f993bce8664eada830 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:20:58.991979 12685 consensus_queue.cc:1048] T be1a92657f494cac8dd227d152f50151 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.039s
I20260709 13:20:59.013644 12698 raft_consensus.cc:493] T bb7fa124c3bf4ef9ab65a407cb008441 P b7ab4784c7344b939bc36f639286f377 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 7ba59cc884714e8aa5f3f0ecaed84cbb)
I20260709 13:20:59.037925 12802 raft_consensus.cc:697] T fe20b4b48823486ca3b9c648db6ce8aa P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 14 LEADER]: Becoming Leader. State: Replica: 7ba59cc884714e8aa5f3f0ecaed84cbb, State: Running, Role: LEADER
I20260709 13:20:59.036914 12668 leader_election.cc:290] T 07a92dd554674067a83a9cb68c4773f2 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:59.075610  6728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6869f07b5a4885a0b99fbe60c3b175" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 19 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:59.035099 12810 raft_consensus.cc:2804] T 3a485a995abc4807b6e511e45419f737 P b7ab4784c7344b939bc36f639286f377 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:20:59.069751  6731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab432e62819d499eaaf3dd55481dd930" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:20:59.013389 12631 consensus_queue.cc:1059] T d33d5ee8ef6f415593d8df52063161ad P b7ab4784c7344b939bc36f639286f377 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: INVALID_TERM, Last received: 14.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.040s
I20260709 13:20:59.084476 12631 raft_consensus.cc:3055] T d33d5ee8ef6f415593d8df52063161ad P b7ab4784c7344b939bc36f639286f377 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:20:59.084905 12631 raft_consensus.cc:740] T d33d5ee8ef6f415593d8df52063161ad P b7ab4784c7344b939bc36f639286f377 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
I20260709 13:20:59.085935 12631 consensus_queue.cc:260] T d33d5ee8ef6f415593d8df52063161ad P b7ab4784c7344b939bc36f639286f377 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:59.018141 12543 raft_consensus.cc:515] T 22ccee1b570c4ad3a57bd7aec085b1b4 P cd75a17ab2604397adab03bb8b5fd75c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:59.090246 12543 leader_election.cc:290] T 22ccee1b570c4ad3a57bd7aec085b1b4 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:20:59.038306 12835 raft_consensus.cc:3060] T bb3d8792045a4583ae2e965b1350a5b4 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:59.082039  6724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d33d5ee8ef6f415593d8df52063161ad" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:59.097208  6724 raft_consensus.cc:2393] T d33d5ee8ef6f415593d8df52063161ad P ccd8a4c3bfe3413cb2ae219b09aea832 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c in current term 15: Already voted for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in this term.
I20260709 13:20:59.035290 12790 raft_consensus.cc:2749] T 711ef6523deb4cbe8ef2ba61e1c21c98 P cd75a17ab2604397adab03bb8b5fd75c [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:20:59.101562  6726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f58dc08b12a2494bb9a1372837970ca2" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
W20260709 13:20:59.103395  6695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 180799us
I20260709 13:20:59.068413 12698 raft_consensus.cc:3060] T bb7fa124c3bf4ef9ab65a407cb008441 P b7ab4784c7344b939bc36f639286f377 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:59.114881  6726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de3186201e1a40d0b335eeb8b4e256e0" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:59.087783 12631 raft_consensus.cc:3060] T d33d5ee8ef6f415593d8df52063161ad P b7ab4784c7344b939bc36f639286f377 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:59.111205  6730 raft_consensus.cc:2393] T 3411566abe2d4c9bb4b2adfdd05e6f17 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c in current term 15: Already voted for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in this term.
I20260709 13:20:59.105234 12811 raft_consensus.cc:2804] T 90d42e216d9741e190bca19a781291fd P b7ab4784c7344b939bc36f639286f377 [term 18 FOLLOWER]: Leader election won for term 18
W20260709 13:20:59.104348 12829 log.cc:927] Time spent T 17587d6730594da4a56fa13a353232a1 P ccd8a4c3bfe3413cb2ae219b09aea832: Append to log took a long time: real 0.163s	user 0.000s	sys 0.001s
I20260709 13:20:59.118531  6732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b8cacb381b746da8d0049b0a83b41dd" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:59.118971  6725 raft_consensus.cc:1240] T fe20b4b48823486ca3b9c648db6ce8aa P ccd8a4c3bfe3413cb2ae219b09aea832 [term 14 FOLLOWER]: Rejecting Update request from peer cd75a17ab2604397adab03bb8b5fd75c for earlier term 13. Current term is 14. Ops: []
I20260709 13:20:59.063539 12714 leader_election.cc:290] T 44bde925b2e541b69890d70715b85176 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:59.070333 12663 raft_consensus.cc:493] T 713b5728a197487c9300b310ab94e5a3 P cd75a17ab2604397adab03bb8b5fd75c [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:20:59.118389  6728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d9def8b32fd443aa94ab1420b06837b" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:59.135571  6728 raft_consensus.cc:2468] T 4d9def8b32fd443aa94ab1420b06837b P ccd8a4c3bfe3413cb2ae219b09aea832 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 16.
I20260709 13:20:59.127449  6730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20f6842e26174571996b8dea4151d4be" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
W20260709 13:20:59.135771  7466 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 101959us
I20260709 13:20:59.100184 12478 raft_consensus.cc:2749] T 4275cf08e63345f993bce8664eada830 P b7ab4784c7344b939bc36f639286f377 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:20:59.154182  6874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a92dd554674067a83a9cb68c4773f2" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:59.155215  6874 raft_consensus.cc:2468] T 07a92dd554674067a83a9cb68c4773f2 P cd75a17ab2604397adab03bb8b5fd75c [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 15.
I20260709 13:20:59.111577 12810 raft_consensus.cc:697] T 3a485a995abc4807b6e511e45419f737 P b7ab4784c7344b939bc36f639286f377 [term 17 LEADER]: Becoming Leader. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
I20260709 13:20:59.158222  6726 raft_consensus.cc:1240] T 90d42e216d9741e190bca19a781291fd P ccd8a4c3bfe3413cb2ae219b09aea832 [term 18 FOLLOWER]: Rejecting Update request from peer cd75a17ab2604397adab03bb8b5fd75c for earlier term 17. Current term is 18. Ops: []
I20260709 13:20:59.159722  6878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a734b5ab7834e05a8c422208acc58b1" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 18 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
W20260709 13:20:59.147850 12838 log.cc:927] Time spent T 7c37d41cd9164c15a6826ca62a851a69 P b7ab4784c7344b939bc36f639286f377: Append to log took a long time: real 0.264s	user 0.000s	sys 0.001s
I20260709 13:20:59.163106  6873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f03d0dbf16864ca4bc1bb5e4c0334c0f" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 18 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:20:59.124945 12527 raft_consensus.cc:493] T f4b8bd455d5a47c18a1380839c6e0d61 P cd75a17ab2604397adab03bb8b5fd75c [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:20:59.156452 12830 log.cc:927] Time spent T 7887766dc6784fcaa42b35c05fea7a99 P b7ab4784c7344b939bc36f639286f377: Append to log took a long time: real 0.201s	user 0.000s	sys 0.001s
I20260709 13:20:59.172434  6873 raft_consensus.cc:3060] T f03d0dbf16864ca4bc1bb5e4c0334c0f P cd75a17ab2604397adab03bb8b5fd75c [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:20:59.150352 12811 raft_consensus.cc:697] T 90d42e216d9741e190bca19a781291fd P b7ab4784c7344b939bc36f639286f377 [term 18 LEADER]: Becoming Leader. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
I20260709 13:20:59.181038  6726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c37d41cd9164c15a6826ca62a851a69" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
W20260709 13:20:59.189215  6772 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 140381us
W20260709 13:20:59.192274  6696 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:59.193465  7498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ba5dac66ab5497e9e336f2a3c28cda5" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:20:59.192119  6772 leader_election.cc:304] T 711ef6523deb4cbe8ef2ba61e1c21c98 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:20:59.156416 12663 raft_consensus.cc:515] T 713b5728a197487c9300b310ab94e5a3 P cd75a17ab2604397adab03bb8b5fd75c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
W20260709 13:20:59.196905  6697 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 118377us
I20260709 13:20:59.186256 12849 raft_consensus.cc:2804] T 4d9def8b32fd443aa94ab1420b06837b P b7ab4784c7344b939bc36f639286f377 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:20:59.170187 12863 consensus_queue.cc:1048] T 44bde925b2e541b69890d70715b85176 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.038s
W20260709 13:20:59.201285  6770 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 170903us
I20260709 13:20:59.212497  6727 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50004 (request call id 2760) took 1331 ms. Trace:
I20260709 13:20:59.212955  6727 rpcz_store.cc:276] 0709 13:20:57.881129 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:57.891146 (+ 10017us) service_pool.cc:224] Handling call
0709 13:20:57.894791 (+  3645us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:57.905912 (+ 11121us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:57.905986 (+    74us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:20:57.906664 (+   678us) log.cc:844] Serialized 26 byte log entry
0709 13:20:58.396698 (+490034us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:20:58.396749 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:58.397307 (+   558us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:59.212280 (+814973us) raft_consensus.cc:1685] finished
0709 13:20:59.212302 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:59.212435 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":5485,"raft.run_cpu_time_us":159,"raft.run_wall_time_us":162,"thread_start_us":486041,"threads_started":1,"wal-append.queue_time_us":842912}
I20260709 13:20:59.182301 12527 raft_consensus.cc:515] T f4b8bd455d5a47c18a1380839c6e0d61 P cd75a17ab2604397adab03bb8b5fd75c [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:59.200062 12785 raft_consensus.cc:493] T 853ac0a8cbd64ce99457f170216d4d0f P ccd8a4c3bfe3413cb2ae219b09aea832 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
W20260709 13:20:59.221196  7466 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 83760.8us
I20260709 13:20:59.226881  6799 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:32976 (request call id 3524) took 1237 ms. Trace:
I20260709 13:20:59.218703  6770 leader_election.cc:304] T 34f36d59d88f40fe8a2805e604fc6c0a P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
I20260709 13:20:59.231518  6729 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50004 (request call id 2776) took 1138 ms. Trace:
I20260709 13:20:59.232128  6729 rpcz_store.cc:276] 0709 13:20:58.093391 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:58.557975 (+464584us) service_pool.cc:224] Handling call
0709 13:20:58.581791 (+ 23816us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:58.841000 (+259209us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:59.231210 (+390210us) spinlock_profiling.cc:243] Waited 239 ms on lock 0x7b5400057154. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f9aae01 00007fcc0f9a983e 00007fcc1496e419 00007fcc0dee5bd4 00007fcc0dee5b62 00007fcc0dee5a91 00007fcc0dee5a0c 00007fcc0dee4cc2 00007fcc0dce548c 00007fcc0dce48c6
0709 13:20:59.231447 (+   237us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":550281088}
I20260709 13:20:59.234727 12561 raft_consensus.cc:3055] T 34f36d59d88f40fe8a2805e604fc6c0a P cd75a17ab2604397adab03bb8b5fd75c [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:20:59.235149 12561 raft_consensus.cc:740] T 34f36d59d88f40fe8a2805e604fc6c0a P cd75a17ab2604397adab03bb8b5fd75c [term 15 LEADER]: Becoming Follower/Learner. State: Replica: cd75a17ab2604397adab03bb8b5fd75c, State: Running, Role: LEADER
I20260709 13:20:59.236145  6874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f00a2e87e56452083b759f60d461ee3" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:59.237032  6874 raft_consensus.cc:2410] T 4f00a2e87e56452083b759f60d461ee3 P cd75a17ab2604397adab03bb8b5fd75c [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ba59cc884714e8aa5f3f0ecaed84cbb for term 19 because replica has last-logged OpId of term: 18 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 12.
I20260709 13:20:59.238293  6874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3d8792045a4583ae2e965b1350a5b4" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:59.239049  6874 raft_consensus.cc:2393] T bb3d8792045a4583ae2e965b1350a5b4 P cd75a17ab2604397adab03bb8b5fd75c [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in current term 16: Already voted for candidate cd75a17ab2604397adab03bb8b5fd75c in this term.
W20260709 13:20:59.240257 12847 log.cc:927] Time spent T 4b8cacb381b746da8d0049b0a83b41dd P ccd8a4c3bfe3413cb2ae219b09aea832: Append to log took a long time: real 0.084s	user 0.000s	sys 0.001s
I20260709 13:20:59.241578 12810 consensus_queue.cc:237] T 3a485a995abc4807b6e511e45419f737 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
W20260709 13:20:59.244854 12864 log.cc:927] Time spent T d8cee0accdb8499c86d4414b72565a38 P 7ba59cc884714e8aa5f3f0ecaed84cbb: Append to log took a long time: real 0.061s	user 0.001s	sys 0.000s
I20260709 13:20:59.245806 12527 leader_election.cc:290] T f4b8bd455d5a47c18a1380839c6e0d61 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:20:59.246985 12785 raft_consensus.cc:515] T 853ac0a8cbd64ce99457f170216d4d0f P ccd8a4c3bfe3413cb2ae219b09aea832 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:59.249533 12785 leader_election.cc:290] T 853ac0a8cbd64ce99457f170216d4d0f P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
W20260709 13:20:59.227164  7468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 64156.9us
W20260709 13:20:59.251312  6800 consensus_meta.cc:287] T 427c124d773f483294511e80fe340075 P b7ab4784c7344b939bc36f639286f377: Time spent flushing consensus metadata: real 0.565s	user 0.013s	sys 0.000s
I20260709 13:20:59.251958  6800 raft_consensus.cc:2468] T 427c124d773f483294511e80fe340075 P b7ab4784c7344b939bc36f639286f377 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in term 16.
I20260709 13:20:59.227402  6799 rpcz_store.cc:276] 0709 13:20:58.000408 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:58.000646 (+   238us) service_pool.cc:224] Handling call
0709 13:20:58.020935 (+ 20289us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:58.038805 (+ 17870us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:58.038854 (+    49us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:20:58.060264 (+ 21410us) log.cc:844] Serialized 26 byte log entry
0709 13:20:58.584116 (+523852us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:20:58.584167 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:58.584257 (+    90us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:59.226611 (+642354us) raft_consensus.cc:1685] finished
0709 13:20:59.226636 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:59.226797 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":207,"raft.queue_time_us":13436,"raft.run_cpu_time_us":211,"raft.run_wall_time_us":18915,"thread_start_us":483587,"threads_started":1,"wal-append.queue_time_us":725840}
I20260709 13:20:59.223585  6697 leader_election.cc:304] T a3022224cc81473690653a83d4e99470 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:20:59.251770  6804 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:32976 (request call id 3518) took 1325 ms. Trace:
I20260709 13:20:59.257360  6804 rpcz_store.cc:276] 0709 13:20:57.926368 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:57.926517 (+   149us) service_pool.cc:224] Handling call
0709 13:20:57.926828 (+   311us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:57.927255 (+   427us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:57.927288 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:20:57.927861 (+   573us) log.cc:844] Serialized 26 byte log entry
0709 13:20:58.396348 (+468487us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:20:58.396403 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:58.396503 (+   100us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:59.251517 (+855014us) raft_consensus.cc:1685] finished
0709 13:20:59.251540 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:59.251707 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":6855,"raft.run_cpu_time_us":140,"raft.run_wall_time_us":141,"thread_start_us":467409,"threads_started":1,"wal-append.queue_time_us":770802}
I20260709 13:20:59.225343  7466 leader_election.cc:304] T b3f13b31a1f84f0d89d007eadd57924c P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:20:59.211724 12849 raft_consensus.cc:493] T 4d9def8b32fd443aa94ab1420b06837b P b7ab4784c7344b939bc36f639286f377 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:20:59.223548 12843 log.cc:927] Time spent T 1528ab62b6fe4e3099d08f141afee116 P 7ba59cc884714e8aa5f3f0ecaed84cbb: Append to log took a long time: real 0.209s	user 0.001s	sys 0.000s
I20260709 13:20:59.265374  6874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe20b4b48823486ca3b9c648db6ce8aa" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
W20260709 13:20:59.263432  6770 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 46831.6us
I20260709 13:20:59.268113  6873 raft_consensus.cc:2468] T f03d0dbf16864ca4bc1bb5e4c0334c0f P cd75a17ab2604397adab03bb8b5fd75c [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 18.
I20260709 13:20:59.268998  6770 leader_election.cc:304] T e31b9971c15848dea59d4d4130141d9e P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
I20260709 13:20:59.196590 12865 consensus_queue.cc:1048] T d8cee0accdb8499c86d4414b72565a38 P 7ba59cc884714e8aa5f3f0ecaed84cbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.037s
I20260709 13:20:59.189378 12802 consensus_queue.cc:237] T fe20b4b48823486ca3b9c648db6ce8aa P 7ba59cc884714e8aa5f3f0ecaed84cbb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:20:59.250996 12871 raft_consensus.cc:2749] T 711ef6523deb4cbe8ef2ba61e1c21c98 P b7ab4784c7344b939bc36f639286f377 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:20:59.271800 12730 raft_consensus.cc:2804] T 34f36d59d88f40fe8a2805e604fc6c0a P b7ab4784c7344b939bc36f639286f377 [term 16 FOLLOWER]: Leader election won for term 16
W20260709 13:20:59.283411  6772 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 56523.2us
I20260709 13:20:59.298998  6799 raft_consensus.cc:1275] T 404190ce4ce94cecbfcb6ea9d1dd8626 P b7ab4784c7344b939bc36f639286f377 [term 15 FOLLOWER]: Refusing update from remote peer 7ba59cc884714e8aa5f3f0ecaed84cbb: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:20:59.300621  6872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "427c124d773f483294511e80fe340075" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:20:59.301236  6872 raft_consensus.cc:3060] T 427c124d773f483294511e80fe340075 P cd75a17ab2604397adab03bb8b5fd75c [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:59.302141  6881 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53406 (request call id 2772) took 2301 ms. Trace:
I20260709 13:20:59.267550 12849 raft_consensus.cc:3060] T 4d9def8b32fd443aa94ab1420b06837b P b7ab4784c7344b939bc36f639286f377 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:59.303139  6881 rpcz_store.cc:276] 0709 13:20:57.000929 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:57.514567 (+513638us) service_pool.cc:224] Handling call
0709 13:20:57.565167 (+ 50600us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:57.701013 (+135846us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:20:58.032545 (+331532us) log.cc:844] Serialized 14 byte log entry
0709 13:20:58.979182 (+946637us) log.cc:844] Serialized 14 byte log entry
0709 13:20:58.980554 (+  1372us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:20:58.986220 (+  5666us) log.cc:844] Serialized 26 byte log entry
0709 13:20:58.986401 (+   181us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:20:58.986627 (+   226us) log.cc:844] Serialized 14 byte log entry
0709 13:20:58.986877 (+   250us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:58.986957 (+    80us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:59.249524 (+262567us) spinlock_profiling.cc:243] Waited 4.46 ms on lock 0x7b18002f8540. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc15785de1 00007fcc157925b1 00007fcc0c8bd3f3 00007fcc0c8bf7c1 00007fcc0c8bf779 00007fcc0c8bf709 00007fcc0c8bf6d1 00007fcc0c8be9cd 000000000038f354 000000000038f199 00007fcc0c8a083a
0709 13:20:59.301733 (+ 52209us) raft_consensus.cc:1685] finished
0709 13:20:59.301771 (+    38us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:59.302029 (+   258us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":75670,"prepare.queue_time_us":539876,"prepare.run_cpu_time_us":52,"prepare.run_wall_time_us":54,"raft.queue_time_us":86179,"raft.run_cpu_time_us":741,"raft.run_wall_time_us":26115,"spinlock_wait_cycles":10253568,"thread_start_us":814194,"threads_started":2,"wal-append.queue_time_us":767337}
W20260709 13:20:59.312894 12858 log.cc:927] Time spent T a1704639a875409b9959353527b3fd68 P ccd8a4c3bfe3413cb2ae219b09aea832: Append to log took a long time: real 0.132s	user 0.000s	sys 0.000s
W20260709 13:20:59.313510 12854 log.cc:927] Time spent T e77e330a82df4b43a745d57a68f6f057 P ccd8a4c3bfe3413cb2ae219b09aea832: Append to log took a long time: real 0.086s	user 0.000s	sys 0.001s
W20260709 13:20:59.314155 12855 log.cc:927] Time spent T 404190ce4ce94cecbfcb6ea9d1dd8626 P 7ba59cc884714e8aa5f3f0ecaed84cbb: Append to log took a long time: real 0.156s	user 0.000s	sys 0.001s
I20260709 13:20:59.272063 12811 consensus_queue.cc:237] T 90d42e216d9741e190bca19a781291fd P b7ab4784c7344b939bc36f639286f377 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 16.9, Last appended by leader: 9, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
W20260709 13:20:59.316838  6770 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 48001.8us
I20260709 13:20:59.271978 12867 raft_consensus.cc:493] T 9b3759de40694069b13c0f8bd40e5709 P cd75a17ab2604397adab03bb8b5fd75c [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:59.317996 12867 raft_consensus.cc:515] T 9b3759de40694069b13c0f8bd40e5709 P cd75a17ab2604397adab03bb8b5fd75c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:59.318966  6875 raft_consensus.cc:1275] T 7a734b5ab7834e05a8c422208acc58b1 P cd75a17ab2604397adab03bb8b5fd75c [term 17 FOLLOWER]: Refusing update from remote peer b7ab4784c7344b939bc36f639286f377: Log matching property violated. Preceding OpId in replica: term: 17 index: 8. Preceding OpId from leader: term: 17 index: 9. (index mismatch)
I20260709 13:20:59.318562 12835 raft_consensus.cc:515] T bb3d8792045a4583ae2e965b1350a5b4 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:20:59.269230 12527 raft_consensus.cc:493] T c4db81d9d329422bb3b4160ca4ac2d1d P cd75a17ab2604397adab03bb8b5fd75c [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:59.322443  6875 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53406 (request call id 2779) took 1460 ms. Trace:
I20260709 13:20:59.322845  6875 rpcz_store.cc:276] 0709 13:20:57.861961 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:57.867154 (+  5193us) service_pool.cc:224] Handling call
0709 13:20:59.302535 (+1435381us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:59.319360 (+ 16825us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:59.320610 (+  1250us) spinlock_profiling.cc:243] Waited 1.43 s on lock 0x7b54002373d0. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f9a98ad 00007fcc1496e419 00007fcc0dee5bd4 00007fcc0dee5b62 00007fcc0dee5a91 00007fcc0dee5a0c 00007fcc0dee4cc2 00007fcc0dce548c 00007fcc0dce48c6 00007fcc0dce426f
0709 13:20:59.322362 (+  1752us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3300127616}
W20260709 13:20:59.325023  6697 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 108596us
I20260709 13:20:59.328385  6772 leader_election.cc:304] T ab432e62819d499eaaf3dd55481dd930 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:20:59.295699 12866 raft_consensus.cc:2749] T b3f13b31a1f84f0d89d007eadd57924c P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:20:59.296756 12831 raft_consensus.cc:493] T 4f00a2e87e56452083b759f60d461ee3 P cd75a17ab2604397adab03bb8b5fd75c [term 18 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:20:59.332401 12840 raft_consensus.cc:493] T 2c240553ce044eedb41541d72b9475d7 P cd75a17ab2604397adab03bb8b5fd75c [term 17 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:20:59.341179  6772 leader_election.cc:304] T 3d65025eea89441290d85dd053810e31 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:20:59.345769 12580 raft_consensus.cc:493] T ce4f062dcd314d43a63ca74067cb5ee3 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:20:59.346504 12580 raft_consensus.cc:515] T ce4f062dcd314d43a63ca74067cb5ee3 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } attrs { replace: true } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:20:59.344369  6881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fa34c08b205435dba97346991aa1f92" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:59.330506 12837 raft_consensus.cc:2804] T 3fa34c08b205435dba97346991aa1f92 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:20:59.357192  6772 leader_election.cc:304] T 7887766dc6784fcaa42b35c05fea7a99 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:20:59.356209  6697 leader_election.cc:304] T 07a92dd554674067a83a9cb68c4773f2 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:20:59.265722 12561 consensus_queue.cc:260] T 34f36d59d88f40fe8a2805e604fc6c0a P cd75a17ab2604397adab03bb8b5fd75c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
W20260709 13:20:59.362254  6695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 250776us
I20260709 13:20:59.335662 12785 raft_consensus.cc:493] T f58dc08b12a2494bb9a1372837970ca2 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:20:59.326766 12685 consensus_queue.cc:1059] T 7a734b5ab7834e05a8c422208acc58b1 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } attrs { replace: true }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.029s
I20260709 13:20:59.367373  6875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "427c124d773f483294511e80fe340075" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:59.328364 12527 raft_consensus.cc:515] T c4db81d9d329422bb3b4160ca4ac2d1d P cd75a17ab2604397adab03bb8b5fd75c [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:59.388626  6697 leader_election.cc:304] T f03d0dbf16864ca4bc1bb5e4c0334c0f P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:20:59.403332  6872 raft_consensus.cc:2468] T 427c124d773f483294511e80fe340075 P cd75a17ab2604397adab03bb8b5fd75c [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in term 16.
I20260709 13:20:59.361281 12625 raft_consensus.cc:2804] T a3022224cc81473690653a83d4e99470 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:20:59.359678 12867 leader_election.cc:290] T 9b3759de40694069b13c0f8bd40e5709 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:20:59.349643 12840 raft_consensus.cc:515] T 2c240553ce044eedb41541d72b9475d7 P cd75a17ab2604397adab03bb8b5fd75c [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:59.436861 12872 raft_consensus.cc:2804] T f03d0dbf16864ca4bc1bb5e4c0334c0f P ccd8a4c3bfe3413cb2ae219b09aea832 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:20:59.437493 12872 raft_consensus.cc:697] T f03d0dbf16864ca4bc1bb5e4c0334c0f P ccd8a4c3bfe3413cb2ae219b09aea832 [term 18 LEADER]: Becoming Leader. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
I20260709 13:20:59.438499 12872 consensus_queue.cc:237] T f03d0dbf16864ca4bc1bb5e4c0334c0f P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:59.438966 12840 leader_election.cc:290] T 2c240553ce044eedb41541d72b9475d7 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:20:59.427516 12561 raft_consensus.cc:3060] T 34f36d59d88f40fe8a2805e604fc6c0a P cd75a17ab2604397adab03bb8b5fd75c [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:59.428109 12862 raft_consensus.cc:2804] T 07a92dd554674067a83a9cb68c4773f2 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 15 FOLLOWER]: Leader pre-election won for term 16
W20260709 13:20:59.428457 12852 log.cc:927] Time spent T f3f9c2e2bf644115957398fe4c9459db P cd75a17ab2604397adab03bb8b5fd75c: Append to log took a long time: real 0.191s	user 0.001s	sys 0.001s
W20260709 13:20:59.428556 12859 log.cc:927] Time spent T f5be3a11b23d4ea9b08300a2789821c7 P b7ab4784c7344b939bc36f639286f377: Append to log took a long time: real 0.222s	user 0.000s	sys 0.001s
I20260709 13:20:59.428139 12868 raft_consensus.cc:493] T 1528ab62b6fe4e3099d08f141afee116 P b7ab4784c7344b939bc36f639286f377 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:59.428980 12832 raft_consensus.cc:493] T 853ac0a8cbd64ce99457f170216d4d0f P cd75a17ab2604397adab03bb8b5fd75c [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
W20260709 13:20:59.433414 12856 log.cc:927] Time spent T 9e326172347f45e99a0d482b5d8ef768 P ccd8a4c3bfe3413cb2ae219b09aea832: Append to log took a long time: real 0.231s	user 0.001s	sys 0.000s
I20260709 13:20:59.433749 12850 raft_consensus.cc:2804] T e31b9971c15848dea59d4d4130141d9e P b7ab4784c7344b939bc36f639286f377 [term 15 FOLLOWER]: Leader election won for term 15
W20260709 13:20:59.434072 12851 log.cc:927] Time spent T bd6869f07b5a4885a0b99fbe60c3b175 P cd75a17ab2604397adab03bb8b5fd75c: Append to log took a long time: real 0.255s	user 0.000s	sys 0.001s
I20260709 13:20:59.434702  6731 raft_consensus.cc:2410] T ab432e62819d499eaaf3dd55481dd930 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c for term 19 because replica has last-logged OpId of term: 18 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 9.
I20260709 13:20:59.392406 12785 raft_consensus.cc:515] T f58dc08b12a2494bb9a1372837970ca2 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:59.342257 12831 raft_consensus.cc:515] T 4f00a2e87e56452083b759f60d461ee3 P cd75a17ab2604397adab03bb8b5fd75c [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:20:59.424787  6844 leader_election.cc:304] T a1704639a875409b9959353527b3fd68 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:20:59.395696 12730 raft_consensus.cc:697] T 34f36d59d88f40fe8a2805e604fc6c0a P b7ab4784c7344b939bc36f639286f377 [term 16 LEADER]: Becoming Leader. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
W20260709 13:20:59.450161  6695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 62199.2us
I20260709 13:20:59.454763 12625 raft_consensus.cc:697] T a3022224cc81473690653a83d4e99470 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 19 LEADER]: Becoming Leader. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
W20260709 13:20:59.456573  6770 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 138161us
W20260709 13:20:59.481038 12566 consensus_meta.cc:287] T 17587d6730594da4a56fa13a353232a1 P b7ab4784c7344b939bc36f639286f377: Time spent flushing consensus metadata: real 0.835s	user 0.013s	sys 0.004s
I20260709 13:20:59.431545 12673 raft_consensus.cc:515] T be1a92657f494cac8dd227d152f50151 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:20:59.446031 12862 raft_consensus.cc:493] T 07a92dd554674067a83a9cb68c4773f2 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:59.443439 12865 raft_consensus.cc:493] T ce4f062dcd314d43a63ca74067cb5ee3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 15 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:20:59.387121 12594 consensus_queue.cc:1059] T 7c37d41cd9164c15a6826ca62a851a69 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.038s
I20260709 13:20:59.506148 12527 leader_election.cc:290] T c4db81d9d329422bb3b4160ca4ac2d1d P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:20:59.505955 12625 consensus_queue.cc:237] T a3022224cc81473690653a83d4e99470 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.10, Last appended by leader: 10, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
W20260709 13:20:59.507117 12860 log.cc:927] Time spent T 7c44c4849aa54f2b94d1f1bef9ed546f P ccd8a4c3bfe3413cb2ae219b09aea832: Append to log took a long time: real 0.156s	user 0.000s	sys 0.001s
I20260709 13:20:59.507478  7503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f00a2e87e56452083b759f60d461ee3" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:20:59.473157 12811 raft_consensus.cc:2749] T ab432e62819d499eaaf3dd55481dd930 P b7ab4784c7344b939bc36f639286f377 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:20:59.486937 12663 leader_election.cc:290] T 713b5728a197487c9300b310ab94e5a3 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:20:59.500365 12871 raft_consensus.cc:2804] T 3d65025eea89441290d85dd053810e31 P b7ab4784c7344b939bc36f639286f377 [term 17 FOLLOWER]: Leader pre-election won for term 18
W20260709 13:20:59.523265  6697 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 155812us
I20260709 13:20:59.466218 12698 raft_consensus.cc:515] T bb7fa124c3bf4ef9ab65a407cb008441 P b7ab4784c7344b939bc36f639286f377 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:20:59.483826 12766 consensus_queue.cc:1048] T 404190ce4ce94cecbfcb6ea9d1dd8626 P 7ba59cc884714e8aa5f3f0ecaed84cbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.038s
I20260709 13:20:59.531417  6723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3d8792045a4583ae2e965b1350a5b4" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:20:59.508069 12849 raft_consensus.cc:515] T 4d9def8b32fd443aa94ab1420b06837b P b7ab4784c7344b939bc36f639286f377 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:59.505985 12831 leader_election.cc:290] T 4f00a2e87e56452083b759f60d461ee3 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:20:59.520313 12862 raft_consensus.cc:3060] T 07a92dd554674067a83a9cb68c4773f2 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:59.529071  7503 raft_consensus.cc:2468] T 4f00a2e87e56452083b759f60d461ee3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 18.
I20260709 13:20:59.538616  6726 raft_consensus.cc:1275] T 1528ab62b6fe4e3099d08f141afee116 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 14 FOLLOWER]: Refusing update from remote peer 7ba59cc884714e8aa5f3f0ecaed84cbb: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:20:59.537889  6695 leader_election.cc:304] T 3411566abe2d4c9bb4b2adfdd05e6f17 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:20:59.523728 12850 raft_consensus.cc:697] T e31b9971c15848dea59d4d4130141d9e P b7ab4784c7344b939bc36f639286f377 [term 15 LEADER]: Becoming Leader. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
I20260709 13:20:59.528514 12566 raft_consensus.cc:3055] T 7a734b5ab7834e05a8c422208acc58b1 P b7ab4784c7344b939bc36f639286f377 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:20:59.485577 12868 raft_consensus.cc:515] T 1528ab62b6fe4e3099d08f141afee116 P b7ab4784c7344b939bc36f639286f377 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:20:59.527561 12685 raft_consensus.cc:493] T 404190ce4ce94cecbfcb6ea9d1dd8626 P b7ab4784c7344b939bc36f639286f377 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:59.552668 12685 raft_consensus.cc:515] T 404190ce4ce94cecbfcb6ea9d1dd8626 P b7ab4784c7344b939bc36f639286f377 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:20:59.494743 12832 raft_consensus.cc:515] T 853ac0a8cbd64ce99457f170216d4d0f P cd75a17ab2604397adab03bb8b5fd75c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:59.543275 12594 consensus_queue.cc:1059] T 4275cf08e63345f993bce8664eada830 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: INVALID_TERM, Last received: 14.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.015s
I20260709 13:20:59.557811 12832 leader_election.cc:290] T 853ac0a8cbd64ce99457f170216d4d0f P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:20:59.527915 12871 raft_consensus.cc:493] T 3d65025eea89441290d85dd053810e31 P b7ab4784c7344b939bc36f639286f377 [term 17 FOLLOWER]: Starting leader election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
W20260709 13:20:59.544323  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 137340us
I20260709 13:20:59.546428 12566 raft_consensus.cc:740] T 7a734b5ab7834e05a8c422208acc58b1 P b7ab4784c7344b939bc36f639286f377 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
I20260709 13:20:59.542132 12888 raft_consensus.cc:2804] T 7887766dc6784fcaa42b35c05fea7a99 P b7ab4784c7344b939bc36f639286f377 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:20:59.548645 12881 raft_consensus.cc:2749] T a1704639a875409b9959353527b3fd68 P cd75a17ab2604397adab03bb8b5fd75c [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:20:59.526108 12865 raft_consensus.cc:515] T ce4f062dcd314d43a63ca74067cb5ee3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } attrs { replace: true } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:20:59.549242  6799 raft_consensus.cc:1275] T 1528ab62b6fe4e3099d08f141afee116 P b7ab4784c7344b939bc36f639286f377 [term 14 FOLLOWER]: Refusing update from remote peer 7ba59cc884714e8aa5f3f0ecaed84cbb: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:20:59.549438 12698 leader_election.cc:290] T bb7fa124c3bf4ef9ab65a407cb008441 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 17 election: Requested vote from peers cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:20:59.550109 12868 leader_election.cc:290] T 1528ab62b6fe4e3099d08f141afee116 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
W20260709 13:20:59.569645  6770 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 67207.4us
I20260709 13:20:59.550762 12849 leader_election.cc:290] T 4d9def8b32fd443aa94ab1420b06837b P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 17 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:59.551707  6876 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53416 (request call id 3506) took 1166 ms. Trace:
W20260709 13:20:59.552008 12885 log.cc:927] Time spent T 3fa34c08b205435dba97346991aa1f92 P 7ba59cc884714e8aa5f3f0ecaed84cbb: Append to log took a long time: real 0.065s	user 0.001s	sys 0.000s
I20260709 13:20:59.547008 12835 leader_election.cc:290] T bb3d8792045a4583ae2e965b1350a5b4 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 16 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:59.565779  7498 raft_consensus.cc:1240] T fe20b4b48823486ca3b9c648db6ce8aa P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 14 LEADER]: Rejecting Update request from peer cd75a17ab2604397adab03bb8b5fd75c for earlier term 13. Current term is 14. Ops: []
W20260709 13:20:59.565613  6772 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 208496us
I20260709 13:20:59.562119 12871 raft_consensus.cc:3060] T 3d65025eea89441290d85dd053810e31 P b7ab4784c7344b939bc36f639286f377 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:20:59.571177  6876 rpcz_store.cc:276] 0709 13:20:58.385033 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:58.385206 (+   173us) service_pool.cc:224] Handling call
0709 13:20:58.399640 (+ 14434us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:58.513191 (+113551us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:58.513257 (+    66us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:20:58.514054 (+   797us) log.cc:844] Serialized 26 byte log entry
0709 13:20:58.852629 (+338575us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:20:58.852709 (+    80us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:58.852812 (+   103us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:59.551485 (+698673us) raft_consensus.cc:1685] finished
0709 13:20:59.551510 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:59.551649 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":61675,"raft.run_cpu_time_us":157,"raft.run_wall_time_us":6153,"thread_start_us":338011,"threads_started":1,"wal-append.queue_time_us":468656}
I20260709 13:20:59.564334 12888 raft_consensus.cc:493] T 7887766dc6784fcaa42b35c05fea7a99 P b7ab4784c7344b939bc36f639286f377 [term 18 FOLLOWER]: Starting leader election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:20:59.565150 12685 leader_election.cc:290] T 404190ce4ce94cecbfcb6ea9d1dd8626 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
W20260709 13:20:59.586351  6773 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:59.592643  6844 leader_election.cc:304] T 3d65025eea89441290d85dd053810e31 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
W20260709 13:20:59.593873  6695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 56053.9us
W20260709 13:20:59.595598 12884 log.cc:927] Time spent T 7887766dc6784fcaa42b35c05fea7a99 P cd75a17ab2604397adab03bb8b5fd75c: Append to log took a long time: real 0.108s	user 0.001s	sys 0.000s
I20260709 13:20:59.595909 12691 raft_consensus.cc:2749] T 3411566abe2d4c9bb4b2adfdd05e6f17 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:20:59.598912 12886 raft_consensus.cc:493] T 22ccee1b570c4ad3a57bd7aec085b1b4 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:20:59.582373 12888 raft_consensus.cc:3060] T 7887766dc6784fcaa42b35c05fea7a99 P b7ab4784c7344b939bc36f639286f377 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:20:59.608596  6695 leader_election.cc:304] T 9e326172347f45e99a0d482b5d8ef768 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
W20260709 13:20:59.611264  6770 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:59.599642 12886 raft_consensus.cc:515] T 22ccee1b570c4ad3a57bd7aec085b1b4 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:59.616781 12760 raft_consensus.cc:3055] T fe20b4b48823486ca3b9c648db6ce8aa P cd75a17ab2604397adab03bb8b5fd75c [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:20:59.617262 12760 raft_consensus.cc:740] T fe20b4b48823486ca3b9c648db6ce8aa P cd75a17ab2604397adab03bb8b5fd75c [term 13 LEADER]: Becoming Follower/Learner. State: Replica: cd75a17ab2604397adab03bb8b5fd75c, State: Running, Role: LEADER
I20260709 13:20:59.618237 12760 consensus_queue.cc:260] T fe20b4b48823486ca3b9c648db6ce8aa P cd75a17ab2604397adab03bb8b5fd75c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:20:59.619473 12760 raft_consensus.cc:3060] T fe20b4b48823486ca3b9c648db6ce8aa P cd75a17ab2604397adab03bb8b5fd75c [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:59.620182 12896 consensus_queue.cc:1048] T b56bf91d90824c959e21e0cee5ba1816 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:20:59.613092  6726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be1a92657f494cac8dd227d152f50151" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 19 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:20:59.624838  6695 leader_election.cc:400] T e31b9971c15848dea59d4d4130141d9e P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 14 election: Vote denied by peer b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817) with higher term. Message: Invalid argument: T e31b9971c15848dea59d4d4130141d9e P b7ab4784c7344b939bc36f639286f377 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 14. Current term is 15.
I20260709 13:20:59.625016  6726 raft_consensus.cc:3060] T be1a92657f494cac8dd227d152f50151 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:20:59.625460  6695 leader_election.cc:403] T e31b9971c15848dea59d4d4130141d9e P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 14 election: Cancelling election due to peer responding with higher term
I20260709 13:20:59.627288  6844 leader_election.cc:304] T d8292e16e5654be6bc408560cf256aaa P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:20:59.627185 12566 consensus_queue.cc:260] T 7a734b5ab7834e05a8c422208acc58b1 P b7ab4784c7344b939bc36f639286f377 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 17.9, Last appended by leader: 9, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } attrs { replace: true } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:20:59.628971 12566 raft_consensus.cc:3060] T 7a734b5ab7834e05a8c422208acc58b1 P b7ab4784c7344b939bc36f639286f377 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:20:59.584282 12730 consensus_queue.cc:237] T 34f36d59d88f40fe8a2805e604fc6c0a P b7ab4784c7344b939bc36f639286f377 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:59.645982  6726 raft_consensus.cc:2468] T be1a92657f494cac8dd227d152f50151 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in term 19.
I20260709 13:20:59.606370 12663 raft_consensus.cc:2749] T 3d65025eea89441290d85dd053810e31 P cd75a17ab2604397adab03bb8b5fd75c [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:20:59.611646 12785 leader_election.cc:290] T f58dc08b12a2494bb9a1372837970ca2 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:59.660465 12893 raft_consensus.cc:493] T b56bf91d90824c959e21e0cee5ba1816 P b7ab4784c7344b939bc36f639286f377 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:59.661059 12893 raft_consensus.cc:515] T b56bf91d90824c959e21e0cee5ba1816 P b7ab4784c7344b939bc36f639286f377 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:59.663143 12893 leader_election.cc:290] T b56bf91d90824c959e21e0cee5ba1816 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
W20260709 13:20:59.664497 12834 consensus_meta.cc:287] T bb7fa124c3bf4ef9ab65a407cb008441 P cd75a17ab2604397adab03bb8b5fd75c: Time spent flushing consensus metadata: real 0.589s	user 0.008s	sys 0.004s
I20260709 13:20:59.665057 12834 raft_consensus.cc:515] T bb7fa124c3bf4ef9ab65a407cb008441 P cd75a17ab2604397adab03bb8b5fd75c [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:20:59.626384 12668 raft_consensus.cc:2749] T 9e326172347f45e99a0d482b5d8ef768 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:20:59.659421 12580 leader_election.cc:290] T ce4f062dcd314d43a63ca74067cb5ee3 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:20:59.655512 12741 raft_consensus.cc:493] T ce4f062dcd314d43a63ca74067cb5ee3 P cd75a17ab2604397adab03bb8b5fd75c [term 15 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:20:59.606241 12766 consensus_queue.cc:1048] T 1528ab62b6fe4e3099d08f141afee116 P 7ba59cc884714e8aa5f3f0ecaed84cbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.051s
I20260709 13:20:59.668277  6880 raft_consensus.cc:1240] T bb7fa124c3bf4ef9ab65a407cb008441 P cd75a17ab2604397adab03bb8b5fd75c [term 17 FOLLOWER]: Rejecting Update request from peer 7ba59cc884714e8aa5f3f0ecaed84cbb for earlier term 16. Current term is 17. Ops: []
I20260709 13:20:59.676994  6723 raft_consensus.cc:2468] T bb3d8792045a4583ae2e965b1350a5b4 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in term 16.
I20260709 13:20:59.690258  6872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6869f07b5a4885a0b99fbe60c3b175" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
W20260709 13:20:59.693106  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 65946.1us
I20260709 13:20:59.655735 12881 raft_consensus.cc:2749] T d8292e16e5654be6bc408560cf256aaa P cd75a17ab2604397adab03bb8b5fd75c [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:20:59.706687  6872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bf4668eeb70467fb3dc5a0289233b3c" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:59.719390  7496 raft_consensus.cc:1240] T be1a92657f494cac8dd227d152f50151 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 19 FOLLOWER]: Rejecting Update request from peer b7ab4784c7344b939bc36f639286f377 for earlier term 18. Current term is 19. Ops: [18.14-18.14]
I20260709 13:20:59.714893  6879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20f6842e26174571996b8dea4151d4be" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:59.717507  6881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e31b9971c15848dea59d4d4130141d9e" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:20:59.721252  6881 raft_consensus.cc:3060] T e31b9971c15848dea59d4d4130141d9e P cd75a17ab2604397adab03bb8b5fd75c [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:59.723630  6844 leader_election.cc:304] T 9e326172347f45e99a0d482b5d8ef768 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:20:59.696291 12897 raft_consensus.cc:493] T d8292e16e5654be6bc408560cf256aaa P b7ab4784c7344b939bc36f639286f377 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:20:59.668009 12834 leader_election.cc:290] T bb7fa124c3bf4ef9ab65a407cb008441 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 17 election: Requested vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:20:59.730336  7495 raft_consensus.cc:1240] T 17587d6730594da4a56fa13a353232a1 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 22 FOLLOWER]: Rejecting Update request from peer b7ab4784c7344b939bc36f639286f377 for earlier term 21. Current term is 22. Ops: [21.15-21.15]
I20260709 13:20:59.745536  6874 raft_consensus.cc:1275] T 07a92dd554674067a83a9cb68c4773f2 P cd75a17ab2604397adab03bb8b5fd75c [term 15 FOLLOWER]: Refusing update from remote peer b7ab4784c7344b939bc36f639286f377: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:20:59.751773  6879 raft_consensus.cc:1240] T f03d0dbf16864ca4bc1bb5e4c0334c0f P cd75a17ab2604397adab03bb8b5fd75c [term 18 FOLLOWER]: Rejecting Update request from peer b7ab4784c7344b939bc36f639286f377 for earlier term 17. Current term is 18. Ops: [17.9-17.9]
W20260709 13:20:59.749114 12631 consensus_meta.cc:287] T d33d5ee8ef6f415593d8df52063161ad P b7ab4784c7344b939bc36f639286f377: Time spent flushing consensus metadata: real 0.600s	user 0.013s	sys 0.001s
I20260709 13:20:59.745266  6875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09c2a98de1a4decabd0ff900dd44caa" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:59.746022  6804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6869f07b5a4885a0b99fbe60c3b175" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 19 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:59.755326  6804 raft_consensus.cc:2410] T bd6869f07b5a4885a0b99fbe60c3b175 P b7ab4784c7344b939bc36f639286f377 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c for term 19 because replica has last-logged OpId of term: 18 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 8.
I20260709 13:20:59.757390  6799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab432e62819d499eaaf3dd55481dd930" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:20:59.725145 12832 raft_consensus.cc:493] T 7a734b5ab7834e05a8c422208acc58b1 P cd75a17ab2604397adab03bb8b5fd75c [term 17 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:20:59.764113  6799 raft_consensus.cc:2393] T ab432e62819d499eaaf3dd55481dd930 P b7ab4784c7344b939bc36f639286f377 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c in current term 19: Already voted for candidate b7ab4784c7344b939bc36f639286f377 in this term.
I20260709 13:20:59.764107  6881 raft_consensus.cc:2468] T e31b9971c15848dea59d4d4130141d9e P cd75a17ab2604397adab03bb8b5fd75c [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 15.
I20260709 13:20:59.768749  6873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44bde925b2e541b69890d70715b85176" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:59.732422 12527 raft_consensus.cc:2749] T 9e326172347f45e99a0d482b5d8ef768 P cd75a17ab2604397adab03bb8b5fd75c [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:20:59.769387  6873 raft_consensus.cc:2468] T 44bde925b2e541b69890d70715b85176 P cd75a17ab2604397adab03bb8b5fd75c [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 17.
I20260709 13:20:59.763557  7495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb7fa124c3bf4ef9ab65a407cb008441" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb"
I20260709 13:20:59.770824  6881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb7fa124c3bf4ef9ab65a407cb008441" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:20:59.727449 12900 raft_consensus.cc:2749] T e31b9971c15848dea59d4d4130141d9e P ccd8a4c3bfe3413cb2ae219b09aea832 [term 15 FOLLOWER]: Leader election lost for term 14. Reason: Vote denied by peer b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817) with higher term. Message: Invalid argument: T e31b9971c15848dea59d4d4130141d9e P b7ab4784c7344b939bc36f639286f377 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 14. Current term is 15.
W20260709 13:20:59.771884  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 48368.2us
I20260709 13:20:59.774039  6804 raft_consensus.cc:1240] T 90d42e216d9741e190bca19a781291fd P b7ab4784c7344b939bc36f639286f377 [term 18 LEADER]: Rejecting Update request from peer cd75a17ab2604397adab03bb8b5fd75c for earlier term 17. Current term is 18. Ops: []
I20260709 13:20:59.742236 12890 raft_consensus.cc:3055] T 7c37d41cd9164c15a6826ca62a851a69 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:20:59.774927  6726 raft_consensus.cc:1240] T be1a92657f494cac8dd227d152f50151 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 19 FOLLOWER]: Rejecting Update request from peer b7ab4784c7344b939bc36f639286f377 for earlier term 18. Current term is 19. Ops: [18.14-18.14]
I20260709 13:20:59.774071  7496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1528ab62b6fe4e3099d08f141afee116" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:20:59.774034  6877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4b8bd455d5a47c18a1380839c6e0d61" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:20:59.780026  6877 raft_consensus.cc:3060] T f4b8bd455d5a47c18a1380839c6e0d61 P cd75a17ab2604397adab03bb8b5fd75c [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:20:59.776652  6730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1528ab62b6fe4e3099d08f141afee116" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:59.781030  6730 raft_consensus.cc:2468] T 1528ab62b6fe4e3099d08f141afee116 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 14.
I20260709 13:20:59.778646  6732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44bde925b2e541b69890d70715b85176" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:59.723371 12741 raft_consensus.cc:515] T ce4f062dcd314d43a63ca74067cb5ee3 P cd75a17ab2604397adab03bb8b5fd75c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } attrs { replace: true } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
W20260709 13:20:59.783840 12828 log.cc:927] Time spent T 3fa34c08b205435dba97346991aa1f92 P cd75a17ab2604397adab03bb8b5fd75c: Append to log took a long time: real 1.033s	user 0.005s	sys 0.001s
I20260709 13:20:59.769802 12631 raft_consensus.cc:493] T b3f13b31a1f84f0d89d007eadd57924c P b7ab4784c7344b939bc36f639286f377 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:20:59.643344 12850 consensus_queue.cc:237] T e31b9971c15848dea59d4d4130141d9e P b7ab4784c7344b939bc36f639286f377 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:59.785430 12631 raft_consensus.cc:515] T b3f13b31a1f84f0d89d007eadd57924c P b7ab4784c7344b939bc36f639286f377 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:20:59.786013 12811 raft_consensus.cc:493] T dbdf895bba214ff68685a24fd17dfb5d P b7ab4784c7344b939bc36f639286f377 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader cd75a17ab2604397adab03bb8b5fd75c)
I20260709 13:20:59.786609 12811 raft_consensus.cc:515] T dbdf895bba214ff68685a24fd17dfb5d P b7ab4784c7344b939bc36f639286f377 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:59.788318  6844 leader_election.cc:304] T b56bf91d90824c959e21e0cee5ba1816 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:20:59.788800 12811 leader_election.cc:290] T dbdf895bba214ff68685a24fd17dfb5d P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:59.732491 12895 consensus_queue.cc:1059] T f03d0dbf16864ca4bc1bb5e4c0334c0f P b7ab4784c7344b939bc36f639286f377 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: INVALID_TERM, Last received: 15.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.207s
I20260709 13:20:59.789812 12895 raft_consensus.cc:493] T 30e88460611e47b2ba16a46a30b5f416 P b7ab4784c7344b939bc36f639286f377 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:20:59.790295  6844 leader_election.cc:304] T f5be3a11b23d4ea9b08300a2789821c7 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377
I20260709 13:20:59.790405 12895 raft_consensus.cc:515] T 30e88460611e47b2ba16a46a30b5f416 P b7ab4784c7344b939bc36f639286f377 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:59.790998 12714 raft_consensus.cc:493] T de3186201e1a40d0b335eeb8b4e256e0 P b7ab4784c7344b939bc36f639286f377 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:20:59.791700  6844 leader_election.cc:400] T 07a92dd554674067a83a9cb68c4773f2 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 14 pre-election: Vote denied by peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391) with higher term. Message: Invalid argument: T 07a92dd554674067a83a9cb68c4773f2 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c for earlier term 14. Current term is 15.
I20260709 13:20:59.792577  6844 leader_election.cc:403] T 07a92dd554674067a83a9cb68c4773f2 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 14 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:20:59.792733  6727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4b8bd455d5a47c18a1380839c6e0d61" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:20:59.795207  6727 raft_consensus.cc:3060] T f4b8bd455d5a47c18a1380839c6e0d61 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:20:59.796375  6728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d9def8b32fd443aa94ab1420b06837b" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:20:59.797310  6728 raft_consensus.cc:3060] T 4d9def8b32fd443aa94ab1420b06837b P ccd8a4c3bfe3413cb2ae219b09aea832 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:59.732241 12831 consensus_queue.cc:1048] T 3fa34c08b205435dba97346991aa1f92 P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Connected to new peer: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.040s
I20260709 13:20:59.759305  6872 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a1704639a875409b9959353527b3fd68"
dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
 from {username='slave'} at 127.0.0.1:53406
I20260709 13:20:59.762822 12704 raft_consensus.cc:493] T 2c240553ce044eedb41541d72b9475d7 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:20:59.801326  6772 leader_election.cc:304] T bd6869f07b5a4885a0b99fbe60c3b175 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:20:59.805796  6872 raft_consensus.cc:493] T a1704639a875409b9959353527b3fd68 P cd75a17ab2604397adab03bb8b5fd75c [term 17 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:20:59.809913  6872 raft_consensus.cc:3060] T a1704639a875409b9959353527b3fd68 P cd75a17ab2604397adab03bb8b5fd75c [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:20:59.801206  6873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d9def8b32fd443aa94ab1420b06837b" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:20:59.791574 12714 raft_consensus.cc:515] T de3186201e1a40d0b335eeb8b4e256e0 P b7ab4784c7344b939bc36f639286f377 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:59.789378 12811 raft_consensus.cc:493] T 3411566abe2d4c9bb4b2adfdd05e6f17 P b7ab4784c7344b939bc36f639286f377 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:59.807806  6724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "404190ce4ce94cecbfcb6ea9d1dd8626" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:59.814631  6772 leader_election.cc:304] T 1bf4668eeb70467fb3dc5a0289233b3c P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:20:59.811453  6873 raft_consensus.cc:3060] T 4d9def8b32fd443aa94ab1420b06837b P cd75a17ab2604397adab03bb8b5fd75c [term 15 FOLLOWER]: Advancing to term 17
I20260709 13:20:59.815884 12810 raft_consensus.cc:2749] T bd6869f07b5a4885a0b99fbe60c3b175 P b7ab4784c7344b939bc36f639286f377 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:20:59.726763 12897 raft_consensus.cc:515] T d8292e16e5654be6bc408560cf256aaa P b7ab4784c7344b939bc36f639286f377 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:59.816776 12810 raft_consensus.cc:2749] T 1bf4668eeb70467fb3dc5a0289233b3c P b7ab4784c7344b939bc36f639286f377 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:20:59.818583 12897 leader_election.cc:290] T d8292e16e5654be6bc408560cf256aaa P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:59.816756 12714 leader_election.cc:290] T de3186201e1a40d0b335eeb8b4e256e0 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:59.818483  6772 leader_election.cc:304] T 20f6842e26174571996b8dea4151d4be P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:20:59.787848 12631 leader_election.cc:290] T b3f13b31a1f84f0d89d007eadd57924c P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:20:59.779609 12890 raft_consensus.cc:740] T 7c37d41cd9164c15a6826ca62a851a69 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
I20260709 13:20:59.825695  7495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb7fa124c3bf4ef9ab65a407cb008441" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb"
I20260709 13:20:59.820895  6844 leader_election.cc:304] T f09c2a98de1a4decabd0ff900dd44caa P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:20:59.820700  6804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d33d5ee8ef6f415593d8df52063161ad" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:59.845723  6804 raft_consensus.cc:2468] T d33d5ee8ef6f415593d8df52063161ad P b7ab4784c7344b939bc36f639286f377 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 15.
W20260709 13:20:59.824501  6846 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:59.848213  6695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 225090us
I20260709 13:20:59.849526  6695 leader_election.cc:304] T 95a75bfe094d4bdc963aba3f08dfcd25 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:20:59.799794 12881 raft_consensus.cc:2749] T b56bf91d90824c959e21e0cee5ba1816 P cd75a17ab2604397adab03bb8b5fd75c [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:20:59.785117 12741 leader_election.cc:290] T ce4f062dcd314d43a63ca74067cb5ee3 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:20:59.805203 12685 raft_consensus.cc:3055] T f03d0dbf16864ca4bc1bb5e4c0334c0f P b7ab4784c7344b939bc36f639286f377 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:20:59.804378 12657 consensus_queue.cc:1059] T be1a92657f494cac8dd227d152f50151 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false }, Status: INVALID_TERM, Last received: 16.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.048s
I20260709 13:20:59.808426 12849 raft_consensus.cc:493] T 7c44c4849aa54f2b94d1f1bef9ed546f P b7ab4784c7344b939bc36f639286f377 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:20:59.793452 12872 raft_consensus.cc:493] T 713b5728a197487c9300b310ab94e5a3 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:20:59.855491  6728 raft_consensus.cc:2468] T 4d9def8b32fd443aa94ab1420b06837b P ccd8a4c3bfe3413cb2ae219b09aea832 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 17.
I20260709 13:20:59.804510 12527 raft_consensus.cc:2764] T f5be3a11b23d4ea9b08300a2789821c7 P cd75a17ab2604397adab03bb8b5fd75c [term 16 FOLLOWER]: Leader pre-election decision vote started in defunct term 15: won
I20260709 13:20:59.821461 12840 raft_consensus.cc:493] T 8c7f33e544204fbaac4078e3e83bbf4e P cd75a17ab2604397adab03bb8b5fd75c [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:20:59.873313 12840 raft_consensus.cc:515] T 8c7f33e544204fbaac4078e3e83bbf4e P cd75a17ab2604397adab03bb8b5fd75c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:59.853072 12704 raft_consensus.cc:515] T 2c240553ce044eedb41541d72b9475d7 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:59.877182 12872 raft_consensus.cc:515] T 713b5728a197487c9300b310ab94e5a3 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:59.863011  6881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b56bf91d90824c959e21e0cee5ba1816" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 18 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
W20260709 13:20:59.864135  6696 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:59.865793  6804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8cee0accdb8499c86d4414b72565a38" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 19 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:59.777119 12832 raft_consensus.cc:515] T 7a734b5ab7834e05a8c422208acc58b1 P cd75a17ab2604397adab03bb8b5fd75c [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } attrs { replace: true } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: NON_VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: true } }
I20260709 13:20:59.869282  7494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "404190ce4ce94cecbfcb6ea9d1dd8626" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:20:59.869065 12890 consensus_queue.cc:260] T 7c37d41cd9164c15a6826ca62a851a69 P ccd8a4c3bfe3413cb2ae219b09aea832 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.12, Last appended by leader: 12, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:59.831130 12871 raft_consensus.cc:515] T 3d65025eea89441290d85dd053810e31 P b7ab4784c7344b939bc36f639286f377 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:59.819813 12811 raft_consensus.cc:515] T 3411566abe2d4c9bb4b2adfdd05e6f17 P b7ab4784c7344b939bc36f639286f377 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:59.870777 12895 leader_election.cc:290] T 30e88460611e47b2ba16a46a30b5f416 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:59.861127 12685 raft_consensus.cc:740] T f03d0dbf16864ca4bc1bb5e4c0334c0f P b7ab4784c7344b939bc36f639286f377 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
I20260709 13:20:59.901686  6799 raft_consensus.cc:1275] T 3411566abe2d4c9bb4b2adfdd05e6f17 P b7ab4784c7344b939bc36f639286f377 [term 15 FOLLOWER]: Refusing update from remote peer cd75a17ab2604397adab03bb8b5fd75c: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:20:59.902276  6772 leader_election.cc:304] T f09c2a98de1a4decabd0ff900dd44caa P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
W20260709 13:20:59.871596 12904 log.cc:927] Time spent T 404190ce4ce94cecbfcb6ea9d1dd8626 P b7ab4784c7344b939bc36f639286f377: Append to log took a long time: real 0.067s	user 0.000s	sys 0.000s
I20260709 13:20:59.871888 12849 raft_consensus.cc:515] T 7c44c4849aa54f2b94d1f1bef9ed546f P b7ab4784c7344b939bc36f639286f377 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:59.884666 12862 raft_consensus.cc:515] T 07a92dd554674067a83a9cb68c4773f2 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:59.908968 12849 leader_election.cc:290] T 7c44c4849aa54f2b94d1f1bef9ed546f P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:59.909781 12862 leader_election.cc:290] T 07a92dd554674067a83a9cb68c4773f2 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 16 election: Requested vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:59.875738 12840 leader_election.cc:290] T 8c7f33e544204fbaac4078e3e83bbf4e P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:20:59.913357 12832 leader_election.cc:290] T 7a734b5ab7834e05a8c422208acc58b1 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:20:59.914389  7466 leader_election.cc:304] T 427c124d773f483294511e80fe340075 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
I20260709 13:20:59.915629 12871 leader_election.cc:290] T 3d65025eea89441290d85dd053810e31 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 18 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:59.916553 12906 raft_consensus.cc:2749] T 95a75bfe094d4bdc963aba3f08dfcd25 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:20:59.906194 12685 consensus_queue.cc:260] T f03d0dbf16864ca4bc1bb5e4c0334c0f P b7ab4784c7344b939bc36f639286f377 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 17.9, Last appended by leader: 9, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:59.917878  6804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d9def8b32fd443aa94ab1420b06837b" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:59.918916  6804 raft_consensus.cc:2368] T 4d9def8b32fd443aa94ab1420b06837b P b7ab4784c7344b939bc36f639286f377 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c for earlier term 16. Current term is 17.
I20260709 13:20:59.919272 12802 raft_consensus.cc:2804] T 427c124d773f483294511e80fe340075 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:20:59.919890 12802 raft_consensus.cc:697] T 427c124d773f483294511e80fe340075 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 16 LEADER]: Becoming Leader. State: Replica: 7ba59cc884714e8aa5f3f0ecaed84cbb, State: Running, Role: LEADER
I20260709 13:20:59.920910 12802 consensus_queue.cc:237] T 427c124d773f483294511e80fe340075 P 7ba59cc884714e8aa5f3f0ecaed84cbb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 16, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } attrs { replace: true } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:20:59.926306  6805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c37d41cd9164c15a6826ca62a851a69" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:20:59.928076 12730 raft_consensus.cc:2749] T f09c2a98de1a4decabd0ff900dd44caa P b7ab4784c7344b939bc36f639286f377 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:20:59.928390 12835 consensus_queue.cc:1048] T 1528ab62b6fe4e3099d08f141afee116 P 7ba59cc884714e8aa5f3f0ecaed84cbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:20:59.928933 12730 consensus_queue.cc:1048] T 07a92dd554674067a83a9cb68c4773f2 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:20:59.930346 12685 raft_consensus.cc:3060] T f03d0dbf16864ca4bc1bb5e4c0334c0f P b7ab4784c7344b939bc36f639286f377 [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:20:59.931493 12899 consensus_queue.cc:1175] T f03d0dbf16864ca4bc1bb5e4c0334c0f P b7ab4784c7344b939bc36f639286f377 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "cd75a17ab2604397adab03bb8b5fd75c" responder_term: 18 status { last_received { term: 15 index: 8 } last_committed_idx: 8 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer b7ab4784c7344b939bc36f639286f377 for earlier term 17. Current term is 18. Ops: [17.9-17.9]" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:20:59.927624  7466 leader_election.cc:304] T be1a92657f494cac8dd227d152f50151 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
I20260709 13:20:59.935514  6730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce4f062dcd314d43a63ca74067cb5ee3" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:59.935756  6728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b56bf91d90824c959e21e0cee5ba1816" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 18 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:59.937629  7466 leader_election.cc:304] T bb3d8792045a4583ae2e965b1350a5b4 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
I20260709 13:20:59.886531  6800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f58dc08b12a2494bb9a1372837970ca2" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:59.892863  7495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce4f062dcd314d43a63ca74067cb5ee3" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
W20260709 13:20:59.895500  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 74692.3us
I20260709 13:20:59.863126 12868 raft_consensus.cc:2749] T 20f6842e26174571996b8dea4151d4be P b7ab4784c7344b939bc36f639286f377 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:20:59.866989 12741 raft_consensus.cc:2749] T f09c2a98de1a4decabd0ff900dd44caa P cd75a17ab2604397adab03bb8b5fd75c [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:20:59.879623 12872 leader_election.cc:290] T 713b5728a197487c9300b310ab94e5a3 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:20:59.904431  6798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de3186201e1a40d0b335eeb8b4e256e0" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:59.905205 12811 leader_election.cc:290] T 3411566abe2d4c9bb4b2adfdd05e6f17 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
W20260709 13:20:59.906128  6697 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:59.821149 12834 raft_consensus.cc:2749] T 07a92dd554674067a83a9cb68c4773f2 P cd75a17ab2604397adab03bb8b5fd75c [term 15 FOLLOWER]: Leader pre-election lost for term 14. Reason: Vote denied by peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391) with higher term. Message: Invalid argument: T 07a92dd554674067a83a9cb68c4773f2 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c for earlier term 14. Current term is 15.
I20260709 13:20:59.926407  6772 leader_election.cc:304] T 44bde925b2e541b69890d70715b85176 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
W20260709 13:20:59.946241  6770 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:59.950179  6695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 100771us
I20260709 13:20:59.958709  6872 raft_consensus.cc:515] T a1704639a875409b9959353527b3fd68 P cd75a17ab2604397adab03bb8b5fd75c [term 18 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:20:59.966866  6695 leader_election.cc:304] T e77e330a82df4b43a745d57a68f6f057 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:20:59.966976  6725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3f13b31a1f84f0d89d007eadd57924c" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:59.953768 12345 raft_consensus.cc:2804] T bb3d8792045a4583ae2e965b1350a5b4 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:20:59.954312  6730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de3186201e1a40d0b335eeb8b4e256e0" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:59.955132  6805 raft_consensus.cc:1240] T bb7fa124c3bf4ef9ab65a407cb008441 P b7ab4784c7344b939bc36f639286f377 [term 17 FOLLOWER]: Rejecting Update request from peer 7ba59cc884714e8aa5f3f0ecaed84cbb for earlier term 16. Current term is 17. Ops: []
I20260709 13:20:59.955133 12890 raft_consensus.cc:3060] T 7c37d41cd9164c15a6826ca62a851a69 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:59.954221  6726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8292e16e5654be6bc408560cf256aaa" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:59.960712  6798 raft_consensus.cc:2468] T de3186201e1a40d0b335eeb8b4e256e0 P b7ab4784c7344b939bc36f639286f377 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 16.
I20260709 13:20:59.962217  6873 raft_consensus.cc:2468] T 4d9def8b32fd443aa94ab1420b06837b P cd75a17ab2604397adab03bb8b5fd75c [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 17.
I20260709 13:20:59.953051  6727 raft_consensus.cc:2468] T f4b8bd455d5a47c18a1380839c6e0d61 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 18.
I20260709 13:20:59.953511 12767 raft_consensus.cc:2804] T be1a92657f494cac8dd227d152f50151 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:20:59.968461  6772 leader_election.cc:304] T bb7fa124c3bf4ef9ab65a407cb008441 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:20:59.916813 12662 leader_election.cc:290] T 7ba5dac66ab5497e9e336f2a3c28cda5 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
W20260709 13:20:59.959928 12555 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.022s	user 0.007s	sys 0.005s
I20260709 13:20:59.975090  6728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbdf895bba214ff68685a24fd17dfb5d" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:20:59.969439  6804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20f6842e26174571996b8dea4151d4be" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:20:59.979393  6800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be1a92657f494cac8dd227d152f50151" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 19 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:20:59.951705 12895 raft_consensus.cc:493] T 17587d6730594da4a56fa13a353232a1 P b7ab4784c7344b939bc36f639286f377 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:00.018167  6732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30e88460611e47b2ba16a46a30b5f416" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:21:00.014355  6697 leader_election.cc:304] T 3fa34c08b205435dba97346991aa1f92 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, cd75a17ab2604397adab03bb8b5fd75c
W20260709 13:21:00.016686 12561 consensus_meta.cc:287] T 34f36d59d88f40fe8a2805e604fc6c0a P cd75a17ab2604397adab03bb8b5fd75c: Time spent flushing consensus metadata: real 0.551s	user 0.013s	sys 0.000s
I20260709 13:20:59.981138 12863 raft_consensus.cc:2749] T e77e330a82df4b43a745d57a68f6f057 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:21:00.013635  6872 leader_election.cc:290] T a1704639a875409b9959353527b3fd68 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 18 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:21:00.028568 12594 raft_consensus.cc:2749] T 3fa34c08b205435dba97346991aa1f92 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:21:00.028715  6729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d65025eea89441290d85dd053810e31" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:21:00.029048  7495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce4f062dcd314d43a63ca74067cb5ee3" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:21:00.028761  6879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce4f062dcd314d43a63ca74067cb5ee3" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:21:00.030889  6879 raft_consensus.cc:2468] T ce4f062dcd314d43a63ca74067cb5ee3 P cd75a17ab2604397adab03bb8b5fd75c [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 15.
I20260709 13:21:00.032228  6879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f58dc08b12a2494bb9a1372837970ca2" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
W20260709 13:21:00.032632  6772 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 64270.5us
I20260709 13:21:00.033423  6879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "713b5728a197487c9300b310ab94e5a3" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:21:00.033774 12849 raft_consensus.cc:2749] T bb7fa124c3bf4ef9ab65a407cb008441 P b7ab4784c7344b939bc36f639286f377 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:21:00.034442  6772 leader_election.cc:304] T 4d9def8b32fd443aa94ab1420b06837b P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:20:59.982137  6844 leader_election.cc:304] T bb3d8792045a4583ae2e965b1350a5b4 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:21:00.026664  6804 raft_consensus.cc:2468] T 20f6842e26174571996b8dea4151d4be P b7ab4784c7344b939bc36f639286f377 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 17.
I20260709 13:21:00.037189  6879 raft_consensus.cc:2468] T 713b5728a197487c9300b310ab94e5a3 P cd75a17ab2604397adab03bb8b5fd75c [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 14.
W20260709 13:21:00.028415 12555 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.095s	user 0.019s	sys 0.023s
I20260709 13:20:59.978897 12811 raft_consensus.cc:2804] T 44bde925b2e541b69890d70715b85176 P b7ab4784c7344b939bc36f639286f377 [term 17 FOLLOWER]: Leader pre-election won for term 18
W20260709 13:21:00.054869  6770 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 50809us
I20260709 13:21:00.035849 12849 raft_consensus.cc:2804] T 4d9def8b32fd443aa94ab1420b06837b P b7ab4784c7344b939bc36f639286f377 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:21:00.058933  6728 raft_consensus.cc:2393] T dbdf895bba214ff68685a24fd17dfb5d P ccd8a4c3bfe3413cb2ae219b09aea832 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7ab4784c7344b939bc36f639286f377 in current term 16: Already voted for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in this term.
I20260709 13:21:00.059957  6873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b8cacb381b746da8d0049b0a83b41dd" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:21:00.015478 12345 raft_consensus.cc:697] T bb3d8792045a4583ae2e965b1350a5b4 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 16 LEADER]: Becoming Leader. State: Replica: 7ba59cc884714e8aa5f3f0ecaed84cbb, State: Running, Role: LEADER
I20260709 13:21:00.060060  6880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "853ac0a8cbd64ce99457f170216d4d0f" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:20:59.982054 12704 leader_election.cc:290] T 2c240553ce044eedb41541d72b9475d7 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:21:00.015724 12767 raft_consensus.cc:697] T be1a92657f494cac8dd227d152f50151 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 19 LEADER]: Becoming Leader. State: Replica: 7ba59cc884714e8aa5f3f0ecaed84cbb, State: Running, Role: LEADER
I20260709 13:21:00.063624  6873 raft_consensus.cc:2376] T 4b8cacb381b746da8d0049b0a83b41dd P cd75a17ab2604397adab03bb8b5fd75c [term 18 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 18. Re-sending same reply.
I20260709 13:21:00.069801  6879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a92dd554674067a83a9cb68c4773f2" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:21:00.073423  6879 raft_consensus.cc:3060] T 07a92dd554674067a83a9cb68c4773f2 P cd75a17ab2604397adab03bb8b5fd75c [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:21:00.069700  6874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c240553ce044eedb41541d72b9475d7" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:21:00.066991  6695 leader_election.cc:304] T 8c7f33e544204fbaac4078e3e83bbf4e P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:21:00.072192  6801 raft_consensus.cc:606] T c4db81d9d329422bb3b4160ca4ac2d1d P b7ab4784c7344b939bc36f639286f377 [term 17 LEADER]: Received request to transfer leadership to TS cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:21:00.061935 12811 raft_consensus.cc:493] T 44bde925b2e541b69890d70715b85176 P b7ab4784c7344b939bc36f639286f377 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:00.078773 12811 raft_consensus.cc:3060] T 44bde925b2e541b69890d70715b85176 P b7ab4784c7344b939bc36f639286f377 [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:21:00.084533  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 102521us
I20260709 13:21:00.088347  6695 leader_election.cc:304] T 9b3759de40694069b13c0f8bd40e5709 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:21:00.065428 12863 raft_consensus.cc:493] T 3a485a995abc4807b6e511e45419f737 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:00.095563 12837 raft_consensus.cc:493] T 3fa34c08b205435dba97346991aa1f92 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 20 FOLLOWER]: Starting leader election (detected failure of leader cd75a17ab2604397adab03bb8b5fd75c)
I20260709 13:21:00.096441 12837 raft_consensus.cc:3060] T 3fa34c08b205435dba97346991aa1f92 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:21:00.096794  6725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c44c4849aa54f2b94d1f1bef9ed546f" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:21:00.077414 12662 raft_consensus.cc:2749] T bb3d8792045a4583ae2e965b1350a5b4 P cd75a17ab2604397adab03bb8b5fd75c [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:21:00.101281 12566 raft_consensus.cc:493] T 9b3759de40694069b13c0f8bd40e5709 P b7ab4784c7344b939bc36f639286f377 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:00.102066 12566 raft_consensus.cc:515] T 9b3759de40694069b13c0f8bd40e5709 P b7ab4784c7344b939bc36f639286f377 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:00.104310 12888 raft_consensus.cc:515] T 7887766dc6784fcaa42b35c05fea7a99 P b7ab4784c7344b939bc36f639286f377 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:00.105545  6844 leader_election.cc:304] T 427c124d773f483294511e80fe340075 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb
I20260709 13:21:00.106664 12834 consensus_queue.cc:1059] T dbdf895bba214ff68685a24fd17dfb5d P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: INVALID_TERM, Last received: 14.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:21:00.107329  6844 leader_election.cc:304] T 1bf4668eeb70467fb3dc5a0289233b3c P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:21:00.107583 12834 raft_consensus.cc:2764] T 427c124d773f483294511e80fe340075 P cd75a17ab2604397adab03bb8b5fd75c [term 16 FOLLOWER]: Leader pre-election decision vote started in defunct term 15: won
I20260709 13:21:00.106688 12888 leader_election.cc:290] T 7887766dc6784fcaa42b35c05fea7a99 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 19 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:21:00.095619 12863 raft_consensus.cc:515] T 3a485a995abc4807b6e511e45419f737 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:00.112874 12691 raft_consensus.cc:3055] T 4275cf08e63345f993bce8664eada830 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:21:00.113416 12691 raft_consensus.cc:740] T 4275cf08e63345f993bce8664eada830 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
I20260709 13:21:00.114675 12691 consensus_queue.cc:260] T 4275cf08e63345f993bce8664eada830 P ccd8a4c3bfe3413cb2ae219b09aea832 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:00.121060  6879 raft_consensus.cc:2468] T 07a92dd554674067a83a9cb68c4773f2 P cd75a17ab2604397adab03bb8b5fd75c [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 16.
I20260709 13:21:00.087282 12849 raft_consensus.cc:697] T 4d9def8b32fd443aa94ab1420b06837b P b7ab4784c7344b939bc36f639286f377 [term 17 LEADER]: Becoming Leader. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
I20260709 13:21:00.123955 12849 consensus_queue.cc:237] T 4d9def8b32fd443aa94ab1420b06837b P b7ab4784c7344b939bc36f639286f377 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:00.127998  6846 leader_election.cc:304] T 4f00a2e87e56452083b759f60d461ee3 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:21:00.036954 12895 raft_consensus.cc:515] T 17587d6730594da4a56fa13a353232a1 P b7ab4784c7344b939bc36f639286f377 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:21:00.134001 12895 leader_election.cc:290] T 17587d6730594da4a56fa13a353232a1 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
W20260709 13:21:00.141212  6697 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 68662.8us
W20260709 13:21:00.144958  6696 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:21:00.145386  6728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3411566abe2d4c9bb4b2adfdd05e6f17" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:21:00.146287  6728 raft_consensus.cc:2468] T 3411566abe2d4c9bb4b2adfdd05e6f17 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 15.
I20260709 13:21:00.148684  6725 raft_consensus.cc:1275] T 3a485a995abc4807b6e511e45419f737 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 17 FOLLOWER]: Refusing update from remote peer b7ab4784c7344b939bc36f639286f377: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
W20260709 13:21:00.160292  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 53058.5us
I20260709 13:21:00.161310  6844 leader_election.cc:304] T 7c44c4849aa54f2b94d1f1bef9ed546f P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:21:00.161551  6770 leader_election.cc:304] T 1528ab62b6fe4e3099d08f141afee116 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
I20260709 13:21:00.161679  6873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbdf895bba214ff68685a24fd17dfb5d" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:21:00.150267  6877 raft_consensus.cc:2468] T f4b8bd455d5a47c18a1380839c6e0d61 P cd75a17ab2604397adab03bb8b5fd75c [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 18.
I20260709 13:21:00.170713  6697 leader_election.cc:304] T 713b5728a197487c9300b310ab94e5a3 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:21:00.094187 12704 raft_consensus.cc:2749] T 8c7f33e544204fbaac4078e3e83bbf4e P ccd8a4c3bfe3413cb2ae219b09aea832 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:21:00.179558  6880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8292e16e5654be6bc408560cf256aaa" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:21:00.175951 12840 raft_consensus.cc:2749] T 7c44c4849aa54f2b94d1f1bef9ed546f P cd75a17ab2604397adab03bb8b5fd75c [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:21:00.180850  6881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d65025eea89441290d85dd053810e31" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
W20260709 13:21:00.181614  6695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 93335.6us
I20260709 13:21:00.111701 12767 consensus_queue.cc:237] T be1a92657f494cac8dd227d152f50151 P 7ba59cc884714e8aa5f3f0ecaed84cbb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 14, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:21:00.110625 12863 leader_election.cc:290] T 3a485a995abc4807b6e511e45419f737 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:21:00.190683  6881 raft_consensus.cc:3060] T 3d65025eea89441290d85dd053810e31 P cd75a17ab2604397adab03bb8b5fd75c [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:21:00.190804  6695 leader_election.cc:304] T dbdf895bba214ff68685a24fd17dfb5d P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:21:00.191632  6873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de3186201e1a40d0b335eeb8b4e256e0" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:21:00.192719  6873 raft_consensus.cc:2468] T de3186201e1a40d0b335eeb8b4e256e0 P cd75a17ab2604397adab03bb8b5fd75c [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 16.
I20260709 13:21:00.094094 12561 consensus_queue.cc:1059] T 95a75bfe094d4bdc963aba3f08dfcd25 P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: INVALID_TERM, Last received: 13.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.085s
I20260709 13:21:00.175259  6877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30e88460611e47b2ba16a46a30b5f416" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:21:00.193419  6770 leader_election.cc:304] T b56bf91d90824c959e21e0cee5ba1816 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:21:00.149205 12741 raft_consensus.cc:3055] T dbdf895bba214ff68685a24fd17dfb5d P cd75a17ab2604397adab03bb8b5fd75c [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:21:00.175776 12543 raft_consensus.cc:2804] T 4f00a2e87e56452083b759f60d461ee3 P cd75a17ab2604397adab03bb8b5fd75c [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:21:00.150123 12871 consensus_queue.cc:1048] T 07a92dd554674067a83a9cb68c4773f2 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.042s
I20260709 13:21:00.189253 12832 raft_consensus.cc:1064] T 95a75bfe094d4bdc963aba3f08dfcd25 P cd75a17ab2604397adab03bb8b5fd75c: attempting to promote NON_VOTER 7ba59cc884714e8aa5f3f0ecaed84cbb to VOTER
I20260709 13:21:00.182996 12594 raft_consensus.cc:2804] T 9b3759de40694069b13c0f8bd40e5709 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:21:00.211550  6877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3411566abe2d4c9bb4b2adfdd05e6f17" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:21:00.206506  6728 raft_consensus.cc:1275] T 90d42e216d9741e190bca19a781291fd P ccd8a4c3bfe3413cb2ae219b09aea832 [term 18 FOLLOWER]: Refusing update from remote peer b7ab4784c7344b939bc36f639286f377: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
I20260709 13:21:00.201483  6770 leader_election.cc:304] T f4b8bd455d5a47c18a1380839c6e0d61 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
I20260709 13:21:00.207044  6844 leader_election.cc:304] T f03d0dbf16864ca4bc1bb5e4c0334c0f P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:21:00.148635 12662 raft_consensus.cc:2749] T 1bf4668eeb70467fb3dc5a0289233b3c P cd75a17ab2604397adab03bb8b5fd75c [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:21:00.209152  6880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c44c4849aa54f2b94d1f1bef9ed546f" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:21:00.176981 12657 consensus_queue.cc:1059] T be1a92657f494cac8dd227d152f50151 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: INVALID_TERM, Last received: 16.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.031s
I20260709 13:21:00.213392  6731 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49998 (request call id 1469) took 1158 ms. Trace:
I20260709 13:21:00.216413  6873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7887766dc6784fcaa42b35c05fea7a99" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:21:00.192655 12625 raft_consensus.cc:2804] T 713b5728a197487c9300b310ab94e5a3 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:21:00.227440  6772 leader_election.cc:304] T de3186201e1a40d0b335eeb8b4e256e0 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:21:00.215703  6697 leader_election.cc:304] T 07a92dd554674067a83a9cb68c4773f2 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:21:00.224992  6731 rpcz_store.cc:276] 0709 13:20:59.055308 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:59.056510 (+  1202us) service_pool.cc:224] Handling call
0709 13:21:00.210764 (+1154254us) spinlock_profiling.cc:243] Waited 350 ms on lock 0x7b5400058a54. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f9ae2fa 00007fcc1496fb17 00007fcc0deea6d4 00007fcc0deea662 00007fcc0deea591 00007fcc0deea50c 00007fcc0dee97c2 00007fcc0dce548c 00007fcc0dce48c6 00007fcc0dce426f
0709 13:21:00.213320 (+  2556us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":806084992}
I20260709 13:21:00.201817 12741 raft_consensus.cc:740] T dbdf895bba214ff68685a24fd17dfb5d P cd75a17ab2604397adab03bb8b5fd75c [term 15 LEADER]: Becoming Follower/Learner. State: Replica: cd75a17ab2604397adab03bb8b5fd75c, State: Running, Role: LEADER
I20260709 13:21:00.205222 12906 raft_consensus.cc:2749] T dbdf895bba214ff68685a24fd17dfb5d P ccd8a4c3bfe3413cb2ae219b09aea832 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:21:00.237210  6873 raft_consensus.cc:1275] T 3a485a995abc4807b6e511e45419f737 P cd75a17ab2604397adab03bb8b5fd75c [term 17 FOLLOWER]: Refusing update from remote peer b7ab4784c7344b939bc36f639286f377: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 13:21:00.236312  6770 leader_election.cc:304] T dbdf895bba214ff68685a24fd17dfb5d P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:21:00.205654 12663 raft_consensus.cc:493] T 4275cf08e63345f993bce8664eada830 P cd75a17ab2604397adab03bb8b5fd75c [term 14 FOLLOWER]: Starting pre-election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:21:00.239475  6772 leader_election.cc:304] T 30e88460611e47b2ba16a46a30b5f416 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:21:00.207789 12543 raft_consensus.cc:493] T 4f00a2e87e56452083b759f60d461ee3 P cd75a17ab2604397adab03bb8b5fd75c [term 18 FOLLOWER]: Starting leader election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:21:00.144734 12345 consensus_queue.cc:237] T bb3d8792045a4583ae2e965b1350a5b4 P 7ba59cc884714e8aa5f3f0ecaed84cbb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:21:00.210471 12893 raft_consensus.cc:2749] T b56bf91d90824c959e21e0cee5ba1816 P b7ab4784c7344b939bc36f639286f377 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:21:00.253849  7468 leader_election.cc:336] T 427c124d773f483294511e80fe340075 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931): Timed out: RequestConsensusVote RPC to 127.5.126.67:42931 timed out after 1.738s (SENT)
I20260709 13:21:00.255443  6772 leader_election.cc:304] T d8292e16e5654be6bc408560cf256aaa P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
W20260709 13:21:00.258692  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 60460.5us
I20260709 13:21:00.259492  6844 leader_election.cc:304] T 7887766dc6784fcaa42b35c05fea7a99 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:21:00.232334 12625 raft_consensus.cc:493] T 713b5728a197487c9300b310ab94e5a3 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 14 FOLLOWER]: Starting leader election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:21:00.262666  6877 raft_consensus.cc:1240] T 07a92dd554674067a83a9cb68c4773f2 P cd75a17ab2604397adab03bb8b5fd75c [term 16 FOLLOWER]: Rejecting Update request from peer b7ab4784c7344b939bc36f639286f377 for earlier term 15. Current term is 16. Ops: [15.9-15.9]
I20260709 13:21:00.241585 12881 raft_consensus.cc:2749] T f03d0dbf16864ca4bc1bb5e4c0334c0f P cd75a17ab2604397adab03bb8b5fd75c [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:21:00.244737 12787 raft_consensus.cc:2804] T 1528ab62b6fe4e3099d08f141afee116 P b7ab4784c7344b939bc36f639286f377 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:21:00.247241 12478 raft_consensus.cc:2804] T de3186201e1a40d0b335eeb8b4e256e0 P b7ab4784c7344b939bc36f639286f377 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:21:00.267508  6772 leader_election.cc:304] T 7c44c4849aa54f2b94d1f1bef9ed546f P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:21:00.248238 12543 raft_consensus.cc:3060] T 4f00a2e87e56452083b759f60d461ee3 P cd75a17ab2604397adab03bb8b5fd75c [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:21:00.265184 12730 raft_consensus.cc:3060] T dbdf895bba214ff68685a24fd17dfb5d P b7ab4784c7344b939bc36f639286f377 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:21:00.276890 12714 raft_consensus.cc:493] T 95a75bfe094d4bdc963aba3f08dfcd25 P b7ab4784c7344b939bc36f639286f377 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader cd75a17ab2604397adab03bb8b5fd75c)
I20260709 13:21:00.240623 12685 raft_consensus.cc:2804] T f4b8bd455d5a47c18a1380839c6e0d61 P b7ab4784c7344b939bc36f639286f377 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:21:00.280417 12685 raft_consensus.cc:697] T f4b8bd455d5a47c18a1380839c6e0d61 P b7ab4784c7344b939bc36f639286f377 [term 18 LEADER]: Becoming Leader. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
I20260709 13:21:00.277554 12714 raft_consensus.cc:515] T 95a75bfe094d4bdc963aba3f08dfcd25 P b7ab4784c7344b939bc36f639286f377 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } attrs { replace: true } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: NON_VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: true } }
I20260709 13:21:00.281497 12685 consensus_queue.cc:237] T f4b8bd455d5a47c18a1380839c6e0d61 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 16.8, Last appended by leader: 8, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:00.282666 12714 leader_election.cc:290] T 95a75bfe094d4bdc963aba3f08dfcd25 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:21:00.248615 12594 raft_consensus.cc:697] T 9b3759de40694069b13c0f8bd40e5709 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 14 LEADER]: Becoming Leader. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
I20260709 13:21:00.284543 12898 raft_consensus.cc:2749] T 7c44c4849aa54f2b94d1f1bef9ed546f P b7ab4784c7344b939bc36f639286f377 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:21:00.284581 12895 consensus_queue.cc:1048] T 3a485a995abc4807b6e511e45419f737 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:21:00.284847 12594 consensus_queue.cc:237] T 9b3759de40694069b13c0f8bd40e5709 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:00.240617 12863 consensus_queue.cc:1048] T 44bde925b2e541b69890d70715b85176 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.031s
I20260709 13:21:00.291868 12673 leader_election.cc:290] T be1a92657f494cac8dd227d152f50151 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 19 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:21:00.292689 12543 raft_consensus.cc:515] T 4f00a2e87e56452083b759f60d461ee3 P cd75a17ab2604397adab03bb8b5fd75c [term 19 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:21:00.254827 12566 leader_election.cc:290] T 9b3759de40694069b13c0f8bd40e5709 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:21:00.295243 12543 leader_election.cc:290] T 4f00a2e87e56452083b759f60d461ee3 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 19 election: Requested vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:21:00.298125 12837 raft_consensus.cc:515] T 3fa34c08b205435dba97346991aa1f92 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:21:00.245874 12905 raft_consensus.cc:2804] T 07a92dd554674067a83a9cb68c4773f2 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:21:00.302887 12905 raft_consensus.cc:697] T 07a92dd554674067a83a9cb68c4773f2 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 16 LEADER]: Becoming Leader. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
I20260709 13:21:00.264993 12625 raft_consensus.cc:3060] T 713b5728a197487c9300b310ab94e5a3 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:21:00.304358  6770 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:21:00.261698 12657 raft_consensus.cc:2749] T 30e88460611e47b2ba16a46a30b5f416 P b7ab4784c7344b939bc36f639286f377 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:21:00.247670 12663 raft_consensus.cc:515] T 4275cf08e63345f993bce8664eada830 P cd75a17ab2604397adab03bb8b5fd75c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:00.320506 12741 consensus_queue.cc:260] T dbdf895bba214ff68685a24fd17dfb5d P cd75a17ab2604397adab03bb8b5fd75c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 15.7, Last appended by leader: 7, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:00.323225  6726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fa34c08b205435dba97346991aa1f92" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:21:00.334108  6726 raft_consensus.cc:3060] T 3fa34c08b205435dba97346991aa1f92 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:21:00.269714 12662 raft_consensus.cc:2749] T 7887766dc6784fcaa42b35c05fea7a99 P cd75a17ab2604397adab03bb8b5fd75c [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:21:00.272064  6844 leader_election.cc:304] T 3a485a995abc4807b6e511e45419f737 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:21:00.331890  6881 raft_consensus.cc:2468] T 3d65025eea89441290d85dd053810e31 P cd75a17ab2604397adab03bb8b5fd75c [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 18.
I20260709 13:21:00.266166 12868 raft_consensus.cc:2749] T d8292e16e5654be6bc408560cf256aaa P b7ab4784c7344b939bc36f639286f377 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:21:00.358580  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 86619.7us
I20260709 13:21:00.350190  6881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b3759de40694069b13c0f8bd40e5709" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:21:00.363662  6875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a75bfe094d4bdc963aba3f08dfcd25" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:21:00.325244 12478 raft_consensus.cc:493] T de3186201e1a40d0b335eeb8b4e256e0 P b7ab4784c7344b939bc36f639286f377 [term 16 FOLLOWER]: Starting leader election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
W20260709 13:21:00.347954 12915 log.cc:927] Time spent T 4f00a2e87e56452083b759f60d461ee3 P cd75a17ab2604397adab03bb8b5fd75c: Append to log took a long time: real 0.154s	user 0.004s	sys 0.000s
I20260709 13:21:00.372089  6881 raft_consensus.cc:2468] T 9b3759de40694069b13c0f8bd40e5709 P cd75a17ab2604397adab03bb8b5fd75c [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 14.
I20260709 13:21:00.371341  6726 raft_consensus.cc:2468] T 3fa34c08b205435dba97346991aa1f92 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in term 21.
W20260709 13:21:00.375828  6695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 128431us
W20260709 13:21:00.362035 12921 log.cc:927] Time spent T 4f00a2e87e56452083b759f60d461ee3 P b7ab4784c7344b939bc36f639286f377: Append to log took a long time: real 0.091s	user 0.000s	sys 0.004s
I20260709 13:21:00.378823  7466 leader_election.cc:304] T 3fa34c08b205435dba97346991aa1f92 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
I20260709 13:21:00.384625  6803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a92dd554674067a83a9cb68c4773f2" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:21:00.383262  6726 raft_consensus.cc:1275] T fe20b4b48823486ca3b9c648db6ce8aa P ccd8a4c3bfe3413cb2ae219b09aea832 [term 14 FOLLOWER]: Refusing update from remote peer 7ba59cc884714e8aa5f3f0ecaed84cbb: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:21:00.372844 12741 raft_consensus.cc:3060] T dbdf895bba214ff68685a24fd17dfb5d P cd75a17ab2604397adab03bb8b5fd75c [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:21:00.375913 12478 raft_consensus.cc:3060] T de3186201e1a40d0b335eeb8b4e256e0 P b7ab4784c7344b939bc36f639286f377 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:21:00.364221 12881 raft_consensus.cc:2749] T 3a485a995abc4807b6e511e45419f737 P cd75a17ab2604397adab03bb8b5fd75c [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:21:00.418094  6805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f03d0dbf16864ca4bc1bb5e4c0334c0f" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 18 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:21:00.422279  6805 raft_consensus.cc:2410] T f03d0dbf16864ca4bc1bb5e4c0334c0f P b7ab4784c7344b939bc36f639286f377 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate ccd8a4c3bfe3413cb2ae219b09aea832 for term 18 because replica has last-logged OpId of term: 17 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 8.
I20260709 13:21:00.422572  6798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a734b5ab7834e05a8c422208acc58b1" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 18 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:21:00.423652  6798 raft_consensus.cc:2410] T 7a734b5ab7834e05a8c422208acc58b1 P b7ab4784c7344b939bc36f639286f377 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate ccd8a4c3bfe3413cb2ae219b09aea832 for term 18 because replica has last-logged OpId of term: 17 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 8.
I20260709 13:21:00.376466 12837 leader_election.cc:290] T 3fa34c08b205435dba97346991aa1f92 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 21 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:21:00.427917  6881 raft_consensus.cc:1275] T c4db81d9d329422bb3b4160ca4ac2d1d P cd75a17ab2604397adab03bb8b5fd75c [term 17 FOLLOWER]: Refusing update from remote peer b7ab4784c7344b939bc36f639286f377: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 13:21:00.426172  6807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d33d5ee8ef6f415593d8df52063161ad" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:21:00.433902  6878 raft_consensus.cc:1240] T a1704639a875409b9959353527b3fd68 P cd75a17ab2604397adab03bb8b5fd75c [term 18 FOLLOWER]: Rejecting Update request from peer b7ab4784c7344b939bc36f639286f377 for earlier term 17. Current term is 18. Ops: []
I20260709 13:21:00.391799 12673 raft_consensus.cc:2804] T 3fa34c08b205435dba97346991aa1f92 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:21:00.445894 12698 raft_consensus.cc:3055] T be1a92657f494cac8dd227d152f50151 P b7ab4784c7344b939bc36f639286f377 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:21:00.446638 12698 raft_consensus.cc:740] T be1a92657f494cac8dd227d152f50151 P b7ab4784c7344b939bc36f639286f377 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
I20260709 13:21:00.460289  6874 raft_consensus.cc:1240] T 4f00a2e87e56452083b759f60d461ee3 P cd75a17ab2604397adab03bb8b5fd75c [term 19 FOLLOWER]: Rejecting Update request from peer b7ab4784c7344b939bc36f639286f377 for earlier term 18. Current term is 19. Ops: []
I20260709 13:21:00.472585 12787 raft_consensus.cc:493] T 1528ab62b6fe4e3099d08f141afee116 P b7ab4784c7344b939bc36f639286f377 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 7ba59cc884714e8aa5f3f0ecaed84cbb)
I20260709 13:21:00.473385 12787 raft_consensus.cc:3060] T 1528ab62b6fe4e3099d08f141afee116 P b7ab4784c7344b939bc36f639286f377 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:21:00.476537  6875 raft_consensus.cc:3055] T 90d42e216d9741e190bca19a781291fd P cd75a17ab2604397adab03bb8b5fd75c [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:21:00.477131  6875 raft_consensus.cc:740] T 90d42e216d9741e190bca19a781291fd P cd75a17ab2604397adab03bb8b5fd75c [term 17 LEADER]: Becoming Follower/Learner. State: Replica: cd75a17ab2604397adab03bb8b5fd75c, State: Running, Role: LEADER
I20260709 13:21:00.478147  6875 consensus_queue.cc:260] T 90d42e216d9741e190bca19a781291fd P cd75a17ab2604397adab03bb8b5fd75c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 17.10, Last appended by leader: 10, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:00.453250 12891 raft_consensus.cc:493] T a1704639a875409b9959353527b3fd68 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:21:00.487057 12891 raft_consensus.cc:515] T a1704639a875409b9959353527b3fd68 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:00.464489 12673 raft_consensus.cc:697] T 3fa34c08b205435dba97346991aa1f92 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 21 LEADER]: Becoming Leader. State: Replica: 7ba59cc884714e8aa5f3f0ecaed84cbb, State: Running, Role: LEADER
I20260709 13:21:00.502314 12673 consensus_queue.cc:237] T 3fa34c08b205435dba97346991aa1f92 P 7ba59cc884714e8aa5f3f0ecaed84cbb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 20.15, Last appended by leader: 15, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
W20260709 13:21:00.508518  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 147695us
I20260709 13:21:00.509629  6844 leader_election.cc:304] T 4d9def8b32fd443aa94ab1420b06837b P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:21:00.512023  6807 raft_consensus.cc:2468] T d33d5ee8ef6f415593d8df52063161ad P b7ab4784c7344b939bc36f639286f377 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 15.
I20260709 13:21:00.513818  7503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3f13b31a1f84f0d89d007eadd57924c" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:21:00.518827  6875 raft_consensus.cc:3060] T 90d42e216d9741e190bca19a781291fd P cd75a17ab2604397adab03bb8b5fd75c [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:21:00.439608 12802 consensus_queue.cc:1048] T fe20b4b48823486ca3b9c648db6ce8aa P 7ba59cc884714e8aa5f3f0ecaed84cbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.059s
I20260709 13:21:00.528697  7500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17587d6730594da4a56fa13a353232a1" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:21:00.529418  7500 raft_consensus.cc:2468] T 17587d6730594da4a56fa13a353232a1 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 22.
I20260709 13:21:00.528425 12927 raft_consensus.cc:493] T f5be3a11b23d4ea9b08300a2789821c7 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:00.530622 12927 raft_consensus.cc:515] T f5be3a11b23d4ea9b08300a2789821c7 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:00.532869 12927 leader_election.cc:290] T f5be3a11b23d4ea9b08300a2789821c7 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:21:00.511445 12631 raft_consensus.cc:493] T 7ba5dac66ab5497e9e336f2a3c28cda5 P b7ab4784c7344b939bc36f639286f377 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 7ba59cc884714e8aa5f3f0ecaed84cbb)
I20260709 13:21:00.447901 12698 consensus_queue.cc:260] T be1a92657f494cac8dd227d152f50151 P b7ab4784c7344b939bc36f639286f377 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.14, Last appended by leader: 14, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:21:00.558662 12698 raft_consensus.cc:3060] T be1a92657f494cac8dd227d152f50151 P b7ab4784c7344b939bc36f639286f377 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:21:00.558310 12631 raft_consensus.cc:515] T 7ba5dac66ab5497e9e336f2a3c28cda5 P b7ab4784c7344b939bc36f639286f377 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:21:00.561443 12631 leader_election.cc:290] T 7ba5dac66ab5497e9e336f2a3c28cda5 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:21:00.538152  6844 leader_election.cc:304] T 4b8cacb381b746da8d0049b0a83b41dd P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:21:00.566939 12662 raft_consensus.cc:2749] T 4b8cacb381b746da8d0049b0a83b41dd P cd75a17ab2604397adab03bb8b5fd75c [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:21:00.566340 12625 raft_consensus.cc:515] T 713b5728a197487c9300b310ab94e5a3 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:00.527712 12663 leader_election.cc:290] T 4275cf08e63345f993bce8664eada830 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
W20260709 13:21:00.542183 12890 consensus_meta.cc:287] T 7c37d41cd9164c15a6826ca62a851a69 P ccd8a4c3bfe3413cb2ae219b09aea832: Time spent flushing consensus metadata: real 0.561s	user 0.008s	sys 0.003s
I20260709 13:21:00.557567 12865 leader_election.cc:290] T ce4f062dcd314d43a63ca74067cb5ee3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:21:00.571448  6807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22ccee1b570c4ad3a57bd7aec085b1b4" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:21:00.573945 12891 leader_election.cc:290] T a1704639a875409b9959353527b3fd68 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:21:00.574226  6807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ba5dac66ab5497e9e336f2a3c28cda5" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:21:00.574985  6807 raft_consensus.cc:2468] T 7ba5dac66ab5497e9e336f2a3c28cda5 P b7ab4784c7344b939bc36f639286f377 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 17.
I20260709 13:21:00.578997  6807 raft_consensus.cc:1275] T f3f9c2e2bf644115957398fe4c9459db P b7ab4784c7344b939bc36f639286f377 [term 17 FOLLOWER]: Refusing update from remote peer cd75a17ab2604397adab03bb8b5fd75c: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:21:00.581729  6807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4b8bd455d5a47c18a1380839c6e0d61" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:21:00.589987  6728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22ccee1b570c4ad3a57bd7aec085b1b4" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:21:00.590485  6805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b3759de40694069b13c0f8bd40e5709" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:21:00.591254  6805 raft_consensus.cc:2468] T 9b3759de40694069b13c0f8bd40e5709 P b7ab4784c7344b939bc36f639286f377 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 14.
I20260709 13:21:00.591465  6728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b3759de40694069b13c0f8bd40e5709" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:21:00.594468  6805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c240553ce044eedb41541d72b9475d7" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:21:00.595772  6802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "713b5728a197487c9300b310ab94e5a3" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:21:00.597249  6798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f00a2e87e56452083b759f60d461ee3" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:21:00.599407  6803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4db81d9d329422bb3b4160ca4ac2d1d" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:21:00.470175 12905 consensus_queue.cc:237] T 07a92dd554674067a83a9cb68c4773f2 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:00.610553  6844 leader_election.cc:304] T bd6869f07b5a4885a0b99fbe60c3b175 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:21:00.614174 12704 raft_consensus.cc:493] T ab432e62819d499eaaf3dd55481dd930 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:00.621065  6730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4b8bd455d5a47c18a1380839c6e0d61" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:21:00.656862  6730 raft_consensus.cc:2393] T f4b8bd455d5a47c18a1380839c6e0d61 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c in current term 18: Already voted for candidate b7ab4784c7344b939bc36f639286f377 in this term.
I20260709 13:21:00.623169  6729 raft_consensus.cc:1275] T 427c124d773f483294511e80fe340075 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 16 FOLLOWER]: Refusing update from remote peer 7ba59cc884714e8aa5f3f0ecaed84cbb: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:21:00.627509 12886 leader_election.cc:290] T 22ccee1b570c4ad3a57bd7aec085b1b4 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:21:00.629330  6727 raft_consensus.cc:1275] T 3411566abe2d4c9bb4b2adfdd05e6f17 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 15 FOLLOWER]: Refusing update from remote peer cd75a17ab2604397adab03bb8b5fd75c: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:21:00.526768 12543 raft_consensus.cc:2764] T 4d9def8b32fd443aa94ab1420b06837b P cd75a17ab2604397adab03bb8b5fd75c [term 17 FOLLOWER]: Leader pre-election decision vote started in defunct term 15: won
I20260709 13:21:00.639379 12865 consensus_queue.cc:1059] T bb7fa124c3bf4ef9ab65a407cb008441 P 7ba59cc884714e8aa5f3f0ecaed84cbb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: INVALID_TERM, Last received: 16.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:21:00.643920  6732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c240553ce044eedb41541d72b9475d7" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:21:00.648864  6725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "713b5728a197487c9300b310ab94e5a3" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:21:00.619815  6799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c7f33e544204fbaac4078e3e83bbf4e" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
W20260709 13:21:00.659861  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 49410.9us
I20260709 13:21:00.670509  6844 leader_election.cc:304] T ab432e62819d499eaaf3dd55481dd930 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:21:00.665004  6801 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:38240 (request call id 24) took 2144 ms. Trace:
I20260709 13:21:00.671693  6801 rpcz_store.cc:276] 0709 13:20:58.508478 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:58.508668 (+   190us) service_pool.cc:224] Handling call
0709 13:21:00.635097 (+2126429us) spinlock_profiling.cc:243] Waited 11.2 ms on lock 0x7b5400318920. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f927520 00007fcc0f9a4652 00007fcc1497260a 00007fcc0def87d4 00007fcc0def8762 00007fcc0def8691 00007fcc0def860c 00007fcc0def78c2 00007fcc0dce548c 00007fcc0dce48c6
0709 13:21:00.652871 (+ 17774us) spinlock_profiling.cc:243] Waited 1.56 s on lock 0x7b54002da854. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f9a4853 00007fcc1497260a 00007fcc0def87d4 00007fcc0def8762 00007fcc0def8691 00007fcc0def860c 00007fcc0def78c2 00007fcc0dce548c 00007fcc0dce48c6 00007fcc0dce426f
0709 13:21:00.652977 (+   106us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3619197696}
I20260709 13:21:00.676021  6875 raft_consensus.cc:1275] T 90d42e216d9741e190bca19a781291fd P cd75a17ab2604397adab03bb8b5fd75c [term 18 FOLLOWER]: Refusing update from remote peer b7ab4784c7344b939bc36f639286f377: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 18 index: 10. (term mismatch)
I20260709 13:21:00.677371  6875 pending_rounds.cc:85] T 90d42e216d9741e190bca19a781291fd P cd75a17ab2604397adab03bb8b5fd75c: Aborting all ops after (but not including) 9
I20260709 13:21:00.677727  6875 pending_rounds.cc:107] T 90d42e216d9741e190bca19a781291fd P cd75a17ab2604397adab03bb8b5fd75c: Aborting uncommitted NO_OP operation due to leader change: 17.10
W20260709 13:21:00.603895 12811 consensus_meta.cc:287] T 44bde925b2e541b69890d70715b85176 P b7ab4784c7344b939bc36f639286f377: Time spent flushing consensus metadata: real 0.525s	user 0.009s	sys 0.000s
I20260709 13:21:00.679003  6875 raft_consensus.cc:2889] T 90d42e216d9741e190bca19a781291fd P cd75a17ab2604397adab03bb8b5fd75c [term 18 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:21:00.680516 12527 raft_consensus.cc:2749] T ab432e62819d499eaaf3dd55481dd930 P cd75a17ab2604397adab03bb8b5fd75c [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:21:00.674011 12730 raft_consensus.cc:2749] T dbdf895bba214ff68685a24fd17dfb5d P b7ab4784c7344b939bc36f639286f377 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:21:00.685002  6807 raft_consensus.cc:1240] T dbdf895bba214ff68685a24fd17dfb5d P b7ab4784c7344b939bc36f639286f377 [term 16 FOLLOWER]: Rejecting Update request from peer cd75a17ab2604397adab03bb8b5fd75c for earlier term 15. Current term is 16. Ops: []
I20260709 13:21:00.667793 12704 raft_consensus.cc:515] T ab432e62819d499eaaf3dd55481dd930 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:00.688426 12704 leader_election.cc:290] T ab432e62819d499eaaf3dd55481dd930 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:21:00.689360  6798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a734b5ab7834e05a8c422208acc58b1" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 18 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:21:00.690251  6798 raft_consensus.cc:2410] T 7a734b5ab7834e05a8c422208acc58b1 P b7ab4784c7344b939bc36f639286f377 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c for term 18 because replica has last-logged OpId of term: 17 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 8.
I20260709 13:21:00.691154  6798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4275cf08e63345f993bce8664eada830" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:21:00.691838  6798 raft_consensus.cc:2393] T 4275cf08e63345f993bce8664eada830 P b7ab4784c7344b939bc36f639286f377 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c in current term 15: Already voted for candidate b7ab4784c7344b939bc36f639286f377 in this term.
W20260709 13:21:00.693384  6806 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:32976 (request call id 3530) took 2513 ms (client timeout 2167 ms). Trace:
W20260709 13:21:00.693893  6806 rpcz_store.cc:269] 0709 13:20:58.180375 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:58.181608 (+  1233us) service_pool.cc:224] Handling call
0709 13:21:00.693146 (+2511538us) spinlock_profiling.cc:243] Waited 2.42 s on lock 0x7b54002da854. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f9ae2fa 00007fcc1496fb17 00007fcc0deea6d4 00007fcc0deea662 00007fcc0deea591 00007fcc0deea50c 00007fcc0dee97c2 00007fcc0dce548c 00007fcc0dce48c6 00007fcc0dce426f
0709 13:21:00.693280 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5565237632}
I20260709 13:21:00.694957  6725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a734b5ab7834e05a8c422208acc58b1" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 18 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:21:00.695209  6806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1704639a875409b9959353527b3fd68" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: true dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:21:00.695856  6725 raft_consensus.cc:2393] T 7a734b5ab7834e05a8c422208acc58b1 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c in current term 18: Already voted for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in this term.
I20260709 13:21:00.697080  6725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1704639a875409b9959353527b3fd68" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: true dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:21:00.697819  6725 raft_consensus.cc:3060] T a1704639a875409b9959353527b3fd68 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:21:00.698436 12802 consensus_queue.cc:1059] T bb7fa124c3bf4ef9ab65a407cb008441 P 7ba59cc884714e8aa5f3f0ecaed84cbb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: INVALID_TERM, Last received: 16.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:21:00.664561 12881 raft_consensus.cc:2749] T bd6869f07b5a4885a0b99fbe60c3b175 P cd75a17ab2604397adab03bb8b5fd75c [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:21:00.704640  6732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4275cf08e63345f993bce8664eada830" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:21:00.706177  6844 leader_election.cc:304] T d33d5ee8ef6f415593d8df52063161ad P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:21:00.707468  6724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "853ac0a8cbd64ce99457f170216d4d0f" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:21:00.695931  6806 raft_consensus.cc:3055] T a1704639a875409b9959353527b3fd68 P b7ab4784c7344b939bc36f639286f377 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:21:00.708331  6806 raft_consensus.cc:740] T a1704639a875409b9959353527b3fd68 P b7ab4784c7344b939bc36f639286f377 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
I20260709 13:21:00.709131  6724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce4f062dcd314d43a63ca74067cb5ee3" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:21:00.713467  6724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4db81d9d329422bb3b4160ca4ac2d1d" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:21:00.707748  6844 leader_election.cc:304] T d8cee0accdb8499c86d4414b72565a38 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, b7ab4784c7344b939bc36f639286f377
I20260709 13:21:00.714167  6724 raft_consensus.cc:2468] T c4db81d9d329422bb3b4160ca4ac2d1d P ccd8a4c3bfe3413cb2ae219b09aea832 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 17.
I20260709 13:21:00.717730  6844 leader_election.cc:400] T 4d9def8b32fd443aa94ab1420b06837b P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 16 pre-election: Vote denied by peer b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817) with higher term. Message: Invalid argument: T 4d9def8b32fd443aa94ab1420b06837b P b7ab4784c7344b939bc36f639286f377 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c for earlier term 16. Current term is 17.
I20260709 13:21:00.718786  6844 leader_election.cc:304] T 7c37d41cd9164c15a6826ca62a851a69 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:21:00.722321  6844 leader_election.cc:304] T f58dc08b12a2494bb9a1372837970ca2 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:21:00.724802  6728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c7f33e544204fbaac4078e3e83bbf4e" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:21:00.725740  6728 raft_consensus.cc:2468] T 8c7f33e544204fbaac4078e3e83bbf4e P ccd8a4c3bfe3413cb2ae219b09aea832 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 14.
I20260709 13:21:00.651896 12787 raft_consensus.cc:515] T 1528ab62b6fe4e3099d08f141afee116 P b7ab4784c7344b939bc36f639286f377 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:21:00.737362  6801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f00a2e87e56452083b759f60d461ee3" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:21:00.738680  6724 raft_consensus.cc:1240] T 3fa34c08b205435dba97346991aa1f92 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 21 FOLLOWER]: Rejecting Update request from peer cd75a17ab2604397adab03bb8b5fd75c for earlier term 20. Current term is 21. Ops: [20.15-20.15]
I20260709 13:21:00.729877  6806 consensus_queue.cc:260] T a1704639a875409b9959353527b3fd68 P b7ab4784c7344b939bc36f639286f377 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
W20260709 13:21:00.732700  6845 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:21:00.729795 12543 raft_consensus.cc:2749] T f58dc08b12a2494bb9a1372837970ca2 P cd75a17ab2604397adab03bb8b5fd75c [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:21:00.728065 12527 raft_consensus.cc:2749] T 7c37d41cd9164c15a6826ca62a851a69 P cd75a17ab2604397adab03bb8b5fd75c [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:21:00.742123  6844 leader_election.cc:304] T de3186201e1a40d0b335eeb8b4e256e0 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:21:00.745916 12527 raft_consensus.cc:2804] T de3186201e1a40d0b335eeb8b4e256e0 P cd75a17ab2604397adab03bb8b5fd75c [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:21:00.746341 12527 raft_consensus.cc:493] T de3186201e1a40d0b335eeb8b4e256e0 P cd75a17ab2604397adab03bb8b5fd75c [term 16 FOLLOWER]: Starting leader election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:21:00.746711 12527 raft_consensus.cc:3060] T de3186201e1a40d0b335eeb8b4e256e0 P cd75a17ab2604397adab03bb8b5fd75c [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:21:00.747233  6725 raft_consensus.cc:2468] T a1704639a875409b9959353527b3fd68 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 18.
I20260709 13:21:00.748085 12787 leader_election.cc:290] T 1528ab62b6fe4e3099d08f141afee116 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 15 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:21:00.756356  6804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb7fa124c3bf4ef9ab65a407cb008441" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:21:00.757216  6804 raft_consensus.cc:2393] T bb7fa124c3bf4ef9ab65a407cb008441 P b7ab4784c7344b939bc36f639286f377 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c in current term 17: Already voted for candidate b7ab4784c7344b939bc36f639286f377 in this term.
I20260709 13:21:00.728607 12741 raft_consensus.cc:2749] T d8cee0accdb8499c86d4414b72565a38 P cd75a17ab2604397adab03bb8b5fd75c [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:21:00.758735  6804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce4f062dcd314d43a63ca74067cb5ee3" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:21:00.759876 12625 leader_election.cc:290] T 713b5728a197487c9300b310ab94e5a3 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 15 election: Requested vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:21:00.757511  6844 leader_election.cc:304] T 20f6842e26174571996b8dea4151d4be P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:21:00.763916 12741 raft_consensus.cc:2804] T 20f6842e26174571996b8dea4151d4be P cd75a17ab2604397adab03bb8b5fd75c [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:21:00.764348 12741 raft_consensus.cc:493] T 20f6842e26174571996b8dea4151d4be P cd75a17ab2604397adab03bb8b5fd75c [term 17 FOLLOWER]: Starting leader election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:21:00.764720 12741 raft_consensus.cc:3060] T 20f6842e26174571996b8dea4151d4be P cd75a17ab2604397adab03bb8b5fd75c [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:21:00.768273 12345 consensus_queue.cc:1048] T 427c124d773f483294511e80fe340075 P 7ba59cc884714e8aa5f3f0ecaed84cbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:21:00.746074  6798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "853ac0a8cbd64ce99457f170216d4d0f" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:21:00.782474  6725 raft_consensus.cc:1275] T f5be3a11b23d4ea9b08300a2789821c7 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 16 FOLLOWER]: Refusing update from remote peer b7ab4784c7344b939bc36f639286f377: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:21:00.783651  6725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a75bfe094d4bdc963aba3f08dfcd25" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:21:00.783649 12551 raft_consensus.cc:493] T 17587d6730594da4a56fa13a353232a1 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:21:00.787389 12551 raft_consensus.cc:515] T 17587d6730594da4a56fa13a353232a1 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:21:00.789888 12551 leader_election.cc:290] T 17587d6730594da4a56fa13a353232a1 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
W20260709 13:21:00.786638  6846 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:21:00.789950  7503 raft_consensus.cc:1240] T 3fa34c08b205435dba97346991aa1f92 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 21 LEADER]: Rejecting Update request from peer cd75a17ab2604397adab03bb8b5fd75c for earlier term 20. Current term is 21. Ops: []
I20260709 13:21:00.790321  7500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f00a2e87e56452083b759f60d461ee3" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb"
I20260709 13:21:00.793864  6730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7887766dc6784fcaa42b35c05fea7a99" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:21:00.794355  6723 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50004 (request call id 2785) took 1028 ms. Trace:
I20260709 13:21:00.794859  6723 rpcz_store.cc:276] 0709 13:20:59.765969 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:59.766169 (+   200us) service_pool.cc:224] Handling call
0709 13:20:59.777837 (+ 11668us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:59.876615 (+ 98778us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:59.876656 (+    41us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:20:59.876704 (+    48us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:20:59.876742 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:21:00.794115 (+917373us) spinlock_profiling.cc:243] Waited 98.6 ms on lock 0x7b54003958d4. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f9aae01 00007fcc0f9a983e 00007fcc1496e419 00007fcc0dee5bd4 00007fcc0dee5b62 00007fcc0dee5a91 00007fcc0dee5a0c 00007fcc0dee4cc2 00007fcc0dce548c 00007fcc0dce48c6
0709 13:21:00.794164 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:21:00.794293 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":226746112}
I20260709 13:21:00.720598 12881 raft_consensus.cc:2804] T d33d5ee8ef6f415593d8df52063161ad P cd75a17ab2604397adab03bb8b5fd75c [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:21:00.797055 12881 raft_consensus.cc:493] T d33d5ee8ef6f415593d8df52063161ad P cd75a17ab2604397adab03bb8b5fd75c [term 14 FOLLOWER]: Starting leader election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:21:00.797511 12881 raft_consensus.cc:3060] T d33d5ee8ef6f415593d8df52063161ad P cd75a17ab2604397adab03bb8b5fd75c [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:21:00.757133  6801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce4f062dcd314d43a63ca74067cb5ee3" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
W20260709 13:21:00.807164  6770 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:21:00.810562  7498 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50756 (request call id 464) took 1375 ms. Trace:
I20260709 13:21:00.812320  7498 rpcz_store.cc:276] 0709 13:20:59.435557 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:59.435841 (+   284us) service_pool.cc:224] Handling call
0709 13:20:59.436388 (+   547us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:59.581320 (+144932us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:21:00.810288 (+1228968us) spinlock_profiling.cc:243] Waited 129 ms on lock 0x7b5400538ed4. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f9aae01 00007fcc0f9a983e 00007fcc1496e419 00007fcc0dee5bd4 00007fcc0dee5b62 00007fcc0dee5a91 00007fcc0dee5a0c 00007fcc0dee4cc2 00007fcc0dce548c 00007fcc0dce48c6
0709 13:21:00.810494 (+   206us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":297044352}
I20260709 13:21:00.815356  6723 raft_consensus.cc:1275] T 34f36d59d88f40fe8a2805e604fc6c0a P ccd8a4c3bfe3413cb2ae219b09aea832 [term 16 FOLLOWER]: Refusing update from remote peer b7ab4784c7344b939bc36f639286f377: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 13:21:00.815157  6724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17587d6730594da4a56fa13a353232a1" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:21:00.820724  6770 leader_election.cc:304] T 3411566abe2d4c9bb4b2adfdd05e6f17 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:21:00.786731  6725 raft_consensus.cc:2393] T 95a75bfe094d4bdc963aba3f08dfcd25 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7ab4784c7344b939bc36f639286f377 in current term 15: Already voted for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in this term.
W20260709 13:21:00.824636  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 67198.4us
I20260709 13:21:00.826411  6806 raft_consensus.cc:3060] T a1704639a875409b9959353527b3fd68 P b7ab4784c7344b939bc36f639286f377 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:21:00.829303  6725 raft_consensus.cc:1240] T be1a92657f494cac8dd227d152f50151 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 19 FOLLOWER]: Rejecting Update request from peer b7ab4784c7344b939bc36f639286f377 for earlier term 18. Current term is 19. Ops: [18.14-18.14]
I20260709 13:21:00.795667  6730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b3759de40694069b13c0f8bd40e5709" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:21:00.816866  6724 raft_consensus.cc:2468] T 17587d6730594da4a56fa13a353232a1 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 21.
I20260709 13:21:00.836722  6877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a485a995abc4807b6e511e45419f737" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:21:00.708096 12811 raft_consensus.cc:515] T 44bde925b2e541b69890d70715b85176 P b7ab4784c7344b939bc36f639286f377 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:00.841585  6879 raft_consensus.cc:1240] T 3d65025eea89441290d85dd053810e31 P cd75a17ab2604397adab03bb8b5fd75c [term 18 FOLLOWER]: Rejecting Update request from peer ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 17. Current term is 18. Ops: []
I20260709 13:21:00.841408  7466 leader_election.cc:304] T ce4f062dcd314d43a63ca74067cb5ee3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:21:00.842248  6770 leader_election.cc:304] T 7887766dc6784fcaa42b35c05fea7a99 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:21:00.839512  6844 leader_election.cc:304] T 7ba5dac66ab5497e9e336f2a3c28cda5 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb
I20260709 13:21:00.848475  6844 leader_election.cc:304] T 9b3759de40694069b13c0f8bd40e5709 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:21:00.857048  6877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab432e62819d499eaaf3dd55481dd930" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:21:00.857892  6877 raft_consensus.cc:2468] T ab432e62819d499eaaf3dd55481dd930 P cd75a17ab2604397adab03bb8b5fd75c [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 19.
I20260709 13:21:00.861579  6801 raft_consensus.cc:1240] T 1528ab62b6fe4e3099d08f141afee116 P b7ab4784c7344b939bc36f639286f377 [term 15 FOLLOWER]: Rejecting Update request from peer 7ba59cc884714e8aa5f3f0ecaed84cbb for earlier term 14. Current term is 15. Ops: []
W20260709 13:21:00.838899  6695 connection.cc:256] RPC call timeout handler was delayed by -1.0014168370000789s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2167s for a response
I20260709 13:21:00.876696  6731 raft_consensus.cc:1240] T 07a92dd554674067a83a9cb68c4773f2 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 16 LEADER]: Rejecting Update request from peer b7ab4784c7344b939bc36f639286f377 for earlier term 15. Current term is 16. Ops: [15.9-15.9]
I20260709 13:21:00.877378  6881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1704639a875409b9959353527b3fd68" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:21:00.878306  6881 raft_consensus.cc:2393] T a1704639a875409b9959353527b3fd68 P cd75a17ab2604397adab03bb8b5fd75c [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ccd8a4c3bfe3413cb2ae219b09aea832 in current term 18: Already voted for candidate cd75a17ab2604397adab03bb8b5fd75c in this term.
I20260709 13:21:00.837946 12345 raft_consensus.cc:493] T 4b8cacb381b746da8d0049b0a83b41dd P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:21:00.884837  6770 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:21:00.879295  6874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22ccee1b570c4ad3a57bd7aec085b1b4" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:21:00.879809  6877 raft_consensus.cc:1275] T 4b8cacb381b746da8d0049b0a83b41dd P cd75a17ab2604397adab03bb8b5fd75c [term 18 FOLLOWER]: Refusing update from remote peer ccd8a4c3bfe3413cb2ae219b09aea832: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 13:21:00.756628 12527 raft_consensus.cc:515] T de3186201e1a40d0b335eeb8b4e256e0 P cd75a17ab2604397adab03bb8b5fd75c [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:00.883052  6724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1528ab62b6fe4e3099d08f141afee116" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:21:00.888806  7498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17587d6730594da4a56fa13a353232a1" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:21:00.888944  6844 leader_election.cc:304] T bb7fa124c3bf4ef9ab65a407cb008441 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, b7ab4784c7344b939bc36f639286f377
I20260709 13:21:00.889710  7498 raft_consensus.cc:2393] T 17587d6730594da4a56fa13a353232a1 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ccd8a4c3bfe3413cb2ae219b09aea832 in current term 22: Already voted for candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in this term.
I20260709 13:21:00.890599  6844 leader_election.cc:304] T ce4f062dcd314d43a63ca74067cb5ee3 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, b7ab4784c7344b939bc36f639286f377
I20260709 13:21:00.876976  6879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5be3a11b23d4ea9b08300a2789821c7" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:21:00.894297  6879 raft_consensus.cc:2468] T f5be3a11b23d4ea9b08300a2789821c7 P cd75a17ab2604397adab03bb8b5fd75c [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 16.
I20260709 13:21:00.896322  6877 raft_consensus.cc:1275] T f03d0dbf16864ca4bc1bb5e4c0334c0f P cd75a17ab2604397adab03bb8b5fd75c [term 18 FOLLOWER]: Refusing update from remote peer ccd8a4c3bfe3413cb2ae219b09aea832: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 18 index: 9. (index mismatch)
I20260709 13:21:00.850471 12899 raft_consensus.cc:2804] T 3411566abe2d4c9bb4b2adfdd05e6f17 P b7ab4784c7344b939bc36f639286f377 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:21:00.856016 12543 raft_consensus.cc:2804] T 7ba5dac66ab5497e9e336f2a3c28cda5 P cd75a17ab2604397adab03bb8b5fd75c [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:21:00.872534 12767 raft_consensus.cc:2749] T ce4f062dcd314d43a63ca74067cb5ee3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:21:00.913486  6881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "713b5728a197487c9300b310ab94e5a3" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:21:00.922719  6877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe20b4b48823486ca3b9c648db6ce8aa" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:21:00.925442  6879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f00a2e87e56452083b759f60d461ee3" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:21:00.882212 12663 raft_consensus.cc:2804] T 9b3759de40694069b13c0f8bd40e5709 P cd75a17ab2604397adab03bb8b5fd75c [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:21:00.930747  6879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "427c124d773f483294511e80fe340075" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:21:00.931638  6879 raft_consensus.cc:2376] T 427c124d773f483294511e80fe340075 P cd75a17ab2604397adab03bb8b5fd75c [term 16 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in term 16. Re-sending same reply.
I20260709 13:21:00.882445 12631 raft_consensus.cc:2749] T 7887766dc6784fcaa42b35c05fea7a99 P b7ab4784c7344b939bc36f639286f377 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:21:00.932744  6875 raft_consensus.cc:1240] T de3186201e1a40d0b335eeb8b4e256e0 P cd75a17ab2604397adab03bb8b5fd75c [term 17 FOLLOWER]: Rejecting Update request from peer ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 16. Current term is 17. Ops: []
I20260709 13:21:00.932821  6879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fa34c08b205435dba97346991aa1f92" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:21:00.849828 12787 consensus_queue.cc:1048] T 90d42e216d9741e190bca19a781291fd P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.061s
I20260709 13:21:00.899360 12840 raft_consensus.cc:2749] T bb7fa124c3bf4ef9ab65a407cb008441 P cd75a17ab2604397adab03bb8b5fd75c [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:21:00.941936  6724 raft_consensus.cc:1275] T be1a92657f494cac8dd227d152f50151 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 19 FOLLOWER]: Refusing update from remote peer 7ba59cc884714e8aa5f3f0ecaed84cbb: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 13:21:00.905153 12831 raft_consensus.cc:2749] T ce4f062dcd314d43a63ca74067cb5ee3 P cd75a17ab2604397adab03bb8b5fd75c [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:21:00.943300  6874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3d8792045a4583ae2e965b1350a5b4" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:21:00.909013 12899 raft_consensus.cc:493] T 3411566abe2d4c9bb4b2adfdd05e6f17 P b7ab4784c7344b939bc36f639286f377 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:00.872125 12685 consensus_queue.cc:1048] T f5be3a11b23d4ea9b08300a2789821c7 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.063s
I20260709 13:21:00.855822 12662 consensus_queue.cc:1048] T f3f9c2e2bf644115957398fe4c9459db P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 8, Time since last communication: 0.061s
I20260709 13:21:00.852383 12897 consensus_queue.cc:1048] T 3a485a995abc4807b6e511e45419f737 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.061s
I20260709 13:21:00.949412  6879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fa34c08b205435dba97346991aa1f92" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:21:00.949862  6874 raft_consensus.cc:2393] T bb3d8792045a4583ae2e965b1350a5b4 P cd75a17ab2604397adab03bb8b5fd75c [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in current term 16: Already voted for candidate cd75a17ab2604397adab03bb8b5fd75c in this term.
I20260709 13:21:00.882773 12698 consensus_queue.cc:1048] T 34f36d59d88f40fe8a2805e604fc6c0a P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.054s
I20260709 13:21:00.977417  7468 leader_election.cc:304] T 4f00a2e87e56452083b759f60d461ee3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:21:00.930902 12663 raft_consensus.cc:493] T 9b3759de40694069b13c0f8bd40e5709 P cd75a17ab2604397adab03bb8b5fd75c [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:00.910991 12566 raft_consensus.cc:493] T 7c37d41cd9164c15a6826ca62a851a69 P b7ab4784c7344b939bc36f639286f377 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:21:00.912664 12543 raft_consensus.cc:493] T 7ba5dac66ab5497e9e336f2a3c28cda5 P cd75a17ab2604397adab03bb8b5fd75c [term 17 FOLLOWER]: Starting leader election (detected failure of leader 7ba59cc884714e8aa5f3f0ecaed84cbb)
W20260709 13:21:00.934826 12478 consensus_meta.cc:287] T de3186201e1a40d0b335eeb8b4e256e0 P b7ab4784c7344b939bc36f639286f377: Time spent flushing consensus metadata: real 0.502s	user 0.010s	sys 0.002s
I20260709 13:21:00.887411 12834 consensus_queue.cc:1048] T 3411566abe2d4c9bb4b2adfdd05e6f17 P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.058s
I20260709 13:21:00.977566  6846 leader_election.cc:304] T 4f00a2e87e56452083b759f60d461ee3 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, b7ab4784c7344b939bc36f639286f377
I20260709 13:21:00.900677 12345 raft_consensus.cc:515] T 4b8cacb381b746da8d0049b0a83b41dd P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:21:00.950078 12625 raft_consensus.cc:493] T 24ee15416e3145beaa1b8183453729a3 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader cd75a17ab2604397adab03bb8b5fd75c)
I20260709 13:21:00.963678  6724 raft_consensus.cc:1275] T c4db81d9d329422bb3b4160ca4ac2d1d P ccd8a4c3bfe3413cb2ae219b09aea832 [term 17 FOLLOWER]: Refusing update from remote peer b7ab4784c7344b939bc36f639286f377: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 13:21:01.003798  6874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce4f062dcd314d43a63ca74067cb5ee3" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:21:01.003216 12831 raft_consensus.cc:2749] T 4f00a2e87e56452083b759f60d461ee3 P cd75a17ab2604397adab03bb8b5fd75c [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:21:01.006371  6877 raft_consensus.cc:2468] T fe20b4b48823486ca3b9c648db6ce8aa P cd75a17ab2604397adab03bb8b5fd75c [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in term 14.
I20260709 13:21:00.988662 12663 raft_consensus.cc:3060] T 9b3759de40694069b13c0f8bd40e5709 P cd75a17ab2604397adab03bb8b5fd75c [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:21:01.015518  6877 raft_consensus.cc:1275] T fe20b4b48823486ca3b9c648db6ce8aa P cd75a17ab2604397adab03bb8b5fd75c [term 14 FOLLOWER]: Refusing update from remote peer 7ba59cc884714e8aa5f3f0ecaed84cbb: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:21:00.995086 12543 raft_consensus.cc:3060] T 7ba5dac66ab5497e9e336f2a3c28cda5 P cd75a17ab2604397adab03bb8b5fd75c [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:21:00.982334  6729 raft_consensus.cc:1240] T 95a75bfe094d4bdc963aba3f08dfcd25 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 15 FOLLOWER]: Rejecting Update request from peer cd75a17ab2604397adab03bb8b5fd75c for earlier term 14. Current term is 15. Ops: [14.8-14.8]
W20260709 13:21:00.981427  7466 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 120412us
I20260709 13:21:00.947198 12928 raft_consensus.cc:493] T 34f36d59d88f40fe8a2805e604fc6c0a P ccd8a4c3bfe3413cb2ae219b09aea832 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:00.986155  6697 leader_election.cc:304] T ab432e62819d499eaaf3dd55481dd930 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:21:00.972721 12899 raft_consensus.cc:3060] T 3411566abe2d4c9bb4b2adfdd05e6f17 P b7ab4784c7344b939bc36f639286f377 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:21:00.978461  6844 leader_election.cc:304] T 22ccee1b570c4ad3a57bd7aec085b1b4 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:21:00.984026  6879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3d8792045a4583ae2e965b1350a5b4" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:21:00.985440 12561 consensus_queue.cc:1059] T 3fa34c08b205435dba97346991aa1f92 P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false }, Status: INVALID_TERM, Last received: 20.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.032s
W20260709 13:21:01.031606  6697 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 45792.1us
I20260709 13:21:01.033653 12739 raft_consensus.cc:2804] T ab432e62819d499eaaf3dd55481dd930 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:21:01.050112  6729 raft_consensus.cc:1275] T bb3d8792045a4583ae2e965b1350a5b4 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 16 FOLLOWER]: Refusing update from remote peer 7ba59cc884714e8aa5f3f0ecaed84cbb: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 13:21:01.000454 12478 raft_consensus.cc:515] T de3186201e1a40d0b335eeb8b4e256e0 P b7ab4784c7344b939bc36f639286f377 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:00.992425 12785 consensus_queue.cc:1059] T 3d65025eea89441290d85dd053810e31 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: INVALID_TERM, Last received: 17.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.032s
I20260709 13:21:01.048259  6879 raft_consensus.cc:2393] T bb3d8792045a4583ae2e965b1350a5b4 P cd75a17ab2604397adab03bb8b5fd75c [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in current term 16: Already voted for candidate cd75a17ab2604397adab03bb8b5fd75c in this term.
I20260709 13:21:00.995462 12566 raft_consensus.cc:515] T 7c37d41cd9164c15a6826ca62a851a69 P b7ab4784c7344b939bc36f639286f377 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
W20260709 13:21:01.038341  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 60043.4us
I20260709 13:21:01.019421 12897 raft_consensus.cc:493] T a3022224cc81473690653a83d4e99470 P b7ab4784c7344b939bc36f639286f377 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:01.023697 12673 raft_consensus.cc:2749] T 4f00a2e87e56452083b759f60d461ee3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:21:01.067734  6697 leader_election.cc:304] T f5be3a11b23d4ea9b08300a2789821c7 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:21:01.070168  6844 leader_election.cc:304] T f4b8bd455d5a47c18a1380839c6e0d61 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:21:01.074893 12891 raft_consensus.cc:2804] T f5be3a11b23d4ea9b08300a2789821c7 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:21:01.075474 12891 raft_consensus.cc:493] T f5be3a11b23d4ea9b08300a2789821c7 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:01.075893 12891 raft_consensus.cc:3060] T f5be3a11b23d4ea9b08300a2789821c7 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:21:01.075995 12902 consensus_queue.cc:1048] T f03d0dbf16864ca4bc1bb5e4c0334c0f P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.002s
I20260709 13:21:01.010464 12625 raft_consensus.cc:515] T 24ee15416e3145beaa1b8183453729a3 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:21:01.083078  6844 leader_election.cc:304] T 713b5728a197487c9300b310ab94e5a3 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:21:01.059031 12739 raft_consensus.cc:493] T ab432e62819d499eaaf3dd55481dd930 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:01.052109 12834 raft_consensus.cc:2749] T 22ccee1b570c4ad3a57bd7aec085b1b4 P cd75a17ab2604397adab03bb8b5fd75c [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:21:01.082782 12811 leader_election.cc:290] T 44bde925b2e541b69890d70715b85176 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 18 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
W20260709 13:21:01.084304  6695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 209745us
I20260709 13:21:01.044380 12928 raft_consensus.cc:515] T 34f36d59d88f40fe8a2805e604fc6c0a P ccd8a4c3bfe3413cb2ae219b09aea832 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:01.066569 12561 consensus_queue.cc:1243] T 3fa34c08b205435dba97346991aa1f92 P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Peer 7ba59cc884714e8aa5f3f0ecaed84cbb log is divergent from this leader: its last log entry 21.16 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 15
I20260709 13:21:01.100307 12871 raft_consensus.cc:493] T f03d0dbf16864ca4bc1bb5e4c0334c0f P b7ab4784c7344b939bc36f639286f377 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:01.102419 12840 raft_consensus.cc:2749] T f4b8bd455d5a47c18a1380839c6e0d61 P cd75a17ab2604397adab03bb8b5fd75c [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:21:01.102468 12837 raft_consensus.cc:3055] T bb7fa124c3bf4ef9ab65a407cb008441 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:21:01.109861 12739 raft_consensus.cc:3060] T ab432e62819d499eaaf3dd55481dd930 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:21:01.111254 12527 leader_election.cc:290] T de3186201e1a40d0b335eeb8b4e256e0 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 17 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:21:01.080256 12896 consensus_queue.cc:1048] T 4b8cacb381b746da8d0049b0a83b41dd P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.038s
I20260709 13:21:01.100613 12662 consensus_queue.cc:1048] T 3411566abe2d4c9bb4b2adfdd05e6f17 P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Connected to new peer: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.020s
W20260709 13:21:01.130517  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 47646us
I20260709 13:21:01.101285 12897 raft_consensus.cc:515] T a3022224cc81473690653a83d4e99470 P b7ab4784c7344b939bc36f639286f377 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:01.141280  6844 leader_election.cc:304] T 2c240553ce044eedb41541d72b9475d7 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:21:01.122126 12837 raft_consensus.cc:740] T bb7fa124c3bf4ef9ab65a407cb008441 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 7ba59cc884714e8aa5f3f0ecaed84cbb, State: Running, Role: LEADER
I20260709 13:21:01.145085  6844 leader_election.cc:304] T 7a734b5ab7834e05a8c422208acc58b1 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:21:01.126164 12834 raft_consensus.cc:2749] T 713b5728a197487c9300b310ab94e5a3 P cd75a17ab2604397adab03bb8b5fd75c [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:21:01.152179 12625 leader_election.cc:290] T 24ee15416e3145beaa1b8183453729a3 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:21:01.238078  7500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ba5dac66ab5497e9e336f2a3c28cda5" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:21:01.125217 12871 raft_consensus.cc:515] T f03d0dbf16864ca4bc1bb5e4c0334c0f P b7ab4784c7344b939bc36f639286f377 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
W20260709 13:21:01.153220 12941 log.cc:927] Time spent T 1528ab62b6fe4e3099d08f141afee116 P 7ba59cc884714e8aa5f3f0ecaed84cbb: Append to log took a long time: real 0.124s	user 0.001s	sys 0.000s
I20260709 13:21:01.158666 12891 raft_consensus.cc:515] T f5be3a11b23d4ea9b08300a2789821c7 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:01.261312  6799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "853ac0a8cbd64ce99457f170216d4d0f" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:21:01.149206 12840 raft_consensus.cc:2749] T 2c240553ce044eedb41541d72b9475d7 P cd75a17ab2604397adab03bb8b5fd75c [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:21:01.160904 12527 raft_consensus.cc:3060] T 7a734b5ab7834e05a8c422208acc58b1 P cd75a17ab2604397adab03bb8b5fd75c [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:21:01.160944 12939 log.cc:927] Time spent T 3a485a995abc4807b6e511e45419f737 P cd75a17ab2604397adab03bb8b5fd75c: Append to log took a long time: real 0.088s	user 0.000s	sys 0.000s
I20260709 13:21:01.153373 12345 leader_election.cc:290] T 4b8cacb381b746da8d0049b0a83b41dd P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:21:01.162537 12943 consensus_queue.cc:1059] T 1528ab62b6fe4e3099d08f141afee116 P 7ba59cc884714e8aa5f3f0ecaed84cbb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: INVALID_TERM, Last received: 14.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:21:01.164181 12478 leader_election.cc:290] T de3186201e1a40d0b335eeb8b4e256e0 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 17 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:21:01.170730 12928 leader_election.cc:290] T 34f36d59d88f40fe8a2805e604fc6c0a P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
W20260709 13:21:01.273900 12952 log.cc:927] Time spent T bd6869f07b5a4885a0b99fbe60c3b175 P cd75a17ab2604397adab03bb8b5fd75c: Append to log took a long time: real 0.122s	user 0.003s	sys 0.006s
I20260709 13:21:01.241953  6806 raft_consensus.cc:2468] T a1704639a875409b9959353527b3fd68 P b7ab4784c7344b939bc36f639286f377 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 18.
I20260709 13:21:01.242935  6844 leader_election.cc:304] T 853ac0a8cbd64ce99457f170216d4d0f P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:21:01.251240  6695 leader_election.cc:304] T 7a734b5ab7834e05a8c422208acc58b1 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:21:01.259087 12871 leader_election.cc:290] T f03d0dbf16864ca4bc1bb5e4c0334c0f P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:21:01.260366  7503 raft_consensus.cc:1275] T 4b8cacb381b746da8d0049b0a83b41dd P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 18 FOLLOWER]: Refusing update from remote peer ccd8a4c3bfe3413cb2ae219b09aea832: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 13:21:01.259001  7498 raft_consensus.cc:1240] T be1a92657f494cac8dd227d152f50151 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 19 LEADER]: Rejecting Update request from peer b7ab4784c7344b939bc36f639286f377 for earlier term 18. Current term is 19. Ops: [18.14-18.14]
I20260709 13:21:01.266355  6807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c240553ce044eedb41541d72b9475d7" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:21:01.267330  7500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1528ab62b6fe4e3099d08f141afee116" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb"
W20260709 13:21:01.268582  6772 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:21:01.262152 12631 raft_consensus.cc:493] T 4275cf08e63345f993bce8664eada830 P b7ab4784c7344b939bc36f639286f377 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:01.278501  6799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f58dc08b12a2494bb9a1372837970ca2" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:21:01.279671  6879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34f36d59d88f40fe8a2805e604fc6c0a" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:21:01.281983  6880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24ee15416e3145beaa1b8183453729a3" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
W20260709 13:21:01.299887  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 57072.1us
I20260709 13:21:01.300944  6879 raft_consensus.cc:2410] T 34f36d59d88f40fe8a2805e604fc6c0a P cd75a17ab2604397adab03bb8b5fd75c [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ccd8a4c3bfe3413cb2ae219b09aea832 for term 17 because replica has last-logged OpId of term: 15 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 8.
I20260709 13:21:01.284677  6803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22ccee1b570c4ad3a57bd7aec085b1b4" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:21:01.301213  6844 leader_election.cc:304] T c4db81d9d329422bb3b4160ca4ac2d1d P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377
I20260709 13:21:01.262553 12891 leader_election.cc:290] T f5be3a11b23d4ea9b08300a2789821c7 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 17 election: Requested vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
W20260709 13:21:01.265290 12950 log.cc:927] Time spent T 427c124d773f483294511e80fe340075 P ccd8a4c3bfe3413cb2ae219b09aea832: Append to log took a long time: real 0.085s	user 0.002s	sys 0.000s
I20260709 13:21:01.167853 12741 raft_consensus.cc:515] T 20f6842e26174571996b8dea4151d4be P cd75a17ab2604397adab03bb8b5fd75c [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:01.286600  6805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "713b5728a197487c9300b310ab94e5a3" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:21:01.286772  6804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce4f062dcd314d43a63ca74067cb5ee3" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:21:01.310124  6799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "713b5728a197487c9300b310ab94e5a3" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:21:01.311296  6807 raft_consensus.cc:1275] T f03d0dbf16864ca4bc1bb5e4c0334c0f P b7ab4784c7344b939bc36f639286f377 [term 18 FOLLOWER]: Refusing update from remote peer ccd8a4c3bfe3413cb2ae219b09aea832: Log matching property violated. Preceding OpId in replica: term: 17 index: 9. Preceding OpId from leader: term: 18 index: 9. (term mismatch)
I20260709 13:21:01.322395  6807 pending_rounds.cc:85] T f03d0dbf16864ca4bc1bb5e4c0334c0f P b7ab4784c7344b939bc36f639286f377: Aborting all ops after (but not including) 8
I20260709 13:21:01.322722  6807 pending_rounds.cc:107] T f03d0dbf16864ca4bc1bb5e4c0334c0f P b7ab4784c7344b939bc36f639286f377: Aborting uncommitted NO_OP operation due to leader change: 17.9
I20260709 13:21:01.322999  6807 raft_consensus.cc:2889] T f03d0dbf16864ca4bc1bb5e4c0334c0f P b7ab4784c7344b939bc36f639286f377 [term 18 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:21:01.311787  6879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ba5dac66ab5497e9e336f2a3c28cda5" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
W20260709 13:21:01.313053  7468 leader_election.cc:336] T fe20b4b48823486ca3b9c648db6ce8aa P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 14 election: RPC error from VoteRequest() call to peer cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931): Timed out: RequestConsensusVote RPC to 127.5.126.67:42931 timed out after 1.683s (SENT)
I20260709 13:21:01.318794 12662 raft_consensus.cc:2804] T c4db81d9d329422bb3b4160ca4ac2d1d P cd75a17ab2604397adab03bb8b5fd75c [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:21:01.313817  6844 leader_election.cc:304] T 8c7f33e544204fbaac4078e3e83bbf4e P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377
W20260709 13:21:01.314662  6695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 64147.5us
I20260709 13:21:01.324712  6802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a485a995abc4807b6e511e45419f737" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:21:01.312901  6880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44bde925b2e541b69890d70715b85176" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:21:01.298170 12902 raft_consensus.cc:493] T 90d42e216d9741e190bca19a781291fd P ccd8a4c3bfe3413cb2ae219b09aea832 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:01.329340  6803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5be3a11b23d4ea9b08300a2789821c7" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:21:01.315085 12834 raft_consensus.cc:2749] T 853ac0a8cbd64ce99457f170216d4d0f P cd75a17ab2604397adab03bb8b5fd75c [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:21:01.319679 12785 raft_consensus.cc:493] T 7c37d41cd9164c15a6826ca62a851a69 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:01.330952  6880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5be3a11b23d4ea9b08300a2789821c7" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:21:01.335930  6880 raft_consensus.cc:3060] T f5be3a11b23d4ea9b08300a2789821c7 P cd75a17ab2604397adab03bb8b5fd75c [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:21:01.327498  6695 leader_election.cc:304] T d33d5ee8ef6f415593d8df52063161ad P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:21:01.333001  6844 leader_election.cc:304] T a1704639a875409b9959353527b3fd68 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:21:01.331964  6874 raft_consensus.cc:1240] T 20f6842e26174571996b8dea4151d4be P cd75a17ab2604397adab03bb8b5fd75c [term 18 FOLLOWER]: Rejecting Update request from peer ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 17. Current term is 18. Ops: []
W20260709 13:21:01.331132  7466 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 85676.4us
I20260709 13:21:01.333338  6801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17587d6730594da4a56fa13a353232a1" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:21:01.319315 12891 raft_consensus.cc:2749] T 7a734b5ab7834e05a8c422208acc58b1 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:21:01.338747  6799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab432e62819d499eaaf3dd55481dd930" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:21:01.340318  6799 raft_consensus.cc:2468] T ab432e62819d499eaaf3dd55481dd930 P b7ab4784c7344b939bc36f639286f377 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 19.
I20260709 13:21:01.341365  6801 raft_consensus.cc:2468] T 17587d6730594da4a56fa13a353232a1 P b7ab4784c7344b939bc36f639286f377 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 22.
I20260709 13:21:01.351018  6801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1704639a875409b9959353527b3fd68" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:21:01.325639 12662 raft_consensus.cc:493] T c4db81d9d329422bb3b4160ca4ac2d1d P cd75a17ab2604397adab03bb8b5fd75c [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:01.355161  6801 raft_consensus.cc:2393] T a1704639a875409b9959353527b3fd68 P b7ab4784c7344b939bc36f639286f377 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ccd8a4c3bfe3413cb2ae219b09aea832 in current term 18: Already voted for candidate cd75a17ab2604397adab03bb8b5fd75c in this term.
I20260709 13:21:01.362601 12668 raft_consensus.cc:2804] T d33d5ee8ef6f415593d8df52063161ad P ccd8a4c3bfe3413cb2ae219b09aea832 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:21:01.363446  6798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a92dd554674067a83a9cb68c4773f2" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:21:01.397864  7500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24ee15416e3145beaa1b8183453729a3" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
W20260709 13:21:01.400200  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 43911.3us
W20260709 13:21:01.364353  6698 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:21:01.352341 12945 consensus_queue.cc:1048] T be1a92657f494cac8dd227d152f50151 P 7ba59cc884714e8aa5f3f0ecaed84cbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.013s
I20260709 13:21:01.348378 12785 raft_consensus.cc:515] T 7c37d41cd9164c15a6826ca62a851a69 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:01.376446  6729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b8cacb381b746da8d0049b0a83b41dd" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 19 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:21:01.377233  6878 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53406 (request call id 2832) took 1055 ms. Trace:
I20260709 13:21:01.378810  6724 raft_consensus.cc:1275] T 3fa34c08b205435dba97346991aa1f92 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 21 FOLLOWER]: Refusing update from remote peer 7ba59cc884714e8aa5f3f0ecaed84cbb: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 21 index: 16. (index mismatch)
W20260709 13:21:01.379449  6695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 52019.5us
I20260709 13:21:01.334645 12566 leader_election.cc:290] T 7c37d41cd9164c15a6826ca62a851a69 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:21:01.380707 12897 leader_election.cc:290] T a3022224cc81473690653a83d4e99470 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:21:01.359800 12673 consensus_queue.cc:1048] T bb3d8792045a4583ae2e965b1350a5b4 P 7ba59cc884714e8aa5f3f0ecaed84cbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.023s
I20260709 13:21:01.382359  6875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de3186201e1a40d0b335eeb8b4e256e0" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:21:01.416580  6875 raft_consensus.cc:2393] T de3186201e1a40d0b335eeb8b4e256e0 P cd75a17ab2604397adab03bb8b5fd75c [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate b7ab4784c7344b939bc36f639286f377 in current term 17: Already voted for candidate cd75a17ab2604397adab03bb8b5fd75c in this term.
I20260709 13:21:01.333559 12902 raft_consensus.cc:515] T 90d42e216d9741e190bca19a781291fd P ccd8a4c3bfe3413cb2ae219b09aea832 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:01.335677 12959 raft_consensus.cc:2804] T 8c7f33e544204fbaac4078e3e83bbf4e P cd75a17ab2604397adab03bb8b5fd75c [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:21:01.315956 12631 raft_consensus.cc:515] T 4275cf08e63345f993bce8664eada830 P b7ab4784c7344b939bc36f639286f377 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:01.447567 12959 raft_consensus.cc:493] T 8c7f33e544204fbaac4078e3e83bbf4e P cd75a17ab2604397adab03bb8b5fd75c [term 14 FOLLOWER]: Starting leader election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:21:01.456645 12959 raft_consensus.cc:3060] T 8c7f33e544204fbaac4078e3e83bbf4e P cd75a17ab2604397adab03bb8b5fd75c [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:21:01.380453 12543 raft_consensus.cc:515] T 7ba5dac66ab5497e9e336f2a3c28cda5 P cd75a17ab2604397adab03bb8b5fd75c [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:21:01.458338  6879 raft_consensus.cc:2393] T 7ba5dac66ab5497e9e336f2a3c28cda5 P cd75a17ab2604397adab03bb8b5fd75c [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7ab4784c7344b939bc36f639286f377 in current term 18: Already voted for candidate cd75a17ab2604397adab03bb8b5fd75c in this term.
I20260709 13:21:01.460323 12944 raft_consensus.cc:493] T 24ee15416e3145beaa1b8183453729a3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 19 FOLLOWER]: Starting pre-election (detected failure of leader cd75a17ab2604397adab03bb8b5fd75c)
I20260709 13:21:01.461165 12944 raft_consensus.cc:515] T 24ee15416e3145beaa1b8183453729a3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:21:01.389978 12527 raft_consensus.cc:2749] T 7a734b5ab7834e05a8c422208acc58b1 P cd75a17ab2604397adab03bb8b5fd75c [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:21:01.390363 12663 raft_consensus.cc:515] T 9b3759de40694069b13c0f8bd40e5709 P cd75a17ab2604397adab03bb8b5fd75c [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:01.393342  6880 raft_consensus.cc:2468] T f5be3a11b23d4ea9b08300a2789821c7 P cd75a17ab2604397adab03bb8b5fd75c [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 17.
I20260709 13:21:01.403545  6878 rpcz_store.cc:276] 0709 13:21:00.321729 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:21:00.441668 (+119939us) service_pool.cc:224] Handling call
0709 13:21:00.459620 (+ 17952us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:21:00.515583 (+ 55963us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:21:00.515641 (+    58us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:21:00.521726 (+  6085us) log.cc:844] Serialized 26 byte log entry
0709 13:21:00.702025 (+180299us) spinlock_profiling.cc:243] Waited 107 ms on lock 0x7b18003fa2a0. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc15785de1 00007fcc157925b1 00007fcc0c89fe07 00007fcc156faab9 00007fcc0c8bc69b 00007fcc0c8ba93f 00007fcc0c8bcc02 00007fcc0f54420b 00007fcc0f549d23 00007fcc0f54a0d1 00007fcc0f965a0f
0709 13:21:00.838460 (+136435us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:21:00.838501 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:21:00.838568 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:21:01.348840 (+510272us) raft_consensus.cc:1685] finished
0709 13:21:01.348863 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:21:01.377150 (+ 28287us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":62985,"raft.run_cpu_time_us":179,"raft.run_wall_time_us":11883,"spinlock_wait_cycles":246496512,"thread_start_us":136229,"threads_started":1,"wal-append.queue_time_us":463329}
I20260709 13:21:01.406327  6730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de3186201e1a40d0b335eeb8b4e256e0" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:21:01.474567  6880 raft_consensus.cc:1275] T a3022224cc81473690653a83d4e99470 P cd75a17ab2604397adab03bb8b5fd75c [term 19 FOLLOWER]: Refusing update from remote peer ccd8a4c3bfe3413cb2ae219b09aea832: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
I20260709 13:21:01.475312 12741 leader_election.cc:290] T 20f6842e26174571996b8dea4151d4be P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 18 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:21:01.397598 12662 raft_consensus.cc:3060] T c4db81d9d329422bb3b4160ca4ac2d1d P cd75a17ab2604397adab03bb8b5fd75c [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:21:01.409034 12893 raft_consensus.cc:493] T 711ef6523deb4cbe8ef2ba61e1c21c98 P b7ab4784c7344b939bc36f639286f377 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:21:01.380391 12958 consensus_queue.cc:1059] T 3fa34c08b205435dba97346991aa1f92 P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: INVALID_TERM, Last received: 17.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.071s
I20260709 13:21:01.407967  6772 leader_election.cc:304] T 404190ce4ce94cecbfcb6ea9d1dd8626 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:21:01.411947  6695 leader_election.cc:304] T 853ac0a8cbd64ce99457f170216d4d0f P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:21:01.414280  6801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34f36d59d88f40fe8a2805e604fc6c0a" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:21:01.420660  6875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b8cacb381b746da8d0049b0a83b41dd" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 19 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:21:01.485656  6875 raft_consensus.cc:2410] T 4b8cacb381b746da8d0049b0a83b41dd P cd75a17ab2604397adab03bb8b5fd75c [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ba59cc884714e8aa5f3f0ecaed84cbb for term 19 because replica has last-logged OpId of term: 16 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 12.
I20260709 13:21:01.413647 12561 raft_consensus.cc:2804] T a1704639a875409b9959353527b3fd68 P cd75a17ab2604397adab03bb8b5fd75c [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:21:01.467962  6798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4db81d9d329422bb3b4160ca4ac2d1d" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
W20260709 13:21:01.485489  6695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 73616.3us
I20260709 13:21:01.421721 12668 raft_consensus.cc:697] T d33d5ee8ef6f415593d8df52063161ad P ccd8a4c3bfe3413cb2ae219b09aea832 [term 15 LEADER]: Becoming Leader. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
I20260709 13:21:01.490113  6695 leader_election.cc:304] T 2c240553ce044eedb41541d72b9475d7 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:21:01.493834  6801 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f09c2a98de1a4decabd0ff900dd44caa"
dest_uuid: "b7ab4784c7344b939bc36f639286f377"
mode: GRACEFUL
new_leader_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
 from {username='slave'} at 127.0.0.1:38240
I20260709 13:21:01.494621  6801 raft_consensus.cc:606] T f09c2a98de1a4decabd0ff900dd44caa P b7ab4784c7344b939bc36f639286f377 [term 18 FOLLOWER]: Received request to transfer leadership to TS cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:21:01.495086  6801 raft_consensus.cc:614] T f09c2a98de1a4decabd0ff900dd44caa P b7ab4784c7344b939bc36f639286f377 [term 18 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 13:21:01.496843  6772 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.68:45071, user_credentials={real_user=slave}} blocked reactor thread for 88944.9us
I20260709 13:21:01.498876  6772 leader_election.cc:304] T b3f13b31a1f84f0d89d007eadd57924c P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, ccd8a4c3bfe3413cb2ae219b09aea832
W20260709 13:21:01.502494  7468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 91257.2us
I20260709 13:21:01.503444  6878 raft_consensus.cc:1275] T e31b9971c15848dea59d4d4130141d9e P cd75a17ab2604397adab03bb8b5fd75c [term 15 FOLLOWER]: Refusing update from remote peer b7ab4784c7344b939bc36f639286f377: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:21:01.503556 12668 consensus_queue.cc:237] T d33d5ee8ef6f415593d8df52063161ad P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:01.504782 12673 raft_consensus.cc:493] T 7a734b5ab7834e05a8c422208acc58b1 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 17 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:21:01.505656 12673 raft_consensus.cc:515] T 7a734b5ab7834e05a8c422208acc58b1 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } attrs { replace: true } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:21:01.508545 12704 raft_consensus.cc:2749] T 2c240553ce044eedb41541d72b9475d7 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:21:01.509444  6695 leader_election.cc:304] T 22ccee1b570c4ad3a57bd7aec085b1b4 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:21:01.510331 12704 raft_consensus.cc:2749] T 22ccee1b570c4ad3a57bd7aec085b1b4 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:21:01.510830  6695 leader_election.cc:304] T f58dc08b12a2494bb9a1372837970ca2 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:21:01.511868 12704 raft_consensus.cc:2749] T f58dc08b12a2494bb9a1372837970ca2 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:21:01.512207 12561 raft_consensus.cc:697] T a1704639a875409b9959353527b3fd68 P cd75a17ab2604397adab03bb8b5fd75c [term 18 LEADER]: Becoming Leader. State: Replica: cd75a17ab2604397adab03bb8b5fd75c, State: Running, Role: LEADER
I20260709 13:21:01.513362 12561 consensus_queue.cc:237] T a1704639a875409b9959353527b3fd68 P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:01.517921  6695 leader_election.cc:304] T 713b5728a197487c9300b310ab94e5a3 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:21:01.418916 12834 consensus_queue.cc:1059] T 95a75bfe094d4bdc963aba3f08dfcd25 P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: INVALID_TERM, Last received: 13.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.070s
I20260709 13:21:01.520274  6877 raft_consensus.cc:1240] T 9b3759de40694069b13c0f8bd40e5709 P cd75a17ab2604397adab03bb8b5fd75c [term 15 FOLLOWER]: Rejecting Update request from peer ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 14. Current term is 15. Ops: []
I20260709 13:21:01.532832  6801 raft_consensus.cc:1240] T 3d65025eea89441290d85dd053810e31 P b7ab4784c7344b939bc36f639286f377 [term 18 FOLLOWER]: Rejecting Update request from peer ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 17. Current term is 18. Ops: []
I20260709 13:21:01.521548  6772 leader_election.cc:304] T 17587d6730594da4a56fa13a353232a1 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, b7ab4784c7344b939bc36f639286f377; no voters: 
W20260709 13:21:01.495187 12962 log.cc:927] Time spent T 7887766dc6784fcaa42b35c05fea7a99 P ccd8a4c3bfe3413cb2ae219b09aea832: Append to log took a long time: real 0.068s	user 0.001s	sys 0.001s
I20260709 13:21:01.476347 12944 leader_election.cc:290] T 24ee15416e3145beaa1b8183453729a3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:21:01.488737 12862 raft_consensus.cc:2749] T 853ac0a8cbd64ce99457f170216d4d0f P ccd8a4c3bfe3413cb2ae219b09aea832 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:21:01.550303  6798 raft_consensus.cc:1240] T 44bde925b2e541b69890d70715b85176 P b7ab4784c7344b939bc36f639286f377 [term 18 FOLLOWER]: Rejecting Update request from peer ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 17. Current term is 18. Ops: [17.11-17.11]
I20260709 13:21:01.558084  6772 leader_election.cc:304] T 3d65025eea89441290d85dd053810e31 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:21:01.529090 12566 raft_consensus.cc:2749] T 404190ce4ce94cecbfcb6ea9d1dd8626 P b7ab4784c7344b939bc36f639286f377 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:21:01.529310 12900 raft_consensus.cc:2749] T 713b5728a197487c9300b310ab94e5a3 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:21:01.540560 12698 raft_consensus.cc:2749] T b3f13b31a1f84f0d89d007eadd57924c P b7ab4784c7344b939bc36f639286f377 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:21:01.548781 12881 consensus_meta.cc:287] T d33d5ee8ef6f415593d8df52063161ad P cd75a17ab2604397adab03bb8b5fd75c: Time spent flushing consensus metadata: real 0.751s	user 0.000s	sys 0.020s
I20260709 13:21:01.571677  6878 raft_consensus.cc:1275] T 34f36d59d88f40fe8a2805e604fc6c0a P cd75a17ab2604397adab03bb8b5fd75c [term 16 FOLLOWER]: Refusing update from remote peer b7ab4784c7344b939bc36f639286f377: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 16 index: 9. (term mismatch)
I20260709 13:21:01.589979 12837 consensus_queue.cc:260] T bb7fa124c3bf4ef9ab65a407cb008441 P 7ba59cc884714e8aa5f3f0ecaed84cbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:21:01.592730 12580 raft_consensus.cc:3055] T 3d65025eea89441290d85dd053810e31 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:21:01.595888  6872 raft_consensus.cc:1275] T f4b8bd455d5a47c18a1380839c6e0d61 P cd75a17ab2604397adab03bb8b5fd75c [term 18 FOLLOWER]: Refusing update from remote peer b7ab4784c7344b939bc36f639286f377: Log matching property violated. Preceding OpId in replica: term: 16 index: 8. Preceding OpId from leader: term: 18 index: 9. (index mismatch)
I20260709 13:21:01.547996 12965 raft_consensus.cc:2804] T 17587d6730594da4a56fa13a353232a1 P b7ab4784c7344b939bc36f639286f377 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:21:01.622545  6798 raft_consensus.cc:1275] T 9b3759de40694069b13c0f8bd40e5709 P b7ab4784c7344b939bc36f639286f377 [term 14 FOLLOWER]: Refusing update from remote peer ccd8a4c3bfe3413cb2ae219b09aea832: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:21:01.605842  6878 pending_rounds.cc:85] T 34f36d59d88f40fe8a2805e604fc6c0a P cd75a17ab2604397adab03bb8b5fd75c: Aborting all ops after (but not including) 8
I20260709 13:21:01.627051  6878 pending_rounds.cc:107] T 34f36d59d88f40fe8a2805e604fc6c0a P cd75a17ab2604397adab03bb8b5fd75c: Aborting uncommitted NO_OP operation due to leader change: 15.9
I20260709 13:21:01.627452  6878 raft_consensus.cc:2889] T 34f36d59d88f40fe8a2805e604fc6c0a P cd75a17ab2604397adab03bb8b5fd75c [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:21:01.527942 12893 raft_consensus.cc:515] T 711ef6523deb4cbe8ef2ba61e1c21c98 P b7ab4784c7344b939bc36f639286f377 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:01.542716 12964 consensus_queue.cc:1048] T fe20b4b48823486ca3b9c648db6ce8aa P 7ba59cc884714e8aa5f3f0ecaed84cbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.112s
I20260709 13:21:01.570153 12898 raft_consensus.cc:2804] T 3d65025eea89441290d85dd053810e31 P b7ab4784c7344b939bc36f639286f377 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:21:01.551437 12899 raft_consensus.cc:515] T 3411566abe2d4c9bb4b2adfdd05e6f17 P b7ab4784c7344b939bc36f639286f377 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:01.651427  6878 raft_consensus.cc:1275] T 4d9def8b32fd443aa94ab1420b06837b P cd75a17ab2604397adab03bb8b5fd75c [term 17 FOLLOWER]: Refusing update from remote peer b7ab4784c7344b939bc36f639286f377: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 17 index: 9. (index mismatch)
W20260709 13:21:01.653002  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 234414us
W20260709 13:21:01.654933  6772 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 96908.1us
I20260709 13:21:01.564512 12871 consensus_queue.cc:1059] T 07a92dd554674067a83a9cb68c4773f2 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.082s
I20260709 13:21:01.656026  6772 leader_election.cc:304] T 95a75bfe094d4bdc963aba3f08dfcd25 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:21:01.624507 12580 raft_consensus.cc:740] T 3d65025eea89441290d85dd053810e31 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
I20260709 13:21:01.632912 12965 raft_consensus.cc:493] T 17587d6730594da4a56fa13a353232a1 P b7ab4784c7344b939bc36f639286f377 [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:01.636019 12785 leader_election.cc:290] T 7c37d41cd9164c15a6826ca62a851a69 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:21:01.645704 12698 raft_consensus.cc:493] T 7a734b5ab7834e05a8c422208acc58b1 P b7ab4784c7344b939bc36f639286f377 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:01.648787 12837 raft_consensus.cc:3060] T bb7fa124c3bf4ef9ab65a407cb008441 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:21:01.663372  6798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c37d41cd9164c15a6826ca62a851a69" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:21:01.639243 12862 raft_consensus.cc:493] T e77e330a82df4b43a745d57a68f6f057 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:21:01.669157  6878 raft_consensus.cc:1275] T bb3d8792045a4583ae2e965b1350a5b4 P cd75a17ab2604397adab03bb8b5fd75c [term 16 FOLLOWER]: Refusing update from remote peer 7ba59cc884714e8aa5f3f0ecaed84cbb: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 13:21:01.619787 12881 raft_consensus.cc:515] T d33d5ee8ef6f415593d8df52063161ad P cd75a17ab2604397adab03bb8b5fd75c [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:01.678385 12881 leader_election.cc:290] T d33d5ee8ef6f415593d8df52063161ad P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 15 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:21:01.679450 12566 raft_consensus.cc:3055] T 07a92dd554674067a83a9cb68c4773f2 P b7ab4784c7344b939bc36f639286f377 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:21:01.679961 12566 raft_consensus.cc:740] T 07a92dd554674067a83a9cb68c4773f2 P b7ab4784c7344b939bc36f639286f377 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
I20260709 13:21:01.680384 12673 leader_election.cc:290] T 7a734b5ab7834e05a8c422208acc58b1 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:21:01.680903 12566 consensus_queue.cc:260] T 07a92dd554674067a83a9cb68c4773f2 P b7ab4784c7344b939bc36f639286f377 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:01.682322 12566 raft_consensus.cc:3060] T 07a92dd554674067a83a9cb68c4773f2 P b7ab4784c7344b939bc36f639286f377 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:21:01.684481 12739 consensus_meta.cc:287] T ab432e62819d499eaaf3dd55481dd930 P ccd8a4c3bfe3413cb2ae219b09aea832: Time spent flushing consensus metadata: real 0.546s	user 0.009s	sys 0.006s
I20260709 13:21:01.684935  6772 leader_election.cc:304] T 9b3759de40694069b13c0f8bd40e5709 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:21:01.684890 12739 raft_consensus.cc:515] T ab432e62819d499eaaf3dd55481dd930 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:01.686415 12871 raft_consensus.cc:3060] T 95a75bfe094d4bdc963aba3f08dfcd25 P b7ab4784c7344b939bc36f639286f377 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:21:01.663450 12527 raft_consensus.cc:493] T 30e88460611e47b2ba16a46a30b5f416 P cd75a17ab2604397adab03bb8b5fd75c [term 13 FOLLOWER]: Starting pre-election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:21:01.671005  6798 raft_consensus.cc:2468] T 7c37d41cd9164c15a6826ca62a851a69 P b7ab4784c7344b939bc36f639286f377 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 16.
I20260709 13:21:01.660080 12898 raft_consensus.cc:697] T 3d65025eea89441290d85dd053810e31 P b7ab4784c7344b939bc36f639286f377 [term 18 LEADER]: Becoming Leader. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
I20260709 13:21:01.710104  6798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a734b5ab7834e05a8c422208acc58b1" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:21:01.711979 12663 leader_election.cc:290] T 9b3759de40694069b13c0f8bd40e5709 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 15 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:21:01.712122 12673 consensus_queue.cc:1048] T bb3d8792045a4583ae2e965b1350a5b4 P 7ba59cc884714e8aa5f3f0ecaed84cbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.001s
W20260709 13:21:01.712930 12963 log.cc:927] Time spent T 44bde925b2e541b69890d70715b85176 P ccd8a4c3bfe3413cb2ae219b09aea832: Append to log took a long time: real 0.138s	user 0.000s	sys 0.001s
I20260709 13:21:01.713721 12968 raft_consensus.cc:493] T 9e326172347f45e99a0d482b5d8ef768 P cd75a17ab2604397adab03bb8b5fd75c [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:21:01.714268 12968 raft_consensus.cc:515] T 9e326172347f45e99a0d482b5d8ef768 P cd75a17ab2604397adab03bb8b5fd75c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:01.716460 12968 leader_election.cc:290] T 9e326172347f45e99a0d482b5d8ef768 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:21:01.717680 12893 leader_election.cc:290] T 711ef6523deb4cbe8ef2ba61e1c21c98 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:21:01.665741 12965 raft_consensus.cc:3060] T 17587d6730594da4a56fa13a353232a1 P b7ab4784c7344b939bc36f639286f377 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:21:01.718587 12881 raft_consensus.cc:493] T 711ef6523deb4cbe8ef2ba61e1c21c98 P cd75a17ab2604397adab03bb8b5fd75c [term 19 FOLLOWER]: Starting pre-election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:21:01.693573 12478 raft_consensus.cc:2804] T 9b3759de40694069b13c0f8bd40e5709 P b7ab4784c7344b939bc36f639286f377 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:21:01.691180 12862 raft_consensus.cc:515] T e77e330a82df4b43a745d57a68f6f057 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } }
I20260709 13:21:01.675282 12698 raft_consensus.cc:515] T 7a734b5ab7834e05a8c422208acc58b1 P b7ab4784c7344b939bc36f639286f377 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } attrs { replace: true } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:21:01.696949 12527 raft_consensus.cc:515] T 30e88460611e47b2ba16a46a30b5f416 P cd75a17ab2604397adab03bb8b5fd75c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:01.731343 12478 raft_consensus.cc:493] T 9b3759de40694069b13c0f8bd40e5709 P b7ab4784c7344b939bc36f639286f377 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:01.806635 12897 raft_consensus.cc:493] T f3f9c2e2bf644115957398fe4c9459db P b7ab4784c7344b939bc36f639286f377 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:01.810653 12478 raft_consensus.cc:3060] T 9b3759de40694069b13c0f8bd40e5709 P b7ab4784c7344b939bc36f639286f377 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:21:01.811061 12897 raft_consensus.cc:515] T f3f9c2e2bf644115957398fe4c9459db P b7ab4784c7344b939bc36f639286f377 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
W20260709 13:21:01.812217 12972 log.cc:927] Time spent T 3411566abe2d4c9bb4b2adfdd05e6f17 P ccd8a4c3bfe3413cb2ae219b09aea832: Append to log took a long time: real 0.072s	user 0.001s	sys 0.000s
I20260709 13:21:01.813490 12897 leader_election.cc:290] T f3f9c2e2bf644115957398fe4c9459db P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:21:01.814769 12668 raft_consensus.cc:493] T be1a92657f494cac8dd227d152f50151 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:01.815307 12668 raft_consensus.cc:515] T be1a92657f494cac8dd227d152f50151 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:21:01.817533 12668 leader_election.cc:290] T be1a92657f494cac8dd227d152f50151 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:21:01.822162 12698 leader_election.cc:290] T 7a734b5ab7834e05a8c422208acc58b1 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:21:01.827980 12965 raft_consensus.cc:515] T 17587d6730594da4a56fa13a353232a1 P b7ab4784c7344b939bc36f639286f377 [term 23 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:21:01.735080 12631 leader_election.cc:290] T 4275cf08e63345f993bce8664eada830 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:21:01.733721 12902 leader_election.cc:290] T 90d42e216d9741e190bca19a781291fd P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:21:01.805294  6798 raft_consensus.cc:2468] T 7a734b5ab7834e05a8c422208acc58b1 P b7ab4784c7344b939bc36f639286f377 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in term 18.
I20260709 13:21:01.835964  6798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5be3a11b23d4ea9b08300a2789821c7" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:21:01.809082 12898 consensus_queue.cc:237] T 3d65025eea89441290d85dd053810e31 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.9, Last appended by leader: 9, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:01.837889  6798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90d42e216d9741e190bca19a781291fd" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 19 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:21:01.739845 12580 consensus_queue.cc:260] T 3d65025eea89441290d85dd053810e31 P ccd8a4c3bfe3413cb2ae219b09aea832 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.9, Last appended by leader: 9, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:01.840466  6798 raft_consensus.cc:1240] T 7887766dc6784fcaa42b35c05fea7a99 P b7ab4784c7344b939bc36f639286f377 [term 19 FOLLOWER]: Rejecting Update request from peer ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 18. Current term is 19. Ops: []
I20260709 13:21:01.841590 12580 raft_consensus.cc:3060] T 3d65025eea89441290d85dd053810e31 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:21:01.842154  6798 raft_consensus.cc:1240] T de3186201e1a40d0b335eeb8b4e256e0 P b7ab4784c7344b939bc36f639286f377 [term 17 FOLLOWER]: Rejecting Update request from peer ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 16. Current term is 17. Ops: []
I20260709 13:21:01.843878  6695 leader_election.cc:304] T ce4f062dcd314d43a63ca74067cb5ee3 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, b7ab4784c7344b939bc36f639286f377
I20260709 13:21:01.845340  5625 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 13:21:01.847528 12902 raft_consensus.cc:2749] T ce4f062dcd314d43a63ca74067cb5ee3 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:21:01.736255 12881 raft_consensus.cc:515] T 711ef6523deb4cbe8ef2ba61e1c21c98 P cd75a17ab2604397adab03bb8b5fd75c [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:01.848327 12902 consensus_queue.cc:1048] T f03d0dbf16864ca4bc1bb5e4c0334c0f P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:21:01.850030  6695 leader_election.cc:304] T 3a485a995abc4807b6e511e45419f737 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
W20260709 13:21:01.850852  6698 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:21:01.850078 12881 leader_election.cc:290] T 711ef6523deb4cbe8ef2ba61e1c21c98 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:21:01.853524  6726 raft_consensus.cc:1240] T f5be3a11b23d4ea9b08300a2789821c7 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 17 FOLLOWER]: Rejecting Update request from peer b7ab4784c7344b939bc36f639286f377 for earlier term 16. Current term is 17. Ops: [16.10-16.10]
I20260709 13:21:01.853852 12767 raft_consensus.cc:3055] T 1528ab62b6fe4e3099d08f141afee116 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:21:01.852578 12902 raft_consensus.cc:2749] T 3a485a995abc4807b6e511e45419f737 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:21:01.854408 12767 raft_consensus.cc:740] T 1528ab62b6fe4e3099d08f141afee116 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 7ba59cc884714e8aa5f3f0ecaed84cbb, State: Running, Role: LEADER
I20260709 13:21:01.855130  6695 leader_election.cc:304] T 17587d6730594da4a56fa13a353232a1 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb
I20260709 13:21:01.856055 12891 raft_consensus.cc:2804] T 17587d6730594da4a56fa13a353232a1 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:21:01.856493 12891 raft_consensus.cc:493] T 17587d6730594da4a56fa13a353232a1 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 21 FOLLOWER]: Starting leader election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:21:01.856710  6726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de3186201e1a40d0b335eeb8b4e256e0" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:21:01.857980  6726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f03d0dbf16864ca4bc1bb5e4c0334c0f" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:21:01.859035  6726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c37d41cd9164c15a6826ca62a851a69" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:21:01.859602  6726 raft_consensus.cc:2468] T 7c37d41cd9164c15a6826ca62a851a69 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 17.
I20260709 13:21:01.856925 12891 raft_consensus.cc:3060] T 17587d6730594da4a56fa13a353232a1 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:21:01.859050  6728 raft_consensus.cc:1275] T e31b9971c15848dea59d4d4130141d9e P ccd8a4c3bfe3413cb2ae219b09aea832 [term 15 FOLLOWER]: Refusing update from remote peer b7ab4784c7344b939bc36f639286f377: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
W20260709 13:21:01.861570  6770 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:21:01.861860  6876 raft_consensus.cc:1240] T 7ba5dac66ab5497e9e336f2a3c28cda5 P cd75a17ab2604397adab03bb8b5fd75c [term 18 FOLLOWER]: Rejecting Update request from peer 7ba59cc884714e8aa5f3f0ecaed84cbb for earlier term 17. Current term is 18. Ops: []
I20260709 13:21:01.861310  6725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3022224cc81473690653a83d4e99470" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 20 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:21:01.853933  6730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44bde925b2e541b69890d70715b85176" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:21:01.869794  6798 raft_consensus.cc:1275] T 427c124d773f483294511e80fe340075 P b7ab4784c7344b939bc36f639286f377 [term 16 FOLLOWER]: Refusing update from remote peer 7ba59cc884714e8aa5f3f0ecaed84cbb: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:21:01.876725  6770 leader_election.cc:304] T 1528ab62b6fe4e3099d08f141afee116 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:21:01.860795 12739 leader_election.cc:290] T ab432e62819d499eaaf3dd55481dd930 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 20 election: Requested vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:21:01.855434 12767 consensus_queue.cc:260] T 1528ab62b6fe4e3099d08f141afee116 P 7ba59cc884714e8aa5f3f0ecaed84cbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:21:01.878428  6798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d33d5ee8ef6f415593d8df52063161ad" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:21:01.882560 12704 raft_consensus.cc:493] T dbdf895bba214ff68685a24fd17dfb5d P ccd8a4c3bfe3413cb2ae219b09aea832 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:01.883490 12704 raft_consensus.cc:515] T dbdf895bba214ff68685a24fd17dfb5d P ccd8a4c3bfe3413cb2ae219b09aea832 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:01.887917  6726 raft_consensus.cc:1275] T 4d9def8b32fd443aa94ab1420b06837b P ccd8a4c3bfe3413cb2ae219b09aea832 [term 17 FOLLOWER]: Refusing update from remote peer b7ab4784c7344b939bc36f639286f377: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 17 index: 9. (index mismatch)
I20260709 13:21:01.889161  6726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4275cf08e63345f993bce8664eada830" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:21:01.881673  6725 raft_consensus.cc:1240] T 713b5728a197487c9300b310ab94e5a3 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 15 FOLLOWER]: Rejecting Update request from peer b7ab4784c7344b939bc36f639286f377 for earlier term 14. Current term is 15. Ops: []
I20260709 13:21:01.894742  6801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20f6842e26174571996b8dea4151d4be" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:21:01.897257 12887 consensus_queue.cc:1048] T c4db81d9d329422bb3b4160ca4ac2d1d P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:21:01.899850 12891 raft_consensus.cc:515] T 17587d6730594da4a56fa13a353232a1 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:21:01.863986  6695 leader_election.cc:304] T a1704639a875409b9959353527b3fd68 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:21:01.884763 12897 raft_consensus.cc:2749] T 1528ab62b6fe4e3099d08f141afee116 P b7ab4784c7344b939bc36f639286f377 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:21:01.907431  6879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c37d41cd9164c15a6826ca62a851a69" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:21:01.913964  6879 raft_consensus.cc:2468] T 7c37d41cd9164c15a6826ca62a851a69 P cd75a17ab2604397adab03bb8b5fd75c [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 17.
I20260709 13:21:01.914309 12863 raft_consensus.cc:493] T bb3d8792045a4583ae2e965b1350a5b4 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:01.882507  6730 raft_consensus.cc:1275] T f4b8bd455d5a47c18a1380839c6e0d61 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 18 FOLLOWER]: Refusing update from remote peer b7ab4784c7344b939bc36f639286f377: Log matching property violated. Preceding OpId in replica: term: 14 index: 7. Preceding OpId from leader: term: 18 index: 9. (index mismatch)
I20260709 13:21:01.911330  6726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f9c2e2bf644115957398fe4c9459db" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 18 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:21:01.802616 12741 raft_consensus.cc:493] T 1bf4668eeb70467fb3dc5a0289233b3c P cd75a17ab2604397adab03bb8b5fd75c [term 16 FOLLOWER]: Starting pre-election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:21:01.909649  6725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "711ef6523deb4cbe8ef2ba61e1c21c98" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:21:01.916435  6801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de3186201e1a40d0b335eeb8b4e256e0" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:21:01.881461 12862 leader_election.cc:290] T e77e330a82df4b43a745d57a68f6f057 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:21:01.920348  6879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90d42e216d9741e190bca19a781291fd" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 19 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:21:01.920753  6878 raft_consensus.cc:1275] T 07a92dd554674067a83a9cb68c4773f2 P cd75a17ab2604397adab03bb8b5fd75c [term 16 FOLLOWER]: Refusing update from remote peer ccd8a4c3bfe3413cb2ae219b09aea832: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 13:21:01.921211  6879 raft_consensus.cc:2410] T 90d42e216d9741e190bca19a781291fd P cd75a17ab2604397adab03bb8b5fd75c [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ccd8a4c3bfe3413cb2ae219b09aea832 for term 19 because replica has last-logged OpId of term: 16 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 8.
I20260709 13:21:01.922259  6798 raft_consensus.cc:2393] T d33d5ee8ef6f415593d8df52063161ad P b7ab4784c7344b939bc36f639286f377 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c in current term 15: Already voted for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in this term.
I20260709 13:21:01.922887  6730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a734b5ab7834e05a8c422208acc58b1" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:21:01.923292  6697 leader_election.cc:304] T f5be3a11b23d4ea9b08300a2789821c7 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:21:01.923565  6730 raft_consensus.cc:2468] T 7a734b5ab7834e05a8c422208acc58b1 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 18.
I20260709 13:21:01.925624  6798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e326172347f45e99a0d482b5d8ef768" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:21:01.927251  6801 raft_consensus.cc:2393] T de3186201e1a40d0b335eeb8b4e256e0 P b7ab4784c7344b939bc36f639286f377 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c in current term 17: Already voted for candidate b7ab4784c7344b939bc36f639286f377 in this term.
I20260709 13:21:01.927155  6798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ba5dac66ab5497e9e336f2a3c28cda5" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
W20260709 13:21:01.928572  6772 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 242452us
I20260709 13:21:01.882404 12631 raft_consensus.cc:493] T 427c124d773f483294511e80fe340075 P b7ab4784c7344b939bc36f639286f377 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:01.879871 12767 raft_consensus.cc:3060] T 1528ab62b6fe4e3099d08f141afee116 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:21:01.965881  6695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 101981us
I20260709 13:21:01.967742  6695 leader_election.cc:304] T 34f36d59d88f40fe8a2805e604fc6c0a P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:21:01.968811  6697 leader_election.cc:304] T 24ee15416e3145beaa1b8183453729a3 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:21:01.931341  6798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "711ef6523deb4cbe8ef2ba61e1c21c98" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:21:01.971462  6798 raft_consensus.cc:2468] T 711ef6523deb4cbe8ef2ba61e1c21c98 P b7ab4784c7344b939bc36f639286f377 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 19.
I20260709 13:21:01.972477  6801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b3759de40694069b13c0f8bd40e5709" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:21:01.960973 12840 raft_consensus.cc:493] T 90d42e216d9741e190bca19a781291fd P cd75a17ab2604397adab03bb8b5fd75c [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:02.001160  6798 raft_consensus.cc:1240] T bb7fa124c3bf4ef9ab65a407cb008441 P b7ab4784c7344b939bc36f639286f377 [term 17 FOLLOWER]: Rejecting Update request from peer 7ba59cc884714e8aa5f3f0ecaed84cbb for earlier term 16. Current term is 17. Ops: []
I20260709 13:21:02.004372 12840 raft_consensus.cc:515] T 90d42e216d9741e190bca19a781291fd P cd75a17ab2604397adab03bb8b5fd75c [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:02.006440 12840 leader_election.cc:290] T 90d42e216d9741e190bca19a781291fd P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:21:01.929522 12881 raft_consensus.cc:493] T dbdf895bba214ff68685a24fd17dfb5d P cd75a17ab2604397adab03bb8b5fd75c [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:02.007062 12881 raft_consensus.cc:515] T dbdf895bba214ff68685a24fd17dfb5d P cd75a17ab2604397adab03bb8b5fd75c [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:02.009029 12881 leader_election.cc:290] T dbdf895bba214ff68685a24fd17dfb5d P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:21:02.009470 12527 leader_election.cc:290] T 30e88460611e47b2ba16a46a30b5f416 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:21:02.006508  6798 raft_consensus.cc:1240] T 4275cf08e63345f993bce8664eada830 P b7ab4784c7344b939bc36f639286f377 [term 15 FOLLOWER]: Rejecting Update request from peer ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 14. Current term is 15. Ops: []
I20260709 13:21:02.009970 12580 raft_consensus.cc:2749] T 24ee15416e3145beaa1b8183453729a3 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:21:02.011644  6798 raft_consensus.cc:1275] T a3022224cc81473690653a83d4e99470 P b7ab4784c7344b939bc36f639286f377 [term 19 FOLLOWER]: Refusing update from remote peer ccd8a4c3bfe3413cb2ae219b09aea832: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
I20260709 13:21:01.890648 12832 consensus_queue.cc:237] T 95a75bfe094d4bdc963aba3f08dfcd25 P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.8, Last appended by leader: 7, Current term: 14, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } attrs { replace: true } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:21:01.965868 12905 raft_consensus.cc:2804] T f5be3a11b23d4ea9b08300a2789821c7 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:21:02.013409  6798 raft_consensus.cc:1240] T 3411566abe2d4c9bb4b2adfdd05e6f17 P b7ab4784c7344b939bc36f639286f377 [term 16 FOLLOWER]: Rejecting Update request from peer cd75a17ab2604397adab03bb8b5fd75c for earlier term 15. Current term is 16. Ops: [15.10-15.10]
I20260709 13:21:01.959272 12862 consensus_queue.cc:1059] T de3186201e1a40d0b335eeb8b4e256e0 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: INVALID_TERM, Last received: 16.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.056s
I20260709 13:21:01.924539 12741 raft_consensus.cc:515] T 1bf4668eeb70467fb3dc5a0289233b3c P cd75a17ab2604397adab03bb8b5fd75c [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:01.922130 12863 raft_consensus.cc:515] T bb3d8792045a4583ae2e965b1350a5b4 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:21:01.974407 12900 raft_consensus.cc:2749] T a1704639a875409b9959353527b3fd68 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:21:01.985520 12871 raft_consensus.cc:2749] T 95a75bfe094d4bdc963aba3f08dfcd25 P b7ab4784c7344b939bc36f639286f377 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:21:02.035166  6773 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:21:01.968735 12739 consensus_queue.cc:1048] T a3022224cc81473690653a83d4e99470 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.055s
I20260709 13:21:01.967700 12662 raft_consensus.cc:515] T c4db81d9d329422bb3b4160ca4ac2d1d P cd75a17ab2604397adab03bb8b5fd75c [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:01.968454 12897 consensus_queue.cc:1048] T c4db81d9d329422bb3b4160ca4ac2d1d P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.056s
I20260709 13:21:01.969551 12902 consensus_queue.cc:1048] T 4b8cacb381b746da8d0049b0a83b41dd P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.059s
I20260709 13:21:02.025992 12896 raft_consensus.cc:2749] T 34f36d59d88f40fe8a2805e604fc6c0a P ccd8a4c3bfe3413cb2ae219b09aea832 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:21:02.033854 12959 consensus_meta.cc:287] T 8c7f33e544204fbaac4078e3e83bbf4e P cd75a17ab2604397adab03bb8b5fd75c: Time spent flushing consensus metadata: real 0.576s	user 0.015s	sys 0.000s
W20260709 13:21:02.044446 12973 log.cc:927] Time spent T 95a75bfe094d4bdc963aba3f08dfcd25 P 7ba59cc884714e8aa5f3f0ecaed84cbb: Append to log took a long time: real 0.052s	user 0.000s	sys 0.001s
I20260709 13:21:01.972129 12631 raft_consensus.cc:515] T 427c124d773f483294511e80fe340075 P b7ab4784c7344b939bc36f639286f377 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } attrs { replace: true } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:21:02.038419 12905 raft_consensus.cc:697] T f5be3a11b23d4ea9b08300a2789821c7 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 17 LEADER]: Becoming Leader. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
I20260709 13:21:02.042054 12704 leader_election.cc:290] T dbdf895bba214ff68685a24fd17dfb5d P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:21:02.067960 12691 raft_consensus.cc:3060] T 4275cf08e63345f993bce8664eada830 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:21:02.069947 12662 leader_election.cc:290] T c4db81d9d329422bb3b4160ca4ac2d1d P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 18 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:21:02.049100 12698 consensus_queue.cc:1059] T 4f00a2e87e56452083b759f60d461ee3 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: INVALID_TERM, Last received: 18.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.024s
I20260709 13:21:02.073239 12631 leader_election.cc:290] T 427c124d773f483294511e80fe340075 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:21:02.074029 12631 raft_consensus.cc:3055] T 4f00a2e87e56452083b759f60d461ee3 P b7ab4784c7344b939bc36f639286f377 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:21:02.074422 12631 raft_consensus.cc:740] T 4f00a2e87e56452083b759f60d461ee3 P b7ab4784c7344b939bc36f639286f377 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
I20260709 13:21:02.085042 12631 consensus_queue.cc:260] T 4f00a2e87e56452083b759f60d461ee3 P b7ab4784c7344b939bc36f639286f377 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 13, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:21:02.073239 12863 leader_election.cc:290] T bb3d8792045a4583ae2e965b1350a5b4 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:21:02.088328 12905 consensus_queue.cc:237] T f5be3a11b23d4ea9b08300a2789821c7 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:02.089730 12741 leader_election.cc:290] T 1bf4668eeb70467fb3dc5a0289233b3c P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:21:02.092530 12891 leader_election.cc:290] T 17587d6730594da4a56fa13a353232a1 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 22 election: Requested vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:21:02.092788 12478 raft_consensus.cc:515] T 9b3759de40694069b13c0f8bd40e5709 P b7ab4784c7344b939bc36f639286f377 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:02.094053  6801 raft_consensus.cc:2393] T 9b3759de40694069b13c0f8bd40e5709 P b7ab4784c7344b939bc36f639286f377 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c in current term 15: Already voted for candidate b7ab4784c7344b939bc36f639286f377 in this term.
I20260709 13:21:02.095114 12478 leader_election.cc:290] T 9b3759de40694069b13c0f8bd40e5709 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 15 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:21:02.065593 12959 raft_consensus.cc:515] T 8c7f33e544204fbaac4078e3e83bbf4e P cd75a17ab2604397adab03bb8b5fd75c [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:02.104688 12965 leader_election.cc:290] T 17587d6730594da4a56fa13a353232a1 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 23 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:21:02.107038  6877 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53416 (request call id 3562) took 1097 ms. Trace:
I20260709 13:21:02.103893 12959 leader_election.cc:290] T 8c7f33e544204fbaac4078e3e83bbf4e P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 15 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:21:02.107502  6877 rpcz_store.cc:276] 0709 13:21:01.009362 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:21:01.026272 (+ 16910us) service_pool.cc:224] Handling call
0709 13:21:01.026637 (+   365us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:21:01.530496 (+503859us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:21:02.106776 (+576280us) spinlock_profiling.cc:243] Waited 493 ms on lock 0x7b54002193d4. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f9aae01 00007fcc0f9a983e 00007fcc1496e419 00007fcc0dee5bd4 00007fcc0dee5b62 00007fcc0dee5a91 00007fcc0dee5a0c 00007fcc0dee4cc2 00007fcc0dce548c 00007fcc0dce48c6
0709 13:21:02.106970 (+   194us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1134630144}
I20260709 13:21:02.111014 12580 raft_consensus.cc:3055] T de3186201e1a40d0b335eeb8b4e256e0 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:21:02.111527 12580 raft_consensus.cc:740] T de3186201e1a40d0b335eeb8b4e256e0 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
I20260709 13:21:02.112463 12580 consensus_queue.cc:260] T de3186201e1a40d0b335eeb8b4e256e0 P ccd8a4c3bfe3413cb2ae219b09aea832 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:02.113798 12580 raft_consensus.cc:3060] T de3186201e1a40d0b335eeb8b4e256e0 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:21:02.108731 12741 raft_consensus.cc:493] T e77e330a82df4b43a745d57a68f6f057 P cd75a17ab2604397adab03bb8b5fd75c [term 18 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:21:02.120645 12741 raft_consensus.cc:515] T e77e330a82df4b43a745d57a68f6f057 P cd75a17ab2604397adab03bb8b5fd75c [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } }
I20260709 13:21:02.123346 12741 leader_election.cc:290] T e77e330a82df4b43a745d57a68f6f057 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391)
W20260709 13:21:02.127154  6696 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:21:02.128949  6697 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.68:45071, user_credentials={real_user=slave}} blocked reactor thread for 160204us
W20260709 13:21:02.129042  6695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 161365us
W20260709 13:21:02.130837  6772 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 159501us
I20260709 13:21:02.131887  6724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20f6842e26174571996b8dea4151d4be" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:21:02.133731  6728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b3759de40694069b13c0f8bd40e5709" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:21:02.141191  6880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab432e62819d499eaaf3dd55481dd930" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:21:02.142040  6880 raft_consensus.cc:3060] T ab432e62819d499eaaf3dd55481dd930 P cd75a17ab2604397adab03bb8b5fd75c [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:21:02.146377  6724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d33d5ee8ef6f415593d8df52063161ad" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:21:02.145704  6877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77e330a82df4b43a745d57a68f6f057" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:21:02.150187  6877 raft_consensus.cc:2468] T e77e330a82df4b43a745d57a68f6f057 P cd75a17ab2604397adab03bb8b5fd75c [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 18.
I20260709 13:21:02.152985  6724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e326172347f45e99a0d482b5d8ef768" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:21:02.154142  6844 leader_election.cc:304] T de3186201e1a40d0b335eeb8b4e256e0 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:21:02.144546 12785 raft_consensus.cc:493] T 4d9def8b32fd443aa94ab1420b06837b P ccd8a4c3bfe3413cb2ae219b09aea832 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:02.156944  6728 raft_consensus.cc:1240] T 3fa34c08b205435dba97346991aa1f92 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 21 FOLLOWER]: Rejecting Update request from peer cd75a17ab2604397adab03bb8b5fd75c for earlier term 20. Current term is 21. Ops: [20.15-20.15]
I20260709 13:21:02.161628  6724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "711ef6523deb4cbe8ef2ba61e1c21c98" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:21:02.157090  6844 leader_election.cc:304] T 711ef6523deb4cbe8ef2ba61e1c21c98 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:21:02.167331  6880 raft_consensus.cc:2468] T ab432e62819d499eaaf3dd55481dd930 P cd75a17ab2604397adab03bb8b5fd75c [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 20.
I20260709 13:21:02.168401  6877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbdf895bba214ff68685a24fd17dfb5d" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 17 candidate_status { last_received { term: 14 index: 6 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:21:02.169621  6877 raft_consensus.cc:2410] T dbdf895bba214ff68685a24fd17dfb5d P cd75a17ab2604397adab03bb8b5fd75c [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ccd8a4c3bfe3413cb2ae219b09aea832 for term 17 because replica has last-logged OpId of term: 15 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 6.
I20260709 13:21:02.166626 12760 raft_consensus.cc:3055] T 95a75bfe094d4bdc963aba3f08dfcd25 P cd75a17ab2604397adab03bb8b5fd75c [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:21:02.175366  6730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17587d6730594da4a56fa13a353232a1" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:21:02.176278  6730 raft_consensus.cc:3060] T 17587d6730594da4a56fa13a353232a1 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:21:02.173055  6877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3d8792045a4583ae2e965b1350a5b4" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:21:02.176954  6725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90d42e216d9741e190bca19a781291fd" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:21:02.177284  6877 raft_consensus.cc:2468] T bb3d8792045a4583ae2e965b1350a5b4 P cd75a17ab2604397adab03bb8b5fd75c [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 16.
I20260709 13:21:02.171346 12760 raft_consensus.cc:740] T 95a75bfe094d4bdc963aba3f08dfcd25 P cd75a17ab2604397adab03bb8b5fd75c [term 14 LEADER]: Becoming Follower/Learner. State: Replica: cd75a17ab2604397adab03bb8b5fd75c, State: Running, Role: LEADER
I20260709 13:21:02.144726 12965 consensus_queue.cc:1048] T 90d42e216d9741e190bca19a781291fd P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.034s
I20260709 13:21:02.178931 12863 raft_consensus.cc:493] T e31b9971c15848dea59d4d4130141d9e P ccd8a4c3bfe3413cb2ae219b09aea832 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:02.149385 12906 raft_consensus.cc:493] T 95a75bfe094d4bdc963aba3f08dfcd25 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:02.180972  6724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbdf895bba214ff68685a24fd17dfb5d" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 17 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:21:02.182922  6728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "427c124d773f483294511e80fe340075" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:21:02.183279  6726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b3759de40694069b13c0f8bd40e5709" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:21:02.181622  6724 raft_consensus.cc:2468] T dbdf895bba214ff68685a24fd17dfb5d P ccd8a4c3bfe3413cb2ae219b09aea832 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 16.
W20260709 13:21:02.184314  7467 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:21:02.186846  6725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30e88460611e47b2ba16a46a30b5f416" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
W20260709 13:21:02.191643 12955 log.cc:927] Time spent T 7887766dc6784fcaa42b35c05fea7a99 P cd75a17ab2604397adab03bb8b5fd75c: Append to log took a long time: real 1.062s	user 0.005s	sys 0.000s
I20260709 13:21:02.165298 12959 raft_consensus.cc:2749] T de3186201e1a40d0b335eeb8b4e256e0 P cd75a17ab2604397adab03bb8b5fd75c [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:21:02.202176 12631 raft_consensus.cc:3060] T 4f00a2e87e56452083b759f60d461ee3 P b7ab4784c7344b939bc36f639286f377 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:21:02.181916 12965 raft_consensus.cc:493] T be1a92657f494cac8dd227d152f50151 P b7ab4784c7344b939bc36f639286f377 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:02.194523 12850 raft_consensus.cc:493] T bb7fa124c3bf4ef9ab65a407cb008441 P b7ab4784c7344b939bc36f639286f377 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:02.203254 12965 raft_consensus.cc:515] T be1a92657f494cac8dd227d152f50151 P b7ab4784c7344b939bc36f639286f377 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:21:02.203428 12850 raft_consensus.cc:515] T bb7fa124c3bf4ef9ab65a407cb008441 P b7ab4784c7344b939bc36f639286f377 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:21:02.195755 12993 consensus_queue.cc:1059] T f5be3a11b23d4ea9b08300a2789821c7 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: INVALID_TERM, Last received: 14.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:21:02.206750 12993 raft_consensus.cc:3055] T f5be3a11b23d4ea9b08300a2789821c7 P b7ab4784c7344b939bc36f639286f377 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:21:02.206305 12906 raft_consensus.cc:515] T 95a75bfe094d4bdc963aba3f08dfcd25 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } attrs { replace: true } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: NON_VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: true } }
I20260709 13:21:02.207111 12993 raft_consensus.cc:740] T f5be3a11b23d4ea9b08300a2789821c7 P b7ab4784c7344b939bc36f639286f377 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
I20260709 13:21:02.207960 12993 consensus_queue.cc:260] T f5be3a11b23d4ea9b08300a2789821c7 P b7ab4784c7344b939bc36f639286f377 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.10, Last appended by leader: 10, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:02.208642 12906 leader_election.cc:290] T 95a75bfe094d4bdc963aba3f08dfcd25 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:21:02.209203 12993 raft_consensus.cc:3060] T f5be3a11b23d4ea9b08300a2789821c7 P b7ab4784c7344b939bc36f639286f377 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:21:02.196743  6770 leader_election.cc:304] T de3186201e1a40d0b335eeb8b4e256e0 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:21:02.196911  6874 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53416 (request call id 3560) took 1267 ms. Trace:
I20260709 13:21:02.205924 12965 leader_election.cc:290] T be1a92657f494cac8dd227d152f50151 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:21:02.213413  6724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4db81d9d329422bb3b4160ca4ac2d1d" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:21:02.221014  6724 raft_consensus.cc:3060] T c4db81d9d329422bb3b4160ca4ac2d1d P ccd8a4c3bfe3413cb2ae219b09aea832 [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:21:02.215401  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 58378us
I20260709 13:21:02.205971 12850 leader_election.cc:290] T bb7fa124c3bf4ef9ab65a407cb008441 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:21:02.210464  6874 rpcz_store.cc:276] 0709 13:21:00.929993 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:21:01.011440 (+ 81447us) service_pool.cc:224] Handling call
0709 13:21:01.022012 (+ 10572us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:21:01.337356 (+315344us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:21:02.196578 (+859222us) spinlock_profiling.cc:243] Waited 308 ms on lock 0x7b5400235fd4. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f9aae01 00007fcc0f9a983e 00007fcc1496e419 00007fcc0dee5bd4 00007fcc0dee5b62 00007fcc0dee5a91 00007fcc0dee5a0c 00007fcc0dee4cc2 00007fcc0dce548c 00007fcc0dce48c6
0709 13:21:02.196841 (+   263us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":709208832}
I20260709 13:21:02.223829  6873 raft_consensus.cc:1240] T bb7fa124c3bf4ef9ab65a407cb008441 P cd75a17ab2604397adab03bb8b5fd75c [term 17 FOLLOWER]: Rejecting Update request from peer 7ba59cc884714e8aa5f3f0ecaed84cbb for earlier term 16. Current term is 17. Ops: []
W20260709 13:21:02.224293  7467 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:21:02.224545  6728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bf4668eeb70467fb3dc5a0289233b3c" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:21:02.236265  6725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c7f33e544204fbaac4078e3e83bbf4e" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:21:02.236709  6873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24ee15416e3145beaa1b8183453729a3" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
W20260709 13:21:02.241549  6695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 53617.6us
I20260709 13:21:02.242676  6877 raft_consensus.cc:3055] T 3fa34c08b205435dba97346991aa1f92 P cd75a17ab2604397adab03bb8b5fd75c [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:21:02.243130  6877 raft_consensus.cc:740] T 3fa34c08b205435dba97346991aa1f92 P cd75a17ab2604397adab03bb8b5fd75c [term 20 LEADER]: Becoming Follower/Learner. State: Replica: cd75a17ab2604397adab03bb8b5fd75c, State: Running, Role: LEADER
I20260709 13:21:02.247300  6728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77e330a82df4b43a745d57a68f6f057" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:21:02.249150 12663 consensus_queue.cc:1059] T 3411566abe2d4c9bb4b2adfdd05e6f17 P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: INVALID_TERM, Last received: 13.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:21:02.249650  6878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a75bfe094d4bdc963aba3f08dfcd25" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:21:02.249897 12937 consensus_queue.cc:1059] T 44bde925b2e541b69890d70715b85176 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: INVALID_TERM, Last received: 15.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:21:02.178717 12760 consensus_queue.cc:260] T 95a75bfe094d4bdc963aba3f08dfcd25 P cd75a17ab2604397adab03bb8b5fd75c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } attrs { replace: true } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:21:02.240116 12897 raft_consensus.cc:2749] T de3186201e1a40d0b335eeb8b4e256e0 P b7ab4784c7344b939bc36f639286f377 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:21:02.169553 12785 raft_consensus.cc:515] T 4d9def8b32fd443aa94ab1420b06837b P ccd8a4c3bfe3413cb2ae219b09aea832 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:02.179483 12863 raft_consensus.cc:515] T e31b9971c15848dea59d4d4130141d9e P ccd8a4c3bfe3413cb2ae219b09aea832 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:02.249277  6874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a734b5ab7834e05a8c422208acc58b1" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:21:02.254171  6874 raft_consensus.cc:2468] T 7a734b5ab7834e05a8c422208acc58b1 P cd75a17ab2604397adab03bb8b5fd75c [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in term 18.
I20260709 13:21:02.261992  6728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24ee15416e3145beaa1b8183453729a3" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:21:02.243862  6877 consensus_queue.cc:260] T 3fa34c08b205435dba97346991aa1f92 P cd75a17ab2604397adab03bb8b5fd75c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 20.15, Last appended by leader: 15, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:21:02.264782  6877 raft_consensus.cc:3060] T 3fa34c08b205435dba97346991aa1f92 P cd75a17ab2604397adab03bb8b5fd75c [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:21:02.265651  6730 raft_consensus.cc:2468] T 17587d6730594da4a56fa13a353232a1 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 23.
I20260709 13:21:02.276549  6695 leader_election.cc:304] T 7c37d41cd9164c15a6826ca62a851a69 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
I20260709 13:21:02.284829  6805 raft_consensus.cc:1275] T be1a92657f494cac8dd227d152f50151 P b7ab4784c7344b939bc36f639286f377 [term 19 FOLLOWER]: Refusing update from remote peer 7ba59cc884714e8aa5f3f0ecaed84cbb: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 19 index: 14. (term mismatch)
I20260709 13:21:02.285308  6805 pending_rounds.cc:85] T be1a92657f494cac8dd227d152f50151 P b7ab4784c7344b939bc36f639286f377: Aborting all ops after (but not including) 13
I20260709 13:21:02.285552  6805 pending_rounds.cc:107] T be1a92657f494cac8dd227d152f50151 P b7ab4784c7344b939bc36f639286f377: Aborting uncommitted NO_OP operation due to leader change: 18.14
I20260709 13:21:02.285796  6805 raft_consensus.cc:2889] T be1a92657f494cac8dd227d152f50151 P b7ab4784c7344b939bc36f639286f377 [term 19 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:21:02.253758 12959 raft_consensus.cc:2804] T 711ef6523deb4cbe8ef2ba61e1c21c98 P cd75a17ab2604397adab03bb8b5fd75c [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:21:02.279223  5625 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:21:02.289482  7495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "427c124d773f483294511e80fe340075" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:21:02.277951 12906 consensus_queue.cc:1048] T 9b3759de40694069b13c0f8bd40e5709 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.007s
I20260709 13:21:02.292053  6874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d9def8b32fd443aa94ab1420b06837b" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 18 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:21:02.293602  7495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17587d6730594da4a56fa13a353232a1" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb"
I20260709 13:21:02.294559  7495 raft_consensus.cc:3060] T 17587d6730594da4a56fa13a353232a1 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:21:02.292855  6874 raft_consensus.cc:2468] T 4d9def8b32fd443aa94ab1420b06837b P cd75a17ab2604397adab03bb8b5fd75c [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 17.
I20260709 13:21:02.259680 12785 leader_election.cc:290] T 4d9def8b32fd443aa94ab1420b06837b P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:21:02.297995  7503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a734b5ab7834e05a8c422208acc58b1" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:21:02.299170  7503 raft_consensus.cc:2468] T 7a734b5ab7834e05a8c422208acc58b1 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 17.
I20260709 13:21:02.274941 12891 raft_consensus.cc:493] T 404190ce4ce94cecbfcb6ea9d1dd8626 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 7ba59cc884714e8aa5f3f0ecaed84cbb)
I20260709 13:21:02.302897  6874 raft_consensus.cc:1275] T 427c124d773f483294511e80fe340075 P cd75a17ab2604397adab03bb8b5fd75c [term 16 FOLLOWER]: Refusing update from remote peer 7ba59cc884714e8aa5f3f0ecaed84cbb: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:21:02.293231 12959 raft_consensus.cc:493] T 711ef6523deb4cbe8ef2ba61e1c21c98 P cd75a17ab2604397adab03bb8b5fd75c [term 19 FOLLOWER]: Starting leader election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:21:02.308198  7496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb7fa124c3bf4ef9ab65a407cb008441" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:21:02.308542 12959 raft_consensus.cc:3060] T 711ef6523deb4cbe8ef2ba61e1c21c98 P cd75a17ab2604397adab03bb8b5fd75c [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:21:02.316816  7494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be1a92657f494cac8dd227d152f50151" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:21:02.318746 12863 leader_election.cc:290] T e31b9971c15848dea59d4d4130141d9e P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
W20260709 13:21:02.328680  6770 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 132029us
I20260709 13:21:02.305284  6800 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:32976 (request call id 3546) took 1044 ms. Trace:
I20260709 13:21:02.329295  7496 raft_consensus.cc:2468] T bb7fa124c3bf4ef9ab65a407cb008441 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 17.
I20260709 13:21:02.330838  6770 leader_election.cc:304] T 7c37d41cd9164c15a6826ca62a851a69 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
I20260709 13:21:02.337128  6770 leader_election.cc:304] T 44bde925b2e541b69890d70715b85176 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:21:02.332991  6800 rpcz_store.cc:276] 0709 13:21:01.260923 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:21:01.262909 (+  1986us) service_pool.cc:224] Handling call
0709 13:21:01.283424 (+ 20515us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:21:01.283728 (+   304us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:21:01.309275 (+ 25547us) log.cc:844] Serialized 14 byte log entry
0709 13:21:01.851062 (+541787us) spinlock_profiling.cc:243] Waited 6.46 ms on lock 0x7b18002693e0. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc15785de1 00007fcc157925b1 00007fcc0c89fe07 00007fcc156faab9 00007fcc0c8bc69b 00007fcc0c8ba93f 00007fcc0c8bcc02 00007fcc0f54420b 00007fcc0f549d23 00007fcc0f54a23a 00007fcc0f9b4a2a
0709 13:21:02.291002 (+439940us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:21:02.291057 (+    55us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:21:02.291105 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:21:02.305103 (+ 13998us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:21:02.305223 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":24980,"prepare.run_cpu_time_us":44,"prepare.run_wall_time_us":47,"raft.queue_time_us":27387,"raft.run_cpu_time_us":162,"raft.run_wall_time_us":162,"spinlock_wait_cycles":14858112,"thread_start_us":439569,"threads_started":2,"wal-append.queue_time_us":744650}
I20260709 13:21:02.343123 12566 raft_consensus.cc:2804] T 7c37d41cd9164c15a6826ca62a851a69 P b7ab4784c7344b939bc36f639286f377 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:21:02.344202  6724 raft_consensus.cc:2468] T c4db81d9d329422bb3b4160ca4ac2d1d P ccd8a4c3bfe3413cb2ae219b09aea832 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 18.
I20260709 13:21:02.344166 12964 consensus_queue.cc:1048] T 427c124d773f483294511e80fe340075 P 7ba59cc884714e8aa5f3f0ecaed84cbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.008s
I20260709 13:21:02.354138 12990 consensus_queue.cc:1048] T a3022224cc81473690653a83d4e99470 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:21:02.328316 12891 raft_consensus.cc:515] T 404190ce4ce94cecbfcb6ea9d1dd8626 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:21:02.358177 12891 leader_election.cc:290] T 404190ce4ce94cecbfcb6ea9d1dd8626 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:21:02.359194  6801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be1a92657f494cac8dd227d152f50151" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 20 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:21:02.360003  6801 raft_consensus.cc:2468] T be1a92657f494cac8dd227d152f50151 P b7ab4784c7344b939bc36f639286f377 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 19.
I20260709 13:21:02.361750 12566 raft_consensus.cc:493] T 7c37d41cd9164c15a6826ca62a851a69 P b7ab4784c7344b939bc36f639286f377 [term 16 FOLLOWER]: Starting leader election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:21:02.362495 12566 raft_consensus.cc:3060] T 7c37d41cd9164c15a6826ca62a851a69 P b7ab4784c7344b939bc36f639286f377 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:21:02.364557 12956 raft_consensus.cc:493] T 4275cf08e63345f993bce8664eada830 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:02.343744 12905 consensus_queue.cc:1059] T 7887766dc6784fcaa42b35c05fea7a99 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: INVALID_TERM, Last received: 18.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.022s
I20260709 13:21:02.365527 12956 raft_consensus.cc:515] T 4275cf08e63345f993bce8664eada830 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:02.366408 12905 raft_consensus.cc:3055] T 7887766dc6784fcaa42b35c05fea7a99 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:21:02.366987  6732 raft_consensus.cc:2468] T 4275cf08e63345f993bce8664eada830 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 15.
I20260709 13:21:02.367858 12905 raft_consensus.cc:740] T 7887766dc6784fcaa42b35c05fea7a99 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
I20260709 13:21:02.369059 12905 consensus_queue.cc:260] T 7887766dc6784fcaa42b35c05fea7a99 P ccd8a4c3bfe3413cb2ae219b09aea832 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.10, Last appended by leader: 10, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:02.405972 12905 raft_consensus.cc:3060] T 7887766dc6784fcaa42b35c05fea7a99 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:21:02.414978  6731 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50004 (request call id 2813) took 1621 ms. Trace:
I20260709 13:21:02.361666  6799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab432e62819d499eaaf3dd55481dd930" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:21:02.421293  6799 raft_consensus.cc:3060] T ab432e62819d499eaaf3dd55481dd930 P b7ab4784c7344b939bc36f639286f377 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:21:02.415784  6731 rpcz_store.cc:276] 0709 13:21:00.782881 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:21:00.805893 (+ 23012us) service_pool.cc:224] Handling call
0709 13:21:00.806361 (+   468us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:21:00.887128 (+ 80767us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:21:02.403652 (+1516524us) spinlock_profiling.cc:243] Waited 58.6 ms on lock 0x7b5400057154. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f9aae01 00007fcc0f9a983e 00007fcc1496e419 00007fcc0dee5bd4 00007fcc0dee5b62 00007fcc0dee5a91 00007fcc0dee5a0c 00007fcc0dee4cc2 00007fcc0dce548c 00007fcc0dce48c6
0709 13:21:02.403955 (+   303us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":134706560}
W20260709 13:21:02.424528  7468 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:21:02.343845 12991 raft_consensus.cc:2804] T 7c37d41cd9164c15a6826ca62a851a69 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:21:02.377363  6802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17587d6730594da4a56fa13a353232a1" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:21:02.426967  6802 raft_consensus.cc:2368] T 17587d6730594da4a56fa13a353232a1 P b7ab4784c7344b939bc36f639286f377 [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 22. Current term is 23.
W20260709 13:21:02.399063 12992 log.cc:927] Time spent T f5be3a11b23d4ea9b08300a2789821c7 P ccd8a4c3bfe3413cb2ae219b09aea832: Append to log took a long time: real 0.095s	user 0.001s	sys 0.000s
W20260709 13:21:02.402328  6845 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:21:02.435637  6724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a734b5ab7834e05a8c422208acc58b1" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:21:02.445112  6724 raft_consensus.cc:2393] T 7a734b5ab7834e05a8c422208acc58b1 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in current term 18: Already voted for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in this term.
I20260709 13:21:02.438709 12898 consensus_queue.cc:1048] T e31b9971c15848dea59d4d4130141d9e P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:21:02.446849  7496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ba5dac66ab5497e9e336f2a3c28cda5" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb"
I20260709 13:21:02.430802 12741 raft_consensus.cc:493] T 34f36d59d88f40fe8a2805e604fc6c0a P cd75a17ab2604397adab03bb8b5fd75c [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:02.439201 12543 leader_election.cc:290] T 7ba5dac66ab5497e9e336f2a3c28cda5 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 18 election: Requested vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:21:02.448899 12741 raft_consensus.cc:515] T 34f36d59d88f40fe8a2805e604fc6c0a P cd75a17ab2604397adab03bb8b5fd75c [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:02.450269  6697 leader_election.cc:304] T 90d42e216d9741e190bca19a781291fd P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:21:02.437880 12730 consensus_queue.cc:1048] T 34f36d59d88f40fe8a2805e604fc6c0a P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:21:02.454499  6772 leader_election.cc:304] T 7ba5dac66ab5497e9e336f2a3c28cda5 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, cd75a17ab2604397adab03bb8b5fd75c
W20260709 13:21:02.457626  6772 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:21:02.454793  6697 leader_election.cc:304] T e77e330a82df4b43a745d57a68f6f057 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:21:02.462284 12937 raft_consensus.cc:2749] T 90d42e216d9741e190bca19a781291fd P ccd8a4c3bfe3413cb2ae219b09aea832 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:21:02.463397 12785 consensus_queue.cc:1059] T 9b3759de40694069b13c0f8bd40e5709 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:21:02.464293 12965 consensus_queue.cc:1048] T 4d9def8b32fd443aa94ab1420b06837b P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:21:02.465477  6881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4275cf08e63345f993bce8664eada830" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:21:02.466161 12897 consensus_queue.cc:1048] T f4b8bd455d5a47c18a1380839c6e0d61 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:21:02.466921  6881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a734b5ab7834e05a8c422208acc58b1" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:21:02.468323 12691 raft_consensus.cc:2804] T e77e330a82df4b43a745d57a68f6f057 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:21:02.467664  6881 raft_consensus.cc:2468] T 7a734b5ab7834e05a8c422208acc58b1 P cd75a17ab2604397adab03bb8b5fd75c [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 18.
I20260709 13:21:02.462577  6804 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50550 (request call id 718) took 1115 ms. Trace:
I20260709 13:21:02.470643  6804 rpcz_store.cc:276] 0709 13:21:01.347065 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:21:01.849320 (+502255us) service_pool.cc:224] Handling call
0709 13:21:02.461809 (+612489us) spinlock_profiling.cc:243] Waited 18.6 ms on lock 0x7b5800003098. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0c745db1 00007fcc0c885b71 00007fcc0c885a22 00007fcc1579ec09 00007fcc148f8ee0 00007fcc149c20ab 00007fcc149c2131 00007fcc14983fc0 00007fcc1496e929 00007fcc1496e3d2 00007fcc0dee5bd4
0709 13:21:02.462043 (+   234us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:21:02.462248 (+   205us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:21:02.462275 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:21:02.462316 (+    41us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:21:02.462347 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:21:02.462411 (+    64us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:21:02.462519 (+   108us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":42809728}
I20260709 13:21:02.458580  6772 leader_election.cc:304] T bb7fa124c3bf4ef9ab65a407cb008441 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, b7ab4784c7344b939bc36f639286f377; no voters: 
I20260709 13:21:02.460690  6697 leader_election.cc:304] T ab432e62819d499eaaf3dd55481dd930 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:21:02.398910  6876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e31b9971c15848dea59d4d4130141d9e" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:21:02.476703  6876 raft_consensus.cc:2468] T e31b9971c15848dea59d4d4130141d9e P cd75a17ab2604397adab03bb8b5fd75c [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 15.
I20260709 13:21:02.481336 12785 raft_consensus.cc:3055] T 9b3759de40694069b13c0f8bd40e5709 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:21:02.481913 12785 raft_consensus.cc:740] T 9b3759de40694069b13c0f8bd40e5709 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
I20260709 13:21:02.484149  6800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbdf895bba214ff68685a24fd17dfb5d" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 17 candidate_status { last_received { term: 14 index: 6 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:21:02.485368  6800 raft_consensus.cc:2410] T dbdf895bba214ff68685a24fd17dfb5d P b7ab4784c7344b939bc36f639286f377 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ccd8a4c3bfe3413cb2ae219b09aea832 for term 17 because replica has last-logged OpId of term: 15 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 6.
I20260709 13:21:02.482052 12863 raft_consensus.cc:2804] T ab432e62819d499eaaf3dd55481dd930 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:21:02.491235 12863 raft_consensus.cc:697] T ab432e62819d499eaaf3dd55481dd930 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 20 LEADER]: Becoming Leader. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
I20260709 13:21:02.462423 12704 consensus_queue.cc:1048] T 07a92dd554674067a83a9cb68c4773f2 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.029s
I20260709 13:21:02.492348 12863 consensus_queue.cc:237] T ab432e62819d499eaaf3dd55481dd930 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 18.10, Last appended by leader: 10, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:02.451731 12741 leader_election.cc:290] T 34f36d59d88f40fe8a2805e604fc6c0a P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:21:02.472919 12698 raft_consensus.cc:2749] T 44bde925b2e541b69890d70715b85176 P b7ab4784c7344b939bc36f639286f377 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:21:02.493754  6846 leader_election.cc:304] T 7ba5dac66ab5497e9e336f2a3c28cda5 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, b7ab4784c7344b939bc36f639286f377
I20260709 13:21:02.495131 12787 raft_consensus.cc:2804] T bb7fa124c3bf4ef9ab65a407cb008441 P b7ab4784c7344b939bc36f639286f377 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:21:02.495620 12787 raft_consensus.cc:493] T bb7fa124c3bf4ef9ab65a407cb008441 P b7ab4784c7344b939bc36f639286f377 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:02.495965 12787 raft_consensus.cc:3060] T bb7fa124c3bf4ef9ab65a407cb008441 P b7ab4784c7344b939bc36f639286f377 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:21:02.498219  7466 leader_election.cc:304] T 4b8cacb381b746da8d0049b0a83b41dd P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:21:02.501044  6697 leader_election.cc:304] T bb3d8792045a4583ae2e965b1350a5b4 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:21:02.503005 12886 consensus_queue.cc:1059] T 20f6842e26174571996b8dea4151d4be P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: INVALID_TERM, Last received: 17.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:21:02.472790 12898 raft_consensus.cc:3060] T 7ba5dac66ab5497e9e336f2a3c28cda5 P b7ab4784c7344b939bc36f639286f377 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:21:02.504297 12929 raft_consensus.cc:3055] T 20f6842e26174571996b8dea4151d4be P ccd8a4c3bfe3413cb2ae219b09aea832 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:21:02.505041 12929 raft_consensus.cc:740] T 20f6842e26174571996b8dea4151d4be P ccd8a4c3bfe3413cb2ae219b09aea832 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
I20260709 13:21:02.505996 12929 consensus_queue.cc:260] T 20f6842e26174571996b8dea4151d4be P ccd8a4c3bfe3413cb2ae219b09aea832 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:02.507169  6874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "711ef6523deb4cbe8ef2ba61e1c21c98" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:21:02.508724 12785 consensus_queue.cc:260] T 9b3759de40694069b13c0f8bd40e5709 P ccd8a4c3bfe3413cb2ae219b09aea832 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:02.510075 12945 consensus_queue.cc:1048] T 3fa34c08b205435dba97346991aa1f92 P 7ba59cc884714e8aa5f3f0ecaed84cbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:21:02.511693 12945 raft_consensus.cc:2749] T 4b8cacb381b746da8d0049b0a83b41dd P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:21:02.513264 12741 raft_consensus.cc:2749] T 7ba5dac66ab5497e9e336f2a3c28cda5 P cd75a17ab2604397adab03bb8b5fd75c [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:21:02.510298 12785 raft_consensus.cc:3060] T 9b3759de40694069b13c0f8bd40e5709 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:21:02.517498  6697 leader_election.cc:304] T 4d9def8b32fd443aa94ab1420b06837b P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:21:02.520951  7502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be1a92657f494cac8dd227d152f50151" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 20 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:21:02.522020 12893 raft_consensus.cc:493] T 30e88460611e47b2ba16a46a30b5f416 P b7ab4784c7344b939bc36f639286f377 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:21:02.524506  7503 raft_consensus.cc:1240] T 3fa34c08b205435dba97346991aa1f92 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 21 LEADER]: Rejecting Update request from peer cd75a17ab2604397adab03bb8b5fd75c for earlier term 20. Current term is 21. Ops: []
I20260709 13:21:02.432722 12991 raft_consensus.cc:493] T 7c37d41cd9164c15a6826ca62a851a69 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:21:02.530431  6732 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49998 (request call id 1492) took 1887 ms (client timeout 1777 ms). Trace:
W20260709 13:21:02.531131  6732 rpcz_store.cc:269] 0709 13:21:00.642616 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:21:00.681743 (+ 39127us) service_pool.cc:224] Handling call
0709 13:21:02.530141 (+1848398us) spinlock_profiling.cc:243] Waited 1.66 s on lock 0x7b54003d5c54. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f9ae2fa 00007fcc1496fb17 00007fcc0deea6d4 00007fcc0deea662 00007fcc0deea591 00007fcc0deea50c 00007fcc0dee97c2 00007fcc0dce548c 00007fcc0dce48c6 00007fcc0dce426f
0709 13:21:02.530325 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3820738432}
I20260709 13:21:02.532802  6881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f03d0dbf16864ca4bc1bb5e4c0334c0f" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:21:02.535818 12893 raft_consensus.cc:515] T 30e88460611e47b2ba16a46a30b5f416 P b7ab4784c7344b939bc36f639286f377 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:02.538362 12893 leader_election.cc:290] T 30e88460611e47b2ba16a46a30b5f416 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:21:02.539989 12907 raft_consensus.cc:2804] T 4d9def8b32fd443aa94ab1420b06837b P ccd8a4c3bfe3413cb2ae219b09aea832 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:21:02.540531 12907 raft_consensus.cc:493] T 4d9def8b32fd443aa94ab1420b06837b P ccd8a4c3bfe3413cb2ae219b09aea832 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:02.541020 12907 raft_consensus.cc:3060] T 4d9def8b32fd443aa94ab1420b06837b P ccd8a4c3bfe3413cb2ae219b09aea832 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:21:02.549736  6697 leader_election.cc:304] T e31b9971c15848dea59d4d4130141d9e P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:21:02.553803  6876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c37d41cd9164c15a6826ca62a851a69" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:21:02.555033  6876 raft_consensus.cc:2393] T 7c37d41cd9164c15a6826ca62a851a69 P cd75a17ab2604397adab03bb8b5fd75c [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7ab4784c7344b939bc36f639286f377 in current term 17: Already voted for candidate cd75a17ab2604397adab03bb8b5fd75c in this term.
W20260709 13:21:02.557163  6844 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.5.126.65:44391 timed out after 1.777s (SENT) [suppressed 9 similar messages]
W20260709 13:21:02.526634 12994 log.cc:927] Time spent T 95a75bfe094d4bdc963aba3f08dfcd25 P cd75a17ab2604397adab03bb8b5fd75c: Append to log took a long time: real 0.163s	user 0.001s	sys 0.000s
W20260709 13:21:02.460741  6770 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 123732us
I20260709 13:21:02.470281 12691 raft_consensus.cc:493] T e77e330a82df4b43a745d57a68f6f057 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 18 FOLLOWER]: Starting leader election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
W20260709 13:21:02.594790  6698 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:21:02.454181 12527 raft_consensus.cc:493] T d8cee0accdb8499c86d4414b72565a38 P cd75a17ab2604397adab03bb8b5fd75c [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 7ba59cc884714e8aa5f3f0ecaed84cbb)
I20260709 13:21:02.581290  6800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77e330a82df4b43a745d57a68f6f057" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:21:02.613871  7503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3d8792045a4583ae2e965b1350a5b4" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:21:02.619845  6881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f9c2e2bf644115957398fe4c9459db" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 18 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:21:02.471868 12899 leader_election.cc:290] T 3411566abe2d4c9bb4b2adfdd05e6f17 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 16 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:21:02.624128  6729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34f36d59d88f40fe8a2805e604fc6c0a" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
W20260709 13:21:02.630539  7467 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:21:02.532249 12991 raft_consensus.cc:3060] T 7c37d41cd9164c15a6826ca62a851a69 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:21:02.643180  7503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17587d6730594da4a56fa13a353232a1" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb"
I20260709 13:21:02.645156  6770 leader_election.cc:304] T 7a734b5ab7834e05a8c422208acc58b1 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
I20260709 13:21:02.530741 12964 consensus_queue.cc:1059] T 7ba5dac66ab5497e9e336f2a3c28cda5 P 7ba59cc884714e8aa5f3f0ecaed84cbb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: INVALID_TERM, Last received: 17.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.087s
I20260709 13:21:02.604233 12691 raft_consensus.cc:3060] T e77e330a82df4b43a745d57a68f6f057 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:21:02.593806 12704 raft_consensus.cc:2804] T e31b9971c15848dea59d4d4130141d9e P ccd8a4c3bfe3413cb2ae219b09aea832 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:21:02.600270 12594 raft_consensus.cc:493] T fe20b4b48823486ca3b9c648db6ce8aa P ccd8a4c3bfe3413cb2ae219b09aea832 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 7ba59cc884714e8aa5f3f0ecaed84cbb)
I20260709 13:21:02.676287  6881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb7fa124c3bf4ef9ab65a407cb008441" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:21:02.677137  6881 raft_consensus.cc:2468] T bb7fa124c3bf4ef9ab65a407cb008441 P cd75a17ab2604397adab03bb8b5fd75c [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 17.
I20260709 13:21:02.670490  6879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b3759de40694069b13c0f8bd40e5709" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:21:02.694607  6879 raft_consensus.cc:2393] T 9b3759de40694069b13c0f8bd40e5709 P cd75a17ab2604397adab03bb8b5fd75c [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate b7ab4784c7344b939bc36f639286f377 in current term 15: Already voted for candidate cd75a17ab2604397adab03bb8b5fd75c in this term.
I20260709 13:21:02.638752 12929 raft_consensus.cc:3060] T 20f6842e26174571996b8dea4151d4be P ccd8a4c3bfe3413cb2ae219b09aea832 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:21:02.678894  6876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3022224cc81473690653a83d4e99470" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 20 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:21:02.610059 12887 consensus_queue.cc:1048] T 4d9def8b32fd443aa94ab1420b06837b P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.068s
I20260709 13:21:02.665653 12704 raft_consensus.cc:493] T e31b9971c15848dea59d4d4130141d9e P ccd8a4c3bfe3413cb2ae219b09aea832 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:02.689862  6770 leader_election.cc:304] T 427c124d773f483294511e80fe340075 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:21:02.670502  6799 raft_consensus.cc:2468] T ab432e62819d499eaaf3dd55481dd930 P b7ab4784c7344b939bc36f639286f377 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 20.
I20260709 13:21:02.696110  6881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "427c124d773f483294511e80fe340075" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:21:02.711149  6881 raft_consensus.cc:2468] T 427c124d773f483294511e80fe340075 P cd75a17ab2604397adab03bb8b5fd75c [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 16.
I20260709 13:21:02.668164 12990 raft_consensus.cc:2804] T bb3d8792045a4583ae2e965b1350a5b4 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:21:02.704001  6877 raft_consensus.cc:1275] T 3fa34c08b205435dba97346991aa1f92 P cd75a17ab2604397adab03bb8b5fd75c [term 21 FOLLOWER]: Refusing update from remote peer 7ba59cc884714e8aa5f3f0ecaed84cbb: Log matching property violated. Preceding OpId in replica: term: 20 index: 15. Preceding OpId from leader: term: 21 index: 16. (index mismatch)
I20260709 13:21:02.660501 12685 consensus_queue.cc:1048] T f4b8bd455d5a47c18a1380839c6e0d61 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.047s
I20260709 13:21:02.625727 12527 raft_consensus.cc:515] T d8cee0accdb8499c86d4414b72565a38 P cd75a17ab2604397adab03bb8b5fd75c [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:21:02.710350  7503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "404190ce4ce94cecbfcb6ea9d1dd8626" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:21:02.710021  7466 leader_election.cc:304] T 7a734b5ab7834e05a8c422208acc58b1 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:21:02.650970 12631 consensus_queue.cc:1059] T 713b5728a197487c9300b310ab94e5a3 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: INVALID_TERM, Last received: 14.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.044s
I20260709 13:21:02.678994 12974 raft_consensus.cc:2804] T 7a734b5ab7834e05a8c422208acc58b1 P b7ab4784c7344b939bc36f639286f377 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:21:02.722957  7466 leader_election.cc:304] T 24ee15416e3145beaa1b8183453729a3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:21:02.725943  6770 leader_election.cc:304] T 17587d6730594da4a56fa13a353232a1 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
I20260709 13:21:02.734001  6876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3411566abe2d4c9bb4b2adfdd05e6f17" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:21:02.680244 12811 consensus_queue.cc:1048] T e31b9971c15848dea59d4d4130141d9e P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.049s
W20260709 13:21:02.733636 12831 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 21 current term: 21 is higher.
I20260709 13:21:02.725329 12704 raft_consensus.cc:3060] T e31b9971c15848dea59d4d4130141d9e P ccd8a4c3bfe3413cb2ae219b09aea832 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:21:02.743469 12673 raft_consensus.cc:2749] T 24ee15416e3145beaa1b8183453729a3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:21:02.741241 12974 raft_consensus.cc:493] T 7a734b5ab7834e05a8c422208acc58b1 P b7ab4784c7344b939bc36f639286f377 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:02.740589 12945 raft_consensus.cc:2804] T 7a734b5ab7834e05a8c422208acc58b1 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:21:02.684906 12594 raft_consensus.cc:515] T fe20b4b48823486ca3b9c648db6ce8aa P ccd8a4c3bfe3413cb2ae219b09aea832 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:21:02.722389 12896 raft_consensus.cc:493] T 427c124d773f483294511e80fe340075 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 7ba59cc884714e8aa5f3f0ecaed84cbb)
I20260709 13:21:02.784737  6876 raft_consensus.cc:1275] T d33d5ee8ef6f415593d8df52063161ad P cd75a17ab2604397adab03bb8b5fd75c [term 15 FOLLOWER]: Refusing update from remote peer ccd8a4c3bfe3413cb2ae219b09aea832: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
W20260709 13:21:02.785661  6770 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 59815us
I20260709 13:21:02.751597 12893 raft_consensus.cc:2749] T 427c124d773f483294511e80fe340075 P b7ab4784c7344b939bc36f639286f377 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:21:02.740921 12767 consensus_queue.cc:1048] T 427c124d773f483294511e80fe340075 P 7ba59cc884714e8aa5f3f0ecaed84cbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.040s
I20260709 13:21:02.744719 12964 consensus_queue.cc:1048] T be1a92657f494cac8dd227d152f50151 P 7ba59cc884714e8aa5f3f0ecaed84cbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.039s
I20260709 13:21:02.797307 12965 raft_consensus.cc:2804] T 17587d6730594da4a56fa13a353232a1 P b7ab4784c7344b939bc36f639286f377 [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:21:02.816541  6799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90d42e216d9741e190bca19a781291fd" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:21:02.823807  6800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbdf895bba214ff68685a24fd17dfb5d" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 17 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:21:02.824802  6800 raft_consensus.cc:2468] T dbdf895bba214ff68685a24fd17dfb5d P b7ab4784c7344b939bc36f639286f377 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 16.
I20260709 13:21:02.825907  6804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4db81d9d329422bb3b4160ca4ac2d1d" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:21:02.831041 12956 leader_election.cc:290] T 4275cf08e63345f993bce8664eada830 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:21:02.839411  6806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bf4668eeb70467fb3dc5a0289233b3c" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:21:02.860978  6804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c7f33e544204fbaac4078e3e83bbf4e" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:21:02.864367  6803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30e88460611e47b2ba16a46a30b5f416" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:21:02.865356  6803 raft_consensus.cc:2468] T 30e88460611e47b2ba16a46a30b5f416 P b7ab4784c7344b939bc36f639286f377 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 13.
I20260709 13:21:02.805498 12974 raft_consensus.cc:3060] T 7a734b5ab7834e05a8c422208acc58b1 P b7ab4784c7344b939bc36f639286f377 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:21:02.922113  6800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77e330a82df4b43a745d57a68f6f057" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:21:02.805207 12945 raft_consensus.cc:493] T 7a734b5ab7834e05a8c422208acc58b1 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 17 FOLLOWER]: Starting leader election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
W20260709 13:21:02.924263  6772 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:21:02.950667  7495 consensus_meta.cc:287] T 17587d6730594da4a56fa13a353232a1 P 7ba59cc884714e8aa5f3f0ecaed84cbb: Time spent flushing consensus metadata: real 0.643s	user 0.008s	sys 0.004s
I20260709 13:21:02.951141  7495 raft_consensus.cc:2468] T 17587d6730594da4a56fa13a353232a1 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 23.
I20260709 13:21:02.953598  6803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34f36d59d88f40fe8a2805e604fc6c0a" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
W20260709 13:21:02.957556  6696 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:21:02.961705  6770 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:21:02.971174  6730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30e88460611e47b2ba16a46a30b5f416" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:21:02.980682  6724 raft_consensus.cc:1275] T 3d65025eea89441290d85dd053810e31 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 18 FOLLOWER]: Refusing update from remote peer b7ab4784c7344b939bc36f639286f377: Log matching property violated. Preceding OpId in replica: term: 17 index: 9. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
I20260709 13:21:02.989235  6772 leader_election.cc:304] T 4275cf08e63345f993bce8664eada830 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:21:02.992991  6729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be1a92657f494cac8dd227d152f50151" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:21:02.997031  6731 raft_consensus.cc:1240] T c4db81d9d329422bb3b4160ca4ac2d1d P ccd8a4c3bfe3413cb2ae219b09aea832 [term 18 FOLLOWER]: Rejecting Update request from peer b7ab4784c7344b939bc36f639286f377 for earlier term 17. Current term is 18. Ops: [17.10-17.10]
I20260709 13:21:02.914063 12965 raft_consensus.cc:697] T 17587d6730594da4a56fa13a353232a1 P b7ab4784c7344b939bc36f639286f377 [term 23 LEADER]: Becoming Leader. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
I20260709 13:21:03.001816  6732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3411566abe2d4c9bb4b2adfdd05e6f17" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:21:02.949728 12945 raft_consensus.cc:3060] T 7a734b5ab7834e05a8c422208acc58b1 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:21:02.838562 12566 raft_consensus.cc:515] T 7c37d41cd9164c15a6826ca62a851a69 P b7ab4784c7344b939bc36f639286f377 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:03.009821  6872 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53416 (request call id 3571) took 1682 ms. Trace:
I20260709 13:21:03.010275 12527 leader_election.cc:290] T d8cee0accdb8499c86d4414b72565a38 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:21:02.835089 12896 raft_consensus.cc:515] T 427c124d773f483294511e80fe340075 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } attrs { replace: true } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
W20260709 13:21:03.016952 13008 log.cc:927] Time spent T 3411566abe2d4c9bb4b2adfdd05e6f17 P cd75a17ab2604397adab03bb8b5fd75c: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
I20260709 13:21:02.993744 12543 raft_consensus.cc:493] T 22ccee1b570c4ad3a57bd7aec085b1b4 P cd75a17ab2604397adab03bb8b5fd75c [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:21:03.018880 12594 leader_election.cc:290] T fe20b4b48823486ca3b9c648db6ce8aa P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:21:03.023586  6804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e31b9971c15848dea59d4d4130141d9e" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:21:03.025008  6801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "404190ce4ce94cecbfcb6ea9d1dd8626" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:21:03.082377  6801 raft_consensus.cc:2468] T 404190ce4ce94cecbfcb6ea9d1dd8626 P b7ab4784c7344b939bc36f639286f377 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 15.
I20260709 13:21:03.032648  6807 raft_consensus.cc:1240] T 9b3759de40694069b13c0f8bd40e5709 P b7ab4784c7344b939bc36f639286f377 [term 15 FOLLOWER]: Rejecting Update request from peer ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 14. Current term is 15. Ops: [14.9-14.9]
I20260709 13:21:03.031195 12685 raft_consensus.cc:493] T d33d5ee8ef6f415593d8df52063161ad P b7ab4784c7344b939bc36f639286f377 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:03.038518  6802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a75bfe094d4bdc963aba3f08dfcd25" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:21:03.084328  6802 raft_consensus.cc:2410] T 95a75bfe094d4bdc963aba3f08dfcd25 P b7ab4784c7344b939bc36f639286f377 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ccd8a4c3bfe3413cb2ae219b09aea832 for term 16 because replica has last-logged OpId of term: 14 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 7.
I20260709 13:21:03.002607 12561 raft_consensus.cc:493] T 3a485a995abc4807b6e511e45419f737 P cd75a17ab2604397adab03bb8b5fd75c [term 17 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:21:03.085225 12561 raft_consensus.cc:515] T 3a485a995abc4807b6e511e45419f737 P cd75a17ab2604397adab03bb8b5fd75c [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
W20260709 13:21:03.041750 12993 consensus_meta.cc:287] T f5be3a11b23d4ea9b08300a2789821c7 P b7ab4784c7344b939bc36f639286f377: Time spent flushing consensus metadata: real 0.825s	user 0.007s	sys 0.008s
I20260709 13:21:03.044413  6800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d9def8b32fd443aa94ab1420b06837b" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 18 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
W20260709 13:21:03.045553 13001 log.cc:927] Time spent T bb3d8792045a4583ae2e965b1350a5b4 P cd75a17ab2604397adab03bb8b5fd75c: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 13:21:02.996538 12741 raft_consensus.cc:493] T 7887766dc6784fcaa42b35c05fea7a99 P cd75a17ab2604397adab03bb8b5fd75c [term 18 FOLLOWER]: Starting pre-election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
W20260709 13:21:03.093921  6695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 75419.7us
I20260709 13:21:03.095386  6695 leader_election.cc:400] T 17587d6730594da4a56fa13a353232a1 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 22 election: Vote denied by peer b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817) with higher term. Message: Invalid argument: T 17587d6730594da4a56fa13a353232a1 P b7ab4784c7344b939bc36f639286f377 [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 22. Current term is 23.
I20260709 13:21:03.095780  6695 leader_election.cc:403] T 17587d6730594da4a56fa13a353232a1 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 22 election: Cancelling election due to peer responding with higher term
W20260709 13:21:03.076833  7467 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:21:03.055708  6872 rpcz_store.cc:276] 0709 13:21:01.327910 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:21:01.634180 (+306270us) service_pool.cc:224] Handling call
0709 13:21:01.634597 (+   417us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:21:01.640142 (+  5545us) raft_consensus.cc:1534] Early marking committed up to index 13
0709 13:21:01.662109 (+ 21967us) log.cc:844] Serialized 14 byte log entry
0709 13:21:02.469010 (+806901us) spinlock_profiling.cc:243] Waited 1.73 ms on lock 0x7b18003b4a60. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc15785de1 00007fcc157925b1 00007fcc0c89fe07 00007fcc156faab9 00007fcc0c8bc69b 00007fcc0c8ba93f 00007fcc0c8bcc02 00007fcc0f54420b 00007fcc0f549d23 00007fcc0f54a23a 00007fcc0f9b4a2a
0709 13:21:02.920471 (+451461us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:21:02.947018 (+ 26547us) log.cc:844] Serialized 26 byte log entry
0709 13:21:02.949365 (+  2347us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:21:02.949413 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:21:02.949488 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:21:03.009516 (+ 60028us) raft_consensus.cc:1685] finished
0709 13:21:03.009622 (+   106us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:21:03.009758 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":179932,"prepare.queue_time_us":14780,"prepare.run_cpu_time_us":54,"prepare.run_wall_time_us":56,"raft.queue_time_us":193272,"raft.run_cpu_time_us":2316,"raft.run_wall_time_us":37550,"spinlock_wait_cycles":5319296,"thread_start_us":259323,"threads_started":1,"wal-append.queue_time_us":1321979}
I20260709 13:21:03.097455  6872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30e88460611e47b2ba16a46a30b5f416" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:21:03.090019  6803 raft_consensus.cc:1275] T 07a92dd554674067a83a9cb68c4773f2 P b7ab4784c7344b939bc36f639286f377 [term 16 FOLLOWER]: Refusing update from remote peer ccd8a4c3bfe3413cb2ae219b09aea832: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 16 index: 9. (term mismatch)
I20260709 13:21:03.098934  6803 pending_rounds.cc:85] T 07a92dd554674067a83a9cb68c4773f2 P b7ab4784c7344b939bc36f639286f377: Aborting all ops after (but not including) 8
W20260709 13:21:03.060271  6772 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 71141.7us
I20260709 13:21:03.099128  6872 raft_consensus.cc:1240] T f5be3a11b23d4ea9b08300a2789821c7 P cd75a17ab2604397adab03bb8b5fd75c [term 17 FOLLOWER]: Rejecting Update request from peer b7ab4784c7344b939bc36f639286f377 for earlier term 16. Current term is 17. Ops: []
I20260709 13:21:03.100893  6772 leader_election.cc:304] T f03d0dbf16864ca4bc1bb5e4c0334c0f P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:21:03.102717  6772 leader_election.cc:304] T f3f9c2e2bf644115957398fe4c9459db P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:21:03.099202  6803 pending_rounds.cc:107] T 07a92dd554674067a83a9cb68c4773f2 P b7ab4784c7344b939bc36f639286f377: Aborting uncommitted NO_OP operation due to leader change: 15.9
I20260709 13:21:03.103602  6803 raft_consensus.cc:2889] T 07a92dd554674067a83a9cb68c4773f2 P b7ab4784c7344b939bc36f639286f377 [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:21:03.114771  6872 raft_consensus.cc:1240] T c4db81d9d329422bb3b4160ca4ac2d1d P cd75a17ab2604397adab03bb8b5fd75c [term 18 FOLLOWER]: Rejecting Update request from peer b7ab4784c7344b939bc36f639286f377 for earlier term 17. Current term is 18. Ops: [17.10-17.10]
I20260709 13:21:03.124490  6805 raft_consensus.cc:1275] T f5be3a11b23d4ea9b08300a2789821c7 P b7ab4784c7344b939bc36f639286f377 [term 17 FOLLOWER]: Refusing update from remote peer ccd8a4c3bfe3413cb2ae219b09aea832: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 17 index: 10. (term mismatch)
I20260709 13:21:03.124930  6805 pending_rounds.cc:85] T f5be3a11b23d4ea9b08300a2789821c7 P b7ab4784c7344b939bc36f639286f377: Aborting all ops after (but not including) 9
I20260709 13:21:03.077751 12698 raft_consensus.cc:2749] T 4275cf08e63345f993bce8664eada830 P b7ab4784c7344b939bc36f639286f377 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:21:03.125216  6805 pending_rounds.cc:107] T f5be3a11b23d4ea9b08300a2789821c7 P b7ab4784c7344b939bc36f639286f377: Aborting uncommitted NO_OP operation due to leader change: 16.10
I20260709 13:21:03.128185  6804 raft_consensus.cc:1240] T 44bde925b2e541b69890d70715b85176 P b7ab4784c7344b939bc36f639286f377 [term 18 FOLLOWER]: Rejecting Update request from peer ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 17. Current term is 18. Ops: [17.11-17.11]
I20260709 13:21:03.132753  6799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4275cf08e63345f993bce8664eada830" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:21:03.131769  6805 raft_consensus.cc:2889] T f5be3a11b23d4ea9b08300a2789821c7 P b7ab4784c7344b939bc36f639286f377 [term 17 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:21:03.135560  6695 leader_election.cc:304] T be1a92657f494cac8dd227d152f50151 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb
I20260709 13:21:03.137303  6695 leader_election.cc:304] T dbdf895bba214ff68685a24fd17dfb5d P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
W20260709 13:21:03.138747  6697 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 139748us
W20260709 13:21:03.139308  6847 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:21:03.151146  6698 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:21:03.091418 12685 raft_consensus.cc:515] T d33d5ee8ef6f415593d8df52063161ad P b7ab4784c7344b939bc36f639286f377 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:03.159626  6803 raft_consensus.cc:1240] T 1528ab62b6fe4e3099d08f141afee116 P b7ab4784c7344b939bc36f639286f377 [term 15 FOLLOWER]: Rejecting Update request from peer 7ba59cc884714e8aa5f3f0ecaed84cbb for earlier term 14. Current term is 15. Ops: []
I20260709 13:21:03.123948 12986 raft_consensus.cc:3055] T 44bde925b2e541b69890d70715b85176 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:21:03.126861 12993 raft_consensus.cc:2749] T f03d0dbf16864ca4bc1bb5e4c0334c0f P b7ab4784c7344b939bc36f639286f377 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:21:03.086525 12543 raft_consensus.cc:515] T 22ccee1b570c4ad3a57bd7aec085b1b4 P cd75a17ab2604397adab03bb8b5fd75c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:03.176719  6799 raft_consensus.cc:2468] T 4275cf08e63345f993bce8664eada830 P b7ab4784c7344b939bc36f639286f377 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 15.
W20260709 13:21:03.182365  6845 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:21:03.153316 12959 consensus_meta.cc:287] T 711ef6523deb4cbe8ef2ba61e1c21c98 P cd75a17ab2604397adab03bb8b5fd75c: Time spent flushing consensus metadata: real 0.844s	user 0.014s	sys 0.001s
I20260709 13:21:03.143296 12895 raft_consensus.cc:493] T 07a92dd554674067a83a9cb68c4773f2 P b7ab4784c7344b939bc36f639286f377 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:03.098347 12691 raft_consensus.cc:515] T e77e330a82df4b43a745d57a68f6f057 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } }
I20260709 13:21:03.151175 12906 raft_consensus.cc:2749] T 17587d6730594da4a56fa13a353232a1 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 23 FOLLOWER]: Leader election lost for term 22. Reason: Vote denied by peer b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817) with higher term. Message: Invalid argument: T 17587d6730594da4a56fa13a353232a1 P b7ab4784c7344b939bc36f639286f377 [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 22. Current term is 23.
I20260709 13:21:03.160703 12594 raft_consensus.cc:2804] T be1a92657f494cac8dd227d152f50151 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:21:03.167594 12811 raft_consensus.cc:493] T 20f6842e26174571996b8dea4151d4be P b7ab4784c7344b939bc36f639286f377 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
W20260709 13:21:03.234756  6697 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 52529.8us
I20260709 13:21:03.149649 12631 raft_consensus.cc:493] T a1704639a875409b9959353527b3fd68 P b7ab4784c7344b939bc36f639286f377 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:03.236327  7494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8cee0accdb8499c86d4414b72565a38" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:21:03.116454 12741 raft_consensus.cc:515] T 7887766dc6784fcaa42b35c05fea7a99 P cd75a17ab2604397adab03bb8b5fd75c [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:03.253271 12685 leader_election.cc:290] T d33d5ee8ef6f415593d8df52063161ad P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:21:03.168548 12551 raft_consensus.cc:2749] T dbdf895bba214ff68685a24fd17dfb5d P ccd8a4c3bfe3413cb2ae219b09aea832 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:21:03.232730 12698 raft_consensus.cc:2749] T f3f9c2e2bf644115957398fe4c9459db P b7ab4784c7344b939bc36f639286f377 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:21:03.256028  6875 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58592 (request call id 534) took 1014 ms. Trace:
I20260709 13:21:03.253268 12741 leader_election.cc:290] T 7887766dc6784fcaa42b35c05fea7a99 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:21:03.257055 12741 raft_consensus.cc:493] T 2c240553ce044eedb41541d72b9475d7 P cd75a17ab2604397adab03bb8b5fd75c [term 17 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:21:03.258103 12741 raft_consensus.cc:515] T 2c240553ce044eedb41541d72b9475d7 P cd75a17ab2604397adab03bb8b5fd75c [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:03.260370 12741 leader_election.cc:290] T 2c240553ce044eedb41541d72b9475d7 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:21:03.261123 12741 raft_consensus.cc:493] T ce4f062dcd314d43a63ca74067cb5ee3 P cd75a17ab2604397adab03bb8b5fd75c [term 15 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:21:03.261650 12896 leader_election.cc:290] T 427c124d773f483294511e80fe340075 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:21:03.150916 12927 consensus_queue.cc:1048] T d33d5ee8ef6f415593d8df52063161ad P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.082s
I20260709 13:21:03.245378 12895 raft_consensus.cc:515] T 07a92dd554674067a83a9cb68c4773f2 P b7ab4784c7344b939bc36f639286f377 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:03.264056 12895 leader_election.cc:290] T 07a92dd554674067a83a9cb68c4773f2 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:21:03.264710 12741 raft_consensus.cc:515] T ce4f062dcd314d43a63ca74067cb5ee3 P cd75a17ab2604397adab03bb8b5fd75c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } attrs { replace: true } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:21:03.265266 12543 leader_election.cc:290] T 22ccee1b570c4ad3a57bd7aec085b1b4 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:21:03.265822 12543 raft_consensus.cc:493] T 713b5728a197487c9300b310ab94e5a3 P cd75a17ab2604397adab03bb8b5fd75c [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:21:03.266289 12543 raft_consensus.cc:515] T 713b5728a197487c9300b310ab94e5a3 P cd75a17ab2604397adab03bb8b5fd75c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:03.267709 12741 leader_election.cc:290] T ce4f062dcd314d43a63ca74067cb5ee3 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:21:03.269145  6873 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58592 (request call id 532) took 1032 ms. Trace:
W20260709 13:21:03.271436 12907 consensus_meta.cc:287] T 4d9def8b32fd443aa94ab1420b06837b P ccd8a4c3bfe3413cb2ae219b09aea832: Time spent flushing consensus metadata: real 0.730s	user 0.010s	sys 0.000s
I20260709 13:21:03.216447 12965 consensus_queue.cc:237] T 17587d6730594da4a56fa13a353232a1 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 21.15, Last appended by leader: 15, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:21:03.174199 12986 raft_consensus.cc:740] T 44bde925b2e541b69890d70715b85176 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
I20260709 13:21:03.248070 12594 raft_consensus.cc:493] T be1a92657f494cac8dd227d152f50151 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 7ba59cc884714e8aa5f3f0ecaed84cbb)
I20260709 13:21:03.269632  6873 rpcz_store.cc:276] 0709 13:21:02.237016 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:21:02.237816 (+   800us) service_pool.cc:224] Handling call
0709 13:21:02.245064 (+  7248us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:21:02.269688 (+ 24624us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:21:02.269732 (+    44us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:21:02.286477 (+ 16745us) log.cc:844] Serialized 52 byte log entry
0709 13:21:02.695579 (+409102us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:21:02.735342 (+ 39763us) log.cc:844] Serialized 14 byte log entry
0709 13:21:02.920550 (+185208us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:21:02.920632 (+    82us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:21:03.268871 (+348239us) raft_consensus.cc:1685] finished
0709 13:21:03.268899 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:21:03.269073 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":208811,"prepare.queue_time_us":37345,"prepare.run_cpu_time_us":34,"prepare.run_wall_time_us":35,"raft.queue_time_us":246034,"raft.run_cpu_time_us":124,"raft.run_wall_time_us":5097,"spinlock_wait_cycles":63970688,"thread_start_us":387243,"threads_started":1,"wal-append.queue_time_us":489657}
I20260709 13:21:03.276541 12944 raft_consensus.cc:3055] T 7ba5dac66ab5497e9e336f2a3c28cda5 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:21:03.295104 12944 raft_consensus.cc:740] T 7ba5dac66ab5497e9e336f2a3c28cda5 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 7ba59cc884714e8aa5f3f0ecaed84cbb, State: Running, Role: LEADER
I20260709 13:21:03.289981 12957 raft_consensus.cc:493] T f58dc08b12a2494bb9a1372837970ca2 P cd75a17ab2604397adab03bb8b5fd75c [term 18 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:21:03.324151  7494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce4f062dcd314d43a63ca74067cb5ee3" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:21:03.325601 12561 leader_election.cc:290] T 3a485a995abc4807b6e511e45419f737 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:21:03.291572  6873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4275cf08e63345f993bce8664eada830" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:21:03.327662  6873 raft_consensus.cc:2468] T 4275cf08e63345f993bce8664eada830 P cd75a17ab2604397adab03bb8b5fd75c [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 14.
I20260709 13:21:03.331163  6873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77e330a82df4b43a745d57a68f6f057" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:21:03.332285  6873 raft_consensus.cc:3060] T e77e330a82df4b43a745d57a68f6f057 P cd75a17ab2604397adab03bb8b5fd75c [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:21:03.332629  7466 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 337660us
I20260709 13:21:03.329804  6879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe20b4b48823486ca3b9c648db6ce8aa" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:21:03.345145  7503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "427c124d773f483294511e80fe340075" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
W20260709 13:21:03.251232 12905 consensus_meta.cc:287] T 7887766dc6784fcaa42b35c05fea7a99 P ccd8a4c3bfe3413cb2ae219b09aea832: Time spent flushing consensus metadata: real 0.838s	user 0.010s	sys 0.005s
I20260709 13:21:03.348578  6879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "427c124d773f483294511e80fe340075" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:21:03.352993  6697 leader_election.cc:304] T 4275cf08e63345f993bce8664eada830 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:21:03.350919  6879 raft_consensus.cc:2468] T 427c124d773f483294511e80fe340075 P cd75a17ab2604397adab03bb8b5fd75c [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 16.
W20260709 13:21:03.353191  7500 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.697s	user 0.000s	sys 0.035s
W20260709 13:21:03.355770  7500 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.700s	user 0.000s	sys 0.036s
W20260709 13:21:03.281369 12787 consensus_meta.cc:287] T bb7fa124c3bf4ef9ab65a407cb008441 P b7ab4784c7344b939bc36f639286f377: Time spent flushing consensus metadata: real 0.785s	user 0.008s	sys 0.002s
I20260709 13:21:03.279850 12760 raft_consensus.cc:3060] T 95a75bfe094d4bdc963aba3f08dfcd25 P cd75a17ab2604397adab03bb8b5fd75c [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:21:03.275739 12898 consensus_meta.cc:287] T 7ba5dac66ab5497e9e336f2a3c28cda5 P b7ab4784c7344b939bc36f639286f377: Time spent flushing consensus metadata: real 0.771s	user 0.008s	sys 0.001s
I20260709 13:21:03.286077 12594 raft_consensus.cc:3060] T be1a92657f494cac8dd227d152f50151 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:21:03.273465 12691 leader_election.cc:290] T e77e330a82df4b43a745d57a68f6f057 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 19 election: Requested vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:21:03.327529 12927 raft_consensus.cc:493] T f58dc08b12a2494bb9a1372837970ca2 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:21:03.232528 12959 raft_consensus.cc:515] T 711ef6523deb4cbe8ef2ba61e1c21c98 P cd75a17ab2604397adab03bb8b5fd75c [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:03.292833 12631 raft_consensus.cc:515] T a1704639a875409b9959353527b3fd68 P b7ab4784c7344b939bc36f639286f377 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:03.359607 12891 raft_consensus.cc:493] T de3186201e1a40d0b335eeb8b4e256e0 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:03.380443  7494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe20b4b48823486ca3b9c648db6ce8aa" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
W20260709 13:21:03.443938  7496 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.900s	user 0.023s	sys 0.007s
I20260709 13:21:03.356895  7500 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50744 (request call id 491) took 1077 ms. Trace:
I20260709 13:21:03.272010 12907 raft_consensus.cc:515] T 4d9def8b32fd443aa94ab1420b06837b P ccd8a4c3bfe3413cb2ae219b09aea832 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
W20260709 13:21:03.459215  7496 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.916s	user 0.023s	sys 0.007s
I20260709 13:21:03.457849  7500 rpcz_store.cc:276] 0709 13:21:02.279205 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:21:02.279493 (+   288us) service_pool.cc:224] Handling call
0709 13:21:02.279838 (+   345us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:21:02.280078 (+   240us) raft_consensus.cc:1534] Early marking committed up to index 13
0709 13:21:02.654993 (+374915us) log.cc:844] Serialized 14 byte log entry
0709 13:21:03.356455 (+701462us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:21:03.356538 (+    83us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:21:03.356607 (+    69us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:21:03.356700 (+    93us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:21:03.356836 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":505960,"prepare.run_cpu_time_us":69,"prepare.run_wall_time_us":12023,"thread_start_us":1056006,"threads_started":2}
I20260709 13:21:03.460897  6873 raft_consensus.cc:2468] T e77e330a82df4b43a745d57a68f6f057 P cd75a17ab2604397adab03bb8b5fd75c [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 19.
I20260709 13:21:03.436092 12543 leader_election.cc:290] T 713b5728a197487c9300b310ab94e5a3 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:21:03.380056 12905 raft_consensus.cc:2804] T 4275cf08e63345f993bce8664eada830 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:21:03.281489 12811 raft_consensus.cc:515] T 20f6842e26174571996b8dea4151d4be P b7ab4784c7344b939bc36f639286f377 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:03.292027 12974 raft_consensus.cc:515] T 7a734b5ab7834e05a8c422208acc58b1 P b7ab4784c7344b939bc36f639286f377 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } attrs { replace: true } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:21:03.487758  6873 raft_consensus.cc:1275] T 3d65025eea89441290d85dd053810e31 P cd75a17ab2604397adab03bb8b5fd75c [term 18 FOLLOWER]: Refusing update from remote peer b7ab4784c7344b939bc36f639286f377: Log matching property violated. Preceding OpId in replica: term: 17 index: 9. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
I20260709 13:21:03.477649  6697 leader_election.cc:304] T e77e330a82df4b43a745d57a68f6f057 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:21:03.447850 12898 raft_consensus.cc:2749] T 7ba5dac66ab5497e9e336f2a3c28cda5 P b7ab4784c7344b939bc36f639286f377 [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:21:03.438279 12662 raft_consensus.cc:3055] T 3411566abe2d4c9bb4b2adfdd05e6f17 P cd75a17ab2604397adab03bb8b5fd75c [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:21:03.487957  6874 raft_consensus.cc:2393] T 711ef6523deb4cbe8ef2ba61e1c21c98 P cd75a17ab2604397adab03bb8b5fd75c [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7ab4784c7344b939bc36f639286f377 in current term 20: Already voted for candidate cd75a17ab2604397adab03bb8b5fd75c in this term.
I20260709 13:21:03.324209 12957 raft_consensus.cc:515] T f58dc08b12a2494bb9a1372837970ca2 P cd75a17ab2604397adab03bb8b5fd75c [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:03.371768 12739 raft_consensus.cc:493] T 9e326172347f45e99a0d482b5d8ef768 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
W20260709 13:21:03.496893  6695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 359678us
I20260709 13:21:03.510613  6728 raft_consensus.cc:1240] T 4d9def8b32fd443aa94ab1420b06837b P ccd8a4c3bfe3413cb2ae219b09aea832 [term 18 FOLLOWER]: Rejecting Update request from peer b7ab4784c7344b939bc36f639286f377 for earlier term 17. Current term is 18. Ops: [17.9-17.9]
I20260709 13:21:03.438468 12625 raft_consensus.cc:493] T 2c240553ce044eedb41541d72b9475d7 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:21:03.438640 12928 raft_consensus.cc:493] T 3a485a995abc4807b6e511e45419f737 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:21:03.448902 12730 raft_consensus.cc:493] T f5be3a11b23d4ea9b08300a2789821c7 P b7ab4784c7344b939bc36f639286f377 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:03.285215 12986 consensus_queue.cc:260] T 44bde925b2e541b69890d70715b85176 P ccd8a4c3bfe3413cb2ae219b09aea832 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:03.519887  6726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c37d41cd9164c15a6826ca62a851a69" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:21:03.488516 12905 raft_consensus.cc:493] T 4275cf08e63345f993bce8664eada830 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:03.525247  6804 raft_consensus.cc:1240] T 7ba5dac66ab5497e9e336f2a3c28cda5 P b7ab4784c7344b939bc36f639286f377 [term 18 FOLLOWER]: Rejecting Update request from peer 7ba59cc884714e8aa5f3f0ecaed84cbb for earlier term 17. Current term is 18. Ops: []
W20260709 13:21:03.517503  6772 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 414817us
W20260709 13:21:03.526494  6696 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:21:03.529794  7467 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:21:03.502153 12566 leader_election.cc:290] T 7c37d41cd9164c15a6826ca62a851a69 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 17 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:21:03.452549 12927 raft_consensus.cc:515] T f58dc08b12a2494bb9a1372837970ca2 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:03.509984 12662 raft_consensus.cc:740] T 3411566abe2d4c9bb4b2adfdd05e6f17 P cd75a17ab2604397adab03bb8b5fd75c [term 15 LEADER]: Becoming Follower/Learner. State: Replica: cd75a17ab2604397adab03bb8b5fd75c, State: Running, Role: LEADER
I20260709 13:21:03.360476 12944 consensus_queue.cc:260] T 7ba5dac66ab5497e9e336f2a3c28cda5 P 7ba59cc884714e8aa5f3f0ecaed84cbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:21:03.373957 12787 raft_consensus.cc:515] T bb7fa124c3bf4ef9ab65a407cb008441 P b7ab4784c7344b939bc36f639286f377 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:21:03.533298  6770 leader_election.cc:304] T be1a92657f494cac8dd227d152f50151 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:21:03.534431  6772 leader_election.cc:304] T a3022224cc81473690653a83d4e99470 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:21:03.516449 12895 raft_consensus.cc:493] T bd6869f07b5a4885a0b99fbe60c3b175 P b7ab4784c7344b939bc36f639286f377 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:21:03.523948 12698 raft_consensus.cc:493] T 7887766dc6784fcaa42b35c05fea7a99 P b7ab4784c7344b939bc36f639286f377 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:03.475104 12891 raft_consensus.cc:515] T de3186201e1a40d0b335eeb8b4e256e0 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:03.532534 12986 raft_consensus.cc:3060] T 44bde925b2e541b69890d70715b85176 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:21:03.531389 12905 raft_consensus.cc:3060] T 4275cf08e63345f993bce8664eada830 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:21:03.558660  6772 leader_election.cc:304] T 9b3759de40694069b13c0f8bd40e5709 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:21:03.560396 12787 leader_election.cc:290] T bb7fa124c3bf4ef9ab65a407cb008441 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 18 election: Requested vote from peers cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:21:03.561183 12787 raft_consensus.cc:2749] T a3022224cc81473690653a83d4e99470 P b7ab4784c7344b939bc36f639286f377 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:21:03.518144 12625 raft_consensus.cc:515] T 2c240553ce044eedb41541d72b9475d7 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:03.531582 13025 raft_consensus.cc:2804] T e77e330a82df4b43a745d57a68f6f057 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:21:03.524585 12739 raft_consensus.cc:515] T 9e326172347f45e99a0d482b5d8ef768 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:03.519691 12730 raft_consensus.cc:515] T f5be3a11b23d4ea9b08300a2789821c7 P b7ab4784c7344b939bc36f639286f377 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:03.544317 13016 raft_consensus.cc:493] T 1528ab62b6fe4e3099d08f141afee116 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:03.517570 12928 raft_consensus.cc:515] T 3a485a995abc4807b6e511e45419f737 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:03.546676 12893 raft_consensus.cc:2749] T be1a92657f494cac8dd227d152f50151 P b7ab4784c7344b939bc36f639286f377 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:21:03.538589 12555 consensus_queue.cc:1059] T c4db81d9d329422bb3b4160ca4ac2d1d P b7ab4784c7344b939bc36f639286f377 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: INVALID_TERM, Last received: 15.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.035s
I20260709 13:21:03.566574 13015 raft_consensus.cc:493] T f4b8bd455d5a47c18a1380839c6e0d61 P cd75a17ab2604397adab03bb8b5fd75c [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:03.566766 12944 raft_consensus.cc:3060] T 7ba5dac66ab5497e9e336f2a3c28cda5 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:21:03.533744 12898 consensus_queue.cc:1048] T 3d65025eea89441290d85dd053810e31 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.043s
I20260709 13:21:03.568701 13014 raft_consensus.cc:493] T 4b8cacb381b746da8d0049b0a83b41dd P cd75a17ab2604397adab03bb8b5fd75c [term 18 FOLLOWER]: Starting pre-election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
W20260709 13:21:03.628122  6770 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 87346.7us
I20260709 13:21:03.579712 13022 raft_consensus.cc:493] T 4f00a2e87e56452083b759f60d461ee3 P cd75a17ab2604397adab03bb8b5fd75c [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:03.578338 12965 raft_consensus.cc:2749] T 9b3759de40694069b13c0f8bd40e5709 P b7ab4784c7344b939bc36f639286f377 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:21:03.630614  6728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a92dd554674067a83a9cb68c4773f2" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 17 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
W20260709 13:21:03.617985 12929 consensus_meta.cc:287] T 20f6842e26174571996b8dea4151d4be P ccd8a4c3bfe3413cb2ae219b09aea832: Time spent flushing consensus metadata: real 0.910s	user 0.007s	sys 0.007s
I20260709 13:21:03.647511  6728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d33d5ee8ef6f415593d8df52063161ad" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:21:03.647866  6879 raft_consensus.cc:1275] T f5be3a11b23d4ea9b08300a2789821c7 P cd75a17ab2604397adab03bb8b5fd75c [term 17 FOLLOWER]: Refusing update from remote peer ccd8a4c3bfe3413cb2ae219b09aea832: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 13:21:03.555836 12698 raft_consensus.cc:515] T 7887766dc6784fcaa42b35c05fea7a99 P b7ab4784c7344b939bc36f639286f377 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:03.546685 12895 raft_consensus.cc:515] T bd6869f07b5a4885a0b99fbe60c3b175 P b7ab4784c7344b939bc36f639286f377 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:03.597633 13025 raft_consensus.cc:697] T e77e330a82df4b43a745d57a68f6f057 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 19 LEADER]: Becoming Leader. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
I20260709 13:21:03.617255 13016 raft_consensus.cc:515] T 1528ab62b6fe4e3099d08f141afee116 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:21:03.645581 12974 leader_election.cc:290] T 7a734b5ab7834e05a8c422208acc58b1 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 19 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:21:03.645366 13022 raft_consensus.cc:515] T 4f00a2e87e56452083b759f60d461ee3 P cd75a17ab2604397adab03bb8b5fd75c [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
W20260709 13:21:03.651299  7466 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 201748us
W20260709 13:21:03.655719  6772 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 95044.6us
I20260709 13:21:03.662025  6728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1704639a875409b9959353527b3fd68" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:21:03.666247  6697 leader_election.cc:304] T fe20b4b48823486ca3b9c648db6ce8aa P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:21:03.669314 12691 raft_consensus.cc:2749] T fe20b4b48823486ca3b9c648db6ce8aa P ccd8a4c3bfe3413cb2ae219b09aea832 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:21:03.666802  6728 raft_consensus.cc:2468] T a1704639a875409b9959353527b3fd68 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 18.
I20260709 13:21:03.667243  6772 leader_election.cc:304] T 3411566abe2d4c9bb4b2adfdd05e6f17 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:21:03.664955  6725 raft_consensus.cc:1240] T 713b5728a197487c9300b310ab94e5a3 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 15 FOLLOWER]: Rejecting Update request from peer b7ab4784c7344b939bc36f639286f377 for earlier term 14. Current term is 15. Ops: []
W20260709 13:21:03.684279 13018 log.cc:927] Time spent T fe20b4b48823486ca3b9c648db6ce8aa P ccd8a4c3bfe3413cb2ae219b09aea832: Append to log took a long time: real 0.118s	user 0.001s	sys 0.000s
I20260709 13:21:03.684702 12698 leader_election.cc:290] T 7887766dc6784fcaa42b35c05fea7a99 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:21:03.685770 12974 raft_consensus.cc:2749] T 3411566abe2d4c9bb4b2adfdd05e6f17 P b7ab4784c7344b939bc36f639286f377 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:21:03.687321 12928 leader_election.cc:290] T 3a485a995abc4807b6e511e45419f737 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:21:03.690826  6772 leader_election.cc:304] T 30e88460611e47b2ba16a46a30b5f416 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:21:03.624459 12662 consensus_queue.cc:260] T 3411566abe2d4c9bb4b2adfdd05e6f17 P cd75a17ab2604397adab03bb8b5fd75c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:03.693858 12957 leader_election.cc:290] T f58dc08b12a2494bb9a1372837970ca2 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:21:03.694334 12625 leader_election.cc:290] T 2c240553ce044eedb41541d72b9475d7 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
W20260709 13:21:03.694972 13032 log.cc:927] Time spent T bb3d8792045a4583ae2e965b1350a5b4 P 7ba59cc884714e8aa5f3f0ecaed84cbb: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
W20260709 13:21:03.695904 13009 log.cc:927] Time spent T 4f00a2e87e56452083b759f60d461ee3 P 7ba59cc884714e8aa5f3f0ecaed84cbb: Append to log took a long time: real 0.163s	user 0.000s	sys 0.001s
I20260709 13:21:03.696447 13025 consensus_queue.cc:237] T e77e330a82df4b43a745d57a68f6f057 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.10, Last appended by leader: 10, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } }
I20260709 13:21:03.671684 12959 leader_election.cc:290] T 711ef6523deb4cbe8ef2ba61e1c21c98 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 20 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:21:03.666589 13029 raft_consensus.cc:493] T bd6869f07b5a4885a0b99fbe60c3b175 P cd75a17ab2604397adab03bb8b5fd75c [term 18 FOLLOWER]: Starting pre-election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:21:03.654714 12929 consensus_queue.cc:1048] T f5be3a11b23d4ea9b08300a2789821c7 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.025s
I20260709 13:21:03.705250  6728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a734b5ab7834e05a8c422208acc58b1" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:21:03.715322  6728 raft_consensus.cc:3060] T 7a734b5ab7834e05a8c422208acc58b1 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:21:03.630321 13015 raft_consensus.cc:515] T f4b8bd455d5a47c18a1380839c6e0d61 P cd75a17ab2604397adab03bb8b5fd75c [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:03.682695  6770 leader_election.cc:304] T a1704639a875409b9959353527b3fd68 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
I20260709 13:21:03.714316 12811 leader_election.cc:290] T 20f6842e26174571996b8dea4151d4be P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:21:03.680500 12631 leader_election.cc:290] T a1704639a875409b9959353527b3fd68 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:21:03.681514 12872 raft_consensus.cc:493] T ce4f062dcd314d43a63ca74067cb5ee3 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:21:03.680743 12907 leader_election.cc:290] T 4d9def8b32fd443aa94ab1420b06837b P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 18 election: Requested vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:21:03.671217 12893 consensus_queue.cc:1059] T 4d9def8b32fd443aa94ab1420b06837b P b7ab4784c7344b939bc36f639286f377 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: INVALID_TERM, Last received: 15.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.036s
I20260709 13:21:03.649262 13014 raft_consensus.cc:515] T 4b8cacb381b746da8d0049b0a83b41dd P cd75a17ab2604397adab03bb8b5fd75c [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:21:03.739873  6878 raft_consensus.cc:2410] T 95a75bfe094d4bdc963aba3f08dfcd25 P cd75a17ab2604397adab03bb8b5fd75c [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ccd8a4c3bfe3413cb2ae219b09aea832 for term 16 because replica has last-logged OpId of term: 14 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 7.
I20260709 13:21:03.740849  6732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5be3a11b23d4ea9b08300a2789821c7" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 18 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:21:03.714468 12543 raft_consensus.cc:493] T b56bf91d90824c959e21e0cee5ba1816 P cd75a17ab2604397adab03bb8b5fd75c [term 17 FOLLOWER]: Starting pre-election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:21:03.721517 12662 raft_consensus.cc:3060] T 3411566abe2d4c9bb4b2adfdd05e6f17 P cd75a17ab2604397adab03bb8b5fd75c [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:21:03.720317 12698 raft_consensus.cc:2749] T 30e88460611e47b2ba16a46a30b5f416 P b7ab4784c7344b939bc36f639286f377 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:21:03.728606 12566 raft_consensus.cc:2804] T a1704639a875409b9959353527b3fd68 P b7ab4784c7344b939bc36f639286f377 [term 18 FOLLOWER]: Leader pre-election won for term 19
W20260709 13:21:03.739970 12704 consensus_meta.cc:287] T e31b9971c15848dea59d4d4130141d9e P ccd8a4c3bfe3413cb2ae219b09aea832: Time spent flushing consensus metadata: real 0.956s	user 0.010s	sys 0.003s
I20260709 13:21:03.737802 12959 raft_consensus.cc:493] T de3186201e1a40d0b335eeb8b4e256e0 P cd75a17ab2604397adab03bb8b5fd75c [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:03.752321  7500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f00a2e87e56452083b759f60d461ee3" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:21:03.754890  6728 raft_consensus.cc:2468] T 7a734b5ab7834e05a8c422208acc58b1 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 19.
I20260709 13:21:03.755488  6732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6869f07b5a4885a0b99fbe60c3b175" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:21:03.773569  6728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7887766dc6784fcaa42b35c05fea7a99" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:21:03.774231  6728 raft_consensus.cc:2468] T 7887766dc6784fcaa42b35c05fea7a99 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 19.
I20260709 13:21:03.775069  6728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20f6842e26174571996b8dea4151d4be" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:21:03.775621  6728 raft_consensus.cc:2468] T 20f6842e26174571996b8dea4151d4be P ccd8a4c3bfe3413cb2ae219b09aea832 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 18.
I20260709 13:21:03.776520 12811 raft_consensus.cc:3055] T 4d9def8b32fd443aa94ab1420b06837b P b7ab4784c7344b939bc36f639286f377 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:21:03.772419 12704 raft_consensus.cc:515] T e31b9971c15848dea59d4d4130141d9e P ccd8a4c3bfe3413cb2ae219b09aea832 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:03.776914 12811 raft_consensus.cc:740] T 4d9def8b32fd443aa94ab1420b06837b P b7ab4784c7344b939bc36f639286f377 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
I20260709 13:21:03.777644  6730 raft_consensus.cc:1240] T e31b9971c15848dea59d4d4130141d9e P ccd8a4c3bfe3413cb2ae219b09aea832 [term 16 FOLLOWER]: Rejecting Update request from peer b7ab4784c7344b939bc36f639286f377 for earlier term 15. Current term is 16. Ops: [15.9-15.9]
I20260709 13:21:03.746011 12543 raft_consensus.cc:515] T b56bf91d90824c959e21e0cee5ba1816 P cd75a17ab2604397adab03bb8b5fd75c [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:03.756105 12895 leader_election.cc:290] T bd6869f07b5a4885a0b99fbe60c3b175 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:21:03.748955 13039 consensus_queue.cc:1048] T 3d65025eea89441290d85dd053810e31 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.035s
I20260709 13:21:03.780791 12543 leader_election.cc:290] T b56bf91d90824c959e21e0cee5ba1816 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:21:03.779281 12959 raft_consensus.cc:515] T de3186201e1a40d0b335eeb8b4e256e0 P cd75a17ab2604397adab03bb8b5fd75c [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:03.783826  7496 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50742 (request call id 565) took 1262 ms. Trace:
I20260709 13:21:03.784329  7496 rpcz_store.cc:276] 0709 13:21:02.521914 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:21:02.522056 (+   142us) service_pool.cc:224] Handling call
0709 13:21:02.522436 (+   380us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:21:02.522891 (+   455us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:21:02.522926 (+    35us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:21:02.543145 (+ 20219us) log.cc:844] Serialized 52 byte log entry
0709 13:21:03.474136 (+930991us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:21:03.509939 (+ 35803us) log.cc:844] Serialized 14 byte log entry
0709 13:21:03.510160 (+   221us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:21:03.510228 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:21:03.783494 (+273266us) raft_consensus.cc:1685] finished
0709 13:21:03.783526 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:21:03.783728 (+   202us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":29786,"prepare.run_cpu_time_us":66,"prepare.run_wall_time_us":5194,"raft.queue_time_us":201,"raft.run_cpu_time_us":207,"raft.run_wall_time_us":210,"thread_start_us":930491,"threads_started":1,"wal-append.queue_time_us":1000038}
I20260709 13:21:03.787678 12959 leader_election.cc:290] T de3186201e1a40d0b335eeb8b4e256e0 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:21:03.777802 12811 consensus_queue.cc:260] T 4d9def8b32fd443aa94ab1420b06837b P b7ab4784c7344b939bc36f639286f377 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 17.9, Last appended by leader: 9, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
W20260709 13:21:03.791349  6844 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 1.233s	user 0.010s	sys 0.017s
W20260709 13:21:03.791827  6844 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 1.234s	user 0.010s	sys 0.017s
I20260709 13:21:03.750087 12927 leader_election.cc:290] T f58dc08b12a2494bb9a1372837970ca2 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:21:03.791895 12811 raft_consensus.cc:3060] T 4d9def8b32fd443aa94ab1420b06837b P b7ab4784c7344b939bc36f639286f377 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:21:03.794317 13014 leader_election.cc:290] T 4b8cacb381b746da8d0049b0a83b41dd P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:21:03.795737  7496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b8cacb381b746da8d0049b0a83b41dd" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:21:03.782388 13016 leader_election.cc:290] T 1528ab62b6fe4e3099d08f141afee116 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
W20260709 13:21:03.796396  6772 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 53147.1us
W20260709 13:21:03.796758  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 1.23955e+06us
W20260709 13:21:03.797267  6881 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.634s	user 0.049s	sys 0.044s
W20260709 13:21:03.802124  6881 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.645s	user 0.050s	sys 0.044s
I20260709 13:21:03.807067  6844 leader_election.cc:304] T 20f6842e26174571996b8dea4151d4be P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:21:03.801128 12802 raft_consensus.cc:493] T 4f00a2e87e56452083b759f60d461ee3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 18 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:21:03.814139  6844 leader_election.cc:304] T d33d5ee8ef6f415593d8df52063161ad P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:21:03.815959  6844 leader_election.cc:304] T 9e326172347f45e99a0d482b5d8ef768 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:21:03.757458 12566 raft_consensus.cc:493] T a1704639a875409b9959353527b3fd68 P b7ab4784c7344b939bc36f639286f377 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:03.723413 13026 consensus_queue.cc:1059] T c4db81d9d329422bb3b4160ca4ac2d1d P b7ab4784c7344b939bc36f639286f377 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: INVALID_TERM, Last received: 15.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.073s
I20260709 13:21:03.757058 13022 leader_election.cc:290] T 4f00a2e87e56452083b759f60d461ee3 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
W20260709 13:21:03.828202  6695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 282793us
I20260709 13:21:03.829981  6695 leader_election.cc:304] T 404190ce4ce94cecbfcb6ea9d1dd8626 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb
I20260709 13:21:03.798898 12891 leader_election.cc:290] T de3186201e1a40d0b335eeb8b4e256e0 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:21:03.798646 12957 raft_consensus.cc:493] T bb3d8792045a4583ae2e965b1350a5b4 P cd75a17ab2604397adab03bb8b5fd75c [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 7ba59cc884714e8aa5f3f0ecaed84cbb)
I20260709 13:21:03.833688 12957 raft_consensus.cc:515] T bb3d8792045a4583ae2e965b1350a5b4 P cd75a17ab2604397adab03bb8b5fd75c [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:21:03.741986 12872 raft_consensus.cc:515] T ce4f062dcd314d43a63ca74067cb5ee3 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } attrs { replace: true } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:21:03.720009 13029 raft_consensus.cc:515] T bd6869f07b5a4885a0b99fbe60c3b175 P cd75a17ab2604397adab03bb8b5fd75c [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:03.822330  6844 leader_election.cc:304] T dbdf895bba214ff68685a24fd17dfb5d P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:21:03.837370  7496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3d8792045a4583ae2e965b1350a5b4" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:21:03.811900 13014 raft_consensus.cc:2749] T 20f6842e26174571996b8dea4151d4be P cd75a17ab2604397adab03bb8b5fd75c [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:21:03.820685 12543 raft_consensus.cc:2749] T 9e326172347f45e99a0d482b5d8ef768 P cd75a17ab2604397adab03bb8b5fd75c [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:21:03.835819 12957 leader_election.cc:290] T bb3d8792045a4583ae2e965b1350a5b4 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:21:03.818998 12959 raft_consensus.cc:2749] T d33d5ee8ef6f415593d8df52063161ad P cd75a17ab2604397adab03bb8b5fd75c [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:21:03.822208 12631 raft_consensus.cc:493] T b56bf91d90824c959e21e0cee5ba1816 P b7ab4784c7344b939bc36f639286f377 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:21:03.830701 12566 raft_consensus.cc:3060] T a1704639a875409b9959353527b3fd68 P b7ab4784c7344b939bc36f639286f377 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:21:03.843281  6727 raft_consensus.cc:1240] T e77e330a82df4b43a745d57a68f6f057 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 19 LEADER]: Rejecting Update request from peer b7ab4784c7344b939bc36f639286f377 for earlier term 18. Current term is 19. Ops: []
I20260709 13:21:03.844434  6844 leader_election.cc:304] T c4db81d9d329422bb3b4160ca4ac2d1d P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:21:03.809383 12802 raft_consensus.cc:515] T 4f00a2e87e56452083b759f60d461ee3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:21:03.853399  6805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "427c124d773f483294511e80fe340075" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
W20260709 13:21:03.866288 13043 log.cc:927] Time spent T e31b9971c15848dea59d4d4130141d9e P cd75a17ab2604397adab03bb8b5fd75c: Append to log took a long time: real 0.094s	user 0.001s	sys 0.000s
W20260709 13:21:03.866786  7469 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:21:03.837644 13050 raft_consensus.cc:2804] T 404190ce4ce94cecbfcb6ea9d1dd8626 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:21:03.845608 12881 raft_consensus.cc:2804] T dbdf895bba214ff68685a24fd17dfb5d P cd75a17ab2604397adab03bb8b5fd75c [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:21:03.874373 13030 raft_consensus.cc:493] T 95a75bfe094d4bdc963aba3f08dfcd25 P cd75a17ab2604397adab03bb8b5fd75c [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:03.891641 13030 raft_consensus.cc:515] T 95a75bfe094d4bdc963aba3f08dfcd25 P cd75a17ab2604397adab03bb8b5fd75c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } attrs { replace: true } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:21:03.892150  6803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d9def8b32fd443aa94ab1420b06837b" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 18 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:21:03.894618 13030 leader_election.cc:290] T 95a75bfe094d4bdc963aba3f08dfcd25 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:21:03.869159  6805 raft_consensus.cc:2468] T 427c124d773f483294511e80fe340075 P b7ab4784c7344b939bc36f639286f377 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 16.
I20260709 13:21:03.869827  6807 raft_consensus.cc:1275] T ab432e62819d499eaaf3dd55481dd930 P b7ab4784c7344b939bc36f639286f377 [term 20 FOLLOWER]: Refusing update from remote peer ccd8a4c3bfe3413cb2ae219b09aea832: Log matching property violated. Preceding OpId in replica: term: 17 index: 9. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
I20260709 13:21:03.862794 12927 consensus_queue.cc:1048] T f5be3a11b23d4ea9b08300a2789821c7 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.033s
I20260709 13:21:03.895761  6805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8cee0accdb8499c86d4414b72565a38" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:21:03.862754 12957 raft_consensus.cc:2804] T c4db81d9d329422bb3b4160ca4ac2d1d P cd75a17ab2604397adab03bb8b5fd75c [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:21:03.870065  6806 raft_consensus.cc:1275] T d33d5ee8ef6f415593d8df52063161ad P b7ab4784c7344b939bc36f639286f377 [term 15 FOLLOWER]: Refusing update from remote peer ccd8a4c3bfe3413cb2ae219b09aea832: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:21:03.894090 13050 raft_consensus.cc:493] T 404190ce4ce94cecbfcb6ea9d1dd8626 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 7ba59cc884714e8aa5f3f0ecaed84cbb)
I20260709 13:21:03.868532  6801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77e330a82df4b43a745d57a68f6f057" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
W20260709 13:21:03.895984  6773 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:21:03.909274  7467 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:21:03.877628  7498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a734b5ab7834e05a8c422208acc58b1" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb"
I20260709 13:21:03.880470  7500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb7fa124c3bf4ef9ab65a407cb008441" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb"
I20260709 13:21:03.910809  7500 raft_consensus.cc:3060] T bb7fa124c3bf4ef9ab65a407cb008441 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:21:03.911432  7494 raft_consensus.cc:1275] T 17587d6730594da4a56fa13a353232a1 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 23 FOLLOWER]: Refusing update from remote peer b7ab4784c7344b939bc36f639286f377: Log matching property violated. Preceding OpId in replica: term: 20 index: 14. Preceding OpId from leader: term: 23 index: 16. (index mismatch)
I20260709 13:21:03.914145 12897 raft_consensus.cc:3055] T 713b5728a197487c9300b310ab94e5a3 P b7ab4784c7344b939bc36f639286f377 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:21:03.914635 12897 raft_consensus.cc:740] T 713b5728a197487c9300b310ab94e5a3 P b7ab4784c7344b939bc36f639286f377 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
I20260709 13:21:03.918542  6804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce4f062dcd314d43a63ca74067cb5ee3" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:21:03.920898 12957 raft_consensus.cc:697] T c4db81d9d329422bb3b4160ca4ac2d1d P cd75a17ab2604397adab03bb8b5fd75c [term 18 LEADER]: Becoming Leader. State: Replica: cd75a17ab2604397adab03bb8b5fd75c, State: Running, Role: LEADER
W20260709 13:21:03.922145 13000 log.cc:927] Time spent T a3022224cc81473690653a83d4e99470 P cd75a17ab2604397adab03bb8b5fd75c: Append to log took a long time: real 1.080s	user 0.005s	sys 0.004s
I20260709 13:21:03.922077 12957 consensus_queue.cc:237] T c4db81d9d329422bb3b4160ca4ac2d1d P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:03.873742 12907 raft_consensus.cc:493] T 713b5728a197487c9300b310ab94e5a3 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:03.923646  6880 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53416 (request call id 3584) took 1753 ms. Trace:
I20260709 13:21:03.850597 12631 raft_consensus.cc:515] T b56bf91d90824c959e21e0cee5ba1816 P b7ab4784c7344b939bc36f639286f377 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:03.924144  6880 rpcz_store.cc:276] 0709 13:21:02.169954 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:21:02.170404 (+   450us) service_pool.cc:224] Handling call
0709 13:21:02.172299 (+  1895us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:21:02.216207 (+ 43908us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:21:02.216262 (+    55us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:21:02.268645 (+ 52383us) log.cc:844] Serialized 52 byte log entry
0709 13:21:02.648233 (+379588us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:21:02.648371 (+   138us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:21:02.648634 (+   263us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:21:03.921455 (+1272821us) spinlock_profiling.cc:243] Waited 50 ms on lock 0x7b4400022b4c. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0c745db1 00007fcc0c7e3c85 00007fcc0c7e46a2 00007fcc0f5561db 00007fcc0f551aaf 00007fcc0f54586e 00007fcc0f544bb6 00007fcc0f5447d8 00007fcc0f54e221 00007fcc0f54e1d9 00007fcc0f54e169
0709 13:21:03.923304 (+  1849us) raft_consensus.cc:1685] finished
0709 13:21:03.923327 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:21:03.923581 (+   254us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":40072,"raft.queue_time_us":55613,"raft.run_cpu_time_us":159,"raft.run_wall_time_us":8966,"spinlock_wait_cycles":115028224,"thread_start_us":346458,"threads_started":1,"wal-append.queue_time_us":494710}
I20260709 13:21:03.926432 12631 leader_election.cc:290] T b56bf91d90824c959e21e0cee5ba1816 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:21:03.926115  6880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c37d41cd9164c15a6826ca62a851a69" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:21:03.927349  6880 raft_consensus.cc:2393] T 7c37d41cd9164c15a6826ca62a851a69 P cd75a17ab2604397adab03bb8b5fd75c [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate b7ab4784c7344b939bc36f639286f377 in current term 17: Already voted for candidate cd75a17ab2604397adab03bb8b5fd75c in this term.
W20260709 13:21:03.927981 13048 log.cc:927] Time spent T 4d9def8b32fd443aa94ab1420b06837b P cd75a17ab2604397adab03bb8b5fd75c: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260709 13:21:03.928303  6880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a92dd554674067a83a9cb68c4773f2" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 17 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:21:03.881414  6731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1528ab62b6fe4e3099d08f141afee116" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
W20260709 13:21:03.930163  6878 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53416 (request call id 3587) took 1701 ms (client timeout 1868 ms). Trace:
I20260709 13:21:03.851117 12928 consensus_queue.cc:1048] T 07a92dd554674067a83a9cb68c4773f2 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.073s
I20260709 13:21:03.930827  6731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "713b5728a197487c9300b310ab94e5a3" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:21:03.887591 12886 raft_consensus.cc:493] T c4db81d9d329422bb3b4160ca4ac2d1d P ccd8a4c3bfe3413cb2ae219b09aea832 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:03.888978 12881 raft_consensus.cc:493] T dbdf895bba214ff68685a24fd17dfb5d P cd75a17ab2604397adab03bb8b5fd75c [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:03.932579 12881 raft_consensus.cc:3060] T dbdf895bba214ff68685a24fd17dfb5d P cd75a17ab2604397adab03bb8b5fd75c [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:21:03.936167 12997 log.cc:927] Time spent T f3f9c2e2bf644115957398fe4c9459db P b7ab4784c7344b939bc36f639286f377: Append to log took a long time: real 1.240s	user 0.004s	sys 0.000s
I20260709 13:21:03.937237 12543 raft_consensus.cc:493] T 7c44c4849aa54f2b94d1f1bef9ed546f P cd75a17ab2604397adab03bb8b5fd75c [term 19 FOLLOWER]: Starting pre-election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:21:03.937824 12543 raft_consensus.cc:515] T 7c44c4849aa54f2b94d1f1bef9ed546f P cd75a17ab2604397adab03bb8b5fd75c [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:03.940620  6798 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:32966 (request call id 1498) took 2076 ms. Trace:
I20260709 13:21:03.941107  6798 rpcz_store.cc:276] 0709 13:21:01.863857 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:21:02.018536 (+154679us) service_pool.cc:224] Handling call
0709 13:21:02.018980 (+   444us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 13:21:02.148713 (+129733us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:21:02.148747 (+    34us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 13:21:02.165783 (+ 17036us) log.cc:844] Serialized 78 byte log entry
0709 13:21:02.243686 (+ 77903us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:21:02.285559 (+ 41873us) log.cc:844] Serialized 14 byte log entry
0709 13:21:02.290743 (+  5184us) log.cc:844] Serialized 14 byte log entry
0709 13:21:02.293781 (+  3038us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:21:02.293857 (+    76us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:21:02.503441 (+209584us) spinlock_profiling.cc:243] Waited 2.93 ms on lock 0x7b180047b180. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc15785de1 00007fcc157925b1 00007fcc0c88b2a6 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc148d3aa1 00007fcc148cab37 00007fcc148ca9ca 00007fcc149c226f
0709 13:21:02.504781 (+  1340us) spinlock_profiling.cc:243] Waited 6.16 ms on lock 0x7b4800061ed8. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc148d3aa1 00007fcc148cab37 00007fcc148ca9ca 00007fcc149c226f 00007fcc149c1f37 00007fcc149d655c 00007fcc149d6508 00007fcc149d6488 00007fcc149d6443 00007fcc149d56ec 00007fcc138ffa96
0709 13:21:03.935348 (+1430567us) spinlock_profiling.cc:243] Waited 18 ms on lock 0x7b4400022b4c. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0c745db1 00007fcc0c7e3c85 00007fcc0c7e46a2 00007fcc0f5561db 00007fcc0f551aaf 00007fcc0f54586e 00007fcc0f544bb6 00007fcc0f5447d8 00007fcc0f54e221 00007fcc0f54e1d9 00007fcc0f54e169
0709 13:21:03.940345 (+  4997us) raft_consensus.cc:1685] finished
0709 13:21:03.940373 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:21:03.940552 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3835,"prepare.queue_time_us":38550,"prepare.run_cpu_time_us":127,"prepare.run_wall_time_us":2807,"raft.queue_time_us":31107,"raft.run_cpu_time_us":3537,"raft.run_wall_time_us":219371,"spinlock_wait_cycles":62331648,"thread_start_us":171518,"threads_started":2,"wal-append.queue_time_us":427807}
I20260709 13:21:03.945695 12802 leader_election.cc:290] T 4f00a2e87e56452083b759f60d461ee3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:21:03.946050  6772 leader_election.cc:304] T 07a92dd554674067a83a9cb68c4773f2 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:21:03.897182  6805 raft_consensus.cc:1240] T 3411566abe2d4c9bb4b2adfdd05e6f17 P b7ab4784c7344b939bc36f639286f377 [term 16 FOLLOWER]: Rejecting Update request from peer cd75a17ab2604397adab03bb8b5fd75c for earlier term 15. Current term is 16. Ops: [15.10-15.10]
I20260709 13:21:03.897691  6874 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53406 (request call id 2848) took 1479 ms. Trace:
I20260709 13:21:03.898799  6877 raft_consensus.cc:1240] T 711ef6523deb4cbe8ef2ba61e1c21c98 P cd75a17ab2604397adab03bb8b5fd75c [term 20 FOLLOWER]: Rejecting Update request from peer ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 19. Current term is 20. Ops: []
I20260709 13:21:03.904841  6806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7887766dc6784fcaa42b35c05fea7a99" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
W20260709 13:21:03.930567  6878 rpcz_store.cc:269] 0709 13:21:02.228801 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:21:02.229075 (+   274us) service_pool.cc:224] Handling call
0709 13:21:03.929974 (+1700899us) spinlock_profiling.cc:243] Waited 1.49 s on lock 0x7b54001752d4. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f9ae2fa 00007fcc1496fb17 00007fcc0deea6d4 00007fcc0deea662 00007fcc0deea591 00007fcc0deea50c 00007fcc0dee97c2 00007fcc0dce548c 00007fcc0dce48c6 00007fcc0dce426f
0709 13:21:03.930110 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3420902144}
W20260709 13:21:03.874646  6695 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:21:03.905575  7496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a75bfe094d4bdc963aba3f08dfcd25" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:21:03.948832  6874 rpcz_store.cc:276] 0709 13:21:02.418501 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:21:02.506820 (+ 88319us) service_pool.cc:224] Handling call
0709 13:21:03.897469 (+1390649us) spinlock_profiling.cc:243] Waited 980 ms on lock 0x7b54001e96d4. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f9ae2fa 00007fcc1496fb17 00007fcc0deea6d4 00007fcc0deea662 00007fcc0deea591 00007fcc0deea50c 00007fcc0dee97c2 00007fcc0dce548c 00007fcc0dce48c6 00007fcc0dce426f
0709 13:21:03.897627 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2253350144}
I20260709 13:21:03.950444  6806 raft_consensus.cc:2393] T 7887766dc6784fcaa42b35c05fea7a99 P b7ab4784c7344b939bc36f639286f377 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c in current term 19: Already voted for candidate b7ab4784c7344b939bc36f639286f377 in this term.
I20260709 13:21:03.919971  6804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22ccee1b570c4ad3a57bd7aec085b1b4" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:21:03.953364  6879 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53406 (request call id 2868) took 1133 ms. Trace:
I20260709 13:21:03.954694  6805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f58dc08b12a2494bb9a1372837970ca2" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:21:03.951556  7496 raft_consensus.cc:2468] T 95a75bfe094d4bdc963aba3f08dfcd25 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 14 LEARNER]: Leader pre-election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 14.
I20260709 13:21:03.950791  6880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1704639a875409b9959353527b3fd68" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:21:03.960090  6806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a485a995abc4807b6e511e45419f737" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:21:03.961208  6806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a485a995abc4807b6e511e45419f737" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:21:03.961838  6804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "711ef6523deb4cbe8ef2ba61e1c21c98" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:21:03.962285  6798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "713b5728a197487c9300b310ab94e5a3" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:21:03.256603  6875 rpcz_store.cc:276] 0709 13:21:02.241601 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:21:02.409674 (+168073us) service_pool.cc:224] Handling call
0709 13:21:02.410168 (+   494us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:21:02.431777 (+ 21609us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:21:02.431823 (+    46us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:21:02.445862 (+ 14039us) log.cc:844] Serialized 26 byte log entry
0709 13:21:03.034761 (+588899us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:21:03.158557 (+123796us) log.cc:844] Serialized 14 byte log entry
0709 13:21:03.158833 (+   276us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:21:03.158938 (+   105us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:21:03.255757 (+ 96819us) raft_consensus.cc:1685] finished
0709 13:21:03.255780 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:21:03.255946 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":93974,"prepare.queue_time_us":180131,"prepare.run_wall_time_us":40,"raft.queue_time_us":98826,"raft.run_cpu_time_us":332,"raft.run_wall_time_us":12967,"thread_start_us":487686,"threads_started":1,"wal-append.queue_time_us":697076}
I20260709 13:21:03.962428  6804 raft_consensus.cc:3060] T 711ef6523deb4cbe8ef2ba61e1c21c98 P b7ab4784c7344b939bc36f639286f377 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:21:03.964818  6805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f00a2e87e56452083b759f60d461ee3" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:21:03.964926  6806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f58dc08b12a2494bb9a1372837970ca2" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:21:03.874477 12625 raft_consensus.cc:493] T 3d65025eea89441290d85dd053810e31 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:03.890010 12872 leader_election.cc:290] T ce4f062dcd314d43a63ca74067cb5ee3 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:21:03.939981 12543 leader_election.cc:290] T 7c44c4849aa54f2b94d1f1bef9ed546f P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:21:03.905838 13050 raft_consensus.cc:3060] T 404190ce4ce94cecbfcb6ea9d1dd8626 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:21:03.904184 12969 consensus_queue.cc:1048] T 3fa34c08b205435dba97346991aa1f92 P 7ba59cc884714e8aa5f3f0ecaed84cbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.084s
I20260709 13:21:03.957124 12831 raft_consensus.cc:493] T fe20b4b48823486ca3b9c648db6ce8aa P cd75a17ab2604397adab03bb8b5fd75c [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 7ba59cc884714e8aa5f3f0ecaed84cbb)
I20260709 13:21:03.955030  6879 rpcz_store.cc:276] 0709 13:21:02.832556 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:21:03.648895 (+816339us) service_pool.cc:224] Handling call
0709 13:21:03.650198 (+  1303us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:21:03.650590 (+   392us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:21:03.650624 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:21:03.659003 (+  8379us) log.cc:844] Serialized 26 byte log entry
0709 13:21:03.747712 (+ 88709us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:21:03.747772 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:21:03.747850 (+    78us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:21:03.953117 (+205267us) raft_consensus.cc:1685] finished
0709 13:21:03.953139 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:21:03.953297 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":529,"raft.run_cpu_time_us":148,"raft.run_wall_time_us":7524,"thread_start_us":38429,"threads_started":1,"wal-append.queue_time_us":158266}
I20260709 13:21:03.973868  6727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "711ef6523deb4cbe8ef2ba61e1c21c98" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:21:03.977473  6723 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49744 (request call id 654) took 1308 ms. Trace:
W20260709 13:21:04.002599  6772 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.68:45071, user_credentials={real_user=slave}} blocked reactor thread for 49366.8us
W20260709 13:21:03.899268 12991 consensus_meta.cc:287] T 7c37d41cd9164c15a6826ca62a851a69 P ccd8a4c3bfe3413cb2ae219b09aea832: Time spent flushing consensus metadata: real 1.244s	user 0.013s	sys 0.000s
I20260709 13:21:03.994618  6799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de3186201e1a40d0b335eeb8b4e256e0" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:21:03.994617  6801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c240553ce044eedb41541d72b9475d7" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:21:03.994473  6806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b56bf91d90824c959e21e0cee5ba1816" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:21:03.968389  6878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a734b5ab7834e05a8c422208acc58b1" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:21:04.010066  6878 raft_consensus.cc:3060] T 7a734b5ab7834e05a8c422208acc58b1 P cd75a17ab2604397adab03bb8b5fd75c [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:21:03.984944  6724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de3186201e1a40d0b335eeb8b4e256e0" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:21:04.012166  6724 raft_consensus.cc:2468] T de3186201e1a40d0b335eeb8b4e256e0 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 17.
I20260709 13:21:04.013353  6724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b8cacb381b746da8d0049b0a83b41dd" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:21:03.976848  6872 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53406 (request call id 2858) took 1327 ms. Trace:
I20260709 13:21:03.980304  6874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d33d5ee8ef6f415593d8df52063161ad" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:21:04.016644  6872 rpcz_store.cc:276] 0709 13:21:02.649589 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:21:03.122011 (+472422us) service_pool.cc:224] Handling call
0709 13:21:03.122361 (+   350us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:21:03.131332 (+  8971us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:21:03.176506 (+ 45174us) log.cc:844] Serialized 14 byte log entry
0709 13:21:03.525298 (+348792us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:21:03.525369 (+    71us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:21:03.525443 (+    74us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:21:03.976505 (+451062us) spinlock_profiling.cc:243] Waited 8.7 ms on lock 0x7b54000a64d4. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f9aae01 00007fcc0f9a983e 00007fcc1496e419 00007fcc0dee5bd4 00007fcc0dee5b62 00007fcc0dee5a91 00007fcc0dee5a0c 00007fcc0dee4cc2 00007fcc0dce548c 00007fcc0dce48c6
0709 13:21:03.976572 (+    67us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:21:03.976777 (+   205us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":31395,"prepare.queue_time_us":83929,"prepare.run_cpu_time_us":43,"prepare.run_wall_time_us":43,"raft.queue_time_us":115,"raft.run_cpu_time_us":170,"raft.run_wall_time_us":8591,"spinlock_wait_cycles":20010240,"thread_start_us":348334,"threads_started":1,"wal-append.queue_time_us":397533}
I20260709 13:21:04.019241  6872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20f6842e26174571996b8dea4151d4be" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:21:04.023553  6872 raft_consensus.cc:2393] T 20f6842e26174571996b8dea4151d4be P cd75a17ab2604397adab03bb8b5fd75c [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7ab4784c7344b939bc36f639286f377 in current term 18: Already voted for candidate cd75a17ab2604397adab03bb8b5fd75c in this term.
I20260709 13:21:04.010195  6732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c240553ce044eedb41541d72b9475d7" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:21:04.025301  6732 raft_consensus.cc:2468] T 2c240553ce044eedb41541d72b9475d7 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 17.
I20260709 13:21:04.025446  6724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a485a995abc4807b6e511e45419f737" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:21:03.998876  6723 rpcz_store.cc:276] 0709 13:21:02.669076 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:21:02.673570 (+  4494us) service_pool.cc:224] Handling call
0709 13:21:02.698388 (+ 24818us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:21:02.962661 (+264273us) raft_consensus.cc:1534] Early marking committed up to index 12
0709 13:21:03.005294 (+ 42633us) log.cc:844] Serialized 14 byte log entry
0709 13:21:03.372874 (+367580us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:21:03.372928 (+    54us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:21:03.372980 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:21:03.977230 (+604250us) spinlock_profiling.cc:243] Waited 181 ms on lock 0x7b5400058054. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f9aae01 00007fcc0f9a983e 00007fcc1496e419 00007fcc0dee5bd4 00007fcc0dee5b62 00007fcc0dee5a91 00007fcc0dee5a0c 00007fcc0dee4cc2 00007fcc0dce548c 00007fcc0dce48c6
0709 13:21:03.977278 (+    48us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:21:03.977398 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":21293,"prepare.queue_time_us":44495,"prepare.run_cpu_time_us":47,"prepare.run_wall_time_us":43,"raft.queue_time_us":6928,"raft.run_cpu_time_us":158,"raft.run_wall_time_us":8390,"spinlock_wait_cycles":417142528,"thread_start_us":367185,"threads_started":1,"wal-append.queue_time_us":531042}
I20260709 13:21:03.897348 12893 raft_consensus.cc:493] T 4f00a2e87e56452083b759f60d461ee3 P b7ab4784c7344b939bc36f639286f377 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:03.897818 12998 raft_consensus.cc:493] T de3186201e1a40d0b335eeb8b4e256e0 P b7ab4784c7344b939bc36f639286f377 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:04.032775  6872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb7fa124c3bf4ef9ab65a407cb008441" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:21:03.956946 12974 raft_consensus.cc:2749] T 07a92dd554674067a83a9cb68c4773f2 P b7ab4784c7344b939bc36f639286f377 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:21:04.045130  6875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b56bf91d90824c959e21e0cee5ba1816" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:21:04.045800  6875 raft_consensus.cc:2468] T b56bf91d90824c959e21e0cee5ba1816 P cd75a17ab2604397adab03bb8b5fd75c [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 17.
I20260709 13:21:04.036723  7500 raft_consensus.cc:2468] T bb7fa124c3bf4ef9ab65a407cb008441 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 18.
W20260709 13:21:03.983394 13040 log.cc:927] Time spent T 34f36d59d88f40fe8a2805e604fc6c0a P cd75a17ab2604397adab03bb8b5fd75c: Append to log took a long time: real 0.240s	user 0.000s	sys 0.001s
I20260709 13:21:03.997452  6880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6869f07b5a4885a0b99fbe60c3b175" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:21:03.877261 12990 raft_consensus.cc:493] T bb3d8792045a4583ae2e965b1350a5b4 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 7ba59cc884714e8aa5f3f0ecaed84cbb)
I20260709 13:21:04.039036  6802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c240553ce044eedb41541d72b9475d7" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:21:03.915484 12897 consensus_queue.cc:260] T 713b5728a197487c9300b310ab94e5a3 P b7ab4784c7344b939bc36f639286f377 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
W20260709 13:21:03.971805 12945 consensus_meta.cc:287] T 7a734b5ab7834e05a8c422208acc58b1 P 7ba59cc884714e8aa5f3f0ecaed84cbb: Time spent flushing consensus metadata: real 0.885s	user 0.012s	sys 0.000s
I20260709 13:21:04.040786  6772 leader_election.cc:304] T 711ef6523deb4cbe8ef2ba61e1c21c98 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:21:04.043784  6872 raft_consensus.cc:3060] T bb7fa124c3bf4ef9ab65a407cb008441 P cd75a17ab2604397adab03bb8b5fd75c [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:21:03.987179 12995 log.cc:927] Time spent T 3a485a995abc4807b6e511e45419f737 P b7ab4784c7344b939bc36f639286f377: Append to log took a long time: real 0.994s	user 0.003s	sys 0.000s
I20260709 13:21:04.048604  6879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7887766dc6784fcaa42b35c05fea7a99" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:21:03.884965 13015 leader_election.cc:290] T f4b8bd455d5a47c18a1380839c6e0d61 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:21:04.050335 12580 raft_consensus.cc:493] T f3f9c2e2bf644115957398fe4c9459db P ccd8a4c3bfe3413cb2ae219b09aea832 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader cd75a17ab2604397adab03bb8b5fd75c)
I20260709 13:21:04.031257 12991 raft_consensus.cc:515] T 7c37d41cd9164c15a6826ca62a851a69 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:04.044113 12543 raft_consensus.cc:493] T 44bde925b2e541b69890d70715b85176 P cd75a17ab2604397adab03bb8b5fd75c [term 17 FOLLOWER]: Starting pre-election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:21:04.059039 12896 raft_consensus.cc:493] T 24ee15416e3145beaa1b8183453729a3 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader cd75a17ab2604397adab03bb8b5fd75c)
I20260709 13:21:03.992515 13030 raft_consensus.cc:493] T 853ac0a8cbd64ce99457f170216d4d0f P cd75a17ab2604397adab03bb8b5fd75c [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:21:04.112406  6726 raft_consensus.cc:2368] T 7c37d41cd9164c15a6826ca62a851a69 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate b7ab4784c7344b939bc36f639286f377 for earlier term 17. Current term is 18.
I20260709 13:21:03.968629 12625 raft_consensus.cc:515] T 3d65025eea89441290d85dd053810e31 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:04.064488  6732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce4f062dcd314d43a63ca74067cb5ee3" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:21:04.047013  6725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4275cf08e63345f993bce8664eada830" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:21:04.073432  6880 raft_consensus.cc:2468] T bd6869f07b5a4885a0b99fbe60c3b175 P cd75a17ab2604397adab03bb8b5fd75c [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 18.
I20260709 13:21:04.074204  6727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b56bf91d90824c959e21e0cee5ba1816" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:21:03.968130 13014 raft_consensus.cc:493] T f09c2a98de1a4decabd0ff900dd44caa P cd75a17ab2604397adab03bb8b5fd75c [term 18 FOLLOWER]: Starting pre-election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
W20260709 13:21:04.088287  6845 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:21:04.087127  6879 raft_consensus.cc:2468] T 7887766dc6784fcaa42b35c05fea7a99 P cd75a17ab2604397adab03bb8b5fd75c [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 18.
W20260709 13:21:04.091003  6772 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 50307.9us
I20260709 13:21:04.082409 13039 raft_consensus.cc:493] T d8cee0accdb8499c86d4414b72565a38 P b7ab4784c7344b939bc36f639286f377 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 7ba59cc884714e8aa5f3f0ecaed84cbb)
W20260709 13:21:04.102632 12986 consensus_meta.cc:287] T 44bde925b2e541b69890d70715b85176 P ccd8a4c3bfe3413cb2ae219b09aea832: Time spent flushing consensus metadata: real 0.538s	user 0.006s	sys 0.005s
I20260709 13:21:04.042747 12802 raft_consensus.cc:493] T 4b8cacb381b746da8d0049b0a83b41dd P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 18 FOLLOWER]: Starting pre-election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:21:03.957943 12907 raft_consensus.cc:515] T 713b5728a197487c9300b310ab94e5a3 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:04.176275 12907 leader_election.cc:290] T 713b5728a197487c9300b310ab94e5a3 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:21:04.176971 12907 raft_consensus.cc:493] T 9b3759de40694069b13c0f8bd40e5709 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:04.177527 12907 raft_consensus.cc:515] T 9b3759de40694069b13c0f8bd40e5709 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:04.056932  6723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b56bf91d90824c959e21e0cee5ba1816" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:21:04.181216  6723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f58dc08b12a2494bb9a1372837970ca2" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:21:04.182894  6874 raft_consensus.cc:2468] T d33d5ee8ef6f415593d8df52063161ad P cd75a17ab2604397adab03bb8b5fd75c [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 15.
I20260709 13:21:04.184393  6731 raft_consensus.cc:2393] T 713b5728a197487c9300b310ab94e5a3 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c in current term 15: Already voted for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in this term.
I20260709 13:21:04.038017  6724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7887766dc6784fcaa42b35c05fea7a99" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:21:04.185160  6724 raft_consensus.cc:2468] T 7887766dc6784fcaa42b35c05fea7a99 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 19.
I20260709 13:21:04.186403 12929 raft_consensus.cc:493] T 1528ab62b6fe4e3099d08f141afee116 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 7ba59cc884714e8aa5f3f0ecaed84cbb)
I20260709 13:21:04.187057 12929 raft_consensus.cc:515] T 1528ab62b6fe4e3099d08f141afee116 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:21:04.189489 12929 leader_election.cc:290] T 1528ab62b6fe4e3099d08f141afee116 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:21:04.105417  6873 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53406 (request call id 2866) took 1413 ms. Trace:
I20260709 13:21:04.229527  6873 rpcz_store.cc:276] 0709 13:21:02.692016 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:21:03.488791 (+796775us) service_pool.cc:224] Handling call
0709 13:21:03.489113 (+   322us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:21:03.512325 (+ 23212us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:21:03.512355 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:21:03.533165 (+ 20810us) log.cc:844] Serialized 26 byte log entry
0709 13:21:03.659174 (+126009us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:21:03.659234 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:21:03.659343 (+   109us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:21:04.105103 (+445760us) raft_consensus.cc:1685] finished
0709 13:21:04.105136 (+    33us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:21:04.105327 (+   191us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":14759,"raft.queue_time_us":23285,"raft.run_cpu_time_us":160,"raft.run_wall_time_us":8308,"thread_start_us":72109,"threads_started":1,"wal-append.queue_time_us":158225}
I20260709 13:21:04.109040 12991 leader_election.cc:290] T 7c37d41cd9164c15a6826ca62a851a69 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 18 election: Requested vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:21:04.099551 13015 raft_consensus.cc:493] T 3fa34c08b205435dba97346991aa1f92 P cd75a17ab2604397adab03bb8b5fd75c [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:04.231767  6873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c37d41cd9164c15a6826ca62a851a69" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:21:04.233390  6873 raft_consensus.cc:3060] T 7c37d41cd9164c15a6826ca62a851a69 P cd75a17ab2604397adab03bb8b5fd75c [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:21:04.233129 13015 raft_consensus.cc:515] T 3fa34c08b205435dba97346991aa1f92 P cd75a17ab2604397adab03bb8b5fd75c [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:21:03.967883 12905 raft_consensus.cc:515] T 4275cf08e63345f993bce8664eada830 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:04.237725 12905 leader_election.cc:290] T 4275cf08e63345f993bce8664eada830 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 16 election: Requested vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:21:04.061283 13029 leader_election.cc:290] T bd6869f07b5a4885a0b99fbe60c3b175 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:21:04.239187  6725 raft_consensus.cc:2368] T 4275cf08e63345f993bce8664eada830 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c for earlier term 15. Current term is 16.
I20260709 13:21:04.082472 12990 raft_consensus.cc:3060] T bb3d8792045a4583ae2e965b1350a5b4 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:21:04.241883 12730 leader_election.cc:290] T f5be3a11b23d4ea9b08300a2789821c7 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:21:04.242985  6803 raft_consensus.cc:2410] T 4d9def8b32fd443aa94ab1420b06837b P b7ab4784c7344b939bc36f639286f377 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate ccd8a4c3bfe3413cb2ae219b09aea832 for term 18 because replica has last-logged OpId of term: 17 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 8.
I20260709 13:21:04.244699  6803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de3186201e1a40d0b335eeb8b4e256e0" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:21:04.235749 13015 leader_election.cc:290] T 3fa34c08b205435dba97346991aa1f92 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:21:04.246224  6803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e31b9971c15848dea59d4d4130141d9e" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:21:03.990381 12831 raft_consensus.cc:515] T fe20b4b48823486ca3b9c648db6ce8aa P cd75a17ab2604397adab03bb8b5fd75c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:21:04.251138  7496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fa34c08b205435dba97346991aa1f92" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:21:04.251622  6877 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53416 (request call id 3591) took 1890 ms. Trace:
I20260709 13:21:04.252245  6877 rpcz_store.cc:276] 0709 13:21:02.361554 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:21:02.727655 (+366101us) service_pool.cc:224] Handling call
0709 13:21:03.898596 (+1170941us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:21:03.948983 (+ 50387us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:21:04.251364 (+302381us) spinlock_profiling.cc:243] Waited 1.17 s on lock 0x7b54001e96d0. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f9a98ad 00007fcc1496e419 00007fcc0dee5bd4 00007fcc0dee5b62 00007fcc0dee5a91 00007fcc0dee5a0c 00007fcc0dee4cc2 00007fcc0dce548c 00007fcc0dce48c6 00007fcc0dce426f
0709 13:21:04.251552 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2692305664}
I20260709 13:21:04.253620  6877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d65025eea89441290d85dd053810e31" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:21:04.030045 12898 consensus_queue.cc:1048] T 17587d6730594da4a56fa13a353232a1 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 14, Time since last communication: 0.070s
I20260709 13:21:04.090214 12555 raft_consensus.cc:493] T d8292e16e5654be6bc408560cf256aaa P b7ab4784c7344b939bc36f639286f377 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:21:04.256081 12555 raft_consensus.cc:515] T d8292e16e5654be6bc408560cf256aaa P b7ab4784c7344b939bc36f639286f377 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:03.946847 12886 raft_consensus.cc:515] T c4db81d9d329422bb3b4160ca4ac2d1d P ccd8a4c3bfe3413cb2ae219b09aea832 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:04.127394  6772 leader_election.cc:304] T b56bf91d90824c959e21e0cee5ba1816 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
W20260709 13:21:04.260478  6772 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 133189us
I20260709 13:21:04.263213  6772 leader_election.cc:304] T bb7fa124c3bf4ef9ab65a407cb008441 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, b7ab4784c7344b939bc36f639286f377; no voters: 
W20260709 13:21:04.264487  7469 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:21:04.266600  6772 leader_election.cc:304] T bd6869f07b5a4885a0b99fbe60c3b175 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:21:04.126084 13030 raft_consensus.cc:515] T 853ac0a8cbd64ce99457f170216d4d0f P cd75a17ab2604397adab03bb8b5fd75c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:04.153136 12625 leader_election.cc:290] T 3d65025eea89441290d85dd053810e31 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:21:04.156718  6727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3d8792045a4583ae2e965b1350a5b4" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:21:04.158227  6732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22ccee1b570c4ad3a57bd7aec085b1b4" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:21:04.169139 12897 raft_consensus.cc:3060] T 713b5728a197487c9300b310ab94e5a3 P b7ab4784c7344b939bc36f639286f377 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:21:04.092381 12945 raft_consensus.cc:515] T 7a734b5ab7834e05a8c422208acc58b1 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 18 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } attrs { replace: true } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:21:04.278705  7498 raft_consensus.cc:3060] T 7a734b5ab7834e05a8c422208acc58b1 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:21:04.278965 12850 raft_consensus.cc:2804] T bb7fa124c3bf4ef9ab65a407cb008441 P b7ab4784c7344b939bc36f639286f377 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:21:04.279778 12850 raft_consensus.cc:697] T bb7fa124c3bf4ef9ab65a407cb008441 P b7ab4784c7344b939bc36f639286f377 [term 18 LEADER]: Becoming Leader. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
I20260709 13:21:04.170113 12704 leader_election.cc:290] T e31b9971c15848dea59d4d4130141d9e P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 16 election: Requested vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:21:04.140333 13014 raft_consensus.cc:515] T f09c2a98de1a4decabd0ff900dd44caa P cd75a17ab2604397adab03bb8b5fd75c [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:04.281003 12850 consensus_queue.cc:237] T bb7fa124c3bf4ef9ab65a407cb008441 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:21:04.283563 12965 raft_consensus.cc:2804] T bd6869f07b5a4885a0b99fbe60c3b175 P b7ab4784c7344b939bc36f639286f377 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:21:04.284026 12965 raft_consensus.cc:493] T bd6869f07b5a4885a0b99fbe60c3b175 P b7ab4784c7344b939bc36f639286f377 [term 18 FOLLOWER]: Starting leader election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:21:04.284447 12965 raft_consensus.cc:3060] T bd6869f07b5a4885a0b99fbe60c3b175 P b7ab4784c7344b939bc36f639286f377 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:21:04.140053 12543 raft_consensus.cc:515] T 44bde925b2e541b69890d70715b85176 P cd75a17ab2604397adab03bb8b5fd75c [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:04.140585 12881 raft_consensus.cc:515] T dbdf895bba214ff68685a24fd17dfb5d P cd75a17ab2604397adab03bb8b5fd75c [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:04.287506 12881 leader_election.cc:290] T dbdf895bba214ff68685a24fd17dfb5d P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 17 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:21:04.186547  6724 raft_consensus.cc:1275] T a1704639a875409b9959353527b3fd68 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 18 FOLLOWER]: Refusing update from remote peer cd75a17ab2604397adab03bb8b5fd75c: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 13:21:04.102705  6802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1528ab62b6fe4e3099d08f141afee116" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:21:04.288547  6879 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53416 (request call id 3598) took 1107 ms. Trace:
I20260709 13:21:04.128484 12896 raft_consensus.cc:515] T 24ee15416e3145beaa1b8183453729a3 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:21:04.288938  6879 rpcz_store.cc:276] 0709 13:21:03.180715 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:21:04.139870 (+959155us) service_pool.cc:224] Handling call
0709 13:21:04.157586 (+ 17716us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:21:04.287555 (+129969us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:21:04.287590 (+    35us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:21:04.287637 (+    47us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:21:04.287674 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:21:04.288314 (+   640us) spinlock_profiling.cc:243] Waited 130 ms on lock 0x7b54001e7dd4. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f9aae01 00007fcc0f9a983e 00007fcc1496e419 00007fcc0dee5bd4 00007fcc0dee5b62 00007fcc0dee5a91 00007fcc0dee5a0c 00007fcc0dee4cc2 00007fcc0dce548c 00007fcc0dce48c6
0709 13:21:04.288358 (+    44us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:21:04.288485 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":298348800}
I20260709 13:21:04.291283  6879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a485a995abc4807b6e511e45419f737" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:21:04.296023  6880 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53416 (request call id 3602) took 1114 ms. Trace:
I20260709 13:21:04.296712  6880 rpcz_store.cc:276] 0709 13:21:03.181867 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:21:04.160949 (+979082us) service_pool.cc:224] Handling call
0709 13:21:04.161321 (+   372us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:21:04.295048 (+133727us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:21:04.295082 (+    34us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:21:04.295130 (+    48us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:21:04.295162 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:21:04.295741 (+   579us) spinlock_profiling.cc:243] Waited 133 ms on lock 0x7b54001e78d4. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f9aae01 00007fcc0f9a983e 00007fcc1496e419 00007fcc0dee5bd4 00007fcc0dee5b62 00007fcc0dee5a91 00007fcc0dee5a0c 00007fcc0dee4cc2 00007fcc0dce548c 00007fcc0dce48c6
0709 13:21:04.295787 (+    46us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:21:04.295953 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":307006848}
I20260709 13:21:04.100733  6801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f00a2e87e56452083b759f60d461ee3" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:21:04.199267  7500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce4f062dcd314d43a63ca74067cb5ee3" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:21:04.310397  6731 raft_consensus.cc:1240] T c4db81d9d329422bb3b4160ca4ac2d1d P ccd8a4c3bfe3413cb2ae219b09aea832 [term 18 FOLLOWER]: Rejecting Update request from peer b7ab4784c7344b939bc36f639286f377 for earlier term 17. Current term is 18. Ops: [17.10-17.10]
I20260709 13:21:04.197373 12739 leader_election.cc:290] T 9e326172347f45e99a0d482b5d8ef768 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:21:04.175812  6697 leader_election.cc:304] T 95a75bfe094d4bdc963aba3f08dfcd25 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:21:04.203797  6729 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49744 (request call id 655) took 1086 ms. Trace:
I20260709 13:21:04.072003 12998 raft_consensus.cc:515] T de3186201e1a40d0b335eeb8b4e256e0 P b7ab4784c7344b939bc36f639286f377 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
W20260709 13:21:04.208463 13046 log.cc:927] Time spent T 90d42e216d9741e190bca19a781291fd P cd75a17ab2604397adab03bb8b5fd75c: Append to log took a long time: real 0.304s	user 0.001s	sys 0.000s
I20260709 13:21:04.190927 13039 raft_consensus.cc:515] T d8cee0accdb8499c86d4414b72565a38 P b7ab4784c7344b939bc36f639286f377 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:21:04.213187  6876 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53406 (request call id 2867) took 1490 ms. Trace:
I20260709 13:21:04.678848  6876 rpcz_store.cc:276] 0709 13:21:02.723127 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:21:03.494721 (+771594us) service_pool.cc:224] Handling call
0709 13:21:03.495155 (+   434us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:21:03.512373 (+ 17218us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:21:03.512400 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:21:03.512841 (+   441us) log.cc:844] Serialized 26 byte log entry
0709 13:21:03.623075 (+110234us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:21:03.623115 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:21:03.623182 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:21:03.982701 (+359519us) spinlock_profiling.cc:243] Waited 1.78 ms on lock 0x7b4400022b4c. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0c745db1 00007fcc0c7e3c85 00007fcc0c7e46a2 00007fcc0f5561db 00007fcc0f551aaf 00007fcc0f54586e 00007fcc0f544bb6 00007fcc0f5447d8 00007fcc0f54e221 00007fcc0f54e1d9 00007fcc0f54e169
0709 13:21:04.212836 (+230135us) raft_consensus.cc:1685] finished
0709 13:21:04.212864 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:21:04.213117 (+   253us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":16804,"raft.queue_time_us":17495,"raft.run_cpu_time_us":276,"raft.run_wall_time_us":19430,"spinlock_wait_cycles":4132992,"thread_start_us":79757,"threads_started":1,"wal-append.queue_time_us":149517}
W20260709 13:21:04.217679 13051 log.cc:927] Time spent T e77e330a82df4b43a745d57a68f6f057 P ccd8a4c3bfe3413cb2ae219b09aea832: Append to log took a long time: real 0.290s	user 0.003s	sys 0.000s
I20260709 13:21:04.223161 12802 raft_consensus.cc:515] T 4b8cacb381b746da8d0049b0a83b41dd P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
W20260709 13:21:04.225026 13049 log.cc:927] Time spent T 90d42e216d9741e190bca19a781291fd P b7ab4784c7344b939bc36f639286f377: Append to log took a long time: real 0.175s	user 0.002s	sys 0.000s
I20260709 13:21:04.224826 12566 raft_consensus.cc:515] T a1704639a875409b9959353527b3fd68 P b7ab4784c7344b939bc36f639286f377 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:04.201231  6770 leader_election.cc:304] T 7887766dc6784fcaa42b35c05fea7a99 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
I20260709 13:21:04.227478 13027 raft_consensus.cc:3055] T c4db81d9d329422bb3b4160ca4ac2d1d P b7ab4784c7344b939bc36f639286f377 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:21:04.227861 13022 raft_consensus.cc:493] T d8292e16e5654be6bc408560cf256aaa P cd75a17ab2604397adab03bb8b5fd75c [term 17 FOLLOWER]: Starting pre-election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:21:04.228606 12662 raft_consensus.cc:493] T f03d0dbf16864ca4bc1bb5e4c0334c0f P cd75a17ab2604397adab03bb8b5fd75c [term 18 FOLLOWER]: Starting pre-election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:21:04.041085 12760 raft_consensus.cc:493] T 3d65025eea89441290d85dd053810e31 P cd75a17ab2604397adab03bb8b5fd75c [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:04.267256 13026 raft_consensus.cc:2804] T b56bf91d90824c959e21e0cee5ba1816 P b7ab4784c7344b939bc36f639286f377 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:21:04.267683 12974 raft_consensus.cc:493] T 7c44c4849aa54f2b94d1f1bef9ed546f P b7ab4784c7344b939bc36f639286f377 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:21:04.071537 12893 raft_consensus.cc:515] T 4f00a2e87e56452083b759f60d461ee3 P b7ab4784c7344b939bc36f639286f377 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:21:04.270977 12685 raft_consensus.cc:493] T 1528ab62b6fe4e3099d08f141afee116 P b7ab4784c7344b939bc36f639286f377 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:04.102686 12580 raft_consensus.cc:515] T f3f9c2e2bf644115957398fe4c9459db P ccd8a4c3bfe3413cb2ae219b09aea832 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:04.233459  6806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce4f062dcd314d43a63ca74067cb5ee3" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
W20260709 13:21:04.314361  6772 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 47828.6us
I20260709 13:21:04.348258  6880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d9def8b32fd443aa94ab1420b06837b" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 18 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:21:04.203052  6804 raft_consensus.cc:2468] T 711ef6523deb4cbe8ef2ba61e1c21c98 P b7ab4784c7344b939bc36f639286f377 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 20.
I20260709 13:21:04.745515  6804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d65025eea89441290d85dd053810e31" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:21:04.594098 12543 leader_election.cc:290] T 44bde925b2e541b69890d70715b85176 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
W20260709 13:21:04.408763 12970 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.113s	user 0.053s	sys 0.081s
I20260709 13:21:04.564524  6844 leader_election.cc:304] T 9b3759de40694069b13c0f8bd40e5709 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:21:04.596897  7500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe20b4b48823486ca3b9c648db6ce8aa" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:21:04.565917  6799 raft_consensus.cc:2468] T de3186201e1a40d0b335eeb8b4e256e0 P b7ab4784c7344b939bc36f639286f377 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 17.
I20260709 13:21:04.563329 12990 raft_consensus.cc:515] T bb3d8792045a4583ae2e965b1350a5b4 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:21:04.565084  7498 raft_consensus.cc:2468] T 7a734b5ab7834e05a8c422208acc58b1 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 19.
I20260709 13:21:04.484768  6879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c240553ce044eedb41541d72b9475d7" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:21:04.774847  6876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce4f062dcd314d43a63ca74067cb5ee3" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:21:04.433427 12907 leader_election.cc:290] T 9b3759de40694069b13c0f8bd40e5709 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:21:04.775609  6876 raft_consensus.cc:2468] T ce4f062dcd314d43a63ca74067cb5ee3 P cd75a17ab2604397adab03bb8b5fd75c [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 15.
I20260709 13:21:04.616669  6732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a734b5ab7834e05a8c422208acc58b1" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:21:04.785787  6805 raft_consensus.cc:2468] T 4f00a2e87e56452083b759f60d461ee3 P b7ab4784c7344b939bc36f639286f377 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 19.
I20260709 13:21:04.738621 13041 raft_consensus.cc:2804] T 7887766dc6784fcaa42b35c05fea7a99 P b7ab4784c7344b939bc36f639286f377 [term 19 FOLLOWER]: Leader pre-election won for term 20
W20260709 13:21:04.585283  6695 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:21:04.584883 12594 consensus_meta.cc:287] T be1a92657f494cac8dd227d152f50151 P ccd8a4c3bfe3413cb2ae219b09aea832: Time spent flushing consensus metadata: real 1.136s	user 0.007s	sys 0.011s
I20260709 13:21:04.584275 12945 leader_election.cc:290] T 7a734b5ab7834e05a8c422208acc58b1 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 18 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
W20260709 13:21:04.561437 12863 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.877s	user 0.007s	sys 0.014s
I20260709 13:21:04.812577 12907 raft_consensus.cc:493] T 22ccee1b570c4ad3a57bd7aec085b1b4 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
W20260709 13:21:04.812919 12863 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 2.146s	user 0.008s	sys 0.015s
I20260709 13:21:04.583500 12831 leader_election.cc:290] T fe20b4b48823486ca3b9c648db6ce8aa P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
W20260709 13:21:04.592278  6697 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 416513us
I20260709 13:21:04.581329 12886 leader_election.cc:290] T c4db81d9d329422bb3b4160ca4ac2d1d P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
W20260709 13:21:04.600092  6872 consensus_meta.cc:287] T bb7fa124c3bf4ef9ab65a407cb008441 P cd75a17ab2604397adab03bb8b5fd75c: Time spent flushing consensus metadata: real 0.516s	user 0.010s	sys 0.000s
I20260709 13:21:04.816783  6872 raft_consensus.cc:2468] T bb7fa124c3bf4ef9ab65a407cb008441 P cd75a17ab2604397adab03bb8b5fd75c [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 18.
I20260709 13:21:04.817428  6872 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53406 (request call id 2876) took 1011 ms. Trace:
I20260709 13:21:04.758329 12685 raft_consensus.cc:515] T 1528ab62b6fe4e3099d08f141afee116 P b7ab4784c7344b939bc36f639286f377 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:21:04.817812  6872 rpcz_store.cc:276] 0709 13:21:03.805733 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:21:04.032344 (+226611us) service_pool.cc:224] Handling call
0709 13:21:04.817337 (+784993us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:21:04.819087  6872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de3186201e1a40d0b335eeb8b4e256e0" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:21:04.354142  6729 rpcz_store.cc:276] 0709 13:21:03.117268 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:21:03.117588 (+   320us) service_pool.cc:224] Handling call
0709 13:21:03.118093 (+   505us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:21:03.150145 (+ 32052us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:21:03.150202 (+    57us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:21:03.981086 (+830884us) spinlock_profiling.cc:243] Waited 13.8 ms on lock 0x7b2c00000f48. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0e2a3a11 00007fcc0e2b3372 00007fcc0f9e5a01 00007fcc0f9aa43a 00007fcc0f9a983e 00007fcc1496e419 00007fcc0dee5bd4 00007fcc0dee5b62 00007fcc0dee5a91 00007fcc0dee5a0c 00007fcc0dee4cc2
0709 13:21:03.981754 (+   668us) log.cc:844] Serialized 52 byte log entry
0709 13:21:04.136728 (+154974us) raft_consensus.cc:1645] Marking committed up to 15
0709 13:21:04.137116 (+   388us) log.cc:844] Serialized 14 byte log entry
0709 13:21:04.143028 (+  5912us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:21:04.143113 (+    85us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:21:04.143155 (+    42us) raft_consensus.cc:1685] finished
0709 13:21:04.203556 (+ 60401us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:21:04.203727 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":40542,"prepare.queue_time_us":192,"prepare.run_cpu_time_us":48,"prepare.run_wall_time_us":50,"raft.queue_time_us":41315,"raft.run_cpu_time_us":298,"raft.run_wall_time_us":51749,"spinlock_wait_cycles":31635840,"thread_start_us":154460,"threads_started":1,"wal-append.queue_time_us":154892}
W20260709 13:21:04.630755  6878 consensus_meta.cc:287] T 7a734b5ab7834e05a8c422208acc58b1 P cd75a17ab2604397adab03bb8b5fd75c: Time spent flushing consensus metadata: real 0.620s	user 0.009s	sys 0.002s
I20260709 13:21:04.820745  6878 raft_consensus.cc:2468] T 7a734b5ab7834e05a8c422208acc58b1 P cd75a17ab2604397adab03bb8b5fd75c [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 19.
I20260709 13:21:04.821291  6878 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53406 (request call id 2878) took 1015 ms. Trace:
I20260709 13:21:04.821369 12893 leader_election.cc:290] T 4f00a2e87e56452083b759f60d461ee3 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:21:04.821678  6878 rpcz_store.cc:276] 0709 13:21:03.806274 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:21:03.963011 (+156737us) service_pool.cc:224] Handling call
0709 13:21:04.821219 (+858208us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:21:04.754590 12631 raft_consensus.cc:2749] T 711ef6523deb4cbe8ef2ba61e1c21c98 P b7ab4784c7344b939bc36f639286f377 [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:21:04.822755  6878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e31b9971c15848dea59d4d4130141d9e" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:21:04.590368  6873 raft_consensus.cc:2468] T 7c37d41cd9164c15a6826ca62a851a69 P cd75a17ab2604397adab03bb8b5fd75c [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 18.
I20260709 13:21:04.588436 13030 leader_election.cc:290] T 853ac0a8cbd64ce99457f170216d4d0f P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
W20260709 13:21:04.464867 12551 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.501s	user 0.009s	sys 0.012s
W20260709 13:21:04.654620  6845 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:21:04.603879 12988 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.904s	user 0.007s	sys 0.023s
I20260709 13:21:04.735780 13022 raft_consensus.cc:515] T d8292e16e5654be6bc408560cf256aaa P cd75a17ab2604397adab03bb8b5fd75c [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:04.760586 12555 leader_election.cc:290] T d8292e16e5654be6bc408560cf256aaa P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:21:04.819747  6872 raft_consensus.cc:2468] T de3186201e1a40d0b335eeb8b4e256e0 P cd75a17ab2604397adab03bb8b5fd75c [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 17.
I20260709 13:21:04.824025  6878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f58dc08b12a2494bb9a1372837970ca2" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:21:04.844900  6731 raft_consensus.cc:1240] T bb3d8792045a4583ae2e965b1350a5b4 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 17 FOLLOWER]: Rejecting Update request from peer 7ba59cc884714e8aa5f3f0ecaed84cbb for earlier term 16. Current term is 17. Ops: []
I20260709 13:21:04.827756  6802 raft_consensus.cc:2468] T 1528ab62b6fe4e3099d08f141afee116 P b7ab4784c7344b939bc36f639286f377 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in term 15.
I20260709 13:21:04.694556 13026 raft_consensus.cc:493] T b56bf91d90824c959e21e0cee5ba1816 P b7ab4784c7344b939bc36f639286f377 [term 17 FOLLOWER]: Starting leader election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:21:04.835204  6875 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53406 (request call id 2869) took 1991 ms. Trace:
I20260709 13:21:04.849078  6875 rpcz_store.cc:276] 0709 13:21:02.843556 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:21:04.097903 (+1254347us) service_pool.cc:224] Handling call
0709 13:21:04.129692 (+ 31789us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:21:04.130154 (+   462us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:21:04.130194 (+    40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:21:04.146138 (+ 15944us) log.cc:844] Serialized 26 byte log entry
0709 13:21:04.529857 (+383719us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:21:04.621752 (+ 91895us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:21:04.621840 (+    88us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:21:04.834942 (+213102us) raft_consensus.cc:1685] finished
0709 13:21:04.834968 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:21:04.835123 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":9640,"raft.run_cpu_time_us":163,"raft.run_wall_time_us":39591,"thread_start_us":312909,"threads_started":1,"wal-append.queue_time_us":560028}
I20260709 13:21:04.825392  6873 raft_consensus.cc:1275] T ab432e62819d499eaaf3dd55481dd930 P cd75a17ab2604397adab03bb8b5fd75c [term 20 FOLLOWER]: Refusing update from remote peer ccd8a4c3bfe3413cb2ae219b09aea832: Log matching property violated. Preceding OpId in replica: term: 17 index: 9. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
I20260709 13:21:04.851361  6873 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53416 (request call id 3606) took 1522 ms. Trace:
I20260709 13:21:04.851675  6873 rpcz_store.cc:276] 0709 13:21:03.329260 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:21:04.824682 (+1495422us) service_pool.cc:224] Handling call
0709 13:21:04.824998 (+   316us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:21:04.851064 (+ 26066us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:21:04.851303 (+   239us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:21:04.852192  6772 leader_election.cc:304] T d33d5ee8ef6f415593d8df52063161ad P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:21:04.681743  6803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c37d41cd9164c15a6826ca62a851a69" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:21:04.620276 12739 raft_consensus.cc:2749] T 95a75bfe094d4bdc963aba3f08dfcd25 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:21:04.659960 13054 log.cc:927] Time spent T 07a92dd554674067a83a9cb68c4773f2 P ccd8a4c3bfe3413cb2ae219b09aea832: Append to log took a long time: real 0.066s	user 0.001s	sys 0.000s
W20260709 13:21:04.691948  6770 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 490745us
W20260709 13:21:04.856980  6874 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.610s	user 0.092s	sys 0.131s
W20260709 13:21:04.696187  6723 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.512s	user 0.001s	sys 0.015s
W20260709 13:21:04.857434  6874 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.611s	user 0.092s	sys 0.131s
I20260709 13:21:04.858115  6723 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50004 (request call id 2876) took 1129 ms. Trace:
I20260709 13:21:04.858279  6878 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53416 (request call id 3608) took 1484 ms. Trace:
I20260709 13:21:04.858647  6878 rpcz_store.cc:276] 0709 13:21:03.373444 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:21:04.845045 (+1471601us) service_pool.cc:224] Handling call
0709 13:21:04.857777 (+ 12732us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:21:04.857971 (+   194us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:21:04.857994 (+    23us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:21:04.858035 (+    41us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:21:04.858066 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:21:04.858117 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:21:04.858216 (+    99us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:21:04.656394 12730 raft_consensus.cc:493] T b3f13b31a1f84f0d89d007eadd57924c P b7ab4784c7344b939bc36f639286f377 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:21:04.668910 12625 raft_consensus.cc:493] T 3fa34c08b205435dba97346991aa1f92 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 7ba59cc884714e8aa5f3f0ecaed84cbb)
I20260709 13:21:04.676335 12896 leader_election.cc:290] T 24ee15416e3145beaa1b8183453729a3 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
W20260709 13:21:04.693498 12785 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.643s	user 0.013s	sys 0.007s
W20260709 13:21:04.871735 12785 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.821s	user 0.013s	sys 0.007s
W20260709 13:21:04.756028  7469 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:21:04.872709 12730 raft_consensus.cc:515] T b3f13b31a1f84f0d89d007eadd57924c P b7ab4784c7344b939bc36f639286f377 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:21:04.875252 12730 leader_election.cc:290] T b3f13b31a1f84f0d89d007eadd57924c P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:21:04.876701  7466 leader_election.cc:304] T 1528ab62b6fe4e3099d08f141afee116 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, b7ab4784c7344b939bc36f639286f377; no voters: ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:21:04.877049  6731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b8cacb381b746da8d0049b0a83b41dd" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
W20260709 13:21:04.692417 13050 consensus_meta.cc:287] T 404190ce4ce94cecbfcb6ea9d1dd8626 P ccd8a4c3bfe3413cb2ae219b09aea832: Time spent flushing consensus metadata: real 0.708s	user 0.011s	sys 0.001s
I20260709 13:21:04.759703  6800 raft_consensus.cc:1240] T a1704639a875409b9959353527b3fd68 P b7ab4784c7344b939bc36f639286f377 [term 19 FOLLOWER]: Rejecting Update request from peer cd75a17ab2604397adab03bb8b5fd75c for earlier term 18. Current term is 19. Ops: []
W20260709 13:21:04.777281  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 212858us
I20260709 13:21:04.880123  6772 leader_election.cc:304] T 7a734b5ab7834e05a8c422208acc58b1 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:21:04.912158  6844 leader_election.cc:304] T 90d42e216d9741e190bca19a781291fd P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:21:04.915242  6844 leader_election.cc:304] T 1bf4668eeb70467fb3dc5a0289233b3c P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:21:04.776878  6881 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53406 (request call id 2857) took 2127 ms. Trace:
I20260709 13:21:04.781002  6804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a734b5ab7834e05a8c422208acc58b1" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:21:03.970805  5625 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:21:04.790373  6732 raft_consensus.cc:2368] T 7a734b5ab7834e05a8c422208acc58b1 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 7ba59cc884714e8aa5f3f0ecaed84cbb for earlier term 18. Current term is 19.
I20260709 13:21:04.916224  6881 rpcz_store.cc:276] 0709 13:21:02.649231 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:21:03.118422 (+469191us) service_pool.cc:224] Handling call
0709 13:21:03.156072 (+ 37650us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:21:03.156533 (+   461us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:21:03.156574 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:21:03.157176 (+   602us) log.cc:844] Serialized 26 byte log entry
0709 13:21:03.802617 (+645441us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:21:03.802675 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:21:03.802773 (+    98us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:21:04.776538 (+973765us) raft_consensus.cc:1685] finished
0709 13:21:04.776571 (+    33us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:21:04.776807 (+   236us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":17518,"raft.run_cpu_time_us":130,"raft.run_wall_time_us":37723,"thread_start_us":645045,"threads_started":1,"wal-append.queue_time_us":684472}
W20260709 13:21:04.762243 12970 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.467s	user 0.075s	sys 0.087s
I20260709 13:21:04.780854 12957 raft_consensus.cc:2749] T 9b3759de40694069b13c0f8bd40e5709 P cd75a17ab2604397adab03bb8b5fd75c [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:21:04.804247 12594 raft_consensus.cc:515] T be1a92657f494cac8dd227d152f50151 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:21:04.803399  6629 catalog_manager.cc:5697] T 427c124d773f483294511e80fe340075 P 7ba59cc884714e8aa5f3f0ecaed84cbb reported cstate change: term changed from 9 to 14, leader changed from b7ab4784c7344b939bc36f639286f377 (127.5.126.66) to 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68). New cstate: current_term: 14 leader_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:21:04.786949 13049 log.cc:927] Time spent T 90d42e216d9741e190bca19a781291fd P b7ab4784c7344b939bc36f639286f377: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
I20260709 13:21:04.805327  6880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5be3a11b23d4ea9b08300a2789821c7" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 18 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:21:04.940675  6880 raft_consensus.cc:2468] T f5be3a11b23d4ea9b08300a2789821c7 P cd75a17ab2604397adab03bb8b5fd75c [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 17.
I20260709 13:21:04.793272 13041 raft_consensus.cc:493] T 7887766dc6784fcaa42b35c05fea7a99 P b7ab4784c7344b939bc36f639286f377 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:21:04.811857 13052 log.cc:927] Time spent T be1a92657f494cac8dd227d152f50151 P 7ba59cc884714e8aa5f3f0ecaed84cbb: Append to log took a long time: real 0.085s	user 0.001s	sys 0.000s
I20260709 13:21:04.813234 12907 raft_consensus.cc:515] T 22ccee1b570c4ad3a57bd7aec085b1b4 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:04.725697 12760 raft_consensus.cc:515] T 3d65025eea89441290d85dd053810e31 P cd75a17ab2604397adab03bb8b5fd75c [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:04.852735  6873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8292e16e5654be6bc408560cf256aaa" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:21:04.971637  6725 raft_consensus.cc:1240] T be1a92657f494cac8dd227d152f50151 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 20 FOLLOWER]: Rejecting Update request from peer 7ba59cc884714e8aa5f3f0ecaed84cbb for earlier term 19. Current term is 20. Ops: []
I20260709 13:21:04.842439 12990 leader_election.cc:290] T bb3d8792045a4583ae2e965b1350a5b4 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 17 election: Requested vote from peers cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
W20260709 13:21:04.826735 12988 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.127s	user 0.012s	sys 0.024s
I20260709 13:21:04.857427  6770 leader_election.cc:304] T 20f6842e26174571996b8dea4151d4be P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:21:04.858503  6723 rpcz_store.cc:276] 0709 13:21:03.728961 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:21:04.182286 (+453325us) service_pool.cc:224] Handling call
0709 13:21:04.182696 (+   410us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:21:04.183114 (+   418us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:21:04.183142 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:21:04.183689 (+   547us) log.cc:844] Serialized 26 byte log entry
0709 13:21:04.857763 (+674074us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:21:04.857805 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:21:04.857869 (+    64us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:21:04.857931 (+    62us) raft_consensus.cc:1685] finished
0709 13:21:04.857943 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:21:04.858057 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":5419,"raft.run_cpu_time_us":92,"raft.run_wall_time_us":92,"thread_start_us":673631,"threads_started":1,"wal-append.queue_time_us":670881}
W20260709 13:21:04.868117 13053 log.cc:927] Time spent T f4b8bd455d5a47c18a1380839c6e0d61 P b7ab4784c7344b939bc36f639286f377: Append to log took a long time: real 0.182s	user 0.000s	sys 0.001s
I20260709 13:21:04.836771 13039 leader_election.cc:290] T d8cee0accdb8499c86d4414b72565a38 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:21:04.832121 13022 leader_election.cc:290] T d8292e16e5654be6bc408560cf256aaa P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:21:04.869194  6876 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53416 (request call id 3610) took 1347 ms. Trace:
I20260709 13:21:04.992274  6629 catalog_manager.cc:5697] T d8cee0accdb8499c86d4414b72565a38 P 7ba59cc884714e8aa5f3f0ecaed84cbb reported cstate change: term changed from 14 to 16. New cstate: current_term: 16 leader_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:21:04.870117  6802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "713b5728a197487c9300b310ab94e5a3" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:21:04.871873 12625 raft_consensus.cc:515] T 3fa34c08b205435dba97346991aa1f92 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:21:04.994156  6876 rpcz_store.cc:276] 0709 13:21:03.521812 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:21:04.868206 (+1346394us) service_pool.cc:224] Handling call
0709 13:21:04.868591 (+   385us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:21:04.868818 (+   227us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:21:04.868849 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:21:04.868899 (+    50us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:21:04.868945 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:21:04.869006 (+    61us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:21:04.869128 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:21:04.845230 13014 leader_election.cc:290] T f09c2a98de1a4decabd0ff900dd44caa P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:21:05.014884  6877 raft_consensus.cc:2468] T 3d65025eea89441290d85dd053810e31 P cd75a17ab2604397adab03bb8b5fd75c [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 18.
I20260709 13:21:04.861187 13026 raft_consensus.cc:3060] T b56bf91d90824c959e21e0cee5ba1816 P b7ab4784c7344b939bc36f639286f377 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:21:04.881070 12998 leader_election.cc:290] T de3186201e1a40d0b335eeb8b4e256e0 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:21:04.759109 12662 raft_consensus.cc:515] T f03d0dbf16864ca4bc1bb5e4c0334c0f P cd75a17ab2604397adab03bb8b5fd75c [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:04.754020 12974 raft_consensus.cc:515] T 7c44c4849aa54f2b94d1f1bef9ed546f P b7ab4784c7344b939bc36f639286f377 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:04.887820  6799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1528ab62b6fe4e3099d08f141afee116" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:21:05.025702  6799 raft_consensus.cc:2393] T 1528ab62b6fe4e3099d08f141afee116 P b7ab4784c7344b939bc36f639286f377 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ccd8a4c3bfe3413cb2ae219b09aea832 in current term 15: Already voted for candidate b7ab4784c7344b939bc36f639286f377 in this term.
I20260709 13:21:04.889242  6879 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53416 (request call id 3609) took 1515 ms. Trace:
I20260709 13:21:05.026286  6879 rpcz_store.cc:276] 0709 13:21:03.373949 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:21:04.856804 (+1482855us) service_pool.cc:224] Handling call
0709 13:21:04.888655 (+ 31851us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:21:04.888894 (+   239us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:21:04.888924 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:21:04.888970 (+    46us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:21:04.889009 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:21:04.889063 (+    54us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:21:04.889176 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:21:04.875916 12811 raft_consensus.cc:2804] T d33d5ee8ef6f415593d8df52063161ad P b7ab4784c7344b939bc36f639286f377 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:21:04.825977 12802 leader_election.cc:290] T 4b8cacb381b746da8d0049b0a83b41dd P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:21:04.890071  6805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4275cf08e63345f993bce8664eada830" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:21:04.833735 12580 leader_election.cc:290] T f3f9c2e2bf644115957398fe4c9459db P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:21:04.891973  7498 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50744 (request call id 500) took 1014 ms. Trace:
I20260709 13:21:05.035115  7498 rpcz_store.cc:276] 0709 13:21:03.877196 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:21:03.877333 (+   137us) service_pool.cc:224] Handling call
0709 13:21:04.891800 (+1014467us) spinlock_profiling.cc:243] Waited 368 ms on lock 0x7b54006f7f54. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f9ae2fa 00007fcc1496fb17 00007fcc0deea6d4 00007fcc0deea662 00007fcc0deea591 00007fcc0deea50c 00007fcc0dee97c2 00007fcc0dce548c 00007fcc0dce48c6 00007fcc0dce426f
0709 13:21:04.891902 (+   102us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":847336832}
I20260709 13:21:04.898262  6695 leader_election.cc:304] T 427c124d773f483294511e80fe340075 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb
W20260709 13:21:05.036998  6695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 138849us
I20260709 13:21:04.899108 12982 consensus_queue.cc:1059] T bb3d8792045a4583ae2e965b1350a5b4 P 7ba59cc884714e8aa5f3f0ecaed84cbb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: INVALID_TERM, Last received: 16.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:21:04.819914 12685 leader_election.cc:290] T 1528ab62b6fe4e3099d08f141afee116 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:21:04.829550 12566 leader_election.cc:290] T a1704639a875409b9959353527b3fd68 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 19 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:21:04.900290  6875 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53406 (request call id 2874) took 1095 ms. Trace:
I20260709 13:21:05.043136  6875 rpcz_store.cc:276] 0709 13:21:03.805243 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:21:04.892454 (+1087211us) service_pool.cc:224] Handling call
0709 13:21:04.892858 (+   404us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:21:04.899930 (+  7072us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:21:04.899958 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:21:04.900002 (+    44us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:21:04.900064 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:21:04.900125 (+    61us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:21:04.900232 (+   107us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:21:04.902154 12965 consensus_meta.cc:287] T bd6869f07b5a4885a0b99fbe60c3b175 P b7ab4784c7344b939bc36f639286f377: Time spent flushing consensus metadata: real 0.617s	user 0.015s	sys 0.000s
W20260709 13:21:04.904844 12897 consensus_meta.cc:287] T 713b5728a197487c9300b310ab94e5a3 P b7ab4784c7344b939bc36f639286f377: Time spent flushing consensus metadata: real 0.627s	user 0.010s	sys 0.006s
I20260709 13:21:04.905381 12945 raft_consensus.cc:2804] T 1528ab62b6fe4e3099d08f141afee116 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:21:04.908985  6878 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53406 (request call id 2873) took 1104 ms. Trace:
I20260709 13:21:04.910451 12898 raft_consensus.cc:493] T 95a75bfe094d4bdc963aba3f08dfcd25 P b7ab4784c7344b939bc36f639286f377 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:05.048815  6878 rpcz_store.cc:276] 0709 13:21:03.805009 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:21:04.876323 (+1071314us) service_pool.cc:224] Handling call
0709 13:21:04.908447 (+ 32124us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:21:04.908652 (+   205us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:21:04.908689 (+    37us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:21:04.908732 (+    43us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:21:04.908771 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:21:04.908825 (+    54us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:21:04.908923 (+    98us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:21:04.917908  6804 raft_consensus.cc:2368] T 7a734b5ab7834e05a8c422208acc58b1 P b7ab4784c7344b939bc36f639286f377 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 7ba59cc884714e8aa5f3f0ecaed84cbb for earlier term 18. Current term is 19.
I20260709 13:21:04.691057 13027 raft_consensus.cc:740] T c4db81d9d329422bb3b4160ca4ac2d1d P b7ab4784c7344b939bc36f639286f377 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
I20260709 13:21:04.919580  6844 leader_election.cc:304] T 8c7f33e544204fbaac4078e3e83bbf4e P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
W20260709 13:21:04.910337  6626 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:53224 (request call id 157) took 92055 ms (client timeout 15000 ms). Trace:
I20260709 13:21:04.925045  6800 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:32966 (request call id 1516) took 1049 ms. Trace:
I20260709 13:21:04.931799  7466 leader_election.cc:400] T 7a734b5ab7834e05a8c422208acc58b1 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 18 election: Vote denied by peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391) with higher term. Message: Invalid argument: T 7a734b5ab7834e05a8c422208acc58b1 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 7ba59cc884714e8aa5f3f0ecaed84cbb for earlier term 18. Current term is 19.
I20260709 13:21:05.054172  7466 leader_election.cc:403] T 7a734b5ab7834e05a8c422208acc58b1 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 18 election: Cancelling election due to peer responding with higher term
I20260709 13:21:04.941087  7500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1528ab62b6fe4e3099d08f141afee116" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:21:05.028111 12990 raft_consensus.cc:493] T 17587d6730594da4a56fa13a353232a1 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:04.953226  7494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f00a2e87e56452083b759f60d461ee3" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:21:04.968648  7503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8cee0accdb8499c86d4414b72565a38" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:21:05.055167  7494 raft_consensus.cc:2468] T 4f00a2e87e56452083b759f60d461ee3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 18.
W20260709 13:21:05.053709  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 134266us
I20260709 13:21:05.056490  6844 leader_election.cc:304] T 30e88460611e47b2ba16a46a30b5f416 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:21:05.053603  6800 rpcz_store.cc:276] 0709 13:21:03.875644 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:21:03.900816 (+ 25172us) service_pool.cc:224] Handling call
0709 13:21:03.901117 (+   301us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:21:04.915449 (+1014332us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:21:04.924689 (+  9240us) spinlock_profiling.cc:243] Waited 858 ms on lock 0x7b54003313d4. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f9aae01 00007fcc0f9a983e 00007fcc1496e419 00007fcc0dee5bd4 00007fcc0dee5b62 00007fcc0dee5a91 00007fcc0dee5a0c 00007fcc0dee4cc2 00007fcc0dce548c 00007fcc0dce48c6
0709 13:21:04.924964 (+   275us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1974069632}
I20260709 13:21:05.029117 12811 raft_consensus.cc:493] T d33d5ee8ef6f415593d8df52063161ad P b7ab4784c7344b939bc36f639286f377 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:04.853320  6803 raft_consensus.cc:3060] T 7c37d41cd9164c15a6826ca62a851a69 P b7ab4784c7344b939bc36f639286f377 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:21:04.924062 12881 raft_consensus.cc:493] T 3411566abe2d4c9bb4b2adfdd05e6f17 P cd75a17ab2604397adab03bb8b5fd75c [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:04.923828 13015 raft_consensus.cc:2749] T 90d42e216d9741e190bca19a781291fd P cd75a17ab2604397adab03bb8b5fd75c [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:21:04.988348  6881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8cee0accdb8499c86d4414b72565a38" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:21:04.989204  6880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f00a2e87e56452083b759f60d461ee3" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:21:05.071094  6880 raft_consensus.cc:2468] T 4f00a2e87e56452083b759f60d461ee3 P cd75a17ab2604397adab03bb8b5fd75c [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 19.
I20260709 13:21:04.918480 13050 raft_consensus.cc:515] T 404190ce4ce94cecbfcb6ea9d1dd8626 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:21:05.073740  6800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4db81d9d329422bb3b4160ca4ac2d1d" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 19 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:21:04.925601 13056 raft_consensus.cc:2749] T 1bf4668eeb70467fb3dc5a0289233b3c P cd75a17ab2604397adab03bb8b5fd75c [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:21:05.103446 12802 raft_consensus.cc:2749] T 7a734b5ab7834e05a8c422208acc58b1 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 19 FOLLOWER]: Leader election lost for term 18. Reason: Vote denied by peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391) with higher term. Message: Invalid argument: T 7a734b5ab7834e05a8c422208acc58b1 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 7ba59cc884714e8aa5f3f0ecaed84cbb for earlier term 18. Current term is 19.
I20260709 13:21:05.065001 13014 raft_consensus.cc:2749] T 8c7f33e544204fbaac4078e3e83bbf4e P cd75a17ab2604397adab03bb8b5fd75c [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:21:05.031749 13039 raft_consensus.cc:2804] T 20f6842e26174571996b8dea4151d4be P b7ab4784c7344b939bc36f639286f377 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:21:05.033731  6805 raft_consensus.cc:3060] T 4275cf08e63345f993bce8664eada830 P b7ab4784c7344b939bc36f639286f377 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:21:05.036129  6629 catalog_manager.cc:5697] T 4f00a2e87e56452083b759f60d461ee3 P 7ba59cc884714e8aa5f3f0ecaed84cbb reported cstate change: term changed from 14 to 17. New cstate: current_term: 17 leader_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:21:05.045910  6802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f9c2e2bf644115957398fe4c9459db" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:21:05.068254 13022 raft_consensus.cc:2804] T 30e88460611e47b2ba16a46a30b5f416 P cd75a17ab2604397adab03bb8b5fd75c [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:21:05.051191  6876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de3186201e1a40d0b335eeb8b4e256e0" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:21:05.054450  6798 raft_consensus.cc:2468] T 713b5728a197487c9300b310ab94e5a3 P b7ab4784c7344b939bc36f639286f377 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 15.
W20260709 13:21:05.060670  7466 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 137704us
I20260709 13:21:05.121151  7466 leader_election.cc:400] T 7a734b5ab7834e05a8c422208acc58b1 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 18 election: Vote denied by peer b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817) with higher term. Message: Invalid argument: T 7a734b5ab7834e05a8c422208acc58b1 P b7ab4784c7344b939bc36f639286f377 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 7ba59cc884714e8aa5f3f0ecaed84cbb for earlier term 18. Current term is 19.
I20260709 13:21:05.061650  6844 leader_election.cc:304] T e77e330a82df4b43a745d57a68f6f057 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:21:05.062495  6804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b3759de40694069b13c0f8bd40e5709" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:21:05.123342  6804 raft_consensus.cc:2468] T 9b3759de40694069b13c0f8bd40e5709 P b7ab4784c7344b939bc36f639286f377 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 15.
I20260709 13:21:05.066597  6799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e326172347f45e99a0d482b5d8ef768" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:21:05.054409 12730 raft_consensus.cc:2804] T 7a734b5ab7834e05a8c422208acc58b1 P b7ab4784c7344b939bc36f639286f377 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:21:05.070657  6877 raft_consensus.cc:1240] T e77e330a82df4b43a745d57a68f6f057 P cd75a17ab2604397adab03bb8b5fd75c [term 19 FOLLOWER]: Rejecting Update request from peer b7ab4784c7344b939bc36f639286f377 for earlier term 18. Current term is 19. Ops: []
I20260709 13:21:05.128937  6877 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53406 (request call id 2877) took 1322 ms. Trace:
I20260709 13:21:05.129424  6877 rpcz_store.cc:276] 0709 13:21:03.806035 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:21:05.060189 (+1254154us) service_pool.cc:224] Handling call
0709 13:21:05.070459 (+ 10270us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:21:05.128548 (+ 58089us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:21:05.128853 (+   305us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:21:04.990748  7495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3f13b31a1f84f0d89d007eadd57924c" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:21:05.048766 12704 raft_consensus.cc:2804] T 427c124d773f483294511e80fe340075 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:21:04.965102 13041 raft_consensus.cc:3060] T 7887766dc6784fcaa42b35c05fea7a99 P b7ab4784c7344b939bc36f639286f377 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:21:04.971415  6873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1704639a875409b9959353527b3fd68" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:21:05.050606 12945 raft_consensus.cc:493] T 1528ab62b6fe4e3099d08f141afee116 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:05.050984 12631 raft_consensus.cc:493] T dbdf895bba214ff68685a24fd17dfb5d P b7ab4784c7344b939bc36f639286f377 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:05.070590  6881 raft_consensus.cc:2468] T d8cee0accdb8499c86d4414b72565a38 P cd75a17ab2604397adab03bb8b5fd75c [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 18.
I20260709 13:21:05.030908  6790 tablet_service.cc:1558] Processing DeleteTablet for tablet 24ee15416e3145beaa1b8183453729a3 with delete_type TABLET_DATA_TOMBSTONED (Replica with old config index 3 (current committed config index is 7)) from {username='slave'} at 127.0.0.1:41714
I20260709 13:21:05.142720  6879 raft_consensus.cc:1240] T 7ba5dac66ab5497e9e336f2a3c28cda5 P cd75a17ab2604397adab03bb8b5fd75c [term 18 FOLLOWER]: Rejecting Update request from peer 7ba59cc884714e8aa5f3f0ecaed84cbb for earlier term 17. Current term is 18. Ops: []
I20260709 13:21:05.143743  6879 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58592 (request call id 537) took 1272 ms. Trace:
I20260709 13:21:05.144330  6879 rpcz_store.cc:276] 0709 13:21:03.870910 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:21:05.107526 (+1236616us) service_pool.cc:224] Handling call
0709 13:21:05.142453 (+ 34927us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:21:05.143392 (+   939us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:21:05.143666 (+   274us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:21:05.108089  6725 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49744 (request call id 659) took 1201 ms. Trace:
I20260709 13:21:05.066461 12982 raft_consensus.cc:3055] T bb3d8792045a4583ae2e965b1350a5b4 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:21:05.165258 12982 raft_consensus.cc:740] T bb3d8792045a4583ae2e965b1350a5b4 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 7ba59cc884714e8aa5f3f0ecaed84cbb, State: Running, Role: LEADER
I20260709 13:21:05.067864 12811 raft_consensus.cc:3060] T d33d5ee8ef6f415593d8df52063161ad P b7ab4784c7344b939bc36f639286f377 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:21:05.055351 12965 raft_consensus.cc:515] T bd6869f07b5a4885a0b99fbe60c3b175 P b7ab4784c7344b939bc36f639286f377 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:05.114807  6803 raft_consensus.cc:2468] T 7c37d41cd9164c15a6826ca62a851a69 P b7ab4784c7344b939bc36f639286f377 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 18.
I20260709 13:21:05.116498  6728 raft_consensus.cc:1240] T 404190ce4ce94cecbfcb6ea9d1dd8626 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 16 FOLLOWER]: Rejecting Update request from peer 7ba59cc884714e8aa5f3f0ecaed84cbb for earlier term 15. Current term is 16. Ops: []
W20260709 13:21:05.123677  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 62144.8us
I20260709 13:21:05.054996 12896 consensus_queue.cc:1048] T ab432e62819d499eaaf3dd55481dd930 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.050s
I20260709 13:21:05.118673  6876 raft_consensus.cc:2468] T de3186201e1a40d0b335eeb8b4e256e0 P cd75a17ab2604397adab03bb8b5fd75c [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 17.
I20260709 13:21:05.138136 13015 raft_consensus.cc:2749] T e77e330a82df4b43a745d57a68f6f057 P cd75a17ab2604397adab03bb8b5fd75c [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:21:05.127483 12594 leader_election.cc:290] T be1a92657f494cac8dd227d152f50151 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 20 election: Requested vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
W20260709 13:21:05.053319  6626 rpcz_store.cc:269] 0709 13:19:32.854934 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:32.929376 (+ 74442us) service_pool.cc:224] Handling call
0709 13:19:34.055943 (+1126567us) spinlock_profiling.cc:243] Waited 138 ms on lock 0x7b5400280190. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0c745db1 00007fcc0c886640 00007fcc1575db76 00007fcc15867c3e 00007fcc13d282a4 00007fcc13d28232 00007fcc13d28161 00007fcc13d280dc 00007fcc13d27392 00007fcc0dce548c 00007fcc0dce48c6
0709 13:21:04.910092 (+90854149us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:20:57.170683 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:20:57.192564 (+ 21881us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:20:57.192606 (+    42us) write_op.cc:435] Acquired schema lock
0709 13:20:57.192624 (+    18us) tablet.cc:662] Decoding operations
0709 13:20:57.253907 (+ 61283us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:20:57.256504 (+  2597us) write_op.cc:641] Partition lock acquired for write op
0709 13:20:57.266445 (+  9941us) tablet.cc:685] Acquiring locks for 3 operations
0709 13:20:57.280140 (+ 13695us) tablet.cc:701] Row locks acquired
0709 13:20:57.280178 (+    38us) write_op.cc:260] PREPARE: finished
0709 13:20:57.280418 (+   240us) write_op.cc:270] Start()
0709 13:20:57.280585 (+   167us) write_op.cc:276] Timestamp: P: 1783603257280347 usec, L: 0
0709 13:20:57.280625 (+    40us) op_driver.cc:348] REPLICATION: starting
0709 13:20:57.501929 (+221304us) log.cc:844] Serialized 1307 byte log entry
0709 13:20:57.859337 (+357408us) spinlock_profiling.cc:243] Waited 216 ms on lock 0x7b5400156154. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f9a5e28 00007fcc133e0581 00007fcc133dfd58 00007fcc133e49f1 00007fcc133e49a9 00007fcc133e4939 00007fcc133e4901 00007fcc133e3b2d 000000000038f354 000000000038f199
0709 13:20:58.437564 (+578227us) op_driver.cc:464] REPLICATION: finished
0709 13:20:59.022995 (+585431us) write_op.cc:301] APPLY: starting
0709 13:20:59.023213 (+   218us) tablet.cc:1367] starting BulkCheckPresence
0709 13:20:59.347319 (+324106us) tablet.cc:1370] finished BulkCheckPresence
0709 13:20:59.347382 (+    63us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:20:59.442002 (+ 94620us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:20:59.442395 (+   393us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=6,key_file_lookups=6,delta_file_lookups=6,mrs_lookups=0
0709 13:20:59.442464 (+    69us) write_op.cc:312] APPLY: finished
0709 13:20:59.442781 (+   317us) log.cc:844] Serialized 40 byte log entry
0709 13:20:59.609842 (+167061us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:20:59.615094 (+  5252us) write_op.cc:454] Released schema lock
0709 13:20:59.615184 (+    90us) write_op.cc:341] FINISH: Updating metrics
0709 13:20:59.615827 (+   643us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:20:59.615866 (+    39us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":195679,"reported_tablets":55,"spinlock_wait_cycles":317998208,"child_traces":[["op",{"apply.queue_time_us":554535,"apply.run_cpu_time_us":32325,"apply.run_wall_time_us":616198,"cfile_cache_hit":14,"cfile_cache_hit_bytes":16655,"num_ops":3,"prepare.queue_time_us":437911,"prepare.run_cpu_time_us":33091,"prepare.run_wall_time_us":700904,"raft.queue_time_us":565464,"raft.run_cpu_time_us":31592,"raft.run_wall_time_us":473943,"replication_time_us":1128253,"spinlock_wait_cycles":497198976,"thread_start_us":1087120,"threads_started":5,"wal-append.queue_time_us":471261,"wal-append.run_cpu_time_us":25903,"wal-append.run_wall_time_us":2246467}]]}
I20260709 13:21:05.153259 12945 raft_consensus.cc:3060] T 1528ab62b6fe4e3099d08f141afee116 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:21:05.153889 12631 raft_consensus.cc:515] T dbdf895bba214ff68685a24fd17dfb5d P b7ab4784c7344b939bc36f639286f377 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:05.155499  6878 raft_consensus.cc:1240] T c4db81d9d329422bb3b4160ca4ac2d1d P cd75a17ab2604397adab03bb8b5fd75c [term 18 LEADER]: Rejecting Update request from peer b7ab4784c7344b939bc36f639286f377 for earlier term 17. Current term is 18. Ops: [17.10-17.10]
I20260709 13:21:05.156282 12730 raft_consensus.cc:697] T 7a734b5ab7834e05a8c422208acc58b1 P b7ab4784c7344b939bc36f639286f377 [term 19 LEADER]: Becoming Leader. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
I20260709 13:21:05.161382 12802 raft_consensus.cc:493] T 7ba5dac66ab5497e9e336f2a3c28cda5 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:05.162160 12760 leader_election.cc:290] T 3d65025eea89441290d85dd053810e31 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:21:05.163318 12907 leader_election.cc:290] T 22ccee1b570c4ad3a57bd7aec085b1b4 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:21:05.073730 12881 raft_consensus.cc:515] T 3411566abe2d4c9bb4b2adfdd05e6f17 P cd75a17ab2604397adab03bb8b5fd75c [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
W20260709 13:21:05.164866 13061 log.cc:927] Time spent T d33d5ee8ef6f415593d8df52063161ad P cd75a17ab2604397adab03bb8b5fd75c: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 13:21:05.148277  6629 catalog_manager.cc:5697] T 24ee15416e3145beaa1b8183453729a3 P 7ba59cc884714e8aa5f3f0ecaed84cbb reported cstate change: term changed from 16 to 19, leader changed from 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68) to cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67). New cstate: current_term: 19 leader_uuid: "cd75a17ab2604397adab03bb8b5fd75c" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } } }
I20260709 13:21:05.065181 12905 consensus_queue.cc:1048] T d33d5ee8ef6f415593d8df52063161ad P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.059s
I20260709 13:21:05.170013  6877 raft_consensus.cc:1240] T 8c7f33e544204fbaac4078e3e83bbf4e P cd75a17ab2604397adab03bb8b5fd75c [term 15 FOLLOWER]: Rejecting Update request from peer b7ab4784c7344b939bc36f639286f377 for earlier term 14. Current term is 15. Ops: []
I20260709 13:21:05.236220  6802 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:32976 (request call id 3620) took 1089 ms. Trace:
I20260709 13:21:05.242973  6877 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53406 (request call id 2885) took 1290 ms. Trace:
I20260709 13:21:05.145927  6725 rpcz_store.cc:276] 0709 13:21:03.906904 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:21:04.240732 (+333828us) service_pool.cc:224] Handling call
0709 13:21:04.241093 (+   361us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:21:04.978425 (+737332us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:21:05.107805 (+129380us) spinlock_profiling.cc:243] Waited 730 ms on lock 0x7b540008d254. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f9aae01 00007fcc0f9a983e 00007fcc1496e419 00007fcc0dee5bd4 00007fcc0dee5b62 00007fcc0dee5a91 00007fcc0dee5a0c 00007fcc0dee4cc2 00007fcc0dce548c 00007fcc0dce48c6
0709 13:21:05.108010 (+   205us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1679675776}
I20260709 13:21:05.181183  6844 leader_election.cc:304] T 34f36d59d88f40fe8a2805e604fc6c0a P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
W20260709 13:21:05.245374  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 64330.7us
I20260709 13:21:05.246388  6844 leader_election.cc:304] T d8cee0accdb8499c86d4414b72565a38 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, b7ab4784c7344b939bc36f639286f377
I20260709 13:21:05.066708 12990 raft_consensus.cc:515] T 17587d6730594da4a56fa13a353232a1 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
W20260709 13:21:05.140542 13060 log.cc:927] Time spent T a3022224cc81473690653a83d4e99470 P ccd8a4c3bfe3413cb2ae219b09aea832: Append to log took a long time: real 0.111s	user 0.000s	sys 0.001s
W20260709 13:21:05.155699 13062 log.cc:927] Time spent T c4db81d9d329422bb3b4160ca4ac2d1d P cd75a17ab2604397adab03bb8b5fd75c: Append to log took a long time: real 0.108s	user 0.001s	sys 0.000s
W20260709 13:21:05.255324  6807 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.673s	user 0.009s	sys 0.031s
I20260709 13:21:05.133879 13039 raft_consensus.cc:493] T 20f6842e26174571996b8dea4151d4be P b7ab4784c7344b939bc36f639286f377 [term 17 FOLLOWER]: Starting leader election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:21:05.135483 13022 raft_consensus.cc:493] T 30e88460611e47b2ba16a46a30b5f416 P cd75a17ab2604397adab03bb8b5fd75c [term 13 FOLLOWER]: Starting leader election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:21:05.059163 12898 raft_consensus.cc:515] T 95a75bfe094d4bdc963aba3f08dfcd25 P b7ab4784c7344b939bc36f639286f377 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } attrs { replace: true } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: NON_VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: true } }
I20260709 13:21:05.177606 13014 raft_consensus.cc:493] T 4d9def8b32fd443aa94ab1420b06837b P cd75a17ab2604397adab03bb8b5fd75c [term 17 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:21:05.139289 12704 raft_consensus.cc:493] T 427c124d773f483294511e80fe340075 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 7ba59cc884714e8aa5f3f0ecaed84cbb)
I20260709 13:21:05.185534 12957 raft_consensus.cc:493] T a3022224cc81473690653a83d4e99470 P cd75a17ab2604397adab03bb8b5fd75c [term 19 FOLLOWER]: Starting pre-election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:21:05.239672  6804 raft_consensus.cc:1240] T bd6869f07b5a4885a0b99fbe60c3b175 P b7ab4784c7344b939bc36f639286f377 [term 19 FOLLOWER]: Rejecting Update request from peer ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 18. Current term is 19. Ops: []
I20260709 13:21:05.182919 13056 raft_consensus.cc:493] T e31b9971c15848dea59d4d4130141d9e P cd75a17ab2604397adab03bb8b5fd75c [term 15 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:21:05.243499  6877 rpcz_store.cc:276] 0709 13:21:03.952216 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:21:05.130551 (+1178335us) service_pool.cc:224] Handling call
0709 13:21:05.169726 (+ 39175us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:21:05.242677 (+ 72951us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:21:05.242914 (+   237us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:21:05.242777  6802 rpcz_store.cc:276] 0709 13:21:04.146616 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:21:05.185635 (+1039019us) service_pool.cc:224] Handling call
0709 13:21:05.235696 (+ 50061us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:21:05.235886 (+   190us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:21:05.235911 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:21:05.235951 (+    40us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:21:05.235982 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:21:05.236052 (+    70us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:21:05.236152 (+   100us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:21:05.248685  6798 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:32966 (request call id 1522) took 1273 ms (client timeout 1531 ms). Trace:
W20260709 13:21:05.286620  6798 rpcz_store.cc:269] 0709 13:21:03.959986 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:21:03.962062 (+  2076us) service_pool.cc:224] Handling call
0709 13:21:05.233002 (+1270940us) spinlock_profiling.cc:243] Waited 1.09 s on lock 0x7b54001d1ad4. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f9ae2fa 00007fcc1496fb17 00007fcc0deea6d4 00007fcc0deea662 00007fcc0deea591 00007fcc0deea50c 00007fcc0dee97c2 00007fcc0dce548c 00007fcc0dce48c6 00007fcc0dce426f
0709 13:21:05.233179 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2510235392}
W20260709 13:21:05.236256  6695 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:21:05.250977  6844 leader_election.cc:304] T ce4f062dcd314d43a63ca74067cb5ee3 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, b7ab4784c7344b939bc36f639286f377
I20260709 13:21:05.227955 12625 leader_election.cc:290] T 3fa34c08b205435dba97346991aa1f92 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:21:05.225376  6803 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:32976 (request call id 3619) took 1110 ms. Trace:
W20260709 13:21:05.259498  6807 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.677s	user 0.010s	sys 0.031s
I20260709 13:21:05.252521  6629 catalog_manager.cc:5697] T 7a734b5ab7834e05a8c422208acc58b1 P 7ba59cc884714e8aa5f3f0ecaed84cbb reported cstate change: term changed from 4 to 15, now has a pending config: VOTER ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65), VOTER b7ab4784c7344b939bc36f639286f377 (127.5.126.66), VOTER cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67), NON_VOTER 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68). New cstate: current_term: 15 leader_uuid: "b7ab4784c7344b939bc36f639286f377" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } } pending_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } attrs { replace: true } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: NON_VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: true } } }
I20260709 13:21:05.242190 12594 raft_consensus.cc:493] T 44bde925b2e541b69890d70715b85176 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:21:05.260862  6697 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 446127us
I20260709 13:21:05.252818 12760 raft_consensus.cc:2749] T 34f36d59d88f40fe8a2805e604fc6c0a P cd75a17ab2604397adab03bb8b5fd75c [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:21:05.166440 12982 consensus_queue.cc:260] T bb3d8792045a4583ae2e965b1350a5b4 P 7ba59cc884714e8aa5f3f0ecaed84cbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 16.14, Last appended by leader: 14, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:21:05.242393 12863 raft_consensus.cc:493] T 8c7f33e544204fbaac4078e3e83bbf4e P ccd8a4c3bfe3413cb2ae219b09aea832 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:21:05.253118 12831 raft_consensus.cc:2749] T d8cee0accdb8499c86d4414b72565a38 P cd75a17ab2604397adab03bb8b5fd75c [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:21:05.293435  6695 leader_election.cc:304] T 9b3759de40694069b13c0f8bd40e5709 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
W20260709 13:21:05.294626  6806 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.501s	user 0.007s	sys 0.041s
W20260709 13:21:05.314314  6806 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.531s	user 0.009s	sys 0.041s
I20260709 13:21:05.291019  6803 rpcz_store.cc:276] 0709 13:21:04.115285 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:21:05.207430 (+1092145us) service_pool.cc:224] Handling call
0709 13:21:05.224963 (+ 17533us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:21:05.225136 (+   173us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:21:05.225165 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:21:05.225194 (+    29us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:21:05.225225 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:21:05.225260 (+    35us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:21:05.225328 (+    68us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:21:05.315774  6803 raft_consensus.cc:1240] T 711ef6523deb4cbe8ef2ba61e1c21c98 P b7ab4784c7344b939bc36f639286f377 [term 20 FOLLOWER]: Rejecting Update request from peer ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 19. Current term is 20. Ops: []
I20260709 13:21:05.316411  6803 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:32976 (request call id 3621) took 1165 ms. Trace:
I20260709 13:21:05.316921  6695 leader_election.cc:304] T 7c37d41cd9164c15a6826ca62a851a69 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
I20260709 13:21:05.263243 13039 raft_consensus.cc:3060] T 20f6842e26174571996b8dea4151d4be P b7ab4784c7344b939bc36f639286f377 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:21:05.237771 12802 raft_consensus.cc:515] T 7ba5dac66ab5497e9e336f2a3c28cda5 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:21:05.300674  6874 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53416 (request call id 3604) took 1985 ms. Trace:
I20260709 13:21:05.325474  6874 rpcz_store.cc:276] 0709 13:21:03.315757 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:21:04.185448 (+869691us) service_pool.cc:224] Handling call
0709 13:21:04.185798 (+   350us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:21:04.202162 (+ 16364us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:21:04.202195 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:21:04.202753 (+   558us) log.cc:844] Serialized 26 byte log entry
0709 13:21:04.857946 (+655193us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:21:04.857991 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:21:04.858061 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:21:05.300350 (+442289us) raft_consensus.cc:1685] finished
0709 13:21:05.300380 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:21:05.300590 (+   210us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":15967,"raft.run_cpu_time_us":112,"raft.run_wall_time_us":112,"thread_start_us":611405,"threads_started":1,"wal-append.queue_time_us":795047}
I20260709 13:21:05.316708  6803 rpcz_store.cc:276] 0709 13:21:04.151003 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:21:05.315299 (+1164296us) service_pool.cc:224] Handling call
0709 13:21:05.315606 (+   307us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:21:05.316178 (+   572us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:21:05.316358 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:21:05.298455  6798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be1a92657f494cac8dd227d152f50151" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
W20260709 13:21:05.330541  6845 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:21:05.331676  6728 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49744 (request call id 657) took 1451 ms. Trace:
I20260709 13:21:05.331842  6798 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:32976 (request call id 3622) took 1013 ms. Trace:
I20260709 13:21:05.280331 12704 raft_consensus.cc:3060] T 427c124d773f483294511e80fe340075 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:21:05.219841 13027 consensus_queue.cc:260] T c4db81d9d329422bb3b4160ca4ac2d1d P b7ab4784c7344b939bc36f639286f377 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.10, Last appended by leader: 10, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:05.312248  6629 catalog_manager.cc:5697] T b3f13b31a1f84f0d89d007eadd57924c P 7ba59cc884714e8aa5f3f0ecaed84cbb reported cstate change: term changed from 12 to 13, leader changed from b7ab4784c7344b939bc36f639286f377 (127.5.126.66) to 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68). New cstate: current_term: 13 leader_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:21:05.265954 13022 raft_consensus.cc:3060] T 30e88460611e47b2ba16a46a30b5f416 P cd75a17ab2604397adab03bb8b5fd75c [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:21:05.334573  6798 rpcz_store.cc:276] 0709 13:21:04.318680 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:21:05.330843 (+1012163us) service_pool.cc:224] Handling call
0709 13:21:05.331207 (+   364us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:21:05.331440 (+   233us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:21:05.331476 (+    36us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:21:05.331529 (+    53us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:21:05.331584 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:21:05.331655 (+    71us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:21:05.331775 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:21:05.300830 13030 raft_consensus.cc:2749] T ce4f062dcd314d43a63ca74067cb5ee3 P cd75a17ab2604397adab03bb8b5fd75c [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:21:05.335719  6804 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:32976 (request call id 3618) took 1229 ms. Trace:
I20260709 13:21:05.345995  6802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22ccee1b570c4ad3a57bd7aec085b1b4" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:21:05.346462  6804 rpcz_store.cc:276] 0709 13:21:04.106407 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:21:05.147462 (+1041055us) service_pool.cc:224] Handling call
0709 13:21:05.147903 (+   441us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:21:05.279941 (+132038us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:21:05.335451 (+ 55510us) spinlock_profiling.cc:243] Waited 91.5 ms on lock 0x7b54001f6b54. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f9aae01 00007fcc0f9a983e 00007fcc1496e419 00007fcc0dee5bd4 00007fcc0dee5b62 00007fcc0dee5a91 00007fcc0dee5a0c 00007fcc0dee4cc2 00007fcc0dce548c 00007fcc0dce48c6
0709 13:21:05.335637 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":210405632}
I20260709 13:21:05.341766  6805 raft_consensus.cc:2468] T 4275cf08e63345f993bce8664eada830 P b7ab4784c7344b939bc36f639286f377 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 16.
I20260709 13:21:05.308766 12850 raft_consensus.cc:493] T f3f9c2e2bf644115957398fe4c9459db P b7ab4784c7344b939bc36f639286f377 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader cd75a17ab2604397adab03bb8b5fd75c)
I20260709 13:21:05.354449  6804 raft_consensus.cc:3055] T e77e330a82df4b43a745d57a68f6f057 P b7ab4784c7344b939bc36f639286f377 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:21:05.355223  6804 raft_consensus.cc:740] T e77e330a82df4b43a745d57a68f6f057 P b7ab4784c7344b939bc36f639286f377 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
W20260709 13:21:05.355928  7469 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:21:05.358139  6799 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50550 (request call id 729) took 1150 ms. Trace:
I20260709 13:21:05.358675  6799 rpcz_store.cc:276] 0709 13:21:04.207691 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:21:05.328243 (+1120552us) service_pool.cc:224] Handling call
0709 13:21:05.357482 (+ 29239us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:21:05.357726 (+   244us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:21:05.357763 (+    37us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:21:05.357819 (+    56us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:21:05.357865 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:21:05.357935 (+    70us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:21:05.358067 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:21:05.365644  6629 catalog_manager.cc:5697] T 7ba5dac66ab5497e9e336f2a3c28cda5 P 7ba59cc884714e8aa5f3f0ecaed84cbb reported cstate change: term changed from 13 to 17, leader changed from cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67) to 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68). New cstate: current_term: 17 leader_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:21:05.370255  6695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 49538us
I20260709 13:21:05.284801 13014 raft_consensus.cc:515] T 4d9def8b32fd443aa94ab1420b06837b P cd75a17ab2604397adab03bb8b5fd75c [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:05.325117 12551 raft_consensus.cc:2804] T 9b3759de40694069b13c0f8bd40e5709 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:21:05.291029 12957 raft_consensus.cc:515] T a3022224cc81473690653a83d4e99470 P cd75a17ab2604397adab03bb8b5fd75c [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:05.354216 12625 raft_consensus.cc:2804] T 7c37d41cd9164c15a6826ca62a851a69 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:21:05.314055 12730 consensus_queue.cc:237] T 7a734b5ab7834e05a8c422208acc58b1 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 17.9, Last appended by leader: 9, Current term: 19, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } attrs { replace: true } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:21:05.321453 12863 raft_consensus.cc:515] T 8c7f33e544204fbaac4078e3e83bbf4e P ccd8a4c3bfe3413cb2ae219b09aea832 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:05.373241  6804 consensus_queue.cc:260] T e77e330a82df4b43a745d57a68f6f057 P b7ab4784c7344b939bc36f639286f377 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.10, Last appended by leader: 10, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } }
I20260709 13:21:05.393829  6804 raft_consensus.cc:3060] T e77e330a82df4b43a745d57a68f6f057 P b7ab4784c7344b939bc36f639286f377 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:21:05.348601 12974 leader_election.cc:290] T 7c44c4849aa54f2b94d1f1bef9ed546f P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
W20260709 13:21:05.373311 13065 log.cc:927] Time spent T f5be3a11b23d4ea9b08300a2789821c7 P b7ab4784c7344b939bc36f639286f377: Append to log took a long time: real 0.112s	user 0.000s	sys 0.001s
I20260709 13:21:05.326100 12982 raft_consensus.cc:3060] T bb3d8792045a4583ae2e965b1350a5b4 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:21:05.325829 12662 leader_election.cc:290] T f03d0dbf16864ca4bc1bb5e4c0334c0f P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:21:05.294394 13056 raft_consensus.cc:515] T e31b9971c15848dea59d4d4130141d9e P cd75a17ab2604397adab03bb8b5fd75c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:05.309103 12594 raft_consensus.cc:515] T 44bde925b2e541b69890d70715b85176 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:05.370157 13027 raft_consensus.cc:3060] T c4db81d9d329422bb3b4160ca4ac2d1d P b7ab4784c7344b939bc36f639286f377 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:21:05.369517 12850 raft_consensus.cc:515] T f3f9c2e2bf644115957398fe4c9459db P b7ab4784c7344b939bc36f639286f377 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:05.332213  6728 rpcz_store.cc:276] 0709 13:21:03.879871 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:21:04.220633 (+340762us) service_pool.cc:224] Handling call
0709 13:21:04.221005 (+   372us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:21:05.179215 (+958210us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:21:05.331345 (+152130us) spinlock_profiling.cc:243] Waited 895 ms on lock 0x7b5400394ed4. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f9aae01 00007fcc0f9a983e 00007fcc1496e419 00007fcc0dee5bd4 00007fcc0dee5b62 00007fcc0dee5a91 00007fcc0dee5a0c 00007fcc0dee4cc2 00007fcc0dce548c 00007fcc0dce48c6
0709 13:21:05.331593 (+   248us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2058780416}
I20260709 13:21:05.396162  6629 catalog_manager.cc:5697] T be1a92657f494cac8dd227d152f50151 P 7ba59cc884714e8aa5f3f0ecaed84cbb reported cstate change: term changed from 15 to 16, leader changed from 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68) to ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65). New cstate: current_term: 16 leader_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } } }
W20260709 13:21:05.408318  6771 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:21:05.386693 12551 raft_consensus.cc:493] T 9b3759de40694069b13c0f8bd40e5709 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:21:05.410058  7469 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:21:05.397883 13064 log.cc:927] Time spent T 17587d6730594da4a56fa13a353232a1 P 7ba59cc884714e8aa5f3f0ecaed84cbb: Append to log took a long time: real 0.298s	user 0.000s	sys 0.001s
I20260709 13:21:05.376662 12970 consensus_queue.cc:1059] T be1a92657f494cac8dd227d152f50151 P 7ba59cc884714e8aa5f3f0ecaed84cbb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: INVALID_TERM, Last received: 19.14, Next index: 15, Last known committed idx: 13, Time since last communication: 0.033s
I20260709 13:21:05.404273  6802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "404190ce4ce94cecbfcb6ea9d1dd8626" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:21:05.404584 13050 leader_election.cc:290] T 404190ce4ce94cecbfcb6ea9d1dd8626 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 16 election: Requested vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:21:05.457089 12594 leader_election.cc:290] T 44bde925b2e541b69890d70715b85176 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:21:05.402860 12625 raft_consensus.cc:697] T 7c37d41cd9164c15a6826ca62a851a69 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 18 LEADER]: Becoming Leader. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
I20260709 13:21:05.411208 12566 raft_consensus.cc:493] T f03d0dbf16864ca4bc1bb5e4c0334c0f P b7ab4784c7344b939bc36f639286f377 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:21:05.458829 13026 raft_consensus.cc:515] T b56bf91d90824c959e21e0cee5ba1816 P b7ab4784c7344b939bc36f639286f377 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:05.462787  6804 raft_consensus.cc:1275] T e77e330a82df4b43a745d57a68f6f057 P b7ab4784c7344b939bc36f639286f377 [term 19 FOLLOWER]: Refusing update from remote peer ccd8a4c3bfe3413cb2ae219b09aea832: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
I20260709 13:21:05.465703 12957 leader_election.cc:290] T a3022224cc81473690653a83d4e99470 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:21:05.465903 13014 leader_election.cc:290] T 4d9def8b32fd443aa94ab1420b06837b P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:21:05.466786 12631 leader_election.cc:290] T dbdf895bba214ff68685a24fd17dfb5d P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:21:05.467573 12965 leader_election.cc:290] T bd6869f07b5a4885a0b99fbe60c3b175 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 19 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:21:05.468245 12881 leader_election.cc:290] T 3411566abe2d4c9bb4b2adfdd05e6f17 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:21:05.471897  6801 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:32976 (request call id 3616) took 1377 ms. Trace:
I20260709 13:21:05.492888 12551 raft_consensus.cc:3060] T 9b3759de40694069b13c0f8bd40e5709 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:21:05.472404 13056 leader_election.cc:290] T e31b9971c15848dea59d4d4130141d9e P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:21:05.398947 12580 raft_consensus.cc:493] T f4b8bd455d5a47c18a1380839c6e0d61 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:21:05.516673 12625 consensus_queue.cc:237] T 7c37d41cd9164c15a6826ca62a851a69 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.12, Last appended by leader: 12, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:05.518994  6801 rpcz_store.cc:276] 0709 13:21:04.094083 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:21:04.300135 (+206052us) service_pool.cc:224] Handling call
0709 13:21:04.603768 (+303633us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:21:04.631729 (+ 27961us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:21:04.631764 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:21:04.632508 (+   744us) log.cc:844] Serialized 26 byte log entry
0709 13:21:04.991603 (+359095us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:21:05.003160 (+ 11557us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:21:05.003267 (+   107us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:21:05.471582 (+468315us) raft_consensus.cc:1685] finished
0709 13:21:05.471616 (+    34us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:21:05.471813 (+   197us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":27341,"raft.queue_time_us":52472,"raft.run_cpu_time_us":179,"raft.run_wall_time_us":16576,"thread_start_us":358669,"threads_started":1,"wal-append.queue_time_us":601258}
I20260709 13:21:05.389429 12907 consensus_queue.cc:1059] T 711ef6523deb4cbe8ef2ba61e1c21c98 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: INVALID_TERM, Last received: 19.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.045s
W20260709 13:21:05.525341  6770 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.508s	user 0.002s	sys 0.011s
I20260709 13:21:05.525617  6629 catalog_manager.cc:5697] T 404190ce4ce94cecbfcb6ea9d1dd8626 P 7ba59cc884714e8aa5f3f0ecaed84cbb reported cstate change: term changed from 13 to 14, leader changed from 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68) to ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65). New cstate: current_term: 14 leader_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } } }
W20260709 13:21:05.541186  6772 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.524s	user 0.001s	sys 0.012s
W20260709 13:21:05.541752  6772 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.524s	user 0.001s	sys 0.013s
W20260709 13:21:05.544057  6772 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 529632us
W20260709 13:21:05.563714  6770 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.546s	user 0.002s	sys 0.011s
W20260709 13:21:05.564857  6770 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 707468us
I20260709 13:21:05.479535 12945 raft_consensus.cc:515] T 1528ab62b6fe4e3099d08f141afee116 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 16 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:21:05.551347  6772 leader_election.cc:304] T f5be3a11b23d4ea9b08300a2789821c7 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:21:05.612784  6629 catalog_manager.cc:5697] T 17587d6730594da4a56fa13a353232a1 P 7ba59cc884714e8aa5f3f0ecaed84cbb reported cstate change: term changed from 15 to 20. New cstate: current_term: 20 leader_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:21:05.523690 12990 leader_election.cc:290] T 17587d6730594da4a56fa13a353232a1 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:21:05.633546  6629 catalog_manager.cc:5697] T 1528ab62b6fe4e3099d08f141afee116 P 7ba59cc884714e8aa5f3f0ecaed84cbb reported cstate change: term changed from 10 to 13, leader changed from 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68) to ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65). New cstate: current_term: 13 leader_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } } }
I20260709 13:21:05.645260  6629 catalog_manager.cc:5697] T ce4f062dcd314d43a63ca74067cb5ee3 P 7ba59cc884714e8aa5f3f0ecaed84cbb reported cstate change: term changed from 14 to 15, leader changed from 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68) to b7ab4784c7344b939bc36f639286f377 (127.5.126.66). New cstate: current_term: 15 leader_uuid: "b7ab4784c7344b939bc36f639286f377" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } attrs { replace: true } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } } }
W20260709 13:21:05.638285  6770 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 71552.1us
W20260709 13:21:05.638685  6772 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 88067.3us
I20260709 13:21:05.503098 13041 raft_consensus.cc:515] T 7887766dc6784fcaa42b35c05fea7a99 P b7ab4784c7344b939bc36f639286f377 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:05.684607  7500 raft_consensus.cc:2393] T 1528ab62b6fe4e3099d08f141afee116 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7ab4784c7344b939bc36f639286f377 in current term 16: Already voted for candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in this term.
I20260709 13:21:05.515833 12566 raft_consensus.cc:515] T f03d0dbf16864ca4bc1bb5e4c0334c0f P b7ab4784c7344b939bc36f639286f377 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:05.609745 12898 leader_election.cc:290] T 95a75bfe094d4bdc963aba3f08dfcd25 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:21:05.683701  6772 leader_election.cc:304] T 4f00a2e87e56452083b759f60d461ee3 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:21:05.707422  6772 leader_election.cc:304] T d8cee0accdb8499c86d4414b72565a38 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:21:05.708199 13014 raft_consensus.cc:493] T d33d5ee8ef6f415593d8df52063161ad P cd75a17ab2604397adab03bb8b5fd75c [term 15 FOLLOWER]: Starting pre-election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:21:05.708812 13014 raft_consensus.cc:515] T d33d5ee8ef6f415593d8df52063161ad P cd75a17ab2604397adab03bb8b5fd75c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:05.711129 13014 leader_election.cc:290] T d33d5ee8ef6f415593d8df52063161ad P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:21:05.711984 12898 raft_consensus.cc:2804] T 4f00a2e87e56452083b759f60d461ee3 P b7ab4784c7344b939bc36f639286f377 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:21:05.712535 12898 raft_consensus.cc:493] T 4f00a2e87e56452083b759f60d461ee3 P b7ab4784c7344b939bc36f639286f377 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:05.712945 12898 raft_consensus.cc:3060] T 4f00a2e87e56452083b759f60d461ee3 P b7ab4784c7344b939bc36f639286f377 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:21:05.697151 12850 leader_election.cc:290] T f3f9c2e2bf644115957398fe4c9459db P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:21:05.618005 12785 consensus_queue.cc:1059] T 711ef6523deb4cbe8ef2ba61e1c21c98 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: INVALID_TERM, Last received: 19.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.089s
I20260709 13:21:05.530947 12580 raft_consensus.cc:515] T f4b8bd455d5a47c18a1380839c6e0d61 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:05.718756 12580 leader_election.cc:290] T f4b8bd455d5a47c18a1380839c6e0d61 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:21:05.704946 13030 raft_consensus.cc:493] T 20f6842e26174571996b8dea4151d4be P cd75a17ab2604397adab03bb8b5fd75c [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:05.719614 13030 raft_consensus.cc:515] T 20f6842e26174571996b8dea4151d4be P cd75a17ab2604397adab03bb8b5fd75c [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:05.631944 13050 raft_consensus.cc:3055] T 711ef6523deb4cbe8ef2ba61e1c21c98 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:21:05.722726 13050 raft_consensus.cc:740] T 711ef6523deb4cbe8ef2ba61e1c21c98 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
I20260709 13:21:05.723719 12896 raft_consensus.cc:493] T 20f6842e26174571996b8dea4151d4be P ccd8a4c3bfe3413cb2ae219b09aea832 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:05.724371 12896 raft_consensus.cc:515] T 20f6842e26174571996b8dea4151d4be P ccd8a4c3bfe3413cb2ae219b09aea832 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:05.726792 12896 leader_election.cc:290] T 20f6842e26174571996b8dea4151d4be P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:21:05.731045  6807 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50550 (request call id 725) took 1654 ms. Trace:
I20260709 13:21:05.662286 12965 raft_consensus.cc:2804] T f5be3a11b23d4ea9b08300a2789821c7 P b7ab4784c7344b939bc36f639286f377 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:21:05.736485 12802 leader_election.cc:290] T 7ba5dac66ab5497e9e336f2a3c28cda5 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:21:05.738227  7496 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50744 (request call id 502) took 1474 ms. Trace:
I20260709 13:21:05.722259 13030 leader_election.cc:290] T 20f6842e26174571996b8dea4151d4be P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:21:05.737506 12863 leader_election.cc:290] T 8c7f33e544204fbaac4078e3e83bbf4e P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:21:05.747205  7496 rpcz_store.cc:276] 0709 13:21:04.264299 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:21:04.265026 (+   727us) service_pool.cc:224] Handling call
0709 13:21:04.265413 (+   387us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:21:04.265828 (+   415us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:21:04.265857 (+    29us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:21:04.591197 (+325340us) log.cc:844] Serialized 52 byte log entry
0709 13:21:04.867750 (+276553us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:21:04.867795 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:21:04.867870 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:21:05.737938 (+870068us) raft_consensus.cc:1685] finished
0709 13:21:05.737964 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:21:05.738154 (+   190us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":6600,"raft.run_cpu_time_us":111,"raft.run_wall_time_us":111,"thread_start_us":276039,"threads_started":1,"wal-append.queue_time_us":442762}
I20260709 13:21:05.741161  6807 rpcz_store.cc:276] 0709 13:21:04.076557 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:21:04.269816 (+193259us) service_pool.cc:224] Handling call
0709 13:21:04.270134 (+   318us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:21:04.270459 (+   325us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:21:04.270486 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:21:04.367524 (+ 97038us) log.cc:844] Serialized 26 byte log entry
0709 13:21:05.291494 (+923970us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:21:05.291557 (+    63us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:21:05.291639 (+    82us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:21:05.730793 (+439154us) raft_consensus.cc:1685] finished
0709 13:21:05.730821 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:21:05.730974 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":12829,"raft.run_cpu_time_us":131,"raft.run_wall_time_us":133,"thread_start_us":709022,"threads_started":1,"wal-append.queue_time_us":1060363}
I20260709 13:21:05.764997  6772 leader_election.cc:304] T de3186201e1a40d0b335eeb8b4e256e0 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
W20260709 13:21:05.822280  6880 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.672s	user 0.025s	sys 0.024s
W20260709 13:21:05.822817  6880 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.673s	user 0.025s	sys 0.024s
W20260709 13:21:05.751335  6873 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.598s	user 0.010s	sys 0.035s
W20260709 13:21:05.825552  6873 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.672s	user 0.010s	sys 0.038s
W20260709 13:21:05.855628  6772 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 90793.5us
W20260709 13:21:05.856937  7468 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.568s	user 0.001s	sys 0.016s
W20260709 13:21:05.857237  7468 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.569s	user 0.001s	sys 0.016s
I20260709 13:21:05.867533  6877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbdf895bba214ff68685a24fd17dfb5d" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 17 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:21:05.867628  6874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c44c4849aa54f2b94d1f1bef9ed546f" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:21:05.746246 12631 raft_consensus.cc:2804] T d8cee0accdb8499c86d4414b72565a38 P b7ab4784c7344b939bc36f639286f377 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:21:05.869009  6874 raft_consensus.cc:2468] T 7c44c4849aa54f2b94d1f1bef9ed546f P cd75a17ab2604397adab03bb8b5fd75c [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 19.
I20260709 13:21:05.870042  7496 raft_consensus.cc:1275] T bb7fa124c3bf4ef9ab65a407cb008441 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 18 FOLLOWER]: Refusing update from remote peer b7ab4784c7344b939bc36f639286f377: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
W20260709 13:21:05.814847 12811 consensus_meta.cc:287] T d33d5ee8ef6f415593d8df52063161ad P b7ab4784c7344b939bc36f639286f377: Time spent flushing consensus metadata: real 0.592s	user 0.012s	sys 0.002s
I20260709 13:21:05.868474  6877 raft_consensus.cc:2393] T dbdf895bba214ff68685a24fd17dfb5d P cd75a17ab2604397adab03bb8b5fd75c [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7ab4784c7344b939bc36f639286f377 in current term 17: Already voted for candidate cd75a17ab2604397adab03bb8b5fd75c in this term.
W20260709 13:21:05.751506  6790 thread.cc:641] tablet-delete [worker] (thread pool) Time spent creating pthread: real 0.525s	user 0.001s	sys 0.010s
W20260709 13:21:05.872954  6806 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.524s	user 0.010s	sys 0.008s
W20260709 13:21:05.874414  6872 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.610s	user 0.164s	sys 0.175s
I20260709 13:21:05.746837 12965 raft_consensus.cc:493] T f5be3a11b23d4ea9b08300a2789821c7 P b7ab4784c7344b939bc36f639286f377 [term 17 FOLLOWER]: Starting leader election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
W20260709 13:21:05.856706 12555 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.522s	user 0.007s	sys 0.037s
I20260709 13:21:05.880311  6877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6869f07b5a4885a0b99fbe60c3b175" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
W20260709 13:21:05.880803  7469 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:21:05.884454  7469 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:21:05.881798  6806 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.538s	user 0.010s	sys 0.008s
W20260709 13:21:05.882081  6872 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.620s	user 0.165s	sys 0.175s
W20260709 13:21:05.882171  6798 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.510s	user 0.001s	sys 0.050s
W20260709 13:21:05.886548  6798 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.518s	user 0.001s	sys 0.050s
I20260709 13:21:05.812733 12850 raft_consensus.cc:493] T be1a92657f494cac8dd227d152f50151 P b7ab4784c7344b939bc36f639286f377 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 7ba59cc884714e8aa5f3f0ecaed84cbb)
I20260709 13:21:05.912360  6877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a75bfe094d4bdc963aba3f08dfcd25" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:21:05.925284  6877 raft_consensus.cc:2410] T 95a75bfe094d4bdc963aba3f08dfcd25 P cd75a17ab2604397adab03bb8b5fd75c [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7ab4784c7344b939bc36f639286f377 for term 16 because replica has last-logged OpId of term: 14 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 8.
I20260709 13:21:05.873481 12631 raft_consensus.cc:493] T d8cee0accdb8499c86d4414b72565a38 P b7ab4784c7344b939bc36f639286f377 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 7ba59cc884714e8aa5f3f0ecaed84cbb)
I20260709 13:21:05.932636  6878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f9c2e2bf644115957398fe4c9459db" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
W20260709 13:21:05.881489  6790 thread.cc:608] tablet-delete [worker] (thread pool) Time spent starting thread: real 0.655s	user 0.005s	sys 0.010s
W20260709 13:21:05.920812 13016 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.605s	user 0.016s	sys 0.037s
I20260709 13:21:05.886040 12965 raft_consensus.cc:3060] T f5be3a11b23d4ea9b08300a2789821c7 P b7ab4784c7344b939bc36f639286f377 [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:21:05.940155  6845 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:21:05.883419 13074 raft_consensus.cc:493] T b3f13b31a1f84f0d89d007eadd57924c P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 14 FOLLOWER]: Starting pre-election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
W20260709 13:21:05.958941  6695 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.570s	user 0.003s	sys 0.019s
W20260709 13:21:05.961635  6695 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.573s	user 0.003s	sys 0.019s
W20260709 13:21:05.940136  6803 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.571s	user 0.022s	sys 0.037s
W20260709 13:21:05.965690  6803 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.597s	user 0.022s	sys 0.037s
W20260709 13:21:05.966281  6844 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.656s	user 0.009s	sys 0.037s
W20260709 13:21:05.966701  6844 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.657s	user 0.009s	sys 0.037s
W20260709 13:21:05.967023  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 673212us
I20260709 13:21:05.893832 13075 raft_consensus.cc:2804] T de3186201e1a40d0b335eeb8b4e256e0 P b7ab4784c7344b939bc36f639286f377 [term 17 FOLLOWER]: Leader pre-election won for term 18
W20260709 13:21:05.978051  6695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 596314us
I20260709 13:21:05.979885  6695 leader_election.cc:304] T 4275cf08e63345f993bce8664eada830 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
W20260709 13:21:05.982276  6881 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.680s	user 0.008s	sys 0.016s
W20260709 13:21:05.983067  6881 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.690s	user 0.009s	sys 0.016s
W20260709 13:21:05.934880  7467 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.559s	user 0.004s	sys 0.019s
W20260709 13:21:05.984555  7467 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.608s	user 0.004s	sys 0.019s
W20260709 13:21:05.997843  6697 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.609s	user 0.010s	sys 0.012s
I20260709 13:21:05.938998 12631 raft_consensus.cc:3060] T d8cee0accdb8499c86d4414b72565a38 P b7ab4784c7344b939bc36f639286f377 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:21:05.937546 12555 raft_consensus.cc:493] T 3411566abe2d4c9bb4b2adfdd05e6f17 P b7ab4784c7344b939bc36f639286f377 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:05.885354 12811 raft_consensus.cc:515] T d33d5ee8ef6f415593d8df52063161ad P b7ab4784c7344b939bc36f639286f377 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
W20260709 13:21:06.004684  6805 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.629s	user 0.029s	sys 0.048s
W20260709 13:21:05.958673 13016 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.648s	user 0.016s	sys 0.038s
I20260709 13:21:05.982681 13075 raft_consensus.cc:493] T de3186201e1a40d0b335eeb8b4e256e0 P b7ab4784c7344b939bc36f639286f377 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:21:06.016629  6805 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.641s	user 0.029s	sys 0.048s
I20260709 13:21:05.938745 12974 consensus_queue.cc:1059] T 8c7f33e544204fbaac4078e3e83bbf4e P b7ab4784c7344b939bc36f639286f377 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: INVALID_TERM, Last received: 14.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.071s
W20260709 13:21:06.012142  6697 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.623s	user 0.010s	sys 0.013s
W20260709 13:21:06.042299  6697 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 660483us
I20260709 13:21:06.043656  6697 leader_election.cc:304] T 3a485a995abc4807b6e511e45419f737 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:21:06.020483  6728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4b8bd455d5a47c18a1380839c6e0d61" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 19 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:21:06.045152  6728 raft_consensus.cc:2410] T f4b8bd455d5a47c18a1380839c6e0d61 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c for term 19 because replica has last-logged OpId of term: 18 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 8.
I20260709 13:21:06.045248  6697 leader_election.cc:304] T 4d9def8b32fd443aa94ab1420b06837b P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:21:06.022539  6723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c44c4849aa54f2b94d1f1bef9ed546f" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:21:06.026993  6880 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58592 (request call id 536) took 2156 ms. Trace:
I20260709 13:21:06.046536  6697 leader_election.cc:304] T 2c240553ce044eedb41541d72b9475d7 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:21:06.046856  6880 rpcz_store.cc:276] 0709 13:21:03.870659 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:21:05.071783 (+1201124us) service_pool.cc:224] Handling call
0709 13:21:05.093466 (+ 21683us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:21:05.093821 (+   355us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:21:05.093845 (+    24us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:21:05.149248 (+ 55403us) spinlock_profiling.cc:243] Waited 42.1 ms on lock 0x7b2c001176f8. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0e2a3a11 00007fcc0e2b3372 00007fcc0f9e5a01 00007fcc0f9aa43a 00007fcc0f9a983e 00007fcc1496e419 00007fcc0dee5bd4 00007fcc0dee5b62 00007fcc0dee5a91 00007fcc0dee5a0c 00007fcc0dee4cc2
0709 13:21:05.149852 (+   604us) log.cc:844] Serialized 26 byte log entry
0709 13:21:05.823687 (+673835us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:21:05.823762 (+    75us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:21:05.823883 (+   121us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:21:06.026534 (+202651us) raft_consensus.cc:1685] finished
0709 13:21:06.026568 (+    34us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:21:06.026899 (+   331us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":4797,"raft.run_cpu_time_us":130,"raft.run_wall_time_us":129,"spinlock_wait_cycles":96737152,"thread_start_us":672897,"threads_started":1,"wal-append.queue_time_us":874154}
I20260709 13:21:06.005332 12896 raft_consensus.cc:2804] T 4275cf08e63345f993bce8664eada830 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:21:06.003430 12802 raft_consensus.cc:493] T ce4f062dcd314d43a63ca74067cb5ee3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 15 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:21:05.934271 12850 raft_consensus.cc:515] T be1a92657f494cac8dd227d152f50151 P b7ab4784c7344b939bc36f639286f377 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:21:06.060853  6799 raft_consensus.cc:1240] T d33d5ee8ef6f415593d8df52063161ad P b7ab4784c7344b939bc36f639286f377 [term 16 FOLLOWER]: Rejecting Update request from peer ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 15. Current term is 16. Ops: [15.9-15.9]
W20260709 13:21:06.066418  6770 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 375921us
I20260709 13:21:06.014009 13026 leader_election.cc:290] T b56bf91d90824c959e21e0cee5ba1816 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 18 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:21:05.996995 12580 consensus_queue.cc:1059] T bd6869f07b5a4885a0b99fbe60c3b175 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: INVALID_TERM, Last received: 18.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.041s
W20260709 13:21:06.077441  6695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 59662.7us
I20260709 13:21:06.071332  6725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a75bfe094d4bdc963aba3f08dfcd25" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:21:06.040521 12785 raft_consensus.cc:493] T dbdf895bba214ff68685a24fd17dfb5d P ccd8a4c3bfe3413cb2ae219b09aea832 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:06.054219 12907 raft_consensus.cc:2749] T 3a485a995abc4807b6e511e45419f737 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:21:06.105966  6732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe20b4b48823486ca3b9c648db6ce8aa" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:21:06.084381  6723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6869f07b5a4885a0b99fbe60c3b175" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:21:06.090706  6725 raft_consensus.cc:2468] T 95a75bfe094d4bdc963aba3f08dfcd25 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 15.
I20260709 13:21:06.081720  6729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fa34c08b205435dba97346991aa1f92" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
W20260709 13:21:06.014878 12970 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.501s	user 0.011s	sys 0.011s
W20260709 13:21:06.103798  7466 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.724s	user 0.011s	sys 0.031s
I20260709 13:21:06.062270 12905 raft_consensus.cc:2749] T 4d9def8b32fd443aa94ab1420b06837b P ccd8a4c3bfe3413cb2ae219b09aea832 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:21:06.091118  6770 leader_election.cc:400] T 7c37d41cd9164c15a6826ca62a851a69 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 17 election: Vote denied by peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391) with higher term. Message: Invalid argument: T 7c37d41cd9164c15a6826ca62a851a69 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate b7ab4784c7344b939bc36f639286f377 for earlier term 17. Current term is 18.
I20260709 13:21:06.039788 13075 raft_consensus.cc:3060] T de3186201e1a40d0b335eeb8b4e256e0 P b7ab4784c7344b939bc36f639286f377 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:21:06.013429 12555 raft_consensus.cc:515] T 3411566abe2d4c9bb4b2adfdd05e6f17 P b7ab4784c7344b939bc36f639286f377 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:06.112403  6723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbdf895bba214ff68685a24fd17dfb5d" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 17 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:21:06.081357  6873 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53416 (request call id 3611) took 1887 ms. Trace:
I20260709 13:21:06.073092 12945 leader_election.cc:290] T 1528ab62b6fe4e3099d08f141afee116 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 16 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:21:06.122927  6732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "853ac0a8cbd64ce99457f170216d4d0f" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:21:06.073974 12896 raft_consensus.cc:697] T 4275cf08e63345f993bce8664eada830 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 16 LEADER]: Becoming Leader. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
W20260709 13:21:06.115875  6697 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 69409.2us
I20260709 13:21:05.983964 13074 raft_consensus.cc:515] T b3f13b31a1f84f0d89d007eadd57924c P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:21:06.113996  6729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44bde925b2e541b69890d70715b85176" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:21:06.124022  6732 raft_consensus.cc:2468] T 853ac0a8cbd64ce99457f170216d4d0f P ccd8a4c3bfe3413cb2ae219b09aea832 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 14.
I20260709 13:21:06.122893  6873 rpcz_store.cc:276] 0709 13:21:04.193614 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:21:05.139293 (+945679us) service_pool.cc:224] Handling call
0709 13:21:05.152422 (+ 13129us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:21:05.152713 (+   291us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:21:05.825983 (+673270us) log.cc:844] Serialized 14 byte log entry
0709 13:21:06.080934 (+254951us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:21:06.080998 (+    64us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:21:06.081055 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:21:06.081140 (+    85us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:21:06.081284 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9161,"prepare.queue_time_us":767462,"prepare.run_cpu_time_us":40,"prepare.run_wall_time_us":42,"raft.queue_time_us":996,"raft.run_cpu_time_us":124,"raft.run_wall_time_us":2725,"thread_start_us":926349,"threads_started":2}
W20260709 13:21:06.126855  7466 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.747s	user 0.012s	sys 0.031s
I20260709 13:21:06.127154  6770 leader_election.cc:403] T 7c37d41cd9164c15a6826ca62a851a69 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 17 election: Cancelling election due to peer responding with higher term
I20260709 13:21:06.133204  6728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09c2a98de1a4decabd0ff900dd44caa" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
W20260709 13:21:06.112901 12704 consensus_meta.cc:287] T 427c124d773f483294511e80fe340075 P ccd8a4c3bfe3413cb2ae219b09aea832: Time spent flushing consensus metadata: real 0.761s	user 0.009s	sys 0.005s
I20260709 13:21:06.133658  6697 leader_election.cc:304] T e31b9971c15848dea59d4d4130141d9e P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:21:06.142189  6729 raft_consensus.cc:2468] T 44bde925b2e541b69890d70715b85176 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 18.
I20260709 13:21:06.148113  6729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8292e16e5654be6bc408560cf256aaa" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
W20260709 13:21:06.149042 13086 log.cc:927] Time spent T e31b9971c15848dea59d4d4130141d9e P b7ab4784c7344b939bc36f639286f377: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
I20260709 13:21:06.150079  6881 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53416 (request call id 3617) took 1954 ms. Trace:
I20260709 13:21:06.150556  6881 rpcz_store.cc:276] 0709 13:21:04.195573 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:21:05.140356 (+944783us) service_pool.cc:224] Handling call
0709 13:21:05.224121 (+ 83765us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:21:05.237946 (+ 13825us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:21:05.238031 (+    85us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:21:05.256154 (+ 18123us) log.cc:844] Serialized 26 byte log entry
0709 13:21:06.014676 (+758522us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:21:06.014818 (+   142us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:21:06.014952 (+   134us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:21:06.149837 (+134885us) raft_consensus.cc:1685] finished
0709 13:21:06.149860 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:21:06.150009 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":8344,"raft.run_cpu_time_us":136,"raft.run_wall_time_us":4430,"thread_start_us":690229,"threads_started":1,"wal-append.queue_time_us":866934}
I20260709 13:21:06.112206 12785 raft_consensus.cc:515] T dbdf895bba214ff68685a24fd17dfb5d P ccd8a4c3bfe3413cb2ae219b09aea832 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:06.154973 12785 leader_election.cc:290] T dbdf895bba214ff68685a24fd17dfb5d P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
W20260709 13:21:06.155117 13039 consensus_meta.cc:287] T 20f6842e26174571996b8dea4151d4be P b7ab4784c7344b939bc36f639286f377: Time spent flushing consensus metadata: real 0.810s	user 0.010s	sys 0.000s
I20260709 13:21:06.155575 13030 raft_consensus.cc:493] T 7ba5dac66ab5497e9e336f2a3c28cda5 P cd75a17ab2604397adab03bb8b5fd75c [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:06.155711 13039 raft_consensus.cc:515] T 20f6842e26174571996b8dea4151d4be P b7ab4784c7344b939bc36f639286f377 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
W20260709 13:21:06.156852 13027 consensus_meta.cc:287] T c4db81d9d329422bb3b4160ca4ac2d1d P b7ab4784c7344b939bc36f639286f377: Time spent flushing consensus metadata: real 0.705s	user 0.011s	sys 0.000s
I20260709 13:21:06.123592 13041 leader_election.cc:290] T 7887766dc6784fcaa42b35c05fea7a99 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 20 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:21:06.157511 12555 leader_election.cc:290] T 3411566abe2d4c9bb4b2adfdd05e6f17 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:21:06.158196 13039 leader_election.cc:290] T 20f6842e26174571996b8dea4151d4be P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 18 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:21:06.158363 12945 raft_consensus.cc:493] T bb7fa124c3bf4ef9ab65a407cb008441 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:06.158921 12945 raft_consensus.cc:515] T bb7fa124c3bf4ef9ab65a407cb008441 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
W20260709 13:21:06.161082 13022 consensus_meta.cc:287] T 30e88460611e47b2ba16a46a30b5f416 P cd75a17ab2604397adab03bb8b5fd75c: Time spent flushing consensus metadata: real 0.806s	user 0.010s	sys 0.001s
I20260709 13:21:06.161808  6800 raft_consensus.cc:2410] T c4db81d9d329422bb3b4160ca4ac2d1d P b7ab4784c7344b939bc36f639286f377 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ccd8a4c3bfe3413cb2ae219b09aea832 for term 19 because replica has last-logged OpId of term: 17 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 9.
I20260709 13:21:06.161509 13022 raft_consensus.cc:515] T 30e88460611e47b2ba16a46a30b5f416 P cd75a17ab2604397adab03bb8b5fd75c [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:06.163094 12811 leader_election.cc:290] T d33d5ee8ef6f415593d8df52063161ad P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 16 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:21:06.092922 13066 raft_consensus.cc:2749] T 2c240553ce044eedb41541d72b9475d7 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:21:06.163148  6723 raft_consensus.cc:3060] T dbdf895bba214ff68685a24fd17dfb5d P ccd8a4c3bfe3413cb2ae219b09aea832 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:21:06.166224  6729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d65025eea89441290d85dd053810e31" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:21:06.170248  6728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f03d0dbf16864ca4bc1bb5e4c0334c0f" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:21:06.170558  6729 raft_consensus.cc:2410] T 3d65025eea89441290d85dd053810e31 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c for term 19 because replica has last-logged OpId of term: 18 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 9.
I20260709 13:21:06.164160 13078 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41714 (request call id 3) took 1189 ms. Trace:
I20260709 13:21:06.074240 12802 raft_consensus.cc:515] T ce4f062dcd314d43a63ca74067cb5ee3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } attrs { replace: true } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:21:06.175807  6697 leader_election.cc:304] T de3186201e1a40d0b335eeb8b4e256e0 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377
I20260709 13:21:06.181427 13078 rpcz_store.cc:276] 0709 13:21:04.970054 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:21:05.030535 (+ 60481us) service_pool.cc:224] Handling call
0709 13:21:06.038174 (+1007639us) ts_tablet_manager.cc:1151] Deleting tablet 24ee15416e3145beaa1b8183453729a3
0709 13:21:06.077103 (+ 38929us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0709 13:21:06.145747 (+ 68644us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":782029,"thread_start_us":720643,"threads_started":1}
I20260709 13:21:06.182232 12896 consensus_queue.cc:237] T 4275cf08e63345f993bce8664eada830 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:06.183629 12990 raft_consensus.cc:2749] T e31b9971c15848dea59d4d4130141d9e P ccd8a4c3bfe3413cb2ae219b09aea832 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:21:06.183667  6875 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53406 (request call id 2883) took 2331 ms. Trace:
I20260709 13:21:06.184700  6875 rpcz_store.cc:276] 0709 13:21:03.852647 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:21:05.063278 (+1210631us) service_pool.cc:224] Handling call
0709 13:21:05.098845 (+ 35567us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:21:05.099335 (+   490us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:21:05.099378 (+    43us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:21:05.433002 (+333624us) spinlock_profiling.cc:243] Waited 36.4 ms on lock 0x7b2c001176f8. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0e2a3a11 00007fcc0e2b3372 00007fcc0f9e5a01 00007fcc0f9aa43a 00007fcc0f9a983e 00007fcc1496e419 00007fcc0dee5bd4 00007fcc0dee5b62 00007fcc0dee5a91 00007fcc0dee5a0c 00007fcc0dee4cc2
0709 13:21:05.490096 (+ 57094us) log.cc:844] Serialized 26 byte log entry
0709 13:21:05.952049 (+461953us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:21:05.952123 (+    74us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:21:05.952246 (+   123us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:21:06.183310 (+231064us) raft_consensus.cc:1685] finished
0709 13:21:06.183333 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:21:06.183590 (+   257us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":4429,"raft.run_cpu_time_us":94,"raft.run_wall_time_us":94,"spinlock_wait_cycles":83715456,"thread_start_us":436791,"threads_started":1,"wal-append.queue_time_us":670978}
I20260709 13:21:06.186444  6727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d33d5ee8ef6f415593d8df52063161ad" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:21:06.186391  6732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3022224cc81473690653a83d4e99470" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:21:06.187011  6724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e31b9971c15848dea59d4d4130141d9e" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:21:06.188135  6724 raft_consensus.cc:2393] T e31b9971c15848dea59d4d4130141d9e P ccd8a4c3bfe3413cb2ae219b09aea832 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c in current term 16: Already voted for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in this term.
I20260709 13:21:06.190160  6724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20f6842e26174571996b8dea4151d4be" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:21:06.190814  6724 raft_consensus.cc:2468] T 20f6842e26174571996b8dea4151d4be P ccd8a4c3bfe3413cb2ae219b09aea832 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 18.
I20260709 13:21:06.192121  6697 leader_election.cc:304] T f58dc08b12a2494bb9a1372837970ca2 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:21:06.193874  6728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d9def8b32fd443aa94ab1420b06837b" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:21:06.164094 13022 leader_election.cc:290] T 30e88460611e47b2ba16a46a30b5f416 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 14 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:21:06.195036  6728 raft_consensus.cc:2393] T 4d9def8b32fd443aa94ab1420b06837b P ccd8a4c3bfe3413cb2ae219b09aea832 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c in current term 18: Already voted for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in this term.
I20260709 13:21:06.142829 12566 leader_election.cc:290] T f03d0dbf16864ca4bc1bb5e4c0334c0f P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:21:06.219808  6723 raft_consensus.cc:2468] T dbdf895bba214ff68685a24fd17dfb5d P ccd8a4c3bfe3413cb2ae219b09aea832 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 17.
I20260709 13:21:06.233842  6725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3411566abe2d4c9bb4b2adfdd05e6f17" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:21:06.209046 12785 raft_consensus.cc:2804] T de3186201e1a40d0b335eeb8b4e256e0 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:21:06.237708  6844 leader_election.cc:304] T de3186201e1a40d0b335eeb8b4e256e0 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:21:06.234869  6725 raft_consensus.cc:2468] T 3411566abe2d4c9bb4b2adfdd05e6f17 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 15.
I20260709 13:21:06.141155 12594 consensus_queue.cc:1048] T e77e330a82df4b43a745d57a68f6f057 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.054s
W20260709 13:21:06.235674 13093 log.cc:927] Time spent T 7a734b5ab7834e05a8c422208acc58b1 P b7ab4784c7344b939bc36f639286f377: Append to log took a long time: real 0.072s	user 0.001s	sys 0.000s
W20260709 13:21:06.248842  6695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 158238us
W20260709 13:21:06.259477  7468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 209495us
W20260709 13:21:06.260213  7466 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 112588us
I20260709 13:21:06.239372 12785 raft_consensus.cc:493] T de3186201e1a40d0b335eeb8b4e256e0 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:21:06.263074  6697 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 71059.4us
I20260709 13:21:06.276654  6844 leader_election.cc:304] T 4b8cacb381b746da8d0049b0a83b41dd P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, ccd8a4c3bfe3413cb2ae219b09aea832
W20260709 13:21:06.246537 13089 log.cc:927] Time spent T 427c124d773f483294511e80fe340075 P b7ab4784c7344b939bc36f639286f377: Append to log took a long time: real 0.082s	user 0.001s	sys 0.000s
I20260709 13:21:06.170737 12704 raft_consensus.cc:515] T 427c124d773f483294511e80fe340075 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } attrs { replace: true } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:21:06.171311 13030 raft_consensus.cc:515] T 7ba5dac66ab5497e9e336f2a3c28cda5 P cd75a17ab2604397adab03bb8b5fd75c [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:21:06.181685 13098 consensus_queue.cc:1059] T 404190ce4ce94cecbfcb6ea9d1dd8626 P 7ba59cc884714e8aa5f3f0ecaed84cbb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: INVALID_TERM, Last received: 15.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.076s
I20260709 13:21:06.247298 12990 raft_consensus.cc:2749] T f58dc08b12a2494bb9a1372837970ca2 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:21:06.293638  7469 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:21:06.289151  6844 leader_election.cc:304] T 2c240553ce044eedb41541d72b9475d7 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
W20260709 13:21:06.285748 12551 consensus_meta.cc:287] T 9b3759de40694069b13c0f8bd40e5709 P ccd8a4c3bfe3413cb2ae219b09aea832: Time spent flushing consensus metadata: real 0.765s	user 0.009s	sys 0.005s
W20260709 13:21:06.298914  6770 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 218563us
I20260709 13:21:06.277869 13022 raft_consensus.cc:2804] T de3186201e1a40d0b335eeb8b4e256e0 P cd75a17ab2604397adab03bb8b5fd75c [term 17 FOLLOWER]: Leader pre-election won for term 18
W20260709 13:21:06.286055 12898 consensus_meta.cc:287] T 4f00a2e87e56452083b759f60d461ee3 P b7ab4784c7344b939bc36f639286f377: Time spent flushing consensus metadata: real 0.573s	user 0.013s	sys 0.000s
I20260709 13:21:06.279142 12785 raft_consensus.cc:3060] T de3186201e1a40d0b335eeb8b4e256e0 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:21:06.332326  6697 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 55674.8us
I20260709 13:21:06.319463 13022 raft_consensus.cc:493] T de3186201e1a40d0b335eeb8b4e256e0 P cd75a17ab2604397adab03bb8b5fd75c [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:06.320968 12555 raft_consensus.cc:2749] T 7c37d41cd9164c15a6826ca62a851a69 P b7ab4784c7344b939bc36f639286f377 [term 18 FOLLOWER]: Leader election lost for term 17. Reason: Vote denied by peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391) with higher term. Message: Invalid argument: T 7c37d41cd9164c15a6826ca62a851a69 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate b7ab4784c7344b939bc36f639286f377 for earlier term 17. Current term is 18.
I20260709 13:21:06.346556 13050 consensus_queue.cc:260] T 711ef6523deb4cbe8ef2ba61e1c21c98 P ccd8a4c3bfe3413cb2ae219b09aea832 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.11, Last appended by leader: 11, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:06.350045  6800 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:32976 (request call id 3632) took 1463 ms. Trace:
I20260709 13:21:06.350601  6800 rpcz_store.cc:276] 0709 13:21:04.886336 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:21:05.057797 (+171461us) service_pool.cc:224] Handling call
0709 13:21:06.349711 (+1291914us) spinlock_profiling.cc:243] Waited 1.06 s on lock 0x7b54002da854. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f9ae2fa 00007fcc1496fb17 00007fcc0deea6d4 00007fcc0deea662 00007fcc0deea591 00007fcc0deea50c 00007fcc0dee97c2 00007fcc0dce548c 00007fcc0dce48c6 00007fcc0dce426f
0709 13:21:06.349959 (+   248us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2444555136}
I20260709 13:21:06.326789 12566 raft_consensus.cc:493] T 30e88460611e47b2ba16a46a30b5f416 P b7ab4784c7344b939bc36f639286f377 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:21:06.353766  6730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8292e16e5654be6bc408560cf256aaa" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:21:06.359900  6803 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50550 (request call id 730) took 2108 ms. Trace:
I20260709 13:21:06.354624  6726 raft_consensus.cc:1275] T 17587d6730594da4a56fa13a353232a1 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 23 FOLLOWER]: Refusing update from remote peer b7ab4784c7344b939bc36f639286f377: Log matching property violated. Preceding OpId in replica: term: 21 index: 15. Preceding OpId from leader: term: 23 index: 16. (index mismatch)
W20260709 13:21:06.366168 13099 log.cc:927] Time spent T 3fa34c08b205435dba97346991aa1f92 P ccd8a4c3bfe3413cb2ae219b09aea832: Append to log took a long time: real 0.082s	user 0.001s	sys 0.000s
I20260709 13:21:06.371042  6728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbdf895bba214ff68685a24fd17dfb5d" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 17 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:21:06.371192  6805 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:32976 (request call id 3637) took 1051 ms. Trace:
I20260709 13:21:06.320704 12898 raft_consensus.cc:515] T 4f00a2e87e56452083b759f60d461ee3 P b7ab4784c7344b939bc36f639286f377 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:21:06.326686 12811 consensus_queue.cc:1059] T e31b9971c15848dea59d4d4130141d9e P b7ab4784c7344b939bc36f639286f377 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.026s
I20260709 13:21:06.319927 12551 raft_consensus.cc:515] T 9b3759de40694069b13c0f8bd40e5709 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:06.360368  6803 rpcz_store.cc:276] 0709 13:21:04.596477 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:21:05.328289 (+731812us) service_pool.cc:224] Handling call
0709 13:21:05.328735 (+   446us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:21:05.329204 (+   469us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:21:05.329245 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:21:05.329846 (+   601us) log.cc:844] Serialized 26 byte log entry
0709 13:21:05.966399 (+636553us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:21:05.966442 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:21:05.966509 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:21:06.359704 (+393195us) raft_consensus.cc:1685] finished
0709 13:21:06.359723 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:21:06.359841 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":238,"raft.run_cpu_time_us":162,"raft.run_wall_time_us":14213,"thread_start_us":597670,"threads_started":1,"wal-append.queue_time_us":750111}
I20260709 13:21:06.396827  6801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce4f062dcd314d43a63ca74067cb5ee3" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:21:06.401121  6729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a75bfe094d4bdc963aba3f08dfcd25" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:21:06.389653  6807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1528ab62b6fe4e3099d08f141afee116" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:21:06.398721  6732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c44c4849aa54f2b94d1f1bef9ed546f" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:21:06.389210  7496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ba5dac66ab5497e9e336f2a3c28cda5" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:21:06.386610  6800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ba5dac66ab5497e9e336f2a3c28cda5" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
W20260709 13:21:06.409081  6697 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 65981.3us
I20260709 13:21:06.426192  6800 raft_consensus.cc:2468] T 7ba5dac66ab5497e9e336f2a3c28cda5 P b7ab4784c7344b939bc36f639286f377 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in term 18.
I20260709 13:21:06.427155  6807 raft_consensus.cc:3060] T 1528ab62b6fe4e3099d08f141afee116 P b7ab4784c7344b939bc36f639286f377 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:21:06.372977  6725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3f13b31a1f84f0d89d007eadd57924c" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:21:06.428637  7466 leader_election.cc:304] T 7ba5dac66ab5497e9e336f2a3c28cda5 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, b7ab4784c7344b939bc36f639286f377; no voters: 
I20260709 13:21:06.419137  6723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1528ab62b6fe4e3099d08f141afee116" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:21:06.393934  6724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1704639a875409b9959353527b3fd68" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:21:06.431015  6724 raft_consensus.cc:3060] T a1704639a875409b9959353527b3fd68 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:21:06.430953  6723 raft_consensus.cc:2468] T 1528ab62b6fe4e3099d08f141afee116 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 14.
I20260709 13:21:06.397553  6730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6869f07b5a4885a0b99fbe60c3b175" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:21:06.432253  6723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f03d0dbf16864ca4bc1bb5e4c0334c0f" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:21:06.395488  6799 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:32976 (request call id 3639) took 1020 ms. Trace:
I20260709 13:21:06.433274  6723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20f6842e26174571996b8dea4151d4be" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:21:06.433810  6799 rpcz_store.cc:276] 0709 13:21:05.374736 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:21:05.406202 (+ 31466us) service_pool.cc:224] Handling call
0709 13:21:05.406691 (+   489us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:21:06.064841 (+658150us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:21:06.395124 (+330283us) spinlock_profiling.cc:243] Waited 654 ms on lock 0x7b54002c88d4. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f9aae01 00007fcc0f9a983e 00007fcc1496e419 00007fcc0dee5bd4 00007fcc0dee5b62 00007fcc0dee5a91 00007fcc0dee5a0c 00007fcc0dee4cc2 00007fcc0dce548c 00007fcc0dce48c6
0709 13:21:06.395408 (+   284us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1503516928}
I20260709 13:21:06.396827  6804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb7fa124c3bf4ef9ab65a407cb008441" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 19 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:21:06.436340  6729 raft_consensus.cc:2468] T 95a75bfe094d4bdc963aba3f08dfcd25 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 15.
I20260709 13:21:06.437539  6729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d33d5ee8ef6f415593d8df52063161ad" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:21:06.438686  7496 raft_consensus.cc:2468] T 7ba5dac66ab5497e9e336f2a3c28cda5 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 18.
I20260709 13:21:06.440419  6846 leader_election.cc:304] T 7ba5dac66ab5497e9e336f2a3c28cda5 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:21:06.371856  6805 rpcz_store.cc:276] 0709 13:21:05.320281 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:21:05.353605 (+ 33324us) service_pool.cc:224] Handling call
0709 13:21:05.353969 (+   364us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:21:05.356768 (+  2799us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:21:05.356810 (+    42us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:21:05.357511 (+   701us) log.cc:844] Serialized 52 byte log entry
0709 13:21:06.020631 (+663120us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:21:06.020684 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:21:06.020760 (+    76us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:21:06.370813 (+350053us) raft_consensus.cc:1685] finished
0709 13:21:06.370849 (+    36us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:21:06.371106 (+   257us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":199,"raft.run_cpu_time_us":148,"raft.run_wall_time_us":11553,"thread_start_us":645018,"threads_started":1,"wal-append.queue_time_us":902832}
I20260709 13:21:06.441982  6730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b56bf91d90824c959e21e0cee5ba1816" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:21:06.339330 13022 raft_consensus.cc:3060] T de3186201e1a40d0b335eeb8b4e256e0 P cd75a17ab2604397adab03bb8b5fd75c [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:21:06.337687 12850 leader_election.cc:290] T be1a92657f494cac8dd227d152f50151 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:21:06.427062  6697 leader_election.cc:304] T 3d65025eea89441290d85dd053810e31 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377
W20260709 13:21:06.383219 12982 consensus_meta.cc:287] T bb3d8792045a4583ae2e965b1350a5b4 P 7ba59cc884714e8aa5f3f0ecaed84cbb: Time spent flushing consensus metadata: real 0.940s	user 0.013s	sys 0.000s
W20260709 13:21:06.373919 13067 log.cc:927] Time spent T bb7fa124c3bf4ef9ab65a407cb008441 P b7ab4784c7344b939bc36f639286f377: Append to log took a long time: real 0.646s	user 0.000s	sys 0.005s
I20260709 13:21:06.470289  7500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1528ab62b6fe4e3099d08f141afee116" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:21:06.471253  7500 raft_consensus.cc:2368] T 1528ab62b6fe4e3099d08f141afee116 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 15. Current term is 16.
I20260709 13:21:06.473577  6873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e326172347f45e99a0d482b5d8ef768" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:21:06.470238  6732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be1a92657f494cac8dd227d152f50151" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:21:06.376655 12905 raft_consensus.cc:3055] T bd6869f07b5a4885a0b99fbe60c3b175 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:21:06.461740  6723 raft_consensus.cc:2468] T 20f6842e26174571996b8dea4151d4be P ccd8a4c3bfe3413cb2ae219b09aea832 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 18.
W20260709 13:21:06.392441 13085 log.cc:927] Time spent T 3fa34c08b205435dba97346991aa1f92 P 7ba59cc884714e8aa5f3f0ecaed84cbb: Append to log took a long time: real 0.120s	user 0.000s	sys 0.001s
I20260709 13:21:06.380098 13016 raft_consensus.cc:3055] T 404190ce4ce94cecbfcb6ea9d1dd8626 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:21:06.477387  7500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24ee15416e3145beaa1b8183453729a3" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:21:06.477838 13016 raft_consensus.cc:740] T 404190ce4ce94cecbfcb6ea9d1dd8626 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 7ba59cc884714e8aa5f3f0ecaed84cbb, State: Running, Role: LEADER
I20260709 13:21:06.396121 12945 leader_election.cc:290] T bb7fa124c3bf4ef9ab65a407cb008441 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:21:06.377261 13073 raft_consensus.cc:3055] T be1a92657f494cac8dd227d152f50151 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:21:06.479455  6731 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49744 (request call id 665) took 1566 ms. Trace:
I20260709 13:21:06.453794 13082 raft_consensus.cc:2804] T 7ba5dac66ab5497e9e336f2a3c28cda5 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:21:06.378212 13074 leader_election.cc:290] T b3f13b31a1f84f0d89d007eadd57924c P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:21:06.480279  6732 raft_consensus.cc:2393] T be1a92657f494cac8dd227d152f50151 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7ab4784c7344b939bc36f639286f377 in current term 20: Already voted for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in this term.
W20260709 13:21:06.479636  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 188272us
I20260709 13:21:06.398092 12704 leader_election.cc:290] T 427c124d773f483294511e80fe340075 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 17 election: Requested vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:21:06.371934 13030 leader_election.cc:290] T 7ba5dac66ab5497e9e336f2a3c28cda5 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:21:06.377746 12802 leader_election.cc:290] T ce4f062dcd314d43a63ca74067cb5ee3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:21:06.498261  6844 leader_election.cc:304] T 3a485a995abc4807b6e511e45419f737 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:21:06.441133 12896 raft_consensus.cc:493] T 7887766dc6784fcaa42b35c05fea7a99 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:06.487062  6877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24ee15416e3145beaa1b8183453729a3" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:21:06.521785  6877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f9c2e2bf644115957398fe4c9459db" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
W20260709 13:21:06.522240  6772 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.68:45071, user_credentials={real_user=slave}} blocked reactor thread for 135421us
I20260709 13:21:06.340075 12580 consensus_queue.cc:1048] T ab432e62819d499eaaf3dd55481dd930 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.119s
I20260709 13:21:06.492730  6875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "713b5728a197487c9300b310ab94e5a3" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:21:06.488363  6731 rpcz_store.cc:276] 0709 13:21:04.912974 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:21:04.913107 (+   133us) service_pool.cc:224] Handling call
0709 13:21:04.913520 (+   413us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:21:05.032741 (+119221us) raft_consensus.cc:1534] Early marking committed up to index 16
0709 13:21:05.515818 (+483077us) log.cc:844] Serialized 14 byte log entry
0709 13:21:05.868593 (+352775us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:21:05.868657 (+    64us) raft_consensus.cc:1645] Marking committed up to 16
0709 13:21:05.870885 (+  2228us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:21:06.073712 (+202827us) spinlock_profiling.cc:243] Waited 11.9 ms on lock 0x7b18003785e0. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc15785de1 00007fcc157925b1 00007fcc0c88b2a6 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f9aae01 00007fcc0f9a983e 00007fcc1496e419
0709 13:21:06.404488 (+330776us) spinlock_profiling.cc:243] Waited 19.2 ms on lock 0x7b18003785e0. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc15785de1 00007fcc157925b1 00007fcc0c8bd522 00007fcc0c8bf7c1 00007fcc0c8bf779 00007fcc0c8bf709 00007fcc0c8bf6d1 00007fcc0c8be9cd 000000000038f354 000000000038f199 00007fcc0c8a083a
0709 13:21:06.479161 (+ 74673us) spinlock_profiling.cc:243] Waited 119 ms on lock 0x7b54003b83d4. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f9aae01 00007fcc0f9a983e 00007fcc1496e419 00007fcc0dee5bd4 00007fcc0dee5b62 00007fcc0dee5a91 00007fcc0dee5a0c 00007fcc0dee4cc2 00007fcc0dce548c 00007fcc0dce48c6
0709 13:21:06.479212 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:21:06.479380 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":499855,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":35,"raft.queue_time_us":1512,"raft.run_cpu_time_us":169,"raft.run_wall_time_us":10131,"spinlock_wait_cycles":345133568,"thread_start_us":835010,"threads_started":2,"wal-append.queue_time_us":723755}
I20260709 13:21:06.476742  6723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de3186201e1a40d0b335eeb8b4e256e0" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:21:06.472225 12625 raft_consensus.cc:2804] T 3d65025eea89441290d85dd053810e31 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:21:06.505016  6724 raft_consensus.cc:2468] T a1704639a875409b9959353527b3fd68 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 19.
I20260709 13:21:06.529341  6877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3d8792045a4583ae2e965b1350a5b4" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:21:06.529933  6877 raft_consensus.cc:3060] T bb3d8792045a4583ae2e965b1350a5b4 P cd75a17ab2604397adab03bb8b5fd75c [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:21:06.511456  6880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b3759de40694069b13c0f8bd40e5709" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:21:06.530807  6880 raft_consensus.cc:2468] T 9b3759de40694069b13c0f8bd40e5709 P cd75a17ab2604397adab03bb8b5fd75c [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 15.
I20260709 13:21:06.511050  6878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4db81d9d329422bb3b4160ca4ac2d1d" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 19 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:21:06.484128  6873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4275cf08e63345f993bce8664eada830" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:21:06.514977  6876 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53406 (request call id 2896) took 1577 ms. Trace:
I20260709 13:21:06.372586 12566 raft_consensus.cc:515] T 30e88460611e47b2ba16a46a30b5f416 P b7ab4784c7344b939bc36f639286f377 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:06.533913  6807 raft_consensus.cc:2468] T 1528ab62b6fe4e3099d08f141afee116 P b7ab4784c7344b939bc36f639286f377 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in term 16.
I20260709 13:21:06.525605  6731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7887766dc6784fcaa42b35c05fea7a99" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:21:06.526327  6875 raft_consensus.cc:2468] T 713b5728a197487c9300b310ab94e5a3 P cd75a17ab2604397adab03bb8b5fd75c [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 14.
I20260709 13:21:06.526717  6844 leader_election.cc:304] T f58dc08b12a2494bb9a1372837970ca2 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:21:06.531998  6873 raft_consensus.cc:3060] T 4275cf08e63345f993bce8664eada830 P cd75a17ab2604397adab03bb8b5fd75c [term 14 FOLLOWER]: Advancing to term 16
I20260709 13:21:06.528151  7500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3d8792045a4583ae2e965b1350a5b4" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb"
I20260709 13:21:06.484532 13098 raft_consensus.cc:493] T bb3d8792045a4583ae2e965b1350a5b4 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:21:06.495713 13068 log.cc:927] Time spent T 07a92dd554674067a83a9cb68c4773f2 P b7ab4784c7344b939bc36f639286f377: Append to log took a long time: real 0.764s	user 0.002s	sys 0.002s
I20260709 13:21:06.460970 12631 raft_consensus.cc:515] T d8cee0accdb8499c86d4414b72565a38 P b7ab4784c7344b939bc36f639286f377 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:21:06.487763 13073 raft_consensus.cc:740] T be1a92657f494cac8dd227d152f50151 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 7ba59cc884714e8aa5f3f0ecaed84cbb, State: Running, Role: LEADER
I20260709 13:21:06.484932 12905 raft_consensus.cc:740] T bd6869f07b5a4885a0b99fbe60c3b175 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
I20260709 13:21:06.558153  6726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f9c2e2bf644115957398fe4c9459db" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:21:06.559460  6879 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53406 (request call id 2897) took 1620 ms. Trace:
I20260709 13:21:06.560976  6874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fa34c08b205435dba97346991aa1f92" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:21:06.577458  6874 raft_consensus.cc:2468] T 3fa34c08b205435dba97346991aa1f92 P cd75a17ab2604397adab03bb8b5fd75c [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 21.
I20260709 13:21:06.562584  6807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3f13b31a1f84f0d89d007eadd57924c" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:21:06.511727 12850 raft_consensus.cc:3055] T e31b9971c15848dea59d4d4130141d9e P b7ab4784c7344b939bc36f639286f377 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:21:06.493980 13082 raft_consensus.cc:493] T 7ba5dac66ab5497e9e336f2a3c28cda5 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:06.532228  6876 rpcz_store.cc:276] 0709 13:21:04.937872 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:21:05.256772 (+318900us) service_pool.cc:224] Handling call
0709 13:21:05.266685 (+  9913us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:21:05.326464 (+ 59779us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:21:05.821811 (+495347us) log.cc:844] Serialized 14 byte log entry
0709 13:21:06.109459 (+287648us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:21:06.109523 (+    64us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:21:06.109569 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:21:06.514655 (+405086us) spinlock_profiling.cc:243] Waited 59.5 ms on lock 0x7b540005b4d4. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f9aae01 00007fcc0f9a983e 00007fcc1496e419 00007fcc0dee5bd4 00007fcc0dee5b62 00007fcc0dee5a91 00007fcc0dee5a0c 00007fcc0dee4cc2 00007fcc0dce548c 00007fcc0dce48c6
0709 13:21:06.514703 (+    48us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:21:06.514847 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8408,"prepare.queue_time_us":657073,"prepare.run_cpu_time_us":125,"prepare.run_wall_time_us":3290,"raft.queue_time_us":44933,"raft.run_cpu_time_us":207,"raft.run_wall_time_us":12515,"spinlock_wait_cycles":136872320,"thread_start_us":707857,"threads_started":2,"wal-append.queue_time_us":363057}
I20260709 13:21:06.498113 13039 raft_consensus.cc:493] T c4db81d9d329422bb3b4160ca4ac2d1d P b7ab4784c7344b939bc36f639286f377 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:06.581512  6726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3411566abe2d4c9bb4b2adfdd05e6f17" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 17 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:21:06.530184 13030 raft_consensus.cc:2804] T 2c240553ce044eedb41541d72b9475d7 P cd75a17ab2604397adab03bb8b5fd75c [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:21:06.593389  7466 leader_election.cc:304] T 1528ab62b6fe4e3099d08f141afee116 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, b7ab4784c7344b939bc36f639286f377; no voters: 
I20260709 13:21:06.536767 12625 raft_consensus.cc:493] T 3d65025eea89441290d85dd053810e31 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 18 FOLLOWER]: Starting leader election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:21:06.575778  6879 rpcz_store.cc:276] 0709 13:21:04.938556 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:21:05.274832 (+336276us) service_pool.cc:224] Handling call
0709 13:21:05.329755 (+ 54923us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:21:05.476379 (+146624us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:21:05.927591 (+451212us) log.cc:844] Serialized 14 byte log entry
0709 13:21:06.289239 (+361648us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:21:06.289304 (+    65us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:21:06.289355 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:21:06.559123 (+269768us) spinlock_profiling.cc:243] Waited 146 ms on lock 0x7b5400065254. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f9aae01 00007fcc0f9a983e 00007fcc1496e419 00007fcc0dee5bd4 00007fcc0dee5b62 00007fcc0dee5a91 00007fcc0dee5a0c 00007fcc0dee4cc2 00007fcc0dce548c 00007fcc0dce48c6
0709 13:21:06.559192 (+    69us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:21:06.559375 (+   183us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":665,"prepare.queue_time_us":542350,"prepare.run_cpu_time_us":47,"prepare.run_wall_time_us":48,"raft.queue_time_us":29460,"raft.run_cpu_time_us":204,"raft.run_wall_time_us":9894,"spinlock_wait_cycles":336387456,"thread_start_us":811902,"threads_started":2,"wal-append.queue_time_us":428572}
I20260709 13:21:06.599617  6726 raft_consensus.cc:2410] T 3411566abe2d4c9bb4b2adfdd05e6f17 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7ab4784c7344b939bc36f639286f377 for term 17 because replica has last-logged OpId of term: 15 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 9.
I20260709 13:21:06.607772  7495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be1a92657f494cac8dd227d152f50151" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb"
I20260709 13:21:06.612771  6806 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:32976 (request call id 3617) took 2514 ms. Trace:
I20260709 13:21:06.574337 13098 raft_consensus.cc:515] T bb3d8792045a4583ae2e965b1350a5b4 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:21:06.613289  6806 rpcz_store.cc:276] 0709 13:21:04.098207 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:21:04.782024 (+683817us) service_pool.cc:224] Handling call
0709 13:21:04.782426 (+   402us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:21:04.782863 (+   437us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:21:04.782897 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:21:04.783450 (+   553us) log.cc:844] Serialized 26 byte log entry
0709 13:21:05.314786 (+531336us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:21:05.902169 (+587383us) log.cc:844] Serialized 14 byte log entry
0709 13:21:06.279308 (+377139us) spinlock_profiling.cc:243] Waited 19.5 ms on lock 0x7b18002733a0. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc15785de1 00007fcc157925b1 00007fcc0c837c0a 00007fcc15f77219 00007fcc0c8bfa40 00007fcc0c8ba4e4 00007fcc0c8ba455 00007fcc0f9a2060 00007fcc0f9b4716 00007fcc0f9c5287 00007fcc0f9c5208
0709 13:21:06.283808 (+  4500us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:21:06.283927 (+   119us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:21:06.478567 (+194640us) spinlock_profiling.cc:243] Waited 6.5 ms on lock 0x7b2400291a28. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0c745db1 00007fcc0c7439c4 00007fcc0c741acb 00007fcc0c8fcdc9 00007fcc0c8fca55 00007fcc0c8fc09d 00007fcc0f52e10e 00007fcc0f54588c 00007fcc0f544bb6 00007fcc0f5447d8 00007fcc0f54e221
0709 13:21:06.612507 (+133940us) raft_consensus.cc:1685] finished
0709 13:21:06.612535 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:21:06.612700 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":95030,"prepare.queue_time_us":571916,"prepare.run_cpu_time_us":62,"prepare.run_wall_time_us":4700,"raft.queue_time_us":403112,"raft.run_cpu_time_us":339,"raft.run_wall_time_us":17998,"spinlock_wait_cycles":59891456,"thread_start_us":1073097,"threads_started":2,"wal-append.queue_time_us":908287}
I20260709 13:21:06.618245  6877 raft_consensus.cc:2468] T bb3d8792045a4583ae2e965b1350a5b4 P cd75a17ab2604397adab03bb8b5fd75c [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 17.
I20260709 13:21:06.618696  6806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17587d6730594da4a56fa13a353232a1" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 24 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:21:06.619913  6872 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53416 (request call id 3607) took 3285 ms. Trace:
I20260709 13:21:06.620395  6805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44bde925b2e541b69890d70715b85176" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:21:06.621129  6805 raft_consensus.cc:2468] T 44bde925b2e541b69890d70715b85176 P b7ab4784c7344b939bc36f639286f377 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 18.
I20260709 13:21:06.621580  6803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4b8bd455d5a47c18a1380839c6e0d61" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:21:06.620651  6872 rpcz_store.cc:276] 0709 13:21:03.334239 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:21:04.842672 (+1508433us) service_pool.cc:224] Handling call
0709 13:21:04.843044 (+   372us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:21:04.843287 (+   243us) raft_consensus.cc:1534] Early marking committed up to index 14
0709 13:21:05.261983 (+418696us) log.cc:844] Serialized 14 byte log entry
0709 13:21:06.541661 (+1279678us) spinlock_profiling.cc:243] Waited 2.02 ms on lock 0x7b180045f400. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc15785de1 00007fcc157925b1 00007fcc0f5524bc 00007fcc0c8a048b 00007fcc156faab9 00007fcc0c8bc69b 00007fcc0c8ba93f 00007fcc0c8bcc02 00007fcc0f54420b 00007fcc0f549d23 00007fcc0f54a23a
0709 13:21:06.619443 (+ 77782us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:21:06.619515 (+    72us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:21:06.619583 (+    68us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:21:06.619673 (+    90us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:21:06.619827 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7076,"prepare.queue_time_us":1011590,"prepare.run_cpu_time_us":53,"prepare.run_wall_time_us":55,"spinlock_wait_cycles":4653440,"thread_start_us":1085990,"threads_started":3,"wal-append.queue_time_us":925154}
I20260709 13:21:06.623287  6803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20f6842e26174571996b8dea4151d4be" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:21:06.623972  6803 raft_consensus.cc:2468] T 20f6842e26174571996b8dea4151d4be P b7ab4784c7344b939bc36f639286f377 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 18.
I20260709 13:21:06.625283  6805 raft_consensus.cc:1240] T b56bf91d90824c959e21e0cee5ba1816 P b7ab4784c7344b939bc36f639286f377 [term 18 FOLLOWER]: Rejecting Update request from peer ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 17. Current term is 18. Ops: []
I20260709 13:21:06.582044 12850 raft_consensus.cc:740] T e31b9971c15848dea59d4d4130141d9e P b7ab4784c7344b939bc36f639286f377 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
I20260709 13:21:06.594453 13082 raft_consensus.cc:3060] T 7ba5dac66ab5497e9e336f2a3c28cda5 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:21:06.629011  6805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbdf895bba214ff68685a24fd17dfb5d" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 17 candidate_status { last_received { term: 14 index: 6 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:21:06.632701  6806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c7f33e544204fbaac4078e3e83bbf4e" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:21:06.529843 12896 raft_consensus.cc:515] T 7887766dc6784fcaa42b35c05fea7a99 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:06.636142  6805 raft_consensus.cc:2410] T dbdf895bba214ff68685a24fd17dfb5d P b7ab4784c7344b939bc36f639286f377 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ccd8a4c3bfe3413cb2ae219b09aea832 for term 17 because replica has last-logged OpId of term: 15 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 6.
I20260709 13:21:06.635926  6873 raft_consensus.cc:2468] T 4275cf08e63345f993bce8664eada830 P cd75a17ab2604397adab03bb8b5fd75c [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 16.
I20260709 13:21:06.605187 13030 raft_consensus.cc:493] T 2c240553ce044eedb41541d72b9475d7 P cd75a17ab2604397adab03bb8b5fd75c [term 17 FOLLOWER]: Starting leader election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:21:06.639101  7503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fa34c08b205435dba97346991aa1f92" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:21:06.510774 13016 consensus_queue.cc:260] T 404190ce4ce94cecbfcb6ea9d1dd8626 P 7ba59cc884714e8aa5f3f0ecaed84cbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:21:06.617221 12625 raft_consensus.cc:3060] T 3d65025eea89441290d85dd053810e31 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:21:06.617558 12802 raft_consensus.cc:2804] T 1528ab62b6fe4e3099d08f141afee116 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:21:06.655593  7503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "404190ce4ce94cecbfcb6ea9d1dd8626" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb"
I20260709 13:21:06.662436  7494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17587d6730594da4a56fa13a353232a1" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 24 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:21:06.667593 13111 raft_consensus.cc:493] T 7a734b5ab7834e05a8c422208acc58b1 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:06.668274 13111 raft_consensus.cc:515] T 7a734b5ab7834e05a8c422208acc58b1 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } attrs { replace: true } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: NON_VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: true } }
I20260709 13:21:06.668727 12631 leader_election.cc:290] T d8cee0accdb8499c86d4414b72565a38 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 19 election: Requested vote from peers cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
W20260709 13:21:06.668826 13109 log.cc:927] Time spent T 7c37d41cd9164c15a6826ca62a851a69 P ccd8a4c3bfe3413cb2ae219b09aea832: Append to log took a long time: real 0.085s	user 0.001s	sys 0.000s
I20260709 13:21:06.647864 13120 raft_consensus.cc:2804] T 7ba5dac66ab5497e9e336f2a3c28cda5 P cd75a17ab2604397adab03bb8b5fd75c [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:21:06.669656 13120 raft_consensus.cc:493] T 7ba5dac66ab5497e9e336f2a3c28cda5 P cd75a17ab2604397adab03bb8b5fd75c [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:06.670011 13120 raft_consensus.cc:3060] T 7ba5dac66ab5497e9e336f2a3c28cda5 P cd75a17ab2604397adab03bb8b5fd75c [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:21:06.672668  6697 leader_election.cc:304] T ce4f062dcd314d43a63ca74067cb5ee3 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, b7ab4784c7344b939bc36f639286f377
I20260709 13:21:06.674157  6697 leader_election.cc:400] T 1528ab62b6fe4e3099d08f141afee116 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 15 pre-election: Vote denied by peer 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071) with higher term. Message: Invalid argument: T 1528ab62b6fe4e3099d08f141afee116 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 15. Current term is 16.
I20260709 13:21:06.674486  6697 leader_election.cc:403] T 1528ab62b6fe4e3099d08f141afee116 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 15 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:21:06.675137 13066 raft_consensus.cc:2749] T ce4f062dcd314d43a63ca74067cb5ee3 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:21:06.675743 13066 raft_consensus.cc:3060] T 1528ab62b6fe4e3099d08f141afee116 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 14 FOLLOWER]: Advancing to term 16
I20260709 13:21:06.676313 12551 leader_election.cc:290] T 9b3759de40694069b13c0f8bd40e5709 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 16 election: Requested vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:21:06.651825 13030 raft_consensus.cc:3060] T 2c240553ce044eedb41541d72b9475d7 P cd75a17ab2604397adab03bb8b5fd75c [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:21:06.627004 13084 raft_consensus.cc:2749] T 4b8cacb381b746da8d0049b0a83b41dd P cd75a17ab2604397adab03bb8b5fd75c [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:21:06.686085 12850 consensus_queue.cc:260] T e31b9971c15848dea59d4d4130141d9e P b7ab4784c7344b939bc36f639286f377 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
W20260709 13:21:06.686589 13106 log.cc:927] Time spent T e31b9971c15848dea59d4d4130141d9e P cd75a17ab2604397adab03bb8b5fd75c: Append to log took a long time: real 0.203s	user 0.001s	sys 0.000s
I20260709 13:21:06.687484 12850 raft_consensus.cc:3060] T e31b9971c15848dea59d4d4130141d9e P b7ab4784c7344b939bc36f639286f377 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:21:06.687003 13066 raft_consensus.cc:2749] T 1528ab62b6fe4e3099d08f141afee116 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 16 FOLLOWER]: Leader pre-election lost for term 15. Reason: Vote denied by peer 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071) with higher term. Message: Invalid argument: T 1528ab62b6fe4e3099d08f141afee116 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 15. Current term is 16.
I20260709 13:21:06.688864 13121 raft_consensus.cc:2749] T f58dc08b12a2494bb9a1372837970ca2 P cd75a17ab2604397adab03bb8b5fd75c [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:21:06.604518 13039 raft_consensus.cc:515] T c4db81d9d329422bb3b4160ca4ac2d1d P b7ab4784c7344b939bc36f639286f377 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:06.690433 13121 raft_consensus.cc:493] T 427c124d773f483294511e80fe340075 P cd75a17ab2604397adab03bb8b5fd75c [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 7ba59cc884714e8aa5f3f0ecaed84cbb)
I20260709 13:21:06.690559  6697 leader_election.cc:304] T 9e326172347f45e99a0d482b5d8ef768 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:21:06.691205 13039 leader_election.cc:290] T c4db81d9d329422bb3b4160ca4ac2d1d P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:21:06.691890 12802 raft_consensus.cc:697] T 1528ab62b6fe4e3099d08f141afee116 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 16 LEADER]: Becoming Leader. State: Replica: 7ba59cc884714e8aa5f3f0ecaed84cbb, State: Running, Role: LEADER
I20260709 13:21:06.672883 12898 leader_election.cc:290] T 4f00a2e87e56452083b759f60d461ee3 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 20 election: Requested vote from peers cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
W20260709 13:21:06.693295 13110 log.cc:927] Time spent T a3022224cc81473690653a83d4e99470 P b7ab4784c7344b939bc36f639286f377: Append to log took a long time: real 0.138s	user 0.001s	sys 0.000s
I20260709 13:21:06.692986 12802 consensus_queue.cc:237] T 1528ab62b6fe4e3099d08f141afee116 P 7ba59cc884714e8aa5f3f0ecaed84cbb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:21:06.691869 13066 raft_consensus.cc:2749] T 9e326172347f45e99a0d482b5d8ef768 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:21:06.697662  6697 leader_election.cc:304] T 24ee15416e3145beaa1b8183453729a3 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:21:06.701587  6697 leader_election.cc:304] T f3f9c2e2bf644115957398fe4c9459db P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:21:06.702953  6731 raft_consensus.cc:3060] T 7887766dc6784fcaa42b35c05fea7a99 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:21:06.705140 12896 leader_election.cc:290] T 7887766dc6784fcaa42b35c05fea7a99 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:21:06.706600  7494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "427c124d773f483294511e80fe340075" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb"
I20260709 13:21:06.709968  6731 raft_consensus.cc:2468] T 7887766dc6784fcaa42b35c05fea7a99 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 20.
I20260709 13:21:06.712654 13108 raft_consensus.cc:2749] T 24ee15416e3145beaa1b8183453729a3 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:21:06.713342 13108 raft_consensus.cc:2749] T f3f9c2e2bf644115957398fe4c9459db P ccd8a4c3bfe3413cb2ae219b09aea832 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:21:06.716269  6806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "427c124d773f483294511e80fe340075" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:21:06.717422 12566 leader_election.cc:290] T 30e88460611e47b2ba16a46a30b5f416 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
W20260709 13:21:06.718751 13068 log.cc:927] Time spent T 07a92dd554674067a83a9cb68c4773f2 P b7ab4784c7344b939bc36f639286f377: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 13:21:06.721818  7500 raft_consensus.cc:2468] T bb3d8792045a4583ae2e965b1350a5b4 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 17.
I20260709 13:21:06.691406 13121 raft_consensus.cc:515] T 427c124d773f483294511e80fe340075 P cd75a17ab2604397adab03bb8b5fd75c [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } attrs { replace: true } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:21:06.688126 13123 raft_consensus.cc:2749] T 3a485a995abc4807b6e511e45419f737 P cd75a17ab2604397adab03bb8b5fd75c [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:21:06.663915 13091 raft_consensus.cc:493] T 34f36d59d88f40fe8a2805e604fc6c0a P ccd8a4c3bfe3413cb2ae219b09aea832 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
W20260709 13:21:06.784373  7469 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:21:06.639629 13075 raft_consensus.cc:515] T de3186201e1a40d0b335eeb8b4e256e0 P b7ab4784c7344b939bc36f639286f377 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:06.650971 12905 consensus_queue.cc:260] T bd6869f07b5a4885a0b99fbe60c3b175 P ccd8a4c3bfe3413cb2ae219b09aea832 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 18.9, Last appended by leader: 9, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:06.784240 13123 raft_consensus.cc:493] T 9e326172347f45e99a0d482b5d8ef768 P cd75a17ab2604397adab03bb8b5fd75c [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:21:06.799043 13123 raft_consensus.cc:515] T 9e326172347f45e99a0d482b5d8ef768 P cd75a17ab2604397adab03bb8b5fd75c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:06.802120 13123 leader_election.cc:290] T 9e326172347f45e99a0d482b5d8ef768 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:21:06.643613 13073 consensus_queue.cc:260] T be1a92657f494cac8dd227d152f50151 P 7ba59cc884714e8aa5f3f0ecaed84cbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.14, Last appended by leader: 14, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:21:06.824923 13073 raft_consensus.cc:3060] T be1a92657f494cac8dd227d152f50151 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:21:06.759989 13120 raft_consensus.cc:515] T 7ba5dac66ab5497e9e336f2a3c28cda5 P cd75a17ab2604397adab03bb8b5fd75c [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:21:06.834573 13120 leader_election.cc:290] T 7ba5dac66ab5497e9e336f2a3c28cda5 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 19 election: Requested vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:21:06.836138 13030 raft_consensus.cc:515] T 2c240553ce044eedb41541d72b9475d7 P cd75a17ab2604397adab03bb8b5fd75c [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:06.839047 13030 leader_election.cc:290] T 2c240553ce044eedb41541d72b9475d7 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 18 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:21:06.841156 12625 raft_consensus.cc:515] T 3d65025eea89441290d85dd053810e31 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:06.844734 13082 raft_consensus.cc:515] T 7ba5dac66ab5497e9e336f2a3c28cda5 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:21:06.780867 13091 raft_consensus.cc:515] T 34f36d59d88f40fe8a2805e604fc6c0a P ccd8a4c3bfe3413cb2ae219b09aea832 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:06.851438 13091 leader_election.cc:290] T 34f36d59d88f40fe8a2805e604fc6c0a P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:21:06.858640 12625 leader_election.cc:290] T 3d65025eea89441290d85dd053810e31 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 19 election: Requested vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:21:06.814640 13041 raft_consensus.cc:3055] T 8c7f33e544204fbaac4078e3e83bbf4e P b7ab4784c7344b939bc36f639286f377 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:21:06.861785 13075 leader_election.cc:290] T de3186201e1a40d0b335eeb8b4e256e0 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 18 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:21:06.859719 13074 raft_consensus.cc:493] T 7a734b5ab7834e05a8c422208acc58b1 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:06.867152  6731 raft_consensus.cc:1240] T 427c124d773f483294511e80fe340075 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 17 FOLLOWER]: Rejecting Update request from peer 7ba59cc884714e8aa5f3f0ecaed84cbb for earlier term 16. Current term is 17. Ops: []
I20260709 13:21:06.868141  6726 raft_consensus.cc:1240] T be1a92657f494cac8dd227d152f50151 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 20 FOLLOWER]: Rejecting Update request from peer 7ba59cc884714e8aa5f3f0ecaed84cbb for earlier term 19. Current term is 20. Ops: []
I20260709 13:21:06.869094 12945 raft_consensus.cc:493] T 17587d6730594da4a56fa13a353232a1 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 23 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:21:06.868966  6697 leader_election.cc:304] T bb3d8792045a4583ae2e965b1350a5b4 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
W20260709 13:21:06.937054  6697 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.68:45071, user_credentials={real_user=slave}} blocked reactor thread for 68196.8us
I20260709 13:21:06.937130  6800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ba5dac66ab5497e9e336f2a3c28cda5" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:21:06.938889  6800 raft_consensus.cc:3060] T 7ba5dac66ab5497e9e336f2a3c28cda5 P b7ab4784c7344b939bc36f639286f377 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:21:06.870337 13129 raft_consensus.cc:493] T 34f36d59d88f40fe8a2805e604fc6c0a P cd75a17ab2604397adab03bb8b5fd75c [term 16 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:21:06.872362 12905 raft_consensus.cc:3060] T bd6869f07b5a4885a0b99fbe60c3b175 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:21:06.873224  6729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1528ab62b6fe4e3099d08f141afee116" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:21:06.886260 13091 raft_consensus.cc:493] T fe20b4b48823486ca3b9c648db6ce8aa P ccd8a4c3bfe3413cb2ae219b09aea832 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 7ba59cc884714e8aa5f3f0ecaed84cbb)
W20260709 13:21:06.896113  6772 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.68:45071, user_credentials={real_user=slave}} blocked reactor thread for 373055us
I20260709 13:21:06.944940  6874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7887766dc6784fcaa42b35c05fea7a99" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:21:06.945642  6874 raft_consensus.cc:3060] T 7887766dc6784fcaa42b35c05fea7a99 P cd75a17ab2604397adab03bb8b5fd75c [term 18 FOLLOWER]: Advancing to term 20
I20260709 13:21:06.945570  6873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3411566abe2d4c9bb4b2adfdd05e6f17" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 17 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:21:06.947080  6873 raft_consensus.cc:2410] T 3411566abe2d4c9bb4b2adfdd05e6f17 P cd75a17ab2604397adab03bb8b5fd75c [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7ab4784c7344b939bc36f639286f377 for term 17 because replica has last-logged OpId of term: 15 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 9.
I20260709 13:21:06.898473 13101 raft_consensus.cc:493] T 44bde925b2e541b69890d70715b85176 P b7ab4784c7344b939bc36f639286f377 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:06.900544 13118 consensus_queue.cc:1048] T bb7fa124c3bf4ef9ab65a407cb008441 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:21:06.901062  6798 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:32976 (request call id 3624) took 2221 ms. Trace:
I20260709 13:21:06.903239  6730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce4f062dcd314d43a63ca74067cb5ee3" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:21:06.953521  6730 raft_consensus.cc:2468] T ce4f062dcd314d43a63ca74067cb5ee3 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in term 15.
I20260709 13:21:06.953779  6872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d33d5ee8ef6f415593d8df52063161ad" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:21:06.904946  6732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3f13b31a1f84f0d89d007eadd57924c" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:21:06.908948 13107 raft_consensus.cc:493] T ce4f062dcd314d43a63ca74067cb5ee3 P cd75a17ab2604397adab03bb8b5fd75c [term 15 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:21:06.924861 12974 raft_consensus.cc:493] T 404190ce4ce94cecbfcb6ea9d1dd8626 P b7ab4784c7344b939bc36f639286f377 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 7ba59cc884714e8aa5f3f0ecaed84cbb)
I20260709 13:21:06.951038  6873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20f6842e26174571996b8dea4151d4be" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:21:06.930779 13120 raft_consensus.cc:493] T 8c7f33e544204fbaac4078e3e83bbf4e P cd75a17ab2604397adab03bb8b5fd75c [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:06.927640 13030 raft_consensus.cc:493] T 90d42e216d9741e190bca19a781291fd P cd75a17ab2604397adab03bb8b5fd75c [term 18 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:21:06.953338  7496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be1a92657f494cac8dd227d152f50151" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:21:06.953143  6798 rpcz_store.cc:276] 0709 13:21:04.680939 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:21:05.344761 (+663822us) service_pool.cc:224] Handling call
0709 13:21:05.345168 (+   407us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:21:05.345438 (+   270us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 13:21:05.888267 (+542829us) log.cc:844] Serialized 14 byte log entry
0709 13:21:06.525333 (+637066us) log.cc:844] Serialized 14 byte log entry
0709 13:21:06.895826 (+370493us) spinlock_profiling.cc:243] Waited 5.87 ms on lock 0x7b1800032aa0. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc15785de1 00007fcc157925b1 00007fcc0c837c0a 00007fcc15f77219 00007fcc0c8bfa40 00007fcc0c8ba4e4 00007fcc0c8ba455 00007fcc0f9a2060 00007fcc0f9b4716 00007fcc0f9c5287 00007fcc0f9c5208
0709 13:21:06.896028 (+   202us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:21:06.900661 (+  4633us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:21:06.900736 (+    75us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:21:06.900833 (+    97us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:21:06.900983 (+   150us) inbound_call.cc:177] Queueing success response
0709 13:21:06.913870 (+ 12887us) spinlock_profiling.cc:243] Waited 10.2 ms on lock 0x7b1800032aa0. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc15785de1 00007fcc157925b1 00007fcc0c8bd522 00007fcc0c8bf7c1 00007fcc0c8bf779 00007fcc0c8bf709 00007fcc0c8bf6d1 00007fcc0c8be9cd 000000000038f354 000000000038f199 00007fcc0c8a083a
Metrics: {"mutex_wait_us":595617,"prepare.queue_time_us":656276,"prepare.run_cpu_time_us":93,"prepare.run_wall_time_us":97,"raft.queue_time_us":573430,"raft.run_cpu_time_us":291,"raft.run_wall_time_us":27135,"spinlock_wait_cycles":37051008,"thread_start_us":927430,"threads_started":2,"wal-append.queue_time_us":587677}
W20260709 13:21:06.956359  7468 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:21:06.956167  7466 leader_election.cc:304] T b3f13b31a1f84f0d89d007eadd57924c P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:21:06.915252  6807 raft_consensus.cc:1240] T d8cee0accdb8499c86d4414b72565a38 P b7ab4784c7344b939bc36f639286f377 [term 19 FOLLOWER]: Rejecting Update request from peer 7ba59cc884714e8aa5f3f0ecaed84cbb for earlier term 18. Current term is 19. Ops: []
I20260709 13:21:06.928206 13041 raft_consensus.cc:740] T 8c7f33e544204fbaac4078e3e83bbf4e P b7ab4784c7344b939bc36f639286f377 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
I20260709 13:21:06.954445  6872 raft_consensus.cc:3060] T d33d5ee8ef6f415593d8df52063161ad P cd75a17ab2604397adab03bb8b5fd75c [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:21:06.961886  6873 raft_consensus.cc:2393] T 20f6842e26174571996b8dea4151d4be P cd75a17ab2604397adab03bb8b5fd75c [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate b7ab4784c7344b939bc36f639286f377 in current term 18: Already voted for candidate cd75a17ab2604397adab03bb8b5fd75c in this term.
I20260709 13:21:06.974318  6772 leader_election.cc:304] T 7c44c4849aa54f2b94d1f1bef9ed546f P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:21:06.963766  6875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b56bf91d90824c959e21e0cee5ba1816" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
W20260709 13:21:06.975855  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 449206us
I20260709 13:21:06.968554  6878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f03d0dbf16864ca4bc1bb5e4c0334c0f" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:21:06.976334  6800 raft_consensus.cc:2468] T 7ba5dac66ab5497e9e336f2a3c28cda5 P b7ab4784c7344b939bc36f639286f377 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in term 19.
I20260709 13:21:06.970130  7496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8cee0accdb8499c86d4414b72565a38" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb"
I20260709 13:21:06.976404  6875 raft_consensus.cc:3060] T b56bf91d90824c959e21e0cee5ba1816 P cd75a17ab2604397adab03bb8b5fd75c [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:21:06.951706 12594 raft_consensus.cc:2804] T bb3d8792045a4583ae2e965b1350a5b4 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:21:06.984342  6872 raft_consensus.cc:2410] T d33d5ee8ef6f415593d8df52063161ad P cd75a17ab2604397adab03bb8b5fd75c [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate b7ab4784c7344b939bc36f639286f377 for term 16 because replica has last-logged OpId of term: 15 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 8.
I20260709 13:21:06.991775  7496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f00a2e87e56452083b759f60d461ee3" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb"
I20260709 13:21:06.992810  7496 raft_consensus.cc:3060] T 4f00a2e87e56452083b759f60d461ee3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 18 FOLLOWER]: Advancing to term 20
I20260709 13:21:06.976708  6844 leader_election.cc:304] T 7887766dc6784fcaa42b35c05fea7a99 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377
I20260709 13:21:06.977120  6878 raft_consensus.cc:2468] T f03d0dbf16864ca4bc1bb5e4c0334c0f P cd75a17ab2604397adab03bb8b5fd75c [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 18.
I20260709 13:21:06.995074  6844 leader_election.cc:400] T 4275cf08e63345f993bce8664eada830 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 15 pre-election: Vote denied by peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391) with higher term. Message: Invalid argument: T 4275cf08e63345f993bce8664eada830 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c for earlier term 15. Current term is 16.
I20260709 13:21:06.995639  6844 leader_election.cc:403] T 4275cf08e63345f993bce8664eada830 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 15 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:21:06.958544 13101 raft_consensus.cc:515] T 44bde925b2e541b69890d70715b85176 P b7ab4784c7344b939bc36f639286f377 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:07.007880  6878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f00a2e87e56452083b759f60d461ee3" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:21:07.016979  6878 raft_consensus.cc:3060] T 4f00a2e87e56452083b759f60d461ee3 P cd75a17ab2604397adab03bb8b5fd75c [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:21:06.940222 12970 consensus_queue.cc:1059] T 427c124d773f483294511e80fe340075 P 7ba59cc884714e8aa5f3f0ecaed84cbb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } attrs { replace: true }, Status: INVALID_TERM, Last received: 16.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.038s
I20260709 13:21:07.008912  6872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8cee0accdb8499c86d4414b72565a38" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
W20260709 13:21:06.990971 12965 consensus_meta.cc:287] T f5be3a11b23d4ea9b08300a2789821c7 P b7ab4784c7344b939bc36f639286f377: Time spent flushing consensus metadata: real 0.983s	user 0.010s	sys 0.005s
I20260709 13:21:07.018059  6872 raft_consensus.cc:3060] T d8cee0accdb8499c86d4414b72565a38 P cd75a17ab2604397adab03bb8b5fd75c [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:21:07.021792  6881 raft_consensus.cc:1275] T 7a734b5ab7834e05a8c422208acc58b1 P cd75a17ab2604397adab03bb8b5fd75c [term 19 FOLLOWER]: Refusing update from remote peer b7ab4784c7344b939bc36f639286f377: Log matching property violated. Preceding OpId in replica: term: 17 index: 8. Preceding OpId from leader: term: 19 index: 10. (index mismatch)
I20260709 13:21:07.016835  6879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4db81d9d329422bb3b4160ca4ac2d1d" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:21:06.977864 12982 raft_consensus.cc:2749] T b3f13b31a1f84f0d89d007eadd57924c P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:21:07.019604  6873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30e88460611e47b2ba16a46a30b5f416" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:21:07.025156  6873 raft_consensus.cc:2393] T 30e88460611e47b2ba16a46a30b5f416 P cd75a17ab2604397adab03bb8b5fd75c [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7ab4784c7344b939bc36f639286f377 in current term 14: Already voted for candidate cd75a17ab2604397adab03bb8b5fd75c in this term.
I20260709 13:21:07.025318  6874 raft_consensus.cc:2468] T 7887766dc6784fcaa42b35c05fea7a99 P cd75a17ab2604397adab03bb8b5fd75c [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 20.
I20260709 13:21:07.025038  6798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a75bfe094d4bdc963aba3f08dfcd25" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:21:07.003638  6844 leader_election.cc:304] T bb3d8792045a4583ae2e965b1350a5b4 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:21:06.991191 12566 raft_consensus.cc:2804] T 7c44c4849aa54f2b94d1f1bef9ed546f P b7ab4784c7344b939bc36f639286f377 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:21:06.943272 13074 raft_consensus.cc:515] T 7a734b5ab7834e05a8c422208acc58b1 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } attrs { replace: true } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:21:07.026490  6798 raft_consensus.cc:2468] T 95a75bfe094d4bdc963aba3f08dfcd25 P b7ab4784c7344b939bc36f639286f377 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 15.
I20260709 13:21:07.026568  6805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6869f07b5a4885a0b99fbe60c3b175" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:21:07.028126  6806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbdf895bba214ff68685a24fd17dfb5d" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 17 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:21:07.035668  6806 raft_consensus.cc:3060] T dbdf895bba214ff68685a24fd17dfb5d P b7ab4784c7344b939bc36f639286f377 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:21:06.943519 12945 raft_consensus.cc:515] T 17587d6730594da4a56fa13a353232a1 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:21:07.035858  6805 raft_consensus.cc:2393] T bd6869f07b5a4885a0b99fbe60c3b175 P b7ab4784c7344b939bc36f639286f377 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c in current term 19: Already voted for candidate b7ab4784c7344b939bc36f639286f377 in this term.
I20260709 13:21:06.958338 13091 raft_consensus.cc:515] T fe20b4b48823486ca3b9c648db6ce8aa P ccd8a4c3bfe3413cb2ae219b09aea832 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:21:07.044473  6801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c44c4849aa54f2b94d1f1bef9ed546f" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:21:07.041412  6772 leader_election.cc:304] T f03d0dbf16864ca4bc1bb5e4c0334c0f P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:21:06.972189 13030 raft_consensus.cc:515] T 90d42e216d9741e190bca19a781291fd P cd75a17ab2604397adab03bb8b5fd75c [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:07.001754 13127 raft_consensus.cc:2749] T 4275cf08e63345f993bce8664eada830 P cd75a17ab2604397adab03bb8b5fd75c [term 16 FOLLOWER]: Leader pre-election lost for term 15. Reason: Vote denied by peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391) with higher term. Message: Invalid argument: T 4275cf08e63345f993bce8664eada830 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c for earlier term 15. Current term is 16.
W20260709 13:21:07.022384 12785 consensus_meta.cc:287] T de3186201e1a40d0b335eeb8b4e256e0 P ccd8a4c3bfe3413cb2ae219b09aea832: Time spent flushing consensus metadata: real 0.693s	user 0.013s	sys 0.000s
I20260709 13:21:06.967077 12974 raft_consensus.cc:515] T 404190ce4ce94cecbfcb6ea9d1dd8626 P b7ab4784c7344b939bc36f639286f377 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:21:07.018507 13082 leader_election.cc:290] T 7ba5dac66ab5497e9e336f2a3c28cda5 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 19 election: Requested vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:21:07.053556  6872 raft_consensus.cc:2468] T d8cee0accdb8499c86d4414b72565a38 P cd75a17ab2604397adab03bb8b5fd75c [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 19.
I20260709 13:21:07.020897 12555 raft_consensus.cc:493] T 1bf4668eeb70467fb3dc5a0289233b3c P b7ab4784c7344b939bc36f639286f377 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:21:07.023070 13124 raft_consensus.cc:493] T ab432e62819d499eaaf3dd55481dd930 P b7ab4784c7344b939bc36f639286f377 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:21:07.057524  6881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de3186201e1a40d0b335eeb8b4e256e0" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:21:07.056389  6804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "853ac0a8cbd64ce99457f170216d4d0f" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:21:06.965925 13120 raft_consensus.cc:515] T 8c7f33e544204fbaac4078e3e83bbf4e P cd75a17ab2604397adab03bb8b5fd75c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:07.056458  6798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44bde925b2e541b69890d70715b85176" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:21:07.053558  6807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4b8bd455d5a47c18a1380839c6e0d61" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 19 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:21:07.070451  6798 raft_consensus.cc:2393] T 44bde925b2e541b69890d70715b85176 P b7ab4784c7344b939bc36f639286f377 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c in current term 18: Already voted for candidate b7ab4784c7344b939bc36f639286f377 in this term.
W20260709 13:21:07.061137  7469 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:21:07.039434 12566 raft_consensus.cc:493] T 7c44c4849aa54f2b94d1f1bef9ed546f P b7ab4784c7344b939bc36f639286f377 [term 19 FOLLOWER]: Starting leader election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:21:07.056289  6772 leader_election.cc:304] T 7887766dc6784fcaa42b35c05fea7a99 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:21:07.005993 13111 leader_election.cc:290] T 7a734b5ab7834e05a8c422208acc58b1 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:21:07.049947 13076 raft_consensus.cc:493] T 4d9def8b32fd443aa94ab1420b06837b P b7ab4784c7344b939bc36f639286f377 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:21:07.055230  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 49733.9us
I20260709 13:21:07.015079 12594 raft_consensus.cc:697] T bb3d8792045a4583ae2e965b1350a5b4 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 17 LEADER]: Becoming Leader. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
I20260709 13:21:07.028362 13014 raft_consensus.cc:2764] T 7887766dc6784fcaa42b35c05fea7a99 P cd75a17ab2604397adab03bb8b5fd75c [term 20 FOLLOWER]: Leader pre-election decision vote started in defunct term 18: won
I20260709 13:21:07.080719  6844 leader_election.cc:304] T 22ccee1b570c4ad3a57bd7aec085b1b4 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:21:07.065249  6878 raft_consensus.cc:2468] T 4f00a2e87e56452083b759f60d461ee3 P cd75a17ab2604397adab03bb8b5fd75c [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 20.
I20260709 13:21:07.066241  7500 raft_consensus.cc:1275] T 7a734b5ab7834e05a8c422208acc58b1 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 19 FOLLOWER]: Refusing update from remote peer b7ab4784c7344b939bc36f639286f377: Log matching property violated. Preceding OpId in replica: term: 17 index: 9. Preceding OpId from leader: term: 19 index: 10. (index mismatch)
I20260709 13:21:07.062892  6875 raft_consensus.cc:2468] T b56bf91d90824c959e21e0cee5ba1816 P cd75a17ab2604397adab03bb8b5fd75c [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 18.
I20260709 13:21:06.965966 13107 raft_consensus.cc:515] T ce4f062dcd314d43a63ca74067cb5ee3 P cd75a17ab2604397adab03bb8b5fd75c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } attrs { replace: true } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:21:07.078420  6806 raft_consensus.cc:2468] T dbdf895bba214ff68685a24fd17dfb5d P b7ab4784c7344b939bc36f639286f377 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 17.
I20260709 13:21:07.054879 12631 raft_consensus.cc:2804] T f03d0dbf16864ca4bc1bb5e4c0334c0f P b7ab4784c7344b939bc36f639286f377 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:21:07.063621 12785 raft_consensus.cc:515] T de3186201e1a40d0b335eeb8b4e256e0 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:07.092963 12594 consensus_queue.cc:237] T bb3d8792045a4583ae2e965b1350a5b4 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 16.14, Last appended by leader: 14, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:21:07.093828 13030 leader_election.cc:290] T 90d42e216d9741e190bca19a781291fd P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:21:07.095240  6723 raft_consensus.cc:2393] T de3186201e1a40d0b335eeb8b4e256e0 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7ab4784c7344b939bc36f639286f377 in current term 18: Already voted for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in this term.
I20260709 13:21:07.089318 12631 raft_consensus.cc:493] T f03d0dbf16864ca4bc1bb5e4c0334c0f P b7ab4784c7344b939bc36f639286f377 [term 18 FOLLOWER]: Starting leader election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:21:07.096796 12631 raft_consensus.cc:3060] T f03d0dbf16864ca4bc1bb5e4c0334c0f P b7ab4784c7344b939bc36f639286f377 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:21:07.027593 12965 raft_consensus.cc:515] T f5be3a11b23d4ea9b08300a2789821c7 P b7ab4784c7344b939bc36f639286f377 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:07.079735 13138 raft_consensus.cc:2749] T bb3d8792045a4583ae2e965b1350a5b4 P cd75a17ab2604397adab03bb8b5fd75c [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:21:07.099941 12965 leader_election.cc:290] T f5be3a11b23d4ea9b08300a2789821c7 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 18 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:21:07.101131  6803 raft_consensus.cc:1240] T f5be3a11b23d4ea9b08300a2789821c7 P b7ab4784c7344b939bc36f639286f377 [term 18 FOLLOWER]: Rejecting Update request from peer ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 17. Current term is 18. Ops: []
I20260709 13:21:07.086794  6614 catalog_manager.cc:5028] TS b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817): tablet 24ee15416e3145beaa1b8183453729a3 (table test-workload [id=04f4d366747e43549980077479ed75b9]) successfully deleted
W20260709 13:21:07.104496  6614 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 143023us
I20260709 13:21:07.107007 13120 leader_election.cc:290] T 8c7f33e544204fbaac4078e3e83bbf4e P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:21:07.108423  6880 raft_consensus.cc:1240] T 8c7f33e544204fbaac4078e3e83bbf4e P cd75a17ab2604397adab03bb8b5fd75c [term 15 FOLLOWER]: Rejecting Update request from peer b7ab4784c7344b939bc36f639286f377 for earlier term 14. Current term is 15. Ops: []
I20260709 13:21:07.111307  6807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09c2a98de1a4decabd0ff900dd44caa" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:21:07.086190 12988 consensus_queue.cc:1048] T 7a734b5ab7834e05a8c422208acc58b1 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:21:07.091872 12785 leader_election.cc:290] T de3186201e1a40d0b335eeb8b4e256e0 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 18 election: Requested vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:21:07.093955 13127 raft_consensus.cc:2749] T 22ccee1b570c4ad3a57bd7aec085b1b4 P cd75a17ab2604397adab03bb8b5fd75c [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:21:07.114382 13091 leader_election.cc:290] T fe20b4b48823486ca3b9c648db6ce8aa P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:21:07.073917 12566 raft_consensus.cc:3060] T 7c44c4849aa54f2b94d1f1bef9ed546f P b7ab4784c7344b939bc36f639286f377 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:21:07.115979  7498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe20b4b48823486ca3b9c648db6ce8aa" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
W20260709 13:21:07.116663 13022 consensus_meta.cc:287] T de3186201e1a40d0b335eeb8b4e256e0 P cd75a17ab2604397adab03bb8b5fd75c: Time spent flushing consensus metadata: real 0.649s	user 0.011s	sys 0.001s
I20260709 13:21:07.117287 13022 raft_consensus.cc:515] T de3186201e1a40d0b335eeb8b4e256e0 P cd75a17ab2604397adab03bb8b5fd75c [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:07.118927  6881 raft_consensus.cc:2393] T de3186201e1a40d0b335eeb8b4e256e0 P cd75a17ab2604397adab03bb8b5fd75c [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate b7ab4784c7344b939bc36f639286f377 in current term 18: Already voted for candidate cd75a17ab2604397adab03bb8b5fd75c in this term.
I20260709 13:21:07.122283 13074 leader_election.cc:290] T 7a734b5ab7834e05a8c422208acc58b1 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:21:06.973558 13129 raft_consensus.cc:515] T 34f36d59d88f40fe8a2805e604fc6c0a P cd75a17ab2604397adab03bb8b5fd75c [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:07.124850 13129 leader_election.cc:290] T 34f36d59d88f40fe8a2805e604fc6c0a P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:21:07.126786 12945 leader_election.cc:290] T 17587d6730594da4a56fa13a353232a1 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:21:07.127637  6723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a734b5ab7834e05a8c422208acc58b1" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 20 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
W20260709 13:21:07.128293 13135 log.cc:927] Time spent T 4b8cacb381b746da8d0049b0a83b41dd P 7ba59cc884714e8aa5f3f0ecaed84cbb: Append to log took a long time: real 0.063s	user 0.001s	sys 0.000s
I20260709 13:21:07.128870  6723 raft_consensus.cc:2468] T 7a734b5ab7834e05a8c422208acc58b1 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in term 19.
I20260709 13:21:07.136464 13076 raft_consensus.cc:515] T 4d9def8b32fd443aa94ab1420b06837b P b7ab4784c7344b939bc36f639286f377 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:07.141319  6723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17587d6730594da4a56fa13a353232a1" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:21:07.144516  6723 raft_consensus.cc:2468] T 17587d6730594da4a56fa13a353232a1 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in term 23.
I20260709 13:21:07.146919  7466 leader_election.cc:304] T 17587d6730594da4a56fa13a353232a1 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
I20260709 13:21:07.148778 13076 leader_election.cc:290] T 4d9def8b32fd443aa94ab1420b06837b P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:21:07.083158 12898 raft_consensus.cc:2804] T 7887766dc6784fcaa42b35c05fea7a99 P b7ab4784c7344b939bc36f639286f377 [term 20 FOLLOWER]: Leader election won for term 20
W20260709 13:21:07.150754  6772 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 68685.8us
I20260709 13:21:07.152473  6772 leader_election.cc:304] T d8cee0accdb8499c86d4414b72565a38 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb
I20260709 13:21:07.156154  6723 raft_consensus.cc:1240] T 427c124d773f483294511e80fe340075 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 17 FOLLOWER]: Rejecting Update request from peer 7ba59cc884714e8aa5f3f0ecaed84cbb for earlier term 16. Current term is 17. Ops: []
I20260709 13:21:07.157981  6772 leader_election.cc:304] T 4f00a2e87e56452083b759f60d461ee3 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
W20260709 13:21:07.154109  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 68323us
I20260709 13:21:07.165027 12982 consensus_queue.cc:1059] T 427c124d773f483294511e80fe340075 P 7ba59cc884714e8aa5f3f0ecaed84cbb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } attrs { replace: true }, Status: INVALID_TERM, Last received: 16.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:21:07.166571 13101 leader_election.cc:290] T 44bde925b2e541b69890d70715b85176 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:21:07.159452 13022 leader_election.cc:290] T de3186201e1a40d0b335eeb8b4e256e0 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 18 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:21:07.168215 12974 leader_election.cc:290] T 404190ce4ce94cecbfcb6ea9d1dd8626 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:21:07.075094 13124 raft_consensus.cc:515] T ab432e62819d499eaaf3dd55481dd930 P b7ab4784c7344b939bc36f639286f377 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:07.170702 13124 leader_election.cc:290] T ab432e62819d499eaaf3dd55481dd930 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:21:07.171669 13121 leader_election.cc:290] T 427c124d773f483294511e80fe340075 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:21:07.061723 13041 consensus_queue.cc:260] T 8c7f33e544204fbaac4078e3e83bbf4e P b7ab4784c7344b939bc36f639286f377 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:07.172078 13050 raft_consensus.cc:3060] T 711ef6523deb4cbe8ef2ba61e1c21c98 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:21:07.188016  6803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d65025eea89441290d85dd053810e31" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:21:07.160509 12898 raft_consensus.cc:697] T 7887766dc6784fcaa42b35c05fea7a99 P b7ab4784c7344b939bc36f639286f377 [term 20 LEADER]: Becoming Leader. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
I20260709 13:21:07.188872  6807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8292e16e5654be6bc408560cf256aaa" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:21:07.172135 13104 raft_consensus.cc:2804] T d8cee0accdb8499c86d4414b72565a38 P b7ab4784c7344b939bc36f639286f377 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:21:07.167840 13098 leader_election.cc:290] T bb3d8792045a4583ae2e965b1350a5b4 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:21:07.175625  6723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3d8792045a4583ae2e965b1350a5b4" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:21:07.184688  7466 leader_election.cc:304] T 7ba5dac66ab5497e9e336f2a3c28cda5 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, b7ab4784c7344b939bc36f639286f377; no voters: 
I20260709 13:21:07.185598 13074 consensus_queue.cc:1059] T d8cee0accdb8499c86d4414b72565a38 P 7ba59cc884714e8aa5f3f0ecaed84cbb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: INVALID_TERM, Last received: 18.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:21:07.188221 13041 raft_consensus.cc:3060] T 8c7f33e544204fbaac4078e3e83bbf4e P b7ab4784c7344b939bc36f639286f377 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:21:07.071976 12555 raft_consensus.cc:515] T 1bf4668eeb70467fb3dc5a0289233b3c P b7ab4784c7344b939bc36f639286f377 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:07.191916  6729 raft_consensus.cc:2468] T 1528ab62b6fe4e3099d08f141afee116 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in term 16.
I20260709 13:21:07.193041  6772 leader_election.cc:304] T b56bf91d90824c959e21e0cee5ba1816 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:21:07.200412  6844 leader_election.cc:304] T 95a75bfe094d4bdc963aba3f08dfcd25 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:21:07.206945  6807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f03d0dbf16864ca4bc1bb5e4c0334c0f" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:21:07.210748  6844 leader_election.cc:304] T 3fa34c08b205435dba97346991aa1f92 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:21:07.237411  6803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a734b5ab7834e05a8c422208acc58b1" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 20 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:21:07.240608  6844 leader_election.cc:304] T fe20b4b48823486ca3b9c648db6ce8aa P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:21:07.246487  6803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17587d6730594da4a56fa13a353232a1" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:21:07.159063 13129 consensus_queue.cc:1048] T a1704639a875409b9959353527b3fd68 P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Connected to new peer: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.071s
W20260709 13:21:07.250243  6772 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 57298us
I20260709 13:21:07.199538 13101 raft_consensus.cc:2804] T 4f00a2e87e56452083b759f60d461ee3 P b7ab4784c7344b939bc36f639286f377 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:21:07.204563 12982 raft_consensus.cc:2804] T 7ba5dac66ab5497e9e336f2a3c28cda5 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:21:07.253531  6807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3022224cc81473690653a83d4e99470" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:21:07.253777  6844 leader_election.cc:304] T 853ac0a8cbd64ce99457f170216d4d0f P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:21:07.255577  6803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d9def8b32fd443aa94ab1420b06837b" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:21:07.257843  6803 raft_consensus.cc:2468] T 4d9def8b32fd443aa94ab1420b06837b P b7ab4784c7344b939bc36f639286f377 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 18.
I20260709 13:21:07.235667 13123 raft_consensus.cc:2804] T 95a75bfe094d4bdc963aba3f08dfcd25 P cd75a17ab2604397adab03bb8b5fd75c [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:21:07.257076  6807 raft_consensus.cc:2468] T a3022224cc81473690653a83d4e99470 P b7ab4784c7344b939bc36f639286f377 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 19.
I20260709 13:21:07.259896  6877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5be3a11b23d4ea9b08300a2789821c7" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:21:07.199182 12631 raft_consensus.cc:515] T f03d0dbf16864ca4bc1bb5e4c0334c0f P b7ab4784c7344b939bc36f639286f377 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:07.260694  6877 raft_consensus.cc:3060] T f5be3a11b23d4ea9b08300a2789821c7 P cd75a17ab2604397adab03bb8b5fd75c [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:21:07.246800 13104 raft_consensus.cc:697] T d8cee0accdb8499c86d4414b72565a38 P b7ab4784c7344b939bc36f639286f377 [term 19 LEADER]: Becoming Leader. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
I20260709 13:21:07.264899  6872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44bde925b2e541b69890d70715b85176" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 19 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:21:07.265170  6874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab432e62819d499eaaf3dd55481dd930" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:21:07.265877  6874 raft_consensus.cc:2468] T ab432e62819d499eaaf3dd55481dd930 P cd75a17ab2604397adab03bb8b5fd75c [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 20.
I20260709 13:21:07.266130  6872 raft_consensus.cc:2410] T 44bde925b2e541b69890d70715b85176 P cd75a17ab2604397adab03bb8b5fd75c [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7ab4784c7344b939bc36f639286f377 for term 19 because replica has last-logged OpId of term: 17 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 10.
I20260709 13:21:07.268354  7495 raft_consensus.cc:2468] T be1a92657f494cac8dd227d152f50151 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 20.
I20260709 13:21:07.258096  6844 leader_election.cc:304] T 44bde925b2e541b69890d70715b85176 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:21:07.256362 12730 raft_consensus.cc:2804] T b56bf91d90824c959e21e0cee5ba1816 P b7ab4784c7344b939bc36f639286f377 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:21:07.262020 13101 raft_consensus.cc:697] T 4f00a2e87e56452083b759f60d461ee3 P b7ab4784c7344b939bc36f639286f377 [term 20 LEADER]: Becoming Leader. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
I20260709 13:21:07.269375 12631 leader_election.cc:290] T f03d0dbf16864ca4bc1bb5e4c0334c0f P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 19 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:21:07.269630 12730 raft_consensus.cc:697] T b56bf91d90824c959e21e0cee5ba1816 P b7ab4784c7344b939bc36f639286f377 [term 18 LEADER]: Becoming Leader. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
I20260709 13:21:07.270068 13101 consensus_queue.cc:237] T 4f00a2e87e56452083b759f60d461ee3 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 13, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:21:07.269402  6875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d9def8b32fd443aa94ab1420b06837b" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:21:07.272607  6875 raft_consensus.cc:2468] T 4d9def8b32fd443aa94ab1420b06837b P cd75a17ab2604397adab03bb8b5fd75c [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 17.
I20260709 13:21:07.267479  6772 leader_election.cc:304] T ab432e62819d499eaaf3dd55481dd930 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:21:07.270648 12730 consensus_queue.cc:237] T b56bf91d90824c959e21e0cee5ba1816 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:07.275419  7502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "404190ce4ce94cecbfcb6ea9d1dd8626" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:21:07.155169 13107 leader_election.cc:290] T ce4f062dcd314d43a63ca74067cb5ee3 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:21:07.250391 13127 raft_consensus.cc:2749] T 3fa34c08b205435dba97346991aa1f92 P cd75a17ab2604397adab03bb8b5fd75c [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:21:07.189807 12898 consensus_queue.cc:237] T 7887766dc6784fcaa42b35c05fea7a99 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 18.10, Last appended by leader: 10, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:07.275419  6872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f03d0dbf16864ca4bc1bb5e4c0334c0f" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:21:07.286705  6872 raft_consensus.cc:3060] T f03d0dbf16864ca4bc1bb5e4c0334c0f P cd75a17ab2604397adab03bb8b5fd75c [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:21:07.287475  6877 raft_consensus.cc:2468] T f5be3a11b23d4ea9b08300a2789821c7 P cd75a17ab2604397adab03bb8b5fd75c [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 18.
I20260709 13:21:07.256274 13120 raft_consensus.cc:2749] T fe20b4b48823486ca3b9c648db6ce8aa P cd75a17ab2604397adab03bb8b5fd75c [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:21:07.289971  6807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3411566abe2d4c9bb4b2adfdd05e6f17" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:21:07.290758  6807 raft_consensus.cc:2468] T 3411566abe2d4c9bb4b2adfdd05e6f17 P b7ab4784c7344b939bc36f639286f377 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 16.
I20260709 13:21:07.258572 13141 raft_consensus.cc:493] T 713b5728a197487c9300b310ab94e5a3 P b7ab4784c7344b939bc36f639286f377 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:07.283630  6844 leader_election.cc:304] T 20f6842e26174571996b8dea4151d4be P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:21:07.297195  6872 raft_consensus.cc:2468] T f03d0dbf16864ca4bc1bb5e4c0334c0f P cd75a17ab2604397adab03bb8b5fd75c [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 19.
I20260709 13:21:07.263908 13030 raft_consensus.cc:2804] T 853ac0a8cbd64ce99457f170216d4d0f P cd75a17ab2604397adab03bb8b5fd75c [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:21:07.262862 13123 raft_consensus.cc:493] T 95a75bfe094d4bdc963aba3f08dfcd25 P cd75a17ab2604397adab03bb8b5fd75c [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:07.295357  6772 leader_election.cc:304] T 4d9def8b32fd443aa94ab1420b06837b P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:21:07.302240  7496 raft_consensus.cc:2468] T 4f00a2e87e56452083b759f60d461ee3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 20.
I20260709 13:21:07.278077 13124 raft_consensus.cc:2804] T ab432e62819d499eaaf3dd55481dd930 P b7ab4784c7344b939bc36f639286f377 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:21:07.305892  6772 leader_election.cc:304] T f03d0dbf16864ca4bc1bb5e4c0334c0f P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:21:07.310243  6844 leader_election.cc:304] T 3411566abe2d4c9bb4b2adfdd05e6f17 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:21:07.283957 13084 raft_consensus.cc:2804] T 44bde925b2e541b69890d70715b85176 P cd75a17ab2604397adab03bb8b5fd75c [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:21:07.321662  6844 leader_election.cc:304] T dbdf895bba214ff68685a24fd17dfb5d P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:21:07.316620  6807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e31b9971c15848dea59d4d4130141d9e" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:21:07.326428  6800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d33d5ee8ef6f415593d8df52063161ad" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:21:07.303702 13030 raft_consensus.cc:493] T 853ac0a8cbd64ce99457f170216d4d0f P cd75a17ab2604397adab03bb8b5fd75c [term 14 FOLLOWER]: Starting leader election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:21:07.327680  6800 raft_consensus.cc:2393] T d33d5ee8ef6f415593d8df52063161ad P b7ab4784c7344b939bc36f639286f377 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c in current term 16: Already voted for candidate b7ab4784c7344b939bc36f639286f377 in this term.
I20260709 13:21:07.327092  6807 raft_consensus.cc:2468] T e31b9971c15848dea59d4d4130141d9e P b7ab4784c7344b939bc36f639286f377 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 16.
I20260709 13:21:07.333525  6872 raft_consensus.cc:1240] T bb3d8792045a4583ae2e965b1350a5b4 P cd75a17ab2604397adab03bb8b5fd75c [term 17 FOLLOWER]: Rejecting Update request from peer 7ba59cc884714e8aa5f3f0ecaed84cbb for earlier term 16. Current term is 17. Ops: []
I20260709 13:21:07.334141  6873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a734b5ab7834e05a8c422208acc58b1" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:21:07.307300 13123 raft_consensus.cc:3060] T 95a75bfe094d4bdc963aba3f08dfcd25 P cd75a17ab2604397adab03bb8b5fd75c [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:21:07.310838 12811 raft_consensus.cc:2804] T 4d9def8b32fd443aa94ab1420b06837b P b7ab4784c7344b939bc36f639286f377 [term 18 FOLLOWER]: Leader pre-election won for term 19
W20260709 13:21:07.343724  7469 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:21:07.345960  6879 raft_consensus.cc:1240] T d8cee0accdb8499c86d4414b72565a38 P cd75a17ab2604397adab03bb8b5fd75c [term 19 FOLLOWER]: Rejecting Update request from peer 7ba59cc884714e8aa5f3f0ecaed84cbb for earlier term 18. Current term is 19. Ops: []
I20260709 13:21:07.316262 13124 raft_consensus.cc:493] T ab432e62819d499eaaf3dd55481dd930 P b7ab4784c7344b939bc36f639286f377 [term 20 FOLLOWER]: Starting leader election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:21:07.347849  6873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b8cacb381b746da8d0049b0a83b41dd" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:21:07.320429 13076 raft_consensus.cc:2804] T f03d0dbf16864ca4bc1bb5e4c0334c0f P b7ab4784c7344b939bc36f639286f377 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:21:07.322036 13084 raft_consensus.cc:493] T 44bde925b2e541b69890d70715b85176 P cd75a17ab2604397adab03bb8b5fd75c [term 17 FOLLOWER]: Starting leader election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:21:07.332544 13030 raft_consensus.cc:3060] T 853ac0a8cbd64ce99457f170216d4d0f P cd75a17ab2604397adab03bb8b5fd75c [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:21:07.351009  6727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4db81d9d329422bb3b4160ca4ac2d1d" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:21:07.328747 13131 raft_consensus.cc:2804] T 20f6842e26174571996b8dea4151d4be P cd75a17ab2604397adab03bb8b5fd75c [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:21:07.353540  6729 raft_consensus.cc:1275] T 7a734b5ab7834e05a8c422208acc58b1 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 19 FOLLOWER]: Refusing update from remote peer b7ab4784c7344b939bc36f639286f377: Log matching property violated. Preceding OpId in replica: term: 17 index: 8. Preceding OpId from leader: term: 19 index: 10. (index mismatch)
I20260709 13:21:07.353955  6873 raft_consensus.cc:2468] T 4b8cacb381b746da8d0049b0a83b41dd P cd75a17ab2604397adab03bb8b5fd75c [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in term 18.
I20260709 13:21:07.354152  6800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20f6842e26174571996b8dea4151d4be" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:21:07.363179  6800 raft_consensus.cc:2468] T 20f6842e26174571996b8dea4151d4be P b7ab4784c7344b939bc36f639286f377 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 18.
I20260709 13:21:07.350353  6724 raft_consensus.cc:1240] T 3d65025eea89441290d85dd053810e31 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 19 FOLLOWER]: Rejecting Update request from peer b7ab4784c7344b939bc36f639286f377 for earlier term 18. Current term is 19. Ops: []
I20260709 13:21:07.363554  6729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f03d0dbf16864ca4bc1bb5e4c0334c0f" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:21:07.364794  6724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab432e62819d499eaaf3dd55481dd930" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:21:07.360630  6731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "404190ce4ce94cecbfcb6ea9d1dd8626" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:21:07.346948 13127 raft_consensus.cc:2804] T dbdf895bba214ff68685a24fd17dfb5d P cd75a17ab2604397adab03bb8b5fd75c [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:21:07.350787  6732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30e88460611e47b2ba16a46a30b5f416" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:21:07.335907 13107 raft_consensus.cc:2804] T 3411566abe2d4c9bb4b2adfdd05e6f17 P cd75a17ab2604397adab03bb8b5fd75c [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:21:07.351498  6875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f00a2e87e56452083b759f60d461ee3" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:21:07.368499  6875 raft_consensus.cc:2368] T 4f00a2e87e56452083b759f60d461ee3 P cd75a17ab2604397adab03bb8b5fd75c [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ba59cc884714e8aa5f3f0ecaed84cbb for earlier term 19. Current term is 20.
I20260709 13:21:07.358353  6730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de3186201e1a40d0b335eeb8b4e256e0" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:21:07.369860  6730 raft_consensus.cc:2393] T de3186201e1a40d0b335eeb8b4e256e0 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate b7ab4784c7344b939bc36f639286f377 in current term 18: Already voted for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in this term.
I20260709 13:21:07.367756  6770 leader_election.cc:304] T d8292e16e5654be6bc408560cf256aaa P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:21:07.354810 13124 raft_consensus.cc:3060] T ab432e62819d499eaaf3dd55481dd930 P b7ab4784c7344b939bc36f639286f377 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:21:07.348321  6872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ba5dac66ab5497e9e336f2a3c28cda5" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:21:07.373941  6872 raft_consensus.cc:2393] T 7ba5dac66ab5497e9e336f2a3c28cda5 P cd75a17ab2604397adab03bb8b5fd75c [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in current term 19: Already voted for candidate cd75a17ab2604397adab03bb8b5fd75c in this term.
I20260709 13:21:07.374003  6881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb7fa124c3bf4ef9ab65a407cb008441" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 19 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:21:07.365800  6731 raft_consensus.cc:2393] T 404190ce4ce94cecbfcb6ea9d1dd8626 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7ab4784c7344b939bc36f639286f377 in current term 16: Already voted for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in this term.
I20260709 13:21:07.356485  6723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5be3a11b23d4ea9b08300a2789821c7" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:21:07.349859 12811 raft_consensus.cc:493] T 4d9def8b32fd443aa94ab1420b06837b P b7ab4784c7344b939bc36f639286f377 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:07.308892 13141 raft_consensus.cc:515] T 713b5728a197487c9300b310ab94e5a3 P b7ab4784c7344b939bc36f639286f377 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:07.378818 13127 raft_consensus.cc:697] T dbdf895bba214ff68685a24fd17dfb5d P cd75a17ab2604397adab03bb8b5fd75c [term 17 LEADER]: Becoming Leader. State: Replica: cd75a17ab2604397adab03bb8b5fd75c, State: Running, Role: LEADER
I20260709 13:21:07.379099 12555 leader_election.cc:290] T 1bf4668eeb70467fb3dc5a0289233b3c P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:21:07.379931 13127 consensus_queue.cc:237] T dbdf895bba214ff68685a24fd17dfb5d P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 15.7, Last appended by leader: 7, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:07.380862 13141 leader_election.cc:290] T 713b5728a197487c9300b310ab94e5a3 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:21:07.372978 12631 raft_consensus.cc:2749] T d8292e16e5654be6bc408560cf256aaa P b7ab4784c7344b939bc36f639286f377 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:21:07.362669 13131 raft_consensus.cc:493] T 20f6842e26174571996b8dea4151d4be P cd75a17ab2604397adab03bb8b5fd75c [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:07.389958  6729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c240553ce044eedb41541d72b9475d7" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:21:07.371313  6873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce4f062dcd314d43a63ca74067cb5ee3" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:21:07.390970  6724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "427c124d773f483294511e80fe340075" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:21:07.392071  6873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3d8792045a4583ae2e965b1350a5b4" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:21:07.392103  6724 raft_consensus.cc:2393] T 427c124d773f483294511e80fe340075 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c in current term 17: Already voted for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in this term.
I20260709 13:21:07.392366  6878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f00a2e87e56452083b759f60d461ee3" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:21:07.392984  6873 raft_consensus.cc:2468] T bb3d8792045a4583ae2e965b1350a5b4 P cd75a17ab2604397adab03bb8b5fd75c [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in term 17.
I20260709 13:21:07.393324  6878 raft_consensus.cc:2368] T 4f00a2e87e56452083b759f60d461ee3 P cd75a17ab2604397adab03bb8b5fd75c [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ba59cc884714e8aa5f3f0ecaed84cbb for earlier term 19. Current term is 20.
I20260709 13:21:07.393751  6873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a734b5ab7834e05a8c422208acc58b1" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 20 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:21:07.262094 13104 consensus_queue.cc:237] T d8cee0accdb8499c86d4414b72565a38 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 13, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:21:07.360440  6726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44bde925b2e541b69890d70715b85176" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 19 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:21:07.358852 13084 raft_consensus.cc:3060] T 44bde925b2e541b69890d70715b85176 P cd75a17ab2604397adab03bb8b5fd75c [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:21:07.377978  6770 leader_election.cc:304] T dbdf895bba214ff68685a24fd17dfb5d P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:21:07.361241 13076 raft_consensus.cc:697] T f03d0dbf16864ca4bc1bb5e4c0334c0f P b7ab4784c7344b939bc36f639286f377 [term 19 LEADER]: Becoming Leader. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
I20260709 13:21:07.378445 12811 raft_consensus.cc:3060] T 4d9def8b32fd443aa94ab1420b06837b P b7ab4784c7344b939bc36f639286f377 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:21:07.370318  6728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d9def8b32fd443aa94ab1420b06837b" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:21:07.411199  6727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30e88460611e47b2ba16a46a30b5f416" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:21:07.411540  6728 raft_consensus.cc:2468] T 4d9def8b32fd443aa94ab1420b06837b P ccd8a4c3bfe3413cb2ae219b09aea832 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 18.
I20260709 13:21:07.384299  6872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a734b5ab7834e05a8c422208acc58b1" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:21:07.412328  6770 leader_election.cc:304] T 1528ab62b6fe4e3099d08f141afee116 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb
I20260709 13:21:07.387429  6732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e326172347f45e99a0d482b5d8ef768" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:21:07.394450  6729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90d42e216d9741e190bca19a781291fd" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:21:07.407375  6726 raft_consensus.cc:2410] T 44bde925b2e541b69890d70715b85176 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7ab4784c7344b939bc36f639286f377 for term 19 because replica has last-logged OpId of term: 17 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 10.
I20260709 13:21:07.369318 13107 raft_consensus.cc:493] T 3411566abe2d4c9bb4b2adfdd05e6f17 P cd75a17ab2604397adab03bb8b5fd75c [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:07.409031  6881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b8cacb381b746da8d0049b0a83b41dd" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:21:07.414204  6879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ba5dac66ab5497e9e336f2a3c28cda5" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:21:07.416721  6732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34f36d59d88f40fe8a2805e604fc6c0a" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:21:07.417981  6729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce4f062dcd314d43a63ca74067cb5ee3" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:21:07.417722  6881 raft_consensus.cc:2468] T 4b8cacb381b746da8d0049b0a83b41dd P cd75a17ab2604397adab03bb8b5fd75c [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in term 18.
I20260709 13:21:07.419147  6729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c7f33e544204fbaac4078e3e83bbf4e" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:21:07.426523  6879 raft_consensus.cc:2393] T 7ba5dac66ab5497e9e336f2a3c28cda5 P cd75a17ab2604397adab03bb8b5fd75c [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in current term 19: Already voted for candidate cd75a17ab2604397adab03bb8b5fd75c in this term.
I20260709 13:21:07.398276 13131 raft_consensus.cc:3060] T 20f6842e26174571996b8dea4151d4be P cd75a17ab2604397adab03bb8b5fd75c [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:21:07.436471  6724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de3186201e1a40d0b335eeb8b4e256e0" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:21:07.438386  6724 raft_consensus.cc:2393] T de3186201e1a40d0b335eeb8b4e256e0 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c in current term 18: Already voted for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in this term.
I20260709 13:21:07.377264 12988 consensus_queue.cc:1048] T 17587d6730594da4a56fa13a353232a1 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 14, Time since last communication: 0.041s
I20260709 13:21:07.418680 13107 raft_consensus.cc:3060] T 3411566abe2d4c9bb4b2adfdd05e6f17 P cd75a17ab2604397adab03bb8b5fd75c [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:21:07.418478 12631 raft_consensus.cc:2749] T dbdf895bba214ff68685a24fd17dfb5d P b7ab4784c7344b939bc36f639286f377 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:21:07.463100  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 51102.5us
W20260709 13:21:07.457329 13116 log.cc:927] Time spent T f5be3a11b23d4ea9b08300a2789821c7 P ccd8a4c3bfe3413cb2ae219b09aea832: Append to log took a long time: real 0.933s	user 0.006s	sys 0.001s
I20260709 13:21:07.465270  6770 leader_election.cc:304] T 95a75bfe094d4bdc963aba3f08dfcd25 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:21:07.435613 12998 raft_consensus.cc:2764] T 1528ab62b6fe4e3099d08f141afee116 P b7ab4784c7344b939bc36f639286f377 [term 16 FOLLOWER]: Leader pre-election decision vote started in defunct term 15: won
W20260709 13:21:07.463853 13149 log.cc:927] Time spent T 3d65025eea89441290d85dd053810e31 P cd75a17ab2604397adab03bb8b5fd75c: Append to log took a long time: real 0.053s	user 0.000s	sys 0.001s
I20260709 13:21:07.469134  6770 leader_election.cc:304] T bd6869f07b5a4885a0b99fbe60c3b175 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:21:07.474073  6770 leader_election.cc:304] T b3f13b31a1f84f0d89d007eadd57924c P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:21:07.477314  6844 leader_election.cc:304] T 7c44c4849aa54f2b94d1f1bef9ed546f P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:21:07.471474 13026 raft_consensus.cc:2804] T 95a75bfe094d4bdc963aba3f08dfcd25 P b7ab4784c7344b939bc36f639286f377 [term 15 FOLLOWER]: Leader pre-election won for term 16
W20260709 13:21:07.472828 13146 log.cc:927] Time spent T bb3d8792045a4583ae2e965b1350a5b4 P ccd8a4c3bfe3413cb2ae219b09aea832: Append to log took a long time: real 0.115s	user 0.000s	sys 0.001s
I20260709 13:21:07.487298  6844 leader_election.cc:304] T bd6869f07b5a4885a0b99fbe60c3b175 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:21:07.449864 13076 consensus_queue.cc:237] T f03d0dbf16864ca4bc1bb5e4c0334c0f P b7ab4784c7344b939bc36f639286f377 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 18.9, Last appended by leader: 9, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:07.487504  5625 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:21:07.485222  6770 leader_election.cc:304] T d33d5ee8ef6f415593d8df52063161ad P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:21:07.464778 12566 raft_consensus.cc:515] T 7c44c4849aa54f2b94d1f1bef9ed546f P b7ab4784c7344b939bc36f639286f377 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:07.491689  6844 leader_election.cc:304] T f4b8bd455d5a47c18a1380839c6e0d61 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:21:07.473305 12631 raft_consensus.cc:2749] T bd6869f07b5a4885a0b99fbe60c3b175 P b7ab4784c7344b939bc36f639286f377 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:21:07.470677 13127 raft_consensus.cc:493] T 07a92dd554674067a83a9cb68c4773f2 P cd75a17ab2604397adab03bb8b5fd75c [term 16 FOLLOWER]: Starting pre-election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:21:07.472816 13132 consensus_queue.cc:1059] T a1704639a875409b9959353527b3fd68 P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.017s
I20260709 13:21:07.498135  6770 leader_election.cc:304] T 20f6842e26174571996b8dea4151d4be P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:21:07.484357 13026 raft_consensus.cc:493] T 95a75bfe094d4bdc963aba3f08dfcd25 P b7ab4784c7344b939bc36f639286f377 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:07.480966 12998 raft_consensus.cc:2749] T b3f13b31a1f84f0d89d007eadd57924c P b7ab4784c7344b939bc36f639286f377 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:21:07.489533 13121 raft_consensus.cc:2749] T 7c44c4849aa54f2b94d1f1bef9ed546f P cd75a17ab2604397adab03bb8b5fd75c [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:21:07.513397  6770 leader_election.cc:304] T be1a92657f494cac8dd227d152f50151 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:21:07.497224 13022 raft_consensus.cc:3060] T bd6869f07b5a4885a0b99fbe60c3b175 P cd75a17ab2604397adab03bb8b5fd75c [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:21:07.500089 12730 raft_consensus.cc:2749] T d33d5ee8ef6f415593d8df52063161ad P b7ab4784c7344b939bc36f639286f377 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:21:07.521060  6697 leader_election.cc:304] T 713b5728a197487c9300b310ab94e5a3 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377
I20260709 13:21:07.513463 13026 raft_consensus.cc:3060] T 95a75bfe094d4bdc963aba3f08dfcd25 P b7ab4784c7344b939bc36f639286f377 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:21:07.533939  6770 leader_election.cc:304] T a1704639a875409b9959353527b3fd68 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:21:07.537636  6697 leader_election.cc:304] T c4db81d9d329422bb3b4160ca4ac2d1d P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:21:07.538859  6697 leader_election.cc:304] T 3fa34c08b205435dba97346991aa1f92 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb
I20260709 13:21:07.514966 13118 raft_consensus.cc:2804] T 20f6842e26174571996b8dea4151d4be P b7ab4784c7344b939bc36f639286f377 [term 18 FOLLOWER]: Leader election won for term 18
W20260709 13:21:07.540969  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 49361.4us
I20260709 13:21:07.543246  6770 leader_election.cc:304] T f3f9c2e2bf644115957398fe4c9459db P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:21:07.542448 12998 raft_consensus.cc:3060] T be1a92657f494cac8dd227d152f50151 P b7ab4784c7344b939bc36f639286f377 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:21:07.533975 12863 raft_consensus.cc:2804] T 713b5728a197487c9300b310ab94e5a3 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:21:07.526693 13121 raft_consensus.cc:2749] T f4b8bd455d5a47c18a1380839c6e0d61 P cd75a17ab2604397adab03bb8b5fd75c [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:21:07.511997 12811 raft_consensus.cc:515] T 4d9def8b32fd443aa94ab1420b06837b P b7ab4784c7344b939bc36f639286f377 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:07.511843 13127 raft_consensus.cc:515] T 07a92dd554674067a83a9cb68c4773f2 P cd75a17ab2604397adab03bb8b5fd75c [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
W20260709 13:21:07.558127 13155 log.cc:927] Time spent T dbdf895bba214ff68685a24fd17dfb5d P cd75a17ab2604397adab03bb8b5fd75c: Append to log took a long time: real 0.087s	user 0.001s	sys 0.000s
I20260709 13:21:07.561741 12811 leader_election.cc:290] T 4d9def8b32fd443aa94ab1420b06837b P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 19 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:21:07.562788 12566 leader_election.cc:290] T 7c44c4849aa54f2b94d1f1bef9ed546f P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 20 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:21:07.549762 12631 raft_consensus.cc:2749] T f3f9c2e2bf644115957398fe4c9459db P b7ab4784c7344b939bc36f639286f377 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:21:07.544976 13050 raft_consensus.cc:2749] T c4db81d9d329422bb3b4160ca4ac2d1d P ccd8a4c3bfe3413cb2ae219b09aea832 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:21:07.517457 13124 raft_consensus.cc:515] T ab432e62819d499eaaf3dd55481dd930 P b7ab4784c7344b939bc36f639286f377 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:07.553906 13132 raft_consensus.cc:3055] T a1704639a875409b9959353527b3fd68 P cd75a17ab2604397adab03bb8b5fd75c [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:21:07.547957 12905 raft_consensus.cc:2804] T 3fa34c08b205435dba97346991aa1f92 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:21:07.547130 12730 raft_consensus.cc:2804] T a1704639a875409b9959353527b3fd68 P b7ab4784c7344b939bc36f639286f377 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:21:07.560254 13159 raft_consensus.cc:493] T e77e330a82df4b43a745d57a68f6f057 P cd75a17ab2604397adab03bb8b5fd75c [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:21:07.560344 13153 log.cc:927] Time spent T b56bf91d90824c959e21e0cee5ba1816 P b7ab4784c7344b939bc36f639286f377: Append to log took a long time: real 0.081s	user 0.000s	sys 0.001s
I20260709 13:21:07.554694 12863 raft_consensus.cc:493] T 713b5728a197487c9300b310ab94e5a3 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:07.555692 13118 raft_consensus.cc:697] T 20f6842e26174571996b8dea4151d4be P b7ab4784c7344b939bc36f639286f377 [term 18 LEADER]: Becoming Leader. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
I20260709 13:21:07.575704 12730 raft_consensus.cc:697] T a1704639a875409b9959353527b3fd68 P b7ab4784c7344b939bc36f639286f377 [term 19 LEADER]: Becoming Leader. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
I20260709 13:21:07.574509 13159 raft_consensus.cc:515] T e77e330a82df4b43a745d57a68f6f057 P cd75a17ab2604397adab03bb8b5fd75c [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } }
I20260709 13:21:07.569274 12831 raft_consensus.cc:493] T 1bf4668eeb70467fb3dc5a0289233b3c P cd75a17ab2604397adab03bb8b5fd75c [term 16 FOLLOWER]: Starting pre-election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:21:07.561792 13127 leader_election.cc:290] T 07a92dd554674067a83a9cb68c4773f2 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:21:07.580710 13124 leader_election.cc:290] T ab432e62819d499eaaf3dd55481dd930 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 21 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:21:07.572077 13132 raft_consensus.cc:740] T a1704639a875409b9959353527b3fd68 P cd75a17ab2604397adab03bb8b5fd75c [term 18 LEADER]: Becoming Follower/Learner. State: Replica: cd75a17ab2604397adab03bb8b5fd75c, State: Running, Role: LEADER
I20260709 13:21:07.585870 13016 raft_consensus.cc:3060] T 404190ce4ce94cecbfcb6ea9d1dd8626 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:21:07.638404  6697 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 91698.7us
I20260709 13:21:07.547922  6770 leader_election.cc:304] T 3411566abe2d4c9bb4b2adfdd05e6f17 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:21:07.597067 13098 raft_consensus.cc:3055] T d8cee0accdb8499c86d4414b72565a38 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:21:07.680305 13098 raft_consensus.cc:740] T d8cee0accdb8499c86d4414b72565a38 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 7ba59cc884714e8aa5f3f0ecaed84cbb, State: Running, Role: LEADER
I20260709 13:21:07.681118 13124 raft_consensus.cc:2749] T 3411566abe2d4c9bb4b2adfdd05e6f17 P b7ab4784c7344b939bc36f639286f377 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:21:07.682710  6770 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 134730us
I20260709 13:21:07.574918 12863 raft_consensus.cc:3060] T 713b5728a197487c9300b310ab94e5a3 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:21:07.572888 12905 raft_consensus.cc:493] T 3fa34c08b205435dba97346991aa1f92 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 21 FOLLOWER]: Starting leader election (detected failure of leader 7ba59cc884714e8aa5f3f0ecaed84cbb)
I20260709 13:21:07.687654 12905 raft_consensus.cc:3060] T 3fa34c08b205435dba97346991aa1f92 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:21:07.601481 13159 leader_election.cc:290] T e77e330a82df4b43a745d57a68f6f057 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391)
I20260709 13:21:07.648720 12730 consensus_queue.cc:237] T a1704639a875409b9959353527b3fd68 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:07.596449 13118 consensus_queue.cc:237] T 20f6842e26174571996b8dea4151d4be P b7ab4784c7344b939bc36f639286f377 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:07.588714 12831 raft_consensus.cc:515] T 1bf4668eeb70467fb3dc5a0289233b3c P cd75a17ab2604397adab03bb8b5fd75c [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
W20260709 13:21:07.670141  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 108230us
I20260709 13:21:07.596611 13132 consensus_queue.cc:260] T a1704639a875409b9959353527b3fd68 P cd75a17ab2604397adab03bb8b5fd75c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.12, Last appended by leader: 12, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:07.685636 13098 consensus_queue.cc:260] T d8cee0accdb8499c86d4414b72565a38 P 7ba59cc884714e8aa5f3f0ecaed84cbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 13, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:21:07.707180 12831 leader_election.cc:290] T 1bf4668eeb70467fb3dc5a0289233b3c P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:21:07.737766  6844 leader_election.cc:304] T f09c2a98de1a4decabd0ff900dd44caa P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:21:07.760380 13098 raft_consensus.cc:3060] T d8cee0accdb8499c86d4414b72565a38 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:21:07.766885 12831 raft_consensus.cc:2749] T f09c2a98de1a4decabd0ff900dd44caa P cd75a17ab2604397adab03bb8b5fd75c [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:21:07.767201  6844 leader_election.cc:304] T 3d65025eea89441290d85dd053810e31 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:21:07.771246  6844 leader_election.cc:304] T d8292e16e5654be6bc408560cf256aaa P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:21:07.774125 12831 raft_consensus.cc:2749] T 3d65025eea89441290d85dd053810e31 P cd75a17ab2604397adab03bb8b5fd75c [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:21:07.776382  6874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22ccee1b570c4ad3a57bd7aec085b1b4" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:21:07.792527 12945 raft_consensus.cc:2804] T 17587d6730594da4a56fa13a353232a1 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:21:07.793967 12863 raft_consensus.cc:515] T 713b5728a197487c9300b310ab94e5a3 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:07.798209 13132 raft_consensus.cc:3060] T a1704639a875409b9959353527b3fd68 P cd75a17ab2604397adab03bb8b5fd75c [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:21:07.821084  6800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b3759de40694069b13c0f8bd40e5709" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:21:07.822250  6800 raft_consensus.cc:3060] T 9b3759de40694069b13c0f8bd40e5709 P b7ab4784c7344b939bc36f639286f377 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:21:07.839282  6876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bf4668eeb70467fb3dc5a0289233b3c" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:21:07.844841  6801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d65025eea89441290d85dd053810e31" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:21:07.853912 13095 raft_consensus.cc:3055] T 427c124d773f483294511e80fe340075 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:21:07.854506 13095 raft_consensus.cc:740] T 427c124d773f483294511e80fe340075 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 7ba59cc884714e8aa5f3f0ecaed84cbb, State: Running, Role: LEADER
I20260709 13:21:07.856859  6874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44bde925b2e541b69890d70715b85176" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:21:07.856858 12982 raft_consensus.cc:697] T 7ba5dac66ab5497e9e336f2a3c28cda5 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 19 LEADER]: Becoming Leader. State: Replica: 7ba59cc884714e8aa5f3f0ecaed84cbb, State: Running, Role: LEADER
I20260709 13:21:07.859215  6807 raft_consensus.cc:1240] T 711ef6523deb4cbe8ef2ba61e1c21c98 P b7ab4784c7344b939bc36f639286f377 [term 20 FOLLOWER]: Rejecting Update request from peer ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 19. Current term is 20. Ops: []
I20260709 13:21:07.860575 12982 consensus_queue.cc:237] T 7ba5dac66ab5497e9e336f2a3c28cda5 P 7ba59cc884714e8aa5f3f0ecaed84cbb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:21:07.862161 12594 raft_consensus.cc:493] T 853ac0a8cbd64ce99457f170216d4d0f P ccd8a4c3bfe3413cb2ae219b09aea832 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:21:07.863240  6799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7887766dc6784fcaa42b35c05fea7a99" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:21:07.863485 12594 raft_consensus.cc:515] T 853ac0a8cbd64ce99457f170216d4d0f P ccd8a4c3bfe3413cb2ae219b09aea832 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:07.868562 12594 leader_election.cc:290] T 853ac0a8cbd64ce99457f170216d4d0f P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:21:07.874650 12704 raft_consensus.cc:493] T 711ef6523deb4cbe8ef2ba61e1c21c98 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:07.876155 12831 raft_consensus.cc:2749] T d8292e16e5654be6bc408560cf256aaa P cd75a17ab2604397adab03bb8b5fd75c [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:21:07.873719  7468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 447639us
W20260709 13:21:07.879154  7468 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:21:07.882440 12945 raft_consensus.cc:493] T 17587d6730594da4a56fa13a353232a1 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 23 FOLLOWER]: Starting leader election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:21:07.895416  6875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c7f33e544204fbaac4078e3e83bbf4e" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:21:07.895464 12945 raft_consensus.cc:3060] T 17587d6730594da4a56fa13a353232a1 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:21:07.896536  6875 raft_consensus.cc:2393] T 8c7f33e544204fbaac4078e3e83bbf4e P cd75a17ab2604397adab03bb8b5fd75c [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ccd8a4c3bfe3413cb2ae219b09aea832 in current term 15: Already voted for candidate cd75a17ab2604397adab03bb8b5fd75c in this term.
I20260709 13:21:07.896934  6881 raft_consensus.cc:1240] T b56bf91d90824c959e21e0cee5ba1816 P cd75a17ab2604397adab03bb8b5fd75c [term 18 FOLLOWER]: Rejecting Update request from peer ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 17. Current term is 18. Ops: []
I20260709 13:21:07.898869 12863 leader_election.cc:290] T 713b5728a197487c9300b310ab94e5a3 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 16 election: Requested vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:21:07.893076  6876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4b8bd455d5a47c18a1380839c6e0d61" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:21:07.887802  7494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ba5dac66ab5497e9e336f2a3c28cda5" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb"
I20260709 13:21:07.901079  6876 raft_consensus.cc:2468] T f4b8bd455d5a47c18a1380839c6e0d61 P cd75a17ab2604397adab03bb8b5fd75c [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 18.
I20260709 13:21:07.892961  7500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce4f062dcd314d43a63ca74067cb5ee3" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:21:07.893769  6880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20f6842e26174571996b8dea4151d4be" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:21:07.801635 13131 raft_consensus.cc:515] T 20f6842e26174571996b8dea4151d4be P cd75a17ab2604397adab03bb8b5fd75c [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:07.862398  6803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a734b5ab7834e05a8c422208acc58b1" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 20 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:21:07.921663  6805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34f36d59d88f40fe8a2805e604fc6c0a" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:21:07.922274  7495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "427c124d773f483294511e80fe340075" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:21:07.875738 12704 raft_consensus.cc:515] T 711ef6523deb4cbe8ef2ba61e1c21c98 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:07.929106  6876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "713b5728a197487c9300b310ab94e5a3" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:21:07.926939  6772 leader_election.cc:304] T f5be3a11b23d4ea9b08300a2789821c7 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:21:07.906088 13084 raft_consensus.cc:515] T 44bde925b2e541b69890d70715b85176 P cd75a17ab2604397adab03bb8b5fd75c [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:07.940698 12863 raft_consensus.cc:493] T bd6869f07b5a4885a0b99fbe60c3b175 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:07.944895 12863 raft_consensus.cc:515] T bd6869f07b5a4885a0b99fbe60c3b175 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:07.855870 13095 consensus_queue.cc:260] T 427c124d773f483294511e80fe340075 P 7ba59cc884714e8aa5f3f0ecaed84cbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } attrs { replace: true } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:21:07.949276  6881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "427c124d773f483294511e80fe340075" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:21:07.949491  6803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de3186201e1a40d0b335eeb8b4e256e0" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:21:07.950446  6881 raft_consensus.cc:3060] T 427c124d773f483294511e80fe340075 P cd75a17ab2604397adab03bb8b5fd75c [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:21:07.950784  6803 raft_consensus.cc:2393] T de3186201e1a40d0b335eeb8b4e256e0 P b7ab4784c7344b939bc36f639286f377 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate ccd8a4c3bfe3413cb2ae219b09aea832 in current term 18: Already voted for candidate b7ab4784c7344b939bc36f639286f377 in this term.
I20260709 13:21:07.953104  6880 raft_consensus.cc:2393] T 20f6842e26174571996b8dea4151d4be P cd75a17ab2604397adab03bb8b5fd75c [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ccd8a4c3bfe3413cb2ae219b09aea832 in current term 19: Already voted for candidate cd75a17ab2604397adab03bb8b5fd75c in this term.
I20260709 13:21:07.944926  6805 raft_consensus.cc:1275] T 7c37d41cd9164c15a6826ca62a851a69 P b7ab4784c7344b939bc36f639286f377 [term 18 FOLLOWER]: Refusing update from remote peer ccd8a4c3bfe3413cb2ae219b09aea832: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 13:21:07.957581  6872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbdf895bba214ff68685a24fd17dfb5d" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 17 candidate_status { last_received { term: 14 index: 6 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:21:07.949980 13131 leader_election.cc:290] T 20f6842e26174571996b8dea4151d4be P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 19 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:21:07.992880 12897 raft_consensus.cc:2804] T f5be3a11b23d4ea9b08300a2789821c7 P b7ab4784c7344b939bc36f639286f377 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:21:07.993666 12897 raft_consensus.cc:697] T f5be3a11b23d4ea9b08300a2789821c7 P b7ab4784c7344b939bc36f639286f377 [term 18 LEADER]: Becoming Leader. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
I20260709 13:21:07.994755 12897 consensus_queue.cc:237] T f5be3a11b23d4ea9b08300a2789821c7 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.10, Last appended by leader: 10, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:07.963114  6874 raft_consensus.cc:2468] T 44bde925b2e541b69890d70715b85176 P cd75a17ab2604397adab03bb8b5fd75c [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 18.
W20260709 13:21:07.997550 13030 consensus_meta.cc:287] T 853ac0a8cbd64ce99457f170216d4d0f P cd75a17ab2604397adab03bb8b5fd75c: Time spent flushing consensus metadata: real 0.628s	user 0.007s	sys 0.012s
I20260709 13:21:07.998131 13030 raft_consensus.cc:515] T 853ac0a8cbd64ce99457f170216d4d0f P cd75a17ab2604397adab03bb8b5fd75c [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:07.998553  6874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d65025eea89441290d85dd053810e31" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
W20260709 13:21:07.999136 13123 consensus_meta.cc:287] T 95a75bfe094d4bdc963aba3f08dfcd25 P cd75a17ab2604397adab03bb8b5fd75c: Time spent flushing consensus metadata: real 0.644s	user 0.012s	sys 0.006s
I20260709 13:21:07.963361  6879 raft_consensus.cc:1240] T f5be3a11b23d4ea9b08300a2789821c7 P cd75a17ab2604397adab03bb8b5fd75c [term 18 FOLLOWER]: Rejecting Update request from peer ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 17. Current term is 18. Ops: []
I20260709 13:21:07.968433  6876 raft_consensus.cc:2468] T 713b5728a197487c9300b310ab94e5a3 P cd75a17ab2604397adab03bb8b5fd75c [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 14.
I20260709 13:21:07.970793  6873 raft_consensus.cc:1240] T 30e88460611e47b2ba16a46a30b5f416 P cd75a17ab2604397adab03bb8b5fd75c [term 14 FOLLOWER]: Rejecting Update request from peer ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 13. Current term is 14. Ops: []
I20260709 13:21:07.971107 13084 leader_election.cc:290] T 44bde925b2e541b69890d70715b85176 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 18 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:21:07.972570  6878 raft_consensus.cc:1275] T e77e330a82df4b43a745d57a68f6f057 P cd75a17ab2604397adab03bb8b5fd75c [term 19 FOLLOWER]: Refusing update from remote peer ccd8a4c3bfe3413cb2ae219b09aea832: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
I20260709 13:21:08.007423  6873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a734b5ab7834e05a8c422208acc58b1" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 20 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:21:08.009332  6873 raft_consensus.cc:1275] T 4275cf08e63345f993bce8664eada830 P cd75a17ab2604397adab03bb8b5fd75c [term 16 FOLLOWER]: Refusing update from remote peer ccd8a4c3bfe3413cb2ae219b09aea832: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
W20260709 13:21:08.009622  6695 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:21:07.974943  6880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b3759de40694069b13c0f8bd40e5709" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:21:08.010433  6880 raft_consensus.cc:3060] T 9b3759de40694069b13c0f8bd40e5709 P cd75a17ab2604397adab03bb8b5fd75c [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:21:08.011090  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 240114us
I20260709 13:21:08.012279  6844 leader_election.cc:304] T f03d0dbf16864ca4bc1bb5e4c0334c0f P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:21:07.978886 13095 raft_consensus.cc:3060] T 427c124d773f483294511e80fe340075 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:21:07.981091  6872 raft_consensus.cc:1240] T d33d5ee8ef6f415593d8df52063161ad P cd75a17ab2604397adab03bb8b5fd75c [term 16 FOLLOWER]: Rejecting Update request from peer ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 15. Current term is 16. Ops: []
I20260709 13:21:07.984457  6727 raft_consensus.cc:1240] T a1704639a875409b9959353527b3fd68 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 19 FOLLOWER]: Rejecting Update request from peer cd75a17ab2604397adab03bb8b5fd75c for earlier term 18. Current term is 19. Ops: [18.12-18.12]
I20260709 13:21:07.983546 12998 raft_consensus.cc:2749] T be1a92657f494cac8dd227d152f50151 P b7ab4784c7344b939bc36f639286f377 [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:21:07.990728  6875 raft_consensus.cc:1240] T 711ef6523deb4cbe8ef2ba61e1c21c98 P cd75a17ab2604397adab03bb8b5fd75c [term 20 FOLLOWER]: Rejecting Update request from peer ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 19. Current term is 20. Ops: []
W20260709 13:21:07.992314  6772 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 68657.5us
I20260709 13:21:07.956823  7468 leader_election.cc:304] T bb7fa124c3bf4ef9ab65a407cb008441 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:21:07.999796  6874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de3186201e1a40d0b335eeb8b4e256e0" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
W20260709 13:21:08.005019  6770 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 85016.7us
I20260709 13:21:08.005268  6879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34f36d59d88f40fe8a2805e604fc6c0a" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:21:08.006132  6876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7887766dc6784fcaa42b35c05fea7a99" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
W20260709 13:21:07.976966 13107 consensus_meta.cc:287] T 3411566abe2d4c9bb4b2adfdd05e6f17 P cd75a17ab2604397adab03bb8b5fd75c: Time spent flushing consensus metadata: real 0.510s	user 0.020s	sys 0.004s
I20260709 13:21:08.039366  6874 raft_consensus.cc:2393] T de3186201e1a40d0b335eeb8b4e256e0 P cd75a17ab2604397adab03bb8b5fd75c [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate ccd8a4c3bfe3413cb2ae219b09aea832 in current term 18: Already voted for candidate cd75a17ab2604397adab03bb8b5fd75c in this term.
I20260709 13:21:08.024955 12863 leader_election.cc:290] T bd6869f07b5a4885a0b99fbe60c3b175 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:21:08.047924 13084 raft_consensus.cc:2749] T f03d0dbf16864ca4bc1bb5e4c0334c0f P cd75a17ab2604397adab03bb8b5fd75c [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:21:08.045068 13030 leader_election.cc:290] T 853ac0a8cbd64ce99457f170216d4d0f P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 15 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:21:08.053165  6876 raft_consensus.cc:2393] T 7887766dc6784fcaa42b35c05fea7a99 P cd75a17ab2604397adab03bb8b5fd75c [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ccd8a4c3bfe3413cb2ae219b09aea832 in current term 20: Already voted for candidate b7ab4784c7344b939bc36f639286f377 in this term.
I20260709 13:21:08.057816 12998 consensus_queue.cc:1059] T 3d65025eea89441290d85dd053810e31 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: INVALID_TERM, Last received: 18.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:21:08.059185 12998 raft_consensus.cc:3055] T 3d65025eea89441290d85dd053810e31 P b7ab4784c7344b939bc36f639286f377 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:21:08.059701 12998 raft_consensus.cc:740] T 3d65025eea89441290d85dd053810e31 P b7ab4784c7344b939bc36f639286f377 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
I20260709 13:21:08.057657 12965 consensus_queue.cc:1048] T 7a734b5ab7834e05a8c422208acc58b1 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:21:08.074934 13101 consensus_queue.cc:1048] T 7a734b5ab7834e05a8c422208acc58b1 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
W20260709 13:21:08.076478  7468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 146670us
I20260709 13:21:07.999836 13123 raft_consensus.cc:515] T 95a75bfe094d4bdc963aba3f08dfcd25 P cd75a17ab2604397adab03bb8b5fd75c [term 16 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } attrs { replace: true } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:21:08.026655 13107 raft_consensus.cc:515] T 3411566abe2d4c9bb4b2adfdd05e6f17 P cd75a17ab2604397adab03bb8b5fd75c [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:08.066289 12704 leader_election.cc:290] T 711ef6523deb4cbe8ef2ba61e1c21c98 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
W20260709 13:21:08.039269  6697 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.5.126.67:42931 timed out after 1.544s (SENT) [suppressed 9 similar messages]
I20260709 13:21:08.086126  6879 raft_consensus.cc:1240] T f03d0dbf16864ca4bc1bb5e4c0334c0f P cd75a17ab2604397adab03bb8b5fd75c [term 19 FOLLOWER]: Rejecting Update request from peer ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 18. Current term is 19. Ops: []
I20260709 13:21:08.082609  6873 raft_consensus.cc:1275] T 7c37d41cd9164c15a6826ca62a851a69 P cd75a17ab2604397adab03bb8b5fd75c [term 18 FOLLOWER]: Refusing update from remote peer ccd8a4c3bfe3413cb2ae219b09aea832: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 13:21:08.090832  6881 raft_consensus.cc:2468] T 427c124d773f483294511e80fe340075 P cd75a17ab2604397adab03bb8b5fd75c [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 17.
I20260709 13:21:08.096467  6800 raft_consensus.cc:2468] T 9b3759de40694069b13c0f8bd40e5709 P b7ab4784c7344b939bc36f639286f377 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 16.
I20260709 13:21:08.105100  6880 raft_consensus.cc:2468] T 9b3759de40694069b13c0f8bd40e5709 P cd75a17ab2604397adab03bb8b5fd75c [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 16.
I20260709 13:21:08.081780  6878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "853ac0a8cbd64ce99457f170216d4d0f" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
W20260709 13:21:08.108206  6695 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:21:08.085299  6872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "713b5728a197487c9300b310ab94e5a3" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:21:08.110702  6872 raft_consensus.cc:3060] T 713b5728a197487c9300b310ab94e5a3 P cd75a17ab2604397adab03bb8b5fd75c [term 14 FOLLOWER]: Advancing to term 16
I20260709 13:21:08.079988 13123 leader_election.cc:290] T 95a75bfe094d4bdc963aba3f08dfcd25 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 16 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:21:08.081979 13107 leader_election.cc:290] T 3411566abe2d4c9bb4b2adfdd05e6f17 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 17 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:21:08.122243  6876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe20b4b48823486ca3b9c648db6ce8aa" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:21:08.124454  7500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a75bfe094d4bdc963aba3f08dfcd25" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb"
I20260709 13:21:08.125485  6873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d9def8b32fd443aa94ab1420b06837b" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:21:08.129827  6875 raft_consensus.cc:1240] T 2c240553ce044eedb41541d72b9475d7 P cd75a17ab2604397adab03bb8b5fd75c [term 18 FOLLOWER]: Rejecting Update request from peer b7ab4784c7344b939bc36f639286f377 for earlier term 17. Current term is 18. Ops: []
I20260709 13:21:08.133602  7500 raft_consensus.cc:3060] T 95a75bfe094d4bdc963aba3f08dfcd25 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 14 LEARNER]: Advancing to term 16
I20260709 13:21:08.144912  7502 raft_consensus.cc:1275] T d8cee0accdb8499c86d4414b72565a38 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 19 FOLLOWER]: Refusing update from remote peer b7ab4784c7344b939bc36f639286f377: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 13:21:08.148151 12730 raft_consensus.cc:493] T 427c124d773f483294511e80fe340075 P b7ab4784c7344b939bc36f639286f377 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 7ba59cc884714e8aa5f3f0ecaed84cbb)
I20260709 13:21:08.149181 12730 raft_consensus.cc:515] T 427c124d773f483294511e80fe340075 P b7ab4784c7344b939bc36f639286f377 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } attrs { replace: true } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
W20260709 13:21:08.155427  6629 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:51654 (request call id 85) took 19149 ms (client timeout 15000 ms). Trace:
I20260709 13:21:08.157254  6878 raft_consensus.cc:1275] T b56bf91d90824c959e21e0cee5ba1816 P cd75a17ab2604397adab03bb8b5fd75c [term 18 FOLLOWER]: Refusing update from remote peer b7ab4784c7344b939bc36f639286f377: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
W20260709 13:21:08.155998  6629 rpcz_store.cc:269] 0709 13:20:49.051569 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:49.051740 (+   171us) service_pool.cc:224] Handling call
0709 13:21:08.155049 (+19103309us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:21:06.510906 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:21:06.511801 (+   895us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:21:06.511867 (+    66us) write_op.cc:435] Acquired schema lock
0709 13:21:06.511887 (+    20us) tablet.cc:662] Decoding operations
0709 13:21:06.513265 (+  1378us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:21:06.513385 (+   120us) write_op.cc:641] Partition lock acquired for write op
0709 13:21:06.513442 (+    57us) tablet.cc:685] Acquiring locks for 12 operations
0709 13:21:06.515070 (+  1628us) tablet.cc:701] Row locks acquired
0709 13:21:06.515140 (+    70us) write_op.cc:260] PREPARE: finished
0709 13:21:06.515381 (+   241us) write_op.cc:270] Start()
0709 13:21:06.515592 (+   211us) write_op.cc:276] Timestamp: P: 1783603266515289 usec, L: 0
0709 13:21:06.515623 (+    31us) op_driver.cc:348] REPLICATION: starting
0709 13:21:06.643855 (+128232us) log.cc:844] Serialized 5085 byte log entry
0709 13:21:07.356802 (+712947us) op_driver.cc:464] REPLICATION: finished
0709 13:21:07.455976 (+ 99174us) write_op.cc:301] APPLY: starting
0709 13:21:07.456093 (+   117us) tablet.cc:1367] starting BulkCheckPresence
0709 13:21:07.578825 (+122732us) tablet.cc:1370] finished BulkCheckPresence
0709 13:21:07.578957 (+   132us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:21:07.689897 (+110940us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:21:07.690471 (+   574us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=24,key_file_lookups=24,delta_file_lookups=24,mrs_lookups=0
0709 13:21:07.690561 (+    90us) write_op.cc:312] APPLY: finished
0709 13:21:07.691395 (+   834us) log.cc:844] Serialized 112 byte log entry
0709 13:21:07.691848 (+   453us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:21:07.692538 (+   690us) write_op.cc:454] Released schema lock
0709 13:21:07.692650 (+   112us) write_op.cc:341] FINISH: Updating metrics
0709 13:21:07.708135 (+ 15485us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:21:07.708214 (+    79us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":2147641,"reported_tablets":17,"child_traces":[["op",{"apply.queue_time_us":97388,"apply.run_cpu_time_us":24935,"apply.run_wall_time_us":238821,"cfile_cache_hit":50,"cfile_cache_hit_bytes":54239,"num_ops":12,"prepare.queue_time_us":326416,"prepare.run_cpu_time_us":46752,"prepare.run_wall_time_us":433909,"raft.queue_time_us":201959,"raft.run_cpu_time_us":10569,"raft.run_wall_time_us":110938,"replication_time_us":819347,"thread_start_us":583913,"threads_started":4,"wal-append.queue_time_us":386338}]]}
W20260709 13:21:08.160516  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 148447us
I20260709 13:21:08.161561  7500 raft_consensus.cc:2468] T 95a75bfe094d4bdc963aba3f08dfcd25 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 16 LEARNER]: Leader election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 16.
I20260709 13:21:08.161733  6844 leader_election.cc:304] T 4d9def8b32fd443aa94ab1420b06837b P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:21:08.165674  6879 raft_consensus.cc:1275] T bb3d8792045a4583ae2e965b1350a5b4 P cd75a17ab2604397adab03bb8b5fd75c [term 17 FOLLOWER]: Refusing update from remote peer ccd8a4c3bfe3413cb2ae219b09aea832: Log matching property violated. Preceding OpId in replica: term: 16 index: 14. Preceding OpId from leader: term: 17 index: 15. (index mismatch)
I20260709 13:21:08.163712  6844 leader_election.cc:304] T a3022224cc81473690653a83d4e99470 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:21:08.160660  6880 raft_consensus.cc:1275] T 4f00a2e87e56452083b759f60d461ee3 P cd75a17ab2604397adab03bb8b5fd75c [term 20 FOLLOWER]: Refusing update from remote peer b7ab4784c7344b939bc36f639286f377: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 20 index: 14. (index mismatch)
I20260709 13:21:08.159341  6878 raft_consensus.cc:1275] T d8cee0accdb8499c86d4414b72565a38 P cd75a17ab2604397adab03bb8b5fd75c [term 19 FOLLOWER]: Refusing update from remote peer b7ab4784c7344b939bc36f639286f377: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 13:21:08.083053 13176 raft_consensus.cc:2749] T bb7fa124c3bf4ef9ab65a407cb008441 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:21:08.174943  6874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab432e62819d499eaaf3dd55481dd930" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:21:08.177949  6873 raft_consensus.cc:3060] T 4d9def8b32fd443aa94ab1420b06837b P cd75a17ab2604397adab03bb8b5fd75c [term 17 FOLLOWER]: Advancing to term 19
I20260709 13:21:08.185110  6875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c44c4849aa54f2b94d1f1bef9ed546f" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:21:08.194540  6878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "427c124d773f483294511e80fe340075" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:21:08.198719 12594 consensus_queue.cc:1059] T d33d5ee8ef6f415593d8df52063161ad P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: INVALID_TERM, Last received: 14.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:21:08.199945 12863 raft_consensus.cc:3055] T d33d5ee8ef6f415593d8df52063161ad P ccd8a4c3bfe3413cb2ae219b09aea832 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:21:08.200423 12863 raft_consensus.cc:740] T d33d5ee8ef6f415593d8df52063161ad P ccd8a4c3bfe3413cb2ae219b09aea832 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
I20260709 13:21:08.201476 12863 consensus_queue.cc:260] T d33d5ee8ef6f415593d8df52063161ad P ccd8a4c3bfe3413cb2ae219b09aea832 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:08.082370 12998 consensus_queue.cc:260] T 3d65025eea89441290d85dd053810e31 P b7ab4784c7344b939bc36f639286f377 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.10, Last appended by leader: 10, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
W20260709 13:21:08.208636  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 45148.3us
I20260709 13:21:08.208842  6878 raft_consensus.cc:2393] T 427c124d773f483294511e80fe340075 P cd75a17ab2604397adab03bb8b5fd75c [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7ab4784c7344b939bc36f639286f377 in current term 17: Already voted for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in this term.
I20260709 13:21:08.208546  6695 leader_election.cc:304] T 17587d6730594da4a56fa13a353232a1 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, b7ab4784c7344b939bc36f639286f377
W20260709 13:21:08.219347  6697 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 180107us
I20260709 13:21:08.208096 13030 raft_consensus.cc:2804] T a3022224cc81473690653a83d4e99470 P cd75a17ab2604397adab03bb8b5fd75c [term 19 FOLLOWER]: Leader pre-election won for term 20
W20260709 13:21:08.223951  6846 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:21:08.224920  6770 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 104964us
I20260709 13:21:08.204406 13122 raft_consensus.cc:493] T 4275cf08e63345f993bce8664eada830 P b7ab4784c7344b939bc36f639286f377 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:21:08.239619 13022 consensus_meta.cc:287] T bd6869f07b5a4885a0b99fbe60c3b175 P cd75a17ab2604397adab03bb8b5fd75c: Time spent flushing consensus metadata: real 0.598s	user 0.007s	sys 0.017s
I20260709 13:21:08.240124  6723 raft_consensus.cc:1240] T 404190ce4ce94cecbfcb6ea9d1dd8626 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 16 FOLLOWER]: Rejecting Update request from peer 7ba59cc884714e8aa5f3f0ecaed84cbb for earlier term 15. Current term is 16. Ops: []
W20260709 13:21:08.242801  7468 leader_election.cc:336] T 4b8cacb381b746da8d0049b0a83b41dd P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931): Timed out: RequestConsensusVote RPC to 127.5.126.67:42931 timed out after 1.640s (SENT)
I20260709 13:21:08.243403  7468 leader_election.cc:304] T 4b8cacb381b746da8d0049b0a83b41dd P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:21:08.245020 13176 raft_consensus.cc:2749] T 4b8cacb381b746da8d0049b0a83b41dd P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:21:08.251543  7503 raft_consensus.cc:2468] T 404190ce4ce94cecbfcb6ea9d1dd8626 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 16.
I20260709 13:21:08.252293 13022 raft_consensus.cc:2749] T bd6869f07b5a4885a0b99fbe60c3b175 P cd75a17ab2604397adab03bb8b5fd75c [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:21:08.230635 13030 raft_consensus.cc:493] T a3022224cc81473690653a83d4e99470 P cd75a17ab2604397adab03bb8b5fd75c [term 19 FOLLOWER]: Starting leader election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:21:08.255930 12863 raft_consensus.cc:3060] T d33d5ee8ef6f415593d8df52063161ad P ccd8a4c3bfe3413cb2ae219b09aea832 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:21:08.256493 13030 raft_consensus.cc:3060] T a3022224cc81473690653a83d4e99470 P cd75a17ab2604397adab03bb8b5fd75c [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:21:08.260839  6803 raft_consensus.cc:1275] T 1528ab62b6fe4e3099d08f141afee116 P b7ab4784c7344b939bc36f639286f377 [term 16 FOLLOWER]: Refusing update from remote peer 7ba59cc884714e8aa5f3f0ecaed84cbb: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:21:08.262478  6727 raft_consensus.cc:1275] T 1528ab62b6fe4e3099d08f141afee116 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 16 FOLLOWER]: Refusing update from remote peer 7ba59cc884714e8aa5f3f0ecaed84cbb: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:21:08.262619 12594 raft_consensus.cc:2749] T 17587d6730594da4a56fa13a353232a1 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:21:08.214021 12730 leader_election.cc:290] T 427c124d773f483294511e80fe340075 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:21:08.188791 12905 raft_consensus.cc:515] T 3fa34c08b205435dba97346991aa1f92 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
W20260709 13:21:08.272241  7469 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:21:08.274685  7468 leader_election.cc:336] T 4f00a2e87e56452083b759f60d461ee3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931): Timed out: RequestConsensusVote RPC to 127.5.126.67:42931 timed out after 1.841s (SENT)
I20260709 13:21:08.275394  7468 leader_election.cc:304] T 4f00a2e87e56452083b759f60d461ee3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:21:08.279472  6873 raft_consensus.cc:2468] T 4d9def8b32fd443aa94ab1420b06837b P cd75a17ab2604397adab03bb8b5fd75c [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 19.
I20260709 13:21:08.286880 12998 raft_consensus.cc:3060] T 3d65025eea89441290d85dd053810e31 P b7ab4784c7344b939bc36f639286f377 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:21:08.291841  7500 raft_consensus.cc:1275] T bb3d8792045a4583ae2e965b1350a5b4 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 17 FOLLOWER]: Refusing update from remote peer ccd8a4c3bfe3413cb2ae219b09aea832: Log matching property violated. Preceding OpId in replica: term: 16 index: 14. Preceding OpId from leader: term: 17 index: 15. (index mismatch)
I20260709 13:21:08.280347 13132 raft_consensus.cc:2764] T 4d9def8b32fd443aa94ab1420b06837b P cd75a17ab2604397adab03bb8b5fd75c [term 19 FOLLOWER]: Leader pre-election decision vote started in defunct term 17: won
W20260709 13:21:08.294505  7503 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50742 (request call id 582) took 1640 ms (client timeout 2007 ms). Trace:
W20260709 13:21:08.295141  7503 rpcz_store.cc:269] 0709 13:21:06.654197 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:21:06.655200 (+  1003us) service_pool.cc:224] Handling call
0709 13:21:08.294143 (+1638943us) spinlock_profiling.cc:243] Waited 1.47 s on lock 0x7b5400570154. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f9ae2fa 00007fcc1496fb17 00007fcc0deea6d4 00007fcc0deea662 00007fcc0deea591 00007fcc0deea50c 00007fcc0dee97c2 00007fcc0dce548c 00007fcc0dce48c6 00007fcc0dce426f
0709 13:21:08.294385 (+   242us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3387974400}
I20260709 13:21:08.299059 13122 raft_consensus.cc:515] T 4275cf08e63345f993bce8664eada830 P b7ab4784c7344b939bc36f639286f377 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:08.301419 13122 leader_election.cc:290] T 4275cf08e63345f993bce8664eada830 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:21:08.309190 12945 raft_consensus.cc:515] T 17587d6730594da4a56fa13a353232a1 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 24 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:21:08.311621 12945 leader_election.cc:290] T 17587d6730594da4a56fa13a353232a1 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 24 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:21:08.316488  6873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6869f07b5a4885a0b99fbe60c3b175" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 20 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:21:08.317358  6873 raft_consensus.cc:2468] T bd6869f07b5a4885a0b99fbe60c3b175 P cd75a17ab2604397adab03bb8b5fd75c [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 19.
I20260709 13:21:08.322547 13176 raft_consensus.cc:2749] T 4f00a2e87e56452083b759f60d461ee3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 20 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:21:08.323416  6726 raft_consensus.cc:1240] T 3fa34c08b205435dba97346991aa1f92 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 22 FOLLOWER]: Rejecting Update request from peer 7ba59cc884714e8aa5f3f0ecaed84cbb for earlier term 21. Current term is 22. Ops: []
I20260709 13:21:08.325680  6873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "711ef6523deb4cbe8ef2ba61e1c21c98" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:21:08.325836  6872 raft_consensus.cc:2468] T 713b5728a197487c9300b310ab94e5a3 P cd75a17ab2604397adab03bb8b5fd75c [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 16.
I20260709 13:21:08.319329  6772 leader_election.cc:304] T 713b5728a197487c9300b310ab94e5a3 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:21:08.336692  6873 raft_consensus.cc:2468] T 711ef6523deb4cbe8ef2ba61e1c21c98 P cd75a17ab2604397adab03bb8b5fd75c [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 20.
W20260709 13:21:08.349836  6772 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 73548us
W20260709 13:21:08.357040  6770 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 83729us
I20260709 13:21:08.356304  6727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17587d6730594da4a56fa13a353232a1" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
W20260709 13:21:08.363801  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 128770us
I20260709 13:21:08.365922  6803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17587d6730594da4a56fa13a353232a1" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:21:08.364948  7495 raft_consensus.cc:2468] T 427c124d773f483294511e80fe340075 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 17.
I20260709 13:21:08.370217  6727 raft_consensus.cc:3060] T 17587d6730594da4a56fa13a353232a1 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 23 FOLLOWER]: Advancing to term 24
W20260709 13:21:08.377169  7469 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:21:08.382623  7468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 107981us
W20260709 13:21:08.384075 13026 consensus_meta.cc:287] T 95a75bfe094d4bdc963aba3f08dfcd25 P b7ab4784c7344b939bc36f639286f377: Time spent flushing consensus metadata: real 0.825s	user 0.013s	sys 0.010s
I20260709 13:21:08.384763 13026 raft_consensus.cc:515] T 95a75bfe094d4bdc963aba3f08dfcd25 P b7ab4784c7344b939bc36f639286f377 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } attrs { replace: true } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: NON_VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: true } }
I20260709 13:21:08.395319  6844 leader_election.cc:304] T e31b9971c15848dea59d4d4130141d9e P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:21:08.387276 12897 raft_consensus.cc:2804] T 713b5728a197487c9300b310ab94e5a3 P b7ab4784c7344b939bc36f639286f377 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:21:08.402333  6697 leader_election.cc:304] T be1a92657f494cac8dd227d152f50151 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: b7ab4784c7344b939bc36f639286f377
W20260709 13:21:08.405292  6695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 196967us
I20260709 13:21:08.404013 12897 raft_consensus.cc:493] T 713b5728a197487c9300b310ab94e5a3 P b7ab4784c7344b939bc36f639286f377 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:08.407480 13132 raft_consensus.cc:2804] T e31b9971c15848dea59d4d4130141d9e P cd75a17ab2604397adab03bb8b5fd75c [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:21:08.406325  6770 leader_election.cc:304] T 30e88460611e47b2ba16a46a30b5f416 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:21:08.386511 12945 consensus_queue.cc:1048] T 1528ab62b6fe4e3099d08f141afee116 P 7ba59cc884714e8aa5f3f0ecaed84cbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.017s
I20260709 13:21:08.407522 12897 raft_consensus.cc:3060] T 713b5728a197487c9300b310ab94e5a3 P b7ab4784c7344b939bc36f639286f377 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:21:08.407279 13050 raft_consensus.cc:493] T 90d42e216d9741e190bca19a781291fd P ccd8a4c3bfe3413cb2ae219b09aea832 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:21:08.417968 13118 consensus_queue.cc:1048] T b56bf91d90824c959e21e0cee5ba1816 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.024s
I20260709 13:21:08.423840 13030 raft_consensus.cc:515] T a3022224cc81473690653a83d4e99470 P cd75a17ab2604397adab03bb8b5fd75c [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:08.424597 12905 leader_election.cc:290] T 3fa34c08b205435dba97346991aa1f92 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 22 election: Requested vote from peers cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:21:08.425546  6872 raft_consensus.cc:1240] T a3022224cc81473690653a83d4e99470 P cd75a17ab2604397adab03bb8b5fd75c [term 20 FOLLOWER]: Rejecting Update request from peer ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 19. Current term is 20. Ops: []
I20260709 13:21:08.417049 13095 consensus_queue.cc:1059] T 3fa34c08b205435dba97346991aa1f92 P 7ba59cc884714e8aa5f3f0ecaed84cbb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: INVALID_TERM, Last received: 21.16, Next index: 17, Last known committed idx: 16, Time since last communication: 0.008s
I20260709 13:21:08.408245 13132 raft_consensus.cc:493] T e31b9971c15848dea59d4d4130141d9e P cd75a17ab2604397adab03bb8b5fd75c [term 15 FOLLOWER]: Starting leader election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:21:08.435293  6727 raft_consensus.cc:2468] T 17587d6730594da4a56fa13a353232a1 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in term 24.
I20260709 13:21:08.437495 13030 leader_election.cc:290] T a3022224cc81473690653a83d4e99470 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 20 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:21:08.444527 13122 raft_consensus.cc:3060] T 30e88460611e47b2ba16a46a30b5f416 P b7ab4784c7344b939bc36f639286f377 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:21:08.444295 12566 consensus_queue.cc:1048] T d8cee0accdb8499c86d4414b72565a38 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.032s
I20260709 13:21:08.405946 13027 consensus_queue.cc:1059] T 2c240553ce044eedb41541d72b9475d7 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: INVALID_TERM, Last received: 17.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.055s
I20260709 13:21:08.443569  6695 leader_election.cc:304] T 44bde925b2e541b69890d70715b85176 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
I20260709 13:21:08.453454 13176 raft_consensus.cc:3055] T 3fa34c08b205435dba97346991aa1f92 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:21:08.425499 12898 consensus_queue.cc:1048] T 4f00a2e87e56452083b759f60d461ee3 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.039s
I20260709 13:21:08.449440  6772 leader_election.cc:304] T 4d9def8b32fd443aa94ab1420b06837b P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:21:08.441481 13132 raft_consensus.cc:3060] T e31b9971c15848dea59d4d4130141d9e P cd75a17ab2604397adab03bb8b5fd75c [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:21:08.453949 13176 raft_consensus.cc:740] T 3fa34c08b205435dba97346991aa1f92 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 7ba59cc884714e8aa5f3f0ecaed84cbb, State: Running, Role: LEADER
W20260709 13:21:08.455721  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 76800.6us
W20260709 13:21:08.458655  6770 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 59289.4us
I20260709 13:21:08.445684 13050 raft_consensus.cc:515] T 90d42e216d9741e190bca19a781291fd P ccd8a4c3bfe3413cb2ae219b09aea832 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:08.460002 12965 raft_consensus.cc:3055] T 2c240553ce044eedb41541d72b9475d7 P b7ab4784c7344b939bc36f639286f377 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:21:08.471328 12965 raft_consensus.cc:740] T 2c240553ce044eedb41541d72b9475d7 P b7ab4784c7344b939bc36f639286f377 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
I20260709 13:21:08.471666  6844 leader_election.cc:304] T d33d5ee8ef6f415593d8df52063161ad P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:21:08.472368 13026 leader_election.cc:290] T 95a75bfe094d4bdc963aba3f08dfcd25 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 16 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:21:08.472517 12965 consensus_queue.cc:260] T 2c240553ce044eedb41541d72b9475d7 P b7ab4784c7344b939bc36f639286f377 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:08.470598  6803 raft_consensus.cc:1275] T 7ba5dac66ab5497e9e336f2a3c28cda5 P b7ab4784c7344b939bc36f639286f377 [term 19 FOLLOWER]: Refusing update from remote peer 7ba59cc884714e8aa5f3f0ecaed84cbb: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 13:21:08.470775 13050 leader_election.cc:290] T 90d42e216d9741e190bca19a781291fd P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:21:08.461890 12970 consensus_queue.cc:1048] T 1528ab62b6fe4e3099d08f141afee116 P 7ba59cc884714e8aa5f3f0ecaed84cbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:21:08.457305 12898 raft_consensus.cc:493] T 7c37d41cd9164c15a6826ca62a851a69 P b7ab4784c7344b939bc36f639286f377 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:08.476070 13030 raft_consensus.cc:2749] T d33d5ee8ef6f415593d8df52063161ad P cd75a17ab2604397adab03bb8b5fd75c [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:21:08.483297 13101 consensus_queue.cc:1048] T d8cee0accdb8499c86d4414b72565a38 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
W20260709 13:21:08.484997  6697 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.68:45071, user_credentials={real_user=slave}} blocked reactor thread for 93897.1us
W20260709 13:21:08.490473  6698 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:21:08.494135  7503 raft_consensus.cc:1275] T 4f00a2e87e56452083b759f60d461ee3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 20 FOLLOWER]: Refusing update from remote peer b7ab4784c7344b939bc36f639286f377: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 20 index: 14. (index mismatch)
I20260709 13:21:08.494716  6878 raft_consensus.cc:1275] T 7887766dc6784fcaa42b35c05fea7a99 P cd75a17ab2604397adab03bb8b5fd75c [term 20 FOLLOWER]: Refusing update from remote peer b7ab4784c7344b939bc36f639286f377: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 20 index: 11. (index mismatch)
I20260709 13:21:08.499828  6874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a75bfe094d4bdc963aba3f08dfcd25" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:21:08.501425  6872 raft_consensus.cc:1240] T 20f6842e26174571996b8dea4151d4be P cd75a17ab2604397adab03bb8b5fd75c [term 19 FOLLOWER]: Rejecting Update request from peer b7ab4784c7344b939bc36f639286f377 for earlier term 18. Current term is 19. Ops: []
I20260709 13:21:08.497771  7468 leader_election.cc:304] T ce4f062dcd314d43a63ca74067cb5ee3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:21:08.502959  6879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4275cf08e63345f993bce8664eada830" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:21:08.503496  6879 raft_consensus.cc:2468] T 4275cf08e63345f993bce8664eada830 P cd75a17ab2604397adab03bb8b5fd75c [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 16.
I20260709 13:21:08.504936  6874 raft_consensus.cc:2393] T 95a75bfe094d4bdc963aba3f08dfcd25 P cd75a17ab2604397adab03bb8b5fd75c [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate b7ab4784c7344b939bc36f639286f377 in current term 16: Already voted for candidate cd75a17ab2604397adab03bb8b5fd75c in this term.
I20260709 13:21:08.508843  7495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "427c124d773f483294511e80fe340075" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:21:08.507819  6695 leader_election.cc:304] T 20f6842e26174571996b8dea4151d4be P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
I20260709 13:21:08.479811 12898 raft_consensus.cc:515] T 7c37d41cd9164c15a6826ca62a851a69 P b7ab4784c7344b939bc36f639286f377 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:08.510828 13095 raft_consensus.cc:2749] T ce4f062dcd314d43a63ca74067cb5ee3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:21:08.509577  7495 raft_consensus.cc:2468] T 427c124d773f483294511e80fe340075 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 17.
I20260709 13:21:08.486361 12863 raft_consensus.cc:2804] T 44bde925b2e541b69890d70715b85176 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:21:08.505657 12704 consensus_queue.cc:1048] T bb3d8792045a4583ae2e965b1350a5b4 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.007s
I20260709 13:21:08.514325  6770 leader_election.cc:304] T c4db81d9d329422bb3b4160ca4ac2d1d P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:21:08.505424 13026 raft_consensus.cc:2804] T 4d9def8b32fd443aa94ab1420b06837b P b7ab4784c7344b939bc36f639286f377 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:21:08.527501 12905 raft_consensus.cc:493] T 24ee15416e3145beaa1b8183453729a3 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader cd75a17ab2604397adab03bb8b5fd75c)
I20260709 13:21:08.529959 12905 raft_consensus.cc:515] T 24ee15416e3145beaa1b8183453729a3 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:21:08.527174 13188 raft_consensus.cc:2804] T be1a92657f494cac8dd227d152f50151 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:21:08.533206 12905 leader_election.cc:290] T 24ee15416e3145beaa1b8183453729a3 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:21:08.527431 13180 raft_consensus.cc:2804] T 20f6842e26174571996b8dea4151d4be P ccd8a4c3bfe3413cb2ae219b09aea832 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:21:08.535599 13180 raft_consensus.cc:493] T 20f6842e26174571996b8dea4151d4be P ccd8a4c3bfe3413cb2ae219b09aea832 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:08.535998 13180 raft_consensus.cc:3060] T 20f6842e26174571996b8dea4151d4be P ccd8a4c3bfe3413cb2ae219b09aea832 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:21:08.541198  6770 leader_election.cc:304] T 404190ce4ce94cecbfcb6ea9d1dd8626 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, ccd8a4c3bfe3413cb2ae219b09aea832
W20260709 13:21:08.536885  7468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 55787.8us
I20260709 13:21:08.536123  7466 leader_election.cc:304] T 17587d6730594da4a56fa13a353232a1 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: b7ab4784c7344b939bc36f639286f377
I20260709 13:21:08.515167 12965 raft_consensus.cc:3060] T 2c240553ce044eedb41541d72b9475d7 P b7ab4784c7344b939bc36f639286f377 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:21:08.516611 12863 raft_consensus.cc:493] T 44bde925b2e541b69890d70715b85176 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:21:08.552551  7466 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 83328.8us
I20260709 13:21:08.554801 12863 raft_consensus.cc:3060] T 44bde925b2e541b69890d70715b85176 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:21:08.552176  6697 leader_election.cc:304] T 404190ce4ce94cecbfcb6ea9d1dd8626 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: b7ab4784c7344b939bc36f639286f377
I20260709 13:21:08.555709 13095 raft_consensus.cc:2804] T 17587d6730594da4a56fa13a353232a1 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 24 FOLLOWER]: Leader election won for term 24
I20260709 13:21:08.548352 13188 raft_consensus.cc:697] T be1a92657f494cac8dd227d152f50151 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 20 LEADER]: Becoming Leader. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
I20260709 13:21:08.567803  7468 leader_election.cc:304] T bb3d8792045a4583ae2e965b1350a5b4 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, cd75a17ab2604397adab03bb8b5fd75c; no voters: ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:21:08.551822 12730 raft_consensus.cc:2749] T c4db81d9d329422bb3b4160ca4ac2d1d P b7ab4784c7344b939bc36f639286f377 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:21:08.519850  6622 catalog_manager.cc:5697] T 20f6842e26174571996b8dea4151d4be P cd75a17ab2604397adab03bb8b5fd75c reported cstate change: term changed from 3 to 15, leader changed from ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65) to b7ab4784c7344b939bc36f639286f377 (127.5.126.66). New cstate: current_term: 15 leader_uuid: "b7ab4784c7344b939bc36f639286f377" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } }
I20260709 13:21:08.516811 13176 consensus_queue.cc:260] T 3fa34c08b205435dba97346991aa1f92 P 7ba59cc884714e8aa5f3f0ecaed84cbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 21.16, Last appended by leader: 16, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:21:08.581813  6622 catalog_manager.cc:5697] T f3f9c2e2bf644115957398fe4c9459db P cd75a17ab2604397adab03bb8b5fd75c reported cstate change: term changed from 6 to 13, leader changed from b7ab4784c7344b939bc36f639286f377 (127.5.126.66) to cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67). New cstate: current_term: 13 leader_uuid: "cd75a17ab2604397adab03bb8b5fd75c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } health_report { overall_health: HEALTHY } } }
I20260709 13:21:08.559482 12970 consensus_queue.cc:1048] T 7ba5dac66ab5497e9e336f2a3c28cda5 P 7ba59cc884714e8aa5f3f0ecaed84cbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.011s
I20260709 13:21:08.563977 13026 raft_consensus.cc:697] T 4d9def8b32fd443aa94ab1420b06837b P b7ab4784c7344b939bc36f639286f377 [term 19 LEADER]: Becoming Leader. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
W20260709 13:21:08.595908  6770 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 54836.6us
I20260709 13:21:08.588128 13095 raft_consensus.cc:697] T 17587d6730594da4a56fa13a353232a1 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 24 LEADER]: Becoming Leader. State: Replica: 7ba59cc884714e8aa5f3f0ecaed84cbb, State: Running, Role: LEADER
I20260709 13:21:08.592556 12905 raft_consensus.cc:2804] T 404190ce4ce94cecbfcb6ea9d1dd8626 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:21:08.569372 13050 consensus_queue.cc:1059] T b56bf91d90824c959e21e0cee5ba1816 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: INVALID_TERM, Last received: 17.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.032s
I20260709 13:21:08.602560 13176 raft_consensus.cc:3060] T 3fa34c08b205435dba97346991aa1f92 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:21:08.606904 13076 raft_consensus.cc:3060] T 404190ce4ce94cecbfcb6ea9d1dd8626 P b7ab4784c7344b939bc36f639286f377 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:21:08.627238 13172 raft_consensus.cc:2804] T bb3d8792045a4583ae2e965b1350a5b4 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:21:08.657518 13050 raft_consensus.cc:3055] T b56bf91d90824c959e21e0cee5ba1816 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:21:08.628060  6622 catalog_manager.cc:5697] T b56bf91d90824c959e21e0cee5ba1816 P cd75a17ab2604397adab03bb8b5fd75c reported cstate change: term changed from 8 to 12, leader changed from ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65) to cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67). New cstate: current_term: 12 leader_uuid: "cd75a17ab2604397adab03bb8b5fd75c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } health_report { overall_health: HEALTHY } } }
I20260709 13:21:08.637415  6770 leader_election.cc:304] T de3186201e1a40d0b335eeb8b4e256e0 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
W20260709 13:21:08.638358  7468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 81612.8us
I20260709 13:21:08.638903 13132 raft_consensus.cc:515] T e31b9971c15848dea59d4d4130141d9e P cd75a17ab2604397adab03bb8b5fd75c [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
W20260709 13:21:08.640578  6697 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.68:45071, user_credentials={real_user=slave}} blocked reactor thread for 124924us
I20260709 13:21:08.648904 12998 consensus_queue.cc:1048] T 4f00a2e87e56452083b759f60d461ee3 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:21:08.649514 12897 raft_consensus.cc:515] T 713b5728a197487c9300b310ab94e5a3 P b7ab4784c7344b939bc36f639286f377 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:08.628119 13026 consensus_queue.cc:237] T 4d9def8b32fd443aa94ab1420b06837b P b7ab4784c7344b939bc36f639286f377 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 17.9, Last appended by leader: 9, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
W20260709 13:21:08.690995  6846 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:21:08.667233 13172 raft_consensus.cc:493] T bb3d8792045a4583ae2e965b1350a5b4 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:21:08.699554  7466 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:21:08.667573 13050 raft_consensus.cc:740] T b56bf91d90824c959e21e0cee5ba1816 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
I20260709 13:21:08.646543 13027 raft_consensus.cc:2955] T 7a734b5ab7834e05a8c422208acc58b1 P b7ab4784c7344b939bc36f639286f377 [term 19 LEADER]: Committing config change with OpId 17.9: config changed from index 6 to 9, 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } attrs { replace: true } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } } }
I20260709 13:21:08.673107 12905 raft_consensus.cc:697] T 404190ce4ce94cecbfcb6ea9d1dd8626 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 16 LEADER]: Becoming Leader. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
W20260709 13:21:08.713683  6695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 118419us
W20260709 13:21:08.697117 13187 log.cc:927] Time spent T bb7fa124c3bf4ef9ab65a407cb008441 P 7ba59cc884714e8aa5f3f0ecaed84cbb: Append to log took a long time: real 0.131s	user 0.000s	sys 0.001s
I20260709 13:21:08.700174 12898 leader_election.cc:290] T 7c37d41cd9164c15a6826ca62a851a69 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:21:08.668713  7495 raft_consensus.cc:2955] T 7a734b5ab7834e05a8c422208acc58b1 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 19 FOLLOWER]: Committing config change with OpId 17.9: config changed from index 6 to 9, 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } attrs { replace: true } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } } }
I20260709 13:21:08.725431  7468 leader_election.cc:304] T 7a734b5ab7834e05a8c422208acc58b1 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:21:08.701597 13172 raft_consensus.cc:3060] T bb3d8792045a4583ae2e965b1350a5b4 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:21:08.673420 13095 consensus_queue.cc:237] T 17587d6730594da4a56fa13a353232a1 P 7ba59cc884714e8aa5f3f0ecaed84cbb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 23.16, Last appended by leader: 16, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
W20260709 13:21:08.737164  6770 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 99930.5us
I20260709 13:21:08.743851  6695 leader_election.cc:304] T 427c124d773f483294511e80fe340075 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, b7ab4784c7344b939bc36f639286f377
I20260709 13:21:08.745042 12594 raft_consensus.cc:2749] T 427c124d773f483294511e80fe340075 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:21:08.750655 12863 raft_consensus.cc:515] T 44bde925b2e541b69890d70715b85176 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:08.753760 12863 leader_election.cc:290] T 44bde925b2e541b69890d70715b85176 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 19 election: Requested vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:21:08.734571  6622 catalog_manager.cc:5697] T 4d9def8b32fd443aa94ab1420b06837b P cd75a17ab2604397adab03bb8b5fd75c reported cstate change: term changed from 7 to 13, leader changed from b7ab4784c7344b939bc36f639286f377 (127.5.126.66) to cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67). New cstate: current_term: 13 leader_uuid: "cd75a17ab2604397adab03bb8b5fd75c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } health_report { overall_health: HEALTHY } } }
W20260709 13:21:08.771000  6772 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 144255us
I20260709 13:21:08.772076  6772 leader_election.cc:304] T 4275cf08e63345f993bce8664eada830 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:21:08.780522 13104 raft_consensus.cc:2749] T de3186201e1a40d0b335eeb8b4e256e0 P b7ab4784c7344b939bc36f639286f377 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:21:08.781004 13030 raft_consensus.cc:493] T 7887766dc6784fcaa42b35c05fea7a99 P cd75a17ab2604397adab03bb8b5fd75c [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:08.781699 13030 raft_consensus.cc:515] T 7887766dc6784fcaa42b35c05fea7a99 P cd75a17ab2604397adab03bb8b5fd75c [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:08.710016 13188 consensus_queue.cc:237] T be1a92657f494cac8dd227d152f50151 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 19.14, Last appended by leader: 14, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:21:08.782459 12704 consensus_queue.cc:1059] T f5be3a11b23d4ea9b08300a2789821c7 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: INVALID_TERM, Last received: 17.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.005s
I20260709 13:21:08.788560 12704 raft_consensus.cc:3055] T f5be3a11b23d4ea9b08300a2789821c7 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:21:08.789111 12704 raft_consensus.cc:740] T f5be3a11b23d4ea9b08300a2789821c7 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
I20260709 13:21:08.790045 12704 consensus_queue.cc:260] T f5be3a11b23d4ea9b08300a2789821c7 P ccd8a4c3bfe3413cb2ae219b09aea832 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:08.791385 12704 raft_consensus.cc:3060] T f5be3a11b23d4ea9b08300a2789821c7 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:21:08.740902 13180 raft_consensus.cc:515] T 20f6842e26174571996b8dea4151d4be P ccd8a4c3bfe3413cb2ae219b09aea832 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
W20260709 13:21:08.813206  7469 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:21:08.813010  7468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 124485us
I20260709 13:21:08.815357 12863 consensus_queue.cc:1048] T 7c37d41cd9164c15a6826ca62a851a69 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.001s
W20260709 13:21:08.816958  6697 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.68:45071, user_credentials={real_user=slave}} blocked reactor thread for 122677us
I20260709 13:21:08.829185  6878 raft_consensus.cc:1275] T f5be3a11b23d4ea9b08300a2789821c7 P cd75a17ab2604397adab03bb8b5fd75c [term 18 FOLLOWER]: Refusing update from remote peer b7ab4784c7344b939bc36f639286f377: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 13:21:08.833196 13198 consensus_queue.cc:1048] T 7887766dc6784fcaa42b35c05fea7a99 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.016s
I20260709 13:21:08.818588  6622 catalog_manager.cc:5697] T 3d65025eea89441290d85dd053810e31 P cd75a17ab2604397adab03bb8b5fd75c reported cstate change: term changed from 9 to 13, leader changed from b7ab4784c7344b939bc36f639286f377 (127.5.126.66) to cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67). New cstate: current_term: 13 leader_uuid: "cd75a17ab2604397adab03bb8b5fd75c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } health_report { overall_health: HEALTHY } } }
I20260709 13:21:08.833966  6805 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4275cf08e63345f993bce8664eada830"
dest_uuid: "b7ab4784c7344b939bc36f639286f377"
mode: GRACEFUL
new_leader_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
 from {username='slave'} at 127.0.0.1:38240
I20260709 13:21:08.794405 12998 raft_consensus.cc:2804] T 4275cf08e63345f993bce8664eada830 P b7ab4784c7344b939bc36f639286f377 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:21:08.835758  6878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c37d41cd9164c15a6826ca62a851a69" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 19 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:21:08.838702  6878 raft_consensus.cc:2468] T 7c37d41cd9164c15a6826ca62a851a69 P cd75a17ab2604397adab03bb8b5fd75c [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 18.
I20260709 13:21:08.769376 13050 consensus_queue.cc:260] T b56bf91d90824c959e21e0cee5ba1816 P ccd8a4c3bfe3413cb2ae219b09aea832 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:08.837826  6695 leader_election.cc:304] T 9b3759de40694069b13c0f8bd40e5709 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
I20260709 13:21:08.845026  6875 raft_consensus.cc:1275] T a1704639a875409b9959353527b3fd68 P cd75a17ab2604397adab03bb8b5fd75c [term 19 FOLLOWER]: Refusing update from remote peer b7ab4784c7344b939bc36f639286f377: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 19 index: 12. (term mismatch)
I20260709 13:21:08.847287  6875 pending_rounds.cc:85] T a1704639a875409b9959353527b3fd68 P cd75a17ab2604397adab03bb8b5fd75c: Aborting all ops after (but not including) 11
I20260709 13:21:08.841692 12998 raft_consensus.cc:493] T 4275cf08e63345f993bce8664eada830 P b7ab4784c7344b939bc36f639286f377 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:08.847640  6875 pending_rounds.cc:107] T a1704639a875409b9959353527b3fd68 P cd75a17ab2604397adab03bb8b5fd75c: Aborting uncommitted NO_OP operation due to leader change: 18.12
I20260709 13:21:08.857191  6875 raft_consensus.cc:2889] T a1704639a875409b9959353527b3fd68 P cd75a17ab2604397adab03bb8b5fd75c [term 19 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:21:08.835992 13104 consensus_queue.cc:1059] T 20f6842e26174571996b8dea4151d4be P b7ab4784c7344b939bc36f639286f377 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.025s
I20260709 13:21:08.848968  6874 raft_consensus.cc:2955] T 7a734b5ab7834e05a8c422208acc58b1 P cd75a17ab2604397adab03bb8b5fd75c [term 19 FOLLOWER]: Committing config change with OpId 17.9: config changed from index 6 to 9, 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } attrs { replace: true } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } } }
I20260709 13:21:08.853988 13132 leader_election.cc:290] T e31b9971c15848dea59d4d4130141d9e P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 16 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:21:08.878304  6879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "713b5728a197487c9300b310ab94e5a3" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
W20260709 13:21:08.873409  6770 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 95050.7us
I20260709 13:21:08.855643 12897 leader_election.cc:290] T 713b5728a197487c9300b310ab94e5a3 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 16 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:21:08.859050 12998 raft_consensus.cc:3060] T 4275cf08e63345f993bce8664eada830 P b7ab4784c7344b939bc36f639286f377 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:21:08.880224  6697 leader_election.cc:304] T 22ccee1b570c4ad3a57bd7aec085b1b4 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:21:08.883915  6879 raft_consensus.cc:2393] T 713b5728a197487c9300b310ab94e5a3 P cd75a17ab2604397adab03bb8b5fd75c [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate b7ab4784c7344b939bc36f639286f377 in current term 16: Already voted for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in this term.
I20260709 13:21:08.879478  6803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "713b5728a197487c9300b310ab94e5a3" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:21:08.884588  6803 raft_consensus.cc:2393] T 713b5728a197487c9300b310ab94e5a3 P b7ab4784c7344b939bc36f639286f377 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate ccd8a4c3bfe3413cb2ae219b09aea832 in current term 16: Already voted for candidate b7ab4784c7344b939bc36f639286f377 in this term.
I20260709 13:21:08.884479  6800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "853ac0a8cbd64ce99457f170216d4d0f" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:21:08.893128  6799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6869f07b5a4885a0b99fbe60c3b175" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 20 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:21:08.866351 13118 raft_consensus.cc:493] T 8c7f33e544204fbaac4078e3e83bbf4e P b7ab4784c7344b939bc36f639286f377 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:08.906345  6877 raft_consensus.cc:1275] T f03d0dbf16864ca4bc1bb5e4c0334c0f P cd75a17ab2604397adab03bb8b5fd75c [term 19 FOLLOWER]: Refusing update from remote peer b7ab4784c7344b939bc36f639286f377: Log matching property violated. Preceding OpId in replica: term: 18 index: 9. Preceding OpId from leader: term: 19 index: 10. (index mismatch)
I20260709 13:21:08.909083  6770 leader_election.cc:304] T 44bde925b2e541b69890d70715b85176 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
W20260709 13:21:08.909777  6773 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:21:08.839203 12905 consensus_queue.cc:237] T 404190ce4ce94cecbfcb6ea9d1dd8626 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:21:08.921069  6801 raft_consensus.cc:1240] T ab432e62819d499eaaf3dd55481dd930 P b7ab4784c7344b939bc36f639286f377 [term 21 FOLLOWER]: Rejecting Update request from peer ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 20. Current term is 21. Ops: []
I20260709 13:21:08.883082 13050 raft_consensus.cc:3060] T b56bf91d90824c959e21e0cee5ba1816 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:21:08.907053  6807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "711ef6523deb4cbe8ef2ba61e1c21c98" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:21:08.883697 13022 raft_consensus.cc:493] T 3fa34c08b205435dba97346991aa1f92 P cd75a17ab2604397adab03bb8b5fd75c [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 7ba59cc884714e8aa5f3f0ecaed84cbb)
I20260709 13:21:08.926478  6807 raft_consensus.cc:2468] T 711ef6523deb4cbe8ef2ba61e1c21c98 P b7ab4784c7344b939bc36f639286f377 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 20.
W20260709 13:21:08.945051  6698 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:21:08.878806 13198 consensus_queue.cc:1048] T f5be3a11b23d4ea9b08300a2789821c7 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.046s
I20260709 13:21:08.932579 12730 raft_consensus.cc:2749] T 44bde925b2e541b69890d70715b85176 P b7ab4784c7344b939bc36f639286f377 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:21:08.937520  6772 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 64876.1us
W20260709 13:21:08.927747  7466 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 65455.6us
I20260709 13:21:08.837637  6622 catalog_manager.cc:5697] T 3fa34c08b205435dba97346991aa1f92 P cd75a17ab2604397adab03bb8b5fd75c reported cstate change: term changed from 12 to 15, leader changed from 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68) to cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67). New cstate: current_term: 15 leader_uuid: "cd75a17ab2604397adab03bb8b5fd75c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:21:08.914052 13030 leader_election.cc:290] T 7887766dc6784fcaa42b35c05fea7a99 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:21:08.914223 13207 raft_consensus.cc:2804] T 9b3759de40694069b13c0f8bd40e5709 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:21:09.014003  6772 leader_election.cc:304] T 7c37d41cd9164c15a6826ca62a851a69 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:21:09.013195 13132 raft_consensus.cc:493] T fe20b4b48823486ca3b9c648db6ce8aa P cd75a17ab2604397adab03bb8b5fd75c [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 7ba59cc884714e8aa5f3f0ecaed84cbb)
I20260709 13:21:08.967931 13206 raft_consensus.cc:493] T 3a485a995abc4807b6e511e45419f737 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:21:09.058924  6877 raft_consensus.cc:1240] T 427c124d773f483294511e80fe340075 P cd75a17ab2604397adab03bb8b5fd75c [term 17 FOLLOWER]: Rejecting Update request from peer 7ba59cc884714e8aa5f3f0ecaed84cbb for earlier term 16. Current term is 17. Ops: []
W20260709 13:21:09.058310  6770 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 160650us
W20260709 13:21:09.073298  7468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 236585us
I20260709 13:21:08.954216 13118 raft_consensus.cc:515] T 8c7f33e544204fbaac4078e3e83bbf4e P b7ab4784c7344b939bc36f639286f377 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:09.012053 13022 raft_consensus.cc:515] T 3fa34c08b205435dba97346991aa1f92 P cd75a17ab2604397adab03bb8b5fd75c [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:21:09.045773 13213 raft_consensus.cc:2749] T 22ccee1b570c4ad3a57bd7aec085b1b4 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:21:09.092459  6872 raft_consensus.cc:1275] T 7ba5dac66ab5497e9e336f2a3c28cda5 P cd75a17ab2604397adab03bb8b5fd75c [term 19 FOLLOWER]: Refusing update from remote peer 7ba59cc884714e8aa5f3f0ecaed84cbb: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 13:21:09.061407 13207 raft_consensus.cc:697] T 9b3759de40694069b13c0f8bd40e5709 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 16 LEADER]: Becoming Leader. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
I20260709 13:21:09.076996 13180 leader_election.cc:290] T 20f6842e26174571996b8dea4151d4be P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 19 election: Requested vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:21:09.097779  6802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90d42e216d9741e190bca19a781291fd" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
W20260709 13:21:09.109295  6697 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 257861us
I20260709 13:21:09.097791  6806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44bde925b2e541b69890d70715b85176" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:21:09.069870 13132 raft_consensus.cc:515] T fe20b4b48823486ca3b9c648db6ce8aa P cd75a17ab2604397adab03bb8b5fd75c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
W20260709 13:21:09.134845  6772 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 94447.6us
I20260709 13:21:09.136291  6806 raft_consensus.cc:3060] T 44bde925b2e541b69890d70715b85176 P b7ab4784c7344b939bc36f639286f377 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:21:09.100943 13205 raft_consensus.cc:493] T 9e326172347f45e99a0d482b5d8ef768 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:21:09.089504 13206 raft_consensus.cc:515] T 3a485a995abc4807b6e511e45419f737 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:09.193854  6697 leader_election.cc:304] T 8c7f33e544204fbaac4078e3e83bbf4e P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
W20260709 13:21:09.198204  7468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 109496us
W20260709 13:21:09.238641  6846 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:21:09.165970 12898 raft_consensus.cc:493] T bd6869f07b5a4885a0b99fbe60c3b175 P b7ab4784c7344b939bc36f639286f377 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:21:09.168737 13208 log.cc:927] Time spent T 4f00a2e87e56452083b759f60d461ee3 P b7ab4784c7344b939bc36f639286f377: Append to log took a long time: real 0.128s	user 0.000s	sys 0.001s
W20260709 13:21:09.257575  7469 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:21:09.163698 13076 raft_consensus.cc:2749] T 404190ce4ce94cecbfcb6ea9d1dd8626 P b7ab4784c7344b939bc36f639286f377 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:21:09.169087 13196 log.cc:927] Time spent T d8cee0accdb8499c86d4414b72565a38 P 7ba59cc884714e8aa5f3f0ecaed84cbb: Append to log took a long time: real 0.313s	user 0.001s	sys 0.000s
I20260709 13:21:09.151351 13213 raft_consensus.cc:493] T f58dc08b12a2494bb9a1372837970ca2 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:21:09.295938  6727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a92dd554674067a83a9cb68c4773f2" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:21:09.296164 13213 raft_consensus.cc:515] T f58dc08b12a2494bb9a1372837970ca2 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:09.199286 13210 raft_consensus.cc:493] T a1704639a875409b9959353527b3fd68 P cd75a17ab2604397adab03bb8b5fd75c [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:09.272552  6844 leader_election.cc:304] T ce4f062dcd314d43a63ca74067cb5ee3 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, ccd8a4c3bfe3413cb2ae219b09aea832
W20260709 13:21:09.272167 13214 log.cc:927] Time spent T 7887766dc6784fcaa42b35c05fea7a99 P cd75a17ab2604397adab03bb8b5fd75c: Append to log took a long time: real 0.099s	user 0.000s	sys 0.000s
I20260709 13:21:09.173434 12897 consensus_queue.cc:1048] T a1704639a875409b9959353527b3fd68 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.103s
I20260709 13:21:09.305634  6879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c7f33e544204fbaac4078e3e83bbf4e" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:21:09.319340  6879 raft_consensus.cc:2468] T 8c7f33e544204fbaac4078e3e83bbf4e P cd75a17ab2604397adab03bb8b5fd75c [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 15.
I20260709 13:21:09.304610  6727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bf4668eeb70467fb3dc5a0289233b3c" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:21:09.165386 13118 leader_election.cc:290] T 8c7f33e544204fbaac4078e3e83bbf4e P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
W20260709 13:21:09.267721 13194 log.cc:927] Time spent T d8cee0accdb8499c86d4414b72565a38 P cd75a17ab2604397adab03bb8b5fd75c: Append to log took a long time: real 0.206s	user 0.000s	sys 0.001s
W20260709 13:21:09.290323 13122 consensus_meta.cc:287] T 30e88460611e47b2ba16a46a30b5f416 P b7ab4784c7344b939bc36f639286f377: Time spent flushing consensus metadata: real 0.845s	user 0.005s	sys 0.010s
I20260709 13:21:09.313357  6806 raft_consensus.cc:2468] T 44bde925b2e541b69890d70715b85176 P b7ab4784c7344b939bc36f639286f377 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 19.
W20260709 13:21:09.323963  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 51560.6us
I20260709 13:21:09.329545  6723 raft_consensus.cc:1275] T dbdf895bba214ff68685a24fd17dfb5d P ccd8a4c3bfe3413cb2ae219b09aea832 [term 17 FOLLOWER]: Refusing update from remote peer cd75a17ab2604397adab03bb8b5fd75c: Log matching property violated. Preceding OpId in replica: term: 14 index: 6. Preceding OpId from leader: term: 17 index: 8. (index mismatch)
I20260709 13:21:09.265206  6622 catalog_manager.cc:5697] T 1bf4668eeb70467fb3dc5a0289233b3c P cd75a17ab2604397adab03bb8b5fd75c reported cstate change: term changed from 7 to 13, leader changed from ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65) to b7ab4784c7344b939bc36f639286f377 (127.5.126.66). New cstate: current_term: 13 leader_uuid: "b7ab4784c7344b939bc36f639286f377" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } }
W20260709 13:21:09.335649  6698 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:21:09.336505  6697 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 166372us
I20260709 13:21:09.206190 13205 raft_consensus.cc:515] T 9e326172347f45e99a0d482b5d8ef768 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:09.343310 13076 raft_consensus.cc:493] T a3022224cc81473690653a83d4e99470 P b7ab4784c7344b939bc36f639286f377 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:21:09.328212 13122 raft_consensus.cc:2749] T 30e88460611e47b2ba16a46a30b5f416 P b7ab4784c7344b939bc36f639286f377 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:21:09.312171 12965 raft_consensus.cc:3055] T 20f6842e26174571996b8dea4151d4be P b7ab4784c7344b939bc36f639286f377 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:21:09.369956 13206 leader_election.cc:290] T 3a485a995abc4807b6e511e45419f737 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:21:09.370464 12965 raft_consensus.cc:740] T 20f6842e26174571996b8dea4151d4be P b7ab4784c7344b939bc36f639286f377 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
I20260709 13:21:09.371497 12965 consensus_queue.cc:260] T 20f6842e26174571996b8dea4151d4be P b7ab4784c7344b939bc36f639286f377 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.11, Last appended by leader: 11, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:09.372856 12965 raft_consensus.cc:3060] T 20f6842e26174571996b8dea4151d4be P b7ab4784c7344b939bc36f639286f377 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:21:09.358193 13076 raft_consensus.cc:515] T a3022224cc81473690653a83d4e99470 P b7ab4784c7344b939bc36f639286f377 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:09.322932 12898 raft_consensus.cc:515] T bd6869f07b5a4885a0b99fbe60c3b175 P b7ab4784c7344b939bc36f639286f377 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:09.379443  6799 raft_consensus.cc:2468] T bd6869f07b5a4885a0b99fbe60c3b175 P b7ab4784c7344b939bc36f639286f377 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 19.
I20260709 13:21:09.361289 12998 raft_consensus.cc:515] T 4275cf08e63345f993bce8664eada830 P b7ab4784c7344b939bc36f639286f377 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:09.362130  6731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77e330a82df4b43a745d57a68f6f057" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:21:09.364909 13201 raft_consensus.cc:3060] T 8c7f33e544204fbaac4078e3e83bbf4e P ccd8a4c3bfe3413cb2ae219b09aea832 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:21:09.421335  6874 consensus_meta.cc:287] T 7a734b5ab7834e05a8c422208acc58b1 P cd75a17ab2604397adab03bb8b5fd75c: Time spent flushing consensus metadata: real 0.523s	user 0.007s	sys 0.003s
I20260709 13:21:09.368548  6622 catalog_manager.cc:5697] T 9b3759de40694069b13c0f8bd40e5709 P cd75a17ab2604397adab03bb8b5fd75c reported cstate change: term changed from 10 to 11, leader changed from ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65) to b7ab4784c7344b939bc36f639286f377 (127.5.126.66). New cstate: current_term: 11 leader_uuid: "b7ab4784c7344b939bc36f639286f377" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } }
I20260709 13:21:09.423815  6622 catalog_manager.cc:5697] T d33d5ee8ef6f415593d8df52063161ad P cd75a17ab2604397adab03bb8b5fd75c reported cstate change: term changed from 8 to 12. New cstate: current_term: 12 leader_uuid: "b7ab4784c7344b939bc36f639286f377" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } }
I20260709 13:21:09.425683  6622 catalog_manager.cc:5697] T a3022224cc81473690653a83d4e99470 P cd75a17ab2604397adab03bb8b5fd75c reported cstate change: term changed from 12 to 14, leader changed from ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65) to cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67). New cstate: current_term: 14 leader_uuid: "cd75a17ab2604397adab03bb8b5fd75c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } health_report { overall_health: HEALTHY } } }
W20260709 13:21:09.429181  6773 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:21:09.398144  6695 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:21:09.334923 13030 raft_consensus.cc:2749] T ce4f062dcd314d43a63ca74067cb5ee3 P cd75a17ab2604397adab03bb8b5fd75c [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:21:09.441769  6727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bf4668eeb70467fb3dc5a0289233b3c" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:21:09.370182  6725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20f6842e26174571996b8dea4151d4be" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:21:09.420722  6723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44bde925b2e541b69890d70715b85176" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:21:09.449427  6805 raft_consensus.cc:606] T 4275cf08e63345f993bce8664eada830 P b7ab4784c7344b939bc36f639286f377 [term 17 FOLLOWER]: Received request to transfer leadership to TS cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:21:09.449909  6805 raft_consensus.cc:614] T 4275cf08e63345f993bce8664eada830 P b7ab4784c7344b939bc36f639286f377 [term 17 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:21:09.311456 13210 raft_consensus.cc:515] T a1704639a875409b9959353527b3fd68 P cd75a17ab2604397adab03bb8b5fd75c [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:09.452256  6725 raft_consensus.cc:2393] T 20f6842e26174571996b8dea4151d4be P ccd8a4c3bfe3413cb2ae219b09aea832 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c in current term 19: Already voted for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in this term.
I20260709 13:21:09.453259  6723 raft_consensus.cc:2368] T 44bde925b2e541b69890d70715b85176 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c for earlier term 18. Current term is 19.
I20260709 13:21:09.420578 13076 leader_election.cc:290] T a3022224cc81473690653a83d4e99470 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:21:09.455726  6695 leader_election.cc:304] T 711ef6523deb4cbe8ef2ba61e1c21c98 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
I20260709 13:21:09.459882  6726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "853ac0a8cbd64ce99457f170216d4d0f" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:21:09.466137  6726 raft_consensus.cc:3060] T 853ac0a8cbd64ce99457f170216d4d0f P ccd8a4c3bfe3413cb2ae219b09aea832 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:21:09.467535  6731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "713b5728a197487c9300b310ab94e5a3" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:21:09.347940 13222 consensus_queue.cc:1048] T f03d0dbf16864ca4bc1bb5e4c0334c0f P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.178s
I20260709 13:21:09.473590  6731 raft_consensus.cc:2393] T 713b5728a197487c9300b310ab94e5a3 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7ab4784c7344b939bc36f639286f377 in current term 16: Already voted for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in this term.
I20260709 13:21:09.453617 13095 raft_consensus.cc:493] T be1a92657f494cac8dd227d152f50151 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:09.452844 13213 leader_election.cc:290] T f58dc08b12a2494bb9a1372837970ca2 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:21:09.493177  6723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a75bfe094d4bdc963aba3f08dfcd25" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:21:09.455631 13122 raft_consensus.cc:493] T f09c2a98de1a4decabd0ff900dd44caa P b7ab4784c7344b939bc36f639286f377 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:21:09.497030  6727 raft_consensus.cc:1240] T 17587d6730594da4a56fa13a353232a1 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 24 FOLLOWER]: Rejecting Update request from peer b7ab4784c7344b939bc36f639286f377 for earlier term 23. Current term is 24. Ops: [23.16-23.16]
I20260709 13:21:09.440513 13118 raft_consensus.cc:493] T 07a92dd554674067a83a9cb68c4773f2 P b7ab4784c7344b939bc36f639286f377 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:21:09.500993  7495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe20b4b48823486ca3b9c648db6ce8aa" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:21:09.507145  6723 raft_consensus.cc:3060] T 95a75bfe094d4bdc963aba3f08dfcd25 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:21:09.475313 12970 raft_consensus.cc:2749] T 7a734b5ab7834e05a8c422208acc58b1 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:21:09.335413 13207 consensus_queue.cc:237] T 9b3759de40694069b13c0f8bd40e5709 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:09.475769 13132 leader_election.cc:290] T fe20b4b48823486ca3b9c648db6ce8aa P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:21:09.493415 13217 raft_consensus.cc:2804] T 711ef6523deb4cbe8ef2ba61e1c21c98 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:21:09.514493  6731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3411566abe2d4c9bb4b2adfdd05e6f17" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:21:09.468688 13206 consensus_queue.cc:1059] T ab432e62819d499eaaf3dd55481dd930 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: INVALID_TERM, Last received: 20.11, Next index: 12, Last known committed idx: 9, Time since last communication: 0.040s
I20260709 13:21:09.524328 13193 raft_consensus.cc:493] T f3f9c2e2bf644115957398fe4c9459db P ccd8a4c3bfe3413cb2ae219b09aea832 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader cd75a17ab2604397adab03bb8b5fd75c)
I20260709 13:21:09.523916 13202 raft_consensus.cc:493] T c4db81d9d329422bb3b4160ca4ac2d1d P ccd8a4c3bfe3413cb2ae219b09aea832 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader cd75a17ab2604397adab03bb8b5fd75c)
I20260709 13:21:09.527798 12998 leader_election.cc:290] T 4275cf08e63345f993bce8664eada830 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 17 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
W20260709 13:21:09.531888  6697 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 74844.1us
I20260709 13:21:09.513705 13118 raft_consensus.cc:515] T 07a92dd554674067a83a9cb68c4773f2 P b7ab4784c7344b939bc36f639286f377 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:09.541940  6725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3022224cc81473690653a83d4e99470" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:21:09.537420 13193 raft_consensus.cc:515] T f3f9c2e2bf644115957398fe4c9459db P ccd8a4c3bfe3413cb2ae219b09aea832 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:09.600688 13202 raft_consensus.cc:515] T c4db81d9d329422bb3b4160ca4ac2d1d P ccd8a4c3bfe3413cb2ae219b09aea832 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:09.602339  6730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d9def8b32fd443aa94ab1420b06837b" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
W20260709 13:21:09.605114 13232 log.cc:927] Time spent T 4f00a2e87e56452083b759f60d461ee3 P 7ba59cc884714e8aa5f3f0ecaed84cbb: Append to log took a long time: real 0.100s	user 0.000s	sys 0.000s
I20260709 13:21:09.605661 13216 raft_consensus.cc:2804] T 7c37d41cd9164c15a6826ca62a851a69 P b7ab4784c7344b939bc36f639286f377 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:21:09.521497 13217 raft_consensus.cc:493] T 711ef6523deb4cbe8ef2ba61e1c21c98 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:09.498800 13095 raft_consensus.cc:515] T be1a92657f494cac8dd227d152f50151 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:21:09.505915 13122 raft_consensus.cc:515] T f09c2a98de1a4decabd0ff900dd44caa P b7ab4784c7344b939bc36f639286f377 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:09.515796  6622 catalog_manager.cc:5697] T e31b9971c15848dea59d4d4130141d9e P cd75a17ab2604397adab03bb8b5fd75c reported cstate change: term changed from 5 to 11, leader changed from ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65) to b7ab4784c7344b939bc36f639286f377 (127.5.126.66). New cstate: current_term: 11 leader_uuid: "b7ab4784c7344b939bc36f639286f377" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } }
I20260709 13:21:09.528506 13132 raft_consensus.cc:493] T d8292e16e5654be6bc408560cf256aaa P cd75a17ab2604397adab03bb8b5fd75c [term 17 FOLLOWER]: Starting pre-election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
W20260709 13:21:09.696213 13050 consensus_meta.cc:287] T b56bf91d90824c959e21e0cee5ba1816 P ccd8a4c3bfe3413cb2ae219b09aea832: Time spent flushing consensus metadata: real 0.750s	user 0.015s	sys 0.000s
I20260709 13:21:09.695964  6697 leader_election.cc:304] T dbdf895bba214ff68685a24fd17dfb5d P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:21:09.696877 13205 leader_election.cc:290] T 9e326172347f45e99a0d482b5d8ef768 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:21:09.541837  6731 raft_consensus.cc:3060] T 3411566abe2d4c9bb4b2adfdd05e6f17 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 15 FOLLOWER]: Advancing to term 17
I20260709 13:21:09.709239 13210 leader_election.cc:290] T a1704639a875409b9959353527b3fd68 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:21:09.709380 13022 leader_election.cc:290] T 3fa34c08b205435dba97346991aa1f92 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:21:09.713881  6724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c44c4849aa54f2b94d1f1bef9ed546f" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:21:09.715554  6728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab432e62819d499eaaf3dd55481dd930" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
W20260709 13:21:09.721675  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 184604us
I20260709 13:21:09.738233  6798 raft_consensus.cc:3055] T 17587d6730594da4a56fa13a353232a1 P b7ab4784c7344b939bc36f639286f377 [term 23 LEADER]: Stepping down as leader of term 23
I20260709 13:21:09.738646 13193 leader_election.cc:290] T f3f9c2e2bf644115957398fe4c9459db P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
W20260709 13:21:09.695797 13172 consensus_meta.cc:287] T bb3d8792045a4583ae2e965b1350a5b4 P 7ba59cc884714e8aa5f3f0ecaed84cbb: Time spent flushing consensus metadata: real 0.957s	user 0.010s	sys 0.003s
I20260709 13:21:09.739717  7495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fa34c08b205435dba97346991aa1f92" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:21:09.747110  6730 raft_consensus.cc:3060] T 4d9def8b32fd443aa94ab1420b06837b P ccd8a4c3bfe3413cb2ae219b09aea832 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:21:09.750337 13217 raft_consensus.cc:3060] T 711ef6523deb4cbe8ef2ba61e1c21c98 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:21:09.750151  6723 raft_consensus.cc:2468] T 95a75bfe094d4bdc963aba3f08dfcd25 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 16.
I20260709 13:21:09.750717  6726 raft_consensus.cc:2468] T 853ac0a8cbd64ce99457f170216d4d0f P ccd8a4c3bfe3413cb2ae219b09aea832 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 15.
W20260709 13:21:09.740274 13176 consensus_meta.cc:287] T 3fa34c08b205435dba97346991aa1f92 P 7ba59cc884714e8aa5f3f0ecaed84cbb: Time spent flushing consensus metadata: real 1.118s	user 0.008s	sys 0.009s
W20260709 13:21:09.752965 12704 consensus_meta.cc:287] T f5be3a11b23d4ea9b08300a2789821c7 P ccd8a4c3bfe3413cb2ae219b09aea832: Time spent flushing consensus metadata: real 0.959s	user 0.021s	sys 0.000s
I20260709 13:21:09.761451  6798 raft_consensus.cc:740] T 17587d6730594da4a56fa13a353232a1 P b7ab4784c7344b939bc36f639286f377 [term 23 LEADER]: Becoming Follower/Learner. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
I20260709 13:21:09.767288  6727 raft_consensus.cc:1240] T 853ac0a8cbd64ce99457f170216d4d0f P ccd8a4c3bfe3413cb2ae219b09aea832 [term 15 FOLLOWER]: Rejecting Update request from peer b7ab4784c7344b939bc36f639286f377 for earlier term 14. Current term is 15. Ops: []
I20260709 13:21:09.775110  6798 consensus_queue.cc:260] T 17587d6730594da4a56fa13a353232a1 P b7ab4784c7344b939bc36f639286f377 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 23.16, Last appended by leader: 16, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:21:09.776266 13118 leader_election.cc:290] T 07a92dd554674067a83a9cb68c4773f2 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:21:09.776870 13211 raft_consensus.cc:493] T 7c44c4849aa54f2b94d1f1bef9ed546f P cd75a17ab2604397adab03bb8b5fd75c [term 19 FOLLOWER]: Starting pre-election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:21:09.777472 13211 raft_consensus.cc:515] T 7c44c4849aa54f2b94d1f1bef9ed546f P cd75a17ab2604397adab03bb8b5fd75c [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:09.779534 13211 leader_election.cc:290] T 7c44c4849aa54f2b94d1f1bef9ed546f P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:21:09.780741  6798 raft_consensus.cc:3060] T 17587d6730594da4a56fa13a353232a1 P b7ab4784c7344b939bc36f639286f377 [term 23 FOLLOWER]: Advancing to term 24
W20260709 13:21:09.780875  6697 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 85012.2us
I20260709 13:21:09.780114 13233 raft_consensus.cc:493] T 3fa34c08b205435dba97346991aa1f92 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:09.788604  6730 raft_consensus.cc:2468] T 4d9def8b32fd443aa94ab1420b06837b P ccd8a4c3bfe3413cb2ae219b09aea832 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 19.
W20260709 13:21:09.787969  6695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 248918us
I20260709 13:21:09.768121 13205 raft_consensus.cc:2749] T dbdf895bba214ff68685a24fd17dfb5d P ccd8a4c3bfe3413cb2ae219b09aea832 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:21:09.772013 13201 raft_consensus.cc:2749] T 8c7f33e544204fbaac4078e3e83bbf4e P ccd8a4c3bfe3413cb2ae219b09aea832 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:21:09.760339 13132 raft_consensus.cc:515] T d8292e16e5654be6bc408560cf256aaa P cd75a17ab2604397adab03bb8b5fd75c [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:09.797475  6695 leader_election.cc:304] T 44bde925b2e541b69890d70715b85176 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
I20260709 13:21:09.810034  6724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "427c124d773f483294511e80fe340075" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:21:09.815205  6697 leader_election.cc:304] T 3d65025eea89441290d85dd053810e31 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:21:09.811309  6695 leader_election.cc:304] T bd6869f07b5a4885a0b99fbe60c3b175 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
I20260709 13:21:09.818416  6622 catalog_manager.cc:5697] T 90d42e216d9741e190bca19a781291fd P cd75a17ab2604397adab03bb8b5fd75c reported cstate change: term changed from 10 to 12. New cstate: current_term: 12 leader_uuid: "b7ab4784c7344b939bc36f639286f377" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } }
W20260709 13:21:09.820459 13027 consensus_meta.cc:287] T 7a734b5ab7834e05a8c422208acc58b1 P b7ab4784c7344b939bc36f639286f377: Time spent flushing consensus metadata: real 1.008s	user 0.002s	sys 0.016s
I20260709 13:21:09.768121 13172 raft_consensus.cc:515] T bb3d8792045a4583ae2e965b1350a5b4 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:21:09.824190  6732 raft_consensus.cc:1275] T 17587d6730594da4a56fa13a353232a1 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 24 FOLLOWER]: Refusing update from remote peer 7ba59cc884714e8aa5f3f0ecaed84cbb: Log matching property violated. Preceding OpId in replica: term: 21 index: 15. Preceding OpId from leader: term: 24 index: 17. (index mismatch)
I20260709 13:21:09.824915 13247 raft_consensus.cc:2804] T 44bde925b2e541b69890d70715b85176 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:21:09.802939 13211 consensus_queue.cc:1048] T dbdf895bba214ff68685a24fd17dfb5d P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Connected to new peer: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.030s
I20260709 13:21:09.825774 13247 raft_consensus.cc:697] T 44bde925b2e541b69890d70715b85176 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 19 LEADER]: Becoming Leader. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
W20260709 13:21:09.828622  6846 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.68:45071, user_credentials={real_user=slave}} blocked reactor thread for 63536us
W20260709 13:21:09.830585  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 68369.6us
I20260709 13:21:09.832345  6724 raft_consensus.cc:2393] T 427c124d773f483294511e80fe340075 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7ab4784c7344b939bc36f639286f377 in current term 17: Already voted for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in this term.
I20260709 13:21:09.800697 13030 raft_consensus.cc:493] T 4b8cacb381b746da8d0049b0a83b41dd P cd75a17ab2604397adab03bb8b5fd75c [term 18 FOLLOWER]: Starting pre-election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:21:09.838033 13132 leader_election.cc:290] T d8292e16e5654be6bc408560cf256aaa P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:21:09.838115 13030 raft_consensus.cc:515] T 4b8cacb381b746da8d0049b0a83b41dd P cd75a17ab2604397adab03bb8b5fd75c [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:21:09.849428 13225 consensus_queue.cc:1048] T 17587d6730594da4a56fa13a353232a1 P 7ba59cc884714e8aa5f3f0ecaed84cbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 14, Time since last communication: 0.018s
I20260709 13:21:09.850041 13122 leader_election.cc:290] T f09c2a98de1a4decabd0ff900dd44caa P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:21:09.850302  6622 catalog_manager.cc:5697] T 7887766dc6784fcaa42b35c05fea7a99 P cd75a17ab2604397adab03bb8b5fd75c reported cstate change: term changed from 10 to 13. New cstate: current_term: 13 leader_uuid: "b7ab4784c7344b939bc36f639286f377" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } }
I20260709 13:21:09.852177  6729 raft_consensus.cc:1275] T b56bf91d90824c959e21e0cee5ba1816 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 18 FOLLOWER]: Refusing update from remote peer b7ab4784c7344b939bc36f639286f377: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 13:21:09.852458 13095 leader_election.cc:290] T be1a92657f494cac8dd227d152f50151 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:21:09.853053 13205 raft_consensus.cc:2804] T bd6869f07b5a4885a0b99fbe60c3b175 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:21:09.853456 13205 raft_consensus.cc:493] T bd6869f07b5a4885a0b99fbe60c3b175 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:09.853778 13205 raft_consensus.cc:3060] T bd6869f07b5a4885a0b99fbe60c3b175 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:21:09.827517 13247 consensus_queue.cc:237] T 44bde925b2e541b69890d70715b85176 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
W20260709 13:21:09.851294  7469 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:21:09.862835  6731 raft_consensus.cc:2468] T 3411566abe2d4c9bb4b2adfdd05e6f17 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 17.
I20260709 13:21:09.864926  6730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be1a92657f494cac8dd227d152f50151" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:21:09.851380 13202 leader_election.cc:290] T c4db81d9d329422bb3b4160ca4ac2d1d P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
W20260709 13:21:09.880119  6773 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:21:09.857440  6622 catalog_manager.cc:5697] T f5be3a11b23d4ea9b08300a2789821c7 P cd75a17ab2604397adab03bb8b5fd75c reported cstate change: term changed from 8 to 11, leader changed from ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65) to b7ab4784c7344b939bc36f639286f377 (127.5.126.66). New cstate: current_term: 11 leader_uuid: "b7ab4784c7344b939bc36f639286f377" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } }
W20260709 13:21:09.881173 13234 log.cc:927] Time spent T e77e330a82df4b43a745d57a68f6f057 P b7ab4784c7344b939bc36f639286f377: Append to log took a long time: real 0.133s	user 0.002s	sys 0.000s
I20260709 13:21:09.882550  6622 catalog_manager.cc:5697] T 07a92dd554674067a83a9cb68c4773f2 P cd75a17ab2604397adab03bb8b5fd75c reported cstate change: term changed from 10 to 12. New cstate: current_term: 12 leader_uuid: "b7ab4784c7344b939bc36f639286f377" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } }
I20260709 13:21:09.884164 12863 raft_consensus.cc:2749] T 3d65025eea89441290d85dd053810e31 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:21:09.888927 13201 raft_consensus.cc:493] T a1704639a875409b9959353527b3fd68 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:09.889249  6802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be1a92657f494cac8dd227d152f50151" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:21:09.889912  6802 raft_consensus.cc:2468] T be1a92657f494cac8dd227d152f50151 P b7ab4784c7344b939bc36f639286f377 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in term 20.
I20260709 13:21:09.889592 13201 raft_consensus.cc:515] T a1704639a875409b9959353527b3fd68 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
W20260709 13:21:09.890625  6697 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 88675.9us
I20260709 13:21:09.892477 13201 leader_election.cc:290] T a1704639a875409b9959353527b3fd68 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:21:09.892313 12863 consensus_queue.cc:1059] T 30e88460611e47b2ba16a46a30b5f416 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: INVALID_TERM, Last received: 13.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:21:09.892807  6697 leader_election.cc:304] T 7a734b5ab7834e05a8c422208acc58b1 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:21:09.893214 13201 consensus_queue.cc:1048] T e77e330a82df4b43a745d57a68f6f057 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:21:09.893745 12863 raft_consensus.cc:3055] T 30e88460611e47b2ba16a46a30b5f416 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:21:09.894230 12863 raft_consensus.cc:740] T 30e88460611e47b2ba16a46a30b5f416 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
I20260709 13:21:09.798370 13233 raft_consensus.cc:515] T 3fa34c08b205435dba97346991aa1f92 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:21:09.895143 12863 consensus_queue.cc:260] T 30e88460611e47b2ba16a46a30b5f416 P ccd8a4c3bfe3413cb2ae219b09aea832 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:09.907860 12863 raft_consensus.cc:3060] T 30e88460611e47b2ba16a46a30b5f416 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:21:09.901774  6732 raft_consensus.cc:1240] T 20f6842e26174571996b8dea4151d4be P ccd8a4c3bfe3413cb2ae219b09aea832 [term 19 FOLLOWER]: Rejecting Update request from peer b7ab4784c7344b939bc36f639286f377 for earlier term 18. Current term is 19. Ops: []
I20260709 13:21:09.916368 13201 consensus_queue.cc:1048] T 4275cf08e63345f993bce8664eada830 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:21:09.900792  6622 catalog_manager.cc:5697] T c4db81d9d329422bb3b4160ca4ac2d1d P cd75a17ab2604397adab03bb8b5fd75c reported cstate change: term changed from 9 to 12. New cstate: current_term: 12 leader_uuid: "b7ab4784c7344b939bc36f639286f377" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } }
I20260709 13:21:09.909303  6730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4275cf08e63345f993bce8664eada830" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:21:09.874897 13095 raft_consensus.cc:493] T b3f13b31a1f84f0d89d007eadd57924c P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 14 FOLLOWER]: Starting pre-election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:21:09.896095  7498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b8cacb381b746da8d0049b0a83b41dd" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:21:09.910842  6805 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:38240 (request call id 26) took 1077 ms. Trace:
I20260709 13:21:09.904958  6728 raft_consensus.cc:1275] T a1704639a875409b9959353527b3fd68 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 19 FOLLOWER]: Refusing update from remote peer b7ab4784c7344b939bc36f639286f377: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260709 13:21:09.911877 13216 raft_consensus.cc:493] T 7c37d41cd9164c15a6826ca62a851a69 P b7ab4784c7344b939bc36f639286f377 [term 18 FOLLOWER]: Starting leader election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:21:09.913094  7466 leader_election.cc:304] T be1a92657f494cac8dd227d152f50151 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, b7ab4784c7344b939bc36f639286f377; no voters: ccd8a4c3bfe3413cb2ae219b09aea832
W20260709 13:21:09.970330  7466 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 57339.1us
I20260709 13:21:09.872455 13030 leader_election.cc:290] T 4b8cacb381b746da8d0049b0a83b41dd P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:21:09.902644  6725 raft_consensus.cc:1275] T f5be3a11b23d4ea9b08300a2789821c7 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 18 FOLLOWER]: Refusing update from remote peer b7ab4784c7344b939bc36f639286f377: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 13:21:09.905623  6723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a75bfe094d4bdc963aba3f08dfcd25" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:21:09.972718  6723 raft_consensus.cc:2393] T 95a75bfe094d4bdc963aba3f08dfcd25 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate b7ab4784c7344b939bc36f639286f377 in current term 16: Already voted for candidate cd75a17ab2604397adab03bb8b5fd75c in this term.
I20260709 13:21:09.914546  6844 leader_election.cc:400] T 44bde925b2e541b69890d70715b85176 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 18 election: Vote denied by peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391) with higher term. Message: Invalid argument: T 44bde925b2e541b69890d70715b85176 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c for earlier term 18. Current term is 19.
I20260709 13:21:09.908691  7495 raft_consensus.cc:2468] T 3fa34c08b205435dba97346991aa1f92 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 22.
I20260709 13:21:09.936681  6799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30e88460611e47b2ba16a46a30b5f416" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:21:09.925599 13222 raft_consensus.cc:493] T 3d65025eea89441290d85dd053810e31 P b7ab4784c7344b939bc36f639286f377 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:09.923962 13180 raft_consensus.cc:3055] T ab432e62819d499eaaf3dd55481dd930 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:21:09.925395  6801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ba5dac66ab5497e9e336f2a3c28cda5" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:21:09.916724  6732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "713b5728a197487c9300b310ab94e5a3" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:21:09.937677  6802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ba5dac66ab5497e9e336f2a3c28cda5" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:21:09.947345 13193 raft_consensus.cc:2749] T 7a734b5ab7834e05a8c422208acc58b1 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:21:09.924485  6806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e326172347f45e99a0d482b5d8ef768" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:21:09.925187  6727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3d8792045a4583ae2e965b1350a5b4" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:21:09.917279 13225 raft_consensus.cc:493] T 4b8cacb381b746da8d0049b0a83b41dd P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 18 FOLLOWER]: Starting pre-election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
W20260709 13:21:09.921350  6695 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:21:09.928472  6800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f58dc08b12a2494bb9a1372837970ca2" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:21:09.945068  6798 raft_consensus.cc:1275] T 17587d6730594da4a56fa13a353232a1 P b7ab4784c7344b939bc36f639286f377 [term 24 FOLLOWER]: Refusing update from remote peer 7ba59cc884714e8aa5f3f0ecaed84cbb: Log matching property violated. Preceding OpId in replica: term: 23 index: 16. Preceding OpId from leader: term: 24 index: 17. (index mismatch)
I20260709 13:21:09.924885  6804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90d42e216d9741e190bca19a781291fd" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:21:10.027608  6800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34f36d59d88f40fe8a2805e604fc6c0a" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:21:09.907982 13172 leader_election.cc:290] T bb3d8792045a4583ae2e965b1350a5b4 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 18 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
W20260709 13:21:09.961778  6698 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:21:10.032464  6798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce4f062dcd314d43a63ca74067cb5ee3" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:21:09.964430  6805 rpcz_store.cc:276] 0709 13:21:08.833588 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:21:08.833767 (+   179us) service_pool.cc:224] Handling call
0709 13:21:09.910622 (+1076855us) spinlock_profiling.cc:243] Waited 615 ms on lock 0x7b54002c97d4. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f9a4853 00007fcc1497260a 00007fcc0def87d4 00007fcc0def8762 00007fcc0def8691 00007fcc0def860c 00007fcc0def78c2 00007fcc0dce548c 00007fcc0dce48c6 00007fcc0dce426f
0709 13:21:09.910750 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1413427456}
I20260709 13:21:09.926559  6803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c240553ce044eedb41541d72b9475d7" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:21:09.978752  6730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c37d41cd9164c15a6826ca62a851a69" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 19 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:21:09.984346 13016 raft_consensus.cc:2804] T be1a92657f494cac8dd227d152f50151 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:21:09.984905 13222 raft_consensus.cc:515] T 3d65025eea89441290d85dd053810e31 P b7ab4784c7344b939bc36f639286f377 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:09.986768  6801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e326172347f45e99a0d482b5d8ef768" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:21:09.988154  6732 raft_consensus.cc:2393] T 713b5728a197487c9300b310ab94e5a3 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate b7ab4784c7344b939bc36f639286f377 in current term 16: Already voted for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in this term.
I20260709 13:21:09.987946  6802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20f6842e26174571996b8dea4151d4be" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:21:09.990559  6807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a485a995abc4807b6e511e45419f737" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:21:09.989140  6697 leader_election.cc:304] T 34f36d59d88f40fe8a2805e604fc6c0a P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:21:09.991539 12898 leader_election.cc:290] T bd6869f07b5a4885a0b99fbe60c3b175 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:21:09.992908  6723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fa34c08b205435dba97346991aa1f92" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 23 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:21:09.976104  6844 leader_election.cc:403] T 44bde925b2e541b69890d70715b85176 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 18 election: Cancelling election due to peer responding with higher term
I20260709 13:21:10.000093  6799 raft_consensus.cc:2468] T 30e88460611e47b2ba16a46a30b5f416 P b7ab4784c7344b939bc36f639286f377 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 14.
I20260709 13:21:10.000746 13233 leader_election.cc:290] T 3fa34c08b205435dba97346991aa1f92 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:21:10.004814 13180 raft_consensus.cc:740] T ab432e62819d499eaaf3dd55481dd930 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
I20260709 13:21:10.006358  6846 leader_election.cc:304] T 3fa34c08b205435dba97346991aa1f92 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:21:10.063133  6806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c7f33e544204fbaac4078e3e83bbf4e" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:21:09.970773 13216 raft_consensus.cc:3060] T 7c37d41cd9164c15a6826ca62a851a69 P b7ab4784c7344b939bc36f639286f377 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:21:10.067448  6800 raft_consensus.cc:1240] T 4275cf08e63345f993bce8664eada830 P b7ab4784c7344b939bc36f639286f377 [term 17 FOLLOWER]: Rejecting Update request from peer ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 16. Current term is 17. Ops: []
I20260709 13:21:10.064158  6723 raft_consensus.cc:2468] T 3fa34c08b205435dba97346991aa1f92 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in term 22.
I20260709 13:21:10.065193  6806 raft_consensus.cc:2468] T 8c7f33e544204fbaac4078e3e83bbf4e P b7ab4784c7344b939bc36f639286f377 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 15.
W20260709 13:21:10.077350  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 245064us
W20260709 13:21:10.077549  6846 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.68:45071, user_credentials={real_user=slave}} blocked reactor thread for 71310.8us
I20260709 13:21:10.078550  6802 raft_consensus.cc:2410] T 20f6842e26174571996b8dea4151d4be P b7ab4784c7344b939bc36f639286f377 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate ccd8a4c3bfe3413cb2ae219b09aea832 for term 19 because replica has last-logged OpId of term: 18 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 10.
I20260709 13:21:10.085582  6878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3022224cc81473690653a83d4e99470" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:21:09.968268 13095 raft_consensus.cc:515] T b3f13b31a1f84f0d89d007eadd57924c P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:21:10.082616  6800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f9c2e2bf644115957398fe4c9459db" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:21:10.093883  6804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de3186201e1a40d0b335eeb8b4e256e0" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:21:10.105794  6807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "427c124d773f483294511e80fe340075" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:21:10.088572  6798 raft_consensus.cc:1240] T 7c44c4849aa54f2b94d1f1bef9ed546f P b7ab4784c7344b939bc36f639286f377 [term 20 FOLLOWER]: Rejecting Update request from peer ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 19. Current term is 20. Ops: []
I20260709 13:21:10.092270  6806 raft_consensus.cc:1240] T f03d0dbf16864ca4bc1bb5e4c0334c0f P b7ab4784c7344b939bc36f639286f377 [term 19 LEADER]: Rejecting Update request from peer ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 18. Current term is 19. Ops: []
I20260709 13:21:10.094237  6802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "713b5728a197487c9300b310ab94e5a3" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:21:10.114709  6802 raft_consensus.cc:2368] T 713b5728a197487c9300b310ab94e5a3 P b7ab4784c7344b939bc36f639286f377 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c for earlier term 15. Current term is 16.
I20260709 13:21:10.099674  7466 leader_election.cc:304] T 3fa34c08b205435dba97346991aa1f92 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
I20260709 13:21:10.039135 13016 raft_consensus.cc:493] T be1a92657f494cac8dd227d152f50151 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:10.106444  6878 raft_consensus.cc:2393] T a3022224cc81473690653a83d4e99470 P cd75a17ab2604397adab03bb8b5fd75c [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7ab4784c7344b939bc36f639286f377 in current term 20: Already voted for candidate cd75a17ab2604397adab03bb8b5fd75c in this term.
I20260709 13:21:10.038337 12704 raft_consensus.cc:493] T f5be3a11b23d4ea9b08300a2789821c7 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:10.091411  6801 raft_consensus.cc:1240] T 30e88460611e47b2ba16a46a30b5f416 P b7ab4784c7344b939bc36f639286f377 [term 14 FOLLOWER]: Rejecting Update request from peer ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 13. Current term is 14. Ops: []
W20260709 13:21:10.100227  6697 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 111210us
I20260709 13:21:10.088672  6799 raft_consensus.cc:1275] T be1a92657f494cac8dd227d152f50151 P b7ab4784c7344b939bc36f639286f377 [term 20 FOLLOWER]: Refusing update from remote peer ccd8a4c3bfe3413cb2ae219b09aea832: Log matching property violated. Preceding OpId in replica: term: 19 index: 14. Preceding OpId from leader: term: 20 index: 15. (index mismatch)
I20260709 13:21:10.147282  6874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6869f07b5a4885a0b99fbe60c3b175" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 20 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:21:10.165364  6801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c240553ce044eedb41541d72b9475d7" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:21:10.090171 13222 leader_election.cc:290] T 3d65025eea89441290d85dd053810e31 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:21:10.228792  6878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4275cf08e63345f993bce8664eada830" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:21:10.229472  6878 raft_consensus.cc:3060] T 4275cf08e63345f993bce8664eada830 P cd75a17ab2604397adab03bb8b5fd75c [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:21:10.230762 13216 raft_consensus.cc:515] T 7c37d41cd9164c15a6826ca62a851a69 P b7ab4784c7344b939bc36f639286f377 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:10.229025 13027 raft_consensus.cc:493] T e31b9971c15848dea59d4d4130141d9e P b7ab4784c7344b939bc36f639286f377 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:10.232127 13027 raft_consensus.cc:515] T e31b9971c15848dea59d4d4130141d9e P b7ab4784c7344b939bc36f639286f377 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:10.232914  6802 raft_consensus.cc:1275] T 404190ce4ce94cecbfcb6ea9d1dd8626 P b7ab4784c7344b939bc36f639286f377 [term 16 FOLLOWER]: Refusing update from remote peer ccd8a4c3bfe3413cb2ae219b09aea832: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:21:10.235057 13027 leader_election.cc:290] T e31b9971c15848dea59d4d4130141d9e P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:21:10.166025  6806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de3186201e1a40d0b335eeb8b4e256e0" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
W20260709 13:21:10.227646  6772 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 111334us
I20260709 13:21:10.167271  6798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "711ef6523deb4cbe8ef2ba61e1c21c98" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:21:10.095872 13205 raft_consensus.cc:515] T bd6869f07b5a4885a0b99fbe60c3b175 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:10.149958 13233 raft_consensus.cc:2804] T 3fa34c08b205435dba97346991aa1f92 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 22 FOLLOWER]: Leader pre-election won for term 23
W20260709 13:21:10.173239  6773 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:21:10.219515 12704 raft_consensus.cc:515] T f5be3a11b23d4ea9b08300a2789821c7 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:10.123541 13016 raft_consensus.cc:3060] T be1a92657f494cac8dd227d152f50151 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:21:10.030369 13225 raft_consensus.cc:515] T 4b8cacb381b746da8d0049b0a83b41dd P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:21:10.110050 13217 raft_consensus.cc:515] T 711ef6523deb4cbe8ef2ba61e1c21c98 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:10.218565 13249 raft_consensus.cc:493] T f03d0dbf16864ca4bc1bb5e4c0334c0f P cd75a17ab2604397adab03bb8b5fd75c [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:10.094405 13188 raft_consensus.cc:2749] T 34f36d59d88f40fe8a2805e604fc6c0a P ccd8a4c3bfe3413cb2ae219b09aea832 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:21:10.104499 13030 raft_consensus.cc:493] T 4d9def8b32fd443aa94ab1420b06837b P cd75a17ab2604397adab03bb8b5fd75c [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:10.256108  6806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4db81d9d329422bb3b4160ca4ac2d1d" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:21:10.085832 13172 raft_consensus.cc:493] T 404190ce4ce94cecbfcb6ea9d1dd8626 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:10.094058 13022 raft_consensus.cc:3060] T 44bde925b2e541b69890d70715b85176 P cd75a17ab2604397adab03bb8b5fd75c [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:21:10.104799 13211 raft_consensus.cc:493] T bd6869f07b5a4885a0b99fbe60c3b175 P cd75a17ab2604397adab03bb8b5fd75c [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:10.263425 12704 leader_election.cc:290] T f5be3a11b23d4ea9b08300a2789821c7 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:21:10.263986 13172 raft_consensus.cc:515] T 404190ce4ce94cecbfcb6ea9d1dd8626 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:21:10.078504  6844 leader_election.cc:304] T 853ac0a8cbd64ce99457f170216d4d0f P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
W20260709 13:21:10.266182  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 187736us
I20260709 13:21:10.096294 13242 raft_consensus.cc:2804] T 3fa34c08b205435dba97346991aa1f92 P cd75a17ab2604397adab03bb8b5fd75c [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:21:10.226924  6803 raft_consensus.cc:2468] T 2c240553ce044eedb41541d72b9475d7 P b7ab4784c7344b939bc36f639286f377 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 18.
I20260709 13:21:10.267573 13248 raft_consensus.cc:2804] T 853ac0a8cbd64ce99457f170216d4d0f P cd75a17ab2604397adab03bb8b5fd75c [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:21:10.089293 13180 consensus_queue.cc:260] T ab432e62819d499eaaf3dd55481dd930 P ccd8a4c3bfe3413cb2ae219b09aea832 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 20.11, Last appended by leader: 11, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:10.166085  6799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f00a2e87e56452083b759f60d461ee3" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:21:10.268224  6803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1704639a875409b9959353527b3fd68" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 20 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:21:10.228070  6697 leader_election.cc:304] T de3186201e1a40d0b335eeb8b4e256e0 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:21:10.237155  6798 raft_consensus.cc:2376] T 711ef6523deb4cbe8ef2ba61e1c21c98 P b7ab4784c7344b939bc36f639286f377 [term 20 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 20. Re-sending same reply.
I20260709 13:21:10.038614 13176 consensus_queue.cc:1048] T 17587d6730594da4a56fa13a353232a1 P 7ba59cc884714e8aa5f3f0ecaed84cbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.148s
I20260709 13:21:10.242074  6772 leader_election.cc:304] T 8c7f33e544204fbaac4078e3e83bbf4e P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:21:10.249986  6872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a92dd554674067a83a9cb68c4773f2" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:21:10.269726  7498 raft_consensus.cc:2468] T 4b8cacb381b746da8d0049b0a83b41dd P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 18.
I20260709 13:21:10.162287  6804 raft_consensus.cc:2393] T de3186201e1a40d0b335eeb8b4e256e0 P b7ab4784c7344b939bc36f639286f377 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c in current term 18: Already voted for candidate b7ab4784c7344b939bc36f639286f377 in this term.
I20260709 13:21:10.258599  6806 raft_consensus.cc:2468] T c4db81d9d329422bb3b4160ca4ac2d1d P b7ab4784c7344b939bc36f639286f377 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 18.
I20260709 13:21:10.264446  6881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09c2a98de1a4decabd0ff900dd44caa" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:21:10.274590  6881 raft_consensus.cc:2468] T f09c2a98de1a4decabd0ff900dd44caa P cd75a17ab2604397adab03bb8b5fd75c [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 18.
I20260709 13:21:10.272256  6872 raft_consensus.cc:2468] T 07a92dd554674067a83a9cb68c4773f2 P cd75a17ab2604397adab03bb8b5fd75c [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 16.
I20260709 13:21:10.264972 13211 raft_consensus.cc:515] T bd6869f07b5a4885a0b99fbe60c3b175 P cd75a17ab2604397adab03bb8b5fd75c [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:10.265338  6801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b56bf91d90824c959e21e0cee5ba1816" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:21:10.266976  6844 leader_election.cc:304] T 95a75bfe094d4bdc963aba3f08dfcd25 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:21:10.112486  6807 raft_consensus.cc:2468] T 427c124d773f483294511e80fe340075 P b7ab4784c7344b939bc36f639286f377 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 16.
I20260709 13:21:10.267493 13242 raft_consensus.cc:493] T 3fa34c08b205435dba97346991aa1f92 P cd75a17ab2604397adab03bb8b5fd75c [term 21 FOLLOWER]: Starting leader election (detected failure of leader 7ba59cc884714e8aa5f3f0ecaed84cbb)
I20260709 13:21:10.236402  6800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a92dd554674067a83a9cb68c4773f2" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:21:10.243220 13233 raft_consensus.cc:493] T 3fa34c08b205435dba97346991aa1f92 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:10.282124  6805 raft_consensus.cc:1240] T ab432e62819d499eaaf3dd55481dd930 P b7ab4784c7344b939bc36f639286f377 [term 21 FOLLOWER]: Rejecting Update request from peer ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 20. Current term is 21. Ops: []
I20260709 13:21:10.273948 13248 raft_consensus.cc:697] T 853ac0a8cbd64ce99457f170216d4d0f P cd75a17ab2604397adab03bb8b5fd75c [term 15 LEADER]: Becoming Leader. State: Replica: cd75a17ab2604397adab03bb8b5fd75c, State: Running, Role: LEADER
I20260709 13:21:10.270766 13132 raft_consensus.cc:493] T d33d5ee8ef6f415593d8df52063161ad P cd75a17ab2604397adab03bb8b5fd75c [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:10.301854 13172 leader_election.cc:290] T 404190ce4ce94cecbfcb6ea9d1dd8626 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:21:10.302196 13132 raft_consensus.cc:515] T d33d5ee8ef6f415593d8df52063161ad P cd75a17ab2604397adab03bb8b5fd75c [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:10.304461 13132 leader_election.cc:290] T d33d5ee8ef6f415593d8df52063161ad P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:21:10.277069 12898 raft_consensus.cc:2804] T 8c7f33e544204fbaac4078e3e83bbf4e P b7ab4784c7344b939bc36f639286f377 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:21:10.294679 13217 leader_election.cc:290] T 711ef6523deb4cbe8ef2ba61e1c21c98 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 21 election: Requested vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:21:10.296128 13205 leader_election.cc:290] T bd6869f07b5a4885a0b99fbe60c3b175 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 20 election: Requested vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
W20260709 13:21:10.296669  6697 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 75187.8us
I20260709 13:21:10.291419  6844 leader_election.cc:304] T 3411566abe2d4c9bb4b2adfdd05e6f17 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:21:10.313709  6874 raft_consensus.cc:2468] T bd6869f07b5a4885a0b99fbe60c3b175 P cd75a17ab2604397adab03bb8b5fd75c [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 19.
W20260709 13:21:10.307202  6695 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:21:10.307439  6803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77e330a82df4b43a745d57a68f6f057" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:21:10.315011  6732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3f13b31a1f84f0d89d007eadd57924c" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:21:10.296152 13188 raft_consensus.cc:2749] T de3186201e1a40d0b335eeb8b4e256e0 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:21:10.283243 13180 raft_consensus.cc:3060] T ab432e62819d499eaaf3dd55481dd930 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:21:10.310799  6878 raft_consensus.cc:2468] T 4275cf08e63345f993bce8664eada830 P cd75a17ab2604397adab03bb8b5fd75c [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 17.
I20260709 13:21:10.317071  6723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "404190ce4ce94cecbfcb6ea9d1dd8626" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:21:10.261476 13030 raft_consensus.cc:515] T 4d9def8b32fd443aa94ab1420b06837b P cd75a17ab2604397adab03bb8b5fd75c [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:10.299886 13218 raft_consensus.cc:2804] T 95a75bfe094d4bdc963aba3f08dfcd25 P cd75a17ab2604397adab03bb8b5fd75c [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:21:10.305790 13233 raft_consensus.cc:3060] T 3fa34c08b205435dba97346991aa1f92 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:21:10.288533 13242 raft_consensus.cc:3060] T 3fa34c08b205435dba97346991aa1f92 P cd75a17ab2604397adab03bb8b5fd75c [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:21:10.326009  6772 leader_election.cc:304] T f09c2a98de1a4decabd0ff900dd44caa P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:21:10.259052 13249 raft_consensus.cc:515] T f03d0dbf16864ca4bc1bb5e4c0334c0f P cd75a17ab2604397adab03bb8b5fd75c [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:10.309689 12898 raft_consensus.cc:493] T 8c7f33e544204fbaac4078e3e83bbf4e P b7ab4784c7344b939bc36f639286f377 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:10.334410  6807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bf4668eeb70467fb3dc5a0289233b3c" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:21:10.335235  6697 leader_election.cc:304] T 7887766dc6784fcaa42b35c05fea7a99 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:21:10.339689  6800 raft_consensus.cc:1275] T 9b3759de40694069b13c0f8bd40e5709 P b7ab4784c7344b939bc36f639286f377 [term 16 FOLLOWER]: Refusing update from remote peer ccd8a4c3bfe3413cb2ae219b09aea832: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:21:10.342499  6772 leader_election.cc:304] T 07a92dd554674067a83a9cb68c4773f2 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:21:10.356755  6803 pending_rounds.cc:85] T c4db81d9d329422bb3b4160ca4ac2d1d P b7ab4784c7344b939bc36f639286f377: Aborting all ops after (but not including) 9
I20260709 13:21:10.362349  6803 pending_rounds.cc:107] T c4db81d9d329422bb3b4160ca4ac2d1d P b7ab4784c7344b939bc36f639286f377: Aborting uncommitted NO_OP operation due to leader change: 17.10
I20260709 13:21:10.362694  6803 raft_consensus.cc:2889] T c4db81d9d329422bb3b4160ca4ac2d1d P b7ab4784c7344b939bc36f639286f377 [term 18 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:21:10.367633  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 76318.8us
I20260709 13:21:10.363741  6772 leader_election.cc:304] T 4275cf08e63345f993bce8664eada830 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:21:10.370831 13122 raft_consensus.cc:2804] T 07a92dd554674067a83a9cb68c4773f2 P b7ab4784c7344b939bc36f639286f377 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:21:10.370970 13210 raft_consensus.cc:2804] T 3411566abe2d4c9bb4b2adfdd05e6f17 P cd75a17ab2604397adab03bb8b5fd75c [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:21:10.371343  6730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7887766dc6784fcaa42b35c05fea7a99" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 21 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:21:10.371524 13122 raft_consensus.cc:493] T 07a92dd554674067a83a9cb68c4773f2 P b7ab4784c7344b939bc36f639286f377 [term 16 FOLLOWER]: Starting leader election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:21:10.371683 13210 raft_consensus.cc:697] T 3411566abe2d4c9bb4b2adfdd05e6f17 P cd75a17ab2604397adab03bb8b5fd75c [term 17 LEADER]: Becoming Leader. State: Replica: cd75a17ab2604397adab03bb8b5fd75c, State: Running, Role: LEADER
I20260709 13:21:10.372234 13122 raft_consensus.cc:3060] T 07a92dd554674067a83a9cb68c4773f2 P b7ab4784c7344b939bc36f639286f377 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:21:10.374218  6729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1704639a875409b9959353527b3fd68" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 20 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:21:10.374874  6729 raft_consensus.cc:2468] T a1704639a875409b9959353527b3fd68 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 19.
I20260709 13:21:10.375283  6805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5be3a11b23d4ea9b08300a2789821c7" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:21:10.376317  6807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20f6842e26174571996b8dea4151d4be" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:21:10.377153  6807 raft_consensus.cc:2410] T 20f6842e26174571996b8dea4151d4be P b7ab4784c7344b939bc36f639286f377 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c for term 19 because replica has last-logged OpId of term: 18 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 10.
I20260709 13:21:10.377708 12970 consensus_queue.cc:1048] T 7ba5dac66ab5497e9e336f2a3c28cda5 P 7ba59cc884714e8aa5f3f0ecaed84cbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:21:10.378748 13211 leader_election.cc:290] T bd6869f07b5a4885a0b99fbe60c3b175 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:21:10.379374 13211 raft_consensus.cc:493] T bb3d8792045a4583ae2e965b1350a5b4 P cd75a17ab2604397adab03bb8b5fd75c [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:10.368539 13216 leader_election.cc:290] T 7c37d41cd9164c15a6826ca62a851a69 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 19 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:21:10.344724 12898 raft_consensus.cc:3060] T 8c7f33e544204fbaac4078e3e83bbf4e P b7ab4784c7344b939bc36f639286f377 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:21:10.380292  6727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe20b4b48823486ca3b9c648db6ce8aa" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:21:10.373008 13210 consensus_queue.cc:237] T 3411566abe2d4c9bb4b2adfdd05e6f17 P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:10.359783 13223 raft_consensus.cc:2804] T f09c2a98de1a4decabd0ff900dd44caa P b7ab4784c7344b939bc36f639286f377 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:21:10.378021  6725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fa34c08b205435dba97346991aa1f92" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:21:10.395047  6878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d65025eea89441290d85dd053810e31" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:21:10.438428  6878 raft_consensus.cc:2468] T 3d65025eea89441290d85dd053810e31 P cd75a17ab2604397adab03bb8b5fd75c [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 18.
I20260709 13:21:10.406425  6880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c37d41cd9164c15a6826ca62a851a69" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:21:10.440044  6880 raft_consensus.cc:3060] T 7c37d41cd9164c15a6826ca62a851a69 P cd75a17ab2604397adab03bb8b5fd75c [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:21:10.440912  6802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6869f07b5a4885a0b99fbe60c3b175" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 20 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:21:10.441634  6802 raft_consensus.cc:3060] T bd6869f07b5a4885a0b99fbe60c3b175 P b7ab4784c7344b939bc36f639286f377 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:21:10.447696  6725 raft_consensus.cc:2393] T 3fa34c08b205435dba97346991aa1f92 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c in current term 22: Already voted for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in this term.
I20260709 13:21:10.411492  6728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b8cacb381b746da8d0049b0a83b41dd" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:21:10.412748  6724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8292e16e5654be6bc408560cf256aaa" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:21:10.414472  6726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d33d5ee8ef6f415593d8df52063161ad" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:21:10.452561  6726 raft_consensus.cc:2468] T d33d5ee8ef6f415593d8df52063161ad P ccd8a4c3bfe3413cb2ae219b09aea832 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 16.
W20260709 13:21:10.389215 13253 log.cc:927] Time spent T 44bde925b2e541b69890d70715b85176 P ccd8a4c3bfe3413cb2ae219b09aea832: Append to log took a long time: real 0.136s	user 0.000s	sys 0.001s
I20260709 13:21:10.379829 13211 raft_consensus.cc:515] T bb3d8792045a4583ae2e965b1350a5b4 P cd75a17ab2604397adab03bb8b5fd75c [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:21:10.425432  7495 raft_consensus.cc:1240] T 17587d6730594da4a56fa13a353232a1 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 24 LEADER]: Rejecting Update request from peer b7ab4784c7344b939bc36f639286f377 for earlier term 23. Current term is 24. Ops: []
I20260709 13:21:10.357906 13176 raft_consensus.cc:493] T ce4f062dcd314d43a63ca74067cb5ee3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 15 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:21:10.427878  6732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e31b9971c15848dea59d4d4130141d9e" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:21:10.390020 13095 leader_election.cc:290] T b3f13b31a1f84f0d89d007eadd57924c P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:21:10.428931  6731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c44c4849aa54f2b94d1f1bef9ed546f" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:21:10.430333  6804 raft_consensus.cc:1275] T 44bde925b2e541b69890d70715b85176 P b7ab4784c7344b939bc36f639286f377 [term 19 FOLLOWER]: Refusing update from remote peer ccd8a4c3bfe3413cb2ae219b09aea832: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260709 13:21:10.427268  6800 consensus_queue.cc:237] T ce4f062dcd314d43a63ca74067cb5ee3 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:21:10.471321  6875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e31b9971c15848dea59d4d4130141d9e" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:21:10.472795  6801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "711ef6523deb4cbe8ef2ba61e1c21c98" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:21:10.301870 13248 consensus_queue.cc:237] T 853ac0a8cbd64ce99457f170216d4d0f P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:10.361479 13205 raft_consensus.cc:2749] T 7887766dc6784fcaa42b35c05fea7a99 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:21:10.486889  6807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44bde925b2e541b69890d70715b85176" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:21:10.436116 13223 raft_consensus.cc:493] T f09c2a98de1a4decabd0ff900dd44caa P b7ab4784c7344b939bc36f639286f377 [term 18 FOLLOWER]: Starting leader election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
W20260709 13:21:10.515307  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 137650us
I20260709 13:21:10.524259  6732 raft_consensus.cc:2393] T e31b9971c15848dea59d4d4130141d9e P ccd8a4c3bfe3413cb2ae219b09aea832 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c in current term 16: Already voted for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in this term.
I20260709 13:21:10.525130  6807 raft_consensus.cc:2368] T 44bde925b2e541b69890d70715b85176 P b7ab4784c7344b939bc36f639286f377 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c for earlier term 18. Current term is 19.
I20260709 13:21:10.433899 13076 raft_consensus.cc:2804] T 4275cf08e63345f993bce8664eada830 P b7ab4784c7344b939bc36f639286f377 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:21:10.437110 12970 raft_consensus.cc:493] T 4f00a2e87e56452083b759f60d461ee3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 20 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:21:10.440958 12965 raft_consensus.cc:493] T 3411566abe2d4c9bb4b2adfdd05e6f17 P b7ab4784c7344b939bc36f639286f377 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:10.516799  6875 raft_consensus.cc:2468] T e31b9971c15848dea59d4d4130141d9e P cd75a17ab2604397adab03bb8b5fd75c [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 16.
I20260709 13:21:10.516422  6801 raft_consensus.cc:3060] T 711ef6523deb4cbe8ef2ba61e1c21c98 P b7ab4784c7344b939bc36f639286f377 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:21:10.524677  6846 leader_election.cc:304] T 4b8cacb381b746da8d0049b0a83b41dd P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:21:10.541167  6880 raft_consensus.cc:2468] T 7c37d41cd9164c15a6826ca62a851a69 P cd75a17ab2604397adab03bb8b5fd75c [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 19.
I20260709 13:21:10.544560  6730 raft_consensus.cc:2468] T 7887766dc6784fcaa42b35c05fea7a99 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 20.
W20260709 13:21:10.524065  6844 connection.cc:256] RPC call timeout handler was delayed by -1.5980220680000912s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15410000000000001s for a response
W20260709 13:21:10.550500  6844 connection.cc:256] RPC call timeout handler was delayed by -1.5422220680000009s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1603s for a response
W20260709 13:21:10.551069  6844 connection.cc:256] RPC call timeout handler was delayed by -1.4234220680000362s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17350000000000002s for a response
W20260709 13:21:10.551468  6844 connection.cc:256] RPC call timeout handler was delayed by -1.3748220679999577s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1789s for a response
W20260709 13:21:10.551865  6844 connection.cc:256] RPC call timeout handler was delayed by -1.2434220679999726s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1935s for a response
W20260709 13:21:10.552232  6844 connection.cc:256] RPC call timeout handler was delayed by -1.0859220680001727s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.211s for a response
I20260709 13:21:10.526243 13223 raft_consensus.cc:3060] T f09c2a98de1a4decabd0ff900dd44caa P b7ab4784c7344b939bc36f639286f377 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:21:10.555967  6805 raft_consensus.cc:1275] T dbdf895bba214ff68685a24fd17dfb5d P b7ab4784c7344b939bc36f639286f377 [term 17 FOLLOWER]: Refusing update from remote peer cd75a17ab2604397adab03bb8b5fd75c: Log matching property violated. Preceding OpId in replica: term: 15 index: 7. Preceding OpId from leader: term: 17 index: 8. (index mismatch)
I20260709 13:21:10.526559 13218 raft_consensus.cc:697] T 95a75bfe094d4bdc963aba3f08dfcd25 P cd75a17ab2604397adab03bb8b5fd75c [term 16 LEADER]: Becoming Leader. State: Replica: cd75a17ab2604397adab03bb8b5fd75c, State: Running, Role: LEADER
I20260709 13:21:10.537336 13095 raft_consensus.cc:493] T 427c124d773f483294511e80fe340075 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:21:10.568179  6697 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 49623.7us
I20260709 13:21:10.503278 13207 consensus_queue.cc:1059] T f03d0dbf16864ca4bc1bb5e4c0334c0f P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: INVALID_TERM, Last received: 18.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.057s
I20260709 13:21:10.504204 13201 consensus_queue.cc:1059] T 4275cf08e63345f993bce8664eada830 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.050s
I20260709 13:21:10.551296 13076 raft_consensus.cc:697] T 4275cf08e63345f993bce8664eada830 P b7ab4784c7344b939bc36f639286f377 [term 17 LEADER]: Becoming Leader. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
I20260709 13:21:10.502491 13176 raft_consensus.cc:515] T ce4f062dcd314d43a63ca74067cb5ee3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } attrs { replace: true } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:21:10.585389  6805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "853ac0a8cbd64ce99457f170216d4d0f" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
W20260709 13:21:10.593218  6771 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:21:10.543834 13193 consensus_queue.cc:1059] T 7c44c4849aa54f2b94d1f1bef9ed546f P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: INVALID_TERM, Last received: 19.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.036s
I20260709 13:21:10.597035 13201 raft_consensus.cc:3055] T 4275cf08e63345f993bce8664eada830 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:21:10.597543 13201 raft_consensus.cc:740] T 4275cf08e63345f993bce8664eada830 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
I20260709 13:21:10.598531 13201 consensus_queue.cc:260] T 4275cf08e63345f993bce8664eada830 P ccd8a4c3bfe3413cb2ae219b09aea832 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 16.9, Last appended by leader: 9, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:10.543088 12970 raft_consensus.cc:515] T 4f00a2e87e56452083b759f60d461ee3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:21:10.599817 13201 raft_consensus.cc:3060] T 4275cf08e63345f993bce8664eada830 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:21:10.575330 13225 leader_election.cc:290] T 4b8cacb381b746da8d0049b0a83b41dd P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:21:10.622704  6807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3411566abe2d4c9bb4b2adfdd05e6f17" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:21:10.584403 13264 raft_consensus.cc:2804] T 4b8cacb381b746da8d0049b0a83b41dd P cd75a17ab2604397adab03bb8b5fd75c [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:21:10.592934 13030 leader_election.cc:290] T 4d9def8b32fd443aa94ab1420b06837b P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:21:10.555156 12965 raft_consensus.cc:515] T 3411566abe2d4c9bb4b2adfdd05e6f17 P b7ab4784c7344b939bc36f639286f377 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:10.632323 13218 consensus_queue.cc:237] T 95a75bfe094d4bdc963aba3f08dfcd25 P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.9, Last appended by leader: 9, Current term: 16, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } attrs { replace: true } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:21:10.634070 12965 leader_election.cc:290] T 3411566abe2d4c9bb4b2adfdd05e6f17 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:21:10.582726 13095 raft_consensus.cc:515] T 427c124d773f483294511e80fe340075 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } attrs { replace: true } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:21:10.638341  6807 raft_consensus.cc:3060] T 3411566abe2d4c9bb4b2adfdd05e6f17 P b7ab4784c7344b939bc36f639286f377 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:21:10.640229  6804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3022224cc81473690653a83d4e99470" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:21:10.624172  6805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a75bfe094d4bdc963aba3f08dfcd25" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:21:10.617897  6697 leader_election.cc:304] T 853ac0a8cbd64ce99457f170216d4d0f P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:21:10.616720 13249 leader_election.cc:290] T f03d0dbf16864ca4bc1bb5e4c0334c0f P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:21:10.627055 12898 raft_consensus.cc:515] T 8c7f33e544204fbaac4078e3e83bbf4e P b7ab4784c7344b939bc36f639286f377 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:10.594801 13266 raft_consensus.cc:493] T 7a734b5ab7834e05a8c422208acc58b1 P cd75a17ab2604397adab03bb8b5fd75c [term 19 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:21:10.654247  6805 raft_consensus.cc:2393] T 95a75bfe094d4bdc963aba3f08dfcd25 P b7ab4784c7344b939bc36f639286f377 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c in current term 16: Already voted for candidate b7ab4784c7344b939bc36f639286f377 in this term.
I20260709 13:21:10.655285  6874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3411566abe2d4c9bb4b2adfdd05e6f17" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 17 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:21:10.657485 13227 raft_consensus.cc:493] T 9b3759de40694069b13c0f8bd40e5709 P b7ab4784c7344b939bc36f639286f377 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:10.654917 13247 raft_consensus.cc:2749] T 853ac0a8cbd64ce99457f170216d4d0f P ccd8a4c3bfe3413cb2ae219b09aea832 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:21:10.658136 13227 raft_consensus.cc:515] T 9b3759de40694069b13c0f8bd40e5709 P b7ab4784c7344b939bc36f639286f377 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
W20260709 13:21:10.653365 13239 log.cc:927] Time spent T f5be3a11b23d4ea9b08300a2789821c7 P cd75a17ab2604397adab03bb8b5fd75c: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 13:21:10.666209 13266 raft_consensus.cc:515] T 7a734b5ab7834e05a8c422208acc58b1 P cd75a17ab2604397adab03bb8b5fd75c [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } attrs { replace: true } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:21:10.626386 13207 consensus_queue.cc:1048] T 7c37d41cd9164c15a6826ca62a851a69 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.049s
I20260709 13:21:10.626782 13264 raft_consensus.cc:493] T 4b8cacb381b746da8d0049b0a83b41dd P cd75a17ab2604397adab03bb8b5fd75c [term 18 FOLLOWER]: Starting leader election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:21:10.695616 13264 raft_consensus.cc:3060] T 4b8cacb381b746da8d0049b0a83b41dd P cd75a17ab2604397adab03bb8b5fd75c [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:21:10.702927 13255 log.cc:927] Time spent T 9b3759de40694069b13c0f8bd40e5709 P ccd8a4c3bfe3413cb2ae219b09aea832: Append to log took a long time: real 0.441s	user 0.005s	sys 0.000s
W20260709 13:21:10.712167  6773 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:21:10.713891  6773 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:21:10.733048 13221 raft_consensus.cc:493] T 20f6842e26174571996b8dea4151d4be P b7ab4784c7344b939bc36f639286f377 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:10.640426 13076 consensus_queue.cc:237] T 4275cf08e63345f993bce8664eada830 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:10.733721 13221 raft_consensus.cc:515] T 20f6842e26174571996b8dea4151d4be P b7ab4784c7344b939bc36f639286f377 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:10.744822  6803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "404190ce4ce94cecbfcb6ea9d1dd8626" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:21:10.745751  6803 raft_consensus.cc:2468] T 404190ce4ce94cecbfcb6ea9d1dd8626 P b7ab4784c7344b939bc36f639286f377 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in term 16.
W20260709 13:21:10.745935  6697 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 128136us
I20260709 13:21:10.748852  6803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3f13b31a1f84f0d89d007eadd57924c" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:21:10.751547  7466 leader_election.cc:304] T 404190ce4ce94cecbfcb6ea9d1dd8626 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, b7ab4784c7344b939bc36f639286f377; no voters: ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:21:10.754515  6730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b8cacb381b746da8d0049b0a83b41dd" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:21:10.755810  7466 leader_election.cc:304] T b3f13b31a1f84f0d89d007eadd57924c P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:21:10.760918  6772 leader_election.cc:304] T 3d65025eea89441290d85dd053810e31 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:21:10.767262  6772 leader_election.cc:304] T bd6869f07b5a4885a0b99fbe60c3b175 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:21:10.768404  6772 leader_election.cc:304] T e31b9971c15848dea59d4d4130141d9e P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:21:10.779064  6803 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7887766dc6784fcaa42b35c05fea7a99"
dest_uuid: "b7ab4784c7344b939bc36f639286f377"
mode: GRACEFUL
new_leader_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
 from {username='slave'} at 127.0.0.1:38240
I20260709 13:21:10.779882  6803 raft_consensus.cc:606] T 7887766dc6784fcaa42b35c05fea7a99 P b7ab4784c7344b939bc36f639286f377 [term 20 LEADER]: Received request to transfer leadership to TS cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:21:10.782079  6697 leader_election.cc:304] T fe20b4b48823486ca3b9c648db6ce8aa P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:21:10.785619  6872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fa34c08b205435dba97346991aa1f92" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 23 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
W20260709 13:21:10.786130  6695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 257661us
I20260709 13:21:10.792392  6874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3d8792045a4583ae2e965b1350a5b4" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:21:10.793053  6874 raft_consensus.cc:3060] T bb3d8792045a4583ae2e965b1350a5b4 P cd75a17ab2604397adab03bb8b5fd75c [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:21:10.795214  6878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b8cacb381b746da8d0049b0a83b41dd" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:21:10.797851  6804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e31b9971c15848dea59d4d4130141d9e" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:21:10.781989 13027 raft_consensus.cc:2804] T 3d65025eea89441290d85dd053810e31 P b7ab4784c7344b939bc36f639286f377 [term 19 FOLLOWER]: Leader pre-election won for term 20
W20260709 13:21:10.813462  6844 leader_election.cc:336] T 713b5728a197487c9300b310ab94e5a3 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817): Timed out: RequestConsensusVote RPC to 127.5.126.66:42817 timed out after 1.531s (SENT)
I20260709 13:21:10.781222 13249 raft_consensus.cc:493] T ab432e62819d499eaaf3dd55481dd930 P cd75a17ab2604397adab03bb8b5fd75c [term 20 FOLLOWER]: Starting pre-election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:21:10.815791  6844 leader_election.cc:304] T 713b5728a197487c9300b310ab94e5a3 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
W20260709 13:21:10.815073  7466 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 56957.7us
I20260709 13:21:10.788890 13211 leader_election.cc:290] T bb3d8792045a4583ae2e965b1350a5b4 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:21:10.787642 13030 raft_consensus.cc:493] T 9b3759de40694069b13c0f8bd40e5709 P cd75a17ab2604397adab03bb8b5fd75c [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:21:10.797627 13271 log.cc:927] Time spent T c4db81d9d329422bb3b4160ca4ac2d1d P ccd8a4c3bfe3413cb2ae219b09aea832: Append to log took a long time: real 0.083s	user 0.001s	sys 0.000s
I20260709 13:21:10.820385  6803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7887766dc6784fcaa42b35c05fea7a99" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 21 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:21:10.766196 12704 consensus_queue.cc:1048] T bb3d8792045a4583ae2e965b1350a5b4 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.043s
I20260709 13:21:10.847194  6874 raft_consensus.cc:2468] T bb3d8792045a4583ae2e965b1350a5b4 P cd75a17ab2604397adab03bb8b5fd75c [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in term 18.
I20260709 13:21:10.849013  6799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f00a2e87e56452083b759f60d461ee3" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:21:10.813133 13257 raft_consensus.cc:2804] T 404190ce4ce94cecbfcb6ea9d1dd8626 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:21:10.817939 13027 raft_consensus.cc:493] T 3d65025eea89441290d85dd053810e31 P b7ab4784c7344b939bc36f639286f377 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:10.813423 12863 raft_consensus.cc:2749] T fe20b4b48823486ca3b9c648db6ce8aa P ccd8a4c3bfe3413cb2ae219b09aea832 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:21:10.799849 13247 consensus_queue.cc:1059] T f03d0dbf16864ca4bc1bb5e4c0334c0f P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: INVALID_TERM, Last received: 18.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.047s
I20260709 13:21:10.862668  6803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1704639a875409b9959353527b3fd68" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 20 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
W20260709 13:21:10.857787  6772 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 89478us
I20260709 13:21:10.821352 13225 raft_consensus.cc:2749] T b3f13b31a1f84f0d89d007eadd57924c P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:21:10.864977  7468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 66640.8us
W20260709 13:21:10.871184  6773 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:21:10.876791  7498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3d8792045a4583ae2e965b1350a5b4" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:21:10.879959  6803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce4f062dcd314d43a63ca74067cb5ee3" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:21:10.860316 13027 raft_consensus.cc:3060] T 3d65025eea89441290d85dd053810e31 P b7ab4784c7344b939bc36f639286f377 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:21:10.856670 13257 raft_consensus.cc:493] T 404190ce4ce94cecbfcb6ea9d1dd8626 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:10.878274  6772 leader_election.cc:304] T 7c37d41cd9164c15a6826ca62a851a69 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:21:10.822264 13249 raft_consensus.cc:515] T ab432e62819d499eaaf3dd55481dd930 P cd75a17ab2604397adab03bb8b5fd75c [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:10.848392 13267 raft_consensus.cc:2749] T 713b5728a197487c9300b310ab94e5a3 P cd75a17ab2604397adab03bb8b5fd75c [term 16 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:21:10.885434  7498 raft_consensus.cc:2393] T bb3d8792045a4583ae2e965b1350a5b4 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c in current term 18: Already voted for candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in this term.
W20260709 13:21:10.912088  6695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 91385.7us
I20260709 13:21:10.867161 13227 leader_election.cc:290] T 9b3759de40694069b13c0f8bd40e5709 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:21:10.931883  6695 leader_election.cc:304] T c4db81d9d329422bb3b4160ca4ac2d1d P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
I20260709 13:21:10.848470 13030 raft_consensus.cc:515] T 9b3759de40694069b13c0f8bd40e5709 P cd75a17ab2604397adab03bb8b5fd75c [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
W20260709 13:21:10.930084  6697 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 148084us
W20260709 13:21:10.934909  6696 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:21:10.849628 13273 consensus_queue.cc:1048] T be1a92657f494cac8dd227d152f50151 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.084s
W20260709 13:21:10.947161  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 148952us
I20260709 13:21:10.875944 13247 consensus_queue.cc:1243] T f03d0dbf16864ca4bc1bb5e4c0334c0f P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Peer b7ab4784c7344b939bc36f639286f377 log is divergent from this leader: its last log entry 19.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
I20260709 13:21:10.952327  6803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c44c4849aa54f2b94d1f1bef9ed546f" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:21:10.957167  6873 raft_consensus.cc:1240] T 853ac0a8cbd64ce99457f170216d4d0f P cd75a17ab2604397adab03bb8b5fd75c [term 15 LEADER]: Rejecting Update request from peer b7ab4784c7344b939bc36f639286f377 for earlier term 14. Current term is 15. Ops: []
I20260709 13:21:10.922792 13257 raft_consensus.cc:3060] T 404190ce4ce94cecbfcb6ea9d1dd8626 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:21:10.874339 13217 consensus_queue.cc:1048] T 404190ce4ce94cecbfcb6ea9d1dd8626 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.067s
I20260709 13:21:10.966429  6803 raft_consensus.cc:2393] T 7c44c4849aa54f2b94d1f1bef9ed546f P b7ab4784c7344b939bc36f639286f377 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c in current term 20: Already voted for candidate b7ab4784c7344b939bc36f639286f377 in this term.
I20260709 13:21:10.931357 12970 leader_election.cc:290] T 4f00a2e87e56452083b759f60d461ee3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:21:10.971122  6806 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a1704639a875409b9959353527b3fd68"
dest_uuid: "b7ab4784c7344b939bc36f639286f377"
mode: GRACEFUL
new_leader_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
 from {username='slave'} at 127.0.0.1:38240
I20260709 13:21:10.985885  6806 raft_consensus.cc:606] T a1704639a875409b9959353527b3fd68 P b7ab4784c7344b939bc36f639286f377 [term 19 LEADER]: Received request to transfer leadership to TS cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:21:10.971617 13266 leader_election.cc:290] T 7a734b5ab7834e05a8c422208acc58b1 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:21:10.972502  6798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d33d5ee8ef6f415593d8df52063161ad" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:21:10.936703 13221 leader_election.cc:290] T 20f6842e26174571996b8dea4151d4be P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:21:10.946184 13207 raft_consensus.cc:2804] T c4db81d9d329422bb3b4160ca4ac2d1d P ccd8a4c3bfe3413cb2ae219b09aea832 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:21:10.977103 13095 leader_election.cc:290] T 427c124d773f483294511e80fe340075 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:21:10.981062 13027 raft_consensus.cc:515] T 3d65025eea89441290d85dd053810e31 P b7ab4784c7344b939bc36f639286f377 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:10.949087 13225 raft_consensus.cc:493] T bb7fa124c3bf4ef9ab65a407cb008441 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 18 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:21:10.992020  6724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "427c124d773f483294511e80fe340075" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:21:10.964179 13076 raft_consensus.cc:2804] T 7c37d41cd9164c15a6826ca62a851a69 P b7ab4784c7344b939bc36f639286f377 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:21:11.005448  7495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a734b5ab7834e05a8c422208acc58b1" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:21:10.988880 13176 leader_election.cc:290] T ce4f062dcd314d43a63ca74067cb5ee3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:21:11.043270  7495 raft_consensus.cc:2468] T 7a734b5ab7834e05a8c422208acc58b1 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 19.
I20260709 13:21:11.008227  6804 raft_consensus.cc:2468] T e31b9971c15848dea59d4d4130141d9e P b7ab4784c7344b939bc36f639286f377 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 16.
I20260709 13:21:11.011157  6726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3d8792045a4583ae2e965b1350a5b4" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:21:11.046573  6726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4275cf08e63345f993bce8664eada830" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:21:11.012528  6806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6869f07b5a4885a0b99fbe60c3b175" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 20 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
W20260709 13:21:11.013074 13016 consensus_meta.cc:287] T be1a92657f494cac8dd227d152f50151 P 7ba59cc884714e8aa5f3f0ecaed84cbb: Time spent flushing consensus metadata: real 0.754s	user 0.020s	sys 0.002s
I20260709 13:21:11.013950  6732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d9def8b32fd443aa94ab1420b06837b" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 20 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:21:11.014956  6730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6869f07b5a4885a0b99fbe60c3b175" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 20 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:21:11.017437  6728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f03d0dbf16864ca4bc1bb5e4c0334c0f" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 20 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:21:11.018132  6729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce4f062dcd314d43a63ca74067cb5ee3" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
W20260709 13:21:11.021819 13280 log.cc:927] Time spent T 17587d6730594da4a56fa13a353232a1 P 7ba59cc884714e8aa5f3f0ecaed84cbb: Append to log took a long time: real 0.110s	user 0.001s	sys 0.000s
W20260709 13:21:11.026172  6844 leader_election.cc:336] T 711ef6523deb4cbe8ef2ba61e1c21c98 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 20 election: RPC error from VoteRequest() call to peer b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817): Timed out: RequestConsensusVote RPC to 127.5.126.66:42817 timed out after 1.702s (SENT)
I20260709 13:21:10.998060  6803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8292e16e5654be6bc408560cf256aaa" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:21:11.053828  6844 leader_election.cc:304] T 711ef6523deb4cbe8ef2ba61e1c21c98 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
W20260709 13:21:11.024461  6772 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 103617us
I20260709 13:21:10.969080 12898 leader_election.cc:290] T 8c7f33e544204fbaac4078e3e83bbf4e P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 16 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
W20260709 13:21:10.993099 13022 consensus_meta.cc:287] T 44bde925b2e541b69890d70715b85176 P cd75a17ab2604397adab03bb8b5fd75c: Time spent flushing consensus metadata: real 0.731s	user 0.016s	sys 0.003s
I20260709 13:21:11.033999  6798 raft_consensus.cc:2468] T d33d5ee8ef6f415593d8df52063161ad P b7ab4784c7344b939bc36f639286f377 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 16.
I20260709 13:21:11.026206  6697 leader_election.cc:304] T 713b5728a197487c9300b310ab94e5a3 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377
W20260709 13:21:11.004282 13233 consensus_meta.cc:287] T 3fa34c08b205435dba97346991aa1f92 P 7ba59cc884714e8aa5f3f0ecaed84cbb: Time spent flushing consensus metadata: real 0.663s	user 0.010s	sys 0.006s
W20260709 13:21:11.004325 13242 consensus_meta.cc:287] T 3fa34c08b205435dba97346991aa1f92 P cd75a17ab2604397adab03bb8b5fd75c: Time spent flushing consensus metadata: real 0.661s	user 0.016s	sys 0.003s
W20260709 13:21:11.022768 13122 consensus_meta.cc:287] T 07a92dd554674067a83a9cb68c4773f2 P b7ab4784c7344b939bc36f639286f377: Time spent flushing consensus metadata: real 0.650s	user 0.012s	sys 0.003s
I20260709 13:21:11.049947  6723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6869f07b5a4885a0b99fbe60c3b175" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 20 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
W20260709 13:21:11.053836  6695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 99768.6us
I20260709 13:21:11.057565  6731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c7f33e544204fbaac4078e3e83bbf4e" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:21:11.096674  6731 raft_consensus.cc:2468] T 8c7f33e544204fbaac4078e3e83bbf4e P ccd8a4c3bfe3413cb2ae219b09aea832 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 15.
I20260709 13:21:11.058542  6804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f03d0dbf16864ca4bc1bb5e4c0334c0f" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 20 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
W20260709 13:21:11.099579  6801 consensus_meta.cc:287] T 711ef6523deb4cbe8ef2ba61e1c21c98 P b7ab4784c7344b939bc36f639286f377: Time spent flushing consensus metadata: real 0.552s	user 0.009s	sys 0.009s
I20260709 13:21:11.099682  6800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20f6842e26174571996b8dea4151d4be" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:21:11.099990  6801 raft_consensus.cc:2468] T 711ef6523deb4cbe8ef2ba61e1c21c98 P b7ab4784c7344b939bc36f639286f377 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 21.
I20260709 13:21:11.100572  6800 raft_consensus.cc:2410] T 20f6842e26174571996b8dea4151d4be P b7ab4784c7344b939bc36f639286f377 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c for term 19 because replica has last-logged OpId of term: 18 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 10.
I20260709 13:21:11.089804 13022 raft_consensus.cc:2749] T 44bde925b2e541b69890d70715b85176 P cd75a17ab2604397adab03bb8b5fd75c [term 19 FOLLOWER]: Leader election lost for term 18. Reason: Vote denied by peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391) with higher term. Message: Invalid argument: T 44bde925b2e541b69890d70715b85176 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c for earlier term 18. Current term is 19.
I20260709 13:21:11.052484 12965 raft_consensus.cc:2804] T e31b9971c15848dea59d4d4130141d9e P b7ab4784c7344b939bc36f639286f377 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:21:11.061631 13264 raft_consensus.cc:515] T 4b8cacb381b746da8d0049b0a83b41dd P cd75a17ab2604397adab03bb8b5fd75c [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:21:11.120980  6806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "427c124d773f483294511e80fe340075" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:21:11.122004  6806 raft_consensus.cc:2468] T 427c124d773f483294511e80fe340075 P b7ab4784c7344b939bc36f639286f377 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in term 16.
I20260709 13:21:11.051355  6724 raft_consensus.cc:2468] T 427c124d773f483294511e80fe340075 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in term 17.
I20260709 13:21:11.064355  6730 raft_consensus.cc:2393] T bd6869f07b5a4885a0b99fbe60c3b175 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c in current term 20: Already voted for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in this term.
I20260709 13:21:11.052870  6725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3022224cc81473690653a83d4e99470" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:21:11.063985  6729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d65025eea89441290d85dd053810e31" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:21:10.989245 13247 consensus_queue.cc:1048] T 9b3759de40694069b13c0f8bd40e5709 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.056s
I20260709 13:21:11.085150  6803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d9def8b32fd443aa94ab1420b06837b" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 20 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
W20260709 13:21:11.086385  6802 consensus_meta.cc:287] T bd6869f07b5a4885a0b99fbe60c3b175 P b7ab4784c7344b939bc36f639286f377: Time spent flushing consensus metadata: real 0.596s	user 0.007s	sys 0.014s
I20260709 13:21:11.037132 13207 raft_consensus.cc:493] T c4db81d9d329422bb3b4160ca4ac2d1d P ccd8a4c3bfe3413cb2ae219b09aea832 [term 18 FOLLOWER]: Starting leader election (detected failure of leader cd75a17ab2604397adab03bb8b5fd75c)
I20260709 13:21:11.087272  6728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a92dd554674067a83a9cb68c4773f2" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
W20260709 13:21:11.092963  6697 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 66824.9us
I20260709 13:21:11.058701  6807 raft_consensus.cc:2468] T 3411566abe2d4c9bb4b2adfdd05e6f17 P b7ab4784c7344b939bc36f639286f377 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 17.
I20260709 13:21:11.126346  6725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e31b9971c15848dea59d4d4130141d9e" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:21:11.117919  6798 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ce4f062dcd314d43a63ca74067cb5ee3"
dest_uuid: "b7ab4784c7344b939bc36f639286f377"
mode: GRACEFUL
new_leader_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
 from {username='slave'} at 127.0.0.1:38240
I20260709 13:21:11.127197  6798 raft_consensus.cc:606] T ce4f062dcd314d43a63ca74067cb5ee3 P b7ab4784c7344b939bc36f639286f377 [term 15 LEADER]: Received request to transfer leadership to TS cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:21:11.051437  6732 raft_consensus.cc:2468] T 4d9def8b32fd443aa94ab1420b06837b P ccd8a4c3bfe3413cb2ae219b09aea832 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 19.
W20260709 13:21:11.121230  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 130795us
I20260709 13:21:11.124742  6802 raft_consensus.cc:2468] T bd6869f07b5a4885a0b99fbe60c3b175 P b7ab4784c7344b939bc36f639286f377 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 20.
I20260709 13:21:11.071331 13076 raft_consensus.cc:697] T 7c37d41cd9164c15a6826ca62a851a69 P b7ab4784c7344b939bc36f639286f377 [term 19 LEADER]: Becoming Leader. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
W20260709 13:21:11.129105  6844 leader_election.cc:336] T de3186201e1a40d0b335eeb8b4e256e0 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817): Timed out: RequestConsensusVote RPC to 127.5.126.66:42817 timed out after 1.715s (SENT)
I20260709 13:21:11.131047  6724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c37d41cd9164c15a6826ca62a851a69" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
W20260709 13:21:11.115355 13180 consensus_meta.cc:287] T ab432e62819d499eaaf3dd55481dd930 P ccd8a4c3bfe3413cb2ae219b09aea832: Time spent flushing consensus metadata: real 0.781s	user 0.013s	sys 0.011s
I20260709 13:21:11.126971  6725 raft_consensus.cc:2468] T e31b9971c15848dea59d4d4130141d9e P ccd8a4c3bfe3413cb2ae219b09aea832 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 16.
I20260709 13:21:11.095423 13263 raft_consensus.cc:2749] T 711ef6523deb4cbe8ef2ba61e1c21c98 P cd75a17ab2604397adab03bb8b5fd75c [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:21:11.099272 12704 raft_consensus.cc:2804] T 713b5728a197487c9300b310ab94e5a3 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:21:11.142895  6770 leader_election.cc:304] T 1bf4668eeb70467fb3dc5a0289233b3c P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:21:11.138500  6729 raft_consensus.cc:2468] T 3d65025eea89441290d85dd053810e31 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 19.
I20260709 13:21:11.051792 13225 raft_consensus.cc:515] T bb7fa124c3bf4ef9ab65a407cb008441 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:21:11.135636  6695 leader_election.cc:304] T 711ef6523deb4cbe8ef2ba61e1c21c98 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
I20260709 13:21:11.144874  6724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b3759de40694069b13c0f8bd40e5709" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 17 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:21:11.147495  6874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4b8bd455d5a47c18a1380839c6e0d61" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:21:11.064323 13016 raft_consensus.cc:515] T be1a92657f494cac8dd227d152f50151 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:21:11.130041 13222 raft_consensus.cc:2764] T bd6869f07b5a4885a0b99fbe60c3b175 P b7ab4784c7344b939bc36f639286f377 [term 20 FOLLOWER]: Leader pre-election decision vote started in defunct term 19: won
I20260709 13:21:11.095546 13233 raft_consensus.cc:515] T 3fa34c08b205435dba97346991aa1f92 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 23 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:21:11.104756 13122 raft_consensus.cc:515] T 07a92dd554674067a83a9cb68c4773f2 P b7ab4784c7344b939bc36f639286f377 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:11.176402  6729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c7f33e544204fbaac4078e3e83bbf4e" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:21:11.177129  6729 raft_consensus.cc:3060] T 8c7f33e544204fbaac4078e3e83bbf4e P ccd8a4c3bfe3413cb2ae219b09aea832 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:21:11.178228  7495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fa34c08b205435dba97346991aa1f92" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb"
I20260709 13:21:11.178519  6874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90d42e216d9741e190bca19a781291fd" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:21:11.158835  6878 raft_consensus.cc:2393] T 4b8cacb381b746da8d0049b0a83b41dd P cd75a17ab2604397adab03bb8b5fd75c [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in current term 19: Already voted for candidate cd75a17ab2604397adab03bb8b5fd75c in this term.
I20260709 13:21:11.175652  6876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44bde925b2e541b69890d70715b85176" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:21:11.181156  6876 raft_consensus.cc:2468] T 44bde925b2e541b69890d70715b85176 P cd75a17ab2604397adab03bb8b5fd75c [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 19.
I20260709 13:21:11.160766 13180 raft_consensus.cc:2804] T 711ef6523deb4cbe8ef2ba61e1c21c98 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:21:11.156641  6881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fa34c08b205435dba97346991aa1f92" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:21:11.128013 13207 raft_consensus.cc:3060] T c4db81d9d329422bb3b4160ca4ac2d1d P ccd8a4c3bfe3413cb2ae219b09aea832 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:21:11.160969  6731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20f6842e26174571996b8dea4151d4be" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:21:11.163852  6732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09c2a98de1a4decabd0ff900dd44caa" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
W20260709 13:21:11.164259 13282 log.cc:927] Time spent T a1704639a875409b9959353527b3fd68 P b7ab4784c7344b939bc36f639286f377: Append to log took a long time: real 0.228s	user 0.000s	sys 0.001s
I20260709 13:21:11.158018  6724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3411566abe2d4c9bb4b2adfdd05e6f17" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 17 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
W20260709 13:21:11.172242  6771 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:21:11.177970 13281 log.cc:927] Time spent T 17587d6730594da4a56fa13a353232a1 P b7ab4784c7344b939bc36f639286f377: Append to log took a long time: real 0.069s	user 0.001s	sys 0.000s
I20260709 13:21:11.196730  7498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24ee15416e3145beaa1b8183453729a3" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:21:11.197482  6724 raft_consensus.cc:2393] T 3411566abe2d4c9bb4b2adfdd05e6f17 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7ab4784c7344b939bc36f639286f377 in current term 17: Already voted for candidate cd75a17ab2604397adab03bb8b5fd75c in this term.
W20260709 13:21:11.200017 13285 log.cc:927] Time spent T 7887766dc6784fcaa42b35c05fea7a99 P cd75a17ab2604397adab03bb8b5fd75c: Append to log took a long time: real 0.177s	user 0.000s	sys 0.001s
I20260709 13:21:11.200749  6875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44bde925b2e541b69890d70715b85176" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:21:11.186664  6731 raft_consensus.cc:2468] T 20f6842e26174571996b8dea4151d4be P ccd8a4c3bfe3413cb2ae219b09aea832 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 19.
I20260709 13:21:11.103248 13242 raft_consensus.cc:515] T 3fa34c08b205435dba97346991aa1f92 P cd75a17ab2604397adab03bb8b5fd75c [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:21:11.189355  7494 raft_consensus.cc:1240] T bb3d8792045a4583ae2e965b1350a5b4 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 18 FOLLOWER]: Rejecting Update request from peer ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 17. Current term is 18. Ops: [17.15-17.15]
I20260709 13:21:11.190866  6879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24ee15416e3145beaa1b8183453729a3" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:21:11.140491 13217 consensus_queue.cc:1048] T 44bde925b2e541b69890d70715b85176 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.039s
I20260709 13:21:11.192955 13288 raft_consensus.cc:493] T dbdf895bba214ff68685a24fd17dfb5d P b7ab4784c7344b939bc36f639286f377 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:21:11.193809 13201 consensus_meta.cc:287] T 4275cf08e63345f993bce8664eada830 P ccd8a4c3bfe3413cb2ae219b09aea832: Time spent flushing consensus metadata: real 0.568s	user 0.010s	sys 0.006s
W20260709 13:21:11.208915  6697 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:21:11.215939  7495 raft_consensus.cc:2368] T 3fa34c08b205435dba97346991aa1f92 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 22. Current term is 23.
I20260709 13:21:11.217068  6727 raft_consensus.cc:1275] T 7887766dc6784fcaa42b35c05fea7a99 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 20 FOLLOWER]: Refusing update from remote peer b7ab4784c7344b939bc36f639286f377: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 20 index: 11. (index mismatch)
I20260709 13:21:11.221446  6726 raft_consensus.cc:2410] T 4275cf08e63345f993bce8664eada830 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate b7ab4784c7344b939bc36f639286f377 for term 17 because replica has last-logged OpId of term: 16 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 8.
I20260709 13:21:11.229300  6732 raft_consensus.cc:1275] T 4d9def8b32fd443aa94ab1420b06837b P ccd8a4c3bfe3413cb2ae219b09aea832 [term 19 FOLLOWER]: Refusing update from remote peer b7ab4784c7344b939bc36f639286f377: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 17 index: 9. (index mismatch)
W20260709 13:21:11.229764  6844 leader_election.cc:336] T 2c240553ce044eedb41541d72b9475d7 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817): Timed out: RequestConsensusVote RPC to 127.5.126.66:42817 timed out after 1.818s (SENT)
I20260709 13:21:11.229977  7494 raft_consensus.cc:1240] T be1a92657f494cac8dd227d152f50151 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 21 FOLLOWER]: Rejecting Update request from peer ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 20. Current term is 21. Ops: []
W20260709 13:21:11.230628  6772 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 44608.2us
I20260709 13:21:11.233474  6876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e326172347f45e99a0d482b5d8ef768" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:21:11.234212  6876 raft_consensus.cc:2468] T 9e326172347f45e99a0d482b5d8ef768 P cd75a17ab2604397adab03bb8b5fd75c [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 14.
I20260709 13:21:11.161085 13290 consensus_queue.cc:1059] T a3022224cc81473690653a83d4e99470 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: INVALID_TERM, Last received: 19.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.075s
I20260709 13:21:11.237342  6879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20f6842e26174571996b8dea4151d4be" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:21:11.197603 13225 leader_election.cc:290] T bb7fa124c3bf4ef9ab65a407cb008441 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:21:11.237393  6881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f58dc08b12a2494bb9a1372837970ca2" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:21:11.188279 13030 leader_election.cc:290] T 9b3759de40694069b13c0f8bd40e5709 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:21:11.238046  6872 raft_consensus.cc:2468] T 3fa34c08b205435dba97346991aa1f92 P cd75a17ab2604397adab03bb8b5fd75c [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in term 22.
W20260709 13:21:11.241691  6844 leader_election.cc:336] T 4f00a2e87e56452083b759f60d461ee3 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817): Timed out: RequestConsensusVote RPC to 127.5.126.66:42817 timed out after 2.071s (SENT)
I20260709 13:21:11.216560 13180 raft_consensus.cc:697] T 711ef6523deb4cbe8ef2ba61e1c21c98 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 21 LEADER]: Becoming Leader. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
I20260709 13:21:11.255347  6879 raft_consensus.cc:2393] T 20f6842e26174571996b8dea4151d4be P cd75a17ab2604397adab03bb8b5fd75c [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate ccd8a4c3bfe3413cb2ae219b09aea832 in current term 19: Already voted for candidate cd75a17ab2604397adab03bb8b5fd75c in this term.
I20260709 13:21:11.261297  7494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b8cacb381b746da8d0049b0a83b41dd" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb"
I20260709 13:21:11.222390 12704 raft_consensus.cc:697] T 713b5728a197487c9300b310ab94e5a3 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 16 LEADER]: Becoming Leader. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
I20260709 13:21:11.264130  6844 leader_election.cc:304] T 4f00a2e87e56452083b759f60d461ee3 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, b7ab4784c7344b939bc36f639286f377
I20260709 13:21:11.266696  6732 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d8292e16e5654be6bc408560cf256aaa"
dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
mode: GRACEFUL
new_leader_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
 from {username='slave'} at 127.0.0.1:38536
I20260709 13:21:11.267544  6732 raft_consensus.cc:606] T d8292e16e5654be6bc408560cf256aaa P ccd8a4c3bfe3413cb2ae219b09aea832 [term 17 LEADER]: Received request to transfer leadership to TS cd75a17ab2604397adab03bb8b5fd75c
W20260709 13:21:11.269572 13296 log.cc:927] Time spent T 7ba5dac66ab5497e9e336f2a3c28cda5 P cd75a17ab2604397adab03bb8b5fd75c: Append to log took a long time: real 0.096s	user 0.001s	sys 0.000s
I20260709 13:21:11.273165  6876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a485a995abc4807b6e511e45419f737" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:21:11.279601  7466 leader_election.cc:304] T ce4f062dcd314d43a63ca74067cb5ee3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:21:11.279865  6880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "711ef6523deb4cbe8ef2ba61e1c21c98" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:21:11.280655  6880 raft_consensus.cc:3060] T 711ef6523deb4cbe8ef2ba61e1c21c98 P cd75a17ab2604397adab03bb8b5fd75c [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:21:11.280692 13225 raft_consensus.cc:2749] T ce4f062dcd314d43a63ca74067cb5ee3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:21:11.258189  6697 leader_election.cc:304] T f4b8bd455d5a47c18a1380839c6e0d61 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:21:11.277930  6875 raft_consensus.cc:2468] T 44bde925b2e541b69890d70715b85176 P cd75a17ab2604397adab03bb8b5fd75c [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 19.
I20260709 13:21:11.282063  7466 leader_election.cc:304] T 427c124d773f483294511e80fe340075 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
I20260709 13:21:11.240826 13016 leader_election.cc:290] T be1a92657f494cac8dd227d152f50151 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 21 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:21:11.243623 13233 leader_election.cc:290] T 3fa34c08b205435dba97346991aa1f92 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 23 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:21:11.284058 13225 raft_consensus.cc:2804] T 427c124d773f483294511e80fe340075 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:21:11.284677 13225 raft_consensus.cc:493] T 427c124d773f483294511e80fe340075 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:11.242295 13122 leader_election.cc:290] T 07a92dd554674067a83a9cb68c4773f2 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 17 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:21:11.281821 12704 consensus_queue.cc:237] T 713b5728a197487c9300b310ab94e5a3 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:11.284991  6879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f9c2e2bf644115957398fe4c9459db" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:21:11.285064 13225 raft_consensus.cc:3060] T 427c124d773f483294511e80fe340075 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:21:11.232964 13288 raft_consensus.cc:515] T dbdf895bba214ff68685a24fd17dfb5d P b7ab4784c7344b939bc36f639286f377 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
W20260709 13:21:11.254943 13223 consensus_meta.cc:287] T f09c2a98de1a4decabd0ff900dd44caa P b7ab4784c7344b939bc36f639286f377: Time spent flushing consensus metadata: real 0.670s	user 0.015s	sys 0.003s
I20260709 13:21:11.286546  6879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1704639a875409b9959353527b3fd68" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 20 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:21:11.300899  6875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5be3a11b23d4ea9b08300a2789821c7" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:21:11.254124 13076 consensus_queue.cc:237] T 7c37d41cd9164c15a6826ca62a851a69 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.13, Last appended by leader: 13, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:11.287357  6876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4db81d9d329422bb3b4160ca4ac2d1d" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:21:11.300911 13180 consensus_queue.cc:237] T 711ef6523deb4cbe8ef2ba61e1c21c98 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.11, Last appended by leader: 11, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:11.239082 13026 raft_consensus.cc:2749] T 1bf4668eeb70467fb3dc5a0289233b3c P b7ab4784c7344b939bc36f639286f377 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:21:11.289175 13247 raft_consensus.cc:3055] T a3022224cc81473690653a83d4e99470 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:21:11.325102  6881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6869f07b5a4885a0b99fbe60c3b175" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 20 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:21:11.348346  6881 raft_consensus.cc:3060] T bd6869f07b5a4885a0b99fbe60c3b175 P cd75a17ab2604397adab03bb8b5fd75c [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:21:11.348989  6878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20f6842e26174571996b8dea4151d4be" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:21:11.350756  6878 raft_consensus.cc:2468] T 20f6842e26174571996b8dea4151d4be P cd75a17ab2604397adab03bb8b5fd75c [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 19.
I20260709 13:21:11.290274  6799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb7fa124c3bf4ef9ab65a407cb008441" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:21:11.299304  6801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be1a92657f494cac8dd227d152f50151" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:21:11.337845  6876 raft_consensus.cc:1240] T bb3d8792045a4583ae2e965b1350a5b4 P cd75a17ab2604397adab03bb8b5fd75c [term 18 FOLLOWER]: Rejecting Update request from peer ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 17. Current term is 18. Ops: [17.15-17.15]
I20260709 13:21:11.340003  6873 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53406 (request call id 2990) took 1065 ms. Trace:
I20260709 13:21:11.355599  6880 raft_consensus.cc:2468] T 711ef6523deb4cbe8ef2ba61e1c21c98 P cd75a17ab2604397adab03bb8b5fd75c [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 21.
I20260709 13:21:11.343178  6875 raft_consensus.cc:1240] T f03d0dbf16864ca4bc1bb5e4c0334c0f P cd75a17ab2604397adab03bb8b5fd75c [term 19 FOLLOWER]: Rejecting Update request from peer ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 18. Current term is 19. Ops: []
I20260709 13:21:11.344990  7503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fa34c08b205435dba97346991aa1f92" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb"
I20260709 13:21:11.344553  6726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fa34c08b205435dba97346991aa1f92" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 23 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:21:11.359302  7503 raft_consensus.cc:2368] T 3fa34c08b205435dba97346991aa1f92 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c for earlier term 22. Current term is 23.
I20260709 13:21:11.359565  6726 raft_consensus.cc:3060] T 3fa34c08b205435dba97346991aa1f92 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 22 FOLLOWER]: Advancing to term 23
W20260709 13:21:11.346647  6772 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.68:45071, user_credentials={real_user=slave}} blocked reactor thread for 71641.5us
I20260709 13:21:11.331197  6879 raft_consensus.cc:1240] T 7c37d41cd9164c15a6826ca62a851a69 P cd75a17ab2604397adab03bb8b5fd75c [term 19 FOLLOWER]: Rejecting Update request from peer ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 18. Current term is 19. Ops: [16.12-18.13]
I20260709 13:21:11.339510  6877 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53406 (request call id 2985) took 1097 ms. Trace:
W20260709 13:21:11.339745  6697 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 81690us
I20260709 13:21:11.340569  6730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be1a92657f494cac8dd227d152f50151" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:21:11.356894  6873 rpcz_store.cc:276] 0709 13:21:10.274430 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:21:10.274693 (+   263us) service_pool.cc:224] Handling call
0709 13:21:10.286485 (+ 11792us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:21:10.957764 (+671279us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:21:11.339762 (+381998us) spinlock_profiling.cc:243] Waited 670 ms on lock 0x7b54000a6ed4. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f9aae01 00007fcc0f9a983e 00007fcc1496e419 00007fcc0dee5bd4 00007fcc0dee5b62 00007fcc0dee5a91 00007fcc0dee5a0c 00007fcc0dee4cc2 00007fcc0dce548c 00007fcc0dce48c6
0709 13:21:11.339944 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1541840640}
I20260709 13:21:11.342859  6729 raft_consensus.cc:2468] T 8c7f33e544204fbaac4078e3e83bbf4e P ccd8a4c3bfe3413cb2ae219b09aea832 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 16.
I20260709 13:21:11.368883  6878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c7f33e544204fbaac4078e3e83bbf4e" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:21:11.369457  6878 raft_consensus.cc:3060] T 8c7f33e544204fbaac4078e3e83bbf4e P cd75a17ab2604397adab03bb8b5fd75c [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:21:11.350907  6874 raft_consensus.cc:1240] T 4275cf08e63345f993bce8664eada830 P cd75a17ab2604397adab03bb8b5fd75c [term 17 FOLLOWER]: Rejecting Update request from peer ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 16. Current term is 17. Ops: [16.9-16.9]
W20260709 13:21:11.313555 13302 log.cc:927] Time spent T 4f00a2e87e56452083b759f60d461ee3 P 7ba59cc884714e8aa5f3f0ecaed84cbb: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260709 13:21:11.371968  6874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a92dd554674067a83a9cb68c4773f2" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:21:11.378328  6874 raft_consensus.cc:1275] T ce4f062dcd314d43a63ca74067cb5ee3 P cd75a17ab2604397adab03bb8b5fd75c [term 15 FOLLOWER]: Refusing update from remote peer b7ab4784c7344b939bc36f639286f377: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:21:11.334008 13223 raft_consensus.cc:515] T f09c2a98de1a4decabd0ff900dd44caa P b7ab4784c7344b939bc36f639286f377 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:11.384016  6879 raft_consensus.cc:1275] T 4d9def8b32fd443aa94ab1420b06837b P cd75a17ab2604397adab03bb8b5fd75c [term 19 FOLLOWER]: Refusing update from remote peer b7ab4784c7344b939bc36f639286f377: Log matching property violated. Preceding OpId in replica: term: 17 index: 9. Preceding OpId from leader: term: 19 index: 10. (index mismatch)
I20260709 13:21:11.325742 13205 raft_consensus.cc:3055] T f03d0dbf16864ca4bc1bb5e4c0334c0f P ccd8a4c3bfe3413cb2ae219b09aea832 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:21:11.320097 12965 raft_consensus.cc:493] T e31b9971c15848dea59d4d4130141d9e P b7ab4784c7344b939bc36f639286f377 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:21:11.308758 13287 log.cc:927] Time spent T d8cee0accdb8499c86d4414b72565a38 P cd75a17ab2604397adab03bb8b5fd75c: Append to log took a long time: real 0.334s	user 0.002s	sys 0.000s
I20260709 13:21:11.374984  7495 raft_consensus.cc:1275] T ce4f062dcd314d43a63ca74067cb5ee3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 15 FOLLOWER]: Refusing update from remote peer b7ab4784c7344b939bc36f639286f377: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:21:11.394099  6697 leader_election.cc:400] T 3fa34c08b205435dba97346991aa1f92 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 22 election: Vote denied by peer 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071) with higher term. Message: Invalid argument: T 3fa34c08b205435dba97346991aa1f92 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 22. Current term is 23.
I20260709 13:21:11.394456  6697 leader_election.cc:403] T 3fa34c08b205435dba97346991aa1f92 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 22 election: Cancelling election due to peer responding with higher term
I20260709 13:21:11.315193 13249 leader_election.cc:290] T ab432e62819d499eaaf3dd55481dd930 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:21:11.338315 13188 raft_consensus.cc:493] T 22ccee1b570c4ad3a57bd7aec085b1b4 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:21:11.340773 13247 raft_consensus.cc:740] T a3022224cc81473690653a83d4e99470 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
I20260709 13:21:11.340191 13304 raft_consensus.cc:2749] T f4b8bd455d5a47c18a1380839c6e0d61 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:21:11.311545 13242 leader_election.cc:290] T 3fa34c08b205435dba97346991aa1f92 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 22 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:21:11.343935 13264 leader_election.cc:290] T 4b8cacb381b746da8d0049b0a83b41dd P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 19 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
W20260709 13:21:11.392503  6770 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 249671us
I20260709 13:21:11.310225 13027 leader_election.cc:290] T 3d65025eea89441290d85dd053810e31 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 20 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:21:11.328126 13202 raft_consensus.cc:3055] T 7c44c4849aa54f2b94d1f1bef9ed546f P ccd8a4c3bfe3413cb2ae219b09aea832 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:21:11.344625 12730 raft_consensus.cc:993] T a1704639a875409b9959353527b3fd68 P b7ab4784c7344b939bc36f639286f377: : Instructing follower cd75a17ab2604397adab03bb8b5fd75c to start an election
I20260709 13:21:11.361145  6877 rpcz_store.cc:276] 0709 13:21:10.242424 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:21:10.242661 (+   237us) service_pool.cc:224] Handling call
0709 13:21:10.243116 (+   455us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:21:10.659715 (+416599us) spinlock_profiling.cc:243] Waited 9.63 ms on lock 0x7b4800210258. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc148d3aa1 00007fcc148cab37 00007fcc148ca9ca 00007fcc149c226f 00007fcc149c1f37 00007fcc149d655c 00007fcc149d6508 00007fcc149d6488 00007fcc149d6443 00007fcc149d56ec 00007fcc138ffa96
0709 13:21:11.110874 (+451159us) spinlock_profiling.cc:243] Waited 2.21 ms on lock 0x7b18001dcec0. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc15785de1 00007fcc157925b1 00007fcc0f5524bc 00007fcc0c8a048b 00007fcc156faab9 00007fcc0c8bc69b 00007fcc0c8ba93f 00007fcc0c8ba455 00007fcc0f9a2060 00007fcc0f9a2bfb 00007fcc0f9ad64b
0709 13:21:11.111019 (+   145us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:21:11.111043 (+    24us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:21:11.111696 (+   653us) log.cc:844] Serialized 26 byte log entry
0709 13:21:11.129479 (+ 17783us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:21:11.129527 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:21:11.339084 (+209557us) spinlock_profiling.cc:243] Waited 122 ms on lock 0x7b5400218ed4. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f9aae01 00007fcc0f9a983e 00007fcc1496e419 00007fcc0dee5bd4 00007fcc0dee5b62 00007fcc0dee5a91 00007fcc0dee5a0c 00007fcc0dee4cc2 00007fcc0dce548c 00007fcc0dce48c6
0709 13:21:11.339147 (+    63us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:21:11.339220 (+    73us) raft_consensus.cc:1685] finished
0709 13:21:11.339237 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:21:11.339406 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":112284,"raft.run_cpu_time_us":2919,"raft.run_wall_time_us":171685,"spinlock_wait_cycles":306690944,"thread_start_us":170327,"threads_started":2,"wal-append.queue_time_us":110518}
I20260709 13:21:11.342957 13210 raft_consensus.cc:2749] T 4f00a2e87e56452083b759f60d461ee3 P cd75a17ab2604397adab03bb8b5fd75c [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 13:21:11.395434  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 153771us
I20260709 13:21:11.385183  6798 raft_consensus.cc:1240] T f09c2a98de1a4decabd0ff900dd44caa P b7ab4784c7344b939bc36f639286f377 [term 19 FOLLOWER]: Rejecting Update request from peer ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 18. Current term is 19. Ops: []
I20260709 13:21:11.409590  6770 leader_election.cc:304] T ab432e62819d499eaaf3dd55481dd930 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:21:11.392148  6846 leader_election.cc:400] T 3fa34c08b205435dba97346991aa1f92 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 22 election: Vote denied by peer 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071) with higher term. Message: Invalid argument: T 3fa34c08b205435dba97346991aa1f92 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c for earlier term 22. Current term is 23.
W20260709 13:21:11.410252  6844 leader_election.cc:336] T b56bf91d90824c959e21e0cee5ba1816 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817): Timed out: RequestConsensusVote RPC to 127.5.126.66:42817 timed out after 2.086s (SENT)
I20260709 13:21:11.410591  6846 leader_election.cc:403] T 3fa34c08b205435dba97346991aa1f92 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 22 election: Cancelling election due to peer responding with higher term
I20260709 13:21:11.396736 12965 raft_consensus.cc:3060] T e31b9971c15848dea59d4d4130141d9e P b7ab4784c7344b939bc36f639286f377 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:21:11.373924  6880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b3759de40694069b13c0f8bd40e5709" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 17 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:21:11.400460  6873 raft_consensus.cc:1275] T 44bde925b2e541b69890d70715b85176 P cd75a17ab2604397adab03bb8b5fd75c [term 19 FOLLOWER]: Refusing update from remote peer ccd8a4c3bfe3413cb2ae219b09aea832: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260709 13:21:11.295728 13207 raft_consensus.cc:515] T c4db81d9d329422bb3b4160ca4ac2d1d P ccd8a4c3bfe3413cb2ae219b09aea832 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:11.420516  6880 raft_consensus.cc:2468] T 9b3759de40694069b13c0f8bd40e5709 P cd75a17ab2604397adab03bb8b5fd75c [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 16.
I20260709 13:21:11.404598  6874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d65025eea89441290d85dd053810e31" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:21:11.440222  6770 leader_election.cc:304] T 7c44c4849aa54f2b94d1f1bef9ed546f P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:21:11.393059 13205 raft_consensus.cc:740] T f03d0dbf16864ca4bc1bb5e4c0334c0f P ccd8a4c3bfe3413cb2ae219b09aea832 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
I20260709 13:21:11.398365  6878 raft_consensus.cc:2468] T 8c7f33e544204fbaac4078e3e83bbf4e P cd75a17ab2604397adab03bb8b5fd75c [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 16.
I20260709 13:21:11.410764  6844 leader_election.cc:304] T b56bf91d90824c959e21e0cee5ba1816 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:21:11.410732  6726 raft_consensus.cc:2468] T 3fa34c08b205435dba97346991aa1f92 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in term 23.
I20260709 13:21:11.445854  6801 raft_consensus.cc:1240] T f03d0dbf16864ca4bc1bb5e4c0334c0f P b7ab4784c7344b939bc36f639286f377 [term 19 LEADER]: Rejecting Update request from peer ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 18. Current term is 19. Ops: []
I20260709 13:21:11.327236 13225 raft_consensus.cc:515] T 427c124d773f483294511e80fe340075 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 18 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } attrs { replace: true } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:21:11.375414 13290 consensus_queue.cc:1059] T bb3d8792045a4583ae2e965b1350a5b4 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false }, Status: INVALID_TERM, Last received: 16.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.032s
I20260709 13:21:11.419238  6695 leader_election.cc:304] T bd6869f07b5a4885a0b99fbe60c3b175 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
I20260709 13:21:11.448750  6697 leader_election.cc:304] T 90d42e216d9741e190bca19a781291fd P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:21:11.406603 13202 raft_consensus.cc:740] T 7c44c4849aa54f2b94d1f1bef9ed546f P ccd8a4c3bfe3413cb2ae219b09aea832 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
I20260709 13:21:11.443727  6881 raft_consensus.cc:2468] T bd6869f07b5a4885a0b99fbe60c3b175 P cd75a17ab2604397adab03bb8b5fd75c [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 20.
I20260709 13:21:11.385111 13273 consensus_queue.cc:1059] T be1a92657f494cac8dd227d152f50151 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.027s
I20260709 13:21:11.307968 13257 raft_consensus.cc:515] T 404190ce4ce94cecbfcb6ea9d1dd8626 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:21:11.440841  7466 leader_election.cc:304] T be1a92657f494cac8dd227d152f50151 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
W20260709 13:21:11.424955  6846 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.68:45071, user_credentials={real_user=slave}} blocked reactor thread for 47564.2us
I20260709 13:21:11.403575 13188 raft_consensus.cc:515] T 22ccee1b570c4ad3a57bd7aec085b1b4 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
W20260709 13:21:11.460480  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 50260us
I20260709 13:21:11.462387 13202 consensus_queue.cc:260] T 7c44c4849aa54f2b94d1f1bef9ed546f P ccd8a4c3bfe3413cb2ae219b09aea832 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 19.13, Last appended by leader: 13, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:11.464848 13193 raft_consensus.cc:3055] T bb3d8792045a4583ae2e965b1350a5b4 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:21:11.465368 13247 consensus_queue.cc:260] T a3022224cc81473690653a83d4e99470 P ccd8a4c3bfe3413cb2ae219b09aea832 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.11, Last appended by leader: 11, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:11.467304 13247 raft_consensus.cc:3060] T a3022224cc81473690653a83d4e99470 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:21:11.428790 13221 raft_consensus.cc:1081] T a1704639a875409b9959353527b3fd68 P b7ab4784c7344b939bc36f639286f377 [term 19 LEADER]: Signalling peer cd75a17ab2604397adab03bb8b5fd75c to start an election
I20260709 13:21:11.468376 13225 leader_election.cc:290] T 427c124d773f483294511e80fe340075 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 18 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:21:11.450062  6805 raft_consensus.cc:1240] T 07a92dd554674067a83a9cb68c4773f2 P b7ab4784c7344b939bc36f639286f377 [term 17 FOLLOWER]: Rejecting Update request from peer ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 16. Current term is 17. Ops: []
W20260709 13:21:11.450464  6772 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 76872us
I20260709 13:21:11.428588 12863 raft_consensus.cc:493] T b56bf91d90824c959e21e0cee5ba1816 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:11.451694 12898 raft_consensus.cc:2749] T ab432e62819d499eaaf3dd55481dd930 P b7ab4784c7344b939bc36f639286f377 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:21:11.453994 13210 raft_consensus.cc:2749] T b56bf91d90824c959e21e0cee5ba1816 P cd75a17ab2604397adab03bb8b5fd75c [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:21:11.454282  6800 raft_consensus.cc:1240] T 7c44c4849aa54f2b94d1f1bef9ed546f P b7ab4784c7344b939bc36f639286f377 [term 20 FOLLOWER]: Rejecting Update request from peer ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 19. Current term is 20. Ops: []
I20260709 13:21:11.463100  6844 leader_election.cc:304] T a1704639a875409b9959353527b3fd68 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:21:11.468859 13288 leader_election.cc:290] T dbdf895bba214ff68685a24fd17dfb5d P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:21:11.429239 13263 raft_consensus.cc:3060] T 3fa34c08b205435dba97346991aa1f92 P cd75a17ab2604397adab03bb8b5fd75c [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:21:11.440105  6874 raft_consensus.cc:3060] T 3d65025eea89441290d85dd053810e31 P cd75a17ab2604397adab03bb8b5fd75c [term 18 FOLLOWER]: Advancing to term 20
I20260709 13:21:11.470966  6697 leader_election.cc:304] T 24ee15416e3145beaa1b8183453729a3 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:21:11.455046 13205 consensus_queue.cc:260] T f03d0dbf16864ca4bc1bb5e4c0334c0f P ccd8a4c3bfe3413cb2ae219b09aea832 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 18.9, Last appended by leader: 9, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:11.459385  7466 leader_election.cc:304] T 3fa34c08b205435dba97346991aa1f92 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
I20260709 13:21:11.489562  6697 leader_election.cc:304] T 9e326172347f45e99a0d482b5d8ef768 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377
I20260709 13:21:11.478436  6844 leader_election.cc:304] T fe20b4b48823486ca3b9c648db6ce8aa P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:21:11.483232  6880 raft_consensus.cc:1275] T 4275cf08e63345f993bce8664eada830 P cd75a17ab2604397adab03bb8b5fd75c [term 17 FOLLOWER]: Refusing update from remote peer b7ab4784c7344b939bc36f639286f377: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 17 index: 9. (index mismatch)
I20260709 13:21:11.450784 13304 raft_consensus.cc:2749] T 3fa34c08b205435dba97346991aa1f92 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 23 FOLLOWER]: Leader election lost for term 22. Reason: Vote denied by peer 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071) with higher term. Message: Invalid argument: T 3fa34c08b205435dba97346991aa1f92 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 22. Current term is 23.
I20260709 13:21:11.492468  6726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "427c124d773f483294511e80fe340075" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:21:11.497171  6726 raft_consensus.cc:3060] T 427c124d773f483294511e80fe340075 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:21:11.499732  6697 leader_election.cc:304] T f58dc08b12a2494bb9a1372837970ca2 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:21:11.455638 13207 leader_election.cc:290] T c4db81d9d329422bb3b4160ca4ac2d1d P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 19 election: Requested vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:21:11.503044  6697 leader_election.cc:304] T 20f6842e26174571996b8dea4151d4be P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:21:11.504360  6697 leader_election.cc:304] T f3f9c2e2bf644115957398fe4c9459db P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:21:11.501607  6844 leader_election.cc:304] T d33d5ee8ef6f415593d8df52063161ad P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:21:11.464829 13223 leader_election.cc:290] T f09c2a98de1a4decabd0ff900dd44caa P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 19 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:21:11.463989 13202 raft_consensus.cc:3060] T 7c44c4849aa54f2b94d1f1bef9ed546f P ccd8a4c3bfe3413cb2ae219b09aea832 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:21:11.465509 13193 raft_consensus.cc:740] T bb3d8792045a4583ae2e965b1350a5b4 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
W20260709 13:21:11.518250  6773 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:21:11.518453  6844 leader_election.cc:304] T 7887766dc6784fcaa42b35c05fea7a99 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:21:11.482918 13242 raft_consensus.cc:2804] T a1704639a875409b9959353527b3fd68 P cd75a17ab2604397adab03bb8b5fd75c [term 19 FOLLOWER]: Leader pre-election won for term 20
W20260709 13:21:11.528486  6695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 109310us
W20260709 13:21:11.529834  6772 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 60323.2us
I20260709 13:21:11.528975  6726 raft_consensus.cc:2468] T 427c124d773f483294511e80fe340075 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in term 18.
I20260709 13:21:11.521136 13027 raft_consensus.cc:2749] T 7c44c4849aa54f2b94d1f1bef9ed546f P b7ab4784c7344b939bc36f639286f377 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:21:11.480554 12863 raft_consensus.cc:515] T b56bf91d90824c959e21e0cee5ba1816 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:11.515883 13201 raft_consensus.cc:2749] T f58dc08b12a2494bb9a1372837970ca2 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:21:11.485430 13290 raft_consensus.cc:2749] T 90d42e216d9741e190bca19a781291fd P ccd8a4c3bfe3413cb2ae219b09aea832 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:21:11.536945  6844 leader_election.cc:304] T bb3d8792045a4583ae2e965b1350a5b4 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:21:11.503687 13273 raft_consensus.cc:2749] T 24ee15416e3145beaa1b8183453729a3 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:21:11.496905 13217 raft_consensus.cc:3055] T be1a92657f494cac8dd227d152f50151 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 20 LEADER]: Stepping down as leader of term 20
W20260709 13:21:11.539191  6770 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 99176.2us
I20260709 13:21:11.503499 13016 raft_consensus.cc:2804] T 3fa34c08b205435dba97346991aa1f92 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:21:11.516007 12704 raft_consensus.cc:2804] T 9e326172347f45e99a0d482b5d8ef768 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:21:11.520908 13218 raft_consensus.cc:2749] T fe20b4b48823486ca3b9c648db6ce8aa P cd75a17ab2604397adab03bb8b5fd75c [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:21:11.558336  6874 raft_consensus.cc:2468] T 3d65025eea89441290d85dd053810e31 P cd75a17ab2604397adab03bb8b5fd75c [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 20.
I20260709 13:21:11.521450 13205 raft_consensus.cc:3060] T f03d0dbf16864ca4bc1bb5e4c0334c0f P ccd8a4c3bfe3413cb2ae219b09aea832 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:21:11.526618 13210 raft_consensus.cc:2804] T d33d5ee8ef6f415593d8df52063161ad P cd75a17ab2604397adab03bb8b5fd75c [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:21:11.529628 13249 raft_consensus.cc:2804] T 7887766dc6784fcaa42b35c05fea7a99 P cd75a17ab2604397adab03bb8b5fd75c [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:21:11.556840  6844 leader_election.cc:304] T 4d9def8b32fd443aa94ab1420b06837b P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:21:11.561134  6772 leader_election.cc:304] T 20f6842e26174571996b8dea4151d4be P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:21:11.536643 13242 raft_consensus.cc:493] T a1704639a875409b9959353527b3fd68 P cd75a17ab2604397adab03bb8b5fd75c [term 19 FOLLOWER]: Starting leader election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:21:11.537637 13230 raft_consensus.cc:2804] T bd6869f07b5a4885a0b99fbe60c3b175 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:21:11.538139 13207 raft_consensus.cc:2749] T 20f6842e26174571996b8dea4151d4be P ccd8a4c3bfe3413cb2ae219b09aea832 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:21:11.539805 13201 raft_consensus.cc:2749] T f3f9c2e2bf644115957398fe4c9459db P ccd8a4c3bfe3413cb2ae219b09aea832 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:21:11.574648  6773 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:21:11.576187  7468 leader_election.cc:304] T bb3d8792045a4583ae2e965b1350a5b4 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, cd75a17ab2604397adab03bb8b5fd75c; no voters: ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:21:11.576928  6800 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f09c2a98de1a4decabd0ff900dd44caa"
dest_uuid: "b7ab4784c7344b939bc36f639286f377"
mode: GRACEFUL
new_leader_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
 from {username='slave'} at 127.0.0.1:38240
I20260709 13:21:11.583753  6800 raft_consensus.cc:606] T f09c2a98de1a4decabd0ff900dd44caa P b7ab4784c7344b939bc36f639286f377 [term 19 FOLLOWER]: Received request to transfer leadership to TS cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:21:11.584241  6800 raft_consensus.cc:614] T f09c2a98de1a4decabd0ff900dd44caa P b7ab4784c7344b939bc36f639286f377 [term 19 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:21:11.577931 13118 raft_consensus.cc:993] T 7887766dc6784fcaa42b35c05fea7a99 P b7ab4784c7344b939bc36f639286f377: : Instructing follower cd75a17ab2604397adab03bb8b5fd75c to start an election
I20260709 13:21:11.578503  6807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4db81d9d329422bb3b4160ca4ac2d1d" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:21:11.546588 13022 raft_consensus.cc:2749] T bb3d8792045a4583ae2e965b1350a5b4 P cd75a17ab2604397adab03bb8b5fd75c [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:21:11.542384 13217 raft_consensus.cc:740] T be1a92657f494cac8dd227d152f50151 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
I20260709 13:21:11.545609 13297 raft_consensus.cc:493] T ab432e62819d499eaaf3dd55481dd930 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:11.546062 12704 raft_consensus.cc:493] T 9e326172347f45e99a0d482b5d8ef768 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 14 FOLLOWER]: Starting leader election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:21:11.592001  6806 raft_consensus.cc:1240] T 7c37d41cd9164c15a6826ca62a851a69 P b7ab4784c7344b939bc36f639286f377 [term 19 LEADER]: Rejecting Update request from peer ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 18. Current term is 19. Ops: []
I20260709 13:21:11.569180 13210 raft_consensus.cc:493] T d33d5ee8ef6f415593d8df52063161ad P cd75a17ab2604397adab03bb8b5fd75c [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:11.569362 13249 raft_consensus.cc:493] T 7887766dc6784fcaa42b35c05fea7a99 P cd75a17ab2604397adab03bb8b5fd75c [term 20 FOLLOWER]: Starting leader election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:21:11.569916 13016 raft_consensus.cc:697] T 3fa34c08b205435dba97346991aa1f92 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 23 LEADER]: Becoming Leader. State: Replica: 7ba59cc884714e8aa5f3f0ecaed84cbb, State: Running, Role: LEADER
I20260709 13:21:11.597838  6805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "427c124d773f483294511e80fe340075" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
W20260709 13:21:11.600651  6770 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 57453.5us
I20260709 13:21:11.601256  6805 raft_consensus.cc:3060] T 427c124d773f483294511e80fe340075 P b7ab4784c7344b939bc36f639286f377 [term 16 FOLLOWER]: Advancing to term 18
I20260709 13:21:11.573500 13242 raft_consensus.cc:3060] T a1704639a875409b9959353527b3fd68 P cd75a17ab2604397adab03bb8b5fd75c [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:21:11.579578 13211 raft_consensus.cc:2804] T 4d9def8b32fd443aa94ab1420b06837b P cd75a17ab2604397adab03bb8b5fd75c [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:21:11.608280 13289 raft_consensus.cc:2749] T be1a92657f494cac8dd227d152f50151 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:21:11.592954 12970 raft_consensus.cc:2804] T bb3d8792045a4583ae2e965b1350a5b4 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:21:11.609846 12970 raft_consensus.cc:697] T bb3d8792045a4583ae2e965b1350a5b4 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 18 LEADER]: Becoming Leader. State: Replica: 7ba59cc884714e8aa5f3f0ecaed84cbb, State: Running, Role: LEADER
I20260709 13:21:11.610911 12970 consensus_queue.cc:237] T bb3d8792045a4583ae2e965b1350a5b4 P 7ba59cc884714e8aa5f3f0ecaed84cbb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 16.14, Last appended by leader: 14, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:21:11.588593 13298 raft_consensus.cc:2804] T 20f6842e26174571996b8dea4151d4be P b7ab4784c7344b939bc36f639286f377 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:21:11.613111 13298 raft_consensus.cc:493] T 20f6842e26174571996b8dea4151d4be P b7ab4784c7344b939bc36f639286f377 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:11.613669 13298 raft_consensus.cc:3060] T 20f6842e26174571996b8dea4151d4be P b7ab4784c7344b939bc36f639286f377 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:21:11.603847 13249 raft_consensus.cc:3060] T 7887766dc6784fcaa42b35c05fea7a99 P cd75a17ab2604397adab03bb8b5fd75c [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:21:11.606576 13216 consensus_queue.cc:1048] T ce4f062dcd314d43a63ca74067cb5ee3 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.012s
I20260709 13:21:11.625072 13295 consensus_queue.cc:1059] T 853ac0a8cbd64ce99457f170216d4d0f P b7ab4784c7344b939bc36f639286f377 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: INVALID_TERM, Last received: 14.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:21:11.626046 13295 consensus_queue.cc:1243] T 853ac0a8cbd64ce99457f170216d4d0f P b7ab4784c7344b939bc36f639286f377 [LEADER]: Peer cd75a17ab2604397adab03bb8b5fd75c log is divergent from this leader: its last log entry 15.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 13:21:11.627082 13295 consensus_queue.cc:1048] T 4d9def8b32fd443aa94ab1420b06837b P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:21:11.617714 13211 raft_consensus.cc:493] T 4d9def8b32fd443aa94ab1420b06837b P cd75a17ab2604397adab03bb8b5fd75c [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:11.627985 13222 raft_consensus.cc:3055] T 853ac0a8cbd64ce99457f170216d4d0f P b7ab4784c7344b939bc36f639286f377 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:21:11.631328 13222 raft_consensus.cc:740] T 853ac0a8cbd64ce99457f170216d4d0f P b7ab4784c7344b939bc36f639286f377 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
I20260709 13:21:11.628674 13211 raft_consensus.cc:3060] T 4d9def8b32fd443aa94ab1420b06837b P cd75a17ab2604397adab03bb8b5fd75c [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:21:11.600348 13230 raft_consensus.cc:697] T bd6869f07b5a4885a0b99fbe60c3b175 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 20 LEADER]: Becoming Leader. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
I20260709 13:21:11.634903 13230 consensus_queue.cc:237] T bd6869f07b5a4885a0b99fbe60c3b175 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 18.9, Last appended by leader: 9, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:11.598182 13193 consensus_queue.cc:260] T bb3d8792045a4583ae2e965b1350a5b4 P ccd8a4c3bfe3413cb2ae219b09aea832 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.15, Last appended by leader: 15, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:21:11.637564 13193 raft_consensus.cc:3060] T bb3d8792045a4583ae2e965b1350a5b4 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:21:11.639066 13257 leader_election.cc:290] T 404190ce4ce94cecbfcb6ea9d1dd8626 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 17 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:21:11.607393 12863 leader_election.cc:290] T b56bf91d90824c959e21e0cee5ba1816 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:21:11.641532 13016 consensus_queue.cc:237] T 3fa34c08b205435dba97346991aa1f92 P 7ba59cc884714e8aa5f3f0ecaed84cbb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 21.16, Last appended by leader: 16, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:21:11.643424  6730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a734b5ab7834e05a8c422208acc58b1" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:21:11.644145  6730 raft_consensus.cc:2468] T 7a734b5ab7834e05a8c422208acc58b1 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 19.
I20260709 13:21:11.645392  6729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b3759de40694069b13c0f8bd40e5709" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 17 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:21:11.642745 13222 consensus_queue.cc:260] T 853ac0a8cbd64ce99457f170216d4d0f P b7ab4784c7344b939bc36f639286f377 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:11.630730  6800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22ccee1b570c4ad3a57bd7aec085b1b4" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:21:11.630470 12965 raft_consensus.cc:515] T e31b9971c15848dea59d4d4130141d9e P b7ab4784c7344b939bc36f639286f377 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:11.600487 13210 raft_consensus.cc:3060] T d33d5ee8ef6f415593d8df52063161ad P cd75a17ab2604397adab03bb8b5fd75c [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:21:11.648501 13217 consensus_queue.cc:260] T be1a92657f494cac8dd227d152f50151 P ccd8a4c3bfe3413cb2ae219b09aea832 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 20.15, Last appended by leader: 15, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:21:11.605433 13297 raft_consensus.cc:515] T ab432e62819d499eaaf3dd55481dd930 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:11.600867 12704 raft_consensus.cc:3060] T 9e326172347f45e99a0d482b5d8ef768 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:21:11.646667  6725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b8cacb381b746da8d0049b0a83b41dd" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
W20260709 13:21:11.661460  6696 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:21:11.655059  6697 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 150786us
I20260709 13:21:11.656554  6728 raft_consensus.cc:1275] T 95a75bfe094d4bdc963aba3f08dfcd25 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 16 FOLLOWER]: Refusing update from remote peer cd75a17ab2604397adab03bb8b5fd75c: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:21:11.606963 13288 raft_consensus.cc:1081] T 7887766dc6784fcaa42b35c05fea7a99 P b7ab4784c7344b939bc36f639286f377 [term 20 LEADER]: Signalling peer cd75a17ab2604397adab03bb8b5fd75c to start an election
I20260709 13:21:11.646039 13290 consensus_queue.cc:1059] T 07a92dd554674067a83a9cb68c4773f2 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: INVALID_TERM, Last received: 16.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:21:11.663380  6807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b56bf91d90824c959e21e0cee5ba1816" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
W20260709 13:21:11.663323  6770 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 61874.3us
I20260709 13:21:11.663619  6729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "404190ce4ce94cecbfcb6ea9d1dd8626" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:21:11.662504  6697 leader_election.cc:304] T 3a485a995abc4807b6e511e45419f737 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:21:11.667531  5625 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 13:21:11.668146  7468 leader_election.cc:304] T 4b8cacb381b746da8d0049b0a83b41dd P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:21:11.669411  5625 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:21:11.670490  6802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "404190ce4ce94cecbfcb6ea9d1dd8626" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:21:11.671639  6844 leader_election.cc:304] T 1bf4668eeb70467fb3dc5a0289233b3c P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:21:11.672765 13022 raft_consensus.cc:2749] T 1bf4668eeb70467fb3dc5a0289233b3c P cd75a17ab2604397adab03bb8b5fd75c [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:21:11.673695  6844 leader_election.cc:304] T 20f6842e26174571996b8dea4151d4be P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:21:11.674261  6772 leader_election.cc:304] T 9b3759de40694069b13c0f8bd40e5709 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:21:11.675625 13294 raft_consensus.cc:2749] T 20f6842e26174571996b8dea4151d4be P cd75a17ab2604397adab03bb8b5fd75c [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:21:11.676374 13294 consensus_queue.cc:1048] T dbdf895bba214ff68685a24fd17dfb5d P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:21:11.678087  6772 leader_election.cc:304] T 8c7f33e544204fbaac4078e3e83bbf4e P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:21:11.678772 12965 leader_election.cc:290] T e31b9971c15848dea59d4d4130141d9e P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 17 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:21:11.679814 13288 raft_consensus.cc:2804] T 8c7f33e544204fbaac4078e3e83bbf4e P b7ab4784c7344b939bc36f639286f377 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:21:11.680384 13288 raft_consensus.cc:697] T 8c7f33e544204fbaac4078e3e83bbf4e P b7ab4784c7344b939bc36f639286f377 [term 16 LEADER]: Becoming Leader. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
I20260709 13:21:11.681216 13288 consensus_queue.cc:237] T 8c7f33e544204fbaac4078e3e83bbf4e P b7ab4784c7344b939bc36f639286f377 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:11.683917  6844 leader_election.cc:304] T 7c44c4849aa54f2b94d1f1bef9ed546f P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:21:11.687214 13218 raft_consensus.cc:3060] T 7c44c4849aa54f2b94d1f1bef9ed546f P cd75a17ab2604397adab03bb8b5fd75c [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:21:11.692386 13217 raft_consensus.cc:3060] T be1a92657f494cac8dd227d152f50151 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:21:11.666613  6770 leader_election.cc:304] T 427c124d773f483294511e80fe340075 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, b7ab4784c7344b939bc36f639286f377; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:21:11.695916  6874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f00a2e87e56452083b759f60d461ee3" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:21:11.613134 13188 leader_election.cc:290] T 22ccee1b570c4ad3a57bd7aec085b1b4 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:21:11.708541  6876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb7fa124c3bf4ef9ab65a407cb008441" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:21:11.709987  6881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fa34c08b205435dba97346991aa1f92" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 23 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
W20260709 13:21:11.712106  6697 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 49675.8us
I20260709 13:21:11.713503  7468 leader_election.cc:304] T 4f00a2e87e56452083b759f60d461ee3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:21:11.729526  6874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "427c124d773f483294511e80fe340075" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:21:11.730556  6874 raft_consensus.cc:2468] T 427c124d773f483294511e80fe340075 P cd75a17ab2604397adab03bb8b5fd75c [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in term 17.
I20260709 13:21:11.724479  7466 leader_election.cc:304] T 404190ce4ce94cecbfcb6ea9d1dd8626 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:21:11.713377  6844 leader_election.cc:304] T 7a734b5ab7834e05a8c422208acc58b1 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:21:11.740271  6880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce4f062dcd314d43a63ca74067cb5ee3" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:21:11.742226  6844 leader_election.cc:304] T 4b8cacb381b746da8d0049b0a83b41dd P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:21:11.747565  6873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "427c124d773f483294511e80fe340075" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:21:11.748376  6873 raft_consensus.cc:3060] T 427c124d773f483294511e80fe340075 P cd75a17ab2604397adab03bb8b5fd75c [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:21:11.663993 13273 raft_consensus.cc:493] T 30e88460611e47b2ba16a46a30b5f416 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:21:11.755642  6772 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 51238.7us
I20260709 13:21:11.683595 13242 raft_consensus.cc:515] T a1704639a875409b9959353527b3fd68 P cd75a17ab2604397adab03bb8b5fd75c [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:11.761248  6729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fa34c08b205435dba97346991aa1f92" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:21:11.761958  6729 raft_consensus.cc:2368] T 3fa34c08b205435dba97346991aa1f92 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c for earlier term 22. Current term is 23.
I20260709 13:21:11.764201  6725 raft_consensus.cc:1275] T 3411566abe2d4c9bb4b2adfdd05e6f17 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 17 FOLLOWER]: Refusing update from remote peer cd75a17ab2604397adab03bb8b5fd75c: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:21:11.764220  6729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab432e62819d499eaaf3dd55481dd930" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:21:11.764974  6729 raft_consensus.cc:2468] T ab432e62819d499eaaf3dd55481dd930 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 21.
I20260709 13:21:11.733532 13201 raft_consensus.cc:2749] T 3a485a995abc4807b6e511e45419f737 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:21:11.721499 13225 raft_consensus.cc:3060] T 4b8cacb381b746da8d0049b0a83b41dd P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:21:11.768641  6770 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 102682us
W20260709 13:21:11.747850 13313 log.cc:927] Time spent T 711ef6523deb4cbe8ef2ba61e1c21c98 P ccd8a4c3bfe3413cb2ae219b09aea832: Append to log took a long time: real 0.119s	user 0.004s	sys 0.000s
I20260709 13:21:11.751040 13275 raft_consensus.cc:2749] T 4f00a2e87e56452083b759f60d461ee3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:21:11.743911 13176 raft_consensus.cc:2749] T 404190ce4ce94cecbfcb6ea9d1dd8626 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:21:11.785590  6772 leader_election.cc:304] T 3d65025eea89441290d85dd053810e31 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:21:11.793563  6697 leader_election.cc:304] T a1704639a875409b9959353527b3fd68 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:21:11.749811 13222 raft_consensus.cc:3060] T 853ac0a8cbd64ce99457f170216d4d0f P b7ab4784c7344b939bc36f639286f377 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:21:11.694298 12863 consensus_queue.cc:1059] T 7c37d41cd9164c15a6826ca62a851a69 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: INVALID_TERM, Last received: 18.13, Next index: 14, Last known committed idx: 11, Time since last communication: 0.093s
I20260709 13:21:11.754802 13264 raft_consensus.cc:2804] T 7a734b5ab7834e05a8c422208acc58b1 P cd75a17ab2604397adab03bb8b5fd75c [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:21:11.812219  6875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e31b9971c15848dea59d4d4130141d9e" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:21:11.719280 13298 raft_consensus.cc:515] T 20f6842e26174571996b8dea4151d4be P b7ab4784c7344b939bc36f639286f377 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:11.821622  6875 raft_consensus.cc:3060] T e31b9971c15848dea59d4d4130141d9e P cd75a17ab2604397adab03bb8b5fd75c [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:21:11.822559  6873 raft_consensus.cc:2468] T 427c124d773f483294511e80fe340075 P cd75a17ab2604397adab03bb8b5fd75c [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in term 18.
I20260709 13:21:11.810245  6876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09c2a98de1a4decabd0ff900dd44caa" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:21:11.817196  6805 raft_consensus.cc:2468] T 427c124d773f483294511e80fe340075 P b7ab4784c7344b939bc36f639286f377 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in term 18.
I20260709 13:21:11.793066  6728 raft_consensus.cc:1275] T 853ac0a8cbd64ce99457f170216d4d0f P ccd8a4c3bfe3413cb2ae219b09aea832 [term 15 FOLLOWER]: Refusing update from remote peer cd75a17ab2604397adab03bb8b5fd75c: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:21:11.838300  6874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbdf895bba214ff68685a24fd17dfb5d" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 18 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:21:11.754961 13294 consensus_queue.cc:1048] T 95a75bfe094d4bdc963aba3f08dfcd25 P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Connected to new peer: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.052s
I20260709 13:21:11.841614  7466 leader_election.cc:304] T 427c124d773f483294511e80fe340075 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
I20260709 13:21:11.854526 13297 leader_election.cc:290] T ab432e62819d499eaaf3dd55481dd930 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:21:11.861829 13308 consensus_queue.cc:1048] T ce4f062dcd314d43a63ca74067cb5ee3 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:21:11.844264 13122 raft_consensus.cc:493] T de3186201e1a40d0b335eeb8b4e256e0 P b7ab4784c7344b939bc36f639286f377 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:11.846333  6880 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a1704639a875409b9959353527b3fd68"
dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
 from {username='slave'} at 127.0.0.1:53406
I20260709 13:21:11.863755 13122 raft_consensus.cc:515] T de3186201e1a40d0b335eeb8b4e256e0 P b7ab4784c7344b939bc36f639286f377 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:11.864624  6880 raft_consensus.cc:493] T a1704639a875409b9959353527b3fd68 P cd75a17ab2604397adab03bb8b5fd75c [term 20 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:21:11.865044  6880 raft_consensus.cc:3060] T a1704639a875409b9959353527b3fd68 P cd75a17ab2604397adab03bb8b5fd75c [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:21:11.866238 13122 leader_election.cc:290] T de3186201e1a40d0b335eeb8b4e256e0 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:21:11.870056 12730 raft_consensus.cc:493] T d8292e16e5654be6bc408560cf256aaa P b7ab4784c7344b939bc36f639286f377 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:21:11.870639 12730 raft_consensus.cc:515] T d8292e16e5654be6bc408560cf256aaa P b7ab4784c7344b939bc36f639286f377 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
W20260709 13:21:11.873384  6770 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 65525.4us
I20260709 13:21:11.875339 13211 raft_consensus.cc:515] T 4d9def8b32fd443aa94ab1420b06837b P cd75a17ab2604397adab03bb8b5fd75c [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:11.825008 13223 raft_consensus.cc:2804] T 9b3759de40694069b13c0f8bd40e5709 P b7ab4784c7344b939bc36f639286f377 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:21:11.844149  6877 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7887766dc6784fcaa42b35c05fea7a99"
dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
 from {username='slave'} at 127.0.0.1:53406
I20260709 13:21:11.827040 13264 raft_consensus.cc:493] T 7a734b5ab7834e05a8c422208acc58b1 P cd75a17ab2604397adab03bb8b5fd75c [term 19 FOLLOWER]: Starting leader election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:21:11.811050 13317 consensus_queue.cc:1059] T f09c2a98de1a4decabd0ff900dd44caa P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: INVALID_TERM, Last received: 18.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.105s
I20260709 13:21:11.759827 13273 raft_consensus.cc:515] T 30e88460611e47b2ba16a46a30b5f416 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
W20260709 13:21:11.899518 13315 log.cc:927] Time spent T 7c37d41cd9164c15a6826ca62a851a69 P b7ab4784c7344b939bc36f639286f377: Append to log took a long time: real 0.105s	user 0.000s	sys 0.000s
I20260709 13:21:11.901414 13263 raft_consensus.cc:2749] T 3fa34c08b205435dba97346991aa1f92 P cd75a17ab2604397adab03bb8b5fd75c [term 23 FOLLOWER]: Leader election lost for term 22. Reason: Vote denied by peer 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071) with higher term. Message: Invalid argument: T 3fa34c08b205435dba97346991aa1f92 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c for earlier term 22. Current term is 23.
I20260709 13:21:11.896906 13176 raft_consensus.cc:2804] T 427c124d773f483294511e80fe340075 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:21:11.821391 13216 raft_consensus.cc:2804] T 3d65025eea89441290d85dd053810e31 P b7ab4784c7344b939bc36f639286f377 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:21:11.893740 13218 raft_consensus.cc:2749] T 7c44c4849aa54f2b94d1f1bef9ed546f P cd75a17ab2604397adab03bb8b5fd75c [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:21:11.888991 13249 raft_consensus.cc:515] T 7887766dc6784fcaa42b35c05fea7a99 P cd75a17ab2604397adab03bb8b5fd75c [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:11.883133 13298 leader_election.cc:290] T 20f6842e26174571996b8dea4151d4be P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 20 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:21:11.902910 12730 leader_election.cc:290] T d8292e16e5654be6bc408560cf256aaa P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:21:11.881294 13242 leader_election.cc:290] T a1704639a875409b9959353527b3fd68 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 20 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:21:11.910352 13295 consensus_queue.cc:1048] T a1704639a875409b9959353527b3fd68 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:21:11.929666  6875 raft_consensus.cc:2468] T e31b9971c15848dea59d4d4130141d9e P cd75a17ab2604397adab03bb8b5fd75c [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 17.
I20260709 13:21:11.791520 13221 consensus_queue.cc:1048] T 4275cf08e63345f993bce8664eada830 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.061s
I20260709 13:21:11.838604 13022 raft_consensus.cc:2749] T 4b8cacb381b746da8d0049b0a83b41dd P cd75a17ab2604397adab03bb8b5fd75c [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
W20260709 13:21:11.949757  6696 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:21:11.849017 13227 raft_consensus.cc:2749] T 427c124d773f483294511e80fe340075 P b7ab4784c7344b939bc36f639286f377 [term 18 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:21:11.919757 13207 raft_consensus.cc:2749] T a1704639a875409b9959353527b3fd68 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:21:11.966598  6873 raft_consensus.cc:1240] T 4d9def8b32fd443aa94ab1420b06837b P cd75a17ab2604397adab03bb8b5fd75c [term 20 FOLLOWER]: Rejecting Update request from peer b7ab4784c7344b939bc36f639286f377 for earlier term 19. Current term is 20. Ops: [19.10-19.10]
I20260709 13:21:12.023728  6798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab432e62819d499eaaf3dd55481dd930" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:21:12.053267  6798 raft_consensus.cc:2468] T ab432e62819d499eaaf3dd55481dd930 P b7ab4784c7344b939bc36f639286f377 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 21.
I20260709 13:21:11.934418 13294 raft_consensus.cc:493] T d8cee0accdb8499c86d4414b72565a38 P cd75a17ab2604397adab03bb8b5fd75c [term 19 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:21:11.954017 13264 raft_consensus.cc:3060] T 7a734b5ab7834e05a8c422208acc58b1 P cd75a17ab2604397adab03bb8b5fd75c [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:21:11.939128 12965 raft_consensus.cc:493] T c4db81d9d329422bb3b4160ca4ac2d1d P b7ab4784c7344b939bc36f639286f377 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader cd75a17ab2604397adab03bb8b5fd75c)
W20260709 13:21:12.042415  6698 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:21:12.040401  6697 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 246931us
I20260709 13:21:12.049862  6877 raft_consensus.cc:493] T 7887766dc6784fcaa42b35c05fea7a99 P cd75a17ab2604397adab03bb8b5fd75c [term 21 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:21:12.061856  6877 raft_consensus.cc:3060] T 7887766dc6784fcaa42b35c05fea7a99 P cd75a17ab2604397adab03bb8b5fd75c [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:21:12.062048  6697 leader_election.cc:304] T f5be3a11b23d4ea9b08300a2789821c7 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
W20260709 13:21:12.051745  6696 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:21:12.063920  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 321786us
I20260709 13:21:12.066834  7468 leader_election.cc:304] T bb7fa124c3bf4ef9ab65a407cb008441 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:21:12.038506 13176 raft_consensus.cc:697] T 427c124d773f483294511e80fe340075 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 18 LEADER]: Becoming Leader. State: Replica: 7ba59cc884714e8aa5f3f0ecaed84cbb, State: Running, Role: LEADER
I20260709 13:21:12.061084  6881 raft_consensus.cc:2468] T 3fa34c08b205435dba97346991aa1f92 P cd75a17ab2604397adab03bb8b5fd75c [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in term 23.
I20260709 13:21:12.076735  6695 leader_election.cc:304] T ab432e62819d499eaaf3dd55481dd930 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
I20260709 13:21:12.015254  6880 raft_consensus.cc:515] T a1704639a875409b9959353527b3fd68 P cd75a17ab2604397adab03bb8b5fd75c [term 21 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:12.043440 13216 raft_consensus.cc:697] T 3d65025eea89441290d85dd053810e31 P b7ab4784c7344b939bc36f639286f377 [term 20 LEADER]: Becoming Leader. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
I20260709 13:21:12.085516  6875 raft_consensus.cc:1240] T a1704639a875409b9959353527b3fd68 P cd75a17ab2604397adab03bb8b5fd75c [term 21 FOLLOWER]: Rejecting Update request from peer b7ab4784c7344b939bc36f639286f377 for earlier term 19. Current term is 21. Ops: []
I20260709 13:21:12.086419  6844 leader_election.cc:400] T 3fa34c08b205435dba97346991aa1f92 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 22 election: Vote denied by peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391) with higher term. Message: Invalid argument: T 3fa34c08b205435dba97346991aa1f92 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c for earlier term 22. Current term is 23.
I20260709 13:21:12.088155  6772 leader_election.cc:304] T e31b9971c15848dea59d4d4130141d9e P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:21:12.098680  6844 leader_election.cc:304] T ab432e62819d499eaaf3dd55481dd930 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
W20260709 13:21:12.102624  6770 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 197076us
I20260709 13:21:12.105746  6880 leader_election.cc:290] T a1704639a875409b9959353527b3fd68 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 21 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:21:12.105410  6770 leader_election.cc:304] T 95a75bfe094d4bdc963aba3f08dfcd25 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:21:12.113128 12863 consensus_queue.cc:1243] T 7c37d41cd9164c15a6826ca62a851a69 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Peer b7ab4784c7344b939bc36f639286f377 log is divergent from this leader: its last log entry 19.14 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 11
I20260709 13:21:12.088872 13233 raft_consensus.cc:2749] T bb7fa124c3bf4ef9ab65a407cb008441 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:21:12.183037  6770 leader_election.cc:304] T 713b5728a197487c9300b310ab94e5a3 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:21:12.076081 12965 raft_consensus.cc:515] T c4db81d9d329422bb3b4160ca4ac2d1d P b7ab4784c7344b939bc36f639286f377 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:12.088973 13242 raft_consensus.cc:493] T f4b8bd455d5a47c18a1380839c6e0d61 P cd75a17ab2604397adab03bb8b5fd75c [term 18 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:21:12.111995 12898 raft_consensus.cc:2804] T e31b9971c15848dea59d4d4130141d9e P b7ab4784c7344b939bc36f639286f377 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:21:12.112210 13297 raft_consensus.cc:2749] T f5be3a11b23d4ea9b08300a2789821c7 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:21:12.194893  6770 leader_election.cc:304] T a3022224cc81473690653a83d4e99470 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:21:12.065217 13294 raft_consensus.cc:515] T d8cee0accdb8499c86d4414b72565a38 P cd75a17ab2604397adab03bb8b5fd75c [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:21:12.205015 13294 leader_election.cc:290] T d8cee0accdb8499c86d4414b72565a38 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:21:12.207399 13027 raft_consensus.cc:3060] T a3022224cc81473690653a83d4e99470 P b7ab4784c7344b939bc36f639286f377 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:21:12.207792  7495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8cee0accdb8499c86d4414b72565a38" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:21:12.208088 13122 raft_consensus.cc:2749] T 713b5728a197487c9300b310ab94e5a3 P b7ab4784c7344b939bc36f639286f377 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:21:12.212086  6874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de3186201e1a40d0b335eeb8b4e256e0" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:21:12.116489 13286 raft_consensus.cc:2749] T 95a75bfe094d4bdc963aba3f08dfcd25 P b7ab4784c7344b939bc36f639286f377 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:21:12.117489 13298 consensus_queue.cc:1048] T f5be3a11b23d4ea9b08300a2789821c7 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.101s
W20260709 13:21:12.201649 13276 log.cc:927] Time spent T dbdf895bba214ff68685a24fd17dfb5d P ccd8a4c3bfe3413cb2ae219b09aea832: Append to log took a long time: real 0.091s	user 0.000s	sys 0.009s
I20260709 13:21:12.213037  6874 raft_consensus.cc:2468] T de3186201e1a40d0b335eeb8b4e256e0 P cd75a17ab2604397adab03bb8b5fd75c [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 18.
I20260709 13:21:12.217950  6874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20f6842e26174571996b8dea4151d4be" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:21:12.219482  6874 raft_consensus.cc:3060] T 20f6842e26174571996b8dea4151d4be P cd75a17ab2604397adab03bb8b5fd75c [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:21:12.223995 13022 raft_consensus.cc:2804] T ab432e62819d499eaaf3dd55481dd930 P cd75a17ab2604397adab03bb8b5fd75c [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:21:12.224649 13022 raft_consensus.cc:493] T ab432e62819d499eaaf3dd55481dd930 P cd75a17ab2604397adab03bb8b5fd75c [term 20 FOLLOWER]: Starting leader election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:21:12.225129 13022 raft_consensus.cc:3060] T ab432e62819d499eaaf3dd55481dd930 P cd75a17ab2604397adab03bb8b5fd75c [term 20 FOLLOWER]: Advancing to term 21
W20260709 13:21:12.242786 13320 log.cc:927] Time spent T be1a92657f494cac8dd227d152f50151 P b7ab4784c7344b939bc36f639286f377: Append to log took a long time: real 0.130s	user 0.000s	sys 0.000s
I20260709 13:21:12.243817 13304 raft_consensus.cc:3055] T 07a92dd554674067a83a9cb68c4773f2 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:21:12.244382 13304 raft_consensus.cc:740] T 07a92dd554674067a83a9cb68c4773f2 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
I20260709 13:21:12.248582  6770 leader_election.cc:304] T 3411566abe2d4c9bb4b2adfdd05e6f17 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
W20260709 13:21:12.252383  6695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 175657us
W20260709 13:21:12.187762 13303 log.cc:927] Time spent T f03d0dbf16864ca4bc1bb5e4c0334c0f P cd75a17ab2604397adab03bb8b5fd75c: Append to log took a long time: real 0.087s	user 0.000s	sys 0.000s
I20260709 13:21:12.273061  6804 raft_consensus.cc:1240] T 07a92dd554674067a83a9cb68c4773f2 P b7ab4784c7344b939bc36f639286f377 [term 17 FOLLOWER]: Rejecting Update request from peer ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 16. Current term is 17. Ops: []
W20260709 13:21:12.320580  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 222034us
I20260709 13:21:12.321038  6802 raft_consensus.cc:1275] T 711ef6523deb4cbe8ef2ba61e1c21c98 P b7ab4784c7344b939bc36f639286f377 [term 21 FOLLOWER]: Refusing update from remote peer ccd8a4c3bfe3413cb2ae219b09aea832: Log matching property violated. Preceding OpId in replica: term: 19 index: 11. Preceding OpId from leader: term: 21 index: 12. (index mismatch)
I20260709 13:21:12.325191  6880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8292e16e5654be6bc408560cf256aaa" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:21:12.327888  6798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30e88460611e47b2ba16a46a30b5f416" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
W20260709 13:21:12.329597  6770 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 60511.2us
I20260709 13:21:12.332156  6874 raft_consensus.cc:2468] T 20f6842e26174571996b8dea4151d4be P cd75a17ab2604397adab03bb8b5fd75c [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 20.
I20260709 13:21:12.328718  6798 raft_consensus.cc:2468] T 30e88460611e47b2ba16a46a30b5f416 P b7ab4784c7344b939bc36f639286f377 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 14.
W20260709 13:21:12.333511  6697 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 257149us
I20260709 13:21:12.275326 13308 raft_consensus.cc:2749] T 3411566abe2d4c9bb4b2adfdd05e6f17 P b7ab4784c7344b939bc36f639286f377 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:21:12.331064  6877 raft_consensus.cc:515] T 7887766dc6784fcaa42b35c05fea7a99 P cd75a17ab2604397adab03bb8b5fd75c [term 22 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:12.348848  6879 raft_consensus.cc:1240] T 7887766dc6784fcaa42b35c05fea7a99 P cd75a17ab2604397adab03bb8b5fd75c [term 22 FOLLOWER]: Rejecting Update request from peer b7ab4784c7344b939bc36f639286f377 for earlier term 20. Current term is 22. Ops: []
I20260709 13:21:12.354431 13336 raft_consensus.cc:2804] T ab432e62819d499eaaf3dd55481dd930 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:21:12.355057 13336 raft_consensus.cc:493] T ab432e62819d499eaaf3dd55481dd930 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:12.354930 13337 consensus_queue.cc:1048] T 853ac0a8cbd64ce99457f170216d4d0f P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Connected to new peer: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:21:12.355443 13336 raft_consensus.cc:3060] T ab432e62819d499eaaf3dd55481dd930 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:21:12.329167 13218 consensus_queue.cc:1048] T 3411566abe2d4c9bb4b2adfdd05e6f17 P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Connected to new peer: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.027s
I20260709 13:21:12.187351 13288 consensus_queue.cc:1048] T b56bf91d90824c959e21e0cee5ba1816 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.138s
I20260709 13:21:12.335983 13027 raft_consensus.cc:2749] T a3022224cc81473690653a83d4e99470 P b7ab4784c7344b939bc36f639286f377 [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 13:21:12.366359 13325 log.cc:927] Time spent T f03d0dbf16864ca4bc1bb5e4c0334c0f P b7ab4784c7344b939bc36f639286f377: Append to log took a long time: real 0.219s	user 0.000s	sys 0.001s
I20260709 13:21:12.317226 13294 raft_consensus.cc:493] T 22ccee1b570c4ad3a57bd7aec085b1b4 P cd75a17ab2604397adab03bb8b5fd75c [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:21:12.368394 13294 raft_consensus.cc:515] T 22ccee1b570c4ad3a57bd7aec085b1b4 P cd75a17ab2604397adab03bb8b5fd75c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
W20260709 13:21:12.374575 13210 consensus_meta.cc:287] T d33d5ee8ef6f415593d8df52063161ad P cd75a17ab2604397adab03bb8b5fd75c: Time spent flushing consensus metadata: real 0.708s	user 0.010s	sys 0.000s
I20260709 13:21:12.374711 13180 raft_consensus.cc:3055] T f09c2a98de1a4decabd0ff900dd44caa P ccd8a4c3bfe3413cb2ae219b09aea832 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:21:12.375084 13210 raft_consensus.cc:515] T d33d5ee8ef6f415593d8df52063161ad P cd75a17ab2604397adab03bb8b5fd75c [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:12.377460 13223 raft_consensus.cc:493] T 9b3759de40694069b13c0f8bd40e5709 P b7ab4784c7344b939bc36f639286f377 [term 16 FOLLOWER]: Starting leader election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:21:12.324784 12898 raft_consensus.cc:697] T e31b9971c15848dea59d4d4130141d9e P b7ab4784c7344b939bc36f639286f377 [term 17 LEADER]: Becoming Leader. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
I20260709 13:21:12.398077  6728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a92dd554674067a83a9cb68c4773f2" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
W20260709 13:21:12.380949  6697 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 46513.1us
I20260709 13:21:12.381457 12965 leader_election.cc:290] T c4db81d9d329422bb3b4160ca4ac2d1d P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
W20260709 13:21:12.381999 13319 log.cc:927] Time spent T 9b3759de40694069b13c0f8bd40e5709 P b7ab4784c7344b939bc36f639286f377: Append to log took a long time: real 0.249s	user 0.002s	sys 0.000s
I20260709 13:21:12.385398 13217 raft_consensus.cc:993] T d8292e16e5654be6bc408560cf256aaa P ccd8a4c3bfe3413cb2ae219b09aea832: : Instructing follower cd75a17ab2604397adab03bb8b5fd75c to start an election
I20260709 13:21:12.386219 13273 leader_election.cc:290] T 30e88460611e47b2ba16a46a30b5f416 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:21:12.386804  6803 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:32976 (request call id 3702) took 1241 ms. Trace:
I20260709 13:21:12.386304  6726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d65025eea89441290d85dd053810e31" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:21:12.415073  6726 raft_consensus.cc:3060] T 3d65025eea89441290d85dd053810e31 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:21:12.375492 13180 raft_consensus.cc:740] T f09c2a98de1a4decabd0ff900dd44caa P ccd8a4c3bfe3413cb2ae219b09aea832 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
I20260709 13:21:12.416237  6731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20f6842e26174571996b8dea4151d4be" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:21:12.416960  6801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b3759de40694069b13c0f8bd40e5709" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 17 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:21:12.417305  6731 raft_consensus.cc:3060] T 20f6842e26174571996b8dea4151d4be P ccd8a4c3bfe3413cb2ae219b09aea832 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:21:12.388259  6725 raft_consensus.cc:1275] T f03d0dbf16864ca4bc1bb5e4c0334c0f P ccd8a4c3bfe3413cb2ae219b09aea832 [term 19 FOLLOWER]: Refusing update from remote peer b7ab4784c7344b939bc36f639286f377: Log matching property violated. Preceding OpId in replica: term: 18 index: 9. Preceding OpId from leader: term: 19 index: 10. (index mismatch)
I20260709 13:21:12.418251  6802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e326172347f45e99a0d482b5d8ef768" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:21:12.391278  6727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e31b9971c15848dea59d4d4130141d9e" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:21:12.402040  6807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3411566abe2d4c9bb4b2adfdd05e6f17" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:21:12.402640  6800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a75bfe094d4bdc963aba3f08dfcd25" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:21:12.419356  6727 raft_consensus.cc:3060] T e31b9971c15848dea59d4d4130141d9e P ccd8a4c3bfe3413cb2ae219b09aea832 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:21:12.419478  6807 raft_consensus.cc:2376] T 3411566abe2d4c9bb4b2adfdd05e6f17 P b7ab4784c7344b939bc36f639286f377 [term 17 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 17. Re-sending same reply.
I20260709 13:21:12.419757  6800 raft_consensus.cc:2393] T 95a75bfe094d4bdc963aba3f08dfcd25 P b7ab4784c7344b939bc36f639286f377 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c in current term 16: Already voted for candidate b7ab4784c7344b939bc36f639286f377 in this term.
I20260709 13:21:12.402745  6804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "427c124d773f483294511e80fe340075" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:21:12.404922  6872 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53416 (request call id 3682) took 1172 ms. Trace:
W20260709 13:21:12.347193 13193 consensus_meta.cc:287] T bb3d8792045a4583ae2e965b1350a5b4 P ccd8a4c3bfe3413cb2ae219b09aea832: Time spent flushing consensus metadata: real 0.709s	user 0.012s	sys 0.002s
I20260709 13:21:12.262799 13242 raft_consensus.cc:515] T f4b8bd455d5a47c18a1380839c6e0d61 P cd75a17ab2604397adab03bb8b5fd75c [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:12.420753  6804 raft_consensus.cc:2368] T 427c124d773f483294511e80fe340075 P b7ab4784c7344b939bc36f639286f377 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c for earlier term 17. Current term is 18.
I20260709 13:21:12.405495  6729 raft_consensus.cc:1275] T 4275cf08e63345f993bce8664eada830 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 17 FOLLOWER]: Refusing update from remote peer b7ab4784c7344b939bc36f639286f377: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 17 index: 9. (term mismatch)
I20260709 13:21:12.421530  6729 pending_rounds.cc:85] T 4275cf08e63345f993bce8664eada830 P ccd8a4c3bfe3413cb2ae219b09aea832: Aborting all ops after (but not including) 8
I20260709 13:21:12.406757  6806 raft_consensus.cc:1275] T 853ac0a8cbd64ce99457f170216d4d0f P b7ab4784c7344b939bc36f639286f377 [term 15 FOLLOWER]: Refusing update from remote peer cd75a17ab2604397adab03bb8b5fd75c: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:21:12.413991  6803 rpcz_store.cc:276] 0709 13:21:11.145860 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:21:11.146759 (+   899us) service_pool.cc:224] Handling call
0709 13:21:11.147034 (+   275us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:21:11.392691 (+245657us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:21:11.392720 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:21:11.501655 (+108935us) spinlock_profiling.cc:243] Waited 4.41 ms on lock 0x7b2c00117598. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0e2a3a11 00007fcc0e2b3372 00007fcc0f9e5a01 00007fcc0f9aa43a 00007fcc0f9a983e 00007fcc1496e419 00007fcc0dee5bd4 00007fcc0dee5b62 00007fcc0dee5a91 00007fcc0dee5a0c 00007fcc0dee4cc2
0709 13:21:11.518090 (+ 16435us) log.cc:844] Serialized 26 byte log entry
0709 13:21:11.811524 (+293434us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:21:11.811561 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:21:11.811656 (+    95us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:21:12.359373 (+547717us) raft_consensus.cc:1685] finished
0709 13:21:12.359393 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:21:12.386710 (+ 27317us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":50454,"raft.queue_time_us":83327,"raft.run_cpu_time_us":151,"raft.run_wall_time_us":6747,"spinlock_wait_cycles":10140032,"thread_start_us":468789,"threads_started":2,"wal-append.queue_time_us":524732}
I20260709 13:21:12.391660  6724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de3186201e1a40d0b335eeb8b4e256e0" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:21:12.332329 13317 raft_consensus.cc:493] T de3186201e1a40d0b335eeb8b4e256e0 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:12.422263  6729 pending_rounds.cc:107] T 4275cf08e63345f993bce8664eada830 P ccd8a4c3bfe3413cb2ae219b09aea832: Aborting uncommitted NO_OP operation due to leader change: 16.9
I20260709 13:21:12.423525  6729 raft_consensus.cc:2889] T 4275cf08e63345f993bce8664eada830 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 17 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:21:12.420854  6805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a734b5ab7834e05a8c422208acc58b1" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
W20260709 13:21:12.374792 12704 consensus_meta.cc:287] T 9e326172347f45e99a0d482b5d8ef768 P ccd8a4c3bfe3413cb2ae219b09aea832: Time spent flushing consensus metadata: real 0.681s	user 0.004s	sys 0.004s
I20260709 13:21:12.416332  6723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbdf895bba214ff68685a24fd17dfb5d" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 18 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:21:12.387534 13290 raft_consensus.cc:493] T 853ac0a8cbd64ce99457f170216d4d0f P ccd8a4c3bfe3413cb2ae219b09aea832 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:21:12.405359 13247 consensus_meta.cc:287] T a3022224cc81473690653a83d4e99470 P ccd8a4c3bfe3413cb2ae219b09aea832: Time spent flushing consensus metadata: real 0.932s	user 0.014s	sys 0.002s
I20260709 13:21:12.405931 13211 leader_election.cc:290] T 4d9def8b32fd443aa94ab1420b06837b P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 20 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:21:12.431968  6730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09c2a98de1a4decabd0ff900dd44caa" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:21:12.420459  6872 rpcz_store.cc:276] 0709 13:21:11.232159 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:21:11.298456 (+ 66297us) service_pool.cc:224] Handling call
0709 13:21:11.298798 (+   342us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:21:11.345256 (+ 46458us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:21:11.345292 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:21:11.345865 (+   573us) log.cc:844] Serialized 26 byte log entry
0709 13:21:11.817257 (+471392us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:21:12.108341 (+291084us) log.cc:844] Serialized 14 byte log entry
0709 13:21:12.280714 (+172373us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:21:12.281669 (+   955us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:21:12.404677 (+123008us) raft_consensus.cc:1685] finished
0709 13:21:12.404698 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:21:12.404845 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":50574,"prepare.queue_time_us":256753,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":39,"raft.queue_time_us":182807,"raft.run_cpu_time_us":229,"raft.run_wall_time_us":17797,"thread_start_us":800968,"threads_started":3,"wal-append.queue_time_us":738400}
I20260709 13:21:12.436728  6729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4db81d9d329422bb3b4160ca4ac2d1d" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:21:12.431169  6770 leader_election.cc:304] T dbdf895bba214ff68685a24fd17dfb5d P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:21:12.405323 13223 raft_consensus.cc:3060] T 9b3759de40694069b13c0f8bd40e5709 P b7ab4784c7344b939bc36f639286f377 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:21:12.447381  6732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8292e16e5654be6bc408560cf256aaa" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:21:12.429255  6725 raft_consensus.cc:2955] T 7a734b5ab7834e05a8c422208acc58b1 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 19 FOLLOWER]: Committing config change with OpId 17.9: config changed from index 6 to 9, 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } attrs { replace: true } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } } }
I20260709 13:21:12.456238 13295 raft_consensus.cc:2749] T dbdf895bba214ff68685a24fd17dfb5d P b7ab4784c7344b939bc36f639286f377 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:21:12.456151 12863 consensus_queue.cc:1059] T 7c37d41cd9164c15a6826ca62a851a69 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: INVALID_TERM, Last received: 15.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
W20260709 13:21:12.457595 13324 log.cc:927] Time spent T 3fa34c08b205435dba97346991aa1f92 P 7ba59cc884714e8aa5f3f0ecaed84cbb: Append to log took a long time: real 0.274s	user 0.001s	sys 0.000s
I20260709 13:21:12.362007 13298 consensus_queue.cc:1048] T 7887766dc6784fcaa42b35c05fea7a99 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.072s
I20260709 13:21:12.317126 13216 consensus_queue.cc:237] T 3d65025eea89441290d85dd053810e31 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.10, Last appended by leader: 10, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:12.464295  6729 raft_consensus.cc:2393] T c4db81d9d329422bb3b4160ca4ac2d1d P ccd8a4c3bfe3413cb2ae219b09aea832 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7ab4784c7344b939bc36f639286f377 in current term 19: Already voted for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in this term.
I20260709 13:21:12.387768 13076 consensus_queue.cc:1048] T 4d9def8b32fd443aa94ab1420b06837b P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.050s
I20260709 13:21:12.465556  6726 raft_consensus.cc:2468] T 3d65025eea89441290d85dd053810e31 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 20.
W20260709 13:21:12.462499 13314 log.cc:927] Time spent T 44bde925b2e541b69890d70715b85176 P b7ab4784c7344b939bc36f639286f377: Append to log took a long time: real 0.064s	user 0.001s	sys 0.000s
I20260709 13:21:12.324028 13176 consensus_queue.cc:237] T 427c124d773f483294511e80fe340075 P 7ba59cc884714e8aa5f3f0ecaed84cbb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 18, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } attrs { replace: true } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:21:12.474668  6801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab432e62819d499eaaf3dd55481dd930" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
W20260709 13:21:12.470983  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 143026us
I20260709 13:21:12.475044  6727 raft_consensus.cc:2468] T e31b9971c15848dea59d4d4130141d9e P ccd8a4c3bfe3413cb2ae219b09aea832 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 17.
I20260709 13:21:12.440517 13217 raft_consensus.cc:493] T 4275cf08e63345f993bce8664eada830 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:12.475039  6731 raft_consensus.cc:2468] T 20f6842e26174571996b8dea4151d4be P ccd8a4c3bfe3413cb2ae219b09aea832 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 20.
I20260709 13:21:12.477336  6798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1704639a875409b9959353527b3fd68" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:21:12.442843 13273 raft_consensus.cc:1081] T d8292e16e5654be6bc408560cf256aaa P ccd8a4c3bfe3413cb2ae219b09aea832 [term 17 LEADER]: Signalling peer cd75a17ab2604397adab03bb8b5fd75c to start an election
I20260709 13:21:12.489605  6695 leader_election.cc:304] T 30e88460611e47b2ba16a46a30b5f416 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
I20260709 13:21:12.510048  6844 leader_election.cc:304] T bd6869f07b5a4885a0b99fbe60c3b175 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:21:12.527496  6801 raft_consensus.cc:2393] T ab432e62819d499eaaf3dd55481dd930 P b7ab4784c7344b939bc36f639286f377 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c in current term 21: Already voted for candidate b7ab4784c7344b939bc36f639286f377 in this term.
I20260709 13:21:12.344697 13304 consensus_queue.cc:260] T 07a92dd554674067a83a9cb68c4773f2 P ccd8a4c3bfe3413cb2ae219b09aea832 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:12.538287  6844 leader_election.cc:304] T f03d0dbf16864ca4bc1bb5e4c0334c0f P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:21:12.433554 12704 raft_consensus.cc:515] T 9e326172347f45e99a0d482b5d8ef768 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:12.570290  6873 raft_consensus.cc:1275] T 3fa34c08b205435dba97346991aa1f92 P cd75a17ab2604397adab03bb8b5fd75c [term 23 FOLLOWER]: Refusing update from remote peer 7ba59cc884714e8aa5f3f0ecaed84cbb: Log matching property violated. Preceding OpId in replica: term: 21 index: 16. Preceding OpId from leader: term: 23 index: 17. (index mismatch)
I20260709 13:21:12.575879  6799 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:32976 (request call id 3707) took 1153 ms. Trace:
I20260709 13:21:12.576419  6799 rpcz_store.cc:276] 0709 13:21:11.422058 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:21:11.446253 (+ 24195us) service_pool.cc:224] Handling call
0709 13:21:11.446580 (+   327us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:21:11.516458 (+ 69878us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:21:11.516508 (+    50us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:21:11.517381 (+   873us) log.cc:844] Serialized 52 byte log entry
0709 13:21:11.804558 (+287177us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:21:11.804605 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:21:11.804688 (+    83us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:21:12.575643 (+770955us) raft_consensus.cc:1685] finished
0709 13:21:12.575670 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:21:12.575813 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":92849,"raft.queue_time_us":71382,"raft.run_cpu_time_us":206,"raft.run_wall_time_us":11172,"thread_start_us":257975,"threads_started":1,"wal-append.queue_time_us":499595}
I20260709 13:21:12.578328  6799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30e88460611e47b2ba16a46a30b5f416" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:21:12.578922  6799 raft_consensus.cc:2376] T 30e88460611e47b2ba16a46a30b5f416 P b7ab4784c7344b939bc36f639286f377 [term 14 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 14. Re-sending same reply.
I20260709 13:21:12.579880  6799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de3186201e1a40d0b335eeb8b4e256e0" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:21:12.582775  6799 raft_consensus.cc:2393] T de3186201e1a40d0b335eeb8b4e256e0 P b7ab4784c7344b939bc36f639286f377 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c in current term 18: Already voted for candidate b7ab4784c7344b939bc36f639286f377 in this term.
W20260709 13:21:12.584920  6697 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 114817us
I20260709 13:21:12.442034 13317 raft_consensus.cc:515] T de3186201e1a40d0b335eeb8b4e256e0 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:12.472525 13027 consensus_queue.cc:1048] T f03d0dbf16864ca4bc1bb5e4c0334c0f P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.103s
I20260709 13:21:12.565901 13030 raft_consensus.cc:2749] T bd6869f07b5a4885a0b99fbe60c3b175 P cd75a17ab2604397adab03bb8b5fd75c [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:21:12.591907  6798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "853ac0a8cbd64ce99457f170216d4d0f" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:21:12.593528  6878 raft_consensus.cc:1275] T 9b3759de40694069b13c0f8bd40e5709 P cd75a17ab2604397adab03bb8b5fd75c [term 16 FOLLOWER]: Refusing update from remote peer ccd8a4c3bfe3413cb2ae219b09aea832: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:21:12.594336  6875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b56bf91d90824c959e21e0cee5ba1816" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:21:12.595111  6872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22ccee1b570c4ad3a57bd7aec085b1b4" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:21:12.596076  6876 raft_consensus.cc:1240] T 4b8cacb381b746da8d0049b0a83b41dd P cd75a17ab2604397adab03bb8b5fd75c [term 19 FOLLOWER]: Rejecting Update request from peer ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 18. Current term is 19. Ops: []
I20260709 13:21:12.596874  6881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab432e62819d499eaaf3dd55481dd930" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:21:12.443010 13290 raft_consensus.cc:515] T 853ac0a8cbd64ce99457f170216d4d0f P ccd8a4c3bfe3413cb2ae219b09aea832 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:12.599278  6876 raft_consensus.cc:1275] T 711ef6523deb4cbe8ef2ba61e1c21c98 P cd75a17ab2604397adab03bb8b5fd75c [term 21 FOLLOWER]: Refusing update from remote peer ccd8a4c3bfe3413cb2ae219b09aea832: Log matching property violated. Preceding OpId in replica: term: 19 index: 11. Preceding OpId from leader: term: 21 index: 12. (index mismatch)
I20260709 13:21:12.582541 13205 raft_consensus.cc:2804] T 30e88460611e47b2ba16a46a30b5f416 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:21:12.610383  6880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30e88460611e47b2ba16a46a30b5f416" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:21:12.591935 12898 consensus_queue.cc:237] T e31b9971c15848dea59d4d4130141d9e P b7ab4784c7344b939bc36f639286f377 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:12.626271  6878 raft_consensus.cc:1275] T bd6869f07b5a4885a0b99fbe60c3b175 P cd75a17ab2604397adab03bb8b5fd75c [term 20 FOLLOWER]: Refusing update from remote peer ccd8a4c3bfe3413cb2ae219b09aea832: Log matching property violated. Preceding OpId in replica: term: 18 index: 9. Preceding OpId from leader: term: 20 index: 10. (index mismatch)
I20260709 13:21:12.613754  6807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7887766dc6784fcaa42b35c05fea7a99" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
W20260709 13:21:12.614791 13331 log.cc:927] Time spent T ce4f062dcd314d43a63ca74067cb5ee3 P 7ba59cc884714e8aa5f3f0ecaed84cbb: Append to log took a long time: real 0.141s	user 0.000s	sys 0.001s
I20260709 13:21:12.596724 13291 consensus_queue.cc:1048] T 44bde925b2e541b69890d70715b85176 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.040s
I20260709 13:21:12.616865 13210 leader_election.cc:290] T d33d5ee8ef6f415593d8df52063161ad P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 17 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:21:12.617311 13273 raft_consensus.cc:493] T 3411566abe2d4c9bb4b2adfdd05e6f17 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:12.637677 12704 leader_election.cc:290] T 9e326172347f45e99a0d482b5d8ef768 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 15 election: Requested vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:21:12.638236 13273 raft_consensus.cc:515] T 3411566abe2d4c9bb4b2adfdd05e6f17 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:12.640565 13273 leader_election.cc:290] T 3411566abe2d4c9bb4b2adfdd05e6f17 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
W20260709 13:21:12.617623 13225 consensus_meta.cc:287] T 4b8cacb381b746da8d0049b0a83b41dd P 7ba59cc884714e8aa5f3f0ecaed84cbb: Time spent flushing consensus metadata: real 0.828s	user 0.011s	sys 0.000s
I20260709 13:21:12.641589 13225 raft_consensus.cc:2749] T 4b8cacb381b746da8d0049b0a83b41dd P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:21:12.642565  7503 raft_consensus.cc:1240] T 4b8cacb381b746da8d0049b0a83b41dd P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 19 FOLLOWER]: Rejecting Update request from peer ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 18. Current term is 19. Ops: []
I20260709 13:21:12.645669 13317 leader_election.cc:290] T de3186201e1a40d0b335eeb8b4e256e0 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:21:12.647776 13290 leader_election.cc:290] T 853ac0a8cbd64ce99457f170216d4d0f P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:21:12.615928 13242 leader_election.cc:290] T f4b8bd455d5a47c18a1380839c6e0d61 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:21:12.527031 13217 raft_consensus.cc:515] T 4275cf08e63345f993bce8664eada830 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:12.586938 13344 raft_consensus.cc:2749] T f03d0dbf16864ca4bc1bb5e4c0334c0f P cd75a17ab2604397adab03bb8b5fd75c [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 13:21:12.600804 13264 consensus_meta.cc:287] T 7a734b5ab7834e05a8c422208acc58b1 P cd75a17ab2604397adab03bb8b5fd75c: Time spent flushing consensus metadata: real 0.516s	user 0.010s	sys 0.000s
I20260709 13:21:12.649374 13264 raft_consensus.cc:515] T 7a734b5ab7834e05a8c422208acc58b1 P cd75a17ab2604397adab03bb8b5fd75c [term 20 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } attrs { replace: true } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:21:12.650339 13217 leader_election.cc:290] T 4275cf08e63345f993bce8664eada830 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:21:12.650339  6801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d9def8b32fd443aa94ab1420b06837b" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 20 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:21:12.620361  6880 raft_consensus.cc:2468] T 30e88460611e47b2ba16a46a30b5f416 P cd75a17ab2604397adab03bb8b5fd75c [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 14.
W20260709 13:21:12.622437 13330 log.cc:927] Time spent T bd6869f07b5a4885a0b99fbe60c3b175 P ccd8a4c3bfe3413cb2ae219b09aea832: Append to log took a long time: real 0.257s	user 0.001s	sys 0.002s
I20260709 13:21:12.613373 13294 leader_election.cc:290] T 22ccee1b570c4ad3a57bd7aec085b1b4 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:21:12.652184  6801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c240553ce044eedb41541d72b9475d7" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:21:12.571132 13247 consensus_queue.cc:1059] T 07a92dd554674067a83a9cb68c4773f2 P ccd8a4c3bfe3413cb2ae219b09aea832 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: INVALID_TERM, Last received: 16.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.028s
I20260709 13:21:12.628924  6724 raft_consensus.cc:2468] T de3186201e1a40d0b335eeb8b4e256e0 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 18.
I20260709 13:21:12.652827  6801 raft_consensus.cc:2376] T 2c240553ce044eedb41541d72b9475d7 P b7ab4784c7344b939bc36f639286f377 [term 18 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 18. Re-sending same reply.
I20260709 13:21:12.653877  6801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77e330a82df4b43a745d57a68f6f057" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:21:12.628228 13205 raft_consensus.cc:493] T 30e88460611e47b2ba16a46a30b5f416 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:12.627924 13298 raft_consensus.cc:493] T f3f9c2e2bf644115957398fe4c9459db P b7ab4784c7344b939bc36f639286f377 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader cd75a17ab2604397adab03bb8b5fd75c)
I20260709 13:21:12.635246 13335 consensus_queue.cc:1048] T 4275cf08e63345f993bce8664eada830 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.163s
I20260709 13:21:12.569962 13193 consensus_queue.cc:1048] T 711ef6523deb4cbe8ef2ba61e1c21c98 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.032s
I20260709 13:21:12.656869  6801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3022224cc81473690653a83d4e99470" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:21:12.655040 13205 raft_consensus.cc:3060] T 30e88460611e47b2ba16a46a30b5f416 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:21:12.666769  6873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4db81d9d329422bb3b4160ca4ac2d1d" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:21:12.617841  6844 leader_election.cc:304] T 9b3759de40694069b13c0f8bd40e5709 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:21:12.664659  6804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8cee0accdb8499c86d4414b72565a38" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:21:12.677285  6798 raft_consensus.cc:2468] T 853ac0a8cbd64ce99457f170216d4d0f P b7ab4784c7344b939bc36f639286f377 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 15.
W20260709 13:21:12.678793  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 68755.9us
I20260709 13:21:12.680337  6844 leader_election.cc:400] T 427c124d773f483294511e80fe340075 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 17 pre-election: Vote denied by peer b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817) with higher term. Message: Invalid argument: T 427c124d773f483294511e80fe340075 P b7ab4784c7344b939bc36f639286f377 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c for earlier term 17. Current term is 18.
I20260709 13:21:12.680855  6844 leader_election.cc:403] T 427c124d773f483294511e80fe340075 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 17 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:21:12.666018 13202 raft_consensus.cc:493] T 2c240553ce044eedb41541d72b9475d7 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:21:12.655200 13298 raft_consensus.cc:515] T f3f9c2e2bf644115957398fe4c9459db P b7ab4784c7344b939bc36f639286f377 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:12.665961 13223 raft_consensus.cc:515] T 9b3759de40694069b13c0f8bd40e5709 P b7ab4784c7344b939bc36f639286f377 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:12.690407 13298 leader_election.cc:290] T f3f9c2e2bf644115957398fe4c9459db P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:21:12.683284 13202 raft_consensus.cc:515] T 2c240553ce044eedb41541d72b9475d7 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:12.694175 13202 leader_election.cc:290] T 2c240553ce044eedb41541d72b9475d7 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:21:12.694824  6807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44bde925b2e541b69890d70715b85176" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:21:12.690414 13223 leader_election.cc:290] T 9b3759de40694069b13c0f8bd40e5709 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 17 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:21:12.696449  6807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34f36d59d88f40fe8a2805e604fc6c0a" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:21:12.697185 13290 raft_consensus.cc:493] T ce4f062dcd314d43a63ca74067cb5ee3 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:21:12.699849 13344 raft_consensus.cc:2749] T 9b3759de40694069b13c0f8bd40e5709 P cd75a17ab2604397adab03bb8b5fd75c [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:21:12.711140  6874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de3186201e1a40d0b335eeb8b4e256e0" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:21:12.700299  6873 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d8292e16e5654be6bc408560cf256aaa"
dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
 from {username='slave'} at 127.0.0.1:53416
I20260709 13:21:12.713367  6873 raft_consensus.cc:493] T d8292e16e5654be6bc408560cf256aaa P cd75a17ab2604397adab03bb8b5fd75c [term 17 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:21:12.713891  6873 raft_consensus.cc:3060] T d8292e16e5654be6bc408560cf256aaa P cd75a17ab2604397adab03bb8b5fd75c [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:21:12.701061  6875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e326172347f45e99a0d482b5d8ef768" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:21:12.700743  6804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a92dd554674067a83a9cb68c4773f2" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:21:12.701813  6872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3411566abe2d4c9bb4b2adfdd05e6f17" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:21:12.701891  6807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ba5dac66ab5497e9e336f2a3c28cda5" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:21:12.717762  6875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "853ac0a8cbd64ce99457f170216d4d0f" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:21:12.702409  6798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ba5dac66ab5497e9e336f2a3c28cda5" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:21:12.708877  6801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1704639a875409b9959353527b3fd68" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: true dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:21:12.718815  6801 raft_consensus.cc:3055] T a1704639a875409b9959353527b3fd68 P b7ab4784c7344b939bc36f639286f377 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:21:12.719231  6801 raft_consensus.cc:740] T a1704639a875409b9959353527b3fd68 P b7ab4784c7344b939bc36f639286f377 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
I20260709 13:21:12.719287  6874 raft_consensus.cc:2468] T de3186201e1a40d0b335eeb8b4e256e0 P cd75a17ab2604397adab03bb8b5fd75c [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 18.
I20260709 13:21:12.720973  6874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4275cf08e63345f993bce8664eada830" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 18 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:21:12.721921  6874 raft_consensus.cc:2468] T 4275cf08e63345f993bce8664eada830 P cd75a17ab2604397adab03bb8b5fd75c [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 17.
I20260709 13:21:12.723066  6874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c240553ce044eedb41541d72b9475d7" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:21:12.724562  6874 raft_consensus.cc:2393] T 2c240553ce044eedb41541d72b9475d7 P cd75a17ab2604397adab03bb8b5fd75c [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ccd8a4c3bfe3413cb2ae219b09aea832 in current term 18: Already voted for candidate cd75a17ab2604397adab03bb8b5fd75c in this term.
I20260709 13:21:12.727113  6804 raft_consensus.cc:2393] T 07a92dd554674067a83a9cb68c4773f2 P b7ab4784c7344b939bc36f639286f377 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c in current term 17: Already voted for candidate b7ab4784c7344b939bc36f639286f377 in this term.
I20260709 13:21:12.730976  6806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c7f33e544204fbaac4078e3e83bbf4e" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:21:12.731336  6807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90d42e216d9741e190bca19a781291fd" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:21:12.731047  5625 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:21:12.736164  6804 raft_consensus.cc:1275] T 3411566abe2d4c9bb4b2adfdd05e6f17 P b7ab4784c7344b939bc36f639286f377 [term 17 FOLLOWER]: Refusing update from remote peer cd75a17ab2604397adab03bb8b5fd75c: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:21:12.709458 13291 raft_consensus.cc:493] T d33d5ee8ef6f415593d8df52063161ad P ccd8a4c3bfe3413cb2ae219b09aea832 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:21:12.746433  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 66264.5us
I20260709 13:21:12.747663  6844 leader_election.cc:304] T 9e326172347f45e99a0d482b5d8ef768 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:21:12.748904  6798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce4f062dcd314d43a63ca74067cb5ee3" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:21:12.740783  6801 consensus_queue.cc:260] T a1704639a875409b9959353527b3fd68 P b7ab4784c7344b939bc36f639286f377 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.12, Last appended by leader: 12, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:12.751368  6801 raft_consensus.cc:3060] T a1704639a875409b9959353527b3fd68 P b7ab4784c7344b939bc36f639286f377 [term 19 FOLLOWER]: Advancing to term 21
W20260709 13:21:12.741616 13022 consensus_meta.cc:287] T ab432e62819d499eaaf3dd55481dd930 P cd75a17ab2604397adab03bb8b5fd75c: Time spent flushing consensus metadata: real 0.516s	user 0.014s	sys 0.000s
I20260709 13:21:12.760095  6873 raft_consensus.cc:515] T d8292e16e5654be6bc408560cf256aaa P cd75a17ab2604397adab03bb8b5fd75c [term 18 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:12.775904  6844 leader_election.cc:304] T 30e88460611e47b2ba16a46a30b5f416 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: ccd8a4c3bfe3413cb2ae219b09aea832
W20260709 13:21:12.778354  6697 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.68:45071, user_credentials={real_user=slave}} blocked reactor thread for 76987.5us
I20260709 13:21:12.740303 13210 raft_consensus.cc:2749] T 427c124d773f483294511e80fe340075 P cd75a17ab2604397adab03bb8b5fd75c [term 18 FOLLOWER]: Leader pre-election lost for term 17. Reason: Vote denied by peer b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817) with higher term. Message: Invalid argument: T 427c124d773f483294511e80fe340075 P b7ab4784c7344b939bc36f639286f377 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c for earlier term 17. Current term is 18.
I20260709 13:21:12.780526  6873 leader_election.cc:290] T d8292e16e5654be6bc408560cf256aaa P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 18 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:21:12.783281  6798 raft_consensus.cc:1275] T 95a75bfe094d4bdc963aba3f08dfcd25 P b7ab4784c7344b939bc36f639286f377 [term 16 FOLLOWER]: Refusing update from remote peer cd75a17ab2604397adab03bb8b5fd75c: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:21:12.812453  6804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8292e16e5654be6bc408560cf256aaa" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:21:12.818789  6804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22ccee1b570c4ad3a57bd7aec085b1b4" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:21:12.777602 13217 raft_consensus.cc:493] T f03d0dbf16864ca4bc1bb5e4c0334c0f P ccd8a4c3bfe3413cb2ae219b09aea832 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:12.734208 13290 raft_consensus.cc:515] T ce4f062dcd314d43a63ca74067cb5ee3 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } attrs { replace: true } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:21:12.770480 13344 raft_consensus.cc:2749] T 9e326172347f45e99a0d482b5d8ef768 P cd75a17ab2604397adab03bb8b5fd75c [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:21:12.825937  6872 raft_consensus.cc:1275] T bb3d8792045a4583ae2e965b1350a5b4 P cd75a17ab2604397adab03bb8b5fd75c [term 18 FOLLOWER]: Refusing update from remote peer 7ba59cc884714e8aa5f3f0ecaed84cbb: Log matching property violated. Preceding OpId in replica: term: 16 index: 14. Preceding OpId from leader: term: 18 index: 15. (index mismatch)
I20260709 13:21:12.827605  6798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d33d5ee8ef6f415593d8df52063161ad" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:21:12.828398  6798 raft_consensus.cc:2468] T d33d5ee8ef6f415593d8df52063161ad P b7ab4784c7344b939bc36f639286f377 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 16.
I20260709 13:21:12.751349 13291 raft_consensus.cc:515] T d33d5ee8ef6f415593d8df52063161ad P ccd8a4c3bfe3413cb2ae219b09aea832 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:12.817880 13030 raft_consensus.cc:493] T 713b5728a197487c9300b310ab94e5a3 P cd75a17ab2604397adab03bb8b5fd75c [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:12.817026 13242 raft_consensus.cc:2804] T 30e88460611e47b2ba16a46a30b5f416 P cd75a17ab2604397adab03bb8b5fd75c [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:21:12.833217  6807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d33d5ee8ef6f415593d8df52063161ad" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:21:12.832412  6697 leader_election.cc:304] T 22ccee1b570c4ad3a57bd7aec085b1b4 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:21:12.834362  6804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e31b9971c15848dea59d4d4130141d9e" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
W20260709 13:21:12.836660  6695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 345751us
I20260709 13:21:12.836256  6801 raft_consensus.cc:2468] T a1704639a875409b9959353527b3fd68 P b7ab4784c7344b939bc36f639286f377 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 21.
I20260709 13:21:12.838503  6807 raft_consensus.cc:3060] T d33d5ee8ef6f415593d8df52063161ad P b7ab4784c7344b939bc36f639286f377 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:21:12.838680  6801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a734b5ab7834e05a8c422208acc58b1" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:21:12.794166 13294 consensus_queue.cc:1048] T 853ac0a8cbd64ce99457f170216d4d0f P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.045s
I20260709 13:21:12.778268 13022 raft_consensus.cc:515] T ab432e62819d499eaaf3dd55481dd930 P cd75a17ab2604397adab03bb8b5fd75c [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:12.846378  6731 raft_consensus.cc:1275] T bb3d8792045a4583ae2e965b1350a5b4 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 18 FOLLOWER]: Refusing update from remote peer 7ba59cc884714e8aa5f3f0ecaed84cbb: Log matching property violated. Preceding OpId in replica: term: 17 index: 15. Preceding OpId from leader: term: 18 index: 15. (term mismatch)
I20260709 13:21:12.841429  6798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4b8bd455d5a47c18a1380839c6e0d61" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:21:12.847394  6731 pending_rounds.cc:85] T bb3d8792045a4583ae2e965b1350a5b4 P ccd8a4c3bfe3413cb2ae219b09aea832: Aborting all ops after (but not including) 14
I20260709 13:21:12.818547 13341 consensus_queue.cc:1048] T 9b3759de40694069b13c0f8bd40e5709 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.020s
I20260709 13:21:12.847728  6731 pending_rounds.cc:107] T bb3d8792045a4583ae2e965b1350a5b4 P ccd8a4c3bfe3413cb2ae219b09aea832: Aborting uncommitted NO_OP operation due to leader change: 17.15
I20260709 13:21:12.792460 13230 consensus_queue.cc:1059] T 4b8cacb381b746da8d0049b0a83b41dd P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false }, Status: INVALID_TERM, Last received: 18.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.043s
I20260709 13:21:12.850288 13305 raft_consensus.cc:3055] T 7c37d41cd9164c15a6826ca62a851a69 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:21:12.841284 13030 raft_consensus.cc:515] T 713b5728a197487c9300b310ab94e5a3 P cd75a17ab2604397adab03bb8b5fd75c [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:12.965389  6732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1704639a875409b9959353527b3fd68" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:21:12.820976 13176 consensus_queue.cc:1048] T 3fa34c08b205435dba97346991aa1f92 P 7ba59cc884714e8aa5f3f0ecaed84cbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 15, Time since last communication: 0.026s
I20260709 13:21:12.855105  6731 raft_consensus.cc:2889] T bb3d8792045a4583ae2e965b1350a5b4 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 18 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:21:12.856889  6801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8292e16e5654be6bc408560cf256aaa" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: true dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:21:12.825156 13217 raft_consensus.cc:515] T f03d0dbf16864ca4bc1bb5e4c0334c0f P ccd8a4c3bfe3413cb2ae219b09aea832 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:12.857049 13242 raft_consensus.cc:697] T 30e88460611e47b2ba16a46a30b5f416 P cd75a17ab2604397adab03bb8b5fd75c [term 14 LEADER]: Becoming Leader. State: Replica: cd75a17ab2604397adab03bb8b5fd75c, State: Running, Role: LEADER
I20260709 13:21:12.898718 13205 raft_consensus.cc:515] T 30e88460611e47b2ba16a46a30b5f416 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:12.896808  6881 raft_consensus.cc:2468] T ab432e62819d499eaaf3dd55481dd930 P cd75a17ab2604397adab03bb8b5fd75c [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 21.
I20260709 13:21:12.907414 13291 leader_election.cc:290] T d33d5ee8ef6f415593d8df52063161ad P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:21:12.897190  6798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3411566abe2d4c9bb4b2adfdd05e6f17" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
W20260709 13:21:12.905238 13354 log.cc:927] Time spent T 427c124d773f483294511e80fe340075 P 7ba59cc884714e8aa5f3f0ecaed84cbb: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 13:21:12.913407 13336 raft_consensus.cc:515] T ab432e62819d499eaaf3dd55481dd930 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:12.891856  6804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4275cf08e63345f993bce8664eada830" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 18 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
W20260709 13:21:12.901248 13353 log.cc:927] Time spent T b56bf91d90824c959e21e0cee5ba1816 P ccd8a4c3bfe3413cb2ae219b09aea832: Append to log took a long time: real 0.064s	user 0.001s	sys 0.000s
I20260709 13:21:12.898159 13290 leader_election.cc:290] T ce4f062dcd314d43a63ca74067cb5ee3 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:21:12.903538 13022 leader_election.cc:290] T ab432e62819d499eaaf3dd55481dd930 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 21 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:21:12.968812  6801 raft_consensus.cc:3060] T d8292e16e5654be6bc408560cf256aaa P b7ab4784c7344b939bc36f639286f377 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:21:12.969969  6803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "853ac0a8cbd64ce99457f170216d4d0f" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:21:12.973431  6807 raft_consensus.cc:2468] T d33d5ee8ef6f415593d8df52063161ad P b7ab4784c7344b939bc36f639286f377 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 17.
W20260709 13:21:12.967326 13357 log.cc:927] Time spent T 44bde925b2e541b69890d70715b85176 P ccd8a4c3bfe3413cb2ae219b09aea832: Append to log took a long time: real 0.071s	user 0.001s	sys 0.000s
I20260709 13:21:12.976372  6731 raft_consensus.cc:1275] T 3fa34c08b205435dba97346991aa1f92 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 23 FOLLOWER]: Refusing update from remote peer 7ba59cc884714e8aa5f3f0ecaed84cbb: Log matching property violated. Preceding OpId in replica: term: 21 index: 16. Preceding OpId from leader: term: 23 index: 17. (index mismatch)
I20260709 13:21:12.989378  6803 raft_consensus.cc:2468] T 853ac0a8cbd64ce99457f170216d4d0f P b7ab4784c7344b939bc36f639286f377 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 15.
I20260709 13:21:12.990286  6731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d9def8b32fd443aa94ab1420b06837b" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 20 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:21:12.990958  6731 raft_consensus.cc:3060] T 4d9def8b32fd443aa94ab1420b06837b P ccd8a4c3bfe3413cb2ae219b09aea832 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:21:12.960139 13294 raft_consensus.cc:493] T 4f00a2e87e56452083b759f60d461ee3 P cd75a17ab2604397adab03bb8b5fd75c [term 20 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:21:12.966811 13305 raft_consensus.cc:740] T 7c37d41cd9164c15a6826ca62a851a69 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
I20260709 13:21:12.992210  6805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c240553ce044eedb41541d72b9475d7" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:21:12.993000  6805 raft_consensus.cc:2393] T 2c240553ce044eedb41541d72b9475d7 P b7ab4784c7344b939bc36f639286f377 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ccd8a4c3bfe3413cb2ae219b09aea832 in current term 18: Already voted for candidate cd75a17ab2604397adab03bb8b5fd75c in this term.
I20260709 13:21:12.994319  6802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de3186201e1a40d0b335eeb8b4e256e0" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:21:12.995132  6802 raft_consensus.cc:2468] T de3186201e1a40d0b335eeb8b4e256e0 P b7ab4784c7344b939bc36f639286f377 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 18.
I20260709 13:21:12.994640 13242 consensus_queue.cc:237] T 30e88460611e47b2ba16a46a30b5f416 P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:12.972707 13030 leader_election.cc:290] T 713b5728a197487c9300b310ab94e5a3 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:21:12.984095  6804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e326172347f45e99a0d482b5d8ef768" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:21:13.004616  6873 raft_consensus.cc:1240] T 7a734b5ab7834e05a8c422208acc58b1 P cd75a17ab2604397adab03bb8b5fd75c [term 20 FOLLOWER]: Rejecting Update request from peer b7ab4784c7344b939bc36f639286f377 for earlier term 19. Current term is 20. Ops: []
I20260709 13:21:13.009766  6873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f9c2e2bf644115957398fe4c9459db" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:21:13.010589  6874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b3759de40694069b13c0f8bd40e5709" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:21:12.977181  6798 raft_consensus.cc:2468] T 3411566abe2d4c9bb4b2adfdd05e6f17 P b7ab4784c7344b939bc36f639286f377 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 17.
I20260709 13:21:13.007439  6875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4db81d9d329422bb3b4160ca4ac2d1d" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:21:13.014334  6727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7887766dc6784fcaa42b35c05fea7a99" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:21:13.015165  6727 raft_consensus.cc:3060] T 7887766dc6784fcaa42b35c05fea7a99 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:21:13.007587  6731 raft_consensus.cc:2468] T 4d9def8b32fd443aa94ab1420b06837b P ccd8a4c3bfe3413cb2ae219b09aea832 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 20.
I20260709 13:21:13.011147  6874 raft_consensus.cc:3060] T 9b3759de40694069b13c0f8bd40e5709 P cd75a17ab2604397adab03bb8b5fd75c [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:21:13.016492  6731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1704639a875409b9959353527b3fd68" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: true dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:21:13.023514  6727 raft_consensus.cc:2468] T 7887766dc6784fcaa42b35c05fea7a99 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 21.
I20260709 13:21:13.024238  6801 raft_consensus.cc:2468] T d8292e16e5654be6bc408560cf256aaa P b7ab4784c7344b939bc36f639286f377 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 18.
I20260709 13:21:12.994410 13305 consensus_queue.cc:260] T 7c37d41cd9164c15a6826ca62a851a69 P ccd8a4c3bfe3413cb2ae219b09aea832 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 13, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:13.028792  6731 raft_consensus.cc:1240] T c4db81d9d329422bb3b4160ca4ac2d1d P ccd8a4c3bfe3413cb2ae219b09aea832 [term 19 FOLLOWER]: Rejecting Update request from peer cd75a17ab2604397adab03bb8b5fd75c for earlier term 18. Current term is 19. Ops: []
I20260709 13:21:13.025302 13216 raft_consensus.cc:493] T bd6869f07b5a4885a0b99fbe60c3b175 P b7ab4784c7344b939bc36f639286f377 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:13.037182 13216 raft_consensus.cc:515] T bd6869f07b5a4885a0b99fbe60c3b175 P b7ab4784c7344b939bc36f639286f377 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
W20260709 13:21:13.039129  6772 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:21:13.039767 13216 leader_election.cc:290] T bd6869f07b5a4885a0b99fbe60c3b175 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:21:13.042762  6874 raft_consensus.cc:2468] T 9b3759de40694069b13c0f8bd40e5709 P cd75a17ab2604397adab03bb8b5fd75c [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 17.
I20260709 13:21:13.015403 13294 raft_consensus.cc:515] T 4f00a2e87e56452083b759f60d461ee3 P cd75a17ab2604397adab03bb8b5fd75c [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:21:13.057132 13294 leader_election.cc:290] T 4f00a2e87e56452083b759f60d461ee3 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:21:13.057960 13249 leader_election.cc:290] T 7887766dc6784fcaa42b35c05fea7a99 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 21 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:21:13.057065 13335 raft_consensus.cc:2955] T ce4f062dcd314d43a63ca74067cb5ee3 P b7ab4784c7344b939bc36f639286f377 [term 15 LEADER]: Committing config change with OpId 15.11: config changed from index 3 to 11, VOTER ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65) evicted. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } } }
I20260709 13:21:13.058688  6772 leader_election.cc:304] T de3186201e1a40d0b335eeb8b4e256e0 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:21:13.059579 13227 raft_consensus.cc:2804] T de3186201e1a40d0b335eeb8b4e256e0 P b7ab4784c7344b939bc36f639286f377 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:21:13.060019 13227 raft_consensus.cc:493] T de3186201e1a40d0b335eeb8b4e256e0 P b7ab4784c7344b939bc36f639286f377 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:13.060485 13227 raft_consensus.cc:3060] T de3186201e1a40d0b335eeb8b4e256e0 P b7ab4784c7344b939bc36f639286f377 [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:21:13.060958 13332 log.cc:927] Time spent T bb3d8792045a4583ae2e965b1350a5b4 P 7ba59cc884714e8aa5f3f0ecaed84cbb: Append to log took a long time: real 0.477s	user 0.000s	sys 0.002s
I20260709 13:21:13.065202  6801 raft_consensus.cc:1275] T 427c124d773f483294511e80fe340075 P b7ab4784c7344b939bc36f639286f377 [term 18 FOLLOWER]: Refusing update from remote peer 7ba59cc884714e8aa5f3f0ecaed84cbb: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 13:21:13.065513  6772 leader_election.cc:304] T 20f6842e26174571996b8dea4151d4be P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:21:13.066843 13205 leader_election.cc:290] T 30e88460611e47b2ba16a46a30b5f416 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 15 election: Requested vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:21:13.067643 13233 consensus_queue.cc:1048] T bb3d8792045a4583ae2e965b1350a5b4 P 7ba59cc884714e8aa5f3f0ecaed84cbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:21:13.071530  6724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22ccee1b570c4ad3a57bd7aec085b1b4" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:21:13.078385  6724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a734b5ab7834e05a8c422208acc58b1" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:21:13.079931  6877 leader_election.cc:290] T 7887766dc6784fcaa42b35c05fea7a99 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 22 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:21:13.076601 13176 consensus_queue.cc:1048] T 3fa34c08b205435dba97346991aa1f92 P 7ba59cc884714e8aa5f3f0ecaed84cbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.009s
I20260709 13:21:13.076517 13216 raft_consensus.cc:2804] T 20f6842e26174571996b8dea4151d4be P b7ab4784c7344b939bc36f639286f377 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:21:13.083362  6877 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RunLeaderElection from 127.0.0.1:53406 (request call id 3027) took 1271 ms. Trace:
I20260709 13:21:13.083803  6877 rpcz_store.cc:276] 0709 13:21:11.809559 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:21:11.826954 (+ 17395us) service_pool.cc:224] Handling call
0709 13:21:13.070138 (+1243184us) spinlock_profiling.cc:243] Waited 114 ms on lock 0x7b5400347e54. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f9a1a3d 00007fcc14971cd0 00007fcc0def6254 00007fcc0def61e2 00007fcc0def6111 00007fcc0def608c 00007fcc0def5342 00007fcc0dce548c 00007fcc0dce48c6 00007fcc0dce426f
0709 13:21:13.080497 (+ 10359us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":261084416}
I20260709 13:21:13.074011 13305 raft_consensus.cc:3060] T 7c37d41cd9164c15a6826ca62a851a69 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:21:13.092187 13217 leader_election.cc:290] T f03d0dbf16864ca4bc1bb5e4c0334c0f P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:21:13.092376  6725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4b8bd455d5a47c18a1380839c6e0d61" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:21:13.093005  6725 raft_consensus.cc:2468] T f4b8bd455d5a47c18a1380839c6e0d61 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 18.
W20260709 13:21:13.093974  6697 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 262144us
I20260709 13:21:13.095259  6697 leader_election.cc:304] T b56bf91d90824c959e21e0cee5ba1816 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:21:13.086402 13336 leader_election.cc:290] T ab432e62819d499eaaf3dd55481dd930 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 22 election: Requested vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:21:13.080008 13298 consensus_queue.cc:1059] T 4d9def8b32fd443aa94ab1420b06837b P b7ab4784c7344b939bc36f639286f377 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: INVALID_TERM, Last received: 17.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.016s
I20260709 13:21:13.096462 13336 raft_consensus.cc:2749] T 22ccee1b570c4ad3a57bd7aec085b1b4 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:21:13.096638 13298 raft_consensus.cc:3055] T 4d9def8b32fd443aa94ab1420b06837b P b7ab4784c7344b939bc36f639286f377 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:21:13.097069 13298 raft_consensus.cc:740] T 4d9def8b32fd443aa94ab1420b06837b P b7ab4784c7344b939bc36f639286f377 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
I20260709 13:21:13.098044 13298 consensus_queue.cc:260] T 4d9def8b32fd443aa94ab1420b06837b P b7ab4784c7344b939bc36f639286f377 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 19.10, Last appended by leader: 10, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:13.099292 13298 raft_consensus.cc:3060] T 4d9def8b32fd443aa94ab1420b06837b P b7ab4784c7344b939bc36f639286f377 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:21:13.084894 13340 consensus_queue.cc:1059] T 7a734b5ab7834e05a8c422208acc58b1 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: INVALID_TERM, Last received: 19.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.017s
I20260709 13:21:13.101099 13340 raft_consensus.cc:3055] T 7a734b5ab7834e05a8c422208acc58b1 P b7ab4784c7344b939bc36f639286f377 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:21:13.101495 13340 raft_consensus.cc:740] T 7a734b5ab7834e05a8c422208acc58b1 P b7ab4784c7344b939bc36f639286f377 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
I20260709 13:21:13.101784 13316 raft_consensus.cc:493] T 34f36d59d88f40fe8a2805e604fc6c0a P ccd8a4c3bfe3413cb2ae219b09aea832 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:21:13.102484 13340 consensus_queue.cc:260] T 7a734b5ab7834e05a8c422208acc58b1 P b7ab4784c7344b939bc36f639286f377 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 19.10, Last appended by leader: 10, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } attrs { replace: true } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:21:13.102720 13316 raft_consensus.cc:515] T 34f36d59d88f40fe8a2805e604fc6c0a P ccd8a4c3bfe3413cb2ae219b09aea832 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:13.104411 13216 raft_consensus.cc:697] T 20f6842e26174571996b8dea4151d4be P b7ab4784c7344b939bc36f639286f377 [term 20 LEADER]: Becoming Leader. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
I20260709 13:21:13.105063 13230 raft_consensus.cc:3055] T 4b8cacb381b746da8d0049b0a83b41dd P ccd8a4c3bfe3413cb2ae219b09aea832 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:21:13.105454 13230 raft_consensus.cc:740] T 4b8cacb381b746da8d0049b0a83b41dd P ccd8a4c3bfe3413cb2ae219b09aea832 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
I20260709 13:21:13.105381 13216 consensus_queue.cc:237] T 20f6842e26174571996b8dea4151d4be P b7ab4784c7344b939bc36f639286f377 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.11, Last appended by leader: 11, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:13.106419 13230 consensus_queue.cc:260] T 4b8cacb381b746da8d0049b0a83b41dd P ccd8a4c3bfe3413cb2ae219b09aea832 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:21:13.107537 13304 raft_consensus.cc:3060] T 07a92dd554674067a83a9cb68c4773f2 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:21:13.125424  6695 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:21:13.115582  6724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d33d5ee8ef6f415593d8df52063161ad" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:21:13.138435  6724 raft_consensus.cc:3060] T d33d5ee8ef6f415593d8df52063161ad P ccd8a4c3bfe3413cb2ae219b09aea832 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:21:13.139683  6805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce4f062dcd314d43a63ca74067cb5ee3" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:21:13.140962  6805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f03d0dbf16864ca4bc1bb5e4c0334c0f" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 20 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:21:13.094043  6725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8292e16e5654be6bc408560cf256aaa" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: true dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:21:13.142732  6725 raft_consensus.cc:3055] T d8292e16e5654be6bc408560cf256aaa P ccd8a4c3bfe3413cb2ae219b09aea832 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:21:13.143133  6725 raft_consensus.cc:740] T d8292e16e5654be6bc408560cf256aaa P ccd8a4c3bfe3413cb2ae219b09aea832 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
I20260709 13:21:13.144441  6770 leader_election.cc:304] T f09c2a98de1a4decabd0ff900dd44caa P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:21:13.146857  6805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab432e62819d499eaaf3dd55481dd930" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:21:13.147511  6805 raft_consensus.cc:3060] T ab432e62819d499eaaf3dd55481dd930 P b7ab4784c7344b939bc36f639286f377 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:21:13.137163  6800 raft_consensus.cc:1217] T 7c37d41cd9164c15a6826ca62a851a69 P b7ab4784c7344b939bc36f639286f377 [term 19 LEADER]: Deduplicated request from leader. Original: 15.11->[16.12-18.13]   Dedup: 18.13->[]
I20260709 13:21:13.150480  6800 raft_consensus.cc:1240] T 7c37d41cd9164c15a6826ca62a851a69 P b7ab4784c7344b939bc36f639286f377 [term 19 LEADER]: Rejecting Update request from peer ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 18. Current term is 19. Ops: [16.12-18.13]
I20260709 13:21:13.152550  6725 consensus_queue.cc:260] T d8292e16e5654be6bc408560cf256aaa P ccd8a4c3bfe3413cb2ae219b09aea832 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:13.157630  6725 raft_consensus.cc:3060] T d8292e16e5654be6bc408560cf256aaa P ccd8a4c3bfe3413cb2ae219b09aea832 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:21:13.157624  6800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30e88460611e47b2ba16a46a30b5f416" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:21:13.158401  6800 raft_consensus.cc:3060] T 30e88460611e47b2ba16a46a30b5f416 P b7ab4784c7344b939bc36f639286f377 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:21:13.158962  6770 leader_election.cc:304] T c4db81d9d329422bb3b4160ca4ac2d1d P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
W20260709 13:21:13.128625  6696 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:21:13.168018  6801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d33d5ee8ef6f415593d8df52063161ad" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:21:13.169193  6801 raft_consensus.cc:2393] T d33d5ee8ef6f415593d8df52063161ad P b7ab4784c7344b939bc36f639286f377 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ccd8a4c3bfe3413cb2ae219b09aea832 in current term 17: Already voted for candidate cd75a17ab2604397adab03bb8b5fd75c in this term.
I20260709 13:21:13.160279  6772 leader_election.cc:304] T 9b3759de40694069b13c0f8bd40e5709 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:21:13.107613 13230 raft_consensus.cc:3060] T 4b8cacb381b746da8d0049b0a83b41dd P ccd8a4c3bfe3413cb2ae219b09aea832 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:21:13.177011  6876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6869f07b5a4885a0b99fbe60c3b175" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 21 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:21:13.172642 12730 raft_consensus.cc:2749] T f09c2a98de1a4decabd0ff900dd44caa P b7ab4784c7344b939bc36f639286f377 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:21:13.177762  6875 raft_consensus.cc:2955] T ce4f062dcd314d43a63ca74067cb5ee3 P cd75a17ab2604397adab03bb8b5fd75c [term 15 FOLLOWER]: Committing config change with OpId 15.11: config changed from index 3 to 11, VOTER ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65) evicted. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } } }
I20260709 13:21:13.180408 13026 raft_consensus.cc:2804] T 9b3759de40694069b13c0f8bd40e5709 P b7ab4784c7344b939bc36f639286f377 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:21:13.131789 13340 raft_consensus.cc:3060] T 7a734b5ab7834e05a8c422208acc58b1 P b7ab4784c7344b939bc36f639286f377 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:21:13.181054 13026 raft_consensus.cc:697] T 9b3759de40694069b13c0f8bd40e5709 P b7ab4784c7344b939bc36f639286f377 [term 17 LEADER]: Becoming Leader. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
I20260709 13:21:13.182410 13026 consensus_queue.cc:237] T 9b3759de40694069b13c0f8bd40e5709 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 16.10, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:13.189026  6877 raft_consensus.cc:1275] T 7c37d41cd9164c15a6826ca62a851a69 P cd75a17ab2604397adab03bb8b5fd75c [term 19 FOLLOWER]: Refusing update from remote peer b7ab4784c7344b939bc36f639286f377: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
W20260709 13:21:13.190733  6697 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 95603.7us
I20260709 13:21:13.192935  6697 leader_election.cc:304] T c4db81d9d329422bb3b4160ca4ac2d1d P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:21:13.196000  6725 raft_consensus.cc:2468] T d8292e16e5654be6bc408560cf256aaa P ccd8a4c3bfe3413cb2ae219b09aea832 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 18.
I20260709 13:21:13.200162  6877 raft_consensus.cc:1240] T d8292e16e5654be6bc408560cf256aaa P cd75a17ab2604397adab03bb8b5fd75c [term 18 FOLLOWER]: Rejecting Update request from peer ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 17. Current term is 18. Ops: []
I20260709 13:21:13.202347  6877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce4f062dcd314d43a63ca74067cb5ee3" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:21:13.204296  7495 raft_consensus.cc:1240] T 404190ce4ce94cecbfcb6ea9d1dd8626 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 17 FOLLOWER]: Rejecting Update request from peer ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 16. Current term is 17. Ops: []
I20260709 13:21:13.205907  7495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce4f062dcd314d43a63ca74067cb5ee3" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:21:13.211683  6805 raft_consensus.cc:2468] T ab432e62819d499eaaf3dd55481dd930 P b7ab4784c7344b939bc36f639286f377 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 22.
I20260709 13:21:13.189373  7503 raft_consensus.cc:2955] T ce4f062dcd314d43a63ca74067cb5ee3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 15 FOLLOWER]: Committing config change with OpId 15.11: config changed from index 3 to 11, VOTER ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65) evicted. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } } }
I20260709 13:21:13.212930  6876 raft_consensus.cc:1240] T 9b3759de40694069b13c0f8bd40e5709 P cd75a17ab2604397adab03bb8b5fd75c [term 17 FOLLOWER]: Rejecting Update request from peer ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 16. Current term is 17. Ops: [14.9-16.10]
I20260709 13:21:13.215840  6880 raft_consensus.cc:1275] T 8c7f33e544204fbaac4078e3e83bbf4e P cd75a17ab2604397adab03bb8b5fd75c [term 16 FOLLOWER]: Refusing update from remote peer b7ab4784c7344b939bc36f639286f377: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:21:13.216781  6876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab432e62819d499eaaf3dd55481dd930" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:21:13.218441  6803 raft_consensus.cc:1275] T 713b5728a197487c9300b310ab94e5a3 P b7ab4784c7344b939bc36f639286f377 [term 16 FOLLOWER]: Refusing update from remote peer ccd8a4c3bfe3413cb2ae219b09aea832: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 13:21:13.183178 13227 raft_consensus.cc:515] T de3186201e1a40d0b335eeb8b4e256e0 P b7ab4784c7344b939bc36f639286f377 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:13.211866  6877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d33d5ee8ef6f415593d8df52063161ad" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:21:13.236593  6801 raft_consensus.cc:1240] T f09c2a98de1a4decabd0ff900dd44caa P b7ab4784c7344b939bc36f639286f377 [term 19 FOLLOWER]: Rejecting Update request from peer ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 18. Current term is 19. Ops: []
I20260709 13:21:13.237848  6876 raft_consensus.cc:1275] T 713b5728a197487c9300b310ab94e5a3 P cd75a17ab2604397adab03bb8b5fd75c [term 16 FOLLOWER]: Refusing update from remote peer ccd8a4c3bfe3413cb2ae219b09aea832: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 13:21:13.228822  6800 raft_consensus.cc:2468] T 30e88460611e47b2ba16a46a30b5f416 P b7ab4784c7344b939bc36f639286f377 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 15.
W20260709 13:21:13.239466  6695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 100646us
I20260709 13:21:13.205286 13221 raft_consensus.cc:3060] T c4db81d9d329422bb3b4160ca4ac2d1d P b7ab4784c7344b939bc36f639286f377 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:21:13.242944  6877 raft_consensus.cc:2393] T d33d5ee8ef6f415593d8df52063161ad P cd75a17ab2604397adab03bb8b5fd75c [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ccd8a4c3bfe3413cb2ae219b09aea832 in current term 17: Already voted for candidate cd75a17ab2604397adab03bb8b5fd75c in this term.
I20260709 13:21:13.240909  6695 leader_election.cc:304] T 853ac0a8cbd64ce99457f170216d4d0f P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
I20260709 13:21:13.210369 13205 raft_consensus.cc:2749] T b56bf91d90824c959e21e0cee5ba1816 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:21:13.250936  6874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30e88460611e47b2ba16a46a30b5f416" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:21:13.251335  6875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f03d0dbf16864ca4bc1bb5e4c0334c0f" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 20 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:21:13.215456 13336 raft_consensus.cc:2749] T c4db81d9d329422bb3b4160ca4ac2d1d P ccd8a4c3bfe3413cb2ae219b09aea832 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:21:13.260679  6695 leader_election.cc:304] T de3186201e1a40d0b335eeb8b4e256e0 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
I20260709 13:21:13.261854 13202 raft_consensus.cc:2804] T 853ac0a8cbd64ce99457f170216d4d0f P ccd8a4c3bfe3413cb2ae219b09aea832 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:21:13.264708 13202 raft_consensus.cc:493] T 853ac0a8cbd64ce99457f170216d4d0f P ccd8a4c3bfe3413cb2ae219b09aea832 [term 15 FOLLOWER]: Starting leader election (detected failure of leader cd75a17ab2604397adab03bb8b5fd75c)
I20260709 13:21:13.265188 13202 raft_consensus.cc:3060] T 853ac0a8cbd64ce99457f170216d4d0f P ccd8a4c3bfe3413cb2ae219b09aea832 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:21:13.274613 13227 leader_election.cc:290] T de3186201e1a40d0b335eeb8b4e256e0 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 19 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:21:13.219563 12730 consensus_queue.cc:1048] T 7c37d41cd9164c15a6826ca62a851a69 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 11, Time since last communication: 0.040s
W20260709 13:21:13.107872 13297 consensus_queue.cc:1175] T 4b8cacb381b746da8d0049b0a83b41dd P ccd8a4c3bfe3413cb2ae219b09aea832 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "cd75a17ab2604397adab03bb8b5fd75c" responder_term: 19 status { last_received { term: 18 index: 14 } last_committed_idx: 14 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 18. Current term is 19. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:21:13.293231 13360 raft_consensus.cc:2804] T de3186201e1a40d0b335eeb8b4e256e0 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:21:13.293462  6695 leader_election.cc:304] T 3411566abe2d4c9bb4b2adfdd05e6f17 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
I20260709 13:21:13.293985 13360 raft_consensus.cc:493] T de3186201e1a40d0b335eeb8b4e256e0 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:13.294456 13360 raft_consensus.cc:3060] T de3186201e1a40d0b335eeb8b4e256e0 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:21:13.295349  6695 leader_election.cc:304] T ce4f062dcd314d43a63ca74067cb5ee3 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, b7ab4784c7344b939bc36f639286f377
I20260709 13:21:13.215263 13342 consensus_queue.cc:1048] T 711ef6523deb4cbe8ef2ba61e1c21c98 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.038s
I20260709 13:21:13.297268 13329 raft_consensus.cc:2749] T ce4f062dcd314d43a63ca74067cb5ee3 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:21:13.295480 13193 raft_consensus.cc:2804] T 3411566abe2d4c9bb4b2adfdd05e6f17 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:21:13.298621 13193 raft_consensus.cc:493] T 3411566abe2d4c9bb4b2adfdd05e6f17 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 17 FOLLOWER]: Starting leader election (detected failure of leader cd75a17ab2604397adab03bb8b5fd75c)
I20260709 13:21:13.299078 13193 raft_consensus.cc:3060] T 3411566abe2d4c9bb4b2adfdd05e6f17 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:21:13.300376 13205 raft_consensus.cc:493] T dbdf895bba214ff68685a24fd17dfb5d P ccd8a4c3bfe3413cb2ae219b09aea832 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader cd75a17ab2604397adab03bb8b5fd75c)
I20260709 13:21:13.300836 13316 leader_election.cc:290] T 34f36d59d88f40fe8a2805e604fc6c0a P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:21:13.301066 13205 raft_consensus.cc:515] T dbdf895bba214ff68685a24fd17dfb5d P ccd8a4c3bfe3413cb2ae219b09aea832 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:13.303495 13205 leader_election.cc:290] T dbdf895bba214ff68685a24fd17dfb5d P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:21:13.297310  6695 leader_election.cc:304] T ab432e62819d499eaaf3dd55481dd930 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
I20260709 13:21:13.304641 13205 raft_consensus.cc:2804] T ab432e62819d499eaaf3dd55481dd930 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:21:13.328174  6875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbdf895bba214ff68685a24fd17dfb5d" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 18 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:21:13.257314 13207 raft_consensus.cc:493] T a3022224cc81473690653a83d4e99470 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:13.330597  6723 raft_consensus.cc:1275] T 427c124d773f483294511e80fe340075 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 18 FOLLOWER]: Refusing update from remote peer 7ba59cc884714e8aa5f3f0ecaed84cbb: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 13:21:13.333264  6879 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53406 (request call id 3031) took 1519 ms. Trace:
I20260709 13:21:13.256841 13273 raft_consensus.cc:493] T be1a92657f494cac8dd227d152f50151 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:13.336318  6723 raft_consensus.cc:1240] T 7887766dc6784fcaa42b35c05fea7a99 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 21 FOLLOWER]: Rejecting Update request from peer b7ab4784c7344b939bc36f639286f377 for earlier term 20. Current term is 21. Ops: [20.11-20.11]
I20260709 13:21:13.333827  6879 rpcz_store.cc:276] 0709 13:21:11.813431 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:21:11.837930 (+ 24499us) service_pool.cc:224] Handling call
0709 13:21:11.861027 (+ 23097us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:21:12.354368 (+493341us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:21:13.332954 (+978586us) spinlock_profiling.cc:243] Waited 487 ms on lock 0x7b5400347e54. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f9aae01 00007fcc0f9a983e 00007fcc1496e419 00007fcc0dee5bd4 00007fcc0dee5b62 00007fcc0dee5a91 00007fcc0dee5a0c 00007fcc0dee4cc2 00007fcc0dce548c 00007fcc0dce48c6
0709 13:21:13.333184 (+   230us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1121235328}
W20260709 13:21:13.344522  6770 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 185664us
I20260709 13:21:13.337868  6724 raft_consensus.cc:2468] T d33d5ee8ef6f415593d8df52063161ad P ccd8a4c3bfe3413cb2ae219b09aea832 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 17.
I20260709 13:21:13.346963  6874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34f36d59d88f40fe8a2805e604fc6c0a" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
W20260709 13:21:13.334978 13345 log.cc:927] Time spent T ce4f062dcd314d43a63ca74067cb5ee3 P cd75a17ab2604397adab03bb8b5fd75c: Append to log took a long time: real 0.069s	user 0.001s	sys 0.000s
I20260709 13:21:13.348764  6770 leader_election.cc:304] T d8292e16e5654be6bc408560cf256aaa P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:21:13.263672 12704 consensus_queue.cc:1059] T 404190ce4ce94cecbfcb6ea9d1dd8626 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.086s
I20260709 13:21:13.343809 13205 raft_consensus.cc:697] T ab432e62819d499eaaf3dd55481dd930 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 22 LEADER]: Becoming Leader. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
I20260709 13:21:13.344456 13225 consensus_queue.cc:1048] T 427c124d773f483294511e80fe340075 P 7ba59cc884714e8aa5f3f0ecaed84cbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.017s
I20260709 13:21:13.344280 13207 raft_consensus.cc:515] T a3022224cc81473690653a83d4e99470 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:13.346622 13273 raft_consensus.cc:515] T be1a92657f494cac8dd227d152f50151 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:21:13.359833 13216 raft_consensus.cc:2749] T d8292e16e5654be6bc408560cf256aaa P b7ab4784c7344b939bc36f639286f377 [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:21:13.388588 13205 consensus_queue.cc:237] T ab432e62819d499eaaf3dd55481dd930 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 20.11, Last appended by leader: 11, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:13.372876 13335 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.ChangeConfig from 127.0.0.1:41714 (request call id 4) took 2946 ms. Trace:
I20260709 13:21:13.396150 13335 rpcz_store.cc:276] 0709 13:21:10.421148 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:21:10.424742 (+  3594us) service_pool.cc:224] Handling call
0709 13:21:10.571465 (+146723us) log.cc:844] Serialized 494 byte log entry
0709 13:21:11.312686 (+741221us) spinlock_profiling.cc:243] Waited 4.14 ms on lock 0x7b540027a9a0. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f92ab26 00007fcc0f92449a 00007fcc0f923714 00007fcc0f903eaa 00007fcc0f90ad53 00007fcc0f90acd9 00007fcc0f90ac69 00007fcc0f90ac31 00007fcc0f909dfd 000000000038f354
0709 13:21:13.367913 (+2055227us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":5934,"raft.queue_time_us":146687,"raft.run_cpu_time_us":4292,"raft.run_wall_time_us":493097,"spinlock_wait_cycles":9520896,"thread_start_us":451925,"threads_started":2,"wal-append.queue_time_us":588058,"wal-append.run_cpu_time_us":2162,"wal-append.run_wall_time_us":1018407}
I20260709 13:21:13.408196  6614 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet ce4f062dcd314d43a63ca74067cb5ee3 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 12)
I20260709 13:21:13.409823 13264 leader_election.cc:290] T 7a734b5ab7834e05a8c422208acc58b1 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 20 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:21:13.410488 13273 leader_election.cc:290] T be1a92657f494cac8dd227d152f50151 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:21:13.416831  6723 raft_consensus.cc:1240] T 9e326172347f45e99a0d482b5d8ef768 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 15 FOLLOWER]: Rejecting Update request from peer b7ab4784c7344b939bc36f639286f377 for earlier term 14. Current term is 15. Ops: []
I20260709 13:21:13.417500  6724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f9c2e2bf644115957398fe4c9459db" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:21:13.421028  6697 leader_election.cc:304] T 9e326172347f45e99a0d482b5d8ef768 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:21:13.421829  6731 raft_consensus.cc:1240] T 4d9def8b32fd443aa94ab1420b06837b P ccd8a4c3bfe3413cb2ae219b09aea832 [term 20 FOLLOWER]: Rejecting Update request from peer b7ab4784c7344b939bc36f639286f377 for earlier term 19. Current term is 20. Ops: [17.9-19.10]
I20260709 13:21:13.423923  7503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a734b5ab7834e05a8c422208acc58b1" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb"
I20260709 13:21:13.424544 13328 raft_consensus.cc:2749] T 9e326172347f45e99a0d482b5d8ef768 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:21:13.425454 13328 raft_consensus.cc:493] T 7c44c4849aa54f2b94d1f1bef9ed546f P ccd8a4c3bfe3413cb2ae219b09aea832 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:13.425659  7494 raft_consensus.cc:1275] T 95a75bfe094d4bdc963aba3f08dfcd25 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 16 LEARNER]: Refusing update from remote peer cd75a17ab2604397adab03bb8b5fd75c: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:21:13.426077 13328 raft_consensus.cc:515] T 7c44c4849aa54f2b94d1f1bef9ed546f P ccd8a4c3bfe3413cb2ae219b09aea832 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:13.428258 13176 consensus_queue.cc:1048] T bb3d8792045a4583ae2e965b1350a5b4 P 7ba59cc884714e8aa5f3f0ecaed84cbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.001s
W20260709 13:21:13.430629 13371 log.cc:927] Time spent T a1704639a875409b9959353527b3fd68 P ccd8a4c3bfe3413cb2ae219b09aea832: Append to log took a long time: real 0.066s	user 0.000s	sys 0.000s
I20260709 13:21:13.435365 13289 consensus_queue.cc:1048] T 427c124d773f483294511e80fe340075 P 7ba59cc884714e8aa5f3f0ecaed84cbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:21:13.435531  7494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be1a92657f494cac8dd227d152f50151" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
W20260709 13:21:13.440508  6696 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:21:13.452558  6726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "713b5728a197487c9300b310ab94e5a3" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:21:13.440784 13207 leader_election.cc:290] T a3022224cc81473690653a83d4e99470 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:21:13.423120  6697 leader_election.cc:304] T 4275cf08e63345f993bce8664eada830 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377
I20260709 13:21:13.462714  6880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de3186201e1a40d0b335eeb8b4e256e0" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:21:13.463394  6880 raft_consensus.cc:3060] T de3186201e1a40d0b335eeb8b4e256e0 P cd75a17ab2604397adab03bb8b5fd75c [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:21:13.464491 13180 consensus_queue.cc:260] T f09c2a98de1a4decabd0ff900dd44caa P ccd8a4c3bfe3413cb2ae219b09aea832 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:13.457232  7495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f00a2e87e56452083b759f60d461ee3" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:21:13.458482  6844 leader_election.cc:304] T de3186201e1a40d0b335eeb8b4e256e0 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:21:13.469090  6726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6869f07b5a4885a0b99fbe60c3b175" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 21 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:21:13.449819  7494 raft_consensus.cc:2468] T be1a92657f494cac8dd227d152f50151 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 21.
I20260709 13:21:13.481936  6729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7887766dc6784fcaa42b35c05fea7a99" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: true dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:21:13.482995  6729 raft_consensus.cc:3060] T 7887766dc6784fcaa42b35c05fea7a99 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 21 FOLLOWER]: Advancing to term 22
W20260709 13:21:13.486533  6697 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 63494.9us
I20260709 13:21:13.487938  6697 leader_election.cc:304] T 2c240553ce044eedb41541d72b9475d7 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:21:13.490739  6800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34f36d59d88f40fe8a2805e604fc6c0a" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:21:13.494489  6799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3022224cc81473690653a83d4e99470" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:21:13.495301  6799 raft_consensus.cc:2468] T a3022224cc81473690653a83d4e99470 P b7ab4784c7344b939bc36f639286f377 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 20.
I20260709 13:21:13.498056  6800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be1a92657f494cac8dd227d152f50151" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:21:13.505112  6731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab432e62819d499eaaf3dd55481dd930" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:21:13.509042  6799 raft_consensus.cc:1275] T bd6869f07b5a4885a0b99fbe60c3b175 P b7ab4784c7344b939bc36f639286f377 [term 20 FOLLOWER]: Refusing update from remote peer ccd8a4c3bfe3413cb2ae219b09aea832: Log matching property violated. Preceding OpId in replica: term: 18 index: 9. Preceding OpId from leader: term: 20 index: 10. (index mismatch)
W20260709 13:21:13.509322  6846 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.68:45071, user_credentials={real_user=slave}} blocked reactor thread for 50208us
I20260709 13:21:13.511320  6726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de3186201e1a40d0b335eeb8b4e256e0" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
W20260709 13:21:13.513175  6772 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 79726.3us
I20260709 13:21:13.407859 13221 raft_consensus.cc:2749] T c4db81d9d329422bb3b4160ca4ac2d1d P b7ab4784c7344b939bc36f639286f377 [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:21:13.519886  6807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f00a2e87e56452083b759f60d461ee3" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:21:13.521271  6695 leader_election.cc:304] T 30e88460611e47b2ba16a46a30b5f416 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
I20260709 13:21:13.521833  6880 raft_consensus.cc:2468] T de3186201e1a40d0b335eeb8b4e256e0 P cd75a17ab2604397adab03bb8b5fd75c [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 19.
I20260709 13:21:13.530732  6798 raft_consensus.cc:1240] T 9b3759de40694069b13c0f8bd40e5709 P b7ab4784c7344b939bc36f639286f377 [term 17 LEADER]: Rejecting Update request from peer ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 16. Current term is 17. Ops: []
I20260709 13:21:13.483304 13180 raft_consensus.cc:3060] T f09c2a98de1a4decabd0ff900dd44caa P ccd8a4c3bfe3413cb2ae219b09aea832 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:21:13.534386  6801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbdf895bba214ff68685a24fd17dfb5d" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 18 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
W20260709 13:21:13.538405  6773 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:21:13.551065  6773 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:21:13.544598  6800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab432e62819d499eaaf3dd55481dd930" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:21:13.552347  6800 raft_consensus.cc:2368] T ab432e62819d499eaaf3dd55481dd930 P b7ab4784c7344b939bc36f639286f377 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c for earlier term 21. Current term is 22.
I20260709 13:21:13.545397  6804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "713b5728a197487c9300b310ab94e5a3" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:21:13.553526  6804 raft_consensus.cc:2468] T 713b5728a197487c9300b310ab94e5a3 P b7ab4784c7344b939bc36f639286f377 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 16.
W20260709 13:21:13.546842  6697 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 59025us
I20260709 13:21:13.559131  6803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7887766dc6784fcaa42b35c05fea7a99" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: true dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:21:13.559963  6803 raft_consensus.cc:3055] T 7887766dc6784fcaa42b35c05fea7a99 P b7ab4784c7344b939bc36f639286f377 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:21:13.560345  6803 raft_consensus.cc:740] T 7887766dc6784fcaa42b35c05fea7a99 P b7ab4784c7344b939bc36f639286f377 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
I20260709 13:21:13.530014 13230 consensus_queue.cc:1048] T 713b5728a197487c9300b310ab94e5a3 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.036s
I20260709 13:21:13.567030 13273 raft_consensus.cc:3060] T 2c240553ce044eedb41541d72b9475d7 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:21:13.568171  6731 raft_consensus.cc:1275] T 7c37d41cd9164c15a6826ca62a851a69 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 19 FOLLOWER]: Refusing update from remote peer b7ab4784c7344b939bc36f639286f377: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 13:21:13.570516  6731 raft_consensus.cc:1275] T 8c7f33e544204fbaac4078e3e83bbf4e P ccd8a4c3bfe3413cb2ae219b09aea832 [term 16 FOLLOWER]: Refusing update from remote peer b7ab4784c7344b939bc36f639286f377: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
W20260709 13:21:13.570703  6770 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 51236.7us
I20260709 13:21:13.572453  6770 leader_election.cc:304] T f3f9c2e2bf644115957398fe4c9459db P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
W20260709 13:21:13.578555  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 120169us
I20260709 13:21:13.579656  6844 leader_election.cc:304] T 2c240553ce044eedb41541d72b9475d7 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:21:13.561286  6803 consensus_queue.cc:260] T 7887766dc6784fcaa42b35c05fea7a99 P b7ab4784c7344b939bc36f639286f377 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 20.11, Last appended by leader: 11, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:13.578966  6770 leader_election.cc:304] T bd6869f07b5a4885a0b99fbe60c3b175 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:21:13.565747  6695 leader_election.cc:304] T a3022224cc81473690653a83d4e99470 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
I20260709 13:21:13.584901  6723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b3759de40694069b13c0f8bd40e5709" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:21:13.587296  6729 raft_consensus.cc:2468] T 7887766dc6784fcaa42b35c05fea7a99 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 22.
I20260709 13:21:13.539764 13304 raft_consensus.cc:2804] T 4275cf08e63345f993bce8664eada830 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:21:13.532788 13298 raft_consensus.cc:493] T 2c240553ce044eedb41541d72b9475d7 P b7ab4784c7344b939bc36f639286f377 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:13.540025 13317 raft_consensus.cc:2804] T 30e88460611e47b2ba16a46a30b5f416 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:21:13.506235 13193 raft_consensus.cc:515] T 3411566abe2d4c9bb4b2adfdd05e6f17 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:13.543987 13249 raft_consensus.cc:2749] T de3186201e1a40d0b335eeb8b4e256e0 P cd75a17ab2604397adab03bb8b5fd75c [term 19 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:21:13.520650 13347 consensus_queue.cc:1048] T 95a75bfe094d4bdc963aba3f08dfcd25 P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.076s
W20260709 13:21:13.624665  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 45083.4us
I20260709 13:21:13.592422 13225 raft_consensus.cc:493] T 404190ce4ce94cecbfcb6ea9d1dd8626 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:13.619539  6697 leader_election.cc:304] T d33d5ee8ef6f415593d8df52063161ad P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:21:13.596243 13207 raft_consensus.cc:2804] T a3022224cc81473690653a83d4e99470 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:21:13.598131 13328 leader_election.cc:290] T 7c44c4849aa54f2b94d1f1bef9ed546f P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:21:13.620291  6803 raft_consensus.cc:3060] T 7887766dc6784fcaa42b35c05fea7a99 P b7ab4784c7344b939bc36f639286f377 [term 20 FOLLOWER]: Advancing to term 22
I20260709 13:21:13.614176 13264 raft_consensus.cc:2804] T 2c240553ce044eedb41541d72b9475d7 P cd75a17ab2604397adab03bb8b5fd75c [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:21:13.602039 13216 raft_consensus.cc:2749] T f3f9c2e2bf644115957398fe4c9459db P b7ab4784c7344b939bc36f639286f377 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:21:13.577919 13076 consensus_queue.cc:1048] T 8c7f33e544204fbaac4078e3e83bbf4e P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.044s
I20260709 13:21:13.625777  6844 leader_election.cc:304] T e77e330a82df4b43a745d57a68f6f057 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
W20260709 13:21:13.637844  6695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 45952.1us
I20260709 13:21:13.602725 13340 consensus_queue.cc:1059] T 9e326172347f45e99a0d482b5d8ef768 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: INVALID_TERM, Last received: 14.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.038s
I20260709 13:21:13.633390 13308 raft_consensus.cc:2749] T bd6869f07b5a4885a0b99fbe60c3b175 P b7ab4784c7344b939bc36f639286f377 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:21:13.606755 13202 raft_consensus.cc:515] T 853ac0a8cbd64ce99457f170216d4d0f P ccd8a4c3bfe3413cb2ae219b09aea832 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:13.664467 13242 raft_consensus.cc:2749] T e77e330a82df4b43a745d57a68f6f057 P cd75a17ab2604397adab03bb8b5fd75c [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 13:21:13.664778 13380 log.cc:927] Time spent T 711ef6523deb4cbe8ef2ba61e1c21c98 P cd75a17ab2604397adab03bb8b5fd75c: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 13:21:13.665191 13317 raft_consensus.cc:697] T 30e88460611e47b2ba16a46a30b5f416 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 15 LEADER]: Becoming Leader. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
W20260709 13:21:13.666306  6697 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 46872.4us
I20260709 13:21:13.666513  6844 leader_election.cc:304] T a3022224cc81473690653a83d4e99470 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:21:13.666801 13247 raft_consensus.cc:2749] T d33d5ee8ef6f415593d8df52063161ad P ccd8a4c3bfe3413cb2ae219b09aea832 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:21:13.670104  6728 raft_consensus.cc:2468] T 07a92dd554674067a83a9cb68c4773f2 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 17.
I20260709 13:21:13.640153 13223 consensus_queue.cc:1048] T 7c37d41cd9164c15a6826ca62a851a69 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.031s
I20260709 13:21:13.670677  6804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c44c4849aa54f2b94d1f1bef9ed546f" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:21:13.689832  6804 raft_consensus.cc:2468] T 7c44c4849aa54f2b94d1f1bef9ed546f P b7ab4784c7344b939bc36f639286f377 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 20.
I20260709 13:21:13.639837 13207 raft_consensus.cc:493] T a3022224cc81473690653a83d4e99470 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:13.690634  6697 leader_election.cc:304] T f03d0dbf16864ca4bc1bb5e4c0334c0f P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:21:13.615227 13298 raft_consensus.cc:515] T 2c240553ce044eedb41541d72b9475d7 P b7ab4784c7344b939bc36f639286f377 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:13.693650  6697 leader_election.cc:304] T 34f36d59d88f40fe8a2805e604fc6c0a P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
W20260709 13:21:13.681289  6695 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:21:13.687834  6844 leader_election.cc:304] T d8cee0accdb8499c86d4414b72565a38 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, b7ab4784c7344b939bc36f639286f377
I20260709 13:21:13.695117 13298 leader_election.cc:290] T 2c240553ce044eedb41541d72b9475d7 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:21:13.621946 13230 consensus_queue.cc:1048] T bd6869f07b5a4885a0b99fbe60c3b175 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.032s
I20260709 13:21:13.690832 13207 raft_consensus.cc:3060] T a3022224cc81473690653a83d4e99470 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:21:13.696780 13242 raft_consensus.cc:2749] T d8cee0accdb8499c86d4414b72565a38 P cd75a17ab2604397adab03bb8b5fd75c [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 13:21:13.694195 13376 log.cc:927] Time spent T 95a75bfe094d4bdc963aba3f08dfcd25 P ccd8a4c3bfe3413cb2ae219b09aea832: Append to log took a long time: real 0.111s	user 0.001s	sys 0.000s
I20260709 13:21:13.704973 13230 raft_consensus.cc:493] T 8c7f33e544204fbaac4078e3e83bbf4e P ccd8a4c3bfe3413cb2ae219b09aea832 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:13.705717 13230 raft_consensus.cc:515] T 8c7f33e544204fbaac4078e3e83bbf4e P ccd8a4c3bfe3413cb2ae219b09aea832 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:13.690781 12704 consensus_queue.cc:1048] T 713b5728a197487c9300b310ab94e5a3 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.004s
I20260709 13:21:13.659726 13264 raft_consensus.cc:697] T 2c240553ce044eedb41541d72b9475d7 P cd75a17ab2604397adab03bb8b5fd75c [term 18 LEADER]: Becoming Leader. State: Replica: cd75a17ab2604397adab03bb8b5fd75c, State: Running, Role: LEADER
I20260709 13:21:13.726572  6873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c44c4849aa54f2b94d1f1bef9ed546f" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:21:13.768313  6873 raft_consensus.cc:2468] T 7c44c4849aa54f2b94d1f1bef9ed546f P cd75a17ab2604397adab03bb8b5fd75c [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 20.
I20260709 13:21:13.645052 13225 raft_consensus.cc:515] T 404190ce4ce94cecbfcb6ea9d1dd8626 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
W20260709 13:21:13.767542  6770 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 153459us
I20260709 13:21:13.730234  6805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c7f33e544204fbaac4078e3e83bbf4e" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:21:13.799602  6803 raft_consensus.cc:2468] T 7887766dc6784fcaa42b35c05fea7a99 P b7ab4784c7344b939bc36f639286f377 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 22.
I20260709 13:21:13.804219  6881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3022224cc81473690653a83d4e99470" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:21:13.651877 13364 consensus_queue.cc:1059] T 9b3759de40694069b13c0f8bd40e5709 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.121s
I20260709 13:21:13.691221 13249 raft_consensus.cc:2749] T a3022224cc81473690653a83d4e99470 P cd75a17ab2604397adab03bb8b5fd75c [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:21:13.717971 13305 raft_consensus.cc:2749] T 34f36d59d88f40fe8a2805e604fc6c0a P ccd8a4c3bfe3413cb2ae219b09aea832 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:21:13.818166  6881 raft_consensus.cc:2468] T a3022224cc81473690653a83d4e99470 P cd75a17ab2604397adab03bb8b5fd75c [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 20.
I20260709 13:21:13.766834 13205 raft_consensus.cc:493] T 427c124d773f483294511e80fe340075 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:13.796231 13347 raft_consensus.cc:493] T bb3d8792045a4583ae2e965b1350a5b4 P cd75a17ab2604397adab03bb8b5fd75c [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:13.768646 13369 raft_consensus.cc:2749] T f03d0dbf16864ca4bc1bb5e4c0334c0f P ccd8a4c3bfe3413cb2ae219b09aea832 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:21:13.811702 13230 leader_election.cc:290] T 8c7f33e544204fbaac4078e3e83bbf4e P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:21:13.823895  6803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3411566abe2d4c9bb4b2adfdd05e6f17" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:21:13.795701 13201 consensus_queue.cc:1048] T bd6869f07b5a4885a0b99fbe60c3b175 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.053s
I20260709 13:21:13.825801  6803 raft_consensus.cc:3060] T 3411566abe2d4c9bb4b2adfdd05e6f17 P b7ab4784c7344b939bc36f639286f377 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:21:13.820906 13364 raft_consensus.cc:3055] T 9b3759de40694069b13c0f8bd40e5709 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:21:13.836294 13364 raft_consensus.cc:740] T 9b3759de40694069b13c0f8bd40e5709 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
I20260709 13:21:13.837163 13364 consensus_queue.cc:260] T 9b3759de40694069b13c0f8bd40e5709 P ccd8a4c3bfe3413cb2ae219b09aea832 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:13.838397 13364 raft_consensus.cc:3060] T 9b3759de40694069b13c0f8bd40e5709 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:21:13.810531 12898 consensus_queue.cc:1048] T 8c7f33e544204fbaac4078e3e83bbf4e P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.015s
I20260709 13:21:13.841490 13193 leader_election.cc:290] T 3411566abe2d4c9bb4b2adfdd05e6f17 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 18 election: Requested vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:21:13.842134 13225 leader_election.cc:290] T 404190ce4ce94cecbfcb6ea9d1dd8626 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:21:13.820278 13205 raft_consensus.cc:515] T 427c124d773f483294511e80fe340075 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } attrs { replace: true } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:21:13.823019 13347 raft_consensus.cc:515] T bb3d8792045a4583ae2e965b1350a5b4 P cd75a17ab2604397adab03bb8b5fd75c [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:21:13.846905 13347 leader_election.cc:290] T bb3d8792045a4583ae2e965b1350a5b4 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
W20260709 13:21:13.852610 13381 log.cc:927] Time spent T 4275cf08e63345f993bce8664eada830 P ccd8a4c3bfe3413cb2ae219b09aea832: Append to log took a long time: real 0.166s	user 0.000s	sys 0.000s
I20260709 13:21:13.824826 13317 consensus_queue.cc:237] T 30e88460611e47b2ba16a46a30b5f416 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:13.869961  6805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "427c124d773f483294511e80fe340075" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 19 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:21:13.872682 13207 raft_consensus.cc:515] T a3022224cc81473690653a83d4e99470 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
W20260709 13:21:13.875034 13370 log.cc:927] Time spent T 853ac0a8cbd64ce99457f170216d4d0f P ccd8a4c3bfe3413cb2ae219b09aea832: Append to log took a long time: real 0.490s	user 0.002s	sys 0.000s
I20260709 13:21:13.886027 13221 raft_consensus.cc:493] T 95a75bfe094d4bdc963aba3f08dfcd25 P b7ab4784c7344b939bc36f639286f377 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:13.890359 13221 raft_consensus.cc:515] T 95a75bfe094d4bdc963aba3f08dfcd25 P b7ab4784c7344b939bc36f639286f377 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } attrs { replace: true } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: NON_VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: true } }
I20260709 13:21:13.891942 13207 leader_election.cc:290] T a3022224cc81473690653a83d4e99470 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 21 election: Requested vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:21:13.893818 13202 leader_election.cc:290] T 853ac0a8cbd64ce99457f170216d4d0f P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 16 election: Requested vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
W20260709 13:21:13.872058 13360 consensus_meta.cc:287] T de3186201e1a40d0b335eeb8b4e256e0 P ccd8a4c3bfe3413cb2ae219b09aea832: Time spent flushing consensus metadata: real 0.577s	user 0.007s	sys 0.006s
I20260709 13:21:13.895704  6805 raft_consensus.cc:1275] T ab432e62819d499eaaf3dd55481dd930 P b7ab4784c7344b939bc36f639286f377 [term 22 FOLLOWER]: Refusing update from remote peer ccd8a4c3bfe3413cb2ae219b09aea832: Log matching property violated. Preceding OpId in replica: term: 20 index: 11. Preceding OpId from leader: term: 22 index: 12. (index mismatch)
I20260709 13:21:13.844731 13205 leader_election.cc:290] T 427c124d773f483294511e80fe340075 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:21:13.867914 13273 raft_consensus.cc:2749] T 2c240553ce044eedb41541d72b9475d7 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:21:13.897748  6727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c240553ce044eedb41541d72b9475d7" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:21:13.908437  6803 raft_consensus.cc:2468] T 3411566abe2d4c9bb4b2adfdd05e6f17 P b7ab4784c7344b939bc36f639286f377 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 18.
I20260709 13:21:13.909945  6729 raft_consensus.cc:1275] T e31b9971c15848dea59d4d4130141d9e P ccd8a4c3bfe3413cb2ae219b09aea832 [term 17 FOLLOWER]: Refusing update from remote peer b7ab4784c7344b939bc36f639286f377: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 13:21:13.911046  6727 raft_consensus.cc:2468] T 2c240553ce044eedb41541d72b9475d7 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 18.
W20260709 13:21:13.910782  6772 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 274879us
W20260709 13:21:13.909515  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 221787us
I20260709 13:21:13.896314 13202 raft_consensus.cc:493] T f58dc08b12a2494bb9a1372837970ca2 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:21:13.860357 13264 consensus_queue.cc:237] T 2c240553ce044eedb41541d72b9475d7 P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:13.919921  6772 leader_election.cc:304] T de3186201e1a40d0b335eeb8b4e256e0 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:21:13.925805  6844 leader_election.cc:304] T 34f36d59d88f40fe8a2805e604fc6c0a P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:21:13.901525 13360 raft_consensus.cc:515] T de3186201e1a40d0b335eeb8b4e256e0 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:13.971104  5625 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:21:13.945202 13290 raft_consensus.cc:493] T 7a734b5ab7834e05a8c422208acc58b1 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
W20260709 13:21:13.980327  6773 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:21:13.988189  6726 raft_consensus.cc:2393] T de3186201e1a40d0b335eeb8b4e256e0 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate b7ab4784c7344b939bc36f639286f377 in current term 19: Already voted for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in this term.
I20260709 13:21:13.991708 13298 raft_consensus.cc:2804] T de3186201e1a40d0b335eeb8b4e256e0 P b7ab4784c7344b939bc36f639286f377 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:21:13.992601 13298 raft_consensus.cc:697] T de3186201e1a40d0b335eeb8b4e256e0 P b7ab4784c7344b939bc36f639286f377 [term 19 LEADER]: Becoming Leader. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
I20260709 13:21:13.993917 13298 consensus_queue.cc:237] T de3186201e1a40d0b335eeb8b4e256e0 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:13.929152 13202 raft_consensus.cc:515] T f58dc08b12a2494bb9a1372837970ca2 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:13.962011 12898 consensus_queue.cc:1048] T e31b9971c15848dea59d4d4130141d9e P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.039s
I20260709 13:21:13.988656 13347 raft_consensus.cc:2749] T 34f36d59d88f40fe8a2805e604fc6c0a P cd75a17ab2604397adab03bb8b5fd75c [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:21:14.014178  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 89226.6us
I20260709 13:21:14.018217  6844 leader_election.cc:304] T 7ba5dac66ab5497e9e336f2a3c28cda5 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, b7ab4784c7344b939bc36f639286f377
W20260709 13:21:14.020079  6772 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 59417.6us
I20260709 13:21:14.013967 13026 raft_consensus.cc:493] T be1a92657f494cac8dd227d152f50151 P b7ab4784c7344b939bc36f639286f377 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:21:14.018442 13361 raft_consensus.cc:493] T 20f6842e26174571996b8dea4151d4be P ccd8a4c3bfe3413cb2ae219b09aea832 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:13.998487 13290 raft_consensus.cc:515] T 7a734b5ab7834e05a8c422208acc58b1 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } attrs { replace: true } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:21:14.036194 13347 raft_consensus.cc:2749] T 7ba5dac66ab5497e9e336f2a3c28cda5 P cd75a17ab2604397adab03bb8b5fd75c [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
W20260709 13:21:14.046335 13394 log.cc:927] Time spent T 3fa34c08b205435dba97346991aa1f92 P 7ba59cc884714e8aa5f3f0ecaed84cbb: Append to log took a long time: real 0.148s	user 0.000s	sys 0.001s
I20260709 13:21:14.037446 13026 raft_consensus.cc:515] T be1a92657f494cac8dd227d152f50151 P b7ab4784c7344b939bc36f639286f377 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
W20260709 13:21:14.069478 13400 log.cc:927] Time spent T bd6869f07b5a4885a0b99fbe60c3b175 P b7ab4784c7344b939bc36f639286f377: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 13:21:14.042057 13361 raft_consensus.cc:515] T 20f6842e26174571996b8dea4151d4be P ccd8a4c3bfe3413cb2ae219b09aea832 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:14.077297  6729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "404190ce4ce94cecbfcb6ea9d1dd8626" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:21:14.085454  7503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "427c124d773f483294511e80fe340075" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 19 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:21:14.086963  7495 raft_consensus.cc:1240] T 404190ce4ce94cecbfcb6ea9d1dd8626 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 17 FOLLOWER]: Rejecting Update request from peer ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 16. Current term is 17. Ops: [16.13-16.13]
I20260709 13:21:14.090274 13221 leader_election.cc:290] T 95a75bfe094d4bdc963aba3f08dfcd25 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:21:14.085458 13026 leader_election.cc:290] T be1a92657f494cac8dd227d152f50151 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:21:14.079433 13207 raft_consensus.cc:493] T f09c2a98de1a4decabd0ff900dd44caa P ccd8a4c3bfe3413cb2ae219b09aea832 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:14.125324  6803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "404190ce4ce94cecbfcb6ea9d1dd8626" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
W20260709 13:21:14.145351  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 94350.8us
I20260709 13:21:14.146256  6730 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50004 (request call id 2975) took 1748 ms. Trace:
W20260709 13:21:14.124774 13402 log.cc:927] Time spent T 713b5728a197487c9300b310ab94e5a3 P b7ab4784c7344b939bc36f639286f377: Append to log took a long time: real 0.075s	user 0.000s	sys 0.000s
I20260709 13:21:14.116187 13360 leader_election.cc:290] T de3186201e1a40d0b335eeb8b4e256e0 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 19 election: Requested vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:21:14.150377  6844 leader_election.cc:304] T 8c7f33e544204fbaac4078e3e83bbf4e P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:21:14.132539 13316 raft_consensus.cc:3055] T 404190ce4ce94cecbfcb6ea9d1dd8626 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:21:14.147185  6730 rpcz_store.cc:276] 0709 13:21:12.393215 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:21:12.478313 (+ 85098us) service_pool.cc:224] Handling call
0709 13:21:12.570512 (+ 92199us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:21:13.112078 (+541566us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:21:13.112143 (+    65us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:21:13.112750 (+   607us) log.cc:844] Serialized 26 byte log entry
0709 13:21:13.589311 (+476561us) spinlock_profiling.cc:243] Waited 2.86 ms on lock 0x7b18004c5700. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc15785de1 00007fcc157925b1 00007fcc0f5524bc 00007fcc0c8a048b 00007fcc156faab9 00007fcc0c8bc69b 00007fcc0c8ba93f 00007fcc0c8bcc02 00007fcc0f54420b 00007fcc0f549d23 00007fcc0f54a0d1
0709 13:21:13.589534 (+   223us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:21:13.921527 (+331993us) log.cc:844] Serialized 14 byte log entry
0709 13:21:13.922276 (+   749us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:21:14.141314 (+219038us) spinlock_profiling.cc:243] Waited 479 ms on lock 0x7b54003b88d4. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f9aae01 00007fcc0f9a983e 00007fcc1496e419 00007fcc0dee5bd4 00007fcc0dee5b62 00007fcc0dee5a91 00007fcc0dee5a0c 00007fcc0dee4cc2 00007fcc0dce548c 00007fcc0dce48c6
0709 13:21:14.141375 (+    61us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:21:14.141427 (+    52us) raft_consensus.cc:1685] finished
0709 13:21:14.141444 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:21:14.141609 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":218064,"prepare.queue_time_us":291243,"prepare.run_cpu_time_us":44,"prepare.run_wall_time_us":45,"raft.queue_time_us":63837,"raft.run_cpu_time_us":317,"raft.run_wall_time_us":19767,"spinlock_wait_cycles":1108386944,"thread_start_us":376506,"threads_started":2,"wal-append.queue_time_us":215172}
I20260709 13:21:14.183862 13304 raft_consensus.cc:493] T 4275cf08e63345f993bce8664eada830 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 17 FOLLOWER]: Starting leader election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:21:14.184643 13304 raft_consensus.cc:3060] T 4275cf08e63345f993bce8664eada830 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:21:14.117913 13207 raft_consensus.cc:515] T f09c2a98de1a4decabd0ff900dd44caa P ccd8a4c3bfe3413cb2ae219b09aea832 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:14.193109 13361 leader_election.cc:290] T 20f6842e26174571996b8dea4151d4be P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:21:14.196928 13290 leader_election.cc:290] T 7a734b5ab7834e05a8c422208acc58b1 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:21:14.157107 13202 leader_election.cc:290] T f58dc08b12a2494bb9a1372837970ca2 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:21:14.157562 13316 raft_consensus.cc:740] T 404190ce4ce94cecbfcb6ea9d1dd8626 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
I20260709 13:21:14.199077 13316 consensus_queue.cc:260] T 404190ce4ce94cecbfcb6ea9d1dd8626 P ccd8a4c3bfe3413cb2ae219b09aea832 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:21:14.200302 13316 raft_consensus.cc:3060] T 404190ce4ce94cecbfcb6ea9d1dd8626 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:21:14.205515  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 55286.9us
I20260709 13:21:14.206314  6844 leader_election.cc:304] T 90d42e216d9741e190bca19a781291fd P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
W20260709 13:21:14.209066 13407 log.cc:927] Time spent T 8c7f33e544204fbaac4078e3e83bbf4e P ccd8a4c3bfe3413cb2ae219b09aea832: Append to log took a long time: real 0.135s	user 0.000s	sys 0.000s
I20260709 13:21:14.218545  6729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a75bfe094d4bdc963aba3f08dfcd25" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:21:14.221182  6724 raft_consensus.cc:1275] T 20f6842e26174571996b8dea4151d4be P ccd8a4c3bfe3413cb2ae219b09aea832 [term 20 FOLLOWER]: Refusing update from remote peer b7ab4784c7344b939bc36f639286f377: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
I20260709 13:21:14.226446  6844 leader_election.cc:304] T 07a92dd554674067a83a9cb68c4773f2 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:21:14.205196 13347 raft_consensus.cc:2749] T 8c7f33e544204fbaac4078e3e83bbf4e P cd75a17ab2604397adab03bb8b5fd75c [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:21:14.241542  7495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be1a92657f494cac8dd227d152f50151" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:21:14.242584  7495 raft_consensus.cc:2393] T be1a92657f494cac8dd227d152f50151 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7ab4784c7344b939bc36f639286f377 in current term 21: Already voted for candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in this term.
W20260709 13:21:14.248885 13406 log.cc:927] Time spent T 4275cf08e63345f993bce8664eada830 P b7ab4784c7344b939bc36f639286f377: Append to log took a long time: real 0.097s	user 0.000s	sys 0.000s
W20260709 13:21:14.250082 13416 log.cc:927] Time spent T 427c124d773f483294511e80fe340075 P ccd8a4c3bfe3413cb2ae219b09aea832: Append to log took a long time: real 0.090s	user 0.001s	sys 0.000s
W20260709 13:21:14.253454  7466 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 141645us
I20260709 13:21:14.257400  6726 raft_consensus.cc:1275] T 3d65025eea89441290d85dd053810e31 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 20 FOLLOWER]: Refusing update from remote peer b7ab4784c7344b939bc36f639286f377: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 20 index: 11. (index mismatch)
I20260709 13:21:14.257477  6732 raft_consensus.cc:1240] T 9e326172347f45e99a0d482b5d8ef768 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 15 FOLLOWER]: Rejecting Update request from peer b7ab4784c7344b939bc36f639286f377 for earlier term 14. Current term is 15. Ops: []
I20260709 13:21:14.263162  6730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be1a92657f494cac8dd227d152f50151" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:21:14.264189  6730 raft_consensus.cc:2468] T be1a92657f494cac8dd227d152f50151 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 21.
I20260709 13:21:14.225026 13264 raft_consensus.cc:2749] T 90d42e216d9741e190bca19a781291fd P cd75a17ab2604397adab03bb8b5fd75c [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:21:14.284164 13399 raft_consensus.cc:3060] T 07a92dd554674067a83a9cb68c4773f2 P cd75a17ab2604397adab03bb8b5fd75c [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:21:14.284415 13026 consensus_queue.cc:1048] T 20f6842e26174571996b8dea4151d4be P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:21:14.286154  6770 leader_election.cc:304] T be1a92657f494cac8dd227d152f50151 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb
I20260709 13:21:14.289112  6844 leader_election.cc:304] T d8292e16e5654be6bc408560cf256aaa P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
W20260709 13:21:14.290328  6770 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.5.126.65:44391 timed out after 1.947s (SENT) [suppressed 23 similar messages]
I20260709 13:21:14.286440 13026 consensus_queue.cc:1048] T 3d65025eea89441290d85dd053810e31 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:21:14.268450 13249 consensus_queue.cc:1048] T 3411566abe2d4c9bb4b2adfdd05e6f17 P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.030s
I20260709 13:21:14.302006 13249 raft_consensus.cc:2749] T d8292e16e5654be6bc408560cf256aaa P cd75a17ab2604397adab03bb8b5fd75c [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:21:14.306119 13378 log.cc:927] Time spent T 9b3759de40694069b13c0f8bd40e5709 P ccd8a4c3bfe3413cb2ae219b09aea832: Append to log took a long time: real 0.697s	user 0.010s	sys 0.000s
I20260709 13:21:14.293738 13027 raft_consensus.cc:2804] T be1a92657f494cac8dd227d152f50151 P b7ab4784c7344b939bc36f639286f377 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:21:14.320287  6844 leader_election.cc:304] T a1704639a875409b9959353527b3fd68 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:21:14.322846  6844 leader_election.cc:304] T 7a734b5ab7834e05a8c422208acc58b1 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, b7ab4784c7344b939bc36f639286f377
I20260709 13:21:14.324219 13249 raft_consensus.cc:2804] T a1704639a875409b9959353527b3fd68 P cd75a17ab2604397adab03bb8b5fd75c [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:21:14.324867 13249 raft_consensus.cc:697] T a1704639a875409b9959353527b3fd68 P cd75a17ab2604397adab03bb8b5fd75c [term 21 LEADER]: Becoming Leader. State: Replica: cd75a17ab2604397adab03bb8b5fd75c, State: Running, Role: LEADER
I20260709 13:21:14.321439 13027 raft_consensus.cc:493] T be1a92657f494cac8dd227d152f50151 P b7ab4784c7344b939bc36f639286f377 [term 20 FOLLOWER]: Starting leader election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:21:14.325904 13027 raft_consensus.cc:3060] T be1a92657f494cac8dd227d152f50151 P b7ab4784c7344b939bc36f639286f377 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:21:14.325759 13249 consensus_queue.cc:237] T a1704639a875409b9959353527b3fd68 P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.12, Last appended by leader: 12, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:14.290915 13391 consensus_queue.cc:1059] T 9e326172347f45e99a0d482b5d8ef768 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: INVALID_TERM, Last received: 14.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.031s
I20260709 13:21:14.295971 13242 consensus_queue.cc:1048] T 95a75bfe094d4bdc963aba3f08dfcd25 P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.047s
W20260709 13:21:14.349925 13364 consensus_meta.cc:287] T 9b3759de40694069b13c0f8bd40e5709 P ccd8a4c3bfe3413cb2ae219b09aea832: Time spent flushing consensus metadata: real 0.511s	user 0.012s	sys 0.002s
I20260709 13:21:14.359234 13347 raft_consensus.cc:2749] T 7a734b5ab7834e05a8c422208acc58b1 P cd75a17ab2604397adab03bb8b5fd75c [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
W20260709 13:21:14.359714 13388 log.cc:927] Time spent T 853ac0a8cbd64ce99457f170216d4d0f P b7ab4784c7344b939bc36f639286f377: Append to log took a long time: real 0.339s	user 0.001s	sys 0.000s
I20260709 13:21:14.342523 13275 raft_consensus.cc:493] T 4b8cacb381b746da8d0049b0a83b41dd P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:21:14.377559  6770 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 87243.3us
I20260709 13:21:14.383261  6725 raft_consensus.cc:1275] T 9b3759de40694069b13c0f8bd40e5709 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 17 FOLLOWER]: Refusing update from remote peer b7ab4784c7344b939bc36f639286f377: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:21:14.403496 13377 raft_consensus.cc:3055] T 9e326172347f45e99a0d482b5d8ef768 P b7ab4784c7344b939bc36f639286f377 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:21:14.404207 13377 raft_consensus.cc:740] T 9e326172347f45e99a0d482b5d8ef768 P b7ab4784c7344b939bc36f639286f377 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
I20260709 13:21:14.405447  7503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3d8792045a4583ae2e965b1350a5b4" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 19 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:21:14.405303 13377 consensus_queue.cc:260] T 9e326172347f45e99a0d482b5d8ef768 P b7ab4784c7344b939bc36f639286f377 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:14.413558  7466 leader_election.cc:304] T 404190ce4ce94cecbfcb6ea9d1dd8626 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:21:14.423277  6880 raft_consensus.cc:1275] T e31b9971c15848dea59d4d4130141d9e P cd75a17ab2604397adab03bb8b5fd75c [term 17 FOLLOWER]: Refusing update from remote peer b7ab4784c7344b939bc36f639286f377: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 13:21:14.431243  6878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a75bfe094d4bdc963aba3f08dfcd25" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:21:14.436455  6874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c240553ce044eedb41541d72b9475d7" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:21:14.421862 13419 raft_consensus.cc:2749] T 404190ce4ce94cecbfcb6ea9d1dd8626 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:21:14.427228 13347 raft_consensus.cc:493] T 4b8cacb381b746da8d0049b0a83b41dd P cd75a17ab2604397adab03bb8b5fd75c [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:21:14.472853  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 150086us
I20260709 13:21:14.474431  6844 leader_election.cc:304] T e31b9971c15848dea59d4d4130141d9e P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:21:14.427615 13242 raft_consensus.cc:493] T 44bde925b2e541b69890d70715b85176 P cd75a17ab2604397adab03bb8b5fd75c [term 19 FOLLOWER]: Starting pre-election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:21:14.386680 13275 raft_consensus.cc:515] T 4b8cacb381b746da8d0049b0a83b41dd P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:21:14.478741  7503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a734b5ab7834e05a8c422208acc58b1" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:21:14.480720  6874 raft_consensus.cc:1275] T 20f6842e26174571996b8dea4151d4be P cd75a17ab2604397adab03bb8b5fd75c [term 20 FOLLOWER]: Refusing update from remote peer b7ab4784c7344b939bc36f639286f377: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
I20260709 13:21:14.439355 13207 leader_election.cc:290] T f09c2a98de1a4decabd0ff900dd44caa P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:21:14.441841 13425 raft_consensus.cc:493] T b56bf91d90824c959e21e0cee5ba1816 P cd75a17ab2604397adab03bb8b5fd75c [term 18 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:21:14.476745  6844 leader_election.cc:304] T d33d5ee8ef6f415593d8df52063161ad P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:21:14.493896  6844 leader_election.cc:304] T d8292e16e5654be6bc408560cf256aaa P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:21:14.497449  6874 raft_consensus.cc:1275] T 9b3759de40694069b13c0f8bd40e5709 P cd75a17ab2604397adab03bb8b5fd75c [term 17 FOLLOWER]: Refusing update from remote peer b7ab4784c7344b939bc36f639286f377: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:21:14.497480  6844 leader_election.cc:304] T 4f00a2e87e56452083b759f60d461ee3 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, b7ab4784c7344b939bc36f639286f377
I20260709 13:21:14.483301 13377 raft_consensus.cc:3060] T 9e326172347f45e99a0d482b5d8ef768 P b7ab4784c7344b939bc36f639286f377 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:21:14.503360 13249 raft_consensus.cc:2749] T e31b9971c15848dea59d4d4130141d9e P cd75a17ab2604397adab03bb8b5fd75c [term 17 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:21:14.495806 13399 raft_consensus.cc:2749] T 07a92dd554674067a83a9cb68c4773f2 P cd75a17ab2604397adab03bb8b5fd75c [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:21:14.480698 13347 raft_consensus.cc:515] T 4b8cacb381b746da8d0049b0a83b41dd P cd75a17ab2604397adab03bb8b5fd75c [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
W20260709 13:21:14.511811  6846 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.68:45071, user_credentials={real_user=slave}} blocked reactor thread for 78128.5us
I20260709 13:21:14.482604 13242 raft_consensus.cc:515] T 44bde925b2e541b69890d70715b85176 P cd75a17ab2604397adab03bb8b5fd75c [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:14.514474  6874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c7f33e544204fbaac4078e3e83bbf4e" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:21:14.518941  6878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3411566abe2d4c9bb4b2adfdd05e6f17" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:21:14.519685  6875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "427c124d773f483294511e80fe340075" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 19 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:21:14.520256  6875 raft_consensus.cc:2468] T 427c124d773f483294511e80fe340075 P cd75a17ab2604397adab03bb8b5fd75c [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 18.
I20260709 13:21:14.521076  6876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "853ac0a8cbd64ce99457f170216d4d0f" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:21:14.522078  6876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f58dc08b12a2494bb9a1372837970ca2" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:21:14.522591  6876 raft_consensus.cc:2468] T f58dc08b12a2494bb9a1372837970ca2 P cd75a17ab2604397adab03bb8b5fd75c [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 18.
I20260709 13:21:14.523331  6876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09c2a98de1a4decabd0ff900dd44caa" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:21:14.524494  6799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3022224cc81473690653a83d4e99470" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:21:14.525328  6807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20f6842e26174571996b8dea4151d4be" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 21 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:21:14.525348  6799 raft_consensus.cc:3060] T a3022224cc81473690653a83d4e99470 P b7ab4784c7344b939bc36f639286f377 [term 20 FOLLOWER]: Advancing to term 21
W20260709 13:21:14.520910  6695 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:21:14.528861  6807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09c2a98de1a4decabd0ff900dd44caa" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:21:14.530040  6807 raft_consensus.cc:2468] T f09c2a98de1a4decabd0ff900dd44caa P b7ab4784c7344b939bc36f639286f377 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 19.
I20260709 13:21:14.520802  6877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3022224cc81473690653a83d4e99470" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:21:14.531250  6877 raft_consensus.cc:3060] T a3022224cc81473690653a83d4e99470 P cd75a17ab2604397adab03bb8b5fd75c [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:21:14.531888  6878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a734b5ab7834e05a8c422208acc58b1" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:21:14.493127 13425 raft_consensus.cc:515] T b56bf91d90824c959e21e0cee5ba1816 P cd75a17ab2604397adab03bb8b5fd75c [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:14.534546  6805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a734b5ab7834e05a8c422208acc58b1" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:21:14.537998  6805 raft_consensus.cc:2468] T 7a734b5ab7834e05a8c422208acc58b1 P b7ab4784c7344b939bc36f639286f377 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 20.
I20260709 13:21:14.535595  6804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de3186201e1a40d0b335eeb8b4e256e0" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:21:14.536285  6878 raft_consensus.cc:2393] T 7a734b5ab7834e05a8c422208acc58b1 P cd75a17ab2604397adab03bb8b5fd75c [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ccd8a4c3bfe3413cb2ae219b09aea832 in current term 20: Already voted for candidate cd75a17ab2604397adab03bb8b5fd75c in this term.
I20260709 13:21:14.540717  6878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de3186201e1a40d0b335eeb8b4e256e0" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:21:14.513403 13249 raft_consensus.cc:2804] T d33d5ee8ef6f415593d8df52063161ad P cd75a17ab2604397adab03bb8b5fd75c [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:21:14.542098  6878 raft_consensus.cc:2393] T de3186201e1a40d0b335eeb8b4e256e0 P cd75a17ab2604397adab03bb8b5fd75c [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate ccd8a4c3bfe3413cb2ae219b09aea832 in current term 19: Already voted for candidate b7ab4784c7344b939bc36f639286f377 in this term.
I20260709 13:21:14.541612  6876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20f6842e26174571996b8dea4151d4be" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 21 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:21:14.546975  6876 raft_consensus.cc:2468] T 20f6842e26174571996b8dea4151d4be P cd75a17ab2604397adab03bb8b5fd75c [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 20.
I20260709 13:21:14.549738  6803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f58dc08b12a2494bb9a1372837970ca2" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:21:14.550016  6801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "853ac0a8cbd64ce99457f170216d4d0f" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:21:14.509621 13304 raft_consensus.cc:515] T 4275cf08e63345f993bce8664eada830 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:14.557080  6772 leader_election.cc:304] T 95a75bfe094d4bdc963aba3f08dfcd25 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:21:14.537307 13216 raft_consensus.cc:493] T 404190ce4ce94cecbfcb6ea9d1dd8626 P b7ab4784c7344b939bc36f639286f377 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:21:14.572860  6877 raft_consensus.cc:2468] T a3022224cc81473690653a83d4e99470 P cd75a17ab2604397adab03bb8b5fd75c [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 21.
I20260709 13:21:14.680948  6799 raft_consensus.cc:2468] T a3022224cc81473690653a83d4e99470 P b7ab4784c7344b939bc36f639286f377 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 21.
I20260709 13:21:14.540810 13399 raft_consensus.cc:2749] T 4f00a2e87e56452083b759f60d461ee3 P cd75a17ab2604397adab03bb8b5fd75c [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:21:14.560316 13309 raft_consensus.cc:493] T 7ba5dac66ab5497e9e336f2a3c28cda5 P b7ab4784c7344b939bc36f639286f377 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 7ba59cc884714e8aa5f3f0ecaed84cbb)
I20260709 13:21:14.683452  6695 leader_election.cc:304] T dbdf895bba214ff68685a24fd17dfb5d P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:21:14.577510 13027 raft_consensus.cc:515] T be1a92657f494cac8dd227d152f50151 P b7ab4784c7344b939bc36f639286f377 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:21:14.713213 13027 leader_election.cc:290] T be1a92657f494cac8dd227d152f50151 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 21 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:21:14.546663 13227 consensus_queue.cc:1048] T e31b9971c15848dea59d4d4130141d9e P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.150s
I20260709 13:21:14.597417 13275 leader_election.cc:290] T 4b8cacb381b746da8d0049b0a83b41dd P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:21:14.579293 13304 leader_election.cc:290] T 4275cf08e63345f993bce8664eada830 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 18 election: Requested vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:21:14.695713 13216 raft_consensus.cc:515] T 404190ce4ce94cecbfcb6ea9d1dd8626 P b7ab4784c7344b939bc36f639286f377 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:21:14.717767 13273 raft_consensus.cc:2749] T dbdf895bba214ff68685a24fd17dfb5d P ccd8a4c3bfe3413cb2ae219b09aea832 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:21:14.546854 13428 raft_consensus.cc:2804] T d8292e16e5654be6bc408560cf256aaa P cd75a17ab2604397adab03bb8b5fd75c [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:21:14.601256  6770 leader_election.cc:304] T 2c240553ce044eedb41541d72b9475d7 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: cd75a17ab2604397adab03bb8b5fd75c
W20260709 13:21:14.697589 13387 log.cc:927] Time spent T 7c37d41cd9164c15a6826ca62a851a69 P cd75a17ab2604397adab03bb8b5fd75c: Append to log took a long time: real 0.131s	user 0.001s	sys 0.000s
W20260709 13:21:14.701324  6697 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:21:14.588506  6728 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50004 (request call id 2962) took 2205 ms (client timeout 1947 ms). Trace:
W20260709 13:21:14.599086  6696 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:21:14.584522  6730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a92dd554674067a83a9cb68c4773f2" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:21:14.735116  6730 raft_consensus.cc:2376] T 07a92dd554674067a83a9cb68c4773f2 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 17 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 17. Re-sending same reply.
I20260709 13:21:14.578756  6731 raft_consensus.cc:1240] T 4275cf08e63345f993bce8664eada830 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 18 FOLLOWER]: Rejecting Update request from peer b7ab4784c7344b939bc36f639286f377 for earlier term 17. Current term is 18. Ops: []
W20260709 13:21:14.664944  6772 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 63710.3us
W20260709 13:21:14.680409  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 183006us
I20260709 13:21:14.580538  7503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b8cacb381b746da8d0049b0a83b41dd" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:21:14.737902  7503 raft_consensus.cc:2468] T 4b8cacb381b746da8d0049b0a83b41dd P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 19.
I20260709 13:21:14.737421  6844 leader_election.cc:400] T ab432e62819d499eaaf3dd55481dd930 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 21 election: Vote denied by peer b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817) with higher term. Message: Invalid argument: T ab432e62819d499eaaf3dd55481dd930 P b7ab4784c7344b939bc36f639286f377 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c for earlier term 21. Current term is 22.
I20260709 13:21:14.739085  6844 leader_election.cc:403] T ab432e62819d499eaaf3dd55481dd930 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 21 election: Cancelling election due to peer responding with higher term
W20260709 13:21:14.726555  6770 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 125366us
I20260709 13:21:14.684185 13425 leader_election.cc:290] T b56bf91d90824c959e21e0cee5ba1816 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:21:14.696470 13217 raft_consensus.cc:493] T 95a75bfe094d4bdc963aba3f08dfcd25 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader cd75a17ab2604397adab03bb8b5fd75c)
I20260709 13:21:14.732635 13242 leader_election.cc:290] T 44bde925b2e541b69890d70715b85176 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:21:14.722378  6695 leader_election.cc:304] T 7c44c4849aa54f2b94d1f1bef9ed546f P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
I20260709 13:21:14.748234 13361 raft_consensus.cc:493] T 4b8cacb381b746da8d0049b0a83b41dd P ccd8a4c3bfe3413cb2ae219b09aea832 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:21:14.734637  6728 rpcz_store.cc:269] 0709 13:21:12.382715 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:21:12.387257 (+  4542us) service_pool.cc:224] Handling call
0709 13:21:14.588294 (+2201037us) spinlock_profiling.cc:243] Waited 1.08 s on lock 0x7b5400057154. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f9ae2fa 00007fcc1496fb17 00007fcc0deea6d4 00007fcc0deea662 00007fcc0deea591 00007fcc0deea50c 00007fcc0dee97c2 00007fcc0dce548c 00007fcc0dce48c6 00007fcc0dce426f
0709 13:21:14.588399 (+   105us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2490564864}
I20260709 13:21:14.748988 13391 raft_consensus.cc:2804] T 2c240553ce044eedb41541d72b9475d7 P b7ab4784c7344b939bc36f639286f377 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:21:14.664327 13298 raft_consensus.cc:2749] T 95a75bfe094d4bdc963aba3f08dfcd25 P b7ab4784c7344b939bc36f639286f377 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:21:14.578428 13347 leader_election.cc:290] T 4b8cacb381b746da8d0049b0a83b41dd P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:21:14.575896 13431 raft_consensus.cc:493] T fe20b4b48823486ca3b9c648db6ce8aa P cd75a17ab2604397adab03bb8b5fd75c [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 7ba59cc884714e8aa5f3f0ecaed84cbb)
I20260709 13:21:14.703296 13364 raft_consensus.cc:493] T f5be3a11b23d4ea9b08300a2789821c7 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:21:14.755462  7498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "404190ce4ce94cecbfcb6ea9d1dd8626" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:21:14.690948 12730 raft_consensus.cc:493] T a1704639a875409b9959353527b3fd68 P b7ab4784c7344b939bc36f639286f377 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:14.755831 13369 raft_consensus.cc:493] T f3f9c2e2bf644115957398fe4c9459db P ccd8a4c3bfe3413cb2ae219b09aea832 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader cd75a17ab2604397adab03bb8b5fd75c)
I20260709 13:21:14.760427  7503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be1a92657f494cac8dd227d152f50151" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb"
I20260709 13:21:14.825731  7503 raft_consensus.cc:2393] T be1a92657f494cac8dd227d152f50151 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate b7ab4784c7344b939bc36f639286f377 in current term 21: Already voted for candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in this term.
I20260709 13:21:14.764968  6844 leader_election.cc:304] T 713b5728a197487c9300b310ab94e5a3 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:21:14.760939 13309 raft_consensus.cc:515] T 7ba5dac66ab5497e9e336f2a3c28cda5 P b7ab4784c7344b939bc36f639286f377 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:21:14.719575 13216 leader_election.cc:290] T 404190ce4ce94cecbfcb6ea9d1dd8626 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
W20260709 13:21:14.775504  6695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 53254.8us
I20260709 13:21:14.774019 13264 raft_consensus.cc:3060] T ab432e62819d499eaaf3dd55481dd930 P cd75a17ab2604397adab03bb8b5fd75c [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:21:14.827414  7498 raft_consensus.cc:2393] T 404190ce4ce94cecbfcb6ea9d1dd8626 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7ab4784c7344b939bc36f639286f377 in current term 17: Already voted for candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in this term.
I20260709 13:21:14.785374 13217 raft_consensus.cc:515] T 95a75bfe094d4bdc963aba3f08dfcd25 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } attrs { replace: true } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:21:14.828608  6730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b8cacb381b746da8d0049b0a83b41dd" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:21:14.772840 13207 raft_consensus.cc:493] T a1704639a875409b9959353527b3fd68 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:21:14.784379 13391 raft_consensus.cc:493] T 2c240553ce044eedb41541d72b9475d7 P b7ab4784c7344b939bc36f639286f377 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:21:14.831210  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 66376.6us
I20260709 13:21:14.812803 13393 raft_consensus.cc:493] T 4d9def8b32fd443aa94ab1420b06837b P b7ab4784c7344b939bc36f639286f377 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:14.784768 13273 raft_consensus.cc:2804] T 7c44c4849aa54f2b94d1f1bef9ed546f P ccd8a4c3bfe3413cb2ae219b09aea832 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:21:14.687248 13403 consensus_queue.cc:1048] T 20f6842e26174571996b8dea4151d4be P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.143s
I20260709 13:21:14.822006 13275 raft_consensus.cc:493] T 7a734b5ab7834e05a8c422208acc58b1 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 19 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:21:14.840415  6844 leader_election.cc:304] T 7887766dc6784fcaa42b35c05fea7a99 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:21:14.686599 13430 raft_consensus.cc:493] T ce4f062dcd314d43a63ca74067cb5ee3 P cd75a17ab2604397adab03bb8b5fd75c [term 15 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:21:14.812171 13249 raft_consensus.cc:697] T d33d5ee8ef6f415593d8df52063161ad P cd75a17ab2604397adab03bb8b5fd75c [term 17 LEADER]: Becoming Leader. State: Replica: cd75a17ab2604397adab03bb8b5fd75c, State: Running, Role: LEADER
I20260709 13:21:14.756096 13410 consensus_queue.cc:1048] T 9b3759de40694069b13c0f8bd40e5709 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 8, Time since last communication: 0.076s
I20260709 13:21:14.842185  6695 leader_election.cc:304] T 3411566abe2d4c9bb4b2adfdd05e6f17 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
I20260709 13:21:14.783679 13428 raft_consensus.cc:697] T d8292e16e5654be6bc408560cf256aaa P cd75a17ab2604397adab03bb8b5fd75c [term 18 LEADER]: Becoming Leader. State: Replica: cd75a17ab2604397adab03bb8b5fd75c, State: Running, Role: LEADER
I20260709 13:21:14.867643  6806 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:32966 (request call id 1607) took 2443 ms. Trace:
I20260709 13:21:14.827854 12730 raft_consensus.cc:515] T a1704639a875409b9959353527b3fd68 P b7ab4784c7344b939bc36f639286f377 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:14.843030 13391 raft_consensus.cc:3060] T 2c240553ce044eedb41541d72b9475d7 P b7ab4784c7344b939bc36f639286f377 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:21:14.804132 13361 raft_consensus.cc:515] T 4b8cacb381b746da8d0049b0a83b41dd P ccd8a4c3bfe3413cb2ae219b09aea832 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:21:14.852197  6844 leader_election.cc:304] T a1704639a875409b9959353527b3fd68 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:21:14.847671 13273 raft_consensus.cc:493] T 7c44c4849aa54f2b94d1f1bef9ed546f P ccd8a4c3bfe3413cb2ae219b09aea832 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:14.868211  6806 rpcz_store.cc:276] 0709 13:21:12.410294 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:21:12.733129 (+322835us) service_pool.cc:224] Handling call
0709 13:21:12.733505 (+   376us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:21:13.517514 (+784009us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:21:13.860338 (+342824us) spinlock_profiling.cc:243] Waited 3.21 ms on lock 0x7b18002d8b60. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc15785de1 00007fcc157925b1 00007fcc0c89fe07 00007fcc156faab9 00007fcc0c8bc69b 00007fcc0c8ba93f 00007fcc0c8ba455 00007fcc133a23c7 00007fcc0f9b49a7 00007fcc0f9c40bf 00007fcc0f9c4038
0709 13:21:14.000490 (+140152us) log.cc:844] Serialized 14 byte log entry
0709 13:21:14.157089 (+156599us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:21:14.157966 (+   877us) log.cc:844] Serialized 26 byte log entry
0709 13:21:14.158170 (+   204us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:21:14.158835 (+   665us) log.cc:844] Serialized 14 byte log entry
0709 13:21:14.159201 (+   366us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:21:14.400886 (+241685us) spinlock_profiling.cc:243] Waited 14.9 ms on lock 0x7b18002d8b60. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc15785de1 00007fcc157925b1 00007fcc0c8bd522 00007fcc0c8bf7c1 00007fcc0c8bf779 00007fcc0c8bf709 00007fcc0c8bf6d1 00007fcc0c8be9cd 000000000038f354 000000000038f199 00007fcc0c8a083a
0709 13:21:14.580831 (+179945us) spinlock_profiling.cc:243] Waited 8.14 ms on lock 0x7b18002d8b60. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc15785de1 00007fcc157925b1 00007fcc0c8bd3f3 00007fcc0c8bf7c1 00007fcc0c8bf779 00007fcc0c8bf709 00007fcc0c8bf6d1 00007fcc0c8be9cd 000000000038f354 000000000038f199 00007fcc0c8a083a
0709 13:21:14.852848 (+272017us) spinlock_profiling.cc:243] Waited 705 ms on lock 0x7b5400353754. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f9aae01 00007fcc0f9a983e 00007fcc1496e419 00007fcc0dee5bd4 00007fcc0dee5b62 00007fcc0dee5a91 00007fcc0dee5a0c 00007fcc0dee4cc2 00007fcc0dce548c 00007fcc0dce48c6
0709 13:21:14.852925 (+    77us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:21:14.853010 (+    85us) raft_consensus.cc:1685] finished
0709 13:21:14.853030 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:21:14.853240 (+   210us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":127685,"prepare.queue_time_us":427841,"prepare.run_cpu_time_us":195,"prepare.run_wall_time_us":6010,"raft.queue_time_us":83379,"raft.run_cpu_time_us":503,"raft.run_wall_time_us":24123,"spinlock_wait_cycles":1682857984,"thread_start_us":258495,"threads_started":2,"wal-append.queue_time_us":213518}
I20260709 13:21:14.842834 13207 raft_consensus.cc:515] T a1704639a875409b9959353527b3fd68 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:14.882043 13207 leader_election.cc:290] T a1704639a875409b9959353527b3fd68 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:21:14.883055 13361 leader_election.cc:290] T 4b8cacb381b746da8d0049b0a83b41dd P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:21:14.884333  6730 raft_consensus.cc:2468] T 4b8cacb381b746da8d0049b0a83b41dd P ccd8a4c3bfe3413cb2ae219b09aea832 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in term 19.
I20260709 13:21:14.884464 13428 consensus_queue.cc:237] T d8292e16e5654be6bc408560cf256aaa P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:14.832218 13369 raft_consensus.cc:515] T f3f9c2e2bf644115957398fe4c9459db P ccd8a4c3bfe3413cb2ae219b09aea832 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:14.871376 13290 raft_consensus.cc:2804] T 3411566abe2d4c9bb4b2adfdd05e6f17 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:21:14.888969 13290 raft_consensus.cc:697] T 3411566abe2d4c9bb4b2adfdd05e6f17 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 18 LEADER]: Becoming Leader. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
I20260709 13:21:14.890051 13369 leader_election.cc:290] T f3f9c2e2bf644115957398fe4c9459db P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:21:14.889920 13290 consensus_queue.cc:237] T 3411566abe2d4c9bb4b2adfdd05e6f17 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.11, Last appended by leader: 11, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:14.900300 13273 raft_consensus.cc:3060] T 7c44c4849aa54f2b94d1f1bef9ed546f P ccd8a4c3bfe3413cb2ae219b09aea832 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:21:14.851114 13393 raft_consensus.cc:515] T 4d9def8b32fd443aa94ab1420b06837b P b7ab4784c7344b939bc36f639286f377 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:14.907202 13393 leader_election.cc:290] T 4d9def8b32fd443aa94ab1420b06837b P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:21:14.858573 13275 raft_consensus.cc:515] T 7a734b5ab7834e05a8c422208acc58b1 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } attrs { replace: true } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
W20260709 13:21:14.912802  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 60672.9us
I20260709 13:21:14.913980  6844 leader_election.cc:304] T 4d9def8b32fd443aa94ab1420b06837b P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377
I20260709 13:21:14.830188 13431 raft_consensus.cc:515] T fe20b4b48823486ca3b9c648db6ce8aa P cd75a17ab2604397adab03bb8b5fd75c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:21:14.833444 13364 raft_consensus.cc:515] T f5be3a11b23d4ea9b08300a2789821c7 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:14.846199 13202 consensus_queue.cc:1048] T ab432e62819d499eaaf3dd55481dd930 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 9, Time since last communication: 0.036s
I20260709 13:21:14.949535 13217 leader_election.cc:290] T 95a75bfe094d4bdc963aba3f08dfcd25 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:21:14.949901 13425 raft_consensus.cc:2804] T 4d9def8b32fd443aa94ab1420b06837b P cd75a17ab2604397adab03bb8b5fd75c [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:21:14.951556  6844 leader_election.cc:304] T 7887766dc6784fcaa42b35c05fea7a99 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377
I20260709 13:21:14.954571  6846 leader_election.cc:304] T 4b8cacb381b746da8d0049b0a83b41dd P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:21:14.872840 13242 raft_consensus.cc:2804] T 7887766dc6784fcaa42b35c05fea7a99 P cd75a17ab2604397adab03bb8b5fd75c [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:21:14.931398  6801 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "22ccee1b570c4ad3a57bd7aec085b1b4"
dest_uuid: "b7ab4784c7344b939bc36f639286f377"
mode: GRACEFUL
new_leader_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
 from {username='slave'} at 127.0.0.1:38240
I20260709 13:21:14.936429 13434 raft_consensus.cc:2749] T a1704639a875409b9959353527b3fd68 P cd75a17ab2604397adab03bb8b5fd75c [term 21 LEADER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:21:14.954715  7498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe20b4b48823486ca3b9c648db6ce8aa" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
W20260709 13:21:14.922428 13392 log.cc:927] Time spent T 427c124d773f483294511e80fe340075 P b7ab4784c7344b939bc36f639286f377: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
I20260709 13:21:14.941536 13364 leader_election.cc:290] T f5be3a11b23d4ea9b08300a2789821c7 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:21:14.943717 13431 leader_election.cc:290] T fe20b4b48823486ca3b9c648db6ce8aa P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:21:14.921538 13275 leader_election.cc:290] T 7a734b5ab7834e05a8c422208acc58b1 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:21:14.945281 13249 consensus_queue.cc:237] T d33d5ee8ef6f415593d8df52063161ad P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.9, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:14.958290  6801 raft_consensus.cc:606] T 22ccee1b570c4ad3a57bd7aec085b1b4 P b7ab4784c7344b939bc36f639286f377 [term 14 LEADER]: Received request to transfer leadership to TS cd75a17ab2604397adab03bb8b5fd75c
W20260709 13:21:14.982376  6770 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 160687us
W20260709 13:21:14.988111  7466 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 152218us
I20260709 13:21:14.987701  6770 leader_election.cc:304] T 07a92dd554674067a83a9cb68c4773f2 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:21:14.993278  7466 leader_election.cc:304] T 4b8cacb381b746da8d0049b0a83b41dd P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
I20260709 13:21:14.867393 13430 raft_consensus.cc:515] T ce4f062dcd314d43a63ca74067cb5ee3 P cd75a17ab2604397adab03bb8b5fd75c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:21:15.006906  6724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a734b5ab7834e05a8c422208acc58b1" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:21:15.007616  6724 raft_consensus.cc:2468] T 7a734b5ab7834e05a8c422208acc58b1 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in term 19.
I20260709 13:21:15.007880 13408 consensus_queue.cc:1059] T 4275cf08e63345f993bce8664eada830 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: INVALID_TERM, Last received: 17.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:21:15.006906  6801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a734b5ab7834e05a8c422208acc58b1" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:21:15.008872 13076 raft_consensus.cc:3055] T 4275cf08e63345f993bce8664eada830 P b7ab4784c7344b939bc36f639286f377 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:21:15.009104  6801 raft_consensus.cc:2468] T 7a734b5ab7834e05a8c422208acc58b1 P b7ab4784c7344b939bc36f639286f377 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in term 20.
I20260709 13:21:15.009248 13076 raft_consensus.cc:740] T 4275cf08e63345f993bce8664eada830 P b7ab4784c7344b939bc36f639286f377 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
I20260709 13:21:15.010202 13076 consensus_queue.cc:260] T 4275cf08e63345f993bce8664eada830 P b7ab4784c7344b939bc36f639286f377 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.9, Last appended by leader: 9, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:15.015384  6729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "404190ce4ce94cecbfcb6ea9d1dd8626" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:21:15.016402  6731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d9def8b32fd443aa94ab1420b06837b" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:21:15.016722 13448 raft_consensus.cc:493] T 24ee15416e3145beaa1b8183453729a3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 19 FOLLOWER]: Starting pre-election (detected failure of leader cd75a17ab2604397adab03bb8b5fd75c)
I20260709 13:21:15.017016  6731 raft_consensus.cc:2468] T 4d9def8b32fd443aa94ab1420b06837b P ccd8a4c3bfe3413cb2ae219b09aea832 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 20.
I20260709 13:21:15.017267 13448 raft_consensus.cc:515] T 24ee15416e3145beaa1b8183453729a3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:21:15.019405  6725 raft_consensus.cc:1275] T de3186201e1a40d0b335eeb8b4e256e0 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 19 FOLLOWER]: Refusing update from remote peer b7ab4784c7344b939bc36f639286f377: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 19 index: 10. (index mismatch)
I20260709 13:21:15.019918 13448 leader_election.cc:290] T 24ee15416e3145beaa1b8183453729a3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:21:15.022019  6729 raft_consensus.cc:2468] T 404190ce4ce94cecbfcb6ea9d1dd8626 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 17.
I20260709 13:21:15.023924  6724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be1a92657f494cac8dd227d152f50151" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:21:15.025545  7466 leader_election.cc:304] T 7a734b5ab7834e05a8c422208acc58b1 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
I20260709 13:21:15.026348 13417 raft_consensus.cc:2804] T 7a734b5ab7834e05a8c422208acc58b1 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:21:15.026700 13417 raft_consensus.cc:493] T 7a734b5ab7834e05a8c422208acc58b1 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 19 FOLLOWER]: Starting leader election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:21:15.027045 13417 raft_consensus.cc:3060] T 7a734b5ab7834e05a8c422208acc58b1 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:21:15.028347  6846 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.68:45071, user_credentials={real_user=slave}} blocked reactor thread for 73837.9us
I20260709 13:21:15.029681  6723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24ee15416e3145beaa1b8183453729a3" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:21:15.033603  6723 raft_consensus.cc:2468] T 24ee15416e3145beaa1b8183453729a3 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in term 19.
I20260709 13:21:15.037782  7466 leader_election.cc:304] T 24ee15416e3145beaa1b8183453729a3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
W20260709 13:21:15.044888  6695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 183127us
I20260709 13:21:15.046527  6695 leader_election.cc:304] T f09c2a98de1a4decabd0ff900dd44caa P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
I20260709 13:21:14.989866 12898 raft_consensus.cc:2804] T 07a92dd554674067a83a9cb68c4773f2 P b7ab4784c7344b939bc36f639286f377 [term 17 FOLLOWER]: Leader election won for term 17
W20260709 13:21:15.070521  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 119050us
I20260709 13:21:15.075275  6724 raft_consensus.cc:2468] T be1a92657f494cac8dd227d152f50151 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 21.
W20260709 13:21:15.079954 13377 consensus_meta.cc:287] T 9e326172347f45e99a0d482b5d8ef768 P b7ab4784c7344b939bc36f639286f377: Time spent flushing consensus metadata: real 0.574s	user 0.006s	sys 0.003s
I20260709 13:21:15.049551 13419 raft_consensus.cc:2804] T 4b8cacb381b746da8d0049b0a83b41dd P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:21:15.081290  6695 leader_election.cc:304] T a3022224cc81473690653a83d4e99470 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
I20260709 13:21:15.062952 13448 raft_consensus.cc:2804] T 24ee15416e3145beaa1b8183453729a3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:21:15.065157 13434 raft_consensus.cc:2804] T 4b8cacb381b746da8d0049b0a83b41dd P cd75a17ab2604397adab03bb8b5fd75c [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:21:15.069113 13361 raft_consensus.cc:2804] T f09c2a98de1a4decabd0ff900dd44caa P ccd8a4c3bfe3413cb2ae219b09aea832 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:21:15.039801 13403 consensus_queue.cc:1048] T 9b3759de40694069b13c0f8bd40e5709 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.046s
I20260709 13:21:15.107189 13202 raft_consensus.cc:2804] T a3022224cc81473690653a83d4e99470 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:21:15.117702 13202 raft_consensus.cc:697] T a3022224cc81473690653a83d4e99470 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 21 LEADER]: Becoming Leader. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
I20260709 13:21:15.114923 13364 raft_consensus.cc:493] T 9e326172347f45e99a0d482b5d8ef768 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:15.118331 13431 consensus_queue.cc:1059] T c4db81d9d329422bb3b4160ca4ac2d1d P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: INVALID_TERM, Last received: 18.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:21:15.118578 13202 consensus_queue.cc:237] T a3022224cc81473690653a83d4e99470 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.11, Last appended by leader: 11, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:15.118667 13364 raft_consensus.cc:515] T 9e326172347f45e99a0d482b5d8ef768 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:15.121011 13439 raft_consensus.cc:3055] T c4db81d9d329422bb3b4160ca4ac2d1d P cd75a17ab2604397adab03bb8b5fd75c [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:21:15.121429 13439 raft_consensus.cc:740] T c4db81d9d329422bb3b4160ca4ac2d1d P cd75a17ab2604397adab03bb8b5fd75c [term 18 LEADER]: Becoming Follower/Learner. State: Replica: cd75a17ab2604397adab03bb8b5fd75c, State: Running, Role: LEADER
I20260709 13:21:15.122263 13439 consensus_queue.cc:260] T c4db81d9d329422bb3b4160ca4ac2d1d P cd75a17ab2604397adab03bb8b5fd75c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.10, Last appended by leader: 10, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:15.077430 12898 raft_consensus.cc:697] T 07a92dd554674067a83a9cb68c4773f2 P b7ab4784c7344b939bc36f639286f377 [term 17 LEADER]: Becoming Leader. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
I20260709 13:21:15.104900 13419 raft_consensus.cc:493] T 4b8cacb381b746da8d0049b0a83b41dd P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:15.132069 13425 raft_consensus.cc:697] T 4d9def8b32fd443aa94ab1420b06837b P cd75a17ab2604397adab03bb8b5fd75c [term 20 LEADER]: Becoming Leader. State: Replica: cd75a17ab2604397adab03bb8b5fd75c, State: Running, Role: LEADER
I20260709 13:21:15.140537 13425 consensus_queue.cc:237] T 4d9def8b32fd443aa94ab1420b06837b P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 17.9, Last appended by leader: 9, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:15.107945 13448 raft_consensus.cc:493] T 24ee15416e3145beaa1b8183453729a3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 19 FOLLOWER]: Starting leader election (detected failure of leader cd75a17ab2604397adab03bb8b5fd75c)
I20260709 13:21:15.111593 13434 raft_consensus.cc:493] T 4b8cacb381b746da8d0049b0a83b41dd P cd75a17ab2604397adab03bb8b5fd75c [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:21:15.143239  6772 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:21:15.111143 13361 raft_consensus.cc:493] T f09c2a98de1a4decabd0ff900dd44caa P ccd8a4c3bfe3413cb2ae219b09aea832 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:15.146700 13242 raft_consensus.cc:697] T 7887766dc6784fcaa42b35c05fea7a99 P cd75a17ab2604397adab03bb8b5fd75c [term 22 LEADER]: Becoming Leader. State: Replica: cd75a17ab2604397adab03bb8b5fd75c, State: Running, Role: LEADER
I20260709 13:21:15.169735 13242 consensus_queue.cc:237] T 7887766dc6784fcaa42b35c05fea7a99 P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 20.11, Last appended by leader: 11, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:15.142982 13419 raft_consensus.cc:3060] T 4b8cacb381b746da8d0049b0a83b41dd P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:21:15.173067 13444 log.cc:927] Time spent T 3d65025eea89441290d85dd053810e31 P ccd8a4c3bfe3413cb2ae219b09aea832: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260709 13:21:15.172657 12898 consensus_queue.cc:237] T 07a92dd554674067a83a9cb68c4773f2 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
W20260709 13:21:15.173452  6847 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:21:15.173591  6697 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 439546us
I20260709 13:21:15.176733  6806 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3411566abe2d4c9bb4b2adfdd05e6f17"
dest_uuid: "b7ab4784c7344b939bc36f639286f377"
mode: GRACEFUL
new_leader_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
 from {username='slave'} at 127.0.0.1:38240
I20260709 13:21:15.196559  6806 raft_consensus.cc:606] T 3411566abe2d4c9bb4b2adfdd05e6f17 P b7ab4784c7344b939bc36f639286f377 [term 18 FOLLOWER]: Received request to transfer leadership to TS cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:21:15.196997  6806 raft_consensus.cc:614] T 3411566abe2d4c9bb4b2adfdd05e6f17 P b7ab4784c7344b939bc36f639286f377 [term 18 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:21:15.177989  6801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4275cf08e63345f993bce8664eada830" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:21:15.197297  6875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d9def8b32fd443aa94ab1420b06837b" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:21:15.179217  7503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ba5dac66ab5497e9e336f2a3c28cda5" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:21:15.200527  6697 leader_election.cc:304] T 8c7f33e544204fbaac4078e3e83bbf4e P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:21:15.183873  6798 raft_consensus.cc:1275] T 30e88460611e47b2ba16a46a30b5f416 P b7ab4784c7344b939bc36f639286f377 [term 15 FOLLOWER]: Refusing update from remote peer ccd8a4c3bfe3413cb2ae219b09aea832: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 13:21:15.188223  6803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1704639a875409b9959353527b3fd68" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:21:15.202209  6803 raft_consensus.cc:2368] T a1704639a875409b9959353527b3fd68 P b7ab4784c7344b939bc36f639286f377 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 20. Current term is 21.
I20260709 13:21:15.182694 13273 raft_consensus.cc:515] T 7c44c4849aa54f2b94d1f1bef9ed546f P ccd8a4c3bfe3413cb2ae219b09aea832 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:15.209934  6877 raft_consensus.cc:1275] T 3d65025eea89441290d85dd053810e31 P cd75a17ab2604397adab03bb8b5fd75c [term 20 FOLLOWER]: Refusing update from remote peer b7ab4784c7344b939bc36f639286f377: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 20 index: 11. (index mismatch)
I20260709 13:21:15.165555 13448 raft_consensus.cc:3060] T 24ee15416e3145beaa1b8183453729a3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:21:15.211349  6803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f9c2e2bf644115957398fe4c9459db" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:21:15.217135  6803 raft_consensus.cc:2468] T f3f9c2e2bf644115957398fe4c9459db P b7ab4784c7344b939bc36f639286f377 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 17.
I20260709 13:21:15.212641  6873 raft_consensus.cc:1275] T de3186201e1a40d0b335eeb8b4e256e0 P cd75a17ab2604397adab03bb8b5fd75c [term 19 FOLLOWER]: Refusing update from remote peer b7ab4784c7344b939bc36f639286f377: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 19 index: 10. (index mismatch)
W20260709 13:21:15.212684  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 137977us
I20260709 13:21:15.218833  6844 leader_election.cc:304] T 22ccee1b570c4ad3a57bd7aec085b1b4 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:21:15.171285 13361 raft_consensus.cc:3060] T f09c2a98de1a4decabd0ff900dd44caa P ccd8a4c3bfe3413cb2ae219b09aea832 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:21:15.145999 13309 leader_election.cc:290] T 7ba5dac66ab5497e9e336f2a3c28cda5 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:21:15.209007  6878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ba5dac66ab5497e9e336f2a3c28cda5" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:21:15.222901  6803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5be3a11b23d4ea9b08300a2789821c7" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:21:15.235965  6878 raft_consensus.cc:2468] T 7ba5dac66ab5497e9e336f2a3c28cda5 P cd75a17ab2604397adab03bb8b5fd75c [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 19.
I20260709 13:21:15.215111  6697 leader_election.cc:304] T 853ac0a8cbd64ce99457f170216d4d0f P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:21:15.167559 13434 raft_consensus.cc:3060] T 4b8cacb381b746da8d0049b0a83b41dd P cd75a17ab2604397adab03bb8b5fd75c [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:21:15.231402  6806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a75bfe094d4bdc963aba3f08dfcd25" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:21:15.243530  6806 raft_consensus.cc:2468] T 95a75bfe094d4bdc963aba3f08dfcd25 P b7ab4784c7344b939bc36f639286f377 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 16.
I20260709 13:21:15.124435 13417 raft_consensus.cc:515] T 7a734b5ab7834e05a8c422208acc58b1 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 20 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } attrs { replace: true } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:21:15.236969  6770 leader_election.cc:304] T 4d9def8b32fd443aa94ab1420b06837b P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
I20260709 13:21:15.237553  6697 leader_election.cc:304] T f58dc08b12a2494bb9a1372837970ca2 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377
I20260709 13:21:15.247514  6697 leader_election.cc:304] T de3186201e1a40d0b335eeb8b4e256e0 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:21:15.239588  6727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1704639a875409b9959353527b3fd68" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 22 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:21:15.259065  6844 leader_election.cc:304] T f4b8bd455d5a47c18a1380839c6e0d61 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377
I20260709 13:21:15.216424 13217 raft_consensus.cc:2749] T 8c7f33e544204fbaac4078e3e83bbf4e P ccd8a4c3bfe3413cb2ae219b09aea832 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:21:15.250744  6803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e326172347f45e99a0d482b5d8ef768" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:21:15.264184 13399 raft_consensus.cc:2749] T 22ccee1b570c4ad3a57bd7aec085b1b4 P cd75a17ab2604397adab03bb8b5fd75c [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:21:15.267436 13454 log.cc:927] Time spent T 853ac0a8cbd64ce99457f170216d4d0f P cd75a17ab2604397adab03bb8b5fd75c: Append to log took a long time: real 0.097s	user 0.000s	sys 0.000s
I20260709 13:21:15.277228 13430 leader_election.cc:290] T ce4f062dcd314d43a63ca74067cb5ee3 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:21:15.257648 13290 raft_consensus.cc:2804] T f58dc08b12a2494bb9a1372837970ca2 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:21:15.279624 13463 raft_consensus.cc:493] T 713b5728a197487c9300b310ab94e5a3 P b7ab4784c7344b939bc36f639286f377 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:21:15.243055 13316 raft_consensus.cc:2749] T 853ac0a8cbd64ce99457f170216d4d0f P ccd8a4c3bfe3413cb2ae219b09aea832 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:21:15.284936  6727 raft_consensus.cc:2468] T a1704639a875409b9959353527b3fd68 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 19.
I20260709 13:21:15.285781  7503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce4f062dcd314d43a63ca74067cb5ee3" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:21:15.289820  6803 raft_consensus.cc:2468] T 9e326172347f45e99a0d482b5d8ef768 P b7ab4784c7344b939bc36f639286f377 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 15.
I20260709 13:21:15.298259 13264 raft_consensus.cc:2749] T ab432e62819d499eaaf3dd55481dd930 P cd75a17ab2604397adab03bb8b5fd75c [term 22 FOLLOWER]: Leader election lost for term 21. Reason: Vote denied by peer b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817) with higher term. Message: Invalid argument: T ab432e62819d499eaaf3dd55481dd930 P b7ab4784c7344b939bc36f639286f377 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c for earlier term 21. Current term is 22.
I20260709 13:21:15.238569 13438 raft_consensus.cc:2764] T 7887766dc6784fcaa42b35c05fea7a99 P cd75a17ab2604397adab03bb8b5fd75c [term 22 LEADER]: Leader election decision vote started in defunct term 21: won
I20260709 13:21:15.223335 13408 raft_consensus.cc:493] T bd6869f07b5a4885a0b99fbe60c3b175 P b7ab4784c7344b939bc36f639286f377 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
W20260709 13:21:15.307793  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 48806.4us
I20260709 13:21:15.249358 13403 raft_consensus.cc:493] T 711ef6523deb4cbe8ef2ba61e1c21c98 P b7ab4784c7344b939bc36f639286f377 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:21:15.284469 12730 leader_election.cc:290] T a1704639a875409b9959353527b3fd68 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:21:15.341352  6695 leader_election.cc:400] T a1704639a875409b9959353527b3fd68 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 20 pre-election: Vote denied by peer b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817) with higher term. Message: Invalid argument: T a1704639a875409b9959353527b3fd68 P b7ab4784c7344b939bc36f639286f377 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 20. Current term is 21.
W20260709 13:21:15.322281  6846 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:21:15.359369  6695 leader_election.cc:403] T a1704639a875409b9959353527b3fd68 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 20 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:21:15.309124  6804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c44c4849aa54f2b94d1f1bef9ed546f" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:21:15.363844  6804 raft_consensus.cc:3060] T 7c44c4849aa54f2b94d1f1bef9ed546f P b7ab4784c7344b939bc36f639286f377 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:21:15.364286  6772 leader_election.cc:304] T 7ba5dac66ab5497e9e336f2a3c28cda5 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb
W20260709 13:21:15.338503  6771 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:21:15.310220  6770 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 53693.4us
I20260709 13:21:15.286728 13309 raft_consensus.cc:2804] T 4d9def8b32fd443aa94ab1420b06837b P b7ab4784c7344b939bc36f639286f377 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:21:15.306617 13290 raft_consensus.cc:493] T f58dc08b12a2494bb9a1372837970ca2 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 18 FOLLOWER]: Starting leader election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:21:15.299445 13304 raft_consensus.cc:2749] T de3186201e1a40d0b335eeb8b4e256e0 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:21:15.341169 13026 raft_consensus.cc:493] T dbdf895bba214ff68685a24fd17dfb5d P b7ab4784c7344b939bc36f639286f377 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader cd75a17ab2604397adab03bb8b5fd75c)
I20260709 13:21:15.378176  6878 raft_consensus.cc:1275] T 427c124d773f483294511e80fe340075 P cd75a17ab2604397adab03bb8b5fd75c [term 18 FOLLOWER]: Refusing update from remote peer 7ba59cc884714e8aa5f3f0ecaed84cbb: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 13:21:15.310704 13460 raft_consensus.cc:493] T 3fa34c08b205435dba97346991aa1f92 P cd75a17ab2604397adab03bb8b5fd75c [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:15.334403 13457 raft_consensus.cc:2804] T f4b8bd455d5a47c18a1380839c6e0d61 P cd75a17ab2604397adab03bb8b5fd75c [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:21:15.399326  6880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b8cacb381b746da8d0049b0a83b41dd" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:21:15.310403 13347 raft_consensus.cc:2804] T 713b5728a197487c9300b310ab94e5a3 P cd75a17ab2604397adab03bb8b5fd75c [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:21:15.354364 13295 consensus_queue.cc:1048] T 3d65025eea89441290d85dd053810e31 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.043s
I20260709 13:21:15.414309  6878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a734b5ab7834e05a8c422208acc58b1" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:21:15.422026  6878 raft_consensus.cc:2393] T 7a734b5ab7834e05a8c422208acc58b1 P cd75a17ab2604397adab03bb8b5fd75c [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in current term 20: Already voted for candidate cd75a17ab2604397adab03bb8b5fd75c in this term.
I20260709 13:21:15.417994  6803 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "90d42e216d9741e190bca19a781291fd"
dest_uuid: "b7ab4784c7344b939bc36f639286f377"
mode: GRACEFUL
new_leader_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
 from {username='slave'} at 127.0.0.1:38240
I20260709 13:21:15.422966  6803 raft_consensus.cc:606] T 90d42e216d9741e190bca19a781291fd P b7ab4784c7344b939bc36f639286f377 [term 18 LEADER]: Received request to transfer leadership to TS cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:21:15.377372 13290 raft_consensus.cc:3060] T f58dc08b12a2494bb9a1372837970ca2 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:21:15.384966 13410 raft_consensus.cc:2804] T 7ba5dac66ab5497e9e336f2a3c28cda5 P b7ab4784c7344b939bc36f639286f377 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:21:15.378418 13309 raft_consensus.cc:493] T 4d9def8b32fd443aa94ab1420b06837b P b7ab4784c7344b939bc36f639286f377 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:15.404757 13026 raft_consensus.cc:515] T dbdf895bba214ff68685a24fd17dfb5d P b7ab4784c7344b939bc36f639286f377 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:15.430140  6724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b56bf91d90824c959e21e0cee5ba1816" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:21:15.431097  6728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b8cacb381b746da8d0049b0a83b41dd" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:21:15.442184  6728 raft_consensus.cc:2468] T 4b8cacb381b746da8d0049b0a83b41dd P ccd8a4c3bfe3413cb2ae219b09aea832 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 19.
I20260709 13:21:15.432058  6723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44bde925b2e541b69890d70715b85176" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:21:15.439222  6804 raft_consensus.cc:2468] T 7c44c4849aa54f2b94d1f1bef9ed546f P b7ab4784c7344b939bc36f639286f377 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 21.
I20260709 13:21:15.370445 12730 consensus_queue.cc:1048] T de3186201e1a40d0b335eeb8b4e256e0 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.046s
I20260709 13:21:15.398051 12965 raft_consensus.cc:493] T b3f13b31a1f84f0d89d007eadd57924c P b7ab4784c7344b939bc36f639286f377 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:21:15.325747 13463 raft_consensus.cc:515] T 713b5728a197487c9300b310ab94e5a3 P b7ab4784c7344b939bc36f639286f377 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:15.447155  6879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24ee15416e3145beaa1b8183453729a3" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:21:15.404486 13457 raft_consensus.cc:493] T f4b8bd455d5a47c18a1380839c6e0d61 P cd75a17ab2604397adab03bb8b5fd75c [term 18 FOLLOWER]: Starting leader election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:21:15.447732  6726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3d8792045a4583ae2e965b1350a5b4" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 19 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:21:15.357641 13403 raft_consensus.cc:515] T 711ef6523deb4cbe8ef2ba61e1c21c98 P b7ab4784c7344b939bc36f639286f377 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
W20260709 13:21:15.452665  6770 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 86306.4us
I20260709 13:21:15.457589  6728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe20b4b48823486ca3b9c648db6ce8aa" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
W20260709 13:21:15.466925  6695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 125719us
I20260709 13:21:15.479561  6695 leader_election.cc:304] T f3f9c2e2bf644115957398fe4c9459db P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
I20260709 13:21:15.488988  6723 raft_consensus.cc:1275] T 2c240553ce044eedb41541d72b9475d7 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 18 FOLLOWER]: Refusing update from remote peer cd75a17ab2604397adab03bb8b5fd75c: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 13:21:15.416381 13450 raft_consensus.cc:3060] T a1704639a875409b9959353527b3fd68 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 19 FOLLOWER]: Advancing to term 21
I20260709 13:21:15.375304 13408 raft_consensus.cc:515] T bd6869f07b5a4885a0b99fbe60c3b175 P b7ab4784c7344b939bc36f639286f377 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:15.409160 13304 consensus_queue.cc:1048] T 30e88460611e47b2ba16a46a30b5f416 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.041s
I20260709 13:21:15.440900 13309 raft_consensus.cc:3060] T 4d9def8b32fd443aa94ab1420b06837b P b7ab4784c7344b939bc36f639286f377 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:21:15.440534 13410 raft_consensus.cc:493] T 7ba5dac66ab5497e9e336f2a3c28cda5 P b7ab4784c7344b939bc36f639286f377 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 7ba59cc884714e8aa5f3f0ecaed84cbb)
I20260709 13:21:15.495172 13216 raft_consensus.cc:493] T 1bf4668eeb70467fb3dc5a0289233b3c P b7ab4784c7344b939bc36f639286f377 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:21:15.576290 13410 raft_consensus.cc:3060] T 7ba5dac66ab5497e9e336f2a3c28cda5 P b7ab4784c7344b939bc36f639286f377 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:21:15.576393 13216 raft_consensus.cc:515] T 1bf4668eeb70467fb3dc5a0289233b3c P b7ab4784c7344b939bc36f639286f377 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:15.578733 13216 leader_election.cc:290] T 1bf4668eeb70467fb3dc5a0289233b3c P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:21:15.563961 13466 raft_consensus.cc:493] T 95a75bfe094d4bdc963aba3f08dfcd25 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 16 FOLLOWER]: Starting pre-election (detected failure of leader cd75a17ab2604397adab03bb8b5fd75c)
I20260709 13:21:15.579515 13466 raft_consensus.cc:515] T 95a75bfe094d4bdc963aba3f08dfcd25 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } attrs { replace: true } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:21:15.580772 13463 leader_election.cc:290] T 713b5728a197487c9300b310ab94e5a3 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:21:15.584537 13466 leader_election.cc:290] T 95a75bfe094d4bdc963aba3f08dfcd25 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
W20260709 13:21:15.588615 13469 log.cc:927] Time spent T 427c124d773f483294511e80fe340075 P 7ba59cc884714e8aa5f3f0ecaed84cbb: Append to log took a long time: real 0.225s	user 0.000s	sys 0.000s
I20260709 13:21:15.589129 13477 raft_consensus.cc:2804] T f3f9c2e2bf644115957398fe4c9459db P ccd8a4c3bfe3413cb2ae219b09aea832 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:21:15.589665 13477 raft_consensus.cc:493] T f3f9c2e2bf644115957398fe4c9459db P ccd8a4c3bfe3413cb2ae219b09aea832 [term 17 FOLLOWER]: Starting leader election (detected failure of leader cd75a17ab2604397adab03bb8b5fd75c)
I20260709 13:21:15.590057 13477 raft_consensus.cc:3060] T f3f9c2e2bf644115957398fe4c9459db P ccd8a4c3bfe3413cb2ae219b09aea832 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:21:15.590418 13468 raft_consensus.cc:493] T b3f13b31a1f84f0d89d007eadd57924c P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 14 FOLLOWER]: Starting pre-election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:21:15.591221 13468 raft_consensus.cc:515] T b3f13b31a1f84f0d89d007eadd57924c P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:21:15.593482 13468 leader_election.cc:290] T b3f13b31a1f84f0d89d007eadd57924c P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:21:15.595446 13403 leader_election.cc:290] T 711ef6523deb4cbe8ef2ba61e1c21c98 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:21:15.609786 13439 raft_consensus.cc:3060] T c4db81d9d329422bb3b4160ca4ac2d1d P cd75a17ab2604397adab03bb8b5fd75c [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:21:15.609490 13410 raft_consensus.cc:515] T 7ba5dac66ab5497e9e336f2a3c28cda5 P b7ab4784c7344b939bc36f639286f377 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:21:15.611862 13410 leader_election.cc:290] T 7ba5dac66ab5497e9e336f2a3c28cda5 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 20 election: Requested vote from peers cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:21:15.612588 13207 raft_consensus.cc:493] T 7887766dc6784fcaa42b35c05fea7a99 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:15.613138 13309 raft_consensus.cc:515] T 4d9def8b32fd443aa94ab1420b06837b P b7ab4784c7344b939bc36f639286f377 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:15.613679 13207 raft_consensus.cc:515] T 7887766dc6784fcaa42b35c05fea7a99 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:15.615306 13309 leader_election.cc:290] T 4d9def8b32fd443aa94ab1420b06837b P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 21 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:21:15.571321  6695 leader_election.cc:304] T 9e326172347f45e99a0d482b5d8ef768 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
W20260709 13:21:15.616276  6695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 45047.4us
I20260709 13:21:15.617027  6695 leader_election.cc:304] T 7c44c4849aa54f2b94d1f1bef9ed546f P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
I20260709 13:21:15.617287 13207 leader_election.cc:290] T 7887766dc6784fcaa42b35c05fea7a99 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:21:15.618220 13076 raft_consensus.cc:3060] T 4275cf08e63345f993bce8664eada830 P b7ab4784c7344b939bc36f639286f377 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:21:15.618707 12863 raft_consensus.cc:2804] T 9e326172347f45e99a0d482b5d8ef768 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:21:15.619005 13477 raft_consensus.cc:515] T f3f9c2e2bf644115957398fe4c9459db P ccd8a4c3bfe3413cb2ae219b09aea832 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:15.619606 12863 raft_consensus.cc:493] T 9e326172347f45e99a0d482b5d8ef768 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:15.620175 12863 raft_consensus.cc:3060] T 9e326172347f45e99a0d482b5d8ef768 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:21:15.621544 13477 leader_election.cc:290] T f3f9c2e2bf644115957398fe4c9459db P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 18 election: Requested vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:21:15.622146 13477 raft_consensus.cc:2804] T 7c44c4849aa54f2b94d1f1bef9ed546f P ccd8a4c3bfe3413cb2ae219b09aea832 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:21:15.622915  6879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1704639a875409b9959353527b3fd68" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 22 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:21:15.624111 13477 raft_consensus.cc:697] T 7c44c4849aa54f2b94d1f1bef9ed546f P ccd8a4c3bfe3413cb2ae219b09aea832 [term 21 LEADER]: Becoming Leader. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
I20260709 13:21:15.625221 13477 consensus_queue.cc:237] T 7c44c4849aa54f2b94d1f1bef9ed546f P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 19.13, Last appended by leader: 13, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:15.448700 13467 raft_consensus.cc:493] T 3d65025eea89441290d85dd053810e31 P cd75a17ab2604397adab03bb8b5fd75c [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:15.449177 13316 raft_consensus.cc:493] T d8292e16e5654be6bc408560cf256aaa P ccd8a4c3bfe3413cb2ae219b09aea832 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:15.484483 13457 raft_consensus.cc:3060] T f4b8bd455d5a47c18a1380839c6e0d61 P cd75a17ab2604397adab03bb8b5fd75c [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:21:15.573321  6804 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9e326172347f45e99a0d482b5d8ef768"
dest_uuid: "b7ab4784c7344b939bc36f639286f377"
mode: GRACEFUL
new_leader_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
 from {username='slave'} at 127.0.0.1:38240
I20260709 13:21:15.646446  6804 raft_consensus.cc:606] T 9e326172347f45e99a0d482b5d8ef768 P b7ab4784c7344b939bc36f639286f377 [term 15 FOLLOWER]: Received request to transfer leadership to TS cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:21:15.646916  6804 raft_consensus.cc:614] T 9e326172347f45e99a0d482b5d8ef768 P b7ab4784c7344b939bc36f639286f377 [term 15 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:21:15.466815 13233 consensus_queue.cc:1048] T 427c124d773f483294511e80fe340075 P 7ba59cc884714e8aa5f3f0ecaed84cbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.163s
W20260709 13:21:15.634985  6697 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 387509us
I20260709 13:21:15.403754 13460 raft_consensus.cc:515] T 3fa34c08b205435dba97346991aa1f92 P cd75a17ab2604397adab03bb8b5fd75c [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:21:15.662230 13460 leader_election.cc:290] T 3fa34c08b205435dba97346991aa1f92 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:21:15.664855 13026 leader_election.cc:290] T dbdf895bba214ff68685a24fd17dfb5d P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:21:15.484440 12965 raft_consensus.cc:515] T b3f13b31a1f84f0d89d007eadd57924c P b7ab4784c7344b939bc36f639286f377 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
W20260709 13:21:15.659297 13472 log.cc:927] Time spent T 713b5728a197487c9300b310ab94e5a3 P cd75a17ab2604397adab03bb8b5fd75c: Append to log took a long time: real 0.095s	user 0.000s	sys 0.000s
I20260709 13:21:15.584687 13441 raft_consensus.cc:493] T 1bf4668eeb70467fb3dc5a0289233b3c P cd75a17ab2604397adab03bb8b5fd75c [term 16 FOLLOWER]: Starting pre-election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:21:15.668912  6804 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ce4f062dcd314d43a63ca74067cb5ee3"
dest_uuid: "b7ab4784c7344b939bc36f639286f377"
mode: GRACEFUL
new_leader_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
 from {username='slave'} at 127.0.0.1:38240
I20260709 13:21:15.715960  6804 raft_consensus.cc:606] T ce4f062dcd314d43a63ca74067cb5ee3 P b7ab4784c7344b939bc36f639286f377 [term 15 LEADER]: Received request to transfer leadership to TS ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:21:15.657202  6697 leader_election.cc:304] T 20f6842e26174571996b8dea4151d4be P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377
I20260709 13:21:15.672744  6729 raft_consensus.cc:1240] T 3411566abe2d4c9bb4b2adfdd05e6f17 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 18 LEADER]: Rejecting Update request from peer cd75a17ab2604397adab03bb8b5fd75c for earlier term 17. Current term is 18. Ops: []
I20260709 13:21:15.565917 13335 consensus_queue.cc:1048] T de3186201e1a40d0b335eeb8b4e256e0 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.095s
I20260709 13:21:15.618261 13207 raft_consensus.cc:493] T c4db81d9d329422bb3b4160ca4ac2d1d P ccd8a4c3bfe3413cb2ae219b09aea832 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:21:15.683382  6847 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:21:15.718958  6697 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 61846.2us
I20260709 13:21:15.719570  6804 raft_consensus.cc:630] T ce4f062dcd314d43a63ca74067cb5ee3 P b7ab4784c7344b939bc36f639286f377 [term 15 LEADER]: Rejecting request to transfer leadership because tablet server ccd8a4c3bfe3413cb2ae219b09aea832 is not a voter in the active config
I20260709 13:21:15.725157  7503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fa34c08b205435dba97346991aa1f92" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 24 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:21:15.648733 13316 raft_consensus.cc:515] T d8292e16e5654be6bc408560cf256aaa P ccd8a4c3bfe3413cb2ae219b09aea832 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
W20260709 13:21:15.742729 13465 log.cc:927] Time spent T e31b9971c15848dea59d4d4130141d9e P b7ab4784c7344b939bc36f639286f377: Append to log took a long time: real 0.370s	user 0.001s	sys 0.000s
I20260709 13:21:15.745143 12965 leader_election.cc:290] T b3f13b31a1f84f0d89d007eadd57924c P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:21:15.752664  5625 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:21:15.754822 13347 raft_consensus.cc:493] T 713b5728a197487c9300b310ab94e5a3 P cd75a17ab2604397adab03bb8b5fd75c [term 16 FOLLOWER]: Starting leader election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:21:15.726220 13417 leader_election.cc:290] T 7a734b5ab7834e05a8c422208acc58b1 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 20 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:21:15.755466 12863 raft_consensus.cc:515] T 9e326172347f45e99a0d482b5d8ef768 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:15.762880 12863 leader_election.cc:290] T 9e326172347f45e99a0d482b5d8ef768 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 16 election: Requested vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:21:15.733160 13207 raft_consensus.cc:515] T c4db81d9d329422bb3b4160ca4ac2d1d P ccd8a4c3bfe3413cb2ae219b09aea832 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:15.771303 13207 leader_election.cc:290] T c4db81d9d329422bb3b4160ca4ac2d1d P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:21:15.723157 13026 raft_consensus.cc:493] T 853ac0a8cbd64ce99457f170216d4d0f P b7ab4784c7344b939bc36f639286f377 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader cd75a17ab2604397adab03bb8b5fd75c)
I20260709 13:21:15.772578 13026 raft_consensus.cc:515] T 853ac0a8cbd64ce99457f170216d4d0f P b7ab4784c7344b939bc36f639286f377 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:15.773168 13408 leader_election.cc:290] T bd6869f07b5a4885a0b99fbe60c3b175 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:21:15.778216 13316 leader_election.cc:290] T d8292e16e5654be6bc408560cf256aaa P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:21:15.723001 13304 raft_consensus.cc:2804] T 20f6842e26174571996b8dea4151d4be P ccd8a4c3bfe3413cb2ae219b09aea832 [term 20 FOLLOWER]: Leader pre-election won for term 21
W20260709 13:21:15.771620 13448 consensus_meta.cc:287] T 24ee15416e3145beaa1b8183453729a3 P 7ba59cc884714e8aa5f3f0ecaed84cbb: Time spent flushing consensus metadata: real 0.533s	user 0.005s	sys 0.003s
I20260709 13:21:15.755750 13347 raft_consensus.cc:3060] T 713b5728a197487c9300b310ab94e5a3 P cd75a17ab2604397adab03bb8b5fd75c [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:21:15.775714 13026 leader_election.cc:290] T 853ac0a8cbd64ce99457f170216d4d0f P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:21:15.651093 13467 raft_consensus.cc:515] T 3d65025eea89441290d85dd053810e31 P cd75a17ab2604397adab03bb8b5fd75c [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:15.796726  6878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bf4668eeb70467fb3dc5a0289233b3c" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:21:15.787971 13304 raft_consensus.cc:493] T 20f6842e26174571996b8dea4151d4be P ccd8a4c3bfe3413cb2ae219b09aea832 [term 20 FOLLOWER]: Starting leader election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:21:15.807595  6872 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53416 (request call id 3735) took 1288 ms. Trace:
I20260709 13:21:15.790289 13316 raft_consensus.cc:493] T d33d5ee8ef6f415593d8df52063161ad P ccd8a4c3bfe3413cb2ae219b09aea832 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:15.811902  6872 rpcz_store.cc:276] 0709 13:21:14.518938 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:21:14.519056 (+   118us) service_pool.cc:224] Handling call
0709 13:21:14.543449 (+ 24393us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:21:14.833698 (+290249us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:21:14.833735 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:21:14.839826 (+  6091us) log.cc:844] Serialized 26 byte log entry
0709 13:21:15.292222 (+452396us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:21:15.292267 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:21:15.302400 (+ 10133us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:21:15.807256 (+504856us) raft_consensus.cc:1685] finished
0709 13:21:15.807288 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:21:15.807506 (+   218us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1897,"raft.queue_time_us":38186,"raft.run_cpu_time_us":64,"raft.run_wall_time_us":64,"thread_start_us":506164,"threads_started":2,"wal-append.queue_time_us":491610}
W20260709 13:21:15.790664  6770 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 299214us
I20260709 13:21:15.817121  6879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a75bfe094d4bdc963aba3f08dfcd25" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:21:15.817427  6876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a734b5ab7834e05a8c422208acc58b1" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
W20260709 13:21:15.808748 13391 consensus_meta.cc:287] T 2c240553ce044eedb41541d72b9475d7 P b7ab4784c7344b939bc36f639286f377: Time spent flushing consensus metadata: real 0.886s	user 0.014s	sys 0.000s
I20260709 13:21:15.822444 13316 raft_consensus.cc:515] T d33d5ee8ef6f415593d8df52063161ad P ccd8a4c3bfe3413cb2ae219b09aea832 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:15.829138  6879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "711ef6523deb4cbe8ef2ba61e1c21c98" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:21:15.813887 13304 raft_consensus.cc:3060] T 20f6842e26174571996b8dea4151d4be P ccd8a4c3bfe3413cb2ae219b09aea832 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:21:15.829895  7498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ba5dac66ab5497e9e336f2a3c28cda5" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb"
I20260709 13:21:15.734999 13441 raft_consensus.cc:515] T 1bf4668eeb70467fb3dc5a0289233b3c P cd75a17ab2604397adab03bb8b5fd75c [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:15.782387 13430 raft_consensus.cc:2955] T 95a75bfe094d4bdc963aba3f08dfcd25 P cd75a17ab2604397adab03bb8b5fd75c [term 16 LEADER]: Committing config change with OpId 14.9: config changed from index 7 to 9, 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } attrs { replace: true } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } } }
W20260709 13:21:15.937569  6697 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 204858us
W20260709 13:21:15.835347 13361 consensus_meta.cc:287] T f09c2a98de1a4decabd0ff900dd44caa P ccd8a4c3bfe3413cb2ae219b09aea832: Time spent flushing consensus metadata: real 0.592s	user 0.006s	sys 0.003s
I20260709 13:21:15.836588 13290 raft_consensus.cc:515] T f58dc08b12a2494bb9a1372837970ca2 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:15.853826  7503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3f13b31a1f84f0d89d007eadd57924c" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:21:15.939849  7503 raft_consensus.cc:2468] T b3f13b31a1f84f0d89d007eadd57924c P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 14.
I20260709 13:21:15.856619 13393 raft_consensus.cc:493] T c4db81d9d329422bb3b4160ca4ac2d1d P b7ab4784c7344b939bc36f639286f377 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:15.867328  6876 raft_consensus.cc:2393] T 7a734b5ab7834e05a8c422208acc58b1 P cd75a17ab2604397adab03bb8b5fd75c [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in current term 20: Already voted for candidate cd75a17ab2604397adab03bb8b5fd75c in this term.
W20260709 13:21:15.925740  6695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 308779us
I20260709 13:21:15.927242  6844 leader_election.cc:304] T fe20b4b48823486ca3b9c648db6ce8aa P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:21:15.961663  6879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d9def8b32fd443aa94ab1420b06837b" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
W20260709 13:21:15.928263  6772 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 49466.1us
I20260709 13:21:15.928674  6770 leader_election.cc:304] T 404190ce4ce94cecbfcb6ea9d1dd8626 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb
I20260709 13:21:15.939276  6697 leader_election.cc:304] T be1a92657f494cac8dd227d152f50151 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: b7ab4784c7344b939bc36f639286f377
I20260709 13:21:15.964798  6800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7887766dc6784fcaa42b35c05fea7a99" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 23 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:21:15.964915  6876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbdf895bba214ff68685a24fd17dfb5d" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 18 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:21:15.965986  6800 raft_consensus.cc:2410] T 7887766dc6784fcaa42b35c05fea7a99 P b7ab4784c7344b939bc36f639286f377 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ccd8a4c3bfe3413cb2ae219b09aea832 for term 23 because replica has last-logged OpId of term: 20 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 10.
I20260709 13:21:15.968329  6807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f9c2e2bf644115957398fe4c9459db" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:21:15.969033  6807 raft_consensus.cc:3060] T f3f9c2e2bf644115957398fe4c9459db P b7ab4784c7344b939bc36f639286f377 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:21:15.970161  6802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e326172347f45e99a0d482b5d8ef768" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:21:15.970759  6802 raft_consensus.cc:3060] T 9e326172347f45e99a0d482b5d8ef768 P b7ab4784c7344b939bc36f639286f377 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:21:15.792685 13448 raft_consensus.cc:515] T 24ee15416e3145beaa1b8183453729a3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 20 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:21:15.973905  6876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ba5dac66ab5497e9e336f2a3c28cda5" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:21:15.977046  6697 leader_election.cc:304] T 427c124d773f483294511e80fe340075 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, b7ab4784c7344b939bc36f639286f377
I20260709 13:21:15.977679  6878 raft_consensus.cc:2468] T 1bf4668eeb70467fb3dc5a0289233b3c P cd75a17ab2604397adab03bb8b5fd75c [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 16.
I20260709 13:21:15.979576  6800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4db81d9d329422bb3b4160ca4ac2d1d" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:21:15.982125  6872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "713b5728a197487c9300b310ab94e5a3" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:21:15.981223  6804 raft_consensus.cc:1275] T 3411566abe2d4c9bb4b2adfdd05e6f17 P b7ab4784c7344b939bc36f639286f377 [term 18 FOLLOWER]: Refusing update from remote peer ccd8a4c3bfe3413cb2ae219b09aea832: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 13:21:15.974787  6879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6869f07b5a4885a0b99fbe60c3b175" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 21 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
W20260709 13:21:15.987421  6770 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 58830.8us
I20260709 13:21:15.991557  6804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8292e16e5654be6bc408560cf256aaa" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:21:15.923960 13391 raft_consensus.cc:515] T 2c240553ce044eedb41541d72b9475d7 P b7ab4784c7344b939bc36f639286f377 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:15.998574  6804 raft_consensus.cc:2468] T d8292e16e5654be6bc408560cf256aaa P b7ab4784c7344b939bc36f639286f377 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 18.
I20260709 13:21:16.005952  6801 raft_consensus.cc:2468] T 4275cf08e63345f993bce8664eada830 P b7ab4784c7344b939bc36f639286f377 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 18.
I20260709 13:21:15.973616 13477 raft_consensus.cc:493] T ce4f062dcd314d43a63ca74067cb5ee3 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:21:16.006865 13477 raft_consensus.cc:515] T ce4f062dcd314d43a63ca74067cb5ee3 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } attrs { replace: true } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:21:16.010339 13477 leader_election.cc:290] T ce4f062dcd314d43a63ca74067cb5ee3 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:21:16.013219  6879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "853ac0a8cbd64ce99457f170216d4d0f" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:21:15.979915 13425 raft_consensus.cc:2749] T fe20b4b48823486ca3b9c648db6ce8aa P cd75a17ab2604397adab03bb8b5fd75c [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:21:16.022166  6802 raft_consensus.cc:2468] T 9e326172347f45e99a0d482b5d8ef768 P b7ab4784c7344b939bc36f639286f377 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 16.
W20260709 13:21:15.999742 13411 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.719s	user 0.000s	sys 0.023s
I20260709 13:21:15.967216 13361 raft_consensus.cc:515] T f09c2a98de1a4decabd0ff900dd44caa P ccd8a4c3bfe3413cb2ae219b09aea832 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
W20260709 13:21:16.028527  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 101391us
I20260709 13:21:15.993919 13076 raft_consensus.cc:2804] T 404190ce4ce94cecbfcb6ea9d1dd8626 P b7ab4784c7344b939bc36f639286f377 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:21:16.041538  6807 raft_consensus.cc:2468] T f3f9c2e2bf644115957398fe4c9459db P b7ab4784c7344b939bc36f639286f377 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 18.
I20260709 13:21:15.969494 13393 raft_consensus.cc:515] T c4db81d9d329422bb3b4160ca4ac2d1d P b7ab4784c7344b939bc36f639286f377 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
W20260709 13:21:16.014493 13419 consensus_meta.cc:287] T 4b8cacb381b746da8d0049b0a83b41dd P 7ba59cc884714e8aa5f3f0ecaed84cbb: Time spent flushing consensus metadata: real 0.803s	user 0.011s	sys 0.001s
I20260709 13:21:16.039742  6770 leader_election.cc:304] T be1a92657f494cac8dd227d152f50151 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb
I20260709 13:21:16.046861  6844 leader_election.cc:304] T bb3d8792045a4583ae2e965b1350a5b4 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:21:16.012320 13242 raft_consensus.cc:493] T 9e326172347f45e99a0d482b5d8ef768 P cd75a17ab2604397adab03bb8b5fd75c [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
W20260709 13:21:16.038336 13411 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.752s	user 0.000s	sys 0.024s
I20260709 13:21:16.085347  6800 raft_consensus.cc:2468] T c4db81d9d329422bb3b4160ca4ac2d1d P b7ab4784c7344b939bc36f639286f377 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 19.
I20260709 13:21:16.041735 13076 raft_consensus.cc:493] T 404190ce4ce94cecbfcb6ea9d1dd8626 P b7ab4784c7344b939bc36f639286f377 [term 16 FOLLOWER]: Starting leader election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:21:16.044894 13477 raft_consensus.cc:2804] T be1a92657f494cac8dd227d152f50151 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:21:16.111552 13448 leader_election.cc:290] T 24ee15416e3145beaa1b8183453729a3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 20 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:21:16.112294 13494 raft_consensus.cc:2749] T 427c124d773f483294511e80fe340075 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:21:16.113041 13494 raft_consensus.cc:493] T f4b8bd455d5a47c18a1380839c6e0d61 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:21:16.113515 13494 raft_consensus.cc:515] T f4b8bd455d5a47c18a1380839c6e0d61 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:16.116752 13290 leader_election.cc:290] T f58dc08b12a2494bb9a1372837970ca2 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 19 election: Requested vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:21:16.115811 13494 leader_election.cc:290] T f4b8bd455d5a47c18a1380839c6e0d61 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:21:16.118813 13494 raft_consensus.cc:493] T 3d65025eea89441290d85dd053810e31 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:21:16.119779 13494 raft_consensus.cc:515] T 3d65025eea89441290d85dd053810e31 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:16.120452 13393 leader_election.cc:290] T c4db81d9d329422bb3b4160ca4ac2d1d P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:21:16.121928 13494 leader_election.cc:290] T 3d65025eea89441290d85dd053810e31 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
W20260709 13:21:16.125244 13434 consensus_meta.cc:287] T 4b8cacb381b746da8d0049b0a83b41dd P cd75a17ab2604397adab03bb8b5fd75c: Time spent flushing consensus metadata: real 0.866s	user 0.013s	sys 0.000s
W20260709 13:21:16.125788 13450 consensus_meta.cc:287] T a1704639a875409b9959353527b3fd68 P ccd8a4c3bfe3413cb2ae219b09aea832: Time spent flushing consensus metadata: real 0.572s	user 0.009s	sys 0.000s
I20260709 13:21:16.126274 13450 raft_consensus.cc:2749] T a1704639a875409b9959353527b3fd68 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 21 FOLLOWER]: Leader pre-election lost for term 20. Reason: Vote denied by peer b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817) with higher term. Message: Invalid argument: T a1704639a875409b9959353527b3fd68 P b7ab4784c7344b939bc36f639286f377 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 20. Current term is 21.
I20260709 13:21:16.125901 13434 raft_consensus.cc:515] T 4b8cacb381b746da8d0049b0a83b41dd P cd75a17ab2604397adab03bb8b5fd75c [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:21:16.099481 13477 raft_consensus.cc:493] T be1a92657f494cac8dd227d152f50151 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:16.127005  6726 raft_consensus.cc:1275] T a1704639a875409b9959353527b3fd68 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 21 FOLLOWER]: Refusing update from remote peer cd75a17ab2604397adab03bb8b5fd75c: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 21 index: 13. (index mismatch)
I20260709 13:21:16.127120 13477 raft_consensus.cc:3060] T be1a92657f494cac8dd227d152f50151 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:21:16.127990  6880 raft_consensus.cc:2393] T 4b8cacb381b746da8d0049b0a83b41dd P cd75a17ab2604397adab03bb8b5fd75c [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in current term 20: Already voted for candidate cd75a17ab2604397adab03bb8b5fd75c in this term.
I20260709 13:21:16.129441 13457 raft_consensus.cc:515] T f4b8bd455d5a47c18a1380839c6e0d61 P cd75a17ab2604397adab03bb8b5fd75c [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:16.087364 13309 raft_consensus.cc:2804] T be1a92657f494cac8dd227d152f50151 P b7ab4784c7344b939bc36f639286f377 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:21:16.132815 13309 raft_consensus.cc:697] T be1a92657f494cac8dd227d152f50151 P b7ab4784c7344b939bc36f639286f377 [term 21 LEADER]: Becoming Leader. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
I20260709 13:21:16.133247 13482 raft_consensus.cc:493] T 711ef6523deb4cbe8ef2ba61e1c21c98 P cd75a17ab2604397adab03bb8b5fd75c [term 21 FOLLOWER]: Starting pre-election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:21:16.087081 13467 leader_election.cc:290] T 3d65025eea89441290d85dd053810e31 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:21:16.133963 13309 consensus_queue.cc:237] T be1a92657f494cac8dd227d152f50151 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 20.15, Last appended by leader: 15, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:21:16.136770  6881 raft_consensus.cc:1240] T f4b8bd455d5a47c18a1380839c6e0d61 P cd75a17ab2604397adab03bb8b5fd75c [term 19 FOLLOWER]: Rejecting Update request from peer b7ab4784c7344b939bc36f639286f377 for earlier term 18. Current term is 19. Ops: []
I20260709 13:21:16.084308 13428 consensus_queue.cc:1048] T 2c240553ce044eedb41541d72b9475d7 P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Connected to new peer: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.060s
I20260709 13:21:16.141453 13464 raft_consensus.cc:993] T 22ccee1b570c4ad3a57bd7aec085b1b4 P b7ab4784c7344b939bc36f639286f377: : Instructing follower cd75a17ab2604397adab03bb8b5fd75c to start an election
I20260709 13:21:16.142086 13464 raft_consensus.cc:1081] T 22ccee1b570c4ad3a57bd7aec085b1b4 P b7ab4784c7344b939bc36f639286f377 [term 14 LEADER]: Signalling peer cd75a17ab2604397adab03bb8b5fd75c to start an election
W20260709 13:21:16.142477 13439 consensus_meta.cc:287] T c4db81d9d329422bb3b4160ca4ac2d1d P cd75a17ab2604397adab03bb8b5fd75c: Time spent flushing consensus metadata: real 0.532s	user 0.015s	sys 0.000s
I20260709 13:21:16.118713 13290 raft_consensus.cc:493] T f03d0dbf16864ca4bc1bb5e4c0334c0f P ccd8a4c3bfe3413cb2ae219b09aea832 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:21:16.144223 13457 leader_election.cc:290] T f4b8bd455d5a47c18a1380839c6e0d61 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 19 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:21:16.143726 13290 raft_consensus.cc:515] T f03d0dbf16864ca4bc1bb5e4c0334c0f P ccd8a4c3bfe3413cb2ae219b09aea832 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
W20260709 13:21:16.150691 13497 log.cc:927] Time spent T 8c7f33e544204fbaac4078e3e83bbf4e P b7ab4784c7344b939bc36f639286f377: Append to log took a long time: real 0.051s	user 0.000s	sys 0.002s
I20260709 13:21:16.151438 13361 leader_election.cc:290] T f09c2a98de1a4decabd0ff900dd44caa P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 20 election: Requested vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:21:16.133255 13316 leader_election.cc:290] T d33d5ee8ef6f415593d8df52063161ad P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:21:16.053172 13419 raft_consensus.cc:515] T 4b8cacb381b746da8d0049b0a83b41dd P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:21:16.152411 13434 leader_election.cc:290] T 4b8cacb381b746da8d0049b0a83b41dd P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 20 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:21:16.154459 13419 leader_election.cc:290] T 4b8cacb381b746da8d0049b0a83b41dd P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 20 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:21:16.099171 13076 raft_consensus.cc:3060] T 404190ce4ce94cecbfcb6ea9d1dd8626 P b7ab4784c7344b939bc36f639286f377 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:21:16.167933  6770 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 58503us
W20260709 13:21:16.172914 13476 log.cc:927] Time spent T 9b3759de40694069b13c0f8bd40e5709 P cd75a17ab2604397adab03bb8b5fd75c: Append to log took a long time: real 0.160s	user 0.001s	sys 0.000s
I20260709 13:21:16.174562 13273 leader_election.cc:290] T 7c44c4849aa54f2b94d1f1bef9ed546f P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 21 election: Requested vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:21:16.175151 13290 leader_election.cc:290] T f03d0dbf16864ca4bc1bb5e4c0334c0f P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:21:16.166320  6772 leader_election.cc:304] T b3f13b31a1f84f0d89d007eadd57924c P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, b7ab4784c7344b939bc36f639286f377; no voters: 
W20260709 13:21:16.179648 13202 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.810s	user 0.022s	sys 0.027s
I20260709 13:21:16.187362 12730 raft_consensus.cc:493] T 3411566abe2d4c9bb4b2adfdd05e6f17 P b7ab4784c7344b939bc36f639286f377 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:16.207005 12730 raft_consensus.cc:515] T 3411566abe2d4c9bb4b2adfdd05e6f17 P b7ab4784c7344b939bc36f639286f377 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:16.209405 12730 leader_election.cc:290] T 3411566abe2d4c9bb4b2adfdd05e6f17 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
W20260709 13:21:16.209971 13493 log.cc:927] Time spent T 7c44c4849aa54f2b94d1f1bef9ed546f P ccd8a4c3bfe3413cb2ae219b09aea832: Append to log took a long time: real 0.133s	user 0.000s	sys 0.001s
I20260709 13:21:16.211045 13477 raft_consensus.cc:515] T be1a92657f494cac8dd227d152f50151 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:21:16.190788 13391 leader_election.cc:290] T 2c240553ce044eedb41541d72b9475d7 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 19 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:21:16.133914 13482 raft_consensus.cc:515] T 711ef6523deb4cbe8ef2ba61e1c21c98 P cd75a17ab2604397adab03bb8b5fd75c [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:16.216102 13482 leader_election.cc:290] T 711ef6523deb4cbe8ef2ba61e1c21c98 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
W20260709 13:21:16.206353 13202 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.843s	user 0.023s	sys 0.027s
I20260709 13:21:16.205222  6770 leader_election.cc:304] T a1704639a875409b9959353527b3fd68 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: cd75a17ab2604397adab03bb8b5fd75c
W20260709 13:21:16.186800 13485 log.cc:927] Time spent T 95a75bfe094d4bdc963aba3f08dfcd25 P cd75a17ab2604397adab03bb8b5fd75c: Append to log took a long time: real 0.162s	user 0.000s	sys 0.001s
I20260709 13:21:16.083930 13242 raft_consensus.cc:515] T 9e326172347f45e99a0d482b5d8ef768 P cd75a17ab2604397adab03bb8b5fd75c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:16.248643  6695 leader_election.cc:304] T d8292e16e5654be6bc408560cf256aaa P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
I20260709 13:21:16.248862 13273 consensus_queue.cc:1048] T 3411566abe2d4c9bb4b2adfdd05e6f17 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:21:16.279831  6695 leader_election.cc:304] T 9e326172347f45e99a0d482b5d8ef768 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
I20260709 13:21:16.273401 13304 raft_consensus.cc:515] T 20f6842e26174571996b8dea4151d4be P ccd8a4c3bfe3413cb2ae219b09aea832 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:16.184821 13026 raft_consensus.cc:2804] T b3f13b31a1f84f0d89d007eadd57924c P b7ab4784c7344b939bc36f639286f377 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:21:16.281435  6695 leader_election.cc:304] T f3f9c2e2bf644115957398fe4c9459db P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
I20260709 13:21:16.172237 13347 raft_consensus.cc:515] T 713b5728a197487c9300b310ab94e5a3 P cd75a17ab2604397adab03bb8b5fd75c [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:16.217221 13441 leader_election.cc:290] T 1bf4668eeb70467fb3dc5a0289233b3c P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:21:16.286203  6798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce4f062dcd314d43a63ca74067cb5ee3" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:21:16.291146  6798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f58dc08b12a2494bb9a1372837970ca2" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:21:16.282939 13217 raft_consensus.cc:2804] T d8292e16e5654be6bc408560cf256aaa P ccd8a4c3bfe3413cb2ae219b09aea832 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:21:16.290462 13488 raft_consensus.cc:2804] T f3f9c2e2bf644115957398fe4c9459db P ccd8a4c3bfe3413cb2ae219b09aea832 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:21:16.337960 13488 raft_consensus.cc:697] T f3f9c2e2bf644115957398fe4c9459db P ccd8a4c3bfe3413cb2ae219b09aea832 [term 18 LEADER]: Becoming Leader. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
I20260709 13:21:16.341981  6807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4b8bd455d5a47c18a1380839c6e0d61" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:21:16.284511 13202 raft_consensus.cc:2804] T 9e326172347f45e99a0d482b5d8ef768 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:21:16.313248  6802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d65025eea89441290d85dd053810e31" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
W20260709 13:21:16.302385  6772 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 84379.9us
I20260709 13:21:16.350353  6772 leader_election.cc:304] T 7ba5dac66ab5497e9e336f2a3c28cda5 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, cd75a17ab2604397adab03bb8b5fd75c
W20260709 13:21:16.359681 13501 log.cc:927] Time spent T 30e88460611e47b2ba16a46a30b5f416 P b7ab4784c7344b939bc36f639286f377: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
I20260709 13:21:16.339244 13488 consensus_queue.cc:237] T f3f9c2e2bf644115957398fe4c9459db P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:16.367187 13242 leader_election.cc:290] T 9e326172347f45e99a0d482b5d8ef768 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:21:16.283754 13026 raft_consensus.cc:493] T b3f13b31a1f84f0d89d007eadd57924c P b7ab4784c7344b939bc36f639286f377 [term 14 FOLLOWER]: Starting leader election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:21:16.372958  6803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d33d5ee8ef6f415593d8df52063161ad" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:21:16.373931  6803 raft_consensus.cc:2468] T d33d5ee8ef6f415593d8df52063161ad P b7ab4784c7344b939bc36f639286f377 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 17.
I20260709 13:21:16.396783  6803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09c2a98de1a4decabd0ff900dd44caa" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:21:16.397781  6803 raft_consensus.cc:3060] T f09c2a98de1a4decabd0ff900dd44caa P b7ab4784c7344b939bc36f639286f377 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:21:16.402591  6802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f03d0dbf16864ca4bc1bb5e4c0334c0f" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
W20260709 13:21:16.406510  6770 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 201402us
I20260709 13:21:16.344542 13217 raft_consensus.cc:493] T d8292e16e5654be6bc408560cf256aaa P ccd8a4c3bfe3413cb2ae219b09aea832 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:16.375059 13026 raft_consensus.cc:3060] T b3f13b31a1f84f0d89d007eadd57924c P b7ab4784c7344b939bc36f639286f377 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:21:16.420087  6695 leader_election.cc:304] T d33d5ee8ef6f415593d8df52063161ad P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
I20260709 13:21:16.376660 13295 raft_consensus.cc:493] T 427c124d773f483294511e80fe340075 P b7ab4784c7344b939bc36f639286f377 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 7ba59cc884714e8aa5f3f0ecaed84cbb)
I20260709 13:21:16.376403 13027 raft_consensus.cc:493] T 1528ab62b6fe4e3099d08f141afee116 P b7ab4784c7344b939bc36f639286f377 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 7ba59cc884714e8aa5f3f0ecaed84cbb)
I20260709 13:21:16.453466  6804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be1a92657f494cac8dd227d152f50151" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:21:16.392918 13202 raft_consensus.cc:697] T 9e326172347f45e99a0d482b5d8ef768 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 16 LEADER]: Becoming Leader. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
I20260709 13:21:16.448734 13450 raft_consensus.cc:2804] T d33d5ee8ef6f415593d8df52063161ad P ccd8a4c3bfe3413cb2ae219b09aea832 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:21:16.417403 13447 raft_consensus.cc:2804] T a1704639a875409b9959353527b3fd68 P b7ab4784c7344b939bc36f639286f377 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:21:16.418371 13217 raft_consensus.cc:3060] T d8292e16e5654be6bc408560cf256aaa P ccd8a4c3bfe3413cb2ae219b09aea832 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:21:16.430898 13477 leader_election.cc:290] T be1a92657f494cac8dd227d152f50151 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 22 election: Requested vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:21:16.432657 13347 leader_election.cc:290] T 713b5728a197487c9300b310ab94e5a3 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 17 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
W20260709 13:21:16.510869  6806 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.514s	user 0.029s	sys 0.037s
W20260709 13:21:16.511557  6806 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.517s	user 0.029s	sys 0.037s
W20260709 13:21:16.463408  6770 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 55812.7us
W20260709 13:21:16.464527  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 417727us
I20260709 13:21:16.461510 13450 raft_consensus.cc:493] T d33d5ee8ef6f415593d8df52063161ad P ccd8a4c3bfe3413cb2ae219b09aea832 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:16.462185 13447 raft_consensus.cc:493] T a1704639a875409b9959353527b3fd68 P b7ab4784c7344b939bc36f639286f377 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:21:16.522329  6697 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.544s	user 0.016s	sys 0.027s
W20260709 13:21:16.522827  6697 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.545s	user 0.016s	sys 0.027s
W20260709 13:21:16.529031  6772 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 178787us
W20260709 13:21:16.523650  6697 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.68:45071, user_credentials={real_user=slave}} blocked reactor thread for 546705us
I20260709 13:21:16.457620 13027 raft_consensus.cc:515] T 1528ab62b6fe4e3099d08f141afee116 P b7ab4784c7344b939bc36f639286f377 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
W20260709 13:21:16.568574  6695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 58321us
I20260709 13:21:16.457293 13295 raft_consensus.cc:515] T 427c124d773f483294511e80fe340075 P b7ab4784c7344b939bc36f639286f377 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } attrs { replace: true } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:21:16.526531 13447 raft_consensus.cc:3060] T a1704639a875409b9959353527b3fd68 P b7ab4784c7344b939bc36f639286f377 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:21:16.522578 13450 raft_consensus.cc:3060] T d33d5ee8ef6f415593d8df52063161ad P ccd8a4c3bfe3413cb2ae219b09aea832 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:21:16.575076  6697 leader_election.cc:304] T 7a734b5ab7834e05a8c422208acc58b1 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:21:16.587199  6723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bf4668eeb70467fb3dc5a0289233b3c" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:21:16.587633  6728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "713b5728a197487c9300b310ab94e5a3" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:21:16.587212  6729 raft_consensus.cc:1240] T f58dc08b12a2494bb9a1372837970ca2 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 19 FOLLOWER]: Rejecting Update request from peer b7ab4784c7344b939bc36f639286f377 for earlier term 18. Current term is 19. Ops: []
I20260709 13:21:16.573603 13227 raft_consensus.cc:2749] T 7ba5dac66ab5497e9e336f2a3c28cda5 P b7ab4784c7344b939bc36f639286f377 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:21:16.492909  6803 raft_consensus.cc:2468] T f09c2a98de1a4decabd0ff900dd44caa P b7ab4784c7344b939bc36f639286f377 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 20.
I20260709 13:21:16.594903  6729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "711ef6523deb4cbe8ef2ba61e1c21c98" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:21:16.572703 13411 raft_consensus.cc:493] T 17587d6730594da4a56fa13a353232a1 P b7ab4784c7344b939bc36f639286f377 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 7ba59cc884714e8aa5f3f0ecaed84cbb)
I20260709 13:21:16.603672  6729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d9def8b32fd443aa94ab1420b06837b" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:21:16.605525  6729 raft_consensus.cc:3060] T 4d9def8b32fd443aa94ab1420b06837b P ccd8a4c3bfe3413cb2ae219b09aea832 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:21:16.566289 13459 consensus_queue.cc:1059] T 3411566abe2d4c9bb4b2adfdd05e6f17 P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: INVALID_TERM, Last received: 17.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.023s
W20260709 13:21:16.604872  6696 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.606s	user 0.021s	sys 0.038s
W20260709 13:21:16.628163  6696 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.629s	user 0.021s	sys 0.038s
I20260709 13:21:16.578226 13290 raft_consensus.cc:493] T 3fa34c08b205435dba97346991aa1f92 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 7ba59cc884714e8aa5f3f0ecaed84cbb)
I20260709 13:21:16.648694  5625 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:21:16.585230 13273 raft_consensus.cc:493] T 7c37d41cd9164c15a6826ca62a851a69 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:21:16.584436 13499 raft_consensus.cc:493] T 22ccee1b570c4ad3a57bd7aec085b1b4 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:21:16.600801 13361 raft_consensus.cc:3060] T 7a734b5ab7834e05a8c422208acc58b1 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:21:16.665396  6723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbdf895bba214ff68685a24fd17dfb5d" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 18 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:21:16.593484 13502 raft_consensus.cc:493] T 1528ab62b6fe4e3099d08f141afee116 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 7ba59cc884714e8aa5f3f0ecaed84cbb)
I20260709 13:21:16.593071 13478 raft_consensus.cc:493] T bb3d8792045a4583ae2e965b1350a5b4 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 7ba59cc884714e8aa5f3f0ecaed84cbb)
I20260709 13:21:16.666855  6723 raft_consensus.cc:2468] T dbdf895bba214ff68685a24fd17dfb5d P ccd8a4c3bfe3413cb2ae219b09aea832 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 17.
W20260709 13:21:16.641448 13430 consensus_meta.cc:287] T 95a75bfe094d4bdc963aba3f08dfcd25 P cd75a17ab2604397adab03bb8b5fd75c: Time spent flushing consensus metadata: real 0.531s	user 0.011s	sys 0.000s
I20260709 13:21:16.601365 13498 raft_consensus.cc:2749] T bb3d8792045a4583ae2e965b1350a5b4 P cd75a17ab2604397adab03bb8b5fd75c [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:21:16.691660  6729 raft_consensus.cc:2468] T 4d9def8b32fd443aa94ab1420b06837b P ccd8a4c3bfe3413cb2ae219b09aea832 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 21.
I20260709 13:21:16.650148 13304 leader_election.cc:290] T 20f6842e26174571996b8dea4151d4be P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 21 election: Requested vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:21:16.703296  7498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "427c124d773f483294511e80fe340075" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:21:16.707737  6723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3f13b31a1f84f0d89d007eadd57924c" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:21:16.707975  6727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6869f07b5a4885a0b99fbe60c3b175" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 21 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:21:16.611910 13411 raft_consensus.cc:515] T 17587d6730594da4a56fa13a353232a1 P b7ab4784c7344b939bc36f639286f377 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:21:16.710722 13411 leader_election.cc:290] T 17587d6730594da4a56fa13a353232a1 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:21:16.585673 13202 consensus_queue.cc:237] T 9e326172347f45e99a0d482b5d8ef768 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
W20260709 13:21:16.701189 13500 log.cc:927] Time spent T a3022224cc81473690653a83d4e99470 P ccd8a4c3bfe3413cb2ae219b09aea832: Append to log took a long time: real 0.128s	user 0.000s	sys 0.000s
I20260709 13:21:16.711232  7498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17587d6730594da4a56fa13a353232a1" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
W20260709 13:21:16.674705 13076 consensus_meta.cc:287] T 404190ce4ce94cecbfcb6ea9d1dd8626 P b7ab4784c7344b939bc36f639286f377: Time spent flushing consensus metadata: real 0.519s	user 0.011s	sys 0.000s
I20260709 13:21:16.712411 13076 raft_consensus.cc:515] T 404190ce4ce94cecbfcb6ea9d1dd8626 P b7ab4784c7344b939bc36f639286f377 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:21:16.715015 13076 leader_election.cc:290] T 404190ce4ce94cecbfcb6ea9d1dd8626 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 17 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:21:16.708178  6724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "853ac0a8cbd64ce99457f170216d4d0f" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:21:16.716241  6724 raft_consensus.cc:2393] T 853ac0a8cbd64ce99457f170216d4d0f P ccd8a4c3bfe3413cb2ae219b09aea832 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7ab4784c7344b939bc36f639286f377 in current term 16: Already voted for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in this term.
I20260709 13:21:16.667122 13273 raft_consensus.cc:515] T 7c37d41cd9164c15a6826ca62a851a69 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:16.719712  6724 raft_consensus.cc:1275] T 07a92dd554674067a83a9cb68c4773f2 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 17 FOLLOWER]: Refusing update from remote peer b7ab4784c7344b939bc36f639286f377: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 13:21:16.669700 13290 raft_consensus.cc:515] T 3fa34c08b205435dba97346991aa1f92 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:21:16.702193 13295 leader_election.cc:290] T 427c124d773f483294511e80fe340075 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:21:16.668674 13459 consensus_queue.cc:1243] T 3411566abe2d4c9bb4b2adfdd05e6f17 P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Peer ccd8a4c3bfe3413cb2ae219b09aea832 log is divergent from this leader: its last log entry 18.12 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 10
I20260709 13:21:16.722798  7498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "404190ce4ce94cecbfcb6ea9d1dd8626" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb"
I20260709 13:21:16.725211  6881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24ee15416e3145beaa1b8183453729a3" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:21:16.736415  7498 raft_consensus.cc:2393] T 404190ce4ce94cecbfcb6ea9d1dd8626 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate b7ab4784c7344b939bc36f639286f377 in current term 17: Already voted for candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in this term.
I20260709 13:21:16.749661  6881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b8cacb381b746da8d0049b0a83b41dd" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:21:16.719790 13273 leader_election.cc:290] T 7c37d41cd9164c15a6826ca62a851a69 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:21:16.643419 13347 raft_consensus.cc:493] T c4db81d9d329422bb3b4160ca4ac2d1d P cd75a17ab2604397adab03bb8b5fd75c [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:16.674352 13499 raft_consensus.cc:515] T 22ccee1b570c4ad3a57bd7aec085b1b4 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:16.730120 13507 raft_consensus.cc:493] T 427c124d773f483294511e80fe340075 P cd75a17ab2604397adab03bb8b5fd75c [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:16.687374 13502 raft_consensus.cc:515] T 1528ab62b6fe4e3099d08f141afee116 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:21:16.736527 13477 raft_consensus.cc:493] T 34f36d59d88f40fe8a2805e604fc6c0a P ccd8a4c3bfe3413cb2ae219b09aea832 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:21:16.804227 13477 raft_consensus.cc:515] T 34f36d59d88f40fe8a2805e604fc6c0a P ccd8a4c3bfe3413cb2ae219b09aea832 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:16.790699 13507 raft_consensus.cc:515] T 427c124d773f483294511e80fe340075 P cd75a17ab2604397adab03bb8b5fd75c [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } attrs { replace: true } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:21:16.809121 13507 leader_election.cc:290] T 427c124d773f483294511e80fe340075 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:21:16.810279 13481 raft_consensus.cc:493] T bd6869f07b5a4885a0b99fbe60c3b175 P cd75a17ab2604397adab03bb8b5fd75c [term 20 FOLLOWER]: Starting pre-election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:21:16.810834 13481 raft_consensus.cc:515] T bd6869f07b5a4885a0b99fbe60c3b175 P cd75a17ab2604397adab03bb8b5fd75c [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:16.811573 13494 raft_consensus.cc:493] T b56bf91d90824c959e21e0cee5ba1816 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:21:16.812134 13494 raft_consensus.cc:515] T b56bf91d90824c959e21e0cee5ba1816 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:16.814427 13494 leader_election.cc:290] T b56bf91d90824c959e21e0cee5ba1816 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:21:16.815492 13027 leader_election.cc:290] T 1528ab62b6fe4e3099d08f141afee116 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:21:16.816309  7498 raft_consensus.cc:2955] T 95a75bfe094d4bdc963aba3f08dfcd25 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 16 FOLLOWER]: Committing config change with OpId 14.9: config changed from index 7 to 9, 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } attrs { replace: true } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } } }
I20260709 13:21:16.817574  7494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1528ab62b6fe4e3099d08f141afee116" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:21:16.820447  7503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b8cacb381b746da8d0049b0a83b41dd" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb"
I20260709 13:21:16.821264  7503 raft_consensus.cc:2393] T 4b8cacb381b746da8d0049b0a83b41dd P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c in current term 20: Already voted for candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in this term.
I20260709 13:21:16.822350  7495 raft_consensus.cc:1240] T 24ee15416e3145beaa1b8183453729a3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 20 FOLLOWER]: Rejecting Update request from peer cd75a17ab2604397adab03bb8b5fd75c for earlier term 19. Current term is 20. Ops: []
I20260709 13:21:16.823632  6875 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58592 (request call id 577) took 1439 ms. Trace:
W20260709 13:21:16.784943 13514 log.cc:927] Time spent T 3d65025eea89441290d85dd053810e31 P b7ab4784c7344b939bc36f639286f377: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 13:21:16.789016 13273 raft_consensus.cc:493] T 3a485a995abc4807b6e511e45419f737 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:21:16.757391 13479 raft_consensus.cc:493] T 17587d6730594da4a56fa13a353232a1 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 7ba59cc884714e8aa5f3f0ecaed84cbb)
I20260709 13:21:16.797394  6724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4db81d9d329422bb3b4160ca4ac2d1d" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:21:16.797679  6727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c240553ce044eedb41541d72b9475d7" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:21:16.833328  6727 raft_consensus.cc:3060] T 2c240553ce044eedb41541d72b9475d7 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:21:16.834074 13479 raft_consensus.cc:515] T 17587d6730594da4a56fa13a353232a1 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
W20260709 13:21:16.793816 13471 log.cc:927] Time spent T 7887766dc6784fcaa42b35c05fea7a99 P cd75a17ab2604397adab03bb8b5fd75c: Append to log took a long time: real 1.424s	user 0.005s	sys 0.000s
I20260709 13:21:16.799592 13289 raft_consensus.cc:493] T be1a92657f494cac8dd227d152f50151 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:16.799865  6730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3411566abe2d4c9bb4b2adfdd05e6f17" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 19 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:21:16.801527 13264 raft_consensus.cc:493] T 07a92dd554674067a83a9cb68c4773f2 P cd75a17ab2604397adab03bb8b5fd75c [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:21:16.802227 13504 log.cc:927] Time spent T 713b5728a197487c9300b310ab94e5a3 P ccd8a4c3bfe3413cb2ae219b09aea832: Append to log took a long time: real 0.132s	user 0.001s	sys 0.000s
I20260709 13:21:16.752810 13460 raft_consensus.cc:493] T e77e330a82df4b43a745d57a68f6f057 P cd75a17ab2604397adab03bb8b5fd75c [term 19 FOLLOWER]: Starting pre-election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:21:16.686787 13478 raft_consensus.cc:515] T bb3d8792045a4583ae2e965b1350a5b4 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:21:16.748521 13304 raft_consensus.cc:493] T 07a92dd554674067a83a9cb68c4773f2 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:16.847407 13304 raft_consensus.cc:515] T 07a92dd554674067a83a9cb68c4773f2 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:16.848140 13478 leader_election.cc:290] T bb3d8792045a4583ae2e965b1350a5b4 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:21:16.849435 13304 leader_election.cc:290] T 07a92dd554674067a83a9cb68c4773f2 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:21:16.849694 13479 leader_election.cc:290] T 17587d6730594da4a56fa13a353232a1 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:21:16.824011  6875 rpcz_store.cc:276] 0709 13:21:15.383833 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:21:15.383979 (+   146us) service_pool.cc:224] Handling call
0709 13:21:15.384292 (+   313us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:21:15.404250 (+ 19958us) raft_consensus.cc:1534] Early marking committed up to index 14
0709 13:21:15.424867 (+ 20617us) log.cc:844] Serialized 14 byte log entry
0709 13:21:16.264244 (+839377us) spinlock_profiling.cc:243] Waited 928 us on lock 0x7b18002a2c20. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc15785de1 00007fcc157925b1 00007fcc0c89fe07 00007fcc156faab9 00007fcc0c8bc69b 00007fcc0c8ba93f 00007fcc0c8bcc02 00007fcc0f54420b 00007fcc0f549d23 00007fcc0f54a23a 00007fcc0f9b4a2a
0709 13:21:16.594815 (+330571us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:21:16.595339 (+   524us) log.cc:844] Serialized 26 byte log entry
0709 13:21:16.595505 (+   166us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:21:16.595538 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:21:16.595614 (+    76us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:21:16.823330 (+227716us) raft_consensus.cc:1685] finished
0709 13:21:16.823449 (+   119us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:21:16.823570 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":46863,"prepare.queue_time_us":21005,"prepare.run_cpu_time_us":66,"prepare.run_wall_time_us":4066,"raft.queue_time_us":44327,"raft.run_cpu_time_us":212,"raft.run_wall_time_us":61844,"spinlock_wait_cycles":19586688,"thread_start_us":316229,"threads_started":1,"wal-append.queue_time_us":1310743}
I20260709 13:21:16.750717 13459 raft_consensus.cc:493] T d8cee0accdb8499c86d4414b72565a38 P cd75a17ab2604397adab03bb8b5fd75c [term 19 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:21:16.833357  6724 raft_consensus.cc:2468] T c4db81d9d329422bb3b4160ca4ac2d1d P ccd8a4c3bfe3413cb2ae219b09aea832 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 19.
I20260709 13:21:16.809664 13507 raft_consensus.cc:493] T 4275cf08e63345f993bce8664eada830 P cd75a17ab2604397adab03bb8b5fd75c [term 17 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:21:16.852643 13290 leader_election.cc:290] T 3fa34c08b205435dba97346991aa1f92 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:21:16.854243 13450 raft_consensus.cc:515] T d33d5ee8ef6f415593d8df52063161ad P ccd8a4c3bfe3413cb2ae219b09aea832 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:16.851738 13507 raft_consensus.cc:515] T 4275cf08e63345f993bce8664eada830 P cd75a17ab2604397adab03bb8b5fd75c [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:16.823068  6629 catalog_manager.cc:5697] T 7a734b5ab7834e05a8c422208acc58b1 P 7ba59cc884714e8aa5f3f0ecaed84cbb reported cstate change: config changed from index -1 to 6, term changed from 15 to 19, NON_VOTER 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68) added, pending config changed, 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68) changed from NON_VOTER to VOTER. New cstate: current_term: 19 leader_uuid: "b7ab4784c7344b939bc36f639286f377" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } attrs { replace: true } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: NON_VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: true } } } pending_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } attrs { replace: true } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } } }
I20260709 13:21:16.843096 13289 raft_consensus.cc:515] T be1a92657f494cac8dd227d152f50151 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:21:16.846587 13460 raft_consensus.cc:515] T e77e330a82df4b43a745d57a68f6f057 P cd75a17ab2604397adab03bb8b5fd75c [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } }
I20260709 13:21:16.859884  6727 raft_consensus.cc:2468] T 2c240553ce044eedb41541d72b9475d7 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 19.
I20260709 13:21:16.824890 13347 raft_consensus.cc:515] T c4db81d9d329422bb3b4160ca4ac2d1d P cd75a17ab2604397adab03bb8b5fd75c [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:16.868381 13316 raft_consensus.cc:493] T e31b9971c15848dea59d4d4130141d9e P ccd8a4c3bfe3413cb2ae219b09aea832 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:21:16.836597 13273 raft_consensus.cc:515] T 3a485a995abc4807b6e511e45419f737 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:16.899564  6728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fa34c08b205435dba97346991aa1f92" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 24 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:21:16.902729  6728 raft_consensus.cc:2410] T 3fa34c08b205435dba97346991aa1f92 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c for term 24 because replica has last-logged OpId of term: 23 index: 17, which is greater than that of the candidate, which has last-logged OpId of term: 21 index: 16.
I20260709 13:21:16.905516  6804 raft_consensus.cc:1240] T f3f9c2e2bf644115957398fe4c9459db P b7ab4784c7344b939bc36f639286f377 [term 18 FOLLOWER]: Rejecting Update request from peer cd75a17ab2604397adab03bb8b5fd75c for earlier term 17. Current term is 18. Ops: []
I20260709 13:21:16.910245  6804 raft_consensus.cc:1240] T 2c240553ce044eedb41541d72b9475d7 P b7ab4784c7344b939bc36f639286f377 [term 19 FOLLOWER]: Rejecting Update request from peer cd75a17ab2604397adab03bb8b5fd75c for earlier term 18. Current term is 19. Ops: []
I20260709 13:21:16.911825  6804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44bde925b2e541b69890d70715b85176" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:21:16.914971  6804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce4f062dcd314d43a63ca74067cb5ee3" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:21:16.916810  6804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b56bf91d90824c959e21e0cee5ba1816" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:21:16.918394  6730 raft_consensus.cc:1240] T 30e88460611e47b2ba16a46a30b5f416 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 15 LEADER]: Rejecting Update request from peer cd75a17ab2604397adab03bb8b5fd75c for earlier term 14. Current term is 15. Ops: []
I20260709 13:21:16.850739 13264 raft_consensus.cc:515] T 07a92dd554674067a83a9cb68c4773f2 P cd75a17ab2604397adab03bb8b5fd75c [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:16.921487  6804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bf4668eeb70467fb3dc5a0289233b3c" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:21:16.922307  6804 raft_consensus.cc:2468] T 1bf4668eeb70467fb3dc5a0289233b3c P b7ab4784c7344b939bc36f639286f377 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 16.
I20260709 13:21:16.898813 13470 raft_consensus.cc:493] T 7887766dc6784fcaa42b35c05fea7a99 P b7ab4784c7344b939bc36f639286f377 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:16.928678  6804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4b8bd455d5a47c18a1380839c6e0d61" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:21:16.943369  6804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e326172347f45e99a0d482b5d8ef768" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:21:16.944430  6804 raft_consensus.cc:2368] T 9e326172347f45e99a0d482b5d8ef768 P b7ab4784c7344b939bc36f639286f377 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c for earlier term 15. Current term is 16.
I20260709 13:21:16.945482  6804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "711ef6523deb4cbe8ef2ba61e1c21c98" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:21:16.945642 13273 leader_election.cc:290] T 3a485a995abc4807b6e511e45419f737 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:21:16.946874  6804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "713b5728a197487c9300b310ab94e5a3" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:21:16.947474 13242 raft_consensus.cc:3055] T 3411566abe2d4c9bb4b2adfdd05e6f17 P cd75a17ab2604397adab03bb8b5fd75c [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:21:16.947973 13242 raft_consensus.cc:740] T 3411566abe2d4c9bb4b2adfdd05e6f17 P cd75a17ab2604397adab03bb8b5fd75c [term 17 LEADER]: Becoming Follower/Learner. State: Replica: cd75a17ab2604397adab03bb8b5fd75c, State: Running, Role: LEADER
I20260709 13:21:16.948434  6804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d65025eea89441290d85dd053810e31" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 21 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:21:16.948786 13242 consensus_queue.cc:260] T 3411566abe2d4c9bb4b2adfdd05e6f17 P cd75a17ab2604397adab03bb8b5fd75c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:16.950050 13242 raft_consensus.cc:3060] T 3411566abe2d4c9bb4b2adfdd05e6f17 P cd75a17ab2604397adab03bb8b5fd75c [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:21:16.951244 13447 raft_consensus.cc:515] T a1704639a875409b9959353527b3fd68 P b7ab4784c7344b939bc36f639286f377 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:16.952234 13450 leader_election.cc:290] T d33d5ee8ef6f415593d8df52063161ad P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 18 election: Requested vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:21:16.953094 13481 leader_election.cc:290] T bd6869f07b5a4885a0b99fbe60c3b175 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:21:16.939112 13507 leader_election.cc:290] T 4275cf08e63345f993bce8664eada830 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:21:16.908643 13316 raft_consensus.cc:515] T e31b9971c15848dea59d4d4130141d9e P ccd8a4c3bfe3413cb2ae219b09aea832 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:16.957213  6799 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:32976 (request call id 3782) took 1668 ms. Trace:
I20260709 13:21:16.957682 13264 leader_election.cc:290] T 07a92dd554674067a83a9cb68c4773f2 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:21:16.957835 13316 leader_election.cc:290] T e31b9971c15848dea59d4d4130141d9e P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:21:16.940632 13347 leader_election.cc:290] T c4db81d9d329422bb3b4160ca4ac2d1d P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
W20260709 13:21:16.958963 13516 log.cc:927] Time spent T 30e88460611e47b2ba16a46a30b5f416 P ccd8a4c3bfe3413cb2ae219b09aea832: Append to log took a long time: real 0.070s	user 0.000s	sys 0.000s
I20260709 13:21:16.943572 13364 leader_election.cc:290] T 9e326172347f45e99a0d482b5d8ef768 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:21:16.961753 13502 leader_election.cc:290] T 1528ab62b6fe4e3099d08f141afee116 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
W20260709 13:21:16.963515 13453 log.cc:927] Time spent T d8292e16e5654be6bc408560cf256aaa P cd75a17ab2604397adab03bb8b5fd75c: Append to log took a long time: real 1.682s	user 0.007s	sys 0.004s
I20260709 13:21:16.963898 13477 leader_election.cc:290] T 34f36d59d88f40fe8a2805e604fc6c0a P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:21:16.964159 13470 raft_consensus.cc:515] T 7887766dc6784fcaa42b35c05fea7a99 P b7ab4784c7344b939bc36f639286f377 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:16.966648 13470 leader_election.cc:290] T 7887766dc6784fcaa42b35c05fea7a99 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:21:16.869042 13459 raft_consensus.cc:515] T d8cee0accdb8499c86d4414b72565a38 P cd75a17ab2604397adab03bb8b5fd75c [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:21:16.968415 13460 leader_election.cc:290] T e77e330a82df4b43a745d57a68f6f057 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391)
I20260709 13:21:16.969504  6807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c37d41cd9164c15a6826ca62a851a69" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:21:16.969714 13459 leader_election.cc:290] T d8cee0accdb8499c86d4414b72565a38 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:21:16.939124 13289 leader_election.cc:290] T be1a92657f494cac8dd227d152f50151 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
W20260709 13:21:16.970662  6801 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:32976 (request call id 3772) took 1793 ms (client timeout 1985 ms). Trace:
I20260709 13:21:16.970898  6807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20f6842e26174571996b8dea4151d4be" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
W20260709 13:21:16.971089  6801 rpcz_store.cc:269] 0709 13:21:15.177433 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:21:15.177726 (+   293us) service_pool.cc:224] Handling call
0709 13:21:16.970455 (+1792729us) spinlock_profiling.cc:243] Waited 759 ms on lock 0x7b54002c97d4. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f9ae2fa 00007fcc1496fb17 00007fcc0deea6d4 00007fcc0deea662 00007fcc0deea591 00007fcc0deea50c 00007fcc0dee97c2 00007fcc0dce548c 00007fcc0dce48c6 00007fcc0dce426f
0709 13:21:16.970576 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1745029888}
I20260709 13:21:16.972818  6801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a75bfe094d4bdc963aba3f08dfcd25" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:21:16.973356 13217 raft_consensus.cc:515] T d8292e16e5654be6bc408560cf256aaa P ccd8a4c3bfe3413cb2ae219b09aea832 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:16.973628  6723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "404190ce4ce94cecbfcb6ea9d1dd8626" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:21:16.973985  6801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a734b5ab7834e05a8c422208acc58b1" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:21:16.975430 13217 leader_election.cc:290] T d8292e16e5654be6bc408560cf256aaa P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 19 election: Requested vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:21:16.957706  6799 rpcz_store.cc:276] 0709 13:21:15.289231 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:21:15.289435 (+   204us) service_pool.cc:224] Handling call
0709 13:21:15.296516 (+  7081us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:21:15.564473 (+267957us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:21:15.739125 (+174652us) log.cc:844] Serialized 14 byte log entry
0709 13:21:16.043537 (+304412us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:21:16.043594 (+    57us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:21:16.043728 (+   134us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:21:16.956951 (+913223us) spinlock_profiling.cc:243] Waited 268 ms on lock 0x7b54001d1ad4. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f9aae01 00007fcc0f9a983e 00007fcc1496e419 00007fcc0dee5bd4 00007fcc0dee5b62 00007fcc0dee5a91 00007fcc0dee5a0c 00007fcc0dee4cc2 00007fcc0dce548c 00007fcc0dce48c6
0709 13:21:16.957013 (+    62us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:21:16.957142 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":66007,"prepare.queue_time_us":60291,"prepare.run_cpu_time_us":42,"prepare.run_wall_time_us":43,"raft.queue_time_us":46070,"raft.run_cpu_time_us":165,"raft.run_wall_time_us":25274,"spinlock_wait_cycles":615506304,"thread_start_us":413657,"threads_started":2,"wal-append.queue_time_us":377531}
I20260709 13:21:16.983106  7495 raft_consensus.cc:1275] T be1a92657f494cac8dd227d152f50151 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 21 FOLLOWER]: Refusing update from remote peer b7ab4784c7344b939bc36f639286f377: Log matching property violated. Preceding OpId in replica: term: 19 index: 14. Preceding OpId from leader: term: 21 index: 16. (index mismatch)
I20260709 13:21:16.987350  7495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b8cacb381b746da8d0049b0a83b41dd" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:21:16.988469  7495 raft_consensus.cc:2393] T 4b8cacb381b746da8d0049b0a83b41dd P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ccd8a4c3bfe3413cb2ae219b09aea832 in current term 20: Already voted for candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in this term.
I20260709 13:21:16.987850  7503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a75bfe094d4bdc963aba3f08dfcd25" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:21:16.995517 13222 consensus_queue.cc:1048] T be1a92657f494cac8dd227d152f50151 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:21:16.996413  6880 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58592 (request call id 578) took 1584 ms. Trace:
I20260709 13:21:16.997067  6880 rpcz_store.cc:276] 0709 13:21:15.398301 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:21:15.398946 (+   645us) service_pool.cc:224] Handling call
0709 13:21:16.981941 (+1582995us) spinlock_profiling.cc:243] Waited 723 ms on lock 0x7b54000a69d4. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f9ae2fa 00007fcc1496fb17 00007fcc0deea6d4 00007fcc0deea662 00007fcc0deea591 00007fcc0deea50c 00007fcc0dee97c2 00007fcc0dce548c 00007fcc0dce48c6 00007fcc0dce426f
0709 13:21:16.982134 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1662126848}
I20260709 13:21:17.007159  7503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce4f062dcd314d43a63ca74067cb5ee3" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:21:17.023272  6804 raft_consensus.cc:1240] T a1704639a875409b9959353527b3fd68 P b7ab4784c7344b939bc36f639286f377 [term 22 FOLLOWER]: Rejecting Update request from peer cd75a17ab2604397adab03bb8b5fd75c for earlier term 21. Current term is 22. Ops: []
I20260709 13:21:17.002645  6730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b8cacb381b746da8d0049b0a83b41dd" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:21:17.027241  6730 raft_consensus.cc:3060] T 4b8cacb381b746da8d0049b0a83b41dd P ccd8a4c3bfe3413cb2ae219b09aea832 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:21:17.029523  6801 raft_consensus.cc:2468] T 7a734b5ab7834e05a8c422208acc58b1 P b7ab4784c7344b939bc36f639286f377 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in term 20.
I20260709 13:21:17.030983  6801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be1a92657f494cac8dd227d152f50151" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 22 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:21:17.032744  6801 raft_consensus.cc:1275] T d8292e16e5654be6bc408560cf256aaa P b7ab4784c7344b939bc36f639286f377 [term 18 FOLLOWER]: Refusing update from remote peer cd75a17ab2604397adab03bb8b5fd75c: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 13:21:17.033823  6801 raft_consensus.cc:1240] T 30e88460611e47b2ba16a46a30b5f416 P b7ab4784c7344b939bc36f639286f377 [term 15 FOLLOWER]: Rejecting Update request from peer cd75a17ab2604397adab03bb8b5fd75c for earlier term 14. Current term is 15. Ops: []
I20260709 13:21:17.035694  6801 raft_consensus.cc:1275] T 7887766dc6784fcaa42b35c05fea7a99 P b7ab4784c7344b939bc36f639286f377 [term 22 FOLLOWER]: Refusing update from remote peer cd75a17ab2604397adab03bb8b5fd75c: Log matching property violated. Preceding OpId in replica: term: 20 index: 11. Preceding OpId from leader: term: 22 index: 12. (index mismatch)
I20260709 13:21:17.037106  7494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be1a92657f494cac8dd227d152f50151" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb"
I20260709 13:21:17.041507  7494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3d8792045a4583ae2e965b1350a5b4" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:21:17.053855  6799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3f13b31a1f84f0d89d007eadd57924c" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:21:17.053957  6770 leader_election.cc:304] T 713b5728a197487c9300b310ab94e5a3 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:21:17.062973  6770 leader_election.cc:304] T 711ef6523deb4cbe8ef2ba61e1c21c98 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:21:17.061427 13295 consensus_queue.cc:1059] T f58dc08b12a2494bb9a1372837970ca2 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: INVALID_TERM, Last received: 18.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.003s
I20260709 13:21:17.064288 13027 raft_consensus.cc:2749] T 713b5728a197487c9300b310ab94e5a3 P b7ab4784c7344b939bc36f639286f377 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:21:17.064944 13295 raft_consensus.cc:3055] T f58dc08b12a2494bb9a1372837970ca2 P b7ab4784c7344b939bc36f639286f377 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:21:17.065445 13295 raft_consensus.cc:740] T f58dc08b12a2494bb9a1372837970ca2 P b7ab4784c7344b939bc36f639286f377 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
I20260709 13:21:17.066351 13295 consensus_queue.cc:260] T f58dc08b12a2494bb9a1372837970ca2 P b7ab4784c7344b939bc36f639286f377 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.10, Last appended by leader: 10, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:17.067668 13295 raft_consensus.cc:3060] T f58dc08b12a2494bb9a1372837970ca2 P b7ab4784c7344b939bc36f639286f377 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:21:17.071722  6800 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:32976 (request call id 3792) took 1095 ms. Trace:
I20260709 13:21:17.072175  6800 rpcz_store.cc:276] 0709 13:21:15.976251 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:21:15.979145 (+  2894us) service_pool.cc:224] Handling call
0709 13:21:17.071532 (+1092387us) spinlock_profiling.cc:243] Waited 105 ms on lock 0x7b54002da854. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f9ae2fa 00007fcc1496fb17 00007fcc0deea6d4 00007fcc0deea662 00007fcc0deea591 00007fcc0deea50c 00007fcc0dee97c2 00007fcc0dce548c 00007fcc0dce48c6 00007fcc0dce426f
0709 13:21:17.071660 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":240820096}
I20260709 13:21:17.073318  6800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b56bf91d90824c959e21e0cee5ba1816" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:21:17.074447  6800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22ccee1b570c4ad3a57bd7aec085b1b4" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:21:17.075644  6800 raft_consensus.cc:1240] T 7ba5dac66ab5497e9e336f2a3c28cda5 P b7ab4784c7344b939bc36f639286f377 [term 20 FOLLOWER]: Rejecting Update request from peer 7ba59cc884714e8aa5f3f0ecaed84cbb for earlier term 19. Current term is 20. Ops: []
I20260709 13:21:17.076655  6805 raft_consensus.cc:1240] T c4db81d9d329422bb3b4160ca4ac2d1d P b7ab4784c7344b939bc36f639286f377 [term 19 FOLLOWER]: Rejecting Update request from peer cd75a17ab2604397adab03bb8b5fd75c for earlier term 18. Current term is 19. Ops: []
I20260709 13:21:17.082230  6695 leader_election.cc:304] T f09c2a98de1a4decabd0ff900dd44caa P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
W20260709 13:21:17.083070  6847 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:21:17.083572  6847 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:21:17.086529  6805 raft_consensus.cc:1275] T 7c44c4849aa54f2b94d1f1bef9ed546f P b7ab4784c7344b939bc36f639286f377 [term 21 FOLLOWER]: Refusing update from remote peer ccd8a4c3bfe3413cb2ae219b09aea832: Log matching property violated. Preceding OpId in replica: term: 19 index: 13. Preceding OpId from leader: term: 21 index: 14. (index mismatch)
I20260709 13:21:17.087682  7494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17587d6730594da4a56fa13a353232a1" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:21:17.089740  6772 leader_election.cc:304] T 1bf4668eeb70467fb3dc5a0289233b3c P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:21:17.087833  6805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1528ab62b6fe4e3099d08f141afee116" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:21:17.092911 13460 raft_consensus.cc:493] T 7c44c4849aa54f2b94d1f1bef9ed546f P cd75a17ab2604397adab03bb8b5fd75c [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:17.099846  6732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24ee15416e3145beaa1b8183453729a3" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:21:17.108425  6732 raft_consensus.cc:3060] T 24ee15416e3145beaa1b8183453729a3 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:21:17.044394 13207 raft_consensus.cc:493] T fe20b4b48823486ca3b9c648db6ce8aa P ccd8a4c3bfe3413cb2ae219b09aea832 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 7ba59cc884714e8aa5f3f0ecaed84cbb)
I20260709 13:21:17.105432  6879 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "22ccee1b570c4ad3a57bd7aec085b1b4"
dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
 from {username='slave'} at 127.0.0.1:53406
I20260709 13:21:17.111668  6879 raft_consensus.cc:493] T 22ccee1b570c4ad3a57bd7aec085b1b4 P cd75a17ab2604397adab03bb8b5fd75c [term 14 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:21:17.112067  6879 raft_consensus.cc:3060] T 22ccee1b570c4ad3a57bd7aec085b1b4 P cd75a17ab2604397adab03bb8b5fd75c [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:21:17.106914  6881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c240553ce044eedb41541d72b9475d7" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:21:17.112687  6723 raft_consensus.cc:2468] T 404190ce4ce94cecbfcb6ea9d1dd8626 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 17.
I20260709 13:21:17.107028  7494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fa34c08b205435dba97346991aa1f92" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:21:17.113170  7500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1528ab62b6fe4e3099d08f141afee116" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:21:17.113720  6723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a75bfe094d4bdc963aba3f08dfcd25" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
W20260709 13:21:17.109210  6802 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.532s	user 0.017s	sys 0.015s
I20260709 13:21:17.108449  6875 raft_consensus.cc:1275] T 07a92dd554674067a83a9cb68c4773f2 P cd75a17ab2604397adab03bb8b5fd75c [term 17 FOLLOWER]: Refusing update from remote peer b7ab4784c7344b939bc36f639286f377: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 13:21:17.104457  6873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4db81d9d329422bb3b4160ca4ac2d1d" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
W20260709 13:21:17.119910  6802 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.605s	user 0.017s	sys 0.016s
I20260709 13:21:17.119421  6730 raft_consensus.cc:2468] T 4b8cacb381b746da8d0049b0a83b41dd P ccd8a4c3bfe3413cb2ae219b09aea832 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 20.
I20260709 13:21:17.120982  6805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a92dd554674067a83a9cb68c4773f2" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:21:17.112555  6804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34f36d59d88f40fe8a2805e604fc6c0a" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:21:17.110486 13264 raft_consensus.cc:493] T 8c7f33e544204fbaac4078e3e83bbf4e P cd75a17ab2604397adab03bb8b5fd75c [term 16 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:21:17.122293 13361 raft_consensus.cc:2749] T 7a734b5ab7834e05a8c422208acc58b1 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:21:17.139609  6800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17587d6730594da4a56fa13a353232a1" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:21:17.119467  6873 raft_consensus.cc:2468] T c4db81d9d329422bb3b4160ca4ac2d1d P cd75a17ab2604397adab03bb8b5fd75c [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 19.
I20260709 13:21:17.147303  6800 raft_consensus.cc:2468] T 17587d6730594da4a56fa13a353232a1 P b7ab4784c7344b939bc36f639286f377 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 24.
I20260709 13:21:17.150445  6697 leader_election.cc:304] T ce4f062dcd314d43a63ca74067cb5ee3 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, b7ab4784c7344b939bc36f639286f377
I20260709 13:21:17.154664  6844 leader_election.cc:304] T 3fa34c08b205435dba97346991aa1f92 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:21:17.079953 13364 raft_consensus.cc:493] T 8c7f33e544204fbaac4078e3e83bbf4e P ccd8a4c3bfe3413cb2ae219b09aea832 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:21:17.155684  6730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17587d6730594da4a56fa13a353232a1" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:21:17.172664  6730 raft_consensus.cc:2468] T 17587d6730594da4a56fa13a353232a1 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 24.
I20260709 13:21:17.157012 13458 consensus_queue.cc:1059] T 30e88460611e47b2ba16a46a30b5f416 P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 8, Time since last communication: 0.017s
I20260709 13:21:17.173766  6730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a734b5ab7834e05a8c422208acc58b1" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:21:17.174314 13458 consensus_queue.cc:1243] T 30e88460611e47b2ba16a46a30b5f416 P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Peer ccd8a4c3bfe3413cb2ae219b09aea832 log is divergent from this leader: its last log entry 15.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 13:21:17.175098  6726 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49998 (request call id 1624) took 1678 ms. Trace:
I20260709 13:21:17.175715 13458 consensus_queue.cc:1059] T 2c240553ce044eedb41541d72b9475d7 P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:21:17.175627  6726 rpcz_store.cc:276] 0709 13:21:15.497110 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:21:15.564187 (+ 67077us) service_pool.cc:224] Handling call
0709 13:21:15.579529 (+ 15342us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:21:16.127351 (+547822us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:21:17.174749 (+1047398us) spinlock_profiling.cc:243] Waited 547 ms on lock 0x7b54003b88d4. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f9aae01 00007fcc0f9a983e 00007fcc1496e419 00007fcc0dee5bd4 00007fcc0dee5b62 00007fcc0dee5a91 00007fcc0dee5a0c 00007fcc0dee4cc2 00007fcc0dce548c 00007fcc0dce48c6
0709 13:21:17.175009 (+   260us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1258288512}
I20260709 13:21:17.176767 13458 raft_consensus.cc:3055] T 2c240553ce044eedb41541d72b9475d7 P cd75a17ab2604397adab03bb8b5fd75c [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:21:17.177304 13458 raft_consensus.cc:740] T 2c240553ce044eedb41541d72b9475d7 P cd75a17ab2604397adab03bb8b5fd75c [term 18 LEADER]: Becoming Follower/Learner. State: Replica: cd75a17ab2604397adab03bb8b5fd75c, State: Running, Role: LEADER
I20260709 13:21:17.177469  6726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4b8bd455d5a47c18a1380839c6e0d61" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:21:17.178282 13458 consensus_queue.cc:260] T 2c240553ce044eedb41541d72b9475d7 P cd75a17ab2604397adab03bb8b5fd75c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.11, Last appended by leader: 11, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:17.179240  6803 raft_consensus.cc:1217] T 3411566abe2d4c9bb4b2adfdd05e6f17 P b7ab4784c7344b939bc36f639286f377 [term 18 FOLLOWER]: Deduplicated request from leader. Original: 13.9->[15.10-17.11]   Dedup: 17.11->[]
I20260709 13:21:17.179904  6803 raft_consensus.cc:1240] T 3411566abe2d4c9bb4b2adfdd05e6f17 P b7ab4784c7344b939bc36f639286f377 [term 18 FOLLOWER]: Rejecting Update request from peer cd75a17ab2604397adab03bb8b5fd75c for earlier term 17. Current term is 18. Ops: [15.10-17.11]
I20260709 13:21:17.115037 13507 raft_consensus.cc:493] T 7a734b5ab7834e05a8c422208acc58b1 P cd75a17ab2604397adab03bb8b5fd75c [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:17.179023  6726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "427c124d773f483294511e80fe340075" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:21:17.110306 13347 raft_consensus.cc:493] T f09c2a98de1a4decabd0ff900dd44caa P cd75a17ab2604397adab03bb8b5fd75c [term 18 FOLLOWER]: Starting pre-election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:21:17.190583  6803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8292e16e5654be6bc408560cf256aaa" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:21:17.191409  6803 raft_consensus.cc:3060] T d8292e16e5654be6bc408560cf256aaa P b7ab4784c7344b939bc36f639286f377 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:21:17.149077  6695 leader_election.cc:304] T 4275cf08e63345f993bce8664eada830 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
I20260709 13:21:17.185041  6804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e31b9971c15848dea59d4d4130141d9e" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:21:17.175899  6844 leader_election.cc:304] T 44bde925b2e541b69890d70715b85176 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:21:17.185040  6726 raft_consensus.cc:2468] T 427c124d773f483294511e80fe340075 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 18.
I20260709 13:21:17.179780 13458 raft_consensus.cc:3060] T 2c240553ce044eedb41541d72b9475d7 P cd75a17ab2604397adab03bb8b5fd75c [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:21:17.123749 13026 consensus_meta.cc:287] T b3f13b31a1f84f0d89d007eadd57924c P b7ab4784c7344b939bc36f639286f377: Time spent flushing consensus metadata: real 0.661s	user 0.011s	sys 0.000s
I20260709 13:21:17.143875 13316 raft_consensus.cc:2804] T f09c2a98de1a4decabd0ff900dd44caa P ccd8a4c3bfe3413cb2ae219b09aea832 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:21:17.209820  6844 leader_election.cc:304] T ce4f062dcd314d43a63ca74067cb5ee3 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, b7ab4784c7344b939bc36f639286f377
I20260709 13:21:17.157527 13425 raft_consensus.cc:2749] T 3fa34c08b205435dba97346991aa1f92 P cd75a17ab2604397adab03bb8b5fd75c [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:21:17.217032  6875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1704639a875409b9959353527b3fd68" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
W20260709 13:21:17.210421  6695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 61462.6us
I20260709 13:21:17.218384  6726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e326172347f45e99a0d482b5d8ef768" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:21:17.214447  6881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4275cf08e63345f993bce8664eada830" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:21:17.167991  6801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d33d5ee8ef6f415593d8df52063161ad" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:21:17.216104  6878 raft_consensus.cc:1275] T ab432e62819d499eaaf3dd55481dd930 P cd75a17ab2604397adab03bb8b5fd75c [term 22 FOLLOWER]: Refusing update from remote peer ccd8a4c3bfe3413cb2ae219b09aea832: Log matching property violated. Preceding OpId in replica: term: 20 index: 11. Preceding OpId from leader: term: 22 index: 12. (index mismatch)
I20260709 13:21:17.220667  6878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5be3a11b23d4ea9b08300a2789821c7" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:21:17.173224 13447 leader_election.cc:290] T a1704639a875409b9959353527b3fd68 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 22 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:21:17.217653  6724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3f13b31a1f84f0d89d007eadd57924c" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:21:17.219524  6881 raft_consensus.cc:3060] T 4275cf08e63345f993bce8664eada830 P cd75a17ab2604397adab03bb8b5fd75c [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:21:17.221331  6844 leader_election.cc:304] T b56bf91d90824c959e21e0cee5ba1816 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:21:17.221642  6878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f9c2e2bf644115957398fe4c9459db" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:21:17.234313  6878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b8cacb381b746da8d0049b0a83b41dd" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:21:17.235097  6878 raft_consensus.cc:2393] T 4b8cacb381b746da8d0049b0a83b41dd P cd75a17ab2604397adab03bb8b5fd75c [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ccd8a4c3bfe3413cb2ae219b09aea832 in current term 20: Already voted for candidate cd75a17ab2604397adab03bb8b5fd75c in this term.
I20260709 13:21:17.163403  6800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a485a995abc4807b6e511e45419f737" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:21:17.217072 13249 raft_consensus.cc:2749] T 44bde925b2e541b69890d70715b85176 P cd75a17ab2604397adab03bb8b5fd75c [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:21:17.155522 13264 raft_consensus.cc:515] T 8c7f33e544204fbaac4078e3e83bbf4e P cd75a17ab2604397adab03bb8b5fd75c [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:17.246138 13264 leader_election.cc:290] T 8c7f33e544204fbaac4078e3e83bbf4e P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:21:17.217844 13026 raft_consensus.cc:515] T b3f13b31a1f84f0d89d007eadd57924c P b7ab4784c7344b939bc36f639286f377 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:21:17.175099 13364 raft_consensus.cc:515] T 8c7f33e544204fbaac4078e3e83bbf4e P ccd8a4c3bfe3413cb2ae219b09aea832 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:17.248958 13026 leader_election.cc:290] T b3f13b31a1f84f0d89d007eadd57924c P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 15 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:21:17.249745 13364 leader_election.cc:290] T 8c7f33e544204fbaac4078e3e83bbf4e P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
W20260709 13:21:17.250181  6772 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:21:17.250633 13316 raft_consensus.cc:697] T f09c2a98de1a4decabd0ff900dd44caa P ccd8a4c3bfe3413cb2ae219b09aea832 [term 20 LEADER]: Becoming Leader. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
I20260709 13:21:17.188997 13202 raft_consensus.cc:2749] T ce4f062dcd314d43a63ca74067cb5ee3 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:21:17.281303  6875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a75bfe094d4bdc963aba3f08dfcd25" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:21:17.277647  6695 leader_election.cc:304] T c4db81d9d329422bb3b4160ca4ac2d1d P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
I20260709 13:21:17.282004  6724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1528ab62b6fe4e3099d08f141afee116" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
W20260709 13:21:17.282838  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 61590.8us
I20260709 13:21:17.210424 13459 raft_consensus.cc:493] T a3022224cc81473690653a83d4e99470 P cd75a17ab2604397adab03bb8b5fd75c [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:17.278522  6799 raft_consensus.cc:2393] T b3f13b31a1f84f0d89d007eadd57924c P b7ab4784c7344b939bc36f639286f377 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in current term 15: Already voted for candidate b7ab4784c7344b939bc36f639286f377 in this term.
I20260709 13:21:17.225495 13399 raft_consensus.cc:493] T 9b3759de40694069b13c0f8bd40e5709 P cd75a17ab2604397adab03bb8b5fd75c [term 17 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:21:17.145812  6723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bf4668eeb70467fb3dc5a0289233b3c" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:21:17.282648  6724 raft_consensus.cc:2468] T 1528ab62b6fe4e3099d08f141afee116 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 16.
I20260709 13:21:17.284449  7500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3f13b31a1f84f0d89d007eadd57924c" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb"
I20260709 13:21:17.289340  6726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "711ef6523deb4cbe8ef2ba61e1c21c98" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:21:17.115289 13460 raft_consensus.cc:515] T 7c44c4849aa54f2b94d1f1bef9ed546f P cd75a17ab2604397adab03bb8b5fd75c [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:17.125224 13207 raft_consensus.cc:515] T fe20b4b48823486ca3b9c648db6ce8aa P ccd8a4c3bfe3413cb2ae219b09aea832 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:21:17.208866 13441 raft_consensus.cc:476] T a1704639a875409b9959353527b3fd68 P cd75a17ab2604397adab03bb8b5fd75c [term 21 LEADER]: Not starting pre-election -- already a leader
I20260709 13:21:17.285626  6878 raft_consensus.cc:3055] T 30e88460611e47b2ba16a46a30b5f416 P cd75a17ab2604397adab03bb8b5fd75c [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:21:17.286617  6875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "427c124d773f483294511e80fe340075" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:21:17.170393  7466 leader_election.cc:304] T 95a75bfe094d4bdc963aba3f08dfcd25 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:21:17.277302  6732 raft_consensus.cc:2468] T 24ee15416e3145beaa1b8183453729a3 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in term 20.
I20260709 13:21:17.232668  6801 raft_consensus.cc:3060] T d33d5ee8ef6f415593d8df52063161ad P b7ab4784c7344b939bc36f639286f377 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:21:17.180930 13430 consensus_queue.cc:1059] T f3f9c2e2bf644115957398fe4c9459db P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: INVALID_TERM, Last received: 17.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.046s
I20260709 13:21:17.211912 13491 raft_consensus.cc:2804] T 4275cf08e63345f993bce8664eada830 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:21:17.290285  6724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "713b5728a197487c9300b310ab94e5a3" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:21:17.156915  6873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3411566abe2d4c9bb4b2adfdd05e6f17" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 19 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:21:17.305495  6803 raft_consensus.cc:2468] T d8292e16e5654be6bc408560cf256aaa P b7ab4784c7344b939bc36f639286f377 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 19.
I20260709 13:21:17.225782 13410 raft_consensus.cc:2804] T 1bf4668eeb70467fb3dc5a0289233b3c P b7ab4784c7344b939bc36f639286f377 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:21:17.326422  6875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4db81d9d329422bb3b4160ca4ac2d1d" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:21:17.327093  6875 raft_consensus.cc:2468] T c4db81d9d329422bb3b4160ca4ac2d1d P cd75a17ab2604397adab03bb8b5fd75c [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 19.
W20260709 13:21:17.329162  6770 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 266241us
I20260709 13:21:17.330816  6770 leader_election.cc:304] T dbdf895bba214ff68685a24fd17dfb5d P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: cd75a17ab2604397adab03bb8b5fd75c
W20260709 13:21:17.331607  6772 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.68:45071, user_credentials={real_user=slave}} blocked reactor thread for 80663us
I20260709 13:21:17.336498  6724 raft_consensus.cc:1240] T 853ac0a8cbd64ce99457f170216d4d0f P ccd8a4c3bfe3413cb2ae219b09aea832 [term 16 FOLLOWER]: Rejecting Update request from peer cd75a17ab2604397adab03bb8b5fd75c for earlier term 15. Current term is 16. Ops: []
I20260709 13:21:17.338004  6724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4db81d9d329422bb3b4160ca4ac2d1d" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
W20260709 13:21:17.340026  6731 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.539s	user 0.018s	sys 0.017s
W20260709 13:21:17.340485  6731 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.539s	user 0.018s	sys 0.017s
I20260709 13:21:17.318897  6725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be1a92657f494cac8dd227d152f50151" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 22 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:21:17.319346  6878 raft_consensus.cc:740] T 30e88460611e47b2ba16a46a30b5f416 P cd75a17ab2604397adab03bb8b5fd75c [term 14 LEADER]: Becoming Follower/Learner. State: Replica: cd75a17ab2604397adab03bb8b5fd75c, State: Running, Role: LEADER
W20260709 13:21:17.319887  7466 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 149629us
I20260709 13:21:17.320741  6732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b8cacb381b746da8d0049b0a83b41dd" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:21:17.321895  6881 raft_consensus.cc:2468] T 4275cf08e63345f993bce8664eada830 P cd75a17ab2604397adab03bb8b5fd75c [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 18.
I20260709 13:21:17.350364  6732 raft_consensus.cc:2393] T 4b8cacb381b746da8d0049b0a83b41dd P ccd8a4c3bfe3413cb2ae219b09aea832 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in current term 20: Already voted for candidate cd75a17ab2604397adab03bb8b5fd75c in this term.
I20260709 13:21:17.351861  6732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6869f07b5a4885a0b99fbe60c3b175" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 21 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:21:17.333007  6844 leader_election.cc:304] T 4b8cacb381b746da8d0049b0a83b41dd P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:21:17.209954 13347 raft_consensus.cc:515] T f09c2a98de1a4decabd0ff900dd44caa P cd75a17ab2604397adab03bb8b5fd75c [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:17.363030  6730 raft_consensus.cc:2468] T 7a734b5ab7834e05a8c422208acc58b1 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in term 20.
I20260709 13:21:17.347395  6878 consensus_queue.cc:260] T 30e88460611e47b2ba16a46a30b5f416 P cd75a17ab2604397adab03bb8b5fd75c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:17.326541  6879 raft_consensus.cc:515] T 22ccee1b570c4ad3a57bd7aec085b1b4 P cd75a17ab2604397adab03bb8b5fd75c [term 15 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:17.366153  6770 leader_election.cc:304] T 4d9def8b32fd443aa94ab1420b06837b P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: cd75a17ab2604397adab03bb8b5fd75c
W20260709 13:21:17.374202  6874 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.528s	user 0.012s	sys 0.042s
W20260709 13:21:17.397938  6874 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.552s	user 0.013s	sys 0.042s
I20260709 13:21:17.395996  6881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8292e16e5654be6bc408560cf256aaa" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:21:17.381969  6875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7887766dc6784fcaa42b35c05fea7a99" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 23 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:21:17.288452 13249 raft_consensus.cc:2749] T ce4f062dcd314d43a63ca74067cb5ee3 P cd75a17ab2604397adab03bb8b5fd75c [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:21:17.232072 13223 consensus_queue.cc:1059] T f4b8bd455d5a47c18a1380839c6e0d61 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: INVALID_TERM, Last received: 18.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.103s
I20260709 13:21:17.400151  6881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7887766dc6784fcaa42b35c05fea7a99" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 23 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:21:17.383070  6725 raft_consensus.cc:2393] T be1a92657f494cac8dd227d152f50151 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in current term 22: Already voted for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in this term.
I20260709 13:21:17.401029  6875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce4f062dcd314d43a63ca74067cb5ee3" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:21:17.210861 13507 raft_consensus.cc:515] T 7a734b5ab7834e05a8c422208acc58b1 P cd75a17ab2604397adab03bb8b5fd75c [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } attrs { replace: true } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:21:17.294703 13264 raft_consensus.cc:2749] T b56bf91d90824c959e21e0cee5ba1816 P cd75a17ab2604397adab03bb8b5fd75c [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:21:17.403899  6770 leader_election.cc:304] T bd6869f07b5a4885a0b99fbe60c3b175 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
W20260709 13:21:17.404260  7468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 502517us
I20260709 13:21:17.405411  6730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4275cf08e63345f993bce8664eada830" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:21:17.405862  6881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f58dc08b12a2494bb9a1372837970ca2" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:21:17.415486  6881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4b8bd455d5a47c18a1380839c6e0d61" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:21:17.416466  6881 raft_consensus.cc:2393] T f4b8bd455d5a47c18a1380839c6e0d61 P cd75a17ab2604397adab03bb8b5fd75c [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ccd8a4c3bfe3413cb2ae219b09aea832 in current term 19: Already voted for candidate cd75a17ab2604397adab03bb8b5fd75c in this term.
I20260709 13:21:17.417197  6881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e326172347f45e99a0d482b5d8ef768" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:21:17.417745  6881 raft_consensus.cc:3060] T 9e326172347f45e99a0d482b5d8ef768 P cd75a17ab2604397adab03bb8b5fd75c [term 14 FOLLOWER]: Advancing to term 16
I20260709 13:21:17.407285  6726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d65025eea89441290d85dd053810e31" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 21 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:21:17.293679 13217 raft_consensus.cc:2804] T c4db81d9d329422bb3b4160ca4ac2d1d P ccd8a4c3bfe3413cb2ae219b09aea832 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:21:17.429209  6879 leader_election.cc:290] T 22ccee1b570c4ad3a57bd7aec085b1b4 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 15 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:21:17.429477  6875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f9c2e2bf644115957398fe4c9459db" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:21:17.409646  6731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77e330a82df4b43a745d57a68f6f057" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:21:17.433974  6875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1704639a875409b9959353527b3fd68" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 22 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:21:17.425454  6801 raft_consensus.cc:2468] T d33d5ee8ef6f415593d8df52063161ad P b7ab4784c7344b939bc36f639286f377 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 18.
I20260709 13:21:17.362371 13447 raft_consensus.cc:2749] T 711ef6523deb4cbe8ef2ba61e1c21c98 P b7ab4784c7344b939bc36f639286f377 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:21:17.399725 13481 raft_consensus.cc:493] T 20f6842e26174571996b8dea4151d4be P cd75a17ab2604397adab03bb8b5fd75c [term 20 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:21:17.333688 13410 raft_consensus.cc:493] T 1bf4668eeb70467fb3dc5a0289233b3c P b7ab4784c7344b939bc36f639286f377 [term 16 FOLLOWER]: Starting leader election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
W20260709 13:21:17.436133  6695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 110135us
I20260709 13:21:17.436741  6770 leader_election.cc:304] T 853ac0a8cbd64ce99457f170216d4d0f P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:21:17.428649 13316 consensus_queue.cc:237] T f09c2a98de1a4decabd0ff900dd44caa P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:17.438839  6879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d65025eea89441290d85dd053810e31" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:21:17.439893 13347 leader_election.cc:290] T f09c2a98de1a4decabd0ff900dd44caa P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:21:17.410046 13425 raft_consensus.cc:2804] T 4b8cacb381b746da8d0049b0a83b41dd P cd75a17ab2604397adab03bb8b5fd75c [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:21:17.433437 13217 raft_consensus.cc:493] T c4db81d9d329422bb3b4160ca4ac2d1d P ccd8a4c3bfe3413cb2ae219b09aea832 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:17.441138 13217 raft_consensus.cc:3060] T c4db81d9d329422bb3b4160ca4ac2d1d P ccd8a4c3bfe3413cb2ae219b09aea832 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:21:17.411799 13222 raft_consensus.cc:2804] T 4d9def8b32fd443aa94ab1420b06837b P b7ab4784c7344b939bc36f639286f377 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:21:17.444479  6695 leader_election.cc:304] T 17587d6730594da4a56fa13a353232a1 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
I20260709 13:21:17.444657 13410 raft_consensus.cc:3060] T 1bf4668eeb70467fb3dc5a0289233b3c P b7ab4784c7344b939bc36f639286f377 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:21:17.447069 12863 raft_consensus.cc:2804] T 17587d6730594da4a56fa13a353232a1 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 13:21:17.447535 12863 raft_consensus.cc:493] T 17587d6730594da4a56fa13a353232a1 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 24 FOLLOWER]: Starting leader election (detected failure of leader 7ba59cc884714e8aa5f3f0ecaed84cbb)
I20260709 13:21:17.447927 12863 raft_consensus.cc:3060] T 17587d6730594da4a56fa13a353232a1 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:21:17.444532 13481 raft_consensus.cc:515] T 20f6842e26174571996b8dea4151d4be P cd75a17ab2604397adab03bb8b5fd75c [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:17.451728  6731 raft_consensus.cc:1240] T f3f9c2e2bf644115957398fe4c9459db P ccd8a4c3bfe3413cb2ae219b09aea832 [term 18 LEADER]: Rejecting Update request from peer cd75a17ab2604397adab03bb8b5fd75c for earlier term 17. Current term is 18. Ops: []
I20260709 13:21:17.438958  6725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "427c124d773f483294511e80fe340075" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 19 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:21:17.453610  6725 raft_consensus.cc:2410] T 427c124d773f483294511e80fe340075 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c for term 19 because replica has last-logged OpId of term: 18 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 11.
I20260709 13:21:17.296912 13399 raft_consensus.cc:515] T 9b3759de40694069b13c0f8bd40e5709 P cd75a17ab2604397adab03bb8b5fd75c [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:17.323356 13202 consensus_queue.cc:1048] T 7c44c4849aa54f2b94d1f1bef9ed546f P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.109s
I20260709 13:21:17.453109  6875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d33d5ee8ef6f415593d8df52063161ad" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:21:17.295393 13459 raft_consensus.cc:515] T a3022224cc81473690653a83d4e99470 P cd75a17ab2604397adab03bb8b5fd75c [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:17.408185 13491 raft_consensus.cc:697] T 4275cf08e63345f993bce8664eada830 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 18 LEADER]: Becoming Leader. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
I20260709 13:21:17.446246  6695 leader_election.cc:304] T d8292e16e5654be6bc408560cf256aaa P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
I20260709 13:21:17.457428  6731 raft_consensus.cc:1275] T 7887766dc6784fcaa42b35c05fea7a99 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 22 FOLLOWER]: Refusing update from remote peer cd75a17ab2604397adab03bb8b5fd75c: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 22 index: 12. (index mismatch)
I20260709 13:21:17.457396 13222 raft_consensus.cc:697] T 4d9def8b32fd443aa94ab1420b06837b P b7ab4784c7344b939bc36f639286f377 [term 21 LEADER]: Becoming Leader. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
I20260709 13:21:17.495695  6879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09c2a98de1a4decabd0ff900dd44caa" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:21:17.497112 13499 leader_election.cc:290] T 22ccee1b570c4ad3a57bd7aec085b1b4 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:21:17.497592 13447 raft_consensus.cc:3060] T 853ac0a8cbd64ce99457f170216d4d0f P b7ab4784c7344b939bc36f639286f377 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:21:17.499449 13425 raft_consensus.cc:697] T 4b8cacb381b746da8d0049b0a83b41dd P cd75a17ab2604397adab03bb8b5fd75c [term 20 LEADER]: Becoming Leader. State: Replica: cd75a17ab2604397adab03bb8b5fd75c, State: Running, Role: LEADER
I20260709 13:21:17.500684  6878 raft_consensus.cc:3060] T 30e88460611e47b2ba16a46a30b5f416 P cd75a17ab2604397adab03bb8b5fd75c [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:21:17.401891 13517 raft_consensus.cc:2804] T dbdf895bba214ff68685a24fd17dfb5d P b7ab4784c7344b939bc36f639286f377 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:21:17.502377 13399 leader_election.cc:290] T 9b3759de40694069b13c0f8bd40e5709 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:21:17.556005 13517 raft_consensus.cc:493] T dbdf895bba214ff68685a24fd17dfb5d P b7ab4784c7344b939bc36f639286f377 [term 17 FOLLOWER]: Starting leader election (detected failure of leader cd75a17ab2604397adab03bb8b5fd75c)
I20260709 13:21:17.458051 13420 consensus_queue.cc:1059] T 7ba5dac66ab5497e9e336f2a3c28cda5 P 7ba59cc884714e8aa5f3f0ecaed84cbb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: INVALID_TERM, Last received: 19.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.122s
I20260709 13:21:17.575999 13517 raft_consensus.cc:3060] T dbdf895bba214ff68685a24fd17dfb5d P b7ab4784c7344b939bc36f639286f377 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:21:17.532713 13527 raft_consensus.cc:476] T 7887766dc6784fcaa42b35c05fea7a99 P cd75a17ab2604397adab03bb8b5fd75c [term 22 LEADER]: Not starting pre-election -- already a leader
I20260709 13:21:17.546778  6879 raft_consensus.cc:3060] T f09c2a98de1a4decabd0ff900dd44caa P cd75a17ab2604397adab03bb8b5fd75c [term 18 FOLLOWER]: Advancing to term 20
I20260709 13:21:17.500700  6725 raft_consensus.cc:1240] T 4d9def8b32fd443aa94ab1420b06837b P ccd8a4c3bfe3413cb2ae219b09aea832 [term 21 FOLLOWER]: Rejecting Update request from peer cd75a17ab2604397adab03bb8b5fd75c for earlier term 20. Current term is 21. Ops: []
I20260709 13:21:17.436863 13430 consensus_queue.cc:1059] T 853ac0a8cbd64ce99457f170216d4d0f P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: INVALID_TERM, Last received: 15.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.146s
W20260709 13:21:17.548843 13417 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.826s	user 0.024s	sys 0.057s
I20260709 13:21:17.587117  6878 raft_consensus.cc:1275] T 30e88460611e47b2ba16a46a30b5f416 P cd75a17ab2604397adab03bb8b5fd75c [term 15 FOLLOWER]: Refusing update from remote peer ccd8a4c3bfe3413cb2ae219b09aea832: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 15 index: 8. (term mismatch)
I20260709 13:21:17.587680  6878 pending_rounds.cc:85] T 30e88460611e47b2ba16a46a30b5f416 P cd75a17ab2604397adab03bb8b5fd75c: Aborting all ops after (but not including) 7
I20260709 13:21:17.501667 13207 leader_election.cc:290] T fe20b4b48823486ca3b9c648db6ce8aa P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:21:17.552408  6727 raft_consensus.cc:1240] T 20f6842e26174571996b8dea4151d4be P ccd8a4c3bfe3413cb2ae219b09aea832 [term 21 FOLLOWER]: Rejecting Update request from peer b7ab4784c7344b939bc36f639286f377 for earlier term 20. Current term is 21. Ops: []
I20260709 13:21:17.593502  6727 raft_consensus.cc:1240] T d8292e16e5654be6bc408560cf256aaa P ccd8a4c3bfe3413cb2ae219b09aea832 [term 19 FOLLOWER]: Rejecting Update request from peer cd75a17ab2604397adab03bb8b5fd75c for earlier term 18. Current term is 19. Ops: []
I20260709 13:21:17.571659 12863 raft_consensus.cc:515] T 17587d6730594da4a56fa13a353232a1 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 25 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:21:17.553020  6881 raft_consensus.cc:2468] T 9e326172347f45e99a0d482b5d8ef768 P cd75a17ab2604397adab03bb8b5fd75c [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 16.
I20260709 13:21:17.437400 13249 consensus_queue.cc:1048] T a1704639a875409b9959353527b3fd68 P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Connected to new peer: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.140s
I20260709 13:21:17.457341 13026 raft_consensus.cc:2749] T bd6869f07b5a4885a0b99fbe60c3b175 P b7ab4784c7344b939bc36f639286f377 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:21:17.510462  6732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c7f33e544204fbaac4078e3e83bbf4e" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:21:17.503245  6726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a92dd554674067a83a9cb68c4773f2" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:21:17.588088  6878 pending_rounds.cc:107] T 30e88460611e47b2ba16a46a30b5f416 P cd75a17ab2604397adab03bb8b5fd75c: Aborting uncommitted NO_OP operation due to leader change: 14.8
W20260709 13:21:17.571998 13242 consensus_meta.cc:287] T 3411566abe2d4c9bb4b2adfdd05e6f17 P cd75a17ab2604397adab03bb8b5fd75c: Time spent flushing consensus metadata: real 0.622s	user 0.005s	sys 0.004s
I20260709 13:21:17.553103  6731 raft_consensus.cc:1240] T 2c240553ce044eedb41541d72b9475d7 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 19 FOLLOWER]: Rejecting Update request from peer cd75a17ab2604397adab03bb8b5fd75c for earlier term 18. Current term is 19. Ops: [18.11-18.11]
I20260709 13:21:17.571717 13460 leader_election.cc:290] T 7c44c4849aa54f2b94d1f1bef9ed546f P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:21:17.573630 13459 leader_election.cc:290] T a3022224cc81473690653a83d4e99470 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
W20260709 13:21:17.585330 13417 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.863s	user 0.024s	sys 0.057s
I20260709 13:21:17.609555  6881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f03d0dbf16864ca4bc1bb5e4c0334c0f" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:21:17.610191 13417 raft_consensus.cc:493] T 404190ce4ce94cecbfcb6ea9d1dd8626 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:17.610855  6881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20f6842e26174571996b8dea4151d4be" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:21:17.546619 13470 consensus_queue.cc:1048] T 07a92dd554674067a83a9cb68c4773f2 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.043s
I20260709 13:21:17.612228  6725 raft_consensus.cc:1240] T d33d5ee8ef6f415593d8df52063161ad P ccd8a4c3bfe3413cb2ae219b09aea832 [term 18 FOLLOWER]: Rejecting Update request from peer cd75a17ab2604397adab03bb8b5fd75c for earlier term 17. Current term is 18. Ops: []
I20260709 13:21:17.615207  6725 raft_consensus.cc:1240] T 24ee15416e3145beaa1b8183453729a3 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 20 FOLLOWER]: Rejecting Update request from peer cd75a17ab2604397adab03bb8b5fd75c for earlier term 19. Current term is 20. Ops: []
I20260709 13:21:17.608807 13217 raft_consensus.cc:515] T c4db81d9d329422bb3b4160ca4ac2d1d P ccd8a4c3bfe3413cb2ae219b09aea832 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:17.604619  6878 raft_consensus.cc:2889] T 30e88460611e47b2ba16a46a30b5f416 P cd75a17ab2604397adab03bb8b5fd75c [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:21:17.617247 13217 leader_election.cc:290] T c4db81d9d329422bb3b4160ca4ac2d1d P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 20 election: Requested vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:21:17.617992  6724 raft_consensus.cc:2393] T c4db81d9d329422bb3b4160ca4ac2d1d P ccd8a4c3bfe3413cb2ae219b09aea832 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c in current term 20: Already voted for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in this term.
I20260709 13:21:17.610734 13417 raft_consensus.cc:515] T 404190ce4ce94cecbfcb6ea9d1dd8626 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:21:17.613801  6881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c37d41cd9164c15a6826ca62a851a69" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
W20260709 13:21:17.614023 13533 log.cc:927] Time spent T 3d65025eea89441290d85dd053810e31 P ccd8a4c3bfe3413cb2ae219b09aea832: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 13:21:17.609019 12863 leader_election.cc:290] T 17587d6730594da4a56fa13a353232a1 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 25 election: Requested vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:21:17.596361 13527 raft_consensus.cc:3055] T 853ac0a8cbd64ce99457f170216d4d0f P cd75a17ab2604397adab03bb8b5fd75c [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:21:17.581166 13491 consensus_queue.cc:237] T 4275cf08e63345f993bce8664eada830 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 17.9, Last appended by leader: 9, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:17.620306 13527 raft_consensus.cc:740] T 853ac0a8cbd64ce99457f170216d4d0f P cd75a17ab2604397adab03bb8b5fd75c [term 15 LEADER]: Becoming Follower/Learner. State: Replica: cd75a17ab2604397adab03bb8b5fd75c, State: Running, Role: LEADER
I20260709 13:21:17.621640 13527 consensus_queue.cc:260] T 853ac0a8cbd64ce99457f170216d4d0f P cd75a17ab2604397adab03bb8b5fd75c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:17.622825 13527 raft_consensus.cc:3060] T 853ac0a8cbd64ce99457f170216d4d0f P cd75a17ab2604397adab03bb8b5fd75c [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:21:17.620251 13456 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 15 current term: 15 is higher.
I20260709 13:21:17.624116  6731 raft_consensus.cc:1240] T 17587d6730594da4a56fa13a353232a1 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 25 FOLLOWER]: Rejecting Update request from peer 7ba59cc884714e8aa5f3f0ecaed84cbb for earlier term 24. Current term is 25. Ops: []
I20260709 13:21:17.620085  6881 raft_consensus.cc:2468] T 7c37d41cd9164c15a6826ca62a851a69 P cd75a17ab2604397adab03bb8b5fd75c [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 19.
I20260709 13:21:17.625454  6873 raft_consensus.cc:2410] T 3411566abe2d4c9bb4b2adfdd05e6f17 P cd75a17ab2604397adab03bb8b5fd75c [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7ab4784c7344b939bc36f639286f377 for term 19 because replica has last-logged OpId of term: 17 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 9.
I20260709 13:21:17.604115  6726 raft_consensus.cc:2468] T 07a92dd554674067a83a9cb68c4773f2 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 17.
I20260709 13:21:17.661615  6879 raft_consensus.cc:2468] T f09c2a98de1a4decabd0ff900dd44caa P cd75a17ab2604397adab03bb8b5fd75c [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 20.
I20260709 13:21:17.669252  7500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "427c124d773f483294511e80fe340075" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 19 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:21:17.620123 13417 leader_election.cc:290] T 404190ce4ce94cecbfcb6ea9d1dd8626 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:21:17.678607  7494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8cee0accdb8499c86d4414b72565a38" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
W20260709 13:21:17.691275 13530 log.cc:927] Time spent T 9b3759de40694069b13c0f8bd40e5709 P ccd8a4c3bfe3413cb2ae219b09aea832: Append to log took a long time: real 0.058s	user 0.000s	sys 0.001s
I20260709 13:21:17.594895 13222 consensus_queue.cc:237] T 4d9def8b32fd443aa94ab1420b06837b P b7ab4784c7344b939bc36f639286f377 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 19.10, Last appended by leader: 10, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
W20260709 13:21:17.696748 13538 log.cc:927] Time spent T 95a75bfe094d4bdc963aba3f08dfcd25 P b7ab4784c7344b939bc36f639286f377: Append to log took a long time: real 0.095s	user 0.000s	sys 0.000s
I20260709 13:21:17.696414  6629 catalog_manager.cc:5697] T b3f13b31a1f84f0d89d007eadd57924c P 7ba59cc884714e8aa5f3f0ecaed84cbb reported cstate change: term changed from 13 to 14, leader changed from 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68) to ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65). New cstate: current_term: 14 leader_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } } }
I20260709 13:21:17.698089  6629 catalog_manager.cc:5697] T 7ba5dac66ab5497e9e336f2a3c28cda5 P 7ba59cc884714e8aa5f3f0ecaed84cbb reported cstate change: term changed from 17 to 19. New cstate: current_term: 19 leader_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:21:17.700477  6874 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53406 (request call id 3085) took 2493 ms. Trace:
I20260709 13:21:17.700835  6874 rpcz_store.cc:276] 0709 13:21:15.207549 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:21:15.207751 (+   202us) service_pool.cc:224] Handling call
0709 13:21:15.227377 (+ 19626us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:21:15.257994 (+ 30617us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:21:15.258019 (+    25us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:21:15.258569 (+   550us) log.cc:844] Serialized 52 byte log entry
0709 13:21:16.845800 (+1587231us) spinlock_profiling.cc:243] Waited 16.7 ms on lock 0x7b18002feea0. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc15785de1 00007fcc157925b1 00007fcc0c89fe07 00007fcc156faab9 00007fcc0c8bc69b 00007fcc0c8ba93f 00007fcc0c8bcc02 00007fcc0f54420b 00007fcc0f549d23 00007fcc0f54a0d1 00007fcc0f965a0f
0709 13:21:17.398317 (+552517us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:21:17.398358 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:21:17.398438 (+    80us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:21:17.700108 (+301670us) raft_consensus.cc:1685] finished
0709 13:21:17.700130 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:21:17.700388 (+   258us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":37018,"raft.queue_time_us":65086,"raft.run_cpu_time_us":220,"raft.run_wall_time_us":30356,"spinlock_wait_cycles":38520832,"thread_start_us":552324,"threads_started":1,"wal-append.queue_time_us":2351280}
I20260709 13:21:17.701812 13410 raft_consensus.cc:515] T 1bf4668eeb70467fb3dc5a0289233b3c P b7ab4784c7344b939bc36f639286f377 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:17.705163 13507 leader_election.cc:290] T 7a734b5ab7834e05a8c422208acc58b1 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:21:17.706421 13447 raft_consensus.cc:2749] T 853ac0a8cbd64ce99457f170216d4d0f P b7ab4784c7344b939bc36f639286f377 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:21:17.699504  6629 catalog_manager.cc:5697] T bb7fa124c3bf4ef9ab65a407cb008441 P 7ba59cc884714e8aa5f3f0ecaed84cbb reported cstate change: term changed from 14 to 18, leader changed from 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68) to b7ab4784c7344b939bc36f639286f377 (127.5.126.66). New cstate: current_term: 18 leader_uuid: "b7ab4784c7344b939bc36f639286f377" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } } }
I20260709 13:21:17.657138 13425 consensus_queue.cc:237] T 4b8cacb381b746da8d0049b0a83b41dd P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
W20260709 13:21:17.710914  6844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:21:17.738013  7494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a734b5ab7834e05a8c422208acc58b1" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
W20260709 13:21:17.742560  6844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:21:17.747928  6879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e31b9971c15848dea59d4d4130141d9e" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:21:17.742790  7494 raft_consensus.cc:2468] T 7a734b5ab7834e05a8c422208acc58b1 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 20.
I20260709 13:21:17.703994 13410 leader_election.cc:290] T 1bf4668eeb70467fb3dc5a0289233b3c P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 17 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:21:17.732860 13460 raft_consensus.cc:493] T 4f00a2e87e56452083b759f60d461ee3 P cd75a17ab2604397adab03bb8b5fd75c [term 20 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:21:17.733464 13507 raft_consensus.cc:493] T ab432e62819d499eaaf3dd55481dd930 P cd75a17ab2604397adab03bb8b5fd75c [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:17.758597  6879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fa34c08b205435dba97346991aa1f92" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
W20260709 13:21:17.758823  7468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 198766us
I20260709 13:21:17.759482  6879 raft_consensus.cc:2468] T 3fa34c08b205435dba97346991aa1f92 P cd75a17ab2604397adab03bb8b5fd75c [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 23.
W20260709 13:21:17.757145 13458 consensus_meta.cc:287] T 2c240553ce044eedb41541d72b9475d7 P cd75a17ab2604397adab03bb8b5fd75c: Time spent flushing consensus metadata: real 0.544s	user 0.005s	sys 0.007s
W20260709 13:21:17.762383  7466 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 363258us
I20260709 13:21:17.743805 13249 consensus_queue.cc:1059] T 24ee15416e3145beaa1b8183453729a3 P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false }, Status: INVALID_TERM, Last received: 19.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.027s
W20260709 13:21:17.770072  6770 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 267760us
I20260709 13:21:17.770881  6880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8292e16e5654be6bc408560cf256aaa" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:21:17.773124  6802 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:32976 (request call id 3802) took 1362 ms. Trace:
I20260709 13:21:17.774112  7466 leader_election.cc:304] T 24ee15416e3145beaa1b8183453729a3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:21:17.774900  6770 leader_election.cc:304] T 2c240553ce044eedb41541d72b9475d7 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
I20260709 13:21:17.775624  6770 leader_election.cc:304] T c4db81d9d329422bb3b4160ca4ac2d1d P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
I20260709 13:21:17.783592  6879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a485a995abc4807b6e511e45419f737" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:21:17.784085  6806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "404190ce4ce94cecbfcb6ea9d1dd8626" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:21:17.784718  6770 leader_election.cc:304] T 404190ce4ce94cecbfcb6ea9d1dd8626 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb
I20260709 13:21:17.773564  6802 rpcz_store.cc:276] 0709 13:21:16.411182 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:21:16.465222 (+ 54040us) service_pool.cc:224] Handling call
0709 13:21:16.465734 (+   512us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:21:16.466058 (+   324us) raft_consensus.cc:1534] Early marking committed up to index 12
0709 13:21:17.143920 (+677862us) log.cc:844] Serialized 14 byte log entry
0709 13:21:17.772747 (+628827us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:21:17.772809 (+    62us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:21:17.772866 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:21:17.772936 (+    70us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:21:17.773052 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":73187,"prepare.queue_time_us":65609,"prepare.run_cpu_time_us":34,"prepare.run_wall_time_us":35,"raft.queue_time_us":30720,"raft.run_cpu_time_us":149,"raft.run_wall_time_us":4298,"thread_start_us":1230667,"threads_started":3,"wal-append.queue_time_us":559342}
I20260709 13:21:17.787928  6806 raft_consensus.cc:2410] T 404190ce4ce94cecbfcb6ea9d1dd8626 P b7ab4784c7344b939bc36f639286f377 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ba59cc884714e8aa5f3f0ecaed84cbb for term 18 because replica has last-logged OpId of term: 16 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 12.
I20260709 13:21:17.790587  6770 leader_election.cc:304] T 17587d6730594da4a56fa13a353232a1 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb
I20260709 13:21:17.761386 13507 raft_consensus.cc:515] T ab432e62819d499eaaf3dd55481dd930 P cd75a17ab2604397adab03bb8b5fd75c [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:17.786964 13410 raft_consensus.cc:2804] T 2c240553ce044eedb41541d72b9475d7 P b7ab4784c7344b939bc36f639286f377 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:21:17.799710  6770 leader_election.cc:304] T 1528ab62b6fe4e3099d08f141afee116 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb
I20260709 13:21:17.794755 13470 raft_consensus.cc:2804] T 404190ce4ce94cecbfcb6ea9d1dd8626 P b7ab4784c7344b939bc36f639286f377 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:21:17.761566 13460 raft_consensus.cc:515] T 4f00a2e87e56452083b759f60d461ee3 P cd75a17ab2604397adab03bb8b5fd75c [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:21:17.790220 13521 raft_consensus.cc:2804] T c4db81d9d329422bb3b4160ca4ac2d1d P b7ab4784c7344b939bc36f639286f377 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:21:17.817701  6879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3d8792045a4583ae2e965b1350a5b4" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:21:17.824359  6879 raft_consensus.cc:2468] T bb3d8792045a4583ae2e965b1350a5b4 P cd75a17ab2604397adab03bb8b5fd75c [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 18.
W20260709 13:21:17.807920  6847 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:21:17.797580 13537 log.cc:927] Time spent T 95a75bfe094d4bdc963aba3f08dfcd25 P ccd8a4c3bfe3413cb2ae219b09aea832: Append to log took a long time: real 0.097s	user 0.001s	sys 0.000s
W20260709 13:21:17.825855  6847 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:21:17.832437  6847 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:21:17.799544 13447 raft_consensus.cc:2804] T 17587d6730594da4a56fa13a353232a1 P b7ab4784c7344b939bc36f639286f377 [term 24 FOLLOWER]: Leader pre-election won for term 25
W20260709 13:21:17.840094  7466 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 65462.2us
I20260709 13:21:17.841521  7498 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50756 (request call id 519) took 1026 ms. Trace:
I20260709 13:21:17.842178  7466 leader_election.cc:304] T 4b8cacb381b746da8d0049b0a83b41dd P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:21:17.833801 13410 raft_consensus.cc:697] T 2c240553ce044eedb41541d72b9475d7 P b7ab4784c7344b939bc36f639286f377 [term 19 LEADER]: Becoming Leader. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
I20260709 13:21:17.824152 13521 raft_consensus.cc:493] T c4db81d9d329422bb3b4160ca4ac2d1d P b7ab4784c7344b939bc36f639286f377 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:17.833731 13222 raft_consensus.cc:2804] T 1528ab62b6fe4e3099d08f141afee116 P b7ab4784c7344b939bc36f639286f377 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:21:17.841979  7498 rpcz_store.cc:276] 0709 13:21:16.814814 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:21:16.815661 (+   847us) service_pool.cc:224] Handling call
0709 13:21:16.815963 (+   302us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:21:16.816196 (+   233us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:21:16.936617 (+120421us) log.cc:844] Serialized 14 byte log entry
0709 13:21:17.789072 (+852455us) log.cc:844] Serialized 14 byte log entry
0709 13:21:17.840706 (+ 51634us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:21:17.840766 (+    60us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:21:17.841185 (+   419us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:21:17.841317 (+   132us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:21:17.841463 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":10016,"raft.queue_time_us":251149,"raft.run_cpu_time_us":80,"raft.run_wall_time_us":80,"thread_start_us":875361,"threads_started":4,"wal-append.queue_time_us":675408}
I20260709 13:21:17.847090  7466 leader_election.cc:304] T 7a734b5ab7834e05a8c422208acc58b1 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:21:17.848739  6879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b8cacb381b746da8d0049b0a83b41dd" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:21:17.835007 13417 raft_consensus.cc:2804] T 24ee15416e3145beaa1b8183453729a3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:21:17.839579 13447 raft_consensus.cc:493] T 17587d6730594da4a56fa13a353232a1 P b7ab4784c7344b939bc36f639286f377 [term 24 FOLLOWER]: Starting leader election (detected failure of leader 7ba59cc884714e8aa5f3f0ecaed84cbb)
I20260709 13:21:17.838207 13470 raft_consensus.cc:697] T 404190ce4ce94cecbfcb6ea9d1dd8626 P b7ab4784c7344b939bc36f639286f377 [term 17 LEADER]: Becoming Leader. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
I20260709 13:21:17.842345 13525 raft_consensus.cc:2749] T 95a75bfe094d4bdc963aba3f08dfcd25 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:21:17.853442  7466 leader_election.cc:304] T be1a92657f494cac8dd227d152f50151 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:21:17.853019 13517 raft_consensus.cc:515] T dbdf895bba214ff68685a24fd17dfb5d P b7ab4784c7344b939bc36f639286f377 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:17.859804 13410 consensus_queue.cc:237] T 2c240553ce044eedb41541d72b9475d7 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:17.861826 13517 leader_election.cc:290] T dbdf895bba214ff68685a24fd17dfb5d P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 18 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:21:17.853119 13447 raft_consensus.cc:3060] T 17587d6730594da4a56fa13a353232a1 P b7ab4784c7344b939bc36f639286f377 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:21:17.848565 13521 raft_consensus.cc:3060] T c4db81d9d329422bb3b4160ca4ac2d1d P b7ab4784c7344b939bc36f639286f377 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:21:17.850756 13222 raft_consensus.cc:493] T 1528ab62b6fe4e3099d08f141afee116 P b7ab4784c7344b939bc36f639286f377 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 7ba59cc884714e8aa5f3f0ecaed84cbb)
I20260709 13:21:17.871784 13447 raft_consensus.cc:515] T 17587d6730594da4a56fa13a353232a1 P b7ab4784c7344b939bc36f639286f377 [term 25 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:21:17.875763 13545 raft_consensus.cc:3055] T 24ee15416e3145beaa1b8183453729a3 P cd75a17ab2604397adab03bb8b5fd75c [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:21:17.876085 13507 leader_election.cc:290] T ab432e62819d499eaaf3dd55481dd930 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:21:17.876415 13545 raft_consensus.cc:740] T 24ee15416e3145beaa1b8183453729a3 P cd75a17ab2604397adab03bb8b5fd75c [term 19 LEADER]: Becoming Follower/Learner. State: Replica: cd75a17ab2604397adab03bb8b5fd75c, State: Running, Role: LEADER
I20260709 13:21:17.863104 13560 raft_consensus.cc:2749] T 4b8cacb381b746da8d0049b0a83b41dd P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:21:17.865348 13417 raft_consensus.cc:697] T 24ee15416e3145beaa1b8183453729a3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 20 LEADER]: Becoming Leader. State: Replica: 7ba59cc884714e8aa5f3f0ecaed84cbb, State: Running, Role: LEADER
I20260709 13:21:17.877578 13545 consensus_queue.cc:260] T 24ee15416e3145beaa1b8183453729a3 P cd75a17ab2604397adab03bb8b5fd75c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.12, Last appended by leader: 12, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:21:17.878270 13417 consensus_queue.cc:237] T 24ee15416e3145beaa1b8183453729a3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.12, Last appended by leader: 12, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:21:17.879540 13447 leader_election.cc:290] T 17587d6730594da4a56fa13a353232a1 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 25 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:21:17.881871 13460 leader_election.cc:290] T 4f00a2e87e56452083b759f60d461ee3 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:21:17.882308 13481 leader_election.cc:290] T 20f6842e26174571996b8dea4151d4be P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:21:17.878885 13545 raft_consensus.cc:3060] T 24ee15416e3145beaa1b8183453729a3 P cd75a17ab2604397adab03bb8b5fd75c [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:21:17.890396 13420 raft_consensus.cc:2804] T 7a734b5ab7834e05a8c422208acc58b1 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:21:17.896823 13420 raft_consensus.cc:697] T 7a734b5ab7834e05a8c422208acc58b1 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 20 LEADER]: Becoming Leader. State: Replica: 7ba59cc884714e8aa5f3f0ecaed84cbb, State: Running, Role: LEADER
W20260709 13:21:17.897718 13509 log.cc:927] Time spent T 3d65025eea89441290d85dd053810e31 P cd75a17ab2604397adab03bb8b5fd75c: Append to log took a long time: real 1.318s	user 0.003s	sys 0.011s
I20260709 13:21:17.897768 13420 consensus_queue.cc:237] T 7a734b5ab7834e05a8c422208acc58b1 P 7ba59cc884714e8aa5f3f0ecaed84cbb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 19.10, Last appended by leader: 10, Current term: 20, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } attrs { replace: true } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:21:17.883165 13470 consensus_queue.cc:237] T 404190ce4ce94cecbfcb6ea9d1dd8626 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
W20260709 13:21:17.905746 13549 log.cc:927] Time spent T e31b9971c15848dea59d4d4130141d9e P cd75a17ab2604397adab03bb8b5fd75c: Append to log took a long time: real 0.100s	user 0.000s	sys 0.001s
I20260709 13:21:17.906952 13546 raft_consensus.cc:3055] T 7ba5dac66ab5497e9e336f2a3c28cda5 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:21:17.907543 13546 raft_consensus.cc:740] T 7ba5dac66ab5497e9e336f2a3c28cda5 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 7ba59cc884714e8aa5f3f0ecaed84cbb, State: Running, Role: LEADER
I20260709 13:21:17.909777 13441 raft_consensus.cc:3055] T f3f9c2e2bf644115957398fe4c9459db P cd75a17ab2604397adab03bb8b5fd75c [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:21:17.910327 13441 raft_consensus.cc:740] T f3f9c2e2bf644115957398fe4c9459db P cd75a17ab2604397adab03bb8b5fd75c [term 17 LEADER]: Becoming Follower/Learner. State: Replica: cd75a17ab2604397adab03bb8b5fd75c, State: Running, Role: LEADER
W20260709 13:21:17.913723 13552 log.cc:927] Time spent T 3411566abe2d4c9bb4b2adfdd05e6f17 P ccd8a4c3bfe3413cb2ae219b09aea832: Append to log took a long time: real 0.082s	user 0.000s	sys 0.002s
I20260709 13:21:17.915125 13546 consensus_queue.cc:260] T 7ba5dac66ab5497e9e336f2a3c28cda5 P 7ba59cc884714e8aa5f3f0ecaed84cbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.14, Last appended by leader: 14, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:21:17.917243 13546 raft_consensus.cc:3060] T 7ba5dac66ab5497e9e336f2a3c28cda5 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:21:17.918073 13521 raft_consensus.cc:515] T c4db81d9d329422bb3b4160ca4ac2d1d P b7ab4784c7344b939bc36f639286f377 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:17.911561 13441 consensus_queue.cc:260] T f3f9c2e2bf644115957398fe4c9459db P cd75a17ab2604397adab03bb8b5fd75c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:17.921516 13441 raft_consensus.cc:3060] T f3f9c2e2bf644115957398fe4c9459db P cd75a17ab2604397adab03bb8b5fd75c [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:21:17.930238 13521 leader_election.cc:290] T c4db81d9d329422bb3b4160ca4ac2d1d P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 20 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:21:18.006973  6872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d33d5ee8ef6f415593d8df52063161ad" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:21:17.755821  5625 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:21:18.009713  6629 catalog_manager.cc:5697] T 95a75bfe094d4bdc963aba3f08dfcd25 P 7ba59cc884714e8aa5f3f0ecaed84cbb reported cstate change: config changed from index -1 to 7, term changed from 11 to 16, leader changed from ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65) to <none>, NON_VOTER 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68) added. New cstate: current_term: 16 committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } attrs { replace: true } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: NON_VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: true } } }
I20260709 13:21:18.014658  6876 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53406 (request call id 3106) took 2093 ms. Trace:
I20260709 13:21:18.015383  6876 rpcz_store.cc:276] 0709 13:21:15.921224 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:21:15.978767 (+ 57543us) service_pool.cc:224] Handling call
0709 13:21:15.979053 (+   286us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:21:15.992551 (+ 13498us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:21:15.994393 (+  1842us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:21:16.014822 (+ 20429us) log.cc:844] Serialized 26 byte log entry
0709 13:21:16.457569 (+442747us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:21:16.457632 (+    63us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:21:16.457723 (+    91us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:21:17.896951 (+1439228us) spinlock_profiling.cc:243] Waited 972 us on lock 0x7b4400022b4c. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0c745db1 00007fcc0c7e3c85 00007fcc0c7e46a2 00007fcc0f5561db 00007fcc0f551aaf 00007fcc0f54586e 00007fcc0f544bb6 00007fcc0f5447d8 00007fcc0f54e221 00007fcc0f54e1d9 00007fcc0f54e169
0709 13:21:18.013884 (+116933us) raft_consensus.cc:1685] finished
0709 13:21:18.013941 (+    57us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:21:18.014422 (+   481us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5488,"raft.queue_time_us":5623,"raft.run_cpu_time_us":119,"raft.run_wall_time_us":6166,"spinlock_wait_cycles":2235136,"thread_start_us":412025,"threads_started":1,"wal-append.queue_time_us":552860}
I20260709 13:21:18.023312  6876 raft_consensus.cc:1240] T 22ccee1b570c4ad3a57bd7aec085b1b4 P cd75a17ab2604397adab03bb8b5fd75c [term 15 FOLLOWER]: Rejecting Update request from peer b7ab4784c7344b939bc36f639286f377 for earlier term 14. Current term is 15. Ops: []
I20260709 13:21:18.025156  6879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e326172347f45e99a0d482b5d8ef768" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:21:18.025671  6875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c44c4849aa54f2b94d1f1bef9ed546f" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:21:18.026419  6879 raft_consensus.cc:2376] T 9e326172347f45e99a0d482b5d8ef768 P cd75a17ab2604397adab03bb8b5fd75c [term 16 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 16. Re-sending same reply.
I20260709 13:21:18.026589  6875 raft_consensus.cc:3060] T 7c44c4849aa54f2b94d1f1bef9ed546f P cd75a17ab2604397adab03bb8b5fd75c [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:21:18.033138  7498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f00a2e87e56452083b759f60d461ee3" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:21:18.033841  6877 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58592 (request call id 585) took 1308 ms. Trace:
I20260709 13:21:18.038166 13026 consensus_queue.cc:1059] T 20f6842e26174571996b8dea4151d4be P b7ab4784c7344b939bc36f639286f377 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: INVALID_TERM, Last received: 20.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:21:18.037719  6878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b56bf91d90824c959e21e0cee5ba1816" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:21:18.041102  6878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c7f33e544204fbaac4078e3e83bbf4e" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:21:18.043423  6878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22ccee1b570c4ad3a57bd7aec085b1b4" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:21:18.031800  6844 leader_election.cc:304] T 1bf4668eeb70467fb3dc5a0289233b3c P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:21:18.034382  6877 rpcz_store.cc:276] 0709 13:21:16.725135 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:21:16.726043 (+   908us) service_pool.cc:224] Handling call
0709 13:21:16.726396 (+   353us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:21:16.810458 (+ 84062us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 13:21:17.297214 (+486756us) log.cc:844] Serialized 14 byte log entry
0709 13:21:17.750193 (+452979us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:21:17.756430 (+  6237us) log.cc:844] Serialized 26 byte log entry
0709 13:21:17.756658 (+   228us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:21:17.757365 (+   707us) log.cc:844] Serialized 14 byte log entry
0709 13:21:17.757577 (+   212us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:21:17.873928 (+116351us) spinlock_profiling.cc:243] Waited 3.77 ms on lock 0x7b180040c6c0. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc15785de1 00007fcc157925b1 00007fcc0c8bd3f3 00007fcc0c8bf7c1 00007fcc0c8bf779 00007fcc0c8bf709 00007fcc0c8bf6d1 00007fcc0c8be9cd 000000000038f354 000000000038f199 00007fcc0c8a083a
0709 13:21:18.033229 (+159301us) spinlock_profiling.cc:243] Waited 83.7 ms on lock 0x7b540039add4. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f9aae01 00007fcc0f9a983e 00007fcc1496e419 00007fcc0dee5bd4 00007fcc0dee5b62 00007fcc0dee5a91 00007fcc0dee5a0c 00007fcc0dee4cc2 00007fcc0dce548c 00007fcc0dce48c6
0709 13:21:18.033314 (+    85us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:21:18.033376 (+    62us) raft_consensus.cc:1685] finished
0709 13:21:18.033388 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:21:18.033644 (+   256us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":372095,"prepare.run_cpu_time_us":66,"prepare.run_wall_time_us":68,"raft.queue_time_us":5896,"raft.run_cpu_time_us":373,"raft.run_wall_time_us":5864,"spinlock_wait_cycles":202371072,"thread_start_us":823833,"threads_started":2,"wal-append.queue_time_us":426425}
I20260709 13:21:18.023761  6874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34f36d59d88f40fe8a2805e604fc6c0a" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:21:18.066254  6878 raft_consensus.cc:2393] T 22ccee1b570c4ad3a57bd7aec085b1b4 P cd75a17ab2604397adab03bb8b5fd75c [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ccd8a4c3bfe3413cb2ae219b09aea832 in current term 15: Already voted for candidate cd75a17ab2604397adab03bb8b5fd75c in this term.
W20260709 13:21:18.058861  6845 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:21:18.065671  6879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe20b4b48823486ca3b9c648db6ce8aa" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:21:17.883504 13222 raft_consensus.cc:3060] T 1528ab62b6fe4e3099d08f141afee116 P b7ab4784c7344b939bc36f639286f377 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:21:18.090034 13347 raft_consensus.cc:493] T 90d42e216d9741e190bca19a781291fd P cd75a17ab2604397adab03bb8b5fd75c [term 18 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:21:18.092494 13264 raft_consensus.cc:493] T 34f36d59d88f40fe8a2805e604fc6c0a P cd75a17ab2604397adab03bb8b5fd75c [term 16 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:21:18.093487 13264 raft_consensus.cc:515] T 34f36d59d88f40fe8a2805e604fc6c0a P cd75a17ab2604397adab03bb8b5fd75c [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:18.094259  6879 raft_consensus.cc:2468] T fe20b4b48823486ca3b9c648db6ce8aa P cd75a17ab2604397adab03bb8b5fd75c [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 14.
I20260709 13:21:18.095621 13027 raft_consensus.cc:3055] T f4b8bd455d5a47c18a1380839c6e0d61 P b7ab4784c7344b939bc36f639286f377 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:21:18.096602 13027 raft_consensus.cc:740] T f4b8bd455d5a47c18a1380839c6e0d61 P b7ab4784c7344b939bc36f639286f377 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
I20260709 13:21:18.097608  6881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a92dd554674067a83a9cb68c4773f2" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:21:18.098696  6881 raft_consensus.cc:2468] T 07a92dd554674067a83a9cb68c4773f2 P cd75a17ab2604397adab03bb8b5fd75c [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 17.
I20260709 13:21:18.098438 13027 consensus_queue.cc:260] T f4b8bd455d5a47c18a1380839c6e0d61 P b7ab4784c7344b939bc36f639286f377 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 18.9, Last appended by leader: 9, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:18.100891  6799 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50550 (request call id 790) took 1138 ms. Trace:
I20260709 13:21:18.101855 13447 raft_consensus.cc:3055] T 20f6842e26174571996b8dea4151d4be P b7ab4784c7344b939bc36f639286f377 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:21:18.101431  6799 rpcz_store.cc:276] 0709 13:21:16.962356 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:21:17.028571 (+ 66215us) service_pool.cc:224] Handling call
0709 13:21:18.100280 (+1071709us) spinlock_profiling.cc:243] Waited 213 ms on lock 0x7b54002c74d4. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f9ae2fa 00007fcc1496fb17 00007fcc0deea6d4 00007fcc0deea662 00007fcc0deea591 00007fcc0deea50c 00007fcc0dee97c2 00007fcc0dce548c 00007fcc0dce48c6 00007fcc0dce426f
0709 13:21:18.100620 (+   340us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":490430720}
I20260709 13:21:18.102545 13447 raft_consensus.cc:740] T 20f6842e26174571996b8dea4151d4be P b7ab4784c7344b939bc36f639286f377 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
I20260709 13:21:18.103267  6728 raft_consensus.cc:2955] T 95a75bfe094d4bdc963aba3f08dfcd25 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 16 FOLLOWER]: Committing config change with OpId 14.9: config changed from index 7 to 9, 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } attrs { replace: true } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } } }
I20260709 13:21:18.106352  6880 raft_consensus.cc:1275] T 3411566abe2d4c9bb4b2adfdd05e6f17 P cd75a17ab2604397adab03bb8b5fd75c [term 18 FOLLOWER]: Refusing update from remote peer ccd8a4c3bfe3413cb2ae219b09aea832: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 13:21:18.105501  6629 catalog_manager.cc:5697] T 3fa34c08b205435dba97346991aa1f92 P 7ba59cc884714e8aa5f3f0ecaed84cbb reported cstate change: term changed from 15 to 21, leader changed from cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67) to 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68). New cstate: current_term: 21 leader_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:21:18.108744 13526 raft_consensus.cc:2804] T d8292e16e5654be6bc408560cf256aaa P ccd8a4c3bfe3413cb2ae219b09aea832 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:21:18.109750 13526 raft_consensus.cc:697] T d8292e16e5654be6bc408560cf256aaa P ccd8a4c3bfe3413cb2ae219b09aea832 [term 19 LEADER]: Becoming Leader. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
I20260709 13:21:18.109066  6629 catalog_manager.cc:5697] T 17587d6730594da4a56fa13a353232a1 P 7ba59cc884714e8aa5f3f0ecaed84cbb reported cstate change: term changed from 20 to 23, leader changed from 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68) to b7ab4784c7344b939bc36f639286f377 (127.5.126.66). New cstate: current_term: 23 leader_uuid: "b7ab4784c7344b939bc36f639286f377" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } } }
I20260709 13:21:18.110394 13446 raft_consensus.cc:493] T a3022224cc81473690653a83d4e99470 P b7ab4784c7344b939bc36f639286f377 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
W20260709 13:21:18.100694  6695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 654309us
I20260709 13:21:18.101593 13027 raft_consensus.cc:3060] T f4b8bd455d5a47c18a1380839c6e0d61 P b7ab4784c7344b939bc36f639286f377 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:21:18.119669  6695 leader_election.cc:304] T d33d5ee8ef6f415593d8df52063161ad P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
I20260709 13:21:18.113154  6874 raft_consensus.cc:2468] T 34f36d59d88f40fe8a2805e604fc6c0a P cd75a17ab2604397adab03bb8b5fd75c [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 16.
I20260709 13:21:18.111744  6629 catalog_manager.cc:5697] T 4b8cacb381b746da8d0049b0a83b41dd P 7ba59cc884714e8aa5f3f0ecaed84cbb reported cstate change: term changed from 14 to 18, leader changed from 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68) to ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65). New cstate: current_term: 18 leader_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } } }
I20260709 13:21:18.111514 13446 raft_consensus.cc:515] T a3022224cc81473690653a83d4e99470 P b7ab4784c7344b939bc36f639286f377 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:18.091132 13347 raft_consensus.cc:515] T 90d42e216d9741e190bca19a781291fd P cd75a17ab2604397adab03bb8b5fd75c [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
W20260709 13:21:18.153898  7466 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 300407us
I20260709 13:21:18.141618 13264 leader_election.cc:290] T 34f36d59d88f40fe8a2805e604fc6c0a P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:21:18.151707 13446 leader_election.cc:290] T a3022224cc81473690653a83d4e99470 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:21:18.171903 13295 raft_consensus.cc:493] T 30e88460611e47b2ba16a46a30b5f416 P b7ab4784c7344b939bc36f639286f377 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:21:18.174055  6697 leader_election.cc:304] T be1a92657f494cac8dd227d152f50151 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, b7ab4784c7344b939bc36f639286f377
I20260709 13:21:18.171933  6877 raft_consensus.cc:1240] T 713b5728a197487c9300b310ab94e5a3 P cd75a17ab2604397adab03bb8b5fd75c [term 17 FOLLOWER]: Rejecting Update request from peer ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 16. Current term is 17. Ops: []
I20260709 13:21:18.175989 13545 raft_consensus.cc:2804] T 1bf4668eeb70467fb3dc5a0289233b3c P cd75a17ab2604397adab03bb8b5fd75c [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:21:18.201064  6875 raft_consensus.cc:2468] T 7c44c4849aa54f2b94d1f1bef9ed546f P cd75a17ab2604397adab03bb8b5fd75c [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 21.
I20260709 13:21:18.198854  6878 raft_consensus.cc:1275] T f3f9c2e2bf644115957398fe4c9459db P cd75a17ab2604397adab03bb8b5fd75c [term 18 FOLLOWER]: Refusing update from remote peer ccd8a4c3bfe3413cb2ae219b09aea832: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 13:21:18.209010 13295 raft_consensus.cc:515] T 30e88460611e47b2ba16a46a30b5f416 P b7ab4784c7344b939bc36f639286f377 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:18.197461 13545 raft_consensus.cc:493] T 1bf4668eeb70467fb3dc5a0289233b3c P cd75a17ab2604397adab03bb8b5fd75c [term 16 FOLLOWER]: Starting leader election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
W20260709 13:21:18.220854  6695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 101420us
I20260709 13:21:18.222827  6872 raft_consensus.cc:1275] T 9e326172347f45e99a0d482b5d8ef768 P cd75a17ab2604397adab03bb8b5fd75c [term 16 FOLLOWER]: Refusing update from remote peer ccd8a4c3bfe3413cb2ae219b09aea832: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 13:21:18.223471  6881 raft_consensus.cc:1275] T 7c44c4849aa54f2b94d1f1bef9ed546f P cd75a17ab2604397adab03bb8b5fd75c [term 21 FOLLOWER]: Refusing update from remote peer ccd8a4c3bfe3413cb2ae219b09aea832: Log matching property violated. Preceding OpId in replica: term: 19 index: 13. Preceding OpId from leader: term: 21 index: 14. (index mismatch)
W20260709 13:21:18.226275  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 195108us
W20260709 13:21:18.224668  6846 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.68:45071, user_credentials={real_user=slave}} blocked reactor thread for 88174.6us
W20260709 13:21:18.232098  6697 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.68:45071, user_credentials={real_user=slave}} blocked reactor thread for 58611.2us
I20260709 13:21:18.111537 13526 consensus_queue.cc:237] T d8292e16e5654be6bc408560cf256aaa P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:18.224970 13545 raft_consensus.cc:3060] T 1bf4668eeb70467fb3dc5a0289233b3c P cd75a17ab2604397adab03bb8b5fd75c [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:21:18.240768  7500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17587d6730594da4a56fa13a353232a1" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb"
I20260709 13:21:18.241531 13202 raft_consensus.cc:2749] T be1a92657f494cac8dd227d152f50151 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 13:21:18.197623 13447 consensus_queue.cc:260] T 20f6842e26174571996b8dea4151d4be P b7ab4784c7344b939bc36f639286f377 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 20.12, Last appended by leader: 12, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:18.246006 13027 raft_consensus.cc:493] T f3f9c2e2bf644115957398fe4c9459db P b7ab4784c7344b939bc36f639286f377 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:18.247562  6799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "427c124d773f483294511e80fe340075" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 19 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:21:18.251030  6806 raft_consensus.cc:1240] T d33d5ee8ef6f415593d8df52063161ad P b7ab4784c7344b939bc36f639286f377 [term 18 FOLLOWER]: Rejecting Update request from peer cd75a17ab2604397adab03bb8b5fd75c for earlier term 17. Current term is 18. Ops: []
I20260709 13:21:18.256505  7494 raft_consensus.cc:1240] T 24ee15416e3145beaa1b8183453729a3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 20 LEADER]: Rejecting Update request from peer cd75a17ab2604397adab03bb8b5fd75c for earlier term 19. Current term is 20. Ops: []
I20260709 13:21:18.255762  6844 leader_election.cc:304] T f4b8bd455d5a47c18a1380839c6e0d61 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:21:18.228341 12863 raft_consensus.cc:2804] T d33d5ee8ef6f415593d8df52063161ad P ccd8a4c3bfe3413cb2ae219b09aea832 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:21:18.264319 13027 raft_consensus.cc:515] T f3f9c2e2bf644115957398fe4c9459db P b7ab4784c7344b939bc36f639286f377 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:18.266538  6802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4275cf08e63345f993bce8664eada830" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:21:18.266983 13027 leader_election.cc:290] T f3f9c2e2bf644115957398fe4c9459db P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:21:18.267781  6802 raft_consensus.cc:2393] T 4275cf08e63345f993bce8664eada830 P b7ab4784c7344b939bc36f639286f377 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c in current term 18: Already voted for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in this term.
I20260709 13:21:18.269661  7498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17587d6730594da4a56fa13a353232a1" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb"
I20260709 13:21:18.269491  7500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe20b4b48823486ca3b9c648db6ce8aa" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:21:18.278095  6629 catalog_manager.cc:5697] T fe20b4b48823486ca3b9c648db6ce8aa P 7ba59cc884714e8aa5f3f0ecaed84cbb reported cstate change: term changed from 11 to 14, leader changed from cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67) to 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68). New cstate: current_term: 14 leader_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:21:18.279426  6801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4db81d9d329422bb3b4160ca4ac2d1d" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:21:18.280830  6801 raft_consensus.cc:2393] T c4db81d9d329422bb3b4160ca4ac2d1d P b7ab4784c7344b939bc36f639286f377 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c in current term 20: Already voted for candidate b7ab4784c7344b939bc36f639286f377 in this term.
I20260709 13:21:18.282555  6875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bf4668eeb70467fb3dc5a0289233b3c" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:21:18.260114 13446 raft_consensus.cc:493] T 9e326172347f45e99a0d482b5d8ef768 P b7ab4784c7344b939bc36f639286f377 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:18.274219 12863 raft_consensus.cc:697] T d33d5ee8ef6f415593d8df52063161ad P ccd8a4c3bfe3413cb2ae219b09aea832 [term 18 LEADER]: Becoming Leader. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
I20260709 13:21:18.300652  6806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6869f07b5a4885a0b99fbe60c3b175" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 21 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:21:18.303560  6806 raft_consensus.cc:2468] T bd6869f07b5a4885a0b99fbe60c3b175 P b7ab4784c7344b939bc36f639286f377 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 20.
I20260709 13:21:18.303754  7466 leader_election.cc:304] T b3f13b31a1f84f0d89d007eadd57924c P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:21:18.305122  6799 raft_consensus.cc:1240] T 1bf4668eeb70467fb3dc5a0289233b3c P b7ab4784c7344b939bc36f639286f377 [term 17 FOLLOWER]: Rejecting Update request from peer ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 16. Current term is 17. Ops: []
I20260709 13:21:18.304908 13546 raft_consensus.cc:3060] T be1a92657f494cac8dd227d152f50151 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:21:18.306437 13347 leader_election.cc:290] T 90d42e216d9741e190bca19a781291fd P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:21:18.317752  6730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7887766dc6784fcaa42b35c05fea7a99" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 23 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
W20260709 13:21:18.318606  6847 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:21:18.319212  6847 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:21:18.319885  6847 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:21:18.320297  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 64710.1us
I20260709 13:21:18.321590  6844 leader_election.cc:400] T 9e326172347f45e99a0d482b5d8ef768 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 15 pre-election: Vote denied by peer b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817) with higher term. Message: Invalid argument: T 9e326172347f45e99a0d482b5d8ef768 P b7ab4784c7344b939bc36f639286f377 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c for earlier term 15. Current term is 16.
I20260709 13:21:18.321928  6844 leader_election.cc:403] T 9e326172347f45e99a0d482b5d8ef768 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 15 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:21:18.321699  6878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4db81d9d329422bb3b4160ca4ac2d1d" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:21:18.322503  6878 raft_consensus.cc:3060] T c4db81d9d329422bb3b4160ca4ac2d1d P cd75a17ab2604397adab03bb8b5fd75c [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:21:18.319028  6730 raft_consensus.cc:2468] T 7887766dc6784fcaa42b35c05fea7a99 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 22.
I20260709 13:21:18.324406 13417 raft_consensus.cc:3060] T b3f13b31a1f84f0d89d007eadd57924c P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:21:18.330544  6727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4db81d9d329422bb3b4160ca4ac2d1d" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:21:18.331682  6727 raft_consensus.cc:2393] T c4db81d9d329422bb3b4160ca4ac2d1d P ccd8a4c3bfe3413cb2ae219b09aea832 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate b7ab4784c7344b939bc36f639286f377 in current term 20: Already voted for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in this term.
I20260709 13:21:18.324635 13347 raft_consensus.cc:2749] T 9e326172347f45e99a0d482b5d8ef768 P cd75a17ab2604397adab03bb8b5fd75c [term 16 FOLLOWER]: Leader pre-election lost for term 15. Reason: Vote denied by peer b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817) with higher term. Message: Invalid argument: T 9e326172347f45e99a0d482b5d8ef768 P b7ab4784c7344b939bc36f639286f377 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c for earlier term 15. Current term is 16.
I20260709 13:21:18.333012 13295 leader_election.cc:290] T 30e88460611e47b2ba16a46a30b5f416 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:21:18.325119  6731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3f13b31a1f84f0d89d007eadd57924c" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:21:18.326675  6724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1704639a875409b9959353527b3fd68" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 22 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:21:18.334951  6724 raft_consensus.cc:3060] T a1704639a875409b9959353527b3fd68 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:21:18.327564  6723 raft_consensus.cc:1240] T be1a92657f494cac8dd227d152f50151 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 22 FOLLOWER]: Rejecting Update request from peer b7ab4784c7344b939bc36f639286f377 for earlier term 21. Current term is 22. Ops: []
I20260709 13:21:18.335914 12863 consensus_queue.cc:237] T d33d5ee8ef6f415593d8df52063161ad P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:18.328786  6725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17587d6730594da4a56fa13a353232a1" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:21:18.338443  6725 raft_consensus.cc:2393] T 17587d6730594da4a56fa13a353232a1 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 25 FOLLOWER]: Leader election vote request: Denying vote to candidate b7ab4784c7344b939bc36f639286f377 in current term 25: Already voted for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in this term.
I20260709 13:21:18.338707  6697 leader_election.cc:304] T 1528ab62b6fe4e3099d08f141afee116 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, b7ab4784c7344b939bc36f639286f377
I20260709 13:21:18.329069  6730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bf4668eeb70467fb3dc5a0289233b3c" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:21:18.326079  6879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f9c2e2bf644115957398fe4c9459db" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:21:18.340363  6801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a92dd554674067a83a9cb68c4773f2" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:21:18.340396  6879 raft_consensus.cc:2468] T f3f9c2e2bf644115957398fe4c9459db P cd75a17ab2604397adab03bb8b5fd75c [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 18.
I20260709 13:21:18.328922  6726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbdf895bba214ff68685a24fd17dfb5d" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 18 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:21:18.323987  6844 leader_election.cc:304] T 711ef6523deb4cbe8ef2ba61e1c21c98 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:21:18.344017 13347 raft_consensus.cc:2749] T 711ef6523deb4cbe8ef2ba61e1c21c98 P cd75a17ab2604397adab03bb8b5fd75c [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 13:21:18.345121 13568 log.cc:927] Time spent T bd6869f07b5a4885a0b99fbe60c3b175 P cd75a17ab2604397adab03bb8b5fd75c: Append to log took a long time: real 0.137s	user 0.000s	sys 0.005s
I20260709 13:21:18.348384  6799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77e330a82df4b43a745d57a68f6f057" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:21:18.352708  6807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c7f33e544204fbaac4078e3e83bbf4e" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:21:18.355118  6800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c7f33e544204fbaac4078e3e83bbf4e" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:21:18.357132  6803 raft_consensus.cc:1240] T b3f13b31a1f84f0d89d007eadd57924c P b7ab4784c7344b939bc36f639286f377 [term 15 FOLLOWER]: Rejecting Update request from peer ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 14. Current term is 15. Ops: []
I20260709 13:21:18.358381  6803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4db81d9d329422bb3b4160ca4ac2d1d" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:21:18.359253  6803 raft_consensus.cc:2393] T c4db81d9d329422bb3b4160ca4ac2d1d P b7ab4784c7344b939bc36f639286f377 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate ccd8a4c3bfe3413cb2ae219b09aea832 in current term 20: Already voted for candidate b7ab4784c7344b939bc36f639286f377 in this term.
I20260709 13:21:18.360443  6800 raft_consensus.cc:1275] T f3f9c2e2bf644115957398fe4c9459db P b7ab4784c7344b939bc36f639286f377 [term 18 FOLLOWER]: Refusing update from remote peer ccd8a4c3bfe3413cb2ae219b09aea832: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 13:21:18.360705 13446 raft_consensus.cc:515] T 9e326172347f45e99a0d482b5d8ef768 P b7ab4784c7344b939bc36f639286f377 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:18.361907  6872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3022224cc81473690653a83d4e99470" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:21:18.360806  6805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17587d6730594da4a56fa13a353232a1" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:21:18.363685 13446 leader_election.cc:290] T 9e326172347f45e99a0d482b5d8ef768 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:21:18.364094  6799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8cee0accdb8499c86d4414b72565a38" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:21:18.360471  6801 raft_consensus.cc:1240] T 4d9def8b32fd443aa94ab1420b06837b P b7ab4784c7344b939bc36f639286f377 [term 21 LEADER]: Rejecting Update request from peer cd75a17ab2604397adab03bb8b5fd75c for earlier term 20. Current term is 21. Ops: []
W20260709 13:21:18.369980 13569 log.cc:927] Time spent T be1a92657f494cac8dd227d152f50151 P 7ba59cc884714e8aa5f3f0ecaed84cbb: Append to log took a long time: real 0.059s	user 0.000s	sys 0.001s
I20260709 13:21:18.370185  6806 raft_consensus.cc:1240] T 17587d6730594da4a56fa13a353232a1 P b7ab4784c7344b939bc36f639286f377 [term 25 FOLLOWER]: Rejecting Update request from peer 7ba59cc884714e8aa5f3f0ecaed84cbb for earlier term 24. Current term is 25. Ops: []
I20260709 13:21:18.372119  7503 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50744 (request call id 570) took 1335 ms. Trace:
I20260709 13:21:18.372560  7503 rpcz_store.cc:276] 0709 13:21:17.036562 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:21:17.037021 (+   459us) service_pool.cc:224] Handling call
0709 13:21:17.037326 (+   305us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:21:17.037713 (+   387us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:21:17.037750 (+    37us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:21:17.038530 (+   780us) log.cc:844] Serialized 52 byte log entry
0709 13:21:18.109162 (+1070632us) spinlock_profiling.cc:243] Waited 3.35 ms on lock 0x7b1800135c40. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc15785de1 00007fcc157925b1 00007fcc0c89fe07 00007fcc156faab9 00007fcc0c8bc69b 00007fcc0c8ba93f 00007fcc0c8bcc02 00007fcc0f54420b 00007fcc0f549d23 00007fcc0f54a0d1 00007fcc0f965a0f
0709 13:21:18.275234 (+166072us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:21:18.277447 (+  2213us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:21:18.297925 (+ 20478us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:21:18.368804 (+ 70879us) spinlock_profiling.cc:243] Waited 1.72 ms on lock 0x7b4400022b4c. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0c745db1 00007fcc0c7e3c85 00007fcc0c7e46a2 00007fcc0f5561db 00007fcc0f551aaf 00007fcc0f54586e 00007fcc0f544bb6 00007fcc0f5447d8 00007fcc0f54e221 00007fcc0f54e1d9 00007fcc0f54e169
0709 13:21:18.371604 (+  2800us) raft_consensus.cc:1685] finished
0709 13:21:18.371631 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:21:18.371847 (+   216us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2580,"raft.run_cpu_time_us":141,"raft.run_wall_time_us":11838,"spinlock_wait_cycles":11659264,"thread_start_us":87547,"threads_started":1,"wal-append.queue_time_us":1269178}
W20260709 13:21:18.379984 13563 log.cc:927] Time spent T 4b8cacb381b746da8d0049b0a83b41dd P cd75a17ab2604397adab03bb8b5fd75c: Append to log took a long time: real 0.079s	user 0.002s	sys 0.000s
I20260709 13:21:18.365474  6629 catalog_manager.cc:5697] T 1528ab62b6fe4e3099d08f141afee116 P 7ba59cc884714e8aa5f3f0ecaed84cbb reported cstate change: term changed from 13 to 16, leader changed from ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65) to 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68). New cstate: current_term: 16 leader_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:21:18.387482  6729 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50004 (request call id 3043) took 1670 ms. Trace:
I20260709 13:21:18.388000  6729 rpcz_store.cc:276] 0709 13:21:16.716658 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:21:16.717102 (+   444us) service_pool.cc:224] Handling call
0709 13:21:16.717449 (+   347us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:21:17.040376 (+322927us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:21:17.040396 (+    20us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:21:18.110713 (+1070317us) spinlock_profiling.cc:243] Waited 49 ms on lock 0x7b2c00000f48. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0e2a3a11 00007fcc0e2b3372 00007fcc0f9e5a01 00007fcc0f9aa43a 00007fcc0f9a983e 00007fcc1496e419 00007fcc0dee5bd4 00007fcc0dee5b62 00007fcc0dee5a91 00007fcc0dee5a0c 00007fcc0dee4cc2
0709 13:21:18.111663 (+   950us) log.cc:844] Serialized 26 byte log entry
0709 13:21:18.196700 (+ 85037us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:21:18.199385 (+  2685us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:21:18.224427 (+ 25042us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:21:18.386904 (+162477us) raft_consensus.cc:1685] finished
0709 13:21:18.386940 (+    36us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:21:18.387272 (+   332us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":39386,"raft.queue_time_us":77741,"raft.run_cpu_time_us":116,"raft.run_wall_time_us":117,"spinlock_wait_cycles":112753920,"thread_start_us":364350,"threads_started":2,"wal-append.queue_time_us":273058}
I20260709 13:21:18.389734  6872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4db81d9d329422bb3b4160ca4ac2d1d" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:21:18.393589  6805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09c2a98de1a4decabd0ff900dd44caa" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:21:18.346343  6844 leader_election.cc:304] T 713b5728a197487c9300b310ab94e5a3 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:21:18.403285  6805 raft_consensus.cc:2368] T f09c2a98de1a4decabd0ff900dd44caa P b7ab4784c7344b939bc36f639286f377 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c for earlier term 19. Current term is 20.
I20260709 13:21:18.405124 13447 raft_consensus.cc:3060] T 20f6842e26174571996b8dea4151d4be P b7ab4784c7344b939bc36f639286f377 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:21:18.405912  6805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b3759de40694069b13c0f8bd40e5709" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:21:18.406749  6799 raft_consensus.cc:1275] T 9e326172347f45e99a0d482b5d8ef768 P b7ab4784c7344b939bc36f639286f377 [term 16 FOLLOWER]: Refusing update from remote peer ccd8a4c3bfe3413cb2ae219b09aea832: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
W20260709 13:21:18.407709  6847 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:21:18.408067  6724 raft_consensus.cc:2468] T a1704639a875409b9959353527b3fd68 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 22.
I20260709 13:21:18.429986  6875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbdf895bba214ff68685a24fd17dfb5d" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 18 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:21:18.424768  6806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c44c4849aa54f2b94d1f1bef9ed546f" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
W20260709 13:21:18.432730  6847 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:21:18.433677  6878 raft_consensus.cc:2468] T c4db81d9d329422bb3b4160ca4ac2d1d P cd75a17ab2604397adab03bb8b5fd75c [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 20.
I20260709 13:21:18.435446  6807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3022224cc81473690653a83d4e99470" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 22 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:21:18.437670  6803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22ccee1b570c4ad3a57bd7aec085b1b4" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: true dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:21:18.456276  6807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a734b5ab7834e05a8c422208acc58b1" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:21:18.460219  6807 raft_consensus.cc:2468] T 7a734b5ab7834e05a8c422208acc58b1 P b7ab4784c7344b939bc36f639286f377 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 20.
I20260709 13:21:18.461283 13477 raft_consensus.cc:493] T 853ac0a8cbd64ce99457f170216d4d0f P ccd8a4c3bfe3413cb2ae219b09aea832 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:18.462023 13477 raft_consensus.cc:515] T 853ac0a8cbd64ce99457f170216d4d0f P ccd8a4c3bfe3413cb2ae219b09aea832 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:18.462849 13207 consensus_queue.cc:1059] T 1bf4668eeb70467fb3dc5a0289233b3c P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: INVALID_TERM, Last received: 16.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:21:18.463515 13529 consensus_queue.cc:1059] T b3f13b31a1f84f0d89d007eadd57924c P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: INVALID_TERM, Last received: 14.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:21:18.464830 13207 consensus_queue.cc:1048] T f3f9c2e2bf644115957398fe4c9459db P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:21:18.465632 13529 raft_consensus.cc:3055] T 1bf4668eeb70467fb3dc5a0289233b3c P ccd8a4c3bfe3413cb2ae219b09aea832 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:21:18.466113 13529 raft_consensus.cc:740] T 1bf4668eeb70467fb3dc5a0289233b3c P ccd8a4c3bfe3413cb2ae219b09aea832 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
I20260709 13:21:18.466758 13207 raft_consensus.cc:3055] T b3f13b31a1f84f0d89d007eadd57924c P ccd8a4c3bfe3413cb2ae219b09aea832 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:21:18.464845 13477 leader_election.cc:290] T 853ac0a8cbd64ce99457f170216d4d0f P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:21:18.467231 13529 consensus_queue.cc:260] T 1bf4668eeb70467fb3dc5a0289233b3c P ccd8a4c3bfe3413cb2ae219b09aea832 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:18.468134 13425 raft_consensus.cc:2749] T f4b8bd455d5a47c18a1380839c6e0d61 P cd75a17ab2604397adab03bb8b5fd75c [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:21:18.472345  6805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab432e62819d499eaaf3dd55481dd930" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 23 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
W20260709 13:21:18.477200  6772 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:21:18.467233 13207 raft_consensus.cc:740] T b3f13b31a1f84f0d89d007eadd57924c P ccd8a4c3bfe3413cb2ae219b09aea832 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
I20260709 13:21:18.479846  6803 raft_consensus.cc:3055] T 22ccee1b570c4ad3a57bd7aec085b1b4 P b7ab4784c7344b939bc36f639286f377 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:21:18.484566  6803 raft_consensus.cc:740] T 22ccee1b570c4ad3a57bd7aec085b1b4 P b7ab4784c7344b939bc36f639286f377 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
I20260709 13:21:18.490445 13495 raft_consensus.cc:2749] T 1528ab62b6fe4e3099d08f141afee116 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:21:18.481688 13529 raft_consensus.cc:3060] T 1bf4668eeb70467fb3dc5a0289233b3c P ccd8a4c3bfe3413cb2ae219b09aea832 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:21:18.491554 13456 raft_consensus.cc:2749] T 713b5728a197487c9300b310ab94e5a3 P cd75a17ab2604397adab03bb8b5fd75c [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:21:18.490098 13207 consensus_queue.cc:260] T b3f13b31a1f84f0d89d007eadd57924c P ccd8a4c3bfe3413cb2ae219b09aea832 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 14.13, Last appended by leader: 13, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:21:18.502617 13207 raft_consensus.cc:3060] T b3f13b31a1f84f0d89d007eadd57924c P ccd8a4c3bfe3413cb2ae219b09aea832 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:21:18.512156  6805 raft_consensus.cc:2410] T ab432e62819d499eaaf3dd55481dd930 P b7ab4784c7344b939bc36f639286f377 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c for term 23 because replica has last-logged OpId of term: 22 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 20 index: 11.
I20260709 13:21:18.520947  6807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f00a2e87e56452083b759f60d461ee3" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
W20260709 13:21:18.524281  6845 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:21:18.532315 13571 log.cc:927] Time spent T bb3d8792045a4583ae2e965b1350a5b4 P cd75a17ab2604397adab03bb8b5fd75c: Append to log took a long time: real 0.133s	user 0.001s	sys 0.000s
W20260709 13:21:18.533613  6696 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:21:18.536223  6729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22ccee1b570c4ad3a57bd7aec085b1b4" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: true dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:21:18.536517  6727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09c2a98de1a4decabd0ff900dd44caa" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:21:18.537535  6728 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49998 (request call id 1629) took 1638 ms. Trace:
I20260709 13:21:18.537474  6729 raft_consensus.cc:3060] T 22ccee1b570c4ad3a57bd7aec085b1b4 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:21:18.544543 13420 consensus_queue.cc:1059] T 17587d6730594da4a56fa13a353232a1 P 7ba59cc884714e8aa5f3f0ecaed84cbb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: INVALID_TERM, Last received: 24.17, Next index: 18, Last known committed idx: 17, Time since last communication: 0.001s
I20260709 13:21:18.546092 13420 consensus_queue.cc:1059] T 17587d6730594da4a56fa13a353232a1 P 7ba59cc884714e8aa5f3f0ecaed84cbb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: INVALID_TERM, Last received: 24.17, Next index: 18, Last known committed idx: 17, Time since last communication: 0.001s
I20260709 13:21:18.547546 13289 raft_consensus.cc:3055] T 17587d6730594da4a56fa13a353232a1 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 24 LEADER]: Stepping down as leader of term 24
I20260709 13:21:18.548065 13289 raft_consensus.cc:740] T 17587d6730594da4a56fa13a353232a1 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 24 LEADER]: Becoming Follower/Learner. State: Replica: 7ba59cc884714e8aa5f3f0ecaed84cbb, State: Running, Role: LEADER
I20260709 13:21:18.549541 13289 consensus_queue.cc:260] T 17587d6730594da4a56fa13a353232a1 P 7ba59cc884714e8aa5f3f0ecaed84cbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 24.17, Last appended by leader: 17, Current term: 24, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:21:18.551668  6729 raft_consensus.cc:2468] T 22ccee1b570c4ad3a57bd7aec085b1b4 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 15.
W20260709 13:21:18.557375  6772 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:21:18.563563 13027 raft_consensus.cc:493] T 95a75bfe094d4bdc963aba3f08dfcd25 P b7ab4784c7344b939bc36f639286f377 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader cd75a17ab2604397adab03bb8b5fd75c)
W20260709 13:21:18.536303  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 190172us
I20260709 13:21:18.564373 13027 raft_consensus.cc:515] T 95a75bfe094d4bdc963aba3f08dfcd25 P b7ab4784c7344b939bc36f639286f377 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } attrs { replace: true } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:21:18.567030 13425 consensus_queue.cc:1048] T d8292e16e5654be6bc408560cf256aaa P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:21:18.567834 13027 leader_election.cc:290] T 95a75bfe094d4bdc963aba3f08dfcd25 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:21:18.538337  6728 rpcz_store.cc:276] 0709 13:21:16.899493 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:21:16.903622 (+  4129us) service_pool.cc:224] Handling call
0709 13:21:16.904278 (+   656us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:21:16.904608 (+   330us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:21:16.920576 (+ 15968us) log.cc:844] Serialized 14 byte log entry
0709 13:21:18.301714 (+1381138us) log.cc:844] Serialized 14 byte log entry
0709 13:21:18.485895 (+184181us) log.cc:844] Serialized 14 byte log entry
0709 13:21:18.499129 (+ 13234us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:21:18.501300 (+  2171us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:21:18.507633 (+  6333us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:21:18.511214 (+  3581us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:21:18.537472 (+ 26258us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":754945,"prepare.queue_time_us":26441,"prepare.run_cpu_time_us":119,"prepare.run_wall_time_us":116,"raft.queue_time_us":781048,"raft.run_cpu_time_us":731,"raft.run_wall_time_us":15853,"thread_start_us":486658,"threads_started":1,"wal-append.queue_time_us":764349}
W20260709 13:21:18.585749  6695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 121896us
I20260709 13:21:18.598698  6801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20f6842e26174571996b8dea4151d4be" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:21:18.612669  6724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "404190ce4ce94cecbfcb6ea9d1dd8626" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:21:18.620932  6730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3022224cc81473690653a83d4e99470" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:21:18.620698  6803 consensus_queue.cc:260] T 22ccee1b570c4ad3a57bd7aec085b1b4 P b7ab4784c7344b939bc36f639286f377 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:18.621969  6803 raft_consensus.cc:3060] T 22ccee1b570c4ad3a57bd7aec085b1b4 P b7ab4784c7344b939bc36f639286f377 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:21:18.597992 13456 consensus_queue.cc:1048] T 7887766dc6784fcaa42b35c05fea7a99 P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.027s
W20260709 13:21:18.645987  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 44980.9us
I20260709 13:21:18.648401  6729 raft_consensus.cc:1240] T 22ccee1b570c4ad3a57bd7aec085b1b4 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 15 FOLLOWER]: Rejecting Update request from peer b7ab4784c7344b939bc36f639286f377 for earlier term 14. Current term is 15. Ops: []
W20260709 13:21:18.651304  7466 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 109131us
I20260709 13:21:18.654253  6723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f9c2e2bf644115957398fe4c9459db" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:21:18.655450 13456 consensus_queue.cc:1059] T a1704639a875409b9959353527b3fd68 P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:21:18.648826 13207 raft_consensus.cc:493] T de3186201e1a40d0b335eeb8b4e256e0 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:21:18.671370 13207 raft_consensus.cc:515] T de3186201e1a40d0b335eeb8b4e256e0 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:18.672619  6729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30e88460611e47b2ba16a46a30b5f416" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:21:18.674060 13207 leader_election.cc:290] T de3186201e1a40d0b335eeb8b4e256e0 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
W20260709 13:21:18.666771  7466 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:21:18.651319 13417 raft_consensus.cc:2749] T b3f13b31a1f84f0d89d007eadd57924c P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:21:18.685334  6724 raft_consensus.cc:2410] T 404190ce4ce94cecbfcb6ea9d1dd8626 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ba59cc884714e8aa5f3f0ecaed84cbb for term 18 because replica has last-logged OpId of term: 16 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 12.
I20260709 13:21:18.657099 13481 raft_consensus.cc:493] T de3186201e1a40d0b335eeb8b4e256e0 P cd75a17ab2604397adab03bb8b5fd75c [term 19 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:21:18.657008 13545 raft_consensus.cc:515] T 1bf4668eeb70467fb3dc5a0289233b3c P cd75a17ab2604397adab03bb8b5fd75c [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:18.703852  6731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a75bfe094d4bdc963aba3f08dfcd25" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:21:18.704527  6731 raft_consensus.cc:2468] T 95a75bfe094d4bdc963aba3f08dfcd25 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 16.
I20260709 13:21:18.703617 13295 raft_consensus.cc:493] T ab432e62819d499eaaf3dd55481dd930 P b7ab4784c7344b939bc36f639286f377 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:21:18.795449  6732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e326172347f45e99a0d482b5d8ef768" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:21:18.796551  6726 raft_consensus.cc:1275] T 2c240553ce044eedb41541d72b9475d7 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 19 FOLLOWER]: Refusing update from remote peer b7ab4784c7344b939bc36f639286f377: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
W20260709 13:21:18.800112 13222 consensus_meta.cc:287] T 1528ab62b6fe4e3099d08f141afee116 P b7ab4784c7344b939bc36f639286f377: Time spent flushing consensus metadata: real 0.526s	user 0.015s	sys 0.002s
I20260709 13:21:18.720739 13026 raft_consensus.cc:493] T 4275cf08e63345f993bce8664eada830 P b7ab4784c7344b939bc36f639286f377 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:21:18.852521  6697 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.68:45071, user_credentials={real_user=slave}} blocked reactor thread for 539987us
I20260709 13:21:18.854457  6697 leader_election.cc:304] T 17587d6730594da4a56fa13a353232a1 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 25 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, b7ab4784c7344b939bc36f639286f377
I20260709 13:21:18.855607 13529 raft_consensus.cc:2749] T 17587d6730594da4a56fa13a353232a1 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 25 FOLLOWER]: Leader election lost for term 25. Reason: could not achieve majority
I20260709 13:21:18.837611 13481 raft_consensus.cc:515] T de3186201e1a40d0b335eeb8b4e256e0 P cd75a17ab2604397adab03bb8b5fd75c [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:18.859596 13481 leader_election.cc:290] T de3186201e1a40d0b335eeb8b4e256e0 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
W20260709 13:21:18.860584  6698 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:21:18.869306  6803 raft_consensus.cc:2468] T 22ccee1b570c4ad3a57bd7aec085b1b4 P b7ab4784c7344b939bc36f639286f377 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 15.
I20260709 13:21:18.865267 13026 raft_consensus.cc:515] T 4275cf08e63345f993bce8664eada830 P b7ab4784c7344b939bc36f639286f377 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:18.863358  6770 leader_election.cc:304] T 7887766dc6784fcaa42b35c05fea7a99 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
W20260709 13:21:18.869837  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 73451.1us
W20260709 13:21:18.863435  6847 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:21:18.875005  6847 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:21:18.884711 13446 consensus_queue.cc:1048] T 07a92dd554674067a83a9cb68c4773f2 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.005s
I20260709 13:21:18.891425 13446 raft_consensus.cc:2804] T 7887766dc6784fcaa42b35c05fea7a99 P b7ab4784c7344b939bc36f639286f377 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:21:18.892216 13587 raft_consensus.cc:493] T 3a485a995abc4807b6e511e45419f737 P cd75a17ab2604397adab03bb8b5fd75c [term 17 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:21:18.893405 13587 raft_consensus.cc:515] T 3a485a995abc4807b6e511e45419f737 P cd75a17ab2604397adab03bb8b5fd75c [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:18.896693 13585 raft_consensus.cc:493] T 4f00a2e87e56452083b759f60d461ee3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 20 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:21:18.897564 13585 raft_consensus.cc:515] T 4f00a2e87e56452083b759f60d461ee3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:21:18.898044 13587 leader_election.cc:290] T 3a485a995abc4807b6e511e45419f737 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:21:18.899071 13587 raft_consensus.cc:493] T 30e88460611e47b2ba16a46a30b5f416 P cd75a17ab2604397adab03bb8b5fd75c [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:18.901173 13587 raft_consensus.cc:515] T 30e88460611e47b2ba16a46a30b5f416 P cd75a17ab2604397adab03bb8b5fd75c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:18.891875 13446 raft_consensus.cc:493] T 7887766dc6784fcaa42b35c05fea7a99 P b7ab4784c7344b939bc36f639286f377 [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:18.904193 13446 raft_consensus.cc:3060] T 7887766dc6784fcaa42b35c05fea7a99 P b7ab4784c7344b939bc36f639286f377 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:21:18.883101 13481 raft_consensus.cc:493] T bb7fa124c3bf4ef9ab65a407cb008441 P cd75a17ab2604397adab03bb8b5fd75c [term 18 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
W20260709 13:21:18.912185  6847 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:21:18.912842 13481 raft_consensus.cc:515] T bb7fa124c3bf4ef9ab65a407cb008441 P cd75a17ab2604397adab03bb8b5fd75c [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:21:18.916620 13585 leader_election.cc:290] T 4f00a2e87e56452083b759f60d461ee3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:21:18.916519 13584 raft_consensus.cc:493] T 7ba5dac66ab5497e9e336f2a3c28cda5 P cd75a17ab2604397adab03bb8b5fd75c [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 7ba59cc884714e8aa5f3f0ecaed84cbb)
I20260709 13:21:18.917564 13584 raft_consensus.cc:515] T 7ba5dac66ab5497e9e336f2a3c28cda5 P cd75a17ab2604397adab03bb8b5fd75c [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
W20260709 13:21:18.918453 13575 log.cc:927] Time spent T 9b3759de40694069b13c0f8bd40e5709 P cd75a17ab2604397adab03bb8b5fd75c: Append to log took a long time: real 0.075s	user 0.000s	sys 0.000s
I20260709 13:21:18.915689 13481 leader_election.cc:290] T bb7fa124c3bf4ef9ab65a407cb008441 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:21:18.916090 13587 leader_election.cc:290] T 30e88460611e47b2ba16a46a30b5f416 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:21:18.812129 13295 raft_consensus.cc:515] T ab432e62819d499eaaf3dd55481dd930 P b7ab4784c7344b939bc36f639286f377 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:18.848830 13222 raft_consensus.cc:515] T 1528ab62b6fe4e3099d08f141afee116 P b7ab4784c7344b939bc36f639286f377 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:21:18.939292 13026 leader_election.cc:290] T 4275cf08e63345f993bce8664eada830 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:21:18.940058 12863 consensus_queue.cc:1048] T ab432e62819d499eaaf3dd55481dd930 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 9, Time since last communication: 0.001s
W20260709 13:21:18.940441 13573 log.cc:927] Time spent T d8292e16e5654be6bc408560cf256aaa P ccd8a4c3bfe3413cb2ae219b09aea832: Append to log took a long time: real 0.500s	user 0.000s	sys 0.003s
I20260709 13:21:18.944972 13289 raft_consensus.cc:3060] T 17587d6730594da4a56fa13a353232a1 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 24 FOLLOWER]: Advancing to term 25
W20260709 13:21:18.945470  6772 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 68348.1us
I20260709 13:21:18.950664 13222 leader_election.cc:290] T 1528ab62b6fe4e3099d08f141afee116 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 17 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:21:18.950760  6806 raft_consensus.cc:1240] T 1528ab62b6fe4e3099d08f141afee116 P b7ab4784c7344b939bc36f639286f377 [term 17 FOLLOWER]: Rejecting Update request from peer 7ba59cc884714e8aa5f3f0ecaed84cbb for earlier term 16. Current term is 17. Ops: []
W20260709 13:21:18.953890 13567 log.cc:927] Time spent T 3fa34c08b205435dba97346991aa1f92 P cd75a17ab2604397adab03bb8b5fd75c: Append to log took a long time: real 0.646s	user 0.006s	sys 0.003s
I20260709 13:21:18.922315 13584 leader_election.cc:290] T 7ba5dac66ab5497e9e336f2a3c28cda5 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:21:18.931411 13545 leader_election.cc:290] T 1bf4668eeb70467fb3dc5a0289233b3c P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 17 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
W20260709 13:21:18.937242 13546 consensus_meta.cc:287] T be1a92657f494cac8dd227d152f50151 P 7ba59cc884714e8aa5f3f0ecaed84cbb: Time spent flushing consensus metadata: real 0.605s	user 0.013s	sys 0.002s
I20260709 13:21:18.961067 13546 raft_consensus.cc:2749] T be1a92657f494cac8dd227d152f50151 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 22 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:21:18.963809  6697 leader_election.cc:304] T f5be3a11b23d4ea9b08300a2789821c7 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:21:18.967404  6697 leader_election.cc:304] T 4b8cacb381b746da8d0049b0a83b41dd P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:21:18.967649 13364 raft_consensus.cc:2749] T f5be3a11b23d4ea9b08300a2789821c7 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:21:18.968520  6844 leader_election.cc:304] T 427c124d773f483294511e80fe340075 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, b7ab4784c7344b939bc36f639286f377
W20260709 13:21:18.970510 13447 consensus_meta.cc:287] T 20f6842e26174571996b8dea4151d4be P b7ab4784c7344b939bc36f639286f377: Time spent flushing consensus metadata: real 0.565s	user 0.012s	sys 0.000s
I20260709 13:21:18.971220  6801 raft_consensus.cc:2468] T 20f6842e26174571996b8dea4151d4be P b7ab4784c7344b939bc36f639286f377 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 21.
I20260709 13:21:18.975610  6801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "853ac0a8cbd64ce99457f170216d4d0f" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:21:18.976315 13441 raft_consensus.cc:493] T 853ac0a8cbd64ce99457f170216d4d0f P cd75a17ab2604397adab03bb8b5fd75c [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:18.976629  6801 raft_consensus.cc:2468] T 853ac0a8cbd64ce99457f170216d4d0f P b7ab4784c7344b939bc36f639286f377 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 16.
I20260709 13:21:18.977087 13441 raft_consensus.cc:515] T 853ac0a8cbd64ce99457f170216d4d0f P cd75a17ab2604397adab03bb8b5fd75c [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
W20260709 13:21:18.978792  6622 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:53234 (request call id 173) took 47420 ms (client timeout 15000 ms). Trace:
I20260709 13:21:18.979382 13441 leader_election.cc:290] T 853ac0a8cbd64ce99457f170216d4d0f P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:21:18.983579 13295 leader_election.cc:290] T ab432e62819d499eaaf3dd55481dd930 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:21:18.985869  6800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de3186201e1a40d0b335eeb8b4e256e0" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:21:18.962353  6772 leader_election.cc:304] T 427c124d773f483294511e80fe340075 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:21:18.988471  6800 raft_consensus.cc:1275] T d8292e16e5654be6bc408560cf256aaa P b7ab4784c7344b939bc36f639286f377 [term 19 FOLLOWER]: Refusing update from remote peer ccd8a4c3bfe3413cb2ae219b09aea832: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
I20260709 13:21:18.988627 13446 raft_consensus.cc:515] T 7887766dc6784fcaa42b35c05fea7a99 P b7ab4784c7344b939bc36f639286f377 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:18.990113  6806 raft_consensus.cc:1275] T d33d5ee8ef6f415593d8df52063161ad P b7ab4784c7344b939bc36f639286f377 [term 18 FOLLOWER]: Refusing update from remote peer ccd8a4c3bfe3413cb2ae219b09aea832: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
I20260709 13:21:18.990388  6728 raft_consensus.cc:1240] T 30e88460611e47b2ba16a46a30b5f416 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 15 LEADER]: Rejecting Update request from peer cd75a17ab2604397adab03bb8b5fd75c for earlier term 14. Current term is 15. Ops: []
I20260709 13:21:18.991297 13446 leader_election.cc:290] T 7887766dc6784fcaa42b35c05fea7a99 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 23 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:21:18.992027 13446 raft_consensus.cc:2749] T 427c124d773f483294511e80fe340075 P b7ab4784c7344b939bc36f639286f377 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:21:18.993290  6844 leader_election.cc:304] T bd6869f07b5a4885a0b99fbe60c3b175 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:21:18.995431 13264 raft_consensus.cc:2749] T 427c124d773f483294511e80fe340075 P cd75a17ab2604397adab03bb8b5fd75c [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:21:18.996250 13584 consensus_queue.cc:1059] T d33d5ee8ef6f415593d8df52063161ad P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:21:18.991853  6732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c44c4849aa54f2b94d1f1bef9ed546f" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:21:18.996922  6800 raft_consensus.cc:1275] T f09c2a98de1a4decabd0ff900dd44caa P b7ab4784c7344b939bc36f639286f377 [term 20 FOLLOWER]: Refusing update from remote peer ccd8a4c3bfe3413cb2ae219b09aea832: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
I20260709 13:21:18.997215 13584 raft_consensus.cc:2804] T bd6869f07b5a4885a0b99fbe60c3b175 P cd75a17ab2604397adab03bb8b5fd75c [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:21:18.997658 13584 raft_consensus.cc:493] T bd6869f07b5a4885a0b99fbe60c3b175 P cd75a17ab2604397adab03bb8b5fd75c [term 20 FOLLOWER]: Starting leader election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:21:18.998040 13584 raft_consensus.cc:3060] T bd6869f07b5a4885a0b99fbe60c3b175 P cd75a17ab2604397adab03bb8b5fd75c [term 20 FOLLOWER]: Advancing to term 21
W20260709 13:21:18.999797  6773 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:21:19.000347 13588 raft_consensus.cc:3055] T d33d5ee8ef6f415593d8df52063161ad P cd75a17ab2604397adab03bb8b5fd75c [term 17 LEADER]: Stepping down as leader of term 17
W20260709 13:21:19.000826  6773 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:21:18.996435  6727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b3759de40694069b13c0f8bd40e5709" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:21:19.000743 13588 raft_consensus.cc:740] T d33d5ee8ef6f415593d8df52063161ad P cd75a17ab2604397adab03bb8b5fd75c [term 17 LEADER]: Becoming Follower/Learner. State: Replica: cd75a17ab2604397adab03bb8b5fd75c, State: Running, Role: LEADER
I20260709 13:21:19.002333 13588 consensus_queue.cc:260] T d33d5ee8ef6f415593d8df52063161ad P cd75a17ab2604397adab03bb8b5fd75c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 17.10, Last appended by leader: 10, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:19.003232 13554 raft_consensus.cc:493] T 7ba5dac66ab5497e9e336f2a3c28cda5 P b7ab4784c7344b939bc36f639286f377 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:19.003499  6731 raft_consensus.cc:1240] T a1704639a875409b9959353527b3fd68 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 22 FOLLOWER]: Rejecting Update request from peer cd75a17ab2604397adab03bb8b5fd75c for earlier term 21. Current term is 22. Ops: [21.13-21.13]
I20260709 13:21:19.003872 13554 raft_consensus.cc:515] T 7ba5dac66ab5497e9e336f2a3c28cda5 P b7ab4784c7344b939bc36f639286f377 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:21:19.005888  6731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a734b5ab7834e05a8c422208acc58b1" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:21:19.006613  6731 raft_consensus.cc:2468] T 7a734b5ab7834e05a8c422208acc58b1 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 20.
I20260709 13:21:19.006902 13554 leader_election.cc:290] T 7ba5dac66ab5497e9e336f2a3c28cda5 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:21:19.007115  6727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab432e62819d499eaaf3dd55481dd930" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 23 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:21:19.007499  6732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20f6842e26174571996b8dea4151d4be" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:21:19.003746 13588 raft_consensus.cc:3060] T d33d5ee8ef6f415593d8df52063161ad P cd75a17ab2604397adab03bb8b5fd75c [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:21:19.008329  6732 raft_consensus.cc:2393] T 20f6842e26174571996b8dea4151d4be P ccd8a4c3bfe3413cb2ae219b09aea832 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c in current term 21: Already voted for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in this term.
I20260709 13:21:19.008531  6806 raft_consensus.cc:1275] T 7a734b5ab7834e05a8c422208acc58b1 P b7ab4784c7344b939bc36f639286f377 [term 20 FOLLOWER]: Refusing update from remote peer 7ba59cc884714e8aa5f3f0ecaed84cbb: Log matching property violated. Preceding OpId in replica: term: 19 index: 10. Preceding OpId from leader: term: 20 index: 11. (index mismatch)
I20260709 13:21:19.011775  6728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3022224cc81473690653a83d4e99470" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 22 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
W20260709 13:21:18.979332  6622 rpcz_store.cc:269] 0709 13:20:31.557866 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:31.558129 (+   263us) service_pool.cc:224] Handling call
0709 13:21:18.978531 (+47420402us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:21:10.562513 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:21:10.597054 (+ 34541us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:21:10.597112 (+    58us) write_op.cc:435] Acquired schema lock
0709 13:21:10.597133 (+    21us) tablet.cc:662] Decoding operations
0709 13:21:10.598598 (+  1465us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:21:10.598698 (+   100us) write_op.cc:641] Partition lock acquired for write op
0709 13:21:10.598727 (+    29us) tablet.cc:685] Acquiring locks for 16 operations
0709 13:21:10.599982 (+  1255us) tablet.cc:701] Row locks acquired
0709 13:21:10.612912 (+ 12930us) write_op.cc:260] PREPARE: finished
0709 13:21:10.657068 (+ 44156us) write_op.cc:270] Start()
0709 13:21:10.741784 (+ 84716us) write_op.cc:276] Timestamp: P: 1783603270651760 usec, L: 0
0709 13:21:10.745389 (+  3605us) op_driver.cc:348] REPLICATION: starting
0709 13:21:10.953403 (+208014us) log.cc:844] Serialized 6308 byte log entry
0709 13:21:11.314073 (+360670us) spinlock_profiling.cc:243] Waited 13.6 ms on lock 0x7b4400022b4c. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0c745db1 00007fcc0c7e3c85 00007fcc0c7e46a2 00007fcc0f5561db 00007fcc0f551aaf 00007fcc0c8a00ac 00007fcc156faab9 00007fcc0c8bc69b 00007fcc0c8ba93f 00007fcc0c8bcc02 00007fcc0f54420b
0709 13:21:11.617126 (+303053us) spinlock_profiling.cc:243] Waited 29.7 ms on lock 0x7b5400156154. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f9a5e28 00007fcc133e0581 00007fcc133dfd58 00007fcc133e49f1 00007fcc133e49a9 00007fcc133e4939 00007fcc133e4901 00007fcc133e3b2d 000000000038f354 000000000038f199
0709 13:21:12.096946 (+479820us) op_driver.cc:464] REPLICATION: finished
0709 13:21:12.624943 (+527997us) write_op.cc:301] APPLY: starting
0709 13:21:12.625051 (+   108us) tablet.cc:1367] starting BulkCheckPresence
0709 13:21:12.910108 (+285057us) tablet.cc:1370] finished BulkCheckPresence
0709 13:21:12.910173 (+    65us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:21:13.465020 (+554847us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:21:13.465319 (+   299us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=32,key_file_lookups=32,delta_file_lookups=32,mrs_lookups=0
0709 13:21:13.465363 (+    44us) write_op.cc:312] APPLY: finished
0709 13:21:13.465693 (+   330us) log.cc:844] Serialized 147 byte log entry
0709 13:21:13.642176 (+176483us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:21:13.672976 (+ 30800us) write_op.cc:454] Released schema lock
0709 13:21:13.679145 (+  6169us) write_op.cc:341] FINISH: Updating metrics
0709 13:21:13.701142 (+ 21997us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:21:13.701188 (+    46us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":465367,"reported_tablets":55,"child_traces":[["op",{"apply.queue_time_us":499764,"apply.run_cpu_time_us":74949,"apply.run_wall_time_us":1076109,"cfile_cache_hit":66,"cfile_cache_hit_bytes":70943,"num_ops":16,"prepare.queue_time_us":310808,"prepare.run_cpu_time_us":35660,"prepare.run_wall_time_us":1080007,"raft.queue_time_us":396083,"raft.run_cpu_time_us":17452,"raft.run_wall_time_us":483156,"replication_time_us":1318850,"spinlock_wait_cycles":99589120,"thread_start_us":1258074,"threads_started":5,"wal-append.queue_time_us":854981,"wal-append.run_cpu_time_us":33214,"wal-append.run_wall_time_us":2449429}]]}
I20260709 13:21:19.032265  6844 leader_election.cc:304] T d8cee0accdb8499c86d4414b72565a38 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, b7ab4784c7344b939bc36f639286f377
I20260709 13:21:19.034608  6844 leader_election.cc:400] T f09c2a98de1a4decabd0ff900dd44caa P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 19 pre-election: Vote denied by peer b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817) with higher term. Message: Invalid argument: T f09c2a98de1a4decabd0ff900dd44caa P b7ab4784c7344b939bc36f639286f377 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c for earlier term 19. Current term is 20.
I20260709 13:21:19.034955  6844 leader_election.cc:403] T f09c2a98de1a4decabd0ff900dd44caa P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 19 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:21:19.035706 13441 raft_consensus.cc:493] T f03d0dbf16864ca4bc1bb5e4c0334c0f P cd75a17ab2604397adab03bb8b5fd75c [term 19 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:21:19.036693 13441 raft_consensus.cc:515] T f03d0dbf16864ca4bc1bb5e4c0334c0f P cd75a17ab2604397adab03bb8b5fd75c [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:19.039077 13481 raft_consensus.cc:493] T 2c240553ce044eedb41541d72b9475d7 P cd75a17ab2604397adab03bb8b5fd75c [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:19.039950 13481 raft_consensus.cc:515] T 2c240553ce044eedb41541d72b9475d7 P cd75a17ab2604397adab03bb8b5fd75c [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:19.042979 13481 leader_election.cc:290] T 2c240553ce044eedb41541d72b9475d7 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:21:19.036211  6772 leader_election.cc:304] T 3411566abe2d4c9bb4b2adfdd05e6f17 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:21:19.047892  7503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb7fa124c3bf4ef9ab65a407cb008441" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:21:19.048198  6878 raft_consensus.cc:1275] T f09c2a98de1a4decabd0ff900dd44caa P cd75a17ab2604397adab03bb8b5fd75c [term 20 FOLLOWER]: Refusing update from remote peer ccd8a4c3bfe3413cb2ae219b09aea832: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
I20260709 13:21:19.049669  6875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de3186201e1a40d0b335eeb8b4e256e0" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:21:19.050416  6875 raft_consensus.cc:2468] T de3186201e1a40d0b335eeb8b4e256e0 P cd75a17ab2604397adab03bb8b5fd75c [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 19.
I20260709 13:21:19.046216 13545 raft_consensus.cc:493] T 3411566abe2d4c9bb4b2adfdd05e6f17 P cd75a17ab2604397adab03bb8b5fd75c [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:19.053865  7494 raft_consensus.cc:1275] T 4b8cacb381b746da8d0049b0a83b41dd P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 20 FOLLOWER]: Refusing update from remote peer cd75a17ab2604397adab03bb8b5fd75c: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 20 index: 15. (index mismatch)
I20260709 13:21:19.054294 13545 raft_consensus.cc:515] T 3411566abe2d4c9bb4b2adfdd05e6f17 P cd75a17ab2604397adab03bb8b5fd75c [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
W20260709 13:21:19.055518  6697 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 88263.8us
I20260709 13:21:19.051735  6877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "853ac0a8cbd64ce99457f170216d4d0f" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:21:19.043704 13481 raft_consensus.cc:493] T e31b9971c15848dea59d4d4130141d9e P cd75a17ab2604397adab03bb8b5fd75c [term 17 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:21:19.056293 13347 raft_consensus.cc:493] T f58dc08b12a2494bb9a1372837970ca2 P cd75a17ab2604397adab03bb8b5fd75c [term 18 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:21:19.058775 13447 raft_consensus.cc:2749] T 3411566abe2d4c9bb4b2adfdd05e6f17 P b7ab4784c7344b939bc36f639286f377 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:21:19.061280  7503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ba5dac66ab5497e9e336f2a3c28cda5" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
W20260709 13:21:19.062448  6695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 80805.2us
I20260709 13:21:19.057632  6877 raft_consensus.cc:2468] T 853ac0a8cbd64ce99457f170216d4d0f P cd75a17ab2604397adab03bb8b5fd75c [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 16.
I20260709 13:21:19.069293  6697 leader_election.cc:304] T 95a75bfe094d4bdc963aba3f08dfcd25 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:21:19.074710 13481 raft_consensus.cc:515] T e31b9971c15848dea59d4d4130141d9e P cd75a17ab2604397adab03bb8b5fd75c [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:19.075155 13545 leader_election.cc:290] T 3411566abe2d4c9bb4b2adfdd05e6f17 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:21:19.066509 13588 consensus_queue.cc:1059] T 4d9def8b32fd443aa94ab1420b06837b P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.011s
I20260709 13:21:19.076313 13588 consensus_queue.cc:1243] T 4d9def8b32fd443aa94ab1420b06837b P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Peer b7ab4784c7344b939bc36f639286f377 log is divergent from this leader: its last log entry 21.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 13:21:19.076823 13588 raft_consensus.cc:3055] T 4d9def8b32fd443aa94ab1420b06837b P cd75a17ab2604397adab03bb8b5fd75c [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:21:19.076977 13481 leader_election.cc:290] T e31b9971c15848dea59d4d4130141d9e P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:21:19.077175 13588 raft_consensus.cc:740] T 4d9def8b32fd443aa94ab1420b06837b P cd75a17ab2604397adab03bb8b5fd75c [term 20 LEADER]: Becoming Follower/Learner. State: Replica: cd75a17ab2604397adab03bb8b5fd75c, State: Running, Role: LEADER
I20260709 13:21:19.078158 13588 consensus_queue.cc:260] T 4d9def8b32fd443aa94ab1420b06837b P cd75a17ab2604397adab03bb8b5fd75c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 20.10, Last appended by leader: 10, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:19.079416 13588 raft_consensus.cc:3060] T 4d9def8b32fd443aa94ab1420b06837b P cd75a17ab2604397adab03bb8b5fd75c [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:21:19.081171 13441 leader_election.cc:290] T f03d0dbf16864ca4bc1bb5e4c0334c0f P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:21:19.082206  6844 leader_election.cc:304] T 7a734b5ab7834e05a8c422208acc58b1 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:21:19.083226  6844 leader_election.cc:304] T 4f00a2e87e56452083b759f60d461ee3 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, b7ab4784c7344b939bc36f639286f377
I20260709 13:21:19.084153 13545 raft_consensus.cc:2804] T 7a734b5ab7834e05a8c422208acc58b1 P cd75a17ab2604397adab03bb8b5fd75c [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:21:19.084592 13545 raft_consensus.cc:493] T 7a734b5ab7834e05a8c422208acc58b1 P cd75a17ab2604397adab03bb8b5fd75c [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:19.084961 13545 raft_consensus.cc:3060] T 7a734b5ab7834e05a8c422208acc58b1 P cd75a17ab2604397adab03bb8b5fd75c [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:21:19.093439 13273 raft_consensus.cc:493] T 4d9def8b32fd443aa94ab1420b06837b P ccd8a4c3bfe3413cb2ae219b09aea832 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:19.094359 13273 raft_consensus.cc:515] T 4d9def8b32fd443aa94ab1420b06837b P ccd8a4c3bfe3413cb2ae219b09aea832 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:19.064502 13264 raft_consensus.cc:2749] T d8cee0accdb8499c86d4414b72565a38 P cd75a17ab2604397adab03bb8b5fd75c [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:21:19.096622 13264 raft_consensus.cc:2749] T 4f00a2e87e56452083b759f60d461ee3 P cd75a17ab2604397adab03bb8b5fd75c [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:21:19.098740  7503 raft_consensus.cc:2468] T 7ba5dac66ab5497e9e336f2a3c28cda5 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 20.
I20260709 13:21:19.099493 13529 raft_consensus.cc:2749] T 95a75bfe094d4bdc963aba3f08dfcd25 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:21:19.100752  6846 leader_election.cc:304] T 7ba5dac66ab5497e9e336f2a3c28cda5 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:21:19.102171 13264 raft_consensus.cc:2804] T 7ba5dac66ab5497e9e336f2a3c28cda5 P cd75a17ab2604397adab03bb8b5fd75c [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:21:19.102705 13264 raft_consensus.cc:493] T 7ba5dac66ab5497e9e336f2a3c28cda5 P cd75a17ab2604397adab03bb8b5fd75c [term 19 FOLLOWER]: Starting leader election (detected failure of leader 7ba59cc884714e8aa5f3f0ecaed84cbb)
I20260709 13:21:19.103201 13264 raft_consensus.cc:3060] T 7ba5dac66ab5497e9e336f2a3c28cda5 P cd75a17ab2604397adab03bb8b5fd75c [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:21:19.103878 13347 raft_consensus.cc:515] T f58dc08b12a2494bb9a1372837970ca2 P cd75a17ab2604397adab03bb8b5fd75c [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:19.106246 13347 leader_election.cc:290] T f58dc08b12a2494bb9a1372837970ca2 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:21:19.056319 13364 raft_consensus.cc:2749] T 4b8cacb381b746da8d0049b0a83b41dd P ccd8a4c3bfe3413cb2ae219b09aea832 [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:21:19.103173 13529 consensus_queue.cc:1048] T d8292e16e5654be6bc408560cf256aaa P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:21:19.112898  6806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f00a2e87e56452083b759f60d461ee3" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
W20260709 13:21:19.113776  6770 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 250760us
I20260709 13:21:19.117184  6770 leader_election.cc:304] T b3f13b31a1f84f0d89d007eadd57924c P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:21:19.103497 13589 raft_consensus.cc:2749] T f09c2a98de1a4decabd0ff900dd44caa P cd75a17ab2604397adab03bb8b5fd75c [term 20 FOLLOWER]: Leader pre-election lost for term 19. Reason: Vote denied by peer b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817) with higher term. Message: Invalid argument: T f09c2a98de1a4decabd0ff900dd44caa P b7ab4784c7344b939bc36f639286f377 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c for earlier term 19. Current term is 20.
I20260709 13:21:19.122668  7466 leader_election.cc:304] T 404190ce4ce94cecbfcb6ea9d1dd8626 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:21:19.065384 13207 consensus_queue.cc:1048] T 9e326172347f45e99a0d482b5d8ef768 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.052s
W20260709 13:21:19.124568  6772 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 132483us
I20260709 13:21:19.072695 13587 consensus_queue.cc:1048] T 4b8cacb381b746da8d0049b0a83b41dd P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.049s
I20260709 13:21:19.139482 13546 raft_consensus.cc:2749] T 404190ce4ce94cecbfcb6ea9d1dd8626 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:21:19.126735 13441 raft_consensus.cc:493] T ce4f062dcd314d43a63ca74067cb5ee3 P cd75a17ab2604397adab03bb8b5fd75c [term 15 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:21:19.141199 13441 raft_consensus.cc:515] T ce4f062dcd314d43a63ca74067cb5ee3 P cd75a17ab2604397adab03bb8b5fd75c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:21:19.146746 13584 raft_consensus.cc:515] T bd6869f07b5a4885a0b99fbe60c3b175 P cd75a17ab2604397adab03bb8b5fd75c [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:19.126214 13446 raft_consensus.cc:2749] T b3f13b31a1f84f0d89d007eadd57924c P b7ab4784c7344b939bc36f639286f377 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:21:19.151417  6770 leader_election.cc:304] T 17587d6730594da4a56fa13a353232a1 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 25 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, ccd8a4c3bfe3413cb2ae219b09aea832
W20260709 13:21:19.167197  7466 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 46620.2us
W20260709 13:21:19.179755  6844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:21:19.181114  6844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:21:19.162307 13273 leader_election.cc:290] T 4d9def8b32fd443aa94ab1420b06837b P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:21:19.186064  7503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce4f062dcd314d43a63ca74067cb5ee3" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:21:19.158911 13447 consensus_queue.cc:1059] T be1a92657f494cac8dd227d152f50151 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: INVALID_TERM, Last received: 0.0, Next index: 16, Last known committed idx: 13, Time since last communication: 0.025s
I20260709 13:21:19.193969  6770 leader_election.cc:304] T a1704639a875409b9959353527b3fd68 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:21:19.191339 13593 raft_consensus.cc:2749] T 17587d6730594da4a56fa13a353232a1 P b7ab4784c7344b939bc36f639286f377 [term 25 FOLLOWER]: Leader election lost for term 25. Reason: could not achieve majority
I20260709 13:21:19.195547  6772 leader_election.cc:304] T 1bf4668eeb70467fb3dc5a0289233b3c P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
W20260709 13:21:19.196292  6845 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:21:19.179186 13441 leader_election.cc:290] T ce4f062dcd314d43a63ca74067cb5ee3 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
W20260709 13:21:19.203090 13456 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.542s	user 0.025s	sys 0.025s
I20260709 13:21:19.196555 13589 raft_consensus.cc:493] T f5be3a11b23d4ea9b08300a2789821c7 P cd75a17ab2604397adab03bb8b5fd75c [term 18 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
W20260709 13:21:19.205166 13456 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.549s	user 0.025s	sys 0.025s
I20260709 13:21:19.207746 13347 raft_consensus.cc:493] T 22ccee1b570c4ad3a57bd7aec085b1b4 P cd75a17ab2604397adab03bb8b5fd75c [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:19.224179 13545 raft_consensus.cc:515] T 7a734b5ab7834e05a8c422208acc58b1 P cd75a17ab2604397adab03bb8b5fd75c [term 21 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } attrs { replace: true } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:21:19.226799 13545 leader_election.cc:290] T 7a734b5ab7834e05a8c422208acc58b1 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 21 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:21:19.228359 13026 raft_consensus.cc:2749] T 1bf4668eeb70467fb3dc5a0289233b3c P b7ab4784c7344b939bc36f639286f377 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:21:19.229310  6878 raft_consensus.cc:1275] T 24ee15416e3145beaa1b8183453729a3 P cd75a17ab2604397adab03bb8b5fd75c [term 20 FOLLOWER]: Refusing update from remote peer 7ba59cc884714e8aa5f3f0ecaed84cbb: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 20 index: 13. (index mismatch)
I20260709 13:21:19.238827  6877 raft_consensus.cc:1240] T 7a734b5ab7834e05a8c422208acc58b1 P cd75a17ab2604397adab03bb8b5fd75c [term 21 FOLLOWER]: Rejecting Update request from peer 7ba59cc884714e8aa5f3f0ecaed84cbb for earlier term 20. Current term is 21. Ops: []
I20260709 13:21:19.244415  6875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f00a2e87e56452083b759f60d461ee3" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:21:19.245885 13579 consensus_queue.cc:1048] T 7a734b5ab7834e05a8c422208acc58b1 P 7ba59cc884714e8aa5f3f0ecaed84cbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.041s
I20260709 13:21:19.249007 13264 raft_consensus.cc:515] T 7ba5dac66ab5497e9e336f2a3c28cda5 P cd75a17ab2604397adab03bb8b5fd75c [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:21:19.254397 13589 raft_consensus.cc:515] T f5be3a11b23d4ea9b08300a2789821c7 P cd75a17ab2604397adab03bb8b5fd75c [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:19.257807 13584 leader_election.cc:290] T bd6869f07b5a4885a0b99fbe60c3b175 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 21 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
W20260709 13:21:19.259140  6698 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:21:19.210489 13546 consensus_queue.cc:1059] T 1528ab62b6fe4e3099d08f141afee116 P 7ba59cc884714e8aa5f3f0ecaed84cbb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: INVALID_TERM, Last received: 16.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.051s
I20260709 13:21:19.263937  6844 leader_election.cc:304] T 3d65025eea89441290d85dd053810e31 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
W20260709 13:21:19.266198  6695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 164102us
I20260709 13:21:19.266956  7494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a734b5ab7834e05a8c422208acc58b1" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb"
I20260709 13:21:19.261021 13593 raft_consensus.cc:2804] T a1704639a875409b9959353527b3fd68 P b7ab4784c7344b939bc36f639286f377 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:21:19.273785 13584 raft_consensus.cc:2749] T 3d65025eea89441290d85dd053810e31 P cd75a17ab2604397adab03bb8b5fd75c [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:21:19.280094 13273 consensus_queue.cc:1048] T f09c2a98de1a4decabd0ff900dd44caa P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.006s
I20260709 13:21:19.260166 13347 raft_consensus.cc:515] T 22ccee1b570c4ad3a57bd7aec085b1b4 P cd75a17ab2604397adab03bb8b5fd75c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:19.282963 13347 leader_election.cc:290] T 22ccee1b570c4ad3a57bd7aec085b1b4 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:21:19.283564 13589 leader_election.cc:290] T f5be3a11b23d4ea9b08300a2789821c7 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:21:19.285589 13425 raft_consensus.cc:3055] T a1704639a875409b9959353527b3fd68 P cd75a17ab2604397adab03bb8b5fd75c [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:21:19.286235 13425 raft_consensus.cc:740] T a1704639a875409b9959353527b3fd68 P cd75a17ab2604397adab03bb8b5fd75c [term 21 LEADER]: Becoming Follower/Learner. State: Replica: cd75a17ab2604397adab03bb8b5fd75c, State: Running, Role: LEADER
I20260709 13:21:19.286509 13593 raft_consensus.cc:697] T a1704639a875409b9959353527b3fd68 P b7ab4784c7344b939bc36f639286f377 [term 22 LEADER]: Becoming Leader. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
I20260709 13:21:19.287690 13593 consensus_queue.cc:237] T a1704639a875409b9959353527b3fd68 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.12, Last appended by leader: 12, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:19.288599 13289 raft_consensus.cc:3055] T 1528ab62b6fe4e3099d08f141afee116 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:21:19.289233 13289 raft_consensus.cc:740] T 1528ab62b6fe4e3099d08f141afee116 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 7ba59cc884714e8aa5f3f0ecaed84cbb, State: Running, Role: LEADER
I20260709 13:21:19.290239 13289 consensus_queue.cc:260] T 1528ab62b6fe4e3099d08f141afee116 P 7ba59cc884714e8aa5f3f0ecaed84cbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:21:19.291672 13289 raft_consensus.cc:3060] T 1528ab62b6fe4e3099d08f141afee116 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:21:19.292567 13295 raft_consensus.cc:3055] T be1a92657f494cac8dd227d152f50151 P b7ab4784c7344b939bc36f639286f377 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:21:19.293016 13295 raft_consensus.cc:740] T be1a92657f494cac8dd227d152f50151 P b7ab4784c7344b939bc36f639286f377 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
I20260709 13:21:19.294001 13295 consensus_queue.cc:260] T be1a92657f494cac8dd227d152f50151 P b7ab4784c7344b939bc36f639286f377 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 21.16, Last appended by leader: 16, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:21:19.295320 13295 raft_consensus.cc:3060] T be1a92657f494cac8dd227d152f50151 P b7ab4784c7344b939bc36f639286f377 [term 21 FOLLOWER]: Advancing to term 22
W20260709 13:21:19.300446  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 76758.1us
W20260709 13:21:19.303462  6697 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 242823us
I20260709 13:21:19.307451  6697 leader_election.cc:304] T 7887766dc6784fcaa42b35c05fea7a99 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:21:19.308363  6844 leader_election.cc:304] T e77e330a82df4b43a745d57a68f6f057 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:21:19.320631  6727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de3186201e1a40d0b335eeb8b4e256e0" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:21:19.320827  6732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90d42e216d9741e190bca19a781291fd" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:21:19.321323  6727 raft_consensus.cc:2468] T de3186201e1a40d0b335eeb8b4e256e0 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 19.
I20260709 13:21:19.324302 13347 raft_consensus.cc:2749] T e77e330a82df4b43a745d57a68f6f057 P cd75a17ab2604397adab03bb8b5fd75c [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:21:19.325614 13347 consensus_queue.cc:1048] T 7887766dc6784fcaa42b35c05fea7a99 P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Connected to new peer: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:21:19.287464 13425 consensus_queue.cc:260] T a1704639a875409b9959353527b3fd68 P cd75a17ab2604397adab03bb8b5fd75c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 21.13, Last appended by leader: 13, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:19.315222  7500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ba5dac66ab5497e9e336f2a3c28cda5" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb"
I20260709 13:21:19.328105 13425 raft_consensus.cc:3060] T a1704639a875409b9959353527b3fd68 P cd75a17ab2604397adab03bb8b5fd75c [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:21:19.329339 13597 raft_consensus.cc:2749] T 7887766dc6784fcaa42b35c05fea7a99 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:21:19.331014 13347 consensus_queue.cc:1059] T d8292e16e5654be6bc408560cf256aaa P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:21:19.332346 13589 raft_consensus.cc:3055] T d8292e16e5654be6bc408560cf256aaa P cd75a17ab2604397adab03bb8b5fd75c [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:21:19.332775 13589 raft_consensus.cc:740] T d8292e16e5654be6bc408560cf256aaa P cd75a17ab2604397adab03bb8b5fd75c [term 18 LEADER]: Becoming Follower/Learner. State: Replica: cd75a17ab2604397adab03bb8b5fd75c, State: Running, Role: LEADER
I20260709 13:21:19.333909 13589 consensus_queue.cc:260] T d8292e16e5654be6bc408560cf256aaa P cd75a17ab2604397adab03bb8b5fd75c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.11, Last appended by leader: 11, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:19.335616 13589 raft_consensus.cc:3060] T d8292e16e5654be6bc408560cf256aaa P cd75a17ab2604397adab03bb8b5fd75c [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:21:19.338738  6695 leader_election.cc:304] T 853ac0a8cbd64ce99457f170216d4d0f P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
I20260709 13:21:19.314342 13264 leader_election.cc:290] T 7ba5dac66ab5497e9e336f2a3c28cda5 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 20 election: Requested vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:21:19.320009  6728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34f36d59d88f40fe8a2805e604fc6c0a" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
W20260709 13:21:19.360491  6695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 85291.2us
I20260709 13:21:19.361224  6844 leader_election.cc:304] T 8c7f33e544204fbaac4078e3e83bbf4e P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:21:19.362318  7500 raft_consensus.cc:2468] T 7ba5dac66ab5497e9e336f2a3c28cda5 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 20.
I20260709 13:21:19.366838  6724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f58dc08b12a2494bb9a1372837970ca2" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:21:19.364204  6846 leader_election.cc:304] T 7ba5dac66ab5497e9e336f2a3c28cda5 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
W20260709 13:21:19.373003  6772 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 177526us
I20260709 13:21:19.374334  6772 leader_election.cc:304] T f3f9c2e2bf644115957398fe4c9459db P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:21:19.382464  6800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d9def8b32fd443aa94ab1420b06837b" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 22 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:21:19.388329  6732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30e88460611e47b2ba16a46a30b5f416" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
W20260709 13:21:19.392088  6697 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 84790.8us
I20260709 13:21:19.394018  6799 raft_consensus.cc:1275] T 4275cf08e63345f993bce8664eada830 P b7ab4784c7344b939bc36f639286f377 [term 18 FOLLOWER]: Refusing update from remote peer ccd8a4c3bfe3413cb2ae219b09aea832: Log matching property violated. Preceding OpId in replica: term: 17 index: 9. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
I20260709 13:21:19.396263 13594 raft_consensus.cc:2804] T 7ba5dac66ab5497e9e336f2a3c28cda5 P cd75a17ab2604397adab03bb8b5fd75c [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:21:19.397006 13594 raft_consensus.cc:697] T 7ba5dac66ab5497e9e336f2a3c28cda5 P cd75a17ab2604397adab03bb8b5fd75c [term 20 LEADER]: Becoming Leader. State: Replica: cd75a17ab2604397adab03bb8b5fd75c, State: Running, Role: LEADER
I20260709 13:21:19.398290 13594 consensus_queue.cc:237] T 7ba5dac66ab5497e9e336f2a3c28cda5 P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.14, Last appended by leader: 14, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:21:19.401278 13273 raft_consensus.cc:493] T dbdf895bba214ff68685a24fd17dfb5d P ccd8a4c3bfe3413cb2ae219b09aea832 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader cd75a17ab2604397adab03bb8b5fd75c)
I20260709 13:21:19.391588 13264 raft_consensus.cc:2749] T 8c7f33e544204fbaac4078e3e83bbf4e P cd75a17ab2604397adab03bb8b5fd75c [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:21:19.402015 13273 raft_consensus.cc:515] T dbdf895bba214ff68685a24fd17dfb5d P ccd8a4c3bfe3413cb2ae219b09aea832 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:19.389421 13601 raft_consensus.cc:2804] T f3f9c2e2bf644115957398fe4c9459db P b7ab4784c7344b939bc36f639286f377 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:21:19.404516 13601 raft_consensus.cc:493] T f3f9c2e2bf644115957398fe4c9459db P b7ab4784c7344b939bc36f639286f377 [term 18 FOLLOWER]: Starting leader election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:21:19.404866 13273 leader_election.cc:290] T dbdf895bba214ff68685a24fd17dfb5d P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:21:19.404942 13601 raft_consensus.cc:3060] T f3f9c2e2bf644115957398fe4c9459db P b7ab4784c7344b939bc36f639286f377 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:21:19.405195  6724 raft_consensus.cc:2393] T f58dc08b12a2494bb9a1372837970ca2 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c in current term 19: Already voted for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in this term.
W20260709 13:21:19.421698  6770 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 227803us
I20260709 13:21:19.395434 13598 consensus_queue.cc:1048] T d33d5ee8ef6f415593d8df52063161ad P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.020s
W20260709 13:21:19.427780  6847 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:21:19.370119 13599 raft_consensus.cc:2804] T 853ac0a8cbd64ce99457f170216d4d0f P ccd8a4c3bfe3413cb2ae219b09aea832 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:21:19.430848 13599 raft_consensus.cc:493] T 853ac0a8cbd64ce99457f170216d4d0f P ccd8a4c3bfe3413cb2ae219b09aea832 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:19.431321 13599 raft_consensus.cc:3060] T 853ac0a8cbd64ce99457f170216d4d0f P ccd8a4c3bfe3413cb2ae219b09aea832 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:21:19.467080  6727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a485a995abc4807b6e511e45419f737" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:21:19.469563  6727 raft_consensus.cc:1275] T 7a734b5ab7834e05a8c422208acc58b1 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 20 FOLLOWER]: Refusing update from remote peer 7ba59cc884714e8aa5f3f0ecaed84cbb: Log matching property violated. Preceding OpId in replica: term: 19 index: 10. Preceding OpId from leader: term: 20 index: 11. (index mismatch)
I20260709 13:21:19.474037  6731 raft_consensus.cc:1275] T 4b8cacb381b746da8d0049b0a83b41dd P ccd8a4c3bfe3413cb2ae219b09aea832 [term 20 FOLLOWER]: Refusing update from remote peer cd75a17ab2604397adab03bb8b5fd75c: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 20 index: 15. (index mismatch)
W20260709 13:21:19.476507  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 49120.6us
I20260709 13:21:19.477056  6725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c240553ce044eedb41541d72b9475d7" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:21:19.477986  6725 raft_consensus.cc:2468] T 2c240553ce044eedb41541d72b9475d7 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 19.
I20260709 13:21:19.479215  6844 leader_election.cc:304] T 07a92dd554674067a83a9cb68c4773f2 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377
I20260709 13:21:19.479992  6728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bf4668eeb70467fb3dc5a0289233b3c" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:21:19.480201 13264 raft_consensus.cc:2804] T 07a92dd554674067a83a9cb68c4773f2 P cd75a17ab2604397adab03bb8b5fd75c [term 17 FOLLOWER]: Leader pre-election won for term 18
W20260709 13:21:19.480268  6772 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 70891.5us
I20260709 13:21:19.480734 13264 raft_consensus.cc:493] T 07a92dd554674067a83a9cb68c4773f2 P cd75a17ab2604397adab03bb8b5fd75c [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:19.481190 13264 raft_consensus.cc:3060] T 07a92dd554674067a83a9cb68c4773f2 P cd75a17ab2604397adab03bb8b5fd75c [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:21:19.465255  6723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "853ac0a8cbd64ce99457f170216d4d0f" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:21:19.481834  6772 leader_election.cc:304] T c4db81d9d329422bb3b4160ca4ac2d1d P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:21:19.485679  6772 leader_election.cc:304] T dbdf895bba214ff68685a24fd17dfb5d P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:21:19.488173 13027 raft_consensus.cc:2804] T c4db81d9d329422bb3b4160ca4ac2d1d P b7ab4784c7344b939bc36f639286f377 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:21:19.488819 13027 raft_consensus.cc:697] T c4db81d9d329422bb3b4160ca4ac2d1d P b7ab4784c7344b939bc36f639286f377 [term 20 LEADER]: Becoming Leader. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
I20260709 13:21:19.469633  6697 leader_election.cc:304] T f58dc08b12a2494bb9a1372837970ca2 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
W20260709 13:21:19.483649  6770 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 60989.5us
I20260709 13:21:19.491295  6770 leader_election.cc:304] T a3022224cc81473690653a83d4e99470 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:21:19.475824  6731 raft_consensus.cc:1275] T 24ee15416e3145beaa1b8183453729a3 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 20 FOLLOWER]: Refusing update from remote peer 7ba59cc884714e8aa5f3f0ecaed84cbb: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 20 index: 13. (index mismatch)
I20260709 13:21:19.483080  6730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f03d0dbf16864ca4bc1bb5e4c0334c0f" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:21:19.498569  6729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e31b9971c15848dea59d4d4130141d9e" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:21:19.506587  6872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a75bfe094d4bdc963aba3f08dfcd25" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:21:19.506939  6881 raft_consensus.cc:1275] T 2c240553ce044eedb41541d72b9475d7 P cd75a17ab2604397adab03bb8b5fd75c [term 19 FOLLOWER]: Refusing update from remote peer b7ab4784c7344b939bc36f639286f377: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 19 index: 11. (term mismatch)
I20260709 13:21:19.508301  6881 pending_rounds.cc:85] T 2c240553ce044eedb41541d72b9475d7 P cd75a17ab2604397adab03bb8b5fd75c: Aborting all ops after (but not including) 10
I20260709 13:21:19.508745  6881 pending_rounds.cc:107] T 2c240553ce044eedb41541d72b9475d7 P cd75a17ab2604397adab03bb8b5fd75c: Aborting uncommitted NO_OP operation due to leader change: 18.11
I20260709 13:21:19.508853  6726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3411566abe2d4c9bb4b2adfdd05e6f17" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:21:19.509047  6881 raft_consensus.cc:2889] T 2c240553ce044eedb41541d72b9475d7 P cd75a17ab2604397adab03bb8b5fd75c [term 19 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:21:19.504207 13584 raft_consensus.cc:493] T 24ee15416e3145beaa1b8183453729a3 P cd75a17ab2604397adab03bb8b5fd75c [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:19.510608 13584 raft_consensus.cc:515] T 24ee15416e3145beaa1b8183453729a3 P cd75a17ab2604397adab03bb8b5fd75c [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:21:19.497056 13554 raft_consensus.cc:2749] T a3022224cc81473690653a83d4e99470 P b7ab4784c7344b939bc36f639286f377 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:21:19.513691 13584 leader_election.cc:290] T 24ee15416e3145beaa1b8183453729a3 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:21:19.514838  6875 raft_consensus.cc:1275] T 4d9def8b32fd443aa94ab1420b06837b P cd75a17ab2604397adab03bb8b5fd75c [term 21 FOLLOWER]: Refusing update from remote peer b7ab4784c7344b939bc36f639286f377: Log matching property violated. Preceding OpId in replica: term: 20 index: 10. Preceding OpId from leader: term: 21 index: 11. (index mismatch)
I20260709 13:21:19.515620  7494 raft_consensus.cc:1275] T 404190ce4ce94cecbfcb6ea9d1dd8626 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 17 FOLLOWER]: Refusing update from remote peer b7ab4784c7344b939bc36f639286f377: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 13:21:19.515630 13598 raft_consensus.cc:2749] T f58dc08b12a2494bb9a1372837970ca2 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:21:19.508103  6877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30e88460611e47b2ba16a46a30b5f416" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:21:19.517078  6877 raft_consensus.cc:2468] T 30e88460611e47b2ba16a46a30b5f416 P cd75a17ab2604397adab03bb8b5fd75c [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 15.
I20260709 13:21:19.488831 13222 raft_consensus.cc:2749] T dbdf895bba214ff68685a24fd17dfb5d P b7ab4784c7344b939bc36f639286f377 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
W20260709 13:21:19.518584 13612 log.cc:927] Time spent T f3f9c2e2bf644115957398fe4c9459db P ccd8a4c3bfe3413cb2ae219b09aea832: Append to log took a long time: real 0.092s	user 0.003s	sys 0.000s
I20260709 13:21:19.497304 13207 consensus_queue.cc:1048] T 4275cf08e63345f993bce8664eada830 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.023s
I20260709 13:21:19.520218 13579 consensus_queue.cc:1048] T 7a734b5ab7834e05a8c422208acc58b1 P 7ba59cc884714e8aa5f3f0ecaed84cbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:21:19.492161 13027 consensus_queue.cc:237] T c4db81d9d329422bb3b4160ca4ac2d1d P b7ab4784c7344b939bc36f639286f377 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.10, Last appended by leader: 10, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
W20260709 13:21:19.525368  6697 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 55858.6us
I20260709 13:21:19.526892  6697 leader_election.cc:304] T f4b8bd455d5a47c18a1380839c6e0d61 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
W20260709 13:21:19.529745 13611 log.cc:927] Time spent T 9e326172347f45e99a0d482b5d8ef768 P b7ab4784c7344b939bc36f639286f377: Append to log took a long time: real 0.104s	user 0.001s	sys 0.000s
I20260709 13:21:19.529910  6728 raft_consensus.cc:2468] T 1bf4668eeb70467fb3dc5a0289233b3c P ccd8a4c3bfe3413cb2ae219b09aea832 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 17.
I20260709 13:21:19.515998  7500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24ee15416e3145beaa1b8183453729a3" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:21:19.532521 13289 consensus_queue.cc:1048] T 24ee15416e3145beaa1b8183453729a3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:21:19.515853  7498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a75bfe094d4bdc963aba3f08dfcd25" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:21:19.506669  6878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e326172347f45e99a0d482b5d8ef768" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:21:19.538409  6878 raft_consensus.cc:2468] T 9e326172347f45e99a0d482b5d8ef768 P cd75a17ab2604397adab03bb8b5fd75c [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 16.
W20260709 13:21:19.534528  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 55435.2us
I20260709 13:21:19.542620  7494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1528ab62b6fe4e3099d08f141afee116" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb"
I20260709 13:21:19.544494  6844 leader_election.cc:304] T c4db81d9d329422bb3b4160ca4ac2d1d P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:21:19.548859  6875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4275cf08e63345f993bce8664eada830" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:21:19.549678  6875 raft_consensus.cc:2468] T 4275cf08e63345f993bce8664eada830 P cd75a17ab2604397adab03bb8b5fd75c [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 18.
I20260709 13:21:19.552256  7494 raft_consensus.cc:2468] T 1528ab62b6fe4e3099d08f141afee116 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 17.
I20260709 13:21:19.566515  6878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7887766dc6784fcaa42b35c05fea7a99" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 23 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:21:19.553750 13597 raft_consensus.cc:3060] T f4b8bd455d5a47c18a1380839c6e0d61 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:21:19.575812  7503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ba5dac66ab5497e9e336f2a3c28cda5" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:21:19.576623  6875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab432e62819d499eaaf3dd55481dd930" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:21:19.578373  7503 raft_consensus.cc:2468] T 7ba5dac66ab5497e9e336f2a3c28cda5 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 20.
I20260709 13:21:19.582305  6875 raft_consensus.cc:2468] T ab432e62819d499eaaf3dd55481dd930 P cd75a17ab2604397adab03bb8b5fd75c [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 22.
I20260709 13:21:19.591146  6874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ba5dac66ab5497e9e336f2a3c28cda5" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:21:19.562417 13347 raft_consensus.cc:493] T 7c37d41cd9164c15a6826ca62a851a69 P cd75a17ab2604397adab03bb8b5fd75c [term 19 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
W20260709 13:21:19.612470  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 68087.8us
W20260709 13:21:19.593205  6771 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:21:19.596328 13545 raft_consensus.cc:493] T b56bf91d90824c959e21e0cee5ba1816 P cd75a17ab2604397adab03bb8b5fd75c [term 18 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:21:19.580230 13456 raft_consensus.cc:493] T 44bde925b2e541b69890d70715b85176 P cd75a17ab2604397adab03bb8b5fd75c [term 19 FOLLOWER]: Starting pre-election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:21:19.562176 13026 consensus_queue.cc:1048] T 2c240553ce044eedb41541d72b9475d7 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.030s
W20260709 13:21:19.601455  6697 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 74747us
I20260709 13:21:19.603683 13588 raft_consensus.cc:493] T bb3d8792045a4583ae2e965b1350a5b4 P cd75a17ab2604397adab03bb8b5fd75c [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 7ba59cc884714e8aa5f3f0ecaed84cbb)
I20260709 13:21:19.580917 13584 raft_consensus.cc:2749] T c4db81d9d329422bb3b4160ca4ac2d1d P cd75a17ab2604397adab03bb8b5fd75c [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:21:19.622303  6844 leader_election.cc:304] T 4275cf08e63345f993bce8664eada830 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:21:19.626385  6802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbdf895bba214ff68685a24fd17dfb5d" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 18 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:21:19.637909  6802 raft_consensus.cc:2393] T dbdf895bba214ff68685a24fd17dfb5d P b7ab4784c7344b939bc36f639286f377 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ccd8a4c3bfe3413cb2ae219b09aea832 in current term 18: Already voted for candidate b7ab4784c7344b939bc36f639286f377 in this term.
I20260709 13:21:19.623652 13456 raft_consensus.cc:515] T 44bde925b2e541b69890d70715b85176 P cd75a17ab2604397adab03bb8b5fd75c [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:19.649204  6697 leader_election.cc:304] T 3d65025eea89441290d85dd053810e31 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
W20260709 13:21:19.653847 13607 log.cc:927] Time spent T 00000000000000000000000000000000 P b3ae52d33b9a4273a42e5e2cf3b5d6b5: Append to log took a long time: real 0.071s	user 0.002s	sys 0.000s
I20260709 13:21:19.654515 13207 raft_consensus.cc:2749] T 3d65025eea89441290d85dd053810e31 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:21:19.634068 13588 raft_consensus.cc:515] T bb3d8792045a4583ae2e965b1350a5b4 P cd75a17ab2604397adab03bb8b5fd75c [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:21:19.656847  6844 leader_election.cc:304] T 22ccee1b570c4ad3a57bd7aec085b1b4 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:21:19.657720 13425 raft_consensus.cc:2804] T 22ccee1b570c4ad3a57bd7aec085b1b4 P cd75a17ab2604397adab03bb8b5fd75c [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:21:19.658350 13425 raft_consensus.cc:697] T 22ccee1b570c4ad3a57bd7aec085b1b4 P cd75a17ab2604397adab03bb8b5fd75c [term 15 LEADER]: Becoming Leader. State: Replica: cd75a17ab2604397adab03bb8b5fd75c, State: Running, Role: LEADER
I20260709 13:21:19.658813 13588 leader_election.cc:290] T bb3d8792045a4583ae2e965b1350a5b4 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:21:19.659278 13425 consensus_queue.cc:237] T 22ccee1b570c4ad3a57bd7aec085b1b4 P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:19.658705  6844 leader_election.cc:304] T 7c44c4849aa54f2b94d1f1bef9ed546f P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:21:19.663609 13456 leader_election.cc:290] T 44bde925b2e541b69890d70715b85176 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:21:19.661053  6697 leader_election.cc:304] T f03d0dbf16864ca4bc1bb5e4c0334c0f P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:21:19.621618 13347 raft_consensus.cc:515] T 7c37d41cd9164c15a6826ca62a851a69 P cd75a17ab2604397adab03bb8b5fd75c [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:19.661577 13599 raft_consensus.cc:515] T 853ac0a8cbd64ce99457f170216d4d0f P ccd8a4c3bfe3413cb2ae219b09aea832 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:19.639654 13545 raft_consensus.cc:515] T b56bf91d90824c959e21e0cee5ba1816 P cd75a17ab2604397adab03bb8b5fd75c [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:19.663478  7500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3d8792045a4583ae2e965b1350a5b4" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
W20260709 13:21:19.674664  6770 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 122501us
I20260709 13:21:19.641410 13264 raft_consensus.cc:515] T 07a92dd554674067a83a9cb68c4773f2 P cd75a17ab2604397adab03bb8b5fd75c [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:19.698348 13599 leader_election.cc:290] T 853ac0a8cbd64ce99457f170216d4d0f P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 17 election: Requested vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:21:19.697953 13601 raft_consensus.cc:515] T f3f9c2e2bf644115957398fe4c9459db P b7ab4784c7344b939bc36f639286f377 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:19.699262  6723 raft_consensus.cc:2393] T 853ac0a8cbd64ce99457f170216d4d0f P ccd8a4c3bfe3413cb2ae219b09aea832 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c in current term 17: Already voted for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in this term.
I20260709 13:21:19.700134  6726 raft_consensus.cc:1275] T 404190ce4ce94cecbfcb6ea9d1dd8626 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 17 FOLLOWER]: Refusing update from remote peer b7ab4784c7344b939bc36f639286f377: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 13:21:19.701064 13601 leader_election.cc:290] T f3f9c2e2bf644115957398fe4c9459db P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 19 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:21:19.701370  6798 raft_consensus.cc:1240] T f3f9c2e2bf644115957398fe4c9459db P b7ab4784c7344b939bc36f639286f377 [term 19 FOLLOWER]: Rejecting Update request from peer ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 18. Current term is 19. Ops: []
I20260709 13:21:19.643483 13594 raft_consensus.cc:2749] T 4275cf08e63345f993bce8664eada830 P cd75a17ab2604397adab03bb8b5fd75c [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:21:19.707491  6726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1528ab62b6fe4e3099d08f141afee116" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:21:19.712113  6877 raft_consensus.cc:1240] T 07a92dd554674067a83a9cb68c4773f2 P cd75a17ab2604397adab03bb8b5fd75c [term 18 FOLLOWER]: Rejecting Update request from peer b7ab4784c7344b939bc36f639286f377 for earlier term 17. Current term is 18. Ops: [17.10-17.10]
I20260709 13:21:19.723106  6728 raft_consensus.cc:1275] T 4d9def8b32fd443aa94ab1420b06837b P ccd8a4c3bfe3413cb2ae219b09aea832 [term 21 FOLLOWER]: Refusing update from remote peer b7ab4784c7344b939bc36f639286f377: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 21 index: 11. (index mismatch)
I20260709 13:21:19.724385  6727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7887766dc6784fcaa42b35c05fea7a99" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 23 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:21:19.725196  6727 raft_consensus.cc:3060] T 7887766dc6784fcaa42b35c05fea7a99 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:21:19.727022  6723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4275cf08e63345f993bce8664eada830" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
W20260709 13:21:19.736696  6845 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:21:19.737702  6729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab432e62819d499eaaf3dd55481dd930" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:21:19.711531 13456 raft_consensus.cc:2749] T 7c44c4849aa54f2b94d1f1bef9ed546f P cd75a17ab2604397adab03bb8b5fd75c [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:21:19.715588 13529 raft_consensus.cc:2749] T f03d0dbf16864ca4bc1bb5e4c0334c0f P ccd8a4c3bfe3413cb2ae219b09aea832 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 13:21:19.748052  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 89417.4us
I20260709 13:21:19.717916 13588 raft_consensus.cc:493] T fe20b4b48823486ca3b9c648db6ce8aa P cd75a17ab2604397adab03bb8b5fd75c [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 7ba59cc884714e8aa5f3f0ecaed84cbb)
I20260709 13:21:19.754010  6844 leader_election.cc:304] T 9b3759de40694069b13c0f8bd40e5709 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
W20260709 13:21:19.758562  6697 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 97635us
I20260709 13:21:19.758082  6802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "853ac0a8cbd64ce99457f170216d4d0f" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:21:19.760862  6802 raft_consensus.cc:3060] T 853ac0a8cbd64ce99457f170216d4d0f P b7ab4784c7344b939bc36f639286f377 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:21:19.753618 13597 raft_consensus.cc:2749] T f4b8bd455d5a47c18a1380839c6e0d61 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:21:19.778105  6805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de3186201e1a40d0b335eeb8b4e256e0" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:21:19.783506  6800 raft_consensus.cc:1240] T dbdf895bba214ff68685a24fd17dfb5d P b7ab4784c7344b939bc36f639286f377 [term 18 FOLLOWER]: Rejecting Update request from peer cd75a17ab2604397adab03bb8b5fd75c for earlier term 17. Current term is 18. Ops: []
I20260709 13:21:19.783646 13222 consensus_queue.cc:1048] T 404190ce4ce94cecbfcb6ea9d1dd8626 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:21:19.784720  6800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a485a995abc4807b6e511e45419f737" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:21:19.784942  6799 raft_consensus.cc:1240] T d8292e16e5654be6bc408560cf256aaa P b7ab4784c7344b939bc36f639286f377 [term 19 FOLLOWER]: Rejecting Update request from peer cd75a17ab2604397adab03bb8b5fd75c for earlier term 18. Current term is 19. Ops: [18.11-18.11]
I20260709 13:21:19.786132  6801 raft_consensus.cc:1240] T 7887766dc6784fcaa42b35c05fea7a99 P b7ab4784c7344b939bc36f639286f377 [term 23 FOLLOWER]: Rejecting Update request from peer cd75a17ab2604397adab03bb8b5fd75c for earlier term 22. Current term is 23. Ops: [22.12-22.12]
I20260709 13:21:19.786065  6798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34f36d59d88f40fe8a2805e604fc6c0a" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:21:19.786357  6806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90d42e216d9741e190bca19a781291fd" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:21:19.789980  6807 raft_consensus.cc:2955] T 95a75bfe094d4bdc963aba3f08dfcd25 P b7ab4784c7344b939bc36f639286f377 [term 16 FOLLOWER]: Committing config change with OpId 14.9: config changed from index 7 to 9, 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } attrs { replace: true } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } } }
I20260709 13:21:19.795228 13602 raft_consensus.cc:493] T f58dc08b12a2494bb9a1372837970ca2 P b7ab4784c7344b939bc36f639286f377 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:19.795852 13602 raft_consensus.cc:515] T f58dc08b12a2494bb9a1372837970ca2 P b7ab4784c7344b939bc36f639286f377 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:19.796977 13347 leader_election.cc:290] T 7c37d41cd9164c15a6826ca62a851a69 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:21:19.797963 13602 leader_election.cc:290] T f58dc08b12a2494bb9a1372837970ca2 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:21:19.799610 13545 leader_election.cc:290] T b56bf91d90824c959e21e0cee5ba1816 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:21:19.800110  6697 leader_election.cc:304] T 20f6842e26174571996b8dea4151d4be P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:21:19.763022 13456 raft_consensus.cc:2749] T 9b3759de40694069b13c0f8bd40e5709 P cd75a17ab2604397adab03bb8b5fd75c [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:21:19.756273 13588 raft_consensus.cc:515] T fe20b4b48823486ca3b9c648db6ce8aa P cd75a17ab2604397adab03bb8b5fd75c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:21:19.826828  6806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb7fa124c3bf4ef9ab65a407cb008441" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:21:19.831661  6805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30e88460611e47b2ba16a46a30b5f416" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:21:19.819061 13207 raft_consensus.cc:2749] T 20f6842e26174571996b8dea4151d4be P ccd8a4c3bfe3413cb2ae219b09aea832 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
W20260709 13:21:19.851384  6695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 96284.5us
I20260709 13:21:19.854507  6806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ba5dac66ab5497e9e336f2a3c28cda5" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:21:19.855600  6806 raft_consensus.cc:2393] T 7ba5dac66ab5497e9e336f2a3c28cda5 P b7ab4784c7344b939bc36f639286f377 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c in current term 20: Already voted for candidate b7ab4784c7344b939bc36f639286f377 in this term.
I20260709 13:21:19.858742  6805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bf4668eeb70467fb3dc5a0289233b3c" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:21:19.860985  6805 raft_consensus.cc:2393] T 1bf4668eeb70467fb3dc5a0289233b3c P b7ab4784c7344b939bc36f639286f377 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c in current term 17: Already voted for candidate b7ab4784c7344b939bc36f639286f377 in this term.
I20260709 13:21:19.852772 13264 leader_election.cc:290] T 07a92dd554674067a83a9cb68c4773f2 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 18 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:21:19.870736  6805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "853ac0a8cbd64ce99457f170216d4d0f" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:21:19.856254 13579 raft_consensus.cc:493] T ce4f062dcd314d43a63ca74067cb5ee3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 15 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:21:19.874598  6697 leader_election.cc:304] T 7c37d41cd9164c15a6826ca62a851a69 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377
W20260709 13:21:19.876196  6698 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:21:19.879992  6772 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.68:45071, user_credentials={real_user=slave}} blocked reactor thread for 97196.6us
I20260709 13:21:19.880899  6772 leader_election.cc:304] T 1528ab62b6fe4e3099d08f141afee116 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, b7ab4784c7344b939bc36f639286f377; no voters: 
W20260709 13:21:19.881763  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 44225.6us
I20260709 13:21:19.881091  6805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c240553ce044eedb41541d72b9475d7" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:21:19.883610  6844 leader_election.cc:304] T a3022224cc81473690653a83d4e99470 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:21:19.885066  6844 leader_election.cc:304] T de3186201e1a40d0b335eeb8b4e256e0 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:21:19.885848 13456 raft_consensus.cc:2749] T a3022224cc81473690653a83d4e99470 P cd75a17ab2604397adab03bb8b5fd75c [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:21:19.886894 13456 raft_consensus.cc:2804] T de3186201e1a40d0b335eeb8b4e256e0 P cd75a17ab2604397adab03bb8b5fd75c [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:21:19.887254  6844 leader_election.cc:304] T 2c240553ce044eedb41541d72b9475d7 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:21:19.888439 13545 consensus_queue.cc:1048] T 4b8cacb381b746da8d0049b0a83b41dd P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Connected to new peer: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:21:19.889127  6844 leader_election.cc:304] T 1bf4668eeb70467fb3dc5a0289233b3c P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:21:19.864146 13597 consensus_queue.cc:1048] T 30e88460611e47b2ba16a46a30b5f416 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.019s
I20260709 13:21:19.891021 13026 raft_consensus.cc:2804] T 1528ab62b6fe4e3099d08f141afee116 P b7ab4784c7344b939bc36f639286f377 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:21:19.891553 13026 raft_consensus.cc:697] T 1528ab62b6fe4e3099d08f141afee116 P b7ab4784c7344b939bc36f639286f377 [term 17 LEADER]: Becoming Leader. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
I20260709 13:21:19.891902 13588 leader_election.cc:290] T fe20b4b48823486ca3b9c648db6ce8aa P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:21:19.892297 13594 raft_consensus.cc:2804] T 1bf4668eeb70467fb3dc5a0289233b3c P cd75a17ab2604397adab03bb8b5fd75c [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:21:19.892975 13594 raft_consensus.cc:697] T 1bf4668eeb70467fb3dc5a0289233b3c P cd75a17ab2604397adab03bb8b5fd75c [term 17 LEADER]: Becoming Leader. State: Replica: cd75a17ab2604397adab03bb8b5fd75c, State: Running, Role: LEADER
I20260709 13:21:19.894058 13594 consensus_queue.cc:237] T 1bf4668eeb70467fb3dc5a0289233b3c P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:19.895853  6772 leader_election.cc:304] T 7ba5dac66ab5497e9e336f2a3c28cda5 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, b7ab4784c7344b939bc36f639286f377; no voters: 
I20260709 13:21:19.896742 13615 raft_consensus.cc:2804] T 7ba5dac66ab5497e9e336f2a3c28cda5 P b7ab4784c7344b939bc36f639286f377 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:21:19.897128 13615 raft_consensus.cc:493] T 7ba5dac66ab5497e9e336f2a3c28cda5 P b7ab4784c7344b939bc36f639286f377 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:19.897560 13615 raft_consensus.cc:3060] T 7ba5dac66ab5497e9e336f2a3c28cda5 P b7ab4784c7344b939bc36f639286f377 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:21:19.898329  7503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe20b4b48823486ca3b9c648db6ce8aa" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:21:19.899577  6798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f58dc08b12a2494bb9a1372837970ca2" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:21:19.900424  6798 raft_consensus.cc:2468] T f58dc08b12a2494bb9a1372837970ca2 P b7ab4784c7344b939bc36f639286f377 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 19.
I20260709 13:21:19.878907 13579 raft_consensus.cc:515] T ce4f062dcd314d43a63ca74067cb5ee3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:21:19.892556 13026 consensus_queue.cc:237] T 1528ab62b6fe4e3099d08f141afee116 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:21:19.905838  6726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f9c2e2bf644115957398fe4c9459db" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:21:19.909260  6806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f03d0dbf16864ca4bc1bb5e4c0334c0f" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:21:19.910189  6877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f9c2e2bf644115957398fe4c9459db" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:21:19.910809  6877 raft_consensus.cc:3060] T f3f9c2e2bf644115957398fe4c9459db P cd75a17ab2604397adab03bb8b5fd75c [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:21:19.911644  6803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3411566abe2d4c9bb4b2adfdd05e6f17" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:21:19.915235  6731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f58dc08b12a2494bb9a1372837970ca2" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:21:19.915925  6731 raft_consensus.cc:2468] T f58dc08b12a2494bb9a1372837970ca2 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 19.
W20260709 13:21:19.913381 13621 log.cc:927] Time spent T de3186201e1a40d0b335eeb8b4e256e0 P cd75a17ab2604397adab03bb8b5fd75c: Append to log took a long time: real 0.082s	user 0.000s	sys 0.001s
W20260709 13:21:19.918172 13616 log.cc:927] Time spent T c4db81d9d329422bb3b4160ca4ac2d1d P b7ab4784c7344b939bc36f639286f377: Append to log took a long time: real 0.066s	user 0.000s	sys 0.000s
I20260709 13:21:19.920158  6877 raft_consensus.cc:2468] T f3f9c2e2bf644115957398fe4c9459db P cd75a17ab2604397adab03bb8b5fd75c [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 19.
I20260709 13:21:19.921909  6805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e31b9971c15848dea59d4d4130141d9e" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
W20260709 13:21:19.928120  6695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 49833.3us
I20260709 13:21:19.889118 13264 raft_consensus.cc:2804] T 2c240553ce044eedb41541d72b9475d7 P cd75a17ab2604397adab03bb8b5fd75c [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:21:19.945502 13264 raft_consensus.cc:493] T 2c240553ce044eedb41541d72b9475d7 P cd75a17ab2604397adab03bb8b5fd75c [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:21:19.945786  6697 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 79455.4us
W20260709 13:21:19.946955 13624 log.cc:927] Time spent T 07a92dd554674067a83a9cb68c4773f2 P ccd8a4c3bfe3413cb2ae219b09aea832: Append to log took a long time: real 0.070s	user 0.000s	sys 0.000s
I20260709 13:21:19.945945 13264 raft_consensus.cc:3060] T 2c240553ce044eedb41541d72b9475d7 P cd75a17ab2604397adab03bb8b5fd75c [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:21:19.977669  6695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 44687.5us
I20260709 13:21:19.977387 13586 raft_consensus.cc:493] T 17587d6730594da4a56fa13a353232a1 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:19.947649  6697 leader_election.cc:304] T e31b9971c15848dea59d4d4130141d9e P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:21:19.985872  6881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f58dc08b12a2494bb9a1372837970ca2" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:21:19.887308 13456 raft_consensus.cc:493] T de3186201e1a40d0b335eeb8b4e256e0 P cd75a17ab2604397adab03bb8b5fd75c [term 19 FOLLOWER]: Starting leader election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:21:19.987365  6881 raft_consensus.cc:2468] T f58dc08b12a2494bb9a1372837970ca2 P cd75a17ab2604397adab03bb8b5fd75c [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 18.
I20260709 13:21:19.945948 13598 raft_consensus.cc:2804] T 7c37d41cd9164c15a6826ca62a851a69 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:21:19.992274 13456 raft_consensus.cc:3060] T de3186201e1a40d0b335eeb8b4e256e0 P cd75a17ab2604397adab03bb8b5fd75c [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:21:19.992415 13222 raft_consensus.cc:493] T f4b8bd455d5a47c18a1380839c6e0d61 P b7ab4784c7344b939bc36f639286f377 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:20.005165  6770 leader_election.cc:304] T f58dc08b12a2494bb9a1372837970ca2 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
I20260709 13:21:19.988601 13207 consensus_queue.cc:1059] T f3f9c2e2bf644115957398fe4c9459db P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: INVALID_TERM, Last received: 18.12, Next index: 13, Last known committed idx: 11, Time since last communication: 0.019s
I20260709 13:21:19.999495 13598 raft_consensus.cc:493] T 7c37d41cd9164c15a6826ca62a851a69 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 19 FOLLOWER]: Starting leader election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:21:19.999688 13446 consensus_queue.cc:1048] T 4d9def8b32fd443aa94ab1420b06837b P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 8, Time since last communication: 0.024s
I20260709 13:21:19.997309 13295 consensus_queue.cc:1048] T 404190ce4ce94cecbfcb6ea9d1dd8626 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.023s
I20260709 13:21:19.992103 13586 raft_consensus.cc:515] T 17587d6730594da4a56fa13a353232a1 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:21:20.019336 13222 raft_consensus.cc:515] T f4b8bd455d5a47c18a1380839c6e0d61 P b7ab4784c7344b939bc36f639286f377 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:20.050235 13222 leader_election.cc:290] T f4b8bd455d5a47c18a1380839c6e0d61 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:21:20.050379  7500 raft_consensus.cc:1275] T 7ba5dac66ab5497e9e336f2a3c28cda5 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 20 FOLLOWER]: Refusing update from remote peer cd75a17ab2604397adab03bb8b5fd75c: Log matching property violated. Preceding OpId in replica: term: 19 index: 14. Preceding OpId from leader: term: 20 index: 15. (index mismatch)
W20260709 13:21:20.054297  6695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 66162.6us
I20260709 13:21:20.031937 13598 raft_consensus.cc:3060] T 7c37d41cd9164c15a6826ca62a851a69 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:21:20.060349  6727 raft_consensus.cc:2468] T 7887766dc6784fcaa42b35c05fea7a99 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 23.
W20260709 13:21:20.064590  7466 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 76307.1us
I20260709 13:21:20.066926  6807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce4f062dcd314d43a63ca74067cb5ee3" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:21:20.090197 13586 leader_election.cc:290] T 17587d6730594da4a56fa13a353232a1 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:21:20.044093 13602 raft_consensus.cc:2804] T f58dc08b12a2494bb9a1372837970ca2 P b7ab4784c7344b939bc36f639286f377 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:21:20.091003 13602 raft_consensus.cc:493] T f58dc08b12a2494bb9a1372837970ca2 P b7ab4784c7344b939bc36f639286f377 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:20.091487 13602 raft_consensus.cc:3060] T f58dc08b12a2494bb9a1372837970ca2 P b7ab4784c7344b939bc36f639286f377 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:21:20.104233 13579 leader_election.cc:290] T ce4f062dcd314d43a63ca74067cb5ee3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:21:20.111406  7468 leader_election.cc:304] T 4f00a2e87e56452083b759f60d461ee3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
W20260709 13:21:20.113055 13636 log.cc:927] Time spent T 7a734b5ab7834e05a8c422208acc58b1 P 7ba59cc884714e8aa5f3f0ecaed84cbb: Append to log took a long time: real 0.061s	user 0.001s	sys 0.000s
W20260709 13:21:20.113169 13632 log.cc:927] Time spent T 3d65025eea89441290d85dd053810e31 P cd75a17ab2604397adab03bb8b5fd75c: Append to log took a long time: real 0.128s	user 0.001s	sys 0.000s
I20260709 13:21:20.116143  6805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17587d6730594da4a56fa13a353232a1" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 26 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:21:20.130831  6805 raft_consensus.cc:2468] T 17587d6730594da4a56fa13a353232a1 P b7ab4784c7344b939bc36f639286f377 [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in term 25.
W20260709 13:21:20.117477  6770 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 112440us
I20260709 13:21:20.121798  6802 raft_consensus.cc:2468] T 853ac0a8cbd64ce99457f170216d4d0f P b7ab4784c7344b939bc36f639286f377 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 17.
I20260709 13:21:20.142556  7466 leader_election.cc:304] T 17587d6730594da4a56fa13a353232a1 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, b7ab4784c7344b939bc36f639286f377; no voters: 
I20260709 13:21:20.145920  6772 leader_election.cc:304] T 95a75bfe094d4bdc963aba3f08dfcd25 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, cd75a17ab2604397adab03bb8b5fd75c
W20260709 13:21:20.139531 13628 log.cc:927] Time spent T d33d5ee8ef6f415593d8df52063161ad P b7ab4784c7344b939bc36f639286f377: Append to log took a long time: real 0.149s	user 0.004s	sys 0.000s
W20260709 13:21:20.140152  6844 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.5.126.66:42817 timed out after 1.625s (SENT) [suppressed 1 similar messages]
I20260709 13:21:20.065649 13594 consensus_queue.cc:1048] T 7ba5dac66ab5497e9e336f2a3c28cda5 P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.078s
I20260709 13:21:20.144811 13289 raft_consensus.cc:2749] T 4f00a2e87e56452083b759f60d461ee3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:21:20.142629 13529 raft_consensus.cc:2749] T e31b9971c15848dea59d4d4130141d9e P ccd8a4c3bfe3413cb2ae219b09aea832 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:21:20.158004  6772 leader_election.cc:304] T 30e88460611e47b2ba16a46a30b5f416 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:21:20.159912 13617 consensus_queue.cc:1048] T 2c240553ce044eedb41541d72b9475d7 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:21:20.160571 13446 consensus_queue.cc:1048] T 4d9def8b32fd443aa94ab1420b06837b P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 8, Time since last communication: 0.000s
W20260709 13:21:20.164165  6697 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 216671us
I20260709 13:21:20.156126 13631 raft_consensus.cc:3055] T f3f9c2e2bf644115957398fe4c9459db P ccd8a4c3bfe3413cb2ae219b09aea832 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:21:20.157127 13026 raft_consensus.cc:2749] T 95a75bfe094d4bdc963aba3f08dfcd25 P b7ab4784c7344b939bc36f639286f377 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:21:20.201849  6805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce4f062dcd314d43a63ca74067cb5ee3" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:21:20.184785  6697 leader_election.cc:304] T 3fa34c08b205435dba97346991aa1f92 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb
I20260709 13:21:20.203094  6803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22ccee1b570c4ad3a57bd7aec085b1b4" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
W20260709 13:21:20.170323  6695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 109326us
I20260709 13:21:20.185065  6772 leader_election.cc:304] T 9e326172347f45e99a0d482b5d8ef768 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:21:20.203680  6803 raft_consensus.cc:2468] T 22ccee1b570c4ad3a57bd7aec085b1b4 P b7ab4784c7344b939bc36f639286f377 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 15.
I20260709 13:21:20.204615  6772 leader_election.cc:304] T 4275cf08e63345f993bce8664eada830 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:21:20.181071 13601 raft_consensus.cc:2804] T 30e88460611e47b2ba16a46a30b5f416 P b7ab4784c7344b939bc36f639286f377 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:21:20.208253  6806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ba5dac66ab5497e9e336f2a3c28cda5" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:21:20.208415 13643 raft_consensus.cc:2804] T 17587d6730594da4a56fa13a353232a1 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 13:21:20.209030 13643 raft_consensus.cc:493] T 17587d6730594da4a56fa13a353232a1 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 25 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:20.209084  6803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5be3a11b23d4ea9b08300a2789821c7" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:21:20.209314  6697 leader_election.cc:304] T 3a485a995abc4807b6e511e45419f737 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:21:20.209523 13643 raft_consensus.cc:3060] T 17587d6730594da4a56fa13a353232a1 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:21:20.210119 13640 raft_consensus.cc:2804] T 3fa34c08b205435dba97346991aa1f92 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:21:20.210543 13640 raft_consensus.cc:493] T 3fa34c08b205435dba97346991aa1f92 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 23 FOLLOWER]: Starting leader election (detected failure of leader 7ba59cc884714e8aa5f3f0ecaed84cbb)
I20260709 13:21:20.210911 13640 raft_consensus.cc:3060] T 3fa34c08b205435dba97346991aa1f92 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:21:20.201150  6802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6869f07b5a4885a0b99fbe60c3b175" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 21 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:21:20.212690  6802 raft_consensus.cc:3060] T bd6869f07b5a4885a0b99fbe60c3b175 P b7ab4784c7344b939bc36f639286f377 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:21:20.206219  6772 leader_election.cc:304] T ab432e62819d499eaaf3dd55481dd930 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:21:20.178470 13273 raft_consensus.cc:493] T ce4f062dcd314d43a63ca74067cb5ee3 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:21:20.206979  6798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44bde925b2e541b69890d70715b85176" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:21:20.207190 13626 raft_consensus.cc:2804] T 4275cf08e63345f993bce8664eada830 P b7ab4784c7344b939bc36f639286f377 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:21:20.169128 13586 consensus_queue.cc:1059] T 7a734b5ab7834e05a8c422208acc58b1 P 7ba59cc884714e8aa5f3f0ecaed84cbb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.038s
I20260709 13:21:20.207579  6807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a734b5ab7834e05a8c422208acc58b1" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:21:20.207867 13554 raft_consensus.cc:2804] T 9e326172347f45e99a0d482b5d8ef768 P b7ab4784c7344b939bc36f639286f377 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:21:20.180243 13446 consensus_queue.cc:1243] T 4d9def8b32fd443aa94ab1420b06837b P b7ab4784c7344b939bc36f639286f377 [LEADER]: Peer cd75a17ab2604397adab03bb8b5fd75c log is divergent from this leader: its last log entry 20.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 13:21:20.184203 13582 consensus_queue.cc:1048] T 24ee15416e3145beaa1b8183453729a3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.107s
I20260709 13:21:20.236759 13593 consensus_queue.cc:1059] T 07a92dd554674067a83a9cb68c4773f2 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: INVALID_TERM, Last received: 16.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:21:20.218525  6695 leader_election.cc:304] T 853ac0a8cbd64ce99457f170216d4d0f P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
I20260709 13:21:20.193472 13264 raft_consensus.cc:515] T 2c240553ce044eedb41541d72b9475d7 P cd75a17ab2604397adab03bb8b5fd75c [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
W20260709 13:21:20.228195  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 88091.5us
I20260709 13:21:20.238216 13593 raft_consensus.cc:3055] T 07a92dd554674067a83a9cb68c4773f2 P b7ab4784c7344b939bc36f639286f377 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:21:20.185920 13456 raft_consensus.cc:515] T de3186201e1a40d0b335eeb8b4e256e0 P cd75a17ab2604397adab03bb8b5fd75c [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:20.238859  6844 leader_election.cc:304] T ab432e62819d499eaaf3dd55481dd930 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:21:20.240129 13264 leader_election.cc:290] T 2c240553ce044eedb41541d72b9475d7 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 20 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:21:20.208477 13601 raft_consensus.cc:493] T 30e88460611e47b2ba16a46a30b5f416 P b7ab4784c7344b939bc36f639286f377 [term 15 FOLLOWER]: Starting leader election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:21:20.222494 13626 raft_consensus.cc:493] T 4275cf08e63345f993bce8664eada830 P b7ab4784c7344b939bc36f639286f377 [term 18 FOLLOWER]: Starting leader election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:21:20.240881 13264 raft_consensus.cc:2749] T ab432e62819d499eaaf3dd55481dd930 P cd75a17ab2604397adab03bb8b5fd75c [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:21:20.240458 13456 leader_election.cc:290] T de3186201e1a40d0b335eeb8b4e256e0 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 20 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:21:20.218947 13602 raft_consensus.cc:515] T f58dc08b12a2494bb9a1372837970ca2 P b7ab4784c7344b939bc36f639286f377 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:20.241184 13626 raft_consensus.cc:3060] T 4275cf08e63345f993bce8664eada830 P b7ab4784c7344b939bc36f639286f377 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:21:20.243438 13602 leader_election.cc:290] T f58dc08b12a2494bb9a1372837970ca2 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 20 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:21:20.231500 13026 raft_consensus.cc:2804] T ab432e62819d499eaaf3dd55481dd930 P b7ab4784c7344b939bc36f639286f377 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:21:20.244261 13026 raft_consensus.cc:493] T ab432e62819d499eaaf3dd55481dd930 P b7ab4784c7344b939bc36f639286f377 [term 22 FOLLOWER]: Starting leader election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:21:20.244722 13026 raft_consensus.cc:3060] T ab432e62819d499eaaf3dd55481dd930 P b7ab4784c7344b939bc36f639286f377 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:21:20.245316  6697 leader_election.cc:304] T bb3d8792045a4583ae2e965b1350a5b4 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb
I20260709 13:21:20.221669 13554 raft_consensus.cc:493] T 9e326172347f45e99a0d482b5d8ef768 P b7ab4784c7344b939bc36f639286f377 [term 16 FOLLOWER]: Starting leader election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:21:20.246976 13554 raft_consensus.cc:3060] T 9e326172347f45e99a0d482b5d8ef768 P b7ab4784c7344b939bc36f639286f377 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:21:20.232185 13639 raft_consensus.cc:2749] T 3a485a995abc4807b6e511e45419f737 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:21:20.179865 13615 raft_consensus.cc:515] T 7ba5dac66ab5497e9e336f2a3c28cda5 P b7ab4784c7344b939bc36f639286f377 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:21:20.250697 13615 leader_election.cc:290] T 7ba5dac66ab5497e9e336f2a3c28cda5 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 21 election: Requested vote from peers cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:21:20.202008 13631 raft_consensus.cc:740] T f3f9c2e2bf644115957398fe4c9459db P ccd8a4c3bfe3413cb2ae219b09aea832 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
I20260709 13:21:20.251899 13631 consensus_queue.cc:260] T f3f9c2e2bf644115957398fe4c9459db P ccd8a4c3bfe3413cb2ae219b09aea832 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 12, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:20.253261 13631 raft_consensus.cc:3060] T f3f9c2e2bf644115957398fe4c9459db P ccd8a4c3bfe3413cb2ae219b09aea832 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:21:20.231073  6807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b56bf91d90824c959e21e0cee5ba1816" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:21:20.240420  6844 leader_election.cc:304] T 20f6842e26174571996b8dea4151d4be P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:21:20.229894  6798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c37d41cd9164c15a6826ca62a851a69" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:21:20.228058 13273 raft_consensus.cc:515] T ce4f062dcd314d43a63ca74067cb5ee3 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } attrs { replace: true } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:21:20.257648  6844 leader_election.cc:304] T 3a485a995abc4807b6e511e45419f737 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:21:20.258505 13594 raft_consensus.cc:2804] T 20f6842e26174571996b8dea4151d4be P cd75a17ab2604397adab03bb8b5fd75c [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:21:20.258903 13594 raft_consensus.cc:493] T 20f6842e26174571996b8dea4151d4be P cd75a17ab2604397adab03bb8b5fd75c [term 20 FOLLOWER]: Starting leader election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:21:20.259284 13594 raft_consensus.cc:3060] T 20f6842e26174571996b8dea4151d4be P cd75a17ab2604397adab03bb8b5fd75c [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:21:20.259955 13273 leader_election.cc:290] T ce4f062dcd314d43a63ca74067cb5ee3 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:21:20.260253 13264 consensus_queue.cc:1059] T dbdf895bba214ff68685a24fd17dfb5d P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: INVALID_TERM, Last received: 17.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:21:20.241132 13601 raft_consensus.cc:3060] T 30e88460611e47b2ba16a46a30b5f416 P b7ab4784c7344b939bc36f639286f377 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:21:20.261144 13598 raft_consensus.cc:515] T 7c37d41cd9164c15a6826ca62a851a69 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:20.263191 13588 raft_consensus.cc:2749] T 3a485a995abc4807b6e511e45419f737 P cd75a17ab2604397adab03bb8b5fd75c [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:21:20.263327 13598 leader_election.cc:290] T 7c37d41cd9164c15a6826ca62a851a69 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 20 election: Requested vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:21:20.264209  6803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a92dd554674067a83a9cb68c4773f2" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:21:20.264550 13588 raft_consensus.cc:3055] T dbdf895bba214ff68685a24fd17dfb5d P cd75a17ab2604397adab03bb8b5fd75c [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:21:20.264896 13588 raft_consensus.cc:740] T dbdf895bba214ff68685a24fd17dfb5d P cd75a17ab2604397adab03bb8b5fd75c [term 17 LEADER]: Becoming Follower/Learner. State: Replica: cd75a17ab2604397adab03bb8b5fd75c, State: Running, Role: LEADER
I20260709 13:21:20.265321  6806 raft_consensus.cc:2368] T 7ba5dac66ab5497e9e336f2a3c28cda5 P b7ab4784c7344b939bc36f639286f377 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c for earlier term 20. Current term is 21.
I20260709 13:21:20.265498 13456 consensus_queue.cc:1059] T 7887766dc6784fcaa42b35c05fea7a99 P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: INVALID_TERM, Last received: 20.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:21:20.265695 13588 consensus_queue.cc:260] T dbdf895bba214ff68685a24fd17dfb5d P cd75a17ab2604397adab03bb8b5fd75c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 17.8, Last appended by leader: 8, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:20.266495 13545 raft_consensus.cc:3055] T 7887766dc6784fcaa42b35c05fea7a99 P cd75a17ab2604397adab03bb8b5fd75c [term 22 LEADER]: Stepping down as leader of term 22
I20260709 13:21:20.266861 13588 raft_consensus.cc:3060] T dbdf895bba214ff68685a24fd17dfb5d P cd75a17ab2604397adab03bb8b5fd75c [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:21:20.266921 13545 raft_consensus.cc:740] T 7887766dc6784fcaa42b35c05fea7a99 P cd75a17ab2604397adab03bb8b5fd75c [term 22 LEADER]: Becoming Follower/Learner. State: Replica: cd75a17ab2604397adab03bb8b5fd75c, State: Running, Role: LEADER
I20260709 13:21:20.268496  6805 raft_consensus.cc:1240] T 7ba5dac66ab5497e9e336f2a3c28cda5 P b7ab4784c7344b939bc36f639286f377 [term 21 FOLLOWER]: Rejecting Update request from peer cd75a17ab2604397adab03bb8b5fd75c for earlier term 20. Current term is 21. Ops: []
I20260709 13:21:20.268301 13545 consensus_queue.cc:260] T 7887766dc6784fcaa42b35c05fea7a99 P cd75a17ab2604397adab03bb8b5fd75c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 22.12, Last appended by leader: 12, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:20.269726 13545 raft_consensus.cc:3060] T 7887766dc6784fcaa42b35c05fea7a99 P cd75a17ab2604397adab03bb8b5fd75c [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:21:20.238677 13593 raft_consensus.cc:740] T 07a92dd554674067a83a9cb68c4773f2 P b7ab4784c7344b939bc36f639286f377 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
I20260709 13:21:20.266891  6844 leader_election.cc:304] T 34f36d59d88f40fe8a2805e604fc6c0a P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:21:20.273152 13593 consensus_queue.cc:260] T 07a92dd554674067a83a9cb68c4773f2 P b7ab4784c7344b939bc36f639286f377 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:20.274062  6844 leader_election.cc:304] T 90d42e216d9741e190bca19a781291fd P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:21:20.274914 13456 raft_consensus.cc:2749] T 34f36d59d88f40fe8a2805e604fc6c0a P cd75a17ab2604397adab03bb8b5fd75c [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:21:20.275655 13456 raft_consensus.cc:2749] T 90d42e216d9741e190bca19a781291fd P cd75a17ab2604397adab03bb8b5fd75c [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:21:20.275998 13289 raft_consensus.cc:493] T b3f13b31a1f84f0d89d007eadd57924c P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:20.276607 13289 raft_consensus.cc:515] T b3f13b31a1f84f0d89d007eadd57924c P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:21:20.276991  6844 leader_election.cc:304] T 30e88460611e47b2ba16a46a30b5f416 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:21:20.272221 13650 raft_consensus.cc:3055] T 7a734b5ab7834e05a8c422208acc58b1 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:21:20.278954  6844 leader_election.cc:304] T bb7fa124c3bf4ef9ab65a407cb008441 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, b7ab4784c7344b939bc36f639286f377
I20260709 13:21:20.271461 13594 raft_consensus.cc:515] T 20f6842e26174571996b8dea4151d4be P cd75a17ab2604397adab03bb8b5fd75c [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:20.284308  6844 leader_election.cc:304] T 853ac0a8cbd64ce99457f170216d4d0f P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:21:20.289103 13425 raft_consensus.cc:493] T d33d5ee8ef6f415593d8df52063161ad P cd75a17ab2604397adab03bb8b5fd75c [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:20.289721 13425 raft_consensus.cc:515] T d33d5ee8ef6f415593d8df52063161ad P cd75a17ab2604397adab03bb8b5fd75c [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:20.290510 13347 raft_consensus.cc:3060] T 853ac0a8cbd64ce99457f170216d4d0f P cd75a17ab2604397adab03bb8b5fd75c [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:21:20.291004 13594 leader_election.cc:290] T 20f6842e26174571996b8dea4151d4be P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 21 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
W20260709 13:21:20.292207  6695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 73767.9us
I20260709 13:21:20.294807  6844 leader_election.cc:304] T f58dc08b12a2494bb9a1372837970ca2 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: ccd8a4c3bfe3413cb2ae219b09aea832
W20260709 13:21:20.294529  6697 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 49290.8us
I20260709 13:21:20.319604  6802 raft_consensus.cc:2468] T bd6869f07b5a4885a0b99fbe60c3b175 P b7ab4784c7344b939bc36f639286f377 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 21.
I20260709 13:21:20.288370 13456 raft_consensus.cc:2749] T bb7fa124c3bf4ef9ab65a407cb008441 P cd75a17ab2604397adab03bb8b5fd75c [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:21:20.326460 13593 raft_consensus.cc:3060] T 07a92dd554674067a83a9cb68c4773f2 P b7ab4784c7344b939bc36f639286f377 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:21:20.327193 13643 raft_consensus.cc:515] T 17587d6730594da4a56fa13a353232a1 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 26 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:21:20.328264  6844 leader_election.cc:304] T f03d0dbf16864ca4bc1bb5e4c0334c0f P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:21:20.337399  6724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4b8bd455d5a47c18a1380839c6e0d61" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 20 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:21:20.285411 13264 raft_consensus.cc:2749] T 30e88460611e47b2ba16a46a30b5f416 P cd75a17ab2604397adab03bb8b5fd75c [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:21:20.336781  6770 leader_election.cc:304] T 7887766dc6784fcaa42b35c05fea7a99 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:21:20.339264  6724 raft_consensus.cc:2468] T f4b8bd455d5a47c18a1380839c6e0d61 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 19.
I20260709 13:21:20.341439  6727 raft_consensus.cc:1240] T 7c37d41cd9164c15a6826ca62a851a69 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 20 FOLLOWER]: Rejecting Update request from peer b7ab4784c7344b939bc36f639286f377 for earlier term 19. Current term is 20. Ops: []
W20260709 13:21:20.345446  6845 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:21:20.342749  6730 raft_consensus.cc:1275] T a1704639a875409b9959353527b3fd68 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 22 FOLLOWER]: Refusing update from remote peer b7ab4784c7344b939bc36f639286f377: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 22 index: 13. (index mismatch)
I20260709 13:21:20.280630 13650 raft_consensus.cc:740] T 7a734b5ab7834e05a8c422208acc58b1 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 7ba59cc884714e8aa5f3f0ecaed84cbb, State: Running, Role: LEADER
I20260709 13:21:20.349179  6724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17587d6730594da4a56fa13a353232a1" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 26 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:21:20.349860  6724 raft_consensus.cc:2468] T 17587d6730594da4a56fa13a353232a1 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in term 25.
I20260709 13:21:20.344380 13456 raft_consensus.cc:2804] T f58dc08b12a2494bb9a1372837970ca2 P cd75a17ab2604397adab03bb8b5fd75c [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:21:20.350893 13456 raft_consensus.cc:493] T f58dc08b12a2494bb9a1372837970ca2 P cd75a17ab2604397adab03bb8b5fd75c [term 18 FOLLOWER]: Starting leader election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:21:20.351363 13456 raft_consensus.cc:3060] T f58dc08b12a2494bb9a1372837970ca2 P cd75a17ab2604397adab03bb8b5fd75c [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:21:20.353327  6629 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:51654 (request call id 86) took 11787 ms (client timeout 15000 ms). Trace:
I20260709 13:21:20.354709  6726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24ee15416e3145beaa1b8183453729a3" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:21:20.355266  6802 raft_consensus.cc:1240] T bd6869f07b5a4885a0b99fbe60c3b175 P b7ab4784c7344b939bc36f639286f377 [term 21 FOLLOWER]: Rejecting Update request from peer ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 20. Current term is 21. Ops: []
I20260709 13:21:20.291832 13425 leader_election.cc:290] T d33d5ee8ef6f415593d8df52063161ad P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:21:20.292533 13644 raft_consensus.cc:2804] T 853ac0a8cbd64ce99457f170216d4d0f P ccd8a4c3bfe3413cb2ae219b09aea832 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:21:20.362785  6726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c37d41cd9164c15a6826ca62a851a69" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:21:20.304136 13289 leader_election.cc:290] T b3f13b31a1f84f0d89d007eadd57924c P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:21:20.366490  6801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce4f062dcd314d43a63ca74067cb5ee3" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
W20260709 13:21:20.368235  6772 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 133509us
I20260709 13:21:20.294772 13495 raft_consensus.cc:2804] T bb3d8792045a4583ae2e965b1350a5b4 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:21:20.373713 13495 raft_consensus.cc:493] T bb3d8792045a4583ae2e965b1350a5b4 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 7ba59cc884714e8aa5f3f0ecaed84cbb)
I20260709 13:21:20.374329 13495 raft_consensus.cc:3060] T bb3d8792045a4583ae2e965b1350a5b4 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:21:20.374953  6726 raft_consensus.cc:2393] T 7c37d41cd9164c15a6826ca62a851a69 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c in current term 20: Already voted for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in this term.
W20260709 13:21:20.376267  7466 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 233801us
I20260709 13:21:20.329523 13594 raft_consensus.cc:493] T f4b8bd455d5a47c18a1380839c6e0d61 P cd75a17ab2604397adab03bb8b5fd75c [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:20.377699 13594 raft_consensus.cc:515] T f4b8bd455d5a47c18a1380839c6e0d61 P cd75a17ab2604397adab03bb8b5fd75c [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:20.379791 13594 leader_election.cc:290] T f4b8bd455d5a47c18a1380839c6e0d61 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:21:20.381768  6801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c37d41cd9164c15a6826ca62a851a69" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:21:20.384449  6801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3f13b31a1f84f0d89d007eadd57924c" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:21:20.385126  6801 raft_consensus.cc:2468] T b3f13b31a1f84f0d89d007eadd57924c P b7ab4784c7344b939bc36f639286f377 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in term 15.
I20260709 13:21:20.384552  6726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a92dd554674067a83a9cb68c4773f2" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:21:20.391973  6805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17587d6730594da4a56fa13a353232a1" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 26 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:21:20.393038  6805 raft_consensus.cc:3060] T 17587d6730594da4a56fa13a353232a1 P b7ab4784c7344b939bc36f639286f377 [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:21:20.392979  6726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17587d6730594da4a56fa13a353232a1" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 26 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:21:20.399185  6723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5be3a11b23d4ea9b08300a2789821c7" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:21:20.399984  6732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6869f07b5a4885a0b99fbe60c3b175" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 21 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:21:20.403010  7466 leader_election.cc:304] T b3f13b31a1f84f0d89d007eadd57924c P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, b7ab4784c7344b939bc36f639286f377; no voters: 
I20260709 13:21:20.403533  6730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3d8792045a4583ae2e965b1350a5b4" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:21:20.403728  6725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a734b5ab7834e05a8c422208acc58b1" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:21:20.404911  6805 raft_consensus.cc:2468] T 17587d6730594da4a56fa13a353232a1 P b7ab4784c7344b939bc36f639286f377 [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in term 26.
I20260709 13:21:20.407882  7466 leader_election.cc:304] T 17587d6730594da4a56fa13a353232a1 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 26 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, b7ab4784c7344b939bc36f639286f377; no voters: 
I20260709 13:21:20.402803  6727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44bde925b2e541b69890d70715b85176" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:21:20.407882  6772 leader_election.cc:304] T f3f9c2e2bf644115957398fe4c9459db P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: ccd8a4c3bfe3413cb2ae219b09aea832
W20260709 13:21:20.353785  6629 rpcz_store.cc:269] 0709 13:21:08.566109 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:21:08.566350 (+   241us) service_pool.cc:224] Handling call
0709 13:21:20.353210 (+11786860us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:21:19.188666 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:21:19.193088 (+  4422us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:21:19.193170 (+    82us) write_op.cc:435] Acquired schema lock
0709 13:21:19.193197 (+    27us) tablet.cc:662] Decoding operations
0709 13:21:19.194418 (+  1221us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:21:19.194524 (+   106us) write_op.cc:641] Partition lock acquired for write op
0709 13:21:19.194560 (+    36us) tablet.cc:685] Acquiring locks for 10 operations
0709 13:21:19.195668 (+  1108us) tablet.cc:701] Row locks acquired
0709 13:21:19.195726 (+    58us) write_op.cc:260] PREPARE: finished
0709 13:21:19.195901 (+   175us) write_op.cc:270] Start()
0709 13:21:19.197988 (+  2087us) write_op.cc:276] Timestamp: P: 1783603279195827 usec, L: 0
0709 13:21:19.206914 (+  8926us) op_driver.cc:348] REPLICATION: starting
0709 13:21:19.275716 (+ 68802us) log.cc:844] Serialized 4290 byte log entry
0709 13:21:19.295537 (+ 19821us) spinlock_profiling.cc:243] Waited 16.6 ms on lock 0x7b4400022b4c. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0c745db1 00007fcc0c7e3c85 00007fcc0c7e46a2 00007fcc0f5561db 00007fcc0f551aaf 00007fcc0c8a00ac 00007fcc156faab9 00007fcc0c8bc69b 00007fcc0c8ba93f 00007fcc0c8bcc02 00007fcc0f54420b
0709 13:21:19.695564 (+400027us) op_driver.cc:464] REPLICATION: finished
0709 13:21:19.908713 (+213149us) write_op.cc:301] APPLY: starting
0709 13:21:19.949370 (+ 40657us) tablet.cc:1367] starting BulkCheckPresence
0709 13:21:20.188070 (+238700us) tablet.cc:1370] finished BulkCheckPresence
0709 13:21:20.188122 (+    52us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:21:20.254070 (+ 65948us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:21:20.254528 (+   458us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=20,key_file_lookups=20,delta_file_lookups=20,mrs_lookups=0
0709 13:21:20.254607 (+    79us) write_op.cc:312] APPLY: finished
0709 13:21:20.255015 (+   408us) log.cc:844] Serialized 96 byte log entry
0709 13:21:20.255228 (+   213us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:21:20.255394 (+   166us) write_op.cc:454] Released schema lock
0709 13:21:20.255467 (+    73us) write_op.cc:341] FINISH: Updating metrics
0709 13:21:20.310914 (+ 55447us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:21:20.329645 (+ 18731us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":3202217,"reported_tablets":18,"child_traces":[["op",{"apply.queue_time_us":185635,"apply.run_cpu_time_us":16942,"apply.run_wall_time_us":396933,"cfile_cache_hit":42,"cfile_cache_hit_bytes":45887,"num_ops":10,"prepare.queue_time_us":283730,"prepare.run_cpu_time_us":29837,"prepare.run_wall_time_us":264272,"raft.queue_time_us":39885,"raft.run_cpu_time_us":18876,"raft.run_wall_time_us":175698,"replication_time_us":488396,"spinlock_wait_cycles":38202624,"thread_start_us":530890,"threads_started":4,"wal-append.queue_time_us":279130}]]}
I20260709 13:21:20.298610 13626 raft_consensus.cc:515] T 4275cf08e63345f993bce8664eada830 P b7ab4784c7344b939bc36f639286f377 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:20.398737 13222 raft_consensus.cc:2804] T 7887766dc6784fcaa42b35c05fea7a99 P b7ab4784c7344b939bc36f639286f377 [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:21:20.368688 13264 raft_consensus.cc:2749] T f03d0dbf16864ca4bc1bb5e4c0334c0f P cd75a17ab2604397adab03bb8b5fd75c [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:21:20.369598 13643 leader_election.cc:290] T 17587d6730594da4a56fa13a353232a1 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 26 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:21:20.422308  6726 raft_consensus.cc:3060] T 17587d6730594da4a56fa13a353232a1 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:21:20.463642  6801 raft_consensus.cc:1240] T 4275cf08e63345f993bce8664eada830 P b7ab4784c7344b939bc36f639286f377 [term 19 FOLLOWER]: Rejecting Update request from peer ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 18. Current term is 19. Ops: []
I20260709 13:21:20.464880  6725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3f13b31a1f84f0d89d007eadd57924c" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:21:20.515244  6729 raft_consensus.cc:1240] T 7887766dc6784fcaa42b35c05fea7a99 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 23 FOLLOWER]: Rejecting Update request from peer cd75a17ab2604397adab03bb8b5fd75c for earlier term 22. Current term is 23. Ops: [20.11-22.12]
I20260709 13:21:20.469480  6730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b56bf91d90824c959e21e0cee5ba1816" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:21:20.427901  6731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe20b4b48823486ca3b9c648db6ce8aa" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
W20260709 13:21:20.527251  6696 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:21:20.503237  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 175074us
I20260709 13:21:20.433931  6697 leader_election.cc:304] T b56bf91d90824c959e21e0cee5ba1816 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:21:20.530740  6844 leader_election.cc:304] T 3411566abe2d4c9bb4b2adfdd05e6f17 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:21:20.520582  6725 raft_consensus.cc:2468] T b3f13b31a1f84f0d89d007eadd57924c P ccd8a4c3bfe3413cb2ae219b09aea832 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in term 15.
W20260709 13:21:20.533025  6770 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 96895.2us
I20260709 13:21:20.504272  6723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f58dc08b12a2494bb9a1372837970ca2" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:21:20.536617  6723 raft_consensus.cc:3060] T f58dc08b12a2494bb9a1372837970ca2 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:21:20.534250  6770 leader_election.cc:304] T f4b8bd455d5a47c18a1380839c6e0d61 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
I20260709 13:21:20.545077  6844 leader_election.cc:304] T e31b9971c15848dea59d4d4130141d9e P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
W20260709 13:21:20.553265  6772 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 145441us
I20260709 13:21:20.424456 13579 raft_consensus.cc:2804] T 17587d6730594da4a56fa13a353232a1 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 26 FOLLOWER]: Leader election won for term 26
I20260709 13:21:20.424700 13582 raft_consensus.cc:2804] T b3f13b31a1f84f0d89d007eadd57924c P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:21:20.561610  6875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4b8bd455d5a47c18a1380839c6e0d61" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 20 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:21:20.472389 13626 leader_election.cc:290] T 4275cf08e63345f993bce8664eada830 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 19 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:21:20.573484  6875 raft_consensus.cc:2468] T f4b8bd455d5a47c18a1380839c6e0d61 P cd75a17ab2604397adab03bb8b5fd75c [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 19.
I20260709 13:21:20.515329 13347 raft_consensus.cc:2749] T 853ac0a8cbd64ce99457f170216d4d0f P cd75a17ab2604397adab03bb8b5fd75c [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:21:20.463801 13655 raft_consensus.cc:2804] T f3f9c2e2bf644115957398fe4c9459db P b7ab4784c7344b939bc36f639286f377 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:21:20.542021 13446 raft_consensus.cc:493] T 20f6842e26174571996b8dea4151d4be P b7ab4784c7344b939bc36f639286f377 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:20.465018 13598 consensus_queue.cc:1059] T bd6869f07b5a4885a0b99fbe60c3b175 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: INVALID_TERM, Last received: 20.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.107s
I20260709 13:21:20.562376 13264 raft_consensus.cc:2749] T 3411566abe2d4c9bb4b2adfdd05e6f17 P cd75a17ab2604397adab03bb8b5fd75c [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:21:20.459574 13601 raft_consensus.cc:515] T 30e88460611e47b2ba16a46a30b5f416 P b7ab4784c7344b939bc36f639286f377 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:20.570293 13207 raft_consensus.cc:2749] T b56bf91d90824c959e21e0cee5ba1816 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:21:20.573287 13582 raft_consensus.cc:493] T b3f13b31a1f84f0d89d007eadd57924c P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:20.642948 13582 raft_consensus.cc:3060] T b3f13b31a1f84f0d89d007eadd57924c P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:21:20.643221 13347 raft_consensus.cc:493] T f09c2a98de1a4decabd0ff900dd44caa P cd75a17ab2604397adab03bb8b5fd75c [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:20.644120 13347 raft_consensus.cc:515] T f09c2a98de1a4decabd0ff900dd44caa P cd75a17ab2604397adab03bb8b5fd75c [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:20.647119 13347 leader_election.cc:290] T f09c2a98de1a4decabd0ff900dd44caa P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:21:20.449674 13495 raft_consensus.cc:515] T bb3d8792045a4583ae2e965b1350a5b4 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:21:20.649773 13495 leader_election.cc:290] T bb3d8792045a4583ae2e965b1350a5b4 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 19 election: Requested vote from peers cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
W20260709 13:21:20.633924  6697 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 200168us
I20260709 13:21:20.650854  6697 leader_election.cc:304] T 8c7f33e544204fbaac4078e3e83bbf4e P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:21:20.635062  7503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ba5dac66ab5497e9e336f2a3c28cda5" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb"
I20260709 13:21:20.655265 13582 raft_consensus.cc:515] T b3f13b31a1f84f0d89d007eadd57924c P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:21:20.659904 13601 leader_election.cc:290] T 30e88460611e47b2ba16a46a30b5f416 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 16 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:21:20.587896 13027 raft_consensus.cc:2804] T f4b8bd455d5a47c18a1380839c6e0d61 P b7ab4784c7344b939bc36f639286f377 [term 19 FOLLOWER]: Leader pre-election won for term 20
W20260709 13:21:20.661626  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 114843us
I20260709 13:21:20.664564  6880 raft_consensus.cc:1275] T c4db81d9d329422bb3b4160ca4ac2d1d P cd75a17ab2604397adab03bb8b5fd75c [term 20 FOLLOWER]: Refusing update from remote peer b7ab4784c7344b939bc36f639286f377: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 20 index: 11. (index mismatch)
W20260709 13:21:20.664106  6770 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 104656us
I20260709 13:21:20.666916  6844 leader_election.cc:304] T 22ccee1b570c4ad3a57bd7aec085b1b4 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:21:20.672170  6844 leader_election.cc:304] T ce4f062dcd314d43a63ca74067cb5ee3 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, b7ab4784c7344b939bc36f639286f377
W20260709 13:21:20.674901  6695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 227235us
W20260709 13:21:20.661717 13610 log.cc:927] Time spent T f09c2a98de1a4decabd0ff900dd44caa P b7ab4784c7344b939bc36f639286f377: Append to log took a long time: real 0.074s	user 0.000s	sys 0.001s
I20260709 13:21:20.607589 13655 raft_consensus.cc:697] T f3f9c2e2bf644115957398fe4c9459db P b7ab4784c7344b939bc36f639286f377 [term 19 LEADER]: Becoming Leader. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
I20260709 13:21:20.679133  6844 leader_election.cc:304] T 7a734b5ab7834e05a8c422208acc58b1 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, b7ab4784c7344b939bc36f639286f377
I20260709 13:21:20.707701  6844 leader_election.cc:400] T 7ba5dac66ab5497e9e336f2a3c28cda5 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 20 election: Vote denied by peer b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817) with higher term. Message: Invalid argument: T 7ba5dac66ab5497e9e336f2a3c28cda5 P b7ab4784c7344b939bc36f639286f377 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c for earlier term 20. Current term is 21.
W20260709 13:21:20.708777  6845 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:21:20.664292 13027 raft_consensus.cc:493] T f4b8bd455d5a47c18a1380839c6e0d61 P b7ab4784c7344b939bc36f639286f377 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:20.599978 13446 raft_consensus.cc:515] T 20f6842e26174571996b8dea4151d4be P b7ab4784c7344b939bc36f639286f377 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:20.710244  6844 leader_election.cc:304] T bd6869f07b5a4885a0b99fbe60c3b175 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:21:20.720944  6697 leader_election.cc:304] T 22ccee1b570c4ad3a57bd7aec085b1b4 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:21:20.721518  6807 raft_consensus.cc:1240] T 30e88460611e47b2ba16a46a30b5f416 P b7ab4784c7344b939bc36f639286f377 [term 16 FOLLOWER]: Rejecting Update request from peer ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 15. Current term is 16. Ops: []
I20260709 13:21:20.681409 13495 raft_consensus.cc:2749] T 8c7f33e544204fbaac4078e3e83bbf4e P ccd8a4c3bfe3413cb2ae219b09aea832 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:21:20.672688 13222 raft_consensus.cc:697] T 7887766dc6784fcaa42b35c05fea7a99 P b7ab4784c7344b939bc36f639286f377 [term 23 LEADER]: Becoming Leader. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
I20260709 13:21:20.675681 13582 leader_election.cc:290] T b3f13b31a1f84f0d89d007eadd57924c P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 16 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:21:20.679867 13347 raft_consensus.cc:2749] T ce4f062dcd314d43a63ca74067cb5ee3 P cd75a17ab2604397adab03bb8b5fd75c [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:21:20.728813  6770 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 53066.3us
I20260709 13:21:20.732499  6875 raft_consensus.cc:1217] T 4d9def8b32fd443aa94ab1420b06837b P cd75a17ab2604397adab03bb8b5fd75c [term 21 FOLLOWER]: Deduplicated request from leader. Original: 15.8->[17.9-21.11]   Dedup: 17.9->[19.10-21.11]
I20260709 13:21:20.733430  6877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce4f062dcd314d43a63ca74067cb5ee3" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:21:20.712689 13425 raft_consensus.cc:2749] T 7a734b5ab7834e05a8c422208acc58b1 P cd75a17ab2604397adab03bb8b5fd75c [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:21:20.737342  6726 raft_consensus.cc:2468] T 17587d6730594da4a56fa13a353232a1 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in term 26.
I20260709 13:21:20.737377  6724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22ccee1b570c4ad3a57bd7aec085b1b4" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:21:20.738505  6726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4275cf08e63345f993bce8664eada830" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:21:20.738713  6724 raft_consensus.cc:2468] T 22ccee1b570c4ad3a57bd7aec085b1b4 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 15.
I20260709 13:21:20.739701  6724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30e88460611e47b2ba16a46a30b5f416" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:21:20.741042  6878 raft_consensus.cc:1275] T a1704639a875409b9959353527b3fd68 P cd75a17ab2604397adab03bb8b5fd75c [term 22 FOLLOWER]: Refusing update from remote peer b7ab4784c7344b939bc36f639286f377: Log matching property violated. Preceding OpId in replica: term: 21 index: 13. Preceding OpId from leader: term: 22 index: 13. (term mismatch)
I20260709 13:21:20.741460  6878 pending_rounds.cc:85] T a1704639a875409b9959353527b3fd68 P cd75a17ab2604397adab03bb8b5fd75c: Aborting all ops after (but not including) 12
I20260709 13:21:20.741689  6878 pending_rounds.cc:107] T a1704639a875409b9959353527b3fd68 P cd75a17ab2604397adab03bb8b5fd75c: Aborting uncommitted NO_OP operation due to leader change: 21.13
I20260709 13:21:20.741921  6878 raft_consensus.cc:2889] T a1704639a875409b9959353527b3fd68 P cd75a17ab2604397adab03bb8b5fd75c [term 22 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:21:20.733098  6875 pending_rounds.cc:85] T 4d9def8b32fd443aa94ab1420b06837b P cd75a17ab2604397adab03bb8b5fd75c: Aborting all ops after (but not including) 9
I20260709 13:21:20.743192  6875 pending_rounds.cc:107] T 4d9def8b32fd443aa94ab1420b06837b P cd75a17ab2604397adab03bb8b5fd75c: Aborting uncommitted NO_OP operation due to leader change: 20.10
I20260709 13:21:20.714598 13027 raft_consensus.cc:3060] T f4b8bd455d5a47c18a1380839c6e0d61 P b7ab4784c7344b939bc36f639286f377 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:21:20.743466  6875 raft_consensus.cc:2889] T 4d9def8b32fd443aa94ab1420b06837b P cd75a17ab2604397adab03bb8b5fd75c [term 21 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:21:20.750859  6724 raft_consensus.cc:1240] T bb3d8792045a4583ae2e965b1350a5b4 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 19 FOLLOWER]: Rejecting Update request from peer 7ba59cc884714e8aa5f3f0ecaed84cbb for earlier term 18. Current term is 19. Ops: []
I20260709 13:21:20.752580  6806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c240553ce044eedb41541d72b9475d7" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:21:20.753063  6799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20f6842e26174571996b8dea4151d4be" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:21:20.753358  6800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d33d5ee8ef6f415593d8df52063161ad" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:21:20.754638  6802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de3186201e1a40d0b335eeb8b4e256e0" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
W20260709 13:21:20.757293  6845 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:21:20.746495 13653 raft_consensus.cc:493] T be1a92657f494cac8dd227d152f50151 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:20.678731 13665 consensus_queue.cc:1048] T a1704639a875409b9959353527b3fd68 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.075s
I20260709 13:21:20.724246 13264 consensus_queue.cc:1059] T 7ba5dac66ab5497e9e336f2a3c28cda5 P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: INVALID_TERM, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.034s
W20260709 13:21:20.790485 13664 log.cc:927] Time spent T d33d5ee8ef6f415593d8df52063161ad P ccd8a4c3bfe3413cb2ae219b09aea832: Append to log took a long time: real 0.110s	user 0.001s	sys 0.000s
I20260709 13:21:20.749555 13529 raft_consensus.cc:2749] T 22ccee1b570c4ad3a57bd7aec085b1b4 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:21:20.816880 13649 raft_consensus.cc:493] T be1a92657f494cac8dd227d152f50151 P b7ab4784c7344b939bc36f639286f377 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:20.817494 13649 raft_consensus.cc:515] T be1a92657f494cac8dd227d152f50151 P b7ab4784c7344b939bc36f639286f377 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:21:20.818493 13670 consensus_queue.cc:1059] T 7c37d41cd9164c15a6826ca62a851a69 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: INVALID_TERM, Last received: 19.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.070s
I20260709 13:21:20.819818 13670 raft_consensus.cc:3055] T 7c37d41cd9164c15a6826ca62a851a69 P b7ab4784c7344b939bc36f639286f377 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:21:20.820235 13670 raft_consensus.cc:740] T 7c37d41cd9164c15a6826ca62a851a69 P b7ab4784c7344b939bc36f639286f377 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
I20260709 13:21:20.791953 13669 raft_consensus.cc:2804] T bd6869f07b5a4885a0b99fbe60c3b175 P cd75a17ab2604397adab03bb8b5fd75c [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:21:20.746938 13658 raft_consensus.cc:2749] T e31b9971c15848dea59d4d4130141d9e P cd75a17ab2604397adab03bb8b5fd75c [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:21:20.833528  6726 raft_consensus.cc:1275] T c4db81d9d329422bb3b4160ca4ac2d1d P ccd8a4c3bfe3413cb2ae219b09aea832 [term 20 FOLLOWER]: Refusing update from remote peer b7ab4784c7344b939bc36f639286f377: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 20 index: 11. (index mismatch)
I20260709 13:21:20.833710  6806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22ccee1b570c4ad3a57bd7aec085b1b4" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: true dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:21:20.834080  6800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4b8bd455d5a47c18a1380839c6e0d61" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 20 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
W20260709 13:21:20.793736 13554 consensus_meta.cc:287] T 9e326172347f45e99a0d482b5d8ef768 P b7ab4784c7344b939bc36f639286f377: Time spent flushing consensus metadata: real 0.546s	user 0.007s	sys 0.006s
I20260709 13:21:20.794579  6878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f58dc08b12a2494bb9a1372837970ca2" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:21:20.798039  6807 raft_consensus.cc:1275] T 22ccee1b570c4ad3a57bd7aec085b1b4 P b7ab4784c7344b939bc36f639286f377 [term 15 FOLLOWER]: Refusing update from remote peer cd75a17ab2604397adab03bb8b5fd75c: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:21:20.790612 13289 raft_consensus.cc:493] T 95a75bfe094d4bdc963aba3f08dfcd25 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 16 FOLLOWER]: Starting pre-election (detected failure of leader cd75a17ab2604397adab03bb8b5fd75c)
I20260709 13:21:20.804610 13655 consensus_queue.cc:237] T f3f9c2e2bf644115957398fe4c9459db P b7ab4784c7344b939bc36f639286f377 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.12, Last appended by leader: 12, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
W20260709 13:21:20.816490 13631 consensus_meta.cc:287] T f3f9c2e2bf644115957398fe4c9459db P ccd8a4c3bfe3413cb2ae219b09aea832: Time spent flushing consensus metadata: real 0.563s	user 0.007s	sys 0.006s
W20260709 13:21:20.798978 13640 consensus_meta.cc:287] T 3fa34c08b205435dba97346991aa1f92 P ccd8a4c3bfe3413cb2ae219b09aea832: Time spent flushing consensus metadata: real 0.588s	user 0.009s	sys 0.006s
I20260709 13:21:20.816097 13222 consensus_queue.cc:237] T 7887766dc6784fcaa42b35c05fea7a99 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 20.11, Last appended by leader: 11, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
W20260709 13:21:20.809001 13026 consensus_meta.cc:287] T ab432e62819d499eaaf3dd55481dd930 P b7ab4784c7344b939bc36f639286f377: Time spent flushing consensus metadata: real 0.564s	user 0.010s	sys 0.002s
I20260709 13:21:20.847342  6881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ba5dac66ab5497e9e336f2a3c28cda5" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:21:20.742452 13579 raft_consensus.cc:697] T 17587d6730594da4a56fa13a353232a1 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 26 LEADER]: Becoming Leader. State: Replica: 7ba59cc884714e8aa5f3f0ecaed84cbb, State: Running, Role: LEADER
I20260709 13:21:20.750207 13207 consensus_queue.cc:1059] T 30e88460611e47b2ba16a46a30b5f416 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: INVALID_TERM, Last received: 15.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.083s
I20260709 13:21:20.756737 13456 raft_consensus.cc:515] T f58dc08b12a2494bb9a1372837970ca2 P cd75a17ab2604397adab03bb8b5fd75c [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:20.851250  6802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09c2a98de1a4decabd0ff900dd44caa" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 21 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:21:20.854532  6880 raft_consensus.cc:1240] T 2c240553ce044eedb41541d72b9475d7 P cd75a17ab2604397adab03bb8b5fd75c [term 20 FOLLOWER]: Rejecting Update request from peer b7ab4784c7344b939bc36f639286f377 for earlier term 19. Current term is 20. Ops: [19.11-19.11]
I20260709 13:21:20.862944 13446 leader_election.cc:290] T 20f6842e26174571996b8dea4151d4be P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:21:20.867787  6877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30e88460611e47b2ba16a46a30b5f416" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:21:20.868539  6877 raft_consensus.cc:3060] T 30e88460611e47b2ba16a46a30b5f416 P cd75a17ab2604397adab03bb8b5fd75c [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:21:20.874572  6844 leader_election.cc:304] T 24ee15416e3145beaa1b8183453729a3 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:21:20.863862 13670 consensus_queue.cc:260] T 7c37d41cd9164c15a6826ca62a851a69 P b7ab4784c7344b939bc36f639286f377 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.14, Last appended by leader: 14, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:20.854503 13669 raft_consensus.cc:697] T bd6869f07b5a4885a0b99fbe60c3b175 P cd75a17ab2604397adab03bb8b5fd75c [term 21 LEADER]: Becoming Leader. State: Replica: cd75a17ab2604397adab03bb8b5fd75c, State: Running, Role: LEADER
I20260709 13:21:20.889169  6880 raft_consensus.cc:1240] T de3186201e1a40d0b335eeb8b4e256e0 P cd75a17ab2604397adab03bb8b5fd75c [term 20 FOLLOWER]: Rejecting Update request from peer b7ab4784c7344b939bc36f639286f377 for earlier term 19. Current term is 20. Ops: []
W20260709 13:21:20.890542  6697 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 209352us
I20260709 13:21:20.900492  6697 leader_election.cc:304] T fe20b4b48823486ca3b9c648db6ce8aa P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb
I20260709 13:21:20.841717 13554 raft_consensus.cc:515] T 9e326172347f45e99a0d482b5d8ef768 P b7ab4784c7344b939bc36f639286f377 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:20.856638 13425 raft_consensus.cc:493] T 711ef6523deb4cbe8ef2ba61e1c21c98 P cd75a17ab2604397adab03bb8b5fd75c [term 21 FOLLOWER]: Starting pre-election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:21:20.886739  6878 raft_consensus.cc:3060] T f58dc08b12a2494bb9a1372837970ca2 P cd75a17ab2604397adab03bb8b5fd75c [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:21:20.893400  6844 leader_election.cc:304] T 7c37d41cd9164c15a6826ca62a851a69 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:21:20.966060 13264 raft_consensus.cc:3060] T 7c37d41cd9164c15a6826ca62a851a69 P cd75a17ab2604397adab03bb8b5fd75c [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:21:20.966195  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 72885.2us
I20260709 13:21:20.931030 13207 raft_consensus.cc:2804] T fe20b4b48823486ca3b9c648db6ce8aa P ccd8a4c3bfe3413cb2ae219b09aea832 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:21:20.967149  6844 leader_election.cc:304] T 07a92dd554674067a83a9cb68c4773f2 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:21:20.967646 13207 raft_consensus.cc:493] T fe20b4b48823486ca3b9c648db6ce8aa P ccd8a4c3bfe3413cb2ae219b09aea832 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 7ba59cc884714e8aa5f3f0ecaed84cbb)
I20260709 13:21:20.902532  6877 raft_consensus.cc:2468] T 30e88460611e47b2ba16a46a30b5f416 P cd75a17ab2604397adab03bb8b5fd75c [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 16.
I20260709 13:21:20.848973 13289 raft_consensus.cc:515] T 95a75bfe094d4bdc963aba3f08dfcd25 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } attrs { replace: true } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:21:20.968137 13207 raft_consensus.cc:3060] T fe20b4b48823486ca3b9c648db6ce8aa P ccd8a4c3bfe3413cb2ae219b09aea832 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:21:20.970736 13658 raft_consensus.cc:2749] T 07a92dd554674067a83a9cb68c4773f2 P cd75a17ab2604397adab03bb8b5fd75c [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:21:20.970808 13289 leader_election.cc:290] T 95a75bfe094d4bdc963aba3f08dfcd25 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:21:20.849304 13640 raft_consensus.cc:515] T 3fa34c08b205435dba97346991aa1f92 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 24 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:21:20.809156 13653 raft_consensus.cc:515] T be1a92657f494cac8dd227d152f50151 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:21:20.855356 13026 raft_consensus.cc:515] T ab432e62819d499eaaf3dd55481dd930 P b7ab4784c7344b939bc36f639286f377 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:20.974666 13653 leader_election.cc:290] T be1a92657f494cac8dd227d152f50151 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:21:20.976420  6798 raft_consensus.cc:1240] T ab432e62819d499eaaf3dd55481dd930 P b7ab4784c7344b939bc36f639286f377 [term 23 FOLLOWER]: Rejecting Update request from peer ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 22. Current term is 23. Ops: []
I20260709 13:21:20.978875 13640 leader_election.cc:290] T 3fa34c08b205435dba97346991aa1f92 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 24 election: Requested vote from peers cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:21:20.981276  6844 leader_election.cc:304] T f5be3a11b23d4ea9b08300a2789821c7 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:21:20.983263  6844 leader_election.cc:304] T bb3d8792045a4583ae2e965b1350a5b4 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:21:20.996841 13660 raft_consensus.cc:2749] T f5be3a11b23d4ea9b08300a2789821c7 P cd75a17ab2604397adab03bb8b5fd75c [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:21:20.997807 13660 raft_consensus.cc:2749] T bb3d8792045a4583ae2e965b1350a5b4 P cd75a17ab2604397adab03bb8b5fd75c [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:21:21.004249 13456 leader_election.cc:290] T f58dc08b12a2494bb9a1372837970ca2 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 19 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:21:21.007207 13634 consensus_queue.cc:1059] T 4275cf08e63345f993bce8664eada830 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: INVALID_TERM, Last received: 18.10, Next index: 11, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:21:21.007690 13651 consensus_queue.cc:1059] T ab432e62819d499eaaf3dd55481dd930 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: INVALID_TERM, Last received: 22.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:21:21.008386 13634 raft_consensus.cc:3055] T 4275cf08e63345f993bce8664eada830 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:21:21.008633 13651 raft_consensus.cc:3055] T ab432e62819d499eaaf3dd55481dd930 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 22 LEADER]: Stepping down as leader of term 22
I20260709 13:21:21.008803 13634 raft_consensus.cc:740] T 4275cf08e63345f993bce8664eada830 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
I20260709 13:21:21.009063 13651 raft_consensus.cc:740] T ab432e62819d499eaaf3dd55481dd930 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 22 LEADER]: Becoming Follower/Learner. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
I20260709 13:21:21.010046 13651 consensus_queue.cc:260] T ab432e62819d499eaaf3dd55481dd930 P ccd8a4c3bfe3413cb2ae219b09aea832 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 22.12, Last appended by leader: 12, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:21.010875 13649 leader_election.cc:290] T be1a92657f494cac8dd227d152f50151 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:21:21.011406 13651 raft_consensus.cc:3060] T ab432e62819d499eaaf3dd55481dd930 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 22 FOLLOWER]: Advancing to term 23
W20260709 13:21:21.029994 13545 consensus_meta.cc:287] T 7887766dc6784fcaa42b35c05fea7a99 P cd75a17ab2604397adab03bb8b5fd75c: Time spent flushing consensus metadata: real 0.760s	user 0.010s	sys 0.003s
I20260709 13:21:21.030751 13545 raft_consensus.cc:493] T e77e330a82df4b43a745d57a68f6f057 P cd75a17ab2604397adab03bb8b5fd75c [term 19 FOLLOWER]: Starting pre-election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:21:20.928609 13425 raft_consensus.cc:515] T 711ef6523deb4cbe8ef2ba61e1c21c98 P cd75a17ab2604397adab03bb8b5fd75c [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:21.040609  6732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20f6842e26174571996b8dea4151d4be" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:21:21.042244  6725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be1a92657f494cac8dd227d152f50151" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 23 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:21:21.042932  6725 raft_consensus.cc:2468] T be1a92657f494cac8dd227d152f50151 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 22.
I20260709 13:21:21.044665  6878 raft_consensus.cc:2468] T f58dc08b12a2494bb9a1372837970ca2 P cd75a17ab2604397adab03bb8b5fd75c [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 20.
I20260709 13:21:21.041558  6732 raft_consensus.cc:2468] T 20f6842e26174571996b8dea4151d4be P ccd8a4c3bfe3413cb2ae219b09aea832 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 21.
W20260709 13:21:21.061290  6697 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 160893us
I20260709 13:21:21.031450 13545 raft_consensus.cc:515] T e77e330a82df4b43a745d57a68f6f057 P cd75a17ab2604397adab03bb8b5fd75c [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } }
I20260709 13:21:20.935796  6802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3f13b31a1f84f0d89d007eadd57924c" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:21:21.095904  6730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab432e62819d499eaaf3dd55481dd930" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
W20260709 13:21:20.939103 13666 log.cc:927] Time spent T 404190ce4ce94cecbfcb6ea9d1dd8626 P ccd8a4c3bfe3413cb2ae219b09aea832: Append to log took a long time: real 0.134s	user 0.001s	sys 0.000s
I20260709 13:21:20.942917 13669 consensus_queue.cc:237] T bd6869f07b5a4885a0b99fbe60c3b175 P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 20.10, Last appended by leader: 10, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:21.024603 13026 leader_election.cc:290] T ab432e62819d499eaaf3dd55481dd930 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 23 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
W20260709 13:21:20.951221 13593 consensus_meta.cc:287] T 07a92dd554674067a83a9cb68c4773f2 P b7ab4784c7344b939bc36f639286f377: Time spent flushing consensus metadata: real 0.624s	user 0.011s	sys 0.001s
W20260709 13:21:20.954306 13588 consensus_meta.cc:287] T dbdf895bba214ff68685a24fd17dfb5d P cd75a17ab2604397adab03bb8b5fd75c: Time spent flushing consensus metadata: real 0.687s	user 0.016s	sys 0.000s
I20260709 13:21:20.958333 13650 consensus_queue.cc:260] T 7a734b5ab7834e05a8c422208acc58b1 P 7ba59cc884714e8aa5f3f0ecaed84cbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 20.11, Last appended by leader: 11, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } attrs { replace: true } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:21:20.958606 13579 consensus_queue.cc:237] T 17587d6730594da4a56fa13a353232a1 P 7ba59cc884714e8aa5f3f0ecaed84cbb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 24.17, Last appended by leader: 17, Current term: 26, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:21:20.904912  6881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4275cf08e63345f993bce8664eada830" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:21:21.124783  6881 raft_consensus.cc:3060] T 4275cf08e63345f993bce8664eada830 P cd75a17ab2604397adab03bb8b5fd75c [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:21:20.871946 13631 raft_consensus.cc:3055] T 30e88460611e47b2ba16a46a30b5f416 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:21:21.070878  6726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e326172347f45e99a0d482b5d8ef768" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:21:21.021819 13597 raft_consensus.cc:3055] T bd6869f07b5a4885a0b99fbe60c3b175 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:21:21.072798 13289 consensus_queue.cc:1059] T bb3d8792045a4583ae2e965b1350a5b4 P 7ba59cc884714e8aa5f3f0ecaed84cbb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: INVALID_TERM, Last received: 18.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 13:21:21.132483  6726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d33d5ee8ef6f415593d8df52063161ad" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
W20260709 13:21:21.074038  6772 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.68:45071, user_credentials={real_user=slave}} blocked reactor thread for 220943us
W20260709 13:21:21.083613  6695 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:21:21.074333  6770 leader_election.cc:304] T be1a92657f494cac8dd227d152f50151 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
I20260709 13:21:21.086546  6725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de3186201e1a40d0b335eeb8b4e256e0" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:21:21.096207  6802 raft_consensus.cc:3060] T b3f13b31a1f84f0d89d007eadd57924c P b7ab4784c7344b939bc36f639286f377 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:21:20.937980  6803 raft_consensus.cc:1240] T 9e326172347f45e99a0d482b5d8ef768 P b7ab4784c7344b939bc36f639286f377 [term 17 FOLLOWER]: Rejecting Update request from peer ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 16. Current term is 17. Ops: []
W20260709 13:21:21.097167  6723 consensus_meta.cc:287] T f58dc08b12a2494bb9a1372837970ca2 P ccd8a4c3bfe3413cb2ae219b09aea832: Time spent flushing consensus metadata: real 0.555s	user 0.007s	sys 0.004s
I20260709 13:21:21.136338  6723 raft_consensus.cc:2468] T f58dc08b12a2494bb9a1372837970ca2 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 20.
I20260709 13:21:21.098320  6807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be1a92657f494cac8dd227d152f50151" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 23 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:21:21.137553  6807 raft_consensus.cc:2468] T be1a92657f494cac8dd227d152f50151 P b7ab4784c7344b939bc36f639286f377 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in term 22.
I20260709 13:21:21.098974  6801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a75bfe094d4bdc963aba3f08dfcd25" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:21:21.044219 13670 raft_consensus.cc:3060] T 7c37d41cd9164c15a6826ca62a851a69 P b7ab4784c7344b939bc36f639286f377 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:21:20.938076 13677 raft_consensus.cc:493] T 713b5728a197487c9300b310ab94e5a3 P cd75a17ab2604397adab03bb8b5fd75c [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:21.023633 13554 leader_election.cc:290] T 9e326172347f45e99a0d482b5d8ef768 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 17 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:21:21.126896  6697 leader_election.cc:304] T 07a92dd554674067a83a9cb68c4773f2 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377
I20260709 13:21:21.127135  6732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c240553ce044eedb41541d72b9475d7" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:21:21.128296  6799 raft_consensus.cc:2468] T 20f6842e26174571996b8dea4151d4be P b7ab4784c7344b939bc36f639286f377 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 21.
W20260709 13:21:21.144671  6770 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 72615.4us
I20260709 13:21:21.148710 13289 raft_consensus.cc:3055] T bb3d8792045a4583ae2e965b1350a5b4 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:21:21.149215 13289 raft_consensus.cc:740] T bb3d8792045a4583ae2e965b1350a5b4 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 7ba59cc884714e8aa5f3f0ecaed84cbb, State: Running, Role: LEADER
I20260709 13:21:21.150151 13289 consensus_queue.cc:260] T bb3d8792045a4583ae2e965b1350a5b4 P 7ba59cc884714e8aa5f3f0ecaed84cbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 18.15, Last appended by leader: 15, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:21:21.150458 13677 raft_consensus.cc:515] T 713b5728a197487c9300b310ab94e5a3 P cd75a17ab2604397adab03bb8b5fd75c [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:21.153569  6725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4b8bd455d5a47c18a1380839c6e0d61" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 20 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:21:21.147789  6726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20f6842e26174571996b8dea4151d4be" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:21:21.155679  6726 raft_consensus.cc:2393] T 20f6842e26174571996b8dea4151d4be P ccd8a4c3bfe3413cb2ae219b09aea832 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c in current term 21: Already voted for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in this term.
I20260709 13:21:21.020767 13634 consensus_queue.cc:260] T 4275cf08e63345f993bce8664eada830 P ccd8a4c3bfe3413cb2ae219b09aea832 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.10, Last appended by leader: 10, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:21.131031 13597 raft_consensus.cc:740] T bd6869f07b5a4885a0b99fbe60c3b175 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
I20260709 13:21:21.159024  7500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be1a92657f494cac8dd227d152f50151" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 23 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:21:21.195752  7500 raft_consensus.cc:2468] T be1a92657f494cac8dd227d152f50151 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 22.
I20260709 13:21:21.103788 13640 raft_consensus.cc:493] T 1528ab62b6fe4e3099d08f141afee116 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 7ba59cc884714e8aa5f3f0ecaed84cbb)
I20260709 13:21:21.196839 13640 raft_consensus.cc:515] T 1528ab62b6fe4e3099d08f141afee116 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
W20260709 13:21:21.197646  6845 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:21:21.199014 13640 leader_election.cc:290] T 1528ab62b6fe4e3099d08f141afee116 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:21:21.145363  6770 leader_election.cc:304] T 20f6842e26174571996b8dea4151d4be P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
I20260709 13:21:21.162387  6877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e326172347f45e99a0d482b5d8ef768" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:21:21.097013 13602 consensus_queue.cc:1048] T c4db81d9d329422bb3b4160ca4ac2d1d P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.037s
I20260709 13:21:21.200340  6877 raft_consensus.cc:3060] T 9e326172347f45e99a0d482b5d8ef768 P cd75a17ab2604397adab03bb8b5fd75c [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:21:21.202169 13593 raft_consensus.cc:2804] T 20f6842e26174571996b8dea4151d4be P b7ab4784c7344b939bc36f639286f377 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:21:21.202553 13593 raft_consensus.cc:493] T 20f6842e26174571996b8dea4151d4be P b7ab4784c7344b939bc36f639286f377 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:21.202888 13593 raft_consensus.cc:3060] T 20f6842e26174571996b8dea4151d4be P b7ab4784c7344b939bc36f639286f377 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:21:21.167593  6726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3f13b31a1f84f0d89d007eadd57924c" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:21:21.203696  6726 raft_consensus.cc:3060] T b3f13b31a1f84f0d89d007eadd57924c P ccd8a4c3bfe3413cb2ae219b09aea832 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:21:21.163470  6878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab432e62819d499eaaf3dd55481dd930" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:21:21.203999 13650 raft_consensus.cc:3060] T 7a734b5ab7834e05a8c422208acc58b1 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:21:21.204427  6878 raft_consensus.cc:3060] T ab432e62819d499eaaf3dd55481dd930 P cd75a17ab2604397adab03bb8b5fd75c [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:21:21.166143  7466 leader_election.cc:304] T be1a92657f494cac8dd227d152f50151 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, b7ab4784c7344b939bc36f639286f377; no voters: 
I20260709 13:21:21.154253  6725 raft_consensus.cc:2468] T f4b8bd455d5a47c18a1380839c6e0d61 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 19.
I20260709 13:21:21.206535  6725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09c2a98de1a4decabd0ff900dd44caa" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 21 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:21:21.206681 13653 raft_consensus.cc:2804] T be1a92657f494cac8dd227d152f50151 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:21:21.207149 13653 raft_consensus.cc:493] T be1a92657f494cac8dd227d152f50151 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:21.207485 13653 raft_consensus.cc:3060] T be1a92657f494cac8dd227d152f50151 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:21:21.208113  6725 raft_consensus.cc:1275] T 1bf4668eeb70467fb3dc5a0289233b3c P ccd8a4c3bfe3413cb2ae219b09aea832 [term 17 FOLLOWER]: Refusing update from remote peer cd75a17ab2604397adab03bb8b5fd75c: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
W20260709 13:21:21.199875  6770 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 54586.8us
W20260709 13:21:21.197155  6772 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:21:21.217192  6845 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:21:21.129890 13631 raft_consensus.cc:740] T 30e88460611e47b2ba16a46a30b5f416 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
I20260709 13:21:21.218258  6723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a75bfe094d4bdc963aba3f08dfcd25" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:21:21.193600  6880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20f6842e26174571996b8dea4151d4be" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:21:21.151764 13289 raft_consensus.cc:3060] T bb3d8792045a4583ae2e965b1350a5b4 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:21:21.220249  6880 raft_consensus.cc:2468] T 20f6842e26174571996b8dea4151d4be P cd75a17ab2604397adab03bb8b5fd75c [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 21.
I20260709 13:21:21.165695 13026 raft_consensus.cc:2804] T be1a92657f494cac8dd227d152f50151 P b7ab4784c7344b939bc36f639286f377 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:21:21.238590 13026 raft_consensus.cc:493] T be1a92657f494cac8dd227d152f50151 P b7ab4784c7344b939bc36f639286f377 [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:21:21.239066  6697 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 144100us
I20260709 13:21:21.240129  6770 leader_election.cc:304] T f58dc08b12a2494bb9a1372837970ca2 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
W20260709 13:21:21.223955 13644 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.776s	user 0.000s	sys 0.026s
W20260709 13:21:21.221225 13657 log.cc:927] Time spent T 4d9def8b32fd443aa94ab1420b06837b P ccd8a4c3bfe3413cb2ae219b09aea832: Append to log took a long time: real 0.087s	user 0.001s	sys 0.000s
I20260709 13:21:21.242764  6726 raft_consensus.cc:2468] T b3f13b31a1f84f0d89d007eadd57924c P ccd8a4c3bfe3413cb2ae219b09aea832 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in term 16.
I20260709 13:21:21.236025  6732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be1a92657f494cac8dd227d152f50151" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 23 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:21:21.239105  6723 raft_consensus.cc:1240] T 3fa34c08b205435dba97346991aa1f92 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 24 FOLLOWER]: Rejecting Update request from peer 7ba59cc884714e8aa5f3f0ecaed84cbb for earlier term 23. Current term is 24. Ops: []
I20260709 13:21:21.243630  6878 raft_consensus.cc:2468] T ab432e62819d499eaaf3dd55481dd930 P cd75a17ab2604397adab03bb8b5fd75c [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 23.
I20260709 13:21:21.250308  6732 raft_consensus.cc:2468] T be1a92657f494cac8dd227d152f50151 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in term 22.
I20260709 13:21:21.195631 13456 raft_consensus.cc:493] T 3d65025eea89441290d85dd053810e31 P cd75a17ab2604397adab03bb8b5fd75c [term 20 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:21:21.245113  6877 raft_consensus.cc:2468] T 9e326172347f45e99a0d482b5d8ef768 P cd75a17ab2604397adab03bb8b5fd75c [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 17.
I20260709 13:21:21.248783  6802 raft_consensus.cc:2468] T b3f13b31a1f84f0d89d007eadd57924c P b7ab4784c7344b939bc36f639286f377 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in term 16.
I20260709 13:21:21.222908 13599 raft_consensus.cc:2804] T 07a92dd554674067a83a9cb68c4773f2 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:21:21.252480  7466 leader_election.cc:304] T b3f13b31a1f84f0d89d007eadd57924c P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
W20260709 13:21:21.273453  6772 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 52551.1us
W20260709 13:21:21.280531  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 297361us
W20260709 13:21:21.253417 13644 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.801s	user 0.001s	sys 0.027s
I20260709 13:21:21.239096 13026 raft_consensus.cc:3060] T be1a92657f494cac8dd227d152f50151 P b7ab4784c7344b939bc36f639286f377 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:21:21.290272  6844 leader_election.cc:304] T 44bde925b2e541b69890d70715b85176 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
W20260709 13:21:21.292873  6770 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 52858.7us
W20260709 13:21:21.293658  6695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 98150.4us
I20260709 13:21:21.297576  6772 leader_election.cc:304] T 7ba5dac66ab5497e9e336f2a3c28cda5 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:21:21.303547  6802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1528ab62b6fe4e3099d08f141afee116" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:21:21.283787 13643 raft_consensus.cc:2804] T b3f13b31a1f84f0d89d007eadd57924c P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:21:21.275746 13599 raft_consensus.cc:493] T 07a92dd554674067a83a9cb68c4773f2 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 17 FOLLOWER]: Starting leader election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:21:21.285888 13677 leader_election.cc:290] T 713b5728a197487c9300b310ab94e5a3 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:21:21.327788  6844 leader_election.cc:304] T b56bf91d90824c959e21e0cee5ba1816 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:21:21.291520 13644 raft_consensus.cc:697] T 853ac0a8cbd64ce99457f170216d4d0f P ccd8a4c3bfe3413cb2ae219b09aea832 [term 17 LEADER]: Becoming Leader. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
I20260709 13:21:21.334576  6798 raft_consensus.cc:1240] T 30e88460611e47b2ba16a46a30b5f416 P b7ab4784c7344b939bc36f639286f377 [term 16 FOLLOWER]: Rejecting Update request from peer ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 15. Current term is 16. Ops: []
I20260709 13:21:21.335578  6772 leader_election.cc:304] T 30e88460611e47b2ba16a46a30b5f416 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:21:21.302258 13554 raft_consensus.cc:2804] T f58dc08b12a2494bb9a1372837970ca2 P b7ab4784c7344b939bc36f639286f377 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:21:21.338871  6807 raft_consensus.cc:1240] T bd6869f07b5a4885a0b99fbe60c3b175 P b7ab4784c7344b939bc36f639286f377 [term 21 FOLLOWER]: Rejecting Update request from peer ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 20. Current term is 21. Ops: []
I20260709 13:21:21.304329 13588 raft_consensus.cc:2749] T 44bde925b2e541b69890d70715b85176 P cd75a17ab2604397adab03bb8b5fd75c [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:21:21.334193  5625 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:21:21.346127  6724 raft_consensus.cc:3060] T 1528ab62b6fe4e3099d08f141afee116 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:21:21.317791 13347 raft_consensus.cc:2749] T 24ee15416e3145beaa1b8183453729a3 P cd75a17ab2604397adab03bb8b5fd75c [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:21:21.288679 13456 raft_consensus.cc:515] T 3d65025eea89441290d85dd053810e31 P cd75a17ab2604397adab03bb8b5fd75c [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:21.329233 13599 raft_consensus.cc:3060] T 07a92dd554674067a83a9cb68c4773f2 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:21:21.360378  7467 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:21:21.319159 13601 consensus_queue.cc:1048] T a1704639a875409b9959353527b3fd68 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.035s
I20260709 13:21:21.295405 13674 consensus_queue.cc:1059] T 3fa34c08b205435dba97346991aa1f92 P 7ba59cc884714e8aa5f3f0ecaed84cbb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: INVALID_TERM, Last received: 23.17, Next index: 18, Last known committed idx: 17, Time since last communication: 0.060s
I20260709 13:21:21.306419 13689 consensus_queue.cc:1048] T 3411566abe2d4c9bb4b2adfdd05e6f17 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.058s
I20260709 13:21:21.301573 13667 consensus_queue.cc:1048] T c4db81d9d329422bb3b4160ca4ac2d1d P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.048s
I20260709 13:21:21.369674 13644 consensus_queue.cc:237] T 853ac0a8cbd64ce99457f170216d4d0f P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.9, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
W20260709 13:21:21.365545 13687 log.cc:927] Time spent T 24ee15416e3145beaa1b8183453729a3 P cd75a17ab2604397adab03bb8b5fd75c: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 13:21:21.354266  6844 leader_election.cc:304] T fe20b4b48823486ca3b9c648db6ce8aa P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:21:21.352133 13554 raft_consensus.cc:697] T f58dc08b12a2494bb9a1372837970ca2 P b7ab4784c7344b939bc36f639286f377 [term 20 LEADER]: Becoming Leader. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
I20260709 13:21:21.442272 13582 raft_consensus.cc:493] T 1528ab62b6fe4e3099d08f141afee116 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:21.343964 13425 leader_election.cc:290] T 711ef6523deb4cbe8ef2ba61e1c21c98 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:21:21.364251 13682 consensus_queue.cc:1059] T de3186201e1a40d0b335eeb8b4e256e0 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: INVALID_TERM, Last received: 19.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.011s
I20260709 13:21:21.363683 13672 raft_consensus.cc:2749] T 7ba5dac66ab5497e9e336f2a3c28cda5 P b7ab4784c7344b939bc36f639286f377 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
W20260709 13:21:21.442835  6770 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 101970us
I20260709 13:21:21.356731 13295 raft_consensus.cc:2804] T 30e88460611e47b2ba16a46a30b5f416 P b7ab4784c7344b939bc36f639286f377 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:21:21.449708 13702 raft_consensus.cc:493] T 07a92dd554674067a83a9cb68c4773f2 P b7ab4784c7344b939bc36f639286f377 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:21.292927 13597 consensus_queue.cc:260] T bd6869f07b5a4885a0b99fbe60c3b175 P ccd8a4c3bfe3413cb2ae219b09aea832 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 20.10, Last appended by leader: 10, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
W20260709 13:21:21.433116 13657 log.cc:927] Time spent T 4d9def8b32fd443aa94ab1420b06837b P ccd8a4c3bfe3413cb2ae219b09aea832: Append to log took a long time: real 0.088s	user 0.000s	sys 0.000s
I20260709 13:21:21.361258 13677 raft_consensus.cc:2749] T b56bf91d90824c959e21e0cee5ba1816 P cd75a17ab2604397adab03bb8b5fd75c [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:21:21.350633 13655 consensus_queue.cc:1059] T 2c240553ce044eedb41541d72b9475d7 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: INVALID_TERM, Last received: 17.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.095s
W20260709 13:21:21.456840  6697 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 79161.4us
I20260709 13:21:21.317899 13662 consensus_queue.cc:1059] T 713b5728a197487c9300b310ab94e5a3 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: INVALID_TERM, Last received: 16.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.036s
I20260709 13:21:21.491513 13662 raft_consensus.cc:3055] T 713b5728a197487c9300b310ab94e5a3 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:21:21.492071 13662 raft_consensus.cc:740] T 713b5728a197487c9300b310ab94e5a3 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
I20260709 13:21:21.493191 13662 consensus_queue.cc:260] T 713b5728a197487c9300b310ab94e5a3 P ccd8a4c3bfe3413cb2ae219b09aea832 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:21.494777 13662 raft_consensus.cc:3060] T 713b5728a197487c9300b310ab94e5a3 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:21:21.497757 13653 raft_consensus.cc:515] T be1a92657f494cac8dd227d152f50151 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 23 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:21:21.470041  6724 raft_consensus.cc:1275] T 1528ab62b6fe4e3099d08f141afee116 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 17 FOLLOWER]: Refusing update from remote peer b7ab4784c7344b939bc36f639286f377: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 13:21:21.441664 13545 leader_election.cc:290] T e77e330a82df4b43a745d57a68f6f057 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391)
W20260709 13:21:21.483054  6695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 144253us
I20260709 13:21:21.479502 13425 raft_consensus.cc:2749] T fe20b4b48823486ca3b9c648db6ce8aa P cd75a17ab2604397adab03bb8b5fd75c [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:21:21.476563 13027 consensus_meta.cc:287] T f4b8bd455d5a47c18a1380839c6e0d61 P b7ab4784c7344b939bc36f639286f377: Time spent flushing consensus metadata: real 0.692s	user 0.012s	sys 0.000s
I20260709 13:21:21.483246  6881 raft_consensus.cc:2468] T 4275cf08e63345f993bce8664eada830 P cd75a17ab2604397adab03bb8b5fd75c [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 19.
W20260709 13:21:21.516525  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 162345us
I20260709 13:21:21.521447 13682 consensus_queue.cc:1048] T 1528ab62b6fe4e3099d08f141afee116 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:21:21.477501 13658 raft_consensus.cc:493] T d8292e16e5654be6bc408560cf256aaa P cd75a17ab2604397adab03bb8b5fd75c [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:21.525169 13027 raft_consensus.cc:515] T f4b8bd455d5a47c18a1380839c6e0d61 P b7ab4784c7344b939bc36f639286f377 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:21.519796  6844 leader_election.cc:304] T f4b8bd455d5a47c18a1380839c6e0d61 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:21:21.533595  6697 leader_election.cc:304] T 34f36d59d88f40fe8a2805e604fc6c0a P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377
I20260709 13:21:21.508833 13295 raft_consensus.cc:697] T 30e88460611e47b2ba16a46a30b5f416 P b7ab4784c7344b939bc36f639286f377 [term 16 LEADER]: Becoming Leader. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
I20260709 13:21:21.475472 13582 raft_consensus.cc:515] T 1528ab62b6fe4e3099d08f141afee116 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:21:21.555136  7468 leader_election.cc:304] T ce4f062dcd314d43a63ca74067cb5ee3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:21:21.557861  6800 raft_consensus.cc:2393] T f4b8bd455d5a47c18a1380839c6e0d61 P b7ab4784c7344b939bc36f639286f377 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c in current term 20: Already voted for candidate b7ab4784c7344b939bc36f639286f377 in this term.
I20260709 13:21:21.537477 13677 raft_consensus.cc:3055] T 7ba5dac66ab5497e9e336f2a3c28cda5 P cd75a17ab2604397adab03bb8b5fd75c [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:21:21.532074 13456 leader_election.cc:290] T 3d65025eea89441290d85dd053810e31 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:21:21.565685 13425 consensus_queue.cc:1048] T 1bf4668eeb70467fb3dc5a0289233b3c P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Connected to new peer: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.006s
I20260709 13:21:21.572131  6798 raft_consensus.cc:1275] T 1bf4668eeb70467fb3dc5a0289233b3c P b7ab4784c7344b939bc36f639286f377 [term 17 FOLLOWER]: Refusing update from remote peer cd75a17ab2604397adab03bb8b5fd75c: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:21:21.540799 13643 raft_consensus.cc:697] T b3f13b31a1f84f0d89d007eadd57924c P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 16 LEADER]: Becoming Leader. State: Replica: 7ba59cc884714e8aa5f3f0ecaed84cbb, State: Running, Role: LEADER
I20260709 13:21:21.525722 13593 raft_consensus.cc:515] T 20f6842e26174571996b8dea4151d4be P b7ab4784c7344b939bc36f639286f377 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:21.575824  6805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f58dc08b12a2494bb9a1372837970ca2" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
W20260709 13:21:21.574596  6772 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.68:45071, user_credentials={real_user=slave}} blocked reactor thread for 129794us
I20260709 13:21:21.579321 13701 raft_consensus.cc:493] T f3f9c2e2bf644115957398fe4c9459db P ccd8a4c3bfe3413cb2ae219b09aea832 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:21.579814 13694 consensus_queue.cc:1059] T 30e88460611e47b2ba16a46a30b5f416 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: INVALID_TERM, Last received: 15.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.048s
I20260709 13:21:21.575330 13653 leader_election.cc:290] T be1a92657f494cac8dd227d152f50151 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 23 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
W20260709 13:21:21.587540  6697 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 62454.7us
I20260709 13:21:21.591349 13642 raft_consensus.cc:3055] T de3186201e1a40d0b335eeb8b4e256e0 P b7ab4784c7344b939bc36f639286f377 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:21:21.591501  7503 raft_consensus.cc:1275] T 1528ab62b6fe4e3099d08f141afee116 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 17 FOLLOWER]: Refusing update from remote peer b7ab4784c7344b939bc36f639286f377: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 13:21:21.601269  6802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d65025eea89441290d85dd053810e31" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:21:21.567134 13588 raft_consensus.cc:2804] T f4b8bd455d5a47c18a1380839c6e0d61 P cd75a17ab2604397adab03bb8b5fd75c [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:21:21.543910 13651 consensus_queue.cc:1059] T bd6869f07b5a4885a0b99fbe60c3b175 P ccd8a4c3bfe3413cb2ae219b09aea832 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: INVALID_TERM, Last received: 20.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.035s
I20260709 13:21:21.606911  6877 raft_consensus.cc:1275] T f3f9c2e2bf644115957398fe4c9459db P cd75a17ab2604397adab03bb8b5fd75c [term 19 FOLLOWER]: Refusing update from remote peer b7ab4784c7344b939bc36f639286f377: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260709 13:21:21.504572 13702 raft_consensus.cc:515] T 07a92dd554674067a83a9cb68c4773f2 P b7ab4784c7344b939bc36f639286f377 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:21.566102 13677 raft_consensus.cc:740] T 7ba5dac66ab5497e9e336f2a3c28cda5 P cd75a17ab2604397adab03bb8b5fd75c [term 20 LEADER]: Becoming Follower/Learner. State: Replica: cd75a17ab2604397adab03bb8b5fd75c, State: Running, Role: LEADER
I20260709 13:21:21.589010 13456 raft_consensus.cc:493] T c4db81d9d329422bb3b4160ca4ac2d1d P cd75a17ab2604397adab03bb8b5fd75c [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:21:21.622916  6695 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:21:21.575861 13545 raft_consensus.cc:493] T a1704639a875409b9959353527b3fd68 P cd75a17ab2604397adab03bb8b5fd75c [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:21.616315  6697 leader_election.cc:304] T c4db81d9d329422bb3b4160ca4ac2d1d P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:21:21.643932  6844 leader_election.cc:304] T 2c240553ce044eedb41541d72b9475d7 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
W20260709 13:21:21.609457 13264 consensus_meta.cc:287] T 7c37d41cd9164c15a6826ca62a851a69 P cd75a17ab2604397adab03bb8b5fd75c: Time spent flushing consensus metadata: real 0.643s	user 0.013s	sys 0.000s
I20260709 13:21:21.646145  6802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "711ef6523deb4cbe8ef2ba61e1c21c98" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:21:21.647748  6877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a75bfe094d4bdc963aba3f08dfcd25" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
W20260709 13:21:21.644579 13207 consensus_meta.cc:287] T fe20b4b48823486ca3b9c648db6ce8aa P ccd8a4c3bfe3413cb2ae219b09aea832: Time spent flushing consensus metadata: real 0.676s	user 0.012s	sys 0.001s
I20260709 13:21:21.650117 13207 raft_consensus.cc:515] T fe20b4b48823486ca3b9c648db6ce8aa P ccd8a4c3bfe3413cb2ae219b09aea832 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:21:21.651154 13702 leader_election.cc:290] T 07a92dd554674067a83a9cb68c4773f2 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:21:21.652287 13207 leader_election.cc:290] T fe20b4b48823486ca3b9c648db6ce8aa P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 15 election: Requested vote from peers cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:21:21.652177 13677 consensus_queue.cc:260] T 7ba5dac66ab5497e9e336f2a3c28cda5 P cd75a17ab2604397adab03bb8b5fd75c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 20.15, Last appended by leader: 15, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:21:21.653810  6802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77e330a82df4b43a745d57a68f6f057" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:21:21.654072  6874 raft_consensus.cc:1240] T 7a734b5ab7834e05a8c422208acc58b1 P cd75a17ab2604397adab03bb8b5fd75c [term 21 FOLLOWER]: Rejecting Update request from peer 7ba59cc884714e8aa5f3f0ecaed84cbb for earlier term 20. Current term is 21. Ops: [20.11-20.11]
I20260709 13:21:21.655247 13594 raft_consensus.cc:2749] T 2c240553ce044eedb41541d72b9475d7 P cd75a17ab2604397adab03bb8b5fd75c [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:21:21.655345  6802 raft_consensus.cc:1240] T 7ba5dac66ab5497e9e336f2a3c28cda5 P b7ab4784c7344b939bc36f639286f377 [term 21 FOLLOWER]: Rejecting Update request from peer cd75a17ab2604397adab03bb8b5fd75c for earlier term 20. Current term is 21. Ops: [20.15-20.15]
W20260709 13:21:21.660576 13696 log.cc:927] Time spent T a1704639a875409b9959353527b3fd68 P ccd8a4c3bfe3413cb2ae219b09aea832: Append to log took a long time: real 0.186s	user 0.000s	sys 0.001s
I20260709 13:21:21.683049  6730 raft_consensus.cc:2468] T ab432e62819d499eaaf3dd55481dd930 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 23.
I20260709 13:21:21.541003 13658 raft_consensus.cc:515] T d8292e16e5654be6bc408560cf256aaa P cd75a17ab2604397adab03bb8b5fd75c [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:21.626822 13667 raft_consensus.cc:493] T 1bf4668eeb70467fb3dc5a0289233b3c P b7ab4784c7344b939bc36f639286f377 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:21.629232 13588 raft_consensus.cc:493] T f4b8bd455d5a47c18a1380839c6e0d61 P cd75a17ab2604397adab03bb8b5fd75c [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:21:21.688416  6695 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:21:21.691475  6697 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 75286.6us
I20260709 13:21:21.642344 13295 consensus_queue.cc:237] T 30e88460611e47b2ba16a46a30b5f416 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:21.705122  6874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a92dd554674067a83a9cb68c4773f2" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:21:21.710388  6877 raft_consensus.cc:1275] T 7887766dc6784fcaa42b35c05fea7a99 P cd75a17ab2604397adab03bb8b5fd75c [term 23 FOLLOWER]: Refusing update from remote peer b7ab4784c7344b939bc36f639286f377: Log matching property violated. Preceding OpId in replica: term: 22 index: 12. Preceding OpId from leader: term: 23 index: 12. (term mismatch)
I20260709 13:21:21.710860  6877 pending_rounds.cc:85] T 7887766dc6784fcaa42b35c05fea7a99 P cd75a17ab2604397adab03bb8b5fd75c: Aborting all ops after (but not including) 11
I20260709 13:21:21.711144  6877 pending_rounds.cc:107] T 7887766dc6784fcaa42b35c05fea7a99 P cd75a17ab2604397adab03bb8b5fd75c: Aborting uncommitted NO_OP operation due to leader change: 22.12
I20260709 13:21:21.711387  6877 raft_consensus.cc:2889] T 7887766dc6784fcaa42b35c05fea7a99 P cd75a17ab2604397adab03bb8b5fd75c [term 23 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:21:21.712479  6697 leader_election.cc:304] T de3186201e1a40d0b335eeb8b4e256e0 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377
I20260709 13:21:21.609762 13642 raft_consensus.cc:740] T de3186201e1a40d0b335eeb8b4e256e0 P b7ab4784c7344b939bc36f639286f377 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
I20260709 13:21:21.649547  6844 leader_election.cc:304] T d33d5ee8ef6f415593d8df52063161ad P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:21:21.694108  6804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "713b5728a197487c9300b310ab94e5a3" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:21:21.709440  6874 raft_consensus.cc:2468] T 07a92dd554674067a83a9cb68c4773f2 P cd75a17ab2604397adab03bb8b5fd75c [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 18.
I20260709 13:21:21.719508  6878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d9def8b32fd443aa94ab1420b06837b" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 22 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:21:21.720165  6880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbdf895bba214ff68685a24fd17dfb5d" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 18 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:21:21.720947  6880 raft_consensus.cc:2468] T dbdf895bba214ff68685a24fd17dfb5d P cd75a17ab2604397adab03bb8b5fd75c [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 18.
I20260709 13:21:21.724860  6880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "853ac0a8cbd64ce99457f170216d4d0f" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
W20260709 13:21:21.733214  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 83891.7us
I20260709 13:21:21.682516 13264 raft_consensus.cc:2749] T 7c37d41cd9164c15a6826ca62a851a69 P cd75a17ab2604397adab03bb8b5fd75c [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:21:21.733999  6844 leader_election.cc:304] T de3186201e1a40d0b335eeb8b4e256e0 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:21:21.734050  7494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce4f062dcd314d43a63ca74067cb5ee3" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:21:21.739825  6878 raft_consensus.cc:1275] T d8292e16e5654be6bc408560cf256aaa P cd75a17ab2604397adab03bb8b5fd75c [term 19 FOLLOWER]: Refusing update from remote peer ccd8a4c3bfe3413cb2ae219b09aea832: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 19 index: 11. (term mismatch)
I20260709 13:21:21.741904  7494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fa34c08b205435dba97346991aa1f92" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb"
I20260709 13:21:21.692289 13644 raft_consensus.cc:2749] T c4db81d9d329422bb3b4160ca4ac2d1d P ccd8a4c3bfe3413cb2ae219b09aea832 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:21:21.606837 13701 raft_consensus.cc:515] T f3f9c2e2bf644115957398fe4c9459db P ccd8a4c3bfe3413cb2ae219b09aea832 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:21.713274 13588 raft_consensus.cc:3060] T f4b8bd455d5a47c18a1380839c6e0d61 P cd75a17ab2604397adab03bb8b5fd75c [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:21:21.740402  6878 pending_rounds.cc:85] T d8292e16e5654be6bc408560cf256aaa P cd75a17ab2604397adab03bb8b5fd75c: Aborting all ops after (but not including) 10
I20260709 13:21:21.759333  6878 pending_rounds.cc:107] T d8292e16e5654be6bc408560cf256aaa P cd75a17ab2604397adab03bb8b5fd75c: Aborting uncommitted NO_OP operation due to leader change: 18.11
I20260709 13:21:21.759655  6878 raft_consensus.cc:2889] T d8292e16e5654be6bc408560cf256aaa P cd75a17ab2604397adab03bb8b5fd75c [term 19 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:21:21.745692  6876 raft_consensus.cc:1240] T 4275cf08e63345f993bce8664eada830 P cd75a17ab2604397adab03bb8b5fd75c [term 19 FOLLOWER]: Rejecting Update request from peer ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 18. Current term is 19. Ops: []
I20260709 13:21:21.748272  6877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce4f062dcd314d43a63ca74067cb5ee3" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:21:21.701543 13698 consensus_queue.cc:1048] T 9e326172347f45e99a0d482b5d8ef768 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.107s
I20260709 13:21:21.752756  6872 raft_consensus.cc:1240] T 30e88460611e47b2ba16a46a30b5f416 P cd75a17ab2604397adab03bb8b5fd75c [term 16 FOLLOWER]: Rejecting Update request from peer ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 15. Current term is 16. Ops: [15.8-15.8]
I20260709 13:21:21.753751  7498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3d8792045a4583ae2e965b1350a5b4" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb"
I20260709 13:21:21.700028 13704 raft_consensus.cc:2804] T 34f36d59d88f40fe8a2805e604fc6c0a P ccd8a4c3bfe3413cb2ae219b09aea832 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:21:21.588124 13554 consensus_queue.cc:237] T f58dc08b12a2494bb9a1372837970ca2 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.10, Last appended by leader: 10, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:21.755473  6874 raft_consensus.cc:1240] T ab432e62819d499eaaf3dd55481dd930 P cd75a17ab2604397adab03bb8b5fd75c [term 23 FOLLOWER]: Rejecting Update request from peer ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 22. Current term is 23. Ops: [22.12-22.12]
I20260709 13:21:21.693243 13674 raft_consensus.cc:2749] T ce4f062dcd314d43a63ca74067cb5ee3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:21:21.743417 13347 raft_consensus.cc:2749] T d33d5ee8ef6f415593d8df52063161ad P cd75a17ab2604397adab03bb8b5fd75c [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:21:21.764401 13703 log.cc:927] Time spent T 404190ce4ce94cecbfcb6ea9d1dd8626 P b7ab4784c7344b939bc36f639286f377: Append to log took a long time: real 0.095s	user 0.001s	sys 0.000s
I20260709 13:21:21.765012 13644 raft_consensus.cc:2804] T de3186201e1a40d0b335eeb8b4e256e0 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:21:21.647143 13456 raft_consensus.cc:515] T c4db81d9d329422bb3b4160ca4ac2d1d P cd75a17ab2604397adab03bb8b5fd75c [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:21.734338 13655 raft_consensus.cc:493] T dbdf895bba214ff68685a24fd17dfb5d P b7ab4784c7344b939bc36f639286f377 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:21.807403  7500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1528ab62b6fe4e3099d08f141afee116" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:21:21.663267 13545 raft_consensus.cc:515] T a1704639a875409b9959353527b3fd68 P cd75a17ab2604397adab03bb8b5fd75c [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:21.794337  7494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe20b4b48823486ca3b9c648db6ce8aa" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb"
I20260709 13:21:21.794713 13711 consensus_queue.cc:1048] T f09c2a98de1a4decabd0ff900dd44caa P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.029s
I20260709 13:21:21.796686 13701 leader_election.cc:290] T f3f9c2e2bf644115957398fe4c9459db P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:21:21.797526  6844 leader_election.cc:304] T f09c2a98de1a4decabd0ff900dd44caa P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:21:21.838667  6844 leader_election.cc:304] T 20f6842e26174571996b8dea4151d4be P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:21:21.802883 13644 raft_consensus.cc:493] T de3186201e1a40d0b335eeb8b4e256e0 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 19 FOLLOWER]: Starting leader election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:21:21.817037 13705 raft_consensus.cc:2749] T de3186201e1a40d0b335eeb8b4e256e0 P cd75a17ab2604397adab03bb8b5fd75c [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:21:21.820080  6800 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:32966 (request call id 1703) took 1080 ms. Trace:
I20260709 13:21:21.848073  6877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe20b4b48823486ca3b9c648db6ce8aa" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
W20260709 13:21:21.820279 13670 consensus_meta.cc:287] T 7c37d41cd9164c15a6826ca62a851a69 P b7ab4784c7344b939bc36f639286f377: Time spent flushing consensus metadata: real 0.661s	user 0.004s	sys 0.007s
I20260709 13:21:21.831537  6803 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:32976 (request call id 3871) took 1495 ms. Trace:
I20260709 13:21:21.834602 13456 leader_election.cc:290] T c4db81d9d329422bb3b4160ca4ac2d1d P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
W20260709 13:21:21.837077  7467 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:21:21.716337 13207 consensus_queue.cc:1048] T 7c44c4849aa54f2b94d1f1bef9ed546f P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.077s
I20260709 13:21:21.849721  6803 rpcz_store.cc:276] 0709 13:21:20.337603 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:21:20.337740 (+   137us) service_pool.cc:224] Handling call
0709 13:21:20.364852 (+ 27112us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:21:21.135903 (+771051us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:21:21.831186 (+695283us) spinlock_profiling.cc:243] Waited 572 ms on lock 0x7b540028aad4. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f9aae01 00007fcc0f9a983e 00007fcc1496e419 00007fcc0dee5bd4 00007fcc0dee5b62 00007fcc0dee5a91 00007fcc0dee5a0c 00007fcc0dee4cc2 00007fcc0dce548c 00007fcc0dce48c6
0709 13:21:21.831421 (+   235us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1315441024}
I20260709 13:21:21.841420  6880 raft_consensus.cc:2468] T 853ac0a8cbd64ce99457f170216d4d0f P cd75a17ab2604397adab03bb8b5fd75c [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 17.
I20260709 13:21:21.848299  6800 rpcz_store.cc:276] 0709 13:21:20.739666 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:21:20.806374 (+ 66708us) service_pool.cc:224] Handling call
0709 13:21:21.819814 (+1013440us) spinlock_profiling.cc:243] Waited 718 ms on lock 0x7b54002c7ed4. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f9ae2fa 00007fcc1496fb17 00007fcc0deea6d4 00007fcc0deea662 00007fcc0deea591 00007fcc0deea50c 00007fcc0dee97c2 00007fcc0dce548c 00007fcc0dce48c6 00007fcc0dce426f
0709 13:21:21.819962 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1652074368}
I20260709 13:21:21.702129 13643 consensus_queue.cc:237] T b3f13b31a1f84f0d89d007eadd57924c P 7ba59cc884714e8aa5f3f0ecaed84cbb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 14.13, Last appended by leader: 13, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:21:21.851686 13644 raft_consensus.cc:3060] T de3186201e1a40d0b335eeb8b4e256e0 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:21:21.767141 13704 raft_consensus.cc:493] T 34f36d59d88f40fe8a2805e604fc6c0a P ccd8a4c3bfe3413cb2ae219b09aea832 [term 16 FOLLOWER]: Starting leader election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:21:21.861217  6800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4db81d9d329422bb3b4160ca4ac2d1d" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 21 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:21:21.865410  6876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fa34c08b205435dba97346991aa1f92" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:21:21.715945 13667 raft_consensus.cc:515] T 1bf4668eeb70467fb3dc5a0289233b3c P b7ab4784c7344b939bc36f639286f377 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:21.870281  6697 leader_election.cc:304] T ce4f062dcd314d43a63ca74067cb5ee3 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, b7ab4784c7344b939bc36f639286f377
I20260709 13:21:21.758281 13594 consensus_queue.cc:1048] T 22ccee1b570c4ad3a57bd7aec085b1b4 P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.094s
I20260709 13:21:21.882653  6876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f9c2e2bf644115957398fe4c9459db" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:21:21.883352  6876 raft_consensus.cc:2468] T f3f9c2e2bf644115957398fe4c9459db P cd75a17ab2604397adab03bb8b5fd75c [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 19.
I20260709 13:21:21.884274  6876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c37d41cd9164c15a6826ca62a851a69" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:21:21.885267  6876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3d8792045a4583ae2e965b1350a5b4" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:21:21.853062 13347 raft_consensus.cc:2749] T f09c2a98de1a4decabd0ff900dd44caa P cd75a17ab2604397adab03bb8b5fd75c [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:21:21.887195 13582 leader_election.cc:290] T 1528ab62b6fe4e3099d08f141afee116 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:21:21.887125 13599 raft_consensus.cc:515] T 07a92dd554674067a83a9cb68c4773f2 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:21.888418  6729 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49998 (request call id 1690) took 1535 ms. Trace:
I20260709 13:21:21.889036  6729 rpcz_store.cc:276] 0709 13:21:20.353438 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:21:20.567711 (+214273us) service_pool.cc:224] Handling call
0709 13:21:20.568148 (+   437us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:21:20.596920 (+ 28772us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:21:20.596972 (+    52us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:21:20.619097 (+ 22125us) log.cc:844] Serialized 26 byte log entry
0709 13:21:20.728554 (+109457us) raft_consensus.cc:1645] Marking committed up to 15
0709 13:21:20.762585 (+ 34031us) log.cc:844] Serialized 14 byte log entry
0709 13:21:20.789699 (+ 27114us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:21:20.789774 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:21:21.226335 (+436561us) spinlock_profiling.cc:243] Waited 6.52 ms on lock 0x7b1800398320. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc15785de1 00007fcc157925b1 00007fcc0c88b2a6 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc15785de1 00007fcc157925b1 00007fcc0c8bd3f3 00007fcc0c8bf7c1
0709 13:21:21.814765 (+588430us) spinlock_profiling.cc:243] Waited 7.83 ms on lock 0x7b1800398320. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc15785de1 00007fcc157925b1 00007fcc0c8bd3f3 00007fcc0c8bf7c1 00007fcc0c8bf779 00007fcc0c8bf709 00007fcc0c8bf6d1 00007fcc0c8be9cd 000000000038f354 000000000038f199 00007fcc0c8a083a
0709 13:21:21.888130 (+ 73365us) raft_consensus.cc:1685] finished
0709 13:21:21.888182 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:21:21.888345 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":17208,"prepare.queue_time_us":54429,"prepare.run_cpu_time_us":40,"prepare.run_wall_time_us":43,"raft.queue_time_us":954,"raft.run_cpu_time_us":310,"raft.run_wall_time_us":24078,"spinlock_wait_cycles":33009280,"thread_start_us":68032,"threads_started":1,"wal-append.queue_time_us":168995}
I20260709 13:21:21.859727 13264 raft_consensus.cc:2804] T 20f6842e26174571996b8dea4151d4be P cd75a17ab2604397adab03bb8b5fd75c [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:21:21.892246 13264 raft_consensus.cc:697] T 20f6842e26174571996b8dea4151d4be P cd75a17ab2604397adab03bb8b5fd75c [term 21 LEADER]: Becoming Leader. State: Replica: cd75a17ab2604397adab03bb8b5fd75c, State: Running, Role: LEADER
I20260709 13:21:21.893220 13264 consensus_queue.cc:237] T 20f6842e26174571996b8dea4151d4be P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 20.12, Last appended by leader: 12, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:21.896571 13593 leader_election.cc:290] T 20f6842e26174571996b8dea4151d4be P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 22 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:21:21.897248  7498 raft_consensus.cc:2468] T bb3d8792045a4583ae2e965b1350a5b4 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 19.
W20260709 13:21:21.901453 13650 consensus_meta.cc:287] T 7a734b5ab7834e05a8c422208acc58b1 P 7ba59cc884714e8aa5f3f0ecaed84cbb: Time spent flushing consensus metadata: real 0.697s	user 0.006s	sys 0.006s
W20260709 13:21:21.902325 13679 log.cc:927] Time spent T 2c240553ce044eedb41541d72b9475d7 P b7ab4784c7344b939bc36f639286f377: Append to log took a long time: real 0.925s	user 0.014s	sys 0.000s
I20260709 13:21:21.902213 13668 raft_consensus.cc:2749] T ce4f062dcd314d43a63ca74067cb5ee3 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:21:21.902910 13709 raft_consensus.cc:493] T 1bf4668eeb70467fb3dc5a0289233b3c P ccd8a4c3bfe3413cb2ae219b09aea832 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:21.903384 13709 raft_consensus.cc:515] T 1bf4668eeb70467fb3dc5a0289233b3c P ccd8a4c3bfe3413cb2ae219b09aea832 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:21.908511  6804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f9c2e2bf644115957398fe4c9459db" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:21:21.902164 13714 raft_consensus.cc:493] T a3022224cc81473690653a83d4e99470 P cd75a17ab2604397adab03bb8b5fd75c [term 21 FOLLOWER]: Starting pre-election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:21:21.909749 13714 raft_consensus.cc:515] T a3022224cc81473690653a83d4e99470 P cd75a17ab2604397adab03bb8b5fd75c [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:21.866636 13655 raft_consensus.cc:515] T dbdf895bba214ff68685a24fd17dfb5d P b7ab4784c7344b939bc36f639286f377 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:21.918401  6802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bf4668eeb70467fb3dc5a0289233b3c" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:21:21.921376  6802 raft_consensus.cc:2468] T 1bf4668eeb70467fb3dc5a0289233b3c P b7ab4784c7344b939bc36f639286f377 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 17.
I20260709 13:21:21.882680  6697 leader_election.cc:304] T 1528ab62b6fe4e3099d08f141afee116 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, b7ab4784c7344b939bc36f639286f377
I20260709 13:21:21.868515 13456 raft_consensus.cc:493] T 7887766dc6784fcaa42b35c05fea7a99 P cd75a17ab2604397adab03bb8b5fd75c [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:21.912176 13641 raft_consensus.cc:493] T 853ac0a8cbd64ce99457f170216d4d0f P b7ab4784c7344b939bc36f639286f377 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:21.906925 13658 leader_election.cc:290] T d8292e16e5654be6bc408560cf256aaa P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:21:21.891562 13667 leader_election.cc:290] T 1bf4668eeb70467fb3dc5a0289233b3c P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:21:21.942189 13655 leader_election.cc:290] T dbdf895bba214ff68685a24fd17dfb5d P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:21:21.944015 13545 leader_election.cc:290] T a1704639a875409b9959353527b3fd68 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:21:21.866252 13704 raft_consensus.cc:3060] T 34f36d59d88f40fe8a2805e604fc6c0a P ccd8a4c3bfe3413cb2ae219b09aea832 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:21:21.905597 13709 leader_election.cc:290] T 1bf4668eeb70467fb3dc5a0289233b3c P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:21:21.912011 13714 leader_election.cc:290] T a3022224cc81473690653a83d4e99470 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
W20260709 13:21:21.966863  7468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 411848us
I20260709 13:21:21.944442  6695 leader_election.cc:304] T 1bf4668eeb70467fb3dc5a0289233b3c P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
W20260709 13:21:21.980280  6697 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.68:45071, user_credentials={real_user=slave}} blocked reactor thread for 97650.9us
I20260709 13:21:21.989974  6697 leader_election.cc:304] T 4d9def8b32fd443aa94ab1420b06837b P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:21:21.989040  6731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4b8bd455d5a47c18a1380839c6e0d61" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 20 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:21:21.991214  6697 leader_election.cc:304] T dbdf895bba214ff68685a24fd17dfb5d P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377
W20260709 13:21:21.992548  6695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 48194us
I20260709 13:21:21.991413  6731 raft_consensus.cc:3060] T f4b8bd455d5a47c18a1380839c6e0d61 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:21:21.994547 13545 raft_consensus.cc:493] T 7c44c4849aa54f2b94d1f1bef9ed546f P cd75a17ab2604397adab03bb8b5fd75c [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:21.834630 13642 consensus_queue.cc:260] T de3186201e1a40d0b335eeb8b4e256e0 P b7ab4784c7344b939bc36f639286f377 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 19.10, Last appended by leader: 10, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
W20260709 13:21:22.012961  7468 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:21:21.975286 13694 consensus_queue.cc:1059] T 9e326172347f45e99a0d482b5d8ef768 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: INVALID_TERM, Last received: 16.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.024s
I20260709 13:21:21.976414 13456 raft_consensus.cc:515] T 7887766dc6784fcaa42b35c05fea7a99 P cd75a17ab2604397adab03bb8b5fd75c [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:22.027666 13545 raft_consensus.cc:515] T 7c44c4849aa54f2b94d1f1bef9ed546f P cd75a17ab2604397adab03bb8b5fd75c [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:22.028709 13655 raft_consensus.cc:493] T bd6869f07b5a4885a0b99fbe60c3b175 P b7ab4784c7344b939bc36f639286f377 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:22.028221  6728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a92dd554674067a83a9cb68c4773f2" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:21:21.996764 13640 raft_consensus.cc:2804] T 1bf4668eeb70467fb3dc5a0289233b3c P ccd8a4c3bfe3413cb2ae219b09aea832 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:21:22.056393 13640 raft_consensus.cc:493] T 1bf4668eeb70467fb3dc5a0289233b3c P ccd8a4c3bfe3413cb2ae219b09aea832 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:22.056890 13640 raft_consensus.cc:3060] T 1bf4668eeb70467fb3dc5a0289233b3c P ccd8a4c3bfe3413cb2ae219b09aea832 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:21:21.980609 13641 raft_consensus.cc:515] T 853ac0a8cbd64ce99457f170216d4d0f P b7ab4784c7344b939bc36f639286f377 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:22.058661 13650 raft_consensus.cc:493] T 7a734b5ab7834e05a8c422208acc58b1 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:22.059249 13650 raft_consensus.cc:515] T 7a734b5ab7834e05a8c422208acc58b1 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } attrs { replace: true } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:21:22.060237  6804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c44c4849aa54f2b94d1f1bef9ed546f" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 22 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:21:22.060585 13641 leader_election.cc:290] T 853ac0a8cbd64ce99457f170216d4d0f P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:21:22.061842 13650 leader_election.cc:290] T 7a734b5ab7834e05a8c422208acc58b1 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:21:22.036854  6728 raft_consensus.cc:2468] T 07a92dd554674067a83a9cb68c4773f2 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 18.
I20260709 13:21:22.037498 13655 raft_consensus.cc:515] T bd6869f07b5a4885a0b99fbe60c3b175 P b7ab4784c7344b939bc36f639286f377 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
W20260709 13:21:22.065361 13719 log.cc:927] Time spent T 30e88460611e47b2ba16a46a30b5f416 P b7ab4784c7344b939bc36f639286f377: Append to log took a long time: real 0.139s	user 0.001s	sys 0.000s
I20260709 13:21:22.066293 13655 leader_election.cc:290] T bd6869f07b5a4885a0b99fbe60c3b175 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:21:22.038398 13545 leader_election.cc:290] T 7c44c4849aa54f2b94d1f1bef9ed546f P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:21:22.038141  6623 catalog_manager.cc:5697] T 3a485a995abc4807b6e511e45419f737 P b7ab4784c7344b939bc36f639286f377 reported cstate change: term changed from 10 to 12, leader changed from ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65) to b7ab4784c7344b939bc36f639286f377 (127.5.126.66). New cstate: current_term: 12 leader_uuid: "b7ab4784c7344b939bc36f639286f377" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } health_report { overall_health: HEALTHY } } }
I20260709 13:21:22.039131 13599 leader_election.cc:290] T 07a92dd554674067a83a9cb68c4773f2 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 18 election: Requested vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
W20260709 13:21:21.998339 13026 consensus_meta.cc:287] T be1a92657f494cac8dd227d152f50151 P b7ab4784c7344b939bc36f639286f377: Time spent flushing consensus metadata: real 0.694s	user 0.013s	sys 0.000s
I20260709 13:21:22.069403 13026 raft_consensus.cc:515] T be1a92657f494cac8dd227d152f50151 P b7ab4784c7344b939bc36f639286f377 [term 23 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:21:22.041390 13694 raft_consensus.cc:3055] T 9e326172347f45e99a0d482b5d8ef768 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:21:21.997172 13639 raft_consensus.cc:2804] T dbdf895bba214ff68685a24fd17dfb5d P ccd8a4c3bfe3413cb2ae219b09aea832 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:21:21.990092 13718 raft_consensus.cc:2749] T 1528ab62b6fe4e3099d08f141afee116 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:21:22.043550 13662 consensus_meta.cc:287] T 713b5728a197487c9300b310ab94e5a3 P ccd8a4c3bfe3413cb2ae219b09aea832: Time spent flushing consensus metadata: real 0.548s	user 0.007s	sys 0.007s
I20260709 13:21:21.994469 13709 raft_consensus.cc:2749] T 4d9def8b32fd443aa94ab1420b06837b P ccd8a4c3bfe3413cb2ae219b09aea832 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:21:22.048564  6805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8292e16e5654be6bc408560cf256aaa" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:21:22.049232 13456 leader_election.cc:290] T 7887766dc6784fcaa42b35c05fea7a99 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:21:22.049250 13723 consensus_queue.cc:1048] T 1bf4668eeb70467fb3dc5a0289233b3c P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:21:22.049860  6802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3022224cc81473690653a83d4e99470" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 22 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:21:22.053107  6800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1704639a875409b9959353527b3fd68" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 23 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:21:22.054872 13714 consensus_queue.cc:1059] T 7ba5dac66ab5497e9e336f2a3c28cda5 P cd75a17ab2604397adab03bb8b5fd75c [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: INVALID_TERM, Last received: 19.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:21:22.032130 13644 raft_consensus.cc:515] T de3186201e1a40d0b335eeb8b4e256e0 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:22.071767  6731 raft_consensus.cc:2468] T f4b8bd455d5a47c18a1380839c6e0d61 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 20.
I20260709 13:21:22.073469  7498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be1a92657f494cac8dd227d152f50151" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 23 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb"
I20260709 13:21:22.082839  7498 raft_consensus.cc:2393] T be1a92657f494cac8dd227d152f50151 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate b7ab4784c7344b939bc36f639286f377 in current term 23: Already voted for candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in this term.
I20260709 13:21:22.083730  6697 leader_election.cc:304] T bb3d8792045a4583ae2e965b1350a5b4 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
I20260709 13:21:22.070474  6623 catalog_manager.cc:5697] T 7c37d41cd9164c15a6826ca62a851a69 P b7ab4784c7344b939bc36f639286f377 reported cstate change: term changed from 5 to 13, leader changed from cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67) to b7ab4784c7344b939bc36f639286f377 (127.5.126.66). New cstate: current_term: 13 leader_uuid: "b7ab4784c7344b939bc36f639286f377" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:22.096719  6731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20f6842e26174571996b8dea4151d4be" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:21:22.098663  6731 raft_consensus.cc:3060] T 20f6842e26174571996b8dea4151d4be P ccd8a4c3bfe3413cb2ae219b09aea832 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:21:22.101271  7468 leader_election.cc:304] T 95a75bfe094d4bdc963aba3f08dfcd25 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:21:22.108855  6804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7887766dc6784fcaa42b35c05fea7a99" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 24 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
W20260709 13:21:22.112757  6695 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:21:22.071843 13026 leader_election.cc:290] T be1a92657f494cac8dd227d152f50151 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 23 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:21:22.118494  6728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bf4668eeb70467fb3dc5a0289233b3c" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:21:22.118908  6725 raft_consensus.cc:1275] T 7887766dc6784fcaa42b35c05fea7a99 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 23 FOLLOWER]: Refusing update from remote peer b7ab4784c7344b939bc36f639286f377: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 23 index: 12. (index mismatch)
I20260709 13:21:22.094817 13639 raft_consensus.cc:493] T dbdf895bba214ff68685a24fd17dfb5d P ccd8a4c3bfe3413cb2ae219b09aea832 [term 17 FOLLOWER]: Starting leader election (detected failure of leader cd75a17ab2604397adab03bb8b5fd75c)
I20260709 13:21:22.081867 13694 raft_consensus.cc:740] T 9e326172347f45e99a0d482b5d8ef768 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
I20260709 13:21:22.128600  6724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbdf895bba214ff68685a24fd17dfb5d" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 19 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:21:22.102584 13295 raft_consensus.cc:493] T f09c2a98de1a4decabd0ff900dd44caa P b7ab4784c7344b939bc36f639286f377 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:21:22.103055 13714 raft_consensus.cc:493] T 34f36d59d88f40fe8a2805e604fc6c0a P cd75a17ab2604397adab03bb8b5fd75c [term 16 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:21:22.115907 13698 raft_consensus.cc:2804] T bb3d8792045a4583ae2e965b1350a5b4 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:21:22.075568 13588 raft_consensus.cc:515] T f4b8bd455d5a47c18a1380839c6e0d61 P cd75a17ab2604397adab03bb8b5fd75c [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:22.134259  6731 raft_consensus.cc:2468] T 20f6842e26174571996b8dea4151d4be P ccd8a4c3bfe3413cb2ae219b09aea832 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 22.
I20260709 13:21:22.120667 13582 raft_consensus.cc:2749] T 95a75bfe094d4bdc963aba3f08dfcd25 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:21:22.130086 13639 raft_consensus.cc:3060] T dbdf895bba214ff68685a24fd17dfb5d P ccd8a4c3bfe3413cb2ae219b09aea832 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:21:22.141670 13704 raft_consensus.cc:515] T 34f36d59d88f40fe8a2805e604fc6c0a P ccd8a4c3bfe3413cb2ae219b09aea832 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:22.144357 13694 consensus_queue.cc:260] T 9e326172347f45e99a0d482b5d8ef768 P ccd8a4c3bfe3413cb2ae219b09aea832 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:22.145745 13694 raft_consensus.cc:3060] T 9e326172347f45e99a0d482b5d8ef768 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:21:22.149056 13644 leader_election.cc:290] T de3186201e1a40d0b335eeb8b4e256e0 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 20 election: Requested vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:21:22.153757  6623 catalog_manager.cc:5697] T f58dc08b12a2494bb9a1372837970ca2 P b7ab4784c7344b939bc36f639286f377 reported cstate change: term changed from 13 to 16, leader changed from ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65) to b7ab4784c7344b939bc36f639286f377 (127.5.126.66). New cstate: current_term: 16 leader_uuid: "b7ab4784c7344b939bc36f639286f377" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:22.160086 13704 leader_election.cc:290] T 34f36d59d88f40fe8a2805e604fc6c0a P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 17 election: Requested vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:21:22.161068  6723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "853ac0a8cbd64ce99457f170216d4d0f" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:21:22.164490  6723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6869f07b5a4885a0b99fbe60c3b175" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 22 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:21:22.155258 13640 raft_consensus.cc:515] T 1bf4668eeb70467fb3dc5a0289233b3c P ccd8a4c3bfe3413cb2ae219b09aea832 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:22.137722 13295 raft_consensus.cc:515] T f09c2a98de1a4decabd0ff900dd44caa P b7ab4784c7344b939bc36f639286f377 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:22.139078 13714 raft_consensus.cc:515] T 34f36d59d88f40fe8a2805e604fc6c0a P cd75a17ab2604397adab03bb8b5fd75c [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:22.169842 13295 leader_election.cc:290] T f09c2a98de1a4decabd0ff900dd44caa P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:21:22.173906 13640 leader_election.cc:290] T 1bf4668eeb70467fb3dc5a0289233b3c P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 18 election: Requested vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:21:22.174762  6728 raft_consensus.cc:2393] T 1bf4668eeb70467fb3dc5a0289233b3c P ccd8a4c3bfe3413cb2ae219b09aea832 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7ab4784c7344b939bc36f639286f377 in current term 18: Already voted for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in this term.
I20260709 13:21:22.176543 13714 leader_election.cc:290] T 34f36d59d88f40fe8a2805e604fc6c0a P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:21:22.177366  6873 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53406 (request call id 3186) took 1020 ms. Trace:
I20260709 13:21:22.177953  6873 rpcz_store.cc:276] 0709 13:21:21.156466 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:21:21.157981 (+  1515us) service_pool.cc:224] Handling call
0709 13:21:21.221749 (+ 63768us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:21:21.451578 (+229829us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:21:21.451607 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:21:21.451649 (+    42us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:21:21.451682 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:21:22.176916 (+725234us) spinlock_profiling.cc:243] Waited 230 ms on lock 0x7b54002198d4. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f9aae01 00007fcc0f9a983e 00007fcc1496e419 00007fcc0dee5bd4 00007fcc0dee5b62 00007fcc0dee5a91 00007fcc0dee5a0c 00007fcc0dee4cc2 00007fcc0dce548c 00007fcc0dce48c6
0709 13:21:22.176976 (+    60us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:21:22.177165 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":528007552}
I20260709 13:21:22.176596  6731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be1a92657f494cac8dd227d152f50151" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 23 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:21:22.181547  6731 raft_consensus.cc:3060] T be1a92657f494cac8dd227d152f50151 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:21:22.181676  6872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a92dd554674067a83a9cb68c4773f2" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:21:22.182714  6872 raft_consensus.cc:2393] T 07a92dd554674067a83a9cb68c4773f2 P cd75a17ab2604397adab03bb8b5fd75c [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate ccd8a4c3bfe3413cb2ae219b09aea832 in current term 18: Already voted for candidate cd75a17ab2604397adab03bb8b5fd75c in this term.
I20260709 13:21:22.183621  6872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6869f07b5a4885a0b99fbe60c3b175" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 22 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:21:22.179627  6873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bf4668eeb70467fb3dc5a0289233b3c" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:21:22.205616  6872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a734b5ab7834e05a8c422208acc58b1" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:21:22.207906 13714 raft_consensus.cc:493] T 8c7f33e544204fbaac4078e3e83bbf4e P cd75a17ab2604397adab03bb8b5fd75c [term 16 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:21:22.208563 13714 raft_consensus.cc:515] T 8c7f33e544204fbaac4078e3e83bbf4e P cd75a17ab2604397adab03bb8b5fd75c [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:22.210263  6726 raft_consensus.cc:1240] T 34f36d59d88f40fe8a2805e604fc6c0a P ccd8a4c3bfe3413cb2ae219b09aea832 [term 17 FOLLOWER]: Rejecting Update request from peer b7ab4784c7344b939bc36f639286f377 for earlier term 16. Current term is 17. Ops: []
I20260709 13:21:22.210667 13714 leader_election.cc:290] T 8c7f33e544204fbaac4078e3e83bbf4e P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:21:22.206651  6872 raft_consensus.cc:2468] T 7a734b5ab7834e05a8c422208acc58b1 P cd75a17ab2604397adab03bb8b5fd75c [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in term 21.
I20260709 13:21:22.216825  6731 raft_consensus.cc:2468] T be1a92657f494cac8dd227d152f50151 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 23.
W20260709 13:21:22.220088  6772 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 67010.7us
I20260709 13:21:22.222440  6876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "853ac0a8cbd64ce99457f170216d4d0f" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:21:22.223390  6876 raft_consensus.cc:2468] T 853ac0a8cbd64ce99457f170216d4d0f P cd75a17ab2604397adab03bb8b5fd75c [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 17.
I20260709 13:21:22.224776  6872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20f6842e26174571996b8dea4151d4be" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:21:22.226454  6873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bf4668eeb70467fb3dc5a0289233b3c" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
W20260709 13:21:22.229439  6695 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:21:22.230839 13588 leader_election.cc:290] T f4b8bd455d5a47c18a1380839c6e0d61 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 20 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:21:22.233289  6874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09c2a98de1a4decabd0ff900dd44caa" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:21:22.233923  6874 raft_consensus.cc:2468] T f09c2a98de1a4decabd0ff900dd44caa P cd75a17ab2604397adab03bb8b5fd75c [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 20.
I20260709 13:21:22.236790  6874 raft_consensus.cc:1240] T 2c240553ce044eedb41541d72b9475d7 P cd75a17ab2604397adab03bb8b5fd75c [term 20 FOLLOWER]: Rejecting Update request from peer b7ab4784c7344b939bc36f639286f377 for earlier term 19. Current term is 20. Ops: [19.11-19.11]
I20260709 13:21:22.236908  6806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34f36d59d88f40fe8a2805e604fc6c0a" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:21:22.238119  6799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c7f33e544204fbaac4078e3e83bbf4e" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:21:22.239180  6801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4b8bd455d5a47c18a1380839c6e0d61" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 20 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:21:22.187830  6623 catalog_manager.cc:5697] T 8c7f33e544204fbaac4078e3e83bbf4e P b7ab4784c7344b939bc36f639286f377 reported cstate change: term changed from 4 to 10, leader changed from cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67) to b7ab4784c7344b939bc36f639286f377 (127.5.126.66). New cstate: current_term: 10 leader_uuid: "b7ab4784c7344b939bc36f639286f377" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:22.239954  6801 raft_consensus.cc:2393] T f4b8bd455d5a47c18a1380839c6e0d61 P b7ab4784c7344b939bc36f639286f377 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c in current term 20: Already voted for candidate b7ab4784c7344b939bc36f639286f377 in this term.
I20260709 13:21:22.242694 13677 raft_consensus.cc:3060] T 7ba5dac66ab5497e9e336f2a3c28cda5 P cd75a17ab2604397adab03bb8b5fd75c [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:21:22.249079 13631 consensus_queue.cc:260] T 30e88460611e47b2ba16a46a30b5f416 P ccd8a4c3bfe3413cb2ae219b09aea832 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:22.250486 13631 raft_consensus.cc:3060] T 30e88460611e47b2ba16a46a30b5f416 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:21:22.243278  6623 catalog_manager.cc:5697] T 44bde925b2e541b69890d70715b85176 P b7ab4784c7344b939bc36f639286f377 reported cstate change: term changed from 4 to 13, leader changed from cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67) to ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65). New cstate: current_term: 13 leader_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } }
I20260709 13:21:22.252277  6872 raft_consensus.cc:1240] T 9e326172347f45e99a0d482b5d8ef768 P cd75a17ab2604397adab03bb8b5fd75c [term 17 FOLLOWER]: Rejecting Update request from peer ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 16. Current term is 17. Ops: [16.9-16.9]
I20260709 13:21:22.253877  6803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34f36d59d88f40fe8a2805e604fc6c0a" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:21:22.233491  6880 raft_consensus.cc:1240] T de3186201e1a40d0b335eeb8b4e256e0 P cd75a17ab2604397adab03bb8b5fd75c [term 20 FOLLOWER]: Rejecting Update request from peer b7ab4784c7344b939bc36f639286f377 for earlier term 19. Current term is 20. Ops: []
I20260709 13:21:22.258697  6876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbdf895bba214ff68685a24fd17dfb5d" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 19 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:21:22.259205  6876 raft_consensus.cc:2468] T dbdf895bba214ff68685a24fd17dfb5d P cd75a17ab2604397adab03bb8b5fd75c [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 18.
I20260709 13:21:22.260965  6801 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1bf4668eeb70467fb3dc5a0289233b3c"
dest_uuid: "b7ab4784c7344b939bc36f639286f377"
mode: GRACEFUL
new_leader_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
 from {username='slave'} at 127.0.0.1:38240
I20260709 13:21:22.261950  6801 raft_consensus.cc:606] T 1bf4668eeb70467fb3dc5a0289233b3c P b7ab4784c7344b939bc36f639286f377 [term 17 FOLLOWER]: Received request to transfer leadership to TS cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:21:22.262430  6801 raft_consensus.cc:614] T 1bf4668eeb70467fb3dc5a0289233b3c P b7ab4784c7344b939bc36f639286f377 [term 17 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:21:22.262714  6803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de3186201e1a40d0b335eeb8b4e256e0" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:21:22.265039  6772 leader_election.cc:304] T ab432e62819d499eaaf3dd55481dd930 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:21:22.269057  6873 raft_consensus.cc:1275] T d33d5ee8ef6f415593d8df52063161ad P cd75a17ab2604397adab03bb8b5fd75c [term 18 FOLLOWER]: Refusing update from remote peer ccd8a4c3bfe3413cb2ae219b09aea832: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 18 index: 10. (term mismatch)
I20260709 13:21:22.269588  6799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a92dd554674067a83a9cb68c4773f2" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:21:22.269948  6873 pending_rounds.cc:85] T d33d5ee8ef6f415593d8df52063161ad P cd75a17ab2604397adab03bb8b5fd75c: Aborting all ops after (but not including) 9
I20260709 13:21:22.269770  6772 leader_election.cc:304] T 9e326172347f45e99a0d482b5d8ef768 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:21:22.270331  6873 pending_rounds.cc:107] T d33d5ee8ef6f415593d8df52063161ad P cd75a17ab2604397adab03bb8b5fd75c: Aborting uncommitted NO_OP operation due to leader change: 17.10
I20260709 13:21:22.270654  6873 raft_consensus.cc:2889] T d33d5ee8ef6f415593d8df52063161ad P cd75a17ab2604397adab03bb8b5fd75c [term 18 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:21:22.272413  6806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bf4668eeb70467fb3dc5a0289233b3c" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:21:22.276718  6879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4275cf08e63345f993bce8664eada830" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:21:22.277655  6879 raft_consensus.cc:2376] T 4275cf08e63345f993bce8664eada830 P cd75a17ab2604397adab03bb8b5fd75c [term 19 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 19. Re-sending same reply.
I20260709 13:21:22.308084  6772 leader_election.cc:304] T 07a92dd554674067a83a9cb68c4773f2 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:21:22.279991 13684 raft_consensus.cc:2804] T ab432e62819d499eaaf3dd55481dd930 P b7ab4784c7344b939bc36f639286f377 [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:21:22.280323 13649 raft_consensus.cc:2804] T 9e326172347f45e99a0d482b5d8ef768 P b7ab4784c7344b939bc36f639286f377 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:21:22.312107  6772 leader_election.cc:304] T 853ac0a8cbd64ce99457f170216d4d0f P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:21:22.309721 13617 consensus_queue.cc:1048] T f3f9c2e2bf644115957398fe4c9459db P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.008s
I20260709 13:21:22.319209 13649 raft_consensus.cc:697] T 9e326172347f45e99a0d482b5d8ef768 P b7ab4784c7344b939bc36f639286f377 [term 17 LEADER]: Becoming Leader. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
I20260709 13:21:22.319484 13617 raft_consensus.cc:2804] T 853ac0a8cbd64ce99457f170216d4d0f P b7ab4784c7344b939bc36f639286f377 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:21:22.319972 13617 raft_consensus.cc:493] T 853ac0a8cbd64ce99457f170216d4d0f P b7ab4784c7344b939bc36f639286f377 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:22.320436 13617 raft_consensus.cc:3060] T 853ac0a8cbd64ce99457f170216d4d0f P b7ab4784c7344b939bc36f639286f377 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:21:22.320497 13649 consensus_queue.cc:237] T 9e326172347f45e99a0d482b5d8ef768 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 16.9, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:22.325140  6799 raft_consensus.cc:2468] T 07a92dd554674067a83a9cb68c4773f2 P b7ab4784c7344b939bc36f639286f377 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 18.
I20260709 13:21:22.317054 13684 raft_consensus.cc:697] T ab432e62819d499eaaf3dd55481dd930 P b7ab4784c7344b939bc36f639286f377 [term 23 LEADER]: Becoming Leader. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
I20260709 13:21:22.312463 13655 consensus_queue.cc:1048] T 7887766dc6784fcaa42b35c05fea7a99 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.022s
I20260709 13:21:22.334286 13684 consensus_queue.cc:237] T ab432e62819d499eaaf3dd55481dd930 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 22.12, Last appended by leader: 12, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:22.339396 13698 raft_consensus.cc:697] T bb3d8792045a4583ae2e965b1350a5b4 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 19 LEADER]: Becoming Leader. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
I20260709 13:21:22.340498 13698 consensus_queue.cc:237] T bb3d8792045a4583ae2e965b1350a5b4 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 18.15, Last appended by leader: 15, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:21:22.334172 13639 raft_consensus.cc:515] T dbdf895bba214ff68685a24fd17dfb5d P ccd8a4c3bfe3413cb2ae219b09aea832 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:22.343863  6772 leader_election.cc:304] T f09c2a98de1a4decabd0ff900dd44caa P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:21:22.346082 13671 raft_consensus.cc:2804] T 07a92dd554674067a83a9cb68c4773f2 P b7ab4784c7344b939bc36f639286f377 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:21:22.347234 13686 raft_consensus.cc:2804] T f09c2a98de1a4decabd0ff900dd44caa P b7ab4784c7344b939bc36f639286f377 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:21:22.347661 13686 raft_consensus.cc:493] T f09c2a98de1a4decabd0ff900dd44caa P b7ab4784c7344b939bc36f639286f377 [term 20 FOLLOWER]: Starting leader election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:21:22.348170 13686 raft_consensus.cc:3060] T f09c2a98de1a4decabd0ff900dd44caa P b7ab4784c7344b939bc36f639286f377 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:21:22.349174 13639 leader_election.cc:290] T dbdf895bba214ff68685a24fd17dfb5d P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 18 election: Requested vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:21:22.349545  6724 raft_consensus.cc:2468] T dbdf895bba214ff68685a24fd17dfb5d P ccd8a4c3bfe3413cb2ae219b09aea832 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 18.
I20260709 13:21:22.352916 13634 raft_consensus.cc:3060] T 4275cf08e63345f993bce8664eada830 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:21:22.361761  6695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 106356us
I20260709 13:21:22.357861 13597 raft_consensus.cc:3060] T bd6869f07b5a4885a0b99fbe60c3b175 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:21:22.364833 13718 raft_consensus.cc:493] T f5be3a11b23d4ea9b08300a2789821c7 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:21:22.365468 13718 raft_consensus.cc:515] T f5be3a11b23d4ea9b08300a2789821c7 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:22.367708 13718 leader_election.cc:290] T f5be3a11b23d4ea9b08300a2789821c7 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
W20260709 13:21:22.369071  6730 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50004 (request call id 3137) took 1298 ms (client timeout 1553 ms). Trace:
I20260709 13:21:22.375203  6880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bf4668eeb70467fb3dc5a0289233b3c" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:21:22.376927  6880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbdf895bba214ff68685a24fd17dfb5d" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 18 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
W20260709 13:21:22.375568  6730 rpcz_store.cc:269] 0709 13:21:21.070771 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:21:21.095611 (+ 24840us) service_pool.cc:224] Handling call
0709 13:21:22.368862 (+1273251us) spinlock_profiling.cc:243] Waited 345 ms on lock 0x7b5400058a54. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f9ae2fa 00007fcc1496fb17 00007fcc0deea6d4 00007fcc0deea662 00007fcc0deea591 00007fcc0deea50c 00007fcc0dee97c2 00007fcc0dce548c 00007fcc0dce48c6 00007fcc0dce426f
0709 13:21:22.368977 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":794579200}
I20260709 13:21:22.369994  6697 leader_election.cc:304] T fe20b4b48823486ca3b9c648db6ce8aa P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:21:22.370508 13711 raft_consensus.cc:493] T 90d42e216d9741e190bca19a781291fd P ccd8a4c3bfe3413cb2ae219b09aea832 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:21:22.371671  6727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f58dc08b12a2494bb9a1372837970ca2" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:21:22.400007  6879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34f36d59d88f40fe8a2805e604fc6c0a" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:21:22.405073  6879 raft_consensus.cc:3060] T 34f36d59d88f40fe8a2805e604fc6c0a P cd75a17ab2604397adab03bb8b5fd75c [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:21:22.405659  6770 leader_election.cc:304] T f4b8bd455d5a47c18a1380839c6e0d61 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
I20260709 13:21:22.407269 13678 raft_consensus.cc:2804] T f4b8bd455d5a47c18a1380839c6e0d61 P b7ab4784c7344b939bc36f639286f377 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:21:22.399942  6732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "711ef6523deb4cbe8ef2ba61e1c21c98" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:21:22.412740  6724 raft_consensus.cc:1275] T 22ccee1b570c4ad3a57bd7aec085b1b4 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 15 FOLLOWER]: Refusing update from remote peer cd75a17ab2604397adab03bb8b5fd75c: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:21:22.413123  6727 raft_consensus.cc:2368] T f58dc08b12a2494bb9a1372837970ca2 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c for earlier term 19. Current term is 20.
I20260709 13:21:22.410691  6770 leader_election.cc:304] T 20f6842e26174571996b8dea4151d4be P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:21:22.380565  6731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77e330a82df4b43a745d57a68f6f057" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:21:22.399596  6729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "713b5728a197487c9300b310ab94e5a3" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:21:22.379344  6878 raft_consensus.cc:1275] T 853ac0a8cbd64ce99457f170216d4d0f P cd75a17ab2604397adab03bb8b5fd75c [term 17 FOLLOWER]: Refusing update from remote peer ccd8a4c3bfe3413cb2ae219b09aea832: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 13:21:22.416270  6880 raft_consensus.cc:2468] T dbdf895bba214ff68685a24fd17dfb5d P cd75a17ab2604397adab03bb8b5fd75c [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 18.
I20260709 13:21:22.381829  6726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d65025eea89441290d85dd053810e31" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:21:22.416707  6729 raft_consensus.cc:2468] T 713b5728a197487c9300b310ab94e5a3 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 17.
I20260709 13:21:22.419442  6730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09c2a98de1a4decabd0ff900dd44caa" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:21:22.378618 13264 raft_consensus.cc:493] T 4d9def8b32fd443aa94ab1420b06837b P cd75a17ab2604397adab03bb8b5fd75c [term 21 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:21:22.423596 13264 raft_consensus.cc:515] T 4d9def8b32fd443aa94ab1420b06837b P cd75a17ab2604397adab03bb8b5fd75c [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:22.424077 13495 raft_consensus.cc:493] T e31b9971c15848dea59d4d4130141d9e P ccd8a4c3bfe3413cb2ae219b09aea832 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:21:22.424612 13495 raft_consensus.cc:515] T e31b9971c15848dea59d4d4130141d9e P ccd8a4c3bfe3413cb2ae219b09aea832 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:22.425305 13711 raft_consensus.cc:515] T 90d42e216d9741e190bca19a781291fd P ccd8a4c3bfe3413cb2ae219b09aea832 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:22.407795 13665 consensus_queue.cc:1048] T 7887766dc6784fcaa42b35c05fea7a99 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.018s
I20260709 13:21:22.425886 13264 leader_election.cc:290] T 4d9def8b32fd443aa94ab1420b06837b P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:21:22.426596 13495 leader_election.cc:290] T e31b9971c15848dea59d4d4130141d9e P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:21:22.396431 13617 raft_consensus.cc:515] T 853ac0a8cbd64ce99457f170216d4d0f P b7ab4784c7344b939bc36f639286f377 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:22.427680 13711 leader_election.cc:290] T 90d42e216d9741e190bca19a781291fd P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:21:22.429803  6877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de3186201e1a40d0b335eeb8b4e256e0" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:21:22.432256  6877 raft_consensus.cc:2393] T de3186201e1a40d0b335eeb8b4e256e0 P cd75a17ab2604397adab03bb8b5fd75c [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate ccd8a4c3bfe3413cb2ae219b09aea832 in current term 20: Already voted for candidate cd75a17ab2604397adab03bb8b5fd75c in this term.
I20260709 13:21:22.433432  6724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8292e16e5654be6bc408560cf256aaa" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:21:22.429653  6729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3022224cc81473690653a83d4e99470" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 22 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:21:22.441773  6770 leader_election.cc:304] T be1a92657f494cac8dd227d152f50151 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb
I20260709 13:21:22.447306 13661 raft_consensus.cc:2804] T be1a92657f494cac8dd227d152f50151 P b7ab4784c7344b939bc36f639286f377 [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:21:22.407857 13678 raft_consensus.cc:697] T f4b8bd455d5a47c18a1380839c6e0d61 P b7ab4784c7344b939bc36f639286f377 [term 20 LEADER]: Becoming Leader. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
I20260709 13:21:22.378674 13723 raft_consensus.cc:493] T 427c124d773f483294511e80fe340075 P cd75a17ab2604397adab03bb8b5fd75c [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 7ba59cc884714e8aa5f3f0ecaed84cbb)
I20260709 13:21:22.459242  6727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4db81d9d329422bb3b4160ca4ac2d1d" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 21 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
W20260709 13:21:22.464459  6772 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 104574us
I20260709 13:21:22.467309 13027 leader_election.cc:290] T f4b8bd455d5a47c18a1380839c6e0d61 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 20 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:21:22.468379 13676 consensus_queue.cc:1059] T 2c240553ce044eedb41541d72b9475d7 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: INVALID_TERM, Last received: 17.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
W20260709 13:21:22.450148  6697 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 80175.2us
I20260709 13:21:22.476856  6697 leader_election.cc:304] T 3fa34c08b205435dba97346991aa1f92 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 24 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:21:22.481840  6697 leader_election.cc:304] T f3f9c2e2bf644115957398fe4c9459db P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377
I20260709 13:21:22.483033  6697 leader_election.cc:304] T 7c37d41cd9164c15a6826ca62a851a69 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:21:22.369127 13668 raft_consensus.cc:493] T 24ee15416e3145beaa1b8183453729a3 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 7ba59cc884714e8aa5f3f0ecaed84cbb)
I20260709 13:21:22.462604  6770 leader_election.cc:304] T dbdf895bba214ff68685a24fd17dfb5d P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
I20260709 13:21:22.448194 13615 raft_consensus.cc:2804] T 20f6842e26174571996b8dea4151d4be P b7ab4784c7344b939bc36f639286f377 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:21:22.460141 13698 raft_consensus.cc:2749] T fe20b4b48823486ca3b9c648db6ce8aa P ccd8a4c3bfe3413cb2ae219b09aea832 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:21:22.459813 13661 raft_consensus.cc:697] T be1a92657f494cac8dd227d152f50151 P b7ab4784c7344b939bc36f639286f377 [term 23 LEADER]: Becoming Leader. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
I20260709 13:21:22.448678 13665 consensus_queue.cc:1059] T 34f36d59d88f40fe8a2805e604fc6c0a P b7ab4784c7344b939bc36f639286f377 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: INVALID_TERM, Last received: 16.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.026s
I20260709 13:21:22.469405 13678 consensus_queue.cc:237] T f4b8bd455d5a47c18a1380839c6e0d61 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 18.9, Last appended by leader: 9, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:22.496433  6879 raft_consensus.cc:2468] T 34f36d59d88f40fe8a2805e604fc6c0a P cd75a17ab2604397adab03bb8b5fd75c [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 17.
I20260709 13:21:22.399083 13686 raft_consensus.cc:515] T f09c2a98de1a4decabd0ff900dd44caa P b7ab4784c7344b939bc36f639286f377 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:22.488200 13704 raft_consensus.cc:2804] T f3f9c2e2bf644115957398fe4c9459db P ccd8a4c3bfe3413cb2ae219b09aea832 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:21:22.489290 13634 raft_consensus.cc:2749] T 7c37d41cd9164c15a6826ca62a851a69 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:21:22.528007  6731 raft_consensus.cc:1240] T 1bf4668eeb70467fb3dc5a0289233b3c P ccd8a4c3bfe3413cb2ae219b09aea832 [term 18 FOLLOWER]: Rejecting Update request from peer cd75a17ab2604397adab03bb8b5fd75c for earlier term 17. Current term is 18. Ops: [17.11-17.11]
I20260709 13:21:22.530161  6770 leader_election.cc:304] T 1bf4668eeb70467fb3dc5a0289233b3c P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:21:22.512982 13665 raft_consensus.cc:3055] T 34f36d59d88f40fe8a2805e604fc6c0a P b7ab4784c7344b939bc36f639286f377 [term 16 LEADER]: Stepping down as leader of term 16
W20260709 13:21:22.513362 13737 log.cc:927] Time spent T 1bf4668eeb70467fb3dc5a0289233b3c P cd75a17ab2604397adab03bb8b5fd75c: Append to log took a long time: real 0.058s	user 0.001s	sys 0.000s
I20260709 13:21:22.513547  7503 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50744 (request call id 592) took 1075 ms. Trace:
I20260709 13:21:22.535847  7503 rpcz_store.cc:276] 0709 13:21:21.437916 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:21:21.438067 (+   151us) service_pool.cc:224] Handling call
0709 13:21:21.451539 (+ 13472us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:21:21.610824 (+159285us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:21:22.513266 (+902442us) spinlock_profiling.cc:243] Waited 137 ms on lock 0x7b5400644954. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f9aae01 00007fcc0f9a983e 00007fcc1496e419 00007fcc0dee5bd4 00007fcc0dee5b62 00007fcc0dee5a91 00007fcc0dee5a0c 00007fcc0dee4cc2 00007fcc0dce548c 00007fcc0dce48c6
0709 13:21:22.513480 (+   214us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":315522432}
I20260709 13:21:22.514446 13615 raft_consensus.cc:697] T 20f6842e26174571996b8dea4151d4be P b7ab4784c7344b939bc36f639286f377 [term 22 LEADER]: Becoming Leader. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
I20260709 13:21:22.514176 13661 consensus_queue.cc:237] T be1a92657f494cac8dd227d152f50151 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 21.16, Last appended by leader: 16, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:21:22.514662 13671 raft_consensus.cc:493] T 07a92dd554674067a83a9cb68c4773f2 P b7ab4784c7344b939bc36f639286f377 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:22.517727  6799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d9def8b32fd443aa94ab1420b06837b" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:21:22.518414  6804 raft_consensus.cc:1275] T bd6869f07b5a4885a0b99fbe60c3b175 P b7ab4784c7344b939bc36f639286f377 [term 21 FOLLOWER]: Refusing update from remote peer cd75a17ab2604397adab03bb8b5fd75c: Log matching property violated. Preceding OpId in replica: term: 20 index: 10. Preceding OpId from leader: term: 21 index: 11. (index mismatch)
I20260709 13:21:22.501400 13649 raft_consensus.cc:2804] T dbdf895bba214ff68685a24fd17dfb5d P b7ab4784c7344b939bc36f639286f377 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:21:22.499605 13027 consensus_queue.cc:1059] T de3186201e1a40d0b335eeb8b4e256e0 P b7ab4784c7344b939bc36f639286f377 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: INVALID_TERM, Last received: 19.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.011s
I20260709 13:21:22.513074 13697 raft_consensus.cc:2749] T 3fa34c08b205435dba97346991aa1f92 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 24 FOLLOWER]: Leader election lost for term 24. Reason: could not achieve majority
I20260709 13:21:22.464710 13723 raft_consensus.cc:515] T 427c124d773f483294511e80fe340075 P cd75a17ab2604397adab03bb8b5fd75c [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } attrs { replace: true } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:21:22.528533 13704 raft_consensus.cc:493] T f3f9c2e2bf644115957398fe4c9459db P ccd8a4c3bfe3413cb2ae219b09aea832 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:22.559358 13723 leader_election.cc:290] T 427c124d773f483294511e80fe340075 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:21:22.546059 13671 raft_consensus.cc:3060] T 07a92dd554674067a83a9cb68c4773f2 P b7ab4784c7344b939bc36f639286f377 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:21:22.546278 13615 consensus_queue.cc:237] T 20f6842e26174571996b8dea4151d4be P b7ab4784c7344b939bc36f639286f377 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 20.12, Last appended by leader: 12, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:22.532182 13665 raft_consensus.cc:740] T 34f36d59d88f40fe8a2805e604fc6c0a P b7ab4784c7344b939bc36f639286f377 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
I20260709 13:21:22.538362 13655 raft_consensus.cc:3060] T 1bf4668eeb70467fb3dc5a0289233b3c P b7ab4784c7344b939bc36f639286f377 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:21:22.560537  6732 raft_consensus.cc:1275] T 30e88460611e47b2ba16a46a30b5f416 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 16 FOLLOWER]: Refusing update from remote peer b7ab4784c7344b939bc36f639286f377: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 13:21:22.543210  6697 leader_election.cc:304] T 1bf4668eeb70467fb3dc5a0289233b3c P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:21:22.555234 13711 consensus_queue.cc:1048] T d8292e16e5654be6bc408560cf256aaa P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:21:22.502786 13668 raft_consensus.cc:515] T 24ee15416e3145beaa1b8183453729a3 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:21:22.559398 13704 raft_consensus.cc:3060] T f3f9c2e2bf644115957398fe4c9459db P ccd8a4c3bfe3413cb2ae219b09aea832 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:21:22.561348 13649 raft_consensus.cc:493] T dbdf895bba214ff68685a24fd17dfb5d P b7ab4784c7344b939bc36f639286f377 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:22.577461  6697 leader_election.cc:304] T dbdf895bba214ff68685a24fd17dfb5d P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:21:22.586014 13634 consensus_queue.cc:1048] T 853ac0a8cbd64ce99457f170216d4d0f P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:21:22.587934 13495 raft_consensus.cc:2804] T dbdf895bba214ff68685a24fd17dfb5d P ccd8a4c3bfe3413cb2ae219b09aea832 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:21:22.588634 13495 raft_consensus.cc:697] T dbdf895bba214ff68685a24fd17dfb5d P ccd8a4c3bfe3413cb2ae219b09aea832 [term 18 LEADER]: Becoming Leader. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
I20260709 13:21:22.589653 13495 consensus_queue.cc:237] T dbdf895bba214ff68685a24fd17dfb5d P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 17.8, Last appended by leader: 8, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:22.594827  6723 raft_consensus.cc:2468] T bd6869f07b5a4885a0b99fbe60c3b175 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 21.
I20260709 13:21:22.596472  6727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4b8bd455d5a47c18a1380839c6e0d61" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 20 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:21:22.597313  6727 raft_consensus.cc:2393] T f4b8bd455d5a47c18a1380839c6e0d61 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c in current term 20: Already voted for candidate b7ab4784c7344b939bc36f639286f377 in this term.
I20260709 13:21:22.598241  6731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7887766dc6784fcaa42b35c05fea7a99" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 24 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:21:22.600618  6732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c44c4849aa54f2b94d1f1bef9ed546f" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 22 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:21:22.564154 13698 consensus_queue.cc:1048] T d33d5ee8ef6f415593d8df52063161ad P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.037s
I20260709 13:21:22.618779  6728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34f36d59d88f40fe8a2805e604fc6c0a" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:21:22.654480  6728 raft_consensus.cc:2393] T 34f36d59d88f40fe8a2805e604fc6c0a P ccd8a4c3bfe3413cb2ae219b09aea832 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c in current term 17: Already voted for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in this term.
I20260709 13:21:22.624264 13222 consensus_queue.cc:1048] T 30e88460611e47b2ba16a46a30b5f416 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:21:22.655941  6725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c7f33e544204fbaac4078e3e83bbf4e" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:21:22.659000  6770 leader_election.cc:304] T bd6869f07b5a4885a0b99fbe60c3b175 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:21:22.638707 13617 leader_election.cc:290] T 853ac0a8cbd64ce99457f170216d4d0f P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 18 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:21:22.647250 13579 raft_consensus.cc:3055] T 3fa34c08b205435dba97346991aa1f92 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 23 LEADER]: Stepping down as leader of term 23
I20260709 13:21:22.662396  6726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1704639a875409b9959353527b3fd68" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 23 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:21:22.584952 13649 raft_consensus.cc:3060] T dbdf895bba214ff68685a24fd17dfb5d P b7ab4784c7344b939bc36f639286f377 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:21:22.651835  6732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "853ac0a8cbd64ce99457f170216d4d0f" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:21:22.651998 13665 consensus_queue.cc:260] T 34f36d59d88f40fe8a2805e604fc6c0a P b7ab4784c7344b939bc36f639286f377 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:22.580953 13694 raft_consensus.cc:2749] T 1bf4668eeb70467fb3dc5a0289233b3c P ccd8a4c3bfe3413cb2ae219b09aea832 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:21:22.602337 13447 raft_consensus.cc:3055] T 2c240553ce044eedb41541d72b9475d7 P b7ab4784c7344b939bc36f639286f377 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:21:22.667975  6804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "427c124d773f483294511e80fe340075" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:21:22.673224  6804 raft_consensus.cc:2468] T 427c124d773f483294511e80fe340075 P b7ab4784c7344b939bc36f639286f377 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 18.
I20260709 13:21:22.678440  6725 raft_consensus.cc:1240] T 20f6842e26174571996b8dea4151d4be P ccd8a4c3bfe3413cb2ae219b09aea832 [term 22 FOLLOWER]: Rejecting Update request from peer cd75a17ab2604397adab03bb8b5fd75c for earlier term 21. Current term is 22. Ops: []
I20260709 13:21:22.680850  6725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d9def8b32fd443aa94ab1420b06837b" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:21:22.662169 13579 raft_consensus.cc:740] T 3fa34c08b205435dba97346991aa1f92 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 23 LEADER]: Becoming Follower/Learner. State: Replica: 7ba59cc884714e8aa5f3f0ecaed84cbb, State: Running, Role: LEADER
I20260709 13:21:22.691275  6726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "427c124d773f483294511e80fe340075" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:21:22.689498  6695 leader_election.cc:304] T 07a92dd554674067a83a9cb68c4773f2 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:21:22.693302  6798 raft_consensus.cc:1240] T f09c2a98de1a4decabd0ff900dd44caa P b7ab4784c7344b939bc36f639286f377 [term 21 FOLLOWER]: Rejecting Update request from peer ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 20. Current term is 21. Ops: []
I20260709 13:21:22.672988 13447 raft_consensus.cc:740] T 2c240553ce044eedb41541d72b9475d7 P b7ab4784c7344b939bc36f639286f377 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
I20260709 13:21:22.667656 13690 raft_consensus.cc:493] T d8cee0accdb8499c86d4414b72565a38 P cd75a17ab2604397adab03bb8b5fd75c [term 19 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:21:22.694741  6798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be1a92657f494cac8dd227d152f50151" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 23 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:21:22.685624  6732 raft_consensus.cc:1275] T bd6869f07b5a4885a0b99fbe60c3b175 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 21 FOLLOWER]: Refusing update from remote peer cd75a17ab2604397adab03bb8b5fd75c: Log matching property violated. Preceding OpId in replica: term: 20 index: 10. Preceding OpId from leader: term: 21 index: 11. (index mismatch)
I20260709 13:21:22.660837 13660 consensus_queue.cc:1048] T bd6869f07b5a4885a0b99fbe60c3b175 P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.026s
I20260709 13:21:22.695981  6802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1528ab62b6fe4e3099d08f141afee116" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:21:22.677785 13554 raft_consensus.cc:2804] T bd6869f07b5a4885a0b99fbe60c3b175 P b7ab4784c7344b939bc36f639286f377 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:21:22.696723  6800 raft_consensus.cc:1275] T 17587d6730594da4a56fa13a353232a1 P b7ab4784c7344b939bc36f639286f377 [term 26 FOLLOWER]: Refusing update from remote peer 7ba59cc884714e8aa5f3f0ecaed84cbb: Log matching property violated. Preceding OpId in replica: term: 24 index: 17. Preceding OpId from leader: term: 26 index: 18. (index mismatch)
I20260709 13:21:22.693352  6725 raft_consensus.cc:1240] T fe20b4b48823486ca3b9c648db6ce8aa P ccd8a4c3bfe3413cb2ae219b09aea832 [term 15 FOLLOWER]: Rejecting Update request from peer 7ba59cc884714e8aa5f3f0ecaed84cbb for earlier term 14. Current term is 15. Ops: []
I20260709 13:21:22.679301 13667 raft_consensus.cc:493] T 427c124d773f483294511e80fe340075 P b7ab4784c7344b939bc36f639286f377 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 7ba59cc884714e8aa5f3f0ecaed84cbb)
I20260709 13:21:22.727726  6732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be1a92657f494cac8dd227d152f50151" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 23 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:21:22.734755  6801 raft_consensus.cc:1240] T 853ac0a8cbd64ce99457f170216d4d0f P b7ab4784c7344b939bc36f639286f377 [term 18 FOLLOWER]: Rejecting Update request from peer ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 17. Current term is 18. Ops: []
I20260709 13:21:22.736375  6732 raft_consensus.cc:2393] T be1a92657f494cac8dd227d152f50151 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in current term 23: Already voted for candidate b7ab4784c7344b939bc36f639286f377 in this term.
I20260709 13:21:22.700054  6804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbdf895bba214ff68685a24fd17dfb5d" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 18 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:21:22.728469  6798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a734b5ab7834e05a8c422208acc58b1" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:21:22.728595 13222 raft_consensus.cc:493] T 7c37d41cd9164c15a6826ca62a851a69 P b7ab4784c7344b939bc36f639286f377 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:22.729772  6807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5be3a11b23d4ea9b08300a2789821c7" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
W20260709 13:21:22.744669 13741 log.cc:927] Time spent T 1528ab62b6fe4e3099d08f141afee116 P b7ab4784c7344b939bc36f639286f377: Append to log took a long time: real 0.066s	user 0.000s	sys 0.000s
I20260709 13:21:22.748564 13579 consensus_queue.cc:260] T 3fa34c08b205435dba97346991aa1f92 P 7ba59cc884714e8aa5f3f0ecaed84cbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 23.17, Last appended by leader: 17, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:21:22.749975 13447 consensus_queue.cc:260] T 2c240553ce044eedb41541d72b9475d7 P b7ab4784c7344b939bc36f639286f377 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.11, Last appended by leader: 11, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:22.751559 13447 raft_consensus.cc:3060] T 2c240553ce044eedb41541d72b9475d7 P b7ab4784c7344b939bc36f639286f377 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:21:22.753985  6723 raft_consensus.cc:1240] T 3fa34c08b205435dba97346991aa1f92 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 24 FOLLOWER]: Rejecting Update request from peer 7ba59cc884714e8aa5f3f0ecaed84cbb for earlier term 23. Current term is 24. Ops: []
I20260709 13:21:22.761018  6802 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9b3759de40694069b13c0f8bd40e5709"
dest_uuid: "b7ab4784c7344b939bc36f639286f377"
mode: GRACEFUL
new_leader_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
 from {username='slave'} at 127.0.0.1:38240
I20260709 13:21:22.761722  6802 raft_consensus.cc:606] T 9b3759de40694069b13c0f8bd40e5709 P b7ab4784c7344b939bc36f639286f377 [term 17 LEADER]: Received request to transfer leadership to TS cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:21:22.762871  6800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90d42e216d9741e190bca19a781291fd" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:21:22.685145 13026 consensus_queue.cc:1048] T 1528ab62b6fe4e3099d08f141afee116 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.048s
I20260709 13:21:22.726738 13554 raft_consensus.cc:493] T bd6869f07b5a4885a0b99fbe60c3b175 P b7ab4784c7344b939bc36f639286f377 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:22.771926  6805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e31b9971c15848dea59d4d4130141d9e" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:21:22.732577 13711 raft_consensus.cc:493] T 7a734b5ab7834e05a8c422208acc58b1 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 7ba59cc884714e8aa5f3f0ecaed84cbb)
I20260709 13:21:22.701335 13634 raft_consensus.cc:2804] T 07a92dd554674067a83a9cb68c4773f2 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:21:22.776189  6723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1528ab62b6fe4e3099d08f141afee116" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:21:22.777769  6799 raft_consensus.cc:1275] T b3f13b31a1f84f0d89d007eadd57924c P b7ab4784c7344b939bc36f639286f377 [term 16 FOLLOWER]: Refusing update from remote peer 7ba59cc884714e8aa5f3f0ecaed84cbb: Log matching property violated. Preceding OpId in replica: term: 14 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 13:21:22.752142 13667 raft_consensus.cc:515] T 427c124d773f483294511e80fe340075 P b7ab4784c7344b939bc36f639286f377 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } attrs { replace: true } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:21:22.750097 13579 raft_consensus.cc:3060] T 3fa34c08b205435dba97346991aa1f92 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:21:22.695849 13641 raft_consensus.cc:493] T 7a734b5ab7834e05a8c422208acc58b1 P b7ab4784c7344b939bc36f639286f377 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 7ba59cc884714e8aa5f3f0ecaed84cbb)
I20260709 13:21:22.786091  6725 raft_consensus.cc:1275] T 17587d6730594da4a56fa13a353232a1 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 26 FOLLOWER]: Refusing update from remote peer 7ba59cc884714e8aa5f3f0ecaed84cbb: Log matching property violated. Preceding OpId in replica: term: 24 index: 17. Preceding OpId from leader: term: 26 index: 18. (index mismatch)
I20260709 13:21:22.758265 13222 raft_consensus.cc:515] T 7c37d41cd9164c15a6826ca62a851a69 P b7ab4784c7344b939bc36f639286f377 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:22.796833  6772 leader_election.cc:304] T 4275cf08e63345f993bce8664eada830 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:21:22.798017  6723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a734b5ab7834e05a8c422208acc58b1" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:21:22.804502  6732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09c2a98de1a4decabd0ff900dd44caa" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:21:22.771926 13554 raft_consensus.cc:3060] T bd6869f07b5a4885a0b99fbe60c3b175 P b7ab4784c7344b939bc36f639286f377 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:21:22.813344  6725 raft_consensus.cc:1275] T b3f13b31a1f84f0d89d007eadd57924c P ccd8a4c3bfe3413cb2ae219b09aea832 [term 16 FOLLOWER]: Refusing update from remote peer 7ba59cc884714e8aa5f3f0ecaed84cbb: Log matching property violated. Preceding OpId in replica: term: 14 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 13:21:22.728303 13690 raft_consensus.cc:515] T d8cee0accdb8499c86d4414b72565a38 P cd75a17ab2604397adab03bb8b5fd75c [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:21:22.829399  6872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "853ac0a8cbd64ce99457f170216d4d0f" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:21:22.830135  6872 raft_consensus.cc:3060] T 853ac0a8cbd64ce99457f170216d4d0f P cd75a17ab2604397adab03bb8b5fd75c [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:21:22.831120 13744 log.cc:927] Time spent T 22ccee1b570c4ad3a57bd7aec085b1b4 P cd75a17ab2604397adab03bb8b5fd75c: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
W20260709 13:21:22.832226 13745 log.cc:927] Time spent T be1a92657f494cac8dd227d152f50151 P b7ab4784c7344b939bc36f639286f377: Append to log took a long time: real 0.079s	user 0.001s	sys 0.000s
I20260709 13:21:22.773792 13698 consensus_queue.cc:1059] T f09c2a98de1a4decabd0ff900dd44caa P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: INVALID_TERM, Last received: 20.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.037s
I20260709 13:21:22.833808 13698 raft_consensus.cc:3055] T f09c2a98de1a4decabd0ff900dd44caa P ccd8a4c3bfe3413cb2ae219b09aea832 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:21:22.834177 13698 raft_consensus.cc:740] T f09c2a98de1a4decabd0ff900dd44caa P ccd8a4c3bfe3413cb2ae219b09aea832 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
I20260709 13:21:22.834739  6728 raft_consensus.cc:1275] T f58dc08b12a2494bb9a1372837970ca2 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 20 FOLLOWER]: Refusing update from remote peer b7ab4784c7344b939bc36f639286f377: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 20 index: 11. (index mismatch)
I20260709 13:21:22.835038 13698 consensus_queue.cc:260] T f09c2a98de1a4decabd0ff900dd44caa P ccd8a4c3bfe3413cb2ae219b09aea832 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 20.12, Last appended by leader: 12, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:22.835976  6873 raft_consensus.cc:1240] T 34f36d59d88f40fe8a2805e604fc6c0a P cd75a17ab2604397adab03bb8b5fd75c [term 17 FOLLOWER]: Rejecting Update request from peer b7ab4784c7344b939bc36f639286f377 for earlier term 16. Current term is 17. Ops: []
I20260709 13:21:22.837354 13710 consensus_queue.cc:1048] T b3f13b31a1f84f0d89d007eadd57924c P 7ba59cc884714e8aa5f3f0ecaed84cbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:21:22.840320  6876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4b8bd455d5a47c18a1380839c6e0d61" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 20 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:21:22.841159  6876 raft_consensus.cc:2393] T f4b8bd455d5a47c18a1380839c6e0d61 P cd75a17ab2604397adab03bb8b5fd75c [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate b7ab4784c7344b939bc36f639286f377 in current term 20: Already voted for candidate cd75a17ab2604397adab03bb8b5fd75c in this term.
I20260709 13:21:22.841475 13655 raft_consensus.cc:2749] T 1bf4668eeb70467fb3dc5a0289233b3c P b7ab4784c7344b939bc36f639286f377 [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:21:22.843753 13617 raft_consensus.cc:2804] T 4275cf08e63345f993bce8664eada830 P b7ab4784c7344b939bc36f639286f377 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:21:22.782356 13599 consensus_queue.cc:1059] T 853ac0a8cbd64ce99457f170216d4d0f P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.062s
I20260709 13:21:22.845022 13599 raft_consensus.cc:493] T 4275cf08e63345f993bce8664eada830 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:22.845691 13599 raft_consensus.cc:515] T 4275cf08e63345f993bce8664eada830 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:22.848017 13652 raft_consensus.cc:3055] T 853ac0a8cbd64ce99457f170216d4d0f P ccd8a4c3bfe3413cb2ae219b09aea832 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:21:22.848625 13652 raft_consensus.cc:740] T 853ac0a8cbd64ce99457f170216d4d0f P ccd8a4c3bfe3413cb2ae219b09aea832 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
I20260709 13:21:22.791698 13711 raft_consensus.cc:515] T 7a734b5ab7834e05a8c422208acc58b1 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } attrs { replace: true } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:21:22.849699 13652 consensus_queue.cc:260] T 853ac0a8cbd64ce99457f170216d4d0f P ccd8a4c3bfe3413cb2ae219b09aea832 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 17.10, Last appended by leader: 10, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:22.851481 13652 raft_consensus.cc:3060] T 853ac0a8cbd64ce99457f170216d4d0f P ccd8a4c3bfe3413cb2ae219b09aea832 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:21:22.852614 13668 leader_election.cc:290] T 24ee15416e3145beaa1b8183453729a3 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:21:22.788615 13653 raft_consensus.cc:493] T 7ba5dac66ab5497e9e336f2a3c28cda5 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 20 FOLLOWER]: Starting pre-election (detected failure of leader cd75a17ab2604397adab03bb8b5fd75c)
I20260709 13:21:22.854569 13653 raft_consensus.cc:515] T 7ba5dac66ab5497e9e336f2a3c28cda5 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:21:22.857016 13653 leader_election.cc:290] T 7ba5dac66ab5497e9e336f2a3c28cda5 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:21:22.857158  6799 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9e326172347f45e99a0d482b5d8ef768"
dest_uuid: "b7ab4784c7344b939bc36f639286f377"
mode: GRACEFUL
new_leader_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
 from {username='slave'} at 127.0.0.1:38240
I20260709 13:21:22.858069  6799 raft_consensus.cc:606] T 9e326172347f45e99a0d482b5d8ef768 P b7ab4784c7344b939bc36f639286f377 [term 17 LEADER]: Received request to transfer leadership to TS cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:21:22.859453 13690 leader_election.cc:290] T d8cee0accdb8499c86d4414b72565a38 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
W20260709 13:21:22.860826 13746 log.cc:927] Time spent T f4b8bd455d5a47c18a1380839c6e0d61 P b7ab4784c7344b939bc36f639286f377: Append to log took a long time: real 0.082s	user 0.000s	sys 0.000s
I20260709 13:21:22.813112 13634 raft_consensus.cc:697] T 07a92dd554674067a83a9cb68c4773f2 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 18 LEADER]: Becoming Leader. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
I20260709 13:21:22.866104 13660 consensus_queue.cc:1048] T 22ccee1b570c4ad3a57bd7aec085b1b4 P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Connected to new peer: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:21:22.866132 13634 consensus_queue.cc:237] T 07a92dd554674067a83a9cb68c4773f2 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:22.872656  6723 raft_consensus.cc:2468] T 7a734b5ab7834e05a8c422208acc58b1 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in term 20.
W20260709 13:21:22.874951  6770 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:21:22.767632 13645 consensus_queue.cc:1048] T 17587d6730594da4a56fa13a353232a1 P 7ba59cc884714e8aa5f3f0ecaed84cbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.042s
I20260709 13:21:22.876223  6844 leader_election.cc:400] T f58dc08b12a2494bb9a1372837970ca2 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 19 election: Vote denied by peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391) with higher term. Message: Invalid argument: T f58dc08b12a2494bb9a1372837970ca2 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c for earlier term 19. Current term is 20.
I20260709 13:21:22.876611  6844 leader_election.cc:403] T f58dc08b12a2494bb9a1372837970ca2 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 19 election: Cancelling election due to peer responding with higher term
W20260709 13:21:22.878005  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 51101.5us
I20260709 13:21:22.878057  6802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a734b5ab7834e05a8c422208acc58b1" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:21:22.878813  6844 leader_election.cc:304] T e77e330a82df4b43a745d57a68f6f057 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:21:22.879122  6805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4275cf08e63345f993bce8664eada830" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
W20260709 13:21:22.880897  6772 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 67670.9us
I20260709 13:21:22.885993  6844 leader_election.cc:304] T 713b5728a197487c9300b310ab94e5a3 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377
I20260709 13:21:22.889331  6844 leader_election.cc:304] T 3d65025eea89441290d85dd053810e31 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:21:22.896487  6724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "427c124d773f483294511e80fe340075" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:21:22.896931  6844 leader_election.cc:304] T 711ef6523deb4cbe8ef2ba61e1c21c98 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:21:22.910844  6799 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "bd6869f07b5a4885a0b99fbe60c3b175"
dest_uuid: "b7ab4784c7344b939bc36f639286f377"
mode: GRACEFUL
new_leader_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
 from {username='slave'} at 127.0.0.1:38240
I20260709 13:21:22.916894 13711 leader_election.cc:290] T 7a734b5ab7834e05a8c422208acc58b1 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:21:22.917692  6731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c37d41cd9164c15a6826ca62a851a69" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:21:22.918474  6731 raft_consensus.cc:2468] T 7c37d41cd9164c15a6826ca62a851a69 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 20.
I20260709 13:21:22.921016 13686 leader_election.cc:290] T f09c2a98de1a4decabd0ff900dd44caa P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 21 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:21:22.880167 13264 raft_consensus.cc:2749] T f58dc08b12a2494bb9a1372837970ca2 P cd75a17ab2604397adab03bb8b5fd75c [term 20 FOLLOWER]: Leader election lost for term 19. Reason: Vote denied by peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391) with higher term. Message: Invalid argument: T f58dc08b12a2494bb9a1372837970ca2 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c for earlier term 19. Current term is 20.
I20260709 13:21:22.880682 13617 raft_consensus.cc:697] T 4275cf08e63345f993bce8664eada830 P b7ab4784c7344b939bc36f639286f377 [term 19 LEADER]: Becoming Leader. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
I20260709 13:21:22.893705 13594 raft_consensus.cc:2749] T e77e330a82df4b43a745d57a68f6f057 P cd75a17ab2604397adab03bb8b5fd75c [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:21:22.903307 13714 raft_consensus.cc:2749] T 3d65025eea89441290d85dd053810e31 P cd75a17ab2604397adab03bb8b5fd75c [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:21:22.941308 13665 raft_consensus.cc:3060] T 34f36d59d88f40fe8a2805e604fc6c0a P b7ab4784c7344b939bc36f639286f377 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:21:22.944586 13645 raft_consensus.cc:493] T bb7fa124c3bf4ef9ab65a407cb008441 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 18 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:21:22.945139 13645 raft_consensus.cc:515] T bb7fa124c3bf4ef9ab65a407cb008441 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:21:22.945977  6881 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53406 (request call id 3191) took 1349 ms. Trace:
I20260709 13:21:22.947238 13645 leader_election.cc:290] T bb7fa124c3bf4ef9ab65a407cb008441 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:21:22.946445  6881 rpcz_store.cc:276] 0709 13:21:21.596768 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:21:21.596985 (+   217us) service_pool.cc:224] Handling call
0709 13:21:21.597459 (+   474us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:21:21.880081 (+282622us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:21:21.880120 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:21:21.880605 (+   485us) log.cc:844] Serialized 26 byte log entry
0709 13:21:22.469825 (+589220us) spinlock_profiling.cc:243] Waited 3.17 ms on lock 0x7b1800441ee0. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc15785de1 00007fcc157925b1 00007fcc0c89fe07 00007fcc156faab9 00007fcc0c8bc69b 00007fcc0c8ba93f 00007fcc0c8bcc02 00007fcc0f54420b 00007fcc0f549d23 00007fcc0f54a0d1 00007fcc0f965a0f
0709 13:21:22.661377 (+191552us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:21:22.661439 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:21:22.945603 (+284164us) spinlock_profiling.cc:243] Waited 272 ms on lock 0x7b540042ac54. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f9aae01 00007fcc0f9a983e 00007fcc1496e419 00007fcc0dee5bd4 00007fcc0dee5b62 00007fcc0dee5a91 00007fcc0dee5a0c 00007fcc0dee4cc2 00007fcc0dce548c 00007fcc0dce48c6
0709 13:21:22.945661 (+    58us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:21:22.945714 (+    53us) raft_consensus.cc:1685] finished
0709 13:21:22.945731 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:21:22.945906 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":11203,"raft.run_cpu_time_us":154,"raft.run_wall_time_us":9599,"spinlock_wait_cycles":632331264,"thread_start_us":191294,"threads_started":1,"wal-append.queue_time_us":867111}
I20260709 13:21:22.905431 13690 raft_consensus.cc:2804] T 713b5728a197487c9300b310ab94e5a3 P cd75a17ab2604397adab03bb8b5fd75c [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:21:22.931002  6770 leader_election.cc:304] T 7c37d41cd9164c15a6826ca62a851a69 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
I20260709 13:21:22.894811 13698 raft_consensus.cc:3060] T f09c2a98de1a4decabd0ff900dd44caa P ccd8a4c3bfe3413cb2ae219b09aea832 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:21:22.907668 13660 raft_consensus.cc:2749] T 711ef6523deb4cbe8ef2ba61e1c21c98 P cd75a17ab2604397adab03bb8b5fd75c [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:21:22.934809 13649 raft_consensus.cc:515] T dbdf895bba214ff68685a24fd17dfb5d P b7ab4784c7344b939bc36f639286f377 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:22.935109 13222 leader_election.cc:290] T 7c37d41cd9164c15a6826ca62a851a69 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:21:22.935649 13615 consensus_queue.cc:1048] T f58dc08b12a2494bb9a1372837970ca2 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:21:22.935885 13617 consensus_queue.cc:237] T 4275cf08e63345f993bce8664eada830 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 18.10, Last appended by leader: 10, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:22.957020  6697 leader_election.cc:304] T 34f36d59d88f40fe8a2805e604fc6c0a P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377
I20260709 13:21:22.812242 13641 raft_consensus.cc:515] T 7a734b5ab7834e05a8c422208acc58b1 P b7ab4784c7344b939bc36f639286f377 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } attrs { replace: true } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:21:22.973431  6804 raft_consensus.cc:2368] T dbdf895bba214ff68685a24fd17dfb5d P b7ab4784c7344b939bc36f639286f377 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 18. Current term is 19.
I20260709 13:21:22.950706 13690 raft_consensus.cc:493] T 713b5728a197487c9300b310ab94e5a3 P cd75a17ab2604397adab03bb8b5fd75c [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:22.979715  6881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5be3a11b23d4ea9b08300a2789821c7" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
W20260709 13:21:22.979029  7466 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 169048us
I20260709 13:21:22.984691  6806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ba5dac66ab5497e9e336f2a3c28cda5" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:21:22.985975  6806 raft_consensus.cc:2393] T 7ba5dac66ab5497e9e336f2a3c28cda5 P b7ab4784c7344b939bc36f639286f377 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in current term 21: Already voted for candidate b7ab4784c7344b939bc36f639286f377 in this term.
I20260709 13:21:22.986884  7494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8cee0accdb8499c86d4414b72565a38" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:21:22.992645 13642 raft_consensus.cc:3060] T de3186201e1a40d0b335eeb8b4e256e0 P b7ab4784c7344b939bc36f639286f377 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:21:23.005450  7500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "427c124d773f483294511e80fe340075" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:21:23.006479 13649 leader_election.cc:290] T dbdf895bba214ff68685a24fd17dfb5d P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 19 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
W20260709 13:21:23.008306  6770 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 47468.3us
W20260709 13:21:23.011624  6772 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 45639.5us
I20260709 13:21:23.012782  6798 raft_consensus.cc:2468] T 7a734b5ab7834e05a8c422208acc58b1 P b7ab4784c7344b939bc36f639286f377 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in term 20.
I20260709 13:21:23.014779 13641 leader_election.cc:290] T 7a734b5ab7834e05a8c422208acc58b1 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:21:22.988090 13690 raft_consensus.cc:3060] T 713b5728a197487c9300b310ab94e5a3 P cd75a17ab2604397adab03bb8b5fd75c [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:21:23.021955  6728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbdf895bba214ff68685a24fd17dfb5d" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 19 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:21:23.022526 13671 raft_consensus.cc:515] T 07a92dd554674067a83a9cb68c4773f2 P b7ab4784c7344b939bc36f639286f377 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:22.966588 13602 raft_consensus.cc:2804] T 7c37d41cd9164c15a6826ca62a851a69 P b7ab4784c7344b939bc36f639286f377 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:21:23.029138  6876 raft_consensus.cc:1275] T f58dc08b12a2494bb9a1372837970ca2 P cd75a17ab2604397adab03bb8b5fd75c [term 20 FOLLOWER]: Refusing update from remote peer b7ab4784c7344b939bc36f639286f377: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 20 index: 11. (index mismatch)
I20260709 13:21:23.028115  6873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09c2a98de1a4decabd0ff900dd44caa" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:21:23.036806  6873 raft_consensus.cc:1275] T 30e88460611e47b2ba16a46a30b5f416 P cd75a17ab2604397adab03bb8b5fd75c [term 16 FOLLOWER]: Refusing update from remote peer b7ab4784c7344b939bc36f639286f377: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 13:21:22.966362 13667 leader_election.cc:290] T 427c124d773f483294511e80fe340075 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
W20260709 13:21:23.038933  6697 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:21:23.050226  6872 raft_consensus.cc:2468] T 853ac0a8cbd64ce99457f170216d4d0f P cd75a17ab2604397adab03bb8b5fd75c [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 18.
I20260709 13:21:23.042188  6798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb7fa124c3bf4ef9ab65a407cb008441" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:21:23.042958  6728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a734b5ab7834e05a8c422208acc58b1" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:21:23.051581  6728 raft_consensus.cc:2468] T 7a734b5ab7834e05a8c422208acc58b1 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 20.
I20260709 13:21:23.048632  6724 raft_consensus.cc:1275] T 9e326172347f45e99a0d482b5d8ef768 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 17 FOLLOWER]: Refusing update from remote peer b7ab4784c7344b939bc36f639286f377: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 13:21:22.974779 13711 raft_consensus.cc:2804] T 34f36d59d88f40fe8a2805e604fc6c0a P ccd8a4c3bfe3413cb2ae219b09aea832 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:21:23.049748  6876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e31b9971c15848dea59d4d4130141d9e" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:21:23.054374  6876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbdf895bba214ff68685a24fd17dfb5d" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 19 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:21:23.040010  6878 raft_consensus.cc:1275] T 9e326172347f45e99a0d482b5d8ef768 P cd75a17ab2604397adab03bb8b5fd75c [term 17 FOLLOWER]: Refusing update from remote peer b7ab4784c7344b939bc36f639286f377: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 13:21:23.055123  6876 raft_consensus.cc:3060] T dbdf895bba214ff68685a24fd17dfb5d P cd75a17ab2604397adab03bb8b5fd75c [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:21:23.061622  6874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "427c124d773f483294511e80fe340075" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:21:23.061964  6881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c37d41cd9164c15a6826ca62a851a69" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:21:23.069134  6881 raft_consensus.cc:2468] T 7c37d41cd9164c15a6826ca62a851a69 P cd75a17ab2604397adab03bb8b5fd75c [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 20.
I20260709 13:21:23.079155 13667 consensus_queue.cc:1048] T 9e326172347f45e99a0d482b5d8ef768 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:21:23.082484  6872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90d42e216d9741e190bca19a781291fd" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:21:23.084376 13446 raft_consensus.cc:493] T 713b5728a197487c9300b310ab94e5a3 P b7ab4784c7344b939bc36f639286f377 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:21:23.085103 13446 raft_consensus.cc:515] T 713b5728a197487c9300b310ab94e5a3 P b7ab4784c7344b939bc36f639286f377 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:23.088902  6728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "713b5728a197487c9300b310ab94e5a3" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:21:23.089699  6728 raft_consensus.cc:2468] T 713b5728a197487c9300b310ab94e5a3 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 17.
I20260709 13:21:23.091104  6770 leader_election.cc:304] T 713b5728a197487c9300b310ab94e5a3 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
I20260709 13:21:23.092056 13026 raft_consensus.cc:2804] T 713b5728a197487c9300b310ab94e5a3 P b7ab4784c7344b939bc36f639286f377 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:21:23.092519 13026 raft_consensus.cc:493] T 713b5728a197487c9300b310ab94e5a3 P b7ab4784c7344b939bc36f639286f377 [term 16 FOLLOWER]: Starting leader election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:21:23.092923 13026 raft_consensus.cc:3060] T 713b5728a197487c9300b310ab94e5a3 P b7ab4784c7344b939bc36f639286f377 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:21:23.099411  6728 raft_consensus.cc:1275] T ab432e62819d499eaaf3dd55481dd930 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 23 FOLLOWER]: Refusing update from remote peer b7ab4784c7344b939bc36f639286f377: Log matching property violated. Preceding OpId in replica: term: 22 index: 12. Preceding OpId from leader: term: 23 index: 13. (index mismatch)
I20260709 13:21:23.101359  7498 raft_consensus.cc:1275] T bb3d8792045a4583ae2e965b1350a5b4 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 19 FOLLOWER]: Refusing update from remote peer ccd8a4c3bfe3413cb2ae219b09aea832: Log matching property violated. Preceding OpId in replica: term: 18 index: 15. Preceding OpId from leader: term: 19 index: 16. (index mismatch)
I20260709 13:21:23.101713  6724 raft_consensus.cc:1275] T be1a92657f494cac8dd227d152f50151 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 23 FOLLOWER]: Refusing update from remote peer b7ab4784c7344b939bc36f639286f377: Log matching property violated. Preceding OpId in replica: term: 20 index: 15. Preceding OpId from leader: term: 23 index: 17. (index mismatch)
I20260709 13:21:23.102108  6872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a734b5ab7834e05a8c422208acc58b1" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:21:23.102936  6872 raft_consensus.cc:2393] T 7a734b5ab7834e05a8c422208acc58b1 P cd75a17ab2604397adab03bb8b5fd75c [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7ab4784c7344b939bc36f639286f377 in current term 21: Already voted for candidate cd75a17ab2604397adab03bb8b5fd75c in this term.
I20260709 13:21:23.104954 13601 consensus_queue.cc:1048] T ab432e62819d499eaaf3dd55481dd930 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:21:23.107208 13686 consensus_queue.cc:1048] T be1a92657f494cac8dd227d152f50151 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:21:23.110605  6724 raft_consensus.cc:1275] T f4b8bd455d5a47c18a1380839c6e0d61 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 20 FOLLOWER]: Refusing update from remote peer b7ab4784c7344b939bc36f639286f377: Log matching property violated. Preceding OpId in replica: term: 18 index: 9. Preceding OpId from leader: term: 20 index: 10. (index mismatch)
I20260709 13:21:23.114590 13686 raft_consensus.cc:993] T 9b3759de40694069b13c0f8bd40e5709 P b7ab4784c7344b939bc36f639286f377: : Instructing follower cd75a17ab2604397adab03bb8b5fd75c to start an election
I20260709 13:21:23.116518 13743 consensus_queue.cc:1048] T f4b8bd455d5a47c18a1380839c6e0d61 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:21:23.118230 13686 raft_consensus.cc:1081] T 9b3759de40694069b13c0f8bd40e5709 P b7ab4784c7344b939bc36f639286f377 [term 17 LEADER]: Signalling peer cd75a17ab2604397adab03bb8b5fd75c to start an election
I20260709 13:21:23.057765 13597 raft_consensus.cc:493] T 22ccee1b570c4ad3a57bd7aec085b1b4 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:23.120404 13670 consensus_queue.cc:1048] T f58dc08b12a2494bb9a1372837970ca2 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:21:23.122064 13671 leader_election.cc:290] T 07a92dd554674067a83a9cb68c4773f2 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 19 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:21:23.122684  6772 leader_election.cc:304] T f09c2a98de1a4decabd0ff900dd44caa P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:21:23.123999  6697 leader_election.cc:304] T f5be3a11b23d4ea9b08300a2789821c7 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:21:23.125813 13495 raft_consensus.cc:2749] T f5be3a11b23d4ea9b08300a2789821c7 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:21:23.126117  6728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a92dd554674067a83a9cb68c4773f2" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:21:23.126305  6697 leader_election.cc:304] T e31b9971c15848dea59d4d4130141d9e P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:21:23.127103 13495 raft_consensus.cc:2749] T e31b9971c15848dea59d4d4130141d9e P ccd8a4c3bfe3413cb2ae219b09aea832 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:21:23.128309 13714 raft_consensus.cc:493] T bb3d8792045a4583ae2e965b1350a5b4 P cd75a17ab2604397adab03bb8b5fd75c [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 7ba59cc884714e8aa5f3f0ecaed84cbb)
I20260709 13:21:23.128902 13714 raft_consensus.cc:515] T bb3d8792045a4583ae2e965b1350a5b4 P cd75a17ab2604397adab03bb8b5fd75c [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:21:23.131139 13714 leader_election.cc:290] T bb3d8792045a4583ae2e965b1350a5b4 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:21:23.127585  6697 leader_election.cc:304] T 90d42e216d9741e190bca19a781291fd P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:21:23.133512 13694 raft_consensus.cc:2749] T 90d42e216d9741e190bca19a781291fd P ccd8a4c3bfe3413cb2ae219b09aea832 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:21:23.038939 13602 raft_consensus.cc:493] T 7c37d41cd9164c15a6826ca62a851a69 P b7ab4784c7344b939bc36f639286f377 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:23.135679 13602 raft_consensus.cc:3060] T 7c37d41cd9164c15a6826ca62a851a69 P b7ab4784c7344b939bc36f639286f377 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:21:23.140775 13597 raft_consensus.cc:515] T 22ccee1b570c4ad3a57bd7aec085b1b4 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
W20260709 13:21:23.142285 13740 log.cc:927] Time spent T 3411566abe2d4c9bb4b2adfdd05e6f17 P cd75a17ab2604397adab03bb8b5fd75c: Append to log took a long time: real 0.082s	user 0.000s	sys 0.000s
I20260709 13:21:23.143244 13597 leader_election.cc:290] T 22ccee1b570c4ad3a57bd7aec085b1b4 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:21:23.144006  6875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "713b5728a197487c9300b310ab94e5a3" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:21:23.145329  6798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22ccee1b570c4ad3a57bd7aec085b1b4" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:21:23.148141 13711 raft_consensus.cc:697] T 34f36d59d88f40fe8a2805e604fc6c0a P ccd8a4c3bfe3413cb2ae219b09aea832 [term 17 LEADER]: Becoming Leader. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
I20260709 13:21:23.149284 13711 consensus_queue.cc:237] T 34f36d59d88f40fe8a2805e604fc6c0a P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:23.166692  7498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a734b5ab7834e05a8c422208acc58b1" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:21:23.167070 13690 raft_consensus.cc:515] T 713b5728a197487c9300b310ab94e5a3 P cd75a17ab2604397adab03bb8b5fd75c [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:23.167532  7498 raft_consensus.cc:2468] T 7a734b5ab7834e05a8c422208acc58b1 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 21.
I20260709 13:21:23.169370 13690 leader_election.cc:290] T 713b5728a197487c9300b310ab94e5a3 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 18 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:21:23.170960  6875 raft_consensus.cc:2368] T 713b5728a197487c9300b310ab94e5a3 P cd75a17ab2604397adab03bb8b5fd75c [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7ab4784c7344b939bc36f639286f377 for earlier term 17. Current term is 18.
W20260709 13:21:23.171841  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 271900us
W20260709 13:21:23.173508  6772 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 50851.3us
I20260709 13:21:23.087852 13446 leader_election.cc:290] T 713b5728a197487c9300b310ab94e5a3 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:21:23.176404  6844 leader_election.cc:304] T a3022224cc81473690653a83d4e99470 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:21:23.177796  7503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "427c124d773f483294511e80fe340075" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:21:23.184092  6844 leader_election.cc:304] T d8292e16e5654be6bc408560cf256aaa P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:21:23.184195  6772 leader_election.cc:304] T 853ac0a8cbd64ce99457f170216d4d0f P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:21:23.189535  6844 leader_election.cc:304] T c4db81d9d329422bb3b4160ca4ac2d1d P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:21:23.190723  7466 leader_election.cc:304] T be1a92657f494cac8dd227d152f50151 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:21:23.194458  6881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a734b5ab7834e05a8c422208acc58b1" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:21:23.195492  6881 raft_consensus.cc:2393] T 7a734b5ab7834e05a8c422208acc58b1 P cd75a17ab2604397adab03bb8b5fd75c [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ccd8a4c3bfe3413cb2ae219b09aea832 in current term 21: Already voted for candidate cd75a17ab2604397adab03bb8b5fd75c in this term.
I20260709 13:21:23.206055 13674 consensus_queue.cc:1059] T fe20b4b48823486ca3b9c648db6ce8aa P 7ba59cc884714e8aa5f3f0ecaed84cbb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: INVALID_TERM, Last received: 14.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:21:23.207420 13674 raft_consensus.cc:3055] T fe20b4b48823486ca3b9c648db6ce8aa P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:21:23.207803 13674 raft_consensus.cc:740] T fe20b4b48823486ca3b9c648db6ce8aa P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 7ba59cc884714e8aa5f3f0ecaed84cbb, State: Running, Role: LEADER
I20260709 13:21:23.208750  7498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a734b5ab7834e05a8c422208acc58b1" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:21:23.208688 13674 consensus_queue.cc:260] T fe20b4b48823486ca3b9c648db6ce8aa P 7ba59cc884714e8aa5f3f0ecaed84cbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:21:23.209450  7498 raft_consensus.cc:2468] T 7a734b5ab7834e05a8c422208acc58b1 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 21.
I20260709 13:21:23.210000 13674 raft_consensus.cc:3060] T fe20b4b48823486ca3b9c648db6ce8aa P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:21:23.214771  6879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24ee15416e3145beaa1b8183453729a3" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:21:23.215492  6879 raft_consensus.cc:2468] T 24ee15416e3145beaa1b8183453729a3 P cd75a17ab2604397adab03bb8b5fd75c [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 20.
I20260709 13:21:23.216428 13700 raft_consensus.cc:2749] T be1a92657f494cac8dd227d152f50151 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260709 13:21:23.219523  7498 raft_consensus.cc:1275] T be1a92657f494cac8dd227d152f50151 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 23 FOLLOWER]: Refusing update from remote peer b7ab4784c7344b939bc36f639286f377: Log matching property violated. Preceding OpId in replica: term: 21 index: 16. Preceding OpId from leader: term: 23 index: 17. (index mismatch)
I20260709 13:21:23.157248 13554 raft_consensus.cc:515] T bd6869f07b5a4885a0b99fbe60c3b175 P b7ab4784c7344b939bc36f639286f377 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:23.225044 13554 leader_election.cc:290] T bd6869f07b5a4885a0b99fbe60c3b175 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 22 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:21:23.175990 13671 raft_consensus.cc:2749] T f09c2a98de1a4decabd0ff900dd44caa P b7ab4784c7344b939bc36f639286f377 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:21:23.226613  6802 raft_consensus.cc:1240] T bd6869f07b5a4885a0b99fbe60c3b175 P b7ab4784c7344b939bc36f639286f377 [term 22 FOLLOWER]: Rejecting Update request from peer cd75a17ab2604397adab03bb8b5fd75c for earlier term 21. Current term is 22. Ops: [21.11-21.11]
I20260709 13:21:23.193701 13222 consensus_queue.cc:1048] T 9e326172347f45e99a0d482b5d8ef768 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.035s
I20260709 13:21:23.230547  7466 leader_election.cc:304] T 1528ab62b6fe4e3099d08f141afee116 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:21:23.231511  6799 raft_consensus.cc:606] T bd6869f07b5a4885a0b99fbe60c3b175 P b7ab4784c7344b939bc36f639286f377 [term 22 FOLLOWER]: Received request to transfer leadership to TS cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:21:23.231971  6799 raft_consensus.cc:614] T bd6869f07b5a4885a0b99fbe60c3b175 P b7ab4784c7344b939bc36f639286f377 [term 22 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:21:23.179026 13649 consensus_queue.cc:1048] T 30e88460611e47b2ba16a46a30b5f416 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.055s
W20260709 13:21:23.235090 13704 consensus_meta.cc:287] T f3f9c2e2bf644115957398fe4c9459db P ccd8a4c3bfe3413cb2ae219b09aea832: Time spent flushing consensus metadata: real 0.634s	user 0.009s	sys 0.003s
I20260709 13:21:23.237236 13602 raft_consensus.cc:515] T 7c37d41cd9164c15a6826ca62a851a69 P b7ab4784c7344b939bc36f639286f377 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:23.197535 13690 raft_consensus.cc:2749] T d8292e16e5654be6bc408560cf256aaa P cd75a17ab2604397adab03bb8b5fd75c [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:21:23.241204  6772 leader_election.cc:304] T 7a734b5ab7834e05a8c422208acc58b1 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
I20260709 13:21:23.242776 13602 leader_election.cc:290] T 7c37d41cd9164c15a6826ca62a851a69 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 21 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:21:23.244410  6697 leader_election.cc:304] T 7a734b5ab7834e05a8c422208acc58b1 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:21:23.246515  6726 raft_consensus.cc:1275] T 20f6842e26174571996b8dea4151d4be P ccd8a4c3bfe3413cb2ae219b09aea832 [term 22 FOLLOWER]: Refusing update from remote peer b7ab4784c7344b939bc36f639286f377: Log matching property violated. Preceding OpId in replica: term: 20 index: 12. Preceding OpId from leader: term: 22 index: 13. (index mismatch)
I20260709 13:21:23.235567 13704 raft_consensus.cc:515] T f3f9c2e2bf644115957398fe4c9459db P ccd8a4c3bfe3413cb2ae219b09aea832 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:23.200201 13446 raft_consensus.cc:2804] T 853ac0a8cbd64ce99457f170216d4d0f P b7ab4784c7344b939bc36f639286f377 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:21:23.247413  7466 leader_election.cc:304] T 7a734b5ab7834e05a8c422208acc58b1 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:21:23.248255  6772 leader_election.cc:304] T 427c124d773f483294511e80fe340075 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:21:23.195771 13714 raft_consensus.cc:2749] T a3022224cc81473690653a83d4e99470 P cd75a17ab2604397adab03bb8b5fd75c [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:21:23.257450  6881 raft_consensus.cc:1275] T ab432e62819d499eaaf3dd55481dd930 P cd75a17ab2604397adab03bb8b5fd75c [term 23 FOLLOWER]: Refusing update from remote peer b7ab4784c7344b939bc36f639286f377: Log matching property violated. Preceding OpId in replica: term: 20 index: 11. Preceding OpId from leader: term: 23 index: 13. (index mismatch)
I20260709 13:21:23.260017  6881 raft_consensus.cc:1240] T 853ac0a8cbd64ce99457f170216d4d0f P cd75a17ab2604397adab03bb8b5fd75c [term 18 FOLLOWER]: Rejecting Update request from peer ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 17. Current term is 18. Ops: [17.10-17.10]
W20260709 13:21:23.252082  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 62645.1us
I20260709 13:21:23.248862 13597 raft_consensus.cc:3060] T 7a734b5ab7834e05a8c422208acc58b1 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:21:23.251963 13601 raft_consensus.cc:2804] T 7a734b5ab7834e05a8c422208acc58b1 P b7ab4784c7344b939bc36f639286f377 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:21:23.267647  6730 raft_consensus.cc:1240] T f3f9c2e2bf644115957398fe4c9459db P ccd8a4c3bfe3413cb2ae219b09aea832 [term 20 FOLLOWER]: Rejecting Update request from peer b7ab4784c7344b939bc36f639286f377 for earlier term 19. Current term is 20. Ops: []
I20260709 13:21:23.251809 13680 raft_consensus.cc:493] T b3f13b31a1f84f0d89d007eadd57924c P b7ab4784c7344b939bc36f639286f377 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:23.278231  6725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c37d41cd9164c15a6826ca62a851a69" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:21:23.279111  6725 raft_consensus.cc:3060] T 7c37d41cd9164c15a6826ca62a851a69 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:21:23.249898 13645 consensus_queue.cc:1048] T b3f13b31a1f84f0d89d007eadd57924c P 7ba59cc884714e8aa5f3f0ecaed84cbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.021s
I20260709 13:21:23.283406  6731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6869f07b5a4885a0b99fbe60c3b175" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 22 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:21:23.248744 13700 consensus_queue.cc:1048] T 17587d6730594da4a56fa13a353232a1 P 7ba59cc884714e8aa5f3f0ecaed84cbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.022s
I20260709 13:21:23.284178  6731 raft_consensus.cc:3060] T bd6869f07b5a4885a0b99fbe60c3b175 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:21:23.248587 13026 raft_consensus.cc:515] T 713b5728a197487c9300b310ab94e5a3 P b7ab4784c7344b939bc36f639286f377 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:23.268591 13684 raft_consensus.cc:2749] T 427c124d773f483294511e80fe340075 P b7ab4784c7344b939bc36f639286f377 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:21:23.307590  7466 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 60258.5us
I20260709 13:21:23.269744 13601 raft_consensus.cc:493] T 7a734b5ab7834e05a8c422208acc58b1 P b7ab4784c7344b939bc36f639286f377 [term 20 FOLLOWER]: Starting leader election (detected failure of leader 7ba59cc884714e8aa5f3f0ecaed84cbb)
I20260709 13:21:23.268363 13446 raft_consensus.cc:697] T 853ac0a8cbd64ce99457f170216d4d0f P b7ab4784c7344b939bc36f639286f377 [term 18 LEADER]: Becoming Leader. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
I20260709 13:21:23.321120 13026 leader_election.cc:290] T 713b5728a197487c9300b310ab94e5a3 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 17 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:21:23.313051 13653 raft_consensus.cc:2804] T 7a734b5ab7834e05a8c422208acc58b1 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:21:23.321864 13601 raft_consensus.cc:3060] T 7a734b5ab7834e05a8c422208acc58b1 P b7ab4784c7344b939bc36f639286f377 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:21:23.358273  6731 raft_consensus.cc:2468] T bd6869f07b5a4885a0b99fbe60c3b175 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 22.
I20260709 13:21:23.366892  6770 leader_election.cc:304] T bd6869f07b5a4885a0b99fbe60c3b175 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
I20260709 13:21:23.295459 13671 consensus_queue.cc:1048] T 20f6842e26174571996b8dea4151d4be P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.054s
I20260709 13:21:23.292737 13649 consensus_queue.cc:1048] T be1a92657f494cac8dd227d152f50151 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 14, Time since last communication: 0.060s
I20260709 13:21:23.280879 13680 raft_consensus.cc:515] T b3f13b31a1f84f0d89d007eadd57924c P b7ab4784c7344b939bc36f639286f377 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:21:23.384239  6695 leader_election.cc:400] T dbdf895bba214ff68685a24fd17dfb5d P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 18 election: Vote denied by peer b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817) with higher term. Message: Invalid argument: T dbdf895bba214ff68685a24fd17dfb5d P b7ab4784c7344b939bc36f639286f377 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 18. Current term is 19.
I20260709 13:21:23.352065 13653 raft_consensus.cc:493] T 7a734b5ab7834e05a8c422208acc58b1 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:21:23.396988  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 135130us
I20260709 13:21:23.397892  6844 leader_election.cc:304] T f4b8bd455d5a47c18a1380839c6e0d61 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:21:23.399446  6731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "713b5728a197487c9300b310ab94e5a3" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:21:23.402529  6844 leader_election.cc:304] T 7887766dc6784fcaa42b35c05fea7a99 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:21:23.339798 13634 consensus_queue.cc:1048] T bb3d8792045a4583ae2e965b1350a5b4 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.045s
I20260709 13:21:23.403870  6844 leader_election.cc:304] T 7c44c4849aa54f2b94d1f1bef9ed546f P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:21:23.408023  6876 raft_consensus.cc:2468] T dbdf895bba214ff68685a24fd17dfb5d P cd75a17ab2604397adab03bb8b5fd75c [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 19.
I20260709 13:21:23.321326 13446 consensus_queue.cc:237] T 853ac0a8cbd64ce99457f170216d4d0f P b7ab4784c7344b939bc36f639286f377 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:23.424294  6876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a92dd554674067a83a9cb68c4773f2" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:21:23.425354  6876 raft_consensus.cc:3060] T 07a92dd554674067a83a9cb68c4773f2 P cd75a17ab2604397adab03bb8b5fd75c [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:21:23.390777 13707 raft_consensus.cc:2804] T bd6869f07b5a4885a0b99fbe60c3b175 P b7ab4784c7344b939bc36f639286f377 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:21:23.398840 13653 raft_consensus.cc:3060] T 7a734b5ab7834e05a8c422208acc58b1 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:21:23.433413  6731 raft_consensus.cc:2468] T 713b5728a197487c9300b310ab94e5a3 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 17.
I20260709 13:21:23.435626  6804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f9c2e2bf644115957398fe4c9459db" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:21:23.443365  6877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6869f07b5a4885a0b99fbe60c3b175" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 22 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:21:23.427263 13660 raft_consensus.cc:2749] T f4b8bd455d5a47c18a1380839c6e0d61 P cd75a17ab2604397adab03bb8b5fd75c [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:21:23.453557  6876 raft_consensus.cc:2468] T 07a92dd554674067a83a9cb68c4773f2 P cd75a17ab2604397adab03bb8b5fd75c [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 19.
W20260709 13:21:23.455577  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 51783.3us
I20260709 13:21:23.461942  6844 leader_election.cc:304] T 34f36d59d88f40fe8a2805e604fc6c0a P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:21:23.468268  6844 leader_election.cc:304] T a1704639a875409b9959353527b3fd68 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:21:23.478227  6844 leader_election.cc:304] T 8c7f33e544204fbaac4078e3e83bbf4e P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
W20260709 13:21:23.447129 13760 log.cc:927] Time spent T 4275cf08e63345f993bce8664eada830 P b7ab4784c7344b939bc36f639286f377: Append to log took a long time: real 0.075s	user 0.001s	sys 0.000s
I20260709 13:21:23.516810  6844 leader_election.cc:304] T 4d9def8b32fd443aa94ab1420b06837b P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:21:23.430742 13690 raft_consensus.cc:2749] T 7887766dc6784fcaa42b35c05fea7a99 P cd75a17ab2604397adab03bb8b5fd75c [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
W20260709 13:21:23.437942 13758 log.cc:927] Time spent T 7887766dc6784fcaa42b35c05fea7a99 P b7ab4784c7344b939bc36f639286f377: Append to log took a long time: real 0.091s	user 0.000s	sys 0.000s
W20260709 13:21:23.491770  6772 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 90741.9us
I20260709 13:21:23.414489 13671 consensus_queue.cc:1048] T ab432e62819d499eaaf3dd55481dd930 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 9, Time since last communication: 0.068s
I20260709 13:21:23.408154 13714 consensus_queue.cc:1059] T 1bf4668eeb70467fb3dc5a0289233b3c P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: INVALID_TERM, Last received: 16.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.059s
I20260709 13:21:23.468259 13594 raft_consensus.cc:2749] T 7c44c4849aa54f2b94d1f1bef9ed546f P cd75a17ab2604397adab03bb8b5fd75c [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:21:23.476922 13756 raft_consensus.cc:2749] T 34f36d59d88f40fe8a2805e604fc6c0a P cd75a17ab2604397adab03bb8b5fd75c [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:21:23.541252  6770 leader_election.cc:304] T 713b5728a197487c9300b310ab94e5a3 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
I20260709 13:21:23.466786 13752 raft_consensus.cc:2749] T 1528ab62b6fe4e3099d08f141afee116 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:21:23.514160 13588 raft_consensus.cc:2749] T a1704639a875409b9959353527b3fd68 P cd75a17ab2604397adab03bb8b5fd75c [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:21:23.478008 13599 leader_election.cc:290] T 4275cf08e63345f993bce8664eada830 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:21:23.522647 13660 raft_consensus.cc:2749] T 8c7f33e544204fbaac4078e3e83bbf4e P cd75a17ab2604397adab03bb8b5fd75c [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:21:23.534538 13639 raft_consensus.cc:493] T 9e326172347f45e99a0d482b5d8ef768 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:23.516016 13707 raft_consensus.cc:697] T bd6869f07b5a4885a0b99fbe60c3b175 P b7ab4784c7344b939bc36f639286f377 [term 22 LEADER]: Becoming Leader. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
I20260709 13:21:23.595201  6873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f9c2e2bf644115957398fe4c9459db" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:21:23.538419 13704 leader_election.cc:290] T f3f9c2e2bf644115957398fe4c9459db P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 20 election: Requested vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
W20260709 13:21:23.607039 13769 log.cc:927] Time spent T 34f36d59d88f40fe8a2805e604fc6c0a P ccd8a4c3bfe3413cb2ae219b09aea832: Append to log took a long time: real 0.164s	user 0.001s	sys 0.000s
W20260709 13:21:23.608909  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 92221us
W20260709 13:21:23.609676  6770 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 68557us
I20260709 13:21:23.611217  6725 raft_consensus.cc:2468] T 7c37d41cd9164c15a6826ca62a851a69 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 21.
I20260709 13:21:23.616906  6729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3d8792045a4583ae2e965b1350a5b4" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:21:23.590368 13756 raft_consensus.cc:2749] T 4d9def8b32fd443aa94ab1420b06837b P cd75a17ab2604397adab03bb8b5fd75c [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:21:23.622911  6729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "713b5728a197487c9300b310ab94e5a3" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:21:23.594964 13723 raft_consensus.cc:2749] T c4db81d9d329422bb3b4160ca4ac2d1d P cd75a17ab2604397adab03bb8b5fd75c [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:21:23.623625  6729 raft_consensus.cc:3060] T 713b5728a197487c9300b310ab94e5a3 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:21:23.559497 13690 consensus_queue.cc:1059] T 20f6842e26174571996b8dea4151d4be P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.059s
I20260709 13:21:23.619712  6873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22ccee1b570c4ad3a57bd7aec085b1b4" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:21:23.610601 13711 raft_consensus.cc:493] T ce4f062dcd314d43a63ca74067cb5ee3 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:21:23.616628 13649 raft_consensus.cc:2804] T 713b5728a197487c9300b310ab94e5a3 P b7ab4784c7344b939bc36f639286f377 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:21:23.662609  6873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4275cf08e63345f993bce8664eada830" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:21:23.604398 13639 raft_consensus.cc:515] T 9e326172347f45e99a0d482b5d8ef768 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:23.663283  6873 raft_consensus.cc:2468] T 4275cf08e63345f993bce8664eada830 P cd75a17ab2604397adab03bb8b5fd75c [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 19.
I20260709 13:21:23.670042  6729 raft_consensus.cc:2468] T 713b5728a197487c9300b310ab94e5a3 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 18.
I20260709 13:21:23.620999 13660 consensus_queue.cc:1048] T bd6869f07b5a4885a0b99fbe60c3b175 P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Connected to new peer: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.036s
W20260709 13:21:23.686342  7466 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:21:23.663656 13579 consensus_meta.cc:287] T 3fa34c08b205435dba97346991aa1f92 P 7ba59cc884714e8aa5f3f0ecaed84cbb: Time spent flushing consensus metadata: real 0.860s	user 0.010s	sys 0.003s
W20260709 13:21:23.748900  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 80003.3us
W20260709 13:21:23.802307  6772 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.68:45071, user_credentials={real_user=slave}} blocked reactor thread for 171480us
W20260709 13:21:23.819780 13763 log.cc:927] Time spent T f58dc08b12a2494bb9a1372837970ca2 P ccd8a4c3bfe3413cb2ae219b09aea832: Append to log took a long time: real 0.229s	user 0.000s	sys 0.000s
W20260709 13:21:23.821595 13770 log.cc:927] Time spent T ab432e62819d499eaaf3dd55481dd930 P ccd8a4c3bfe3413cb2ae219b09aea832: Append to log took a long time: real 0.224s	user 0.000s	sys 0.000s
W20260709 13:21:23.823259 13762 log.cc:927] Time spent T be1a92657f494cac8dd227d152f50151 P ccd8a4c3bfe3413cb2ae219b09aea832: Append to log took a long time: real 0.287s	user 0.000s	sys 0.000s
W20260709 13:21:23.830498 13776 log.cc:927] Time spent T d8292e16e5654be6bc408560cf256aaa P cd75a17ab2604397adab03bb8b5fd75c: Append to log took a long time: real 0.267s	user 0.000s	sys 0.001s
W20260709 13:21:23.832744 13761 log.cc:927] Time spent T 1528ab62b6fe4e3099d08f141afee116 P 7ba59cc884714e8aa5f3f0ecaed84cbb: Append to log took a long time: real 0.431s	user 0.000s	sys 0.002s
I20260709 13:21:23.832826  6881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ba5dac66ab5497e9e336f2a3c28cda5" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:21:23.838140 13639 leader_election.cc:290] T 9e326172347f45e99a0d482b5d8ef768 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:21:23.748750 13756 raft_consensus.cc:493] T ab432e62819d499eaaf3dd55481dd930 P cd75a17ab2604397adab03bb8b5fd75c [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:23.840679 13756 raft_consensus.cc:515] T ab432e62819d499eaaf3dd55481dd930 P cd75a17ab2604397adab03bb8b5fd75c [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:23.843065 13756 leader_election.cc:290] T ab432e62819d499eaaf3dd55481dd930 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:21:23.760481 13777 raft_consensus.cc:493] T 7ba5dac66ab5497e9e336f2a3c28cda5 P cd75a17ab2604397adab03bb8b5fd75c [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:21:23.845278 13674 consensus_meta.cc:287] T fe20b4b48823486ca3b9c648db6ce8aa P 7ba59cc884714e8aa5f3f0ecaed84cbb: Time spent flushing consensus metadata: real 0.635s	user 0.009s	sys 0.005s
I20260709 13:21:23.844938 13777 raft_consensus.cc:515] T 7ba5dac66ab5497e9e336f2a3c28cda5 P cd75a17ab2604397adab03bb8b5fd75c [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
W20260709 13:21:23.846565  6697 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:21:23.847379 13777 leader_election.cc:290] T 7ba5dac66ab5497e9e336f2a3c28cda5 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:21:23.848074  6881 raft_consensus.cc:2468] T 7ba5dac66ab5497e9e336f2a3c28cda5 P cd75a17ab2604397adab03bb8b5fd75c [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in term 21.
I20260709 13:21:23.849261 13655 raft_consensus.cc:493] T 22ccee1b570c4ad3a57bd7aec085b1b4 P b7ab4784c7344b939bc36f639286f377 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader cd75a17ab2604397adab03bb8b5fd75c)
I20260709 13:21:23.661259 13649 raft_consensus.cc:697] T 713b5728a197487c9300b310ab94e5a3 P b7ab4784c7344b939bc36f639286f377 [term 17 LEADER]: Becoming Leader. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
W20260709 13:21:23.850880 13698 consensus_meta.cc:287] T f09c2a98de1a4decabd0ff900dd44caa P ccd8a4c3bfe3413cb2ae219b09aea832: Time spent flushing consensus metadata: real 0.896s	user 0.010s	sys 0.002s
I20260709 13:21:23.851073 13680 leader_election.cc:290] T b3f13b31a1f84f0d89d007eadd57924c P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
W20260709 13:21:23.852437 13642 consensus_meta.cc:287] T de3186201e1a40d0b335eeb8b4e256e0 P b7ab4784c7344b939bc36f639286f377: Time spent flushing consensus metadata: real 0.859s	user 0.011s	sys 0.003s
I20260709 13:21:23.852052 13707 consensus_queue.cc:237] T bd6869f07b5a4885a0b99fbe60c3b175 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 20.10, Last appended by leader: 10, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:23.657274 13711 raft_consensus.cc:515] T ce4f062dcd314d43a63ca74067cb5ee3 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } attrs { replace: true } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:21:23.755697  6844 leader_election.cc:304] T 713b5728a197487c9300b310ab94e5a3 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:21:23.855849 13660 raft_consensus.cc:493] T 30e88460611e47b2ba16a46a30b5f416 P cd75a17ab2604397adab03bb8b5fd75c [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:21:23.855883 13757 log.cc:927] Time spent T 7887766dc6784fcaa42b35c05fea7a99 P cd75a17ab2604397adab03bb8b5fd75c: Append to log took a long time: real 0.458s	user 0.000s	sys 0.002s
W20260709 13:21:23.970927  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 215372us
I20260709 13:21:23.973194  6728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab432e62819d499eaaf3dd55481dd930" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 24 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:21:23.978511  6723 raft_consensus.cc:1240] T bd6869f07b5a4885a0b99fbe60c3b175 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 22 FOLLOWER]: Rejecting Update request from peer cd75a17ab2604397adab03bb8b5fd75c for earlier term 21. Current term is 22. Ops: [21.11-21.11]
I20260709 13:21:23.990072  6873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb7fa124c3bf4ef9ab65a407cb008441" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:21:23.994678 13793 raft_consensus.cc:2804] T 713b5728a197487c9300b310ab94e5a3 P cd75a17ab2604397adab03bb8b5fd75c [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:21:23.995565 13793 raft_consensus.cc:697] T 713b5728a197487c9300b310ab94e5a3 P cd75a17ab2604397adab03bb8b5fd75c [term 18 LEADER]: Becoming Leader. State: Replica: cd75a17ab2604397adab03bb8b5fd75c, State: Running, Role: LEADER
I20260709 13:21:23.996430 13714 raft_consensus.cc:493] T 3fa34c08b205435dba97346991aa1f92 P cd75a17ab2604397adab03bb8b5fd75c [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 7ba59cc884714e8aa5f3f0ecaed84cbb)
I20260709 13:21:23.996589 13777 consensus_queue.cc:1059] T bd6869f07b5a4885a0b99fbe60c3b175 P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: INVALID_TERM, Last received: 20.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:21:23.996702 13793 consensus_queue.cc:237] T 713b5728a197487c9300b310ab94e5a3 P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 16.9, Last appended by leader: 9, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:23.997162 13714 raft_consensus.cc:515] T 3fa34c08b205435dba97346991aa1f92 P cd75a17ab2604397adab03bb8b5fd75c [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:21:23.997890 13777 raft_consensus.cc:3055] T bd6869f07b5a4885a0b99fbe60c3b175 P cd75a17ab2604397adab03bb8b5fd75c [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:21:23.998270 13777 raft_consensus.cc:740] T bd6869f07b5a4885a0b99fbe60c3b175 P cd75a17ab2604397adab03bb8b5fd75c [term 21 LEADER]: Becoming Follower/Learner. State: Replica: cd75a17ab2604397adab03bb8b5fd75c, State: Running, Role: LEADER
I20260709 13:21:23.999346 13714 leader_election.cc:290] T 3fa34c08b205435dba97346991aa1f92 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:21:23.999071 13777 consensus_queue.cc:260] T bd6869f07b5a4885a0b99fbe60c3b175 P cd75a17ab2604397adab03bb8b5fd75c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 21.11, Last appended by leader: 11, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:24.000312 13777 raft_consensus.cc:3060] T bd6869f07b5a4885a0b99fbe60c3b175 P cd75a17ab2604397adab03bb8b5fd75c [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:21:24.002003  6728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fa34c08b205435dba97346991aa1f92" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:21:24.002787  6873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c37d41cd9164c15a6826ca62a851a69" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
W20260709 13:21:23.971511 13597 consensus_meta.cc:287] T 7a734b5ab7834e05a8c422208acc58b1 P ccd8a4c3bfe3413cb2ae219b09aea832: Time spent flushing consensus metadata: real 0.701s	user 0.010s	sys 0.004s
I20260709 13:21:24.004352  6728 raft_consensus.cc:2393] T 3fa34c08b205435dba97346991aa1f92 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c in current term 24: Already voted for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in this term.
I20260709 13:21:24.009449  6772 leader_election.cc:304] T dbdf895bba214ff68685a24fd17dfb5d P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:21:24.005818  7468 leader_election.cc:304] T bb7fa124c3bf4ef9ab65a407cb008441 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:21:24.004650  6873 raft_consensus.cc:3060] T 7c37d41cd9164c15a6826ca62a851a69 P cd75a17ab2604397adab03bb8b5fd75c [term 20 FOLLOWER]: Advancing to term 21
W20260709 13:21:24.013990 13601 consensus_meta.cc:287] T 7a734b5ab7834e05a8c422208acc58b1 P b7ab4784c7344b939bc36f639286f377: Time spent flushing consensus metadata: real 0.636s	user 0.010s	sys 0.001s
I20260709 13:21:23.965623 13660 raft_consensus.cc:515] T 30e88460611e47b2ba16a46a30b5f416 P cd75a17ab2604397adab03bb8b5fd75c [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:24.020758 13601 raft_consensus.cc:515] T 7a734b5ab7834e05a8c422208acc58b1 P b7ab4784c7344b939bc36f639286f377 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } attrs { replace: true } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:21:24.026590  6723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30e88460611e47b2ba16a46a30b5f416" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 17 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:21:23.904085 13655 raft_consensus.cc:515] T 22ccee1b570c4ad3a57bd7aec085b1b4 P b7ab4784c7344b939bc36f639286f377 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:24.029850  6880 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53406 (request call id 3214) took 1229 ms. Trace:
I20260709 13:21:24.034039  6803 raft_consensus.cc:2468] T de3186201e1a40d0b335eeb8b4e256e0 P b7ab4784c7344b939bc36f639286f377 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 20.
I20260709 13:21:24.035046  6880 rpcz_store.cc:276] 0709 13:21:22.800230 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:21:22.800427 (+   197us) service_pool.cc:224] Handling call
0709 13:21:22.800871 (+   444us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:21:22.813252 (+ 12381us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:21:22.813291 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:21:22.813945 (+   654us) log.cc:844] Serialized 26 byte log entry
0709 13:21:22.998398 (+184453us) spinlock_profiling.cc:243] Waited 44.5 ms on lock 0x7b4800210258. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc148d3aa1 00007fcc148cab37 00007fcc148ca9ca 00007fcc149c226f 00007fcc149c1f37 00007fcc149d655c 00007fcc149d6508 00007fcc149d6488 00007fcc149d6443 00007fcc149d56ec 00007fcc138ffa96
0709 13:21:23.230253 (+231855us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:21:23.230294 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:21:23.230364 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:21:24.029467 (+799103us) raft_consensus.cc:1685] finished
0709 13:21:24.029492 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:21:24.029782 (+   290us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":4118,"raft.run_cpu_time_us":3533,"raft.run_wall_time_us":168167,"spinlock_wait_cycles":102313856,"thread_start_us":310793,"threads_started":1,"wal-append.queue_time_us":426998}
I20260709 13:21:24.039983  6880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "713b5728a197487c9300b310ab94e5a3" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:21:24.041518  6880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e326172347f45e99a0d482b5d8ef768" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:21:24.042235  6880 raft_consensus.cc:2468] T 9e326172347f45e99a0d482b5d8ef768 P cd75a17ab2604397adab03bb8b5fd75c [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 17.
I20260709 13:21:24.035379  6772 leader_election.cc:304] T 07a92dd554674067a83a9cb68c4773f2 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:21:24.028919 13674 raft_consensus.cc:2749] T bb7fa124c3bf4ef9ab65a407cb008441 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:21:24.030236 13597 raft_consensus.cc:2749] T 7a734b5ab7834e05a8c422208acc58b1 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:21:24.022539 13660 leader_election.cc:290] T 30e88460611e47b2ba16a46a30b5f416 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:21:24.036296 13686 raft_consensus.cc:493] T de3186201e1a40d0b335eeb8b4e256e0 P b7ab4784c7344b939bc36f639286f377 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:24.029736 13676 raft_consensus.cc:2804] T dbdf895bba214ff68685a24fd17dfb5d P b7ab4784c7344b939bc36f639286f377 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:21:24.049840  6880 raft_consensus.cc:3060] T bb3d8792045a4583ae2e965b1350a5b4 P cd75a17ab2604397adab03bb8b5fd75c [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:21:24.046203 13756 raft_consensus.cc:493] T f09c2a98de1a4decabd0ff900dd44caa P cd75a17ab2604397adab03bb8b5fd75c [term 20 FOLLOWER]: Starting pre-election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:21:24.042804 13649 consensus_queue.cc:237] T 713b5728a197487c9300b310ab94e5a3 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:24.054494 13686 raft_consensus.cc:515] T de3186201e1a40d0b335eeb8b4e256e0 P b7ab4784c7344b939bc36f639286f377 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:24.065126  6875 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9b3759de40694069b13c0f8bd40e5709"
dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
 from {username='slave'} at 127.0.0.1:53406
I20260709 13:21:24.057915 13792 raft_consensus.cc:2804] T 07a92dd554674067a83a9cb68c4773f2 P b7ab4784c7344b939bc36f639286f377 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:21:24.082558  6875 raft_consensus.cc:493] T 9b3759de40694069b13c0f8bd40e5709 P cd75a17ab2604397adab03bb8b5fd75c [term 17 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:21:24.083031  6875 raft_consensus.cc:3060] T 9b3759de40694069b13c0f8bd40e5709 P cd75a17ab2604397adab03bb8b5fd75c [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:21:24.058320 13676 raft_consensus.cc:697] T dbdf895bba214ff68685a24fd17dfb5d P b7ab4784c7344b939bc36f639286f377 [term 19 LEADER]: Becoming Leader. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
I20260709 13:21:24.084818 13676 consensus_queue.cc:237] T dbdf895bba214ff68685a24fd17dfb5d P b7ab4784c7344b939bc36f639286f377 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 17.8, Last appended by leader: 8, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
W20260709 13:21:24.086333 13784 log.cc:927] Time spent T bb3d8792045a4583ae2e965b1350a5b4 P 7ba59cc884714e8aa5f3f0ecaed84cbb: Append to log took a long time: real 0.251s	user 0.002s	sys 0.005s
I20260709 13:21:24.082697  6723 raft_consensus.cc:1240] T 1bf4668eeb70467fb3dc5a0289233b3c P ccd8a4c3bfe3413cb2ae219b09aea832 [term 18 FOLLOWER]: Rejecting Update request from peer cd75a17ab2604397adab03bb8b5fd75c for earlier term 17. Current term is 18. Ops: [17.11-17.11]
I20260709 13:21:24.057096 13601 leader_election.cc:290] T 7a734b5ab7834e05a8c422208acc58b1 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 21 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:21:24.095996  6880 raft_consensus.cc:1275] T bb3d8792045a4583ae2e965b1350a5b4 P cd75a17ab2604397adab03bb8b5fd75c [term 19 FOLLOWER]: Refusing update from remote peer ccd8a4c3bfe3413cb2ae219b09aea832: Log matching property violated. Preceding OpId in replica: term: 18 index: 15. Preceding OpId from leader: term: 19 index: 16. (index mismatch)
I20260709 13:21:24.115682 13588 raft_consensus.cc:3055] T 1bf4668eeb70467fb3dc5a0289233b3c P cd75a17ab2604397adab03bb8b5fd75c [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:21:24.116282 13588 raft_consensus.cc:740] T 1bf4668eeb70467fb3dc5a0289233b3c P cd75a17ab2604397adab03bb8b5fd75c [term 17 LEADER]: Becoming Follower/Learner. State: Replica: cd75a17ab2604397adab03bb8b5fd75c, State: Running, Role: LEADER
I20260709 13:21:24.125164 13711 leader_election.cc:290] T ce4f062dcd314d43a63ca74067cb5ee3 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:21:24.129936  6880 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53416 (request call id 3833) took 1011 ms. Trace:
I20260709 13:21:24.130612  6880 rpcz_store.cc:276] 0709 13:21:23.118004 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:21:24.047189 (+929185us) service_pool.cc:224] Handling call
0709 13:21:24.049720 (+  2531us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:21:24.108005 (+ 58285us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:21:24.129854 (+ 21849us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:21:24.098156  6875 raft_consensus.cc:515] T 9b3759de40694069b13c0f8bd40e5709 P cd75a17ab2604397adab03bb8b5fd75c [term 18 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:24.140493  6723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b3759de40694069b13c0f8bd40e5709" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: true dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:21:24.141208  6723 raft_consensus.cc:3060] T 9b3759de40694069b13c0f8bd40e5709 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:21:24.144356  6806 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ce4f062dcd314d43a63ca74067cb5ee3"
dest_uuid: "b7ab4784c7344b939bc36f639286f377"
mode: GRACEFUL
new_leader_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
 from {username='slave'} at 127.0.0.1:38240
I20260709 13:21:24.145107  6806 raft_consensus.cc:606] T ce4f062dcd314d43a63ca74067cb5ee3 P b7ab4784c7344b939bc36f639286f377 [term 15 LEADER]: Received request to transfer leadership to TS cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:21:24.146458  6876 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53416 (request call id 3831) took 1029 ms. Trace:
I20260709 13:21:24.146870  6876 rpcz_store.cc:276] 0709 13:21:23.117468 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:21:23.463639 (+346171us) service_pool.cc:224] Handling call
0709 13:21:23.464139 (+   500us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:21:23.553066 (+ 88927us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:21:23.553104 (+    38us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:21:23.553147 (+    43us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:21:23.553185 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:21:24.146200 (+593015us) spinlock_profiling.cc:243] Waited 88.7 ms on lock 0x7b5400142dd4. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f9aae01 00007fcc0f9a983e 00007fcc1496e419 00007fcc0dee5bd4 00007fcc0dee5b62 00007fcc0dee5a91 00007fcc0dee5a0c 00007fcc0dee4cc2 00007fcc0dce548c 00007fcc0dce48c6
0709 13:21:24.146253 (+    53us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:21:24.146397 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":203950976}
I20260709 13:21:24.149322 13710 raft_consensus.cc:493] T 4b8cacb381b746da8d0049b0a83b41dd P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 20 FOLLOWER]: Starting pre-election (detected failure of leader cd75a17ab2604397adab03bb8b5fd75c)
I20260709 13:21:24.149979 13710 raft_consensus.cc:515] T 4b8cacb381b746da8d0049b0a83b41dd P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:21:24.151501  6846 leader_election.cc:304] T 427c124d773f483294511e80fe340075 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:21:24.153834 13677 raft_consensus.cc:2749] T 427c124d773f483294511e80fe340075 P cd75a17ab2604397adab03bb8b5fd75c [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:21:24.155673  7499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3d8792045a4583ae2e965b1350a5b4" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:21:24.157303 13674 raft_consensus.cc:493] T 3fa34c08b205435dba97346991aa1f92 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:24.157966  6876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce4f062dcd314d43a63ca74067cb5ee3" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:21:24.158947  6846 leader_election.cc:304] T bb3d8792045a4583ae2e965b1350a5b4 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:21:24.079509 13756 raft_consensus.cc:515] T f09c2a98de1a4decabd0ff900dd44caa P cd75a17ab2604397adab03bb8b5fd75c [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
W20260709 13:21:24.171681  6772 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 90960us
I20260709 13:21:24.175341  6876 raft_consensus.cc:1275] T f4b8bd455d5a47c18a1380839c6e0d61 P cd75a17ab2604397adab03bb8b5fd75c [term 20 FOLLOWER]: Refusing update from remote peer b7ab4784c7344b939bc36f639286f377: Log matching property violated. Preceding OpId in replica: term: 18 index: 9. Preceding OpId from leader: term: 20 index: 10. (index mismatch)
I20260709 13:21:24.171312  5625 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
W20260709 13:21:24.141505 13653 consensus_meta.cc:287] T 7a734b5ab7834e05a8c422208acc58b1 P 7ba59cc884714e8aa5f3f0ecaed84cbb: Time spent flushing consensus metadata: real 0.674s	user 0.005s	sys 0.008s
I20260709 13:21:24.094619 13714 consensus_queue.cc:1059] T 1bf4668eeb70467fb3dc5a0289233b3c P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: INVALID_TERM, Last received: 16.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.070s
I20260709 13:21:24.180181  6875 leader_election.cc:290] T 9b3759de40694069b13c0f8bd40e5709 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 18 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:21:24.182792  6873 raft_consensus.cc:2468] T 7c37d41cd9164c15a6826ca62a851a69 P cd75a17ab2604397adab03bb8b5fd75c [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 21.
I20260709 13:21:24.159605  6728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b8cacb381b746da8d0049b0a83b41dd" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:21:24.192582  6772 leader_election.cc:400] T 713b5728a197487c9300b310ab94e5a3 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 17 pre-election: Vote denied by peer cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931) with higher term. Message: Invalid argument: T 713b5728a197487c9300b310ab94e5a3 P cd75a17ab2604397adab03bb8b5fd75c [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7ab4784c7344b939bc36f639286f377 for earlier term 17. Current term is 18.
I20260709 13:21:24.191396  5625 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:21:24.159639 13790 raft_consensus.cc:493] T 44bde925b2e541b69890d70715b85176 P cd75a17ab2604397adab03bb8b5fd75c [term 19 FOLLOWER]: Starting pre-election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
W20260709 13:21:24.181113 13796 log.cc:927] Time spent T 713b5728a197487c9300b310ab94e5a3 P cd75a17ab2604397adab03bb8b5fd75c: Append to log took a long time: real 0.069s	user 0.000s	sys 0.001s
I20260709 13:21:24.171602 13793 raft_consensus.cc:2749] T bb3d8792045a4583ae2e965b1350a5b4 P cd75a17ab2604397adab03bb8b5fd75c [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:21:24.204957  6772 leader_election.cc:304] T 7c37d41cd9164c15a6826ca62a851a69 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:21:24.202471  6723 raft_consensus.cc:2468] T 9b3759de40694069b13c0f8bd40e5709 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 18.
I20260709 13:21:24.207244  6844 leader_election.cc:304] T 9b3759de40694069b13c0f8bd40e5709 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:21:24.178898 13694 raft_consensus.cc:493] T 2c240553ce044eedb41541d72b9475d7 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:21:24.215390  7499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3f13b31a1f84f0d89d007eadd57924c" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 17 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:21:24.215968  7495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a734b5ab7834e05a8c422208acc58b1" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb"
I20260709 13:21:24.221239  6878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a734b5ab7834e05a8c422208acc58b1" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:21:24.222385  6878 raft_consensus.cc:2393] T 7a734b5ab7834e05a8c422208acc58b1 P cd75a17ab2604397adab03bb8b5fd75c [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate b7ab4784c7344b939bc36f639286f377 in current term 21: Already voted for candidate cd75a17ab2604397adab03bb8b5fd75c in this term.
I20260709 13:21:24.200740 13799 raft_consensus.cc:493] T 95a75bfe094d4bdc963aba3f08dfcd25 P b7ab4784c7344b939bc36f639286f377 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader cd75a17ab2604397adab03bb8b5fd75c)
I20260709 13:21:24.171972 13674 raft_consensus.cc:515] T 3fa34c08b205435dba97346991aa1f92 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:21:24.224370 13694 raft_consensus.cc:515] T 2c240553ce044eedb41541d72b9475d7 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:24.203121 13792 raft_consensus.cc:697] T 07a92dd554674067a83a9cb68c4773f2 P b7ab4784c7344b939bc36f639286f377 [term 19 LEADER]: Becoming Leader. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
I20260709 13:21:24.218286 13714 raft_consensus.cc:2804] T 9b3759de40694069b13c0f8bd40e5709 P cd75a17ab2604397adab03bb8b5fd75c [term 18 FOLLOWER]: Leader election won for term 18
W20260709 13:21:24.243371  7466 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 60999.9us
I20260709 13:21:24.243624  6875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b8cacb381b746da8d0049b0a83b41dd" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:21:24.225904 13743 raft_consensus.cc:2804] T 7c37d41cd9164c15a6826ca62a851a69 P b7ab4784c7344b939bc36f639286f377 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:21:24.198518 13653 raft_consensus.cc:515] T 7a734b5ab7834e05a8c422208acc58b1 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 22 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } attrs { replace: true } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:21:24.218381 13791 consensus_queue.cc:1048] T f4b8bd455d5a47c18a1380839c6e0d61 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.031s
W20260709 13:21:24.251303  7466 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:21:24.254155  7466 leader_election.cc:304] T 4b8cacb381b746da8d0049b0a83b41dd P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:21:24.209159 13790 raft_consensus.cc:515] T 44bde925b2e541b69890d70715b85176 P cd75a17ab2604397adab03bb8b5fd75c [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:24.241302 13710 leader_election.cc:290] T 4b8cacb381b746da8d0049b0a83b41dd P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:21:24.254448 13743 raft_consensus.cc:697] T 7c37d41cd9164c15a6826ca62a851a69 P b7ab4784c7344b939bc36f639286f377 [term 21 LEADER]: Becoming Leader. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
I20260709 13:21:24.257305  7496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce4f062dcd314d43a63ca74067cb5ee3" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:21:24.259378 13694 leader_election.cc:290] T 2c240553ce044eedb41541d72b9475d7 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:21:24.266180  7495 raft_consensus.cc:2368] T 7a734b5ab7834e05a8c422208acc58b1 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate b7ab4784c7344b939bc36f639286f377 for earlier term 21. Current term is 22.
I20260709 13:21:24.268306 13653 leader_election.cc:290] T 7a734b5ab7834e05a8c422208acc58b1 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 22 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:21:24.273160  6878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c240553ce044eedb41541d72b9475d7" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:21:24.273901  6878 raft_consensus.cc:2393] T 2c240553ce044eedb41541d72b9475d7 P cd75a17ab2604397adab03bb8b5fd75c [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ccd8a4c3bfe3413cb2ae219b09aea832 in current term 20: Already voted for candidate cd75a17ab2604397adab03bb8b5fd75c in this term.
I20260709 13:21:24.277068  6723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a734b5ab7834e05a8c422208acc58b1" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:21:24.278066  6723 raft_consensus.cc:3060] T 7a734b5ab7834e05a8c422208acc58b1 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:21:24.250423 13714 raft_consensus.cc:697] T 9b3759de40694069b13c0f8bd40e5709 P cd75a17ab2604397adab03bb8b5fd75c [term 18 LEADER]: Becoming Leader. State: Replica: cd75a17ab2604397adab03bb8b5fd75c, State: Running, Role: LEADER
W20260709 13:21:24.257305 13789 log.cc:927] Time spent T 22ccee1b570c4ad3a57bd7aec085b1b4 P ccd8a4c3bfe3413cb2ae219b09aea832: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260709 13:21:24.293813  6807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a734b5ab7834e05a8c422208acc58b1" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:21:24.314098  6807 raft_consensus.cc:3060] T 7a734b5ab7834e05a8c422208acc58b1 P b7ab4784c7344b939bc36f639286f377 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:21:24.295269 13790 leader_election.cc:290] T 44bde925b2e541b69890d70715b85176 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:21:24.296969 13756 leader_election.cc:290] T f09c2a98de1a4decabd0ff900dd44caa P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:21:24.297619 13674 leader_election.cc:290] T 3fa34c08b205435dba97346991aa1f92 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:21:24.298071 13714 consensus_queue.cc:237] T 9b3759de40694069b13c0f8bd40e5709 P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:24.299506  6728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09c2a98de1a4decabd0ff900dd44caa" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:21:24.324201  6728 raft_consensus.cc:2468] T f09c2a98de1a4decabd0ff900dd44caa P ccd8a4c3bfe3413cb2ae219b09aea832 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 21.
I20260709 13:21:24.299432  6724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44bde925b2e541b69890d70715b85176" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:21:24.270805 13772 raft_consensus.cc:2749] T 4b8cacb381b746da8d0049b0a83b41dd P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:21:24.242491 13799 raft_consensus.cc:515] T 95a75bfe094d4bdc963aba3f08dfcd25 P b7ab4784c7344b939bc36f639286f377 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } attrs { replace: true } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:21:24.326694  6844 leader_election.cc:304] T f09c2a98de1a4decabd0ff900dd44caa P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:21:24.327580 13756 raft_consensus.cc:2804] T f09c2a98de1a4decabd0ff900dd44caa P cd75a17ab2604397adab03bb8b5fd75c [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:21:24.301172 13792 consensus_queue.cc:237] T 07a92dd554674067a83a9cb68c4773f2 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:24.301651  6880 raft_consensus.cc:1275] T 4275cf08e63345f993bce8664eada830 P cd75a17ab2604397adab03bb8b5fd75c [term 19 FOLLOWER]: Refusing update from remote peer b7ab4784c7344b939bc36f639286f377: Log matching property violated. Preceding OpId in replica: term: 17 index: 9. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
I20260709 13:21:24.302718 13694 raft_consensus.cc:493] T fe20b4b48823486ca3b9c648db6ce8aa P ccd8a4c3bfe3413cb2ae219b09aea832 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:24.289409 13743 consensus_queue.cc:237] T 7c37d41cd9164c15a6826ca62a851a69 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.14, Last appended by leader: 14, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:24.306154  6873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fa34c08b205435dba97346991aa1f92" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 25 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:21:24.335745  6724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fa34c08b205435dba97346991aa1f92" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 25 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:21:24.344647  6873 raft_consensus.cc:2468] T 3fa34c08b205435dba97346991aa1f92 P cd75a17ab2604397adab03bb8b5fd75c [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in term 23.
I20260709 13:21:24.348256  6807 raft_consensus.cc:2468] T 7a734b5ab7834e05a8c422208acc58b1 P b7ab4784c7344b939bc36f639286f377 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in term 22.
I20260709 13:21:24.349205  7468 leader_election.cc:304] T 3fa34c08b205435dba97346991aa1f92 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:21:24.288290  6878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a734b5ab7834e05a8c422208acc58b1" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:21:24.350767  6878 raft_consensus.cc:3060] T 7a734b5ab7834e05a8c422208acc58b1 P cd75a17ab2604397adab03bb8b5fd75c [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:21:24.343386  6723 raft_consensus.cc:2468] T 7a734b5ab7834e05a8c422208acc58b1 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in term 22.
I20260709 13:21:24.344841  6724 raft_consensus.cc:2468] T 3fa34c08b205435dba97346991aa1f92 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in term 24.
I20260709 13:21:24.354713  7466 leader_election.cc:304] T 7a734b5ab7834e05a8c422208acc58b1 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
I20260709 13:21:24.355686  6873 raft_consensus.cc:1275] T 34f36d59d88f40fe8a2805e604fc6c0a P cd75a17ab2604397adab03bb8b5fd75c [term 17 FOLLOWER]: Refusing update from remote peer ccd8a4c3bfe3413cb2ae219b09aea832: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 13:21:24.353740 13694 raft_consensus.cc:515] T fe20b4b48823486ca3b9c648db6ce8aa P ccd8a4c3bfe3413cb2ae219b09aea832 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:21:24.363691 13694 leader_election.cc:290] T fe20b4b48823486ca3b9c648db6ce8aa P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:21:24.328312 13799 leader_election.cc:290] T 95a75bfe094d4bdc963aba3f08dfcd25 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:21:24.353760 13790 raft_consensus.cc:493] T ce4f062dcd314d43a63ca74067cb5ee3 P cd75a17ab2604397adab03bb8b5fd75c [term 15 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:21:24.328020 13756 raft_consensus.cc:493] T f09c2a98de1a4decabd0ff900dd44caa P cd75a17ab2604397adab03bb8b5fd75c [term 20 FOLLOWER]: Starting leader election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:21:24.371451  7496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe20b4b48823486ca3b9c648db6ce8aa" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:21:24.353320 13772 raft_consensus.cc:2804] T 3fa34c08b205435dba97346991aa1f92 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 13:21:24.374943  7496 raft_consensus.cc:2468] T fe20b4b48823486ca3b9c648db6ce8aa P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 15.
I20260709 13:21:24.385685  6697 leader_election.cc:304] T fe20b4b48823486ca3b9c648db6ce8aa P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
W20260709 13:21:24.413775  6772 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 158181us
I20260709 13:21:24.371451 13674 raft_consensus.cc:2804] T 7a734b5ab7834e05a8c422208acc58b1 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:21:24.383870 13756 raft_consensus.cc:3060] T f09c2a98de1a4decabd0ff900dd44caa P cd75a17ab2604397adab03bb8b5fd75c [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:21:24.383816 13772 raft_consensus.cc:493] T 3fa34c08b205435dba97346991aa1f92 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 24 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:24.420511  6878 raft_consensus.cc:2468] T 7a734b5ab7834e05a8c422208acc58b1 P cd75a17ab2604397adab03bb8b5fd75c [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in term 22.
I20260709 13:21:24.407965 13694 raft_consensus.cc:2804] T fe20b4b48823486ca3b9c648db6ce8aa P ccd8a4c3bfe3413cb2ae219b09aea832 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:21:24.422379  7496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a75bfe094d4bdc963aba3f08dfcd25" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:21:24.422809 13694 raft_consensus.cc:493] T fe20b4b48823486ca3b9c648db6ce8aa P ccd8a4c3bfe3413cb2ae219b09aea832 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:24.423286  6878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a75bfe094d4bdc963aba3f08dfcd25" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:21:24.420526 13676 raft_consensus.cc:493] T 34f36d59d88f40fe8a2805e604fc6c0a P b7ab4784c7344b939bc36f639286f377 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:24.382979 13790 raft_consensus.cc:515] T ce4f062dcd314d43a63ca74067cb5ee3 P cd75a17ab2604397adab03bb8b5fd75c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:21:24.432565 13781 raft_consensus.cc:493] T d33d5ee8ef6f415593d8df52063161ad P cd75a17ab2604397adab03bb8b5fd75c [term 18 FOLLOWER]: Starting pre-election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:21:24.438608 13781 raft_consensus.cc:515] T d33d5ee8ef6f415593d8df52063161ad P cd75a17ab2604397adab03bb8b5fd75c [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:24.440106 13667 consensus_queue.cc:1048] T 4275cf08e63345f993bce8664eada830 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.001s
W20260709 13:21:24.444614 13779 log.cc:927] Time spent T 20f6842e26174571996b8dea4151d4be P ccd8a4c3bfe3413cb2ae219b09aea832: Append to log took a long time: real 0.609s	user 0.008s	sys 0.001s
I20260709 13:21:24.446692  6723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d33d5ee8ef6f415593d8df52063161ad" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:21:24.449483 13781 leader_election.cc:290] T d33d5ee8ef6f415593d8df52063161ad P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:21:24.424659 13772 raft_consensus.cc:3060] T 3fa34c08b205435dba97346991aa1f92 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:21:24.423348 13694 raft_consensus.cc:3060] T fe20b4b48823486ca3b9c648db6ce8aa P ccd8a4c3bfe3413cb2ae219b09aea832 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:21:24.421551 13711 raft_consensus.cc:493] T 4b8cacb381b746da8d0049b0a83b41dd P ccd8a4c3bfe3413cb2ae219b09aea832 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader cd75a17ab2604397adab03bb8b5fd75c)
I20260709 13:21:24.463891  6878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe20b4b48823486ca3b9c648db6ce8aa" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:21:24.426205 13674 raft_consensus.cc:697] T 7a734b5ab7834e05a8c422208acc58b1 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 22 LEADER]: Becoming Leader. State: Replica: 7ba59cc884714e8aa5f3f0ecaed84cbb, State: Running, Role: LEADER
W20260709 13:21:24.455571  6697 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:21:24.462220  6732 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50004 (request call id 3213) took 1069 ms. Trace:
I20260709 13:21:24.472323  6878 raft_consensus.cc:1240] T dbdf895bba214ff68685a24fd17dfb5d P cd75a17ab2604397adab03bb8b5fd75c [term 19 FOLLOWER]: Rejecting Update request from peer ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 18. Current term is 19. Ops: []
I20260709 13:21:24.466727  6732 rpcz_store.cc:276] 0709 13:21:23.393272 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:21:23.393518 (+   246us) service_pool.cc:224] Handling call
0709 13:21:23.394009 (+   491us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:21:23.394476 (+   467us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:21:23.394537 (+    61us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:21:23.413760 (+ 19223us) log.cc:844] Serialized 26 byte log entry
0709 13:21:23.612488 (+198728us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:21:23.612530 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:21:23.612597 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:21:24.443962 (+831365us) spinlock_profiling.cc:243] Waited 19.5 ms on lock 0x7b4400022b4c. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0c745db1 00007fcc0c7e3c85 00007fcc0c7e46a2 00007fcc0f5561db 00007fcc0f551aaf 00007fcc0f54586e 00007fcc0f544bb6 00007fcc0f5447d8 00007fcc0f54e221 00007fcc0f54e1d9 00007fcc0f54e169
0709 13:21:24.455987 (+ 12025us) raft_consensus.cc:1685] finished
0709 13:21:24.456024 (+    37us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:21:24.462144 (+  6120us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":3718,"raft.run_cpu_time_us":131,"raft.run_wall_time_us":5087,"spinlock_wait_cycles":44786432,"thread_start_us":145299,"threads_started":1,"wal-append.queue_time_us":240896}
I20260709 13:21:24.478359 13597 raft_consensus.cc:493] T 7887766dc6784fcaa42b35c05fea7a99 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:21:24.479339 13597 raft_consensus.cc:515] T 7887766dc6784fcaa42b35c05fea7a99 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:24.481992  6877 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53416 (request call id 3830) took 1364 ms. Trace:
I20260709 13:21:24.482537  6877 rpcz_store.cc:276] 0709 13:21:23.117168 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:21:23.469880 (+352712us) service_pool.cc:224] Handling call
0709 13:21:23.518737 (+ 48857us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:21:24.330717 (+811980us) spinlock_profiling.cc:243] Waited 1.84 ms on lock 0x7b18001e7f00. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc15785de1 00007fcc157925b1 00007fcc0f5524bc 00007fcc0c8a048b 00007fcc156faab9 00007fcc0c8bc69b 00007fcc0c8ba93f 00007fcc0c8ba455 00007fcc0f9a2060 00007fcc0f9a2bfb 00007fcc0f9ad64b
0709 13:21:24.330908 (+   191us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:21:24.331232 (+   324us) log.cc:844] Serialized 14 byte log entry
0709 13:21:24.430501 (+ 99269us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:21:24.430987 (+   486us) log.cc:844] Serialized 26 byte log entry
0709 13:21:24.431135 (+   148us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:21:24.431340 (+   205us) log.cc:844] Serialized 14 byte log entry
0709 13:21:24.432432 (+  1092us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:21:24.432849 (+   417us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:21:24.481661 (+ 48812us) raft_consensus.cc:1685] finished
0709 13:21:24.481691 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:21:24.481913 (+   222us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6510,"prepare.queue_time_us":6128,"prepare.run_cpu_time_us":80,"prepare.run_wall_time_us":83,"raft.queue_time_us":44754,"raft.run_cpu_time_us":353,"raft.run_wall_time_us":31375,"spinlock_wait_cycles":4224384,"thread_start_us":170090,"threads_started":2,"wal-append.queue_time_us":124808}
I20260709 13:21:24.468503 13711 raft_consensus.cc:515] T 4b8cacb381b746da8d0049b0a83b41dd P ccd8a4c3bfe3413cb2ae219b09aea832 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:21:24.508163 13597 leader_election.cc:290] T 7887766dc6784fcaa42b35c05fea7a99 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:21:24.474363 13698 raft_consensus.cc:493] T a1704639a875409b9959353527b3fd68 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:21:24.514479  6877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7887766dc6784fcaa42b35c05fea7a99" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 24 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:21:24.514228 13698 raft_consensus.cc:515] T a1704639a875409b9959353527b3fd68 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:24.516960 13698 leader_election.cc:290] T a1704639a875409b9959353527b3fd68 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:21:24.519340  6872 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53416 (request call id 3836) took 1048 ms. Trace:
I20260709 13:21:24.519224  6877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1704639a875409b9959353527b3fd68" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:21:24.520978  7502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24ee15416e3145beaa1b8183453729a3" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
W20260709 13:21:24.521524  6845 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:21:24.436401 13676 raft_consensus.cc:515] T 34f36d59d88f40fe8a2805e604fc6c0a P b7ab4784c7344b939bc36f639286f377 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:24.521843  6872 rpcz_store.cc:276] 0709 13:21:23.470905 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:21:24.218035 (+747130us) service_pool.cc:224] Handling call
0709 13:21:24.236555 (+ 18520us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:21:24.299370 (+ 62815us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:21:24.299409 (+    39us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:21:24.299458 (+    49us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:21:24.299492 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:21:24.519125 (+219633us) spinlock_profiling.cc:243] Waited 62.6 ms on lock 0x7b54001e7dd4. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f9aae01 00007fcc0f9a983e 00007fcc1496e419 00007fcc0dee5bd4 00007fcc0dee5b62 00007fcc0dee5a91 00007fcc0dee5a0c 00007fcc0dee4cc2 00007fcc0dce548c 00007fcc0dce48c6
0709 13:21:24.519176 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:21:24.519280 (+   104us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":143870208}
I20260709 13:21:24.528301  7502 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50742 (request call id 622) took 1474 ms. Trace:
I20260709 13:21:24.528767  7502 rpcz_store.cc:276] 0709 13:21:23.051964 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:21:23.204747 (+152783us) service_pool.cc:224] Handling call
0709 13:21:24.520708 (+1315961us) spinlock_profiling.cc:243] Waited 8.56 ms on lock 0x7b5800123f98. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0c745db1 00007fcc0c885b71 00007fcc0c885a22 00007fcc1579ec09 00007fcc148f8ee0 00007fcc149c20ab 00007fcc149c2131 00007fcc149700a0 00007fcc1496f984 00007fcc0deea6d4 00007fcc0deea662
0709 13:21:24.526653 (+  5945us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":19695488}
I20260709 13:21:24.530849 13793 raft_consensus.cc:493] T 4f00a2e87e56452083b759f60d461ee3 P cd75a17ab2604397adab03bb8b5fd75c [term 20 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:21:24.533267 13793 raft_consensus.cc:515] T 4f00a2e87e56452083b759f60d461ee3 P cd75a17ab2604397adab03bb8b5fd75c [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:21:24.534891 13447 raft_consensus.cc:993] T 9e326172347f45e99a0d482b5d8ef768 P b7ab4784c7344b939bc36f639286f377: : Instructing follower cd75a17ab2604397adab03bb8b5fd75c to start an election
I20260709 13:21:24.535497 13447 raft_consensus.cc:1081] T 9e326172347f45e99a0d482b5d8ef768 P b7ab4784c7344b939bc36f639286f377 [term 17 LEADER]: Signalling peer cd75a17ab2604397adab03bb8b5fd75c to start an election
I20260709 13:21:24.541349  6802 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:32966 (request call id 1732) took 1627 ms. Trace:
I20260709 13:21:24.535614 13793 leader_election.cc:290] T 4f00a2e87e56452083b759f60d461ee3 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:21:24.541836  6802 rpcz_store.cc:276] 0709 13:21:22.914460 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:21:22.914651 (+   191us) service_pool.cc:224] Handling call
0709 13:21:22.915150 (+   499us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:21:23.227078 (+311928us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:21:24.541056 (+1313978us) spinlock_profiling.cc:243] Waited 309 ms on lock 0x7b54001f6b54. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f9aae01 00007fcc0f9a983e 00007fcc1496e419 00007fcc0dee5bd4 00007fcc0dee5b62 00007fcc0dee5a91 00007fcc0dee5a0c 00007fcc0dee4cc2 00007fcc0dce548c 00007fcc0dce48c6
0709 13:21:24.541277 (+   221us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":709937024}
I20260709 13:21:24.526793 13264 raft_consensus.cc:493] T 2c240553ce044eedb41541d72b9475d7 P cd75a17ab2604397adab03bb8b5fd75c [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:24.554728  6880 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9e326172347f45e99a0d482b5d8ef768"
dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
 from {username='slave'} at 127.0.0.1:53406
I20260709 13:21:24.556586  6880 raft_consensus.cc:493] T 9e326172347f45e99a0d482b5d8ef768 P cd75a17ab2604397adab03bb8b5fd75c [term 17 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:21:24.557062  6880 raft_consensus.cc:3060] T 9e326172347f45e99a0d482b5d8ef768 P cd75a17ab2604397adab03bb8b5fd75c [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:21:24.558892  6730 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50004 (request call id 3170) took 2029 ms. Trace:
I20260709 13:21:24.559345  6730 rpcz_store.cc:276] 0709 13:21:22.529691 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:21:22.530539 (+   848us) service_pool.cc:224] Handling call
0709 13:21:22.530968 (+   429us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:21:23.270221 (+739253us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:21:24.558621 (+1288400us) spinlock_profiling.cc:243] Waited 736 ms on lock 0x7b54003197d4. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f9aae01 00007fcc0f9a983e 00007fcc1496e419 00007fcc0dee5bd4 00007fcc0dee5b62 00007fcc0dee5a91 00007fcc0dee5a0c 00007fcc0dee4cc2 00007fcc0dce548c 00007fcc0dce48c6
0709 13:21:24.558820 (+   199us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1693751552}
I20260709 13:21:24.558099 13264 raft_consensus.cc:515] T 2c240553ce044eedb41541d72b9475d7 P cd75a17ab2604397adab03bb8b5fd75c [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:24.571180 13264 leader_election.cc:290] T 2c240553ce044eedb41541d72b9475d7 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:21:24.572230 13674 consensus_queue.cc:237] T 7a734b5ab7834e05a8c422208acc58b1 P 7ba59cc884714e8aa5f3f0ecaed84cbb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 20.11, Last appended by leader: 11, Current term: 22, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } attrs { replace: true } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:21:24.573338 13588 consensus_queue.cc:260] T 1bf4668eeb70467fb3dc5a0289233b3c P cd75a17ab2604397adab03bb8b5fd75c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:24.574647 13588 raft_consensus.cc:3060] T 1bf4668eeb70467fb3dc5a0289233b3c P cd75a17ab2604397adab03bb8b5fd75c [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:21:24.577071 13711 leader_election.cc:290] T 4b8cacb381b746da8d0049b0a83b41dd P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
W20260709 13:21:24.578334  6803 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:32976 (request call id 3904) took 2316 ms (client timeout 2246 ms). Trace:
W20260709 13:21:24.578800  6803 rpcz_store.cc:269] 0709 13:21:22.262319 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:21:22.262493 (+   174us) service_pool.cc:224] Handling call
0709 13:21:24.578093 (+2315600us) spinlock_profiling.cc:243] Waited 1.65 s on lock 0x7b54001f6154. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f9ae2fa 00007fcc1496fb17 00007fcc0deea6d4 00007fcc0deea662 00007fcc0deea591 00007fcc0deea50c 00007fcc0dee97c2 00007fcc0dce548c 00007fcc0dce48c6 00007fcc0dce426f
0709 13:21:24.578220 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3805948800}
I20260709 13:21:24.591044  6873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b8cacb381b746da8d0049b0a83b41dd" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:21:24.593283  7498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b8cacb381b746da8d0049b0a83b41dd" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:21:24.596751 13655 leader_election.cc:290] T 22ccee1b570c4ad3a57bd7aec085b1b4 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:21:24.563606 13694 raft_consensus.cc:515] T fe20b4b48823486ca3b9c648db6ce8aa P ccd8a4c3bfe3413cb2ae219b09aea832 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:21:24.603502  6730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c240553ce044eedb41541d72b9475d7" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 21 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:21:24.604358  6730 raft_consensus.cc:2410] T 2c240553ce044eedb41541d72b9475d7 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c for term 21 because replica has last-logged OpId of term: 19 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 10.
I20260709 13:21:24.611081  6877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22ccee1b570c4ad3a57bd7aec085b1b4" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:21:24.613241  7468 leader_election.cc:304] T 7ba5dac66ab5497e9e336f2a3c28cda5 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377
I20260709 13:21:24.612918  6880 raft_consensus.cc:515] T 9e326172347f45e99a0d482b5d8ef768 P cd75a17ab2604397adab03bb8b5fd75c [term 18 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:24.616402 13704 raft_consensus.cc:493] T 8c7f33e544204fbaac4078e3e83bbf4e P ccd8a4c3bfe3413cb2ae219b09aea832 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:21:24.616904 13704 raft_consensus.cc:515] T 8c7f33e544204fbaac4078e3e83bbf4e P ccd8a4c3bfe3413cb2ae219b09aea832 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:24.618407  6730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e326172347f45e99a0d482b5d8ef768" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: true dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:21:24.618966  6730 raft_consensus.cc:3060] T 9e326172347f45e99a0d482b5d8ef768 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:21:24.612010 13667 raft_consensus.cc:493] T 7ba5dac66ab5497e9e336f2a3c28cda5 P b7ab4784c7344b939bc36f639286f377 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:24.622115  6877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c7f33e544204fbaac4078e3e83bbf4e" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:21:24.622383  6880 leader_election.cc:290] T 9e326172347f45e99a0d482b5d8ef768 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 18 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:21:24.630124  6732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3f13b31a1f84f0d89d007eadd57924c" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 17 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:21:24.632194  6724 raft_consensus.cc:1275] T 4275cf08e63345f993bce8664eada830 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 19 FOLLOWER]: Refusing update from remote peer b7ab4784c7344b939bc36f639286f377: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
I20260709 13:21:24.635178  6730 raft_consensus.cc:2468] T 9e326172347f45e99a0d482b5d8ef768 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 18.
I20260709 13:21:24.636336  6844 leader_election.cc:304] T 9e326172347f45e99a0d482b5d8ef768 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:21:24.600185 13651 raft_consensus.cc:493] T c4db81d9d329422bb3b4160ca4ac2d1d P ccd8a4c3bfe3413cb2ae219b09aea832 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:21:24.618906 13704 leader_election.cc:290] T 8c7f33e544204fbaac4078e3e83bbf4e P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
W20260709 13:21:24.621165 13817 log.cc:927] Time spent T f3f9c2e2bf644115957398fe4c9459db P cd75a17ab2604397adab03bb8b5fd75c: Append to log took a long time: real 0.067s	user 0.000s	sys 0.001s
I20260709 13:21:24.641805  6730 raft_consensus.cc:1240] T 9b3759de40694069b13c0f8bd40e5709 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 18 FOLLOWER]: Rejecting Update request from peer b7ab4784c7344b939bc36f639286f377 for earlier term 17. Current term is 18. Ops: []
I20260709 13:21:24.626448 13807 raft_consensus.cc:2804] T 7ba5dac66ab5497e9e336f2a3c28cda5 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:21:24.644316 13698 raft_consensus.cc:493] T b56bf91d90824c959e21e0cee5ba1816 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:21:24.644982 13660 raft_consensus.cc:2804] T 9e326172347f45e99a0d482b5d8ef768 P cd75a17ab2604397adab03bb8b5fd75c [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:21:24.645563 13631 raft_consensus.cc:493] T 3a485a995abc4807b6e511e45419f737 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
W20260709 13:21:24.646030  6847 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:21:24.612222 13207 raft_consensus.cc:493] T 404190ce4ce94cecbfcb6ea9d1dd8626 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:21:24.651244  7498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ba5dac66ab5497e9e336f2a3c28cda5" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:21:24.659427  6728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a734b5ab7834e05a8c422208acc58b1" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:21:24.672132  6728 raft_consensus.cc:2368] T 7a734b5ab7834e05a8c422208acc58b1 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate b7ab4784c7344b939bc36f639286f377 for earlier term 21. Current term is 22.
I20260709 13:21:24.666869  7502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fa34c08b205435dba97346991aa1f92" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:21:24.626464 13723 raft_consensus.cc:493] T 853ac0a8cbd64ce99457f170216d4d0f P cd75a17ab2604397adab03bb8b5fd75c [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:24.626530 13711 raft_consensus.cc:493] T 4d9def8b32fd443aa94ab1420b06837b P ccd8a4c3bfe3413cb2ae219b09aea832 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:21:24.674067  7494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f00a2e87e56452083b759f60d461ee3" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:21:24.655037 13771 raft_consensus.cc:493] T 95a75bfe094d4bdc963aba3f08dfcd25 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 16 FOLLOWER]: Starting pre-election (detected failure of leader cd75a17ab2604397adab03bb8b5fd75c)
I20260709 13:21:24.685328 13771 raft_consensus.cc:515] T 95a75bfe094d4bdc963aba3f08dfcd25 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } attrs { replace: true } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:21:24.682276 13207 raft_consensus.cc:515] T 404190ce4ce94cecbfcb6ea9d1dd8626 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:21:24.693064 13207 leader_election.cc:290] T 404190ce4ce94cecbfcb6ea9d1dd8626 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:21:24.671651 13698 raft_consensus.cc:515] T b56bf91d90824c959e21e0cee5ba1816 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:24.655308 13651 raft_consensus.cc:515] T c4db81d9d329422bb3b4160ca4ac2d1d P ccd8a4c3bfe3413cb2ae219b09aea832 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:24.695081  6728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a75bfe094d4bdc963aba3f08dfcd25" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:21:24.695977 13698 leader_election.cc:290] T b56bf91d90824c959e21e0cee5ba1816 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:21:24.697422 13771 leader_election.cc:290] T 95a75bfe094d4bdc963aba3f08dfcd25 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:21:24.697976 13694 leader_election.cc:290] T fe20b4b48823486ca3b9c648db6ce8aa P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 16 election: Requested vote from peers cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:21:24.700135  6879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a75bfe094d4bdc963aba3f08dfcd25" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:21:24.660866 13807 raft_consensus.cc:493] T 7ba5dac66ab5497e9e336f2a3c28cda5 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 20 FOLLOWER]: Starting leader election (detected failure of leader cd75a17ab2604397adab03bb8b5fd75c)
I20260709 13:21:24.681639 13631 raft_consensus.cc:515] T 3a485a995abc4807b6e511e45419f737 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:24.718581 13554 raft_consensus.cc:493] T d8292e16e5654be6bc408560cf256aaa P b7ab4784c7344b939bc36f639286f377 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:21:24.704784  6803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a75bfe094d4bdc963aba3f08dfcd25" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:21:24.723944 13554 raft_consensus.cc:515] T d8292e16e5654be6bc408560cf256aaa P b7ab4784c7344b939bc36f639286f377 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:24.709187  6806 raft_consensus.cc:1240] T 20f6842e26174571996b8dea4151d4be P b7ab4784c7344b939bc36f639286f377 [term 22 LEADER]: Rejecting Update request from peer cd75a17ab2604397adab03bb8b5fd75c for earlier term 21. Current term is 22. Ops: []
I20260709 13:21:24.709527  6805 raft_consensus.cc:1240] T 1bf4668eeb70467fb3dc5a0289233b3c P b7ab4784c7344b939bc36f639286f377 [term 18 FOLLOWER]: Rejecting Update request from peer cd75a17ab2604397adab03bb8b5fd75c for earlier term 17. Current term is 18. Ops: []
I20260709 13:21:24.709964  6799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "713b5728a197487c9300b310ab94e5a3" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:21:24.710237 13661 raft_consensus.cc:493] T 2c240553ce044eedb41541d72b9475d7 P b7ab4784c7344b939bc36f639286f377 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:24.710510 13791 raft_consensus.cc:493] T e77e330a82df4b43a745d57a68f6f057 P b7ab4784c7344b939bc36f639286f377 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:21:24.710631  6807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8cee0accdb8499c86d4414b72565a38" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:21:24.711387 13601 raft_consensus.cc:493] T 44bde925b2e541b69890d70715b85176 P b7ab4784c7344b939bc36f639286f377 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:21:24.743181 13791 raft_consensus.cc:515] T e77e330a82df4b43a745d57a68f6f057 P b7ab4784c7344b939bc36f639286f377 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } }
I20260709 13:21:24.743853 13601 raft_consensus.cc:515] T 44bde925b2e541b69890d70715b85176 P b7ab4784c7344b939bc36f639286f377 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:24.712059  6804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab432e62819d499eaaf3dd55481dd930" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 24 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:21:24.680615 13711 raft_consensus.cc:515] T 4d9def8b32fd443aa94ab1420b06837b P ccd8a4c3bfe3413cb2ae219b09aea832 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:24.663261 13772 raft_consensus.cc:515] T 3fa34c08b205435dba97346991aa1f92 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 25 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:21:24.748750  7502 raft_consensus.cc:2368] T 3fa34c08b205435dba97346991aa1f92 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c for earlier term 24. Current term is 25.
I20260709 13:21:24.749529 13711 leader_election.cc:290] T 4d9def8b32fd443aa94ab1420b06837b P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:21:24.749894 13772 leader_election.cc:290] T 3fa34c08b205435dba97346991aa1f92 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 25 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:21:24.697181 13651 leader_election.cc:290] T c4db81d9d329422bb3b4160ca4ac2d1d P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:21:24.713372  6802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ba5dac66ab5497e9e336f2a3c28cda5" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:21:24.716022  7468 leader_election.cc:304] T 95a75bfe094d4bdc963aba3f08dfcd25 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:21:24.720268  6800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30e88460611e47b2ba16a46a30b5f416" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 17 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
W20260709 13:21:24.716466 13690 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.978s	user 0.025s	sys 0.035s
W20260709 13:21:24.752767 13690 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.083s	user 0.025s	sys 0.035s
I20260709 13:21:24.754752  6725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a75bfe094d4bdc963aba3f08dfcd25" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:21:24.756693  6726 raft_consensus.cc:1240] T 9e326172347f45e99a0d482b5d8ef768 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 18 FOLLOWER]: Rejecting Update request from peer b7ab4784c7344b939bc36f639286f377 for earlier term 17. Current term is 18. Ops: [17.10-17.10]
I20260709 13:21:24.662258 13756 raft_consensus.cc:515] T f09c2a98de1a4decabd0ff900dd44caa P cd75a17ab2604397adab03bb8b5fd75c [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:24.731479  6728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22ccee1b570c4ad3a57bd7aec085b1b4" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:21:24.729326 13661 raft_consensus.cc:515] T 2c240553ce044eedb41541d72b9475d7 P b7ab4784c7344b939bc36f639286f377 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:24.759341  6875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fa34c08b205435dba97346991aa1f92" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 25 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:21:24.759959  6875 raft_consensus.cc:3060] T 3fa34c08b205435dba97346991aa1f92 P cd75a17ab2604397adab03bb8b5fd75c [term 23 FOLLOWER]: Advancing to term 25
I20260709 13:21:24.729622 13807 raft_consensus.cc:3060] T 7ba5dac66ab5497e9e336f2a3c28cda5 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:21:24.677420 13723 raft_consensus.cc:515] T 853ac0a8cbd64ce99457f170216d4d0f P cd75a17ab2604397adab03bb8b5fd75c [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:24.741703 13602 raft_consensus.cc:493] T d33d5ee8ef6f415593d8df52063161ad P b7ab4784c7344b939bc36f639286f377 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:21:24.677042 13660 raft_consensus.cc:697] T 9e326172347f45e99a0d482b5d8ef768 P cd75a17ab2604397adab03bb8b5fd75c [term 18 LEADER]: Becoming Leader. State: Replica: cd75a17ab2604397adab03bb8b5fd75c, State: Running, Role: LEADER
I20260709 13:21:24.628895 13667 raft_consensus.cc:515] T 7ba5dac66ab5497e9e336f2a3c28cda5 P b7ab4784c7344b939bc36f639286f377 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:21:24.761511  6800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b3759de40694069b13c0f8bd40e5709" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: true dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:21:24.762305  6726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09c2a98de1a4decabd0ff900dd44caa" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:21:24.786571  6800 raft_consensus.cc:3055] T 9b3759de40694069b13c0f8bd40e5709 P b7ab4784c7344b939bc36f639286f377 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:21:24.786847  6807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09c2a98de1a4decabd0ff900dd44caa" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:21:24.787876  6807 raft_consensus.cc:2393] T f09c2a98de1a4decabd0ff900dd44caa P b7ab4784c7344b939bc36f639286f377 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c in current term 21: Already voted for candidate b7ab4784c7344b939bc36f639286f377 in this term.
I20260709 13:21:24.787096  6800 raft_consensus.cc:740] T 9b3759de40694069b13c0f8bd40e5709 P b7ab4784c7344b939bc36f639286f377 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
I20260709 13:21:24.729461 13676 leader_election.cc:290] T 34f36d59d88f40fe8a2805e604fc6c0a P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:21:24.726681 13554 leader_election.cc:290] T d8292e16e5654be6bc408560cf256aaa P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:21:24.796674  6799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d33d5ee8ef6f415593d8df52063161ad" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:21:24.771790 13671 raft_consensus.cc:493] T 7c44c4849aa54f2b94d1f1bef9ed546f P b7ab4784c7344b939bc36f639286f377 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:21:24.769776 13690 raft_consensus.cc:493] T 90d42e216d9741e190bca19a781291fd P cd75a17ab2604397adab03bb8b5fd75c [term 18 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:21:24.798285 13690 raft_consensus.cc:515] T 90d42e216d9741e190bca19a781291fd P cd75a17ab2604397adab03bb8b5fd75c [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:24.746202 13601 leader_election.cc:290] T 44bde925b2e541b69890d70715b85176 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:21:24.769145 13772 raft_consensus.cc:2749] T 95a75bfe094d4bdc963aba3f08dfcd25 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:21:24.769495 13651 raft_consensus.cc:493] T 3d65025eea89441290d85dd053810e31 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:21:24.800449 13651 raft_consensus.cc:515] T 3d65025eea89441290d85dd053810e31 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:24.801322 13690 leader_election.cc:290] T 90d42e216d9741e190bca19a781291fd P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:21:24.802014  6730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90d42e216d9741e190bca19a781291fd" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:21:24.770958 13711 raft_consensus.cc:493] T 1528ab62b6fe4e3099d08f141afee116 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:21:24.802659 13651 leader_election.cc:290] T 3d65025eea89441290d85dd053810e31 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:21:24.788668 13697 raft_consensus.cc:493] T f03d0dbf16864ca4bc1bb5e4c0334c0f P ccd8a4c3bfe3413cb2ae219b09aea832 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:21:24.802965  6805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f00a2e87e56452083b759f60d461ee3" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:21:24.802876 13711 raft_consensus.cc:515] T 1528ab62b6fe4e3099d08f141afee116 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:21:24.790814 13707 raft_consensus.cc:493] T 711ef6523deb4cbe8ef2ba61e1c21c98 P b7ab4784c7344b939bc36f639286f377 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:21:24.803668 13697 raft_consensus.cc:515] T f03d0dbf16864ca4bc1bb5e4c0334c0f P ccd8a4c3bfe3413cb2ae219b09aea832 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:24.723986 13631 leader_election.cc:290] T 3a485a995abc4807b6e511e45419f737 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:21:24.804391 13707 raft_consensus.cc:515] T 711ef6523deb4cbe8ef2ba61e1c21c98 P b7ab4784c7344b939bc36f639286f377 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:24.803293 13661 leader_election.cc:290] T 2c240553ce044eedb41541d72b9475d7 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:21:24.805239 13711 leader_election.cc:290] T 1528ab62b6fe4e3099d08f141afee116 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:21:24.805896 13697 leader_election.cc:290] T f03d0dbf16864ca4bc1bb5e4c0334c0f P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:21:24.806627 13707 leader_election.cc:290] T 711ef6523deb4cbe8ef2ba61e1c21c98 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
W20260709 13:21:24.806823 13785 log.cc:927] Time spent T 17587d6730594da4a56fa13a353232a1 P ccd8a4c3bfe3413cb2ae219b09aea832: Append to log took a long time: real 0.972s	user 0.009s	sys 0.000s
I20260709 13:21:24.807343  6804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44bde925b2e541b69890d70715b85176" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:21:24.798020 13671 raft_consensus.cc:515] T 7c44c4849aa54f2b94d1f1bef9ed546f P b7ab4784c7344b939bc36f639286f377 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:24.808005  6804 raft_consensus.cc:2468] T 44bde925b2e541b69890d70715b85176 P b7ab4784c7344b939bc36f639286f377 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 19.
I20260709 13:21:24.808187  6731 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49744 (request call id 788) took 1357 ms. Trace:
I20260709 13:21:24.808524  6731 rpcz_store.cc:276] 0709 13:21:23.451239 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:21:23.451458 (+   219us) service_pool.cc:224] Handling call
0709 13:21:23.490027 (+ 38569us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:21:23.490582 (+   555us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:21:23.490629 (+    47us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:21:23.526370 (+ 35741us) log.cc:844] Serialized 26 byte log entry
0709 13:21:23.637597 (+111227us) raft_consensus.cc:1645] Marking committed up to 17
0709 13:21:23.637638 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:21:23.637712 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:21:24.769336 (+1131624us) spinlock_profiling.cc:243] Waited 22.1 ms on lock 0x7b4400022b4c. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0c745db1 00007fcc0c7e3c85 00007fcc0c7e46a2 00007fcc0f5561db 00007fcc0f551aaf 00007fcc0f54586e 00007fcc0f544bb6 00007fcc0f5447d8 00007fcc0f54e221 00007fcc0f54e1d9 00007fcc0f54e169
0709 13:21:24.807885 (+ 38549us) raft_consensus.cc:1685] finished
0709 13:21:24.807906 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:21:24.808127 (+   221us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":180,"raft.run_cpu_time_us":241,"raft.run_wall_time_us":22816,"spinlock_wait_cycles":50901248,"thread_start_us":71517,"threads_started":1,"wal-append.queue_time_us":287132}
I20260709 13:21:24.809850 13671 leader_election.cc:290] T 7c44c4849aa54f2b94d1f1bef9ed546f P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:21:24.811240  6804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e326172347f45e99a0d482b5d8ef768" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: true dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:21:24.811933  6807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce4f062dcd314d43a63ca74067cb5ee3" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:21:24.759864 13756 leader_election.cc:290] T f09c2a98de1a4decabd0ff900dd44caa P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 21 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:21:24.746181 13791 leader_election.cc:290] T e77e330a82df4b43a745d57a68f6f057 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931), ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391)
I20260709 13:21:24.811331  6805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c240553ce044eedb41541d72b9475d7" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 21 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
W20260709 13:21:24.813939  6772 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.68:45071, user_credentials={real_user=slave}} blocked reactor thread for 131451us
I20260709 13:21:24.782015 13775 raft_consensus.cc:493] T 1bf4668eeb70467fb3dc5a0289233b3c P b7ab4784c7344b939bc36f639286f377 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:24.792222  6800 consensus_queue.cc:260] T 9b3759de40694069b13c0f8bd40e5709 P b7ab4784c7344b939bc36f639286f377 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
W20260709 13:21:24.829983 13780 thread.cc:641] apply [worker] (thread pool) Time spent creating pthread: real 0.994s	user 0.006s	sys 0.011s
I20260709 13:21:24.822316  6803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90d42e216d9741e190bca19a781291fd" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:21:24.827880  6805 raft_consensus.cc:2410] T 2c240553ce044eedb41541d72b9475d7 P b7ab4784c7344b939bc36f639286f377 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c for term 21 because replica has last-logged OpId of term: 19 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 10.
I20260709 13:21:24.825052  6802 raft_consensus.cc:2468] T 7ba5dac66ab5497e9e336f2a3c28cda5 P b7ab4784c7344b939bc36f639286f377 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 21.
I20260709 13:21:24.816411  6726 raft_consensus.cc:2468] T f09c2a98de1a4decabd0ff900dd44caa P ccd8a4c3bfe3413cb2ae219b09aea832 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 21.
I20260709 13:21:24.814565  6806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09c2a98de1a4decabd0ff900dd44caa" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:21:24.874464  6806 raft_consensus.cc:2393] T f09c2a98de1a4decabd0ff900dd44caa P b7ab4784c7344b939bc36f639286f377 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c in current term 21: Already voted for candidate b7ab4784c7344b939bc36f639286f377 in this term.
I20260709 13:21:24.833226  6804 raft_consensus.cc:3055] T 9e326172347f45e99a0d482b5d8ef768 P b7ab4784c7344b939bc36f639286f377 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:21:24.876010  6804 raft_consensus.cc:740] T 9e326172347f45e99a0d482b5d8ef768 P b7ab4784c7344b939bc36f639286f377 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
I20260709 13:21:24.875458  6844 leader_election.cc:304] T f09c2a98de1a4decabd0ff900dd44caa P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:21:24.830232  6875 raft_consensus.cc:2468] T 3fa34c08b205435dba97346991aa1f92 P cd75a17ab2604397adab03bb8b5fd75c [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in term 25.
I20260709 13:21:24.847029  6798 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50550 (request call id 824) took 1535 ms. Trace:
I20260709 13:21:24.850204 13723 leader_election.cc:290] T 853ac0a8cbd64ce99457f170216d4d0f P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:21:24.850684 13660 consensus_queue.cc:237] T 9e326172347f45e99a0d482b5d8ef768 P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 17.10, Last appended by leader: 10, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:24.851675 13686 leader_election.cc:290] T de3186201e1a40d0b335eeb8b4e256e0 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:21:24.851948  6731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "853ac0a8cbd64ce99457f170216d4d0f" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 19 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
W20260709 13:21:24.875295 13780 thread.cc:608] apply [worker] (thread pool) Time spent starting thread: real 1.037s	user 0.007s	sys 0.011s
I20260709 13:21:24.864542 13697 raft_consensus.cc:493] T bd6869f07b5a4885a0b99fbe60c3b175 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:24.878273 13756 raft_consensus.cc:2804] T f09c2a98de1a4decabd0ff900dd44caa P cd75a17ab2604397adab03bb8b5fd75c [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:21:24.884454 13697 raft_consensus.cc:515] T bd6869f07b5a4885a0b99fbe60c3b175 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:24.887065 13697 leader_election.cc:290] T bd6869f07b5a4885a0b99fbe60c3b175 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:21:24.891723  6800 raft_consensus.cc:3060] T 9b3759de40694069b13c0f8bd40e5709 P b7ab4784c7344b939bc36f639286f377 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:21:24.792899 13602 raft_consensus.cc:515] T d33d5ee8ef6f415593d8df52063161ad P b7ab4784c7344b939bc36f639286f377 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:24.881436  6731 raft_consensus.cc:2410] T 853ac0a8cbd64ce99457f170216d4d0f P ccd8a4c3bfe3413cb2ae219b09aea832 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c for term 19 because replica has last-logged OpId of term: 17 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 9.
I20260709 13:21:24.872018 13791 raft_consensus.cc:493] T a3022224cc81473690653a83d4e99470 P b7ab4784c7344b939bc36f639286f377 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:21:24.881785  7468 leader_election.cc:304] T 3fa34c08b205435dba97346991aa1f92 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:21:24.833839 13775 raft_consensus.cc:515] T 1bf4668eeb70467fb3dc5a0289233b3c P b7ab4784c7344b939bc36f639286f377 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:24.884895 13756 raft_consensus.cc:697] T f09c2a98de1a4decabd0ff900dd44caa P cd75a17ab2604397adab03bb8b5fd75c [term 21 LEADER]: Becoming Leader. State: Replica: cd75a17ab2604397adab03bb8b5fd75c, State: Running, Role: LEADER
I20260709 13:21:24.877004  6804 consensus_queue.cc:260] T 9e326172347f45e99a0d482b5d8ef768 P b7ab4784c7344b939bc36f639286f377 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:24.878113  6798 rpcz_store.cc:276] 0709 13:21:23.311889 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:21:23.312196 (+   307us) service_pool.cc:224] Handling call
0709 13:21:23.319757 (+  7561us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:21:23.543505 (+223748us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:21:23.543574 (+    69us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:21:23.545175 (+  1601us) log.cc:844] Serialized 26 byte log entry
0709 13:21:23.764555 (+219380us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:21:23.764605 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:21:24.840125 (+1075520us) spinlock_profiling.cc:243] Waited 91.7 ms on lock 0x7b54002c74d4. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f9aae01 00007fcc0f9a983e 00007fcc1496e419 00007fcc0dee5bd4 00007fcc0dee5b62 00007fcc0dee5a91 00007fcc0dee5a0c 00007fcc0dee4cc2 00007fcc0dce548c 00007fcc0dce48c6
0709 13:21:24.840190 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:21:24.840240 (+    50us) raft_consensus.cc:1685] finished
0709 13:21:24.840255 (+    15us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:21:24.846920 (+  6665us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":24059,"raft.run_cpu_time_us":123,"raft.run_wall_time_us":116,"spinlock_wait_cycles":210991488,"thread_start_us":297179,"threads_started":2,"wal-append.queue_time_us":434556}
I20260709 13:21:24.852465 13667 leader_election.cc:290] T 7ba5dac66ab5497e9e336f2a3c28cda5 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:21:24.911754 13772 raft_consensus.cc:2804] T 3fa34c08b205435dba97346991aa1f92 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 25 FOLLOWER]: Leader election won for term 25
I20260709 13:21:24.912339 13772 raft_consensus.cc:697] T 3fa34c08b205435dba97346991aa1f92 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 25 LEADER]: Becoming Leader. State: Replica: 7ba59cc884714e8aa5f3f0ecaed84cbb, State: Running, Role: LEADER
I20260709 13:21:24.913275 13772 consensus_queue.cc:237] T 3fa34c08b205435dba97346991aa1f92 P 7ba59cc884714e8aa5f3f0ecaed84cbb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 23.17, Last appended by leader: 17, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:21:24.914590 13756 consensus_queue.cc:237] T f09c2a98de1a4decabd0ff900dd44caa P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 20.12, Last appended by leader: 12, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:24.917573  6799 raft_consensus.cc:2468] T d33d5ee8ef6f415593d8df52063161ad P b7ab4784c7344b939bc36f639286f377 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 18.
I20260709 13:21:24.918670 13690 raft_consensus.cc:493] T dbdf895bba214ff68685a24fd17dfb5d P cd75a17ab2604397adab03bb8b5fd75c [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:24.919278 13690 raft_consensus.cc:515] T dbdf895bba214ff68685a24fd17dfb5d P cd75a17ab2604397adab03bb8b5fd75c [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:24.921736  6772 leader_election.cc:304] T 95a75bfe094d4bdc963aba3f08dfcd25 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:21:24.910172  6804 raft_consensus.cc:3060] T 9e326172347f45e99a0d482b5d8ef768 P b7ab4784c7344b939bc36f639286f377 [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:21:24.904899 13824 log.cc:927] Time spent T 30e88460611e47b2ba16a46a30b5f416 P b7ab4784c7344b939bc36f639286f377: Append to log took a long time: real 0.074s	user 0.001s	sys 0.000s
I20260709 13:21:24.903213 13594 raft_consensus.cc:493] T d8292e16e5654be6bc408560cf256aaa P cd75a17ab2604397adab03bb8b5fd75c [term 19 FOLLOWER]: Starting pre-election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:21:24.907070 13674 raft_consensus.cc:493] T 4f00a2e87e56452083b759f60d461ee3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 20 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
W20260709 13:21:24.937544  7466 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 208060us
I20260709 13:21:24.947281  6770 leader_election.cc:304] T b3f13b31a1f84f0d89d007eadd57924c P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:21:24.948647  6879 raft_consensus.cc:1240] T 9e326172347f45e99a0d482b5d8ef768 P cd75a17ab2604397adab03bb8b5fd75c [term 18 LEADER]: Rejecting Update request from peer b7ab4784c7344b939bc36f639286f377 for earlier term 17. Current term is 18. Ops: []
I20260709 13:21:24.948523 13594 raft_consensus.cc:515] T d8292e16e5654be6bc408560cf256aaa P cd75a17ab2604397adab03bb8b5fd75c [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:24.946008 13027 raft_consensus.cc:493] T f09c2a98de1a4decabd0ff900dd44caa P b7ab4784c7344b939bc36f639286f377 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:24.956352 13027 raft_consensus.cc:515] T f09c2a98de1a4decabd0ff900dd44caa P b7ab4784c7344b939bc36f639286f377 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:24.957351  7494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ba5dac66ab5497e9e336f2a3c28cda5" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 22 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:21:24.958379 13027 leader_election.cc:290] T f09c2a98de1a4decabd0ff900dd44caa P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:21:24.958524 13665 consensus_queue.cc:1059] T f3f9c2e2bf644115957398fe4c9459db P b7ab4784c7344b939bc36f639286f377 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:21:24.962451 13790 leader_election.cc:290] T ce4f062dcd314d43a63ca74067cb5ee3 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:21:24.962728 13594 leader_election.cc:290] T d8292e16e5654be6bc408560cf256aaa P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:21:24.964190 13674 raft_consensus.cc:515] T 4f00a2e87e56452083b759f60d461ee3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:21:24.945565 13801 raft_consensus.cc:2749] T 95a75bfe094d4bdc963aba3f08dfcd25 P b7ab4784c7344b939bc36f639286f377 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:21:24.971494 13690 leader_election.cc:290] T dbdf895bba214ff68685a24fd17dfb5d P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:21:24.979614  6875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77e330a82df4b43a745d57a68f6f057" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:21:25.014247  6875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f00a2e87e56452083b759f60d461ee3" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:21:25.015231  6875 raft_consensus.cc:2468] T 4f00a2e87e56452083b759f60d461ee3 P cd75a17ab2604397adab03bb8b5fd75c [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in term 20.
I20260709 13:21:24.980360  6880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34f36d59d88f40fe8a2805e604fc6c0a" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:21:24.974493  6877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8292e16e5654be6bc408560cf256aaa" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:21:24.984714  6872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44bde925b2e541b69890d70715b85176" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:21:25.016742  6880 raft_consensus.cc:2468] T 34f36d59d88f40fe8a2805e604fc6c0a P cd75a17ab2604397adab03bb8b5fd75c [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 17.
I20260709 13:21:24.986640  6874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "711ef6523deb4cbe8ef2ba61e1c21c98" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:21:25.016773  6877 raft_consensus.cc:2468] T d8292e16e5654be6bc408560cf256aaa P cd75a17ab2604397adab03bb8b5fd75c [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 19.
I20260709 13:21:24.987870  6876 raft_consensus.cc:3055] T 20f6842e26174571996b8dea4151d4be P cd75a17ab2604397adab03bb8b5fd75c [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:21:25.019352  6876 raft_consensus.cc:740] T 20f6842e26174571996b8dea4151d4be P cd75a17ab2604397adab03bb8b5fd75c [term 21 LEADER]: Becoming Follower/Learner. State: Replica: cd75a17ab2604397adab03bb8b5fd75c, State: Running, Role: LEADER
I20260709 13:21:24.990898  6798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f00a2e87e56452083b759f60d461ee3" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:21:24.991773 13602 leader_election.cc:290] T d33d5ee8ef6f415593d8df52063161ad P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:21:24.977600  6879 raft_consensus.cc:1275] T bd6869f07b5a4885a0b99fbe60c3b175 P cd75a17ab2604397adab03bb8b5fd75c [term 22 FOLLOWER]: Refusing update from remote peer b7ab4784c7344b939bc36f639286f377: Log matching property violated. Preceding OpId in replica: term: 21 index: 11. Preceding OpId from leader: term: 22 index: 11. (term mismatch)
I20260709 13:21:25.035446  6879 pending_rounds.cc:85] T bd6869f07b5a4885a0b99fbe60c3b175 P cd75a17ab2604397adab03bb8b5fd75c: Aborting all ops after (but not including) 10
I20260709 13:21:25.035777  6879 pending_rounds.cc:107] T bd6869f07b5a4885a0b99fbe60c3b175 P cd75a17ab2604397adab03bb8b5fd75c: Aborting uncommitted NO_OP operation due to leader change: 21.11
I20260709 13:21:25.036082  6879 raft_consensus.cc:2889] T bd6869f07b5a4885a0b99fbe60c3b175 P cd75a17ab2604397adab03bb8b5fd75c [term 22 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:21:24.995417  6770 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 48233.2us
I20260709 13:21:24.997169 13707 raft_consensus.cc:2749] T b3f13b31a1f84f0d89d007eadd57924c P b7ab4784c7344b939bc36f639286f377 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:21:24.999017 13593 raft_consensus.cc:3055] T f3f9c2e2bf644115957398fe4c9459db P b7ab4784c7344b939bc36f639286f377 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:21:25.052520  6730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbdf895bba214ff68685a24fd17dfb5d" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 20 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:21:25.053205  6728 raft_consensus.cc:1275] T 9b3759de40694069b13c0f8bd40e5709 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 18 FOLLOWER]: Refusing update from remote peer cd75a17ab2604397adab03bb8b5fd75c: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 13:21:25.053969  6726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8292e16e5654be6bc408560cf256aaa" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:21:25.054677  6880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ba5dac66ab5497e9e336f2a3c28cda5" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 22 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:21:25.055449  6880 raft_consensus.cc:2410] T 7ba5dac66ab5497e9e336f2a3c28cda5 P cd75a17ab2604397adab03bb8b5fd75c [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7ab4784c7344b939bc36f639286f377 for term 22 because replica has last-logged OpId of term: 20 index: 15, which is greater than that of the candidate, which has last-logged OpId of term: 19 index: 14.
I20260709 13:21:24.967684 13674 leader_election.cc:290] T 4f00a2e87e56452083b759f60d461ee3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:21:25.002665  6881 raft_consensus.cc:1275] T 07a92dd554674067a83a9cb68c4773f2 P cd75a17ab2604397adab03bb8b5fd75c [term 19 FOLLOWER]: Refusing update from remote peer b7ab4784c7344b939bc36f639286f377: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
I20260709 13:21:25.004655  6846 leader_election.cc:400] T 3fa34c08b205435dba97346991aa1f92 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 24 pre-election: Vote denied by peer 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071) with higher term. Message: Invalid argument: T 3fa34c08b205435dba97346991aa1f92 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c for earlier term 24. Current term is 25.
I20260709 13:21:25.059727  6846 leader_election.cc:403] T 3fa34c08b205435dba97346991aa1f92 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 24 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:21:25.004797  6805 raft_consensus.cc:1240] T 07a92dd554674067a83a9cb68c4773f2 P b7ab4784c7344b939bc36f639286f377 [term 19 LEADER]: Rejecting Update request from peer ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 18. Current term is 19. Ops: []
I20260709 13:21:25.007630  6804 raft_consensus.cc:2468] T 9e326172347f45e99a0d482b5d8ef768 P b7ab4784c7344b939bc36f639286f377 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 18.
W20260709 13:21:25.008090  6772 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 57550.6us
I20260709 13:21:24.975744 13775 leader_election.cc:290] T 1bf4668eeb70467fb3dc5a0289233b3c P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:21:25.025869  7468 leader_election.cc:304] T 4f00a2e87e56452083b759f60d461ee3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:21:25.064677  6770 leader_election.cc:400] T 7a734b5ab7834e05a8c422208acc58b1 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 21 election: Vote denied by peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391) with higher term. Message: Invalid argument: T 7a734b5ab7834e05a8c422208acc58b1 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate b7ab4784c7344b939bc36f639286f377 for earlier term 21. Current term is 22.
I20260709 13:21:25.065109  6770 leader_election.cc:403] T 7a734b5ab7834e05a8c422208acc58b1 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 21 election: Cancelling election due to peer responding with higher term
I20260709 13:21:25.065867  6805 raft_consensus.cc:1275] T 34f36d59d88f40fe8a2805e604fc6c0a P b7ab4784c7344b939bc36f639286f377 [term 17 FOLLOWER]: Refusing update from remote peer ccd8a4c3bfe3413cb2ae219b09aea832: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 13:21:25.066219  6806 raft_consensus.cc:1240] T dbdf895bba214ff68685a24fd17dfb5d P b7ab4784c7344b939bc36f639286f377 [term 19 LEADER]: Rejecting Update request from peer ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 18. Current term is 19. Ops: []
W20260709 13:21:25.067510  6846 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.68:45071, user_credentials={real_user=slave}} blocked reactor thread for 62990.6us
I20260709 13:21:25.033356  6800 raft_consensus.cc:2468] T 9b3759de40694069b13c0f8bd40e5709 P b7ab4784c7344b939bc36f639286f377 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 18.
I20260709 13:21:25.040697  6878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c240553ce044eedb41541d72b9475d7" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:21:25.039469  6873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c44c4849aa54f2b94d1f1bef9ed546f" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:21:25.068708  6878 raft_consensus.cc:2468] T 2c240553ce044eedb41541d72b9475d7 P cd75a17ab2604397adab03bb8b5fd75c [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 20.
I20260709 13:21:25.049371  6872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de3186201e1a40d0b335eeb8b4e256e0" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:21:25.070044  6872 raft_consensus.cc:2468] T de3186201e1a40d0b335eeb8b4e256e0 P cd75a17ab2604397adab03bb8b5fd75c [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 20.
I20260709 13:21:25.020387  6876 consensus_queue.cc:260] T 20f6842e26174571996b8dea4151d4be P cd75a17ab2604397adab03bb8b5fd75c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 21.13, Last appended by leader: 13, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:25.051013  6724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fa34c08b205435dba97346991aa1f92" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 25 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:21:25.072182  6695 leader_election.cc:304] T de3186201e1a40d0b335eeb8b4e256e0 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:21:25.061267  7502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce4f062dcd314d43a63ca74067cb5ee3" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:21:25.072625  6724 raft_consensus.cc:3060] T 3fa34c08b205435dba97346991aa1f92 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:21:25.057410 13790 raft_consensus.cc:493] T 7c44c4849aa54f2b94d1f1bef9ed546f P cd75a17ab2604397adab03bb8b5fd75c [term 21 FOLLOWER]: Starting pre-election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:21:25.072870  6876 raft_consensus.cc:3060] T 20f6842e26174571996b8dea4151d4be P cd75a17ab2604397adab03bb8b5fd75c [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:21:25.074640  6881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe20b4b48823486ca3b9c648db6ce8aa" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:21:25.079265  6877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a485a995abc4807b6e511e45419f737" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:21:25.078203  6875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b56bf91d90824c959e21e0cee5ba1816" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:21:25.081569  6877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d9def8b32fd443aa94ab1420b06837b" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:21:25.082238  6877 raft_consensus.cc:2468] T 4d9def8b32fd443aa94ab1420b06837b P cd75a17ab2604397adab03bb8b5fd75c [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 21.
I20260709 13:21:25.082919  6881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d65025eea89441290d85dd053810e31" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:21:25.086289  6877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f03d0dbf16864ca4bc1bb5e4c0334c0f" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:21:25.071787  6806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce4f062dcd314d43a63ca74067cb5ee3" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:21:25.089715  6875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6869f07b5a4885a0b99fbe60c3b175" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 23 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:21:25.090078  6807 raft_consensus.cc:1275] T 9b3759de40694069b13c0f8bd40e5709 P b7ab4784c7344b939bc36f639286f377 [term 18 FOLLOWER]: Refusing update from remote peer cd75a17ab2604397adab03bb8b5fd75c: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 13:21:25.090371  6875 raft_consensus.cc:2468] T bd6869f07b5a4885a0b99fbe60c3b175 P cd75a17ab2604397adab03bb8b5fd75c [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 22.
I20260709 13:21:25.076886  6879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4db81d9d329422bb3b4160ca4ac2d1d" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:21:25.095816  6800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c240553ce044eedb41541d72b9475d7" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:21:25.096432  6800 raft_consensus.cc:2468] T 2c240553ce044eedb41541d72b9475d7 P b7ab4784c7344b939bc36f639286f377 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 20.
I20260709 13:21:24.910955 13791 raft_consensus.cc:515] T a3022224cc81473690653a83d4e99470 P b7ab4784c7344b939bc36f639286f377 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:25.092276  6801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e326172347f45e99a0d482b5d8ef768" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:21:25.105125  6876 raft_consensus.cc:1275] T 20f6842e26174571996b8dea4151d4be P cd75a17ab2604397adab03bb8b5fd75c [term 22 FOLLOWER]: Refusing update from remote peer b7ab4784c7344b939bc36f639286f377: Log matching property violated. Preceding OpId in replica: term: 21 index: 13. Preceding OpId from leader: term: 22 index: 13. (term mismatch)
I20260709 13:21:25.058065 13631 raft_consensus.cc:493] T 1bf4668eeb70467fb3dc5a0289233b3c P ccd8a4c3bfe3413cb2ae219b09aea832 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:25.108319  6876 pending_rounds.cc:85] T 20f6842e26174571996b8dea4151d4be P cd75a17ab2604397adab03bb8b5fd75c: Aborting all ops after (but not including) 12
I20260709 13:21:25.108894  6876 pending_rounds.cc:107] T 20f6842e26174571996b8dea4151d4be P cd75a17ab2604397adab03bb8b5fd75c: Aborting uncommitted NO_OP operation due to leader change: 21.13
I20260709 13:21:25.109673  6876 raft_consensus.cc:2889] T 20f6842e26174571996b8dea4151d4be P cd75a17ab2604397adab03bb8b5fd75c [term 22 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:21:25.110760  7501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe20b4b48823486ca3b9c648db6ce8aa" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb"
I20260709 13:21:25.111361  7501 raft_consensus.cc:3060] T fe20b4b48823486ca3b9c648db6ce8aa P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:21:25.112854  7497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1528ab62b6fe4e3099d08f141afee116" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:21:25.114012 13631 raft_consensus.cc:515] T 1bf4668eeb70467fb3dc5a0289233b3c P ccd8a4c3bfe3413cb2ae219b09aea832 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:25.114126  7497 raft_consensus.cc:2468] T 1528ab62b6fe4e3099d08f141afee116 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 17.
I20260709 13:21:25.071347 13588 raft_consensus.cc:493] T de3186201e1a40d0b335eeb8b4e256e0 P cd75a17ab2604397adab03bb8b5fd75c [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:25.115413 13807 raft_consensus.cc:515] T 7ba5dac66ab5497e9e336f2a3c28cda5 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:21:25.115870 13588 raft_consensus.cc:515] T de3186201e1a40d0b335eeb8b4e256e0 P cd75a17ab2604397adab03bb8b5fd75c [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:25.089910 13694 raft_consensus.cc:493] T 853ac0a8cbd64ce99457f170216d4d0f P ccd8a4c3bfe3413cb2ae219b09aea832 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:25.117256 13694 raft_consensus.cc:515] T 853ac0a8cbd64ce99457f170216d4d0f P ccd8a4c3bfe3413cb2ae219b09aea832 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:25.117974 13631 leader_election.cc:290] T 1bf4668eeb70467fb3dc5a0289233b3c P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:21:25.119292 13694 leader_election.cc:290] T 853ac0a8cbd64ce99457f170216d4d0f P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:21:25.071097 13602 consensus_queue.cc:1048] T 4275cf08e63345f993bce8664eada830 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.054s
I20260709 13:21:25.120560  6727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de3186201e1a40d0b335eeb8b4e256e0" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:21:25.058421 13593 raft_consensus.cc:740] T f3f9c2e2bf644115957398fe4c9459db P b7ab4784c7344b939bc36f639286f377 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
I20260709 13:21:25.121644 13791 leader_election.cc:290] T a3022224cc81473690653a83d4e99470 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:21:25.121764 13593 consensus_queue.cc:260] T f3f9c2e2bf644115957398fe4c9459db P b7ab4784c7344b939bc36f639286f377 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 19.13, Last appended by leader: 13, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:25.092945 13752 raft_consensus.cc:493] T d8cee0accdb8499c86d4414b72565a38 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 19 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:21:25.122993 13593 raft_consensus.cc:3060] T f3f9c2e2bf644115957398fe4c9459db P b7ab4784c7344b939bc36f639286f377 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:21:25.122792 13752 raft_consensus.cc:515] T d8cee0accdb8499c86d4414b72565a38 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:21:25.124825 13752 leader_election.cc:290] T d8cee0accdb8499c86d4414b72565a38 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:21:25.088553 13698 raft_consensus.cc:493] T ab432e62819d499eaaf3dd55481dd930 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:21:25.125519 13698 raft_consensus.cc:515] T ab432e62819d499eaaf3dd55481dd930 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:25.122784  6772 leader_election.cc:304] T 22ccee1b570c4ad3a57bd7aec085b1b4 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:21:25.130676 13829 raft_consensus.cc:2749] T 22ccee1b570c4ad3a57bd7aec085b1b4 P b7ab4784c7344b939bc36f639286f377 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:21:25.136240  6876 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53406 (request call id 3251) took 1736 ms. Trace:
I20260709 13:21:25.138223  6732 raft_consensus.cc:1240] T 713b5728a197487c9300b310ab94e5a3 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 18 FOLLOWER]: Rejecting Update request from peer b7ab4784c7344b939bc36f639286f377 for earlier term 17. Current term is 18. Ops: []
I20260709 13:21:25.139592  6728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8292e16e5654be6bc408560cf256aaa" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:21:25.137616  6876 rpcz_store.cc:276] 0709 13:21:23.400302 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:21:24.176435 (+776133us) service_pool.cc:224] Handling call
0709 13:21:24.176681 (+   246us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:21:24.987777 (+811096us) spinlock_profiling.cc:243] Waited 576 ms on lock 0x7b54000f1020. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f921dc0 00007fcc0f9ac1c0 00007fcc0f9ad231 00007fcc0f9a9d8f 00007fcc0f9a983e 00007fcc1496e419 00007fcc0dee5bd4 00007fcc0dee5b62 00007fcc0dee5a91 00007fcc0dee5a0c
0709 13:21:25.135619 (+147842us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:21:25.136161 (+   542us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1325921536}
I20260709 13:21:25.070333 13660 raft_consensus.cc:2749] T 3fa34c08b205435dba97346991aa1f92 P cd75a17ab2604397adab03bb8b5fd75c [term 25 FOLLOWER]: Leader pre-election lost for term 24. Reason: Vote denied by peer 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071) with higher term. Message: Invalid argument: T 3fa34c08b205435dba97346991aa1f92 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c for earlier term 24. Current term is 25.
I20260709 13:21:25.150655  7501 raft_consensus.cc:2468] T fe20b4b48823486ca3b9c648db6ce8aa P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 16.
I20260709 13:21:25.151866  6731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34f36d59d88f40fe8a2805e604fc6c0a" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
W20260709 13:21:25.154582  6697 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 126589us
I20260709 13:21:25.155018  6844 leader_election.cc:304] T d8cee0accdb8499c86d4414b72565a38 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, b7ab4784c7344b939bc36f639286f377
I20260709 13:21:25.155804  6731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44bde925b2e541b69890d70715b85176" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:21:25.093482  7499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "404190ce4ce94cecbfcb6ea9d1dd8626" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:21:25.159435  6801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7887766dc6784fcaa42b35c05fea7a99" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 24 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:21:25.159490  6732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77e330a82df4b43a745d57a68f6f057" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:21:25.161551  6804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1704639a875409b9959353527b3fd68" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:21:25.162909  6723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c240553ce044eedb41541d72b9475d7" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:21:25.163911  6723 raft_consensus.cc:2468] T 2c240553ce044eedb41541d72b9475d7 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 19.
I20260709 13:21:25.164371  7498 raft_consensus.cc:2468] T 7ba5dac66ab5497e9e336f2a3c28cda5 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 21.
I20260709 13:21:25.097584 13027 raft_consensus.cc:2749] T 7a734b5ab7834e05a8c422208acc58b1 P b7ab4784c7344b939bc36f639286f377 [term 22 FOLLOWER]: Leader election lost for term 21. Reason: Vote denied by peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391) with higher term. Message: Invalid argument: T 7a734b5ab7834e05a8c422208acc58b1 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate b7ab4784c7344b939bc36f639286f377 for earlier term 21. Current term is 22.
I20260709 13:21:25.101908 13674 raft_consensus.cc:2804] T 4f00a2e87e56452083b759f60d461ee3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:21:25.102747 13704 raft_consensus.cc:2804] T de3186201e1a40d0b335eeb8b4e256e0 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:21:25.167941  6723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "711ef6523deb4cbe8ef2ba61e1c21c98" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:21:25.091336 13690 consensus_queue.cc:1048] T 9b3759de40694069b13c0f8bd40e5709 P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Connected to new peer: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.066s
I20260709 13:21:25.169852  6723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c44c4849aa54f2b94d1f1bef9ed546f" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
W20260709 13:21:25.149075 13782 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 22 current term: 22 is higher.
I20260709 13:21:25.152945 13711 raft_consensus.cc:493] T e31b9971c15848dea59d4d4130141d9e P ccd8a4c3bfe3413cb2ae219b09aea832 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:21:25.180006 13711 raft_consensus.cc:515] T e31b9971c15848dea59d4d4130141d9e P ccd8a4c3bfe3413cb2ae219b09aea832 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:25.180474  6805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d9def8b32fd443aa94ab1420b06837b" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:21:25.181025  6801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c7f33e544204fbaac4078e3e83bbf4e" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:21:25.181793  6805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "853ac0a8cbd64ce99457f170216d4d0f" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:21:25.182138 13711 leader_election.cc:290] T e31b9971c15848dea59d4d4130141d9e P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:21:25.183286 13698 leader_election.cc:290] T ab432e62819d499eaaf3dd55481dd930 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:21:25.182178  6801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f03d0dbf16864ca4bc1bb5e4c0334c0f" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:21:25.184398  6804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "404190ce4ce94cecbfcb6ea9d1dd8626" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:21:25.185168  6801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1528ab62b6fe4e3099d08f141afee116" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:21:25.185379  6804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d65025eea89441290d85dd053810e31" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:21:25.186214  6801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bf4668eeb70467fb3dc5a0289233b3c" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:21:25.187057  6801 raft_consensus.cc:2410] T 1bf4668eeb70467fb3dc5a0289233b3c P b7ab4784c7344b939bc36f639286f377 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ccd8a4c3bfe3413cb2ae219b09aea832 for term 19 because replica has last-logged OpId of term: 17 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 10.
I20260709 13:21:25.119314 13588 leader_election.cc:290] T de3186201e1a40d0b335eeb8b4e256e0 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:21:25.173419  6728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09c2a98de1a4decabd0ff900dd44caa" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:21:25.188832  6728 raft_consensus.cc:2468] T f09c2a98de1a4decabd0ff900dd44caa P ccd8a4c3bfe3413cb2ae219b09aea832 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 21.
I20260709 13:21:25.095683 13790 raft_consensus.cc:515] T 7c44c4849aa54f2b94d1f1bef9ed546f P cd75a17ab2604397adab03bb8b5fd75c [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:25.192615 13790 leader_election.cc:290] T 7c44c4849aa54f2b94d1f1bef9ed546f P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:21:25.192950 13588 raft_consensus.cc:2749] T d8cee0accdb8499c86d4414b72565a38 P cd75a17ab2604397adab03bb8b5fd75c [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:21:25.193240  6873 raft_consensus.cc:2468] T 7c44c4849aa54f2b94d1f1bef9ed546f P cd75a17ab2604397adab03bb8b5fd75c [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 21.
I20260709 13:21:25.172413  6723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de3186201e1a40d0b335eeb8b4e256e0" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:21:25.196194  6844 leader_election.cc:304] T ab432e62819d499eaaf3dd55481dd930 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:21:25.199569 13690 raft_consensus.cc:2749] T ab432e62819d499eaaf3dd55481dd930 P cd75a17ab2604397adab03bb8b5fd75c [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:21:25.173503  6731 raft_consensus.cc:3055] T 07a92dd554674067a83a9cb68c4773f2 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:21:25.176460  6798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4db81d9d329422bb3b4160ca4ac2d1d" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:21:25.177136  6806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a485a995abc4807b6e511e45419f737" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:21:25.186287  6804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6869f07b5a4885a0b99fbe60c3b175" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 23 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:21:25.206183  6731 raft_consensus.cc:740] T 07a92dd554674067a83a9cb68c4773f2 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
I20260709 13:21:25.206463 13652 consensus_queue.cc:1059] T 07a92dd554674067a83a9cb68c4773f2 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:21:25.200862  6844 leader_election.cc:304] T 30e88460611e47b2ba16a46a30b5f416 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
W20260709 13:21:25.203531  6772 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 45919.2us
I20260709 13:21:25.207405 13652 consensus_queue.cc:1243] T 07a92dd554674067a83a9cb68c4773f2 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Peer b7ab4784c7344b939bc36f639286f377 log is divergent from this leader: its last log entry 19.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 10
I20260709 13:21:25.167456 13674 raft_consensus.cc:493] T 4f00a2e87e56452083b759f60d461ee3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 20 FOLLOWER]: Starting leader election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:21:25.172796 13670 raft_consensus.cc:993] T ce4f062dcd314d43a63ca74067cb5ee3 P b7ab4784c7344b939bc36f639286f377: : Instructing follower cd75a17ab2604397adab03bb8b5fd75c to start an election
I20260709 13:21:25.208231 13207 consensus_queue.cc:1059] T dbdf895bba214ff68685a24fd17dfb5d P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.005s
I20260709 13:21:25.213549 13207 consensus_queue.cc:1243] T dbdf895bba214ff68685a24fd17dfb5d P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Peer b7ab4784c7344b939bc36f639286f377 log is divergent from this leader: its last log entry 19.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 13:21:25.208027 13652 consensus_queue.cc:1048] T 34f36d59d88f40fe8a2805e604fc6c0a P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.007s
I20260709 13:21:25.214995  6800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b56bf91d90824c959e21e0cee5ba1816" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:21:25.215701 13652 raft_consensus.cc:3055] T dbdf895bba214ff68685a24fd17dfb5d P ccd8a4c3bfe3413cb2ae219b09aea832 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:21:25.216151 13652 raft_consensus.cc:740] T dbdf895bba214ff68685a24fd17dfb5d P ccd8a4c3bfe3413cb2ae219b09aea832 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
I20260709 13:21:25.217006 13652 consensus_queue.cc:260] T dbdf895bba214ff68685a24fd17dfb5d P ccd8a4c3bfe3413cb2ae219b09aea832 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 18.9, Last appended by leader: 9, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
W20260709 13:21:25.209438  6697 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:21:25.208738  6772 leader_election.cc:304] T 34f36d59d88f40fe8a2805e604fc6c0a P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
W20260709 13:21:25.218446  6697 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:21:25.218758 13801 raft_consensus.cc:2804] T 34f36d59d88f40fe8a2805e604fc6c0a P b7ab4784c7344b939bc36f639286f377 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:21:25.219137 13801 raft_consensus.cc:493] T 34f36d59d88f40fe8a2805e604fc6c0a P b7ab4784c7344b939bc36f639286f377 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:25.219446 13801 raft_consensus.cc:3060] T 34f36d59d88f40fe8a2805e604fc6c0a P b7ab4784c7344b939bc36f639286f377 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:21:25.201339 13704 raft_consensus.cc:697] T de3186201e1a40d0b335eeb8b4e256e0 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 20 LEADER]: Becoming Leader. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
I20260709 13:21:25.209637  6846 leader_election.cc:304] T 7ba5dac66ab5497e9e336f2a3c28cda5 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:21:25.221101 13588 raft_consensus.cc:2804] T 7ba5dac66ab5497e9e336f2a3c28cda5 P cd75a17ab2604397adab03bb8b5fd75c [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:21:25.221508 13588 raft_consensus.cc:493] T 7ba5dac66ab5497e9e336f2a3c28cda5 P cd75a17ab2604397adab03bb8b5fd75c [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:25.221829 13588 raft_consensus.cc:3060] T 7ba5dac66ab5497e9e336f2a3c28cda5 P cd75a17ab2604397adab03bb8b5fd75c [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:21:25.212563 13670 raft_consensus.cc:1081] T ce4f062dcd314d43a63ca74067cb5ee3 P b7ab4784c7344b939bc36f639286f377 [term 15 LEADER]: Signalling peer cd75a17ab2604397adab03bb8b5fd75c to start an election
I20260709 13:21:25.224622  6772 leader_election.cc:304] T d8292e16e5654be6bc408560cf256aaa P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:21:25.219787  6697 leader_election.cc:304] T f3f9c2e2bf644115957398fe4c9459db P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:21:25.227787  6697 leader_election.cc:304] T 22ccee1b570c4ad3a57bd7aec085b1b4 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:21:25.228057 13774 raft_consensus.cc:2804] T d8292e16e5654be6bc408560cf256aaa P b7ab4784c7344b939bc36f639286f377 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:21:25.228616 13774 raft_consensus.cc:493] T d8292e16e5654be6bc408560cf256aaa P b7ab4784c7344b939bc36f639286f377 [term 19 FOLLOWER]: Starting leader election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:21:25.174114  6724 raft_consensus.cc:2468] T 3fa34c08b205435dba97346991aa1f92 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in term 25.
I20260709 13:21:25.209002 13674 raft_consensus.cc:3060] T 4f00a2e87e56452083b759f60d461ee3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 20 FOLLOWER]: Advancing to term 21
W20260709 13:21:25.240816  6906 heartbeater.cc:646] Failed to heartbeat to 127.5.126.126:34367 (5 consecutive failures): Timed out: Failed to send heartbeat to master: TSHeartbeat RPC to 127.5.126.126:34367 timed out after 15.000s (SENT)
I20260709 13:21:25.211563 13782 raft_consensus.cc:2749] T 30e88460611e47b2ba16a46a30b5f416 P cd75a17ab2604397adab03bb8b5fd75c [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:21:25.221122 13704 consensus_queue.cc:237] T de3186201e1a40d0b335eeb8b4e256e0 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 19.10, Last appended by leader: 10, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:25.234167 13807 leader_election.cc:290] T 7ba5dac66ab5497e9e336f2a3c28cda5 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 21 election: Requested vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:21:25.229019 13774 raft_consensus.cc:3060] T d8292e16e5654be6bc408560cf256aaa P b7ab4784c7344b939bc36f639286f377 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:21:25.238561 13661 consensus_queue.cc:1048] T 07a92dd554674067a83a9cb68c4773f2 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.009s
I20260709 13:21:25.236379  6874 raft_consensus.cc:1240] T 9b3759de40694069b13c0f8bd40e5709 P cd75a17ab2604397adab03bb8b5fd75c [term 18 LEADER]: Rejecting Update request from peer b7ab4784c7344b939bc36f639286f377 for earlier term 17. Current term is 18. Ops: []
I20260709 13:21:25.229660 13694 raft_consensus.cc:2749] T f3f9c2e2bf644115957398fe4c9459db P ccd8a4c3bfe3413cb2ae219b09aea832 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:21:25.230101 13446 consensus_queue.cc:1048] T bd6869f07b5a4885a0b99fbe60c3b175 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.023s
I20260709 13:21:25.229858 13698 raft_consensus.cc:2749] T 22ccee1b570c4ad3a57bd7aec085b1b4 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:21:25.229040  6697 leader_election.cc:304] T 4275cf08e63345f993bce8664eada830 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377
I20260709 13:21:25.208738  6844 leader_election.cc:304] T 4f00a2e87e56452083b759f60d461ee3 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, b7ab4784c7344b939bc36f639286f377
I20260709 13:21:25.255988  6697 leader_election.cc:304] T 9e326172347f45e99a0d482b5d8ef768 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
W20260709 13:21:25.259068  7468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 233351us
W20260709 13:21:25.258394  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 49727.8us
I20260709 13:21:25.260819  6844 leader_election.cc:304] T 44bde925b2e541b69890d70715b85176 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:21:25.268314  6800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e31b9971c15848dea59d4d4130141d9e" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:21:25.259727  6724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bf4668eeb70467fb3dc5a0289233b3c" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:21:25.270646  6724 raft_consensus.cc:2468] T 1bf4668eeb70467fb3dc5a0289233b3c P ccd8a4c3bfe3413cb2ae219b09aea832 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 18.
I20260709 13:21:25.275120  6697 leader_election.cc:304] T ce4f062dcd314d43a63ca74067cb5ee3 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:21:25.238646  6772 leader_election.cc:304] T 2c240553ce044eedb41541d72b9475d7 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:21:25.277920  6723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d33d5ee8ef6f415593d8df52063161ad" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:21:25.234761  6731 consensus_queue.cc:260] T 07a92dd554674067a83a9cb68c4773f2 P ccd8a4c3bfe3413cb2ae219b09aea832 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.11, Last appended by leader: 11, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:25.281576  6731 raft_consensus.cc:3060] T 07a92dd554674067a83a9cb68c4773f2 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:21:25.281876  6803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "853ac0a8cbd64ce99457f170216d4d0f" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 19 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:21:25.283236  6844 leader_election.cc:304] T ce4f062dcd314d43a63ca74067cb5ee3 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, b7ab4784c7344b939bc36f639286f377
I20260709 13:21:25.284911  6804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de3186201e1a40d0b335eeb8b4e256e0" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:21:25.285742  6804 raft_consensus.cc:2468] T de3186201e1a40d0b335eeb8b4e256e0 P b7ab4784c7344b939bc36f639286f377 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 20.
I20260709 13:21:25.284778  6806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbdf895bba214ff68685a24fd17dfb5d" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 20 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:21:25.286067  6801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8292e16e5654be6bc408560cf256aaa" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:21:25.287307  6805 raft_consensus.cc:3055] T 713b5728a197487c9300b310ab94e5a3 P b7ab4784c7344b939bc36f639286f377 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:21:25.288277  6805 raft_consensus.cc:740] T 713b5728a197487c9300b310ab94e5a3 P b7ab4784c7344b939bc36f639286f377 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
I20260709 13:21:25.281041  6772 leader_election.cc:304] T de3186201e1a40d0b335eeb8b4e256e0 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:21:25.294662  6844 leader_election.cc:304] T 2c240553ce044eedb41541d72b9475d7 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:21:25.289100  6805 consensus_queue.cc:260] T 713b5728a197487c9300b310ab94e5a3 P b7ab4784c7344b939bc36f639286f377 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.10, Last appended by leader: 10, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:25.296972  6805 raft_consensus.cc:3060] T 713b5728a197487c9300b310ab94e5a3 P b7ab4784c7344b939bc36f639286f377 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:21:25.298488  6844 leader_election.cc:304] T 90d42e216d9741e190bca19a781291fd P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:21:25.298079  6772 leader_election.cc:304] T 7c44c4849aa54f2b94d1f1bef9ed546f P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:21:25.300474  6726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3022224cc81473690653a83d4e99470" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:21:25.305613  6844 leader_election.cc:304] T d33d5ee8ef6f415593d8df52063161ad P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:21:25.273867 13597 raft_consensus.cc:2804] T 4275cf08e63345f993bce8664eada830 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:21:25.307649  6800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab432e62819d499eaaf3dd55481dd930" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:21:25.273625 13690 raft_consensus.cc:2749] T 4f00a2e87e56452083b759f60d461ee3 P cd75a17ab2604397adab03bb8b5fd75c [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:21:25.274523 13711 raft_consensus.cc:2764] T 9e326172347f45e99a0d482b5d8ef768 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 18 FOLLOWER]: Leader pre-election decision vote started in defunct term 17: won
I20260709 13:21:25.320335  6731 raft_consensus.cc:1275] T 07a92dd554674067a83a9cb68c4773f2 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 19 FOLLOWER]: Refusing update from remote peer b7ab4784c7344b939bc36f639286f377: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 19 index: 11. (term mismatch)
I20260709 13:21:25.320955  6731 pending_rounds.cc:85] T 07a92dd554674067a83a9cb68c4773f2 P ccd8a4c3bfe3413cb2ae219b09aea832: Aborting all ops after (but not including) 10
I20260709 13:21:25.321319  6731 pending_rounds.cc:107] T 07a92dd554674067a83a9cb68c4773f2 P ccd8a4c3bfe3413cb2ae219b09aea832: Aborting uncommitted NO_OP operation due to leader change: 18.11
I20260709 13:21:25.321712  6731 raft_consensus.cc:2889] T 07a92dd554674067a83a9cb68c4773f2 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 19 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:21:25.310187  6844 leader_election.cc:304] T de3186201e1a40d0b335eeb8b4e256e0 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
W20260709 13:21:25.315383  6695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 111235us
I20260709 13:21:25.331868  6726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c44c4849aa54f2b94d1f1bef9ed546f" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:21:25.326783  6695 leader_election.cc:304] T 2c240553ce044eedb41541d72b9475d7 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:21:25.337008  6873 raft_consensus.cc:1240] T 713b5728a197487c9300b310ab94e5a3 P cd75a17ab2604397adab03bb8b5fd75c [term 18 LEADER]: Rejecting Update request from peer b7ab4784c7344b939bc36f639286f377 for earlier term 17. Current term is 18. Ops: []
I20260709 13:21:25.338105  6872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bf4668eeb70467fb3dc5a0289233b3c" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:21:25.339087  6872 raft_consensus.cc:2468] T 1bf4668eeb70467fb3dc5a0289233b3c P cd75a17ab2604397adab03bb8b5fd75c [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 18.
I20260709 13:21:25.340512  6876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d33d5ee8ef6f415593d8df52063161ad" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:21:25.343775  6800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c44c4849aa54f2b94d1f1bef9ed546f" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:21:25.296571 13756 raft_consensus.cc:2804] T 44bde925b2e541b69890d70715b85176 P cd75a17ab2604397adab03bb8b5fd75c [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:21:25.296622 13594 raft_consensus.cc:2749] T ce4f062dcd314d43a63ca74067cb5ee3 P cd75a17ab2604397adab03bb8b5fd75c [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:21:25.236622 13801 raft_consensus.cc:515] T 34f36d59d88f40fe8a2805e604fc6c0a P b7ab4784c7344b939bc36f639286f377 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:25.296425 13670 raft_consensus.cc:2804] T 2c240553ce044eedb41541d72b9475d7 P b7ab4784c7344b939bc36f639286f377 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:21:25.299757 13684 raft_consensus.cc:2804] T de3186201e1a40d0b335eeb8b4e256e0 P b7ab4784c7344b939bc36f639286f377 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:21:25.293093 13771 raft_consensus.cc:493] T be1a92657f494cac8dd227d152f50151 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 23 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:21:25.313828 13602 raft_consensus.cc:2804] T 7c44c4849aa54f2b94d1f1bef9ed546f P b7ab4784c7344b939bc36f639286f377 [term 21 FOLLOWER]: Leader pre-election won for term 22
W20260709 13:21:25.345060 13697 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 19 current term: 19 is higher.
I20260709 13:21:25.344363 13660 raft_consensus.cc:2804] T de3186201e1a40d0b335eeb8b4e256e0 P cd75a17ab2604397adab03bb8b5fd75c [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:21:25.357553  6872 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ce4f062dcd314d43a63ca74067cb5ee3"
dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
 from {username='slave'} at 127.0.0.1:53406
I20260709 13:21:25.340616  6731 raft_consensus.cc:1275] T 713b5728a197487c9300b310ab94e5a3 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 18 FOLLOWER]: Refusing update from remote peer cd75a17ab2604397adab03bb8b5fd75c: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
I20260709 13:21:25.306980 13777 raft_consensus.cc:2749] T 2c240553ce044eedb41541d72b9475d7 P cd75a17ab2604397adab03bb8b5fd75c [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:21:25.277094 13631 consensus_queue.cc:1048] T bb3d8792045a4583ae2e965b1350a5b4 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.053s
I20260709 13:21:25.417640  6872 raft_consensus.cc:493] T ce4f062dcd314d43a63ca74067cb5ee3 P cd75a17ab2604397adab03bb8b5fd75c [term 15 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:21:25.418233  6872 raft_consensus.cc:3060] T ce4f062dcd314d43a63ca74067cb5ee3 P cd75a17ab2604397adab03bb8b5fd75c [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:21:25.308570 13826 raft_consensus.cc:2749] T 90d42e216d9741e190bca19a781291fd P cd75a17ab2604397adab03bb8b5fd75c [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:21:25.313889 13597 raft_consensus.cc:493] T 4275cf08e63345f993bce8664eada830 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:25.372296  6805 raft_consensus.cc:1275] T 713b5728a197487c9300b310ab94e5a3 P b7ab4784c7344b939bc36f639286f377 [term 18 FOLLOWER]: Refusing update from remote peer cd75a17ab2604397adab03bb8b5fd75c: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 18 index: 10. (term mismatch)
I20260709 13:21:25.423713  6805 pending_rounds.cc:85] T 713b5728a197487c9300b310ab94e5a3 P b7ab4784c7344b939bc36f639286f377: Aborting all ops after (but not including) 9
I20260709 13:21:25.299798 13651 raft_consensus.cc:2749] T ce4f062dcd314d43a63ca74067cb5ee3 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:21:25.375136  6874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09c2a98de1a4decabd0ff900dd44caa" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:21:25.398252  6730 raft_consensus.cc:1275] T 7c37d41cd9164c15a6826ca62a851a69 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 21 FOLLOWER]: Refusing update from remote peer b7ab4784c7344b939bc36f639286f377: Log matching property violated. Preceding OpId in replica: term: 19 index: 14. Preceding OpId from leader: term: 21 index: 15. (index mismatch)
I20260709 13:21:25.313558 13723 raft_consensus.cc:2804] T d33d5ee8ef6f415593d8df52063161ad P cd75a17ab2604397adab03bb8b5fd75c [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:21:25.354950  6878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3022224cc81473690653a83d4e99470" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:21:25.397260 13602 raft_consensus.cc:493] T 7c44c4849aa54f2b94d1f1bef9ed546f P b7ab4784c7344b939bc36f639286f377 [term 21 FOLLOWER]: Starting leader election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:21:25.312278 13774 raft_consensus.cc:515] T d8292e16e5654be6bc408560cf256aaa P b7ab4784c7344b939bc36f639286f377 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:25.307260 13642 consensus_queue.cc:1048] T 20f6842e26174571996b8dea4151d4be P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 10, Time since last communication: 0.071s
I20260709 13:21:25.313616 13793 consensus_queue.cc:1048] T 9b3759de40694069b13c0f8bd40e5709 P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.088s
I20260709 13:21:25.327252 13674 raft_consensus.cc:515] T 4f00a2e87e56452083b759f60d461ee3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 21 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:21:25.355635 13756 raft_consensus.cc:493] T 44bde925b2e541b69890d70715b85176 P cd75a17ab2604397adab03bb8b5fd75c [term 19 FOLLOWER]: Starting leader election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:21:25.374615 13684 raft_consensus.cc:493] T de3186201e1a40d0b335eeb8b4e256e0 P b7ab4784c7344b939bc36f639286f377 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:25.367734 13670 raft_consensus.cc:493] T 2c240553ce044eedb41541d72b9475d7 P b7ab4784c7344b939bc36f639286f377 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:21:25.424618  6697 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 143143us
I20260709 13:21:25.424000  6805 pending_rounds.cc:107] T 713b5728a197487c9300b310ab94e5a3 P b7ab4784c7344b939bc36f639286f377: Aborting uncommitted NO_OP operation due to leader change: 17.10
W20260709 13:21:25.356140  7466 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 290862us
I20260709 13:21:25.412847 13660 raft_consensus.cc:493] T de3186201e1a40d0b335eeb8b4e256e0 P cd75a17ab2604397adab03bb8b5fd75c [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:25.453442  6873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ba5dac66ab5497e9e336f2a3c28cda5" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:21:25.451728  6844 leader_election.cc:304] T 853ac0a8cbd64ce99457f170216d4d0f P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:21:25.453025  5625 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:21:25.431260 13597 raft_consensus.cc:3060] T 4275cf08e63345f993bce8664eada830 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:21:25.452930  6876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8cee0accdb8499c86d4414b72565a38" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:21:25.490622  6805 raft_consensus.cc:2889] T 713b5728a197487c9300b310ab94e5a3 P b7ab4784c7344b939bc36f639286f377 [term 18 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:21:25.402654 13771 raft_consensus.cc:515] T be1a92657f494cac8dd227d152f50151 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:21:25.493487  6805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8cee0accdb8499c86d4414b72565a38" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:21:25.497556  6806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ba5dac66ab5497e9e336f2a3c28cda5" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:21:25.498687  6697 leader_election.cc:304] T 4b8cacb381b746da8d0049b0a83b41dd P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:21:25.501770  6697 leader_election.cc:304] T 4d9def8b32fd443aa94ab1420b06837b P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:21:25.443158 13599 raft_consensus.cc:2804] T 2c240553ce044eedb41541d72b9475d7 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:21:25.441454 13723 raft_consensus.cc:493] T d33d5ee8ef6f415593d8df52063161ad P cd75a17ab2604397adab03bb8b5fd75c [term 18 FOLLOWER]: Starting leader election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:21:25.448336 13602 raft_consensus.cc:3060] T 7c44c4849aa54f2b94d1f1bef9ed546f P b7ab4784c7344b939bc36f639286f377 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:21:25.506917  6805 raft_consensus.cc:1275] T 7a734b5ab7834e05a8c422208acc58b1 P b7ab4784c7344b939bc36f639286f377 [term 22 FOLLOWER]: Refusing update from remote peer 7ba59cc884714e8aa5f3f0ecaed84cbb: Log matching property violated. Preceding OpId in replica: term: 20 index: 11. Preceding OpId from leader: term: 22 index: 12. (index mismatch)
I20260709 13:21:25.509119  6806 raft_consensus.cc:2393] T 7ba5dac66ab5497e9e336f2a3c28cda5 P b7ab4784c7344b939bc36f639286f377 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in current term 21: Already voted for candidate b7ab4784c7344b939bc36f639286f377 in this term.
W20260709 13:21:25.511607  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 60058.1us
I20260709 13:21:25.513870  6844 leader_election.cc:304] T d8292e16e5654be6bc408560cf256aaa P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:21:25.515334  6844 leader_election.cc:304] T dbdf895bba214ff68685a24fd17dfb5d P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:21:25.517364  6725 raft_consensus.cc:1275] T bd6869f07b5a4885a0b99fbe60c3b175 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 22 FOLLOWER]: Refusing update from remote peer b7ab4784c7344b939bc36f639286f377: Log matching property violated. Preceding OpId in replica: term: 20 index: 10. Preceding OpId from leader: term: 22 index: 11. (index mismatch)
I20260709 13:21:25.509756  6697 leader_election.cc:304] T bd6869f07b5a4885a0b99fbe60c3b175 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:21:25.477603 13756 raft_consensus.cc:3060] T 44bde925b2e541b69890d70715b85176 P cd75a17ab2604397adab03bb8b5fd75c [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:21:25.531288  6844 leader_election.cc:304] T 7c44c4849aa54f2b94d1f1bef9ed546f P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:21:25.511888 13599 raft_consensus.cc:493] T 2c240553ce044eedb41541d72b9475d7 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 19 FOLLOWER]: Starting leader election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:21:25.532353 13599 raft_consensus.cc:3060] T 2c240553ce044eedb41541d72b9475d7 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:21:25.532218 13714 consensus_queue.cc:1048] T 713b5728a197487c9300b310ab94e5a3 P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:21:25.534442  7468 leader_election.cc:304] T d8cee0accdb8499c86d4414b72565a38 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:21:25.535508 13771 leader_election.cc:290] T be1a92657f494cac8dd227d152f50151 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:21:25.515679 13723 raft_consensus.cc:3060] T d33d5ee8ef6f415593d8df52063161ad P cd75a17ab2604397adab03bb8b5fd75c [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:21:25.566592  6805 raft_consensus.cc:1275] T 9e326172347f45e99a0d482b5d8ef768 P b7ab4784c7344b939bc36f639286f377 [term 18 FOLLOWER]: Refusing update from remote peer cd75a17ab2604397adab03bb8b5fd75c: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 13:21:25.568210  6770 leader_election.cc:304] T e77e330a82df4b43a745d57a68f6f057 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:21:25.541868 13690 raft_consensus.cc:2749] T dbdf895bba214ff68685a24fd17dfb5d P cd75a17ab2604397adab03bb8b5fd75c [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:21:25.528851 13790 raft_consensus.cc:2749] T d8292e16e5654be6bc408560cf256aaa P cd75a17ab2604397adab03bb8b5fd75c [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:21:25.550745 13579 consensus_queue.cc:1048] T 7a734b5ab7834e05a8c422208acc58b1 P 7ba59cc884714e8aa5f3f0ecaed84cbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:21:25.484521 13670 raft_consensus.cc:3060] T 2c240553ce044eedb41541d72b9475d7 P b7ab4784c7344b939bc36f639286f377 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:21:25.485442 13684 raft_consensus.cc:3060] T de3186201e1a40d0b335eeb8b4e256e0 P b7ab4784c7344b939bc36f639286f377 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:21:25.485885 13660 raft_consensus.cc:3060] T de3186201e1a40d0b335eeb8b4e256e0 P cd75a17ab2604397adab03bb8b5fd75c [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:21:25.537910 13793 raft_consensus.cc:2749] T 7c44c4849aa54f2b94d1f1bef9ed546f P cd75a17ab2604397adab03bb8b5fd75c [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:21:25.574856  6806 raft_consensus.cc:1275] T f09c2a98de1a4decabd0ff900dd44caa P b7ab4784c7344b939bc36f639286f377 [term 21 FOLLOWER]: Refusing update from remote peer cd75a17ab2604397adab03bb8b5fd75c: Log matching property violated. Preceding OpId in replica: term: 20 index: 12. Preceding OpId from leader: term: 21 index: 13. (index mismatch)
W20260709 13:21:25.576792  6697 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 67074.4us
I20260709 13:21:25.570689  6872 raft_consensus.cc:515] T ce4f062dcd314d43a63ca74067cb5ee3 P cd75a17ab2604397adab03bb8b5fd75c [term 16 FOLLOWER]: Starting forced leader election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:21:25.620441  6876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "853ac0a8cbd64ce99457f170216d4d0f" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:21:25.621853  6876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e31b9971c15848dea59d4d4130141d9e" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:21:25.465936 13588 raft_consensus.cc:515] T 7ba5dac66ab5497e9e336f2a3c28cda5 P cd75a17ab2604397adab03bb8b5fd75c [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:21:25.635319  6877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24ee15416e3145beaa1b8183453729a3" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:21:25.637944  6772 leader_election.cc:304] T 7ba5dac66ab5497e9e336f2a3c28cda5 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:21:25.562335 13711 raft_consensus.cc:2749] T 4b8cacb381b746da8d0049b0a83b41dd P ccd8a4c3bfe3413cb2ae219b09aea832 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:21:25.495260 13694 consensus_queue.cc:1048] T 34f36d59d88f40fe8a2805e604fc6c0a P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.095s
W20260709 13:21:25.642201  6770 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 74167.5us
I20260709 13:21:25.641458  6879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bf4668eeb70467fb3dc5a0289233b3c" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:21:25.643338  6697 leader_election.cc:304] T 1528ab62b6fe4e3099d08f141afee116 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
I20260709 13:21:25.575702 13839 raft_consensus.cc:2749] T d8cee0accdb8499c86d4414b72565a38 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:21:25.653621  6876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab432e62819d499eaaf3dd55481dd930" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:21:25.615953 13698 raft_consensus.cc:2804] T 4d9def8b32fd443aa94ab1420b06837b P ccd8a4c3bfe3413cb2ae219b09aea832 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:21:25.670531  6879 raft_consensus.cc:2410] T 1bf4668eeb70467fb3dc5a0289233b3c P cd75a17ab2604397adab03bb8b5fd75c [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ccd8a4c3bfe3413cb2ae219b09aea832 for term 19 because replica has last-logged OpId of term: 17 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 10.
I20260709 13:21:25.683825  6697 leader_election.cc:304] T fe20b4b48823486ca3b9c648db6ce8aa P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:21:25.686694  6873 raft_consensus.cc:2368] T 7ba5dac66ab5497e9e336f2a3c28cda5 P cd75a17ab2604397adab03bb8b5fd75c [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 7ba59cc884714e8aa5f3f0ecaed84cbb for earlier term 21. Current term is 22.
W20260709 13:21:25.687337  6772 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.68:45071, user_credentials={real_user=slave}} blocked reactor thread for 49507.4us
I20260709 13:21:25.693032  6772 leader_election.cc:400] T 7a734b5ab7834e05a8c422208acc58b1 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 21 election: Vote denied by peer 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071) with higher term. Message: Invalid argument: T 7a734b5ab7834e05a8c422208acc58b1 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate b7ab4784c7344b939bc36f639286f377 for earlier term 21. Current term is 22.
I20260709 13:21:25.690255  6770 leader_election.cc:304] T 711ef6523deb4cbe8ef2ba61e1c21c98 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:21:25.655164 13295 raft_consensus.cc:2749] T e77e330a82df4b43a745d57a68f6f057 P b7ab4784c7344b939bc36f639286f377 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:21:25.678155 13698 raft_consensus.cc:493] T 4d9def8b32fd443aa94ab1420b06837b P ccd8a4c3bfe3413cb2ae219b09aea832 [term 21 FOLLOWER]: Starting leader election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:21:25.645232 13777 consensus_queue.cc:1048] T 713b5728a197487c9300b310ab94e5a3 P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Connected to new peer: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.050s
I20260709 13:21:25.673256 13848 raft_consensus.cc:2804] T bd6869f07b5a4885a0b99fbe60c3b175 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 22 FOLLOWER]: Leader pre-election won for term 23
W20260709 13:21:25.717598  6695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 390884us
I20260709 13:21:25.692598 13601 raft_consensus.cc:493] T 3411566abe2d4c9bb4b2adfdd05e6f17 P b7ab4784c7344b939bc36f639286f377 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:21:25.695519 13631 raft_consensus.cc:2804] T 1528ab62b6fe4e3099d08f141afee116 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:21:25.725395  6770 leader_election.cc:304] T 44bde925b2e541b69890d70715b85176 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:21:25.696966 13642 raft_consensus.cc:2749] T 7ba5dac66ab5497e9e336f2a3c28cda5 P b7ab4784c7344b939bc36f639286f377 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:21:25.749805  6876 raft_consensus.cc:1240] T ce4f062dcd314d43a63ca74067cb5ee3 P cd75a17ab2604397adab03bb8b5fd75c [term 16 FOLLOWER]: Rejecting Update request from peer b7ab4784c7344b939bc36f639286f377 for earlier term 15. Current term is 16. Ops: []
I20260709 13:21:25.752738  6880 raft_consensus.cc:1275] T 7c37d41cd9164c15a6826ca62a851a69 P cd75a17ab2604397adab03bb8b5fd75c [term 21 FOLLOWER]: Refusing update from remote peer b7ab4784c7344b939bc36f639286f377: Log matching property violated. Preceding OpId in replica: term: 19 index: 14. Preceding OpId from leader: term: 21 index: 15. (index mismatch)
I20260709 13:21:25.750614  6695 leader_election.cc:304] T a1704639a875409b9959353527b3fd68 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:21:25.756222  6880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34f36d59d88f40fe8a2805e604fc6c0a" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:21:25.758172  6880 raft_consensus.cc:3060] T 34f36d59d88f40fe8a2805e604fc6c0a P cd75a17ab2604397adab03bb8b5fd75c [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:21:25.700304 13771 raft_consensus.cc:493] T bb3d8792045a4583ae2e965b1350a5b4 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 19 FOLLOWER]: Starting pre-election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
W20260709 13:21:25.767863  6772 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:21:25.766305  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 188081us
I20260709 13:21:25.720825 13801 leader_election.cc:290] T 34f36d59d88f40fe8a2805e604fc6c0a P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 18 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:21:25.745311 13554 raft_consensus.cc:2749] T 711ef6523deb4cbe8ef2ba61e1c21c98 P b7ab4784c7344b939bc36f639286f377 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:21:25.742575 13594 raft_consensus.cc:2749] T 853ac0a8cbd64ce99457f170216d4d0f P cd75a17ab2604397adab03bb8b5fd75c [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:21:25.724754 13848 raft_consensus.cc:493] T bd6869f07b5a4885a0b99fbe60c3b175 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:25.747399 13631 raft_consensus.cc:493] T 1528ab62b6fe4e3099d08f141afee116 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 17 FOLLOWER]: Starting leader election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:21:25.776083  6772 leader_election.cc:304] T 1bf4668eeb70467fb3dc5a0289233b3c P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:21:25.771580 13295 raft_consensus.cc:2749] T 44bde925b2e541b69890d70715b85176 P b7ab4784c7344b939bc36f639286f377 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:21:25.721879 13698 raft_consensus.cc:3060] T 4d9def8b32fd443aa94ab1420b06837b P ccd8a4c3bfe3413cb2ae219b09aea832 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:21:25.772328 13694 raft_consensus.cc:2804] T fe20b4b48823486ca3b9c648db6ce8aa P ccd8a4c3bfe3413cb2ae219b09aea832 [term 16 FOLLOWER]: Leader election won for term 16
W20260709 13:21:25.780534  7466 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 258338us
I20260709 13:21:25.777202  6695 leader_election.cc:304] T 7887766dc6784fcaa42b35c05fea7a99 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:21:25.778703  6723 raft_consensus.cc:1275] T 9e326172347f45e99a0d482b5d8ef768 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 18 FOLLOWER]: Refusing update from remote peer cd75a17ab2604397adab03bb8b5fd75c: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 13:21:25.815009  7503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce4f062dcd314d43a63ca74067cb5ee3" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: true dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb"
I20260709 13:21:25.813114 13849 raft_consensus.cc:2749] T a1704639a875409b9959353527b3fd68 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:21:25.828083  7503 raft_consensus.cc:3060] T ce4f062dcd314d43a63ca74067cb5ee3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:21:25.819923  7496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ba5dac66ab5497e9e336f2a3c28cda5" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb"
I20260709 13:21:25.790592  6880 raft_consensus.cc:2468] T 34f36d59d88f40fe8a2805e604fc6c0a P cd75a17ab2604397adab03bb8b5fd75c [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 18.
I20260709 13:21:25.756709 13601 raft_consensus.cc:515] T 3411566abe2d4c9bb4b2adfdd05e6f17 P b7ab4784c7344b939bc36f639286f377 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:25.807375  6872 leader_election.cc:290] T ce4f062dcd314d43a63ca74067cb5ee3 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 16 election: Requested vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:21:25.832074  7496 raft_consensus.cc:3060] T 7ba5dac66ab5497e9e336f2a3c28cda5 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:21:25.800418 13593 raft_consensus.cc:2804] T 1bf4668eeb70467fb3dc5a0289233b3c P b7ab4784c7344b939bc36f639286f377 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:21:25.783345 13631 raft_consensus.cc:3060] T 1528ab62b6fe4e3099d08f141afee116 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:21:25.835635 13593 raft_consensus.cc:493] T 1bf4668eeb70467fb3dc5a0289233b3c P b7ab4784c7344b939bc36f639286f377 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:25.836102 13593 raft_consensus.cc:3060] T 1bf4668eeb70467fb3dc5a0289233b3c P b7ab4784c7344b939bc36f639286f377 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:21:25.815189 13838 raft_consensus.cc:493] T 404190ce4ce94cecbfcb6ea9d1dd8626 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 17 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:21:25.837389 13838 raft_consensus.cc:515] T 404190ce4ce94cecbfcb6ea9d1dd8626 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:21:25.804505 13690 raft_consensus.cc:493] T 711ef6523deb4cbe8ef2ba61e1c21c98 P cd75a17ab2604397adab03bb8b5fd75c [term 21 FOLLOWER]: Starting pre-election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:21:25.838940 13690 raft_consensus.cc:515] T 711ef6523deb4cbe8ef2ba61e1c21c98 P cd75a17ab2604397adab03bb8b5fd75c [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
W20260709 13:21:25.834410  6695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 57508.5us
W20260709 13:21:25.841843  6772 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 53632.6us
I20260709 13:21:25.842578  6723 raft_consensus.cc:1275] T 3fa34c08b205435dba97346991aa1f92 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 25 FOLLOWER]: Refusing update from remote peer 7ba59cc884714e8aa5f3f0ecaed84cbb: Log matching property violated. Preceding OpId in replica: term: 23 index: 17. Preceding OpId from leader: term: 25 index: 18. (index mismatch)
I20260709 13:21:25.843058 13862 raft_consensus.cc:2749] T 7887766dc6784fcaa42b35c05fea7a99 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:21:25.833089 13694 raft_consensus.cc:697] T fe20b4b48823486ca3b9c648db6ce8aa P ccd8a4c3bfe3413cb2ae219b09aea832 [term 16 LEADER]: Becoming Leader. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
I20260709 13:21:25.843137  6695 leader_election.cc:304] T 8c7f33e544204fbaac4078e3e83bbf4e P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:21:25.844568 13860 raft_consensus.cc:2749] T 8c7f33e544204fbaac4078e3e83bbf4e P ccd8a4c3bfe3413cb2ae219b09aea832 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:21:25.844568 13694 consensus_queue.cc:237] T fe20b4b48823486ca3b9c648db6ce8aa P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:21:25.846164  6695 leader_election.cc:304] T f03d0dbf16864ca4bc1bb5e4c0334c0f P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:21:25.846573 13599 raft_consensus.cc:515] T 2c240553ce044eedb41541d72b9475d7 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:25.847471 13865 raft_consensus.cc:493] T 3411566abe2d4c9bb4b2adfdd05e6f17 P cd75a17ab2604397adab03bb8b5fd75c [term 18 FOLLOWER]: Starting pre-election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:21:25.789233 13777 raft_consensus.cc:493] T fe20b4b48823486ca3b9c648db6ce8aa P cd75a17ab2604397adab03bb8b5fd75c [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 7ba59cc884714e8aa5f3f0ecaed84cbb)
I20260709 13:21:25.849615 13865 raft_consensus.cc:515] T 3411566abe2d4c9bb4b2adfdd05e6f17 P cd75a17ab2604397adab03bb8b5fd75c [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:25.850111 13777 raft_consensus.cc:515] T fe20b4b48823486ca3b9c648db6ce8aa P cd75a17ab2604397adab03bb8b5fd75c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:21:25.851749 13865 leader_election.cc:290] T 3411566abe2d4c9bb4b2adfdd05e6f17 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:21:25.851997  6725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "404190ce4ce94cecbfcb6ea9d1dd8626" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:21:25.853022  6729 raft_consensus.cc:1275] T 7a734b5ab7834e05a8c422208acc58b1 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 22 FOLLOWER]: Refusing update from remote peer 7ba59cc884714e8aa5f3f0ecaed84cbb: Log matching property violated. Preceding OpId in replica: term: 20 index: 11. Preceding OpId from leader: term: 22 index: 12. (index mismatch)
I20260709 13:21:25.853677  7495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe20b4b48823486ca3b9c648db6ce8aa" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:21:25.783797 13848 raft_consensus.cc:3060] T bd6869f07b5a4885a0b99fbe60c3b175 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:21:25.854400  7495 raft_consensus.cc:2368] T fe20b4b48823486ca3b9c648db6ce8aa P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c for earlier term 15. Current term is 16.
I20260709 13:21:25.855474 13860 raft_consensus.cc:2749] T f03d0dbf16864ca4bc1bb5e4c0334c0f P ccd8a4c3bfe3413cb2ae219b09aea832 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:21:25.855739  6846 leader_election.cc:400] T fe20b4b48823486ca3b9c648db6ce8aa P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 15 pre-election: Vote denied by peer 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071) with higher term. Message: Invalid argument: T fe20b4b48823486ca3b9c648db6ce8aa P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c for earlier term 15. Current term is 16.
I20260709 13:21:25.856148  6846 leader_election.cc:403] T fe20b4b48823486ca3b9c648db6ce8aa P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 15 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:21:25.800051 13826 raft_consensus.cc:493] T a3022224cc81473690653a83d4e99470 P cd75a17ab2604397adab03bb8b5fd75c [term 21 FOLLOWER]: Starting pre-election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:21:25.818079 13674 leader_election.cc:290] T 4f00a2e87e56452083b759f60d461ee3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 21 election: Requested vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:21:25.856868 13839 consensus_queue.cc:1048] T 3fa34c08b205435dba97346991aa1f92 P 7ba59cc884714e8aa5f3f0ecaed84cbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.000s
I20260709 13:21:25.857270 13865 raft_consensus.cc:3060] T fe20b4b48823486ca3b9c648db6ce8aa P cd75a17ab2604397adab03bb8b5fd75c [term 14 FOLLOWER]: Advancing to term 16
I20260709 13:21:25.801681 13652 raft_consensus.cc:3060] T dbdf895bba214ff68685a24fd17dfb5d P ccd8a4c3bfe3413cb2ae219b09aea832 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:21:25.839990 13838 leader_election.cc:290] T 404190ce4ce94cecbfcb6ea9d1dd8626 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:21:25.778126 13774 leader_election.cc:290] T d8292e16e5654be6bc408560cf256aaa P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 20 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:21:25.788408 13771 raft_consensus.cc:515] T bb3d8792045a4583ae2e965b1350a5b4 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:21:25.834511 13602 raft_consensus.cc:515] T 7c44c4849aa54f2b94d1f1bef9ed546f P b7ab4784c7344b939bc36f639286f377 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:25.862723 13771 leader_election.cc:290] T bb3d8792045a4583ae2e965b1350a5b4 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:21:25.806354 13670 raft_consensus.cc:515] T 2c240553ce044eedb41541d72b9475d7 P b7ab4784c7344b939bc36f639286f377 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:25.817538 13588 leader_election.cc:290] T 7ba5dac66ab5497e9e336f2a3c28cda5 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 22 election: Requested vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:21:25.826999 13852 raft_consensus.cc:493] T 7c37d41cd9164c15a6826ca62a851a69 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:25.865185 13670 leader_election.cc:290] T 2c240553ce044eedb41541d72b9475d7 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 21 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:21:25.865043 13852 raft_consensus.cc:515] T 7c37d41cd9164c15a6826ca62a851a69 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:25.866084 13756 raft_consensus.cc:515] T 44bde925b2e541b69890d70715b85176 P cd75a17ab2604397adab03bb8b5fd75c [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:25.867328 13852 leader_election.cc:290] T 7c37d41cd9164c15a6826ca62a851a69 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:21:25.869330 13674 consensus_queue.cc:1048] T 7a734b5ab7834e05a8c422208acc58b1 P 7ba59cc884714e8aa5f3f0ecaed84cbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:21:25.874678  6729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3d8792045a4583ae2e965b1350a5b4" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:21:25.877426  6806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be1a92657f494cac8dd227d152f50151" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:21:25.879914 13865 raft_consensus.cc:2749] T fe20b4b48823486ca3b9c648db6ce8aa P cd75a17ab2604397adab03bb8b5fd75c [term 16 FOLLOWER]: Leader pre-election lost for term 15. Reason: Vote denied by peer 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071) with higher term. Message: Invalid argument: T fe20b4b48823486ca3b9c648db6ce8aa P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c for earlier term 15. Current term is 16.
I20260709 13:21:25.881501 13690 leader_election.cc:290] T 711ef6523deb4cbe8ef2ba61e1c21c98 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:21:25.869460 13601 leader_election.cc:290] T 3411566abe2d4c9bb4b2adfdd05e6f17 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:21:25.852496  6723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be1a92657f494cac8dd227d152f50151" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:21:25.881246 13698 raft_consensus.cc:515] T 4d9def8b32fd443aa94ab1420b06837b P ccd8a4c3bfe3413cb2ae219b09aea832 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:25.856828 13826 raft_consensus.cc:515] T a3022224cc81473690653a83d4e99470 P cd75a17ab2604397adab03bb8b5fd75c [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
W20260709 13:21:25.891916  6695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 45824.7us
I20260709 13:21:25.894135  6695 leader_election.cc:304] T 3d65025eea89441290d85dd053810e31 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:21:25.768643  6770 leader_election.cc:304] T f09c2a98de1a4decabd0ff900dd44caa P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
I20260709 13:21:25.896824  6806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f00a2e87e56452083b759f60d461ee3" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:21:25.852473 13599 leader_election.cc:290] T 2c240553ce044eedb41541d72b9475d7 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 20 election: Requested vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:21:25.912688  6695 leader_election.cc:304] T c4db81d9d329422bb3b4160ca4ac2d1d P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:21:25.863917 13602 leader_election.cc:290] T 7c44c4849aa54f2b94d1f1bef9ed546f P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 22 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:21:25.914669  6805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "404190ce4ce94cecbfcb6ea9d1dd8626" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:21:25.915521  7466 leader_election.cc:304] T be1a92657f494cac8dd227d152f50151 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:21:25.917440  6730 raft_consensus.cc:1240] T 4d9def8b32fd443aa94ab1420b06837b P ccd8a4c3bfe3413cb2ae219b09aea832 [term 22 FOLLOWER]: Rejecting Update request from peer b7ab4784c7344b939bc36f639286f377 for earlier term 21. Current term is 22. Ops: []
I20260709 13:21:25.852286 13777 leader_election.cc:290] T fe20b4b48823486ca3b9c648db6ce8aa P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
W20260709 13:21:25.917474  6770 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 148930us
I20260709 13:21:25.927906 13860 raft_consensus.cc:2749] T c4db81d9d329422bb3b4160ca4ac2d1d P ccd8a4c3bfe3413cb2ae219b09aea832 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:21:25.933394  6770 leader_election.cc:304] T d33d5ee8ef6f415593d8df52063161ad P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:21:25.922114  6695 leader_election.cc:304] T 3a485a995abc4807b6e511e45419f737 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:21:25.929952  7466 leader_election.cc:304] T 404190ce4ce94cecbfcb6ea9d1dd8626 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:21:25.911357 13852 raft_consensus.cc:2749] T 3d65025eea89441290d85dd053810e31 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 13:21:25.972640  6695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 50614.3us
I20260709 13:21:25.929538 13756 leader_election.cc:290] T 44bde925b2e541b69890d70715b85176 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 20 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:21:25.980978  6695 leader_election.cc:304] T b56bf91d90824c959e21e0cee5ba1816 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:21:25.930145 13743 raft_consensus.cc:2804] T f09c2a98de1a4decabd0ff900dd44caa P b7ab4784c7344b939bc36f639286f377 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:21:25.981848 13743 raft_consensus.cc:493] T f09c2a98de1a4decabd0ff900dd44caa P b7ab4784c7344b939bc36f639286f377 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:21:25.983999  6770 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 50674.8us
I20260709 13:21:25.940583 13870 raft_consensus.cc:2749] T 404190ce4ce94cecbfcb6ea9d1dd8626 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:21:25.987836  6697 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.68:45071, user_credentials={real_user=slave}} blocked reactor thread for 304089us
I20260709 13:21:25.988957  6697 leader_election.cc:304] T 404190ce4ce94cecbfcb6ea9d1dd8626 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, b7ab4784c7344b939bc36f639286f377
W20260709 13:21:25.989681  6695 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:21:25.978422 13860 raft_consensus.cc:2749] T 3a485a995abc4807b6e511e45419f737 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:21:26.002202  6872 raft_consensus.cc:1240] T 34f36d59d88f40fe8a2805e604fc6c0a P cd75a17ab2604397adab03bb8b5fd75c [term 18 FOLLOWER]: Rejecting Update request from peer ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 17. Current term is 18. Ops: [17.10-17.10]
I20260709 13:21:25.945598 13684 raft_consensus.cc:515] T de3186201e1a40d0b335eeb8b4e256e0 P b7ab4784c7344b939bc36f639286f377 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:25.989666 13651 raft_consensus.cc:2749] T b56bf91d90824c959e21e0cee5ba1816 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:21:26.012210  6872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c240553ce044eedb41541d72b9475d7" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:21:26.016621  6873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c37d41cd9164c15a6826ca62a851a69" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 22 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:21:26.021481  6873 raft_consensus.cc:2468] T 7c37d41cd9164c15a6826ca62a851a69 P cd75a17ab2604397adab03bb8b5fd75c [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 21.
I20260709 13:21:26.019541  7503 raft_consensus.cc:2468] T ce4f062dcd314d43a63ca74067cb5ee3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 16.
I20260709 13:21:25.987035 13447 raft_consensus.cc:2749] T d33d5ee8ef6f415593d8df52063161ad P b7ab4784c7344b939bc36f639286f377 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:21:26.024298  6723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34f36d59d88f40fe8a2805e604fc6c0a" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:21:26.025751  6846 leader_election.cc:304] T ce4f062dcd314d43a63ca74067cb5ee3 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:21:25.984633 13743 raft_consensus.cc:3060] T f09c2a98de1a4decabd0ff900dd44caa P b7ab4784c7344b939bc36f639286f377 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:21:25.997354 13849 raft_consensus.cc:493] T 713b5728a197487c9300b310ab94e5a3 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:26.000358 13207 raft_consensus.cc:2749] T 404190ce4ce94cecbfcb6ea9d1dd8626 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:21:25.997351 13777 raft_consensus.cc:493] T 427c124d773f483294511e80fe340075 P cd75a17ab2604397adab03bb8b5fd75c [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 7ba59cc884714e8aa5f3f0ecaed84cbb)
I20260709 13:21:26.040138  6805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce4f062dcd314d43a63ca74067cb5ee3" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: true dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:21:26.029168  6872 raft_consensus.cc:2393] T 2c240553ce044eedb41541d72b9475d7 P cd75a17ab2604397adab03bb8b5fd75c [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate ccd8a4c3bfe3413cb2ae219b09aea832 in current term 20: Already voted for candidate cd75a17ab2604397adab03bb8b5fd75c in this term.
I20260709 13:21:26.033442  7468 leader_election.cc:400] T 7ba5dac66ab5497e9e336f2a3c28cda5 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 21 election: Vote denied by peer cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931) with higher term. Message: Invalid argument: T 7ba5dac66ab5497e9e336f2a3c28cda5 P cd75a17ab2604397adab03bb8b5fd75c [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 7ba59cc884714e8aa5f3f0ecaed84cbb for earlier term 21. Current term is 22.
I20260709 13:21:26.041060  7468 leader_election.cc:403] T 7ba5dac66ab5497e9e336f2a3c28cda5 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 21 election: Cancelling election due to peer responding with higher term
W20260709 13:21:26.020874 13597 consensus_meta.cc:287] T 4275cf08e63345f993bce8664eada830 P ccd8a4c3bfe3413cb2ae219b09aea832: Time spent flushing consensus metadata: real 0.516s	user 0.009s	sys 0.005s
I20260709 13:21:26.035476  6723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "711ef6523deb4cbe8ef2ba61e1c21c98" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:21:25.989472 13602 consensus_queue.cc:1048] T 07a92dd554674067a83a9cb68c4773f2 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.034s
I20260709 13:21:26.080241  6697 leader_election.cc:304] T 853ac0a8cbd64ce99457f170216d4d0f P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:21:26.042591  6804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ba5dac66ab5497e9e336f2a3c28cda5" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:21:26.083068  6804 raft_consensus.cc:3060] T 7ba5dac66ab5497e9e336f2a3c28cda5 P b7ab4784c7344b939bc36f639286f377 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:21:26.044077  6800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3411566abe2d4c9bb4b2adfdd05e6f17" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:21:26.087157  6800 raft_consensus.cc:2468] T 3411566abe2d4c9bb4b2adfdd05e6f17 P b7ab4784c7344b939bc36f639286f377 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 18.
I20260709 13:21:26.044854  6802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44bde925b2e541b69890d70715b85176" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:21:26.000445 13707 consensus_queue.cc:1048] T 7c37d41cd9164c15a6826ca62a851a69 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.034s
I20260709 13:21:26.034703 13851 raft_consensus.cc:2804] T ce4f062dcd314d43a63ca74067cb5ee3 P cd75a17ab2604397adab03bb8b5fd75c [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:21:26.012988 13667 consensus_queue.cc:1048] T bd6869f07b5a4885a0b99fbe60c3b175 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.036s
I20260709 13:21:26.047742  6723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3022224cc81473690653a83d4e99470" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:21:26.098623  6798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "711ef6523deb4cbe8ef2ba61e1c21c98" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:21:26.102401  6697 leader_election.cc:304] T e31b9971c15848dea59d4d4130141d9e P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:21:26.109956  6723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3411566abe2d4c9bb4b2adfdd05e6f17" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:21:26.105746  7496 raft_consensus.cc:2468] T 7ba5dac66ab5497e9e336f2a3c28cda5 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 22.
W20260709 13:21:26.106921  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 64145.9us
I20260709 13:21:26.116577  6723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3411566abe2d4c9bb4b2adfdd05e6f17" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:21:26.117187  6846 leader_election.cc:304] T 7ba5dac66ab5497e9e336f2a3c28cda5 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:21:26.110150 13700 raft_consensus.cc:2749] T be1a92657f494cac8dd227d152f50151 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:21:26.082387 13826 leader_election.cc:290] T a3022224cc81473690653a83d4e99470 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:21:26.136417  6804 raft_consensus.cc:2468] T 7ba5dac66ab5497e9e336f2a3c28cda5 P b7ab4784c7344b939bc36f639286f377 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 22.
I20260709 13:21:26.140918  6723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44bde925b2e541b69890d70715b85176" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:21:26.141999 13793 raft_consensus.cc:2804] T 7ba5dac66ab5497e9e336f2a3c28cda5 P cd75a17ab2604397adab03bb8b5fd75c [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:21:26.142340  6872 raft_consensus.cc:1275] T 3fa34c08b205435dba97346991aa1f92 P cd75a17ab2604397adab03bb8b5fd75c [term 25 FOLLOWER]: Refusing update from remote peer 7ba59cc884714e8aa5f3f0ecaed84cbb: Log matching property violated. Preceding OpId in replica: term: 23 index: 17. Preceding OpId from leader: term: 25 index: 18. (index mismatch)
I20260709 13:21:26.142573 13793 raft_consensus.cc:697] T 7ba5dac66ab5497e9e336f2a3c28cda5 P cd75a17ab2604397adab03bb8b5fd75c [term 22 LEADER]: Becoming Leader. State: Replica: cd75a17ab2604397adab03bb8b5fd75c, State: Running, Role: LEADER
I20260709 13:21:26.143882  6798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3022224cc81473690653a83d4e99470" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:21:26.140267 13851 raft_consensus.cc:697] T ce4f062dcd314d43a63ca74067cb5ee3 P cd75a17ab2604397adab03bb8b5fd75c [term 16 LEADER]: Becoming Leader. State: Replica: cd75a17ab2604397adab03bb8b5fd75c, State: Running, Role: LEADER
I20260709 13:21:26.145166  6873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f00a2e87e56452083b759f60d461ee3" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:21:26.145359  6723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c240553ce044eedb41541d72b9475d7" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:21:26.145969 13851 consensus_queue.cc:237] T ce4f062dcd314d43a63ca74067cb5ee3 P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:21:26.146648  6878 raft_consensus.cc:1275] T 7a734b5ab7834e05a8c422208acc58b1 P cd75a17ab2604397adab03bb8b5fd75c [term 22 FOLLOWER]: Refusing update from remote peer 7ba59cc884714e8aa5f3f0ecaed84cbb: Log matching property violated. Preceding OpId in replica: term: 19 index: 10. Preceding OpId from leader: term: 22 index: 12. (index mismatch)
I20260709 13:21:26.144253  6730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8292e16e5654be6bc408560cf256aaa" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:21:26.147687  6880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3d8792045a4583ae2e965b1350a5b4" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:21:26.040283 13849 raft_consensus.cc:515] T 713b5728a197487c9300b310ab94e5a3 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:26.149308  6730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe20b4b48823486ca3b9c648db6ce8aa" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:21:26.136976  6697 leader_election.cc:304] T 24ee15416e3145beaa1b8183453729a3 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:21:26.045571 13594 consensus_queue.cc:1048] T f09c2a98de1a4decabd0ff900dd44caa P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.062s
I20260709 13:21:26.137127 13870 raft_consensus.cc:2749] T 7ba5dac66ab5497e9e336f2a3c28cda5 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 22 FOLLOWER]: Leader election lost for term 21. Reason: Vote denied by peer cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931) with higher term. Message: Invalid argument: T 7ba5dac66ab5497e9e336f2a3c28cda5 P cd75a17ab2604397adab03bb8b5fd75c [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 7ba59cc884714e8aa5f3f0ecaed84cbb for earlier term 21. Current term is 22.
I20260709 13:21:26.152858  6697 leader_election.cc:304] T ab432e62819d499eaaf3dd55481dd930 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:21:26.046080 13690 consensus_queue.cc:1048] T 9e326172347f45e99a0d482b5d8ef768 P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.076s
I20260709 13:21:26.048772 13723 raft_consensus.cc:515] T d33d5ee8ef6f415593d8df52063161ad P cd75a17ab2604397adab03bb8b5fd75c [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:26.160075  6723 raft_consensus.cc:3060] T 2c240553ce044eedb41541d72b9475d7 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:21:26.165599  6697 leader_election.cc:304] T 1bf4668eeb70467fb3dc5a0289233b3c P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:21:26.084230 13597 raft_consensus.cc:515] T 4275cf08e63345f993bce8664eada830 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:26.168524 13588 consensus_queue.cc:1048] T 9e326172347f45e99a0d482b5d8ef768 P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Connected to new peer: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.001s
W20260709 13:21:26.171022 13867 log.cc:927] Time spent T 07a92dd554674067a83a9cb68c4773f2 P cd75a17ab2604397adab03bb8b5fd75c: Append to log took a long time: real 0.074s	user 0.000s	sys 0.000s
I20260709 13:21:26.046321 13777 raft_consensus.cc:515] T 427c124d773f483294511e80fe340075 P cd75a17ab2604397adab03bb8b5fd75c [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } attrs { replace: true } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:21:26.151593 13697 raft_consensus.cc:2749] T e31b9971c15848dea59d4d4130141d9e P ccd8a4c3bfe3413cb2ae219b09aea832 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:21:26.150595 13698 leader_election.cc:290] T 4d9def8b32fd443aa94ab1420b06837b P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 22 election: Requested vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
W20260709 13:21:26.167829 13875 log.cc:927] Time spent T 20f6842e26174571996b8dea4151d4be P cd75a17ab2604397adab03bb8b5fd75c: Append to log took a long time: real 0.058s	user 0.001s	sys 0.000s
W20260709 13:21:26.162922 13872 log.cc:927] Time spent T bb3d8792045a4583ae2e965b1350a5b4 P cd75a17ab2604397adab03bb8b5fd75c: Append to log took a long time: real 0.129s	user 0.001s	sys 0.000s
I20260709 13:21:26.143580 13793 consensus_queue.cc:237] T 7ba5dac66ab5497e9e336f2a3c28cda5 P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 20.15, Last appended by leader: 15, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:21:26.190842  6728 raft_consensus.cc:1240] T 4275cf08e63345f993bce8664eada830 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 20 FOLLOWER]: Rejecting Update request from peer b7ab4784c7344b939bc36f639286f377 for earlier term 19. Current term is 20. Ops: [19.11-19.11]
I20260709 13:21:26.156502 13863 raft_consensus.cc:493] T 3a485a995abc4807b6e511e45419f737 P cd75a17ab2604397adab03bb8b5fd75c [term 17 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:21:26.167753 13782 raft_consensus.cc:493] T 7887766dc6784fcaa42b35c05fea7a99 P cd75a17ab2604397adab03bb8b5fd75c [term 23 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:21:26.175427  6730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c44c4849aa54f2b94d1f1bef9ed546f" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:21:26.181886 13862 raft_consensus.cc:2749] T 24ee15416e3145beaa1b8183453729a3 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 13:21:26.218142  6697 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 52646.1us
I20260709 13:21:26.194614 13599 raft_consensus.cc:2749] T ab432e62819d499eaaf3dd55481dd930 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:21:26.197598 13698 raft_consensus.cc:2749] T 1bf4668eeb70467fb3dc5a0289233b3c P ccd8a4c3bfe3413cb2ae219b09aea832 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:21:26.257429  6730 raft_consensus.cc:1275] T f09c2a98de1a4decabd0ff900dd44caa P ccd8a4c3bfe3413cb2ae219b09aea832 [term 21 FOLLOWER]: Refusing update from remote peer cd75a17ab2604397adab03bb8b5fd75c: Log matching property violated. Preceding OpId in replica: term: 20 index: 12. Preceding OpId from leader: term: 21 index: 13. (index mismatch)
I20260709 13:21:26.243678  6697 leader_election.cc:304] T 7c37d41cd9164c15a6826ca62a851a69 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:21:26.267652  6723 raft_consensus.cc:2468] T 2c240553ce044eedb41541d72b9475d7 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 21.
I20260709 13:21:26.273140  6880 raft_consensus.cc:1240] T 44bde925b2e541b69890d70715b85176 P cd75a17ab2604397adab03bb8b5fd75c [term 20 FOLLOWER]: Rejecting Update request from peer ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 19. Current term is 20. Ops: []
I20260709 13:21:26.195604 13848 raft_consensus.cc:515] T bd6869f07b5a4885a0b99fbe60c3b175 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:26.281611  6878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d9def8b32fd443aa94ab1420b06837b" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
W20260709 13:21:26.279256 13875 log.cc:927] Time spent T 20f6842e26174571996b8dea4151d4be P cd75a17ab2604397adab03bb8b5fd75c: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260709 13:21:26.268712 13860 consensus_queue.cc:1059] T 34f36d59d88f40fe8a2805e604fc6c0a P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: INVALID_TERM, Last received: 16.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.024s
W20260709 13:21:26.292471 13878 log.cc:927] Time spent T de3186201e1a40d0b335eeb8b4e256e0 P ccd8a4c3bfe3413cb2ae219b09aea832: Append to log took a long time: real 0.101s	user 0.000s	sys 0.001s
I20260709 13:21:26.285355 13698 raft_consensus.cc:2804] T 7c37d41cd9164c15a6826ca62a851a69 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:21:26.294325 13698 raft_consensus.cc:493] T 7c37d41cd9164c15a6826ca62a851a69 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:26.294777 13698 raft_consensus.cc:3060] T 7c37d41cd9164c15a6826ca62a851a69 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:21:26.251571 13697 raft_consensus.cc:493] T f5be3a11b23d4ea9b08300a2789821c7 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:21:26.209021 13782 raft_consensus.cc:515] T 7887766dc6784fcaa42b35c05fea7a99 P cd75a17ab2604397adab03bb8b5fd75c [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:26.318001  6874 raft_consensus.cc:1240] T 07a92dd554674067a83a9cb68c4773f2 P cd75a17ab2604397adab03bb8b5fd75c [term 19 FOLLOWER]: Rejecting Update request from peer ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 18. Current term is 19. Ops: []
I20260709 13:21:26.206979 13863 raft_consensus.cc:515] T 3a485a995abc4807b6e511e45419f737 P cd75a17ab2604397adab03bb8b5fd75c [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
W20260709 13:21:26.319810  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 176334us
I20260709 13:21:26.321518  6844 leader_election.cc:304] T 3411566abe2d4c9bb4b2adfdd05e6f17 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:21:26.322893  6844 leader_election.cc:304] T 711ef6523deb4cbe8ef2ba61e1c21c98 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
W20260709 13:21:26.311014 13872 log.cc:927] Time spent T bb3d8792045a4583ae2e965b1350a5b4 P cd75a17ab2604397adab03bb8b5fd75c: Append to log took a long time: real 0.055s	user 0.001s	sys 0.000s
I20260709 13:21:26.328315  6844 leader_election.cc:304] T a3022224cc81473690653a83d4e99470 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
W20260709 13:21:26.319813 13871 log.cc:927] Time spent T 713b5728a197487c9300b310ab94e5a3 P b7ab4784c7344b939bc36f639286f377: Append to log took a long time: real 0.276s	user 0.002s	sys 0.000s
I20260709 13:21:26.340463  6770 leader_election.cc:304] T 2c240553ce044eedb41541d72b9475d7 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
I20260709 13:21:26.347052 13222 raft_consensus.cc:2804] T 2c240553ce044eedb41541d72b9475d7 P b7ab4784c7344b939bc36f639286f377 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:21:26.353714 13222 raft_consensus.cc:697] T 2c240553ce044eedb41541d72b9475d7 P b7ab4784c7344b939bc36f639286f377 [term 21 LEADER]: Becoming Leader. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
I20260709 13:21:26.354748 13222 consensus_queue.cc:237] T 2c240553ce044eedb41541d72b9475d7 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.11, Last appended by leader: 11, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:26.362176 13723 leader_election.cc:290] T d33d5ee8ef6f415593d8df52063161ad P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 19 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:21:26.328836 13865 raft_consensus.cc:2804] T 3411566abe2d4c9bb4b2adfdd05e6f17 P cd75a17ab2604397adab03bb8b5fd75c [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:21:26.363077 13865 raft_consensus.cc:493] T 3411566abe2d4c9bb4b2adfdd05e6f17 P cd75a17ab2604397adab03bb8b5fd75c [term 18 FOLLOWER]: Starting leader election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
W20260709 13:21:26.363576 13593 consensus_meta.cc:287] T 1bf4668eeb70467fb3dc5a0289233b3c P b7ab4784c7344b939bc36f639286f377: Time spent flushing consensus metadata: real 0.527s	user 0.010s	sys 0.001s
I20260709 13:21:26.365257 13782 leader_election.cc:290] T 7887766dc6784fcaa42b35c05fea7a99 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:21:26.366711 13863 leader_election.cc:290] T 3a485a995abc4807b6e511e45419f737 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:21:26.329245 13756 raft_consensus.cc:2749] T 711ef6523deb4cbe8ef2ba61e1c21c98 P cd75a17ab2604397adab03bb8b5fd75c [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:21:26.368335 13849 leader_election.cc:290] T 713b5728a197487c9300b310ab94e5a3 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:21:26.363523 13865 raft_consensus.cc:3060] T 3411566abe2d4c9bb4b2adfdd05e6f17 P cd75a17ab2604397adab03bb8b5fd75c [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:21:26.370815  6844 leader_election.cc:304] T 44bde925b2e541b69890d70715b85176 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:21:26.366770 13777 leader_election.cc:290] T 427c124d773f483294511e80fe340075 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:21:26.349654 13651 raft_consensus.cc:3055] T 34f36d59d88f40fe8a2805e604fc6c0a P ccd8a4c3bfe3413cb2ae219b09aea832 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:21:26.321213 13697 raft_consensus.cc:515] T f5be3a11b23d4ea9b08300a2789821c7 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:26.361379 13848 leader_election.cc:290] T bd6869f07b5a4885a0b99fbe60c3b175 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 23 election: Requested vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:21:26.352080 13874 raft_consensus.cc:2749] T a3022224cc81473690653a83d4e99470 P cd75a17ab2604397adab03bb8b5fd75c [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 13:21:26.407688  6697 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 124622us
W20260709 13:21:26.394170 13660 consensus_meta.cc:287] T de3186201e1a40d0b335eeb8b4e256e0 P cd75a17ab2604397adab03bb8b5fd75c: Time spent flushing consensus metadata: real 0.744s	user 0.014s	sys 0.000s
I20260709 13:21:26.351223 13698 raft_consensus.cc:515] T 7c37d41cd9164c15a6826ca62a851a69 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:26.416541  6801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d33d5ee8ef6f415593d8df52063161ad" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:21:26.383924 13651 raft_consensus.cc:740] T 34f36d59d88f40fe8a2805e604fc6c0a P ccd8a4c3bfe3413cb2ae219b09aea832 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
I20260709 13:21:26.419150  6879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6869f07b5a4885a0b99fbe60c3b175" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 23 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:21:26.419953  6881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4275cf08e63345f993bce8664eada830" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
W20260709 13:21:26.420696  6695 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:21:26.422142  6801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7887766dc6784fcaa42b35c05fea7a99" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 24 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:21:26.423465  6803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "427c124d773f483294511e80fe340075" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:21:26.424867  6798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a485a995abc4807b6e511e45419f737" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:21:26.426106  6877 raft_consensus.cc:1240] T d33d5ee8ef6f415593d8df52063161ad P cd75a17ab2604397adab03bb8b5fd75c [term 19 FOLLOWER]: Rejecting Update request from peer ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 18. Current term is 19. Ops: []
I20260709 13:21:26.374850 13593 raft_consensus.cc:515] T 1bf4668eeb70467fb3dc5a0289233b3c P b7ab4784c7344b939bc36f639286f377 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:26.433315  6878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "713b5728a197487c9300b310ab94e5a3" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
W20260709 13:21:26.430794 13631 consensus_meta.cc:287] T 1528ab62b6fe4e3099d08f141afee116 P ccd8a4c3bfe3413cb2ae219b09aea832: Time spent flushing consensus metadata: real 0.595s	user 0.013s	sys 0.000s
I20260709 13:21:26.407824 13597 leader_election.cc:290] T 4275cf08e63345f993bce8664eada830 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 20 election: Requested vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:21:26.411942 13886 raft_consensus.cc:2749] T 44bde925b2e541b69890d70715b85176 P cd75a17ab2604397adab03bb8b5fd75c [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:21:26.443406 13594 raft_consensus.cc:493] T f5be3a11b23d4ea9b08300a2789821c7 P cd75a17ab2604397adab03bb8b5fd75c [term 18 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:21:26.454018 13594 raft_consensus.cc:515] T f5be3a11b23d4ea9b08300a2789821c7 P cd75a17ab2604397adab03bb8b5fd75c [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
W20260709 13:21:26.465132  7466 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 291553us
I20260709 13:21:26.426937 13874 consensus_queue.cc:1048] T f09c2a98de1a4decabd0ff900dd44caa P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Connected to new peer: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.039s
I20260709 13:21:26.428900 13660 raft_consensus.cc:515] T de3186201e1a40d0b335eeb8b4e256e0 P cd75a17ab2604397adab03bb8b5fd75c [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:26.502524  7498 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50744 (request call id 624) took 1166 ms. Trace:
W20260709 13:21:26.505846  6772 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 618351us
I20260709 13:21:26.506755  6772 leader_election.cc:304] T a3022224cc81473690653a83d4e99470 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:21:26.507731 13601 raft_consensus.cc:2749] T a3022224cc81473690653a83d4e99470 P b7ab4784c7344b939bc36f639286f377 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:21:26.510790  6805 raft_consensus.cc:3055] T ce4f062dcd314d43a63ca74067cb5ee3 P b7ab4784c7344b939bc36f639286f377 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:21:26.511364  6805 raft_consensus.cc:740] T ce4f062dcd314d43a63ca74067cb5ee3 P b7ab4784c7344b939bc36f639286f377 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
I20260709 13:21:26.512514 13697 leader_election.cc:290] T f5be3a11b23d4ea9b08300a2789821c7 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:21:26.469135 13886 raft_consensus.cc:493] T f03d0dbf16864ca4bc1bb5e4c0334c0f P cd75a17ab2604397adab03bb8b5fd75c [term 19 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:21:26.506762 13894 consensus_queue.cc:1048] T 3fa34c08b205435dba97346991aa1f92 P 7ba59cc884714e8aa5f3f0ecaed84cbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.008s
I20260709 13:21:26.514870 13886 raft_consensus.cc:515] T f03d0dbf16864ca4bc1bb5e4c0334c0f P cd75a17ab2604397adab03bb8b5fd75c [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:26.515548  6805 consensus_queue.cc:260] T ce4f062dcd314d43a63ca74067cb5ee3 P b7ab4784c7344b939bc36f639286f377 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:21:26.516616  6805 raft_consensus.cc:3060] T ce4f062dcd314d43a63ca74067cb5ee3 P b7ab4784c7344b939bc36f639286f377 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:21:26.503046  7498 rpcz_store.cc:276] 0709 13:21:25.335846 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:21:25.343417 (+  7571us) service_pool.cc:224] Handling call
0709 13:21:25.343721 (+   304us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:21:25.535775 (+192054us) raft_consensus.cc:1534] Early marking committed up to index 17
0709 13:21:25.683411 (+147636us) log.cc:844] Serialized 14 byte log entry
0709 13:21:26.107853 (+424442us) log.cc:844] Serialized 14 byte log entry
0709 13:21:26.108227 (+   374us) log.cc:844] Serialized 14 byte log entry
0709 13:21:26.108437 (+   210us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:21:26.108478 (+    41us) raft_consensus.cc:1645] Marking committed up to 17
0709 13:21:26.108529 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:21:26.501652 (+393123us) spinlock_profiling.cc:243] Waited 3.41 ms on lock 0x7b18002557c0. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc15785de1 00007fcc157925b1 00007fcc0c88b2a6 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f9aae01 00007fcc0f9a983e 00007fcc1496e419
0709 13:21:26.502225 (+   573us) spinlock_profiling.cc:243] Waited 192 ms on lock 0x7b5400604d54. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f9aae01 00007fcc0f9a983e 00007fcc1496e419 00007fcc0dee5bd4 00007fcc0dee5b62 00007fcc0dee5a91 00007fcc0dee5a0c 00007fcc0dee4cc2 00007fcc0dce548c 00007fcc0dce48c6
0709 13:21:26.502277 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:21:26.502447 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":293819,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":39,"raft.queue_time_us":219,"raft.run_cpu_time_us":1890,"raft.run_wall_time_us":29377,"spinlock_wait_cycles":502784896,"thread_start_us":570984,"threads_started":2,"wal-append.queue_time_us":513691}
I20260709 13:21:26.518265 13593 leader_election.cc:290] T 1bf4668eeb70467fb3dc5a0289233b3c P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 19 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:21:26.510893 13743 raft_consensus.cc:515] T f09c2a98de1a4decabd0ff900dd44caa P b7ab4784c7344b939bc36f639286f377 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:26.520823  6806 raft_consensus.cc:1240] T f09c2a98de1a4decabd0ff900dd44caa P b7ab4784c7344b939bc36f639286f377 [term 22 FOLLOWER]: Rejecting Update request from peer cd75a17ab2604397adab03bb8b5fd75c for earlier term 21. Current term is 22. Ops: [21.13-21.13]
I20260709 13:21:26.483345 13756 raft_consensus.cc:493] T 3d65025eea89441290d85dd053810e31 P cd75a17ab2604397adab03bb8b5fd75c [term 20 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:21:26.522326 13756 raft_consensus.cc:515] T 3d65025eea89441290d85dd053810e31 P cd75a17ab2604397adab03bb8b5fd75c [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:26.524775 13743 leader_election.cc:290] T f09c2a98de1a4decabd0ff900dd44caa P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 22 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:21:26.527616 13698 leader_election.cc:290] T 7c37d41cd9164c15a6826ca62a851a69 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 22 election: Requested vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:21:26.531064  6878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c37d41cd9164c15a6826ca62a851a69" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 22 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:21:26.490877 13885 raft_consensus.cc:493] T c4db81d9d329422bb3b4160ca4ac2d1d P cd75a17ab2604397adab03bb8b5fd75c [term 20 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:21:26.531975  6878 raft_consensus.cc:3060] T 7c37d41cd9164c15a6826ca62a851a69 P cd75a17ab2604397adab03bb8b5fd75c [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:21:26.532616 13885 raft_consensus.cc:515] T c4db81d9d329422bb3b4160ca4ac2d1d P cd75a17ab2604397adab03bb8b5fd75c [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:26.533340  6805 raft_consensus.cc:2468] T ce4f062dcd314d43a63ca74067cb5ee3 P b7ab4784c7344b939bc36f639286f377 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 16.
I20260709 13:21:26.455201 13631 raft_consensus.cc:515] T 1528ab62b6fe4e3099d08f141afee116 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:21:26.537750 13631 leader_election.cc:290] T 1528ab62b6fe4e3099d08f141afee116 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 18 election: Requested vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:21:26.467861 13651 consensus_queue.cc:260] T 34f36d59d88f40fe8a2805e604fc6c0a P ccd8a4c3bfe3413cb2ae219b09aea832 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.10, Last appended by leader: 10, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:26.539974  6875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5be3a11b23d4ea9b08300a2789821c7" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:21:26.554720  6875 raft_consensus.cc:2468] T f5be3a11b23d4ea9b08300a2789821c7 P cd75a17ab2604397adab03bb8b5fd75c [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 18.
I20260709 13:21:26.555454 13845 raft_consensus.cc:493] T 17587d6730594da4a56fa13a353232a1 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 26 FOLLOWER]: Starting pre-election (detected failure of leader 7ba59cc884714e8aa5f3f0ecaed84cbb)
I20260709 13:21:26.542776 13594 leader_election.cc:290] T f5be3a11b23d4ea9b08300a2789821c7 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:21:26.556180 13845 raft_consensus.cc:515] T 17587d6730594da4a56fa13a353232a1 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:21:26.543695 13671 consensus_queue.cc:1048] T 7c37d41cd9164c15a6826ca62a851a69 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.014s
I20260709 13:21:26.545456 13651 raft_consensus.cc:3060] T 34f36d59d88f40fe8a2805e604fc6c0a P ccd8a4c3bfe3413cb2ae219b09aea832 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:21:26.577947 13845 leader_election.cc:290] T 17587d6730594da4a56fa13a353232a1 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:21:26.579450 13756 leader_election.cc:290] T 3d65025eea89441290d85dd053810e31 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:21:26.582765  6801 raft_consensus.cc:1240] T 7c44c4849aa54f2b94d1f1bef9ed546f P b7ab4784c7344b939bc36f639286f377 [term 22 FOLLOWER]: Rejecting Update request from peer ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 21. Current term is 22. Ops: []
I20260709 13:21:26.551082  6726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d33d5ee8ef6f415593d8df52063161ad" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:21:26.559809 13554 raft_consensus.cc:493] T 427c124d773f483294511e80fe340075 P b7ab4784c7344b939bc36f639286f377 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 7ba59cc884714e8aa5f3f0ecaed84cbb)
I20260709 13:21:26.583117  6732 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50004 (request call id 3247) took 1409 ms. Trace:
I20260709 13:21:26.589035  6801 raft_consensus.cc:1240] T d8292e16e5654be6bc408560cf256aaa P b7ab4784c7344b939bc36f639286f377 [term 20 FOLLOWER]: Rejecting Update request from peer ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 19. Current term is 20. Ops: []
I20260709 13:21:26.589174  6726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de3186201e1a40d0b335eeb8b4e256e0" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:21:26.553798 13660 leader_election.cc:290] T de3186201e1a40d0b335eeb8b4e256e0 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 21 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:21:26.552623  6881 raft_consensus.cc:1240] T de3186201e1a40d0b335eeb8b4e256e0 P cd75a17ab2604397adab03bb8b5fd75c [term 21 FOLLOWER]: Rejecting Update request from peer ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 20. Current term is 21. Ops: []
I20260709 13:21:26.587814  6732 rpcz_store.cc:276] 0709 13:21:25.174238 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:21:25.257471 (+ 83233us) service_pool.cc:224] Handling call
0709 13:21:25.257891 (+   420us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:21:25.258135 (+   244us) raft_consensus.cc:1534] Early marking committed up to index 17
0709 13:21:25.273662 (+ 15527us) log.cc:844] Serialized 14 byte log entry
0709 13:21:25.590060 (+316398us) log.cc:844] Serialized 14 byte log entry
0709 13:21:26.582528 (+992468us) log.cc:844] Serialized 14 byte log entry
0709 13:21:26.582760 (+   232us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:21:26.582811 (+    51us) raft_consensus.cc:1645] Marking committed up to 17
0709 13:21:26.582857 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:21:26.582925 (+    68us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:21:26.583052 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1046344,"prepare.queue_time_us":1231057,"prepare.run_cpu_time_us":96,"prepare.run_wall_time_us":98,"raft.queue_time_us":72326,"raft.run_cpu_time_us":127,"raft.run_wall_time_us":2991,"thread_start_us":285089,"threads_started":2,"wal-append.queue_time_us":165471}
I20260709 13:21:26.594246  6801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c240553ce044eedb41541d72b9475d7" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:21:26.594596  6732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bf4668eeb70467fb3dc5a0289233b3c" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:21:26.595299  6732 raft_consensus.cc:3060] T 1bf4668eeb70467fb3dc5a0289233b3c P ccd8a4c3bfe3413cb2ae219b09aea832 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:21:26.596920  6798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c37d41cd9164c15a6826ca62a851a69" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 22 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:21:26.600385  6801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d9def8b32fd443aa94ab1420b06837b" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:21:26.547472  6772 leader_election.cc:304] T 34f36d59d88f40fe8a2805e604fc6c0a P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: ccd8a4c3bfe3413cb2ae219b09aea832
W20260709 13:21:26.563628 13652 consensus_meta.cc:287] T dbdf895bba214ff68685a24fd17dfb5d P ccd8a4c3bfe3413cb2ae219b09aea832: Time spent flushing consensus metadata: real 0.706s	user 0.014s	sys 0.000s
I20260709 13:21:26.569864 13886 leader_election.cc:290] T f03d0dbf16864ca4bc1bb5e4c0334c0f P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:21:26.563653 13684 leader_election.cc:290] T de3186201e1a40d0b335eeb8b4e256e0 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 21 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:21:26.579614  6806 raft_consensus.cc:1240] T 34f36d59d88f40fe8a2805e604fc6c0a P b7ab4784c7344b939bc36f639286f377 [term 18 FOLLOWER]: Rejecting Update request from peer ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 17. Current term is 18. Ops: [17.10-17.10]
I20260709 13:21:26.603416  6803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4275cf08e63345f993bce8664eada830" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
W20260709 13:21:26.603931  6772 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 56552.6us
I20260709 13:21:26.607506  6726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "427c124d773f483294511e80fe340075" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:21:26.608027  6730 raft_consensus.cc:1275] T dbdf895bba214ff68685a24fd17dfb5d P ccd8a4c3bfe3413cb2ae219b09aea832 [term 19 FOLLOWER]: Refusing update from remote peer b7ab4784c7344b939bc36f639286f377: Log matching property violated. Preceding OpId in replica: term: 18 index: 9. Preceding OpId from leader: term: 19 index: 9. (term mismatch)
I20260709 13:21:26.619246  6730 pending_rounds.cc:85] T dbdf895bba214ff68685a24fd17dfb5d P ccd8a4c3bfe3413cb2ae219b09aea832: Aborting all ops after (but not including) 8
I20260709 13:21:26.619622  6730 pending_rounds.cc:107] T dbdf895bba214ff68685a24fd17dfb5d P ccd8a4c3bfe3413cb2ae219b09aea832: Aborting uncommitted NO_OP operation due to leader change: 18.9
I20260709 13:21:26.620014  6730 raft_consensus.cc:2889] T dbdf895bba214ff68685a24fd17dfb5d P ccd8a4c3bfe3413cb2ae219b09aea832 [term 19 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:21:26.617357 13593 raft_consensus.cc:2804] T 34f36d59d88f40fe8a2805e604fc6c0a P b7ab4784c7344b939bc36f639286f377 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:21:26.622139 13593 raft_consensus.cc:697] T 34f36d59d88f40fe8a2805e604fc6c0a P b7ab4784c7344b939bc36f639286f377 [term 18 LEADER]: Becoming Leader. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
I20260709 13:21:26.598824 13554 raft_consensus.cc:515] T 427c124d773f483294511e80fe340075 P b7ab4784c7344b939bc36f639286f377 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } attrs { replace: true } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:21:26.623889 13593 consensus_queue.cc:237] T 34f36d59d88f40fe8a2805e604fc6c0a P b7ab4784c7344b939bc36f639286f377 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:26.629118  6726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7887766dc6784fcaa42b35c05fea7a99" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 24 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:21:26.631371 13554 leader_election.cc:290] T 427c124d773f483294511e80fe340075 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:21:26.636524  6804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6869f07b5a4885a0b99fbe60c3b175" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 23 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:21:26.640920  6804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "713b5728a197487c9300b310ab94e5a3" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:21:26.641434  6873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c44c4849aa54f2b94d1f1bef9ed546f" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:21:26.644848  6804 raft_consensus.cc:1240] T de3186201e1a40d0b335eeb8b4e256e0 P b7ab4784c7344b939bc36f639286f377 [term 21 FOLLOWER]: Rejecting Update request from peer ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 20. Current term is 21. Ops: []
I20260709 13:21:26.646745  6804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5be3a11b23d4ea9b08300a2789821c7" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
W20260709 13:21:26.647037  6697 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:21:26.650269  6803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c37d41cd9164c15a6826ca62a851a69" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 22 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:21:26.553704  6878 raft_consensus.cc:2468] T 7c37d41cd9164c15a6826ca62a851a69 P cd75a17ab2604397adab03bb8b5fd75c [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 22.
I20260709 13:21:26.652565  6801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1528ab62b6fe4e3099d08f141afee116" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
W20260709 13:21:26.652844  6770 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:21:26.655350  6806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17587d6730594da4a56fa13a353232a1" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 27 candidate_status { last_received { term: 26 index: 18 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:21:26.656213  6878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c240553ce044eedb41541d72b9475d7" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:21:26.656862  6878 raft_consensus.cc:3060] T 2c240553ce044eedb41541d72b9475d7 P cd75a17ab2604397adab03bb8b5fd75c [term 20 FOLLOWER]: Advancing to term 21
W20260709 13:21:26.660275  7468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 250266us
I20260709 13:21:26.661020  7468 leader_election.cc:304] T 4f00a2e87e56452083b759f60d461ee3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:21:26.662542  7468 leader_election.cc:304] T bb3d8792045a4583ae2e965b1350a5b4 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:21:26.664619  6872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3411566abe2d4c9bb4b2adfdd05e6f17" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:21:26.678443  6726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a485a995abc4807b6e511e45419f737" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:21:26.685472  6873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bf4668eeb70467fb3dc5a0289233b3c" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:21:26.686460  6873 raft_consensus.cc:3060] T 1bf4668eeb70467fb3dc5a0289233b3c P cd75a17ab2604397adab03bb8b5fd75c [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:21:26.687493  7498 raft_consensus.cc:1240] T ce4f062dcd314d43a63ca74067cb5ee3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 16 FOLLOWER]: Rejecting Update request from peer b7ab4784c7344b939bc36f639286f377 for earlier term 15. Current term is 16. Ops: []
I20260709 13:21:26.693166  6875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8292e16e5654be6bc408560cf256aaa" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:21:26.702272 13698 consensus_queue.cc:1059] T 7c44c4849aa54f2b94d1f1bef9ed546f P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: INVALID_TERM, Last received: 21.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:21:26.703578  6726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "427c124d773f483294511e80fe340075" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:21:26.704974  6726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09c2a98de1a4decabd0ff900dd44caa" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:21:26.705504  6726 raft_consensus.cc:3060] T f09c2a98de1a4decabd0ff900dd44caa P ccd8a4c3bfe3413cb2ae219b09aea832 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:21:26.714618  6875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09c2a98de1a4decabd0ff900dd44caa" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:21:26.682847 13752 raft_consensus.cc:2749] T 4f00a2e87e56452083b759f60d461ee3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:21:26.717322  6876 raft_consensus.cc:1275] T dbdf895bba214ff68685a24fd17dfb5d P cd75a17ab2604397adab03bb8b5fd75c [term 19 FOLLOWER]: Refusing update from remote peer b7ab4784c7344b939bc36f639286f377: Log matching property violated. Preceding OpId in replica: term: 17 index: 8. Preceding OpId from leader: term: 19 index: 9. (index mismatch)
I20260709 13:21:26.689919 13868 consensus_queue.cc:1048] T 7a734b5ab7834e05a8c422208acc58b1 P 7ba59cc884714e8aa5f3f0ecaed84cbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.028s
I20260709 13:21:26.720592  6695 leader_election.cc:304] T 2c240553ce044eedb41541d72b9475d7 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:21:26.722411  6876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de3186201e1a40d0b335eeb8b4e256e0" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:21:26.722489  6879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "427c124d773f483294511e80fe340075" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:21:26.723899  6879 raft_consensus.cc:2468] T 427c124d773f483294511e80fe340075 P cd75a17ab2604397adab03bb8b5fd75c [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 18.
I20260709 13:21:26.725314  6879 raft_consensus.cc:1240] T 7c37d41cd9164c15a6826ca62a851a69 P cd75a17ab2604397adab03bb8b5fd75c [term 22 FOLLOWER]: Rejecting Update request from peer b7ab4784c7344b939bc36f639286f377 for earlier term 21. Current term is 22. Ops: [21.15-21.15]
I20260709 13:21:26.726184 13207 consensus_queue.cc:1059] T d8292e16e5654be6bc408560cf256aaa P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: INVALID_TERM, Last received: 19.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:21:26.727087 13207 raft_consensus.cc:2749] T 2c240553ce044eedb41541d72b9475d7 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 21 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:21:26.728062 13207 raft_consensus.cc:3055] T d8292e16e5654be6bc408560cf256aaa P ccd8a4c3bfe3413cb2ae219b09aea832 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:21:26.728749  6874 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53416 (request call id 3863) took 1108 ms. Trace:
I20260709 13:21:26.736358  6878 raft_consensus.cc:2468] T 2c240553ce044eedb41541d72b9475d7 P cd75a17ab2604397adab03bb8b5fd75c [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 21.
I20260709 13:21:26.729259  6874 rpcz_store.cc:276] 0709 13:21:25.620113 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:21:25.622819 (+  2706us) service_pool.cc:224] Handling call
0709 13:21:26.317733 (+694914us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:21:26.318623 (+   890us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:21:26.727883 (+409260us) spinlock_profiling.cc:243] Waited 695 ms on lock 0x7b54001423d0. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f9a98ad 00007fcc1496e419 00007fcc0dee5bd4 00007fcc0dee5b62 00007fcc0dee5a91 00007fcc0dee5a0c 00007fcc0dee4cc2 00007fcc0dce548c 00007fcc0dce48c6 00007fcc0dce426f
0709 13:21:26.728674 (+   791us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1597375872}
I20260709 13:21:26.747923  7498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "427c124d773f483294511e80fe340075" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
W20260709 13:21:26.735890  7468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 73404.6us
I20260709 13:21:26.761047  6726 raft_consensus.cc:2468] T f09c2a98de1a4decabd0ff900dd44caa P ccd8a4c3bfe3413cb2ae219b09aea832 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 22.
I20260709 13:21:26.770644 13896 consensus_queue.cc:1059] T de3186201e1a40d0b335eeb8b4e256e0 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:21:26.773293 13848 raft_consensus.cc:3055] T de3186201e1a40d0b335eeb8b4e256e0 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:21:26.773898 13848 raft_consensus.cc:740] T de3186201e1a40d0b335eeb8b4e256e0 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
I20260709 13:21:26.772840 13896 raft_consensus.cc:493] T dbdf895bba214ff68685a24fd17dfb5d P ccd8a4c3bfe3413cb2ae219b09aea832 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:26.783447 13896 raft_consensus.cc:515] T dbdf895bba214ff68685a24fd17dfb5d P ccd8a4c3bfe3413cb2ae219b09aea832 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:26.789242  6801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbdf895bba214ff68685a24fd17dfb5d" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 20 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:21:26.763478  6770 leader_election.cc:304] T f09c2a98de1a4decabd0ff900dd44caa P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
I20260709 13:21:26.794060  7495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17587d6730594da4a56fa13a353232a1" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 27 candidate_status { last_received { term: 26 index: 18 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:21:26.794682  7498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1528ab62b6fe4e3099d08f141afee116" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb"
I20260709 13:21:26.775089 13848 consensus_queue.cc:260] T de3186201e1a40d0b335eeb8b4e256e0 P ccd8a4c3bfe3413cb2ae219b09aea832 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 20.11, Last appended by leader: 11, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:26.796576 13848 raft_consensus.cc:3060] T de3186201e1a40d0b335eeb8b4e256e0 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:21:26.803429  6697 leader_election.cc:304] T 17587d6730594da4a56fa13a353232a1 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, b7ab4784c7344b939bc36f639286f377
I20260709 13:21:26.805708 13698 raft_consensus.cc:2749] T 17587d6730594da4a56fa13a353232a1 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 13:21:26.812112  6803 raft_consensus.cc:1240] T d8292e16e5654be6bc408560cf256aaa P b7ab4784c7344b939bc36f639286f377 [term 20 FOLLOWER]: Rejecting Update request from peer ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 19. Current term is 20. Ops: []
I20260709 13:21:26.816442  6697 leader_election.cc:304] T 1528ab62b6fe4e3099d08f141afee116 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, b7ab4784c7344b939bc36f639286f377
I20260709 13:21:26.818401 13698 raft_consensus.cc:2749] T 1528ab62b6fe4e3099d08f141afee116 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:21:26.820645 13631 consensus_queue.cc:1059] T d8292e16e5654be6bc408560cf256aaa P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: INVALID_TERM, Last received: 19.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:21:26.832823  6873 raft_consensus.cc:2468] T 1bf4668eeb70467fb3dc5a0289233b3c P cd75a17ab2604397adab03bb8b5fd75c [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 19.
I20260709 13:21:26.846118  6731 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50004 (request call id 3257) took 1381 ms. Trace:
I20260709 13:21:26.846694  6731 rpcz_store.cc:276] 0709 13:21:25.464889 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:21:25.465081 (+   192us) service_pool.cc:224] Handling call
0709 13:21:25.465446 (+   365us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:21:25.465715 (+   269us) raft_consensus.cc:1534] Early marking committed up to index 13
0709 13:21:26.581895 (+1116180us) log.cc:844] Serialized 14 byte log entry
0709 13:21:26.845433 (+263538us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:21:26.845492 (+    59us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:21:26.845605 (+   113us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:21:26.845676 (+    71us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:21:26.845846 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1122973,"prepare.queue_time_us":1118654,"prepare.run_cpu_time_us":69,"prepare.run_wall_time_us":7571,"thread_start_us":256229,"threads_started":1}
W20260709 13:21:26.853055  6695 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:21:26.745203 13207 raft_consensus.cc:740] T d8292e16e5654be6bc408560cf256aaa P ccd8a4c3bfe3413cb2ae219b09aea832 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
I20260709 13:21:26.765468 13756 raft_consensus.cc:493] T 7a734b5ab7834e05a8c422208acc58b1 P cd75a17ab2604397adab03bb8b5fd75c [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:26.764062 13700 raft_consensus.cc:2749] T bb3d8792045a4583ae2e965b1350a5b4 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:21:26.867377  6731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5be3a11b23d4ea9b08300a2789821c7" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:21:26.727854 13865 raft_consensus.cc:515] T 3411566abe2d4c9bb4b2adfdd05e6f17 P cd75a17ab2604397adab03bb8b5fd75c [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
W20260709 13:21:26.869204 13694 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.974s	user 0.017s	sys 0.018s
I20260709 13:21:26.869561  6731 raft_consensus.cc:2468] T f5be3a11b23d4ea9b08300a2789821c7 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 18.
I20260709 13:21:26.881196  6726 raft_consensus.cc:1240] T bd6869f07b5a4885a0b99fbe60c3b175 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 23 FOLLOWER]: Rejecting Update request from peer b7ab4784c7344b939bc36f639286f377 for earlier term 22. Current term is 23. Ops: [22.11-22.11]
I20260709 13:21:26.877852  6731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de3186201e1a40d0b335eeb8b4e256e0" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:21:26.837466 13631 raft_consensus.cc:493] T f4b8bd455d5a47c18a1380839c6e0d61 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:21:26.837167 13874 raft_consensus.cc:493] T 4275cf08e63345f993bce8664eada830 P cd75a17ab2604397adab03bb8b5fd75c [term 19 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:21:26.892747  6873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbdf895bba214ff68685a24fd17dfb5d" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 20 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:21:26.893371  6731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d65025eea89441290d85dd053810e31" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:21:26.899471  6873 raft_consensus.cc:2468] T dbdf895bba214ff68685a24fd17dfb5d P cd75a17ab2604397adab03bb8b5fd75c [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 19.
I20260709 13:21:26.899914  6875 raft_consensus.cc:1240] T 3411566abe2d4c9bb4b2adfdd05e6f17 P cd75a17ab2604397adab03bb8b5fd75c [term 19 FOLLOWER]: Rejecting Update request from peer ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 18. Current term is 19. Ops: []
I20260709 13:21:26.883775  6726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f03d0dbf16864ca4bc1bb5e4c0334c0f" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:21:26.856356 13826 raft_consensus.cc:493] T f3f9c2e2bf644115957398fe4c9459db P cd75a17ab2604397adab03bb8b5fd75c [term 19 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:21:26.864056 13594 raft_consensus.cc:493] T f4b8bd455d5a47c18a1380839c6e0d61 P cd75a17ab2604397adab03bb8b5fd75c [term 20 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
W20260709 13:21:26.884788 13694 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.001s	user 0.018s	sys 0.018s
I20260709 13:21:26.904099 13631 raft_consensus.cc:515] T f4b8bd455d5a47c18a1380839c6e0d61 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:26.930653 13631 leader_election.cc:290] T f4b8bd455d5a47c18a1380839c6e0d61 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:21:26.922729  6731 raft_consensus.cc:1240] T 7c37d41cd9164c15a6826ca62a851a69 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 22 FOLLOWER]: Rejecting Update request from peer b7ab4784c7344b939bc36f639286f377 for earlier term 21. Current term is 22. Ops: [21.15-21.15]
I20260709 13:21:26.918716  6726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4db81d9d329422bb3b4160ca4ac2d1d" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:21:26.921092 13207 consensus_queue.cc:260] T d8292e16e5654be6bc408560cf256aaa P ccd8a4c3bfe3413cb2ae219b09aea832 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.11, Last appended by leader: 11, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:26.935019 13207 raft_consensus.cc:3060] T d8292e16e5654be6bc408560cf256aaa P ccd8a4c3bfe3413cb2ae219b09aea832 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:21:26.906883 13874 raft_consensus.cc:515] T 4275cf08e63345f993bce8664eada830 P cd75a17ab2604397adab03bb8b5fd75c [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:26.937819 13874 leader_election.cc:290] T 4275cf08e63345f993bce8664eada830 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:21:26.896734 13896 leader_election.cc:290] T dbdf895bba214ff68685a24fd17dfb5d P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:21:26.925086 13826 raft_consensus.cc:515] T f3f9c2e2bf644115957398fe4c9459db P cd75a17ab2604397adab03bb8b5fd75c [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:26.940227 13826 leader_election.cc:290] T f3f9c2e2bf644115957398fe4c9459db P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:21:26.877774 13756 raft_consensus.cc:515] T 7a734b5ab7834e05a8c422208acc58b1 P cd75a17ab2604397adab03bb8b5fd75c [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } attrs { replace: true } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:21:26.942957 13756 leader_election.cc:290] T 7a734b5ab7834e05a8c422208acc58b1 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:21:26.945518  6873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4b8bd455d5a47c18a1380839c6e0d61" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 21 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:21:26.946995 13865 leader_election.cc:290] T 3411566abe2d4c9bb4b2adfdd05e6f17 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 19 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:21:26.967935 13597 raft_consensus.cc:493] T 20f6842e26174571996b8dea4151d4be P ccd8a4c3bfe3413cb2ae219b09aea832 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:21:26.968918 13597 raft_consensus.cc:515] T 20f6842e26174571996b8dea4151d4be P ccd8a4c3bfe3413cb2ae219b09aea832 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:26.974611  6876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20f6842e26174571996b8dea4151d4be" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:21:26.975638 13885 leader_election.cc:290] T c4db81d9d329422bb3b4160ca4ac2d1d P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
W20260709 13:21:26.976197  6697 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:21:26.977036 13597 leader_election.cc:290] T 20f6842e26174571996b8dea4151d4be P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:21:26.982501  6731 raft_consensus.cc:1240] T f09c2a98de1a4decabd0ff900dd44caa P ccd8a4c3bfe3413cb2ae219b09aea832 [term 22 FOLLOWER]: Rejecting Update request from peer cd75a17ab2604397adab03bb8b5fd75c for earlier term 21. Current term is 22. Ops: [21.13-21.13]
I20260709 13:21:26.945387 13594 raft_consensus.cc:515] T f4b8bd455d5a47c18a1380839c6e0d61 P cd75a17ab2604397adab03bb8b5fd75c [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:26.992504  7498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "427c124d773f483294511e80fe340075" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
W20260709 13:21:26.992879 13879 log.cc:927] Time spent T be1a92657f494cac8dd227d152f50151 P 7ba59cc884714e8aa5f3f0ecaed84cbb: Append to log took a long time: real 0.716s	user 0.003s	sys 0.000s
I20260709 13:21:26.994056 13594 leader_election.cc:290] T f4b8bd455d5a47c18a1380839c6e0d61 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:21:26.994773  6873 raft_consensus.cc:2468] T f4b8bd455d5a47c18a1380839c6e0d61 P cd75a17ab2604397adab03bb8b5fd75c [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 20.
I20260709 13:21:26.995486  6727 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49998 (request call id 1743) took 1875 ms. Trace:
I20260709 13:21:26.995865  6727 rpcz_store.cc:276] 0709 13:21:25.120095 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:21:25.120279 (+   184us) service_pool.cc:224] Handling call
0709 13:21:26.995268 (+1874989us) spinlock_profiling.cc:243] Waited 916 ms on lock 0x7b540020b7d4. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f9ae2fa 00007fcc1496fb17 00007fcc0deea6d4 00007fcc0deea662 00007fcc0deea591 00007fcc0deea50c 00007fcc0dee97c2 00007fcc0dce548c 00007fcc0dce48c6 00007fcc0dce426f
0709 13:21:26.995419 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2107933568}
I20260709 13:21:26.996325  7495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a734b5ab7834e05a8c422208acc58b1" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 23 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:21:26.998800  6728 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50004 (request call id 3252) took 1705 ms. Trace:
I20260709 13:21:26.999014 13893 consensus_queue.cc:1059] T 44bde925b2e541b69890d70715b85176 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: INVALID_TERM, Last received: 19.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:21:27.000582 13893 raft_consensus.cc:3055] T 44bde925b2e541b69890d70715b85176 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:21:27.001019 13893 raft_consensus.cc:740] T 44bde925b2e541b69890d70715b85176 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
I20260709 13:21:27.002238 13893 consensus_queue.cc:260] T 44bde925b2e541b69890d70715b85176 P ccd8a4c3bfe3413cb2ae219b09aea832 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.12, Last appended by leader: 12, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:27.003350  6728 rpcz_store.cc:276] 0709 13:21:25.293345 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:21:25.294048 (+   703us) service_pool.cc:224] Handling call
0709 13:21:25.294396 (+   348us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:21:26.193169 (+898773us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:21:26.998523 (+805354us) spinlock_profiling.cc:243] Waited 896 ms on lock 0x7b54003d5c54. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f9aae01 00007fcc0f9a983e 00007fcc1496e419 00007fcc0dee5bd4 00007fcc0dee5b62 00007fcc0dee5a91 00007fcc0dee5a0c 00007fcc0dee4cc2 00007fcc0dce548c 00007fcc0dce48c6
0709 13:21:26.998737 (+   214us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2060756736}
I20260709 13:21:26.998816  6697 leader_election.cc:304] T 4d9def8b32fd443aa94ab1420b06837b P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:21:27.006220 13698 raft_consensus.cc:2749] T 4d9def8b32fd443aa94ab1420b06837b P ccd8a4c3bfe3413cb2ae219b09aea832 [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 13:21:27.008994 13697 raft_consensus.cc:3055] T 7c44c4849aa54f2b94d1f1bef9ed546f P ccd8a4c3bfe3413cb2ae219b09aea832 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:21:27.009619 13697 raft_consensus.cc:740] T 7c44c4849aa54f2b94d1f1bef9ed546f P ccd8a4c3bfe3413cb2ae219b09aea832 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
I20260709 13:21:27.010717 13697 consensus_queue.cc:260] T 7c44c4849aa54f2b94d1f1bef9ed546f P ccd8a4c3bfe3413cb2ae219b09aea832 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 21.14, Last appended by leader: 14, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:27.008816  6697 leader_election.cc:304] T bd6869f07b5a4885a0b99fbe60c3b175 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:21:27.013074 13896 raft_consensus.cc:2749] T bd6869f07b5a4885a0b99fbe60c3b175 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260709 13:21:27.013931 13896 consensus_queue.cc:1059] T d33d5ee8ef6f415593d8df52063161ad P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: INVALID_TERM, Last received: 18.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:21:27.015331 13631 raft_consensus.cc:3055] T d33d5ee8ef6f415593d8df52063161ad P ccd8a4c3bfe3413cb2ae219b09aea832 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:21:27.015764 13631 raft_consensus.cc:740] T d33d5ee8ef6f415593d8df52063161ad P ccd8a4c3bfe3413cb2ae219b09aea832 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
I20260709 13:21:27.016846 13631 consensus_queue.cc:260] T d33d5ee8ef6f415593d8df52063161ad P ccd8a4c3bfe3413cb2ae219b09aea832 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.10, Last appended by leader: 10, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:27.018880 13631 raft_consensus.cc:3060] T d33d5ee8ef6f415593d8df52063161ad P ccd8a4c3bfe3413cb2ae219b09aea832 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:21:27.020560  6697 leader_election.cc:304] T 713b5728a197487c9300b310ab94e5a3 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:21:27.024660 13597 raft_consensus.cc:2749] T 713b5728a197487c9300b310ab94e5a3 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:21:27.029589  6846 leader_election.cc:304] T 427c124d773f483294511e80fe340075 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:21:27.032394  6697 leader_election.cc:304] T 4275cf08e63345f993bce8664eada830 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:21:27.004020 13893 raft_consensus.cc:3060] T 44bde925b2e541b69890d70715b85176 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:21:27.073453  6697 leader_election.cc:304] T f5be3a11b23d4ea9b08300a2789821c7 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377
I20260709 13:21:27.075196 13694 raft_consensus.cc:2749] T 4275cf08e63345f993bce8664eada830 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:21:27.075771 13775 consensus_queue.cc:1059] T 4d9def8b32fd443aa94ab1420b06837b P b7ab4784c7344b939bc36f639286f377 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: INVALID_TERM, Last received: 21.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:21:27.076741 13694 raft_consensus.cc:2804] T f5be3a11b23d4ea9b08300a2789821c7 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:21:27.077229 13694 raft_consensus.cc:493] T f5be3a11b23d4ea9b08300a2789821c7 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 18 FOLLOWER]: Starting leader election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:21:27.077597 13694 raft_consensus.cc:3060] T f5be3a11b23d4ea9b08300a2789821c7 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:21:27.078688  6846 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.68:45071, user_credentials={real_user=slave}} blocked reactor thread for 47732.8us
I20260709 13:21:27.075299  6697 leader_election.cc:304] T 7c37d41cd9164c15a6826ca62a851a69 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377
I20260709 13:21:27.084126 13698 raft_consensus.cc:2804] T 7c37d41cd9164c15a6826ca62a851a69 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:21:27.084672 13698 raft_consensus.cc:697] T 7c37d41cd9164c15a6826ca62a851a69 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 22 LEADER]: Becoming Leader. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
I20260709 13:21:27.075289  6730 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50004 (request call id 3277) took 1037 ms. Trace:
I20260709 13:21:27.085640 13698 consensus_queue.cc:237] T 7c37d41cd9164c15a6826ca62a851a69 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.14, Last appended by leader: 14, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:27.086043 13885 raft_consensus.cc:493] T 07a92dd554674067a83a9cb68c4773f2 P cd75a17ab2604397adab03bb8b5fd75c [term 19 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:21:27.085973  6730 rpcz_store.cc:276] 0709 13:21:26.037534 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:21:26.319002 (+281468us) service_pool.cc:224] Handling call
0709 13:21:26.333525 (+ 14523us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:21:26.620663 (+287138us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:21:27.075046 (+454383us) spinlock_profiling.cc:243] Waited 274 ms on lock 0x7b540020bcd4. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f9aae01 00007fcc0f9a983e 00007fcc1496e419 00007fcc0dee5bd4 00007fcc0dee5b62 00007fcc0dee5a91 00007fcc0dee5a0c 00007fcc0dee4cc2 00007fcc0dce548c 00007fcc0dce48c6
0709 13:21:27.075213 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":630388480}
I20260709 13:21:27.086869 13885 raft_consensus.cc:515] T 07a92dd554674067a83a9cb68c4773f2 P cd75a17ab2604397adab03bb8b5fd75c [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:27.087230  6697 leader_election.cc:304] T dbdf895bba214ff68685a24fd17dfb5d P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377
I20260709 13:21:27.088243 13207 raft_consensus.cc:2804] T dbdf895bba214ff68685a24fd17dfb5d P ccd8a4c3bfe3413cb2ae219b09aea832 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:21:27.088627 13207 raft_consensus.cc:493] T dbdf895bba214ff68685a24fd17dfb5d P ccd8a4c3bfe3413cb2ae219b09aea832 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:27.088996 13207 raft_consensus.cc:3060] T dbdf895bba214ff68685a24fd17dfb5d P ccd8a4c3bfe3413cb2ae219b09aea832 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:21:27.089104 13885 leader_election.cc:290] T 07a92dd554674067a83a9cb68c4773f2 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:21:27.090009 13885 raft_consensus.cc:493] T 4d9def8b32fd443aa94ab1420b06837b P cd75a17ab2604397adab03bb8b5fd75c [term 21 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:21:27.090471 13885 raft_consensus.cc:515] T 4d9def8b32fd443aa94ab1420b06837b P cd75a17ab2604397adab03bb8b5fd75c [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:27.094009 13885 leader_election.cc:290] T 4d9def8b32fd443aa94ab1420b06837b P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:21:27.068387 13864 raft_consensus.cc:2749] T 427c124d773f483294511e80fe340075 P cd75a17ab2604397adab03bb8b5fd75c [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:21:27.134050  6732 consensus_meta.cc:287] T 1bf4668eeb70467fb3dc5a0289233b3c P ccd8a4c3bfe3413cb2ae219b09aea832: Time spent flushing consensus metadata: real 0.538s	user 0.011s	sys 0.000s
I20260709 13:21:27.134761  6732 raft_consensus.cc:2468] T 1bf4668eeb70467fb3dc5a0289233b3c P ccd8a4c3bfe3413cb2ae219b09aea832 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 19.
I20260709 13:21:27.125957 13651 raft_consensus.cc:493] T 9e326172347f45e99a0d482b5d8ef768 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:21:27.154901  6772 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.68:45071, user_credentials={real_user=slave}} blocked reactor thread for 318858us
I20260709 13:21:27.088755  6697 leader_election.cc:304] T f4b8bd455d5a47c18a1380839c6e0d61 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
W20260709 13:21:27.162839  6697 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 74147.5us
W20260709 13:21:27.166453  6697 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:21:27.169689  6844 leader_election.cc:304] T d33d5ee8ef6f415593d8df52063161ad P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:21:27.153542 13694 raft_consensus.cc:515] T f5be3a11b23d4ea9b08300a2789821c7 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
W20260709 13:21:27.192378  6770 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 429007us
I20260709 13:21:27.204586  6732 raft_consensus.cc:1240] T 1528ab62b6fe4e3099d08f141afee116 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 18 FOLLOWER]: Rejecting Update request from peer b7ab4784c7344b939bc36f639286f377 for earlier term 17. Current term is 18. Ops: []
I20260709 13:21:27.151373 13651 raft_consensus.cc:515] T 9e326172347f45e99a0d482b5d8ef768 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:27.176484 13652 raft_consensus.cc:2804] T f4b8bd455d5a47c18a1380839c6e0d61 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:21:27.151770 13207 raft_consensus.cc:515] T dbdf895bba214ff68685a24fd17dfb5d P ccd8a4c3bfe3413cb2ae219b09aea832 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:27.177574 13593 raft_consensus.cc:2804] T f09c2a98de1a4decabd0ff900dd44caa P b7ab4784c7344b939bc36f639286f377 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:21:27.176841 13888 raft_consensus.cc:493] T be1a92657f494cac8dd227d152f50151 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
W20260709 13:21:27.224459  6772 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.68:45071, user_credentials={real_user=slave}} blocked reactor thread for 68552.8us
I20260709 13:21:27.212435 13652 raft_consensus.cc:493] T f4b8bd455d5a47c18a1380839c6e0d61 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 20 FOLLOWER]: Starting leader election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:21:27.190032 13863 raft_consensus.cc:2749] T d33d5ee8ef6f415593d8df52063161ad P cd75a17ab2604397adab03bb8b5fd75c [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
W20260709 13:21:27.208565 13793 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.603s	user 0.037s	sys 0.077s
W20260709 13:21:27.212690 13909 log.cc:927] Time spent T bd6869f07b5a4885a0b99fbe60c3b175 P cd75a17ab2604397adab03bb8b5fd75c: Append to log took a long time: real 0.052s	user 0.001s	sys 0.000s
I20260709 13:21:27.227875  6772 leader_election.cc:304] T 427c124d773f483294511e80fe340075 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:21:27.177232 13887 consensus_queue.cc:1059] T 3411566abe2d4c9bb4b2adfdd05e6f17 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: INVALID_TERM, Last received: 18.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.045s
I20260709 13:21:27.249780  6805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4b8bd455d5a47c18a1380839c6e0d61" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 21 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:21:27.252498  6803 raft_consensus.cc:1240] T 7c44c4849aa54f2b94d1f1bef9ed546f P b7ab4784c7344b939bc36f639286f377 [term 22 FOLLOWER]: Rejecting Update request from peer ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 21. Current term is 22. Ops: []
I20260709 13:21:27.253670  6804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20f6842e26174571996b8dea4151d4be" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
W20260709 13:21:27.234454 13793 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.636s	user 0.038s	sys 0.078s
I20260709 13:21:27.255621 13839 raft_consensus.cc:493] T 1528ab62b6fe4e3099d08f141afee116 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 17 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
W20260709 13:21:27.262837 13903 log.cc:927] Time spent T 2c240553ce044eedb41541d72b9475d7 P b7ab4784c7344b939bc36f639286f377: Append to log took a long time: real 0.110s	user 0.001s	sys 0.000s
I20260709 13:21:27.233456 13652 raft_consensus.cc:3060] T f4b8bd455d5a47c18a1380839c6e0d61 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:21:27.257944 13864 raft_consensus.cc:493] T 90d42e216d9741e190bca19a781291fd P cd75a17ab2604397adab03bb8b5fd75c [term 18 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:21:27.242610 13602 raft_consensus.cc:493] T f3f9c2e2bf644115957398fe4c9459db P b7ab4784c7344b939bc36f639286f377 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:27.276572  7498 raft_consensus.cc:1275] T ce4f062dcd314d43a63ca74067cb5ee3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 16 FOLLOWER]: Refusing update from remote peer cd75a17ab2604397adab03bb8b5fd75c: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
W20260709 13:21:27.282553  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 73715.7us
I20260709 13:21:27.262674 13839 raft_consensus.cc:515] T 1528ab62b6fe4e3099d08f141afee116 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:21:27.255065 13593 raft_consensus.cc:697] T f09c2a98de1a4decabd0ff900dd44caa P b7ab4784c7344b939bc36f639286f377 [term 22 LEADER]: Becoming Leader. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
I20260709 13:21:27.255470 13851 raft_consensus.cc:493] T d8cee0accdb8499c86d4414b72565a38 P cd75a17ab2604397adab03bb8b5fd75c [term 19 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:21:27.256529 13863 raft_consensus.cc:493] T a1704639a875409b9959353527b3fd68 P cd75a17ab2604397adab03bb8b5fd75c [term 22 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:21:27.292531 13863 raft_consensus.cc:515] T a1704639a875409b9959353527b3fd68 P cd75a17ab2604397adab03bb8b5fd75c [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:27.294891 13863 leader_election.cc:290] T a1704639a875409b9959353527b3fd68 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:21:27.283758  6844 leader_election.cc:304] T 3a485a995abc4807b6e511e45419f737 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:21:27.230707 13888 raft_consensus.cc:515] T be1a92657f494cac8dd227d152f50151 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:21:27.297505 13888 leader_election.cc:290] T be1a92657f494cac8dd227d152f50151 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:21:27.305334  6844 leader_election.cc:304] T 7887766dc6784fcaa42b35c05fea7a99 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:21:27.309608  7498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be1a92657f494cac8dd227d152f50151" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
W20260709 13:21:27.311836  6698 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:21:27.286499 13915 raft_consensus.cc:2749] T 427c124d773f483294511e80fe340075 P b7ab4784c7344b939bc36f639286f377 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:21:27.319048  6730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f9c2e2bf644115957398fe4c9459db" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:21:27.319900  6730 raft_consensus.cc:2393] T f3f9c2e2bf644115957398fe4c9459db P ccd8a4c3bfe3413cb2ae219b09aea832 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c in current term 20: Already voted for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in this term.
I20260709 13:21:27.325805  6728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3411566abe2d4c9bb4b2adfdd05e6f17" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:21:27.324239  6731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a734b5ab7834e05a8c422208acc58b1" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 23 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:21:27.330178  6844 leader_election.cc:304] T f5be3a11b23d4ea9b08300a2789821c7 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:21:27.311694 13793 raft_consensus.cc:2749] T 3a485a995abc4807b6e511e45419f737 P cd75a17ab2604397adab03bb8b5fd75c [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:21:27.323050  6732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4275cf08e63345f993bce8664eada830" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:21:27.280648 13864 raft_consensus.cc:515] T 90d42e216d9741e190bca19a781291fd P cd75a17ab2604397adab03bb8b5fd75c [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:27.311575 13777 raft_consensus.cc:2749] T 7887766dc6784fcaa42b35c05fea7a99 P cd75a17ab2604397adab03bb8b5fd75c [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:21:27.345132  6732 raft_consensus.cc:2393] T 4275cf08e63345f993bce8664eada830 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c in current term 20: Already voted for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in this term.
I20260709 13:21:27.345443  6730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a92dd554674067a83a9cb68c4773f2" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:21:27.343703  6731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4b8bd455d5a47c18a1380839c6e0d61" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 21 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:21:27.346657 13893 consensus_queue.cc:1059] T 7c44c4849aa54f2b94d1f1bef9ed546f P ccd8a4c3bfe3413cb2ae219b09aea832 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: INVALID_TERM, Last received: 21.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:21:27.344409 13774 raft_consensus.cc:493] T 9b3759de40694069b13c0f8bd40e5709 P b7ab4784c7344b939bc36f639286f377 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader cd75a17ab2604397adab03bb8b5fd75c)
I20260709 13:21:27.310545 13851 raft_consensus.cc:515] T d8cee0accdb8499c86d4414b72565a38 P cd75a17ab2604397adab03bb8b5fd75c [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
W20260709 13:21:27.347699 13913 log.cc:927] Time spent T 7a734b5ab7834e05a8c422208acc58b1 P 7ba59cc884714e8aa5f3f0ecaed84cbb: Append to log took a long time: real 0.089s	user 0.000s	sys 0.000s
I20260709 13:21:27.391817  6729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d9def8b32fd443aa94ab1420b06837b" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:21:27.395970  6729 raft_consensus.cc:2393] T 4d9def8b32fd443aa94ab1420b06837b P ccd8a4c3bfe3413cb2ae219b09aea832 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c in current term 22: Already voted for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in this term.
I20260709 13:21:27.300781 13602 raft_consensus.cc:515] T f3f9c2e2bf644115957398fe4c9459db P b7ab4784c7344b939bc36f639286f377 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:27.320889 13447 raft_consensus.cc:493] T b3f13b31a1f84f0d89d007eadd57924c P b7ab4784c7344b939bc36f639286f377 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 7ba59cc884714e8aa5f3f0ecaed84cbb)
I20260709 13:21:27.359112 13711 raft_consensus.cc:3055] T 3411566abe2d4c9bb4b2adfdd05e6f17 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:21:27.329598 13856 raft_consensus.cc:493] T 3fa34c08b205435dba97346991aa1f92 P cd75a17ab2604397adab03bb8b5fd75c [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:27.302428 13886 consensus_queue.cc:1048] T ce4f062dcd314d43a63ca74067cb5ee3 P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.040s
I20260709 13:21:27.362955  6804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be1a92657f494cac8dd227d152f50151" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:21:27.380059  6730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1704639a875409b9959353527b3fd68" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:21:27.380808  6844 leader_election.cc:304] T 7a734b5ab7834e05a8c422208acc58b1 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:21:27.381660 13774 raft_consensus.cc:515] T 9b3759de40694069b13c0f8bd40e5709 P b7ab4784c7344b939bc36f639286f377 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:27.387478 13207 leader_election.cc:290] T dbdf895bba214ff68685a24fd17dfb5d P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 20 election: Requested vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
W20260709 13:21:27.398576 13916 log.cc:927] Time spent T bd6869f07b5a4885a0b99fbe60c3b175 P b7ab4784c7344b939bc36f639286f377: Append to log took a long time: real 0.122s	user 0.001s	sys 0.000s
I20260709 13:21:27.398490  6724 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50004 (request call id 3249) took 2123 ms. Trace:
I20260709 13:21:27.460367 13652 raft_consensus.cc:515] T f4b8bd455d5a47c18a1380839c6e0d61 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:27.460579  6724 rpcz_store.cc:276] 0709 13:21:25.275249 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:21:25.308353 (+ 33104us) service_pool.cc:224] Handling call
0709 13:21:25.308665 (+   312us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:21:26.315451 (+1006786us) spinlock_profiling.cc:243] Waited 1.49 ms on lock 0x7b1800362560. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc15785de1 00007fcc157925b1 00007fcc0f5524bc 00007fcc0c8a048b 00007fcc156faab9 00007fcc0c8bc69b 00007fcc0c8ba93f 00007fcc0c8ba455 00007fcc0f9a2060 00007fcc0f9a2bfb 00007fcc0f9ad64b
0709 13:21:26.315582 (+   131us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:21:26.620502 (+304920us) log.cc:844] Serialized 14 byte log entry
0709 13:21:27.020123 (+399621us) spinlock_profiling.cc:243] Waited 7.3 ms on lock 0x7b1800362560. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc15785de1 00007fcc157925b1 00007fcc0c89fe07 00007fcc156faab9 00007fcc0c8bc69b 00007fcc0c8ba93f 00007fcc0c8bcc02 00007fcc0f54420b 00007fcc0f549d23 00007fcc0f54a23a 00007fcc0f9b4a2a
0709 13:21:27.398034 (+377911us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:21:27.398115 (+    81us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:21:27.398188 (+    73us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:21:27.398264 (+    76us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:21:27.398399 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":394288,"prepare.queue_time_us":304732,"prepare.run_cpu_time_us":45,"prepare.run_wall_time_us":48,"raft.queue_time_us":92077,"raft.run_cpu_time_us":299,"raft.run_wall_time_us":21396,"spinlock_wait_cycles":20215808,"thread_start_us":425911,"threads_started":2}
I20260709 13:21:27.400573 13593 consensus_queue.cc:237] T f09c2a98de1a4decabd0ff900dd44caa P b7ab4784c7344b939bc36f639286f377 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 20.12, Last appended by leader: 12, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:27.462990 13652 leader_election.cc:290] T f4b8bd455d5a47c18a1380839c6e0d61 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 21 election: Requested vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:21:27.409363 13839 leader_election.cc:290] T 1528ab62b6fe4e3099d08f141afee116 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:21:27.410547 13651 leader_election.cc:290] T 9e326172347f45e99a0d482b5d8ef768 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:21:27.360088 13723 raft_consensus.cc:2804] T f5be3a11b23d4ea9b08300a2789821c7 P cd75a17ab2604397adab03bb8b5fd75c [term 18 FOLLOWER]: Leader pre-election won for term 19
W20260709 13:21:27.416723 13912 log.cc:927] Time spent T 07a92dd554674067a83a9cb68c4773f2 P ccd8a4c3bfe3413cb2ae219b09aea832: Append to log took a long time: real 0.145s	user 0.000s	sys 0.000s
I20260709 13:21:27.467125 13723 raft_consensus.cc:493] T f5be3a11b23d4ea9b08300a2789821c7 P cd75a17ab2604397adab03bb8b5fd75c [term 18 FOLLOWER]: Starting leader election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:21:27.467649 13723 raft_consensus.cc:3060] T f5be3a11b23d4ea9b08300a2789821c7 P cd75a17ab2604397adab03bb8b5fd75c [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:21:27.376744 13910 log.cc:927] Time spent T 853ac0a8cbd64ce99457f170216d4d0f P cd75a17ab2604397adab03bb8b5fd75c: Append to log took a long time: real 0.203s	user 0.000s	sys 0.001s
I20260709 13:21:27.418259 13877 raft_consensus.cc:2749] T 853ac0a8cbd64ce99457f170216d4d0f P ccd8a4c3bfe3413cb2ae219b09aea832 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:21:27.419601 13917 log.cc:927] Time spent T 07a92dd554674067a83a9cb68c4773f2 P b7ab4784c7344b939bc36f639286f377: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260709 13:21:27.372112 13915 raft_consensus.cc:493] T 9e326172347f45e99a0d482b5d8ef768 P b7ab4784c7344b939bc36f639286f377 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:27.470283 13915 raft_consensus.cc:515] T 9e326172347f45e99a0d482b5d8ef768 P b7ab4784c7344b939bc36f639286f377 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:27.472627  6723 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50004 (request call id 3278) took 1287 ms. Trace:
W20260709 13:21:27.431656  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 50940.6us
I20260709 13:21:27.473341  6723 rpcz_store.cc:276] 0709 13:21:26.185491 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:21:26.722458 (+536967us) service_pool.cc:224] Handling call
0709 13:21:26.722747 (+   289us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:21:26.755300 (+ 32553us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:21:26.755340 (+    40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:21:26.755991 (+   651us) log.cc:844] Serialized 26 byte log entry
0709 13:21:27.154493 (+398502us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:21:27.154539 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:21:27.154618 (+    79us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:21:27.472136 (+317518us) raft_consensus.cc:1685] finished
0709 13:21:27.472169 (+    33us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:21:27.472523 (+   354us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":32595,"raft.queue_time_us":42312,"raft.run_cpu_time_us":120,"raft.run_wall_time_us":2467,"thread_start_us":398111,"threads_started":1,"wal-append.queue_time_us":478530}
I20260709 13:21:27.439316  6725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1528ab62b6fe4e3099d08f141afee116" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
W20260709 13:21:27.476317 13918 log.cc:927] Time spent T 7a734b5ab7834e05a8c422208acc58b1 P cd75a17ab2604397adab03bb8b5fd75c: Append to log took a long time: real 0.052s	user 0.001s	sys 0.000s
I20260709 13:21:27.442708  6806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de3186201e1a40d0b335eeb8b4e256e0" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:21:27.481885  6806 raft_consensus.cc:2393] T de3186201e1a40d0b335eeb8b4e256e0 P b7ab4784c7344b939bc36f639286f377 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c in current term 21: Already voted for candidate b7ab4784c7344b939bc36f639286f377 in this term.
I20260709 13:21:27.322150 13863 consensus_queue.cc:1059] T f09c2a98de1a4decabd0ff900dd44caa P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: INVALID_TERM, Last received: 20.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.053s
I20260709 13:21:27.483166 13863 raft_consensus.cc:3055] T f09c2a98de1a4decabd0ff900dd44caa P cd75a17ab2604397adab03bb8b5fd75c [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:21:27.483547 13863 raft_consensus.cc:740] T f09c2a98de1a4decabd0ff900dd44caa P cd75a17ab2604397adab03bb8b5fd75c [term 21 LEADER]: Becoming Follower/Learner. State: Replica: cd75a17ab2604397adab03bb8b5fd75c, State: Running, Role: LEADER
I20260709 13:21:27.484572 13863 consensus_queue.cc:260] T f09c2a98de1a4decabd0ff900dd44caa P cd75a17ab2604397adab03bb8b5fd75c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 21.13, Last appended by leader: 13, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:27.486464 13863 raft_consensus.cc:3060] T f09c2a98de1a4decabd0ff900dd44caa P cd75a17ab2604397adab03bb8b5fd75c [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:21:27.472819 13915 leader_election.cc:290] T 9e326172347f45e99a0d482b5d8ef768 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:21:27.476565  6725 raft_consensus.cc:2393] T 1528ab62b6fe4e3099d08f141afee116 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in current term 18: Already voted for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in this term.
I20260709 13:21:27.430013 13447 raft_consensus.cc:515] T b3f13b31a1f84f0d89d007eadd57924c P b7ab4784c7344b939bc36f639286f377 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:21:27.491575 13447 leader_election.cc:290] T b3f13b31a1f84f0d89d007eadd57924c P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:21:27.448936 13826 raft_consensus.cc:2749] T 7a734b5ab7834e05a8c422208acc58b1 P cd75a17ab2604397adab03bb8b5fd75c [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:21:27.428608 13711 raft_consensus.cc:740] T 3411566abe2d4c9bb4b2adfdd05e6f17 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
I20260709 13:21:27.516938  6880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbdf895bba214ff68685a24fd17dfb5d" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 20 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:21:27.517562  6880 raft_consensus.cc:3060] T dbdf895bba214ff68685a24fd17dfb5d P cd75a17ab2604397adab03bb8b5fd75c [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:21:27.517192 13711 consensus_queue.cc:260] T 3411566abe2d4c9bb4b2adfdd05e6f17 P ccd8a4c3bfe3413cb2ae219b09aea832 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 12, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:27.518599 13711 raft_consensus.cc:3060] T 3411566abe2d4c9bb4b2adfdd05e6f17 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:21:27.494067 13588 consensus_queue.cc:1175] T f09c2a98de1a4decabd0ff900dd44caa P cd75a17ab2604397adab03bb8b5fd75c [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" responder_term: 22 status { last_received { term: 20 index: 12 } last_committed_idx: 12 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer cd75a17ab2604397adab03bb8b5fd75c for earlier term 21. Current term is 22. Ops: [21.13-21.13]" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:21:27.496790 13602 leader_election.cc:290] T f3f9c2e2bf644115957398fe4c9459db P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:21:27.498493 13864 leader_election.cc:290] T 90d42e216d9741e190bca19a781291fd P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:21:27.504298 13851 leader_election.cc:290] T d8cee0accdb8499c86d4414b72565a38 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:21:27.505671  7495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8cee0accdb8499c86d4414b72565a38" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:21:27.507849 13774 leader_election.cc:290] T 9b3759de40694069b13c0f8bd40e5709 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:21:27.454766 13856 raft_consensus.cc:515] T 3fa34c08b205435dba97346991aa1f92 P cd75a17ab2604397adab03bb8b5fd75c [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:21:27.438064  6803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5be3a11b23d4ea9b08300a2789821c7" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:21:27.454180 13694 leader_election.cc:290] T f5be3a11b23d4ea9b08300a2789821c7 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 19 election: Requested vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:21:27.525108  6723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90d42e216d9741e190bca19a781291fd" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:21:27.551358  6872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e326172347f45e99a0d482b5d8ef768" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:21:27.553912  6872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5be3a11b23d4ea9b08300a2789821c7" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:21:27.555855  6806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d65025eea89441290d85dd053810e31" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:21:27.557258  6805 raft_consensus.cc:1275] T 7ba5dac66ab5497e9e336f2a3c28cda5 P b7ab4784c7344b939bc36f639286f377 [term 22 FOLLOWER]: Refusing update from remote peer cd75a17ab2604397adab03bb8b5fd75c: Log matching property violated. Preceding OpId in replica: term: 19 index: 14. Preceding OpId from leader: term: 20 index: 15. (index mismatch)
I20260709 13:21:27.558508  6798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4275cf08e63345f993bce8664eada830" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:21:27.559214  6804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a734b5ab7834e05a8c422208acc58b1" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 23 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:21:27.559654  6800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f9c2e2bf644115957398fe4c9459db" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:21:27.560794  6804 raft_consensus.cc:2410] T 7a734b5ab7834e05a8c422208acc58b1 P b7ab4784c7344b939bc36f639286f377 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c for term 23 because replica has last-logged OpId of term: 22 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 19 index: 10.
I20260709 13:21:27.553853  6880 raft_consensus.cc:2468] T dbdf895bba214ff68685a24fd17dfb5d P cd75a17ab2604397adab03bb8b5fd75c [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 20.
I20260709 13:21:27.563222  6881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4b8bd455d5a47c18a1380839c6e0d61" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 21 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:21:27.564831  6881 raft_consensus.cc:3060] T f4b8bd455d5a47c18a1380839c6e0d61 P cd75a17ab2604397adab03bb8b5fd75c [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:21:27.560573  6800 raft_consensus.cc:2468] T f3f9c2e2bf644115957398fe4c9459db P b7ab4784c7344b939bc36f639286f377 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 20.
W20260709 13:21:27.569073  6695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 237190us
I20260709 13:21:27.569146  6803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f03d0dbf16864ca4bc1bb5e4c0334c0f" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:21:27.571262  6695 leader_election.cc:304] T 20f6842e26174571996b8dea4151d4be P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:21:27.565652  6697 leader_election.cc:304] T dbdf895bba214ff68685a24fd17dfb5d P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:21:27.576234  6803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4db81d9d329422bb3b4160ca4ac2d1d" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:21:27.579646  6695 leader_election.cc:304] T be1a92657f494cac8dd227d152f50151 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, b7ab4784c7344b939bc36f639286f377
I20260709 13:21:27.582943  6798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5be3a11b23d4ea9b08300a2789821c7" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:21:27.589239  6804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1528ab62b6fe4e3099d08f141afee116" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:21:27.594465  6798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4b8bd455d5a47c18a1380839c6e0d61" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 21 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:21:27.596012  6800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e326172347f45e99a0d482b5d8ef768" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
W20260709 13:21:27.598052  6696 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:21:27.564393 13207 raft_consensus.cc:493] T f3f9c2e2bf644115957398fe4c9459db P ccd8a4c3bfe3413cb2ae219b09aea832 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:27.605217  6803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d9def8b32fd443aa94ab1420b06837b" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:21:27.607112  6798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a92dd554674067a83a9cb68c4773f2" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:21:27.608929  6803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4b8bd455d5a47c18a1380839c6e0d61" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 21 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:21:27.610714  6804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbdf895bba214ff68685a24fd17dfb5d" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 20 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:21:27.612715  6695 leader_election.cc:304] T f5be3a11b23d4ea9b08300a2789821c7 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:21:27.583108 13887 raft_consensus.cc:2749] T 20f6842e26174571996b8dea4151d4be P ccd8a4c3bfe3413cb2ae219b09aea832 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:21:27.580924 13631 raft_consensus.cc:2749] T be1a92657f494cac8dd227d152f50151 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:21:27.585178 13848 raft_consensus.cc:2804] T dbdf895bba214ff68685a24fd17dfb5d P ccd8a4c3bfe3413cb2ae219b09aea832 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:21:27.614575  6881 raft_consensus.cc:2468] T f4b8bd455d5a47c18a1380839c6e0d61 P cd75a17ab2604397adab03bb8b5fd75c [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 21.
I20260709 13:21:27.614467  6695 leader_election.cc:304] T 9e326172347f45e99a0d482b5d8ef768 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:21:27.611439 13207 raft_consensus.cc:515] T f3f9c2e2bf644115957398fe4c9459db P ccd8a4c3bfe3413cb2ae219b09aea832 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:27.621961 13694 raft_consensus.cc:2749] T f5be3a11b23d4ea9b08300a2789821c7 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:21:27.622605  6697 leader_election.cc:304] T f4b8bd455d5a47c18a1380839c6e0d61 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:21:27.651592  6772 leader_election.cc:304] T 7c44c4849aa54f2b94d1f1bef9ed546f P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:21:27.662487  6874 raft_consensus.cc:1275] T 7c37d41cd9164c15a6826ca62a851a69 P cd75a17ab2604397adab03bb8b5fd75c [term 22 FOLLOWER]: Refusing update from remote peer ccd8a4c3bfe3413cb2ae219b09aea832: Log matching property violated. Preceding OpId in replica: term: 19 index: 14. Preceding OpId from leader: term: 22 index: 15. (index mismatch)
I20260709 13:21:27.666733  6772 leader_election.cc:304] T 3411566abe2d4c9bb4b2adfdd05e6f17 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:21:27.654747  6802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3411566abe2d4c9bb4b2adfdd05e6f17" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:21:27.672186  6803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1704639a875409b9959353527b3fd68" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:21:27.682566  6803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90d42e216d9741e190bca19a781291fd" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:21:27.660611 13848 raft_consensus.cc:697] T dbdf895bba214ff68685a24fd17dfb5d P ccd8a4c3bfe3413cb2ae219b09aea832 [term 20 LEADER]: Becoming Leader. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
W20260709 13:21:27.686717  6695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 72346.7us
I20260709 13:21:27.687392  6772 leader_election.cc:304] T d8292e16e5654be6bc408560cf256aaa P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:21:27.667006 13877 raft_consensus.cc:2804] T f4b8bd455d5a47c18a1380839c6e0d61 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:21:27.682518 13925 raft_consensus.cc:2749] T 7c44c4849aa54f2b94d1f1bef9ed546f P b7ab4784c7344b939bc36f639286f377 [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 13:21:27.690295  6802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8cee0accdb8499c86d4414b72565a38" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:21:27.692864 13723 raft_consensus.cc:515] T f5be3a11b23d4ea9b08300a2789821c7 P cd75a17ab2604397adab03bb8b5fd75c [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:27.725761  6803 raft_consensus.cc:3055] T 7c37d41cd9164c15a6826ca62a851a69 P b7ab4784c7344b939bc36f639286f377 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:21:27.726212  6803 raft_consensus.cc:740] T 7c37d41cd9164c15a6826ca62a851a69 P b7ab4784c7344b939bc36f639286f377 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
I20260709 13:21:27.726979  6803 consensus_queue.cc:260] T 7c37d41cd9164c15a6826ca62a851a69 P b7ab4784c7344b939bc36f639286f377 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 21.15, Last appended by leader: 15, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:27.727834  6803 raft_consensus.cc:3060] T 7c37d41cd9164c15a6826ca62a851a69 P b7ab4784c7344b939bc36f639286f377 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:21:27.729933 13926 raft_consensus.cc:2749] T d8292e16e5654be6bc408560cf256aaa P b7ab4784c7344b939bc36f639286f377 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:21:27.730424 13856 leader_election.cc:290] T 3fa34c08b205435dba97346991aa1f92 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:21:27.732360 13697 raft_consensus.cc:3060] T 7c44c4849aa54f2b94d1f1bef9ed546f P ccd8a4c3bfe3413cb2ae219b09aea832 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:21:27.734366 13877 raft_consensus.cc:697] T f4b8bd455d5a47c18a1380839c6e0d61 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 21 LEADER]: Becoming Leader. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
I20260709 13:21:27.735517 13877 consensus_queue.cc:237] T f4b8bd455d5a47c18a1380839c6e0d61 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 20.10, Last appended by leader: 10, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:27.737900 13295 raft_consensus.cc:3055] T 4d9def8b32fd443aa94ab1420b06837b P b7ab4784c7344b939bc36f639286f377 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:21:27.738363 13295 raft_consensus.cc:740] T 4d9def8b32fd443aa94ab1420b06837b P b7ab4784c7344b939bc36f639286f377 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
I20260709 13:21:27.747195 13207 leader_election.cc:290] T f3f9c2e2bf644115957398fe4c9459db P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:21:27.732455 13711 raft_consensus.cc:493] T 404190ce4ce94cecbfcb6ea9d1dd8626 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:21:27.755303 13711 raft_consensus.cc:515] T 404190ce4ce94cecbfcb6ea9d1dd8626 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:21:27.756484 13848 consensus_queue.cc:237] T dbdf895bba214ff68685a24fd17dfb5d P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 17.8, Last appended by leader: 9, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:27.687161 13447 raft_consensus.cc:2749] T 3411566abe2d4c9bb4b2adfdd05e6f17 P b7ab4784c7344b939bc36f639286f377 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:21:27.766038 13908 log.cc:927] Time spent T 7ba5dac66ab5497e9e336f2a3c28cda5 P cd75a17ab2604397adab03bb8b5fd75c: Append to log took a long time: real 0.460s	user 0.003s	sys 0.000s
I20260709 13:21:27.739259 13295 consensus_queue.cc:260] T 4d9def8b32fd443aa94ab1420b06837b P b7ab4784c7344b939bc36f639286f377 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 21.11, Last appended by leader: 11, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:27.769600 13295 raft_consensus.cc:3060] T 4d9def8b32fd443aa94ab1420b06837b P b7ab4784c7344b939bc36f639286f377 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:21:27.695174 13928 raft_consensus.cc:2749] T 9e326172347f45e99a0d482b5d8ef768 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:21:27.777369  6728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fa34c08b205435dba97346991aa1f92" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 26 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:21:27.779498  7495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fa34c08b205435dba97346991aa1f92" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 26 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:21:27.781031  6806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "404190ce4ce94cecbfcb6ea9d1dd8626" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:21:27.782591  6801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f9c2e2bf644115957398fe4c9459db" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 21 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
W20260709 13:21:27.791707  6772 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 68274.7us
I20260709 13:21:27.792124  6801 raft_consensus.cc:2410] T f3f9c2e2bf644115957398fe4c9459db P b7ab4784c7344b939bc36f639286f377 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ccd8a4c3bfe3413cb2ae219b09aea832 for term 21 because replica has last-logged OpId of term: 19 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 12.
W20260709 13:21:27.793643  6770 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 99257.5us
I20260709 13:21:27.795468 13914 consensus_queue.cc:1059] T bd6869f07b5a4885a0b99fbe60c3b175 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: INVALID_TERM, Last received: 20.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:21:27.801059  6844 leader_election.cc:304] T 3fa34c08b205435dba97346991aa1f92 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:21:27.822755  6803 raft_consensus.cc:1275] T 7c37d41cd9164c15a6826ca62a851a69 P b7ab4784c7344b939bc36f639286f377 [term 22 FOLLOWER]: Refusing update from remote peer ccd8a4c3bfe3413cb2ae219b09aea832: Log matching property violated. Preceding OpId in replica: term: 21 index: 15. Preceding OpId from leader: term: 22 index: 15. (term mismatch)
I20260709 13:21:27.823505  6803 pending_rounds.cc:85] T 7c37d41cd9164c15a6826ca62a851a69 P b7ab4784c7344b939bc36f639286f377: Aborting all ops after (but not including) 14
I20260709 13:21:27.823845  6803 pending_rounds.cc:107] T 7c37d41cd9164c15a6826ca62a851a69 P b7ab4784c7344b939bc36f639286f377: Aborting uncommitted NO_OP operation due to leader change: 21.15
I20260709 13:21:27.824288  6803 raft_consensus.cc:2889] T 7c37d41cd9164c15a6826ca62a851a69 P b7ab4784c7344b939bc36f639286f377 [term 22 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:21:27.823968  6877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f9c2e2bf644115957398fe4c9459db" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 21 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:21:27.825457  6877 raft_consensus.cc:2410] T f3f9c2e2bf644115957398fe4c9459db P cd75a17ab2604397adab03bb8b5fd75c [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ccd8a4c3bfe3413cb2ae219b09aea832 for term 21 because replica has last-logged OpId of term: 19 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 12.
I20260709 13:21:27.791363 13928 raft_consensus.cc:493] T 3a485a995abc4807b6e511e45419f737 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
W20260709 13:21:27.842274  7466 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 233978us
I20260709 13:21:27.817735 13896 raft_consensus.cc:493] T c4db81d9d329422bb3b4160ca4ac2d1d P ccd8a4c3bfe3413cb2ae219b09aea832 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
W20260709 13:21:27.844228  6772 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 43963.2us
I20260709 13:21:27.846058  7466 leader_election.cc:304] T 1528ab62b6fe4e3099d08f141afee116 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:21:27.830435 13865 raft_consensus.cc:2749] T 3fa34c08b205435dba97346991aa1f92 P cd75a17ab2604397adab03bb8b5fd75c [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:21:27.808115 13925 consensus_queue.cc:1048] T dbdf895bba214ff68685a24fd17dfb5d P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.033s
I20260709 13:21:27.840065 13446 raft_consensus.cc:3055] T bd6869f07b5a4885a0b99fbe60c3b175 P b7ab4784c7344b939bc36f639286f377 [term 22 LEADER]: Stepping down as leader of term 22
W20260709 13:21:27.857165 13938 log.cc:927] Time spent T 7a734b5ab7834e05a8c422208acc58b1 P b7ab4784c7344b939bc36f639286f377: Append to log took a long time: real 0.061s	user 0.001s	sys 0.000s
I20260709 13:21:27.858098  6770 leader_election.cc:304] T 1bf4668eeb70467fb3dc5a0289233b3c P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
I20260709 13:21:27.847348  6772 leader_election.cc:304] T de3186201e1a40d0b335eeb8b4e256e0 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:21:27.843370 13928 raft_consensus.cc:515] T 3a485a995abc4807b6e511e45419f737 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:27.861335 13684 consensus_queue.cc:1059] T 4275cf08e63345f993bce8664eada830 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: INVALID_TERM, Last received: 18.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:21:27.849428 13891 raft_consensus.cc:3060] T 1528ab62b6fe4e3099d08f141afee116 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:21:27.861490 13774 consensus_queue.cc:1048] T dbdf895bba214ff68685a24fd17dfb5d P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:21:27.834097 13698 consensus_queue.cc:1048] T 7c37d41cd9164c15a6826ca62a851a69 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.026s
I20260709 13:21:27.892958 13800 consensus_queue.cc:1059] T 1528ab62b6fe4e3099d08f141afee116 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: INVALID_TERM, Last received: 17.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:21:27.893929  6724 raft_consensus.cc:1275] T 34f36d59d88f40fe8a2805e604fc6c0a P ccd8a4c3bfe3413cb2ae219b09aea832 [term 18 FOLLOWER]: Refusing update from remote peer b7ab4784c7344b939bc36f639286f377: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 18 index: 10. (term mismatch)
I20260709 13:21:27.894623  6724 pending_rounds.cc:85] T 34f36d59d88f40fe8a2805e604fc6c0a P ccd8a4c3bfe3413cb2ae219b09aea832: Aborting all ops after (but not including) 9
I20260709 13:21:27.894989  6724 pending_rounds.cc:107] T 34f36d59d88f40fe8a2805e604fc6c0a P ccd8a4c3bfe3413cb2ae219b09aea832: Aborting uncommitted NO_OP operation due to leader change: 17.10
I20260709 13:21:27.895311  6724 raft_consensus.cc:2889] T 34f36d59d88f40fe8a2805e604fc6c0a P ccd8a4c3bfe3413cb2ae219b09aea832 [term 18 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:21:27.898120  6725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e326172347f45e99a0d482b5d8ef768" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:21:27.888527 13707 raft_consensus.cc:3055] T 4275cf08e63345f993bce8664eada830 P b7ab4784c7344b939bc36f639286f377 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:21:27.902127 13707 raft_consensus.cc:740] T 4275cf08e63345f993bce8664eada830 P b7ab4784c7344b939bc36f639286f377 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
I20260709 13:21:27.888118 13670 raft_consensus.cc:2749] T de3186201e1a40d0b335eeb8b4e256e0 P b7ab4784c7344b939bc36f639286f377 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:21:27.860677 13446 raft_consensus.cc:740] T bd6869f07b5a4885a0b99fbe60c3b175 P b7ab4784c7344b939bc36f639286f377 [term 22 LEADER]: Becoming Follower/Learner. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
I20260709 13:21:27.889019 13295 raft_consensus.cc:2804] T 1bf4668eeb70467fb3dc5a0289233b3c P b7ab4784c7344b939bc36f639286f377 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:21:27.903584 13707 consensus_queue.cc:260] T 4275cf08e63345f993bce8664eada830 P b7ab4784c7344b939bc36f639286f377 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.11, Last appended by leader: 11, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:27.904335 13295 raft_consensus.cc:697] T 1bf4668eeb70467fb3dc5a0289233b3c P b7ab4784c7344b939bc36f639286f377 [term 19 LEADER]: Becoming Leader. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
I20260709 13:21:27.904969 13707 raft_consensus.cc:3060] T 4275cf08e63345f993bce8664eada830 P b7ab4784c7344b939bc36f639286f377 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:21:27.905547 13295 consensus_queue.cc:237] T 1bf4668eeb70467fb3dc5a0289233b3c P b7ab4784c7344b939bc36f639286f377 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:27.906072 13926 raft_consensus.cc:3055] T 1528ab62b6fe4e3099d08f141afee116 P b7ab4784c7344b939bc36f639286f377 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:21:27.908931 13926 raft_consensus.cc:740] T 1528ab62b6fe4e3099d08f141afee116 P b7ab4784c7344b939bc36f639286f377 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
I20260709 13:21:27.904270 13446 consensus_queue.cc:260] T bd6869f07b5a4885a0b99fbe60c3b175 P b7ab4784c7344b939bc36f639286f377 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 22.11, Last appended by leader: 11, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:27.909902 13926 consensus_queue.cc:260] T 1528ab62b6fe4e3099d08f141afee116 P b7ab4784c7344b939bc36f639286f377 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:21:27.910919 13446 raft_consensus.cc:3060] T bd6869f07b5a4885a0b99fbe60c3b175 P b7ab4784c7344b939bc36f639286f377 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:21:27.911553 13926 raft_consensus.cc:3060] T 1528ab62b6fe4e3099d08f141afee116 P b7ab4784c7344b939bc36f639286f377 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:21:27.849651 13896 raft_consensus.cc:515] T c4db81d9d329422bb3b4160ca4ac2d1d P ccd8a4c3bfe3413cb2ae219b09aea832 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:27.902174  6730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3f13b31a1f84f0d89d007eadd57924c" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:21:27.914155 13896 leader_election.cc:290] T c4db81d9d329422bb3b4160ca4ac2d1d P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:21:27.859567 13711 leader_election.cc:290] T 404190ce4ce94cecbfcb6ea9d1dd8626 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:21:27.916927  6873 raft_consensus.cc:1240] T f4b8bd455d5a47c18a1380839c6e0d61 P cd75a17ab2604397adab03bb8b5fd75c [term 21 FOLLOWER]: Rejecting Update request from peer b7ab4784c7344b939bc36f639286f377 for earlier term 20. Current term is 21. Ops: []
I20260709 13:21:27.922693  6801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4db81d9d329422bb3b4160ca4ac2d1d" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:21:27.923866  6876 raft_consensus.cc:1275] T 2c240553ce044eedb41541d72b9475d7 P cd75a17ab2604397adab03bb8b5fd75c [term 21 FOLLOWER]: Refusing update from remote peer b7ab4784c7344b939bc36f639286f377: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 21 index: 12. (index mismatch)
I20260709 13:21:27.930876  6730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b3759de40694069b13c0f8bd40e5709" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:21:27.932893  6725 raft_consensus.cc:1240] T 4d9def8b32fd443aa94ab1420b06837b P ccd8a4c3bfe3413cb2ae219b09aea832 [term 22 FOLLOWER]: Rejecting Update request from peer b7ab4784c7344b939bc36f639286f377 for earlier term 21. Current term is 22. Ops: []
I20260709 13:21:27.930898 13723 leader_election.cc:290] T f5be3a11b23d4ea9b08300a2789821c7 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 19 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:21:27.937551  6724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f9c2e2bf644115957398fe4c9459db" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:21:27.938639  6724 raft_consensus.cc:2468] T f3f9c2e2bf644115957398fe4c9459db P ccd8a4c3bfe3413cb2ae219b09aea832 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 20.
I20260709 13:21:27.946774 13891 raft_consensus.cc:2749] T 1528ab62b6fe4e3099d08f141afee116 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:21:27.960611  6881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4db81d9d329422bb3b4160ca4ac2d1d" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:21:27.968360  6879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e326172347f45e99a0d482b5d8ef768" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:21:27.965907  7495 raft_consensus.cc:1240] T 4f00a2e87e56452083b759f60d461ee3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 21 FOLLOWER]: Rejecting Update request from peer b7ab4784c7344b939bc36f639286f377 for earlier term 20. Current term is 21. Ops: []
I20260709 13:21:27.970109  6880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f9c2e2bf644115957398fe4c9459db" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:21:27.971112  6880 raft_consensus.cc:2468] T f3f9c2e2bf644115957398fe4c9459db P cd75a17ab2604397adab03bb8b5fd75c [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 19.
I20260709 13:21:27.966282  6872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a485a995abc4807b6e511e45419f737" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:21:27.966434  7503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3f13b31a1f84f0d89d007eadd57924c" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:21:27.962407  6695 leader_election.cc:304] T f3f9c2e2bf644115957398fe4c9459db P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:21:27.974208  6880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b3759de40694069b13c0f8bd40e5709" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:21:27.976620  6876 raft_consensus.cc:1275] T 34f36d59d88f40fe8a2805e604fc6c0a P cd75a17ab2604397adab03bb8b5fd75c [term 18 FOLLOWER]: Refusing update from remote peer b7ab4784c7344b939bc36f639286f377: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
I20260709 13:21:27.979959  6723 raft_consensus.cc:1275] T 2c240553ce044eedb41541d72b9475d7 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 21 FOLLOWER]: Refusing update from remote peer b7ab4784c7344b939bc36f639286f377: Log matching property violated. Preceding OpId in replica: term: 19 index: 11. Preceding OpId from leader: term: 21 index: 12. (index mismatch)
I20260709 13:21:27.982204  6723 raft_consensus.cc:1240] T dbdf895bba214ff68685a24fd17dfb5d P ccd8a4c3bfe3413cb2ae219b09aea832 [term 20 LEADER]: Rejecting Update request from peer b7ab4784c7344b939bc36f639286f377 for earlier term 19. Current term is 20. Ops: [19.9-19.9]
I20260709 13:21:27.986712  6723 pending_rounds.cc:85] T 853ac0a8cbd64ce99457f170216d4d0f P ccd8a4c3bfe3413cb2ae219b09aea832: Aborting all ops after (but not including) 9
I20260709 13:21:27.987125  6723 pending_rounds.cc:107] T 853ac0a8cbd64ce99457f170216d4d0f P ccd8a4c3bfe3413cb2ae219b09aea832: Aborting uncommitted NO_OP operation due to leader change: 17.10
I20260709 13:21:27.987430  6723 raft_consensus.cc:2889] T 853ac0a8cbd64ce99457f170216d4d0f P ccd8a4c3bfe3413cb2ae219b09aea832 [term 18 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:21:27.992211  6801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a485a995abc4807b6e511e45419f737" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:21:27.990931  6697 leader_election.cc:304] T c4db81d9d329422bb3b4160ca4ac2d1d P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:21:27.996143 13698 raft_consensus.cc:2749] T c4db81d9d329422bb3b4160ca4ac2d1d P ccd8a4c3bfe3413cb2ae219b09aea832 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:21:27.963369 13928 leader_election.cc:290] T 3a485a995abc4807b6e511e45419f737 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
W20260709 13:21:28.004438  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 173758us
I20260709 13:21:28.005285  6695 leader_election.cc:304] T 3a485a995abc4807b6e511e45419f737 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
W20260709 13:21:28.008086  6773 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:21:28.006219  6725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5be3a11b23d4ea9b08300a2789821c7" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:21:28.009037  6770 leader_election.cc:304] T f3f9c2e2bf644115957398fe4c9459db P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
I20260709 13:21:27.993587 13697 raft_consensus.cc:2749] T f3f9c2e2bf644115957398fe4c9459db P ccd8a4c3bfe3413cb2ae219b09aea832 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:21:28.012353  6844 leader_election.cc:304] T de3186201e1a40d0b335eeb8b4e256e0 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:21:28.019507 13661 consensus_queue.cc:1048] T 2c240553ce044eedb41541d72b9475d7 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:21:27.999027 13711 consensus_queue.cc:1048] T 7c37d41cd9164c15a6826ca62a851a69 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.017s
I20260709 13:21:28.025101 13863 raft_consensus.cc:2749] T de3186201e1a40d0b335eeb8b4e256e0 P cd75a17ab2604397adab03bb8b5fd75c [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:21:28.010958 13921 consensus_queue.cc:1048] T 34f36d59d88f40fe8a2805e604fc6c0a P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.014s
I20260709 13:21:28.009616 13896 raft_consensus.cc:2749] T 3a485a995abc4807b6e511e45419f737 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:21:28.032881 13914 raft_consensus.cc:2804] T f3f9c2e2bf644115957398fe4c9459db P b7ab4784c7344b939bc36f639286f377 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:21:28.038195 13914 raft_consensus.cc:493] T f3f9c2e2bf644115957398fe4c9459db P b7ab4784c7344b939bc36f639286f377 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:28.038653 13914 raft_consensus.cc:3060] T f3f9c2e2bf644115957398fe4c9459db P b7ab4784c7344b939bc36f639286f377 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:21:28.060521  6772 leader_election.cc:304] T b3f13b31a1f84f0d89d007eadd57924c P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:21:28.084548  6876 raft_consensus.cc:1240] T f5be3a11b23d4ea9b08300a2789821c7 P cd75a17ab2604397adab03bb8b5fd75c [term 19 FOLLOWER]: Rejecting Update request from peer b7ab4784c7344b939bc36f639286f377 for earlier term 18. Current term is 19. Ops: []
I20260709 13:21:28.087613 13027 raft_consensus.cc:2749] T b3f13b31a1f84f0d89d007eadd57924c P b7ab4784c7344b939bc36f639286f377 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:21:28.089560 13864 consensus_queue.cc:1048] T 7ba5dac66ab5497e9e336f2a3c28cda5 P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:21:28.086920  6844 leader_election.cc:304] T 4275cf08e63345f993bce8664eada830 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
W20260709 13:21:28.095034  6770 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 76584us
I20260709 13:21:28.098932  6844 leader_election.cc:304] T f3f9c2e2bf644115957398fe4c9459db P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:21:28.102964  6844 leader_election.cc:304] T 3d65025eea89441290d85dd053810e31 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:21:28.106247  6844 leader_election.cc:304] T f03d0dbf16864ca4bc1bb5e4c0334c0f P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:21:28.107273  7503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "404190ce4ce94cecbfcb6ea9d1dd8626" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:21:28.113729  6844 leader_election.cc:304] T c4db81d9d329422bb3b4160ca4ac2d1d P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:21:28.109898 13690 raft_consensus.cc:2804] T f3f9c2e2bf644115957398fe4c9459db P cd75a17ab2604397adab03bb8b5fd75c [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:21:28.116300 13856 raft_consensus.cc:2749] T f03d0dbf16864ca4bc1bb5e4c0334c0f P cd75a17ab2604397adab03bb8b5fd75c [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:21:28.116986 13856 raft_consensus.cc:493] T d8292e16e5654be6bc408560cf256aaa P cd75a17ab2604397adab03bb8b5fd75c [term 19 FOLLOWER]: Starting pre-election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:21:28.117442 13856 raft_consensus.cc:515] T d8292e16e5654be6bc408560cf256aaa P cd75a17ab2604397adab03bb8b5fd75c [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:28.119422 13856 leader_election.cc:290] T d8292e16e5654be6bc408560cf256aaa P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:21:28.119890 13856 raft_consensus.cc:493] T 44bde925b2e541b69890d70715b85176 P cd75a17ab2604397adab03bb8b5fd75c [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:28.120339 13856 raft_consensus.cc:515] T 44bde925b2e541b69890d70715b85176 P cd75a17ab2604397adab03bb8b5fd75c [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:28.115285 13707 consensus_queue.cc:1059] T dbdf895bba214ff68685a24fd17dfb5d P b7ab4784c7344b939bc36f639286f377 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: INVALID_TERM, Last received: 17.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.007s
I20260709 13:21:28.122282 13856 leader_election.cc:290] T 44bde925b2e541b69890d70715b85176 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:21:28.091991 13593 consensus_queue.cc:1059] T 4f00a2e87e56452083b759f60d461ee3 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false }, Status: INVALID_TERM, Last received: 20.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.018s
I20260709 13:21:28.134220 13027 consensus_queue.cc:1048] T 2c240553ce044eedb41541d72b9475d7 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:21:28.134873  6772 leader_election.cc:304] T 9b3759de40694069b13c0f8bd40e5709 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:21:28.136340 13027 raft_consensus.cc:2749] T 9b3759de40694069b13c0f8bd40e5709 P b7ab4784c7344b939bc36f639286f377 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:21:28.104141 13946 raft_consensus.cc:3060] T 4275cf08e63345f993bce8664eada830 P cd75a17ab2604397adab03bb8b5fd75c [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:21:28.137897 13554 raft_consensus.cc:493] T 44bde925b2e541b69890d70715b85176 P b7ab4784c7344b939bc36f639286f377 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:21:28.138563 13593 raft_consensus.cc:3055] T 4f00a2e87e56452083b759f60d461ee3 P b7ab4784c7344b939bc36f639286f377 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:21:28.139012 13593 raft_consensus.cc:740] T 4f00a2e87e56452083b759f60d461ee3 P b7ab4784c7344b939bc36f639286f377 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
I20260709 13:21:28.138760 13554 raft_consensus.cc:515] T 44bde925b2e541b69890d70715b85176 P b7ab4784c7344b939bc36f639286f377 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:28.139847 13593 consensus_queue.cc:260] T 4f00a2e87e56452083b759f60d461ee3 P b7ab4784c7344b939bc36f639286f377 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 20.14, Last appended by leader: 14, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:21:28.141160 13593 raft_consensus.cc:3060] T 4f00a2e87e56452083b759f60d461ee3 P b7ab4784c7344b939bc36f639286f377 [term 20 FOLLOWER]: Advancing to term 21
W20260709 13:21:28.165531  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 51883.3us
I20260709 13:21:28.167903  6801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5be3a11b23d4ea9b08300a2789821c7" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:21:28.115880 13690 raft_consensus.cc:493] T f3f9c2e2bf644115957398fe4c9459db P cd75a17ab2604397adab03bb8b5fd75c [term 19 FOLLOWER]: Starting leader election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:21:28.110126 13864 raft_consensus.cc:2749] T 3d65025eea89441290d85dd053810e31 P cd75a17ab2604397adab03bb8b5fd75c [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:21:28.171597 13885 raft_consensus.cc:2749] T c4db81d9d329422bb3b4160ca4ac2d1d P cd75a17ab2604397adab03bb8b5fd75c [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:21:28.175654  6844 leader_election.cc:304] T f4b8bd455d5a47c18a1380839c6e0d61 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
W20260709 13:21:28.176337  7466 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 67501.6us
I20260709 13:21:28.106649 13684 consensus_queue.cc:1059] T f4b8bd455d5a47c18a1380839c6e0d61 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: INVALID_TERM, Last received: 20.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.065s
W20260709 13:21:28.171573 13933 log.cc:927] Time spent T ce4f062dcd314d43a63ca74067cb5ee3 P 7ba59cc884714e8aa5f3f0ecaed84cbb: Append to log took a long time: real 0.062s	user 0.001s	sys 0.000s
I20260709 13:21:28.188839  6697 leader_election.cc:304] T 404190ce4ce94cecbfcb6ea9d1dd8626 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, b7ab4784c7344b939bc36f639286f377
W20260709 13:21:28.199404  6772 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 55429.7us
I20260709 13:21:28.200186  6844 leader_election.cc:304] T 4d9def8b32fd443aa94ab1420b06837b P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:21:28.229791  6844 leader_election.cc:304] T 07a92dd554674067a83a9cb68c4773f2 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:21:28.180104 13690 raft_consensus.cc:3060] T f3f9c2e2bf644115957398fe4c9459db P cd75a17ab2604397adab03bb8b5fd75c [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:21:28.235023  6844 leader_election.cc:304] T 3411566abe2d4c9bb4b2adfdd05e6f17 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
W20260709 13:21:28.236173  6770 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 83650us
W20260709 13:21:28.245831  6772 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 45559.8us
I20260709 13:21:28.243816 13684 raft_consensus.cc:3055] T f4b8bd455d5a47c18a1380839c6e0d61 P b7ab4784c7344b939bc36f639286f377 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:21:28.197858 13885 raft_consensus.cc:493] T bd6869f07b5a4885a0b99fbe60c3b175 P cd75a17ab2604397adab03bb8b5fd75c [term 22 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:21:28.198587 13707 consensus_queue.cc:1243] T dbdf895bba214ff68685a24fd17dfb5d P b7ab4784c7344b939bc36f639286f377 [LEADER]: Peer ccd8a4c3bfe3413cb2ae219b09aea832 log is divergent from this leader: its last log entry 20.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 13:21:28.256906  6772 leader_election.cc:304] T 9e326172347f45e99a0d482b5d8ef768 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:21:28.266654  6844 leader_election.cc:304] T a1704639a875409b9959353527b3fd68 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:21:28.203637 13864 raft_consensus.cc:2749] T f4b8bd455d5a47c18a1380839c6e0d61 P cd75a17ab2604397adab03bb8b5fd75c [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:21:28.234311 13670 consensus_queue.cc:1048] T 34f36d59d88f40fe8a2805e604fc6c0a P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.038s
I20260709 13:21:28.272949  6844 leader_election.cc:304] T d8cee0accdb8499c86d4414b72565a38 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, b7ab4784c7344b939bc36f639286f377
W20260709 13:21:28.277180  6770 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:21:28.277805  6844 leader_election.cc:304] T 90d42e216d9741e190bca19a781291fd P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:21:28.252507 13863 raft_consensus.cc:3060] T 4d9def8b32fd443aa94ab1420b06837b P cd75a17ab2604397adab03bb8b5fd75c [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:21:28.253139 13588 raft_consensus.cc:493] T e31b9971c15848dea59d4d4130141d9e P cd75a17ab2604397adab03bb8b5fd75c [term 17 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:21:28.282771 13886 raft_consensus.cc:2749] T d8cee0accdb8499c86d4414b72565a38 P cd75a17ab2604397adab03bb8b5fd75c [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:21:28.270540 13928 raft_consensus.cc:493] T d8292e16e5654be6bc408560cf256aaa P ccd8a4c3bfe3413cb2ae219b09aea832 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:28.273120 13885 raft_consensus.cc:515] T bd6869f07b5a4885a0b99fbe60c3b175 P cd75a17ab2604397adab03bb8b5fd75c [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:28.279953 13777 raft_consensus.cc:2749] T a1704639a875409b9959353527b3fd68 P cd75a17ab2604397adab03bb8b5fd75c [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:21:28.233670 13711 raft_consensus.cc:493] T 34f36d59d88f40fe8a2805e604fc6c0a P ccd8a4c3bfe3413cb2ae219b09aea832 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:21:28.264810 13684 raft_consensus.cc:740] T f4b8bd455d5a47c18a1380839c6e0d61 P b7ab4784c7344b939bc36f639286f377 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
I20260709 13:21:28.253427 13947 raft_consensus.cc:2749] T 07a92dd554674067a83a9cb68c4773f2 P cd75a17ab2604397adab03bb8b5fd75c [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:21:28.252671 13890 raft_consensus.cc:2749] T 404190ce4ce94cecbfcb6ea9d1dd8626 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:21:27.995355  5625 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:21:28.283177 13723 raft_consensus.cc:2749] T 90d42e216d9741e190bca19a781291fd P cd75a17ab2604397adab03bb8b5fd75c [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:21:28.273242 13865 raft_consensus.cc:2749] T 3411566abe2d4c9bb4b2adfdd05e6f17 P cd75a17ab2604397adab03bb8b5fd75c [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
W20260709 13:21:28.349810 13952 log.cc:927] Time spent T 853ac0a8cbd64ce99457f170216d4d0f P b7ab4784c7344b939bc36f639286f377: Append to log took a long time: real 0.073s	user 0.000s	sys 0.000s
I20260709 13:21:28.336668 13711 raft_consensus.cc:515] T 34f36d59d88f40fe8a2805e604fc6c0a P ccd8a4c3bfe3413cb2ae219b09aea832 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:28.389343 13711 leader_election.cc:290] T 34f36d59d88f40fe8a2805e604fc6c0a P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:21:28.351953 13554 leader_election.cc:290] T 44bde925b2e541b69890d70715b85176 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:21:28.367695 13684 consensus_queue.cc:260] T f4b8bd455d5a47c18a1380839c6e0d61 P b7ab4784c7344b939bc36f639286f377 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 20.10, Last appended by leader: 10, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:28.299422 13602 raft_consensus.cc:2749] T 9e326172347f45e99a0d482b5d8ef768 P b7ab4784c7344b939bc36f639286f377 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:21:28.301394 13631 raft_consensus.cc:493] T d33d5ee8ef6f415593d8df52063161ad P ccd8a4c3bfe3413cb2ae219b09aea832 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:28.301589 13588 raft_consensus.cc:515] T e31b9971c15848dea59d4d4130141d9e P cd75a17ab2604397adab03bb8b5fd75c [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:28.394773 13601 raft_consensus.cc:3055] T dbdf895bba214ff68685a24fd17dfb5d P b7ab4784c7344b939bc36f639286f377 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:21:28.275342 13914 raft_consensus.cc:515] T f3f9c2e2bf644115957398fe4c9459db P b7ab4784c7344b939bc36f639286f377 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:28.406878  6875 raft_consensus.cc:1275] T dbdf895bba214ff68685a24fd17dfb5d P cd75a17ab2604397adab03bb8b5fd75c [term 20 FOLLOWER]: Refusing update from remote peer ccd8a4c3bfe3413cb2ae219b09aea832: Log matching property violated. Preceding OpId in replica: term: 17 index: 8. Preceding OpId from leader: term: 20 index: 9. (index mismatch)
W20260709 13:21:28.410168  6772 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 109461us
I20260709 13:21:28.416405  6801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34f36d59d88f40fe8a2805e604fc6c0a" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:21:28.417160  6873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34f36d59d88f40fe8a2805e604fc6c0a" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:21:28.409403 13652 raft_consensus.cc:493] T f09c2a98de1a4decabd0ff900dd44caa P ccd8a4c3bfe3413cb2ae219b09aea832 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:28.374536 13885 leader_election.cc:290] T bd6869f07b5a4885a0b99fbe60c3b175 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:21:28.327586 13928 raft_consensus.cc:515] T d8292e16e5654be6bc408560cf256aaa P ccd8a4c3bfe3413cb2ae219b09aea832 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:28.430537  6873 raft_consensus.cc:2468] T 34f36d59d88f40fe8a2805e604fc6c0a P cd75a17ab2604397adab03bb8b5fd75c [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 18.
W20260709 13:21:28.440359  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 161070us
I20260709 13:21:28.422996 13601 raft_consensus.cc:740] T dbdf895bba214ff68685a24fd17dfb5d P b7ab4784c7344b939bc36f639286f377 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
I20260709 13:21:28.440524 13652 raft_consensus.cc:515] T f09c2a98de1a4decabd0ff900dd44caa P ccd8a4c3bfe3413cb2ae219b09aea832 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:28.450845  6844 leader_election.cc:304] T f5be3a11b23d4ea9b08300a2789821c7 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:21:28.451388 13863 raft_consensus.cc:2749] T 4d9def8b32fd443aa94ab1420b06837b P cd75a17ab2604397adab03bb8b5fd75c [term 22 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:21:28.424870 13631 raft_consensus.cc:515] T d33d5ee8ef6f415593d8df52063161ad P ccd8a4c3bfe3413cb2ae219b09aea832 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:28.465864 13631 leader_election.cc:290] T d33d5ee8ef6f415593d8df52063161ad P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:21:28.461563 13588 leader_election.cc:290] T e31b9971c15848dea59d4d4130141d9e P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:21:28.461674 13690 raft_consensus.cc:515] T f3f9c2e2bf644115957398fe4c9459db P cd75a17ab2604397adab03bb8b5fd75c [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:28.458524 13947 raft_consensus.cc:2749] T f5be3a11b23d4ea9b08300a2789821c7 P cd75a17ab2604397adab03bb8b5fd75c [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:21:28.472358 13652 leader_election.cc:290] T f09c2a98de1a4decabd0ff900dd44caa P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:21:28.476023 13946 raft_consensus.cc:2749] T 4275cf08e63345f993bce8664eada830 P cd75a17ab2604397adab03bb8b5fd75c [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:21:28.478396 13914 leader_election.cc:290] T f3f9c2e2bf644115957398fe4c9459db P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 21 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:21:28.477278 13928 leader_election.cc:290] T d8292e16e5654be6bc408560cf256aaa P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:21:28.478976 13601 consensus_queue.cc:260] T dbdf895bba214ff68685a24fd17dfb5d P b7ab4784c7344b939bc36f639286f377 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 19.9, Last appended by leader: 9, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:28.481731 13601 raft_consensus.cc:3060] T dbdf895bba214ff68685a24fd17dfb5d P b7ab4784c7344b939bc36f639286f377 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:21:28.478085 13690 leader_election.cc:290] T f3f9c2e2bf644115957398fe4c9459db P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 20 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:21:28.489380 13684 raft_consensus.cc:3060] T f4b8bd455d5a47c18a1380839c6e0d61 P b7ab4784c7344b939bc36f639286f377 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:21:28.553911  6726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44bde925b2e541b69890d70715b85176" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:21:28.594817  6805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e31b9971c15848dea59d4d4130141d9e" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:21:28.586491  6874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09c2a98de1a4decabd0ff900dd44caa" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 23 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:21:28.602427  6874 raft_consensus.cc:2410] T f09c2a98de1a4decabd0ff900dd44caa P cd75a17ab2604397adab03bb8b5fd75c [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ccd8a4c3bfe3413cb2ae219b09aea832 for term 23 because replica has last-logged OpId of term: 21 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 20 index: 12.
I20260709 13:21:28.597338  6697 leader_election.cc:304] T 34f36d59d88f40fe8a2805e604fc6c0a P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:21:28.584843  6875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d33d5ee8ef6f415593d8df52063161ad" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:21:28.604897  6875 raft_consensus.cc:2468] T d33d5ee8ef6f415593d8df52063161ad P cd75a17ab2604397adab03bb8b5fd75c [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 19.
I20260709 13:21:28.585743  6876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8292e16e5654be6bc408560cf256aaa" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:21:28.607291  6876 raft_consensus.cc:2468] T d8292e16e5654be6bc408560cf256aaa P cd75a17ab2604397adab03bb8b5fd75c [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 19.
I20260709 13:21:28.577770  6873 raft_consensus.cc:1275] T f4b8bd455d5a47c18a1380839c6e0d61 P cd75a17ab2604397adab03bb8b5fd75c [term 21 FOLLOWER]: Refusing update from remote peer ccd8a4c3bfe3413cb2ae219b09aea832: Log matching property violated. Preceding OpId in replica: term: 20 index: 10. Preceding OpId from leader: term: 21 index: 11. (index mismatch)
I20260709 13:21:28.613579  6728 raft_consensus.cc:1275] T 1bf4668eeb70467fb3dc5a0289233b3c P ccd8a4c3bfe3413cb2ae219b09aea832 [term 19 FOLLOWER]: Refusing update from remote peer b7ab4784c7344b939bc36f639286f377: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260709 13:21:28.614950  6729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f9c2e2bf644115957398fe4c9459db" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:21:28.615828  6725 raft_consensus.cc:1240] T f4b8bd455d5a47c18a1380839c6e0d61 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 21 LEADER]: Rejecting Update request from peer b7ab4784c7344b939bc36f639286f377 for earlier term 20. Current term is 21. Ops: []
I20260709 13:21:28.616019  6729 raft_consensus.cc:3060] T f3f9c2e2bf644115957398fe4c9459db P ccd8a4c3bfe3413cb2ae219b09aea832 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:21:28.579458  6803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8292e16e5654be6bc408560cf256aaa" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:21:28.556001  6726 raft_consensus.cc:2468] T 44bde925b2e541b69890d70715b85176 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 20.
I20260709 13:21:28.621578  6803 raft_consensus.cc:2393] T d8292e16e5654be6bc408560cf256aaa P b7ab4784c7344b939bc36f639286f377 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c in current term 20: Already voted for candidate b7ab4784c7344b939bc36f639286f377 in this term.
I20260709 13:21:28.581457  6800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6869f07b5a4885a0b99fbe60c3b175" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 23 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:21:28.624922  6697 leader_election.cc:304] T d33d5ee8ef6f415593d8df52063161ad P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:21:28.556874  6727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8292e16e5654be6bc408560cf256aaa" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:21:28.626106  6727 raft_consensus.cc:2468] T d8292e16e5654be6bc408560cf256aaa P ccd8a4c3bfe3413cb2ae219b09aea832 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 20.
W20260709 13:21:28.562604  6772 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 119229us
I20260709 13:21:28.580484  6804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44bde925b2e541b69890d70715b85176" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:21:28.634054  6804 raft_consensus.cc:2468] T 44bde925b2e541b69890d70715b85176 P b7ab4784c7344b939bc36f639286f377 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 19.
I20260709 13:21:28.562182  6802 raft_consensus.cc:1275] T dbdf895bba214ff68685a24fd17dfb5d P b7ab4784c7344b939bc36f639286f377 [term 20 FOLLOWER]: Refusing update from remote peer ccd8a4c3bfe3413cb2ae219b09aea832: Log matching property violated. Preceding OpId in replica: term: 19 index: 9. Preceding OpId from leader: term: 20 index: 9. (term mismatch)
I20260709 13:21:28.635658  6802 pending_rounds.cc:85] T dbdf895bba214ff68685a24fd17dfb5d P b7ab4784c7344b939bc36f639286f377: Aborting all ops after (but not including) 8
I20260709 13:21:28.636065  6802 pending_rounds.cc:107] T dbdf895bba214ff68685a24fd17dfb5d P b7ab4784c7344b939bc36f639286f377: Aborting uncommitted NO_OP operation due to leader change: 19.9
I20260709 13:21:28.636456  6802 raft_consensus.cc:2889] T dbdf895bba214ff68685a24fd17dfb5d P b7ab4784c7344b939bc36f639286f377 [term 20 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:21:28.639156 13579 raft_consensus.cc:493] T 4f00a2e87e56452083b759f60d461ee3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:28.640478 13579 raft_consensus.cc:515] T 4f00a2e87e56452083b759f60d461ee3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:21:28.643669  6806 raft_consensus.cc:1275] T f4b8bd455d5a47c18a1380839c6e0d61 P b7ab4784c7344b939bc36f639286f377 [term 21 FOLLOWER]: Refusing update from remote peer ccd8a4c3bfe3413cb2ae219b09aea832: Log matching property violated. Preceding OpId in replica: term: 20 index: 10. Preceding OpId from leader: term: 21 index: 11. (index mismatch)
I20260709 13:21:28.644655 13579 leader_election.cc:290] T 4f00a2e87e56452083b759f60d461ee3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:21:28.556532  6732 raft_consensus.cc:1240] T f5be3a11b23d4ea9b08300a2789821c7 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 19 FOLLOWER]: Rejecting Update request from peer b7ab4784c7344b939bc36f639286f377 for earlier term 18. Current term is 19. Ops: []
I20260709 13:21:28.645481  6800 raft_consensus.cc:2468] T bd6869f07b5a4885a0b99fbe60c3b175 P b7ab4784c7344b939bc36f639286f377 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 23.
I20260709 13:21:28.650645  6876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f00a2e87e56452083b759f60d461ee3" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:21:28.660856  6805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09c2a98de1a4decabd0ff900dd44caa" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 23 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:21:28.661366 13651 raft_consensus.cc:493] T de3186201e1a40d0b335eeb8b4e256e0 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:28.662389 13651 raft_consensus.cc:515] T de3186201e1a40d0b335eeb8b4e256e0 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:28.664417 13631 raft_consensus.cc:493] T 3d65025eea89441290d85dd053810e31 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:21:28.665374 13631 raft_consensus.cc:515] T 3d65025eea89441290d85dd053810e31 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:28.639561 13295 consensus_queue.cc:1059] T f5be3a11b23d4ea9b08300a2789821c7 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: INVALID_TERM, Last received: 18.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.036s
I20260709 13:21:28.686919 13295 raft_consensus.cc:3055] T f5be3a11b23d4ea9b08300a2789821c7 P b7ab4784c7344b939bc36f639286f377 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:21:28.687546 13295 raft_consensus.cc:740] T f5be3a11b23d4ea9b08300a2789821c7 P b7ab4784c7344b939bc36f639286f377 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
I20260709 13:21:28.672063 13652 raft_consensus.cc:493] T 30e88460611e47b2ba16a46a30b5f416 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
W20260709 13:21:28.680455  6697 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 55808.2us
I20260709 13:21:28.688185 13849 consensus_queue.cc:1048] T dbdf895bba214ff68685a24fd17dfb5d P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.004s
I20260709 13:21:28.691931  6805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8292e16e5654be6bc408560cf256aaa" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:21:28.692507 13890 raft_consensus.cc:2804] T 34f36d59d88f40fe8a2805e604fc6c0a P ccd8a4c3bfe3413cb2ae219b09aea832 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:21:28.693075 13886 raft_consensus.cc:493] T 1bf4668eeb70467fb3dc5a0289233b3c P cd75a17ab2604397adab03bb8b5fd75c [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:28.693327 13946 raft_consensus.cc:493] T 7c44c4849aa54f2b94d1f1bef9ed546f P cd75a17ab2604397adab03bb8b5fd75c [term 21 FOLLOWER]: Starting pre-election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:21:28.694212 13886 raft_consensus.cc:515] T 1bf4668eeb70467fb3dc5a0289233b3c P cd75a17ab2604397adab03bb8b5fd75c [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:28.694317 13946 raft_consensus.cc:515] T 7c44c4849aa54f2b94d1f1bef9ed546f P cd75a17ab2604397adab03bb8b5fd75c [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:28.696188 13651 leader_election.cc:290] T de3186201e1a40d0b335eeb8b4e256e0 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:21:28.696754 13928 raft_consensus.cc:2804] T d33d5ee8ef6f415593d8df52063161ad P ccd8a4c3bfe3413cb2ae219b09aea832 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:21:28.693327 13890 raft_consensus.cc:493] T 34f36d59d88f40fe8a2805e604fc6c0a P ccd8a4c3bfe3413cb2ae219b09aea832 [term 18 FOLLOWER]: Starting leader election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:21:28.700850  6803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d33d5ee8ef6f415593d8df52063161ad" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:21:28.692970  6805 raft_consensus.cc:2468] T d8292e16e5654be6bc408560cf256aaa P b7ab4784c7344b939bc36f639286f377 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 20.
I20260709 13:21:28.720206  6800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f00a2e87e56452083b759f60d461ee3" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:21:28.713498  6874 raft_consensus.cc:1275] T f09c2a98de1a4decabd0ff900dd44caa P cd75a17ab2604397adab03bb8b5fd75c [term 22 FOLLOWER]: Refusing update from remote peer b7ab4784c7344b939bc36f639286f377: Log matching property violated. Preceding OpId in replica: term: 21 index: 13. Preceding OpId from leader: term: 22 index: 13. (term mismatch)
I20260709 13:21:28.702776 13849 raft_consensus.cc:493] T bd6869f07b5a4885a0b99fbe60c3b175 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:28.720737  6728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e31b9971c15848dea59d4d4130141d9e" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:21:28.713300  6730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6869f07b5a4885a0b99fbe60c3b175" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 23 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:21:28.744653  6874 pending_rounds.cc:85] T f09c2a98de1a4decabd0ff900dd44caa P cd75a17ab2604397adab03bb8b5fd75c: Aborting all ops after (but not including) 12
I20260709 13:21:28.750277  6874 pending_rounds.cc:107] T f09c2a98de1a4decabd0ff900dd44caa P cd75a17ab2604397adab03bb8b5fd75c: Aborting uncommitted NO_OP operation due to leader change: 21.13
I20260709 13:21:28.750757  6874 raft_consensus.cc:2889] T f09c2a98de1a4decabd0ff900dd44caa P cd75a17ab2604397adab03bb8b5fd75c [term 22 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:21:28.722602  6725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f9c2e2bf644115957398fe4c9459db" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:21:28.730327  6724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44bde925b2e541b69890d70715b85176" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:21:28.716768  6695 leader_election.cc:304] T f09c2a98de1a4decabd0ff900dd44caa P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:21:28.757679 13849 raft_consensus.cc:515] T bd6869f07b5a4885a0b99fbe60c3b175 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:28.760466  6800 raft_consensus.cc:2468] T 4f00a2e87e56452083b759f60d461ee3 P b7ab4784c7344b939bc36f639286f377 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in term 21.
I20260709 13:21:28.761592 13886 leader_election.cc:290] T 1bf4668eeb70467fb3dc5a0289233b3c P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:21:28.699983 13928 raft_consensus.cc:493] T d33d5ee8ef6f415593d8df52063161ad P ccd8a4c3bfe3413cb2ae219b09aea832 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:28.755290  6724 raft_consensus.cc:2468] T 44bde925b2e541b69890d70715b85176 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 20.
I20260709 13:21:28.767259 13891 raft_consensus.cc:493] T be1a92657f494cac8dd227d152f50151 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 23 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:21:28.768250 13891 raft_consensus.cc:515] T be1a92657f494cac8dd227d152f50151 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:21:28.771656 13891 leader_election.cc:290] T be1a92657f494cac8dd227d152f50151 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:21:28.763082 13295 consensus_queue.cc:260] T f5be3a11b23d4ea9b08300a2789821c7 P b7ab4784c7344b939bc36f639286f377 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:28.779122 13295 raft_consensus.cc:3060] T f5be3a11b23d4ea9b08300a2789821c7 P b7ab4784c7344b939bc36f639286f377 [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:21:28.781358  6770 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 70274.6us
I20260709 13:21:28.784189  6697 leader_election.cc:304] T d8292e16e5654be6bc408560cf256aaa P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
W20260709 13:21:28.785236  6697 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 94089.1us
I20260709 13:21:28.786546 13965 raft_consensus.cc:2804] T d8292e16e5654be6bc408560cf256aaa P ccd8a4c3bfe3413cb2ae219b09aea832 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:21:28.787056 13965 raft_consensus.cc:493] T d8292e16e5654be6bc408560cf256aaa P ccd8a4c3bfe3413cb2ae219b09aea832 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:28.787428 13965 raft_consensus.cc:3060] T d8292e16e5654be6bc408560cf256aaa P ccd8a4c3bfe3413cb2ae219b09aea832 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:21:28.789800  6728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be1a92657f494cac8dd227d152f50151" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
W20260709 13:21:28.790676  6695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 74309.1us
I20260709 13:21:28.794346 13698 raft_consensus.cc:2749] T f09c2a98de1a4decabd0ff900dd44caa P ccd8a4c3bfe3413cb2ae219b09aea832 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
W20260709 13:21:28.783555  6623 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:53224 (request call id 159) took 60244 ms (client timeout 15000 ms). Trace:
I20260709 13:21:28.799981  6874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44bde925b2e541b69890d70715b85176" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:21:28.801092  6874 raft_consensus.cc:2393] T 44bde925b2e541b69890d70715b85176 P cd75a17ab2604397adab03bb8b5fd75c [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7ab4784c7344b939bc36f639286f377 in current term 20: Already voted for candidate cd75a17ab2604397adab03bb8b5fd75c in this term.
I20260709 13:21:28.702621 13941 raft_consensus.cc:493] T 4275cf08e63345f993bce8664eada830 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:28.804920  6729 raft_consensus.cc:2468] T f3f9c2e2bf644115957398fe4c9459db P ccd8a4c3bfe3413cb2ae219b09aea832 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 21.
I20260709 13:21:28.722726 13890 raft_consensus.cc:3060] T 34f36d59d88f40fe8a2805e604fc6c0a P ccd8a4c3bfe3413cb2ae219b09aea832 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:21:28.719120 13631 leader_election.cc:290] T 3d65025eea89441290d85dd053810e31 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:21:28.841959  6730 raft_consensus.cc:2393] T bd6869f07b5a4885a0b99fbe60c3b175 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c in current term 23: Already voted for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in this term.
I20260709 13:21:28.807590 13928 raft_consensus.cc:3060] T d33d5ee8ef6f415593d8df52063161ad P ccd8a4c3bfe3413cb2ae219b09aea832 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:21:28.718614 13651 consensus_queue.cc:1048] T f4b8bd455d5a47c18a1380839c6e0d61 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.128s
I20260709 13:21:28.728901 13652 raft_consensus.cc:515] T 30e88460611e47b2ba16a46a30b5f416 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:28.877815  6874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de3186201e1a40d0b335eeb8b4e256e0" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:21:28.885939 13941 raft_consensus.cc:515] T 4275cf08e63345f993bce8664eada830 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:28.888998 13941 leader_election.cc:290] T 4275cf08e63345f993bce8664eada830 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
W20260709 13:21:28.796375  6623 rpcz_store.cc:269] 0709 13:20:28.538664 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:28.539444 (+   780us) service_pool.cc:224] Handling call
0709 13:21:28.783234 (+60243790us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:21:23.144927 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:21:23.145585 (+   658us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:21:23.145625 (+    40us) write_op.cc:435] Acquired schema lock
0709 13:21:23.145643 (+    18us) tablet.cc:662] Decoding operations
0709 13:21:23.146349 (+   706us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:21:23.146412 (+    63us) write_op.cc:641] Partition lock acquired for write op
0709 13:21:23.146439 (+    27us) tablet.cc:685] Acquiring locks for 5 operations
0709 13:21:23.146983 (+   544us) tablet.cc:701] Row locks acquired
0709 13:21:23.147001 (+    18us) write_op.cc:260] PREPARE: finished
0709 13:21:23.147153 (+   152us) write_op.cc:270] Start()
0709 13:21:23.147291 (+   138us) write_op.cc:276] Timestamp: P: 1783603283147099 usec, L: 0
0709 13:21:23.147310 (+    19us) op_driver.cc:348] REPLICATION: starting
0709 13:21:23.160277 (+ 12967us) log.cc:844] Serialized 2078 byte log entry
0709 13:21:23.755250 (+594973us) op_driver.cc:464] REPLICATION: finished
0709 13:21:24.713722 (+958472us) spinlock_profiling.cc:243] Waited 20.3 ms on lock 0x7b4400022b4c. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0c745db1 00007fcc0c7e3c85 00007fcc0c7e46a2 00007fcc0f5561db 00007fcc0f551aaf 00007fcc0c8a00ac 00007fcc156faab9 00007fcc0c8bc69b 00007fcc0c8ba93f 00007fcc0c8bcc02 00007fcc133e0ef0
0709 13:21:24.931148 (+217426us) write_op.cc:301] APPLY: starting
0709 13:21:24.932881 (+  1733us) tablet.cc:1367] starting BulkCheckPresence
0709 13:21:24.996197 (+ 63316us) tablet.cc:1370] finished BulkCheckPresence
0709 13:21:24.996258 (+    61us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:21:25.113010 (+116752us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:21:25.113230 (+   220us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=10,key_file_lookups=10,delta_file_lookups=10,mrs_lookups=0
0709 13:21:25.113272 (+    42us) write_op.cc:312] APPLY: finished
0709 13:21:25.113517 (+   245us) log.cc:844] Serialized 56 byte log entry
0709 13:21:25.425286 (+311769us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:21:25.441851 (+ 16565us) write_op.cc:454] Released schema lock
0709 13:21:25.454637 (+ 12786us) write_op.cc:341] FINISH: Updating metrics
0709 13:21:25.591103 (+136466us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:21:25.623737 (+ 32634us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":1527573,"reported_tablets":55,"child_traces":[["op",{"apply.queue_time_us":1078092,"apply.run_cpu_time_us":31867,"apply.run_wall_time_us":604864,"cfile_cache_hit":22,"cfile_cache_hit_bytes":25007,"num_ops":5,"prepare.queue_time_us":413826,"prepare.run_cpu_time_us":33831,"prepare.run_wall_time_us":277302,"raft.queue_time_us":153000,"raft.run_cpu_time_us":19633,"raft.run_wall_time_us":1240702,"replication_time_us":517235,"spinlock_wait_cycles":46748928,"thread_start_us":1739881,"threads_started":5,"wal-append.queue_time_us":607790,"wal-append.run_cpu_time_us":20656,"wal-append.run_wall_time_us":2226834}]]}
I20260709 13:21:28.917224  6621 catalog_manager.cc:5697] T 1bf4668eeb70467fb3dc5a0289233b3c P b7ab4784c7344b939bc36f639286f377 reported cstate change: term changed from 13 to 16, leader changed from b7ab4784c7344b939bc36f639286f377 (127.5.126.66) to ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65). New cstate: current_term: 16 leader_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } }
I20260709 13:21:28.921034  6621 catalog_manager.cc:5697] T dbdf895bba214ff68685a24fd17dfb5d P b7ab4784c7344b939bc36f639286f377 reported cstate change: term changed from 6 to 14. New cstate: current_term: 14 leader_uuid: "b7ab4784c7344b939bc36f639286f377" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } health_report { overall_health: HEALTHY } } }
I20260709 13:21:28.924494  6621 catalog_manager.cc:5697] T ab432e62819d499eaaf3dd55481dd930 P b7ab4784c7344b939bc36f639286f377 reported cstate change: term changed from 12 to 17. New cstate: current_term: 17 leader_uuid: "b7ab4784c7344b939bc36f639286f377" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } health_report { overall_health: HEALTHY } } }
I20260709 13:21:28.927284  7466 leader_election.cc:304] T 4f00a2e87e56452083b759f60d461ee3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, b7ab4784c7344b939bc36f639286f377; no voters: cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:21:28.929630 13652 leader_election.cc:290] T 30e88460611e47b2ba16a46a30b5f416 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:21:28.930433 13839 raft_consensus.cc:2804] T 4f00a2e87e56452083b759f60d461ee3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:21:28.930853 13839 raft_consensus.cc:493] T 4f00a2e87e56452083b759f60d461ee3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:28.931185 13839 raft_consensus.cc:3060] T 4f00a2e87e56452083b759f60d461ee3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:21:28.928841  6621 catalog_manager.cc:5697] T 9b3759de40694069b13c0f8bd40e5709 P b7ab4784c7344b939bc36f639286f377 reported cstate change: term changed from 11 to 13. New cstate: current_term: 13 leader_uuid: "b7ab4784c7344b939bc36f639286f377" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } health_report { overall_health: HEALTHY } } }
I20260709 13:21:28.933564 13965 raft_consensus.cc:515] T d8292e16e5654be6bc408560cf256aaa P ccd8a4c3bfe3413cb2ae219b09aea832 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:28.932416  6621 catalog_manager.cc:5697] T 30e88460611e47b2ba16a46a30b5f416 P b7ab4784c7344b939bc36f639286f377 reported cstate change: term changed from 9 to 13. New cstate: current_term: 13 leader_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } }
W20260709 13:21:28.935593 13964 log.cc:927] Time spent T ce4f062dcd314d43a63ca74067cb5ee3 P b7ab4784c7344b939bc36f639286f377: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 13:21:28.936303  6621 catalog_manager.cc:5697] T 07a92dd554674067a83a9cb68c4773f2 P b7ab4784c7344b939bc36f639286f377 reported cstate change: term changed from 12 to 13, leader changed from b7ab4784c7344b939bc36f639286f377 (127.5.126.66) to ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65). New cstate: current_term: 13 leader_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } }
I20260709 13:21:28.937825 13597 consensus_queue.cc:1048] T f4b8bd455d5a47c18a1380839c6e0d61 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:21:28.938165  6621 catalog_manager.cc:5697] T 3a485a995abc4807b6e511e45419f737 P b7ab4784c7344b939bc36f639286f377 reported cstate change: term changed from 12 to 15, leader changed from b7ab4784c7344b939bc36f639286f377 (127.5.126.66) to ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65). New cstate: current_term: 15 leader_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } }
I20260709 13:21:28.939890  6621 catalog_manager.cc:5697] T 7c37d41cd9164c15a6826ca62a851a69 P b7ab4784c7344b939bc36f639286f377 reported cstate change: term changed from 13 to 15. New cstate: current_term: 15 leader_uuid: "b7ab4784c7344b939bc36f639286f377" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } health_report { overall_health: HEALTHY } } }
I20260709 13:21:28.940924  6874 raft_consensus.cc:2468] T de3186201e1a40d0b335eeb8b4e256e0 P cd75a17ab2604397adab03bb8b5fd75c [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 21.
W20260709 13:21:28.942852  6772 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:21:28.946895 13946 leader_election.cc:290] T 7c44c4849aa54f2b94d1f1bef9ed546f P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
W20260709 13:21:28.946911  6770 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 85824.9us
I20260709 13:21:28.959954  6803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be1a92657f494cac8dd227d152f50151" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:21:28.950944  6844 leader_election.cc:304] T 44bde925b2e541b69890d70715b85176 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:21:28.960626 13965 leader_election.cc:290] T d8292e16e5654be6bc408560cf256aaa P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 21 election: Requested vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:21:28.960955 13652 raft_consensus.cc:493] T 7c44c4849aa54f2b94d1f1bef9ed546f P ccd8a4c3bfe3413cb2ae219b09aea832 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:28.988073 13684 consensus_queue.cc:1048] T 1bf4668eeb70467fb3dc5a0289233b3c P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:21:28.988641  6872 raft_consensus.cc:1240] T dbdf895bba214ff68685a24fd17dfb5d P cd75a17ab2604397adab03bb8b5fd75c [term 20 FOLLOWER]: Rejecting Update request from peer b7ab4784c7344b939bc36f639286f377 for earlier term 19. Current term is 20. Ops: [19.9-19.9]
I20260709 13:21:28.990394 13711 raft_consensus.cc:493] T 1528ab62b6fe4e3099d08f141afee116 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:28.991206 13711 raft_consensus.cc:515] T 1528ab62b6fe4e3099d08f141afee116 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:21:28.992180 13698 raft_consensus.cc:493] T 4d9def8b32fd443aa94ab1420b06837b P ccd8a4c3bfe3413cb2ae219b09aea832 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:28.992795 13698 raft_consensus.cc:515] T 4d9def8b32fd443aa94ab1420b06837b P ccd8a4c3bfe3413cb2ae219b09aea832 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:28.994678 13711 leader_election.cc:290] T 1528ab62b6fe4e3099d08f141afee116 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:21:28.995101 13698 leader_election.cc:290] T 4d9def8b32fd443aa94ab1420b06837b P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
W20260709 13:21:29.008319  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 60674.5us
I20260709 13:21:28.996255 13652 raft_consensus.cc:515] T 7c44c4849aa54f2b94d1f1bef9ed546f P ccd8a4c3bfe3413cb2ae219b09aea832 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:29.006515  6697 leader_election.cc:304] T de3186201e1a40d0b335eeb8b4e256e0 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:21:29.011241 13447 raft_consensus.cc:493] T d33d5ee8ef6f415593d8df52063161ad P b7ab4784c7344b939bc36f639286f377 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:21:28.980530 13849 leader_election.cc:290] T bd6869f07b5a4885a0b99fbe60c3b175 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:21:29.015208 13447 raft_consensus.cc:515] T d33d5ee8ef6f415593d8df52063161ad P b7ab4784c7344b939bc36f639286f377 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
W20260709 13:21:29.018009  6771 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:21:29.018707  6881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4275cf08e63345f993bce8664eada830" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 21 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:21:29.019500 13447 leader_election.cc:290] T d33d5ee8ef6f415593d8df52063161ad P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:21:29.020761  6876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f9c2e2bf644115957398fe4c9459db" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:21:29.021548  6876 raft_consensus.cc:3060] T f3f9c2e2bf644115957398fe4c9459db P cd75a17ab2604397adab03bb8b5fd75c [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:21:29.015425 13865 raft_consensus.cc:2804] T 44bde925b2e541b69890d70715b85176 P cd75a17ab2604397adab03bb8b5fd75c [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:21:29.023519 13865 raft_consensus.cc:493] T 44bde925b2e541b69890d70715b85176 P cd75a17ab2604397adab03bb8b5fd75c [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:29.023927 13865 raft_consensus.cc:3060] T 44bde925b2e541b69890d70715b85176 P cd75a17ab2604397adab03bb8b5fd75c [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:21:29.024138  6881 raft_consensus.cc:1275] T 1bf4668eeb70467fb3dc5a0289233b3c P cd75a17ab2604397adab03bb8b5fd75c [term 19 FOLLOWER]: Refusing update from remote peer b7ab4784c7344b939bc36f639286f377: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260709 13:21:29.034845  6874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d65025eea89441290d85dd053810e31" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:21:29.038620  6800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d65025eea89441290d85dd053810e31" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:21:29.039394  6802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6869f07b5a4885a0b99fbe60c3b175" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 24 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:21:29.040875  6802 raft_consensus.cc:2410] T bd6869f07b5a4885a0b99fbe60c3b175 P b7ab4784c7344b939bc36f639286f377 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ccd8a4c3bfe3413cb2ae219b09aea832 for term 24 because replica has last-logged OpId of term: 22 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 20 index: 10.
I20260709 13:21:29.051404  6804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de3186201e1a40d0b335eeb8b4e256e0" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:21:29.051481  7466 leader_election.cc:304] T be1a92657f494cac8dd227d152f50151 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:21:29.022488 13927 consensus_queue.cc:1048] T f09c2a98de1a4decabd0ff900dd44caa P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:21:29.055783  6844 leader_election.cc:304] T d8292e16e5654be6bc408560cf256aaa P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:21:29.047045 13651 raft_consensus.cc:2804] T de3186201e1a40d0b335eeb8b4e256e0 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 21 FOLLOWER]: Leader pre-election won for term 22
W20260709 13:21:29.078595  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 48928.6us
I20260709 13:21:29.050212 13941 consensus_queue.cc:1048] T dbdf895bba214ff68685a24fd17dfb5d P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.026s
I20260709 13:21:29.083204 13886 raft_consensus.cc:2804] T d8292e16e5654be6bc408560cf256aaa P cd75a17ab2604397adab03bb8b5fd75c [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:21:29.097226  6879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d33d5ee8ef6f415593d8df52063161ad" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:21:29.069895 13579 raft_consensus.cc:2749] T be1a92657f494cac8dd227d152f50151 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:21:29.073750 13651 raft_consensus.cc:493] T de3186201e1a40d0b335eeb8b4e256e0 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:28.955987  6621 catalog_manager.cc:5697] T 3411566abe2d4c9bb4b2adfdd05e6f17 P b7ab4784c7344b939bc36f639286f377 reported cstate change: term changed from 8 to 13, leader changed from b7ab4784c7344b939bc36f639286f377 (127.5.126.66) to ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65). New cstate: current_term: 13 leader_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } }
I20260709 13:21:29.100169  6804 raft_consensus.cc:2468] T de3186201e1a40d0b335eeb8b4e256e0 P b7ab4784c7344b939bc36f639286f377 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 21.
I20260709 13:21:29.088327  6805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4275cf08e63345f993bce8664eada830" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 21 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:21:29.101385  6875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8292e16e5654be6bc408560cf256aaa" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:21:29.110347  6879 raft_consensus.cc:2393] T d33d5ee8ef6f415593d8df52063161ad P cd75a17ab2604397adab03bb8b5fd75c [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7ab4784c7344b939bc36f639286f377 in current term 19: Already voted for candidate cd75a17ab2604397adab03bb8b5fd75c in this term.
I20260709 13:21:29.107857 13651 raft_consensus.cc:3060] T de3186201e1a40d0b335eeb8b4e256e0 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:21:29.111984  6803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8292e16e5654be6bc408560cf256aaa" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:21:29.104990 13886 raft_consensus.cc:493] T d8292e16e5654be6bc408560cf256aaa P cd75a17ab2604397adab03bb8b5fd75c [term 19 FOLLOWER]: Starting leader election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:21:29.119179  6803 raft_consensus.cc:3060] T d8292e16e5654be6bc408560cf256aaa P b7ab4784c7344b939bc36f639286f377 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:21:29.110294 13447 raft_consensus.cc:493] T 4d9def8b32fd443aa94ab1420b06837b P b7ab4784c7344b939bc36f639286f377 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:29.124552  6799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30e88460611e47b2ba16a46a30b5f416" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:21:29.125221  6800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d9def8b32fd443aa94ab1420b06837b" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 23 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:21:29.120770 13886 raft_consensus.cc:3060] T d8292e16e5654be6bc408560cf256aaa P cd75a17ab2604397adab03bb8b5fd75c [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:21:29.132587  6805 raft_consensus.cc:2410] T 4275cf08e63345f993bce8664eada830 P b7ab4784c7344b939bc36f639286f377 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ccd8a4c3bfe3413cb2ae219b09aea832 for term 21 because replica has last-logged OpId of term: 19 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 10.
I20260709 13:21:29.133809 13926 consensus_queue.cc:1048] T 1bf4668eeb70467fb3dc5a0289233b3c P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.088s
I20260709 13:21:29.134080 13652 leader_election.cc:290] T 7c44c4849aa54f2b94d1f1bef9ed546f P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:21:29.145116  6879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6869f07b5a4885a0b99fbe60c3b175" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 24 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:21:29.145289  6804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1528ab62b6fe4e3099d08f141afee116" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:21:29.141911  6878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30e88460611e47b2ba16a46a30b5f416" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:21:29.142021  7499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1528ab62b6fe4e3099d08f141afee116" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:21:29.157564  6621 catalog_manager.cc:5697] T 713b5728a197487c9300b310ab94e5a3 P b7ab4784c7344b939bc36f639286f377 reported cstate change: term changed from 12 to 14, leader changed from ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65) to b7ab4784c7344b939bc36f639286f377 (127.5.126.66). New cstate: current_term: 14 leader_uuid: "b7ab4784c7344b939bc36f639286f377" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } health_report { overall_health: HEALTHY } } }
I20260709 13:21:29.140362 13447 raft_consensus.cc:515] T 4d9def8b32fd443aa94ab1420b06837b P b7ab4784c7344b939bc36f639286f377 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:29.246641  6800 raft_consensus.cc:2468] T 4d9def8b32fd443aa94ab1420b06837b P b7ab4784c7344b939bc36f639286f377 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 22.
I20260709 13:21:29.247840 13447 leader_election.cc:290] T 4d9def8b32fd443aa94ab1420b06837b P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:21:29.250312  6804 raft_consensus.cc:2468] T 1528ab62b6fe4e3099d08f141afee116 P b7ab4784c7344b939bc36f639286f377 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 18.
I20260709 13:21:29.252086  7499 raft_consensus.cc:2468] T 1528ab62b6fe4e3099d08f141afee116 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 18.
I20260709 13:21:29.253938  6879 raft_consensus.cc:2410] T bd6869f07b5a4885a0b99fbe60c3b175 P cd75a17ab2604397adab03bb8b5fd75c [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ccd8a4c3bfe3413cb2ae219b09aea832 for term 24 because replica has last-logged OpId of term: 22 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 20 index: 10.
I20260709 13:21:29.255048  6879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c44c4849aa54f2b94d1f1bef9ed546f" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 23 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:21:29.255712  6879 raft_consensus.cc:2468] T 7c44c4849aa54f2b94d1f1bef9ed546f P cd75a17ab2604397adab03bb8b5fd75c [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 21.
W20260709 13:21:29.261785  6772 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 116397us
W20260709 13:21:29.269732  7466 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 178477us
I20260709 13:21:29.268805  6881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d9def8b32fd443aa94ab1420b06837b" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 23 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:21:29.264972  6770 leader_election.cc:304] T 44bde925b2e541b69890d70715b85176 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: cd75a17ab2604397adab03bb8b5fd75c
W20260709 13:21:29.265010  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 115620us
I20260709 13:21:29.279544  6876 raft_consensus.cc:2468] T f3f9c2e2bf644115957398fe4c9459db P cd75a17ab2604397adab03bb8b5fd75c [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 21.
I20260709 13:21:29.255811 13865 raft_consensus.cc:515] T 44bde925b2e541b69890d70715b85176 P cd75a17ab2604397adab03bb8b5fd75c [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:29.271806 13652 raft_consensus.cc:493] T ce4f062dcd314d43a63ca74067cb5ee3 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
W20260709 13:21:29.284993 13295 consensus_meta.cc:287] T f5be3a11b23d4ea9b08300a2789821c7 P b7ab4784c7344b939bc36f639286f377: Time spent flushing consensus metadata: real 0.505s	user 0.006s	sys 0.009s
I20260709 13:21:29.326378  6805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c44c4849aa54f2b94d1f1bef9ed546f" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 23 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:21:29.327385  6805 raft_consensus.cc:2468] T 7c44c4849aa54f2b94d1f1bef9ed546f P b7ab4784c7344b939bc36f639286f377 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 22.
I20260709 13:21:29.335450 13966 raft_consensus.cc:2804] T 44bde925b2e541b69890d70715b85176 P b7ab4784c7344b939bc36f639286f377 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:21:29.336203 13966 raft_consensus.cc:493] T 44bde925b2e541b69890d70715b85176 P b7ab4784c7344b939bc36f639286f377 [term 19 FOLLOWER]: Starting leader election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:21:29.336676 13966 raft_consensus.cc:3060] T 44bde925b2e541b69890d70715b85176 P b7ab4784c7344b939bc36f639286f377 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:21:29.343286 13652 raft_consensus.cc:515] T ce4f062dcd314d43a63ca74067cb5ee3 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } attrs { replace: true } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:21:29.347975 13652 leader_election.cc:290] T ce4f062dcd314d43a63ca74067cb5ee3 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:21:29.358686  6880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d9def8b32fd443aa94ab1420b06837b" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 23 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
W20260709 13:21:29.349550 13971 log.cc:927] Time spent T 7ba5dac66ab5497e9e336f2a3c28cda5 P b7ab4784c7344b939bc36f639286f377: Append to log took a long time: real 0.207s	user 0.004s	sys 0.000s
W20260709 13:21:29.364295  6695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 83199.1us
W20260709 13:21:29.363247  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 52801.9us
I20260709 13:21:29.375172  6697 leader_election.cc:304] T 7c44c4849aa54f2b94d1f1bef9ed546f P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:21:29.396346  6621 catalog_manager.cc:5697] T 853ac0a8cbd64ce99457f170216d4d0f P b7ab4784c7344b939bc36f639286f377 reported cstate change: term changed from 2 to 14. New cstate: current_term: 14 leader_uuid: "b7ab4784c7344b939bc36f639286f377" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } health_report { overall_health: HEALTHY } } }
I20260709 13:21:29.405323  6726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c44c4849aa54f2b94d1f1bef9ed546f" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:21:29.406726  6729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bf4668eeb70467fb3dc5a0289233b3c" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 20 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
W20260709 13:21:29.408321  6770 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 170768us
I20260709 13:21:29.409022  6729 raft_consensus.cc:2468] T 1bf4668eeb70467fb3dc5a0289233b3c P ccd8a4c3bfe3413cb2ae219b09aea832 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 19.
I20260709 13:21:29.409382  6770 leader_election.cc:304] T f3f9c2e2bf644115957398fe4c9459db P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
I20260709 13:21:29.410522 13593 raft_consensus.cc:2804] T f3f9c2e2bf644115957398fe4c9459db P b7ab4784c7344b939bc36f639286f377 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:21:29.411141 13593 raft_consensus.cc:697] T f3f9c2e2bf644115957398fe4c9459db P b7ab4784c7344b939bc36f639286f377 [term 21 LEADER]: Becoming Leader. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
I20260709 13:21:29.412781  6806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f9c2e2bf644115957398fe4c9459db" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:21:29.412540 13593 consensus_queue.cc:237] T f3f9c2e2bf644115957398fe4c9459db P b7ab4784c7344b939bc36f639286f377 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 19.13, Last appended by leader: 13, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:29.418311  6621 catalog_manager.cc:5697] T c4db81d9d329422bb3b4160ca4ac2d1d P b7ab4784c7344b939bc36f639286f377 reported cstate change: term changed from 12 to 15. New cstate: current_term: 15 leader_uuid: "b7ab4784c7344b939bc36f639286f377" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } health_report { overall_health: HEALTHY } } }
W20260709 13:21:29.423684 13976 log.cc:927] Time spent T dbdf895bba214ff68685a24fd17dfb5d P cd75a17ab2604397adab03bb8b5fd75c: Append to log took a long time: real 0.281s	user 0.000s	sys 0.010s
I20260709 13:21:29.441113  6695 leader_election.cc:304] T bd6869f07b5a4885a0b99fbe60c3b175 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:21:29.422493  6621 catalog_manager.cc:5697] T 34f36d59d88f40fe8a2805e604fc6c0a P b7ab4784c7344b939bc36f639286f377 reported cstate change: term changed from 7 to 14. New cstate: current_term: 14 leader_uuid: "b7ab4784c7344b939bc36f639286f377" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:29.446529  6621 catalog_manager.cc:5697] T 2c240553ce044eedb41541d72b9475d7 P b7ab4784c7344b939bc36f639286f377 reported cstate change: term changed from 12 to 17, leader changed from ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65) to b7ab4784c7344b939bc36f639286f377 (127.5.126.66). New cstate: current_term: 17 leader_uuid: "b7ab4784c7344b939bc36f639286f377" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } health_report { overall_health: HEALTHY } } }
I20260709 13:21:29.368491 13928 raft_consensus.cc:515] T d33d5ee8ef6f415593d8df52063161ad P ccd8a4c3bfe3413cb2ae219b09aea832 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:29.399914 13652 raft_consensus.cc:2804] T 7c44c4849aa54f2b94d1f1bef9ed546f P ccd8a4c3bfe3413cb2ae219b09aea832 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:21:29.459477  6726 raft_consensus.cc:2468] T 7c44c4849aa54f2b94d1f1bef9ed546f P ccd8a4c3bfe3413cb2ae219b09aea832 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 22.
I20260709 13:21:29.466763  7499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce4f062dcd314d43a63ca74067cb5ee3" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:21:29.470646  6807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c44c4849aa54f2b94d1f1bef9ed546f" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:21:29.471732  6807 raft_consensus.cc:2393] T 7c44c4849aa54f2b94d1f1bef9ed546f P b7ab4784c7344b939bc36f639286f377 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c in current term 22: Already voted for candidate b7ab4784c7344b939bc36f639286f377 in this term.
I20260709 13:21:29.476374 13886 raft_consensus.cc:515] T d8292e16e5654be6bc408560cf256aaa P cd75a17ab2604397adab03bb8b5fd75c [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:29.477663  6875 raft_consensus.cc:3060] T d8292e16e5654be6bc408560cf256aaa P cd75a17ab2604397adab03bb8b5fd75c [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:21:29.478662 13651 raft_consensus.cc:515] T de3186201e1a40d0b335eeb8b4e256e0 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:29.479720  6727 raft_consensus.cc:1275] T f09c2a98de1a4decabd0ff900dd44caa P ccd8a4c3bfe3413cb2ae219b09aea832 [term 22 FOLLOWER]: Refusing update from remote peer b7ab4784c7344b939bc36f639286f377: Log matching property violated. Preceding OpId in replica: term: 20 index: 12. Preceding OpId from leader: term: 22 index: 13. (index mismatch)
W20260709 13:21:29.497676  6695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 56667.2us
I20260709 13:21:29.495924  6873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce4f062dcd314d43a63ca74067cb5ee3" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:21:29.499593  6695 leader_election.cc:304] T 3d65025eea89441290d85dd053810e31 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:21:29.497277  6844 leader_election.cc:304] T e31b9971c15848dea59d4d4130141d9e P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:21:29.498944  6697 leader_election.cc:304] T 1528ab62b6fe4e3099d08f141afee116 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
I20260709 13:21:29.484556 13652 raft_consensus.cc:493] T 7c44c4849aa54f2b94d1f1bef9ed546f P ccd8a4c3bfe3413cb2ae219b09aea832 [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:29.433727 13839 raft_consensus.cc:515] T 4f00a2e87e56452083b759f60d461ee3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 22 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:21:29.530068  6728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d33d5ee8ef6f415593d8df52063161ad" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:21:29.541800  6728 raft_consensus.cc:2368] T d33d5ee8ef6f415593d8df52063161ad P ccd8a4c3bfe3413cb2ae219b09aea832 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7ab4784c7344b939bc36f639286f377 for earlier term 19. Current term is 20.
I20260709 13:21:29.504462 13965 raft_consensus.cc:2749] T 3d65025eea89441290d85dd053810e31 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 13:21:29.530229 13890 consensus_meta.cc:287] T 34f36d59d88f40fe8a2805e604fc6c0a P ccd8a4c3bfe3413cb2ae219b09aea832: Time spent flushing consensus metadata: real 0.653s	user 0.000s	sys 0.014s
I20260709 13:21:29.526985 13652 raft_consensus.cc:3060] T 7c44c4849aa54f2b94d1f1bef9ed546f P ccd8a4c3bfe3413cb2ae219b09aea832 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:21:29.549855  6695 leader_election.cc:304] T 4275cf08e63345f993bce8664eada830 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:21:29.558468  6728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d9def8b32fd443aa94ab1420b06837b" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 23 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:21:29.559262  6728 raft_consensus.cc:2468] T 4d9def8b32fd443aa94ab1420b06837b P ccd8a4c3bfe3413cb2ae219b09aea832 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 22.
I20260709 13:21:29.559495 13849 raft_consensus.cc:493] T 713b5728a197487c9300b310ab94e5a3 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader cd75a17ab2604397adab03bb8b5fd75c)
I20260709 13:21:29.560518 13849 raft_consensus.cc:515] T 713b5728a197487c9300b310ab94e5a3 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:29.563575 13849 leader_election.cc:290] T 713b5728a197487c9300b310ab94e5a3 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:21:29.564309 13896 raft_consensus.cc:2749] T bd6869f07b5a4885a0b99fbe60c3b175 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:21:29.564713  6798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bf4668eeb70467fb3dc5a0289233b3c" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 20 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:21:29.565013 13928 leader_election.cc:290] T d33d5ee8ef6f415593d8df52063161ad P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 20 election: Requested vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:21:29.556445 13890 raft_consensus.cc:515] T 34f36d59d88f40fe8a2805e604fc6c0a P ccd8a4c3bfe3413cb2ae219b09aea832 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:29.542815 13631 raft_consensus.cc:2804] T 1528ab62b6fe4e3099d08f141afee116 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:21:29.560273 13856 raft_consensus.cc:2749] T e31b9971c15848dea59d4d4130141d9e P cd75a17ab2604397adab03bb8b5fd75c [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:21:29.581625  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 93016.3us
I20260709 13:21:29.587610  6803 raft_consensus.cc:2468] T d8292e16e5654be6bc408560cf256aaa P b7ab4784c7344b939bc36f639286f377 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 21.
I20260709 13:21:29.565578 13698 raft_consensus.cc:2749] T 4275cf08e63345f993bce8664eada830 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:21:29.565186 13697 raft_consensus.cc:493] T f5be3a11b23d4ea9b08300a2789821c7 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:29.580389 13631 raft_consensus.cc:493] T 1528ab62b6fe4e3099d08f141afee116 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:29.597404  6730 raft_consensus.cc:1240] T 34f36d59d88f40fe8a2805e604fc6c0a P ccd8a4c3bfe3413cb2ae219b09aea832 [term 19 FOLLOWER]: Rejecting Update request from peer b7ab4784c7344b939bc36f639286f377 for earlier term 18. Current term is 19. Ops: []
I20260709 13:21:29.603940 13631 raft_consensus.cc:3060] T 1528ab62b6fe4e3099d08f141afee116 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:21:29.604244 13697 raft_consensus.cc:515] T f5be3a11b23d4ea9b08300a2789821c7 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:29.606595 13697 leader_election.cc:290] T f5be3a11b23d4ea9b08300a2789821c7 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:21:29.603204  6621 catalog_manager.cc:5697] T f5be3a11b23d4ea9b08300a2789821c7 P b7ab4784c7344b939bc36f639286f377 reported cstate change: term changed from 11 to 14, leader changed from b7ab4784c7344b939bc36f639286f377 (127.5.126.66) to ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65). New cstate: current_term: 14 leader_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } }
I20260709 13:21:29.614403  6621 catalog_manager.cc:5697] T 9e326172347f45e99a0d482b5d8ef768 P b7ab4784c7344b939bc36f639286f377 reported cstate change: term changed from 10 to 12. New cstate: current_term: 12 leader_uuid: "b7ab4784c7344b939bc36f639286f377" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } health_report { overall_health: HEALTHY } } }
I20260709 13:21:29.590166 13865 leader_election.cc:290] T 44bde925b2e541b69890d70715b85176 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 21 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:21:29.617372 13966 raft_consensus.cc:515] T 44bde925b2e541b69890d70715b85176 P b7ab4784c7344b939bc36f639286f377 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:29.633606  6621 catalog_manager.cc:5697] T 22ccee1b570c4ad3a57bd7aec085b1b4 P b7ab4784c7344b939bc36f639286f377 reported cstate change: term changed from 6 to 14. New cstate: current_term: 14 leader_uuid: "b7ab4784c7344b939bc36f639286f377" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:29.620576 13886 leader_election.cc:290] T d8292e16e5654be6bc408560cf256aaa P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 20 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:21:29.619753  6844 leader_election.cc:304] T bd6869f07b5a4885a0b99fbe60c3b175 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:21:29.649554  6875 raft_consensus.cc:2468] T d8292e16e5654be6bc408560cf256aaa P cd75a17ab2604397adab03bb8b5fd75c [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 21.
I20260709 13:21:29.591418 13651 leader_election.cc:290] T de3186201e1a40d0b335eeb8b4e256e0 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 22 election: Requested vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:21:29.653622 13886 raft_consensus.cc:2804] T bd6869f07b5a4885a0b99fbe60c3b175 P cd75a17ab2604397adab03bb8b5fd75c [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:21:29.654098 13886 raft_consensus.cc:493] T bd6869f07b5a4885a0b99fbe60c3b175 P cd75a17ab2604397adab03bb8b5fd75c [term 22 FOLLOWER]: Starting leader election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:21:29.658564 13886 raft_consensus.cc:3060] T bd6869f07b5a4885a0b99fbe60c3b175 P cd75a17ab2604397adab03bb8b5fd75c [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:21:29.659902 13890 leader_election.cc:290] T 34f36d59d88f40fe8a2805e604fc6c0a P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 19 election: Requested vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:21:29.660192 13865 raft_consensus.cc:493] T 4f00a2e87e56452083b759f60d461ee3 P cd75a17ab2604397adab03bb8b5fd75c [term 20 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:21:29.661126 13865 raft_consensus.cc:515] T 4f00a2e87e56452083b759f60d461ee3 P cd75a17ab2604397adab03bb8b5fd75c [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
W20260709 13:21:29.674005 13979 log.cc:927] Time spent T f4b8bd455d5a47c18a1380839c6e0d61 P cd75a17ab2604397adab03bb8b5fd75c: Append to log took a long time: real 0.266s	user 0.003s	sys 0.000s
I20260709 13:21:29.693249 13839 leader_election.cc:290] T 4f00a2e87e56452083b759f60d461ee3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 22 election: Requested vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:21:29.693470 13631 raft_consensus.cc:515] T 1528ab62b6fe4e3099d08f141afee116 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
W20260709 13:21:29.694975  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 75286.9us
I20260709 13:21:29.696148 13865 leader_election.cc:290] T 4f00a2e87e56452083b759f60d461ee3 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:21:29.642800  6621 catalog_manager.cc:5697] T 7887766dc6784fcaa42b35c05fea7a99 P b7ab4784c7344b939bc36f639286f377 reported cstate change: term changed from 13 to 16, leader changed from b7ab4784c7344b939bc36f639286f377 (127.5.126.66) to ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65). New cstate: current_term: 16 leader_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } }
W20260709 13:21:29.706910  6697 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.68:45071, user_credentials={real_user=slave}} blocked reactor thread for 208026us
I20260709 13:21:29.717154  6844 leader_election.cc:304] T f3f9c2e2bf644115957398fe4c9459db P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:21:29.745144  6802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f00a2e87e56452083b759f60d461ee3" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:21:29.748750  6802 raft_consensus.cc:3060] T 4f00a2e87e56452083b759f60d461ee3 P b7ab4784c7344b939bc36f639286f377 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:21:29.755426  6873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "713b5728a197487c9300b310ab94e5a3" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:21:29.757004  6878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d33d5ee8ef6f415593d8df52063161ad" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:21:29.757604  6878 raft_consensus.cc:3060] T d33d5ee8ef6f415593d8df52063161ad P cd75a17ab2604397adab03bb8b5fd75c [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:21:29.764130  6876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34f36d59d88f40fe8a2805e604fc6c0a" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
W20260709 13:21:29.764377  6695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 214576us
I20260709 13:21:29.771888  6695 leader_election.cc:304] T 30e88460611e47b2ba16a46a30b5f416 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:21:29.751988 13946 raft_consensus.cc:2749] T f3f9c2e2bf644115957398fe4c9459db P cd75a17ab2604397adab03bb8b5fd75c [term 21 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:21:29.776253  6880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de3186201e1a40d0b335eeb8b4e256e0" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:21:29.777268  6880 raft_consensus.cc:3060] T de3186201e1a40d0b335eeb8b4e256e0 P cd75a17ab2604397adab03bb8b5fd75c [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:21:29.763782  6697 leader_election.cc:304] T ce4f062dcd314d43a63ca74067cb5ee3 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:21:29.751274 13631 leader_election.cc:290] T 1528ab62b6fe4e3099d08f141afee116 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 19 election: Requested vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
W20260709 13:21:29.779222  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 62198.1us
W20260709 13:21:29.769321 13983 log.cc:927] Time spent T 9e326172347f45e99a0d482b5d8ef768 P b7ab4784c7344b939bc36f639286f377: Append to log took a long time: real 0.068s	user 0.000s	sys 0.001s
I20260709 13:21:29.784526  6873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5be3a11b23d4ea9b08300a2789821c7" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:21:29.785264  6873 raft_consensus.cc:2468] T f5be3a11b23d4ea9b08300a2789821c7 P cd75a17ab2604397adab03bb8b5fd75c [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 19.
I20260709 13:21:29.791445  7496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f00a2e87e56452083b759f60d461ee3" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:21:29.802194  7496 raft_consensus.cc:2368] T 4f00a2e87e56452083b759f60d461ee3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c for earlier term 21. Current term is 22.
I20260709 13:21:29.806146 13941 raft_consensus.cc:2749] T 30e88460611e47b2ba16a46a30b5f416 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:21:29.808284  6881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44bde925b2e541b69890d70715b85176" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:21:29.809068  6881 raft_consensus.cc:2368] T 44bde925b2e541b69890d70715b85176 P cd75a17ab2604397adab03bb8b5fd75c [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate b7ab4784c7344b939bc36f639286f377 for earlier term 20. Current term is 21.
I20260709 13:21:29.812314 13631 raft_consensus.cc:2749] T ce4f062dcd314d43a63ca74067cb5ee3 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:21:29.814545 13886 raft_consensus.cc:515] T bd6869f07b5a4885a0b99fbe60c3b175 P cd75a17ab2604397adab03bb8b5fd75c [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
W20260709 13:21:29.816726 13982 log.cc:927] Time spent T f09c2a98de1a4decabd0ff900dd44caa P cd75a17ab2604397adab03bb8b5fd75c: Append to log took a long time: real 0.056s	user 0.000s	sys 0.001s
I20260709 13:21:29.817266 13927 raft_consensus.cc:493] T 4275cf08e63345f993bce8664eada830 P b7ab4784c7344b939bc36f639286f377 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:29.817857 13927 raft_consensus.cc:515] T 4275cf08e63345f993bce8664eada830 P b7ab4784c7344b939bc36f639286f377 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:29.827257 13966 leader_election.cc:290] T 44bde925b2e541b69890d70715b85176 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 20 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:21:29.828025 13966 raft_consensus.cc:493] T 3411566abe2d4c9bb4b2adfdd05e6f17 P b7ab4784c7344b939bc36f639286f377 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:21:29.832778 13966 raft_consensus.cc:515] T 3411566abe2d4c9bb4b2adfdd05e6f17 P b7ab4784c7344b939bc36f639286f377 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:29.791445  6799 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1bf4668eeb70467fb3dc5a0289233b3c"
dest_uuid: "b7ab4784c7344b939bc36f639286f377"
mode: GRACEFUL
new_leader_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
 from {username='slave'} at 127.0.0.1:38240
I20260709 13:21:29.834686  6799 raft_consensus.cc:606] T 1bf4668eeb70467fb3dc5a0289233b3c P b7ab4784c7344b939bc36f639286f377 [term 19 LEADER]: Received request to transfer leadership to TS cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:21:29.831951  6730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44bde925b2e541b69890d70715b85176" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:21:29.839346 13927 leader_election.cc:290] T 4275cf08e63345f993bce8664eada830 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:21:29.841863  6799 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "90d42e216d9741e190bca19a781291fd"
dest_uuid: "b7ab4784c7344b939bc36f639286f377"
mode: GRACEFUL
new_leader_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
 from {username='slave'} at 127.0.0.1:38240
I20260709 13:21:29.843801  6799 raft_consensus.cc:606] T 90d42e216d9741e190bca19a781291fd P b7ab4784c7344b939bc36f639286f377 [term 18 LEADER]: Received request to transfer leadership to TS cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:21:29.779069  6621 catalog_manager.cc:5697] T de3186201e1a40d0b335eeb8b4e256e0 P b7ab4784c7344b939bc36f639286f377 reported cstate change: term changed from 11 to 16. New cstate: current_term: 16 leader_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } }
I20260709 13:21:29.844683  6878 raft_consensus.cc:2468] T d33d5ee8ef6f415593d8df52063161ad P cd75a17ab2604397adab03bb8b5fd75c [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 20.
I20260709 13:21:29.846143  6621 catalog_manager.cc:5697] T d8292e16e5654be6bc408560cf256aaa P b7ab4784c7344b939bc36f639286f377 reported cstate change: term changed from 8 to 17. New cstate: current_term: 17 leader_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } }
I20260709 13:21:29.848330  6799 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9e326172347f45e99a0d482b5d8ef768"
dest_uuid: "b7ab4784c7344b939bc36f639286f377"
mode: GRACEFUL
new_leader_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
 from {username='slave'} at 127.0.0.1:38240
I20260709 13:21:29.848997  6799 raft_consensus.cc:606] T 9e326172347f45e99a0d482b5d8ef768 P b7ab4784c7344b939bc36f639286f377 [term 18 FOLLOWER]: Received request to transfer leadership to TS cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:21:29.849370  6799 raft_consensus.cc:614] T 9e326172347f45e99a0d482b5d8ef768 P b7ab4784c7344b939bc36f639286f377 [term 18 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:21:29.853256  6799 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f09c2a98de1a4decabd0ff900dd44caa"
dest_uuid: "b7ab4784c7344b939bc36f639286f377"
mode: GRACEFUL
new_leader_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
 from {username='slave'} at 127.0.0.1:38240
I20260709 13:21:29.853811  6799 raft_consensus.cc:606] T f09c2a98de1a4decabd0ff900dd44caa P b7ab4784c7344b939bc36f639286f377 [term 22 LEADER]: Received request to transfer leadership to TS cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:21:29.856483 13886 leader_election.cc:290] T bd6869f07b5a4885a0b99fbe60c3b175 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 23 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:21:29.872444  6846 leader_election.cc:400] T 4f00a2e87e56452083b759f60d461ee3 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 21 pre-election: Vote denied by peer 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071) with higher term. Message: Invalid argument: T 4f00a2e87e56452083b759f60d461ee3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c for earlier term 21. Current term is 22.
I20260709 13:21:29.872864  6846 leader_election.cc:403] T 4f00a2e87e56452083b759f60d461ee3 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 21 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:21:29.875670 13865 raft_consensus.cc:3060] T 4f00a2e87e56452083b759f60d461ee3 P cd75a17ab2604397adab03bb8b5fd75c [term 20 FOLLOWER]: Advancing to term 22
I20260709 13:21:29.877954  6697 leader_election.cc:304] T f5be3a11b23d4ea9b08300a2789821c7 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
W20260709 13:21:29.890192  6695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 84620.3us
I20260709 13:21:29.891636  6695 leader_election.cc:304] T 4d9def8b32fd443aa94ab1420b06837b P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: cd75a17ab2604397adab03bb8b5fd75c
W20260709 13:21:29.857653 13985 log.cc:927] Time spent T 1bf4668eeb70467fb3dc5a0289233b3c P cd75a17ab2604397adab03bb8b5fd75c: Append to log took a long time: real 0.111s	user 0.004s	sys 0.000s
I20260709 13:21:29.894402  6695 leader_election.cc:304] T d8292e16e5654be6bc408560cf256aaa P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
I20260709 13:21:29.907755  6875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4275cf08e63345f993bce8664eada830" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:21:29.909380  6875 raft_consensus.cc:2468] T 4275cf08e63345f993bce8664eada830 P cd75a17ab2604397adab03bb8b5fd75c [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 20.
I20260709 13:21:29.910420 13890 raft_consensus.cc:2804] T f5be3a11b23d4ea9b08300a2789821c7 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:21:29.911059 13890 raft_consensus.cc:493] T f5be3a11b23d4ea9b08300a2789821c7 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:29.911460 13890 raft_consensus.cc:3060] T f5be3a11b23d4ea9b08300a2789821c7 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:21:29.917151  6697 leader_election.cc:304] T d33d5ee8ef6f415593d8df52063161ad P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:21:29.921913  6880 raft_consensus.cc:2468] T de3186201e1a40d0b335eeb8b4e256e0 P cd75a17ab2604397adab03bb8b5fd75c [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 22.
I20260709 13:21:29.922978 13989 raft_consensus.cc:2804] T d33d5ee8ef6f415593d8df52063161ad P ccd8a4c3bfe3413cb2ae219b09aea832 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:21:29.923581 13989 raft_consensus.cc:697] T d33d5ee8ef6f415593d8df52063161ad P ccd8a4c3bfe3413cb2ae219b09aea832 [term 20 LEADER]: Becoming Leader. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
I20260709 13:21:29.916961 13941 raft_consensus.cc:2804] T 4d9def8b32fd443aa94ab1420b06837b P ccd8a4c3bfe3413cb2ae219b09aea832 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:21:29.877295  7499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1528ab62b6fe4e3099d08f141afee116" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb"
I20260709 13:21:29.935196  7499 raft_consensus.cc:3060] T 1528ab62b6fe4e3099d08f141afee116 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:21:29.867971  6621 catalog_manager.cc:5697] T 4d9def8b32fd443aa94ab1420b06837b P b7ab4784c7344b939bc36f639286f377 reported cstate change: term changed from 13 to 15, leader changed from cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67) to ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65). New cstate: current_term: 15 leader_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } }
I20260709 13:21:29.936993  6730 raft_consensus.cc:2468] T 44bde925b2e541b69890d70715b85176 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 20.
I20260709 13:21:29.938383  6802 raft_consensus.cc:2468] T 4f00a2e87e56452083b759f60d461ee3 P b7ab4784c7344b939bc36f639286f377 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in term 22.
I20260709 13:21:29.939767  6802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce4f062dcd314d43a63ca74067cb5ee3" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:21:29.940985  6697 leader_election.cc:304] T de3186201e1a40d0b335eeb8b4e256e0 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:21:29.945353  6621 catalog_manager.cc:5697] T 711ef6523deb4cbe8ef2ba61e1c21c98 P b7ab4784c7344b939bc36f639286f377 reported cstate change: term changed from 11 to 17, leader changed from ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65) to cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67). New cstate: current_term: 17 leader_uuid: "cd75a17ab2604397adab03bb8b5fd75c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } }
I20260709 13:21:29.946735 13966 leader_election.cc:290] T 3411566abe2d4c9bb4b2adfdd05e6f17 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:21:29.937568 13697 raft_consensus.cc:2804] T d8292e16e5654be6bc408560cf256aaa P ccd8a4c3bfe3413cb2ae219b09aea832 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:21:29.948895 13987 raft_consensus.cc:2804] T de3186201e1a40d0b335eeb8b4e256e0 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:21:29.949502 13987 raft_consensus.cc:697] T de3186201e1a40d0b335eeb8b4e256e0 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 22 LEADER]: Becoming Leader. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
I20260709 13:21:29.950495 13987 consensus_queue.cc:237] T de3186201e1a40d0b335eeb8b4e256e0 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 20.11, Last appended by leader: 11, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
W20260709 13:21:29.954088  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 153228us
I20260709 13:21:29.932422 13941 raft_consensus.cc:493] T 4d9def8b32fd443aa94ab1420b06837b P ccd8a4c3bfe3413cb2ae219b09aea832 [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:29.953125 13697 raft_consensus.cc:697] T d8292e16e5654be6bc408560cf256aaa P ccd8a4c3bfe3413cb2ae219b09aea832 [term 21 LEADER]: Becoming Leader. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
I20260709 13:21:29.977630  6879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3411566abe2d4c9bb4b2adfdd05e6f17" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:21:29.983583  6770 leader_election.cc:400] T d33d5ee8ef6f415593d8df52063161ad P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 19 pre-election: Vote denied by peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391) with higher term. Message: Invalid argument: T d33d5ee8ef6f415593d8df52063161ad P ccd8a4c3bfe3413cb2ae219b09aea832 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7ab4784c7344b939bc36f639286f377 for earlier term 19. Current term is 20.
I20260709 13:21:29.984097  6770 leader_election.cc:403] T d33d5ee8ef6f415593d8df52063161ad P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 19 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:21:29.985560  6807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1528ab62b6fe4e3099d08f141afee116" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:21:29.986327  6807 raft_consensus.cc:3060] T 1528ab62b6fe4e3099d08f141afee116 P b7ab4784c7344b939bc36f639286f377 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:21:29.986158 13966 consensus_queue.cc:1048] T f09c2a98de1a4decabd0ff900dd44caa P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:21:29.987718  6805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5be3a11b23d4ea9b08300a2789821c7" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:21:29.988941  6805 raft_consensus.cc:2468] T f5be3a11b23d4ea9b08300a2789821c7 P b7ab4784c7344b939bc36f639286f377 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 19.
I20260709 13:21:29.989969  6804 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f5be3a11b23d4ea9b08300a2789821c7"
dest_uuid: "b7ab4784c7344b939bc36f639286f377"
mode: GRACEFUL
new_leader_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
 from {username='slave'} at 127.0.0.1:38240
I20260709 13:21:29.990574  6804 raft_consensus.cc:606] T f5be3a11b23d4ea9b08300a2789821c7 P b7ab4784c7344b939bc36f639286f377 [term 19 FOLLOWER]: Received request to transfer leadership to TS cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:21:29.990911  6804 raft_consensus.cc:614] T f5be3a11b23d4ea9b08300a2789821c7 P b7ab4784c7344b939bc36f639286f377 [term 19 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:21:29.994546  6772 leader_election.cc:400] T 44bde925b2e541b69890d70715b85176 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 20 election: Vote denied by peer cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931) with higher term. Message: Invalid argument: T 44bde925b2e541b69890d70715b85176 P cd75a17ab2604397adab03bb8b5fd75c [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate b7ab4784c7344b939bc36f639286f377 for earlier term 20. Current term is 21.
I20260709 13:21:29.994971  6772 leader_election.cc:403] T 44bde925b2e541b69890d70715b85176 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 20 election: Cancelling election due to peer responding with higher term
I20260709 13:21:29.995048 13849 raft_consensus.cc:493] T 3411566abe2d4c9bb4b2adfdd05e6f17 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:29.995558 13684 raft_consensus.cc:3060] T 44bde925b2e541b69890d70715b85176 P b7ab4784c7344b939bc36f639286f377 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:21:29.997995 13925 raft_consensus.cc:993] T f09c2a98de1a4decabd0ff900dd44caa P b7ab4784c7344b939bc36f639286f377: : Instructing follower cd75a17ab2604397adab03bb8b5fd75c to start an election
I20260709 13:21:29.998517 13925 raft_consensus.cc:1081] T f09c2a98de1a4decabd0ff900dd44caa P b7ab4784c7344b939bc36f639286f377 [term 22 LEADER]: Signalling peer cd75a17ab2604397adab03bb8b5fd75c to start an election
I20260709 13:21:29.995847 13849 raft_consensus.cc:515] T 3411566abe2d4c9bb4b2adfdd05e6f17 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:30.002351  7466 leader_election.cc:304] T 4f00a2e87e56452083b759f60d461ee3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, b7ab4784c7344b939bc36f639286f377; no voters: 
I20260709 13:21:29.987673  6770 leader_election.cc:304] T 4d9def8b32fd443aa94ab1420b06837b P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:21:30.004383  6799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "713b5728a197487c9300b310ab94e5a3" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:21:30.005798  5625 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:21:30.006394 13447 raft_consensus.cc:2804] T 4d9def8b32fd443aa94ab1420b06837b P b7ab4784c7344b939bc36f639286f377 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:21:30.006772 13447 raft_consensus.cc:493] T 4d9def8b32fd443aa94ab1420b06837b P b7ab4784c7344b939bc36f639286f377 [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:30.007078 13447 raft_consensus.cc:3060] T 4d9def8b32fd443aa94ab1420b06837b P b7ab4784c7344b939bc36f639286f377 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:21:30.007668  5625 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:21:30.005820  6803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34f36d59d88f40fe8a2805e604fc6c0a" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:21:30.004462  6772 leader_election.cc:304] T 4275cf08e63345f993bce8664eada830 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:21:30.009014  6802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de3186201e1a40d0b335eeb8b4e256e0" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:21:30.005138  6798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d33d5ee8ef6f415593d8df52063161ad" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:21:30.010056  6802 raft_consensus.cc:3060] T de3186201e1a40d0b335eeb8b4e256e0 P b7ab4784c7344b939bc36f639286f377 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:21:29.971706 13941 raft_consensus.cc:3060] T 4d9def8b32fd443aa94ab1420b06837b P ccd8a4c3bfe3413cb2ae219b09aea832 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:21:30.004384 13978 raft_consensus.cc:2804] T 4f00a2e87e56452083b759f60d461ee3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:21:30.016263 13989 consensus_queue.cc:237] T d33d5ee8ef6f415593d8df52063161ad P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.10, Last appended by leader: 10, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:30.001157 13849 leader_election.cc:290] T 3411566abe2d4c9bb4b2adfdd05e6f17 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:21:30.015326  6807 raft_consensus.cc:2468] T 1528ab62b6fe4e3099d08f141afee116 P b7ab4784c7344b939bc36f639286f377 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 19.
I20260709 13:21:30.017660 13697 consensus_queue.cc:237] T d8292e16e5654be6bc408560cf256aaa P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.11, Last appended by leader: 11, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:30.020480 13652 raft_consensus.cc:515] T 7c44c4849aa54f2b94d1f1bef9ed546f P ccd8a4c3bfe3413cb2ae219b09aea832 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:30.030136 13978 raft_consensus.cc:697] T 4f00a2e87e56452083b759f60d461ee3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 22 LEADER]: Becoming Leader. State: Replica: 7ba59cc884714e8aa5f3f0ecaed84cbb, State: Running, Role: LEADER
I20260709 13:21:30.030617 13999 raft_consensus.cc:2804] T 4275cf08e63345f993bce8664eada830 P b7ab4784c7344b939bc36f639286f377 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:21:30.032397 13295 raft_consensus.cc:993] T 1bf4668eeb70467fb3dc5a0289233b3c P b7ab4784c7344b939bc36f639286f377: : Instructing follower cd75a17ab2604397adab03bb8b5fd75c to start an election
I20260709 13:21:29.947522  6621 catalog_manager.cc:5697] T 3d65025eea89441290d85dd053810e31 P b7ab4784c7344b939bc36f639286f377 reported cstate change: term changed from 13 to 15, leader changed from cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67) to ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65). New cstate: current_term: 15 leader_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } }
I20260709 13:21:30.036836  6730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8292e16e5654be6bc408560cf256aaa" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:21:30.038705 13992 raft_consensus.cc:993] T 90d42e216d9741e190bca19a781291fd P b7ab4784c7344b939bc36f639286f377: : Instructing follower cd75a17ab2604397adab03bb8b5fd75c to start an election
I20260709 13:21:30.040477  6879 raft_consensus.cc:2393] T 3411566abe2d4c9bb4b2adfdd05e6f17 P cd75a17ab2604397adab03bb8b5fd75c [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7ab4784c7344b939bc36f639286f377 in current term 19: Already voted for candidate cd75a17ab2604397adab03bb8b5fd75c in this term.
I20260709 13:21:30.041599 13990 consensus_queue.cc:1059] T 34f36d59d88f40fe8a2805e604fc6c0a P b7ab4784c7344b939bc36f639286f377 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: INVALID_TERM, Last received: 18.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:21:30.041851  6731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6869f07b5a4885a0b99fbe60c3b175" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 23 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:21:30.046857 13890 raft_consensus.cc:515] T f5be3a11b23d4ea9b08300a2789821c7 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:30.048743 13684 raft_consensus.cc:2749] T 44bde925b2e541b69890d70715b85176 P b7ab4784c7344b939bc36f639286f377 [term 21 FOLLOWER]: Leader election lost for term 20. Reason: Vote denied by peer cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931) with higher term. Message: Invalid argument: T 44bde925b2e541b69890d70715b85176 P cd75a17ab2604397adab03bb8b5fd75c [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate b7ab4784c7344b939bc36f639286f377 for earlier term 20. Current term is 21.
I20260709 13:21:29.987867 13966 raft_consensus.cc:3060] T d33d5ee8ef6f415593d8df52063161ad P b7ab4784c7344b939bc36f639286f377 [term 18 FOLLOWER]: Advancing to term 20
I20260709 13:21:30.035102  6726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44bde925b2e541b69890d70715b85176" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:21:30.092657  6726 raft_consensus.cc:3060] T 44bde925b2e541b69890d70715b85176 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:21:30.087461  6731 raft_consensus.cc:2393] T bd6869f07b5a4885a0b99fbe60c3b175 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c in current term 23: Already voted for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in this term.
W20260709 13:21:30.088588  6697 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.68:45071, user_credentials={real_user=slave}} blocked reactor thread for 96279.9us
I20260709 13:21:30.089643  6876 raft_consensus.cc:1275] T f3f9c2e2bf644115957398fe4c9459db P cd75a17ab2604397adab03bb8b5fd75c [term 21 FOLLOWER]: Refusing update from remote peer b7ab4784c7344b939bc36f639286f377: Log matching property violated. Preceding OpId in replica: term: 19 index: 13. Preceding OpId from leader: term: 21 index: 14. (index mismatch)
I20260709 13:21:30.085239  6844 leader_election.cc:304] T 1bf4668eeb70467fb3dc5a0289233b3c P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377
I20260709 13:21:30.097393  6844 leader_election.cc:304] T 7c44c4849aa54f2b94d1f1bef9ed546f P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377
I20260709 13:21:30.078336 13999 raft_consensus.cc:493] T 4275cf08e63345f993bce8664eada830 P b7ab4784c7344b939bc36f639286f377 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:30.087934 13991 raft_consensus.cc:493] T ce4f062dcd314d43a63ca74067cb5ee3 P b7ab4784c7344b939bc36f639286f377 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader cd75a17ab2604397adab03bb8b5fd75c)
I20260709 13:21:30.090073 13926 raft_consensus.cc:1081] T 1bf4668eeb70467fb3dc5a0289233b3c P b7ab4784c7344b939bc36f639286f377 [term 19 LEADER]: Signalling peer cd75a17ab2604397adab03bb8b5fd75c to start an election
I20260709 13:21:30.090149 13856 raft_consensus.cc:493] T 3411566abe2d4c9bb4b2adfdd05e6f17 P cd75a17ab2604397adab03bb8b5fd75c [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:30.133210  6875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3411566abe2d4c9bb4b2adfdd05e6f17" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:21:30.097474  6880 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f09c2a98de1a4decabd0ff900dd44caa"
dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
 from {username='slave'} at 127.0.0.1:53406
I20260709 13:21:30.083691 13447 raft_consensus.cc:515] T 4d9def8b32fd443aa94ab1420b06837b P b7ab4784c7344b939bc36f639286f377 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:30.138512  6877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f00a2e87e56452083b759f60d461ee3" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:21:30.142900 13446 raft_consensus.cc:1081] T 90d42e216d9741e190bca19a781291fd P b7ab4784c7344b939bc36f639286f377 [term 18 LEADER]: Signalling peer cd75a17ab2604397adab03bb8b5fd75c to start an election
I20260709 13:21:30.112531 13946 raft_consensus.cc:2804] T 1bf4668eeb70467fb3dc5a0289233b3c P cd75a17ab2604397adab03bb8b5fd75c [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:21:30.109788 13999 raft_consensus.cc:3060] T 4275cf08e63345f993bce8664eada830 P b7ab4784c7344b939bc36f639286f377 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:21:30.147588  6804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3411566abe2d4c9bb4b2adfdd05e6f17" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:21:30.158160  6804 raft_consensus.cc:2468] T 3411566abe2d4c9bb4b2adfdd05e6f17 P b7ab4784c7344b939bc36f639286f377 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 18.
I20260709 13:21:30.114977 13865 raft_consensus.cc:2749] T 4f00a2e87e56452083b759f60d461ee3 P cd75a17ab2604397adab03bb8b5fd75c [term 22 FOLLOWER]: Leader pre-election lost for term 21. Reason: Vote denied by peer 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071) with higher term. Message: Invalid argument: T 4f00a2e87e56452083b759f60d461ee3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c for earlier term 21. Current term is 22.
I20260709 13:21:30.164844 13978 consensus_queue.cc:237] T 4f00a2e87e56452083b759f60d461ee3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 20.14, Last appended by leader: 14, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:21:30.166961 13966 raft_consensus.cc:2749] T d33d5ee8ef6f415593d8df52063161ad P b7ab4784c7344b939bc36f639286f377 [term 20 FOLLOWER]: Leader pre-election lost for term 19. Reason: Vote denied by peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391) with higher term. Message: Invalid argument: T d33d5ee8ef6f415593d8df52063161ad P ccd8a4c3bfe3413cb2ae219b09aea832 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7ab4784c7344b939bc36f639286f377 for earlier term 19. Current term is 20.
I20260709 13:21:30.168126 13690 raft_consensus.cc:2804] T 7c44c4849aa54f2b94d1f1bef9ed546f P cd75a17ab2604397adab03bb8b5fd75c [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:21:30.168658 13690 raft_consensus.cc:493] T 7c44c4849aa54f2b94d1f1bef9ed546f P cd75a17ab2604397adab03bb8b5fd75c [term 21 FOLLOWER]: Starting leader election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:21:30.169067 13690 raft_consensus.cc:3060] T 7c44c4849aa54f2b94d1f1bef9ed546f P cd75a17ab2604397adab03bb8b5fd75c [term 21 FOLLOWER]: Advancing to term 22
W20260709 13:21:30.170792  6695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 44564.3us
I20260709 13:21:30.183671  6695 leader_election.cc:304] T 713b5728a197487c9300b310ab94e5a3 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:21:30.184746  6798 raft_consensus.cc:2468] T d33d5ee8ef6f415593d8df52063161ad P b7ab4784c7344b939bc36f639286f377 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 20.
W20260709 13:21:30.192299  6770 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 110578us
I20260709 13:21:30.153414 13946 raft_consensus.cc:493] T 1bf4668eeb70467fb3dc5a0289233b3c P cd75a17ab2604397adab03bb8b5fd75c [term 19 FOLLOWER]: Starting leader election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:21:30.194823  6876 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "90d42e216d9741e190bca19a781291fd"
dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
 from {username='slave'} at 127.0.0.1:53406
I20260709 13:21:30.209666  6876 raft_consensus.cc:493] T 90d42e216d9741e190bca19a781291fd P cd75a17ab2604397adab03bb8b5fd75c [term 18 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:21:30.210129  6876 raft_consensus.cc:3060] T 90d42e216d9741e190bca19a781291fd P cd75a17ab2604397adab03bb8b5fd75c [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:21:30.195914  6695 leader_election.cc:304] T 34f36d59d88f40fe8a2805e604fc6c0a P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:21:30.211319 13946 raft_consensus.cc:3060] T 1bf4668eeb70467fb3dc5a0289233b3c P cd75a17ab2604397adab03bb8b5fd75c [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:21:30.211724  6878 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1bf4668eeb70467fb3dc5a0289233b3c"
dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
 from {username='slave'} at 127.0.0.1:53406
I20260709 13:21:30.208794 13988 raft_consensus.cc:2749] T 713b5728a197487c9300b310ab94e5a3 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:21:30.216547  6880 raft_consensus.cc:493] T f09c2a98de1a4decabd0ff900dd44caa P cd75a17ab2604397adab03bb8b5fd75c [term 22 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:21:30.217069  6880 raft_consensus.cc:3060] T f09c2a98de1a4decabd0ff900dd44caa P cd75a17ab2604397adab03bb8b5fd75c [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:21:30.220149  6695 leader_election.cc:304] T 1528ab62b6fe4e3099d08f141afee116 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
I20260709 13:21:30.221889  6877 raft_consensus.cc:2468] T 4f00a2e87e56452083b759f60d461ee3 P cd75a17ab2604397adab03bb8b5fd75c [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in term 22.
I20260709 13:21:30.222395  6726 raft_consensus.cc:2468] T 44bde925b2e541b69890d70715b85176 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 21.
I20260709 13:21:30.136641 13856 raft_consensus.cc:515] T 3411566abe2d4c9bb4b2adfdd05e6f17 P cd75a17ab2604397adab03bb8b5fd75c [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:30.249696 13890 leader_election.cc:290] T f5be3a11b23d4ea9b08300a2789821c7 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 20 election: Requested vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:21:30.251365  6800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5be3a11b23d4ea9b08300a2789821c7" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:21:30.258742  6731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3411566abe2d4c9bb4b2adfdd05e6f17" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:21:30.268759  6800 raft_consensus.cc:3060] T f5be3a11b23d4ea9b08300a2789821c7 P b7ab4784c7344b939bc36f639286f377 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:21:30.268926  6731 raft_consensus.cc:2468] T 3411566abe2d4c9bb4b2adfdd05e6f17 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 19.
I20260709 13:21:30.252447  6695 leader_election.cc:304] T 3411566abe2d4c9bb4b2adfdd05e6f17 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
I20260709 13:21:30.255748  6805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8292e16e5654be6bc408560cf256aaa" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:21:30.262645  6880 raft_consensus.cc:515] T f09c2a98de1a4decabd0ff900dd44caa P cd75a17ab2604397adab03bb8b5fd75c [term 23 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:30.258275  6876 raft_consensus.cc:515] T 90d42e216d9741e190bca19a781291fd P cd75a17ab2604397adab03bb8b5fd75c [term 19 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:30.267122  6877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5be3a11b23d4ea9b08300a2789821c7" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:21:30.270486  6877 raft_consensus.cc:3060] T f5be3a11b23d4ea9b08300a2789821c7 P cd75a17ab2604397adab03bb8b5fd75c [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:21:30.157428 13991 raft_consensus.cc:515] T ce4f062dcd314d43a63ca74067cb5ee3 P b7ab4784c7344b939bc36f639286f377 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:21:30.182869  7499 raft_consensus.cc:2468] T 1528ab62b6fe4e3099d08f141afee116 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 19.
I20260709 13:21:30.239583 13295 raft_consensus.cc:3055] T 34f36d59d88f40fe8a2805e604fc6c0a P b7ab4784c7344b939bc36f639286f377 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:21:30.280771  6805 raft_consensus.cc:2368] T d8292e16e5654be6bc408560cf256aaa P b7ab4784c7344b939bc36f639286f377 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c for earlier term 20. Current term is 21.
I20260709 13:21:30.281162  6876 leader_election.cc:290] T 90d42e216d9741e190bca19a781291fd P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 19 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:21:30.283768  6726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4275cf08e63345f993bce8664eada830" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:21:30.284562  6726 raft_consensus.cc:2468] T 4275cf08e63345f993bce8664eada830 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 20.
I20260709 13:21:30.285539  6806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6869f07b5a4885a0b99fbe60c3b175" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 23 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:21:30.263674  6801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f00a2e87e56452083b759f60d461ee3" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:21:30.280658 13295 raft_consensus.cc:740] T 34f36d59d88f40fe8a2805e604fc6c0a P b7ab4784c7344b939bc36f639286f377 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
I20260709 13:21:30.289134  6798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c44c4849aa54f2b94d1f1bef9ed546f" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 23 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:21:30.289880  6798 raft_consensus.cc:3060] T 7c44c4849aa54f2b94d1f1bef9ed546f P b7ab4784c7344b939bc36f639286f377 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:21:30.157310  6621 catalog_manager.cc:5697] T 44bde925b2e541b69890d70715b85176 P b7ab4784c7344b939bc36f639286f377 reported cstate change: term changed from 13 to 15. New cstate: current_term: 15 leader_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } }
I20260709 13:21:30.292259  6621 catalog_manager.cc:5697] T e31b9971c15848dea59d4d4130141d9e P b7ab4784c7344b939bc36f639286f377 reported cstate change: term changed from 11 to 13. New cstate: current_term: 13 leader_uuid: "b7ab4784c7344b939bc36f639286f377" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:30.294275  6621 catalog_manager.cc:5697] T 4275cf08e63345f993bce8664eada830 P b7ab4784c7344b939bc36f639286f377 reported cstate change: term changed from 3 to 13. New cstate: current_term: 13 leader_uuid: "b7ab4784c7344b939bc36f639286f377" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } health_report { overall_health: HEALTHY } } }
I20260709 13:21:30.297704 13946 raft_consensus.cc:515] T 1bf4668eeb70467fb3dc5a0289233b3c P cd75a17ab2604397adab03bb8b5fd75c [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:30.289223 13295 consensus_queue.cc:260] T 34f36d59d88f40fe8a2805e604fc6c0a P b7ab4784c7344b939bc36f639286f377 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.10, Last appended by leader: 10, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:30.300171  6878 raft_consensus.cc:493] T 1bf4668eeb70467fb3dc5a0289233b3c P cd75a17ab2604397adab03bb8b5fd75c [term 20 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:21:30.300436 13295 raft_consensus.cc:3060] T 34f36d59d88f40fe8a2805e604fc6c0a P b7ab4784c7344b939bc36f639286f377 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:21:30.300699  6878 raft_consensus.cc:3060] T 1bf4668eeb70467fb3dc5a0289233b3c P cd75a17ab2604397adab03bb8b5fd75c [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:21:30.302605 13856 leader_election.cc:290] T 3411566abe2d4c9bb4b2adfdd05e6f17 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:21:30.307685  6731 raft_consensus.cc:1275] T f3f9c2e2bf644115957398fe4c9459db P ccd8a4c3bfe3413cb2ae219b09aea832 [term 21 FOLLOWER]: Refusing update from remote peer b7ab4784c7344b939bc36f639286f377: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 21 index: 14. (index mismatch)
I20260709 13:21:30.299917 13946 leader_election.cc:290] T 1bf4668eeb70467fb3dc5a0289233b3c P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 20 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:21:30.308542 13652 leader_election.cc:290] T 7c44c4849aa54f2b94d1f1bef9ed546f P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 23 election: Requested vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:21:30.323442 13988 raft_consensus.cc:2804] T 3411566abe2d4c9bb4b2adfdd05e6f17 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:21:30.323946 13988 raft_consensus.cc:493] T 3411566abe2d4c9bb4b2adfdd05e6f17 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:30.324303 13988 raft_consensus.cc:3060] T 3411566abe2d4c9bb4b2adfdd05e6f17 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:21:30.257037 13965 raft_consensus.cc:2804] T 1528ab62b6fe4e3099d08f141afee116 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:21:30.308207  6875 raft_consensus.cc:2468] T 3411566abe2d4c9bb4b2adfdd05e6f17 P cd75a17ab2604397adab03bb8b5fd75c [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 19.
I20260709 13:21:30.315938  6880 leader_election.cc:290] T f09c2a98de1a4decabd0ff900dd44caa P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 23 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:21:30.318687 13690 raft_consensus.cc:515] T 7c44c4849aa54f2b94d1f1bef9ed546f P cd75a17ab2604397adab03bb8b5fd75c [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:30.226513 13989 raft_consensus.cc:2749] T 34f36d59d88f40fe8a2805e604fc6c0a P ccd8a4c3bfe3413cb2ae219b09aea832 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:21:30.322829  6801 raft_consensus.cc:2368] T 4f00a2e87e56452083b759f60d461ee3 P b7ab4784c7344b939bc36f639286f377 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c for earlier term 21. Current term is 22.
W20260709 13:21:30.329634  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 231068us
I20260709 13:21:30.330319  6877 raft_consensus.cc:2468] T f5be3a11b23d4ea9b08300a2789821c7 P cd75a17ab2604397adab03bb8b5fd75c [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 20.
W20260709 13:21:30.310199 13601 consensus_queue.cc:1175] T 34f36d59d88f40fe8a2805e604fc6c0a P b7ab4784c7344b939bc36f639286f377 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "cd75a17ab2604397adab03bb8b5fd75c" responder_term: 18 status { last_received { term: 18 index: 10 } last_committed_idx: 10 last_received_current_leader { term: 18 index: 10 } }
I20260709 13:21:30.336236  6799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44bde925b2e541b69890d70715b85176" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:21:30.348481  6697 leader_election.cc:304] T f5be3a11b23d4ea9b08300a2789821c7 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:21:30.328836  6878 raft_consensus.cc:515] T 1bf4668eeb70467fb3dc5a0289233b3c P cd75a17ab2604397adab03bb8b5fd75c [term 21 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:30.341197  6802 raft_consensus.cc:2468] T de3186201e1a40d0b335eeb8b4e256e0 P b7ab4784c7344b939bc36f639286f377 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 22.
I20260709 13:21:30.342839  6798 raft_consensus.cc:2468] T 7c44c4849aa54f2b94d1f1bef9ed546f P b7ab4784c7344b939bc36f639286f377 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 23.
I20260709 13:21:30.341828  6800 raft_consensus.cc:2468] T f5be3a11b23d4ea9b08300a2789821c7 P b7ab4784c7344b939bc36f639286f377 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 20.
I20260709 13:21:30.332643  6872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c44c4849aa54f2b94d1f1bef9ed546f" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 23 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:21:30.352921  6879 raft_consensus.cc:1240] T 1bf4668eeb70467fb3dc5a0289233b3c P cd75a17ab2604397adab03bb8b5fd75c [term 21 FOLLOWER]: Rejecting Update request from peer b7ab4784c7344b939bc36f639286f377 for earlier term 19. Current term is 21. Ops: []
I20260709 13:21:30.356345 13914 consensus_queue.cc:1048] T f3f9c2e2bf644115957398fe4c9459db P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.176s
I20260709 13:21:30.358022  6695 leader_election.cc:304] T 7c44c4849aa54f2b94d1f1bef9ed546f P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
I20260709 13:21:30.362828 13991 leader_election.cc:290] T ce4f062dcd314d43a63ca74067cb5ee3 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:21:30.367121  6872 raft_consensus.cc:3060] T 7c44c4849aa54f2b94d1f1bef9ed546f P cd75a17ab2604397adab03bb8b5fd75c [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:21:30.373544 13690 leader_election.cc:290] T 7c44c4849aa54f2b94d1f1bef9ed546f P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 22 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:21:30.374338 13999 raft_consensus.cc:515] T 4275cf08e63345f993bce8664eada830 P b7ab4784c7344b939bc36f639286f377 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:30.376298  6621 catalog_manager.cc:5697] T e77e330a82df4b43a745d57a68f6f057 P b7ab4784c7344b939bc36f639286f377 reported cstate change: term changed from 14 to 16, leader changed from ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65) to b7ab4784c7344b939bc36f639286f377 (127.5.126.66). New cstate: current_term: 16 leader_uuid: "b7ab4784c7344b939bc36f639286f377" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } health_report { overall_health: HEALTHY } } }
W20260709 13:21:30.348075 13980 log.cc:927] Time spent T f4b8bd455d5a47c18a1380839c6e0d61 P b7ab4784c7344b939bc36f639286f377: Append to log took a long time: real 0.072s	user 0.000s	sys 0.000s
I20260709 13:21:30.380224  6844 leader_election.cc:304] T 44bde925b2e541b69890d70715b85176 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:21:30.390734  6730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90d42e216d9741e190bca19a781291fd" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: true dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:21:30.391539  6730 raft_consensus.cc:3060] T 90d42e216d9741e190bca19a781291fd P ccd8a4c3bfe3413cb2ae219b09aea832 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:21:30.392874  6723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bf4668eeb70467fb3dc5a0289233b3c" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:21:30.394335 13989 raft_consensus.cc:2804] T 7c44c4849aa54f2b94d1f1bef9ed546f P ccd8a4c3bfe3413cb2ae219b09aea832 [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:21:30.381523 13890 raft_consensus.cc:2804] T f5be3a11b23d4ea9b08300a2789821c7 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:21:30.396685 13890 raft_consensus.cc:697] T f5be3a11b23d4ea9b08300a2789821c7 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 20 LEADER]: Becoming Leader. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
I20260709 13:21:30.397846 13941 raft_consensus.cc:515] T 4d9def8b32fd443aa94ab1420b06837b P ccd8a4c3bfe3413cb2ae219b09aea832 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:30.382023 13447 leader_election.cc:290] T 4d9def8b32fd443aa94ab1420b06837b P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 23 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:21:30.401458 13999 leader_election.cc:290] T 4275cf08e63345f993bce8664eada830 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 21 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:21:30.403344  6732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09c2a98de1a4decabd0ff900dd44caa" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: true dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:21:30.403543 13989 raft_consensus.cc:697] T 7c44c4849aa54f2b94d1f1bef9ed546f P ccd8a4c3bfe3413cb2ae219b09aea832 [term 23 LEADER]: Becoming Leader. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
I20260709 13:21:30.368250 13965 raft_consensus.cc:697] T 1528ab62b6fe4e3099d08f141afee116 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 19 LEADER]: Becoming Leader. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
I20260709 13:21:30.404541 13989 consensus_queue.cc:237] T 7c44c4849aa54f2b94d1f1bef9ed546f P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 21.14, Last appended by leader: 14, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:30.405740 13965 consensus_queue.cc:237] T 1528ab62b6fe4e3099d08f141afee116 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:21:30.397774 13890 consensus_queue.cc:237] T f5be3a11b23d4ea9b08300a2789821c7 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:30.414743  6878 leader_election.cc:290] T 1bf4668eeb70467fb3dc5a0289233b3c P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 21 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:21:30.418807 14011 raft_consensus.cc:2804] T 44bde925b2e541b69890d70715b85176 P cd75a17ab2604397adab03bb8b5fd75c [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:21:30.419543 14011 raft_consensus.cc:697] T 44bde925b2e541b69890d70715b85176 P cd75a17ab2604397adab03bb8b5fd75c [term 21 LEADER]: Becoming Leader. State: Replica: cd75a17ab2604397adab03bb8b5fd75c, State: Running, Role: LEADER
I20260709 13:21:30.420706 14011 consensus_queue.cc:237] T 44bde925b2e541b69890d70715b85176 P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.12, Last appended by leader: 12, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:30.423549  6804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d9def8b32fd443aa94ab1420b06837b" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 23 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:21:30.424492  6804 raft_consensus.cc:2393] T 4d9def8b32fd443aa94ab1420b06837b P b7ab4784c7344b939bc36f639286f377 [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate ccd8a4c3bfe3413cb2ae219b09aea832 in current term 23: Already voted for candidate b7ab4784c7344b939bc36f639286f377 in this term.
I20260709 13:21:30.424714  6872 raft_consensus.cc:2468] T 7c44c4849aa54f2b94d1f1bef9ed546f P cd75a17ab2604397adab03bb8b5fd75c [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 23.
I20260709 13:21:30.426481  6730 raft_consensus.cc:2468] T 90d42e216d9741e190bca19a781291fd P ccd8a4c3bfe3413cb2ae219b09aea832 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 19.
I20260709 13:21:30.426891 13941 leader_election.cc:290] T 4d9def8b32fd443aa94ab1420b06837b P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 23 election: Requested vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:21:30.428769  6880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d9def8b32fd443aa94ab1420b06837b" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 23 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:21:30.429409  6880 raft_consensus.cc:3060] T 4d9def8b32fd443aa94ab1420b06837b P cd75a17ab2604397adab03bb8b5fd75c [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:21:30.430611  6730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bf4668eeb70467fb3dc5a0289233b3c" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: true dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:21:30.430757 13988 raft_consensus.cc:515] T 3411566abe2d4c9bb4b2adfdd05e6f17 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:30.431456  6730 raft_consensus.cc:3060] T 1bf4668eeb70467fb3dc5a0289233b3c P ccd8a4c3bfe3413cb2ae219b09aea832 [term 19 FOLLOWER]: Advancing to term 21
I20260709 13:21:30.433562  6844 leader_election.cc:304] T 90d42e216d9741e190bca19a781291fd P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:21:30.437774  6878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d9def8b32fd443aa94ab1420b06837b" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 23 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:21:30.438675  6875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4275cf08e63345f993bce8664eada830" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:21:30.439459  6875 raft_consensus.cc:3060] T 4275cf08e63345f993bce8664eada830 P cd75a17ab2604397adab03bb8b5fd75c [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:21:30.441835  6874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce4f062dcd314d43a63ca74067cb5ee3" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:21:30.442848  6806 raft_consensus.cc:2468] T bd6869f07b5a4885a0b99fbe60c3b175 P b7ab4784c7344b939bc36f639286f377 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 23.
I20260709 13:21:30.445223  6799 raft_consensus.cc:2468] T 44bde925b2e541b69890d70715b85176 P b7ab4784c7344b939bc36f639286f377 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 21.
I20260709 13:21:30.446586  6726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3411566abe2d4c9bb4b2adfdd05e6f17" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:21:30.447494  6726 raft_consensus.cc:2393] T 3411566abe2d4c9bb4b2adfdd05e6f17 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c in current term 20: Already voted for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in this term.
I20260709 13:21:30.465322  6844 leader_election.cc:400] T d8292e16e5654be6bc408560cf256aaa P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 20 election: Vote denied by peer b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817) with higher term. Message: Invalid argument: T d8292e16e5654be6bc408560cf256aaa P b7ab4784c7344b939bc36f639286f377 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c for earlier term 20. Current term is 21.
I20260709 13:21:30.465991  6844 leader_election.cc:403] T d8292e16e5654be6bc408560cf256aaa P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 20 election: Cancelling election due to peer responding with higher term
I20260709 13:21:30.467111  6723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c44c4849aa54f2b94d1f1bef9ed546f" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:21:30.469436  6730 raft_consensus.cc:2468] T 1bf4668eeb70467fb3dc5a0289233b3c P ccd8a4c3bfe3413cb2ae219b09aea832 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 21.
I20260709 13:21:30.470501  6729 raft_consensus.cc:1240] T 1bf4668eeb70467fb3dc5a0289233b3c P ccd8a4c3bfe3413cb2ae219b09aea832 [term 21 FOLLOWER]: Rejecting Update request from peer b7ab4784c7344b939bc36f639286f377 for earlier term 19. Current term is 21. Ops: []
I20260709 13:21:30.458734  7498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce4f062dcd314d43a63ca74067cb5ee3" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:21:30.472600  6727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d9def8b32fd443aa94ab1420b06837b" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 23 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:21:30.488896  6727 raft_consensus.cc:2393] T 4d9def8b32fd443aa94ab1420b06837b P ccd8a4c3bfe3413cb2ae219b09aea832 [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate b7ab4784c7344b939bc36f639286f377 in current term 23: Already voted for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in this term.
I20260709 13:21:30.490216  6880 raft_consensus.cc:2468] T 4d9def8b32fd443aa94ab1420b06837b P cd75a17ab2604397adab03bb8b5fd75c [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 23.
I20260709 13:21:30.494496  6804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09c2a98de1a4decabd0ff900dd44caa" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: true dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:21:30.494242  6803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bf4668eeb70467fb3dc5a0289233b3c" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:21:30.476558  6844 leader_election.cc:400] T 4f00a2e87e56452083b759f60d461ee3 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 21 pre-election: Vote denied by peer b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817) with higher term. Message: Invalid argument: T 4f00a2e87e56452083b759f60d461ee3 P b7ab4784c7344b939bc36f639286f377 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c for earlier term 21. Current term is 22.
I20260709 13:21:30.496173  6804 raft_consensus.cc:3055] T f09c2a98de1a4decabd0ff900dd44caa P b7ab4784c7344b939bc36f639286f377 [term 22 LEADER]: Stepping down as leader of term 22
I20260709 13:21:30.497148  6806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90d42e216d9741e190bca19a781291fd" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: true dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:21:30.498575  6806 raft_consensus.cc:3055] T 90d42e216d9741e190bca19a781291fd P b7ab4784c7344b939bc36f639286f377 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:21:30.498946  6806 raft_consensus.cc:740] T 90d42e216d9741e190bca19a781291fd P b7ab4784c7344b939bc36f639286f377 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
I20260709 13:21:30.498391  6804 raft_consensus.cc:740] T f09c2a98de1a4decabd0ff900dd44caa P b7ab4784c7344b939bc36f639286f377 [term 22 LEADER]: Becoming Follower/Learner. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
I20260709 13:21:30.508581  6804 consensus_queue.cc:260] T f09c2a98de1a4decabd0ff900dd44caa P b7ab4784c7344b939bc36f639286f377 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 22.13, Last appended by leader: 13, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:30.509857  6804 raft_consensus.cc:3060] T f09c2a98de1a4decabd0ff900dd44caa P b7ab4784c7344b939bc36f639286f377 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:21:30.516801  6807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3411566abe2d4c9bb4b2adfdd05e6f17" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:21:30.517470  6807 raft_consensus.cc:2468] T 3411566abe2d4c9bb4b2adfdd05e6f17 P b7ab4784c7344b939bc36f639286f377 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 18.
I20260709 13:21:30.393299  6621 catalog_manager.cc:5697] T f09c2a98de1a4decabd0ff900dd44caa P b7ab4784c7344b939bc36f639286f377 reported cstate change: term changed from 12 to 16. New cstate: current_term: 16 leader_uuid: "b7ab4784c7344b939bc36f639286f377" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } health_report { overall_health: HEALTHY } } }
I20260709 13:21:30.519811  6801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c44c4849aa54f2b94d1f1bef9ed546f" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:21:30.486930 13946 raft_consensus.cc:2749] T d8292e16e5654be6bc408560cf256aaa P cd75a17ab2604397adab03bb8b5fd75c [term 21 FOLLOWER]: Leader election lost for term 20. Reason: Vote denied by peer b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817) with higher term. Message: Invalid argument: T d8292e16e5654be6bc408560cf256aaa P b7ab4784c7344b939bc36f639286f377 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c for earlier term 20. Current term is 21.
I20260709 13:21:30.504309  6772 leader_election.cc:304] T ce4f062dcd314d43a63ca74067cb5ee3 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:21:30.524142  6803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3411566abe2d4c9bb4b2adfdd05e6f17" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:21:30.524758  6803 raft_consensus.cc:3060] T 3411566abe2d4c9bb4b2adfdd05e6f17 P b7ab4784c7344b939bc36f639286f377 [term 18 FOLLOWER]: Advancing to term 20
I20260709 13:21:30.476780 14010 raft_consensus.cc:2804] T 90d42e216d9741e190bca19a781291fd P cd75a17ab2604397adab03bb8b5fd75c [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:21:30.519809  6875 raft_consensus.cc:2468] T 4275cf08e63345f993bce8664eada830 P cd75a17ab2604397adab03bb8b5fd75c [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 21.
I20260709 13:21:30.521908  6801 raft_consensus.cc:2368] T 7c44c4849aa54f2b94d1f1bef9ed546f P b7ab4784c7344b939bc36f639286f377 [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c for earlier term 22. Current term is 23.
I20260709 13:21:30.516584  6806 consensus_queue.cc:260] T 90d42e216d9741e190bca19a781291fd P b7ab4784c7344b939bc36f639286f377 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.10, Last appended by leader: 10, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:30.528321  6806 raft_consensus.cc:3060] T 90d42e216d9741e190bca19a781291fd P b7ab4784c7344b939bc36f639286f377 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:21:30.525780  6727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4275cf08e63345f993bce8664eada830" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:21:30.529660  6727 raft_consensus.cc:3060] T 4275cf08e63345f993bce8664eada830 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:21:30.517398  6844 leader_election.cc:304] T bd6869f07b5a4885a0b99fbe60c3b175 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:21:30.495986 13447 raft_consensus.cc:493] T 7ba5dac66ab5497e9e336f2a3c28cda5 P b7ab4784c7344b939bc36f639286f377 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader cd75a17ab2604397adab03bb8b5fd75c)
I20260709 13:21:30.478813 13997 consensus_queue.cc:1059] T 1bf4668eeb70467fb3dc5a0289233b3c P b7ab4784c7344b939bc36f639286f377 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: INVALID_TERM, Last received: 19.12, Next index: 13, Last known committed idx: 11, Time since last communication: 0.084s
I20260709 13:21:30.534624  6772 leader_election.cc:304] T 4275cf08e63345f993bce8664eada830 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:21:30.548908  6804 raft_consensus.cc:2468] T f09c2a98de1a4decabd0ff900dd44caa P b7ab4784c7344b939bc36f639286f377 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 23.
I20260709 13:21:30.543234  6806 raft_consensus.cc:2468] T 90d42e216d9741e190bca19a781291fd P b7ab4784c7344b939bc36f639286f377 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 19.
I20260709 13:21:30.544938  6770 leader_election.cc:304] T 3411566abe2d4c9bb4b2adfdd05e6f17 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:21:30.549129 13946 raft_consensus.cc:2804] T bd6869f07b5a4885a0b99fbe60c3b175 P cd75a17ab2604397adab03bb8b5fd75c [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:21:30.544014 13593 raft_consensus.cc:2749] T ce4f062dcd314d43a63ca74067cb5ee3 P b7ab4784c7344b939bc36f639286f377 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:21:30.561988 14020 log.cc:927] Time spent T 1528ab62b6fe4e3099d08f141afee116 P ccd8a4c3bfe3413cb2ae219b09aea832: Append to log took a long time: real 0.086s	user 0.000s	sys 0.000s
I20260709 13:21:30.566473  6727 raft_consensus.cc:2468] T 4275cf08e63345f993bce8664eada830 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 21.
I20260709 13:21:30.569224  6803 raft_consensus.cc:2468] T 3411566abe2d4c9bb4b2adfdd05e6f17 P b7ab4784c7344b939bc36f639286f377 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 20.
I20260709 13:21:30.576858  6807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bf4668eeb70467fb3dc5a0289233b3c" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: true dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:21:30.578291  6807 raft_consensus.cc:3055] T 1bf4668eeb70467fb3dc5a0289233b3c P b7ab4784c7344b939bc36f639286f377 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:21:30.578796  6807 raft_consensus.cc:740] T 1bf4668eeb70467fb3dc5a0289233b3c P b7ab4784c7344b939bc36f639286f377 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
I20260709 13:21:30.544270 13447 raft_consensus.cc:515] T 7ba5dac66ab5497e9e336f2a3c28cda5 P b7ab4784c7344b939bc36f639286f377 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:21:30.581462 13447 leader_election.cc:290] T 7ba5dac66ab5497e9e336f2a3c28cda5 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
W20260709 13:21:30.584373  6772 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 49843.2us
I20260709 13:21:30.542007 14010 raft_consensus.cc:697] T 90d42e216d9741e190bca19a781291fd P cd75a17ab2604397adab03bb8b5fd75c [term 19 LEADER]: Becoming Leader. State: Replica: cd75a17ab2604397adab03bb8b5fd75c, State: Running, Role: LEADER
I20260709 13:21:30.590174  6875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3411566abe2d4c9bb4b2adfdd05e6f17" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:21:30.591040  6875 raft_consensus.cc:3060] T 3411566abe2d4c9bb4b2adfdd05e6f17 P cd75a17ab2604397adab03bb8b5fd75c [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:21:30.593469 14008 raft_consensus.cc:2804] T 4275cf08e63345f993bce8664eada830 P b7ab4784c7344b939bc36f639286f377 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:21:30.596674  6874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ba5dac66ab5497e9e336f2a3c28cda5" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:21:30.605934  6621 catalog_manager.cc:5697] T f03d0dbf16864ca4bc1bb5e4c0334c0f P b7ab4784c7344b939bc36f639286f377 reported cstate change: term changed from 5 to 15. New cstate: current_term: 15 leader_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } }
W20260709 13:21:30.608537 14016 log.cc:927] Time spent T 1bf4668eeb70467fb3dc5a0289233b3c P b7ab4784c7344b939bc36f639286f377: Append to log took a long time: real 0.077s	user 0.001s	sys 0.001s
I20260709 13:21:30.615303  6697 leader_election.cc:304] T 4d9def8b32fd443aa94ab1420b06837b P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377
I20260709 13:21:30.617292 13988 leader_election.cc:290] T 3411566abe2d4c9bb4b2adfdd05e6f17 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 20 election: Requested vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:21:30.622928 14010 consensus_queue.cc:237] T 90d42e216d9741e190bca19a781291fd P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.10, Last appended by leader: 10, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:30.625625  6844 leader_election.cc:304] T 1bf4668eeb70467fb3dc5a0289233b3c P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:21:30.603528  6695 leader_election.cc:304] T 3411566abe2d4c9bb4b2adfdd05e6f17 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
I20260709 13:21:30.579684  6807 consensus_queue.cc:260] T 1bf4668eeb70467fb3dc5a0289233b3c P b7ab4784c7344b939bc36f639286f377 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.12, Last appended by leader: 12, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:30.630208  6807 raft_consensus.cc:3060] T 1bf4668eeb70467fb3dc5a0289233b3c P b7ab4784c7344b939bc36f639286f377 [term 19 FOLLOWER]: Advancing to term 21
I20260709 13:21:30.634696  6880 raft_consensus.cc:1275] T d8292e16e5654be6bc408560cf256aaa P cd75a17ab2604397adab03bb8b5fd75c [term 21 FOLLOWER]: Refusing update from remote peer ccd8a4c3bfe3413cb2ae219b09aea832: Log matching property violated. Preceding OpId in replica: term: 19 index: 11. Preceding OpId from leader: term: 21 index: 12. (index mismatch)
I20260709 13:21:30.636747  6873 raft_consensus.cc:1275] T d33d5ee8ef6f415593d8df52063161ad P cd75a17ab2604397adab03bb8b5fd75c [term 20 FOLLOWER]: Refusing update from remote peer ccd8a4c3bfe3413cb2ae219b09aea832: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 20 index: 11. (index mismatch)
I20260709 13:21:30.558755 13946 raft_consensus.cc:697] T bd6869f07b5a4885a0b99fbe60c3b175 P cd75a17ab2604397adab03bb8b5fd75c [term 23 LEADER]: Becoming Leader. State: Replica: cd75a17ab2604397adab03bb8b5fd75c, State: Running, Role: LEADER
W20260709 13:21:30.639521  6770 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 94806.9us
I20260709 13:21:30.649487  6875 raft_consensus.cc:2468] T 3411566abe2d4c9bb4b2adfdd05e6f17 P cd75a17ab2604397adab03bb8b5fd75c [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 20.
I20260709 13:21:30.650563  6805 raft_consensus.cc:1275] T d33d5ee8ef6f415593d8df52063161ad P b7ab4784c7344b939bc36f639286f377 [term 20 FOLLOWER]: Refusing update from remote peer ccd8a4c3bfe3413cb2ae219b09aea832: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 20 index: 11. (index mismatch)
I20260709 13:21:30.652299  7498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ba5dac66ab5497e9e336f2a3c28cda5" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:21:30.660801  6801 raft_consensus.cc:1275] T de3186201e1a40d0b335eeb8b4e256e0 P b7ab4784c7344b939bc36f639286f377 [term 22 FOLLOWER]: Refusing update from remote peer ccd8a4c3bfe3413cb2ae219b09aea832: Log matching property violated. Preceding OpId in replica: term: 19 index: 10. Preceding OpId from leader: term: 22 index: 12. (index mismatch)
I20260709 13:21:30.666311  6807 raft_consensus.cc:2468] T 1bf4668eeb70467fb3dc5a0289233b3c P b7ab4784c7344b939bc36f639286f377 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 21.
I20260709 13:21:30.637867 13651 raft_consensus.cc:2804] T 3411566abe2d4c9bb4b2adfdd05e6f17 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:21:30.640751 13987 raft_consensus.cc:2804] T 4d9def8b32fd443aa94ab1420b06837b P ccd8a4c3bfe3413cb2ae219b09aea832 [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:21:30.641052 13865 raft_consensus.cc:2804] T 1bf4668eeb70467fb3dc5a0289233b3c P cd75a17ab2604397adab03bb8b5fd75c [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:21:30.670172 14017 consensus_queue.cc:1048] T f3f9c2e2bf644115957398fe4c9459db P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.006s
I20260709 13:21:30.671494 13697 consensus_queue.cc:1048] T d33d5ee8ef6f415593d8df52063161ad P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:21:30.671537 13651 raft_consensus.cc:697] T 3411566abe2d4c9bb4b2adfdd05e6f17 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 20 LEADER]: Becoming Leader. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
W20260709 13:21:30.672288  7468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 93672.7us
I20260709 13:21:30.645545 13999 raft_consensus.cc:2764] T 3411566abe2d4c9bb4b2adfdd05e6f17 P b7ab4784c7344b939bc36f639286f377 [term 20 FOLLOWER]: Leader pre-election decision vote started in defunct term 18: won
I20260709 13:21:30.647214 14008 raft_consensus.cc:697] T 4275cf08e63345f993bce8664eada830 P b7ab4784c7344b939bc36f639286f377 [term 21 LEADER]: Becoming Leader. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
I20260709 13:21:30.697814 14008 consensus_queue.cc:237] T 4275cf08e63345f993bce8664eada830 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.11, Last appended by leader: 11, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:30.698939 13651 consensus_queue.cc:237] T 3411566abe2d4c9bb4b2adfdd05e6f17 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 12, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:30.689317 13965 consensus_queue.cc:1048] T de3186201e1a40d0b335eeb8b4e256e0 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:21:30.689906  6770 leader_election.cc:304] T 4d9def8b32fd443aa94ab1420b06837b P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:21:30.692168 13865 raft_consensus.cc:697] T 1bf4668eeb70467fb3dc5a0289233b3c P cd75a17ab2604397adab03bb8b5fd75c [term 21 LEADER]: Becoming Leader. State: Replica: cd75a17ab2604397adab03bb8b5fd75c, State: Running, Role: LEADER
I20260709 13:21:30.693215  6772 leader_election.cc:304] T 7ba5dac66ab5497e9e336f2a3c28cda5 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:21:30.696623 13987 raft_consensus.cc:697] T 4d9def8b32fd443aa94ab1420b06837b P ccd8a4c3bfe3413cb2ae219b09aea832 [term 23 LEADER]: Becoming Leader. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
I20260709 13:21:30.708482 13987 consensus_queue.cc:237] T 4d9def8b32fd443aa94ab1420b06837b P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 21.11, Last appended by leader: 11, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:30.716534 13849 consensus_queue.cc:1048] T d8292e16e5654be6bc408560cf256aaa P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:21:30.718222 13946 consensus_queue.cc:237] T bd6869f07b5a4885a0b99fbe60c3b175 P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 22.11, Last appended by leader: 11, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:30.724952  6807 raft_consensus.cc:1275] T d8292e16e5654be6bc408560cf256aaa P b7ab4784c7344b939bc36f639286f377 [term 21 FOLLOWER]: Refusing update from remote peer ccd8a4c3bfe3413cb2ae219b09aea832: Log matching property violated. Preceding OpId in replica: term: 19 index: 11. Preceding OpId from leader: term: 21 index: 12. (index mismatch)
I20260709 13:21:30.707293 13295 raft_consensus.cc:2749] T 4d9def8b32fd443aa94ab1420b06837b P b7ab4784c7344b939bc36f639286f377 [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260709 13:21:30.737537  6844 leader_election.cc:304] T 1bf4668eeb70467fb3dc5a0289233b3c P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:21:30.757154  6844 leader_election.cc:304] T 3411566abe2d4c9bb4b2adfdd05e6f17 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:21:30.758492  6844 leader_election.cc:400] T 7c44c4849aa54f2b94d1f1bef9ed546f P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 22 election: Vote denied by peer b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817) with higher term. Message: Invalid argument: T 7c44c4849aa54f2b94d1f1bef9ed546f P b7ab4784c7344b939bc36f639286f377 [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c for earlier term 22. Current term is 23.
I20260709 13:21:30.758782  6844 leader_election.cc:403] T 7c44c4849aa54f2b94d1f1bef9ed546f P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 22 election: Cancelling election due to peer responding with higher term
I20260709 13:21:30.739828  6872 raft_consensus.cc:1240] T 90d42e216d9741e190bca19a781291fd P cd75a17ab2604397adab03bb8b5fd75c [term 19 LEADER]: Rejecting Update request from peer b7ab4784c7344b939bc36f639286f377 for earlier term 18. Current term is 19. Ops: []
I20260709 13:21:30.742008 14003 consensus_queue.cc:1048] T d33d5ee8ef6f415593d8df52063161ad P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.014s
I20260709 13:21:30.746528 13865 consensus_queue.cc:237] T 1bf4668eeb70467fb3dc5a0289233b3c P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.12, Last appended by leader: 12, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
W20260709 13:21:30.747682  6772 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.68:45071, user_credentials={real_user=slave}} blocked reactor thread for 54549.2us
I20260709 13:21:30.749468  6801 raft_consensus.cc:1275] T 4f00a2e87e56452083b759f60d461ee3 P b7ab4784c7344b939bc36f639286f377 [term 22 FOLLOWER]: Refusing update from remote peer 7ba59cc884714e8aa5f3f0ecaed84cbb: Log matching property violated. Preceding OpId in replica: term: 20 index: 14. Preceding OpId from leader: term: 22 index: 15. (index mismatch)
I20260709 13:21:30.750428 13999 raft_consensus.cc:2749] T 7ba5dac66ab5497e9e336f2a3c28cda5 P b7ab4784c7344b939bc36f639286f377 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:21:30.783682 14010 raft_consensus.cc:2764] T 3411566abe2d4c9bb4b2adfdd05e6f17 P cd75a17ab2604397adab03bb8b5fd75c [term 20 FOLLOWER]: Leader pre-election decision vote started in defunct term 19: won
I20260709 13:21:30.732656 13890 consensus_queue.cc:1048] T d8292e16e5654be6bc408560cf256aaa P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.047s
I20260709 13:21:30.791903  6873 raft_consensus.cc:1275] T de3186201e1a40d0b335eeb8b4e256e0 P cd75a17ab2604397adab03bb8b5fd75c [term 22 FOLLOWER]: Refusing update from remote peer ccd8a4c3bfe3413cb2ae219b09aea832: Log matching property violated. Preceding OpId in replica: term: 19 index: 10. Preceding OpId from leader: term: 22 index: 12. (index mismatch)
I20260709 13:21:30.802867 13870 consensus_queue.cc:1048] T 4f00a2e87e56452083b759f60d461ee3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.022s
I20260709 13:21:30.814369  6844 leader_election.cc:304] T f09c2a98de1a4decabd0ff900dd44caa P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:21:30.796932 14011 raft_consensus.cc:2749] T 7c44c4849aa54f2b94d1f1bef9ed546f P cd75a17ab2604397adab03bb8b5fd75c [term 23 FOLLOWER]: Leader election lost for term 22. Reason: Vote denied by peer b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817) with higher term. Message: Invalid argument: T 7c44c4849aa54f2b94d1f1bef9ed546f P b7ab4784c7344b939bc36f639286f377 [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c for earlier term 22. Current term is 23.
I20260709 13:21:30.829514 13998 raft_consensus.cc:2749] T 1bf4668eeb70467fb3dc5a0289233b3c P cd75a17ab2604397adab03bb8b5fd75c [term 21 LEADER]: Leader election lost for term 20. Reason: could not achieve majority
W20260709 13:21:30.834887  6770 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 45430.3us
I20260709 13:21:30.821017 13987 consensus_queue.cc:1048] T de3186201e1a40d0b335eeb8b4e256e0 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.015s
I20260709 13:21:30.829612 14010 raft_consensus.cc:2804] T f09c2a98de1a4decabd0ff900dd44caa P cd75a17ab2604397adab03bb8b5fd75c [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:21:30.899948  6803 raft_consensus.cc:1275] T 1528ab62b6fe4e3099d08f141afee116 P b7ab4784c7344b939bc36f639286f377 [term 19 FOLLOWER]: Refusing update from remote peer ccd8a4c3bfe3413cb2ae219b09aea832: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 13:21:30.896095 14010 raft_consensus.cc:697] T f09c2a98de1a4decabd0ff900dd44caa P cd75a17ab2604397adab03bb8b5fd75c [term 23 LEADER]: Becoming Leader. State: Replica: cd75a17ab2604397adab03bb8b5fd75c, State: Running, Role: LEADER
I20260709 13:21:30.944417  6879 raft_consensus.cc:1275] T 4f00a2e87e56452083b759f60d461ee3 P cd75a17ab2604397adab03bb8b5fd75c [term 22 FOLLOWER]: Refusing update from remote peer 7ba59cc884714e8aa5f3f0ecaed84cbb: Log matching property violated. Preceding OpId in replica: term: 20 index: 14. Preceding OpId from leader: term: 22 index: 15. (index mismatch)
I20260709 13:21:30.914569 13965 consensus_queue.cc:1048] T 1528ab62b6fe4e3099d08f141afee116 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.049s
I20260709 13:21:30.978335  6872 raft_consensus.cc:1275] T 7c44c4849aa54f2b94d1f1bef9ed546f P cd75a17ab2604397adab03bb8b5fd75c [term 23 FOLLOWER]: Refusing update from remote peer ccd8a4c3bfe3413cb2ae219b09aea832: Log matching property violated. Preceding OpId in replica: term: 21 index: 14. Preceding OpId from leader: term: 23 index: 15. (index mismatch)
W20260709 13:21:31.033603  6770 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 119651us
W20260709 13:21:31.031095 14029 log.cc:927] Time spent T 3411566abe2d4c9bb4b2adfdd05e6f17 P ccd8a4c3bfe3413cb2ae219b09aea832: Append to log took a long time: real 0.051s	user 0.001s	sys 0.000s
W20260709 13:21:31.045301  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 113722us
I20260709 13:21:31.055420  6806 raft_consensus.cc:1275] T 7c44c4849aa54f2b94d1f1bef9ed546f P b7ab4784c7344b939bc36f639286f377 [term 23 FOLLOWER]: Refusing update from remote peer ccd8a4c3bfe3413cb2ae219b09aea832: Log matching property violated. Preceding OpId in replica: term: 21 index: 14. Preceding OpId from leader: term: 23 index: 15. (index mismatch)
I20260709 13:21:31.074581  6730 raft_consensus.cc:1275] T 44bde925b2e541b69890d70715b85176 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 21 FOLLOWER]: Refusing update from remote peer cd75a17ab2604397adab03bb8b5fd75c: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 21 index: 13. (index mismatch)
I20260709 13:21:31.086436  5625 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:21:31.035576 14003 consensus_queue.cc:1048] T 7c44c4849aa54f2b94d1f1bef9ed546f P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.024s
I20260709 13:21:31.062083 13839 consensus_queue.cc:1048] T 4f00a2e87e56452083b759f60d461ee3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.113s
W20260709 13:21:31.235955 14023 log.cc:927] Time spent T f3f9c2e2bf644115957398fe4c9459db P cd75a17ab2604397adab03bb8b5fd75c: Append to log took a long time: real 0.105s	user 0.001s	sys 0.000s
W20260709 13:21:31.555135  6873 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.503s	user 0.037s	sys 0.119s
W20260709 13:21:31.555680  6873 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.504s	user 0.037s	sys 0.119s
I20260709 13:21:31.061504 14010 consensus_queue.cc:237] T f09c2a98de1a4decabd0ff900dd44caa P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 22.13, Last appended by leader: 13, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:31.453094 13849 consensus_queue.cc:1048] T 7c44c4849aa54f2b94d1f1bef9ed546f P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
W20260709 13:21:31.590480  6846 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.535s	user 0.044s	sys 0.088s
W20260709 13:21:31.598147  6846 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.543s	user 0.044s	sys 0.088s
W20260709 13:21:31.709735  6805 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.576s	user 0.077s	sys 0.160s
W20260709 13:21:31.710220  6805 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.623s	user 0.077s	sys 0.160s
I20260709 13:21:31.660630 13684 raft_consensus.cc:493] T 34f36d59d88f40fe8a2805e604fc6c0a P b7ab4784c7344b939bc36f639286f377 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:31.727104 13697 raft_consensus.cc:493] T 404190ce4ce94cecbfcb6ea9d1dd8626 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
W20260709 13:21:31.732152 14034 log.cc:927] Time spent T f3f9c2e2bf644115957398fe4c9459db P ccd8a4c3bfe3413cb2ae219b09aea832: Append to log took a long time: real 0.170s	user 0.001s	sys 0.000s
W20260709 13:21:31.732991 14031 log.cc:927] Time spent T bd6869f07b5a4885a0b99fbe60c3b175 P cd75a17ab2604397adab03bb8b5fd75c: Append to log took a long time: real 0.541s	user 0.000s	sys 0.000s
W20260709 13:21:31.733781 14030 log.cc:927] Time spent T d8292e16e5654be6bc408560cf256aaa P cd75a17ab2604397adab03bb8b5fd75c: Append to log took a long time: real 0.602s	user 0.000s	sys 0.001s
W20260709 13:21:31.734673 14032 log.cc:927] Time spent T 4275cf08e63345f993bce8664eada830 P b7ab4784c7344b939bc36f639286f377: Append to log took a long time: real 0.475s	user 0.001s	sys 0.000s
W20260709 13:21:31.805121  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 722099us
I20260709 13:21:31.813320  6880 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53416 (request call id 3970) took 1086 ms. Trace:
I20260709 13:21:31.813910  6880 rpcz_store.cc:276] 0709 13:21:30.727073 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:21:30.727227 (+   154us) service_pool.cc:224] Handling call
0709 13:21:30.727510 (+   283us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:21:30.727845 (+   335us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:21:30.727870 (+    25us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:21:30.728829 (+   959us) log.cc:844] Serialized 26 byte log entry
0709 13:21:30.771929 (+ 43100us) spinlock_profiling.cc:243] Waited 2.61 ms on lock 0x7b1800485200. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc15785de1 00007fcc157925b1 00007fcc0c89fe07 00007fcc156faab9 00007fcc0c8bc69b 00007fcc0c8ba93f 00007fcc0c8bcc02 00007fcc0f54420b 00007fcc0f549d23 00007fcc0f54a0d1 00007fcc0f965a0f
0709 13:21:30.960658 (+188729us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:21:30.960712 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:21:30.960794 (+    82us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:21:31.812953 (+852159us) raft_consensus.cc:1685] finished
0709 13:21:31.812976 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:21:31.813188 (+   212us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":23460,"raft.queue_time_us":2738,"raft.run_cpu_time_us":254,"raft.run_wall_time_us":7337,"spinlock_wait_cycles":6942848,"thread_start_us":187882,"threads_started":1,"wal-append.queue_time_us":295685}
I20260709 13:21:31.826329  6801 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:32976 (request call id 4054) took 1044 ms. Trace:
I20260709 13:21:31.756251 13684 raft_consensus.cc:515] T 34f36d59d88f40fe8a2805e604fc6c0a P b7ab4784c7344b939bc36f639286f377 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:31.826843  6801 rpcz_store.cc:276] 0709 13:21:30.781916 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:21:30.782087 (+   171us) service_pool.cc:224] Handling call
0709 13:21:30.796318 (+ 14231us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:21:30.817178 (+ 20860us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:21:30.817235 (+    57us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:21:30.838173 (+ 20938us) log.cc:844] Serialized 52 byte log entry
0709 13:21:31.054654 (+216481us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:21:31.054727 (+    73us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:21:31.054824 (+    97us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:21:31.825986 (+771162us) raft_consensus.cc:1685] finished
0709 13:21:31.826020 (+    34us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:21:31.826251 (+   231us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":26907,"raft.queue_time_us":27865,"raft.run_cpu_time_us":227,"raft.run_wall_time_us":8128,"thread_start_us":161438,"threads_started":1,"wal-append.queue_time_us":815015}
I20260709 13:21:31.829248 13684 leader_election.cc:290] T 34f36d59d88f40fe8a2805e604fc6c0a P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:21:31.831521  6732 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50004 (request call id 3387) took 1089 ms. Trace:
I20260709 13:21:31.831982  6732 rpcz_store.cc:276] 0709 13:21:30.741621 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:21:30.742062 (+   441us) service_pool.cc:224] Handling call
0709 13:21:30.742481 (+   419us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:21:30.768650 (+ 26169us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:21:30.768699 (+    49us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:21:30.782238 (+ 13539us) log.cc:844] Serialized 52 byte log entry
0709 13:21:31.036398 (+254160us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:21:31.234997 (+198599us) log.cc:844] Serialized 14 byte log entry
0709 13:21:31.235670 (+   673us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:21:31.235958 (+   288us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:21:31.831249 (+595291us) raft_consensus.cc:1685] finished
0709 13:21:31.831273 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:21:31.831425 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":18470,"prepare.queue_time_us":623310,"prepare.run_cpu_time_us":80,"prepare.run_wall_time_us":7144,"raft.queue_time_us":338424,"raft.run_cpu_time_us":320,"raft.run_wall_time_us":9776,"thread_start_us":432587,"threads_started":2,"wal-append.queue_time_us":384499}
I20260709 13:21:31.846108 14046 consensus_queue.cc:1048] T 44bde925b2e541b69890d70715b85176 P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Connected to new peer: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:21:31.848232  6805 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:32976 (request call id 4056) took 1016 ms. Trace:
I20260709 13:21:31.848683  6805 rpcz_store.cc:276] 0709 13:21:30.832135 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:21:30.832299 (+   164us) service_pool.cc:224] Handling call
0709 13:21:30.832702 (+   403us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:21:30.866561 (+ 33859us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:21:30.866592 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:21:31.031440 (+164848us) spinlock_profiling.cc:243] Waited 34.2 ms on lock 0x7b2c00117598. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0e2a3a11 00007fcc0e2b3372 00007fcc0f9e5a01 00007fcc0f9aa43a 00007fcc0f9a983e 00007fcc1496e419 00007fcc0dee5bd4 00007fcc0dee5b62 00007fcc0dee5a91 00007fcc0dee5a0c 00007fcc0dee4cc2
0709 13:21:31.038391 (+  6951us) log.cc:844] Serialized 26 byte log entry
0709 13:21:31.710665 (+672274us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:21:31.710724 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:21:31.710821 (+    97us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:21:31.836110 (+125289us) raft_consensus.cc:1685] finished
0709 13:21:31.836245 (+   135us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:21:31.848155 (+ 11910us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":33386,"raft.queue_time_us":33913,"raft.run_cpu_time_us":105,"raft.run_wall_time_us":106,"spinlock_wait_cycles":78585728,"thread_start_us":628798,"threads_started":1,"wal-append.queue_time_us":761709}
I20260709 13:21:31.854677  6807 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50550 (request call id 874) took 1039 ms. Trace:
I20260709 13:21:31.855208  6807 rpcz_store.cc:276] 0709 13:21:30.815633 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:21:30.815862 (+   229us) service_pool.cc:224] Handling call
0709 13:21:30.816305 (+   443us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:21:30.845471 (+ 29166us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:21:30.845509 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:21:30.857644 (+ 12135us) log.cc:844] Serialized 26 byte log entry
0709 13:21:31.034778 (+177134us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:21:31.036871 (+  2093us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:21:31.036978 (+   107us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:21:31.854347 (+817369us) raft_consensus.cc:1685] finished
0709 13:21:31.854375 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:21:31.854599 (+   224us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":18144,"raft.queue_time_us":49199,"raft.run_cpu_time_us":110,"raft.run_wall_time_us":110,"thread_start_us":174916,"threads_started":1,"wal-append.queue_time_us":908057}
I20260709 13:21:31.872166  6729 raft_consensus.cc:1275] T 4275cf08e63345f993bce8664eada830 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 21 FOLLOWER]: Refusing update from remote peer b7ab4784c7344b939bc36f639286f377: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 21 index: 12. (index mismatch)
I20260709 13:21:31.920241  6807 raft_consensus.cc:1275] T f5be3a11b23d4ea9b08300a2789821c7 P b7ab4784c7344b939bc36f639286f377 [term 20 FOLLOWER]: Refusing update from remote peer ccd8a4c3bfe3413cb2ae219b09aea832: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
I20260709 13:21:31.870724 13886 raft_consensus.cc:493] T a1704639a875409b9959353527b3fd68 P cd75a17ab2604397adab03bb8b5fd75c [term 22 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:21:31.882633 13849 raft_consensus.cc:493] T f09c2a98de1a4decabd0ff900dd44caa P ccd8a4c3bfe3413cb2ae219b09aea832 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:21:31.927224  7498 raft_consensus.cc:1275] T 1528ab62b6fe4e3099d08f141afee116 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 19 FOLLOWER]: Refusing update from remote peer ccd8a4c3bfe3413cb2ae219b09aea832: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 13:21:31.892202 13697 raft_consensus.cc:515] T 404190ce4ce94cecbfcb6ea9d1dd8626 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:21:31.922282 13996 raft_consensus.cc:493] T dbdf895bba214ff68685a24fd17dfb5d P b7ab4784c7344b939bc36f639286f377 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:21:31.947822  6805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "404190ce4ce94cecbfcb6ea9d1dd8626" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:21:31.955168  7498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "404190ce4ce94cecbfcb6ea9d1dd8626" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:21:31.929904 13886 raft_consensus.cc:515] T a1704639a875409b9959353527b3fd68 P cd75a17ab2604397adab03bb8b5fd75c [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
W20260709 13:21:31.960250  6696 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.708s	user 0.000s	sys 0.010s
W20260709 13:21:31.960665  6696 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.791s	user 0.000s	sys 0.011s
I20260709 13:21:31.960777  6724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34f36d59d88f40fe8a2805e604fc6c0a" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:21:31.961457  6724 raft_consensus.cc:2468] T 34f36d59d88f40fe8a2805e604fc6c0a P ccd8a4c3bfe3413cb2ae219b09aea832 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 19.
I20260709 13:21:31.961565 13886 leader_election.cc:290] T a1704639a875409b9959353527b3fd68 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:21:31.963039 13996 raft_consensus.cc:515] T dbdf895bba214ff68685a24fd17dfb5d P b7ab4784c7344b939bc36f639286f377 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:31.965595 13996 leader_election.cc:290] T dbdf895bba214ff68685a24fd17dfb5d P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:21:31.943014 13849 raft_consensus.cc:515] T f09c2a98de1a4decabd0ff900dd44caa P ccd8a4c3bfe3413cb2ae219b09aea832 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:31.974786 13849 leader_election.cc:290] T f09c2a98de1a4decabd0ff900dd44caa P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:21:31.938856 14059 raft_consensus.cc:493] T 1528ab62b6fe4e3099d08f141afee116 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:31.982354 13295 raft_consensus.cc:493] T f5be3a11b23d4ea9b08300a2789821c7 P b7ab4784c7344b939bc36f639286f377 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:31.983006 13295 raft_consensus.cc:515] T f5be3a11b23d4ea9b08300a2789821c7 P b7ab4784c7344b939bc36f639286f377 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:31.987275 14064 raft_consensus.cc:493] T fe20b4b48823486ca3b9c648db6ce8aa P cd75a17ab2604397adab03bb8b5fd75c [term 16 FOLLOWER]: Starting pre-election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:21:31.985757 14067 raft_consensus.cc:493] T 2c240553ce044eedb41541d72b9475d7 P cd75a17ab2604397adab03bb8b5fd75c [term 21 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:21:31.987984 14064 raft_consensus.cc:515] T fe20b4b48823486ca3b9c648db6ce8aa P cd75a17ab2604397adab03bb8b5fd75c [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:21:31.988241 14067 raft_consensus.cc:515] T 2c240553ce044eedb41541d72b9475d7 P cd75a17ab2604397adab03bb8b5fd75c [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:31.991052 14064 leader_election.cc:290] T fe20b4b48823486ca3b9c648db6ce8aa P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:21:31.946587 13697 leader_election.cc:290] T 404190ce4ce94cecbfcb6ea9d1dd8626 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:21:31.948632 13998 raft_consensus.cc:493] T 34f36d59d88f40fe8a2805e604fc6c0a P cd75a17ab2604397adab03bb8b5fd75c [term 18 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:21:31.997254 13998 raft_consensus.cc:515] T 34f36d59d88f40fe8a2805e604fc6c0a P cd75a17ab2604397adab03bb8b5fd75c [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:31.999516 14053 raft_consensus.cc:493] T be1a92657f494cac8dd227d152f50151 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 23 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:21:32.000218 14053 raft_consensus.cc:515] T be1a92657f494cac8dd227d152f50151 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:21:32.002687 14053 leader_election.cc:290] T be1a92657f494cac8dd227d152f50151 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
W20260709 13:21:32.004168  6695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 47504.3us
I20260709 13:21:32.005744 13295 leader_election.cc:290] T f5be3a11b23d4ea9b08300a2789821c7 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:21:31.999742 13998 leader_election.cc:290] T 34f36d59d88f40fe8a2805e604fc6c0a P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:21:32.011200  6803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be1a92657f494cac8dd227d152f50151" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:21:31.966161 13996 raft_consensus.cc:493] T 22ccee1b570c4ad3a57bd7aec085b1b4 P b7ab4784c7344b939bc36f639286f377 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader cd75a17ab2604397adab03bb8b5fd75c)
I20260709 13:21:32.049716  6874 raft_consensus.cc:1275] T f5be3a11b23d4ea9b08300a2789821c7 P cd75a17ab2604397adab03bb8b5fd75c [term 20 FOLLOWER]: Refusing update from remote peer ccd8a4c3bfe3413cb2ae219b09aea832: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
I20260709 13:21:32.011338 14067 leader_election.cc:290] T 2c240553ce044eedb41541d72b9475d7 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:21:32.068593  6726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be1a92657f494cac8dd227d152f50151" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:21:32.067075  6730 raft_consensus.cc:1275] T 1bf4668eeb70467fb3dc5a0289233b3c P ccd8a4c3bfe3413cb2ae219b09aea832 [term 21 FOLLOWER]: Refusing update from remote peer cd75a17ab2604397adab03bb8b5fd75c: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 21 index: 13. (index mismatch)
I20260709 13:21:32.069482  6726 raft_consensus.cc:2468] T be1a92657f494cac8dd227d152f50151 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in term 23.
I20260709 13:21:32.073573  6875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34f36d59d88f40fe8a2805e604fc6c0a" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:21:32.008878 13965 consensus_queue.cc:1048] T 1528ab62b6fe4e3099d08f141afee116 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.047s
I20260709 13:21:32.075233  6875 raft_consensus.cc:2468] T 34f36d59d88f40fe8a2805e604fc6c0a P cd75a17ab2604397adab03bb8b5fd75c [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 18.
I20260709 13:21:32.076640  6872 raft_consensus.cc:1275] T 3411566abe2d4c9bb4b2adfdd05e6f17 P cd75a17ab2604397adab03bb8b5fd75c [term 20 FOLLOWER]: Refusing update from remote peer ccd8a4c3bfe3413cb2ae219b09aea832: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 20 index: 13. (index mismatch)
I20260709 13:21:32.081040  6726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c240553ce044eedb41541d72b9475d7" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:21:32.084751  6728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe20b4b48823486ca3b9c648db6ce8aa" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:21:32.085988  6724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1704639a875409b9959353527b3fd68" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:21:32.093078  6875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09c2a98de1a4decabd0ff900dd44caa" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:21:32.104115  6731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34f36d59d88f40fe8a2805e604fc6c0a" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:21:32.105291  6731 raft_consensus.cc:2393] T 34f36d59d88f40fe8a2805e604fc6c0a P ccd8a4c3bfe3413cb2ae219b09aea832 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c in current term 19: Already voted for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in this term.
I20260709 13:21:31.976022 14059 raft_consensus.cc:515] T 1528ab62b6fe4e3099d08f141afee116 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:21:32.078297 13651 raft_consensus.cc:493] T be1a92657f494cac8dd227d152f50151 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:21:32.109917 13651 raft_consensus.cc:515] T be1a92657f494cac8dd227d152f50151 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
W20260709 13:21:32.111002 14073 log.cc:927] Time spent T de3186201e1a40d0b335eeb8b4e256e0 P ccd8a4c3bfe3413cb2ae219b09aea832: Append to log took a long time: real 0.064s	user 0.001s	sys 0.000s
I20260709 13:21:32.125061  6878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbdf895bba214ff68685a24fd17dfb5d" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 21 candidate_status { last_received { term: 20 index: 9 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:21:32.128281 14037 raft_consensus.cc:493] T 90d42e216d9741e190bca19a781291fd P b7ab4784c7344b939bc36f639286f377 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:32.077557 14074 raft_consensus.cc:493] T f58dc08b12a2494bb9a1372837970ca2 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:21:32.095310 13926 raft_consensus.cc:493] T 7a734b5ab7834e05a8c422208acc58b1 P b7ab4784c7344b939bc36f639286f377 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 7ba59cc884714e8aa5f3f0ecaed84cbb)
I20260709 13:21:32.142580  7498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe20b4b48823486ca3b9c648db6ce8aa" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:21:32.135293 14037 raft_consensus.cc:515] T 90d42e216d9741e190bca19a781291fd P b7ab4784c7344b939bc36f639286f377 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
W20260709 13:21:32.202847  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 71931.3us
I20260709 13:21:32.073350 13996 raft_consensus.cc:515] T 22ccee1b570c4ad3a57bd7aec085b1b4 P b7ab4784c7344b939bc36f639286f377 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
W20260709 13:21:32.212268  6846 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.68:45071, user_credentials={real_user=slave}} blocked reactor thread for 61778.6us
I20260709 13:21:32.207231  6770 leader_election.cc:304] T 34f36d59d88f40fe8a2805e604fc6c0a P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
W20260709 13:21:32.216130  7466 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 139834us
I20260709 13:21:32.217016  6878 raft_consensus.cc:1275] T 4275cf08e63345f993bce8664eada830 P cd75a17ab2604397adab03bb8b5fd75c [term 21 FOLLOWER]: Refusing update from remote peer b7ab4784c7344b939bc36f639286f377: Log matching property violated. Preceding OpId in replica: term: 19 index: 11. Preceding OpId from leader: term: 21 index: 12. (index mismatch)
I20260709 13:21:32.217298  7466 leader_election.cc:304] T be1a92657f494cac8dd227d152f50151 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: b7ab4784c7344b939bc36f639286f377
W20260709 13:21:32.204350  7468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 126900us
W20260709 13:21:32.304286  6846 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.68:45071, user_credentials={real_user=slave}} blocked reactor thread for 91135.6us
W20260709 13:21:32.320075  6697 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 60634us
I20260709 13:21:32.321734  6726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbdf895bba214ff68685a24fd17dfb5d" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 21 candidate_status { last_received { term: 20 index: 9 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:21:32.211721 13988 raft_consensus.cc:493] T 1bf4668eeb70467fb3dc5a0289233b3c P ccd8a4c3bfe3413cb2ae219b09aea832 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:32.336724  6874 raft_consensus.cc:1275] T 4d9def8b32fd443aa94ab1420b06837b P cd75a17ab2604397adab03bb8b5fd75c [term 23 FOLLOWER]: Refusing update from remote peer ccd8a4c3bfe3413cb2ae219b09aea832: Log matching property violated. Preceding OpId in replica: term: 21 index: 11. Preceding OpId from leader: term: 23 index: 12. (index mismatch)
I20260709 13:21:32.349354  6726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5be3a11b23d4ea9b08300a2789821c7" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 21 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:21:32.310312 13925 raft_consensus.cc:2804] T 34f36d59d88f40fe8a2805e604fc6c0a P b7ab4784c7344b939bc36f639286f377 [term 19 FOLLOWER]: Leader pre-election won for term 20
W20260709 13:21:32.362823  7468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 144086us
W20260709 13:21:32.370419  7466 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 153184us
I20260709 13:21:32.363240 13914 raft_consensus.cc:493] T 17587d6730594da4a56fa13a353232a1 P b7ab4784c7344b939bc36f639286f377 [term 26 FOLLOWER]: Starting pre-election (detected failure of leader 7ba59cc884714e8aa5f3f0ecaed84cbb)
I20260709 13:21:32.372537 13588 raft_consensus.cc:493] T 4275cf08e63345f993bce8664eada830 P cd75a17ab2604397adab03bb8b5fd75c [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:32.372895 13914 raft_consensus.cc:515] T 17587d6730594da4a56fa13a353232a1 P b7ab4784c7344b939bc36f639286f377 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:21:32.373163 13588 raft_consensus.cc:515] T 4275cf08e63345f993bce8664eada830 P cd75a17ab2604397adab03bb8b5fd75c [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:32.375315 14066 consensus_queue.cc:1048] T 1bf4668eeb70467fb3dc5a0289233b3c P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Connected to new peer: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.164s
I20260709 13:21:32.372291 14075 consensus_queue.cc:1048] T f5be3a11b23d4ea9b08300a2789821c7 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.266s
I20260709 13:21:32.385977  6807 raft_consensus.cc:1275] T bd6869f07b5a4885a0b99fbe60c3b175 P b7ab4784c7344b939bc36f639286f377 [term 23 FOLLOWER]: Refusing update from remote peer cd75a17ab2604397adab03bb8b5fd75c: Log matching property violated. Preceding OpId in replica: term: 22 index: 11. Preceding OpId from leader: term: 23 index: 12. (index mismatch)
I20260709 13:21:32.387599  6805 raft_consensus.cc:1275] T 1bf4668eeb70467fb3dc5a0289233b3c P b7ab4784c7344b939bc36f639286f377 [term 21 FOLLOWER]: Refusing update from remote peer cd75a17ab2604397adab03bb8b5fd75c: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 21 index: 13. (index mismatch)
I20260709 13:21:32.388664  6803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1704639a875409b9959353527b3fd68" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:21:32.389742  6804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34f36d59d88f40fe8a2805e604fc6c0a" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:21:32.389928  6806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c240553ce044eedb41541d72b9475d7" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:21:32.203933 14074 raft_consensus.cc:515] T f58dc08b12a2494bb9a1372837970ca2 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:32.470837  6727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17587d6730594da4a56fa13a353232a1" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 27 candidate_status { last_received { term: 26 index: 18 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:21:32.353688 14061 raft_consensus.cc:493] T bd6869f07b5a4885a0b99fbe60c3b175 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:32.509289  6801 raft_consensus.cc:1275] T 90d42e216d9741e190bca19a781291fd P b7ab4784c7344b939bc36f639286f377 [term 19 FOLLOWER]: Refusing update from remote peer cd75a17ab2604397adab03bb8b5fd75c: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
I20260709 13:21:32.357630 13927 raft_consensus.cc:493] T 713b5728a197487c9300b310ab94e5a3 P b7ab4784c7344b939bc36f639286f377 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader cd75a17ab2604397adab03bb8b5fd75c)
I20260709 13:21:32.373662 14058 consensus_queue.cc:1048] T 4275cf08e63345f993bce8664eada830 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.301s
I20260709 13:21:32.245052 13926 raft_consensus.cc:515] T 7a734b5ab7834e05a8c422208acc58b1 P b7ab4784c7344b939bc36f639286f377 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } attrs { replace: true } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:21:32.375236 13588 leader_election.cc:290] T 4275cf08e63345f993bce8664eada830 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:21:32.365947 13925 raft_consensus.cc:493] T 34f36d59d88f40fe8a2805e604fc6c0a P b7ab4784c7344b939bc36f639286f377 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:32.375911 14021 raft_consensus.cc:2804] T be1a92657f494cac8dd227d152f50151 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:21:32.510106  6799 raft_consensus.cc:1275] T 44bde925b2e541b69890d70715b85176 P b7ab4784c7344b939bc36f639286f377 [term 21 FOLLOWER]: Refusing update from remote peer cd75a17ab2604397adab03bb8b5fd75c: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 21 index: 13. (index mismatch)
I20260709 13:21:32.549602  6875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5be3a11b23d4ea9b08300a2789821c7" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 21 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:21:32.375345 13914 leader_election.cc:290] T 17587d6730594da4a56fa13a353232a1 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:21:32.420797 13990 raft_consensus.cc:493] T bd6869f07b5a4885a0b99fbe60c3b175 P b7ab4784c7344b939bc36f639286f377 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:32.568758  6875 raft_consensus.cc:2468] T f5be3a11b23d4ea9b08300a2789821c7 P cd75a17ab2604397adab03bb8b5fd75c [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 20.
I20260709 13:21:32.441816 13684 raft_consensus.cc:493] T d8292e16e5654be6bc408560cf256aaa P b7ab4784c7344b939bc36f639286f377 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
W20260709 13:21:32.554463 14034 log.cc:927] Time spent T f3f9c2e2bf644115957398fe4c9459db P ccd8a4c3bfe3413cb2ae219b09aea832: Append to log took a long time: real 0.139s	user 0.000s	sys 0.001s
I20260709 13:21:32.510056 13896 consensus_queue.cc:1048] T 3411566abe2d4c9bb4b2adfdd05e6f17 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.154s
I20260709 13:21:32.355763 13988 raft_consensus.cc:515] T 1bf4668eeb70467fb3dc5a0289233b3c P ccd8a4c3bfe3413cb2ae219b09aea832 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:32.626586 14065 raft_consensus.cc:493] T f03d0dbf16864ca4bc1bb5e4c0334c0f P cd75a17ab2604397adab03bb8b5fd75c [term 19 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:21:32.557382 13651 leader_election.cc:290] T be1a92657f494cac8dd227d152f50151 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:21:32.573838 13925 raft_consensus.cc:3060] T 34f36d59d88f40fe8a2805e604fc6c0a P b7ab4784c7344b939bc36f639286f377 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:21:32.573212 14021 raft_consensus.cc:493] T be1a92657f494cac8dd227d152f50151 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 23 FOLLOWER]: Starting leader election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
W20260709 13:21:32.719179  6695 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.597s	user 0.004s	sys 0.012s
W20260709 13:21:32.781716  6695 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.668s	user 0.004s	sys 0.032s
W20260709 13:21:32.782239  6695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 687987us
I20260709 13:21:32.555558 13927 raft_consensus.cc:515] T 713b5728a197487c9300b310ab94e5a3 P b7ab4784c7344b939bc36f639286f377 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:32.710135 14065 raft_consensus.cc:515] T f03d0dbf16864ca4bc1bb5e4c0334c0f P cd75a17ab2604397adab03bb8b5fd75c [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:32.661280 13684 raft_consensus.cc:515] T d8292e16e5654be6bc408560cf256aaa P b7ab4784c7344b939bc36f639286f377 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:32.628371 13990 raft_consensus.cc:515] T bd6869f07b5a4885a0b99fbe60c3b175 P b7ab4784c7344b939bc36f639286f377 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:32.543474 14061 raft_consensus.cc:515] T bd6869f07b5a4885a0b99fbe60c3b175 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:32.814052 14065 leader_election.cc:290] T f03d0dbf16864ca4bc1bb5e4c0334c0f P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
W20260709 13:21:32.816084 14044 log.cc:927] Time spent T de3186201e1a40d0b335eeb8b4e256e0 P cd75a17ab2604397adab03bb8b5fd75c: Append to log took a long time: real 0.146s	user 0.001s	sys 0.000s
I20260709 13:21:32.816809 13927 leader_election.cc:290] T 713b5728a197487c9300b310ab94e5a3 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
W20260709 13:21:32.819219 14076 log.cc:927] Time spent T 4f00a2e87e56452083b759f60d461ee3 P 7ba59cc884714e8aa5f3f0ecaed84cbb: Append to log took a long time: real 0.108s	user 0.000s	sys 0.000s
I20260709 13:21:32.786373 14021 raft_consensus.cc:3060] T be1a92657f494cac8dd227d152f50151 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:21:32.847234  7498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17587d6730594da4a56fa13a353232a1" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 27 candidate_status { last_received { term: 26 index: 18 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:21:32.798660 14060 consensus_queue.cc:1048] T f5be3a11b23d4ea9b08300a2789821c7 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.400s
I20260709 13:21:32.859768 14061 leader_election.cc:290] T bd6869f07b5a4885a0b99fbe60c3b175 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:21:32.861531  6801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09c2a98de1a4decabd0ff900dd44caa" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:21:32.862250  6695 leader_election.cc:304] T 404190ce4ce94cecbfcb6ea9d1dd8626 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, b7ab4784c7344b939bc36f639286f377
I20260709 13:21:32.862386  6801 raft_consensus.cc:2393] T f09c2a98de1a4decabd0ff900dd44caa P b7ab4784c7344b939bc36f639286f377 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ccd8a4c3bfe3413cb2ae219b09aea832 in current term 23: Already voted for candidate cd75a17ab2604397adab03bb8b5fd75c in this term.
I20260709 13:21:32.863109 13593 raft_consensus.cc:493] T e77e330a82df4b43a745d57a68f6f057 P b7ab4784c7344b939bc36f639286f377 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:21:32.862372  6803 raft_consensus.cc:1275] T 4d9def8b32fd443aa94ab1420b06837b P b7ab4784c7344b939bc36f639286f377 [term 23 FOLLOWER]: Refusing update from remote peer ccd8a4c3bfe3413cb2ae219b09aea832: Log matching property violated. Preceding OpId in replica: term: 21 index: 11. Preceding OpId from leader: term: 23 index: 12. (index mismatch)
I20260709 13:21:32.865329  6801 raft_consensus.cc:1275] T 3411566abe2d4c9bb4b2adfdd05e6f17 P b7ab4784c7344b939bc36f639286f377 [term 20 FOLLOWER]: Refusing update from remote peer ccd8a4c3bfe3413cb2ae219b09aea832: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 20 index: 13. (index mismatch)
I20260709 13:21:32.865409  6725 raft_consensus.cc:1275] T bd6869f07b5a4885a0b99fbe60c3b175 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 23 FOLLOWER]: Refusing update from remote peer cd75a17ab2604397adab03bb8b5fd75c: Log matching property violated. Preceding OpId in replica: term: 20 index: 10. Preceding OpId from leader: term: 23 index: 12. (index mismatch)
W20260709 13:21:32.867219 14082 log.cc:927] Time spent T 4f00a2e87e56452083b759f60d461ee3 P cd75a17ab2604397adab03bb8b5fd75c: Append to log took a long time: real 0.090s	user 0.000s	sys 0.000s
I20260709 13:21:32.862636 14058 raft_consensus.cc:493] T 1bf4668eeb70467fb3dc5a0289233b3c P b7ab4784c7344b939bc36f639286f377 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:32.868242 14058 raft_consensus.cc:515] T 1bf4668eeb70467fb3dc5a0289233b3c P b7ab4784c7344b939bc36f639286f377 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:32.869608 13684 leader_election.cc:290] T d8292e16e5654be6bc408560cf256aaa P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:21:32.870386 14037 leader_election.cc:290] T 90d42e216d9741e190bca19a781291fd P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:21:32.870461 14058 leader_election.cc:290] T 1bf4668eeb70467fb3dc5a0289233b3c P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:21:32.873180 13988 leader_election.cc:290] T 1bf4668eeb70467fb3dc5a0289233b3c P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:21:32.874392 14074 leader_election.cc:290] T f58dc08b12a2494bb9a1372837970ca2 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:21:32.852329 13996 leader_election.cc:290] T 22ccee1b570c4ad3a57bd7aec085b1b4 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:21:32.898458  6801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be1a92657f494cac8dd227d152f50151" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:21:32.863768 13593 raft_consensus.cc:515] T e77e330a82df4b43a745d57a68f6f057 P b7ab4784c7344b939bc36f639286f377 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } }
I20260709 13:21:32.905565  6798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bf4668eeb70467fb3dc5a0289233b3c" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 22 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:21:32.906277  6798 raft_consensus.cc:2468] T 1bf4668eeb70467fb3dc5a0289233b3c P b7ab4784c7344b939bc36f639286f377 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 21.
I20260709 13:21:32.904771  6800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6869f07b5a4885a0b99fbe60c3b175" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 24 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:21:32.907696  6800 raft_consensus.cc:2410] T bd6869f07b5a4885a0b99fbe60c3b175 P b7ab4784c7344b939bc36f639286f377 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ccd8a4c3bfe3413cb2ae219b09aea832 for term 24 because replica has last-logged OpId of term: 22 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 20 index: 10.
I20260709 13:21:32.895807 13927 raft_consensus.cc:493] T f4b8bd455d5a47c18a1380839c6e0d61 P b7ab4784c7344b939bc36f639286f377 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:21:32.917042 14081 raft_consensus.cc:2749] T 404190ce4ce94cecbfcb6ea9d1dd8626 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:21:32.916831 13927 raft_consensus.cc:515] T f4b8bd455d5a47c18a1380839c6e0d61 P b7ab4784c7344b939bc36f639286f377 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:32.920985  6802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f58dc08b12a2494bb9a1372837970ca2" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:21:32.921412 14090 consensus_queue.cc:1048] T 4d9def8b32fd443aa94ab1420b06837b P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:21:32.922051 13926 leader_election.cc:290] T 7a734b5ab7834e05a8c422208acc58b1 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:21:32.919870 14003 raft_consensus.cc:493] T ab432e62819d499eaaf3dd55481dd930 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:21:32.923365 14003 raft_consensus.cc:515] T ab432e62819d499eaaf3dd55481dd930 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:32.923981 13593 leader_election.cc:290] T e77e330a82df4b43a745d57a68f6f057 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931), ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391)
I20260709 13:21:32.921593 14061 consensus_queue.cc:1048] T 3411566abe2d4c9bb4b2adfdd05e6f17 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.004s
I20260709 13:21:32.898654 13991 raft_consensus.cc:493] T f09c2a98de1a4decabd0ff900dd44caa P b7ab4784c7344b939bc36f639286f377 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:21:32.927542  6770 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 378545us
W20260709 13:21:32.930255  7466 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.528s	user 0.002s	sys 0.006s
W20260709 13:21:32.945959  7466 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.544s	user 0.007s	sys 0.006s
I20260709 13:21:32.948417  6873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "713b5728a197487c9300b310ab94e5a3" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
W20260709 13:21:32.949045  6697 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.607s	user 0.014s	sys 0.021s
W20260709 13:21:32.949735  6697 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.608s	user 0.014s	sys 0.021s
I20260709 13:21:32.949220  6875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22ccee1b570c4ad3a57bd7aec085b1b4" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:21:32.952683  6875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8292e16e5654be6bc408560cf256aaa" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:21:32.955322  6873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90d42e216d9741e190bca19a781291fd" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:21:32.956526  6878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bf4668eeb70467fb3dc5a0289233b3c" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 22 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:21:32.959256  6732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90d42e216d9741e190bca19a781291fd" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:21:32.919938 13927 leader_election.cc:290] T f4b8bd455d5a47c18a1380839c6e0d61 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:21:32.959931  6732 raft_consensus.cc:2468] T 90d42e216d9741e190bca19a781291fd P ccd8a4c3bfe3413cb2ae219b09aea832 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 19.
I20260709 13:21:32.967274  6875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a734b5ab7834e05a8c422208acc58b1" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:21:32.969656  6873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4b8bd455d5a47c18a1380839c6e0d61" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
W20260709 13:21:32.962531  6697 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 620442us
I20260709 13:21:32.968155  6875 raft_consensus.cc:2468] T 7a734b5ab7834e05a8c422208acc58b1 P cd75a17ab2604397adab03bb8b5fd75c [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 22.
I20260709 13:21:32.980634  6724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22ccee1b570c4ad3a57bd7aec085b1b4" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:21:32.982503  7498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a734b5ab7834e05a8c422208acc58b1" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:21:32.977504  6697 leader_election.cc:304] T f09c2a98de1a4decabd0ff900dd44caa P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:21:32.981567  6724 raft_consensus.cc:2468] T 22ccee1b570c4ad3a57bd7aec085b1b4 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 15.
I20260709 13:21:32.946548 14003 leader_election.cc:290] T ab432e62819d499eaaf3dd55481dd930 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:21:32.962123 14058 raft_consensus.cc:493] T 4d9def8b32fd443aa94ab1420b06837b P b7ab4784c7344b939bc36f639286f377 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:32.996212  6772 leader_election.cc:304] T 17587d6730594da4a56fa13a353232a1 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:21:32.937923 13991 raft_consensus.cc:515] T f09c2a98de1a4decabd0ff900dd44caa P b7ab4784c7344b939bc36f639286f377 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:32.998960  6798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4275cf08e63345f993bce8664eada830" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 22 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:21:32.995498 13927 raft_consensus.cc:493] T 427c124d773f483294511e80fe340075 P b7ab4784c7344b939bc36f639286f377 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 7ba59cc884714e8aa5f3f0ecaed84cbb)
W20260709 13:21:33.006541  6845 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.563s	user 0.011s	sys 0.018s
I20260709 13:21:33.006791 13927 raft_consensus.cc:515] T 427c124d773f483294511e80fe340075 P b7ab4784c7344b939bc36f639286f377 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } attrs { replace: true } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:21:33.008258 13966 raft_consensus.cc:2749] T 17587d6730594da4a56fa13a353232a1 P b7ab4784c7344b939bc36f639286f377 [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 13:21:33.010600 13927 leader_election.cc:290] T 427c124d773f483294511e80fe340075 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:21:32.978528 13926 raft_consensus.cc:493] T b3f13b31a1f84f0d89d007eadd57924c P b7ab4784c7344b939bc36f639286f377 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 7ba59cc884714e8aa5f3f0ecaed84cbb)
I20260709 13:21:33.012336 13926 raft_consensus.cc:515] T b3f13b31a1f84f0d89d007eadd57924c P b7ab4784c7344b939bc36f639286f377 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:21:33.015995 13926 leader_election.cc:290] T b3f13b31a1f84f0d89d007eadd57924c P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:21:33.017421  6772 leader_election.cc:304] T dbdf895bba214ff68685a24fd17dfb5d P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:21:33.018239 14017 raft_consensus.cc:2749] T dbdf895bba214ff68685a24fd17dfb5d P b7ab4784c7344b939bc36f639286f377 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:21:33.019606 14017 consensus_queue.cc:1048] T 4275cf08e63345f993bce8664eada830 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:21:33.023293  6772 leader_election.cc:304] T f5be3a11b23d4ea9b08300a2789821c7 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: ccd8a4c3bfe3413cb2ae219b09aea832
W20260709 13:21:33.023682 14092 log.cc:927] Time spent T 00000000000000000000000000000000 P b3ae52d33b9a4273a42e5e2cf3b5d6b5: Append to log took a long time: real 0.096s	user 0.000s	sys 0.000s
I20260709 13:21:33.024096 13996 raft_consensus.cc:2804] T f5be3a11b23d4ea9b08300a2789821c7 P b7ab4784c7344b939bc36f639286f377 [term 20 FOLLOWER]: Leader pre-election won for term 21
W20260709 13:21:33.006929  6845 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.681s	user 0.011s	sys 0.019s
I20260709 13:21:33.029491 13991 leader_election.cc:290] T f09c2a98de1a4decabd0ff900dd44caa P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:21:32.989497 14063 raft_consensus.cc:493] T 95a75bfe094d4bdc963aba3f08dfcd25 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 16 FOLLOWER]: Starting pre-election (detected failure of leader cd75a17ab2604397adab03bb8b5fd75c)
I20260709 13:21:33.036738  6731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "713b5728a197487c9300b310ab94e5a3" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:21:33.037897  6732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a734b5ab7834e05a8c422208acc58b1" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:21:33.038987  6727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8292e16e5654be6bc408560cf256aaa" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:21:33.045886  7498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "427c124d773f483294511e80fe340075" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
W20260709 13:21:33.046960  6697 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 43804.9us
I20260709 13:21:33.049506  6728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bf4668eeb70467fb3dc5a0289233b3c" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 22 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:21:33.050592  6725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77e330a82df4b43a745d57a68f6f057" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:21:33.002018 14003 raft_consensus.cc:3060] T f09c2a98de1a4decabd0ff900dd44caa P ccd8a4c3bfe3413cb2ae219b09aea832 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:21:33.050925  6724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4b8bd455d5a47c18a1380839c6e0d61" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:21:33.057163  6728 raft_consensus.cc:2468] T 1bf4668eeb70467fb3dc5a0289233b3c P ccd8a4c3bfe3413cb2ae219b09aea832 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 21.
I20260709 13:21:33.052238 13996 raft_consensus.cc:493] T f5be3a11b23d4ea9b08300a2789821c7 P b7ab4784c7344b939bc36f639286f377 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:33.064232  6731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09c2a98de1a4decabd0ff900dd44caa" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:21:33.065423  6732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "427c124d773f483294511e80fe340075" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:21:33.063993 13996 raft_consensus.cc:3060] T f5be3a11b23d4ea9b08300a2789821c7 P b7ab4784c7344b939bc36f639286f377 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:21:33.068284  6770 leader_election.cc:304] T 90d42e216d9741e190bca19a781291fd P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:21:33.072454  7498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3f13b31a1f84f0d89d007eadd57924c" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:21:33.074780  6724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3f13b31a1f84f0d89d007eadd57924c" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:21:33.078192  7499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be1a92657f494cac8dd227d152f50151" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:21:33.037824 14058 raft_consensus.cc:515] T 4d9def8b32fd443aa94ab1420b06837b P b7ab4784c7344b939bc36f639286f377 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:33.062062 13966 raft_consensus.cc:493] T 95a75bfe094d4bdc963aba3f08dfcd25 P b7ab4784c7344b939bc36f639286f377 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader cd75a17ab2604397adab03bb8b5fd75c)
I20260709 13:21:33.049012 13925 raft_consensus.cc:515] T 34f36d59d88f40fe8a2805e604fc6c0a P b7ab4784c7344b939bc36f639286f377 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:33.089594  6770 leader_election.cc:304] T 22ccee1b570c4ad3a57bd7aec085b1b4 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:21:33.079607 14098 raft_consensus.cc:2804] T 90d42e216d9741e190bca19a781291fd P b7ab4784c7344b939bc36f639286f377 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:21:33.072906 14074 consensus_queue.cc:1048] T 4d9def8b32fd443aa94ab1420b06837b P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.019s
I20260709 13:21:33.098827  6804 raft_consensus.cc:2368] T 34f36d59d88f40fe8a2805e604fc6c0a P b7ab4784c7344b939bc36f639286f377 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c for earlier term 19. Current term is 20.
I20260709 13:21:33.105221 13963 raft_consensus.cc:493] T ce4f062dcd314d43a63ca74067cb5ee3 P b7ab4784c7344b939bc36f639286f377 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader cd75a17ab2604397adab03bb8b5fd75c)
I20260709 13:21:33.098237 14098 raft_consensus.cc:493] T 90d42e216d9741e190bca19a781291fd P b7ab4784c7344b939bc36f639286f377 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:33.121592  6697 leader_election.cc:304] T be1a92657f494cac8dd227d152f50151 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, b7ab4784c7344b939bc36f639286f377
I20260709 13:21:33.090117 13966 raft_consensus.cc:515] T 95a75bfe094d4bdc963aba3f08dfcd25 P b7ab4784c7344b939bc36f639286f377 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } attrs { replace: true } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
W20260709 13:21:33.184945 14107 log.cc:927] Time spent T 1528ab62b6fe4e3099d08f141afee116 P b7ab4784c7344b939bc36f639286f377: Append to log took a long time: real 0.090s	user 0.000s	sys 0.000s
W20260709 13:21:33.186666 14110 log.cc:927] Time spent T d8292e16e5654be6bc408560cf256aaa P b7ab4784c7344b939bc36f639286f377: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
I20260709 13:21:33.200768  5625 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:21:33.210642 13966 leader_election.cc:290] T 95a75bfe094d4bdc963aba3f08dfcd25 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:21:33.239876  7498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a75bfe094d4bdc963aba3f08dfcd25" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
W20260709 13:21:33.242115  6697 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.68:45071, user_credentials={real_user=slave}} blocked reactor thread for 120589us
I20260709 13:21:33.118206 14098 raft_consensus.cc:3060] T 90d42e216d9741e190bca19a781291fd P b7ab4784c7344b939bc36f639286f377 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:21:33.067898 14063 raft_consensus.cc:515] T 95a75bfe094d4bdc963aba3f08dfcd25 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } attrs { replace: true } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:21:33.105870 13963 raft_consensus.cc:515] T ce4f062dcd314d43a63ca74067cb5ee3 P b7ab4784c7344b939bc36f639286f377 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:21:33.344345 14052 raft_consensus.cc:2749] T be1a92657f494cac8dd227d152f50151 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:21:33.410804  7498 raft_consensus.cc:2468] T 95a75bfe094d4bdc963aba3f08dfcd25 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 16.
W20260709 13:21:33.411618 14021 consensus_meta.cc:287] T be1a92657f494cac8dd227d152f50151 P 7ba59cc884714e8aa5f3f0ecaed84cbb: Time spent flushing consensus metadata: real 0.521s	user 0.006s	sys 0.006s
I20260709 13:21:33.430751  6730 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50004 (request call id 3411) took 1107 ms. Trace:
I20260709 13:21:33.436633  6730 rpcz_store.cc:276] 0709 13:21:32.323195 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:21:32.323337 (+   142us) service_pool.cc:224] Handling call
0709 13:21:32.323736 (+   399us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:21:32.568363 (+244627us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:21:32.568395 (+    32us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:21:32.568442 (+    47us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:21:32.568478 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:21:33.430469 (+861991us) spinlock_profiling.cc:243] Waited 244 ms on lock 0x7b5400407c54. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f9aae01 00007fcc0f9a983e 00007fcc1496e419 00007fcc0dee5bd4 00007fcc0dee5b62 00007fcc0dee5a91 00007fcc0dee5a0c 00007fcc0dee4cc2 00007fcc0dce548c 00007fcc0dce48c6
0709 13:21:33.430525 (+    56us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:21:33.430681 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":561996544}
W20260709 13:21:33.432463 14109 log.cc:927] Time spent T d33d5ee8ef6f415593d8df52063161ad P b7ab4784c7344b939bc36f639286f377: Append to log took a long time: real 0.088s	user 0.000s	sys 0.000s
I20260709 13:21:33.449678 13963 leader_election.cc:290] T ce4f062dcd314d43a63ca74067cb5ee3 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:21:33.455626 13925 leader_election.cc:290] T 34f36d59d88f40fe8a2805e604fc6c0a P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 20 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:21:33.469269 14077 raft_consensus.cc:493] T 404190ce4ce94cecbfcb6ea9d1dd8626 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 17 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:21:33.477639  6804 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:32966 (request call id 1839) took 1088 ms. Trace:
I20260709 13:21:33.478178  6804 rpcz_store.cc:276] 0709 13:21:32.389167 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:21:32.389338 (+   171us) service_pool.cc:224] Handling call
0709 13:21:33.477330 (+1087992us) spinlock_profiling.cc:243] Waited 690 ms on lock 0x7b54001a3bd4. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f9ae2fa 00007fcc1496fb17 00007fcc0deea6d4 00007fcc0deea662 00007fcc0deea591 00007fcc0deea50c 00007fcc0dee97c2 00007fcc0dce548c 00007fcc0dce48c6 00007fcc0dce426f
0709 13:21:33.477519 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1586702208}
I20260709 13:21:33.485867  6880 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53406 (request call id 3478) took 1538 ms. Trace:
I20260709 13:21:33.486478  6880 rpcz_store.cc:276] 0709 13:21:31.947171 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:21:31.947282 (+   111us) service_pool.cc:224] Handling call
0709 13:21:31.947583 (+   301us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:21:31.979021 (+ 31438us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:21:31.979055 (+    34us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:21:31.979099 (+    44us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:21:31.979132 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:21:33.485450 (+1506318us) spinlock_profiling.cc:243] Waited 31.2 ms on lock 0x7b540042ac54. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f9aae01 00007fcc0f9a983e 00007fcc1496e419 00007fcc0dee5bd4 00007fcc0dee5b62 00007fcc0dee5a91 00007fcc0dee5a0c 00007fcc0dee4cc2 00007fcc0dce548c 00007fcc0dce48c6
0709 13:21:33.485513 (+    63us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:21:33.485770 (+   257us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":71773568}
I20260709 13:21:33.459131 14058 leader_election.cc:290] T 4d9def8b32fd443aa94ab1420b06837b P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:21:33.470094 14077 raft_consensus.cc:515] T 404190ce4ce94cecbfcb6ea9d1dd8626 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:21:33.442409 14021 raft_consensus.cc:515] T be1a92657f494cac8dd227d152f50151 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 24 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:21:33.490728 13953 raft_consensus.cc:493] T d8cee0accdb8499c86d4414b72565a38 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 19 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:21:33.496765 14091 raft_consensus.cc:493] T 7ba5dac66ab5497e9e336f2a3c28cda5 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 22 FOLLOWER]: Starting pre-election (detected failure of leader cd75a17ab2604397adab03bb8b5fd75c)
I20260709 13:21:33.497416 13953 raft_consensus.cc:515] T d8cee0accdb8499c86d4414b72565a38 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:21:33.510469 14091 raft_consensus.cc:515] T 7ba5dac66ab5497e9e336f2a3c28cda5 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:21:33.511900 13697 raft_consensus.cc:493] T 95a75bfe094d4bdc963aba3f08dfcd25 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader cd75a17ab2604397adab03bb8b5fd75c)
I20260709 13:21:33.512581 13697 raft_consensus.cc:515] T 95a75bfe094d4bdc963aba3f08dfcd25 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } attrs { replace: true } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:21:33.513564 14091 leader_election.cc:290] T 7ba5dac66ab5497e9e336f2a3c28cda5 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:21:33.516074 14077 leader_election.cc:290] T 404190ce4ce94cecbfcb6ea9d1dd8626 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:21:33.517129 13697 leader_election.cc:290] T 95a75bfe094d4bdc963aba3f08dfcd25 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:21:33.513621 14063 leader_election.cc:290] T 95a75bfe094d4bdc963aba3f08dfcd25 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:21:33.519779 13697 raft_consensus.cc:493] T 17587d6730594da4a56fa13a353232a1 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 26 FOLLOWER]: Starting pre-election (detected failure of leader 7ba59cc884714e8aa5f3f0ecaed84cbb)
I20260709 13:21:33.520166 14021 leader_election.cc:290] T be1a92657f494cac8dd227d152f50151 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 24 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:21:33.481813 13996 raft_consensus.cc:515] T f5be3a11b23d4ea9b08300a2789821c7 P b7ab4784c7344b939bc36f639286f377 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:33.522162  7499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a75bfe094d4bdc963aba3f08dfcd25" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:21:33.531486 13953 leader_election.cc:290] T d8cee0accdb8499c86d4414b72565a38 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:21:33.533445 14098 raft_consensus.cc:515] T 90d42e216d9741e190bca19a781291fd P b7ab4784c7344b939bc36f639286f377 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:33.541599 13996 leader_election.cc:290] T f5be3a11b23d4ea9b08300a2789821c7 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 21 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:21:33.542526 14098 leader_election.cc:290] T 90d42e216d9741e190bca19a781291fd P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 20 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:21:33.545746 14059 leader_election.cc:290] T 1528ab62b6fe4e3099d08f141afee116 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:21:33.550221 14003 raft_consensus.cc:2749] T f09c2a98de1a4decabd0ff900dd44caa P ccd8a4c3bfe3413cb2ae219b09aea832 [term 23 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:21:33.551095  6731 raft_consensus.cc:2468] T f09c2a98de1a4decabd0ff900dd44caa P ccd8a4c3bfe3413cb2ae219b09aea832 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 23.
I20260709 13:21:33.551623  6695 leader_election.cc:304] T 1bf4668eeb70467fb3dc5a0289233b3c P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
I20260709 13:21:33.554239 14090 raft_consensus.cc:493] T 713b5728a197487c9300b310ab94e5a3 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader cd75a17ab2604397adab03bb8b5fd75c)
I20260709 13:21:33.554845 14090 raft_consensus.cc:515] T 713b5728a197487c9300b310ab94e5a3 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:33.556305 14083 raft_consensus.cc:2804] T 1bf4668eeb70467fb3dc5a0289233b3c P ccd8a4c3bfe3413cb2ae219b09aea832 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:21:33.556793 14083 raft_consensus.cc:493] T 1bf4668eeb70467fb3dc5a0289233b3c P ccd8a4c3bfe3413cb2ae219b09aea832 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:33.557128 14083 raft_consensus.cc:3060] T 1bf4668eeb70467fb3dc5a0289233b3c P ccd8a4c3bfe3413cb2ae219b09aea832 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:21:33.561066 14090 leader_election.cc:290] T 713b5728a197487c9300b310ab94e5a3 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:21:33.564545 14101 raft_consensus.cc:493] T 3fa34c08b205435dba97346991aa1f92 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 7ba59cc884714e8aa5f3f0ecaed84cbb)
I20260709 13:21:33.565234 14101 raft_consensus.cc:515] T 3fa34c08b205435dba97346991aa1f92 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:21:33.520419 13697 raft_consensus.cc:515] T 17587d6730594da4a56fa13a353232a1 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:21:33.567731 14101 leader_election.cc:290] T 3fa34c08b205435dba97346991aa1f92 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:21:33.570787 14083 raft_consensus.cc:515] T 1bf4668eeb70467fb3dc5a0289233b3c P ccd8a4c3bfe3413cb2ae219b09aea832 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:33.575532 14074 raft_consensus.cc:493] T 7a734b5ab7834e05a8c422208acc58b1 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 7ba59cc884714e8aa5f3f0ecaed84cbb)
I20260709 13:21:33.575475 13990 leader_election.cc:290] T bd6869f07b5a4885a0b99fbe60c3b175 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:21:33.576753 14074 raft_consensus.cc:515] T 7a734b5ab7834e05a8c422208acc58b1 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } attrs { replace: true } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:21:33.582813 13896 raft_consensus.cc:493] T 24ee15416e3145beaa1b8183453729a3 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 7ba59cc884714e8aa5f3f0ecaed84cbb)
I20260709 13:21:33.583446 13896 raft_consensus.cc:515] T 24ee15416e3145beaa1b8183453729a3 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:21:33.585002 14083 leader_election.cc:290] T 1bf4668eeb70467fb3dc5a0289233b3c P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 22 election: Requested vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:21:33.592522  6732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1528ab62b6fe4e3099d08f141afee116" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 20 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:21:33.590821  6731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a75bfe094d4bdc963aba3f08dfcd25" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:21:33.593247  6731 raft_consensus.cc:2468] T 95a75bfe094d4bdc963aba3f08dfcd25 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in term 16.
I20260709 13:21:33.586153 14074 leader_election.cc:290] T 7a734b5ab7834e05a8c422208acc58b1 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:21:33.594761  6731 raft_consensus.cc:1275] T 90d42e216d9741e190bca19a781291fd P ccd8a4c3bfe3413cb2ae219b09aea832 [term 19 FOLLOWER]: Refusing update from remote peer cd75a17ab2604397adab03bb8b5fd75c: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
I20260709 13:21:33.596258  6727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be1a92657f494cac8dd227d152f50151" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:21:33.600324  7499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fa34c08b205435dba97346991aa1f92" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 26 candidate_status { last_received { term: 25 index: 18 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:21:33.601424  6731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4275cf08e63345f993bce8664eada830" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 22 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:21:33.604607  6725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "404190ce4ce94cecbfcb6ea9d1dd8626" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
W20260709 13:21:33.605189 14089 log.cc:927] Time spent T 7c44c4849aa54f2b94d1f1bef9ed546f P cd75a17ab2604397adab03bb8b5fd75c: Append to log took a long time: real 0.763s	user 0.010s	sys 0.000s
I20260709 13:21:33.605432  6725 raft_consensus.cc:2468] T 404190ce4ce94cecbfcb6ea9d1dd8626 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in term 17.
I20260709 13:21:33.599603 14090 raft_consensus.cc:493] T 9e326172347f45e99a0d482b5d8ef768 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader cd75a17ab2604397adab03bb8b5fd75c)
I20260709 13:21:33.606310 14074 raft_consensus.cc:493] T 427c124d773f483294511e80fe340075 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 7ba59cc884714e8aa5f3f0ecaed84cbb)
I20260709 13:21:33.616256 14074 raft_consensus.cc:515] T 427c124d773f483294511e80fe340075 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } attrs { replace: true } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:21:33.619551 14074 leader_election.cc:290] T 427c124d773f483294511e80fe340075 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:21:33.625645 14088 raft_consensus.cc:493] T 30e88460611e47b2ba16a46a30b5f416 P cd75a17ab2604397adab03bb8b5fd75c [term 16 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:21:33.626281 14088 raft_consensus.cc:515] T 30e88460611e47b2ba16a46a30b5f416 P cd75a17ab2604397adab03bb8b5fd75c [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:33.627682 14066 raft_consensus.cc:476] T 1bf4668eeb70467fb3dc5a0289233b3c P cd75a17ab2604397adab03bb8b5fd75c [term 21 LEADER]: Not starting pre-election -- already a leader
I20260709 13:21:33.628366 14053 raft_consensus.cc:493] T 4b8cacb381b746da8d0049b0a83b41dd P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 20 FOLLOWER]: Starting pre-election (detected failure of leader cd75a17ab2604397adab03bb8b5fd75c)
I20260709 13:21:33.629050  6879 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53416 (request call id 3984) took 1579 ms. Trace:
I20260709 13:21:33.628877 14053 raft_consensus.cc:515] T 4b8cacb381b746da8d0049b0a83b41dd P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:21:33.629364  6879 rpcz_store.cc:276] 0709 13:21:32.049612 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:21:32.049723 (+   111us) service_pool.cc:224] Handling call
0709 13:21:32.050000 (+   277us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:21:32.050341 (+   341us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:21:32.050372 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:21:32.055500 (+  5128us) log.cc:844] Serialized 26 byte log entry
0709 13:21:32.474120 (+418620us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:21:32.474181 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:21:32.474283 (+   102us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:21:33.599535 (+1125252us) spinlock_profiling.cc:243] Waited 5.81 ms on lock 0x7b4400022b4c. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0c745db1 00007fcc0c7e3c85 00007fcc0c7e46a2 00007fcc0f5561db 00007fcc0f551aaf 00007fcc0f54586e 00007fcc0f544bb6 00007fcc0f5447d8 00007fcc0f54e221 00007fcc0f54e1d9 00007fcc0f54e169
0709 13:21:33.628773 (+ 29238us) raft_consensus.cc:1685] finished
0709 13:21:33.628798 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:21:33.628993 (+   195us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7886,"raft.queue_time_us":3421,"raft.run_cpu_time_us":151,"raft.run_wall_time_us":5055,"spinlock_wait_cycles":13358336,"thread_start_us":382644,"threads_started":1,"wal-append.queue_time_us":613276}
I20260709 13:21:33.631043 14053 leader_election.cc:290] T 4b8cacb381b746da8d0049b0a83b41dd P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:21:33.609289 14101 raft_consensus.cc:493] T 4b8cacb381b746da8d0049b0a83b41dd P ccd8a4c3bfe3413cb2ae219b09aea832 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader cd75a17ab2604397adab03bb8b5fd75c)
I20260709 13:21:33.638074  6725 raft_consensus.cc:1240] T 1bf4668eeb70467fb3dc5a0289233b3c P ccd8a4c3bfe3413cb2ae219b09aea832 [term 22 FOLLOWER]: Rejecting Update request from peer cd75a17ab2604397adab03bb8b5fd75c for earlier term 21. Current term is 22. Ops: [21.13-21.13]
I20260709 13:21:33.639537  6880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "427c124d773f483294511e80fe340075" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:21:33.640558 14011 raft_consensus.cc:493] T bb7fa124c3bf4ef9ab65a407cb008441 P cd75a17ab2604397adab03bb8b5fd75c [term 18 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:21:33.640465  6880 raft_consensus.cc:2468] T 427c124d773f483294511e80fe340075 P cd75a17ab2604397adab03bb8b5fd75c [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 18.
I20260709 13:21:33.641175 14011 raft_consensus.cc:515] T bb7fa124c3bf4ef9ab65a407cb008441 P cd75a17ab2604397adab03bb8b5fd75c [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:21:33.643527 14011 leader_election.cc:290] T bb7fa124c3bf4ef9ab65a407cb008441 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:21:33.644340 13865 raft_consensus.cc:493] T e77e330a82df4b43a745d57a68f6f057 P cd75a17ab2604397adab03bb8b5fd75c [term 19 FOLLOWER]: Starting pre-election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:21:33.645097 14087 raft_consensus.cc:493] T 4d9def8b32fd443aa94ab1420b06837b P cd75a17ab2604397adab03bb8b5fd75c [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:33.644901 13865 raft_consensus.cc:515] T e77e330a82df4b43a745d57a68f6f057 P cd75a17ab2604397adab03bb8b5fd75c [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } }
I20260709 13:21:33.645423 14088 leader_election.cc:290] T 30e88460611e47b2ba16a46a30b5f416 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:21:33.645646 13690 raft_consensus.cc:493] T 3d65025eea89441290d85dd053810e31 P cd75a17ab2604397adab03bb8b5fd75c [term 20 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:21:33.646173 14068 raft_consensus.cc:493] T 7c37d41cd9164c15a6826ca62a851a69 P cd75a17ab2604397adab03bb8b5fd75c [term 22 FOLLOWER]: Starting pre-election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:21:33.646347 13690 raft_consensus.cc:515] T 3d65025eea89441290d85dd053810e31 P cd75a17ab2604397adab03bb8b5fd75c [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:33.646678 14068 raft_consensus.cc:515] T 7c37d41cd9164c15a6826ca62a851a69 P cd75a17ab2604397adab03bb8b5fd75c [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:33.647188 13865 leader_election.cc:290] T e77e330a82df4b43a745d57a68f6f057 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391)
I20260709 13:21:33.645845 13588 raft_consensus.cc:493] T bb3d8792045a4583ae2e965b1350a5b4 P cd75a17ab2604397adab03bb8b5fd75c [term 19 FOLLOWER]: Starting pre-election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:21:33.648734 13588 raft_consensus.cc:515] T bb3d8792045a4583ae2e965b1350a5b4 P cd75a17ab2604397adab03bb8b5fd75c [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:21:33.649072 13946 raft_consensus.cc:493] T 711ef6523deb4cbe8ef2ba61e1c21c98 P cd75a17ab2604397adab03bb8b5fd75c [term 21 FOLLOWER]: Starting pre-election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:21:33.634106 14090 raft_consensus.cc:515] T 9e326172347f45e99a0d482b5d8ef768 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:33.649823 13946 raft_consensus.cc:515] T 711ef6523deb4cbe8ef2ba61e1c21c98 P cd75a17ab2604397adab03bb8b5fd75c [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:33.645701 14087 raft_consensus.cc:515] T 4d9def8b32fd443aa94ab1420b06837b P cd75a17ab2604397adab03bb8b5fd75c [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:33.649319 13998 raft_consensus.cc:493] T dbdf895bba214ff68685a24fd17dfb5d P cd75a17ab2604397adab03bb8b5fd75c [term 20 FOLLOWER]: Starting pre-election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:21:33.651811 13998 raft_consensus.cc:515] T dbdf895bba214ff68685a24fd17dfb5d P cd75a17ab2604397adab03bb8b5fd75c [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:33.652192 14039 raft_consensus.cc:493] T d8292e16e5654be6bc408560cf256aaa P cd75a17ab2604397adab03bb8b5fd75c [term 21 FOLLOWER]: Starting pre-election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:21:33.652760 14039 raft_consensus.cc:515] T d8292e16e5654be6bc408560cf256aaa P cd75a17ab2604397adab03bb8b5fd75c [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:33.653577 13690 leader_election.cc:290] T 3d65025eea89441290d85dd053810e31 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:21:33.655148 14039 leader_election.cc:290] T d8292e16e5654be6bc408560cf256aaa P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:21:33.655664 14011 raft_consensus.cc:493] T 20f6842e26174571996b8dea4151d4be P cd75a17ab2604397adab03bb8b5fd75c [term 22 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:21:33.656822 13946 leader_election.cc:290] T 711ef6523deb4cbe8ef2ba61e1c21c98 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:21:33.657039 14068 leader_election.cc:290] T 7c37d41cd9164c15a6826ca62a851a69 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:21:33.640406 14064 raft_consensus.cc:493] T d8cee0accdb8499c86d4414b72565a38 P cd75a17ab2604397adab03bb8b5fd75c [term 19 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:21:33.658452 14090 leader_election.cc:290] T 9e326172347f45e99a0d482b5d8ef768 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:21:33.658216 14064 raft_consensus.cc:515] T d8cee0accdb8499c86d4414b72565a38 P cd75a17ab2604397adab03bb8b5fd75c [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:21:33.657701 14053 raft_consensus.cc:493] T ce4f062dcd314d43a63ca74067cb5ee3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 16 FOLLOWER]: Starting pre-election (detected failure of leader cd75a17ab2604397adab03bb8b5fd75c)
I20260709 13:21:33.661700 13865 raft_consensus.cc:493] T e31b9971c15848dea59d4d4130141d9e P cd75a17ab2604397adab03bb8b5fd75c [term 17 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:21:33.662256 14053 raft_consensus.cc:515] T ce4f062dcd314d43a63ca74067cb5ee3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:21:33.667455 14053 leader_election.cc:290] T ce4f062dcd314d43a63ca74067cb5ee3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:21:33.659737 13588 leader_election.cc:290] T bb3d8792045a4583ae2e965b1350a5b4 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:21:33.634903  7466 leader_election.cc:304] T 404190ce4ce94cecbfcb6ea9d1dd8626 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
I20260709 13:21:33.656972 13697 leader_election.cc:290] T 17587d6730594da4a56fa13a353232a1 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:21:33.660514 14064 leader_election.cc:290] T d8cee0accdb8499c86d4414b72565a38 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:21:33.661441 14039 raft_consensus.cc:493] T a3022224cc81473690653a83d4e99470 P cd75a17ab2604397adab03bb8b5fd75c [term 21 FOLLOWER]: Starting pre-election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:21:33.716631  6880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce4f062dcd314d43a63ca74067cb5ee3" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:21:33.662362 13865 raft_consensus.cc:515] T e31b9971c15848dea59d4d4130141d9e P cd75a17ab2604397adab03bb8b5fd75c [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:33.657568 13946 raft_consensus.cc:493] T 8c7f33e544204fbaac4078e3e83bbf4e P cd75a17ab2604397adab03bb8b5fd75c [term 16 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:21:33.658628 14087 leader_election.cc:290] T 4d9def8b32fd443aa94ab1420b06837b P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:21:33.656404 13998 leader_election.cc:290] T dbdf895bba214ff68685a24fd17dfb5d P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:21:33.752592  6807 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3411566abe2d4c9bb4b2adfdd05e6f17"
dest_uuid: "b7ab4784c7344b939bc36f639286f377"
mode: GRACEFUL
new_leader_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
 from {username='slave'} at 127.0.0.1:38240
I20260709 13:21:33.753491  6807 raft_consensus.cc:606] T 3411566abe2d4c9bb4b2adfdd05e6f17 P b7ab4784c7344b939bc36f639286f377 [term 20 FOLLOWER]: Received request to transfer leadership to TS cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:21:33.754026  6807 raft_consensus.cc:614] T 3411566abe2d4c9bb4b2adfdd05e6f17 P b7ab4784c7344b939bc36f639286f377 [term 20 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:21:33.664677  6844 leader_election.cc:304] T fe20b4b48823486ca3b9c648db6ce8aa P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:21:33.649170 14121 raft_consensus.cc:493] T de3186201e1a40d0b335eeb8b4e256e0 P cd75a17ab2604397adab03bb8b5fd75c [term 22 FOLLOWER]: Starting pre-election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:21:33.646093 14088 raft_consensus.cc:493] T 24ee15416e3145beaa1b8183453729a3 P cd75a17ab2604397adab03bb8b5fd75c [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 7ba59cc884714e8aa5f3f0ecaed84cbb)
I20260709 13:21:33.673120  6731 raft_consensus.cc:1275] T f09c2a98de1a4decabd0ff900dd44caa P ccd8a4c3bfe3413cb2ae219b09aea832 [term 23 FOLLOWER]: Refusing update from remote peer cd75a17ab2604397adab03bb8b5fd75c: Log matching property violated. Preceding OpId in replica: term: 22 index: 13. Preceding OpId from leader: term: 23 index: 14. (index mismatch)
W20260709 13:21:33.675889  6770 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 586378us
I20260709 13:21:33.763284 14088 raft_consensus.cc:515] T 24ee15416e3145beaa1b8183453729a3 P cd75a17ab2604397adab03bb8b5fd75c [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:21:33.763969 13992 raft_consensus.cc:493] T 44bde925b2e541b69890d70715b85176 P b7ab4784c7344b939bc36f639286f377 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:33.764519 13992 raft_consensus.cc:515] T 44bde925b2e541b69890d70715b85176 P b7ab4784c7344b939bc36f639286f377 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:33.765220  6770 leader_election.cc:304] T 713b5728a197487c9300b310ab94e5a3 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:21:33.765491 14088 leader_election.cc:290] T 24ee15416e3145beaa1b8183453729a3 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:21:33.766105 14088 raft_consensus.cc:493] T 7887766dc6784fcaa42b35c05fea7a99 P cd75a17ab2604397adab03bb8b5fd75c [term 23 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:21:33.766618 13992 leader_election.cc:290] T 44bde925b2e541b69890d70715b85176 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:21:33.766563  6770 leader_election.cc:304] T 7a734b5ab7834e05a8c422208acc58b1 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:21:33.767274 13992 raft_consensus.cc:493] T 9e326172347f45e99a0d482b5d8ef768 P b7ab4784c7344b939bc36f639286f377 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader cd75a17ab2604397adab03bb8b5fd75c)
W20260709 13:21:33.712811  7466 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 78239us
I20260709 13:21:33.769071 14037 raft_consensus.cc:2749] T 713b5728a197487c9300b310ab94e5a3 P b7ab4784c7344b939bc36f639286f377 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:21:33.769404 14055 raft_consensus.cc:2749] T 7a734b5ab7834e05a8c422208acc58b1 P b7ab4784c7344b939bc36f639286f377 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:21:33.749197 14064 raft_consensus.cc:493] T 07a92dd554674067a83a9cb68c4773f2 P cd75a17ab2604397adab03bb8b5fd75c [term 19 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:21:33.770309 14064 raft_consensus.cc:515] T 07a92dd554674067a83a9cb68c4773f2 P cd75a17ab2604397adab03bb8b5fd75c [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:33.720122  6725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f03d0dbf16864ca4bc1bb5e4c0334c0f" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:21:33.772405 14064 leader_election.cc:290] T 07a92dd554674067a83a9cb68c4773f2 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:21:33.773243  7501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "427c124d773f483294511e80fe340075" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:21:33.773067 14121 raft_consensus.cc:515] T de3186201e1a40d0b335eeb8b4e256e0 P cd75a17ab2604397adab03bb8b5fd75c [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:33.774822  7497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17587d6730594da4a56fa13a353232a1" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 27 candidate_status { last_received { term: 26 index: 18 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:21:33.775499 14121 leader_election.cc:290] T de3186201e1a40d0b335eeb8b4e256e0 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:21:33.720144  7498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce4f062dcd314d43a63ca74067cb5ee3" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:21:33.724116 14039 raft_consensus.cc:515] T a3022224cc81473690653a83d4e99470 P cd75a17ab2604397adab03bb8b5fd75c [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:33.777806 13865 leader_election.cc:290] T e31b9971c15848dea59d4d4130141d9e P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:21:33.725057 13955 raft_consensus.cc:2804] T 404190ce4ce94cecbfcb6ea9d1dd8626 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:21:33.727046  7503 raft_consensus.cc:1240] T be1a92657f494cac8dd227d152f50151 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 24 FOLLOWER]: Rejecting Update request from peer b7ab4784c7344b939bc36f639286f377 for earlier term 23. Current term is 24. Ops: []
I20260709 13:21:33.673923 14101 raft_consensus.cc:515] T 4b8cacb381b746da8d0049b0a83b41dd P ccd8a4c3bfe3413cb2ae219b09aea832 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:21:33.739367 13997 raft_consensus.cc:493] T 7c37d41cd9164c15a6826ca62a851a69 P b7ab4784c7344b939bc36f639286f377 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:21:33.740721 13990 raft_consensus.cc:493] T 9b3759de40694069b13c0f8bd40e5709 P b7ab4784c7344b939bc36f639286f377 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader cd75a17ab2604397adab03bb8b5fd75c)
I20260709 13:21:33.784994 13990 raft_consensus.cc:515] T 9b3759de40694069b13c0f8bd40e5709 P b7ab4784c7344b939bc36f639286f377 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:33.787400 13990 leader_election.cc:290] T 9b3759de40694069b13c0f8bd40e5709 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:21:33.741319 14017 raft_consensus.cc:493] T 711ef6523deb4cbe8ef2ba61e1c21c98 P b7ab4784c7344b939bc36f639286f377 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:21:33.747430  6880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34f36d59d88f40fe8a2805e604fc6c0a" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:21:33.747733  6873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d9def8b32fd443aa94ab1420b06837b" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 24 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:21:33.788381  6880 raft_consensus.cc:3060] T 34f36d59d88f40fe8a2805e604fc6c0a P cd75a17ab2604397adab03bb8b5fd75c [term 18 FOLLOWER]: Advancing to term 20
I20260709 13:21:33.745297 13588 raft_consensus.cc:493] T 3fa34c08b205435dba97346991aa1f92 P cd75a17ab2604397adab03bb8b5fd75c [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 7ba59cc884714e8aa5f3f0ecaed84cbb)
I20260709 13:21:33.789201 13588 raft_consensus.cc:515] T 3fa34c08b205435dba97346991aa1f92 P cd75a17ab2604397adab03bb8b5fd75c [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:21:33.748293  6877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90d42e216d9741e190bca19a781291fd" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:21:33.748478  6872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5be3a11b23d4ea9b08300a2789821c7" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 21 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:21:33.792414  6872 raft_consensus.cc:3060] T f5be3a11b23d4ea9b08300a2789821c7 P cd75a17ab2604397adab03bb8b5fd75c [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:21:33.793203  6877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bf4668eeb70467fb3dc5a0289233b3c" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 22 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:21:33.793764 14101 leader_election.cc:290] T 4b8cacb381b746da8d0049b0a83b41dd P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:21:33.794351  6877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab432e62819d499eaaf3dd55481dd930" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:21:33.794973  6877 raft_consensus.cc:2468] T ab432e62819d499eaaf3dd55481dd930 P cd75a17ab2604397adab03bb8b5fd75c [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 23.
I20260709 13:21:33.798990  7497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b8cacb381b746da8d0049b0a83b41dd" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:21:33.781756 13955 raft_consensus.cc:493] T 404190ce4ce94cecbfcb6ea9d1dd8626 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 17 FOLLOWER]: Starting leader election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:21:33.801663 13955 raft_consensus.cc:3060] T 404190ce4ce94cecbfcb6ea9d1dd8626 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:21:33.799827  7497 raft_consensus.cc:2468] T 4b8cacb381b746da8d0049b0a83b41dd P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 20.
I20260709 13:21:33.803339  6697 leader_election.cc:304] T 4b8cacb381b746da8d0049b0a83b41dd P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
I20260709 13:21:33.804191 14017 raft_consensus.cc:515] T 711ef6523deb4cbe8ef2ba61e1c21c98 P b7ab4784c7344b939bc36f639286f377 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:33.804989 14003 raft_consensus.cc:2804] T 4b8cacb381b746da8d0049b0a83b41dd P ccd8a4c3bfe3413cb2ae219b09aea832 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:21:33.805474 14003 raft_consensus.cc:493] T 4b8cacb381b746da8d0049b0a83b41dd P ccd8a4c3bfe3413cb2ae219b09aea832 [term 20 FOLLOWER]: Starting leader election (detected failure of leader cd75a17ab2604397adab03bb8b5fd75c)
I20260709 13:21:33.805886 14003 raft_consensus.cc:3060] T 4b8cacb381b746da8d0049b0a83b41dd P ccd8a4c3bfe3413cb2ae219b09aea832 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:21:33.806551 14017 leader_election.cc:290] T 711ef6523deb4cbe8ef2ba61e1c21c98 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:21:33.808184 14039 leader_election.cc:290] T a3022224cc81473690653a83d4e99470 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:21:33.772444  7495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a734b5ab7834e05a8c422208acc58b1" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:21:33.760296 14120 raft_consensus.cc:493] T f58dc08b12a2494bb9a1372837970ca2 P cd75a17ab2604397adab03bb8b5fd75c [term 20 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:21:33.809963 14120 raft_consensus.cc:515] T f58dc08b12a2494bb9a1372837970ca2 P cd75a17ab2604397adab03bb8b5fd75c [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:33.718644 13914 raft_consensus.cc:2804] T 22ccee1b570c4ad3a57bd7aec085b1b4 P b7ab4784c7344b939bc36f639286f377 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:21:33.762665  6876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6869f07b5a4885a0b99fbe60c3b175" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 24 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:21:33.821087  6800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a75bfe094d4bdc963aba3f08dfcd25" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:21:33.822031  6800 raft_consensus.cc:2468] T 95a75bfe094d4bdc963aba3f08dfcd25 P b7ab4784c7344b939bc36f639286f377 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in term 16.
I20260709 13:21:33.780196  6770 leader_election.cc:304] T f4b8bd455d5a47c18a1380839c6e0d61 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
W20260709 13:21:33.784260  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 124229us
I20260709 13:21:33.788496  6873 raft_consensus.cc:2468] T 4d9def8b32fd443aa94ab1420b06837b P cd75a17ab2604397adab03bb8b5fd75c [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 23.
I20260709 13:21:33.656987 14011 raft_consensus.cc:515] T 20f6842e26174571996b8dea4151d4be P cd75a17ab2604397adab03bb8b5fd75c [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:33.761973  6881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f58dc08b12a2494bb9a1372837970ca2" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:21:33.824991  6873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a75bfe094d4bdc963aba3f08dfcd25" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
W20260709 13:21:33.826207  6770 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 58193.8us
I20260709 13:21:33.827307  6770 leader_election.cc:304] T 1bf4668eeb70467fb3dc5a0289233b3c P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:21:33.828061  6876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6869f07b5a4885a0b99fbe60c3b175" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 24 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:21:33.816747  6872 raft_consensus.cc:2468] T f5be3a11b23d4ea9b08300a2789821c7 P cd75a17ab2604397adab03bb8b5fd75c [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 21.
I20260709 13:21:33.831787  6807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab432e62819d499eaaf3dd55481dd930" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:21:33.820075 14057 raft_consensus.cc:493] T a3022224cc81473690653a83d4e99470 P b7ab4784c7344b939bc36f639286f377 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:21:33.833197 14098 raft_consensus.cc:2749] T f4b8bd455d5a47c18a1380839c6e0d61 P b7ab4784c7344b939bc36f639286f377 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:21:33.833626 14057 raft_consensus.cc:515] T a3022224cc81473690653a83d4e99470 P b7ab4784c7344b939bc36f639286f377 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:33.834846  6802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ba5dac66ab5497e9e336f2a3c28cda5" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:21:33.834839  6872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "713b5728a197487c9300b310ab94e5a3" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:21:33.782423 13946 raft_consensus.cc:515] T 8c7f33e544204fbaac4078e3e83bbf4e P cd75a17ab2604397adab03bb8b5fd75c [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:33.835759  6802 raft_consensus.cc:2468] T 7ba5dac66ab5497e9e336f2a3c28cda5 P b7ab4784c7344b939bc36f639286f377 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in term 22.
I20260709 13:21:33.840999  6770 leader_election.cc:304] T d8292e16e5654be6bc408560cf256aaa P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:21:33.842788 14098 raft_consensus.cc:2804] T 1bf4668eeb70467fb3dc5a0289233b3c P b7ab4784c7344b939bc36f639286f377 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:21:33.843228 13690 consensus_queue.cc:1048] T 90d42e216d9741e190bca19a781291fd P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Connected to new peer: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:21:33.843228 14098 raft_consensus.cc:493] T 1bf4668eeb70467fb3dc5a0289233b3c P b7ab4784c7344b939bc36f639286f377 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:33.844350 14098 raft_consensus.cc:3060] T 1bf4668eeb70467fb3dc5a0289233b3c P b7ab4784c7344b939bc36f639286f377 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:21:33.849105 14058 raft_consensus.cc:2749] T d8292e16e5654be6bc408560cf256aaa P b7ab4784c7344b939bc36f639286f377 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:21:33.849299  6770 leader_election.cc:304] T 427c124d773f483294511e80fe340075 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:21:33.850133 14058 raft_consensus.cc:2749] T 427c124d773f483294511e80fe340075 P b7ab4784c7344b939bc36f639286f377 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:21:33.850265  6770 leader_election.cc:304] T b3f13b31a1f84f0d89d007eadd57924c P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:21:33.851164 14058 raft_consensus.cc:2749] T b3f13b31a1f84f0d89d007eadd57924c P b7ab4784c7344b939bc36f639286f377 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:21:33.838753 13998 consensus_queue.cc:1048] T bd6869f07b5a4885a0b99fbe60c3b175 P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Connected to new peer: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.014s
I20260709 13:21:33.835445 13588 leader_election.cc:290] T 3fa34c08b205435dba97346991aa1f92 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:21:33.830545 13914 raft_consensus.cc:493] T 22ccee1b570c4ad3a57bd7aec085b1b4 P b7ab4784c7344b939bc36f639286f377 [term 15 FOLLOWER]: Starting leader election (detected failure of leader cd75a17ab2604397adab03bb8b5fd75c)
I20260709 13:21:33.877125  6881 raft_consensus.cc:2468] T f58dc08b12a2494bb9a1372837970ca2 P cd75a17ab2604397adab03bb8b5fd75c [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 20.
I20260709 13:21:33.880851  6807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "404190ce4ce94cecbfcb6ea9d1dd8626" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:21:33.767767 13992 raft_consensus.cc:515] T 9e326172347f45e99a0d482b5d8ef768 P b7ab4784c7344b939bc36f639286f377 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:33.822204 13865 raft_consensus.cc:2749] T fe20b4b48823486ca3b9c648db6ce8aa P cd75a17ab2604397adab03bb8b5fd75c [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:21:33.876322  6770 leader_election.cc:304] T f09c2a98de1a4decabd0ff900dd44caa P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
I20260709 13:21:33.878079  6772 leader_election.cc:304] T 4d9def8b32fd443aa94ab1420b06837b P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:21:33.887454  6872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fa34c08b205435dba97346991aa1f92" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 26 candidate_status { last_received { term: 25 index: 18 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:21:33.891633  6807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a75bfe094d4bdc963aba3f08dfcd25" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:21:33.900141  6732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5be3a11b23d4ea9b08300a2789821c7" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 21 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:21:33.900851  6730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6869f07b5a4885a0b99fbe60c3b175" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 24 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:21:33.902158  6872 raft_consensus.cc:2468] T 3fa34c08b205435dba97346991aa1f92 P cd75a17ab2604397adab03bb8b5fd75c [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 25.
I20260709 13:21:33.902331  6730 raft_consensus.cc:2468] T bd6869f07b5a4885a0b99fbe60c3b175 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 23.
I20260709 13:21:33.903614  6730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b3759de40694069b13c0f8bd40e5709" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:21:33.904223  6730 raft_consensus.cc:2468] T 9b3759de40694069b13c0f8bd40e5709 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 18.
I20260709 13:21:33.901930  6807 raft_consensus.cc:2468] T 95a75bfe094d4bdc963aba3f08dfcd25 P b7ab4784c7344b939bc36f639286f377 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 16.
I20260709 13:21:33.905524  6728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44bde925b2e541b69890d70715b85176" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 22 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:21:33.899288  6731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34f36d59d88f40fe8a2805e604fc6c0a" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:21:33.907374  6731 raft_consensus.cc:3060] T 34f36d59d88f40fe8a2805e604fc6c0a P ccd8a4c3bfe3413cb2ae219b09aea832 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:21:33.908890  6844 leader_election.cc:304] T a1704639a875409b9959353527b3fd68 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:21:33.910339  6807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be1a92657f494cac8dd227d152f50151" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:21:33.907892 13697 raft_consensus.cc:493] T e31b9971c15848dea59d4d4130141d9e P ccd8a4c3bfe3413cb2ae219b09aea832 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:21:33.912926 14057 leader_election.cc:290] T a3022224cc81473690653a83d4e99470 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:21:33.914813  6844 leader_election.cc:304] T 2c240553ce044eedb41541d72b9475d7 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:21:33.921442 13946 leader_election.cc:290] T 8c7f33e544204fbaac4078e3e83bbf4e P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:21:33.924877  6725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a75bfe094d4bdc963aba3f08dfcd25" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:21:33.925704  6725 raft_consensus.cc:2468] T 95a75bfe094d4bdc963aba3f08dfcd25 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 16.
I20260709 13:21:33.926576  6726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90d42e216d9741e190bca19a781291fd" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:21:33.927217  6726 raft_consensus.cc:3060] T 90d42e216d9741e190bca19a781291fd P ccd8a4c3bfe3413cb2ae219b09aea832 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:21:33.905015 14121 consensus_queue.cc:1059] T 1bf4668eeb70467fb3dc5a0289233b3c P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: INVALID_TERM, Last received: 19.12, Next index: 13, Last known committed idx: 11, Time since last communication: 0.023s
I20260709 13:21:33.888447 13914 raft_consensus.cc:3060] T 22ccee1b570c4ad3a57bd7aec085b1b4 P b7ab4784c7344b939bc36f639286f377 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:21:33.907943 13990 raft_consensus.cc:2804] T f09c2a98de1a4decabd0ff900dd44caa P b7ab4784c7344b939bc36f639286f377 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:21:33.932099  6727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d9def8b32fd443aa94ab1420b06837b" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 24 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:21:33.932715 13990 raft_consensus.cc:493] T f09c2a98de1a4decabd0ff900dd44caa P b7ab4784c7344b939bc36f639286f377 [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:33.933326 13990 raft_consensus.cc:3060] T f09c2a98de1a4decabd0ff900dd44caa P b7ab4784c7344b939bc36f639286f377 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:21:33.766527 14088 raft_consensus.cc:515] T 7887766dc6784fcaa42b35c05fea7a99 P cd75a17ab2604397adab03bb8b5fd75c [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:33.932767 13896 leader_election.cc:290] T 24ee15416e3145beaa1b8183453729a3 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:21:33.943558  6802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "713b5728a197487c9300b310ab94e5a3" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:21:33.936676  6878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09c2a98de1a4decabd0ff900dd44caa" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:21:33.938254  6874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a75bfe094d4bdc963aba3f08dfcd25" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:21:33.912652 13697 raft_consensus.cc:515] T e31b9971c15848dea59d4d4130141d9e P ccd8a4c3bfe3413cb2ae219b09aea832 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:33.900938  6772 leader_election.cc:304] T f5be3a11b23d4ea9b08300a2789821c7 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:21:33.886197 13987 raft_consensus.cc:493] T f3f9c2e2bf644115957398fe4c9459db P ccd8a4c3bfe3413cb2ae219b09aea832 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:21:33.967458 14068 consensus_queue.cc:1048] T 90d42e216d9741e190bca19a781291fd P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:21:33.967232  6844 leader_election.cc:304] T 4275cf08e63345f993bce8664eada830 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:21:33.970520 13697 leader_election.cc:290] T e31b9971c15848dea59d4d4130141d9e P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:21:33.970916  6844 leader_election.cc:400] T 34f36d59d88f40fe8a2805e604fc6c0a P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 19 pre-election: Vote denied by peer b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817) with higher term. Message: Invalid argument: T 34f36d59d88f40fe8a2805e604fc6c0a P b7ab4784c7344b939bc36f639286f377 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c for earlier term 19. Current term is 20.
I20260709 13:21:33.971283  6844 leader_election.cc:403] T 34f36d59d88f40fe8a2805e604fc6c0a P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 19 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:21:33.971247 13987 raft_consensus.cc:515] T f3f9c2e2bf644115957398fe4c9459db P ccd8a4c3bfe3413cb2ae219b09aea832 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:33.972194 14087 raft_consensus.cc:2749] T 4275cf08e63345f993bce8664eada830 P cd75a17ab2604397adab03bb8b5fd75c [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:21:33.973965  6732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b8cacb381b746da8d0049b0a83b41dd" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:21:33.966027 14121 raft_consensus.cc:3055] T 1bf4668eeb70467fb3dc5a0289233b3c P cd75a17ab2604397adab03bb8b5fd75c [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:21:33.976435 14121 raft_consensus.cc:740] T 1bf4668eeb70467fb3dc5a0289233b3c P cd75a17ab2604397adab03bb8b5fd75c [term 21 LEADER]: Becoming Follower/Learner. State: Replica: cd75a17ab2604397adab03bb8b5fd75c, State: Running, Role: LEADER
I20260709 13:21:33.977315 14121 consensus_queue.cc:260] T 1bf4668eeb70467fb3dc5a0289233b3c P cd75a17ab2604397adab03bb8b5fd75c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 21.13, Last appended by leader: 13, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:33.978456 14121 raft_consensus.cc:3060] T 1bf4668eeb70467fb3dc5a0289233b3c P cd75a17ab2604397adab03bb8b5fd75c [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:21:33.979879  6878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a75bfe094d4bdc963aba3f08dfcd25" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:21:33.980453 14066 consensus_queue.cc:1048] T 44bde925b2e541b69890d70715b85176 P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:21:33.981006  6878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ba5dac66ab5497e9e336f2a3c28cda5" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:21:33.981760 14011 leader_election.cc:290] T 20f6842e26174571996b8dea4151d4be P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:21:33.888393 14101 raft_consensus.cc:493] T 44bde925b2e541b69890d70715b85176 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader cd75a17ab2604397adab03bb8b5fd75c)
I20260709 13:21:33.983026 14101 raft_consensus.cc:515] T 44bde925b2e541b69890d70715b85176 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:33.985039  6877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce4f062dcd314d43a63ca74067cb5ee3" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:21:33.985421 14101 leader_election.cc:290] T 44bde925b2e541b69890d70715b85176 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:21:33.834431 13997 raft_consensus.cc:515] T 7c37d41cd9164c15a6826ca62a851a69 P b7ab4784c7344b939bc36f639286f377 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:33.986585  6877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b8cacb381b746da8d0049b0a83b41dd" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:21:33.988099 13997 leader_election.cc:290] T 7c37d41cd9164c15a6826ca62a851a69 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:21:33.942914 13886 raft_consensus.cc:493] T f3f9c2e2bf644115957398fe4c9459db P cd75a17ab2604397adab03bb8b5fd75c [term 21 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:21:33.991451 13886 raft_consensus.cc:515] T f3f9c2e2bf644115957398fe4c9459db P cd75a17ab2604397adab03bb8b5fd75c [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:33.993642 13886 leader_election.cc:290] T f3f9c2e2bf644115957398fe4c9459db P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
W20260709 13:21:33.994326 14067 consensus_queue.cc:1175] T 1bf4668eeb70467fb3dc5a0289233b3c P cd75a17ab2604397adab03bb8b5fd75c [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "b7ab4784c7344b939bc36f639286f377" responder_term: 21 status { last_received { term: 19 index: 12 } last_committed_idx: 12 error { code: PRECEDING_ENTRY_DIDNT_MATCH status { code: ILLEGAL_STATE message: "Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 21 index: 13. (index mismatch)" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:21:33.987795  6877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8cee0accdb8499c86d4414b72565a38" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
W20260709 13:21:34.027565  6845 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:21:33.998044  6728 raft_consensus.cc:2410] T 44bde925b2e541b69890d70715b85176 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7ab4784c7344b939bc36f639286f377 for term 22 because replica has last-logged OpId of term: 21 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 19 index: 12.
I20260709 13:21:34.032135  6800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bf4668eeb70467fb3dc5a0289233b3c" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 22 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:21:33.946002  6807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8cee0accdb8499c86d4414b72565a38" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:21:33.999739  6880 raft_consensus.cc:2468] T 34f36d59d88f40fe8a2805e604fc6c0a P cd75a17ab2604397adab03bb8b5fd75c [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 20.
I20260709 13:21:34.002609  6725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77e330a82df4b43a745d57a68f6f057" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:21:34.047458  6725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8292e16e5654be6bc408560cf256aaa" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:21:33.959806  7495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24ee15416e3145beaa1b8183453729a3" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:21:34.049288  6877 raft_consensus.cc:2468] T d8cee0accdb8499c86d4414b72565a38 P cd75a17ab2604397adab03bb8b5fd75c [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in term 19.
I20260709 13:21:33.935565  6879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77e330a82df4b43a745d57a68f6f057" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:21:34.006634  6730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30e88460611e47b2ba16a46a30b5f416" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:21:34.058596  6730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3d8792045a4583ae2e965b1350a5b4" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:21:34.064849  6725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "711ef6523deb4cbe8ef2ba61e1c21c98" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:21:34.060671  6724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "711ef6523deb4cbe8ef2ba61e1c21c98" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
W20260709 13:21:34.077805  6772 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 176949us
I20260709 13:21:34.080312  6879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bf4668eeb70467fb3dc5a0289233b3c" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 22 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:21:34.089455  6725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c37d41cd9164c15a6826ca62a851a69" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:21:34.092134  6730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d9def8b32fd443aa94ab1420b06837b" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 24 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:21:34.088639  6772 leader_election.cc:304] T ce4f062dcd314d43a63ca74067cb5ee3 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:21:33.944872 13998 raft_consensus.cc:2749] T a1704639a875409b9959353527b3fd68 P cd75a17ab2604397adab03bb8b5fd75c [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:21:33.965737 14010 raft_consensus.cc:2749] T 2c240553ce044eedb41541d72b9475d7 P cd75a17ab2604397adab03bb8b5fd75c [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:21:34.097749  6807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1528ab62b6fe4e3099d08f141afee116" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 20 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:21:34.098140  6726 raft_consensus.cc:2468] T 90d42e216d9741e190bca19a781291fd P ccd8a4c3bfe3413cb2ae219b09aea832 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 20.
I20260709 13:21:33.960836 14120 leader_election.cc:290] T f58dc08b12a2494bb9a1372837970ca2 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:21:34.099201  6726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de3186201e1a40d0b335eeb8b4e256e0" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:21:34.100090  6725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24ee15416e3145beaa1b8183453729a3" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:21:34.101251  6723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbdf895bba214ff68685a24fd17dfb5d" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 21 candidate_status { last_received { term: 20 index: 9 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:21:34.054102 14087 raft_consensus.cc:2749] T 34f36d59d88f40fe8a2805e604fc6c0a P cd75a17ab2604397adab03bb8b5fd75c [term 20 FOLLOWER]: Leader pre-election lost for term 19. Reason: Vote denied by peer b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817) with higher term. Message: Invalid argument: T 34f36d59d88f40fe8a2805e604fc6c0a P b7ab4784c7344b939bc36f639286f377 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c for earlier term 19. Current term is 20.
I20260709 13:21:33.935156 13690 consensus_queue.cc:1048] T bd6869f07b5a4885a0b99fbe60c3b175 P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.157s
I20260709 13:21:34.108518  6874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a734b5ab7834e05a8c422208acc58b1" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:21:34.124352  6727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a92dd554674067a83a9cb68c4773f2" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:21:34.126744 13927 raft_consensus.cc:2749] T ce4f062dcd314d43a63ca74067cb5ee3 P b7ab4784c7344b939bc36f639286f377 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:21:34.124401  7468 leader_election.cc:304] T d8cee0accdb8499c86d4414b72565a38 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:21:34.128659 14079 raft_consensus.cc:2804] T d8cee0accdb8499c86d4414b72565a38 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:21:34.129180 14079 raft_consensus.cc:493] T d8cee0accdb8499c86d4414b72565a38 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 19 FOLLOWER]: Starting leader election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:21:34.129552 14079 raft_consensus.cc:3060] T d8cee0accdb8499c86d4414b72565a38 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:21:34.130820 13914 raft_consensus.cc:515] T 22ccee1b570c4ad3a57bd7aec085b1b4 P b7ab4784c7344b939bc36f639286f377 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:34.132521 13992 leader_election.cc:290] T 9e326172347f45e99a0d482b5d8ef768 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:21:34.118571 13990 raft_consensus.cc:515] T f09c2a98de1a4decabd0ff900dd44caa P b7ab4784c7344b939bc36f639286f377 [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:34.118861 14017 raft_consensus.cc:2804] T 4d9def8b32fd443aa94ab1420b06837b P b7ab4784c7344b939bc36f639286f377 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:21:34.152086  6730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e31b9971c15848dea59d4d4130141d9e" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:21:34.152271  6806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30e88460611e47b2ba16a46a30b5f416" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:21:34.091955 13987 leader_election.cc:290] T f3f9c2e2bf644115957398fe4c9459db P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:21:34.133994  6803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a734b5ab7834e05a8c422208acc58b1" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:21:34.136350  6729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d65025eea89441290d85dd053810e31" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:21:34.094569 14036 raft_consensus.cc:2804] T f5be3a11b23d4ea9b08300a2789821c7 P b7ab4784c7344b939bc36f639286f377 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:21:34.138005  6878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "427c124d773f483294511e80fe340075" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:21:34.144258  6877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44bde925b2e541b69890d70715b85176" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 22 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:21:33.965417 13955 raft_consensus.cc:515] T 404190ce4ce94cecbfcb6ea9d1dd8626 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:21:34.179905  6878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c37d41cd9164c15a6826ca62a851a69" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:21:34.149847  6807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce4f062dcd314d43a63ca74067cb5ee3" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:21:34.150836  6799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb7fa124c3bf4ef9ab65a407cb008441" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:21:34.152861  6730 raft_consensus.cc:2468] T e31b9971c15848dea59d4d4130141d9e P ccd8a4c3bfe3413cb2ae219b09aea832 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 17.
I20260709 13:21:34.157194  6805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77e330a82df4b43a745d57a68f6f057" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:21:34.154390  6874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "711ef6523deb4cbe8ef2ba61e1c21c98" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:21:34.158995  6806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "427c124d773f483294511e80fe340075" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:21:34.159263  6881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b3759de40694069b13c0f8bd40e5709" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:21:34.181423  6807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d65025eea89441290d85dd053810e31" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:21:34.176807  6802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f03d0dbf16864ca4bc1bb5e4c0334c0f" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:21:34.147083  6731 raft_consensus.cc:2468] T 34f36d59d88f40fe8a2805e604fc6c0a P ccd8a4c3bfe3413cb2ae219b09aea832 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 20.
I20260709 13:21:34.184947  6803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8292e16e5654be6bc408560cf256aaa" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:21:34.189947  6805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbdf895bba214ff68685a24fd17dfb5d" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 21 candidate_status { last_received { term: 20 index: 9 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:21:34.102473 14011 consensus_queue.cc:1048] T f09c2a98de1a4decabd0ff900dd44caa P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Connected to new peer: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.071s
I20260709 13:21:34.195303  6798 raft_consensus.cc:1240] T f09c2a98de1a4decabd0ff900dd44caa P b7ab4784c7344b939bc36f639286f377 [term 24 FOLLOWER]: Rejecting Update request from peer cd75a17ab2604397adab03bb8b5fd75c for earlier term 23. Current term is 24. Ops: []
I20260709 13:21:34.199640  6729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fa34c08b205435dba97346991aa1f92" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 26 candidate_status { last_received { term: 25 index: 18 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:21:34.203557  6874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e326172347f45e99a0d482b5d8ef768" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:21:34.207702  7496 raft_consensus.cc:1240] T 404190ce4ce94cecbfcb6ea9d1dd8626 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 18 FOLLOWER]: Rejecting Update request from peer b7ab4784c7344b939bc36f639286f377 for earlier term 17. Current term is 18. Ops: []
I20260709 13:21:34.209110  6875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b8cacb381b746da8d0049b0a83b41dd" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:21:34.215179  6874 raft_consensus.cc:1240] T f5be3a11b23d4ea9b08300a2789821c7 P cd75a17ab2604397adab03bb8b5fd75c [term 21 FOLLOWER]: Rejecting Update request from peer ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 20. Current term is 21. Ops: [20.12-20.12]
I20260709 13:21:34.152786 14057 consensus_queue.cc:1059] T be1a92657f494cac8dd227d152f50151 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false }, Status: INVALID_TERM, Last received: 23.17, Next index: 18, Last known committed idx: 17, Time since last communication: 0.050s
I20260709 13:21:34.188057 14036 raft_consensus.cc:697] T f5be3a11b23d4ea9b08300a2789821c7 P b7ab4784c7344b939bc36f639286f377 [term 21 LEADER]: Becoming Leader. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
I20260709 13:21:34.217212  6872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3022224cc81473690653a83d4e99470" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:21:34.218456  6729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3022224cc81473690653a83d4e99470" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:21:34.207067  6772 leader_election.cc:304] T 34f36d59d88f40fe8a2805e604fc6c0a P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:21:34.225219  6799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "711ef6523deb4cbe8ef2ba61e1c21c98" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:21:34.220803  6807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17587d6730594da4a56fa13a353232a1" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 27 candidate_status { last_received { term: 26 index: 18 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:21:34.227309  6806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c37d41cd9164c15a6826ca62a851a69" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:21:34.227550  6802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d9def8b32fd443aa94ab1420b06837b" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 24 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:21:34.228729  6806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a92dd554674067a83a9cb68c4773f2" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:21:34.228749  6802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8cee0accdb8499c86d4414b72565a38" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:21:34.230844 14098 raft_consensus.cc:515] T 1bf4668eeb70467fb3dc5a0289233b3c P b7ab4784c7344b939bc36f639286f377 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:34.232343  6800 raft_consensus.cc:2393] T 1bf4668eeb70467fb3dc5a0289233b3c P b7ab4784c7344b939bc36f639286f377 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate ccd8a4c3bfe3413cb2ae219b09aea832 in current term 22: Already voted for candidate b7ab4784c7344b939bc36f639286f377 in this term.
I20260709 13:21:34.234028 14017 raft_consensus.cc:493] T 4d9def8b32fd443aa94ab1420b06837b P b7ab4784c7344b939bc36f639286f377 [term 23 FOLLOWER]: Starting leader election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:21:34.238404  6802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de3186201e1a40d0b335eeb8b4e256e0" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:21:34.239717  6879 raft_consensus.cc:2410] T 1bf4668eeb70467fb3dc5a0289233b3c P cd75a17ab2604397adab03bb8b5fd75c [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate ccd8a4c3bfe3413cb2ae219b09aea832 for term 22 because replica has last-logged OpId of term: 21 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 19 index: 12.
I20260709 13:21:34.266474  7497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3d8792045a4583ae2e965b1350a5b4" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:21:34.266793  7503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb7fa124c3bf4ef9ab65a407cb008441" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:21:34.268864  7498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8cee0accdb8499c86d4414b72565a38" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:21:34.270987  7502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24ee15416e3145beaa1b8183453729a3" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:21:34.276743  6729 raft_consensus.cc:1240] T 90d42e216d9741e190bca19a781291fd P ccd8a4c3bfe3413cb2ae219b09aea832 [term 20 FOLLOWER]: Rejecting Update request from peer cd75a17ab2604397adab03bb8b5fd75c for earlier term 19. Current term is 20. Ops: [19.11-19.11]
W20260709 13:21:34.277699  6772 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 70743us
I20260709 13:21:34.278656  6772 leader_election.cc:304] T e77e330a82df4b43a745d57a68f6f057 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:21:34.283843  6874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44bde925b2e541b69890d70715b85176" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:21:34.289779  6875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e31b9971c15848dea59d4d4130141d9e" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:21:34.234578 14017 raft_consensus.cc:3060] T 4d9def8b32fd443aa94ab1420b06837b P b7ab4784c7344b939bc36f639286f377 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:21:34.295077  6807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e31b9971c15848dea59d4d4130141d9e" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:21:34.298738  6874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f9c2e2bf644115957398fe4c9459db" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:21:34.303733  6731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c7f33e544204fbaac4078e3e83bbf4e" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:21:34.306561  6725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f9c2e2bf644115957398fe4c9459db" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:21:34.304013  6730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f58dc08b12a2494bb9a1372837970ca2" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:21:34.311646  6731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7887766dc6784fcaa42b35c05fea7a99" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 24 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:21:34.308209  6730 raft_consensus.cc:2468] T f58dc08b12a2494bb9a1372837970ca2 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 20.
I20260709 13:21:34.299605  6874 raft_consensus.cc:2468] T f3f9c2e2bf644115957398fe4c9459db P cd75a17ab2604397adab03bb8b5fd75c [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 21.
I20260709 13:21:34.314990  6802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e326172347f45e99a0d482b5d8ef768" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:21:34.300530  7502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fa34c08b205435dba97346991aa1f92" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 26 candidate_status { last_received { term: 25 index: 18 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:21:34.220252 14079 raft_consensus.cc:515] T d8cee0accdb8499c86d4414b72565a38 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:21:34.293793 13996 raft_consensus.cc:2804] T 34f36d59d88f40fe8a2805e604fc6c0a P b7ab4784c7344b939bc36f639286f377 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:21:34.293977 13963 raft_consensus.cc:2749] T e77e330a82df4b43a745d57a68f6f057 P b7ab4784c7344b939bc36f639286f377 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:21:34.327962  6872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24ee15416e3145beaa1b8183453729a3" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:21:34.337044  6800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3022224cc81473690653a83d4e99470" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:21:34.342401 13914 leader_election.cc:290] T 22ccee1b570c4ad3a57bd7aec085b1b4 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 16 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:21:34.337769  6697 leader_election.cc:304] T ab432e62819d499eaaf3dd55481dd930 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:21:34.272873 14003 raft_consensus.cc:515] T 4b8cacb381b746da8d0049b0a83b41dd P ccd8a4c3bfe3413cb2ae219b09aea832 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:21:34.354791  7495 raft_consensus.cc:1240] T d8cee0accdb8499c86d4414b72565a38 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 20 FOLLOWER]: Rejecting Update request from peer b7ab4784c7344b939bc36f639286f377 for earlier term 19. Current term is 20. Ops: []
I20260709 13:21:34.358382  6800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c7f33e544204fbaac4078e3e83bbf4e" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:21:34.368778  6732 raft_consensus.cc:2393] T 4b8cacb381b746da8d0049b0a83b41dd P ccd8a4c3bfe3413cb2ae219b09aea832 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in current term 21: Already voted for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in this term.
W20260709 13:21:34.370353  7466 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 218665us
I20260709 13:21:34.372951  7466 leader_election.cc:304] T 95a75bfe094d4bdc963aba3f08dfcd25 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:21:34.374698  7466 leader_election.cc:304] T 7ba5dac66ab5497e9e336f2a3c28cda5 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, b7ab4784c7344b939bc36f639286f377; no voters: cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:21:34.352288 13987 raft_consensus.cc:2804] T ab432e62819d499eaaf3dd55481dd930 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:21:34.350500 13996 raft_consensus.cc:697] T 34f36d59d88f40fe8a2805e604fc6c0a P b7ab4784c7344b939bc36f639286f377 [term 20 LEADER]: Becoming Leader. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
I20260709 13:21:34.388401  6800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f58dc08b12a2494bb9a1372837970ca2" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:21:34.341065  6844 leader_election.cc:304] T e31b9971c15848dea59d4d4130141d9e P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
W20260709 13:21:34.389730  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 48770.2us
I20260709 13:21:34.333447  6874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e326172347f45e99a0d482b5d8ef768" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:21:34.333470  6846 leader_election.cc:304] T bb3d8792045a4583ae2e965b1350a5b4 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:21:34.334519  6727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20f6842e26174571996b8dea4151d4be" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:21:34.366912 14088 leader_election.cc:290] T 7887766dc6784fcaa42b35c05fea7a99 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
W20260709 13:21:34.400112  6846 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.68:45071, user_credentials={real_user=slave}} blocked reactor thread for 82016.8us
I20260709 13:21:34.432914  6800 raft_consensus.cc:1240] T 90d42e216d9741e190bca19a781291fd P b7ab4784c7344b939bc36f639286f377 [term 20 FOLLOWER]: Rejecting Update request from peer cd75a17ab2604397adab03bb8b5fd75c for earlier term 19. Current term is 20. Ops: [19.11-19.11]
I20260709 13:21:34.380468 14098 leader_election.cc:290] T 1bf4668eeb70467fb3dc5a0289233b3c P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 22 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:21:34.381037 13987 raft_consensus.cc:493] T ab432e62819d499eaaf3dd55481dd930 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 23 FOLLOWER]: Starting leader election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:21:34.430424  6844 leader_election.cc:304] T f58dc08b12a2494bb9a1372837970ca2 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:21:34.437194  6807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f9c2e2bf644115957398fe4c9459db" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:21:34.346817 14036 consensus_queue.cc:237] T f5be3a11b23d4ea9b08300a2789821c7 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:34.393725 14103 raft_consensus.cc:2804] T 95a75bfe094d4bdc963aba3f08dfcd25 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:21:34.397935 13990 leader_election.cc:290] T f09c2a98de1a4decabd0ff900dd44caa P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 24 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:21:34.470633  6800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20f6842e26174571996b8dea4151d4be" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:21:34.400775 13588 raft_consensus.cc:2804] T e31b9971c15848dea59d4d4130141d9e P cd75a17ab2604397adab03bb8b5fd75c [term 17 FOLLOWER]: Leader pre-election won for term 18
W20260709 13:21:34.445305 14125 log.cc:927] Time spent T 4d9def8b32fd443aa94ab1420b06837b P b7ab4784c7344b939bc36f639286f377: Append to log took a long time: real 0.154s	user 0.001s	sys 0.000s
I20260709 13:21:34.481123  6807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e31b9971c15848dea59d4d4130141d9e" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:21:34.467311 13987 raft_consensus.cc:3060] T ab432e62819d499eaaf3dd55481dd930 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:21:34.435235 14066 raft_consensus.cc:2749] T bb3d8792045a4583ae2e965b1350a5b4 P cd75a17ab2604397adab03bb8b5fd75c [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:21:34.465279 13955 leader_election.cc:290] T 404190ce4ce94cecbfcb6ea9d1dd8626 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 18 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:21:34.468472 14088 raft_consensus.cc:2804] T f58dc08b12a2494bb9a1372837970ca2 P cd75a17ab2604397adab03bb8b5fd75c [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:21:34.469589 14103 raft_consensus.cc:493] T 95a75bfe094d4bdc963aba3f08dfcd25 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 16 FOLLOWER]: Starting leader election (detected failure of leader cd75a17ab2604397adab03bb8b5fd75c)
I20260709 13:21:34.437686 14121 consensus_queue.cc:1059] T 90d42e216d9741e190bca19a781291fd P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: INVALID_TERM, Last received: 18.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.057s
W20260709 13:21:34.495746  6772 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 96701.2us
I20260709 13:21:34.479218 13588 raft_consensus.cc:493] T e31b9971c15848dea59d4d4130141d9e P cd75a17ab2604397adab03bb8b5fd75c [term 17 FOLLOWER]: Starting leader election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
W20260709 13:21:34.498298 14124 log.cc:927] Time spent T 7c44c4849aa54f2b94d1f1bef9ed546f P b7ab4784c7344b939bc36f639286f377: Append to log took a long time: real 0.254s	user 0.001s	sys 0.000s
I20260709 13:21:34.507668 14088 raft_consensus.cc:493] T f58dc08b12a2494bb9a1372837970ca2 P cd75a17ab2604397adab03bb8b5fd75c [term 20 FOLLOWER]: Starting leader election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:21:34.515552 14103 raft_consensus.cc:3060] T 95a75bfe094d4bdc963aba3f08dfcd25 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:21:34.564869  6846 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.68:45071, user_credentials={real_user=slave}} blocked reactor thread for 46260.4us
I20260709 13:21:34.515385 14059 raft_consensus.cc:2804] T 7ba5dac66ab5497e9e336f2a3c28cda5 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:21:34.574966  6874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bf4668eeb70467fb3dc5a0289233b3c" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 22 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:21:34.575855  6874 raft_consensus.cc:2410] T 1bf4668eeb70467fb3dc5a0289233b3c P cd75a17ab2604397adab03bb8b5fd75c [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate b7ab4784c7344b939bc36f639286f377 for term 22 because replica has last-logged OpId of term: 21 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 19 index: 12.
I20260709 13:21:34.565313  6802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f9c2e2bf644115957398fe4c9459db" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
W20260709 13:21:34.548096 14128 log.cc:927] Time spent T 3411566abe2d4c9bb4b2adfdd05e6f17 P cd75a17ab2604397adab03bb8b5fd75c: Append to log took a long time: real 0.110s	user 0.004s	sys 0.002s
I20260709 13:21:34.522346 13588 raft_consensus.cc:3060] T e31b9971c15848dea59d4d4130141d9e P cd75a17ab2604397adab03bb8b5fd75c [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:21:34.547219 14101 raft_consensus.cc:493] T f03d0dbf16864ca4bc1bb5e4c0334c0f P ccd8a4c3bfe3413cb2ae219b09aea832 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:21:34.572685  6877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22ccee1b570c4ad3a57bd7aec085b1b4" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:21:34.576812  6879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09c2a98de1a4decabd0ff900dd44caa" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:21:34.577801  6799 raft_consensus.cc:1240] T 22ccee1b570c4ad3a57bd7aec085b1b4 P b7ab4784c7344b939bc36f639286f377 [term 16 FOLLOWER]: Rejecting Update request from peer cd75a17ab2604397adab03bb8b5fd75c for earlier term 15. Current term is 16. Ops: []
I20260709 13:21:34.578454  6801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44bde925b2e541b69890d70715b85176" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
W20260709 13:21:34.598378 14129 log.cc:927] Time spent T 4f00a2e87e56452083b759f60d461ee3 P cd75a17ab2604397adab03bb8b5fd75c: Append to log took a long time: real 0.131s	user 0.001s	sys 0.000s
I20260709 13:21:34.549595 13856 raft_consensus.cc:3055] T 90d42e216d9741e190bca19a781291fd P cd75a17ab2604397adab03bb8b5fd75c [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:21:34.570669  6846 leader_election.cc:304] T 24ee15416e3145beaa1b8183453729a3 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:21:34.497942 13996 consensus_queue.cc:237] T 34f36d59d88f40fe8a2805e604fc6c0a P b7ab4784c7344b939bc36f639286f377 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.10, Last appended by leader: 10, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:34.594489 14079 leader_election.cc:290] T d8cee0accdb8499c86d4414b72565a38 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 20 election: Requested vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:21:34.569661 14088 raft_consensus.cc:3060] T f58dc08b12a2494bb9a1372837970ca2 P cd75a17ab2604397adab03bb8b5fd75c [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:21:34.575049 14008 raft_consensus.cc:493] T de3186201e1a40d0b335eeb8b4e256e0 P b7ab4784c7344b939bc36f639286f377 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:21:34.574815 14059 raft_consensus.cc:493] T 7ba5dac66ab5497e9e336f2a3c28cda5 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 22 FOLLOWER]: Starting leader election (detected failure of leader cd75a17ab2604397adab03bb8b5fd75c)
W20260709 13:21:34.603940  6697 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 255483us
I20260709 13:21:34.585330 13890 raft_consensus.cc:493] T 3d65025eea89441290d85dd053810e31 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:21:34.598582 14003 leader_election.cc:290] T 4b8cacb381b746da8d0049b0a83b41dd P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 21 election: Requested vote from peers cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:21:34.621740  6802 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "34f36d59d88f40fe8a2805e604fc6c0a"
dest_uuid: "b7ab4784c7344b939bc36f639286f377"
mode: GRACEFUL
new_leader_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
 from {username='slave'} at 127.0.0.1:38240
I20260709 13:21:34.615265  6697 leader_election.cc:304] T bd6869f07b5a4885a0b99fbe60c3b175 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
W20260709 13:21:34.626368  7466 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 251774us
I20260709 13:21:34.615595 14059 raft_consensus.cc:3060] T 7ba5dac66ab5497e9e336f2a3c28cda5 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:21:34.596227 14101 raft_consensus.cc:515] T f03d0dbf16864ca4bc1bb5e4c0334c0f P ccd8a4c3bfe3413cb2ae219b09aea832 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:34.610893 13856 raft_consensus.cc:740] T 90d42e216d9741e190bca19a781291fd P cd75a17ab2604397adab03bb8b5fd75c [term 19 LEADER]: Becoming Follower/Learner. State: Replica: cd75a17ab2604397adab03bb8b5fd75c, State: Running, Role: LEADER
I20260709 13:21:34.621524 14121 raft_consensus.cc:2749] T 24ee15416e3145beaa1b8183453729a3 P cd75a17ab2604397adab03bb8b5fd75c [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 13:21:34.639578  6695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 83223.4us
I20260709 13:21:34.579190  6770 leader_election.cc:304] T bd6869f07b5a4885a0b99fbe60c3b175 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:21:34.630584 14003 raft_consensus.cc:493] T 07a92dd554674067a83a9cb68c4773f2 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:21:34.615948 14008 raft_consensus.cc:515] T de3186201e1a40d0b335eeb8b4e256e0 P b7ab4784c7344b939bc36f639286f377 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:34.667019 14008 leader_election.cc:290] T de3186201e1a40d0b335eeb8b4e256e0 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:21:34.655002  6727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3022224cc81473690653a83d4e99470" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:21:34.655269  6731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c37d41cd9164c15a6826ca62a851a69" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:21:34.623629 13890 raft_consensus.cc:515] T 3d65025eea89441290d85dd053810e31 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:34.658213  6728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e326172347f45e99a0d482b5d8ef768" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:21:34.642228 14134 raft_consensus.cc:493] T 2c240553ce044eedb41541d72b9475d7 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:21:34.662604  6880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8cee0accdb8499c86d4414b72565a38" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
W20260709 13:21:34.662806  6697 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 47649.8us
I20260709 13:21:34.686949  6697 leader_election.cc:304] T 95a75bfe094d4bdc963aba3f08dfcd25 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, cd75a17ab2604397adab03bb8b5fd75c
W20260709 13:21:34.677404 14133 log.cc:927] Time spent T bd6869f07b5a4885a0b99fbe60c3b175 P ccd8a4c3bfe3413cb2ae219b09aea832: Append to log took a long time: real 0.066s	user 0.000s	sys 0.000s
I20260709 13:21:34.681034 14141 raft_consensus.cc:493] T 853ac0a8cbd64ce99457f170216d4d0f P ccd8a4c3bfe3413cb2ae219b09aea832 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:21:34.629923  7466 leader_election.cc:304] T be1a92657f494cac8dd227d152f50151 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 24 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
W20260709 13:21:34.706182  7466 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 76370.3us
I20260709 13:21:34.707872  7466 leader_election.cc:304] T 1528ab62b6fe4e3099d08f141afee116 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:21:34.688555  6697 leader_election.cc:304] T 3fa34c08b205435dba97346991aa1f92 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb
I20260709 13:21:34.663708 13856 consensus_queue.cc:260] T 90d42e216d9741e190bca19a781291fd P cd75a17ab2604397adab03bb8b5fd75c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 19.11, Last appended by leader: 11, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:34.711673 14101 leader_election.cc:290] T f03d0dbf16864ca4bc1bb5e4c0334c0f P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:21:34.711890 13856 raft_consensus.cc:3060] T 90d42e216d9741e190bca19a781291fd P cd75a17ab2604397adab03bb8b5fd75c [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:21:34.713223 14101 raft_consensus.cc:2749] T 95a75bfe094d4bdc963aba3f08dfcd25 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:21:34.714764 14127 log.cc:927] Time spent T 4d9def8b32fd443aa94ab1420b06837b P cd75a17ab2604397adab03bb8b5fd75c: Append to log took a long time: real 0.447s	user 0.004s	sys 0.000s
I20260709 13:21:34.717614 13890 leader_election.cc:290] T 3d65025eea89441290d85dd053810e31 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:21:34.719486  7466 leader_election.cc:304] T ce4f062dcd314d43a63ca74067cb5ee3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
W20260709 13:21:34.729099  6695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 88322.8us
I20260709 13:21:34.718417 14115 raft_consensus.cc:2749] T be1a92657f494cac8dd227d152f50151 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 24 FOLLOWER]: Leader election lost for term 24. Reason: could not achieve majority
I20260709 13:21:34.734597  6730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "404190ce4ce94cecbfcb6ea9d1dd8626" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
W20260709 13:21:34.737349  6846 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:21:34.737910  6695 leader_election.cc:304] T 713b5728a197487c9300b310ab94e5a3 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:21:34.738899 14101 raft_consensus.cc:2749] T 713b5728a197487c9300b310ab94e5a3 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:21:34.740981  6846 leader_election.cc:304] T 3fa34c08b205435dba97346991aa1f92 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:21:34.741291  6695 leader_election.cc:304] T 7a734b5ab7834e05a8c422208acc58b1 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, b7ab4784c7344b939bc36f639286f377
I20260709 13:21:34.742424  6695 leader_election.cc:304] T 427c124d773f483294511e80fe340075 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, b7ab4784c7344b939bc36f639286f377
I20260709 13:21:34.743275  6695 leader_election.cc:304] T 17587d6730594da4a56fa13a353232a1 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, b7ab4784c7344b939bc36f639286f377
I20260709 13:21:34.743355 13896 raft_consensus.cc:2749] T 427c124d773f483294511e80fe340075 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:21:34.742594 14101 raft_consensus.cc:2749] T 7a734b5ab7834e05a8c422208acc58b1 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:21:34.744342 14101 raft_consensus.cc:2749] T 17587d6730594da4a56fa13a353232a1 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 13:21:34.745272  6697 leader_election.cc:304] T f58dc08b12a2494bb9a1372837970ca2 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377
I20260709 13:21:34.746121 13896 raft_consensus.cc:2804] T f58dc08b12a2494bb9a1372837970ca2 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:21:34.746549 13896 raft_consensus.cc:493] T f58dc08b12a2494bb9a1372837970ca2 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 20 FOLLOWER]: Starting leader election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:21:34.746899 13896 raft_consensus.cc:3060] T f58dc08b12a2494bb9a1372837970ca2 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:21:34.747138  6726 raft_consensus.cc:1240] T 4b8cacb381b746da8d0049b0a83b41dd P ccd8a4c3bfe3413cb2ae219b09aea832 [term 21 FOLLOWER]: Rejecting Update request from peer cd75a17ab2604397adab03bb8b5fd75c for earlier term 20. Current term is 21. Ops: []
I20260709 13:21:34.748284  6697 leader_election.cc:304] T 9e326172347f45e99a0d482b5d8ef768 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:21:34.748466  6801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f03d0dbf16864ca4bc1bb5e4c0334c0f" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:21:34.751344  6806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "404190ce4ce94cecbfcb6ea9d1dd8626" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:21:34.751940 14101 raft_consensus.cc:2749] T 9e326172347f45e99a0d482b5d8ef768 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:21:34.752617  6806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8cee0accdb8499c86d4414b72565a38" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:21:34.754073  6806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d65025eea89441290d85dd053810e31" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
W20260709 13:21:34.745481 14126 log.cc:927] Time spent T 44bde925b2e541b69890d70715b85176 P cd75a17ab2604397adab03bb8b5fd75c: Append to log took a long time: real 0.487s	user 0.000s	sys 0.002s
I20260709 13:21:34.721907 14135 raft_consensus.cc:2749] T 1528ab62b6fe4e3099d08f141afee116 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:21:34.684664 14003 raft_consensus.cc:515] T 07a92dd554674067a83a9cb68c4773f2 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:34.787601  6723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bf4668eeb70467fb3dc5a0289233b3c" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 22 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:21:34.790406  6723 raft_consensus.cc:2393] T 1bf4668eeb70467fb3dc5a0289233b3c P ccd8a4c3bfe3413cb2ae219b09aea832 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate b7ab4784c7344b939bc36f639286f377 in current term 22: Already voted for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in this term.
I20260709 13:21:34.705866 14134 raft_consensus.cc:515] T 2c240553ce044eedb41541d72b9475d7 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:34.727942 14130 raft_consensus.cc:2749] T ce4f062dcd314d43a63ca74067cb5ee3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:21:34.802544  6732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22ccee1b570c4ad3a57bd7aec085b1b4" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:21:34.803442  6805 raft_consensus.cc:1240] T f5be3a11b23d4ea9b08300a2789821c7 P b7ab4784c7344b939bc36f639286f377 [term 21 LEADER]: Rejecting Update request from peer ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 20. Current term is 21. Ops: [20.12-20.12]
I20260709 13:21:34.731745 14137 raft_consensus.cc:2804] T 3fa34c08b205435dba97346991aa1f92 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 13:21:34.804876  6731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09c2a98de1a4decabd0ff900dd44caa" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:21:34.805732  6731 raft_consensus.cc:3060] T f09c2a98de1a4decabd0ff900dd44caa P ccd8a4c3bfe3413cb2ae219b09aea832 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:21:34.786984 14010 raft_consensus.cc:2749] T 3fa34c08b205435dba97346991aa1f92 P cd75a17ab2604397adab03bb8b5fd75c [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:21:34.795886 14142 raft_consensus.cc:2749] T bd6869f07b5a4885a0b99fbe60c3b175 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:21:34.798122 14146 raft_consensus.cc:493] T 4275cf08e63345f993bce8664eada830 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:21:34.722213 14141 raft_consensus.cc:515] T 853ac0a8cbd64ce99457f170216d4d0f P ccd8a4c3bfe3413cb2ae219b09aea832 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
W20260709 13:21:34.836874  6697 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 88656us
I20260709 13:21:34.808090 14137 raft_consensus.cc:493] T 3fa34c08b205435dba97346991aa1f92 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 25 FOLLOWER]: Starting leader election (detected failure of leader 7ba59cc884714e8aa5f3f0ecaed84cbb)
I20260709 13:21:34.839392  6731 raft_consensus.cc:2468] T f09c2a98de1a4decabd0ff900dd44caa P ccd8a4c3bfe3413cb2ae219b09aea832 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 24.
I20260709 13:21:34.825258 14149 raft_consensus.cc:493] T 3a485a995abc4807b6e511e45419f737 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:21:34.854617 14141 leader_election.cc:290] T 853ac0a8cbd64ce99457f170216d4d0f P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
W20260709 13:21:34.856513 14136 log.cc:927] Time spent T 44bde925b2e541b69890d70715b85176 P ccd8a4c3bfe3413cb2ae219b09aea832: Append to log took a long time: real 0.134s	user 0.000s	sys 0.001s
I20260709 13:21:34.858837 14134 leader_election.cc:290] T 2c240553ce044eedb41541d72b9475d7 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:21:34.876186 14088 raft_consensus.cc:515] T f58dc08b12a2494bb9a1372837970ca2 P cd75a17ab2604397adab03bb8b5fd75c [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:34.878703 14088 leader_election.cc:290] T f58dc08b12a2494bb9a1372837970ca2 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 21 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:21:34.878816 13987 raft_consensus.cc:515] T ab432e62819d499eaaf3dd55481dd930 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
W20260709 13:21:34.880751 14139 log.cc:927] Time spent T 44bde925b2e541b69890d70715b85176 P b7ab4784c7344b939bc36f639286f377: Append to log took a long time: real 0.102s	user 0.000s	sys 0.001s
I20260709 13:21:34.881049 13987 leader_election.cc:290] T ab432e62819d499eaaf3dd55481dd930 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 24 election: Requested vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:21:34.884882 14058 raft_consensus.cc:3055] T be1a92657f494cac8dd227d152f50151 P b7ab4784c7344b939bc36f639286f377 [term 23 LEADER]: Stepping down as leader of term 23
I20260709 13:21:34.885413 14058 raft_consensus.cc:740] T be1a92657f494cac8dd227d152f50151 P b7ab4784c7344b939bc36f639286f377 [term 23 LEADER]: Becoming Follower/Learner. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
I20260709 13:21:34.886445 14058 consensus_queue.cc:260] T be1a92657f494cac8dd227d152f50151 P b7ab4784c7344b939bc36f639286f377 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 23.17, Last appended by leader: 17, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:21:34.887578 14058 raft_consensus.cc:3060] T be1a92657f494cac8dd227d152f50151 P b7ab4784c7344b939bc36f639286f377 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:21:34.840591 14137 raft_consensus.cc:3060] T 3fa34c08b205435dba97346991aa1f92 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:21:34.888211 14059 raft_consensus.cc:515] T 7ba5dac66ab5497e9e336f2a3c28cda5 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 23 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:21:34.892478 14059 leader_election.cc:290] T 7ba5dac66ab5497e9e336f2a3c28cda5 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 23 election: Requested vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:21:34.892921 14003 leader_election.cc:290] T 07a92dd554674067a83a9cb68c4773f2 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:21:34.906258 14103 raft_consensus.cc:515] T 95a75bfe094d4bdc963aba3f08dfcd25 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 17 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } attrs { replace: true } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
W20260709 13:21:34.910157 14140 log.cc:927] Time spent T bd6869f07b5a4885a0b99fbe60c3b175 P b7ab4784c7344b939bc36f639286f377: Append to log took a long time: real 0.128s	user 0.000s	sys 0.002s
I20260709 13:21:34.843118 14156 raft_consensus.cc:493] T 20f6842e26174571996b8dea4151d4be P ccd8a4c3bfe3413cb2ae219b09aea832 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
W20260709 13:21:34.864008 14017 consensus_meta.cc:287] T 4d9def8b32fd443aa94ab1420b06837b P b7ab4784c7344b939bc36f639286f377: Time spent flushing consensus metadata: real 0.552s	user 0.004s	sys 0.004s
I20260709 13:21:34.926986  6802 raft_consensus.cc:606] T 34f36d59d88f40fe8a2805e604fc6c0a P b7ab4784c7344b939bc36f639286f377 [term 20 LEADER]: Received request to transfer leadership to TS cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:21:34.919643 13896 raft_consensus.cc:515] T f58dc08b12a2494bb9a1372837970ca2 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:34.851263 14149 raft_consensus.cc:515] T 3a485a995abc4807b6e511e45419f737 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:34.836719 14146 raft_consensus.cc:515] T 4275cf08e63345f993bce8664eada830 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:34.851128 14148 consensus_queue.cc:1059] T f5be3a11b23d4ea9b08300a2789821c7 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: INVALID_TERM, Last received: 18.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.073s
W20260709 13:21:34.945488  6770 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 366420us
I20260709 13:21:34.946506  6770 leader_election.cc:304] T 9b3759de40694069b13c0f8bd40e5709 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:21:34.939671  7466 leader_election.cc:304] T 4b8cacb381b746da8d0049b0a83b41dd P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:21:34.956944 13997 raft_consensus.cc:2804] T bd6869f07b5a4885a0b99fbe60c3b175 P b7ab4784c7344b939bc36f639286f377 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:21:34.957458 13997 raft_consensus.cc:493] T bd6869f07b5a4885a0b99fbe60c3b175 P b7ab4784c7344b939bc36f639286f377 [term 23 FOLLOWER]: Starting leader election (detected failure of leader cd75a17ab2604397adab03bb8b5fd75c)
I20260709 13:21:34.957401  6799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ba5dac66ab5497e9e336f2a3c28cda5" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:21:34.957975 13997 raft_consensus.cc:3060] T bd6869f07b5a4885a0b99fbe60c3b175 P b7ab4784c7344b939bc36f639286f377 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:21:34.958678 13588 raft_consensus.cc:515] T e31b9971c15848dea59d4d4130141d9e P cd75a17ab2604397adab03bb8b5fd75c [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:34.941120 13896 leader_election.cc:290] T f58dc08b12a2494bb9a1372837970ca2 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 21 election: Requested vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:21:34.960461 14161 raft_consensus.cc:3060] T 4b8cacb381b746da8d0049b0a83b41dd P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 20 FOLLOWER]: Advancing to term 21
W20260709 13:21:34.961793  6772 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.68:45071, user_credentials={real_user=slave}} blocked reactor thread for 302992us
I20260709 13:21:34.931663 14156 raft_consensus.cc:515] T 20f6842e26174571996b8dea4151d4be P ccd8a4c3bfe3413cb2ae219b09aea832 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:34.964618 13588 leader_election.cc:290] T e31b9971c15848dea59d4d4130141d9e P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 18 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:21:34.964506  6770 leader_election.cc:304] T 95a75bfe094d4bdc963aba3f08dfcd25 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:21:34.966261 14156 leader_election.cc:290] T 20f6842e26174571996b8dea4151d4be P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:21:34.966907 14149 leader_election.cc:290] T 3a485a995abc4807b6e511e45419f737 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:21:34.931529 14017 raft_consensus.cc:515] T 4d9def8b32fd443aa94ab1420b06837b P b7ab4784c7344b939bc36f639286f377 [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:34.985500  7502 raft_consensus.cc:1240] T be1a92657f494cac8dd227d152f50151 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 24 FOLLOWER]: Rejecting Update request from peer b7ab4784c7344b939bc36f639286f377 for earlier term 23. Current term is 24. Ops: []
I20260709 13:21:34.987424 14017 leader_election.cc:290] T 4d9def8b32fd443aa94ab1420b06837b P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 24 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:21:34.988242  6801 raft_consensus.cc:1240] T 4d9def8b32fd443aa94ab1420b06837b P b7ab4784c7344b939bc36f639286f377 [term 24 FOLLOWER]: Rejecting Update request from peer ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 23. Current term is 24. Ops: []
W20260709 13:21:34.989842  6773 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:21:34.970813  6881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de3186201e1a40d0b335eeb8b4e256e0" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:21:34.971917 14103 leader_election.cc:290] T 95a75bfe094d4bdc963aba3f08dfcd25 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 17 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:21:34.972370 13996 raft_consensus.cc:2804] T 9b3759de40694069b13c0f8bd40e5709 P b7ab4784c7344b939bc36f639286f377 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:21:34.995766 13996 raft_consensus.cc:493] T 9b3759de40694069b13c0f8bd40e5709 P b7ab4784c7344b939bc36f639286f377 [term 18 FOLLOWER]: Starting leader election (detected failure of leader cd75a17ab2604397adab03bb8b5fd75c)
I20260709 13:21:34.996474 13996 raft_consensus.cc:3060] T 9b3759de40694069b13c0f8bd40e5709 P b7ab4784c7344b939bc36f639286f377 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:21:34.997684 14055 raft_consensus.cc:2804] T 95a75bfe094d4bdc963aba3f08dfcd25 P b7ab4784c7344b939bc36f639286f377 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:21:34.998183  6770 leader_election.cc:304] T 44bde925b2e541b69890d70715b85176 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:21:34.973759 13684 consensus_queue.cc:1059] T 404190ce4ce94cecbfcb6ea9d1dd8626 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false }, Status: INVALID_TERM, Last received: 17.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:21:34.995771 14137 raft_consensus.cc:515] T 3fa34c08b205435dba97346991aa1f92 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 26 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:21:35.000296 13684 raft_consensus.cc:3055] T 404190ce4ce94cecbfcb6ea9d1dd8626 P b7ab4784c7344b939bc36f639286f377 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:21:35.000742 13684 raft_consensus.cc:740] T 404190ce4ce94cecbfcb6ea9d1dd8626 P b7ab4784c7344b939bc36f639286f377 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
I20260709 13:21:35.001704 13684 consensus_queue.cc:260] T 404190ce4ce94cecbfcb6ea9d1dd8626 P b7ab4784c7344b939bc36f639286f377 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.14, Last appended by leader: 14, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:21:35.002624 14137 leader_election.cc:290] T 3fa34c08b205435dba97346991aa1f92 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 26 election: Requested vote from peers cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:21:35.003350 13684 raft_consensus.cc:3060] T 404190ce4ce94cecbfcb6ea9d1dd8626 P b7ab4784c7344b939bc36f639286f377 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:21:34.974602 13992 consensus_queue.cc:1059] T d8cee0accdb8499c86d4414b72565a38 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false }, Status: INVALID_TERM, Last received: 19.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:21:35.004897 13992 raft_consensus.cc:2749] T 44bde925b2e541b69890d70715b85176 P b7ab4784c7344b939bc36f639286f377 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:21:35.005028  6770 leader_election.cc:304] T 711ef6523deb4cbe8ef2ba61e1c21c98 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:21:35.005865 14017 raft_consensus.cc:3055] T d8cee0accdb8499c86d4414b72565a38 P b7ab4784c7344b939bc36f639286f377 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:21:35.006350 14017 raft_consensus.cc:740] T d8cee0accdb8499c86d4414b72565a38 P b7ab4784c7344b939bc36f639286f377 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
I20260709 13:21:35.007211 14017 consensus_queue.cc:260] T d8cee0accdb8499c86d4414b72565a38 P b7ab4784c7344b939bc36f639286f377 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.14, Last appended by leader: 14, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:21:35.008648 14017 raft_consensus.cc:3060] T d8cee0accdb8499c86d4414b72565a38 P b7ab4784c7344b939bc36f639286f377 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:21:34.976702  6879 raft_consensus.cc:1240] T f58dc08b12a2494bb9a1372837970ca2 P cd75a17ab2604397adab03bb8b5fd75c [term 21 FOLLOWER]: Rejecting Update request from peer b7ab4784c7344b939bc36f639286f377 for earlier term 20. Current term is 21. Ops: []
I20260709 13:21:34.978058  7466 leader_election.cc:304] T 404190ce4ce94cecbfcb6ea9d1dd8626 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:21:34.966981  6844 leader_election.cc:304] T 30e88460611e47b2ba16a46a30b5f416 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:21:35.020161  6881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d9def8b32fd443aa94ab1420b06837b" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 24 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:21:35.022717  6798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "853ac0a8cbd64ce99457f170216d4d0f" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
W20260709 13:21:35.023108  7466 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 45191.1us
I20260709 13:21:35.024112  6807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab432e62819d499eaaf3dd55481dd930" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:21:35.025717  6800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c240553ce044eedb41541d72b9475d7" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:21:35.027697  6798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f58dc08b12a2494bb9a1372837970ca2" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:21:35.028957  6731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a75bfe094d4bdc963aba3f08dfcd25" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:21:35.030252  6881 raft_consensus.cc:1240] T e31b9971c15848dea59d4d4130141d9e P cd75a17ab2604397adab03bb8b5fd75c [term 18 FOLLOWER]: Rejecting Update request from peer b7ab4784c7344b939bc36f639286f377 for earlier term 17. Current term is 18. Ops: []
W20260709 13:21:35.030699  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 63821.5us
I20260709 13:21:35.031446  6799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a485a995abc4807b6e511e45419f737" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:21:35.031556  6844 leader_election.cc:304] T bb7fa124c3bf4ef9ab65a407cb008441 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, b7ab4784c7344b939bc36f639286f377
I20260709 13:21:35.031469  6798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20f6842e26174571996b8dea4151d4be" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
W20260709 13:21:34.985890 14123 log.cc:927] Time spent T 3411566abe2d4c9bb4b2adfdd05e6f17 P b7ab4784c7344b939bc36f639286f377: Append to log took a long time: real 0.726s	user 0.001s	sys 0.002s
I20260709 13:21:35.034958  6800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a75bfe094d4bdc963aba3f08dfcd25" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:21:35.035522 13690 raft_consensus.cc:2749] T 30e88460611e47b2ba16a46a30b5f416 P cd75a17ab2604397adab03bb8b5fd75c [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:21:35.035585  6844 leader_election.cc:304] T f03d0dbf16864ca4bc1bb5e4c0334c0f P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:21:35.036453 13690 raft_consensus.cc:2749] T bb7fa124c3bf4ef9ab65a407cb008441 P cd75a17ab2604397adab03bb8b5fd75c [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:21:35.037941  6804 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:32976 (request call id 4085) took 1219 ms. Trace:
I20260709 13:21:35.038403  6804 rpcz_store.cc:276] 0709 13:21:33.818330 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:21:33.818529 (+   199us) service_pool.cc:224] Handling call
0709 13:21:33.818875 (+   346us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:21:33.852225 (+ 33350us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:21:33.852255 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:21:33.852722 (+   467us) log.cc:844] Serialized 26 byte log entry
0709 13:21:34.106119 (+253397us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:21:34.106367 (+   248us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:21:34.106457 (+    90us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:21:34.985106 (+878649us) spinlock_profiling.cc:243] Waited 31.4 ms on lock 0x7b4400022b4c. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0c745db1 00007fcc0c7e3c85 00007fcc0c7e46a2 00007fcc0f5561db 00007fcc0f551aaf 00007fcc0f54586e 00007fcc0f544bb6 00007fcc0f5447d8 00007fcc0f54e221 00007fcc0f54e1d9 00007fcc0f54e169
0709 13:21:35.037587 (+ 52481us) raft_consensus.cc:1685] finished
0709 13:21:35.037613 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:21:35.037848 (+   235us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":12326,"raft.queue_time_us":12469,"raft.run_cpu_time_us":129,"raft.run_wall_time_us":41304,"spinlock_wait_cycles":72244608,"thread_start_us":251560,"threads_started":1,"wal-append.queue_time_us":371955}
I20260709 13:21:35.039651 13697 consensus_queue.cc:1059] T 4d9def8b32fd443aa94ab1420b06837b P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: INVALID_TERM, Last received: 23.12, Next index: 13, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:21:35.025642 14115 raft_consensus.cc:2749] T 404190ce4ce94cecbfcb6ea9d1dd8626 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:21:35.040792 14149 raft_consensus.cc:3055] T 4d9def8b32fd443aa94ab1420b06837b P ccd8a4c3bfe3413cb2ae219b09aea832 [term 23 LEADER]: Stepping down as leader of term 23
I20260709 13:21:35.041271 14149 raft_consensus.cc:740] T 4d9def8b32fd443aa94ab1420b06837b P ccd8a4c3bfe3413cb2ae219b09aea832 [term 23 LEADER]: Becoming Follower/Learner. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
I20260709 13:21:35.041519 14120 raft_consensus.cc:2749] T f03d0dbf16864ca4bc1bb5e4c0334c0f P cd75a17ab2604397adab03bb8b5fd75c [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:21:35.042539 14149 consensus_queue.cc:260] T 4d9def8b32fd443aa94ab1420b06837b P ccd8a4c3bfe3413cb2ae219b09aea832 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 23.12, Last appended by leader: 12, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:34.998205 14055 raft_consensus.cc:493] T 95a75bfe094d4bdc963aba3f08dfcd25 P b7ab4784c7344b939bc36f639286f377 [term 16 FOLLOWER]: Starting leader election (detected failure of leader cd75a17ab2604397adab03bb8b5fd75c)
I20260709 13:21:35.043718 14055 raft_consensus.cc:3060] T 95a75bfe094d4bdc963aba3f08dfcd25 P b7ab4784c7344b939bc36f639286f377 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:21:35.041196  6697 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 196636us
I20260709 13:21:35.015714 13996 raft_consensus.cc:515] T 9b3759de40694069b13c0f8bd40e5709 P b7ab4784c7344b939bc36f639286f377 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:35.043959 14149 raft_consensus.cc:3060] T 4d9def8b32fd443aa94ab1420b06837b P ccd8a4c3bfe3413cb2ae219b09aea832 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:21:35.049057  6802 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "bd6869f07b5a4885a0b99fbe60c3b175"
dest_uuid: "b7ab4784c7344b939bc36f639286f377"
mode: GRACEFUL
new_leader_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
 from {username='slave'} at 127.0.0.1:38240
I20260709 13:21:35.066120  6805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4275cf08e63345f993bce8664eada830" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:21:35.051590  6801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a92dd554674067a83a9cb68c4773f2" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:21:35.050464 13996 leader_election.cc:290] T 9b3759de40694069b13c0f8bd40e5709 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 19 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:21:35.046365  6697 leader_election.cc:304] T 44bde925b2e541b69890d70715b85176 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:21:35.070225 14161 raft_consensus.cc:2749] T 4b8cacb381b746da8d0049b0a83b41dd P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:21:35.074532 14159 raft_consensus.cc:3055] T f5be3a11b23d4ea9b08300a2789821c7 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:21:35.075063 14159 raft_consensus.cc:740] T f5be3a11b23d4ea9b08300a2789821c7 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
I20260709 13:21:35.076001 14159 consensus_queue.cc:260] T f5be3a11b23d4ea9b08300a2789821c7 P ccd8a4c3bfe3413cb2ae219b09aea832 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 20.12, Last appended by leader: 12, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:35.077602 14159 raft_consensus.cc:3060] T f5be3a11b23d4ea9b08300a2789821c7 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:21:35.067515  6844 leader_election.cc:304] T e77e330a82df4b43a745d57a68f6f057 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:21:35.043484 14146 leader_election.cc:290] T 4275cf08e63345f993bce8664eada830 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
W20260709 13:21:35.083568  6770 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 78672.5us
I20260709 13:21:35.083781 13992 raft_consensus.cc:2749] T 711ef6523deb4cbe8ef2ba61e1c21c98 P b7ab4784c7344b939bc36f639286f377 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:21:35.083559  7502 raft_consensus.cc:1240] T 4b8cacb381b746da8d0049b0a83b41dd P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 21 FOLLOWER]: Rejecting Update request from peer cd75a17ab2604397adab03bb8b5fd75c for earlier term 20. Current term is 21. Ops: []
I20260709 13:21:35.084774  6770 leader_election.cc:304] T 90d42e216d9741e190bca19a781291fd P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:21:35.086668 14038 raft_consensus.cc:2804] T 90d42e216d9741e190bca19a781291fd P b7ab4784c7344b939bc36f639286f377 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:21:35.086853 13996 consensus_queue.cc:1059] T f58dc08b12a2494bb9a1372837970ca2 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: INVALID_TERM, Last received: 20.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:21:35.087464 14038 raft_consensus.cc:697] T 90d42e216d9741e190bca19a781291fd P b7ab4784c7344b939bc36f639286f377 [term 20 LEADER]: Becoming Leader. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
I20260709 13:21:35.088379  7496 raft_consensus.cc:1240] T 95a75bfe094d4bdc963aba3f08dfcd25 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 17 FOLLOWER]: Rejecting Update request from peer cd75a17ab2604397adab03bb8b5fd75c for earlier term 16. Current term is 17. Ops: []
I20260709 13:21:35.090068  6844 leader_election.cc:304] T 3d65025eea89441290d85dd053810e31 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:21:35.088529  7495 raft_consensus.cc:1240] T 7ba5dac66ab5497e9e336f2a3c28cda5 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 23 FOLLOWER]: Rejecting Update request from peer cd75a17ab2604397adab03bb8b5fd75c for earlier term 22. Current term is 23. Ops: []
I20260709 13:21:35.091213 14064 consensus_queue.cc:1059] T 4b8cacb381b746da8d0049b0a83b41dd P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false }, Status: INVALID_TERM, Last received: 20.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 13:21:35.091878 13991 raft_consensus.cc:3055] T f58dc08b12a2494bb9a1372837970ca2 P b7ab4784c7344b939bc36f639286f377 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:21:35.092339 13991 raft_consensus.cc:740] T f58dc08b12a2494bb9a1372837970ca2 P b7ab4784c7344b939bc36f639286f377 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
I20260709 13:21:35.092504 14064 raft_consensus.cc:3055] T 4b8cacb381b746da8d0049b0a83b41dd P cd75a17ab2604397adab03bb8b5fd75c [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:21:35.092922 14064 raft_consensus.cc:740] T 4b8cacb381b746da8d0049b0a83b41dd P cd75a17ab2604397adab03bb8b5fd75c [term 20 LEADER]: Becoming Follower/Learner. State: Replica: cd75a17ab2604397adab03bb8b5fd75c, State: Running, Role: LEADER
I20260709 13:21:35.092675 14038 consensus_queue.cc:237] T 90d42e216d9741e190bca19a781291fd P b7ab4784c7344b939bc36f639286f377 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.10, Last appended by leader: 10, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:35.094237 14162 raft_consensus.cc:2749] T 44bde925b2e541b69890d70715b85176 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:21:35.089018  6770 leader_election.cc:304] T a3022224cc81473690653a83d4e99470 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:21:35.096086 14102 raft_consensus.cc:2749] T a3022224cc81473690653a83d4e99470 P b7ab4784c7344b939bc36f639286f377 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:21:35.096230  6770 leader_election.cc:304] T 7c37d41cd9164c15a6826ca62a851a69 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:21:35.097126 13684 raft_consensus.cc:2749] T 7c37d41cd9164c15a6826ca62a851a69 P b7ab4784c7344b939bc36f639286f377 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:21:35.089776  6697 leader_election.cc:304] T e31b9971c15848dea59d4d4130141d9e P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:21:35.098049 13896 raft_consensus.cc:2749] T e31b9971c15848dea59d4d4130141d9e P ccd8a4c3bfe3413cb2ae219b09aea832 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:21:35.098567  6697 leader_election.cc:304] T f3f9c2e2bf644115957398fe4c9459db P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377
I20260709 13:21:35.093823 14064 consensus_queue.cc:260] T 4b8cacb381b746da8d0049b0a83b41dd P cd75a17ab2604397adab03bb8b5fd75c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 20.15, Last appended by leader: 15, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:21:35.099262 14102 consensus_queue.cc:1059] T e31b9971c15848dea59d4d4130141d9e P b7ab4784c7344b939bc36f639286f377 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: INVALID_TERM, Last received: 17.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:21:35.099577 14156 raft_consensus.cc:2804] T f3f9c2e2bf644115957398fe4c9459db P ccd8a4c3bfe3413cb2ae219b09aea832 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:21:35.100111 14156 raft_consensus.cc:493] T f3f9c2e2bf644115957398fe4c9459db P ccd8a4c3bfe3413cb2ae219b09aea832 [term 21 FOLLOWER]: Starting leader election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:21:35.100426 14102 raft_consensus.cc:3055] T e31b9971c15848dea59d4d4130141d9e P b7ab4784c7344b939bc36f639286f377 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:21:35.101047 14102 raft_consensus.cc:740] T e31b9971c15848dea59d4d4130141d9e P b7ab4784c7344b939bc36f639286f377 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
I20260709 13:21:35.101480  6697 leader_election.cc:304] T 1bf4668eeb70467fb3dc5a0289233b3c P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:21:35.086653 14066 raft_consensus.cc:2749] T e77e330a82df4b43a745d57a68f6f057 P cd75a17ab2604397adab03bb8b5fd75c [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:21:35.047751 13997 raft_consensus.cc:515] T bd6869f07b5a4885a0b99fbe60c3b175 P b7ab4784c7344b939bc36f639286f377 [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:35.102324 14137 raft_consensus.cc:2749] T 1bf4668eeb70467fb3dc5a0289233b3c P ccd8a4c3bfe3413cb2ae219b09aea832 [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 13:21:35.100569 14156 raft_consensus.cc:3060] T f3f9c2e2bf644115957398fe4c9459db P ccd8a4c3bfe3413cb2ae219b09aea832 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:21:35.104012  6802 raft_consensus.cc:606] T bd6869f07b5a4885a0b99fbe60c3b175 P b7ab4784c7344b939bc36f639286f377 [term 24 FOLLOWER]: Received request to transfer leadership to TS cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:21:35.097452  6770 leader_election.cc:304] T 9e326172347f45e99a0d482b5d8ef768 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:21:35.114013  6802 raft_consensus.cc:614] T bd6869f07b5a4885a0b99fbe60c3b175 P b7ab4784c7344b939bc36f639286f377 [term 24 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:21:35.102195 14102 consensus_queue.cc:260] T e31b9971c15848dea59d4d4130141d9e P b7ab4784c7344b939bc36f639286f377 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:35.119180 13991 consensus_queue.cc:260] T f58dc08b12a2494bb9a1372837970ca2 P b7ab4784c7344b939bc36f639286f377 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 20.11, Last appended by leader: 11, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:35.121678 13991 raft_consensus.cc:3060] T f58dc08b12a2494bb9a1372837970ca2 P b7ab4784c7344b939bc36f639286f377 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:21:35.100124 14064 raft_consensus.cc:3060] T 4b8cacb381b746da8d0049b0a83b41dd P cd75a17ab2604397adab03bb8b5fd75c [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:21:35.110011  6877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6869f07b5a4885a0b99fbe60c3b175" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 24 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:21:35.103453  6697 leader_election.cc:304] T 24ee15416e3145beaa1b8183453729a3 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:21:35.131101 14137 raft_consensus.cc:2749] T 24ee15416e3145beaa1b8183453729a3 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:21:35.130574 14055 raft_consensus.cc:515] T 95a75bfe094d4bdc963aba3f08dfcd25 P b7ab4784c7344b939bc36f639286f377 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } attrs { replace: true } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:21:35.133252  6800 raft_consensus.cc:2393] T 95a75bfe094d4bdc963aba3f08dfcd25 P b7ab4784c7344b939bc36f639286f377 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in current term 17: Already voted for candidate b7ab4784c7344b939bc36f639286f377 in this term.
I20260709 13:21:35.133543  7496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b8cacb381b746da8d0049b0a83b41dd" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb"
I20260709 13:21:35.106438 13690 consensus_queue.cc:1059] T 95a75bfe094d4bdc963aba3f08dfcd25 P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false }, Status: INVALID_TERM, Last received: 16.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.010s
I20260709 13:21:35.116837 14067 raft_consensus.cc:2749] T 3d65025eea89441290d85dd053810e31 P cd75a17ab2604397adab03bb8b5fd75c [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:21:35.119832 14102 raft_consensus.cc:3060] T e31b9971c15848dea59d4d4130141d9e P b7ab4784c7344b939bc36f639286f377 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:21:35.107909  6879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b3759de40694069b13c0f8bd40e5709" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:21:35.134788  6881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b8cacb381b746da8d0049b0a83b41dd" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:21:35.114730  6844 leader_election.cc:304] T dbdf895bba214ff68685a24fd17dfb5d P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:21:35.155812  6872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f03d0dbf16864ca4bc1bb5e4c0334c0f" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:21:35.136256  6875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d65025eea89441290d85dd053810e31" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:21:35.157598  6844 leader_election.cc:304] T d8292e16e5654be6bc408560cf256aaa P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:21:35.157703  6770 leader_election.cc:304] T 1bf4668eeb70467fb3dc5a0289233b3c P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:21:35.138535  7495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fa34c08b205435dba97346991aa1f92" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 26 candidate_status { last_received { term: 25 index: 18 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb"
I20260709 13:21:35.143196  6878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "853ac0a8cbd64ce99457f170216d4d0f" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:21:35.144336  6876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c240553ce044eedb41541d72b9475d7" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:21:35.145817  6873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab432e62819d499eaaf3dd55481dd930" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:21:35.147213  6874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a92dd554674067a83a9cb68c4773f2" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:21:35.160784  6770 leader_election.cc:304] T 22ccee1b570c4ad3a57bd7aec085b1b4 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:21:35.162631  6876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20f6842e26174571996b8dea4151d4be" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:21:35.164420  6878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fa34c08b205435dba97346991aa1f92" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 26 candidate_status { last_received { term: 25 index: 18 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:21:35.164750  6844 leader_election.cc:304] T 4d9def8b32fd443aa94ab1420b06837b P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:21:35.165060  6770 leader_election.cc:304] T f09c2a98de1a4decabd0ff900dd44caa P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:21:35.165472  6879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a485a995abc4807b6e511e45419f737" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:21:35.166249  6844 leader_election.cc:304] T 7c37d41cd9164c15a6826ca62a851a69 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:21:35.169332  6873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f58dc08b12a2494bb9a1372837970ca2" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:21:35.173676  6731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de3186201e1a40d0b335eeb8b4e256e0" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:21:35.163741 14087 raft_consensus.cc:2749] T dbdf895bba214ff68685a24fd17dfb5d P cd75a17ab2604397adab03bb8b5fd75c [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:21:35.168362 13856 raft_consensus.cc:2749] T 4d9def8b32fd443aa94ab1420b06837b P cd75a17ab2604397adab03bb8b5fd75c [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:21:35.163475 14160 raft_consensus.cc:493] T 7887766dc6784fcaa42b35c05fea7a99 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:21:35.168721 13601 raft_consensus.cc:2749] T 1bf4668eeb70467fb3dc5a0289233b3c P b7ab4784c7344b939bc36f639286f377 [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 13:21:35.168522 13999 raft_consensus.cc:2749] T 22ccee1b570c4ad3a57bd7aec085b1b4 P b7ab4784c7344b939bc36f639286f377 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:21:35.177776 14160 raft_consensus.cc:515] T 7887766dc6784fcaa42b35c05fea7a99 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:35.172720 14008 raft_consensus.cc:2804] T f09c2a98de1a4decabd0ff900dd44caa P b7ab4784c7344b939bc36f639286f377 [term 24 FOLLOWER]: Leader election won for term 24
I20260709 13:21:35.180269 14008 raft_consensus.cc:697] T f09c2a98de1a4decabd0ff900dd44caa P b7ab4784c7344b939bc36f639286f377 [term 24 LEADER]: Becoming Leader. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
I20260709 13:21:35.181134 14008 consensus_queue.cc:237] T f09c2a98de1a4decabd0ff900dd44caa P b7ab4784c7344b939bc36f639286f377 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 22.13, Last appended by leader: 13, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:35.181509  6872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4275cf08e63345f993bce8664eada830" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:21:35.183096 14160 leader_election.cc:290] T 7887766dc6784fcaa42b35c05fea7a99 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:21:35.168855 14011 raft_consensus.cc:2749] T d8292e16e5654be6bc408560cf256aaa P cd75a17ab2604397adab03bb8b5fd75c [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:21:35.107175 13997 leader_election.cc:290] T bd6869f07b5a4885a0b99fbe60c3b175 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 24 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:21:35.151083 13684 raft_consensus.cc:2749] T 9e326172347f45e99a0d482b5d8ef768 P b7ab4784c7344b939bc36f639286f377 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:21:35.106576 14066 consensus_queue.cc:1059] T 7ba5dac66ab5497e9e336f2a3c28cda5 P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false }, Status: INVALID_TERM, Last received: 22.16, Next index: 17, Last known committed idx: 16, Time since last communication: 0.062s
I20260709 13:21:35.190327  7466 leader_election.cc:304] T 95a75bfe094d4bdc963aba3f08dfcd25 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:21:35.191810 14115 raft_consensus.cc:2749] T 95a75bfe094d4bdc963aba3f08dfcd25 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:21:35.191833 14120 raft_consensus.cc:3055] T 95a75bfe094d4bdc963aba3f08dfcd25 P cd75a17ab2604397adab03bb8b5fd75c [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:21:35.192941 14120 raft_consensus.cc:740] T 95a75bfe094d4bdc963aba3f08dfcd25 P cd75a17ab2604397adab03bb8b5fd75c [term 16 LEADER]: Becoming Follower/Learner. State: Replica: cd75a17ab2604397adab03bb8b5fd75c, State: Running, Role: LEADER
I20260709 13:21:35.136273 14156 raft_consensus.cc:515] T f3f9c2e2bf644115957398fe4c9459db P ccd8a4c3bfe3413cb2ae219b09aea832 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:35.193784 14120 consensus_queue.cc:260] T 95a75bfe094d4bdc963aba3f08dfcd25 P cd75a17ab2604397adab03bb8b5fd75c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } attrs { replace: true } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:21:35.196130 14055 leader_election.cc:290] T 95a75bfe094d4bdc963aba3f08dfcd25 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 17 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:21:35.189306  6731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d9def8b32fd443aa94ab1420b06837b" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 24 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:21:35.199887  7495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a75bfe094d4bdc963aba3f08dfcd25" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb"
I20260709 13:21:35.207594  6723 raft_consensus.cc:1240] T ab432e62819d499eaaf3dd55481dd930 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 24 FOLLOWER]: Rejecting Update request from peer b7ab4784c7344b939bc36f639286f377 for earlier term 23. Current term is 24. Ops: []
I20260709 13:21:35.203979  6726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b3759de40694069b13c0f8bd40e5709" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:21:35.204842  6729 raft_consensus.cc:1240] T f58dc08b12a2494bb9a1372837970ca2 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 21 FOLLOWER]: Rejecting Update request from peer b7ab4784c7344b939bc36f639286f377 for earlier term 20. Current term is 21. Ops: []
I20260709 13:21:35.201829  6844 leader_election.cc:304] T 07a92dd554674067a83a9cb68c4773f2 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:21:35.206532  6730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6869f07b5a4885a0b99fbe60c3b175" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 24 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:21:35.210736  6802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7887766dc6784fcaa42b35c05fea7a99" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 24 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:21:35.207398 14147 raft_consensus.cc:2749] T 7c37d41cd9164c15a6826ca62a851a69 P cd75a17ab2604397adab03bb8b5fd75c [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:21:35.218515 14120 raft_consensus.cc:3060] T 95a75bfe094d4bdc963aba3f08dfcd25 P cd75a17ab2604397adab03bb8b5fd75c [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:21:35.199626 14149 raft_consensus.cc:493] T 22ccee1b570c4ad3a57bd7aec085b1b4 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader cd75a17ab2604397adab03bb8b5fd75c)
W20260709 13:21:35.222626  6845 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:21:35.222442 14149 raft_consensus.cc:515] T 22ccee1b570c4ad3a57bd7aec085b1b4 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:35.224189  7495 raft_consensus.cc:2393] T 95a75bfe094d4bdc963aba3f08dfcd25 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate b7ab4784c7344b939bc36f639286f377 in current term 17: Already voted for candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in this term.
I20260709 13:21:35.228149  6802 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c4db81d9d329422bb3b4160ca4ac2d1d"
dest_uuid: "b7ab4784c7344b939bc36f639286f377"
mode: GRACEFUL
new_leader_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
 from {username='slave'} at 127.0.0.1:38240
I20260709 13:21:35.228785  6802 raft_consensus.cc:606] T c4db81d9d329422bb3b4160ca4ac2d1d P b7ab4784c7344b939bc36f639286f377 [term 20 LEADER]: Received request to transfer leadership to TS cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:21:35.232704  6802 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f58dc08b12a2494bb9a1372837970ca2"
dest_uuid: "b7ab4784c7344b939bc36f639286f377"
mode: GRACEFUL
new_leader_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
 from {username='slave'} at 127.0.0.1:38240
I20260709 13:21:35.233923  6876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a75bfe094d4bdc963aba3f08dfcd25" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:21:35.235678  6881 raft_consensus.cc:2468] T 4b8cacb381b746da8d0049b0a83b41dd P cd75a17ab2604397adab03bb8b5fd75c [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 21.
I20260709 13:21:35.242949  6732 raft_consensus.cc:1240] T 3fa34c08b205435dba97346991aa1f92 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 26 FOLLOWER]: Rejecting Update request from peer 7ba59cc884714e8aa5f3f0ecaed84cbb for earlier term 25. Current term is 26. Ops: []
I20260709 13:21:35.249164 14161 consensus_queue.cc:1059] T 3fa34c08b205435dba97346991aa1f92 P 7ba59cc884714e8aa5f3f0ecaed84cbb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: INVALID_TERM, Last received: 25.18, Next index: 19, Last known committed idx: 18, Time since last communication: 0.001s
I20260709 13:21:35.252292  6731 raft_consensus.cc:2468] T 4d9def8b32fd443aa94ab1420b06837b P ccd8a4c3bfe3413cb2ae219b09aea832 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 24.
I20260709 13:21:35.255400 14156 leader_election.cc:290] T f3f9c2e2bf644115957398fe4c9459db P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 22 election: Requested vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:21:35.255620 14079 raft_consensus.cc:3055] T 3fa34c08b205435dba97346991aa1f92 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 25 LEADER]: Stepping down as leader of term 25
I20260709 13:21:35.256165 14079 raft_consensus.cc:740] T 3fa34c08b205435dba97346991aa1f92 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 25 LEADER]: Becoming Follower/Learner. State: Replica: 7ba59cc884714e8aa5f3f0ecaed84cbb, State: Running, Role: LEADER
I20260709 13:21:35.257515 14079 consensus_queue.cc:260] T 3fa34c08b205435dba97346991aa1f92 P 7ba59cc884714e8aa5f3f0ecaed84cbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 25.18, Last appended by leader: 18, Current term: 25, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:21:35.258541 14079 raft_consensus.cc:3060] T 3fa34c08b205435dba97346991aa1f92 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:21:35.262226 14066 raft_consensus.cc:493] T 1bf4668eeb70467fb3dc5a0289233b3c P cd75a17ab2604397adab03bb8b5fd75c [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:35.262493  6876 raft_consensus.cc:2468] T 95a75bfe094d4bdc963aba3f08dfcd25 P cd75a17ab2604397adab03bb8b5fd75c [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 17.
I20260709 13:21:35.262840 14066 raft_consensus.cc:515] T 1bf4668eeb70467fb3dc5a0289233b3c P cd75a17ab2604397adab03bb8b5fd75c [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:35.262118 13588 raft_consensus.cc:3055] T 7ba5dac66ab5497e9e336f2a3c28cda5 P cd75a17ab2604397adab03bb8b5fd75c [term 22 LEADER]: Stepping down as leader of term 22
I20260709 13:21:35.265266 13588 raft_consensus.cc:740] T 7ba5dac66ab5497e9e336f2a3c28cda5 P cd75a17ab2604397adab03bb8b5fd75c [term 22 LEADER]: Becoming Follower/Learner. State: Replica: cd75a17ab2604397adab03bb8b5fd75c, State: Running, Role: LEADER
I20260709 13:21:35.265686 14066 leader_election.cc:290] T 1bf4668eeb70467fb3dc5a0289233b3c P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:21:35.266278 13588 consensus_queue.cc:260] T 7ba5dac66ab5497e9e336f2a3c28cda5 P cd75a17ab2604397adab03bb8b5fd75c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 22.16, Last appended by leader: 16, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:21:35.267988  6876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7887766dc6784fcaa42b35c05fea7a99" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 24 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:21:35.267859 13588 raft_consensus.cc:3060] T 7ba5dac66ab5497e9e336f2a3c28cda5 P cd75a17ab2604397adab03bb8b5fd75c [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:21:35.271077  6805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f9c2e2bf644115957398fe4c9459db" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:21:35.271409  6802 raft_consensus.cc:606] T f58dc08b12a2494bb9a1372837970ca2 P b7ab4784c7344b939bc36f639286f377 [term 21 FOLLOWER]: Received request to transfer leadership to TS cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:21:35.271891  6802 raft_consensus.cc:614] T f58dc08b12a2494bb9a1372837970ca2 P b7ab4784c7344b939bc36f639286f377 [term 21 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:21:35.274523  5625 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
W20260709 13:21:35.278584  6846 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:21:35.282296 14066 raft_consensus.cc:2749] T 07a92dd554674067a83a9cb68c4773f2 P cd75a17ab2604397adab03bb8b5fd75c [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:21:35.283183 14017 raft_consensus.cc:493] T 7c44c4849aa54f2b94d1f1bef9ed546f P b7ab4784c7344b939bc36f639286f377 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:21:35.283826 14017 raft_consensus.cc:515] T 7c44c4849aa54f2b94d1f1bef9ed546f P b7ab4784c7344b939bc36f639286f377 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:35.285949 14017 leader_election.cc:290] T 7c44c4849aa54f2b94d1f1bef9ed546f P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:21:35.288072  6876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c44c4849aa54f2b94d1f1bef9ed546f" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
W20260709 13:21:35.290174  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 88421.3us
I20260709 13:21:35.291000  6844 leader_election.cc:304] T d8cee0accdb8499c86d4414b72565a38 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, b7ab4784c7344b939bc36f639286f377
I20260709 13:21:35.296118  6697 leader_election.cc:304] T 2c240553ce044eedb41541d72b9475d7 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:21:35.296531  5625 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:21:35.296725 14066 raft_consensus.cc:2749] T d8cee0accdb8499c86d4414b72565a38 P cd75a17ab2604397adab03bb8b5fd75c [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:21:35.297287 14160 raft_consensus.cc:2749] T 2c240553ce044eedb41541d72b9475d7 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:21:35.297387  6697 leader_election.cc:304] T 853ac0a8cbd64ce99457f170216d4d0f P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:21:35.298147 14159 raft_consensus.cc:2749] T 853ac0a8cbd64ce99457f170216d4d0f P ccd8a4c3bfe3413cb2ae219b09aea832 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:21:35.298182  6844 leader_election.cc:304] T 711ef6523deb4cbe8ef2ba61e1c21c98 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:21:35.298555  6697 leader_election.cc:304] T f03d0dbf16864ca4bc1bb5e4c0334c0f P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:21:35.301700 14149 leader_election.cc:290] T 22ccee1b570c4ad3a57bd7aec085b1b4 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:21:35.302384 14149 raft_consensus.cc:2749] T f03d0dbf16864ca4bc1bb5e4c0334c0f P ccd8a4c3bfe3413cb2ae219b09aea832 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:21:35.304827 13998 raft_consensus.cc:2749] T 711ef6523deb4cbe8ef2ba61e1c21c98 P cd75a17ab2604397adab03bb8b5fd75c [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:21:35.304919  6802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22ccee1b570c4ad3a57bd7aec085b1b4" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:21:35.305946  6802 raft_consensus.cc:2393] T 22ccee1b570c4ad3a57bd7aec085b1b4 P b7ab4784c7344b939bc36f639286f377 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ccd8a4c3bfe3413cb2ae219b09aea832 in current term 16: Already voted for candidate b7ab4784c7344b939bc36f639286f377 in this term.
I20260709 13:21:35.308065  6844 leader_election.cc:304] T de3186201e1a40d0b335eeb8b4e256e0 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:21:35.315692  6626 catalog_manager.cc:5697] T f3f9c2e2bf644115957398fe4c9459db P ccd8a4c3bfe3413cb2ae219b09aea832 reported cstate change: term changed from 13 to 15. New cstate: current_term: 15 leader_uuid: "cd75a17ab2604397adab03bb8b5fd75c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } }
I20260709 13:21:35.316643 14064 raft_consensus.cc:2749] T de3186201e1a40d0b335eeb8b4e256e0 P cd75a17ab2604397adab03bb8b5fd75c [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:21:35.299757  6697 leader_election.cc:304] T ab432e62819d499eaaf3dd55481dd930 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 24 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:21:35.317358  6626 catalog_manager.cc:5697] T 20f6842e26174571996b8dea4151d4be P ccd8a4c3bfe3413cb2ae219b09aea832 reported cstate change: term changed from 15 to 17, leader changed from b7ab4784c7344b939bc36f639286f377 (127.5.126.66) to ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65). New cstate: current_term: 17 leader_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } health_report { overall_health: HEALTHY } } }
I20260709 13:21:35.319512 14160 raft_consensus.cc:2749] T ab432e62819d499eaaf3dd55481dd930 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 24 FOLLOWER]: Leader election lost for term 24. Reason: could not achieve majority
I20260709 13:21:35.320767  6697 leader_election.cc:304] T 20f6842e26174571996b8dea4151d4be P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:21:35.321764  6626 catalog_manager.cc:5697] T a3022224cc81473690653a83d4e99470 P ccd8a4c3bfe3413cb2ae219b09aea832 reported cstate change: term changed from 14 to 17, leader changed from cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67) to ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65). New cstate: current_term: 17 leader_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:35.324126  6697 leader_election.cc:304] T 3d65025eea89441290d85dd053810e31 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:21:35.332628  6844 leader_election.cc:304] T a3022224cc81473690653a83d4e99470 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:21:35.331633  6770 leader_election.cc:304] T de3186201e1a40d0b335eeb8b4e256e0 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:21:35.332228 14160 raft_consensus.cc:2749] T 20f6842e26174571996b8dea4151d4be P ccd8a4c3bfe3413cb2ae219b09aea832 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:21:35.334739  6732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a75bfe094d4bdc963aba3f08dfcd25" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:21:35.337551  6844 leader_election.cc:304] T 8c7f33e544204fbaac4078e3e83bbf4e P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:21:35.339620  6844 leader_election.cc:304] T f3f9c2e2bf644115957398fe4c9459db P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:21:35.341926  6725 raft_consensus.cc:1275] T f5be3a11b23d4ea9b08300a2789821c7 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 21 FOLLOWER]: Refusing update from remote peer b7ab4784c7344b939bc36f639286f377: Log matching property violated. Preceding OpId in replica: term: 20 index: 12. Preceding OpId from leader: term: 21 index: 12. (term mismatch)
I20260709 13:21:35.342365  6725 pending_rounds.cc:85] T f5be3a11b23d4ea9b08300a2789821c7 P ccd8a4c3bfe3413cb2ae219b09aea832: Aborting all ops after (but not including) 11
I20260709 13:21:35.342583  6725 pending_rounds.cc:107] T f5be3a11b23d4ea9b08300a2789821c7 P ccd8a4c3bfe3413cb2ae219b09aea832: Aborting uncommitted NO_OP operation due to leader change: 20.12
I20260709 13:21:35.342885  6725 raft_consensus.cc:2889] T f5be3a11b23d4ea9b08300a2789821c7 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 21 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:21:35.343513  6626 catalog_manager.cc:5697] T 8c7f33e544204fbaac4078e3e83bbf4e P ccd8a4c3bfe3413cb2ae219b09aea832 reported cstate change: term changed from 10 to 13, leader changed from b7ab4784c7344b939bc36f639286f377 (127.5.126.66) to ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65). New cstate: current_term: 13 leader_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } health_report { overall_health: HEALTHY } } }
I20260709 13:21:35.344450  6697 leader_election.cc:304] T f58dc08b12a2494bb9a1372837970ca2 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:21:35.336308 13886 consensus_queue.cc:1059] T f09c2a98de1a4decabd0ff900dd44caa P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: INVALID_TERM, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.007s
I20260709 13:21:35.346244  6697 leader_election.cc:304] T 4275cf08e63345f993bce8664eada830 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:21:35.344450  6844 leader_election.cc:304] T 20f6842e26174571996b8dea4151d4be P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:21:35.348268 14156 raft_consensus.cc:2749] T f58dc08b12a2494bb9a1372837970ca2 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:21:35.336460 14159 raft_consensus.cc:2749] T 3d65025eea89441290d85dd053810e31 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:21:35.349504  6697 leader_election.cc:304] T 07a92dd554674067a83a9cb68c4773f2 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:21:35.340637 14102 raft_consensus.cc:2749] T de3186201e1a40d0b335eeb8b4e256e0 P b7ab4784c7344b939bc36f639286f377 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:21:35.350943  6770 leader_election.cc:304] T 9b3759de40694069b13c0f8bd40e5709 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:21:35.355718 14163 raft_consensus.cc:2749] T 07a92dd554674067a83a9cb68c4773f2 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:21:35.357831 13998 raft_consensus.cc:3055] T f09c2a98de1a4decabd0ff900dd44caa P cd75a17ab2604397adab03bb8b5fd75c [term 23 LEADER]: Stepping down as leader of term 23
I20260709 13:21:35.358260 13998 raft_consensus.cc:740] T f09c2a98de1a4decabd0ff900dd44caa P cd75a17ab2604397adab03bb8b5fd75c [term 23 LEADER]: Becoming Follower/Learner. State: Replica: cd75a17ab2604397adab03bb8b5fd75c, State: Running, Role: LEADER
I20260709 13:21:35.359107  6770 leader_election.cc:304] T bd6869f07b5a4885a0b99fbe60c3b175 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 24 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:21:35.354957  6697 leader_election.cc:304] T 3a485a995abc4807b6e511e45419f737 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:21:35.359705 13886 raft_consensus.cc:2749] T 20f6842e26174571996b8dea4151d4be P cd75a17ab2604397adab03bb8b5fd75c [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:21:35.360378 14149 raft_consensus.cc:2749] T 3a485a995abc4807b6e511e45419f737 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:21:35.359182 13998 consensus_queue.cc:260] T f09c2a98de1a4decabd0ff900dd44caa P cd75a17ab2604397adab03bb8b5fd75c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 23.14, Last appended by leader: 14, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:35.343218 14064 raft_consensus.cc:2749] T 8c7f33e544204fbaac4078e3e83bbf4e P cd75a17ab2604397adab03bb8b5fd75c [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:21:35.355782 13914 raft_consensus.cc:2749] T 9b3759de40694069b13c0f8bd40e5709 P b7ab4784c7344b939bc36f639286f377 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:21:35.366277  6876 raft_consensus.cc:1275] T f5be3a11b23d4ea9b08300a2789821c7 P cd75a17ab2604397adab03bb8b5fd75c [term 21 FOLLOWER]: Refusing update from remote peer b7ab4784c7344b939bc36f639286f377: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 21 index: 12. (index mismatch)
I20260709 13:21:35.362284  6697 leader_election.cc:304] T 3fa34c08b205435dba97346991aa1f92 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 26 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:21:35.343786 13588 raft_consensus.cc:2749] T a3022224cc81473690653a83d4e99470 P cd75a17ab2604397adab03bb8b5fd75c [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:21:35.348832 14148 raft_consensus.cc:2749] T 4275cf08e63345f993bce8664eada830 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:21:35.348908 14120 raft_consensus.cc:2749] T f3f9c2e2bf644115957398fe4c9459db P cd75a17ab2604397adab03bb8b5fd75c [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:21:35.372534  6731 raft_consensus.cc:1240] T f09c2a98de1a4decabd0ff900dd44caa P ccd8a4c3bfe3413cb2ae219b09aea832 [term 24 FOLLOWER]: Rejecting Update request from peer cd75a17ab2604397adab03bb8b5fd75c for earlier term 23. Current term is 24. Ops: [23.14-23.14]
I20260709 13:21:35.368253 14098 raft_consensus.cc:2749] T bd6869f07b5a4885a0b99fbe60c3b175 P b7ab4784c7344b939bc36f639286f377 [term 24 FOLLOWER]: Leader election lost for term 24. Reason: could not achieve majority
I20260709 13:21:35.369910 13886 consensus_queue.cc:1059] T 22ccee1b570c4ad3a57bd7aec085b1b4 P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: INVALID_TERM, Last received: 15.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.006s
I20260709 13:21:35.376056  6626 catalog_manager.cc:5697] T 95a75bfe094d4bdc963aba3f08dfcd25 P ccd8a4c3bfe3413cb2ae219b09aea832 reported cstate change: term changed from 16 to 13, leader changed from <none> to ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65). New cstate: current_term: 13 leader_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: NON_VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:35.377800 14036 consensus_queue.cc:1048] T f5be3a11b23d4ea9b08300a2789821c7 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:21:35.378479  6626 catalog_manager.cc:5697] T f09c2a98de1a4decabd0ff900dd44caa P ccd8a4c3bfe3413cb2ae219b09aea832 reported cstate change: term changed from 16 to 18, leader changed from b7ab4784c7344b939bc36f639286f377 (127.5.126.66) to ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65). New cstate: current_term: 18 leader_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:35.383101 13886 raft_consensus.cc:3055] T 22ccee1b570c4ad3a57bd7aec085b1b4 P cd75a17ab2604397adab03bb8b5fd75c [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:21:35.383566 13886 raft_consensus.cc:740] T 22ccee1b570c4ad3a57bd7aec085b1b4 P cd75a17ab2604397adab03bb8b5fd75c [term 15 LEADER]: Becoming Follower/Learner. State: Replica: cd75a17ab2604397adab03bb8b5fd75c, State: Running, Role: LEADER
I20260709 13:21:35.384406 13886 consensus_queue.cc:260] T 22ccee1b570c4ad3a57bd7aec085b1b4 P cd75a17ab2604397adab03bb8b5fd75c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:35.385601 13886 raft_consensus.cc:3060] T 22ccee1b570c4ad3a57bd7aec085b1b4 P cd75a17ab2604397adab03bb8b5fd75c [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:21:35.371469 14156 raft_consensus.cc:2749] T 3fa34c08b205435dba97346991aa1f92 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 26 FOLLOWER]: Leader election lost for term 26. Reason: could not achieve majority
I20260709 13:21:35.364262 13997 consensus_queue.cc:1059] T ab432e62819d499eaaf3dd55481dd930 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: INVALID_TERM, Last received: 23.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.033s
I20260709 13:21:35.388391 13997 raft_consensus.cc:3055] T ab432e62819d499eaaf3dd55481dd930 P b7ab4784c7344b939bc36f639286f377 [term 23 LEADER]: Stepping down as leader of term 23
I20260709 13:21:35.388782 13997 raft_consensus.cc:740] T ab432e62819d499eaaf3dd55481dd930 P b7ab4784c7344b939bc36f639286f377 [term 23 LEADER]: Becoming Follower/Learner. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
I20260709 13:21:35.389289  6697 leader_election.cc:304] T 7887766dc6784fcaa42b35c05fea7a99 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:21:35.389595 13997 consensus_queue.cc:260] T ab432e62819d499eaaf3dd55481dd930 P b7ab4784c7344b939bc36f639286f377 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 23.13, Last appended by leader: 13, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:35.390437 14159 raft_consensus.cc:2749] T 7887766dc6784fcaa42b35c05fea7a99 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:21:35.390887  6697 leader_election.cc:304] T 4b8cacb381b746da8d0049b0a83b41dd P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb
I20260709 13:21:35.391108 13997 raft_consensus.cc:3060] T ab432e62819d499eaaf3dd55481dd930 P b7ab4784c7344b939bc36f639286f377 [term 23 FOLLOWER]: Advancing to term 24
W20260709 13:21:35.393957  7468 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:21:35.366637 13998 raft_consensus.cc:3060] T f09c2a98de1a4decabd0ff900dd44caa P cd75a17ab2604397adab03bb8b5fd75c [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:21:35.405012  6770 leader_election.cc:304] T 4d9def8b32fd443aa94ab1420b06837b P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:21:35.408738 14038 raft_consensus.cc:2804] T 4d9def8b32fd443aa94ab1420b06837b P b7ab4784c7344b939bc36f639286f377 [term 24 FOLLOWER]: Leader election won for term 24
I20260709 13:21:35.409340 14038 raft_consensus.cc:697] T 4d9def8b32fd443aa94ab1420b06837b P b7ab4784c7344b939bc36f639286f377 [term 24 LEADER]: Becoming Leader. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
I20260709 13:21:35.410305 14038 consensus_queue.cc:237] T 4d9def8b32fd443aa94ab1420b06837b P b7ab4784c7344b939bc36f639286f377 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 23.12, Last appended by leader: 12, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:35.416671  6877 raft_consensus.cc:1275] T 34f36d59d88f40fe8a2805e604fc6c0a P cd75a17ab2604397adab03bb8b5fd75c [term 20 FOLLOWER]: Refusing update from remote peer b7ab4784c7344b939bc36f639286f377: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 20 index: 11. (index mismatch)
I20260709 13:21:35.418565  7468 leader_election.cc:304] T d8cee0accdb8499c86d4414b72565a38 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:21:35.424566 13991 consensus_queue.cc:1048] T 34f36d59d88f40fe8a2805e604fc6c0a P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:21:35.420819  6726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f58dc08b12a2494bb9a1372837970ca2" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:21:35.426133  6726 raft_consensus.cc:2393] T f58dc08b12a2494bb9a1372837970ca2 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c in current term 21: Already voted for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in this term.
I20260709 13:21:35.425335 14079 raft_consensus.cc:2749] T d8cee0accdb8499c86d4414b72565a38 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:21:35.441710  6723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e31b9971c15848dea59d4d4130141d9e" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
W20260709 13:21:35.442433  6697 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 51627.7us
I20260709 13:21:35.418995  6770 leader_election.cc:304] T 95a75bfe094d4bdc963aba3f08dfcd25 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, ccd8a4c3bfe3413cb2ae219b09aea832
W20260709 13:21:35.449867  6695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 50266.7us
I20260709 13:21:35.452920  6729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c44c4849aa54f2b94d1f1bef9ed546f" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:21:35.452935  6732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bf4668eeb70467fb3dc5a0289233b3c" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:21:35.447342 14160 raft_consensus.cc:2804] T 4b8cacb381b746da8d0049b0a83b41dd P ccd8a4c3bfe3413cb2ae219b09aea832 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:21:35.456182  6876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ba5dac66ab5497e9e336f2a3c28cda5" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
W20260709 13:21:35.457226  6846 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:21:35.477653  6879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22ccee1b570c4ad3a57bd7aec085b1b4" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:21:35.479399  6802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7887766dc6784fcaa42b35c05fea7a99" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 24 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:21:35.454581  6732 raft_consensus.cc:2468] T 1bf4668eeb70467fb3dc5a0289233b3c P ccd8a4c3bfe3413cb2ae219b09aea832 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 22.
I20260709 13:21:35.481707  6807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bf4668eeb70467fb3dc5a0289233b3c" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:21:35.481950  6770 leader_election.cc:304] T 7c44c4849aa54f2b94d1f1bef9ed546f P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:21:35.482445  6807 raft_consensus.cc:2468] T 1bf4668eeb70467fb3dc5a0289233b3c P b7ab4784c7344b939bc36f639286f377 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 22.
I20260709 13:21:35.487411  6729 raft_consensus.cc:1240] T f3f9c2e2bf644115957398fe4c9459db P ccd8a4c3bfe3413cb2ae219b09aea832 [term 22 FOLLOWER]: Rejecting Update request from peer b7ab4784c7344b939bc36f639286f377 for earlier term 21. Current term is 22. Ops: []
I20260709 13:21:35.478475  6879 raft_consensus.cc:2468] T 22ccee1b570c4ad3a57bd7aec085b1b4 P cd75a17ab2604397adab03bb8b5fd75c [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 16.
I20260709 13:21:35.468724 13588 raft_consensus.cc:493] T d33d5ee8ef6f415593d8df52063161ad P cd75a17ab2604397adab03bb8b5fd75c [term 20 FOLLOWER]: Starting pre-election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:21:35.498178 13588 raft_consensus.cc:515] T d33d5ee8ef6f415593d8df52063161ad P cd75a17ab2604397adab03bb8b5fd75c [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:35.515638 14098 raft_consensus.cc:993] T 34f36d59d88f40fe8a2805e604fc6c0a P b7ab4784c7344b939bc36f639286f377: : Instructing follower cd75a17ab2604397adab03bb8b5fd75c to start an election
I20260709 13:21:35.516379 14098 raft_consensus.cc:1081] T 34f36d59d88f40fe8a2805e604fc6c0a P b7ab4784c7344b939bc36f639286f377 [term 20 LEADER]: Signalling peer cd75a17ab2604397adab03bb8b5fd75c to start an election
I20260709 13:21:35.516409 13963 raft_consensus.cc:2749] T 7c44c4849aa54f2b94d1f1bef9ed546f P b7ab4784c7344b939bc36f639286f377 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:21:35.518671  6801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e31b9971c15848dea59d4d4130141d9e" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:21:35.520891  6872 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "34f36d59d88f40fe8a2805e604fc6c0a"
dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
 from {username='slave'} at 127.0.0.1:53406
I20260709 13:21:35.453738 14036 consensus_queue.cc:1048] T f5be3a11b23d4ea9b08300a2789821c7 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.068s
I20260709 13:21:35.521576  6872 raft_consensus.cc:493] T 34f36d59d88f40fe8a2805e604fc6c0a P cd75a17ab2604397adab03bb8b5fd75c [term 20 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:21:35.522009  6872 raft_consensus.cc:3060] T 34f36d59d88f40fe8a2805e604fc6c0a P cd75a17ab2604397adab03bb8b5fd75c [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:21:35.526494  6878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a75bfe094d4bdc963aba3f08dfcd25" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:21:35.527307  6878 raft_consensus.cc:2393] T 95a75bfe094d4bdc963aba3f08dfcd25 P cd75a17ab2604397adab03bb8b5fd75c [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in current term 17: Already voted for candidate b7ab4784c7344b939bc36f639286f377 in this term.
I20260709 13:21:35.527861  6877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f9c2e2bf644115957398fe4c9459db" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:21:35.532928  6800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f58dc08b12a2494bb9a1372837970ca2" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:21:35.449738 13991 raft_consensus.cc:2749] T 95a75bfe094d4bdc963aba3f08dfcd25 P b7ab4784c7344b939bc36f639286f377 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
W20260709 13:21:35.538942  6697 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.68:45071, user_credentials={real_user=slave}} blocked reactor thread for 66726.2us
I20260709 13:21:35.523924 14160 raft_consensus.cc:697] T 4b8cacb381b746da8d0049b0a83b41dd P ccd8a4c3bfe3413cb2ae219b09aea832 [term 21 LEADER]: Becoming Leader. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
I20260709 13:21:35.542492  6876 raft_consensus.cc:2468] T 7ba5dac66ab5497e9e336f2a3c28cda5 P cd75a17ab2604397adab03bb8b5fd75c [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in term 23.
I20260709 13:21:35.540617  6697 leader_election.cc:304] T 22ccee1b570c4ad3a57bd7aec085b1b4 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377
I20260709 13:21:35.550936  6798 raft_consensus.cc:1240] T 95a75bfe094d4bdc963aba3f08dfcd25 P b7ab4784c7344b939bc36f639286f377 [term 17 FOLLOWER]: Rejecting Update request from peer cd75a17ab2604397adab03bb8b5fd75c for earlier term 16. Current term is 17. Ops: []
I20260709 13:21:35.536233 13998 raft_consensus.cc:493] T 427c124d773f483294511e80fe340075 P cd75a17ab2604397adab03bb8b5fd75c [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 7ba59cc884714e8aa5f3f0ecaed84cbb)
I20260709 13:21:35.545744  6872 raft_consensus.cc:515] T 34f36d59d88f40fe8a2805e604fc6c0a P cd75a17ab2604397adab03bb8b5fd75c [term 21 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:35.553185  6801 raft_consensus.cc:2468] T e31b9971c15848dea59d4d4130141d9e P b7ab4784c7344b939bc36f639286f377 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 18.
I20260709 13:21:35.573969 14160 consensus_queue.cc:237] T 4b8cacb381b746da8d0049b0a83b41dd P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 20.15, Last appended by leader: 15, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:21:35.575198  6800 raft_consensus.cc:2468] T f58dc08b12a2494bb9a1372837970ca2 P b7ab4784c7344b939bc36f639286f377 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 21.
I20260709 13:21:35.576601  6844 leader_election.cc:304] T 1bf4668eeb70467fb3dc5a0289233b3c P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:21:35.578733 14087 raft_consensus.cc:2804] T 1bf4668eeb70467fb3dc5a0289233b3c P cd75a17ab2604397adab03bb8b5fd75c [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:21:35.579139 14087 raft_consensus.cc:493] T 1bf4668eeb70467fb3dc5a0289233b3c P cd75a17ab2604397adab03bb8b5fd75c [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:35.579594 14087 raft_consensus.cc:3060] T 1bf4668eeb70467fb3dc5a0289233b3c P cd75a17ab2604397adab03bb8b5fd75c [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:21:35.583959 14137 raft_consensus.cc:2804] T 22ccee1b570c4ad3a57bd7aec085b1b4 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 15 FOLLOWER]: Leader pre-election won for term 16
W20260709 13:21:35.584120  6697 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 43562.3us
I20260709 13:21:35.584556 14137 raft_consensus.cc:493] T 22ccee1b570c4ad3a57bd7aec085b1b4 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 15 FOLLOWER]: Starting leader election (detected failure of leader cd75a17ab2604397adab03bb8b5fd75c)
I20260709 13:21:35.585043 14137 raft_consensus.cc:3060] T 22ccee1b570c4ad3a57bd7aec085b1b4 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:21:35.585813  6697 leader_election.cc:304] T f3f9c2e2bf644115957398fe4c9459db P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:21:35.550714 14149 raft_consensus.cc:493] T be1a92657f494cac8dd227d152f50151 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:21:35.588205 14146 raft_consensus.cc:2749] T f3f9c2e2bf644115957398fe4c9459db P ccd8a4c3bfe3413cb2ae219b09aea832 [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 13:21:35.588616 14149 raft_consensus.cc:515] T be1a92657f494cac8dd227d152f50151 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:21:35.590950 14149 leader_election.cc:290] T be1a92657f494cac8dd227d152f50151 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:21:35.592950 13998 raft_consensus.cc:515] T 427c124d773f483294511e80fe340075 P cd75a17ab2604397adab03bb8b5fd75c [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } attrs { replace: true } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:21:35.595715 13998 leader_election.cc:290] T 427c124d773f483294511e80fe340075 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:21:35.596882  7495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "427c124d773f483294511e80fe340075" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:21:35.599965  6872 leader_election.cc:290] T 34f36d59d88f40fe8a2805e604fc6c0a P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 21 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:21:35.577315 14017 consensus_queue.cc:1059] T f3f9c2e2bf644115957398fe4c9459db P b7ab4784c7344b939bc36f639286f377 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: INVALID_TERM, Last received: 21.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:21:35.602200  6805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be1a92657f494cac8dd227d152f50151" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:21:35.604293  6805 raft_consensus.cc:2468] T be1a92657f494cac8dd227d152f50151 P b7ab4784c7344b939bc36f639286f377 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 24.
I20260709 13:21:35.604641 14017 raft_consensus.cc:3055] T f3f9c2e2bf644115957398fe4c9459db P b7ab4784c7344b939bc36f639286f377 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:21:35.613497 14017 raft_consensus.cc:740] T f3f9c2e2bf644115957398fe4c9459db P b7ab4784c7344b939bc36f639286f377 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
I20260709 13:21:35.614398 14017 consensus_queue.cc:260] T f3f9c2e2bf644115957398fe4c9459db P b7ab4784c7344b939bc36f639286f377 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 21.14, Last appended by leader: 14, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:35.615473 14038 raft_consensus.cc:993] T c4db81d9d329422bb3b4160ca4ac2d1d P b7ab4784c7344b939bc36f639286f377: : Instructing follower cd75a17ab2604397adab03bb8b5fd75c to start an election
I20260709 13:21:35.615742 14017 raft_consensus.cc:3060] T f3f9c2e2bf644115957398fe4c9459db P b7ab4784c7344b939bc36f639286f377 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:21:35.622195  6880 raft_consensus.cc:1240] T 34f36d59d88f40fe8a2805e604fc6c0a P cd75a17ab2604397adab03bb8b5fd75c [term 21 FOLLOWER]: Rejecting Update request from peer b7ab4784c7344b939bc36f639286f377 for earlier term 20. Current term is 21. Ops: []
I20260709 13:21:35.620867  7495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be1a92657f494cac8dd227d152f50151" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:21:35.628088  7495 raft_consensus.cc:2393] T be1a92657f494cac8dd227d152f50151 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ccd8a4c3bfe3413cb2ae219b09aea832 in current term 24: Already voted for candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in this term.
I20260709 13:21:35.617923  6695 leader_election.cc:304] T be1a92657f494cac8dd227d152f50151 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
I20260709 13:21:35.632875 14148 raft_consensus.cc:2804] T be1a92657f494cac8dd227d152f50151 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:21:35.602461 13987 raft_consensus.cc:493] T b56bf91d90824c959e21e0cee5ba1816 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
W20260709 13:21:35.634230  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 57759.9us
I20260709 13:21:35.649857  6805 raft_consensus.cc:1240] T bd6869f07b5a4885a0b99fbe60c3b175 P b7ab4784c7344b939bc36f639286f377 [term 24 FOLLOWER]: Rejecting Update request from peer cd75a17ab2604397adab03bb8b5fd75c for earlier term 23. Current term is 24. Ops: []
I20260709 13:21:35.657521  6799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34f36d59d88f40fe8a2805e604fc6c0a" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: true dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:21:35.658836  6807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d33d5ee8ef6f415593d8df52063161ad" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:21:35.656418  6802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "427c124d773f483294511e80fe340075" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:21:35.615984 14038 raft_consensus.cc:1081] T c4db81d9d329422bb3b4160ca4ac2d1d P b7ab4784c7344b939bc36f639286f377 [term 20 LEADER]: Signalling peer cd75a17ab2604397adab03bb8b5fd75c to start an election
I20260709 13:21:35.616444 13588 leader_election.cc:290] T d33d5ee8ef6f415593d8df52063161ad P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:21:35.641466 14148 raft_consensus.cc:493] T be1a92657f494cac8dd227d152f50151 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 23 FOLLOWER]: Starting leader election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:21:35.649616 14055 raft_consensus.cc:493] T 7ba5dac66ab5497e9e336f2a3c28cda5 P b7ab4784c7344b939bc36f639286f377 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader cd75a17ab2604397adab03bb8b5fd75c)
I20260709 13:21:35.697024  6844 leader_election.cc:304] T 7887766dc6784fcaa42b35c05fea7a99 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:21:35.715317  6844 leader_election.cc:304] T e31b9971c15848dea59d4d4130141d9e P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:21:35.720055 14120 raft_consensus.cc:2749] T 7887766dc6784fcaa42b35c05fea7a99 P cd75a17ab2604397adab03bb8b5fd75c [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:21:35.721555  6844 leader_election.cc:304] T f58dc08b12a2494bb9a1372837970ca2 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:21:35.722270 14120 raft_consensus.cc:2804] T e31b9971c15848dea59d4d4130141d9e P cd75a17ab2604397adab03bb8b5fd75c [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:21:35.722781 14120 raft_consensus.cc:697] T e31b9971c15848dea59d4d4130141d9e P cd75a17ab2604397adab03bb8b5fd75c [term 18 LEADER]: Becoming Leader. State: Replica: cd75a17ab2604397adab03bb8b5fd75c, State: Running, Role: LEADER
I20260709 13:21:35.723608 14120 consensus_queue.cc:237] T e31b9971c15848dea59d4d4130141d9e P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:35.726364  6844 leader_election.cc:304] T 427c124d773f483294511e80fe340075 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, b7ab4784c7344b939bc36f639286f377
W20260709 13:21:35.728645  6621 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:53224 (request call id 160) took 42747 ms (client timeout 15000 ms). Trace:
I20260709 13:21:35.730263 13998 raft_consensus.cc:2804] T f58dc08b12a2494bb9a1372837970ca2 P cd75a17ab2604397adab03bb8b5fd75c [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:21:35.730914 13998 raft_consensus.cc:697] T f58dc08b12a2494bb9a1372837970ca2 P cd75a17ab2604397adab03bb8b5fd75c [term 21 LEADER]: Becoming Leader. State: Replica: cd75a17ab2604397adab03bb8b5fd75c, State: Running, Role: LEADER
I20260709 13:21:35.731767 13998 consensus_queue.cc:237] T f58dc08b12a2494bb9a1372837970ca2 P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 20.11, Last appended by leader: 11, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:35.732385 13690 consensus_queue.cc:1059] T bd6869f07b5a4885a0b99fbe60c3b175 P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: INVALID_TERM, Last received: 23.12, Next index: 13, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:21:35.733214 13690 raft_consensus.cc:2749] T 427c124d773f483294511e80fe340075 P cd75a17ab2604397adab03bb8b5fd75c [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:21:35.733965 13690 raft_consensus.cc:3055] T bd6869f07b5a4885a0b99fbe60c3b175 P cd75a17ab2604397adab03bb8b5fd75c [term 23 LEADER]: Stepping down as leader of term 23
I20260709 13:21:35.734257 13690 raft_consensus.cc:740] T bd6869f07b5a4885a0b99fbe60c3b175 P cd75a17ab2604397adab03bb8b5fd75c [term 23 LEADER]: Becoming Follower/Learner. State: Replica: cd75a17ab2604397adab03bb8b5fd75c, State: Running, Role: LEADER
I20260709 13:21:35.728245 14055 raft_consensus.cc:515] T 7ba5dac66ab5497e9e336f2a3c28cda5 P b7ab4784c7344b939bc36f639286f377 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:21:35.735072 13690 consensus_queue.cc:260] T bd6869f07b5a4885a0b99fbe60c3b175 P cd75a17ab2604397adab03bb8b5fd75c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 23.12, Last appended by leader: 12, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:35.652401 13987 raft_consensus.cc:515] T b56bf91d90824c959e21e0cee5ba1816 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:35.754944 13690 raft_consensus.cc:3060] T bd6869f07b5a4885a0b99fbe60c3b175 P cd75a17ab2604397adab03bb8b5fd75c [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:21:35.670372 13992 consensus_queue.cc:1059] T 34f36d59d88f40fe8a2805e604fc6c0a P b7ab4784c7344b939bc36f639286f377 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: INVALID_TERM, Last received: 20.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.074s
I20260709 13:21:35.695075 14148 raft_consensus.cc:3060] T be1a92657f494cac8dd227d152f50151 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 23 FOLLOWER]: Advancing to term 24
W20260709 13:21:35.759277  6844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:21:35.729102  6621 rpcz_store.cc:269] 0709 13:20:52.981238 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:52.997618 (+ 16380us) service_pool.cc:224] Handling call
0709 13:21:35.728523 (+42730905us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:21:31.848628 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:21:31.852725 (+  4097us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:21:31.852793 (+    68us) write_op.cc:435] Acquired schema lock
0709 13:21:31.852814 (+    21us) tablet.cc:662] Decoding operations
0709 13:21:31.976684 (+123870us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:21:31.976832 (+   148us) write_op.cc:641] Partition lock acquired for write op
0709 13:21:31.976863 (+    31us) tablet.cc:685] Acquiring locks for 29 operations
0709 13:21:32.303265 (+326402us) tablet.cc:701] Row locks acquired
0709 13:21:32.303337 (+    72us) write_op.cc:260] PREPARE: finished
0709 13:21:32.303601 (+   264us) write_op.cc:270] Start()
0709 13:21:32.303842 (+   241us) write_op.cc:276] Timestamp: P: 1783603292303502 usec, L: 0
0709 13:21:32.303887 (+    45us) op_driver.cc:348] REPLICATION: starting
0709 13:21:32.413833 (+109946us) log.cc:844] Serialized 11314 byte log entry
0709 13:21:33.498553 (+1084720us) op_driver.cc:464] REPLICATION: finished
0709 13:21:33.535298 (+ 36745us) write_op.cc:301] APPLY: starting
0709 13:21:33.535394 (+    96us) tablet.cc:1367] starting BulkCheckPresence
0709 13:21:33.553273 (+ 17879us) tablet.cc:1370] finished BulkCheckPresence
0709 13:21:33.553392 (+   119us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:21:34.114845 (+561453us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:21:34.169570 (+ 54725us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=58,key_file_lookups=58,delta_file_lookups=58,mrs_lookups=0
0709 13:21:34.169681 (+   111us) write_op.cc:312] APPLY: finished
0709 13:21:34.170536 (+   855us) log.cc:844] Serialized 251 byte log entry
0709 13:21:34.170771 (+   235us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:21:34.171101 (+   330us) write_op.cc:454] Released schema lock
0709 13:21:34.171217 (+   116us) write_op.cc:341] FINISH: Updating metrics
0709 13:21:34.171710 (+   493us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:21:34.171761 (+    51us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":34918,"reported_tablets":55,"child_traces":[["op",{"apply.queue_time_us":36403,"apply.run_cpu_time_us":38732,"apply.run_wall_time_us":636381,"cfile_cache_hit":118,"cfile_cache_hit_bytes":125231,"num_ops":29,"prepare.queue_time_us":846978,"prepare.run_cpu_time_us":23515,"prepare.run_wall_time_us":937573,"raft.queue_time_us":216262,"raft.run_cpu_time_us":6024,"raft.run_wall_time_us":57112,"replication_time_us":1187621,"thread_start_us":579542,"threads_started":4,"wal-append.queue_time_us":439361,"wal-append.run_cpu_time_us":13280,"wal-append.run_wall_time_us":2342470}]]}
W20260709 13:21:35.801138  7468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 137575us
I20260709 13:21:35.804294  7468 leader_election.cc:304] T 7ba5dac66ab5497e9e336f2a3c28cda5 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377
I20260709 13:21:35.812932 14149 raft_consensus.cc:493] T 34f36d59d88f40fe8a2805e604fc6c0a P ccd8a4c3bfe3413cb2ae219b09aea832 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:35.813812 14149 raft_consensus.cc:515] T 34f36d59d88f40fe8a2805e604fc6c0a P ccd8a4c3bfe3413cb2ae219b09aea832 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:35.816009 14149 leader_election.cc:290] T 34f36d59d88f40fe8a2805e604fc6c0a P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:21:35.822309 14148 raft_consensus.cc:515] T be1a92657f494cac8dd227d152f50151 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 24 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:21:35.841956 14148 leader_election.cc:290] T be1a92657f494cac8dd227d152f50151 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 24 election: Requested vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:21:35.922547  6730 raft_consensus.cc:1275] T 34f36d59d88f40fe8a2805e604fc6c0a P ccd8a4c3bfe3413cb2ae219b09aea832 [term 20 FOLLOWER]: Refusing update from remote peer b7ab4784c7344b939bc36f639286f377: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 20 index: 11. (index mismatch)
I20260709 13:21:35.924484  6729 raft_consensus.cc:1275] T 90d42e216d9741e190bca19a781291fd P ccd8a4c3bfe3413cb2ae219b09aea832 [term 20 FOLLOWER]: Refusing update from remote peer b7ab4784c7344b939bc36f639286f377: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 20 index: 11. (index mismatch)
I20260709 13:21:35.936120 14115 raft_consensus.cc:2804] T 7ba5dac66ab5497e9e336f2a3c28cda5 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:21:35.936393 14055 leader_election.cc:290] T 7ba5dac66ab5497e9e336f2a3c28cda5 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:21:35.936841 14115 raft_consensus.cc:697] T 7ba5dac66ab5497e9e336f2a3c28cda5 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 23 LEADER]: Becoming Leader. State: Replica: 7ba59cc884714e8aa5f3f0ecaed84cbb, State: Running, Role: LEADER
I20260709 13:21:35.937698 14115 consensus_queue.cc:237] T 7ba5dac66ab5497e9e336f2a3c28cda5 P 7ba59cc884714e8aa5f3f0ecaed84cbb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 22.16, Last appended by leader: 16, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:21:35.800563 14137 raft_consensus.cc:515] T 22ccee1b570c4ad3a57bd7aec085b1b4 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:35.940642 14087 raft_consensus.cc:515] T 1bf4668eeb70467fb3dc5a0289233b3c P cd75a17ab2604397adab03bb8b5fd75c [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:35.941162 14137 leader_election.cc:290] T 22ccee1b570c4ad3a57bd7aec085b1b4 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 16 election: Requested vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:21:35.942744 14087 leader_election.cc:290] T 1bf4668eeb70467fb3dc5a0289233b3c P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 23 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:21:35.954246  6731 raft_consensus.cc:1275] T f09c2a98de1a4decabd0ff900dd44caa P ccd8a4c3bfe3413cb2ae219b09aea832 [term 24 FOLLOWER]: Refusing update from remote peer b7ab4784c7344b939bc36f639286f377: Log matching property violated. Preceding OpId in replica: term: 22 index: 13. Preceding OpId from leader: term: 24 index: 14. (index mismatch)
I20260709 13:21:35.987468  6729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34f36d59d88f40fe8a2805e604fc6c0a" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: true dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:21:35.988266  6729 raft_consensus.cc:3060] T 34f36d59d88f40fe8a2805e604fc6c0a P ccd8a4c3bfe3413cb2ae219b09aea832 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:21:35.989100  6724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bf4668eeb70467fb3dc5a0289233b3c" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:21:35.989995  6724 raft_consensus.cc:3060] T 1bf4668eeb70467fb3dc5a0289233b3c P ccd8a4c3bfe3413cb2ae219b09aea832 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:21:35.990989  6728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "427c124d773f483294511e80fe340075" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:21:35.993304  6731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d33d5ee8ef6f415593d8df52063161ad" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
W20260709 13:21:35.999306  6697 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 308478us
I20260709 13:21:35.987596 14148 raft_consensus.cc:493] T 90d42e216d9741e190bca19a781291fd P ccd8a4c3bfe3413cb2ae219b09aea832 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:36.004825  6844 leader_election.cc:304] T d33d5ee8ef6f415593d8df52063161ad P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:21:36.008634  6877 raft_consensus.cc:1275] T f09c2a98de1a4decabd0ff900dd44caa P cd75a17ab2604397adab03bb8b5fd75c [term 24 FOLLOWER]: Refusing update from remote peer b7ab4784c7344b939bc36f639286f377: Log matching property violated. Preceding OpId in replica: term: 23 index: 14. Preceding OpId from leader: term: 24 index: 14. (term mismatch)
I20260709 13:21:36.009140  6877 pending_rounds.cc:85] T f09c2a98de1a4decabd0ff900dd44caa P cd75a17ab2604397adab03bb8b5fd75c: Aborting all ops after (but not including) 13
I20260709 13:21:36.009373  6877 pending_rounds.cc:107] T f09c2a98de1a4decabd0ff900dd44caa P cd75a17ab2604397adab03bb8b5fd75c: Aborting uncommitted NO_OP operation due to leader change: 23.14
I20260709 13:21:36.009639  6877 raft_consensus.cc:2889] T f09c2a98de1a4decabd0ff900dd44caa P cd75a17ab2604397adab03bb8b5fd75c [term 24 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:21:36.016366  7495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ba5dac66ab5497e9e336f2a3c28cda5" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:21:36.023937  6872 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c4db81d9d329422bb3b4160ca4ac2d1d"
dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
 from {username='slave'} at 127.0.0.1:53406
I20260709 13:21:36.024873  6872 raft_consensus.cc:493] T c4db81d9d329422bb3b4160ca4ac2d1d P cd75a17ab2604397adab03bb8b5fd75c [term 20 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:21:36.025358  6872 raft_consensus.cc:3060] T c4db81d9d329422bb3b4160ca4ac2d1d P cd75a17ab2604397adab03bb8b5fd75c [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:21:36.033717  6729 raft_consensus.cc:2468] T 34f36d59d88f40fe8a2805e604fc6c0a P ccd8a4c3bfe3413cb2ae219b09aea832 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 21.
I20260709 13:21:36.038564  6877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ba5dac66ab5497e9e336f2a3c28cda5" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:21:36.042007  6880 raft_consensus.cc:1275] T 90d42e216d9741e190bca19a781291fd P cd75a17ab2604397adab03bb8b5fd75c [term 20 FOLLOWER]: Refusing update from remote peer b7ab4784c7344b939bc36f639286f377: Log matching property violated. Preceding OpId in replica: term: 19 index: 11. Preceding OpId from leader: term: 20 index: 11. (term mismatch)
I20260709 13:21:36.039340  6844 leader_election.cc:304] T 34f36d59d88f40fe8a2805e604fc6c0a P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:21:36.042557  6880 pending_rounds.cc:85] T 90d42e216d9741e190bca19a781291fd P cd75a17ab2604397adab03bb8b5fd75c: Aborting all ops after (but not including) 10
I20260709 13:21:36.042999  6880 pending_rounds.cc:107] T 90d42e216d9741e190bca19a781291fd P cd75a17ab2604397adab03bb8b5fd75c: Aborting uncommitted NO_OP operation due to leader change: 19.11
I20260709 13:21:36.043330  6880 raft_consensus.cc:2889] T 90d42e216d9741e190bca19a781291fd P cd75a17ab2604397adab03bb8b5fd75c [term 20 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:21:36.047344  6877 raft_consensus.cc:2393] T 7ba5dac66ab5497e9e336f2a3c28cda5 P cd75a17ab2604397adab03bb8b5fd75c [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b7ab4784c7344b939bc36f639286f377 in current term 23: Already voted for candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in this term.
I20260709 13:21:36.051594  6872 raft_consensus.cc:515] T c4db81d9d329422bb3b4160ca4ac2d1d P cd75a17ab2604397adab03bb8b5fd75c [term 21 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:36.021507 14120 raft_consensus.cc:2749] T d33d5ee8ef6f415593d8df52063161ad P cd75a17ab2604397adab03bb8b5fd75c [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 13:21:36.067705  6770 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 100579us
I20260709 13:21:36.008754 14148 raft_consensus.cc:515] T 90d42e216d9741e190bca19a781291fd P ccd8a4c3bfe3413cb2ae219b09aea832 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:36.053352 13987 leader_election.cc:290] T b56bf91d90824c959e21e0cee5ba1816 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:21:36.062027 13690 raft_consensus.cc:2804] T 34f36d59d88f40fe8a2805e604fc6c0a P cd75a17ab2604397adab03bb8b5fd75c [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:21:36.087491 14017 consensus_queue.cc:1048] T f09c2a98de1a4decabd0ff900dd44caa P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
W20260709 13:21:36.092449  6846 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:21:36.092679 13690 raft_consensus.cc:697] T 34f36d59d88f40fe8a2805e604fc6c0a P cd75a17ab2604397adab03bb8b5fd75c [term 21 LEADER]: Becoming Leader. State: Replica: cd75a17ab2604397adab03bb8b5fd75c, State: Running, Role: LEADER
I20260709 13:21:36.093611 13690 consensus_queue.cc:237] T 34f36d59d88f40fe8a2805e604fc6c0a P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 20.11, Last appended by leader: 11, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
W20260709 13:21:36.041391  6614 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet ce4f062dcd314d43a63ca74067cb5ee3 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER failed with leader b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica b7ab4784c7344b939bc36f639286f377 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 16 leader_uuid: "cd75a17ab2604397adab03bb8b5fd75c" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } } }
W20260709 13:21:36.096421  6614 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 73622.9us
I20260709 13:21:36.098340 14148 leader_election.cc:290] T 90d42e216d9741e190bca19a781291fd P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:21:36.098477  6874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34f36d59d88f40fe8a2805e604fc6c0a" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 21 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:21:36.098685 13992 consensus_queue.cc:1048] T 34f36d59d88f40fe8a2805e604fc6c0a P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.001s
W20260709 13:21:36.100636 14172 log.cc:927] Time spent T f5be3a11b23d4ea9b08300a2789821c7 P ccd8a4c3bfe3413cb2ae219b09aea832: Append to log took a long time: real 0.109s	user 0.000s	sys 0.001s
I20260709 13:21:36.092532  6727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4db81d9d329422bb3b4160ca4ac2d1d" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: true dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:21:36.101558  6727 raft_consensus.cc:3060] T c4db81d9d329422bb3b4160ca4ac2d1d P ccd8a4c3bfe3413cb2ae219b09aea832 [term 20 FOLLOWER]: Advancing to term 21
W20260709 13:21:36.111101 14169 log.cc:927] Time spent T f5be3a11b23d4ea9b08300a2789821c7 P cd75a17ab2604397adab03bb8b5fd75c: Append to log took a long time: real 0.152s	user 0.001s	sys 0.000s
I20260709 13:21:36.113646  6724 raft_consensus.cc:2468] T 1bf4668eeb70467fb3dc5a0289233b3c P ccd8a4c3bfe3413cb2ae219b09aea832 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 23.
I20260709 13:21:36.129603  6872 leader_election.cc:290] T c4db81d9d329422bb3b4160ca4ac2d1d P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 21 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:21:36.131086  6844 leader_election.cc:304] T 1bf4668eeb70467fb3dc5a0289233b3c P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:21:36.132807  6873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22ccee1b570c4ad3a57bd7aec085b1b4" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:21:36.136102 14087 raft_consensus.cc:2804] T 1bf4668eeb70467fb3dc5a0289233b3c P cd75a17ab2604397adab03bb8b5fd75c [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:21:36.136790 14087 raft_consensus.cc:697] T 1bf4668eeb70467fb3dc5a0289233b3c P cd75a17ab2604397adab03bb8b5fd75c [term 23 LEADER]: Becoming Leader. State: Replica: cd75a17ab2604397adab03bb8b5fd75c, State: Running, Role: LEADER
I20260709 13:21:36.137763 14087 consensus_queue.cc:237] T 1bf4668eeb70467fb3dc5a0289233b3c P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 21.13, Last appended by leader: 13, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:36.138646  6727 raft_consensus.cc:2468] T c4db81d9d329422bb3b4160ca4ac2d1d P ccd8a4c3bfe3413cb2ae219b09aea832 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 21.
I20260709 13:21:36.142746  6844 leader_election.cc:304] T c4db81d9d329422bb3b4160ca4ac2d1d P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:21:36.143110  6800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be1a92657f494cac8dd227d152f50151" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:21:36.151576 13998 raft_consensus.cc:2804] T c4db81d9d329422bb3b4160ca4ac2d1d P cd75a17ab2604397adab03bb8b5fd75c [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:21:36.152423 13998 raft_consensus.cc:697] T c4db81d9d329422bb3b4160ca4ac2d1d P cd75a17ab2604397adab03bb8b5fd75c [term 21 LEADER]: Becoming Leader. State: Replica: cd75a17ab2604397adab03bb8b5fd75c, State: Running, Role: LEADER
I20260709 13:21:36.156854 13998 consensus_queue.cc:237] T c4db81d9d329422bb3b4160ca4ac2d1d P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 20.11, Last appended by leader: 11, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
W20260709 13:21:36.167452  6770 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 93589.2us
I20260709 13:21:36.168475  6874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90d42e216d9741e190bca19a781291fd" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 21 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:21:36.177742  6879 raft_consensus.cc:1275] T 4b8cacb381b746da8d0049b0a83b41dd P cd75a17ab2604397adab03bb8b5fd75c [term 21 FOLLOWER]: Refusing update from remote peer ccd8a4c3bfe3413cb2ae219b09aea832: Log matching property violated. Preceding OpId in replica: term: 20 index: 15. Preceding OpId from leader: term: 21 index: 16. (index mismatch)
I20260709 13:21:36.184177  6798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b56bf91d90824c959e21e0cee5ba1816" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:21:36.146421  6801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34f36d59d88f40fe8a2805e604fc6c0a" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 21 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:21:36.194458  6800 raft_consensus.cc:2468] T be1a92657f494cac8dd227d152f50151 P b7ab4784c7344b939bc36f639286f377 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 24.
W20260709 13:21:36.195421  6772 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 124102us
I20260709 13:21:36.167954  6880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b56bf91d90824c959e21e0cee5ba1816" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:21:36.171118  6874 raft_consensus.cc:2468] T 90d42e216d9741e190bca19a781291fd P cd75a17ab2604397adab03bb8b5fd75c [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 20.
I20260709 13:21:36.206346  6807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22ccee1b570c4ad3a57bd7aec085b1b4" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:21:36.207903  6801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90d42e216d9741e190bca19a781291fd" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 21 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:21:36.211155  6807 raft_consensus.cc:2393] T 22ccee1b570c4ad3a57bd7aec085b1b4 P b7ab4784c7344b939bc36f639286f377 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate ccd8a4c3bfe3413cb2ae219b09aea832 in current term 16: Already voted for candidate b7ab4784c7344b939bc36f639286f377 in this term.
I20260709 13:21:36.213845 13896 consensus_queue.cc:1048] T 4b8cacb381b746da8d0049b0a83b41dd P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 13:21:36.228978 14055 consensus_queue.cc:1048] T 90d42e216d9741e190bca19a781291fd P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:21:36.231115 13996 consensus_queue.cc:1048] T 90d42e216d9741e190bca19a781291fd P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:21:36.234208  6799 raft_consensus.cc:3055] T 34f36d59d88f40fe8a2805e604fc6c0a P b7ab4784c7344b939bc36f639286f377 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:21:36.234696  6799 raft_consensus.cc:740] T 34f36d59d88f40fe8a2805e604fc6c0a P b7ab4784c7344b939bc36f639286f377 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
I20260709 13:21:36.237246  6772 leader_election.cc:304] T 7ba5dac66ab5497e9e336f2a3c28cda5 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:21:36.239303 14008 raft_consensus.cc:3060] T 7ba5dac66ab5497e9e336f2a3c28cda5 P b7ab4784c7344b939bc36f639286f377 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:21:36.249323  6879 raft_consensus.cc:3060] T 4d9def8b32fd443aa94ab1420b06837b P cd75a17ab2604397adab03bb8b5fd75c [term 23 FOLLOWER]: Advancing to term 24
W20260709 13:21:36.253173  6770 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 48436.4us
I20260709 13:21:36.261189  6873 raft_consensus.cc:2468] T 22ccee1b570c4ad3a57bd7aec085b1b4 P cd75a17ab2604397adab03bb8b5fd75c [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 16.
I20260709 13:21:36.262248  6697 leader_election.cc:304] T 90d42e216d9741e190bca19a781291fd P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:21:36.265080  6801 raft_consensus.cc:1240] T 9b3759de40694069b13c0f8bd40e5709 P b7ab4784c7344b939bc36f639286f377 [term 19 FOLLOWER]: Rejecting Update request from peer cd75a17ab2604397adab03bb8b5fd75c for earlier term 18. Current term is 19. Ops: []
I20260709 13:21:36.267513  6798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bf4668eeb70467fb3dc5a0289233b3c" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:21:36.268424  6798 raft_consensus.cc:3060] T 1bf4668eeb70467fb3dc5a0289233b3c P b7ab4784c7344b939bc36f639286f377 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:21:36.268447  6802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4db81d9d329422bb3b4160ca4ac2d1d" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: true dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:21:36.269114  6800 raft_consensus.cc:1275] T e31b9971c15848dea59d4d4130141d9e P b7ab4784c7344b939bc36f639286f377 [term 18 FOLLOWER]: Refusing update from remote peer cd75a17ab2604397adab03bb8b5fd75c: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 13:21:36.269310  6802 raft_consensus.cc:3055] T c4db81d9d329422bb3b4160ca4ac2d1d P b7ab4784c7344b939bc36f639286f377 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:21:36.269603  6802 raft_consensus.cc:740] T c4db81d9d329422bb3b4160ca4ac2d1d P b7ab4784c7344b939bc36f639286f377 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
I20260709 13:21:36.270335  6802 consensus_queue.cc:260] T c4db81d9d329422bb3b4160ca4ac2d1d P b7ab4784c7344b939bc36f639286f377 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 20.11, Last appended by leader: 11, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:36.271406  6802 raft_consensus.cc:3060] T c4db81d9d329422bb3b4160ca4ac2d1d P b7ab4784c7344b939bc36f639286f377 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:21:36.277384  6731 raft_consensus.cc:1275] T 4d9def8b32fd443aa94ab1420b06837b P ccd8a4c3bfe3413cb2ae219b09aea832 [term 24 FOLLOWER]: Refusing update from remote peer b7ab4784c7344b939bc36f639286f377: Log matching property violated. Preceding OpId in replica: term: 23 index: 12. Preceding OpId from leader: term: 24 index: 13. (index mismatch)
I20260709 13:21:36.278956  6697 leader_election.cc:304] T 22ccee1b570c4ad3a57bd7aec085b1b4 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:21:36.302924  6727 raft_consensus.cc:1240] T c4db81d9d329422bb3b4160ca4ac2d1d P ccd8a4c3bfe3413cb2ae219b09aea832 [term 21 FOLLOWER]: Rejecting Update request from peer b7ab4784c7344b939bc36f639286f377 for earlier term 20. Current term is 21. Ops: []
I20260709 13:21:36.311542  5625 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:21:36.259546 14150 raft_consensus.cc:493] T 404190ce4ce94cecbfcb6ea9d1dd8626 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:21:36.316458  6723 raft_consensus.cc:1240] T 34f36d59d88f40fe8a2805e604fc6c0a P ccd8a4c3bfe3413cb2ae219b09aea832 [term 21 FOLLOWER]: Rejecting Update request from peer b7ab4784c7344b939bc36f639286f377 for earlier term 20. Current term is 21. Ops: [20.11-20.11]
I20260709 13:21:36.318821  6695 leader_election.cc:304] T 34f36d59d88f40fe8a2805e604fc6c0a P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:21:36.313323 14159 raft_consensus.cc:2804] T 22ccee1b570c4ad3a57bd7aec085b1b4 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:21:36.291621 14176 raft_consensus.cc:2804] T 90d42e216d9741e190bca19a781291fd P ccd8a4c3bfe3413cb2ae219b09aea832 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:21:36.319911 14058 consensus_queue.cc:1048] T 4d9def8b32fd443aa94ab1420b06837b P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.006s
I20260709 13:21:36.331363  6799 consensus_queue.cc:260] T 34f36d59d88f40fe8a2805e604fc6c0a P b7ab4784c7344b939bc36f639286f377 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 20.11, Last appended by leader: 11, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:36.353896  6802 raft_consensus.cc:2468] T c4db81d9d329422bb3b4160ca4ac2d1d P b7ab4784c7344b939bc36f639286f377 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 21.
I20260709 13:21:36.359130  6799 raft_consensus.cc:3060] T 34f36d59d88f40fe8a2805e604fc6c0a P b7ab4784c7344b939bc36f639286f377 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:21:36.358067  6798 raft_consensus.cc:2468] T 1bf4668eeb70467fb3dc5a0289233b3c P b7ab4784c7344b939bc36f639286f377 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 23.
W20260709 13:21:36.369609  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 73426.1us
I20260709 13:21:36.291695 14186 consensus_queue.cc:1048] T f09c2a98de1a4decabd0ff900dd44caa P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.080s
I20260709 13:21:36.302181 14066 consensus_queue.cc:1059] T 9b3759de40694069b13c0f8bd40e5709 P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: INVALID_TERM, Last received: 18.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.055s
I20260709 13:21:36.361856 14160 raft_consensus.cc:2749] T 34f36d59d88f40fe8a2805e604fc6c0a P ccd8a4c3bfe3413cb2ae219b09aea832 [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:21:36.325835 14150 raft_consensus.cc:515] T 404190ce4ce94cecbfcb6ea9d1dd8626 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:21:36.413031  6723 raft_consensus.cc:1275] T f58dc08b12a2494bb9a1372837970ca2 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 21 FOLLOWER]: Refusing update from remote peer cd75a17ab2604397adab03bb8b5fd75c: Log matching property violated. Preceding OpId in replica: term: 20 index: 11. Preceding OpId from leader: term: 21 index: 12. (index mismatch)
I20260709 13:21:36.408862 14189 raft_consensus.cc:493] T be1a92657f494cac8dd227d152f50151 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:36.427024 14189 raft_consensus.cc:515] T be1a92657f494cac8dd227d152f50151 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:21:36.429735 14189 leader_election.cc:290] T be1a92657f494cac8dd227d152f50151 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:21:36.430438  7496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be1a92657f494cac8dd227d152f50151" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb"
I20260709 13:21:36.431278  7496 raft_consensus.cc:2393] T be1a92657f494cac8dd227d152f50151 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate ccd8a4c3bfe3413cb2ae219b09aea832 in current term 24: Already voted for candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in this term.
I20260709 13:21:36.434825  7496 raft_consensus.cc:1275] T 4b8cacb381b746da8d0049b0a83b41dd P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 21 FOLLOWER]: Refusing update from remote peer ccd8a4c3bfe3413cb2ae219b09aea832: Log matching property violated. Preceding OpId in replica: term: 20 index: 15. Preceding OpId from leader: term: 21 index: 16. (index mismatch)
I20260709 13:21:36.416507  6877 raft_consensus.cc:1240] T 34f36d59d88f40fe8a2805e604fc6c0a P cd75a17ab2604397adab03bb8b5fd75c [term 21 LEADER]: Rejecting Update request from peer b7ab4784c7344b939bc36f639286f377 for earlier term 20. Current term is 21. Ops: []
I20260709 13:21:36.369006 14159 raft_consensus.cc:697] T 22ccee1b570c4ad3a57bd7aec085b1b4 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 16 LEADER]: Becoming Leader. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
I20260709 13:21:36.443336  6802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be1a92657f494cac8dd227d152f50151" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 25 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:21:36.444411  6802 raft_consensus.cc:2468] T be1a92657f494cac8dd227d152f50151 P b7ab4784c7344b939bc36f639286f377 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in term 24.
I20260709 13:21:36.413177  6725 raft_consensus.cc:3060] T e31b9971c15848dea59d4d4130141d9e P ccd8a4c3bfe3413cb2ae219b09aea832 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:21:36.371011 13588 consensus_queue.cc:1048] T e31b9971c15848dea59d4d4130141d9e P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.067s
I20260709 13:21:36.454172  6732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be1a92657f494cac8dd227d152f50151" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 25 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:21:36.458848  6732 raft_consensus.cc:2468] T be1a92657f494cac8dd227d152f50151 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in term 24.
W20260709 13:21:36.456976  6695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 138255us
I20260709 13:21:36.457226  6800 raft_consensus.cc:1275] T f58dc08b12a2494bb9a1372837970ca2 P b7ab4784c7344b939bc36f639286f377 [term 21 FOLLOWER]: Refusing update from remote peer cd75a17ab2604397adab03bb8b5fd75c: Log matching property violated. Preceding OpId in replica: term: 20 index: 11. Preceding OpId from leader: term: 21 index: 12. (index mismatch)
I20260709 13:21:36.470681  6695 leader_election.cc:304] T be1a92657f494cac8dd227d152f50151 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
I20260709 13:21:36.474852  6799 raft_consensus.cc:2468] T 34f36d59d88f40fe8a2805e604fc6c0a P b7ab4784c7344b939bc36f639286f377 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 21.
W20260709 13:21:36.476817 14057 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 21 current term: 21 is higher.
I20260709 13:21:36.477416 14149 raft_consensus.cc:2804] T be1a92657f494cac8dd227d152f50151 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 24 FOLLOWER]: Leader election won for term 24
I20260709 13:21:36.478091 14149 raft_consensus.cc:697] T be1a92657f494cac8dd227d152f50151 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 24 LEADER]: Becoming Leader. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
I20260709 13:21:36.479271 14149 consensus_queue.cc:237] T be1a92657f494cac8dd227d152f50151 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 23.17, Last appended by leader: 17, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:21:36.483474 14011 raft_consensus.cc:3055] T 9b3759de40694069b13c0f8bd40e5709 P cd75a17ab2604397adab03bb8b5fd75c [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:21:36.491075 14011 raft_consensus.cc:740] T 9b3759de40694069b13c0f8bd40e5709 P cd75a17ab2604397adab03bb8b5fd75c [term 18 LEADER]: Becoming Follower/Learner. State: Replica: cd75a17ab2604397adab03bb8b5fd75c, State: Running, Role: LEADER
I20260709 13:21:36.491402  6695 leader_election.cc:304] T b56bf91d90824c959e21e0cee5ba1816 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:21:36.492571 14011 consensus_queue.cc:260] T 9b3759de40694069b13c0f8bd40e5709 P cd75a17ab2604397adab03bb8b5fd75c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 12, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:36.496214 14011 raft_consensus.cc:3060] T 9b3759de40694069b13c0f8bd40e5709 P cd75a17ab2604397adab03bb8b5fd75c [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:21:36.502439 14197 log.cc:927] Time spent T bd6869f07b5a4885a0b99fbe60c3b175 P ccd8a4c3bfe3413cb2ae219b09aea832: Append to log took a long time: real 0.077s	user 0.002s	sys 0.000s
I20260709 13:21:36.480253  6725 raft_consensus.cc:1275] T e31b9971c15848dea59d4d4130141d9e P ccd8a4c3bfe3413cb2ae219b09aea832 [term 18 FOLLOWER]: Refusing update from remote peer cd75a17ab2604397adab03bb8b5fd75c: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
W20260709 13:21:36.486945 14196 log.cc:927] Time spent T c4db81d9d329422bb3b4160ca4ac2d1d P cd75a17ab2604397adab03bb8b5fd75c: Append to log took a long time: real 0.070s	user 0.000s	sys 0.002s
I20260709 13:21:36.487520 14201 consensus_queue.cc:1048] T f58dc08b12a2494bb9a1372837970ca2 P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Connected to new peer: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.018s
I20260709 13:21:36.489758 14150 leader_election.cc:290] T 404190ce4ce94cecbfcb6ea9d1dd8626 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:21:36.510010  7466 leader_election.cc:304] T be1a92657f494cac8dd227d152f50151 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, b7ab4784c7344b939bc36f639286f377; no voters: 
I20260709 13:21:36.535930 14162 raft_consensus.cc:2749] T b56bf91d90824c959e21e0cee5ba1816 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:21:36.538794 14159 consensus_queue.cc:237] T 22ccee1b570c4ad3a57bd7aec085b1b4 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
W20260709 13:21:36.549326 14200 log.cc:927] Time spent T 90d42e216d9741e190bca19a781291fd P cd75a17ab2604397adab03bb8b5fd75c: Append to log took a long time: real 0.080s	user 0.000s	sys 0.001s
I20260709 13:21:36.550432 14161 raft_consensus.cc:493] T 3fa34c08b205435dba97346991aa1f92 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:21:36.546761  6695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 55479.8us
I20260709 13:21:36.551065 14161 raft_consensus.cc:515] T 3fa34c08b205435dba97346991aa1f92 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:21:36.520689 14193 raft_consensus.cc:2804] T be1a92657f494cac8dd227d152f50151 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 13:21:36.556515 14193 raft_consensus.cc:493] T be1a92657f494cac8dd227d152f50151 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 24 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:36.556924 14193 raft_consensus.cc:3060] T be1a92657f494cac8dd227d152f50151 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:21:36.557363 14161 leader_election.cc:290] T 3fa34c08b205435dba97346991aa1f92 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:21:36.521765 14176 raft_consensus.cc:493] T 90d42e216d9741e190bca19a781291fd P ccd8a4c3bfe3413cb2ae219b09aea832 [term 20 FOLLOWER]: Starting leader election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:21:36.559758 14176 raft_consensus.cc:3060] T 90d42e216d9741e190bca19a781291fd P ccd8a4c3bfe3413cb2ae219b09aea832 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:21:36.564126 14008 raft_consensus.cc:2749] T 7ba5dac66ab5497e9e336f2a3c28cda5 P b7ab4784c7344b939bc36f639286f377 [term 23 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:21:36.565462  6798 raft_consensus.cc:1275] T 7ba5dac66ab5497e9e336f2a3c28cda5 P b7ab4784c7344b939bc36f639286f377 [term 23 FOLLOWER]: Refusing update from remote peer 7ba59cc884714e8aa5f3f0ecaed84cbb: Log matching property violated. Preceding OpId in replica: term: 22 index: 16. Preceding OpId from leader: term: 23 index: 17. (index mismatch)
I20260709 13:21:36.571689  6879 raft_consensus.cc:1275] T 4d9def8b32fd443aa94ab1420b06837b P cd75a17ab2604397adab03bb8b5fd75c [term 24 FOLLOWER]: Refusing update from remote peer b7ab4784c7344b939bc36f639286f377: Log matching property violated. Preceding OpId in replica: term: 23 index: 12. Preceding OpId from leader: term: 24 index: 13. (index mismatch)
I20260709 13:21:36.577170 14161 consensus_queue.cc:1048] T 7ba5dac66ab5497e9e336f2a3c28cda5 P 7ba59cc884714e8aa5f3f0ecaed84cbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.000s
I20260709 13:21:36.578833  6728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fa34c08b205435dba97346991aa1f92" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 27 candidate_status { last_received { term: 25 index: 18 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:21:36.580935  6728 raft_consensus.cc:2468] T 3fa34c08b205435dba97346991aa1f92 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in term 26.
I20260709 13:21:36.583531 14055 consensus_queue.cc:1048] T 4d9def8b32fd443aa94ab1420b06837b P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:21:36.582506  7466 leader_election.cc:304] T 3fa34c08b205435dba97346991aa1f92 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
I20260709 13:21:36.585741 14175 raft_consensus.cc:2804] T 3fa34c08b205435dba97346991aa1f92 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 26 FOLLOWER]: Leader pre-election won for term 27
I20260709 13:21:36.586120 14175 raft_consensus.cc:493] T 3fa34c08b205435dba97346991aa1f92 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 26 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:36.586460 14175 raft_consensus.cc:3060] T 3fa34c08b205435dba97346991aa1f92 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 26 FOLLOWER]: Advancing to term 27
W20260709 13:21:36.554992  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 94886.4us
I20260709 13:21:36.609225  7496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "404190ce4ce94cecbfcb6ea9d1dd8626" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:21:36.610014  7496 raft_consensus.cc:2393] T 404190ce4ce94cecbfcb6ea9d1dd8626 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ccd8a4c3bfe3413cb2ae219b09aea832 in current term 18: Already voted for candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in this term.
I20260709 13:21:36.612412  6798 raft_consensus.cc:1275] T 1bf4668eeb70467fb3dc5a0289233b3c P b7ab4784c7344b939bc36f639286f377 [term 23 FOLLOWER]: Refusing update from remote peer cd75a17ab2604397adab03bb8b5fd75c: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 23 index: 14. (index mismatch)
I20260709 13:21:36.614022  6731 raft_consensus.cc:1275] T 1bf4668eeb70467fb3dc5a0289233b3c P ccd8a4c3bfe3413cb2ae219b09aea832 [term 23 FOLLOWER]: Refusing update from remote peer cd75a17ab2604397adab03bb8b5fd75c: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 23 index: 14. (index mismatch)
I20260709 13:21:36.618654  6798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "404190ce4ce94cecbfcb6ea9d1dd8626" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:21:36.619612  6798 raft_consensus.cc:2468] T 404190ce4ce94cecbfcb6ea9d1dd8626 P b7ab4784c7344b939bc36f639286f377 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 18.
I20260709 13:21:36.628435 14203 consensus_queue.cc:1048] T f58dc08b12a2494bb9a1372837970ca2 P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:21:36.623564 14038 raft_consensus.cc:493] T ab432e62819d499eaaf3dd55481dd930 P b7ab4784c7344b939bc36f639286f377 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:36.609338 14205 consensus_queue.cc:1048] T 4b8cacb381b746da8d0049b0a83b41dd P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.037s
I20260709 13:21:36.632323 14038 raft_consensus.cc:515] T ab432e62819d499eaaf3dd55481dd930 P b7ab4784c7344b939bc36f639286f377 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:36.647733  6879 raft_consensus.cc:1275] T 7ba5dac66ab5497e9e336f2a3c28cda5 P cd75a17ab2604397adab03bb8b5fd75c [term 23 FOLLOWER]: Refusing update from remote peer 7ba59cc884714e8aa5f3f0ecaed84cbb: Log matching property violated. Preceding OpId in replica: term: 22 index: 16. Preceding OpId from leader: term: 23 index: 17. (index mismatch)
I20260709 13:21:36.648216 14202 consensus_queue.cc:1048] T 1bf4668eeb70467fb3dc5a0289233b3c P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:21:36.649829  6877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fa34c08b205435dba97346991aa1f92" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 27 candidate_status { last_received { term: 25 index: 18 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:21:36.650496  6877 raft_consensus.cc:2468] T 3fa34c08b205435dba97346991aa1f92 P cd75a17ab2604397adab03bb8b5fd75c [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in term 25.
I20260709 13:21:36.700275 14161 consensus_queue.cc:1048] T 7ba5dac66ab5497e9e336f2a3c28cda5 P 7ba59cc884714e8aa5f3f0ecaed84cbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.001s
W20260709 13:21:36.688169 14200 log.cc:927] Time spent T 90d42e216d9741e190bca19a781291fd P cd75a17ab2604397adab03bb8b5fd75c: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 13:21:36.689831 13998 consensus_queue.cc:1048] T e31b9971c15848dea59d4d4130141d9e P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Connected to new peer: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.015s
I20260709 13:21:36.707041 14038 leader_election.cc:290] T ab432e62819d499eaaf3dd55481dd930 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:21:36.724658  6802 raft_consensus.cc:1275] T c4db81d9d329422bb3b4160ca4ac2d1d P b7ab4784c7344b939bc36f639286f377 [term 21 FOLLOWER]: Refusing update from remote peer cd75a17ab2604397adab03bb8b5fd75c: Log matching property violated. Preceding OpId in replica: term: 20 index: 11. Preceding OpId from leader: term: 21 index: 12. (index mismatch)
I20260709 13:21:36.736398 14203 consensus_queue.cc:1048] T c4db81d9d329422bb3b4160ca4ac2d1d P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:21:36.753563  6879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab432e62819d499eaaf3dd55481dd930" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 25 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:21:36.754297  6879 raft_consensus.cc:2468] T ab432e62819d499eaaf3dd55481dd930 P cd75a17ab2604397adab03bb8b5fd75c [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 23.
I20260709 13:21:36.709406 13690 consensus_queue.cc:1048] T 1bf4668eeb70467fb3dc5a0289233b3c P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Connected to new peer: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 11, Time since last communication: 0.039s
I20260709 13:21:36.744288 13991 raft_consensus.cc:493] T d8cee0accdb8499c86d4414b72565a38 P b7ab4784c7344b939bc36f639286f377 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:21:36.780624 14215 log.cc:927] Time spent T 4d9def8b32fd443aa94ab1420b06837b P cd75a17ab2604397adab03bb8b5fd75c: Append to log took a long time: real 0.086s	user 0.000s	sys 0.001s
I20260709 13:21:36.780370 13991 raft_consensus.cc:515] T d8cee0accdb8499c86d4414b72565a38 P b7ab4784c7344b939bc36f639286f377 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:21:36.787133  6772 leader_election.cc:304] T ab432e62819d499eaaf3dd55481dd930 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:21:36.797636  6804 raft_consensus.cc:1275] T 34f36d59d88f40fe8a2805e604fc6c0a P b7ab4784c7344b939bc36f639286f377 [term 21 FOLLOWER]: Refusing update from remote peer cd75a17ab2604397adab03bb8b5fd75c: Log matching property violated. Preceding OpId in replica: term: 20 index: 11. Preceding OpId from leader: term: 21 index: 12. (index mismatch)
I20260709 13:21:36.811017 13991 leader_election.cc:290] T d8cee0accdb8499c86d4414b72565a38 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
W20260709 13:21:36.815414 14211 log.cc:927] Time spent T f09c2a98de1a4decabd0ff900dd44caa P b7ab4784c7344b939bc36f639286f377: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260709 13:21:36.803184 14058 raft_consensus.cc:493] T 22ccee1b570c4ad3a57bd7aec085b1b4 P b7ab4784c7344b939bc36f639286f377 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:36.816366 14058 raft_consensus.cc:515] T 22ccee1b570c4ad3a57bd7aec085b1b4 P b7ab4784c7344b939bc36f639286f377 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:36.818475 14058 leader_election.cc:290] T 22ccee1b570c4ad3a57bd7aec085b1b4 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:21:36.821890 14176 raft_consensus.cc:515] T 90d42e216d9741e190bca19a781291fd P ccd8a4c3bfe3413cb2ae219b09aea832 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:36.823146  6724 raft_consensus.cc:1240] T 90d42e216d9741e190bca19a781291fd P ccd8a4c3bfe3413cb2ae219b09aea832 [term 21 FOLLOWER]: Rejecting Update request from peer b7ab4784c7344b939bc36f639286f377 for earlier term 20. Current term is 21. Ops: []
I20260709 13:21:36.795786 13992 raft_consensus.cc:2804] T ab432e62819d499eaaf3dd55481dd930 P b7ab4784c7344b939bc36f639286f377 [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 13:21:36.824445 13992 raft_consensus.cc:493] T ab432e62819d499eaaf3dd55481dd930 P b7ab4784c7344b939bc36f639286f377 [term 24 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:36.824851 13992 raft_consensus.cc:3060] T ab432e62819d499eaaf3dd55481dd930 P b7ab4784c7344b939bc36f639286f377 [term 24 FOLLOWER]: Advancing to term 25
W20260709 13:21:36.825287  6697 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 190717us
W20260709 13:21:36.828226  6695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 192977us
I20260709 13:21:36.791991 14193 raft_consensus.cc:515] T be1a92657f494cac8dd227d152f50151 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 25 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:21:36.757519 14175 raft_consensus.cc:515] T 3fa34c08b205435dba97346991aa1f92 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 27 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:21:36.839836  6727 raft_consensus.cc:1275] T c4db81d9d329422bb3b4160ca4ac2d1d P ccd8a4c3bfe3413cb2ae219b09aea832 [term 21 FOLLOWER]: Refusing update from remote peer cd75a17ab2604397adab03bb8b5fd75c: Log matching property violated. Preceding OpId in replica: term: 20 index: 11. Preceding OpId from leader: term: 21 index: 12. (index mismatch)
I20260709 13:21:36.840976  6802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be1a92657f494cac8dd227d152f50151" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 25 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:21:36.841029  6724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be1a92657f494cac8dd227d152f50151" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 25 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:21:36.841470  6726 raft_consensus.cc:1275] T 34f36d59d88f40fe8a2805e604fc6c0a P ccd8a4c3bfe3413cb2ae219b09aea832 [term 21 FOLLOWER]: Refusing update from remote peer cd75a17ab2604397adab03bb8b5fd75c: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 21 index: 12. (index mismatch)
I20260709 13:21:36.842974  6731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab432e62819d499eaaf3dd55481dd930" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 25 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:21:36.867591  6802 raft_consensus.cc:3060] T be1a92657f494cac8dd227d152f50151 P b7ab4784c7344b939bc36f639286f377 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:21:36.844094  6730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fa34c08b205435dba97346991aa1f92" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 27 candidate_status { last_received { term: 25 index: 18 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:21:36.869877  6730 raft_consensus.cc:3060] T 3fa34c08b205435dba97346991aa1f92 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 26 FOLLOWER]: Advancing to term 27
I20260709 13:21:36.848323  6879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8cee0accdb8499c86d4414b72565a38" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:21:36.867062  6731 raft_consensus.cc:2468] T ab432e62819d499eaaf3dd55481dd930 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 24.
I20260709 13:21:36.872176  6879 raft_consensus.cc:2468] T d8cee0accdb8499c86d4414b72565a38 P cd75a17ab2604397adab03bb8b5fd75c [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 19.
I20260709 13:21:36.879021  6879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fa34c08b205435dba97346991aa1f92" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 27 candidate_status { last_received { term: 25 index: 18 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:21:36.879879  6879 raft_consensus.cc:3060] T 3fa34c08b205435dba97346991aa1f92 P cd75a17ab2604397adab03bb8b5fd75c [term 25 FOLLOWER]: Advancing to term 27
W20260709 13:21:36.882431  6695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 53395.5us
I20260709 13:21:36.883762  6695 leader_election.cc:304] T 404190ce4ce94cecbfcb6ea9d1dd8626 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb
I20260709 13:21:36.892539  6731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22ccee1b570c4ad3a57bd7aec085b1b4" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:21:36.847704  7502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8cee0accdb8499c86d4414b72565a38" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:21:36.838776 13896 raft_consensus.cc:493] T ce4f062dcd314d43a63ca74067cb5ee3 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:21:36.934427  6802 raft_consensus.cc:2468] T be1a92657f494cac8dd227d152f50151 P b7ab4784c7344b939bc36f639286f377 [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in term 25.
I20260709 13:21:36.932121  6772 leader_election.cc:304] T d8cee0accdb8499c86d4414b72565a38 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
W20260709 13:21:36.947362  6695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 63715.8us
I20260709 13:21:36.835194 14193 leader_election.cc:290] T be1a92657f494cac8dd227d152f50151 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 25 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:21:36.957746  7502 raft_consensus.cc:2468] T d8cee0accdb8499c86d4414b72565a38 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 20.
I20260709 13:21:36.956248  6879 raft_consensus.cc:2468] T 3fa34c08b205435dba97346991aa1f92 P cd75a17ab2604397adab03bb8b5fd75c [term 27 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in term 27.
I20260709 13:21:36.934415  6875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22ccee1b570c4ad3a57bd7aec085b1b4" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:21:36.939752 14066 raft_consensus.cc:493] T 95a75bfe094d4bdc963aba3f08dfcd25 P cd75a17ab2604397adab03bb8b5fd75c [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:36.948232 13896 raft_consensus.cc:515] T ce4f062dcd314d43a63ca74067cb5ee3 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } attrs { replace: true } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:21:36.960755 13914 raft_consensus.cc:493] T 9b3759de40694069b13c0f8bd40e5709 P b7ab4784c7344b939bc36f639286f377 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:36.835676 14175 leader_election.cc:290] T 3fa34c08b205435dba97346991aa1f92 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 27 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:21:36.985977 14008 consensus_queue.cc:1059] T 90d42e216d9741e190bca19a781291fd P b7ab4784c7344b939bc36f639286f377 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: INVALID_TERM, Last received: 20.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:21:36.986785 14036 raft_consensus.cc:2804] T d8cee0accdb8499c86d4414b72565a38 P b7ab4784c7344b939bc36f639286f377 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:21:36.991830  6730 raft_consensus.cc:2468] T 3fa34c08b205435dba97346991aa1f92 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 27 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in term 27.
I20260709 13:21:36.896203 14120 consensus_queue.cc:1048] T c4db81d9d329422bb3b4160ca4ac2d1d P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Connected to new peer: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.098s
I20260709 13:21:36.989343  6875 raft_consensus.cc:2468] T 22ccee1b570c4ad3a57bd7aec085b1b4 P cd75a17ab2604397adab03bb8b5fd75c [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 16.
I20260709 13:21:36.883855 14087 consensus_queue.cc:1048] T 34f36d59d88f40fe8a2805e604fc6c0a P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.090s
W20260709 13:21:36.994491  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 116037us
I20260709 13:21:36.957808 14156 raft_consensus.cc:2804] T 404190ce4ce94cecbfcb6ea9d1dd8626 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 17 FOLLOWER]: Leader pre-election won for term 18
W20260709 13:21:36.995658 14214 log.cc:927] Time spent T 4d9def8b32fd443aa94ab1420b06837b P ccd8a4c3bfe3413cb2ae219b09aea832: Append to log took a long time: real 0.079s	user 0.002s	sys 0.000s
I20260709 13:21:37.018546  7468 leader_election.cc:304] T 3fa34c08b205435dba97346991aa1f92 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 27 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:21:37.013015  6772 leader_election.cc:304] T 22ccee1b570c4ad3a57bd7aec085b1b4 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:21:37.010461 14036 raft_consensus.cc:493] T d8cee0accdb8499c86d4414b72565a38 P b7ab4784c7344b939bc36f639286f377 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:37.003888 14066 raft_consensus.cc:515] T 95a75bfe094d4bdc963aba3f08dfcd25 P cd75a17ab2604397adab03bb8b5fd75c [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } attrs { replace: true } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:21:37.069437 14058 raft_consensus.cc:2804] T 22ccee1b570c4ad3a57bd7aec085b1b4 P b7ab4784c7344b939bc36f639286f377 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:21:37.069767 13896 leader_election.cc:290] T ce4f062dcd314d43a63ca74067cb5ee3 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:21:37.069988 14058 raft_consensus.cc:493] T 22ccee1b570c4ad3a57bd7aec085b1b4 P b7ab4784c7344b939bc36f639286f377 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:37.070398 14058 raft_consensus.cc:3060] T 22ccee1b570c4ad3a57bd7aec085b1b4 P b7ab4784c7344b939bc36f639286f377 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:21:37.070700 14066 leader_election.cc:290] T 95a75bfe094d4bdc963aba3f08dfcd25 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:21:37.050482 14036 raft_consensus.cc:3060] T d8cee0accdb8499c86d4414b72565a38 P b7ab4784c7344b939bc36f639286f377 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:21:37.023926 14156 raft_consensus.cc:493] T 404190ce4ce94cecbfcb6ea9d1dd8626 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 17 FOLLOWER]: Starting leader election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:21:37.074330 14156 raft_consensus.cc:3060] T 404190ce4ce94cecbfcb6ea9d1dd8626 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:21:37.085057 14222 log.cc:927] Time spent T 4d9def8b32fd443aa94ab1420b06837b P b7ab4784c7344b939bc36f639286f377: Append to log took a long time: real 0.084s	user 0.000s	sys 0.000s
I20260709 13:21:37.083535 13992 raft_consensus.cc:515] T ab432e62819d499eaaf3dd55481dd930 P b7ab4784c7344b939bc36f639286f377 [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:37.088954 13992 leader_election.cc:290] T ab432e62819d499eaaf3dd55481dd930 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 25 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:21:37.087726 14058 raft_consensus.cc:515] T 22ccee1b570c4ad3a57bd7aec085b1b4 P b7ab4784c7344b939bc36f639286f377 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:37.004254 13914 raft_consensus.cc:515] T 9b3759de40694069b13c0f8bd40e5709 P b7ab4784c7344b939bc36f639286f377 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
W20260709 13:21:37.106096 14223 log.cc:927] Time spent T c4db81d9d329422bb3b4160ca4ac2d1d P b7ab4784c7344b939bc36f639286f377: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 13:21:37.106302 14176 leader_election.cc:290] T 90d42e216d9741e190bca19a781291fd P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 21 election: Requested vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:21:37.108105 13914 leader_election.cc:290] T 9b3759de40694069b13c0f8bd40e5709 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:21:37.043550 14186 raft_consensus.cc:3055] T 90d42e216d9741e190bca19a781291fd P b7ab4784c7344b939bc36f639286f377 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:21:37.113371  6807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90d42e216d9741e190bca19a781291fd" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:21:37.113744 14186 raft_consensus.cc:740] T 90d42e216d9741e190bca19a781291fd P b7ab4784c7344b939bc36f639286f377 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
I20260709 13:21:37.114717  6805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce4f062dcd314d43a63ca74067cb5ee3" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:21:37.114639 14186 consensus_queue.cc:260] T 90d42e216d9741e190bca19a781291fd P b7ab4784c7344b939bc36f639286f377 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 20.11, Last appended by leader: 11, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:37.115671 14186 raft_consensus.cc:3060] T 90d42e216d9741e190bca19a781291fd P b7ab4784c7344b939bc36f639286f377 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:21:37.045801 14161 raft_consensus.cc:2804] T 3fa34c08b205435dba97346991aa1f92 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 27 FOLLOWER]: Leader election won for term 27
W20260709 13:21:37.149691  6772 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 135429us
I20260709 13:21:37.147722 14161 raft_consensus.cc:697] T 3fa34c08b205435dba97346991aa1f92 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 27 LEADER]: Becoming Leader. State: Replica: 7ba59cc884714e8aa5f3f0ecaed84cbb, State: Running, Role: LEADER
I20260709 13:21:37.052327 14230 raft_consensus.cc:493] T 95a75bfe094d4bdc963aba3f08dfcd25 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:37.166163  6875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab432e62819d499eaaf3dd55481dd930" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 25 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:21:37.167140  6875 raft_consensus.cc:3060] T ab432e62819d499eaaf3dd55481dd930 P cd75a17ab2604397adab03bb8b5fd75c [term 23 FOLLOWER]: Advancing to term 25
I20260709 13:21:37.171824  6877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b3759de40694069b13c0f8bd40e5709" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:21:37.172827  6877 raft_consensus.cc:2468] T 9b3759de40694069b13c0f8bd40e5709 P cd75a17ab2604397adab03bb8b5fd75c [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 19.
I20260709 13:21:37.175246  7502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a75bfe094d4bdc963aba3f08dfcd25" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:21:37.158645 14038 raft_consensus.cc:493] T bd6869f07b5a4885a0b99fbe60c3b175 P b7ab4784c7344b939bc36f639286f377 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:37.178205 14038 raft_consensus.cc:515] T bd6869f07b5a4885a0b99fbe60c3b175 P b7ab4784c7344b939bc36f639286f377 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:37.162921 14203 raft_consensus.cc:493] T bd6869f07b5a4885a0b99fbe60c3b175 P cd75a17ab2604397adab03bb8b5fd75c [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:37.184603 14203 raft_consensus.cc:515] T bd6869f07b5a4885a0b99fbe60c3b175 P cd75a17ab2604397adab03bb8b5fd75c [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:37.186900 14203 leader_election.cc:290] T bd6869f07b5a4885a0b99fbe60c3b175 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:21:37.191270 14156 raft_consensus.cc:515] T 404190ce4ce94cecbfcb6ea9d1dd8626 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:21:37.198369  6875 raft_consensus.cc:2468] T ab432e62819d499eaaf3dd55481dd930 P cd75a17ab2604397adab03bb8b5fd75c [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 25.
I20260709 13:21:37.228935 14161 consensus_queue.cc:237] T 3fa34c08b205435dba97346991aa1f92 P 7ba59cc884714e8aa5f3f0ecaed84cbb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 25.18, Last appended by leader: 18, Current term: 27, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:21:37.233512 14036 raft_consensus.cc:515] T d8cee0accdb8499c86d4414b72565a38 P b7ab4784c7344b939bc36f639286f377 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:21:37.237207 14058 leader_election.cc:290] T 22ccee1b570c4ad3a57bd7aec085b1b4 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 17 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
W20260709 13:21:37.239215 14219 log.cc:927] Time spent T 7ba5dac66ab5497e9e336f2a3c28cda5 P b7ab4784c7344b939bc36f639286f377: Append to log took a long time: real 0.516s	user 0.005s	sys 0.000s
I20260709 13:21:37.254187  6880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce4f062dcd314d43a63ca74067cb5ee3" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:21:37.255492  6879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90d42e216d9741e190bca19a781291fd" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:21:37.267326 14038 leader_election.cc:290] T bd6869f07b5a4885a0b99fbe60c3b175 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:21:37.247596  7466 leader_election.cc:304] T be1a92657f494cac8dd227d152f50151 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, b7ab4784c7344b939bc36f639286f377; no voters: 
I20260709 13:21:37.258348  6772 leader_election.cc:304] T 9b3759de40694069b13c0f8bd40e5709 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:21:37.274117 14189 raft_consensus.cc:2804] T be1a92657f494cac8dd227d152f50151 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 25 FOLLOWER]: Leader election won for term 25
I20260709 13:21:37.198908 14230 raft_consensus.cc:515] T 95a75bfe094d4bdc963aba3f08dfcd25 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } attrs { replace: true } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:21:37.274681 14189 raft_consensus.cc:697] T be1a92657f494cac8dd227d152f50151 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 25 LEADER]: Becoming Leader. State: Replica: 7ba59cc884714e8aa5f3f0ecaed84cbb, State: Running, Role: LEADER
I20260709 13:21:37.275086  7502 raft_consensus.cc:2468] T 95a75bfe094d4bdc963aba3f08dfcd25 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 17.
W20260709 13:21:37.276567  6695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 159928us
I20260709 13:21:37.279974  6880 raft_consensus.cc:1275] T 22ccee1b570c4ad3a57bd7aec085b1b4 P cd75a17ab2604397adab03bb8b5fd75c [term 16 FOLLOWER]: Refusing update from remote peer ccd8a4c3bfe3413cb2ae219b09aea832: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:21:37.276443  6772 leader_election.cc:304] T ab432e62819d499eaaf3dd55481dd930 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
W20260709 13:21:37.290540  6614 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet ce4f062dcd314d43a63ca74067cb5ee3 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER failed with leader b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica b7ab4784c7344b939bc36f639286f377 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 16 leader_uuid: "cd75a17ab2604397adab03bb8b5fd75c" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } } }
I20260709 13:21:37.242463 14036 leader_election.cc:290] T d8cee0accdb8499c86d4414b72565a38 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 21 election: Requested vote from peers cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:21:37.309079  6801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "404190ce4ce94cecbfcb6ea9d1dd8626" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:21:37.313694  6807 raft_consensus.cc:1240] T 22ccee1b570c4ad3a57bd7aec085b1b4 P b7ab4784c7344b939bc36f639286f377 [term 17 FOLLOWER]: Rejecting Update request from peer ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 16. Current term is 17. Ops: []
I20260709 13:21:37.299818  7502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8cee0accdb8499c86d4414b72565a38" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb"
I20260709 13:21:37.296231 14058 raft_consensus.cc:2804] T 9b3759de40694069b13c0f8bd40e5709 P b7ab4784c7344b939bc36f639286f377 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:21:37.310866  6798 raft_consensus.cc:1240] T be1a92657f494cac8dd227d152f50151 P b7ab4784c7344b939bc36f639286f377 [term 25 FOLLOWER]: Rejecting Update request from peer ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 24. Current term is 25. Ops: []
I20260709 13:21:37.315745  7502 raft_consensus.cc:3060] T d8cee0accdb8499c86d4414b72565a38 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:21:37.317991  6725 raft_consensus.cc:1240] T 90d42e216d9741e190bca19a781291fd P ccd8a4c3bfe3413cb2ae219b09aea832 [term 21 FOLLOWER]: Rejecting Update request from peer b7ab4784c7344b939bc36f639286f377 for earlier term 20. Current term is 21. Ops: []
I20260709 13:21:37.320350  6730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b3759de40694069b13c0f8bd40e5709" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:21:37.324815  6728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab432e62819d499eaaf3dd55481dd930" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 25 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:21:37.325325  6724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22ccee1b570c4ad3a57bd7aec085b1b4" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:21:37.350732  6728 raft_consensus.cc:3060] T ab432e62819d499eaaf3dd55481dd930 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:21:37.331156 14230 leader_election.cc:290] T 95a75bfe094d4bdc963aba3f08dfcd25 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:21:37.246014 14156 leader_election.cc:290] T 404190ce4ce94cecbfcb6ea9d1dd8626 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 18 election: Requested vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:21:37.296312 14079 raft_consensus.cc:493] T 404190ce4ce94cecbfcb6ea9d1dd8626 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:37.334168 14102 raft_consensus.cc:2804] T ab432e62819d499eaaf3dd55481dd930 P b7ab4784c7344b939bc36f639286f377 [term 25 FOLLOWER]: Leader election won for term 25
I20260709 13:21:37.275736 14189 consensus_queue.cc:237] T be1a92657f494cac8dd227d152f50151 P 7ba59cc884714e8aa5f3f0ecaed84cbb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 23.17, Last appended by leader: 17, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:21:37.346413  6877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22ccee1b570c4ad3a57bd7aec085b1b4" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:21:37.361618  6877 raft_consensus.cc:3060] T 22ccee1b570c4ad3a57bd7aec085b1b4 P cd75a17ab2604397adab03bb8b5fd75c [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:21:37.347620  6875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8cee0accdb8499c86d4414b72565a38" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:21:37.362571  6875 raft_consensus.cc:3060] T d8cee0accdb8499c86d4414b72565a38 P cd75a17ab2604397adab03bb8b5fd75c [term 19 FOLLOWER]: Advancing to term 21
I20260709 13:21:37.327260  6732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6869f07b5a4885a0b99fbe60c3b175" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 25 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:21:37.363046  6879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6869f07b5a4885a0b99fbe60c3b175" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 25 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:21:37.364289  6879 raft_consensus.cc:2468] T bd6869f07b5a4885a0b99fbe60c3b175 P cd75a17ab2604397adab03bb8b5fd75c [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 24.
W20260709 13:21:37.360147  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 316670us
I20260709 13:21:37.368450  6801 raft_consensus.cc:2468] T 404190ce4ce94cecbfcb6ea9d1dd8626 P b7ab4784c7344b939bc36f639286f377 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 18.
I20260709 13:21:37.353581 13991 raft_consensus.cc:493] T f3f9c2e2bf644115957398fe4c9459db P b7ab4784c7344b939bc36f639286f377 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:37.379896 13991 raft_consensus.cc:515] T f3f9c2e2bf644115957398fe4c9459db P b7ab4784c7344b939bc36f639286f377 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:37.382660 13991 leader_election.cc:290] T f3f9c2e2bf644115957398fe4c9459db P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:21:37.383181 14234 raft_consensus.cc:493] T 95a75bfe094d4bdc963aba3f08dfcd25 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader cd75a17ab2604397adab03bb8b5fd75c)
I20260709 13:21:37.361956 14079 raft_consensus.cc:515] T 404190ce4ce94cecbfcb6ea9d1dd8626 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:21:37.386538 14079 leader_election.cc:290] T 404190ce4ce94cecbfcb6ea9d1dd8626 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:21:37.387120 14102 raft_consensus.cc:697] T ab432e62819d499eaaf3dd55481dd930 P b7ab4784c7344b939bc36f639286f377 [term 25 LEADER]: Becoming Leader. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
I20260709 13:21:37.388192 14102 consensus_queue.cc:237] T ab432e62819d499eaaf3dd55481dd930 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 23.13, Last appended by leader: 13, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:37.397979  6875 raft_consensus.cc:2468] T d8cee0accdb8499c86d4414b72565a38 P cd75a17ab2604397adab03bb8b5fd75c [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 21.
I20260709 13:21:37.335144 14058 raft_consensus.cc:493] T 9b3759de40694069b13c0f8bd40e5709 P b7ab4784c7344b939bc36f639286f377 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:37.404999  6732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a75bfe094d4bdc963aba3f08dfcd25" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:21:37.407943  7495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce4f062dcd314d43a63ca74067cb5ee3" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:21:37.409334  6725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6869f07b5a4885a0b99fbe60c3b175" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 25 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
W20260709 13:21:37.411026  6772 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 46103.1us
W20260709 13:21:37.411284  6697 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 58654.2us
I20260709 13:21:37.402597  6877 raft_consensus.cc:2468] T 22ccee1b570c4ad3a57bd7aec085b1b4 P cd75a17ab2604397adab03bb8b5fd75c [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 17.
I20260709 13:21:37.407958  6875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a75bfe094d4bdc963aba3f08dfcd25" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:21:37.418766  6801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a75bfe094d4bdc963aba3f08dfcd25" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:21:37.436515  6875 raft_consensus.cc:2468] T 95a75bfe094d4bdc963aba3f08dfcd25 P cd75a17ab2604397adab03bb8b5fd75c [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in term 17.
I20260709 13:21:37.422039  6772 leader_election.cc:304] T bd6869f07b5a4885a0b99fbe60c3b175 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:21:37.410876 14058 raft_consensus.cc:3060] T 9b3759de40694069b13c0f8bd40e5709 P b7ab4784c7344b939bc36f639286f377 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:21:37.424842  6731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f9c2e2bf644115957398fe4c9459db" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 23 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:21:37.439299  6772 leader_election.cc:304] T d8cee0accdb8499c86d4414b72565a38 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:21:37.441511  6772 leader_election.cc:304] T 22ccee1b570c4ad3a57bd7aec085b1b4 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:21:37.439062  6731 raft_consensus.cc:2468] T f3f9c2e2bf644115957398fe4c9459db P ccd8a4c3bfe3413cb2ae219b09aea832 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 22.
I20260709 13:21:37.443109 14057 raft_consensus.cc:2804] T d8cee0accdb8499c86d4414b72565a38 P b7ab4784c7344b939bc36f639286f377 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:21:37.443707 14057 raft_consensus.cc:697] T d8cee0accdb8499c86d4414b72565a38 P b7ab4784c7344b939bc36f639286f377 [term 21 LEADER]: Becoming Leader. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
I20260709 13:21:37.445124 14057 consensus_queue.cc:237] T d8cee0accdb8499c86d4414b72565a38 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.14, Last appended by leader: 14, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:21:37.454033 14098 raft_consensus.cc:2804] T 22ccee1b570c4ad3a57bd7aec085b1b4 P b7ab4784c7344b939bc36f639286f377 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:21:37.454706 14098 raft_consensus.cc:697] T 22ccee1b570c4ad3a57bd7aec085b1b4 P b7ab4784c7344b939bc36f639286f377 [term 17 LEADER]: Becoming Leader. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
I20260709 13:21:37.410601 14235 consensus_queue.cc:1059] T be1a92657f494cac8dd227d152f50151 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: INVALID_TERM, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.054s
I20260709 13:21:37.410257 14202 consensus_queue.cc:1048] T 34f36d59d88f40fe8a2805e604fc6c0a P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Connected to new peer: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 9, Time since last communication: 0.031s
I20260709 13:21:37.457806 14146 raft_consensus.cc:3055] T be1a92657f494cac8dd227d152f50151 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 24 LEADER]: Stepping down as leader of term 24
I20260709 13:21:37.458241 14146 raft_consensus.cc:740] T be1a92657f494cac8dd227d152f50151 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 24 LEADER]: Becoming Follower/Learner. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
I20260709 13:21:37.459028 14146 consensus_queue.cc:260] T be1a92657f494cac8dd227d152f50151 P ccd8a4c3bfe3413cb2ae219b09aea832 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 24.18, Last appended by leader: 18, Current term: 24, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:21:37.460511 14146 raft_consensus.cc:3060] T be1a92657f494cac8dd227d152f50151 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:21:37.462528  6730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a75bfe094d4bdc963aba3f08dfcd25" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:21:37.465730  6804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a75bfe094d4bdc963aba3f08dfcd25" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:21:37.427980  6798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6869f07b5a4885a0b99fbe60c3b175" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 25 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:21:37.427423  6695 leader_election.cc:304] T 404190ce4ce94cecbfcb6ea9d1dd8626 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
I20260709 13:21:37.473449  6727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "404190ce4ce94cecbfcb6ea9d1dd8626" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:21:37.474165  6727 raft_consensus.cc:2468] T 404190ce4ce94cecbfcb6ea9d1dd8626 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in term 18.
I20260709 13:21:37.429929  7495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "404190ce4ce94cecbfcb6ea9d1dd8626" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb"
I20260709 13:21:37.436607  6801 raft_consensus.cc:2468] T 95a75bfe094d4bdc963aba3f08dfcd25 P b7ab4784c7344b939bc36f639286f377 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 17.
W20260709 13:21:37.478065 14226 log.cc:927] Time spent T 4b8cacb381b746da8d0049b0a83b41dd P 7ba59cc884714e8aa5f3f0ecaed84cbb: Append to log took a long time: real 0.424s	user 0.004s	sys 0.001s
I20260709 13:21:37.383837 14234 raft_consensus.cc:515] T 95a75bfe094d4bdc963aba3f08dfcd25 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } attrs { replace: true } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
W20260709 13:21:37.480315  6695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 52956.9us
I20260709 13:21:37.481482  6805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "404190ce4ce94cecbfcb6ea9d1dd8626" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:21:37.490696  6805 raft_consensus.cc:2468] T 404190ce4ce94cecbfcb6ea9d1dd8626 P b7ab4784c7344b939bc36f639286f377 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in term 18.
I20260709 13:21:37.483371  7502 raft_consensus.cc:2468] T d8cee0accdb8499c86d4414b72565a38 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 21.
I20260709 13:21:37.485889  7495 raft_consensus.cc:2393] T 404190ce4ce94cecbfcb6ea9d1dd8626 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate ccd8a4c3bfe3413cb2ae219b09aea832 in current term 18: Already voted for candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in this term.
I20260709 13:21:37.482438 14176 raft_consensus.cc:2804] T 404190ce4ce94cecbfcb6ea9d1dd8626 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:21:37.496587  6728 raft_consensus.cc:2468] T ab432e62819d499eaaf3dd55481dd930 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 25.
I20260709 13:21:37.421541  6877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f9c2e2bf644115957398fe4c9459db" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 23 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:21:37.511950  6877 raft_consensus.cc:2468] T f3f9c2e2bf644115957398fe4c9459db P cd75a17ab2604397adab03bb8b5fd75c [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 21.
I20260709 13:21:37.461766 13991 raft_consensus.cc:2804] T bd6869f07b5a4885a0b99fbe60c3b175 P b7ab4784c7344b939bc36f639286f377 [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 13:21:37.519524  6772 leader_election.cc:304] T f3f9c2e2bf644115957398fe4c9459db P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
W20260709 13:21:37.534780  6697 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 100281us
I20260709 13:21:37.432209 13697 consensus_queue.cc:1059] T 22ccee1b570c4ad3a57bd7aec085b1b4 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.079s
I20260709 13:21:37.537528  6732 raft_consensus.cc:2468] T 95a75bfe094d4bdc963aba3f08dfcd25 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 16.
I20260709 13:21:37.541278  6697 leader_election.cc:304] T 90d42e216d9741e190bca19a781291fd P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:21:37.548432  6844 leader_election.cc:304] T 95a75bfe094d4bdc963aba3f08dfcd25 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:21:37.455627 14098 consensus_queue.cc:237] T 22ccee1b570c4ad3a57bd7aec085b1b4 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:37.551764  6697 leader_election.cc:304] T ce4f062dcd314d43a63ca74067cb5ee3 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:21:37.536494 13991 raft_consensus.cc:493] T bd6869f07b5a4885a0b99fbe60c3b175 P b7ab4784c7344b939bc36f639286f377 [term 24 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:37.540475 14038 raft_consensus.cc:2804] T f3f9c2e2bf644115957398fe4c9459db P b7ab4784c7344b939bc36f639286f377 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:21:37.538026 14176 raft_consensus.cc:697] T 404190ce4ce94cecbfcb6ea9d1dd8626 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 18 LEADER]: Becoming Leader. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
I20260709 13:21:37.577898 14160 raft_consensus.cc:3055] T 22ccee1b570c4ad3a57bd7aec085b1b4 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:21:37.579859 13886 raft_consensus.cc:2804] T 95a75bfe094d4bdc963aba3f08dfcd25 P cd75a17ab2604397adab03bb8b5fd75c [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:21:37.574710 14156 raft_consensus.cc:2749] T 90d42e216d9741e190bca19a781291fd P ccd8a4c3bfe3413cb2ae219b09aea832 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:21:37.579088 14148 raft_consensus.cc:2749] T ce4f062dcd314d43a63ca74067cb5ee3 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:21:37.583520 13991 raft_consensus.cc:3060] T bd6869f07b5a4885a0b99fbe60c3b175 P b7ab4784c7344b939bc36f639286f377 [term 24 FOLLOWER]: Advancing to term 25
W20260709 13:21:37.610690 14227 log.cc:927] Time spent T 1bf4668eeb70467fb3dc5a0289233b3c P ccd8a4c3bfe3413cb2ae219b09aea832: Append to log took a long time: real 0.524s	user 0.004s	sys 0.006s
I20260709 13:21:37.585078 14038 raft_consensus.cc:493] T f3f9c2e2bf644115957398fe4c9459db P b7ab4784c7344b939bc36f639286f377 [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:21:37.635532  7466 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 94552.4us
I20260709 13:21:37.596664 14160 raft_consensus.cc:740] T 22ccee1b570c4ad3a57bd7aec085b1b4 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
I20260709 13:21:37.633950 13886 raft_consensus.cc:493] T 95a75bfe094d4bdc963aba3f08dfcd25 P cd75a17ab2604397adab03bb8b5fd75c [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:37.643078  7466 leader_election.cc:304] T 404190ce4ce94cecbfcb6ea9d1dd8626 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
I20260709 13:21:37.642710 14038 raft_consensus.cc:3060] T f3f9c2e2bf644115957398fe4c9459db P b7ab4784c7344b939bc36f639286f377 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:21:37.682119  7496 raft_consensus.cc:1240] T be1a92657f494cac8dd227d152f50151 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 25 LEADER]: Rejecting Update request from peer ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 24. Current term is 25. Ops: []
I20260709 13:21:37.589105 14236 consensus_queue.cc:1048] T 22ccee1b570c4ad3a57bd7aec085b1b4 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.070s
I20260709 13:21:37.682029  7466 leader_election.cc:304] T 95a75bfe094d4bdc963aba3f08dfcd25 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:21:37.677477 13886 raft_consensus.cc:3060] T 95a75bfe094d4bdc963aba3f08dfcd25 P cd75a17ab2604397adab03bb8b5fd75c [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:21:37.744416  6805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a75bfe094d4bdc963aba3f08dfcd25" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:21:37.746157  6805 raft_consensus.cc:2393] T 95a75bfe094d4bdc963aba3f08dfcd25 P b7ab4784c7344b939bc36f639286f377 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ccd8a4c3bfe3413cb2ae219b09aea832 in current term 17: Already voted for candidate b7ab4784c7344b939bc36f639286f377 in this term.
I20260709 13:21:37.685952 14189 raft_consensus.cc:2804] T 404190ce4ce94cecbfcb6ea9d1dd8626 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:21:37.730703 14162 raft_consensus.cc:493] T bd6869f07b5a4885a0b99fbe60c3b175 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader cd75a17ab2604397adab03bb8b5fd75c)
I20260709 13:21:37.754320 14189 raft_consensus.cc:493] T 404190ce4ce94cecbfcb6ea9d1dd8626 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:37.746999 14249 raft_consensus.cc:2749] T 95a75bfe094d4bdc963aba3f08dfcd25 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:21:37.771032 14189 raft_consensus.cc:3060] T 404190ce4ce94cecbfcb6ea9d1dd8626 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:21:37.793226 14224 log.cc:927] Time spent T f58dc08b12a2494bb9a1372837970ca2 P b7ab4784c7344b939bc36f639286f377: Append to log took a long time: real 0.683s	user 0.004s	sys 0.000s
I20260709 13:21:37.795590  6799 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:32966 (request call id 1897) took 1073 ms. Trace:
I20260709 13:21:37.773386 14162 raft_consensus.cc:515] T bd6869f07b5a4885a0b99fbe60c3b175 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:37.796015  6799 rpcz_store.cc:276] 0709 13:21:36.722563 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:21:36.722700 (+   137us) service_pool.cc:224] Handling call
0709 13:21:36.723140 (+   440us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:21:36.749848 (+ 26708us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:21:36.749887 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:21:36.750391 (+   504us) log.cc:844] Serialized 26 byte log entry
0709 13:21:36.935404 (+185013us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:21:36.935449 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:21:36.935514 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:21:37.782866 (+847352us) spinlock_profiling.cc:243] Waited 28.2 ms on lock 0x7b4400022b4c. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0c745db1 00007fcc0c7e3c85 00007fcc0c7e46a2 00007fcc0f5561db 00007fcc0f551aaf 00007fcc0f54586e 00007fcc0f544bb6 00007fcc0f5447d8 00007fcc0f54e221 00007fcc0f54e1d9 00007fcc0f54e169
0709 13:21:37.795219 (+ 12353us) raft_consensus.cc:1685] finished
0709 13:21:37.795247 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:21:37.795514 (+   267us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":53380,"raft.queue_time_us":28964,"raft.run_cpu_time_us":159,"raft.run_wall_time_us":2420,"spinlock_wait_cycles":66835584,"thread_start_us":184608,"threads_started":1,"wal-append.queue_time_us":262141}
I20260709 13:21:37.798946 14162 leader_election.cc:290] T bd6869f07b5a4885a0b99fbe60c3b175 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:21:37.804718  6805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6869f07b5a4885a0b99fbe60c3b175" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 24 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:21:37.707083 14176 consensus_queue.cc:237] T 404190ce4ce94cecbfcb6ea9d1dd8626 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.14, Last appended by leader: 14, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
W20260709 13:21:37.808516  6697 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 126502us
I20260709 13:21:37.806375 13991 raft_consensus.cc:515] T bd6869f07b5a4885a0b99fbe60c3b175 P b7ab4784c7344b939bc36f639286f377 [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:37.820495  6798 raft_consensus.cc:2393] T bd6869f07b5a4885a0b99fbe60c3b175 P b7ab4784c7344b939bc36f639286f377 [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c in current term 25: Already voted for candidate b7ab4784c7344b939bc36f639286f377 in this term.
I20260709 13:21:37.830821 14058 raft_consensus.cc:515] T 9b3759de40694069b13c0f8bd40e5709 P b7ab4784c7344b939bc36f639286f377 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:37.830828 13886 raft_consensus.cc:515] T 95a75bfe094d4bdc963aba3f08dfcd25 P cd75a17ab2604397adab03bb8b5fd75c [term 18 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } attrs { replace: true } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:21:37.839414 13886 leader_election.cc:290] T 95a75bfe094d4bdc963aba3f08dfcd25 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 18 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:21:37.849088 13991 leader_election.cc:290] T bd6869f07b5a4885a0b99fbe60c3b175 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 25 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
W20260709 13:21:37.850310 14245 log.cc:927] Time spent T ab432e62819d499eaaf3dd55481dd930 P b7ab4784c7344b939bc36f639286f377: Append to log took a long time: real 0.174s	user 0.001s	sys 0.000s
W20260709 13:21:37.851872 14243 log.cc:927] Time spent T 34f36d59d88f40fe8a2805e604fc6c0a P b7ab4784c7344b939bc36f639286f377: Append to log took a long time: real 0.144s	user 0.001s	sys 0.000s
I20260709 13:21:37.886821  7496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a75bfe094d4bdc963aba3f08dfcd25" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb"
I20260709 13:21:37.887742  7496 raft_consensus.cc:3060] T 95a75bfe094d4bdc963aba3f08dfcd25 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:21:37.861905 14256 log.cc:927] Time spent T c4db81d9d329422bb3b4160ca4ac2d1d P cd75a17ab2604397adab03bb8b5fd75c: Append to log took a long time: real 0.061s	user 0.001s	sys 0.000s
W20260709 13:21:37.891813  6696 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:21:37.891250  7466 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 171451us
W20260709 13:21:37.893517  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 92902us
I20260709 13:21:37.895735  6802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a75bfe094d4bdc963aba3f08dfcd25" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:21:37.896440  6802 raft_consensus.cc:3060] T 95a75bfe094d4bdc963aba3f08dfcd25 P b7ab4784c7344b939bc36f639286f377 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:21:37.898309  6807 raft_consensus.cc:1275] T be1a92657f494cac8dd227d152f50151 P b7ab4784c7344b939bc36f639286f377 [term 25 FOLLOWER]: Refusing update from remote peer 7ba59cc884714e8aa5f3f0ecaed84cbb: Log matching property violated. Preceding OpId in replica: term: 23 index: 17. Preceding OpId from leader: term: 25 index: 18. (index mismatch)
I20260709 13:21:37.861701 14234 leader_election.cc:290] T 95a75bfe094d4bdc963aba3f08dfcd25 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:21:37.914093  6724 raft_consensus.cc:1275] T be1a92657f494cac8dd227d152f50151 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 25 FOLLOWER]: Refusing update from remote peer 7ba59cc884714e8aa5f3f0ecaed84cbb: Log matching property violated. Preceding OpId in replica: term: 24 index: 18. Preceding OpId from leader: term: 25 index: 18. (term mismatch)
I20260709 13:21:37.921240  6724 pending_rounds.cc:85] T be1a92657f494cac8dd227d152f50151 P ccd8a4c3bfe3413cb2ae219b09aea832: Aborting all ops after (but not including) 17
I20260709 13:21:37.913178  7495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a75bfe094d4bdc963aba3f08dfcd25" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:21:37.921552  6724 pending_rounds.cc:107] T be1a92657f494cac8dd227d152f50151 P ccd8a4c3bfe3413cb2ae219b09aea832: Aborting uncommitted NO_OP operation due to leader change: 24.18
I20260709 13:21:37.921880  6724 raft_consensus.cc:2889] T be1a92657f494cac8dd227d152f50151 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 25 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:21:37.909185  6723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a75bfe094d4bdc963aba3f08dfcd25" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:21:37.923277  6723 raft_consensus.cc:3060] T 95a75bfe094d4bdc963aba3f08dfcd25 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 16 FOLLOWER]: Advancing to term 18
I20260709 13:21:37.908383  6732 raft_consensus.cc:1275] T 3fa34c08b205435dba97346991aa1f92 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 27 FOLLOWER]: Refusing update from remote peer 7ba59cc884714e8aa5f3f0ecaed84cbb: Log matching property violated. Preceding OpId in replica: term: 25 index: 18. Preceding OpId from leader: term: 27 index: 19. (index mismatch)
I20260709 13:21:37.938670 14011 raft_consensus.cc:493] T 24ee15416e3145beaa1b8183453729a3 P cd75a17ab2604397adab03bb8b5fd75c [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 7ba59cc884714e8aa5f3f0ecaed84cbb)
I20260709 13:21:37.905295  6802 raft_consensus.cc:2468] T 95a75bfe094d4bdc963aba3f08dfcd25 P b7ab4784c7344b939bc36f639286f377 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 18.
I20260709 13:21:37.939500 14011 raft_consensus.cc:515] T 24ee15416e3145beaa1b8183453729a3 P cd75a17ab2604397adab03bb8b5fd75c [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:21:37.941089 14058 leader_election.cc:290] T 9b3759de40694069b13c0f8bd40e5709 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 20 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:21:37.942801 14011 leader_election.cc:290] T 24ee15416e3145beaa1b8183453729a3 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:21:37.944684 14038 raft_consensus.cc:515] T f3f9c2e2bf644115957398fe4c9459db P b7ab4784c7344b939bc36f639286f377 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:37.947494 14038 leader_election.cc:290] T f3f9c2e2bf644115957398fe4c9459db P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 23 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:21:37.949621  6844 leader_election.cc:304] T bd6869f07b5a4885a0b99fbe60c3b175 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:21:37.951314  6879 raft_consensus.cc:1240] T 22ccee1b570c4ad3a57bd7aec085b1b4 P cd75a17ab2604397adab03bb8b5fd75c [term 17 FOLLOWER]: Rejecting Update request from peer ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 16. Current term is 17. Ops: [16.11-16.11]
I20260709 13:21:37.952689 13588 raft_consensus.cc:3060] T bd6869f07b5a4885a0b99fbe60c3b175 P cd75a17ab2604397adab03bb8b5fd75c [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:21:37.953418  6879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a75bfe094d4bdc963aba3f08dfcd25" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:21:37.954183  6879 raft_consensus.cc:2368] T 95a75bfe094d4bdc963aba3f08dfcd25 P cd75a17ab2604397adab03bb8b5fd75c [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 17. Current term is 18.
I20260709 13:21:37.955205 14189 raft_consensus.cc:515] T 404190ce4ce94cecbfcb6ea9d1dd8626 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:21:37.957329 14189 leader_election.cc:290] T 404190ce4ce94cecbfcb6ea9d1dd8626 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 19 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:21:37.961638  6879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6869f07b5a4885a0b99fbe60c3b175" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 24 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:21:37.967303  7496 raft_consensus.cc:2468] T 95a75bfe094d4bdc963aba3f08dfcd25 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 18.
I20260709 13:21:37.973701  7495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24ee15416e3145beaa1b8183453729a3" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:21:37.985793 13588 raft_consensus.cc:2749] T bd6869f07b5a4885a0b99fbe60c3b175 P cd75a17ab2604397adab03bb8b5fd75c [term 25 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:21:37.987690  6879 raft_consensus.cc:2368] T bd6869f07b5a4885a0b99fbe60c3b175 P cd75a17ab2604397adab03bb8b5fd75c [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 24. Current term is 25.
I20260709 13:21:37.990236  6732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "404190ce4ce94cecbfcb6ea9d1dd8626" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:21:37.997294  6732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24ee15416e3145beaa1b8183453729a3" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:21:37.998441 14174 raft_consensus.cc:493] T 9e326172347f45e99a0d482b5d8ef768 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader cd75a17ab2604397adab03bb8b5fd75c)
I20260709 13:21:37.998998  6805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "404190ce4ce94cecbfcb6ea9d1dd8626" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:21:37.999205 14174 raft_consensus.cc:515] T 9e326172347f45e99a0d482b5d8ef768 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:38.001271  6723 raft_consensus.cc:2468] T 95a75bfe094d4bdc963aba3f08dfcd25 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 18.
I20260709 13:21:37.999688  6805 raft_consensus.cc:3060] T 404190ce4ce94cecbfcb6ea9d1dd8626 P b7ab4784c7344b939bc36f639286f377 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:21:38.004472  6697 leader_election.cc:304] T 95a75bfe094d4bdc963aba3f08dfcd25 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, b7ab4784c7344b939bc36f639286f377
I20260709 13:21:38.007834  6846 leader_election.cc:304] T 95a75bfe094d4bdc963aba3f08dfcd25 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:21:38.009500  6799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e326172347f45e99a0d482b5d8ef768" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:21:38.011947 13588 raft_consensus.cc:2804] T 95a75bfe094d4bdc963aba3f08dfcd25 P cd75a17ab2604397adab03bb8b5fd75c [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:21:38.012756 13588 raft_consensus.cc:697] T 95a75bfe094d4bdc963aba3f08dfcd25 P cd75a17ab2604397adab03bb8b5fd75c [term 18 LEADER]: Becoming Leader. State: Replica: cd75a17ab2604397adab03bb8b5fd75c, State: Running, Role: LEADER
I20260709 13:21:38.013805 13588 consensus_queue.cc:237] T 95a75bfe094d4bdc963aba3f08dfcd25 P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 18, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } attrs { replace: true } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:21:38.001963 14174 leader_election.cc:290] T 9e326172347f45e99a0d482b5d8ef768 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:21:38.014379  6875 raft_consensus.cc:1275] T 3fa34c08b205435dba97346991aa1f92 P cd75a17ab2604397adab03bb8b5fd75c [term 27 FOLLOWER]: Refusing update from remote peer 7ba59cc884714e8aa5f3f0ecaed84cbb: Log matching property violated. Preceding OpId in replica: term: 25 index: 18. Preceding OpId from leader: term: 27 index: 19. (index mismatch)
I20260709 13:21:38.021972  6877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e326172347f45e99a0d482b5d8ef768" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:21:38.022974  6697 leader_election.cc:400] T 95a75bfe094d4bdc963aba3f08dfcd25 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 17 pre-election: Vote denied by peer cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931) with higher term. Message: Invalid argument: T 95a75bfe094d4bdc963aba3f08dfcd25 P cd75a17ab2604397adab03bb8b5fd75c [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 17. Current term is 18.
I20260709 13:21:38.030467 14146 raft_consensus.cc:2749] T 95a75bfe094d4bdc963aba3f08dfcd25 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 18 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:21:38.035668 14174 consensus_queue.cc:1059] T 22ccee1b570c4ad3a57bd7aec085b1b4 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: INVALID_TERM, Last received: 15.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.013s
I20260709 13:21:38.022018 14193 consensus_queue.cc:1048] T be1a92657f494cac8dd227d152f50151 P 7ba59cc884714e8aa5f3f0ecaed84cbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.009s
I20260709 13:21:38.051698  6805 raft_consensus.cc:2468] T 404190ce4ce94cecbfcb6ea9d1dd8626 P b7ab4784c7344b939bc36f639286f377 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in term 19.
I20260709 13:21:38.055527  6844 leader_election.cc:304] T 24ee15416e3145beaa1b8183453729a3 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:21:38.057332  7466 leader_election.cc:304] T 404190ce4ce94cecbfcb6ea9d1dd8626 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, b7ab4784c7344b939bc36f639286f377; no voters: ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:21:38.062419  6878 raft_consensus.cc:1275] T d8cee0accdb8499c86d4414b72565a38 P cd75a17ab2604397adab03bb8b5fd75c [term 21 FOLLOWER]: Refusing update from remote peer b7ab4784c7344b939bc36f639286f377: Log matching property violated. Preceding OpId in replica: term: 19 index: 14. Preceding OpId from leader: term: 21 index: 15. (index mismatch)
I20260709 13:21:38.064213  6875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6869f07b5a4885a0b99fbe60c3b175" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 25 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:21:38.065464  6875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b3759de40694069b13c0f8bd40e5709" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:21:38.066185  6875 raft_consensus.cc:3060] T 9b3759de40694069b13c0f8bd40e5709 P cd75a17ab2604397adab03bb8b5fd75c [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:21:38.072278  6878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f9c2e2bf644115957398fe4c9459db" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 23 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:21:38.082346  6878 raft_consensus.cc:3060] T f3f9c2e2bf644115957398fe4c9459db P cd75a17ab2604397adab03bb8b5fd75c [term 21 FOLLOWER]: Advancing to term 23
I20260709 13:21:38.070262  6697 leader_election.cc:304] T 9e326172347f45e99a0d482b5d8ef768 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:21:38.090638  7502 raft_consensus.cc:1275] T d8cee0accdb8499c86d4414b72565a38 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 21 FOLLOWER]: Refusing update from remote peer b7ab4784c7344b939bc36f639286f377: Log matching property violated. Preceding OpId in replica: term: 19 index: 14. Preceding OpId from leader: term: 21 index: 15. (index mismatch)
I20260709 13:21:38.045341 14183 consensus_queue.cc:1048] T 3fa34c08b205435dba97346991aa1f92 P 7ba59cc884714e8aa5f3f0ecaed84cbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 18, Time since last communication: 0.039s
I20260709 13:21:38.098732  6875 raft_consensus.cc:2468] T 9b3759de40694069b13c0f8bd40e5709 P cd75a17ab2604397adab03bb8b5fd75c [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 20.
I20260709 13:21:38.103825  6872 raft_consensus.cc:1275] T ab432e62819d499eaaf3dd55481dd930 P cd75a17ab2604397adab03bb8b5fd75c [term 25 FOLLOWER]: Refusing update from remote peer b7ab4784c7344b939bc36f639286f377: Log matching property violated. Preceding OpId in replica: term: 23 index: 13. Preceding OpId from leader: term: 25 index: 14. (index mismatch)
I20260709 13:21:38.069069 13886 raft_consensus.cc:2749] T 24ee15416e3145beaa1b8183453729a3 P cd75a17ab2604397adab03bb8b5fd75c [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 13:21:38.113739 14266 log.cc:927] Time spent T 34f36d59d88f40fe8a2805e604fc6c0a P cd75a17ab2604397adab03bb8b5fd75c: Append to log took a long time: real 0.080s	user 0.001s	sys 0.000s
I20260709 13:21:38.114845  6772 leader_election.cc:304] T 9b3759de40694069b13c0f8bd40e5709 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:21:38.115624 14058 consensus_queue.cc:1048] T ab432e62819d499eaaf3dd55481dd930 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:21:38.116281 14017 raft_consensus.cc:2804] T 9b3759de40694069b13c0f8bd40e5709 P b7ab4784c7344b939bc36f639286f377 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:21:38.116899 14017 raft_consensus.cc:697] T 9b3759de40694069b13c0f8bd40e5709 P b7ab4784c7344b939bc36f639286f377 [term 20 LEADER]: Becoming Leader. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
I20260709 13:21:38.118022 14017 consensus_queue.cc:237] T 9b3759de40694069b13c0f8bd40e5709 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 12, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:38.120338 13914 consensus_queue.cc:1048] T d8cee0accdb8499c86d4414b72565a38 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:21:38.056492 14260 consensus_queue.cc:1048] T be1a92657f494cac8dd227d152f50151 P 7ba59cc884714e8aa5f3f0ecaed84cbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.068s
I20260709 13:21:38.096745 14241 raft_consensus.cc:2804] T 404190ce4ce94cecbfcb6ea9d1dd8626 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:21:38.145102 14150 raft_consensus.cc:493] T 9b3759de40694069b13c0f8bd40e5709 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader cd75a17ab2604397adab03bb8b5fd75c)
I20260709 13:21:38.145917 14150 raft_consensus.cc:515] T 9b3759de40694069b13c0f8bd40e5709 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:38.160440 14189 consensus_queue.cc:1048] T 3fa34c08b205435dba97346991aa1f92 P 7ba59cc884714e8aa5f3f0ecaed84cbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 18, Time since last communication: 0.001s
I20260709 13:21:38.109861 14162 raft_consensus.cc:2749] T 9e326172347f45e99a0d482b5d8ef768 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:21:38.176600  6725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6869f07b5a4885a0b99fbe60c3b175" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 25 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:21:38.177412  6725 raft_consensus.cc:3060] T bd6869f07b5a4885a0b99fbe60c3b175 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 23 FOLLOWER]: Advancing to term 25
I20260709 13:21:38.179436  6730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f9c2e2bf644115957398fe4c9459db" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 23 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:21:38.180449  6802 raft_consensus.cc:1240] T 22ccee1b570c4ad3a57bd7aec085b1b4 P b7ab4784c7344b939bc36f639286f377 [term 17 LEADER]: Rejecting Update request from peer ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 16. Current term is 17. Ops: [16.11-16.11]
I20260709 13:21:38.180501  6724 raft_consensus.cc:1275] T ab432e62819d499eaaf3dd55481dd930 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 25 FOLLOWER]: Refusing update from remote peer b7ab4784c7344b939bc36f639286f377: Log matching property violated. Preceding OpId in replica: term: 23 index: 13. Preceding OpId from leader: term: 25 index: 14. (index mismatch)
I20260709 13:21:38.181356  6730 raft_consensus.cc:3060] T f3f9c2e2bf644115957398fe4c9459db P ccd8a4c3bfe3413cb2ae219b09aea832 [term 22 FOLLOWER]: Advancing to term 23
W20260709 13:21:38.185323  7466 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 128103us
I20260709 13:21:38.186474  6732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b3759de40694069b13c0f8bd40e5709" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:21:38.195596  6725 raft_consensus.cc:2468] T bd6869f07b5a4885a0b99fbe60c3b175 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 25.
W20260709 13:21:38.202011  7468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 93372.8us
W20260709 13:21:38.212975  6697 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 56784.8us
I20260709 13:21:38.213124  6730 raft_consensus.cc:2468] T f3f9c2e2bf644115957398fe4c9459db P ccd8a4c3bfe3413cb2ae219b09aea832 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 23.
I20260709 13:21:38.213979  6878 raft_consensus.cc:2468] T f3f9c2e2bf644115957398fe4c9459db P cd75a17ab2604397adab03bb8b5fd75c [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 23.
I20260709 13:21:38.223129 14163 consensus_queue.cc:1059] T 22ccee1b570c4ad3a57bd7aec085b1b4 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: INVALID_TERM, Last received: 15.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.011s
I20260709 13:21:38.239274 14163 consensus_queue.cc:1243] T 22ccee1b570c4ad3a57bd7aec085b1b4 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Peer b7ab4784c7344b939bc36f639286f377 log is divergent from this leader: its last log entry 17.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 10
I20260709 13:21:38.229085 14186 consensus_queue.cc:1048] T ab432e62819d499eaaf3dd55481dd930 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.006s
I20260709 13:21:38.230250  6770 leader_election.cc:304] T bd6869f07b5a4885a0b99fbe60c3b175 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:21:38.243921 14058 raft_consensus.cc:2804] T bd6869f07b5a4885a0b99fbe60c3b175 P b7ab4784c7344b939bc36f639286f377 [term 25 FOLLOWER]: Leader election won for term 25
I20260709 13:21:38.243790  6770 leader_election.cc:304] T f3f9c2e2bf644115957398fe4c9459db P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
I20260709 13:21:38.247107  6732 raft_consensus.cc:3060] T 9b3759de40694069b13c0f8bd40e5709 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 18 FOLLOWER]: Advancing to term 20
I20260709 13:21:38.255324  6878 raft_consensus.cc:1240] T 22ccee1b570c4ad3a57bd7aec085b1b4 P cd75a17ab2604397adab03bb8b5fd75c [term 17 FOLLOWER]: Rejecting Update request from peer ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 16. Current term is 17. Ops: [16.11-16.11]
I20260709 13:21:38.244980 14058 raft_consensus.cc:697] T bd6869f07b5a4885a0b99fbe60c3b175 P b7ab4784c7344b939bc36f639286f377 [term 25 LEADER]: Becoming Leader. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
I20260709 13:21:38.250990 14253 raft_consensus.cc:2804] T f3f9c2e2bf644115957398fe4c9459db P b7ab4784c7344b939bc36f639286f377 [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:21:38.250527 14241 raft_consensus.cc:697] T 404190ce4ce94cecbfcb6ea9d1dd8626 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 19 LEADER]: Becoming Leader. State: Replica: 7ba59cc884714e8aa5f3f0ecaed84cbb, State: Running, Role: LEADER
I20260709 13:21:38.288442 14160 consensus_queue.cc:260] T 22ccee1b570c4ad3a57bd7aec085b1b4 P ccd8a4c3bfe3413cb2ae219b09aea832 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.11, Last appended by leader: 11, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:38.290987 14160 raft_consensus.cc:3060] T 22ccee1b570c4ad3a57bd7aec085b1b4 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:21:38.298533 14150 leader_election.cc:290] T 9b3759de40694069b13c0f8bd40e5709 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:21:38.307832 14058 consensus_queue.cc:237] T bd6869f07b5a4885a0b99fbe60c3b175 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 23.12, Last appended by leader: 12, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:38.326215  6802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b3759de40694069b13c0f8bd40e5709" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:21:38.365895  6732 raft_consensus.cc:2468] T 9b3759de40694069b13c0f8bd40e5709 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 20.
I20260709 13:21:38.398576  6697 leader_election.cc:400] T bd6869f07b5a4885a0b99fbe60c3b175 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 24 pre-election: Vote denied by peer cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931) with higher term. Message: Invalid argument: T bd6869f07b5a4885a0b99fbe60c3b175 P cd75a17ab2604397adab03bb8b5fd75c [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 24. Current term is 25.
I20260709 13:21:38.402653  6697 leader_election.cc:403] T bd6869f07b5a4885a0b99fbe60c3b175 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 24 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:21:38.413617  6881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b3759de40694069b13c0f8bd40e5709" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:21:38.414559  6881 raft_consensus.cc:2368] T 9b3759de40694069b13c0f8bd40e5709 P cd75a17ab2604397adab03bb8b5fd75c [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 19. Current term is 20.
I20260709 13:21:38.401762 14253 raft_consensus.cc:697] T f3f9c2e2bf644115957398fe4c9459db P b7ab4784c7344b939bc36f639286f377 [term 23 LEADER]: Becoming Leader. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
I20260709 13:21:38.421226 14253 consensus_queue.cc:237] T f3f9c2e2bf644115957398fe4c9459db P b7ab4784c7344b939bc36f639286f377 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 21.14, Last appended by leader: 14, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:38.424351 14148 raft_consensus.cc:2749] T bd6869f07b5a4885a0b99fbe60c3b175 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 25 FOLLOWER]: Leader pre-election lost for term 24. Reason: Vote denied by peer cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931) with higher term. Message: Invalid argument: T bd6869f07b5a4885a0b99fbe60c3b175 P cd75a17ab2604397adab03bb8b5fd75c [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 24. Current term is 25.
I20260709 13:21:38.386373 13996 consensus_queue.cc:1048] T d8cee0accdb8499c86d4414b72565a38 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.039s
I20260709 13:21:38.436293  6874 raft_consensus.cc:1275] T 22ccee1b570c4ad3a57bd7aec085b1b4 P cd75a17ab2604397adab03bb8b5fd75c [term 17 FOLLOWER]: Refusing update from remote peer b7ab4784c7344b939bc36f639286f377: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:21:38.466926 13914 consensus_queue.cc:1048] T 22ccee1b570c4ad3a57bd7aec085b1b4 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:21:38.474763  6802 raft_consensus.cc:1240] T 404190ce4ce94cecbfcb6ea9d1dd8626 P b7ab4784c7344b939bc36f639286f377 [term 19 FOLLOWER]: Rejecting Update request from peer ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 18. Current term is 19. Ops: []
I20260709 13:21:38.472708  6621 catalog_manager.cc:5697] T 427c124d773f483294511e80fe340075 P 7ba59cc884714e8aa5f3f0ecaed84cbb reported cstate change: term changed from 14 to 18. New cstate: current_term: 18 leader_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:21:38.479198  6621 catalog_manager.cc:5697] T d8cee0accdb8499c86d4414b72565a38 P 7ba59cc884714e8aa5f3f0ecaed84cbb reported cstate change: term changed from 16 to 19, leader changed from 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68) to b7ab4784c7344b939bc36f639286f377 (127.5.126.66). New cstate: current_term: 19 leader_uuid: "b7ab4784c7344b939bc36f639286f377" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } } }
I20260709 13:21:38.483566  6621 catalog_manager.cc:5697] T 4f00a2e87e56452083b759f60d461ee3 P 7ba59cc884714e8aa5f3f0ecaed84cbb reported cstate change: term changed from 17 to 20, leader changed from 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68) to b7ab4784c7344b939bc36f639286f377 (127.5.126.66). New cstate: current_term: 20 leader_uuid: "b7ab4784c7344b939bc36f639286f377" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } } }
I20260709 13:21:38.488653  6621 catalog_manager.cc:5697] T 24ee15416e3145beaa1b8183453729a3 P 7ba59cc884714e8aa5f3f0ecaed84cbb reported cstate change: term changed from 19 to 20, leader changed from cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67) to 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68). New cstate: current_term: 20 leader_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:21:38.491088  7502 raft_consensus.cc:1275] T 95a75bfe094d4bdc963aba3f08dfcd25 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 18 FOLLOWER]: Refusing update from remote peer cd75a17ab2604397adab03bb8b5fd75c: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 13:21:38.490484  6621 catalog_manager.cc:5697] T 7a734b5ab7834e05a8c422208acc58b1 P 7ba59cc884714e8aa5f3f0ecaed84cbb reported cstate change: config changed from index 6 to 9, term changed from 19 to 21, leader changed from b7ab4784c7344b939bc36f639286f377 (127.5.126.66) to <none>, 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68) changed from NON_VOTER to VOTER, no longer has a pending config: VOTER ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65), VOTER b7ab4784c7344b939bc36f639286f377 (127.5.126.66), VOTER cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67), VOTER 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68). New cstate: current_term: 21 committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } attrs { replace: true } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } } }
I20260709 13:21:38.497251 13998 consensus_queue.cc:1048] T 95a75bfe094d4bdc963aba3f08dfcd25 P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:21:38.487047 14233 consensus_queue.cc:1059] T 404190ce4ce94cecbfcb6ea9d1dd8626 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: INVALID_TERM, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:21:38.502411  6723 raft_consensus.cc:1275] T 95a75bfe094d4bdc963aba3f08dfcd25 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 18 FOLLOWER]: Refusing update from remote peer cd75a17ab2604397adab03bb8b5fd75c: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 13:21:38.500504  6621 catalog_manager.cc:5697] T 95a75bfe094d4bdc963aba3f08dfcd25 P 7ba59cc884714e8aa5f3f0ecaed84cbb reported cstate change: config changed from index 7 to 9, term changed from 13 to 16, leader changed from ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65) to cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68) changed from NON_VOTER to VOTER. New cstate: current_term: 16 leader_uuid: "cd75a17ab2604397adab03bb8b5fd75c" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } attrs { replace: true } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } } }
I20260709 13:21:38.517756  6621 catalog_manager.cc:5697] T b3f13b31a1f84f0d89d007eadd57924c P 7ba59cc884714e8aa5f3f0ecaed84cbb reported cstate change: term changed from 14 to 16, leader changed from ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65) to 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68). New cstate: current_term: 16 leader_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:21:38.519377  6621 catalog_manager.cc:5697] T 7ba5dac66ab5497e9e336f2a3c28cda5 P 7ba59cc884714e8aa5f3f0ecaed84cbb reported cstate change: term changed from 19 to 20, leader changed from 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68) to cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67). New cstate: current_term: 20 leader_uuid: "cd75a17ab2604397adab03bb8b5fd75c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } } }
I20260709 13:21:38.528963  6621 catalog_manager.cc:5697] T 3fa34c08b205435dba97346991aa1f92 P 7ba59cc884714e8aa5f3f0ecaed84cbb reported cstate change: term changed from 21 to 23. New cstate: current_term: 23 leader_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:21:38.534140  6697 leader_election.cc:400] T 9b3759de40694069b13c0f8bd40e5709 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 19 pre-election: Vote denied by peer cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931) with higher term. Message: Invalid argument: T 9b3759de40694069b13c0f8bd40e5709 P cd75a17ab2604397adab03bb8b5fd75c [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 19. Current term is 20.
I20260709 13:21:38.534508  6697 leader_election.cc:403] T 9b3759de40694069b13c0f8bd40e5709 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 19 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:21:38.522838 14174 raft_consensus.cc:3055] T 404190ce4ce94cecbfcb6ea9d1dd8626 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:21:38.530491  6621 catalog_manager.cc:5697] T 17587d6730594da4a56fa13a353232a1 P 7ba59cc884714e8aa5f3f0ecaed84cbb reported cstate change: term changed from 23 to 26, leader changed from b7ab4784c7344b939bc36f639286f377 (127.5.126.66) to 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68). New cstate: current_term: 26 leader_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:21:38.525028 14066 consensus_queue.cc:1048] T 95a75bfe094d4bdc963aba3f08dfcd25 P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Connected to new peer: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.017s
I20260709 13:21:38.537992 14174 raft_consensus.cc:740] T 404190ce4ce94cecbfcb6ea9d1dd8626 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
I20260709 13:21:38.540167 14241 consensus_queue.cc:237] T 404190ce4ce94cecbfcb6ea9d1dd8626 P 7ba59cc884714e8aa5f3f0ecaed84cbb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.14, Last appended by leader: 14, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
W20260709 13:21:38.580797  6626 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:53214 (request call id 180) took 44500 ms (client timeout 15000 ms). Trace:
I20260709 13:21:38.582949  6621 catalog_manager.cc:5697] T 4b8cacb381b746da8d0049b0a83b41dd P 7ba59cc884714e8aa5f3f0ecaed84cbb reported cstate change: term changed from 18 to 20, leader changed from ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65) to cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67). New cstate: current_term: 20 leader_uuid: "cd75a17ab2604397adab03bb8b5fd75c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } } }
I20260709 13:21:38.559456 14252 raft_consensus.cc:2749] T 9b3759de40694069b13c0f8bd40e5709 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 20 FOLLOWER]: Leader pre-election lost for term 19. Reason: Vote denied by peer cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931) with higher term. Message: Invalid argument: T 9b3759de40694069b13c0f8bd40e5709 P cd75a17ab2604397adab03bb8b5fd75c [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 19. Current term is 20.
I20260709 13:21:38.585350  6621 catalog_manager.cc:5697] T ce4f062dcd314d43a63ca74067cb5ee3 P 7ba59cc884714e8aa5f3f0ecaed84cbb reported cstate change: config changed from index 3 to 11, VOTER ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65) evicted. New cstate: current_term: 15 leader_uuid: "b7ab4784c7344b939bc36f639286f377" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } } }
W20260709 13:21:38.614660  6770 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 350752us
I20260709 13:21:38.616536  6621 catalog_manager.cc:5697] T 404190ce4ce94cecbfcb6ea9d1dd8626 P 7ba59cc884714e8aa5f3f0ecaed84cbb reported cstate change: term changed from 14 to 17, leader changed from ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65) to b7ab4784c7344b939bc36f639286f377 (127.5.126.66). New cstate: current_term: 17 leader_uuid: "b7ab4784c7344b939bc36f639286f377" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } } }
W20260709 13:21:38.630321  6697 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 47437.5us
I20260709 13:21:38.631230  6730 raft_consensus.cc:1275] T 22ccee1b570c4ad3a57bd7aec085b1b4 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 17 FOLLOWER]: Refusing update from remote peer b7ab4784c7344b939bc36f639286f377: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 17 index: 11. (term mismatch)
I20260709 13:21:38.631639  6730 pending_rounds.cc:85] T 22ccee1b570c4ad3a57bd7aec085b1b4 P ccd8a4c3bfe3413cb2ae219b09aea832: Aborting all ops after (but not including) 10
I20260709 13:21:38.631871  6730 pending_rounds.cc:107] T 22ccee1b570c4ad3a57bd7aec085b1b4 P ccd8a4c3bfe3413cb2ae219b09aea832: Aborting uncommitted NO_OP operation due to leader change: 16.11
I20260709 13:21:38.632128  6730 raft_consensus.cc:2889] T 22ccee1b570c4ad3a57bd7aec085b1b4 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 17 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:21:38.582090  6626 rpcz_store.cc:269] 0709 13:20:54.080513 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:21:05.226907 (+11146394us) service_pool.cc:224] Handling call
0709 13:21:38.580685 (+33353778us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:21:35.923282 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:21:35.932686 (+  9404us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:21:35.935666 (+  2980us) write_op.cc:435] Acquired schema lock
0709 13:21:35.935694 (+    28us) tablet.cc:662] Decoding operations
0709 13:21:35.944413 (+  8719us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:21:35.944501 (+    88us) write_op.cc:641] Partition lock acquired for write op
0709 13:21:35.944531 (+    30us) tablet.cc:685] Acquiring locks for 6 operations
0709 13:21:35.945070 (+   539us) tablet.cc:701] Row locks acquired
0709 13:21:35.945091 (+    21us) write_op.cc:260] PREPARE: finished
0709 13:21:35.945252 (+   161us) write_op.cc:270] Start()
0709 13:21:35.945367 (+   115us) write_op.cc:276] Timestamp: P: 1783603295945199 usec, L: 0
0709 13:21:35.945389 (+    22us) op_driver.cc:348] REPLICATION: starting
0709 13:21:35.981233 (+ 35844us) log.cc:844] Serialized 2520 byte log entry
0709 13:21:36.411668 (+430435us) op_driver.cc:464] REPLICATION: finished
0709 13:21:36.568507 (+156839us) write_op.cc:301] APPLY: starting
0709 13:21:36.568615 (+   108us) tablet.cc:1367] starting BulkCheckPresence
0709 13:21:36.706938 (+138323us) tablet.cc:1370] finished BulkCheckPresence
0709 13:21:36.707114 (+   176us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:21:36.837218 (+130104us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:21:36.837482 (+   264us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=12,key_file_lookups=12,delta_file_lookups=12,mrs_lookups=0
0709 13:21:36.837527 (+    45us) write_op.cc:312] APPLY: finished
0709 13:21:36.837793 (+   266us) log.cc:844] Serialized 64 byte log entry
0709 13:21:36.888385 (+ 50592us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:21:36.947516 (+ 59131us) write_op.cc:454] Released schema lock
0709 13:21:36.950214 (+  2698us) write_op.cc:341] FINISH: Updating metrics
0709 13:21:36.973515 (+ 23301us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:21:36.973556 (+    41us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":104324,"reported_tablets":55,"child_traces":[["op",{"apply.queue_time_us":153711,"apply.run_cpu_time_us":16976,"apply.run_wall_time_us":404956,"cfile_cache_hit":26,"cfile_cache_hit_bytes":29183,"num_ops":6,"prepare.queue_time_us":407929,"prepare.run_cpu_time_us":21964,"prepare.run_wall_time_us":340230,"raft.queue_time_us":166034,"raft.run_cpu_time_us":14214,"raft.run_wall_time_us":220736,"replication_time_us":419673,"thread_start_us":565152,"threads_started":4,"wal-append.queue_time_us":169869,"wal-append.run_cpu_time_us":42849,"wal-append.run_wall_time_us":1704908}]]}
I20260709 13:21:38.590126 14055 raft_consensus.cc:493] T 90d42e216d9741e190bca19a781291fd P b7ab4784c7344b939bc36f639286f377 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:38.669831  6880 raft_consensus.cc:1275] T 9b3759de40694069b13c0f8bd40e5709 P cd75a17ab2604397adab03bb8b5fd75c [term 20 FOLLOWER]: Refusing update from remote peer b7ab4784c7344b939bc36f639286f377: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 20 index: 13. (index mismatch)
I20260709 13:21:38.649947 14055 raft_consensus.cc:515] T 90d42e216d9741e190bca19a781291fd P b7ab4784c7344b939bc36f639286f377 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:38.623091 14174 consensus_queue.cc:260] T 404190ce4ce94cecbfcb6ea9d1dd8626 P ccd8a4c3bfe3413cb2ae219b09aea832 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.15, Last appended by leader: 15, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:21:38.700986 13684 consensus_queue.cc:1048] T 9b3759de40694069b13c0f8bd40e5709 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.024s
I20260709 13:21:38.730136  6807 raft_consensus.cc:1275] T 95a75bfe094d4bdc963aba3f08dfcd25 P b7ab4784c7344b939bc36f639286f377 [term 18 FOLLOWER]: Refusing update from remote peer cd75a17ab2604397adab03bb8b5fd75c: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
W20260709 13:21:38.742280  6697 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:21:38.752843  6878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90d42e216d9741e190bca19a781291fd" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
W20260709 13:21:38.766392 14277 log.cc:927] Time spent T be1a92657f494cac8dd227d152f50151 P ccd8a4c3bfe3413cb2ae219b09aea832: Append to log took a long time: real 0.143s	user 0.000s	sys 0.001s
I20260709 13:21:38.774940 13992 consensus_queue.cc:1048] T 22ccee1b570c4ad3a57bd7aec085b1b4 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.003s
I20260709 13:21:38.795419  6724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90d42e216d9741e190bca19a781291fd" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:21:38.796180  6724 raft_consensus.cc:2468] T 90d42e216d9741e190bca19a781291fd P ccd8a4c3bfe3413cb2ae219b09aea832 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 21.
I20260709 13:21:38.726682 13998 raft_consensus.cc:493] T 90d42e216d9741e190bca19a781291fd P cd75a17ab2604397adab03bb8b5fd75c [term 20 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:21:38.769078 14174 raft_consensus.cc:3060] T 404190ce4ce94cecbfcb6ea9d1dd8626 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:21:38.903851  6770 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 103817us
I20260709 13:21:38.905146  7496 raft_consensus.cc:1240] T 404190ce4ce94cecbfcb6ea9d1dd8626 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 19 LEADER]: Rejecting Update request from peer ccd8a4c3bfe3413cb2ae219b09aea832 for earlier term 18. Current term is 19. Ops: []
I20260709 13:21:38.907681 13998 raft_consensus.cc:515] T 90d42e216d9741e190bca19a781291fd P cd75a17ab2604397adab03bb8b5fd75c [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:38.918515  6878 raft_consensus.cc:2468] T 90d42e216d9741e190bca19a781291fd P cd75a17ab2604397adab03bb8b5fd75c [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 20.
I20260709 13:21:38.921741 13998 leader_election.cc:290] T 90d42e216d9741e190bca19a781291fd P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
W20260709 13:21:38.923039 14280 log.cc:927] Time spent T 3fa34c08b205435dba97346991aa1f92 P cd75a17ab2604397adab03bb8b5fd75c: Append to log took a long time: real 0.136s	user 0.002s	sys 0.000s
W20260709 13:21:38.945062 14279 log.cc:927] Time spent T ab432e62819d499eaaf3dd55481dd930 P ccd8a4c3bfe3413cb2ae219b09aea832: Append to log took a long time: real 0.278s	user 0.002s	sys 0.000s
W20260709 13:21:38.949714 14278 log.cc:927] Time spent T d8cee0accdb8499c86d4414b72565a38 P cd75a17ab2604397adab03bb8b5fd75c: Append to log took a long time: real 0.273s	user 0.001s	sys 0.001s
W20260709 13:21:38.949714 14281 log.cc:927] Time spent T 95a75bfe094d4bdc963aba3f08dfcd25 P 7ba59cc884714e8aa5f3f0ecaed84cbb: Append to log took a long time: real 0.194s	user 0.007s	sys 0.000s
W20260709 13:21:38.950555 14284 log.cc:927] Time spent T d8cee0accdb8499c86d4414b72565a38 P 7ba59cc884714e8aa5f3f0ecaed84cbb: Append to log took a long time: real 0.223s	user 0.002s	sys 0.000s
W20260709 13:21:38.990113  6695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 194921us
W20260709 13:21:39.006450  6770 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 101653us
I20260709 13:21:39.008905  6770 leader_election.cc:304] T 90d42e216d9741e190bca19a781291fd P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
I20260709 13:21:39.015774  6725 raft_consensus.cc:1275] T 9b3759de40694069b13c0f8bd40e5709 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 20 FOLLOWER]: Refusing update from remote peer b7ab4784c7344b939bc36f639286f377: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 20 index: 13. (index mismatch)
W20260709 13:21:39.043435  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 134083us
I20260709 13:21:39.062700  5625 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:21:39.108762 14066 consensus_queue.cc:1048] T 95a75bfe094d4bdc963aba3f08dfcd25 P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:21:39.116467 13963 raft_consensus.cc:2804] T 90d42e216d9741e190bca19a781291fd P b7ab4784c7344b939bc36f639286f377 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:21:39.117062 13963 raft_consensus.cc:493] T 90d42e216d9741e190bca19a781291fd P b7ab4784c7344b939bc36f639286f377 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:39.117532 13963 raft_consensus.cc:3060] T 90d42e216d9741e190bca19a781291fd P b7ab4784c7344b939bc36f639286f377 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:21:39.125142 14008 consensus_queue.cc:1048] T 9b3759de40694069b13c0f8bd40e5709 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
W20260709 13:21:39.132933 14287 log.cc:927] Time spent T 95a75bfe094d4bdc963aba3f08dfcd25 P ccd8a4c3bfe3413cb2ae219b09aea832: Append to log took a long time: real 0.224s	user 0.000s	sys 0.002s
W20260709 13:21:39.358251  6772 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 342660us
W20260709 13:21:39.380656  6621 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.559s	user 0.008s	sys 0.012s
W20260709 13:21:39.381387  6621 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.618s	user 0.008s	sys 0.012s
I20260709 13:21:39.442366 14055 leader_election.cc:290] T 90d42e216d9741e190bca19a781291fd P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
W20260709 13:21:39.452370  6772 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 90767.5us
W20260709 13:21:39.478792  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 432924us
I20260709 13:21:39.514515 14294 raft_consensus.cc:493] T dbdf895bba214ff68685a24fd17dfb5d P b7ab4784c7344b939bc36f639286f377 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:21:39.515527 14294 raft_consensus.cc:515] T dbdf895bba214ff68685a24fd17dfb5d P b7ab4784c7344b939bc36f639286f377 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:39.518390 14294 leader_election.cc:290] T dbdf895bba214ff68685a24fd17dfb5d P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:21:39.511288 13963 raft_consensus.cc:515] T 90d42e216d9741e190bca19a781291fd P b7ab4784c7344b939bc36f639286f377 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:39.492987 14161 raft_consensus.cc:493] T 4b8cacb381b746da8d0049b0a83b41dd P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 21 FOLLOWER]: Starting pre-election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:21:39.523536 14161 raft_consensus.cc:515] T 4b8cacb381b746da8d0049b0a83b41dd P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:21:39.528458 14192 raft_consensus.cc:493] T 95a75bfe094d4bdc963aba3f08dfcd25 P b7ab4784c7344b939bc36f639286f377 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:21:39.528792 14299 log.cc:927] Time spent T 9b3759de40694069b13c0f8bd40e5709 P ccd8a4c3bfe3413cb2ae219b09aea832: Append to log took a long time: real 0.086s	user 0.001s	sys 0.000s
I20260709 13:21:39.529726  6727 raft_consensus.cc:1275] T bd6869f07b5a4885a0b99fbe60c3b175 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 25 FOLLOWER]: Refusing update from remote peer b7ab4784c7344b939bc36f639286f377: Log matching property violated. Preceding OpId in replica: term: 23 index: 12. Preceding OpId from leader: term: 25 index: 13. (index mismatch)
I20260709 13:21:39.529462 14192 raft_consensus.cc:515] T 95a75bfe094d4bdc963aba3f08dfcd25 P b7ab4784c7344b939bc36f639286f377 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } attrs { replace: true } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:21:39.548810 14259 raft_consensus.cc:493] T bd6869f07b5a4885a0b99fbe60c3b175 P cd75a17ab2604397adab03bb8b5fd75c [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:39.549914 14259 raft_consensus.cc:515] T bd6869f07b5a4885a0b99fbe60c3b175 P cd75a17ab2604397adab03bb8b5fd75c [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:39.553555  6726 raft_consensus.cc:1275] T 404190ce4ce94cecbfcb6ea9d1dd8626 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 19 FOLLOWER]: Refusing update from remote peer 7ba59cc884714e8aa5f3f0ecaed84cbb: Log matching property violated. Preceding OpId in replica: term: 18 index: 15. Preceding OpId from leader: term: 19 index: 15. (term mismatch)
I20260709 13:21:39.554100  6726 pending_rounds.cc:85] T 404190ce4ce94cecbfcb6ea9d1dd8626 P ccd8a4c3bfe3413cb2ae219b09aea832: Aborting all ops after (but not including) 14
I20260709 13:21:39.554401  6726 pending_rounds.cc:107] T 404190ce4ce94cecbfcb6ea9d1dd8626 P ccd8a4c3bfe3413cb2ae219b09aea832: Aborting uncommitted NO_OP operation due to leader change: 18.15
I20260709 13:21:39.554713  6726 raft_consensus.cc:2889] T 404190ce4ce94cecbfcb6ea9d1dd8626 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 19 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:21:39.538667 14161 leader_election.cc:290] T 4b8cacb381b746da8d0049b0a83b41dd P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:21:39.560372  7496 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50742 (request call id 694) took 1217 ms. Trace:
I20260709 13:21:39.561033 13963 leader_election.cc:290] T 90d42e216d9741e190bca19a781291fd P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 22 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:21:39.565263  6724 raft_consensus.cc:1275] T f3f9c2e2bf644115957398fe4c9459db P ccd8a4c3bfe3413cb2ae219b09aea832 [term 23 FOLLOWER]: Refusing update from remote peer b7ab4784c7344b939bc36f639286f377: Log matching property violated. Preceding OpId in replica: term: 21 index: 14. Preceding OpId from leader: term: 23 index: 15. (index mismatch)
I20260709 13:21:39.573009 14303 raft_consensus.cc:493] T 3d65025eea89441290d85dd053810e31 P cd75a17ab2604397adab03bb8b5fd75c [term 20 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:21:39.573925 14303 raft_consensus.cc:515] T 3d65025eea89441290d85dd053810e31 P cd75a17ab2604397adab03bb8b5fd75c [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:39.581568 14192 leader_election.cc:290] T 95a75bfe094d4bdc963aba3f08dfcd25 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:21:39.582751  6727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b8cacb381b746da8d0049b0a83b41dd" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:21:39.587044 14189 consensus_queue.cc:1048] T 404190ce4ce94cecbfcb6ea9d1dd8626 P 7ba59cc884714e8aa5f3f0ecaed84cbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:21:39.605288 14259 leader_election.cc:290] T bd6869f07b5a4885a0b99fbe60c3b175 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:21:39.608343 14303 leader_election.cc:290] T 3d65025eea89441290d85dd053810e31 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:21:39.609794  6873 raft_consensus.cc:1275] T f3f9c2e2bf644115957398fe4c9459db P cd75a17ab2604397adab03bb8b5fd75c [term 23 FOLLOWER]: Refusing update from remote peer b7ab4784c7344b939bc36f639286f377: Log matching property violated. Preceding OpId in replica: term: 21 index: 14. Preceding OpId from leader: term: 23 index: 15. (index mismatch)
I20260709 13:21:39.610139  6732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90d42e216d9741e190bca19a781291fd" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:21:39.610898  6732 raft_consensus.cc:3060] T 90d42e216d9741e190bca19a781291fd P ccd8a4c3bfe3413cb2ae219b09aea832 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:21:39.561069  7496 rpcz_store.cc:276] 0709 13:21:38.342796 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:21:38.342974 (+   178us) service_pool.cc:224] Handling call
0709 13:21:38.343368 (+   394us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:21:38.905759 (+562391us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:21:39.559658 (+653899us) spinlock_profiling.cc:243] Waited 561 ms on lock 0x7b5400570154. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f9aae01 00007fcc0f9a983e 00007fcc1496e419 00007fcc0dee5bd4 00007fcc0dee5b62 00007fcc0dee5a91 00007fcc0dee5a0c 00007fcc0dee4cc2 00007fcc0dce548c 00007fcc0dce48c6
0709 13:21:39.560101 (+   443us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1291282688}
I20260709 13:21:39.620949  6877 raft_consensus.cc:1275] T bd6869f07b5a4885a0b99fbe60c3b175 P cd75a17ab2604397adab03bb8b5fd75c [term 25 FOLLOWER]: Refusing update from remote peer b7ab4784c7344b939bc36f639286f377: Log matching property violated. Preceding OpId in replica: term: 23 index: 12. Preceding OpId from leader: term: 25 index: 13. (index mismatch)
I20260709 13:21:39.623085  6732 raft_consensus.cc:2468] T 90d42e216d9741e190bca19a781291fd P ccd8a4c3bfe3413cb2ae219b09aea832 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 22.
W20260709 13:21:39.624963  6770 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 44470.4us
I20260709 13:21:39.624563  6725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbdf895bba214ff68685a24fd17dfb5d" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 21 candidate_status { last_received { term: 20 index: 9 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:21:39.646188  7496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a75bfe094d4bdc963aba3f08dfcd25" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:21:39.644351 13963 consensus_queue.cc:1048] T bd6869f07b5a4885a0b99fbe60c3b175 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.010s
I20260709 13:21:39.659082  6876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbdf895bba214ff68685a24fd17dfb5d" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 21 candidate_status { last_received { term: 20 index: 9 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:21:39.660219  6879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90d42e216d9741e190bca19a781291fd" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:21:39.661132  6879 raft_consensus.cc:3060] T 90d42e216d9741e190bca19a781291fd P cd75a17ab2604397adab03bb8b5fd75c [term 20 FOLLOWER]: Advancing to term 22
I20260709 13:21:39.664745  6725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90d42e216d9741e190bca19a781291fd" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:21:39.665606  6725 raft_consensus.cc:2368] T 90d42e216d9741e190bca19a781291fd P ccd8a4c3bfe3413cb2ae219b09aea832 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c for earlier term 21. Current term is 22.
I20260709 13:21:39.667335  6881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a75bfe094d4bdc963aba3f08dfcd25" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
W20260709 13:21:39.679931 14292 log.cc:927] Time spent T 22ccee1b570c4ad3a57bd7aec085b1b4 P ccd8a4c3bfe3413cb2ae219b09aea832: Append to log took a long time: real 0.319s	user 0.000s	sys 0.005s
I20260709 13:21:39.720860 14008 consensus_queue.cc:1048] T f3f9c2e2bf644115957398fe4c9459db P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:21:39.723188  6770 leader_election.cc:304] T 90d42e216d9741e190bca19a781291fd P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
I20260709 13:21:39.725214 13684 raft_consensus.cc:2804] T 90d42e216d9741e190bca19a781291fd P b7ab4784c7344b939bc36f639286f377 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:21:39.725860 13684 raft_consensus.cc:697] T 90d42e216d9741e190bca19a781291fd P b7ab4784c7344b939bc36f639286f377 [term 22 LEADER]: Becoming Leader. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
I20260709 13:21:39.720196  6805 raft_consensus.cc:1275] T 404190ce4ce94cecbfcb6ea9d1dd8626 P b7ab4784c7344b939bc36f639286f377 [term 19 FOLLOWER]: Refusing update from remote peer 7ba59cc884714e8aa5f3f0ecaed84cbb: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
I20260709 13:21:39.703806  6879 raft_consensus.cc:2468] T 90d42e216d9741e190bca19a781291fd P cd75a17ab2604397adab03bb8b5fd75c [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 22.
I20260709 13:21:39.740502 13684 consensus_queue.cc:237] T 90d42e216d9741e190bca19a781291fd P b7ab4784c7344b939bc36f639286f377 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 20.11, Last appended by leader: 11, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:39.743319 14193 raft_consensus.cc:493] T 1528ab62b6fe4e3099d08f141afee116 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 19 FOLLOWER]: Starting pre-election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:21:39.750473 14303 raft_consensus.cc:493] T 427c124d773f483294511e80fe340075 P cd75a17ab2604397adab03bb8b5fd75c [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 7ba59cc884714e8aa5f3f0ecaed84cbb)
I20260709 13:21:39.751224 14259 raft_consensus.cc:493] T 3411566abe2d4c9bb4b2adfdd05e6f17 P cd75a17ab2604397adab03bb8b5fd75c [term 20 FOLLOWER]: Starting pre-election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:21:39.782189  6805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90d42e216d9741e190bca19a781291fd" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:21:39.792704  6726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a75bfe094d4bdc963aba3f08dfcd25" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:21:39.802616 13697 raft_consensus.cc:493] T 8c7f33e544204fbaac4078e3e83bbf4e P ccd8a4c3bfe3413cb2ae219b09aea832 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:21:39.803037  6729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6869f07b5a4885a0b99fbe60c3b175" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 26 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:21:39.808308 14303 raft_consensus.cc:515] T 427c124d773f483294511e80fe340075 P cd75a17ab2604397adab03bb8b5fd75c [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } attrs { replace: true } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:21:39.803960  6729 raft_consensus.cc:2468] T bd6869f07b5a4885a0b99fbe60c3b175 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 25.
I20260709 13:21:39.867697 13697 raft_consensus.cc:515] T 8c7f33e544204fbaac4078e3e83bbf4e P ccd8a4c3bfe3413cb2ae219b09aea832 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:39.870374 13697 leader_election.cc:290] T 8c7f33e544204fbaac4078e3e83bbf4e P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:21:39.836650 14193 raft_consensus.cc:515] T 1528ab62b6fe4e3099d08f141afee116 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:21:39.812549 14259 raft_consensus.cc:515] T 3411566abe2d4c9bb4b2adfdd05e6f17 P cd75a17ab2604397adab03bb8b5fd75c [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:39.877419  6802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c7f33e544204fbaac4078e3e83bbf4e" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
W20260709 13:21:39.878835 14286 log.cc:927] Time spent T be1a92657f494cac8dd227d152f50151 P b7ab4784c7344b939bc36f639286f377: Append to log took a long time: real 0.055s	user 0.000s	sys 0.001s
I20260709 13:21:39.879431 13998 raft_consensus.cc:493] T 711ef6523deb4cbe8ef2ba61e1c21c98 P cd75a17ab2604397adab03bb8b5fd75c [term 21 FOLLOWER]: Starting pre-election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:21:39.880419 13998 raft_consensus.cc:515] T 711ef6523deb4cbe8ef2ba61e1c21c98 P cd75a17ab2604397adab03bb8b5fd75c [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:39.895817 14162 raft_consensus.cc:493] T 853ac0a8cbd64ce99457f170216d4d0f P ccd8a4c3bfe3413cb2ae219b09aea832 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:21:39.896708 14162 raft_consensus.cc:515] T 853ac0a8cbd64ce99457f170216d4d0f P ccd8a4c3bfe3413cb2ae219b09aea832 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
W20260709 13:21:39.908638  6614 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet ce4f062dcd314d43a63ca74067cb5ee3 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER failed with leader b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica b7ab4784c7344b939bc36f639286f377 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 16 leader_uuid: "cd75a17ab2604397adab03bb8b5fd75c" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } } }
I20260709 13:21:39.908951 14275 consensus_queue.cc:1048] T bd6869f07b5a4885a0b99fbe60c3b175 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
W20260709 13:21:39.909479  6614 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 59345.5us
I20260709 13:21:39.910576  6844 leader_election.cc:400] T 90d42e216d9741e190bca19a781291fd P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 21 pre-election: Vote denied by peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391) with higher term. Message: Invalid argument: T 90d42e216d9741e190bca19a781291fd P ccd8a4c3bfe3413cb2ae219b09aea832 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c for earlier term 21. Current term is 22.
I20260709 13:21:39.911000  6844 leader_election.cc:403] T 90d42e216d9741e190bca19a781291fd P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 21 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:21:39.908825 13990 consensus_queue.cc:1048] T f3f9c2e2bf644115957398fe4c9459db P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.067s
I20260709 13:21:39.915625  6728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d65025eea89441290d85dd053810e31" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:21:39.899202 14162 leader_election.cc:290] T 853ac0a8cbd64ce99457f170216d4d0f P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:21:39.908695 14202 raft_consensus.cc:493] T 4f00a2e87e56452083b759f60d461ee3 P cd75a17ab2604397adab03bb8b5fd75c [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 7ba59cc884714e8aa5f3f0ecaed84cbb)
I20260709 13:21:39.916209  6801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6869f07b5a4885a0b99fbe60c3b175" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 26 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:21:39.915922  6872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c7f33e544204fbaac4078e3e83bbf4e" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:21:39.925814  6772 leader_election.cc:304] T 95a75bfe094d4bdc963aba3f08dfcd25 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:21:39.914392 14066 raft_consensus.cc:2749] T 90d42e216d9741e190bca19a781291fd P cd75a17ab2604397adab03bb8b5fd75c [term 22 FOLLOWER]: Leader pre-election lost for term 21. Reason: Vote denied by peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391) with higher term. Message: Invalid argument: T 90d42e216d9741e190bca19a781291fd P ccd8a4c3bfe3413cb2ae219b09aea832 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c for earlier term 21. Current term is 22.
I20260709 13:21:39.911989 14161 consensus_queue.cc:1048] T 404190ce4ce94cecbfcb6ea9d1dd8626 P 7ba59cc884714e8aa5f3f0ecaed84cbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.022s
I20260709 13:21:39.957602 14202 raft_consensus.cc:515] T 4f00a2e87e56452083b759f60d461ee3 P cd75a17ab2604397adab03bb8b5fd75c [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:21:39.966403 14298 raft_consensus.cc:2749] T 95a75bfe094d4bdc963aba3f08dfcd25 P b7ab4784c7344b939bc36f639286f377 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:21:39.975939  6803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "853ac0a8cbd64ce99457f170216d4d0f" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:21:39.985967 14303 leader_election.cc:290] T 427c124d773f483294511e80fe340075 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:21:39.986900 14303 raft_consensus.cc:493] T d8cee0accdb8499c86d4414b72565a38 P cd75a17ab2604397adab03bb8b5fd75c [term 21 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:21:39.987224  7495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "427c124d773f483294511e80fe340075" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:21:39.986933 14202 leader_election.cc:290] T 4f00a2e87e56452083b759f60d461ee3 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:21:39.990451  7502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f00a2e87e56452083b759f60d461ee3" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:21:39.994866  6807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d65025eea89441290d85dd053810e31" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:21:39.995432 14259 leader_election.cc:290] T 3411566abe2d4c9bb4b2adfdd05e6f17 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:21:39.999212  6772 leader_election.cc:304] T dbdf895bba214ff68685a24fd17dfb5d P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:21:40.001251 14055 raft_consensus.cc:2749] T dbdf895bba214ff68685a24fd17dfb5d P b7ab4784c7344b939bc36f639286f377 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:21:40.001442 14175 raft_consensus.cc:493] T d8cee0accdb8499c86d4414b72565a38 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 21 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:21:40.002290 14175 raft_consensus.cc:515] T d8cee0accdb8499c86d4414b72565a38 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:21:40.007220  6697 leader_election.cc:304] T 8c7f33e544204fbaac4078e3e83bbf4e P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:21:40.010847 14159 raft_consensus.cc:2749] T 8c7f33e544204fbaac4078e3e83bbf4e P ccd8a4c3bfe3413cb2ae219b09aea832 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:21:40.011600 14159 raft_consensus.cc:493] T 34f36d59d88f40fe8a2805e604fc6c0a P ccd8a4c3bfe3413cb2ae219b09aea832 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader cd75a17ab2604397adab03bb8b5fd75c)
I20260709 13:21:40.014981 14159 raft_consensus.cc:515] T 34f36d59d88f40fe8a2805e604fc6c0a P ccd8a4c3bfe3413cb2ae219b09aea832 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:39.987797 14303 raft_consensus.cc:515] T d8cee0accdb8499c86d4414b72565a38 P cd75a17ab2604397adab03bb8b5fd75c [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:21:40.018887 14175 leader_election.cc:290] T d8cee0accdb8499c86d4414b72565a38 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:21:40.021020  6879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "853ac0a8cbd64ce99457f170216d4d0f" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:21:40.025049  7496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8cee0accdb8499c86d4414b72565a38" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
W20260709 13:21:40.027330  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 115591us
I20260709 13:21:39.987046 14193 leader_election.cc:290] T 1528ab62b6fe4e3099d08f141afee116 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:21:40.030021  7496 raft_consensus.cc:2468] T d8cee0accdb8499c86d4414b72565a38 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 21.
I20260709 13:21:40.021791 14303 leader_election.cc:290] T d8cee0accdb8499c86d4414b72565a38 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
W20260709 13:21:40.071463 14319 log.cc:927] Time spent T 404190ce4ce94cecbfcb6ea9d1dd8626 P ccd8a4c3bfe3413cb2ae219b09aea832: Append to log took a long time: real 0.087s	user 0.000s	sys 0.003s
I20260709 13:21:40.072180 14066 raft_consensus.cc:493] T 7ba5dac66ab5497e9e336f2a3c28cda5 P cd75a17ab2604397adab03bb8b5fd75c [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 7ba59cc884714e8aa5f3f0ecaed84cbb)
I20260709 13:21:40.020372 14159 leader_election.cc:290] T 34f36d59d88f40fe8a2805e604fc6c0a P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:21:40.073293 14066 raft_consensus.cc:515] T 7ba5dac66ab5497e9e336f2a3c28cda5 P cd75a17ab2604397adab03bb8b5fd75c [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:21:40.074245 13998 leader_election.cc:290] T 711ef6523deb4cbe8ef2ba61e1c21c98 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:21:40.075959 14257 raft_consensus.cc:493] T 7a734b5ab7834e05a8c422208acc58b1 P cd75a17ab2604397adab03bb8b5fd75c [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 7ba59cc884714e8aa5f3f0ecaed84cbb)
I20260709 13:21:40.075953 14066 leader_election.cc:290] T 7ba5dac66ab5497e9e336f2a3c28cda5 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:21:40.076749 14257 raft_consensus.cc:515] T 7a734b5ab7834e05a8c422208acc58b1 P cd75a17ab2604397adab03bb8b5fd75c [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } attrs { replace: true } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:21:40.076325  6844 leader_election.cc:304] T bd6869f07b5a4885a0b99fbe60c3b175 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:21:40.101629 14297 raft_consensus.cc:2804] T bd6869f07b5a4885a0b99fbe60c3b175 P cd75a17ab2604397adab03bb8b5fd75c [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 13:21:40.102160 14297 raft_consensus.cc:493] T bd6869f07b5a4885a0b99fbe60c3b175 P cd75a17ab2604397adab03bb8b5fd75c [term 25 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:40.102479 14297 raft_consensus.cc:3060] T bd6869f07b5a4885a0b99fbe60c3b175 P cd75a17ab2604397adab03bb8b5fd75c [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:21:40.102782 14163 raft_consensus.cc:493] T 9e326172347f45e99a0d482b5d8ef768 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader cd75a17ab2604397adab03bb8b5fd75c)
I20260709 13:21:40.104115  7502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ba5dac66ab5497e9e336f2a3c28cda5" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:21:40.031049 14259 raft_consensus.cc:493] T 24ee15416e3145beaa1b8183453729a3 P cd75a17ab2604397adab03bb8b5fd75c [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 7ba59cc884714e8aa5f3f0ecaed84cbb)
I20260709 13:21:40.162662  6879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34f36d59d88f40fe8a2805e604fc6c0a" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:21:40.157851  6877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8cee0accdb8499c86d4414b72565a38" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:21:40.163952  6876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b8cacb381b746da8d0049b0a83b41dd" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
W20260709 13:21:40.167543  7466 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 210508us
I20260709 13:21:40.167703  6729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "427c124d773f483294511e80fe340075" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:21:40.107950 14163 raft_consensus.cc:515] T 9e326172347f45e99a0d482b5d8ef768 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:40.186749  6732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "711ef6523deb4cbe8ef2ba61e1c21c98" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:21:40.185583  6725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3411566abe2d4c9bb4b2adfdd05e6f17" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:21:40.163321  6695 leader_election.cc:304] T 853ac0a8cbd64ce99457f170216d4d0f P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:21:40.205855  6805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1528ab62b6fe4e3099d08f141afee116" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
W20260709 13:21:40.213260  6695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 53626.1us
I20260709 13:21:40.155467 14259 raft_consensus.cc:515] T 24ee15416e3145beaa1b8183453729a3 P cd75a17ab2604397adab03bb8b5fd75c [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:21:40.231712  6725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a734b5ab7834e05a8c422208acc58b1" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:21:40.239439  6799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34f36d59d88f40fe8a2805e604fc6c0a" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:21:40.241622 14236 raft_consensus.cc:2749] T 853ac0a8cbd64ce99457f170216d4d0f P ccd8a4c3bfe3413cb2ae219b09aea832 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:21:40.242640 14017 raft_consensus.cc:493] T 404190ce4ce94cecbfcb6ea9d1dd8626 P b7ab4784c7344b939bc36f639286f377 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:40.243264 14017 raft_consensus.cc:515] T 404190ce4ce94cecbfcb6ea9d1dd8626 P b7ab4784c7344b939bc36f639286f377 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:21:40.244268 14257 leader_election.cc:290] T 7a734b5ab7834e05a8c422208acc58b1 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:21:40.245678 14017 leader_election.cc:290] T 404190ce4ce94cecbfcb6ea9d1dd8626 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:21:40.249029 14233 raft_consensus.cc:493] T 95a75bfe094d4bdc963aba3f08dfcd25 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader cd75a17ab2604397adab03bb8b5fd75c)
I20260709 13:21:40.249730 14233 raft_consensus.cc:515] T 95a75bfe094d4bdc963aba3f08dfcd25 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } attrs { replace: true } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:21:40.250943 14163 leader_election.cc:290] T 9e326172347f45e99a0d482b5d8ef768 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:21:40.254709  6805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8cee0accdb8499c86d4414b72565a38" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:21:40.257604 14259 leader_election.cc:290] T 24ee15416e3145beaa1b8183453729a3 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:21:40.269335 14233 leader_election.cc:290] T 95a75bfe094d4bdc963aba3f08dfcd25 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:21:40.278218  6725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1528ab62b6fe4e3099d08f141afee116" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:21:40.275691  6846 leader_election.cc:304] T d8cee0accdb8499c86d4414b72565a38 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
W20260709 13:21:40.280105  6846 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.68:45071, user_credentials={real_user=slave}} blocked reactor thread for 141847us
I20260709 13:21:40.284231  7496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a734b5ab7834e05a8c422208acc58b1" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:21:40.343052  7502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24ee15416e3145beaa1b8183453729a3" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:21:40.340956 14204 raft_consensus.cc:493] T 22ccee1b570c4ad3a57bd7aec085b1b4 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:21:40.392232  7466 leader_election.cc:304] T 1528ab62b6fe4e3099d08f141afee116 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
W20260709 13:21:40.411430  6770 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 211966us
I20260709 13:21:40.435752  6799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e326172347f45e99a0d482b5d8ef768" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:21:40.456847  6803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f00a2e87e56452083b759f60d461ee3" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:21:40.422005 14204 raft_consensus.cc:515] T 22ccee1b570c4ad3a57bd7aec085b1b4 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:40.465724  6803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8cee0accdb8499c86d4414b72565a38" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:21:40.467459  6798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "427c124d773f483294511e80fe340075" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:21:40.480600  6799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a75bfe094d4bdc963aba3f08dfcd25" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:21:40.488297  6802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3411566abe2d4c9bb4b2adfdd05e6f17" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:21:40.467264 14185 raft_consensus.cc:2749] T 1528ab62b6fe4e3099d08f141afee116 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:21:40.506956  6806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "711ef6523deb4cbe8ef2ba61e1c21c98" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
W20260709 13:21:40.510568 14326 log.cc:927] Time spent T 90d42e216d9741e190bca19a781291fd P b7ab4784c7344b939bc36f639286f377: Append to log took a long time: real 0.096s	user 0.001s	sys 0.000s
I20260709 13:21:40.513404  6798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ba5dac66ab5497e9e336f2a3c28cda5" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:21:40.521178  6723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "404190ce4ce94cecbfcb6ea9d1dd8626" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 20 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:21:40.512158 14036 raft_consensus.cc:493] T 1bf4668eeb70467fb3dc5a0289233b3c P b7ab4784c7344b939bc36f639286f377 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader cd75a17ab2604397adab03bb8b5fd75c)
I20260709 13:21:40.478631 14324 raft_consensus.cc:493] T 2c240553ce044eedb41541d72b9475d7 P cd75a17ab2604397adab03bb8b5fd75c [term 21 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:21:40.567035 14297 raft_consensus.cc:515] T bd6869f07b5a4885a0b99fbe60c3b175 P cd75a17ab2604397adab03bb8b5fd75c [term 26 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
W20260709 13:21:40.569347 14321 log.cc:927] Time spent T d8cee0accdb8499c86d4414b72565a38 P b7ab4784c7344b939bc36f639286f377: Append to log took a long time: real 0.376s	user 0.001s	sys 0.005s
W20260709 13:21:40.576462 14332 log.cc:927] Time spent T d8cee0accdb8499c86d4414b72565a38 P 7ba59cc884714e8aa5f3f0ecaed84cbb: Append to log took a long time: real 0.080s	user 0.001s	sys 0.000s
I20260709 13:21:40.613811  6875 raft_consensus.cc:1240] T bd6869f07b5a4885a0b99fbe60c3b175 P cd75a17ab2604397adab03bb8b5fd75c [term 26 FOLLOWER]: Rejecting Update request from peer b7ab4784c7344b939bc36f639286f377 for earlier term 25. Current term is 26. Ops: [25.13-25.13]
I20260709 13:21:40.616211 14036 raft_consensus.cc:515] T 1bf4668eeb70467fb3dc5a0289233b3c P b7ab4784c7344b939bc36f639286f377 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:40.618757 14036 leader_election.cc:290] T 1bf4668eeb70467fb3dc5a0289233b3c P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:21:40.628185 14322 raft_consensus.cc:2804] T d8cee0accdb8499c86d4414b72565a38 P cd75a17ab2604397adab03bb8b5fd75c [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:21:40.630584 14322 raft_consensus.cc:493] T d8cee0accdb8499c86d4414b72565a38 P cd75a17ab2604397adab03bb8b5fd75c [term 21 FOLLOWER]: Starting leader election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:21:40.631042 14322 raft_consensus.cc:3060] T d8cee0accdb8499c86d4414b72565a38 P cd75a17ab2604397adab03bb8b5fd75c [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:21:40.634102 14297 leader_election.cc:290] T bd6869f07b5a4885a0b99fbe60c3b175 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 26 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:21:40.634850 14323 raft_consensus.cc:493] T 30e88460611e47b2ba16a46a30b5f416 P cd75a17ab2604397adab03bb8b5fd75c [term 16 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:21:40.635459 14323 raft_consensus.cc:515] T 30e88460611e47b2ba16a46a30b5f416 P cd75a17ab2604397adab03bb8b5fd75c [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:40.637645 14323 leader_election.cc:290] T 30e88460611e47b2ba16a46a30b5f416 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
W20260709 13:21:40.649106 14344 log.cc:927] Time spent T 95a75bfe094d4bdc963aba3f08dfcd25 P ccd8a4c3bfe3413cb2ae219b09aea832: Append to log took a long time: real 0.067s	user 0.000s	sys 0.000s
I20260709 13:21:40.592480 14324 raft_consensus.cc:515] T 2c240553ce044eedb41541d72b9475d7 P cd75a17ab2604397adab03bb8b5fd75c [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
W20260709 13:21:40.653244 14346 log.cc:927] Time spent T 95a75bfe094d4bdc963aba3f08dfcd25 P cd75a17ab2604397adab03bb8b5fd75c: Append to log took a long time: real 0.072s	user 0.000s	sys 0.001s
I20260709 13:21:40.656347 14324 leader_election.cc:290] T 2c240553ce044eedb41541d72b9475d7 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:21:40.659420  6844 leader_election.cc:304] T 3d65025eea89441290d85dd053810e31 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
W20260709 13:21:40.664019 14343 log.cc:927] Time spent T 404190ce4ce94cecbfcb6ea9d1dd8626 P b7ab4784c7344b939bc36f639286f377: Append to log took a long time: real 0.075s	user 0.000s	sys 0.000s
W20260709 13:21:40.645908 14292 log.cc:927] Time spent T 22ccee1b570c4ad3a57bd7aec085b1b4 P ccd8a4c3bfe3413cb2ae219b09aea832: Append to log took a long time: real 0.056s	user 0.001s	sys 0.000s
I20260709 13:21:40.669432  6844 leader_election.cc:304] T 4f00a2e87e56452083b759f60d461ee3 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, b7ab4784c7344b939bc36f639286f377
I20260709 13:21:40.673652 14297 raft_consensus.cc:2749] T 4f00a2e87e56452083b759f60d461ee3 P cd75a17ab2604397adab03bb8b5fd75c [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:21:40.671739 14323 raft_consensus.cc:2749] T 3d65025eea89441290d85dd053810e31 P cd75a17ab2604397adab03bb8b5fd75c [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:21:40.689935  7496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "404190ce4ce94cecbfcb6ea9d1dd8626" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 20 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:21:40.698733  6844 leader_election.cc:304] T 427c124d773f483294511e80fe340075 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, ccd8a4c3bfe3413cb2ae219b09aea832
W20260709 13:21:40.705169  6770 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 186851us
I20260709 13:21:40.712621 14204 leader_election.cc:290] T 22ccee1b570c4ad3a57bd7aec085b1b4 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:21:40.715873  6770 leader_election.cc:304] T 404190ce4ce94cecbfcb6ea9d1dd8626 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:21:40.717764 14036 raft_consensus.cc:2749] T 404190ce4ce94cecbfcb6ea9d1dd8626 P b7ab4784c7344b939bc36f639286f377 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:21:40.720250  6731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24ee15416e3145beaa1b8183453729a3" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:21:40.723757  6729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c240553ce044eedb41541d72b9475d7" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:21:40.726460  6732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30e88460611e47b2ba16a46a30b5f416" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:21:40.729086 14334 raft_consensus.cc:2749] T 427c124d773f483294511e80fe340075 P cd75a17ab2604397adab03bb8b5fd75c [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:21:40.729600  6724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6869f07b5a4885a0b99fbe60c3b175" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 26 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:21:40.760229 14066 raft_consensus.cc:493] T 3fa34c08b205435dba97346991aa1f92 P cd75a17ab2604397adab03bb8b5fd75c [term 27 FOLLOWER]: Starting pre-election (detected failure of leader 7ba59cc884714e8aa5f3f0ecaed84cbb)
I20260709 13:21:40.760969 14066 raft_consensus.cc:515] T 3fa34c08b205435dba97346991aa1f92 P cd75a17ab2604397adab03bb8b5fd75c [term 27 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:21:40.762215  7495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a75bfe094d4bdc963aba3f08dfcd25" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:21:40.763522  6881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a75bfe094d4bdc963aba3f08dfcd25" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:21:40.764451  6872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e326172347f45e99a0d482b5d8ef768" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:21:40.760237  6803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22ccee1b570c4ad3a57bd7aec085b1b4" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:21:40.785528  6695 leader_election.cc:304] T 34f36d59d88f40fe8a2805e604fc6c0a P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:21:40.796693  6695 leader_election.cc:304] T 95a75bfe094d4bdc963aba3f08dfcd25 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, b7ab4784c7344b939bc36f639286f377
I20260709 13:21:40.799070 14340 raft_consensus.cc:2749] T 95a75bfe094d4bdc963aba3f08dfcd25 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:21:40.793139 14204 raft_consensus.cc:2749] T 34f36d59d88f40fe8a2805e604fc6c0a P ccd8a4c3bfe3413cb2ae219b09aea832 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:21:40.816854  6877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22ccee1b570c4ad3a57bd7aec085b1b4" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:21:40.815867 14066 leader_election.cc:290] T 3fa34c08b205435dba97346991aa1f92 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:21:40.821903  6846 leader_election.cc:304] T 7a734b5ab7834e05a8c422208acc58b1 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:21:40.836652 14324 raft_consensus.cc:2749] T 7a734b5ab7834e05a8c422208acc58b1 P cd75a17ab2604397adab03bb8b5fd75c [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:21:40.836802  6846 leader_election.cc:304] T 24ee15416e3145beaa1b8183453729a3 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:21:40.838887  6730 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50004 (request call id 3611) took 1059 ms. Trace:
I20260709 13:21:40.856719 14322 raft_consensus.cc:515] T d8cee0accdb8499c86d4414b72565a38 P cd75a17ab2604397adab03bb8b5fd75c [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:21:40.857589 14259 raft_consensus.cc:2749] T 24ee15416e3145beaa1b8183453729a3 P cd75a17ab2604397adab03bb8b5fd75c [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:21:40.858978 14322 leader_election.cc:290] T d8cee0accdb8499c86d4414b72565a38 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 22 election: Requested vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:21:40.864718  6728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fa34c08b205435dba97346991aa1f92" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 28 candidate_status { last_received { term: 27 index: 19 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
W20260709 13:21:40.868829  7468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 86141.7us
I20260709 13:21:40.870115  7468 leader_election.cc:304] T 4b8cacb381b746da8d0049b0a83b41dd P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:21:40.871511  7468 leader_election.cc:304] T d8cee0accdb8499c86d4414b72565a38 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:21:40.881445  7496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fa34c08b205435dba97346991aa1f92" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 28 candidate_status { last_received { term: 27 index: 19 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:21:40.883939  6725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bf4668eeb70467fb3dc5a0289233b3c" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" is_pre_election: true
I20260709 13:21:40.885963  7502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8cee0accdb8499c86d4414b72565a38" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb"
I20260709 13:21:40.888504  6844 leader_election.cc:304] T 711ef6523deb4cbe8ef2ba61e1c21c98 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:21:40.892287  6844 leader_election.cc:304] T 3411566abe2d4c9bb4b2adfdd05e6f17 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:21:40.895063  6731 raft_consensus.cc:1275] T 90d42e216d9741e190bca19a781291fd P ccd8a4c3bfe3413cb2ae219b09aea832 [term 22 FOLLOWER]: Refusing update from remote peer b7ab4784c7344b939bc36f639286f377: Log matching property violated. Preceding OpId in replica: term: 20 index: 11. Preceding OpId from leader: term: 22 index: 12. (index mismatch)
I20260709 13:21:40.895887  6697 leader_election.cc:304] T 9e326172347f45e99a0d482b5d8ef768 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:21:40.897535  6844 leader_election.cc:304] T 7ba5dac66ab5497e9e336f2a3c28cda5 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, b7ab4784c7344b939bc36f639286f377
I20260709 13:21:40.872381 14193 raft_consensus.cc:2749] T 4b8cacb381b746da8d0049b0a83b41dd P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:21:40.901013  6846 leader_election.cc:304] T 3fa34c08b205435dba97346991aa1f92 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:21:40.908376  6803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8cee0accdb8499c86d4414b72565a38" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:21:40.912748  6802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30e88460611e47b2ba16a46a30b5f416" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:21:40.912797  6798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6869f07b5a4885a0b99fbe60c3b175" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 26 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:21:40.894461 14257 raft_consensus.cc:2749] T 711ef6523deb4cbe8ef2ba61e1c21c98 P cd75a17ab2604397adab03bb8b5fd75c [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:21:40.851753  6730 rpcz_store.cc:276] 0709 13:21:39.779200 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:21:39.794652 (+ 15452us) service_pool.cc:224] Handling call
0709 13:21:39.814301 (+ 19649us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:21:39.853322 (+ 39021us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:21:39.853372 (+    50us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:21:39.999278 (+145906us) spinlock_profiling.cc:243] Waited 7.68 ms on lock 0x7b18003ef320. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc15785de1 00007fcc157925b1 00007fcc0c8bd557 00007fcc0c8bf7c1 00007fcc0c8bf779 00007fcc0c8bf709 00007fcc0c8bf6d1 00007fcc0c8be9cd 000000000038f354 000000000038f199 00007fcc0c8a083a
0709 13:21:40.021488 (+ 22210us) spinlock_profiling.cc:243] Waited 12.4 ms on lock 0x7b2c00000f48. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0e2a3a11 00007fcc0e2b3372 00007fcc0f9e5a01 00007fcc0f9aa43a 00007fcc0f9a983e 00007fcc1496e419 00007fcc0dee5bd4 00007fcc0dee5b62 00007fcc0dee5a91 00007fcc0dee5a0c 00007fcc0dee4cc2
0709 13:21:40.022048 (+   560us) log.cc:844] Serialized 26 byte log entry
0709 13:21:40.302523 (+280475us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:21:40.302563 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:21:40.302635 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:21:40.650432 (+347797us) raft_consensus.cc:1685] finished
0709 13:21:40.650452 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:21:40.838575 (+188123us) spinlock_profiling.cc:243] Waited 9.42 ms on lock 0x7b5400319cd0. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f9a98ad 00007fcc1496e419 00007fcc0dee5bd4 00007fcc0dee5b62 00007fcc0dee5a91 00007fcc0dee5a0c 00007fcc0dee4cc2 00007fcc0dce548c 00007fcc0dce48c6 00007fcc0dce426f
0709 13:21:40.838690 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":14112,"raft.run_cpu_time_us":202,"raft.run_wall_time_us":22311,"spinlock_wait_cycles":67935104,"thread_start_us":280055,"threads_started":1,"wal-append.queue_time_us":402852}
I20260709 13:21:40.878651 14354 raft_consensus.cc:2749] T d8cee0accdb8499c86d4414b72565a38 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:21:40.915782  6801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a734b5ab7834e05a8c422208acc58b1" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:21:40.925323  6697 leader_election.cc:304] T 22ccee1b570c4ad3a57bd7aec085b1b4 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:21:40.904918 14295 raft_consensus.cc:2749] T 3411566abe2d4c9bb4b2adfdd05e6f17 P cd75a17ab2604397adab03bb8b5fd75c [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:21:40.913928 14324 raft_consensus.cc:2749] T 7ba5dac66ab5497e9e336f2a3c28cda5 P cd75a17ab2604397adab03bb8b5fd75c [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:21:40.879345 14017 consensus_queue.cc:1059] T bd6869f07b5a4885a0b99fbe60c3b175 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: INVALID_TERM, Last received: 23.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.037s
I20260709 13:21:40.916878 14236 raft_consensus.cc:2749] T 9e326172347f45e99a0d482b5d8ef768 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:21:40.953698  6804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c240553ce044eedb41541d72b9475d7" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:21:40.944617 14066 raft_consensus.cc:2749] T 3fa34c08b205435dba97346991aa1f92 P cd75a17ab2604397adab03bb8b5fd75c [term 27 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
W20260709 13:21:40.956774  6846 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.68:45071, user_credentials={real_user=slave}} blocked reactor thread for 55813.9us
I20260709 13:21:40.953969 14162 raft_consensus.cc:2749] T 22ccee1b570c4ad3a57bd7aec085b1b4 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:21:40.959164  6880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bf4668eeb70467fb3dc5a0289233b3c" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:21:40.966066  6874 raft_consensus.cc:1275] T 90d42e216d9741e190bca19a781291fd P cd75a17ab2604397adab03bb8b5fd75c [term 22 FOLLOWER]: Refusing update from remote peer b7ab4784c7344b939bc36f639286f377: Log matching property violated. Preceding OpId in replica: term: 20 index: 11. Preceding OpId from leader: term: 22 index: 12. (index mismatch)
W20260709 13:21:40.977092  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 79682.3us
I20260709 13:21:41.013103 14057 consensus_queue.cc:1048] T 90d42e216d9741e190bca19a781291fd P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.001s
W20260709 13:21:41.025106  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 47248.9us
I20260709 13:21:41.027191  6844 leader_election.cc:304] T bd6869f07b5a4885a0b99fbe60c3b175 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 26 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:21:41.027946 14324 raft_consensus.cc:2749] T bd6869f07b5a4885a0b99fbe60c3b175 P cd75a17ab2604397adab03bb8b5fd75c [term 26 FOLLOWER]: Leader election lost for term 26. Reason: could not achieve majority
I20260709 13:21:41.029090  6844 leader_election.cc:304] T d8cee0accdb8499c86d4414b72565a38 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, b7ab4784c7344b939bc36f639286f377
I20260709 13:21:41.029811 14324 raft_consensus.cc:2749] T d8cee0accdb8499c86d4414b72565a38 P cd75a17ab2604397adab03bb8b5fd75c [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 13:21:41.038146 14192 raft_consensus.cc:3055] T bd6869f07b5a4885a0b99fbe60c3b175 P b7ab4784c7344b939bc36f639286f377 [term 25 LEADER]: Stepping down as leader of term 25
I20260709 13:21:41.038668 14192 raft_consensus.cc:740] T bd6869f07b5a4885a0b99fbe60c3b175 P b7ab4784c7344b939bc36f639286f377 [term 25 LEADER]: Becoming Follower/Learner. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
I20260709 13:21:41.039745 14192 consensus_queue.cc:260] T bd6869f07b5a4885a0b99fbe60c3b175 P b7ab4784c7344b939bc36f639286f377 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 25.13, Last appended by leader: 13, Current term: 25, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:41.053262 14192 raft_consensus.cc:3060] T bd6869f07b5a4885a0b99fbe60c3b175 P b7ab4784c7344b939bc36f639286f377 [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:21:41.048420  6844 leader_election.cc:304] T 30e88460611e47b2ba16a46a30b5f416 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:21:41.057914 14257 raft_consensus.cc:2749] T 30e88460611e47b2ba16a46a30b5f416 P cd75a17ab2604397adab03bb8b5fd75c [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:21:41.061044  6844 leader_election.cc:304] T 2c240553ce044eedb41541d72b9475d7 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:21:41.061862 14257 raft_consensus.cc:2749] T 2c240553ce044eedb41541d72b9475d7 P cd75a17ab2604397adab03bb8b5fd75c [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 13:21:41.131165  6697 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 185290us
I20260709 13:21:41.167285  6800 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "713b5728a197487c9300b310ab94e5a3"
dest_uuid: "b7ab4784c7344b939bc36f639286f377"
mode: GRACEFUL
new_leader_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
 from {username='slave'} at 127.0.0.1:38240
I20260709 13:21:41.173430  6800 raft_consensus.cc:606] T 713b5728a197487c9300b310ab94e5a3 P b7ab4784c7344b939bc36f639286f377 [term 18 FOLLOWER]: Received request to transfer leadership to TS cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:21:41.174028  6800 raft_consensus.cc:614] T 713b5728a197487c9300b310ab94e5a3 P b7ab4784c7344b939bc36f639286f377 [term 18 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 13:21:41.172295  6772 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 73718.1us
I20260709 13:21:41.176602  6772 leader_election.cc:304] T 1bf4668eeb70467fb3dc5a0289233b3c P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:21:41.182564  6804 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "90d42e216d9741e190bca19a781291fd"
dest_uuid: "b7ab4784c7344b939bc36f639286f377"
mode: GRACEFUL
new_leader_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
 from {username='slave'} at 127.0.0.1:38240
I20260709 13:21:41.183360  6804 raft_consensus.cc:606] T 90d42e216d9741e190bca19a781291fd P b7ab4784c7344b939bc36f639286f377 [term 22 LEADER]: Received request to transfer leadership to TS cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:21:41.185812 13684 raft_consensus.cc:2749] T 1bf4668eeb70467fb3dc5a0289233b3c P b7ab4784c7344b939bc36f639286f377 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:21:41.186252 14017 consensus_queue.cc:1048] T 90d42e216d9741e190bca19a781291fd P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:21:41.191105  6804 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "bb7fa124c3bf4ef9ab65a407cb008441"
dest_uuid: "b7ab4784c7344b939bc36f639286f377"
mode: GRACEFUL
new_leader_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
 from {username='slave'} at 127.0.0.1:38240
I20260709 13:21:41.191787  6804 raft_consensus.cc:606] T bb7fa124c3bf4ef9ab65a407cb008441 P b7ab4784c7344b939bc36f639286f377 [term 18 LEADER]: Received request to transfer leadership to TS cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:21:41.227169 14038 raft_consensus.cc:993] T bb7fa124c3bf4ef9ab65a407cb008441 P b7ab4784c7344b939bc36f639286f377: : Instructing follower cd75a17ab2604397adab03bb8b5fd75c to start an election
I20260709 13:21:41.227670 14038 raft_consensus.cc:1081] T bb7fa124c3bf4ef9ab65a407cb008441 P b7ab4784c7344b939bc36f639286f377 [term 18 LEADER]: Signalling peer cd75a17ab2604397adab03bb8b5fd75c to start an election
W20260709 13:21:41.234993  6695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 293340us
I20260709 13:21:41.242244  6800 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ce4f062dcd314d43a63ca74067cb5ee3"
dest_uuid: "b7ab4784c7344b939bc36f639286f377"
mode: GRACEFUL
new_leader_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
 from {username='slave'} at 127.0.0.1:38240
I20260709 13:21:41.242918  6800 raft_consensus.cc:606] T ce4f062dcd314d43a63ca74067cb5ee3 P b7ab4784c7344b939bc36f639286f377 [term 16 FOLLOWER]: Received request to transfer leadership to TS cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:21:41.243278  6800 raft_consensus.cc:614] T ce4f062dcd314d43a63ca74067cb5ee3 P b7ab4784c7344b939bc36f639286f377 [term 16 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:21:41.296327  6800 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "dbdf895bba214ff68685a24fd17dfb5d"
dest_uuid: "b7ab4784c7344b939bc36f639286f377"
mode: GRACEFUL
new_leader_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
 from {username='slave'} at 127.0.0.1:38240
I20260709 13:21:41.300994  6800 raft_consensus.cc:606] T dbdf895bba214ff68685a24fd17dfb5d P b7ab4784c7344b939bc36f639286f377 [term 20 FOLLOWER]: Received request to transfer leadership to TS cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:21:41.301429  6800 raft_consensus.cc:614] T dbdf895bba214ff68685a24fd17dfb5d P b7ab4784c7344b939bc36f639286f377 [term 20 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:21:41.319824  6874 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "bb7fa124c3bf4ef9ab65a407cb008441"
dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
 from {username='slave'} at 127.0.0.1:53406
I20260709 13:21:41.320541  6874 raft_consensus.cc:493] T bb7fa124c3bf4ef9ab65a407cb008441 P cd75a17ab2604397adab03bb8b5fd75c [term 18 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:21:41.320909  6874 raft_consensus.cc:3060] T bb7fa124c3bf4ef9ab65a407cb008441 P cd75a17ab2604397adab03bb8b5fd75c [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:21:41.326670  6732 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f5be3a11b23d4ea9b08300a2789821c7"
dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
mode: GRACEFUL
new_leader_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
 from {username='slave'} at 127.0.0.1:38536
I20260709 13:21:41.327343  6732 raft_consensus.cc:606] T f5be3a11b23d4ea9b08300a2789821c7 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 21 FOLLOWER]: Received request to transfer leadership to TS cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:21:41.327682  6732 raft_consensus.cc:614] T f5be3a11b23d4ea9b08300a2789821c7 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 21 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:21:41.337779  5625 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 13:21:41.344197 14192 raft_consensus.cc:993] T 90d42e216d9741e190bca19a781291fd P b7ab4784c7344b939bc36f639286f377: : Instructing follower cd75a17ab2604397adab03bb8b5fd75c to start an election
I20260709 13:21:41.345028 14338 raft_consensus.cc:1081] T 90d42e216d9741e190bca19a781291fd P b7ab4784c7344b939bc36f639286f377 [term 22 LEADER]: Signalling peer cd75a17ab2604397adab03bb8b5fd75c to start an election
I20260709 13:21:41.354039  6873 raft_consensus.cc:1240] T d8cee0accdb8499c86d4414b72565a38 P cd75a17ab2604397adab03bb8b5fd75c [term 22 FOLLOWER]: Rejecting Update request from peer b7ab4784c7344b939bc36f639286f377 for earlier term 21. Current term is 22. Ops: []
I20260709 13:21:41.364517  5625 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:21:41.373766  6873 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "90d42e216d9741e190bca19a781291fd"
dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
 from {username='slave'} at 127.0.0.1:53406
I20260709 13:21:41.374897  6873 raft_consensus.cc:493] T 90d42e216d9741e190bca19a781291fd P cd75a17ab2604397adab03bb8b5fd75c [term 22 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:21:41.375917  6873 raft_consensus.cc:3060] T 90d42e216d9741e190bca19a781291fd P cd75a17ab2604397adab03bb8b5fd75c [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:21:41.384701  6873 raft_consensus.cc:515] T 90d42e216d9741e190bca19a781291fd P cd75a17ab2604397adab03bb8b5fd75c [term 23 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:41.386780  6873 leader_election.cc:290] T 90d42e216d9741e190bca19a781291fd P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 23 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:21:41.392745  6732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90d42e216d9741e190bca19a781291fd" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: true dest_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832"
I20260709 13:21:41.393548  6732 raft_consensus.cc:3060] T 90d42e216d9741e190bca19a781291fd P ccd8a4c3bfe3413cb2ae219b09aea832 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:21:41.375751  6874 raft_consensus.cc:515] T bb7fa124c3bf4ef9ab65a407cb008441 P cd75a17ab2604397adab03bb8b5fd75c [term 19 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:21:41.415081  6732 raft_consensus.cc:2468] T 90d42e216d9741e190bca19a781291fd P ccd8a4c3bfe3413cb2ae219b09aea832 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 23.
W20260709 13:21:41.421772  6621 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:51654 (request call id 87) took 18479 ms (client timeout 15000 ms). Trace:
I20260709 13:21:41.430402 14275 consensus_queue.cc:1059] T d8cee0accdb8499c86d4414b72565a38 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: INVALID_TERM, Last received: 21.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 13:21:41.431718 14275 raft_consensus.cc:3055] T d8cee0accdb8499c86d4414b72565a38 P b7ab4784c7344b939bc36f639286f377 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:21:41.432168 14275 raft_consensus.cc:740] T d8cee0accdb8499c86d4414b72565a38 P b7ab4784c7344b939bc36f639286f377 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
I20260709 13:21:41.433599  6805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90d42e216d9741e190bca19a781291fd" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: true dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:21:41.434367  6805 raft_consensus.cc:3055] T 90d42e216d9741e190bca19a781291fd P b7ab4784c7344b939bc36f639286f377 [term 22 LEADER]: Stepping down as leader of term 22
I20260709 13:21:41.434708  6805 raft_consensus.cc:740] T 90d42e216d9741e190bca19a781291fd P b7ab4784c7344b939bc36f639286f377 [term 22 LEADER]: Becoming Follower/Learner. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
I20260709 13:21:41.443755  7495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb7fa124c3bf4ef9ab65a407cb008441" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: true dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb"
I20260709 13:21:41.444307  6844 leader_election.cc:304] T 90d42e216d9741e190bca19a781291fd P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:21:41.444574  7495 raft_consensus.cc:3060] T bb7fa124c3bf4ef9ab65a407cb008441 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:21:41.446244 14323 raft_consensus.cc:2804] T 90d42e216d9741e190bca19a781291fd P cd75a17ab2604397adab03bb8b5fd75c [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:21:41.446900 14323 raft_consensus.cc:697] T 90d42e216d9741e190bca19a781291fd P cd75a17ab2604397adab03bb8b5fd75c [term 23 LEADER]: Becoming Leader. State: Replica: cd75a17ab2604397adab03bb8b5fd75c, State: Running, Role: LEADER
I20260709 13:21:41.447809 14323 consensus_queue.cc:237] T 90d42e216d9741e190bca19a781291fd P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 22.12, Last appended by leader: 12, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:41.457437  6874 leader_election.cc:290] T bb7fa124c3bf4ef9ab65a407cb008441 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 19 election: Requested vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:21:41.460335  7495 raft_consensus.cc:2468] T bb7fa124c3bf4ef9ab65a407cb008441 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 19.
I20260709 13:21:41.457772  6805 consensus_queue.cc:260] T 90d42e216d9741e190bca19a781291fd P b7ab4784c7344b939bc36f639286f377 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 22.12, Last appended by leader: 12, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:41.469393  6805 raft_consensus.cc:3060] T 90d42e216d9741e190bca19a781291fd P b7ab4784c7344b939bc36f639286f377 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:21:41.472157  6846 leader_election.cc:304] T bb7fa124c3bf4ef9ab65a407cb008441 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:21:41.483412  6800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb7fa124c3bf4ef9ab65a407cb008441" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: true dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:21:41.487673  6800 raft_consensus.cc:3055] T bb7fa124c3bf4ef9ab65a407cb008441 P b7ab4784c7344b939bc36f639286f377 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:21:41.477546 14297 raft_consensus.cc:2804] T bb7fa124c3bf4ef9ab65a407cb008441 P cd75a17ab2604397adab03bb8b5fd75c [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:21:41.501868  6805 raft_consensus.cc:2468] T 90d42e216d9741e190bca19a781291fd P b7ab4784c7344b939bc36f639286f377 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 23.
I20260709 13:21:41.433473 14275 consensus_queue.cc:260] T d8cee0accdb8499c86d4414b72565a38 P b7ab4784c7344b939bc36f639286f377 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 21.15, Last appended by leader: 15, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:21:41.482052 14162 raft_consensus.cc:493] T bd6869f07b5a4885a0b99fbe60c3b175 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:21:41.488247  6800 raft_consensus.cc:740] T bb7fa124c3bf4ef9ab65a407cb008441 P b7ab4784c7344b939bc36f639286f377 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
I20260709 13:21:41.513157 14297 raft_consensus.cc:697] T bb7fa124c3bf4ef9ab65a407cb008441 P cd75a17ab2604397adab03bb8b5fd75c [term 19 LEADER]: Becoming Leader. State: Replica: cd75a17ab2604397adab03bb8b5fd75c, State: Running, Role: LEADER
I20260709 13:21:41.525758  6800 consensus_queue.cc:260] T bb7fa124c3bf4ef9ab65a407cb008441 P b7ab4784c7344b939bc36f639286f377 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 13, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
W20260709 13:21:41.424614  6621 rpcz_store.cc:269] 0709 13:21:22.942172 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:21:35.912478 (+12970306us) service_pool.cc:224] Handling call
0709 13:21:36.328596 (+416118us) spinlock_profiling.cc:243] Waited 253 ms on lock 0x7b5400156154. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f914090 00007fcc0f9b2f3a 00007fcc157691cc 00007fcc1586737e 00007fcc13d282a4 00007fcc13d28232 00007fcc13d28161 00007fcc13d280dc 00007fcc13d27392 00007fcc0dce548c 00007fcc0dce48c6
0709 13:21:41.421639 (+5093043us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:21:39.298783 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:21:39.299797 (+  1014us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:21:39.299879 (+    82us) write_op.cc:435] Acquired schema lock
0709 13:21:39.299918 (+    39us) tablet.cc:662] Decoding operations
0709 13:21:39.371444 (+ 71526us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:21:39.371622 (+   178us) write_op.cc:641] Partition lock acquired for write op
0709 13:21:39.371706 (+    84us) tablet.cc:685] Acquiring locks for 13 operations
0709 13:21:39.374060 (+  2354us) tablet.cc:701] Row locks acquired
0709 13:21:39.374147 (+    87us) write_op.cc:260] PREPARE: finished
0709 13:21:39.374528 (+   381us) write_op.cc:270] Start()
0709 13:21:39.374854 (+   326us) write_op.cc:276] Timestamp: P: 1783603299374408 usec, L: 0
0709 13:21:39.374922 (+    68us) op_driver.cc:348] REPLICATION: starting
0709 13:21:39.530805 (+155883us) log.cc:844] Serialized 5245 byte log entry
0709 13:21:39.692936 (+162131us) spinlock_profiling.cc:243] Waited 4.13 ms on lock 0x7b5400156154. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f9a5e28 00007fcc133e0581 00007fcc133dfd58 00007fcc133e49f1 00007fcc133e49a9 00007fcc133e4939 00007fcc133e4901 00007fcc133e3b2d 000000000038f354 000000000038f199
0709 13:21:39.936133 (+243197us) op_driver.cc:464] REPLICATION: finished
0709 13:21:40.415439 (+479306us) write_op.cc:301] APPLY: starting
0709 13:21:40.431135 (+ 15696us) tablet.cc:1367] starting BulkCheckPresence
0709 13:21:40.680783 (+249648us) tablet.cc:1370] finished BulkCheckPresence
0709 13:21:40.680837 (+    54us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:21:41.031396 (+350559us) spinlock_profiling.cc:243] Waited 16.1 ms on lock 0x7b1800455fe0. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc15785de1 00007fcc157925b1 00007fcc0f6e90ec 00007fcc0f735c0a 00007fcc0f7354f7 00007fcc0f735490 00007fcc0f6ecf48 00007fcc134011bb 00007fcc134485d4 00007fcc132f48da 00007fcc132f73cb
0709 13:21:41.032966 (+  1570us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:21:41.086888 (+ 53922us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=26,key_file_lookups=26,delta_file_lookups=26,mrs_lookups=0
0709 13:21:41.086958 (+    70us) write_op.cc:312] APPLY: finished
0709 13:21:41.087394 (+   436us) log.cc:844] Serialized 120 byte log entry
0709 13:21:41.241391 (+153997us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:21:41.245192 (+  3801us) write_op.cc:454] Released schema lock
0709 13:21:41.255694 (+ 10502us) write_op.cc:341] FINISH: Updating metrics
0709 13:21:41.306110 (+ 50416us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:21:41.306141 (+    31us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":93733,"reported_tablets":18,"spinlock_wait_cycles":581406464,"child_traces":[["op",{"apply.queue_time_us":470594,"apply.run_cpu_time_us":42220,"apply.run_wall_time_us":879791,"cfile_cache_hit":54,"cfile_cache_hit_bytes":58415,"num_ops":13,"prepare.queue_time_us":535665,"prepare.run_cpu_time_us":19215,"prepare.run_wall_time_us":394576,"raft.queue_time_us":149193,"raft.run_cpu_time_us":38868,"raft.run_wall_time_us":445034,"replication_time_us":539791,"spinlock_wait_cycles":46498944,"thread_start_us":1250640,"threads_started":5,"wal-append.queue_time_us":263720,"wal-append.run_cpu_time_us":32105,"wal-append.run_wall_time_us":1178007}]]}
I20260709 13:21:41.521450 14162 raft_consensus.cc:515] T bd6869f07b5a4885a0b99fbe60c3b175 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:41.539283 14297 consensus_queue.cc:237] T bb7fa124c3bf4ef9ab65a407cb008441 P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 13, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:21:41.555258 14275 raft_consensus.cc:3060] T d8cee0accdb8499c86d4414b72565a38 P b7ab4784c7344b939bc36f639286f377 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:21:41.557575 14162 leader_election.cc:290] T bd6869f07b5a4885a0b99fbe60c3b175 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:21:41.562024  6801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6869f07b5a4885a0b99fbe60c3b175" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 26 candidate_status { last_received { term: 25 index: 13 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:21:41.587525  6801 raft_consensus.cc:2468] T bd6869f07b5a4885a0b99fbe60c3b175 P b7ab4784c7344b939bc36f639286f377 [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 26.
I20260709 13:21:41.567080  6880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6869f07b5a4885a0b99fbe60c3b175" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 26 candidate_status { last_received { term: 25 index: 13 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:21:41.588888  6880 raft_consensus.cc:2393] T bd6869f07b5a4885a0b99fbe60c3b175 P cd75a17ab2604397adab03bb8b5fd75c [term 26 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ccd8a4c3bfe3413cb2ae219b09aea832 in current term 26: Already voted for candidate cd75a17ab2604397adab03bb8b5fd75c in this term.
I20260709 13:21:41.589764  6695 leader_election.cc:304] T bd6869f07b5a4885a0b99fbe60c3b175 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 
I20260709 13:21:41.570170  6800 raft_consensus.cc:3060] T bb7fa124c3bf4ef9ab65a407cb008441 P b7ab4784c7344b939bc36f639286f377 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:21:41.591060 14236 raft_consensus.cc:2804] T bd6869f07b5a4885a0b99fbe60c3b175 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 13:21:41.592669 14236 raft_consensus.cc:493] T bd6869f07b5a4885a0b99fbe60c3b175 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 25 FOLLOWER]: Starting leader election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:21:41.598567 14236 raft_consensus.cc:3060] T bd6869f07b5a4885a0b99fbe60c3b175 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:21:41.633319  6800 raft_consensus.cc:2468] T bb7fa124c3bf4ef9ab65a407cb008441 P b7ab4784c7344b939bc36f639286f377 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 19.
I20260709 13:21:41.671329 14236 raft_consensus.cc:515] T bd6869f07b5a4885a0b99fbe60c3b175 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 26 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:41.717826  6629 catalog_manager.cc:5697] T dbdf895bba214ff68685a24fd17dfb5d P b7ab4784c7344b939bc36f639286f377 reported cstate change: term changed from 14 to 17, leader changed from b7ab4784c7344b939bc36f639286f377 (127.5.126.66) to cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67). New cstate: current_term: 17 leader_uuid: "cd75a17ab2604397adab03bb8b5fd75c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } }
I20260709 13:21:41.723397  6629 catalog_manager.cc:5697] T 9b3759de40694069b13c0f8bd40e5709 P b7ab4784c7344b939bc36f639286f377 reported cstate change: term changed from 13 to 17. New cstate: current_term: 17 leader_uuid: "b7ab4784c7344b939bc36f639286f377" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:41.737771  6629 catalog_manager.cc:5697] T 3a485a995abc4807b6e511e45419f737 P b7ab4784c7344b939bc36f639286f377 reported cstate change: term changed from 15 to 17, leader changed from ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65) to b7ab4784c7344b939bc36f639286f377 (127.5.126.66). New cstate: current_term: 17 leader_uuid: "b7ab4784c7344b939bc36f639286f377" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } health_report { overall_health: HEALTHY } } }
I20260709 13:21:41.744863  6629 catalog_manager.cc:5697] T 7c37d41cd9164c15a6826ca62a851a69 P b7ab4784c7344b939bc36f639286f377 reported cstate change: term changed from 15 to 19. New cstate: current_term: 19 leader_uuid: "b7ab4784c7344b939bc36f639286f377" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } health_report { overall_health: HEALTHY } } }
I20260709 13:21:41.752229  6629 catalog_manager.cc:5697] T 713b5728a197487c9300b310ab94e5a3 P b7ab4784c7344b939bc36f639286f377 reported cstate change: term changed from 14 to 16, leader changed from b7ab4784c7344b939bc36f639286f377 (127.5.126.66) to ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65). New cstate: current_term: 16 leader_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } }
I20260709 13:21:41.758841  6629 catalog_manager.cc:5697] T 853ac0a8cbd64ce99457f170216d4d0f P b7ab4784c7344b939bc36f639286f377 reported cstate change: term changed from 14 to 15, leader changed from b7ab4784c7344b939bc36f639286f377 (127.5.126.66) to cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67). New cstate: current_term: 15 leader_uuid: "cd75a17ab2604397adab03bb8b5fd75c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } }
I20260709 13:21:41.759718 14236 leader_election.cc:290] T bd6869f07b5a4885a0b99fbe60c3b175 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 26 election: Requested vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:21:41.761765  6801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6869f07b5a4885a0b99fbe60c3b175" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 26 candidate_status { last_received { term: 25 index: 13 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:21:41.764887  6881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6869f07b5a4885a0b99fbe60c3b175" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 26 candidate_status { last_received { term: 25 index: 13 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:21:41.765782  6881 raft_consensus.cc:2393] T bd6869f07b5a4885a0b99fbe60c3b175 P cd75a17ab2604397adab03bb8b5fd75c [term 26 FOLLOWER]: Leader election vote request: Denying vote to candidate ccd8a4c3bfe3413cb2ae219b09aea832 in current term 26: Already voted for candidate cd75a17ab2604397adab03bb8b5fd75c in this term.
I20260709 13:21:41.773806  6801 raft_consensus.cc:2468] T bd6869f07b5a4885a0b99fbe60c3b175 P b7ab4784c7344b939bc36f639286f377 [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ccd8a4c3bfe3413cb2ae219b09aea832 in term 26.
I20260709 13:21:41.784926  6695 leader_election.cc:304] T bd6869f07b5a4885a0b99fbe60c3b175 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 26 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832; no voters: cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:21:41.786329 14361 raft_consensus.cc:2804] T bd6869f07b5a4885a0b99fbe60c3b175 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 26 FOLLOWER]: Leader election won for term 26
I20260709 13:21:41.786926 14361 raft_consensus.cc:697] T bd6869f07b5a4885a0b99fbe60c3b175 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 26 LEADER]: Becoming Leader. State: Replica: ccd8a4c3bfe3413cb2ae219b09aea832, State: Running, Role: LEADER
I20260709 13:21:41.780416  6719 tablet_service.cc:1558] Processing DeleteTablet for tablet ce4f062dcd314d43a63ca74067cb5ee3 with delete_type TABLET_DATA_TOMBSTONED (TS ccd8a4c3bfe3413cb2ae219b09aea832 not found in new config with opid_index 11) from {username='slave'} at 127.0.0.1:55770
I20260709 13:21:41.787961 14361 consensus_queue.cc:237] T bd6869f07b5a4885a0b99fbe60c3b175 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 25.13, Last appended by leader: 13, Current term: 26, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
W20260709 13:21:41.782387  6772 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 45200.2us
I20260709 13:21:41.776650  6629 catalog_manager.cc:5697] T f4b8bd455d5a47c18a1380839c6e0d61 P b7ab4784c7344b939bc36f639286f377 reported cstate change: term changed from 5 to 18, leader changed from ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65) to b7ab4784c7344b939bc36f639286f377 (127.5.126.66). New cstate: current_term: 18 leader_uuid: "b7ab4784c7344b939bc36f639286f377" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } health_report { overall_health: HEALTHY } } }
I20260709 13:21:41.796275  6629 catalog_manager.cc:5697] T be1a92657f494cac8dd227d152f50151 P b7ab4784c7344b939bc36f639286f377 reported cstate change: term changed from 16 to 20. New cstate: current_term: 20 leader_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } } }
I20260709 13:21:41.800345  6629 catalog_manager.cc:5697] T f58dc08b12a2494bb9a1372837970ca2 P b7ab4784c7344b939bc36f639286f377 reported cstate change: term changed from 16 to 18. New cstate: current_term: 18 leader_uuid: "b7ab4784c7344b939bc36f639286f377" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } health_report { overall_health: HEALTHY } } }
I20260709 13:21:41.802884  6629 catalog_manager.cc:5697] T 34f36d59d88f40fe8a2805e604fc6c0a P b7ab4784c7344b939bc36f639286f377 reported cstate change: term changed from 14 to 16. New cstate: current_term: 16 leader_uuid: "b7ab4784c7344b939bc36f639286f377" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } health_report { overall_health: HEALTHY } } }
I20260709 13:21:41.812882  6629 catalog_manager.cc:5697] T 90d42e216d9741e190bca19a781291fd P b7ab4784c7344b939bc36f639286f377 reported cstate change: term changed from 12 to 18. New cstate: current_term: 18 leader_uuid: "b7ab4784c7344b939bc36f639286f377" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } health_report { overall_health: HEALTHY } } }
I20260709 13:21:41.814914  6629 catalog_manager.cc:5697] T f5be3a11b23d4ea9b08300a2789821c7 P b7ab4784c7344b939bc36f639286f377 reported cstate change: term changed from 14 to 18, leader changed from ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65) to b7ab4784c7344b939bc36f639286f377 (127.5.126.66). New cstate: current_term: 18 leader_uuid: "b7ab4784c7344b939bc36f639286f377" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } health_report { overall_health: HEALTHY } } }
I20260709 13:21:41.817299 14373 tablet_replica.cc:333] T ce4f062dcd314d43a63ca74067cb5ee3 P ccd8a4c3bfe3413cb2ae219b09aea832: stopping tablet replica
I20260709 13:21:41.818545 14373 raft_consensus.cc:2243] T ce4f062dcd314d43a63ca74067cb5ee3 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:41.818002  6629 catalog_manager.cc:5697] T 9e326172347f45e99a0d482b5d8ef768 P b7ab4784c7344b939bc36f639286f377 reported cstate change: term changed from 12 to 14. New cstate: current_term: 14 leader_uuid: "b7ab4784c7344b939bc36f639286f377" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } health_report { overall_health: HEALTHY } } }
I20260709 13:21:41.819379 14373 raft_consensus.cc:2272] T ce4f062dcd314d43a63ca74067cb5ee3 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:41.819670  6629 catalog_manager.cc:5697] T 8c7f33e544204fbaac4078e3e83bbf4e P b7ab4784c7344b939bc36f639286f377 reported cstate change: term changed from 13 to 16, leader changed from ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65) to b7ab4784c7344b939bc36f639286f377 (127.5.126.66). New cstate: current_term: 16 leader_uuid: "b7ab4784c7344b939bc36f639286f377" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:41.928828  6629 catalog_manager.cc:5697] T b56bf91d90824c959e21e0cee5ba1816 P b7ab4784c7344b939bc36f639286f377 reported cstate change: term changed from 12 to 18, leader changed from cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67) to b7ab4784c7344b939bc36f639286f377 (127.5.126.66). New cstate: current_term: 18 leader_uuid: "b7ab4784c7344b939bc36f639286f377" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } health_report { overall_health: HEALTHY } } }
I20260709 13:21:41.937599  6732 raft_consensus.cc:1275] T 90d42e216d9741e190bca19a781291fd P ccd8a4c3bfe3413cb2ae219b09aea832 [term 23 FOLLOWER]: Refusing update from remote peer cd75a17ab2604397adab03bb8b5fd75c: Log matching property violated. Preceding OpId in replica: term: 22 index: 12. Preceding OpId from leader: term: 23 index: 13. (index mismatch)
I20260709 13:21:41.940485  6629 catalog_manager.cc:5697] T 7887766dc6784fcaa42b35c05fea7a99 P b7ab4784c7344b939bc36f639286f377 reported cstate change: term changed from 16 to 20, leader changed from ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65) to b7ab4784c7344b939bc36f639286f377 (127.5.126.66). New cstate: current_term: 20 leader_uuid: "b7ab4784c7344b939bc36f639286f377" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } health_report { overall_health: HEALTHY } } }
I20260709 13:21:41.941025 14373 ts_tablet_manager.cc:1916] T ce4f062dcd314d43a63ca74067cb5ee3 P ccd8a4c3bfe3413cb2ae219b09aea832: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:21:41.971999  6614 catalog_manager.cc:5244] ChangeConfig:REMOVE_PEER RPC for tablet ce4f062dcd314d43a63ca74067cb5ee3 with cas_config_opid_index 3: aborting the task: latest config opid_index 11; task opid_index 3
I20260709 13:21:41.992167  6629 catalog_manager.cc:5697] T 711ef6523deb4cbe8ef2ba61e1c21c98 P b7ab4784c7344b939bc36f639286f377 reported cstate change: term changed from 17 to 21, leader changed from cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67) to ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65). New cstate: current_term: 21 leader_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } }
I20260709 13:21:42.002635  6629 catalog_manager.cc:5697] T 3d65025eea89441290d85dd053810e31 P b7ab4784c7344b939bc36f639286f377 reported cstate change: term changed from 15 to 20, leader changed from ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65) to b7ab4784c7344b939bc36f639286f377 (127.5.126.66). New cstate: current_term: 20 leader_uuid: "b7ab4784c7344b939bc36f639286f377" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:42.022051 14373 ts_tablet_manager.cc:1929] T ce4f062dcd314d43a63ca74067cb5ee3 P ccd8a4c3bfe3413cb2ae219b09aea832: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 15.10
I20260709 13:21:42.032143 14373 log.cc:1199] T ce4f062dcd314d43a63ca74067cb5ee3 P ccd8a4c3bfe3413cb2ae219b09aea832: Deleting WAL directory at /tmp/dist-test-taskWHb0CB/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783603057096655-5625-0/minicluster-data/ts-0-root/wals/ce4f062dcd314d43a63ca74067cb5ee3
I20260709 13:21:41.983305 14297 consensus_queue.cc:1048] T 90d42e216d9741e190bca19a781291fd P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Connected to new peer: Peer: permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.017s
I20260709 13:21:42.006394  6629 catalog_manager.cc:5697] T 44bde925b2e541b69890d70715b85176 P b7ab4784c7344b939bc36f639286f377 reported cstate change: term changed from 15 to 19. New cstate: current_term: 19 leader_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } }
I20260709 13:21:42.053289  6800 raft_consensus.cc:1275] T 90d42e216d9741e190bca19a781291fd P b7ab4784c7344b939bc36f639286f377 [term 23 FOLLOWER]: Refusing update from remote peer cd75a17ab2604397adab03bb8b5fd75c: Log matching property violated. Preceding OpId in replica: term: 22 index: 12. Preceding OpId from leader: term: 23 index: 13. (index mismatch)
I20260709 13:21:42.040129  6801 raft_consensus.cc:1275] T bb7fa124c3bf4ef9ab65a407cb008441 P b7ab4784c7344b939bc36f639286f377 [term 19 FOLLOWER]: Refusing update from remote peer cd75a17ab2604397adab03bb8b5fd75c: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 13:21:42.054654  6629 catalog_manager.cc:5697] T e31b9971c15848dea59d4d4130141d9e P b7ab4784c7344b939bc36f639286f377 reported cstate change: term changed from 13 to 17. New cstate: current_term: 17 leader_uuid: "b7ab4784c7344b939bc36f639286f377" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:42.056960  6629 catalog_manager.cc:5697] T 20f6842e26174571996b8dea4151d4be P b7ab4784c7344b939bc36f639286f377 reported cstate change: term changed from 17 to 20, leader changed from ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65) to b7ab4784c7344b939bc36f639286f377 (127.5.126.66). New cstate: current_term: 20 leader_uuid: "b7ab4784c7344b939bc36f639286f377" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:42.058519  6629 catalog_manager.cc:5697] T 4275cf08e63345f993bce8664eada830 P b7ab4784c7344b939bc36f639286f377 reported cstate change: term changed from 13 to 17. New cstate: current_term: 17 leader_uuid: "b7ab4784c7344b939bc36f639286f377" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } health_report { overall_health: UNKNOWN } } }
W20260709 13:21:42.061023  6772 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 117904us
I20260709 13:21:42.086928  6614 catalog_manager.cc:5028] TS ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): tablet ce4f062dcd314d43a63ca74067cb5ee3 (table test-workload [id=04f4d366747e43549980077479ed75b9]) successfully deleted
I20260709 13:21:42.088088  6629 catalog_manager.cc:5697] T e77e330a82df4b43a745d57a68f6f057 P b7ab4784c7344b939bc36f639286f377 reported cstate change: term changed from 16 to 19, leader changed from b7ab4784c7344b939bc36f639286f377 (127.5.126.66) to ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65). New cstate: current_term: 19 leader_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } }
I20260709 13:21:42.090097  6629 catalog_manager.cc:5697] T f3f9c2e2bf644115957398fe4c9459db P b7ab4784c7344b939bc36f639286f377 reported cstate change: term changed from 15 to 17. New cstate: current_term: 17 leader_uuid: "cd75a17ab2604397adab03bb8b5fd75c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } }
I20260709 13:21:42.101740  7495 raft_consensus.cc:1275] T bb7fa124c3bf4ef9ab65a407cb008441 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 19 FOLLOWER]: Refusing update from remote peer cd75a17ab2604397adab03bb8b5fd75c: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 13:21:42.104079 14295 consensus_queue.cc:1048] T bb7fa124c3bf4ef9ab65a407cb008441 P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:21:42.115566  6629 catalog_manager.cc:5697] T f03d0dbf16864ca4bc1bb5e4c0334c0f P b7ab4784c7344b939bc36f639286f377 reported cstate change: term changed from 15 to 19, leader changed from ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65) to b7ab4784c7344b939bc36f639286f377 (127.5.126.66). New cstate: current_term: 19 leader_uuid: "b7ab4784c7344b939bc36f639286f377" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } health_report { overall_health: HEALTHY } } }
I20260709 13:21:42.107833 14066 consensus_queue.cc:1048] T 90d42e216d9741e190bca19a781291fd P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:21:42.116560 14322 consensus_queue.cc:1048] T bb7fa124c3bf4ef9ab65a407cb008441 P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:21:42.191052  6881 raft_consensus.cc:1275] T bd6869f07b5a4885a0b99fbe60c3b175 P cd75a17ab2604397adab03bb8b5fd75c [term 26 FOLLOWER]: Refusing update from remote peer ccd8a4c3bfe3413cb2ae219b09aea832: Log matching property violated. Preceding OpId in replica: term: 23 index: 12. Preceding OpId from leader: term: 26 index: 14. (index mismatch)
I20260709 13:21:42.192600 14236 consensus_queue.cc:1048] T bd6869f07b5a4885a0b99fbe60c3b175 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.000s
W20260709 13:21:42.517323  6772 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 257192us
I20260709 13:21:42.554502  6800 raft_consensus.cc:1275] T bd6869f07b5a4885a0b99fbe60c3b175 P b7ab4784c7344b939bc36f639286f377 [term 26 FOLLOWER]: Refusing update from remote peer ccd8a4c3bfe3413cb2ae219b09aea832: Log matching property violated. Preceding OpId in replica: term: 25 index: 13. Preceding OpId from leader: term: 26 index: 14. (index mismatch)
W20260709 13:21:42.564886  6772 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 46306.7us
I20260709 13:21:42.572358 14205 consensus_queue.cc:1048] T bd6869f07b5a4885a0b99fbe60c3b175 P ccd8a4c3bfe3413cb2ae219b09aea832 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:21:42.592471  5625 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:21:42.645299 13684 raft_consensus.cc:493] T d8cee0accdb8499c86d4414b72565a38 P b7ab4784c7344b939bc36f639286f377 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:42.646142 13684 raft_consensus.cc:515] T d8cee0accdb8499c86d4414b72565a38 P b7ab4784c7344b939bc36f639286f377 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:21:42.659839 13684 leader_election.cc:290] T d8cee0accdb8499c86d4414b72565a38 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
W20260709 13:21:42.668541 14388 log.cc:927] Time spent T 00000000000000000000000000000000 P b3ae52d33b9a4273a42e5e2cf3b5d6b5: Append to log took a long time: real 0.095s	user 0.002s	sys 0.000s
W20260709 13:21:42.769268  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 433187us
I20260709 13:21:42.815789  6872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8cee0accdb8499c86d4414b72565a38" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:21:42.816505  6872 raft_consensus.cc:2468] T d8cee0accdb8499c86d4414b72565a38 P cd75a17ab2604397adab03bb8b5fd75c [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 22.
I20260709 13:21:42.826591  7495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8cee0accdb8499c86d4414b72565a38" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
W20260709 13:21:42.861382  6695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 77053us
W20260709 13:21:42.870402  7466 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 60383.1us
W20260709 13:21:42.891695  6697 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 68932.2us
I20260709 13:21:42.879899 14396 raft_consensus.cc:493] T d8cee0accdb8499c86d4414b72565a38 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 21 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:21:42.908601 14396 raft_consensus.cc:515] T d8cee0accdb8499c86d4414b72565a38 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:21:42.911144 14396 leader_election.cc:290] T d8cee0accdb8499c86d4414b72565a38 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:21:42.918877  6772 leader_election.cc:304] T d8cee0accdb8499c86d4414b72565a38 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:21:42.919890 14293 raft_consensus.cc:2804] T d8cee0accdb8499c86d4414b72565a38 P b7ab4784c7344b939bc36f639286f377 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:21:42.920406 14293 raft_consensus.cc:493] T d8cee0accdb8499c86d4414b72565a38 P b7ab4784c7344b939bc36f639286f377 [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:42.920761 14293 raft_consensus.cc:3060] T d8cee0accdb8499c86d4414b72565a38 P b7ab4784c7344b939bc36f639286f377 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:21:42.930855  6804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8cee0accdb8499c86d4414b72565a38" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:21:43.007169 14293 raft_consensus.cc:515] T d8cee0accdb8499c86d4414b72565a38 P b7ab4784c7344b939bc36f639286f377 [term 23 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:21:43.014776  6804 raft_consensus.cc:2368] T d8cee0accdb8499c86d4414b72565a38 P b7ab4784c7344b939bc36f639286f377 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ba59cc884714e8aa5f3f0ecaed84cbb for earlier term 22. Current term is 23.
I20260709 13:21:43.018726  7466 leader_election.cc:400] T d8cee0accdb8499c86d4414b72565a38 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 22 pre-election: Vote denied by peer b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817) with higher term. Message: Invalid argument: T d8cee0accdb8499c86d4414b72565a38 P b7ab4784c7344b939bc36f639286f377 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ba59cc884714e8aa5f3f0ecaed84cbb for earlier term 22. Current term is 23.
I20260709 13:21:43.019054  7466 leader_election.cc:403] T d8cee0accdb8499c86d4414b72565a38 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 22 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:21:43.019690 14411 raft_consensus.cc:3060] T d8cee0accdb8499c86d4414b72565a38 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 21 FOLLOWER]: Advancing to term 23
/apache/dev/git/kudu/src/kudu/master/auto_leader_rebalancer-test.cc:278: Failure
Failed
Bad status: Illegal state: leader_transfer_task size should be 0, but 6
/apache/dev/git/kudu/src/kudu/util/test_util.cc:402: Failure
Failed
Timed out waiting for assertion to pass.
I20260709 13:21:43.023751  5625 tablet_server.cc:179] TabletServer@127.5.126.65:0 shutting down...
W20260709 13:21:43.029172  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 223447us
I20260709 13:21:43.036314  6874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8cee0accdb8499c86d4414b72565a38" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:21:43.037212  6874 raft_consensus.cc:3060] T d8cee0accdb8499c86d4414b72565a38 P cd75a17ab2604397adab03bb8b5fd75c [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:21:43.052665  6874 raft_consensus.cc:2468] T d8cee0accdb8499c86d4414b72565a38 P cd75a17ab2604397adab03bb8b5fd75c [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 23.
I20260709 13:21:43.036608 14411 raft_consensus.cc:2749] T d8cee0accdb8499c86d4414b72565a38 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 23 FOLLOWER]: Leader pre-election lost for term 22. Reason: Vote denied by peer b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817) with higher term. Message: Invalid argument: T d8cee0accdb8499c86d4414b72565a38 P b7ab4784c7344b939bc36f639286f377 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ba59cc884714e8aa5f3f0ecaed84cbb for earlier term 22. Current term is 23.
I20260709 13:21:43.055831  6772 leader_election.cc:304] T d8cee0accdb8499c86d4414b72565a38 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:21:43.078832  6881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8cee0accdb8499c86d4414b72565a38" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:21:43.080883  6881 raft_consensus.cc:2368] T d8cee0accdb8499c86d4414b72565a38 P cd75a17ab2604397adab03bb8b5fd75c [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ba59cc884714e8aa5f3f0ecaed84cbb for earlier term 22. Current term is 23.
W20260709 13:21:43.129880  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 50904.6us
I20260709 13:21:43.077770 14395 raft_consensus.cc:2804] T d8cee0accdb8499c86d4414b72565a38 P b7ab4784c7344b939bc36f639286f377 [term 23 FOLLOWER]: Leader election won for term 23
W20260709 13:21:43.136994  6844 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 2 similar messages]
I20260709 13:21:43.139997  7495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8cee0accdb8499c86d4414b72565a38" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb"
I20260709 13:21:43.137881 14293 leader_election.cc:290] T d8cee0accdb8499c86d4414b72565a38 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 23 election: Requested vote from peers cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:21:43.151690 14395 raft_consensus.cc:697] T d8cee0accdb8499c86d4414b72565a38 P b7ab4784c7344b939bc36f639286f377 [term 23 LEADER]: Becoming Leader. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
W20260709 13:21:43.193432  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 56473.9us
I20260709 13:21:43.198283  7468 leader_election.cc:400] T d8cee0accdb8499c86d4414b72565a38 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 22 pre-election: Vote denied by peer cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931) with higher term. Message: Invalid argument: T d8cee0accdb8499c86d4414b72565a38 P cd75a17ab2604397adab03bb8b5fd75c [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ba59cc884714e8aa5f3f0ecaed84cbb for earlier term 22. Current term is 23.
I20260709 13:21:43.211961 14395 consensus_queue.cc:237] T d8cee0accdb8499c86d4414b72565a38 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 21.15, Last appended by leader: 15, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:21:43.232240  7495 raft_consensus.cc:2468] T d8cee0accdb8499c86d4414b72565a38 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 23.
W20260709 13:21:43.245175  6844 consensus_peers.cc:597] T e31b9971c15848dea59d4d4130141d9e P cd75a17ab2604397adab03bb8b5fd75c -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:43.261763  6770 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 99402.8us
W20260709 13:21:43.348242  6844 consensus_peers.cc:597] T 34f36d59d88f40fe8a2805e604fc6c0a P cd75a17ab2604397adab03bb8b5fd75c -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:43.363547  7466 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 170641us
W20260709 13:21:43.389731  6844 consensus_peers.cc:597] T c4db81d9d329422bb3b4160ca4ac2d1d P cd75a17ab2604397adab03bb8b5fd75c -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:43.420804  6844 consensus_peers.cc:597] T 1bf4668eeb70467fb3dc5a0289233b3c P cd75a17ab2604397adab03bb8b5fd75c -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:43.423264  6844 consensus_peers.cc:597] T f58dc08b12a2494bb9a1372837970ca2 P cd75a17ab2604397adab03bb8b5fd75c -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:43.426892  7466 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 46861.6us
W20260709 13:21:43.428866  6844 consensus_peers.cc:597] T 9e326172347f45e99a0d482b5d8ef768 P cd75a17ab2604397adab03bb8b5fd75c -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:43.468072  6844 consensus_peers.cc:597] T 90d42e216d9741e190bca19a781291fd P cd75a17ab2604397adab03bb8b5fd75c -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:43.464396  6770 consensus_peers.cc:597] T 4d9def8b32fd443aa94ab1420b06837b P b7ab4784c7344b939bc36f639286f377 -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:43.457185 14406 raft_consensus.cc:493] T e31b9971c15848dea59d4d4130141d9e P ccd8a4c3bfe3413cb2ae219b09aea832 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader cd75a17ab2604397adab03bb8b5fd75c)
W20260709 13:21:43.476233  6770 consensus_peers.cc:597] T 22ccee1b570c4ad3a57bd7aec085b1b4 P b7ab4784c7344b939bc36f639286f377 -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:43.479672 14385 raft_consensus.cc:493] T 9e326172347f45e99a0d482b5d8ef768 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader cd75a17ab2604397adab03bb8b5fd75c)
I20260709 13:21:43.480316 14385 raft_consensus.cc:515] T 9e326172347f45e99a0d482b5d8ef768 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:43.482662 14385 leader_election.cc:290] T 9e326172347f45e99a0d482b5d8ef768 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
W20260709 13:21:43.486399  6770 consensus_peers.cc:597] T 853ac0a8cbd64ce99457f170216d4d0f P b7ab4784c7344b939bc36f639286f377 -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:43.488372  6800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e326172347f45e99a0d482b5d8ef768" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:21:43.504089 14405 raft_consensus.cc:493] T 34f36d59d88f40fe8a2805e604fc6c0a P ccd8a4c3bfe3413cb2ae219b09aea832 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader cd75a17ab2604397adab03bb8b5fd75c)
I20260709 13:21:43.473171 14386 raft_consensus.cc:493] T c4db81d9d329422bb3b4160ca4ac2d1d P ccd8a4c3bfe3413cb2ae219b09aea832 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader cd75a17ab2604397adab03bb8b5fd75c)
W20260709 13:21:43.498337  6770 consensus_peers.cc:597] T 3d65025eea89441290d85dd053810e31 P b7ab4784c7344b939bc36f639286f377 -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:43.524852  7466 consensus_peers.cc:597] T b3f13b31a1f84f0d89d007eadd57924c P 7ba59cc884714e8aa5f3f0ecaed84cbb -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:43.528493  7466 consensus_peers.cc:597] T 24ee15416e3145beaa1b8183453729a3 P 7ba59cc884714e8aa5f3f0ecaed84cbb -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:43.484344 14406 raft_consensus.cc:515] T e31b9971c15848dea59d4d4130141d9e P ccd8a4c3bfe3413cb2ae219b09aea832 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:43.512913 14386 raft_consensus.cc:515] T c4db81d9d329422bb3b4160ca4ac2d1d P ccd8a4c3bfe3413cb2ae219b09aea832 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:43.509790 14405 raft_consensus.cc:515] T 34f36d59d88f40fe8a2805e604fc6c0a P ccd8a4c3bfe3413cb2ae219b09aea832 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:43.594435 14386 leader_election.cc:290] T c4db81d9d329422bb3b4160ca4ac2d1d P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:21:43.595566 14406 leader_election.cc:290] T e31b9971c15848dea59d4d4130141d9e P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
W20260709 13:21:43.613306  6844 consensus_peers.cc:597] T 95a75bfe094d4bdc963aba3f08dfcd25 P cd75a17ab2604397adab03bb8b5fd75c -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:43.617585 14405 leader_election.cc:290] T 34f36d59d88f40fe8a2805e604fc6c0a P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:21:43.628176 14406 raft_consensus.cc:493] T f58dc08b12a2494bb9a1372837970ca2 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader cd75a17ab2604397adab03bb8b5fd75c)
I20260709 13:21:43.628815 14406 raft_consensus.cc:515] T f58dc08b12a2494bb9a1372837970ca2 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:43.648337  6800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e31b9971c15848dea59d4d4130141d9e" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:21:43.652245  6804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4db81d9d329422bb3b4160ca4ac2d1d" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:21:43.654168  6805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34f36d59d88f40fe8a2805e604fc6c0a" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
W20260709 13:21:43.650398  7466 consensus_peers.cc:597] T 427c124d773f483294511e80fe340075 P 7ba59cc884714e8aa5f3f0ecaed84cbb -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:43.658883  6800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f58dc08b12a2494bb9a1372837970ca2" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
W20260709 13:21:43.663502  6844 consensus_peers.cc:597] T 44bde925b2e541b69890d70715b85176 P cd75a17ab2604397adab03bb8b5fd75c -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:43.666935  6881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e326172347f45e99a0d482b5d8ef768" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:21:43.659910 14406 leader_election.cc:290] T f58dc08b12a2494bb9a1372837970ca2 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:21:43.693709  6878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4db81d9d329422bb3b4160ca4ac2d1d" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:21:43.695114  6877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34f36d59d88f40fe8a2805e604fc6c0a" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:21:43.705292  6877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f58dc08b12a2494bb9a1372837970ca2" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:21:43.716298  6881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e31b9971c15848dea59d4d4130141d9e" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
W20260709 13:21:43.721335  6770 consensus_peers.cc:597] T 07a92dd554674067a83a9cb68c4773f2 P b7ab4784c7344b939bc36f639286f377 -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:43.720695  6697 leader_election.cc:304] T 9e326172347f45e99a0d482b5d8ef768 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:21:43.729502 14393 raft_consensus.cc:2749] T 9e326172347f45e99a0d482b5d8ef768 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:21:43.742194  6697 leader_election.cc:304] T c4db81d9d329422bb3b4160ca4ac2d1d P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:21:43.743765  6697 leader_election.cc:304] T 34f36d59d88f40fe8a2805e604fc6c0a P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
W20260709 13:21:43.722886  6770 consensus_peers.cc:597] T 2c240553ce044eedb41541d72b9475d7 P b7ab4784c7344b939bc36f639286f377 -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:43.743721 14406 raft_consensus.cc:2749] T c4db81d9d329422bb3b4160ca4ac2d1d P ccd8a4c3bfe3413cb2ae219b09aea832 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 13:21:43.747718  6770 consensus_peers.cc:597] T f09c2a98de1a4decabd0ff900dd44caa P b7ab4784c7344b939bc36f639286f377 -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:43.751400 14163 raft_consensus.cc:2749] T 34f36d59d88f40fe8a2805e604fc6c0a P ccd8a4c3bfe3413cb2ae219b09aea832 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 13:21:43.750039  6770 consensus_peers.cc:597] T 7887766dc6784fcaa42b35c05fea7a99 P b7ab4784c7344b939bc36f639286f377 -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:43.757228  6770 consensus_peers.cc:597] T 30e88460611e47b2ba16a46a30b5f416 P b7ab4784c7344b939bc36f639286f377 -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:43.759264  6770 consensus_peers.cc:597] T 3a485a995abc4807b6e511e45419f737 P b7ab4784c7344b939bc36f639286f377 -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:43.760008  6770 consensus_peers.cc:597] T f5be3a11b23d4ea9b08300a2789821c7 P b7ab4784c7344b939bc36f639286f377 -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:43.760567  6770 consensus_peers.cc:597] T 8c7f33e544204fbaac4078e3e83bbf4e P b7ab4784c7344b939bc36f639286f377 -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:43.761052  6770 consensus_peers.cc:597] T a1704639a875409b9959353527b3fd68 P b7ab4784c7344b939bc36f639286f377 -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:43.769160  7466 consensus_peers.cc:597] T 404190ce4ce94cecbfcb6ea9d1dd8626 P 7ba59cc884714e8aa5f3f0ecaed84cbb -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:43.769613  7466 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 109149us
W20260709 13:21:43.770241  7466 consensus_peers.cc:597] T 7a734b5ab7834e05a8c422208acc58b1 P 7ba59cc884714e8aa5f3f0ecaed84cbb -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:43.770781  7466 consensus_peers.cc:597] T 3fa34c08b205435dba97346991aa1f92 P 7ba59cc884714e8aa5f3f0ecaed84cbb -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:43.770852  6844 consensus_peers.cc:597] T 713b5728a197487c9300b310ab94e5a3 P cd75a17ab2604397adab03bb8b5fd75c -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:43.757669  6697 leader_election.cc:304] T f58dc08b12a2494bb9a1372837970ca2 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:21:43.798617 14236 raft_consensus.cc:2749] T f58dc08b12a2494bb9a1372837970ca2 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:21:43.800324  6697 leader_election.cc:304] T e31b9971c15848dea59d4d4130141d9e P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:21:43.801599 14236 raft_consensus.cc:2749] T e31b9971c15848dea59d4d4130141d9e P ccd8a4c3bfe3413cb2ae219b09aea832 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:21:43.801666  6770 consensus_peers.cc:597] T 9b3759de40694069b13c0f8bd40e5709 P b7ab4784c7344b939bc36f639286f377 -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:43.803764  7466 consensus_peers.cc:597] T be1a92657f494cac8dd227d152f50151 P 7ba59cc884714e8aa5f3f0ecaed84cbb -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:43.804600  7466 consensus_peers.cc:597] T 17587d6730594da4a56fa13a353232a1 P 7ba59cc884714e8aa5f3f0ecaed84cbb -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:43.802791  6770 consensus_peers.cc:597] T f3f9c2e2bf644115957398fe4c9459db P b7ab4784c7344b939bc36f639286f377 -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:43.814224  6770 consensus_peers.cc:597] T ab432e62819d499eaaf3dd55481dd930 P b7ab4784c7344b939bc36f639286f377 -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:43.814877  6770 consensus_peers.cc:597] T 20f6842e26174571996b8dea4151d4be P b7ab4784c7344b939bc36f639286f377 -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:43.815440  6770 consensus_peers.cc:597] T f03d0dbf16864ca4bc1bb5e4c0334c0f P b7ab4784c7344b939bc36f639286f377 -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:43.815893 14163 raft_consensus.cc:493] T 1bf4668eeb70467fb3dc5a0289233b3c P ccd8a4c3bfe3413cb2ae219b09aea832 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader cd75a17ab2604397adab03bb8b5fd75c)
I20260709 13:21:43.816551 14163 raft_consensus.cc:515] T 1bf4668eeb70467fb3dc5a0289233b3c P ccd8a4c3bfe3413cb2ae219b09aea832 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:43.818759 14163 leader_election.cc:290] T 1bf4668eeb70467fb3dc5a0289233b3c P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:21:43.820997  6804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bf4668eeb70467fb3dc5a0289233b3c" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:21:43.827662  7495 raft_consensus.cc:1275] T d8cee0accdb8499c86d4414b72565a38 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 23 FOLLOWER]: Refusing update from remote peer b7ab4784c7344b939bc36f639286f377: Log matching property violated. Preceding OpId in replica: term: 21 index: 15. Preceding OpId from leader: term: 23 index: 16. (index mismatch)
I20260709 13:21:43.830003 14375 consensus_queue.cc:1048] T d8cee0accdb8499c86d4414b72565a38 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
W20260709 13:21:43.848346  6770 consensus_peers.cc:597] T b56bf91d90824c959e21e0cee5ba1816 P b7ab4784c7344b939bc36f639286f377 -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:43.849061  6875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bf4668eeb70467fb3dc5a0289233b3c" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
W20260709 13:21:43.849233  6770 consensus_peers.cc:597] T 4275cf08e63345f993bce8664eada830 P b7ab4784c7344b939bc36f639286f377 -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:43.874238  6697 leader_election.cc:304] T 1bf4668eeb70467fb3dc5a0289233b3c P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:21:43.880138 14163 raft_consensus.cc:2749] T 1bf4668eeb70467fb3dc5a0289233b3c P ccd8a4c3bfe3413cb2ae219b09aea832 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
W20260709 13:21:43.908191  6772 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 45994.6us
W20260709 13:21:43.909622  6770 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 48603us
I20260709 13:21:43.939651  6877 raft_consensus.cc:1275] T d8cee0accdb8499c86d4414b72565a38 P cd75a17ab2604397adab03bb8b5fd75c [term 23 FOLLOWER]: Refusing update from remote peer b7ab4784c7344b939bc36f639286f377: Log matching property violated. Preceding OpId in replica: term: 21 index: 15. Preceding OpId from leader: term: 23 index: 16. (index mismatch)
I20260709 13:21:43.950914 13684 consensus_queue.cc:1048] T d8cee0accdb8499c86d4414b72565a38 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
W20260709 13:21:44.003386  6629 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:53224 (request call id 161) took 28439 ms (client timeout 15000 ms). Trace:
I20260709 13:21:44.001209  6623 catalog_manager.cc:5697] T ab432e62819d499eaaf3dd55481dd930 P ccd8a4c3bfe3413cb2ae219b09aea832 reported cstate change: term changed from 17 to 22, leader changed from b7ab4784c7344b939bc36f639286f377 (127.5.126.66) to ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65). New cstate: current_term: 22 leader_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } health_report { overall_health: UNKNOWN } } }
W20260709 13:21:44.003855  6629 rpcz_store.cc:269] 0709 13:21:15.563865 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:21:20.460468 (+4896603us) service_pool.cc:224] Handling call
0709 13:21:44.003296 (+23542828us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:21:42.291586 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:21:42.292323 (+   737us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:21:42.292377 (+    54us) write_op.cc:435] Acquired schema lock
0709 13:21:42.292400 (+    23us) tablet.cc:662] Decoding operations
0709 13:21:42.294657 (+  2257us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:21:42.294775 (+   118us) write_op.cc:641] Partition lock acquired for write op
0709 13:21:42.294816 (+    41us) tablet.cc:685] Acquiring locks for 25 operations
0709 13:21:42.322802 (+ 27986us) tablet.cc:701] Row locks acquired
0709 13:21:42.322827 (+    25us) write_op.cc:260] PREPARE: finished
0709 13:21:42.322974 (+   147us) write_op.cc:270] Start()
0709 13:21:42.323109 (+   135us) write_op.cc:276] Timestamp: P: 1783603302322925 usec, L: 0
0709 13:21:42.323237 (+   128us) op_driver.cc:348] REPLICATION: starting
0709 13:21:42.323957 (+   720us) log.cc:844] Serialized 9765 byte log entry
0709 13:21:42.882418 (+558461us) op_driver.cc:464] REPLICATION: finished
0709 13:21:42.990052 (+107634us) write_op.cc:301] APPLY: starting
0709 13:21:42.990148 (+    96us) tablet.cc:1367] starting BulkCheckPresence
0709 13:21:43.221245 (+231097us) tablet.cc:1370] finished BulkCheckPresence
0709 13:21:43.221353 (+   108us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:21:43.579621 (+358268us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:21:43.579974 (+   353us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=50,key_file_lookups=50,delta_file_lookups=50,mrs_lookups=0
0709 13:21:43.580017 (+    43us) write_op.cc:312] APPLY: finished
0709 13:21:43.580479 (+   462us) log.cc:844] Serialized 219 byte log entry
0709 13:21:43.580662 (+   183us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:21:43.580861 (+   199us) write_op.cc:454] Released schema lock
0709 13:21:43.580921 (+    60us) write_op.cc:341] FINISH: Updating metrics
0709 13:21:43.581350 (+   429us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:21:43.581376 (+    26us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":3712,"reported_tablets":55,"child_traces":[["op",{"apply.queue_time_us":103263,"apply.run_cpu_time_us":37224,"apply.run_wall_time_us":591297,"cfile_cache_hit":102,"cfile_cache_hit_bytes":108527,"num_ops":25,"prepare.queue_time_us":75961,"prepare.run_cpu_time_us":22762,"prepare.run_wall_time_us":279909,"raft.queue_time_us":165687,"raft.run_cpu_time_us":7630,"raft.run_wall_time_us":119183,"replication_time_us":545765,"thread_start_us":278441,"threads_started":4,"wal-append.queue_time_us":249059}]]}
I20260709 13:21:44.004801  6623 catalog_manager.cc:5697] T 30e88460611e47b2ba16a46a30b5f416 P ccd8a4c3bfe3413cb2ae219b09aea832 reported cstate change: term changed from 13 to 15. New cstate: current_term: 15 leader_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:44.037922  6623 catalog_manager.cc:5697] T f3f9c2e2bf644115957398fe4c9459db P ccd8a4c3bfe3413cb2ae219b09aea832 reported cstate change: term changed from 17 to 18, leader changed from cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67) to ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65). New cstate: current_term: 18 leader_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:44.064810  6623 catalog_manager.cc:5697] T bd6869f07b5a4885a0b99fbe60c3b175 P ccd8a4c3bfe3413cb2ae219b09aea832 reported cstate change: term changed from 11 to 20, leader changed from b7ab4784c7344b939bc36f639286f377 (127.5.126.66) to ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65). New cstate: current_term: 20 leader_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:44.066763  6623 catalog_manager.cc:5697] T bb3d8792045a4583ae2e965b1350a5b4 P ccd8a4c3bfe3413cb2ae219b09aea832 reported cstate change: term changed from 12 to 18. New cstate: current_term: 18 leader_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } } }
I20260709 13:21:44.069440 14236 raft_consensus.cc:493] T f03d0dbf16864ca4bc1bb5e4c0334c0f P ccd8a4c3bfe3413cb2ae219b09aea832 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:21:44.070909 14236 raft_consensus.cc:515] T f03d0dbf16864ca4bc1bb5e4c0334c0f P ccd8a4c3bfe3413cb2ae219b09aea832 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:44.069583 14163 raft_consensus.cc:493] T 4d9def8b32fd443aa94ab1420b06837b P ccd8a4c3bfe3413cb2ae219b09aea832 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:21:44.073283 14163 raft_consensus.cc:515] T 4d9def8b32fd443aa94ab1420b06837b P ccd8a4c3bfe3413cb2ae219b09aea832 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:44.075433 14163 leader_election.cc:290] T 4d9def8b32fd443aa94ab1420b06837b P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:21:44.075966 14361 raft_consensus.cc:493] T 24ee15416e3145beaa1b8183453729a3 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 7ba59cc884714e8aa5f3f0ecaed84cbb)
I20260709 13:21:44.076875 14361 raft_consensus.cc:515] T 24ee15416e3145beaa1b8183453729a3 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:21:44.077666  6804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f03d0dbf16864ca4bc1bb5e4c0334c0f" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:21:44.079355 14361 leader_election.cc:290] T 24ee15416e3145beaa1b8183453729a3 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:21:44.076097  6800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d9def8b32fd443aa94ab1420b06837b" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 25 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:21:44.080425  6875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d9def8b32fd443aa94ab1420b06837b" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 25 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:21:44.084295  6881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24ee15416e3145beaa1b8183453729a3" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:21:44.089515  6875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f03d0dbf16864ca4bc1bb5e4c0334c0f" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:21:44.090507  6697 leader_election.cc:304] T 4d9def8b32fd443aa94ab1420b06837b P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:21:44.093864 14163 raft_consensus.cc:2749] T 4d9def8b32fd443aa94ab1420b06837b P ccd8a4c3bfe3413cb2ae219b09aea832 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:21:44.095328  6697 leader_election.cc:304] T f03d0dbf16864ca4bc1bb5e4c0334c0f P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:21:44.077847 14236 leader_election.cc:290] T f03d0dbf16864ca4bc1bb5e4c0334c0f P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:21:44.096328 14163 raft_consensus.cc:2749] T f03d0dbf16864ca4bc1bb5e4c0334c0f P ccd8a4c3bfe3413cb2ae219b09aea832 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:21:44.106109  7502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24ee15416e3145beaa1b8183453729a3" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:21:44.112432  6697 leader_election.cc:304] T 24ee15416e3145beaa1b8183453729a3 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:21:44.099418  6623 catalog_manager.cc:5697] T a3022224cc81473690653a83d4e99470 P ccd8a4c3bfe3413cb2ae219b09aea832 reported cstate change: term changed from 17 to 21. New cstate: current_term: 21 leader_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:44.117756 14236 raft_consensus.cc:2749] T 24ee15416e3145beaa1b8183453729a3 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:21:44.117322  6623 catalog_manager.cc:5697] T 3411566abe2d4c9bb4b2adfdd05e6f17 P ccd8a4c3bfe3413cb2ae219b09aea832 reported cstate change: term changed from 13 to 18. New cstate: current_term: 18 leader_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:44.150530  6623 catalog_manager.cc:5697] T 7a734b5ab7834e05a8c422208acc58b1 P ccd8a4c3bfe3413cb2ae219b09aea832 reported cstate change: term changed from 21 to 19, leader changed from <none> to b7ab4784c7344b939bc36f639286f377 (127.5.126.66). New cstate: current_term: 19 leader_uuid: "b7ab4784c7344b939bc36f639286f377" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } attrs { replace: true } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } } }
I20260709 13:21:44.158020  6623 catalog_manager.cc:5697] T a1704639a875409b9959353527b3fd68 P ccd8a4c3bfe3413cb2ae219b09aea832 reported cstate change: term changed from 6 to 19. New cstate: current_term: 19 leader_uuid: "b7ab4784c7344b939bc36f639286f377" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } }
I20260709 13:21:44.185431 14163 raft_consensus.cc:493] T 3d65025eea89441290d85dd053810e31 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:21:44.186955 14236 raft_consensus.cc:493] T 2c240553ce044eedb41541d72b9475d7 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:21:44.188120 14236 raft_consensus.cc:515] T 2c240553ce044eedb41541d72b9475d7 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:44.191617  6877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c240553ce044eedb41541d72b9475d7" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:21:44.193151 14236 leader_election.cc:290] T 2c240553ce044eedb41541d72b9475d7 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:21:44.186200 14163 raft_consensus.cc:515] T 3d65025eea89441290d85dd053810e31 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:44.193676  6804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c240553ce044eedb41541d72b9475d7" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:21:44.195358  6695 leader_election.cc:304] T 2c240553ce044eedb41541d72b9475d7 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:21:44.195559 14163 leader_election.cc:290] T 3d65025eea89441290d85dd053810e31 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:21:44.196230 14361 raft_consensus.cc:2749] T 2c240553ce044eedb41541d72b9475d7 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:21:44.198211  6804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d65025eea89441290d85dd053810e31" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:21:44.198244  6877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d65025eea89441290d85dd053810e31" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:21:44.200655  6695 leader_election.cc:304] T 3d65025eea89441290d85dd053810e31 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:21:44.202680 14361 raft_consensus.cc:2749] T 3d65025eea89441290d85dd053810e31 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:21:44.234066 14236 raft_consensus.cc:493] T 22ccee1b570c4ad3a57bd7aec085b1b4 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:21:44.236122 14236 raft_consensus.cc:515] T 22ccee1b570c4ad3a57bd7aec085b1b4 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:44.234804 14163 raft_consensus.cc:493] T 853ac0a8cbd64ce99457f170216d4d0f P ccd8a4c3bfe3413cb2ae219b09aea832 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:21:44.244530 14163 raft_consensus.cc:515] T 853ac0a8cbd64ce99457f170216d4d0f P ccd8a4c3bfe3413cb2ae219b09aea832 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:44.245095  6877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22ccee1b570c4ad3a57bd7aec085b1b4" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:21:44.246392  6804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22ccee1b570c4ad3a57bd7aec085b1b4" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:21:44.248010 14236 leader_election.cc:290] T 22ccee1b570c4ad3a57bd7aec085b1b4 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:21:44.249984  6695 leader_election.cc:304] T 22ccee1b570c4ad3a57bd7aec085b1b4 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:21:44.264401 14236 raft_consensus.cc:2749] T 22ccee1b570c4ad3a57bd7aec085b1b4 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:21:44.265539 14163 leader_election.cc:290] T 853ac0a8cbd64ce99457f170216d4d0f P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:21:44.266947  6877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "853ac0a8cbd64ce99457f170216d4d0f" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:21:44.271893 14163 raft_consensus.cc:493] T 404190ce4ce94cecbfcb6ea9d1dd8626 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 7ba59cc884714e8aa5f3f0ecaed84cbb)
I20260709 13:21:44.272758 14163 raft_consensus.cc:515] T 404190ce4ce94cecbfcb6ea9d1dd8626 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:21:44.277155  7495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "404190ce4ce94cecbfcb6ea9d1dd8626" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:21:44.280378 14361 raft_consensus.cc:493] T 3a485a995abc4807b6e511e45419f737 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:21:44.280997 14361 raft_consensus.cc:515] T 3a485a995abc4807b6e511e45419f737 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:44.283324 14361 leader_election.cc:290] T 3a485a995abc4807b6e511e45419f737 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:21:44.275866 14163 leader_election.cc:290] T 404190ce4ce94cecbfcb6ea9d1dd8626 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:21:44.283852 14361 raft_consensus.cc:493] T 90d42e216d9741e190bca19a781291fd P ccd8a4c3bfe3413cb2ae219b09aea832 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader cd75a17ab2604397adab03bb8b5fd75c)
I20260709 13:21:44.292723 14361 raft_consensus.cc:515] T 90d42e216d9741e190bca19a781291fd P ccd8a4c3bfe3413cb2ae219b09aea832 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:44.285792 14393 raft_consensus.cc:493] T 713b5728a197487c9300b310ab94e5a3 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader cd75a17ab2604397adab03bb8b5fd75c)
I20260709 13:21:44.295500 14361 leader_election.cc:290] T 90d42e216d9741e190bca19a781291fd P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:21:44.295292 14393 raft_consensus.cc:515] T 713b5728a197487c9300b310ab94e5a3 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:44.296209 14361 raft_consensus.cc:493] T 7a734b5ab7834e05a8c422208acc58b1 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 7ba59cc884714e8aa5f3f0ecaed84cbb)
I20260709 13:21:44.287606  6875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a485a995abc4807b6e511e45419f737" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:21:44.297178 14163 raft_consensus.cc:493] T b3f13b31a1f84f0d89d007eadd57924c P ccd8a4c3bfe3413cb2ae219b09aea832 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 7ba59cc884714e8aa5f3f0ecaed84cbb)
I20260709 13:21:44.298143 14393 leader_election.cc:290] T 713b5728a197487c9300b310ab94e5a3 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:21:44.299933 14393 raft_consensus.cc:493] T be1a92657f494cac8dd227d152f50151 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 7ba59cc884714e8aa5f3f0ecaed84cbb)
I20260709 13:21:44.300892 14393 raft_consensus.cc:515] T be1a92657f494cac8dd227d152f50151 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:21:44.303263  6875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90d42e216d9741e190bca19a781291fd" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:21:44.299031 14163 raft_consensus.cc:515] T b3f13b31a1f84f0d89d007eadd57924c P ccd8a4c3bfe3413cb2ae219b09aea832 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:21:44.303576  6877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "713b5728a197487c9300b310ab94e5a3" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:21:44.288391 14236 raft_consensus.cc:493] T 44bde925b2e541b69890d70715b85176 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader cd75a17ab2604397adab03bb8b5fd75c)
I20260709 13:21:44.306718  7495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be1a92657f494cac8dd227d152f50151" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 26 candidate_status { last_received { term: 25 index: 18 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:21:44.307308 14163 leader_election.cc:290] T b3f13b31a1f84f0d89d007eadd57924c P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:21:44.310523  7495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3f13b31a1f84f0d89d007eadd57924c" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:21:44.303260 14393 leader_election.cc:290] T be1a92657f494cac8dd227d152f50151 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:21:44.312873 14236 raft_consensus.cc:515] T 44bde925b2e541b69890d70715b85176 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:44.315450 14236 leader_election.cc:290] T 44bde925b2e541b69890d70715b85176 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
W20260709 13:21:44.316792  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 44112.1us
I20260709 13:21:44.298153 14361 raft_consensus.cc:515] T 7a734b5ab7834e05a8c422208acc58b1 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } attrs { replace: true } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:21:44.328105  6877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44bde925b2e541b69890d70715b85176" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:21:44.336527 14361 leader_election.cc:290] T 7a734b5ab7834e05a8c422208acc58b1 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:21:44.338339  6875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a734b5ab7834e05a8c422208acc58b1" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:21:44.343843  7495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a734b5ab7834e05a8c422208acc58b1" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:21:44.346349  6697 leader_election.cc:304] T 7a734b5ab7834e05a8c422208acc58b1 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:21:44.348820 14430 raft_consensus.cc:2749] T 7a734b5ab7834e05a8c422208acc58b1 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:21:44.356506 14163 raft_consensus.cc:493] T 95a75bfe094d4bdc963aba3f08dfcd25 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader cd75a17ab2604397adab03bb8b5fd75c)
I20260709 13:21:44.357226 14163 raft_consensus.cc:515] T 95a75bfe094d4bdc963aba3f08dfcd25 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } attrs { replace: true } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:21:44.360391 14163 leader_election.cc:290] T 95a75bfe094d4bdc963aba3f08dfcd25 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:21:44.371724  6877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a75bfe094d4bdc963aba3f08dfcd25" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:21:44.374091  7495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a75bfe094d4bdc963aba3f08dfcd25" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
W20260709 13:21:44.376955  6695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 127023us
I20260709 13:21:44.380273  6800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "853ac0a8cbd64ce99457f170216d4d0f" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:21:44.382697  6800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "404190ce4ce94cecbfcb6ea9d1dd8626" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:21:44.383088  6804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a485a995abc4807b6e511e45419f737" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:21:44.388098 14236 raft_consensus.cc:493] T 07a92dd554674067a83a9cb68c4773f2 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:21:44.389319 14236 raft_consensus.cc:515] T 07a92dd554674067a83a9cb68c4773f2 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:44.391908 14236 leader_election.cc:290] T 07a92dd554674067a83a9cb68c4773f2 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:21:44.396898  6872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a92dd554674067a83a9cb68c4773f2" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:21:44.399227 14430 raft_consensus.cc:493] T 427c124d773f483294511e80fe340075 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 7ba59cc884714e8aa5f3f0ecaed84cbb)
I20260709 13:21:44.399780  6804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90d42e216d9741e190bca19a781291fd" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:21:44.399972 14430 raft_consensus.cc:515] T 427c124d773f483294511e80fe340075 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } attrs { replace: true } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:21:44.401145  6800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "713b5728a197487c9300b310ab94e5a3" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:21:44.405542 14163 raft_consensus.cc:493] T 9b3759de40694069b13c0f8bd40e5709 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:21:44.406217 14163 raft_consensus.cc:515] T 9b3759de40694069b13c0f8bd40e5709 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:44.408628 14163 leader_election.cc:290] T 9b3759de40694069b13c0f8bd40e5709 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:21:44.409646  6800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be1a92657f494cac8dd227d152f50151" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 26 candidate_status { last_received { term: 25 index: 18 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:21:44.412226  6805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a734b5ab7834e05a8c422208acc58b1" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:21:44.412427  6800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3f13b31a1f84f0d89d007eadd57924c" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:21:44.412994 14393 raft_consensus.cc:493] T 30e88460611e47b2ba16a46a30b5f416 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:21:44.413599 14393 raft_consensus.cc:515] T 30e88460611e47b2ba16a46a30b5f416 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:44.415313  6804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44bde925b2e541b69890d70715b85176" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:21:44.416028 14393 leader_election.cc:290] T 30e88460611e47b2ba16a46a30b5f416 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:21:44.419202  6697 leader_election.cc:304] T 95a75bfe094d4bdc963aba3f08dfcd25 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:21:44.422395  6800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a75bfe094d4bdc963aba3f08dfcd25" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:21:44.423808 14236 raft_consensus.cc:2749] T 95a75bfe094d4bdc963aba3f08dfcd25 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:21:44.425223  6695 leader_election.cc:304] T 853ac0a8cbd64ce99457f170216d4d0f P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:21:44.426829 14430 leader_election.cc:290] T 427c124d773f483294511e80fe340075 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:21:44.428561  6877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b3759de40694069b13c0f8bd40e5709" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:21:44.432848  6622 catalog_manager.cc:5697] T 7c44c4849aa54f2b94d1f1bef9ed546f P cd75a17ab2604397adab03bb8b5fd75c reported cstate change: term changed from 12 to 19, leader changed from b7ab4784c7344b939bc36f639286f377 (127.5.126.66) to ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65). New cstate: current_term: 19 leader_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } }
I20260709 13:21:44.433475  6877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30e88460611e47b2ba16a46a30b5f416" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:21:44.435065 14429 raft_consensus.cc:2749] T 853ac0a8cbd64ce99457f170216d4d0f P ccd8a4c3bfe3413cb2ae219b09aea832 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:21:44.450309  6806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a92dd554674067a83a9cb68c4773f2" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:21:44.454790 14429 raft_consensus.cc:493] T 3fa34c08b205435dba97346991aa1f92 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 27 FOLLOWER]: Starting pre-election (detected failure of leader 7ba59cc884714e8aa5f3f0ecaed84cbb)
I20260709 13:21:44.455499 14429 raft_consensus.cc:515] T 3fa34c08b205435dba97346991aa1f92 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 27 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
W20260709 13:21:44.456171  6623 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:53214 (request call id 181) took 26274 ms (client timeout 15000 ms). Trace:
I20260709 13:21:44.457178 14163 raft_consensus.cc:493] T 17587d6730594da4a56fa13a353232a1 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 26 FOLLOWER]: Starting pre-election (detected failure of leader 7ba59cc884714e8aa5f3f0ecaed84cbb)
W20260709 13:21:44.456657  6623 rpcz_store.cc:269] 0709 13:21:18.174332 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:21:28.925465 (+10751133us) service_pool.cc:224] Handling call
0709 13:21:29.757912 (+832447us) spinlock_profiling.cc:243] Waited 5.12 ms on lock 0x7b5400156154. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f914090 00007fcc0f9b2f3a 00007fcc157691cc 00007fcc1586737e 00007fcc13d282a4 00007fcc13d28232 00007fcc13d28161 00007fcc13d280dc 00007fcc13d27392 00007fcc0dce548c 00007fcc0dce48c6
0709 13:21:44.448423 (+14690511us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:21:44.197653 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:21:44.204579 (+  6926us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:21:44.204621 (+    42us) write_op.cc:435] Acquired schema lock
0709 13:21:44.204640 (+    19us) tablet.cc:662] Decoding operations
0709 13:21:44.205633 (+   993us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:21:44.205732 (+    99us) write_op.cc:641] Partition lock acquired for write op
0709 13:21:44.205759 (+    27us) tablet.cc:685] Acquiring locks for 9 operations
0709 13:21:44.212785 (+  7026us) tablet.cc:701] Row locks acquired
0709 13:21:44.212799 (+    14us) write_op.cc:260] PREPARE: finished
0709 13:21:44.212963 (+   164us) write_op.cc:270] Start()
0709 13:21:44.213091 (+   128us) write_op.cc:276] Timestamp: P: 1783603304212913 usec, L: 0
0709 13:21:44.213109 (+    18us) op_driver.cc:348] REPLICATION: starting
0709 13:21:44.213828 (+   719us) log.cc:844] Serialized 3670 byte log entry
0709 13:21:44.312938 (+ 99110us) op_driver.cc:464] REPLICATION: finished
0709 13:21:44.329618 (+ 16680us) write_op.cc:301] APPLY: starting
0709 13:21:44.329716 (+    98us) tablet.cc:1367] starting BulkCheckPresence
0709 13:21:44.337272 (+  7556us) tablet.cc:1370] finished BulkCheckPresence
0709 13:21:44.337372 (+   100us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:21:44.343986 (+  6614us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:21:44.344272 (+   286us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=18,key_file_lookups=18,delta_file_lookups=18,mrs_lookups=0
0709 13:21:44.344318 (+    46us) write_op.cc:312] APPLY: finished
0709 13:21:44.344737 (+   419us) log.cc:844] Serialized 88 byte log entry
0709 13:21:44.345716 (+   979us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:21:44.345867 (+   151us) write_op.cc:454] Released schema lock
0709 13:21:44.345915 (+    48us) write_op.cc:341] FINISH: Updating metrics
0709 13:21:44.347428 (+  1513us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:21:44.347474 (+    46us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":56721,"reported_tablets":55,"spinlock_wait_cycles":11767168,"child_traces":[["op",{"apply.queue_time_us":16370,"apply.run_cpu_time_us":13377,"apply.run_wall_time_us":17735,"cfile_cache_hit":38,"cfile_cache_hit_bytes":41711,"num_ops":9,"prepare.queue_time_us":32440,"prepare.run_cpu_time_us":4291,"prepare.run_wall_time_us":16692,"replication_time_us":99635,"thread_start_us":52131,"threads_started":2}]]}
I20260709 13:21:44.436332  6695 leader_election.cc:304] T 404190ce4ce94cecbfcb6ea9d1dd8626 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, b7ab4784c7344b939bc36f639286f377
I20260709 13:21:44.440127  6872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "427c124d773f483294511e80fe340075" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:21:44.464439  7495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "427c124d773f483294511e80fe340075" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:21:44.464272 14236 raft_consensus.cc:493] T b56bf91d90824c959e21e0cee5ba1816 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:21:44.465698 14236 raft_consensus.cc:515] T b56bf91d90824c959e21e0cee5ba1816 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:44.467145 14393 raft_consensus.cc:2749] T 404190ce4ce94cecbfcb6ea9d1dd8626 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:21:44.470916 14236 leader_election.cc:290] T b56bf91d90824c959e21e0cee5ba1816 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:21:44.473826  6697 leader_election.cc:304] T 427c124d773f483294511e80fe340075 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:21:44.475174 14393 raft_consensus.cc:2749] T 427c124d773f483294511e80fe340075 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:21:44.470975 14429 leader_election.cc:290] T 3fa34c08b205435dba97346991aa1f92 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:21:44.479346 14430 raft_consensus.cc:493] T 7887766dc6784fcaa42b35c05fea7a99 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:21:44.479887 14430 raft_consensus.cc:515] T 7887766dc6784fcaa42b35c05fea7a99 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:44.458110 14163 raft_consensus.cc:515] T 17587d6730594da4a56fa13a353232a1 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:21:44.482002 14430 leader_election.cc:290] T 7887766dc6784fcaa42b35c05fea7a99 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:21:44.482477 14430 raft_consensus.cc:493] T f5be3a11b23d4ea9b08300a2789821c7 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:21:44.483052 14163 leader_election.cc:290] T 17587d6730594da4a56fa13a353232a1 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:21:44.468941  6695 leader_election.cc:304] T 3a485a995abc4807b6e511e45419f737 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:21:44.484638  6695 leader_election.cc:304] T 713b5728a197487c9300b310ab94e5a3 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:21:44.485328 14163 raft_consensus.cc:2749] T 3a485a995abc4807b6e511e45419f737 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:21:44.500447  6875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b56bf91d90824c959e21e0cee5ba1816" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:21:44.485740  6695 leader_election.cc:304] T 90d42e216d9741e190bca19a781291fd P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:21:44.486253 14429 raft_consensus.cc:2749] T 713b5728a197487c9300b310ab94e5a3 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:21:44.490222  6872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fa34c08b205435dba97346991aa1f92" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 28 candidate_status { last_received { term: 27 index: 19 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:21:44.492493 14393 raft_consensus.cc:493] T 4275cf08e63345f993bce8664eada830 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:21:44.503310  7495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fa34c08b205435dba97346991aa1f92" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 28 candidate_status { last_received { term: 27 index: 19 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:21:44.503438 14393 raft_consensus.cc:515] T 4275cf08e63345f993bce8664eada830 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:44.482990 14430 raft_consensus.cc:515] T f5be3a11b23d4ea9b08300a2789821c7 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:44.511972  6695 leader_election.cc:304] T be1a92657f494cac8dd227d152f50151 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, b7ab4784c7344b939bc36f639286f377
I20260709 13:21:44.505249  6622 catalog_manager.cc:5697] T 07a92dd554674067a83a9cb68c4773f2 P cd75a17ab2604397adab03bb8b5fd75c reported cstate change: term changed from 13 to 16. New cstate: current_term: 16 leader_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } }
I20260709 13:21:44.516239  6872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7887766dc6784fcaa42b35c05fea7a99" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 24 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:21:44.516620  7495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17587d6730594da4a56fa13a353232a1" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 27 candidate_status { last_received { term: 26 index: 18 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:21:44.513971  6622 catalog_manager.cc:5697] T c4db81d9d329422bb3b4160ca4ac2d1d P cd75a17ab2604397adab03bb8b5fd75c reported cstate change: term changed from 15 to 18, leader changed from b7ab4784c7344b939bc36f639286f377 (127.5.126.66) to cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67). New cstate: current_term: 18 leader_uuid: "cd75a17ab2604397adab03bb8b5fd75c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } health_report { overall_health: HEALTHY } } }
I20260709 13:21:44.523789 14361 raft_consensus.cc:493] T f09c2a98de1a4decabd0ff900dd44caa P ccd8a4c3bfe3413cb2ae219b09aea832 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:21:44.527630 14361 raft_consensus.cc:515] T f09c2a98de1a4decabd0ff900dd44caa P ccd8a4c3bfe3413cb2ae219b09aea832 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:44.530189 14361 leader_election.cc:290] T f09c2a98de1a4decabd0ff900dd44caa P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:21:44.523494 14429 raft_consensus.cc:2749] T 90d42e216d9741e190bca19a781291fd P ccd8a4c3bfe3413cb2ae219b09aea832 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:21:44.510551 14163 raft_consensus.cc:493] T 8c7f33e544204fbaac4078e3e83bbf4e P ccd8a4c3bfe3413cb2ae219b09aea832 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
W20260709 13:21:44.548588  6614 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 117521us
I20260709 13:21:44.541335 14361 raft_consensus.cc:2749] T be1a92657f494cac8dd227d152f50151 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
W20260709 13:21:44.559607  6695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 47737.3us
I20260709 13:21:44.561522  6695 leader_election.cc:304] T b3f13b31a1f84f0d89d007eadd57924c P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, b7ab4784c7344b939bc36f639286f377
I20260709 13:21:44.543497 14429 raft_consensus.cc:493] T 20f6842e26174571996b8dea4151d4be P ccd8a4c3bfe3413cb2ae219b09aea832 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
W20260709 13:21:44.582000  6614 catalog_manager.cc:4755] TS ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet ce4f062dcd314d43a63ca74067cb5ee3: Remote error: Service unavailable: service kudu.tserver.TabletServerAdminService not registered on TabletServer
I20260709 13:21:44.588189 14393 leader_election.cc:290] T 4275cf08e63345f993bce8664eada830 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:21:44.588937 14393 raft_consensus.cc:2749] T b3f13b31a1f84f0d89d007eadd57924c P ccd8a4c3bfe3413cb2ae219b09aea832 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:21:44.547760 14163 raft_consensus.cc:515] T 8c7f33e544204fbaac4078e3e83bbf4e P ccd8a4c3bfe3413cb2ae219b09aea832 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:44.617379 14430 leader_election.cc:290] T f5be3a11b23d4ea9b08300a2789821c7 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
W20260709 13:21:44.632697  6695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 69857.9us
I20260709 13:21:44.566169 14429 raft_consensus.cc:515] T 20f6842e26174571996b8dea4151d4be P ccd8a4c3bfe3413cb2ae219b09aea832 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:44.641474 14163 leader_election.cc:290] T 8c7f33e544204fbaac4078e3e83bbf4e P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:21:44.641822 14429 leader_election.cc:290] T 20f6842e26174571996b8dea4151d4be P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:21:44.636933  6695 leader_election.cc:304] T 44bde925b2e541b69890d70715b85176 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:21:44.657944  6695 leader_election.cc:304] T 07a92dd554674067a83a9cb68c4773f2 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:21:44.666946  6806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "427c124d773f483294511e80fe340075" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:21:44.668320  6800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30e88460611e47b2ba16a46a30b5f416" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:21:44.670904  6801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b56bf91d90824c959e21e0cee5ba1816" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:21:44.672900  6804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b3759de40694069b13c0f8bd40e5709" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:21:44.680543  6801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09c2a98de1a4decabd0ff900dd44caa" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:21:44.681434  6805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4275cf08e63345f993bce8664eada830" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:21:44.682879  6798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5be3a11b23d4ea9b08300a2789821c7" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:21:44.680927  6803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7887766dc6784fcaa42b35c05fea7a99" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 24 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:21:44.687343 14393 raft_consensus.cc:493] T a1704639a875409b9959353527b3fd68 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:21:44.687995 14393 raft_consensus.cc:515] T a1704639a875409b9959353527b3fd68 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:44.690621 14393 leader_election.cc:290] T a1704639a875409b9959353527b3fd68 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:21:44.692816  6799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c7f33e544204fbaac4078e3e83bbf4e" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:21:44.695302  6697 leader_election.cc:304] T 3fa34c08b205435dba97346991aa1f92 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:21:44.672251 14429 raft_consensus.cc:493] T ab432e62819d499eaaf3dd55481dd930 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:21:44.696199 14430 raft_consensus.cc:2749] T 3fa34c08b205435dba97346991aa1f92 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 27 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
I20260709 13:21:44.696368 14429 raft_consensus.cc:515] T ab432e62819d499eaaf3dd55481dd930 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:44.698318  6877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09c2a98de1a4decabd0ff900dd44caa" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:21:44.698719 14429 leader_election.cc:290] T ab432e62819d499eaaf3dd55481dd930 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:21:44.676431 14435 raft_consensus.cc:2749] T 07a92dd554674067a83a9cb68c4773f2 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:21:44.701259 14435 raft_consensus.cc:493] T f3f9c2e2bf644115957398fe4c9459db P ccd8a4c3bfe3413cb2ae219b09aea832 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:21:44.701793 14435 raft_consensus.cc:515] T f3f9c2e2bf644115957398fe4c9459db P ccd8a4c3bfe3413cb2ae219b09aea832 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:44.703619  6877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4275cf08e63345f993bce8664eada830" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:21:44.705809  6877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5be3a11b23d4ea9b08300a2789821c7" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:21:44.710448  6695 leader_election.cc:304] T b56bf91d90824c959e21e0cee5ba1816 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:21:44.711575  6877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c7f33e544204fbaac4078e3e83bbf4e" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:21:44.711876 14429 raft_consensus.cc:2749] T b56bf91d90824c959e21e0cee5ba1816 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:21:44.656668 14433 raft_consensus.cc:2749] T 44bde925b2e541b69890d70715b85176 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:21:44.678454  6804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17587d6730594da4a56fa13a353232a1" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 27 candidate_status { last_received { term: 26 index: 18 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:21:44.722543  6804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20f6842e26174571996b8dea4151d4be" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:21:44.725024  6695 leader_election.cc:304] T 9b3759de40694069b13c0f8bd40e5709 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:21:44.729212  6875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20f6842e26174571996b8dea4151d4be" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:21:44.703913 14435 leader_election.cc:290] T f3f9c2e2bf644115957398fe4c9459db P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:21:44.732347  6875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1704639a875409b9959353527b3fd68" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:21:44.736855  6695 leader_election.cc:304] T 30e88460611e47b2ba16a46a30b5f416 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:21:44.737668 14433 raft_consensus.cc:2749] T 9b3759de40694069b13c0f8bd40e5709 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:21:44.738348 14434 raft_consensus.cc:2749] T 30e88460611e47b2ba16a46a30b5f416 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:21:44.739828  6875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab432e62819d499eaaf3dd55481dd930" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 26 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:21:44.745271  6875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f9c2e2bf644115957398fe4c9459db" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:21:44.746411  6695 leader_election.cc:304] T 7887766dc6784fcaa42b35c05fea7a99 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:21:44.747377  6697 leader_election.cc:304] T f09c2a98de1a4decabd0ff900dd44caa P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:21:44.747473  6804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1704639a875409b9959353527b3fd68" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:21:44.747849  6695 leader_election.cc:304] T 17587d6730594da4a56fa13a353232a1 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, b7ab4784c7344b939bc36f639286f377
I20260709 13:21:44.749433  6804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab432e62819d499eaaf3dd55481dd930" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 26 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:21:44.752183  6623 catalog_manager.cc:5697] T bb3d8792045a4583ae2e965b1350a5b4 P 7ba59cc884714e8aa5f3f0ecaed84cbb reported cstate change: term changed from 18 to 19, leader changed from 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68) to ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65). New cstate: current_term: 19 leader_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } } }
I20260709 13:21:44.754103  6623 catalog_manager.cc:5697] T d8cee0accdb8499c86d4414b72565a38 P 7ba59cc884714e8aa5f3f0ecaed84cbb reported cstate change: term changed from 19 to 21. New cstate: current_term: 21 leader_uuid: "b7ab4784c7344b939bc36f639286f377" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } } }
I20260709 13:21:44.755386 14433 raft_consensus.cc:2749] T f09c2a98de1a4decabd0ff900dd44caa P ccd8a4c3bfe3413cb2ae219b09aea832 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:21:44.753149 14430 raft_consensus.cc:2749] T 7887766dc6784fcaa42b35c05fea7a99 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:21:44.756325  6697 leader_election.cc:304] T 4275cf08e63345f993bce8664eada830 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:21:44.759101  6804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f9c2e2bf644115957398fe4c9459db" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:21:44.770107  6697 leader_election.cc:304] T f5be3a11b23d4ea9b08300a2789821c7 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:21:44.772204 14430 raft_consensus.cc:2749] T 4275cf08e63345f993bce8664eada830 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:21:44.772853 14236 raft_consensus.cc:2749] T f5be3a11b23d4ea9b08300a2789821c7 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:21:44.773651 14236 raft_consensus.cc:2749] T 17587d6730594da4a56fa13a353232a1 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 13:21:44.771804  6697 leader_election.cc:304] T 8c7f33e544204fbaac4078e3e83bbf4e P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:21:44.774524 14236 raft_consensus.cc:2749] T 8c7f33e544204fbaac4078e3e83bbf4e P ccd8a4c3bfe3413cb2ae219b09aea832 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:21:44.797966  6695 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 50173us
I20260709 13:21:44.804214  6695 leader_election.cc:304] T 20f6842e26174571996b8dea4151d4be P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:21:44.827307 14434 raft_consensus.cc:2749] T 20f6842e26174571996b8dea4151d4be P ccd8a4c3bfe3413cb2ae219b09aea832 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:21:44.832520  6695 leader_election.cc:304] T a1704639a875409b9959353527b3fd68 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:21:44.834254 14430 raft_consensus.cc:2749] T a1704639a875409b9959353527b3fd68 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:21:44.835994  6695 leader_election.cc:304] T ab432e62819d499eaaf3dd55481dd930 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:21:44.845120  6623 catalog_manager.cc:5697] T 4f00a2e87e56452083b759f60d461ee3 P 7ba59cc884714e8aa5f3f0ecaed84cbb reported cstate change: term changed from 20 to 22, leader changed from b7ab4784c7344b939bc36f639286f377 (127.5.126.66) to 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68). New cstate: current_term: 22 leader_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:21:44.847645  6623 catalog_manager.cc:5697] T 7a734b5ab7834e05a8c422208acc58b1 P 7ba59cc884714e8aa5f3f0ecaed84cbb reported cstate change: term changed from 19 to 22, leader changed from b7ab4784c7344b939bc36f639286f377 (127.5.126.66) to 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68). New cstate: current_term: 22 leader_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:21:44.857354  6695 leader_election.cc:304] T f3f9c2e2bf644115957398fe4c9459db P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:21:44.858134 14430 raft_consensus.cc:2749] T ab432e62819d499eaaf3dd55481dd930 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:21:44.858318 14435 raft_consensus.cc:2749] T f3f9c2e2bf644115957398fe4c9459db P ccd8a4c3bfe3413cb2ae219b09aea832 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:21:44.867045  6623 catalog_manager.cc:5697] T 95a75bfe094d4bdc963aba3f08dfcd25 P 7ba59cc884714e8aa5f3f0ecaed84cbb reported cstate change: term changed from 16 to 18. New cstate: current_term: 18 leader_uuid: "cd75a17ab2604397adab03bb8b5fd75c" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } attrs { replace: true } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } } }
I20260709 13:21:44.868991  6623 catalog_manager.cc:5697] T be1a92657f494cac8dd227d152f50151 P 7ba59cc884714e8aa5f3f0ecaed84cbb reported cstate change: term changed from 20 to 25, leader changed from ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65) to 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68). New cstate: current_term: 25 leader_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:21:44.871199  6623 catalog_manager.cc:5697] T 7ba5dac66ab5497e9e336f2a3c28cda5 P 7ba59cc884714e8aa5f3f0ecaed84cbb reported cstate change: term changed from 20 to 23, leader changed from cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67) to 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68). New cstate: current_term: 23 leader_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:21:44.904699  6623 catalog_manager.cc:5697] T 3fa34c08b205435dba97346991aa1f92 P 7ba59cc884714e8aa5f3f0ecaed84cbb reported cstate change: term changed from 23 to 27. New cstate: current_term: 27 leader_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:21:44.906991  6623 catalog_manager.cc:5697] T 4b8cacb381b746da8d0049b0a83b41dd P 7ba59cc884714e8aa5f3f0ecaed84cbb reported cstate change: term changed from 20 to 21, leader changed from cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67) to ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65). New cstate: current_term: 21 leader_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } } }
W20260709 13:21:44.910562  6622 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:53234 (request call id 175) took 34680 ms (client timeout 15000 ms). Trace:
W20260709 13:21:44.915958  6622 rpcz_store.cc:269] 0709 13:21:10.230537 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:21:19.016348 (+8785811us) service_pool.cc:224] Handling call
0709 13:21:19.499298 (+482950us) spinlock_profiling.cc:243] Waited 186 ms on lock 0x7b5400156154. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f914090 00007fcc0f9b2f3a 00007fcc157691cc 00007fcc1586737e 00007fcc13d282a4 00007fcc13d28232 00007fcc13d28161 00007fcc13d280dc 00007fcc13d27392 00007fcc0dce548c 00007fcc0dce48c6
0709 13:21:44.910464 (+25411166us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:21:44.556368 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:21:44.567043 (+ 10675us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:21:44.567104 (+    61us) write_op.cc:435] Acquired schema lock
0709 13:21:44.567119 (+    15us) tablet.cc:662] Decoding operations
0709 13:21:44.567685 (+   566us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:21:44.567743 (+    58us) write_op.cc:641] Partition lock acquired for write op
0709 13:21:44.567783 (+    40us) tablet.cc:685] Acquiring locks for 3 operations
0709 13:21:44.568171 (+   388us) tablet.cc:701] Row locks acquired
0709 13:21:44.568185 (+    14us) write_op.cc:260] PREPARE: finished
0709 13:21:44.568348 (+   163us) write_op.cc:270] Start()
0709 13:21:44.568471 (+   123us) write_op.cc:276] Timestamp: P: 1783603304568301 usec, L: 0
0709 13:21:44.568501 (+    30us) op_driver.cc:348] REPLICATION: starting
0709 13:21:44.569261 (+   760us) log.cc:844] Serialized 1307 byte log entry
0709 13:21:44.571612 (+  2351us) op_driver.cc:464] REPLICATION: finished
0709 13:21:44.572150 (+   538us) write_op.cc:301] APPLY: starting
0709 13:21:44.572234 (+    84us) tablet.cc:1367] starting BulkCheckPresence
0709 13:21:44.574335 (+  2101us) tablet.cc:1370] finished BulkCheckPresence
0709 13:21:44.574459 (+   124us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:21:44.643056 (+ 68597us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:21:44.643304 (+   248us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=6,key_file_lookups=6,delta_file_lookups=6,mrs_lookups=0
0709 13:21:44.643352 (+    48us) write_op.cc:312] APPLY: finished
0709 13:21:44.643607 (+   255us) log.cc:844] Serialized 40 byte log entry
0709 13:21:44.643807 (+   200us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:21:44.643929 (+   122us) write_op.cc:454] Released schema lock
0709 13:21:44.643978 (+    49us) write_op.cc:341] FINISH: Updating metrics
0709 13:21:44.644517 (+   539us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:21:44.644558 (+    41us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":13344,"reported_tablets":55,"spinlock_wait_cycles":428306304,"child_traces":[["op",{"apply.queue_time_us":248,"apply.run_cpu_time_us":6658,"apply.run_wall_time_us":72281,"cfile_cache_hit":12,"cfile_cache_hit_bytes":12528,"num_ops":3,"prepare.queue_time_us":794,"prepare.run_cpu_time_us":3226,"prepare.run_wall_time_us":20807,"replication_time_us":2952}]]}
I20260709 13:21:44.915073  6623 catalog_manager.cc:5697] T fe20b4b48823486ca3b9c648db6ce8aa P 7ba59cc884714e8aa5f3f0ecaed84cbb reported cstate change: term changed from 14 to 16, leader changed from 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68) to ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65). New cstate: current_term: 16 leader_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } } }
I20260709 13:21:44.940953  6623 catalog_manager.cc:5697] T 1528ab62b6fe4e3099d08f141afee116 P 7ba59cc884714e8aa5f3f0ecaed84cbb reported cstate change: term changed from 16 to 19, leader changed from 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68) to ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65). New cstate: current_term: 19 leader_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } } }
I20260709 13:21:44.956810  6623 catalog_manager.cc:5697] T ce4f062dcd314d43a63ca74067cb5ee3 P 7ba59cc884714e8aa5f3f0ecaed84cbb reported cstate change: term changed from 15 to 16, leader changed from b7ab4784c7344b939bc36f639286f377 (127.5.126.66) to cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67). New cstate: current_term: 16 leader_uuid: "cd75a17ab2604397adab03bb8b5fd75c" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } } }
I20260709 13:21:44.958642  6623 catalog_manager.cc:5697] T 404190ce4ce94cecbfcb6ea9d1dd8626 P 7ba59cc884714e8aa5f3f0ecaed84cbb reported cstate change: term changed from 17 to 19, leader changed from b7ab4784c7344b939bc36f639286f377 (127.5.126.66) to 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68). New cstate: current_term: 19 leader_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:21:45.069828  5625 thread.cc:527] Waited for 1000ms trying to join with heartbeat (tid 6757)
I20260709 13:21:45.077893  7502 consensus_queue.cc:237] T 7a734b5ab7834e05a8c422208acc58b1 P 7ba59cc884714e8aa5f3f0ecaed84cbb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 22.12, Last appended by leader: 11, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:21:45.083238  6623 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:51654 (request call id 88) took 4994 ms. Trace:
I20260709 13:21:45.097385  6623 rpcz_store.cc:276] 0709 13:21:40.089057 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:21:44.484427 (+4395370us) service_pool.cc:224] Handling call
0709 13:21:45.083128 (+598701us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:21:44.984015 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:21:44.984609 (+   594us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:21:44.984651 (+    42us) write_op.cc:435] Acquired schema lock
0709 13:21:44.984670 (+    19us) tablet.cc:662] Decoding operations
0709 13:21:44.985944 (+  1274us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:21:44.986016 (+    72us) write_op.cc:641] Partition lock acquired for write op
0709 13:21:44.986051 (+    35us) tablet.cc:685] Acquiring locks for 13 operations
0709 13:21:44.987324 (+  1273us) tablet.cc:701] Row locks acquired
0709 13:21:44.987360 (+    36us) write_op.cc:260] PREPARE: finished
0709 13:21:44.987546 (+   186us) write_op.cc:270] Start()
0709 13:21:44.987691 (+   145us) write_op.cc:276] Timestamp: P: 1783603304987491 usec, L: 0
0709 13:21:44.987718 (+    27us) op_driver.cc:348] REPLICATION: starting
0709 13:21:44.988567 (+   849us) log.cc:844] Serialized 5213 byte log entry
0709 13:21:44.996536 (+  7969us) op_driver.cc:464] REPLICATION: finished
0709 13:21:44.997088 (+   552us) write_op.cc:301] APPLY: starting
0709 13:21:44.997183 (+    95us) tablet.cc:1367] starting BulkCheckPresence
0709 13:21:45.005903 (+  8720us) tablet.cc:1370] finished BulkCheckPresence
0709 13:21:45.006037 (+   134us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:21:45.034499 (+ 28462us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:21:45.034815 (+   316us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=26,key_file_lookups=26,delta_file_lookups=26,mrs_lookups=0
0709 13:21:45.034877 (+    62us) write_op.cc:312] APPLY: finished
0709 13:21:45.035257 (+   380us) log.cc:844] Serialized 120 byte log entry
0709 13:21:45.052298 (+ 17041us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:21:45.052505 (+   207us) write_op.cc:454] Released schema lock
0709 13:21:45.052579 (+    74us) write_op.cc:341] FINISH: Updating metrics
0709 13:21:45.072695 (+ 20116us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:21:45.072736 (+    41us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":106510,"reported_tablets":18,"spinlock_wait_cycles":2944,"child_traces":[["op",{"apply.queue_time_us":296,"apply.run_cpu_time_us":19965,"apply.run_wall_time_us":75535,"cfile_cache_hit":52,"cfile_cache_hit_bytes":54288,"num_ops":13,"prepare.queue_time_us":123,"prepare.run_cpu_time_us":4967,"prepare.run_wall_time_us":9297,"replication_time_us":8646,"spinlock_wait_cycles":49536}]]}
I20260709 13:21:45.142774  6799 raft_consensus.cc:1275] T 7a734b5ab7834e05a8c422208acc58b1 P b7ab4784c7344b939bc36f639286f377 [term 22 FOLLOWER]: Refusing update from remote peer 7ba59cc884714e8aa5f3f0ecaed84cbb: Log matching property violated. Preceding OpId in replica: term: 22 index: 12. Preceding OpId from leader: term: 22 index: 13. (index mismatch)
I20260709 13:21:45.145005  6875 raft_consensus.cc:1275] T 7a734b5ab7834e05a8c422208acc58b1 P cd75a17ab2604397adab03bb8b5fd75c [term 22 FOLLOWER]: Refusing update from remote peer 7ba59cc884714e8aa5f3f0ecaed84cbb: Log matching property violated. Preceding OpId in replica: term: 22 index: 12. Preceding OpId from leader: term: 22 index: 13. (index mismatch)
I20260709 13:21:45.149930 14411 consensus_queue.cc:1048] T 7a734b5ab7834e05a8c422208acc58b1 P 7ba59cc884714e8aa5f3f0ecaed84cbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:21:45.152107 14400 consensus_queue.cc:1048] T 7a734b5ab7834e05a8c422208acc58b1 P 7ba59cc884714e8aa5f3f0ecaed84cbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:21:45.191938  6626 catalog_manager.cc:5697] T 20f6842e26174571996b8dea4151d4be P cd75a17ab2604397adab03bb8b5fd75c reported cstate change: term changed from 20 to 22. New cstate: current_term: 22 leader_uuid: "b7ab4784c7344b939bc36f639286f377" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } }
I20260709 13:21:45.193655  6626 catalog_manager.cc:5697] T 7c44c4849aa54f2b94d1f1bef9ed546f P cd75a17ab2604397adab03bb8b5fd75c reported cstate change: term changed from 19 to 21. New cstate: current_term: 21 leader_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } }
I20260709 13:21:45.195133  6626 catalog_manager.cc:5697] T 30e88460611e47b2ba16a46a30b5f416 P cd75a17ab2604397adab03bb8b5fd75c reported cstate change: term changed from 15 to 16, leader changed from ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65) to b7ab4784c7344b939bc36f639286f377 (127.5.126.66). New cstate: current_term: 16 leader_uuid: "b7ab4784c7344b939bc36f639286f377" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } }
I20260709 13:21:45.215878  6626 catalog_manager.cc:5697] T 9e326172347f45e99a0d482b5d8ef768 P cd75a17ab2604397adab03bb8b5fd75c reported cstate change: term changed from 14 to 18, leader changed from b7ab4784c7344b939bc36f639286f377 (127.5.126.66) to cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67). New cstate: current_term: 18 leader_uuid: "cd75a17ab2604397adab03bb8b5fd75c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } health_report { overall_health: HEALTHY } } }
I20260709 13:21:45.218762  6626 catalog_manager.cc:5697] T a1704639a875409b9959353527b3fd68 P cd75a17ab2604397adab03bb8b5fd75c reported cstate change: term changed from 19 to 22. New cstate: current_term: 22 leader_uuid: "b7ab4784c7344b939bc36f639286f377" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } }
I20260709 13:21:45.221194  6626 catalog_manager.cc:5697] T 9b3759de40694069b13c0f8bd40e5709 P cd75a17ab2604397adab03bb8b5fd75c reported cstate change: term changed from 17 to 18, leader changed from b7ab4784c7344b939bc36f639286f377 (127.5.126.66) to cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67). New cstate: current_term: 18 leader_uuid: "cd75a17ab2604397adab03bb8b5fd75c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } health_report { overall_health: HEALTHY } } }
I20260709 13:21:45.227969 14400 raft_consensus.cc:2955] T 7a734b5ab7834e05a8c422208acc58b1 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 22 LEADER]: Committing config change with OpId 22.13: config changed from index 9 to 13, VOTER ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65) evicted. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } } }
I20260709 13:21:45.222852  6626 catalog_manager.cc:5697] T 713b5728a197487c9300b310ab94e5a3 P cd75a17ab2604397adab03bb8b5fd75c reported cstate change: term changed from 16 to 18, leader changed from ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65) to cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67). New cstate: current_term: 18 leader_uuid: "cd75a17ab2604397adab03bb8b5fd75c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } health_report { overall_health: HEALTHY } } }
I20260709 13:21:45.234701  6626 catalog_manager.cc:5697] T 853ac0a8cbd64ce99457f170216d4d0f P cd75a17ab2604397adab03bb8b5fd75c reported cstate change: term changed from 15 to 18, leader changed from cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67) to b7ab4784c7344b939bc36f639286f377 (127.5.126.66). New cstate: current_term: 18 leader_uuid: "b7ab4784c7344b939bc36f639286f377" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } }
I20260709 13:21:45.235764  6804 raft_consensus.cc:2955] T 7a734b5ab7834e05a8c422208acc58b1 P b7ab4784c7344b939bc36f639286f377 [term 22 FOLLOWER]: Committing config change with OpId 22.13: config changed from index 9 to 13, VOTER ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65) evicted. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } } }
I20260709 13:21:45.238293  6626 catalog_manager.cc:5697] T d8292e16e5654be6bc408560cf256aaa P cd75a17ab2604397adab03bb8b5fd75c reported cstate change: term changed from 17 to 19. New cstate: current_term: 19 leader_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } }
I20260709 13:21:45.239996  6626 catalog_manager.cc:5697] T 4275cf08e63345f993bce8664eada830 P cd75a17ab2604397adab03bb8b5fd75c reported cstate change: term changed from 17 to 19. New cstate: current_term: 19 leader_uuid: "b7ab4784c7344b939bc36f639286f377" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } }
I20260709 13:21:45.241390  6626 catalog_manager.cc:5697] T 22ccee1b570c4ad3a57bd7aec085b1b4 P cd75a17ab2604397adab03bb8b5fd75c reported cstate change: term changed from 14 to 15, leader changed from b7ab4784c7344b939bc36f639286f377 (127.5.126.66) to cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67). New cstate: current_term: 15 leader_uuid: "cd75a17ab2604397adab03bb8b5fd75c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } health_report { overall_health: HEALTHY } } }
I20260709 13:21:45.242873  6626 catalog_manager.cc:5697] T 7887766dc6784fcaa42b35c05fea7a99 P cd75a17ab2604397adab03bb8b5fd75c reported cstate change: term changed from 20 to 23. New cstate: current_term: 23 leader_uuid: "b7ab4784c7344b939bc36f639286f377" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } }
I20260709 13:21:45.251600  6616 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 7a734b5ab7834e05a8c422208acc58b1 with cas_config_opid_index 9: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:21:45.260596  6626 catalog_manager.cc:5697] T ab432e62819d499eaaf3dd55481dd930 P cd75a17ab2604397adab03bb8b5fd75c reported cstate change: term changed from 22 to 23, leader changed from ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65) to b7ab4784c7344b939bc36f639286f377 (127.5.126.66). New cstate: current_term: 23 leader_uuid: "b7ab4784c7344b939bc36f639286f377" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } }
I20260709 13:21:45.262944  6626 catalog_manager.cc:5697] T 07a92dd554674067a83a9cb68c4773f2 P cd75a17ab2604397adab03bb8b5fd75c reported cstate change: term changed from 16 to 19, leader changed from ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65) to b7ab4784c7344b939bc36f639286f377 (127.5.126.66). New cstate: current_term: 19 leader_uuid: "b7ab4784c7344b939bc36f639286f377" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } }
I20260709 13:21:45.264387  6626 catalog_manager.cc:5697] T f58dc08b12a2494bb9a1372837970ca2 P cd75a17ab2604397adab03bb8b5fd75c reported cstate change: term changed from 18 to 20. New cstate: current_term: 20 leader_uuid: "b7ab4784c7344b939bc36f639286f377" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } }
I20260709 13:21:45.265686  6626 catalog_manager.cc:5697] T c4db81d9d329422bb3b4160ca4ac2d1d P cd75a17ab2604397adab03bb8b5fd75c reported cstate change: term changed from 18 to 20, leader changed from cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67) to b7ab4784c7344b939bc36f639286f377 (127.5.126.66). New cstate: current_term: 20 leader_uuid: "b7ab4784c7344b939bc36f639286f377" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } }
I20260709 13:21:45.266812  6626 catalog_manager.cc:5697] T bd6869f07b5a4885a0b99fbe60c3b175 P cd75a17ab2604397adab03bb8b5fd75c reported cstate change: term changed from 20 to 22, leader changed from ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65) to b7ab4784c7344b939bc36f639286f377 (127.5.126.66). New cstate: current_term: 22 leader_uuid: "b7ab4784c7344b939bc36f639286f377" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } }
I20260709 13:21:45.298359  6875 raft_consensus.cc:2955] T 7a734b5ab7834e05a8c422208acc58b1 P cd75a17ab2604397adab03bb8b5fd75c [term 22 FOLLOWER]: Committing config change with OpId 22.13: config changed from index 9 to 13, VOTER ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65) evicted. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } } }
I20260709 13:21:45.343708 14236 raft_consensus.cc:493] T 9e326172347f45e99a0d482b5d8ef768 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader cd75a17ab2604397adab03bb8b5fd75c)
I20260709 13:21:45.344342 14236 raft_consensus.cc:515] T 9e326172347f45e99a0d482b5d8ef768 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:45.346535 14236 leader_election.cc:290] T 9e326172347f45e99a0d482b5d8ef768 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:21:45.347766  6881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e326172347f45e99a0d482b5d8ef768" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:21:45.354355  6799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e326172347f45e99a0d482b5d8ef768" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:21:45.355895  6695 leader_election.cc:304] T 9e326172347f45e99a0d482b5d8ef768 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:21:45.357820 14430 raft_consensus.cc:2749] T 9e326172347f45e99a0d482b5d8ef768 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:21:45.443152  6844 consensus_peers.cc:597] T 1bf4668eeb70467fb3dc5a0289233b3c P cd75a17ab2604397adab03bb8b5fd75c -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:21:45.460570  6844 consensus_peers.cc:597] T 9e326172347f45e99a0d482b5d8ef768 P cd75a17ab2604397adab03bb8b5fd75c -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:21:45.474102  6844 consensus_peers.cc:597] T 34f36d59d88f40fe8a2805e604fc6c0a P cd75a17ab2604397adab03bb8b5fd75c -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:21:45.474339  6623 catalog_manager.cc:5697] T bb7fa124c3bf4ef9ab65a407cb008441 P 7ba59cc884714e8aa5f3f0ecaed84cbb reported cstate change: term changed from 18 to 19, leader changed from b7ab4784c7344b939bc36f639286f377 (127.5.126.66) to cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67). New cstate: current_term: 19 leader_uuid: "cd75a17ab2604397adab03bb8b5fd75c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } } }
I20260709 13:21:45.477387  6623 catalog_manager.cc:5697] T d8cee0accdb8499c86d4414b72565a38 P 7ba59cc884714e8aa5f3f0ecaed84cbb reported cstate change: term changed from 21 to 23. New cstate: current_term: 23 leader_uuid: "b7ab4784c7344b939bc36f639286f377" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } } }
I20260709 13:21:45.551895 14435 raft_consensus.cc:493] T e31b9971c15848dea59d4d4130141d9e P ccd8a4c3bfe3413cb2ae219b09aea832 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader cd75a17ab2604397adab03bb8b5fd75c)
I20260709 13:21:45.552604 14435 raft_consensus.cc:515] T e31b9971c15848dea59d4d4130141d9e P ccd8a4c3bfe3413cb2ae219b09aea832 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:45.555024 14435 leader_election.cc:290] T e31b9971c15848dea59d4d4130141d9e P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:21:45.556407  6881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e31b9971c15848dea59d4d4130141d9e" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:21:45.557894  6804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e31b9971c15848dea59d4d4130141d9e" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:21:45.559453  6695 leader_election.cc:304] T e31b9971c15848dea59d4d4130141d9e P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:21:45.560983 14236 raft_consensus.cc:2749] T e31b9971c15848dea59d4d4130141d9e P ccd8a4c3bfe3413cb2ae219b09aea832 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:21:45.568943 14435 raft_consensus.cc:493] T f58dc08b12a2494bb9a1372837970ca2 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader cd75a17ab2604397adab03bb8b5fd75c)
I20260709 13:21:45.569612 14435 raft_consensus.cc:515] T f58dc08b12a2494bb9a1372837970ca2 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:45.573848  6804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f58dc08b12a2494bb9a1372837970ca2" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:21:45.577668  6881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f58dc08b12a2494bb9a1372837970ca2" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:21:45.579241  6697 leader_election.cc:304] T f58dc08b12a2494bb9a1372837970ca2 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:21:45.580142 14236 raft_consensus.cc:2749] T f58dc08b12a2494bb9a1372837970ca2 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:21:45.581015 14435 leader_election.cc:290] T f58dc08b12a2494bb9a1372837970ca2 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
W20260709 13:21:45.633248  6626 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:53234 (request call id 176) took 17058 ms (client timeout 15000 ms). Trace:
W20260709 13:21:45.636096  6626 rpcz_store.cc:269] 0709 13:21:28.575501 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:21:38.670102 (+10094601us) service_pool.cc:224] Handling call
0709 13:21:38.998286 (+328184us) spinlock_profiling.cc:243] Waited 6.54 ms on lock 0x7b5400280190. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0c745db1 00007fcc0c885b71 00007fcc0c8860b2 00007fcc157ffa89 00007fcc15797da6 00007fcc15769088 00007fcc1586737e 00007fcc13d282a4 00007fcc13d28232 00007fcc13d28161 00007fcc13d280dc
0709 13:21:39.004209 (+  5923us) spinlock_profiling.cc:243] Waited 3.34 ms on lock 0x7b5400156154. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f914090 00007fcc0f9b2f3a 00007fcc157691cc 00007fcc1586737e 00007fcc13d282a4 00007fcc13d28232 00007fcc13d28161 00007fcc13d280dc 00007fcc13d27392 00007fcc0dce548c 00007fcc0dce48c6
0709 13:21:45.633165 (+6628956us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:21:45.271692 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:21:45.272540 (+   848us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:21:45.272577 (+    37us) write_op.cc:435] Acquired schema lock
0709 13:21:45.272596 (+    19us) tablet.cc:662] Decoding operations
0709 13:21:45.274018 (+  1422us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:21:45.274076 (+    58us) write_op.cc:641] Partition lock acquired for write op
0709 13:21:45.274103 (+    27us) tablet.cc:685] Acquiring locks for 17 operations
0709 13:21:45.275355 (+  1252us) tablet.cc:701] Row locks acquired
0709 13:21:45.275381 (+    26us) write_op.cc:260] PREPARE: finished
0709 13:21:45.275530 (+   149us) write_op.cc:270] Start()
0709 13:21:45.275641 (+   111us) write_op.cc:276] Timestamp: P: 1783603305275483 usec, L: 0
0709 13:21:45.275666 (+    25us) op_driver.cc:348] REPLICATION: starting
0709 13:21:45.277545 (+  1879us) log.cc:844] Serialized 6699 byte log entry
0709 13:21:45.280957 (+  3412us) op_driver.cc:464] REPLICATION: finished
0709 13:21:45.281960 (+  1003us) write_op.cc:301] APPLY: starting
0709 13:21:45.282060 (+   100us) tablet.cc:1367] starting BulkCheckPresence
0709 13:21:45.301394 (+ 19334us) tablet.cc:1370] finished BulkCheckPresence
0709 13:21:45.301501 (+   107us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:21:45.385207 (+ 83706us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:21:45.385518 (+   311us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=34,key_file_lookups=34,delta_file_lookups=34,mrs_lookups=0
0709 13:21:45.385598 (+    80us) write_op.cc:312] APPLY: finished
0709 13:21:45.403212 (+ 17614us) log.cc:844] Serialized 156 byte log entry
0709 13:21:45.403402 (+   190us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:21:45.403574 (+   172us) write_op.cc:454] Released schema lock
0709 13:21:45.403636 (+    62us) write_op.cc:341] FINISH: Updating metrics
0709 13:21:45.406537 (+  2901us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:21:45.406577 (+    40us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":20941,"reported_tablets":55,"spinlock_wait_cycles":22749696,"child_traces":[["op",{"apply.queue_time_us":716,"apply.run_cpu_time_us":24245,"apply.run_wall_time_us":124551,"cfile_cache_hit":68,"cfile_cache_hit_bytes":70992,"num_ops":17,"prepare.queue_time_us":146,"prepare.run_cpu_time_us":5184,"prepare.run_wall_time_us":8692,"replication_time_us":5077}]]}
W20260709 13:21:45.660698  7468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 44276.7us
W20260709 13:21:45.666675  6770 consensus_peers.cc:597] T 22ccee1b570c4ad3a57bd7aec085b1b4 P b7ab4784c7344b939bc36f639286f377 -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:21:45.701035  6844 consensus_peers.cc:597] T c4db81d9d329422bb3b4160ca4ac2d1d P cd75a17ab2604397adab03bb8b5fd75c -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:21:45.727022  6844 consensus_peers.cc:597] T e31b9971c15848dea59d4d4130141d9e P cd75a17ab2604397adab03bb8b5fd75c -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:21:45.748907  6875 consensus_queue.cc:237] T 95a75bfe094d4bdc963aba3f08dfcd25 P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 10, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
W20260709 13:21:45.791172  6770 consensus_peers.cc:597] T 9b3759de40694069b13c0f8bd40e5709 P b7ab4784c7344b939bc36f639286f377 -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:21:45.809867  7466 consensus_peers.cc:597] T b3f13b31a1f84f0d89d007eadd57924c P 7ba59cc884714e8aa5f3f0ecaed84cbb -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:21:45.820446 14236 raft_consensus.cc:493] T 3d65025eea89441290d85dd053810e31 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:21:45.822382 14236 raft_consensus.cc:515] T 3d65025eea89441290d85dd053810e31 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:45.828270  6799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d65025eea89441290d85dd053810e31" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:21:45.829849 14236 leader_election.cc:290] T 3d65025eea89441290d85dd053810e31 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:21:45.830863  7502 raft_consensus.cc:1275] T 95a75bfe094d4bdc963aba3f08dfcd25 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 18 FOLLOWER]: Refusing update from remote peer cd75a17ab2604397adab03bb8b5fd75c: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 13:21:45.832182  6877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d65025eea89441290d85dd053810e31" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:21:45.834322  6697 leader_election.cc:304] T 3d65025eea89441290d85dd053810e31 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:21:45.836493 14445 raft_consensus.cc:2749] T 3d65025eea89441290d85dd053810e31 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 13:21:45.838661  6844 consensus_peers.cc:597] T 90d42e216d9741e190bca19a781291fd P cd75a17ab2604397adab03bb8b5fd75c -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:21:45.839481  6770 consensus_peers.cc:597] T 3d65025eea89441290d85dd053810e31 P b7ab4784c7344b939bc36f639286f377 -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:21:45.837857 14436 consensus_queue.cc:1048] T 95a75bfe094d4bdc963aba3f08dfcd25 P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.008s
W20260709 13:21:45.861588  6770 consensus_peers.cc:597] T 30e88460611e47b2ba16a46a30b5f416 P b7ab4784c7344b939bc36f639286f377 -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:21:45.867601  6844 consensus_peers.cc:597] T 95a75bfe094d4bdc963aba3f08dfcd25 P cd75a17ab2604397adab03bb8b5fd75c -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:45.877061  6623 catalog_manager.cc:5697] T 7a734b5ab7834e05a8c422208acc58b1 P 7ba59cc884714e8aa5f3f0ecaed84cbb reported cstate change: config changed from index 9 to 13, VOTER ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65) evicted. New cstate: current_term: 22 leader_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" committed_config { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:21:45.878254  6770 consensus_peers.cc:597] T 8c7f33e544204fbaac4078e3e83bbf4e P b7ab4784c7344b939bc36f639286f377 -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:21:45.884759  6614 catalog_manager.cc:4755] TS ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet ce4f062dcd314d43a63ca74067cb5ee3: Remote error: Service unavailable: service kudu.tserver.TabletServerAdminService not registered on TabletServer
I20260709 13:21:45.895218 14430 raft_consensus.cc:493] T 1bf4668eeb70467fb3dc5a0289233b3c P ccd8a4c3bfe3413cb2ae219b09aea832 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader cd75a17ab2604397adab03bb8b5fd75c)
I20260709 13:21:45.896128 14430 raft_consensus.cc:515] T 1bf4668eeb70467fb3dc5a0289233b3c P ccd8a4c3bfe3413cb2ae219b09aea832 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:45.897887 14445 raft_consensus.cc:493] T c4db81d9d329422bb3b4160ca4ac2d1d P ccd8a4c3bfe3413cb2ae219b09aea832 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader cd75a17ab2604397adab03bb8b5fd75c)
I20260709 13:21:45.899935  6799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bf4668eeb70467fb3dc5a0289233b3c" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:21:45.900509 14445 raft_consensus.cc:515] T c4db81d9d329422bb3b4160ca4ac2d1d P ccd8a4c3bfe3413cb2ae219b09aea832 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:45.905448 14445 leader_election.cc:290] T c4db81d9d329422bb3b4160ca4ac2d1d P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:21:45.906500  6804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4db81d9d329422bb3b4160ca4ac2d1d" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
W20260709 13:21:45.910725  7466 consensus_peers.cc:597] T 427c124d773f483294511e80fe340075 P 7ba59cc884714e8aa5f3f0ecaed84cbb -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:21:45.921778  6881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bf4668eeb70467fb3dc5a0289233b3c" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:21:45.923645 14430 leader_election.cc:290] T 1bf4668eeb70467fb3dc5a0289233b3c P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:21:45.924405  6877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4db81d9d329422bb3b4160ca4ac2d1d" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:21:45.926946 14430 raft_consensus.cc:493] T 4d9def8b32fd443aa94ab1420b06837b P ccd8a4c3bfe3413cb2ae219b09aea832 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:21:45.927122  6697 leader_election.cc:304] T 1bf4668eeb70467fb3dc5a0289233b3c P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:21:45.928279 14445 raft_consensus.cc:2749] T 1bf4668eeb70467fb3dc5a0289233b3c P ccd8a4c3bfe3413cb2ae219b09aea832 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:21:45.930529  6695 leader_election.cc:304] T c4db81d9d329422bb3b4160ca4ac2d1d P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:21:45.931655 14445 raft_consensus.cc:2749] T c4db81d9d329422bb3b4160ca4ac2d1d P ccd8a4c3bfe3413cb2ae219b09aea832 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:21:45.927676 14430 raft_consensus.cc:515] T 4d9def8b32fd443aa94ab1420b06837b P ccd8a4c3bfe3413cb2ae219b09aea832 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
W20260709 13:21:45.939278  6770 consensus_peers.cc:597] T 07a92dd554674067a83a9cb68c4773f2 P b7ab4784c7344b939bc36f639286f377 -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:21:45.940267  6770 consensus_peers.cc:597] T 4d9def8b32fd443aa94ab1420b06837b P b7ab4784c7344b939bc36f639286f377 -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:21:45.940874  6770 consensus_peers.cc:597] T 853ac0a8cbd64ce99457f170216d4d0f P b7ab4784c7344b939bc36f639286f377 -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:21:45.936765  6799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d9def8b32fd443aa94ab1420b06837b" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 25 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
W20260709 13:21:45.943840  6844 consensus_peers.cc:597] T f58dc08b12a2494bb9a1372837970ca2 P cd75a17ab2604397adab03bb8b5fd75c -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:21:45.945735  6877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d9def8b32fd443aa94ab1420b06837b" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 25 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:21:45.950235  6697 leader_election.cc:304] T 4d9def8b32fd443aa94ab1420b06837b P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:21:45.951469 14445 raft_consensus.cc:2749] T 4d9def8b32fd443aa94ab1420b06837b P ccd8a4c3bfe3413cb2ae219b09aea832 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:21:45.952266 14435 raft_consensus.cc:493] T 34f36d59d88f40fe8a2805e604fc6c0a P ccd8a4c3bfe3413cb2ae219b09aea832 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader cd75a17ab2604397adab03bb8b5fd75c)
I20260709 13:21:45.952946 14435 raft_consensus.cc:515] T 34f36d59d88f40fe8a2805e604fc6c0a P ccd8a4c3bfe3413cb2ae219b09aea832 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:45.953495 14430 leader_election.cc:290] T 4d9def8b32fd443aa94ab1420b06837b P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:21:45.960310 14435 leader_election.cc:290] T 34f36d59d88f40fe8a2805e604fc6c0a P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:21:45.962881  6799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34f36d59d88f40fe8a2805e604fc6c0a" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:21:45.963399 14436 raft_consensus.cc:2955] T 95a75bfe094d4bdc963aba3f08dfcd25 P cd75a17ab2604397adab03bb8b5fd75c [term 18 LEADER]: Committing config change with OpId 18.12: config changed from index 9 to 12, VOTER b7ab4784c7344b939bc36f639286f377 (127.5.126.66) evicted. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } } }
I20260709 13:21:45.966712  6881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34f36d59d88f40fe8a2805e604fc6c0a" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:21:45.972965  6697 leader_election.cc:304] T 34f36d59d88f40fe8a2805e604fc6c0a P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:21:45.971063  7502 raft_consensus.cc:2955] T 95a75bfe094d4bdc963aba3f08dfcd25 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 18 FOLLOWER]: Committing config change with OpId 18.12: config changed from index 9 to 12, VOTER b7ab4784c7344b939bc36f639286f377 (127.5.126.66) evicted. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } } }
I20260709 13:21:45.984699 14445 raft_consensus.cc:2749] T 34f36d59d88f40fe8a2805e604fc6c0a P ccd8a4c3bfe3413cb2ae219b09aea832 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 13:21:45.989889  7466 consensus_peers.cc:597] T 404190ce4ce94cecbfcb6ea9d1dd8626 P 7ba59cc884714e8aa5f3f0ecaed84cbb -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:21:45.990602  7466 consensus_peers.cc:597] T 24ee15416e3145beaa1b8183453729a3 P 7ba59cc884714e8aa5f3f0ecaed84cbb -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:21:45.999100  6625 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:53234 (request call id 172) took 95759 ms (client timeout 15000 ms). Trace:
I20260709 13:21:46.001935 14430 raft_consensus.cc:493] T 2c240553ce044eedb41541d72b9475d7 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:21:46.002578 14430 raft_consensus.cc:515] T 2c240553ce044eedb41541d72b9475d7 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:46.004825 14430 leader_election.cc:290] T 2c240553ce044eedb41541d72b9475d7 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
W20260709 13:21:45.999904  6625 rpcz_store.cc:269] 0709 13:20:10.239535 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:10.244318 (+  4783us) service_pool.cc:224] Handling call
0709 13:20:11.547346 (+1303028us) spinlock_profiling.cc:243] Waited 573 ms on lock 0x7b5400156154. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f914090 00007fcc0f9b2f3a 00007fcc157691cc 00007fcc1586737e 00007fcc13d282a4 00007fcc13d28232 00007fcc13d28161 00007fcc13d280dc 00007fcc13d27392 00007fcc0dce548c 00007fcc0dce48c6
0709 13:21:45.998933 (+94451587us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":109840,"reported_tablets":55,"spinlock_wait_cycles":1318329088}
I20260709 13:21:46.008558  6877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c240553ce044eedb41541d72b9475d7" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:21:46.011307  6799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c240553ce044eedb41541d72b9475d7" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
W20260709 13:21:46.014036  6770 consensus_peers.cc:597] T 4275cf08e63345f993bce8664eada830 P b7ab4784c7344b939bc36f639286f377 -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:21:46.014036  6695 leader_election.cc:304] T 2c240553ce044eedb41541d72b9475d7 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
W20260709 13:21:46.014915  6770 consensus_peers.cc:597] T 2c240553ce044eedb41541d72b9475d7 P b7ab4784c7344b939bc36f639286f377 -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:21:46.015439  6770 consensus_peers.cc:597] T 20f6842e26174571996b8dea4151d4be P b7ab4784c7344b939bc36f639286f377 -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:21:46.017329  6770 consensus_peers.cc:597] T a1704639a875409b9959353527b3fd68 P b7ab4784c7344b939bc36f639286f377 -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:21:46.017428 14435 raft_consensus.cc:2749] T 2c240553ce044eedb41541d72b9475d7 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 13:21:46.026329  7466 consensus_peers.cc:597] T be1a92657f494cac8dd227d152f50151 P 7ba59cc884714e8aa5f3f0ecaed84cbb -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:21:46.026764  6770 consensus_peers.cc:597] T f09c2a98de1a4decabd0ff900dd44caa P b7ab4784c7344b939bc36f639286f377 -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:21:46.036362  6616 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 95a75bfe094d4bdc963aba3f08dfcd25 with cas_config_opid_index 9: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
W20260709 13:21:46.047657  6770 consensus_peers.cc:597] T f3f9c2e2bf644115957398fe4c9459db P b7ab4784c7344b939bc36f639286f377 -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:21:46.047991  6625 catalog_manager.cc:5697] T 95a75bfe094d4bdc963aba3f08dfcd25 P 7ba59cc884714e8aa5f3f0ecaed84cbb reported cstate change: config changed from index 9 to 12, VOTER b7ab4784c7344b939bc36f639286f377 (127.5.126.66) evicted. New cstate: current_term: 18 leader_uuid: "cd75a17ab2604397adab03bb8b5fd75c" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } } }
W20260709 13:21:46.053637  6770 consensus_peers.cc:597] T f03d0dbf16864ca4bc1bb5e4c0334c0f P b7ab4784c7344b939bc36f639286f377 -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:21:46.070418  5625 thread.cc:527] Waited for 2000ms trying to join with heartbeat (tid 6757)
I20260709 13:21:46.085256  6790 tablet_service.cc:1558] Processing DeleteTablet for tablet 95a75bfe094d4bdc963aba3f08dfcd25 with delete_type TABLET_DATA_TOMBSTONED (TS b7ab4784c7344b939bc36f639286f377 not found in new config with opid_index 12) from {username='slave'} at 127.0.0.1:41714
W20260709 13:21:46.092113  6770 consensus_peers.cc:597] T f5be3a11b23d4ea9b08300a2789821c7 P b7ab4784c7344b939bc36f639286f377 -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:21:46.097290 14453 tablet_replica.cc:333] T 95a75bfe094d4bdc963aba3f08dfcd25 P b7ab4784c7344b939bc36f639286f377: stopping tablet replica
I20260709 13:21:46.097419 14435 raft_consensus.cc:493] T 7a734b5ab7834e05a8c422208acc58b1 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 7ba59cc884714e8aa5f3f0ecaed84cbb)
I20260709 13:21:46.098537 14435 raft_consensus.cc:515] T 7a734b5ab7834e05a8c422208acc58b1 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } attrs { replace: true } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:21:46.099440 14453 raft_consensus.cc:2243] T 95a75bfe094d4bdc963aba3f08dfcd25 P b7ab4784c7344b939bc36f639286f377 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:46.100797 14453 raft_consensus.cc:2272] T 95a75bfe094d4bdc963aba3f08dfcd25 P b7ab4784c7344b939bc36f639286f377 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:46.101732  6799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a734b5ab7834e05a8c422208acc58b1" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:21:46.103750  6872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a734b5ab7834e05a8c422208acc58b1" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:21:46.104986  7502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a734b5ab7834e05a8c422208acc58b1" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:21:46.105463 14435 leader_election.cc:290] T 7a734b5ab7834e05a8c422208acc58b1 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:21:46.110008  6697 leader_election.cc:304] T 7a734b5ab7834e05a8c422208acc58b1 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, b7ab4784c7344b939bc36f639286f377
I20260709 13:21:46.116258 14435 raft_consensus.cc:2749] T 7a734b5ab7834e05a8c422208acc58b1 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:21:46.119892 14453 ts_tablet_manager.cc:1916] T 95a75bfe094d4bdc963aba3f08dfcd25 P b7ab4784c7344b939bc36f639286f377: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
W20260709 13:21:46.153528  7466 consensus_peers.cc:597] T 3fa34c08b205435dba97346991aa1f92 P 7ba59cc884714e8aa5f3f0ecaed84cbb -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:21:46.154884  6844 consensus_peers.cc:597] T 44bde925b2e541b69890d70715b85176 P cd75a17ab2604397adab03bb8b5fd75c -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:21:46.159256 14445 raft_consensus.cc:493] T 24ee15416e3145beaa1b8183453729a3 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 7ba59cc884714e8aa5f3f0ecaed84cbb)
I20260709 13:21:46.159907 14445 raft_consensus.cc:515] T 24ee15416e3145beaa1b8183453729a3 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:21:46.162277 14445 leader_election.cc:290] T 24ee15416e3145beaa1b8183453729a3 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:21:46.169948  7502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24ee15416e3145beaa1b8183453729a3" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:21:46.172536  6877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24ee15416e3145beaa1b8183453729a3" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:21:46.176980  6697 leader_election.cc:304] T 24ee15416e3145beaa1b8183453729a3 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:21:46.178295 14435 raft_consensus.cc:493] T be1a92657f494cac8dd227d152f50151 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 7ba59cc884714e8aa5f3f0ecaed84cbb)
I20260709 13:21:46.178879 14435 raft_consensus.cc:515] T be1a92657f494cac8dd227d152f50151 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:21:46.180995 14435 leader_election.cc:290] T be1a92657f494cac8dd227d152f50151 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:21:46.182611  6799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be1a92657f494cac8dd227d152f50151" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 26 candidate_status { last_received { term: 25 index: 18 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:21:46.185401 14445 raft_consensus.cc:2749] T 24ee15416e3145beaa1b8183453729a3 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:21:46.191359  7502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be1a92657f494cac8dd227d152f50151" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 26 candidate_status { last_received { term: 25 index: 18 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:21:46.225250 14445 raft_consensus.cc:493] T b56bf91d90824c959e21e0cee5ba1816 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:21:46.225878 14445 raft_consensus.cc:515] T b56bf91d90824c959e21e0cee5ba1816 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
W20260709 13:21:46.227578  7466 consensus_peers.cc:597] T 17587d6730594da4a56fa13a353232a1 P 7ba59cc884714e8aa5f3f0ecaed84cbb -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:21:46.229984  6697 leader_election.cc:304] T be1a92657f494cac8dd227d152f50151 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, b7ab4784c7344b939bc36f639286f377
I20260709 13:21:46.231076  6804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b56bf91d90824c959e21e0cee5ba1816" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:21:46.237643 14435 raft_consensus.cc:2749] T be1a92657f494cac8dd227d152f50151 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:21:46.238786  6877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b56bf91d90824c959e21e0cee5ba1816" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:21:46.233037 14445 leader_election.cc:290] T b56bf91d90824c959e21e0cee5ba1816 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:21:46.242939 14435 raft_consensus.cc:493] T 22ccee1b570c4ad3a57bd7aec085b1b4 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:21:46.243482 14435 raft_consensus.cc:515] T 22ccee1b570c4ad3a57bd7aec085b1b4 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:46.247479  6697 leader_election.cc:304] T b56bf91d90824c959e21e0cee5ba1816 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:21:46.249060 14236 raft_consensus.cc:493] T 404190ce4ce94cecbfcb6ea9d1dd8626 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 7ba59cc884714e8aa5f3f0ecaed84cbb)
I20260709 13:21:46.250049 14434 raft_consensus.cc:2749] T b56bf91d90824c959e21e0cee5ba1816 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:21:46.249990 14236 raft_consensus.cc:515] T 404190ce4ce94cecbfcb6ea9d1dd8626 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:21:46.252204 14435 leader_election.cc:290] T 22ccee1b570c4ad3a57bd7aec085b1b4 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:21:46.254711  6803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "404190ce4ce94cecbfcb6ea9d1dd8626" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:21:46.255427  6804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22ccee1b570c4ad3a57bd7aec085b1b4" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:21:46.252768 14236 leader_election.cc:290] T 404190ce4ce94cecbfcb6ea9d1dd8626 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:21:46.271845 14453 ts_tablet_manager.cc:1929] T 95a75bfe094d4bdc963aba3f08dfcd25 P b7ab4784c7344b939bc36f639286f377: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 18.11
I20260709 13:21:46.272425 14453 log.cc:1199] T 95a75bfe094d4bdc963aba3f08dfcd25 P b7ab4784c7344b939bc36f639286f377: Deleting WAL directory at /tmp/dist-test-taskWHb0CB/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783603057096655-5625-0/minicluster-data/ts-1-root/wals/95a75bfe094d4bdc963aba3f08dfcd25
I20260709 13:21:46.276394  6614 catalog_manager.cc:5028] TS b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817): tablet 95a75bfe094d4bdc963aba3f08dfcd25 (table test-workload [id=04f4d366747e43549980077479ed75b9]) successfully deleted
I20260709 13:21:46.280292 14435 raft_consensus.cc:493] T 07a92dd554674067a83a9cb68c4773f2 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:21:46.281042 14435 raft_consensus.cc:515] T 07a92dd554674067a83a9cb68c4773f2 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:46.283567 14435 leader_election.cc:290] T 07a92dd554674067a83a9cb68c4773f2 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:21:46.284425  6804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a92dd554674067a83a9cb68c4773f2" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:21:46.286357  6877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22ccee1b570c4ad3a57bd7aec085b1b4" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
W20260709 13:21:46.288102  6627 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:53214 (request call id 179) took 77836 ms (client timeout 15000 ms). Trace:
W20260709 13:21:46.288730  6770 consensus_peers.cc:597] T 7887766dc6784fcaa42b35c05fea7a99 P b7ab4784c7344b939bc36f639286f377 -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:21:46.288760  6627 rpcz_store.cc:269] 0709 13:20:28.451917 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:28.452120 (+   203us) service_pool.cc:224] Handling call
0709 13:21:46.287777 (+77835657us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":37284,"reported_tablets":55}
I20260709 13:21:46.297443  7502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "404190ce4ce94cecbfcb6ea9d1dd8626" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:21:46.298720  6877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a92dd554674067a83a9cb68c4773f2" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:21:46.310634  6697 leader_election.cc:304] T 404190ce4ce94cecbfcb6ea9d1dd8626 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, b7ab4784c7344b939bc36f639286f377
W20260709 13:21:46.314311  6628 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:53234 (request call id 171) took 118684 ms (client timeout 15000 ms). Trace:
I20260709 13:21:46.315148 14236 raft_consensus.cc:2749] T 404190ce4ce94cecbfcb6ea9d1dd8626 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 13:21:46.339720  6628 rpcz_store.cc:269] 0709 13:19:47.636892 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:47.662011 (+ 25119us) service_pool.cc:224] Handling call
0709 13:19:47.846164 (+184153us) spinlock_profiling.cc:243] Waited 38.9 ms on lock 0x7b5400156154. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f914090 00007fcc0f9b2f3a 00007fcc157691cc 00007fcc1586737e 00007fcc13d282a4 00007fcc13d28232 00007fcc13d28161 00007fcc13d280dc 00007fcc13d27392 00007fcc0dce548c 00007fcc0dce48c6
0709 13:21:46.314020 (+118467856us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":85675,"reported_tablets":55,"spinlock_wait_cycles":89389312}
I20260709 13:21:46.319150  6697 leader_election.cc:304] T 22ccee1b570c4ad3a57bd7aec085b1b4 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
W20260709 13:21:46.330608  6770 consensus_peers.cc:597] T 3a485a995abc4807b6e511e45419f737 P b7ab4784c7344b939bc36f639286f377 -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:21:46.346999 14236 raft_consensus.cc:2749] T 22ccee1b570c4ad3a57bd7aec085b1b4 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:21:46.347440  6697 leader_election.cc:304] T 07a92dd554674067a83a9cb68c4773f2 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:21:46.349658 14236 raft_consensus.cc:2749] T 07a92dd554674067a83a9cb68c4773f2 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:21:46.364564 14236 raft_consensus.cc:493] T 853ac0a8cbd64ce99457f170216d4d0f P ccd8a4c3bfe3413cb2ae219b09aea832 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:21:46.365345 14236 raft_consensus.cc:515] T 853ac0a8cbd64ce99457f170216d4d0f P ccd8a4c3bfe3413cb2ae219b09aea832 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:46.366080 14445 raft_consensus.cc:493] T 427c124d773f483294511e80fe340075 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 7ba59cc884714e8aa5f3f0ecaed84cbb)
I20260709 13:21:46.366844 14445 raft_consensus.cc:515] T 427c124d773f483294511e80fe340075 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } attrs { replace: true } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:21:46.367640 14236 leader_election.cc:290] T 853ac0a8cbd64ce99457f170216d4d0f P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:21:46.368498 14236 raft_consensus.cc:493] T 90d42e216d9741e190bca19a781291fd P ccd8a4c3bfe3413cb2ae219b09aea832 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader cd75a17ab2604397adab03bb8b5fd75c)
I20260709 13:21:46.368997 14236 raft_consensus.cc:515] T 90d42e216d9741e190bca19a781291fd P ccd8a4c3bfe3413cb2ae219b09aea832 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:46.369967  6804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "853ac0a8cbd64ce99457f170216d4d0f" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:21:46.371345 14236 leader_election.cc:290] T 90d42e216d9741e190bca19a781291fd P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:21:46.373175  6804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90d42e216d9741e190bca19a781291fd" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:21:46.373745 14435 raft_consensus.cc:493] T f03d0dbf16864ca4bc1bb5e4c0334c0f P ccd8a4c3bfe3413cb2ae219b09aea832 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:21:46.374429 14435 raft_consensus.cc:515] T f03d0dbf16864ca4bc1bb5e4c0334c0f P ccd8a4c3bfe3413cb2ae219b09aea832 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:46.377460 14435 leader_election.cc:290] T f03d0dbf16864ca4bc1bb5e4c0334c0f P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:21:46.380209  6803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f03d0dbf16864ca4bc1bb5e4c0334c0f" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:21:46.386387  6799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "427c124d773f483294511e80fe340075" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:21:46.386754  6877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "853ac0a8cbd64ce99457f170216d4d0f" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:21:46.388434 14236 raft_consensus.cc:493] T 4275cf08e63345f993bce8664eada830 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:21:46.389031 14236 raft_consensus.cc:515] T 4275cf08e63345f993bce8664eada830 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:46.397116 14445 leader_election.cc:290] T 427c124d773f483294511e80fe340075 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:21:46.398937 14430 raft_consensus.cc:493] T b3f13b31a1f84f0d89d007eadd57924c P ccd8a4c3bfe3413cb2ae219b09aea832 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 7ba59cc884714e8aa5f3f0ecaed84cbb)
I20260709 13:21:46.401208 14430 raft_consensus.cc:515] T b3f13b31a1f84f0d89d007eadd57924c P ccd8a4c3bfe3413cb2ae219b09aea832 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:21:46.404779 14430 leader_election.cc:290] T b3f13b31a1f84f0d89d007eadd57924c P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:21:46.407006  6803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3f13b31a1f84f0d89d007eadd57924c" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:21:46.404824  6804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4275cf08e63345f993bce8664eada830" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:21:46.409073  6877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90d42e216d9741e190bca19a781291fd" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:21:46.410694 14236 leader_election.cc:290] T 4275cf08e63345f993bce8664eada830 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:21:46.413071  6872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f03d0dbf16864ca4bc1bb5e4c0334c0f" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:21:46.417306  6872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "427c124d773f483294511e80fe340075" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:21:46.422269 14236 raft_consensus.cc:493] T 3a485a995abc4807b6e511e45419f737 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:21:46.419993  6621 catalog_manager.cc:5697] T dbdf895bba214ff68685a24fd17dfb5d P ccd8a4c3bfe3413cb2ae219b09aea832 reported cstate change: term changed from 17 to 20, leader changed from cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67) to ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65). New cstate: current_term: 20 leader_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } health_report { overall_health: HEALTHY } } }
I20260709 13:21:46.424523  6621 catalog_manager.cc:5697] T f3f9c2e2bf644115957398fe4c9459db P ccd8a4c3bfe3413cb2ae219b09aea832 reported cstate change: term changed from 18 to 21, leader changed from ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65) to b7ab4784c7344b939bc36f639286f377 (127.5.126.66). New cstate: current_term: 21 leader_uuid: "b7ab4784c7344b939bc36f639286f377" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } }
I20260709 13:21:46.426486  6621 catalog_manager.cc:5697] T 44bde925b2e541b69890d70715b85176 P ccd8a4c3bfe3413cb2ae219b09aea832 reported cstate change: term changed from 19 to 21, leader changed from ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65) to cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67). New cstate: current_term: 21 leader_uuid: "cd75a17ab2604397adab03bb8b5fd75c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } }
I20260709 13:21:46.428328  6621 catalog_manager.cc:5697] T 7c44c4849aa54f2b94d1f1bef9ed546f P ccd8a4c3bfe3413cb2ae219b09aea832 reported cstate change: term changed from 21 to 23. New cstate: current_term: 23 leader_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:46.442927  6790 tablet_service.cc:1558] Processing DeleteTablet for tablet 95a75bfe094d4bdc963aba3f08dfcd25 with delete_type TABLET_DATA_TOMBSTONED (Replica has no consensus available (current committed config index is 12)) from {username='slave'} at 127.0.0.1:41714
I20260709 13:21:46.422935 14236 raft_consensus.cc:515] T 3a485a995abc4807b6e511e45419f737 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:46.443200  6621 catalog_manager.cc:5697] T 3411566abe2d4c9bb4b2adfdd05e6f17 P ccd8a4c3bfe3413cb2ae219b09aea832 reported cstate change: term changed from 18 to 20. New cstate: current_term: 20 leader_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:46.444818  6614 catalog_manager.cc:5028] TS b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817): tablet 95a75bfe094d4bdc963aba3f08dfcd25 (table test-workload [id=04f4d366747e43549980077479ed75b9]) successfully deleted
W20260709 13:21:46.447515  6630 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:53224 (request call id 158) took 103179 ms (client timeout 15000 ms). Trace:
W20260709 13:21:46.447971  6630 rpcz_store.cc:269] 0709 13:20:03.268062 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:03.268270 (+   208us) service_pool.cc:224] Handling call
0709 13:21:46.447266 (+103178996us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":30190,"reported_tablets":55}
I20260709 13:21:46.449350  6621 catalog_manager.cc:5697] T 7c37d41cd9164c15a6826ca62a851a69 P ccd8a4c3bfe3413cb2ae219b09aea832 reported cstate change: term changed from 19 to 22, leader changed from b7ab4784c7344b939bc36f639286f377 (127.5.126.66) to ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65). New cstate: current_term: 22 leader_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } health_report { overall_health: HEALTHY } } }
I20260709 13:21:46.456167 14430 raft_consensus.cc:493] T 7887766dc6784fcaa42b35c05fea7a99 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:21:46.456954 14430 raft_consensus.cc:515] T 7887766dc6784fcaa42b35c05fea7a99 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:46.459132  6697 leader_election.cc:304] T 853ac0a8cbd64ce99457f170216d4d0f P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:21:46.460024  6803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7887766dc6784fcaa42b35c05fea7a99" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 24 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
W20260709 13:21:46.460727  6770 consensus_peers.cc:597] T ab432e62819d499eaaf3dd55481dd930 P b7ab4784c7344b939bc36f639286f377 -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:21:46.464246 14236 leader_election.cc:290] T 3a485a995abc4807b6e511e45419f737 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:21:46.465082  6804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a485a995abc4807b6e511e45419f737" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:21:46.466109 14434 raft_consensus.cc:2749] T 853ac0a8cbd64ce99457f170216d4d0f P ccd8a4c3bfe3413cb2ae219b09aea832 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:21:46.467898  6697 leader_election.cc:304] T f03d0dbf16864ca4bc1bb5e4c0334c0f P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:21:46.471240 14430 leader_election.cc:290] T 7887766dc6784fcaa42b35c05fea7a99 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:21:46.471886 14430 raft_consensus.cc:2749] T f03d0dbf16864ca4bc1bb5e4c0334c0f P ccd8a4c3bfe3413cb2ae219b09aea832 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:21:46.475569  6697 leader_election.cc:304] T 427c124d773f483294511e80fe340075 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:21:46.484567 14445 raft_consensus.cc:493] T 20f6842e26174571996b8dea4151d4be P ccd8a4c3bfe3413cb2ae219b09aea832 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:21:46.485289 14434 raft_consensus.cc:2749] T 427c124d773f483294511e80fe340075 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:21:46.486235 14430 raft_consensus.cc:493] T 3fa34c08b205435dba97346991aa1f92 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 27 FOLLOWER]: Starting pre-election (detected failure of leader 7ba59cc884714e8aa5f3f0ecaed84cbb)
I20260709 13:21:46.486811 14430 raft_consensus.cc:515] T 3fa34c08b205435dba97346991aa1f92 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 27 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:21:46.485280 14445 raft_consensus.cc:515] T 20f6842e26174571996b8dea4151d4be P ccd8a4c3bfe3413cb2ae219b09aea832 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:46.491156 14445 leader_election.cc:290] T 20f6842e26174571996b8dea4151d4be P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:21:46.495903  6804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20f6842e26174571996b8dea4151d4be" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:21:46.498437  6697 leader_election.cc:304] T 90d42e216d9741e190bca19a781291fd P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:21:46.451323  6621 catalog_manager.cc:5697] T 4275cf08e63345f993bce8664eada830 P ccd8a4c3bfe3413cb2ae219b09aea832 reported cstate change: term changed from 19 to 21. New cstate: current_term: 21 leader_uuid: "b7ab4784c7344b939bc36f639286f377" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } }
I20260709 13:21:46.499769 14445 raft_consensus.cc:2749] T 90d42e216d9741e190bca19a781291fd P ccd8a4c3bfe3413cb2ae219b09aea832 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:21:46.504799  6621 catalog_manager.cc:5697] T d8292e16e5654be6bc408560cf256aaa P ccd8a4c3bfe3413cb2ae219b09aea832 reported cstate change: term changed from 19 to 21. New cstate: current_term: 21 leader_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } health_report { overall_health: HEALTHY } } }
I20260709 13:21:46.498808 14430 leader_election.cc:290] T 3fa34c08b205435dba97346991aa1f92 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:21:46.508898  7502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "427c124d773f483294511e80fe340075" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:21:46.510022 14430 raft_consensus.cc:493] T 713b5728a197487c9300b310ab94e5a3 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader cd75a17ab2604397adab03bb8b5fd75c)
I20260709 13:21:46.511057 14430 raft_consensus.cc:515] T 713b5728a197487c9300b310ab94e5a3 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:46.513899  6799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "713b5728a197487c9300b310ab94e5a3" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:21:46.517346  7502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3f13b31a1f84f0d89d007eadd57924c" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:21:46.518126  6877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4275cf08e63345f993bce8664eada830" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:21:46.519843 14430 leader_election.cc:290] T 713b5728a197487c9300b310ab94e5a3 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:21:46.506655  6621 catalog_manager.cc:5697] T de3186201e1a40d0b335eeb8b4e256e0 P ccd8a4c3bfe3413cb2ae219b09aea832 reported cstate change: term changed from 16 to 22. New cstate: current_term: 22 leader_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } health_report { overall_health: HEALTHY } } }
I20260709 13:21:46.523388  6621 catalog_manager.cc:5697] T d33d5ee8ef6f415593d8df52063161ad P ccd8a4c3bfe3413cb2ae219b09aea832 reported cstate change: term changed from 12 to 20, leader changed from b7ab4784c7344b939bc36f639286f377 (127.5.126.66) to ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65). New cstate: current_term: 20 leader_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } health_report { overall_health: HEALTHY } } }
I20260709 13:21:46.525790  6621 catalog_manager.cc:5697] T 4d9def8b32fd443aa94ab1420b06837b P ccd8a4c3bfe3413cb2ae219b09aea832 reported cstate change: term changed from 15 to 23. New cstate: current_term: 23 leader_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:46.527827  6621 catalog_manager.cc:5697] T 2c240553ce044eedb41541d72b9475d7 P ccd8a4c3bfe3413cb2ae219b09aea832 reported cstate change: term changed from 17 to 21. New cstate: current_term: 21 leader_uuid: "b7ab4784c7344b939bc36f639286f377" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } }
I20260709 13:21:46.529559  6621 catalog_manager.cc:5697] T f4b8bd455d5a47c18a1380839c6e0d61 P ccd8a4c3bfe3413cb2ae219b09aea832 reported cstate change: term changed from 18 to 21, leader changed from b7ab4784c7344b939bc36f639286f377 (127.5.126.66) to ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65). New cstate: current_term: 21 leader_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } health_report { overall_health: HEALTHY } } }
I20260709 13:21:46.531606  6621 catalog_manager.cc:5697] T f5be3a11b23d4ea9b08300a2789821c7 P ccd8a4c3bfe3413cb2ae219b09aea832 reported cstate change: term changed from 18 to 20, leader changed from b7ab4784c7344b939bc36f639286f377 (127.5.126.66) to ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65). New cstate: current_term: 20 leader_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:46.541101  6877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a485a995abc4807b6e511e45419f737" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:21:46.545148  6877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7887766dc6784fcaa42b35c05fea7a99" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 24 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:21:46.548282  6872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20f6842e26174571996b8dea4151d4be" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:21:46.555223  6872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fa34c08b205435dba97346991aa1f92" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 28 candidate_status { last_received { term: 27 index: 19 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:21:46.586982 14430 raft_consensus.cc:493] T 8c7f33e544204fbaac4078e3e83bbf4e P ccd8a4c3bfe3413cb2ae219b09aea832 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:21:46.587006  7502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fa34c08b205435dba97346991aa1f92" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 28 candidate_status { last_received { term: 27 index: 19 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:21:46.587656 14430 raft_consensus.cc:515] T 8c7f33e544204fbaac4078e3e83bbf4e P ccd8a4c3bfe3413cb2ae219b09aea832 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:46.591988 14430 leader_election.cc:290] T 8c7f33e544204fbaac4078e3e83bbf4e P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:21:46.592670  6799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c7f33e544204fbaac4078e3e83bbf4e" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:21:46.594316  6697 leader_election.cc:304] T b3f13b31a1f84f0d89d007eadd57924c P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, b7ab4784c7344b939bc36f639286f377
I20260709 13:21:46.599373 14445 raft_consensus.cc:2749] T b3f13b31a1f84f0d89d007eadd57924c P ccd8a4c3bfe3413cb2ae219b09aea832 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:21:46.604480  6770 consensus_peers.cc:597] T b56bf91d90824c959e21e0cee5ba1816 P b7ab4784c7344b939bc36f639286f377 -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:21:46.614233  6872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "713b5728a197487c9300b310ab94e5a3" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:21:46.616648  6697 leader_election.cc:304] T 4275cf08e63345f993bce8664eada830 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:21:46.617522 14435 raft_consensus.cc:2749] T 4275cf08e63345f993bce8664eada830 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:21:46.618062  6874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c7f33e544204fbaac4078e3e83bbf4e" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
W20260709 13:21:46.626415  6844 consensus_peers.cc:597] T 713b5728a197487c9300b310ab94e5a3 P cd75a17ab2604397adab03bb8b5fd75c -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:21:46.626705  6697 leader_election.cc:304] T 3a485a995abc4807b6e511e45419f737 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:21:46.642812 14435 raft_consensus.cc:2749] T 3a485a995abc4807b6e511e45419f737 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:21:46.644361  6697 leader_election.cc:304] T 7887766dc6784fcaa42b35c05fea7a99 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:21:46.647980 14435 raft_consensus.cc:2749] T 7887766dc6784fcaa42b35c05fea7a99 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:21:46.650509  6697 leader_election.cc:304] T 20f6842e26174571996b8dea4151d4be P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:21:46.653093 14435 raft_consensus.cc:2749] T 20f6842e26174571996b8dea4151d4be P ccd8a4c3bfe3413cb2ae219b09aea832 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:21:46.654760 14434 raft_consensus.cc:493] T 95a75bfe094d4bdc963aba3f08dfcd25 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader cd75a17ab2604397adab03bb8b5fd75c)
I20260709 13:21:46.655423 14434 raft_consensus.cc:515] T 95a75bfe094d4bdc963aba3f08dfcd25 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } attrs { replace: true } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:21:46.658628 14434 leader_election.cc:290] T 95a75bfe094d4bdc963aba3f08dfcd25 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:21:46.660686  6799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a75bfe094d4bdc963aba3f08dfcd25" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:21:46.664893 14434 raft_consensus.cc:493] T f3f9c2e2bf644115957398fe4c9459db P ccd8a4c3bfe3413cb2ae219b09aea832 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:21:46.665462 14434 raft_consensus.cc:515] T f3f9c2e2bf644115957398fe4c9459db P ccd8a4c3bfe3413cb2ae219b09aea832 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:46.667681 14434 leader_election.cc:290] T f3f9c2e2bf644115957398fe4c9459db P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:21:46.655385  6697 leader_election.cc:304] T 3fa34c08b205435dba97346991aa1f92 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:21:46.669363  6799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f9c2e2bf644115957398fe4c9459db" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:21:46.669739 14434 raft_consensus.cc:2749] T 3fa34c08b205435dba97346991aa1f92 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 27 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
I20260709 13:21:46.671080  6697 leader_election.cc:304] T 713b5728a197487c9300b310ab94e5a3 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:21:46.675854 14434 raft_consensus.cc:2749] T 713b5728a197487c9300b310ab94e5a3 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:21:46.684304  6697 leader_election.cc:304] T 8c7f33e544204fbaac4078e3e83bbf4e P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:21:46.664685  6629 catalog_manager.cc:5697] T 34f36d59d88f40fe8a2805e604fc6c0a P b7ab4784c7344b939bc36f639286f377 reported cstate change: term changed from 16 to 20. New cstate: current_term: 20 leader_uuid: "b7ab4784c7344b939bc36f639286f377" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:46.686619  6629 catalog_manager.cc:5697] T 90d42e216d9741e190bca19a781291fd P b7ab4784c7344b939bc36f639286f377 reported cstate change: term changed from 18 to 20. New cstate: current_term: 20 leader_uuid: "b7ab4784c7344b939bc36f639286f377" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:46.687726 14434 raft_consensus.cc:2749] T 8c7f33e544204fbaac4078e3e83bbf4e P ccd8a4c3bfe3413cb2ae219b09aea832 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:21:46.694706  6621 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:53214 (request call id 182) took 11517 ms (client timeout 15000 ms). Trace:
I20260709 13:21:46.696107  6877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a75bfe094d4bdc963aba3f08dfcd25" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:21:46.697562  7502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a75bfe094d4bdc963aba3f08dfcd25" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:21:46.709488  6877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f9c2e2bf644115957398fe4c9459db" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:21:46.719846 14434 raft_consensus.cc:493] T ab432e62819d499eaaf3dd55481dd930 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:21:46.720736 14434 raft_consensus.cc:515] T ab432e62819d499eaaf3dd55481dd930 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:46.723975  6799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab432e62819d499eaaf3dd55481dd930" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 26 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:21:46.726240 14434 leader_election.cc:290] T ab432e62819d499eaaf3dd55481dd930 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:21:46.728356 14435 raft_consensus.cc:493] T a1704639a875409b9959353527b3fd68 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:21:46.729000 14435 raft_consensus.cc:515] T a1704639a875409b9959353527b3fd68 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:46.731640 14435 leader_election.cc:290] T a1704639a875409b9959353527b3fd68 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:21:46.733011  6874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab432e62819d499eaaf3dd55481dd930" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 26 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:21:46.734413  6799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1704639a875409b9959353527b3fd68" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:21:46.737823  6697 leader_election.cc:304] T 95a75bfe094d4bdc963aba3f08dfcd25 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, b7ab4784c7344b939bc36f639286f377
I20260709 13:21:46.706732  6629 catalog_manager.cc:5697] T f5be3a11b23d4ea9b08300a2789821c7 P b7ab4784c7344b939bc36f639286f377 reported cstate change: term changed from 20 to 21, leader changed from ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65) to b7ab4784c7344b939bc36f639286f377 (127.5.126.66). New cstate: current_term: 21 leader_uuid: "b7ab4784c7344b939bc36f639286f377" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:46.745680 14435 raft_consensus.cc:2749] T 95a75bfe094d4bdc963aba3f08dfcd25 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:21:46.716308  6621 rpcz_store.cc:269] 0709 13:21:35.177413 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:21:41.563720 (+6386307us) service_pool.cc:224] Handling call
0709 13:21:46.694635 (+5130915us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:21:46.540478 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:21:46.541035 (+   557us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:21:46.541075 (+    40us) write_op.cc:435] Acquired schema lock
0709 13:21:46.541093 (+    18us) tablet.cc:662] Decoding operations
0709 13:21:46.542331 (+  1238us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:21:46.542394 (+    63us) write_op.cc:641] Partition lock acquired for write op
0709 13:21:46.542421 (+    27us) tablet.cc:685] Acquiring locks for 14 operations
0709 13:21:46.543511 (+  1090us) tablet.cc:701] Row locks acquired
0709 13:21:46.543532 (+    21us) write_op.cc:260] PREPARE: finished
0709 13:21:46.543739 (+   207us) write_op.cc:270] Start()
0709 13:21:46.543864 (+   125us) write_op.cc:276] Timestamp: P: 1783603306543689 usec, L: 0
0709 13:21:46.543885 (+    21us) op_driver.cc:348] REPLICATION: starting
0709 13:21:46.544601 (+   716us) log.cc:844] Serialized 5544 byte log entry
0709 13:21:46.547222 (+  2621us) op_driver.cc:464] REPLICATION: finished
0709 13:21:46.547731 (+   509us) write_op.cc:301] APPLY: starting
0709 13:21:46.547816 (+    85us) tablet.cc:1367] starting BulkCheckPresence
0709 13:21:46.558765 (+ 10949us) tablet.cc:1370] finished BulkCheckPresence
0709 13:21:46.558885 (+   120us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:21:46.581262 (+ 22377us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:21:46.581579 (+   317us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=28,key_file_lookups=28,delta_file_lookups=28,mrs_lookups=0
0709 13:21:46.581623 (+    44us) write_op.cc:312] APPLY: finished
0709 13:21:46.581995 (+   372us) log.cc:844] Serialized 129 byte log entry
0709 13:21:46.582882 (+   887us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:21:46.583057 (+   175us) write_op.cc:454] Released schema lock
0709 13:21:46.583114 (+    57us) write_op.cc:341] FINISH: Updating metrics
0709 13:21:46.601500 (+ 18386us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:21:46.601535 (+    35us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":9189,"reported_tablets":55,"child_traces":[["op",{"apply.queue_time_us":296,"apply.run_cpu_time_us":19054,"apply.run_wall_time_us":53680,"cfile_cache_hit":56,"cfile_cache_hit_bytes":58464,"num_ops":14,"prepare.queue_time_us":154,"prepare.run_cpu_time_us":4451,"prepare.run_wall_time_us":19730,"replication_time_us":3209}]]}
I20260709 13:21:46.751269  6697 leader_election.cc:304] T f3f9c2e2bf644115957398fe4c9459db P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:21:46.752803 14435 raft_consensus.cc:2749] T f3f9c2e2bf644115957398fe4c9459db P ccd8a4c3bfe3413cb2ae219b09aea832 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:21:46.755729  6697 leader_election.cc:304] T ab432e62819d499eaaf3dd55481dd930 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:21:46.774266 14434 raft_consensus.cc:2749] T ab432e62819d499eaaf3dd55481dd930 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:21:46.779304  6874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1704639a875409b9959353527b3fd68" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:21:46.785198 14434 raft_consensus.cc:493] T f09c2a98de1a4decabd0ff900dd44caa P ccd8a4c3bfe3413cb2ae219b09aea832 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:21:46.785928 14434 raft_consensus.cc:515] T f09c2a98de1a4decabd0ff900dd44caa P ccd8a4c3bfe3413cb2ae219b09aea832 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:46.788328 14434 leader_election.cc:290] T f09c2a98de1a4decabd0ff900dd44caa P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:21:46.790922  6799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09c2a98de1a4decabd0ff900dd44caa" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:21:46.791318 14435 raft_consensus.cc:493] T 9b3759de40694069b13c0f8bd40e5709 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:21:46.792065 14435 raft_consensus.cc:515] T 9b3759de40694069b13c0f8bd40e5709 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:46.794217 14435 leader_election.cc:290] T 9b3759de40694069b13c0f8bd40e5709 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:21:46.795677  6804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b3759de40694069b13c0f8bd40e5709" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:21:46.800293  6874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09c2a98de1a4decabd0ff900dd44caa" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:21:46.810997  6874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b3759de40694069b13c0f8bd40e5709" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:21:46.818738  6697 leader_election.cc:304] T a1704639a875409b9959353527b3fd68 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:21:46.819757 14435 raft_consensus.cc:2749] T a1704639a875409b9959353527b3fd68 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:21:46.821188  6697 leader_election.cc:304] T f09c2a98de1a4decabd0ff900dd44caa P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:21:46.822332 14435 raft_consensus.cc:2749] T f09c2a98de1a4decabd0ff900dd44caa P ccd8a4c3bfe3413cb2ae219b09aea832 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:21:46.823813  6697 leader_election.cc:304] T 9b3759de40694069b13c0f8bd40e5709 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:21:46.825146 14435 raft_consensus.cc:2749] T 9b3759de40694069b13c0f8bd40e5709 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:21:46.840078  5625 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:21:46.843016  5625 tablet_replica.cc:333] T 427c124d773f483294511e80fe340075 P ccd8a4c3bfe3413cb2ae219b09aea832: stopping tablet replica
I20260709 13:21:46.844084  5625 raft_consensus.cc:2243] T 427c124d773f483294511e80fe340075 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:46.851958  5625 raft_consensus.cc:2272] T 427c124d773f483294511e80fe340075 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:46.855731  5625 tablet_replica.cc:333] T 4275cf08e63345f993bce8664eada830 P ccd8a4c3bfe3413cb2ae219b09aea832: stopping tablet replica
I20260709 13:21:46.857931  5625 raft_consensus.cc:2243] T 4275cf08e63345f993bce8664eada830 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:46.861493  5625 raft_consensus.cc:2272] T 4275cf08e63345f993bce8664eada830 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:46.866200  5625 tablet_replica.cc:333] T 22ccee1b570c4ad3a57bd7aec085b1b4 P ccd8a4c3bfe3413cb2ae219b09aea832: stopping tablet replica
I20260709 13:21:46.867322  5625 raft_consensus.cc:2243] T 22ccee1b570c4ad3a57bd7aec085b1b4 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:46.878873 14435 raft_consensus.cc:493] T 44bde925b2e541b69890d70715b85176 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader cd75a17ab2604397adab03bb8b5fd75c)
I20260709 13:21:46.879573 14435 raft_consensus.cc:515] T 44bde925b2e541b69890d70715b85176 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:46.882979 14435 leader_election.cc:290] T 44bde925b2e541b69890d70715b85176 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:21:46.883282  6804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44bde925b2e541b69890d70715b85176" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:21:46.883769  6874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44bde925b2e541b69890d70715b85176" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:21:46.885515  6790 tablet_service.cc:1558] Processing DeleteTablet for tablet 95a75bfe094d4bdc963aba3f08dfcd25 with delete_type TABLET_DATA_TOMBSTONED (Replica with old config index 9 (current committed config index is 12)) from {username='slave'} at 127.0.0.1:41714
I20260709 13:21:46.886831  6697 leader_election.cc:304] T 44bde925b2e541b69890d70715b85176 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:21:46.887447  6614 catalog_manager.cc:5028] TS b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817): tablet 95a75bfe094d4bdc963aba3f08dfcd25 (table test-workload [id=04f4d366747e43549980077479ed75b9]) successfully deleted
I20260709 13:21:46.888367 14434 raft_consensus.cc:2749] T 44bde925b2e541b69890d70715b85176 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 13:21:46.899688  6629 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:53224 (request call id 162) took 11592 ms (client timeout 15000 ms). Trace:
I20260709 13:21:46.918093  5625 raft_consensus.cc:2272] T 22ccee1b570c4ad3a57bd7aec085b1b4 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:46.921473  5625 tablet_replica.cc:333] T b56bf91d90824c959e21e0cee5ba1816 P ccd8a4c3bfe3413cb2ae219b09aea832: stopping tablet replica
W20260709 13:21:46.923908  6614 catalog_manager.cc:4755] TS ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet ce4f062dcd314d43a63ca74067cb5ee3: Remote error: Service unavailable: service kudu.tserver.TabletServerAdminService not registered on TabletServer
W20260709 13:21:46.900287  6629 rpcz_store.cc:269] 0709 13:21:35.307187 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:21:44.028432 (+8721245us) service_pool.cc:224] Handling call
0709 13:21:46.801722 (+2773290us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:21:46.801754 (+    32us) write_op.cc:454] Released schema lock
0709 13:21:46.899575 (+ 97821us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:21:46.759963 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:21:46.760647 (+   684us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:21:46.760698 (+    51us) write_op.cc:435] Acquired schema lock
0709 13:21:46.760720 (+    22us) tablet.cc:662] Decoding operations
0709 13:21:46.761504 (+   784us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:21:46.761584 (+    80us) write_op.cc:641] Partition lock acquired for write op
0709 13:21:46.761620 (+    36us) tablet.cc:685] Acquiring locks for 3 operations
0709 13:21:46.761997 (+   377us) tablet.cc:701] Row locks acquired
0709 13:21:46.762016 (+    19us) write_op.cc:260] PREPARE: finished
0709 13:21:46.762199 (+   183us) write_op.cc:270] Start()
0709 13:21:46.762329 (+   130us) write_op.cc:276] Timestamp: P: 1783603306762139 usec, L: 0
0709 13:21:46.762355 (+    26us) op_driver.cc:348] REPLICATION: starting
0709 13:21:46.763211 (+   856us) log.cc:844] Serialized 1308 byte log entry
0709 13:21:46.765663 (+  2452us) op_driver.cc:464] REPLICATION: finished
0709 13:21:46.766209 (+   546us) write_op.cc:301] APPLY: starting
0709 13:21:46.766296 (+    87us) tablet.cc:1367] starting BulkCheckPresence
0709 13:21:46.768559 (+  2263us) tablet.cc:1370] finished BulkCheckPresence
0709 13:21:46.768678 (+   119us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:21:46.771747 (+  3069us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:21:46.772016 (+   269us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=6,key_file_lookups=6,delta_file_lookups=6,mrs_lookups=0
0709 13:21:46.772093 (+    77us) write_op.cc:312] APPLY: finished
0709 13:21:46.772353 (+   260us) log.cc:844] Serialized 41 byte log entry
0709 13:21:46.773320 (+   967us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:21:46.773451 (+   131us) write_op.cc:454] Released schema lock
0709 13:21:46.773505 (+    54us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"mutex_wait_us":884,"reported_tablets":55,"spinlock_wait_cycles":2944,"child_traces":[["op",{"apply.queue_time_us":331,"apply.run_cpu_time_us":6172,"apply.run_wall_time_us":7710,"cfile_cache_hit":12,"cfile_cache_hit_bytes":12528,"num_ops":3,"prepare.queue_time_us":149,"prepare.run_cpu_time_us":3629,"prepare.run_wall_time_us":11453,"replication_time_us":3148}]]}
I20260709 13:21:46.950599 14435 raft_consensus.cc:493] T 30e88460611e47b2ba16a46a30b5f416 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:21:46.951323 14435 raft_consensus.cc:515] T 30e88460611e47b2ba16a46a30b5f416 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:46.955174  6874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30e88460611e47b2ba16a46a30b5f416" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:21:46.957219  5625 raft_consensus.cc:2243] T b56bf91d90824c959e21e0cee5ba1816 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:46.958137  5625 raft_consensus.cc:2272] T b56bf91d90824c959e21e0cee5ba1816 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:46.959177  6803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30e88460611e47b2ba16a46a30b5f416" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:21:46.961427  5625 tablet_replica.cc:333] T ab432e62819d499eaaf3dd55481dd930 P ccd8a4c3bfe3413cb2ae219b09aea832: stopping tablet replica
I20260709 13:21:46.962438  5625 raft_consensus.cc:2243] T ab432e62819d499eaaf3dd55481dd930 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 25 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:46.962335  6697 leader_election.cc:304] T 30e88460611e47b2ba16a46a30b5f416 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:21:46.963784 14236 raft_consensus.cc:2749] T 30e88460611e47b2ba16a46a30b5f416 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:21:46.976356 14236 raft_consensus.cc:493] T f5be3a11b23d4ea9b08300a2789821c7 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:21:46.977000 14236 raft_consensus.cc:515] T f5be3a11b23d4ea9b08300a2789821c7 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:46.979146 14435 leader_election.cc:290] T 30e88460611e47b2ba16a46a30b5f416 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:21:46.980118  6803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5be3a11b23d4ea9b08300a2789821c7" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:21:46.984083 14236 leader_election.cc:290] T f5be3a11b23d4ea9b08300a2789821c7 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:21:46.988209  6874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5be3a11b23d4ea9b08300a2789821c7" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:21:46.989737  6697 leader_election.cc:304] T f5be3a11b23d4ea9b08300a2789821c7 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:21:46.991084 14236 raft_consensus.cc:2749] T f5be3a11b23d4ea9b08300a2789821c7 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:21:46.993901  5625 raft_consensus.cc:2272] T ab432e62819d499eaaf3dd55481dd930 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:47.018764  5625 tablet_replica.cc:333] T 2c240553ce044eedb41541d72b9475d7 P ccd8a4c3bfe3413cb2ae219b09aea832: stopping tablet replica
I20260709 13:21:47.019702  5625 raft_consensus.cc:2243] T 2c240553ce044eedb41541d72b9475d7 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:47.020470  5625 raft_consensus.cc:2272] T 2c240553ce044eedb41541d72b9475d7 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:47.020985 14430 raft_consensus.cc:493] T 17587d6730594da4a56fa13a353232a1 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 26 FOLLOWER]: Starting pre-election (detected failure of leader 7ba59cc884714e8aa5f3f0ecaed84cbb)
I20260709 13:21:47.021696 14430 raft_consensus.cc:515] T 17587d6730594da4a56fa13a353232a1 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:21:47.023730  5625 tablet_replica.cc:333] T 17587d6730594da4a56fa13a353232a1 P ccd8a4c3bfe3413cb2ae219b09aea832: stopping tablet replica
I20260709 13:21:47.025223  6803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17587d6730594da4a56fa13a353232a1" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 27 candidate_status { last_received { term: 26 index: 18 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:21:47.028363 14430 leader_election.cc:290] T 17587d6730594da4a56fa13a353232a1 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:21:47.056926  5625 raft_consensus.cc:2243] T 17587d6730594da4a56fa13a353232a1 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 26 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:47.029894  7502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17587d6730594da4a56fa13a353232a1" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 27 candidate_status { last_received { term: 26 index: 18 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:21:47.059242  6697 leader_election.cc:304] T 17587d6730594da4a56fa13a353232a1 P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, b7ab4784c7344b939bc36f639286f377
I20260709 13:21:47.061720  5625 raft_consensus.cc:2272] T 17587d6730594da4a56fa13a353232a1 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 26 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:47.062444 14430 raft_consensus.cc:2706] T 17587d6730594da4a56fa13a353232a1 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 26 FOLLOWER]: Received pre-election callback for term 27 while not running: Illegal state: RaftConsensus is not running: State = Stopped
I20260709 13:21:47.082046  5625 tablet_replica.cc:333] T 3411566abe2d4c9bb4b2adfdd05e6f17 P ccd8a4c3bfe3413cb2ae219b09aea832: stopping tablet replica
I20260709 13:21:47.083315  5625 raft_consensus.cc:2243] T 3411566abe2d4c9bb4b2adfdd05e6f17 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 20 LEADER]: Raft consensus shutting down.
I20260709 13:21:47.090524  5625 raft_consensus.cc:2272] T 3411566abe2d4c9bb4b2adfdd05e6f17 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:47.097774  6622 catalog_manager.cc:5697] T f3f9c2e2bf644115957398fe4c9459db P cd75a17ab2604397adab03bb8b5fd75c reported cstate change: term changed from 21 to 23. New cstate: current_term: 23 leader_uuid: "b7ab4784c7344b939bc36f639286f377" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } }
I20260709 13:21:47.100188  6622 catalog_manager.cc:5697] T 4d9def8b32fd443aa94ab1420b06837b P cd75a17ab2604397adab03bb8b5fd75c reported cstate change: term changed from 23 to 24, leader changed from ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65) to b7ab4784c7344b939bc36f639286f377 (127.5.126.66). New cstate: current_term: 24 leader_uuid: "b7ab4784c7344b939bc36f639286f377" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } }
I20260709 13:21:47.102818  6622 catalog_manager.cc:5697] T 1bf4668eeb70467fb3dc5a0289233b3c P cd75a17ab2604397adab03bb8b5fd75c reported cstate change: term changed from 16 to 23, leader changed from ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65) to cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67). New cstate: current_term: 23 leader_uuid: "cd75a17ab2604397adab03bb8b5fd75c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } health_report { overall_health: HEALTHY } } }
I20260709 13:21:47.104707 14236 raft_consensus.cc:493] T e31b9971c15848dea59d4d4130141d9e P ccd8a4c3bfe3413cb2ae219b09aea832 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader cd75a17ab2604397adab03bb8b5fd75c)
I20260709 13:21:47.105257 14236 raft_consensus.cc:515] T e31b9971c15848dea59d4d4130141d9e P ccd8a4c3bfe3413cb2ae219b09aea832 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:47.107179 14236 leader_election.cc:290] T e31b9971c15848dea59d4d4130141d9e P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:21:47.108479  6803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e31b9971c15848dea59d4d4130141d9e" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:21:47.109256  6877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e31b9971c15848dea59d4d4130141d9e" candidate_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:21:47.111702  6697 leader_election.cc:304] T e31b9971c15848dea59d4d4130141d9e P ccd8a4c3bfe3413cb2ae219b09aea832 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccd8a4c3bfe3413cb2ae219b09aea832; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:21:47.115091 14236 raft_consensus.cc:2749] T e31b9971c15848dea59d4d4130141d9e P ccd8a4c3bfe3413cb2ae219b09aea832 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:21:47.116464  5625 tablet_replica.cc:333] T 713b5728a197487c9300b310ab94e5a3 P ccd8a4c3bfe3413cb2ae219b09aea832: stopping tablet replica
I20260709 13:21:47.119117  6622 catalog_manager.cc:5697] T 9b3759de40694069b13c0f8bd40e5709 P cd75a17ab2604397adab03bb8b5fd75c reported cstate change: term changed from 18 to 20, leader changed from cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67) to b7ab4784c7344b939bc36f639286f377 (127.5.126.66). New cstate: current_term: 20 leader_uuid: "b7ab4784c7344b939bc36f639286f377" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } }
I20260709 13:21:47.121311  6622 catalog_manager.cc:5697] T 34f36d59d88f40fe8a2805e604fc6c0a P cd75a17ab2604397adab03bb8b5fd75c reported cstate change: term changed from 20 to 21, leader changed from b7ab4784c7344b939bc36f639286f377 (127.5.126.66) to cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67). New cstate: current_term: 21 leader_uuid: "cd75a17ab2604397adab03bb8b5fd75c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } health_report { overall_health: HEALTHY } } }
W20260709 13:21:47.133634  6624 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:53234 (request call id 174) took 54135 ms (client timeout 15000 ms). Trace:
W20260709 13:21:47.134194  6624 rpcz_store.cc:269] 0709 13:20:52.998197 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:53.480887 (+482690us) service_pool.cc:224] Handling call
0709 13:20:54.181890 (+701003us) spinlock_profiling.cc:243] Waited 49.2 ms on lock 0x7b5400280190. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0c745db1 00007fcc0c885b71 00007fcc0c8860b2 00007fcc157ffa89 00007fcc15797da6 00007fcc15769088 00007fcc1586737e 00007fcc13d282a4 00007fcc13d28232 00007fcc13d28161 00007fcc13d280dc
0709 13:21:47.133380 (+52951490us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":35249,"reported_tablets":55,"spinlock_wait_cycles":113218944}
I20260709 13:21:47.123481  6622 catalog_manager.cc:5697] T f09c2a98de1a4decabd0ff900dd44caa P cd75a17ab2604397adab03bb8b5fd75c reported cstate change: term changed from 18 to 24, leader changed from ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65) to b7ab4784c7344b939bc36f639286f377 (127.5.126.66). New cstate: current_term: 24 leader_uuid: "b7ab4784c7344b939bc36f639286f377" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } }
I20260709 13:21:47.137013  6622 catalog_manager.cc:5697] T e31b9971c15848dea59d4d4130141d9e P cd75a17ab2604397adab03bb8b5fd75c reported cstate change: term changed from 17 to 18, leader changed from b7ab4784c7344b939bc36f639286f377 (127.5.126.66) to cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67). New cstate: current_term: 18 leader_uuid: "cd75a17ab2604397adab03bb8b5fd75c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } health_report { overall_health: HEALTHY } } }
I20260709 13:21:47.147280  5625 raft_consensus.cc:2243] T 713b5728a197487c9300b310ab94e5a3 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:47.148125  5625 raft_consensus.cc:2272] T 713b5728a197487c9300b310ab94e5a3 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:47.146186  6622 catalog_manager.cc:5697] T 90d42e216d9741e190bca19a781291fd P cd75a17ab2604397adab03bb8b5fd75c reported cstate change: term changed from 20 to 23, leader changed from b7ab4784c7344b939bc36f639286f377 (127.5.126.66) to cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67). New cstate: current_term: 23 leader_uuid: "cd75a17ab2604397adab03bb8b5fd75c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } health_report { overall_health: HEALTHY } } }
I20260709 13:21:47.154754  6622 catalog_manager.cc:5697] T 22ccee1b570c4ad3a57bd7aec085b1b4 P cd75a17ab2604397adab03bb8b5fd75c reported cstate change: term changed from 15 to 17, leader changed from cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67) to b7ab4784c7344b939bc36f639286f377 (127.5.126.66). New cstate: current_term: 17 leader_uuid: "b7ab4784c7344b939bc36f639286f377" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } }
I20260709 13:21:47.168890  6622 catalog_manager.cc:5697] T ab432e62819d499eaaf3dd55481dd930 P cd75a17ab2604397adab03bb8b5fd75c reported cstate change: term changed from 23 to 25. New cstate: current_term: 25 leader_uuid: "b7ab4784c7344b939bc36f639286f377" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } }
I20260709 13:21:47.171360  6622 catalog_manager.cc:5697] T f58dc08b12a2494bb9a1372837970ca2 P cd75a17ab2604397adab03bb8b5fd75c reported cstate change: term changed from 20 to 21, leader changed from b7ab4784c7344b939bc36f639286f377 (127.5.126.66) to cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67). New cstate: current_term: 21 leader_uuid: "cd75a17ab2604397adab03bb8b5fd75c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } health_report { overall_health: HEALTHY } } }
I20260709 13:21:47.173384  6622 catalog_manager.cc:5697] T c4db81d9d329422bb3b4160ca4ac2d1d P cd75a17ab2604397adab03bb8b5fd75c reported cstate change: term changed from 20 to 21, leader changed from b7ab4784c7344b939bc36f639286f377 (127.5.126.66) to cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67). New cstate: current_term: 21 leader_uuid: "cd75a17ab2604397adab03bb8b5fd75c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } health_report { overall_health: HEALTHY } } }
I20260709 13:21:47.177824  5625 tablet_replica.cc:333] T de3186201e1a40d0b335eeb8b4e256e0 P ccd8a4c3bfe3413cb2ae219b09aea832: stopping tablet replica
I20260709 13:21:47.178845  5625 raft_consensus.cc:2243] T de3186201e1a40d0b335eeb8b4e256e0 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 22 LEADER]: Raft consensus shutting down.
I20260709 13:21:47.180063  5625 raft_consensus.cc:2272] T de3186201e1a40d0b335eeb8b4e256e0 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:47.175149  6622 catalog_manager.cc:5697] T bd6869f07b5a4885a0b99fbe60c3b175 P cd75a17ab2604397adab03bb8b5fd75c reported cstate change: term changed from 22 to 26, leader changed from b7ab4784c7344b939bc36f639286f377 (127.5.126.66) to ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65). New cstate: current_term: 26 leader_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } }
I20260709 13:21:47.210392  5625 tablet_replica.cc:333] T d8292e16e5654be6bc408560cf256aaa P ccd8a4c3bfe3413cb2ae219b09aea832: stopping tablet replica
I20260709 13:21:47.211355  5625 raft_consensus.cc:2243] T d8292e16e5654be6bc408560cf256aaa P ccd8a4c3bfe3413cb2ae219b09aea832 [term 21 LEADER]: Raft consensus shutting down.
I20260709 13:21:47.213289  5625 raft_consensus.cc:2272] T d8292e16e5654be6bc408560cf256aaa P ccd8a4c3bfe3413cb2ae219b09aea832 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:47.216130  5625 tablet_replica.cc:333] T f5be3a11b23d4ea9b08300a2789821c7 P ccd8a4c3bfe3413cb2ae219b09aea832: stopping tablet replica
I20260709 13:21:47.217016  5625 raft_consensus.cc:2243] T f5be3a11b23d4ea9b08300a2789821c7 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:47.217700  5625 raft_consensus.cc:2272] T f5be3a11b23d4ea9b08300a2789821c7 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:47.220952  5625 tablet_replica.cc:333] T a1704639a875409b9959353527b3fd68 P ccd8a4c3bfe3413cb2ae219b09aea832: stopping tablet replica
I20260709 13:21:47.221865  5625 raft_consensus.cc:2243] T a1704639a875409b9959353527b3fd68 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:47.237072  5625 raft_consensus.cc:2272] T a1704639a875409b9959353527b3fd68 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:47.240705  5625 tablet_replica.cc:333] T 24ee15416e3145beaa1b8183453729a3 P ccd8a4c3bfe3413cb2ae219b09aea832: stopping tablet replica
I20260709 13:21:47.242734  5625 raft_consensus.cc:2243] T 24ee15416e3145beaa1b8183453729a3 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:47.243913  5625 raft_consensus.cc:2272] T 24ee15416e3145beaa1b8183453729a3 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:47.247192  5625 tablet_replica.cc:333] T fe20b4b48823486ca3b9c648db6ce8aa P ccd8a4c3bfe3413cb2ae219b09aea832: stopping tablet replica
I20260709 13:21:47.248008  5625 raft_consensus.cc:2243] T fe20b4b48823486ca3b9c648db6ce8aa P ccd8a4c3bfe3413cb2ae219b09aea832 [term 16 LEADER]: Raft consensus shutting down.
I20260709 13:21:47.249264  5625 raft_consensus.cc:2272] T fe20b4b48823486ca3b9c648db6ce8aa P ccd8a4c3bfe3413cb2ae219b09aea832 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:47.251926  5625 tablet_replica.cc:333] T c4db81d9d329422bb3b4160ca4ac2d1d P ccd8a4c3bfe3413cb2ae219b09aea832: stopping tablet replica
I20260709 13:21:47.252694  5625 raft_consensus.cc:2243] T c4db81d9d329422bb3b4160ca4ac2d1d P ccd8a4c3bfe3413cb2ae219b09aea832 [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:47.253454  5625 raft_consensus.cc:2272] T c4db81d9d329422bb3b4160ca4ac2d1d P ccd8a4c3bfe3413cb2ae219b09aea832 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:47.256466  5625 tablet_replica.cc:333] T bd6869f07b5a4885a0b99fbe60c3b175 P ccd8a4c3bfe3413cb2ae219b09aea832: stopping tablet replica
I20260709 13:21:47.257311  5625 raft_consensus.cc:2243] T bd6869f07b5a4885a0b99fbe60c3b175 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 26 LEADER]: Raft consensus shutting down.
I20260709 13:21:47.258359  5625 raft_consensus.cc:2272] T bd6869f07b5a4885a0b99fbe60c3b175 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 26 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:47.261123  5625 tablet_replica.cc:333] T 9b3759de40694069b13c0f8bd40e5709 P ccd8a4c3bfe3413cb2ae219b09aea832: stopping tablet replica
I20260709 13:21:47.261924  5625 raft_consensus.cc:2243] T 9b3759de40694069b13c0f8bd40e5709 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:47.262580  5625 raft_consensus.cc:2272] T 9b3759de40694069b13c0f8bd40e5709 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:47.265269  5625 tablet_replica.cc:333] T 7a734b5ab7834e05a8c422208acc58b1 P ccd8a4c3bfe3413cb2ae219b09aea832: stopping tablet replica
I20260709 13:21:47.266139  5625 raft_consensus.cc:2243] T 7a734b5ab7834e05a8c422208acc58b1 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:47.267098  5625 raft_consensus.cc:2272] T 7a734b5ab7834e05a8c422208acc58b1 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:47.269706  5625 tablet_replica.cc:333] T 34f36d59d88f40fe8a2805e604fc6c0a P ccd8a4c3bfe3413cb2ae219b09aea832: stopping tablet replica
I20260709 13:21:47.270493  5625 raft_consensus.cc:2243] T 34f36d59d88f40fe8a2805e604fc6c0a P ccd8a4c3bfe3413cb2ae219b09aea832 [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:47.271199  5625 raft_consensus.cc:2272] T 34f36d59d88f40fe8a2805e604fc6c0a P ccd8a4c3bfe3413cb2ae219b09aea832 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:47.273741  5625 tablet_replica.cc:333] T d33d5ee8ef6f415593d8df52063161ad P ccd8a4c3bfe3413cb2ae219b09aea832: stopping tablet replica
I20260709 13:21:47.309150  5625 raft_consensus.cc:2243] T d33d5ee8ef6f415593d8df52063161ad P ccd8a4c3bfe3413cb2ae219b09aea832 [term 20 LEADER]: Raft consensus shutting down.
I20260709 13:21:47.310591  5625 raft_consensus.cc:2272] T d33d5ee8ef6f415593d8df52063161ad P ccd8a4c3bfe3413cb2ae219b09aea832 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:47.313853  5625 tablet_replica.cc:333] T 7c37d41cd9164c15a6826ca62a851a69 P ccd8a4c3bfe3413cb2ae219b09aea832: stopping tablet replica
I20260709 13:21:47.314726  5625 raft_consensus.cc:2243] T 7c37d41cd9164c15a6826ca62a851a69 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 22 LEADER]: Raft consensus shutting down.
I20260709 13:21:47.315928  5625 raft_consensus.cc:2272] T 7c37d41cd9164c15a6826ca62a851a69 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:47.319145  5625 tablet_replica.cc:333] T 9e326172347f45e99a0d482b5d8ef768 P ccd8a4c3bfe3413cb2ae219b09aea832: stopping tablet replica
I20260709 13:21:47.319993  5625 raft_consensus.cc:2243] T 9e326172347f45e99a0d482b5d8ef768 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:47.330989  5625 raft_consensus.cc:2272] T 9e326172347f45e99a0d482b5d8ef768 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:47.334470  5625 tablet_replica.cc:333] T 1bf4668eeb70467fb3dc5a0289233b3c P ccd8a4c3bfe3413cb2ae219b09aea832: stopping tablet replica
I20260709 13:21:47.335335  5625 raft_consensus.cc:2243] T 1bf4668eeb70467fb3dc5a0289233b3c P ccd8a4c3bfe3413cb2ae219b09aea832 [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:47.336027  5625 raft_consensus.cc:2272] T 1bf4668eeb70467fb3dc5a0289233b3c P ccd8a4c3bfe3413cb2ae219b09aea832 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:47.343339  5625 tablet_replica.cc:333] T 95a75bfe094d4bdc963aba3f08dfcd25 P ccd8a4c3bfe3413cb2ae219b09aea832: stopping tablet replica
I20260709 13:21:47.344175  5625 raft_consensus.cc:2243] T 95a75bfe094d4bdc963aba3f08dfcd25 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:47.344966  5625 raft_consensus.cc:2272] T 95a75bfe094d4bdc963aba3f08dfcd25 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:47.347507  5625 tablet_replica.cc:333] T 8c7f33e544204fbaac4078e3e83bbf4e P ccd8a4c3bfe3413cb2ae219b09aea832: stopping tablet replica
I20260709 13:21:47.348367  5625 raft_consensus.cc:2243] T 8c7f33e544204fbaac4078e3e83bbf4e P ccd8a4c3bfe3413cb2ae219b09aea832 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:47.349035  5625 raft_consensus.cc:2272] T 8c7f33e544204fbaac4078e3e83bbf4e P ccd8a4c3bfe3413cb2ae219b09aea832 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:47.350867  6622 catalog_manager.cc:5244] ChangeConfig:REMOVE_PEER RPC for tablet 95a75bfe094d4bdc963aba3f08dfcd25 with cas_config_opid_index 9: aborting the task: latest config opid_index 12; task opid_index 9
I20260709 13:21:47.351969  5625 tablet_replica.cc:333] T f03d0dbf16864ca4bc1bb5e4c0334c0f P ccd8a4c3bfe3413cb2ae219b09aea832: stopping tablet replica
I20260709 13:21:47.353947  5625 raft_consensus.cc:2243] T f03d0dbf16864ca4bc1bb5e4c0334c0f P ccd8a4c3bfe3413cb2ae219b09aea832 [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:47.363200  5625 raft_consensus.cc:2272] T f03d0dbf16864ca4bc1bb5e4c0334c0f P ccd8a4c3bfe3413cb2ae219b09aea832 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:47.366257  5625 tablet_replica.cc:333] T bb3d8792045a4583ae2e965b1350a5b4 P ccd8a4c3bfe3413cb2ae219b09aea832: stopping tablet replica
I20260709 13:21:47.367098  5625 raft_consensus.cc:2243] T bb3d8792045a4583ae2e965b1350a5b4 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 19 LEADER]: Raft consensus shutting down.
I20260709 13:21:47.368299  5625 raft_consensus.cc:2272] T bb3d8792045a4583ae2e965b1350a5b4 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:47.371225  5625 tablet_replica.cc:333] T 3d65025eea89441290d85dd053810e31 P ccd8a4c3bfe3413cb2ae219b09aea832: stopping tablet replica
I20260709 13:21:47.372100  5625 raft_consensus.cc:2243] T 3d65025eea89441290d85dd053810e31 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:47.372915  5625 raft_consensus.cc:2272] T 3d65025eea89441290d85dd053810e31 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:47.373363  6622 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:53234 (request call id 177) took 3644 ms. Trace:
I20260709 13:21:47.375984  5625 tablet_replica.cc:333] T 44bde925b2e541b69890d70715b85176 P ccd8a4c3bfe3413cb2ae219b09aea832: stopping tablet replica
I20260709 13:21:47.376832  5625 raft_consensus.cc:2243] T 44bde925b2e541b69890d70715b85176 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:47.377422  5625 raft_consensus.cc:2272] T 44bde925b2e541b69890d70715b85176 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:47.373916  6622 rpcz_store.cc:276] 0709 13:21:43.728604 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:21:44.931791 (+1203187us) service_pool.cc:224] Handling call
0709 13:21:47.373262 (+2441471us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:21:47.196176 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:21:47.196888 (+   712us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:21:47.196928 (+    40us) write_op.cc:435] Acquired schema lock
0709 13:21:47.196949 (+    21us) tablet.cc:662] Decoding operations
0709 13:21:47.198209 (+  1260us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:21:47.198272 (+    63us) write_op.cc:641] Partition lock acquired for write op
0709 13:21:47.198311 (+    39us) tablet.cc:685] Acquiring locks for 13 operations
0709 13:21:47.199510 (+  1199us) tablet.cc:701] Row locks acquired
0709 13:21:47.199532 (+    22us) write_op.cc:260] PREPARE: finished
0709 13:21:47.199705 (+   173us) write_op.cc:270] Start()
0709 13:21:47.201432 (+  1727us) write_op.cc:276] Timestamp: P: 1783603307199649 usec, L: 0
0709 13:21:47.201456 (+    24us) op_driver.cc:348] REPLICATION: starting
0709 13:21:47.202285 (+   829us) log.cc:844] Serialized 5159 byte log entry
0709 13:21:47.228290 (+ 26005us) op_driver.cc:464] REPLICATION: finished
0709 13:21:47.230971 (+  2681us) write_op.cc:301] APPLY: starting
0709 13:21:47.231050 (+    79us) tablet.cc:1367] starting BulkCheckPresence
0709 13:21:47.238459 (+  7409us) tablet.cc:1370] finished BulkCheckPresence
0709 13:21:47.238546 (+    87us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:21:47.280381 (+ 41835us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:21:47.280657 (+   276us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=26,key_file_lookups=26,delta_file_lookups=26,mrs_lookups=0
0709 13:21:47.280705 (+    48us) write_op.cc:312] APPLY: finished
0709 13:21:47.281040 (+   335us) log.cc:844] Serialized 121 byte log entry
0709 13:21:47.281832 (+   792us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:21:47.281978 (+   146us) write_op.cc:454] Released schema lock
0709 13:21:47.282031 (+    53us) write_op.cc:341] FINISH: Updating metrics
0709 13:21:47.282416 (+   385us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:21:47.282443 (+    27us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":35694,"reported_tablets":55,"spinlock_wait_cycles":15488,"child_traces":[["op",{"apply.queue_time_us":2427,"apply.run_cpu_time_us":16959,"apply.run_wall_time_us":51424,"cfile_cache_hit":52,"cfile_cache_hit_bytes":54288,"num_ops":13,"prepare.queue_time_us":195,"prepare.run_cpu_time_us":4979,"prepare.run_wall_time_us":26559,"replication_time_us":26680}]]}
I20260709 13:21:47.386173  5625 tablet_replica.cc:333] T 4b8cacb381b746da8d0049b0a83b41dd P ccd8a4c3bfe3413cb2ae219b09aea832: stopping tablet replica
I20260709 13:21:47.391222  5625 raft_consensus.cc:2243] T 4b8cacb381b746da8d0049b0a83b41dd P ccd8a4c3bfe3413cb2ae219b09aea832 [term 21 LEADER]: Raft consensus shutting down.
I20260709 13:21:47.413923  5625 raft_consensus.cc:2272] T 4b8cacb381b746da8d0049b0a83b41dd P ccd8a4c3bfe3413cb2ae219b09aea832 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:47.417155  5625 tablet_replica.cc:333] T 1528ab62b6fe4e3099d08f141afee116 P ccd8a4c3bfe3413cb2ae219b09aea832: stopping tablet replica
I20260709 13:21:47.418033  5625 raft_consensus.cc:2243] T 1528ab62b6fe4e3099d08f141afee116 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 19 LEADER]: Raft consensus shutting down.
I20260709 13:21:47.445039  5625 raft_consensus.cc:2272] T 1528ab62b6fe4e3099d08f141afee116 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:47.460366  5625 tablet_replica.cc:333] T 3fa34c08b205435dba97346991aa1f92 P ccd8a4c3bfe3413cb2ae219b09aea832: stopping tablet replica
I20260709 13:21:47.461352  5625 raft_consensus.cc:2243] T 3fa34c08b205435dba97346991aa1f92 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 27 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:47.462263  5625 raft_consensus.cc:2272] T 3fa34c08b205435dba97346991aa1f92 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 27 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:47.481792  5625 tablet_replica.cc:333] T 3a485a995abc4807b6e511e45419f737 P ccd8a4c3bfe3413cb2ae219b09aea832: stopping tablet replica
I20260709 13:21:47.482877  5625 raft_consensus.cc:2243] T 3a485a995abc4807b6e511e45419f737 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:47.483623  5625 raft_consensus.cc:2272] T 3a485a995abc4807b6e511e45419f737 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:47.487093  5625 tablet_replica.cc:333] T 7c44c4849aa54f2b94d1f1bef9ed546f P ccd8a4c3bfe3413cb2ae219b09aea832: stopping tablet replica
I20260709 13:21:47.487937  5625 raft_consensus.cc:2243] T 7c44c4849aa54f2b94d1f1bef9ed546f P ccd8a4c3bfe3413cb2ae219b09aea832 [term 23 LEADER]: Raft consensus shutting down.
I20260709 13:21:47.489244  5625 raft_consensus.cc:2272] T 7c44c4849aa54f2b94d1f1bef9ed546f P ccd8a4c3bfe3413cb2ae219b09aea832 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:47.492501  5625 tablet_replica.cc:333] T 07a92dd554674067a83a9cb68c4773f2 P ccd8a4c3bfe3413cb2ae219b09aea832: stopping tablet replica
I20260709 13:21:47.493342  5625 raft_consensus.cc:2243] T 07a92dd554674067a83a9cb68c4773f2 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:47.494050  5625 raft_consensus.cc:2272] T 07a92dd554674067a83a9cb68c4773f2 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:47.497506  5625 tablet_replica.cc:333] T 30e88460611e47b2ba16a46a30b5f416 P ccd8a4c3bfe3413cb2ae219b09aea832: stopping tablet replica
I20260709 13:21:47.498663  5625 raft_consensus.cc:2243] T 30e88460611e47b2ba16a46a30b5f416 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:47.499305  5625 raft_consensus.cc:2272] T 30e88460611e47b2ba16a46a30b5f416 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:47.502507  5625 tablet_replica.cc:333] T be1a92657f494cac8dd227d152f50151 P ccd8a4c3bfe3413cb2ae219b09aea832: stopping tablet replica
I20260709 13:21:47.503309  5625 raft_consensus.cc:2243] T be1a92657f494cac8dd227d152f50151 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 25 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:47.504079  5625 raft_consensus.cc:2272] T be1a92657f494cac8dd227d152f50151 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:47.507261  5625 tablet_replica.cc:333] T f4b8bd455d5a47c18a1380839c6e0d61 P ccd8a4c3bfe3413cb2ae219b09aea832: stopping tablet replica
I20260709 13:21:47.508141  5625 raft_consensus.cc:2243] T f4b8bd455d5a47c18a1380839c6e0d61 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 21 LEADER]: Raft consensus shutting down.
I20260709 13:21:47.509492  5625 raft_consensus.cc:2272] T f4b8bd455d5a47c18a1380839c6e0d61 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:47.512919  5625 tablet_replica.cc:333] T e31b9971c15848dea59d4d4130141d9e P ccd8a4c3bfe3413cb2ae219b09aea832: stopping tablet replica
I20260709 13:21:47.513767  5625 raft_consensus.cc:2243] T e31b9971c15848dea59d4d4130141d9e P ccd8a4c3bfe3413cb2ae219b09aea832 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:47.514458  5625 raft_consensus.cc:2272] T e31b9971c15848dea59d4d4130141d9e P ccd8a4c3bfe3413cb2ae219b09aea832 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:47.517963  5625 tablet_replica.cc:333] T f09c2a98de1a4decabd0ff900dd44caa P ccd8a4c3bfe3413cb2ae219b09aea832: stopping tablet replica
I20260709 13:21:47.518833  5625 raft_consensus.cc:2243] T f09c2a98de1a4decabd0ff900dd44caa P ccd8a4c3bfe3413cb2ae219b09aea832 [term 24 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:47.519497  5625 raft_consensus.cc:2272] T f09c2a98de1a4decabd0ff900dd44caa P ccd8a4c3bfe3413cb2ae219b09aea832 [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:47.522607  5625 tablet_replica.cc:333] T e77e330a82df4b43a745d57a68f6f057 P ccd8a4c3bfe3413cb2ae219b09aea832: stopping tablet replica
I20260709 13:21:47.523476  5625 raft_consensus.cc:2243] T e77e330a82df4b43a745d57a68f6f057 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 19 LEADER]: Raft consensus shutting down.
I20260709 13:21:47.524829  5625 raft_consensus.cc:2272] T e77e330a82df4b43a745d57a68f6f057 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:47.528401  5625 tablet_replica.cc:333] T a3022224cc81473690653a83d4e99470 P ccd8a4c3bfe3413cb2ae219b09aea832: stopping tablet replica
I20260709 13:21:47.529276  5625 raft_consensus.cc:2243] T a3022224cc81473690653a83d4e99470 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 21 LEADER]: Raft consensus shutting down.
I20260709 13:21:47.530619  5625 raft_consensus.cc:2272] T a3022224cc81473690653a83d4e99470 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:47.554908  5625 tablet_replica.cc:333] T f3f9c2e2bf644115957398fe4c9459db P ccd8a4c3bfe3413cb2ae219b09aea832: stopping tablet replica
W20260709 13:21:47.552228  6678 auto_rebalancer.cc:629] Failed to schedule move for tablet d8292e16e5654be6bc408560cf256aaa: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:21:47.555980  5625 raft_consensus.cc:2243] T f3f9c2e2bf644115957398fe4c9459db P ccd8a4c3bfe3413cb2ae219b09aea832 [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:47.556981  5625 raft_consensus.cc:2272] T f3f9c2e2bf644115957398fe4c9459db P ccd8a4c3bfe3413cb2ae219b09aea832 [term 23 FOLLOWER]: Raft consensus is shut down!
W20260709 13:21:47.559089  6678 auto_rebalancer.cc:629] Failed to schedule move for tablet a3022224cc81473690653a83d4e99470: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:21:47.560642  5625 tablet_replica.cc:333] T 711ef6523deb4cbe8ef2ba61e1c21c98 P ccd8a4c3bfe3413cb2ae219b09aea832: stopping tablet replica
I20260709 13:21:47.561702  5625 raft_consensus.cc:2243] T 711ef6523deb4cbe8ef2ba61e1c21c98 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 21 LEADER]: Raft consensus shutting down.
I20260709 13:21:47.563022  5625 raft_consensus.cc:2272] T 711ef6523deb4cbe8ef2ba61e1c21c98 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:47.566633  6803 consensus_queue.cc:237] T f3f9c2e2bf644115957398fe4c9459db P b7ab4784c7344b939bc36f639286f377 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 23.15, Last appended by leader: 14, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } attrs { replace: true } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: NON_VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: true } }
I20260709 13:21:47.578575  5625 tablet_replica.cc:333] T 4d9def8b32fd443aa94ab1420b06837b P ccd8a4c3bfe3413cb2ae219b09aea832: stopping tablet replica
I20260709 13:21:47.579553  5625 raft_consensus.cc:2243] T 4d9def8b32fd443aa94ab1420b06837b P ccd8a4c3bfe3413cb2ae219b09aea832 [term 24 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:47.580385  5625 raft_consensus.cc:2272] T 4d9def8b32fd443aa94ab1420b06837b P ccd8a4c3bfe3413cb2ae219b09aea832 [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:47.584935  5625 tablet_replica.cc:333] T dbdf895bba214ff68685a24fd17dfb5d P ccd8a4c3bfe3413cb2ae219b09aea832: stopping tablet replica
I20260709 13:21:47.585870  5625 raft_consensus.cc:2243] T dbdf895bba214ff68685a24fd17dfb5d P ccd8a4c3bfe3413cb2ae219b09aea832 [term 20 LEADER]: Raft consensus shutting down.
I20260709 13:21:47.587149  5625 raft_consensus.cc:2272] T dbdf895bba214ff68685a24fd17dfb5d P ccd8a4c3bfe3413cb2ae219b09aea832 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:47.599784  5625 tablet_replica.cc:333] T 90d42e216d9741e190bca19a781291fd P ccd8a4c3bfe3413cb2ae219b09aea832: stopping tablet replica
I20260709 13:21:47.600786  5625 raft_consensus.cc:2243] T 90d42e216d9741e190bca19a781291fd P ccd8a4c3bfe3413cb2ae219b09aea832 [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:47.601683  5625 raft_consensus.cc:2272] T 90d42e216d9741e190bca19a781291fd P ccd8a4c3bfe3413cb2ae219b09aea832 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:47.610392  5625 tablet_replica.cc:333] T b3f13b31a1f84f0d89d007eadd57924c P ccd8a4c3bfe3413cb2ae219b09aea832: stopping tablet replica
I20260709 13:21:47.611364  5625 raft_consensus.cc:2243] T b3f13b31a1f84f0d89d007eadd57924c P ccd8a4c3bfe3413cb2ae219b09aea832 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:47.612071  5625 raft_consensus.cc:2272] T b3f13b31a1f84f0d89d007eadd57924c P ccd8a4c3bfe3413cb2ae219b09aea832 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:47.615944  5625 tablet_replica.cc:333] T 20f6842e26174571996b8dea4151d4be P ccd8a4c3bfe3413cb2ae219b09aea832: stopping tablet replica
I20260709 13:21:47.616786  5625 raft_consensus.cc:2243] T 20f6842e26174571996b8dea4151d4be P ccd8a4c3bfe3413cb2ae219b09aea832 [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:47.617491  5625 raft_consensus.cc:2272] T 20f6842e26174571996b8dea4151d4be P ccd8a4c3bfe3413cb2ae219b09aea832 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:47.620738  5625 tablet_replica.cc:333] T 7887766dc6784fcaa42b35c05fea7a99 P ccd8a4c3bfe3413cb2ae219b09aea832: stopping tablet replica
I20260709 13:21:47.621595  5625 raft_consensus.cc:2243] T 7887766dc6784fcaa42b35c05fea7a99 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:47.622962  5625 raft_consensus.cc:2272] T 7887766dc6784fcaa42b35c05fea7a99 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:47.627858  5625 tablet_replica.cc:333] T 404190ce4ce94cecbfcb6ea9d1dd8626 P ccd8a4c3bfe3413cb2ae219b09aea832: stopping tablet replica
I20260709 13:21:47.628759  5625 raft_consensus.cc:2243] T 404190ce4ce94cecbfcb6ea9d1dd8626 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:47.629467  5625 raft_consensus.cc:2272] T 404190ce4ce94cecbfcb6ea9d1dd8626 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:47.632503  5625 tablet_replica.cc:333] T f58dc08b12a2494bb9a1372837970ca2 P ccd8a4c3bfe3413cb2ae219b09aea832: stopping tablet replica
I20260709 13:21:47.632644  6874 raft_consensus.cc:1275] T f3f9c2e2bf644115957398fe4c9459db P cd75a17ab2604397adab03bb8b5fd75c [term 23 FOLLOWER]: Refusing update from remote peer b7ab4784c7344b939bc36f639286f377: Log matching property violated. Preceding OpId in replica: term: 23 index: 15. Preceding OpId from leader: term: 23 index: 16. (index mismatch)
I20260709 13:21:47.633204  5625 raft_consensus.cc:2243] T f58dc08b12a2494bb9a1372837970ca2 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:47.635697  5625 raft_consensus.cc:2272] T f58dc08b12a2494bb9a1372837970ca2 P ccd8a4c3bfe3413cb2ae219b09aea832 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:47.635905 14452 consensus_queue.cc:1048] T f3f9c2e2bf644115957398fe4c9459db P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.013s
I20260709 13:21:47.675633  5625 tablet_replica.cc:333] T 853ac0a8cbd64ce99457f170216d4d0f P ccd8a4c3bfe3413cb2ae219b09aea832: stopping tablet replica
I20260709 13:21:47.689900  5625 raft_consensus.cc:2243] T 853ac0a8cbd64ce99457f170216d4d0f P ccd8a4c3bfe3413cb2ae219b09aea832 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:47.690735  5625 raft_consensus.cc:2272] T 853ac0a8cbd64ce99457f170216d4d0f P ccd8a4c3bfe3413cb2ae219b09aea832 [term 18 FOLLOWER]: Raft consensus is shut down!
W20260709 13:21:47.695591  6770 consensus_peers.cc:597] T f3f9c2e2bf644115957398fe4c9459db P b7ab4784c7344b939bc36f639286f377 -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:47.715036  6772 consensus_peers.cc:597] T f3f9c2e2bf644115957398fe4c9459db P b7ab4784c7344b939bc36f639286f377 -> Peer 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071): Couldn't send request to peer 7ba59cc884714e8aa5f3f0ecaed84cbb. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: f3f9c2e2bf644115957398fe4c9459db. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:47.816100  6772 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 87789us
I20260709 13:21:47.830602 14461 raft_consensus.cc:2955] T f3f9c2e2bf644115957398fe4c9459db P b7ab4784c7344b939bc36f639286f377 [term 23 LEADER]: Committing config change with OpId 23.16: config changed from index -1 to 16, NON_VOTER 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68) added. New config: { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } attrs { replace: true } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: NON_VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: true } } }
W20260709 13:21:47.832260  6844 consensus_peers.cc:597] T 34f36d59d88f40fe8a2805e604fc6c0a P cd75a17ab2604397adab03bb8b5fd75c -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:21:47.837900  6874 raft_consensus.cc:2955] T f3f9c2e2bf644115957398fe4c9459db P cd75a17ab2604397adab03bb8b5fd75c [term 23 FOLLOWER]: Committing config change with OpId 23.16: config changed from index -1 to 16, NON_VOTER 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68) added. New config: { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } attrs { replace: true } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: NON_VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: true } } }
I20260709 13:21:47.863847  6629 catalog_manager.cc:5697] T f3f9c2e2bf644115957398fe4c9459db P cd75a17ab2604397adab03bb8b5fd75c reported cstate change: config changed from index -1 to 16, NON_VOTER 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68) added. New cstate: current_term: 23 leader_uuid: "b7ab4784c7344b939bc36f639286f377" committed_config { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } attrs { replace: true } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: NON_VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: true } } }
I20260709 13:21:47.865399  6804 consensus_queue.cc:237] T 3a485a995abc4807b6e511e45419f737 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } attrs { replace: true } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: NON_VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: true } }
I20260709 13:21:47.914584  6877 raft_consensus.cc:1275] T 3a485a995abc4807b6e511e45419f737 P cd75a17ab2604397adab03bb8b5fd75c [term 17 FOLLOWER]: Refusing update from remote peer b7ab4784c7344b939bc36f639286f377: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:21:47.917075 14439 consensus_queue.cc:1048] T 3a485a995abc4807b6e511e45419f737 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
W20260709 13:21:47.919854  6772 consensus_peers.cc:597] T 3a485a995abc4807b6e511e45419f737 P b7ab4784c7344b939bc36f639286f377 -> Peer 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071): Couldn't send request to peer 7ba59cc884714e8aa5f3f0ecaed84cbb. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 3a485a995abc4807b6e511e45419f737. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:47.920404  6770 consensus_peers.cc:597] T 3a485a995abc4807b6e511e45419f737 P b7ab4784c7344b939bc36f639286f377 -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:47.924741  7502 consensus_queue.cc:237] T 427c124d773f483294511e80fe340075 P 7ba59cc884714e8aa5f3f0ecaed84cbb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 11, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:21:47.950292  6874 raft_consensus.cc:1275] T 427c124d773f483294511e80fe340075 P cd75a17ab2604397adab03bb8b5fd75c [term 18 FOLLOWER]: Refusing update from remote peer 7ba59cc884714e8aa5f3f0ecaed84cbb: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 13:21:47.953223  6804 raft_consensus.cc:1275] T 427c124d773f483294511e80fe340075 P b7ab4784c7344b939bc36f639286f377 [term 18 FOLLOWER]: Refusing update from remote peer 7ba59cc884714e8aa5f3f0ecaed84cbb: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 13:21:47.957753 14400 consensus_queue.cc:1048] T 427c124d773f483294511e80fe340075 P 7ba59cc884714e8aa5f3f0ecaed84cbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:21:47.972824 14461 raft_consensus.cc:2955] T 3a485a995abc4807b6e511e45419f737 P b7ab4784c7344b939bc36f639286f377 [term 17 LEADER]: Committing config change with OpId 17.11: config changed from index -1 to 11, NON_VOTER 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } attrs { replace: true } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: NON_VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: true } } }
I20260709 13:21:47.971302 14438 consensus_queue.cc:1048] T 427c124d773f483294511e80fe340075 P 7ba59cc884714e8aa5f3f0ecaed84cbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.005s
I20260709 13:21:47.976271  6877 raft_consensus.cc:2955] T 3a485a995abc4807b6e511e45419f737 P cd75a17ab2604397adab03bb8b5fd75c [term 17 FOLLOWER]: Committing config change with OpId 17.11: config changed from index -1 to 11, NON_VOTER 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } attrs { replace: true } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: NON_VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: true } } }
I20260709 13:21:47.989714 14462 raft_consensus.cc:2955] T 427c124d773f483294511e80fe340075 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 18 LEADER]: Committing config change with OpId 18.13: config changed from index 3 to 13, VOTER ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65) evicted. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } } }
I20260709 13:21:47.991668  6874 raft_consensus.cc:2955] T 427c124d773f483294511e80fe340075 P cd75a17ab2604397adab03bb8b5fd75c [term 18 FOLLOWER]: Committing config change with OpId 18.13: config changed from index 3 to 13, VOTER ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65) evicted. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } } }
W20260709 13:21:48.032595  6844 consensus_peers.cc:597] T 9e326172347f45e99a0d482b5d8ef768 P cd75a17ab2604397adab03bb8b5fd75c -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
W20260709 13:21:48.097569  7466 consensus_peers.cc:597] T b3f13b31a1f84f0d89d007eadd57924c P 7ba59cc884714e8aa5f3f0ecaed84cbb -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:21:48.099326  6616 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 427c124d773f483294511e80fe340075 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 14)
I20260709 13:21:48.117249  6624 catalog_manager.cc:5697] T 427c124d773f483294511e80fe340075 P 7ba59cc884714e8aa5f3f0ecaed84cbb reported cstate change: config changed from index 3 to 13, VOTER ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65) evicted. New cstate: current_term: 18 leader_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" committed_config { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:21:48.093111  6799 raft_consensus.cc:2955] T 427c124d773f483294511e80fe340075 P b7ab4784c7344b939bc36f639286f377 [term 18 FOLLOWER]: Committing config change with OpId 18.13: config changed from index 3 to 13, VOTER ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65) evicted. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } } }
I20260709 13:21:48.138973  6622 catalog_manager.cc:5697] T 3a485a995abc4807b6e511e45419f737 P cd75a17ab2604397adab03bb8b5fd75c reported cstate change: config changed from index -1 to 11, NON_VOTER 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68) added. New cstate: current_term: 17 leader_uuid: "b7ab4784c7344b939bc36f639286f377" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } attrs { replace: true } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: NON_VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: true } } }
W20260709 13:21:48.143463  6770 consensus_peers.cc:597] T 3d65025eea89441290d85dd053810e31 P b7ab4784c7344b939bc36f639286f377 -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
W20260709 13:21:48.143867  6844 connection.cc:573] client connection to 127.5.126.65:44391 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260709 13:21:48.145421  6844 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107) [suppressed 384 similar messages]
W20260709 13:21:48.144732  6614 connection.cc:573] client connection to 127.5.126.65:44391 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260709 13:21:48.171411  6844 consensus_peers.cc:597] T e31b9971c15848dea59d4d4130141d9e P cd75a17ab2604397adab03bb8b5fd75c -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:21:48.185778 14474 ts_tablet_manager.cc:933] T f3f9c2e2bf644115957398fe4c9459db P 7ba59cc884714e8aa5f3f0ecaed84cbb: Initiating tablet copy from peer b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:21:48.197988 14474 tablet_copy_client.cc:323] T f3f9c2e2bf644115957398fe4c9459db P 7ba59cc884714e8aa5f3f0ecaed84cbb: tablet copy: Beginning tablet copy session from remote peer at address 127.5.126.66:42817
I20260709 13:21:48.278568 14464 raft_consensus.cc:493] T fe20b4b48823486ca3b9c648db6ce8aa P cd75a17ab2604397adab03bb8b5fd75c [term 16 FOLLOWER]: Starting pre-election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:21:48.279491 14464 raft_consensus.cc:515] T fe20b4b48823486ca3b9c648db6ce8aa P cd75a17ab2604397adab03bb8b5fd75c [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:21:48.283052 14464 leader_election.cc:290] T fe20b4b48823486ca3b9c648db6ce8aa P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:21:48.284650  7502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe20b4b48823486ca3b9c648db6ce8aa" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:21:48.318908  6817 tablet_copy_service.cc:140] P b7ab4784c7344b939bc36f639286f377: Received BeginTabletCopySession request for tablet f3f9c2e2bf644115957398fe4c9459db from peer 7ba59cc884714e8aa5f3f0ecaed84cbb ({username='slave'} at 127.0.0.1:50550)
I20260709 13:21:48.319636  6817 tablet_copy_service.cc:161] P b7ab4784c7344b939bc36f639286f377: Beginning new tablet copy session on tablet f3f9c2e2bf644115957398fe4c9459db from peer 7ba59cc884714e8aa5f3f0ecaed84cbb at {username='slave'} at 127.0.0.1:50550: session id = 7ba59cc884714e8aa5f3f0ecaed84cbb-f3f9c2e2bf644115957398fe4c9459db
W20260709 13:21:48.325098  6614 catalog_manager.cc:4755] TS ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 427c124d773f483294511e80fe340075: Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111)
I20260709 13:21:48.343572  6817 tablet_copy_source_session.cc:215] T f3f9c2e2bf644115957398fe4c9459db P b7ab4784c7344b939bc36f639286f377: Tablet Copy: opened 0 blocks and 1 log segments
W20260709 13:21:48.348465  6770 consensus_peers.cc:597] T 8c7f33e544204fbaac4078e3e83bbf4e P b7ab4784c7344b939bc36f639286f377 -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:21:48.350425 14474 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f3f9c2e2bf644115957398fe4c9459db. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:48.353233 14464 raft_consensus.cc:493] T de3186201e1a40d0b335eeb8b4e256e0 P cd75a17ab2604397adab03bb8b5fd75c [term 22 FOLLOWER]: Starting pre-election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:21:48.353830 14464 raft_consensus.cc:515] T de3186201e1a40d0b335eeb8b4e256e0 P cd75a17ab2604397adab03bb8b5fd75c [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
W20260709 13:21:48.356817  6844 consensus_peers.cc:597] T c4db81d9d329422bb3b4160ca4ac2d1d P cd75a17ab2604397adab03bb8b5fd75c -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:21:48.355918 14464 leader_election.cc:290] T de3186201e1a40d0b335eeb8b4e256e0 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
W20260709 13:21:48.358369  6770 consensus_peers.cc:597] T 9b3759de40694069b13c0f8bd40e5709 P b7ab4784c7344b939bc36f639286f377 -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:21:48.358953  6770 consensus_peers.cc:597] T 22ccee1b570c4ad3a57bd7aec085b1b4 P b7ab4784c7344b939bc36f639286f377 -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:21:48.368930 14452 raft_consensus.cc:493] T de3186201e1a40d0b335eeb8b4e256e0 P b7ab4784c7344b939bc36f639286f377 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:21:48.369540 14452 raft_consensus.cc:515] T de3186201e1a40d0b335eeb8b4e256e0 P b7ab4784c7344b939bc36f639286f377 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:48.372077 14452 leader_election.cc:290] T de3186201e1a40d0b335eeb8b4e256e0 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:21:48.376839  6877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de3186201e1a40d0b335eeb8b4e256e0" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:21:48.377624  6877 raft_consensus.cc:2468] T de3186201e1a40d0b335eeb8b4e256e0 P cd75a17ab2604397adab03bb8b5fd75c [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 22.
W20260709 13:21:48.379670  7466 consensus_peers.cc:597] T 24ee15416e3145beaa1b8183453729a3 P 7ba59cc884714e8aa5f3f0ecaed84cbb -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:21:48.380658  6799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de3186201e1a40d0b335eeb8b4e256e0" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:21:48.381215  6772 leader_election.cc:304] T de3186201e1a40d0b335eeb8b4e256e0 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:21:48.381379  6799 raft_consensus.cc:2468] T de3186201e1a40d0b335eeb8b4e256e0 P b7ab4784c7344b939bc36f639286f377 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 22.
I20260709 13:21:48.387032 14461 raft_consensus.cc:2804] T de3186201e1a40d0b335eeb8b4e256e0 P b7ab4784c7344b939bc36f639286f377 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:21:48.387490 14461 raft_consensus.cc:493] T de3186201e1a40d0b335eeb8b4e256e0 P b7ab4784c7344b939bc36f639286f377 [term 22 FOLLOWER]: Starting leader election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:21:48.387869 14461 raft_consensus.cc:3060] T de3186201e1a40d0b335eeb8b4e256e0 P b7ab4784c7344b939bc36f639286f377 [term 22 FOLLOWER]: Advancing to term 23
W20260709 13:21:48.396298  6844 consensus_peers.cc:597] T 1bf4668eeb70467fb3dc5a0289233b3c P cd75a17ab2604397adab03bb8b5fd75c -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:21:48.404358  6844 consensus_peers.cc:597] T 90d42e216d9741e190bca19a781291fd P cd75a17ab2604397adab03bb8b5fd75c -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:21:48.404995  6844 leader_election.cc:336] T fe20b4b48823486ca3b9c648db6ce8aa P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111)
I20260709 13:21:48.405480  6844 leader_election.cc:304] T fe20b4b48823486ca3b9c648db6ce8aa P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:21:48.412655 14464 raft_consensus.cc:2749] T fe20b4b48823486ca3b9c648db6ce8aa P cd75a17ab2604397adab03bb8b5fd75c [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:21:48.406679 14461 raft_consensus.cc:515] T de3186201e1a40d0b335eeb8b4e256e0 P b7ab4784c7344b939bc36f639286f377 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
W20260709 13:21:48.408470  6770 consensus_peers.cc:597] T 853ac0a8cbd64ce99457f170216d4d0f P b7ab4784c7344b939bc36f639286f377 -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:21:48.417810 14462 raft_consensus.cc:493] T fe20b4b48823486ca3b9c648db6ce8aa P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 16 FOLLOWER]: Starting pre-election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:21:48.418447 14462 raft_consensus.cc:515] T fe20b4b48823486ca3b9c648db6ce8aa P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:21:48.423656 14462 leader_election.cc:290] T fe20b4b48823486ca3b9c648db6ce8aa P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
W20260709 13:21:48.426446  7466 leader_election.cc:336] T fe20b4b48823486ca3b9c648db6ce8aa P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111)
I20260709 13:21:48.426935  6877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de3186201e1a40d0b335eeb8b4e256e0" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:21:48.427567  6877 raft_consensus.cc:3060] T de3186201e1a40d0b335eeb8b4e256e0 P cd75a17ab2604397adab03bb8b5fd75c [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:21:48.431521 14462 raft_consensus.cc:493] T 4b8cacb381b746da8d0049b0a83b41dd P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 21 FOLLOWER]: Starting pre-election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:21:48.432125 14462 raft_consensus.cc:515] T 4b8cacb381b746da8d0049b0a83b41dd P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
W20260709 13:21:48.436712  6770 leader_election.cc:336] T de3186201e1a40d0b335eeb8b4e256e0 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111)
I20260709 13:21:48.437666 14462 leader_election.cc:290] T 4b8cacb381b746da8d0049b0a83b41dd P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
W20260709 13:21:48.440196  7466 leader_election.cc:336] T 4b8cacb381b746da8d0049b0a83b41dd P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111)
I20260709 13:21:48.441108 14457 raft_consensus.cc:493] T 3411566abe2d4c9bb4b2adfdd05e6f17 P b7ab4784c7344b939bc36f639286f377 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:21:48.441713 14457 raft_consensus.cc:515] T 3411566abe2d4c9bb4b2adfdd05e6f17 P b7ab4784c7344b939bc36f639286f377 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:48.444517 14457 leader_election.cc:290] T 3411566abe2d4c9bb4b2adfdd05e6f17 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:21:48.452817  6874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3411566abe2d4c9bb4b2adfdd05e6f17" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:21:48.456169 14461 leader_election.cc:290] T de3186201e1a40d0b335eeb8b4e256e0 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 23 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:21:48.457119 14464 raft_consensus.cc:493] T 4b8cacb381b746da8d0049b0a83b41dd P cd75a17ab2604397adab03bb8b5fd75c [term 21 FOLLOWER]: Starting pre-election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:21:48.464753 14457 raft_consensus.cc:493] T a3022224cc81473690653a83d4e99470 P b7ab4784c7344b939bc36f639286f377 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:21:48.464416 14464 raft_consensus.cc:515] T 4b8cacb381b746da8d0049b0a83b41dd P cd75a17ab2604397adab03bb8b5fd75c [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:21:48.465446 14457 raft_consensus.cc:515] T a3022224cc81473690653a83d4e99470 P b7ab4784c7344b939bc36f639286f377 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:48.467676 14457 leader_election.cc:290] T a3022224cc81473690653a83d4e99470 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:21:48.468307  7502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b8cacb381b746da8d0049b0a83b41dd" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:21:48.468981  7502 raft_consensus.cc:2468] T 4b8cacb381b746da8d0049b0a83b41dd P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 21.
I20260709 13:21:48.470201  6846 leader_election.cc:304] T 4b8cacb381b746da8d0049b0a83b41dd P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:21:48.470645  6874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3022224cc81473690653a83d4e99470" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:21:48.471089 14463 raft_consensus.cc:2804] T 4b8cacb381b746da8d0049b0a83b41dd P cd75a17ab2604397adab03bb8b5fd75c [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:21:48.471653 14463 raft_consensus.cc:493] T 4b8cacb381b746da8d0049b0a83b41dd P cd75a17ab2604397adab03bb8b5fd75c [term 21 FOLLOWER]: Starting leader election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:21:48.472100 14463 raft_consensus.cc:3060] T 4b8cacb381b746da8d0049b0a83b41dd P cd75a17ab2604397adab03bb8b5fd75c [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:21:48.471455 14464 leader_election.cc:290] T 4b8cacb381b746da8d0049b0a83b41dd P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:21:48.497588  6844 leader_election.cc:304] T de3186201e1a40d0b335eeb8b4e256e0 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:21:48.503964 14464 raft_consensus.cc:493] T bd6869f07b5a4885a0b99fbe60c3b175 P cd75a17ab2604397adab03bb8b5fd75c [term 26 FOLLOWER]: Starting pre-election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:21:48.504616 14464 raft_consensus.cc:515] T bd6869f07b5a4885a0b99fbe60c3b175 P cd75a17ab2604397adab03bb8b5fd75c [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:48.506804 14464 leader_election.cc:290] T bd6869f07b5a4885a0b99fbe60c3b175 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:21:48.508664  6874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe20b4b48823486ca3b9c648db6ce8aa" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:21:48.509392  6874 raft_consensus.cc:2468] T fe20b4b48823486ca3b9c648db6ce8aa P cd75a17ab2604397adab03bb8b5fd75c [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in term 16.
I20260709 13:21:48.510543  6877 raft_consensus.cc:2468] T de3186201e1a40d0b335eeb8b4e256e0 P cd75a17ab2604397adab03bb8b5fd75c [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 23.
I20260709 13:21:48.511320 14437 raft_consensus.cc:2764] T de3186201e1a40d0b335eeb8b4e256e0 P cd75a17ab2604397adab03bb8b5fd75c [term 23 FOLLOWER]: Leader pre-election decision vote started in defunct term 22: won
I20260709 13:21:48.511982  6772 leader_election.cc:304] T de3186201e1a40d0b335eeb8b4e256e0 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:21:48.513041 14461 raft_consensus.cc:2804] T de3186201e1a40d0b335eeb8b4e256e0 P b7ab4784c7344b939bc36f639286f377 [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:21:48.513504 14437 raft_consensus.cc:493] T f4b8bd455d5a47c18a1380839c6e0d61 P cd75a17ab2604397adab03bb8b5fd75c [term 21 FOLLOWER]: Starting pre-election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:21:48.514205 14437 raft_consensus.cc:515] T f4b8bd455d5a47c18a1380839c6e0d61 P cd75a17ab2604397adab03bb8b5fd75c [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:48.513558 14461 raft_consensus.cc:697] T de3186201e1a40d0b335eeb8b4e256e0 P b7ab4784c7344b939bc36f639286f377 [term 23 LEADER]: Becoming Leader. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
I20260709 13:21:48.515897 14461 consensus_queue.cc:237] T de3186201e1a40d0b335eeb8b4e256e0 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 22.12, Last appended by leader: 12, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:48.516470 14482 raft_consensus.cc:493] T 7c37d41cd9164c15a6826ca62a851a69 P cd75a17ab2604397adab03bb8b5fd75c [term 22 FOLLOWER]: Starting pre-election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:21:48.516979 14437 leader_election.cc:290] T f4b8bd455d5a47c18a1380839c6e0d61 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:21:48.517143 14482 raft_consensus.cc:515] T 7c37d41cd9164c15a6826ca62a851a69 P cd75a17ab2604397adab03bb8b5fd75c [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:48.519258 14474 tablet_copy_client.cc:806] T f3f9c2e2bf644115957398fe4c9459db P 7ba59cc884714e8aa5f3f0ecaed84cbb: tablet copy: Starting download of 0 data blocks...
I20260709 13:21:48.519510 14482 leader_election.cc:290] T 7c37d41cd9164c15a6826ca62a851a69 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:21:48.519981 14474 tablet_copy_client.cc:670] T f3f9c2e2bf644115957398fe4c9459db P 7ba59cc884714e8aa5f3f0ecaed84cbb: tablet copy: Starting download of 1 WAL segments...
W20260709 13:21:48.516829  6770 consensus_peers.cc:597] T 4d9def8b32fd443aa94ab1420b06837b P b7ab4784c7344b939bc36f639286f377 -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:21:48.520455  6877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b8cacb381b746da8d0049b0a83b41dd" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:21:48.540928 14474 tablet_copy_client.cc:538] T f3f9c2e2bf644115957398fe4c9459db P 7ba59cc884714e8aa5f3f0ecaed84cbb: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:21:48.548260  6624 catalog_manager.cc:5697] T de3186201e1a40d0b335eeb8b4e256e0 P b7ab4784c7344b939bc36f639286f377 reported cstate change: term changed from 22 to 23, leader changed from ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65) to b7ab4784c7344b939bc36f639286f377 (127.5.126.66). New cstate: current_term: 23 leader_uuid: "b7ab4784c7344b939bc36f639286f377" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:48.569614 14437 raft_consensus.cc:493] T 3411566abe2d4c9bb4b2adfdd05e6f17 P cd75a17ab2604397adab03bb8b5fd75c [term 20 FOLLOWER]: Starting pre-election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:21:48.570367 14437 raft_consensus.cc:515] T 3411566abe2d4c9bb4b2adfdd05e6f17 P cd75a17ab2604397adab03bb8b5fd75c [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:48.572996 14437 leader_election.cc:290] T 3411566abe2d4c9bb4b2adfdd05e6f17 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
W20260709 13:21:48.552822  6844 leader_election.cc:336] T de3186201e1a40d0b335eeb8b4e256e0 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111)
W20260709 13:21:48.577930  7466 consensus_peers.cc:597] T 404190ce4ce94cecbfcb6ea9d1dd8626 P 7ba59cc884714e8aa5f3f0ecaed84cbb -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:21:48.491638 14463 raft_consensus.cc:515] T 4b8cacb381b746da8d0049b0a83b41dd P cd75a17ab2604397adab03bb8b5fd75c [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:21:48.556629 14457 raft_consensus.cc:493] T f4b8bd455d5a47c18a1380839c6e0d61 P b7ab4784c7344b939bc36f639286f377 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:21:48.580394 14457 raft_consensus.cc:515] T f4b8bd455d5a47c18a1380839c6e0d61 P b7ab4784c7344b939bc36f639286f377 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:48.583510  6874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4b8bd455d5a47c18a1380839c6e0d61" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:21:48.583783 14457 leader_election.cc:290] T f4b8bd455d5a47c18a1380839c6e0d61 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:21:48.584206  6874 raft_consensus.cc:2468] T f4b8bd455d5a47c18a1380839c6e0d61 P cd75a17ab2604397adab03bb8b5fd75c [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 21.
I20260709 13:21:48.584625  6877 raft_consensus.cc:2393] T 4b8cacb381b746da8d0049b0a83b41dd P cd75a17ab2604397adab03bb8b5fd75c [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in current term 22: Already voted for candidate cd75a17ab2604397adab03bb8b5fd75c in this term.
I20260709 13:21:48.585412  6772 leader_election.cc:304] T f4b8bd455d5a47c18a1380839c6e0d61 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:21:48.586787 14484 ts_tablet_manager.cc:933] T 3a485a995abc4807b6e511e45419f737 P 7ba59cc884714e8aa5f3f0ecaed84cbb: Initiating tablet copy from peer b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:21:48.588239  7495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b8cacb381b746da8d0049b0a83b41dd" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb"
I20260709 13:21:48.588797  7495 raft_consensus.cc:3060] T 4b8cacb381b746da8d0049b0a83b41dd P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:21:48.586884 14457 raft_consensus.cc:2804] T f4b8bd455d5a47c18a1380839c6e0d61 P b7ab4784c7344b939bc36f639286f377 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:21:48.596311 14457 raft_consensus.cc:493] T f4b8bd455d5a47c18a1380839c6e0d61 P b7ab4784c7344b939bc36f639286f377 [term 21 FOLLOWER]: Starting leader election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:21:48.596907 14457 raft_consensus.cc:3060] T f4b8bd455d5a47c18a1380839c6e0d61 P b7ab4784c7344b939bc36f639286f377 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:21:48.597429 14463 leader_election.cc:290] T 4b8cacb381b746da8d0049b0a83b41dd P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 22 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:21:48.601423 14484 tablet_copy_client.cc:323] T 3a485a995abc4807b6e511e45419f737 P 7ba59cc884714e8aa5f3f0ecaed84cbb: tablet copy: Beginning tablet copy session from remote peer at address 127.5.126.66:42817
I20260709 13:21:48.603731  6817 tablet_copy_service.cc:140] P b7ab4784c7344b939bc36f639286f377: Received BeginTabletCopySession request for tablet 3a485a995abc4807b6e511e45419f737 from peer 7ba59cc884714e8aa5f3f0ecaed84cbb ({username='slave'} at 127.0.0.1:50550)
I20260709 13:21:48.604346  6817 tablet_copy_service.cc:161] P b7ab4784c7344b939bc36f639286f377: Beginning new tablet copy session on tablet 3a485a995abc4807b6e511e45419f737 from peer 7ba59cc884714e8aa5f3f0ecaed84cbb at {username='slave'} at 127.0.0.1:50550: session id = 7ba59cc884714e8aa5f3f0ecaed84cbb-3a485a995abc4807b6e511e45419f737
I20260709 13:21:48.604600  7495 raft_consensus.cc:2468] T 4b8cacb381b746da8d0049b0a83b41dd P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 22.
I20260709 13:21:48.605927  6846 leader_election.cc:304] T 4b8cacb381b746da8d0049b0a83b41dd P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:21:48.606849 14463 raft_consensus.cc:2804] T 4b8cacb381b746da8d0049b0a83b41dd P cd75a17ab2604397adab03bb8b5fd75c [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:21:48.607614 14463 raft_consensus.cc:697] T 4b8cacb381b746da8d0049b0a83b41dd P cd75a17ab2604397adab03bb8b5fd75c [term 22 LEADER]: Becoming Leader. State: Replica: cd75a17ab2604397adab03bb8b5fd75c, State: Running, Role: LEADER
I20260709 13:21:48.608726 14463 consensus_queue.cc:237] T 4b8cacb381b746da8d0049b0a83b41dd P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 21.16, Last appended by leader: 16, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:21:48.614328  6817 tablet_copy_source_session.cc:215] T 3a485a995abc4807b6e511e45419f737 P b7ab4784c7344b939bc36f639286f377: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:21:48.619186 14461 raft_consensus.cc:493] T d8292e16e5654be6bc408560cf256aaa P b7ab4784c7344b939bc36f639286f377 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:21:48.619990 14484 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3a485a995abc4807b6e511e45419f737. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:48.619781 14461 raft_consensus.cc:515] T d8292e16e5654be6bc408560cf256aaa P b7ab4784c7344b939bc36f639286f377 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:48.622942 14461 leader_election.cc:290] T d8292e16e5654be6bc408560cf256aaa P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:21:48.623924  6877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8292e16e5654be6bc408560cf256aaa" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:21:48.636283 14437 raft_consensus.cc:493] T d33d5ee8ef6f415593d8df52063161ad P cd75a17ab2604397adab03bb8b5fd75c [term 20 FOLLOWER]: Starting pre-election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:21:48.637022  7468 leader_election.cc:304] T fe20b4b48823486ca3b9c648db6ce8aa P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, cd75a17ab2604397adab03bb8b5fd75c; no voters: ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:21:48.638797 14400 raft_consensus.cc:2804] T fe20b4b48823486ca3b9c648db6ce8aa P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:21:48.639163 14400 raft_consensus.cc:493] T fe20b4b48823486ca3b9c648db6ce8aa P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 16 FOLLOWER]: Starting leader election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:21:48.639510 14400 raft_consensus.cc:3060] T fe20b4b48823486ca3b9c648db6ce8aa P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:21:48.641161  7466 consensus_peers.cc:597] T 17587d6730594da4a56fa13a353232a1 P 7ba59cc884714e8aa5f3f0ecaed84cbb -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:21:48.636896 14437 raft_consensus.cc:515] T d33d5ee8ef6f415593d8df52063161ad P cd75a17ab2604397adab03bb8b5fd75c [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:48.649710 14437 leader_election.cc:290] T d33d5ee8ef6f415593d8df52063161ad P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:21:48.652951 14484 tablet_copy_client.cc:806] T 3a485a995abc4807b6e511e45419f737 P 7ba59cc884714e8aa5f3f0ecaed84cbb: tablet copy: Starting download of 0 data blocks...
I20260709 13:21:48.647409 14400 raft_consensus.cc:515] T fe20b4b48823486ca3b9c648db6ce8aa P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:21:48.653764 14484 tablet_copy_client.cc:670] T 3a485a995abc4807b6e511e45419f737 P 7ba59cc884714e8aa5f3f0ecaed84cbb: tablet copy: Starting download of 1 WAL segments...
I20260709 13:21:48.659268 14400 leader_election.cc:290] T fe20b4b48823486ca3b9c648db6ce8aa P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 17 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:21:48.660121  6877 raft_consensus.cc:2468] T d8292e16e5654be6bc408560cf256aaa P cd75a17ab2604397adab03bb8b5fd75c [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 21.
I20260709 13:21:48.661397  6772 leader_election.cc:304] T d8292e16e5654be6bc408560cf256aaa P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:21:48.662328 14465 raft_consensus.cc:2804] T d8292e16e5654be6bc408560cf256aaa P b7ab4784c7344b939bc36f639286f377 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:21:48.662492 14484 tablet_copy_client.cc:538] T 3a485a995abc4807b6e511e45419f737 P 7ba59cc884714e8aa5f3f0ecaed84cbb: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:21:48.662782 14465 raft_consensus.cc:493] T d8292e16e5654be6bc408560cf256aaa P b7ab4784c7344b939bc36f639286f377 [term 21 FOLLOWER]: Starting leader election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:21:48.663470 14465 raft_consensus.cc:3060] T d8292e16e5654be6bc408560cf256aaa P b7ab4784c7344b939bc36f639286f377 [term 21 FOLLOWER]: Advancing to term 22
W20260709 13:21:48.664484  7466 leader_election.cc:336] T fe20b4b48823486ca3b9c648db6ce8aa P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 17 election: RPC error from VoteRequest() call to peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111)
I20260709 13:21:48.668303 14461 raft_consensus.cc:493] T bd6869f07b5a4885a0b99fbe60c3b175 P b7ab4784c7344b939bc36f639286f377 [term 26 FOLLOWER]: Starting pre-election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:21:48.668911 14461 raft_consensus.cc:515] T bd6869f07b5a4885a0b99fbe60c3b175 P b7ab4784c7344b939bc36f639286f377 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:48.672168 14482 raft_consensus.cc:493] T bb3d8792045a4583ae2e965b1350a5b4 P cd75a17ab2604397adab03bb8b5fd75c [term 19 FOLLOWER]: Starting pre-election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:21:48.672797 14482 raft_consensus.cc:515] T bb3d8792045a4583ae2e965b1350a5b4 P cd75a17ab2604397adab03bb8b5fd75c [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:21:48.675029 14482 leader_election.cc:290] T bb3d8792045a4583ae2e965b1350a5b4 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:21:48.675581 14482 raft_consensus.cc:493] T dbdf895bba214ff68685a24fd17dfb5d P cd75a17ab2604397adab03bb8b5fd75c [term 20 FOLLOWER]: Starting pre-election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:21:48.677430  7502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3d8792045a4583ae2e965b1350a5b4" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:21:48.679355 14482 raft_consensus.cc:515] T dbdf895bba214ff68685a24fd17dfb5d P cd75a17ab2604397adab03bb8b5fd75c [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:48.681475 14482 leader_election.cc:290] T dbdf895bba214ff68685a24fd17dfb5d P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
W20260709 13:21:48.684943  6770 leader_election.cc:336] T de3186201e1a40d0b335eeb8b4e256e0 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 23 election: RPC error from VoteRequest() call to peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111)
I20260709 13:21:48.692422 14461 leader_election.cc:290] T bd6869f07b5a4885a0b99fbe60c3b175 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:21:48.693481  6877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6869f07b5a4885a0b99fbe60c3b175" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 27 candidate_status { last_received { term: 26 index: 14 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:21:48.694275  6877 raft_consensus.cc:2468] T bd6869f07b5a4885a0b99fbe60c3b175 P cd75a17ab2604397adab03bb8b5fd75c [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 26.
I20260709 13:21:48.696400  6772 leader_election.cc:304] T bd6869f07b5a4885a0b99fbe60c3b175 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:21:48.702004 14484 tablet_bootstrap.cc:492] T 3a485a995abc4807b6e511e45419f737 P 7ba59cc884714e8aa5f3f0ecaed84cbb: Bootstrap starting.
I20260709 13:21:48.703621 14439 raft_consensus.cc:2804] T bd6869f07b5a4885a0b99fbe60c3b175 P b7ab4784c7344b939bc36f639286f377 [term 26 FOLLOWER]: Leader pre-election won for term 27
I20260709 13:21:48.704193 14439 raft_consensus.cc:493] T bd6869f07b5a4885a0b99fbe60c3b175 P b7ab4784c7344b939bc36f639286f377 [term 26 FOLLOWER]: Starting leader election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:21:48.704627 14439 raft_consensus.cc:3060] T bd6869f07b5a4885a0b99fbe60c3b175 P b7ab4784c7344b939bc36f639286f377 [term 26 FOLLOWER]: Advancing to term 27
I20260709 13:21:48.710402 14487 raft_consensus.cc:493] T bb3d8792045a4583ae2e965b1350a5b4 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 19 FOLLOWER]: Starting pre-election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:21:48.711316 14487 raft_consensus.cc:515] T bb3d8792045a4583ae2e965b1350a5b4 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:21:48.713589 14439 raft_consensus.cc:515] T bd6869f07b5a4885a0b99fbe60c3b175 P b7ab4784c7344b939bc36f639286f377 [term 27 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:48.715377 14452 raft_consensus.cc:493] T 711ef6523deb4cbe8ef2ba61e1c21c98 P b7ab4784c7344b939bc36f639286f377 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:21:48.715898 14452 raft_consensus.cc:515] T 711ef6523deb4cbe8ef2ba61e1c21c98 P b7ab4784c7344b939bc36f639286f377 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:48.720341  6874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6869f07b5a4885a0b99fbe60c3b175" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 27 candidate_status { last_received { term: 26 index: 14 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:21:48.720677  6872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "711ef6523deb4cbe8ef2ba61e1c21c98" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:21:48.782510  6874 raft_consensus.cc:3060] T bd6869f07b5a4885a0b99fbe60c3b175 P cd75a17ab2604397adab03bb8b5fd75c [term 26 FOLLOWER]: Advancing to term 27
I20260709 13:21:48.732510 14369 raft_consensus.cc:493] T 7c44c4849aa54f2b94d1f1bef9ed546f P b7ab4784c7344b939bc36f639286f377 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
W20260709 13:21:48.741596  7468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 103214us
W20260709 13:21:48.723285  7466 leader_election.cc:336] T bb3d8792045a4583ae2e965b1350a5b4 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111)
W20260709 13:21:48.784690  7466 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 61435.1us
I20260709 13:21:48.784756  7468 leader_election.cc:304] T 4b8cacb381b746da8d0049b0a83b41dd P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:21:48.717975 14452 leader_election.cc:290] T 711ef6523deb4cbe8ef2ba61e1c21c98 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:21:48.789839 14462 raft_consensus.cc:2749] T 4b8cacb381b746da8d0049b0a83b41dd P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 22 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:21:48.755671 14461 raft_consensus.cc:493] T d33d5ee8ef6f415593d8df52063161ad P b7ab4784c7344b939bc36f639286f377 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:21:48.792585 14461 raft_consensus.cc:515] T d33d5ee8ef6f415593d8df52063161ad P b7ab4784c7344b939bc36f639286f377 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:48.783421 14369 raft_consensus.cc:515] T 7c44c4849aa54f2b94d1f1bef9ed546f P b7ab4784c7344b939bc36f639286f377 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:48.794557 14487 leader_election.cc:290] T bb3d8792045a4583ae2e965b1350a5b4 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:21:48.796461 14369 leader_election.cc:290] T 7c44c4849aa54f2b94d1f1bef9ed546f P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:21:48.794544 14461 leader_election.cc:290] T d33d5ee8ef6f415593d8df52063161ad P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:21:48.797982 14490 raft_consensus.cc:493] T dbdf895bba214ff68685a24fd17dfb5d P b7ab4784c7344b939bc36f639286f377 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:21:48.798677 14490 raft_consensus.cc:515] T dbdf895bba214ff68685a24fd17dfb5d P b7ab4784c7344b939bc36f639286f377 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:48.804210 14490 leader_election.cc:290] T dbdf895bba214ff68685a24fd17dfb5d P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
W20260709 13:21:48.805840  7466 consensus_peers.cc:597] T be1a92657f494cac8dd227d152f50151 P 7ba59cc884714e8aa5f3f0ecaed84cbb -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:21:48.785835  6844 consensus_peers.cc:597] T 95a75bfe094d4bdc963aba3f08dfcd25 P cd75a17ab2604397adab03bb8b5fd75c -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:21:48.733896 14486 raft_consensus.cc:493] T 1528ab62b6fe4e3099d08f141afee116 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 19 FOLLOWER]: Starting pre-election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:21:48.716005 14439 leader_election.cc:290] T bd6869f07b5a4885a0b99fbe60c3b175 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 27 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:21:48.808501 14486 raft_consensus.cc:515] T 1528ab62b6fe4e3099d08f141afee116 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
W20260709 13:21:48.780745  6770 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 89845.8us
I20260709 13:21:48.806483  6874 raft_consensus.cc:2468] T bd6869f07b5a4885a0b99fbe60c3b175 P cd75a17ab2604397adab03bb8b5fd75c [term 27 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 27.
W20260709 13:21:48.808166  6844 leader_election.cc:336] T 4b8cacb381b746da8d0049b0a83b41dd P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111)
I20260709 13:21:48.833449  6804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1528ab62b6fe4e3099d08f141afee116" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:21:48.840767  6804 raft_consensus.cc:2468] T 1528ab62b6fe4e3099d08f141afee116 P b7ab4784c7344b939bc36f639286f377 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in term 19.
I20260709 13:21:48.815274  6799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6869f07b5a4885a0b99fbe60c3b175" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 27 candidate_status { last_received { term: 26 index: 14 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:21:48.844437  6806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c37d41cd9164c15a6826ca62a851a69" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:21:48.834503  6624 catalog_manager.cc:5697] T 4b8cacb381b746da8d0049b0a83b41dd P cd75a17ab2604397adab03bb8b5fd75c reported cstate change: term changed from 21 to 22, leader changed from ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65) to cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67). New cstate: current_term: 22 leader_uuid: "cd75a17ab2604397adab03bb8b5fd75c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:48.846917  6799 raft_consensus.cc:2393] T bd6869f07b5a4885a0b99fbe60c3b175 P b7ab4784c7344b939bc36f639286f377 [term 27 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c in current term 27: Already voted for candidate b7ab4784c7344b939bc36f639286f377 in this term.
I20260709 13:21:48.821319 14461 raft_consensus.cc:493] T 7c37d41cd9164c15a6826ca62a851a69 P b7ab4784c7344b939bc36f639286f377 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:21:48.826128 14486 leader_election.cc:290] T 1528ab62b6fe4e3099d08f141afee116 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:21:48.834301 14474 tablet_bootstrap.cc:492] T f3f9c2e2bf644115957398fe4c9459db P 7ba59cc884714e8aa5f3f0ecaed84cbb: Bootstrap starting.
I20260709 13:21:48.818852 14457 raft_consensus.cc:515] T f4b8bd455d5a47c18a1380839c6e0d61 P b7ab4784c7344b939bc36f639286f377 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:48.846238  6803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4b8bd455d5a47c18a1380839c6e0d61" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:21:48.850243  6799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3411566abe2d4c9bb4b2adfdd05e6f17" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:21:48.856194  6799 raft_consensus.cc:2468] T 3411566abe2d4c9bb4b2adfdd05e6f17 P b7ab4784c7344b939bc36f639286f377 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 20.
I20260709 13:21:48.857573  6798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d33d5ee8ef6f415593d8df52063161ad" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:21:48.858263  6798 raft_consensus.cc:2468] T d33d5ee8ef6f415593d8df52063161ad P b7ab4784c7344b939bc36f639286f377 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 20.
I20260709 13:21:48.858361  6803 raft_consensus.cc:2393] T f4b8bd455d5a47c18a1380839c6e0d61 P b7ab4784c7344b939bc36f639286f377 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c in current term 22: Already voted for candidate b7ab4784c7344b939bc36f639286f377 in this term.
I20260709 13:21:48.857229  7466 leader_election.cc:304] T 1528ab62b6fe4e3099d08f141afee116 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, b7ab4784c7344b939bc36f639286f377; no voters: 
I20260709 13:21:48.861812  6874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe20b4b48823486ca3b9c648db6ce8aa" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:21:48.862519  6874 raft_consensus.cc:3060] T fe20b4b48823486ca3b9c648db6ce8aa P cd75a17ab2604397adab03bb8b5fd75c [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:21:48.864339  6877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3d8792045a4583ae2e965b1350a5b4" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:21:48.805917 14465 raft_consensus.cc:515] T d8292e16e5654be6bc408560cf256aaa P b7ab4784c7344b939bc36f639286f377 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:48.865150  6877 raft_consensus.cc:2468] T bb3d8792045a4583ae2e965b1350a5b4 P cd75a17ab2604397adab03bb8b5fd75c [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in term 19.
I20260709 13:21:48.866981 14465 leader_election.cc:290] T d8292e16e5654be6bc408560cf256aaa P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 22 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
W20260709 13:21:48.873584  7466 leader_election.cc:336] T 1528ab62b6fe4e3099d08f141afee116 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111)
W20260709 13:21:48.877990  6844 consensus_peers.cc:597] T 44bde925b2e541b69890d70715b85176 P cd75a17ab2604397adab03bb8b5fd75c -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:21:48.878366  6772 leader_election.cc:304] T bd6869f07b5a4885a0b99fbe60c3b175 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 27 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
W20260709 13:21:48.878567  6844 leader_election.cc:336] T 3411566abe2d4c9bb4b2adfdd05e6f17 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111)
I20260709 13:21:48.879423 14439 raft_consensus.cc:2804] T bd6869f07b5a4885a0b99fbe60c3b175 P b7ab4784c7344b939bc36f639286f377 [term 27 FOLLOWER]: Leader election won for term 27
W20260709 13:21:48.879288  6844 leader_election.cc:336] T 4b8cacb381b746da8d0049b0a83b41dd P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 22 election: RPC error from VoteRequest() call to peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111)
I20260709 13:21:48.881136 14439 raft_consensus.cc:697] T bd6869f07b5a4885a0b99fbe60c3b175 P b7ab4784c7344b939bc36f639286f377 [term 27 LEADER]: Becoming Leader. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
I20260709 13:21:48.882707  6798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbdf895bba214ff68685a24fd17dfb5d" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 21 candidate_status { last_received { term: 20 index: 9 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:21:48.883404  6798 raft_consensus.cc:2468] T dbdf895bba214ff68685a24fd17dfb5d P b7ab4784c7344b939bc36f639286f377 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 20.
I20260709 13:21:48.884717  6877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d33d5ee8ef6f415593d8df52063161ad" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:21:48.885376  6877 raft_consensus.cc:2468] T d33d5ee8ef6f415593d8df52063161ad P cd75a17ab2604397adab03bb8b5fd75c [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 20.
I20260709 13:21:48.885430  6872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c44c4849aa54f2b94d1f1bef9ed546f" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:21:48.885826  6881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbdf895bba214ff68685a24fd17dfb5d" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 21 candidate_status { last_received { term: 20 index: 9 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
W20260709 13:21:48.886374  7466 consensus_peers.cc:597] T 3fa34c08b205435dba97346991aa1f92 P 7ba59cc884714e8aa5f3f0ecaed84cbb -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:21:48.886458  6881 raft_consensus.cc:2468] T dbdf895bba214ff68685a24fd17dfb5d P cd75a17ab2604397adab03bb8b5fd75c [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 20.
I20260709 13:21:48.856117 14461 raft_consensus.cc:515] T 7c37d41cd9164c15a6826ca62a851a69 P b7ab4784c7344b939bc36f639286f377 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:48.888520  6806 raft_consensus.cc:2468] T 7c37d41cd9164c15a6826ca62a851a69 P b7ab4784c7344b939bc36f639286f377 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 22.
I20260709 13:21:48.889752 14461 leader_election.cc:290] T 7c37d41cd9164c15a6826ca62a851a69 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:21:48.873469 14462 raft_consensus.cc:2804] T 1528ab62b6fe4e3099d08f141afee116 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:21:48.890504 14462 raft_consensus.cc:493] T 1528ab62b6fe4e3099d08f141afee116 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 19 FOLLOWER]: Starting leader election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:21:48.891134 14462 raft_consensus.cc:3060] T 1528ab62b6fe4e3099d08f141afee116 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:21:48.894081 14457 leader_election.cc:290] T f4b8bd455d5a47c18a1380839c6e0d61 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 22 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:21:48.894044  6874 raft_consensus.cc:2468] T fe20b4b48823486ca3b9c648db6ce8aa P cd75a17ab2604397adab03bb8b5fd75c [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in term 17.
I20260709 13:21:48.902406  7468 leader_election.cc:304] T bb3d8792045a4583ae2e965b1350a5b4 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, cd75a17ab2604397adab03bb8b5fd75c; no voters: ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:21:48.906800  6772 leader_election.cc:304] T d33d5ee8ef6f415593d8df52063161ad P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:21:48.907877 14490 raft_consensus.cc:2804] T d33d5ee8ef6f415593d8df52063161ad P b7ab4784c7344b939bc36f639286f377 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:21:48.908340 14490 raft_consensus.cc:493] T d33d5ee8ef6f415593d8df52063161ad P b7ab4784c7344b939bc36f639286f377 [term 20 FOLLOWER]: Starting leader election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:21:48.908706 14490 raft_consensus.cc:3060] T d33d5ee8ef6f415593d8df52063161ad P b7ab4784c7344b939bc36f639286f377 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:21:48.882202 14439 consensus_queue.cc:237] T bd6869f07b5a4885a0b99fbe60c3b175 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 26.14, Last appended by leader: 14, Current term: 27, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:48.916414 14487 raft_consensus.cc:2804] T bb3d8792045a4583ae2e965b1350a5b4 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:21:48.916947 14487 raft_consensus.cc:493] T bb3d8792045a4583ae2e965b1350a5b4 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 19 FOLLOWER]: Starting leader election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:21:48.917342 14487 raft_consensus.cc:3060] T bb3d8792045a4583ae2e965b1350a5b4 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:21:48.923094 14462 raft_consensus.cc:515] T 1528ab62b6fe4e3099d08f141afee116 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 20 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:21:48.930873 14462 leader_election.cc:290] T 1528ab62b6fe4e3099d08f141afee116 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 20 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:21:48.933562  6806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1528ab62b6fe4e3099d08f141afee116" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:21:48.934248  6806 raft_consensus.cc:3060] T 1528ab62b6fe4e3099d08f141afee116 P b7ab4784c7344b939bc36f639286f377 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:21:48.943131  6806 raft_consensus.cc:2468] T 1528ab62b6fe4e3099d08f141afee116 P b7ab4784c7344b939bc36f639286f377 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in term 20.
I20260709 13:21:48.945832  6872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4b8bd455d5a47c18a1380839c6e0d61" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:21:48.946074  6881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c37d41cd9164c15a6826ca62a851a69" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:21:48.946542  6872 raft_consensus.cc:3060] T f4b8bd455d5a47c18a1380839c6e0d61 P cd75a17ab2604397adab03bb8b5fd75c [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:21:48.946744  6881 raft_consensus.cc:2468] T 7c37d41cd9164c15a6826ca62a851a69 P cd75a17ab2604397adab03bb8b5fd75c [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 22.
I20260709 13:21:48.945384  6874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8292e16e5654be6bc408560cf256aaa" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:21:48.947714  6874 raft_consensus.cc:3060] T d8292e16e5654be6bc408560cf256aaa P cd75a17ab2604397adab03bb8b5fd75c [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:21:48.955116 14482 raft_consensus.cc:493] T 711ef6523deb4cbe8ef2ba61e1c21c98 P cd75a17ab2604397adab03bb8b5fd75c [term 21 FOLLOWER]: Starting pre-election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:21:48.955773 14482 raft_consensus.cc:515] T 711ef6523deb4cbe8ef2ba61e1c21c98 P cd75a17ab2604397adab03bb8b5fd75c [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:48.957945 14482 leader_election.cc:290] T 711ef6523deb4cbe8ef2ba61e1c21c98 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:21:48.959018  6872 raft_consensus.cc:2468] T f4b8bd455d5a47c18a1380839c6e0d61 P cd75a17ab2604397adab03bb8b5fd75c [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 22.
I20260709 13:21:48.961746 14484 tablet_bootstrap.cc:492] T 3a485a995abc4807b6e511e45419f737 P 7ba59cc884714e8aa5f3f0ecaed84cbb: Bootstrap replayed 1/1 log segments. Stats: ops{read=13 overwritten=2 applied=11 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:21:48.962918 14484 tablet_bootstrap.cc:492] T 3a485a995abc4807b6e511e45419f737 P 7ba59cc884714e8aa5f3f0ecaed84cbb: Bootstrap complete.
W20260709 13:21:48.963258  6772 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 56551.6us
I20260709 13:21:48.966639  6772 leader_election.cc:304] T dbdf895bba214ff68685a24fd17dfb5d P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:21:48.965364  7468 leader_election.cc:304] T fe20b4b48823486ca3b9c648db6ce8aa P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, cd75a17ab2604397adab03bb8b5fd75c; no voters: ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:21:48.969483 14400 raft_consensus.cc:2804] T fe20b4b48823486ca3b9c648db6ce8aa P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:21:48.970085 14400 raft_consensus.cc:697] T fe20b4b48823486ca3b9c648db6ce8aa P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 17 LEADER]: Becoming Leader. State: Replica: 7ba59cc884714e8aa5f3f0ecaed84cbb, State: Running, Role: LEADER
I20260709 13:21:48.970248 14465 raft_consensus.cc:2804] T dbdf895bba214ff68685a24fd17dfb5d P b7ab4784c7344b939bc36f639286f377 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:21:48.970780 14465 raft_consensus.cc:493] T dbdf895bba214ff68685a24fd17dfb5d P b7ab4784c7344b939bc36f639286f377 [term 20 FOLLOWER]: Starting leader election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:21:48.971180 14465 raft_consensus.cc:3060] T dbdf895bba214ff68685a24fd17dfb5d P b7ab4784c7344b939bc36f639286f377 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:21:48.971074 14400 consensus_queue.cc:237] T fe20b4b48823486ca3b9c648db6ce8aa P 7ba59cc884714e8aa5f3f0ecaed84cbb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
W20260709 13:21:48.965502  6844 leader_election.cc:336] T bd6869f07b5a4885a0b99fbe60c3b175 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111)
W20260709 13:21:48.973434  6844 leader_election.cc:336] T f4b8bd455d5a47c18a1380839c6e0d61 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111)
W20260709 13:21:49.002942  6844 leader_election.cc:336] T 7c37d41cd9164c15a6826ca62a851a69 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111)
I20260709 13:21:48.965338  6874 raft_consensus.cc:2468] T d8292e16e5654be6bc408560cf256aaa P cd75a17ab2604397adab03bb8b5fd75c [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 22.
I20260709 13:21:48.967747 14487 raft_consensus.cc:515] T bb3d8792045a4583ae2e965b1350a5b4 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:21:48.963723 14484 ts_tablet_manager.cc:1403] T 3a485a995abc4807b6e511e45419f737 P 7ba59cc884714e8aa5f3f0ecaed84cbb: Time spent bootstrapping tablet: real 0.262s	user 0.049s	sys 0.008s
I20260709 13:21:49.001754 14490 raft_consensus.cc:515] T d33d5ee8ef6f415593d8df52063161ad P b7ab4784c7344b939bc36f639286f377 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:48.997273  7466 leader_election.cc:304] T 1528ab62b6fe4e3099d08f141afee116 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, b7ab4784c7344b939bc36f639286f377; no voters: 
W20260709 13:21:48.967324  6770 leader_election.cc:336] T 3411566abe2d4c9bb4b2adfdd05e6f17 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111)
I20260709 13:21:49.011175 14486 raft_consensus.cc:2804] T 1528ab62b6fe4e3099d08f141afee116 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:21:49.011518  6770 leader_election.cc:304] T 3411566abe2d4c9bb4b2adfdd05e6f17 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:21:49.012488 14452 raft_consensus.cc:2749] T 3411566abe2d4c9bb4b2adfdd05e6f17 P b7ab4784c7344b939bc36f639286f377 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 13:21:49.014246  6770 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 46950.5us
W20260709 13:21:49.015972  6770 consensus_peers.cc:597] T 4275cf08e63345f993bce8664eada830 P b7ab4784c7344b939bc36f639286f377 -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:21:49.016554  6770 leader_election.cc:336] T a3022224cc81473690653a83d4e99470 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111)
I20260709 13:21:49.028241  6770 leader_election.cc:304] T a3022224cc81473690653a83d4e99470 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:21:49.009155  6772 leader_election.cc:304] T 7c37d41cd9164c15a6826ca62a851a69 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:21:49.033260  6772 leader_election.cc:304] T f4b8bd455d5a47c18a1380839c6e0d61 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:21:49.036554 14452 raft_consensus.cc:2804] T 7c37d41cd9164c15a6826ca62a851a69 P b7ab4784c7344b939bc36f639286f377 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:21:49.037115 14452 raft_consensus.cc:493] T 7c37d41cd9164c15a6826ca62a851a69 P b7ab4784c7344b939bc36f639286f377 [term 22 FOLLOWER]: Starting leader election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:21:49.037511 14452 raft_consensus.cc:3060] T 7c37d41cd9164c15a6826ca62a851a69 P b7ab4784c7344b939bc36f639286f377 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:21:49.038229  6772 leader_election.cc:304] T d8292e16e5654be6bc408560cf256aaa P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:21:49.039325 14439 raft_consensus.cc:2804] T f4b8bd455d5a47c18a1380839c6e0d61 P b7ab4784c7344b939bc36f639286f377 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:21:49.041857 14487 leader_election.cc:290] T bb3d8792045a4583ae2e965b1350a5b4 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 20 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:21:49.039893 14461 raft_consensus.cc:2804] T d8292e16e5654be6bc408560cf256aaa P b7ab4784c7344b939bc36f639286f377 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:21:49.042030 14439 raft_consensus.cc:697] T f4b8bd455d5a47c18a1380839c6e0d61 P b7ab4784c7344b939bc36f639286f377 [term 22 LEADER]: Becoming Leader. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
I20260709 13:21:49.042682 14461 raft_consensus.cc:697] T d8292e16e5654be6bc408560cf256aaa P b7ab4784c7344b939bc36f639286f377 [term 22 LEADER]: Becoming Leader. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
I20260709 13:21:49.043979 14461 consensus_queue.cc:237] T d8292e16e5654be6bc408560cf256aaa P b7ab4784c7344b939bc36f639286f377 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 21.12, Last appended by leader: 12, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:49.013598 14484 raft_consensus.cc:359] T 3a485a995abc4807b6e511e45419f737 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 17 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } attrs { replace: true } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: NON_VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: true } }
I20260709 13:21:49.045897 14484 raft_consensus.cc:740] T 3a485a995abc4807b6e511e45419f737 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 17 LEARNER]: Becoming Follower/Learner. State: Replica: 7ba59cc884714e8aa5f3f0ecaed84cbb, State: Initialized, Role: LEARNER
I20260709 13:21:49.047343 14482 raft_consensus.cc:493] T e77e330a82df4b43a745d57a68f6f057 P cd75a17ab2604397adab03bb8b5fd75c [term 19 FOLLOWER]: Starting pre-election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:21:49.048002 14482 raft_consensus.cc:515] T e77e330a82df4b43a745d57a68f6f057 P cd75a17ab2604397adab03bb8b5fd75c [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } }
I20260709 13:21:48.994755 14465 raft_consensus.cc:515] T dbdf895bba214ff68685a24fd17dfb5d P b7ab4784c7344b939bc36f639286f377 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:49.029814 14490 leader_election.cc:290] T d33d5ee8ef6f415593d8df52063161ad P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 21 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
W20260709 13:21:49.053310  7466 leader_election.cc:336] T 1528ab62b6fe4e3099d08f141afee116 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 20 election: RPC error from VoteRequest() call to peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111)
W20260709 13:21:49.052557  6770 consensus_peers.cc:597] T 2c240553ce044eedb41541d72b9475d7 P b7ab4784c7344b939bc36f639286f377 -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:21:49.061218  6770 consensus_peers.cc:597] T 07a92dd554674067a83a9cb68c4773f2 P b7ab4784c7344b939bc36f639286f377 -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:21:49.061501  6874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3d8792045a4583ae2e965b1350a5b4" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:21:49.064088  6624 catalog_manager.cc:5697] T bd6869f07b5a4885a0b99fbe60c3b175 P b7ab4784c7344b939bc36f639286f377 reported cstate change: term changed from 26 to 27, leader changed from ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65) to b7ab4784c7344b939bc36f639286f377 (127.5.126.66). New cstate: current_term: 27 leader_uuid: "b7ab4784c7344b939bc36f639286f377" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:49.066543  6872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d33d5ee8ef6f415593d8df52063161ad" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:21:49.067176  6872 raft_consensus.cc:3060] T d33d5ee8ef6f415593d8df52063161ad P cd75a17ab2604397adab03bb8b5fd75c [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:21:49.067409 14492 raft_consensus.cc:2749] T a3022224cc81473690653a83d4e99470 P b7ab4784c7344b939bc36f639286f377 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:21:49.058768 14464 raft_consensus.cc:493] T 7c44c4849aa54f2b94d1f1bef9ed546f P cd75a17ab2604397adab03bb8b5fd75c [term 23 FOLLOWER]: Starting pre-election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:21:49.068619 14464 raft_consensus.cc:515] T 7c44c4849aa54f2b94d1f1bef9ed546f P cd75a17ab2604397adab03bb8b5fd75c [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:49.051724 14482 leader_election.cc:290] T e77e330a82df4b43a745d57a68f6f057 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391)
I20260709 13:21:49.073882  6622 catalog_manager.cc:5697] T fe20b4b48823486ca3b9c648db6ce8aa P 7ba59cc884714e8aa5f3f0ecaed84cbb reported cstate change: term changed from 16 to 17, leader changed from ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65) to 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68). New cstate: current_term: 17 leader_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:21:49.063050  6874 raft_consensus.cc:3060] T bb3d8792045a4583ae2e965b1350a5b4 P cd75a17ab2604397adab03bb8b5fd75c [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:21:49.051625 14439 consensus_queue.cc:237] T f4b8bd455d5a47c18a1380839c6e0d61 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 21.11, Last appended by leader: 11, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:49.046662 14484 consensus_queue.cc:260] T 3a485a995abc4807b6e511e45419f737 P 7ba59cc884714e8aa5f3f0ecaed84cbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } attrs { replace: true } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: NON_VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: true } }
I20260709 13:21:49.083982  6872 raft_consensus.cc:2468] T d33d5ee8ef6f415593d8df52063161ad P cd75a17ab2604397adab03bb8b5fd75c [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 21.
I20260709 13:21:49.099031 14465 leader_election.cc:290] T dbdf895bba214ff68685a24fd17dfb5d P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 21 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:21:49.086691 14452 raft_consensus.cc:515] T 7c37d41cd9164c15a6826ca62a851a69 P b7ab4784c7344b939bc36f639286f377 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:49.119505 14452 leader_election.cc:290] T 7c37d41cd9164c15a6826ca62a851a69 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 23 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:21:49.097009 14464 leader_election.cc:290] T 7c44c4849aa54f2b94d1f1bef9ed546f P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
W20260709 13:21:49.112625  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 48527.8us
W20260709 13:21:49.120904  6844 leader_election.cc:336] T d33d5ee8ef6f415593d8df52063161ad P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111)
W20260709 13:21:49.121775  6844 leader_election.cc:336] T bb3d8792045a4583ae2e965b1350a5b4 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111)
I20260709 13:21:49.107034 14484 ts_tablet_manager.cc:1434] T 3a485a995abc4807b6e511e45419f737 P 7ba59cc884714e8aa5f3f0ecaed84cbb: Time spent starting tablet: real 0.101s	user 0.009s	sys 0.000s
I20260709 13:21:49.124969  6881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c37d41cd9164c15a6826ca62a851a69" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:21:49.125906  6881 raft_consensus.cc:3060] T 7c37d41cd9164c15a6826ca62a851a69 P cd75a17ab2604397adab03bb8b5fd75c [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:21:49.131362  6877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbdf895bba214ff68685a24fd17dfb5d" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 21 candidate_status { last_received { term: 20 index: 9 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:21:49.132056  6877 raft_consensus.cc:3060] T dbdf895bba214ff68685a24fd17dfb5d P cd75a17ab2604397adab03bb8b5fd75c [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:21:49.122418  6844 leader_election.cc:304] T bb3d8792045a4583ae2e965b1350a5b4 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, ccd8a4c3bfe3413cb2ae219b09aea832
W20260709 13:21:49.140522  7466 leader_election.cc:336] T bb3d8792045a4583ae2e965b1350a5b4 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 20 election: RPC error from VoteRequest() call to peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111)
W20260709 13:21:49.112125  6770 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 50885.6us
I20260709 13:21:49.145498  6874 raft_consensus.cc:2468] T bb3d8792045a4583ae2e965b1350a5b4 P cd75a17ab2604397adab03bb8b5fd75c [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in term 20.
W20260709 13:21:49.143020  6844 leader_election.cc:336] T dbdf895bba214ff68685a24fd17dfb5d P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111)
W20260709 13:21:49.146588  6844 consensus_peers.cc:597] T f58dc08b12a2494bb9a1372837970ca2 P cd75a17ab2604397adab03bb8b5fd75c -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:21:49.114684 14486 raft_consensus.cc:697] T 1528ab62b6fe4e3099d08f141afee116 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 20 LEADER]: Becoming Leader. State: Replica: 7ba59cc884714e8aa5f3f0ecaed84cbb, State: Running, Role: LEADER
I20260709 13:21:49.152525  6772 leader_election.cc:304] T d33d5ee8ef6f415593d8df52063161ad P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:21:49.158746 14463 raft_consensus.cc:493] T a3022224cc81473690653a83d4e99470 P cd75a17ab2604397adab03bb8b5fd75c [term 21 FOLLOWER]: Starting pre-election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:21:49.161676 14463 raft_consensus.cc:515] T a3022224cc81473690653a83d4e99470 P cd75a17ab2604397adab03bb8b5fd75c [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:49.163942 14463 leader_election.cc:290] T a3022224cc81473690653a83d4e99470 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:21:49.159363  6877 raft_consensus.cc:2468] T dbdf895bba214ff68685a24fd17dfb5d P cd75a17ab2604397adab03bb8b5fd75c [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 21.
I20260709 13:21:49.159399  6881 raft_consensus.cc:2468] T 7c37d41cd9164c15a6826ca62a851a69 P cd75a17ab2604397adab03bb8b5fd75c [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 23.
I20260709 13:21:49.166522 14490 raft_consensus.cc:2804] T d33d5ee8ef6f415593d8df52063161ad P b7ab4784c7344b939bc36f639286f377 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:21:49.167167 14490 raft_consensus.cc:697] T d33d5ee8ef6f415593d8df52063161ad P b7ab4784c7344b939bc36f639286f377 [term 21 LEADER]: Becoming Leader. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
I20260709 13:21:49.168114 14490 consensus_queue.cc:237] T d33d5ee8ef6f415593d8df52063161ad P b7ab4784c7344b939bc36f639286f377 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 20.11, Last appended by leader: 11, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:49.150285 14482 raft_consensus.cc:2749] T bb3d8792045a4583ae2e965b1350a5b4 P cd75a17ab2604397adab03bb8b5fd75c [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:21:49.169337  6772 leader_election.cc:304] T dbdf895bba214ff68685a24fd17dfb5d P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:21:49.170444  6772 leader_election.cc:304] T 7c37d41cd9164c15a6826ca62a851a69 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:21:49.170928 14369 raft_consensus.cc:2804] T dbdf895bba214ff68685a24fd17dfb5d P b7ab4784c7344b939bc36f639286f377 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:21:49.160169  6817 tablet_copy_service.cc:342] P b7ab4784c7344b939bc36f639286f377: Request end of tablet copy session 7ba59cc884714e8aa5f3f0ecaed84cbb-3a485a995abc4807b6e511e45419f737 received from {username='slave'} at 127.0.0.1:50550
W20260709 13:21:49.160485  6844 leader_election.cc:336] T 711ef6523deb4cbe8ef2ba61e1c21c98 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111)
I20260709 13:21:49.178818  6844 leader_election.cc:304] T bd6869f07b5a4885a0b99fbe60c3b175 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:21:49.181111  6844 leader_election.cc:304] T 3411566abe2d4c9bb4b2adfdd05e6f17 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:21:49.179603  6817 tablet_copy_service.cc:434] P b7ab4784c7344b939bc36f639286f377: ending tablet copy session 7ba59cc884714e8aa5f3f0ecaed84cbb-3a485a995abc4807b6e511e45419f737 on tablet 3a485a995abc4807b6e511e45419f737 with peer 7ba59cc884714e8aa5f3f0ecaed84cbb
I20260709 13:21:49.176937 14461 raft_consensus.cc:2804] T 7c37d41cd9164c15a6826ca62a851a69 P b7ab4784c7344b939bc36f639286f377 [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:21:49.183565 14461 raft_consensus.cc:697] T 7c37d41cd9164c15a6826ca62a851a69 P b7ab4784c7344b939bc36f639286f377 [term 23 LEADER]: Becoming Leader. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
I20260709 13:21:49.183007 14486 consensus_queue.cc:237] T 1528ab62b6fe4e3099d08f141afee116 P 7ba59cc884714e8aa5f3f0ecaed84cbb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.14, Last appended by leader: 14, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:21:49.184055 14437 raft_consensus.cc:2749] T bd6869f07b5a4885a0b99fbe60c3b175 P cd75a17ab2604397adab03bb8b5fd75c [term 27 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 13:21:49.184578 14461 consensus_queue.cc:237] T 7c37d41cd9164c15a6826ca62a851a69 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 22.15, Last appended by leader: 15, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:49.186985  7495 raft_consensus.cc:1275] T 4b8cacb381b746da8d0049b0a83b41dd P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 22 FOLLOWER]: Refusing update from remote peer cd75a17ab2604397adab03bb8b5fd75c: Log matching property violated. Preceding OpId in replica: term: 21 index: 16. Preceding OpId from leader: term: 22 index: 17. (index mismatch)
I20260709 13:21:49.187400  7468 leader_election.cc:304] T bb3d8792045a4583ae2e965b1350a5b4 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, cd75a17ab2604397adab03bb8b5fd75c; no voters: ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:21:49.193496 14487 raft_consensus.cc:2804] T bb3d8792045a4583ae2e965b1350a5b4 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:21:49.194108 14487 raft_consensus.cc:697] T bb3d8792045a4583ae2e965b1350a5b4 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 20 LEADER]: Becoming Leader. State: Replica: 7ba59cc884714e8aa5f3f0ecaed84cbb, State: Running, Role: LEADER
I20260709 13:21:49.195003 14487 consensus_queue.cc:237] T bb3d8792045a4583ae2e965b1350a5b4 P 7ba59cc884714e8aa5f3f0ecaed84cbb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 19.16, Last appended by leader: 16, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:21:49.200544 14437 raft_consensus.cc:2804] T 3411566abe2d4c9bb4b2adfdd05e6f17 P cd75a17ab2604397adab03bb8b5fd75c [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:21:49.201313 14437 raft_consensus.cc:493] T 3411566abe2d4c9bb4b2adfdd05e6f17 P cd75a17ab2604397adab03bb8b5fd75c [term 20 FOLLOWER]: Starting leader election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:21:49.192214 14482 consensus_queue.cc:1048] T 4b8cacb381b746da8d0049b0a83b41dd P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.010s
I20260709 13:21:49.202021 14437 raft_consensus.cc:3060] T 3411566abe2d4c9bb4b2adfdd05e6f17 P cd75a17ab2604397adab03bb8b5fd75c [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:21:49.208297  6844 leader_election.cc:304] T d33d5ee8ef6f415593d8df52063161ad P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:21:49.209226 14482 raft_consensus.cc:2764] T d33d5ee8ef6f415593d8df52063161ad P cd75a17ab2604397adab03bb8b5fd75c [term 21 FOLLOWER]: Leader pre-election decision vote started in defunct term 20: won
I20260709 13:21:49.209774  6844 leader_election.cc:304] T f4b8bd455d5a47c18a1380839c6e0d61 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:21:49.210815 14482 raft_consensus.cc:2749] T f4b8bd455d5a47c18a1380839c6e0d61 P cd75a17ab2604397adab03bb8b5fd75c [term 22 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 13:21:49.226339  6844 leader_election.cc:336] T e77e330a82df4b43a745d57a68f6f057 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111)
W20260709 13:21:49.230906  6844 leader_election.cc:336] T 7c44c4849aa54f2b94d1f1bef9ed546f P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111)
W20260709 13:21:49.233151  6844 consensus_peers.cc:597] T 4b8cacb381b746da8d0049b0a83b41dd P cd75a17ab2604397adab03bb8b5fd75c -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:49.242905 14369 raft_consensus.cc:697] T dbdf895bba214ff68685a24fd17dfb5d P b7ab4784c7344b939bc36f639286f377 [term 21 LEADER]: Becoming Leader. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
W20260709 13:21:49.298478  5625 thread.cc:527] Waited for 1000ms trying to join with diag-logger (tid 6753)
I20260709 13:21:49.304775  6624 catalog_manager.cc:5697] T f4b8bd455d5a47c18a1380839c6e0d61 P b7ab4784c7344b939bc36f639286f377 reported cstate change: term changed from 21 to 22, leader changed from ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65) to b7ab4784c7344b939bc36f639286f377 (127.5.126.66). New cstate: current_term: 22 leader_uuid: "b7ab4784c7344b939bc36f639286f377" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:49.308983  6624 catalog_manager.cc:5697] T d8292e16e5654be6bc408560cf256aaa P b7ab4784c7344b939bc36f639286f377 reported cstate change: term changed from 21 to 22, leader changed from ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65) to b7ab4784c7344b939bc36f639286f377 (127.5.126.66). New cstate: current_term: 22 leader_uuid: "b7ab4784c7344b939bc36f639286f377" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:49.326289 14457 raft_consensus.cc:493] T e77e330a82df4b43a745d57a68f6f057 P b7ab4784c7344b939bc36f639286f377 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:21:49.327675 14457 raft_consensus.cc:515] T e77e330a82df4b43a745d57a68f6f057 P b7ab4784c7344b939bc36f639286f377 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } }
I20260709 13:21:49.329487 14369 consensus_queue.cc:237] T dbdf895bba214ff68685a24fd17dfb5d P b7ab4784c7344b939bc36f639286f377 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 20.9, Last appended by leader: 9, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:49.332335 14457 leader_election.cc:290] T e77e330a82df4b43a745d57a68f6f057 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931), ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391)
W20260709 13:21:49.451526 14502 log.cc:927] Time spent T 7c37d41cd9164c15a6826ca62a851a69 P b7ab4784c7344b939bc36f639286f377: Append to log took a long time: real 0.183s	user 0.002s	sys 0.000s
W20260709 13:21:49.479740  6770 leader_election.cc:336] T bd6869f07b5a4885a0b99fbe60c3b175 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 27 election: RPC error from VoteRequest() call to peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111)
W20260709 13:21:49.482596  6844 leader_election.cc:336] T a3022224cc81473690653a83d4e99470 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111)
I20260709 13:21:49.489802  6877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77e330a82df4b43a745d57a68f6f057" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:21:49.491068  6877 raft_consensus.cc:2468] T e77e330a82df4b43a745d57a68f6f057 P cd75a17ab2604397adab03bb8b5fd75c [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 19.
W20260709 13:21:49.496798  6770 leader_election.cc:336] T 711ef6523deb4cbe8ef2ba61e1c21c98 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111)
I20260709 13:21:49.498682  6770 leader_election.cc:304] T 711ef6523deb4cbe8ef2ba61e1c21c98 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:21:49.503676  6844 leader_election.cc:304] T dbdf895bba214ff68685a24fd17dfb5d P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:21:49.507270 14461 raft_consensus.cc:2749] T 711ef6523deb4cbe8ef2ba61e1c21c98 P b7ab4784c7344b939bc36f639286f377 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:21:49.509738 14463 raft_consensus.cc:2764] T dbdf895bba214ff68685a24fd17dfb5d P cd75a17ab2604397adab03bb8b5fd75c [term 21 FOLLOWER]: Leader pre-election decision vote started in defunct term 20: won
I20260709 13:21:49.523550  6844 leader_election.cc:304] T 7c37d41cd9164c15a6826ca62a851a69 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:21:49.524856 14463 raft_consensus.cc:2764] T 7c37d41cd9164c15a6826ca62a851a69 P cd75a17ab2604397adab03bb8b5fd75c [term 23 FOLLOWER]: Leader pre-election decision vote started in defunct term 22: won
I20260709 13:21:49.533524  6877 raft_consensus.cc:1275] T fe20b4b48823486ca3b9c648db6ce8aa P cd75a17ab2604397adab03bb8b5fd75c [term 17 FOLLOWER]: Refusing update from remote peer 7ba59cc884714e8aa5f3f0ecaed84cbb: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
W20260709 13:21:49.536818  6844 consensus_peers.cc:597] T 713b5728a197487c9300b310ab94e5a3 P cd75a17ab2604397adab03bb8b5fd75c -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:21:49.542965  6770 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 51504.4us
W20260709 13:21:49.544083  6770 consensus_peers.cc:597] T 7887766dc6784fcaa42b35c05fea7a99 P b7ab4784c7344b939bc36f639286f377 -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:21:49.544669  6770 leader_election.cc:336] T d33d5ee8ef6f415593d8df52063161ad P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111)
W20260709 13:21:49.546001  6770 leader_election.cc:336] T 7c44c4849aa54f2b94d1f1bef9ed546f P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111)
I20260709 13:21:49.546753  6770 leader_election.cc:304] T 7c44c4849aa54f2b94d1f1bef9ed546f P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:21:49.545867 14486 consensus_queue.cc:1048] T fe20b4b48823486ca3b9c648db6ce8aa P 7ba59cc884714e8aa5f3f0ecaed84cbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.002s
I20260709 13:21:49.555248  6881 raft_consensus.cc:1275] T d8292e16e5654be6bc408560cf256aaa P cd75a17ab2604397adab03bb8b5fd75c [term 22 FOLLOWER]: Refusing update from remote peer b7ab4784c7344b939bc36f639286f377: Log matching property violated. Preceding OpId in replica: term: 21 index: 12. Preceding OpId from leader: term: 22 index: 13. (index mismatch)
I20260709 13:21:49.559937  6624 catalog_manager.cc:5697] T 1528ab62b6fe4e3099d08f141afee116 P 7ba59cc884714e8aa5f3f0ecaed84cbb reported cstate change: term changed from 19 to 20, leader changed from ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65) to 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68). New cstate: current_term: 20 leader_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:21:49.554991 14437 raft_consensus.cc:515] T 3411566abe2d4c9bb4b2adfdd05e6f17 P cd75a17ab2604397adab03bb8b5fd75c [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:49.578815 14461 raft_consensus.cc:2749] T 7c44c4849aa54f2b94d1f1bef9ed546f P b7ab4784c7344b939bc36f639286f377 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:21:49.585919 14437 leader_election.cc:290] T 3411566abe2d4c9bb4b2adfdd05e6f17 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 21 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:21:49.593901  6874 raft_consensus.cc:1275] T f4b8bd455d5a47c18a1380839c6e0d61 P cd75a17ab2604397adab03bb8b5fd75c [term 22 FOLLOWER]: Refusing update from remote peer b7ab4784c7344b939bc36f639286f377: Log matching property violated. Preceding OpId in replica: term: 21 index: 11. Preceding OpId from leader: term: 22 index: 12. (index mismatch)
I20260709 13:21:49.594627  6772 leader_election.cc:304] T e77e330a82df4b43a745d57a68f6f057 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:21:49.600554  6874 raft_consensus.cc:1275] T 7c37d41cd9164c15a6826ca62a851a69 P cd75a17ab2604397adab03bb8b5fd75c [term 23 FOLLOWER]: Refusing update from remote peer b7ab4784c7344b939bc36f639286f377: Log matching property violated. Preceding OpId in replica: term: 22 index: 15. Preceding OpId from leader: term: 23 index: 16. (index mismatch)
I20260709 13:21:49.601341 14465 raft_consensus.cc:2804] T e77e330a82df4b43a745d57a68f6f057 P b7ab4784c7344b939bc36f639286f377 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:21:49.601832 14465 raft_consensus.cc:493] T e77e330a82df4b43a745d57a68f6f057 P b7ab4784c7344b939bc36f639286f377 [term 19 FOLLOWER]: Starting leader election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:21:49.602216 14465 raft_consensus.cc:3060] T e77e330a82df4b43a745d57a68f6f057 P b7ab4784c7344b939bc36f639286f377 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:21:49.612211 14369 consensus_queue.cc:1048] T f4b8bd455d5a47c18a1380839c6e0d61 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
W20260709 13:21:49.597028  6770 leader_election.cc:336] T dbdf895bba214ff68685a24fd17dfb5d P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111)
W20260709 13:21:49.617553  6844 leader_election.cc:336] T 3411566abe2d4c9bb4b2adfdd05e6f17 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 21 election: RPC error from VoteRequest() call to peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111)
I20260709 13:21:49.612217 14500 consensus_queue.cc:1048] T d8292e16e5654be6bc408560cf256aaa P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.011s
I20260709 13:21:49.623533 14439 consensus_queue.cc:1048] T 7c37d41cd9164c15a6826ca62a851a69 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 13:21:49.650117  6622 catalog_manager.cc:5697] T bb3d8792045a4583ae2e965b1350a5b4 P 7ba59cc884714e8aa5f3f0ecaed84cbb reported cstate change: term changed from 19 to 20, leader changed from ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65) to 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68). New cstate: current_term: 20 leader_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:21:49.673560  6806 raft_consensus.cc:1275] T 1528ab62b6fe4e3099d08f141afee116 P b7ab4784c7344b939bc36f639286f377 [term 20 FOLLOWER]: Refusing update from remote peer 7ba59cc884714e8aa5f3f0ecaed84cbb: Log matching property violated. Preceding OpId in replica: term: 19 index: 14. Preceding OpId from leader: term: 20 index: 15. (index mismatch)
I20260709 13:21:49.681458 14488 consensus_queue.cc:1048] T 1528ab62b6fe4e3099d08f141afee116 P 7ba59cc884714e8aa5f3f0ecaed84cbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
W20260709 13:21:49.713644  6770 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 134084us
I20260709 13:21:49.680436  6624 catalog_manager.cc:5697] T dbdf895bba214ff68685a24fd17dfb5d P b7ab4784c7344b939bc36f639286f377 reported cstate change: term changed from 20 to 21, leader changed from ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65) to b7ab4784c7344b939bc36f639286f377 (127.5.126.66). New cstate: current_term: 21 leader_uuid: "b7ab4784c7344b939bc36f639286f377" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:49.729775  6624 catalog_manager.cc:5697] T 7c37d41cd9164c15a6826ca62a851a69 P b7ab4784c7344b939bc36f639286f377 reported cstate change: term changed from 22 to 23, leader changed from ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65) to b7ab4784c7344b939bc36f639286f377 (127.5.126.66). New cstate: current_term: 23 leader_uuid: "b7ab4784c7344b939bc36f639286f377" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } health_report { overall_health: UNKNOWN } } }
W20260709 13:21:49.737876  7466 consensus_peers.cc:597] T fe20b4b48823486ca3b9c648db6ce8aa P 7ba59cc884714e8aa5f3f0ecaed84cbb -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:49.738528  7466 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 49472.5us
I20260709 13:21:49.741825  6878 raft_consensus.cc:1275] T d33d5ee8ef6f415593d8df52063161ad P cd75a17ab2604397adab03bb8b5fd75c [term 21 FOLLOWER]: Refusing update from remote peer b7ab4784c7344b939bc36f639286f377: Log matching property violated. Preceding OpId in replica: term: 20 index: 11. Preceding OpId from leader: term: 21 index: 12. (index mismatch)
I20260709 13:21:49.743609 14437 raft_consensus.cc:493] T ab432e62819d499eaaf3dd55481dd930 P cd75a17ab2604397adab03bb8b5fd75c [term 25 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:21:49.744516 14437 raft_consensus.cc:515] T ab432e62819d499eaaf3dd55481dd930 P cd75a17ab2604397adab03bb8b5fd75c [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:49.747040 14437 leader_election.cc:290] T ab432e62819d499eaaf3dd55481dd930 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
W20260709 13:21:49.772523  6770 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 56630.6us
W20260709 13:21:49.773974  6614 catalog_manager.cc:4755] TS ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 427c124d773f483294511e80fe340075: Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111)
W20260709 13:21:49.775976 14516 log.cc:927] Time spent T 7c37d41cd9164c15a6826ca62a851a69 P cd75a17ab2604397adab03bb8b5fd75c: Append to log took a long time: real 0.064s	user 0.000s	sys 0.002s
W20260709 13:21:49.785408  6844 leader_election.cc:336] T ab432e62819d499eaaf3dd55481dd930 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111)
I20260709 13:21:49.731817  6624 catalog_manager.cc:5697] T d33d5ee8ef6f415593d8df52063161ad P b7ab4784c7344b939bc36f639286f377 reported cstate change: term changed from 20 to 21, leader changed from ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65) to b7ab4784c7344b939bc36f639286f377 (127.5.126.66). New cstate: current_term: 21 leader_uuid: "b7ab4784c7344b939bc36f639286f377" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:49.746121 14465 raft_consensus.cc:515] T e77e330a82df4b43a745d57a68f6f057 P b7ab4784c7344b939bc36f639286f377 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } }
W20260709 13:21:49.792637 14474 log.cc:927] Time spent T f3f9c2e2bf644115957398fe4c9459db P 7ba59cc884714e8aa5f3f0ecaed84cbb: Append to log took a long time: real 0.071s	user 0.001s	sys 0.000s
I20260709 13:21:49.842522  6878 raft_consensus.cc:1275] T bb3d8792045a4583ae2e965b1350a5b4 P cd75a17ab2604397adab03bb8b5fd75c [term 20 FOLLOWER]: Refusing update from remote peer 7ba59cc884714e8aa5f3f0ecaed84cbb: Log matching property violated. Preceding OpId in replica: term: 19 index: 16. Preceding OpId from leader: term: 20 index: 17. (index mismatch)
I20260709 13:21:49.855597 14486 consensus_queue.cc:1048] T bb3d8792045a4583ae2e965b1350a5b4 P 7ba59cc884714e8aa5f3f0ecaed84cbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.001s
I20260709 13:21:49.856781 14465 leader_election.cc:290] T e77e330a82df4b43a745d57a68f6f057 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 20 election: Requested vote from peers cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931), ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391)
I20260709 13:21:49.839381 14369 raft_consensus.cc:493] T 1bf4668eeb70467fb3dc5a0289233b3c P b7ab4784c7344b939bc36f639286f377 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader cd75a17ab2604397adab03bb8b5fd75c)
I20260709 13:21:49.862133 14492 consensus_queue.cc:1048] T d33d5ee8ef6f415593d8df52063161ad P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.042s
I20260709 13:21:49.873036 14369 raft_consensus.cc:515] T 1bf4668eeb70467fb3dc5a0289233b3c P b7ab4784c7344b939bc36f639286f377 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:49.875429 14369 leader_election.cc:290] T 1bf4668eeb70467fb3dc5a0289233b3c P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:21:49.888166  6878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77e330a82df4b43a745d57a68f6f057" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c"
I20260709 13:21:49.889030  6878 raft_consensus.cc:3060] T e77e330a82df4b43a745d57a68f6f057 P cd75a17ab2604397adab03bb8b5fd75c [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:21:49.889387 14474 tablet_bootstrap.cc:492] T f3f9c2e2bf644115957398fe4c9459db P 7ba59cc884714e8aa5f3f0ecaed84cbb: Bootstrap replayed 1/1 log segments. Stats: ops{read=16 overwritten=0 applied=16 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:21:49.891894 14474 tablet_bootstrap.cc:492] T f3f9c2e2bf644115957398fe4c9459db P 7ba59cc884714e8aa5f3f0ecaed84cbb: Bootstrap complete.
I20260709 13:21:49.909196  6878 raft_consensus.cc:2468] T e77e330a82df4b43a745d57a68f6f057 P cd75a17ab2604397adab03bb8b5fd75c [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7ab4784c7344b939bc36f639286f377 in term 20.
I20260709 13:21:49.932564 14474 ts_tablet_manager.cc:1403] T f3f9c2e2bf644115957398fe4c9459db P 7ba59cc884714e8aa5f3f0ecaed84cbb: Time spent bootstrapping tablet: real 1.099s	user 0.101s	sys 0.004s
W20260709 13:21:49.894588  7466 consensus_peers.cc:597] T 1528ab62b6fe4e3099d08f141afee116 P 7ba59cc884714e8aa5f3f0ecaed84cbb -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:49.958052 14457 raft_consensus.cc:493] T 44bde925b2e541b69890d70715b85176 P b7ab4784c7344b939bc36f639286f377 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader cd75a17ab2604397adab03bb8b5fd75c)
I20260709 13:21:49.958844 14457 raft_consensus.cc:515] T 44bde925b2e541b69890d70715b85176 P b7ab4784c7344b939bc36f639286f377 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:49.961294 14457 leader_election.cc:290] T 44bde925b2e541b69890d70715b85176 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:21:49.962596 14522 raft_consensus.cc:493] T 90d42e216d9741e190bca19a781291fd P b7ab4784c7344b939bc36f639286f377 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader cd75a17ab2604397adab03bb8b5fd75c)
I20260709 13:21:49.963261 14522 raft_consensus.cc:515] T 90d42e216d9741e190bca19a781291fd P b7ab4784c7344b939bc36f639286f377 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:49.973790  6799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "711ef6523deb4cbe8ef2ba61e1c21c98" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:21:49.974803  6799 raft_consensus.cc:2468] T 711ef6523deb4cbe8ef2ba61e1c21c98 P b7ab4784c7344b939bc36f639286f377 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 21.
I20260709 13:21:49.980428  6798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e77e330a82df4b43a745d57a68f6f057" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:21:49.981477  6798 raft_consensus.cc:2393] T e77e330a82df4b43a745d57a68f6f057 P b7ab4784c7344b939bc36f639286f377 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd75a17ab2604397adab03bb8b5fd75c in current term 20: Already voted for candidate b7ab4784c7344b939bc36f639286f377 in this term.
I20260709 13:21:49.980510 14522 leader_election.cc:290] T 90d42e216d9741e190bca19a781291fd P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:21:49.981855  6803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3022224cc81473690653a83d4e99470" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:21:49.982745  6804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c44c4849aa54f2b94d1f1bef9ed546f" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:21:49.982782  6803 raft_consensus.cc:2468] T a3022224cc81473690653a83d4e99470 P b7ab4784c7344b939bc36f639286f377 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 21.
I20260709 13:21:49.998410  6806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3411566abe2d4c9bb4b2adfdd05e6f17" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:21:50.000100  6806 raft_consensus.cc:3060] T 3411566abe2d4c9bb4b2adfdd05e6f17 P b7ab4784c7344b939bc36f639286f377 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:21:49.983806  6804 raft_consensus.cc:2468] T 7c44c4849aa54f2b94d1f1bef9ed546f P b7ab4784c7344b939bc36f639286f377 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 23.
I20260709 13:21:50.008545  6804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab432e62819d499eaaf3dd55481dd930" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 26 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377" is_pre_election: true
I20260709 13:21:50.007900  6772 leader_election.cc:304] T e77e330a82df4b43a745d57a68f6f057 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:21:50.013190 14500 raft_consensus.cc:2804] T e77e330a82df4b43a745d57a68f6f057 P b7ab4784c7344b939bc36f639286f377 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:21:50.013821 14500 raft_consensus.cc:697] T e77e330a82df4b43a745d57a68f6f057 P b7ab4784c7344b939bc36f639286f377 [term 20 LEADER]: Becoming Leader. State: Replica: b7ab4784c7344b939bc36f639286f377, State: Running, Role: LEADER
I20260709 13:21:50.014909 14500 consensus_queue.cc:237] T e77e330a82df4b43a745d57a68f6f057 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.11, Last appended by leader: 11, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } }
W20260709 13:21:50.018711  6770 consensus_peers.cc:597] T f5be3a11b23d4ea9b08300a2789821c7 P b7ab4784c7344b939bc36f639286f377 -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:21:50.019439  6770 leader_election.cc:336] T f4b8bd455d5a47c18a1380839c6e0d61 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 22 election: RPC error from VoteRequest() call to peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111)
W20260709 13:21:50.022611  7466 consensus_peers.cc:597] T bb3d8792045a4583ae2e965b1350a5b4 P 7ba59cc884714e8aa5f3f0ecaed84cbb -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:49.993614 14474 raft_consensus.cc:359] T f3f9c2e2bf644115957398fe4c9459db P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 23 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } attrs { replace: true } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: NON_VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: true } }
I20260709 13:21:50.033653 14474 raft_consensus.cc:740] T f3f9c2e2bf644115957398fe4c9459db P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 23 LEARNER]: Becoming Follower/Learner. State: Replica: 7ba59cc884714e8aa5f3f0ecaed84cbb, State: Initialized, Role: LEARNER
I20260709 13:21:50.028059  6877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bf4668eeb70467fb3dc5a0289233b3c" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:21:50.036834  6874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44bde925b2e541b69890d70715b85176" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:21:50.024680  6806 raft_consensus.cc:2468] T 3411566abe2d4c9bb4b2adfdd05e6f17 P b7ab4784c7344b939bc36f639286f377 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 21.
I20260709 13:21:50.033092  7495 raft_consensus.cc:1217] T 3a485a995abc4807b6e511e45419f737 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 17 LEARNER]: Deduplicated request from leader. Original: 17.10->[17.11-17.11]   Dedup: 17.11->[]
W20260709 13:21:50.045749  6770 leader_election.cc:336] T d8292e16e5654be6bc408560cf256aaa P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 22 election: RPC error from VoteRequest() call to peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111)
I20260709 13:21:50.046135  6875 raft_consensus.cc:1275] T de3186201e1a40d0b335eeb8b4e256e0 P cd75a17ab2604397adab03bb8b5fd75c [term 23 FOLLOWER]: Refusing update from remote peer b7ab4784c7344b939bc36f639286f377: Log matching property violated. Preceding OpId in replica: term: 22 index: 12. Preceding OpId from leader: term: 23 index: 13. (index mismatch)
I20260709 13:21:50.043537  6876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90d42e216d9741e190bca19a781291fd" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
W20260709 13:21:50.047569  6770 leader_election.cc:336] T 7c37d41cd9164c15a6826ca62a851a69 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111)
W20260709 13:21:50.053449  6770 leader_election.cc:336] T d33d5ee8ef6f415593d8df52063161ad P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 21 election: RPC error from VoteRequest() call to peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111)
W20260709 13:21:50.055231  6770 leader_election.cc:336] T dbdf895bba214ff68685a24fd17dfb5d P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 21 election: RPC error from VoteRequest() call to peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111)
W20260709 13:21:50.056470  6770 leader_election.cc:336] T 7c37d41cd9164c15a6826ca62a851a69 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 23 election: RPC error from VoteRequest() call to peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111)
I20260709 13:21:50.034497 14474 consensus_queue.cc:260] T f3f9c2e2bf644115957398fe4c9459db P 7ba59cc884714e8aa5f3f0ecaed84cbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 16, Last appended: 23.16, Last appended by leader: 16, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } attrs { replace: true } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: NON_VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: true } }
I20260709 13:21:50.059789 14474 ts_tablet_manager.cc:1434] T f3f9c2e2bf644115957398fe4c9459db P 7ba59cc884714e8aa5f3f0ecaed84cbb: Time spent starting tablet: real 0.127s	user 0.009s	sys 0.001s
W20260709 13:21:50.067929  6770 consensus_peers.cc:597] T f03d0dbf16864ca4bc1bb5e4c0334c0f P b7ab4784c7344b939bc36f639286f377 -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:21:50.068648  6770 consensus_peers.cc:597] T f09c2a98de1a4decabd0ff900dd44caa P b7ab4784c7344b939bc36f639286f377 -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:21:50.069183  6770 leader_election.cc:336] T f4b8bd455d5a47c18a1380839c6e0d61 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111)
W20260709 13:21:50.070979  6770 consensus_peers.cc:597] T a1704639a875409b9959353527b3fd68 P b7ab4784c7344b939bc36f639286f377 -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:21:50.071576  6770 consensus_peers.cc:597] T 30e88460611e47b2ba16a46a30b5f416 P b7ab4784c7344b939bc36f639286f377 -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:21:50.072141  6770 leader_election.cc:336] T d8292e16e5654be6bc408560cf256aaa P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111)
W20260709 13:21:50.074813  6770 consensus_peers.cc:597] T 20f6842e26174571996b8dea4151d4be P b7ab4784c7344b939bc36f639286f377 -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:21:50.075076  6817 tablet_copy_service.cc:342] P b7ab4784c7344b939bc36f639286f377: Request end of tablet copy session 7ba59cc884714e8aa5f3f0ecaed84cbb-f3f9c2e2bf644115957398fe4c9459db received from {username='slave'} at 127.0.0.1:50550
W20260709 13:21:50.075330  6770 leader_election.cc:336] T bd6869f07b5a4885a0b99fbe60c3b175 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111)
I20260709 13:21:50.075829  6817 tablet_copy_service.cc:434] P b7ab4784c7344b939bc36f639286f377: ending tablet copy session 7ba59cc884714e8aa5f3f0ecaed84cbb-f3f9c2e2bf644115957398fe4c9459db on tablet f3f9c2e2bf644115957398fe4c9459db with peer 7ba59cc884714e8aa5f3f0ecaed84cbb
W20260709 13:21:50.076550  6770 consensus_peers.cc:597] T ab432e62819d499eaaf3dd55481dd930 P b7ab4784c7344b939bc36f639286f377 -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:21:50.126744  6770 leader_election.cc:336] T e77e330a82df4b43a745d57a68f6f057 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111)
W20260709 13:21:50.127861  6770 consensus_peers.cc:597] T de3186201e1a40d0b335eeb8b4e256e0 P b7ab4784c7344b939bc36f639286f377 -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:50.128978  6770 consensus_peers.cc:597] T b56bf91d90824c959e21e0cee5ba1816 P b7ab4784c7344b939bc36f639286f377 -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:21:50.129571  6770 consensus_peers.cc:597] T bd6869f07b5a4885a0b99fbe60c3b175 P b7ab4784c7344b939bc36f639286f377 -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:50.130132  6770 consensus_peers.cc:597] T f4b8bd455d5a47c18a1380839c6e0d61 P b7ab4784c7344b939bc36f639286f377 -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:50.130676  6770 consensus_peers.cc:597] T d8292e16e5654be6bc408560cf256aaa P b7ab4784c7344b939bc36f639286f377 -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:50.131310  6770 consensus_peers.cc:597] T d33d5ee8ef6f415593d8df52063161ad P b7ab4784c7344b939bc36f639286f377 -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:50.131839  6770 consensus_peers.cc:597] T 7c37d41cd9164c15a6826ca62a851a69 P b7ab4784c7344b939bc36f639286f377 -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:50.132459  6770 consensus_peers.cc:597] T dbdf895bba214ff68685a24fd17dfb5d P b7ab4784c7344b939bc36f639286f377 -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:50.132943  6770 leader_election.cc:336] T e77e330a82df4b43a745d57a68f6f057 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 20 election: RPC error from VoteRequest() call to peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111)
W20260709 13:21:50.133833  6770 leader_election.cc:336] T 1bf4668eeb70467fb3dc5a0289233b3c P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111)
W20260709 13:21:50.140730  6770 leader_election.cc:336] T 44bde925b2e541b69890d70715b85176 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111)
W20260709 13:21:50.141409  6770 leader_election.cc:336] T 90d42e216d9741e190bca19a781291fd P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111)
I20260709 13:21:50.137477  6772 leader_election.cc:304] T 1bf4668eeb70467fb3dc5a0289233b3c P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:21:50.151690 14522 raft_consensus.cc:2749] T 1bf4668eeb70467fb3dc5a0289233b3c P b7ab4784c7344b939bc36f639286f377 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:21:50.153070  6772 leader_election.cc:304] T 44bde925b2e541b69890d70715b85176 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:21:50.153903 14522 raft_consensus.cc:2749] T 44bde925b2e541b69890d70715b85176 P b7ab4784c7344b939bc36f639286f377 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:21:50.157228 14522 consensus_queue.cc:1048] T de3186201e1a40d0b335eeb8b4e256e0 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:21:50.158933  6772 leader_election.cc:304] T 90d42e216d9741e190bca19a781291fd P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:21:50.159595 14522 raft_consensus.cc:2749] T 90d42e216d9741e190bca19a781291fd P b7ab4784c7344b939bc36f639286f377 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:21:50.164480  7495 raft_consensus.cc:1217] T f3f9c2e2bf644115957398fe4c9459db P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 23 LEARNER]: Deduplicated request from leader. Original: 23.15->[23.16-23.16]   Dedup: 23.16->[]
I20260709 13:21:50.166164  6872 raft_consensus.cc:1275] T bd6869f07b5a4885a0b99fbe60c3b175 P cd75a17ab2604397adab03bb8b5fd75c [term 27 FOLLOWER]: Refusing update from remote peer b7ab4784c7344b939bc36f639286f377: Log matching property violated. Preceding OpId in replica: term: 26 index: 14. Preceding OpId from leader: term: 27 index: 15. (index mismatch)
I20260709 13:21:50.174108  6875 raft_consensus.cc:1275] T dbdf895bba214ff68685a24fd17dfb5d P cd75a17ab2604397adab03bb8b5fd75c [term 21 FOLLOWER]: Refusing update from remote peer b7ab4784c7344b939bc36f639286f377: Log matching property violated. Preceding OpId in replica: term: 20 index: 9. Preceding OpId from leader: term: 21 index: 10. (index mismatch)
I20260709 13:21:50.192497 14457 consensus_queue.cc:1048] T bd6869f07b5a4885a0b99fbe60c3b175 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:21:50.194736 14457 consensus_queue.cc:1048] T dbdf895bba214ff68685a24fd17dfb5d P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:21:50.199222  6624 catalog_manager.cc:5697] T e77e330a82df4b43a745d57a68f6f057 P b7ab4784c7344b939bc36f639286f377 reported cstate change: term changed from 19 to 20, leader changed from ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65) to b7ab4784c7344b939bc36f639286f377 (127.5.126.66). New cstate: current_term: 20 leader_uuid: "b7ab4784c7344b939bc36f639286f377" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:50.227211  6844 leader_election.cc:304] T 711ef6523deb4cbe8ef2ba61e1c21c98 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:21:50.238065 14463 raft_consensus.cc:2804] T 711ef6523deb4cbe8ef2ba61e1c21c98 P cd75a17ab2604397adab03bb8b5fd75c [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:21:50.238579 14463 raft_consensus.cc:493] T 711ef6523deb4cbe8ef2ba61e1c21c98 P cd75a17ab2604397adab03bb8b5fd75c [term 21 FOLLOWER]: Starting leader election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:21:50.238997 14463 raft_consensus.cc:3060] T 711ef6523deb4cbe8ef2ba61e1c21c98 P cd75a17ab2604397adab03bb8b5fd75c [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:21:50.244975  6844 leader_election.cc:304] T e77e330a82df4b43a745d57a68f6f057 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:21:50.251261 14463 raft_consensus.cc:515] T 711ef6523deb4cbe8ef2ba61e1c21c98 P cd75a17ab2604397adab03bb8b5fd75c [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:50.256767 14507 raft_consensus.cc:2749] T e77e330a82df4b43a745d57a68f6f057 P cd75a17ab2604397adab03bb8b5fd75c [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:21:50.267930 14463 leader_election.cc:290] T 711ef6523deb4cbe8ef2ba61e1c21c98 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 22 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:21:50.276939  6844 leader_election.cc:304] T a3022224cc81473690653a83d4e99470 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:21:50.278309 14463 raft_consensus.cc:2804] T a3022224cc81473690653a83d4e99470 P cd75a17ab2604397adab03bb8b5fd75c [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:21:50.278887 14463 raft_consensus.cc:493] T a3022224cc81473690653a83d4e99470 P cd75a17ab2604397adab03bb8b5fd75c [term 21 FOLLOWER]: Starting leader election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:21:50.279438 14463 raft_consensus.cc:3060] T a3022224cc81473690653a83d4e99470 P cd75a17ab2604397adab03bb8b5fd75c [term 21 FOLLOWER]: Advancing to term 22
W20260709 13:21:50.300060  5625 thread.cc:527] Waited for 2000ms trying to join with diag-logger (tid 6753)
W20260709 13:21:50.323770  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 46969.2us
I20260709 13:21:50.326138  6844 leader_election.cc:304] T 7c44c4849aa54f2b94d1f1bef9ed546f P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:21:50.330969 14507 raft_consensus.cc:2804] T 7c44c4849aa54f2b94d1f1bef9ed546f P cd75a17ab2604397adab03bb8b5fd75c [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:21:50.331782 14507 raft_consensus.cc:493] T 7c44c4849aa54f2b94d1f1bef9ed546f P cd75a17ab2604397adab03bb8b5fd75c [term 23 FOLLOWER]: Starting leader election (detected failure of leader ccd8a4c3bfe3413cb2ae219b09aea832)
I20260709 13:21:50.332237 14507 raft_consensus.cc:3060] T 7c44c4849aa54f2b94d1f1bef9ed546f P cd75a17ab2604397adab03bb8b5fd75c [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:21:50.345942 14507 raft_consensus.cc:515] T 7c44c4849aa54f2b94d1f1bef9ed546f P cd75a17ab2604397adab03bb8b5fd75c [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:50.358285  6844 leader_election.cc:304] T ab432e62819d499eaaf3dd55481dd930 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:21:50.364813  6844 leader_election.cc:304] T 3411566abe2d4c9bb4b2adfdd05e6f17 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:21:50.360179 14507 leader_election.cc:290] T 7c44c4849aa54f2b94d1f1bef9ed546f P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 24 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:21:50.364674 14437 raft_consensus.cc:2749] T ab432e62819d499eaaf3dd55481dd930 P cd75a17ab2604397adab03bb8b5fd75c [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:21:50.378438 14464 raft_consensus.cc:2804] T 3411566abe2d4c9bb4b2adfdd05e6f17 P cd75a17ab2604397adab03bb8b5fd75c [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:21:50.379145 14464 raft_consensus.cc:697] T 3411566abe2d4c9bb4b2adfdd05e6f17 P cd75a17ab2604397adab03bb8b5fd75c [term 21 LEADER]: Becoming Leader. State: Replica: cd75a17ab2604397adab03bb8b5fd75c, State: Running, Role: LEADER
I20260709 13:21:50.402964 14464 consensus_queue.cc:237] T 3411566abe2d4c9bb4b2adfdd05e6f17 P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 20.13, Last appended by leader: 13, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
W20260709 13:21:50.414312  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 49623.9us
I20260709 13:21:50.422148 14463 raft_consensus.cc:515] T a3022224cc81473690653a83d4e99470 P cd75a17ab2604397adab03bb8b5fd75c [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
W20260709 13:21:50.437743  7466 consensus_peers.cc:597] T b3f13b31a1f84f0d89d007eadd57924c P 7ba59cc884714e8aa5f3f0ecaed84cbb -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:21:50.441452  6806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "711ef6523deb4cbe8ef2ba61e1c21c98" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:21:50.442436  6806 raft_consensus.cc:3060] T 711ef6523deb4cbe8ef2ba61e1c21c98 P b7ab4784c7344b939bc36f639286f377 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:21:50.431062 14463 leader_election.cc:290] T a3022224cc81473690653a83d4e99470 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 22 election: Requested vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:21:50.446964  6799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c44c4849aa54f2b94d1f1bef9ed546f" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:21:50.452217  6799 raft_consensus.cc:3060] T 7c44c4849aa54f2b94d1f1bef9ed546f P b7ab4784c7344b939bc36f639286f377 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:21:50.455829  6806 raft_consensus.cc:2468] T 711ef6523deb4cbe8ef2ba61e1c21c98 P b7ab4784c7344b939bc36f639286f377 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 22.
I20260709 13:21:50.456442  6876 raft_consensus.cc:1275] T e77e330a82df4b43a745d57a68f6f057 P cd75a17ab2604397adab03bb8b5fd75c [term 20 FOLLOWER]: Refusing update from remote peer b7ab4784c7344b939bc36f639286f377: Log matching property violated. Preceding OpId in replica: term: 19 index: 11. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
I20260709 13:21:50.468201  6799 raft_consensus.cc:2468] T 7c44c4849aa54f2b94d1f1bef9ed546f P b7ab4784c7344b939bc36f639286f377 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 24.
W20260709 13:21:50.506609  6772 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 48964.2us
I20260709 13:21:50.513388 14439 consensus_queue.cc:1048] T e77e330a82df4b43a745d57a68f6f057 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
W20260709 13:21:50.523375  6770 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 69197.2us
W20260709 13:21:50.552106  6844 leader_election.cc:336] T 711ef6523deb4cbe8ef2ba61e1c21c98 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 22 election: RPC error from VoteRequest() call to peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111)
W20260709 13:21:50.553054  6844 leader_election.cc:336] T 7c44c4849aa54f2b94d1f1bef9ed546f P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 24 election: RPC error from VoteRequest() call to peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111)
W20260709 13:21:50.553550  6844 consensus_peers.cc:597] T e31b9971c15848dea59d4d4130141d9e P cd75a17ab2604397adab03bb8b5fd75c -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:21:50.553979  6844 leader_election.cc:336] T a3022224cc81473690653a83d4e99470 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 22 election: RPC error from VoteRequest() call to peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111)
W20260709 13:21:50.556017  6614 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 45155.6us
I20260709 13:21:50.560837  6624 catalog_manager.cc:5697] T 3411566abe2d4c9bb4b2adfdd05e6f17 P cd75a17ab2604397adab03bb8b5fd75c reported cstate change: term changed from 20 to 21, leader changed from ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65) to cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67). New cstate: current_term: 21 leader_uuid: "cd75a17ab2604397adab03bb8b5fd75c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } health_report { overall_health: HEALTHY } } }
I20260709 13:21:50.580639 14369 raft_consensus.cc:1064] T f3f9c2e2bf644115957398fe4c9459db P b7ab4784c7344b939bc36f639286f377: attempting to promote NON_VOTER 7ba59cc884714e8aa5f3f0ecaed84cbb to VOTER
I20260709 13:21:50.590899 14369 consensus_queue.cc:237] T f3f9c2e2bf644115957398fe4c9459db P b7ab4784c7344b939bc36f639286f377 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 23.16, Last appended by leader: 14, Current term: 23, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } attrs { replace: true } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:21:50.610263  6844 leader_election.cc:304] T 711ef6523deb4cbe8ef2ba61e1c21c98 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:21:50.611446  6804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3022224cc81473690653a83d4e99470" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "b7ab4784c7344b939bc36f639286f377"
I20260709 13:21:50.612133  6804 raft_consensus.cc:3060] T a3022224cc81473690653a83d4e99470 P b7ab4784c7344b939bc36f639286f377 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:21:50.612916 14463 raft_consensus.cc:2804] T 711ef6523deb4cbe8ef2ba61e1c21c98 P cd75a17ab2604397adab03bb8b5fd75c [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:21:50.613576 14463 raft_consensus.cc:697] T 711ef6523deb4cbe8ef2ba61e1c21c98 P cd75a17ab2604397adab03bb8b5fd75c [term 22 LEADER]: Becoming Leader. State: Replica: cd75a17ab2604397adab03bb8b5fd75c, State: Running, Role: LEADER
I20260709 13:21:50.615063 14463 consensus_queue.cc:237] T 711ef6523deb4cbe8ef2ba61e1c21c98 P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 21.12, Last appended by leader: 12, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:50.625593  6804 raft_consensus.cc:2468] T a3022224cc81473690653a83d4e99470 P b7ab4784c7344b939bc36f639286f377 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 22.
I20260709 13:21:50.636555 14490 raft_consensus.cc:1064] T 3a485a995abc4807b6e511e45419f737 P b7ab4784c7344b939bc36f639286f377: attempting to promote NON_VOTER 7ba59cc884714e8aa5f3f0ecaed84cbb to VOTER
I20260709 13:21:50.638567  6844 leader_election.cc:304] T 7c44c4849aa54f2b94d1f1bef9ed546f P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:21:50.643445 14490 consensus_queue.cc:237] T 3a485a995abc4807b6e511e45419f737 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 9, Current term: 17, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } attrs { replace: true } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:21:50.653359 14537 raft_consensus.cc:2804] T 7c44c4849aa54f2b94d1f1bef9ed546f P cd75a17ab2604397adab03bb8b5fd75c [term 24 FOLLOWER]: Leader election won for term 24
I20260709 13:21:50.653987 14537 raft_consensus.cc:697] T 7c44c4849aa54f2b94d1f1bef9ed546f P cd75a17ab2604397adab03bb8b5fd75c [term 24 LEADER]: Becoming Leader. State: Replica: cd75a17ab2604397adab03bb8b5fd75c, State: Running, Role: LEADER
I20260709 13:21:50.654904 14537 consensus_queue.cc:237] T 7c44c4849aa54f2b94d1f1bef9ed546f P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 23.15, Last appended by leader: 15, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:50.664322  6844 leader_election.cc:304] T a3022224cc81473690653a83d4e99470 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c; no voters: ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:21:50.666173  7495 raft_consensus.cc:1275] T f3f9c2e2bf644115957398fe4c9459db P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 23 LEARNER]: Refusing update from remote peer b7ab4784c7344b939bc36f639286f377: Log matching property violated. Preceding OpId in replica: term: 23 index: 16. Preceding OpId from leader: term: 23 index: 17. (index mismatch)
W20260709 13:21:50.664772  6770 consensus_peers.cc:597] T e77e330a82df4b43a745d57a68f6f057 P b7ab4784c7344b939bc36f639286f377 -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:50.676854 14464 raft_consensus.cc:2804] T a3022224cc81473690653a83d4e99470 P cd75a17ab2604397adab03bb8b5fd75c [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:21:50.687034  6876 raft_consensus.cc:1275] T f3f9c2e2bf644115957398fe4c9459db P cd75a17ab2604397adab03bb8b5fd75c [term 23 FOLLOWER]: Refusing update from remote peer b7ab4784c7344b939bc36f639286f377: Log matching property violated. Preceding OpId in replica: term: 23 index: 16. Preceding OpId from leader: term: 23 index: 17. (index mismatch)
I20260709 13:21:50.676393 14500 consensus_queue.cc:1048] T f3f9c2e2bf644115957398fe4c9459db P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.012s
I20260709 13:21:50.708525 14464 raft_consensus.cc:697] T a3022224cc81473690653a83d4e99470 P cd75a17ab2604397adab03bb8b5fd75c [term 22 LEADER]: Becoming Leader. State: Replica: cd75a17ab2604397adab03bb8b5fd75c, State: Running, Role: LEADER
I20260709 13:21:50.709702 14464 consensus_queue.cc:237] T a3022224cc81473690653a83d4e99470 P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 21.12, Last appended by leader: 12, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:21:50.716392 14369 consensus_queue.cc:1048] T f3f9c2e2bf644115957398fe4c9459db P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.001s
I20260709 13:21:50.715134  6624 catalog_manager.cc:5697] T 711ef6523deb4cbe8ef2ba61e1c21c98 P cd75a17ab2604397adab03bb8b5fd75c reported cstate change: term changed from 21 to 22, leader changed from ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65) to cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67). New cstate: current_term: 22 leader_uuid: "cd75a17ab2604397adab03bb8b5fd75c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } health_report { overall_health: HEALTHY } } }
I20260709 13:21:50.722268  6876 raft_consensus.cc:1275] T 3a485a995abc4807b6e511e45419f737 P cd75a17ab2604397adab03bb8b5fd75c [term 17 FOLLOWER]: Refusing update from remote peer b7ab4784c7344b939bc36f639286f377: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 13:21:50.735085 14369 consensus_queue.cc:1048] T 3a485a995abc4807b6e511e45419f737 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:21:50.736325  7502 raft_consensus.cc:1275] T 3a485a995abc4807b6e511e45419f737 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 17 LEARNER]: Refusing update from remote peer b7ab4784c7344b939bc36f639286f377: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 13:21:50.740512 14500 consensus_queue.cc:1048] T 3a485a995abc4807b6e511e45419f737 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.003s
W20260709 13:21:50.749609  7468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 66408us
I20260709 13:21:50.778844  6624 catalog_manager.cc:5697] T 7c44c4849aa54f2b94d1f1bef9ed546f P cd75a17ab2604397adab03bb8b5fd75c reported cstate change: term changed from 23 to 24, leader changed from ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65) to cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67). New cstate: current_term: 24 leader_uuid: "cd75a17ab2604397adab03bb8b5fd75c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } health_report { overall_health: HEALTHY } } }
I20260709 13:21:50.783078  6624 catalog_manager.cc:5697] T a3022224cc81473690653a83d4e99470 P cd75a17ab2604397adab03bb8b5fd75c reported cstate change: term changed from 21 to 22, leader changed from ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65) to cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67). New cstate: current_term: 22 leader_uuid: "cd75a17ab2604397adab03bb8b5fd75c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } health_report { overall_health: HEALTHY } } }
W20260709 13:21:50.785953  6770 consensus_peers.cc:597] T f3f9c2e2bf644115957398fe4c9459db P b7ab4784c7344b939bc36f639286f377 -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:50.792377  6770 consensus_peers.cc:597] T 3a485a995abc4807b6e511e45419f737 P b7ab4784c7344b939bc36f639286f377 -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:50.809129  6614 catalog_manager.cc:4755] TS ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 427c124d773f483294511e80fe340075: Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111)
I20260709 13:21:50.833431  6804 raft_consensus.cc:1275] T 3411566abe2d4c9bb4b2adfdd05e6f17 P b7ab4784c7344b939bc36f639286f377 [term 21 FOLLOWER]: Refusing update from remote peer cd75a17ab2604397adab03bb8b5fd75c: Log matching property violated. Preceding OpId in replica: term: 20 index: 13. Preceding OpId from leader: term: 21 index: 14. (index mismatch)
I20260709 13:21:50.837172 14369 raft_consensus.cc:2955] T f3f9c2e2bf644115957398fe4c9459db P b7ab4784c7344b939bc36f639286f377 [term 23 LEADER]: Committing config change with OpId 23.17: config changed from index 16 to 17, 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68) changed from NON_VOTER to VOTER. New config: { opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } attrs { replace: true } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } } }
I20260709 13:21:50.855844 14535 consensus_queue.cc:1048] T 3411566abe2d4c9bb4b2adfdd05e6f17 P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
W20260709 13:21:50.868484  6844 consensus_peers.cc:597] T 34f36d59d88f40fe8a2805e604fc6c0a P cd75a17ab2604397adab03bb8b5fd75c -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:21:50.868132  6876 raft_consensus.cc:2955] T f3f9c2e2bf644115957398fe4c9459db P cd75a17ab2604397adab03bb8b5fd75c [term 23 FOLLOWER]: Committing config change with OpId 23.17: config changed from index 16 to 17, 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68) changed from NON_VOTER to VOTER. New config: { opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } attrs { replace: true } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } } }
W20260709 13:21:50.917228  6844 consensus_peers.cc:597] T 1bf4668eeb70467fb3dc5a0289233b3c P cd75a17ab2604397adab03bb8b5fd75c -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:21:50.916208 14457 raft_consensus.cc:2955] T 3a485a995abc4807b6e511e45419f737 P b7ab4784c7344b939bc36f639286f377 [term 17 LEADER]: Committing config change with OpId 17.12: config changed from index 11 to 12, 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } attrs { replace: true } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } } }
W20260709 13:21:50.946868  6844 consensus_peers.cc:597] T 3411566abe2d4c9bb4b2adfdd05e6f17 P cd75a17ab2604397adab03bb8b5fd75c -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:50.958570  7502 raft_consensus.cc:2955] T 3a485a995abc4807b6e511e45419f737 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 17 FOLLOWER]: Committing config change with OpId 17.12: config changed from index 11 to 12, 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } attrs { replace: true } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } } }
I20260709 13:21:50.964781  7495 raft_consensus.cc:2955] T f3f9c2e2bf644115957398fe4c9459db P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 23 FOLLOWER]: Committing config change with OpId 23.17: config changed from index 16 to 17, 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68) changed from NON_VOTER to VOTER. New config: { opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } attrs { replace: true } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } } }
I20260709 13:21:50.970603  6624 catalog_manager.cc:5697] T f3f9c2e2bf644115957398fe4c9459db P b7ab4784c7344b939bc36f639286f377 reported cstate change: config changed from index 16 to 17, 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68) changed from NON_VOTER to VOTER. New cstate: current_term: 23 leader_uuid: "b7ab4784c7344b939bc36f639286f377" committed_config { opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:21:50.990830  6878 raft_consensus.cc:2955] T 3a485a995abc4807b6e511e45419f737 P cd75a17ab2604397adab03bb8b5fd75c [term 17 FOLLOWER]: Committing config change with OpId 17.12: config changed from index 11 to 12, 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } attrs { replace: true } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } } }
W20260709 13:21:51.026196  6844 consensus_peers.cc:597] T 95a75bfe094d4bdc963aba3f08dfcd25 P cd75a17ab2604397adab03bb8b5fd75c -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:21:51.025640  6624 catalog_manager.cc:5697] T 3a485a995abc4807b6e511e45419f737 P b7ab4784c7344b939bc36f639286f377 reported cstate change: config changed from index 11 to 12, 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68) changed from NON_VOTER to VOTER. New cstate: current_term: 17 leader_uuid: "b7ab4784c7344b939bc36f639286f377" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:21:51.070887  6806 raft_consensus.cc:1275] T 711ef6523deb4cbe8ef2ba61e1c21c98 P b7ab4784c7344b939bc36f639286f377 [term 22 FOLLOWER]: Refusing update from remote peer cd75a17ab2604397adab03bb8b5fd75c: Log matching property violated. Preceding OpId in replica: term: 21 index: 12. Preceding OpId from leader: term: 22 index: 13. (index mismatch)
I20260709 13:21:51.074357 14536 consensus_queue.cc:1048] T 711ef6523deb4cbe8ef2ba61e1c21c98 P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:21:51.081329  6806 consensus_queue.cc:237] T 3a485a995abc4807b6e511e45419f737 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
W20260709 13:21:51.082038  6844 consensus_peers.cc:597] T 9e326172347f45e99a0d482b5d8ef768 P cd75a17ab2604397adab03bb8b5fd75c -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:21:51.086755  7502 raft_consensus.cc:1275] T 3a485a995abc4807b6e511e45419f737 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 17 FOLLOWER]: Refusing update from remote peer b7ab4784c7344b939bc36f639286f377: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 13:21:51.087248  6876 raft_consensus.cc:1275] T 3a485a995abc4807b6e511e45419f737 P cd75a17ab2604397adab03bb8b5fd75c [term 17 FOLLOWER]: Refusing update from remote peer b7ab4784c7344b939bc36f639286f377: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 13:21:51.091243 14457 consensus_queue.cc:1048] T 3a485a995abc4807b6e511e45419f737 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:21:51.094720 14522 consensus_queue.cc:1048] T 3a485a995abc4807b6e511e45419f737 P b7ab4784c7344b939bc36f639286f377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:21:51.102489 14457 raft_consensus.cc:2955] T 3a485a995abc4807b6e511e45419f737 P b7ab4784c7344b939bc36f639286f377 [term 17 LEADER]: Committing config change with OpId 17.13: config changed from index 12 to 13, VOTER ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65) evicted. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } } }
W20260709 13:21:51.116374  6844 consensus_peers.cc:597] T c4db81d9d329422bb3b4160ca4ac2d1d P cd75a17ab2604397adab03bb8b5fd75c -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:21:51.120533  7502 raft_consensus.cc:2955] T 3a485a995abc4807b6e511e45419f737 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 17 FOLLOWER]: Committing config change with OpId 17.13: config changed from index 12 to 13, VOTER ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65) evicted. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } } }
I20260709 13:21:51.118671  6878 raft_consensus.cc:2955] T 3a485a995abc4807b6e511e45419f737 P cd75a17ab2604397adab03bb8b5fd75c [term 17 FOLLOWER]: Committing config change with OpId 17.13: config changed from index 12 to 13, VOTER ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65) evicted. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } } }
I20260709 13:21:51.140700  6799 raft_consensus.cc:1275] T a3022224cc81473690653a83d4e99470 P b7ab4784c7344b939bc36f639286f377 [term 22 FOLLOWER]: Refusing update from remote peer cd75a17ab2604397adab03bb8b5fd75c: Log matching property violated. Preceding OpId in replica: term: 21 index: 12. Preceding OpId from leader: term: 22 index: 13. (index mismatch)
I20260709 13:21:51.141852  6614 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 3a485a995abc4807b6e511e45419f737 with cas_config_opid_index 12: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
W20260709 13:21:51.150554  7466 consensus_peers.cc:597] T 24ee15416e3145beaa1b8183453729a3 P 7ba59cc884714e8aa5f3f0ecaed84cbb -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:21:51.156890  7466 consensus_peers.cc:597] T 17587d6730594da4a56fa13a353232a1 P 7ba59cc884714e8aa5f3f0ecaed84cbb -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:21:51.157076  6624 catalog_manager.cc:5697] T 3a485a995abc4807b6e511e45419f737 P b7ab4784c7344b939bc36f639286f377 reported cstate change: config changed from index 12 to 13, VOTER ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65) evicted. New cstate: current_term: 17 leader_uuid: "b7ab4784c7344b939bc36f639286f377" committed_config { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:21:51.180989  6844 consensus_peers.cc:597] T 7c44c4849aa54f2b94d1f1bef9ed546f P cd75a17ab2604397adab03bb8b5fd75c -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:51.181468  6844 consensus_peers.cc:597] T 711ef6523deb4cbe8ef2ba61e1c21c98 P cd75a17ab2604397adab03bb8b5fd75c -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:51.197321  7466 consensus_peers.cc:597] T 3fa34c08b205435dba97346991aa1f92 P 7ba59cc884714e8aa5f3f0ecaed84cbb -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:21:51.203576  7466 consensus_peers.cc:597] T 404190ce4ce94cecbfcb6ea9d1dd8626 P 7ba59cc884714e8aa5f3f0ecaed84cbb -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:21:51.206122 14537 consensus_queue.cc:1048] T a3022224cc81473690653a83d4e99470 P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
W20260709 13:21:51.208756  6844 consensus_peers.cc:597] T 90d42e216d9741e190bca19a781291fd P cd75a17ab2604397adab03bb8b5fd75c -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:21:51.269048  6844 consensus_peers.cc:597] T f58dc08b12a2494bb9a1372837970ca2 P cd75a17ab2604397adab03bb8b5fd75c -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:21:51.293474  7466 consensus_peers.cc:597] T be1a92657f494cac8dd227d152f50151 P 7ba59cc884714e8aa5f3f0ecaed84cbb -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:21:51.299573  6844 consensus_peers.cc:597] T a3022224cc81473690653a83d4e99470 P cd75a17ab2604397adab03bb8b5fd75c -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:51.300670  5625 thread.cc:527] Waited for 3000ms trying to join with diag-logger (tid 6753)
I20260709 13:21:51.308012  6806 raft_consensus.cc:1275] T 7c44c4849aa54f2b94d1f1bef9ed546f P b7ab4784c7344b939bc36f639286f377 [term 24 FOLLOWER]: Refusing update from remote peer cd75a17ab2604397adab03bb8b5fd75c: Log matching property violated. Preceding OpId in replica: term: 23 index: 15. Preceding OpId from leader: term: 24 index: 16. (index mismatch)
W20260709 13:21:51.309652  6770 consensus_peers.cc:597] T 853ac0a8cbd64ce99457f170216d4d0f P b7ab4784c7344b939bc36f639286f377 -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:21:51.317802  6770 consensus_peers.cc:597] T 8c7f33e544204fbaac4078e3e83bbf4e P b7ab4784c7344b939bc36f639286f377 -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:21:51.331424  6844 consensus_peers.cc:597] T 44bde925b2e541b69890d70715b85176 P cd75a17ab2604397adab03bb8b5fd75c -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:21:51.334271 14463 consensus_queue.cc:1048] T 7c44c4849aa54f2b94d1f1bef9ed546f P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
W20260709 13:21:51.540273  6770 consensus_peers.cc:597] T 4275cf08e63345f993bce8664eada830 P b7ab4784c7344b939bc36f639286f377 -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:21:51.607431  6770 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 54972.8us
W20260709 13:21:51.640569  6844 consensus_peers.cc:597] T 4b8cacb381b746da8d0049b0a83b41dd P cd75a17ab2604397adab03bb8b5fd75c -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:21:51.653568  6770 consensus_peers.cc:597] T 22ccee1b570c4ad3a57bd7aec085b1b4 P b7ab4784c7344b939bc36f639286f377 -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:21:51.784385  6770 consensus_peers.cc:597] T 2c240553ce044eedb41541d72b9475d7 P b7ab4784c7344b939bc36f639286f377 -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:21:51.894940  6770 consensus_peers.cc:597] T 7887766dc6784fcaa42b35c05fea7a99 P b7ab4784c7344b939bc36f639286f377 -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:21:51.916162  6614 catalog_manager.cc:4755] TS ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 3a485a995abc4807b6e511e45419f737: Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111)
W20260709 13:21:51.954497  6770 consensus_peers.cc:597] T 07a92dd554674067a83a9cb68c4773f2 P b7ab4784c7344b939bc36f639286f377 -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:21:51.993377  6844 consensus_peers.cc:597] T 713b5728a197487c9300b310ab94e5a3 P cd75a17ab2604397adab03bb8b5fd75c -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:21:52.065083  6770 consensus_peers.cc:597] T 4d9def8b32fd443aa94ab1420b06837b P b7ab4784c7344b939bc36f639286f377 -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:21:52.141613  6770 consensus_peers.cc:597] T 9b3759de40694069b13c0f8bd40e5709 P b7ab4784c7344b939bc36f639286f377 -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:21:52.205691  6770 consensus_peers.cc:597] T d33d5ee8ef6f415593d8df52063161ad P b7ab4784c7344b939bc36f639286f377 -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:21:52.259413  6770 consensus_peers.cc:597] T f5be3a11b23d4ea9b08300a2789821c7 P b7ab4784c7344b939bc36f639286f377 -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:21:52.293344  6770 consensus_peers.cc:597] T f4b8bd455d5a47c18a1380839c6e0d61 P b7ab4784c7344b939bc36f639286f377 -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:21:52.301898  5625 thread.cc:527] Waited for 4000ms trying to join with diag-logger (tid 6753)
W20260709 13:21:52.343147  7466 consensus_peers.cc:597] T fe20b4b48823486ca3b9c648db6ce8aa P 7ba59cc884714e8aa5f3f0ecaed84cbb -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:21:52.346624  6770 consensus_peers.cc:597] T 30e88460611e47b2ba16a46a30b5f416 P b7ab4784c7344b939bc36f639286f377 -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:21:52.376904  6770 consensus_peers.cc:597] T 7c37d41cd9164c15a6826ca62a851a69 P b7ab4784c7344b939bc36f639286f377 -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:21:52.388474  6770 consensus_peers.cc:597] T bd6869f07b5a4885a0b99fbe60c3b175 P b7ab4784c7344b939bc36f639286f377 -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:21:52.394035  6770 consensus_peers.cc:597] T d8292e16e5654be6bc408560cf256aaa P b7ab4784c7344b939bc36f639286f377 -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:21:52.435324  7466 consensus_peers.cc:597] T 1528ab62b6fe4e3099d08f141afee116 P 7ba59cc884714e8aa5f3f0ecaed84cbb -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:21:52.453562  6770 consensus_peers.cc:597] T f03d0dbf16864ca4bc1bb5e4c0334c0f P b7ab4784c7344b939bc36f639286f377 -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:21:52.461356  7466 consensus_peers.cc:597] T bb3d8792045a4583ae2e965b1350a5b4 P 7ba59cc884714e8aa5f3f0ecaed84cbb -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:21:52.473330  6770 consensus_peers.cc:597] T 20f6842e26174571996b8dea4151d4be P b7ab4784c7344b939bc36f639286f377 -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:21:52.474210  6770 consensus_peers.cc:597] T ab432e62819d499eaaf3dd55481dd930 P b7ab4784c7344b939bc36f639286f377 -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:21:52.480603  6770 consensus_peers.cc:597] T dbdf895bba214ff68685a24fd17dfb5d P b7ab4784c7344b939bc36f639286f377 -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:21:52.567304  6770 consensus_peers.cc:597] T b56bf91d90824c959e21e0cee5ba1816 P b7ab4784c7344b939bc36f639286f377 -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:21:52.570463  6770 consensus_peers.cc:597] T de3186201e1a40d0b335eeb8b4e256e0 P b7ab4784c7344b939bc36f639286f377 -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:21:52.650679  6770 consensus_peers.cc:597] T 3d65025eea89441290d85dd053810e31 P b7ab4784c7344b939bc36f639286f377 -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:21:52.801187  6770 consensus_peers.cc:597] T a1704639a875409b9959353527b3fd68 P b7ab4784c7344b939bc36f639286f377 -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:21:52.873258  6844 consensus_peers.cc:597] T e31b9971c15848dea59d4d4130141d9e P cd75a17ab2604397adab03bb8b5fd75c -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:21:52.882344  6770 consensus_peers.cc:597] T f09c2a98de1a4decabd0ff900dd44caa P b7ab4784c7344b939bc36f639286f377 -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:21:52.979717  7466 consensus_peers.cc:597] T b3f13b31a1f84f0d89d007eadd57924c P 7ba59cc884714e8aa5f3f0ecaed84cbb -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:21:53.014250  6770 consensus_peers.cc:597] T e77e330a82df4b43a745d57a68f6f057 P b7ab4784c7344b939bc36f639286f377 -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:21:53.129756  6614 catalog_manager.cc:4755] TS ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet ce4f062dcd314d43a63ca74067cb5ee3: Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111)
W20260709 13:21:53.149719  6770 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111) [suppressed 477 similar messages]
W20260709 13:21:53.228868  6770 consensus_peers.cc:597] T f3f9c2e2bf644115957398fe4c9459db P b7ab4784c7344b939bc36f639286f377 -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:21:53.302479  5625 thread.cc:527] Waited for 5000ms trying to join with diag-logger (tid 6753)
W20260709 13:21:53.456390  7466 consensus_peers.cc:597] T 17587d6730594da4a56fa13a353232a1 P 7ba59cc884714e8aa5f3f0ecaed84cbb -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:21:53.461963  6844 consensus_peers.cc:597] T 1bf4668eeb70467fb3dc5a0289233b3c P cd75a17ab2604397adab03bb8b5fd75c -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:21:53.503944  6844 consensus_peers.cc:597] T 34f36d59d88f40fe8a2805e604fc6c0a P cd75a17ab2604397adab03bb8b5fd75c -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:21:53.508766  7466 consensus_peers.cc:597] T 404190ce4ce94cecbfcb6ea9d1dd8626 P 7ba59cc884714e8aa5f3f0ecaed84cbb -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:21:53.571556  6844 consensus_peers.cc:597] T 95a75bfe094d4bdc963aba3f08dfcd25 P cd75a17ab2604397adab03bb8b5fd75c -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:21:53.574616  6844 consensus_peers.cc:597] T 44bde925b2e541b69890d70715b85176 P cd75a17ab2604397adab03bb8b5fd75c -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:21:53.587999  7466 consensus_peers.cc:597] T 24ee15416e3145beaa1b8183453729a3 P 7ba59cc884714e8aa5f3f0ecaed84cbb -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:21:53.589514  6844 consensus_peers.cc:597] T 3411566abe2d4c9bb4b2adfdd05e6f17 P cd75a17ab2604397adab03bb8b5fd75c -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:21:53.643415  6844 consensus_peers.cc:597] T f58dc08b12a2494bb9a1372837970ca2 P cd75a17ab2604397adab03bb8b5fd75c -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:21:53.652169  6844 consensus_peers.cc:597] T 90d42e216d9741e190bca19a781291fd P cd75a17ab2604397adab03bb8b5fd75c -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:21:53.692869  7466 consensus_peers.cc:597] T 3fa34c08b205435dba97346991aa1f92 P 7ba59cc884714e8aa5f3f0ecaed84cbb -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:21:53.710129  6844 consensus_peers.cc:597] T a3022224cc81473690653a83d4e99470 P cd75a17ab2604397adab03bb8b5fd75c -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:21:53.722129  6844 consensus_peers.cc:597] T 9e326172347f45e99a0d482b5d8ef768 P cd75a17ab2604397adab03bb8b5fd75c -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:21:53.743140  6844 consensus_peers.cc:597] T c4db81d9d329422bb3b4160ca4ac2d1d P cd75a17ab2604397adab03bb8b5fd75c -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:21:53.738047  6770 consensus_peers.cc:597] T 853ac0a8cbd64ce99457f170216d4d0f P b7ab4784c7344b939bc36f639286f377 -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:21:53.798056  6844 consensus_peers.cc:597] T 7c44c4849aa54f2b94d1f1bef9ed546f P cd75a17ab2604397adab03bb8b5fd75c -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:21:53.919462  7466 consensus_peers.cc:597] T be1a92657f494cac8dd227d152f50151 P 7ba59cc884714e8aa5f3f0ecaed84cbb -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:21:53.924562  6770 consensus_peers.cc:597] T 8c7f33e544204fbaac4078e3e83bbf4e P b7ab4784c7344b939bc36f639286f377 -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:21:53.946380  6844 consensus_peers.cc:597] T 711ef6523deb4cbe8ef2ba61e1c21c98 P cd75a17ab2604397adab03bb8b5fd75c -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:21:54.038616  6770 consensus_peers.cc:597] T 4275cf08e63345f993bce8664eada830 P b7ab4784c7344b939bc36f639286f377 -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:21:54.132478  6770 consensus_peers.cc:597] T 07a92dd554674067a83a9cb68c4773f2 P b7ab4784c7344b939bc36f639286f377 -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:21:54.135838  6770 consensus_peers.cc:597] T 22ccee1b570c4ad3a57bd7aec085b1b4 P b7ab4784c7344b939bc36f639286f377 -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:21:54.239337  6844 consensus_peers.cc:597] T 713b5728a197487c9300b310ab94e5a3 P cd75a17ab2604397adab03bb8b5fd75c -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:21:54.303190  5625 thread.cc:527] Waited for 6000ms trying to join with diag-logger (tid 6753)
W20260709 13:21:54.322934  6844 consensus_peers.cc:597] T 4b8cacb381b746da8d0049b0a83b41dd P cd75a17ab2604397adab03bb8b5fd75c -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:21:54.325063  6770 consensus_peers.cc:597] T 9b3759de40694069b13c0f8bd40e5709 P b7ab4784c7344b939bc36f639286f377 -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:21:54.385602  6770 consensus_peers.cc:597] T 2c240553ce044eedb41541d72b9475d7 P b7ab4784c7344b939bc36f639286f377 -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:21:54.588260  6770 consensus_peers.cc:597] T 4d9def8b32fd443aa94ab1420b06837b P b7ab4784c7344b939bc36f639286f377 -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:21:54.606127  6770 consensus_peers.cc:597] T d33d5ee8ef6f415593d8df52063161ad P b7ab4784c7344b939bc36f639286f377 -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:21:54.631579  6770 consensus_peers.cc:597] T 7887766dc6784fcaa42b35c05fea7a99 P b7ab4784c7344b939bc36f639286f377 -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:21:54.746699  6770 consensus_peers.cc:597] T d8292e16e5654be6bc408560cf256aaa P b7ab4784c7344b939bc36f639286f377 -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:21:54.767704  6614 catalog_manager.cc:4755] TS ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 7a734b5ab7834e05a8c422208acc58b1: Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111)
W20260709 13:21:54.768402  6770 consensus_peers.cc:597] T f5be3a11b23d4ea9b08300a2789821c7 P b7ab4784c7344b939bc36f639286f377 -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:21:54.795984  6770 consensus_peers.cc:597] T 30e88460611e47b2ba16a46a30b5f416 P b7ab4784c7344b939bc36f639286f377 -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:21:54.904693  6770 consensus_peers.cc:597] T f4b8bd455d5a47c18a1380839c6e0d61 P b7ab4784c7344b939bc36f639286f377 -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:21:54.913599  7466 consensus_peers.cc:597] T bb3d8792045a4583ae2e965b1350a5b4 P 7ba59cc884714e8aa5f3f0ecaed84cbb -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:21:54.915894  6770 consensus_peers.cc:597] T b56bf91d90824c959e21e0cee5ba1816 P b7ab4784c7344b939bc36f639286f377 -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:21:54.930969  6770 consensus_peers.cc:597] T f03d0dbf16864ca4bc1bb5e4c0334c0f P b7ab4784c7344b939bc36f639286f377 -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:21:54.935848  6770 consensus_peers.cc:597] T ab432e62819d499eaaf3dd55481dd930 P b7ab4784c7344b939bc36f639286f377 -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:21:54.952905  6770 consensus_peers.cc:597] T 7c37d41cd9164c15a6826ca62a851a69 P b7ab4784c7344b939bc36f639286f377 -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:21:54.960433  6770 consensus_peers.cc:597] T bd6869f07b5a4885a0b99fbe60c3b175 P b7ab4784c7344b939bc36f639286f377 -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:21:54.986002  7466 consensus_peers.cc:597] T fe20b4b48823486ca3b9c648db6ce8aa P 7ba59cc884714e8aa5f3f0ecaed84cbb -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:21:55.008612  6770 consensus_peers.cc:597] T dbdf895bba214ff68685a24fd17dfb5d P b7ab4784c7344b939bc36f639286f377 -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:21:55.082965  7466 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 58873.5us
W20260709 13:21:55.091373  6770 consensus_peers.cc:597] T de3186201e1a40d0b335eeb8b4e256e0 P b7ab4784c7344b939bc36f639286f377 -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:21:55.115634  7466 consensus_peers.cc:597] T 1528ab62b6fe4e3099d08f141afee116 P 7ba59cc884714e8aa5f3f0ecaed84cbb -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:21:55.177011  6770 consensus_peers.cc:597] T 3d65025eea89441290d85dd053810e31 P b7ab4784c7344b939bc36f639286f377 -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:21:55.225443  6770 consensus_peers.cc:597] T f09c2a98de1a4decabd0ff900dd44caa P b7ab4784c7344b939bc36f639286f377 -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:21:55.264981  6770 consensus_peers.cc:597] T a1704639a875409b9959353527b3fd68 P b7ab4784c7344b939bc36f639286f377 -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:21:55.303711  5625 thread.cc:527] Waited for 7000ms trying to join with diag-logger (tid 6753)
W20260709 13:21:55.342967  6770 consensus_peers.cc:597] T 20f6842e26174571996b8dea4151d4be P b7ab4784c7344b939bc36f639286f377 -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:21:55.355144  7466 consensus_peers.cc:597] T b3f13b31a1f84f0d89d007eadd57924c P 7ba59cc884714e8aa5f3f0ecaed84cbb -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:21:55.387398  6844 consensus_peers.cc:597] T e31b9971c15848dea59d4d4130141d9e P cd75a17ab2604397adab03bb8b5fd75c -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:21:55.590492  6770 consensus_peers.cc:597] T e77e330a82df4b43a745d57a68f6f057 P b7ab4784c7344b939bc36f639286f377 -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:21:55.755026  6770 consensus_peers.cc:597] T f3f9c2e2bf644115957398fe4c9459db P b7ab4784c7344b939bc36f639286f377 -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:21:55.809088  7466 consensus_peers.cc:597] T 17587d6730594da4a56fa13a353232a1 P 7ba59cc884714e8aa5f3f0ecaed84cbb -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:21:55.813618  6844 consensus_peers.cc:597] T 34f36d59d88f40fe8a2805e604fc6c0a P cd75a17ab2604397adab03bb8b5fd75c -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:21:55.821844  6844 consensus_peers.cc:597] T 1bf4668eeb70467fb3dc5a0289233b3c P cd75a17ab2604397adab03bb8b5fd75c -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:21:55.896121  7466 consensus_peers.cc:597] T 24ee15416e3145beaa1b8183453729a3 P 7ba59cc884714e8aa5f3f0ecaed84cbb -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:21:55.903373  6844 consensus_peers.cc:597] T 3411566abe2d4c9bb4b2adfdd05e6f17 P cd75a17ab2604397adab03bb8b5fd75c -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:21:55.959286  6844 consensus_peers.cc:597] T 95a75bfe094d4bdc963aba3f08dfcd25 P cd75a17ab2604397adab03bb8b5fd75c -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:21:56.026283  6844 consensus_peers.cc:597] T c4db81d9d329422bb3b4160ca4ac2d1d P cd75a17ab2604397adab03bb8b5fd75c -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:21:56.114645  7466 consensus_peers.cc:597] T 3fa34c08b205435dba97346991aa1f92 P 7ba59cc884714e8aa5f3f0ecaed84cbb -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:21:56.121733  6844 consensus_peers.cc:597] T f58dc08b12a2494bb9a1372837970ca2 P cd75a17ab2604397adab03bb8b5fd75c -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:21:56.133150  6844 consensus_peers.cc:597] T a3022224cc81473690653a83d4e99470 P cd75a17ab2604397adab03bb8b5fd75c -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:21:56.161818  6844 consensus_peers.cc:597] T 44bde925b2e541b69890d70715b85176 P cd75a17ab2604397adab03bb8b5fd75c -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:21:56.181697  7466 consensus_peers.cc:597] T 404190ce4ce94cecbfcb6ea9d1dd8626 P 7ba59cc884714e8aa5f3f0ecaed84cbb -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:21:56.187309  6844 consensus_peers.cc:597] T 90d42e216d9741e190bca19a781291fd P cd75a17ab2604397adab03bb8b5fd75c -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:21:56.304646  5625 thread.cc:527] Waited for 8000ms trying to join with diag-logger (tid 6753)
W20260709 13:21:56.330417  6844 consensus_peers.cc:597] T 711ef6523deb4cbe8ef2ba61e1c21c98 P cd75a17ab2604397adab03bb8b5fd75c -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:21:56.362006  6770 consensus_peers.cc:597] T 853ac0a8cbd64ce99457f170216d4d0f P b7ab4784c7344b939bc36f639286f377 -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:21:56.392710  7466 consensus_peers.cc:597] T be1a92657f494cac8dd227d152f50151 P 7ba59cc884714e8aa5f3f0ecaed84cbb -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:21:56.396319  6770 consensus_peers.cc:597] T 8c7f33e544204fbaac4078e3e83bbf4e P b7ab4784c7344b939bc36f639286f377 -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:21:56.515743  6844 consensus_peers.cc:597] T 9e326172347f45e99a0d482b5d8ef768 P cd75a17ab2604397adab03bb8b5fd75c -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:21:56.615662  6844 consensus_peers.cc:597] T 7c44c4849aa54f2b94d1f1bef9ed546f P cd75a17ab2604397adab03bb8b5fd75c -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:21:56.632416  6844 consensus_peers.cc:597] T 4b8cacb381b746da8d0049b0a83b41dd P cd75a17ab2604397adab03bb8b5fd75c -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:21:56.637003  6770 consensus_peers.cc:597] T 4275cf08e63345f993bce8664eada830 P b7ab4784c7344b939bc36f639286f377 -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:21:56.659736  6770 consensus_peers.cc:597] T 22ccee1b570c4ad3a57bd7aec085b1b4 P b7ab4784c7344b939bc36f639286f377 -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:21:56.703794  6770 consensus_peers.cc:597] T 07a92dd554674067a83a9cb68c4773f2 P b7ab4784c7344b939bc36f639286f377 -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:21:56.841301  6844 consensus_peers.cc:597] T 713b5728a197487c9300b310ab94e5a3 P cd75a17ab2604397adab03bb8b5fd75c -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:21:56.838658  6770 consensus_peers.cc:597] T 2c240553ce044eedb41541d72b9475d7 P b7ab4784c7344b939bc36f639286f377 -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:21:56.961027  6770 consensus_peers.cc:597] T 9b3759de40694069b13c0f8bd40e5709 P b7ab4784c7344b939bc36f639286f377 -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:21:57.108430  6614 catalog_manager.cc:4755] TS ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 427c124d773f483294511e80fe340075: Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111)
W20260709 13:21:57.169013  6770 consensus_peers.cc:597] T d33d5ee8ef6f415593d8df52063161ad P b7ab4784c7344b939bc36f639286f377 -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:21:57.255255  6770 consensus_peers.cc:597] T 30e88460611e47b2ba16a46a30b5f416 P b7ab4784c7344b939bc36f639286f377 -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:21:57.272794  6770 consensus_peers.cc:597] T d8292e16e5654be6bc408560cf256aaa P b7ab4784c7344b939bc36f639286f377 -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:21:57.297262  6770 consensus_peers.cc:597] T 4d9def8b32fd443aa94ab1420b06837b P b7ab4784c7344b939bc36f639286f377 -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:21:57.305250  5625 thread.cc:527] Waited for 9000ms trying to join with diag-logger (tid 6753)
W20260709 13:21:57.367018  6770 consensus_peers.cc:597] T f5be3a11b23d4ea9b08300a2789821c7 P b7ab4784c7344b939bc36f639286f377 -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:21:57.389107  6770 consensus_peers.cc:597] T ab432e62819d499eaaf3dd55481dd930 P b7ab4784c7344b939bc36f639286f377 -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:21:57.440914  6770 consensus_peers.cc:597] T 7887766dc6784fcaa42b35c05fea7a99 P b7ab4784c7344b939bc36f639286f377 -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:21:57.452338  7466 consensus_peers.cc:597] T fe20b4b48823486ca3b9c648db6ce8aa P 7ba59cc884714e8aa5f3f0ecaed84cbb -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:21:57.458355  6770 consensus_peers.cc:597] T dbdf895bba214ff68685a24fd17dfb5d P b7ab4784c7344b939bc36f639286f377 -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:21:57.512859  7466 consensus_peers.cc:597] T bb3d8792045a4583ae2e965b1350a5b4 P 7ba59cc884714e8aa5f3f0ecaed84cbb -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:21:57.526592  6770 consensus_peers.cc:597] T b56bf91d90824c959e21e0cee5ba1816 P b7ab4784c7344b939bc36f639286f377 -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:21:57.531369  6770 consensus_peers.cc:597] T f4b8bd455d5a47c18a1380839c6e0d61 P b7ab4784c7344b939bc36f639286f377 -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:21:57.573274  6770 consensus_peers.cc:597] T de3186201e1a40d0b335eeb8b4e256e0 P b7ab4784c7344b939bc36f639286f377 -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:21:57.585966  6770 consensus_peers.cc:597] T f03d0dbf16864ca4bc1bb5e4c0334c0f P b7ab4784c7344b939bc36f639286f377 -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:21:57.590706  6770 consensus_peers.cc:597] T bd6869f07b5a4885a0b99fbe60c3b175 P b7ab4784c7344b939bc36f639286f377 -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:21:57.645924  6770 consensus_peers.cc:597] T 7c37d41cd9164c15a6826ca62a851a69 P b7ab4784c7344b939bc36f639286f377 -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:21:57.653934  6770 consensus_peers.cc:597] T f09c2a98de1a4decabd0ff900dd44caa P b7ab4784c7344b939bc36f639286f377 -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:21:57.736284  7466 consensus_peers.cc:597] T 1528ab62b6fe4e3099d08f141afee116 P 7ba59cc884714e8aa5f3f0ecaed84cbb -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:21:57.742358  6770 consensus_peers.cc:597] T 3d65025eea89441290d85dd053810e31 P b7ab4784c7344b939bc36f639286f377 -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:21:57.770661  6770 consensus_peers.cc:597] T a1704639a875409b9959353527b3fd68 P b7ab4784c7344b939bc36f639286f377 -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:21:57.831744  7466 consensus_peers.cc:597] T b3f13b31a1f84f0d89d007eadd57924c P 7ba59cc884714e8aa5f3f0ecaed84cbb -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:21:57.910810  6770 consensus_peers.cc:597] T 20f6842e26174571996b8dea4151d4be P b7ab4784c7344b939bc36f639286f377 -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:21:57.960063  6770 consensus_peers.cc:597] T e77e330a82df4b43a745d57a68f6f057 P b7ab4784c7344b939bc36f639286f377 -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:21:58.160780  6844 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111) [suppressed 507 similar messages]
W20260709 13:21:58.170567  6844 consensus_peers.cc:597] T e31b9971c15848dea59d4d4130141d9e P cd75a17ab2604397adab03bb8b5fd75c -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:21:58.213271  6844 consensus_peers.cc:597] T 3411566abe2d4c9bb4b2adfdd05e6f17 P cd75a17ab2604397adab03bb8b5fd75c -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:21:58.262473  7466 consensus_peers.cc:597] T 17587d6730594da4a56fa13a353232a1 P 7ba59cc884714e8aa5f3f0ecaed84cbb -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:21:58.305866  5625 thread.cc:527] Waited for 10000ms trying to join with diag-logger (tid 6753)
W20260709 13:21:58.353302  6844 consensus_peers.cc:597] T 34f36d59d88f40fe8a2805e604fc6c0a P cd75a17ab2604397adab03bb8b5fd75c -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:21:58.389503  6844 consensus_peers.cc:597] T 1bf4668eeb70467fb3dc5a0289233b3c P cd75a17ab2604397adab03bb8b5fd75c -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:21:58.402777  7466 consensus_peers.cc:597] T 24ee15416e3145beaa1b8183453729a3 P 7ba59cc884714e8aa5f3f0ecaed84cbb -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:21:58.416357  6770 consensus_peers.cc:597] T f3f9c2e2bf644115957398fe4c9459db P b7ab4784c7344b939bc36f639286f377 -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:21:58.462025  6844 consensus_peers.cc:597] T c4db81d9d329422bb3b4160ca4ac2d1d P cd75a17ab2604397adab03bb8b5fd75c -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:21:58.537765  7466 consensus_peers.cc:597] T 404190ce4ce94cecbfcb6ea9d1dd8626 P 7ba59cc884714e8aa5f3f0ecaed84cbb -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:21:58.566118  6844 consensus_peers.cc:597] T a3022224cc81473690653a83d4e99470 P cd75a17ab2604397adab03bb8b5fd75c -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:21:58.637393  6770 consensus_peers.cc:597] T 8c7f33e544204fbaac4078e3e83bbf4e P b7ab4784c7344b939bc36f639286f377 -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:21:58.649092  6844 consensus_peers.cc:597] T 44bde925b2e541b69890d70715b85176 P cd75a17ab2604397adab03bb8b5fd75c -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:21:58.653496  6844 consensus_peers.cc:597] T f58dc08b12a2494bb9a1372837970ca2 P cd75a17ab2604397adab03bb8b5fd75c -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:21:58.654035  6844 consensus_peers.cc:597] T 95a75bfe094d4bdc963aba3f08dfcd25 P cd75a17ab2604397adab03bb8b5fd75c -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:21:58.664943  6770 consensus_peers.cc:597] T 853ac0a8cbd64ce99457f170216d4d0f P b7ab4784c7344b939bc36f639286f377 -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:21:58.742234  6844 consensus_peers.cc:597] T 90d42e216d9741e190bca19a781291fd P cd75a17ab2604397adab03bb8b5fd75c -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:21:58.749727  6844 consensus_peers.cc:597] T 711ef6523deb4cbe8ef2ba61e1c21c98 P cd75a17ab2604397adab03bb8b5fd75c -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:21:58.851928  7466 consensus_peers.cc:597] T 3fa34c08b205435dba97346991aa1f92 P 7ba59cc884714e8aa5f3f0ecaed84cbb -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:21:58.881572  6844 consensus_peers.cc:597] T 4b8cacb381b746da8d0049b0a83b41dd P cd75a17ab2604397adab03bb8b5fd75c -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:21:59.018193  7466 consensus_peers.cc:597] T be1a92657f494cac8dd227d152f50151 P 7ba59cc884714e8aa5f3f0ecaed84cbb -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:21:59.032513  6770 consensus_peers.cc:597] T 22ccee1b570c4ad3a57bd7aec085b1b4 P b7ab4784c7344b939bc36f639286f377 -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:21:59.122809  6770 consensus_peers.cc:597] T 07a92dd554674067a83a9cb68c4773f2 P b7ab4784c7344b939bc36f639286f377 -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:21:59.125406  6844 consensus_peers.cc:597] T 9e326172347f45e99a0d482b5d8ef768 P cd75a17ab2604397adab03bb8b5fd75c -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:21:59.257814  6770 consensus_peers.cc:597] T 2c240553ce044eedb41541d72b9475d7 P b7ab4784c7344b939bc36f639286f377 -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:21:59.306468  5625 thread.cc:527] Waited for 11000ms trying to join with diag-logger (tid 6753)
W20260709 13:21:59.365064  6844 consensus_peers.cc:597] T 7c44c4849aa54f2b94d1f1bef9ed546f P cd75a17ab2604397adab03bb8b5fd75c -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:21:59.385748  6770 consensus_peers.cc:597] T 4275cf08e63345f993bce8664eada830 P b7ab4784c7344b939bc36f639286f377 -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:21:59.394044  6770 consensus_peers.cc:597] T 9b3759de40694069b13c0f8bd40e5709 P b7ab4784c7344b939bc36f639286f377 -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:21:59.394562  6844 consensus_peers.cc:597] T 713b5728a197487c9300b310ab94e5a3 P cd75a17ab2604397adab03bb8b5fd75c -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:21:59.580229  6770 consensus_peers.cc:597] T 30e88460611e47b2ba16a46a30b5f416 P b7ab4784c7344b939bc36f639286f377 -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:21:59.683586  6770 consensus_peers.cc:597] T f5be3a11b23d4ea9b08300a2789821c7 P b7ab4784c7344b939bc36f639286f377 -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:21:59.720157  6770 consensus_peers.cc:597] T d33d5ee8ef6f415593d8df52063161ad P b7ab4784c7344b939bc36f639286f377 -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:21:59.760521  6770 consensus_peers.cc:597] T dbdf895bba214ff68685a24fd17dfb5d P b7ab4784c7344b939bc36f639286f377 -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:21:59.761169  6770 consensus_peers.cc:597] T ab432e62819d499eaaf3dd55481dd930 P b7ab4784c7344b939bc36f639286f377 -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:21:59.821816  6770 consensus_peers.cc:597] T b56bf91d90824c959e21e0cee5ba1816 P b7ab4784c7344b939bc36f639286f377 -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:21:59.873435  7466 consensus_peers.cc:597] T fe20b4b48823486ca3b9c648db6ce8aa P 7ba59cc884714e8aa5f3f0ecaed84cbb -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:21:59.894922  6614 catalog_manager.cc:4755] TS ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 3a485a995abc4807b6e511e45419f737: Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111)
W20260709 13:21:59.923081  6770 consensus_peers.cc:597] T 4d9def8b32fd443aa94ab1420b06837b P b7ab4784c7344b939bc36f639286f377 -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:21:59.945825  6770 consensus_peers.cc:597] T d8292e16e5654be6bc408560cf256aaa P b7ab4784c7344b939bc36f639286f377 -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:21:59.972461  6770 consensus_peers.cc:597] T de3186201e1a40d0b335eeb8b4e256e0 P b7ab4784c7344b939bc36f639286f377 -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:21:59.987784  6770 consensus_peers.cc:597] T bd6869f07b5a4885a0b99fbe60c3b175 P b7ab4784c7344b939bc36f639286f377 -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:22:00.012970  6770 consensus_peers.cc:597] T a1704639a875409b9959353527b3fd68 P b7ab4784c7344b939bc36f639286f377 -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:22:00.072624  6770 consensus_peers.cc:597] T f03d0dbf16864ca4bc1bb5e4c0334c0f P b7ab4784c7344b939bc36f639286f377 -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:22:00.098311  6770 consensus_peers.cc:597] T f4b8bd455d5a47c18a1380839c6e0d61 P b7ab4784c7344b939bc36f639286f377 -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:22:00.113586  7466 consensus_peers.cc:597] T bb3d8792045a4583ae2e965b1350a5b4 P 7ba59cc884714e8aa5f3f0ecaed84cbb -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:22:00.149474  6770 consensus_peers.cc:597] T f09c2a98de1a4decabd0ff900dd44caa P b7ab4784c7344b939bc36f639286f377 -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:22:00.207296  7466 consensus_peers.cc:597] T 1528ab62b6fe4e3099d08f141afee116 P 7ba59cc884714e8aa5f3f0ecaed84cbb -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:22:00.261689  6770 consensus_peers.cc:597] T 20f6842e26174571996b8dea4151d4be P b7ab4784c7344b939bc36f639286f377 -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:22:00.268271  7466 consensus_peers.cc:597] T b3f13b31a1f84f0d89d007eadd57924c P 7ba59cc884714e8aa5f3f0ecaed84cbb -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:22:00.273976  6770 consensus_peers.cc:597] T 3d65025eea89441290d85dd053810e31 P b7ab4784c7344b939bc36f639286f377 -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:22:00.296873  6770 consensus_peers.cc:597] T 7c37d41cd9164c15a6826ca62a851a69 P b7ab4784c7344b939bc36f639286f377 -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:22:00.298009  6770 consensus_peers.cc:597] T 7887766dc6784fcaa42b35c05fea7a99 P b7ab4784c7344b939bc36f639286f377 -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:22:00.307245  5625 thread.cc:527] Waited for 12000ms trying to join with diag-logger (tid 6753)
W20260709 13:22:00.336578  6770 consensus_peers.cc:597] T e77e330a82df4b43a745d57a68f6f057 P b7ab4784c7344b939bc36f639286f377 -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:22:00.664181  6844 consensus_peers.cc:597] T 3411566abe2d4c9bb4b2adfdd05e6f17 P cd75a17ab2604397adab03bb8b5fd75c -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:22:00.704205  6844 consensus_peers.cc:597] T c4db81d9d329422bb3b4160ca4ac2d1d P cd75a17ab2604397adab03bb8b5fd75c -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:22:00.747579  6844 consensus_peers.cc:597] T e31b9971c15848dea59d4d4130141d9e P cd75a17ab2604397adab03bb8b5fd75c -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:22:00.898339  7466 consensus_peers.cc:597] T 17587d6730594da4a56fa13a353232a1 P 7ba59cc884714e8aa5f3f0ecaed84cbb -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:22:00.929889  6844 consensus_peers.cc:597] T 1bf4668eeb70467fb3dc5a0289233b3c P cd75a17ab2604397adab03bb8b5fd75c -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:22:00.945367  6844 consensus_peers.cc:597] T 34f36d59d88f40fe8a2805e604fc6c0a P cd75a17ab2604397adab03bb8b5fd75c -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:22:01.018790  6770 consensus_peers.cc:597] T f3f9c2e2bf644115957398fe4c9459db P b7ab4784c7344b939bc36f639286f377 -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:22:01.057436  7466 consensus_peers.cc:597] T 24ee15416e3145beaa1b8183453729a3 P 7ba59cc884714e8aa5f3f0ecaed84cbb -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:22:01.093605  6844 consensus_peers.cc:597] T 95a75bfe094d4bdc963aba3f08dfcd25 P cd75a17ab2604397adab03bb8b5fd75c -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:22:01.117384  7466 consensus_peers.cc:597] T 404190ce4ce94cecbfcb6ea9d1dd8626 P 7ba59cc884714e8aa5f3f0ecaed84cbb -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:22:01.131045  6844 consensus_peers.cc:597] T f58dc08b12a2494bb9a1372837970ca2 P cd75a17ab2604397adab03bb8b5fd75c -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:22:01.147416  6770 consensus_peers.cc:597] T 853ac0a8cbd64ce99457f170216d4d0f P b7ab4784c7344b939bc36f639286f377 -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:22:01.257663  6844 consensus_peers.cc:597] T 90d42e216d9741e190bca19a781291fd P cd75a17ab2604397adab03bb8b5fd75c -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:22:01.308235  5625 thread.cc:527] Waited for 13000ms trying to join with diag-logger (tid 6753)
W20260709 13:22:01.407596  6844 consensus_peers.cc:597] T a3022224cc81473690653a83d4e99470 P cd75a17ab2604397adab03bb8b5fd75c -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:22:01.408650  6844 consensus_peers.cc:597] T 44bde925b2e541b69890d70715b85176 P cd75a17ab2604397adab03bb8b5fd75c -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:22:01.408941  6770 consensus_peers.cc:597] T 22ccee1b570c4ad3a57bd7aec085b1b4 P b7ab4784c7344b939bc36f639286f377 -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:22:01.437561  6844 consensus_peers.cc:597] T 4b8cacb381b746da8d0049b0a83b41dd P cd75a17ab2604397adab03bb8b5fd75c -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:22:01.446419  6770 consensus_peers.cc:597] T 8c7f33e544204fbaac4078e3e83bbf4e P b7ab4784c7344b939bc36f639286f377 -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:22:01.465483  6614 catalog_manager.cc:4755] TS ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet ce4f062dcd314d43a63ca74067cb5ee3: Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111)
W20260709 13:22:01.535607  7466 consensus_peers.cc:597] T be1a92657f494cac8dd227d152f50151 P 7ba59cc884714e8aa5f3f0ecaed84cbb -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:22:01.611106  6844 consensus_peers.cc:597] T 711ef6523deb4cbe8ef2ba61e1c21c98 P cd75a17ab2604397adab03bb8b5fd75c -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:22:01.780578  6770 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 124303us
W20260709 13:22:01.878580  7466 consensus_peers.cc:597] T 3fa34c08b205435dba97346991aa1f92 P 7ba59cc884714e8aa5f3f0ecaed84cbb -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:22:01.914736  6770 consensus_peers.cc:597] T 07a92dd554674067a83a9cb68c4773f2 P b7ab4784c7344b939bc36f639286f377 -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:22:01.915819  6770 consensus_peers.cc:597] T 4275cf08e63345f993bce8664eada830 P b7ab4784c7344b939bc36f639286f377 -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:22:01.930272  6770 consensus_peers.cc:597] T 2c240553ce044eedb41541d72b9475d7 P b7ab4784c7344b939bc36f639286f377 -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:22:01.938653  6844 consensus_peers.cc:597] T 9e326172347f45e99a0d482b5d8ef768 P cd75a17ab2604397adab03bb8b5fd75c -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:22:01.941613  6844 consensus_peers.cc:597] T 713b5728a197487c9300b310ab94e5a3 P cd75a17ab2604397adab03bb8b5fd75c -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:22:01.990425  6844 consensus_peers.cc:597] T 7c44c4849aa54f2b94d1f1bef9ed546f P cd75a17ab2604397adab03bb8b5fd75c -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:22:02.010829  6770 consensus_peers.cc:597] T 9b3759de40694069b13c0f8bd40e5709 P b7ab4784c7344b939bc36f639286f377 -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:22:02.041553  6770 consensus_peers.cc:597] T dbdf895bba214ff68685a24fd17dfb5d P b7ab4784c7344b939bc36f639286f377 -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:22:02.096381  6770 consensus_peers.cc:597] T d33d5ee8ef6f415593d8df52063161ad P b7ab4784c7344b939bc36f639286f377 -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:22:02.122895  6770 consensus_peers.cc:597] T f5be3a11b23d4ea9b08300a2789821c7 P b7ab4784c7344b939bc36f639286f377 -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:22:02.234174  6770 consensus_peers.cc:597] T 30e88460611e47b2ba16a46a30b5f416 P b7ab4784c7344b939bc36f639286f377 -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:22:02.309389  5625 thread.cc:527] Waited for 14000ms trying to join with diag-logger (tid 6753)
W20260709 13:22:02.377426  6770 consensus_peers.cc:597] T ab432e62819d499eaaf3dd55481dd930 P b7ab4784c7344b939bc36f639286f377 -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:22:02.430156  7466 consensus_peers.cc:597] T bb3d8792045a4583ae2e965b1350a5b4 P 7ba59cc884714e8aa5f3f0ecaed84cbb -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:22:02.477682  6770 consensus_peers.cc:597] T f03d0dbf16864ca4bc1bb5e4c0334c0f P b7ab4784c7344b939bc36f639286f377 -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:22:02.478272  6770 consensus_peers.cc:597] T b56bf91d90824c959e21e0cee5ba1816 P b7ab4784c7344b939bc36f639286f377 -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:22:02.515378  6770 consensus_peers.cc:597] T de3186201e1a40d0b335eeb8b4e256e0 P b7ab4784c7344b939bc36f639286f377 -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:22:02.527472  6770 consensus_peers.cc:597] T 4d9def8b32fd443aa94ab1420b06837b P b7ab4784c7344b939bc36f639286f377 -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:22:02.560593  6770 consensus_peers.cc:597] T f09c2a98de1a4decabd0ff900dd44caa P b7ab4784c7344b939bc36f639286f377 -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:22:02.570217  7466 consensus_peers.cc:597] T fe20b4b48823486ca3b9c648db6ce8aa P 7ba59cc884714e8aa5f3f0ecaed84cbb -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:22:02.571218  6770 consensus_peers.cc:597] T f4b8bd455d5a47c18a1380839c6e0d61 P b7ab4784c7344b939bc36f639286f377 -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:22:02.586417  6770 consensus_peers.cc:597] T bd6869f07b5a4885a0b99fbe60c3b175 P b7ab4784c7344b939bc36f639286f377 -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:22:02.618105  6770 consensus_peers.cc:597] T d8292e16e5654be6bc408560cf256aaa P b7ab4784c7344b939bc36f639286f377 -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:22:02.642922  6770 consensus_peers.cc:597] T 20f6842e26174571996b8dea4151d4be P b7ab4784c7344b939bc36f639286f377 -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:22:02.677009  6770 consensus_peers.cc:597] T a1704639a875409b9959353527b3fd68 P b7ab4784c7344b939bc36f639286f377 -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:22:02.864308  6770 consensus_peers.cc:597] T 7887766dc6784fcaa42b35c05fea7a99 P b7ab4784c7344b939bc36f639286f377 -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:22:02.880168  6770 consensus_peers.cc:597] T 7c37d41cd9164c15a6826ca62a851a69 P b7ab4784c7344b939bc36f639286f377 -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:22:02.974442  6770 consensus_peers.cc:597] T e77e330a82df4b43a745d57a68f6f057 P b7ab4784c7344b939bc36f639286f377 -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:22:02.981539  6770 consensus_peers.cc:597] T 3d65025eea89441290d85dd053810e31 P b7ab4784c7344b939bc36f639286f377 -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:22:03.076314  7466 consensus_peers.cc:597] T b3f13b31a1f84f0d89d007eadd57924c P 7ba59cc884714e8aa5f3f0ecaed84cbb -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:22:03.093822  6614 catalog_manager.cc:4755] TS ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 7a734b5ab7834e05a8c422208acc58b1: Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111)
W20260709 13:22:03.103937  7466 consensus_peers.cc:597] T 1528ab62b6fe4e3099d08f141afee116 P 7ba59cc884714e8aa5f3f0ecaed84cbb -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:22:03.165597  6770 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111) [suppressed 505 similar messages]
W20260709 13:22:03.309993  5625 thread.cc:527] Waited for 15000ms trying to join with diag-logger (tid 6753)
W20260709 13:22:03.430269  7466 consensus_peers.cc:597] T 17587d6730594da4a56fa13a353232a1 P 7ba59cc884714e8aa5f3f0ecaed84cbb -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:22:03.436975  6844 consensus_peers.cc:597] T 1bf4668eeb70467fb3dc5a0289233b3c P cd75a17ab2604397adab03bb8b5fd75c -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:22:03.437965  6844 consensus_peers.cc:597] T e31b9971c15848dea59d4d4130141d9e P cd75a17ab2604397adab03bb8b5fd75c -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:22:03.444213  6844 consensus_peers.cc:597] T 3411566abe2d4c9bb4b2adfdd05e6f17 P cd75a17ab2604397adab03bb8b5fd75c -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:22:03.463374  7466 consensus_peers.cc:597] T 24ee15416e3145beaa1b8183453729a3 P 7ba59cc884714e8aa5f3f0ecaed84cbb -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:22:03.626451  6770 consensus_peers.cc:597] T f3f9c2e2bf644115957398fe4c9459db P b7ab4784c7344b939bc36f639286f377 -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:22:03.642436  6844 consensus_peers.cc:597] T a3022224cc81473690653a83d4e99470 P cd75a17ab2604397adab03bb8b5fd75c -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:22:03.686403  6844 consensus_peers.cc:597] T 34f36d59d88f40fe8a2805e604fc6c0a P cd75a17ab2604397adab03bb8b5fd75c -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:22:03.741959  7466 consensus_peers.cc:597] T 404190ce4ce94cecbfcb6ea9d1dd8626 P 7ba59cc884714e8aa5f3f0ecaed84cbb -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:22:03.745832  6844 consensus_peers.cc:597] T c4db81d9d329422bb3b4160ca4ac2d1d P cd75a17ab2604397adab03bb8b5fd75c -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:22:03.822031  6844 consensus_peers.cc:597] T 90d42e216d9741e190bca19a781291fd P cd75a17ab2604397adab03bb8b5fd75c -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:22:03.850382  7466 consensus_peers.cc:597] T be1a92657f494cac8dd227d152f50151 P 7ba59cc884714e8aa5f3f0ecaed84cbb -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:22:03.863173  6844 consensus_peers.cc:597] T 44bde925b2e541b69890d70715b85176 P cd75a17ab2604397adab03bb8b5fd75c -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:22:03.913866  6844 consensus_peers.cc:597] T f58dc08b12a2494bb9a1372837970ca2 P cd75a17ab2604397adab03bb8b5fd75c -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:22:03.943864  6770 consensus_peers.cc:597] T 853ac0a8cbd64ce99457f170216d4d0f P b7ab4784c7344b939bc36f639286f377 -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:22:03.976131  6770 consensus_peers.cc:597] T 07a92dd554674067a83a9cb68c4773f2 P b7ab4784c7344b939bc36f639286f377 -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:22:03.986174  6770 consensus_peers.cc:597] T 8c7f33e544204fbaac4078e3e83bbf4e P b7ab4784c7344b939bc36f639286f377 -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:22:04.026101  6844 consensus_peers.cc:597] T 95a75bfe094d4bdc963aba3f08dfcd25 P cd75a17ab2604397adab03bb8b5fd75c -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:22:04.102428  6770 consensus_peers.cc:597] T 2c240553ce044eedb41541d72b9475d7 P b7ab4784c7344b939bc36f639286f377 -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:22:04.228070  6844 consensus_peers.cc:597] T 9e326172347f45e99a0d482b5d8ef768 P cd75a17ab2604397adab03bb8b5fd75c -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:22:04.261235  6844 consensus_peers.cc:597] T 4b8cacb381b746da8d0049b0a83b41dd P cd75a17ab2604397adab03bb8b5fd75c -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:22:04.279284  6770 consensus_peers.cc:597] T 22ccee1b570c4ad3a57bd7aec085b1b4 P b7ab4784c7344b939bc36f639286f377 -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:22:04.292299  6844 consensus_peers.cc:597] T 711ef6523deb4cbe8ef2ba61e1c21c98 P cd75a17ab2604397adab03bb8b5fd75c -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:22:04.310496  5625 thread.cc:527] Waited for 16000ms trying to join with diag-logger (tid 6753)
W20260709 13:22:04.320370  7466 consensus_peers.cc:597] T 3fa34c08b205435dba97346991aa1f92 P 7ba59cc884714e8aa5f3f0ecaed84cbb -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:22:04.383101  6844 consensus_peers.cc:597] T 713b5728a197487c9300b310ab94e5a3 P cd75a17ab2604397adab03bb8b5fd75c -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:22:04.392925  6770 consensus_peers.cc:597] T 9b3759de40694069b13c0f8bd40e5709 P b7ab4784c7344b939bc36f639286f377 -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:22:04.447834  6770 consensus_peers.cc:597] T 4275cf08e63345f993bce8664eada830 P b7ab4784c7344b939bc36f639286f377 -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:22:04.448578  6770 consensus_peers.cc:597] T dbdf895bba214ff68685a24fd17dfb5d P b7ab4784c7344b939bc36f639286f377 -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:22:04.612516  6844 consensus_peers.cc:597] T 7c44c4849aa54f2b94d1f1bef9ed546f P cd75a17ab2604397adab03bb8b5fd75c -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:22:04.738639  6770 consensus_peers.cc:597] T d33d5ee8ef6f415593d8df52063161ad P b7ab4784c7344b939bc36f639286f377 -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:22:04.759233  6770 consensus_peers.cc:597] T f5be3a11b23d4ea9b08300a2789821c7 P b7ab4784c7344b939bc36f639286f377 -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:22:04.763549  6770 consensus_peers.cc:597] T 30e88460611e47b2ba16a46a30b5f416 P b7ab4784c7344b939bc36f639286f377 -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:22:04.764325  6770 consensus_peers.cc:597] T d8292e16e5654be6bc408560cf256aaa P b7ab4784c7344b939bc36f639286f377 -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:22:04.899968  6770 consensus_peers.cc:597] T f09c2a98de1a4decabd0ff900dd44caa P b7ab4784c7344b939bc36f639286f377 -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:22:04.912335  6770 consensus_peers.cc:597] T b56bf91d90824c959e21e0cee5ba1816 P b7ab4784c7344b939bc36f639286f377 -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:22:04.929203  7466 consensus_peers.cc:597] T bb3d8792045a4583ae2e965b1350a5b4 P 7ba59cc884714e8aa5f3f0ecaed84cbb -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:22:04.981417  6770 consensus_peers.cc:597] T ab432e62819d499eaaf3dd55481dd930 P b7ab4784c7344b939bc36f639286f377 -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:22:04.992333  6770 consensus_peers.cc:597] T de3186201e1a40d0b335eeb8b4e256e0 P b7ab4784c7344b939bc36f639286f377 -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:22:05.002434  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 53548.1us
W20260709 13:22:05.042418  7466 consensus_peers.cc:597] T fe20b4b48823486ca3b9c648db6ce8aa P 7ba59cc884714e8aa5f3f0ecaed84cbb -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:22:05.076287  6770 consensus_peers.cc:597] T f4b8bd455d5a47c18a1380839c6e0d61 P b7ab4784c7344b939bc36f639286f377 -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:22:05.116840  6770 consensus_peers.cc:597] T 4d9def8b32fd443aa94ab1420b06837b P b7ab4784c7344b939bc36f639286f377 -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:22:05.120774  6770 consensus_peers.cc:597] T f03d0dbf16864ca4bc1bb5e4c0334c0f P b7ab4784c7344b939bc36f639286f377 -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:22:05.201771  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 57716.5us
W20260709 13:22:05.226974  6770 consensus_peers.cc:597] T bd6869f07b5a4885a0b99fbe60c3b175 P b7ab4784c7344b939bc36f639286f377 -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:22:05.261137  6770 consensus_peers.cc:597] T 20f6842e26174571996b8dea4151d4be P b7ab4784c7344b939bc36f639286f377 -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:22:05.311036  5625 thread.cc:527] Waited for 17000ms trying to join with diag-logger (tid 6753)
W20260709 13:22:05.327828  6770 consensus_peers.cc:597] T a1704639a875409b9959353527b3fd68 P b7ab4784c7344b939bc36f639286f377 -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:22:05.380612  6770 consensus_peers.cc:597] T 7c37d41cd9164c15a6826ca62a851a69 P b7ab4784c7344b939bc36f639286f377 -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:22:05.413975  6770 consensus_peers.cc:597] T 7887766dc6784fcaa42b35c05fea7a99 P b7ab4784c7344b939bc36f639286f377 -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:22:05.439237  6614 catalog_manager.cc:4755] TS ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 427c124d773f483294511e80fe340075: Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111)
W20260709 13:22:05.457731  6770 consensus_peers.cc:597] T 3d65025eea89441290d85dd053810e31 P b7ab4784c7344b939bc36f639286f377 -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:22:05.547518  6770 consensus_peers.cc:597] T e77e330a82df4b43a745d57a68f6f057 P b7ab4784c7344b939bc36f639286f377 -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:22:05.547672  7466 consensus_peers.cc:597] T b3f13b31a1f84f0d89d007eadd57924c P 7ba59cc884714e8aa5f3f0ecaed84cbb -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:22:05.764506  7466 consensus_peers.cc:597] T 1528ab62b6fe4e3099d08f141afee116 P 7ba59cc884714e8aa5f3f0ecaed84cbb -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:22:05.853893  6844 consensus_peers.cc:597] T 1bf4668eeb70467fb3dc5a0289233b3c P cd75a17ab2604397adab03bb8b5fd75c -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:22:05.894531  7466 consensus_peers.cc:597] T 24ee15416e3145beaa1b8183453729a3 P 7ba59cc884714e8aa5f3f0ecaed84cbb -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:22:05.924273  6844 consensus_peers.cc:597] T c4db81d9d329422bb3b4160ca4ac2d1d P cd75a17ab2604397adab03bb8b5fd75c -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:22:05.982007  6844 consensus_peers.cc:597] T 3411566abe2d4c9bb4b2adfdd05e6f17 P cd75a17ab2604397adab03bb8b5fd75c -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:22:06.050202  6844 consensus_peers.cc:597] T e31b9971c15848dea59d4d4130141d9e P cd75a17ab2604397adab03bb8b5fd75c -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:22:06.096961  7466 consensus_peers.cc:597] T 404190ce4ce94cecbfcb6ea9d1dd8626 P 7ba59cc884714e8aa5f3f0ecaed84cbb -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:22:06.115092  7466 consensus_peers.cc:597] T 17587d6730594da4a56fa13a353232a1 P 7ba59cc884714e8aa5f3f0ecaed84cbb -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:22:06.198231  6844 consensus_peers.cc:597] T 44bde925b2e541b69890d70715b85176 P cd75a17ab2604397adab03bb8b5fd75c -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:22:06.227731  6844 consensus_peers.cc:597] T a3022224cc81473690653a83d4e99470 P cd75a17ab2604397adab03bb8b5fd75c -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:22:06.303645  7466 consensus_peers.cc:597] T be1a92657f494cac8dd227d152f50151 P 7ba59cc884714e8aa5f3f0ecaed84cbb -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:22:06.311542  5625 thread.cc:527] Waited for 18000ms trying to join with diag-logger (tid 6753)
W20260709 13:22:06.314356  6844 consensus_peers.cc:597] T 34f36d59d88f40fe8a2805e604fc6c0a P cd75a17ab2604397adab03bb8b5fd75c -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:22:06.320196  6844 consensus_peers.cc:597] T f58dc08b12a2494bb9a1372837970ca2 P cd75a17ab2604397adab03bb8b5fd75c -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:22:06.367687  6770 consensus_peers.cc:597] T 853ac0a8cbd64ce99457f170216d4d0f P b7ab4784c7344b939bc36f639286f377 -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:22:06.417461  6770 consensus_peers.cc:597] T f3f9c2e2bf644115957398fe4c9459db P b7ab4784c7344b939bc36f639286f377 -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:22:06.521206  6770 consensus_peers.cc:597] T 07a92dd554674067a83a9cb68c4773f2 P b7ab4784c7344b939bc36f639286f377 -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:22:06.522367  6844 consensus_peers.cc:597] T 90d42e216d9741e190bca19a781291fd P cd75a17ab2604397adab03bb8b5fd75c -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:22:06.526015  6844 consensus_peers.cc:597] T 95a75bfe094d4bdc963aba3f08dfcd25 P cd75a17ab2604397adab03bb8b5fd75c -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:22:06.685511  7466 consensus_peers.cc:597] T 3fa34c08b205435dba97346991aa1f92 P 7ba59cc884714e8aa5f3f0ecaed84cbb -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:22:06.700599  6770 consensus_peers.cc:597] T 8c7f33e544204fbaac4078e3e83bbf4e P b7ab4784c7344b939bc36f639286f377 -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:22:06.722043  6844 consensus_peers.cc:597] T 4b8cacb381b746da8d0049b0a83b41dd P cd75a17ab2604397adab03bb8b5fd75c -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:22:06.723440  6770 consensus_peers.cc:597] T 22ccee1b570c4ad3a57bd7aec085b1b4 P b7ab4784c7344b939bc36f639286f377 -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:22:06.765082  6844 consensus_peers.cc:597] T 9e326172347f45e99a0d482b5d8ef768 P cd75a17ab2604397adab03bb8b5fd75c -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:22:06.803527  6770 consensus_peers.cc:597] T dbdf895bba214ff68685a24fd17dfb5d P b7ab4784c7344b939bc36f639286f377 -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:22:06.804216  6770 consensus_peers.cc:597] T 2c240553ce044eedb41541d72b9475d7 P b7ab4784c7344b939bc36f639286f377 -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:22:06.917475  6770 consensus_peers.cc:597] T 9b3759de40694069b13c0f8bd40e5709 P b7ab4784c7344b939bc36f639286f377 -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:22:06.997397  6844 consensus_peers.cc:597] T 713b5728a197487c9300b310ab94e5a3 P cd75a17ab2604397adab03bb8b5fd75c -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:22:07.000291  6844 consensus_peers.cc:597] T 711ef6523deb4cbe8ef2ba61e1c21c98 P cd75a17ab2604397adab03bb8b5fd75c -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:22:07.066917  6770 consensus_peers.cc:597] T f5be3a11b23d4ea9b08300a2789821c7 P b7ab4784c7344b939bc36f639286f377 -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:22:07.140919  6770 consensus_peers.cc:597] T 4275cf08e63345f993bce8664eada830 P b7ab4784c7344b939bc36f639286f377 -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:22:07.151564  6844 consensus_peers.cc:597] T 7c44c4849aa54f2b94d1f1bef9ed546f P cd75a17ab2604397adab03bb8b5fd75c -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:22:07.215821  6770 consensus_peers.cc:597] T 30e88460611e47b2ba16a46a30b5f416 P b7ab4784c7344b939bc36f639286f377 -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:22:07.250366  6770 consensus_peers.cc:597] T d8292e16e5654be6bc408560cf256aaa P b7ab4784c7344b939bc36f639286f377 -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:22:07.252420  6770 consensus_peers.cc:597] T b56bf91d90824c959e21e0cee5ba1816 P b7ab4784c7344b939bc36f639286f377 -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:22:07.282655  6770 consensus_peers.cc:597] T f09c2a98de1a4decabd0ff900dd44caa P b7ab4784c7344b939bc36f639286f377 -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:22:07.312127  5625 thread.cc:527] Waited for 19000ms trying to join with diag-logger (tid 6753)
W20260709 13:22:07.321403  6770 consensus_peers.cc:597] T f4b8bd455d5a47c18a1380839c6e0d61 P b7ab4784c7344b939bc36f639286f377 -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:22:07.337545  6770 consensus_peers.cc:597] T d33d5ee8ef6f415593d8df52063161ad P b7ab4784c7344b939bc36f639286f377 -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:22:07.412549  6770 consensus_peers.cc:597] T ab432e62819d499eaaf3dd55481dd930 P b7ab4784c7344b939bc36f639286f377 -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:22:07.415042  7466 consensus_peers.cc:597] T fe20b4b48823486ca3b9c648db6ce8aa P 7ba59cc884714e8aa5f3f0ecaed84cbb -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:22:07.524165  7466 consensus_peers.cc:597] T bb3d8792045a4583ae2e965b1350a5b4 P 7ba59cc884714e8aa5f3f0ecaed84cbb -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:22:07.595022  6770 consensus_peers.cc:597] T 4d9def8b32fd443aa94ab1420b06837b P b7ab4784c7344b939bc36f639286f377 -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:22:07.647341  6770 consensus_peers.cc:597] T bd6869f07b5a4885a0b99fbe60c3b175 P b7ab4784c7344b939bc36f639286f377 -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:22:07.777056  7466 consensus_peers.cc:597] T b3f13b31a1f84f0d89d007eadd57924c P 7ba59cc884714e8aa5f3f0ecaed84cbb -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 13:22:07.911175  6770 consensus_peers.cc:597] T de3186201e1a40d0b335eeb8b4e256e0 P b7ab4784c7344b939bc36f639286f377 -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:22:08.029326  6770 consensus_peers.cc:597] T e77e330a82df4b43a745d57a68f6f057 P b7ab4784c7344b939bc36f639286f377 -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:22:08.080227  6770 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 50934us
W20260709 13:22:08.086971  6770 consensus_peers.cc:597] T 7887766dc6784fcaa42b35c05fea7a99 P b7ab4784c7344b939bc36f639286f377 -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:22:08.089571  6770 consensus_peers.cc:597] T 20f6842e26174571996b8dea4151d4be P b7ab4784c7344b939bc36f639286f377 -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:22:08.160753  6614 catalog_manager.cc:4755] TS ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 3a485a995abc4807b6e511e45419f737: Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111)
W20260709 13:22:08.312763  5625 thread.cc:527] Waited for 20000ms trying to join with diag-logger (tid 6753)
W20260709 13:22:08.615823  6770 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 501119us
W20260709 13:22:08.616613  6770 consensus_peers.cc:597] T a1704639a875409b9959353527b3fd68 P b7ab4784c7344b939bc36f639286f377 -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:22:08.617023  6770 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111) [suppressed 494 similar messages]
W20260709 13:22:08.623245  6770 consensus_peers.cc:597] T 7c37d41cd9164c15a6826ca62a851a69 P b7ab4784c7344b939bc36f639286f377 -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:22:08.782277  7466 consensus_peers.cc:597] T 1528ab62b6fe4e3099d08f141afee116 P 7ba59cc884714e8aa5f3f0ecaed84cbb -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:22:08.784941  7466 consensus_peers.cc:597] T 24ee15416e3145beaa1b8183453729a3 P 7ba59cc884714e8aa5f3f0ecaed84cbb -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 13:22:08.802717  6770 consensus_peers.cc:597] T 3d65025eea89441290d85dd053810e31 P b7ab4784c7344b939bc36f639286f377 -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:22:08.806684  6770 consensus_peers.cc:597] T f03d0dbf16864ca4bc1bb5e4c0334c0f P b7ab4784c7344b939bc36f639286f377 -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:22:08.809114  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 56877.5us
W20260709 13:22:08.830699  7466 consensus_peers.cc:597] T 404190ce4ce94cecbfcb6ea9d1dd8626 P 7ba59cc884714e8aa5f3f0ecaed84cbb -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 13:22:08.972215  6844 consensus_peers.cc:597] T 1bf4668eeb70467fb3dc5a0289233b3c P cd75a17ab2604397adab03bb8b5fd75c -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 13:22:08.973613  6844 consensus_peers.cc:597] T 3411566abe2d4c9bb4b2adfdd05e6f17 P cd75a17ab2604397adab03bb8b5fd75c -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:22:08.974262  6844 consensus_peers.cc:597] T c4db81d9d329422bb3b4160ca4ac2d1d P cd75a17ab2604397adab03bb8b5fd75c -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 13:22:09.182129  6844 consensus_peers.cc:597] T e31b9971c15848dea59d4d4130141d9e P cd75a17ab2604397adab03bb8b5fd75c -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 13:22:09.187426  7466 consensus_peers.cc:597] T 17587d6730594da4a56fa13a353232a1 P 7ba59cc884714e8aa5f3f0ecaed84cbb -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 13:22:09.327322  6844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.66:42817, user_credentials={real_user=slave}} blocked reactor thread for 118337us
I20260709 13:22:09.399392  5625 tablet_server.cc:196] TabletServer@127.5.126.65:0 shutdown complete.
W20260709 13:22:09.407366  7466 consensus_peers.cc:597] T be1a92657f494cac8dd227d152f50151 P 7ba59cc884714e8aa5f3f0ecaed84cbb -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 13:22:09.446265  6770 consensus_peers.cc:597] T 853ac0a8cbd64ce99457f170216d4d0f P b7ab4784c7344b939bc36f639286f377 -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 13:22:09.458201  6844 consensus_peers.cc:597] T 95a75bfe094d4bdc963aba3f08dfcd25 P cd75a17ab2604397adab03bb8b5fd75c -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:22:09.485877  6661 debug-util.cc:398] Leaking SignalData structure 0x7b0800178720 after lost signal to thread 5628
W20260709 13:22:09.490526  6661 debug-util.cc:398] Leaking SignalData structure 0x7b080035c700 after lost signal to thread 6664
W20260709 13:22:09.492513  6661 debug-util.cc:398] Leaking SignalData structure 0x7b08001f17a0 after lost signal to thread 6831
W20260709 13:22:09.493983  6661 debug-util.cc:398] Leaking SignalData structure 0x7b08003f22c0 after lost signal to thread 6905
W20260709 13:22:09.495481  6661 debug-util.cc:398] Leaking SignalData structure 0x7b08002f4560 after lost signal to thread 7527
W20260709 13:22:09.496021  6661 debug-util.cc:398] Leaking SignalData structure 0x7b0800129840 after lost signal to thread 14625
W20260709 13:22:09.499902  6844 consensus_peers.cc:597] T 44bde925b2e541b69890d70715b85176 P cd75a17ab2604397adab03bb8b5fd75c -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 13:22:09.500735  6844 consensus_peers.cc:597] T a3022224cc81473690653a83d4e99470 P cd75a17ab2604397adab03bb8b5fd75c -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:22:09.504151  6844 consensus_peers.cc:597] T 90d42e216d9741e190bca19a781291fd P cd75a17ab2604397adab03bb8b5fd75c -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 13:22:09.520467  6770 consensus_peers.cc:597] T 8c7f33e544204fbaac4078e3e83bbf4e P b7ab4784c7344b939bc36f639286f377 -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 13:22:09.554893  6770 consensus_peers.cc:597] T 07a92dd554674067a83a9cb68c4773f2 P b7ab4784c7344b939bc36f639286f377 -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 13:22:09.559739  6770 consensus_peers.cc:597] T f3f9c2e2bf644115957398fe4c9459db P b7ab4784c7344b939bc36f639286f377 -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:22:09.576144  6844 consensus_peers.cc:597] T f58dc08b12a2494bb9a1372837970ca2 P cd75a17ab2604397adab03bb8b5fd75c -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 13:22:09.576731  6844 consensus_peers.cc:597] T 34f36d59d88f40fe8a2805e604fc6c0a P cd75a17ab2604397adab03bb8b5fd75c -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 13:22:09.591652  6844 consensus_peers.cc:597] T 4b8cacb381b746da8d0049b0a83b41dd P cd75a17ab2604397adab03bb8b5fd75c -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:22:09.790555  7466 consensus_peers.cc:597] T 3fa34c08b205435dba97346991aa1f92 P 7ba59cc884714e8aa5f3f0ecaed84cbb -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 13:22:09.836694  6770 consensus_peers.cc:597] T dbdf895bba214ff68685a24fd17dfb5d P b7ab4784c7344b939bc36f639286f377 -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:22:09.843420  6770 consensus_peers.cc:597] T 22ccee1b570c4ad3a57bd7aec085b1b4 P b7ab4784c7344b939bc36f639286f377 -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 13:22:09.866088  6770 consensus_peers.cc:597] T d8292e16e5654be6bc408560cf256aaa P b7ab4784c7344b939bc36f639286f377 -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:22:09.899550  6770 consensus_peers.cc:597] T f09c2a98de1a4decabd0ff900dd44caa P b7ab4784c7344b939bc36f639286f377 -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 13:22:09.934723  6844 consensus_peers.cc:597] T 711ef6523deb4cbe8ef2ba61e1c21c98 P cd75a17ab2604397adab03bb8b5fd75c -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:22:09.943836  6844 consensus_peers.cc:597] T 9e326172347f45e99a0d482b5d8ef768 P cd75a17ab2604397adab03bb8b5fd75c -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 13:22:09.944542  6844 consensus_peers.cc:597] T 713b5728a197487c9300b310ab94e5a3 P cd75a17ab2604397adab03bb8b5fd75c -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 13:22:09.926568  6770 consensus_peers.cc:597] T 2c240553ce044eedb41541d72b9475d7 P b7ab4784c7344b939bc36f639286f377 -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 13:22:10.019169  7466 consensus_peers.cc:597] T fe20b4b48823486ca3b9c648db6ce8aa P 7ba59cc884714e8aa5f3f0ecaed84cbb -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:22:10.052476  6770 consensus_peers.cc:597] T 9b3759de40694069b13c0f8bd40e5709 P b7ab4784c7344b939bc36f639286f377 -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 13:22:10.166049  6770 consensus_peers.cc:597] T f5be3a11b23d4ea9b08300a2789821c7 P b7ab4784c7344b939bc36f639286f377 -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 13:22:10.184712  6770 consensus_peers.cc:597] T f4b8bd455d5a47c18a1380839c6e0d61 P b7ab4784c7344b939bc36f639286f377 -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:22:10.217285  6770 consensus_peers.cc:597] T ab432e62819d499eaaf3dd55481dd930 P b7ab4784c7344b939bc36f639286f377 -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 13:22:10.486356  7466 consensus_peers.cc:597] T bb3d8792045a4583ae2e965b1350a5b4 P 7ba59cc884714e8aa5f3f0ecaed84cbb -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:22:10.491950  6770 consensus_peers.cc:597] T b56bf91d90824c959e21e0cee5ba1816 P b7ab4784c7344b939bc36f639286f377 -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 13:22:10.497221  6770 consensus_peers.cc:597] T 4275cf08e63345f993bce8664eada830 P b7ab4784c7344b939bc36f639286f377 -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 13:22:10.524585  6770 consensus_peers.cc:597] T 30e88460611e47b2ba16a46a30b5f416 P b7ab4784c7344b939bc36f639286f377 -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 13:22:10.564730  6846 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.68:45071, user_credentials={real_user=slave}} blocked reactor thread for 100590us
W20260709 13:22:10.572538  6770 consensus_peers.cc:597] T d33d5ee8ef6f415593d8df52063161ad P b7ab4784c7344b939bc36f639286f377 -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:22:10.573577  6770 consensus_peers.cc:597] T bd6869f07b5a4885a0b99fbe60c3b175 P b7ab4784c7344b939bc36f639286f377 -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260709 13:22:10.592203  5625 tablet_server.cc:179] TabletServer@127.5.126.66:0 shutting down...
W20260709 13:22:10.618002  6770 consensus_peers.cc:597] T 7887766dc6784fcaa42b35c05fea7a99 P b7ab4784c7344b939bc36f639286f377 -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 13:22:10.624832  6770 consensus_peers.cc:597] T a1704639a875409b9959353527b3fd68 P b7ab4784c7344b939bc36f639286f377 -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 13:22:10.655009  6844 consensus_peers.cc:597] T 7c44c4849aa54f2b94d1f1bef9ed546f P cd75a17ab2604397adab03bb8b5fd75c -> Peer b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817): Couldn't send request to peer b7ab4784c7344b939bc36f639286f377. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:22:10.662626  6770 consensus_peers.cc:597] T 4d9def8b32fd443aa94ab1420b06837b P b7ab4784c7344b939bc36f639286f377 -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 13:22:10.665510  7466 consensus_peers.cc:597] T 7ba5dac66ab5497e9e336f2a3c28cda5 P 7ba59cc884714e8aa5f3f0ecaed84cbb -> Peer b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817): Couldn't send request to peer b7ab4784c7344b939bc36f639286f377. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:22:10.666535  6844 consensus_peers.cc:597] T 7c44c4849aa54f2b94d1f1bef9ed546f P cd75a17ab2604397adab03bb8b5fd75c -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:22:10.668002  6844 consensus_peers.cc:597] T 1bf4668eeb70467fb3dc5a0289233b3c P cd75a17ab2604397adab03bb8b5fd75c -> Peer b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817): Couldn't send request to peer b7ab4784c7344b939bc36f639286f377. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:22:10.670996  7466 consensus_peers.cc:597] T 7a734b5ab7834e05a8c422208acc58b1 P 7ba59cc884714e8aa5f3f0ecaed84cbb -> Peer b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817): Couldn't send request to peer b7ab4784c7344b939bc36f639286f377. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:22:10.672958  6844 consensus_peers.cc:597] T 711ef6523deb4cbe8ef2ba61e1c21c98 P cd75a17ab2604397adab03bb8b5fd75c -> Peer b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817): Couldn't send request to peer b7ab4784c7344b939bc36f639286f377. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:22:10.676697  6770 consensus_peers.cc:597] T de3186201e1a40d0b335eeb8b4e256e0 P b7ab4784c7344b939bc36f639286f377 -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:22:10.679296  6844 consensus_peers.cc:597] T 713b5728a197487c9300b310ab94e5a3 P cd75a17ab2604397adab03bb8b5fd75c -> Peer b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817): Couldn't send request to peer b7ab4784c7344b939bc36f639286f377. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:22:10.695897  6844 consensus_peers.cc:597] T e31b9971c15848dea59d4d4130141d9e P cd75a17ab2604397adab03bb8b5fd75c -> Peer b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817): Couldn't send request to peer b7ab4784c7344b939bc36f639286f377. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:22:10.726056  7466 consensus_peers.cc:597] T 17587d6730594da4a56fa13a353232a1 P 7ba59cc884714e8aa5f3f0ecaed84cbb -> Peer b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817): Couldn't send request to peer b7ab4784c7344b939bc36f639286f377. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:22:10.744843  7466 consensus_peers.cc:597] T 427c124d773f483294511e80fe340075 P 7ba59cc884714e8aa5f3f0ecaed84cbb -> Peer b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817): Couldn't send request to peer b7ab4784c7344b939bc36f639286f377. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:22:10.748368  6844 consensus_peers.cc:597] T 44bde925b2e541b69890d70715b85176 P cd75a17ab2604397adab03bb8b5fd75c -> Peer b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817): Couldn't send request to peer b7ab4784c7344b939bc36f639286f377. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:22:10.761435  7466 consensus_peers.cc:597] T 1528ab62b6fe4e3099d08f141afee116 P 7ba59cc884714e8aa5f3f0ecaed84cbb -> Peer b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817): Couldn't send request to peer b7ab4784c7344b939bc36f639286f377. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:22:10.762128  6770 consensus_peers.cc:597] T 20f6842e26174571996b8dea4151d4be P b7ab4784c7344b939bc36f639286f377 -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 13:22:10.786401  6844 consensus_peers.cc:597] T ce4f062dcd314d43a63ca74067cb5ee3 P cd75a17ab2604397adab03bb8b5fd75c -> Peer b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817): Couldn't send request to peer b7ab4784c7344b939bc36f639286f377. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:22:10.842110  7466 consensus_peers.cc:597] T b3f13b31a1f84f0d89d007eadd57924c P 7ba59cc884714e8aa5f3f0ecaed84cbb -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260709 13:22:10.876904  6844 consensus_peers.cc:597] T c4db81d9d329422bb3b4160ca4ac2d1d P cd75a17ab2604397adab03bb8b5fd75c -> Peer b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817): Couldn't send request to peer b7ab4784c7344b939bc36f639286f377. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:22:10.884013  5625 ts_tablet_manager.cc:1507] Shutting down tablet manager...
W20260709 13:22:10.887874  6844 consensus_peers.cc:597] T f58dc08b12a2494bb9a1372837970ca2 P cd75a17ab2604397adab03bb8b5fd75c -> Peer b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817): Couldn't send request to peer b7ab4784c7344b939bc36f639286f377. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:22:10.888758  6844 consensus_peers.cc:597] T 9e326172347f45e99a0d482b5d8ef768 P cd75a17ab2604397adab03bb8b5fd75c -> Peer b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817): Couldn't send request to peer b7ab4784c7344b939bc36f639286f377. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:22:10.889576  6844 consensus_peers.cc:597] T 90d42e216d9741e190bca19a781291fd P cd75a17ab2604397adab03bb8b5fd75c -> Peer b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817): Couldn't send request to peer b7ab4784c7344b939bc36f639286f377. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:22:10.891719  5625 tablet_replica.cc:333] T 4275cf08e63345f993bce8664eada830 P b7ab4784c7344b939bc36f639286f377: stopping tablet replica
I20260709 13:22:10.905941  5625 raft_consensus.cc:2243] T 4275cf08e63345f993bce8664eada830 P b7ab4784c7344b939bc36f639286f377 [term 21 LEADER]: Raft consensus shutting down.
W20260709 13:22:10.908653  6770 consensus_peers.cc:597] T e77e330a82df4b43a745d57a68f6f057 P b7ab4784c7344b939bc36f639286f377 -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260709 13:22:10.908932  5625 raft_consensus.cc:2272] T 4275cf08e63345f993bce8664eada830 P b7ab4784c7344b939bc36f639286f377 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:10.915087  5625 tablet_replica.cc:333] T 22ccee1b570c4ad3a57bd7aec085b1b4 P b7ab4784c7344b939bc36f639286f377: stopping tablet replica
W20260709 13:22:10.915761  6844 consensus_peers.cc:597] T 3411566abe2d4c9bb4b2adfdd05e6f17 P cd75a17ab2604397adab03bb8b5fd75c -> Peer b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817): Couldn't send request to peer b7ab4784c7344b939bc36f639286f377. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:22:10.916419  5625 raft_consensus.cc:2243] T 22ccee1b570c4ad3a57bd7aec085b1b4 P b7ab4784c7344b939bc36f639286f377 [term 17 LEADER]: Raft consensus shutting down.
I20260709 13:22:10.917949  5625 raft_consensus.cc:2272] T 22ccee1b570c4ad3a57bd7aec085b1b4 P b7ab4784c7344b939bc36f639286f377 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:10.921386  5625 tablet_replica.cc:333] T d8cee0accdb8499c86d4414b72565a38 P b7ab4784c7344b939bc36f639286f377: stopping tablet replica
I20260709 13:22:10.931671  5625 raft_consensus.cc:2243] T d8cee0accdb8499c86d4414b72565a38 P b7ab4784c7344b939bc36f639286f377 [term 23 LEADER]: Raft consensus shutting down.
I20260709 13:22:10.933245  5625 raft_consensus.cc:2272] T d8cee0accdb8499c86d4414b72565a38 P b7ab4784c7344b939bc36f639286f377 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:10.936391  5625 tablet_replica.cc:333] T 17587d6730594da4a56fa13a353232a1 P b7ab4784c7344b939bc36f639286f377: stopping tablet replica
I20260709 13:22:10.939881  5625 raft_consensus.cc:2243] T 17587d6730594da4a56fa13a353232a1 P b7ab4784c7344b939bc36f639286f377 [term 26 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:10.940966  5625 raft_consensus.cc:2272] T 17587d6730594da4a56fa13a353232a1 P b7ab4784c7344b939bc36f639286f377 [term 26 FOLLOWER]: Raft consensus is shut down!
W20260709 13:22:10.943406  6844 consensus_peers.cc:597] T 34f36d59d88f40fe8a2805e604fc6c0a P cd75a17ab2604397adab03bb8b5fd75c -> Peer b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817): Couldn't send request to peer b7ab4784c7344b939bc36f639286f377. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:22:10.955550  5625 tablet_replica.cc:333] T 9e326172347f45e99a0d482b5d8ef768 P b7ab4784c7344b939bc36f639286f377: stopping tablet replica
I20260709 13:22:10.964489  5625 raft_consensus.cc:2243] T 9e326172347f45e99a0d482b5d8ef768 P b7ab4784c7344b939bc36f639286f377 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:10.975827  5625 raft_consensus.cc:2272] T 9e326172347f45e99a0d482b5d8ef768 P b7ab4784c7344b939bc36f639286f377 [term 18 FOLLOWER]: Raft consensus is shut down!
W20260709 13:22:10.977552  7466 consensus_peers.cc:597] T 404190ce4ce94cecbfcb6ea9d1dd8626 P 7ba59cc884714e8aa5f3f0ecaed84cbb -> Peer b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817): Couldn't send request to peer b7ab4784c7344b939bc36f639286f377. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:22:10.985601  5625 tablet_replica.cc:333] T c4db81d9d329422bb3b4160ca4ac2d1d P b7ab4784c7344b939bc36f639286f377: stopping tablet replica
I20260709 13:22:10.987952  5625 raft_consensus.cc:2243] T c4db81d9d329422bb3b4160ca4ac2d1d P b7ab4784c7344b939bc36f639286f377 [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:10.989125  5625 raft_consensus.cc:2272] T c4db81d9d329422bb3b4160ca4ac2d1d P b7ab4784c7344b939bc36f639286f377 [term 21 FOLLOWER]: Raft consensus is shut down!
W20260709 13:22:10.990999  6844 consensus_peers.cc:597] T a3022224cc81473690653a83d4e99470 P cd75a17ab2604397adab03bb8b5fd75c -> Peer b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817): Couldn't send request to peer b7ab4784c7344b939bc36f639286f377. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:22:11.003232  7466 consensus_peers.cc:597] T 4f00a2e87e56452083b759f60d461ee3 P 7ba59cc884714e8aa5f3f0ecaed84cbb -> Peer b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817): Couldn't send request to peer b7ab4784c7344b939bc36f639286f377. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:22:11.026705  6844 consensus_peers.cc:597] T bb7fa124c3bf4ef9ab65a407cb008441 P cd75a17ab2604397adab03bb8b5fd75c -> Peer b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817): Couldn't send request to peer b7ab4784c7344b939bc36f639286f377. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:22:11.036885  7466 consensus_peers.cc:597] T b3f13b31a1f84f0d89d007eadd57924c P 7ba59cc884714e8aa5f3f0ecaed84cbb -> Peer b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817): Couldn't send request to peer b7ab4784c7344b939bc36f639286f377. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:22:11.041462  5625 tablet_replica.cc:333] T 427c124d773f483294511e80fe340075 P b7ab4784c7344b939bc36f639286f377: stopping tablet replica
W20260709 13:22:11.054522  6844 consensus_peers.cc:597] T 1bf4668eeb70467fb3dc5a0289233b3c P cd75a17ab2604397adab03bb8b5fd75c -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
I20260709 13:22:11.060742  5625 raft_consensus.cc:2243] T 427c124d773f483294511e80fe340075 P b7ab4784c7344b939bc36f639286f377 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:11.063005  5625 raft_consensus.cc:2272] T 427c124d773f483294511e80fe340075 P b7ab4784c7344b939bc36f639286f377 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:11.071929  5625 tablet_replica.cc:333] T b56bf91d90824c959e21e0cee5ba1816 P b7ab4784c7344b939bc36f639286f377: stopping tablet replica
W20260709 13:22:11.102000  6770 consensus_peers.cc:597] T 7c37d41cd9164c15a6826ca62a851a69 P b7ab4784c7344b939bc36f639286f377 -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260709 13:22:11.118367  5625 raft_consensus.cc:2243] T b56bf91d90824c959e21e0cee5ba1816 P b7ab4784c7344b939bc36f639286f377 [term 18 LEADER]: Raft consensus shutting down.
I20260709 13:22:11.123818  5625 raft_consensus.cc:2272] T b56bf91d90824c959e21e0cee5ba1816 P b7ab4784c7344b939bc36f639286f377 [term 18 FOLLOWER]: Raft consensus is shut down!
W20260709 13:22:11.134774  7466 consensus_peers.cc:597] T be1a92657f494cac8dd227d152f50151 P 7ba59cc884714e8aa5f3f0ecaed84cbb -> Peer b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817): Couldn't send request to peer b7ab4784c7344b939bc36f639286f377. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:22:11.140136  5625 tablet_replica.cc:333] T 3411566abe2d4c9bb4b2adfdd05e6f17 P b7ab4784c7344b939bc36f639286f377: stopping tablet replica
I20260709 13:22:11.157652  5625 raft_consensus.cc:2243] T 3411566abe2d4c9bb4b2adfdd05e6f17 P b7ab4784c7344b939bc36f639286f377 [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:11.159049  5625 raft_consensus.cc:2272] T 3411566abe2d4c9bb4b2adfdd05e6f17 P b7ab4784c7344b939bc36f639286f377 [term 21 FOLLOWER]: Raft consensus is shut down!
W20260709 13:22:11.154892  6844 consensus_peers.cc:597] T c4db81d9d329422bb3b4160ca4ac2d1d P cd75a17ab2604397adab03bb8b5fd75c -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260709 13:22:11.161504  7466 consensus_peers.cc:597] T 24ee15416e3145beaa1b8183453729a3 P 7ba59cc884714e8aa5f3f0ecaed84cbb -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
I20260709 13:22:11.168788  5625 tablet_replica.cc:333] T 713b5728a197487c9300b310ab94e5a3 P b7ab4784c7344b939bc36f639286f377: stopping tablet replica
I20260709 13:22:11.180722  5625 raft_consensus.cc:2243] T 713b5728a197487c9300b310ab94e5a3 P b7ab4784c7344b939bc36f639286f377 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:11.204133  5625 raft_consensus.cc:2272] T 713b5728a197487c9300b310ab94e5a3 P b7ab4784c7344b939bc36f639286f377 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:11.239370  5625 tablet_replica.cc:333] T a1704639a875409b9959353527b3fd68 P b7ab4784c7344b939bc36f639286f377: stopping tablet replica
I20260709 13:22:11.240419  5625 raft_consensus.cc:2243] T a1704639a875409b9959353527b3fd68 P b7ab4784c7344b939bc36f639286f377 [term 22 LEADER]: Raft consensus shutting down.
I20260709 13:22:11.242116  5625 raft_consensus.cc:2272] T a1704639a875409b9959353527b3fd68 P b7ab4784c7344b939bc36f639286f377 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:11.257362  5625 tablet_replica.cc:333] T f5be3a11b23d4ea9b08300a2789821c7 P b7ab4784c7344b939bc36f639286f377: stopping tablet replica
I20260709 13:22:11.259581  5625 raft_consensus.cc:2243] T f5be3a11b23d4ea9b08300a2789821c7 P b7ab4784c7344b939bc36f639286f377 [term 21 LEADER]: Raft consensus shutting down.
W20260709 13:22:11.269132  7466 consensus_peers.cc:597] T 404190ce4ce94cecbfcb6ea9d1dd8626 P 7ba59cc884714e8aa5f3f0ecaed84cbb -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
I20260709 13:22:11.270208  5625 raft_consensus.cc:2272] T f5be3a11b23d4ea9b08300a2789821c7 P b7ab4784c7344b939bc36f639286f377 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:11.275395  5625 tablet_replica.cc:333] T bd6869f07b5a4885a0b99fbe60c3b175 P b7ab4784c7344b939bc36f639286f377: stopping tablet replica
I20260709 13:22:11.276350  5625 raft_consensus.cc:2243] T bd6869f07b5a4885a0b99fbe60c3b175 P b7ab4784c7344b939bc36f639286f377 [term 27 LEADER]: Raft consensus shutting down.
W20260709 13:22:11.278919  6770 consensus_peers.cc:597] T 3d65025eea89441290d85dd053810e31 P b7ab4784c7344b939bc36f639286f377 -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
I20260709 13:22:11.290330  5625 raft_consensus.cc:2272] T bd6869f07b5a4885a0b99fbe60c3b175 P b7ab4784c7344b939bc36f639286f377 [term 27 FOLLOWER]: Raft consensus is shut down!
W20260709 13:22:11.291363  6844 consensus_peers.cc:597] T 3411566abe2d4c9bb4b2adfdd05e6f17 P cd75a17ab2604397adab03bb8b5fd75c -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260709 13:22:11.303046  5625 tablet_replica.cc:333] T 7a734b5ab7834e05a8c422208acc58b1 P b7ab4784c7344b939bc36f639286f377: stopping tablet replica
I20260709 13:22:11.304513  5625 raft_consensus.cc:2243] T 7a734b5ab7834e05a8c422208acc58b1 P b7ab4784c7344b939bc36f639286f377 [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:11.306288  5625 raft_consensus.cc:2272] T 7a734b5ab7834e05a8c422208acc58b1 P b7ab4784c7344b939bc36f639286f377 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:11.310350  5625 tablet_replica.cc:333] T 34f36d59d88f40fe8a2805e604fc6c0a P b7ab4784c7344b939bc36f639286f377: stopping tablet replica
I20260709 13:22:11.311506  5625 raft_consensus.cc:2243] T 34f36d59d88f40fe8a2805e604fc6c0a P b7ab4784c7344b939bc36f639286f377 [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:11.312479  5625 raft_consensus.cc:2272] T 34f36d59d88f40fe8a2805e604fc6c0a P b7ab4784c7344b939bc36f639286f377 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:11.315919  5625 tablet_replica.cc:333] T d33d5ee8ef6f415593d8df52063161ad P b7ab4784c7344b939bc36f639286f377: stopping tablet replica
I20260709 13:22:11.316958  5625 raft_consensus.cc:2243] T d33d5ee8ef6f415593d8df52063161ad P b7ab4784c7344b939bc36f639286f377 [term 21 LEADER]: Raft consensus shutting down.
I20260709 13:22:11.318542  5625 raft_consensus.cc:2272] T d33d5ee8ef6f415593d8df52063161ad P b7ab4784c7344b939bc36f639286f377 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:11.349279  5625 tablet_replica.cc:333] T 9b3759de40694069b13c0f8bd40e5709 P b7ab4784c7344b939bc36f639286f377: stopping tablet replica
I20260709 13:22:11.350342  5625 raft_consensus.cc:2243] T 9b3759de40694069b13c0f8bd40e5709 P b7ab4784c7344b939bc36f639286f377 [term 20 LEADER]: Raft consensus shutting down.
I20260709 13:22:11.429661  5625 raft_consensus.cc:2272] T 9b3759de40694069b13c0f8bd40e5709 P b7ab4784c7344b939bc36f639286f377 [term 20 FOLLOWER]: Raft consensus is shut down!
W20260709 13:22:11.426744  6844 consensus_peers.cc:597] T a3022224cc81473690653a83d4e99470 P cd75a17ab2604397adab03bb8b5fd75c -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260709 13:22:11.447086  5625 tablet_replica.cc:333] T 7c37d41cd9164c15a6826ca62a851a69 P b7ab4784c7344b939bc36f639286f377: stopping tablet replica
I20260709 13:22:11.457626  5625 raft_consensus.cc:2243] T 7c37d41cd9164c15a6826ca62a851a69 P b7ab4784c7344b939bc36f639286f377 [term 23 LEADER]: Raft consensus shutting down.
I20260709 13:22:11.459681  5625 raft_consensus.cc:2272] T 7c37d41cd9164c15a6826ca62a851a69 P b7ab4784c7344b939bc36f639286f377 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:11.498091  5625 tablet_replica.cc:333] T 1bf4668eeb70467fb3dc5a0289233b3c P b7ab4784c7344b939bc36f639286f377: stopping tablet replica
I20260709 13:22:11.499742  5625 raft_consensus.cc:2243] T 1bf4668eeb70467fb3dc5a0289233b3c P b7ab4784c7344b939bc36f639286f377 [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:11.508606  5625 raft_consensus.cc:2272] T 1bf4668eeb70467fb3dc5a0289233b3c P b7ab4784c7344b939bc36f639286f377 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:11.524655  5625 tablet_replica.cc:333] T 8c7f33e544204fbaac4078e3e83bbf4e P b7ab4784c7344b939bc36f639286f377: stopping tablet replica
I20260709 13:22:11.525357 14670 raft_consensus.cc:493] T 7ba5dac66ab5497e9e336f2a3c28cda5 P b7ab4784c7344b939bc36f639286f377 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 7ba59cc884714e8aa5f3f0ecaed84cbb)
I20260709 13:22:11.526190  5625 raft_consensus.cc:2243] T 8c7f33e544204fbaac4078e3e83bbf4e P b7ab4784c7344b939bc36f639286f377 [term 16 LEADER]: Raft consensus shutting down.
I20260709 13:22:11.526300 14670 raft_consensus.cc:515] T 7ba5dac66ab5497e9e336f2a3c28cda5 P b7ab4784c7344b939bc36f639286f377 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:22:11.527949  5625 raft_consensus.cc:2272] T 8c7f33e544204fbaac4078e3e83bbf4e P b7ab4784c7344b939bc36f639286f377 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:11.530465 14670 leader_election.cc:290] T 7ba5dac66ab5497e9e336f2a3c28cda5 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:22:11.531453  5625 tablet_replica.cc:333] T f03d0dbf16864ca4bc1bb5e4c0334c0f P b7ab4784c7344b939bc36f639286f377: stopping tablet replica
I20260709 13:22:11.532555  5625 raft_consensus.cc:2243] T f03d0dbf16864ca4bc1bb5e4c0334c0f P b7ab4784c7344b939bc36f639286f377 [term 19 LEADER]: Raft consensus shutting down.
I20260709 13:22:11.534147  5625 raft_consensus.cc:2272] T f03d0dbf16864ca4bc1bb5e4c0334c0f P b7ab4784c7344b939bc36f639286f377 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:11.551339  7502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ba5dac66ab5497e9e336f2a3c28cda5" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:22:11.565533  5625 tablet_replica.cc:333] T 1528ab62b6fe4e3099d08f141afee116 P b7ab4784c7344b939bc36f639286f377: stopping tablet replica
I20260709 13:22:11.566553  5625 raft_consensus.cc:2243] T 1528ab62b6fe4e3099d08f141afee116 P b7ab4784c7344b939bc36f639286f377 [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:11.567345  5625 raft_consensus.cc:2272] T 1528ab62b6fe4e3099d08f141afee116 P b7ab4784c7344b939bc36f639286f377 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:11.570923  5625 tablet_replica.cc:333] T 4f00a2e87e56452083b759f60d461ee3 P b7ab4784c7344b939bc36f639286f377: stopping tablet replica
I20260709 13:22:11.571969  5625 raft_consensus.cc:2243] T 4f00a2e87e56452083b759f60d461ee3 P b7ab4784c7344b939bc36f639286f377 [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:11.575350  5625 raft_consensus.cc:2272] T 4f00a2e87e56452083b759f60d461ee3 P b7ab4784c7344b939bc36f639286f377 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:11.583671  5625 tablet_replica.cc:333] T 3d65025eea89441290d85dd053810e31 P b7ab4784c7344b939bc36f639286f377: stopping tablet replica
I20260709 13:22:11.584620  5625 raft_consensus.cc:2243] T 3d65025eea89441290d85dd053810e31 P b7ab4784c7344b939bc36f639286f377 [term 20 LEADER]: Raft consensus shutting down.
I20260709 13:22:11.585963  5625 raft_consensus.cc:2272] T 3d65025eea89441290d85dd053810e31 P b7ab4784c7344b939bc36f639286f377 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:11.594573 14681 raft_consensus.cc:493] T e31b9971c15848dea59d4d4130141d9e P b7ab4784c7344b939bc36f639286f377 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader cd75a17ab2604397adab03bb8b5fd75c)
I20260709 13:22:11.595201 14681 raft_consensus.cc:515] T e31b9971c15848dea59d4d4130141d9e P b7ab4784c7344b939bc36f639286f377 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:22:11.597523 14681 leader_election.cc:290] T e31b9971c15848dea59d4d4130141d9e P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
W20260709 13:22:11.608443  7468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 162773us
I20260709 13:22:11.618861  5625 tablet_replica.cc:333] T 44bde925b2e541b69890d70715b85176 P b7ab4784c7344b939bc36f639286f377: stopping tablet replica
I20260709 13:22:11.638054  5625 raft_consensus.cc:2243] T 44bde925b2e541b69890d70715b85176 P b7ab4784c7344b939bc36f639286f377 [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:11.639564  5625 raft_consensus.cc:2272] T 44bde925b2e541b69890d70715b85176 P b7ab4784c7344b939bc36f639286f377 [term 21 FOLLOWER]: Raft consensus is shut down!
W20260709 13:22:11.640599  7466 consensus_peers.cc:597] T 1528ab62b6fe4e3099d08f141afee116 P 7ba59cc884714e8aa5f3f0ecaed84cbb -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260709 13:22:11.643530  5625 tablet_replica.cc:333] T 30e88460611e47b2ba16a46a30b5f416 P b7ab4784c7344b939bc36f639286f377: stopping tablet replica
I20260709 13:22:11.657861  5625 raft_consensus.cc:2243] T 30e88460611e47b2ba16a46a30b5f416 P b7ab4784c7344b939bc36f639286f377 [term 16 LEADER]: Raft consensus shutting down.
I20260709 13:22:11.660540  5625 raft_consensus.cc:2272] T 30e88460611e47b2ba16a46a30b5f416 P b7ab4784c7344b939bc36f639286f377 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:11.666543  6879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e31b9971c15848dea59d4d4130141d9e" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:22:11.661815  6873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ba5dac66ab5497e9e336f2a3c28cda5" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:22:11.675412  6772 leader_election.cc:304] T 7ba5dac66ab5497e9e336f2a3c28cda5 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:22:11.677577 14670 raft_consensus.cc:2749] T 7ba5dac66ab5497e9e336f2a3c28cda5 P b7ab4784c7344b939bc36f639286f377 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:22:11.684501 14681 raft_consensus.cc:493] T 7c44c4849aa54f2b94d1f1bef9ed546f P b7ab4784c7344b939bc36f639286f377 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader cd75a17ab2604397adab03bb8b5fd75c)
I20260709 13:22:11.685983 14681 raft_consensus.cc:515] T 7c44c4849aa54f2b94d1f1bef9ed546f P b7ab4784c7344b939bc36f639286f377 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:22:11.690028 14681 leader_election.cc:290] T 7c44c4849aa54f2b94d1f1bef9ed546f P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:22:11.693439 14681 raft_consensus.cc:493] T 711ef6523deb4cbe8ef2ba61e1c21c98 P b7ab4784c7344b939bc36f639286f377 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader cd75a17ab2604397adab03bb8b5fd75c)
I20260709 13:22:11.709203 14681 raft_consensus.cc:515] T 711ef6523deb4cbe8ef2ba61e1c21c98 P b7ab4784c7344b939bc36f639286f377 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:22:11.714126  5625 tablet_replica.cc:333] T be1a92657f494cac8dd227d152f50151 P b7ab4784c7344b939bc36f639286f377: stopping tablet replica
W20260709 13:22:11.720402  6770 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 47095.5us
I20260709 13:22:11.724059  6879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c44c4849aa54f2b94d1f1bef9ed546f" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 25 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:22:11.724910 14681 leader_election.cc:290] T 711ef6523deb4cbe8ef2ba61e1c21c98 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:22:11.724243  5625 raft_consensus.cc:2243] T be1a92657f494cac8dd227d152f50151 P b7ab4784c7344b939bc36f639286f377 [term 25 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:11.726822  5625 raft_consensus.cc:2272] T be1a92657f494cac8dd227d152f50151 P b7ab4784c7344b939bc36f639286f377 [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:11.727008  6874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "711ef6523deb4cbe8ef2ba61e1c21c98" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:22:11.732304  5625 tablet_replica.cc:333] T f4b8bd455d5a47c18a1380839c6e0d61 P b7ab4784c7344b939bc36f639286f377: stopping tablet replica
I20260709 13:22:11.733546  5625 raft_consensus.cc:2243] T f4b8bd455d5a47c18a1380839c6e0d61 P b7ab4784c7344b939bc36f639286f377 [term 22 LEADER]: Raft consensus shutting down.
I20260709 13:22:11.736864  5625 raft_consensus.cc:2272] T f4b8bd455d5a47c18a1380839c6e0d61 P b7ab4784c7344b939bc36f639286f377 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:11.740465  5625 tablet_replica.cc:333] T 3a485a995abc4807b6e511e45419f737 P b7ab4784c7344b939bc36f639286f377: stopping tablet replica
I20260709 13:22:11.741509  5625 raft_consensus.cc:2243] T 3a485a995abc4807b6e511e45419f737 P b7ab4784c7344b939bc36f639286f377 [term 17 LEADER]: Raft consensus shutting down.
I20260709 13:22:11.746970  5625 raft_consensus.cc:2272] T 3a485a995abc4807b6e511e45419f737 P b7ab4784c7344b939bc36f639286f377 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:11.753136  5625 tablet_replica.cc:333] T 7c44c4849aa54f2b94d1f1bef9ed546f P b7ab4784c7344b939bc36f639286f377: stopping tablet replica
I20260709 13:22:11.754381  5625 raft_consensus.cc:2243] T 7c44c4849aa54f2b94d1f1bef9ed546f P b7ab4784c7344b939bc36f639286f377 [term 24 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:11.755470  5625 raft_consensus.cc:2272] T 7c44c4849aa54f2b94d1f1bef9ed546f P b7ab4784c7344b939bc36f639286f377 [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:11.762624  5625 tablet_replica.cc:333] T 07a92dd554674067a83a9cb68c4773f2 P b7ab4784c7344b939bc36f639286f377: stopping tablet replica
I20260709 13:22:11.763585  5625 raft_consensus.cc:2243] T 07a92dd554674067a83a9cb68c4773f2 P b7ab4784c7344b939bc36f639286f377 [term 19 LEADER]: Raft consensus shutting down.
I20260709 13:22:11.764838  5625 raft_consensus.cc:2272] T 07a92dd554674067a83a9cb68c4773f2 P b7ab4784c7344b939bc36f639286f377 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:11.806437  5625 tablet_replica.cc:333] T f3f9c2e2bf644115957398fe4c9459db P b7ab4784c7344b939bc36f639286f377: stopping tablet replica
I20260709 13:22:11.807331  5625 raft_consensus.cc:2243] T f3f9c2e2bf644115957398fe4c9459db P b7ab4784c7344b939bc36f639286f377 [term 23 LEADER]: Raft consensus shutting down.
I20260709 13:22:11.809046  5625 raft_consensus.cc:2272] T f3f9c2e2bf644115957398fe4c9459db P b7ab4784c7344b939bc36f639286f377 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:11.832152  5625 tablet_replica.cc:333] T 711ef6523deb4cbe8ef2ba61e1c21c98 P b7ab4784c7344b939bc36f639286f377: stopping tablet replica
I20260709 13:22:11.833248  5625 raft_consensus.cc:2243] T 711ef6523deb4cbe8ef2ba61e1c21c98 P b7ab4784c7344b939bc36f639286f377 [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:11.834429  5625 raft_consensus.cc:2272] T 711ef6523deb4cbe8ef2ba61e1c21c98 P b7ab4784c7344b939bc36f639286f377 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:11.837682  5625 tablet_replica.cc:333] T 4d9def8b32fd443aa94ab1420b06837b P b7ab4784c7344b939bc36f639286f377: stopping tablet replica
I20260709 13:22:11.844710  5625 raft_consensus.cc:2243] T 4d9def8b32fd443aa94ab1420b06837b P b7ab4784c7344b939bc36f639286f377 [term 24 LEADER]: Raft consensus shutting down.
I20260709 13:22:11.849247  5625 raft_consensus.cc:2272] T 4d9def8b32fd443aa94ab1420b06837b P b7ab4784c7344b939bc36f639286f377 [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:11.852248  5625 tablet_replica.cc:333] T d8292e16e5654be6bc408560cf256aaa P b7ab4784c7344b939bc36f639286f377: stopping tablet replica
I20260709 13:22:11.860697  5625 raft_consensus.cc:2243] T d8292e16e5654be6bc408560cf256aaa P b7ab4784c7344b939bc36f639286f377 [term 22 LEADER]: Raft consensus shutting down.
W20260709 13:22:11.815325  7466 consensus_peers.cc:597] T 17587d6730594da4a56fa13a353232a1 P 7ba59cc884714e8aa5f3f0ecaed84cbb -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260709 13:22:11.872984  7466 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.65:44391, user_credentials={real_user=slave}} blocked reactor thread for 57698.3us
I20260709 13:22:11.889026  5625 raft_consensus.cc:2272] T d8292e16e5654be6bc408560cf256aaa P b7ab4784c7344b939bc36f639286f377 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:11.892524  5625 tablet_replica.cc:333] T de3186201e1a40d0b335eeb8b4e256e0 P b7ab4784c7344b939bc36f639286f377: stopping tablet replica
I20260709 13:22:11.893359  5625 raft_consensus.cc:2243] T de3186201e1a40d0b335eeb8b4e256e0 P b7ab4784c7344b939bc36f639286f377 [term 23 LEADER]: Raft consensus shutting down.
I20260709 13:22:11.894419  5625 raft_consensus.cc:2272] T de3186201e1a40d0b335eeb8b4e256e0 P b7ab4784c7344b939bc36f639286f377 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:11.897776  5625 tablet_replica.cc:333] T 7887766dc6784fcaa42b35c05fea7a99 P b7ab4784c7344b939bc36f639286f377: stopping tablet replica
I20260709 13:22:11.908425  5625 raft_consensus.cc:2243] T 7887766dc6784fcaa42b35c05fea7a99 P b7ab4784c7344b939bc36f639286f377 [term 23 LEADER]: Raft consensus shutting down.
I20260709 13:22:11.909554  5625 raft_consensus.cc:2272] T 7887766dc6784fcaa42b35c05fea7a99 P b7ab4784c7344b939bc36f639286f377 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:11.912459  5625 tablet_replica.cc:333] T ab432e62819d499eaaf3dd55481dd930 P b7ab4784c7344b939bc36f639286f377: stopping tablet replica
I20260709 13:22:11.913270  5625 raft_consensus.cc:2243] T ab432e62819d499eaaf3dd55481dd930 P b7ab4784c7344b939bc36f639286f377 [term 25 LEADER]: Raft consensus shutting down.
I20260709 13:22:11.914228  5625 raft_consensus.cc:2272] T ab432e62819d499eaaf3dd55481dd930 P b7ab4784c7344b939bc36f639286f377 [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:11.917006  5625 tablet_replica.cc:333] T dbdf895bba214ff68685a24fd17dfb5d P b7ab4784c7344b939bc36f639286f377: stopping tablet replica
W20260709 13:22:11.917618  6844 consensus_peers.cc:597] T 44bde925b2e541b69890d70715b85176 P cd75a17ab2604397adab03bb8b5fd75c -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260709 13:22:11.918138  6844 consensus_peers.cc:597] T 90d42e216d9741e190bca19a781291fd P cd75a17ab2604397adab03bb8b5fd75c -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
I20260709 13:22:11.917829  5625 raft_consensus.cc:2243] T dbdf895bba214ff68685a24fd17dfb5d P b7ab4784c7344b939bc36f639286f377 [term 21 LEADER]: Raft consensus shutting down.
I20260709 13:22:11.923663  5625 raft_consensus.cc:2272] T dbdf895bba214ff68685a24fd17dfb5d P b7ab4784c7344b939bc36f639286f377 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:11.926683  5625 tablet_replica.cc:333] T e77e330a82df4b43a745d57a68f6f057 P b7ab4784c7344b939bc36f639286f377: stopping tablet replica
I20260709 13:22:11.933600  5625 raft_consensus.cc:2243] T e77e330a82df4b43a745d57a68f6f057 P b7ab4784c7344b939bc36f639286f377 [term 20 LEADER]: Raft consensus shutting down.
I20260709 13:22:11.934866  5625 raft_consensus.cc:2272] T e77e330a82df4b43a745d57a68f6f057 P b7ab4784c7344b939bc36f639286f377 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:11.937855  5625 tablet_replica.cc:333] T f09c2a98de1a4decabd0ff900dd44caa P b7ab4784c7344b939bc36f639286f377: stopping tablet replica
I20260709 13:22:11.938640  5625 raft_consensus.cc:2243] T f09c2a98de1a4decabd0ff900dd44caa P b7ab4784c7344b939bc36f639286f377 [term 24 LEADER]: Raft consensus shutting down.
I20260709 13:22:11.941726  5625 raft_consensus.cc:2272] T f09c2a98de1a4decabd0ff900dd44caa P b7ab4784c7344b939bc36f639286f377 [term 24 FOLLOWER]: Raft consensus is shut down!
W20260709 13:22:11.943272  6844 consensus_peers.cc:597] T e31b9971c15848dea59d4d4130141d9e P cd75a17ab2604397adab03bb8b5fd75c -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260709 13:22:11.951781  7466 consensus_peers.cc:597] T be1a92657f494cac8dd227d152f50151 P 7ba59cc884714e8aa5f3f0ecaed84cbb -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260709 13:22:11.955780  7466 consensus_peers.cc:597] T 3fa34c08b205435dba97346991aa1f92 P 7ba59cc884714e8aa5f3f0ecaed84cbb -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
I20260709 13:22:11.955947  5625 tablet_replica.cc:333] T 2c240553ce044eedb41541d72b9475d7 P b7ab4784c7344b939bc36f639286f377: stopping tablet replica
I20260709 13:22:11.958182  5625 raft_consensus.cc:2243] T 2c240553ce044eedb41541d72b9475d7 P b7ab4784c7344b939bc36f639286f377 [term 21 LEADER]: Raft consensus shutting down.
W20260709 13:22:11.960423  6844 consensus_peers.cc:597] T 95a75bfe094d4bdc963aba3f08dfcd25 P cd75a17ab2604397adab03bb8b5fd75c -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
I20260709 13:22:11.960554  5625 raft_consensus.cc:2272] T 2c240553ce044eedb41541d72b9475d7 P b7ab4784c7344b939bc36f639286f377 [term 21 FOLLOWER]: Raft consensus is shut down!
W20260709 13:22:11.961593  6770 leader_election.cc:336] T 7c44c4849aa54f2b94d1f1bef9ed546f P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111)
I20260709 13:22:11.962452  6770 leader_election.cc:304] T 7c44c4849aa54f2b94d1f1bef9ed546f P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:22:11.963626  5625 tablet_replica.cc:333] T 90d42e216d9741e190bca19a781291fd P b7ab4784c7344b939bc36f639286f377: stopping tablet replica
W20260709 13:22:11.966415  6770 raft_consensus.cc:2686] T 7c44c4849aa54f2b94d1f1bef9ed546f P b7ab4784c7344b939bc36f639286f377: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260709 13:22:11.967046  5625 raft_consensus.cc:2243] T 90d42e216d9741e190bca19a781291fd P b7ab4784c7344b939bc36f639286f377 [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:11.967895  5625 raft_consensus.cc:2272] T 90d42e216d9741e190bca19a781291fd P b7ab4784c7344b939bc36f639286f377 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:11.971043  5625 tablet_replica.cc:333] T b3f13b31a1f84f0d89d007eadd57924c P b7ab4784c7344b939bc36f639286f377: stopping tablet replica
I20260709 13:22:11.980770  5625 raft_consensus.cc:2243] T b3f13b31a1f84f0d89d007eadd57924c P b7ab4784c7344b939bc36f639286f377 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:11.981566  5625 raft_consensus.cc:2272] T b3f13b31a1f84f0d89d007eadd57924c P b7ab4784c7344b939bc36f639286f377 [term 16 FOLLOWER]: Raft consensus is shut down!
W20260709 13:22:11.967088  6770 leader_election.cc:336] T 711ef6523deb4cbe8ef2ba61e1c21c98 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111)
I20260709 13:22:11.983349  6770 leader_election.cc:304] T 711ef6523deb4cbe8ef2ba61e1c21c98 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
W20260709 13:22:11.984009  6770 raft_consensus.cc:2686] T 711ef6523deb4cbe8ef2ba61e1c21c98 P b7ab4784c7344b939bc36f639286f377: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260709 13:22:11.984601  5625 tablet_replica.cc:333] T bb7fa124c3bf4ef9ab65a407cb008441 P b7ab4784c7344b939bc36f639286f377: stopping tablet replica
W20260709 13:22:11.984716  6770 consensus_peers.cc:597] T 853ac0a8cbd64ce99457f170216d4d0f P b7ab4784c7344b939bc36f639286f377 -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
I20260709 13:22:11.985499  5625 raft_consensus.cc:2243] T bb7fa124c3bf4ef9ab65a407cb008441 P b7ab4784c7344b939bc36f639286f377 [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:11.986238  5625 raft_consensus.cc:2272] T bb7fa124c3bf4ef9ab65a407cb008441 P b7ab4784c7344b939bc36f639286f377 [term 19 FOLLOWER]: Raft consensus is shut down!
W20260709 13:22:11.986353  6770 leader_election.cc:336] T e31b9971c15848dea59d4d4130141d9e P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111)
I20260709 13:22:11.986857  6770 leader_election.cc:304] T e31b9971c15848dea59d4d4130141d9e P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:22:11.987623 14670 raft_consensus.cc:2749] T e31b9971c15848dea59d4d4130141d9e P b7ab4784c7344b939bc36f639286f377 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:22:11.990607  5625 tablet_replica.cc:333] T 20f6842e26174571996b8dea4151d4be P b7ab4784c7344b939bc36f639286f377: stopping tablet replica
I20260709 13:22:11.993701  5625 raft_consensus.cc:2243] T 20f6842e26174571996b8dea4151d4be P b7ab4784c7344b939bc36f639286f377 [term 22 LEADER]: Raft consensus shutting down.
I20260709 13:22:11.999871  5625 raft_consensus.cc:2272] T 20f6842e26174571996b8dea4151d4be P b7ab4784c7344b939bc36f639286f377 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:12.002933  5625 tablet_replica.cc:333] T 404190ce4ce94cecbfcb6ea9d1dd8626 P b7ab4784c7344b939bc36f639286f377: stopping tablet replica
I20260709 13:22:12.003750  5625 raft_consensus.cc:2243] T 404190ce4ce94cecbfcb6ea9d1dd8626 P b7ab4784c7344b939bc36f639286f377 [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:12.004441  5625 raft_consensus.cc:2272] T 404190ce4ce94cecbfcb6ea9d1dd8626 P b7ab4784c7344b939bc36f639286f377 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:12.010807  5625 tablet_replica.cc:333] T 853ac0a8cbd64ce99457f170216d4d0f P b7ab4784c7344b939bc36f639286f377: stopping tablet replica
I20260709 13:22:12.014959  5625 raft_consensus.cc:2243] T 853ac0a8cbd64ce99457f170216d4d0f P b7ab4784c7344b939bc36f639286f377 [term 18 LEADER]: Raft consensus shutting down.
I20260709 13:22:12.016245  5625 raft_consensus.cc:2272] T 853ac0a8cbd64ce99457f170216d4d0f P b7ab4784c7344b939bc36f639286f377 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:12.019217  5625 tablet_replica.cc:333] T ce4f062dcd314d43a63ca74067cb5ee3 P b7ab4784c7344b939bc36f639286f377: stopping tablet replica
I20260709 13:22:12.024662  5625 raft_consensus.cc:2243] T ce4f062dcd314d43a63ca74067cb5ee3 P b7ab4784c7344b939bc36f639286f377 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:12.025309  5625 raft_consensus.cc:2272] T ce4f062dcd314d43a63ca74067cb5ee3 P b7ab4784c7344b939bc36f639286f377 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:12.033164  5625 tablet_replica.cc:333] T 7ba5dac66ab5497e9e336f2a3c28cda5 P b7ab4784c7344b939bc36f639286f377: stopping tablet replica
I20260709 13:22:12.033918 14686 raft_consensus.cc:493] T 22ccee1b570c4ad3a57bd7aec085b1b4 P cd75a17ab2604397adab03bb8b5fd75c [term 17 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:22:12.034550 14686 raft_consensus.cc:515] T 22ccee1b570c4ad3a57bd7aec085b1b4 P cd75a17ab2604397adab03bb8b5fd75c [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:22:12.036985 14686 leader_election.cc:290] T 22ccee1b570c4ad3a57bd7aec085b1b4 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:22:12.037866 14686 raft_consensus.cc:493] T 4275cf08e63345f993bce8664eada830 P cd75a17ab2604397adab03bb8b5fd75c [term 21 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:22:12.038399 14686 raft_consensus.cc:515] T 4275cf08e63345f993bce8664eada830 P cd75a17ab2604397adab03bb8b5fd75c [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:22:12.040330 14686 leader_election.cc:290] T 4275cf08e63345f993bce8664eada830 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:22:12.041304  5625 raft_consensus.cc:2243] T 7ba5dac66ab5497e9e336f2a3c28cda5 P b7ab4784c7344b939bc36f639286f377 [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:12.042174  5625 raft_consensus.cc:2272] T 7ba5dac66ab5497e9e336f2a3c28cda5 P b7ab4784c7344b939bc36f639286f377 [term 23 FOLLOWER]: Raft consensus is shut down!
W20260709 13:22:12.044541  6844 leader_election.cc:336] T 22ccee1b570c4ad3a57bd7aec085b1b4 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111)
W20260709 13:22:12.047408  6844 leader_election.cc:336] T 22ccee1b570c4ad3a57bd7aec085b1b4 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:22:12.048456  6844 leader_election.cc:304] T 22ccee1b570c4ad3a57bd7aec085b1b4 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:22:12.045123  5625 tablet_replica.cc:333] T e31b9971c15848dea59d4d4130141d9e P b7ab4784c7344b939bc36f639286f377: stopping tablet replica
I20260709 13:22:12.049427 14686 raft_consensus.cc:2749] T 22ccee1b570c4ad3a57bd7aec085b1b4 P cd75a17ab2604397adab03bb8b5fd75c [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:22:12.054144  5625 raft_consensus.cc:2243] T e31b9971c15848dea59d4d4130141d9e P b7ab4784c7344b939bc36f639286f377 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:12.054772  5625 raft_consensus.cc:2272] T e31b9971c15848dea59d4d4130141d9e P b7ab4784c7344b939bc36f639286f377 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:12.057746  5625 tablet_replica.cc:333] T a3022224cc81473690653a83d4e99470 P b7ab4784c7344b939bc36f639286f377: stopping tablet replica
W20260709 13:22:12.059428  6844 leader_election.cc:336] T 4275cf08e63345f993bce8664eada830 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111)
W20260709 13:22:12.063024  6844 leader_election.cc:336] T 4275cf08e63345f993bce8664eada830 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:22:12.063490  6844 leader_election.cc:304] T 4275cf08e63345f993bce8664eada830 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:22:12.064246 14686 raft_consensus.cc:2749] T 4275cf08e63345f993bce8664eada830 P cd75a17ab2604397adab03bb8b5fd75c [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:22:12.063090  5625 raft_consensus.cc:2243] T a3022224cc81473690653a83d4e99470 P b7ab4784c7344b939bc36f639286f377 [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:12.065639 14689 raft_consensus.cc:493] T f58dc08b12a2494bb9a1372837970ca2 P b7ab4784c7344b939bc36f639286f377 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader cd75a17ab2604397adab03bb8b5fd75c)
I20260709 13:22:12.066293 14689 raft_consensus.cc:515] T f58dc08b12a2494bb9a1372837970ca2 P b7ab4784c7344b939bc36f639286f377 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
W20260709 13:22:12.065706 14670 raft_consensus.cc:670] T a3022224cc81473690653a83d4e99470 P b7ab4784c7344b939bc36f639286f377: failed to trigger leader election: Illegal state: RaftConsensus is not running: State = Stopping
I20260709 13:22:12.068997  5625 raft_consensus.cc:2272] T a3022224cc81473690653a83d4e99470 P b7ab4784c7344b939bc36f639286f377 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:12.070917 14689 leader_election.cc:290] T f58dc08b12a2494bb9a1372837970ca2 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:22:12.072481  6874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f58dc08b12a2494bb9a1372837970ca2" candidate_uuid: "b7ab4784c7344b939bc36f639286f377" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
W20260709 13:22:12.074568  6770 leader_election.cc:336] T f58dc08b12a2494bb9a1372837970ca2 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111)
I20260709 13:22:12.075055  6770 leader_election.cc:304] T f58dc08b12a2494bb9a1372837970ca2 P b7ab4784c7344b939bc36f639286f377 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7ab4784c7344b939bc36f639286f377; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:22:12.076472 14689 raft_consensus.cc:2749] T f58dc08b12a2494bb9a1372837970ca2 P b7ab4784c7344b939bc36f639286f377 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:22:12.086156  5625 tablet_replica.cc:333] T f58dc08b12a2494bb9a1372837970ca2 P b7ab4784c7344b939bc36f639286f377: stopping tablet replica
I20260709 13:22:12.089309  5625 raft_consensus.cc:2243] T f58dc08b12a2494bb9a1372837970ca2 P b7ab4784c7344b939bc36f639286f377 [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:12.090077  5625 raft_consensus.cc:2272] T f58dc08b12a2494bb9a1372837970ca2 P b7ab4784c7344b939bc36f639286f377 [term 21 FOLLOWER]: Raft consensus is shut down!
W20260709 13:22:12.088371  6844 consensus_peers.cc:597] T 34f36d59d88f40fe8a2805e604fc6c0a P cd75a17ab2604397adab03bb8b5fd75c -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
I20260709 13:22:12.174562 14677 raft_consensus.cc:493] T d8cee0accdb8499c86d4414b72565a38 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 23 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:22:12.175765 14677 raft_consensus.cc:515] T d8cee0accdb8499c86d4414b72565a38 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:22:12.179557  6874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8cee0accdb8499c86d4414b72565a38" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:22:12.181008 14677 leader_election.cc:290] T d8cee0accdb8499c86d4414b72565a38 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
W20260709 13:22:12.182834  7466 leader_election.cc:336] T d8cee0accdb8499c86d4414b72565a38 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:22:12.183353  7466 leader_election.cc:304] T d8cee0accdb8499c86d4414b72565a38 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:22:12.184508 14677 raft_consensus.cc:2749] T d8cee0accdb8499c86d4414b72565a38 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
W20260709 13:22:12.261292  6844 consensus_peers.cc:597] T 4b8cacb381b746da8d0049b0a83b41dd P cd75a17ab2604397adab03bb8b5fd75c -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
I20260709 13:22:12.310526 14669 raft_consensus.cc:493] T a1704639a875409b9959353527b3fd68 P cd75a17ab2604397adab03bb8b5fd75c [term 22 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:22:12.311224 14669 raft_consensus.cc:515] T a1704639a875409b9959353527b3fd68 P cd75a17ab2604397adab03bb8b5fd75c [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:22:12.313781 14669 leader_election.cc:290] T a1704639a875409b9959353527b3fd68 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
W20260709 13:22:12.325156  6844 leader_election.cc:336] T a1704639a875409b9959353527b3fd68 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111)
W20260709 13:22:12.326470  6844 leader_election.cc:336] T a1704639a875409b9959353527b3fd68 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:22:12.327056  6844 leader_election.cc:304] T a1704639a875409b9959353527b3fd68 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:22:12.328020 14669 raft_consensus.cc:2749] T a1704639a875409b9959353527b3fd68 P cd75a17ab2604397adab03bb8b5fd75c [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
W20260709 13:22:12.344698  6844 consensus_peers.cc:597] T f58dc08b12a2494bb9a1372837970ca2 P cd75a17ab2604397adab03bb8b5fd75c -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
I20260709 13:22:12.413046 14669 raft_consensus.cc:493] T d33d5ee8ef6f415593d8df52063161ad P cd75a17ab2604397adab03bb8b5fd75c [term 21 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:22:12.413703 14669 raft_consensus.cc:515] T d33d5ee8ef6f415593d8df52063161ad P cd75a17ab2604397adab03bb8b5fd75c [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:22:12.416399 14669 leader_election.cc:290] T d33d5ee8ef6f415593d8df52063161ad P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
W20260709 13:22:12.440142  6844 leader_election.cc:336] T d33d5ee8ef6f415593d8df52063161ad P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111)
I20260709 13:22:12.443405 14669 raft_consensus.cc:493] T b56bf91d90824c959e21e0cee5ba1816 P cd75a17ab2604397adab03bb8b5fd75c [term 18 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:22:12.444154 14669 raft_consensus.cc:515] T b56bf91d90824c959e21e0cee5ba1816 P cd75a17ab2604397adab03bb8b5fd75c [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:22:12.447055 14669 leader_election.cc:290] T b56bf91d90824c959e21e0cee5ba1816 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
W20260709 13:22:12.448127  6844 leader_election.cc:336] T d33d5ee8ef6f415593d8df52063161ad P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817): Network error: Client connection negotiation failed: client connection to 127.5.126.66:42817: connect: Connection refused (error 111)
I20260709 13:22:12.448765  6844 leader_election.cc:304] T d33d5ee8ef6f415593d8df52063161ad P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:22:12.449656 14669 raft_consensus.cc:2749] T d33d5ee8ef6f415593d8df52063161ad P cd75a17ab2604397adab03bb8b5fd75c [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:22:12.457347 14669 raft_consensus.cc:493] T 3d65025eea89441290d85dd053810e31 P cd75a17ab2604397adab03bb8b5fd75c [term 20 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:22:12.457970 14669 raft_consensus.cc:515] T 3d65025eea89441290d85dd053810e31 P cd75a17ab2604397adab03bb8b5fd75c [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:22:12.461390 14669 leader_election.cc:290] T 3d65025eea89441290d85dd053810e31 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:22:12.485445 14669 raft_consensus.cc:493] T 9b3759de40694069b13c0f8bd40e5709 P cd75a17ab2604397adab03bb8b5fd75c [term 20 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:22:12.486210 14669 raft_consensus.cc:515] T 9b3759de40694069b13c0f8bd40e5709 P cd75a17ab2604397adab03bb8b5fd75c [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:22:12.489737 14669 leader_election.cc:290] T 9b3759de40694069b13c0f8bd40e5709 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:22:12.504323 14669 raft_consensus.cc:493] T f03d0dbf16864ca4bc1bb5e4c0334c0f P cd75a17ab2604397adab03bb8b5fd75c [term 19 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:22:12.504988 14669 raft_consensus.cc:515] T f03d0dbf16864ca4bc1bb5e4c0334c0f P cd75a17ab2604397adab03bb8b5fd75c [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:22:12.505846 14686 raft_consensus.cc:493] T 8c7f33e544204fbaac4078e3e83bbf4e P cd75a17ab2604397adab03bb8b5fd75c [term 16 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:22:12.506449 14686 raft_consensus.cc:515] T 8c7f33e544204fbaac4078e3e83bbf4e P cd75a17ab2604397adab03bb8b5fd75c [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:22:12.507416 14669 leader_election.cc:290] T f03d0dbf16864ca4bc1bb5e4c0334c0f P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:22:12.512667 14669 raft_consensus.cc:493] T d8cee0accdb8499c86d4414b72565a38 P cd75a17ab2604397adab03bb8b5fd75c [term 23 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:22:12.513542 14686 leader_election.cc:290] T 8c7f33e544204fbaac4078e3e83bbf4e P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:22:12.513233 14669 raft_consensus.cc:515] T d8cee0accdb8499c86d4414b72565a38 P cd75a17ab2604397adab03bb8b5fd75c [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:22:12.519840  7495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8cee0accdb8499c86d4414b72565a38" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:22:12.520188 14669 leader_election.cc:290] T d8cee0accdb8499c86d4414b72565a38 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:22:12.520555  7495 raft_consensus.cc:2468] T d8cee0accdb8499c86d4414b72565a38 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 23.
I20260709 13:22:12.521843  6846 leader_election.cc:304] T d8cee0accdb8499c86d4414b72565a38 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:22:12.532240 14669 raft_consensus.cc:2804] T d8cee0accdb8499c86d4414b72565a38 P cd75a17ab2604397adab03bb8b5fd75c [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:22:12.532756 14669 raft_consensus.cc:493] T d8cee0accdb8499c86d4414b72565a38 P cd75a17ab2604397adab03bb8b5fd75c [term 23 FOLLOWER]: Starting leader election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:22:12.533195 14669 raft_consensus.cc:3060] T d8cee0accdb8499c86d4414b72565a38 P cd75a17ab2604397adab03bb8b5fd75c [term 23 FOLLOWER]: Advancing to term 24
W20260709 13:22:12.541986  6844 leader_election.cc:336] T b56bf91d90824c959e21e0cee5ba1816 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111)
I20260709 13:22:12.544512 14669 raft_consensus.cc:515] T d8cee0accdb8499c86d4414b72565a38 P cd75a17ab2604397adab03bb8b5fd75c [term 24 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:22:12.551496 14669 leader_election.cc:290] T d8cee0accdb8499c86d4414b72565a38 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 24 election: Requested vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:22:12.551697  7495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8cee0accdb8499c86d4414b72565a38" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb"
I20260709 13:22:12.552292  7495 raft_consensus.cc:3060] T d8cee0accdb8499c86d4414b72565a38 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 23 FOLLOWER]: Advancing to term 24
W20260709 13:22:12.552232  6844 leader_election.cc:336] T b56bf91d90824c959e21e0cee5ba1816 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817): Network error: Client connection negotiation failed: client connection to 127.5.126.66:42817: connect: Connection refused (error 111)
I20260709 13:22:12.553287  6844 leader_election.cc:304] T b56bf91d90824c959e21e0cee5ba1816 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
W20260709 13:22:12.554268  6844 leader_election.cc:336] T 3d65025eea89441290d85dd053810e31 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817): Network error: Client connection negotiation failed: client connection to 127.5.126.66:42817: connect: Connection refused (error 111)
I20260709 13:22:12.556689 14669 raft_consensus.cc:2749] T b56bf91d90824c959e21e0cee5ba1816 P cd75a17ab2604397adab03bb8b5fd75c [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:22:12.561043  7495 raft_consensus.cc:2468] T d8cee0accdb8499c86d4414b72565a38 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 24.
I20260709 13:22:12.565383  6846 leader_election.cc:304] T d8cee0accdb8499c86d4414b72565a38 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
W20260709 13:22:12.566283  6844 leader_election.cc:336] T 3d65025eea89441290d85dd053810e31 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111)
I20260709 13:22:12.566469 14669 raft_consensus.cc:2804] T d8cee0accdb8499c86d4414b72565a38 P cd75a17ab2604397adab03bb8b5fd75c [term 24 FOLLOWER]: Leader election won for term 24
I20260709 13:22:12.566982  6844 leader_election.cc:304] T 3d65025eea89441290d85dd053810e31 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:22:12.567354 14669 raft_consensus.cc:697] T d8cee0accdb8499c86d4414b72565a38 P cd75a17ab2604397adab03bb8b5fd75c [term 24 LEADER]: Becoming Leader. State: Replica: cd75a17ab2604397adab03bb8b5fd75c, State: Running, Role: LEADER
I20260709 13:22:12.568020 14686 raft_consensus.cc:2749] T 3d65025eea89441290d85dd053810e31 P cd75a17ab2604397adab03bb8b5fd75c [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:22:12.568825 14669 consensus_queue.cc:237] T d8cee0accdb8499c86d4414b72565a38 P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 23.16, Last appended by leader: 16, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
W20260709 13:22:12.570231  6844 consensus_peers.cc:597] T 713b5728a197487c9300b310ab94e5a3 P cd75a17ab2604397adab03bb8b5fd75c -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260709 13:22:12.576604  6844 leader_election.cc:336] T 9b3759de40694069b13c0f8bd40e5709 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111)
I20260709 13:22:12.581506 14686 raft_consensus.cc:493] T f5be3a11b23d4ea9b08300a2789821c7 P cd75a17ab2604397adab03bb8b5fd75c [term 21 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:22:12.582216 14686 raft_consensus.cc:515] T f5be3a11b23d4ea9b08300a2789821c7 P cd75a17ab2604397adab03bb8b5fd75c [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:22:12.584642 14686 leader_election.cc:290] T f5be3a11b23d4ea9b08300a2789821c7 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
W20260709 13:22:12.587397  6844 leader_election.cc:336] T 9b3759de40694069b13c0f8bd40e5709 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817): Network error: Client connection negotiation failed: client connection to 127.5.126.66:42817: connect: Connection refused (error 111)
I20260709 13:22:12.588068  6844 leader_election.cc:304] T 9b3759de40694069b13c0f8bd40e5709 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:22:12.590935 14686 raft_consensus.cc:2749] T 9b3759de40694069b13c0f8bd40e5709 P cd75a17ab2604397adab03bb8b5fd75c [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 13:22:12.592499  6844 leader_election.cc:336] T f03d0dbf16864ca4bc1bb5e4c0334c0f P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817): Network error: Client connection negotiation failed: client connection to 127.5.126.66:42817: connect: Connection refused (error 111)
W20260709 13:22:12.593123  6844 leader_election.cc:336] T 8c7f33e544204fbaac4078e3e83bbf4e P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817): Network error: Client connection negotiation failed: client connection to 127.5.126.66:42817: connect: Connection refused (error 111)
W20260709 13:22:12.593717  6844 leader_election.cc:336] T d8cee0accdb8499c86d4414b72565a38 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817): Network error: Client connection negotiation failed: client connection to 127.5.126.66:42817: connect: Connection refused (error 111)
I20260709 13:22:12.596210 14686 raft_consensus.cc:493] T 30e88460611e47b2ba16a46a30b5f416 P cd75a17ab2604397adab03bb8b5fd75c [term 16 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
W20260709 13:22:12.605489  6844 leader_election.cc:336] T f03d0dbf16864ca4bc1bb5e4c0334c0f P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111)
I20260709 13:22:12.606494  6844 leader_election.cc:304] T f03d0dbf16864ca4bc1bb5e4c0334c0f P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:22:12.606127 14686 raft_consensus.cc:515] T 30e88460611e47b2ba16a46a30b5f416 P cd75a17ab2604397adab03bb8b5fd75c [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:22:12.607611 14669 raft_consensus.cc:2749] T f03d0dbf16864ca4bc1bb5e4c0334c0f P cd75a17ab2604397adab03bb8b5fd75c [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:22:12.608711 14686 leader_election.cc:290] T 30e88460611e47b2ba16a46a30b5f416 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
W20260709 13:22:12.608685  6844 leader_election.cc:336] T 8c7f33e544204fbaac4078e3e83bbf4e P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111)
I20260709 13:22:12.610427  6844 leader_election.cc:304] T 8c7f33e544204fbaac4078e3e83bbf4e P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:22:12.610230  6624 catalog_manager.cc:5697] T d8cee0accdb8499c86d4414b72565a38 P cd75a17ab2604397adab03bb8b5fd75c reported cstate change: term changed from 23 to 24, leader changed from b7ab4784c7344b939bc36f639286f377 (127.5.126.66) to cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67). New cstate: current_term: 24 leader_uuid: "cd75a17ab2604397adab03bb8b5fd75c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:22:12.612438 14686 raft_consensus.cc:2749] T 8c7f33e544204fbaac4078e3e83bbf4e P cd75a17ab2604397adab03bb8b5fd75c [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:22:12.628486  6844 leader_election.cc:336] T d8cee0accdb8499c86d4414b72565a38 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 24 election: RPC error from VoteRequest() call to peer b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817): Network error: Client connection negotiation failed: client connection to 127.5.126.66:42817: connect: Connection refused (error 111)
W20260709 13:22:12.640161  6844 leader_election.cc:336] T f5be3a11b23d4ea9b08300a2789821c7 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111)
W20260709 13:22:12.644507  6844 leader_election.cc:336] T 30e88460611e47b2ba16a46a30b5f416 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111)
W20260709 13:22:12.645609  6844 leader_election.cc:336] T 30e88460611e47b2ba16a46a30b5f416 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817): Network error: Client connection negotiation failed: client connection to 127.5.126.66:42817: connect: Connection refused (error 111)
I20260709 13:22:12.646188  6844 leader_election.cc:304] T 30e88460611e47b2ba16a46a30b5f416 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:22:12.656610 14669 raft_consensus.cc:2749] T 30e88460611e47b2ba16a46a30b5f416 P cd75a17ab2604397adab03bb8b5fd75c [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:22:12.661118  6844 leader_election.cc:336] T f5be3a11b23d4ea9b08300a2789821c7 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817): Network error: Client connection negotiation failed: client connection to 127.5.126.66:42817: connect: Connection refused (error 111)
I20260709 13:22:12.661775  6844 leader_election.cc:304] T f5be3a11b23d4ea9b08300a2789821c7 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:22:12.662732 14669 raft_consensus.cc:2749] T f5be3a11b23d4ea9b08300a2789821c7 P cd75a17ab2604397adab03bb8b5fd75c [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 13:22:12.670238  6844 consensus_peers.cc:597] T 711ef6523deb4cbe8ef2ba61e1c21c98 P cd75a17ab2604397adab03bb8b5fd75c -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:22:12.684602  7468 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.67:42931, user_credentials={real_user=slave}} blocked reactor thread for 48687.6us
W20260709 13:22:12.720026  7466 consensus_peers.cc:597] T fe20b4b48823486ca3b9c648db6ce8aa P 7ba59cc884714e8aa5f3f0ecaed84cbb -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:22:12.720665  6902 debug-util.cc:398] Leaking SignalData structure 0x7b0800314780 after lost signal to thread 5628
W20260709 13:22:12.721953  6902 debug-util.cc:398] Leaking SignalData structure 0x7b08001c27e0 after lost signal to thread 6664
W20260709 13:22:12.722555  6902 debug-util.cc:398] Leaking SignalData structure 0x7b08001c0e20 after lost signal to thread 6831
W20260709 13:22:12.723804  6902 debug-util.cc:398] Leaking SignalData structure 0x7b08003b1160 after lost signal to thread 6905
W20260709 13:22:12.725246  6902 debug-util.cc:398] Leaking SignalData structure 0x7b0800388200 after lost signal to thread 7527
I20260709 13:22:12.752682 14686 raft_consensus.cc:493] T bd6869f07b5a4885a0b99fbe60c3b175 P cd75a17ab2604397adab03bb8b5fd75c [term 27 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:22:12.753489 14686 raft_consensus.cc:515] T bd6869f07b5a4885a0b99fbe60c3b175 P cd75a17ab2604397adab03bb8b5fd75c [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:22:12.755971 14686 leader_election.cc:290] T bd6869f07b5a4885a0b99fbe60c3b175 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:22:12.761372 14686 raft_consensus.cc:493] T ab432e62819d499eaaf3dd55481dd930 P cd75a17ab2604397adab03bb8b5fd75c [term 25 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:22:12.761970 14686 raft_consensus.cc:515] T ab432e62819d499eaaf3dd55481dd930 P cd75a17ab2604397adab03bb8b5fd75c [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
W20260709 13:22:12.764904  6844 leader_election.cc:336] T bd6869f07b5a4885a0b99fbe60c3b175 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 28 pre-election: RPC error from VoteRequest() call to peer b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817): Network error: Client connection negotiation failed: client connection to 127.5.126.66:42817: connect: Connection refused (error 111)
W20260709 13:22:12.766237  6844 leader_election.cc:336] T bd6869f07b5a4885a0b99fbe60c3b175 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 28 pre-election: RPC error from VoteRequest() call to peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111)
I20260709 13:22:12.766148 14686 leader_election.cc:290] T ab432e62819d499eaaf3dd55481dd930 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:22:12.766958  6844 leader_election.cc:304] T bd6869f07b5a4885a0b99fbe60c3b175 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:22:12.767891 14686 raft_consensus.cc:2749] T bd6869f07b5a4885a0b99fbe60c3b175 P cd75a17ab2604397adab03bb8b5fd75c [term 27 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
W20260709 13:22:12.801329  6844 leader_election.cc:336] T ab432e62819d499eaaf3dd55481dd930 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111)
W20260709 13:22:12.814677  6844 leader_election.cc:336] T ab432e62819d499eaaf3dd55481dd930 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817): Network error: Client connection negotiation failed: client connection to 127.5.126.66:42817: connect: Connection refused (error 111)
I20260709 13:22:12.824275  6844 leader_election.cc:304] T ab432e62819d499eaaf3dd55481dd930 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:22:12.825295 14686 raft_consensus.cc:2749] T ab432e62819d499eaaf3dd55481dd930 P cd75a17ab2604397adab03bb8b5fd75c [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
W20260709 13:22:12.826798  6844 consensus_peers.cc:597] T 9e326172347f45e99a0d482b5d8ef768 P cd75a17ab2604397adab03bb8b5fd75c -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
I20260709 13:22:12.827322 14669 raft_consensus.cc:493] T 7c37d41cd9164c15a6826ca62a851a69 P cd75a17ab2604397adab03bb8b5fd75c [term 23 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:22:12.827986 14669 raft_consensus.cc:515] T 7c37d41cd9164c15a6826ca62a851a69 P cd75a17ab2604397adab03bb8b5fd75c [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:22:12.830163 14669 leader_election.cc:290] T 7c37d41cd9164c15a6826ca62a851a69 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
W20260709 13:22:12.861630  6844 leader_election.cc:336] T 7c37d41cd9164c15a6826ca62a851a69 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817): Network error: Client connection negotiation failed: client connection to 127.5.126.66:42817: connect: Connection refused (error 111)
W20260709 13:22:12.862648  6844 leader_election.cc:336] T 7c37d41cd9164c15a6826ca62a851a69 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111)
I20260709 13:22:12.872242  6844 leader_election.cc:304] T 7c37d41cd9164c15a6826ca62a851a69 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:22:12.873451 14699 raft_consensus.cc:2749] T 7c37d41cd9164c15a6826ca62a851a69 P cd75a17ab2604397adab03bb8b5fd75c [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:22:12.907730 14699 raft_consensus.cc:493] T f4b8bd455d5a47c18a1380839c6e0d61 P cd75a17ab2604397adab03bb8b5fd75c [term 22 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:22:12.908479 14699 raft_consensus.cc:515] T f4b8bd455d5a47c18a1380839c6e0d61 P cd75a17ab2604397adab03bb8b5fd75c [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:22:12.911175 14699 leader_election.cc:290] T f4b8bd455d5a47c18a1380839c6e0d61 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
W20260709 13:22:12.927177  6844 leader_election.cc:336] T f4b8bd455d5a47c18a1380839c6e0d61 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111)
W20260709 13:22:12.929466  6844 leader_election.cc:336] T f4b8bd455d5a47c18a1380839c6e0d61 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817): Network error: Client connection negotiation failed: client connection to 127.5.126.66:42817: connect: Connection refused (error 111)
I20260709 13:22:12.930014  6844 leader_election.cc:304] T f4b8bd455d5a47c18a1380839c6e0d61 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:22:12.930869 14699 raft_consensus.cc:2749] T f4b8bd455d5a47c18a1380839c6e0d61 P cd75a17ab2604397adab03bb8b5fd75c [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:22:12.951268 14699 raft_consensus.cc:493] T 20f6842e26174571996b8dea4151d4be P cd75a17ab2604397adab03bb8b5fd75c [term 22 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:22:12.951923 14699 raft_consensus.cc:515] T 20f6842e26174571996b8dea4151d4be P cd75a17ab2604397adab03bb8b5fd75c [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:22:12.954272 14699 leader_election.cc:290] T 20f6842e26174571996b8dea4151d4be P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
W20260709 13:22:12.961042  7466 consensus_peers.cc:597] T 7a734b5ab7834e05a8c422208acc58b1 P 7ba59cc884714e8aa5f3f0ecaed84cbb -> Peer b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817): Couldn't send request to peer b7ab4784c7344b939bc36f639286f377. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.66:42817: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:22:12.964250  6844 leader_election.cc:336] T 20f6842e26174571996b8dea4151d4be P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111)
W20260709 13:22:12.965278  6844 leader_election.cc:336] T 20f6842e26174571996b8dea4151d4be P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817): Network error: Client connection negotiation failed: client connection to 127.5.126.66:42817: connect: Connection refused (error 111)
I20260709 13:22:12.965691  6844 leader_election.cc:304] T 20f6842e26174571996b8dea4151d4be P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:22:12.966486 14699 raft_consensus.cc:2749] T 20f6842e26174571996b8dea4151d4be P cd75a17ab2604397adab03bb8b5fd75c [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:22:12.974745  7495 raft_consensus.cc:1275] T d8cee0accdb8499c86d4414b72565a38 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 24 FOLLOWER]: Refusing update from remote peer cd75a17ab2604397adab03bb8b5fd75c: Log matching property violated. Preceding OpId in replica: term: 23 index: 16. Preceding OpId from leader: term: 24 index: 17. (index mismatch)
I20260709 13:22:12.977029 14699 consensus_queue.cc:1048] T d8cee0accdb8499c86d4414b72565a38 P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.001s
W20260709 13:22:13.010457  6844 consensus_peers.cc:597] T d8cee0accdb8499c86d4414b72565a38 P cd75a17ab2604397adab03bb8b5fd75c -> Peer b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817): Couldn't send request to peer b7ab4784c7344b939bc36f639286f377. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.66:42817: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:22:13.055119 14693 raft_consensus.cc:493] T 3a485a995abc4807b6e511e45419f737 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 17 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:22:13.055804 14693 raft_consensus.cc:515] T 3a485a995abc4807b6e511e45419f737 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:22:13.060020  6874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a485a995abc4807b6e511e45419f737" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:22:13.063679 14693 leader_election.cc:290] T 3a485a995abc4807b6e511e45419f737 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
W20260709 13:22:13.066489  7466 leader_election.cc:336] T 3a485a995abc4807b6e511e45419f737 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817): Network error: Client connection negotiation failed: client connection to 127.5.126.66:42817: connect: Connection refused (error 111)
I20260709 13:22:13.066996  7466 leader_election.cc:304] T 3a485a995abc4807b6e511e45419f737 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:22:13.068816 14695 raft_consensus.cc:2749] T 3a485a995abc4807b6e511e45419f737 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:22:13.073455  6844 consensus_peers.cc:597] T 7c44c4849aa54f2b94d1f1bef9ed546f P cd75a17ab2604397adab03bb8b5fd75c -> Peer b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817): Couldn't send request to peer b7ab4784c7344b939bc36f639286f377. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.66:42817: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:22:13.093449  7466 consensus_peers.cc:597] T bb3d8792045a4583ae2e965b1350a5b4 P 7ba59cc884714e8aa5f3f0ecaed84cbb -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:22:13.111416  6844 consensus_peers.cc:597] T 713b5728a197487c9300b310ab94e5a3 P cd75a17ab2604397adab03bb8b5fd75c -> Peer b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817): Couldn't send request to peer b7ab4784c7344b939bc36f639286f377. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.66:42817: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:22:13.156257  6844 consensus_peers.cc:597] T ce4f062dcd314d43a63ca74067cb5ee3 P cd75a17ab2604397adab03bb8b5fd75c -> Peer b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817): Couldn't send request to peer b7ab4784c7344b939bc36f639286f377. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.66:42817: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:22:13.162411 14686 raft_consensus.cc:493] T 4d9def8b32fd443aa94ab1420b06837b P cd75a17ab2604397adab03bb8b5fd75c [term 24 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:22:13.163107 14686 raft_consensus.cc:515] T 4d9def8b32fd443aa94ab1420b06837b P cd75a17ab2604397adab03bb8b5fd75c [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:22:13.165530 14686 leader_election.cc:290] T 4d9def8b32fd443aa94ab1420b06837b P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
W20260709 13:22:13.173856  6844 leader_election.cc:336] T 4d9def8b32fd443aa94ab1420b06837b P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111)
I20260709 13:22:13.174072 14686 raft_consensus.cc:493] T 07a92dd554674067a83a9cb68c4773f2 P cd75a17ab2604397adab03bb8b5fd75c [term 19 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
W20260709 13:22:13.174891  6844 leader_election.cc:336] T 4d9def8b32fd443aa94ab1420b06837b P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817): Network error: Client connection negotiation failed: client connection to 127.5.126.66:42817: connect: Connection refused (error 111)
I20260709 13:22:13.174736 14686 raft_consensus.cc:515] T 07a92dd554674067a83a9cb68c4773f2 P cd75a17ab2604397adab03bb8b5fd75c [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:22:13.177649 14700 raft_consensus.cc:493] T de3186201e1a40d0b335eeb8b4e256e0 P cd75a17ab2604397adab03bb8b5fd75c [term 23 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:22:13.178206 14700 raft_consensus.cc:515] T de3186201e1a40d0b335eeb8b4e256e0 P cd75a17ab2604397adab03bb8b5fd75c [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:22:13.175380  6844 leader_election.cc:304] T 4d9def8b32fd443aa94ab1420b06837b P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:22:13.180765 14699 raft_consensus.cc:2749] T 4d9def8b32fd443aa94ab1420b06837b P cd75a17ab2604397adab03bb8b5fd75c [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:22:13.180356 14700 leader_election.cc:290] T de3186201e1a40d0b335eeb8b4e256e0 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:22:13.177165 14686 leader_election.cc:290] T 07a92dd554674067a83a9cb68c4773f2 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:22:13.182706 14700 raft_consensus.cc:493] T dbdf895bba214ff68685a24fd17dfb5d P cd75a17ab2604397adab03bb8b5fd75c [term 21 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:22:13.183211 14700 raft_consensus.cc:515] T dbdf895bba214ff68685a24fd17dfb5d P cd75a17ab2604397adab03bb8b5fd75c [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:22:13.185891 14700 leader_election.cc:290] T dbdf895bba214ff68685a24fd17dfb5d P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:22:13.189934 14700 raft_consensus.cc:493] T d8292e16e5654be6bc408560cf256aaa P cd75a17ab2604397adab03bb8b5fd75c [term 22 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:22:13.190441 14700 raft_consensus.cc:515] T d8292e16e5654be6bc408560cf256aaa P cd75a17ab2604397adab03bb8b5fd75c [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:22:13.192442 14700 leader_election.cc:290] T d8292e16e5654be6bc408560cf256aaa P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:22:13.196848 14700 raft_consensus.cc:493] T 2c240553ce044eedb41541d72b9475d7 P cd75a17ab2604397adab03bb8b5fd75c [term 21 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:22:13.198942 14700 raft_consensus.cc:515] T 2c240553ce044eedb41541d72b9475d7 P cd75a17ab2604397adab03bb8b5fd75c [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:22:13.201292 14700 leader_election.cc:290] T 2c240553ce044eedb41541d72b9475d7 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
W20260709 13:22:13.213505  6844 leader_election.cc:336] T 07a92dd554674067a83a9cb68c4773f2 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111)
W20260709 13:22:13.214229  6844 leader_election.cc:336] T de3186201e1a40d0b335eeb8b4e256e0 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111)
W20260709 13:22:13.215051  6844 leader_election.cc:336] T dbdf895bba214ff68685a24fd17dfb5d P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111)
W20260709 13:22:13.216537  6844 leader_election.cc:336] T 07a92dd554674067a83a9cb68c4773f2 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817): Network error: Client connection negotiation failed: client connection to 127.5.126.66:42817: connect: Connection refused (error 111)
I20260709 13:22:13.217096  6844 leader_election.cc:304] T 07a92dd554674067a83a9cb68c4773f2 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:22:13.218134 14700 raft_consensus.cc:2749] T 07a92dd554674067a83a9cb68c4773f2 P cd75a17ab2604397adab03bb8b5fd75c [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 13:22:13.218343  6844 leader_election.cc:336] T de3186201e1a40d0b335eeb8b4e256e0 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817): Network error: Client connection negotiation failed: client connection to 127.5.126.66:42817: connect: Connection refused (error 111)
I20260709 13:22:13.218770  6844 leader_election.cc:304] T de3186201e1a40d0b335eeb8b4e256e0 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:22:13.227914 14700 raft_consensus.cc:493] T f3f9c2e2bf644115957398fe4c9459db P cd75a17ab2604397adab03bb8b5fd75c [term 23 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:22:13.232440 14700 raft_consensus.cc:515] T f3f9c2e2bf644115957398fe4c9459db P cd75a17ab2604397adab03bb8b5fd75c [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } attrs { replace: true } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:22:13.232632 14686 raft_consensus.cc:2749] T de3186201e1a40d0b335eeb8b4e256e0 P cd75a17ab2604397adab03bb8b5fd75c [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
W20260709 13:22:13.232756  6844 leader_election.cc:336] T dbdf895bba214ff68685a24fd17dfb5d P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817): Network error: Client connection negotiation failed: client connection to 127.5.126.66:42817: connect: Connection refused (error 111)
I20260709 13:22:13.233547  6844 leader_election.cc:304] T dbdf895bba214ff68685a24fd17dfb5d P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:22:13.234354 14686 raft_consensus.cc:2749] T dbdf895bba214ff68685a24fd17dfb5d P cd75a17ab2604397adab03bb8b5fd75c [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:22:13.236977 14700 leader_election.cc:290] T f3f9c2e2bf644115957398fe4c9459db P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:22:13.237473  7495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f9c2e2bf644115957398fe4c9459db" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
W20260709 13:22:13.239427  7466 consensus_peers.cc:597] T 427c124d773f483294511e80fe340075 P 7ba59cc884714e8aa5f3f0ecaed84cbb -> Peer b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817): Couldn't send request to peer b7ab4784c7344b939bc36f639286f377. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.66:42817: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:22:13.240418 14700 raft_consensus.cc:493] T 3a485a995abc4807b6e511e45419f737 P cd75a17ab2604397adab03bb8b5fd75c [term 17 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:22:13.241086 14700 raft_consensus.cc:515] T 3a485a995abc4807b6e511e45419f737 P cd75a17ab2604397adab03bb8b5fd75c [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
W20260709 13:22:13.241695  6844 leader_election.cc:336] T d8292e16e5654be6bc408560cf256aaa P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111)
W20260709 13:22:13.242206  6844 leader_election.cc:336] T 2c240553ce044eedb41541d72b9475d7 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111)
W20260709 13:22:13.242995  6844 leader_election.cc:336] T d8292e16e5654be6bc408560cf256aaa P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817): Network error: Client connection negotiation failed: client connection to 127.5.126.66:42817: connect: Connection refused (error 111)
I20260709 13:22:13.243427  6844 leader_election.cc:304] T d8292e16e5654be6bc408560cf256aaa P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:22:13.244944 14669 raft_consensus.cc:2749] T d8292e16e5654be6bc408560cf256aaa P cd75a17ab2604397adab03bb8b5fd75c [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
W20260709 13:22:13.244997  6844 leader_election.cc:336] T 2c240553ce044eedb41541d72b9475d7 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817): Network error: Client connection negotiation failed: client connection to 127.5.126.66:42817: connect: Connection refused (error 111)
I20260709 13:22:13.246286  6844 leader_election.cc:304] T 2c240553ce044eedb41541d72b9475d7 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:22:13.247785 14700 leader_election.cc:290] T 3a485a995abc4807b6e511e45419f737 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
I20260709 13:22:13.249145  6619 maintenance_manager.cc:419] P b3ae52d33b9a4273a42e5e2cf3b5d6b5: Scheduling FlushDeltaMemStoresOp(00000000000000000000000000000000): perf score=0.033401
I20260709 13:22:13.249125  7495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a485a995abc4807b6e511e45419f737" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" is_pre_election: true
I20260709 13:22:13.251631  7495 raft_consensus.cc:2468] T 3a485a995abc4807b6e511e45419f737 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 17.
I20260709 13:22:13.253319  6846 leader_election.cc:304] T 3a485a995abc4807b6e511e45419f737 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, cd75a17ab2604397adab03bb8b5fd75c; no voters: 
I20260709 13:22:13.254544 14700 raft_consensus.cc:2804] T 3a485a995abc4807b6e511e45419f737 P cd75a17ab2604397adab03bb8b5fd75c [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:22:13.255015 14700 raft_consensus.cc:493] T 3a485a995abc4807b6e511e45419f737 P cd75a17ab2604397adab03bb8b5fd75c [term 17 FOLLOWER]: Starting leader election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:22:13.255421 14700 raft_consensus.cc:3060] T 3a485a995abc4807b6e511e45419f737 P cd75a17ab2604397adab03bb8b5fd75c [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:22:13.264405 14686 raft_consensus.cc:2749] T 2c240553ce044eedb41541d72b9475d7 P cd75a17ab2604397adab03bb8b5fd75c [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 13:22:13.267990  6844 leader_election.cc:336] T f3f9c2e2bf644115957398fe4c9459db P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817): Network error: Client connection negotiation failed: client connection to 127.5.126.66:42817: connect: Connection refused (error 111)
I20260709 13:22:13.269446  6844 leader_election.cc:304] T f3f9c2e2bf644115957398fe4c9459db P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, b7ab4784c7344b939bc36f639286f377
I20260709 13:22:13.275885 14700 raft_consensus.cc:515] T 3a485a995abc4807b6e511e45419f737 P cd75a17ab2604397adab03bb8b5fd75c [term 18 FOLLOWER]: Starting leader election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:22:13.277014 14686 raft_consensus.cc:2749] T f3f9c2e2bf644115957398fe4c9459db P cd75a17ab2604397adab03bb8b5fd75c [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
W20260709 13:22:13.277428  6844 consensus_peers.cc:597] T e31b9971c15848dea59d4d4130141d9e P cd75a17ab2604397adab03bb8b5fd75c -> Peer b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817): Couldn't send request to peer b7ab4784c7344b939bc36f639286f377. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.66:42817: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:22:13.278226 14686 raft_consensus.cc:493] T 7887766dc6784fcaa42b35c05fea7a99 P cd75a17ab2604397adab03bb8b5fd75c [term 23 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
W20260709 13:22:13.278728  6844 leader_election.cc:336] T f3f9c2e2bf644115957398fe4c9459db P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111)
I20260709 13:22:13.278752 14686 raft_consensus.cc:515] T 7887766dc6784fcaa42b35c05fea7a99 P cd75a17ab2604397adab03bb8b5fd75c [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:22:13.281369 14686 leader_election.cc:290] T 7887766dc6784fcaa42b35c05fea7a99 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
W20260709 13:22:13.286131  6844 leader_election.cc:336] T 3a485a995abc4807b6e511e45419f737 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817): Network error: Client connection negotiation failed: client connection to 127.5.126.66:42817: connect: Connection refused (error 111)
W20260709 13:22:13.289538  6844 consensus_peers.cc:597] T 9e326172347f45e99a0d482b5d8ef768 P cd75a17ab2604397adab03bb8b5fd75c -> Peer b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817): Couldn't send request to peer b7ab4784c7344b939bc36f639286f377. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.66:42817: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:22:13.289846  7495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a485a995abc4807b6e511e45419f737" candidate_uuid: "cd75a17ab2604397adab03bb8b5fd75c" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb"
I20260709 13:22:13.296510  7495 raft_consensus.cc:3060] T 3a485a995abc4807b6e511e45419f737 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:22:13.291808 14700 leader_election.cc:290] T 3a485a995abc4807b6e511e45419f737 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 18 election: Requested vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), 7ba59cc884714e8aa5f3f0ecaed84cbb (127.5.126.68:45071)
W20260709 13:22:13.305672  7466 consensus_peers.cc:597] T b3f13b31a1f84f0d89d007eadd57924c P 7ba59cc884714e8aa5f3f0ecaed84cbb -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
W20260709 13:22:13.305277  6844 consensus_peers.cc:597] T 1bf4668eeb70467fb3dc5a0289233b3c P cd75a17ab2604397adab03bb8b5fd75c -> Peer b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817): Couldn't send request to peer b7ab4784c7344b939bc36f639286f377. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.66:42817: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:22:13.314464  6844 leader_election.cc:336] T 7887766dc6784fcaa42b35c05fea7a99 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817): Network error: Client connection negotiation failed: client connection to 127.5.126.66:42817: connect: Connection refused (error 111)
I20260709 13:22:13.315462 14693 raft_consensus.cc:493] T f3f9c2e2bf644115957398fe4c9459db P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 23 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:22:13.316469 14693 raft_consensus.cc:515] T f3f9c2e2bf644115957398fe4c9459db P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } attrs { replace: true } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:22:13.313069  7495 raft_consensus.cc:2468] T 3a485a995abc4807b6e511e45419f737 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd75a17ab2604397adab03bb8b5fd75c in term 18.
W20260709 13:22:13.317274  6844 consensus_peers.cc:597] T 7c44c4849aa54f2b94d1f1bef9ed546f P cd75a17ab2604397adab03bb8b5fd75c -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:22:13.317811  6844 leader_election.cc:336] T 7887766dc6784fcaa42b35c05fea7a99 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111)
I20260709 13:22:13.318179  6844 leader_election.cc:304] T 7887766dc6784fcaa42b35c05fea7a99 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:22:13.319002 14700 raft_consensus.cc:2749] T 7887766dc6784fcaa42b35c05fea7a99 P cd75a17ab2604397adab03bb8b5fd75c [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
W20260709 13:22:13.319691  6844 consensus_peers.cc:597] T f58dc08b12a2494bb9a1372837970ca2 P cd75a17ab2604397adab03bb8b5fd75c -> Peer b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817): Couldn't send request to peer b7ab4784c7344b939bc36f639286f377. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.66:42817: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:22:13.320199  6844 leader_election.cc:336] T 3a485a995abc4807b6e511e45419f737 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 18 election: RPC error from VoteRequest() call to peer b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817): Network error: Client connection negotiation failed: client connection to 127.5.126.66:42817: connect: Connection refused (error 111)
I20260709 13:22:13.321447  6846 leader_election.cc:304] T 3a485a995abc4807b6e511e45419f737 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377
I20260709 13:22:13.323736  6879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f9c2e2bf644115957398fe4c9459db" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:22:13.324250 14700 raft_consensus.cc:2804] T 3a485a995abc4807b6e511e45419f737 P cd75a17ab2604397adab03bb8b5fd75c [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:22:13.324504  6879 raft_consensus.cc:2468] T f3f9c2e2bf644115957398fe4c9459db P cd75a17ab2604397adab03bb8b5fd75c [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in term 23.
I20260709 13:22:13.324774 14700 raft_consensus.cc:697] T 3a485a995abc4807b6e511e45419f737 P cd75a17ab2604397adab03bb8b5fd75c [term 18 LEADER]: Becoming Leader. State: Replica: cd75a17ab2604397adab03bb8b5fd75c, State: Running, Role: LEADER
I20260709 13:22:13.325806 14700 consensus_queue.cc:237] T 3a485a995abc4807b6e511e45419f737 P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
W20260709 13:22:13.331813  7466 leader_election.cc:336] T f3f9c2e2bf644115957398fe4c9459db P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111)
W20260709 13:22:13.332790  7466 leader_election.cc:336] T f3f9c2e2bf644115957398fe4c9459db P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817): Network error: Client connection negotiation failed: client connection to 127.5.126.66:42817: connect: Connection refused (error 111)
I20260709 13:22:13.333288  7466 leader_election.cc:304] T f3f9c2e2bf644115957398fe4c9459db P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:22:13.334738 14695 raft_consensus.cc:2749] T f3f9c2e2bf644115957398fe4c9459db P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:22:13.333825 14693 leader_election.cc:290] T f3f9c2e2bf644115957398fe4c9459db P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:22:13.341332  6618 maintenance_manager.cc:643] P b3ae52d33b9a4273a42e5e2cf3b5d6b5: FlushDeltaMemStoresOp(00000000000000000000000000000000) complete. Timing: real 0.090s	user 0.039s	sys 0.002s Metrics: {"bytes_written":6776,"delete_count":0,"lbm_write_time_us":925,"lbm_writes_lt_1ms":6,"reinsert_count":0,"update_count":279}
I20260709 13:22:13.344023  6619 maintenance_manager.cc:419] P b3ae52d33b9a4273a42e5e2cf3b5d6b5: Scheduling MajorDeltaCompactionOp(00000000000000000000000000000000): perf score=0.321452
W20260709 13:22:13.349977  6844 consensus_peers.cc:597] T 44bde925b2e541b69890d70715b85176 P cd75a17ab2604397adab03bb8b5fd75c -> Peer b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817): Couldn't send request to peer b7ab4784c7344b939bc36f639286f377. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.66:42817: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:22:13.350600  6844 consensus_peers.cc:597] T bb7fa124c3bf4ef9ab65a407cb008441 P cd75a17ab2604397adab03bb8b5fd75c -> Peer b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817): Couldn't send request to peer b7ab4784c7344b939bc36f639286f377. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.66:42817: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:22:13.357596  5625 thread.cc:527] Waited for 1000ms trying to join with diag-logger (tid 6828)
I20260709 13:22:13.358560  6624 catalog_manager.cc:5697] T 3a485a995abc4807b6e511e45419f737 P cd75a17ab2604397adab03bb8b5fd75c reported cstate change: term changed from 17 to 18, leader changed from b7ab4784c7344b939bc36f639286f377 (127.5.126.66) to cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67). New cstate: current_term: 18 leader_uuid: "cd75a17ab2604397adab03bb8b5fd75c" committed_config { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 13:22:13.373905  7466 consensus_peers.cc:597] T 1528ab62b6fe4e3099d08f141afee116 P 7ba59cc884714e8aa5f3f0ecaed84cbb -> Peer b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817): Couldn't send request to peer b7ab4784c7344b939bc36f639286f377. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.66:42817: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:22:13.387255  7466 consensus_peers.cc:597] T 17587d6730594da4a56fa13a353232a1 P 7ba59cc884714e8aa5f3f0ecaed84cbb -> Peer b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817): Couldn't send request to peer b7ab4784c7344b939bc36f639286f377. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.66:42817: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:22:13.400398  7466 consensus_peers.cc:597] T 4f00a2e87e56452083b759f60d461ee3 P 7ba59cc884714e8aa5f3f0ecaed84cbb -> Peer b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817): Couldn't send request to peer b7ab4784c7344b939bc36f639286f377. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.66:42817: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:22:13.405341 14686 raft_consensus.cc:493] T f09c2a98de1a4decabd0ff900dd44caa P cd75a17ab2604397adab03bb8b5fd75c [term 24 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:22:13.406217 14686 raft_consensus.cc:515] T f09c2a98de1a4decabd0ff900dd44caa P cd75a17ab2604397adab03bb8b5fd75c [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:22:13.409147 14686 leader_election.cc:290] T f09c2a98de1a4decabd0ff900dd44caa P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
W20260709 13:22:13.432446  6844 leader_election.cc:336] T f09c2a98de1a4decabd0ff900dd44caa P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111)
I20260709 13:22:13.433178 14700 raft_consensus.cc:493] T e77e330a82df4b43a745d57a68f6f057 P cd75a17ab2604397adab03bb8b5fd75c [term 20 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:22:13.438822 14700 raft_consensus.cc:515] T e77e330a82df4b43a745d57a68f6f057 P cd75a17ab2604397adab03bb8b5fd75c [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } }
W20260709 13:22:13.439930  6844 leader_election.cc:336] T f09c2a98de1a4decabd0ff900dd44caa P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817): Network error: Client connection negotiation failed: client connection to 127.5.126.66:42817: connect: Connection refused (error 111)
I20260709 13:22:13.440508  6844 leader_election.cc:304] T f09c2a98de1a4decabd0ff900dd44caa P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:22:13.441377 14700 leader_election.cc:290] T e77e330a82df4b43a745d57a68f6f057 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391)
I20260709 13:22:13.441725 14669 raft_consensus.cc:2749] T f09c2a98de1a4decabd0ff900dd44caa P cd75a17ab2604397adab03bb8b5fd75c [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
W20260709 13:22:13.447752  6844 consensus_peers.cc:597] T 711ef6523deb4cbe8ef2ba61e1c21c98 P cd75a17ab2604397adab03bb8b5fd75c -> Peer b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817): Couldn't send request to peer b7ab4784c7344b939bc36f639286f377. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.66:42817: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:22:13.453997 14686 raft_consensus.cc:493] T 853ac0a8cbd64ce99457f170216d4d0f P cd75a17ab2604397adab03bb8b5fd75c [term 18 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:22:13.459959 14686 raft_consensus.cc:515] T 853ac0a8cbd64ce99457f170216d4d0f P cd75a17ab2604397adab03bb8b5fd75c [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:22:13.462280 14686 leader_election.cc:290] T 853ac0a8cbd64ce99457f170216d4d0f P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
W20260709 13:22:13.464550  6844 leader_election.cc:336] T e77e330a82df4b43a745d57a68f6f057 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111)
W20260709 13:22:13.470556  6844 leader_election.cc:336] T e77e330a82df4b43a745d57a68f6f057 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817): Network error: Client connection negotiation failed: client connection to 127.5.126.66:42817: connect: Connection refused (error 111)
I20260709 13:22:13.471004  6844 leader_election.cc:304] T e77e330a82df4b43a745d57a68f6f057 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:22:13.471755 14686 raft_consensus.cc:2749] T e77e330a82df4b43a745d57a68f6f057 P cd75a17ab2604397adab03bb8b5fd75c [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 13:22:13.486057  6844 consensus_peers.cc:597] T 90d42e216d9741e190bca19a781291fd P cd75a17ab2604397adab03bb8b5fd75c -> Peer b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817): Couldn't send request to peer b7ab4784c7344b939bc36f639286f377. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.66:42817: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:22:13.486657  6844 leader_election.cc:336] T 853ac0a8cbd64ce99457f170216d4d0f P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817): Network error: Client connection negotiation failed: client connection to 127.5.126.66:42817: connect: Connection refused (error 111)
W20260709 13:22:13.487656  6844 leader_election.cc:336] T 853ac0a8cbd64ce99457f170216d4d0f P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111)
I20260709 13:22:13.488132  6844 leader_election.cc:304] T 853ac0a8cbd64ce99457f170216d4d0f P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:22:13.489010 14686 raft_consensus.cc:2749] T 853ac0a8cbd64ce99457f170216d4d0f P cd75a17ab2604397adab03bb8b5fd75c [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:22:13.492383  7466 consensus_peers.cc:597] T 7ba5dac66ab5497e9e336f2a3c28cda5 P 7ba59cc884714e8aa5f3f0ecaed84cbb -> Peer b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817): Couldn't send request to peer b7ab4784c7344b939bc36f639286f377. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.66:42817: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:22:13.551450  7466 consensus_peers.cc:597] T 24ee15416e3145beaa1b8183453729a3 P 7ba59cc884714e8aa5f3f0ecaed84cbb -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
W20260709 13:22:13.551520  6844 consensus_peers.cc:597] T 34f36d59d88f40fe8a2805e604fc6c0a P cd75a17ab2604397adab03bb8b5fd75c -> Peer b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817): Couldn't send request to peer b7ab4784c7344b939bc36f639286f377. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.66:42817: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:22:13.559993  6618 maintenance_manager.cc:643] P b3ae52d33b9a4273a42e5e2cf3b5d6b5: MajorDeltaCompactionOp(00000000000000000000000000000000) complete. Timing: real 0.215s	user 0.105s	sys 0.035s Metrics: {"cfile_cache_miss":9,"cfile_cache_miss_bytes":27519,"cfile_init":4,"delete_count":0,"delta_blocks_compacted":2,"delta_iterators_relevant":2,"dirs.queue_time_us":38994,"dirs.run_cpu_time_us":687,"dirs.run_wall_time_us":6941,"lbm_read_time_us":2263,"lbm_reads_lt_1ms":25,"lbm_write_time_us":1689,"lbm_writes_lt_1ms":11,"peak_mem_usage":301340,"reinsert_count":0,"thread_start_us":42354,"threads_started":2,"update_count":283}
I20260709 13:22:13.562887  6619 maintenance_manager.cc:419] P b3ae52d33b9a4273a42e5e2cf3b5d6b5: Scheduling MinorDeltaCompactionOp(00000000000000000000000000000000): perf score=0.002000
I20260709 13:22:13.563778  6618 maintenance_manager.cc:643] P b3ae52d33b9a4273a42e5e2cf3b5d6b5: MinorDeltaCompactionOp(00000000000000000000000000000000) complete. Timing: real 0.000s	user 0.000s	sys 0.000s Metrics: {}
W20260709 13:22:13.577277  7466 consensus_peers.cc:597] T b3f13b31a1f84f0d89d007eadd57924c P 7ba59cc884714e8aa5f3f0ecaed84cbb -> Peer b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817): Couldn't send request to peer b7ab4784c7344b939bc36f639286f377. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.66:42817: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:22:13.583565  6844 consensus_peers.cc:597] T 3411566abe2d4c9bb4b2adfdd05e6f17 P cd75a17ab2604397adab03bb8b5fd75c -> Peer b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817): Couldn't send request to peer b7ab4784c7344b939bc36f639286f377. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.66:42817: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:22:13.595732 14686 raft_consensus.cc:493] T 22ccee1b570c4ad3a57bd7aec085b1b4 P cd75a17ab2604397adab03bb8b5fd75c [term 17 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:22:13.596431 14686 raft_consensus.cc:515] T 22ccee1b570c4ad3a57bd7aec085b1b4 P cd75a17ab2604397adab03bb8b5fd75c [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:22:13.598726 14686 leader_election.cc:290] T 22ccee1b570c4ad3a57bd7aec085b1b4 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
W20260709 13:22:13.599620  6844 consensus_peers.cc:597] T 1bf4668eeb70467fb3dc5a0289233b3c P cd75a17ab2604397adab03bb8b5fd75c -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
W20260709 13:22:13.614898  6844 leader_election.cc:336] T 22ccee1b570c4ad3a57bd7aec085b1b4 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111)
W20260709 13:22:13.621258  7466 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.5.126.66:42817: connect: Connection refused (error 111) [suppressed 617 similar messages]
W20260709 13:22:13.625219  7466 consensus_peers.cc:597] T be1a92657f494cac8dd227d152f50151 P 7ba59cc884714e8aa5f3f0ecaed84cbb -> Peer b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817): Couldn't send request to peer b7ab4784c7344b939bc36f639286f377. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.66:42817: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:22:13.617164  6844 leader_election.cc:336] T 22ccee1b570c4ad3a57bd7aec085b1b4 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817): Network error: Client connection negotiation failed: client connection to 127.5.126.66:42817: connect: Connection refused (error 111)
I20260709 13:22:13.626410  6844 leader_election.cc:304] T 22ccee1b570c4ad3a57bd7aec085b1b4 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:22:13.627328 14669 raft_consensus.cc:2749] T 22ccee1b570c4ad3a57bd7aec085b1b4 P cd75a17ab2604397adab03bb8b5fd75c [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:22:13.631347  6844 consensus_peers.cc:597] T a3022224cc81473690653a83d4e99470 P cd75a17ab2604397adab03bb8b5fd75c -> Peer b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817): Couldn't send request to peer b7ab4784c7344b939bc36f639286f377. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.66:42817: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:22:13.666668  6844 consensus_peers.cc:597] T c4db81d9d329422bb3b4160ca4ac2d1d P cd75a17ab2604397adab03bb8b5fd75c -> Peer b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817): Couldn't send request to peer b7ab4784c7344b939bc36f639286f377. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.66:42817: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:22:13.700111  7466 consensus_peers.cc:597] T 404190ce4ce94cecbfcb6ea9d1dd8626 P 7ba59cc884714e8aa5f3f0ecaed84cbb -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
W20260709 13:22:13.827183  6844 consensus_peers.cc:597] T 3a485a995abc4807b6e511e45419f737 P cd75a17ab2604397adab03bb8b5fd75c -> Peer b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817): Couldn't send request to peer b7ab4784c7344b939bc36f639286f377. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.66:42817: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:22:13.828785  7495 raft_consensus.cc:1275] T 3a485a995abc4807b6e511e45419f737 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 18 FOLLOWER]: Refusing update from remote peer cd75a17ab2604397adab03bb8b5fd75c: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 13:22:13.831981 14669 consensus_queue.cc:1048] T 3a485a995abc4807b6e511e45419f737 P cd75a17ab2604397adab03bb8b5fd75c [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
W20260709 13:22:13.835626  7466 consensus_peers.cc:597] T 404190ce4ce94cecbfcb6ea9d1dd8626 P 7ba59cc884714e8aa5f3f0ecaed84cbb -> Peer b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817): Couldn't send request to peer b7ab4784c7344b939bc36f639286f377. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.66:42817: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:22:13.855685  7466 consensus_peers.cc:597] T 17587d6730594da4a56fa13a353232a1 P 7ba59cc884714e8aa5f3f0ecaed84cbb -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
W20260709 13:22:13.898386  6844 consensus_peers.cc:597] T a3022224cc81473690653a83d4e99470 P cd75a17ab2604397adab03bb8b5fd75c -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:22:13.997925  6844 consensus_peers.cc:597] T c4db81d9d329422bb3b4160ca4ac2d1d P cd75a17ab2604397adab03bb8b5fd75c -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
I20260709 13:22:14.016132 14700 raft_consensus.cc:493] T 4275cf08e63345f993bce8664eada830 P cd75a17ab2604397adab03bb8b5fd75c [term 21 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:22:14.017153 14700 raft_consensus.cc:515] T 4275cf08e63345f993bce8664eada830 P cd75a17ab2604397adab03bb8b5fd75c [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:22:14.019560 14700 leader_election.cc:290] T 4275cf08e63345f993bce8664eada830 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
W20260709 13:22:14.035622  6844 consensus_peers.cc:597] T 3411566abe2d4c9bb4b2adfdd05e6f17 P cd75a17ab2604397adab03bb8b5fd75c -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:22:14.061472  6844 leader_election.cc:336] T 4275cf08e63345f993bce8664eada830 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817): Network error: Client connection negotiation failed: client connection to 127.5.126.66:42817: connect: Connection refused (error 111)
W20260709 13:22:14.062440  6844 leader_election.cc:336] T 4275cf08e63345f993bce8664eada830 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111)
I20260709 13:22:14.062902  6844 leader_election.cc:304] T 4275cf08e63345f993bce8664eada830 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:22:14.063720 14700 raft_consensus.cc:2749] T 4275cf08e63345f993bce8664eada830 P cd75a17ab2604397adab03bb8b5fd75c [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 13:22:14.130792  6844 consensus_peers.cc:597] T 44bde925b2e541b69890d70715b85176 P cd75a17ab2604397adab03bb8b5fd75c -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
I20260709 13:22:14.172756 14669 raft_consensus.cc:493] T 30e88460611e47b2ba16a46a30b5f416 P cd75a17ab2604397adab03bb8b5fd75c [term 16 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:22:14.173342 14669 raft_consensus.cc:515] T 30e88460611e47b2ba16a46a30b5f416 P cd75a17ab2604397adab03bb8b5fd75c [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:22:14.175439 14669 leader_election.cc:290] T 30e88460611e47b2ba16a46a30b5f416 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
W20260709 13:22:14.185712  6844 leader_election.cc:336] T 30e88460611e47b2ba16a46a30b5f416 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111)
W20260709 13:22:14.187093  6844 leader_election.cc:336] T 30e88460611e47b2ba16a46a30b5f416 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817): Network error: Client connection negotiation failed: client connection to 127.5.126.66:42817: connect: Connection refused (error 111)
I20260709 13:22:14.187584  6844 leader_election.cc:304] T 30e88460611e47b2ba16a46a30b5f416 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:22:14.189667 14669 raft_consensus.cc:2749] T 30e88460611e47b2ba16a46a30b5f416 P cd75a17ab2604397adab03bb8b5fd75c [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:22:14.194131  7466 consensus_peers.cc:597] T 1528ab62b6fe4e3099d08f141afee116 P 7ba59cc884714e8aa5f3f0ecaed84cbb -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
I20260709 13:22:14.198320 14700 raft_consensus.cc:493] T d33d5ee8ef6f415593d8df52063161ad P cd75a17ab2604397adab03bb8b5fd75c [term 21 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:22:14.199002 14700 raft_consensus.cc:515] T d33d5ee8ef6f415593d8df52063161ad P cd75a17ab2604397adab03bb8b5fd75c [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:22:14.201188 14700 leader_election.cc:290] T d33d5ee8ef6f415593d8df52063161ad P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
W20260709 13:22:14.214708  6844 leader_election.cc:336] T d33d5ee8ef6f415593d8df52063161ad P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111)
W20260709 13:22:14.215459  6844 consensus_peers.cc:597] T e31b9971c15848dea59d4d4130141d9e P cd75a17ab2604397adab03bb8b5fd75c -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
W20260709 13:22:14.217844  6844 leader_election.cc:336] T d33d5ee8ef6f415593d8df52063161ad P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817): Network error: Client connection negotiation failed: client connection to 127.5.126.66:42817: connect: Connection refused (error 111)
I20260709 13:22:14.218353  6844 leader_election.cc:304] T d33d5ee8ef6f415593d8df52063161ad P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:22:14.221176 14700 raft_consensus.cc:2749] T d33d5ee8ef6f415593d8df52063161ad P cd75a17ab2604397adab03bb8b5fd75c [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:22:14.287251 14669 raft_consensus.cc:493] T f5be3a11b23d4ea9b08300a2789821c7 P cd75a17ab2604397adab03bb8b5fd75c [term 21 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:22:14.287868 14669 raft_consensus.cc:515] T f5be3a11b23d4ea9b08300a2789821c7 P cd75a17ab2604397adab03bb8b5fd75c [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:22:14.290267 14669 leader_election.cc:290] T f5be3a11b23d4ea9b08300a2789821c7 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
W20260709 13:22:14.296478  6844 leader_election.cc:336] T f5be3a11b23d4ea9b08300a2789821c7 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111)
W20260709 13:22:14.297298  6844 leader_election.cc:336] T f5be3a11b23d4ea9b08300a2789821c7 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817): Network error: Client connection negotiation failed: client connection to 127.5.126.66:42817: connect: Connection refused (error 111)
I20260709 13:22:14.297773  6844 leader_election.cc:304] T f5be3a11b23d4ea9b08300a2789821c7 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:22:14.298645 14669 raft_consensus.cc:2749] T f5be3a11b23d4ea9b08300a2789821c7 P cd75a17ab2604397adab03bb8b5fd75c [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:22:14.308925 14669 raft_consensus.cc:493] T b56bf91d90824c959e21e0cee5ba1816 P cd75a17ab2604397adab03bb8b5fd75c [term 18 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:22:14.309525 14669 raft_consensus.cc:515] T b56bf91d90824c959e21e0cee5ba1816 P cd75a17ab2604397adab03bb8b5fd75c [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:22:14.311746 14669 leader_election.cc:290] T b56bf91d90824c959e21e0cee5ba1816 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
W20260709 13:22:14.320143  6844 leader_election.cc:336] T b56bf91d90824c959e21e0cee5ba1816 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111)
I20260709 13:22:14.324451 14669 raft_consensus.cc:493] T a1704639a875409b9959353527b3fd68 P cd75a17ab2604397adab03bb8b5fd75c [term 22 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:22:14.325091 14669 raft_consensus.cc:515] T a1704639a875409b9959353527b3fd68 P cd75a17ab2604397adab03bb8b5fd75c [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:22:14.327438 14669 leader_election.cc:290] T a1704639a875409b9959353527b3fd68 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
W20260709 13:22:14.320922  6844 leader_election.cc:336] T b56bf91d90824c959e21e0cee5ba1816 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817): Network error: Client connection negotiation failed: client connection to 127.5.126.66:42817: connect: Connection refused (error 111)
I20260709 13:22:14.328305  6844 leader_election.cc:304] T b56bf91d90824c959e21e0cee5ba1816 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:22:14.329277 14669 raft_consensus.cc:2749] T b56bf91d90824c959e21e0cee5ba1816 P cd75a17ab2604397adab03bb8b5fd75c [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:22:14.345342  6844 leader_election.cc:336] T a1704639a875409b9959353527b3fd68 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111)
W20260709 13:22:14.346159  6844 leader_election.cc:336] T a1704639a875409b9959353527b3fd68 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817): Network error: Client connection negotiation failed: client connection to 127.5.126.66:42817: connect: Connection refused (error 111)
I20260709 13:22:14.347265  6844 leader_election.cc:304] T a1704639a875409b9959353527b3fd68 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:22:14.349665 14669 raft_consensus.cc:2749] T a1704639a875409b9959353527b3fd68 P cd75a17ab2604397adab03bb8b5fd75c [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
W20260709 13:22:14.358249  5625 thread.cc:527] Waited for 2000ms trying to join with diag-logger (tid 6828)
W20260709 13:22:14.361986  6844 consensus_peers.cc:597] T 90d42e216d9741e190bca19a781291fd P cd75a17ab2604397adab03bb8b5fd75c -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
W20260709 13:22:14.367002  7466 consensus_peers.cc:597] T be1a92657f494cac8dd227d152f50151 P 7ba59cc884714e8aa5f3f0ecaed84cbb -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
W20260709 13:22:14.387106  7466 consensus_peers.cc:597] T 3fa34c08b205435dba97346991aa1f92 P 7ba59cc884714e8aa5f3f0ecaed84cbb -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
I20260709 13:22:14.423336 14686 raft_consensus.cc:493] T bd6869f07b5a4885a0b99fbe60c3b175 P cd75a17ab2604397adab03bb8b5fd75c [term 27 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:22:14.424095 14686 raft_consensus.cc:515] T bd6869f07b5a4885a0b99fbe60c3b175 P cd75a17ab2604397adab03bb8b5fd75c [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:22:14.426687 14686 leader_election.cc:290] T bd6869f07b5a4885a0b99fbe60c3b175 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:22:14.434459 14686 raft_consensus.cc:493] T 7c37d41cd9164c15a6826ca62a851a69 P cd75a17ab2604397adab03bb8b5fd75c [term 23 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:22:14.435027 14686 raft_consensus.cc:515] T 7c37d41cd9164c15a6826ca62a851a69 P cd75a17ab2604397adab03bb8b5fd75c [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
W20260709 13:22:14.435811  6844 leader_election.cc:336] T bd6869f07b5a4885a0b99fbe60c3b175 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 28 pre-election: RPC error from VoteRequest() call to peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111)
W20260709 13:22:14.436561  6844 leader_election.cc:336] T bd6869f07b5a4885a0b99fbe60c3b175 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 28 pre-election: RPC error from VoteRequest() call to peer b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817): Network error: Client connection negotiation failed: client connection to 127.5.126.66:42817: connect: Connection refused (error 111)
I20260709 13:22:14.437207  6844 leader_election.cc:304] T bd6869f07b5a4885a0b99fbe60c3b175 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:22:14.437482 14686 leader_election.cc:290] T 7c37d41cd9164c15a6826ca62a851a69 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:22:14.437937 14669 raft_consensus.cc:2749] T bd6869f07b5a4885a0b99fbe60c3b175 P cd75a17ab2604397adab03bb8b5fd75c [term 27 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
W20260709 13:22:14.457571  6844 consensus_peers.cc:597] T 95a75bfe094d4bdc963aba3f08dfcd25 P cd75a17ab2604397adab03bb8b5fd75c -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260709 13:22:14.458114  6844 leader_election.cc:336] T 7c37d41cd9164c15a6826ca62a851a69 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111)
W20260709 13:22:14.459031  6844 leader_election.cc:336] T 7c37d41cd9164c15a6826ca62a851a69 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817): Network error: Client connection negotiation failed: client connection to 127.5.126.66:42817: connect: Connection refused (error 111)
I20260709 13:22:14.459474  6844 leader_election.cc:304] T 7c37d41cd9164c15a6826ca62a851a69 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:22:14.461829 14686 raft_consensus.cc:2749] T 7c37d41cd9164c15a6826ca62a851a69 P cd75a17ab2604397adab03bb8b5fd75c [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:22:14.476073 14686 raft_consensus.cc:493] T 9b3759de40694069b13c0f8bd40e5709 P cd75a17ab2604397adab03bb8b5fd75c [term 20 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:22:14.476704 14686 raft_consensus.cc:515] T 9b3759de40694069b13c0f8bd40e5709 P cd75a17ab2604397adab03bb8b5fd75c [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:22:14.479012 14686 leader_election.cc:290] T 9b3759de40694069b13c0f8bd40e5709 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
W20260709 13:22:14.484998  6844 leader_election.cc:336] T 9b3759de40694069b13c0f8bd40e5709 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111)
W20260709 13:22:14.485790  6844 leader_election.cc:336] T 9b3759de40694069b13c0f8bd40e5709 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817): Network error: Client connection negotiation failed: client connection to 127.5.126.66:42817: connect: Connection refused (error 111)
I20260709 13:22:14.486202  6844 leader_election.cc:304] T 9b3759de40694069b13c0f8bd40e5709 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:22:14.489290 14669 raft_consensus.cc:2749] T 9b3759de40694069b13c0f8bd40e5709 P cd75a17ab2604397adab03bb8b5fd75c [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 13:22:14.534282  6844 consensus_peers.cc:597] T f58dc08b12a2494bb9a1372837970ca2 P cd75a17ab2604397adab03bb8b5fd75c -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
I20260709 13:22:14.555656 14669 raft_consensus.cc:493] T f03d0dbf16864ca4bc1bb5e4c0334c0f P cd75a17ab2604397adab03bb8b5fd75c [term 19 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:22:14.556286 14669 raft_consensus.cc:515] T f03d0dbf16864ca4bc1bb5e4c0334c0f P cd75a17ab2604397adab03bb8b5fd75c [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:22:14.558377 14669 leader_election.cc:290] T f03d0dbf16864ca4bc1bb5e4c0334c0f P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
W20260709 13:22:14.565128  6844 leader_election.cc:336] T f03d0dbf16864ca4bc1bb5e4c0334c0f P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111)
W20260709 13:22:14.565912  6844 leader_election.cc:336] T f03d0dbf16864ca4bc1bb5e4c0334c0f P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817): Network error: Client connection negotiation failed: client connection to 127.5.126.66:42817: connect: Connection refused (error 111)
I20260709 13:22:14.566346  6844 leader_election.cc:304] T f03d0dbf16864ca4bc1bb5e4c0334c0f P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:22:14.567893 14669 raft_consensus.cc:2749] T f03d0dbf16864ca4bc1bb5e4c0334c0f P cd75a17ab2604397adab03bb8b5fd75c [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:22:14.588961 14669 raft_consensus.cc:493] T 8c7f33e544204fbaac4078e3e83bbf4e P cd75a17ab2604397adab03bb8b5fd75c [term 16 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:22:14.589509 14669 raft_consensus.cc:515] T 8c7f33e544204fbaac4078e3e83bbf4e P cd75a17ab2604397adab03bb8b5fd75c [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:22:14.591388 14669 leader_election.cc:290] T 8c7f33e544204fbaac4078e3e83bbf4e P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
W20260709 13:22:14.597075  6844 leader_election.cc:336] T 8c7f33e544204fbaac4078e3e83bbf4e P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111)
W20260709 13:22:14.598174  6844 leader_election.cc:336] T 8c7f33e544204fbaac4078e3e83bbf4e P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817): Network error: Client connection negotiation failed: client connection to 127.5.126.66:42817: connect: Connection refused (error 111)
I20260709 13:22:14.598717  6844 leader_election.cc:304] T 8c7f33e544204fbaac4078e3e83bbf4e P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:22:14.599535 14669 raft_consensus.cc:2749] T 8c7f33e544204fbaac4078e3e83bbf4e P cd75a17ab2604397adab03bb8b5fd75c [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:22:14.648563  6844 consensus_peers.cc:597] T 34f36d59d88f40fe8a2805e604fc6c0a P cd75a17ab2604397adab03bb8b5fd75c -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
I20260709 13:22:14.666314 14686 raft_consensus.cc:493] T 3d65025eea89441290d85dd053810e31 P cd75a17ab2604397adab03bb8b5fd75c [term 20 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:22:14.666985 14686 raft_consensus.cc:515] T 3d65025eea89441290d85dd053810e31 P cd75a17ab2604397adab03bb8b5fd75c [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:22:14.669276 14686 leader_election.cc:290] T 3d65025eea89441290d85dd053810e31 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:22:14.669772 14686 raft_consensus.cc:493] T 20f6842e26174571996b8dea4151d4be P cd75a17ab2604397adab03bb8b5fd75c [term 22 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:22:14.670202 14686 raft_consensus.cc:515] T 20f6842e26174571996b8dea4151d4be P cd75a17ab2604397adab03bb8b5fd75c [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:22:14.673556 14686 leader_election.cc:290] T 20f6842e26174571996b8dea4151d4be P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
W20260709 13:22:14.692943  6844 leader_election.cc:336] T 3d65025eea89441290d85dd053810e31 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111)
W20260709 13:22:14.696311  6844 leader_election.cc:336] T 3d65025eea89441290d85dd053810e31 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817): Network error: Client connection negotiation failed: client connection to 127.5.126.66:42817: connect: Connection refused (error 111)
I20260709 13:22:14.696805  6844 leader_election.cc:304] T 3d65025eea89441290d85dd053810e31 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:22:14.697634 14686 raft_consensus.cc:2749] T 3d65025eea89441290d85dd053810e31 P cd75a17ab2604397adab03bb8b5fd75c [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 13:22:14.698349  6844 leader_election.cc:336] T 20f6842e26174571996b8dea4151d4be P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111)
W20260709 13:22:14.699175  6844 consensus_peers.cc:597] T 713b5728a197487c9300b310ab94e5a3 P cd75a17ab2604397adab03bb8b5fd75c -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
W20260709 13:22:14.710816  6844 leader_election.cc:336] T 20f6842e26174571996b8dea4151d4be P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817): Network error: Client connection negotiation failed: client connection to 127.5.126.66:42817: connect: Connection refused (error 111)
I20260709 13:22:14.711410  6844 leader_election.cc:304] T 20f6842e26174571996b8dea4151d4be P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:22:14.712325 14686 raft_consensus.cc:2749] T 20f6842e26174571996b8dea4151d4be P cd75a17ab2604397adab03bb8b5fd75c [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:22:14.730810 14686 raft_consensus.cc:493] T 4d9def8b32fd443aa94ab1420b06837b P cd75a17ab2604397adab03bb8b5fd75c [term 24 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:22:14.731432 14686 raft_consensus.cc:515] T 4d9def8b32fd443aa94ab1420b06837b P cd75a17ab2604397adab03bb8b5fd75c [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:22:14.733811 14686 leader_election.cc:290] T 4d9def8b32fd443aa94ab1420b06837b P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
W20260709 13:22:14.737524  6844 leader_election.cc:336] T 4d9def8b32fd443aa94ab1420b06837b P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111)
W20260709 13:22:14.739990  6844 leader_election.cc:336] T 4d9def8b32fd443aa94ab1420b06837b P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817): Network error: Client connection negotiation failed: client connection to 127.5.126.66:42817: connect: Connection refused (error 111)
I20260709 13:22:14.740612  6844 leader_election.cc:304] T 4d9def8b32fd443aa94ab1420b06837b P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:22:14.741580 14686 raft_consensus.cc:2749] T 4d9def8b32fd443aa94ab1420b06837b P cd75a17ab2604397adab03bb8b5fd75c [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:22:14.831504 14686 raft_consensus.cc:493] T d8292e16e5654be6bc408560cf256aaa P cd75a17ab2604397adab03bb8b5fd75c [term 22 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:22:14.832125 14686 raft_consensus.cc:515] T d8292e16e5654be6bc408560cf256aaa P cd75a17ab2604397adab03bb8b5fd75c [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:22:14.834302 14686 leader_election.cc:290] T d8292e16e5654be6bc408560cf256aaa P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
W20260709 13:22:14.841393  6844 leader_election.cc:336] T d8292e16e5654be6bc408560cf256aaa P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111)
W20260709 13:22:14.842497  6844 leader_election.cc:336] T d8292e16e5654be6bc408560cf256aaa P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817): Network error: Client connection negotiation failed: client connection to 127.5.126.66:42817: connect: Connection refused (error 111)
I20260709 13:22:14.842980  6844 leader_election.cc:304] T d8292e16e5654be6bc408560cf256aaa P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:22:14.846627 14686 raft_consensus.cc:2749] T d8292e16e5654be6bc408560cf256aaa P cd75a17ab2604397adab03bb8b5fd75c [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:22:14.857187 14669 raft_consensus.cc:493] T ab432e62819d499eaaf3dd55481dd930 P cd75a17ab2604397adab03bb8b5fd75c [term 25 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:22:14.857707 14669 raft_consensus.cc:515] T ab432e62819d499eaaf3dd55481dd930 P cd75a17ab2604397adab03bb8b5fd75c [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:22:14.861138 14669 leader_election.cc:290] T ab432e62819d499eaaf3dd55481dd930 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
W20260709 13:22:14.869046  6844 leader_election.cc:336] T ab432e62819d499eaaf3dd55481dd930 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111)
W20260709 13:22:14.876659  6844 leader_election.cc:336] T ab432e62819d499eaaf3dd55481dd930 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817): Network error: Client connection negotiation failed: client connection to 127.5.126.66:42817: connect: Connection refused (error 111)
I20260709 13:22:14.877252  6844 leader_election.cc:304] T ab432e62819d499eaaf3dd55481dd930 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:22:14.880883 14669 raft_consensus.cc:2749] T ab432e62819d499eaaf3dd55481dd930 P cd75a17ab2604397adab03bb8b5fd75c [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
W20260709 13:22:14.884992  6844 consensus_peers.cc:597] T 4b8cacb381b746da8d0049b0a83b41dd P cd75a17ab2604397adab03bb8b5fd75c -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
I20260709 13:22:14.902319 14669 raft_consensus.cc:493] T dbdf895bba214ff68685a24fd17dfb5d P cd75a17ab2604397adab03bb8b5fd75c [term 21 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:22:14.902869 14669 raft_consensus.cc:515] T dbdf895bba214ff68685a24fd17dfb5d P cd75a17ab2604397adab03bb8b5fd75c [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:22:14.905058 14669 leader_election.cc:290] T dbdf895bba214ff68685a24fd17dfb5d P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
W20260709 13:22:14.910784  6844 leader_election.cc:336] T dbdf895bba214ff68685a24fd17dfb5d P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111)
W20260709 13:22:14.924225  6844 leader_election.cc:336] T dbdf895bba214ff68685a24fd17dfb5d P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817): Network error: Client connection negotiation failed: client connection to 127.5.126.66:42817: connect: Connection refused (error 111)
I20260709 13:22:14.924765  6844 leader_election.cc:304] T dbdf895bba214ff68685a24fd17dfb5d P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:22:14.925525 14669 raft_consensus.cc:2749] T dbdf895bba214ff68685a24fd17dfb5d P cd75a17ab2604397adab03bb8b5fd75c [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 13:22:14.955754  7466 consensus_peers.cc:597] T fe20b4b48823486ca3b9c648db6ce8aa P 7ba59cc884714e8aa5f3f0ecaed84cbb -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
I20260709 13:22:14.963722 14669 raft_consensus.cc:493] T 2c240553ce044eedb41541d72b9475d7 P cd75a17ab2604397adab03bb8b5fd75c [term 21 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:22:14.964357 14669 raft_consensus.cc:515] T 2c240553ce044eedb41541d72b9475d7 P cd75a17ab2604397adab03bb8b5fd75c [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:22:14.966517 14669 leader_election.cc:290] T 2c240553ce044eedb41541d72b9475d7 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
W20260709 13:22:14.972280  6844 leader_election.cc:336] T 2c240553ce044eedb41541d72b9475d7 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111)
W20260709 13:22:14.973254  6844 leader_election.cc:336] T 2c240553ce044eedb41541d72b9475d7 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817): Network error: Client connection negotiation failed: client connection to 127.5.126.66:42817: connect: Connection refused (error 111)
I20260709 13:22:14.973683  6844 leader_election.cc:304] T 2c240553ce044eedb41541d72b9475d7 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:22:14.974511 14669 raft_consensus.cc:2749] T 2c240553ce044eedb41541d72b9475d7 P cd75a17ab2604397adab03bb8b5fd75c [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 13:22:14.996089  6844 consensus_peers.cc:597] T 711ef6523deb4cbe8ef2ba61e1c21c98 P cd75a17ab2604397adab03bb8b5fd75c -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
I20260709 13:22:15.102474 14669 raft_consensus.cc:493] T 7887766dc6784fcaa42b35c05fea7a99 P cd75a17ab2604397adab03bb8b5fd75c [term 23 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:22:15.103060 14669 raft_consensus.cc:515] T 7887766dc6784fcaa42b35c05fea7a99 P cd75a17ab2604397adab03bb8b5fd75c [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:22:15.105293 14669 leader_election.cc:290] T 7887766dc6784fcaa42b35c05fea7a99 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
W20260709 13:22:15.110324  6844 leader_election.cc:336] T 7887766dc6784fcaa42b35c05fea7a99 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111)
W20260709 13:22:15.113773  6844 leader_election.cc:336] T 7887766dc6784fcaa42b35c05fea7a99 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817): Network error: Client connection negotiation failed: client connection to 127.5.126.66:42817: connect: Connection refused (error 111)
I20260709 13:22:15.114396  6844 leader_election.cc:304] T 7887766dc6784fcaa42b35c05fea7a99 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:22:15.124615 14669 raft_consensus.cc:2749] T 7887766dc6784fcaa42b35c05fea7a99 P cd75a17ab2604397adab03bb8b5fd75c [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:22:15.162158 14669 raft_consensus.cc:493] T f4b8bd455d5a47c18a1380839c6e0d61 P cd75a17ab2604397adab03bb8b5fd75c [term 22 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:22:15.162802 14669 raft_consensus.cc:515] T f4b8bd455d5a47c18a1380839c6e0d61 P cd75a17ab2604397adab03bb8b5fd75c [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:22:15.164906 14669 leader_election.cc:290] T f4b8bd455d5a47c18a1380839c6e0d61 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
W20260709 13:22:15.170003  6844 leader_election.cc:336] T f4b8bd455d5a47c18a1380839c6e0d61 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111)
W20260709 13:22:15.177714  6844 leader_election.cc:336] T f4b8bd455d5a47c18a1380839c6e0d61 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817): Network error: Client connection negotiation failed: client connection to 127.5.126.66:42817: connect: Connection refused (error 111)
I20260709 13:22:15.179687  6844 leader_election.cc:304] T f4b8bd455d5a47c18a1380839c6e0d61 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:22:15.183375 14669 raft_consensus.cc:2749] T f4b8bd455d5a47c18a1380839c6e0d61 P cd75a17ab2604397adab03bb8b5fd75c [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:22:15.210873 14669 raft_consensus.cc:493] T 853ac0a8cbd64ce99457f170216d4d0f P cd75a17ab2604397adab03bb8b5fd75c [term 18 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:22:15.211436 14669 raft_consensus.cc:515] T 853ac0a8cbd64ce99457f170216d4d0f P cd75a17ab2604397adab03bb8b5fd75c [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:22:15.213639 14669 leader_election.cc:290] T 853ac0a8cbd64ce99457f170216d4d0f P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
W20260709 13:22:15.217422  6844 leader_election.cc:336] T 853ac0a8cbd64ce99457f170216d4d0f P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111)
W20260709 13:22:15.218324  6844 leader_election.cc:336] T 853ac0a8cbd64ce99457f170216d4d0f P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817): Network error: Client connection negotiation failed: client connection to 127.5.126.66:42817: connect: Connection refused (error 111)
I20260709 13:22:15.218815  6844 leader_election.cc:304] T 853ac0a8cbd64ce99457f170216d4d0f P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:22:15.220351 14686 raft_consensus.cc:2749] T 853ac0a8cbd64ce99457f170216d4d0f P cd75a17ab2604397adab03bb8b5fd75c [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:22:15.254541 14669 raft_consensus.cc:493] T 07a92dd554674067a83a9cb68c4773f2 P cd75a17ab2604397adab03bb8b5fd75c [term 19 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:22:15.255133 14669 raft_consensus.cc:515] T 07a92dd554674067a83a9cb68c4773f2 P cd75a17ab2604397adab03bb8b5fd75c [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:22:15.257345 14669 leader_election.cc:290] T 07a92dd554674067a83a9cb68c4773f2 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
W20260709 13:22:15.261804  6844 leader_election.cc:336] T 07a92dd554674067a83a9cb68c4773f2 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111)
W20260709 13:22:15.264281  6844 leader_election.cc:336] T 07a92dd554674067a83a9cb68c4773f2 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817): Network error: Client connection negotiation failed: client connection to 127.5.126.66:42817: connect: Connection refused (error 111)
I20260709 13:22:15.264849  6844 leader_election.cc:304] T 07a92dd554674067a83a9cb68c4773f2 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:22:15.265736 14669 raft_consensus.cc:2749] T 07a92dd554674067a83a9cb68c4773f2 P cd75a17ab2604397adab03bb8b5fd75c [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:22:15.294749 14693 raft_consensus.cc:493] T f3f9c2e2bf644115957398fe4c9459db P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 23 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:22:15.295447 14693 raft_consensus.cc:515] T f3f9c2e2bf644115957398fe4c9459db P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } attrs { replace: true } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:22:15.300729  6874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f9c2e2bf644115957398fe4c9459db" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:22:15.301483  6874 raft_consensus.cc:2468] T f3f9c2e2bf644115957398fe4c9459db P cd75a17ab2604397adab03bb8b5fd75c [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in term 23.
I20260709 13:22:15.300721 14693 leader_election.cc:290] T f3f9c2e2bf644115957398fe4c9459db P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
W20260709 13:22:15.307473  7466 leader_election.cc:336] T f3f9c2e2bf644115957398fe4c9459db P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111)
W20260709 13:22:15.309733  7466 leader_election.cc:336] T f3f9c2e2bf644115957398fe4c9459db P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817): Network error: Client connection negotiation failed: client connection to 127.5.126.66:42817: connect: Connection refused (error 111)
I20260709 13:22:15.310622  7466 leader_election.cc:304] T f3f9c2e2bf644115957398fe4c9459db P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb, cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:22:15.312527 14693 raft_consensus.cc:2749] T f3f9c2e2bf644115957398fe4c9459db P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
W20260709 13:22:15.358882  5625 thread.cc:527] Waited for 3000ms trying to join with diag-logger (tid 6828)
I20260709 13:22:15.378671 14669 raft_consensus.cc:493] T 22ccee1b570c4ad3a57bd7aec085b1b4 P cd75a17ab2604397adab03bb8b5fd75c [term 17 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:22:15.379360 14669 raft_consensus.cc:515] T 22ccee1b570c4ad3a57bd7aec085b1b4 P cd75a17ab2604397adab03bb8b5fd75c [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:22:15.381661 14669 leader_election.cc:290] T 22ccee1b570c4ad3a57bd7aec085b1b4 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
W20260709 13:22:15.386860  6844 leader_election.cc:336] T 22ccee1b570c4ad3a57bd7aec085b1b4 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111)
W20260709 13:22:15.393293  6844 leader_election.cc:336] T 22ccee1b570c4ad3a57bd7aec085b1b4 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817): Network error: Client connection negotiation failed: client connection to 127.5.126.66:42817: connect: Connection refused (error 111)
I20260709 13:22:15.393899  6844 leader_election.cc:304] T 22ccee1b570c4ad3a57bd7aec085b1b4 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:22:15.394825 14686 raft_consensus.cc:2749] T 22ccee1b570c4ad3a57bd7aec085b1b4 P cd75a17ab2604397adab03bb8b5fd75c [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:22:15.447324 14669 raft_consensus.cc:493] T de3186201e1a40d0b335eeb8b4e256e0 P cd75a17ab2604397adab03bb8b5fd75c [term 23 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:22:15.447933 14669 raft_consensus.cc:515] T de3186201e1a40d0b335eeb8b4e256e0 P cd75a17ab2604397adab03bb8b5fd75c [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:22:15.450043 14669 leader_election.cc:290] T de3186201e1a40d0b335eeb8b4e256e0 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
W20260709 13:22:15.465579  6844 leader_election.cc:336] T de3186201e1a40d0b335eeb8b4e256e0 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111)
W20260709 13:22:15.467301  6844 leader_election.cc:336] T de3186201e1a40d0b335eeb8b4e256e0 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817): Network error: Client connection negotiation failed: client connection to 127.5.126.66:42817: connect: Connection refused (error 111)
I20260709 13:22:15.468740  6844 leader_election.cc:304] T de3186201e1a40d0b335eeb8b4e256e0 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:22:15.470873 14669 raft_consensus.cc:2749] T de3186201e1a40d0b335eeb8b4e256e0 P cd75a17ab2604397adab03bb8b5fd75c [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
W20260709 13:22:15.475214  6844 consensus_peers.cc:597] T 713b5728a197487c9300b310ab94e5a3 P cd75a17ab2604397adab03bb8b5fd75c -> Peer b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817): Couldn't send request to peer b7ab4784c7344b939bc36f639286f377. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.66:42817: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:22:15.488224  6844 consensus_peers.cc:597] T d8cee0accdb8499c86d4414b72565a38 P cd75a17ab2604397adab03bb8b5fd75c -> Peer b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817): Couldn't send request to peer b7ab4784c7344b939bc36f639286f377. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.66:42817: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:22:15.514475  7466 consensus_peers.cc:597] T 7a734b5ab7834e05a8c422208acc58b1 P 7ba59cc884714e8aa5f3f0ecaed84cbb -> Peer b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817): Couldn't send request to peer b7ab4784c7344b939bc36f639286f377. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.66:42817: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:22:15.529057  6844 consensus_peers.cc:597] T ce4f062dcd314d43a63ca74067cb5ee3 P cd75a17ab2604397adab03bb8b5fd75c -> Peer b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817): Couldn't send request to peer b7ab4784c7344b939bc36f639286f377. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.66:42817: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:22:15.557430  7466 consensus_peers.cc:597] T bb3d8792045a4583ae2e965b1350a5b4 P 7ba59cc884714e8aa5f3f0ecaed84cbb -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
I20260709 13:22:15.573699 14669 raft_consensus.cc:493] T e77e330a82df4b43a745d57a68f6f057 P cd75a17ab2604397adab03bb8b5fd75c [term 20 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:22:15.574420 14669 raft_consensus.cc:515] T e77e330a82df4b43a745d57a68f6f057 P cd75a17ab2604397adab03bb8b5fd75c [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } }
I20260709 13:22:15.576752 14669 leader_election.cc:290] T e77e330a82df4b43a745d57a68f6f057 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391)
W20260709 13:22:15.587496  6844 leader_election.cc:336] T e77e330a82df4b43a745d57a68f6f057 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111)
I20260709 13:22:15.588212 14686 raft_consensus.cc:493] T f09c2a98de1a4decabd0ff900dd44caa P cd75a17ab2604397adab03bb8b5fd75c [term 24 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:22:15.590261 14686 raft_consensus.cc:515] T f09c2a98de1a4decabd0ff900dd44caa P cd75a17ab2604397adab03bb8b5fd75c [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:22:15.594210 14686 leader_election.cc:290] T f09c2a98de1a4decabd0ff900dd44caa P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
W20260709 13:22:15.602658  6844 leader_election.cc:336] T e77e330a82df4b43a745d57a68f6f057 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817): Network error: Client connection negotiation failed: client connection to 127.5.126.66:42817: connect: Connection refused (error 111)
I20260709 13:22:15.604214  6844 leader_election.cc:304] T e77e330a82df4b43a745d57a68f6f057 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:22:15.606313 14686 raft_consensus.cc:2749] T e77e330a82df4b43a745d57a68f6f057 P cd75a17ab2604397adab03bb8b5fd75c [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 13:22:15.620146  6844 consensus_peers.cc:597] T 1bf4668eeb70467fb3dc5a0289233b3c P cd75a17ab2604397adab03bb8b5fd75c -> Peer b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817): Couldn't send request to peer b7ab4784c7344b939bc36f639286f377. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.66:42817: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:22:15.657337  6844 leader_election.cc:336] T f09c2a98de1a4decabd0ff900dd44caa P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817): Network error: Client connection negotiation failed: client connection to 127.5.126.66:42817: connect: Connection refused (error 111)
W20260709 13:22:15.662016  6844 leader_election.cc:336] T f09c2a98de1a4decabd0ff900dd44caa P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111)
I20260709 13:22:15.662743  6844 leader_election.cc:304] T f09c2a98de1a4decabd0ff900dd44caa P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:22:15.669139 14715 raft_consensus.cc:2749] T f09c2a98de1a4decabd0ff900dd44caa P cd75a17ab2604397adab03bb8b5fd75c [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
W20260709 13:22:15.670569  6844 consensus_peers.cc:597] T 7c44c4849aa54f2b94d1f1bef9ed546f P cd75a17ab2604397adab03bb8b5fd75c -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:22:15.682025  6844 consensus_peers.cc:597] T 9e326172347f45e99a0d482b5d8ef768 P cd75a17ab2604397adab03bb8b5fd75c -> Peer b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817): Couldn't send request to peer b7ab4784c7344b939bc36f639286f377. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.66:42817: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:22:15.700189  6844 consensus_peers.cc:597] T 7c44c4849aa54f2b94d1f1bef9ed546f P cd75a17ab2604397adab03bb8b5fd75c -> Peer b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817): Couldn't send request to peer b7ab4784c7344b939bc36f639286f377. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.66:42817: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:22:15.704511  6844 consensus_peers.cc:597] T 9e326172347f45e99a0d482b5d8ef768 P cd75a17ab2604397adab03bb8b5fd75c -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
W20260709 13:22:15.806751  6844 consensus_peers.cc:597] T 44bde925b2e541b69890d70715b85176 P cd75a17ab2604397adab03bb8b5fd75c -> Peer b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817): Couldn't send request to peer b7ab4784c7344b939bc36f639286f377. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.66:42817: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:22:15.817579  6844 consensus_peers.cc:597] T 34f36d59d88f40fe8a2805e604fc6c0a P cd75a17ab2604397adab03bb8b5fd75c -> Peer b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817): Couldn't send request to peer b7ab4784c7344b939bc36f639286f377. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.66:42817: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:22:15.818394  7466 consensus_peers.cc:597] T b3f13b31a1f84f0d89d007eadd57924c P 7ba59cc884714e8aa5f3f0ecaed84cbb -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111). This is attempt 66: this message will repeat every 5th retry.
W20260709 13:22:15.859822  7466 consensus_peers.cc:597] T 17587d6730594da4a56fa13a353232a1 P 7ba59cc884714e8aa5f3f0ecaed84cbb -> Peer b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817): Couldn't send request to peer b7ab4784c7344b939bc36f639286f377. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.66:42817: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:22:15.861202  6844 consensus_peers.cc:597] T e31b9971c15848dea59d4d4130141d9e P cd75a17ab2604397adab03bb8b5fd75c -> Peer b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817): Couldn't send request to peer b7ab4784c7344b939bc36f639286f377. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.66:42817: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:22:15.926759  7466 consensus_peers.cc:597] T 4f00a2e87e56452083b759f60d461ee3 P 7ba59cc884714e8aa5f3f0ecaed84cbb -> Peer b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817): Couldn't send request to peer b7ab4784c7344b939bc36f639286f377. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.66:42817: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:22:15.927716  7466 consensus_peers.cc:597] T 7ba5dac66ab5497e9e336f2a3c28cda5 P 7ba59cc884714e8aa5f3f0ecaed84cbb -> Peer b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817): Couldn't send request to peer b7ab4784c7344b939bc36f639286f377. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.66:42817: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:22:15.938411  6844 consensus_peers.cc:597] T 711ef6523deb4cbe8ef2ba61e1c21c98 P cd75a17ab2604397adab03bb8b5fd75c -> Peer b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817): Couldn't send request to peer b7ab4784c7344b939bc36f639286f377. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.66:42817: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:22:15.941375  7466 consensus_peers.cc:597] T 404190ce4ce94cecbfcb6ea9d1dd8626 P 7ba59cc884714e8aa5f3f0ecaed84cbb -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111). This is attempt 66: this message will repeat every 5th retry.
W20260709 13:22:15.956321  6844 consensus_peers.cc:597] T f58dc08b12a2494bb9a1372837970ca2 P cd75a17ab2604397adab03bb8b5fd75c -> Peer b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817): Couldn't send request to peer b7ab4784c7344b939bc36f639286f377. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.66:42817: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:22:15.993650  7466 consensus_peers.cc:597] T 1528ab62b6fe4e3099d08f141afee116 P 7ba59cc884714e8aa5f3f0ecaed84cbb -> Peer b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817): Couldn't send request to peer b7ab4784c7344b939bc36f639286f377. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.66:42817: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:22:16.015182  6844 consensus_peers.cc:597] T 3411566abe2d4c9bb4b2adfdd05e6f17 P cd75a17ab2604397adab03bb8b5fd75c -> Peer b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817): Couldn't send request to peer b7ab4784c7344b939bc36f639286f377. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.66:42817: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:22:16.024273  7466 consensus_peers.cc:597] T be1a92657f494cac8dd227d152f50151 P 7ba59cc884714e8aa5f3f0ecaed84cbb -> Peer b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817): Couldn't send request to peer b7ab4784c7344b939bc36f639286f377. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.66:42817: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:22:16.038180  7466 consensus_peers.cc:597] T 24ee15416e3145beaa1b8183453729a3 P 7ba59cc884714e8aa5f3f0ecaed84cbb -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111). This is attempt 66: this message will repeat every 5th retry.
W20260709 13:22:16.053122  6844 consensus_peers.cc:597] T bb7fa124c3bf4ef9ab65a407cb008441 P cd75a17ab2604397adab03bb8b5fd75c -> Peer b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817): Couldn't send request to peer b7ab4784c7344b939bc36f639286f377. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.66:42817: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:22:16.057142 14669 raft_consensus.cc:493] T b56bf91d90824c959e21e0cee5ba1816 P cd75a17ab2604397adab03bb8b5fd75c [term 18 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
W20260709 13:22:16.057847  7466 consensus_peers.cc:597] T 427c124d773f483294511e80fe340075 P 7ba59cc884714e8aa5f3f0ecaed84cbb -> Peer b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817): Couldn't send request to peer b7ab4784c7344b939bc36f639286f377. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.66:42817: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:22:16.057711 14669 raft_consensus.cc:515] T b56bf91d90824c959e21e0cee5ba1816 P cd75a17ab2604397adab03bb8b5fd75c [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:22:16.063256 14669 leader_election.cc:290] T b56bf91d90824c959e21e0cee5ba1816 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
W20260709 13:22:16.067209  6844 leader_election.cc:336] T b56bf91d90824c959e21e0cee5ba1816 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111)
W20260709 13:22:16.076306  6844 leader_election.cc:336] T b56bf91d90824c959e21e0cee5ba1816 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817): Network error: Client connection negotiation failed: client connection to 127.5.126.66:42817: connect: Connection refused (error 111)
I20260709 13:22:16.077023  6844 leader_election.cc:304] T b56bf91d90824c959e21e0cee5ba1816 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:22:16.077963 14669 raft_consensus.cc:2749] T b56bf91d90824c959e21e0cee5ba1816 P cd75a17ab2604397adab03bb8b5fd75c [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:22:16.102375 14669 raft_consensus.cc:493] T 30e88460611e47b2ba16a46a30b5f416 P cd75a17ab2604397adab03bb8b5fd75c [term 16 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:22:16.103089 14669 raft_consensus.cc:515] T 30e88460611e47b2ba16a46a30b5f416 P cd75a17ab2604397adab03bb8b5fd75c [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:22:16.105412 14669 leader_election.cc:290] T 30e88460611e47b2ba16a46a30b5f416 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
W20260709 13:22:16.110987  6844 leader_election.cc:336] T 30e88460611e47b2ba16a46a30b5f416 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111)
W20260709 13:22:16.112396  6844 leader_election.cc:336] T 30e88460611e47b2ba16a46a30b5f416 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817): Network error: Client connection negotiation failed: client connection to 127.5.126.66:42817: connect: Connection refused (error 111)
I20260709 13:22:16.112941  6844 leader_election.cc:304] T 30e88460611e47b2ba16a46a30b5f416 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:22:16.114101 14669 raft_consensus.cc:2749] T 30e88460611e47b2ba16a46a30b5f416 P cd75a17ab2604397adab03bb8b5fd75c [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:22:16.171027  6844 consensus_peers.cc:597] T 90d42e216d9741e190bca19a781291fd P cd75a17ab2604397adab03bb8b5fd75c -> Peer b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817): Couldn't send request to peer b7ab4784c7344b939bc36f639286f377. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.66:42817: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:22:16.267381  7466 consensus_peers.cc:597] T b3f13b31a1f84f0d89d007eadd57924c P 7ba59cc884714e8aa5f3f0ecaed84cbb -> Peer b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817): Couldn't send request to peer b7ab4784c7344b939bc36f639286f377. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.66:42817: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:22:16.271332  6844 consensus_peers.cc:597] T 1bf4668eeb70467fb3dc5a0289233b3c P cd75a17ab2604397adab03bb8b5fd75c -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111). This is attempt 66: this message will repeat every 5th retry.
W20260709 13:22:16.305883  6844 consensus_peers.cc:597] T a3022224cc81473690653a83d4e99470 P cd75a17ab2604397adab03bb8b5fd75c -> Peer b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817): Couldn't send request to peer b7ab4784c7344b939bc36f639286f377. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.66:42817: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:22:16.309913  7466 consensus_peers.cc:597] T 17587d6730594da4a56fa13a353232a1 P 7ba59cc884714e8aa5f3f0ecaed84cbb -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111). This is attempt 66: this message will repeat every 5th retry.
W20260709 13:22:16.317297  6844 consensus_peers.cc:597] T 3a485a995abc4807b6e511e45419f737 P cd75a17ab2604397adab03bb8b5fd75c -> Peer b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817): Couldn't send request to peer b7ab4784c7344b939bc36f639286f377. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.66:42817: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:22:16.328230 14715 raft_consensus.cc:493] T 3d65025eea89441290d85dd053810e31 P cd75a17ab2604397adab03bb8b5fd75c [term 20 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:22:16.328938 14715 raft_consensus.cc:515] T 3d65025eea89441290d85dd053810e31 P cd75a17ab2604397adab03bb8b5fd75c [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:22:16.331566 14715 leader_election.cc:290] T 3d65025eea89441290d85dd053810e31 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
W20260709 13:22:16.337066  6844 leader_election.cc:336] T 3d65025eea89441290d85dd053810e31 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111)
W20260709 13:22:16.337891  6844 leader_election.cc:336] T 3d65025eea89441290d85dd053810e31 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817): Network error: Client connection negotiation failed: client connection to 127.5.126.66:42817: connect: Connection refused (error 111)
I20260709 13:22:16.340584  6844 leader_election.cc:304] T 3d65025eea89441290d85dd053810e31 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:22:16.341421 14715 raft_consensus.cc:2749] T 3d65025eea89441290d85dd053810e31 P cd75a17ab2604397adab03bb8b5fd75c [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 13:22:16.344097  7466 consensus_peers.cc:597] T 404190ce4ce94cecbfcb6ea9d1dd8626 P 7ba59cc884714e8aa5f3f0ecaed84cbb -> Peer b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817): Couldn't send request to peer b7ab4784c7344b939bc36f639286f377. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.66:42817: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:22:16.359380  5625 thread.cc:527] Waited for 4000ms trying to join with diag-logger (tid 6828)
W20260709 13:22:16.390494  6844 consensus_peers.cc:597] T c4db81d9d329422bb3b4160ca4ac2d1d P cd75a17ab2604397adab03bb8b5fd75c -> Peer b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817): Couldn't send request to peer b7ab4784c7344b939bc36f639286f377. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.66:42817: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:22:16.403242  6844 consensus_peers.cc:597] T a3022224cc81473690653a83d4e99470 P cd75a17ab2604397adab03bb8b5fd75c -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 13:22:16.428613  6844 consensus_peers.cc:597] T c4db81d9d329422bb3b4160ca4ac2d1d P cd75a17ab2604397adab03bb8b5fd75c -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111). This is attempt 66: this message will repeat every 5th retry.
I20260709 13:22:16.445142 14715 raft_consensus.cc:493] T 20f6842e26174571996b8dea4151d4be P cd75a17ab2604397adab03bb8b5fd75c [term 22 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:22:16.445771 14715 raft_consensus.cc:515] T 20f6842e26174571996b8dea4151d4be P cd75a17ab2604397adab03bb8b5fd75c [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:22:16.448071 14715 leader_election.cc:290] T 20f6842e26174571996b8dea4151d4be P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
W20260709 13:22:16.453300  6844 leader_election.cc:336] T 20f6842e26174571996b8dea4151d4be P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111)
W20260709 13:22:16.455456  6844 leader_election.cc:336] T 20f6842e26174571996b8dea4151d4be P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817): Network error: Client connection negotiation failed: client connection to 127.5.126.66:42817: connect: Connection refused (error 111)
I20260709 13:22:16.455978  6844 leader_election.cc:304] T 20f6842e26174571996b8dea4151d4be P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:22:16.456830 14715 raft_consensus.cc:2749] T 20f6842e26174571996b8dea4151d4be P cd75a17ab2604397adab03bb8b5fd75c [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:22:16.511335 14715 raft_consensus.cc:493] T d33d5ee8ef6f415593d8df52063161ad P cd75a17ab2604397adab03bb8b5fd75c [term 21 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:22:16.511943 14715 raft_consensus.cc:515] T d33d5ee8ef6f415593d8df52063161ad P cd75a17ab2604397adab03bb8b5fd75c [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:22:16.514223 14715 leader_election.cc:290] T d33d5ee8ef6f415593d8df52063161ad P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
W20260709 13:22:16.520520  6844 leader_election.cc:336] T d33d5ee8ef6f415593d8df52063161ad P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817): Network error: Client connection negotiation failed: client connection to 127.5.126.66:42817: connect: Connection refused (error 111)
W20260709 13:22:16.521337  6844 leader_election.cc:336] T d33d5ee8ef6f415593d8df52063161ad P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111)
I20260709 13:22:16.522017  6844 leader_election.cc:304] T d33d5ee8ef6f415593d8df52063161ad P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:22:16.523221 14715 raft_consensus.cc:2749] T d33d5ee8ef6f415593d8df52063161ad P cd75a17ab2604397adab03bb8b5fd75c [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:22:16.645229 14715 raft_consensus.cc:493] T 8c7f33e544204fbaac4078e3e83bbf4e P cd75a17ab2604397adab03bb8b5fd75c [term 16 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:22:16.645983 14715 raft_consensus.cc:515] T 8c7f33e544204fbaac4078e3e83bbf4e P cd75a17ab2604397adab03bb8b5fd75c [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:22:16.662364 14715 leader_election.cc:290] T 8c7f33e544204fbaac4078e3e83bbf4e P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
W20260709 13:22:16.663079  6844 leader_election.cc:336] T 8c7f33e544204fbaac4078e3e83bbf4e P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111)
W20260709 13:22:16.676863  6844 leader_election.cc:336] T 8c7f33e544204fbaac4078e3e83bbf4e P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817): Network error: Client connection negotiation failed: client connection to 127.5.126.66:42817: connect: Connection refused (error 111)
I20260709 13:22:16.677991  6844 leader_election.cc:304] T 8c7f33e544204fbaac4078e3e83bbf4e P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:22:16.679740 14715 raft_consensus.cc:2749] T 8c7f33e544204fbaac4078e3e83bbf4e P cd75a17ab2604397adab03bb8b5fd75c [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:22:16.681022  7466 consensus_peers.cc:597] T 3fa34c08b205435dba97346991aa1f92 P 7ba59cc884714e8aa5f3f0ecaed84cbb -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111). This is attempt 66: this message will repeat every 5th retry.
W20260709 13:22:16.700858  6846 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.68:45071, user_credentials={real_user=slave}} blocked reactor thread for 47389us
W20260709 13:22:16.734709  6844 consensus_peers.cc:597] T 3411566abe2d4c9bb4b2adfdd05e6f17 P cd75a17ab2604397adab03bb8b5fd75c -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 13:22:16.735433  6844 consensus_peers.cc:597] T 95a75bfe094d4bdc963aba3f08dfcd25 P cd75a17ab2604397adab03bb8b5fd75c -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
I20260709 13:22:16.767266 14669 raft_consensus.cc:493] T a1704639a875409b9959353527b3fd68 P cd75a17ab2604397adab03bb8b5fd75c [term 22 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:22:16.767884 14669 raft_consensus.cc:515] T a1704639a875409b9959353527b3fd68 P cd75a17ab2604397adab03bb8b5fd75c [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:22:16.769985 14669 leader_election.cc:290] T a1704639a875409b9959353527b3fd68 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
W20260709 13:22:16.777369  6844 leader_election.cc:336] T a1704639a875409b9959353527b3fd68 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817): Network error: Client connection negotiation failed: client connection to 127.5.126.66:42817: connect: Connection refused (error 111)
W20260709 13:22:16.789886  6844 leader_election.cc:336] T a1704639a875409b9959353527b3fd68 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111)
I20260709 13:22:16.790512  6844 leader_election.cc:304] T a1704639a875409b9959353527b3fd68 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:22:16.791622 14717 raft_consensus.cc:2749] T a1704639a875409b9959353527b3fd68 P cd75a17ab2604397adab03bb8b5fd75c [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
W20260709 13:22:16.805822  6844 consensus_peers.cc:597] T 44bde925b2e541b69890d70715b85176 P cd75a17ab2604397adab03bb8b5fd75c -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111). This is attempt 66: this message will repeat every 5th retry.
W20260709 13:22:16.806514  6844 consensus_peers.cc:597] T 90d42e216d9741e190bca19a781291fd P cd75a17ab2604397adab03bb8b5fd75c -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111). This is attempt 66: this message will repeat every 5th retry.
W20260709 13:22:16.848074  7466 consensus_peers.cc:597] T 1528ab62b6fe4e3099d08f141afee116 P 7ba59cc884714e8aa5f3f0ecaed84cbb -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 13:22:16.901068  6844 consensus_peers.cc:597] T e31b9971c15848dea59d4d4130141d9e P cd75a17ab2604397adab03bb8b5fd75c -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111). This is attempt 66: this message will repeat every 5th retry.
I20260709 13:22:16.963305 14717 raft_consensus.cc:493] T 2c240553ce044eedb41541d72b9475d7 P cd75a17ab2604397adab03bb8b5fd75c [term 21 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:22:16.964206 14717 raft_consensus.cc:515] T 2c240553ce044eedb41541d72b9475d7 P cd75a17ab2604397adab03bb8b5fd75c [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:22:16.974917 14717 leader_election.cc:290] T 2c240553ce044eedb41541d72b9475d7 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
W20260709 13:22:16.975796  6844 leader_election.cc:336] T 2c240553ce044eedb41541d72b9475d7 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111)
W20260709 13:22:16.986929  6844 leader_election.cc:336] T 2c240553ce044eedb41541d72b9475d7 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817): Network error: Client connection negotiation failed: client connection to 127.5.126.66:42817: connect: Connection refused (error 111)
I20260709 13:22:16.989041  6844 leader_election.cc:304] T 2c240553ce044eedb41541d72b9475d7 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:22:16.992564 14717 raft_consensus.cc:2749] T 2c240553ce044eedb41541d72b9475d7 P cd75a17ab2604397adab03bb8b5fd75c [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:22:17.070992 14717 raft_consensus.cc:493] T 9b3759de40694069b13c0f8bd40e5709 P cd75a17ab2604397adab03bb8b5fd75c [term 20 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:22:17.071699 14717 raft_consensus.cc:515] T 9b3759de40694069b13c0f8bd40e5709 P cd75a17ab2604397adab03bb8b5fd75c [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:22:17.074680 14717 leader_election.cc:290] T 9b3759de40694069b13c0f8bd40e5709 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
W20260709 13:22:17.080969  6844 leader_election.cc:336] T 9b3759de40694069b13c0f8bd40e5709 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111)
W20260709 13:22:17.081836  6844 leader_election.cc:336] T 9b3759de40694069b13c0f8bd40e5709 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817): Network error: Client connection negotiation failed: client connection to 127.5.126.66:42817: connect: Connection refused (error 111)
I20260709 13:22:17.082314  6844 leader_election.cc:304] T 9b3759de40694069b13c0f8bd40e5709 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:22:17.083755 14717 raft_consensus.cc:2749] T 9b3759de40694069b13c0f8bd40e5709 P cd75a17ab2604397adab03bb8b5fd75c [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:22:17.088608 14717 raft_consensus.cc:493] T f5be3a11b23d4ea9b08300a2789821c7 P cd75a17ab2604397adab03bb8b5fd75c [term 21 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:22:17.090917 14717 raft_consensus.cc:515] T f5be3a11b23d4ea9b08300a2789821c7 P cd75a17ab2604397adab03bb8b5fd75c [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:22:17.096932 14717 leader_election.cc:290] T f5be3a11b23d4ea9b08300a2789821c7 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
W20260709 13:22:17.102530  6844 leader_election.cc:336] T f5be3a11b23d4ea9b08300a2789821c7 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111)
W20260709 13:22:17.106348  6844 leader_election.cc:336] T f5be3a11b23d4ea9b08300a2789821c7 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817): Network error: Client connection negotiation failed: client connection to 127.5.126.66:42817: connect: Connection refused (error 111)
I20260709 13:22:17.106869  6844 leader_election.cc:304] T f5be3a11b23d4ea9b08300a2789821c7 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:22:17.112705 14717 raft_consensus.cc:2749] T f5be3a11b23d4ea9b08300a2789821c7 P cd75a17ab2604397adab03bb8b5fd75c [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 13:22:17.129204  6844 consensus_peers.cc:597] T f58dc08b12a2494bb9a1372837970ca2 P cd75a17ab2604397adab03bb8b5fd75c -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111). This is attempt 66: this message will repeat every 5th retry.
I20260709 13:22:17.131240 14717 raft_consensus.cc:493] T 4275cf08e63345f993bce8664eada830 P cd75a17ab2604397adab03bb8b5fd75c [term 21 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:22:17.131824 14717 raft_consensus.cc:515] T 4275cf08e63345f993bce8664eada830 P cd75a17ab2604397adab03bb8b5fd75c [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:22:17.134235 14717 leader_election.cc:290] T 4275cf08e63345f993bce8664eada830 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
W20260709 13:22:17.141597  6844 leader_election.cc:336] T 4275cf08e63345f993bce8664eada830 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111)
W20260709 13:22:17.144706  6844 leader_election.cc:336] T 4275cf08e63345f993bce8664eada830 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817): Network error: Client connection negotiation failed: client connection to 127.5.126.66:42817: connect: Connection refused (error 111)
I20260709 13:22:17.145294  6844 leader_election.cc:304] T 4275cf08e63345f993bce8664eada830 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:22:17.146220 14717 raft_consensus.cc:2749] T 4275cf08e63345f993bce8664eada830 P cd75a17ab2604397adab03bb8b5fd75c [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 13:22:17.191612  7466 consensus_peers.cc:597] T be1a92657f494cac8dd227d152f50151 P 7ba59cc884714e8aa5f3f0ecaed84cbb -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111). This is attempt 66: this message will repeat every 5th retry.
I20260709 13:22:17.204159 14717 raft_consensus.cc:493] T d8292e16e5654be6bc408560cf256aaa P cd75a17ab2604397adab03bb8b5fd75c [term 22 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:22:17.204921 14717 raft_consensus.cc:515] T d8292e16e5654be6bc408560cf256aaa P cd75a17ab2604397adab03bb8b5fd75c [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:22:17.210045 14717 leader_election.cc:290] T d8292e16e5654be6bc408560cf256aaa P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
W20260709 13:22:17.213523  6844 leader_election.cc:336] T d8292e16e5654be6bc408560cf256aaa P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111)
W20260709 13:22:17.215924  6844 leader_election.cc:336] T d8292e16e5654be6bc408560cf256aaa P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817): Network error: Client connection negotiation failed: client connection to 127.5.126.66:42817: connect: Connection refused (error 111)
I20260709 13:22:17.216471  6844 leader_election.cc:304] T d8292e16e5654be6bc408560cf256aaa P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:22:17.217990 14717 raft_consensus.cc:2749] T d8292e16e5654be6bc408560cf256aaa P cd75a17ab2604397adab03bb8b5fd75c [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
W20260709 13:22:17.247711  6844 consensus_peers.cc:597] T 34f36d59d88f40fe8a2805e604fc6c0a P cd75a17ab2604397adab03bb8b5fd75c -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111). This is attempt 66: this message will repeat every 5th retry.
W20260709 13:22:17.248303  7466 consensus_peers.cc:597] T fe20b4b48823486ca3b9c648db6ce8aa P 7ba59cc884714e8aa5f3f0ecaed84cbb -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260709 13:22:17.295468  6844 consensus_peers.cc:597] T 713b5728a197487c9300b310ab94e5a3 P cd75a17ab2604397adab03bb8b5fd75c -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111). This is attempt 66: this message will repeat every 5th retry.
I20260709 13:22:17.333724 14717 raft_consensus.cc:493] T de3186201e1a40d0b335eeb8b4e256e0 P cd75a17ab2604397adab03bb8b5fd75c [term 23 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:22:17.334630 14717 raft_consensus.cc:515] T de3186201e1a40d0b335eeb8b4e256e0 P cd75a17ab2604397adab03bb8b5fd75c [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:22:17.337241 14717 leader_election.cc:290] T de3186201e1a40d0b335eeb8b4e256e0 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
W20260709 13:22:17.350497  6844 leader_election.cc:336] T de3186201e1a40d0b335eeb8b4e256e0 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111)
W20260709 13:22:17.355691  6844 leader_election.cc:336] T de3186201e1a40d0b335eeb8b4e256e0 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817): Network error: Client connection negotiation failed: client connection to 127.5.126.66:42817: connect: Connection refused (error 111)
I20260709 13:22:17.357638  6844 leader_election.cc:304] T de3186201e1a40d0b335eeb8b4e256e0 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:22:17.358392 14693 raft_consensus.cc:493] T f3f9c2e2bf644115957398fe4c9459db P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 23 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:22:17.359380 14693 raft_consensus.cc:515] T f3f9c2e2bf644115957398fe4c9459db P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } attrs { replace: true } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
W20260709 13:22:17.359942  5625 thread.cc:527] Waited for 5000ms trying to join with diag-logger (tid 6828)
I20260709 13:22:17.363138 14693 leader_election.cc:290] T f3f9c2e2bf644115957398fe4c9459db P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:22:17.366096 14717 raft_consensus.cc:2749] T de3186201e1a40d0b335eeb8b4e256e0 P cd75a17ab2604397adab03bb8b5fd75c [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
W20260709 13:22:17.370393  7466 leader_election.cc:336] T f3f9c2e2bf644115957398fe4c9459db P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817): Network error: Client connection negotiation failed: client connection to 127.5.126.66:42817: connect: Connection refused (error 111)
W20260709 13:22:17.371366  7466 leader_election.cc:336] T f3f9c2e2bf644115957398fe4c9459db P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111)
I20260709 13:22:17.371860  7466 leader_election.cc:304] T f3f9c2e2bf644115957398fe4c9459db P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:22:17.371915  6874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f9c2e2bf644115957398fe4c9459db" candidate_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "cd75a17ab2604397adab03bb8b5fd75c" is_pre_election: true
I20260709 13:22:17.372751  6874 raft_consensus.cc:2468] T f3f9c2e2bf644115957398fe4c9459db P cd75a17ab2604397adab03bb8b5fd75c [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ba59cc884714e8aa5f3f0ecaed84cbb in term 23.
I20260709 13:22:17.372902 14693 raft_consensus.cc:2749] T f3f9c2e2bf644115957398fe4c9459db P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
W20260709 13:22:17.389519  6844 consensus_peers.cc:597] T 4b8cacb381b746da8d0049b0a83b41dd P cd75a17ab2604397adab03bb8b5fd75c -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260709 13:22:17.405965  6844 consensus_peers.cc:597] T 711ef6523deb4cbe8ef2ba61e1c21c98 P cd75a17ab2604397adab03bb8b5fd75c -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
I20260709 13:22:17.414372 14717 raft_consensus.cc:493] T ab432e62819d499eaaf3dd55481dd930 P cd75a17ab2604397adab03bb8b5fd75c [term 25 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:22:17.414973 14717 raft_consensus.cc:515] T ab432e62819d499eaaf3dd55481dd930 P cd75a17ab2604397adab03bb8b5fd75c [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:22:17.418313 14717 leader_election.cc:290] T ab432e62819d499eaaf3dd55481dd930 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
W20260709 13:22:17.440512  6844 leader_election.cc:336] T ab432e62819d499eaaf3dd55481dd930 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817): Network error: Client connection negotiation failed: client connection to 127.5.126.66:42817: connect: Connection refused (error 111)
W20260709 13:22:17.441627  6844 leader_election.cc:336] T ab432e62819d499eaaf3dd55481dd930 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111)
I20260709 13:22:17.442121  6844 leader_election.cc:304] T ab432e62819d499eaaf3dd55481dd930 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:22:17.443065 14717 raft_consensus.cc:2749] T ab432e62819d499eaaf3dd55481dd930 P cd75a17ab2604397adab03bb8b5fd75c [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:22:17.533500 14669 raft_consensus.cc:493] T 4d9def8b32fd443aa94ab1420b06837b P cd75a17ab2604397adab03bb8b5fd75c [term 24 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:22:17.534121 14669 raft_consensus.cc:515] T 4d9def8b32fd443aa94ab1420b06837b P cd75a17ab2604397adab03bb8b5fd75c [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:22:17.536230 14669 leader_election.cc:290] T 4d9def8b32fd443aa94ab1420b06837b P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
W20260709 13:22:17.541833  6844 leader_election.cc:336] T 4d9def8b32fd443aa94ab1420b06837b P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111)
W20260709 13:22:17.542676  6844 leader_election.cc:336] T 4d9def8b32fd443aa94ab1420b06837b P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817): Network error: Client connection negotiation failed: client connection to 127.5.126.66:42817: connect: Connection refused (error 111)
I20260709 13:22:17.543160  6844 leader_election.cc:304] T 4d9def8b32fd443aa94ab1420b06837b P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:22:17.544559 14669 raft_consensus.cc:2749] T 4d9def8b32fd443aa94ab1420b06837b P cd75a17ab2604397adab03bb8b5fd75c [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:22:17.620934 14669 raft_consensus.cc:493] T 7c37d41cd9164c15a6826ca62a851a69 P cd75a17ab2604397adab03bb8b5fd75c [term 23 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:22:17.621589 14669 raft_consensus.cc:515] T 7c37d41cd9164c15a6826ca62a851a69 P cd75a17ab2604397adab03bb8b5fd75c [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:22:17.623836 14669 leader_election.cc:290] T 7c37d41cd9164c15a6826ca62a851a69 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
W20260709 13:22:17.637326  6844 leader_election.cc:336] T 7c37d41cd9164c15a6826ca62a851a69 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111)
W20260709 13:22:17.640480  6844 leader_election.cc:336] T 7c37d41cd9164c15a6826ca62a851a69 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817): Network error: Client connection negotiation failed: client connection to 127.5.126.66:42817: connect: Connection refused (error 111)
I20260709 13:22:17.641031  6844 leader_election.cc:304] T 7c37d41cd9164c15a6826ca62a851a69 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:22:17.641922 14669 raft_consensus.cc:2749] T 7c37d41cd9164c15a6826ca62a851a69 P cd75a17ab2604397adab03bb8b5fd75c [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:22:17.669641 14669 raft_consensus.cc:493] T bd6869f07b5a4885a0b99fbe60c3b175 P cd75a17ab2604397adab03bb8b5fd75c [term 27 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:22:17.670351 14669 raft_consensus.cc:515] T bd6869f07b5a4885a0b99fbe60c3b175 P cd75a17ab2604397adab03bb8b5fd75c [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:22:17.676131 14669 leader_election.cc:290] T bd6869f07b5a4885a0b99fbe60c3b175 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:22:17.680330 14669 raft_consensus.cc:493] T dbdf895bba214ff68685a24fd17dfb5d P cd75a17ab2604397adab03bb8b5fd75c [term 21 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:22:17.680974 14669 raft_consensus.cc:515] T dbdf895bba214ff68685a24fd17dfb5d P cd75a17ab2604397adab03bb8b5fd75c [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:22:17.684350 14669 leader_election.cc:290] T dbdf895bba214ff68685a24fd17dfb5d P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
W20260709 13:22:17.706856  6844 leader_election.cc:336] T bd6869f07b5a4885a0b99fbe60c3b175 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 28 pre-election: RPC error from VoteRequest() call to peer b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817): Network error: Client connection negotiation failed: client connection to 127.5.126.66:42817: connect: Connection refused (error 111)
W20260709 13:22:17.712226  6844 leader_election.cc:336] T dbdf895bba214ff68685a24fd17dfb5d P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817): Network error: Client connection negotiation failed: client connection to 127.5.126.66:42817: connect: Connection refused (error 111)
W20260709 13:22:17.716792  6844 leader_election.cc:336] T bd6869f07b5a4885a0b99fbe60c3b175 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 28 pre-election: RPC error from VoteRequest() call to peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111)
I20260709 13:22:17.718742  6844 leader_election.cc:304] T bd6869f07b5a4885a0b99fbe60c3b175 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:22:17.727815 14669 raft_consensus.cc:2749] T bd6869f07b5a4885a0b99fbe60c3b175 P cd75a17ab2604397adab03bb8b5fd75c [term 27 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
W20260709 13:22:17.729332  6844 leader_election.cc:336] T dbdf895bba214ff68685a24fd17dfb5d P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111)
I20260709 13:22:17.734951  6844 leader_election.cc:304] T dbdf895bba214ff68685a24fd17dfb5d P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:22:17.735917 14669 raft_consensus.cc:2749] T dbdf895bba214ff68685a24fd17dfb5d P cd75a17ab2604397adab03bb8b5fd75c [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:22:17.765297 14669 raft_consensus.cc:493] T 07a92dd554674067a83a9cb68c4773f2 P cd75a17ab2604397adab03bb8b5fd75c [term 19 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:22:17.766116 14669 raft_consensus.cc:515] T 07a92dd554674067a83a9cb68c4773f2 P cd75a17ab2604397adab03bb8b5fd75c [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:22:17.769390 14669 leader_election.cc:290] T 07a92dd554674067a83a9cb68c4773f2 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
W20260709 13:22:17.786227  6844 leader_election.cc:336] T 07a92dd554674067a83a9cb68c4773f2 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817): Network error: Client connection negotiation failed: client connection to 127.5.126.66:42817: connect: Connection refused (error 111)
W20260709 13:22:17.789501  6844 leader_election.cc:336] T 07a92dd554674067a83a9cb68c4773f2 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111)
I20260709 13:22:17.789986  6844 leader_election.cc:304] T 07a92dd554674067a83a9cb68c4773f2 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:22:17.791273 14669 raft_consensus.cc:2749] T 07a92dd554674067a83a9cb68c4773f2 P cd75a17ab2604397adab03bb8b5fd75c [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 13:22:17.801899  6844 consensus_peers.cc:597] T 713b5728a197487c9300b310ab94e5a3 P cd75a17ab2604397adab03bb8b5fd75c -> Peer b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817): Couldn't send request to peer b7ab4784c7344b939bc36f639286f377. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.66:42817: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:22:17.808959  7466 consensus_peers.cc:597] T 7a734b5ab7834e05a8c422208acc58b1 P 7ba59cc884714e8aa5f3f0ecaed84cbb -> Peer b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817): Couldn't send request to peer b7ab4784c7344b939bc36f639286f377. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.66:42817: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:22:17.825589 14669 raft_consensus.cc:493] T f03d0dbf16864ca4bc1bb5e4c0334c0f P cd75a17ab2604397adab03bb8b5fd75c [term 19 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:22:17.826308 14669 raft_consensus.cc:515] T f03d0dbf16864ca4bc1bb5e4c0334c0f P cd75a17ab2604397adab03bb8b5fd75c [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:22:17.828681 14669 leader_election.cc:290] T f03d0dbf16864ca4bc1bb5e4c0334c0f P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
W20260709 13:22:17.832351  6844 leader_election.cc:336] T f03d0dbf16864ca4bc1bb5e4c0334c0f P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111)
W20260709 13:22:17.834401  6844 leader_election.cc:336] T f03d0dbf16864ca4bc1bb5e4c0334c0f P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817): Network error: Client connection negotiation failed: client connection to 127.5.126.66:42817: connect: Connection refused (error 111)
I20260709 13:22:17.834854  6844 leader_election.cc:304] T f03d0dbf16864ca4bc1bb5e4c0334c0f P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:22:17.838058 14717 raft_consensus.cc:2749] T f03d0dbf16864ca4bc1bb5e4c0334c0f P cd75a17ab2604397adab03bb8b5fd75c [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:22:17.888927 14719 raft_consensus.cc:493] T f4b8bd455d5a47c18a1380839c6e0d61 P cd75a17ab2604397adab03bb8b5fd75c [term 22 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:22:17.889858 14719 raft_consensus.cc:515] T f4b8bd455d5a47c18a1380839c6e0d61 P cd75a17ab2604397adab03bb8b5fd75c [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:22:17.898439 14719 leader_election.cc:290] T f4b8bd455d5a47c18a1380839c6e0d61 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
W20260709 13:22:17.908753  6844 leader_election.cc:336] T f4b8bd455d5a47c18a1380839c6e0d61 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817): Network error: Client connection negotiation failed: client connection to 127.5.126.66:42817: connect: Connection refused (error 111)
W20260709 13:22:17.909483  6844 leader_election.cc:336] T f4b8bd455d5a47c18a1380839c6e0d61 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111)
I20260709 13:22:17.909863  6844 leader_election.cc:304] T f4b8bd455d5a47c18a1380839c6e0d61 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:22:17.910812 14719 raft_consensus.cc:2749] T f4b8bd455d5a47c18a1380839c6e0d61 P cd75a17ab2604397adab03bb8b5fd75c [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
W20260709 13:22:17.912257  6614 catalog_manager.cc:4755] TS ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet ce4f062dcd314d43a63ca74067cb5ee3: Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111)
W20260709 13:22:18.080587  6844 consensus_peers.cc:597] T ce4f062dcd314d43a63ca74067cb5ee3 P cd75a17ab2604397adab03bb8b5fd75c -> Peer b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817): Couldn't send request to peer b7ab4784c7344b939bc36f639286f377. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.66:42817: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:22:18.100725  7466 consensus_peers.cc:597] T bb3d8792045a4583ae2e965b1350a5b4 P 7ba59cc884714e8aa5f3f0ecaed84cbb -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260709 13:22:18.117025  6844 consensus_peers.cc:597] T d8cee0accdb8499c86d4414b72565a38 P cd75a17ab2604397adab03bb8b5fd75c -> Peer b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817): Couldn't send request to peer b7ab4784c7344b939bc36f639286f377. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.66:42817: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:22:18.127480 14719 raft_consensus.cc:493] T 853ac0a8cbd64ce99457f170216d4d0f P cd75a17ab2604397adab03bb8b5fd75c [term 18 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:22:18.128180 14719 raft_consensus.cc:515] T 853ac0a8cbd64ce99457f170216d4d0f P cd75a17ab2604397adab03bb8b5fd75c [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:22:18.130661 14719 leader_election.cc:290] T 853ac0a8cbd64ce99457f170216d4d0f P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
W20260709 13:22:18.136433  6844 leader_election.cc:336] T 853ac0a8cbd64ce99457f170216d4d0f P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111)
W20260709 13:22:18.137315  6844 leader_election.cc:336] T 853ac0a8cbd64ce99457f170216d4d0f P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817): Network error: Client connection negotiation failed: client connection to 127.5.126.66:42817: connect: Connection refused (error 111)
I20260709 13:22:18.137785  6844 leader_election.cc:304] T 853ac0a8cbd64ce99457f170216d4d0f P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:22:18.139039 14719 raft_consensus.cc:2749] T 853ac0a8cbd64ce99457f170216d4d0f P cd75a17ab2604397adab03bb8b5fd75c [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:22:18.253314 14719 raft_consensus.cc:493] T 7887766dc6784fcaa42b35c05fea7a99 P cd75a17ab2604397adab03bb8b5fd75c [term 23 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:22:18.253942 14719 raft_consensus.cc:515] T 7887766dc6784fcaa42b35c05fea7a99 P cd75a17ab2604397adab03bb8b5fd75c [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:22:18.257393 14719 leader_election.cc:290] T 7887766dc6784fcaa42b35c05fea7a99 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
W20260709 13:22:18.260968  6844 leader_election.cc:336] T 7887766dc6784fcaa42b35c05fea7a99 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111)
W20260709 13:22:18.271486  7466 consensus_peers.cc:597] T 1528ab62b6fe4e3099d08f141afee116 P 7ba59cc884714e8aa5f3f0ecaed84cbb -> Peer b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817): Couldn't send request to peer b7ab4784c7344b939bc36f639286f377. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.66:42817: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:22:18.276059 14719 raft_consensus.cc:493] T f09c2a98de1a4decabd0ff900dd44caa P cd75a17ab2604397adab03bb8b5fd75c [term 24 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:22:18.276741 14719 raft_consensus.cc:515] T f09c2a98de1a4decabd0ff900dd44caa P cd75a17ab2604397adab03bb8b5fd75c [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:22:18.279163 14719 leader_election.cc:290] T f09c2a98de1a4decabd0ff900dd44caa P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
W20260709 13:22:18.284729  6844 leader_election.cc:336] T f09c2a98de1a4decabd0ff900dd44caa P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111)
W20260709 13:22:18.301331  7466 consensus_peers.cc:597] T 4f00a2e87e56452083b759f60d461ee3 P 7ba59cc884714e8aa5f3f0ecaed84cbb -> Peer b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817): Couldn't send request to peer b7ab4784c7344b939bc36f639286f377. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.66:42817: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:22:18.882529  6844 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111) [suppressed 564 similar messages]
I20260709 13:22:18.890604 14726 raft_consensus.cc:493] T 4275cf08e63345f993bce8664eada830 P cd75a17ab2604397adab03bb8b5fd75c [term 21 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:22:18.893904 14726 raft_consensus.cc:515] T 4275cf08e63345f993bce8664eada830 P cd75a17ab2604397adab03bb8b5fd75c [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:22:18.897282 14726 leader_election.cc:290] T 4275cf08e63345f993bce8664eada830 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:22:18.923969 14731 raft_consensus.cc:493] T 9b3759de40694069b13c0f8bd40e5709 P cd75a17ab2604397adab03bb8b5fd75c [term 20 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:22:18.924832 14731 raft_consensus.cc:515] T 9b3759de40694069b13c0f8bd40e5709 P cd75a17ab2604397adab03bb8b5fd75c [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:22:18.925232 14733 raft_consensus.cc:493] T 20f6842e26174571996b8dea4151d4be P cd75a17ab2604397adab03bb8b5fd75c [term 22 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:22:18.925870 14733 raft_consensus.cc:515] T 20f6842e26174571996b8dea4151d4be P cd75a17ab2604397adab03bb8b5fd75c [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:22:18.927398 14731 leader_election.cc:290] T 9b3759de40694069b13c0f8bd40e5709 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:22:18.931313 14724 raft_consensus.cc:493] T 2c240553ce044eedb41541d72b9475d7 P cd75a17ab2604397adab03bb8b5fd75c [term 21 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:22:18.931542 14731 raft_consensus.cc:493] T e77e330a82df4b43a745d57a68f6f057 P cd75a17ab2604397adab03bb8b5fd75c [term 20 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:22:18.931944 14724 raft_consensus.cc:515] T 2c240553ce044eedb41541d72b9475d7 P cd75a17ab2604397adab03bb8b5fd75c [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:22:18.934548 14724 leader_election.cc:290] T 2c240553ce044eedb41541d72b9475d7 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:22:18.933493 14731 raft_consensus.cc:515] T e77e330a82df4b43a745d57a68f6f057 P cd75a17ab2604397adab03bb8b5fd75c [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } }
I20260709 13:22:18.928819 14733 leader_election.cc:290] T 20f6842e26174571996b8dea4151d4be P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:22:18.937906 14731 leader_election.cc:290] T e77e330a82df4b43a745d57a68f6f057 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391)
W20260709 13:22:18.952373  6844 consensus_peers.cc:597] T 9e326172347f45e99a0d482b5d8ef768 P cd75a17ab2604397adab03bb8b5fd75c -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111). This is attempt 66: this message will repeat every 5th retry.
W20260709 13:22:18.972456  7466 consensus_peers.cc:597] T 404190ce4ce94cecbfcb6ea9d1dd8626 P 7ba59cc884714e8aa5f3f0ecaed84cbb -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111). This is attempt 71: this message will repeat every 5th retry.
W20260709 13:22:18.973464  7466 consensus_peers.cc:597] T b3f13b31a1f84f0d89d007eadd57924c P 7ba59cc884714e8aa5f3f0ecaed84cbb -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111). This is attempt 71: this message will repeat every 5th retry.
W20260709 13:22:18.974227  7466 consensus_peers.cc:597] T 24ee15416e3145beaa1b8183453729a3 P 7ba59cc884714e8aa5f3f0ecaed84cbb -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111). This is attempt 71: this message will repeat every 5th retry.
W20260709 13:22:18.976503  7466 consensus_peers.cc:597] T be1a92657f494cac8dd227d152f50151 P 7ba59cc884714e8aa5f3f0ecaed84cbb -> Peer b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817): Couldn't send request to peer b7ab4784c7344b939bc36f639286f377. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.66:42817: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:22:18.977062  7466 consensus_peers.cc:597] T 404190ce4ce94cecbfcb6ea9d1dd8626 P 7ba59cc884714e8aa5f3f0ecaed84cbb -> Peer b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817): Couldn't send request to peer b7ab4784c7344b939bc36f639286f377. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.66:42817: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:22:18.977579  7466 consensus_peers.cc:597] T 7ba5dac66ab5497e9e336f2a3c28cda5 P 7ba59cc884714e8aa5f3f0ecaed84cbb -> Peer b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817): Couldn't send request to peer b7ab4784c7344b939bc36f639286f377. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.66:42817: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:22:18.978055  7466 consensus_peers.cc:597] T b3f13b31a1f84f0d89d007eadd57924c P 7ba59cc884714e8aa5f3f0ecaed84cbb -> Peer b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817): Couldn't send request to peer b7ab4784c7344b939bc36f639286f377. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.66:42817: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:22:18.978633  7466 consensus_peers.cc:597] T 427c124d773f483294511e80fe340075 P 7ba59cc884714e8aa5f3f0ecaed84cbb -> Peer b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817): Couldn't send request to peer b7ab4784c7344b939bc36f639286f377. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.66:42817: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:22:18.972553  6844 consensus_peers.cc:597] T 7c44c4849aa54f2b94d1f1bef9ed546f P cd75a17ab2604397adab03bb8b5fd75c -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 13:22:18.979760  7466 consensus_peers.cc:597] T 17587d6730594da4a56fa13a353232a1 P 7ba59cc884714e8aa5f3f0ecaed84cbb -> Peer b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817): Couldn't send request to peer b7ab4784c7344b939bc36f639286f377. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.66:42817: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:22:18.980259  6844 leader_election.cc:336] T 4275cf08e63345f993bce8664eada830 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111)
W20260709 13:22:18.981033  6844 leader_election.cc:336] T 9b3759de40694069b13c0f8bd40e5709 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111)
W20260709 13:22:18.981442  6844 leader_election.cc:336] T 20f6842e26174571996b8dea4151d4be P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111)
W20260709 13:22:18.982064  6844 leader_election.cc:336] T 2c240553ce044eedb41541d72b9475d7 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111)
W20260709 13:22:18.982450  6844 leader_election.cc:336] T e77e330a82df4b43a745d57a68f6f057 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111)
I20260709 13:22:19.039685  5625 tablet_server.cc:196] TabletServer@127.5.126.66:0 shutdown complete.
I20260709 13:22:19.164175  5625 tablet_server.cc:179] TabletServer@127.5.126.67:0 shutting down...
I20260709 13:22:19.186282 14730 raft_consensus.cc:493] T f5be3a11b23d4ea9b08300a2789821c7 P cd75a17ab2604397adab03bb8b5fd75c [term 21 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:22:19.187156 14730 raft_consensus.cc:515] T f5be3a11b23d4ea9b08300a2789821c7 P cd75a17ab2604397adab03bb8b5fd75c [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:22:19.189508 14730 leader_election.cc:290] T f5be3a11b23d4ea9b08300a2789821c7 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
W20260709 13:22:19.192241  6844 consensus_peers.cc:597] T 7c44c4849aa54f2b94d1f1bef9ed546f P cd75a17ab2604397adab03bb8b5fd75c -> Peer b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817): Couldn't send request to peer b7ab4784c7344b939bc36f639286f377. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.66:42817: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:22:19.192829  6844 consensus_peers.cc:597] T f58dc08b12a2494bb9a1372837970ca2 P cd75a17ab2604397adab03bb8b5fd75c -> Peer b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817): Couldn't send request to peer b7ab4784c7344b939bc36f639286f377. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.66:42817: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:22:19.193274  6844 leader_election.cc:336] T 7887766dc6784fcaa42b35c05fea7a99 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817): Network error: Client connection negotiation failed: client connection to 127.5.126.66:42817: connect: Connection refused (error 111)
I20260709 13:22:19.193701  6844 leader_election.cc:304] T 7887766dc6784fcaa42b35c05fea7a99 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
W20260709 13:22:19.195063  6844 consensus_peers.cc:597] T 9e326172347f45e99a0d482b5d8ef768 P cd75a17ab2604397adab03bb8b5fd75c -> Peer b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817): Couldn't send request to peer b7ab4784c7344b939bc36f639286f377. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.66:42817: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:22:19.195652  6844 leader_election.cc:336] T f09c2a98de1a4decabd0ff900dd44caa P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817): Network error: Client connection negotiation failed: client connection to 127.5.126.66:42817: connect: Connection refused (error 111)
I20260709 13:22:19.196162  6844 leader_election.cc:304] T f09c2a98de1a4decabd0ff900dd44caa P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:22:19.196511 14730 raft_consensus.cc:2749] T 7887766dc6784fcaa42b35c05fea7a99 P cd75a17ab2604397adab03bb8b5fd75c [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:22:19.197233 14733 raft_consensus.cc:2749] T f09c2a98de1a4decabd0ff900dd44caa P cd75a17ab2604397adab03bb8b5fd75c [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
W20260709 13:22:19.197403  6844 consensus_peers.cc:597] T 44bde925b2e541b69890d70715b85176 P cd75a17ab2604397adab03bb8b5fd75c -> Peer b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817): Couldn't send request to peer b7ab4784c7344b939bc36f639286f377. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.66:42817: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:22:19.201929  6844 consensus_peers.cc:597] T 3411566abe2d4c9bb4b2adfdd05e6f17 P cd75a17ab2604397adab03bb8b5fd75c -> Peer b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817): Couldn't send request to peer b7ab4784c7344b939bc36f639286f377. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.66:42817: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:22:19.202418  6844 consensus_peers.cc:597] T 711ef6523deb4cbe8ef2ba61e1c21c98 P cd75a17ab2604397adab03bb8b5fd75c -> Peer b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817): Couldn't send request to peer b7ab4784c7344b939bc36f639286f377. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.66:42817: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:22:19.202854  6844 consensus_peers.cc:597] T e31b9971c15848dea59d4d4130141d9e P cd75a17ab2604397adab03bb8b5fd75c -> Peer b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817): Couldn't send request to peer b7ab4784c7344b939bc36f639286f377. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.66:42817: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:22:19.203356  6844 consensus_peers.cc:597] T bb7fa124c3bf4ef9ab65a407cb008441 P cd75a17ab2604397adab03bb8b5fd75c -> Peer b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817): Couldn't send request to peer b7ab4784c7344b939bc36f639286f377. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.66:42817: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:22:19.203857  6844 leader_election.cc:336] T 4275cf08e63345f993bce8664eada830 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817): Network error: Client connection negotiation failed: client connection to 127.5.126.66:42817: connect: Connection refused (error 111)
I20260709 13:22:19.204280  6844 leader_election.cc:304] T 4275cf08e63345f993bce8664eada830 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
W20260709 13:22:19.205446  6844 consensus_peers.cc:597] T 34f36d59d88f40fe8a2805e604fc6c0a P cd75a17ab2604397adab03bb8b5fd75c -> Peer b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817): Couldn't send request to peer b7ab4784c7344b939bc36f639286f377. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.66:42817: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:22:19.205928  6844 leader_election.cc:336] T 9b3759de40694069b13c0f8bd40e5709 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817): Network error: Client connection negotiation failed: client connection to 127.5.126.66:42817: connect: Connection refused (error 111)
I20260709 13:22:19.206343  6844 leader_election.cc:304] T 9b3759de40694069b13c0f8bd40e5709 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
W20260709 13:22:19.207238  6844 leader_election.cc:336] T 20f6842e26174571996b8dea4151d4be P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817): Network error: Client connection negotiation failed: client connection to 127.5.126.66:42817: connect: Connection refused (error 111)
I20260709 13:22:19.207667  6844 leader_election.cc:304] T 20f6842e26174571996b8dea4151d4be P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:22:19.208492 14731 raft_consensus.cc:2749] T 4275cf08e63345f993bce8664eada830 P cd75a17ab2604397adab03bb8b5fd75c [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 13:22:19.208637  6844 leader_election.cc:336] T 2c240553ce044eedb41541d72b9475d7 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817): Network error: Client connection negotiation failed: client connection to 127.5.126.66:42817: connect: Connection refused (error 111)
I20260709 13:22:19.209142  6844 leader_election.cc:304] T 2c240553ce044eedb41541d72b9475d7 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:22:19.209460 14731 raft_consensus.cc:2749] T 9b3759de40694069b13c0f8bd40e5709 P cd75a17ab2604397adab03bb8b5fd75c [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 13:22:19.210035  6844 leader_election.cc:336] T e77e330a82df4b43a745d57a68f6f057 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817): Network error: Client connection negotiation failed: client connection to 127.5.126.66:42817: connect: Connection refused (error 111)
I20260709 13:22:19.210315 14731 raft_consensus.cc:2749] T 20f6842e26174571996b8dea4151d4be P cd75a17ab2604397adab03bb8b5fd75c [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:22:19.210422  6844 leader_election.cc:304] T e77e330a82df4b43a745d57a68f6f057 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:22:19.211237 14731 raft_consensus.cc:2749] T 2c240553ce044eedb41541d72b9475d7 P cd75a17ab2604397adab03bb8b5fd75c [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:22:19.211540 14733 raft_consensus.cc:2749] T e77e330a82df4b43a745d57a68f6f057 P cd75a17ab2604397adab03bb8b5fd75c [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 13:22:19.215555  6844 consensus_peers.cc:597] T 1bf4668eeb70467fb3dc5a0289233b3c P cd75a17ab2604397adab03bb8b5fd75c -> Peer b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817): Couldn't send request to peer b7ab4784c7344b939bc36f639286f377. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.66:42817: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:22:19.219116  6844 leader_election.cc:336] T f5be3a11b23d4ea9b08300a2789821c7 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817): Network error: Client connection negotiation failed: client connection to 127.5.126.66:42817: connect: Connection refused (error 111)
W20260709 13:22:19.222388  6844 leader_election.cc:336] T f5be3a11b23d4ea9b08300a2789821c7 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111)
I20260709 13:22:19.222790  6844 leader_election.cc:304] T f5be3a11b23d4ea9b08300a2789821c7 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:22:19.223889 14730 raft_consensus.cc:2749] T f5be3a11b23d4ea9b08300a2789821c7 P cd75a17ab2604397adab03bb8b5fd75c [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:22:19.237058 14730 raft_consensus.cc:493] T 30e88460611e47b2ba16a46a30b5f416 P cd75a17ab2604397adab03bb8b5fd75c [term 16 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:22:19.237727 14730 raft_consensus.cc:515] T 30e88460611e47b2ba16a46a30b5f416 P cd75a17ab2604397adab03bb8b5fd75c [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:22:19.239916 14730 leader_election.cc:290] T 30e88460611e47b2ba16a46a30b5f416 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
W20260709 13:22:19.242245  7466 consensus_peers.cc:597] T 3fa34c08b205435dba97346991aa1f92 P 7ba59cc884714e8aa5f3f0ecaed84cbb -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111). This is attempt 71: this message will repeat every 5th retry.
W20260709 13:22:19.246978  6844 leader_election.cc:336] T 30e88460611e47b2ba16a46a30b5f416 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111)
I20260709 13:22:19.247673  5625 ts_tablet_manager.cc:1507] Shutting down tablet manager...
W20260709 13:22:19.247900  6844 leader_election.cc:336] T 30e88460611e47b2ba16a46a30b5f416 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817): Network error: Client connection negotiation failed: client connection to 127.5.126.66:42817: connect: Connection refused (error 111)
I20260709 13:22:19.248473  6844 leader_election.cc:304] T 30e88460611e47b2ba16a46a30b5f416 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:22:19.248857  5625 tablet_replica.cc:333] T 4275cf08e63345f993bce8664eada830 P cd75a17ab2604397adab03bb8b5fd75c: stopping tablet replica
I20260709 13:22:19.249476 14730 raft_consensus.cc:2749] T 30e88460611e47b2ba16a46a30b5f416 P cd75a17ab2604397adab03bb8b5fd75c [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:22:19.250873  5625 raft_consensus.cc:2243] T 4275cf08e63345f993bce8664eada830 P cd75a17ab2604397adab03bb8b5fd75c [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:19.251681  5625 raft_consensus.cc:2272] T 4275cf08e63345f993bce8664eada830 P cd75a17ab2604397adab03bb8b5fd75c [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:19.254290  5625 tablet_replica.cc:333] T ab432e62819d499eaaf3dd55481dd930 P cd75a17ab2604397adab03bb8b5fd75c: stopping tablet replica
I20260709 13:22:19.255038  5625 raft_consensus.cc:2243] T ab432e62819d499eaaf3dd55481dd930 P cd75a17ab2604397adab03bb8b5fd75c [term 25 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:19.255828  5625 raft_consensus.cc:2272] T ab432e62819d499eaaf3dd55481dd930 P cd75a17ab2604397adab03bb8b5fd75c [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:19.258334  5625 tablet_replica.cc:333] T 427c124d773f483294511e80fe340075 P cd75a17ab2604397adab03bb8b5fd75c: stopping tablet replica
I20260709 13:22:19.258970  5625 raft_consensus.cc:2243] T 427c124d773f483294511e80fe340075 P cd75a17ab2604397adab03bb8b5fd75c [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:19.259764  5625 raft_consensus.cc:2272] T 427c124d773f483294511e80fe340075 P cd75a17ab2604397adab03bb8b5fd75c [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:19.262071  5625 tablet_replica.cc:333] T 22ccee1b570c4ad3a57bd7aec085b1b4 P cd75a17ab2604397adab03bb8b5fd75c: stopping tablet replica
I20260709 13:22:19.262777  5625 raft_consensus.cc:2243] T 22ccee1b570c4ad3a57bd7aec085b1b4 P cd75a17ab2604397adab03bb8b5fd75c [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:19.263288  5625 raft_consensus.cc:2272] T 22ccee1b570c4ad3a57bd7aec085b1b4 P cd75a17ab2604397adab03bb8b5fd75c [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:19.265827  5625 tablet_replica.cc:333] T b56bf91d90824c959e21e0cee5ba1816 P cd75a17ab2604397adab03bb8b5fd75c: stopping tablet replica
I20260709 13:22:19.266515  5625 raft_consensus.cc:2243] T b56bf91d90824c959e21e0cee5ba1816 P cd75a17ab2604397adab03bb8b5fd75c [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:19.267117  5625 raft_consensus.cc:2272] T b56bf91d90824c959e21e0cee5ba1816 P cd75a17ab2604397adab03bb8b5fd75c [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:19.269903  5625 tablet_replica.cc:333] T d8cee0accdb8499c86d4414b72565a38 P cd75a17ab2604397adab03bb8b5fd75c: stopping tablet replica
I20260709 13:22:19.269833 14733 raft_consensus.cc:493] T d8292e16e5654be6bc408560cf256aaa P cd75a17ab2604397adab03bb8b5fd75c [term 22 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:22:19.270498 14733 raft_consensus.cc:515] T d8292e16e5654be6bc408560cf256aaa P cd75a17ab2604397adab03bb8b5fd75c [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:22:19.271135  5625 raft_consensus.cc:2243] T d8cee0accdb8499c86d4414b72565a38 P cd75a17ab2604397adab03bb8b5fd75c [term 24 LEADER]: Raft consensus shutting down.
I20260709 13:22:19.272831  5625 raft_consensus.cc:2272] T d8cee0accdb8499c86d4414b72565a38 P cd75a17ab2604397adab03bb8b5fd75c [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:19.273120 14733 leader_election.cc:290] T d8292e16e5654be6bc408560cf256aaa P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:22:19.275934  5625 tablet_replica.cc:333] T 7c44c4849aa54f2b94d1f1bef9ed546f P cd75a17ab2604397adab03bb8b5fd75c: stopping tablet replica
I20260709 13:22:19.277163  5625 raft_consensus.cc:2243] T 7c44c4849aa54f2b94d1f1bef9ed546f P cd75a17ab2604397adab03bb8b5fd75c [term 24 LEADER]: Raft consensus shutting down.
I20260709 13:22:19.278849  5625 raft_consensus.cc:2272] T 7c44c4849aa54f2b94d1f1bef9ed546f P cd75a17ab2604397adab03bb8b5fd75c [term 24 FOLLOWER]: Raft consensus is shut down!
W20260709 13:22:19.280362  6844 leader_election.cc:336] T d8292e16e5654be6bc408560cf256aaa P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817): Network error: Client connection negotiation failed: client connection to 127.5.126.66:42817: connect: Connection refused (error 111)
W20260709 13:22:19.281546  6844 leader_election.cc:336] T d8292e16e5654be6bc408560cf256aaa P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111)
I20260709 13:22:19.282059  5625 tablet_replica.cc:333] T 3411566abe2d4c9bb4b2adfdd05e6f17 P cd75a17ab2604397adab03bb8b5fd75c: stopping tablet replica
I20260709 13:22:19.281971  6844 leader_election.cc:304] T d8292e16e5654be6bc408560cf256aaa P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:22:19.283084  5625 raft_consensus.cc:2243] T 3411566abe2d4c9bb4b2adfdd05e6f17 P cd75a17ab2604397adab03bb8b5fd75c [term 21 LEADER]: Raft consensus shutting down.
I20260709 13:22:19.284693  5625 raft_consensus.cc:2272] T 3411566abe2d4c9bb4b2adfdd05e6f17 P cd75a17ab2604397adab03bb8b5fd75c [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:19.286033 14730 raft_consensus.cc:2749] T d8292e16e5654be6bc408560cf256aaa P cd75a17ab2604397adab03bb8b5fd75c [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:22:19.288332  5625 tablet_replica.cc:333] T 713b5728a197487c9300b310ab94e5a3 P cd75a17ab2604397adab03bb8b5fd75c: stopping tablet replica
I20260709 13:22:19.289407  5625 raft_consensus.cc:2243] T 713b5728a197487c9300b310ab94e5a3 P cd75a17ab2604397adab03bb8b5fd75c [term 18 LEADER]: Raft consensus shutting down.
I20260709 13:22:19.290771  5625 raft_consensus.cc:2272] T 713b5728a197487c9300b310ab94e5a3 P cd75a17ab2604397adab03bb8b5fd75c [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:19.293617  5625 tablet_replica.cc:333] T de3186201e1a40d0b335eeb8b4e256e0 P cd75a17ab2604397adab03bb8b5fd75c: stopping tablet replica
I20260709 13:22:19.294474  5625 raft_consensus.cc:2243] T de3186201e1a40d0b335eeb8b4e256e0 P cd75a17ab2604397adab03bb8b5fd75c [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:19.295169  5625 raft_consensus.cc:2272] T de3186201e1a40d0b335eeb8b4e256e0 P cd75a17ab2604397adab03bb8b5fd75c [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:19.297842  5625 tablet_replica.cc:333] T d8292e16e5654be6bc408560cf256aaa P cd75a17ab2604397adab03bb8b5fd75c: stopping tablet replica
I20260709 13:22:19.298673  5625 raft_consensus.cc:2243] T d8292e16e5654be6bc408560cf256aaa P cd75a17ab2604397adab03bb8b5fd75c [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:19.299711  5625 raft_consensus.cc:2272] T d8292e16e5654be6bc408560cf256aaa P cd75a17ab2604397adab03bb8b5fd75c [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:19.302742  5625 tablet_replica.cc:333] T 24ee15416e3145beaa1b8183453729a3 P cd75a17ab2604397adab03bb8b5fd75c: stopping tablet replica
I20260709 13:22:19.303565  5625 raft_consensus.cc:2243] T 24ee15416e3145beaa1b8183453729a3 P cd75a17ab2604397adab03bb8b5fd75c [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:19.304268  5625 raft_consensus.cc:2272] T 24ee15416e3145beaa1b8183453729a3 P cd75a17ab2604397adab03bb8b5fd75c [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:19.306840  5625 tablet_replica.cc:333] T a1704639a875409b9959353527b3fd68 P cd75a17ab2604397adab03bb8b5fd75c: stopping tablet replica
I20260709 13:22:19.307663  5625 raft_consensus.cc:2243] T a1704639a875409b9959353527b3fd68 P cd75a17ab2604397adab03bb8b5fd75c [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:19.308789  5625 raft_consensus.cc:2272] T a1704639a875409b9959353527b3fd68 P cd75a17ab2604397adab03bb8b5fd75c [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:19.311671  5625 tablet_replica.cc:333] T fe20b4b48823486ca3b9c648db6ce8aa P cd75a17ab2604397adab03bb8b5fd75c: stopping tablet replica
I20260709 13:22:19.312597  5625 raft_consensus.cc:2243] T fe20b4b48823486ca3b9c648db6ce8aa P cd75a17ab2604397adab03bb8b5fd75c [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:19.313231  5625 raft_consensus.cc:2272] T fe20b4b48823486ca3b9c648db6ce8aa P cd75a17ab2604397adab03bb8b5fd75c [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:19.315995  5625 tablet_replica.cc:333] T f5be3a11b23d4ea9b08300a2789821c7 P cd75a17ab2604397adab03bb8b5fd75c: stopping tablet replica
I20260709 13:22:19.316818  5625 raft_consensus.cc:2243] T f5be3a11b23d4ea9b08300a2789821c7 P cd75a17ab2604397adab03bb8b5fd75c [term 21 FOLLOWER]: Raft consensus shutting down.
W20260709 13:22:19.317540  7468 consensus_peers.cc:597] T 24ee15416e3145beaa1b8183453729a3 P 7ba59cc884714e8aa5f3f0ecaed84cbb -> Peer cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931): Couldn't send request to peer cd75a17ab2604397adab03bb8b5fd75c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:22:19.317961  5625 raft_consensus.cc:2272] T f5be3a11b23d4ea9b08300a2789821c7 P cd75a17ab2604397adab03bb8b5fd75c [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:19.321031  5625 tablet_replica.cc:333] T 9b3759de40694069b13c0f8bd40e5709 P cd75a17ab2604397adab03bb8b5fd75c: stopping tablet replica
I20260709 13:22:19.321849  5625 raft_consensus.cc:2243] T 9b3759de40694069b13c0f8bd40e5709 P cd75a17ab2604397adab03bb8b5fd75c [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:19.322494  5625 raft_consensus.cc:2272] T 9b3759de40694069b13c0f8bd40e5709 P cd75a17ab2604397adab03bb8b5fd75c [term 20 FOLLOWER]: Raft consensus is shut down!
W20260709 13:22:19.325150  6844 consensus_peers.cc:597] T a3022224cc81473690653a83d4e99470 P cd75a17ab2604397adab03bb8b5fd75c -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
I20260709 13:22:19.325436  5625 tablet_replica.cc:333] T c4db81d9d329422bb3b4160ca4ac2d1d P cd75a17ab2604397adab03bb8b5fd75c: stopping tablet replica
W20260709 13:22:19.326360  7466 consensus_peers.cc:597] T 1528ab62b6fe4e3099d08f141afee116 P 7ba59cc884714e8aa5f3f0ecaed84cbb -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
I20260709 13:22:19.326476  5625 raft_consensus.cc:2243] T c4db81d9d329422bb3b4160ca4ac2d1d P cd75a17ab2604397adab03bb8b5fd75c [term 21 LEADER]: Raft consensus shutting down.
I20260709 13:22:19.327755  5625 raft_consensus.cc:2272] T c4db81d9d329422bb3b4160ca4ac2d1d P cd75a17ab2604397adab03bb8b5fd75c [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:19.330431  5625 tablet_replica.cc:333] T bd6869f07b5a4885a0b99fbe60c3b175 P cd75a17ab2604397adab03bb8b5fd75c: stopping tablet replica
I20260709 13:22:19.331239  5625 raft_consensus.cc:2243] T bd6869f07b5a4885a0b99fbe60c3b175 P cd75a17ab2604397adab03bb8b5fd75c [term 27 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:19.331787  5625 raft_consensus.cc:2272] T bd6869f07b5a4885a0b99fbe60c3b175 P cd75a17ab2604397adab03bb8b5fd75c [term 27 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:19.334303  5625 tablet_replica.cc:333] T 7a734b5ab7834e05a8c422208acc58b1 P cd75a17ab2604397adab03bb8b5fd75c: stopping tablet replica
I20260709 13:22:19.334817 14730 raft_consensus.cc:493] T 7c37d41cd9164c15a6826ca62a851a69 P cd75a17ab2604397adab03bb8b5fd75c [term 23 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:22:19.334997  5625 raft_consensus.cc:2243] T 7a734b5ab7834e05a8c422208acc58b1 P cd75a17ab2604397adab03bb8b5fd75c [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:19.335466 14730 raft_consensus.cc:515] T 7c37d41cd9164c15a6826ca62a851a69 P cd75a17ab2604397adab03bb8b5fd75c [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } }
I20260709 13:22:19.336340  5625 raft_consensus.cc:2272] T 7a734b5ab7834e05a8c422208acc58b1 P cd75a17ab2604397adab03bb8b5fd75c [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:19.337816 14730 leader_election.cc:290] T 7c37d41cd9164c15a6826ca62a851a69 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817)
I20260709 13:22:19.339419  5625 tablet_replica.cc:333] T 34f36d59d88f40fe8a2805e604fc6c0a P cd75a17ab2604397adab03bb8b5fd75c: stopping tablet replica
I20260709 13:22:19.340396  5625 raft_consensus.cc:2243] T 34f36d59d88f40fe8a2805e604fc6c0a P cd75a17ab2604397adab03bb8b5fd75c [term 21 LEADER]: Raft consensus shutting down.
I20260709 13:22:19.341657  5625 raft_consensus.cc:2272] T 34f36d59d88f40fe8a2805e604fc6c0a P cd75a17ab2604397adab03bb8b5fd75c [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:19.344518  5625 tablet_replica.cc:333] T d33d5ee8ef6f415593d8df52063161ad P cd75a17ab2604397adab03bb8b5fd75c: stopping tablet replica
W20260709 13:22:19.344424  6844 leader_election.cc:336] T 7c37d41cd9164c15a6826ca62a851a69 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111)
W20260709 13:22:19.345293  6844 consensus_peers.cc:597] T 3a485a995abc4807b6e511e45419f737 P cd75a17ab2604397adab03bb8b5fd75c -> Peer b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817): Couldn't send request to peer b7ab4784c7344b939bc36f639286f377. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.66:42817: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:22:19.345360  5625 raft_consensus.cc:2243] T d33d5ee8ef6f415593d8df52063161ad P cd75a17ab2604397adab03bb8b5fd75c [term 21 FOLLOWER]: Raft consensus shutting down.
W20260709 13:22:19.345860  6844 leader_election.cc:336] T 7c37d41cd9164c15a6826ca62a851a69 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817): Network error: Client connection negotiation failed: client connection to 127.5.126.66:42817: connect: Connection refused (error 111)
I20260709 13:22:19.346316  5625 raft_consensus.cc:2272] T d33d5ee8ef6f415593d8df52063161ad P cd75a17ab2604397adab03bb8b5fd75c [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:19.346282  6844 leader_election.cc:304] T 7c37d41cd9164c15a6826ca62a851a69 P cd75a17ab2604397adab03bb8b5fd75c [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd75a17ab2604397adab03bb8b5fd75c; no voters: b7ab4784c7344b939bc36f639286f377, ccd8a4c3bfe3413cb2ae219b09aea832
I20260709 13:22:19.347203 14730 raft_consensus.cc:2749] T 7c37d41cd9164c15a6826ca62a851a69 P cd75a17ab2604397adab03bb8b5fd75c [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:22:19.349129  5625 tablet_replica.cc:333] T 7c37d41cd9164c15a6826ca62a851a69 P cd75a17ab2604397adab03bb8b5fd75c: stopping tablet replica
I20260709 13:22:19.349807  5625 raft_consensus.cc:2243] T 7c37d41cd9164c15a6826ca62a851a69 P cd75a17ab2604397adab03bb8b5fd75c [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:19.350679  5625 raft_consensus.cc:2272] T 7c37d41cd9164c15a6826ca62a851a69 P cd75a17ab2604397adab03bb8b5fd75c [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:19.352936  5625 tablet_replica.cc:333] T f03d0dbf16864ca4bc1bb5e4c0334c0f P cd75a17ab2604397adab03bb8b5fd75c: stopping tablet replica
I20260709 13:22:19.353716  5625 raft_consensus.cc:2243] T f03d0dbf16864ca4bc1bb5e4c0334c0f P cd75a17ab2604397adab03bb8b5fd75c [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:19.354552  5625 raft_consensus.cc:2272] T f03d0dbf16864ca4bc1bb5e4c0334c0f P cd75a17ab2604397adab03bb8b5fd75c [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:19.358737  5625 tablet_replica.cc:333] T 1bf4668eeb70467fb3dc5a0289233b3c P cd75a17ab2604397adab03bb8b5fd75c: stopping tablet replica
W20260709 13:22:19.359021  7468 consensus_peers.cc:597] T 7a734b5ab7834e05a8c422208acc58b1 P 7ba59cc884714e8aa5f3f0ecaed84cbb -> Peer cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931): Couldn't send request to peer cd75a17ab2604397adab03bb8b5fd75c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:22:19.359611  5625 raft_consensus.cc:2243] T 1bf4668eeb70467fb3dc5a0289233b3c P cd75a17ab2604397adab03bb8b5fd75c [term 23 LEADER]: Raft consensus shutting down.
I20260709 13:22:19.361346  5625 raft_consensus.cc:2272] T 1bf4668eeb70467fb3dc5a0289233b3c P cd75a17ab2604397adab03bb8b5fd75c [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:19.364450  5625 tablet_replica.cc:333] T 95a75bfe094d4bdc963aba3f08dfcd25 P cd75a17ab2604397adab03bb8b5fd75c: stopping tablet replica
I20260709 13:22:19.365285  5625 raft_consensus.cc:2243] T 95a75bfe094d4bdc963aba3f08dfcd25 P cd75a17ab2604397adab03bb8b5fd75c [term 18 LEADER]: Raft consensus shutting down.
I20260709 13:22:19.366612  5625 raft_consensus.cc:2272] T 95a75bfe094d4bdc963aba3f08dfcd25 P cd75a17ab2604397adab03bb8b5fd75c [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:19.369820  5625 tablet_replica.cc:333] T 9e326172347f45e99a0d482b5d8ef768 P cd75a17ab2604397adab03bb8b5fd75c: stopping tablet replica
I20260709 13:22:19.370630  5625 raft_consensus.cc:2243] T 9e326172347f45e99a0d482b5d8ef768 P cd75a17ab2604397adab03bb8b5fd75c [term 18 LEADER]: Raft consensus shutting down.
I20260709 13:22:19.371932  5625 raft_consensus.cc:2272] T 9e326172347f45e99a0d482b5d8ef768 P cd75a17ab2604397adab03bb8b5fd75c [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:19.377094  5625 tablet_replica.cc:333] T 8c7f33e544204fbaac4078e3e83bbf4e P cd75a17ab2604397adab03bb8b5fd75c: stopping tablet replica
I20260709 13:22:19.377942  5625 raft_consensus.cc:2243] T 8c7f33e544204fbaac4078e3e83bbf4e P cd75a17ab2604397adab03bb8b5fd75c [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:19.378720  5625 raft_consensus.cc:2272] T 8c7f33e544204fbaac4078e3e83bbf4e P cd75a17ab2604397adab03bb8b5fd75c [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:19.381687  5625 tablet_replica.cc:333] T 4b8cacb381b746da8d0049b0a83b41dd P cd75a17ab2604397adab03bb8b5fd75c: stopping tablet replica
I20260709 13:22:19.382223  5625 raft_consensus.cc:2243] T 4b8cacb381b746da8d0049b0a83b41dd P cd75a17ab2604397adab03bb8b5fd75c [term 22 LEADER]: Raft consensus shutting down.
I20260709 13:22:19.383337  5625 raft_consensus.cc:2272] T 4b8cacb381b746da8d0049b0a83b41dd P cd75a17ab2604397adab03bb8b5fd75c [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:19.386428  5625 tablet_replica.cc:333] T bb3d8792045a4583ae2e965b1350a5b4 P cd75a17ab2604397adab03bb8b5fd75c: stopping tablet replica
I20260709 13:22:19.387316  5625 raft_consensus.cc:2243] T bb3d8792045a4583ae2e965b1350a5b4 P cd75a17ab2604397adab03bb8b5fd75c [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:19.388918  5625 raft_consensus.cc:2272] T bb3d8792045a4583ae2e965b1350a5b4 P cd75a17ab2604397adab03bb8b5fd75c [term 20 FOLLOWER]: Raft consensus is shut down!
W20260709 13:22:19.388983  7468 consensus_peers.cc:597] T 7ba5dac66ab5497e9e336f2a3c28cda5 P 7ba59cc884714e8aa5f3f0ecaed84cbb -> Peer cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931): Couldn't send request to peer cd75a17ab2604397adab03bb8b5fd75c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:22:19.389520  7466 consensus_peers.cc:597] T 17587d6730594da4a56fa13a353232a1 P 7ba59cc884714e8aa5f3f0ecaed84cbb -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111). This is attempt 71: this message will repeat every 5th retry.
I20260709 13:22:19.391280  5625 tablet_replica.cc:333] T 4f00a2e87e56452083b759f60d461ee3 P cd75a17ab2604397adab03bb8b5fd75c: stopping tablet replica
I20260709 13:22:19.391888  5625 raft_consensus.cc:2243] T 4f00a2e87e56452083b759f60d461ee3 P cd75a17ab2604397adab03bb8b5fd75c [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:19.392620  5625 raft_consensus.cc:2272] T 4f00a2e87e56452083b759f60d461ee3 P cd75a17ab2604397adab03bb8b5fd75c [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:19.394991  5625 tablet_replica.cc:333] T 3d65025eea89441290d85dd053810e31 P cd75a17ab2604397adab03bb8b5fd75c: stopping tablet replica
I20260709 13:22:19.395622  5625 raft_consensus.cc:2243] T 3d65025eea89441290d85dd053810e31 P cd75a17ab2604397adab03bb8b5fd75c [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:19.396400  5625 raft_consensus.cc:2272] T 3d65025eea89441290d85dd053810e31 P cd75a17ab2604397adab03bb8b5fd75c [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:19.398697  5625 tablet_replica.cc:333] T 44bde925b2e541b69890d70715b85176 P cd75a17ab2604397adab03bb8b5fd75c: stopping tablet replica
I20260709 13:22:19.399225  5625 raft_consensus.cc:2243] T 44bde925b2e541b69890d70715b85176 P cd75a17ab2604397adab03bb8b5fd75c [term 21 LEADER]: Raft consensus shutting down.
I20260709 13:22:19.400130  5625 raft_consensus.cc:2272] T 44bde925b2e541b69890d70715b85176 P cd75a17ab2604397adab03bb8b5fd75c [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:19.402647  5625 tablet_replica.cc:333] T 3fa34c08b205435dba97346991aa1f92 P cd75a17ab2604397adab03bb8b5fd75c: stopping tablet replica
I20260709 13:22:19.403218  5625 raft_consensus.cc:2243] T 3fa34c08b205435dba97346991aa1f92 P cd75a17ab2604397adab03bb8b5fd75c [term 27 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:19.404313  5625 raft_consensus.cc:2272] T 3fa34c08b205435dba97346991aa1f92 P cd75a17ab2604397adab03bb8b5fd75c [term 27 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:19.406570  5625 tablet_replica.cc:333] T 3a485a995abc4807b6e511e45419f737 P cd75a17ab2604397adab03bb8b5fd75c: stopping tablet replica
I20260709 13:22:19.407181  5625 raft_consensus.cc:2243] T 3a485a995abc4807b6e511e45419f737 P cd75a17ab2604397adab03bb8b5fd75c [term 18 LEADER]: Raft consensus shutting down.
I20260709 13:22:19.408560  5625 raft_consensus.cc:2272] T 3a485a995abc4807b6e511e45419f737 P cd75a17ab2604397adab03bb8b5fd75c [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:19.410665  5625 tablet_replica.cc:333] T f4b8bd455d5a47c18a1380839c6e0d61 P cd75a17ab2604397adab03bb8b5fd75c: stopping tablet replica
I20260709 13:22:19.411427  5625 raft_consensus.cc:2243] T f4b8bd455d5a47c18a1380839c6e0d61 P cd75a17ab2604397adab03bb8b5fd75c [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:19.412278  5625 raft_consensus.cc:2272] T f4b8bd455d5a47c18a1380839c6e0d61 P cd75a17ab2604397adab03bb8b5fd75c [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:19.415135  5625 tablet_replica.cc:333] T 30e88460611e47b2ba16a46a30b5f416 P cd75a17ab2604397adab03bb8b5fd75c: stopping tablet replica
I20260709 13:22:19.415908  5625 raft_consensus.cc:2243] T 30e88460611e47b2ba16a46a30b5f416 P cd75a17ab2604397adab03bb8b5fd75c [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:19.416899  5625 raft_consensus.cc:2272] T 30e88460611e47b2ba16a46a30b5f416 P cd75a17ab2604397adab03bb8b5fd75c [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:19.419297  5625 tablet_replica.cc:333] T 07a92dd554674067a83a9cb68c4773f2 P cd75a17ab2604397adab03bb8b5fd75c: stopping tablet replica
I20260709 13:22:19.421033  5625 raft_consensus.cc:2243] T 07a92dd554674067a83a9cb68c4773f2 P cd75a17ab2604397adab03bb8b5fd75c [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:19.421996  5625 raft_consensus.cc:2272] T 07a92dd554674067a83a9cb68c4773f2 P cd75a17ab2604397adab03bb8b5fd75c [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:19.424575  5625 tablet_replica.cc:333] T 2c240553ce044eedb41541d72b9475d7 P cd75a17ab2604397adab03bb8b5fd75c: stopping tablet replica
I20260709 13:22:19.425099  5625 raft_consensus.cc:2243] T 2c240553ce044eedb41541d72b9475d7 P cd75a17ab2604397adab03bb8b5fd75c [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:19.425823  5625 raft_consensus.cc:2272] T 2c240553ce044eedb41541d72b9475d7 P cd75a17ab2604397adab03bb8b5fd75c [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:19.428220  5625 tablet_replica.cc:333] T 90d42e216d9741e190bca19a781291fd P cd75a17ab2604397adab03bb8b5fd75c: stopping tablet replica
I20260709 13:22:19.428864  5625 raft_consensus.cc:2243] T 90d42e216d9741e190bca19a781291fd P cd75a17ab2604397adab03bb8b5fd75c [term 23 LEADER]: Raft consensus shutting down.
I20260709 13:22:19.429888  5625 raft_consensus.cc:2272] T 90d42e216d9741e190bca19a781291fd P cd75a17ab2604397adab03bb8b5fd75c [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:19.432461  5625 tablet_replica.cc:333] T bb7fa124c3bf4ef9ab65a407cb008441 P cd75a17ab2604397adab03bb8b5fd75c: stopping tablet replica
I20260709 13:22:19.433029  5625 raft_consensus.cc:2243] T bb7fa124c3bf4ef9ab65a407cb008441 P cd75a17ab2604397adab03bb8b5fd75c [term 19 LEADER]: Raft consensus shutting down.
I20260709 13:22:19.433948  5625 raft_consensus.cc:2272] T bb7fa124c3bf4ef9ab65a407cb008441 P cd75a17ab2604397adab03bb8b5fd75c [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:19.436498  5625 tablet_replica.cc:333] T 20f6842e26174571996b8dea4151d4be P cd75a17ab2604397adab03bb8b5fd75c: stopping tablet replica
I20260709 13:22:19.437417  5625 raft_consensus.cc:2243] T 20f6842e26174571996b8dea4151d4be P cd75a17ab2604397adab03bb8b5fd75c [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:19.438362  5625 raft_consensus.cc:2272] T 20f6842e26174571996b8dea4151d4be P cd75a17ab2604397adab03bb8b5fd75c [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:19.441170  5625 tablet_replica.cc:333] T f3f9c2e2bf644115957398fe4c9459db P cd75a17ab2604397adab03bb8b5fd75c: stopping tablet replica
I20260709 13:22:19.441880  5625 raft_consensus.cc:2243] T f3f9c2e2bf644115957398fe4c9459db P cd75a17ab2604397adab03bb8b5fd75c [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:19.442826  5625 raft_consensus.cc:2272] T f3f9c2e2bf644115957398fe4c9459db P cd75a17ab2604397adab03bb8b5fd75c [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:19.445802  5625 tablet_replica.cc:333] T 711ef6523deb4cbe8ef2ba61e1c21c98 P cd75a17ab2604397adab03bb8b5fd75c: stopping tablet replica
I20260709 13:22:19.446375  5625 raft_consensus.cc:2243] T 711ef6523deb4cbe8ef2ba61e1c21c98 P cd75a17ab2604397adab03bb8b5fd75c [term 22 LEADER]: Raft consensus shutting down.
I20260709 13:22:19.447630  5625 raft_consensus.cc:2272] T 711ef6523deb4cbe8ef2ba61e1c21c98 P cd75a17ab2604397adab03bb8b5fd75c [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:19.450227  5625 tablet_replica.cc:333] T 4d9def8b32fd443aa94ab1420b06837b P cd75a17ab2604397adab03bb8b5fd75c: stopping tablet replica
I20260709 13:22:19.450851  5625 raft_consensus.cc:2243] T 4d9def8b32fd443aa94ab1420b06837b P cd75a17ab2604397adab03bb8b5fd75c [term 24 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:19.451408  5625 raft_consensus.cc:2272] T 4d9def8b32fd443aa94ab1420b06837b P cd75a17ab2604397adab03bb8b5fd75c [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:19.454185  5625 tablet_replica.cc:333] T dbdf895bba214ff68685a24fd17dfb5d P cd75a17ab2604397adab03bb8b5fd75c: stopping tablet replica
I20260709 13:22:19.454759  5625 raft_consensus.cc:2243] T dbdf895bba214ff68685a24fd17dfb5d P cd75a17ab2604397adab03bb8b5fd75c [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:19.455389  5625 raft_consensus.cc:2272] T dbdf895bba214ff68685a24fd17dfb5d P cd75a17ab2604397adab03bb8b5fd75c [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:19.458051  5625 tablet_replica.cc:333] T f09c2a98de1a4decabd0ff900dd44caa P cd75a17ab2604397adab03bb8b5fd75c: stopping tablet replica
W20260709 13:22:19.458235  7468 consensus_peers.cc:597] T 427c124d773f483294511e80fe340075 P 7ba59cc884714e8aa5f3f0ecaed84cbb -> Peer cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931): Couldn't send request to peer cd75a17ab2604397adab03bb8b5fd75c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:22:19.458850  5625 raft_consensus.cc:2243] T f09c2a98de1a4decabd0ff900dd44caa P cd75a17ab2604397adab03bb8b5fd75c [term 24 FOLLOWER]: Raft consensus shutting down.
W20260709 13:22:19.460390  7468 consensus_peers.cc:597] T bb3d8792045a4583ae2e965b1350a5b4 P 7ba59cc884714e8aa5f3f0ecaed84cbb -> Peer cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931): Couldn't send request to peer cd75a17ab2604397adab03bb8b5fd75c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:22:19.460917  5625 raft_consensus.cc:2272] T f09c2a98de1a4decabd0ff900dd44caa P cd75a17ab2604397adab03bb8b5fd75c [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:19.463915  5625 tablet_replica.cc:333] T e77e330a82df4b43a745d57a68f6f057 P cd75a17ab2604397adab03bb8b5fd75c: stopping tablet replica
I20260709 13:22:19.464718  5625 raft_consensus.cc:2243] T e77e330a82df4b43a745d57a68f6f057 P cd75a17ab2604397adab03bb8b5fd75c [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:19.465670  5625 raft_consensus.cc:2272] T e77e330a82df4b43a745d57a68f6f057 P cd75a17ab2604397adab03bb8b5fd75c [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:19.467972  5625 tablet_replica.cc:333] T 7ba5dac66ab5497e9e336f2a3c28cda5 P cd75a17ab2604397adab03bb8b5fd75c: stopping tablet replica
W20260709 13:22:19.468657  6844 consensus_peers.cc:597] T a3022224cc81473690653a83d4e99470 P cd75a17ab2604397adab03bb8b5fd75c -> Peer b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817): Couldn't send request to peer b7ab4784c7344b939bc36f639286f377. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.66:42817: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:22:19.468878  5625 raft_consensus.cc:2243] T 7ba5dac66ab5497e9e336f2a3c28cda5 P cd75a17ab2604397adab03bb8b5fd75c [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:19.469616  5625 raft_consensus.cc:2272] T 7ba5dac66ab5497e9e336f2a3c28cda5 P cd75a17ab2604397adab03bb8b5fd75c [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:19.472728  5625 tablet_replica.cc:333] T e31b9971c15848dea59d4d4130141d9e P cd75a17ab2604397adab03bb8b5fd75c: stopping tablet replica
I20260709 13:22:19.473387  5625 raft_consensus.cc:2243] T e31b9971c15848dea59d4d4130141d9e P cd75a17ab2604397adab03bb8b5fd75c [term 18 LEADER]: Raft consensus shutting down.
W20260709 13:22:19.474241  7468 consensus_peers.cc:597] T fe20b4b48823486ca3b9c648db6ce8aa P 7ba59cc884714e8aa5f3f0ecaed84cbb -> Peer cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931): Couldn't send request to peer cd75a17ab2604397adab03bb8b5fd75c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:22:19.474579  5625 raft_consensus.cc:2272] T e31b9971c15848dea59d4d4130141d9e P cd75a17ab2604397adab03bb8b5fd75c [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:19.478003  5625 tablet_replica.cc:333] T a3022224cc81473690653a83d4e99470 P cd75a17ab2604397adab03bb8b5fd75c: stopping tablet replica
I20260709 13:22:19.478616  5625 raft_consensus.cc:2243] T a3022224cc81473690653a83d4e99470 P cd75a17ab2604397adab03bb8b5fd75c [term 22 LEADER]: Raft consensus shutting down.
I20260709 13:22:19.480173  5625 raft_consensus.cc:2272] T a3022224cc81473690653a83d4e99470 P cd75a17ab2604397adab03bb8b5fd75c [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:19.482448  5625 tablet_replica.cc:333] T 853ac0a8cbd64ce99457f170216d4d0f P cd75a17ab2604397adab03bb8b5fd75c: stopping tablet replica
I20260709 13:22:19.483000  5625 raft_consensus.cc:2243] T 853ac0a8cbd64ce99457f170216d4d0f P cd75a17ab2604397adab03bb8b5fd75c [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:19.483484  5625 raft_consensus.cc:2272] T 853ac0a8cbd64ce99457f170216d4d0f P cd75a17ab2604397adab03bb8b5fd75c [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:19.486158  5625 tablet_replica.cc:333] T ce4f062dcd314d43a63ca74067cb5ee3 P cd75a17ab2604397adab03bb8b5fd75c: stopping tablet replica
I20260709 13:22:19.486842  5625 raft_consensus.cc:2243] T ce4f062dcd314d43a63ca74067cb5ee3 P cd75a17ab2604397adab03bb8b5fd75c [term 16 LEADER]: Raft consensus shutting down.
I20260709 13:22:19.488008  5625 raft_consensus.cc:2272] T ce4f062dcd314d43a63ca74067cb5ee3 P cd75a17ab2604397adab03bb8b5fd75c [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:19.490656  5625 tablet_replica.cc:333] T 7887766dc6784fcaa42b35c05fea7a99 P cd75a17ab2604397adab03bb8b5fd75c: stopping tablet replica
I20260709 13:22:19.491153  5625 raft_consensus.cc:2243] T 7887766dc6784fcaa42b35c05fea7a99 P cd75a17ab2604397adab03bb8b5fd75c [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:19.491694  5625 raft_consensus.cc:2272] T 7887766dc6784fcaa42b35c05fea7a99 P cd75a17ab2604397adab03bb8b5fd75c [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:19.493961  5625 tablet_replica.cc:333] T f58dc08b12a2494bb9a1372837970ca2 P cd75a17ab2604397adab03bb8b5fd75c: stopping tablet replica
I20260709 13:22:19.494508  5625 raft_consensus.cc:2243] T f58dc08b12a2494bb9a1372837970ca2 P cd75a17ab2604397adab03bb8b5fd75c [term 21 LEADER]: Raft consensus shutting down.
I20260709 13:22:19.495522  5625 raft_consensus.cc:2272] T f58dc08b12a2494bb9a1372837970ca2 P cd75a17ab2604397adab03bb8b5fd75c [term 21 FOLLOWER]: Raft consensus is shut down!
W20260709 13:22:19.505373  7468 consensus_peers.cc:597] T 4f00a2e87e56452083b759f60d461ee3 P 7ba59cc884714e8aa5f3f0ecaed84cbb -> Peer cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931): Couldn't send request to peer cd75a17ab2604397adab03bb8b5fd75c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:22:19.519445  6614 catalog_manager.cc:4755] TS ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 7a734b5ab7834e05a8c422208acc58b1: Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111)
W20260709 13:22:19.536818  7468 consensus_peers.cc:597] T 3fa34c08b205435dba97346991aa1f92 P 7ba59cc884714e8aa5f3f0ecaed84cbb -> Peer cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931): Couldn't send request to peer cd75a17ab2604397adab03bb8b5fd75c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:22:19.856534  7524 debug-util.cc:398] Leaking SignalData structure 0x7b080018dce0 after lost signal to thread 5628
W20260709 13:22:19.863770  7524 debug-util.cc:398] Leaking SignalData structure 0x7b08002b8a20 after lost signal to thread 6664
W20260709 13:22:19.868409  7524 debug-util.cc:398] Leaking SignalData structure 0x7b0800289040 after lost signal to thread 6905
W20260709 13:22:19.871217  7524 debug-util.cc:398] Leaking SignalData structure 0x7b08002f9520 after lost signal to thread 7527
W20260709 13:22:19.875226  7466 consensus_peers.cc:597] T be1a92657f494cac8dd227d152f50151 P 7ba59cc884714e8aa5f3f0ecaed84cbb -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111). This is attempt 71: this message will repeat every 5th retry.
W20260709 13:22:19.998327  7466 consensus_peers.cc:597] T fe20b4b48823486ca3b9c648db6ce8aa P 7ba59cc884714e8aa5f3f0ecaed84cbb -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
W20260709 13:22:20.353168  7466 consensus_peers.cc:597] T 7a734b5ab7834e05a8c422208acc58b1 P 7ba59cc884714e8aa5f3f0ecaed84cbb -> Peer b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817): Couldn't send request to peer b7ab4784c7344b939bc36f639286f377. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.66:42817: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 13:22:20.438973 14732 raft_consensus.cc:493] T 3a485a995abc4807b6e511e45419f737 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 18 FOLLOWER]: Starting pre-election (detected failure of leader cd75a17ab2604397adab03bb8b5fd75c)
I20260709 13:22:20.441788 14732 raft_consensus.cc:515] T 3a485a995abc4807b6e511e45419f737 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:22:20.448740 14743 raft_consensus.cc:493] T d8cee0accdb8499c86d4414b72565a38 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 24 FOLLOWER]: Starting pre-election (detected failure of leader cd75a17ab2604397adab03bb8b5fd75c)
I20260709 13:22:20.449597 14743 raft_consensus.cc:515] T d8cee0accdb8499c86d4414b72565a38 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:22:20.453068 14743 leader_election.cc:290] T d8cee0accdb8499c86d4414b72565a38 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:22:20.446471 14732 leader_election.cc:290] T 3a485a995abc4807b6e511e45419f737 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
W20260709 13:22:20.461934  7468 leader_election.cc:336] T 3a485a995abc4807b6e511e45419f737 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931): Network error: Client connection negotiation failed: client connection to 127.5.126.67:42931: connect: Connection refused (error 111)
W20260709 13:22:20.462749  7468 leader_election.cc:336] T d8cee0accdb8499c86d4414b72565a38 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931): Network error: Client connection negotiation failed: client connection to 127.5.126.67:42931: connect: Connection refused (error 111)
W20260709 13:22:20.479810  7466 leader_election.cc:336] T 3a485a995abc4807b6e511e45419f737 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817): Network error: Client connection negotiation failed: client connection to 127.5.126.66:42817: connect: Connection refused (error 111)
I20260709 13:22:20.480414  7466 leader_election.cc:304] T 3a485a995abc4807b6e511e45419f737 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:22:20.481325 14732 raft_consensus.cc:2749] T 3a485a995abc4807b6e511e45419f737 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:22:20.482767  7466 leader_election.cc:336] T d8cee0accdb8499c86d4414b72565a38 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817): Network error: Client connection negotiation failed: client connection to 127.5.126.66:42817: connect: Connection refused (error 111)
I20260709 13:22:20.483206  7466 leader_election.cc:304] T d8cee0accdb8499c86d4414b72565a38 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb; no voters: b7ab4784c7344b939bc36f639286f377, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:22:20.483982 14732 raft_consensus.cc:2749] T d8cee0accdb8499c86d4414b72565a38 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:22:20.534497  5625 tablet_server.cc:196] TabletServer@127.5.126.67:0 shutdown complete.
I20260709 13:22:20.648684 14732 raft_consensus.cc:493] T f3f9c2e2bf644115957398fe4c9459db P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 23 FOLLOWER]: Starting pre-election (detected failure of leader b7ab4784c7344b939bc36f639286f377)
I20260709 13:22:20.649760 14732 raft_consensus.cc:515] T f3f9c2e2bf644115957398fe4c9459db P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "b7ab4784c7344b939bc36f639286f377" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 42817 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } attrs { replace: true } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
W20260709 13:22:20.660409  7468 leader_election.cc:336] T f3f9c2e2bf644115957398fe4c9459db P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931): Network error: Client connection negotiation failed: client connection to 127.5.126.67:42931: connect: Connection refused (error 111)
I20260709 13:22:20.661434 14732 leader_election.cc:290] T f3f9c2e2bf644115957398fe4c9459db P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
W20260709 13:22:20.673095  7466 leader_election.cc:336] T f3f9c2e2bf644115957398fe4c9459db P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111)
I20260709 13:22:20.673727  7466 leader_election.cc:304] T f3f9c2e2bf644115957398fe4c9459db P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:22:20.674636 14732 raft_consensus.cc:2749] T f3f9c2e2bf644115957398fe4c9459db P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
W20260709 13:22:20.675854  7466 leader_election.cc:336] T f3f9c2e2bf644115957398fe4c9459db P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer b7ab4784c7344b939bc36f639286f377 (127.5.126.66:42817): Network error: Client connection negotiation failed: client connection to 127.5.126.66:42817: connect: Connection refused (error 111)
I20260709 13:22:20.756719  5625 tablet_server.cc:179] TabletServer@127.5.126.68:0 shutting down...
I20260709 13:22:20.829660  5625 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:22:20.830919  5625 tablet_replica.cc:333] T f3f9c2e2bf644115957398fe4c9459db P 7ba59cc884714e8aa5f3f0ecaed84cbb: stopping tablet replica
I20260709 13:22:20.832289  5625 raft_consensus.cc:2243] T f3f9c2e2bf644115957398fe4c9459db P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:20.833992  5625 raft_consensus.cc:2272] T f3f9c2e2bf644115957398fe4c9459db P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:20.839437  5625 tablet_replica.cc:333] T ce4f062dcd314d43a63ca74067cb5ee3 P 7ba59cc884714e8aa5f3f0ecaed84cbb: stopping tablet replica
I20260709 13:22:20.840482  5625 raft_consensus.cc:2243] T ce4f062dcd314d43a63ca74067cb5ee3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:20.842311  5625 raft_consensus.cc:2272] T ce4f062dcd314d43a63ca74067cb5ee3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:20.846933  5625 tablet_replica.cc:333] T 1528ab62b6fe4e3099d08f141afee116 P 7ba59cc884714e8aa5f3f0ecaed84cbb: stopping tablet replica
I20260709 13:22:20.847941  5625 raft_consensus.cc:2243] T 1528ab62b6fe4e3099d08f141afee116 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 20 LEADER]: Raft consensus shutting down.
I20260709 13:22:20.849385  5625 raft_consensus.cc:2272] T 1528ab62b6fe4e3099d08f141afee116 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:20.853835  5625 tablet_replica.cc:333] T b3f13b31a1f84f0d89d007eadd57924c P 7ba59cc884714e8aa5f3f0ecaed84cbb: stopping tablet replica
I20260709 13:22:20.855006  5625 raft_consensus.cc:2243] T b3f13b31a1f84f0d89d007eadd57924c P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 16 LEADER]: Raft consensus shutting down.
I20260709 13:22:20.856855  5625 raft_consensus.cc:2272] T b3f13b31a1f84f0d89d007eadd57924c P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:20.860827  5625 tablet_replica.cc:333] T 7ba5dac66ab5497e9e336f2a3c28cda5 P 7ba59cc884714e8aa5f3f0ecaed84cbb: stopping tablet replica
I20260709 13:22:20.861891  5625 raft_consensus.cc:2243] T 7ba5dac66ab5497e9e336f2a3c28cda5 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 23 LEADER]: Raft consensus shutting down.
I20260709 13:22:20.863513  5625 raft_consensus.cc:2272] T 7ba5dac66ab5497e9e336f2a3c28cda5 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:20.864600 14732 raft_consensus.cc:493] T 95a75bfe094d4bdc963aba3f08dfcd25 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 18 FOLLOWER]: Starting pre-election (detected failure of leader cd75a17ab2604397adab03bb8b5fd75c)
I20260709 13:22:20.865417 14732 raft_consensus.cc:515] T 95a75bfe094d4bdc963aba3f08dfcd25 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
I20260709 13:22:20.867229  5625 tablet_replica.cc:333] T bb7fa124c3bf4ef9ab65a407cb008441 P 7ba59cc884714e8aa5f3f0ecaed84cbb: stopping tablet replica
I20260709 13:22:20.868357  5625 raft_consensus.cc:2243] T bb7fa124c3bf4ef9ab65a407cb008441 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:20.869385  5625 raft_consensus.cc:2272] T bb7fa124c3bf4ef9ab65a407cb008441 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:20.870054 14743 raft_consensus.cc:493] T 4b8cacb381b746da8d0049b0a83b41dd P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 22 FOLLOWER]: Starting pre-election (detected failure of leader cd75a17ab2604397adab03bb8b5fd75c)
I20260709 13:22:20.870761 14743 raft_consensus.cc:515] T 4b8cacb381b746da8d0049b0a83b41dd P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ccd8a4c3bfe3413cb2ae219b09aea832" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44391 } } peers { permanent_uuid: "cd75a17ab2604397adab03bb8b5fd75c" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 42931 } } peers { permanent_uuid: "7ba59cc884714e8aa5f3f0ecaed84cbb" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 45071 } attrs { promote: false } }
W20260709 13:22:20.873010  7468 leader_election.cc:336] T 95a75bfe094d4bdc963aba3f08dfcd25 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931): Network error: Client connection negotiation failed: client connection to 127.5.126.67:42931: connect: Connection refused (error 111)
I20260709 13:22:20.873310 14743 leader_election.cc:290] T 4b8cacb381b746da8d0049b0a83b41dd P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:22:20.877465  5625 tablet_replica.cc:333] T 95a75bfe094d4bdc963aba3f08dfcd25 P 7ba59cc884714e8aa5f3f0ecaed84cbb: stopping tablet replica
I20260709 13:22:20.878513  5625 raft_consensus.cc:2243] T 95a75bfe094d4bdc963aba3f08dfcd25 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:20.880638  5625 raft_consensus.cc:2272] T 95a75bfe094d4bdc963aba3f08dfcd25 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 18 FOLLOWER]: Raft consensus is shut down!
W20260709 13:22:20.881224  7468 leader_election.cc:336] T 4b8cacb381b746da8d0049b0a83b41dd P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931): Network error: Client connection negotiation failed: client connection to 127.5.126.67:42931: connect: Connection refused (error 111)
I20260709 13:22:20.881788 14732 leader_election.cc:290] T 95a75bfe094d4bdc963aba3f08dfcd25 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391), cd75a17ab2604397adab03bb8b5fd75c (127.5.126.67:42931)
I20260709 13:22:20.887267  5625 tablet_replica.cc:333] T be1a92657f494cac8dd227d152f50151 P 7ba59cc884714e8aa5f3f0ecaed84cbb: stopping tablet replica
W20260709 13:22:20.887918  7466 leader_election.cc:336] T 95a75bfe094d4bdc963aba3f08dfcd25 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111)
I20260709 13:22:20.888466  5625 raft_consensus.cc:2243] T be1a92657f494cac8dd227d152f50151 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 25 LEADER]: Raft consensus shutting down.
I20260709 13:22:20.888469  7466 leader_election.cc:304] T 95a75bfe094d4bdc963aba3f08dfcd25 P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
W20260709 13:22:20.889567  7466 raft_consensus.cc:2686] T 95a75bfe094d4bdc963aba3f08dfcd25 P 7ba59cc884714e8aa5f3f0ecaed84cbb: unable to run election callback: Service unavailable: Thread pool token was shut down
W20260709 13:22:20.890218  7466 leader_election.cc:336] T 4b8cacb381b746da8d0049b0a83b41dd P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111)
I20260709 13:22:20.890646  7466 leader_election.cc:304] T 4b8cacb381b746da8d0049b0a83b41dd P 7ba59cc884714e8aa5f3f0ecaed84cbb [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ba59cc884714e8aa5f3f0ecaed84cbb; no voters: ccd8a4c3bfe3413cb2ae219b09aea832, cd75a17ab2604397adab03bb8b5fd75c
I20260709 13:22:20.890785  5625 raft_consensus.cc:2272] T be1a92657f494cac8dd227d152f50151 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:20.891368 14732 raft_consensus.cc:2749] T 4b8cacb381b746da8d0049b0a83b41dd P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:22:20.894841  5625 tablet_replica.cc:333] T 17587d6730594da4a56fa13a353232a1 P 7ba59cc884714e8aa5f3f0ecaed84cbb: stopping tablet replica
I20260709 13:22:20.895879  5625 raft_consensus.cc:2243] T 17587d6730594da4a56fa13a353232a1 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 26 LEADER]: Raft consensus shutting down.
I20260709 13:22:20.897712  5625 raft_consensus.cc:2272] T 17587d6730594da4a56fa13a353232a1 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 26 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:20.901925  5625 tablet_replica.cc:333] T 404190ce4ce94cecbfcb6ea9d1dd8626 P 7ba59cc884714e8aa5f3f0ecaed84cbb: stopping tablet replica
I20260709 13:22:20.902932  5625 raft_consensus.cc:2243] T 404190ce4ce94cecbfcb6ea9d1dd8626 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 19 LEADER]: Raft consensus shutting down.
I20260709 13:22:20.904860  5625 raft_consensus.cc:2272] T 404190ce4ce94cecbfcb6ea9d1dd8626 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:20.908687  5625 tablet_replica.cc:333] T 7a734b5ab7834e05a8c422208acc58b1 P 7ba59cc884714e8aa5f3f0ecaed84cbb: stopping tablet replica
I20260709 13:22:20.909672  5625 raft_consensus.cc:2243] T 7a734b5ab7834e05a8c422208acc58b1 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 22 LEADER]: Raft consensus shutting down.
I20260709 13:22:20.911427  5625 raft_consensus.cc:2272] T 7a734b5ab7834e05a8c422208acc58b1 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:20.916194  5625 tablet_replica.cc:333] T 24ee15416e3145beaa1b8183453729a3 P 7ba59cc884714e8aa5f3f0ecaed84cbb: stopping tablet replica
I20260709 13:22:20.917079  5625 raft_consensus.cc:2243] T 24ee15416e3145beaa1b8183453729a3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 20 LEADER]: Raft consensus shutting down.
I20260709 13:22:20.918747  5625 raft_consensus.cc:2272] T 24ee15416e3145beaa1b8183453729a3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:20.922484  5625 tablet_replica.cc:333] T 4f00a2e87e56452083b759f60d461ee3 P 7ba59cc884714e8aa5f3f0ecaed84cbb: stopping tablet replica
I20260709 13:22:20.923372  5625 raft_consensus.cc:2243] T 4f00a2e87e56452083b759f60d461ee3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 22 LEADER]: Raft consensus shutting down.
I20260709 13:22:20.925015  5625 raft_consensus.cc:2272] T 4f00a2e87e56452083b759f60d461ee3 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 22 FOLLOWER]: Raft consensus is shut down!
W20260709 13:22:20.926949  7466 consensus_peers.cc:597] T bb3d8792045a4583ae2e965b1350a5b4 P 7ba59cc884714e8aa5f3f0ecaed84cbb -> Peer ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): Couldn't send request to peer ccd8a4c3bfe3413cb2ae219b09aea832. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
I20260709 13:22:20.928520  5625 tablet_replica.cc:333] T d8cee0accdb8499c86d4414b72565a38 P 7ba59cc884714e8aa5f3f0ecaed84cbb: stopping tablet replica
I20260709 13:22:20.929482  5625 raft_consensus.cc:2243] T d8cee0accdb8499c86d4414b72565a38 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 24 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:20.930295  5625 raft_consensus.cc:2272] T d8cee0accdb8499c86d4414b72565a38 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:20.933813  5625 tablet_replica.cc:333] T fe20b4b48823486ca3b9c648db6ce8aa P 7ba59cc884714e8aa5f3f0ecaed84cbb: stopping tablet replica
I20260709 13:22:20.934652  5625 raft_consensus.cc:2243] T fe20b4b48823486ca3b9c648db6ce8aa P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 17 LEADER]: Raft consensus shutting down.
I20260709 13:22:20.936156  5625 raft_consensus.cc:2272] T fe20b4b48823486ca3b9c648db6ce8aa P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:20.939824  5625 tablet_replica.cc:333] T 4b8cacb381b746da8d0049b0a83b41dd P 7ba59cc884714e8aa5f3f0ecaed84cbb: stopping tablet replica
I20260709 13:22:20.940691  5625 raft_consensus.cc:2243] T 4b8cacb381b746da8d0049b0a83b41dd P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:20.941819  5625 raft_consensus.cc:2272] T 4b8cacb381b746da8d0049b0a83b41dd P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:20.945442  5625 tablet_replica.cc:333] T 427c124d773f483294511e80fe340075 P 7ba59cc884714e8aa5f3f0ecaed84cbb: stopping tablet replica
I20260709 13:22:20.946341  5625 raft_consensus.cc:2243] T 427c124d773f483294511e80fe340075 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 18 LEADER]: Raft consensus shutting down.
I20260709 13:22:20.947993  5625 raft_consensus.cc:2272] T 427c124d773f483294511e80fe340075 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:20.951577  5625 tablet_replica.cc:333] T bb3d8792045a4583ae2e965b1350a5b4 P 7ba59cc884714e8aa5f3f0ecaed84cbb: stopping tablet replica
I20260709 13:22:20.952363  5625 raft_consensus.cc:2243] T bb3d8792045a4583ae2e965b1350a5b4 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 20 LEADER]: Raft consensus shutting down.
I20260709 13:22:20.953902  5625 raft_consensus.cc:2272] T bb3d8792045a4583ae2e965b1350a5b4 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:20.956503  5625 tablet_replica.cc:333] T 3a485a995abc4807b6e511e45419f737 P 7ba59cc884714e8aa5f3f0ecaed84cbb: stopping tablet replica
I20260709 13:22:20.957124  5625 raft_consensus.cc:2243] T 3a485a995abc4807b6e511e45419f737 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:20.958633  5625 raft_consensus.cc:2272] T 3a485a995abc4807b6e511e45419f737 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:20.962131  5625 tablet_replica.cc:333] T 3fa34c08b205435dba97346991aa1f92 P 7ba59cc884714e8aa5f3f0ecaed84cbb: stopping tablet replica
I20260709 13:22:20.962658  5625 raft_consensus.cc:2243] T 3fa34c08b205435dba97346991aa1f92 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 27 LEADER]: Raft consensus shutting down.
I20260709 13:22:20.964022  5625 raft_consensus.cc:2272] T 3fa34c08b205435dba97346991aa1f92 P 7ba59cc884714e8aa5f3f0ecaed84cbb [term 27 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:21.394730  5625 tablet_server.cc:196] TabletServer@127.5.126.68:0 shutdown complete.
I20260709 13:22:21.456645  5625 master.cc:562] Master@127.5.126.126:34367 shutting down...
W20260709 13:22:21.507028  6678 auto_rebalancer.cc:873] Removing replace marker failed: Catalog manager is not initialized. State: Closing
W20260709 13:22:21.507402  6678 auto_rebalancer.cc:901] Could not move replica: Service unavailable: Catalog manager is not initialized. State: Closing
W20260709 13:22:21.507661  6678 auto_rebalancer.cc:330] scheduled replica move failed to complete: Service unavailable: Catalog manager is not initialized. State: Closing
W20260709 13:22:21.870833  6614 catalog_manager.cc:4755] TS ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 427c124d773f483294511e80fe340075: Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111)
W20260709 13:22:24.550873  6614 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111) [suppressed 189 similar messages]
W20260709 13:22:24.554411  6614 catalog_manager.cc:4755] TS ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 3a485a995abc4807b6e511e45419f737: Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111)
W20260709 13:22:50.727061  6614 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111)
W20260709 13:22:50.731494  6614 catalog_manager.cc:4755] TS ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet ce4f062dcd314d43a63ca74067cb5ee3: Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111)
W20260709 13:22:52.317086  6614 catalog_manager.cc:4755] TS ccd8a4c3bfe3413cb2ae219b09aea832 (127.5.126.65:44391): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 7a734b5ab7834e05a8c422208acc58b1: Network error: Client connection negotiation failed: client connection to 127.5.126.65:44391: connect: Connection refused (error 111)
I20260709 13:22:54.689342  5625 raft_consensus.cc:2243] T 00000000000000000000000000000000 P b3ae52d33b9a4273a42e5e2cf3b5d6b5 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:22:54.690636  5625 raft_consensus.cc:2272] T 00000000000000000000000000000000 P b3ae52d33b9a4273a42e5e2cf3b5d6b5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:54.691057  5625 tablet_replica.cc:333] T 00000000000000000000000000000000 P b3ae52d33b9a4273a42e5e2cf3b5d6b5: stopping tablet replica
I20260709 13:22:54.921042  5625 master.cc:584] Master@127.5.126.126:34367 shutdown complete.
I20260709 13:22:54.978580  5625 test_util.cc:182] -----------------------------------------------
I20260709 13:22:54.978894  5625 test_util.cc:183] Had failures, leaving test files at /tmp/dist-test-taskWHb0CB/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783603057096655-5625-0
[  FAILED  ] LeaderRebalancerTest.AddTserver (293827 ms)
[ RUN      ] LeaderRebalancerTest.RestartTserver
I20260709 13:22:54.983351  5625 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.5.126.126:45503
I20260709 13:22:54.984843  5625 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:22:54.991990 14758 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:22:54.992501 14759 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:22:54.993818 14761 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:22:54.994138  5625 server_base.cc:1061] running on GCE node
I20260709 13:22:54.998288  5625 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:22:54.998525  5625 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:22:54.998646  5625 hybrid_clock.cc:648] HybridClock initialized: now 1783603374998633 us; error 0 us; skew 500 ppm
I20260709 13:22:54.999140  5625 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:22:55.002058  5625 webserver.cc:533] Webserver started at http://127.5.126.126:45109/ using document root <none> and password file <none>
I20260709 13:22:55.002588  5625 fs_manager.cc:362] Metadata directory not provided
I20260709 13:22:55.002765  5625 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:22:55.003003  5625 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:22:55.004552  5625 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskWHb0CB/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783603057096655-5625-0/minicluster-data/master-0-root/instance:
uuid: "cac9771223d04992a839004076c8c496"
format_stamp: "Formatted at 2026-07-09 13:22:54 on dist-test-slave-smzk"
I20260709 13:22:55.009932  5625 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.005s	sys 0.000s
I20260709 13:22:55.014089 14766 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:22:55.015003  5625 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.001s	sys 0.000s
I20260709 13:22:55.015417  5625 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskWHb0CB/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783603057096655-5625-0/minicluster-data/master-0-root
uuid: "cac9771223d04992a839004076c8c496"
format_stamp: "Formatted at 2026-07-09 13:22:54 on dist-test-slave-smzk"
I20260709 13:22:55.015723  5625 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWHb0CB/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783603057096655-5625-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskWHb0CB/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783603057096655-5625-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskWHb0CB/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783603057096655-5625-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:22:55.034978  5625 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:22:55.036579  5625 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:22:55.085598  5625 rpc_server.cc:307] RPC server started. Bound to: 127.5.126.126:45503
I20260709 13:22:55.085821 14817 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.5.126.126:45503 every 8 connection(s)
I20260709 13:22:55.090386 14818 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:55.101828 14818 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P cac9771223d04992a839004076c8c496: Bootstrap starting.
I20260709 13:22:55.106765 14818 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P cac9771223d04992a839004076c8c496: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:55.111512 14818 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P cac9771223d04992a839004076c8c496: No bootstrap required, opened a new log
I20260709 13:22:55.113781 14818 raft_consensus.cc:359] T 00000000000000000000000000000000 P cac9771223d04992a839004076c8c496 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cac9771223d04992a839004076c8c496" member_type: VOTER }
I20260709 13:22:55.114254 14818 raft_consensus.cc:385] T 00000000000000000000000000000000 P cac9771223d04992a839004076c8c496 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:55.114490 14818 raft_consensus.cc:740] T 00000000000000000000000000000000 P cac9771223d04992a839004076c8c496 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cac9771223d04992a839004076c8c496, State: Initialized, Role: FOLLOWER
I20260709 13:22:55.115216 14818 consensus_queue.cc:260] T 00000000000000000000000000000000 P cac9771223d04992a839004076c8c496 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cac9771223d04992a839004076c8c496" member_type: VOTER }
I20260709 13:22:55.115751 14818 raft_consensus.cc:399] T 00000000000000000000000000000000 P cac9771223d04992a839004076c8c496 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:22:55.115996 14818 raft_consensus.cc:493] T 00000000000000000000000000000000 P cac9771223d04992a839004076c8c496 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:22:55.116302 14818 raft_consensus.cc:3060] T 00000000000000000000000000000000 P cac9771223d04992a839004076c8c496 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:55.121330 14818 raft_consensus.cc:515] T 00000000000000000000000000000000 P cac9771223d04992a839004076c8c496 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cac9771223d04992a839004076c8c496" member_type: VOTER }
I20260709 13:22:55.121893 14818 leader_election.cc:304] T 00000000000000000000000000000000 P cac9771223d04992a839004076c8c496 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: cac9771223d04992a839004076c8c496; no voters: 
I20260709 13:22:55.123144 14818 leader_election.cc:290] T 00000000000000000000000000000000 P cac9771223d04992a839004076c8c496 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:22:55.123807 14821 raft_consensus.cc:2804] T 00000000000000000000000000000000 P cac9771223d04992a839004076c8c496 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:22:55.125546 14821 raft_consensus.cc:697] T 00000000000000000000000000000000 P cac9771223d04992a839004076c8c496 [term 1 LEADER]: Becoming Leader. State: Replica: cac9771223d04992a839004076c8c496, State: Running, Role: LEADER
I20260709 13:22:55.126281 14821 consensus_queue.cc:237] T 00000000000000000000000000000000 P cac9771223d04992a839004076c8c496 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cac9771223d04992a839004076c8c496" member_type: VOTER }
I20260709 13:22:55.126523 14818 sys_catalog.cc:565] T 00000000000000000000000000000000 P cac9771223d04992a839004076c8c496 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:22:55.135267 14822 sys_catalog.cc:455] T 00000000000000000000000000000000 P cac9771223d04992a839004076c8c496 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "cac9771223d04992a839004076c8c496" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cac9771223d04992a839004076c8c496" member_type: VOTER } }
I20260709 13:22:55.135478 14823 sys_catalog.cc:455] T 00000000000000000000000000000000 P cac9771223d04992a839004076c8c496 [sys.catalog]: SysCatalogTable state changed. Reason: New leader cac9771223d04992a839004076c8c496. Latest consensus state: current_term: 1 leader_uuid: "cac9771223d04992a839004076c8c496" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cac9771223d04992a839004076c8c496" member_type: VOTER } }
I20260709 13:22:55.136140 14823 sys_catalog.cc:458] T 00000000000000000000000000000000 P cac9771223d04992a839004076c8c496 [sys.catalog]: This master's current role is: LEADER
I20260709 13:22:55.136121 14822 sys_catalog.cc:458] T 00000000000000000000000000000000 P cac9771223d04992a839004076c8c496 [sys.catalog]: This master's current role is: LEADER
I20260709 13:22:55.143159 14831 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:22:55.148703 14831 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:22:55.149962  5625 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:22:55.158766 14831 catalog_manager.cc:1383] Generated new cluster ID: dfdd3398d15a4663a88def520bf073aa
I20260709 13:22:55.159123 14831 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:22:55.171962 14831 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:22:55.173600 14831 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:22:55.187724 14831 catalog_manager.cc:6070] T 00000000000000000000000000000000 P cac9771223d04992a839004076c8c496: Generated new TSK 0
I20260709 13:22:55.188508 14831 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:22:55.218632  5625 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:22:55.225803 14839 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:22:55.227330 14840 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:22:55.229084 14842 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:22:55.230746  5625 server_base.cc:1061] running on GCE node
I20260709 13:22:55.233932  5625 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:22:55.234153  5625 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:22:55.234375  5625 hybrid_clock.cc:648] HybridClock initialized: now 1783603375234342 us; error 0 us; skew 500 ppm
I20260709 13:22:55.234972  5625 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:22:55.237726  5625 webserver.cc:533] Webserver started at http://127.5.126.65:44757/ using document root <none> and password file <none>
I20260709 13:22:55.238231  5625 fs_manager.cc:362] Metadata directory not provided
I20260709 13:22:55.238420  5625 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:22:55.238714  5625 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:22:55.239944  5625 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskWHb0CB/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783603057096655-5625-0/minicluster-data/ts-0-root/instance:
uuid: "f3a500981b494979b58d2b1041fec9c8"
format_stamp: "Formatted at 2026-07-09 13:22:55 on dist-test-slave-smzk"
I20260709 13:22:55.245415  5625 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.001s	sys 0.003s
I20260709 13:22:55.249261 14847 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:22:55.250212  5625 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.004s	sys 0.000s
I20260709 13:22:55.250547  5625 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskWHb0CB/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783603057096655-5625-0/minicluster-data/ts-0-root
uuid: "f3a500981b494979b58d2b1041fec9c8"
format_stamp: "Formatted at 2026-07-09 13:22:55 on dist-test-slave-smzk"
I20260709 13:22:55.250903  5625 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWHb0CB/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783603057096655-5625-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskWHb0CB/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783603057096655-5625-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskWHb0CB/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783603057096655-5625-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:22:55.263154  5625 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:22:55.264597  5625 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:22:55.266341  5625 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:22:55.269093  5625 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:22:55.269335  5625 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:22:55.269625  5625 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:22:55.269827  5625 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:22:55.319243  5625 rpc_server.cc:307] RPC server started. Bound to: 127.5.126.65:34129
I20260709 13:22:55.319669 14909 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.5.126.65:34129 every 8 connection(s)
I20260709 13:22:55.325487  5625 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:22:55.335264 14914 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:22:55.338970 14915 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:22:55.340250  5625 server_base.cc:1061] running on GCE node
W20260709 13:22:55.340400 14917 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:22:55.344026 14910 heartbeater.cc:344] Connected to a master server at 127.5.126.126:45503
I20260709 13:22:55.344532 14910 heartbeater.cc:461] Registering TS with master...
I20260709 13:22:55.344620  5625 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:22:55.344973  5625 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:22:55.345162  5625 hybrid_clock.cc:648] HybridClock initialized: now 1783603375345130 us; error 0 us; skew 500 ppm
I20260709 13:22:55.345567 14910 heartbeater.cc:507] Master 127.5.126.126:45503 requested a full tablet report, sending...
I20260709 13:22:55.345871  5625 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:22:55.348023 14783 ts_manager.cc:194] Registered new tserver with Master: f3a500981b494979b58d2b1041fec9c8 (127.5.126.65:34129)
I20260709 13:22:55.348964  5625 webserver.cc:533] Webserver started at http://127.5.126.66:35109/ using document root <none> and password file <none>
I20260709 13:22:55.349547  5625 fs_manager.cc:362] Metadata directory not provided
I20260709 13:22:55.349758  5625 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:22:55.350060  5625 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:22:55.350294 14783 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:54420
I20260709 13:22:55.351665  5625 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskWHb0CB/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783603057096655-5625-0/minicluster-data/ts-1-root/instance:
uuid: "0efc951052454eec9a58b0cd025945b8"
format_stamp: "Formatted at 2026-07-09 13:22:55 on dist-test-slave-smzk"
I20260709 13:22:55.356950  5625 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:22:55.360916 14922 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:22:55.361805  5625 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.004s	sys 0.000s
I20260709 13:22:55.362151  5625 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskWHb0CB/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783603057096655-5625-0/minicluster-data/ts-1-root
uuid: "0efc951052454eec9a58b0cd025945b8"
format_stamp: "Formatted at 2026-07-09 13:22:55 on dist-test-slave-smzk"
I20260709 13:22:55.362498  5625 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWHb0CB/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783603057096655-5625-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskWHb0CB/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783603057096655-5625-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskWHb0CB/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783603057096655-5625-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:22:55.381253  5625 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:22:55.382735  5625 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:22:55.384491  5625 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:22:55.387022  5625 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:22:55.387261  5625 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:22:55.387533  5625 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:22:55.387717  5625 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:22:55.438477  5625 rpc_server.cc:307] RPC server started. Bound to: 127.5.126.66:34613
I20260709 13:22:55.438603 14984 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.5.126.66:34613 every 8 connection(s)
I20260709 13:22:55.444507  5625 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:22:55.453434 14988 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:22:55.456390 14989 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:22:55.459791  5625 server_base.cc:1061] running on GCE node
W20260709 13:22:55.460665 14991 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:22:55.461377 14985 heartbeater.cc:344] Connected to a master server at 127.5.126.126:45503
I20260709 13:22:55.461798 14985 heartbeater.cc:461] Registering TS with master...
I20260709 13:22:55.462719 14985 heartbeater.cc:507] Master 127.5.126.126:45503 requested a full tablet report, sending...
I20260709 13:22:55.464270  5625 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:22:55.464566  5625 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:22:55.464789  5625 hybrid_clock.cc:648] HybridClock initialized: now 1783603375464768 us; error 0 us; skew 500 ppm
I20260709 13:22:55.465240 14783 ts_manager.cc:194] Registered new tserver with Master: 0efc951052454eec9a58b0cd025945b8 (127.5.126.66:34613)
I20260709 13:22:55.465701  5625 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:22:55.467541 14783 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:54434
I20260709 13:22:55.469364  5625 webserver.cc:533] Webserver started at http://127.5.126.67:42059/ using document root <none> and password file <none>
I20260709 13:22:55.469990  5625 fs_manager.cc:362] Metadata directory not provided
I20260709 13:22:55.470216  5625 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:22:55.470551  5625 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:22:55.471925  5625 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskWHb0CB/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783603057096655-5625-0/minicluster-data/ts-2-root/instance:
uuid: "a1a22e9119494570b6d2217713fd7e43"
format_stamp: "Formatted at 2026-07-09 13:22:55 on dist-test-slave-smzk"
I20260709 13:22:55.477421  5625 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.000s	sys 0.004s
I20260709 13:22:55.482082 14996 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:22:55.483085  5625 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.001s	sys 0.000s
I20260709 13:22:55.483492  5625 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskWHb0CB/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783603057096655-5625-0/minicluster-data/ts-2-root
uuid: "a1a22e9119494570b6d2217713fd7e43"
format_stamp: "Formatted at 2026-07-09 13:22:55 on dist-test-slave-smzk"
I20260709 13:22:55.483866  5625 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWHb0CB/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783603057096655-5625-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskWHb0CB/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783603057096655-5625-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskWHb0CB/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783603057096655-5625-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:22:55.496273  5625 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:22:55.497730  5625 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:22:55.499585  5625 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:22:55.502139  5625 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:22:55.502408  5625 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:22:55.502665  5625 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:22:55.502851  5625 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:22:55.553514  5625 rpc_server.cc:307] RPC server started. Bound to: 127.5.126.67:38125
I20260709 13:22:55.553682 15058 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.5.126.67:38125 every 8 connection(s)
I20260709 13:22:55.559516  5625 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:22:55.569181 15062 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:22:55.570981 15063 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:22:55.575129  5625 server_base.cc:1061] running on GCE node
W20260709 13:22:55.575449 15065 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:22:55.576556 15059 heartbeater.cc:344] Connected to a master server at 127.5.126.126:45503
I20260709 13:22:55.576972  5625 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
I20260709 13:22:55.576983 15059 heartbeater.cc:461] Registering TS with master...
W20260709 13:22:55.577435  5625 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:22:55.577719  5625 hybrid_clock.cc:648] HybridClock initialized: now 1783603375577700 us; error 0 us; skew 500 ppm
I20260709 13:22:55.578310 15059 heartbeater.cc:507] Master 127.5.126.126:45503 requested a full tablet report, sending...
I20260709 13:22:55.578418  5625 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:22:55.581527 14783 ts_manager.cc:194] Registered new tserver with Master: a1a22e9119494570b6d2217713fd7e43 (127.5.126.67:38125)
I20260709 13:22:55.581830  5625 webserver.cc:533] Webserver started at http://127.5.126.68:37907/ using document root <none> and password file <none>
I20260709 13:22:55.582640  5625 fs_manager.cc:362] Metadata directory not provided
I20260709 13:22:55.582916  5625 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:22:55.583261  5625 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:22:55.583653 14783 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:54438
I20260709 13:22:55.585237  5625 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskWHb0CB/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783603057096655-5625-0/minicluster-data/ts-3-root/instance:
uuid: "a722e54d227f4c29a9ed6ce77858003a"
format_stamp: "Formatted at 2026-07-09 13:22:55 on dist-test-slave-smzk"
I20260709 13:22:55.590519  5625 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.006s	sys 0.000s
I20260709 13:22:55.594682 15070 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:22:55.595693  5625 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.000s
I20260709 13:22:55.596297  5625 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskWHb0CB/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783603057096655-5625-0/minicluster-data/ts-3-root
uuid: "a722e54d227f4c29a9ed6ce77858003a"
format_stamp: "Formatted at 2026-07-09 13:22:55 on dist-test-slave-smzk"
I20260709 13:22:55.596608  5625 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWHb0CB/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783603057096655-5625-0/minicluster-data/ts-3-root
metadata directory: /tmp/dist-test-taskWHb0CB/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783603057096655-5625-0/minicluster-data/ts-3-root
1 data directories: /tmp/dist-test-taskWHb0CB/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783603057096655-5625-0/minicluster-data/ts-3-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:22:55.608203  5625 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:22:55.609637  5625 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:22:55.611377  5625 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:22:55.614195  5625 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:22:55.614398  5625 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:22:55.614588  5625 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:22:55.614717  5625 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:22:55.663916  5625 rpc_server.cc:307] RPC server started. Bound to: 127.5.126.68:46669
I20260709 13:22:55.664181 15132 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.5.126.68:46669 every 8 connection(s)
I20260709 13:22:55.679867 15133 heartbeater.cc:344] Connected to a master server at 127.5.126.126:45503
I20260709 13:22:55.680536 15133 heartbeater.cc:461] Registering TS with master...
I20260709 13:22:55.681469 15133 heartbeater.cc:507] Master 127.5.126.126:45503 requested a full tablet report, sending...
I20260709 13:22:55.683727 14783 ts_manager.cc:194] Registered new tserver with Master: a722e54d227f4c29a9ed6ce77858003a (127.5.126.68:46669)
I20260709 13:22:55.684746  5625 internal_mini_cluster.cc:371] 4 TS(s) registered with all masters after 0.017049078s
I20260709 13:22:55.685513 14783 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:54448
I20260709 13:22:55.716864 14783 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:54462:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}""\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
I20260709 13:22:55.981900 14949 tablet_service.cc:1511] Processing CreateTablet for tablet a71163721b4d48b0b5ff366b9d12ac32 (DEFAULT_TABLE table=test-workload [id=9261731b25a046aea02157c57c0f5059]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 13:22:55.983565 14949 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a71163721b4d48b0b5ff366b9d12ac32. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:55.985086 14950 tablet_service.cc:1511] Processing CreateTablet for tablet 48be8cf045364be999b8f0fd547b7b9d (DEFAULT_TABLE table=test-workload [id=9261731b25a046aea02157c57c0f5059]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 13:22:55.985675 14948 tablet_service.cc:1511] Processing CreateTablet for tablet 117ae8a22b1d46579ce047f99e30520b (DEFAULT_TABLE table=test-workload [id=9261731b25a046aea02157c57c0f5059]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 13:22:55.986564 14950 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 48be8cf045364be999b8f0fd547b7b9d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:55.989297 15019 tablet_service.cc:1511] Processing CreateTablet for tablet 36f72377897846f2a1f3d8d33ec14af6 (DEFAULT_TABLE table=test-workload [id=9261731b25a046aea02157c57c0f5059]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 13:22:55.989491 15021 tablet_service.cc:1511] Processing CreateTablet for tablet 46ed2e9dd1324ac4a6e07f813cfebb7e (DEFAULT_TABLE table=test-workload [id=9261731b25a046aea02157c57c0f5059]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 13:22:55.990912 15019 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 36f72377897846f2a1f3d8d33ec14af6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:55.990615 15097 tablet_service.cc:1511] Processing CreateTablet for tablet d65eaa0ab4574a1ea92b3848d4dc9c4d (DEFAULT_TABLE table=test-workload [id=9261731b25a046aea02157c57c0f5059]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 13:22:55.992086 15097 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d65eaa0ab4574a1ea92b3848d4dc9c4d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:55.992362 15022 tablet_service.cc:1511] Processing CreateTablet for tablet 117ae8a22b1d46579ce047f99e30520b (DEFAULT_TABLE table=test-workload [id=9261731b25a046aea02157c57c0f5059]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 13:22:55.993333 15018 tablet_service.cc:1511] Processing CreateTablet for tablet db6d3d345bd3495e9ec9a0e75ecd0562 (DEFAULT_TABLE table=test-workload [id=9261731b25a046aea02157c57c0f5059]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 13:22:55.994012 15022 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 117ae8a22b1d46579ce047f99e30520b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:55.994884 15018 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet db6d3d345bd3495e9ec9a0e75ecd0562. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:55.996517 15023 tablet_service.cc:1511] Processing CreateTablet for tablet d65eaa0ab4574a1ea92b3848d4dc9c4d (DEFAULT_TABLE table=test-workload [id=9261731b25a046aea02157c57c0f5059]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 13:22:55.997356 14946 tablet_service.cc:1511] Processing CreateTablet for tablet 914c9c0c3be1486f8dcce382b61b5450 (DEFAULT_TABLE table=test-workload [id=9261731b25a046aea02157c57c0f5059]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 13:22:55.998893 14946 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 914c9c0c3be1486f8dcce382b61b5450. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:55.998137 15023 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d65eaa0ab4574a1ea92b3848d4dc9c4d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:56.001528 14945 tablet_service.cc:1511] Processing CreateTablet for tablet 36f72377897846f2a1f3d8d33ec14af6 (DEFAULT_TABLE table=test-workload [id=9261731b25a046aea02157c57c0f5059]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 13:22:56.003017 14945 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 36f72377897846f2a1f3d8d33ec14af6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:56.004438 15021 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 46ed2e9dd1324ac4a6e07f813cfebb7e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:56.005373 15095 tablet_service.cc:1511] Processing CreateTablet for tablet 914c9c0c3be1486f8dcce382b61b5450 (DEFAULT_TABLE table=test-workload [id=9261731b25a046aea02157c57c0f5059]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 13:22:56.006827 15095 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 914c9c0c3be1486f8dcce382b61b5450. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:56.009366 15094 tablet_service.cc:1511] Processing CreateTablet for tablet 5df7528567fd4291a888bfb37c28dc27 (DEFAULT_TABLE table=test-workload [id=9261731b25a046aea02157c57c0f5059]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 13:22:56.010840 15094 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5df7528567fd4291a888bfb37c28dc27. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:56.013820 14941 tablet_service.cc:1511] Processing CreateTablet for tablet 7560205f5d324c7d821dff8efe7a6256 (DEFAULT_TABLE table=test-workload [id=9261731b25a046aea02157c57c0f5059]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 13:22:56.016362 15092 tablet_service.cc:1511] Processing CreateTablet for tablet e75f8237624f42f793627366f05b792a (DEFAULT_TABLE table=test-workload [id=9261731b25a046aea02157c57c0f5059]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 13:22:56.017796 15092 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e75f8237624f42f793627366f05b792a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:56.021292 15089 tablet_service.cc:1511] Processing CreateTablet for tablet 268027ae94a54cf4acf51c54c7b9032b (DEFAULT_TABLE table=test-workload [id=9261731b25a046aea02157c57c0f5059]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 13:22:56.022781 15089 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 268027ae94a54cf4acf51c54c7b9032b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:56.025333 14947 tablet_service.cc:1511] Processing CreateTablet for tablet 46ed2e9dd1324ac4a6e07f813cfebb7e (DEFAULT_TABLE table=test-workload [id=9261731b25a046aea02157c57c0f5059]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 13:22:56.029547 14943 tablet_service.cc:1511] Processing CreateTablet for tablet e75f8237624f42f793627366f05b792a (DEFAULT_TABLE table=test-workload [id=9261731b25a046aea02157c57c0f5059]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 13:22:56.033339 15093 tablet_service.cc:1511] Processing CreateTablet for tablet 36f72377897846f2a1f3d8d33ec14af6 (DEFAULT_TABLE table=test-workload [id=9261731b25a046aea02157c57c0f5059]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 13:22:56.034869 15093 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 36f72377897846f2a1f3d8d33ec14af6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:56.037191 15090 tablet_service.cc:1511] Processing CreateTablet for tablet 5cd72bf3a0114fddb1bda8271debea24 (DEFAULT_TABLE table=test-workload [id=9261731b25a046aea02157c57c0f5059]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 13:22:56.038662 15090 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5cd72bf3a0114fddb1bda8271debea24. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:56.042372 14875 tablet_service.cc:1511] Processing CreateTablet for tablet 48be8cf045364be999b8f0fd547b7b9d (DEFAULT_TABLE table=test-workload [id=9261731b25a046aea02157c57c0f5059]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 13:22:56.045428 14874 tablet_service.cc:1511] Processing CreateTablet for tablet a71163721b4d48b0b5ff366b9d12ac32 (DEFAULT_TABLE table=test-workload [id=9261731b25a046aea02157c57c0f5059]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 13:22:56.049360 14872 tablet_service.cc:1511] Processing CreateTablet for tablet 46ed2e9dd1324ac4a6e07f813cfebb7e (DEFAULT_TABLE table=test-workload [id=9261731b25a046aea02157c57c0f5059]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 13:22:56.050679 15016 tablet_service.cc:1511] Processing CreateTablet for tablet 5cd72bf3a0114fddb1bda8271debea24 (DEFAULT_TABLE table=test-workload [id=9261731b25a046aea02157c57c0f5059]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 13:22:56.051904 14871 tablet_service.cc:1511] Processing CreateTablet for tablet 914c9c0c3be1486f8dcce382b61b5450 (DEFAULT_TABLE table=test-workload [id=9261731b25a046aea02157c57c0f5059]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 13:22:56.053609 15015 tablet_service.cc:1511] Processing CreateTablet for tablet 7560205f5d324c7d821dff8efe7a6256 (DEFAULT_TABLE table=test-workload [id=9261731b25a046aea02157c57c0f5059]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 13:22:56.054497 14870 tablet_service.cc:1511] Processing CreateTablet for tablet 5df7528567fd4291a888bfb37c28dc27 (DEFAULT_TABLE table=test-workload [id=9261731b25a046aea02157c57c0f5059]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 13:22:56.055786 14942 tablet_service.cc:1511] Processing CreateTablet for tablet 5cd72bf3a0114fddb1bda8271debea24 (DEFAULT_TABLE table=test-workload [id=9261731b25a046aea02157c57c0f5059]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 13:22:56.057643 14869 tablet_service.cc:1511] Processing CreateTablet for tablet db6d3d345bd3495e9ec9a0e75ecd0562 (DEFAULT_TABLE table=test-workload [id=9261731b25a046aea02157c57c0f5059]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 13:22:56.057996 14944 tablet_service.cc:1511] Processing CreateTablet for tablet db6d3d345bd3495e9ec9a0e75ecd0562 (DEFAULT_TABLE table=test-workload [id=9261731b25a046aea02157c57c0f5059]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 13:22:55.989297 15098 tablet_service.cc:1511] Processing CreateTablet for tablet a71163721b4d48b0b5ff366b9d12ac32 (DEFAULT_TABLE table=test-workload [id=9261731b25a046aea02157c57c0f5059]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 13:22:56.060492 14868 tablet_service.cc:1511] Processing CreateTablet for tablet e75f8237624f42f793627366f05b792a (DEFAULT_TABLE table=test-workload [id=9261731b25a046aea02157c57c0f5059]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 13:22:56.061080 15098 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a71163721b4d48b0b5ff366b9d12ac32. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:56.063482 14867 tablet_service.cc:1511] Processing CreateTablet for tablet 70d027ba81f54eba882756b941186710 (DEFAULT_TABLE table=test-workload [id=9261731b25a046aea02157c57c0f5059]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 13:22:56.064191 15020 tablet_service.cc:1511] Processing CreateTablet for tablet 5df7528567fd4291a888bfb37c28dc27 (DEFAULT_TABLE table=test-workload [id=9261731b25a046aea02157c57c0f5059]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 13:22:56.047920 14873 tablet_service.cc:1511] Processing CreateTablet for tablet d65eaa0ab4574a1ea92b3848d4dc9c4d (DEFAULT_TABLE table=test-workload [id=9261731b25a046aea02157c57c0f5059]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 13:22:55.997363 15096 tablet_service.cc:1511] Processing CreateTablet for tablet 117ae8a22b1d46579ce047f99e30520b (DEFAULT_TABLE table=test-workload [id=9261731b25a046aea02157c57c0f5059]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 13:22:56.066331 14875 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 48be8cf045364be999b8f0fd547b7b9d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:56.067143 14868 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e75f8237624f42f793627366f05b792a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:56.067518 15096 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 117ae8a22b1d46579ce047f99e30520b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:56.068466 14874 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a71163721b4d48b0b5ff366b9d12ac32. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:55.983178 15024 tablet_service.cc:1511] Processing CreateTablet for tablet 48be8cf045364be999b8f0fd547b7b9d (DEFAULT_TABLE table=test-workload [id=9261731b25a046aea02157c57c0f5059]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 13:22:56.069228 14869 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet db6d3d345bd3495e9ec9a0e75ecd0562. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:56.069927 14948 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 117ae8a22b1d46579ce047f99e30520b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:56.027966 15091 tablet_service.cc:1511] Processing CreateTablet for tablet 70d027ba81f54eba882756b941186710 (DEFAULT_TABLE table=test-workload [id=9261731b25a046aea02157c57c0f5059]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 13:22:56.047382 15017 tablet_service.cc:1511] Processing CreateTablet for tablet 70d027ba81f54eba882756b941186710 (DEFAULT_TABLE table=test-workload [id=9261731b25a046aea02157c57c0f5059]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 13:22:56.072718 14866 tablet_service.cc:1511] Processing CreateTablet for tablet 7560205f5d324c7d821dff8efe7a6256 (DEFAULT_TABLE table=test-workload [id=9261731b25a046aea02157c57c0f5059]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 13:22:56.072741 15091 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 70d027ba81f54eba882756b941186710. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:56.070056 14873 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d65eaa0ab4574a1ea92b3848d4dc9c4d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:56.074891 15016 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5cd72bf3a0114fddb1bda8271debea24. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:56.078086 15024 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 48be8cf045364be999b8f0fd547b7b9d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:56.080646 15020 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5df7528567fd4291a888bfb37c28dc27. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:56.084532 14947 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 46ed2e9dd1324ac4a6e07f813cfebb7e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:56.086776 14941 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7560205f5d324c7d821dff8efe7a6256. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:56.088708 15015 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7560205f5d324c7d821dff8efe7a6256. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:56.092522 14943 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e75f8237624f42f793627366f05b792a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:56.092756 14866 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7560205f5d324c7d821dff8efe7a6256. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:56.094755 14871 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 914c9c0c3be1486f8dcce382b61b5450. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:56.096138 14870 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5df7528567fd4291a888bfb37c28dc27. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:56.097378 14872 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 46ed2e9dd1324ac4a6e07f813cfebb7e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:56.098078 15017 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 70d027ba81f54eba882756b941186710. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:56.098954 14867 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 70d027ba81f54eba882756b941186710. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:56.110988 14944 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet db6d3d345bd3495e9ec9a0e75ecd0562. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:56.112780 14942 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5cd72bf3a0114fddb1bda8271debea24. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:22:56.143321 14830 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:22:56.200443 15023 tablet_service.cc:1511] Processing CreateTablet for tablet e85432ede09747339c957cdaa7d15ac6 (DEFAULT_TABLE table=test-workload [id=9261731b25a046aea02157c57c0f5059]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 13:22:56.201934 15023 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e85432ede09747339c957cdaa7d15ac6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:56.273732 15155 tablet_bootstrap.cc:492] T 117ae8a22b1d46579ce047f99e30520b P a1a22e9119494570b6d2217713fd7e43: Bootstrap starting.
I20260709 13:22:56.275513 15153 tablet_bootstrap.cc:492] T 48be8cf045364be999b8f0fd547b7b9d P 0efc951052454eec9a58b0cd025945b8: Bootstrap starting.
I20260709 13:22:56.278043 14950 tablet_service.cc:1511] Processing CreateTablet for tablet 268027ae94a54cf4acf51c54c7b9032b (DEFAULT_TABLE table=test-workload [id=9261731b25a046aea02157c57c0f5059]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 13:22:56.279731 14950 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 268027ae94a54cf4acf51c54c7b9032b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:56.292867 15154 tablet_bootstrap.cc:492] T d65eaa0ab4574a1ea92b3848d4dc9c4d P a722e54d227f4c29a9ed6ce77858003a: Bootstrap starting.
I20260709 13:22:56.304756 15095 tablet_service.cc:1511] Processing CreateTablet for tablet 2a862e106a9e48a692bc72ea8c03ab39 (DEFAULT_TABLE table=test-workload [id=9261731b25a046aea02157c57c0f5059]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 13:22:56.305055 15022 tablet_service.cc:1511] Processing CreateTablet for tablet 7b8e0fe5ef6d4c42b9854399aac3a1d6 (DEFAULT_TABLE table=test-workload [id=9261731b25a046aea02157c57c0f5059]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 13:22:56.306244 15095 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2a862e106a9e48a692bc72ea8c03ab39. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:56.308730 15091 tablet_service.cc:1511] Processing CreateTablet for tablet e85432ede09747339c957cdaa7d15ac6 (DEFAULT_TABLE table=test-workload [id=9261731b25a046aea02157c57c0f5059]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 13:22:56.310529 15091 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e85432ede09747339c957cdaa7d15ac6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:56.308823 15019 tablet_service.cc:1511] Processing CreateTablet for tablet 74a144396e4443288858878b63f08cc8 (DEFAULT_TABLE table=test-workload [id=9261731b25a046aea02157c57c0f5059]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 13:22:56.306270 15022 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7b8e0fe5ef6d4c42b9854399aac3a1d6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:56.279558 14868 tablet_service.cc:1511] Processing CreateTablet for tablet 268027ae94a54cf4acf51c54c7b9032b (DEFAULT_TABLE table=test-workload [id=9261731b25a046aea02157c57c0f5059]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 13:22:56.312701 14874 tablet_service.cc:1511] Processing CreateTablet for tablet e85432ede09747339c957cdaa7d15ac6 (DEFAULT_TABLE table=test-workload [id=9261731b25a046aea02157c57c0f5059]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 13:22:56.346501 15156 tablet_bootstrap.cc:492] T 48be8cf045364be999b8f0fd547b7b9d P f3a500981b494979b58d2b1041fec9c8: Bootstrap starting.
I20260709 13:22:56.347795 15153 tablet_bootstrap.cc:654] T 48be8cf045364be999b8f0fd547b7b9d P 0efc951052454eec9a58b0cd025945b8: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:56.334100 14868 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 268027ae94a54cf4acf51c54c7b9032b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:56.355365 14910 heartbeater.cc:499] Master 127.5.126.126:45503 was elected leader, sending a full tablet report...
I20260709 13:22:56.352232 15154 tablet_bootstrap.cc:654] T d65eaa0ab4574a1ea92b3848d4dc9c4d P a722e54d227f4c29a9ed6ce77858003a: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:56.338234 15019 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 74a144396e4443288858878b63f08cc8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:56.376605 15097 tablet_service.cc:1511] Processing CreateTablet for tablet 7b8e0fe5ef6d4c42b9854399aac3a1d6 (DEFAULT_TABLE table=test-workload [id=9261731b25a046aea02157c57c0f5059]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 13:22:56.378393 15097 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7b8e0fe5ef6d4c42b9854399aac3a1d6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:56.390537 15155 tablet_bootstrap.cc:654] T 117ae8a22b1d46579ce047f99e30520b P a1a22e9119494570b6d2217713fd7e43: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:56.394375 14948 tablet_service.cc:1511] Processing CreateTablet for tablet 7b8e0fe5ef6d4c42b9854399aac3a1d6 (DEFAULT_TABLE table=test-workload [id=9261731b25a046aea02157c57c0f5059]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 13:22:56.395841 14948 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7b8e0fe5ef6d4c42b9854399aac3a1d6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:56.396206 14874 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e85432ede09747339c957cdaa7d15ac6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:56.399243 15020 tablet_service.cc:1511] Processing CreateTablet for tablet f0424da0ffb84ba5931fe92f6dd57c5f (DEFAULT_TABLE table=test-workload [id=9261731b25a046aea02157c57c0f5059]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 13:22:56.402824 15015 tablet_service.cc:1511] Processing CreateTablet for tablet b025139466084200b70879196cd3f922 (DEFAULT_TABLE table=test-workload [id=9261731b25a046aea02157c57c0f5059]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 13:22:56.405355 14870 tablet_service.cc:1511] Processing CreateTablet for tablet 2a862e106a9e48a692bc72ea8c03ab39 (DEFAULT_TABLE table=test-workload [id=9261731b25a046aea02157c57c0f5059]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 13:22:56.416842 15020 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f0424da0ffb84ba5931fe92f6dd57c5f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:56.418483 14872 tablet_service.cc:1511] Processing CreateTablet for tablet dadd194761924530aede05672c9eecf9 (DEFAULT_TABLE table=test-workload [id=9261731b25a046aea02157c57c0f5059]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 13:22:56.421837 14872 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dadd194761924530aede05672c9eecf9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:56.423002 14945 tablet_service.cc:1511] Processing CreateTablet for tablet f0424da0ffb84ba5931fe92f6dd57c5f (DEFAULT_TABLE table=test-workload [id=9261731b25a046aea02157c57c0f5059]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 13:22:56.409598 14873 tablet_service.cc:1511] Processing CreateTablet for tablet 74a144396e4443288858878b63f08cc8 (DEFAULT_TABLE table=test-workload [id=9261731b25a046aea02157c57c0f5059]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 13:22:56.424996 15015 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b025139466084200b70879196cd3f922. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:56.425501 14873 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 74a144396e4443288858878b63f08cc8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:56.406927 15093 tablet_service.cc:1511] Processing CreateTablet for tablet dadd194761924530aede05672c9eecf9 (DEFAULT_TABLE table=test-workload [id=9261731b25a046aea02157c57c0f5059]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 13:22:56.457058 14945 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f0424da0ffb84ba5931fe92f6dd57c5f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:56.440398 15018 tablet_service.cc:1511] Processing CreateTablet for tablet dadd194761924530aede05672c9eecf9 (DEFAULT_TABLE table=test-workload [id=9261731b25a046aea02157c57c0f5059]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 13:22:56.463443 15093 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dadd194761924530aede05672c9eecf9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:56.428983 14946 tablet_service.cc:1511] Processing CreateTablet for tablet 74a144396e4443288858878b63f08cc8 (DEFAULT_TABLE table=test-workload [id=9261731b25a046aea02157c57c0f5059]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 13:22:56.468611 14870 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2a862e106a9e48a692bc72ea8c03ab39. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:56.470845 14985 heartbeater.cc:499] Master 127.5.126.126:45503 was elected leader, sending a full tablet report...
I20260709 13:22:56.485035 15018 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dadd194761924530aede05672c9eecf9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:56.501988 15090 tablet_service.cc:1511] Processing CreateTablet for tablet ced632bda66e4a74b9c854befbcbac9b (DEFAULT_TABLE table=test-workload [id=9261731b25a046aea02157c57c0f5059]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 13:22:56.505613 15095 tablet_service.cc:1511] Processing CreateTablet for tablet aecef3c240394d54844ec8170e9cad59 (DEFAULT_TABLE table=test-workload [id=9261731b25a046aea02157c57c0f5059]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 13:22:56.507525 15155 tablet_bootstrap.cc:492] T 117ae8a22b1d46579ce047f99e30520b P a1a22e9119494570b6d2217713fd7e43: No bootstrap required, opened a new log
I20260709 13:22:56.507861 14946 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 74a144396e4443288858878b63f08cc8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:56.508077 15155 ts_tablet_manager.cc:1403] T 117ae8a22b1d46579ce047f99e30520b P a1a22e9119494570b6d2217713fd7e43: Time spent bootstrapping tablet: real 0.235s	user 0.010s	sys 0.010s
I20260709 13:22:56.512156 15089 tablet_service.cc:1511] Processing CreateTablet for tablet f0424da0ffb84ba5931fe92f6dd57c5f (DEFAULT_TABLE table=test-workload [id=9261731b25a046aea02157c57c0f5059]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 13:22:56.498992 14949 tablet_service.cc:1511] Processing CreateTablet for tablet 2a862e106a9e48a692bc72ea8c03ab39 (DEFAULT_TABLE table=test-workload [id=9261731b25a046aea02157c57c0f5059]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 13:22:56.514443 14949 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2a862e106a9e48a692bc72ea8c03ab39. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:56.514367 14869 tablet_service.cc:1511] Processing CreateTablet for tablet aecef3c240394d54844ec8170e9cad59 (DEFAULT_TABLE table=test-workload [id=9261731b25a046aea02157c57c0f5059]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 13:22:56.515867 14869 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aecef3c240394d54844ec8170e9cad59. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:56.530185 15023 tablet_service.cc:1511] Processing CreateTablet for tablet 7a4cf38d1a6644f082f401b9b26bfb27 (DEFAULT_TABLE table=test-workload [id=9261731b25a046aea02157c57c0f5059]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 13:22:56.516903 15092 tablet_service.cc:1511] Processing CreateTablet for tablet 7a4cf38d1a6644f082f401b9b26bfb27 (DEFAULT_TABLE table=test-workload [id=9261731b25a046aea02157c57c0f5059]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 13:22:56.522967 14943 tablet_service.cc:1511] Processing CreateTablet for tablet ced632bda66e4a74b9c854befbcbac9b (DEFAULT_TABLE table=test-workload [id=9261731b25a046aea02157c57c0f5059]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 13:22:56.535422 14943 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ced632bda66e4a74b9c854befbcbac9b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:56.525121 14875 tablet_service.cc:1511] Processing CreateTablet for tablet b025139466084200b70879196cd3f922 (DEFAULT_TABLE table=test-workload [id=9261731b25a046aea02157c57c0f5059]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 13:22:56.538328 14875 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b025139466084200b70879196cd3f922. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:56.512732 14941 tablet_service.cc:1511] Processing CreateTablet for tablet aecef3c240394d54844ec8170e9cad59 (DEFAULT_TABLE table=test-workload [id=9261731b25a046aea02157c57c0f5059]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 13:22:56.527127 14867 tablet_service.cc:1511] Processing CreateTablet for tablet 7a4cf38d1a6644f082f401b9b26bfb27 (DEFAULT_TABLE table=test-workload [id=9261731b25a046aea02157c57c0f5059]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 13:22:56.526933 15021 tablet_service.cc:1511] Processing CreateTablet for tablet ced632bda66e4a74b9c854befbcbac9b (DEFAULT_TABLE table=test-workload [id=9261731b25a046aea02157c57c0f5059]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 13:22:56.470916 14944 tablet_service.cc:1511] Processing CreateTablet for tablet b025139466084200b70879196cd3f922 (DEFAULT_TABLE table=test-workload [id=9261731b25a046aea02157c57c0f5059]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 13:22:56.531921 15023 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7a4cf38d1a6644f082f401b9b26bfb27. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:56.548594 14941 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aecef3c240394d54844ec8170e9cad59. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:56.549773 15153 tablet_bootstrap.cc:492] T 48be8cf045364be999b8f0fd547b7b9d P 0efc951052454eec9a58b0cd025945b8: No bootstrap required, opened a new log
I20260709 13:22:56.549609 15096 tablet_service.cc:1511] Processing CreateTablet for tablet f954c6c25a25443abd9705c8e909bf47 (DEFAULT_TABLE table=test-workload [id=9261731b25a046aea02157c57c0f5059]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 13:22:56.549810 14867 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7a4cf38d1a6644f082f401b9b26bfb27. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:56.550407 15153 ts_tablet_manager.cc:1403] T 48be8cf045364be999b8f0fd547b7b9d P 0efc951052454eec9a58b0cd025945b8: Time spent bootstrapping tablet: real 0.275s	user 0.006s	sys 0.020s
I20260709 13:22:56.565034 14944 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b025139466084200b70879196cd3f922. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:56.569257 15098 tablet_service.cc:1511] Processing CreateTablet for tablet 0819f8999271428481a1f839026171a7 (DEFAULT_TABLE table=test-workload [id=9261731b25a046aea02157c57c0f5059]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 13:22:56.570163 15095 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aecef3c240394d54844ec8170e9cad59. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:56.571020 15098 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0819f8999271428481a1f839026171a7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:56.572088 15090 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ced632bda66e4a74b9c854befbcbac9b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:56.573837 15155 raft_consensus.cc:359] T 117ae8a22b1d46579ce047f99e30520b P a1a22e9119494570b6d2217713fd7e43 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } } peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } } peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } }
I20260709 13:22:56.574668 15155 raft_consensus.cc:385] T 117ae8a22b1d46579ce047f99e30520b P a1a22e9119494570b6d2217713fd7e43 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:56.575031 15155 raft_consensus.cc:740] T 117ae8a22b1d46579ce047f99e30520b P a1a22e9119494570b6d2217713fd7e43 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a1a22e9119494570b6d2217713fd7e43, State: Initialized, Role: FOLLOWER
I20260709 13:22:56.579054 15089 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f0424da0ffb84ba5931fe92f6dd57c5f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:56.580780 15021 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ced632bda66e4a74b9c854befbcbac9b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:56.583300 15094 tablet_service.cc:1511] Processing CreateTablet for tablet e429eefef04d433e8f18dfbc0387068d (DEFAULT_TABLE table=test-workload [id=9261731b25a046aea02157c57c0f5059]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 13:22:56.585136 15094 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e429eefef04d433e8f18dfbc0387068d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:56.587069 15059 heartbeater.cc:499] Master 127.5.126.126:45503 was elected leader, sending a full tablet report...
I20260709 13:22:56.591895 15154 tablet_bootstrap.cc:492] T d65eaa0ab4574a1ea92b3848d4dc9c4d P a722e54d227f4c29a9ed6ce77858003a: No bootstrap required, opened a new log
I20260709 13:22:56.592577 15154 ts_tablet_manager.cc:1403] T d65eaa0ab4574a1ea92b3848d4dc9c4d P a722e54d227f4c29a9ed6ce77858003a: Time spent bootstrapping tablet: real 0.300s	user 0.012s	sys 0.014s
I20260709 13:22:56.595867 15024 tablet_service.cc:1511] Processing CreateTablet for tablet e3693e8a3b0444bf978dc845dcfd2a45 (DEFAULT_TABLE table=test-workload [id=9261731b25a046aea02157c57c0f5059]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 13:22:56.595989 15015 tablet_service.cc:1511] Processing CreateTablet for tablet 0819f8999271428481a1f839026171a7 (DEFAULT_TABLE table=test-workload [id=9261731b25a046aea02157c57c0f5059]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 13:22:56.597429 15024 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e3693e8a3b0444bf978dc845dcfd2a45. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:56.602283 15015 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0819f8999271428481a1f839026171a7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:56.614568 15016 tablet_service.cc:1511] Processing CreateTablet for tablet 107541237b4a452e8b47b0c3527b7ede (DEFAULT_TABLE table=test-workload [id=9261731b25a046aea02157c57c0f5059]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 13:22:56.632468 14950 tablet_service.cc:1511] Processing CreateTablet for tablet e3693e8a3b0444bf978dc845dcfd2a45 (DEFAULT_TABLE table=test-workload [id=9261731b25a046aea02157c57c0f5059]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 13:22:56.634116 14950 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e3693e8a3b0444bf978dc845dcfd2a45. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:22:56.636191 14769 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.5.126.66:34613, user_credentials={real_user=slave}} blocked reactor thread for 57744.2us
W20260709 13:22:56.637197 14768 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.5.126.67:38125, user_credentials={real_user=slave}} blocked reactor thread for 50163.9us
I20260709 13:22:56.644385 14942 tablet_service.cc:1511] Processing CreateTablet for tablet f954c6c25a25443abd9705c8e909bf47 (DEFAULT_TABLE table=test-workload [id=9261731b25a046aea02157c57c0f5059]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 13:22:56.645859 14942 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f954c6c25a25443abd9705c8e909bf47. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:56.648216 14874 tablet_service.cc:1511] Processing CreateTablet for tablet f954c6c25a25443abd9705c8e909bf47 (DEFAULT_TABLE table=test-workload [id=9261731b25a046aea02157c57c0f5059]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 13:22:56.648677 14947 tablet_service.cc:1511] Processing CreateTablet for tablet e429eefef04d433e8f18dfbc0387068d (DEFAULT_TABLE table=test-workload [id=9261731b25a046aea02157c57c0f5059]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 13:22:56.649199 15153 raft_consensus.cc:359] T 48be8cf045364be999b8f0fd547b7b9d P 0efc951052454eec9a58b0cd025945b8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } } peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } } peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } }
I20260709 13:22:56.650022 15153 raft_consensus.cc:385] T 48be8cf045364be999b8f0fd547b7b9d P 0efc951052454eec9a58b0cd025945b8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:56.650378 15153 raft_consensus.cc:740] T 48be8cf045364be999b8f0fd547b7b9d P 0efc951052454eec9a58b0cd025945b8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0efc951052454eec9a58b0cd025945b8, State: Initialized, Role: FOLLOWER
I20260709 13:22:56.651196 15153 consensus_queue.cc:260] T 48be8cf045364be999b8f0fd547b7b9d P 0efc951052454eec9a58b0cd025945b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } } peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } } peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } }
I20260709 13:22:56.652385 15092 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7a4cf38d1a6644f082f401b9b26bfb27. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:56.653370 14874 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f954c6c25a25443abd9705c8e909bf47. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:56.656308 15155 consensus_queue.cc:260] T 117ae8a22b1d46579ce047f99e30520b P a1a22e9119494570b6d2217713fd7e43 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } } peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } } peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } }
I20260709 13:22:56.659104 14866 tablet_service.cc:1511] Processing CreateTablet for tablet 0819f8999271428481a1f839026171a7 (DEFAULT_TABLE table=test-workload [id=9261731b25a046aea02157c57c0f5059]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 13:22:56.660650 14866 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0819f8999271428481a1f839026171a7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:56.668476 15096 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f954c6c25a25443abd9705c8e909bf47. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:56.673225 14941 tablet_service.cc:1511] Processing CreateTablet for tablet 107541237b4a452e8b47b0c3527b7ede (DEFAULT_TABLE table=test-workload [id=9261731b25a046aea02157c57c0f5059]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 13:22:56.596252 15017 tablet_service.cc:1511] Processing CreateTablet for tablet e429eefef04d433e8f18dfbc0387068d (DEFAULT_TABLE table=test-workload [id=9261731b25a046aea02157c57c0f5059]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 13:22:56.685299 15154 raft_consensus.cc:359] T d65eaa0ab4574a1ea92b3848d4dc9c4d P a722e54d227f4c29a9ed6ce77858003a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } } peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } } peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } }
I20260709 13:22:56.686290 15154 raft_consensus.cc:385] T d65eaa0ab4574a1ea92b3848d4dc9c4d P a722e54d227f4c29a9ed6ce77858003a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:56.659104 15091 tablet_service.cc:1511] Processing CreateTablet for tablet e4f2c694c8194f1e86ad76c7ff051ea7 (DEFAULT_TABLE table=test-workload [id=9261731b25a046aea02157c57c0f5059]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 13:22:56.686664 15154 raft_consensus.cc:740] T d65eaa0ab4574a1ea92b3848d4dc9c4d P a722e54d227f4c29a9ed6ce77858003a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a722e54d227f4c29a9ed6ce77858003a, State: Initialized, Role: FOLLOWER
I20260709 13:22:56.687726 15091 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e4f2c694c8194f1e86ad76c7ff051ea7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:56.687551 15154 consensus_queue.cc:260] T d65eaa0ab4574a1ea92b3848d4dc9c4d P a722e54d227f4c29a9ed6ce77858003a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } } peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } } peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } }
I20260709 13:22:56.689421 15133 heartbeater.cc:499] Master 127.5.126.126:45503 was elected leader, sending a full tablet report...
I20260709 13:22:56.650130 14947 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e429eefef04d433e8f18dfbc0387068d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:56.699656 15156 tablet_bootstrap.cc:654] T 48be8cf045364be999b8f0fd547b7b9d P f3a500981b494979b58d2b1041fec9c8: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:56.700269 14871 tablet_service.cc:1511] Processing CreateTablet for tablet e3693e8a3b0444bf978dc845dcfd2a45 (DEFAULT_TABLE table=test-workload [id=9261731b25a046aea02157c57c0f5059]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 13:22:56.706571 15016 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 107541237b4a452e8b47b0c3527b7ede. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:56.722934 15155 ts_tablet_manager.cc:1434] T 117ae8a22b1d46579ce047f99e30520b P a1a22e9119494570b6d2217713fd7e43: Time spent starting tablet: real 0.214s	user 0.005s	sys 0.008s
I20260709 13:22:56.724823 14871 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e3693e8a3b0444bf978dc845dcfd2a45. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:56.725908 14873 tablet_service.cc:1511] Processing CreateTablet for tablet e4f2c694c8194f1e86ad76c7ff051ea7 (DEFAULT_TABLE table=test-workload [id=9261731b25a046aea02157c57c0f5059]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 13:22:56.727375 14873 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e4f2c694c8194f1e86ad76c7ff051ea7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:56.691648 14874 tablet_service.cc:1511] Processing CreateTablet for tablet 107541237b4a452e8b47b0c3527b7ede (DEFAULT_TABLE table=test-workload [id=9261731b25a046aea02157c57c0f5059]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 13:22:56.729194 14874 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 107541237b4a452e8b47b0c3527b7ede. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:56.729765 14941 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 107541237b4a452e8b47b0c3527b7ede. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:56.747448 14945 tablet_service.cc:1511] Processing CreateTablet for tablet e4f2c694c8194f1e86ad76c7ff051ea7 (DEFAULT_TABLE table=test-workload [id=9261731b25a046aea02157c57c0f5059]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 13:22:56.751081 14945 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e4f2c694c8194f1e86ad76c7ff051ea7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:56.747589 15097 tablet_service.cc:1511] Processing CreateTablet for tablet 03b63e2bee374ed5931dab67ee14b555 (DEFAULT_TABLE table=test-workload [id=9261731b25a046aea02157c57c0f5059]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 13:22:56.759639 15097 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 03b63e2bee374ed5931dab67ee14b555. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:56.775892 14872 tablet_service.cc:1511] Processing CreateTablet for tablet 03b63e2bee374ed5931dab67ee14b555 (DEFAULT_TABLE table=test-workload [id=9261731b25a046aea02157c57c0f5059]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 13:22:56.777498 14872 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 03b63e2bee374ed5931dab67ee14b555. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:56.786749 15020 tablet_service.cc:1511] Processing CreateTablet for tablet 03b63e2bee374ed5931dab67ee14b555 (DEFAULT_TABLE table=test-workload [id=9261731b25a046aea02157c57c0f5059]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 13:22:56.792877 15020 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 03b63e2bee374ed5931dab67ee14b555. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:56.793789 15017 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e429eefef04d433e8f18dfbc0387068d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:56.794288 15019 tablet_service.cc:1511] Processing CreateTablet for tablet decdd091b0f243d786ee350a437b30f1 (DEFAULT_TABLE table=test-workload [id=9261731b25a046aea02157c57c0f5059]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 13:22:56.797880 15018 tablet_service.cc:1511] Processing CreateTablet for tablet c3abd41db36d404089eaf1f9063bbcb0 (DEFAULT_TABLE table=test-workload [id=9261731b25a046aea02157c57c0f5059]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 13:22:56.800331 15155 tablet_bootstrap.cc:492] T d65eaa0ab4574a1ea92b3848d4dc9c4d P a1a22e9119494570b6d2217713fd7e43: Bootstrap starting.
I20260709 13:22:56.795985 15019 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet decdd091b0f243d786ee350a437b30f1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:56.801851 15015 tablet_service.cc:1511] Processing CreateTablet for tablet 8996bae84ecc4bffa0239d64dce7b24f (DEFAULT_TABLE table=test-workload [id=9261731b25a046aea02157c57c0f5059]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 13:22:56.804987 15018 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c3abd41db36d404089eaf1f9063bbcb0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:56.805321 15022 tablet_service.cc:1511] Processing CreateTablet for tablet e4a490a7748841c3803607059f9d8825 (DEFAULT_TABLE table=test-workload [id=9261731b25a046aea02157c57c0f5059]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
W20260709 13:22:56.810034 15060 tablet.cc:2406] T 117ae8a22b1d46579ce047f99e30520b P a1a22e9119494570b6d2217713fd7e43: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 13:22:56.816918 15015 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8996bae84ecc4bffa0239d64dce7b24f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:56.818095 15155 tablet_bootstrap.cc:654] T d65eaa0ab4574a1ea92b3848d4dc9c4d P a1a22e9119494570b6d2217713fd7e43: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:56.824596 15022 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e4a490a7748841c3803607059f9d8825. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:56.777316 15154 ts_tablet_manager.cc:1434] T d65eaa0ab4574a1ea92b3848d4dc9c4d P a722e54d227f4c29a9ed6ce77858003a: Time spent starting tablet: real 0.184s	user 0.024s	sys 0.002s
I20260709 13:22:56.828711 15098 tablet_service.cc:1511] Processing CreateTablet for tablet decdd091b0f243d786ee350a437b30f1 (DEFAULT_TABLE table=test-workload [id=9261731b25a046aea02157c57c0f5059]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 13:22:56.829249 15154 tablet_bootstrap.cc:492] T 70d027ba81f54eba882756b941186710 P a722e54d227f4c29a9ed6ce77858003a: Bootstrap starting.
I20260709 13:22:56.830245 15098 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet decdd091b0f243d786ee350a437b30f1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:56.833178 14868 tablet_service.cc:1511] Processing CreateTablet for tablet c3abd41db36d404089eaf1f9063bbcb0 (DEFAULT_TABLE table=test-workload [id=9261731b25a046aea02157c57c0f5059]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 13:22:56.834529 14868 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c3abd41db36d404089eaf1f9063bbcb0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:56.837311 14944 tablet_service.cc:1511] Processing CreateTablet for tablet decdd091b0f243d786ee350a437b30f1 (DEFAULT_TABLE table=test-workload [id=9261731b25a046aea02157c57c0f5059]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 13:22:56.837942 15163 raft_consensus.cc:493] T 48be8cf045364be999b8f0fd547b7b9d P 0efc951052454eec9a58b0cd025945b8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:56.838729 14944 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet decdd091b0f243d786ee350a437b30f1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:56.839116 15163 raft_consensus.cc:515] T 48be8cf045364be999b8f0fd547b7b9d P 0efc951052454eec9a58b0cd025945b8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } } peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } } peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } }
I20260709 13:22:56.859189 15161 raft_consensus.cc:493] T d65eaa0ab4574a1ea92b3848d4dc9c4d P a722e54d227f4c29a9ed6ce77858003a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:56.859851 15161 raft_consensus.cc:515] T d65eaa0ab4574a1ea92b3848d4dc9c4d P a722e54d227f4c29a9ed6ce77858003a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } } peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } } peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } }
I20260709 13:22:56.908859 15153 ts_tablet_manager.cc:1434] T 48be8cf045364be999b8f0fd547b7b9d P 0efc951052454eec9a58b0cd025945b8: Time spent starting tablet: real 0.358s	user 0.010s	sys 0.016s
I20260709 13:22:56.910099 15161 leader_election.cc:290] T d65eaa0ab4574a1ea92b3848d4dc9c4d P a722e54d227f4c29a9ed6ce77858003a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a1a22e9119494570b6d2217713fd7e43 (127.5.126.67:38125), f3a500981b494979b58d2b1041fec9c8 (127.5.126.65:34129)
I20260709 13:22:56.879271 15163 leader_election.cc:290] T 48be8cf045364be999b8f0fd547b7b9d P 0efc951052454eec9a58b0cd025945b8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f3a500981b494979b58d2b1041fec9c8 (127.5.126.65:34129), a1a22e9119494570b6d2217713fd7e43 (127.5.126.67:38125)
I20260709 13:22:56.931512 14943 tablet_service.cc:1511] Processing CreateTablet for tablet c3abd41db36d404089eaf1f9063bbcb0 (DEFAULT_TABLE table=test-workload [id=9261731b25a046aea02157c57c0f5059]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 13:22:56.964669 15153 tablet_bootstrap.cc:492] T 117ae8a22b1d46579ce047f99e30520b P 0efc951052454eec9a58b0cd025945b8: Bootstrap starting.
I20260709 13:22:56.972203 15160 raft_consensus.cc:493] T 117ae8a22b1d46579ce047f99e30520b P a1a22e9119494570b6d2217713fd7e43 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:56.981026 15160 raft_consensus.cc:515] T 117ae8a22b1d46579ce047f99e30520b P a1a22e9119494570b6d2217713fd7e43 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } } peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } } peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } }
I20260709 13:22:56.973737 15096 tablet_service.cc:1511] Processing CreateTablet for tablet 8996bae84ecc4bffa0239d64dce7b24f (DEFAULT_TABLE table=test-workload [id=9261731b25a046aea02157c57c0f5059]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 13:22:56.982856 15096 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8996bae84ecc4bffa0239d64dce7b24f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:56.980892 14943 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c3abd41db36d404089eaf1f9063bbcb0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:56.983899 15160 leader_election.cc:290] T 117ae8a22b1d46579ce047f99e30520b P a1a22e9119494570b6d2217713fd7e43 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0efc951052454eec9a58b0cd025945b8 (127.5.126.66:34613), a722e54d227f4c29a9ed6ce77858003a (127.5.126.68:46669)
I20260709 13:22:57.012423 15156 tablet_bootstrap.cc:492] T 48be8cf045364be999b8f0fd547b7b9d P f3a500981b494979b58d2b1041fec9c8: No bootstrap required, opened a new log
I20260709 13:22:57.013059 15156 ts_tablet_manager.cc:1403] T 48be8cf045364be999b8f0fd547b7b9d P f3a500981b494979b58d2b1041fec9c8: Time spent bootstrapping tablet: real 0.667s	user 0.014s	sys 0.026s
I20260709 13:22:57.025509 14949 tablet_service.cc:1511] Processing CreateTablet for tablet e4a490a7748841c3803607059f9d8825 (DEFAULT_TABLE table=test-workload [id=9261731b25a046aea02157c57c0f5059]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 13:22:57.026777 15154 tablet_bootstrap.cc:654] T 70d027ba81f54eba882756b941186710 P a722e54d227f4c29a9ed6ce77858003a: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:57.027364 14949 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e4a490a7748841c3803607059f9d8825. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:57.029359 14946 tablet_service.cc:1511] Processing CreateTablet for tablet 532cc9041f414e018098570192e0fae8 (DEFAULT_TABLE table=test-workload [id=9261731b25a046aea02157c57c0f5059]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 13:22:57.033330 14869 tablet_service.cc:1511] Processing CreateTablet for tablet 532cc9041f414e018098570192e0fae8 (DEFAULT_TABLE table=test-workload [id=9261731b25a046aea02157c57c0f5059]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 13:22:57.036842 15155 tablet_bootstrap.cc:492] T d65eaa0ab4574a1ea92b3848d4dc9c4d P a1a22e9119494570b6d2217713fd7e43: No bootstrap required, opened a new log
I20260709 13:22:57.038986 15093 tablet_service.cc:1511] Processing CreateTablet for tablet e4a490a7748841c3803607059f9d8825 (DEFAULT_TABLE table=test-workload [id=9261731b25a046aea02157c57c0f5059]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 13:22:57.046648 15156 raft_consensus.cc:359] T 48be8cf045364be999b8f0fd547b7b9d P f3a500981b494979b58d2b1041fec9c8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } } peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } } peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } }
I20260709 13:22:57.071257 15156 raft_consensus.cc:385] T 48be8cf045364be999b8f0fd547b7b9d P f3a500981b494979b58d2b1041fec9c8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:57.080582 15156 raft_consensus.cc:740] T 48be8cf045364be999b8f0fd547b7b9d P f3a500981b494979b58d2b1041fec9c8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f3a500981b494979b58d2b1041fec9c8, State: Initialized, Role: FOLLOWER
I20260709 13:22:57.082196 14867 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:43362 (request call id 17) took 1008 ms. Trace:
I20260709 13:22:57.082692 14867 rpcz_store.cc:276] 0709 13:22:56.074232 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:22:56.526204 (+451972us) service_pool.cc:224] Handling call
0709 13:22:56.549271 (+ 23067us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:22:56.549384 (+   113us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:22:56.719904 (+170520us) tablet_metadata.cc:665] Metadata flushed
0709 13:22:57.081599 (+361695us) tablet_replica.cc:206] Creating consensus instance
0709 13:22:57.082117 (+   518us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:22:57.081761 15156 consensus_queue.cc:260] T 48be8cf045364be999b8f0fd547b7b9d P f3a500981b494979b58d2b1041fec9c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } } peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } } peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } }
I20260709 13:22:57.063252 15153 tablet_bootstrap.cc:654] T 117ae8a22b1d46579ce047f99e30520b P 0efc951052454eec9a58b0cd025945b8: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:56.971983 15094 tablet_service.cc:1511] Processing CreateTablet for tablet 532cc9041f414e018098570192e0fae8 (DEFAULT_TABLE table=test-workload [id=9261731b25a046aea02157c57c0f5059]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 13:22:57.104136 15155 ts_tablet_manager.cc:1403] T d65eaa0ab4574a1ea92b3848d4dc9c4d P a1a22e9119494570b6d2217713fd7e43: Time spent bootstrapping tablet: real 0.304s	user 0.020s	sys 0.007s
I20260709 13:22:57.113603 15093 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e4a490a7748841c3803607059f9d8825. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:57.115327 14946 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 532cc9041f414e018098570192e0fae8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:57.117324 15094 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 532cc9041f414e018098570192e0fae8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:57.128608 14875 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:43362 (request call id 15) took 1055 ms. Trace:
I20260709 13:22:57.129169 14875 rpcz_store.cc:276] 0709 13:22:56.073492 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:22:56.432190 (+358698us) service_pool.cc:224] Handling call
0709 13:22:56.537748 (+105558us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:22:56.537869 (+   121us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:22:56.904238 (+366369us) tablet_metadata.cc:665] Metadata flushed
0709 13:22:57.071246 (+167008us) tablet_replica.cc:206] Creating consensus instance
0709 13:22:57.128518 (+ 57272us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:22:57.111205 14871 tablet_service.cc:1511] Processing CreateTablet for tablet d64d06459b344ff99c0df07c249c3a60 (DEFAULT_TABLE table=test-workload [id=9261731b25a046aea02157c57c0f5059]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 13:22:57.133719 14871 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d64d06459b344ff99c0df07c249c3a60. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:57.138841 14875 tablet_service.cc:1511] Processing CreateTablet for tablet e1ae79ed138a4950a681f24aa1107ef3 (DEFAULT_TABLE table=test-workload [id=9261731b25a046aea02157c57c0f5059]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 13:22:57.079422 14873 tablet_service.cc:1511] Processing CreateTablet for tablet 8996bae84ecc4bffa0239d64dce7b24f (DEFAULT_TABLE table=test-workload [id=9261731b25a046aea02157c57c0f5059]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 13:22:57.141721 14867 tablet_service.cc:1511] Processing CreateTablet for tablet 88a7c4171c664e819837994755edf95c (DEFAULT_TABLE table=test-workload [id=9261731b25a046aea02157c57c0f5059]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 13:22:57.146428 14950 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:53404 (request call id 18) took 1065 ms. Trace:
I20260709 13:22:57.146906 14950 rpcz_store.cc:276] 0709 13:22:56.081402 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:22:56.631314 (+549912us) service_pool.cc:224] Handling call
0709 13:22:56.633539 (+  2225us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:22:56.633657 (+   118us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:22:56.947035 (+313378us) tablet_metadata.cc:665] Metadata flushed
0709 13:22:57.103445 (+156410us) tablet_replica.cc:206] Creating consensus instance
0709 13:22:57.113495 (+ 10050us) spinlock_profiling.cc:243] Waited 4.95 ms on lock 0x7b5800004898. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0c745db1 00007fcc0c885b71 00007fcc0c8861a2 00007fcc157c7bb9 00007fcc148f8d88 00007fcc149bf973 00007fcc149bb70f 00007fcc149bbecd 00007fcc1496a400 00007fcc0ddefaf4 00007fcc0ddefa82
0709 13:22:57.146352 (+ 32857us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":11388288}
I20260709 13:22:57.159691 15091 tablet_service.cc:1511] Processing CreateTablet for tablet d64d06459b344ff99c0df07c249c3a60 (DEFAULT_TABLE table=test-workload [id=9261731b25a046aea02157c57c0f5059]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 13:22:57.160808 14885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48be8cf045364be999b8f0fd547b7b9d" candidate_uuid: "0efc951052454eec9a58b0cd025945b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f3a500981b494979b58d2b1041fec9c8" is_pre_election: true
I20260709 13:22:57.161183 15091 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d64d06459b344ff99c0df07c249c3a60. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:57.161763 14885 raft_consensus.cc:2468] T 48be8cf045364be999b8f0fd547b7b9d P f3a500981b494979b58d2b1041fec9c8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0efc951052454eec9a58b0cd025945b8 in term 0.
I20260709 13:22:57.162878 14869 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 532cc9041f414e018098570192e0fae8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:57.164605 14925 leader_election.cc:304] T 48be8cf045364be999b8f0fd547b7b9d P 0efc951052454eec9a58b0cd025945b8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0efc951052454eec9a58b0cd025945b8, f3a500981b494979b58d2b1041fec9c8; no voters: 
I20260709 13:22:57.166285 15163 raft_consensus.cc:2804] T 48be8cf045364be999b8f0fd547b7b9d P 0efc951052454eec9a58b0cd025945b8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:22:57.166677 15163 raft_consensus.cc:493] T 48be8cf045364be999b8f0fd547b7b9d P 0efc951052454eec9a58b0cd025945b8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:22:57.166991 15163 raft_consensus.cc:3060] T 48be8cf045364be999b8f0fd547b7b9d P 0efc951052454eec9a58b0cd025945b8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:57.135604 14866 tablet_service.cc:1511] Processing CreateTablet for tablet 03f377f48e8849adade3945935d300a9 (DEFAULT_TABLE table=test-workload [id=9261731b25a046aea02157c57c0f5059]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 13:22:57.170499 15024 tablet_service.cc:1511] Processing CreateTablet for tablet 03f377f48e8849adade3945935d300a9 (DEFAULT_TABLE table=test-workload [id=9261731b25a046aea02157c57c0f5059]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 13:22:57.171048 15095 tablet_service.cc:1511] Processing CreateTablet for tablet 03f377f48e8849adade3945935d300a9 (DEFAULT_TABLE table=test-workload [id=9261731b25a046aea02157c57c0f5059]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 13:22:57.172083 15024 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 03f377f48e8849adade3945935d300a9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:57.172528 15095 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 03f377f48e8849adade3945935d300a9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:57.172273 14947 tablet_service.cc:1511] Processing CreateTablet for tablet 88a7c4171c664e819837994755edf95c (DEFAULT_TABLE table=test-workload [id=9261731b25a046aea02157c57c0f5059]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 13:22:57.172991 15020 tablet_service.cc:1511] Processing CreateTablet for tablet 53592d0c0a46440dbfcd26f8b8111859 (DEFAULT_TABLE table=test-workload [id=9261731b25a046aea02157c57c0f5059]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 13:22:57.173523 14947 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 88a7c4171c664e819837994755edf95c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:57.174341 15020 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 53592d0c0a46440dbfcd26f8b8111859. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:57.174990 15022 tablet_service.cc:1511] Processing CreateTablet for tablet 88a7c4171c664e819837994755edf95c (DEFAULT_TABLE table=test-workload [id=9261731b25a046aea02157c57c0f5059]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 13:22:57.175449 15021 tablet_service.cc:1511] Processing CreateTablet for tablet e1ae79ed138a4950a681f24aa1107ef3 (DEFAULT_TABLE table=test-workload [id=9261731b25a046aea02157c57c0f5059]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
W20260709 13:22:57.176244 14830 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:22:57.176409 15022 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 88a7c4171c664e819837994755edf95c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:57.177469 14945 tablet_service.cc:1511] Processing CreateTablet for tablet 53592d0c0a46440dbfcd26f8b8111859 (DEFAULT_TABLE table=test-workload [id=9261731b25a046aea02157c57c0f5059]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 13:22:57.177800 15023 tablet_service.cc:1511] Processing CreateTablet for tablet abc01daa220a47fa8578b0d20a17c9ab (DEFAULT_TABLE table=test-workload [id=9261731b25a046aea02157c57c0f5059]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 13:22:57.178246 14873 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8996bae84ecc4bffa0239d64dce7b24f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:57.178896 14945 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 53592d0c0a46440dbfcd26f8b8111859. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:57.179049 15023 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet abc01daa220a47fa8578b0d20a17c9ab. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:57.180925 15034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48be8cf045364be999b8f0fd547b7b9d" candidate_uuid: "0efc951052454eec9a58b0cd025945b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1a22e9119494570b6d2217713fd7e43" is_pre_election: true
I20260709 13:22:57.182793 15021 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e1ae79ed138a4950a681f24aa1107ef3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:57.184422 14866 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 03f377f48e8849adade3945935d300a9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:57.185233 14867 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 88a7c4171c664e819837994755edf95c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:57.187211 14875 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e1ae79ed138a4950a681f24aa1107ef3. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:22:57.191397 14924 leader_election.cc:343] T 48be8cf045364be999b8f0fd547b7b9d P 0efc951052454eec9a58b0cd025945b8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a1a22e9119494570b6d2217713fd7e43 (127.5.126.67:38125): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:57.107959 15155 raft_consensus.cc:359] T d65eaa0ab4574a1ea92b3848d4dc9c4d P a1a22e9119494570b6d2217713fd7e43 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } } peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } } peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } }
I20260709 13:22:57.221024 14870 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:43362 (request call id 13) took 1148 ms. Trace:
I20260709 13:22:57.221840 15090 tablet_service.cc:1511] Processing CreateTablet for tablet 53592d0c0a46440dbfcd26f8b8111859 (DEFAULT_TABLE table=test-workload [id=9261731b25a046aea02157c57c0f5059]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 13:22:57.223254 15092 tablet_service.cc:1511] Processing CreateTablet for tablet 58a622a48cd24833bc5fc27e03114176 (DEFAULT_TABLE table=test-workload [id=9261731b25a046aea02157c57c0f5059]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 13:22:57.223800 15090 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 53592d0c0a46440dbfcd26f8b8111859. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:57.224998 15092 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 58a622a48cd24833bc5fc27e03114176. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:57.225704 15156 ts_tablet_manager.cc:1434] T 48be8cf045364be999b8f0fd547b7b9d P f3a500981b494979b58d2b1041fec9c8: Time spent starting tablet: real 0.212s	user 0.015s	sys 0.017s
I20260709 13:22:57.229815 15156 tablet_bootstrap.cc:492] T e75f8237624f42f793627366f05b792a P f3a500981b494979b58d2b1041fec9c8: Bootstrap starting.
I20260709 13:22:57.229650 15089 tablet_service.cc:1511] Processing CreateTablet for tablet abc01daa220a47fa8578b0d20a17c9ab (DEFAULT_TABLE table=test-workload [id=9261731b25a046aea02157c57c0f5059]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 13:22:57.231518 15089 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet abc01daa220a47fa8578b0d20a17c9ab. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:57.267210 15153 tablet_bootstrap.cc:492] T 117ae8a22b1d46579ce047f99e30520b P 0efc951052454eec9a58b0cd025945b8: No bootstrap required, opened a new log
I20260709 13:22:57.267795 15153 ts_tablet_manager.cc:1403] T 117ae8a22b1d46579ce047f99e30520b P 0efc951052454eec9a58b0cd025945b8: Time spent bootstrapping tablet: real 0.320s	user 0.007s	sys 0.011s
I20260709 13:22:57.221824 14870 rpcz_store.cc:276] 0709 13:22:56.072783 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:22:56.404347 (+331564us) service_pool.cc:224] Handling call
0709 13:22:56.411328 (+  6981us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:22:56.411438 (+   110us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:22:56.773062 (+361624us) tablet_metadata.cc:665] Metadata flushed
0709 13:22:57.177444 (+404382us) tablet_replica.cc:206] Creating consensus instance
0709 13:22:57.220909 (+ 43465us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:22:57.269436 14950 tablet_service.cc:1511] Processing CreateTablet for tablet e1ae79ed138a4950a681f24aa1107ef3 (DEFAULT_TABLE table=test-workload [id=9261731b25a046aea02157c57c0f5059]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 13:22:57.270375 14870 tablet_service.cc:1511] Processing CreateTablet for tablet abc01daa220a47fa8578b0d20a17c9ab (DEFAULT_TABLE table=test-workload [id=9261731b25a046aea02157c57c0f5059]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 13:22:57.271039 14950 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e1ae79ed138a4950a681f24aa1107ef3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:57.270949 14942 tablet_service.cc:1511] Processing CreateTablet for tablet 58a622a48cd24833bc5fc27e03114176 (DEFAULT_TABLE table=test-workload [id=9261731b25a046aea02157c57c0f5059]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 13:22:57.271361 15153 raft_consensus.cc:359] T 117ae8a22b1d46579ce047f99e30520b P 0efc951052454eec9a58b0cd025945b8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } } peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } } peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } }
I20260709 13:22:57.272280 15153 raft_consensus.cc:385] T 117ae8a22b1d46579ce047f99e30520b P 0efc951052454eec9a58b0cd025945b8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:57.202060 15163 raft_consensus.cc:515] T 48be8cf045364be999b8f0fd547b7b9d P 0efc951052454eec9a58b0cd025945b8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } } peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } } peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } }
I20260709 13:22:57.209975 15155 raft_consensus.cc:385] T d65eaa0ab4574a1ea92b3848d4dc9c4d P a1a22e9119494570b6d2217713fd7e43 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:57.277415 14885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d65eaa0ab4574a1ea92b3848d4dc9c4d" candidate_uuid: "a722e54d227f4c29a9ed6ce77858003a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f3a500981b494979b58d2b1041fec9c8" is_pre_election: true
I20260709 13:22:57.273991 14941 tablet_service.cc:1511] Processing CreateTablet for tablet ad084674821d4137b02efe692068d382 (DEFAULT_TABLE table=test-workload [id=9261731b25a046aea02157c57c0f5059]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 13:22:57.272480 14942 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 58a622a48cd24833bc5fc27e03114176. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:57.284433 14941 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ad084674821d4137b02efe692068d382. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:57.277940 14884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48be8cf045364be999b8f0fd547b7b9d" candidate_uuid: "0efc951052454eec9a58b0cd025945b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f3a500981b494979b58d2b1041fec9c8"
I20260709 13:22:57.287704 14884 raft_consensus.cc:3060] T 48be8cf045364be999b8f0fd547b7b9d P f3a500981b494979b58d2b1041fec9c8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:57.278218 15163 leader_election.cc:290] T 48be8cf045364be999b8f0fd547b7b9d P 0efc951052454eec9a58b0cd025945b8 [CANDIDATE]: Term 1 election: Requested vote from peers f3a500981b494979b58d2b1041fec9c8 (127.5.126.65:34129), a1a22e9119494570b6d2217713fd7e43 (127.5.126.67:38125)
I20260709 13:22:57.272598 15153 raft_consensus.cc:740] T 117ae8a22b1d46579ce047f99e30520b P 0efc951052454eec9a58b0cd025945b8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0efc951052454eec9a58b0cd025945b8, State: Initialized, Role: FOLLOWER
I20260709 13:22:57.289901 15153 consensus_queue.cc:260] T 117ae8a22b1d46579ce047f99e30520b P 0efc951052454eec9a58b0cd025945b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } } peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } } peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } }
I20260709 13:22:57.279837 15155 raft_consensus.cc:740] T d65eaa0ab4574a1ea92b3848d4dc9c4d P a1a22e9119494570b6d2217713fd7e43 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a1a22e9119494570b6d2217713fd7e43, State: Initialized, Role: FOLLOWER
I20260709 13:22:57.309825 15033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d65eaa0ab4574a1ea92b3848d4dc9c4d" candidate_uuid: "a722e54d227f4c29a9ed6ce77858003a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1a22e9119494570b6d2217713fd7e43" is_pre_election: true
I20260709 13:22:57.293953 15153 ts_tablet_manager.cc:1434] T 117ae8a22b1d46579ce047f99e30520b P 0efc951052454eec9a58b0cd025945b8: Time spent starting tablet: real 0.026s	user 0.007s	sys 0.000s
I20260709 13:22:57.321722 15153 tablet_bootstrap.cc:492] T 914c9c0c3be1486f8dcce382b61b5450 P 0efc951052454eec9a58b0cd025945b8: Bootstrap starting.
I20260709 13:22:57.323637 15017 tablet_service.cc:1511] Processing CreateTablet for tablet b0b7e1c1e67845cb9bd2208bb2fb7c21 (DEFAULT_TABLE table=test-workload [id=9261731b25a046aea02157c57c0f5059]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 13:22:57.325114 15017 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b0b7e1c1e67845cb9bd2208bb2fb7c21. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:57.328819 14870 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet abc01daa220a47fa8578b0d20a17c9ab. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:57.306052 15155 consensus_queue.cc:260] T d65eaa0ab4574a1ea92b3848d4dc9c4d P a1a22e9119494570b6d2217713fd7e43 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } } peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } } peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } }
I20260709 13:22:57.333580 15033 raft_consensus.cc:2468] T d65eaa0ab4574a1ea92b3848d4dc9c4d P a1a22e9119494570b6d2217713fd7e43 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a722e54d227f4c29a9ed6ce77858003a in term 0.
I20260709 13:22:57.221135 14944 tablet_service.cc:1511] Processing CreateTablet for tablet d64d06459b344ff99c0df07c249c3a60 (DEFAULT_TABLE table=test-workload [id=9261731b25a046aea02157c57c0f5059]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 13:22:57.335680 14944 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d64d06459b344ff99c0df07c249c3a60. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:57.339169 15072 leader_election.cc:304] T d65eaa0ab4574a1ea92b3848d4dc9c4d P a722e54d227f4c29a9ed6ce77858003a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1a22e9119494570b6d2217713fd7e43, a722e54d227f4c29a9ed6ce77858003a; no voters: 
I20260709 13:22:57.340196 15161 raft_consensus.cc:2804] T d65eaa0ab4574a1ea92b3848d4dc9c4d P a722e54d227f4c29a9ed6ce77858003a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:22:57.339949 14960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "117ae8a22b1d46579ce047f99e30520b" candidate_uuid: "a1a22e9119494570b6d2217713fd7e43" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0efc951052454eec9a58b0cd025945b8" is_pre_election: true
I20260709 13:22:57.340845 15161 raft_consensus.cc:493] T d65eaa0ab4574a1ea92b3848d4dc9c4d P a722e54d227f4c29a9ed6ce77858003a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:22:57.341296 15161 raft_consensus.cc:3060] T d65eaa0ab4574a1ea92b3848d4dc9c4d P a722e54d227f4c29a9ed6ce77858003a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:57.341228 14960 raft_consensus.cc:2468] T 117ae8a22b1d46579ce047f99e30520b P 0efc951052454eec9a58b0cd025945b8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1a22e9119494570b6d2217713fd7e43 in term 0.
I20260709 13:22:57.343128 14999 leader_election.cc:304] T 117ae8a22b1d46579ce047f99e30520b P a1a22e9119494570b6d2217713fd7e43 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0efc951052454eec9a58b0cd025945b8, a1a22e9119494570b6d2217713fd7e43; no voters: 
I20260709 13:22:57.345846 15160 raft_consensus.cc:2804] T 117ae8a22b1d46579ce047f99e30520b P a1a22e9119494570b6d2217713fd7e43 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:22:57.346297 15160 raft_consensus.cc:493] T 117ae8a22b1d46579ce047f99e30520b P a1a22e9119494570b6d2217713fd7e43 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:22:57.346654 15160 raft_consensus.cc:3060] T 117ae8a22b1d46579ce047f99e30520b P a1a22e9119494570b6d2217713fd7e43 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:57.292635 15034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48be8cf045364be999b8f0fd547b7b9d" candidate_uuid: "0efc951052454eec9a58b0cd025945b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1a22e9119494570b6d2217713fd7e43"
I20260709 13:22:57.305052 15019 tablet_service.cc:1511] Processing CreateTablet for tablet ad084674821d4137b02efe692068d382 (DEFAULT_TABLE table=test-workload [id=9261731b25a046aea02157c57c0f5059]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 13:22:57.352893 15019 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ad084674821d4137b02efe692068d382. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:22:57.280923 14769 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.5.126.68:46669, user_credentials={real_user=slave}} blocked reactor thread for 52091.7us
W20260709 13:22:57.361955 14924 leader_election.cc:343] T 48be8cf045364be999b8f0fd547b7b9d P 0efc951052454eec9a58b0cd025945b8 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer a1a22e9119494570b6d2217713fd7e43 (127.5.126.67:38125): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:57.362331 15018 tablet_service.cc:1511] Processing CreateTablet for tablet f86a730e237248dc9b91cbb75e29c324 (DEFAULT_TABLE table=test-workload [id=9261731b25a046aea02157c57c0f5059]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 13:22:57.363659 15155 ts_tablet_manager.cc:1434] T d65eaa0ab4574a1ea92b3848d4dc9c4d P a1a22e9119494570b6d2217713fd7e43: Time spent starting tablet: real 0.259s	user 0.005s	sys 0.004s
I20260709 13:22:57.372422 15155 tablet_bootstrap.cc:492] T 36f72377897846f2a1f3d8d33ec14af6 P a1a22e9119494570b6d2217713fd7e43: Bootstrap starting.
I20260709 13:22:57.363782 15018 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f86a730e237248dc9b91cbb75e29c324. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:57.365911 15154 tablet_bootstrap.cc:492] T 70d027ba81f54eba882756b941186710 P a722e54d227f4c29a9ed6ce77858003a: No bootstrap required, opened a new log
I20260709 13:22:57.376576 15154 ts_tablet_manager.cc:1403] T 70d027ba81f54eba882756b941186710 P a722e54d227f4c29a9ed6ce77858003a: Time spent bootstrapping tablet: real 0.548s	user 0.024s	sys 0.056s
I20260709 13:22:57.377689 15153 tablet_bootstrap.cc:654] T 914c9c0c3be1486f8dcce382b61b5450 P 0efc951052454eec9a58b0cd025945b8: Neither blocks nor log segments found. Creating new log.
W20260709 13:22:57.381156 15073 leader_election.cc:343] T d65eaa0ab4574a1ea92b3848d4dc9c4d P a722e54d227f4c29a9ed6ce77858003a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f3a500981b494979b58d2b1041fec9c8 (127.5.126.65:34129): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:57.383152 15096 tablet_service.cc:1511] Processing CreateTablet for tablet ad084674821d4137b02efe692068d382 (DEFAULT_TABLE table=test-workload [id=9261731b25a046aea02157c57c0f5059]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 13:22:57.384577 15096 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ad084674821d4137b02efe692068d382. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:57.385186 15161 raft_consensus.cc:515] T d65eaa0ab4574a1ea92b3848d4dc9c4d P a722e54d227f4c29a9ed6ce77858003a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } } peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } } peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } }
I20260709 13:22:57.388329 14874 tablet_service.cc:1511] Processing CreateTablet for tablet 77e8d8b35cf148e99e8274bf65e5ed05 (DEFAULT_TABLE table=test-workload [id=9261731b25a046aea02157c57c0f5059]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 13:22:57.393443 15156 tablet_bootstrap.cc:700] T e75f8237624f42f793627366f05b792a P f3a500981b494979b58d2b1041fec9c8: Time spent opening tablet: real 0.106s	user 0.004s	sys 0.000s
I20260709 13:22:57.422526 15156 tablet_bootstrap.cc:654] T e75f8237624f42f793627366f05b792a P f3a500981b494979b58d2b1041fec9c8: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:57.422844 14874 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 77e8d8b35cf148e99e8274bf65e5ed05. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:57.423173 15017 tablet_service.cc:1511] Processing CreateTablet for tablet 08dea3083d334745abe54f9b220bd86a (DEFAULT_TABLE table=test-workload [id=9261731b25a046aea02157c57c0f5059]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 13:22:57.424477 15017 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 08dea3083d334745abe54f9b220bd86a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:57.369211 14868 tablet_service.cc:1511] Processing CreateTablet for tablet b0b7e1c1e67845cb9bd2208bb2fb7c21 (DEFAULT_TABLE table=test-workload [id=9261731b25a046aea02157c57c0f5059]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 13:22:57.355809 15160 raft_consensus.cc:515] T 117ae8a22b1d46579ce047f99e30520b P a1a22e9119494570b6d2217713fd7e43 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } } peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } } peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } }
I20260709 13:22:57.398296 15108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "117ae8a22b1d46579ce047f99e30520b" candidate_uuid: "a1a22e9119494570b6d2217713fd7e43" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a722e54d227f4c29a9ed6ce77858003a" is_pre_election: true
I20260709 13:22:57.400876 15154 raft_consensus.cc:359] T 70d027ba81f54eba882756b941186710 P a722e54d227f4c29a9ed6ce77858003a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } } peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } } peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } }
I20260709 13:22:57.401206 14949 tablet_service.cc:1511] Processing CreateTablet for tablet 77e8d8b35cf148e99e8274bf65e5ed05 (DEFAULT_TABLE table=test-workload [id=9261731b25a046aea02157c57c0f5059]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 13:22:57.426494 15154 raft_consensus.cc:385] T 70d027ba81f54eba882756b941186710 P a722e54d227f4c29a9ed6ce77858003a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:57.426926 15154 raft_consensus.cc:740] T 70d027ba81f54eba882756b941186710 P a722e54d227f4c29a9ed6ce77858003a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a722e54d227f4c29a9ed6ce77858003a, State: Initialized, Role: FOLLOWER
I20260709 13:22:57.427476 14949 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 77e8d8b35cf148e99e8274bf65e5ed05. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:57.428820 15161 leader_election.cc:290] T d65eaa0ab4574a1ea92b3848d4dc9c4d P a722e54d227f4c29a9ed6ce77858003a [CANDIDATE]: Term 1 election: Requested vote from peers a1a22e9119494570b6d2217713fd7e43 (127.5.126.67:38125), f3a500981b494979b58d2b1041fec9c8 (127.5.126.65:34129)
I20260709 13:22:57.430249 14868 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b0b7e1c1e67845cb9bd2208bb2fb7c21. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:22:57.430646 14999 leader_election.cc:343] T 117ae8a22b1d46579ce047f99e30520b P a1a22e9119494570b6d2217713fd7e43 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a722e54d227f4c29a9ed6ce77858003a (127.5.126.68:46669): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:57.431104 14960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "117ae8a22b1d46579ce047f99e30520b" candidate_uuid: "a1a22e9119494570b6d2217713fd7e43" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0efc951052454eec9a58b0cd025945b8"
I20260709 13:22:57.431847 14960 raft_consensus.cc:3060] T 117ae8a22b1d46579ce047f99e30520b P 0efc951052454eec9a58b0cd025945b8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:57.403251 15098 tablet_service.cc:1511] Processing CreateTablet for tablet 77e8d8b35cf148e99e8274bf65e5ed05 (DEFAULT_TABLE table=test-workload [id=9261731b25a046aea02157c57c0f5059]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 13:22:57.403901 14884 raft_consensus.cc:2468] T 48be8cf045364be999b8f0fd547b7b9d P f3a500981b494979b58d2b1041fec9c8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0efc951052454eec9a58b0cd025945b8 in term 1.
I20260709 13:22:57.406944 15016 tablet_service.cc:1511] Processing CreateTablet for tablet 7e29a38455b241239882b6af3eac3d51 (DEFAULT_TABLE table=test-workload [id=9261731b25a046aea02157c57c0f5059]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 13:22:57.454968 15016 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7e29a38455b241239882b6af3eac3d51. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:57.409135 14943 tablet_service.cc:1511] Processing CreateTablet for tablet b0b7e1c1e67845cb9bd2208bb2fb7c21 (DEFAULT_TABLE table=test-workload [id=9261731b25a046aea02157c57c0f5059]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 13:22:57.415786 15155 tablet_bootstrap.cc:654] T 36f72377897846f2a1f3d8d33ec14af6 P a1a22e9119494570b6d2217713fd7e43: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:57.458493 14943 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b0b7e1c1e67845cb9bd2208bb2fb7c21. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:57.452260 15034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d65eaa0ab4574a1ea92b3848d4dc9c4d" candidate_uuid: "a722e54d227f4c29a9ed6ce77858003a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1a22e9119494570b6d2217713fd7e43"
I20260709 13:22:57.460629 15034 raft_consensus.cc:3060] T d65eaa0ab4574a1ea92b3848d4dc9c4d P a1a22e9119494570b6d2217713fd7e43 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:57.269436 14872 tablet_service.cc:1511] Processing CreateTablet for tablet 58a622a48cd24833bc5fc27e03114176 (DEFAULT_TABLE table=test-workload [id=9261731b25a046aea02157c57c0f5059]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 13:22:57.463519 14872 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 58a622a48cd24833bc5fc27e03114176. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:57.475598 15098 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 77e8d8b35cf148e99e8274bf65e5ed05. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:57.497941 15160 leader_election.cc:290] T 117ae8a22b1d46579ce047f99e30520b P a1a22e9119494570b6d2217713fd7e43 [CANDIDATE]: Term 1 election: Requested vote from peers 0efc951052454eec9a58b0cd025945b8 (127.5.126.66:34613), a722e54d227f4c29a9ed6ce77858003a (127.5.126.68:46669)
I20260709 13:22:57.507098 14884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d65eaa0ab4574a1ea92b3848d4dc9c4d" candidate_uuid: "a722e54d227f4c29a9ed6ce77858003a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f3a500981b494979b58d2b1041fec9c8"
W20260709 13:22:57.511724 15073 leader_election.cc:343] T d65eaa0ab4574a1ea92b3848d4dc9c4d P a722e54d227f4c29a9ed6ce77858003a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f3a500981b494979b58d2b1041fec9c8 (127.5.126.65:34129): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:57.515594 15154 consensus_queue.cc:260] T 70d027ba81f54eba882756b941186710 P a722e54d227f4c29a9ed6ce77858003a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } } peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } } peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } }
I20260709 13:22:57.521126 14925 leader_election.cc:304] T 48be8cf045364be999b8f0fd547b7b9d P 0efc951052454eec9a58b0cd025945b8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0efc951052454eec9a58b0cd025945b8, f3a500981b494979b58d2b1041fec9c8; no voters: a1a22e9119494570b6d2217713fd7e43
W20260709 13:22:57.522526 14768 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.5.126.67:38125, user_credentials={real_user=slave}} blocked reactor thread for 67478us
I20260709 13:22:57.522637 15163 raft_consensus.cc:2804] T 48be8cf045364be999b8f0fd547b7b9d P 0efc951052454eec9a58b0cd025945b8 [term 1 FOLLOWER]: Leader election won for term 1
W20260709 13:22:57.529363 14999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.68:46669, user_credentials={real_user=slave}} blocked reactor thread for 97030us
I20260709 13:22:57.542152 15153 tablet_bootstrap.cc:492] T 914c9c0c3be1486f8dcce382b61b5450 P 0efc951052454eec9a58b0cd025945b8: No bootstrap required, opened a new log
I20260709 13:22:57.541801 15018 tablet_service.cc:1511] Processing CreateTablet for tablet dee43e01ec5d409b877a5c2dbf5b7b77 (DEFAULT_TABLE table=test-workload [id=9261731b25a046aea02157c57c0f5059]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 13:22:57.542826 15153 ts_tablet_manager.cc:1403] T 914c9c0c3be1486f8dcce382b61b5450 P 0efc951052454eec9a58b0cd025945b8: Time spent bootstrapping tablet: real 0.221s	user 0.016s	sys 0.000s
I20260709 13:22:57.543371 15018 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dee43e01ec5d409b877a5c2dbf5b7b77. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:22:57.538380 14769 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.5.126.66:34613, user_credentials={real_user=slave}} blocked reactor thread for 81326.6us
I20260709 13:22:57.565373 15024 tablet_service.cc:1511] Processing CreateTablet for tablet a2de4fecd70240dd8ed436fa8de65773 (DEFAULT_TABLE table=test-workload [id=9261731b25a046aea02157c57c0f5059]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 13:22:57.569705 15024 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a2de4fecd70240dd8ed436fa8de65773. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:57.571285 15153 raft_consensus.cc:359] T 914c9c0c3be1486f8dcce382b61b5450 P 0efc951052454eec9a58b0cd025945b8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } } peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } } peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } }
I20260709 13:22:57.577353 15153 raft_consensus.cc:385] T 914c9c0c3be1486f8dcce382b61b5450 P 0efc951052454eec9a58b0cd025945b8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:57.578449 15153 raft_consensus.cc:740] T 914c9c0c3be1486f8dcce382b61b5450 P 0efc951052454eec9a58b0cd025945b8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0efc951052454eec9a58b0cd025945b8, State: Initialized, Role: FOLLOWER
I20260709 13:22:57.579423 15153 consensus_queue.cc:260] T 914c9c0c3be1486f8dcce382b61b5450 P 0efc951052454eec9a58b0cd025945b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } } peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } } peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } }
I20260709 13:22:57.537995 15163 raft_consensus.cc:697] T 48be8cf045364be999b8f0fd547b7b9d P 0efc951052454eec9a58b0cd025945b8 [term 1 LEADER]: Becoming Leader. State: Replica: 0efc951052454eec9a58b0cd025945b8, State: Running, Role: LEADER
I20260709 13:22:57.581085 15163 consensus_queue.cc:237] T 48be8cf045364be999b8f0fd547b7b9d P 0efc951052454eec9a58b0cd025945b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } } peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } } peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } }
I20260709 13:22:57.585297 15108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "117ae8a22b1d46579ce047f99e30520b" candidate_uuid: "a1a22e9119494570b6d2217713fd7e43" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a722e54d227f4c29a9ed6ce77858003a"
I20260709 13:22:57.590206 15154 ts_tablet_manager.cc:1434] T 70d027ba81f54eba882756b941186710 P a722e54d227f4c29a9ed6ce77858003a: Time spent starting tablet: real 0.213s	user 0.011s	sys 0.011s
I20260709 13:22:57.590643 15155 tablet_bootstrap.cc:492] T 36f72377897846f2a1f3d8d33ec14af6 P a1a22e9119494570b6d2217713fd7e43: No bootstrap required, opened a new log
I20260709 13:22:57.591233 15155 ts_tablet_manager.cc:1403] T 36f72377897846f2a1f3d8d33ec14af6 P a1a22e9119494570b6d2217713fd7e43: Time spent bootstrapping tablet: real 0.219s	user 0.012s	sys 0.024s
I20260709 13:22:57.594017 15154 tablet_bootstrap.cc:492] T 914c9c0c3be1486f8dcce382b61b5450 P a722e54d227f4c29a9ed6ce77858003a: Bootstrap starting.
I20260709 13:22:57.595649 15155 raft_consensus.cc:359] T 36f72377897846f2a1f3d8d33ec14af6 P a1a22e9119494570b6d2217713fd7e43 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } } peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } } peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } }
I20260709 13:22:57.596566 15155 raft_consensus.cc:385] T 36f72377897846f2a1f3d8d33ec14af6 P a1a22e9119494570b6d2217713fd7e43 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:57.596922 15155 raft_consensus.cc:740] T 36f72377897846f2a1f3d8d33ec14af6 P a1a22e9119494570b6d2217713fd7e43 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a1a22e9119494570b6d2217713fd7e43, State: Initialized, Role: FOLLOWER
I20260709 13:22:57.599356 15034 raft_consensus.cc:2468] T d65eaa0ab4574a1ea92b3848d4dc9c4d P a1a22e9119494570b6d2217713fd7e43 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a722e54d227f4c29a9ed6ce77858003a in term 1.
I20260709 13:22:57.601832 14960 raft_consensus.cc:2468] T 117ae8a22b1d46579ce047f99e30520b P 0efc951052454eec9a58b0cd025945b8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1a22e9119494570b6d2217713fd7e43 in term 1.
W20260709 13:22:57.603021 14999 leader_election.cc:343] T 117ae8a22b1d46579ce047f99e30520b P a1a22e9119494570b6d2217713fd7e43 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer a722e54d227f4c29a9ed6ce77858003a (127.5.126.68:46669): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:57.603792 14999 leader_election.cc:304] T 117ae8a22b1d46579ce047f99e30520b P a1a22e9119494570b6d2217713fd7e43 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0efc951052454eec9a58b0cd025945b8, a1a22e9119494570b6d2217713fd7e43; no voters: a722e54d227f4c29a9ed6ce77858003a
I20260709 13:22:57.605394 15160 raft_consensus.cc:2804] T 117ae8a22b1d46579ce047f99e30520b P a1a22e9119494570b6d2217713fd7e43 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:22:57.610530 15156 tablet_bootstrap.cc:492] T e75f8237624f42f793627366f05b792a P f3a500981b494979b58d2b1041fec9c8: No bootstrap required, opened a new log
I20260709 13:22:57.611256 15156 ts_tablet_manager.cc:1403] T e75f8237624f42f793627366f05b792a P f3a500981b494979b58d2b1041fec9c8: Time spent bootstrapping tablet: real 0.382s	user 0.017s	sys 0.010s
I20260709 13:22:57.623557 15090 tablet_service.cc:1511] Processing CreateTablet for tablet 7e29a38455b241239882b6af3eac3d51 (DEFAULT_TABLE table=test-workload [id=9261731b25a046aea02157c57c0f5059]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 13:22:57.617910 15072 leader_election.cc:304] T d65eaa0ab4574a1ea92b3848d4dc9c4d P a722e54d227f4c29a9ed6ce77858003a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a1a22e9119494570b6d2217713fd7e43, a722e54d227f4c29a9ed6ce77858003a; no voters: f3a500981b494979b58d2b1041fec9c8
I20260709 13:22:57.634626 15161 raft_consensus.cc:2804] T d65eaa0ab4574a1ea92b3848d4dc9c4d P a722e54d227f4c29a9ed6ce77858003a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:22:57.635076 15090 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7e29a38455b241239882b6af3eac3d51. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:57.623144 15095 tablet_service.cc:1511] Processing CreateTablet for tablet f86a730e237248dc9b91cbb75e29c324 (DEFAULT_TABLE table=test-workload [id=9261731b25a046aea02157c57c0f5059]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 13:22:57.641042 15095 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f86a730e237248dc9b91cbb75e29c324. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:57.640538 15156 raft_consensus.cc:359] T e75f8237624f42f793627366f05b792a P f3a500981b494979b58d2b1041fec9c8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } } peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } } peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } }
I20260709 13:22:57.641710 15156 raft_consensus.cc:385] T e75f8237624f42f793627366f05b792a P f3a500981b494979b58d2b1041fec9c8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:57.642134 15156 raft_consensus.cc:740] T e75f8237624f42f793627366f05b792a P f3a500981b494979b58d2b1041fec9c8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f3a500981b494979b58d2b1041fec9c8, State: Initialized, Role: FOLLOWER
I20260709 13:22:57.645391 15156 consensus_queue.cc:260] T e75f8237624f42f793627366f05b792a P f3a500981b494979b58d2b1041fec9c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } } peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } } peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } }
I20260709 13:22:57.648602 15156 ts_tablet_manager.cc:1434] T e75f8237624f42f793627366f05b792a P f3a500981b494979b58d2b1041fec9c8: Time spent starting tablet: real 0.037s	user 0.008s	sys 0.004s
I20260709 13:22:57.624388 14944 tablet_service.cc:1511] Processing CreateTablet for tablet 7e29a38455b241239882b6af3eac3d51 (DEFAULT_TABLE table=test-workload [id=9261731b25a046aea02157c57c0f5059]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 13:22:57.650339 14944 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7e29a38455b241239882b6af3eac3d51. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:57.626246 15160 raft_consensus.cc:697] T 117ae8a22b1d46579ce047f99e30520b P a1a22e9119494570b6d2217713fd7e43 [term 1 LEADER]: Becoming Leader. State: Replica: a1a22e9119494570b6d2217713fd7e43, State: Running, Role: LEADER
I20260709 13:22:57.661089 15156 tablet_bootstrap.cc:492] T a71163721b4d48b0b5ff366b9d12ac32 P f3a500981b494979b58d2b1041fec9c8: Bootstrap starting.
I20260709 13:22:57.664143 15153 ts_tablet_manager.cc:1434] T 914c9c0c3be1486f8dcce382b61b5450 P 0efc951052454eec9a58b0cd025945b8: Time spent starting tablet: real 0.121s	user 0.013s	sys 0.000s
I20260709 13:22:57.665635 15153 tablet_bootstrap.cc:492] T a71163721b4d48b0b5ff366b9d12ac32 P 0efc951052454eec9a58b0cd025945b8: Bootstrap starting.
I20260709 13:22:57.667207 15018 tablet_service.cc:1511] Processing CreateTablet for tablet affcb03ab55349748a95c103059d2955 (DEFAULT_TABLE table=test-workload [id=9261731b25a046aea02157c57c0f5059]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 13:22:57.668710 15018 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet affcb03ab55349748a95c103059d2955. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:57.670819 14783 catalog_manager.cc:5697] T 48be8cf045364be999b8f0fd547b7b9d P 0efc951052454eec9a58b0cd025945b8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0efc951052454eec9a58b0cd025945b8 (127.5.126.66). New cstate: current_term: 1 leader_uuid: "0efc951052454eec9a58b0cd025945b8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } health_report { overall_health: UNKNOWN } } }
I20260709 13:22:57.602277 15155 consensus_queue.cc:260] T 36f72377897846f2a1f3d8d33ec14af6 P a1a22e9119494570b6d2217713fd7e43 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } } peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } } peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } }
I20260709 13:22:57.680840 15178 raft_consensus.cc:493] T e75f8237624f42f793627366f05b792a P f3a500981b494979b58d2b1041fec9c8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:57.681420 15178 raft_consensus.cc:515] T e75f8237624f42f793627366f05b792a P f3a500981b494979b58d2b1041fec9c8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } } peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } } peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } }
I20260709 13:22:57.682235 14874 tablet_service.cc:1511] Processing CreateTablet for tablet f86a730e237248dc9b91cbb75e29c324 (DEFAULT_TABLE table=test-workload [id=9261731b25a046aea02157c57c0f5059]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 13:22:57.683598 14874 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f86a730e237248dc9b91cbb75e29c324. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:57.675364 15161 raft_consensus.cc:697] T d65eaa0ab4574a1ea92b3848d4dc9c4d P a722e54d227f4c29a9ed6ce77858003a [term 1 LEADER]: Becoming Leader. State: Replica: a722e54d227f4c29a9ed6ce77858003a, State: Running, Role: LEADER
I20260709 13:22:57.685060 15161 consensus_queue.cc:237] T d65eaa0ab4574a1ea92b3848d4dc9c4d P a722e54d227f4c29a9ed6ce77858003a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } } peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } } peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } }
I20260709 13:22:57.685581 15160 consensus_queue.cc:237] T 117ae8a22b1d46579ce047f99e30520b P a1a22e9119494570b6d2217713fd7e43 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } } peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } } peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } }
I20260709 13:22:57.689575 15155 ts_tablet_manager.cc:1434] T 36f72377897846f2a1f3d8d33ec14af6 P a1a22e9119494570b6d2217713fd7e43: Time spent starting tablet: real 0.098s	user 0.004s	sys 0.004s
I20260709 13:22:57.690725 15155 tablet_bootstrap.cc:492] T db6d3d345bd3495e9ec9a0e75ecd0562 P a1a22e9119494570b6d2217713fd7e43: Bootstrap starting.
I20260709 13:22:57.693109 14945 tablet_service.cc:1511] Processing CreateTablet for tablet 08dea3083d334745abe54f9b220bd86a (DEFAULT_TABLE table=test-workload [id=9261731b25a046aea02157c57c0f5059]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 13:22:57.694512 14945 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 08dea3083d334745abe54f9b220bd86a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:57.696060 14947 tablet_service.cc:1511] Processing CreateTablet for tablet 2a9523aa8663464686254c8412c37e67 (DEFAULT_TABLE table=test-workload [id=9261731b25a046aea02157c57c0f5059]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 13:22:57.697868 14947 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2a9523aa8663464686254c8412c37e67. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:57.698252 15153 tablet_bootstrap.cc:654] T a71163721b4d48b0b5ff366b9d12ac32 P 0efc951052454eec9a58b0cd025945b8: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:57.699816 14866 tablet_service.cc:1511] Processing CreateTablet for tablet 2a9523aa8663464686254c8412c37e67 (DEFAULT_TABLE table=test-workload [id=9261731b25a046aea02157c57c0f5059]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 13:22:57.699980 14870 tablet_service.cc:1511] Processing CreateTablet for tablet 08dea3083d334745abe54f9b220bd86a (DEFAULT_TABLE table=test-workload [id=9261731b25a046aea02157c57c0f5059]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 13:22:57.701359 14866 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2a9523aa8663464686254c8412c37e67. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:57.703971 15096 tablet_service.cc:1511] Processing CreateTablet for tablet 2a9523aa8663464686254c8412c37e67 (DEFAULT_TABLE table=test-workload [id=9261731b25a046aea02157c57c0f5059]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 13:22:57.705322 15096 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2a9523aa8663464686254c8412c37e67. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:57.705160 14941 tablet_service.cc:1511] Processing CreateTablet for tablet a2de4fecd70240dd8ed436fa8de65773 (DEFAULT_TABLE table=test-workload [id=9261731b25a046aea02157c57c0f5059]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 13:22:57.706827 14941 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a2de4fecd70240dd8ed436fa8de65773. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:57.708992 15089 tablet_service.cc:1511] Processing CreateTablet for tablet dee43e01ec5d409b877a5c2dbf5b7b77 (DEFAULT_TABLE table=test-workload [id=9261731b25a046aea02157c57c0f5059]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 13:22:57.704414 14870 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 08dea3083d334745abe54f9b220bd86a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:57.709535 14875 tablet_service.cc:1511] Processing CreateTablet for tablet dee43e01ec5d409b877a5c2dbf5b7b77 (DEFAULT_TABLE table=test-workload [id=9261731b25a046aea02157c57c0f5059]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 13:22:57.712313 15093 tablet_service.cc:1511] Processing CreateTablet for tablet a2de4fecd70240dd8ed436fa8de65773 (DEFAULT_TABLE table=test-workload [id=9261731b25a046aea02157c57c0f5059]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 13:22:57.713109 15178 leader_election.cc:290] T e75f8237624f42f793627366f05b792a P f3a500981b494979b58d2b1041fec9c8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a722e54d227f4c29a9ed6ce77858003a (127.5.126.68:46669), 0efc951052454eec9a58b0cd025945b8 (127.5.126.66:34613)
I20260709 13:22:57.728204 15098 tablet_service.cc:1511] Processing CreateTablet for tablet af00ad02fba64998bb25991f6f69f291 (DEFAULT_TABLE table=test-workload [id=9261731b25a046aea02157c57c0f5059]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 13:22:57.729303 14871 tablet_service.cc:1511] Processing CreateTablet for tablet affcb03ab55349748a95c103059d2955 (DEFAULT_TABLE table=test-workload [id=9261731b25a046aea02157c57c0f5059]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 13:22:57.730288 15089 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dee43e01ec5d409b877a5c2dbf5b7b77. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:57.745302 15098 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet af00ad02fba64998bb25991f6f69f291. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:57.748394 14875 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dee43e01ec5d409b877a5c2dbf5b7b77. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:57.752351 15093 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a2de4fecd70240dd8ed436fa8de65773. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:57.753759 15154 tablet_bootstrap.cc:654] T 914c9c0c3be1486f8dcce382b61b5450 P a722e54d227f4c29a9ed6ce77858003a: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:57.729970 14942 tablet_service.cc:1511] Processing CreateTablet for tablet af00ad02fba64998bb25991f6f69f291 (DEFAULT_TABLE table=test-workload [id=9261731b25a046aea02157c57c0f5059]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 13:22:57.729974 14950 tablet_service.cc:1511] Processing CreateTablet for tablet affcb03ab55349748a95c103059d2955 (DEFAULT_TABLE table=test-workload [id=9261731b25a046aea02157c57c0f5059]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 13:22:57.732256 14868 tablet_service.cc:1511] Processing CreateTablet for tablet af00ad02fba64998bb25991f6f69f291 (DEFAULT_TABLE table=test-workload [id=9261731b25a046aea02157c57c0f5059]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 13:22:57.740581 15016 tablet_service.cc:1511] Processing CreateTablet for tablet 16d5db73377a4925b9f1e814ba306fcc (DEFAULT_TABLE table=test-workload [id=9261731b25a046aea02157c57c0f5059]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 13:22:57.759027 15016 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 16d5db73377a4925b9f1e814ba306fcc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:57.762964 15156 tablet_bootstrap.cc:654] T a71163721b4d48b0b5ff366b9d12ac32 P f3a500981b494979b58d2b1041fec9c8: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:57.764483 14871 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet affcb03ab55349748a95c103059d2955. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:57.763077 14782 catalog_manager.cc:5697] T d65eaa0ab4574a1ea92b3848d4dc9c4d P a722e54d227f4c29a9ed6ce77858003a reported cstate change: term changed from 0 to 1, leader changed from <none> to a722e54d227f4c29a9ed6ce77858003a (127.5.126.68). New cstate: current_term: 1 leader_uuid: "a722e54d227f4c29a9ed6ce77858003a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } health_report { overall_health: UNKNOWN } } }
I20260709 13:22:57.768153 14868 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet af00ad02fba64998bb25991f6f69f291. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:57.769598 14872 tablet_service.cc:1511] Processing CreateTablet for tablet 16d5db73377a4925b9f1e814ba306fcc (DEFAULT_TABLE table=test-workload [id=9261731b25a046aea02157c57c0f5059]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 13:22:57.769680 15090 tablet_service.cc:1511] Processing CreateTablet for tablet 16d5db73377a4925b9f1e814ba306fcc (DEFAULT_TABLE table=test-workload [id=9261731b25a046aea02157c57c0f5059]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 13:22:57.771001 14872 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 16d5db73377a4925b9f1e814ba306fcc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:57.757560 14942 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet af00ad02fba64998bb25991f6f69f291. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:57.772027 15090 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 16d5db73377a4925b9f1e814ba306fcc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:57.773085 14943 tablet_service.cc:1511] Processing CreateTablet for tablet 34e83f249d9942e99244702be584c8ae (DEFAULT_TABLE table=test-workload [id=9261731b25a046aea02157c57c0f5059]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 13:22:57.774451 14943 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 34e83f249d9942e99244702be584c8ae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:57.776465 14950 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet affcb03ab55349748a95c103059d2955. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:57.797184 15155 tablet_bootstrap.cc:654] T db6d3d345bd3495e9ec9a0e75ecd0562 P a1a22e9119494570b6d2217713fd7e43: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:57.808792 14781 catalog_manager.cc:5697] T 117ae8a22b1d46579ce047f99e30520b P a1a22e9119494570b6d2217713fd7e43 reported cstate change: term changed from 0 to 1, leader changed from <none> to a1a22e9119494570b6d2217713fd7e43 (127.5.126.67). New cstate: current_term: 1 leader_uuid: "a1a22e9119494570b6d2217713fd7e43" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } health_report { overall_health: UNKNOWN } } }
I20260709 13:22:57.813928 15095 tablet_service.cc:1511] Processing CreateTablet for tablet 34e83f249d9942e99244702be584c8ae (DEFAULT_TABLE table=test-workload [id=9261731b25a046aea02157c57c0f5059]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 13:22:57.815424 15095 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 34e83f249d9942e99244702be584c8ae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:57.830772 15022 tablet_service.cc:1511] Processing CreateTablet for tablet 2956fb66a7f34f3e99f42598fb93178e (DEFAULT_TABLE table=test-workload [id=9261731b25a046aea02157c57c0f5059]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 13:22:57.832458 15163 raft_consensus.cc:493] T 914c9c0c3be1486f8dcce382b61b5450 P 0efc951052454eec9a58b0cd025945b8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:57.833025 15163 raft_consensus.cc:515] T 914c9c0c3be1486f8dcce382b61b5450 P 0efc951052454eec9a58b0cd025945b8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } } peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } } peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } }
I20260709 13:22:57.835430 15163 leader_election.cc:290] T 914c9c0c3be1486f8dcce382b61b5450 P 0efc951052454eec9a58b0cd025945b8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a722e54d227f4c29a9ed6ce77858003a (127.5.126.68:46669), f3a500981b494979b58d2b1041fec9c8 (127.5.126.65:34129)
I20260709 13:22:57.835711 15017 tablet_service.cc:1511] Processing CreateTablet for tablet 34e83f249d9942e99244702be584c8ae (DEFAULT_TABLE table=test-workload [id=9261731b25a046aea02157c57c0f5059]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 13:22:57.837168 15017 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 34e83f249d9942e99244702be584c8ae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:57.848263 15022 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2956fb66a7f34f3e99f42598fb93178e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:57.849813 14866 tablet_service.cc:1511] Processing CreateTablet for tablet 2956fb66a7f34f3e99f42598fb93178e (DEFAULT_TABLE table=test-workload [id=9261731b25a046aea02157c57c0f5059]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 13:22:57.851401 14866 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2956fb66a7f34f3e99f42598fb93178e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:57.912583 14944 tablet_service.cc:1511] Processing CreateTablet for tablet 2956fb66a7f34f3e99f42598fb93178e (DEFAULT_TABLE table=test-workload [id=9261731b25a046aea02157c57c0f5059]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 13:22:57.914113 14944 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2956fb66a7f34f3e99f42598fb93178e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:57.916428 15161 raft_consensus.cc:493] T 70d027ba81f54eba882756b941186710 P a722e54d227f4c29a9ed6ce77858003a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:57.917055 15161 raft_consensus.cc:515] T 70d027ba81f54eba882756b941186710 P a722e54d227f4c29a9ed6ce77858003a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } } peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } } peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } }
I20260709 13:22:57.919250 15161 leader_election.cc:290] T 70d027ba81f54eba882756b941186710 P a722e54d227f4c29a9ed6ce77858003a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a1a22e9119494570b6d2217713fd7e43 (127.5.126.67:38125), f3a500981b494979b58d2b1041fec9c8 (127.5.126.65:34129)
I20260709 13:22:57.920258 15034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70d027ba81f54eba882756b941186710" candidate_uuid: "a722e54d227f4c29a9ed6ce77858003a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1a22e9119494570b6d2217713fd7e43" is_pre_election: true
I20260709 13:22:57.923312 14884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70d027ba81f54eba882756b941186710" candidate_uuid: "a722e54d227f4c29a9ed6ce77858003a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f3a500981b494979b58d2b1041fec9c8" is_pre_election: true
W20260709 13:22:57.923657 15072 leader_election.cc:343] T 70d027ba81f54eba882756b941186710 P a722e54d227f4c29a9ed6ce77858003a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a1a22e9119494570b6d2217713fd7e43 (127.5.126.67:38125): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:22:57.925006 15073 leader_election.cc:343] T 70d027ba81f54eba882756b941186710 P a722e54d227f4c29a9ed6ce77858003a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f3a500981b494979b58d2b1041fec9c8 (127.5.126.65:34129): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:57.924957 15016 tablet_service.cc:1511] Processing CreateTablet for tablet bf0b7c8005aa4d8ab97a1499761bf98a (DEFAULT_TABLE table=test-workload [id=9261731b25a046aea02157c57c0f5059]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 13:22:57.925799 15073 leader_election.cc:304] T 70d027ba81f54eba882756b941186710 P a722e54d227f4c29a9ed6ce77858003a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a722e54d227f4c29a9ed6ce77858003a; no voters: a1a22e9119494570b6d2217713fd7e43, f3a500981b494979b58d2b1041fec9c8
I20260709 13:22:57.926699 15016 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bf0b7c8005aa4d8ab97a1499761bf98a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:57.927125 15161 raft_consensus.cc:2749] T 70d027ba81f54eba882756b941186710 P a722e54d227f4c29a9ed6ce77858003a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:22:57.930249 15108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e75f8237624f42f793627366f05b792a" candidate_uuid: "f3a500981b494979b58d2b1041fec9c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a722e54d227f4c29a9ed6ce77858003a" is_pre_election: true
I20260709 13:22:57.931280 14874 tablet_service.cc:1511] Processing CreateTablet for tablet 940021bf0c344d01bc3adaae308d968d (DEFAULT_TABLE table=test-workload [id=9261731b25a046aea02157c57c0f5059]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 13:22:57.931627 14871 tablet_service.cc:1511] Processing CreateTablet for tablet bf0b7c8005aa4d8ab97a1499761bf98a (DEFAULT_TABLE table=test-workload [id=9261731b25a046aea02157c57c0f5059]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 13:22:57.932431 14949 tablet_service.cc:1511] Processing CreateTablet for tablet 940021bf0c344d01bc3adaae308d968d (DEFAULT_TABLE table=test-workload [id=9261731b25a046aea02157c57c0f5059]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 13:22:57.934037 14949 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 940021bf0c344d01bc3adaae308d968d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:57.934348 14871 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bf0b7c8005aa4d8ab97a1499761bf98a. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:22:57.936295 14850 leader_election.cc:343] T e75f8237624f42f793627366f05b792a P f3a500981b494979b58d2b1041fec9c8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a722e54d227f4c29a9ed6ce77858003a (127.5.126.68:46669): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:57.938454 15153 tablet_bootstrap.cc:492] T a71163721b4d48b0b5ff366b9d12ac32 P 0efc951052454eec9a58b0cd025945b8: No bootstrap required, opened a new log
I20260709 13:22:57.939086 15153 ts_tablet_manager.cc:1403] T a71163721b4d48b0b5ff366b9d12ac32 P 0efc951052454eec9a58b0cd025945b8: Time spent bootstrapping tablet: real 0.274s	user 0.022s	sys 0.006s
I20260709 13:22:57.941571 14960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e75f8237624f42f793627366f05b792a" candidate_uuid: "f3a500981b494979b58d2b1041fec9c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0efc951052454eec9a58b0cd025945b8" is_pre_election: true
W20260709 13:22:57.943171 14850 leader_election.cc:343] T e75f8237624f42f793627366f05b792a P f3a500981b494979b58d2b1041fec9c8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0efc951052454eec9a58b0cd025945b8 (127.5.126.66:34613): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:57.943651 14850 leader_election.cc:304] T e75f8237624f42f793627366f05b792a P f3a500981b494979b58d2b1041fec9c8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f3a500981b494979b58d2b1041fec9c8; no voters: 0efc951052454eec9a58b0cd025945b8, a722e54d227f4c29a9ed6ce77858003a
I20260709 13:22:57.944492 15178 raft_consensus.cc:2749] T e75f8237624f42f793627366f05b792a P f3a500981b494979b58d2b1041fec9c8 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:22:57.944986 15090 tablet_service.cc:1511] Processing CreateTablet for tablet 940021bf0c344d01bc3adaae308d968d (DEFAULT_TABLE table=test-workload [id=9261731b25a046aea02157c57c0f5059]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 13:22:57.947151 15156 tablet_bootstrap.cc:492] T a71163721b4d48b0b5ff366b9d12ac32 P f3a500981b494979b58d2b1041fec9c8: No bootstrap required, opened a new log
I20260709 13:22:57.947700 15156 ts_tablet_manager.cc:1403] T a71163721b4d48b0b5ff366b9d12ac32 P f3a500981b494979b58d2b1041fec9c8: Time spent bootstrapping tablet: real 0.298s	user 0.015s	sys 0.014s
I20260709 13:22:57.950318 15098 tablet_service.cc:1511] Processing CreateTablet for tablet bf0b7c8005aa4d8ab97a1499761bf98a (DEFAULT_TABLE table=test-workload [id=9261731b25a046aea02157c57c0f5059]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 13:22:57.936442 14874 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 940021bf0c344d01bc3adaae308d968d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:57.951095 15156 raft_consensus.cc:359] T a71163721b4d48b0b5ff366b9d12ac32 P f3a500981b494979b58d2b1041fec9c8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } } peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } } peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } }
I20260709 13:22:57.951100 15090 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 940021bf0c344d01bc3adaae308d968d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:57.954857 15156 raft_consensus.cc:385] T a71163721b4d48b0b5ff366b9d12ac32 P f3a500981b494979b58d2b1041fec9c8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:57.944351 15153 raft_consensus.cc:359] T a71163721b4d48b0b5ff366b9d12ac32 P 0efc951052454eec9a58b0cd025945b8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } } peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } } peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } }
I20260709 13:22:57.956027 15156 raft_consensus.cc:740] T a71163721b4d48b0b5ff366b9d12ac32 P f3a500981b494979b58d2b1041fec9c8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f3a500981b494979b58d2b1041fec9c8, State: Initialized, Role: FOLLOWER
I20260709 13:22:57.964294 15153 raft_consensus.cc:385] T a71163721b4d48b0b5ff366b9d12ac32 P 0efc951052454eec9a58b0cd025945b8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:57.964689 15153 raft_consensus.cc:740] T a71163721b4d48b0b5ff366b9d12ac32 P 0efc951052454eec9a58b0cd025945b8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0efc951052454eec9a58b0cd025945b8, State: Initialized, Role: FOLLOWER
I20260709 13:22:57.965055 15156 consensus_queue.cc:260] T a71163721b4d48b0b5ff366b9d12ac32 P f3a500981b494979b58d2b1041fec9c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } } peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } } peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } }
I20260709 13:22:57.967967 15156 ts_tablet_manager.cc:1434] T a71163721b4d48b0b5ff366b9d12ac32 P f3a500981b494979b58d2b1041fec9c8: Time spent starting tablet: real 0.020s	user 0.009s	sys 0.001s
I20260709 13:22:57.969295 15156 tablet_bootstrap.cc:492] T 5df7528567fd4291a888bfb37c28dc27 P f3a500981b494979b58d2b1041fec9c8: Bootstrap starting.
W20260709 13:22:57.969650 14924 consensus_peers.cc:597] T 48be8cf045364be999b8f0fd547b7b9d P 0efc951052454eec9a58b0cd025945b8 -> Peer a1a22e9119494570b6d2217713fd7e43 (127.5.126.67:38125): Couldn't send request to peer a1a22e9119494570b6d2217713fd7e43. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:22:57.969988 15154 tablet_bootstrap.cc:492] T 914c9c0c3be1486f8dcce382b61b5450 P a722e54d227f4c29a9ed6ce77858003a: No bootstrap required, opened a new log
I20260709 13:22:57.970717 15154 ts_tablet_manager.cc:1403] T 914c9c0c3be1486f8dcce382b61b5450 P a722e54d227f4c29a9ed6ce77858003a: Time spent bootstrapping tablet: real 0.377s	user 0.016s	sys 0.012s
I20260709 13:22:57.973183 15155 tablet_bootstrap.cc:492] T db6d3d345bd3495e9ec9a0e75ecd0562 P a1a22e9119494570b6d2217713fd7e43: No bootstrap required, opened a new log
I20260709 13:22:57.972994 14884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "914c9c0c3be1486f8dcce382b61b5450" candidate_uuid: "0efc951052454eec9a58b0cd025945b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f3a500981b494979b58d2b1041fec9c8" is_pre_election: true
I20260709 13:22:57.973870 15098 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bf0b7c8005aa4d8ab97a1499761bf98a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:57.974795 15155 ts_tablet_manager.cc:1403] T db6d3d345bd3495e9ec9a0e75ecd0562 P a1a22e9119494570b6d2217713fd7e43: Time spent bootstrapping tablet: real 0.284s	user 0.008s	sys 0.009s
I20260709 13:22:57.977952 15155 raft_consensus.cc:359] T db6d3d345bd3495e9ec9a0e75ecd0562 P a1a22e9119494570b6d2217713fd7e43 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } } peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } } peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } }
I20260709 13:22:57.978698 15155 raft_consensus.cc:385] T db6d3d345bd3495e9ec9a0e75ecd0562 P a1a22e9119494570b6d2217713fd7e43 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:57.978989 15155 raft_consensus.cc:740] T db6d3d345bd3495e9ec9a0e75ecd0562 P a1a22e9119494570b6d2217713fd7e43 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a1a22e9119494570b6d2217713fd7e43, State: Initialized, Role: FOLLOWER
I20260709 13:22:57.979864 15155 consensus_queue.cc:260] T db6d3d345bd3495e9ec9a0e75ecd0562 P a1a22e9119494570b6d2217713fd7e43 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } } peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } } peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } }
W20260709 13:22:57.980561 14925 leader_election.cc:343] T 914c9c0c3be1486f8dcce382b61b5450 P 0efc951052454eec9a58b0cd025945b8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f3a500981b494979b58d2b1041fec9c8 (127.5.126.65:34129): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:57.982282 15153 consensus_queue.cc:260] T a71163721b4d48b0b5ff366b9d12ac32 P 0efc951052454eec9a58b0cd025945b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } } peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } } peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } }
I20260709 13:22:57.984962 15153 ts_tablet_manager.cc:1434] T a71163721b4d48b0b5ff366b9d12ac32 P 0efc951052454eec9a58b0cd025945b8: Time spent starting tablet: real 0.046s	user 0.002s	sys 0.006s
I20260709 13:22:57.986157 15155 ts_tablet_manager.cc:1434] T db6d3d345bd3495e9ec9a0e75ecd0562 P a1a22e9119494570b6d2217713fd7e43: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.000s
I20260709 13:22:57.987306 15155 tablet_bootstrap.cc:492] T 5df7528567fd4291a888bfb37c28dc27 P a1a22e9119494570b6d2217713fd7e43: Bootstrap starting.
I20260709 13:22:57.992882 15156 tablet_bootstrap.cc:654] T 5df7528567fd4291a888bfb37c28dc27 P f3a500981b494979b58d2b1041fec9c8: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:57.994423 15155 tablet_bootstrap.cc:654] T 5df7528567fd4291a888bfb37c28dc27 P a1a22e9119494570b6d2217713fd7e43: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:57.996920 15153 tablet_bootstrap.cc:492] T 36f72377897846f2a1f3d8d33ec14af6 P 0efc951052454eec9a58b0cd025945b8: Bootstrap starting.
I20260709 13:22:58.009662 15160 raft_consensus.cc:493] T 36f72377897846f2a1f3d8d33ec14af6 P a1a22e9119494570b6d2217713fd7e43 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:58.010625 15160 raft_consensus.cc:515] T 36f72377897846f2a1f3d8d33ec14af6 P a1a22e9119494570b6d2217713fd7e43 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } } peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } } peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } }
I20260709 13:22:58.013000 15154 raft_consensus.cc:359] T 914c9c0c3be1486f8dcce382b61b5450 P a722e54d227f4c29a9ed6ce77858003a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } } peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } } peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } }
I20260709 13:22:58.020859 14960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36f72377897846f2a1f3d8d33ec14af6" candidate_uuid: "a1a22e9119494570b6d2217713fd7e43" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0efc951052454eec9a58b0cd025945b8" is_pre_election: true
I20260709 13:22:58.019055 15108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36f72377897846f2a1f3d8d33ec14af6" candidate_uuid: "a1a22e9119494570b6d2217713fd7e43" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a722e54d227f4c29a9ed6ce77858003a" is_pre_election: true
I20260709 13:22:58.013823 15160 leader_election.cc:290] T 36f72377897846f2a1f3d8d33ec14af6 P a1a22e9119494570b6d2217713fd7e43 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0efc951052454eec9a58b0cd025945b8 (127.5.126.66:34613), a722e54d227f4c29a9ed6ce77858003a (127.5.126.68:46669)
I20260709 13:22:58.030283 15178 raft_consensus.cc:493] T a71163721b4d48b0b5ff366b9d12ac32 P f3a500981b494979b58d2b1041fec9c8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:58.047550 15163 consensus_queue.cc:1048] T 48be8cf045364be999b8f0fd547b7b9d P 0efc951052454eec9a58b0cd025945b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 13:22:58.052377 14999 leader_election.cc:343] T 36f72377897846f2a1f3d8d33ec14af6 P a1a22e9119494570b6d2217713fd7e43 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a722e54d227f4c29a9ed6ce77858003a (127.5.126.68:46669): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:58.048012 15107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "914c9c0c3be1486f8dcce382b61b5450" candidate_uuid: "0efc951052454eec9a58b0cd025945b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a722e54d227f4c29a9ed6ce77858003a" is_pre_election: true
I20260709 13:22:58.049232 15153 tablet_bootstrap.cc:654] T 36f72377897846f2a1f3d8d33ec14af6 P 0efc951052454eec9a58b0cd025945b8: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:58.039784 15154 raft_consensus.cc:385] T 914c9c0c3be1486f8dcce382b61b5450 P a722e54d227f4c29a9ed6ce77858003a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:58.051597 15178 raft_consensus.cc:515] T a71163721b4d48b0b5ff366b9d12ac32 P f3a500981b494979b58d2b1041fec9c8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } } peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } } peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } }
I20260709 13:22:58.067062 15178 leader_election.cc:290] T a71163721b4d48b0b5ff366b9d12ac32 P f3a500981b494979b58d2b1041fec9c8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a722e54d227f4c29a9ed6ce77858003a (127.5.126.68:46669), 0efc951052454eec9a58b0cd025945b8 (127.5.126.66:34613)
I20260709 13:22:58.069382 15108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a71163721b4d48b0b5ff366b9d12ac32" candidate_uuid: "f3a500981b494979b58d2b1041fec9c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a722e54d227f4c29a9ed6ce77858003a" is_pre_election: true
W20260709 13:22:58.071082 14850 leader_election.cc:343] T a71163721b4d48b0b5ff366b9d12ac32 P f3a500981b494979b58d2b1041fec9c8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a722e54d227f4c29a9ed6ce77858003a (127.5.126.68:46669): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:58.072649 14959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a71163721b4d48b0b5ff366b9d12ac32" candidate_uuid: "f3a500981b494979b58d2b1041fec9c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0efc951052454eec9a58b0cd025945b8" is_pre_election: true
I20260709 13:22:58.073436 14959 raft_consensus.cc:2468] T a71163721b4d48b0b5ff366b9d12ac32 P 0efc951052454eec9a58b0cd025945b8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f3a500981b494979b58d2b1041fec9c8 in term 0.
W20260709 13:22:58.074442 14999 leader_election.cc:343] T 36f72377897846f2a1f3d8d33ec14af6 P a1a22e9119494570b6d2217713fd7e43 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0efc951052454eec9a58b0cd025945b8 (127.5.126.66:34613): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:58.074932 14999 leader_election.cc:304] T 36f72377897846f2a1f3d8d33ec14af6 P a1a22e9119494570b6d2217713fd7e43 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1a22e9119494570b6d2217713fd7e43; no voters: 0efc951052454eec9a58b0cd025945b8, a722e54d227f4c29a9ed6ce77858003a
I20260709 13:22:58.075744 15160 raft_consensus.cc:2749] T 36f72377897846f2a1f3d8d33ec14af6 P a1a22e9119494570b6d2217713fd7e43 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:22:58.081668 15073 consensus_peers.cc:597] T d65eaa0ab4574a1ea92b3848d4dc9c4d P a722e54d227f4c29a9ed6ce77858003a -> Peer f3a500981b494979b58d2b1041fec9c8 (127.5.126.65:34129): Couldn't send request to peer f3a500981b494979b58d2b1041fec9c8. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:22:58.082619 14850 leader_election.cc:304] T a71163721b4d48b0b5ff366b9d12ac32 P f3a500981b494979b58d2b1041fec9c8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0efc951052454eec9a58b0cd025945b8, f3a500981b494979b58d2b1041fec9c8; no voters: a722e54d227f4c29a9ed6ce77858003a
I20260709 13:22:58.083930 15178 raft_consensus.cc:2804] T a71163721b4d48b0b5ff366b9d12ac32 P f3a500981b494979b58d2b1041fec9c8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:22:58.062767 15154 raft_consensus.cc:740] T 914c9c0c3be1486f8dcce382b61b5450 P a722e54d227f4c29a9ed6ce77858003a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a722e54d227f4c29a9ed6ce77858003a, State: Initialized, Role: FOLLOWER
I20260709 13:22:58.084403 15178 raft_consensus.cc:493] T a71163721b4d48b0b5ff366b9d12ac32 P f3a500981b494979b58d2b1041fec9c8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:22:58.084789 15178 raft_consensus.cc:3060] T a71163721b4d48b0b5ff366b9d12ac32 P f3a500981b494979b58d2b1041fec9c8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:58.085139 15154 consensus_queue.cc:260] T 914c9c0c3be1486f8dcce382b61b5450 P a722e54d227f4c29a9ed6ce77858003a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } } peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } } peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } }
I20260709 13:22:58.089334 15107 raft_consensus.cc:2468] T 914c9c0c3be1486f8dcce382b61b5450 P a722e54d227f4c29a9ed6ce77858003a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0efc951052454eec9a58b0cd025945b8 in term 0.
I20260709 13:22:58.091825 15154 ts_tablet_manager.cc:1434] T 914c9c0c3be1486f8dcce382b61b5450 P a722e54d227f4c29a9ed6ce77858003a: Time spent starting tablet: real 0.121s	user 0.008s	sys 0.000s
I20260709 13:22:58.092084 14925 leader_election.cc:304] T 914c9c0c3be1486f8dcce382b61b5450 P 0efc951052454eec9a58b0cd025945b8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0efc951052454eec9a58b0cd025945b8, a722e54d227f4c29a9ed6ce77858003a; no voters: f3a500981b494979b58d2b1041fec9c8
I20260709 13:22:58.093048 15154 tablet_bootstrap.cc:492] T 36f72377897846f2a1f3d8d33ec14af6 P a722e54d227f4c29a9ed6ce77858003a: Bootstrap starting.
I20260709 13:22:58.093410 15163 raft_consensus.cc:2804] T 914c9c0c3be1486f8dcce382b61b5450 P 0efc951052454eec9a58b0cd025945b8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:22:58.093806 15163 raft_consensus.cc:493] T 914c9c0c3be1486f8dcce382b61b5450 P 0efc951052454eec9a58b0cd025945b8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:22:58.094128 15163 raft_consensus.cc:3060] T 914c9c0c3be1486f8dcce382b61b5450 P 0efc951052454eec9a58b0cd025945b8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:58.101848 15154 tablet_bootstrap.cc:654] T 36f72377897846f2a1f3d8d33ec14af6 P a722e54d227f4c29a9ed6ce77858003a: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:58.111151 15156 tablet_bootstrap.cc:492] T 5df7528567fd4291a888bfb37c28dc27 P f3a500981b494979b58d2b1041fec9c8: No bootstrap required, opened a new log
I20260709 13:22:58.112200 15156 ts_tablet_manager.cc:1403] T 5df7528567fd4291a888bfb37c28dc27 P f3a500981b494979b58d2b1041fec9c8: Time spent bootstrapping tablet: real 0.143s	user 0.017s	sys 0.005s
I20260709 13:22:58.111184 15155 tablet_bootstrap.cc:492] T 5df7528567fd4291a888bfb37c28dc27 P a1a22e9119494570b6d2217713fd7e43: No bootstrap required, opened a new log
I20260709 13:22:58.119226 15178 raft_consensus.cc:515] T a71163721b4d48b0b5ff366b9d12ac32 P f3a500981b494979b58d2b1041fec9c8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } } peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } } peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } }
I20260709 13:22:58.121052 15155 ts_tablet_manager.cc:1403] T 5df7528567fd4291a888bfb37c28dc27 P a1a22e9119494570b6d2217713fd7e43: Time spent bootstrapping tablet: real 0.134s	user 0.015s	sys 0.020s
I20260709 13:22:58.124964 15155 raft_consensus.cc:359] T 5df7528567fd4291a888bfb37c28dc27 P a1a22e9119494570b6d2217713fd7e43 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } } peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } } peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } }
I20260709 13:22:58.125725 15155 raft_consensus.cc:385] T 5df7528567fd4291a888bfb37c28dc27 P a1a22e9119494570b6d2217713fd7e43 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:58.126111 15155 raft_consensus.cc:740] T 5df7528567fd4291a888bfb37c28dc27 P a1a22e9119494570b6d2217713fd7e43 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a1a22e9119494570b6d2217713fd7e43, State: Initialized, Role: FOLLOWER
I20260709 13:22:58.127300 15155 consensus_queue.cc:260] T 5df7528567fd4291a888bfb37c28dc27 P a1a22e9119494570b6d2217713fd7e43 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } } peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } } peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } }
I20260709 13:22:58.135147 15178 leader_election.cc:290] T a71163721b4d48b0b5ff366b9d12ac32 P f3a500981b494979b58d2b1041fec9c8 [CANDIDATE]: Term 1 election: Requested vote from peers a722e54d227f4c29a9ed6ce77858003a (127.5.126.68:46669), 0efc951052454eec9a58b0cd025945b8 (127.5.126.66:34613)
I20260709 13:22:58.139024 15107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a71163721b4d48b0b5ff366b9d12ac32" candidate_uuid: "f3a500981b494979b58d2b1041fec9c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a722e54d227f4c29a9ed6ce77858003a"
I20260709 13:22:58.141041 14959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a71163721b4d48b0b5ff366b9d12ac32" candidate_uuid: "f3a500981b494979b58d2b1041fec9c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0efc951052454eec9a58b0cd025945b8"
I20260709 13:22:58.141935 14959 raft_consensus.cc:3060] T a71163721b4d48b0b5ff366b9d12ac32 P 0efc951052454eec9a58b0cd025945b8 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:22:58.145717 14850 leader_election.cc:343] T a71163721b4d48b0b5ff366b9d12ac32 P f3a500981b494979b58d2b1041fec9c8 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer a722e54d227f4c29a9ed6ce77858003a (127.5.126.68:46669): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:58.155699 15161 consensus_queue.cc:1048] T d65eaa0ab4574a1ea92b3848d4dc9c4d P a722e54d227f4c29a9ed6ce77858003a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:22:58.117127 15163 raft_consensus.cc:515] T 914c9c0c3be1486f8dcce382b61b5450 P 0efc951052454eec9a58b0cd025945b8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } } peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } } peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } }
I20260709 13:22:58.176230 15163 leader_election.cc:290] T 914c9c0c3be1486f8dcce382b61b5450 P 0efc951052454eec9a58b0cd025945b8 [CANDIDATE]: Term 1 election: Requested vote from peers a722e54d227f4c29a9ed6ce77858003a (127.5.126.68:46669), f3a500981b494979b58d2b1041fec9c8 (127.5.126.65:34129)
I20260709 13:22:58.176834 15156 raft_consensus.cc:359] T 5df7528567fd4291a888bfb37c28dc27 P f3a500981b494979b58d2b1041fec9c8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } } peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } } peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } }
I20260709 13:22:58.177726 15156 raft_consensus.cc:385] T 5df7528567fd4291a888bfb37c28dc27 P f3a500981b494979b58d2b1041fec9c8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:58.178073 15156 raft_consensus.cc:740] T 5df7528567fd4291a888bfb37c28dc27 P f3a500981b494979b58d2b1041fec9c8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f3a500981b494979b58d2b1041fec9c8, State: Initialized, Role: FOLLOWER
I20260709 13:22:58.187919 15155 ts_tablet_manager.cc:1434] T 5df7528567fd4291a888bfb37c28dc27 P a1a22e9119494570b6d2217713fd7e43: Time spent starting tablet: real 0.066s	user 0.004s	sys 0.004s
W20260709 13:22:58.188295 14830 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:22:58.188673 14885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "914c9c0c3be1486f8dcce382b61b5450" candidate_uuid: "0efc951052454eec9a58b0cd025945b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f3a500981b494979b58d2b1041fec9c8"
I20260709 13:22:58.189374 15155 tablet_bootstrap.cc:492] T 7560205f5d324c7d821dff8efe7a6256 P a1a22e9119494570b6d2217713fd7e43: Bootstrap starting.
W20260709 13:22:58.190872 14925 leader_election.cc:343] T 914c9c0c3be1486f8dcce382b61b5450 P 0efc951052454eec9a58b0cd025945b8 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f3a500981b494979b58d2b1041fec9c8 (127.5.126.65:34129): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:58.192670 15107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "914c9c0c3be1486f8dcce382b61b5450" candidate_uuid: "0efc951052454eec9a58b0cd025945b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a722e54d227f4c29a9ed6ce77858003a"
I20260709 13:22:58.193411 15107 raft_consensus.cc:3060] T 914c9c0c3be1486f8dcce382b61b5450 P a722e54d227f4c29a9ed6ce77858003a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:58.197531 15155 tablet_bootstrap.cc:654] T 7560205f5d324c7d821dff8efe7a6256 P a1a22e9119494570b6d2217713fd7e43: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:58.204368 14959 raft_consensus.cc:2468] T a71163721b4d48b0b5ff366b9d12ac32 P 0efc951052454eec9a58b0cd025945b8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f3a500981b494979b58d2b1041fec9c8 in term 1.
I20260709 13:22:58.208149 15153 tablet_bootstrap.cc:492] T 36f72377897846f2a1f3d8d33ec14af6 P 0efc951052454eec9a58b0cd025945b8: No bootstrap required, opened a new log
I20260709 13:22:58.221341 15153 ts_tablet_manager.cc:1403] T 36f72377897846f2a1f3d8d33ec14af6 P 0efc951052454eec9a58b0cd025945b8: Time spent bootstrapping tablet: real 0.235s	user 0.044s	sys 0.024s
W20260709 13:22:58.221673 14999 consensus_peers.cc:597] T 117ae8a22b1d46579ce047f99e30520b P a1a22e9119494570b6d2217713fd7e43 -> Peer a722e54d227f4c29a9ed6ce77858003a (127.5.126.68:46669): Couldn't send request to peer a722e54d227f4c29a9ed6ce77858003a. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:22:58.209609 15154 tablet_bootstrap.cc:492] T 36f72377897846f2a1f3d8d33ec14af6 P a722e54d227f4c29a9ed6ce77858003a: No bootstrap required, opened a new log
I20260709 13:22:58.223055 15154 ts_tablet_manager.cc:1403] T 36f72377897846f2a1f3d8d33ec14af6 P a722e54d227f4c29a9ed6ce77858003a: Time spent bootstrapping tablet: real 0.130s	user 0.030s	sys 0.029s
I20260709 13:22:58.226939 15154 raft_consensus.cc:359] T 36f72377897846f2a1f3d8d33ec14af6 P a722e54d227f4c29a9ed6ce77858003a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } } peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } } peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } }
I20260709 13:22:58.227780 15154 raft_consensus.cc:385] T 36f72377897846f2a1f3d8d33ec14af6 P a722e54d227f4c29a9ed6ce77858003a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:58.228266 15154 raft_consensus.cc:740] T 36f72377897846f2a1f3d8d33ec14af6 P a722e54d227f4c29a9ed6ce77858003a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a722e54d227f4c29a9ed6ce77858003a, State: Initialized, Role: FOLLOWER
I20260709 13:22:58.228072 15153 raft_consensus.cc:359] T 36f72377897846f2a1f3d8d33ec14af6 P 0efc951052454eec9a58b0cd025945b8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } } peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } } peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } }
I20260709 13:22:58.229027 15153 raft_consensus.cc:385] T 36f72377897846f2a1f3d8d33ec14af6 P 0efc951052454eec9a58b0cd025945b8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:58.229413 15153 raft_consensus.cc:740] T 36f72377897846f2a1f3d8d33ec14af6 P 0efc951052454eec9a58b0cd025945b8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0efc951052454eec9a58b0cd025945b8, State: Initialized, Role: FOLLOWER
I20260709 13:22:58.229259 15154 consensus_queue.cc:260] T 36f72377897846f2a1f3d8d33ec14af6 P a722e54d227f4c29a9ed6ce77858003a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } } peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } } peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } }
I20260709 13:22:58.221766 15107 raft_consensus.cc:2468] T 914c9c0c3be1486f8dcce382b61b5450 P a722e54d227f4c29a9ed6ce77858003a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0efc951052454eec9a58b0cd025945b8 in term 1.
I20260709 13:22:58.230336 15153 consensus_queue.cc:260] T 36f72377897846f2a1f3d8d33ec14af6 P 0efc951052454eec9a58b0cd025945b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } } peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } } peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } }
I20260709 13:22:58.204689 15156 consensus_queue.cc:260] T 5df7528567fd4291a888bfb37c28dc27 P f3a500981b494979b58d2b1041fec9c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } } peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } } peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } }
I20260709 13:22:58.232499 14925 leader_election.cc:304] T 914c9c0c3be1486f8dcce382b61b5450 P 0efc951052454eec9a58b0cd025945b8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0efc951052454eec9a58b0cd025945b8, a722e54d227f4c29a9ed6ce77858003a; no voters: f3a500981b494979b58d2b1041fec9c8
I20260709 13:22:58.234978 15156 ts_tablet_manager.cc:1434] T 5df7528567fd4291a888bfb37c28dc27 P f3a500981b494979b58d2b1041fec9c8: Time spent starting tablet: real 0.122s	user 0.006s	sys 0.001s
I20260709 13:22:58.236845 15156 tablet_bootstrap.cc:492] T d65eaa0ab4574a1ea92b3848d4dc9c4d P f3a500981b494979b58d2b1041fec9c8: Bootstrap starting.
I20260709 13:22:58.243314 14850 leader_election.cc:304] T a71163721b4d48b0b5ff366b9d12ac32 P f3a500981b494979b58d2b1041fec9c8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0efc951052454eec9a58b0cd025945b8, f3a500981b494979b58d2b1041fec9c8; no voters: a722e54d227f4c29a9ed6ce77858003a
I20260709 13:22:58.252861 15178 raft_consensus.cc:2804] T a71163721b4d48b0b5ff366b9d12ac32 P f3a500981b494979b58d2b1041fec9c8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:22:58.253461 15178 raft_consensus.cc:697] T a71163721b4d48b0b5ff366b9d12ac32 P f3a500981b494979b58d2b1041fec9c8 [term 1 LEADER]: Becoming Leader. State: Replica: f3a500981b494979b58d2b1041fec9c8, State: Running, Role: LEADER
I20260709 13:22:58.254381 15178 consensus_queue.cc:237] T a71163721b4d48b0b5ff366b9d12ac32 P f3a500981b494979b58d2b1041fec9c8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } } peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } } peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } }
I20260709 13:22:58.256075 15156 tablet_bootstrap.cc:654] T d65eaa0ab4574a1ea92b3848d4dc9c4d P f3a500981b494979b58d2b1041fec9c8: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:58.257483 15216 raft_consensus.cc:2804] T 914c9c0c3be1486f8dcce382b61b5450 P 0efc951052454eec9a58b0cd025945b8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:22:58.258044 15216 raft_consensus.cc:697] T 914c9c0c3be1486f8dcce382b61b5450 P 0efc951052454eec9a58b0cd025945b8 [term 1 LEADER]: Becoming Leader. State: Replica: 0efc951052454eec9a58b0cd025945b8, State: Running, Role: LEADER
I20260709 13:22:58.258927 15216 consensus_queue.cc:237] T 914c9c0c3be1486f8dcce382b61b5450 P 0efc951052454eec9a58b0cd025945b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } } peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } } peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } }
I20260709 13:22:58.261294 15155 tablet_bootstrap.cc:492] T 7560205f5d324c7d821dff8efe7a6256 P a1a22e9119494570b6d2217713fd7e43: No bootstrap required, opened a new log
I20260709 13:22:58.262544 15153 ts_tablet_manager.cc:1434] T 36f72377897846f2a1f3d8d33ec14af6 P 0efc951052454eec9a58b0cd025945b8: Time spent starting tablet: real 0.041s	user 0.007s	sys 0.009s
I20260709 13:22:58.261821 15155 ts_tablet_manager.cc:1403] T 7560205f5d324c7d821dff8efe7a6256 P a1a22e9119494570b6d2217713fd7e43: Time spent bootstrapping tablet: real 0.073s	user 0.015s	sys 0.024s
I20260709 13:22:58.268714 15160 consensus_queue.cc:1048] T 117ae8a22b1d46579ce047f99e30520b P a1a22e9119494570b6d2217713fd7e43 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:22:58.272748 15153 tablet_bootstrap.cc:492] T db6d3d345bd3495e9ec9a0e75ecd0562 P 0efc951052454eec9a58b0cd025945b8: Bootstrap starting.
I20260709 13:22:58.272688 15155 raft_consensus.cc:359] T 7560205f5d324c7d821dff8efe7a6256 P a1a22e9119494570b6d2217713fd7e43 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } } peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } } peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } }
I20260709 13:22:58.287366 15216 raft_consensus.cc:493] T 36f72377897846f2a1f3d8d33ec14af6 P 0efc951052454eec9a58b0cd025945b8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:58.288297 15216 raft_consensus.cc:515] T 36f72377897846f2a1f3d8d33ec14af6 P 0efc951052454eec9a58b0cd025945b8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } } peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } } peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } }
I20260709 13:22:58.276914 15155 raft_consensus.cc:385] T 7560205f5d324c7d821dff8efe7a6256 P a1a22e9119494570b6d2217713fd7e43 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:58.298195 15154 ts_tablet_manager.cc:1434] T 36f72377897846f2a1f3d8d33ec14af6 P a722e54d227f4c29a9ed6ce77858003a: Time spent starting tablet: real 0.075s	user 0.038s	sys 0.033s
I20260709 13:22:58.299458 15154 tablet_bootstrap.cc:492] T 268027ae94a54cf4acf51c54c7b9032b P a722e54d227f4c29a9ed6ce77858003a: Bootstrap starting.
I20260709 13:22:58.292348 15155 raft_consensus.cc:740] T 7560205f5d324c7d821dff8efe7a6256 P a1a22e9119494570b6d2217713fd7e43 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a1a22e9119494570b6d2217713fd7e43, State: Initialized, Role: FOLLOWER
I20260709 13:22:58.304898 15153 tablet_bootstrap.cc:654] T db6d3d345bd3495e9ec9a0e75ecd0562 P 0efc951052454eec9a58b0cd025945b8: Neither blocks nor log segments found. Creating new log.
W20260709 13:22:58.293123 14925 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.68:46669, user_credentials={real_user=slave}} blocked reactor thread for 60785.2us
I20260709 13:22:58.316601 15033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36f72377897846f2a1f3d8d33ec14af6" candidate_uuid: "0efc951052454eec9a58b0cd025945b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1a22e9119494570b6d2217713fd7e43" is_pre_election: true
I20260709 13:22:58.317497 15033 raft_consensus.cc:2468] T 36f72377897846f2a1f3d8d33ec14af6 P a1a22e9119494570b6d2217713fd7e43 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0efc951052454eec9a58b0cd025945b8 in term 0.
I20260709 13:22:58.319139 14924 leader_election.cc:304] T 36f72377897846f2a1f3d8d33ec14af6 P 0efc951052454eec9a58b0cd025945b8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0efc951052454eec9a58b0cd025945b8, a1a22e9119494570b6d2217713fd7e43; no voters: 
I20260709 13:22:58.320505 15220 raft_consensus.cc:2804] T 36f72377897846f2a1f3d8d33ec14af6 P 0efc951052454eec9a58b0cd025945b8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:22:58.321108 15220 raft_consensus.cc:493] T 36f72377897846f2a1f3d8d33ec14af6 P 0efc951052454eec9a58b0cd025945b8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:22:58.321563 15220 raft_consensus.cc:3060] T 36f72377897846f2a1f3d8d33ec14af6 P 0efc951052454eec9a58b0cd025945b8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:58.324427 15160 raft_consensus.cc:493] T 5df7528567fd4291a888bfb37c28dc27 P a1a22e9119494570b6d2217713fd7e43 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:58.323835 14781 catalog_manager.cc:5697] T a71163721b4d48b0b5ff366b9d12ac32 P f3a500981b494979b58d2b1041fec9c8 reported cstate change: term changed from 0 to 1, leader changed from <none> to f3a500981b494979b58d2b1041fec9c8 (127.5.126.65). New cstate: current_term: 1 leader_uuid: "f3a500981b494979b58d2b1041fec9c8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } health_report { overall_health: UNKNOWN } } }
I20260709 13:22:58.324976 15160 raft_consensus.cc:515] T 5df7528567fd4291a888bfb37c28dc27 P a1a22e9119494570b6d2217713fd7e43 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } } peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } } peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } }
I20260709 13:22:58.320638 15155 consensus_queue.cc:260] T 7560205f5d324c7d821dff8efe7a6256 P a1a22e9119494570b6d2217713fd7e43 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } } peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } } peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } }
I20260709 13:22:58.328668 15160 leader_election.cc:290] T 5df7528567fd4291a888bfb37c28dc27 P a1a22e9119494570b6d2217713fd7e43 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a722e54d227f4c29a9ed6ce77858003a (127.5.126.68:46669), f3a500981b494979b58d2b1041fec9c8 (127.5.126.65:34129)
I20260709 13:22:58.338451 15154 tablet_bootstrap.cc:654] T 268027ae94a54cf4acf51c54c7b9032b P a722e54d227f4c29a9ed6ce77858003a: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:58.343614 15108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36f72377897846f2a1f3d8d33ec14af6" candidate_uuid: "0efc951052454eec9a58b0cd025945b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a722e54d227f4c29a9ed6ce77858003a" is_pre_election: true
I20260709 13:22:58.344357 15108 raft_consensus.cc:2468] T 36f72377897846f2a1f3d8d33ec14af6 P a722e54d227f4c29a9ed6ce77858003a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0efc951052454eec9a58b0cd025945b8 in term 0.
I20260709 13:22:58.336398 15107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df7528567fd4291a888bfb37c28dc27" candidate_uuid: "a1a22e9119494570b6d2217713fd7e43" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a722e54d227f4c29a9ed6ce77858003a" is_pre_election: true
I20260709 13:22:58.346685 15216 leader_election.cc:290] T 36f72377897846f2a1f3d8d33ec14af6 P 0efc951052454eec9a58b0cd025945b8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a1a22e9119494570b6d2217713fd7e43 (127.5.126.67:38125), a722e54d227f4c29a9ed6ce77858003a (127.5.126.68:46669)
I20260709 13:22:58.334117 15220 raft_consensus.cc:515] T 36f72377897846f2a1f3d8d33ec14af6 P 0efc951052454eec9a58b0cd025945b8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } } peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } } peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } }
I20260709 13:22:58.361238 15155 ts_tablet_manager.cc:1434] T 7560205f5d324c7d821dff8efe7a6256 P a1a22e9119494570b6d2217713fd7e43: Time spent starting tablet: real 0.092s	user 0.011s	sys 0.017s
I20260709 13:22:58.362650 15155 tablet_bootstrap.cc:492] T e85432ede09747339c957cdaa7d15ac6 P a1a22e9119494570b6d2217713fd7e43: Bootstrap starting.
I20260709 13:22:58.362782 15156 tablet_bootstrap.cc:492] T d65eaa0ab4574a1ea92b3848d4dc9c4d P f3a500981b494979b58d2b1041fec9c8: No bootstrap required, opened a new log
I20260709 13:22:58.363677 15156 ts_tablet_manager.cc:1403] T d65eaa0ab4574a1ea92b3848d4dc9c4d P f3a500981b494979b58d2b1041fec9c8: Time spent bootstrapping tablet: real 0.127s	user 0.013s	sys 0.013s
I20260709 13:22:58.371618 15220 leader_election.cc:290] T 36f72377897846f2a1f3d8d33ec14af6 P 0efc951052454eec9a58b0cd025945b8 [CANDIDATE]: Term 1 election: Requested vote from peers a1a22e9119494570b6d2217713fd7e43 (127.5.126.67:38125), a722e54d227f4c29a9ed6ce77858003a (127.5.126.68:46669)
I20260709 13:22:58.372462 15034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36f72377897846f2a1f3d8d33ec14af6" candidate_uuid: "0efc951052454eec9a58b0cd025945b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1a22e9119494570b6d2217713fd7e43"
I20260709 13:22:58.372901 15107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36f72377897846f2a1f3d8d33ec14af6" candidate_uuid: "0efc951052454eec9a58b0cd025945b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a722e54d227f4c29a9ed6ce77858003a"
I20260709 13:22:58.373216 15034 raft_consensus.cc:3060] T 36f72377897846f2a1f3d8d33ec14af6 P a1a22e9119494570b6d2217713fd7e43 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:58.373780 15107 raft_consensus.cc:3060] T 36f72377897846f2a1f3d8d33ec14af6 P a722e54d227f4c29a9ed6ce77858003a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:58.375411 15156 raft_consensus.cc:359] T d65eaa0ab4574a1ea92b3848d4dc9c4d P f3a500981b494979b58d2b1041fec9c8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } } peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } } peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } }
I20260709 13:22:58.376206 15156 raft_consensus.cc:385] T d65eaa0ab4574a1ea92b3848d4dc9c4d P f3a500981b494979b58d2b1041fec9c8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:58.376487 15156 raft_consensus.cc:740] T d65eaa0ab4574a1ea92b3848d4dc9c4d P f3a500981b494979b58d2b1041fec9c8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f3a500981b494979b58d2b1041fec9c8, State: Initialized, Role: FOLLOWER
I20260709 13:22:58.380612 15155 tablet_bootstrap.cc:654] T e85432ede09747339c957cdaa7d15ac6 P a1a22e9119494570b6d2217713fd7e43: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:58.384891 15156 consensus_queue.cc:260] T d65eaa0ab4574a1ea92b3848d4dc9c4d P f3a500981b494979b58d2b1041fec9c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } } peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } } peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } }
I20260709 13:22:58.387095 15034 raft_consensus.cc:2468] T 36f72377897846f2a1f3d8d33ec14af6 P a1a22e9119494570b6d2217713fd7e43 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0efc951052454eec9a58b0cd025945b8 in term 1.
I20260709 13:22:58.390511 14924 leader_election.cc:304] T 36f72377897846f2a1f3d8d33ec14af6 P 0efc951052454eec9a58b0cd025945b8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0efc951052454eec9a58b0cd025945b8, a1a22e9119494570b6d2217713fd7e43; no voters: 
I20260709 13:22:58.385105 14782 catalog_manager.cc:5697] T 914c9c0c3be1486f8dcce382b61b5450 P 0efc951052454eec9a58b0cd025945b8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0efc951052454eec9a58b0cd025945b8 (127.5.126.66). New cstate: current_term: 1 leader_uuid: "0efc951052454eec9a58b0cd025945b8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } health_report { overall_health: HEALTHY } } }
I20260709 13:22:58.392043 15156 ts_tablet_manager.cc:1434] T d65eaa0ab4574a1ea92b3848d4dc9c4d P f3a500981b494979b58d2b1041fec9c8: Time spent starting tablet: real 0.028s	user 0.009s	sys 0.000s
I20260709 13:22:58.395754 15107 raft_consensus.cc:2468] T 36f72377897846f2a1f3d8d33ec14af6 P a722e54d227f4c29a9ed6ce77858003a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0efc951052454eec9a58b0cd025945b8 in term 1.
I20260709 13:22:58.397653 15224 raft_consensus.cc:493] T 7560205f5d324c7d821dff8efe7a6256 P a1a22e9119494570b6d2217713fd7e43 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:58.398263 15224 raft_consensus.cc:515] T 7560205f5d324c7d821dff8efe7a6256 P a1a22e9119494570b6d2217713fd7e43 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } } peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } } peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } }
I20260709 13:22:58.400893 15224 leader_election.cc:290] T 7560205f5d324c7d821dff8efe7a6256 P a1a22e9119494570b6d2217713fd7e43 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f3a500981b494979b58d2b1041fec9c8 (127.5.126.65:34129), 0efc951052454eec9a58b0cd025945b8 (127.5.126.66:34613)
I20260709 13:22:58.392702 15220 raft_consensus.cc:2804] T 36f72377897846f2a1f3d8d33ec14af6 P 0efc951052454eec9a58b0cd025945b8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:22:58.402946 15220 raft_consensus.cc:697] T 36f72377897846f2a1f3d8d33ec14af6 P 0efc951052454eec9a58b0cd025945b8 [term 1 LEADER]: Becoming Leader. State: Replica: 0efc951052454eec9a58b0cd025945b8, State: Running, Role: LEADER
I20260709 13:22:58.405361 15220 consensus_queue.cc:237] T 36f72377897846f2a1f3d8d33ec14af6 P 0efc951052454eec9a58b0cd025945b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } } peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } } peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } }
W20260709 13:22:58.406838 14999 leader_election.cc:343] T 5df7528567fd4291a888bfb37c28dc27 P a1a22e9119494570b6d2217713fd7e43 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a722e54d227f4c29a9ed6ce77858003a (127.5.126.68:46669): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:58.408332 15156 tablet_bootstrap.cc:492] T 46ed2e9dd1324ac4a6e07f813cfebb7e P f3a500981b494979b58d2b1041fec9c8: Bootstrap starting.
I20260709 13:22:58.415053 15153 tablet_bootstrap.cc:492] T db6d3d345bd3495e9ec9a0e75ecd0562 P 0efc951052454eec9a58b0cd025945b8: No bootstrap required, opened a new log
I20260709 13:22:58.417093 14959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7560205f5d324c7d821dff8efe7a6256" candidate_uuid: "a1a22e9119494570b6d2217713fd7e43" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0efc951052454eec9a58b0cd025945b8" is_pre_election: true
I20260709 13:22:58.418941 15154 tablet_bootstrap.cc:492] T 268027ae94a54cf4acf51c54c7b9032b P a722e54d227f4c29a9ed6ce77858003a: No bootstrap required, opened a new log
I20260709 13:22:58.419560 15154 ts_tablet_manager.cc:1403] T 268027ae94a54cf4acf51c54c7b9032b P a722e54d227f4c29a9ed6ce77858003a: Time spent bootstrapping tablet: real 0.120s	user 0.014s	sys 0.002s
W20260709 13:22:58.420938 14999 leader_election.cc:343] T 7560205f5d324c7d821dff8efe7a6256 P a1a22e9119494570b6d2217713fd7e43 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0efc951052454eec9a58b0cd025945b8 (127.5.126.66:34613): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:58.424561 15154 raft_consensus.cc:359] T 268027ae94a54cf4acf51c54c7b9032b P a722e54d227f4c29a9ed6ce77858003a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } } peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } } peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } }
I20260709 13:22:58.425631 15154 raft_consensus.cc:385] T 268027ae94a54cf4acf51c54c7b9032b P a722e54d227f4c29a9ed6ce77858003a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:58.426376 15153 ts_tablet_manager.cc:1403] T db6d3d345bd3495e9ec9a0e75ecd0562 P 0efc951052454eec9a58b0cd025945b8: Time spent bootstrapping tablet: real 0.154s	user 0.020s	sys 0.006s
I20260709 13:22:58.426029 15154 raft_consensus.cc:740] T 268027ae94a54cf4acf51c54c7b9032b P a722e54d227f4c29a9ed6ce77858003a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a722e54d227f4c29a9ed6ce77858003a, State: Initialized, Role: FOLLOWER
I20260709 13:22:58.430173 15156 tablet_bootstrap.cc:654] T 46ed2e9dd1324ac4a6e07f813cfebb7e P f3a500981b494979b58d2b1041fec9c8: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:58.431749 14885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7560205f5d324c7d821dff8efe7a6256" candidate_uuid: "a1a22e9119494570b6d2217713fd7e43" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f3a500981b494979b58d2b1041fec9c8" is_pre_election: true
I20260709 13:22:58.431555 15154 consensus_queue.cc:260] T 268027ae94a54cf4acf51c54c7b9032b P a722e54d227f4c29a9ed6ce77858003a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } } peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } } peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } }
I20260709 13:22:58.434136 14884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df7528567fd4291a888bfb37c28dc27" candidate_uuid: "a1a22e9119494570b6d2217713fd7e43" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f3a500981b494979b58d2b1041fec9c8" is_pre_election: true
I20260709 13:22:58.434406 15154 ts_tablet_manager.cc:1434] T 268027ae94a54cf4acf51c54c7b9032b P a722e54d227f4c29a9ed6ce77858003a: Time spent starting tablet: real 0.014s	user 0.006s	sys 0.003s
I20260709 13:22:58.435209 14884 raft_consensus.cc:2468] T 5df7528567fd4291a888bfb37c28dc27 P f3a500981b494979b58d2b1041fec9c8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1a22e9119494570b6d2217713fd7e43 in term 0.
I20260709 13:22:58.437146 15154 tablet_bootstrap.cc:492] T 2a862e106a9e48a692bc72ea8c03ab39 P a722e54d227f4c29a9ed6ce77858003a: Bootstrap starting.
W20260709 13:22:58.438258 14999 leader_election.cc:343] T 7560205f5d324c7d821dff8efe7a6256 P a1a22e9119494570b6d2217713fd7e43 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f3a500981b494979b58d2b1041fec9c8 (127.5.126.65:34129): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:58.438971 14999 leader_election.cc:304] T 7560205f5d324c7d821dff8efe7a6256 P a1a22e9119494570b6d2217713fd7e43 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1a22e9119494570b6d2217713fd7e43; no voters: 0efc951052454eec9a58b0cd025945b8, f3a500981b494979b58d2b1041fec9c8
I20260709 13:22:58.440045 15224 raft_consensus.cc:2749] T 7560205f5d324c7d821dff8efe7a6256 P a1a22e9119494570b6d2217713fd7e43 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:22:58.440512 14999 leader_election.cc:304] T 5df7528567fd4291a888bfb37c28dc27 P a1a22e9119494570b6d2217713fd7e43 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a1a22e9119494570b6d2217713fd7e43, f3a500981b494979b58d2b1041fec9c8; no voters: a722e54d227f4c29a9ed6ce77858003a
I20260709 13:22:58.441533 15224 raft_consensus.cc:2804] T 5df7528567fd4291a888bfb37c28dc27 P a1a22e9119494570b6d2217713fd7e43 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:22:58.441901 15224 raft_consensus.cc:493] T 5df7528567fd4291a888bfb37c28dc27 P a1a22e9119494570b6d2217713fd7e43 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:22:58.442237 15224 raft_consensus.cc:3060] T 5df7528567fd4291a888bfb37c28dc27 P a1a22e9119494570b6d2217713fd7e43 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:58.444458 15154 tablet_bootstrap.cc:654] T 2a862e106a9e48a692bc72ea8c03ab39 P a722e54d227f4c29a9ed6ce77858003a: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:58.444263 15153 raft_consensus.cc:359] T db6d3d345bd3495e9ec9a0e75ecd0562 P 0efc951052454eec9a58b0cd025945b8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } } peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } } peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } }
I20260709 13:22:58.445084 15153 raft_consensus.cc:385] T db6d3d345bd3495e9ec9a0e75ecd0562 P 0efc951052454eec9a58b0cd025945b8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:58.445415 15153 raft_consensus.cc:740] T db6d3d345bd3495e9ec9a0e75ecd0562 P 0efc951052454eec9a58b0cd025945b8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0efc951052454eec9a58b0cd025945b8, State: Initialized, Role: FOLLOWER
I20260709 13:22:58.446954 15153 consensus_queue.cc:260] T db6d3d345bd3495e9ec9a0e75ecd0562 P 0efc951052454eec9a58b0cd025945b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } } peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } } peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } }
I20260709 13:22:58.447817 15155 tablet_bootstrap.cc:492] T e85432ede09747339c957cdaa7d15ac6 P a1a22e9119494570b6d2217713fd7e43: No bootstrap required, opened a new log
I20260709 13:22:58.448414 15155 ts_tablet_manager.cc:1403] T e85432ede09747339c957cdaa7d15ac6 P a1a22e9119494570b6d2217713fd7e43: Time spent bootstrapping tablet: real 0.086s	user 0.009s	sys 0.006s
I20260709 13:22:58.449950 15160 raft_consensus.cc:493] T db6d3d345bd3495e9ec9a0e75ecd0562 P a1a22e9119494570b6d2217713fd7e43 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:58.450192 15153 ts_tablet_manager.cc:1434] T db6d3d345bd3495e9ec9a0e75ecd0562 P 0efc951052454eec9a58b0cd025945b8: Time spent starting tablet: real 0.023s	user 0.004s	sys 0.003s
I20260709 13:22:58.450552 15160 raft_consensus.cc:515] T db6d3d345bd3495e9ec9a0e75ecd0562 P a1a22e9119494570b6d2217713fd7e43 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } } peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } } peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } }
I20260709 13:22:58.450130 14783 catalog_manager.cc:5697] T 36f72377897846f2a1f3d8d33ec14af6 P 0efc951052454eec9a58b0cd025945b8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0efc951052454eec9a58b0cd025945b8 (127.5.126.66). New cstate: current_term: 1 leader_uuid: "0efc951052454eec9a58b0cd025945b8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } health_report { overall_health: UNKNOWN } } }
I20260709 13:22:58.451416 15153 tablet_bootstrap.cc:492] T 7560205f5d324c7d821dff8efe7a6256 P 0efc951052454eec9a58b0cd025945b8: Bootstrap starting.
I20260709 13:22:58.451362 15155 raft_consensus.cc:359] T e85432ede09747339c957cdaa7d15ac6 P a1a22e9119494570b6d2217713fd7e43 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } } peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } } peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } }
I20260709 13:22:58.452320 15155 raft_consensus.cc:385] T e85432ede09747339c957cdaa7d15ac6 P a1a22e9119494570b6d2217713fd7e43 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:58.452631 15155 raft_consensus.cc:740] T e85432ede09747339c957cdaa7d15ac6 P a1a22e9119494570b6d2217713fd7e43 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a1a22e9119494570b6d2217713fd7e43, State: Initialized, Role: FOLLOWER
I20260709 13:22:58.452800 15160 leader_election.cc:290] T db6d3d345bd3495e9ec9a0e75ecd0562 P a1a22e9119494570b6d2217713fd7e43 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f3a500981b494979b58d2b1041fec9c8 (127.5.126.65:34129), 0efc951052454eec9a58b0cd025945b8 (127.5.126.66:34613)
I20260709 13:22:58.459213 15153 tablet_bootstrap.cc:654] T 7560205f5d324c7d821dff8efe7a6256 P 0efc951052454eec9a58b0cd025945b8: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:58.459991 14884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db6d3d345bd3495e9ec9a0e75ecd0562" candidate_uuid: "a1a22e9119494570b6d2217713fd7e43" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f3a500981b494979b58d2b1041fec9c8" is_pre_election: true
I20260709 13:22:58.461115 14959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db6d3d345bd3495e9ec9a0e75ecd0562" candidate_uuid: "a1a22e9119494570b6d2217713fd7e43" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0efc951052454eec9a58b0cd025945b8" is_pre_election: true
W20260709 13:22:58.461679 14999 leader_election.cc:343] T db6d3d345bd3495e9ec9a0e75ecd0562 P a1a22e9119494570b6d2217713fd7e43 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f3a500981b494979b58d2b1041fec9c8 (127.5.126.65:34129): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:58.461887 14959 raft_consensus.cc:2468] T db6d3d345bd3495e9ec9a0e75ecd0562 P 0efc951052454eec9a58b0cd025945b8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1a22e9119494570b6d2217713fd7e43 in term 0.
I20260709 13:22:58.462724 15224 raft_consensus.cc:515] T 5df7528567fd4291a888bfb37c28dc27 P a1a22e9119494570b6d2217713fd7e43 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } } peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } } peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } }
I20260709 13:22:58.465078 15224 leader_election.cc:290] T 5df7528567fd4291a888bfb37c28dc27 P a1a22e9119494570b6d2217713fd7e43 [CANDIDATE]: Term 1 election: Requested vote from peers a722e54d227f4c29a9ed6ce77858003a (127.5.126.68:46669), f3a500981b494979b58d2b1041fec9c8 (127.5.126.65:34129)
I20260709 13:22:58.465811 15155 consensus_queue.cc:260] T e85432ede09747339c957cdaa7d15ac6 P a1a22e9119494570b6d2217713fd7e43 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } } peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } } peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } }
I20260709 13:22:58.466145 15107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df7528567fd4291a888bfb37c28dc27" candidate_uuid: "a1a22e9119494570b6d2217713fd7e43" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a722e54d227f4c29a9ed6ce77858003a"
I20260709 13:22:58.466804 14999 leader_election.cc:304] T db6d3d345bd3495e9ec9a0e75ecd0562 P a1a22e9119494570b6d2217713fd7e43 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0efc951052454eec9a58b0cd025945b8, a1a22e9119494570b6d2217713fd7e43; no voters: f3a500981b494979b58d2b1041fec9c8
I20260709 13:22:58.467581 15160 raft_consensus.cc:493] T e85432ede09747339c957cdaa7d15ac6 P a1a22e9119494570b6d2217713fd7e43 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:58.466266 14884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df7528567fd4291a888bfb37c28dc27" candidate_uuid: "a1a22e9119494570b6d2217713fd7e43" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f3a500981b494979b58d2b1041fec9c8"
I20260709 13:22:58.468178 15160 raft_consensus.cc:515] T e85432ede09747339c957cdaa7d15ac6 P a1a22e9119494570b6d2217713fd7e43 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } } peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } } peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } }
I20260709 13:22:58.469048 14884 raft_consensus.cc:3060] T 5df7528567fd4291a888bfb37c28dc27 P f3a500981b494979b58d2b1041fec9c8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:58.470635 15160 leader_election.cc:290] T e85432ede09747339c957cdaa7d15ac6 P a1a22e9119494570b6d2217713fd7e43 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a722e54d227f4c29a9ed6ce77858003a (127.5.126.68:46669), f3a500981b494979b58d2b1041fec9c8 (127.5.126.65:34129)
I20260709 13:22:58.471235 15160 raft_consensus.cc:2804] T db6d3d345bd3495e9ec9a0e75ecd0562 P a1a22e9119494570b6d2217713fd7e43 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:22:58.471736 15160 raft_consensus.cc:493] T db6d3d345bd3495e9ec9a0e75ecd0562 P a1a22e9119494570b6d2217713fd7e43 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:22:58.472128 15160 raft_consensus.cc:3060] T db6d3d345bd3495e9ec9a0e75ecd0562 P a1a22e9119494570b6d2217713fd7e43 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:58.472540 15178 raft_consensus.cc:493] T d65eaa0ab4574a1ea92b3848d4dc9c4d P f3a500981b494979b58d2b1041fec9c8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:58.473395 15178 raft_consensus.cc:515] T d65eaa0ab4574a1ea92b3848d4dc9c4d P f3a500981b494979b58d2b1041fec9c8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } } peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } } peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } }
I20260709 13:22:58.477252 14884 raft_consensus.cc:2468] T 5df7528567fd4291a888bfb37c28dc27 P f3a500981b494979b58d2b1041fec9c8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1a22e9119494570b6d2217713fd7e43 in term 1.
I20260709 13:22:58.480790 15156 tablet_bootstrap.cc:492] T 46ed2e9dd1324ac4a6e07f813cfebb7e P f3a500981b494979b58d2b1041fec9c8: No bootstrap required, opened a new log
I20260709 13:22:58.481431 15156 ts_tablet_manager.cc:1403] T 46ed2e9dd1324ac4a6e07f813cfebb7e P f3a500981b494979b58d2b1041fec9c8: Time spent bootstrapping tablet: real 0.080s	user 0.019s	sys 0.000s
I20260709 13:22:58.481696 15155 ts_tablet_manager.cc:1434] T e85432ede09747339c957cdaa7d15ac6 P a1a22e9119494570b6d2217713fd7e43: Time spent starting tablet: real 0.033s	user 0.004s	sys 0.002s
I20260709 13:22:58.482887 15155 tablet_bootstrap.cc:492] T 46ed2e9dd1324ac4a6e07f813cfebb7e P a1a22e9119494570b6d2217713fd7e43: Bootstrap starting.
I20260709 13:22:58.486598 15160 raft_consensus.cc:515] T db6d3d345bd3495e9ec9a0e75ecd0562 P a1a22e9119494570b6d2217713fd7e43 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } } peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } } peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } }
I20260709 13:22:58.490134 15108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d65eaa0ab4574a1ea92b3848d4dc9c4d" candidate_uuid: "f3a500981b494979b58d2b1041fec9c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a722e54d227f4c29a9ed6ce77858003a" is_pre_election: true
I20260709 13:22:58.491106 15178 leader_election.cc:290] T d65eaa0ab4574a1ea92b3848d4dc9c4d P f3a500981b494979b58d2b1041fec9c8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a1a22e9119494570b6d2217713fd7e43 (127.5.126.67:38125), a722e54d227f4c29a9ed6ce77858003a (127.5.126.68:46669)
I20260709 13:22:58.499840 15160 leader_election.cc:290] T db6d3d345bd3495e9ec9a0e75ecd0562 P a1a22e9119494570b6d2217713fd7e43 [CANDIDATE]: Term 1 election: Requested vote from peers f3a500981b494979b58d2b1041fec9c8 (127.5.126.65:34129), 0efc951052454eec9a58b0cd025945b8 (127.5.126.66:34613)
I20260709 13:22:58.501057 15108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e85432ede09747339c957cdaa7d15ac6" candidate_uuid: "a1a22e9119494570b6d2217713fd7e43" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a722e54d227f4c29a9ed6ce77858003a" is_pre_election: true
I20260709 13:22:58.502735 15154 tablet_bootstrap.cc:492] T 2a862e106a9e48a692bc72ea8c03ab39 P a722e54d227f4c29a9ed6ce77858003a: No bootstrap required, opened a new log
I20260709 13:22:58.503376 15154 ts_tablet_manager.cc:1403] T 2a862e106a9e48a692bc72ea8c03ab39 P a722e54d227f4c29a9ed6ce77858003a: Time spent bootstrapping tablet: real 0.066s	user 0.014s	sys 0.034s
I20260709 13:22:58.503674 15156 raft_consensus.cc:359] T 46ed2e9dd1324ac4a6e07f813cfebb7e P f3a500981b494979b58d2b1041fec9c8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } } peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } } peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } }
I20260709 13:22:58.504544 15156 raft_consensus.cc:385] T 46ed2e9dd1324ac4a6e07f813cfebb7e P f3a500981b494979b58d2b1041fec9c8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:58.504875 15156 raft_consensus.cc:740] T 46ed2e9dd1324ac4a6e07f813cfebb7e P f3a500981b494979b58d2b1041fec9c8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f3a500981b494979b58d2b1041fec9c8, State: Initialized, Role: FOLLOWER
I20260709 13:22:58.505724 15156 consensus_queue.cc:260] T 46ed2e9dd1324ac4a6e07f813cfebb7e P f3a500981b494979b58d2b1041fec9c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } } peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } } peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } }
I20260709 13:22:58.506994 15154 raft_consensus.cc:359] T 2a862e106a9e48a692bc72ea8c03ab39 P a722e54d227f4c29a9ed6ce77858003a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } } peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } } peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } }
I20260709 13:22:58.507812 15154 raft_consensus.cc:385] T 2a862e106a9e48a692bc72ea8c03ab39 P a722e54d227f4c29a9ed6ce77858003a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:58.507615 14959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db6d3d345bd3495e9ec9a0e75ecd0562" candidate_uuid: "a1a22e9119494570b6d2217713fd7e43" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0efc951052454eec9a58b0cd025945b8"
I20260709 13:22:58.508306 15154 raft_consensus.cc:740] T 2a862e106a9e48a692bc72ea8c03ab39 P a722e54d227f4c29a9ed6ce77858003a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a722e54d227f4c29a9ed6ce77858003a, State: Initialized, Role: FOLLOWER
I20260709 13:22:58.508646 14959 raft_consensus.cc:3060] T db6d3d345bd3495e9ec9a0e75ecd0562 P 0efc951052454eec9a58b0cd025945b8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:58.509213 15154 consensus_queue.cc:260] T 2a862e106a9e48a692bc72ea8c03ab39 P a722e54d227f4c29a9ed6ce77858003a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } } peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } } peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } }
I20260709 13:22:58.509744 15153 tablet_bootstrap.cc:492] T 7560205f5d324c7d821dff8efe7a6256 P 0efc951052454eec9a58b0cd025945b8: No bootstrap required, opened a new log
I20260709 13:22:58.510562 15153 ts_tablet_manager.cc:1403] T 7560205f5d324c7d821dff8efe7a6256 P 0efc951052454eec9a58b0cd025945b8: Time spent bootstrapping tablet: real 0.059s	user 0.010s	sys 0.004s
I20260709 13:22:58.512104 15155 tablet_bootstrap.cc:654] T 46ed2e9dd1324ac4a6e07f813cfebb7e P a1a22e9119494570b6d2217713fd7e43: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:58.513950 15153 raft_consensus.cc:359] T 7560205f5d324c7d821dff8efe7a6256 P 0efc951052454eec9a58b0cd025945b8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } } peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } } peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } }
I20260709 13:22:58.514654 15156 ts_tablet_manager.cc:1434] T 46ed2e9dd1324ac4a6e07f813cfebb7e P f3a500981b494979b58d2b1041fec9c8: Time spent starting tablet: real 0.033s	user 0.007s	sys 0.000s
I20260709 13:22:58.514782 15153 raft_consensus.cc:385] T 7560205f5d324c7d821dff8efe7a6256 P 0efc951052454eec9a58b0cd025945b8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:58.515125 15153 raft_consensus.cc:740] T 7560205f5d324c7d821dff8efe7a6256 P 0efc951052454eec9a58b0cd025945b8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0efc951052454eec9a58b0cd025945b8, State: Initialized, Role: FOLLOWER
I20260709 13:22:58.517483 15154 ts_tablet_manager.cc:1434] T 2a862e106a9e48a692bc72ea8c03ab39 P a722e54d227f4c29a9ed6ce77858003a: Time spent starting tablet: real 0.014s	user 0.008s	sys 0.000s
I20260709 13:22:58.515883 15156 tablet_bootstrap.cc:492] T db6d3d345bd3495e9ec9a0e75ecd0562 P f3a500981b494979b58d2b1041fec9c8: Bootstrap starting.
I20260709 13:22:58.519368 15154 tablet_bootstrap.cc:492] T e75f8237624f42f793627366f05b792a P a722e54d227f4c29a9ed6ce77858003a: Bootstrap starting.
I20260709 13:22:58.522373 15155 tablet_bootstrap.cc:492] T 46ed2e9dd1324ac4a6e07f813cfebb7e P a1a22e9119494570b6d2217713fd7e43: No bootstrap required, opened a new log
I20260709 13:22:58.525485 15155 ts_tablet_manager.cc:1403] T 46ed2e9dd1324ac4a6e07f813cfebb7e P a1a22e9119494570b6d2217713fd7e43: Time spent bootstrapping tablet: real 0.043s	user 0.016s	sys 0.001s
I20260709 13:22:58.527709 15154 tablet_bootstrap.cc:654] T e75f8237624f42f793627366f05b792a P a722e54d227f4c29a9ed6ce77858003a: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:58.515869 15153 consensus_queue.cc:260] T 7560205f5d324c7d821dff8efe7a6256 P 0efc951052454eec9a58b0cd025945b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } } peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } } peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } }
I20260709 13:22:58.528620 15155 raft_consensus.cc:359] T 46ed2e9dd1324ac4a6e07f813cfebb7e P a1a22e9119494570b6d2217713fd7e43 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } } peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } } peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } }
I20260709 13:22:58.529363 15155 raft_consensus.cc:385] T 46ed2e9dd1324ac4a6e07f813cfebb7e P a1a22e9119494570b6d2217713fd7e43 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:58.529644 15155 raft_consensus.cc:740] T 46ed2e9dd1324ac4a6e07f813cfebb7e P a1a22e9119494570b6d2217713fd7e43 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a1a22e9119494570b6d2217713fd7e43, State: Initialized, Role: FOLLOWER
I20260709 13:22:58.529937 15153 ts_tablet_manager.cc:1434] T 7560205f5d324c7d821dff8efe7a6256 P 0efc951052454eec9a58b0cd025945b8: Time spent starting tablet: real 0.019s	user 0.006s	sys 0.000s
I20260709 13:22:58.530400 15155 consensus_queue.cc:260] T 46ed2e9dd1324ac4a6e07f813cfebb7e P a1a22e9119494570b6d2217713fd7e43 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } } peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } } peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } }
I20260709 13:22:58.532716 15155 ts_tablet_manager.cc:1434] T 46ed2e9dd1324ac4a6e07f813cfebb7e P a1a22e9119494570b6d2217713fd7e43: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.001s
I20260709 13:22:58.533605 15155 tablet_bootstrap.cc:492] T 48be8cf045364be999b8f0fd547b7b9d P a1a22e9119494570b6d2217713fd7e43: Bootstrap starting.
I20260709 13:22:58.537024 15153 tablet_bootstrap.cc:492] T e75f8237624f42f793627366f05b792a P 0efc951052454eec9a58b0cd025945b8: Bootstrap starting.
I20260709 13:22:58.539273 15155 tablet_bootstrap.cc:654] T 48be8cf045364be999b8f0fd547b7b9d P a1a22e9119494570b6d2217713fd7e43: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:58.542217 14959 raft_consensus.cc:2468] T db6d3d345bd3495e9ec9a0e75ecd0562 P 0efc951052454eec9a58b0cd025945b8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1a22e9119494570b6d2217713fd7e43 in term 1.
I20260709 13:22:58.547421 14885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db6d3d345bd3495e9ec9a0e75ecd0562" candidate_uuid: "a1a22e9119494570b6d2217713fd7e43" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f3a500981b494979b58d2b1041fec9c8"
W20260709 13:22:58.543429 14999 leader_election.cc:343] T 5df7528567fd4291a888bfb37c28dc27 P a1a22e9119494570b6d2217713fd7e43 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer a722e54d227f4c29a9ed6ce77858003a (127.5.126.68:46669): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:58.544596 14884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e85432ede09747339c957cdaa7d15ac6" candidate_uuid: "a1a22e9119494570b6d2217713fd7e43" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f3a500981b494979b58d2b1041fec9c8" is_pre_election: true
I20260709 13:22:58.550249 15034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d65eaa0ab4574a1ea92b3848d4dc9c4d" candidate_uuid: "f3a500981b494979b58d2b1041fec9c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1a22e9119494570b6d2217713fd7e43" is_pre_election: true
W20260709 13:22:58.551030 14999 leader_election.cc:343] T e85432ede09747339c957cdaa7d15ac6 P a1a22e9119494570b6d2217713fd7e43 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a722e54d227f4c29a9ed6ce77858003a (127.5.126.68:46669): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:58.552475 14849 leader_election.cc:304] T d65eaa0ab4574a1ea92b3848d4dc9c4d P f3a500981b494979b58d2b1041fec9c8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f3a500981b494979b58d2b1041fec9c8; no voters: a1a22e9119494570b6d2217713fd7e43, a722e54d227f4c29a9ed6ce77858003a
I20260709 13:22:58.553576 15178 raft_consensus.cc:2749] T d65eaa0ab4574a1ea92b3848d4dc9c4d P f3a500981b494979b58d2b1041fec9c8 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:22:58.555500 14999 leader_election.cc:304] T 5df7528567fd4291a888bfb37c28dc27 P a1a22e9119494570b6d2217713fd7e43 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a1a22e9119494570b6d2217713fd7e43, f3a500981b494979b58d2b1041fec9c8; no voters: a722e54d227f4c29a9ed6ce77858003a
I20260709 13:22:58.556614 15160 raft_consensus.cc:2804] T 5df7528567fd4291a888bfb37c28dc27 P a1a22e9119494570b6d2217713fd7e43 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:22:58.557111 15160 raft_consensus.cc:697] T 5df7528567fd4291a888bfb37c28dc27 P a1a22e9119494570b6d2217713fd7e43 [term 1 LEADER]: Becoming Leader. State: Replica: a1a22e9119494570b6d2217713fd7e43, State: Running, Role: LEADER
W20260709 13:22:58.557063 14999 leader_election.cc:343] T db6d3d345bd3495e9ec9a0e75ecd0562 P a1a22e9119494570b6d2217713fd7e43 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f3a500981b494979b58d2b1041fec9c8 (127.5.126.65:34129): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:22:58.558089 14999 leader_election.cc:343] T e85432ede09747339c957cdaa7d15ac6 P a1a22e9119494570b6d2217713fd7e43 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f3a500981b494979b58d2b1041fec9c8 (127.5.126.65:34129): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:58.558215 15160 consensus_queue.cc:237] T 5df7528567fd4291a888bfb37c28dc27 P a1a22e9119494570b6d2217713fd7e43 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } } peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } } peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } }
I20260709 13:22:58.558593 14999 leader_election.cc:304] T e85432ede09747339c957cdaa7d15ac6 P a1a22e9119494570b6d2217713fd7e43 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1a22e9119494570b6d2217713fd7e43; no voters: a722e54d227f4c29a9ed6ce77858003a, f3a500981b494979b58d2b1041fec9c8
I20260709 13:22:58.559577 15235 raft_consensus.cc:2749] T e85432ede09747339c957cdaa7d15ac6 P a1a22e9119494570b6d2217713fd7e43 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:22:58.560806 14999 leader_election.cc:304] T db6d3d345bd3495e9ec9a0e75ecd0562 P a1a22e9119494570b6d2217713fd7e43 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0efc951052454eec9a58b0cd025945b8, a1a22e9119494570b6d2217713fd7e43; no voters: f3a500981b494979b58d2b1041fec9c8
I20260709 13:22:58.561618 15235 raft_consensus.cc:2804] T db6d3d345bd3495e9ec9a0e75ecd0562 P a1a22e9119494570b6d2217713fd7e43 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:22:58.562214 15235 raft_consensus.cc:697] T db6d3d345bd3495e9ec9a0e75ecd0562 P a1a22e9119494570b6d2217713fd7e43 [term 1 LEADER]: Becoming Leader. State: Replica: a1a22e9119494570b6d2217713fd7e43, State: Running, Role: LEADER
I20260709 13:22:58.563237 15235 consensus_queue.cc:237] T db6d3d345bd3495e9ec9a0e75ecd0562 P a1a22e9119494570b6d2217713fd7e43 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } } peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } } peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } }
I20260709 13:22:58.568272 15156 tablet_bootstrap.cc:654] T db6d3d345bd3495e9ec9a0e75ecd0562 P f3a500981b494979b58d2b1041fec9c8: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:58.571995 15155 tablet_bootstrap.cc:492] T 48be8cf045364be999b8f0fd547b7b9d P a1a22e9119494570b6d2217713fd7e43: No bootstrap required, opened a new log
I20260709 13:22:58.572566 15155 ts_tablet_manager.cc:1403] T 48be8cf045364be999b8f0fd547b7b9d P a1a22e9119494570b6d2217713fd7e43: Time spent bootstrapping tablet: real 0.039s	user 0.007s	sys 0.018s
I20260709 13:22:58.573591 15154 tablet_bootstrap.cc:492] T e75f8237624f42f793627366f05b792a P a722e54d227f4c29a9ed6ce77858003a: No bootstrap required, opened a new log
I20260709 13:22:58.573750 15153 tablet_bootstrap.cc:654] T e75f8237624f42f793627366f05b792a P 0efc951052454eec9a58b0cd025945b8: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:58.579905 15154 ts_tablet_manager.cc:1403] T e75f8237624f42f793627366f05b792a P a722e54d227f4c29a9ed6ce77858003a: Time spent bootstrapping tablet: real 0.061s	user 0.020s	sys 0.028s
I20260709 13:22:58.580704 15156 tablet_bootstrap.cc:492] T db6d3d345bd3495e9ec9a0e75ecd0562 P f3a500981b494979b58d2b1041fec9c8: No bootstrap required, opened a new log
I20260709 13:22:58.581293 15156 ts_tablet_manager.cc:1403] T db6d3d345bd3495e9ec9a0e75ecd0562 P f3a500981b494979b58d2b1041fec9c8: Time spent bootstrapping tablet: real 0.066s	user 0.017s	sys 0.003s
I20260709 13:22:58.575511 15155 raft_consensus.cc:359] T 48be8cf045364be999b8f0fd547b7b9d P a1a22e9119494570b6d2217713fd7e43 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } } peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } } peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } }
I20260709 13:22:58.582132 15155 raft_consensus.cc:385] T 48be8cf045364be999b8f0fd547b7b9d P a1a22e9119494570b6d2217713fd7e43 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:58.582521 15155 raft_consensus.cc:740] T 48be8cf045364be999b8f0fd547b7b9d P a1a22e9119494570b6d2217713fd7e43 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a1a22e9119494570b6d2217713fd7e43, State: Initialized, Role: FOLLOWER
I20260709 13:22:58.583508 15154 raft_consensus.cc:359] T e75f8237624f42f793627366f05b792a P a722e54d227f4c29a9ed6ce77858003a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } } peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } } peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } }
I20260709 13:22:58.583608 15155 consensus_queue.cc:260] T 48be8cf045364be999b8f0fd547b7b9d P a1a22e9119494570b6d2217713fd7e43 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } } peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } } peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } }
I20260709 13:22:58.587826 15153 tablet_bootstrap.cc:492] T e75f8237624f42f793627366f05b792a P 0efc951052454eec9a58b0cd025945b8: No bootstrap required, opened a new log
I20260709 13:22:58.588436 15153 ts_tablet_manager.cc:1403] T e75f8237624f42f793627366f05b792a P 0efc951052454eec9a58b0cd025945b8: Time spent bootstrapping tablet: real 0.052s	user 0.015s	sys 0.002s
I20260709 13:22:58.589144 15155 ts_tablet_manager.cc:1434] T 48be8cf045364be999b8f0fd547b7b9d P a1a22e9119494570b6d2217713fd7e43: Time spent starting tablet: real 0.016s	user 0.006s	sys 0.002s
I20260709 13:22:58.584724 15156 raft_consensus.cc:359] T db6d3d345bd3495e9ec9a0e75ecd0562 P f3a500981b494979b58d2b1041fec9c8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } } peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } } peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } }
I20260709 13:22:58.589617 15156 raft_consensus.cc:385] T db6d3d345bd3495e9ec9a0e75ecd0562 P f3a500981b494979b58d2b1041fec9c8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:58.589964 15156 raft_consensus.cc:740] T db6d3d345bd3495e9ec9a0e75ecd0562 P f3a500981b494979b58d2b1041fec9c8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f3a500981b494979b58d2b1041fec9c8, State: Initialized, Role: FOLLOWER
I20260709 13:22:58.590183 15155 tablet_bootstrap.cc:492] T 5cd72bf3a0114fddb1bda8271debea24 P a1a22e9119494570b6d2217713fd7e43: Bootstrap starting.
I20260709 13:22:58.590847 15156 consensus_queue.cc:260] T db6d3d345bd3495e9ec9a0e75ecd0562 P f3a500981b494979b58d2b1041fec9c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } } peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } } peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } }
I20260709 13:22:58.586594 15154 raft_consensus.cc:385] T e75f8237624f42f793627366f05b792a P a722e54d227f4c29a9ed6ce77858003a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:58.594311 15156 ts_tablet_manager.cc:1434] T db6d3d345bd3495e9ec9a0e75ecd0562 P f3a500981b494979b58d2b1041fec9c8: Time spent starting tablet: real 0.013s	user 0.007s	sys 0.000s
I20260709 13:22:58.592123 15154 raft_consensus.cc:740] T e75f8237624f42f793627366f05b792a P a722e54d227f4c29a9ed6ce77858003a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a722e54d227f4c29a9ed6ce77858003a, State: Initialized, Role: FOLLOWER
I20260709 13:22:58.595543 15154 consensus_queue.cc:260] T e75f8237624f42f793627366f05b792a P a722e54d227f4c29a9ed6ce77858003a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } } peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } } peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } }
I20260709 13:22:58.592157 15153 raft_consensus.cc:359] T e75f8237624f42f793627366f05b792a P 0efc951052454eec9a58b0cd025945b8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } } peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } } peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } }
I20260709 13:22:58.599057 15153 raft_consensus.cc:385] T e75f8237624f42f793627366f05b792a P 0efc951052454eec9a58b0cd025945b8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:58.598418 14782 catalog_manager.cc:5697] T 5df7528567fd4291a888bfb37c28dc27 P a1a22e9119494570b6d2217713fd7e43 reported cstate change: term changed from 0 to 1, leader changed from <none> to a1a22e9119494570b6d2217713fd7e43 (127.5.126.67). New cstate: current_term: 1 leader_uuid: "a1a22e9119494570b6d2217713fd7e43" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } health_report { overall_health: UNKNOWN } } }
I20260709 13:22:58.599627 15156 tablet_bootstrap.cc:492] T 70d027ba81f54eba882756b941186710 P f3a500981b494979b58d2b1041fec9c8: Bootstrap starting.
I20260709 13:22:58.599436 15153 raft_consensus.cc:740] T e75f8237624f42f793627366f05b792a P 0efc951052454eec9a58b0cd025945b8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0efc951052454eec9a58b0cd025945b8, State: Initialized, Role: FOLLOWER
I20260709 13:22:58.597404 15155 tablet_bootstrap.cc:654] T 5cd72bf3a0114fddb1bda8271debea24 P a1a22e9119494570b6d2217713fd7e43: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:58.600874 14782 catalog_manager.cc:5697] T db6d3d345bd3495e9ec9a0e75ecd0562 P a1a22e9119494570b6d2217713fd7e43 reported cstate change: term changed from 0 to 1, leader changed from <none> to a1a22e9119494570b6d2217713fd7e43 (127.5.126.67). New cstate: current_term: 1 leader_uuid: "a1a22e9119494570b6d2217713fd7e43" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } health_report { overall_health: HEALTHY } } }
I20260709 13:22:58.598348 15154 ts_tablet_manager.cc:1434] T e75f8237624f42f793627366f05b792a P a722e54d227f4c29a9ed6ce77858003a: Time spent starting tablet: real 0.018s	user 0.007s	sys 0.000s
I20260709 13:22:58.603579 15154 tablet_bootstrap.cc:492] T 5cd72bf3a0114fddb1bda8271debea24 P a722e54d227f4c29a9ed6ce77858003a: Bootstrap starting.
I20260709 13:22:58.603518 15153 consensus_queue.cc:260] T e75f8237624f42f793627366f05b792a P 0efc951052454eec9a58b0cd025945b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } } peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } } peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } }
I20260709 13:22:58.605626 15153 ts_tablet_manager.cc:1434] T e75f8237624f42f793627366f05b792a P 0efc951052454eec9a58b0cd025945b8: Time spent starting tablet: real 0.017s	user 0.002s	sys 0.003s
I20260709 13:22:58.606748 15153 tablet_bootstrap.cc:492] T 268027ae94a54cf4acf51c54c7b9032b P 0efc951052454eec9a58b0cd025945b8: Bootstrap starting.
I20260709 13:22:58.610052 15178 raft_consensus.cc:493] T 46ed2e9dd1324ac4a6e07f813cfebb7e P f3a500981b494979b58d2b1041fec9c8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:58.610626 15178 raft_consensus.cc:515] T 46ed2e9dd1324ac4a6e07f813cfebb7e P f3a500981b494979b58d2b1041fec9c8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } } peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } } peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } }
I20260709 13:22:58.611814 15156 tablet_bootstrap.cc:654] T 70d027ba81f54eba882756b941186710 P f3a500981b494979b58d2b1041fec9c8: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:58.612223 15154 tablet_bootstrap.cc:654] T 5cd72bf3a0114fddb1bda8271debea24 P a722e54d227f4c29a9ed6ce77858003a: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:58.614070 15153 tablet_bootstrap.cc:654] T 268027ae94a54cf4acf51c54c7b9032b P 0efc951052454eec9a58b0cd025945b8: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:58.614295 15178 leader_election.cc:290] T 46ed2e9dd1324ac4a6e07f813cfebb7e P f3a500981b494979b58d2b1041fec9c8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0efc951052454eec9a58b0cd025945b8 (127.5.126.66:34613), a1a22e9119494570b6d2217713fd7e43 (127.5.126.67:38125)
I20260709 13:22:58.616941 14959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46ed2e9dd1324ac4a6e07f813cfebb7e" candidate_uuid: "f3a500981b494979b58d2b1041fec9c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0efc951052454eec9a58b0cd025945b8" is_pre_election: true
I20260709 13:22:58.618557 15034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46ed2e9dd1324ac4a6e07f813cfebb7e" candidate_uuid: "f3a500981b494979b58d2b1041fec9c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1a22e9119494570b6d2217713fd7e43" is_pre_election: true
I20260709 13:22:58.619421 15034 raft_consensus.cc:2468] T 46ed2e9dd1324ac4a6e07f813cfebb7e P a1a22e9119494570b6d2217713fd7e43 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f3a500981b494979b58d2b1041fec9c8 in term 0.
I20260709 13:22:58.621207 14849 leader_election.cc:304] T 46ed2e9dd1324ac4a6e07f813cfebb7e P f3a500981b494979b58d2b1041fec9c8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1a22e9119494570b6d2217713fd7e43, f3a500981b494979b58d2b1041fec9c8; no voters: 
W20260709 13:22:58.622956 14850 leader_election.cc:343] T 46ed2e9dd1324ac4a6e07f813cfebb7e P f3a500981b494979b58d2b1041fec9c8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0efc951052454eec9a58b0cd025945b8 (127.5.126.66:34613): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:58.624270 15178 raft_consensus.cc:2804] T 46ed2e9dd1324ac4a6e07f813cfebb7e P f3a500981b494979b58d2b1041fec9c8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:22:58.624814 15178 raft_consensus.cc:493] T 46ed2e9dd1324ac4a6e07f813cfebb7e P f3a500981b494979b58d2b1041fec9c8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:22:58.625229 15178 raft_consensus.cc:3060] T 46ed2e9dd1324ac4a6e07f813cfebb7e P f3a500981b494979b58d2b1041fec9c8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:58.637811 15235 raft_consensus.cc:493] T 48be8cf045364be999b8f0fd547b7b9d P a1a22e9119494570b6d2217713fd7e43 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:58.638531 15235 raft_consensus.cc:515] T 48be8cf045364be999b8f0fd547b7b9d P a1a22e9119494570b6d2217713fd7e43 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } } peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } } peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } }
I20260709 13:22:58.642962 15235 leader_election.cc:290] T 48be8cf045364be999b8f0fd547b7b9d P a1a22e9119494570b6d2217713fd7e43 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0efc951052454eec9a58b0cd025945b8 (127.5.126.66:34613), f3a500981b494979b58d2b1041fec9c8 (127.5.126.65:34129)
I20260709 13:22:58.644968 14959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48be8cf045364be999b8f0fd547b7b9d" candidate_uuid: "a1a22e9119494570b6d2217713fd7e43" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0efc951052454eec9a58b0cd025945b8" is_pre_election: true
I20260709 13:22:58.648891 14884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48be8cf045364be999b8f0fd547b7b9d" candidate_uuid: "a1a22e9119494570b6d2217713fd7e43" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f3a500981b494979b58d2b1041fec9c8" is_pre_election: true
I20260709 13:22:58.650955 14999 leader_election.cc:304] T 48be8cf045364be999b8f0fd547b7b9d P a1a22e9119494570b6d2217713fd7e43 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1a22e9119494570b6d2217713fd7e43; no voters: 0efc951052454eec9a58b0cd025945b8, f3a500981b494979b58d2b1041fec9c8
I20260709 13:22:58.653442 15160 raft_consensus.cc:2749] T 48be8cf045364be999b8f0fd547b7b9d P a1a22e9119494570b6d2217713fd7e43 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:22:58.659706 15220 consensus_queue.cc:1048] T 914c9c0c3be1486f8dcce382b61b5450 P 0efc951052454eec9a58b0cd025945b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:22:58.670639 14884 raft_consensus.cc:3060] T d65eaa0ab4574a1ea92b3848d4dc9c4d P f3a500981b494979b58d2b1041fec9c8 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:22:58.677059 14925 consensus_peers.cc:597] T 914c9c0c3be1486f8dcce382b61b5450 P 0efc951052454eec9a58b0cd025945b8 -> Peer f3a500981b494979b58d2b1041fec9c8 (127.5.126.65:34129): Couldn't send request to peer f3a500981b494979b58d2b1041fec9c8. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:22:58.666622 15178 raft_consensus.cc:515] T 46ed2e9dd1324ac4a6e07f813cfebb7e P f3a500981b494979b58d2b1041fec9c8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } } peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } } peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } }
I20260709 13:22:58.682962 15155 tablet_bootstrap.cc:492] T 5cd72bf3a0114fddb1bda8271debea24 P a1a22e9119494570b6d2217713fd7e43: No bootstrap required, opened a new log
I20260709 13:22:58.688380 15155 ts_tablet_manager.cc:1403] T 5cd72bf3a0114fddb1bda8271debea24 P a1a22e9119494570b6d2217713fd7e43: Time spent bootstrapping tablet: real 0.098s	user 0.027s	sys 0.020s
I20260709 13:22:58.690448 15178 leader_election.cc:290] T 46ed2e9dd1324ac4a6e07f813cfebb7e P f3a500981b494979b58d2b1041fec9c8 [CANDIDATE]: Term 1 election: Requested vote from peers 0efc951052454eec9a58b0cd025945b8 (127.5.126.66:34613), a1a22e9119494570b6d2217713fd7e43 (127.5.126.67:38125)
I20260709 13:22:58.691406 15155 raft_consensus.cc:359] T 5cd72bf3a0114fddb1bda8271debea24 P a1a22e9119494570b6d2217713fd7e43 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } } peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } } peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } }
I20260709 13:22:58.692222 15155 raft_consensus.cc:385] T 5cd72bf3a0114fddb1bda8271debea24 P a1a22e9119494570b6d2217713fd7e43 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:58.692272 15034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46ed2e9dd1324ac4a6e07f813cfebb7e" candidate_uuid: "f3a500981b494979b58d2b1041fec9c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1a22e9119494570b6d2217713fd7e43"
I20260709 13:22:58.692591 15155 raft_consensus.cc:740] T 5cd72bf3a0114fddb1bda8271debea24 P a1a22e9119494570b6d2217713fd7e43 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a1a22e9119494570b6d2217713fd7e43, State: Initialized, Role: FOLLOWER
I20260709 13:22:58.692932 15034 raft_consensus.cc:3060] T 46ed2e9dd1324ac4a6e07f813cfebb7e P a1a22e9119494570b6d2217713fd7e43 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:58.693310 15155 consensus_queue.cc:260] T 5cd72bf3a0114fddb1bda8271debea24 P a1a22e9119494570b6d2217713fd7e43 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } } peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } } peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } }
I20260709 13:22:58.695787 15155 ts_tablet_manager.cc:1434] T 5cd72bf3a0114fddb1bda8271debea24 P a1a22e9119494570b6d2217713fd7e43: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.001s
I20260709 13:22:58.691475 14959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46ed2e9dd1324ac4a6e07f813cfebb7e" candidate_uuid: "f3a500981b494979b58d2b1041fec9c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0efc951052454eec9a58b0cd025945b8"
I20260709 13:22:58.696712 15155 tablet_bootstrap.cc:492] T b025139466084200b70879196cd3f922 P a1a22e9119494570b6d2217713fd7e43: Bootstrap starting.
W20260709 13:22:58.698094 14850 leader_election.cc:343] T 46ed2e9dd1324ac4a6e07f813cfebb7e P f3a500981b494979b58d2b1041fec9c8 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 0efc951052454eec9a58b0cd025945b8 (127.5.126.66:34613): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:58.703845 15178 consensus_queue.cc:1048] T a71163721b4d48b0b5ff366b9d12ac32 P f3a500981b494979b58d2b1041fec9c8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:22:58.703861 15155 tablet_bootstrap.cc:654] T b025139466084200b70879196cd3f922 P a1a22e9119494570b6d2217713fd7e43: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:58.723807 15220 raft_consensus.cc:493] T 7560205f5d324c7d821dff8efe7a6256 P 0efc951052454eec9a58b0cd025945b8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:58.724498 15220 raft_consensus.cc:515] T 7560205f5d324c7d821dff8efe7a6256 P 0efc951052454eec9a58b0cd025945b8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } } peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } } peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } }
I20260709 13:22:58.727257 15220 leader_election.cc:290] T 7560205f5d324c7d821dff8efe7a6256 P 0efc951052454eec9a58b0cd025945b8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f3a500981b494979b58d2b1041fec9c8 (127.5.126.65:34129), a1a22e9119494570b6d2217713fd7e43 (127.5.126.67:38125)
I20260709 13:22:58.728669 15033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7560205f5d324c7d821dff8efe7a6256" candidate_uuid: "0efc951052454eec9a58b0cd025945b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1a22e9119494570b6d2217713fd7e43" is_pre_election: true
I20260709 13:22:58.728931 14885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7560205f5d324c7d821dff8efe7a6256" candidate_uuid: "0efc951052454eec9a58b0cd025945b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f3a500981b494979b58d2b1041fec9c8" is_pre_election: true
I20260709 13:22:58.729452 15033 raft_consensus.cc:2468] T 7560205f5d324c7d821dff8efe7a6256 P a1a22e9119494570b6d2217713fd7e43 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0efc951052454eec9a58b0cd025945b8 in term 0.
I20260709 13:22:58.731184 14924 leader_election.cc:304] T 7560205f5d324c7d821dff8efe7a6256 P 0efc951052454eec9a58b0cd025945b8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0efc951052454eec9a58b0cd025945b8, a1a22e9119494570b6d2217713fd7e43; no voters: 
I20260709 13:22:58.732009 15154 tablet_bootstrap.cc:492] T 5cd72bf3a0114fddb1bda8271debea24 P a722e54d227f4c29a9ed6ce77858003a: No bootstrap required, opened a new log
I20260709 13:22:58.732223 15220 raft_consensus.cc:2804] T 7560205f5d324c7d821dff8efe7a6256 P 0efc951052454eec9a58b0cd025945b8 [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260709 13:22:58.732427 14925 leader_election.cc:343] T 7560205f5d324c7d821dff8efe7a6256 P 0efc951052454eec9a58b0cd025945b8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f3a500981b494979b58d2b1041fec9c8 (127.5.126.65:34129): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:58.732617 15154 ts_tablet_manager.cc:1403] T 5cd72bf3a0114fddb1bda8271debea24 P a722e54d227f4c29a9ed6ce77858003a: Time spent bootstrapping tablet: real 0.129s	user 0.025s	sys 0.027s
I20260709 13:22:58.738641 15154 raft_consensus.cc:359] T 5cd72bf3a0114fddb1bda8271debea24 P a722e54d227f4c29a9ed6ce77858003a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } } peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } } peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } }
I20260709 13:22:58.739511 15154 raft_consensus.cc:385] T 5cd72bf3a0114fddb1bda8271debea24 P a722e54d227f4c29a9ed6ce77858003a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:58.732630 15220 raft_consensus.cc:493] T 7560205f5d324c7d821dff8efe7a6256 P 0efc951052454eec9a58b0cd025945b8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:22:58.744451 15220 raft_consensus.cc:3060] T 7560205f5d324c7d821dff8efe7a6256 P 0efc951052454eec9a58b0cd025945b8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:58.739840 15154 raft_consensus.cc:740] T 5cd72bf3a0114fddb1bda8271debea24 P a722e54d227f4c29a9ed6ce77858003a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a722e54d227f4c29a9ed6ce77858003a, State: Initialized, Role: FOLLOWER
I20260709 13:22:58.751008 15161 raft_consensus.cc:493] T 2a862e106a9e48a692bc72ea8c03ab39 P a722e54d227f4c29a9ed6ce77858003a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:58.752058 15154 consensus_queue.cc:260] T 5cd72bf3a0114fddb1bda8271debea24 P a722e54d227f4c29a9ed6ce77858003a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } } peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } } peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } }
I20260709 13:22:58.751907 15161 raft_consensus.cc:515] T 2a862e106a9e48a692bc72ea8c03ab39 P a722e54d227f4c29a9ed6ce77858003a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } } peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } } peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } }
I20260709 13:22:58.759542 15154 ts_tablet_manager.cc:1434] T 5cd72bf3a0114fddb1bda8271debea24 P a722e54d227f4c29a9ed6ce77858003a: Time spent starting tablet: real 0.024s	user 0.008s	sys 0.000s
I20260709 13:22:58.764215 14885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a862e106a9e48a692bc72ea8c03ab39" candidate_uuid: "a722e54d227f4c29a9ed6ce77858003a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f3a500981b494979b58d2b1041fec9c8" is_pre_election: true
I20260709 13:22:58.765496 15154 tablet_bootstrap.cc:492] T a71163721b4d48b0b5ff366b9d12ac32 P a722e54d227f4c29a9ed6ce77858003a: Bootstrap starting.
I20260709 13:22:58.761476 15161 leader_election.cc:290] T 2a862e106a9e48a692bc72ea8c03ab39 P a722e54d227f4c29a9ed6ce77858003a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f3a500981b494979b58d2b1041fec9c8 (127.5.126.65:34129), 0efc951052454eec9a58b0cd025945b8 (127.5.126.66:34613)
I20260709 13:22:58.777479 15034 raft_consensus.cc:2468] T 46ed2e9dd1324ac4a6e07f813cfebb7e P a1a22e9119494570b6d2217713fd7e43 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f3a500981b494979b58d2b1041fec9c8 in term 1.
I20260709 13:22:58.790810 14849 leader_election.cc:304] T 46ed2e9dd1324ac4a6e07f813cfebb7e P f3a500981b494979b58d2b1041fec9c8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a1a22e9119494570b6d2217713fd7e43, f3a500981b494979b58d2b1041fec9c8; no voters: 0efc951052454eec9a58b0cd025945b8
I20260709 13:22:58.791898 15178 raft_consensus.cc:2804] T 46ed2e9dd1324ac4a6e07f813cfebb7e P f3a500981b494979b58d2b1041fec9c8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:22:58.792469 15178 raft_consensus.cc:697] T 46ed2e9dd1324ac4a6e07f813cfebb7e P f3a500981b494979b58d2b1041fec9c8 [term 1 LEADER]: Becoming Leader. State: Replica: f3a500981b494979b58d2b1041fec9c8, State: Running, Role: LEADER
I20260709 13:22:58.793392 15178 consensus_queue.cc:237] T 46ed2e9dd1324ac4a6e07f813cfebb7e P f3a500981b494979b58d2b1041fec9c8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } } peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } } peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } }
I20260709 13:22:58.794028 15156 tablet_bootstrap.cc:492] T 70d027ba81f54eba882756b941186710 P f3a500981b494979b58d2b1041fec9c8: No bootstrap required, opened a new log
I20260709 13:22:58.794549 15156 ts_tablet_manager.cc:1403] T 70d027ba81f54eba882756b941186710 P f3a500981b494979b58d2b1041fec9c8: Time spent bootstrapping tablet: real 0.195s	user 0.074s	sys 0.102s
I20260709 13:22:58.792469 15235 raft_consensus.cc:493] T 5cd72bf3a0114fddb1bda8271debea24 P a1a22e9119494570b6d2217713fd7e43 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:58.796756 15235 raft_consensus.cc:515] T 5cd72bf3a0114fddb1bda8271debea24 P a1a22e9119494570b6d2217713fd7e43 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } } peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } } peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } }
I20260709 13:22:58.797559 15156 raft_consensus.cc:359] T 70d027ba81f54eba882756b941186710 P f3a500981b494979b58d2b1041fec9c8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } } peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } } peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } }
I20260709 13:22:58.798218 15156 raft_consensus.cc:385] T 70d027ba81f54eba882756b941186710 P f3a500981b494979b58d2b1041fec9c8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:58.798477 15156 raft_consensus.cc:740] T 70d027ba81f54eba882756b941186710 P f3a500981b494979b58d2b1041fec9c8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f3a500981b494979b58d2b1041fec9c8, State: Initialized, Role: FOLLOWER
I20260709 13:22:58.798786 15235 leader_election.cc:290] T 5cd72bf3a0114fddb1bda8271debea24 P a1a22e9119494570b6d2217713fd7e43 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0efc951052454eec9a58b0cd025945b8 (127.5.126.66:34613), a722e54d227f4c29a9ed6ce77858003a (127.5.126.68:46669)
I20260709 13:22:58.799183 15156 consensus_queue.cc:260] T 70d027ba81f54eba882756b941186710 P f3a500981b494979b58d2b1041fec9c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } } peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } } peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } }
I20260709 13:22:58.800956 14960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cd72bf3a0114fddb1bda8271debea24" candidate_uuid: "a1a22e9119494570b6d2217713fd7e43" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0efc951052454eec9a58b0cd025945b8" is_pre_election: true
I20260709 13:22:58.802043 15154 tablet_bootstrap.cc:654] T a71163721b4d48b0b5ff366b9d12ac32 P a722e54d227f4c29a9ed6ce77858003a: Neither blocks nor log segments found. Creating new log.
W20260709 13:22:58.802735 14999 leader_election.cc:343] T 5cd72bf3a0114fddb1bda8271debea24 P a1a22e9119494570b6d2217713fd7e43 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0efc951052454eec9a58b0cd025945b8 (127.5.126.66:34613): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:58.803908 15107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cd72bf3a0114fddb1bda8271debea24" candidate_uuid: "a1a22e9119494570b6d2217713fd7e43" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a722e54d227f4c29a9ed6ce77858003a" is_pre_election: true
I20260709 13:22:58.804829 15107 raft_consensus.cc:2468] T 5cd72bf3a0114fddb1bda8271debea24 P a722e54d227f4c29a9ed6ce77858003a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1a22e9119494570b6d2217713fd7e43 in term 0.
W20260709 13:22:58.805828 15073 leader_election.cc:343] T 2a862e106a9e48a692bc72ea8c03ab39 P a722e54d227f4c29a9ed6ce77858003a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f3a500981b494979b58d2b1041fec9c8 (127.5.126.65:34129): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:58.806856 14999 leader_election.cc:304] T 5cd72bf3a0114fddb1bda8271debea24 P a1a22e9119494570b6d2217713fd7e43 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a1a22e9119494570b6d2217713fd7e43, a722e54d227f4c29a9ed6ce77858003a; no voters: 0efc951052454eec9a58b0cd025945b8
I20260709 13:22:58.807624 15156 ts_tablet_manager.cc:1434] T 70d027ba81f54eba882756b941186710 P f3a500981b494979b58d2b1041fec9c8: Time spent starting tablet: real 0.013s	user 0.007s	sys 0.000s
I20260709 13:22:58.808290 15235 raft_consensus.cc:2804] T 5cd72bf3a0114fddb1bda8271debea24 P a1a22e9119494570b6d2217713fd7e43 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:22:58.808768 15235 raft_consensus.cc:493] T 5cd72bf3a0114fddb1bda8271debea24 P a1a22e9119494570b6d2217713fd7e43 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:22:58.809134 15235 raft_consensus.cc:3060] T 5cd72bf3a0114fddb1bda8271debea24 P a1a22e9119494570b6d2217713fd7e43 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:58.809046 15156 tablet_bootstrap.cc:492] T 914c9c0c3be1486f8dcce382b61b5450 P f3a500981b494979b58d2b1041fec9c8: Bootstrap starting.
I20260709 13:22:58.826329 15153 tablet_bootstrap.cc:492] T 268027ae94a54cf4acf51c54c7b9032b P 0efc951052454eec9a58b0cd025945b8: No bootstrap required, opened a new log
I20260709 13:22:58.826920 15153 ts_tablet_manager.cc:1403] T 268027ae94a54cf4acf51c54c7b9032b P 0efc951052454eec9a58b0cd025945b8: Time spent bootstrapping tablet: real 0.220s	user 0.034s	sys 0.054s
I20260709 13:22:58.823469 15220 raft_consensus.cc:515] T 7560205f5d324c7d821dff8efe7a6256 P 0efc951052454eec9a58b0cd025945b8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } } peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } } peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } }
I20260709 13:22:58.837961 15156 tablet_bootstrap.cc:654] T 914c9c0c3be1486f8dcce382b61b5450 P f3a500981b494979b58d2b1041fec9c8: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:58.839366 14885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7560205f5d324c7d821dff8efe7a6256" candidate_uuid: "0efc951052454eec9a58b0cd025945b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f3a500981b494979b58d2b1041fec9c8"
W20260709 13:22:58.841146 14925 leader_election.cc:343] T 7560205f5d324c7d821dff8efe7a6256 P 0efc951052454eec9a58b0cd025945b8 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f3a500981b494979b58d2b1041fec9c8 (127.5.126.65:34129): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:58.841873 15155 tablet_bootstrap.cc:492] T b025139466084200b70879196cd3f922 P a1a22e9119494570b6d2217713fd7e43: No bootstrap required, opened a new log
I20260709 13:22:58.842437 15220 leader_election.cc:290] T 7560205f5d324c7d821dff8efe7a6256 P 0efc951052454eec9a58b0cd025945b8 [CANDIDATE]: Term 1 election: Requested vote from peers f3a500981b494979b58d2b1041fec9c8 (127.5.126.65:34129), a1a22e9119494570b6d2217713fd7e43 (127.5.126.67:38125)
I20260709 13:22:58.843992 15034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7560205f5d324c7d821dff8efe7a6256" candidate_uuid: "0efc951052454eec9a58b0cd025945b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1a22e9119494570b6d2217713fd7e43"
I20260709 13:22:58.844875 15034 raft_consensus.cc:3060] T 7560205f5d324c7d821dff8efe7a6256 P a1a22e9119494570b6d2217713fd7e43 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:58.847342 14959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a862e106a9e48a692bc72ea8c03ab39" candidate_uuid: "a722e54d227f4c29a9ed6ce77858003a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0efc951052454eec9a58b0cd025945b8" is_pre_election: true
W20260709 13:22:58.851660 14850 consensus_peers.cc:597] T a71163721b4d48b0b5ff366b9d12ac32 P f3a500981b494979b58d2b1041fec9c8 -> Peer a722e54d227f4c29a9ed6ce77858003a (127.5.126.68:46669): Couldn't send request to peer a722e54d227f4c29a9ed6ce77858003a. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:22:58.852330 15073 leader_election.cc:343] T 2a862e106a9e48a692bc72ea8c03ab39 P a722e54d227f4c29a9ed6ce77858003a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0efc951052454eec9a58b0cd025945b8 (127.5.126.66:34613): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:58.852949 15073 leader_election.cc:304] T 2a862e106a9e48a692bc72ea8c03ab39 P a722e54d227f4c29a9ed6ce77858003a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a722e54d227f4c29a9ed6ce77858003a; no voters: 0efc951052454eec9a58b0cd025945b8, f3a500981b494979b58d2b1041fec9c8
I20260709 13:22:58.853919 15161 raft_consensus.cc:2749] T 2a862e106a9e48a692bc72ea8c03ab39 P a722e54d227f4c29a9ed6ce77858003a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:22:58.855034 15034 raft_consensus.cc:2468] T 7560205f5d324c7d821dff8efe7a6256 P a1a22e9119494570b6d2217713fd7e43 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0efc951052454eec9a58b0cd025945b8 in term 1.
I20260709 13:22:58.856740 14924 leader_election.cc:304] T 7560205f5d324c7d821dff8efe7a6256 P 0efc951052454eec9a58b0cd025945b8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0efc951052454eec9a58b0cd025945b8, a1a22e9119494570b6d2217713fd7e43; no voters: f3a500981b494979b58d2b1041fec9c8
I20260709 13:22:58.857128 15235 raft_consensus.cc:515] T 5cd72bf3a0114fddb1bda8271debea24 P a1a22e9119494570b6d2217713fd7e43 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } } peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } } peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } }
I20260709 13:22:58.857977 15154 tablet_bootstrap.cc:492] T a71163721b4d48b0b5ff366b9d12ac32 P a722e54d227f4c29a9ed6ce77858003a: No bootstrap required, opened a new log
I20260709 13:22:58.857929 15220 raft_consensus.cc:2804] T 7560205f5d324c7d821dff8efe7a6256 P 0efc951052454eec9a58b0cd025945b8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:22:58.858822 15220 raft_consensus.cc:697] T 7560205f5d324c7d821dff8efe7a6256 P 0efc951052454eec9a58b0cd025945b8 [term 1 LEADER]: Becoming Leader. State: Replica: 0efc951052454eec9a58b0cd025945b8, State: Running, Role: LEADER
I20260709 13:22:58.859726 15220 consensus_queue.cc:237] T 7560205f5d324c7d821dff8efe7a6256 P 0efc951052454eec9a58b0cd025945b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } } peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } } peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } }
I20260709 13:22:58.860975 15155 ts_tablet_manager.cc:1403] T b025139466084200b70879196cd3f922 P a1a22e9119494570b6d2217713fd7e43: Time spent bootstrapping tablet: real 0.164s	user 0.016s	sys 0.029s
I20260709 13:22:58.863951 14959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cd72bf3a0114fddb1bda8271debea24" candidate_uuid: "a1a22e9119494570b6d2217713fd7e43" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0efc951052454eec9a58b0cd025945b8"
W20260709 13:22:58.868185 14999 leader_election.cc:343] T 5cd72bf3a0114fddb1bda8271debea24 P a1a22e9119494570b6d2217713fd7e43 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 0efc951052454eec9a58b0cd025945b8 (127.5.126.66:34613): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:58.869800 15155 raft_consensus.cc:359] T b025139466084200b70879196cd3f922 P a1a22e9119494570b6d2217713fd7e43 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } } peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } } peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } }
I20260709 13:22:58.870544 15155 raft_consensus.cc:385] T b025139466084200b70879196cd3f922 P a1a22e9119494570b6d2217713fd7e43 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:58.870793 15155 raft_consensus.cc:740] T b025139466084200b70879196cd3f922 P a1a22e9119494570b6d2217713fd7e43 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a1a22e9119494570b6d2217713fd7e43, State: Initialized, Role: FOLLOWER
I20260709 13:22:58.871819 15153 raft_consensus.cc:359] T 268027ae94a54cf4acf51c54c7b9032b P 0efc951052454eec9a58b0cd025945b8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } } peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } } peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } }
I20260709 13:22:58.872514 15153 raft_consensus.cc:385] T 268027ae94a54cf4acf51c54c7b9032b P 0efc951052454eec9a58b0cd025945b8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:58.872757 15153 raft_consensus.cc:740] T 268027ae94a54cf4acf51c54c7b9032b P 0efc951052454eec9a58b0cd025945b8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0efc951052454eec9a58b0cd025945b8, State: Initialized, Role: FOLLOWER
I20260709 13:22:58.872948 15108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cd72bf3a0114fddb1bda8271debea24" candidate_uuid: "a1a22e9119494570b6d2217713fd7e43" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a722e54d227f4c29a9ed6ce77858003a"
I20260709 13:22:58.873641 15108 raft_consensus.cc:3060] T 5cd72bf3a0114fddb1bda8271debea24 P a722e54d227f4c29a9ed6ce77858003a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:58.874392 15154 ts_tablet_manager.cc:1403] T a71163721b4d48b0b5ff366b9d12ac32 P a722e54d227f4c29a9ed6ce77858003a: Time spent bootstrapping tablet: real 0.109s	user 0.011s	sys 0.012s
I20260709 13:22:58.876087 15155 consensus_queue.cc:260] T b025139466084200b70879196cd3f922 P a1a22e9119494570b6d2217713fd7e43 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } } peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } } peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } }
I20260709 13:22:58.878264 15155 ts_tablet_manager.cc:1434] T b025139466084200b70879196cd3f922 P a1a22e9119494570b6d2217713fd7e43: Time spent starting tablet: real 0.017s	user 0.005s	sys 0.001s
I20260709 13:22:58.878556 15156 tablet_bootstrap.cc:492] T 914c9c0c3be1486f8dcce382b61b5450 P f3a500981b494979b58d2b1041fec9c8: No bootstrap required, opened a new log
I20260709 13:22:58.879019 15156 ts_tablet_manager.cc:1403] T 914c9c0c3be1486f8dcce382b61b5450 P f3a500981b494979b58d2b1041fec9c8: Time spent bootstrapping tablet: real 0.070s	user 0.012s	sys 0.001s
I20260709 13:22:58.879479 15154 raft_consensus.cc:359] T a71163721b4d48b0b5ff366b9d12ac32 P a722e54d227f4c29a9ed6ce77858003a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } } peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } } peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } }
I20260709 13:22:58.880326 15154 raft_consensus.cc:385] T a71163721b4d48b0b5ff366b9d12ac32 P a722e54d227f4c29a9ed6ce77858003a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:58.880656 15154 raft_consensus.cc:740] T a71163721b4d48b0b5ff366b9d12ac32 P a722e54d227f4c29a9ed6ce77858003a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a722e54d227f4c29a9ed6ce77858003a, State: Initialized, Role: FOLLOWER
I20260709 13:22:58.881559 15154 consensus_queue.cc:260] T a71163721b4d48b0b5ff366b9d12ac32 P a722e54d227f4c29a9ed6ce77858003a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } } peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } } peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } }
I20260709 13:22:58.881831 15156 raft_consensus.cc:359] T 914c9c0c3be1486f8dcce382b61b5450 P f3a500981b494979b58d2b1041fec9c8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } } peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } } peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } }
I20260709 13:22:58.882628 15156 raft_consensus.cc:385] T 914c9c0c3be1486f8dcce382b61b5450 P f3a500981b494979b58d2b1041fec9c8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:58.882917 15156 raft_consensus.cc:740] T 914c9c0c3be1486f8dcce382b61b5450 P f3a500981b494979b58d2b1041fec9c8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f3a500981b494979b58d2b1041fec9c8, State: Initialized, Role: FOLLOWER
I20260709 13:22:58.873494 15153 consensus_queue.cc:260] T 268027ae94a54cf4acf51c54c7b9032b P 0efc951052454eec9a58b0cd025945b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } } peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } } peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } }
I20260709 13:22:58.885699 15153 ts_tablet_manager.cc:1434] T 268027ae94a54cf4acf51c54c7b9032b P 0efc951052454eec9a58b0cd025945b8: Time spent starting tablet: real 0.058s	user 0.008s	sys 0.000s
I20260709 13:22:58.886281 15235 leader_election.cc:290] T 5cd72bf3a0114fddb1bda8271debea24 P a1a22e9119494570b6d2217713fd7e43 [CANDIDATE]: Term 1 election: Requested vote from peers 0efc951052454eec9a58b0cd025945b8 (127.5.126.66:34613), a722e54d227f4c29a9ed6ce77858003a (127.5.126.68:46669)
I20260709 13:22:58.885216 14781 catalog_manager.cc:5697] T 46ed2e9dd1324ac4a6e07f813cfebb7e P f3a500981b494979b58d2b1041fec9c8 reported cstate change: term changed from 0 to 1, leader changed from <none> to f3a500981b494979b58d2b1041fec9c8 (127.5.126.65). New cstate: current_term: 1 leader_uuid: "f3a500981b494979b58d2b1041fec9c8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } health_report { overall_health: UNKNOWN } } }
I20260709 13:22:58.885586 15154 ts_tablet_manager.cc:1434] T a71163721b4d48b0b5ff366b9d12ac32 P a722e54d227f4c29a9ed6ce77858003a: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.000s
I20260709 13:22:58.883641 15156 consensus_queue.cc:260] T 914c9c0c3be1486f8dcce382b61b5450 P f3a500981b494979b58d2b1041fec9c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } } peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } } peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } }
I20260709 13:22:58.887969 15155 tablet_bootstrap.cc:492] T 70d027ba81f54eba882756b941186710 P a1a22e9119494570b6d2217713fd7e43: Bootstrap starting.
I20260709 13:22:58.883877 15108 raft_consensus.cc:2468] T 5cd72bf3a0114fddb1bda8271debea24 P a722e54d227f4c29a9ed6ce77858003a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1a22e9119494570b6d2217713fd7e43 in term 1.
I20260709 13:22:58.890674 15156 ts_tablet_manager.cc:1434] T 914c9c0c3be1486f8dcce382b61b5450 P f3a500981b494979b58d2b1041fec9c8: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.000s
I20260709 13:22:58.891283 14999 leader_election.cc:304] T 5cd72bf3a0114fddb1bda8271debea24 P a1a22e9119494570b6d2217713fd7e43 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a1a22e9119494570b6d2217713fd7e43, a722e54d227f4c29a9ed6ce77858003a; no voters: 0efc951052454eec9a58b0cd025945b8
I20260709 13:22:58.891626 15156 tablet_bootstrap.cc:492] T e85432ede09747339c957cdaa7d15ac6 P f3a500981b494979b58d2b1041fec9c8: Bootstrap starting.
I20260709 13:22:58.886766 15153 tablet_bootstrap.cc:492] T 5cd72bf3a0114fddb1bda8271debea24 P 0efc951052454eec9a58b0cd025945b8: Bootstrap starting.
I20260709 13:22:58.892802 15235 raft_consensus.cc:2804] T 5cd72bf3a0114fddb1bda8271debea24 P a1a22e9119494570b6d2217713fd7e43 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:22:58.898067 15156 tablet_bootstrap.cc:654] T e85432ede09747339c957cdaa7d15ac6 P f3a500981b494979b58d2b1041fec9c8: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:58.900542 15153 tablet_bootstrap.cc:654] T 5cd72bf3a0114fddb1bda8271debea24 P 0efc951052454eec9a58b0cd025945b8: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:58.893543 15235 raft_consensus.cc:697] T 5cd72bf3a0114fddb1bda8271debea24 P a1a22e9119494570b6d2217713fd7e43 [term 1 LEADER]: Becoming Leader. State: Replica: a1a22e9119494570b6d2217713fd7e43, State: Running, Role: LEADER
I20260709 13:22:58.903043 15235 consensus_queue.cc:237] T 5cd72bf3a0114fddb1bda8271debea24 P a1a22e9119494570b6d2217713fd7e43 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } } peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } } peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } }
I20260709 13:22:58.911935 15155 tablet_bootstrap.cc:654] T 70d027ba81f54eba882756b941186710 P a1a22e9119494570b6d2217713fd7e43: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:58.912423 15160 raft_consensus.cc:493] T b025139466084200b70879196cd3f922 P a1a22e9119494570b6d2217713fd7e43 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:58.913280 15160 raft_consensus.cc:515] T b025139466084200b70879196cd3f922 P a1a22e9119494570b6d2217713fd7e43 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } } peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } } peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } }
I20260709 13:22:58.917470 14884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b025139466084200b70879196cd3f922" candidate_uuid: "a1a22e9119494570b6d2217713fd7e43" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f3a500981b494979b58d2b1041fec9c8" is_pre_election: true
I20260709 13:22:58.918710 15154 tablet_bootstrap.cc:492] T 117ae8a22b1d46579ce047f99e30520b P a722e54d227f4c29a9ed6ce77858003a: Bootstrap starting.
I20260709 13:22:58.918939 15220 consensus_queue.cc:1048] T 36f72377897846f2a1f3d8d33ec14af6 P 0efc951052454eec9a58b0cd025945b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:22:58.919328 14999 leader_election.cc:343] T b025139466084200b70879196cd3f922 P a1a22e9119494570b6d2217713fd7e43 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f3a500981b494979b58d2b1041fec9c8 (127.5.126.65:34129): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:58.920585 15160 leader_election.cc:290] T b025139466084200b70879196cd3f922 P a1a22e9119494570b6d2217713fd7e43 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f3a500981b494979b58d2b1041fec9c8 (127.5.126.65:34129), 0efc951052454eec9a58b0cd025945b8 (127.5.126.66:34613)
I20260709 13:22:58.922243 14959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b025139466084200b70879196cd3f922" candidate_uuid: "a1a22e9119494570b6d2217713fd7e43" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0efc951052454eec9a58b0cd025945b8" is_pre_election: true
W20260709 13:22:58.924546 14999 leader_election.cc:343] T b025139466084200b70879196cd3f922 P a1a22e9119494570b6d2217713fd7e43 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0efc951052454eec9a58b0cd025945b8 (127.5.126.66:34613): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:58.925010 14999 leader_election.cc:304] T b025139466084200b70879196cd3f922 P a1a22e9119494570b6d2217713fd7e43 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1a22e9119494570b6d2217713fd7e43; no voters: 0efc951052454eec9a58b0cd025945b8, f3a500981b494979b58d2b1041fec9c8
I20260709 13:22:58.925858 15224 raft_consensus.cc:2749] T b025139466084200b70879196cd3f922 P a1a22e9119494570b6d2217713fd7e43 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:22:58.933193 15161 raft_consensus.cc:493] T 268027ae94a54cf4acf51c54c7b9032b P a722e54d227f4c29a9ed6ce77858003a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:58.933301 15178 raft_consensus.cc:493] T 914c9c0c3be1486f8dcce382b61b5450 P f3a500981b494979b58d2b1041fec9c8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:58.933805 15161 raft_consensus.cc:515] T 268027ae94a54cf4acf51c54c7b9032b P a722e54d227f4c29a9ed6ce77858003a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } } peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } } peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } }
I20260709 13:22:58.934118 15178 raft_consensus.cc:515] T 914c9c0c3be1486f8dcce382b61b5450 P f3a500981b494979b58d2b1041fec9c8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } } peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } } peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } }
I20260709 13:22:58.936210 15161 leader_election.cc:290] T 268027ae94a54cf4acf51c54c7b9032b P a722e54d227f4c29a9ed6ce77858003a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f3a500981b494979b58d2b1041fec9c8 (127.5.126.65:34129), 0efc951052454eec9a58b0cd025945b8 (127.5.126.66:34613)
I20260709 13:22:58.936853 15178 leader_election.cc:290] T 914c9c0c3be1486f8dcce382b61b5450 P f3a500981b494979b58d2b1041fec9c8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a722e54d227f4c29a9ed6ce77858003a (127.5.126.68:46669), 0efc951052454eec9a58b0cd025945b8 (127.5.126.66:34613)
I20260709 13:22:58.937048 14884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "268027ae94a54cf4acf51c54c7b9032b" candidate_uuid: "a722e54d227f4c29a9ed6ce77858003a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f3a500981b494979b58d2b1041fec9c8" is_pre_election: true
W20260709 13:22:58.939576 15073 leader_election.cc:343] T 268027ae94a54cf4acf51c54c7b9032b P a722e54d227f4c29a9ed6ce77858003a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f3a500981b494979b58d2b1041fec9c8 (127.5.126.65:34129): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:58.942157 15107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "914c9c0c3be1486f8dcce382b61b5450" candidate_uuid: "f3a500981b494979b58d2b1041fec9c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a722e54d227f4c29a9ed6ce77858003a" is_pre_election: true
I20260709 13:22:58.944329 14959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "268027ae94a54cf4acf51c54c7b9032b" candidate_uuid: "a722e54d227f4c29a9ed6ce77858003a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0efc951052454eec9a58b0cd025945b8" is_pre_election: true
I20260709 13:22:58.945032 14959 raft_consensus.cc:2468] T 268027ae94a54cf4acf51c54c7b9032b P 0efc951052454eec9a58b0cd025945b8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a722e54d227f4c29a9ed6ce77858003a in term 0.
I20260709 13:22:58.945865 15154 tablet_bootstrap.cc:654] T 117ae8a22b1d46579ce047f99e30520b P a722e54d227f4c29a9ed6ce77858003a: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:58.947856 15073 leader_election.cc:304] T 268027ae94a54cf4acf51c54c7b9032b P a722e54d227f4c29a9ed6ce77858003a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0efc951052454eec9a58b0cd025945b8, a722e54d227f4c29a9ed6ce77858003a; no voters: f3a500981b494979b58d2b1041fec9c8
I20260709 13:22:58.949514 15161 raft_consensus.cc:2804] T 268027ae94a54cf4acf51c54c7b9032b P a722e54d227f4c29a9ed6ce77858003a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:22:58.950001 15161 raft_consensus.cc:493] T 268027ae94a54cf4acf51c54c7b9032b P a722e54d227f4c29a9ed6ce77858003a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:22:58.950457 15161 raft_consensus.cc:3060] T 268027ae94a54cf4acf51c54c7b9032b P a722e54d227f4c29a9ed6ce77858003a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:58.953064 14960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "914c9c0c3be1486f8dcce382b61b5450" candidate_uuid: "f3a500981b494979b58d2b1041fec9c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0efc951052454eec9a58b0cd025945b8" is_pre_election: true
I20260709 13:22:58.955722 14850 leader_election.cc:304] T 914c9c0c3be1486f8dcce382b61b5450 P f3a500981b494979b58d2b1041fec9c8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f3a500981b494979b58d2b1041fec9c8; no voters: 0efc951052454eec9a58b0cd025945b8, a722e54d227f4c29a9ed6ce77858003a
I20260709 13:22:58.956979 15178 raft_consensus.cc:2749] T 914c9c0c3be1486f8dcce382b61b5450 P f3a500981b494979b58d2b1041fec9c8 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:22:58.959654 15211 consensus_queue.cc:1048] T 36f72377897846f2a1f3d8d33ec14af6 P 0efc951052454eec9a58b0cd025945b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:22:58.962622 14783 catalog_manager.cc:5697] T 7560205f5d324c7d821dff8efe7a6256 P 0efc951052454eec9a58b0cd025945b8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0efc951052454eec9a58b0cd025945b8 (127.5.126.66). New cstate: current_term: 1 leader_uuid: "0efc951052454eec9a58b0cd025945b8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } health_report { overall_health: UNKNOWN } } }
I20260709 13:22:59.002017 15154 tablet_bootstrap.cc:492] T 117ae8a22b1d46579ce047f99e30520b P a722e54d227f4c29a9ed6ce77858003a: No bootstrap required, opened a new log
I20260709 13:22:59.002821 15154 ts_tablet_manager.cc:1403] T 117ae8a22b1d46579ce047f99e30520b P a722e54d227f4c29a9ed6ce77858003a: Time spent bootstrapping tablet: real 0.084s	user 0.020s	sys 0.009s
I20260709 13:22:59.006250 15155 tablet_bootstrap.cc:492] T 70d027ba81f54eba882756b941186710 P a1a22e9119494570b6d2217713fd7e43: No bootstrap required, opened a new log
I20260709 13:22:59.006263 15153 tablet_bootstrap.cc:492] T 5cd72bf3a0114fddb1bda8271debea24 P 0efc951052454eec9a58b0cd025945b8: No bootstrap required, opened a new log
I20260709 13:22:59.007551 15155 ts_tablet_manager.cc:1403] T 70d027ba81f54eba882756b941186710 P a1a22e9119494570b6d2217713fd7e43: Time spent bootstrapping tablet: real 0.120s	user 0.031s	sys 0.007s
I20260709 13:22:59.007688 15153 ts_tablet_manager.cc:1403] T 5cd72bf3a0114fddb1bda8271debea24 P 0efc951052454eec9a58b0cd025945b8: Time spent bootstrapping tablet: real 0.121s	user 0.024s	sys 0.047s
I20260709 13:22:59.009110 15156 tablet_bootstrap.cc:492] T e85432ede09747339c957cdaa7d15ac6 P f3a500981b494979b58d2b1041fec9c8: No bootstrap required, opened a new log
I20260709 13:22:59.009629 15156 ts_tablet_manager.cc:1403] T e85432ede09747339c957cdaa7d15ac6 P f3a500981b494979b58d2b1041fec9c8: Time spent bootstrapping tablet: real 0.118s	user 0.020s	sys 0.024s
I20260709 13:22:59.015100 15153 raft_consensus.cc:359] T 5cd72bf3a0114fddb1bda8271debea24 P 0efc951052454eec9a58b0cd025945b8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } } peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } } peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } }
I20260709 13:22:59.015858 15153 raft_consensus.cc:385] T 5cd72bf3a0114fddb1bda8271debea24 P 0efc951052454eec9a58b0cd025945b8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:59.016168 15153 raft_consensus.cc:740] T 5cd72bf3a0114fddb1bda8271debea24 P 0efc951052454eec9a58b0cd025945b8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0efc951052454eec9a58b0cd025945b8, State: Initialized, Role: FOLLOWER
I20260709 13:22:59.016911 15153 consensus_queue.cc:260] T 5cd72bf3a0114fddb1bda8271debea24 P 0efc951052454eec9a58b0cd025945b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } } peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } } peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } }
I20260709 13:22:59.017120 14780 catalog_manager.cc:5697] T 5cd72bf3a0114fddb1bda8271debea24 P a1a22e9119494570b6d2217713fd7e43 reported cstate change: term changed from 0 to 1, leader changed from <none> to a1a22e9119494570b6d2217713fd7e43 (127.5.126.67). New cstate: current_term: 1 leader_uuid: "a1a22e9119494570b6d2217713fd7e43" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } health_report { overall_health: UNKNOWN } } }
I20260709 13:22:59.017160 15154 raft_consensus.cc:359] T 117ae8a22b1d46579ce047f99e30520b P a722e54d227f4c29a9ed6ce77858003a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } } peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } } peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } }
I20260709 13:22:59.018880 15154 raft_consensus.cc:385] T 117ae8a22b1d46579ce047f99e30520b P a722e54d227f4c29a9ed6ce77858003a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:59.019294 15154 raft_consensus.cc:740] T 117ae8a22b1d46579ce047f99e30520b P a722e54d227f4c29a9ed6ce77858003a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a722e54d227f4c29a9ed6ce77858003a, State: Initialized, Role: FOLLOWER
I20260709 13:22:59.019919 15153 ts_tablet_manager.cc:1434] T 5cd72bf3a0114fddb1bda8271debea24 P 0efc951052454eec9a58b0cd025945b8: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.000s
I20260709 13:22:59.021154 15153 tablet_bootstrap.cc:492] T 46ed2e9dd1324ac4a6e07f813cfebb7e P 0efc951052454eec9a58b0cd025945b8: Bootstrap starting.
I20260709 13:22:59.020471 15154 consensus_queue.cc:260] T 117ae8a22b1d46579ce047f99e30520b P a722e54d227f4c29a9ed6ce77858003a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } } peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } } peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } }
I20260709 13:22:59.022230 15155 raft_consensus.cc:359] T 70d027ba81f54eba882756b941186710 P a1a22e9119494570b6d2217713fd7e43 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } } peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } } peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } }
I20260709 13:22:59.023438 15155 raft_consensus.cc:385] T 70d027ba81f54eba882756b941186710 P a1a22e9119494570b6d2217713fd7e43 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:59.023800 15155 raft_consensus.cc:740] T 70d027ba81f54eba882756b941186710 P a1a22e9119494570b6d2217713fd7e43 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a1a22e9119494570b6d2217713fd7e43, State: Initialized, Role: FOLLOWER
I20260709 13:22:59.028004 15153 tablet_bootstrap.cc:654] T 46ed2e9dd1324ac4a6e07f813cfebb7e P 0efc951052454eec9a58b0cd025945b8: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:59.029518 15155 consensus_queue.cc:260] T 70d027ba81f54eba882756b941186710 P a1a22e9119494570b6d2217713fd7e43 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } } peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } } peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } }
I20260709 13:22:59.033329 15154 ts_tablet_manager.cc:1434] T 117ae8a22b1d46579ce047f99e30520b P a722e54d227f4c29a9ed6ce77858003a: Time spent starting tablet: real 0.030s	user 0.010s	sys 0.000s
I20260709 13:22:59.034947 15154 tablet_bootstrap.cc:492] T 5df7528567fd4291a888bfb37c28dc27 P a722e54d227f4c29a9ed6ce77858003a: Bootstrap starting.
I20260709 13:22:59.036706 15156 raft_consensus.cc:359] T e85432ede09747339c957cdaa7d15ac6 P f3a500981b494979b58d2b1041fec9c8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } } peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } } peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } }
I20260709 13:22:59.038589 15178 raft_consensus.cc:493] T db6d3d345bd3495e9ec9a0e75ecd0562 P f3a500981b494979b58d2b1041fec9c8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:59.039008 15155 ts_tablet_manager.cc:1434] T 70d027ba81f54eba882756b941186710 P a1a22e9119494570b6d2217713fd7e43: Time spent starting tablet: real 0.031s	user 0.005s	sys 0.004s
I20260709 13:22:59.039109 15178 raft_consensus.cc:515] T db6d3d345bd3495e9ec9a0e75ecd0562 P f3a500981b494979b58d2b1041fec9c8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } } peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } } peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } }
I20260709 13:22:59.041954 15178 leader_election.cc:290] T db6d3d345bd3495e9ec9a0e75ecd0562 P f3a500981b494979b58d2b1041fec9c8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0efc951052454eec9a58b0cd025945b8 (127.5.126.66:34613), a1a22e9119494570b6d2217713fd7e43 (127.5.126.67:38125)
I20260709 13:22:59.043004 14960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db6d3d345bd3495e9ec9a0e75ecd0562" candidate_uuid: "f3a500981b494979b58d2b1041fec9c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0efc951052454eec9a58b0cd025945b8" is_pre_election: true
I20260709 13:22:59.043146 15033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db6d3d345bd3495e9ec9a0e75ecd0562" candidate_uuid: "f3a500981b494979b58d2b1041fec9c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1a22e9119494570b6d2217713fd7e43" is_pre_election: true
I20260709 13:22:59.044107 14960 raft_consensus.cc:2393] T db6d3d345bd3495e9ec9a0e75ecd0562 P 0efc951052454eec9a58b0cd025945b8 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f3a500981b494979b58d2b1041fec9c8 in current term 1: Already voted for candidate a1a22e9119494570b6d2217713fd7e43 in this term.
I20260709 13:22:59.037858 15156 raft_consensus.cc:385] T e85432ede09747339c957cdaa7d15ac6 P f3a500981b494979b58d2b1041fec9c8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:59.046459 15156 raft_consensus.cc:740] T e85432ede09747339c957cdaa7d15ac6 P f3a500981b494979b58d2b1041fec9c8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f3a500981b494979b58d2b1041fec9c8, State: Initialized, Role: FOLLOWER
I20260709 13:22:59.042999 15161 raft_consensus.cc:515] T 268027ae94a54cf4acf51c54c7b9032b P a722e54d227f4c29a9ed6ce77858003a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } } peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } } peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } }
I20260709 13:22:59.048012 15156 consensus_queue.cc:260] T e85432ede09747339c957cdaa7d15ac6 P f3a500981b494979b58d2b1041fec9c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } } peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } } peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } }
I20260709 13:22:59.050431 14884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "268027ae94a54cf4acf51c54c7b9032b" candidate_uuid: "a722e54d227f4c29a9ed6ce77858003a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f3a500981b494979b58d2b1041fec9c8"
I20260709 13:22:59.050868 14850 leader_election.cc:304] T db6d3d345bd3495e9ec9a0e75ecd0562 P f3a500981b494979b58d2b1041fec9c8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f3a500981b494979b58d2b1041fec9c8; no voters: 0efc951052454eec9a58b0cd025945b8, a1a22e9119494570b6d2217713fd7e43
W20260709 13:22:59.051949 15073 leader_election.cc:343] T 268027ae94a54cf4acf51c54c7b9032b P a722e54d227f4c29a9ed6ce77858003a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f3a500981b494979b58d2b1041fec9c8 (127.5.126.65:34129): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:59.054913 14960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "268027ae94a54cf4acf51c54c7b9032b" candidate_uuid: "a722e54d227f4c29a9ed6ce77858003a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0efc951052454eec9a58b0cd025945b8"
I20260709 13:22:59.055598 14960 raft_consensus.cc:3060] T 268027ae94a54cf4acf51c54c7b9032b P 0efc951052454eec9a58b0cd025945b8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:59.046993 15155 tablet_bootstrap.cc:492] T f0424da0ffb84ba5931fe92f6dd57c5f P a1a22e9119494570b6d2217713fd7e43: Bootstrap starting.
I20260709 13:22:59.056895 15178 raft_consensus.cc:3060] T db6d3d345bd3495e9ec9a0e75ecd0562 P f3a500981b494979b58d2b1041fec9c8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:59.058943 15108 raft_consensus.cc:3060] T 117ae8a22b1d46579ce047f99e30520b P a722e54d227f4c29a9ed6ce77858003a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:59.061858 15161 leader_election.cc:290] T 268027ae94a54cf4acf51c54c7b9032b P a722e54d227f4c29a9ed6ce77858003a [CANDIDATE]: Term 1 election: Requested vote from peers f3a500981b494979b58d2b1041fec9c8 (127.5.126.65:34129), 0efc951052454eec9a58b0cd025945b8 (127.5.126.66:34613)
I20260709 13:22:59.062920 15220 raft_consensus.cc:493] T 5cd72bf3a0114fddb1bda8271debea24 P 0efc951052454eec9a58b0cd025945b8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:59.066118 15156 ts_tablet_manager.cc:1434] T e85432ede09747339c957cdaa7d15ac6 P f3a500981b494979b58d2b1041fec9c8: Time spent starting tablet: real 0.056s	user 0.003s	sys 0.006s
I20260709 13:22:59.069079 14960 raft_consensus.cc:2468] T 268027ae94a54cf4acf51c54c7b9032b P 0efc951052454eec9a58b0cd025945b8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a722e54d227f4c29a9ed6ce77858003a in term 1.
I20260709 13:22:59.064432 15178 raft_consensus.cc:2749] T db6d3d345bd3495e9ec9a0e75ecd0562 P f3a500981b494979b58d2b1041fec9c8 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:22:59.065965 15220 raft_consensus.cc:515] T 5cd72bf3a0114fddb1bda8271debea24 P 0efc951052454eec9a58b0cd025945b8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } } peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } } peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } }
I20260709 13:22:59.070591 15073 leader_election.cc:304] T 268027ae94a54cf4acf51c54c7b9032b P a722e54d227f4c29a9ed6ce77858003a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0efc951052454eec9a58b0cd025945b8, a722e54d227f4c29a9ed6ce77858003a; no voters: f3a500981b494979b58d2b1041fec9c8
I20260709 13:22:59.071344 15220 leader_election.cc:290] T 5cd72bf3a0114fddb1bda8271debea24 P 0efc951052454eec9a58b0cd025945b8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a1a22e9119494570b6d2217713fd7e43 (127.5.126.67:38125), a722e54d227f4c29a9ed6ce77858003a (127.5.126.68:46669)
I20260709 13:22:59.071516 15161 raft_consensus.cc:2804] T 268027ae94a54cf4acf51c54c7b9032b P a722e54d227f4c29a9ed6ce77858003a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:22:59.072749 15156 tablet_bootstrap.cc:492] T 7560205f5d324c7d821dff8efe7a6256 P f3a500981b494979b58d2b1041fec9c8: Bootstrap starting.
I20260709 13:22:59.073203 15161 raft_consensus.cc:697] T 268027ae94a54cf4acf51c54c7b9032b P a722e54d227f4c29a9ed6ce77858003a [term 1 LEADER]: Becoming Leader. State: Replica: a722e54d227f4c29a9ed6ce77858003a, State: Running, Role: LEADER
I20260709 13:22:59.074225 15161 consensus_queue.cc:237] T 268027ae94a54cf4acf51c54c7b9032b P a722e54d227f4c29a9ed6ce77858003a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } } peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } } peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } }
I20260709 13:22:59.079053 15155 tablet_bootstrap.cc:654] T f0424da0ffb84ba5931fe92f6dd57c5f P a1a22e9119494570b6d2217713fd7e43: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:59.074169 15107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cd72bf3a0114fddb1bda8271debea24" candidate_uuid: "0efc951052454eec9a58b0cd025945b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a722e54d227f4c29a9ed6ce77858003a" is_pre_election: true
W20260709 13:22:59.080180 14999 consensus_peers.cc:597] T 5df7528567fd4291a888bfb37c28dc27 P a1a22e9119494570b6d2217713fd7e43 -> Peer a722e54d227f4c29a9ed6ce77858003a (127.5.126.68:46669): Couldn't send request to peer a722e54d227f4c29a9ed6ce77858003a. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:22:59.080216 15107 raft_consensus.cc:2393] T 5cd72bf3a0114fddb1bda8271debea24 P a722e54d227f4c29a9ed6ce77858003a [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0efc951052454eec9a58b0cd025945b8 in current term 1: Already voted for candidate a1a22e9119494570b6d2217713fd7e43 in this term.
I20260709 13:22:59.085762 15034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cd72bf3a0114fddb1bda8271debea24" candidate_uuid: "0efc951052454eec9a58b0cd025945b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1a22e9119494570b6d2217713fd7e43" is_pre_election: true
I20260709 13:22:59.086319 15160 consensus_queue.cc:1048] T 5df7528567fd4291a888bfb37c28dc27 P a1a22e9119494570b6d2217713fd7e43 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 13:22:59.088601 15220 raft_consensus.cc:493] T e75f8237624f42f793627366f05b792a P 0efc951052454eec9a58b0cd025945b8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:59.087355 15235 consensus_queue.cc:1048] T db6d3d345bd3495e9ec9a0e75ecd0562 P a1a22e9119494570b6d2217713fd7e43 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 13:22:59.089237 15156 tablet_bootstrap.cc:654] T 7560205f5d324c7d821dff8efe7a6256 P f3a500981b494979b58d2b1041fec9c8: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:59.089124 15220 raft_consensus.cc:515] T e75f8237624f42f793627366f05b792a P 0efc951052454eec9a58b0cd025945b8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } } peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } } peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } }
I20260709 13:22:59.091449 15220 leader_election.cc:290] T e75f8237624f42f793627366f05b792a P 0efc951052454eec9a58b0cd025945b8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a722e54d227f4c29a9ed6ce77858003a (127.5.126.68:46669), f3a500981b494979b58d2b1041fec9c8 (127.5.126.65:34129)
I20260709 13:22:59.094475 15107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e75f8237624f42f793627366f05b792a" candidate_uuid: "0efc951052454eec9a58b0cd025945b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a722e54d227f4c29a9ed6ce77858003a" is_pre_election: true
I20260709 13:22:59.094494 15213 raft_consensus.cc:493] T e75f8237624f42f793627366f05b792a P a722e54d227f4c29a9ed6ce77858003a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:59.095696 15213 raft_consensus.cc:515] T e75f8237624f42f793627366f05b792a P a722e54d227f4c29a9ed6ce77858003a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } } peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } } peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } }
I20260709 13:22:59.097903 15154 tablet_bootstrap.cc:654] T 5df7528567fd4291a888bfb37c28dc27 P a722e54d227f4c29a9ed6ce77858003a: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:59.098754 14883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e75f8237624f42f793627366f05b792a" candidate_uuid: "0efc951052454eec9a58b0cd025945b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f3a500981b494979b58d2b1041fec9c8" is_pre_election: true
I20260709 13:22:59.099470 14883 raft_consensus.cc:2468] T e75f8237624f42f793627366f05b792a P f3a500981b494979b58d2b1041fec9c8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0efc951052454eec9a58b0cd025945b8 in term 0.
I20260709 13:22:59.108889 14924 leader_election.cc:304] T 5cd72bf3a0114fddb1bda8271debea24 P 0efc951052454eec9a58b0cd025945b8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0efc951052454eec9a58b0cd025945b8; no voters: a1a22e9119494570b6d2217713fd7e43, a722e54d227f4c29a9ed6ce77858003a
I20260709 13:22:59.109129 15259 raft_consensus.cc:493] T 70d027ba81f54eba882756b941186710 P f3a500981b494979b58d2b1041fec9c8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:59.109747 15259 raft_consensus.cc:515] T 70d027ba81f54eba882756b941186710 P f3a500981b494979b58d2b1041fec9c8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } } peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } } peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } }
I20260709 13:22:59.110252 14925 leader_election.cc:304] T e75f8237624f42f793627366f05b792a P 0efc951052454eec9a58b0cd025945b8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0efc951052454eec9a58b0cd025945b8, f3a500981b494979b58d2b1041fec9c8; no voters: 
I20260709 13:22:59.111119 15211 raft_consensus.cc:3060] T 5cd72bf3a0114fddb1bda8271debea24 P 0efc951052454eec9a58b0cd025945b8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:59.112773 15220 raft_consensus.cc:2804] T e75f8237624f42f793627366f05b792a P 0efc951052454eec9a58b0cd025945b8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:22:59.113184 15220 raft_consensus.cc:493] T e75f8237624f42f793627366f05b792a P 0efc951052454eec9a58b0cd025945b8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:22:59.113525 15220 raft_consensus.cc:3060] T e75f8237624f42f793627366f05b792a P 0efc951052454eec9a58b0cd025945b8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:59.113752 15034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70d027ba81f54eba882756b941186710" candidate_uuid: "f3a500981b494979b58d2b1041fec9c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1a22e9119494570b6d2217713fd7e43" is_pre_election: true
I20260709 13:22:59.114766 15034 raft_consensus.cc:2468] T 70d027ba81f54eba882756b941186710 P a1a22e9119494570b6d2217713fd7e43 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f3a500981b494979b58d2b1041fec9c8 in term 0.
I20260709 13:22:59.117482 15107 raft_consensus.cc:2468] T e75f8237624f42f793627366f05b792a P a722e54d227f4c29a9ed6ce77858003a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0efc951052454eec9a58b0cd025945b8 in term 0.
I20260709 13:22:59.121703 15106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70d027ba81f54eba882756b941186710" candidate_uuid: "f3a500981b494979b58d2b1041fec9c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a722e54d227f4c29a9ed6ce77858003a" is_pre_election: true
I20260709 13:22:59.120476 14849 leader_election.cc:304] T 70d027ba81f54eba882756b941186710 P f3a500981b494979b58d2b1041fec9c8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1a22e9119494570b6d2217713fd7e43, f3a500981b494979b58d2b1041fec9c8; no voters: 
I20260709 13:22:59.122704 15106 raft_consensus.cc:2468] T 70d027ba81f54eba882756b941186710 P a722e54d227f4c29a9ed6ce77858003a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f3a500981b494979b58d2b1041fec9c8 in term 0.
I20260709 13:22:59.124753 14960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e75f8237624f42f793627366f05b792a" candidate_uuid: "a722e54d227f4c29a9ed6ce77858003a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0efc951052454eec9a58b0cd025945b8" is_pre_election: true
I20260709 13:22:59.123389 15178 raft_consensus.cc:2804] T 70d027ba81f54eba882756b941186710 P f3a500981b494979b58d2b1041fec9c8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:22:59.125809 15178 raft_consensus.cc:493] T 70d027ba81f54eba882756b941186710 P f3a500981b494979b58d2b1041fec9c8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:22:59.125844 15213 leader_election.cc:290] T e75f8237624f42f793627366f05b792a P a722e54d227f4c29a9ed6ce77858003a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f3a500981b494979b58d2b1041fec9c8 (127.5.126.65:34129), 0efc951052454eec9a58b0cd025945b8 (127.5.126.66:34613)
I20260709 13:22:59.126484 15178 raft_consensus.cc:3060] T 70d027ba81f54eba882756b941186710 P f3a500981b494979b58d2b1041fec9c8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:59.127329 14883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e75f8237624f42f793627366f05b792a" candidate_uuid: "a722e54d227f4c29a9ed6ce77858003a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f3a500981b494979b58d2b1041fec9c8" is_pre_election: true
I20260709 13:22:59.128261 14883 raft_consensus.cc:2468] T e75f8237624f42f793627366f05b792a P f3a500981b494979b58d2b1041fec9c8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a722e54d227f4c29a9ed6ce77858003a in term 0.
I20260709 13:22:59.130242 15073 leader_election.cc:304] T e75f8237624f42f793627366f05b792a P a722e54d227f4c29a9ed6ce77858003a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a722e54d227f4c29a9ed6ce77858003a, f3a500981b494979b58d2b1041fec9c8; no voters: 
I20260709 13:22:59.122377 15153 tablet_bootstrap.cc:492] T 46ed2e9dd1324ac4a6e07f813cfebb7e P 0efc951052454eec9a58b0cd025945b8: No bootstrap required, opened a new log
I20260709 13:22:59.131611 15153 ts_tablet_manager.cc:1403] T 46ed2e9dd1324ac4a6e07f813cfebb7e P 0efc951052454eec9a58b0cd025945b8: Time spent bootstrapping tablet: real 0.111s	user 0.014s	sys 0.012s
I20260709 13:22:59.133299 14883 raft_consensus.cc:3060] T 914c9c0c3be1486f8dcce382b61b5450 P f3a500981b494979b58d2b1041fec9c8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:59.134588 15161 raft_consensus.cc:2804] T e75f8237624f42f793627366f05b792a P a722e54d227f4c29a9ed6ce77858003a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:22:59.135054 15161 raft_consensus.cc:493] T e75f8237624f42f793627366f05b792a P a722e54d227f4c29a9ed6ce77858003a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:22:59.135409 15161 raft_consensus.cc:3060] T e75f8237624f42f793627366f05b792a P a722e54d227f4c29a9ed6ce77858003a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:59.116961 15259 leader_election.cc:290] T 70d027ba81f54eba882756b941186710 P f3a500981b494979b58d2b1041fec9c8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a1a22e9119494570b6d2217713fd7e43 (127.5.126.67:38125), a722e54d227f4c29a9ed6ce77858003a (127.5.126.68:46669)
I20260709 13:22:59.136029 15153 raft_consensus.cc:359] T 46ed2e9dd1324ac4a6e07f813cfebb7e P 0efc951052454eec9a58b0cd025945b8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } } peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } } peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } }
I20260709 13:22:59.141439 15153 raft_consensus.cc:385] T 46ed2e9dd1324ac4a6e07f813cfebb7e P 0efc951052454eec9a58b0cd025945b8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:59.142590 15153 raft_consensus.cc:740] T 46ed2e9dd1324ac4a6e07f813cfebb7e P 0efc951052454eec9a58b0cd025945b8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0efc951052454eec9a58b0cd025945b8, State: Initialized, Role: FOLLOWER
I20260709 13:22:59.145100 15153 consensus_queue.cc:260] T 46ed2e9dd1324ac4a6e07f813cfebb7e P 0efc951052454eec9a58b0cd025945b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } } peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } } peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } }
I20260709 13:22:59.140532 15211 raft_consensus.cc:2749] T 5cd72bf3a0114fddb1bda8271debea24 P 0efc951052454eec9a58b0cd025945b8 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:22:59.150404 15153 ts_tablet_manager.cc:1434] T 46ed2e9dd1324ac4a6e07f813cfebb7e P 0efc951052454eec9a58b0cd025945b8: Time spent starting tablet: real 0.018s	user 0.008s	sys 0.000s
I20260709 13:22:59.151568 15259 raft_consensus.cc:493] T e85432ede09747339c957cdaa7d15ac6 P f3a500981b494979b58d2b1041fec9c8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:59.153983 15259 raft_consensus.cc:515] T e85432ede09747339c957cdaa7d15ac6 P f3a500981b494979b58d2b1041fec9c8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } } peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } } peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } }
I20260709 13:22:59.155054 15178 raft_consensus.cc:515] T 70d027ba81f54eba882756b941186710 P f3a500981b494979b58d2b1041fec9c8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } } peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } } peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } }
I20260709 13:22:59.157657 15178 leader_election.cc:290] T 70d027ba81f54eba882756b941186710 P f3a500981b494979b58d2b1041fec9c8 [CANDIDATE]: Term 1 election: Requested vote from peers a1a22e9119494570b6d2217713fd7e43 (127.5.126.67:38125), a722e54d227f4c29a9ed6ce77858003a (127.5.126.68:46669)
I20260709 13:22:59.158049 15106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e85432ede09747339c957cdaa7d15ac6" candidate_uuid: "f3a500981b494979b58d2b1041fec9c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a722e54d227f4c29a9ed6ce77858003a" is_pre_election: true
I20260709 13:22:59.161819 15034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e85432ede09747339c957cdaa7d15ac6" candidate_uuid: "f3a500981b494979b58d2b1041fec9c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1a22e9119494570b6d2217713fd7e43" is_pre_election: true
I20260709 13:22:59.162184 15220 raft_consensus.cc:515] T e75f8237624f42f793627366f05b792a P 0efc951052454eec9a58b0cd025945b8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } } peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } } peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } }
I20260709 13:22:59.162793 15034 raft_consensus.cc:2468] T e85432ede09747339c957cdaa7d15ac6 P a1a22e9119494570b6d2217713fd7e43 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f3a500981b494979b58d2b1041fec9c8 in term 0.
I20260709 13:22:59.163767 14960 raft_consensus.cc:2393] T e75f8237624f42f793627366f05b792a P 0efc951052454eec9a58b0cd025945b8 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a722e54d227f4c29a9ed6ce77858003a in current term 1: Already voted for candidate 0efc951052454eec9a58b0cd025945b8 in this term.
I20260709 13:22:59.164408 15033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70d027ba81f54eba882756b941186710" candidate_uuid: "f3a500981b494979b58d2b1041fec9c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1a22e9119494570b6d2217713fd7e43"
I20260709 13:22:59.168157 15153 tablet_bootstrap.cc:492] T aecef3c240394d54844ec8170e9cad59 P 0efc951052454eec9a58b0cd025945b8: Bootstrap starting.
I20260709 13:22:59.168669 15033 raft_consensus.cc:3060] T 70d027ba81f54eba882756b941186710 P a1a22e9119494570b6d2217713fd7e43 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:59.165685 15259 leader_election.cc:290] T e85432ede09747339c957cdaa7d15ac6 P f3a500981b494979b58d2b1041fec9c8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a1a22e9119494570b6d2217713fd7e43 (127.5.126.67:38125), a722e54d227f4c29a9ed6ce77858003a (127.5.126.68:46669)
I20260709 13:22:59.170127 14849 leader_election.cc:304] T e85432ede09747339c957cdaa7d15ac6 P f3a500981b494979b58d2b1041fec9c8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1a22e9119494570b6d2217713fd7e43, f3a500981b494979b58d2b1041fec9c8; no voters: 
I20260709 13:22:59.171090 15156 tablet_bootstrap.cc:492] T 7560205f5d324c7d821dff8efe7a6256 P f3a500981b494979b58d2b1041fec9c8: No bootstrap required, opened a new log
I20260709 13:22:59.171619 15156 ts_tablet_manager.cc:1403] T 7560205f5d324c7d821dff8efe7a6256 P f3a500981b494979b58d2b1041fec9c8: Time spent bootstrapping tablet: real 0.099s	user 0.005s	sys 0.020s
I20260709 13:22:59.173539 15259 raft_consensus.cc:2804] T e85432ede09747339c957cdaa7d15ac6 P f3a500981b494979b58d2b1041fec9c8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:22:59.174014 15259 raft_consensus.cc:493] T e85432ede09747339c957cdaa7d15ac6 P f3a500981b494979b58d2b1041fec9c8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:22:59.174422 15259 raft_consensus.cc:3060] T e85432ede09747339c957cdaa7d15ac6 P f3a500981b494979b58d2b1041fec9c8 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:22:59.176707 14850 leader_election.cc:343] T e85432ede09747339c957cdaa7d15ac6 P f3a500981b494979b58d2b1041fec9c8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a722e54d227f4c29a9ed6ce77858003a (127.5.126.68:46669): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:59.177014 15106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70d027ba81f54eba882756b941186710" candidate_uuid: "f3a500981b494979b58d2b1041fec9c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a722e54d227f4c29a9ed6ce77858003a"
I20260709 13:22:59.177701 15106 raft_consensus.cc:3060] T 70d027ba81f54eba882756b941186710 P a722e54d227f4c29a9ed6ce77858003a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:59.181568 15224 consensus_queue.cc:1048] T db6d3d345bd3495e9ec9a0e75ecd0562 P a1a22e9119494570b6d2217713fd7e43 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:22:59.182927 15034 raft_consensus.cc:3060] T 48be8cf045364be999b8f0fd547b7b9d P a1a22e9119494570b6d2217713fd7e43 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:59.183228 15033 raft_consensus.cc:2468] T 70d027ba81f54eba882756b941186710 P a1a22e9119494570b6d2217713fd7e43 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f3a500981b494979b58d2b1041fec9c8 in term 1.
I20260709 13:22:59.176155 15156 raft_consensus.cc:359] T 7560205f5d324c7d821dff8efe7a6256 P f3a500981b494979b58d2b1041fec9c8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } } peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } } peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } }
I20260709 13:22:59.184880 15156 raft_consensus.cc:385] T 7560205f5d324c7d821dff8efe7a6256 P f3a500981b494979b58d2b1041fec9c8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:59.185149 15156 raft_consensus.cc:740] T 7560205f5d324c7d821dff8efe7a6256 P f3a500981b494979b58d2b1041fec9c8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f3a500981b494979b58d2b1041fec9c8, State: Initialized, Role: FOLLOWER
I20260709 13:22:59.187471 15156 consensus_queue.cc:260] T 7560205f5d324c7d821dff8efe7a6256 P f3a500981b494979b58d2b1041fec9c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } } peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } } peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } }
I20260709 13:22:59.192874 15106 raft_consensus.cc:2468] T 70d027ba81f54eba882756b941186710 P a722e54d227f4c29a9ed6ce77858003a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f3a500981b494979b58d2b1041fec9c8 in term 1.
I20260709 13:22:59.194739 14849 leader_election.cc:304] T 70d027ba81f54eba882756b941186710 P f3a500981b494979b58d2b1041fec9c8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1a22e9119494570b6d2217713fd7e43, f3a500981b494979b58d2b1041fec9c8; no voters: 
I20260709 13:22:59.199260 15153 tablet_bootstrap.cc:654] T aecef3c240394d54844ec8170e9cad59 P 0efc951052454eec9a58b0cd025945b8: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:59.205564 15154 tablet_bootstrap.cc:492] T 5df7528567fd4291a888bfb37c28dc27 P a722e54d227f4c29a9ed6ce77858003a: No bootstrap required, opened a new log
I20260709 13:22:59.205034 14782 catalog_manager.cc:5697] T 268027ae94a54cf4acf51c54c7b9032b P a722e54d227f4c29a9ed6ce77858003a reported cstate change: term changed from 0 to 1, leader changed from <none> to a722e54d227f4c29a9ed6ce77858003a (127.5.126.68). New cstate: current_term: 1 leader_uuid: "a722e54d227f4c29a9ed6ce77858003a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } health_report { overall_health: UNKNOWN } } }
I20260709 13:22:59.206202 15154 ts_tablet_manager.cc:1403] T 5df7528567fd4291a888bfb37c28dc27 P a722e54d227f4c29a9ed6ce77858003a: Time spent bootstrapping tablet: real 0.172s	user 0.017s	sys 0.007s
I20260709 13:22:59.205853 15161 raft_consensus.cc:515] T e75f8237624f42f793627366f05b792a P a722e54d227f4c29a9ed6ce77858003a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } } peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } } peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } }
I20260709 13:22:59.209282 15154 raft_consensus.cc:359] T 5df7528567fd4291a888bfb37c28dc27 P a722e54d227f4c29a9ed6ce77858003a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } } peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } } peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } }
I20260709 13:22:59.209932 15154 raft_consensus.cc:385] T 5df7528567fd4291a888bfb37c28dc27 P a722e54d227f4c29a9ed6ce77858003a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:59.210166 15220 leader_election.cc:290] T e75f8237624f42f793627366f05b792a P 0efc951052454eec9a58b0cd025945b8 [CANDIDATE]: Term 1 election: Requested vote from peers a722e54d227f4c29a9ed6ce77858003a (127.5.126.68:46669), f3a500981b494979b58d2b1041fec9c8 (127.5.126.65:34129)
I20260709 13:22:59.210198 15154 raft_consensus.cc:740] T 5df7528567fd4291a888bfb37c28dc27 P a722e54d227f4c29a9ed6ce77858003a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a722e54d227f4c29a9ed6ce77858003a, State: Initialized, Role: FOLLOWER
I20260709 13:22:59.211176 15154 consensus_queue.cc:260] T 5df7528567fd4291a888bfb37c28dc27 P a722e54d227f4c29a9ed6ce77858003a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } } peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } } peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } }
I20260709 13:22:59.211885 15108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e75f8237624f42f793627366f05b792a" candidate_uuid: "0efc951052454eec9a58b0cd025945b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a722e54d227f4c29a9ed6ce77858003a"
I20260709 13:22:59.212831 15155 tablet_bootstrap.cc:492] T f0424da0ffb84ba5931fe92f6dd57c5f P a1a22e9119494570b6d2217713fd7e43: No bootstrap required, opened a new log
I20260709 13:22:59.213404 15155 ts_tablet_manager.cc:1403] T f0424da0ffb84ba5931fe92f6dd57c5f P a1a22e9119494570b6d2217713fd7e43: Time spent bootstrapping tablet: real 0.167s	user 0.021s	sys 0.012s
I20260709 13:22:59.214346 15108 raft_consensus.cc:2393] T e75f8237624f42f793627366f05b792a P a722e54d227f4c29a9ed6ce77858003a [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 0efc951052454eec9a58b0cd025945b8 in current term 1: Already voted for candidate a722e54d227f4c29a9ed6ce77858003a in this term.
I20260709 13:22:59.215147 15154 ts_tablet_manager.cc:1434] T 5df7528567fd4291a888bfb37c28dc27 P a722e54d227f4c29a9ed6ce77858003a: Time spent starting tablet: real 0.009s	user 0.004s	sys 0.004s
I20260709 13:22:59.216205 15154 tablet_bootstrap.cc:492] T e85432ede09747339c957cdaa7d15ac6 P a722e54d227f4c29a9ed6ce77858003a: Bootstrap starting.
I20260709 13:22:59.216482 14884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e75f8237624f42f793627366f05b792a" candidate_uuid: "0efc951052454eec9a58b0cd025945b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f3a500981b494979b58d2b1041fec9c8"
I20260709 13:22:59.217136 14884 raft_consensus.cc:3060] T e75f8237624f42f793627366f05b792a P f3a500981b494979b58d2b1041fec9c8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:59.218079 15155 raft_consensus.cc:359] T f0424da0ffb84ba5931fe92f6dd57c5f P a1a22e9119494570b6d2217713fd7e43 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } } peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } } peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } }
I20260709 13:22:59.219281 15155 raft_consensus.cc:385] T f0424da0ffb84ba5931fe92f6dd57c5f P a1a22e9119494570b6d2217713fd7e43 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:59.219564 15155 raft_consensus.cc:740] T f0424da0ffb84ba5931fe92f6dd57c5f P a1a22e9119494570b6d2217713fd7e43 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a1a22e9119494570b6d2217713fd7e43, State: Initialized, Role: FOLLOWER
I20260709 13:22:59.229246 15260 raft_consensus.cc:2804] T 70d027ba81f54eba882756b941186710 P f3a500981b494979b58d2b1041fec9c8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:22:59.229851 15260 raft_consensus.cc:697] T 70d027ba81f54eba882756b941186710 P f3a500981b494979b58d2b1041fec9c8 [term 1 LEADER]: Becoming Leader. State: Replica: f3a500981b494979b58d2b1041fec9c8, State: Running, Role: LEADER
I20260709 13:22:59.230710 15260 consensus_queue.cc:237] T 70d027ba81f54eba882756b941186710 P f3a500981b494979b58d2b1041fec9c8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } } peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } } peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } }
I20260709 13:22:59.231779 15259 raft_consensus.cc:515] T e85432ede09747339c957cdaa7d15ac6 P f3a500981b494979b58d2b1041fec9c8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } } peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } } peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } }
I20260709 13:22:59.233739 14960 raft_consensus.cc:3060] T 46ed2e9dd1324ac4a6e07f813cfebb7e P 0efc951052454eec9a58b0cd025945b8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:59.232146 14885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e75f8237624f42f793627366f05b792a" candidate_uuid: "a722e54d227f4c29a9ed6ce77858003a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f3a500981b494979b58d2b1041fec9c8"
I20260709 13:22:59.234155 15259 leader_election.cc:290] T e85432ede09747339c957cdaa7d15ac6 P f3a500981b494979b58d2b1041fec9c8 [CANDIDATE]: Term 1 election: Requested vote from peers a1a22e9119494570b6d2217713fd7e43 (127.5.126.67:38125), a722e54d227f4c29a9ed6ce77858003a (127.5.126.68:46669)
I20260709 13:22:59.239581 15033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e85432ede09747339c957cdaa7d15ac6" candidate_uuid: "f3a500981b494979b58d2b1041fec9c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1a22e9119494570b6d2217713fd7e43"
I20260709 13:22:59.240114 15108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e85432ede09747339c957cdaa7d15ac6" candidate_uuid: "f3a500981b494979b58d2b1041fec9c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a722e54d227f4c29a9ed6ce77858003a"
I20260709 13:22:59.240453 15154 tablet_bootstrap.cc:654] T e85432ede09747339c957cdaa7d15ac6 P a722e54d227f4c29a9ed6ce77858003a: Neither blocks nor log segments found. Creating new log.
W20260709 13:22:59.243045 14850 leader_election.cc:343] T e85432ede09747339c957cdaa7d15ac6 P f3a500981b494979b58d2b1041fec9c8 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer a722e54d227f4c29a9ed6ce77858003a (127.5.126.68:46669): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:59.240232 15033 raft_consensus.cc:3060] T e85432ede09747339c957cdaa7d15ac6 P a1a22e9119494570b6d2217713fd7e43 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:59.257118 14884 raft_consensus.cc:2468] T e75f8237624f42f793627366f05b792a P f3a500981b494979b58d2b1041fec9c8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0efc951052454eec9a58b0cd025945b8 in term 1.
I20260709 13:22:59.259070 15259 consensus_queue.cc:1048] T 46ed2e9dd1324ac4a6e07f813cfebb7e P f3a500981b494979b58d2b1041fec9c8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:22:59.260362 14925 leader_election.cc:304] T e75f8237624f42f793627366f05b792a P 0efc951052454eec9a58b0cd025945b8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0efc951052454eec9a58b0cd025945b8, f3a500981b494979b58d2b1041fec9c8; no voters: a722e54d227f4c29a9ed6ce77858003a
I20260709 13:22:59.261718 15220 raft_consensus.cc:2804] T e75f8237624f42f793627366f05b792a P 0efc951052454eec9a58b0cd025945b8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:22:59.262236 15220 raft_consensus.cc:697] T e75f8237624f42f793627366f05b792a P 0efc951052454eec9a58b0cd025945b8 [term 1 LEADER]: Becoming Leader. State: Replica: 0efc951052454eec9a58b0cd025945b8, State: Running, Role: LEADER
I20260709 13:22:59.262948 15155 consensus_queue.cc:260] T f0424da0ffb84ba5931fe92f6dd57c5f P a1a22e9119494570b6d2217713fd7e43 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } } peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } } peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } }
I20260709 13:22:59.263060 15220 consensus_queue.cc:237] T e75f8237624f42f793627366f05b792a P 0efc951052454eec9a58b0cd025945b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } } peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } } peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } }
I20260709 13:22:59.268723 15211 consensus_queue.cc:1048] T 7560205f5d324c7d821dff8efe7a6256 P 0efc951052454eec9a58b0cd025945b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:22:59.265347 15156 ts_tablet_manager.cc:1434] T 7560205f5d324c7d821dff8efe7a6256 P f3a500981b494979b58d2b1041fec9c8: Time spent starting tablet: real 0.093s	user 0.004s	sys 0.004s
I20260709 13:22:59.271221 15156 tablet_bootstrap.cc:492] T f954c6c25a25443abd9705c8e909bf47 P f3a500981b494979b58d2b1041fec9c8: Bootstrap starting.
I20260709 13:22:59.266216 15161 leader_election.cc:290] T e75f8237624f42f793627366f05b792a P a722e54d227f4c29a9ed6ce77858003a [CANDIDATE]: Term 1 election: Requested vote from peers f3a500981b494979b58d2b1041fec9c8 (127.5.126.65:34129), 0efc951052454eec9a58b0cd025945b8 (127.5.126.66:34613)
I20260709 13:22:59.277005 14960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e75f8237624f42f793627366f05b792a" candidate_uuid: "a722e54d227f4c29a9ed6ce77858003a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0efc951052454eec9a58b0cd025945b8"
I20260709 13:22:59.283468 15073 leader_election.cc:304] T e75f8237624f42f793627366f05b792a P a722e54d227f4c29a9ed6ce77858003a [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a722e54d227f4c29a9ed6ce77858003a; no voters: 0efc951052454eec9a58b0cd025945b8, f3a500981b494979b58d2b1041fec9c8
I20260709 13:22:59.281855 15033 raft_consensus.cc:2468] T e85432ede09747339c957cdaa7d15ac6 P a1a22e9119494570b6d2217713fd7e43 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f3a500981b494979b58d2b1041fec9c8 in term 1.
I20260709 13:22:59.287825 15213 raft_consensus.cc:2749] T e75f8237624f42f793627366f05b792a P a722e54d227f4c29a9ed6ce77858003a [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:22:59.289155 15155 ts_tablet_manager.cc:1434] T f0424da0ffb84ba5931fe92f6dd57c5f P a1a22e9119494570b6d2217713fd7e43: Time spent starting tablet: real 0.075s	user 0.007s	sys 0.001s
I20260709 13:22:59.290895 14849 leader_election.cc:304] T e85432ede09747339c957cdaa7d15ac6 P f3a500981b494979b58d2b1041fec9c8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a1a22e9119494570b6d2217713fd7e43, f3a500981b494979b58d2b1041fec9c8; no voters: a722e54d227f4c29a9ed6ce77858003a
I20260709 13:22:59.292392 15153 tablet_bootstrap.cc:492] T aecef3c240394d54844ec8170e9cad59 P 0efc951052454eec9a58b0cd025945b8: No bootstrap required, opened a new log
I20260709 13:22:59.293215 15153 ts_tablet_manager.cc:1403] T aecef3c240394d54844ec8170e9cad59 P 0efc951052454eec9a58b0cd025945b8: Time spent bootstrapping tablet: real 0.126s	user 0.018s	sys 0.004s
I20260709 13:22:59.294476 15155 tablet_bootstrap.cc:492] T 74a144396e4443288858878b63f08cc8 P a1a22e9119494570b6d2217713fd7e43: Bootstrap starting.
W20260709 13:22:59.283412 14830 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:22:59.292145 15259 raft_consensus.cc:2804] T e85432ede09747339c957cdaa7d15ac6 P f3a500981b494979b58d2b1041fec9c8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:22:59.307920 15259 raft_consensus.cc:697] T e85432ede09747339c957cdaa7d15ac6 P f3a500981b494979b58d2b1041fec9c8 [term 1 LEADER]: Becoming Leader. State: Replica: f3a500981b494979b58d2b1041fec9c8, State: Running, Role: LEADER
I20260709 13:22:59.309129 15153 raft_consensus.cc:359] T aecef3c240394d54844ec8170e9cad59 P 0efc951052454eec9a58b0cd025945b8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } } peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } } peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } }
I20260709 13:22:59.309939 15153 raft_consensus.cc:385] T aecef3c240394d54844ec8170e9cad59 P 0efc951052454eec9a58b0cd025945b8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:59.309381 15259 consensus_queue.cc:237] T e85432ede09747339c957cdaa7d15ac6 P f3a500981b494979b58d2b1041fec9c8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } } peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } } peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } }
I20260709 13:22:59.312386 15160 raft_consensus.cc:493] T f0424da0ffb84ba5931fe92f6dd57c5f P a1a22e9119494570b6d2217713fd7e43 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:59.310243 15153 raft_consensus.cc:740] T aecef3c240394d54844ec8170e9cad59 P 0efc951052454eec9a58b0cd025945b8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0efc951052454eec9a58b0cd025945b8, State: Initialized, Role: FOLLOWER
I20260709 13:22:59.312979 15160 raft_consensus.cc:515] T f0424da0ffb84ba5931fe92f6dd57c5f P a1a22e9119494570b6d2217713fd7e43 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } } peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } } peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } }
I20260709 13:22:59.314240 15153 consensus_queue.cc:260] T aecef3c240394d54844ec8170e9cad59 P 0efc951052454eec9a58b0cd025945b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } } peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } } peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } }
I20260709 13:22:59.315244 15161 raft_consensus.cc:493] T a71163721b4d48b0b5ff366b9d12ac32 P a722e54d227f4c29a9ed6ce77858003a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:59.316218 15160 leader_election.cc:290] T f0424da0ffb84ba5931fe92f6dd57c5f P a1a22e9119494570b6d2217713fd7e43 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0efc951052454eec9a58b0cd025945b8 (127.5.126.66:34613), a722e54d227f4c29a9ed6ce77858003a (127.5.126.68:46669)
I20260709 13:22:59.315903 15161 raft_consensus.cc:515] T a71163721b4d48b0b5ff366b9d12ac32 P a722e54d227f4c29a9ed6ce77858003a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } } peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } } peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } }
I20260709 13:22:59.318275 14960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0424da0ffb84ba5931fe92f6dd57c5f" candidate_uuid: "a1a22e9119494570b6d2217713fd7e43" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0efc951052454eec9a58b0cd025945b8" is_pre_election: true
I20260709 13:22:59.318606 15108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0424da0ffb84ba5931fe92f6dd57c5f" candidate_uuid: "a1a22e9119494570b6d2217713fd7e43" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a722e54d227f4c29a9ed6ce77858003a" is_pre_election: true
W20260709 13:22:59.319720 14999 leader_election.cc:343] T f0424da0ffb84ba5931fe92f6dd57c5f P a1a22e9119494570b6d2217713fd7e43 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0efc951052454eec9a58b0cd025945b8 (127.5.126.66:34613): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:22:59.320595 14999 leader_election.cc:343] T f0424da0ffb84ba5931fe92f6dd57c5f P a1a22e9119494570b6d2217713fd7e43 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a722e54d227f4c29a9ed6ce77858003a (127.5.126.68:46669): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:59.320829 14883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a71163721b4d48b0b5ff366b9d12ac32" candidate_uuid: "a722e54d227f4c29a9ed6ce77858003a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f3a500981b494979b58d2b1041fec9c8" is_pre_election: true
I20260709 13:22:59.321023 14999 leader_election.cc:304] T f0424da0ffb84ba5931fe92f6dd57c5f P a1a22e9119494570b6d2217713fd7e43 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1a22e9119494570b6d2217713fd7e43; no voters: 0efc951052454eec9a58b0cd025945b8, a722e54d227f4c29a9ed6ce77858003a
I20260709 13:22:59.317281 15153 ts_tablet_manager.cc:1434] T aecef3c240394d54844ec8170e9cad59 P 0efc951052454eec9a58b0cd025945b8: Time spent starting tablet: real 0.024s	user 0.007s	sys 0.000s
I20260709 13:22:59.322773 15153 tablet_bootstrap.cc:492] T f0424da0ffb84ba5931fe92f6dd57c5f P 0efc951052454eec9a58b0cd025945b8: Bootstrap starting.
I20260709 13:22:59.326252 15108 raft_consensus.cc:3060] T a71163721b4d48b0b5ff366b9d12ac32 P a722e54d227f4c29a9ed6ce77858003a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:59.339489 14960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a71163721b4d48b0b5ff366b9d12ac32" candidate_uuid: "a722e54d227f4c29a9ed6ce77858003a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0efc951052454eec9a58b0cd025945b8" is_pre_election: true
I20260709 13:22:59.340402 15156 tablet_bootstrap.cc:654] T f954c6c25a25443abd9705c8e909bf47 P f3a500981b494979b58d2b1041fec9c8: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:59.337852 15258 consensus_queue.cc:1048] T 46ed2e9dd1324ac4a6e07f813cfebb7e P f3a500981b494979b58d2b1041fec9c8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.004s
I20260709 13:22:59.342293 15073 leader_election.cc:304] T a71163721b4d48b0b5ff366b9d12ac32 P a722e54d227f4c29a9ed6ce77858003a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a722e54d227f4c29a9ed6ce77858003a; no voters: 0efc951052454eec9a58b0cd025945b8, f3a500981b494979b58d2b1041fec9c8
I20260709 13:22:59.327297 15160 raft_consensus.cc:2749] T f0424da0ffb84ba5931fe92f6dd57c5f P a1a22e9119494570b6d2217713fd7e43 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:22:59.341842 14783 catalog_manager.cc:5697] T e75f8237624f42f793627366f05b792a P 0efc951052454eec9a58b0cd025945b8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0efc951052454eec9a58b0cd025945b8 (127.5.126.66). New cstate: current_term: 1 leader_uuid: "0efc951052454eec9a58b0cd025945b8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } health_report { overall_health: HEALTHY } } }
I20260709 13:22:59.348155 14780 catalog_manager.cc:5697] T 70d027ba81f54eba882756b941186710 P f3a500981b494979b58d2b1041fec9c8 reported cstate change: term changed from 0 to 1, leader changed from <none> to f3a500981b494979b58d2b1041fec9c8 (127.5.126.65). New cstate: current_term: 1 leader_uuid: "f3a500981b494979b58d2b1041fec9c8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } health_report { overall_health: HEALTHY } } }
I20260709 13:22:59.357041 15153 tablet_bootstrap.cc:654] T f0424da0ffb84ba5931fe92f6dd57c5f P 0efc951052454eec9a58b0cd025945b8: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:59.346611 15161 leader_election.cc:290] T a71163721b4d48b0b5ff366b9d12ac32 P a722e54d227f4c29a9ed6ce77858003a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f3a500981b494979b58d2b1041fec9c8 (127.5.126.65:34129), 0efc951052454eec9a58b0cd025945b8 (127.5.126.66:34613)
I20260709 13:22:59.374769 15258 raft_consensus.cc:493] T 7560205f5d324c7d821dff8efe7a6256 P f3a500981b494979b58d2b1041fec9c8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:59.386065 15258 raft_consensus.cc:515] T 7560205f5d324c7d821dff8efe7a6256 P f3a500981b494979b58d2b1041fec9c8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } } peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } } peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } }
I20260709 13:22:59.391754 15161 raft_consensus.cc:493] T 5df7528567fd4291a888bfb37c28dc27 P a722e54d227f4c29a9ed6ce77858003a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:59.392478 15161 raft_consensus.cc:515] T 5df7528567fd4291a888bfb37c28dc27 P a722e54d227f4c29a9ed6ce77858003a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } } peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } } peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } }
I20260709 13:22:59.395020 15258 leader_election.cc:290] T 7560205f5d324c7d821dff8efe7a6256 P f3a500981b494979b58d2b1041fec9c8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0efc951052454eec9a58b0cd025945b8 (127.5.126.66:34613), a1a22e9119494570b6d2217713fd7e43 (127.5.126.67:38125)
I20260709 13:22:59.397061 14883 raft_consensus.cc:3060] T 7560205f5d324c7d821dff8efe7a6256 P f3a500981b494979b58d2b1041fec9c8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:59.397421 14884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df7528567fd4291a888bfb37c28dc27" candidate_uuid: "a722e54d227f4c29a9ed6ce77858003a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f3a500981b494979b58d2b1041fec9c8" is_pre_election: true
I20260709 13:22:59.398375 15032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7560205f5d324c7d821dff8efe7a6256" candidate_uuid: "f3a500981b494979b58d2b1041fec9c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1a22e9119494570b6d2217713fd7e43" is_pre_election: true
I20260709 13:22:59.395951 14960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7560205f5d324c7d821dff8efe7a6256" candidate_uuid: "f3a500981b494979b58d2b1041fec9c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0efc951052454eec9a58b0cd025945b8" is_pre_election: true
I20260709 13:22:59.401927 14850 leader_election.cc:304] T 7560205f5d324c7d821dff8efe7a6256 P f3a500981b494979b58d2b1041fec9c8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f3a500981b494979b58d2b1041fec9c8; no voters: 0efc951052454eec9a58b0cd025945b8, a1a22e9119494570b6d2217713fd7e43
I20260709 13:22:59.396155 15034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df7528567fd4291a888bfb37c28dc27" candidate_uuid: "a722e54d227f4c29a9ed6ce77858003a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1a22e9119494570b6d2217713fd7e43" is_pre_election: true
I20260709 13:22:59.404486 15072 leader_election.cc:304] T 5df7528567fd4291a888bfb37c28dc27 P a722e54d227f4c29a9ed6ce77858003a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a722e54d227f4c29a9ed6ce77858003a; no voters: a1a22e9119494570b6d2217713fd7e43, f3a500981b494979b58d2b1041fec9c8
I20260709 13:22:59.404650 15224 consensus_queue.cc:1048] T 5cd72bf3a0114fddb1bda8271debea24 P a1a22e9119494570b6d2217713fd7e43 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:22:59.405499 15213 raft_consensus.cc:2749] T 5df7528567fd4291a888bfb37c28dc27 P a722e54d227f4c29a9ed6ce77858003a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:22:59.410338 15161 leader_election.cc:290] T 5df7528567fd4291a888bfb37c28dc27 P a722e54d227f4c29a9ed6ce77858003a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a1a22e9119494570b6d2217713fd7e43 (127.5.126.67:38125), f3a500981b494979b58d2b1041fec9c8 (127.5.126.65:34129)
I20260709 13:22:59.414693 15155 tablet_bootstrap.cc:654] T 74a144396e4443288858878b63f08cc8 P a1a22e9119494570b6d2217713fd7e43: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:59.423720 15153 tablet_bootstrap.cc:492] T f0424da0ffb84ba5931fe92f6dd57c5f P 0efc951052454eec9a58b0cd025945b8: No bootstrap required, opened a new log
I20260709 13:22:59.426914 15153 ts_tablet_manager.cc:1403] T f0424da0ffb84ba5931fe92f6dd57c5f P 0efc951052454eec9a58b0cd025945b8: Time spent bootstrapping tablet: real 0.104s	user 0.019s	sys 0.008s
I20260709 13:22:59.431288 15224 consensus_queue.cc:1048] T 5cd72bf3a0114fddb1bda8271debea24 P a1a22e9119494570b6d2217713fd7e43 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:22:59.427345 15154 tablet_bootstrap.cc:492] T e85432ede09747339c957cdaa7d15ac6 P a722e54d227f4c29a9ed6ce77858003a: No bootstrap required, opened a new log
I20260709 13:22:59.432524 15154 ts_tablet_manager.cc:1403] T e85432ede09747339c957cdaa7d15ac6 P a722e54d227f4c29a9ed6ce77858003a: Time spent bootstrapping tablet: real 0.217s	user 0.009s	sys 0.008s
I20260709 13:22:59.431169 15282 raft_consensus.cc:2749] T a71163721b4d48b0b5ff366b9d12ac32 P a722e54d227f4c29a9ed6ce77858003a [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:22:59.431792 15156 tablet_bootstrap.cc:492] T f954c6c25a25443abd9705c8e909bf47 P f3a500981b494979b58d2b1041fec9c8: No bootstrap required, opened a new log
I20260709 13:22:59.436508 15156 ts_tablet_manager.cc:1403] T f954c6c25a25443abd9705c8e909bf47 P f3a500981b494979b58d2b1041fec9c8: Time spent bootstrapping tablet: real 0.166s	user 0.020s	sys 0.010s
I20260709 13:22:59.438851 15258 raft_consensus.cc:2749] T 7560205f5d324c7d821dff8efe7a6256 P f3a500981b494979b58d2b1041fec9c8 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:22:59.451912 15154 raft_consensus.cc:359] T e85432ede09747339c957cdaa7d15ac6 P a722e54d227f4c29a9ed6ce77858003a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } } peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } } peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } }
I20260709 13:22:59.452839 15154 raft_consensus.cc:385] T e85432ede09747339c957cdaa7d15ac6 P a722e54d227f4c29a9ed6ce77858003a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:59.453140 15154 raft_consensus.cc:740] T e85432ede09747339c957cdaa7d15ac6 P a722e54d227f4c29a9ed6ce77858003a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a722e54d227f4c29a9ed6ce77858003a, State: Initialized, Role: FOLLOWER
I20260709 13:22:59.452943 15156 raft_consensus.cc:359] T f954c6c25a25443abd9705c8e909bf47 P f3a500981b494979b58d2b1041fec9c8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } } peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } } peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } }
I20260709 13:22:59.453928 15154 consensus_queue.cc:260] T e85432ede09747339c957cdaa7d15ac6 P a722e54d227f4c29a9ed6ce77858003a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } } peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } } peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } }
I20260709 13:22:59.453899 15156 raft_consensus.cc:385] T f954c6c25a25443abd9705c8e909bf47 P f3a500981b494979b58d2b1041fec9c8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:59.455029 15156 raft_consensus.cc:740] T f954c6c25a25443abd9705c8e909bf47 P f3a500981b494979b58d2b1041fec9c8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f3a500981b494979b58d2b1041fec9c8, State: Initialized, Role: FOLLOWER
I20260709 13:22:59.456580 15153 raft_consensus.cc:359] T f0424da0ffb84ba5931fe92f6dd57c5f P 0efc951052454eec9a58b0cd025945b8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } } peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } } peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } }
I20260709 13:22:59.457279 15153 raft_consensus.cc:385] T f0424da0ffb84ba5931fe92f6dd57c5f P 0efc951052454eec9a58b0cd025945b8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:59.455739 15156 consensus_queue.cc:260] T f954c6c25a25443abd9705c8e909bf47 P f3a500981b494979b58d2b1041fec9c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } } peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } } peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } }
I20260709 13:22:59.457540 15153 raft_consensus.cc:740] T f0424da0ffb84ba5931fe92f6dd57c5f P 0efc951052454eec9a58b0cd025945b8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0efc951052454eec9a58b0cd025945b8, State: Initialized, Role: FOLLOWER
I20260709 13:22:59.458411 15153 consensus_queue.cc:260] T f0424da0ffb84ba5931fe92f6dd57c5f P 0efc951052454eec9a58b0cd025945b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } } peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } } peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } }
I20260709 13:22:59.459306 15156 ts_tablet_manager.cc:1434] T f954c6c25a25443abd9705c8e909bf47 P f3a500981b494979b58d2b1041fec9c8: Time spent starting tablet: real 0.022s	user 0.009s	sys 0.003s
I20260709 13:22:59.460438 15156 tablet_bootstrap.cc:492] T 74a144396e4443288858878b63f08cc8 P f3a500981b494979b58d2b1041fec9c8: Bootstrap starting.
I20260709 13:22:59.460474 15153 ts_tablet_manager.cc:1434] T f0424da0ffb84ba5931fe92f6dd57c5f P 0efc951052454eec9a58b0cd025945b8: Time spent starting tablet: real 0.029s	user 0.006s	sys 0.000s
I20260709 13:22:59.461688 15153 tablet_bootstrap.cc:492] T b025139466084200b70879196cd3f922 P 0efc951052454eec9a58b0cd025945b8: Bootstrap starting.
I20260709 13:22:59.463564 14780 catalog_manager.cc:5697] T e85432ede09747339c957cdaa7d15ac6 P f3a500981b494979b58d2b1041fec9c8 reported cstate change: term changed from 0 to 1, leader changed from <none> to f3a500981b494979b58d2b1041fec9c8 (127.5.126.65). New cstate: current_term: 1 leader_uuid: "f3a500981b494979b58d2b1041fec9c8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } health_report { overall_health: HEALTHY } } }
I20260709 13:22:59.471700 15163 consensus_queue.cc:1048] T 7560205f5d324c7d821dff8efe7a6256 P 0efc951052454eec9a58b0cd025945b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:22:59.472856 15154 ts_tablet_manager.cc:1434] T e85432ede09747339c957cdaa7d15ac6 P a722e54d227f4c29a9ed6ce77858003a: Time spent starting tablet: real 0.036s	user 0.006s	sys 0.001s
I20260709 13:22:59.473912 15154 tablet_bootstrap.cc:492] T 7b8e0fe5ef6d4c42b9854399aac3a1d6 P a722e54d227f4c29a9ed6ce77858003a: Bootstrap starting.
I20260709 13:22:59.488902 15153 tablet_bootstrap.cc:654] T b025139466084200b70879196cd3f922 P 0efc951052454eec9a58b0cd025945b8: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:59.492224 15154 tablet_bootstrap.cc:654] T 7b8e0fe5ef6d4c42b9854399aac3a1d6 P a722e54d227f4c29a9ed6ce77858003a: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:59.499061 15155 tablet_bootstrap.cc:492] T 74a144396e4443288858878b63f08cc8 P a1a22e9119494570b6d2217713fd7e43: No bootstrap required, opened a new log
I20260709 13:22:59.499644 15155 ts_tablet_manager.cc:1403] T 74a144396e4443288858878b63f08cc8 P a1a22e9119494570b6d2217713fd7e43: Time spent bootstrapping tablet: real 0.205s	user 0.020s	sys 0.008s
I20260709 13:22:59.504531 15163 raft_consensus.cc:493] T f0424da0ffb84ba5931fe92f6dd57c5f P 0efc951052454eec9a58b0cd025945b8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:59.505350 15163 raft_consensus.cc:515] T f0424da0ffb84ba5931fe92f6dd57c5f P 0efc951052454eec9a58b0cd025945b8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } } peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } } peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } }
I20260709 13:22:59.506448 15153 tablet_bootstrap.cc:492] T b025139466084200b70879196cd3f922 P 0efc951052454eec9a58b0cd025945b8: No bootstrap required, opened a new log
I20260709 13:22:59.507076 15153 ts_tablet_manager.cc:1403] T b025139466084200b70879196cd3f922 P 0efc951052454eec9a58b0cd025945b8: Time spent bootstrapping tablet: real 0.046s	user 0.012s	sys 0.002s
I20260709 13:22:59.509039 15033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0424da0ffb84ba5931fe92f6dd57c5f" candidate_uuid: "0efc951052454eec9a58b0cd025945b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1a22e9119494570b6d2217713fd7e43" is_pre_election: true
I20260709 13:22:59.509801 15033 raft_consensus.cc:2468] T f0424da0ffb84ba5931fe92f6dd57c5f P a1a22e9119494570b6d2217713fd7e43 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0efc951052454eec9a58b0cd025945b8 in term 0.
I20260709 13:22:59.510249 15153 raft_consensus.cc:359] T b025139466084200b70879196cd3f922 P 0efc951052454eec9a58b0cd025945b8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } } peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } } peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } }
I20260709 13:22:59.511070 15153 raft_consensus.cc:385] T b025139466084200b70879196cd3f922 P 0efc951052454eec9a58b0cd025945b8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:59.511396 15153 raft_consensus.cc:740] T b025139466084200b70879196cd3f922 P 0efc951052454eec9a58b0cd025945b8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0efc951052454eec9a58b0cd025945b8, State: Initialized, Role: FOLLOWER
I20260709 13:22:59.511607 15155 raft_consensus.cc:359] T 74a144396e4443288858878b63f08cc8 P a1a22e9119494570b6d2217713fd7e43 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } } peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } } peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } }
I20260709 13:22:59.511794 14924 leader_election.cc:304] T f0424da0ffb84ba5931fe92f6dd57c5f P 0efc951052454eec9a58b0cd025945b8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0efc951052454eec9a58b0cd025945b8, a1a22e9119494570b6d2217713fd7e43; no voters: 
I20260709 13:22:59.512689 15156 tablet_bootstrap.cc:654] T 74a144396e4443288858878b63f08cc8 P f3a500981b494979b58d2b1041fec9c8: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:59.512195 15153 consensus_queue.cc:260] T b025139466084200b70879196cd3f922 P 0efc951052454eec9a58b0cd025945b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } } peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } } peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } }
I20260709 13:22:59.512923 15220 raft_consensus.cc:2804] T f0424da0ffb84ba5931fe92f6dd57c5f P 0efc951052454eec9a58b0cd025945b8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:22:59.513406 15220 raft_consensus.cc:493] T f0424da0ffb84ba5931fe92f6dd57c5f P 0efc951052454eec9a58b0cd025945b8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:22:59.513762 15220 raft_consensus.cc:3060] T f0424da0ffb84ba5931fe92f6dd57c5f P 0efc951052454eec9a58b0cd025945b8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:59.514963 15153 ts_tablet_manager.cc:1434] T b025139466084200b70879196cd3f922 P 0efc951052454eec9a58b0cd025945b8: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:22:59.512372 15155 raft_consensus.cc:385] T 74a144396e4443288858878b63f08cc8 P a1a22e9119494570b6d2217713fd7e43 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:59.515965 15155 raft_consensus.cc:740] T 74a144396e4443288858878b63f08cc8 P a1a22e9119494570b6d2217713fd7e43 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a1a22e9119494570b6d2217713fd7e43, State: Initialized, Role: FOLLOWER
I20260709 13:22:59.516177 15153 tablet_bootstrap.cc:492] T ced632bda66e4a74b9c854befbcbac9b P 0efc951052454eec9a58b0cd025945b8: Bootstrap starting.
I20260709 13:22:59.516948 15155 consensus_queue.cc:260] T 74a144396e4443288858878b63f08cc8 P a1a22e9119494570b6d2217713fd7e43 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } } peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } } peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } }
I20260709 13:22:59.519433 15155 ts_tablet_manager.cc:1434] T 74a144396e4443288858878b63f08cc8 P a1a22e9119494570b6d2217713fd7e43: Time spent starting tablet: real 0.019s	user 0.008s	sys 0.000s
I20260709 13:22:59.522929 15155 tablet_bootstrap.cc:492] T dadd194761924530aede05672c9eecf9 P a1a22e9119494570b6d2217713fd7e43: Bootstrap starting.
I20260709 13:22:59.523223 15153 tablet_bootstrap.cc:654] T ced632bda66e4a74b9c854befbcbac9b P 0efc951052454eec9a58b0cd025945b8: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:59.524221 15282 consensus_queue.cc:1048] T 268027ae94a54cf4acf51c54c7b9032b P a722e54d227f4c29a9ed6ce77858003a [LEADER]: Connected to new peer: Peer: permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:22:59.532348 15154 tablet_bootstrap.cc:492] T 7b8e0fe5ef6d4c42b9854399aac3a1d6 P a722e54d227f4c29a9ed6ce77858003a: No bootstrap required, opened a new log
I20260709 13:22:59.538266 15155 tablet_bootstrap.cc:654] T dadd194761924530aede05672c9eecf9 P a1a22e9119494570b6d2217713fd7e43: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:59.538769 15154 ts_tablet_manager.cc:1403] T 7b8e0fe5ef6d4c42b9854399aac3a1d6 P a722e54d227f4c29a9ed6ce77858003a: Time spent bootstrapping tablet: real 0.065s	user 0.015s	sys 0.000s
I20260709 13:22:59.541668 15154 raft_consensus.cc:359] T 7b8e0fe5ef6d4c42b9854399aac3a1d6 P a722e54d227f4c29a9ed6ce77858003a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } } peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } } peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } }
I20260709 13:22:59.542364 15154 raft_consensus.cc:385] T 7b8e0fe5ef6d4c42b9854399aac3a1d6 P a722e54d227f4c29a9ed6ce77858003a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:59.542661 15154 raft_consensus.cc:740] T 7b8e0fe5ef6d4c42b9854399aac3a1d6 P a722e54d227f4c29a9ed6ce77858003a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a722e54d227f4c29a9ed6ce77858003a, State: Initialized, Role: FOLLOWER
I20260709 13:22:59.543342 15154 consensus_queue.cc:260] T 7b8e0fe5ef6d4c42b9854399aac3a1d6 P a722e54d227f4c29a9ed6ce77858003a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } } peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } } peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } }
I20260709 13:22:59.533929 15163 leader_election.cc:290] T f0424da0ffb84ba5931fe92f6dd57c5f P 0efc951052454eec9a58b0cd025945b8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a1a22e9119494570b6d2217713fd7e43 (127.5.126.67:38125), a722e54d227f4c29a9ed6ce77858003a (127.5.126.68:46669)
I20260709 13:22:59.535483 15108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0424da0ffb84ba5931fe92f6dd57c5f" candidate_uuid: "0efc951052454eec9a58b0cd025945b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a722e54d227f4c29a9ed6ce77858003a" is_pre_election: true
I20260709 13:22:59.544719 15161 raft_consensus.cc:493] T 7b8e0fe5ef6d4c42b9854399aac3a1d6 P a722e54d227f4c29a9ed6ce77858003a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:59.545183 15161 raft_consensus.cc:515] T 7b8e0fe5ef6d4c42b9854399aac3a1d6 P a722e54d227f4c29a9ed6ce77858003a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } } peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } } peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } }
W20260709 13:22:59.545639 14925 leader_election.cc:343] T f0424da0ffb84ba5931fe92f6dd57c5f P 0efc951052454eec9a58b0cd025945b8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a722e54d227f4c29a9ed6ce77858003a (127.5.126.68:46669): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:59.548277 15033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b8e0fe5ef6d4c42b9854399aac3a1d6" candidate_uuid: "a722e54d227f4c29a9ed6ce77858003a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1a22e9119494570b6d2217713fd7e43" is_pre_election: true
W20260709 13:22:59.549795 15072 leader_election.cc:343] T 7b8e0fe5ef6d4c42b9854399aac3a1d6 P a722e54d227f4c29a9ed6ce77858003a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a1a22e9119494570b6d2217713fd7e43 (127.5.126.67:38125): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:59.550951 14959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b8e0fe5ef6d4c42b9854399aac3a1d6" candidate_uuid: "a722e54d227f4c29a9ed6ce77858003a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0efc951052454eec9a58b0cd025945b8" is_pre_election: true
I20260709 13:22:59.552470 15163 raft_consensus.cc:493] T aecef3c240394d54844ec8170e9cad59 P 0efc951052454eec9a58b0cd025945b8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:59.553038 15163 raft_consensus.cc:515] T aecef3c240394d54844ec8170e9cad59 P 0efc951052454eec9a58b0cd025945b8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } } peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } } peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } }
I20260709 13:22:59.555154 15163 leader_election.cc:290] T aecef3c240394d54844ec8170e9cad59 P 0efc951052454eec9a58b0cd025945b8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a722e54d227f4c29a9ed6ce77858003a (127.5.126.68:46669), f3a500981b494979b58d2b1041fec9c8 (127.5.126.65:34129)
I20260709 13:22:59.556016 15161 leader_election.cc:290] T 7b8e0fe5ef6d4c42b9854399aac3a1d6 P a722e54d227f4c29a9ed6ce77858003a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0efc951052454eec9a58b0cd025945b8 (127.5.126.66:34613), a1a22e9119494570b6d2217713fd7e43 (127.5.126.67:38125)
I20260709 13:22:59.556957 15108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aecef3c240394d54844ec8170e9cad59" candidate_uuid: "0efc951052454eec9a58b0cd025945b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a722e54d227f4c29a9ed6ce77858003a" is_pre_election: true
I20260709 13:22:59.559305 14884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aecef3c240394d54844ec8170e9cad59" candidate_uuid: "0efc951052454eec9a58b0cd025945b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f3a500981b494979b58d2b1041fec9c8" is_pre_election: true
W20260709 13:22:59.562326 14925 leader_election.cc:343] T aecef3c240394d54844ec8170e9cad59 P 0efc951052454eec9a58b0cd025945b8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f3a500981b494979b58d2b1041fec9c8 (127.5.126.65:34129): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:22:59.563246 14925 leader_election.cc:343] T aecef3c240394d54844ec8170e9cad59 P 0efc951052454eec9a58b0cd025945b8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a722e54d227f4c29a9ed6ce77858003a (127.5.126.68:46669): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:59.563781 14925 leader_election.cc:304] T aecef3c240394d54844ec8170e9cad59 P 0efc951052454eec9a58b0cd025945b8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0efc951052454eec9a58b0cd025945b8; no voters: a722e54d227f4c29a9ed6ce77858003a, f3a500981b494979b58d2b1041fec9c8
W20260709 13:22:59.563257 15073 leader_election.cc:343] T 7b8e0fe5ef6d4c42b9854399aac3a1d6 P a722e54d227f4c29a9ed6ce77858003a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0efc951052454eec9a58b0cd025945b8 (127.5.126.66:34613): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:59.566677 15073 leader_election.cc:304] T 7b8e0fe5ef6d4c42b9854399aac3a1d6 P a722e54d227f4c29a9ed6ce77858003a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a722e54d227f4c29a9ed6ce77858003a; no voters: 0efc951052454eec9a58b0cd025945b8, a1a22e9119494570b6d2217713fd7e43
I20260709 13:22:59.568157 15282 raft_consensus.cc:2749] T 7b8e0fe5ef6d4c42b9854399aac3a1d6 P a722e54d227f4c29a9ed6ce77858003a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:22:59.568965 15073 consensus_peers.cc:597] T 268027ae94a54cf4acf51c54c7b9032b P a722e54d227f4c29a9ed6ce77858003a -> Peer f3a500981b494979b58d2b1041fec9c8 (127.5.126.65:34129): Couldn't send request to peer f3a500981b494979b58d2b1041fec9c8. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:22:59.572299 15211 raft_consensus.cc:2749] T aecef3c240394d54844ec8170e9cad59 P 0efc951052454eec9a58b0cd025945b8 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:22:59.578320 15108 raft_consensus.cc:3060] T 5df7528567fd4291a888bfb37c28dc27 P a722e54d227f4c29a9ed6ce77858003a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:59.580469 15220 raft_consensus.cc:515] T f0424da0ffb84ba5931fe92f6dd57c5f P 0efc951052454eec9a58b0cd025945b8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } } peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } } peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } }
I20260709 13:22:59.583415 15033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0424da0ffb84ba5931fe92f6dd57c5f" candidate_uuid: "0efc951052454eec9a58b0cd025945b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1a22e9119494570b6d2217713fd7e43"
I20260709 13:22:59.584088 15033 raft_consensus.cc:3060] T f0424da0ffb84ba5931fe92f6dd57c5f P a1a22e9119494570b6d2217713fd7e43 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:59.595276 15033 raft_consensus.cc:2468] T f0424da0ffb84ba5931fe92f6dd57c5f P a1a22e9119494570b6d2217713fd7e43 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0efc951052454eec9a58b0cd025945b8 in term 1.
I20260709 13:22:59.596557 14924 leader_election.cc:304] T f0424da0ffb84ba5931fe92f6dd57c5f P 0efc951052454eec9a58b0cd025945b8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0efc951052454eec9a58b0cd025945b8, a1a22e9119494570b6d2217713fd7e43; no voters: 
I20260709 13:22:59.597465 15211 raft_consensus.cc:2804] T f0424da0ffb84ba5931fe92f6dd57c5f P 0efc951052454eec9a58b0cd025945b8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:22:59.597606 15154 ts_tablet_manager.cc:1434] T 7b8e0fe5ef6d4c42b9854399aac3a1d6 P a722e54d227f4c29a9ed6ce77858003a: Time spent starting tablet: real 0.058s	user 0.006s	sys 0.000s
I20260709 13:22:59.598011 15211 raft_consensus.cc:697] T f0424da0ffb84ba5931fe92f6dd57c5f P 0efc951052454eec9a58b0cd025945b8 [term 1 LEADER]: Becoming Leader. State: Replica: 0efc951052454eec9a58b0cd025945b8, State: Running, Role: LEADER
I20260709 13:22:59.598716 15154 tablet_bootstrap.cc:492] T 0819f8999271428481a1f839026171a7 P a722e54d227f4c29a9ed6ce77858003a: Bootstrap starting.
I20260709 13:22:59.598927 15211 consensus_queue.cc:237] T f0424da0ffb84ba5931fe92f6dd57c5f P 0efc951052454eec9a58b0cd025945b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } } peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } } peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } }
I20260709 13:22:59.600746 15220 leader_election.cc:290] T f0424da0ffb84ba5931fe92f6dd57c5f P 0efc951052454eec9a58b0cd025945b8 [CANDIDATE]: Term 1 election: Requested vote from peers a1a22e9119494570b6d2217713fd7e43 (127.5.126.67:38125), a722e54d227f4c29a9ed6ce77858003a (127.5.126.68:46669)
I20260709 13:22:59.597620 15155 tablet_bootstrap.cc:492] T dadd194761924530aede05672c9eecf9 P a1a22e9119494570b6d2217713fd7e43: No bootstrap required, opened a new log
I20260709 13:22:59.601743 15155 ts_tablet_manager.cc:1403] T dadd194761924530aede05672c9eecf9 P a1a22e9119494570b6d2217713fd7e43: Time spent bootstrapping tablet: real 0.079s	user 0.023s	sys 0.001s
I20260709 13:22:59.604532 15155 raft_consensus.cc:359] T dadd194761924530aede05672c9eecf9 P a1a22e9119494570b6d2217713fd7e43 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } } peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } } peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } }
I20260709 13:22:59.605166 15155 raft_consensus.cc:385] T dadd194761924530aede05672c9eecf9 P a1a22e9119494570b6d2217713fd7e43 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:59.605432 15155 raft_consensus.cc:740] T dadd194761924530aede05672c9eecf9 P a1a22e9119494570b6d2217713fd7e43 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a1a22e9119494570b6d2217713fd7e43, State: Initialized, Role: FOLLOWER
I20260709 13:22:59.606086 15155 consensus_queue.cc:260] T dadd194761924530aede05672c9eecf9 P a1a22e9119494570b6d2217713fd7e43 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } } peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } } peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } }
I20260709 13:22:59.606349 15106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0424da0ffb84ba5931fe92f6dd57c5f" candidate_uuid: "0efc951052454eec9a58b0cd025945b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a722e54d227f4c29a9ed6ce77858003a"
W20260709 13:22:59.608542 14925 leader_election.cc:343] T f0424da0ffb84ba5931fe92f6dd57c5f P 0efc951052454eec9a58b0cd025945b8 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer a722e54d227f4c29a9ed6ce77858003a (127.5.126.68:46669): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:59.612818 15154 tablet_bootstrap.cc:654] T 0819f8999271428481a1f839026171a7 P a722e54d227f4c29a9ed6ce77858003a: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:59.618250 15156 tablet_bootstrap.cc:492] T 74a144396e4443288858878b63f08cc8 P f3a500981b494979b58d2b1041fec9c8: No bootstrap required, opened a new log
I20260709 13:22:59.618956 15156 ts_tablet_manager.cc:1403] T 74a144396e4443288858878b63f08cc8 P f3a500981b494979b58d2b1041fec9c8: Time spent bootstrapping tablet: real 0.159s	user 0.020s	sys 0.014s
I20260709 13:22:59.632593 15155 ts_tablet_manager.cc:1434] T dadd194761924530aede05672c9eecf9 P a1a22e9119494570b6d2217713fd7e43: Time spent starting tablet: real 0.031s	user 0.006s	sys 0.001s
I20260709 13:22:59.634090 15155 tablet_bootstrap.cc:492] T 0819f8999271428481a1f839026171a7 P a1a22e9119494570b6d2217713fd7e43: Bootstrap starting.
I20260709 13:22:59.642822 15155 tablet_bootstrap.cc:654] T 0819f8999271428481a1f839026171a7 P a1a22e9119494570b6d2217713fd7e43: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:59.648659 15156 raft_consensus.cc:359] T 74a144396e4443288858878b63f08cc8 P f3a500981b494979b58d2b1041fec9c8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } } peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } } peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } }
I20260709 13:22:59.656821 15156 raft_consensus.cc:385] T 74a144396e4443288858878b63f08cc8 P f3a500981b494979b58d2b1041fec9c8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:59.657346 15156 raft_consensus.cc:740] T 74a144396e4443288858878b63f08cc8 P f3a500981b494979b58d2b1041fec9c8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f3a500981b494979b58d2b1041fec9c8, State: Initialized, Role: FOLLOWER
I20260709 13:22:59.664878 15156 consensus_queue.cc:260] T 74a144396e4443288858878b63f08cc8 P f3a500981b494979b58d2b1041fec9c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } } peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } } peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } }
I20260709 13:22:59.673122 15156 ts_tablet_manager.cc:1434] T 74a144396e4443288858878b63f08cc8 P f3a500981b494979b58d2b1041fec9c8: Time spent starting tablet: real 0.054s	user 0.012s	sys 0.000s
I20260709 13:22:59.674803 15156 tablet_bootstrap.cc:492] T dadd194761924530aede05672c9eecf9 P f3a500981b494979b58d2b1041fec9c8: Bootstrap starting.
I20260709 13:22:59.676530 15153 tablet_bootstrap.cc:492] T ced632bda66e4a74b9c854befbcbac9b P 0efc951052454eec9a58b0cd025945b8: No bootstrap required, opened a new log
I20260709 13:22:59.677125 15153 ts_tablet_manager.cc:1403] T ced632bda66e4a74b9c854befbcbac9b P 0efc951052454eec9a58b0cd025945b8: Time spent bootstrapping tablet: real 0.161s	user 0.036s	sys 0.051s
I20260709 13:22:59.668448 14782 catalog_manager.cc:5697] T f0424da0ffb84ba5931fe92f6dd57c5f P 0efc951052454eec9a58b0cd025945b8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0efc951052454eec9a58b0cd025945b8 (127.5.126.66). New cstate: current_term: 1 leader_uuid: "0efc951052454eec9a58b0cd025945b8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } health_report { overall_health: UNKNOWN } } }
I20260709 13:22:59.680927 15153 raft_consensus.cc:359] T ced632bda66e4a74b9c854befbcbac9b P 0efc951052454eec9a58b0cd025945b8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } } peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } } peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } }
I20260709 13:22:59.681790 15156 tablet_bootstrap.cc:654] T dadd194761924530aede05672c9eecf9 P f3a500981b494979b58d2b1041fec9c8: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:59.681764 15153 raft_consensus.cc:385] T ced632bda66e4a74b9c854befbcbac9b P 0efc951052454eec9a58b0cd025945b8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:59.682366 15153 raft_consensus.cc:740] T ced632bda66e4a74b9c854befbcbac9b P 0efc951052454eec9a58b0cd025945b8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0efc951052454eec9a58b0cd025945b8, State: Initialized, Role: FOLLOWER
I20260709 13:22:59.683235 15153 consensus_queue.cc:260] T ced632bda66e4a74b9c854befbcbac9b P 0efc951052454eec9a58b0cd025945b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } } peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } } peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } }
I20260709 13:22:59.688004 15153 ts_tablet_manager.cc:1434] T ced632bda66e4a74b9c854befbcbac9b P 0efc951052454eec9a58b0cd025945b8: Time spent starting tablet: real 0.011s	user 0.008s	sys 0.000s
I20260709 13:22:59.688517 15155 tablet_bootstrap.cc:492] T 0819f8999271428481a1f839026171a7 P a1a22e9119494570b6d2217713fd7e43: No bootstrap required, opened a new log
I20260709 13:22:59.689059 15155 ts_tablet_manager.cc:1403] T 0819f8999271428481a1f839026171a7 P a1a22e9119494570b6d2217713fd7e43: Time spent bootstrapping tablet: real 0.055s	user 0.014s	sys 0.007s
I20260709 13:22:59.691174 15154 tablet_bootstrap.cc:492] T 0819f8999271428481a1f839026171a7 P a722e54d227f4c29a9ed6ce77858003a: No bootstrap required, opened a new log
I20260709 13:22:59.691915 15154 ts_tablet_manager.cc:1403] T 0819f8999271428481a1f839026171a7 P a722e54d227f4c29a9ed6ce77858003a: Time spent bootstrapping tablet: real 0.093s	user 0.034s	sys 0.013s
I20260709 13:22:59.692749 15211 raft_consensus.cc:493] T ced632bda66e4a74b9c854befbcbac9b P 0efc951052454eec9a58b0cd025945b8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:59.693325 15211 raft_consensus.cc:515] T ced632bda66e4a74b9c854befbcbac9b P 0efc951052454eec9a58b0cd025945b8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } } peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } } peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } }
I20260709 13:22:59.695426 15211 leader_election.cc:290] T ced632bda66e4a74b9c854befbcbac9b P 0efc951052454eec9a58b0cd025945b8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a1a22e9119494570b6d2217713fd7e43 (127.5.126.67:38125), a722e54d227f4c29a9ed6ce77858003a (127.5.126.68:46669)
I20260709 13:22:59.696296 15154 raft_consensus.cc:359] T 0819f8999271428481a1f839026171a7 P a722e54d227f4c29a9ed6ce77858003a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } } peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } } peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } }
I20260709 13:22:59.699146 15108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ced632bda66e4a74b9c854befbcbac9b" candidate_uuid: "0efc951052454eec9a58b0cd025945b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a722e54d227f4c29a9ed6ce77858003a" is_pre_election: true
I20260709 13:22:59.702883 15154 raft_consensus.cc:385] T 0819f8999271428481a1f839026171a7 P a722e54d227f4c29a9ed6ce77858003a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:59.703320 15154 raft_consensus.cc:740] T 0819f8999271428481a1f839026171a7 P a722e54d227f4c29a9ed6ce77858003a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a722e54d227f4c29a9ed6ce77858003a, State: Initialized, Role: FOLLOWER
I20260709 13:22:59.704111 15154 consensus_queue.cc:260] T 0819f8999271428481a1f839026171a7 P a722e54d227f4c29a9ed6ce77858003a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } } peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } } peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } }
W20260709 13:22:59.705070 14925 leader_election.cc:343] T ced632bda66e4a74b9c854befbcbac9b P 0efc951052454eec9a58b0cd025945b8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a722e54d227f4c29a9ed6ce77858003a (127.5.126.68:46669): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:59.699616 15155 raft_consensus.cc:359] T 0819f8999271428481a1f839026171a7 P a1a22e9119494570b6d2217713fd7e43 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } } peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } } peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } }
I20260709 13:22:59.700582 15033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ced632bda66e4a74b9c854befbcbac9b" candidate_uuid: "0efc951052454eec9a58b0cd025945b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1a22e9119494570b6d2217713fd7e43" is_pre_election: true
I20260709 13:22:59.707343 15155 raft_consensus.cc:385] T 0819f8999271428481a1f839026171a7 P a1a22e9119494570b6d2217713fd7e43 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 13:22:59.707746 14924 leader_election.cc:343] T ced632bda66e4a74b9c854befbcbac9b P 0efc951052454eec9a58b0cd025945b8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a1a22e9119494570b6d2217713fd7e43 (127.5.126.67:38125): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:59.707962 15155 raft_consensus.cc:740] T 0819f8999271428481a1f839026171a7 P a1a22e9119494570b6d2217713fd7e43 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a1a22e9119494570b6d2217713fd7e43, State: Initialized, Role: FOLLOWER
I20260709 13:22:59.708393 14924 leader_election.cc:304] T ced632bda66e4a74b9c854befbcbac9b P 0efc951052454eec9a58b0cd025945b8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0efc951052454eec9a58b0cd025945b8; no voters: a1a22e9119494570b6d2217713fd7e43, a722e54d227f4c29a9ed6ce77858003a
I20260709 13:22:59.709525 15155 consensus_queue.cc:260] T 0819f8999271428481a1f839026171a7 P a1a22e9119494570b6d2217713fd7e43 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } } peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } } peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } }
I20260709 13:22:59.701856 15156 tablet_bootstrap.cc:492] T dadd194761924530aede05672c9eecf9 P f3a500981b494979b58d2b1041fec9c8: No bootstrap required, opened a new log
I20260709 13:22:59.701800 15258 consensus_queue.cc:1048] T 70d027ba81f54eba882756b941186710 P f3a500981b494979b58d2b1041fec9c8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:22:59.711453 15282 raft_consensus.cc:493] T 0819f8999271428481a1f839026171a7 P a722e54d227f4c29a9ed6ce77858003a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:59.711985 15282 raft_consensus.cc:515] T 0819f8999271428481a1f839026171a7 P a722e54d227f4c29a9ed6ce77858003a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } } peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } } peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } }
I20260709 13:22:59.713622 15211 raft_consensus.cc:2749] T ced632bda66e4a74b9c854befbcbac9b P 0efc951052454eec9a58b0cd025945b8 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:22:59.714269 15282 leader_election.cc:290] T 0819f8999271428481a1f839026171a7 P a722e54d227f4c29a9ed6ce77858003a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a1a22e9119494570b6d2217713fd7e43 (127.5.126.67:38125), f3a500981b494979b58d2b1041fec9c8 (127.5.126.65:34129)
I20260709 13:22:59.702430 15153 tablet_bootstrap.cc:492] T 74a144396e4443288858878b63f08cc8 P 0efc951052454eec9a58b0cd025945b8: Bootstrap starting.
I20260709 13:22:59.715456 14883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0819f8999271428481a1f839026171a7" candidate_uuid: "a722e54d227f4c29a9ed6ce77858003a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f3a500981b494979b58d2b1041fec9c8" is_pre_election: true
I20260709 13:22:59.716004 15033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0819f8999271428481a1f839026171a7" candidate_uuid: "a722e54d227f4c29a9ed6ce77858003a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1a22e9119494570b6d2217713fd7e43" is_pre_election: true
I20260709 13:22:59.716850 15033 raft_consensus.cc:2468] T 0819f8999271428481a1f839026171a7 P a1a22e9119494570b6d2217713fd7e43 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a722e54d227f4c29a9ed6ce77858003a in term 0.
W20260709 13:22:59.717406 15073 leader_election.cc:343] T 0819f8999271428481a1f839026171a7 P a722e54d227f4c29a9ed6ce77858003a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f3a500981b494979b58d2b1041fec9c8 (127.5.126.65:34129): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:59.719841 15154 ts_tablet_manager.cc:1434] T 0819f8999271428481a1f839026171a7 P a722e54d227f4c29a9ed6ce77858003a: Time spent starting tablet: real 0.027s	user 0.007s	sys 0.000s
I20260709 13:22:59.720333 15072 leader_election.cc:304] T 0819f8999271428481a1f839026171a7 P a722e54d227f4c29a9ed6ce77858003a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a1a22e9119494570b6d2217713fd7e43, a722e54d227f4c29a9ed6ce77858003a; no voters: f3a500981b494979b58d2b1041fec9c8
I20260709 13:22:59.720952 15258 consensus_queue.cc:1048] T 70d027ba81f54eba882756b941186710 P f3a500981b494979b58d2b1041fec9c8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:22:59.722091 15161 raft_consensus.cc:2804] T 0819f8999271428481a1f839026171a7 P a722e54d227f4c29a9ed6ce77858003a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:22:59.722481 15153 tablet_bootstrap.cc:654] T 74a144396e4443288858878b63f08cc8 P 0efc951052454eec9a58b0cd025945b8: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:59.722568 15161 raft_consensus.cc:493] T 0819f8999271428481a1f839026171a7 P a722e54d227f4c29a9ed6ce77858003a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:22:59.723218 15161 raft_consensus.cc:3060] T 0819f8999271428481a1f839026171a7 P a722e54d227f4c29a9ed6ce77858003a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:59.720985 15154 tablet_bootstrap.cc:492] T e429eefef04d433e8f18dfbc0387068d P a722e54d227f4c29a9ed6ce77858003a: Bootstrap starting.
I20260709 13:22:59.730620 15259 consensus_queue.cc:1048] T e85432ede09747339c957cdaa7d15ac6 P f3a500981b494979b58d2b1041fec9c8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:22:59.732632 15156 ts_tablet_manager.cc:1403] T dadd194761924530aede05672c9eecf9 P f3a500981b494979b58d2b1041fec9c8: Time spent bootstrapping tablet: real 0.058s	user 0.019s	sys 0.007s
I20260709 13:22:59.735214 15154 tablet_bootstrap.cc:654] T e429eefef04d433e8f18dfbc0387068d P a722e54d227f4c29a9ed6ce77858003a: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:59.737335 15155 ts_tablet_manager.cc:1434] T 0819f8999271428481a1f839026171a7 P a1a22e9119494570b6d2217713fd7e43: Time spent starting tablet: real 0.048s	user 0.009s	sys 0.000s
I20260709 13:22:59.740101 15156 raft_consensus.cc:359] T dadd194761924530aede05672c9eecf9 P f3a500981b494979b58d2b1041fec9c8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } } peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } } peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } }
I20260709 13:22:59.741133 15156 raft_consensus.cc:385] T dadd194761924530aede05672c9eecf9 P f3a500981b494979b58d2b1041fec9c8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:59.741541 15156 raft_consensus.cc:740] T dadd194761924530aede05672c9eecf9 P f3a500981b494979b58d2b1041fec9c8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f3a500981b494979b58d2b1041fec9c8, State: Initialized, Role: FOLLOWER
I20260709 13:22:59.742573 15155 tablet_bootstrap.cc:492] T 7b8e0fe5ef6d4c42b9854399aac3a1d6 P a1a22e9119494570b6d2217713fd7e43: Bootstrap starting.
I20260709 13:22:59.742527 15156 consensus_queue.cc:260] T dadd194761924530aede05672c9eecf9 P f3a500981b494979b58d2b1041fec9c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } } peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } } peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } }
I20260709 13:22:59.743745 15161 raft_consensus.cc:515] T 0819f8999271428481a1f839026171a7 P a722e54d227f4c29a9ed6ce77858003a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } } peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } } peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } }
I20260709 13:22:59.746623 15156 ts_tablet_manager.cc:1434] T dadd194761924530aede05672c9eecf9 P f3a500981b494979b58d2b1041fec9c8: Time spent starting tablet: real 0.014s	user 0.005s	sys 0.002s
I20260709 13:22:59.753281 15156 tablet_bootstrap.cc:492] T 268027ae94a54cf4acf51c54c7b9032b P f3a500981b494979b58d2b1041fec9c8: Bootstrap starting.
I20260709 13:22:59.764678 15259 raft_consensus.cc:493] T 74a144396e4443288858878b63f08cc8 P f3a500981b494979b58d2b1041fec9c8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:59.765362 15259 raft_consensus.cc:515] T 74a144396e4443288858878b63f08cc8 P f3a500981b494979b58d2b1041fec9c8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } } peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } } peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } }
I20260709 13:22:59.765776 15214 consensus_queue.cc:1048] T e75f8237624f42f793627366f05b792a P 0efc951052454eec9a58b0cd025945b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:22:59.768730 14960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74a144396e4443288858878b63f08cc8" candidate_uuid: "f3a500981b494979b58d2b1041fec9c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0efc951052454eec9a58b0cd025945b8" is_pre_election: true
I20260709 13:22:59.768989 15032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74a144396e4443288858878b63f08cc8" candidate_uuid: "f3a500981b494979b58d2b1041fec9c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1a22e9119494570b6d2217713fd7e43" is_pre_election: true
I20260709 13:22:59.769714 15032 raft_consensus.cc:2468] T 74a144396e4443288858878b63f08cc8 P a1a22e9119494570b6d2217713fd7e43 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f3a500981b494979b58d2b1041fec9c8 in term 0.
I20260709 13:22:59.771134 15156 tablet_bootstrap.cc:654] T 268027ae94a54cf4acf51c54c7b9032b P f3a500981b494979b58d2b1041fec9c8: Neither blocks nor log segments found. Creating new log.
W20260709 13:22:59.770785 14850 leader_election.cc:343] T 74a144396e4443288858878b63f08cc8 P f3a500981b494979b58d2b1041fec9c8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0efc951052454eec9a58b0cd025945b8 (127.5.126.66:34613): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:59.787307 14849 leader_election.cc:304] T 74a144396e4443288858878b63f08cc8 P f3a500981b494979b58d2b1041fec9c8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a1a22e9119494570b6d2217713fd7e43, f3a500981b494979b58d2b1041fec9c8; no voters: 0efc951052454eec9a58b0cd025945b8
I20260709 13:22:59.789988 15260 raft_consensus.cc:2804] T 74a144396e4443288858878b63f08cc8 P f3a500981b494979b58d2b1041fec9c8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:22:59.790431 15260 raft_consensus.cc:493] T 74a144396e4443288858878b63f08cc8 P f3a500981b494979b58d2b1041fec9c8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:22:59.790779 15260 raft_consensus.cc:3060] T 74a144396e4443288858878b63f08cc8 P f3a500981b494979b58d2b1041fec9c8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:59.768762 15259 leader_election.cc:290] T 74a144396e4443288858878b63f08cc8 P f3a500981b494979b58d2b1041fec9c8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0efc951052454eec9a58b0cd025945b8 (127.5.126.66:34613), a1a22e9119494570b6d2217713fd7e43 (127.5.126.67:38125)
I20260709 13:22:59.792809 15258 raft_consensus.cc:493] T f954c6c25a25443abd9705c8e909bf47 P f3a500981b494979b58d2b1041fec9c8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:59.796326 15258 raft_consensus.cc:515] T f954c6c25a25443abd9705c8e909bf47 P f3a500981b494979b58d2b1041fec9c8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } } peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } } peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } }
I20260709 13:22:59.798892 15258 leader_election.cc:290] T f954c6c25a25443abd9705c8e909bf47 P f3a500981b494979b58d2b1041fec9c8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a722e54d227f4c29a9ed6ce77858003a (127.5.126.68:46669), 0efc951052454eec9a58b0cd025945b8 (127.5.126.66:34613)
I20260709 13:22:59.799628 15031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0819f8999271428481a1f839026171a7" candidate_uuid: "a722e54d227f4c29a9ed6ce77858003a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1a22e9119494570b6d2217713fd7e43"
I20260709 13:22:59.800482 15031 raft_consensus.cc:3060] T 0819f8999271428481a1f839026171a7 P a1a22e9119494570b6d2217713fd7e43 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:59.801621 14960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f954c6c25a25443abd9705c8e909bf47" candidate_uuid: "f3a500981b494979b58d2b1041fec9c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0efc951052454eec9a58b0cd025945b8" is_pre_election: true
I20260709 13:22:59.799813 15107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f954c6c25a25443abd9705c8e909bf47" candidate_uuid: "f3a500981b494979b58d2b1041fec9c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a722e54d227f4c29a9ed6ce77858003a" is_pre_election: true
I20260709 13:22:59.803287 15282 raft_consensus.cc:493] T e85432ede09747339c957cdaa7d15ac6 P a722e54d227f4c29a9ed6ce77858003a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:22:59.804399 14850 leader_election.cc:343] T f954c6c25a25443abd9705c8e909bf47 P f3a500981b494979b58d2b1041fec9c8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a722e54d227f4c29a9ed6ce77858003a (127.5.126.68:46669): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:59.804131 15282 raft_consensus.cc:515] T e85432ede09747339c957cdaa7d15ac6 P a722e54d227f4c29a9ed6ce77858003a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } } peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } } peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } }
W20260709 13:22:59.805243 14850 leader_election.cc:343] T f954c6c25a25443abd9705c8e909bf47 P f3a500981b494979b58d2b1041fec9c8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0efc951052454eec9a58b0cd025945b8 (127.5.126.66:34613): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:59.805716 14850 leader_election.cc:304] T f954c6c25a25443abd9705c8e909bf47 P f3a500981b494979b58d2b1041fec9c8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f3a500981b494979b58d2b1041fec9c8; no voters: 0efc951052454eec9a58b0cd025945b8, a722e54d227f4c29a9ed6ce77858003a
I20260709 13:22:59.806979 15258 raft_consensus.cc:2749] T f954c6c25a25443abd9705c8e909bf47 P f3a500981b494979b58d2b1041fec9c8 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:22:59.807729 15282 leader_election.cc:290] T e85432ede09747339c957cdaa7d15ac6 P a722e54d227f4c29a9ed6ce77858003a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a1a22e9119494570b6d2217713fd7e43 (127.5.126.67:38125), f3a500981b494979b58d2b1041fec9c8 (127.5.126.65:34129)
I20260709 13:22:59.808547 15032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e85432ede09747339c957cdaa7d15ac6" candidate_uuid: "a722e54d227f4c29a9ed6ce77858003a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1a22e9119494570b6d2217713fd7e43" is_pre_election: true
I20260709 13:22:59.808569 14883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e85432ede09747339c957cdaa7d15ac6" candidate_uuid: "a722e54d227f4c29a9ed6ce77858003a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f3a500981b494979b58d2b1041fec9c8" is_pre_election: true
I20260709 13:22:59.812440 15072 leader_election.cc:304] T e85432ede09747339c957cdaa7d15ac6 P a722e54d227f4c29a9ed6ce77858003a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a722e54d227f4c29a9ed6ce77858003a; no voters: a1a22e9119494570b6d2217713fd7e43, f3a500981b494979b58d2b1041fec9c8
I20260709 13:22:59.813495 15282 raft_consensus.cc:2749] T e85432ede09747339c957cdaa7d15ac6 P a722e54d227f4c29a9ed6ce77858003a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:22:59.818166 15161 leader_election.cc:290] T 0819f8999271428481a1f839026171a7 P a722e54d227f4c29a9ed6ce77858003a [CANDIDATE]: Term 1 election: Requested vote from peers a1a22e9119494570b6d2217713fd7e43 (127.5.126.67:38125), f3a500981b494979b58d2b1041fec9c8 (127.5.126.65:34129)
I20260709 13:22:59.829761 14883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0819f8999271428481a1f839026171a7" candidate_uuid: "a722e54d227f4c29a9ed6ce77858003a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f3a500981b494979b58d2b1041fec9c8"
I20260709 13:22:59.825435 15214 consensus_queue.cc:1048] T e75f8237624f42f793627366f05b792a P 0efc951052454eec9a58b0cd025945b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.007s
I20260709 13:22:59.835503 15260 raft_consensus.cc:515] T 74a144396e4443288858878b63f08cc8 P f3a500981b494979b58d2b1041fec9c8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } } peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } } peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } }
I20260709 13:22:59.853614 15260 leader_election.cc:290] T 74a144396e4443288858878b63f08cc8 P f3a500981b494979b58d2b1041fec9c8 [CANDIDATE]: Term 1 election: Requested vote from peers 0efc951052454eec9a58b0cd025945b8 (127.5.126.66:34613), a1a22e9119494570b6d2217713fd7e43 (127.5.126.67:38125)
I20260709 13:22:59.855913 15155 tablet_bootstrap.cc:654] T 7b8e0fe5ef6d4c42b9854399aac3a1d6 P a1a22e9119494570b6d2217713fd7e43: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:59.858096 15031 raft_consensus.cc:2468] T 0819f8999271428481a1f839026171a7 P a1a22e9119494570b6d2217713fd7e43 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a722e54d227f4c29a9ed6ce77858003a in term 1.
I20260709 13:22:59.860353 15154 tablet_bootstrap.cc:492] T e429eefef04d433e8f18dfbc0387068d P a722e54d227f4c29a9ed6ce77858003a: No bootstrap required, opened a new log
I20260709 13:22:59.860848 15154 ts_tablet_manager.cc:1403] T e429eefef04d433e8f18dfbc0387068d P a722e54d227f4c29a9ed6ce77858003a: Time spent bootstrapping tablet: real 0.140s	user 0.021s	sys 0.055s
W20260709 13:22:59.843473 15073 leader_election.cc:343] T 0819f8999271428481a1f839026171a7 P a722e54d227f4c29a9ed6ce77858003a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f3a500981b494979b58d2b1041fec9c8 (127.5.126.65:34129): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:59.869052 15153 tablet_bootstrap.cc:492] T 74a144396e4443288858878b63f08cc8 P 0efc951052454eec9a58b0cd025945b8: No bootstrap required, opened a new log
I20260709 13:22:59.869601 15153 ts_tablet_manager.cc:1403] T 74a144396e4443288858878b63f08cc8 P 0efc951052454eec9a58b0cd025945b8: Time spent bootstrapping tablet: real 0.180s	user 0.038s	sys 0.028s
I20260709 13:22:59.870652 15106 raft_consensus.cc:3060] T e85432ede09747339c957cdaa7d15ac6 P a722e54d227f4c29a9ed6ce77858003a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:59.868364 15154 raft_consensus.cc:359] T e429eefef04d433e8f18dfbc0387068d P a722e54d227f4c29a9ed6ce77858003a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } } peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } } peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } }
I20260709 13:22:59.874795 15154 raft_consensus.cc:385] T e429eefef04d433e8f18dfbc0387068d P a722e54d227f4c29a9ed6ce77858003a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:59.874065 14960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74a144396e4443288858878b63f08cc8" candidate_uuid: "f3a500981b494979b58d2b1041fec9c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0efc951052454eec9a58b0cd025945b8"
I20260709 13:22:59.878448 15154 raft_consensus.cc:740] T e429eefef04d433e8f18dfbc0387068d P a722e54d227f4c29a9ed6ce77858003a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a722e54d227f4c29a9ed6ce77858003a, State: Initialized, Role: FOLLOWER
I20260709 13:22:59.879221 15153 raft_consensus.cc:359] T 74a144396e4443288858878b63f08cc8 P 0efc951052454eec9a58b0cd025945b8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } } peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } } peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } }
I20260709 13:22:59.880599 15153 raft_consensus.cc:385] T 74a144396e4443288858878b63f08cc8 P 0efc951052454eec9a58b0cd025945b8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:59.880654 15154 consensus_queue.cc:260] T e429eefef04d433e8f18dfbc0387068d P a722e54d227f4c29a9ed6ce77858003a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } } peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } } peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } }
I20260709 13:22:59.881042 15153 raft_consensus.cc:740] T 74a144396e4443288858878b63f08cc8 P 0efc951052454eec9a58b0cd025945b8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0efc951052454eec9a58b0cd025945b8, State: Initialized, Role: FOLLOWER
I20260709 13:22:59.886667 15072 leader_election.cc:304] T 0819f8999271428481a1f839026171a7 P a722e54d227f4c29a9ed6ce77858003a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a1a22e9119494570b6d2217713fd7e43, a722e54d227f4c29a9ed6ce77858003a; no voters: f3a500981b494979b58d2b1041fec9c8
W20260709 13:22:59.888276 14850 leader_election.cc:343] T 74a144396e4443288858878b63f08cc8 P f3a500981b494979b58d2b1041fec9c8 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 0efc951052454eec9a58b0cd025945b8 (127.5.126.66:34613): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:59.888964 15154 ts_tablet_manager.cc:1434] T e429eefef04d433e8f18dfbc0387068d P a722e54d227f4c29a9ed6ce77858003a: Time spent starting tablet: real 0.028s	user 0.009s	sys 0.000s
I20260709 13:22:59.890686 15282 raft_consensus.cc:2804] T 0819f8999271428481a1f839026171a7 P a722e54d227f4c29a9ed6ce77858003a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:22:59.891287 15282 raft_consensus.cc:697] T 0819f8999271428481a1f839026171a7 P a722e54d227f4c29a9ed6ce77858003a [term 1 LEADER]: Becoming Leader. State: Replica: a722e54d227f4c29a9ed6ce77858003a, State: Running, Role: LEADER
I20260709 13:22:59.892264 15282 consensus_queue.cc:237] T 0819f8999271428481a1f839026171a7 P a722e54d227f4c29a9ed6ce77858003a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } } peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } } peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } }
I20260709 13:22:59.897204 15033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74a144396e4443288858878b63f08cc8" candidate_uuid: "f3a500981b494979b58d2b1041fec9c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1a22e9119494570b6d2217713fd7e43"
I20260709 13:22:59.897971 15033 raft_consensus.cc:3060] T 74a144396e4443288858878b63f08cc8 P a1a22e9119494570b6d2217713fd7e43 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:59.909963 15154 tablet_bootstrap.cc:492] T f954c6c25a25443abd9705c8e909bf47 P a722e54d227f4c29a9ed6ce77858003a: Bootstrap starting.
I20260709 13:22:59.943252 15153 consensus_queue.cc:260] T 74a144396e4443288858878b63f08cc8 P 0efc951052454eec9a58b0cd025945b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } } peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } } peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } }
I20260709 13:22:59.959743 15153 ts_tablet_manager.cc:1434] T 74a144396e4443288858878b63f08cc8 P 0efc951052454eec9a58b0cd025945b8: Time spent starting tablet: real 0.090s	user 0.009s	sys 0.000s
I20260709 13:22:59.962010 15153 tablet_bootstrap.cc:492] T 7b8e0fe5ef6d4c42b9854399aac3a1d6 P 0efc951052454eec9a58b0cd025945b8: Bootstrap starting.
W20260709 13:22:59.944871 15072 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:38125, user_credentials={real_user=slave}} blocked reactor thread for 85439.8us
I20260709 13:22:59.980892 15156 tablet_bootstrap.cc:492] T 268027ae94a54cf4acf51c54c7b9032b P f3a500981b494979b58d2b1041fec9c8: No bootstrap required, opened a new log
I20260709 13:22:59.981575 15156 ts_tablet_manager.cc:1403] T 268027ae94a54cf4acf51c54c7b9032b P f3a500981b494979b58d2b1041fec9c8: Time spent bootstrapping tablet: real 0.229s	user 0.014s	sys 0.013s
I20260709 13:22:59.983189 15211 raft_consensus.cc:493] T b025139466084200b70879196cd3f922 P 0efc951052454eec9a58b0cd025945b8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:59.989645 15211 raft_consensus.cc:515] T b025139466084200b70879196cd3f922 P 0efc951052454eec9a58b0cd025945b8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } } peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } } peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } }
I20260709 13:22:59.997602 15156 raft_consensus.cc:359] T 268027ae94a54cf4acf51c54c7b9032b P f3a500981b494979b58d2b1041fec9c8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } } peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } } peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } }
I20260709 13:22:59.998590 15156 raft_consensus.cc:385] T 268027ae94a54cf4acf51c54c7b9032b P f3a500981b494979b58d2b1041fec9c8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:59.998915 15156 raft_consensus.cc:740] T 268027ae94a54cf4acf51c54c7b9032b P f3a500981b494979b58d2b1041fec9c8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f3a500981b494979b58d2b1041fec9c8, State: Initialized, Role: FOLLOWER
I20260709 13:22:59.999877 15156 consensus_queue.cc:260] T 268027ae94a54cf4acf51c54c7b9032b P f3a500981b494979b58d2b1041fec9c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } } peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } } peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } }
I20260709 13:23:00.002594 15156 ts_tablet_manager.cc:1434] T 268027ae94a54cf4acf51c54c7b9032b P f3a500981b494979b58d2b1041fec9c8: Time spent starting tablet: real 0.021s	user 0.005s	sys 0.001s
I20260709 13:23:00.003418 15211 leader_election.cc:290] T b025139466084200b70879196cd3f922 P 0efc951052454eec9a58b0cd025945b8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f3a500981b494979b58d2b1041fec9c8 (127.5.126.65:34129), a1a22e9119494570b6d2217713fd7e43 (127.5.126.67:38125)
I20260709 13:23:00.003701 15156 tablet_bootstrap.cc:492] T aecef3c240394d54844ec8170e9cad59 P f3a500981b494979b58d2b1041fec9c8: Bootstrap starting.
I20260709 13:23:00.005164 15031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b025139466084200b70879196cd3f922" candidate_uuid: "0efc951052454eec9a58b0cd025945b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1a22e9119494570b6d2217713fd7e43" is_pre_election: true
I20260709 13:23:00.005849 15031 raft_consensus.cc:2468] T b025139466084200b70879196cd3f922 P a1a22e9119494570b6d2217713fd7e43 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0efc951052454eec9a58b0cd025945b8 in term 0.
I20260709 13:23:00.006819 14924 leader_election.cc:304] T b025139466084200b70879196cd3f922 P 0efc951052454eec9a58b0cd025945b8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0efc951052454eec9a58b0cd025945b8, a1a22e9119494570b6d2217713fd7e43; no voters: 
I20260709 13:23:00.007732 15211 raft_consensus.cc:2804] T b025139466084200b70879196cd3f922 P 0efc951052454eec9a58b0cd025945b8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:23:00.008179 15154 tablet_bootstrap.cc:654] T f954c6c25a25443abd9705c8e909bf47 P a722e54d227f4c29a9ed6ce77858003a: Neither blocks nor log segments found. Creating new log.
I20260709 13:23:00.008356 15211 raft_consensus.cc:493] T b025139466084200b70879196cd3f922 P 0efc951052454eec9a58b0cd025945b8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:23:00.008963 15211 raft_consensus.cc:3060] T b025139466084200b70879196cd3f922 P 0efc951052454eec9a58b0cd025945b8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:23:00.016469 15153 tablet_bootstrap.cc:654] T 7b8e0fe5ef6d4c42b9854399aac3a1d6 P 0efc951052454eec9a58b0cd025945b8: Neither blocks nor log segments found. Creating new log.
I20260709 13:23:00.017143 15156 tablet_bootstrap.cc:654] T aecef3c240394d54844ec8170e9cad59 P f3a500981b494979b58d2b1041fec9c8: Neither blocks nor log segments found. Creating new log.
I20260709 13:23:00.018296 15033 raft_consensus.cc:2468] T 74a144396e4443288858878b63f08cc8 P a1a22e9119494570b6d2217713fd7e43 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f3a500981b494979b58d2b1041fec9c8 in term 1.
I20260709 13:23:00.023180 15155 tablet_bootstrap.cc:492] T 7b8e0fe5ef6d4c42b9854399aac3a1d6 P a1a22e9119494570b6d2217713fd7e43: No bootstrap required, opened a new log
I20260709 13:23:00.023806 15155 ts_tablet_manager.cc:1403] T 7b8e0fe5ef6d4c42b9854399aac3a1d6 P a1a22e9119494570b6d2217713fd7e43: Time spent bootstrapping tablet: real 0.281s	user 0.034s	sys 0.024s
I20260709 13:23:00.026310 15155 raft_consensus.cc:359] T 7b8e0fe5ef6d4c42b9854399aac3a1d6 P a1a22e9119494570b6d2217713fd7e43 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } } peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } } peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } }
I20260709 13:23:00.026926 15155 raft_consensus.cc:385] T 7b8e0fe5ef6d4c42b9854399aac3a1d6 P a1a22e9119494570b6d2217713fd7e43 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:23:00.027232 15155 raft_consensus.cc:740] T 7b8e0fe5ef6d4c42b9854399aac3a1d6 P a1a22e9119494570b6d2217713fd7e43 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a1a22e9119494570b6d2217713fd7e43, State: Initialized, Role: FOLLOWER
I20260709 13:23:00.027845 15155 consensus_queue.cc:260] T 7b8e0fe5ef6d4c42b9854399aac3a1d6 P a1a22e9119494570b6d2217713fd7e43 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } } peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } } peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } }
I20260709 13:23:00.030479 15153 tablet_bootstrap.cc:492] T 7b8e0fe5ef6d4c42b9854399aac3a1d6 P 0efc951052454eec9a58b0cd025945b8: No bootstrap required, opened a new log
I20260709 13:23:00.030547 15156 tablet_bootstrap.cc:492] T aecef3c240394d54844ec8170e9cad59 P f3a500981b494979b58d2b1041fec9c8: No bootstrap required, opened a new log
I20260709 13:23:00.027932 15211 raft_consensus.cc:515] T b025139466084200b70879196cd3f922 P 0efc951052454eec9a58b0cd025945b8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } } peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } } peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } }
I20260709 13:23:00.031245 15153 ts_tablet_manager.cc:1403] T 7b8e0fe5ef6d4c42b9854399aac3a1d6 P 0efc951052454eec9a58b0cd025945b8: Time spent bootstrapping tablet: real 0.070s	user 0.019s	sys 0.001s
I20260709 13:23:00.031493 15156 ts_tablet_manager.cc:1403] T aecef3c240394d54844ec8170e9cad59 P f3a500981b494979b58d2b1041fec9c8: Time spent bootstrapping tablet: real 0.028s	user 0.002s	sys 0.010s
I20260709 13:23:00.032903 15154 tablet_bootstrap.cc:492] T f954c6c25a25443abd9705c8e909bf47 P a722e54d227f4c29a9ed6ce77858003a: No bootstrap required, opened a new log
I20260709 13:23:00.032889 15211 leader_election.cc:290] T b025139466084200b70879196cd3f922 P 0efc951052454eec9a58b0cd025945b8 [CANDIDATE]: Term 1 election: Requested vote from peers f3a500981b494979b58d2b1041fec9c8 (127.5.126.65:34129), a1a22e9119494570b6d2217713fd7e43 (127.5.126.67:38125)
I20260709 13:23:00.033777 15154 ts_tablet_manager.cc:1403] T f954c6c25a25443abd9705c8e909bf47 P a722e54d227f4c29a9ed6ce77858003a: Time spent bootstrapping tablet: real 0.124s	user 0.010s	sys 0.008s
I20260709 13:23:00.030781 15155 ts_tablet_manager.cc:1434] T 7b8e0fe5ef6d4c42b9854399aac3a1d6 P a1a22e9119494570b6d2217713fd7e43: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:23:00.034855 15153 raft_consensus.cc:359] T 7b8e0fe5ef6d4c42b9854399aac3a1d6 P 0efc951052454eec9a58b0cd025945b8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } } peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } } peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } }
I20260709 13:23:00.035794 15153 raft_consensus.cc:385] T 7b8e0fe5ef6d4c42b9854399aac3a1d6 P 0efc951052454eec9a58b0cd025945b8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:23:00.036078 15153 raft_consensus.cc:740] T 7b8e0fe5ef6d4c42b9854399aac3a1d6 P 0efc951052454eec9a58b0cd025945b8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0efc951052454eec9a58b0cd025945b8, State: Initialized, Role: FOLLOWER
I20260709 13:23:00.036381 15155 tablet_bootstrap.cc:492] T 7a4cf38d1a6644f082f401b9b26bfb27 P a1a22e9119494570b6d2217713fd7e43: Bootstrap starting.
I20260709 13:23:00.034798 15156 raft_consensus.cc:359] T aecef3c240394d54844ec8170e9cad59 P f3a500981b494979b58d2b1041fec9c8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } } peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } } peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } }
I20260709 13:23:00.036901 15156 raft_consensus.cc:385] T aecef3c240394d54844ec8170e9cad59 P f3a500981b494979b58d2b1041fec9c8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:23:00.036813 15153 consensus_queue.cc:260] T 7b8e0fe5ef6d4c42b9854399aac3a1d6 P 0efc951052454eec9a58b0cd025945b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } } peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } } peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } }
I20260709 13:23:00.037401 15156 raft_consensus.cc:740] T aecef3c240394d54844ec8170e9cad59 P f3a500981b494979b58d2b1041fec9c8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f3a500981b494979b58d2b1041fec9c8, State: Initialized, Role: FOLLOWER
I20260709 13:23:00.038517 15156 consensus_queue.cc:260] T aecef3c240394d54844ec8170e9cad59 P f3a500981b494979b58d2b1041fec9c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } } peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } } peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } }
I20260709 13:23:00.082171 14849 leader_election.cc:304] T 74a144396e4443288858878b63f08cc8 P f3a500981b494979b58d2b1041fec9c8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a1a22e9119494570b6d2217713fd7e43, f3a500981b494979b58d2b1041fec9c8; no voters: 0efc951052454eec9a58b0cd025945b8
I20260709 13:23:00.084335 14884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b025139466084200b70879196cd3f922" candidate_uuid: "0efc951052454eec9a58b0cd025945b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f3a500981b494979b58d2b1041fec9c8" is_pre_election: true
I20260709 13:23:00.086887 14885 raft_consensus.cc:3060] T 268027ae94a54cf4acf51c54c7b9032b P f3a500981b494979b58d2b1041fec9c8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:23:00.087488 15153 ts_tablet_manager.cc:1434] T 7b8e0fe5ef6d4c42b9854399aac3a1d6 P 0efc951052454eec9a58b0cd025945b8: Time spent starting tablet: real 0.056s	user 0.006s	sys 0.003s
I20260709 13:23:00.091133 15153 tablet_bootstrap.cc:492] T 2a862e106a9e48a692bc72ea8c03ab39 P 0efc951052454eec9a58b0cd025945b8: Bootstrap starting.
I20260709 13:23:00.036659 15154 raft_consensus.cc:359] T f954c6c25a25443abd9705c8e909bf47 P a722e54d227f4c29a9ed6ce77858003a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } } peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } } peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } }
I20260709 13:23:00.093775 15154 raft_consensus.cc:385] T f954c6c25a25443abd9705c8e909bf47 P a722e54d227f4c29a9ed6ce77858003a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:23:00.094282 15154 raft_consensus.cc:740] T f954c6c25a25443abd9705c8e909bf47 P a722e54d227f4c29a9ed6ce77858003a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a722e54d227f4c29a9ed6ce77858003a, State: Initialized, Role: FOLLOWER
I20260709 13:23:00.095024 14884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b025139466084200b70879196cd3f922" candidate_uuid: "0efc951052454eec9a58b0cd025945b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f3a500981b494979b58d2b1041fec9c8"
I20260709 13:23:00.099682 15160 raft_consensus.cc:493] T dadd194761924530aede05672c9eecf9 P a1a22e9119494570b6d2217713fd7e43 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:23:00.101140 15033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b025139466084200b70879196cd3f922" candidate_uuid: "0efc951052454eec9a58b0cd025945b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1a22e9119494570b6d2217713fd7e43"
I20260709 13:23:00.101044 15160 raft_consensus.cc:515] T dadd194761924530aede05672c9eecf9 P a1a22e9119494570b6d2217713fd7e43 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } } peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } } peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } }
I20260709 13:23:00.102501 15033 raft_consensus.cc:3060] T b025139466084200b70879196cd3f922 P a1a22e9119494570b6d2217713fd7e43 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:23:00.095853 15154 consensus_queue.cc:260] T f954c6c25a25443abd9705c8e909bf47 P a722e54d227f4c29a9ed6ce77858003a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } } peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } } peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } }
I20260709 13:23:00.108173 15154 ts_tablet_manager.cc:1434] T f954c6c25a25443abd9705c8e909bf47 P a722e54d227f4c29a9ed6ce77858003a: Time spent starting tablet: real 0.074s	user 0.008s	sys 0.002s
I20260709 13:23:00.118007 14884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dadd194761924530aede05672c9eecf9" candidate_uuid: "a1a22e9119494570b6d2217713fd7e43" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f3a500981b494979b58d2b1041fec9c8" is_pre_election: true
W20260709 13:23:00.091710 14925 leader_election.cc:343] T b025139466084200b70879196cd3f922 P 0efc951052454eec9a58b0cd025945b8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f3a500981b494979b58d2b1041fec9c8 (127.5.126.65:34129): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:23:00.118983 14884 raft_consensus.cc:2468] T dadd194761924530aede05672c9eecf9 P f3a500981b494979b58d2b1041fec9c8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1a22e9119494570b6d2217713fd7e43 in term 0.
W20260709 13:23:00.121995 14925 leader_election.cc:343] T b025139466084200b70879196cd3f922 P 0efc951052454eec9a58b0cd025945b8 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f3a500981b494979b58d2b1041fec9c8 (127.5.126.65:34129): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:23:00.116004 15106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dadd194761924530aede05672c9eecf9" candidate_uuid: "a1a22e9119494570b6d2217713fd7e43" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a722e54d227f4c29a9ed6ce77858003a" is_pre_election: true
I20260709 13:23:00.113441 15160 leader_election.cc:290] T dadd194761924530aede05672c9eecf9 P a1a22e9119494570b6d2217713fd7e43 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a722e54d227f4c29a9ed6ce77858003a (127.5.126.68:46669), f3a500981b494979b58d2b1041fec9c8 (127.5.126.65:34129)
W20260709 13:23:00.129246 14999 leader_election.cc:343] T dadd194761924530aede05672c9eecf9 P a1a22e9119494570b6d2217713fd7e43 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a722e54d227f4c29a9ed6ce77858003a (127.5.126.68:46669): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:23:00.125305 15154 tablet_bootstrap.cc:492] T dadd194761924530aede05672c9eecf9 P a722e54d227f4c29a9ed6ce77858003a: Bootstrap starting.
I20260709 13:23:00.130333 14999 leader_election.cc:304] T dadd194761924530aede05672c9eecf9 P a1a22e9119494570b6d2217713fd7e43 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a1a22e9119494570b6d2217713fd7e43, f3a500981b494979b58d2b1041fec9c8; no voters: a722e54d227f4c29a9ed6ce77858003a
I20260709 13:23:00.134804 15160 raft_consensus.cc:2804] T dadd194761924530aede05672c9eecf9 P a1a22e9119494570b6d2217713fd7e43 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:23:00.135349 15160 raft_consensus.cc:493] T dadd194761924530aede05672c9eecf9 P a1a22e9119494570b6d2217713fd7e43 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:23:00.135800 15160 raft_consensus.cc:3060] T dadd194761924530aede05672c9eecf9 P a1a22e9119494570b6d2217713fd7e43 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:23:00.140508 15156 ts_tablet_manager.cc:1434] T aecef3c240394d54844ec8170e9cad59 P f3a500981b494979b58d2b1041fec9c8: Time spent starting tablet: real 0.108s	user 0.007s	sys 0.001s
I20260709 13:23:00.143123 15156 tablet_bootstrap.cc:492] T e4f2c694c8194f1e86ad76c7ff051ea7 P f3a500981b494979b58d2b1041fec9c8: Bootstrap starting.
I20260709 13:23:00.145211 15259 consensus_queue.cc:1048] T e85432ede09747339c957cdaa7d15ac6 P f3a500981b494979b58d2b1041fec9c8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:23:00.146231 15260 raft_consensus.cc:2804] T 74a144396e4443288858878b63f08cc8 P f3a500981b494979b58d2b1041fec9c8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:23:00.147094 15260 raft_consensus.cc:697] T 74a144396e4443288858878b63f08cc8 P f3a500981b494979b58d2b1041fec9c8 [term 1 LEADER]: Becoming Leader. State: Replica: f3a500981b494979b58d2b1041fec9c8, State: Running, Role: LEADER
I20260709 13:23:00.158226 15260 consensus_queue.cc:237] T 74a144396e4443288858878b63f08cc8 P f3a500981b494979b58d2b1041fec9c8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } } peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } } peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } }
I20260709 13:23:00.165048 15155 tablet_bootstrap.cc:654] T 7a4cf38d1a6644f082f401b9b26bfb27 P a1a22e9119494570b6d2217713fd7e43: Neither blocks nor log segments found. Creating new log.
I20260709 13:23:00.181326 15259 raft_consensus.cc:493] T 268027ae94a54cf4acf51c54c7b9032b P f3a500981b494979b58d2b1041fec9c8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a722e54d227f4c29a9ed6ce77858003a)
I20260709 13:23:00.182224 15259 raft_consensus.cc:515] T 268027ae94a54cf4acf51c54c7b9032b P f3a500981b494979b58d2b1041fec9c8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } } peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } } peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } }
W20260709 13:23:00.182241 14925 consensus_peers.cc:597] T f0424da0ffb84ba5931fe92f6dd57c5f P 0efc951052454eec9a58b0cd025945b8 -> Peer a722e54d227f4c29a9ed6ce77858003a (127.5.126.68:46669): Couldn't send request to peer a722e54d227f4c29a9ed6ce77858003a. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:23:00.200644 15156 tablet_bootstrap.cc:654] T e4f2c694c8194f1e86ad76c7ff051ea7 P f3a500981b494979b58d2b1041fec9c8: Neither blocks nor log segments found. Creating new log.
I20260709 13:23:00.193372 15282 raft_consensus.cc:493] T e429eefef04d433e8f18dfbc0387068d P a722e54d227f4c29a9ed6ce77858003a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:23:00.203029 15282 raft_consensus.cc:515] T e429eefef04d433e8f18dfbc0387068d P a722e54d227f4c29a9ed6ce77858003a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } } peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } } peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } }
I20260709 13:23:00.206355 15282 leader_election.cc:290] T e429eefef04d433e8f18dfbc0387068d P a722e54d227f4c29a9ed6ce77858003a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0efc951052454eec9a58b0cd025945b8 (127.5.126.66:34613), a1a22e9119494570b6d2217713fd7e43 (127.5.126.67:38125)
I20260709 13:23:00.207823 14960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e429eefef04d433e8f18dfbc0387068d" candidate_uuid: "a722e54d227f4c29a9ed6ce77858003a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0efc951052454eec9a58b0cd025945b8" is_pre_election: true
I20260709 13:23:00.210481 15034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e429eefef04d433e8f18dfbc0387068d" candidate_uuid: "a722e54d227f4c29a9ed6ce77858003a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1a22e9119494570b6d2217713fd7e43" is_pre_election: true
W20260709 13:23:00.210950 15073 leader_election.cc:343] T e429eefef04d433e8f18dfbc0387068d P a722e54d227f4c29a9ed6ce77858003a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0efc951052454eec9a58b0cd025945b8 (127.5.126.66:34613): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:23:00.213335 15072 leader_election.cc:343] T e429eefef04d433e8f18dfbc0387068d P a722e54d227f4c29a9ed6ce77858003a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a1a22e9119494570b6d2217713fd7e43 (127.5.126.67:38125): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:23:00.213979 15072 leader_election.cc:304] T e429eefef04d433e8f18dfbc0387068d P a722e54d227f4c29a9ed6ce77858003a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a722e54d227f4c29a9ed6ce77858003a; no voters: 0efc951052454eec9a58b0cd025945b8, a1a22e9119494570b6d2217713fd7e43
I20260709 13:23:00.214982 15282 raft_consensus.cc:2749] T e429eefef04d433e8f18dfbc0387068d P a722e54d227f4c29a9ed6ce77858003a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:23:00.228468 15215 consensus_queue.cc:1048] T f0424da0ffb84ba5931fe92f6dd57c5f P 0efc951052454eec9a58b0cd025945b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260709 13:23:00.247814 14782 catalog_manager.cc:5697] T 0819f8999271428481a1f839026171a7 P a722e54d227f4c29a9ed6ce77858003a reported cstate change: term changed from 0 to 1, leader changed from <none> to a722e54d227f4c29a9ed6ce77858003a (127.5.126.68). New cstate: current_term: 1 leader_uuid: "a722e54d227f4c29a9ed6ce77858003a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } health_report { overall_health: UNKNOWN } } }
I20260709 13:23:00.251446 15033 raft_consensus.cc:2468] T b025139466084200b70879196cd3f922 P a1a22e9119494570b6d2217713fd7e43 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0efc951052454eec9a58b0cd025945b8 in term 1.
I20260709 13:23:00.259526 15155 tablet_bootstrap.cc:492] T 7a4cf38d1a6644f082f401b9b26bfb27 P a1a22e9119494570b6d2217713fd7e43: No bootstrap required, opened a new log
I20260709 13:23:00.253324 15259 leader_election.cc:290] T 268027ae94a54cf4acf51c54c7b9032b P f3a500981b494979b58d2b1041fec9c8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a722e54d227f4c29a9ed6ce77858003a (127.5.126.68:46669), 0efc951052454eec9a58b0cd025945b8 (127.5.126.66:34613)
I20260709 13:23:00.254037 15224 raft_consensus.cc:493] T 7b8e0fe5ef6d4c42b9854399aac3a1d6 P a1a22e9119494570b6d2217713fd7e43 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:23:00.260380 15224 raft_consensus.cc:515] T 7b8e0fe5ef6d4c42b9854399aac3a1d6 P a1a22e9119494570b6d2217713fd7e43 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } } peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } } peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } }
I20260709 13:23:00.255669 15108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "268027ae94a54cf4acf51c54c7b9032b" candidate_uuid: "f3a500981b494979b58d2b1041fec9c8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a722e54d227f4c29a9ed6ce77858003a" is_pre_election: true
I20260709 13:23:00.261353 14924 leader_election.cc:304] T b025139466084200b70879196cd3f922 P 0efc951052454eec9a58b0cd025945b8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0efc951052454eec9a58b0cd025945b8, a1a22e9119494570b6d2217713fd7e43; no voters: f3a500981b494979b58d2b1041fec9c8
I20260709 13:23:00.255534 14960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "268027ae94a54cf4acf51c54c7b9032b" candidate_uuid: "f3a500981b494979b58d2b1041fec9c8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0efc951052454eec9a58b0cd025945b8" is_pre_election: true
I20260709 13:23:00.262373 15213 raft_consensus.cc:493] T f954c6c25a25443abd9705c8e909bf47 P a722e54d227f4c29a9ed6ce77858003a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:23:00.263244 15211 raft_consensus.cc:2804] T b025139466084200b70879196cd3f922 P 0efc951052454eec9a58b0cd025945b8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:23:00.252379 15214 raft_consensus.cc:493] T 74a144396e4443288858878b63f08cc8 P 0efc951052454eec9a58b0cd025945b8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:23:00.261337 15153 tablet_bootstrap.cc:654] T 2a862e106a9e48a692bc72ea8c03ab39 P 0efc951052454eec9a58b0cd025945b8: Neither blocks nor log segments found. Creating new log.
I20260709 13:23:00.265898 15259 raft_consensus.cc:493] T aecef3c240394d54844ec8170e9cad59 P f3a500981b494979b58d2b1041fec9c8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:23:00.263912 15211 raft_consensus.cc:697] T b025139466084200b70879196cd3f922 P 0efc951052454eec9a58b0cd025945b8 [term 1 LEADER]: Becoming Leader. State: Replica: 0efc951052454eec9a58b0cd025945b8, State: Running, Role: LEADER
I20260709 13:23:00.266552 15259 raft_consensus.cc:515] T aecef3c240394d54844ec8170e9cad59 P f3a500981b494979b58d2b1041fec9c8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } } peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } } peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } }
I20260709 13:23:00.268098 15211 consensus_queue.cc:237] T b025139466084200b70879196cd3f922 P 0efc951052454eec9a58b0cd025945b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } } peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } } peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } }
I20260709 13:23:00.271677 15259 leader_election.cc:290] T aecef3c240394d54844ec8170e9cad59 P f3a500981b494979b58d2b1041fec9c8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a722e54d227f4c29a9ed6ce77858003a (127.5.126.68:46669), 0efc951052454eec9a58b0cd025945b8 (127.5.126.66:34613)
I20260709 13:23:00.271371 15214 raft_consensus.cc:515] T 74a144396e4443288858878b63f08cc8 P 0efc951052454eec9a58b0cd025945b8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } } peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } } peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } }
I20260709 13:23:00.276244 14960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aecef3c240394d54844ec8170e9cad59" candidate_uuid: "f3a500981b494979b58d2b1041fec9c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0efc951052454eec9a58b0cd025945b8" is_pre_election: true
I20260709 13:23:00.277197 14960 raft_consensus.cc:2468] T aecef3c240394d54844ec8170e9cad59 P 0efc951052454eec9a58b0cd025945b8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f3a500981b494979b58d2b1041fec9c8 in term 0.
I20260709 13:23:00.277482 15107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aecef3c240394d54844ec8170e9cad59" candidate_uuid: "f3a500981b494979b58d2b1041fec9c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a722e54d227f4c29a9ed6ce77858003a" is_pre_election: true
I20260709 13:23:00.277851 15160 raft_consensus.cc:515] T dadd194761924530aede05672c9eecf9 P a1a22e9119494570b6d2217713fd7e43 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } } peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } } peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } }
I20260709 13:23:00.279186 14850 leader_election.cc:304] T aecef3c240394d54844ec8170e9cad59 P f3a500981b494979b58d2b1041fec9c8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0efc951052454eec9a58b0cd025945b8, f3a500981b494979b58d2b1041fec9c8; no voters: 
I20260709 13:23:00.263175 15213 raft_consensus.cc:515] T f954c6c25a25443abd9705c8e909bf47 P a722e54d227f4c29a9ed6ce77858003a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } } peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } } peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } }
W20260709 13:23:00.280315 14850 leader_election.cc:343] T aecef3c240394d54844ec8170e9cad59 P f3a500981b494979b58d2b1041fec9c8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a722e54d227f4c29a9ed6ce77858003a (127.5.126.68:46669): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:23:00.281286 15107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dadd194761924530aede05672c9eecf9" candidate_uuid: "a1a22e9119494570b6d2217713fd7e43" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a722e54d227f4c29a9ed6ce77858003a"
I20260709 13:23:00.281473 15259 raft_consensus.cc:2804] T aecef3c240394d54844ec8170e9cad59 P f3a500981b494979b58d2b1041fec9c8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:23:00.281930 15213 leader_election.cc:290] T f954c6c25a25443abd9705c8e909bf47 P a722e54d227f4c29a9ed6ce77858003a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f3a500981b494979b58d2b1041fec9c8 (127.5.126.65:34129), 0efc951052454eec9a58b0cd025945b8 (127.5.126.66:34613)
I20260709 13:23:00.289127 14850 leader_election.cc:304] T 268027ae94a54cf4acf51c54c7b9032b P f3a500981b494979b58d2b1041fec9c8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f3a500981b494979b58d2b1041fec9c8; no voters: 0efc951052454eec9a58b0cd025945b8, a722e54d227f4c29a9ed6ce77858003a
I20260709 13:23:00.289445 14884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f954c6c25a25443abd9705c8e909bf47" candidate_uuid: "a722e54d227f4c29a9ed6ce77858003a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f3a500981b494979b58d2b1041fec9c8" is_pre_election: true
I20260709 13:23:00.290305 15258 raft_consensus.cc:2749] T 268027ae94a54cf4acf51c54c7b9032b P f3a500981b494979b58d2b1041fec9c8 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:23:00.290386 14884 raft_consensus.cc:2468] T f954c6c25a25443abd9705c8e909bf47 P f3a500981b494979b58d2b1041fec9c8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a722e54d227f4c29a9ed6ce77858003a in term 0.
I20260709 13:23:00.282771 15259 raft_consensus.cc:493] T aecef3c240394d54844ec8170e9cad59 P f3a500981b494979b58d2b1041fec9c8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:23:00.293990 15155 ts_tablet_manager.cc:1403] T 7a4cf38d1a6644f082f401b9b26bfb27 P a1a22e9119494570b6d2217713fd7e43: Time spent bootstrapping tablet: real 0.258s	user 0.021s	sys 0.004s
W20260709 13:23:00.300379 14999 leader_election.cc:343] T dadd194761924530aede05672c9eecf9 P a1a22e9119494570b6d2217713fd7e43 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer a722e54d227f4c29a9ed6ce77858003a (127.5.126.68:46669): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:23:00.300477 14960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f954c6c25a25443abd9705c8e909bf47" candidate_uuid: "a722e54d227f4c29a9ed6ce77858003a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0efc951052454eec9a58b0cd025945b8" is_pre_election: true
I20260709 13:23:00.300907 14884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dadd194761924530aede05672c9eecf9" candidate_uuid: "a1a22e9119494570b6d2217713fd7e43" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f3a500981b494979b58d2b1041fec9c8"
I20260709 13:23:00.301688 14884 raft_consensus.cc:3060] T dadd194761924530aede05672c9eecf9 P f3a500981b494979b58d2b1041fec9c8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:23:00.302754 15224 leader_election.cc:290] T 7b8e0fe5ef6d4c42b9854399aac3a1d6 P a1a22e9119494570b6d2217713fd7e43 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0efc951052454eec9a58b0cd025945b8 (127.5.126.66:34613), a722e54d227f4c29a9ed6ce77858003a (127.5.126.68:46669)
I20260709 13:23:00.294894 15259 raft_consensus.cc:3060] T aecef3c240394d54844ec8170e9cad59 P f3a500981b494979b58d2b1041fec9c8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:23:00.306807 14960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b8e0fe5ef6d4c42b9854399aac3a1d6" candidate_uuid: "a1a22e9119494570b6d2217713fd7e43" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0efc951052454eec9a58b0cd025945b8" is_pre_election: true
I20260709 13:23:00.336004 14960 raft_consensus.cc:2468] T 7b8e0fe5ef6d4c42b9854399aac3a1d6 P 0efc951052454eec9a58b0cd025945b8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1a22e9119494570b6d2217713fd7e43 in term 0.
W20260709 13:23:00.308488 15073 leader_election.cc:343] T f954c6c25a25443abd9705c8e909bf47 P a722e54d227f4c29a9ed6ce77858003a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0efc951052454eec9a58b0cd025945b8 (127.5.126.66:34613): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:23:00.309334 15108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b8e0fe5ef6d4c42b9854399aac3a1d6" candidate_uuid: "a1a22e9119494570b6d2217713fd7e43" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a722e54d227f4c29a9ed6ce77858003a" is_pre_election: true
I20260709 13:23:00.337808 15073 leader_election.cc:304] T f954c6c25a25443abd9705c8e909bf47 P a722e54d227f4c29a9ed6ce77858003a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a722e54d227f4c29a9ed6ce77858003a, f3a500981b494979b58d2b1041fec9c8; no voters: 0efc951052454eec9a58b0cd025945b8
I20260709 13:23:00.338725 15108 raft_consensus.cc:2468] T 7b8e0fe5ef6d4c42b9854399aac3a1d6 P a722e54d227f4c29a9ed6ce77858003a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1a22e9119494570b6d2217713fd7e43 in term 0.
I20260709 13:23:00.312662 15214 leader_election.cc:290] T 74a144396e4443288858878b63f08cc8 P 0efc951052454eec9a58b0cd025945b8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f3a500981b494979b58d2b1041fec9c8 (127.5.126.65:34129), a1a22e9119494570b6d2217713fd7e43 (127.5.126.67:38125)
I20260709 13:23:00.316269 15032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74a144396e4443288858878b63f08cc8" candidate_uuid: "0efc951052454eec9a58b0cd025945b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1a22e9119494570b6d2217713fd7e43" is_pre_election: true
I20260709 13:23:00.341574 14999 leader_election.cc:304] T 7b8e0fe5ef6d4c42b9854399aac3a1d6 P a1a22e9119494570b6d2217713fd7e43 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0efc951052454eec9a58b0cd025945b8, a1a22e9119494570b6d2217713fd7e43; no voters: 
I20260709 13:23:00.342092 15032 raft_consensus.cc:2393] T 74a144396e4443288858878b63f08cc8 P a1a22e9119494570b6d2217713fd7e43 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0efc951052454eec9a58b0cd025945b8 in current term 1: Already voted for candidate f3a500981b494979b58d2b1041fec9c8 in this term.
I20260709 13:23:00.317121 15156 tablet_bootstrap.cc:492] T e4f2c694c8194f1e86ad76c7ff051ea7 P f3a500981b494979b58d2b1041fec9c8: No bootstrap required, opened a new log
I20260709 13:23:00.343007 15326 raft_consensus.cc:2804] T 7b8e0fe5ef6d4c42b9854399aac3a1d6 P a1a22e9119494570b6d2217713fd7e43 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:23:00.343429 15156 ts_tablet_manager.cc:1403] T e4f2c694c8194f1e86ad76c7ff051ea7 P f3a500981b494979b58d2b1041fec9c8: Time spent bootstrapping tablet: real 0.201s	user 0.033s	sys 0.004s
I20260709 13:23:00.343430 15326 raft_consensus.cc:493] T 7b8e0fe5ef6d4c42b9854399aac3a1d6 P a1a22e9119494570b6d2217713fd7e43 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:23:00.344224 15326 raft_consensus.cc:3060] T 7b8e0fe5ef6d4c42b9854399aac3a1d6 P a1a22e9119494570b6d2217713fd7e43 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:23:00.346002 15073 consensus_peers.cc:597] T 0819f8999271428481a1f839026171a7 P a722e54d227f4c29a9ed6ce77858003a -> Peer f3a500981b494979b58d2b1041fec9c8 (127.5.126.65:34129): Couldn't send request to peer f3a500981b494979b58d2b1041fec9c8. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:23:00.347190 15156 raft_consensus.cc:359] T e4f2c694c8194f1e86ad76c7ff051ea7 P f3a500981b494979b58d2b1041fec9c8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } } peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } } peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } }
I20260709 13:23:00.298548 15160 leader_election.cc:290] T dadd194761924530aede05672c9eecf9 P a1a22e9119494570b6d2217713fd7e43 [CANDIDATE]: Term 1 election: Requested vote from peers a722e54d227f4c29a9ed6ce77858003a (127.5.126.68:46669), f3a500981b494979b58d2b1041fec9c8 (127.5.126.65:34129)
I20260709 13:23:00.318714 15155 raft_consensus.cc:359] T 7a4cf38d1a6644f082f401b9b26bfb27 P a1a22e9119494570b6d2217713fd7e43 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } } peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } } peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } }
I20260709 13:23:00.320973 14883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74a144396e4443288858878b63f08cc8" candidate_uuid: "0efc951052454eec9a58b0cd025945b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f3a500981b494979b58d2b1041fec9c8" is_pre_election: true
I20260709 13:23:00.349480 15155 raft_consensus.cc:385] T 7a4cf38d1a6644f082f401b9b26bfb27 P a1a22e9119494570b6d2217713fd7e43 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:23:00.349815 15155 raft_consensus.cc:740] T 7a4cf38d1a6644f082f401b9b26bfb27 P a1a22e9119494570b6d2217713fd7e43 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a1a22e9119494570b6d2217713fd7e43, State: Initialized, Role: FOLLOWER
I20260709 13:23:00.324735 15153 tablet_bootstrap.cc:492] T 2a862e106a9e48a692bc72ea8c03ab39 P 0efc951052454eec9a58b0cd025945b8: No bootstrap required, opened a new log
I20260709 13:23:00.350769 15155 consensus_queue.cc:260] T 7a4cf38d1a6644f082f401b9b26bfb27 P a1a22e9119494570b6d2217713fd7e43 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } } peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } } peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } }
I20260709 13:23:00.351435 15153 ts_tablet_manager.cc:1403] T 2a862e106a9e48a692bc72ea8c03ab39 P 0efc951052454eec9a58b0cd025945b8: Time spent bootstrapping tablet: real 0.261s	user 0.014s	sys 0.015s
I20260709 13:23:00.351579 15156 raft_consensus.cc:385] T e4f2c694c8194f1e86ad76c7ff051ea7 P f3a500981b494979b58d2b1041fec9c8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:23:00.351933 15156 raft_consensus.cc:740] T e4f2c694c8194f1e86ad76c7ff051ea7 P f3a500981b494979b58d2b1041fec9c8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f3a500981b494979b58d2b1041fec9c8, State: Initialized, Role: FOLLOWER
I20260709 13:23:00.354470 14925 leader_election.cc:304] T 74a144396e4443288858878b63f08cc8 P 0efc951052454eec9a58b0cd025945b8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0efc951052454eec9a58b0cd025945b8; no voters: a1a22e9119494570b6d2217713fd7e43, f3a500981b494979b58d2b1041fec9c8
I20260709 13:23:00.356949 15215 raft_consensus.cc:3060] T 74a144396e4443288858878b63f08cc8 P 0efc951052454eec9a58b0cd025945b8 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:23:00.359216 14830 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:23:00.352923 15156 consensus_queue.cc:260] T e4f2c694c8194f1e86ad76c7ff051ea7 P f3a500981b494979b58d2b1041fec9c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } } peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } } peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } }
I20260709 13:23:00.328951 15154 tablet_bootstrap.cc:654] T dadd194761924530aede05672c9eecf9 P a722e54d227f4c29a9ed6ce77858003a: Neither blocks nor log segments found. Creating new log.
I20260709 13:23:00.332300 14884 raft_consensus.cc:2468] T dadd194761924530aede05672c9eecf9 P f3a500981b494979b58d2b1041fec9c8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1a22e9119494570b6d2217713fd7e43 in term 1.
I20260709 13:23:00.340829 15161 raft_consensus.cc:2804] T f954c6c25a25443abd9705c8e909bf47 P a722e54d227f4c29a9ed6ce77858003a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:23:00.389330 15161 raft_consensus.cc:493] T f954c6c25a25443abd9705c8e909bf47 P a722e54d227f4c29a9ed6ce77858003a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:23:00.389839 15161 raft_consensus.cc:3060] T f954c6c25a25443abd9705c8e909bf47 P a722e54d227f4c29a9ed6ce77858003a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:23:00.392833 14999 leader_election.cc:304] T dadd194761924530aede05672c9eecf9 P a1a22e9119494570b6d2217713fd7e43 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a1a22e9119494570b6d2217713fd7e43, f3a500981b494979b58d2b1041fec9c8; no voters: a722e54d227f4c29a9ed6ce77858003a
I20260709 13:23:00.393790 15160 raft_consensus.cc:2804] T dadd194761924530aede05672c9eecf9 P a1a22e9119494570b6d2217713fd7e43 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:23:00.394279 15160 raft_consensus.cc:697] T dadd194761924530aede05672c9eecf9 P a1a22e9119494570b6d2217713fd7e43 [term 1 LEADER]: Becoming Leader. State: Replica: a1a22e9119494570b6d2217713fd7e43, State: Running, Role: LEADER
I20260709 13:23:00.395119 15160 consensus_queue.cc:237] T dadd194761924530aede05672c9eecf9 P a1a22e9119494570b6d2217713fd7e43 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } } peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } } peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } }
I20260709 13:23:00.395642 15215 raft_consensus.cc:2749] T 74a144396e4443288858878b63f08cc8 P 0efc951052454eec9a58b0cd025945b8 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:23:00.385898 15213 consensus_queue.cc:1048] T 0819f8999271428481a1f839026171a7 P a722e54d227f4c29a9ed6ce77858003a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:23:00.364001 15155 ts_tablet_manager.cc:1434] T 7a4cf38d1a6644f082f401b9b26bfb27 P a1a22e9119494570b6d2217713fd7e43: Time spent starting tablet: real 0.069s	user 0.006s	sys 0.001s
I20260709 13:23:00.409631 15155 tablet_bootstrap.cc:492] T ced632bda66e4a74b9c854befbcbac9b P a1a22e9119494570b6d2217713fd7e43: Bootstrap starting.
I20260709 13:23:00.409868 15154 tablet_bootstrap.cc:492] T dadd194761924530aede05672c9eecf9 P a722e54d227f4c29a9ed6ce77858003a: No bootstrap required, opened a new log
I20260709 13:23:00.410482 15154 ts_tablet_manager.cc:1403] T dadd194761924530aede05672c9eecf9 P a722e54d227f4c29a9ed6ce77858003a: Time spent bootstrapping tablet: real 0.286s	user 0.006s	sys 0.013s
I20260709 13:23:00.368391 15156 ts_tablet_manager.cc:1434] T e4f2c694c8194f1e86ad76c7ff051ea7 P f3a500981b494979b58d2b1041fec9c8: Time spent starting tablet: real 0.024s	user 0.008s	sys 0.001s
I20260709 13:23:00.362046 15153 raft_consensus.cc:359] T 2a862e106a9e48a692bc72ea8c03ab39 P 0efc951052454eec9a58b0cd025945b8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } } peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } } peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } }
I20260709 13:23:00.414579 15153 raft_consensus.cc:385] T 2a862e106a9e48a692bc72ea8c03ab39 P 0efc951052454eec9a58b0cd025945b8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:23:00.414896 15153 raft_consensus.cc:740] T 2a862e106a9e48a692bc72ea8c03ab39 P 0efc951052454eec9a58b0cd025945b8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0efc951052454eec9a58b0cd025945b8, State: Initialized, Role: FOLLOWER
I20260709 13:23:00.415009 15156 tablet_bootstrap.cc:492] T 7a4cf38d1a6644f082f401b9b26bfb27 P f3a500981b494979b58d2b1041fec9c8: Bootstrap starting.
I20260709 13:23:00.417026 15155 tablet_bootstrap.cc:654] T ced632bda66e4a74b9c854befbcbac9b P a1a22e9119494570b6d2217713fd7e43: Neither blocks nor log segments found. Creating new log.
I20260709 13:23:00.415731 15153 consensus_queue.cc:260] T 2a862e106a9e48a692bc72ea8c03ab39 P 0efc951052454eec9a58b0cd025945b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } } peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } } peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } }
I20260709 13:23:00.417773 14783 catalog_manager.cc:5697] T dadd194761924530aede05672c9eecf9 P a1a22e9119494570b6d2217713fd7e43 reported cstate change: term changed from 0 to 1, leader changed from <none> to a1a22e9119494570b6d2217713fd7e43 (127.5.126.67). New cstate: current_term: 1 leader_uuid: "a1a22e9119494570b6d2217713fd7e43" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } health_report { overall_health: UNKNOWN } } }
I20260709 13:23:00.420437 15153 ts_tablet_manager.cc:1434] T 2a862e106a9e48a692bc72ea8c03ab39 P 0efc951052454eec9a58b0cd025945b8: Time spent starting tablet: real 0.069s	user 0.008s	sys 0.000s
I20260709 13:23:00.402192 15161 raft_consensus.cc:515] T f954c6c25a25443abd9705c8e909bf47 P a722e54d227f4c29a9ed6ce77858003a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } } peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } } peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } }
I20260709 13:23:00.403162 15259 raft_consensus.cc:515] T aecef3c240394d54844ec8170e9cad59 P f3a500981b494979b58d2b1041fec9c8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } } peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } } peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } }
I20260709 13:23:00.421746 15153 tablet_bootstrap.cc:492] T 107541237b4a452e8b47b0c3527b7ede P 0efc951052454eec9a58b0cd025945b8: Bootstrap starting.
I20260709 13:23:00.423017 15156 tablet_bootstrap.cc:654] T 7a4cf38d1a6644f082f401b9b26bfb27 P f3a500981b494979b58d2b1041fec9c8: Neither blocks nor log segments found. Creating new log.
I20260709 13:23:00.424973 14960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aecef3c240394d54844ec8170e9cad59" candidate_uuid: "f3a500981b494979b58d2b1041fec9c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0efc951052454eec9a58b0cd025945b8"
I20260709 13:23:00.425239 15108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aecef3c240394d54844ec8170e9cad59" candidate_uuid: "f3a500981b494979b58d2b1041fec9c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a722e54d227f4c29a9ed6ce77858003a"
I20260709 13:23:00.425750 14960 raft_consensus.cc:3060] T aecef3c240394d54844ec8170e9cad59 P 0efc951052454eec9a58b0cd025945b8 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:23:00.426860 14850 leader_election.cc:343] T aecef3c240394d54844ec8170e9cad59 P f3a500981b494979b58d2b1041fec9c8 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer a722e54d227f4c29a9ed6ce77858003a (127.5.126.68:46669): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:23:00.423044 15259 leader_election.cc:290] T aecef3c240394d54844ec8170e9cad59 P f3a500981b494979b58d2b1041fec9c8 [CANDIDATE]: Term 1 election: Requested vote from peers a722e54d227f4c29a9ed6ce77858003a (127.5.126.68:46669), 0efc951052454eec9a58b0cd025945b8 (127.5.126.66:34613)
I20260709 13:23:00.430943 14884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f954c6c25a25443abd9705c8e909bf47" candidate_uuid: "a722e54d227f4c29a9ed6ce77858003a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f3a500981b494979b58d2b1041fec9c8"
I20260709 13:23:00.431623 14884 raft_consensus.cc:3060] T f954c6c25a25443abd9705c8e909bf47 P f3a500981b494979b58d2b1041fec9c8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:23:00.432387 14959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f954c6c25a25443abd9705c8e909bf47" candidate_uuid: "a722e54d227f4c29a9ed6ce77858003a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0efc951052454eec9a58b0cd025945b8"
I20260709 13:23:00.413262 15154 raft_consensus.cc:359] T dadd194761924530aede05672c9eecf9 P a722e54d227f4c29a9ed6ce77858003a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } } peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } } peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } }
I20260709 13:23:00.383186 15326 raft_consensus.cc:515] T 7b8e0fe5ef6d4c42b9854399aac3a1d6 P a1a22e9119494570b6d2217713fd7e43 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } } peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } } peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } }
W20260709 13:23:00.433938 15073 leader_election.cc:343] T f954c6c25a25443abd9705c8e909bf47 P a722e54d227f4c29a9ed6ce77858003a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 0efc951052454eec9a58b0cd025945b8 (127.5.126.66:34613): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:23:00.434387 15154 raft_consensus.cc:385] T dadd194761924530aede05672c9eecf9 P a722e54d227f4c29a9ed6ce77858003a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:23:00.434033 15161 leader_election.cc:290] T f954c6c25a25443abd9705c8e909bf47 P a722e54d227f4c29a9ed6ce77858003a [CANDIDATE]: Term 1 election: Requested vote from peers f3a500981b494979b58d2b1041fec9c8 (127.5.126.65:34129), 0efc951052454eec9a58b0cd025945b8 (127.5.126.66:34613)
I20260709 13:23:00.433918 15215 raft_consensus.cc:493] T 2a862e106a9e48a692bc72ea8c03ab39 P 0efc951052454eec9a58b0cd025945b8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:23:00.437103 15326 leader_election.cc:290] T 7b8e0fe5ef6d4c42b9854399aac3a1d6 P a1a22e9119494570b6d2217713fd7e43 [CANDIDATE]: Term 1 election: Requested vote from peers 0efc951052454eec9a58b0cd025945b8 (127.5.126.66:34613), a722e54d227f4c29a9ed6ce77858003a (127.5.126.68:46669)
I20260709 13:23:00.436849 15215 raft_consensus.cc:515] T 2a862e106a9e48a692bc72ea8c03ab39 P 0efc951052454eec9a58b0cd025945b8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } } peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } } peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } }
I20260709 13:23:00.434855 15154 raft_consensus.cc:740] T dadd194761924530aede05672c9eecf9 P a722e54d227f4c29a9ed6ce77858003a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a722e54d227f4c29a9ed6ce77858003a, State: Initialized, Role: FOLLOWER
I20260709 13:23:00.443270 15153 tablet_bootstrap.cc:654] T 107541237b4a452e8b47b0c3527b7ede P 0efc951052454eec9a58b0cd025945b8: Neither blocks nor log segments found. Creating new log.
I20260709 13:23:00.444370 15215 leader_election.cc:290] T 2a862e106a9e48a692bc72ea8c03ab39 P 0efc951052454eec9a58b0cd025945b8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a722e54d227f4c29a9ed6ce77858003a (127.5.126.68:46669), f3a500981b494979b58d2b1041fec9c8 (127.5.126.65:34129)
I20260709 13:23:00.454172 15106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b8e0fe5ef6d4c42b9854399aac3a1d6" candidate_uuid: "a1a22e9119494570b6d2217713fd7e43" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a722e54d227f4c29a9ed6ce77858003a"
I20260709 13:23:00.455186 15106 raft_consensus.cc:3060] T 7b8e0fe5ef6d4c42b9854399aac3a1d6 P a722e54d227f4c29a9ed6ce77858003a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:23:00.446949 15108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a862e106a9e48a692bc72ea8c03ab39" candidate_uuid: "0efc951052454eec9a58b0cd025945b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a722e54d227f4c29a9ed6ce77858003a" is_pre_election: true
I20260709 13:23:00.457135 15108 raft_consensus.cc:2468] T 2a862e106a9e48a692bc72ea8c03ab39 P a722e54d227f4c29a9ed6ce77858003a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0efc951052454eec9a58b0cd025945b8 in term 0.
I20260709 13:23:00.458415 14883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a862e106a9e48a692bc72ea8c03ab39" candidate_uuid: "0efc951052454eec9a58b0cd025945b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f3a500981b494979b58d2b1041fec9c8" is_pre_election: true
I20260709 13:23:00.459003 14925 leader_election.cc:304] T 2a862e106a9e48a692bc72ea8c03ab39 P 0efc951052454eec9a58b0cd025945b8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0efc951052454eec9a58b0cd025945b8, a722e54d227f4c29a9ed6ce77858003a; no voters: 
I20260709 13:23:00.443815 14959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b8e0fe5ef6d4c42b9854399aac3a1d6" candidate_uuid: "a1a22e9119494570b6d2217713fd7e43" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0efc951052454eec9a58b0cd025945b8"
I20260709 13:23:00.459852 14959 raft_consensus.cc:3060] T 7b8e0fe5ef6d4c42b9854399aac3a1d6 P 0efc951052454eec9a58b0cd025945b8 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:23:00.460227 14925 leader_election.cc:343] T 2a862e106a9e48a692bc72ea8c03ab39 P 0efc951052454eec9a58b0cd025945b8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f3a500981b494979b58d2b1041fec9c8 (127.5.126.65:34129): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:23:00.461426 15215 raft_consensus.cc:2804] T 2a862e106a9e48a692bc72ea8c03ab39 P 0efc951052454eec9a58b0cd025945b8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:23:00.461858 15215 raft_consensus.cc:493] T 2a862e106a9e48a692bc72ea8c03ab39 P 0efc951052454eec9a58b0cd025945b8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:23:00.462266 15215 raft_consensus.cc:3060] T 2a862e106a9e48a692bc72ea8c03ab39 P 0efc951052454eec9a58b0cd025945b8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:23:00.446158 14779 catalog_manager.cc:5697] T b025139466084200b70879196cd3f922 P 0efc951052454eec9a58b0cd025945b8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0efc951052454eec9a58b0cd025945b8 (127.5.126.66). New cstate: current_term: 1 leader_uuid: "0efc951052454eec9a58b0cd025945b8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } health_report { overall_health: UNKNOWN } } }
I20260709 13:23:00.478181 14884 raft_consensus.cc:2468] T f954c6c25a25443abd9705c8e909bf47 P f3a500981b494979b58d2b1041fec9c8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a722e54d227f4c29a9ed6ce77858003a in term 1.
I20260709 13:23:00.479889 15073 leader_election.cc:304] T f954c6c25a25443abd9705c8e909bf47 P a722e54d227f4c29a9ed6ce77858003a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a722e54d227f4c29a9ed6ce77858003a, f3a500981b494979b58d2b1041fec9c8; no voters: 0efc951052454eec9a58b0cd025945b8
I20260709 13:23:00.480913 15161 raft_consensus.cc:2804] T f954c6c25a25443abd9705c8e909bf47 P a722e54d227f4c29a9ed6ce77858003a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:23:00.481524 15161 raft_consensus.cc:697] T f954c6c25a25443abd9705c8e909bf47 P a722e54d227f4c29a9ed6ce77858003a [term 1 LEADER]: Becoming Leader. State: Replica: a722e54d227f4c29a9ed6ce77858003a, State: Running, Role: LEADER
I20260709 13:23:00.481612 15154 consensus_queue.cc:260] T dadd194761924530aede05672c9eecf9 P a722e54d227f4c29a9ed6ce77858003a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } } peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } } peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } }
I20260709 13:23:00.482524 15161 consensus_queue.cc:237] T f954c6c25a25443abd9705c8e909bf47 P a722e54d227f4c29a9ed6ce77858003a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } } peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } } peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } }
I20260709 13:23:00.485582 15154 ts_tablet_manager.cc:1434] T dadd194761924530aede05672c9eecf9 P a722e54d227f4c29a9ed6ce77858003a: Time spent starting tablet: real 0.075s	user 0.008s	sys 0.002s
I20260709 13:23:00.493968 15282 raft_consensus.cc:493] T dadd194761924530aede05672c9eecf9 P a722e54d227f4c29a9ed6ce77858003a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:23:00.494004 14960 raft_consensus.cc:2468] T aecef3c240394d54844ec8170e9cad59 P 0efc951052454eec9a58b0cd025945b8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f3a500981b494979b58d2b1041fec9c8 in term 1.
I20260709 13:23:00.479700 15215 raft_consensus.cc:515] T 2a862e106a9e48a692bc72ea8c03ab39 P 0efc951052454eec9a58b0cd025945b8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } } peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } } peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } }
I20260709 13:23:00.511475 15154 tablet_bootstrap.cc:492] T f0424da0ffb84ba5931fe92f6dd57c5f P a722e54d227f4c29a9ed6ce77858003a: Bootstrap starting.
I20260709 13:23:00.515271 15155 tablet_bootstrap.cc:492] T ced632bda66e4a74b9c854befbcbac9b P a1a22e9119494570b6d2217713fd7e43: No bootstrap required, opened a new log
I20260709 13:23:00.515946 15155 ts_tablet_manager.cc:1403] T ced632bda66e4a74b9c854befbcbac9b P a1a22e9119494570b6d2217713fd7e43: Time spent bootstrapping tablet: real 0.107s	user 0.017s	sys 0.004s
I20260709 13:23:00.516404 14850 leader_election.cc:304] T aecef3c240394d54844ec8170e9cad59 P f3a500981b494979b58d2b1041fec9c8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0efc951052454eec9a58b0cd025945b8, f3a500981b494979b58d2b1041fec9c8; no voters: a722e54d227f4c29a9ed6ce77858003a
I20260709 13:23:00.517804 15259 raft_consensus.cc:2804] T aecef3c240394d54844ec8170e9cad59 P f3a500981b494979b58d2b1041fec9c8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:23:00.518354 15259 raft_consensus.cc:697] T aecef3c240394d54844ec8170e9cad59 P f3a500981b494979b58d2b1041fec9c8 [term 1 LEADER]: Becoming Leader. State: Replica: f3a500981b494979b58d2b1041fec9c8, State: Running, Role: LEADER
I20260709 13:23:00.518657 15154 tablet_bootstrap.cc:654] T f0424da0ffb84ba5931fe92f6dd57c5f P a722e54d227f4c29a9ed6ce77858003a: Neither blocks nor log segments found. Creating new log.
I20260709 13:23:00.524180 15155 raft_consensus.cc:359] T ced632bda66e4a74b9c854befbcbac9b P a1a22e9119494570b6d2217713fd7e43 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } } peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } } peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } }
I20260709 13:23:00.527097 15155 raft_consensus.cc:385] T ced632bda66e4a74b9c854befbcbac9b P a1a22e9119494570b6d2217713fd7e43 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:23:00.526547 15106 raft_consensus.cc:2468] T 7b8e0fe5ef6d4c42b9854399aac3a1d6 P a722e54d227f4c29a9ed6ce77858003a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1a22e9119494570b6d2217713fd7e43 in term 1.
I20260709 13:23:00.528772 15155 raft_consensus.cc:740] T ced632bda66e4a74b9c854befbcbac9b P a1a22e9119494570b6d2217713fd7e43 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a1a22e9119494570b6d2217713fd7e43, State: Initialized, Role: FOLLOWER
I20260709 13:23:00.504132 15282 raft_consensus.cc:515] T dadd194761924530aede05672c9eecf9 P a722e54d227f4c29a9ed6ce77858003a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } } peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } } peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } }
I20260709 13:23:00.530019 15215 leader_election.cc:290] T 2a862e106a9e48a692bc72ea8c03ab39 P 0efc951052454eec9a58b0cd025945b8 [CANDIDATE]: Term 1 election: Requested vote from peers a722e54d227f4c29a9ed6ce77858003a (127.5.126.68:46669), f3a500981b494979b58d2b1041fec9c8 (127.5.126.65:34129)
I20260709 13:23:00.534332 14999 leader_election.cc:304] T 7b8e0fe5ef6d4c42b9854399aac3a1d6 P a1a22e9119494570b6d2217713fd7e43 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1a22e9119494570b6d2217713fd7e43, a722e54d227f4c29a9ed6ce77858003a; no voters: 
I20260709 13:23:00.534166 15155 consensus_queue.cc:260] T ced632bda66e4a74b9c854befbcbac9b P a1a22e9119494570b6d2217713fd7e43 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } } peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } } peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } }
I20260709 13:23:00.535646 15160 raft_consensus.cc:2804] T 7b8e0fe5ef6d4c42b9854399aac3a1d6 P a1a22e9119494570b6d2217713fd7e43 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:23:00.536351 15160 raft_consensus.cc:697] T 7b8e0fe5ef6d4c42b9854399aac3a1d6 P a1a22e9119494570b6d2217713fd7e43 [term 1 LEADER]: Becoming Leader. State: Replica: a1a22e9119494570b6d2217713fd7e43, State: Running, Role: LEADER
I20260709 13:23:00.536804 15155 ts_tablet_manager.cc:1434] T ced632bda66e4a74b9c854befbcbac9b P a1a22e9119494570b6d2217713fd7e43: Time spent starting tablet: real 0.020s	user 0.006s	sys 0.003s
I20260709 13:23:00.537628 15160 consensus_queue.cc:237] T 7b8e0fe5ef6d4c42b9854399aac3a1d6 P a1a22e9119494570b6d2217713fd7e43 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } } peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } } peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } }
I20260709 13:23:00.519475 15259 consensus_queue.cc:237] T aecef3c240394d54844ec8170e9cad59 P f3a500981b494979b58d2b1041fec9c8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } } peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } } peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } }
I20260709 13:23:00.542434 14884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a862e106a9e48a692bc72ea8c03ab39" candidate_uuid: "0efc951052454eec9a58b0cd025945b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f3a500981b494979b58d2b1041fec9c8"
I20260709 13:23:00.542830 15106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a862e106a9e48a692bc72ea8c03ab39" candidate_uuid: "0efc951052454eec9a58b0cd025945b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a722e54d227f4c29a9ed6ce77858003a"
I20260709 13:23:00.555594 15106 raft_consensus.cc:3060] T 2a862e106a9e48a692bc72ea8c03ab39 P a722e54d227f4c29a9ed6ce77858003a [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:23:00.556722 14925 leader_election.cc:343] T 2a862e106a9e48a692bc72ea8c03ab39 P 0efc951052454eec9a58b0cd025945b8 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f3a500981b494979b58d2b1041fec9c8 (127.5.126.65:34129): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:23:00.542848 15224 raft_consensus.cc:493] T ced632bda66e4a74b9c854befbcbac9b P a1a22e9119494570b6d2217713fd7e43 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:23:00.561128 15224 raft_consensus.cc:515] T ced632bda66e4a74b9c854befbcbac9b P a1a22e9119494570b6d2217713fd7e43 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } } peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } } peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } }
I20260709 13:23:00.561494 14780 catalog_manager.cc:5697] T 74a144396e4443288858878b63f08cc8 P f3a500981b494979b58d2b1041fec9c8 reported cstate change: term changed from 0 to 1, leader changed from <none> to f3a500981b494979b58d2b1041fec9c8 (127.5.126.65). New cstate: current_term: 1 leader_uuid: "f3a500981b494979b58d2b1041fec9c8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } health_report { overall_health: UNKNOWN } } }
I20260709 13:23:00.544857 15282 leader_election.cc:290] T dadd194761924530aede05672c9eecf9 P a722e54d227f4c29a9ed6ce77858003a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a1a22e9119494570b6d2217713fd7e43 (127.5.126.67:38125), f3a500981b494979b58d2b1041fec9c8 (127.5.126.65:34129)
I20260709 13:23:00.567390 15108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ced632bda66e4a74b9c854befbcbac9b" candidate_uuid: "a1a22e9119494570b6d2217713fd7e43" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a722e54d227f4c29a9ed6ce77858003a" is_pre_election: true
I20260709 13:23:00.568207 14958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ced632bda66e4a74b9c854befbcbac9b" candidate_uuid: "a1a22e9119494570b6d2217713fd7e43" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0efc951052454eec9a58b0cd025945b8" is_pre_election: true
I20260709 13:23:00.546598 14883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dadd194761924530aede05672c9eecf9" candidate_uuid: "a722e54d227f4c29a9ed6ce77858003a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f3a500981b494979b58d2b1041fec9c8" is_pre_election: true
I20260709 13:23:00.570268 14883 raft_consensus.cc:2393] T dadd194761924530aede05672c9eecf9 P f3a500981b494979b58d2b1041fec9c8 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a722e54d227f4c29a9ed6ce77858003a in current term 1: Already voted for candidate a1a22e9119494570b6d2217713fd7e43 in this term.
I20260709 13:23:00.568924 14958 raft_consensus.cc:2468] T ced632bda66e4a74b9c854befbcbac9b P 0efc951052454eec9a58b0cd025945b8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1a22e9119494570b6d2217713fd7e43 in term 0.
I20260709 13:23:00.545670 15032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dadd194761924530aede05672c9eecf9" candidate_uuid: "a722e54d227f4c29a9ed6ce77858003a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1a22e9119494570b6d2217713fd7e43" is_pre_election: true
I20260709 13:23:00.574483 15072 leader_election.cc:304] T dadd194761924530aede05672c9eecf9 P a722e54d227f4c29a9ed6ce77858003a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a722e54d227f4c29a9ed6ce77858003a; no voters: a1a22e9119494570b6d2217713fd7e43, f3a500981b494979b58d2b1041fec9c8
I20260709 13:23:00.568735 15224 leader_election.cc:290] T ced632bda66e4a74b9c854befbcbac9b P a1a22e9119494570b6d2217713fd7e43 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0efc951052454eec9a58b0cd025945b8 (127.5.126.66:34613), a722e54d227f4c29a9ed6ce77858003a (127.5.126.68:46669)
I20260709 13:23:00.540086 15155 tablet_bootstrap.cc:492] T 03b63e2bee374ed5931dab67ee14b555 P a1a22e9119494570b6d2217713fd7e43: Bootstrap starting.
I20260709 13:23:00.576265 15156 tablet_bootstrap.cc:492] T 7a4cf38d1a6644f082f401b9b26bfb27 P f3a500981b494979b58d2b1041fec9c8: No bootstrap required, opened a new log
I20260709 13:23:00.576812 15156 ts_tablet_manager.cc:1403] T 7a4cf38d1a6644f082f401b9b26bfb27 P f3a500981b494979b58d2b1041fec9c8: Time spent bootstrapping tablet: real 0.162s	user 0.012s	sys 0.041s
I20260709 13:23:00.574602 14999 leader_election.cc:304] T ced632bda66e4a74b9c854befbcbac9b P a1a22e9119494570b6d2217713fd7e43 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0efc951052454eec9a58b0cd025945b8, a1a22e9119494570b6d2217713fd7e43; no voters: 
W20260709 13:23:00.578189 14999 leader_election.cc:343] T ced632bda66e4a74b9c854befbcbac9b P a1a22e9119494570b6d2217713fd7e43 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a722e54d227f4c29a9ed6ce77858003a (127.5.126.68:46669): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:23:00.579151 15224 raft_consensus.cc:2804] T ced632bda66e4a74b9c854befbcbac9b P a1a22e9119494570b6d2217713fd7e43 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:23:00.579561 15224 raft_consensus.cc:493] T ced632bda66e4a74b9c854befbcbac9b P a1a22e9119494570b6d2217713fd7e43 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:23:00.579900 15224 raft_consensus.cc:3060] T ced632bda66e4a74b9c854befbcbac9b P a1a22e9119494570b6d2217713fd7e43 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:23:00.580232 15156 raft_consensus.cc:359] T 7a4cf38d1a6644f082f401b9b26bfb27 P f3a500981b494979b58d2b1041fec9c8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } } peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } } peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } }
I20260709 13:23:00.580983 15156 raft_consensus.cc:385] T 7a4cf38d1a6644f082f401b9b26bfb27 P f3a500981b494979b58d2b1041fec9c8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:23:00.581287 15156 raft_consensus.cc:740] T 7a4cf38d1a6644f082f401b9b26bfb27 P f3a500981b494979b58d2b1041fec9c8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f3a500981b494979b58d2b1041fec9c8, State: Initialized, Role: FOLLOWER
I20260709 13:23:00.582021 15156 consensus_queue.cc:260] T 7a4cf38d1a6644f082f401b9b26bfb27 P f3a500981b494979b58d2b1041fec9c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } } peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } } peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } }
I20260709 13:23:00.586719 15156 ts_tablet_manager.cc:1434] T 7a4cf38d1a6644f082f401b9b26bfb27 P f3a500981b494979b58d2b1041fec9c8: Time spent starting tablet: real 0.010s	user 0.008s	sys 0.000s
I20260709 13:23:00.587987 15156 tablet_bootstrap.cc:492] T e3693e8a3b0444bf978dc845dcfd2a45 P f3a500981b494979b58d2b1041fec9c8: Bootstrap starting.
I20260709 13:23:00.508193 14959 raft_consensus.cc:2468] T 7b8e0fe5ef6d4c42b9854399aac3a1d6 P 0efc951052454eec9a58b0cd025945b8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1a22e9119494570b6d2217713fd7e43 in term 1.
I20260709 13:23:00.598628 15153 tablet_bootstrap.cc:492] T 107541237b4a452e8b47b0c3527b7ede P 0efc951052454eec9a58b0cd025945b8: No bootstrap required, opened a new log
I20260709 13:23:00.601073 15153 ts_tablet_manager.cc:1403] T 107541237b4a452e8b47b0c3527b7ede P 0efc951052454eec9a58b0cd025945b8: Time spent bootstrapping tablet: real 0.180s	user 0.010s	sys 0.011s
I20260709 13:23:00.605118 15106 raft_consensus.cc:2468] T 2a862e106a9e48a692bc72ea8c03ab39 P a722e54d227f4c29a9ed6ce77858003a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0efc951052454eec9a58b0cd025945b8 in term 1.
I20260709 13:23:00.608331 15260 raft_consensus.cc:493] T e4f2c694c8194f1e86ad76c7ff051ea7 P f3a500981b494979b58d2b1041fec9c8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:23:00.609066 15260 raft_consensus.cc:515] T e4f2c694c8194f1e86ad76c7ff051ea7 P f3a500981b494979b58d2b1041fec9c8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } } peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } } peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } }
I20260709 13:23:00.612903 15108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4f2c694c8194f1e86ad76c7ff051ea7" candidate_uuid: "f3a500981b494979b58d2b1041fec9c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a722e54d227f4c29a9ed6ce77858003a" is_pre_election: true
W20260709 13:23:00.614862 14850 leader_election.cc:343] T e4f2c694c8194f1e86ad76c7ff051ea7 P f3a500981b494979b58d2b1041fec9c8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a722e54d227f4c29a9ed6ce77858003a (127.5.126.68:46669): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:23:00.595861 15213 raft_consensus.cc:3060] T dadd194761924530aede05672c9eecf9 P a722e54d227f4c29a9ed6ce77858003a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:23:00.624718 15260 leader_election.cc:290] T e4f2c694c8194f1e86ad76c7ff051ea7 P f3a500981b494979b58d2b1041fec9c8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a722e54d227f4c29a9ed6ce77858003a (127.5.126.68:46669), 0efc951052454eec9a58b0cd025945b8 (127.5.126.66:34613)
I20260709 13:23:00.626876 14958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4f2c694c8194f1e86ad76c7ff051ea7" candidate_uuid: "f3a500981b494979b58d2b1041fec9c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0efc951052454eec9a58b0cd025945b8" is_pre_election: true
W20260709 13:23:00.628846 14850 leader_election.cc:343] T e4f2c694c8194f1e86ad76c7ff051ea7 P f3a500981b494979b58d2b1041fec9c8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0efc951052454eec9a58b0cd025945b8 (127.5.126.66:34613): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:23:00.629350 14850 leader_election.cc:304] T e4f2c694c8194f1e86ad76c7ff051ea7 P f3a500981b494979b58d2b1041fec9c8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f3a500981b494979b58d2b1041fec9c8; no voters: 0efc951052454eec9a58b0cd025945b8, a722e54d227f4c29a9ed6ce77858003a
I20260709 13:23:00.631847 15326 raft_consensus.cc:493] T 7a4cf38d1a6644f082f401b9b26bfb27 P a1a22e9119494570b6d2217713fd7e43 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:23:00.632514 15326 raft_consensus.cc:515] T 7a4cf38d1a6644f082f401b9b26bfb27 P a1a22e9119494570b6d2217713fd7e43 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } } peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } } peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } }
I20260709 13:23:00.635124 15326 leader_election.cc:290] T 7a4cf38d1a6644f082f401b9b26bfb27 P a1a22e9119494570b6d2217713fd7e43 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a722e54d227f4c29a9ed6ce77858003a (127.5.126.68:46669), f3a500981b494979b58d2b1041fec9c8 (127.5.126.65:34129)
I20260709 13:23:00.637367 15108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a4cf38d1a6644f082f401b9b26bfb27" candidate_uuid: "a1a22e9119494570b6d2217713fd7e43" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a722e54d227f4c29a9ed6ce77858003a" is_pre_election: true
W20260709 13:23:00.639526 14999 leader_election.cc:343] T 7a4cf38d1a6644f082f401b9b26bfb27 P a1a22e9119494570b6d2217713fd7e43 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a722e54d227f4c29a9ed6ce77858003a (127.5.126.68:46669): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:23:00.640362 15260 raft_consensus.cc:2749] T e4f2c694c8194f1e86ad76c7ff051ea7 P f3a500981b494979b58d2b1041fec9c8 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:23:00.640256 14883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a4cf38d1a6644f082f401b9b26bfb27" candidate_uuid: "a1a22e9119494570b6d2217713fd7e43" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f3a500981b494979b58d2b1041fec9c8" is_pre_election: true
I20260709 13:23:00.641409 14883 raft_consensus.cc:2468] T 7a4cf38d1a6644f082f401b9b26bfb27 P f3a500981b494979b58d2b1041fec9c8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1a22e9119494570b6d2217713fd7e43 in term 0.
I20260709 13:23:00.644174 14999 leader_election.cc:304] T 7a4cf38d1a6644f082f401b9b26bfb27 P a1a22e9119494570b6d2217713fd7e43 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a1a22e9119494570b6d2217713fd7e43, f3a500981b494979b58d2b1041fec9c8; no voters: a722e54d227f4c29a9ed6ce77858003a
I20260709 13:23:00.605229 15153 raft_consensus.cc:359] T 107541237b4a452e8b47b0c3527b7ede P 0efc951052454eec9a58b0cd025945b8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } } peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } } peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } }
I20260709 13:23:00.649341 15153 raft_consensus.cc:385] T 107541237b4a452e8b47b0c3527b7ede P 0efc951052454eec9a58b0cd025945b8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:23:00.645656 15155 tablet_bootstrap.cc:654] T 03b63e2bee374ed5931dab67ee14b555 P a1a22e9119494570b6d2217713fd7e43: Neither blocks nor log segments found. Creating new log.
I20260709 13:23:00.645684 15326 raft_consensus.cc:2804] T 7a4cf38d1a6644f082f401b9b26bfb27 P a1a22e9119494570b6d2217713fd7e43 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:23:00.649712 15153 raft_consensus.cc:740] T 107541237b4a452e8b47b0c3527b7ede P 0efc951052454eec9a58b0cd025945b8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0efc951052454eec9a58b0cd025945b8, State: Initialized, Role: FOLLOWER
I20260709 13:23:00.661074 15153 consensus_queue.cc:260] T 107541237b4a452e8b47b0c3527b7ede P 0efc951052454eec9a58b0cd025945b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } } peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } } peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } }
I20260709 13:23:00.653323 15326 raft_consensus.cc:493] T 7a4cf38d1a6644f082f401b9b26bfb27 P a1a22e9119494570b6d2217713fd7e43 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:23:00.654847 14925 leader_election.cc:304] T 2a862e106a9e48a692bc72ea8c03ab39 P 0efc951052454eec9a58b0cd025945b8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0efc951052454eec9a58b0cd025945b8, a722e54d227f4c29a9ed6ce77858003a; no voters: f3a500981b494979b58d2b1041fec9c8
I20260709 13:23:00.666332 15326 raft_consensus.cc:3060] T 7a4cf38d1a6644f082f401b9b26bfb27 P a1a22e9119494570b6d2217713fd7e43 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:23:00.684649 15154 tablet_bootstrap.cc:492] T f0424da0ffb84ba5931fe92f6dd57c5f P a722e54d227f4c29a9ed6ce77858003a: No bootstrap required, opened a new log
I20260709 13:23:00.685150 15154 ts_tablet_manager.cc:1403] T f0424da0ffb84ba5931fe92f6dd57c5f P a722e54d227f4c29a9ed6ce77858003a: Time spent bootstrapping tablet: real 0.176s	user 0.037s	sys 0.049s
W20260709 13:23:00.686518 15072 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.67:38125, user_credentials={real_user=slave}} blocked reactor thread for 72230.2us
I20260709 13:23:00.691438 14782 catalog_manager.cc:5697] T f954c6c25a25443abd9705c8e909bf47 P a722e54d227f4c29a9ed6ce77858003a reported cstate change: term changed from 0 to 1, leader changed from <none> to a722e54d227f4c29a9ed6ce77858003a (127.5.126.68). New cstate: current_term: 1 leader_uuid: "a722e54d227f4c29a9ed6ce77858003a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } health_report { overall_health: UNKNOWN } } }
I20260709 13:23:00.700632 15156 tablet_bootstrap.cc:654] T e3693e8a3b0444bf978dc845dcfd2a45 P f3a500981b494979b58d2b1041fec9c8: Neither blocks nor log segments found. Creating new log.
I20260709 13:23:00.695932 15220 raft_consensus.cc:2804] T 2a862e106a9e48a692bc72ea8c03ab39 P 0efc951052454eec9a58b0cd025945b8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:23:00.708009 15153 ts_tablet_manager.cc:1434] T 107541237b4a452e8b47b0c3527b7ede P 0efc951052454eec9a58b0cd025945b8: Time spent starting tablet: real 0.107s	user 0.004s	sys 0.006s
W20260709 13:23:00.699826 14925 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.68:46669, user_credentials={real_user=slave}} blocked reactor thread for 48100.1us
I20260709 13:23:00.711228 15220 raft_consensus.cc:697] T 2a862e106a9e48a692bc72ea8c03ab39 P 0efc951052454eec9a58b0cd025945b8 [term 1 LEADER]: Becoming Leader. State: Replica: 0efc951052454eec9a58b0cd025945b8, State: Running, Role: LEADER
I20260709 13:23:00.712353 15220 consensus_queue.cc:237] T 2a862e106a9e48a692bc72ea8c03ab39 P 0efc951052454eec9a58b0cd025945b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } } peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } } peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } }
I20260709 13:23:00.719102 15153 tablet_bootstrap.cc:492] T f954c6c25a25443abd9705c8e909bf47 P 0efc951052454eec9a58b0cd025945b8: Bootstrap starting.
I20260709 13:23:00.719125 15260 consensus_queue.cc:1048] T 74a144396e4443288858878b63f08cc8 P f3a500981b494979b58d2b1041fec9c8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:23:00.725409 15224 raft_consensus.cc:515] T ced632bda66e4a74b9c854befbcbac9b P a1a22e9119494570b6d2217713fd7e43 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } } peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } } peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } }
I20260709 13:23:00.697204 15326 raft_consensus.cc:515] T 7a4cf38d1a6644f082f401b9b26bfb27 P a1a22e9119494570b6d2217713fd7e43 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } } peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } } peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } }
I20260709 13:23:00.728271 15326 leader_election.cc:290] T 7a4cf38d1a6644f082f401b9b26bfb27 P a1a22e9119494570b6d2217713fd7e43 [CANDIDATE]: Term 1 election: Requested vote from peers a722e54d227f4c29a9ed6ce77858003a (127.5.126.68:46669), f3a500981b494979b58d2b1041fec9c8 (127.5.126.65:34129)
I20260709 13:23:00.731520 15154 raft_consensus.cc:359] T f0424da0ffb84ba5931fe92f6dd57c5f P a722e54d227f4c29a9ed6ce77858003a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } } peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } } peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } }
I20260709 13:23:00.732199 15224 leader_election.cc:290] T ced632bda66e4a74b9c854befbcbac9b P a1a22e9119494570b6d2217713fd7e43 [CANDIDATE]: Term 1 election: Requested vote from peers 0efc951052454eec9a58b0cd025945b8 (127.5.126.66:34613), a722e54d227f4c29a9ed6ce77858003a (127.5.126.68:46669)
I20260709 13:23:00.732501 15154 raft_consensus.cc:385] T f0424da0ffb84ba5931fe92f6dd57c5f P a722e54d227f4c29a9ed6ce77858003a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:23:00.738615 15154 raft_consensus.cc:740] T f0424da0ffb84ba5931fe92f6dd57c5f P a722e54d227f4c29a9ed6ce77858003a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a722e54d227f4c29a9ed6ce77858003a, State: Initialized, Role: FOLLOWER
I20260709 13:23:00.739410 15154 consensus_queue.cc:260] T f0424da0ffb84ba5931fe92f6dd57c5f P a722e54d227f4c29a9ed6ce77858003a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } } peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } } peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } }
I20260709 13:23:00.742897 15154 ts_tablet_manager.cc:1434] T f0424da0ffb84ba5931fe92f6dd57c5f P a722e54d227f4c29a9ed6ce77858003a: Time spent starting tablet: real 0.057s	user 0.008s	sys 0.000s
I20260709 13:23:00.742782 15260 consensus_queue.cc:1048] T 74a144396e4443288858878b63f08cc8 P f3a500981b494979b58d2b1041fec9c8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:23:00.744390 15154 tablet_bootstrap.cc:492] T 7a4cf38d1a6644f082f401b9b26bfb27 P a722e54d227f4c29a9ed6ce77858003a: Bootstrap starting.
I20260709 13:23:00.746476 14883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a4cf38d1a6644f082f401b9b26bfb27" candidate_uuid: "a1a22e9119494570b6d2217713fd7e43" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f3a500981b494979b58d2b1041fec9c8"
I20260709 13:23:00.746977 15106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ced632bda66e4a74b9c854befbcbac9b" candidate_uuid: "a1a22e9119494570b6d2217713fd7e43" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a722e54d227f4c29a9ed6ce77858003a"
I20260709 13:23:00.747149 14883 raft_consensus.cc:3060] T 7a4cf38d1a6644f082f401b9b26bfb27 P f3a500981b494979b58d2b1041fec9c8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:23:00.748493 15108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a4cf38d1a6644f082f401b9b26bfb27" candidate_uuid: "a1a22e9119494570b6d2217713fd7e43" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a722e54d227f4c29a9ed6ce77858003a"
I20260709 13:23:00.749902 15155 tablet_bootstrap.cc:492] T 03b63e2bee374ed5931dab67ee14b555 P a1a22e9119494570b6d2217713fd7e43: No bootstrap required, opened a new log
W20260709 13:23:00.752170 14999 leader_election.cc:343] T ced632bda66e4a74b9c854befbcbac9b P a1a22e9119494570b6d2217713fd7e43 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer a722e54d227f4c29a9ed6ce77858003a (127.5.126.68:46669): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:23:00.752948 14999 leader_election.cc:343] T 7a4cf38d1a6644f082f401b9b26bfb27 P a1a22e9119494570b6d2217713fd7e43 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer a722e54d227f4c29a9ed6ce77858003a (127.5.126.68:46669): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:23:00.757058 15213 raft_consensus.cc:2749] T dadd194761924530aede05672c9eecf9 P a722e54d227f4c29a9ed6ce77858003a [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:23:00.757824 15155 ts_tablet_manager.cc:1403] T 03b63e2bee374ed5931dab67ee14b555 P a1a22e9119494570b6d2217713fd7e43: Time spent bootstrapping tablet: real 0.219s	user 0.011s	sys 0.019s
I20260709 13:23:00.763247 14960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ced632bda66e4a74b9c854befbcbac9b" candidate_uuid: "a1a22e9119494570b6d2217713fd7e43" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0efc951052454eec9a58b0cd025945b8"
I20260709 13:23:00.764058 14960 raft_consensus.cc:3060] T ced632bda66e4a74b9c854befbcbac9b P 0efc951052454eec9a58b0cd025945b8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:23:00.767436 15153 tablet_bootstrap.cc:654] T f954c6c25a25443abd9705c8e909bf47 P 0efc951052454eec9a58b0cd025945b8: Neither blocks nor log segments found. Creating new log.
I20260709 13:23:00.779733 15154 tablet_bootstrap.cc:654] T 7a4cf38d1a6644f082f401b9b26bfb27 P a722e54d227f4c29a9ed6ce77858003a: Neither blocks nor log segments found. Creating new log.
I20260709 13:23:00.774422 15155 raft_consensus.cc:359] T 03b63e2bee374ed5931dab67ee14b555 P a1a22e9119494570b6d2217713fd7e43 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } } peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } } peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } }
I20260709 13:23:00.791669 15155 raft_consensus.cc:385] T 03b63e2bee374ed5931dab67ee14b555 P a1a22e9119494570b6d2217713fd7e43 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:23:00.792001 15155 raft_consensus.cc:740] T 03b63e2bee374ed5931dab67ee14b555 P a1a22e9119494570b6d2217713fd7e43 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a1a22e9119494570b6d2217713fd7e43, State: Initialized, Role: FOLLOWER
I20260709 13:23:00.793766 15155 consensus_queue.cc:260] T 03b63e2bee374ed5931dab67ee14b555 P a1a22e9119494570b6d2217713fd7e43 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } } peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } } peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } }
I20260709 13:23:00.800051 14782 catalog_manager.cc:5697] T 7b8e0fe5ef6d4c42b9854399aac3a1d6 P a1a22e9119494570b6d2217713fd7e43 reported cstate change: term changed from 0 to 1, leader changed from <none> to a1a22e9119494570b6d2217713fd7e43 (127.5.126.67). New cstate: current_term: 1 leader_uuid: "a1a22e9119494570b6d2217713fd7e43" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } health_report { overall_health: UNKNOWN } } }
I20260709 13:23:00.808312 14883 raft_consensus.cc:2468] T 7a4cf38d1a6644f082f401b9b26bfb27 P f3a500981b494979b58d2b1041fec9c8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1a22e9119494570b6d2217713fd7e43 in term 1.
I20260709 13:23:00.816746 14999 leader_election.cc:304] T 7a4cf38d1a6644f082f401b9b26bfb27 P a1a22e9119494570b6d2217713fd7e43 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a1a22e9119494570b6d2217713fd7e43, f3a500981b494979b58d2b1041fec9c8; no voters: a722e54d227f4c29a9ed6ce77858003a
I20260709 13:23:00.818575 15350 raft_consensus.cc:2804] T 7a4cf38d1a6644f082f401b9b26bfb27 P a1a22e9119494570b6d2217713fd7e43 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:23:00.819087 15350 raft_consensus.cc:697] T 7a4cf38d1a6644f082f401b9b26bfb27 P a1a22e9119494570b6d2217713fd7e43 [term 1 LEADER]: Becoming Leader. State: Replica: a1a22e9119494570b6d2217713fd7e43, State: Running, Role: LEADER
I20260709 13:23:00.819244 15224 raft_consensus.cc:493] T 03b63e2bee374ed5931dab67ee14b555 P a1a22e9119494570b6d2217713fd7e43 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:23:00.819917 15224 raft_consensus.cc:515] T 03b63e2bee374ed5931dab67ee14b555 P a1a22e9119494570b6d2217713fd7e43 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } } peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } } peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } }
I20260709 13:23:00.819984 15350 consensus_queue.cc:237] T 7a4cf38d1a6644f082f401b9b26bfb27 P a1a22e9119494570b6d2217713fd7e43 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } } peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } } peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } }
I20260709 13:23:00.822314 15224 leader_election.cc:290] T 03b63e2bee374ed5931dab67ee14b555 P a1a22e9119494570b6d2217713fd7e43 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a722e54d227f4c29a9ed6ce77858003a (127.5.126.68:46669), f3a500981b494979b58d2b1041fec9c8 (127.5.126.65:34129)
I20260709 13:23:00.803706 14960 raft_consensus.cc:2468] T ced632bda66e4a74b9c854befbcbac9b P 0efc951052454eec9a58b0cd025945b8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1a22e9119494570b6d2217713fd7e43 in term 1.
I20260709 13:23:00.825098 15108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03b63e2bee374ed5931dab67ee14b555" candidate_uuid: "a1a22e9119494570b6d2217713fd7e43" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a722e54d227f4c29a9ed6ce77858003a" is_pre_election: true
W20260709 13:23:00.828161 14999 leader_election.cc:343] T 03b63e2bee374ed5931dab67ee14b555 P a1a22e9119494570b6d2217713fd7e43 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a722e54d227f4c29a9ed6ce77858003a (127.5.126.68:46669): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:23:00.828636 15211 consensus_queue.cc:1048] T b025139466084200b70879196cd3f922 P 0efc951052454eec9a58b0cd025945b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:23:00.831934 14999 leader_election.cc:304] T ced632bda66e4a74b9c854befbcbac9b P a1a22e9119494570b6d2217713fd7e43 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0efc951052454eec9a58b0cd025945b8, a1a22e9119494570b6d2217713fd7e43; no voters: a722e54d227f4c29a9ed6ce77858003a
I20260709 13:23:00.830868 15161 raft_consensus.cc:493] T f0424da0ffb84ba5931fe92f6dd57c5f P a722e54d227f4c29a9ed6ce77858003a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:23:00.833308 15161 raft_consensus.cc:515] T f0424da0ffb84ba5931fe92f6dd57c5f P a722e54d227f4c29a9ed6ce77858003a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } } peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } } peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } }
I20260709 13:23:00.834851 15155 ts_tablet_manager.cc:1434] T 03b63e2bee374ed5931dab67ee14b555 P a1a22e9119494570b6d2217713fd7e43: Time spent starting tablet: real 0.077s	user 0.006s	sys 0.001s
I20260709 13:23:00.836124 15161 leader_election.cc:290] T f0424da0ffb84ba5931fe92f6dd57c5f P a722e54d227f4c29a9ed6ce77858003a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0efc951052454eec9a58b0cd025945b8 (127.5.126.66:34613), a1a22e9119494570b6d2217713fd7e43 (127.5.126.67:38125)
I20260709 13:23:00.839840 15155 tablet_bootstrap.cc:492] T e3693e8a3b0444bf978dc845dcfd2a45 P a1a22e9119494570b6d2217713fd7e43: Bootstrap starting.
I20260709 13:23:00.838229 14959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0424da0ffb84ba5931fe92f6dd57c5f" candidate_uuid: "a722e54d227f4c29a9ed6ce77858003a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0efc951052454eec9a58b0cd025945b8" is_pre_election: true
I20260709 13:23:00.843364 15033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0424da0ffb84ba5931fe92f6dd57c5f" candidate_uuid: "a722e54d227f4c29a9ed6ce77858003a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1a22e9119494570b6d2217713fd7e43" is_pre_election: true
I20260709 13:23:00.868649 15153 tablet_bootstrap.cc:492] T f954c6c25a25443abd9705c8e909bf47 P 0efc951052454eec9a58b0cd025945b8: No bootstrap required, opened a new log
I20260709 13:23:00.869822 15153 ts_tablet_manager.cc:1403] T f954c6c25a25443abd9705c8e909bf47 P 0efc951052454eec9a58b0cd025945b8: Time spent bootstrapping tablet: real 0.151s	user 0.018s	sys 0.007s
I20260709 13:23:00.852836 14779 catalog_manager.cc:5697] T aecef3c240394d54844ec8170e9cad59 P f3a500981b494979b58d2b1041fec9c8 reported cstate change: term changed from 0 to 1, leader changed from <none> to f3a500981b494979b58d2b1041fec9c8 (127.5.126.65). New cstate: current_term: 1 leader_uuid: "f3a500981b494979b58d2b1041fec9c8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } health_report { overall_health: UNKNOWN } } }
I20260709 13:23:00.873947 15156 tablet_bootstrap.cc:492] T e3693e8a3b0444bf978dc845dcfd2a45 P f3a500981b494979b58d2b1041fec9c8: No bootstrap required, opened a new log
I20260709 13:23:00.875558 15156 ts_tablet_manager.cc:1403] T e3693e8a3b0444bf978dc845dcfd2a45 P f3a500981b494979b58d2b1041fec9c8: Time spent bootstrapping tablet: real 0.288s	user 0.022s	sys 0.006s
I20260709 13:23:00.877609 15073 leader_election.cc:304] T f0424da0ffb84ba5931fe92f6dd57c5f P a722e54d227f4c29a9ed6ce77858003a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a722e54d227f4c29a9ed6ce77858003a; no voters: 0efc951052454eec9a58b0cd025945b8, a1a22e9119494570b6d2217713fd7e43
I20260709 13:23:00.865269 14883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03b63e2bee374ed5931dab67ee14b555" candidate_uuid: "a1a22e9119494570b6d2217713fd7e43" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f3a500981b494979b58d2b1041fec9c8" is_pre_election: true
I20260709 13:23:00.881948 15161 raft_consensus.cc:2749] T f0424da0ffb84ba5931fe92f6dd57c5f P a722e54d227f4c29a9ed6ce77858003a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:23:00.885201 15355 raft_consensus.cc:2804] T ced632bda66e4a74b9c854befbcbac9b P a1a22e9119494570b6d2217713fd7e43 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:23:00.885833 15355 raft_consensus.cc:697] T ced632bda66e4a74b9c854befbcbac9b P a1a22e9119494570b6d2217713fd7e43 [term 1 LEADER]: Becoming Leader. State: Replica: a1a22e9119494570b6d2217713fd7e43, State: Running, Role: LEADER
I20260709 13:23:00.886831 15355 consensus_queue.cc:237] T ced632bda66e4a74b9c854befbcbac9b P a1a22e9119494570b6d2217713fd7e43 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } } peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } } peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } }
W20260709 13:23:00.877621 14925 consensus_peers.cc:597] T b025139466084200b70879196cd3f922 P 0efc951052454eec9a58b0cd025945b8 -> Peer f3a500981b494979b58d2b1041fec9c8 (127.5.126.65:34129): Couldn't send request to peer f3a500981b494979b58d2b1041fec9c8. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:23:00.890781 15156 raft_consensus.cc:359] T e3693e8a3b0444bf978dc845dcfd2a45 P f3a500981b494979b58d2b1041fec9c8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } } peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } } peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } }
I20260709 13:23:00.891935 15156 raft_consensus.cc:385] T e3693e8a3b0444bf978dc845dcfd2a45 P f3a500981b494979b58d2b1041fec9c8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:23:00.892302 15156 raft_consensus.cc:740] T e3693e8a3b0444bf978dc845dcfd2a45 P f3a500981b494979b58d2b1041fec9c8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f3a500981b494979b58d2b1041fec9c8, State: Initialized, Role: FOLLOWER
I20260709 13:23:00.898552 15156 consensus_queue.cc:260] T e3693e8a3b0444bf978dc845dcfd2a45 P f3a500981b494979b58d2b1041fec9c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } } peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } } peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } }
W20260709 13:23:00.914040 14999 leader_election.cc:343] T 03b63e2bee374ed5931dab67ee14b555 P a1a22e9119494570b6d2217713fd7e43 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f3a500981b494979b58d2b1041fec9c8 (127.5.126.65:34129): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:23:00.925715 15156 ts_tablet_manager.cc:1434] T e3693e8a3b0444bf978dc845dcfd2a45 P f3a500981b494979b58d2b1041fec9c8: Time spent starting tablet: real 0.050s	user 0.010s	sys 0.000s
I20260709 13:23:00.933996 15156 tablet_bootstrap.cc:492] T b025139466084200b70879196cd3f922 P f3a500981b494979b58d2b1041fec9c8: Bootstrap starting.
I20260709 13:23:00.942036 15215 raft_consensus.cc:493] T 107541237b4a452e8b47b0c3527b7ede P 0efc951052454eec9a58b0cd025945b8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:23:00.948659 15215 raft_consensus.cc:515] T 107541237b4a452e8b47b0c3527b7ede P 0efc951052454eec9a58b0cd025945b8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } } peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } } peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } }
I20260709 13:23:00.940284 14999 leader_election.cc:304] T 03b63e2bee374ed5931dab67ee14b555 P a1a22e9119494570b6d2217713fd7e43 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1a22e9119494570b6d2217713fd7e43; no voters: a722e54d227f4c29a9ed6ce77858003a, f3a500981b494979b58d2b1041fec9c8
I20260709 13:23:00.957760 15160 raft_consensus.cc:2749] T 03b63e2bee374ed5931dab67ee14b555 P a1a22e9119494570b6d2217713fd7e43 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:23:00.957823 14999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.65:34129, user_credentials={real_user=slave}} blocked reactor thread for 44140.5us
I20260709 13:23:00.959355 14884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "107541237b4a452e8b47b0c3527b7ede" candidate_uuid: "0efc951052454eec9a58b0cd025945b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f3a500981b494979b58d2b1041fec9c8" is_pre_election: true
W20260709 13:23:00.961134 14925 leader_election.cc:343] T 107541237b4a452e8b47b0c3527b7ede P 0efc951052454eec9a58b0cd025945b8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f3a500981b494979b58d2b1041fec9c8 (127.5.126.65:34129): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:23:00.963372 15160 consensus_queue.cc:1048] T dadd194761924530aede05672c9eecf9 P a1a22e9119494570b6d2217713fd7e43 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:23:00.967075 15153 raft_consensus.cc:359] T f954c6c25a25443abd9705c8e909bf47 P 0efc951052454eec9a58b0cd025945b8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } } peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } } peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } }
I20260709 13:23:00.968029 15153 raft_consensus.cc:385] T f954c6c25a25443abd9705c8e909bf47 P 0efc951052454eec9a58b0cd025945b8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:23:00.968389 15153 raft_consensus.cc:740] T f954c6c25a25443abd9705c8e909bf47 P 0efc951052454eec9a58b0cd025945b8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0efc951052454eec9a58b0cd025945b8, State: Initialized, Role: FOLLOWER
I20260709 13:23:00.969230 15153 consensus_queue.cc:260] T f954c6c25a25443abd9705c8e909bf47 P 0efc951052454eec9a58b0cd025945b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } } peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } } peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } }
I20260709 13:23:00.975060 15215 leader_election.cc:290] T 107541237b4a452e8b47b0c3527b7ede P 0efc951052454eec9a58b0cd025945b8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f3a500981b494979b58d2b1041fec9c8 (127.5.126.65:34129), a1a22e9119494570b6d2217713fd7e43 (127.5.126.67:38125)
I20260709 13:23:00.977137 15154 tablet_bootstrap.cc:492] T 7a4cf38d1a6644f082f401b9b26bfb27 P a722e54d227f4c29a9ed6ce77858003a: No bootstrap required, opened a new log
I20260709 13:23:00.976948 15032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "107541237b4a452e8b47b0c3527b7ede" candidate_uuid: "0efc951052454eec9a58b0cd025945b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1a22e9119494570b6d2217713fd7e43" is_pre_election: true
I20260709 13:23:00.977713 15154 ts_tablet_manager.cc:1403] T 7a4cf38d1a6644f082f401b9b26bfb27 P a722e54d227f4c29a9ed6ce77858003a: Time spent bootstrapping tablet: real 0.234s	user 0.018s	sys 0.014s
W20260709 13:23:00.978706 14924 leader_election.cc:343] T 107541237b4a452e8b47b0c3527b7ede P 0efc951052454eec9a58b0cd025945b8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a1a22e9119494570b6d2217713fd7e43 (127.5.126.67:38125): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:23:00.979241 14924 leader_election.cc:304] T 107541237b4a452e8b47b0c3527b7ede P 0efc951052454eec9a58b0cd025945b8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0efc951052454eec9a58b0cd025945b8; no voters: a1a22e9119494570b6d2217713fd7e43, f3a500981b494979b58d2b1041fec9c8
I20260709 13:23:00.980338 15156 tablet_bootstrap.cc:654] T b025139466084200b70879196cd3f922 P f3a500981b494979b58d2b1041fec9c8: Neither blocks nor log segments found. Creating new log.
I20260709 13:23:00.981117 15154 raft_consensus.cc:359] T 7a4cf38d1a6644f082f401b9b26bfb27 P a722e54d227f4c29a9ed6ce77858003a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } } peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } } peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } }
I20260709 13:23:00.974155 14783 catalog_manager.cc:5697] T 2a862e106a9e48a692bc72ea8c03ab39 P 0efc951052454eec9a58b0cd025945b8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0efc951052454eec9a58b0cd025945b8 (127.5.126.66). New cstate: current_term: 1 leader_uuid: "0efc951052454eec9a58b0cd025945b8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } health_report { overall_health: HEALTHY } } }
I20260709 13:23:00.981962 15154 raft_consensus.cc:385] T 7a4cf38d1a6644f082f401b9b26bfb27 P a722e54d227f4c29a9ed6ce77858003a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:23:00.982244 15154 raft_consensus.cc:740] T 7a4cf38d1a6644f082f401b9b26bfb27 P a722e54d227f4c29a9ed6ce77858003a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a722e54d227f4c29a9ed6ce77858003a, State: Initialized, Role: FOLLOWER
I20260709 13:23:01.002676 15153 ts_tablet_manager.cc:1434] T f954c6c25a25443abd9705c8e909bf47 P 0efc951052454eec9a58b0cd025945b8: Time spent starting tablet: real 0.128s	user 0.002s	sys 0.006s
I20260709 13:23:01.003073 15215 raft_consensus.cc:2749] T 107541237b4a452e8b47b0c3527b7ede P 0efc951052454eec9a58b0cd025945b8 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:23:00.975216 15155 tablet_bootstrap.cc:654] T e3693e8a3b0444bf978dc845dcfd2a45 P a1a22e9119494570b6d2217713fd7e43: Neither blocks nor log segments found. Creating new log.
I20260709 13:23:01.005484 15355 consensus_queue.cc:1048] T dadd194761924530aede05672c9eecf9 P a1a22e9119494570b6d2217713fd7e43 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:23:01.009966 15154 consensus_queue.cc:260] T 7a4cf38d1a6644f082f401b9b26bfb27 P a722e54d227f4c29a9ed6ce77858003a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } } peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } } peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } }
I20260709 13:23:01.026381 15153 tablet_bootstrap.cc:492] T e3693e8a3b0444bf978dc845dcfd2a45 P 0efc951052454eec9a58b0cd025945b8: Bootstrap starting.
I20260709 13:23:01.033907 15156 tablet_bootstrap.cc:492] T b025139466084200b70879196cd3f922 P f3a500981b494979b58d2b1041fec9c8: No bootstrap required, opened a new log
I20260709 13:23:01.034494 15156 ts_tablet_manager.cc:1403] T b025139466084200b70879196cd3f922 P f3a500981b494979b58d2b1041fec9c8: Time spent bootstrapping tablet: real 0.101s	user 0.025s	sys 0.024s
I20260709 13:23:01.023813 15213 raft_consensus.cc:493] T 7a4cf38d1a6644f082f401b9b26bfb27 P a722e54d227f4c29a9ed6ce77858003a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:23:01.035380 15213 raft_consensus.cc:515] T 7a4cf38d1a6644f082f401b9b26bfb27 P a722e54d227f4c29a9ed6ce77858003a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } } peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } } peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } }
I20260709 13:23:01.040280 15355 consensus_queue.cc:1048] T 7b8e0fe5ef6d4c42b9854399aac3a1d6 P a1a22e9119494570b6d2217713fd7e43 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:23:01.033372 14780 catalog_manager.cc:5697] T ced632bda66e4a74b9c854befbcbac9b P a1a22e9119494570b6d2217713fd7e43 reported cstate change: term changed from 0 to 1, leader changed from <none> to a1a22e9119494570b6d2217713fd7e43 (127.5.126.67). New cstate: current_term: 1 leader_uuid: "a1a22e9119494570b6d2217713fd7e43" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } health_report { overall_health: UNKNOWN } } }
I20260709 13:23:01.039497 15156 raft_consensus.cc:359] T b025139466084200b70879196cd3f922 P f3a500981b494979b58d2b1041fec9c8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } } peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } } peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } }
I20260709 13:23:01.041431 15156 raft_consensus.cc:385] T b025139466084200b70879196cd3f922 P f3a500981b494979b58d2b1041fec9c8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:23:01.041762 15156 raft_consensus.cc:740] T b025139466084200b70879196cd3f922 P f3a500981b494979b58d2b1041fec9c8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f3a500981b494979b58d2b1041fec9c8, State: Initialized, Role: FOLLOWER
I20260709 13:23:01.042450 15156 consensus_queue.cc:260] T b025139466084200b70879196cd3f922 P f3a500981b494979b58d2b1041fec9c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } } peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } } peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } }
I20260709 13:23:01.042579 14780 catalog_manager.cc:5697] T 7a4cf38d1a6644f082f401b9b26bfb27 P a1a22e9119494570b6d2217713fd7e43 reported cstate change: term changed from 0 to 1, leader changed from <none> to a1a22e9119494570b6d2217713fd7e43 (127.5.126.67). New cstate: current_term: 1 leader_uuid: "a1a22e9119494570b6d2217713fd7e43" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } health_report { overall_health: UNKNOWN } } }
I20260709 13:23:01.046120 15156 ts_tablet_manager.cc:1434] T b025139466084200b70879196cd3f922 P f3a500981b494979b58d2b1041fec9c8: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.002s
I20260709 13:23:01.046613 15213 leader_election.cc:290] T 7a4cf38d1a6644f082f401b9b26bfb27 P a722e54d227f4c29a9ed6ce77858003a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a1a22e9119494570b6d2217713fd7e43 (127.5.126.67:38125), f3a500981b494979b58d2b1041fec9c8 (127.5.126.65:34129)
I20260709 13:23:01.047745 15156 tablet_bootstrap.cc:492] T 0819f8999271428481a1f839026171a7 P f3a500981b494979b58d2b1041fec9c8: Bootstrap starting.
I20260709 13:23:01.050377 14884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a4cf38d1a6644f082f401b9b26bfb27" candidate_uuid: "a722e54d227f4c29a9ed6ce77858003a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f3a500981b494979b58d2b1041fec9c8" is_pre_election: true
I20260709 13:23:01.051403 14884 raft_consensus.cc:2393] T 7a4cf38d1a6644f082f401b9b26bfb27 P f3a500981b494979b58d2b1041fec9c8 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a722e54d227f4c29a9ed6ce77858003a in current term 1: Already voted for candidate a1a22e9119494570b6d2217713fd7e43 in this term.
I20260709 13:23:01.054947 15031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a4cf38d1a6644f082f401b9b26bfb27" candidate_uuid: "a722e54d227f4c29a9ed6ce77858003a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1a22e9119494570b6d2217713fd7e43" is_pre_election: true
I20260709 13:23:01.055233 15156 tablet_bootstrap.cc:654] T 0819f8999271428481a1f839026171a7 P f3a500981b494979b58d2b1041fec9c8: Neither blocks nor log segments found. Creating new log.
I20260709 13:23:01.055871 15154 ts_tablet_manager.cc:1434] T 7a4cf38d1a6644f082f401b9b26bfb27 P a722e54d227f4c29a9ed6ce77858003a: Time spent starting tablet: real 0.078s	user 0.010s	sys 0.000s
I20260709 13:23:01.057361 15154 tablet_bootstrap.cc:492] T ced632bda66e4a74b9c854befbcbac9b P a722e54d227f4c29a9ed6ce77858003a: Bootstrap starting.
I20260709 13:23:01.060469 15213 consensus_queue.cc:1048] T f954c6c25a25443abd9705c8e909bf47 P a722e54d227f4c29a9ed6ce77858003a [LEADER]: Connected to new peer: Peer: permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:23:01.062533 15072 leader_election.cc:304] T 7a4cf38d1a6644f082f401b9b26bfb27 P a722e54d227f4c29a9ed6ce77858003a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a722e54d227f4c29a9ed6ce77858003a; no voters: a1a22e9119494570b6d2217713fd7e43, f3a500981b494979b58d2b1041fec9c8
I20260709 13:23:01.073338 15355 consensus_queue.cc:1048] T 7b8e0fe5ef6d4c42b9854399aac3a1d6 P a1a22e9119494570b6d2217713fd7e43 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:23:01.074869 15153 tablet_bootstrap.cc:654] T e3693e8a3b0444bf978dc845dcfd2a45 P 0efc951052454eec9a58b0cd025945b8: Neither blocks nor log segments found. Creating new log.
I20260709 13:23:01.070808 15213 raft_consensus.cc:3060] T 7a4cf38d1a6644f082f401b9b26bfb27 P a722e54d227f4c29a9ed6ce77858003a [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:23:01.081334 14850 consensus_peers.cc:597] T aecef3c240394d54844ec8170e9cad59 P f3a500981b494979b58d2b1041fec9c8 -> Peer a722e54d227f4c29a9ed6ce77858003a (127.5.126.68:46669): Couldn't send request to peer a722e54d227f4c29a9ed6ce77858003a. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:23:01.085034 14959 raft_consensus.cc:3060] T f954c6c25a25443abd9705c8e909bf47 P 0efc951052454eec9a58b0cd025945b8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:23:01.099414 15213 raft_consensus.cc:2749] T 7a4cf38d1a6644f082f401b9b26bfb27 P a722e54d227f4c29a9ed6ce77858003a [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:23:01.112377 15156 tablet_bootstrap.cc:492] T 0819f8999271428481a1f839026171a7 P f3a500981b494979b58d2b1041fec9c8: No bootstrap required, opened a new log
I20260709 13:23:01.112879 15156 ts_tablet_manager.cc:1403] T 0819f8999271428481a1f839026171a7 P f3a500981b494979b58d2b1041fec9c8: Time spent bootstrapping tablet: real 0.066s	user 0.015s	sys 0.013s
I20260709 13:23:01.115100 15156 raft_consensus.cc:359] T 0819f8999271428481a1f839026171a7 P f3a500981b494979b58d2b1041fec9c8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } } peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } } peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } }
I20260709 13:23:01.115653 15156 raft_consensus.cc:385] T 0819f8999271428481a1f839026171a7 P f3a500981b494979b58d2b1041fec9c8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:23:01.115869 15156 raft_consensus.cc:740] T 0819f8999271428481a1f839026171a7 P f3a500981b494979b58d2b1041fec9c8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f3a500981b494979b58d2b1041fec9c8, State: Initialized, Role: FOLLOWER
I20260709 13:23:01.116566 15156 consensus_queue.cc:260] T 0819f8999271428481a1f839026171a7 P f3a500981b494979b58d2b1041fec9c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } } peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } } peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } }
I20260709 13:23:01.118685 15156 ts_tablet_manager.cc:1434] T 0819f8999271428481a1f839026171a7 P f3a500981b494979b58d2b1041fec9c8: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 13:23:01.119552 15156 tablet_bootstrap.cc:492] T 03b63e2bee374ed5931dab67ee14b555 P f3a500981b494979b58d2b1041fec9c8: Bootstrap starting.
I20260709 13:23:01.102273 15154 tablet_bootstrap.cc:654] T ced632bda66e4a74b9c854befbcbac9b P a722e54d227f4c29a9ed6ce77858003a: Neither blocks nor log segments found. Creating new log.
I20260709 13:23:01.105808 15259 consensus_queue.cc:1048] T aecef3c240394d54844ec8170e9cad59 P f3a500981b494979b58d2b1041fec9c8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:23:01.077750 15155 tablet_bootstrap.cc:492] T e3693e8a3b0444bf978dc845dcfd2a45 P a1a22e9119494570b6d2217713fd7e43: No bootstrap required, opened a new log
I20260709 13:23:01.122241 15155 ts_tablet_manager.cc:1403] T e3693e8a3b0444bf978dc845dcfd2a45 P a1a22e9119494570b6d2217713fd7e43: Time spent bootstrapping tablet: real 0.286s	user 0.006s	sys 0.019s
I20260709 13:23:01.125077 15156 tablet_bootstrap.cc:654] T 03b63e2bee374ed5931dab67ee14b555 P f3a500981b494979b58d2b1041fec9c8: Neither blocks nor log segments found. Creating new log.
I20260709 13:23:01.152509 15155 raft_consensus.cc:359] T e3693e8a3b0444bf978dc845dcfd2a45 P a1a22e9119494570b6d2217713fd7e43 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } } peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } } peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } }
I20260709 13:23:01.155073 15211 raft_consensus.cc:493] T f954c6c25a25443abd9705c8e909bf47 P 0efc951052454eec9a58b0cd025945b8 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:23:01.155622 15155 raft_consensus.cc:385] T e3693e8a3b0444bf978dc845dcfd2a45 P a1a22e9119494570b6d2217713fd7e43 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:23:01.155931 15211 raft_consensus.cc:515] T f954c6c25a25443abd9705c8e909bf47 P 0efc951052454eec9a58b0cd025945b8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } } peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } } peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } }
I20260709 13:23:01.156050 15155 raft_consensus.cc:740] T e3693e8a3b0444bf978dc845dcfd2a45 P a1a22e9119494570b6d2217713fd7e43 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a1a22e9119494570b6d2217713fd7e43, State: Initialized, Role: FOLLOWER
I20260709 13:23:01.159085 15155 consensus_queue.cc:260] T e3693e8a3b0444bf978dc845dcfd2a45 P a1a22e9119494570b6d2217713fd7e43 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } } peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } } peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } }
I20260709 13:23:01.162150 15155 ts_tablet_manager.cc:1434] T e3693e8a3b0444bf978dc845dcfd2a45 P a1a22e9119494570b6d2217713fd7e43: Time spent starting tablet: real 0.039s	user 0.009s	sys 0.000s
I20260709 13:23:01.164023 15155 tablet_bootstrap.cc:492] T e4a490a7748841c3803607059f9d8825 P a1a22e9119494570b6d2217713fd7e43: Bootstrap starting.
I20260709 13:23:01.170527 14884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f954c6c25a25443abd9705c8e909bf47" candidate_uuid: "0efc951052454eec9a58b0cd025945b8" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f3a500981b494979b58d2b1041fec9c8" is_pre_election: true
I20260709 13:23:01.176637 15108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f954c6c25a25443abd9705c8e909bf47" candidate_uuid: "0efc951052454eec9a58b0cd025945b8" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a722e54d227f4c29a9ed6ce77858003a" is_pre_election: true
I20260709 13:23:01.178791 14925 leader_election.cc:304] T f954c6c25a25443abd9705c8e909bf47 P 0efc951052454eec9a58b0cd025945b8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0efc951052454eec9a58b0cd025945b8; no voters: a722e54d227f4c29a9ed6ce77858003a, f3a500981b494979b58d2b1041fec9c8
I20260709 13:23:01.184600 15215 raft_consensus.cc:2749] T f954c6c25a25443abd9705c8e909bf47 P 0efc951052454eec9a58b0cd025945b8 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:23:01.182781 15211 leader_election.cc:290] T f954c6c25a25443abd9705c8e909bf47 P 0efc951052454eec9a58b0cd025945b8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a722e54d227f4c29a9ed6ce77858003a (127.5.126.68:46669), f3a500981b494979b58d2b1041fec9c8 (127.5.126.65:34129)
I20260709 13:23:01.187176 15156 tablet_bootstrap.cc:492] T 03b63e2bee374ed5931dab67ee14b555 P f3a500981b494979b58d2b1041fec9c8: No bootstrap required, opened a new log
I20260709 13:23:01.188016 15156 ts_tablet_manager.cc:1403] T 03b63e2bee374ed5931dab67ee14b555 P f3a500981b494979b58d2b1041fec9c8: Time spent bootstrapping tablet: real 0.069s	user 0.013s	sys 0.010s
I20260709 13:23:01.188951 14884 raft_consensus.cc:3060] T 0819f8999271428481a1f839026171a7 P f3a500981b494979b58d2b1041fec9c8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:23:01.192286 15156 raft_consensus.cc:359] T 03b63e2bee374ed5931dab67ee14b555 P f3a500981b494979b58d2b1041fec9c8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } } peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } } peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } }
I20260709 13:23:01.193878 15156 raft_consensus.cc:385] T 03b63e2bee374ed5931dab67ee14b555 P f3a500981b494979b58d2b1041fec9c8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:23:01.194243 15156 raft_consensus.cc:740] T 03b63e2bee374ed5931dab67ee14b555 P f3a500981b494979b58d2b1041fec9c8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f3a500981b494979b58d2b1041fec9c8, State: Initialized, Role: FOLLOWER
I20260709 13:23:01.195227 15156 consensus_queue.cc:260] T 03b63e2bee374ed5931dab67ee14b555 P f3a500981b494979b58d2b1041fec9c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } } peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } } peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } }
I20260709 13:23:01.199265 15156 ts_tablet_manager.cc:1434] T 03b63e2bee374ed5931dab67ee14b555 P f3a500981b494979b58d2b1041fec9c8: Time spent starting tablet: real 0.011s	user 0.004s	sys 0.004s
I20260709 13:23:01.201484 15156 tablet_bootstrap.cc:492] T 2a862e106a9e48a692bc72ea8c03ab39 P f3a500981b494979b58d2b1041fec9c8: Bootstrap starting.
I20260709 13:23:01.202534 15282 consensus_queue.cc:1048] T f954c6c25a25443abd9705c8e909bf47 P a722e54d227f4c29a9ed6ce77858003a [LEADER]: Connected to new peer: Peer: permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:23:01.213546 15156 tablet_bootstrap.cc:654] T 2a862e106a9e48a692bc72ea8c03ab39 P f3a500981b494979b58d2b1041fec9c8: Neither blocks nor log segments found. Creating new log.
I20260709 13:23:01.217603 15153 tablet_bootstrap.cc:492] T e3693e8a3b0444bf978dc845dcfd2a45 P 0efc951052454eec9a58b0cd025945b8: No bootstrap required, opened a new log
I20260709 13:23:01.218436 15153 ts_tablet_manager.cc:1403] T e3693e8a3b0444bf978dc845dcfd2a45 P 0efc951052454eec9a58b0cd025945b8: Time spent bootstrapping tablet: real 0.209s	user 0.025s	sys 0.030s
I20260709 13:23:01.227628 15153 raft_consensus.cc:359] T e3693e8a3b0444bf978dc845dcfd2a45 P 0efc951052454eec9a58b0cd025945b8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } } peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } } peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } }
I20260709 13:23:01.228755 15153 raft_consensus.cc:385] T e3693e8a3b0444bf978dc845dcfd2a45 P 0efc951052454eec9a58b0cd025945b8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:23:01.229087 15153 raft_consensus.cc:740] T e3693e8a3b0444bf978dc845dcfd2a45 P 0efc951052454eec9a58b0cd025945b8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0efc951052454eec9a58b0cd025945b8, State: Initialized, Role: FOLLOWER
I20260709 13:23:01.230089 15153 consensus_queue.cc:260] T e3693e8a3b0444bf978dc845dcfd2a45 P 0efc951052454eec9a58b0cd025945b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } } peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } } peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } }
I20260709 13:23:01.231884 15153 ts_tablet_manager.cc:1434] T e3693e8a3b0444bf978dc845dcfd2a45 P 0efc951052454eec9a58b0cd025945b8: Time spent starting tablet: real 0.013s	user 0.001s	sys 0.006s
I20260709 13:23:01.233160 15153 tablet_bootstrap.cc:492] T e429eefef04d433e8f18dfbc0387068d P 0efc951052454eec9a58b0cd025945b8: Bootstrap starting.
I20260709 13:23:01.248580 15154 tablet_bootstrap.cc:492] T ced632bda66e4a74b9c854befbcbac9b P a722e54d227f4c29a9ed6ce77858003a: No bootstrap required, opened a new log
I20260709 13:23:01.249442 15154 ts_tablet_manager.cc:1403] T ced632bda66e4a74b9c854befbcbac9b P a722e54d227f4c29a9ed6ce77858003a: Time spent bootstrapping tablet: real 0.192s	user 0.031s	sys 0.034s
I20260709 13:23:01.252604 15155 tablet_bootstrap.cc:654] T e4a490a7748841c3803607059f9d8825 P a1a22e9119494570b6d2217713fd7e43: Neither blocks nor log segments found. Creating new log.
I20260709 13:23:01.252485 15259 raft_consensus.cc:493] T 03b63e2bee374ed5931dab67ee14b555 P f3a500981b494979b58d2b1041fec9c8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:23:01.253520 15259 raft_consensus.cc:515] T 03b63e2bee374ed5931dab67ee14b555 P f3a500981b494979b58d2b1041fec9c8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } } peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } } peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } }
I20260709 13:23:01.255030 15154 raft_consensus.cc:359] T ced632bda66e4a74b9c854befbcbac9b P a722e54d227f4c29a9ed6ce77858003a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } } peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } } peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } }
I20260709 13:23:01.256088 15154 raft_consensus.cc:385] T ced632bda66e4a74b9c854befbcbac9b P a722e54d227f4c29a9ed6ce77858003a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:23:01.257606 15031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03b63e2bee374ed5931dab67ee14b555" candidate_uuid: "f3a500981b494979b58d2b1041fec9c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1a22e9119494570b6d2217713fd7e43" is_pre_election: true
I20260709 13:23:01.258572 15031 raft_consensus.cc:2468] T 03b63e2bee374ed5931dab67ee14b555 P a1a22e9119494570b6d2217713fd7e43 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f3a500981b494979b58d2b1041fec9c8 in term 0.
I20260709 13:23:01.257706 15106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03b63e2bee374ed5931dab67ee14b555" candidate_uuid: "f3a500981b494979b58d2b1041fec9c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a722e54d227f4c29a9ed6ce77858003a" is_pre_election: true
I20260709 13:23:01.256419 15154 raft_consensus.cc:740] T ced632bda66e4a74b9c854befbcbac9b P a722e54d227f4c29a9ed6ce77858003a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a722e54d227f4c29a9ed6ce77858003a, State: Initialized, Role: FOLLOWER
I20260709 13:23:01.274782 15154 consensus_queue.cc:260] T ced632bda66e4a74b9c854befbcbac9b P a722e54d227f4c29a9ed6ce77858003a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } } peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } } peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } }
I20260709 13:23:01.256512 15259 leader_election.cc:290] T 03b63e2bee374ed5931dab67ee14b555 P f3a500981b494979b58d2b1041fec9c8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a1a22e9119494570b6d2217713fd7e43 (127.5.126.67:38125), a722e54d227f4c29a9ed6ce77858003a (127.5.126.68:46669)
I20260709 13:23:01.264457 15326 consensus_queue.cc:1048] T 7a4cf38d1a6644f082f401b9b26bfb27 P a1a22e9119494570b6d2217713fd7e43 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.015s
I20260709 13:23:01.265369 14849 leader_election.cc:304] T 03b63e2bee374ed5931dab67ee14b555 P f3a500981b494979b58d2b1041fec9c8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1a22e9119494570b6d2217713fd7e43, f3a500981b494979b58d2b1041fec9c8; no voters: 
I20260709 13:23:01.283907 15108 raft_consensus.cc:3060] T f0424da0ffb84ba5931fe92f6dd57c5f P a722e54d227f4c29a9ed6ce77858003a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:23:01.287227 15364 raft_consensus.cc:2804] T 03b63e2bee374ed5931dab67ee14b555 P f3a500981b494979b58d2b1041fec9c8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:23:01.294739 15153 tablet_bootstrap.cc:654] T e429eefef04d433e8f18dfbc0387068d P 0efc951052454eec9a58b0cd025945b8: Neither blocks nor log segments found. Creating new log.
I20260709 13:23:01.287767 15364 raft_consensus.cc:493] T 03b63e2bee374ed5931dab67ee14b555 P f3a500981b494979b58d2b1041fec9c8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:23:01.296183 15364 raft_consensus.cc:3060] T 03b63e2bee374ed5931dab67ee14b555 P f3a500981b494979b58d2b1041fec9c8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:23:01.307596 15260 raft_consensus.cc:493] T e3693e8a3b0444bf978dc845dcfd2a45 P f3a500981b494979b58d2b1041fec9c8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:23:01.303670 14850 leader_election.cc:343] T 03b63e2bee374ed5931dab67ee14b555 P f3a500981b494979b58d2b1041fec9c8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a722e54d227f4c29a9ed6ce77858003a (127.5.126.68:46669): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:23:01.307152 15154 ts_tablet_manager.cc:1434] T ced632bda66e4a74b9c854befbcbac9b P a722e54d227f4c29a9ed6ce77858003a: Time spent starting tablet: real 0.057s	user 0.008s	sys 0.002s
W20260709 13:23:01.313045 14850 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.68:46669, user_credentials={real_user=slave}} blocked reactor thread for 49999.5us
I20260709 13:23:01.314895 15154 tablet_bootstrap.cc:492] T aecef3c240394d54844ec8170e9cad59 P a722e54d227f4c29a9ed6ce77858003a: Bootstrap starting.
I20260709 13:23:01.316511 15156 tablet_bootstrap.cc:492] T 2a862e106a9e48a692bc72ea8c03ab39 P f3a500981b494979b58d2b1041fec9c8: No bootstrap required, opened a new log
I20260709 13:23:01.317155 15156 ts_tablet_manager.cc:1403] T 2a862e106a9e48a692bc72ea8c03ab39 P f3a500981b494979b58d2b1041fec9c8: Time spent bootstrapping tablet: real 0.117s	user 0.019s	sys 0.026s
I20260709 13:23:01.321133 15260 raft_consensus.cc:515] T e3693e8a3b0444bf978dc845dcfd2a45 P f3a500981b494979b58d2b1041fec9c8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } } peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } } peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } }
I20260709 13:23:01.326716 15260 leader_election.cc:290] T e3693e8a3b0444bf978dc845dcfd2a45 P f3a500981b494979b58d2b1041fec9c8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0efc951052454eec9a58b0cd025945b8 (127.5.126.66:34613), a1a22e9119494570b6d2217713fd7e43 (127.5.126.67:38125)
I20260709 13:23:01.344414 15032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3693e8a3b0444bf978dc845dcfd2a45" candidate_uuid: "f3a500981b494979b58d2b1041fec9c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1a22e9119494570b6d2217713fd7e43" is_pre_election: true
I20260709 13:23:01.339322 15326 raft_consensus.cc:493] T e3693e8a3b0444bf978dc845dcfd2a45 P a1a22e9119494570b6d2217713fd7e43 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:23:01.345865 15326 raft_consensus.cc:515] T e3693e8a3b0444bf978dc845dcfd2a45 P a1a22e9119494570b6d2217713fd7e43 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } } peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } } peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } }
I20260709 13:23:01.346733 15156 raft_consensus.cc:359] T 2a862e106a9e48a692bc72ea8c03ab39 P f3a500981b494979b58d2b1041fec9c8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } } peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } } peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } }
I20260709 13:23:01.347225 15032 raft_consensus.cc:2468] T e3693e8a3b0444bf978dc845dcfd2a45 P a1a22e9119494570b6d2217713fd7e43 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f3a500981b494979b58d2b1041fec9c8 in term 0.
I20260709 13:23:01.355013 15155 tablet_bootstrap.cc:492] T e4a490a7748841c3803607059f9d8825 P a1a22e9119494570b6d2217713fd7e43: No bootstrap required, opened a new log
I20260709 13:23:01.355718 15155 ts_tablet_manager.cc:1403] T e4a490a7748841c3803607059f9d8825 P a1a22e9119494570b6d2217713fd7e43: Time spent bootstrapping tablet: real 0.192s	user 0.021s	sys 0.037s
I20260709 13:23:01.361423 15211 consensus_queue.cc:1048] T 2a862e106a9e48a692bc72ea8c03ab39 P 0efc951052454eec9a58b0cd025945b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:23:01.347533 15156 raft_consensus.cc:385] T 2a862e106a9e48a692bc72ea8c03ab39 P f3a500981b494979b58d2b1041fec9c8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:23:01.364125 15156 raft_consensus.cc:740] T 2a862e106a9e48a692bc72ea8c03ab39 P f3a500981b494979b58d2b1041fec9c8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f3a500981b494979b58d2b1041fec9c8, State: Initialized, Role: FOLLOWER
I20260709 13:23:01.368363 15258 raft_consensus.cc:493] T b025139466084200b70879196cd3f922 P f3a500981b494979b58d2b1041fec9c8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:23:01.373064 15155 raft_consensus.cc:359] T e4a490a7748841c3803607059f9d8825 P a1a22e9119494570b6d2217713fd7e43 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } } peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } } peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } }
I20260709 13:23:01.376344 15155 raft_consensus.cc:385] T e4a490a7748841c3803607059f9d8825 P a1a22e9119494570b6d2217713fd7e43 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:23:01.376750 15155 raft_consensus.cc:740] T e4a490a7748841c3803607059f9d8825 P a1a22e9119494570b6d2217713fd7e43 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a1a22e9119494570b6d2217713fd7e43, State: Initialized, Role: FOLLOWER
I20260709 13:23:01.376344 15156 consensus_queue.cc:260] T 2a862e106a9e48a692bc72ea8c03ab39 P f3a500981b494979b58d2b1041fec9c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } } peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } } peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } }
I20260709 13:23:01.381171 15155 consensus_queue.cc:260] T e4a490a7748841c3803607059f9d8825 P a1a22e9119494570b6d2217713fd7e43 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } } peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } } peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } }
I20260709 13:23:01.378691 15258 raft_consensus.cc:515] T b025139466084200b70879196cd3f922 P f3a500981b494979b58d2b1041fec9c8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } } peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } } peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } }
I20260709 13:23:01.401067 15258 leader_election.cc:290] T b025139466084200b70879196cd3f922 P f3a500981b494979b58d2b1041fec9c8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0efc951052454eec9a58b0cd025945b8 (127.5.126.66:34613), a1a22e9119494570b6d2217713fd7e43 (127.5.126.67:38125)
I20260709 13:23:01.402047 14958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3693e8a3b0444bf978dc845dcfd2a45" candidate_uuid: "f3a500981b494979b58d2b1041fec9c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0efc951052454eec9a58b0cd025945b8" is_pre_election: true
I20260709 13:23:01.403174 14958 raft_consensus.cc:2468] T e3693e8a3b0444bf978dc845dcfd2a45 P 0efc951052454eec9a58b0cd025945b8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f3a500981b494979b58d2b1041fec9c8 in term 0.
I20260709 13:23:01.411950 15326 leader_election.cc:290] T e3693e8a3b0444bf978dc845dcfd2a45 P a1a22e9119494570b6d2217713fd7e43 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f3a500981b494979b58d2b1041fec9c8 (127.5.126.65:34129), 0efc951052454eec9a58b0cd025945b8 (127.5.126.66:34613)
W20260709 13:23:01.416913 14925 consensus_peers.cc:597] T 2a862e106a9e48a692bc72ea8c03ab39 P 0efc951052454eec9a58b0cd025945b8 -> Peer f3a500981b494979b58d2b1041fec9c8 (127.5.126.65:34129): Couldn't send request to peer f3a500981b494979b58d2b1041fec9c8. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:23:01.386221 15364 raft_consensus.cc:515] T 03b63e2bee374ed5931dab67ee14b555 P f3a500981b494979b58d2b1041fec9c8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } } peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } } peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } }
I20260709 13:23:01.432879 15156 ts_tablet_manager.cc:1434] T 2a862e106a9e48a692bc72ea8c03ab39 P f3a500981b494979b58d2b1041fec9c8: Time spent starting tablet: real 0.115s	user 0.007s	sys 0.001s
I20260709 13:23:01.434269 15156 tablet_bootstrap.cc:492] T 107541237b4a452e8b47b0c3527b7ede P f3a500981b494979b58d2b1041fec9c8: Bootstrap starting.
I20260709 13:23:01.434950 15106 raft_consensus.cc:3060] T ced632bda66e4a74b9c854befbcbac9b P a722e54d227f4c29a9ed6ce77858003a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:23:01.437496 15155 ts_tablet_manager.cc:1434] T e4a490a7748841c3803607059f9d8825 P a1a22e9119494570b6d2217713fd7e43: Time spent starting tablet: real 0.081s	user 0.010s	sys 0.002s
I20260709 13:23:01.432927 15364 leader_election.cc:290] T 03b63e2bee374ed5931dab67ee14b555 P f3a500981b494979b58d2b1041fec9c8 [CANDIDATE]: Term 1 election: Requested vote from peers a1a22e9119494570b6d2217713fd7e43 (127.5.126.67:38125), a722e54d227f4c29a9ed6ce77858003a (127.5.126.68:46669)
I20260709 13:23:01.452844 14885 raft_consensus.cc:3060] T b025139466084200b70879196cd3f922 P f3a500981b494979b58d2b1041fec9c8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:23:01.455029 14958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3693e8a3b0444bf978dc845dcfd2a45" candidate_uuid: "a1a22e9119494570b6d2217713fd7e43" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0efc951052454eec9a58b0cd025945b8" is_pre_election: true
I20260709 13:23:01.458830 15156 tablet_bootstrap.cc:654] T 107541237b4a452e8b47b0c3527b7ede P f3a500981b494979b58d2b1041fec9c8: Neither blocks nor log segments found. Creating new log.
I20260709 13:23:01.465842 15282 raft_consensus.cc:493] T ced632bda66e4a74b9c854befbcbac9b P a722e54d227f4c29a9ed6ce77858003a [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:23:01.443068 14849 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.67:38125, user_credentials={real_user=slave}} blocked reactor thread for 72649.3us
I20260709 13:23:01.459618 15153 tablet_bootstrap.cc:492] T e429eefef04d433e8f18dfbc0387068d P 0efc951052454eec9a58b0cd025945b8: No bootstrap required, opened a new log
I20260709 13:23:01.468968 15153 ts_tablet_manager.cc:1403] T e429eefef04d433e8f18dfbc0387068d P 0efc951052454eec9a58b0cd025945b8: Time spent bootstrapping tablet: real 0.236s	user 0.007s	sys 0.039s
I20260709 13:23:01.467294 15282 raft_consensus.cc:515] T ced632bda66e4a74b9c854befbcbac9b P a722e54d227f4c29a9ed6ce77858003a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } } peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } } peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } }
I20260709 13:23:01.466796 14958 raft_consensus.cc:2468] T e3693e8a3b0444bf978dc845dcfd2a45 P 0efc951052454eec9a58b0cd025945b8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1a22e9119494570b6d2217713fd7e43 in term 0.
I20260709 13:23:01.474527 15282 leader_election.cc:290] T ced632bda66e4a74b9c854befbcbac9b P a722e54d227f4c29a9ed6ce77858003a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0efc951052454eec9a58b0cd025945b8 (127.5.126.66:34613), a1a22e9119494570b6d2217713fd7e43 (127.5.126.67:38125)
I20260709 13:23:01.475644 15032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ced632bda66e4a74b9c854befbcbac9b" candidate_uuid: "a722e54d227f4c29a9ed6ce77858003a" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1a22e9119494570b6d2217713fd7e43" is_pre_election: true
I20260709 13:23:01.476385 14958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ced632bda66e4a74b9c854befbcbac9b" candidate_uuid: "a722e54d227f4c29a9ed6ce77858003a" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0efc951052454eec9a58b0cd025945b8" is_pre_election: true
I20260709 13:23:01.476199 14849 leader_election.cc:304] T e3693e8a3b0444bf978dc845dcfd2a45 P f3a500981b494979b58d2b1041fec9c8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1a22e9119494570b6d2217713fd7e43, f3a500981b494979b58d2b1041fec9c8; no voters: 
I20260709 13:23:01.477140 14958 raft_consensus.cc:2468] T ced632bda66e4a74b9c854befbcbac9b P 0efc951052454eec9a58b0cd025945b8 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a722e54d227f4c29a9ed6ce77858003a in term 1.
I20260709 13:23:01.469403 15155 tablet_bootstrap.cc:492] T 8996bae84ecc4bffa0239d64dce7b24f P a1a22e9119494570b6d2217713fd7e43: Bootstrap starting.
I20260709 13:23:01.478533 15073 leader_election.cc:304] T ced632bda66e4a74b9c854befbcbac9b P a722e54d227f4c29a9ed6ce77858003a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0efc951052454eec9a58b0cd025945b8, a722e54d227f4c29a9ed6ce77858003a; no voters: a1a22e9119494570b6d2217713fd7e43
I20260709 13:23:01.481304 15154 tablet_bootstrap.cc:654] T aecef3c240394d54844ec8170e9cad59 P a722e54d227f4c29a9ed6ce77858003a: Neither blocks nor log segments found. Creating new log.
I20260709 13:23:01.481956 15282 raft_consensus.cc:2804] T ced632bda66e4a74b9c854befbcbac9b P a722e54d227f4c29a9ed6ce77858003a [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:23:01.484851 15282 raft_consensus.cc:493] T ced632bda66e4a74b9c854befbcbac9b P a722e54d227f4c29a9ed6ce77858003a [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:23:01.485374 15326 consensus_queue.cc:1048] T ced632bda66e4a74b9c854befbcbac9b P a1a22e9119494570b6d2217713fd7e43 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:23:01.485515 14999 leader_election.cc:304] T e3693e8a3b0444bf978dc845dcfd2a45 P a1a22e9119494570b6d2217713fd7e43 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0efc951052454eec9a58b0cd025945b8, a1a22e9119494570b6d2217713fd7e43; no voters: 
I20260709 13:23:01.486975 15224 raft_consensus.cc:2804] T e3693e8a3b0444bf978dc845dcfd2a45 P a1a22e9119494570b6d2217713fd7e43 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:23:01.487068 15282 raft_consensus.cc:3060] T ced632bda66e4a74b9c854befbcbac9b P a722e54d227f4c29a9ed6ce77858003a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:23:01.487432 15224 raft_consensus.cc:493] T e3693e8a3b0444bf978dc845dcfd2a45 P a1a22e9119494570b6d2217713fd7e43 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:23:01.488372 15364 raft_consensus.cc:2804] T e3693e8a3b0444bf978dc845dcfd2a45 P f3a500981b494979b58d2b1041fec9c8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:23:01.488462 15224 raft_consensus.cc:3060] T e3693e8a3b0444bf978dc845dcfd2a45 P a1a22e9119494570b6d2217713fd7e43 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:23:01.488919 15364 raft_consensus.cc:493] T e3693e8a3b0444bf978dc845dcfd2a45 P f3a500981b494979b58d2b1041fec9c8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:23:01.489307 15364 raft_consensus.cc:3060] T e3693e8a3b0444bf978dc845dcfd2a45 P f3a500981b494979b58d2b1041fec9c8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:23:01.495517 15363 raft_consensus.cc:493] T 0819f8999271428481a1f839026171a7 P f3a500981b494979b58d2b1041fec9c8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a722e54d227f4c29a9ed6ce77858003a)
I20260709 13:23:01.496176 15363 raft_consensus.cc:515] T 0819f8999271428481a1f839026171a7 P f3a500981b494979b58d2b1041fec9c8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } } peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } } peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } }
I20260709 13:23:01.498919 15363 leader_election.cc:290] T 0819f8999271428481a1f839026171a7 P f3a500981b494979b58d2b1041fec9c8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a1a22e9119494570b6d2217713fd7e43 (127.5.126.67:38125), a722e54d227f4c29a9ed6ce77858003a (127.5.126.68:46669)
I20260709 13:23:01.505895 15364 raft_consensus.cc:515] T e3693e8a3b0444bf978dc845dcfd2a45 P f3a500981b494979b58d2b1041fec9c8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } } peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } } peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } }
I20260709 13:23:01.506271 15355 consensus_queue.cc:1048] T ced632bda66e4a74b9c854befbcbac9b P a1a22e9119494570b6d2217713fd7e43 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:23:01.506606 15224 raft_consensus.cc:515] T e3693e8a3b0444bf978dc845dcfd2a45 P a1a22e9119494570b6d2217713fd7e43 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } } peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } } peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } }
W20260709 13:23:01.482193 14850 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.66:34613, user_credentials={real_user=slave}} blocked reactor thread for 83584.9us
I20260709 13:23:01.509245 15032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b025139466084200b70879196cd3f922" candidate_uuid: "f3a500981b494979b58d2b1041fec9c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1a22e9119494570b6d2217713fd7e43" is_pre_election: true
I20260709 13:23:01.511438 15155 tablet_bootstrap.cc:654] T 8996bae84ecc4bffa0239d64dce7b24f P a1a22e9119494570b6d2217713fd7e43: Neither blocks nor log segments found. Creating new log.
I20260709 13:23:01.511974 14883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3693e8a3b0444bf978dc845dcfd2a45" candidate_uuid: "a1a22e9119494570b6d2217713fd7e43" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f3a500981b494979b58d2b1041fec9c8" is_pre_election: true
I20260709 13:23:01.512850 14960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b025139466084200b70879196cd3f922" candidate_uuid: "f3a500981b494979b58d2b1041fec9c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0efc951052454eec9a58b0cd025945b8" is_pre_election: true
I20260709 13:23:01.512902 14883 raft_consensus.cc:2393] T e3693e8a3b0444bf978dc845dcfd2a45 P f3a500981b494979b58d2b1041fec9c8 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a1a22e9119494570b6d2217713fd7e43 in current term 1: Already voted for candidate f3a500981b494979b58d2b1041fec9c8 in this term.
I20260709 13:23:01.514037 15033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03b63e2bee374ed5931dab67ee14b555" candidate_uuid: "f3a500981b494979b58d2b1041fec9c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1a22e9119494570b6d2217713fd7e43"
I20260709 13:23:01.514943 15032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0819f8999271428481a1f839026171a7" candidate_uuid: "f3a500981b494979b58d2b1041fec9c8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a1a22e9119494570b6d2217713fd7e43" is_pre_election: true
I20260709 13:23:01.515280 15033 raft_consensus.cc:3060] T 03b63e2bee374ed5931dab67ee14b555 P a1a22e9119494570b6d2217713fd7e43 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:23:01.521132 15107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03b63e2bee374ed5931dab67ee14b555" candidate_uuid: "f3a500981b494979b58d2b1041fec9c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a722e54d227f4c29a9ed6ce77858003a"
I20260709 13:23:01.523604 15107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0819f8999271428481a1f839026171a7" candidate_uuid: "f3a500981b494979b58d2b1041fec9c8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a722e54d227f4c29a9ed6ce77858003a" is_pre_election: true
I20260709 13:23:01.525197 15364 leader_election.cc:290] T e3693e8a3b0444bf978dc845dcfd2a45 P f3a500981b494979b58d2b1041fec9c8 [CANDIDATE]: Term 1 election: Requested vote from peers 0efc951052454eec9a58b0cd025945b8 (127.5.126.66:34613), a1a22e9119494570b6d2217713fd7e43 (127.5.126.67:38125)
I20260709 13:23:01.539718 15032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3693e8a3b0444bf978dc845dcfd2a45" candidate_uuid: "f3a500981b494979b58d2b1041fec9c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1a22e9119494570b6d2217713fd7e43"
I20260709 13:23:01.540638 15032 raft_consensus.cc:2393] T e3693e8a3b0444bf978dc845dcfd2a45 P a1a22e9119494570b6d2217713fd7e43 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate f3a500981b494979b58d2b1041fec9c8 in current term 1: Already voted for candidate a1a22e9119494570b6d2217713fd7e43 in this term.
I20260709 13:23:01.542459 15224 leader_election.cc:290] T e3693e8a3b0444bf978dc845dcfd2a45 P a1a22e9119494570b6d2217713fd7e43 [CANDIDATE]: Term 1 election: Requested vote from peers f3a500981b494979b58d2b1041fec9c8 (127.5.126.65:34129), 0efc951052454eec9a58b0cd025945b8 (127.5.126.66:34613)
I20260709 13:23:01.544701 15355 consensus_queue.cc:1048] T 7a4cf38d1a6644f082f401b9b26bfb27 P a1a22e9119494570b6d2217713fd7e43 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:23:01.543052 15153 raft_consensus.cc:359] T e429eefef04d433e8f18dfbc0387068d P 0efc951052454eec9a58b0cd025945b8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } } peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } } peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } }
I20260709 13:23:01.546124 15153 raft_consensus.cc:385] T e429eefef04d433e8f18dfbc0387068d P 0efc951052454eec9a58b0cd025945b8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:23:01.546414 15153 raft_consensus.cc:740] T e429eefef04d433e8f18dfbc0387068d P 0efc951052454eec9a58b0cd025945b8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0efc951052454eec9a58b0cd025945b8, State: Initialized, Role: FOLLOWER
I20260709 13:23:01.547112 15153 consensus_queue.cc:260] T e429eefef04d433e8f18dfbc0387068d P 0efc951052454eec9a58b0cd025945b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } } peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } } peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } }
I20260709 13:23:01.549572 14958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3693e8a3b0444bf978dc845dcfd2a45" candidate_uuid: "a1a22e9119494570b6d2217713fd7e43" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0efc951052454eec9a58b0cd025945b8"
I20260709 13:23:01.550679 15156 tablet_bootstrap.cc:492] T 107541237b4a452e8b47b0c3527b7ede P f3a500981b494979b58d2b1041fec9c8: No bootstrap required, opened a new log
W20260709 13:23:01.550837 14850 leader_election.cc:343] T 03b63e2bee374ed5931dab67ee14b555 P f3a500981b494979b58d2b1041fec9c8 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer a722e54d227f4c29a9ed6ce77858003a (127.5.126.68:46669): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:23:01.551319 15156 ts_tablet_manager.cc:1403] T 107541237b4a452e8b47b0c3527b7ede P f3a500981b494979b58d2b1041fec9c8: Time spent bootstrapping tablet: real 0.117s	user 0.009s	sys 0.007s
I20260709 13:23:01.554975 14959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3693e8a3b0444bf978dc845dcfd2a45" candidate_uuid: "f3a500981b494979b58d2b1041fec9c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0efc951052454eec9a58b0cd025945b8"
I20260709 13:23:01.555795 15153 ts_tablet_manager.cc:1434] T e429eefef04d433e8f18dfbc0387068d P 0efc951052454eec9a58b0cd025945b8: Time spent starting tablet: real 0.086s	user 0.004s	sys 0.002s
I20260709 13:23:01.550696 14958 raft_consensus.cc:3060] T e3693e8a3b0444bf978dc845dcfd2a45 P 0efc951052454eec9a58b0cd025945b8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:23:01.559154 15033 raft_consensus.cc:2468] T 03b63e2bee374ed5931dab67ee14b555 P a1a22e9119494570b6d2217713fd7e43 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f3a500981b494979b58d2b1041fec9c8 in term 1.
W20260709 13:23:01.569811 14830 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:23:01.563436 15282 raft_consensus.cc:515] T ced632bda66e4a74b9c854befbcbac9b P a722e54d227f4c29a9ed6ce77858003a [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } } peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } } peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } }
I20260709 13:23:01.551635 14850 leader_election.cc:304] T 0819f8999271428481a1f839026171a7 P f3a500981b494979b58d2b1041fec9c8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f3a500981b494979b58d2b1041fec9c8; no voters: a1a22e9119494570b6d2217713fd7e43, a722e54d227f4c29a9ed6ce77858003a
I20260709 13:23:01.577100 15364 raft_consensus.cc:2749] T 0819f8999271428481a1f839026171a7 P f3a500981b494979b58d2b1041fec9c8 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:23:01.584386 15153 tablet_bootstrap.cc:492] T e4f2c694c8194f1e86ad76c7ff051ea7 P 0efc951052454eec9a58b0cd025945b8: Bootstrap starting.
I20260709 13:23:01.583472 14884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3693e8a3b0444bf978dc845dcfd2a45" candidate_uuid: "a1a22e9119494570b6d2217713fd7e43" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f3a500981b494979b58d2b1041fec9c8"
I20260709 13:23:01.587924 15106 raft_consensus.cc:1240] T ced632bda66e4a74b9c854befbcbac9b P a722e54d227f4c29a9ed6ce77858003a [term 2 FOLLOWER]: Rejecting Update request from peer a1a22e9119494570b6d2217713fd7e43 for earlier term 1. Current term is 2. Ops: [1.1-1.1]
I20260709 13:23:01.588459 15156 raft_consensus.cc:359] T 107541237b4a452e8b47b0c3527b7ede P f3a500981b494979b58d2b1041fec9c8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } } peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } } peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } }
I20260709 13:23:01.592810 15156 raft_consensus.cc:385] T 107541237b4a452e8b47b0c3527b7ede P f3a500981b494979b58d2b1041fec9c8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:23:01.593104 15156 raft_consensus.cc:740] T 107541237b4a452e8b47b0c3527b7ede P f3a500981b494979b58d2b1041fec9c8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f3a500981b494979b58d2b1041fec9c8, State: Initialized, Role: FOLLOWER
I20260709 13:23:01.594063 14884 raft_consensus.cc:2393] T e3693e8a3b0444bf978dc845dcfd2a45 P f3a500981b494979b58d2b1041fec9c8 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate a1a22e9119494570b6d2217713fd7e43 in current term 1: Already voted for candidate f3a500981b494979b58d2b1041fec9c8 in this term.
I20260709 13:23:01.577809 14850 leader_election.cc:304] T b025139466084200b70879196cd3f922 P f3a500981b494979b58d2b1041fec9c8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f3a500981b494979b58d2b1041fec9c8; no voters: 0efc951052454eec9a58b0cd025945b8, a1a22e9119494570b6d2217713fd7e43
I20260709 13:23:01.596355 14850 leader_election.cc:304] T e3693e8a3b0444bf978dc845dcfd2a45 P f3a500981b494979b58d2b1041fec9c8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f3a500981b494979b58d2b1041fec9c8; no voters: 0efc951052454eec9a58b0cd025945b8, a1a22e9119494570b6d2217713fd7e43
I20260709 13:23:01.598827 15385 raft_consensus.cc:2749] T e3693e8a3b0444bf978dc845dcfd2a45 P f3a500981b494979b58d2b1041fec9c8 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:23:01.598160 15364 raft_consensus.cc:2749] T b025139466084200b70879196cd3f922 P f3a500981b494979b58d2b1041fec9c8 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:23:01.607901 15282 leader_election.cc:290] T ced632bda66e4a74b9c854befbcbac9b P a722e54d227f4c29a9ed6ce77858003a [CANDIDATE]: Term 2 election: Requested vote from peers 0efc951052454eec9a58b0cd025945b8 (127.5.126.66:34613), a1a22e9119494570b6d2217713fd7e43 (127.5.126.67:38125)
I20260709 13:23:01.609042 15156 consensus_queue.cc:260] T 107541237b4a452e8b47b0c3527b7ede P f3a500981b494979b58d2b1041fec9c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } } peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } } peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } }
I20260709 13:23:01.609477 15154 tablet_bootstrap.cc:492] T aecef3c240394d54844ec8170e9cad59 P a722e54d227f4c29a9ed6ce77858003a: No bootstrap required, opened a new log
I20260709 13:23:01.609617 14959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ced632bda66e4a74b9c854befbcbac9b" candidate_uuid: "a722e54d227f4c29a9ed6ce77858003a" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0efc951052454eec9a58b0cd025945b8"
I20260709 13:23:01.610383 15154 ts_tablet_manager.cc:1403] T aecef3c240394d54844ec8170e9cad59 P a722e54d227f4c29a9ed6ce77858003a: Time spent bootstrapping tablet: real 0.296s	user 0.023s	sys 0.014s
I20260709 13:23:01.610680 15033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ced632bda66e4a74b9c854befbcbac9b" candidate_uuid: "a722e54d227f4c29a9ed6ce77858003a" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1a22e9119494570b6d2217713fd7e43"
I20260709 13:23:01.611212 15156 ts_tablet_manager.cc:1434] T 107541237b4a452e8b47b0c3527b7ede P f3a500981b494979b58d2b1041fec9c8: Time spent starting tablet: real 0.060s	user 0.004s	sys 0.003s
I20260709 13:23:01.611954 14849 leader_election.cc:304] T 03b63e2bee374ed5931dab67ee14b555 P f3a500981b494979b58d2b1041fec9c8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a1a22e9119494570b6d2217713fd7e43, f3a500981b494979b58d2b1041fec9c8; no voters: a722e54d227f4c29a9ed6ce77858003a
I20260709 13:23:01.614060 15072 leader_election.cc:304] T ced632bda66e4a74b9c854befbcbac9b P a722e54d227f4c29a9ed6ce77858003a [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a722e54d227f4c29a9ed6ce77858003a; no voters: 0efc951052454eec9a58b0cd025945b8, a1a22e9119494570b6d2217713fd7e43
I20260709 13:23:01.615382 15282 raft_consensus.cc:2749] T ced632bda66e4a74b9c854befbcbac9b P a722e54d227f4c29a9ed6ce77858003a [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:23:01.615480 15385 raft_consensus.cc:2804] T 03b63e2bee374ed5931dab67ee14b555 P f3a500981b494979b58d2b1041fec9c8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:23:01.621387 15385 raft_consensus.cc:697] T 03b63e2bee374ed5931dab67ee14b555 P f3a500981b494979b58d2b1041fec9c8 [term 1 LEADER]: Becoming Leader. State: Replica: f3a500981b494979b58d2b1041fec9c8, State: Running, Role: LEADER
I20260709 13:23:01.622429 15385 consensus_queue.cc:237] T 03b63e2bee374ed5931dab67ee14b555 P f3a500981b494979b58d2b1041fec9c8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } } peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } } peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } }
I20260709 13:23:01.634653 15350 consensus_queue.cc:1059] T ced632bda66e4a74b9c854befbcbac9b P a1a22e9119494570b6d2217713fd7e43 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 }, Status: INVALID_TERM, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:23:01.635762 15350 raft_consensus.cc:3055] T ced632bda66e4a74b9c854befbcbac9b P a1a22e9119494570b6d2217713fd7e43 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:23:01.636194 15350 raft_consensus.cc:740] T ced632bda66e4a74b9c854befbcbac9b P a1a22e9119494570b6d2217713fd7e43 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a1a22e9119494570b6d2217713fd7e43, State: Running, Role: LEADER
I20260709 13:23:01.637099 15350 consensus_queue.cc:260] T ced632bda66e4a74b9c854befbcbac9b P a1a22e9119494570b6d2217713fd7e43 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } } peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } } peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } }
I20260709 13:23:01.639070 15350 raft_consensus.cc:3060] T ced632bda66e4a74b9c854befbcbac9b P a1a22e9119494570b6d2217713fd7e43 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:23:01.641356 15156 tablet_bootstrap.cc:492] T c3abd41db36d404089eaf1f9063bbcb0 P f3a500981b494979b58d2b1041fec9c8: Bootstrap starting.
I20260709 13:23:01.643211 15154 raft_consensus.cc:359] T aecef3c240394d54844ec8170e9cad59 P a722e54d227f4c29a9ed6ce77858003a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } } peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } } peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } }
I20260709 13:23:01.647221 15154 raft_consensus.cc:385] T aecef3c240394d54844ec8170e9cad59 P a722e54d227f4c29a9ed6ce77858003a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:23:01.649857 15154 raft_consensus.cc:740] T aecef3c240394d54844ec8170e9cad59 P a722e54d227f4c29a9ed6ce77858003a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a722e54d227f4c29a9ed6ce77858003a, State: Initialized, Role: FOLLOWER
I20260709 13:23:01.650816 15154 consensus_queue.cc:260] T aecef3c240394d54844ec8170e9cad59 P a722e54d227f4c29a9ed6ce77858003a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } } peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } } peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } }
I20260709 13:23:01.646624 15155 tablet_bootstrap.cc:492] T 8996bae84ecc4bffa0239d64dce7b24f P a1a22e9119494570b6d2217713fd7e43: No bootstrap required, opened a new log
I20260709 13:23:01.651662 15153 tablet_bootstrap.cc:654] T e4f2c694c8194f1e86ad76c7ff051ea7 P 0efc951052454eec9a58b0cd025945b8: Neither blocks nor log segments found. Creating new log.
I20260709 13:23:01.652206 15155 ts_tablet_manager.cc:1403] T 8996bae84ecc4bffa0239d64dce7b24f P a1a22e9119494570b6d2217713fd7e43: Time spent bootstrapping tablet: real 0.187s	user 0.023s	sys 0.004s
I20260709 13:23:01.647604 14958 raft_consensus.cc:2468] T e3693e8a3b0444bf978dc845dcfd2a45 P 0efc951052454eec9a58b0cd025945b8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1a22e9119494570b6d2217713fd7e43 in term 1.
I20260709 13:23:01.657975 14999 leader_election.cc:304] T e3693e8a3b0444bf978dc845dcfd2a45 P a1a22e9119494570b6d2217713fd7e43 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0efc951052454eec9a58b0cd025945b8, a1a22e9119494570b6d2217713fd7e43; no voters: f3a500981b494979b58d2b1041fec9c8
I20260709 13:23:01.659204 15224 raft_consensus.cc:2804] T e3693e8a3b0444bf978dc845dcfd2a45 P a1a22e9119494570b6d2217713fd7e43 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:23:01.659775 15224 raft_consensus.cc:697] T e3693e8a3b0444bf978dc845dcfd2a45 P a1a22e9119494570b6d2217713fd7e43 [term 1 LEADER]: Becoming Leader. State: Replica: a1a22e9119494570b6d2217713fd7e43, State: Running, Role: LEADER
I20260709 13:23:01.660805 15224 consensus_queue.cc:237] T e3693e8a3b0444bf978dc845dcfd2a45 P a1a22e9119494570b6d2217713fd7e43 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } } peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } } peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } }
I20260709 13:23:01.662312 15156 tablet_bootstrap.cc:654] T c3abd41db36d404089eaf1f9063bbcb0 P f3a500981b494979b58d2b1041fec9c8: Neither blocks nor log segments found. Creating new log.
I20260709 13:23:01.670096 15154 ts_tablet_manager.cc:1434] T aecef3c240394d54844ec8170e9cad59 P a722e54d227f4c29a9ed6ce77858003a: Time spent starting tablet: real 0.059s	user 0.005s	sys 0.003s
I20260709 13:23:01.671332 15154 tablet_bootstrap.cc:492] T e4f2c694c8194f1e86ad76c7ff051ea7 P a722e54d227f4c29a9ed6ce77858003a: Bootstrap starting.
I20260709 13:23:01.667799 15155 raft_consensus.cc:359] T 8996bae84ecc4bffa0239d64dce7b24f P a1a22e9119494570b6d2217713fd7e43 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } } peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } } peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } }
I20260709 13:23:01.677407 15155 raft_consensus.cc:385] T 8996bae84ecc4bffa0239d64dce7b24f P a1a22e9119494570b6d2217713fd7e43 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:23:01.677716 15155 raft_consensus.cc:740] T 8996bae84ecc4bffa0239d64dce7b24f P a1a22e9119494570b6d2217713fd7e43 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a1a22e9119494570b6d2217713fd7e43, State: Initialized, Role: FOLLOWER
I20260709 13:23:01.678490 15155 consensus_queue.cc:260] T 8996bae84ecc4bffa0239d64dce7b24f P a1a22e9119494570b6d2217713fd7e43 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } } peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } } peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } }
I20260709 13:23:01.678980 14780 catalog_manager.cc:5697] T e3693e8a3b0444bf978dc845dcfd2a45 P a1a22e9119494570b6d2217713fd7e43 reported cstate change: term changed from 0 to 1, leader changed from <none> to a1a22e9119494570b6d2217713fd7e43 (127.5.126.67). New cstate: current_term: 1 leader_uuid: "a1a22e9119494570b6d2217713fd7e43" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } health_report { overall_health: HEALTHY } } }
I20260709 13:23:01.685107 15153 tablet_bootstrap.cc:492] T e4f2c694c8194f1e86ad76c7ff051ea7 P 0efc951052454eec9a58b0cd025945b8: No bootstrap required, opened a new log
I20260709 13:23:01.685878 15153 ts_tablet_manager.cc:1403] T e4f2c694c8194f1e86ad76c7ff051ea7 P 0efc951052454eec9a58b0cd025945b8: Time spent bootstrapping tablet: real 0.106s	user 0.012s	sys 0.010s
I20260709 13:23:01.693749 15153 raft_consensus.cc:359] T e4f2c694c8194f1e86ad76c7ff051ea7 P 0efc951052454eec9a58b0cd025945b8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } } peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } } peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } }
I20260709 13:23:01.694584 15153 raft_consensus.cc:385] T e4f2c694c8194f1e86ad76c7ff051ea7 P 0efc951052454eec9a58b0cd025945b8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:23:01.694865 15153 raft_consensus.cc:740] T e4f2c694c8194f1e86ad76c7ff051ea7 P 0efc951052454eec9a58b0cd025945b8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0efc951052454eec9a58b0cd025945b8, State: Initialized, Role: FOLLOWER
I20260709 13:23:01.695604 15154 tablet_bootstrap.cc:654] T e4f2c694c8194f1e86ad76c7ff051ea7 P a722e54d227f4c29a9ed6ce77858003a: Neither blocks nor log segments found. Creating new log.
I20260709 13:23:01.695736 15153 consensus_queue.cc:260] T e4f2c694c8194f1e86ad76c7ff051ea7 P 0efc951052454eec9a58b0cd025945b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } } peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } } peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } }
I20260709 13:23:01.697160 15155 ts_tablet_manager.cc:1434] T 8996bae84ecc4bffa0239d64dce7b24f P a1a22e9119494570b6d2217713fd7e43: Time spent starting tablet: real 0.032s	user 0.006s	sys 0.001s
I20260709 13:23:01.700814 15155 tablet_bootstrap.cc:492] T 107541237b4a452e8b47b0c3527b7ede P a1a22e9119494570b6d2217713fd7e43: Bootstrap starting.
I20260709 13:23:01.707665 15153 ts_tablet_manager.cc:1434] T e4f2c694c8194f1e86ad76c7ff051ea7 P 0efc951052454eec9a58b0cd025945b8: Time spent starting tablet: real 0.021s	user 0.007s	sys 0.000s
I20260709 13:23:01.711874 15156 tablet_bootstrap.cc:492] T c3abd41db36d404089eaf1f9063bbcb0 P f3a500981b494979b58d2b1041fec9c8: No bootstrap required, opened a new log
I20260709 13:23:01.712553 15156 ts_tablet_manager.cc:1403] T c3abd41db36d404089eaf1f9063bbcb0 P f3a500981b494979b58d2b1041fec9c8: Time spent bootstrapping tablet: real 0.072s	user 0.018s	sys 0.009s
I20260709 13:23:01.715632 15156 raft_consensus.cc:359] T c3abd41db36d404089eaf1f9063bbcb0 P f3a500981b494979b58d2b1041fec9c8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } } peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } } peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } }
I20260709 13:23:01.717005 15153 tablet_bootstrap.cc:492] T decdd091b0f243d786ee350a437b30f1 P 0efc951052454eec9a58b0cd025945b8: Bootstrap starting.
I20260709 13:23:01.725648 15155 tablet_bootstrap.cc:654] T 107541237b4a452e8b47b0c3527b7ede P a1a22e9119494570b6d2217713fd7e43: Neither blocks nor log segments found. Creating new log.
I20260709 13:23:01.732308 15153 tablet_bootstrap.cc:654] T decdd091b0f243d786ee350a437b30f1 P 0efc951052454eec9a58b0cd025945b8: Neither blocks nor log segments found. Creating new log.
I20260709 13:23:01.716617 15156 raft_consensus.cc:385] T c3abd41db36d404089eaf1f9063bbcb0 P f3a500981b494979b58d2b1041fec9c8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:23:01.737114 15156 raft_consensus.cc:740] T c3abd41db36d404089eaf1f9063bbcb0 P f3a500981b494979b58d2b1041fec9c8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f3a500981b494979b58d2b1041fec9c8, State: Initialized, Role: FOLLOWER
I20260709 13:23:01.741910 15156 consensus_queue.cc:260] T c3abd41db36d404089eaf1f9063bbcb0 P f3a500981b494979b58d2b1041fec9c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } } peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } } peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } }
I20260709 13:23:01.744176 15154 tablet_bootstrap.cc:492] T e4f2c694c8194f1e86ad76c7ff051ea7 P a722e54d227f4c29a9ed6ce77858003a: No bootstrap required, opened a new log
I20260709 13:23:01.744807 15154 ts_tablet_manager.cc:1403] T e4f2c694c8194f1e86ad76c7ff051ea7 P a722e54d227f4c29a9ed6ce77858003a: Time spent bootstrapping tablet: real 0.074s	user 0.018s	sys 0.019s
I20260709 13:23:01.747799 15154 raft_consensus.cc:359] T e4f2c694c8194f1e86ad76c7ff051ea7 P a722e54d227f4c29a9ed6ce77858003a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } } peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } } peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } }
I20260709 13:23:01.748575 15154 raft_consensus.cc:385] T e4f2c694c8194f1e86ad76c7ff051ea7 P a722e54d227f4c29a9ed6ce77858003a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:23:01.748847 15154 raft_consensus.cc:740] T e4f2c694c8194f1e86ad76c7ff051ea7 P a722e54d227f4c29a9ed6ce77858003a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a722e54d227f4c29a9ed6ce77858003a, State: Initialized, Role: FOLLOWER
I20260709 13:23:01.749851 15156 ts_tablet_manager.cc:1434] T c3abd41db36d404089eaf1f9063bbcb0 P f3a500981b494979b58d2b1041fec9c8: Time spent starting tablet: real 0.037s	user 0.007s	sys 0.001s
I20260709 13:23:01.749656 15154 consensus_queue.cc:260] T e4f2c694c8194f1e86ad76c7ff051ea7 P a722e54d227f4c29a9ed6ce77858003a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } } peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } } peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } }
I20260709 13:23:01.751123 15156 tablet_bootstrap.cc:492] T 532cc9041f414e018098570192e0fae8 P f3a500981b494979b58d2b1041fec9c8: Bootstrap starting.
I20260709 13:23:01.752002 15154 ts_tablet_manager.cc:1434] T e4f2c694c8194f1e86ad76c7ff051ea7 P a722e54d227f4c29a9ed6ce77858003a: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:23:01.753340 15154 tablet_bootstrap.cc:492] T 8996bae84ecc4bffa0239d64dce7b24f P a722e54d227f4c29a9ed6ce77858003a: Bootstrap starting.
I20260709 13:23:01.755358 15153 tablet_bootstrap.cc:492] T decdd091b0f243d786ee350a437b30f1 P 0efc951052454eec9a58b0cd025945b8: No bootstrap required, opened a new log
I20260709 13:23:01.756822 15153 ts_tablet_manager.cc:1403] T decdd091b0f243d786ee350a437b30f1 P 0efc951052454eec9a58b0cd025945b8: Time spent bootstrapping tablet: real 0.041s	user 0.010s	sys 0.009s
I20260709 13:23:01.760248 15156 tablet_bootstrap.cc:654] T 532cc9041f414e018098570192e0fae8 P f3a500981b494979b58d2b1041fec9c8: Neither blocks nor log segments found. Creating new log.
I20260709 13:23:01.761911 15154 tablet_bootstrap.cc:654] T 8996bae84ecc4bffa0239d64dce7b24f P a722e54d227f4c29a9ed6ce77858003a: Neither blocks nor log segments found. Creating new log.
I20260709 13:23:01.763437 14885 raft_consensus.cc:3060] T 2a862e106a9e48a692bc72ea8c03ab39 P f3a500981b494979b58d2b1041fec9c8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:23:01.772852 15156 tablet_bootstrap.cc:492] T 532cc9041f414e018098570192e0fae8 P f3a500981b494979b58d2b1041fec9c8: No bootstrap required, opened a new log
I20260709 13:23:01.772769 15211 raft_consensus.cc:493] T e429eefef04d433e8f18dfbc0387068d P 0efc951052454eec9a58b0cd025945b8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:23:01.773808 15211 raft_consensus.cc:515] T e429eefef04d433e8f18dfbc0387068d P 0efc951052454eec9a58b0cd025945b8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } } peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } } peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } }
I20260709 13:23:01.777406 15033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e429eefef04d433e8f18dfbc0387068d" candidate_uuid: "0efc951052454eec9a58b0cd025945b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1a22e9119494570b6d2217713fd7e43" is_pre_election: true
I20260709 13:23:01.777683 15154 tablet_bootstrap.cc:492] T 8996bae84ecc4bffa0239d64dce7b24f P a722e54d227f4c29a9ed6ce77858003a: No bootstrap required, opened a new log
I20260709 13:23:01.778357 15154 ts_tablet_manager.cc:1403] T 8996bae84ecc4bffa0239d64dce7b24f P a722e54d227f4c29a9ed6ce77858003a: Time spent bootstrapping tablet: real 0.025s	user 0.010s	sys 0.008s
W20260709 13:23:01.779067 14924 leader_election.cc:343] T e429eefef04d433e8f18dfbc0387068d P 0efc951052454eec9a58b0cd025945b8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a1a22e9119494570b6d2217713fd7e43 (127.5.126.67:38125): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:23:01.780273 15211 leader_election.cc:290] T e429eefef04d433e8f18dfbc0387068d P 0efc951052454eec9a58b0cd025945b8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a1a22e9119494570b6d2217713fd7e43 (127.5.126.67:38125), a722e54d227f4c29a9ed6ce77858003a (127.5.126.68:46669)
I20260709 13:23:01.760360 15153 raft_consensus.cc:359] T decdd091b0f243d786ee350a437b30f1 P 0efc951052454eec9a58b0cd025945b8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } } peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } } peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } }
I20260709 13:23:01.783878 15105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e429eefef04d433e8f18dfbc0387068d" candidate_uuid: "0efc951052454eec9a58b0cd025945b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a722e54d227f4c29a9ed6ce77858003a" is_pre_election: true
I20260709 13:23:01.784060 15156 ts_tablet_manager.cc:1403] T 532cc9041f414e018098570192e0fae8 P f3a500981b494979b58d2b1041fec9c8: Time spent bootstrapping tablet: real 0.033s	user 0.003s	sys 0.017s
I20260709 13:23:01.785175 15105 raft_consensus.cc:2468] T e429eefef04d433e8f18dfbc0387068d P a722e54d227f4c29a9ed6ce77858003a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0efc951052454eec9a58b0cd025945b8 in term 0.
I20260709 13:23:01.786572 14925 leader_election.cc:304] T e429eefef04d433e8f18dfbc0387068d P 0efc951052454eec9a58b0cd025945b8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0efc951052454eec9a58b0cd025945b8, a722e54d227f4c29a9ed6ce77858003a; no voters: a1a22e9119494570b6d2217713fd7e43
I20260709 13:23:01.781718 15154 raft_consensus.cc:359] T 8996bae84ecc4bffa0239d64dce7b24f P a722e54d227f4c29a9ed6ce77858003a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } } peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } } peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } }
I20260709 13:23:01.787333 15154 raft_consensus.cc:385] T 8996bae84ecc4bffa0239d64dce7b24f P a722e54d227f4c29a9ed6ce77858003a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:23:01.787420 15211 raft_consensus.cc:2804] T e429eefef04d433e8f18dfbc0387068d P 0efc951052454eec9a58b0cd025945b8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:23:01.787719 15154 raft_consensus.cc:740] T 8996bae84ecc4bffa0239d64dce7b24f P a722e54d227f4c29a9ed6ce77858003a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a722e54d227f4c29a9ed6ce77858003a, State: Initialized, Role: FOLLOWER
I20260709 13:23:01.787863 15211 raft_consensus.cc:493] T e429eefef04d433e8f18dfbc0387068d P 0efc951052454eec9a58b0cd025945b8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:23:01.788348 15153 raft_consensus.cc:385] T decdd091b0f243d786ee350a437b30f1 P 0efc951052454eec9a58b0cd025945b8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:23:01.788669 15154 consensus_queue.cc:260] T 8996bae84ecc4bffa0239d64dce7b24f P a722e54d227f4c29a9ed6ce77858003a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } } peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } } peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } }
I20260709 13:23:01.789767 15211 raft_consensus.cc:3060] T e429eefef04d433e8f18dfbc0387068d P 0efc951052454eec9a58b0cd025945b8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:23:01.789669 15153 raft_consensus.cc:740] T decdd091b0f243d786ee350a437b30f1 P 0efc951052454eec9a58b0cd025945b8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0efc951052454eec9a58b0cd025945b8, State: Initialized, Role: FOLLOWER
I20260709 13:23:01.791599 15154 ts_tablet_manager.cc:1434] T 8996bae84ecc4bffa0239d64dce7b24f P a722e54d227f4c29a9ed6ce77858003a: Time spent starting tablet: real 0.013s	user 0.007s	sys 0.000s
I20260709 13:23:01.792282 15153 consensus_queue.cc:260] T decdd091b0f243d786ee350a437b30f1 P 0efc951052454eec9a58b0cd025945b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } } peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } } peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } }
I20260709 13:23:01.796458 15153 ts_tablet_manager.cc:1434] T decdd091b0f243d786ee350a437b30f1 P 0efc951052454eec9a58b0cd025945b8: Time spent starting tablet: real 0.039s	user 0.006s	sys 0.000s
I20260709 13:23:01.792778 15154 tablet_bootstrap.cc:492] T 03b63e2bee374ed5931dab67ee14b555 P a722e54d227f4c29a9ed6ce77858003a: Bootstrap starting.
I20260709 13:23:01.789196 15156 raft_consensus.cc:359] T 532cc9041f414e018098570192e0fae8 P f3a500981b494979b58d2b1041fec9c8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } } peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } } peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } }
I20260709 13:23:01.801653 15156 raft_consensus.cc:385] T 532cc9041f414e018098570192e0fae8 P f3a500981b494979b58d2b1041fec9c8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:23:01.802006 15156 raft_consensus.cc:740] T 532cc9041f414e018098570192e0fae8 P f3a500981b494979b58d2b1041fec9c8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f3a500981b494979b58d2b1041fec9c8, State: Initialized, Role: FOLLOWER
I20260709 13:23:01.802892 15153 tablet_bootstrap.cc:492] T 532cc9041f414e018098570192e0fae8 P 0efc951052454eec9a58b0cd025945b8: Bootstrap starting.
I20260709 13:23:01.800832 15161 raft_consensus.cc:493] T 8996bae84ecc4bffa0239d64dce7b24f P a722e54d227f4c29a9ed6ce77858003a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:23:01.804349 15161 raft_consensus.cc:515] T 8996bae84ecc4bffa0239d64dce7b24f P a722e54d227f4c29a9ed6ce77858003a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } } peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } } peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } }
I20260709 13:23:01.799798 15211 raft_consensus.cc:515] T e429eefef04d433e8f18dfbc0387068d P 0efc951052454eec9a58b0cd025945b8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } } peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } } peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } }
I20260709 13:23:01.806612 15161 leader_election.cc:290] T 8996bae84ecc4bffa0239d64dce7b24f P a722e54d227f4c29a9ed6ce77858003a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a1a22e9119494570b6d2217713fd7e43 (127.5.126.67:38125), f3a500981b494979b58d2b1041fec9c8 (127.5.126.65:34129)
I20260709 13:23:01.802783 15156 consensus_queue.cc:260] T 532cc9041f414e018098570192e0fae8 P f3a500981b494979b58d2b1041fec9c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } } peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } } peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } }
I20260709 13:23:01.808080 15032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e429eefef04d433e8f18dfbc0387068d" candidate_uuid: "0efc951052454eec9a58b0cd025945b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1a22e9119494570b6d2217713fd7e43"
I20260709 13:23:01.808586 15211 leader_election.cc:290] T e429eefef04d433e8f18dfbc0387068d P 0efc951052454eec9a58b0cd025945b8 [CANDIDATE]: Term 1 election: Requested vote from peers a1a22e9119494570b6d2217713fd7e43 (127.5.126.67:38125), a722e54d227f4c29a9ed6ce77858003a (127.5.126.68:46669)
I20260709 13:23:01.808810 15156 ts_tablet_manager.cc:1434] T 532cc9041f414e018098570192e0fae8 P f3a500981b494979b58d2b1041fec9c8: Time spent starting tablet: real 0.024s	user 0.005s	sys 0.002s
I20260709 13:23:01.810007 15156 tablet_bootstrap.cc:492] T 8996bae84ecc4bffa0239d64dce7b24f P f3a500981b494979b58d2b1041fec9c8: Bootstrap starting.
I20260709 13:23:01.810603 14881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8996bae84ecc4bffa0239d64dce7b24f" candidate_uuid: "a722e54d227f4c29a9ed6ce77858003a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f3a500981b494979b58d2b1041fec9c8" is_pre_election: true
W20260709 13:23:01.813244 14924 leader_election.cc:343] T e429eefef04d433e8f18dfbc0387068d P 0efc951052454eec9a58b0cd025945b8 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer a1a22e9119494570b6d2217713fd7e43 (127.5.126.67:38125): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:23:01.814167 15105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e429eefef04d433e8f18dfbc0387068d" candidate_uuid: "0efc951052454eec9a58b0cd025945b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a722e54d227f4c29a9ed6ce77858003a"
I20260709 13:23:01.814774 15105 raft_consensus.cc:3060] T e429eefef04d433e8f18dfbc0387068d P a722e54d227f4c29a9ed6ce77858003a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:23:01.816726 15156 tablet_bootstrap.cc:654] T 8996bae84ecc4bffa0239d64dce7b24f P f3a500981b494979b58d2b1041fec9c8: Neither blocks nor log segments found. Creating new log.
W20260709 13:23:01.816792 15073 leader_election.cc:343] T 8996bae84ecc4bffa0239d64dce7b24f P a722e54d227f4c29a9ed6ce77858003a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f3a500981b494979b58d2b1041fec9c8 (127.5.126.65:34129): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:23:01.818238 15224 raft_consensus.cc:493] T e4a490a7748841c3803607059f9d8825 P a1a22e9119494570b6d2217713fd7e43 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:23:01.818629 15033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8996bae84ecc4bffa0239d64dce7b24f" candidate_uuid: "a722e54d227f4c29a9ed6ce77858003a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1a22e9119494570b6d2217713fd7e43" is_pre_election: true
I20260709 13:23:01.818965 15154 tablet_bootstrap.cc:654] T 03b63e2bee374ed5931dab67ee14b555 P a722e54d227f4c29a9ed6ce77858003a: Neither blocks nor log segments found. Creating new log.
I20260709 13:23:01.818786 15224 raft_consensus.cc:515] T e4a490a7748841c3803607059f9d8825 P a1a22e9119494570b6d2217713fd7e43 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } } peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } } peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } }
I20260709 13:23:01.819320 15033 raft_consensus.cc:2468] T 8996bae84ecc4bffa0239d64dce7b24f P a1a22e9119494570b6d2217713fd7e43 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a722e54d227f4c29a9ed6ce77858003a in term 0.
I20260709 13:23:01.821079 15224 leader_election.cc:290] T e4a490a7748841c3803607059f9d8825 P a1a22e9119494570b6d2217713fd7e43 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0efc951052454eec9a58b0cd025945b8 (127.5.126.66:34613), a722e54d227f4c29a9ed6ce77858003a (127.5.126.68:46669)
I20260709 13:23:01.823649 14958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4a490a7748841c3803607059f9d8825" candidate_uuid: "a1a22e9119494570b6d2217713fd7e43" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0efc951052454eec9a58b0cd025945b8" is_pre_election: true
I20260709 13:23:01.824393 15155 tablet_bootstrap.cc:492] T 107541237b4a452e8b47b0c3527b7ede P a1a22e9119494570b6d2217713fd7e43: No bootstrap required, opened a new log
I20260709 13:23:01.824895 15155 ts_tablet_manager.cc:1403] T 107541237b4a452e8b47b0c3527b7ede P a1a22e9119494570b6d2217713fd7e43: Time spent bootstrapping tablet: real 0.127s	user 0.016s	sys 0.014s
I20260709 13:23:01.820962 15072 leader_election.cc:304] T 8996bae84ecc4bffa0239d64dce7b24f P a722e54d227f4c29a9ed6ce77858003a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a1a22e9119494570b6d2217713fd7e43, a722e54d227f4c29a9ed6ce77858003a; no voters: f3a500981b494979b58d2b1041fec9c8
I20260709 13:23:01.825798 15153 tablet_bootstrap.cc:654] T 532cc9041f414e018098570192e0fae8 P 0efc951052454eec9a58b0cd025945b8: Neither blocks nor log segments found. Creating new log.
I20260709 13:23:01.826771 15161 raft_consensus.cc:2804] T 8996bae84ecc4bffa0239d64dce7b24f P a722e54d227f4c29a9ed6ce77858003a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:23:01.827337 15161 raft_consensus.cc:493] T 8996bae84ecc4bffa0239d64dce7b24f P a722e54d227f4c29a9ed6ce77858003a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:23:01.827867 15161 raft_consensus.cc:3060] T 8996bae84ecc4bffa0239d64dce7b24f P a722e54d227f4c29a9ed6ce77858003a [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:23:01.832402 14999 leader_election.cc:343] T e4a490a7748841c3803607059f9d8825 P a1a22e9119494570b6d2217713fd7e43 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0efc951052454eec9a58b0cd025945b8 (127.5.126.66:34613): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:23:01.836651 15213 raft_consensus.cc:493] T e4f2c694c8194f1e86ad76c7ff051ea7 P a722e54d227f4c29a9ed6ce77858003a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:23:01.837368 15213 raft_consensus.cc:515] T e4f2c694c8194f1e86ad76c7ff051ea7 P a722e54d227f4c29a9ed6ce77858003a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } } peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } } peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } }
I20260709 13:23:01.840206 15213 leader_election.cc:290] T e4f2c694c8194f1e86ad76c7ff051ea7 P a722e54d227f4c29a9ed6ce77858003a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f3a500981b494979b58d2b1041fec9c8 (127.5.126.65:34129), 0efc951052454eec9a58b0cd025945b8 (127.5.126.66:34613)
I20260709 13:23:01.839512 15155 raft_consensus.cc:359] T 107541237b4a452e8b47b0c3527b7ede P a1a22e9119494570b6d2217713fd7e43 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } } peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } } peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } }
I20260709 13:23:01.841053 15155 raft_consensus.cc:385] T 107541237b4a452e8b47b0c3527b7ede P a1a22e9119494570b6d2217713fd7e43 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:23:01.841416 15155 raft_consensus.cc:740] T 107541237b4a452e8b47b0c3527b7ede P a1a22e9119494570b6d2217713fd7e43 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a1a22e9119494570b6d2217713fd7e43, State: Initialized, Role: FOLLOWER
I20260709 13:23:01.842274 15106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4a490a7748841c3803607059f9d8825" candidate_uuid: "a1a22e9119494570b6d2217713fd7e43" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a722e54d227f4c29a9ed6ce77858003a" is_pre_election: true
I20260709 13:23:01.842381 15155 consensus_queue.cc:260] T 107541237b4a452e8b47b0c3527b7ede P a1a22e9119494570b6d2217713fd7e43 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } } peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } } peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } }
I20260709 13:23:01.847313 14958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4f2c694c8194f1e86ad76c7ff051ea7" candidate_uuid: "a722e54d227f4c29a9ed6ce77858003a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0efc951052454eec9a58b0cd025945b8" is_pre_election: true
I20260709 13:23:01.848284 14958 raft_consensus.cc:2468] T e4f2c694c8194f1e86ad76c7ff051ea7 P 0efc951052454eec9a58b0cd025945b8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a722e54d227f4c29a9ed6ce77858003a in term 0.
I20260709 13:23:01.850158 14881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4f2c694c8194f1e86ad76c7ff051ea7" candidate_uuid: "a722e54d227f4c29a9ed6ce77858003a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f3a500981b494979b58d2b1041fec9c8" is_pre_election: true
I20260709 13:23:01.851106 14881 raft_consensus.cc:2468] T e4f2c694c8194f1e86ad76c7ff051ea7 P f3a500981b494979b58d2b1041fec9c8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a722e54d227f4c29a9ed6ce77858003a in term 0.
I20260709 13:23:01.854101 15155 ts_tablet_manager.cc:1434] T 107541237b4a452e8b47b0c3527b7ede P a1a22e9119494570b6d2217713fd7e43: Time spent starting tablet: real 0.029s	user 0.009s	sys 0.000s
I20260709 13:23:01.855643 15155 tablet_bootstrap.cc:492] T c3abd41db36d404089eaf1f9063bbcb0 P a1a22e9119494570b6d2217713fd7e43: Bootstrap starting.
W20260709 13:23:01.860499 14999 leader_election.cc:343] T e4a490a7748841c3803607059f9d8825 P a1a22e9119494570b6d2217713fd7e43 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a722e54d227f4c29a9ed6ce77858003a (127.5.126.68:46669): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:23:01.861322 14999 leader_election.cc:304] T e4a490a7748841c3803607059f9d8825 P a1a22e9119494570b6d2217713fd7e43 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1a22e9119494570b6d2217713fd7e43; no voters: 0efc951052454eec9a58b0cd025945b8, a722e54d227f4c29a9ed6ce77858003a
I20260709 13:23:01.863580 15224 raft_consensus.cc:2749] T e4a490a7748841c3803607059f9d8825 P a1a22e9119494570b6d2217713fd7e43 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:23:01.873528 15155 tablet_bootstrap.cc:654] T c3abd41db36d404089eaf1f9063bbcb0 P a1a22e9119494570b6d2217713fd7e43: Neither blocks nor log segments found. Creating new log.
I20260709 13:23:01.882812 15073 leader_election.cc:304] T e4f2c694c8194f1e86ad76c7ff051ea7 P a722e54d227f4c29a9ed6ce77858003a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a722e54d227f4c29a9ed6ce77858003a, f3a500981b494979b58d2b1041fec9c8; no voters: 
I20260709 13:23:01.895375 15155 tablet_bootstrap.cc:492] T c3abd41db36d404089eaf1f9063bbcb0 P a1a22e9119494570b6d2217713fd7e43: No bootstrap required, opened a new log
I20260709 13:23:01.896119 15155 ts_tablet_manager.cc:1403] T c3abd41db36d404089eaf1f9063bbcb0 P a1a22e9119494570b6d2217713fd7e43: Time spent bootstrapping tablet: real 0.041s	user 0.015s	sys 0.002s
I20260709 13:23:01.898044 15213 raft_consensus.cc:2804] T e4f2c694c8194f1e86ad76c7ff051ea7 P a722e54d227f4c29a9ed6ce77858003a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:23:01.898855 15213 raft_consensus.cc:493] T e4f2c694c8194f1e86ad76c7ff051ea7 P a722e54d227f4c29a9ed6ce77858003a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:23:01.899348 15213 raft_consensus.cc:3060] T e4f2c694c8194f1e86ad76c7ff051ea7 P a722e54d227f4c29a9ed6ce77858003a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:23:01.910795 15155 raft_consensus.cc:359] T c3abd41db36d404089eaf1f9063bbcb0 P a1a22e9119494570b6d2217713fd7e43 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } } peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } } peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } }
I20260709 13:23:01.911844 15155 raft_consensus.cc:385] T c3abd41db36d404089eaf1f9063bbcb0 P a1a22e9119494570b6d2217713fd7e43 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:23:01.912212 15155 raft_consensus.cc:740] T c3abd41db36d404089eaf1f9063bbcb0 P a1a22e9119494570b6d2217713fd7e43 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a1a22e9119494570b6d2217713fd7e43, State: Initialized, Role: FOLLOWER
I20260709 13:23:01.913154 15155 consensus_queue.cc:260] T c3abd41db36d404089eaf1f9063bbcb0 P a1a22e9119494570b6d2217713fd7e43 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } } peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } } peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } }
I20260709 13:23:01.922065 15155 ts_tablet_manager.cc:1434] T c3abd41db36d404089eaf1f9063bbcb0 P a1a22e9119494570b6d2217713fd7e43: Time spent starting tablet: real 0.026s	user 0.007s	sys 0.001s
I20260709 13:23:01.923379 15155 tablet_bootstrap.cc:492] T e429eefef04d433e8f18dfbc0387068d P a1a22e9119494570b6d2217713fd7e43: Bootstrap starting.
I20260709 13:23:01.926815 15105 raft_consensus.cc:2468] T e429eefef04d433e8f18dfbc0387068d P a722e54d227f4c29a9ed6ce77858003a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0efc951052454eec9a58b0cd025945b8 in term 1.
I20260709 13:23:01.919469 15161 raft_consensus.cc:515] T 8996bae84ecc4bffa0239d64dce7b24f P a722e54d227f4c29a9ed6ce77858003a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } } peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } } peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } }
I20260709 13:23:01.952601 15213 raft_consensus.cc:515] T e4f2c694c8194f1e86ad76c7ff051ea7 P a722e54d227f4c29a9ed6ce77858003a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } } peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } } peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } }
I20260709 13:23:01.955286 15213 leader_election.cc:290] T e4f2c694c8194f1e86ad76c7ff051ea7 P a722e54d227f4c29a9ed6ce77858003a [CANDIDATE]: Term 1 election: Requested vote from peers f3a500981b494979b58d2b1041fec9c8 (127.5.126.65:34129), 0efc951052454eec9a58b0cd025945b8 (127.5.126.66:34613)
I20260709 13:23:01.962152 14958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4f2c694c8194f1e86ad76c7ff051ea7" candidate_uuid: "a722e54d227f4c29a9ed6ce77858003a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0efc951052454eec9a58b0cd025945b8"
I20260709 13:23:01.963939 15156 tablet_bootstrap.cc:492] T 8996bae84ecc4bffa0239d64dce7b24f P f3a500981b494979b58d2b1041fec9c8: No bootstrap required, opened a new log
I20260709 13:23:01.964600 15156 ts_tablet_manager.cc:1403] T 8996bae84ecc4bffa0239d64dce7b24f P f3a500981b494979b58d2b1041fec9c8: Time spent bootstrapping tablet: real 0.155s	user 0.014s	sys 0.056s
I20260709 13:23:01.964526 14885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4f2c694c8194f1e86ad76c7ff051ea7" candidate_uuid: "a722e54d227f4c29a9ed6ce77858003a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f3a500981b494979b58d2b1041fec9c8"
I20260709 13:23:01.957796 15161 leader_election.cc:290] T 8996bae84ecc4bffa0239d64dce7b24f P a722e54d227f4c29a9ed6ce77858003a [CANDIDATE]: Term 1 election: Requested vote from peers a1a22e9119494570b6d2217713fd7e43 (127.5.126.67:38125), f3a500981b494979b58d2b1041fec9c8 (127.5.126.65:34129)
I20260709 13:23:01.958348 14925 leader_election.cc:304] T e429eefef04d433e8f18dfbc0387068d P 0efc951052454eec9a58b0cd025945b8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0efc951052454eec9a58b0cd025945b8, a722e54d227f4c29a9ed6ce77858003a; no voters: a1a22e9119494570b6d2217713fd7e43
I20260709 13:23:01.966699 15211 raft_consensus.cc:2804] T e429eefef04d433e8f18dfbc0387068d P 0efc951052454eec9a58b0cd025945b8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:23:01.962728 14883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8996bae84ecc4bffa0239d64dce7b24f" candidate_uuid: "a722e54d227f4c29a9ed6ce77858003a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f3a500981b494979b58d2b1041fec9c8"
I20260709 13:23:01.955127 15033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8996bae84ecc4bffa0239d64dce7b24f" candidate_uuid: "a722e54d227f4c29a9ed6ce77858003a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1a22e9119494570b6d2217713fd7e43"
I20260709 13:23:01.966753 14782 catalog_manager.cc:5697] T 03b63e2bee374ed5931dab67ee14b555 P f3a500981b494979b58d2b1041fec9c8 reported cstate change: term changed from 0 to 1, leader changed from <none> to f3a500981b494979b58d2b1041fec9c8 (127.5.126.65). New cstate: current_term: 1 leader_uuid: "f3a500981b494979b58d2b1041fec9c8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } health_report { overall_health: HEALTHY } } }
I20260709 13:23:01.967515 15156 raft_consensus.cc:359] T 8996bae84ecc4bffa0239d64dce7b24f P f3a500981b494979b58d2b1041fec9c8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } } peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } } peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } }
I20260709 13:23:01.968205 15156 raft_consensus.cc:385] T 8996bae84ecc4bffa0239d64dce7b24f P f3a500981b494979b58d2b1041fec9c8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 13:23:01.968468 15073 leader_election.cc:343] T 8996bae84ecc4bffa0239d64dce7b24f P a722e54d227f4c29a9ed6ce77858003a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f3a500981b494979b58d2b1041fec9c8 (127.5.126.65:34129): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:23:01.969038 15153 tablet_bootstrap.cc:492] T 532cc9041f414e018098570192e0fae8 P 0efc951052454eec9a58b0cd025945b8: No bootstrap required, opened a new log
I20260709 13:23:01.969496 15211 raft_consensus.cc:697] T e429eefef04d433e8f18dfbc0387068d P 0efc951052454eec9a58b0cd025945b8 [term 1 LEADER]: Becoming Leader. State: Replica: 0efc951052454eec9a58b0cd025945b8, State: Running, Role: LEADER
I20260709 13:23:01.970635 15211 consensus_queue.cc:237] T e429eefef04d433e8f18dfbc0387068d P 0efc951052454eec9a58b0cd025945b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } } peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } } peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } }
I20260709 13:23:01.968691 14958 raft_consensus.cc:3060] T e4f2c694c8194f1e86ad76c7ff051ea7 P 0efc951052454eec9a58b0cd025945b8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:23:01.965642 15154 tablet_bootstrap.cc:492] T 03b63e2bee374ed5931dab67ee14b555 P a722e54d227f4c29a9ed6ce77858003a: No bootstrap required, opened a new log
I20260709 13:23:01.939680 15155 tablet_bootstrap.cc:654] T e429eefef04d433e8f18dfbc0387068d P a1a22e9119494570b6d2217713fd7e43: Neither blocks nor log segments found. Creating new log.
I20260709 13:23:01.974274 15154 ts_tablet_manager.cc:1403] T 03b63e2bee374ed5931dab67ee14b555 P a722e54d227f4c29a9ed6ce77858003a: Time spent bootstrapping tablet: real 0.182s	user 0.040s	sys 0.083s
I20260709 13:23:01.965269 14885 raft_consensus.cc:3060] T e4f2c694c8194f1e86ad76c7ff051ea7 P f3a500981b494979b58d2b1041fec9c8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:23:01.979197 15154 raft_consensus.cc:359] T 03b63e2bee374ed5931dab67ee14b555 P a722e54d227f4c29a9ed6ce77858003a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } } peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } } peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } }
I20260709 13:23:01.980027 15154 raft_consensus.cc:385] T 03b63e2bee374ed5931dab67ee14b555 P a722e54d227f4c29a9ed6ce77858003a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:23:01.967672 15033 raft_consensus.cc:3060] T 8996bae84ecc4bffa0239d64dce7b24f P a1a22e9119494570b6d2217713fd7e43 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:23:01.980340 15154 raft_consensus.cc:740] T 03b63e2bee374ed5931dab67ee14b555 P a722e54d227f4c29a9ed6ce77858003a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a722e54d227f4c29a9ed6ce77858003a, State: Initialized, Role: FOLLOWER
I20260709 13:23:01.981159 15154 consensus_queue.cc:260] T 03b63e2bee374ed5931dab67ee14b555 P a722e54d227f4c29a9ed6ce77858003a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } } peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } } peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } }
I20260709 13:23:01.982863 15154 ts_tablet_manager.cc:1434] T 03b63e2bee374ed5931dab67ee14b555 P a722e54d227f4c29a9ed6ce77858003a: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.000s
I20260709 13:23:01.969506 15153 ts_tablet_manager.cc:1403] T 532cc9041f414e018098570192e0fae8 P 0efc951052454eec9a58b0cd025945b8: Time spent bootstrapping tablet: real 0.167s	user 0.040s	sys 0.028s
I20260709 13:23:01.987541 15153 raft_consensus.cc:359] T 532cc9041f414e018098570192e0fae8 P 0efc951052454eec9a58b0cd025945b8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } } peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } } peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } }
I20260709 13:23:01.988229 15153 raft_consensus.cc:385] T 532cc9041f414e018098570192e0fae8 P 0efc951052454eec9a58b0cd025945b8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:23:01.988507 15153 raft_consensus.cc:740] T 532cc9041f414e018098570192e0fae8 P 0efc951052454eec9a58b0cd025945b8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0efc951052454eec9a58b0cd025945b8, State: Initialized, Role: FOLLOWER
I20260709 13:23:01.968497 15156 raft_consensus.cc:740] T 8996bae84ecc4bffa0239d64dce7b24f P f3a500981b494979b58d2b1041fec9c8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f3a500981b494979b58d2b1041fec9c8, State: Initialized, Role: FOLLOWER
I20260709 13:23:01.989177 15153 consensus_queue.cc:260] T 532cc9041f414e018098570192e0fae8 P 0efc951052454eec9a58b0cd025945b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } } peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } } peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } }
I20260709 13:23:01.989810 15156 consensus_queue.cc:260] T 8996bae84ecc4bffa0239d64dce7b24f P f3a500981b494979b58d2b1041fec9c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } } peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } } peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } }
I20260709 13:23:01.991812 15153 ts_tablet_manager.cc:1434] T 532cc9041f414e018098570192e0fae8 P 0efc951052454eec9a58b0cd025945b8: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.001s
I20260709 13:23:01.992266 15156 ts_tablet_manager.cc:1434] T 8996bae84ecc4bffa0239d64dce7b24f P f3a500981b494979b58d2b1041fec9c8: Time spent starting tablet: real 0.027s	user 0.008s	sys 0.000s
I20260709 13:23:01.992805 15153 tablet_bootstrap.cc:492] T e4a490a7748841c3803607059f9d8825 P 0efc951052454eec9a58b0cd025945b8: Bootstrap starting.
I20260709 13:23:01.993549 15156 tablet_bootstrap.cc:492] T d64d06459b344ff99c0df07c249c3a60 P f3a500981b494979b58d2b1041fec9c8: Bootstrap starting.
I20260709 13:23:02.001159 14781 catalog_manager.cc:5697] T e429eefef04d433e8f18dfbc0387068d P 0efc951052454eec9a58b0cd025945b8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0efc951052454eec9a58b0cd025945b8 (127.5.126.66). New cstate: current_term: 1 leader_uuid: "0efc951052454eec9a58b0cd025945b8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } health_report { overall_health: UNKNOWN } } }
I20260709 13:23:02.003077 15153 tablet_bootstrap.cc:654] T e4a490a7748841c3803607059f9d8825 P 0efc951052454eec9a58b0cd025945b8: Neither blocks nor log segments found. Creating new log.
I20260709 13:23:02.003072 15156 tablet_bootstrap.cc:654] T d64d06459b344ff99c0df07c249c3a60 P f3a500981b494979b58d2b1041fec9c8: Neither blocks nor log segments found. Creating new log.
I20260709 13:23:02.013005 15154 tablet_bootstrap.cc:492] T decdd091b0f243d786ee350a437b30f1 P a722e54d227f4c29a9ed6ce77858003a: Bootstrap starting.
I20260709 13:23:02.015247 14885 raft_consensus.cc:2468] T e4f2c694c8194f1e86ad76c7ff051ea7 P f3a500981b494979b58d2b1041fec9c8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a722e54d227f4c29a9ed6ce77858003a in term 1.
I20260709 13:23:02.020905 15073 leader_election.cc:304] T e4f2c694c8194f1e86ad76c7ff051ea7 P a722e54d227f4c29a9ed6ce77858003a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a722e54d227f4c29a9ed6ce77858003a, f3a500981b494979b58d2b1041fec9c8; no voters: 
I20260709 13:23:02.022120 15161 raft_consensus.cc:2804] T e4f2c694c8194f1e86ad76c7ff051ea7 P a722e54d227f4c29a9ed6ce77858003a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:23:02.022703 15161 raft_consensus.cc:697] T e4f2c694c8194f1e86ad76c7ff051ea7 P a722e54d227f4c29a9ed6ce77858003a [term 1 LEADER]: Becoming Leader. State: Replica: a722e54d227f4c29a9ed6ce77858003a, State: Running, Role: LEADER
I20260709 13:23:02.023614 15161 consensus_queue.cc:237] T e4f2c694c8194f1e86ad76c7ff051ea7 P a722e54d227f4c29a9ed6ce77858003a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } } peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } } peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } }
I20260709 13:23:02.026682 15106 raft_consensus.cc:3060] T aecef3c240394d54844ec8170e9cad59 P a722e54d227f4c29a9ed6ce77858003a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:23:02.030143 15033 raft_consensus.cc:2468] T 8996bae84ecc4bffa0239d64dce7b24f P a1a22e9119494570b6d2217713fd7e43 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a722e54d227f4c29a9ed6ce77858003a in term 1.
I20260709 13:23:02.035079 15072 leader_election.cc:304] T 8996bae84ecc4bffa0239d64dce7b24f P a722e54d227f4c29a9ed6ce77858003a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a1a22e9119494570b6d2217713fd7e43, a722e54d227f4c29a9ed6ce77858003a; no voters: f3a500981b494979b58d2b1041fec9c8
I20260709 13:23:02.036474 15213 raft_consensus.cc:2804] T 8996bae84ecc4bffa0239d64dce7b24f P a722e54d227f4c29a9ed6ce77858003a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:23:02.036996 15213 raft_consensus.cc:697] T 8996bae84ecc4bffa0239d64dce7b24f P a722e54d227f4c29a9ed6ce77858003a [term 1 LEADER]: Becoming Leader. State: Replica: a722e54d227f4c29a9ed6ce77858003a, State: Running, Role: LEADER
I20260709 13:23:02.037863 15213 consensus_queue.cc:237] T 8996bae84ecc4bffa0239d64dce7b24f P a722e54d227f4c29a9ed6ce77858003a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } } peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } } peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } }
I20260709 13:23:02.044685 15211 raft_consensus.cc:493] T decdd091b0f243d786ee350a437b30f1 P 0efc951052454eec9a58b0cd025945b8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:23:02.051939 15211 raft_consensus.cc:515] T decdd091b0f243d786ee350a437b30f1 P 0efc951052454eec9a58b0cd025945b8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } } peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } } peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } }
I20260709 13:23:02.069319 15155 tablet_bootstrap.cc:492] T e429eefef04d433e8f18dfbc0387068d P a1a22e9119494570b6d2217713fd7e43: No bootstrap required, opened a new log
I20260709 13:23:02.071275 15155 ts_tablet_manager.cc:1403] T e429eefef04d433e8f18dfbc0387068d P a1a22e9119494570b6d2217713fd7e43: Time spent bootstrapping tablet: real 0.148s	user 0.012s	sys 0.007s
I20260709 13:23:02.075894 15258 raft_consensus.cc:493] T 107541237b4a452e8b47b0c3527b7ede P f3a500981b494979b58d2b1041fec9c8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:23:02.083153 15384 raft_consensus.cc:493] T 8996bae84ecc4bffa0239d64dce7b24f P f3a500981b494979b58d2b1041fec9c8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:23:02.085974 15258 raft_consensus.cc:515] T 107541237b4a452e8b47b0c3527b7ede P f3a500981b494979b58d2b1041fec9c8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } } peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } } peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } }
I20260709 13:23:02.086421 15384 raft_consensus.cc:515] T 8996bae84ecc4bffa0239d64dce7b24f P f3a500981b494979b58d2b1041fec9c8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } } peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } } peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } }
I20260709 13:23:02.089178 15258 leader_election.cc:290] T 107541237b4a452e8b47b0c3527b7ede P f3a500981b494979b58d2b1041fec9c8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0efc951052454eec9a58b0cd025945b8 (127.5.126.66:34613), a1a22e9119494570b6d2217713fd7e43 (127.5.126.67:38125)
I20260709 13:23:02.091835 15156 tablet_bootstrap.cc:492] T d64d06459b344ff99c0df07c249c3a60 P f3a500981b494979b58d2b1041fec9c8: No bootstrap required, opened a new log
I20260709 13:23:02.092586 15156 ts_tablet_manager.cc:1403] T d64d06459b344ff99c0df07c249c3a60 P f3a500981b494979b58d2b1041fec9c8: Time spent bootstrapping tablet: real 0.099s	user 0.012s	sys 0.020s
I20260709 13:23:02.076582 14958 raft_consensus.cc:2468] T e4f2c694c8194f1e86ad76c7ff051ea7 P 0efc951052454eec9a58b0cd025945b8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a722e54d227f4c29a9ed6ce77858003a in term 1.
I20260709 13:23:02.104851 15384 leader_election.cc:290] T 8996bae84ecc4bffa0239d64dce7b24f P f3a500981b494979b58d2b1041fec9c8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a1a22e9119494570b6d2217713fd7e43 (127.5.126.67:38125), a722e54d227f4c29a9ed6ce77858003a (127.5.126.68:46669)
I20260709 13:23:02.107242 15033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "decdd091b0f243d786ee350a437b30f1" candidate_uuid: "0efc951052454eec9a58b0cd025945b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1a22e9119494570b6d2217713fd7e43" is_pre_election: true
I20260709 13:23:02.110070 14960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "107541237b4a452e8b47b0c3527b7ede" candidate_uuid: "f3a500981b494979b58d2b1041fec9c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0efc951052454eec9a58b0cd025945b8" is_pre_election: true
I20260709 13:23:02.110771 14960 raft_consensus.cc:2468] T 107541237b4a452e8b47b0c3527b7ede P 0efc951052454eec9a58b0cd025945b8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f3a500981b494979b58d2b1041fec9c8 in term 0.
W20260709 13:23:02.110901 14924 leader_election.cc:343] T decdd091b0f243d786ee350a437b30f1 P 0efc951052454eec9a58b0cd025945b8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a1a22e9119494570b6d2217713fd7e43 (127.5.126.67:38125): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:23:02.114409 14850 leader_election.cc:304] T 107541237b4a452e8b47b0c3527b7ede P f3a500981b494979b58d2b1041fec9c8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0efc951052454eec9a58b0cd025945b8, f3a500981b494979b58d2b1041fec9c8; no voters: 
I20260709 13:23:02.116462 15033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "107541237b4a452e8b47b0c3527b7ede" candidate_uuid: "f3a500981b494979b58d2b1041fec9c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1a22e9119494570b6d2217713fd7e43" is_pre_election: true
I20260709 13:23:02.117304 15033 raft_consensus.cc:2468] T 107541237b4a452e8b47b0c3527b7ede P a1a22e9119494570b6d2217713fd7e43 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f3a500981b494979b58d2b1041fec9c8 in term 0.
I20260709 13:23:02.117674 15032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8996bae84ecc4bffa0239d64dce7b24f" candidate_uuid: "f3a500981b494979b58d2b1041fec9c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1a22e9119494570b6d2217713fd7e43" is_pre_election: true
I20260709 13:23:02.118628 15032 raft_consensus.cc:2393] T 8996bae84ecc4bffa0239d64dce7b24f P a1a22e9119494570b6d2217713fd7e43 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f3a500981b494979b58d2b1041fec9c8 in current term 1: Already voted for candidate a722e54d227f4c29a9ed6ce77858003a in this term.
I20260709 13:23:02.119392 15211 leader_election.cc:290] T decdd091b0f243d786ee350a437b30f1 P 0efc951052454eec9a58b0cd025945b8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a1a22e9119494570b6d2217713fd7e43 (127.5.126.67:38125), a722e54d227f4c29a9ed6ce77858003a (127.5.126.68:46669)
I20260709 13:23:02.121044 15258 raft_consensus.cc:2804] T 107541237b4a452e8b47b0c3527b7ede P f3a500981b494979b58d2b1041fec9c8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:23:02.121558 15258 raft_consensus.cc:493] T 107541237b4a452e8b47b0c3527b7ede P f3a500981b494979b58d2b1041fec9c8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:23:02.121919 15258 raft_consensus.cc:3060] T 107541237b4a452e8b47b0c3527b7ede P f3a500981b494979b58d2b1041fec9c8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:23:02.126830 15384 raft_consensus.cc:493] T 532cc9041f414e018098570192e0fae8 P f3a500981b494979b58d2b1041fec9c8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:23:02.127449 15384 raft_consensus.cc:515] T 532cc9041f414e018098570192e0fae8 P f3a500981b494979b58d2b1041fec9c8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } } peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } } peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } }
I20260709 13:23:02.128634 15326 consensus_queue.cc:1048] T e3693e8a3b0444bf978dc845dcfd2a45 P a1a22e9119494570b6d2217713fd7e43 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:23:02.129774 15384 leader_election.cc:290] T 532cc9041f414e018098570192e0fae8 P f3a500981b494979b58d2b1041fec9c8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a722e54d227f4c29a9ed6ce77858003a (127.5.126.68:46669), 0efc951052454eec9a58b0cd025945b8 (127.5.126.66:34613)
I20260709 13:23:02.131002 15155 raft_consensus.cc:359] T e429eefef04d433e8f18dfbc0387068d P a1a22e9119494570b6d2217713fd7e43 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } } peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } } peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } }
I20260709 13:23:02.137199 15155 raft_consensus.cc:385] T e429eefef04d433e8f18dfbc0387068d P a1a22e9119494570b6d2217713fd7e43 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:23:02.137598 15155 raft_consensus.cc:740] T e429eefef04d433e8f18dfbc0387068d P a1a22e9119494570b6d2217713fd7e43 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a1a22e9119494570b6d2217713fd7e43, State: Initialized, Role: FOLLOWER
I20260709 13:23:02.141940 15153 tablet_bootstrap.cc:492] T e4a490a7748841c3803607059f9d8825 P 0efc951052454eec9a58b0cd025945b8: No bootstrap required, opened a new log
I20260709 13:23:02.142565 15153 ts_tablet_manager.cc:1403] T e4a490a7748841c3803607059f9d8825 P 0efc951052454eec9a58b0cd025945b8: Time spent bootstrapping tablet: real 0.150s	user 0.014s	sys 0.023s
I20260709 13:23:02.147373 15155 consensus_queue.cc:260] T e429eefef04d433e8f18dfbc0387068d P a1a22e9119494570b6d2217713fd7e43 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } } peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } } peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } }
I20260709 13:23:02.149956 15155 ts_tablet_manager.cc:1434] T e429eefef04d433e8f18dfbc0387068d P a1a22e9119494570b6d2217713fd7e43: Time spent starting tablet: real 0.078s	user 0.006s	sys 0.001s
I20260709 13:23:02.150466 15154 tablet_bootstrap.cc:654] T decdd091b0f243d786ee350a437b30f1 P a722e54d227f4c29a9ed6ce77858003a: Neither blocks nor log segments found. Creating new log.
I20260709 13:23:02.158941 15105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8996bae84ecc4bffa0239d64dce7b24f" candidate_uuid: "f3a500981b494979b58d2b1041fec9c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a722e54d227f4c29a9ed6ce77858003a" is_pre_election: true
I20260709 13:23:02.162333 15105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "532cc9041f414e018098570192e0fae8" candidate_uuid: "f3a500981b494979b58d2b1041fec9c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a722e54d227f4c29a9ed6ce77858003a" is_pre_election: true
I20260709 13:23:02.151623 15384 raft_consensus.cc:493] T c3abd41db36d404089eaf1f9063bbcb0 P f3a500981b494979b58d2b1041fec9c8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:23:02.175446 15156 raft_consensus.cc:359] T d64d06459b344ff99c0df07c249c3a60 P f3a500981b494979b58d2b1041fec9c8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } } peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } } peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } }
I20260709 13:23:02.176812 15156 raft_consensus.cc:385] T d64d06459b344ff99c0df07c249c3a60 P f3a500981b494979b58d2b1041fec9c8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:23:02.177210 15156 raft_consensus.cc:740] T d64d06459b344ff99c0df07c249c3a60 P f3a500981b494979b58d2b1041fec9c8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f3a500981b494979b58d2b1041fec9c8, State: Initialized, Role: FOLLOWER
I20260709 13:23:02.181900 15258 raft_consensus.cc:515] T 107541237b4a452e8b47b0c3527b7ede P f3a500981b494979b58d2b1041fec9c8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } } peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } } peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } }
I20260709 13:23:02.183753 15258 leader_election.cc:290] T 107541237b4a452e8b47b0c3527b7ede P f3a500981b494979b58d2b1041fec9c8 [CANDIDATE]: Term 1 election: Requested vote from peers 0efc951052454eec9a58b0cd025945b8 (127.5.126.66:34613), a1a22e9119494570b6d2217713fd7e43 (127.5.126.67:38125)
I20260709 13:23:02.178150 15156 consensus_queue.cc:260] T d64d06459b344ff99c0df07c249c3a60 P f3a500981b494979b58d2b1041fec9c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } } peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } } peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } }
I20260709 13:23:02.175689 15153 raft_consensus.cc:359] T e4a490a7748841c3803607059f9d8825 P 0efc951052454eec9a58b0cd025945b8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } } peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } } peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } }
I20260709 13:23:02.185643 15153 raft_consensus.cc:385] T e4a490a7748841c3803607059f9d8825 P 0efc951052454eec9a58b0cd025945b8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:23:02.185921 15153 raft_consensus.cc:740] T e4a490a7748841c3803607059f9d8825 P 0efc951052454eec9a58b0cd025945b8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0efc951052454eec9a58b0cd025945b8, State: Initialized, Role: FOLLOWER
I20260709 13:23:02.194765 15155 tablet_bootstrap.cc:492] T decdd091b0f243d786ee350a437b30f1 P a1a22e9119494570b6d2217713fd7e43: Bootstrap starting.
I20260709 13:23:02.198935 15153 consensus_queue.cc:260] T e4a490a7748841c3803607059f9d8825 P 0efc951052454eec9a58b0cd025945b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } } peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } } peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } }
I20260709 13:23:02.199748 15032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "107541237b4a452e8b47b0c3527b7ede" candidate_uuid: "f3a500981b494979b58d2b1041fec9c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1a22e9119494570b6d2217713fd7e43"
I20260709 13:23:02.200480 15032 raft_consensus.cc:3060] T 107541237b4a452e8b47b0c3527b7ede P a1a22e9119494570b6d2217713fd7e43 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:23:02.202544 15156 ts_tablet_manager.cc:1434] T d64d06459b344ff99c0df07c249c3a60 P f3a500981b494979b58d2b1041fec9c8: Time spent starting tablet: real 0.110s	user 0.009s	sys 0.000s
I20260709 13:23:02.186353 14959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "532cc9041f414e018098570192e0fae8" candidate_uuid: "f3a500981b494979b58d2b1041fec9c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0efc951052454eec9a58b0cd025945b8" is_pre_election: true
I20260709 13:23:02.204831 14959 raft_consensus.cc:2468] T 532cc9041f414e018098570192e0fae8 P 0efc951052454eec9a58b0cd025945b8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f3a500981b494979b58d2b1041fec9c8 in term 0.
I20260709 13:23:02.207031 15153 ts_tablet_manager.cc:1434] T e4a490a7748841c3803607059f9d8825 P 0efc951052454eec9a58b0cd025945b8: Time spent starting tablet: real 0.064s	user 0.002s	sys 0.006s
I20260709 13:23:02.212432 15258 consensus_queue.cc:1048] T 03b63e2bee374ed5931dab67ee14b555 P f3a500981b494979b58d2b1041fec9c8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:23:02.175532 15384 raft_consensus.cc:515] T c3abd41db36d404089eaf1f9063bbcb0 P f3a500981b494979b58d2b1041fec9c8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } } peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } } peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } }
I20260709 13:23:02.249032 15156 tablet_bootstrap.cc:492] T 88a7c4171c664e819837994755edf95c P f3a500981b494979b58d2b1041fec9c8: Bootstrap starting.
I20260709 13:23:02.253515 15224 raft_consensus.cc:493] T c3abd41db36d404089eaf1f9063bbcb0 P a1a22e9119494570b6d2217713fd7e43 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:23:02.251843 15105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "decdd091b0f243d786ee350a437b30f1" candidate_uuid: "0efc951052454eec9a58b0cd025945b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a722e54d227f4c29a9ed6ce77858003a" is_pre_election: true
I20260709 13:23:02.250278 15282 raft_consensus.cc:493] T aecef3c240394d54844ec8170e9cad59 P a722e54d227f4c29a9ed6ce77858003a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f3a500981b494979b58d2b1041fec9c8)
I20260709 13:23:02.257805 15282 raft_consensus.cc:515] T aecef3c240394d54844ec8170e9cad59 P a722e54d227f4c29a9ed6ce77858003a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } } peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } } peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } }
I20260709 13:23:02.233415 15032 raft_consensus.cc:2468] T 107541237b4a452e8b47b0c3527b7ede P a1a22e9119494570b6d2217713fd7e43 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f3a500981b494979b58d2b1041fec9c8 in term 1.
I20260709 13:23:02.261127 14849 leader_election.cc:304] T 107541237b4a452e8b47b0c3527b7ede P f3a500981b494979b58d2b1041fec9c8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1a22e9119494570b6d2217713fd7e43, f3a500981b494979b58d2b1041fec9c8; no voters: 
I20260709 13:23:02.261432 14850 leader_election.cc:304] T 8996bae84ecc4bffa0239d64dce7b24f P f3a500981b494979b58d2b1041fec9c8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f3a500981b494979b58d2b1041fec9c8; no voters: a1a22e9119494570b6d2217713fd7e43, a722e54d227f4c29a9ed6ce77858003a
I20260709 13:23:02.262099 15385 raft_consensus.cc:2804] T 107541237b4a452e8b47b0c3527b7ede P f3a500981b494979b58d2b1041fec9c8 [term 1 FOLLOWER]: Leader election won for term 1
W20260709 13:23:02.262660 14850 leader_election.cc:343] T 532cc9041f414e018098570192e0fae8 P f3a500981b494979b58d2b1041fec9c8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a722e54d227f4c29a9ed6ce77858003a (127.5.126.68:46669): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:23:02.272571 15384 leader_election.cc:290] T c3abd41db36d404089eaf1f9063bbcb0 P f3a500981b494979b58d2b1041fec9c8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0efc951052454eec9a58b0cd025945b8 (127.5.126.66:34613), a1a22e9119494570b6d2217713fd7e43 (127.5.126.67:38125)
I20260709 13:23:02.273236 14959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "107541237b4a452e8b47b0c3527b7ede" candidate_uuid: "f3a500981b494979b58d2b1041fec9c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0efc951052454eec9a58b0cd025945b8"
I20260709 13:23:02.273911 14959 raft_consensus.cc:3060] T 107541237b4a452e8b47b0c3527b7ede P 0efc951052454eec9a58b0cd025945b8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:23:02.262928 15363 raft_consensus.cc:3060] T 8996bae84ecc4bffa0239d64dce7b24f P f3a500981b494979b58d2b1041fec9c8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:23:02.277695 15156 tablet_bootstrap.cc:654] T 88a7c4171c664e819837994755edf95c P f3a500981b494979b58d2b1041fec9c8: Neither blocks nor log segments found. Creating new log.
I20260709 13:23:02.274121 15032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3abd41db36d404089eaf1f9063bbcb0" candidate_uuid: "f3a500981b494979b58d2b1041fec9c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1a22e9119494570b6d2217713fd7e43" is_pre_election: true
I20260709 13:23:02.255736 15224 raft_consensus.cc:515] T c3abd41db36d404089eaf1f9063bbcb0 P a1a22e9119494570b6d2217713fd7e43 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } } peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } } peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } }
I20260709 13:23:02.292495 15153 tablet_bootstrap.cc:492] T c3abd41db36d404089eaf1f9063bbcb0 P 0efc951052454eec9a58b0cd025945b8: Bootstrap starting.
I20260709 13:23:02.295800 15385 raft_consensus.cc:697] T 107541237b4a452e8b47b0c3527b7ede P f3a500981b494979b58d2b1041fec9c8 [term 1 LEADER]: Becoming Leader. State: Replica: f3a500981b494979b58d2b1041fec9c8, State: Running, Role: LEADER
I20260709 13:23:02.306361 15385 consensus_queue.cc:237] T 107541237b4a452e8b47b0c3527b7ede P f3a500981b494979b58d2b1041fec9c8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } } peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } } peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } }
I20260709 13:23:02.295958 15384 raft_consensus.cc:493] T d64d06459b344ff99c0df07c249c3a60 P f3a500981b494979b58d2b1041fec9c8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:23:02.298054 15213 raft_consensus.cc:493] T 03b63e2bee374ed5931dab67ee14b555 P a722e54d227f4c29a9ed6ce77858003a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:23:02.321218 15213 raft_consensus.cc:515] T 03b63e2bee374ed5931dab67ee14b555 P a722e54d227f4c29a9ed6ce77858003a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } } peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } } peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } }
I20260709 13:23:02.287563 14850 leader_election.cc:304] T 532cc9041f414e018098570192e0fae8 P f3a500981b494979b58d2b1041fec9c8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0efc951052454eec9a58b0cd025945b8, f3a500981b494979b58d2b1041fec9c8; no voters: a722e54d227f4c29a9ed6ce77858003a
I20260709 13:23:02.326195 15429 raft_consensus.cc:2804] T 532cc9041f414e018098570192e0fae8 P f3a500981b494979b58d2b1041fec9c8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:23:02.326608 15429 raft_consensus.cc:493] T 532cc9041f414e018098570192e0fae8 P f3a500981b494979b58d2b1041fec9c8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:23:02.326653 15106 raft_consensus.cc:3060] T 03b63e2bee374ed5931dab67ee14b555 P a722e54d227f4c29a9ed6ce77858003a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:23:02.328001 15429 raft_consensus.cc:3060] T 532cc9041f414e018098570192e0fae8 P f3a500981b494979b58d2b1041fec9c8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:23:02.331159 15154 tablet_bootstrap.cc:492] T decdd091b0f243d786ee350a437b30f1 P a722e54d227f4c29a9ed6ce77858003a: No bootstrap required, opened a new log
I20260709 13:23:02.331964 15154 ts_tablet_manager.cc:1403] T decdd091b0f243d786ee350a437b30f1 P a722e54d227f4c29a9ed6ce77858003a: Time spent bootstrapping tablet: real 0.348s	user 0.015s	sys 0.004s
I20260709 13:23:02.299240 15427 consensus_queue.cc:1048] T e3693e8a3b0444bf978dc845dcfd2a45 P a1a22e9119494570b6d2217713fd7e43 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.024s
I20260709 13:23:02.330407 14782 catalog_manager.cc:5697] T e4f2c694c8194f1e86ad76c7ff051ea7 P a722e54d227f4c29a9ed6ce77858003a reported cstate change: term changed from 0 to 1, leader changed from <none> to a722e54d227f4c29a9ed6ce77858003a (127.5.126.68). New cstate: current_term: 1 leader_uuid: "a722e54d227f4c29a9ed6ce77858003a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } health_report { overall_health: UNKNOWN } } }
I20260709 13:23:02.322467 15032 raft_consensus.cc:2468] T c3abd41db36d404089eaf1f9063bbcb0 P a1a22e9119494570b6d2217713fd7e43 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f3a500981b494979b58d2b1041fec9c8 in term 0.
I20260709 13:23:02.344612 15155 tablet_bootstrap.cc:654] T decdd091b0f243d786ee350a437b30f1 P a1a22e9119494570b6d2217713fd7e43: Neither blocks nor log segments found. Creating new log.
W20260709 13:23:02.363945 14925 leader_election.cc:343] T decdd091b0f243d786ee350a437b30f1 P 0efc951052454eec9a58b0cd025945b8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a722e54d227f4c29a9ed6ce77858003a (127.5.126.68:46669): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:23:02.364725 14925 leader_election.cc:304] T decdd091b0f243d786ee350a437b30f1 P 0efc951052454eec9a58b0cd025945b8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0efc951052454eec9a58b0cd025945b8; no voters: a1a22e9119494570b6d2217713fd7e43, a722e54d227f4c29a9ed6ce77858003a
I20260709 13:23:02.375820 14849 leader_election.cc:304] T c3abd41db36d404089eaf1f9063bbcb0 P f3a500981b494979b58d2b1041fec9c8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1a22e9119494570b6d2217713fd7e43, f3a500981b494979b58d2b1041fec9c8; no voters: 
I20260709 13:23:02.376830 15211 raft_consensus.cc:2749] T decdd091b0f243d786ee350a437b30f1 P 0efc951052454eec9a58b0cd025945b8 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:23:02.382551 15258 raft_consensus.cc:2804] T c3abd41db36d404089eaf1f9063bbcb0 P f3a500981b494979b58d2b1041fec9c8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:23:02.383040 15258 raft_consensus.cc:493] T c3abd41db36d404089eaf1f9063bbcb0 P f3a500981b494979b58d2b1041fec9c8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:23:02.383405 15258 raft_consensus.cc:3060] T c3abd41db36d404089eaf1f9063bbcb0 P f3a500981b494979b58d2b1041fec9c8 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:23:02.351020 14850 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.66:34613, user_credentials={real_user=slave}} blocked reactor thread for 75864.6us
I20260709 13:23:02.366936 15213 leader_election.cc:290] T 03b63e2bee374ed5931dab67ee14b555 P a722e54d227f4c29a9ed6ce77858003a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a1a22e9119494570b6d2217713fd7e43 (127.5.126.67:38125), f3a500981b494979b58d2b1041fec9c8 (127.5.126.65:34129)
I20260709 13:23:02.370981 14885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03b63e2bee374ed5931dab67ee14b555" candidate_uuid: "a722e54d227f4c29a9ed6ce77858003a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f3a500981b494979b58d2b1041fec9c8" is_pre_election: true
I20260709 13:23:02.372495 15032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03b63e2bee374ed5931dab67ee14b555" candidate_uuid: "a722e54d227f4c29a9ed6ce77858003a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1a22e9119494570b6d2217713fd7e43" is_pre_election: true
I20260709 13:23:02.386303 14960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3abd41db36d404089eaf1f9063bbcb0" candidate_uuid: "f3a500981b494979b58d2b1041fec9c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0efc951052454eec9a58b0cd025945b8" is_pre_election: true
I20260709 13:23:02.323634 15384 raft_consensus.cc:515] T d64d06459b344ff99c0df07c249c3a60 P f3a500981b494979b58d2b1041fec9c8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } } peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } } peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } }
I20260709 13:23:02.388172 15073 leader_election.cc:304] T 03b63e2bee374ed5931dab67ee14b555 P a722e54d227f4c29a9ed6ce77858003a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a722e54d227f4c29a9ed6ce77858003a; no voters: a1a22e9119494570b6d2217713fd7e43, f3a500981b494979b58d2b1041fec9c8
I20260709 13:23:02.375845 15154 raft_consensus.cc:359] T decdd091b0f243d786ee350a437b30f1 P a722e54d227f4c29a9ed6ce77858003a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } } peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } } peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } }
I20260709 13:23:02.391211 15154 raft_consensus.cc:385] T decdd091b0f243d786ee350a437b30f1 P a722e54d227f4c29a9ed6ce77858003a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:23:02.391431 15154 raft_consensus.cc:740] T decdd091b0f243d786ee350a437b30f1 P a722e54d227f4c29a9ed6ce77858003a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a722e54d227f4c29a9ed6ce77858003a, State: Initialized, Role: FOLLOWER
I20260709 13:23:02.394228 15384 leader_election.cc:290] T d64d06459b344ff99c0df07c249c3a60 P f3a500981b494979b58d2b1041fec9c8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a722e54d227f4c29a9ed6ce77858003a (127.5.126.68:46669), 0efc951052454eec9a58b0cd025945b8 (127.5.126.66:34613)
I20260709 13:23:02.395479 15282 leader_election.cc:290] T aecef3c240394d54844ec8170e9cad59 P a722e54d227f4c29a9ed6ce77858003a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f3a500981b494979b58d2b1041fec9c8 (127.5.126.65:34129), 0efc951052454eec9a58b0cd025945b8 (127.5.126.66:34613)
I20260709 13:23:02.396075 15282 raft_consensus.cc:2749] T 03b63e2bee374ed5931dab67ee14b555 P a722e54d227f4c29a9ed6ce77858003a [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:23:02.398144 14885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aecef3c240394d54844ec8170e9cad59" candidate_uuid: "a722e54d227f4c29a9ed6ce77858003a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f3a500981b494979b58d2b1041fec9c8" is_pre_election: true
I20260709 13:23:02.399644 15153 tablet_bootstrap.cc:654] T c3abd41db36d404089eaf1f9063bbcb0 P 0efc951052454eec9a58b0cd025945b8: Neither blocks nor log segments found. Creating new log.
I20260709 13:23:02.401839 15156 tablet_bootstrap.cc:492] T 88a7c4171c664e819837994755edf95c P f3a500981b494979b58d2b1041fec9c8: No bootstrap required, opened a new log
I20260709 13:23:02.406709 15156 ts_tablet_manager.cc:1403] T 88a7c4171c664e819837994755edf95c P f3a500981b494979b58d2b1041fec9c8: Time spent bootstrapping tablet: real 0.203s	user 0.019s	sys 0.012s
I20260709 13:23:02.401770 14960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aecef3c240394d54844ec8170e9cad59" candidate_uuid: "a722e54d227f4c29a9ed6ce77858003a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0efc951052454eec9a58b0cd025945b8" is_pre_election: true
I20260709 13:23:02.411345 15033 raft_consensus.cc:3060] T e429eefef04d433e8f18dfbc0387068d P a1a22e9119494570b6d2217713fd7e43 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:23:02.412819 14959 raft_consensus.cc:2468] T 107541237b4a452e8b47b0c3527b7ede P 0efc951052454eec9a58b0cd025945b8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f3a500981b494979b58d2b1041fec9c8 in term 1.
I20260709 13:23:02.412540 15156 raft_consensus.cc:359] T 88a7c4171c664e819837994755edf95c P f3a500981b494979b58d2b1041fec9c8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } } peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } } peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } }
I20260709 13:23:02.428141 15156 raft_consensus.cc:385] T 88a7c4171c664e819837994755edf95c P f3a500981b494979b58d2b1041fec9c8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:23:02.428572 15156 raft_consensus.cc:740] T 88a7c4171c664e819837994755edf95c P f3a500981b494979b58d2b1041fec9c8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f3a500981b494979b58d2b1041fec9c8, State: Initialized, Role: FOLLOWER
I20260709 13:23:02.413957 15073 leader_election.cc:304] T aecef3c240394d54844ec8170e9cad59 P a722e54d227f4c29a9ed6ce77858003a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a722e54d227f4c29a9ed6ce77858003a; no voters: 0efc951052454eec9a58b0cd025945b8, f3a500981b494979b58d2b1041fec9c8
I20260709 13:23:02.373692 15224 leader_election.cc:290] T c3abd41db36d404089eaf1f9063bbcb0 P a1a22e9119494570b6d2217713fd7e43 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f3a500981b494979b58d2b1041fec9c8 (127.5.126.65:34129), 0efc951052454eec9a58b0cd025945b8 (127.5.126.66:34613)
I20260709 13:23:02.387903 15429 raft_consensus.cc:515] T 532cc9041f414e018098570192e0fae8 P f3a500981b494979b58d2b1041fec9c8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } } peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } } peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } }
I20260709 13:23:02.422647 14781 catalog_manager.cc:5697] T 8996bae84ecc4bffa0239d64dce7b24f P a722e54d227f4c29a9ed6ce77858003a reported cstate change: term changed from 0 to 1, leader changed from <none> to a722e54d227f4c29a9ed6ce77858003a (127.5.126.68). New cstate: current_term: 1 leader_uuid: "a722e54d227f4c29a9ed6ce77858003a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } health_report { overall_health: UNKNOWN } } }
I20260709 13:23:02.426642 15154 consensus_queue.cc:260] T decdd091b0f243d786ee350a437b30f1 P a722e54d227f4c29a9ed6ce77858003a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } } peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } } peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } }
I20260709 13:23:02.430747 15213 raft_consensus.cc:2749] T aecef3c240394d54844ec8170e9cad59 P a722e54d227f4c29a9ed6ce77858003a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:23:02.445417 15429 leader_election.cc:290] T 532cc9041f414e018098570192e0fae8 P f3a500981b494979b58d2b1041fec9c8 [CANDIDATE]: Term 1 election: Requested vote from peers a722e54d227f4c29a9ed6ce77858003a (127.5.126.68:46669), 0efc951052454eec9a58b0cd025945b8 (127.5.126.66:34613)
I20260709 13:23:02.446254 15156 consensus_queue.cc:260] T 88a7c4171c664e819837994755edf95c P f3a500981b494979b58d2b1041fec9c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } } peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } } peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } }
I20260709 13:23:02.448616 15156 ts_tablet_manager.cc:1434] T 88a7c4171c664e819837994755edf95c P f3a500981b494979b58d2b1041fec9c8: Time spent starting tablet: real 0.042s	user 0.009s	sys 0.000s
I20260709 13:23:02.449774 15156 tablet_bootstrap.cc:492] T e1ae79ed138a4950a681f24aa1107ef3 P f3a500981b494979b58d2b1041fec9c8: Bootstrap starting.
I20260709 13:23:02.452369 15363 raft_consensus.cc:2749] T 8996bae84ecc4bffa0239d64dce7b24f P f3a500981b494979b58d2b1041fec9c8 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:23:02.457243 14999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.68:46669, user_credentials={real_user=slave}} blocked reactor thread for 114095us
I20260709 13:23:02.455657 15258 raft_consensus.cc:515] T c3abd41db36d404089eaf1f9063bbcb0 P f3a500981b494979b58d2b1041fec9c8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } } peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } } peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } }
I20260709 13:23:02.463286 15154 ts_tablet_manager.cc:1434] T decdd091b0f243d786ee350a437b30f1 P a722e54d227f4c29a9ed6ce77858003a: Time spent starting tablet: real 0.131s	user 0.007s	sys 0.002s
I20260709 13:23:02.462733 15282 raft_consensus.cc:493] T decdd091b0f243d786ee350a437b30f1 P a722e54d227f4c29a9ed6ce77858003a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:23:02.477382 14960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3abd41db36d404089eaf1f9063bbcb0" candidate_uuid: "a1a22e9119494570b6d2217713fd7e43" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0efc951052454eec9a58b0cd025945b8" is_pre_election: true
I20260709 13:23:02.477329 15258 leader_election.cc:290] T c3abd41db36d404089eaf1f9063bbcb0 P f3a500981b494979b58d2b1041fec9c8 [CANDIDATE]: Term 1 election: Requested vote from peers 0efc951052454eec9a58b0cd025945b8 (127.5.126.66:34613), a1a22e9119494570b6d2217713fd7e43 (127.5.126.67:38125)
I20260709 13:23:02.478521 15155 tablet_bootstrap.cc:492] T decdd091b0f243d786ee350a437b30f1 P a1a22e9119494570b6d2217713fd7e43: No bootstrap required, opened a new log
I20260709 13:23:02.479169 15155 ts_tablet_manager.cc:1403] T decdd091b0f243d786ee350a437b30f1 P a1a22e9119494570b6d2217713fd7e43: Time spent bootstrapping tablet: real 0.311s	user 0.012s	sys 0.008s
W20260709 13:23:02.481209 14850 leader_election.cc:343] T c3abd41db36d404089eaf1f9063bbcb0 P f3a500981b494979b58d2b1041fec9c8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0efc951052454eec9a58b0cd025945b8 (127.5.126.66:34613): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:23:02.488106 15107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "532cc9041f414e018098570192e0fae8" candidate_uuid: "f3a500981b494979b58d2b1041fec9c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a722e54d227f4c29a9ed6ce77858003a"
I20260709 13:23:02.488519 15105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d64d06459b344ff99c0df07c249c3a60" candidate_uuid: "f3a500981b494979b58d2b1041fec9c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a722e54d227f4c29a9ed6ce77858003a" is_pre_election: true
I20260709 13:23:02.488142 14884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3abd41db36d404089eaf1f9063bbcb0" candidate_uuid: "a1a22e9119494570b6d2217713fd7e43" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f3a500981b494979b58d2b1041fec9c8" is_pre_election: true
I20260709 13:23:02.489490 15156 tablet_bootstrap.cc:654] T e1ae79ed138a4950a681f24aa1107ef3 P f3a500981b494979b58d2b1041fec9c8: Neither blocks nor log segments found. Creating new log.
I20260709 13:23:02.489746 14884 raft_consensus.cc:2393] T c3abd41db36d404089eaf1f9063bbcb0 P f3a500981b494979b58d2b1041fec9c8 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a1a22e9119494570b6d2217713fd7e43 in current term 1: Already voted for candidate f3a500981b494979b58d2b1041fec9c8 in this term.
I20260709 13:23:02.489718 15385 consensus_queue.cc:1048] T 03b63e2bee374ed5931dab67ee14b555 P f3a500981b494979b58d2b1041fec9c8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:23:02.490871 15033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3abd41db36d404089eaf1f9063bbcb0" candidate_uuid: "f3a500981b494979b58d2b1041fec9c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1a22e9119494570b6d2217713fd7e43"
I20260709 13:23:02.492868 15033 raft_consensus.cc:3060] T c3abd41db36d404089eaf1f9063bbcb0 P a1a22e9119494570b6d2217713fd7e43 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:23:02.493954 14957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3abd41db36d404089eaf1f9063bbcb0" candidate_uuid: "f3a500981b494979b58d2b1041fec9c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0efc951052454eec9a58b0cd025945b8"
I20260709 13:23:02.482471 15155 raft_consensus.cc:359] T decdd091b0f243d786ee350a437b30f1 P a1a22e9119494570b6d2217713fd7e43 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } } peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } } peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } }
I20260709 13:23:02.494882 15155 raft_consensus.cc:385] T decdd091b0f243d786ee350a437b30f1 P a1a22e9119494570b6d2217713fd7e43 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:23:02.495190 15155 raft_consensus.cc:740] T decdd091b0f243d786ee350a437b30f1 P a1a22e9119494570b6d2217713fd7e43 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a1a22e9119494570b6d2217713fd7e43, State: Initialized, Role: FOLLOWER
I20260709 13:23:02.495879 15155 consensus_queue.cc:260] T decdd091b0f243d786ee350a437b30f1 P a1a22e9119494570b6d2217713fd7e43 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } } peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } } peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } }
I20260709 13:23:02.498297 15155 ts_tablet_manager.cc:1434] T decdd091b0f243d786ee350a437b30f1 P a1a22e9119494570b6d2217713fd7e43: Time spent starting tablet: real 0.019s	user 0.009s	sys 0.001s
W20260709 13:23:02.498859 14999 leader_election.cc:343] T c3abd41db36d404089eaf1f9063bbcb0 P a1a22e9119494570b6d2217713fd7e43 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0efc951052454eec9a58b0cd025945b8 (127.5.126.66:34613): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:23:02.499571 15155 tablet_bootstrap.cc:492] T b0b7e1c1e67845cb9bd2208bb2fb7c21 P a1a22e9119494570b6d2217713fd7e43: Bootstrap starting.
I20260709 13:23:02.501578 14999 leader_election.cc:304] T c3abd41db36d404089eaf1f9063bbcb0 P a1a22e9119494570b6d2217713fd7e43 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1a22e9119494570b6d2217713fd7e43; no voters: 0efc951052454eec9a58b0cd025945b8, f3a500981b494979b58d2b1041fec9c8
I20260709 13:23:02.459616 15215 consensus_queue.cc:1048] T e429eefef04d433e8f18dfbc0387068d P 0efc951052454eec9a58b0cd025945b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.012s
I20260709 13:23:02.504290 15154 tablet_bootstrap.cc:492] T 532cc9041f414e018098570192e0fae8 P a722e54d227f4c29a9ed6ce77858003a: Bootstrap starting.
I20260709 13:23:02.503795 15282 raft_consensus.cc:515] T decdd091b0f243d786ee350a437b30f1 P a722e54d227f4c29a9ed6ce77858003a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } } peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } } peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } }
W20260709 13:23:02.500972 14850 leader_election.cc:343] T c3abd41db36d404089eaf1f9063bbcb0 P f3a500981b494979b58d2b1041fec9c8 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 0efc951052454eec9a58b0cd025945b8 (127.5.126.66:34613): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:23:02.513952 14958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "532cc9041f414e018098570192e0fae8" candidate_uuid: "f3a500981b494979b58d2b1041fec9c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0efc951052454eec9a58b0cd025945b8"
I20260709 13:23:02.515226 14958 raft_consensus.cc:3060] T 532cc9041f414e018098570192e0fae8 P 0efc951052454eec9a58b0cd025945b8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:23:02.515627 15282 leader_election.cc:290] T decdd091b0f243d786ee350a437b30f1 P a722e54d227f4c29a9ed6ce77858003a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0efc951052454eec9a58b0cd025945b8 (127.5.126.66:34613), a1a22e9119494570b6d2217713fd7e43 (127.5.126.67:38125)
W20260709 13:23:02.519810 14850 leader_election.cc:343] T d64d06459b344ff99c0df07c249c3a60 P f3a500981b494979b58d2b1041fec9c8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a722e54d227f4c29a9ed6ce77858003a (127.5.126.68:46669): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:23:02.520694 15031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "decdd091b0f243d786ee350a437b30f1" candidate_uuid: "a722e54d227f4c29a9ed6ce77858003a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1a22e9119494570b6d2217713fd7e43" is_pre_election: true
I20260709 13:23:02.521947 15031 raft_consensus.cc:2468] T decdd091b0f243d786ee350a437b30f1 P a1a22e9119494570b6d2217713fd7e43 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a722e54d227f4c29a9ed6ce77858003a in term 0.
I20260709 13:23:02.522526 14957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "decdd091b0f243d786ee350a437b30f1" candidate_uuid: "a722e54d227f4c29a9ed6ce77858003a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0efc951052454eec9a58b0cd025945b8" is_pre_election: true
I20260709 13:23:02.523291 14957 raft_consensus.cc:2468] T decdd091b0f243d786ee350a437b30f1 P 0efc951052454eec9a58b0cd025945b8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a722e54d227f4c29a9ed6ce77858003a in term 0.
I20260709 13:23:02.523782 15072 leader_election.cc:304] T decdd091b0f243d786ee350a437b30f1 P a722e54d227f4c29a9ed6ce77858003a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1a22e9119494570b6d2217713fd7e43, a722e54d227f4c29a9ed6ce77858003a; no voters: 
I20260709 13:23:02.524293 15155 tablet_bootstrap.cc:654] T b0b7e1c1e67845cb9bd2208bb2fb7c21 P a1a22e9119494570b6d2217713fd7e43: Neither blocks nor log segments found. Creating new log.
I20260709 13:23:02.525118 15213 raft_consensus.cc:2804] T decdd091b0f243d786ee350a437b30f1 P a722e54d227f4c29a9ed6ce77858003a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:23:02.525539 15213 raft_consensus.cc:493] T decdd091b0f243d786ee350a437b30f1 P a722e54d227f4c29a9ed6ce77858003a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:23:02.525902 15213 raft_consensus.cc:3060] T decdd091b0f243d786ee350a437b30f1 P a722e54d227f4c29a9ed6ce77858003a [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:23:02.534479 14850 leader_election.cc:343] T 532cc9041f414e018098570192e0fae8 P f3a500981b494979b58d2b1041fec9c8 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer a722e54d227f4c29a9ed6ce77858003a (127.5.126.68:46669): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:23:02.538295 14959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d64d06459b344ff99c0df07c249c3a60" candidate_uuid: "f3a500981b494979b58d2b1041fec9c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0efc951052454eec9a58b0cd025945b8" is_pre_election: true
I20260709 13:23:02.558733 14958 raft_consensus.cc:2468] T 532cc9041f414e018098570192e0fae8 P 0efc951052454eec9a58b0cd025945b8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f3a500981b494979b58d2b1041fec9c8 in term 1.
I20260709 13:23:02.560016 15439 raft_consensus.cc:493] T e4a490a7748841c3803607059f9d8825 P 0efc951052454eec9a58b0cd025945b8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:23:02.562095 15427 raft_consensus.cc:493] T e429eefef04d433e8f18dfbc0387068d P a1a22e9119494570b6d2217713fd7e43 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:23:02.562633 15427 raft_consensus.cc:515] T e429eefef04d433e8f18dfbc0387068d P a1a22e9119494570b6d2217713fd7e43 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } } peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } } peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } }
I20260709 13:23:02.566435 15427 leader_election.cc:290] T e429eefef04d433e8f18dfbc0387068d P a1a22e9119494570b6d2217713fd7e43 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0efc951052454eec9a58b0cd025945b8 (127.5.126.66:34613), a722e54d227f4c29a9ed6ce77858003a (127.5.126.68:46669)
I20260709 13:23:02.565807 15211 consensus_queue.cc:1048] T e429eefef04d433e8f18dfbc0387068d P 0efc951052454eec9a58b0cd025945b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:23:02.566852 15153 tablet_bootstrap.cc:492] T c3abd41db36d404089eaf1f9063bbcb0 P 0efc951052454eec9a58b0cd025945b8: No bootstrap required, opened a new log
I20260709 13:23:02.567968 15107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e429eefef04d433e8f18dfbc0387068d" candidate_uuid: "a1a22e9119494570b6d2217713fd7e43" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a722e54d227f4c29a9ed6ce77858003a" is_pre_election: true
I20260709 13:23:02.570202 14959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e429eefef04d433e8f18dfbc0387068d" candidate_uuid: "a1a22e9119494570b6d2217713fd7e43" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0efc951052454eec9a58b0cd025945b8" is_pre_election: true
W20260709 13:23:02.571250 14850 leader_election.cc:343] T d64d06459b344ff99c0df07c249c3a60 P f3a500981b494979b58d2b1041fec9c8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0efc951052454eec9a58b0cd025945b8 (127.5.126.66:34613): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:23:02.560966 15439 raft_consensus.cc:515] T e4a490a7748841c3803607059f9d8825 P 0efc951052454eec9a58b0cd025945b8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } } peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } } peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } }
I20260709 13:23:02.578702 15153 ts_tablet_manager.cc:1403] T c3abd41db36d404089eaf1f9063bbcb0 P 0efc951052454eec9a58b0cd025945b8: Time spent bootstrapping tablet: real 0.308s	user 0.015s	sys 0.031s
I20260709 13:23:02.584350 14780 catalog_manager.cc:5697] T 107541237b4a452e8b47b0c3527b7ede P f3a500981b494979b58d2b1041fec9c8 reported cstate change: term changed from 0 to 1, leader changed from <none> to f3a500981b494979b58d2b1041fec9c8 (127.5.126.65). New cstate: current_term: 1 leader_uuid: "f3a500981b494979b58d2b1041fec9c8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } health_report { overall_health: UNKNOWN } } }
I20260709 13:23:02.583089 15107 raft_consensus.cc:2468] T e429eefef04d433e8f18dfbc0387068d P a722e54d227f4c29a9ed6ce77858003a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1a22e9119494570b6d2217713fd7e43 in term 1.
I20260709 13:23:02.583323 14850 leader_election.cc:304] T d64d06459b344ff99c0df07c249c3a60 P f3a500981b494979b58d2b1041fec9c8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f3a500981b494979b58d2b1041fec9c8; no voters: 0efc951052454eec9a58b0cd025945b8, a722e54d227f4c29a9ed6ce77858003a
I20260709 13:23:02.593516 15385 raft_consensus.cc:2749] T d64d06459b344ff99c0df07c249c3a60 P f3a500981b494979b58d2b1041fec9c8 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:23:02.595091 14850 leader_election.cc:304] T 532cc9041f414e018098570192e0fae8 P f3a500981b494979b58d2b1041fec9c8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0efc951052454eec9a58b0cd025945b8, f3a500981b494979b58d2b1041fec9c8; no voters: a722e54d227f4c29a9ed6ce77858003a
I20260709 13:23:02.595949 15385 raft_consensus.cc:2804] T 532cc9041f414e018098570192e0fae8 P f3a500981b494979b58d2b1041fec9c8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:23:02.596479 15385 raft_consensus.cc:697] T 532cc9041f414e018098570192e0fae8 P f3a500981b494979b58d2b1041fec9c8 [term 1 LEADER]: Becoming Leader. State: Replica: f3a500981b494979b58d2b1041fec9c8, State: Running, Role: LEADER
I20260709 13:23:02.596716 14999 leader_election.cc:304] T e429eefef04d433e8f18dfbc0387068d P a1a22e9119494570b6d2217713fd7e43 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1a22e9119494570b6d2217713fd7e43, a722e54d227f4c29a9ed6ce77858003a; no voters: 
I20260709 13:23:02.597339 15385 consensus_queue.cc:237] T 532cc9041f414e018098570192e0fae8 P f3a500981b494979b58d2b1041fec9c8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } } peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } } peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } }
I20260709 13:23:02.596110 15156 tablet_bootstrap.cc:492] T e1ae79ed138a4950a681f24aa1107ef3 P f3a500981b494979b58d2b1041fec9c8: No bootstrap required, opened a new log
I20260709 13:23:02.599741 15156 ts_tablet_manager.cc:1403] T e1ae79ed138a4950a681f24aa1107ef3 P f3a500981b494979b58d2b1041fec9c8: Time spent bootstrapping tablet: real 0.150s	user 0.022s	sys 0.007s
I20260709 13:23:02.603382 15154 tablet_bootstrap.cc:654] T 532cc9041f414e018098570192e0fae8 P a722e54d227f4c29a9ed6ce77858003a: Neither blocks nor log segments found. Creating new log.
I20260709 13:23:02.614423 15153 raft_consensus.cc:359] T c3abd41db36d404089eaf1f9063bbcb0 P 0efc951052454eec9a58b0cd025945b8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } } peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } } peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } }
I20260709 13:23:02.617154 15153 raft_consensus.cc:385] T c3abd41db36d404089eaf1f9063bbcb0 P 0efc951052454eec9a58b0cd025945b8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:23:02.617614 15153 raft_consensus.cc:740] T c3abd41db36d404089eaf1f9063bbcb0 P 0efc951052454eec9a58b0cd025945b8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0efc951052454eec9a58b0cd025945b8, State: Initialized, Role: FOLLOWER
I20260709 13:23:02.618392 15153 consensus_queue.cc:260] T c3abd41db36d404089eaf1f9063bbcb0 P 0efc951052454eec9a58b0cd025945b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } } peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } } peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } }
I20260709 13:23:02.619948 15418 consensus_queue.cc:1048] T 8996bae84ecc4bffa0239d64dce7b24f P a722e54d227f4c29a9ed6ce77858003a [LEADER]: Connected to new peer: Peer: permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:23:02.620831 15153 ts_tablet_manager.cc:1434] T c3abd41db36d404089eaf1f9063bbcb0 P 0efc951052454eec9a58b0cd025945b8: Time spent starting tablet: real 0.038s	user 0.003s	sys 0.005s
I20260709 13:23:02.626446 15213 raft_consensus.cc:515] T decdd091b0f243d786ee350a437b30f1 P a722e54d227f4c29a9ed6ce77858003a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } } peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } } peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } }
I20260709 13:23:02.621752 15033 raft_consensus.cc:2468] T c3abd41db36d404089eaf1f9063bbcb0 P a1a22e9119494570b6d2217713fd7e43 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f3a500981b494979b58d2b1041fec9c8 in term 1.
I20260709 13:23:02.628886 14849 leader_election.cc:304] T c3abd41db36d404089eaf1f9063bbcb0 P f3a500981b494979b58d2b1041fec9c8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a1a22e9119494570b6d2217713fd7e43, f3a500981b494979b58d2b1041fec9c8; no voters: 0efc951052454eec9a58b0cd025945b8
I20260709 13:23:02.615185 15156 raft_consensus.cc:359] T e1ae79ed138a4950a681f24aa1107ef3 P f3a500981b494979b58d2b1041fec9c8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } } peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } } peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } }
I20260709 13:23:02.631505 15156 raft_consensus.cc:385] T e1ae79ed138a4950a681f24aa1107ef3 P f3a500981b494979b58d2b1041fec9c8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:23:02.632534 15428 raft_consensus.cc:2804] T c3abd41db36d404089eaf1f9063bbcb0 P f3a500981b494979b58d2b1041fec9c8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:23:02.633062 15428 raft_consensus.cc:697] T c3abd41db36d404089eaf1f9063bbcb0 P f3a500981b494979b58d2b1041fec9c8 [term 1 LEADER]: Becoming Leader. State: Replica: f3a500981b494979b58d2b1041fec9c8, State: Running, Role: LEADER
I20260709 13:23:02.633903 15428 consensus_queue.cc:237] T c3abd41db36d404089eaf1f9063bbcb0 P f3a500981b494979b58d2b1041fec9c8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } } peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } } peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } }
I20260709 13:23:02.636751 15425 raft_consensus.cc:2804] T e429eefef04d433e8f18dfbc0387068d P a1a22e9119494570b6d2217713fd7e43 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:23:02.627887 15326 raft_consensus.cc:2749] T c3abd41db36d404089eaf1f9063bbcb0 P a1a22e9119494570b6d2217713fd7e43 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:23:02.638768 15425 raft_consensus.cc:493] T e429eefef04d433e8f18dfbc0387068d P a1a22e9119494570b6d2217713fd7e43 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 0efc951052454eec9a58b0cd025945b8)
I20260709 13:23:02.639324 15425 raft_consensus.cc:3060] T e429eefef04d433e8f18dfbc0387068d P a1a22e9119494570b6d2217713fd7e43 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:23:02.642050 15282 consensus_queue.cc:1048] T 8996bae84ecc4bffa0239d64dce7b24f P a722e54d227f4c29a9ed6ce77858003a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:23:02.646442 14957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "decdd091b0f243d786ee350a437b30f1" candidate_uuid: "a722e54d227f4c29a9ed6ce77858003a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0efc951052454eec9a58b0cd025945b8"
I20260709 13:23:02.647385 14957 raft_consensus.cc:3060] T decdd091b0f243d786ee350a437b30f1 P 0efc951052454eec9a58b0cd025945b8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:23:02.654201 15034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4a490a7748841c3803607059f9d8825" candidate_uuid: "0efc951052454eec9a58b0cd025945b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1a22e9119494570b6d2217713fd7e43" is_pre_election: true
I20260709 13:23:02.654359 15439 leader_election.cc:290] T e4a490a7748841c3803607059f9d8825 P 0efc951052454eec9a58b0cd025945b8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a1a22e9119494570b6d2217713fd7e43 (127.5.126.67:38125), a722e54d227f4c29a9ed6ce77858003a (127.5.126.68:46669)
I20260709 13:23:02.654953 15034 raft_consensus.cc:2468] T e4a490a7748841c3803607059f9d8825 P a1a22e9119494570b6d2217713fd7e43 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0efc951052454eec9a58b0cd025945b8 in term 0.
I20260709 13:23:02.656364 15108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4a490a7748841c3803607059f9d8825" candidate_uuid: "0efc951052454eec9a58b0cd025945b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a722e54d227f4c29a9ed6ce77858003a" is_pre_election: true
I20260709 13:23:02.660859 14924 leader_election.cc:304] T e4a490a7748841c3803607059f9d8825 P 0efc951052454eec9a58b0cd025945b8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0efc951052454eec9a58b0cd025945b8, a1a22e9119494570b6d2217713fd7e43; no voters: 
I20260709 13:23:02.662016 15439 raft_consensus.cc:2804] T e4a490a7748841c3803607059f9d8825 P 0efc951052454eec9a58b0cd025945b8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:23:02.662495 15439 raft_consensus.cc:493] T e4a490a7748841c3803607059f9d8825 P 0efc951052454eec9a58b0cd025945b8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:23:02.662904 15439 raft_consensus.cc:3060] T e4a490a7748841c3803607059f9d8825 P 0efc951052454eec9a58b0cd025945b8 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:23:02.663414 14925 leader_election.cc:343] T e4a490a7748841c3803607059f9d8825 P 0efc951052454eec9a58b0cd025945b8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a722e54d227f4c29a9ed6ce77858003a (127.5.126.68:46669): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:23:02.673341 15363 raft_consensus.cc:493] T 88a7c4171c664e819837994755edf95c P f3a500981b494979b58d2b1041fec9c8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:23:02.673249 15282 consensus_queue.cc:1048] T e4f2c694c8194f1e86ad76c7ff051ea7 P a722e54d227f4c29a9ed6ce77858003a [LEADER]: Connected to new peer: Peer: permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:23:02.674021 15363 raft_consensus.cc:515] T 88a7c4171c664e819837994755edf95c P f3a500981b494979b58d2b1041fec9c8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } } peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } } peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } }
I20260709 13:23:02.677348 15363 leader_election.cc:290] T 88a7c4171c664e819837994755edf95c P f3a500981b494979b58d2b1041fec9c8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0efc951052454eec9a58b0cd025945b8 (127.5.126.66:34613), a1a22e9119494570b6d2217713fd7e43 (127.5.126.67:38125)
I20260709 13:23:02.680101 14959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88a7c4171c664e819837994755edf95c" candidate_uuid: "f3a500981b494979b58d2b1041fec9c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0efc951052454eec9a58b0cd025945b8" is_pre_election: true
I20260709 13:23:02.680691 15153 tablet_bootstrap.cc:492] T 58a622a48cd24833bc5fc27e03114176 P 0efc951052454eec9a58b0cd025945b8: Bootstrap starting.
I20260709 13:23:02.680472 15034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88a7c4171c664e819837994755edf95c" candidate_uuid: "f3a500981b494979b58d2b1041fec9c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1a22e9119494570b6d2217713fd7e43" is_pre_election: true
W20260709 13:23:02.683929 14849 leader_election.cc:343] T 88a7c4171c664e819837994755edf95c P f3a500981b494979b58d2b1041fec9c8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a1a22e9119494570b6d2217713fd7e43 (127.5.126.67:38125): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:23:02.685123 14850 leader_election.cc:343] T 88a7c4171c664e819837994755edf95c P f3a500981b494979b58d2b1041fec9c8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0efc951052454eec9a58b0cd025945b8 (127.5.126.66:34613): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:23:02.685573 14850 leader_election.cc:304] T 88a7c4171c664e819837994755edf95c P f3a500981b494979b58d2b1041fec9c8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f3a500981b494979b58d2b1041fec9c8; no voters: 0efc951052454eec9a58b0cd025945b8, a1a22e9119494570b6d2217713fd7e43
I20260709 13:23:02.686713 15363 raft_consensus.cc:2749] T 88a7c4171c664e819837994755edf95c P f3a500981b494979b58d2b1041fec9c8 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:23:02.689393 15031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "decdd091b0f243d786ee350a437b30f1" candidate_uuid: "a722e54d227f4c29a9ed6ce77858003a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1a22e9119494570b6d2217713fd7e43"
I20260709 13:23:02.690356 15031 raft_consensus.cc:3060] T decdd091b0f243d786ee350a437b30f1 P a1a22e9119494570b6d2217713fd7e43 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:23:02.630839 15213 leader_election.cc:290] T decdd091b0f243d786ee350a437b30f1 P a722e54d227f4c29a9ed6ce77858003a [CANDIDATE]: Term 1 election: Requested vote from peers 0efc951052454eec9a58b0cd025945b8 (127.5.126.66:34613), a1a22e9119494570b6d2217713fd7e43 (127.5.126.67:38125)
I20260709 13:23:02.631815 15156 raft_consensus.cc:740] T e1ae79ed138a4950a681f24aa1107ef3 P f3a500981b494979b58d2b1041fec9c8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f3a500981b494979b58d2b1041fec9c8, State: Initialized, Role: FOLLOWER
I20260709 13:23:02.692605 15156 consensus_queue.cc:260] T e1ae79ed138a4950a681f24aa1107ef3 P f3a500981b494979b58d2b1041fec9c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } } peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } } peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } }
I20260709 13:23:02.694849 15425 raft_consensus.cc:515] T e429eefef04d433e8f18dfbc0387068d P a1a22e9119494570b6d2217713fd7e43 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } } peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } } peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } }
I20260709 13:23:02.712105 14959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e429eefef04d433e8f18dfbc0387068d" candidate_uuid: "a1a22e9119494570b6d2217713fd7e43" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0efc951052454eec9a58b0cd025945b8"
I20260709 13:23:02.715394 15425 leader_election.cc:290] T e429eefef04d433e8f18dfbc0387068d P a1a22e9119494570b6d2217713fd7e43 [CANDIDATE]: Term 2 election: Requested vote from peers 0efc951052454eec9a58b0cd025945b8 (127.5.126.66:34613), a722e54d227f4c29a9ed6ce77858003a (127.5.126.68:46669)
I20260709 13:23:02.717263 15033 raft_consensus.cc:1240] T e429eefef04d433e8f18dfbc0387068d P a1a22e9119494570b6d2217713fd7e43 [term 2 FOLLOWER]: Rejecting Update request from peer 0efc951052454eec9a58b0cd025945b8 for earlier term 1. Current term is 2. Ops: []
I20260709 13:23:02.712399 15153 tablet_bootstrap.cc:654] T 58a622a48cd24833bc5fc27e03114176 P 0efc951052454eec9a58b0cd025945b8: Neither blocks nor log segments found. Creating new log.
I20260709 13:23:02.717609 15108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e429eefef04d433e8f18dfbc0387068d" candidate_uuid: "a1a22e9119494570b6d2217713fd7e43" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a722e54d227f4c29a9ed6ce77858003a"
I20260709 13:23:02.720332 14999 leader_election.cc:304] T e429eefef04d433e8f18dfbc0387068d P a1a22e9119494570b6d2217713fd7e43 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1a22e9119494570b6d2217713fd7e43; no voters: 0efc951052454eec9a58b0cd025945b8, a722e54d227f4c29a9ed6ce77858003a
I20260709 13:23:02.724284 15425 raft_consensus.cc:2749] T e429eefef04d433e8f18dfbc0387068d P a1a22e9119494570b6d2217713fd7e43 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:23:02.724442 15383 consensus_queue.cc:1059] T e429eefef04d433e8f18dfbc0387068d P 0efc951052454eec9a58b0cd025945b8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:23:02.727078 15383 raft_consensus.cc:3055] T e429eefef04d433e8f18dfbc0387068d P 0efc951052454eec9a58b0cd025945b8 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:23:02.727392 15383 raft_consensus.cc:740] T e429eefef04d433e8f18dfbc0387068d P 0efc951052454eec9a58b0cd025945b8 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0efc951052454eec9a58b0cd025945b8, State: Running, Role: LEADER
I20260709 13:23:02.727499 15213 consensus_queue.cc:1048] T e4f2c694c8194f1e86ad76c7ff051ea7 P a722e54d227f4c29a9ed6ce77858003a [LEADER]: Connected to new peer: Peer: permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:23:02.728395 15383 consensus_queue.cc:260] T e429eefef04d433e8f18dfbc0387068d P 0efc951052454eec9a58b0cd025945b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } } peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } } peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } }
I20260709 13:23:02.729638 15383 raft_consensus.cc:3060] T e429eefef04d433e8f18dfbc0387068d P 0efc951052454eec9a58b0cd025945b8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:23:02.695303 15156 ts_tablet_manager.cc:1434] T e1ae79ed138a4950a681f24aa1107ef3 P f3a500981b494979b58d2b1041fec9c8: Time spent starting tablet: real 0.095s	user 0.004s	sys 0.001s
I20260709 13:23:02.698501 15439 raft_consensus.cc:515] T e4a490a7748841c3803607059f9d8825 P 0efc951052454eec9a58b0cd025945b8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } } peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } } peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } }
I20260709 13:23:02.803999 15258 raft_consensus.cc:493] T e1ae79ed138a4950a681f24aa1107ef3 P f3a500981b494979b58d2b1041fec9c8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:23:02.836294 15156 tablet_bootstrap.cc:492] T 03f377f48e8849adade3945935d300a9 P f3a500981b494979b58d2b1041fec9c8: Bootstrap starting.
I20260709 13:23:02.828163 15031 raft_consensus.cc:2468] T decdd091b0f243d786ee350a437b30f1 P a1a22e9119494570b6d2217713fd7e43 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a722e54d227f4c29a9ed6ce77858003a in term 1.
I20260709 13:23:02.824579 15258 raft_consensus.cc:515] T e1ae79ed138a4950a681f24aa1107ef3 P f3a500981b494979b58d2b1041fec9c8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } } peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } } peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } }
I20260709 13:23:02.883370 15155 tablet_bootstrap.cc:492] T b0b7e1c1e67845cb9bd2208bb2fb7c21 P a1a22e9119494570b6d2217713fd7e43: No bootstrap required, opened a new log
I20260709 13:23:02.883944 15155 ts_tablet_manager.cc:1403] T b0b7e1c1e67845cb9bd2208bb2fb7c21 P a1a22e9119494570b6d2217713fd7e43: Time spent bootstrapping tablet: real 0.385s	user 0.017s	sys 0.061s
I20260709 13:23:02.898944 15072 leader_election.cc:304] T decdd091b0f243d786ee350a437b30f1 P a722e54d227f4c29a9ed6ce77858003a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1a22e9119494570b6d2217713fd7e43, a722e54d227f4c29a9ed6ce77858003a; no voters: 
I20260709 13:23:02.907246 15282 raft_consensus.cc:2804] T decdd091b0f243d786ee350a437b30f1 P a722e54d227f4c29a9ed6ce77858003a [term 1 FOLLOWER]: Leader election won for term 1
W20260709 13:23:02.911712 15441 log.cc:927] Time spent T e3693e8a3b0444bf978dc845dcfd2a45 P f3a500981b494979b58d2b1041fec9c8: Append to log took a long time: real 0.087s	user 0.001s	sys 0.000s
I20260709 13:23:02.907907 15282 raft_consensus.cc:697] T decdd091b0f243d786ee350a437b30f1 P a722e54d227f4c29a9ed6ce77858003a [term 1 LEADER]: Becoming Leader. State: Replica: a722e54d227f4c29a9ed6ce77858003a, State: Running, Role: LEADER
I20260709 13:23:02.928512 15439 leader_election.cc:290] T e4a490a7748841c3803607059f9d8825 P 0efc951052454eec9a58b0cd025945b8 [CANDIDATE]: Term 1 election: Requested vote from peers a1a22e9119494570b6d2217713fd7e43 (127.5.126.67:38125), a722e54d227f4c29a9ed6ce77858003a (127.5.126.68:46669)
I20260709 13:23:02.930217 15154 tablet_bootstrap.cc:492] T 532cc9041f414e018098570192e0fae8 P a722e54d227f4c29a9ed6ce77858003a: No bootstrap required, opened a new log
I20260709 13:23:02.930701 15154 ts_tablet_manager.cc:1403] T 532cc9041f414e018098570192e0fae8 P a722e54d227f4c29a9ed6ce77858003a: Time spent bootstrapping tablet: real 0.460s	user 0.019s	sys 0.028s
I20260709 13:23:02.946550 15282 consensus_queue.cc:237] T decdd091b0f243d786ee350a437b30f1 P a722e54d227f4c29a9ed6ce77858003a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } } peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } } peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } }
W20260709 13:23:02.947665 14830 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:23:02.955773 15031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4a490a7748841c3803607059f9d8825" candidate_uuid: "0efc951052454eec9a58b0cd025945b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1a22e9119494570b6d2217713fd7e43"
I20260709 13:23:02.956751 15031 raft_consensus.cc:3060] T e4a490a7748841c3803607059f9d8825 P a1a22e9119494570b6d2217713fd7e43 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:23:02.959129 14782 catalog_manager.cc:5697] T 532cc9041f414e018098570192e0fae8 P f3a500981b494979b58d2b1041fec9c8 reported cstate change: term changed from 0 to 1, leader changed from <none> to f3a500981b494979b58d2b1041fec9c8 (127.5.126.65). New cstate: current_term: 1 leader_uuid: "f3a500981b494979b58d2b1041fec9c8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } health_report { overall_health: UNKNOWN } } }
I20260709 13:23:02.961683 14957 raft_consensus.cc:2468] T decdd091b0f243d786ee350a437b30f1 P 0efc951052454eec9a58b0cd025945b8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a722e54d227f4c29a9ed6ce77858003a in term 1.
I20260709 13:23:02.962179 14782 catalog_manager.cc:5697] T c3abd41db36d404089eaf1f9063bbcb0 P f3a500981b494979b58d2b1041fec9c8 reported cstate change: term changed from 0 to 1, leader changed from <none> to f3a500981b494979b58d2b1041fec9c8 (127.5.126.65). New cstate: current_term: 1 leader_uuid: "f3a500981b494979b58d2b1041fec9c8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } health_report { overall_health: UNKNOWN } } }
W20260709 13:23:02.965934 15443 log.cc:927] Time spent T 03b63e2bee374ed5931dab67ee14b555 P a722e54d227f4c29a9ed6ce77858003a: Append to log took a long time: real 0.098s	user 0.000s	sys 0.001s
I20260709 13:23:02.972604 15154 raft_consensus.cc:359] T 532cc9041f414e018098570192e0fae8 P a722e54d227f4c29a9ed6ce77858003a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } } peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } } peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } }
I20260709 13:23:02.973491 15154 raft_consensus.cc:385] T 532cc9041f414e018098570192e0fae8 P a722e54d227f4c29a9ed6ce77858003a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:23:02.973805 15154 raft_consensus.cc:740] T 532cc9041f414e018098570192e0fae8 P a722e54d227f4c29a9ed6ce77858003a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a722e54d227f4c29a9ed6ce77858003a, State: Initialized, Role: FOLLOWER
I20260709 13:23:02.976756 15154 consensus_queue.cc:260] T 532cc9041f414e018098570192e0fae8 P a722e54d227f4c29a9ed6ce77858003a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } } peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } } peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } }
I20260709 13:23:02.979074 15258 leader_election.cc:290] T e1ae79ed138a4950a681f24aa1107ef3 P f3a500981b494979b58d2b1041fec9c8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0efc951052454eec9a58b0cd025945b8 (127.5.126.66:34613), a1a22e9119494570b6d2217713fd7e43 (127.5.126.67:38125)
I20260709 13:23:02.947732 15155 raft_consensus.cc:359] T b0b7e1c1e67845cb9bd2208bb2fb7c21 P a1a22e9119494570b6d2217713fd7e43 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } } peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } } peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } }
I20260709 13:23:02.953074 15153 tablet_bootstrap.cc:492] T 58a622a48cd24833bc5fc27e03114176 P 0efc951052454eec9a58b0cd025945b8: No bootstrap required, opened a new log
I20260709 13:23:02.985046 15153 ts_tablet_manager.cc:1403] T 58a622a48cd24833bc5fc27e03114176 P 0efc951052454eec9a58b0cd025945b8: Time spent bootstrapping tablet: real 0.305s	user 0.012s	sys 0.019s
I20260709 13:23:02.985821 15155 raft_consensus.cc:385] T b0b7e1c1e67845cb9bd2208bb2fb7c21 P a1a22e9119494570b6d2217713fd7e43 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:23:02.986308 15155 raft_consensus.cc:740] T b0b7e1c1e67845cb9bd2208bb2fb7c21 P a1a22e9119494570b6d2217713fd7e43 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a1a22e9119494570b6d2217713fd7e43, State: Initialized, Role: FOLLOWER
I20260709 13:23:02.999612 15154 ts_tablet_manager.cc:1434] T 532cc9041f414e018098570192e0fae8 P a722e54d227f4c29a9ed6ce77858003a: Time spent starting tablet: real 0.069s	user 0.006s	sys 0.001s
I20260709 13:23:03.001139 15154 tablet_bootstrap.cc:492] T d64d06459b344ff99c0df07c249c3a60 P a722e54d227f4c29a9ed6ce77858003a: Bootstrap starting.
I20260709 13:23:03.002084 15155 consensus_queue.cc:260] T b0b7e1c1e67845cb9bd2208bb2fb7c21 P a1a22e9119494570b6d2217713fd7e43 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } } peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } } peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } }
I20260709 13:23:03.010020 15363 consensus_queue.cc:1048] T 107541237b4a452e8b47b0c3527b7ede P f3a500981b494979b58d2b1041fec9c8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:23:03.026286 15153 raft_consensus.cc:359] T 58a622a48cd24833bc5fc27e03114176 P 0efc951052454eec9a58b0cd025945b8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } } peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } } peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } }
I20260709 13:23:03.027820 15153 raft_consensus.cc:385] T 58a622a48cd24833bc5fc27e03114176 P 0efc951052454eec9a58b0cd025945b8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:23:03.028306 15153 raft_consensus.cc:740] T 58a622a48cd24833bc5fc27e03114176 P 0efc951052454eec9a58b0cd025945b8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0efc951052454eec9a58b0cd025945b8, State: Initialized, Role: FOLLOWER
I20260709 13:23:03.040422 15456 raft_consensus.cc:493] T ced632bda66e4a74b9c854befbcbac9b P 0efc951052454eec9a58b0cd025945b8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a1a22e9119494570b6d2217713fd7e43)
I20260709 13:23:03.041173 15456 raft_consensus.cc:515] T ced632bda66e4a74b9c854befbcbac9b P 0efc951052454eec9a58b0cd025945b8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } } peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } } peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } }
I20260709 13:23:03.041589 15108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4a490a7748841c3803607059f9d8825" candidate_uuid: "0efc951052454eec9a58b0cd025945b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a722e54d227f4c29a9ed6ce77858003a"
I20260709 13:23:03.043706 15456 leader_election.cc:290] T ced632bda66e4a74b9c854befbcbac9b P 0efc951052454eec9a58b0cd025945b8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a1a22e9119494570b6d2217713fd7e43 (127.5.126.67:38125), a722e54d227f4c29a9ed6ce77858003a (127.5.126.68:46669)
I20260709 13:23:03.054605 15029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ced632bda66e4a74b9c854befbcbac9b" candidate_uuid: "0efc951052454eec9a58b0cd025945b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a1a22e9119494570b6d2217713fd7e43" is_pre_election: true
I20260709 13:23:03.055615 15029 raft_consensus.cc:2468] T ced632bda66e4a74b9c854befbcbac9b P a1a22e9119494570b6d2217713fd7e43 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0efc951052454eec9a58b0cd025945b8 in term 2.
I20260709 13:23:03.059203 15363 consensus_queue.cc:1048] T 107541237b4a452e8b47b0c3527b7ede P f3a500981b494979b58d2b1041fec9c8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:23:03.061057 14924 leader_election.cc:304] T ced632bda66e4a74b9c854befbcbac9b P 0efc951052454eec9a58b0cd025945b8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0efc951052454eec9a58b0cd025945b8, a1a22e9119494570b6d2217713fd7e43; no voters: 
I20260709 13:23:03.062688 15153 consensus_queue.cc:260] T 58a622a48cd24833bc5fc27e03114176 P 0efc951052454eec9a58b0cd025945b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } } peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } } peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } }
I20260709 13:23:03.049183 15032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1ae79ed138a4950a681f24aa1107ef3" candidate_uuid: "f3a500981b494979b58d2b1041fec9c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1a22e9119494570b6d2217713fd7e43" is_pre_election: true
W20260709 13:23:03.094857 14849 leader_election.cc:343] T e1ae79ed138a4950a681f24aa1107ef3 P f3a500981b494979b58d2b1041fec9c8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a1a22e9119494570b6d2217713fd7e43 (127.5.126.67:38125): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:23:03.077636 15383 raft_consensus.cc:493] T c3abd41db36d404089eaf1f9063bbcb0 P 0efc951052454eec9a58b0cd025945b8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:23:03.096185 15383 raft_consensus.cc:515] T c3abd41db36d404089eaf1f9063bbcb0 P 0efc951052454eec9a58b0cd025945b8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } } peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } } peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } }
I20260709 13:23:03.099582 15383 leader_election.cc:290] T c3abd41db36d404089eaf1f9063bbcb0 P 0efc951052454eec9a58b0cd025945b8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f3a500981b494979b58d2b1041fec9c8 (127.5.126.65:34129), a1a22e9119494570b6d2217713fd7e43 (127.5.126.67:38125)
I20260709 13:23:03.086014 14960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1ae79ed138a4950a681f24aa1107ef3" candidate_uuid: "f3a500981b494979b58d2b1041fec9c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0efc951052454eec9a58b0cd025945b8" is_pre_election: true
I20260709 13:23:03.106001 15107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ced632bda66e4a74b9c854befbcbac9b" candidate_uuid: "0efc951052454eec9a58b0cd025945b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a722e54d227f4c29a9ed6ce77858003a" is_pre_election: true
I20260709 13:23:03.107388 15107 raft_consensus.cc:2393] T ced632bda66e4a74b9c854befbcbac9b P a722e54d227f4c29a9ed6ce77858003a [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0efc951052454eec9a58b0cd025945b8 in current term 2: Already voted for candidate a722e54d227f4c29a9ed6ce77858003a in this term.
I20260709 13:23:03.116133 14959 raft_consensus.cc:3060] T c3abd41db36d404089eaf1f9063bbcb0 P 0efc951052454eec9a58b0cd025945b8 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:23:03.119416 14850 leader_election.cc:343] T e1ae79ed138a4950a681f24aa1107ef3 P f3a500981b494979b58d2b1041fec9c8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0efc951052454eec9a58b0cd025945b8 (127.5.126.66:34613): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:23:03.120344 14850 leader_election.cc:304] T e1ae79ed138a4950a681f24aa1107ef3 P f3a500981b494979b58d2b1041fec9c8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f3a500981b494979b58d2b1041fec9c8; no voters: 0efc951052454eec9a58b0cd025945b8, a1a22e9119494570b6d2217713fd7e43
I20260709 13:23:03.121829 15452 raft_consensus.cc:2749] T e1ae79ed138a4950a681f24aa1107ef3 P f3a500981b494979b58d2b1041fec9c8 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:23:03.128186 15154 tablet_bootstrap.cc:654] T d64d06459b344ff99c0df07c249c3a60 P a722e54d227f4c29a9ed6ce77858003a: Neither blocks nor log segments found. Creating new log.
I20260709 13:23:03.090512 15156 tablet_bootstrap.cc:654] T 03f377f48e8849adade3945935d300a9 P f3a500981b494979b58d2b1041fec9c8: Neither blocks nor log segments found. Creating new log.
I20260709 13:23:03.134352 15155 ts_tablet_manager.cc:1434] T b0b7e1c1e67845cb9bd2208bb2fb7c21 P a1a22e9119494570b6d2217713fd7e43: Time spent starting tablet: real 0.250s	user 0.008s	sys 0.002s
I20260709 13:23:03.137864 15440 raft_consensus.cc:2804] T ced632bda66e4a74b9c854befbcbac9b P 0efc951052454eec9a58b0cd025945b8 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:23:03.138615 15440 raft_consensus.cc:493] T ced632bda66e4a74b9c854befbcbac9b P 0efc951052454eec9a58b0cd025945b8 [term 1 FOLLOWER]: Starting leader election (detected failure of leader a1a22e9119494570b6d2217713fd7e43)
I20260709 13:23:03.139189 15440 raft_consensus.cc:3060] T ced632bda66e4a74b9c854befbcbac9b P 0efc951052454eec9a58b0cd025945b8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:23:03.166131 15153 ts_tablet_manager.cc:1434] T 58a622a48cd24833bc5fc27e03114176 P 0efc951052454eec9a58b0cd025945b8: Time spent starting tablet: real 0.181s	user 0.010s	sys 0.002s
I20260709 13:23:03.178807 15155 tablet_bootstrap.cc:492] T e1ae79ed138a4950a681f24aa1107ef3 P a1a22e9119494570b6d2217713fd7e43: Bootstrap starting.
W20260709 13:23:03.182293 14924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:38125, user_credentials={real_user=slave}} blocked reactor thread for 121333us
I20260709 13:23:03.206725 15153 tablet_bootstrap.cc:492] T e1ae79ed138a4950a681f24aa1107ef3 P 0efc951052454eec9a58b0cd025945b8: Bootstrap starting.
I20260709 13:23:03.190892 15031 raft_consensus.cc:2468] T e4a490a7748841c3803607059f9d8825 P a1a22e9119494570b6d2217713fd7e43 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0efc951052454eec9a58b0cd025945b8 in term 1.
I20260709 13:23:03.213996 15385 consensus_queue.cc:1048] T 532cc9041f414e018098570192e0fae8 P f3a500981b494979b58d2b1041fec9c8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:23:03.217042 15034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3abd41db36d404089eaf1f9063bbcb0" candidate_uuid: "0efc951052454eec9a58b0cd025945b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1a22e9119494570b6d2217713fd7e43" is_pre_election: true
I20260709 13:23:03.218154 15034 raft_consensus.cc:2393] T c3abd41db36d404089eaf1f9063bbcb0 P a1a22e9119494570b6d2217713fd7e43 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0efc951052454eec9a58b0cd025945b8 in current term 1: Already voted for candidate f3a500981b494979b58d2b1041fec9c8 in this term.
I20260709 13:23:03.241556 14782 catalog_manager.cc:5697] T decdd091b0f243d786ee350a437b30f1 P a722e54d227f4c29a9ed6ce77858003a reported cstate change: term changed from 0 to 1, leader changed from <none> to a722e54d227f4c29a9ed6ce77858003a (127.5.126.68). New cstate: current_term: 1 leader_uuid: "a722e54d227f4c29a9ed6ce77858003a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } health_report { overall_health: HEALTHY } } }
I20260709 13:23:03.260360 15108 raft_consensus.cc:3060] T 532cc9041f414e018098570192e0fae8 P a722e54d227f4c29a9ed6ce77858003a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:23:03.261905 15453 consensus_queue.cc:1048] T c3abd41db36d404089eaf1f9063bbcb0 P f3a500981b494979b58d2b1041fec9c8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:23:03.262511 15153 tablet_bootstrap.cc:654] T e1ae79ed138a4950a681f24aa1107ef3 P 0efc951052454eec9a58b0cd025945b8: Neither blocks nor log segments found. Creating new log.
W20260709 13:23:03.249269 14925 leader_election.cc:343] T e4a490a7748841c3803607059f9d8825 P 0efc951052454eec9a58b0cd025945b8 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer a722e54d227f4c29a9ed6ce77858003a (127.5.126.68:46669): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:23:03.274991 15155 tablet_bootstrap.cc:654] T e1ae79ed138a4950a681f24aa1107ef3 P a1a22e9119494570b6d2217713fd7e43: Neither blocks nor log segments found. Creating new log.
W20260709 13:23:03.306520 15073 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.65:34129, user_credentials={real_user=slave}} blocked reactor thread for 49672.5us
I20260709 13:23:03.316291 15154 tablet_bootstrap.cc:492] T d64d06459b344ff99c0df07c249c3a60 P a722e54d227f4c29a9ed6ce77858003a: No bootstrap required, opened a new log
I20260709 13:23:03.316898 15154 ts_tablet_manager.cc:1403] T d64d06459b344ff99c0df07c249c3a60 P a722e54d227f4c29a9ed6ce77858003a: Time spent bootstrapping tablet: real 0.316s	user 0.016s	sys 0.001s
I20260709 13:23:03.318672 15460 raft_consensus.cc:493] T 532cc9041f414e018098570192e0fae8 P a722e54d227f4c29a9ed6ce77858003a [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:23:03.319235 15460 raft_consensus.cc:515] T 532cc9041f414e018098570192e0fae8 P a722e54d227f4c29a9ed6ce77858003a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } } peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } } peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } }
I20260709 13:23:03.320461 14885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3abd41db36d404089eaf1f9063bbcb0" candidate_uuid: "0efc951052454eec9a58b0cd025945b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f3a500981b494979b58d2b1041fec9c8" is_pre_election: true
I20260709 13:23:03.323324 15460 leader_election.cc:290] T 532cc9041f414e018098570192e0fae8 P a722e54d227f4c29a9ed6ce77858003a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f3a500981b494979b58d2b1041fec9c8 (127.5.126.65:34129), 0efc951052454eec9a58b0cd025945b8 (127.5.126.66:34613)
I20260709 13:23:03.323124 15452 consensus_queue.cc:1048] T c3abd41db36d404089eaf1f9063bbcb0 P f3a500981b494979b58d2b1041fec9c8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:23:03.334982 15363 consensus_queue.cc:1048] T 532cc9041f414e018098570192e0fae8 P f3a500981b494979b58d2b1041fec9c8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:23:03.342876 14924 leader_election.cc:304] T e4a490a7748841c3803607059f9d8825 P 0efc951052454eec9a58b0cd025945b8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0efc951052454eec9a58b0cd025945b8, a1a22e9119494570b6d2217713fd7e43; no voters: a722e54d227f4c29a9ed6ce77858003a
I20260709 13:23:03.344208 15215 raft_consensus.cc:2804] T e4a490a7748841c3803607059f9d8825 P 0efc951052454eec9a58b0cd025945b8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:23:03.344758 15215 raft_consensus.cc:697] T e4a490a7748841c3803607059f9d8825 P 0efc951052454eec9a58b0cd025945b8 [term 1 LEADER]: Becoming Leader. State: Replica: 0efc951052454eec9a58b0cd025945b8, State: Running, Role: LEADER
I20260709 13:23:03.353731 15154 raft_consensus.cc:359] T d64d06459b344ff99c0df07c249c3a60 P a722e54d227f4c29a9ed6ce77858003a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } } peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } } peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } }
I20260709 13:23:03.355978 15154 raft_consensus.cc:385] T d64d06459b344ff99c0df07c249c3a60 P a722e54d227f4c29a9ed6ce77858003a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:23:03.356482 15154 raft_consensus.cc:740] T d64d06459b344ff99c0df07c249c3a60 P a722e54d227f4c29a9ed6ce77858003a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a722e54d227f4c29a9ed6ce77858003a, State: Initialized, Role: FOLLOWER
I20260709 13:23:03.360989 15154 consensus_queue.cc:260] T d64d06459b344ff99c0df07c249c3a60 P a722e54d227f4c29a9ed6ce77858003a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } } peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } } peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } }
I20260709 13:23:03.365424 15215 consensus_queue.cc:237] T e4a490a7748841c3803607059f9d8825 P 0efc951052454eec9a58b0cd025945b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } } peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } } peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } }
I20260709 13:23:03.367453 14925 leader_election.cc:304] T c3abd41db36d404089eaf1f9063bbcb0 P 0efc951052454eec9a58b0cd025945b8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0efc951052454eec9a58b0cd025945b8; no voters: a1a22e9119494570b6d2217713fd7e43, f3a500981b494979b58d2b1041fec9c8
I20260709 13:23:03.369107 15383 raft_consensus.cc:2749] T c3abd41db36d404089eaf1f9063bbcb0 P 0efc951052454eec9a58b0cd025945b8 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:23:03.372608 14881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "532cc9041f414e018098570192e0fae8" candidate_uuid: "a722e54d227f4c29a9ed6ce77858003a" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f3a500981b494979b58d2b1041fec9c8" is_pre_election: true
I20260709 13:23:03.382477 15434 raft_consensus.cc:493] T b0b7e1c1e67845cb9bd2208bb2fb7c21 P a1a22e9119494570b6d2217713fd7e43 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:23:03.387394 15434 raft_consensus.cc:515] T b0b7e1c1e67845cb9bd2208bb2fb7c21 P a1a22e9119494570b6d2217713fd7e43 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } } peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } } peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } }
I20260709 13:23:03.389286 15418 consensus_queue.cc:1048] T decdd091b0f243d786ee350a437b30f1 P a722e54d227f4c29a9ed6ce77858003a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:23:03.389739 15434 leader_election.cc:290] T b0b7e1c1e67845cb9bd2208bb2fb7c21 P a1a22e9119494570b6d2217713fd7e43 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f3a500981b494979b58d2b1041fec9c8 (127.5.126.65:34129), 0efc951052454eec9a58b0cd025945b8 (127.5.126.66:34613)
I20260709 13:23:03.392303 15440 raft_consensus.cc:515] T ced632bda66e4a74b9c854befbcbac9b P 0efc951052454eec9a58b0cd025945b8 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } } peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } } peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } }
W20260709 13:23:03.362856 14924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:38125, user_credentials={real_user=slave}} blocked reactor thread for 56775.3us
I20260709 13:23:03.405843 15154 ts_tablet_manager.cc:1434] T d64d06459b344ff99c0df07c249c3a60 P a722e54d227f4c29a9ed6ce77858003a: Time spent starting tablet: real 0.089s	user 0.008s	sys 0.001s
I20260709 13:23:03.408480 15153 tablet_bootstrap.cc:492] T e1ae79ed138a4950a681f24aa1107ef3 P 0efc951052454eec9a58b0cd025945b8: No bootstrap required, opened a new log
I20260709 13:23:03.409126 15153 ts_tablet_manager.cc:1403] T e1ae79ed138a4950a681f24aa1107ef3 P 0efc951052454eec9a58b0cd025945b8: Time spent bootstrapping tablet: real 0.215s	user 0.017s	sys 0.030s
I20260709 13:23:03.435607 15464 raft_consensus.cc:493] T 58a622a48cd24833bc5fc27e03114176 P 0efc951052454eec9a58b0cd025945b8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:23:03.436393 15464 raft_consensus.cc:515] T 58a622a48cd24833bc5fc27e03114176 P 0efc951052454eec9a58b0cd025945b8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } } peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } } peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } }
I20260709 13:23:03.444413 15154 tablet_bootstrap.cc:492] T e4a490a7748841c3803607059f9d8825 P a722e54d227f4c29a9ed6ce77858003a: Bootstrap starting.
I20260709 13:23:03.424841 15418 raft_consensus.cc:493] T d64d06459b344ff99c0df07c249c3a60 P a722e54d227f4c29a9ed6ce77858003a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:23:03.456450 15418 raft_consensus.cc:515] T d64d06459b344ff99c0df07c249c3a60 P a722e54d227f4c29a9ed6ce77858003a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } } peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } } peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } }
I20260709 13:23:03.456905 14881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0b7e1c1e67845cb9bd2208bb2fb7c21" candidate_uuid: "a1a22e9119494570b6d2217713fd7e43" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f3a500981b494979b58d2b1041fec9c8" is_pre_election: true
I20260709 13:23:03.458900 15418 leader_election.cc:290] T d64d06459b344ff99c0df07c249c3a60 P a722e54d227f4c29a9ed6ce77858003a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f3a500981b494979b58d2b1041fec9c8 (127.5.126.65:34129), 0efc951052454eec9a58b0cd025945b8 (127.5.126.66:34613)
I20260709 13:23:03.460875 14959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "532cc9041f414e018098570192e0fae8" candidate_uuid: "a722e54d227f4c29a9ed6ce77858003a" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0efc951052454eec9a58b0cd025945b8" is_pre_election: true
I20260709 13:23:03.468973 14957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0b7e1c1e67845cb9bd2208bb2fb7c21" candidate_uuid: "a1a22e9119494570b6d2217713fd7e43" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0efc951052454eec9a58b0cd025945b8" is_pre_election: true
W20260709 13:23:03.470781 14999 leader_election.cc:343] T b0b7e1c1e67845cb9bd2208bb2fb7c21 P a1a22e9119494570b6d2217713fd7e43 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f3a500981b494979b58d2b1041fec9c8 (127.5.126.65:34129): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:23:03.471985 15464 leader_election.cc:290] T 58a622a48cd24833bc5fc27e03114176 P 0efc951052454eec9a58b0cd025945b8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a722e54d227f4c29a9ed6ce77858003a (127.5.126.68:46669), f3a500981b494979b58d2b1041fec9c8 (127.5.126.65:34129)
I20260709 13:23:03.473304 15108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58a622a48cd24833bc5fc27e03114176" candidate_uuid: "0efc951052454eec9a58b0cd025945b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a722e54d227f4c29a9ed6ce77858003a" is_pre_election: true
I20260709 13:23:03.474881 15155 tablet_bootstrap.cc:492] T e1ae79ed138a4950a681f24aa1107ef3 P a1a22e9119494570b6d2217713fd7e43: No bootstrap required, opened a new log
W20260709 13:23:03.475504 14925 leader_election.cc:343] T 58a622a48cd24833bc5fc27e03114176 P 0efc951052454eec9a58b0cd025945b8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a722e54d227f4c29a9ed6ce77858003a (127.5.126.68:46669): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:23:03.475538 15155 ts_tablet_manager.cc:1403] T e1ae79ed138a4950a681f24aa1107ef3 P a1a22e9119494570b6d2217713fd7e43: Time spent bootstrapping tablet: real 0.328s	user 0.024s	sys 0.029s
I20260709 13:23:03.477012 15440 leader_election.cc:290] T ced632bda66e4a74b9c854befbcbac9b P 0efc951052454eec9a58b0cd025945b8 [CANDIDATE]: Term 2 election: Requested vote from peers a1a22e9119494570b6d2217713fd7e43 (127.5.126.67:38125), a722e54d227f4c29a9ed6ce77858003a (127.5.126.68:46669)
W20260709 13:23:03.478080 14999 leader_election.cc:343] T b0b7e1c1e67845cb9bd2208bb2fb7c21 P a1a22e9119494570b6d2217713fd7e43 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0efc951052454eec9a58b0cd025945b8 (127.5.126.66:34613): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:23:03.478367 15108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ced632bda66e4a74b9c854befbcbac9b" candidate_uuid: "0efc951052454eec9a58b0cd025945b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a722e54d227f4c29a9ed6ce77858003a"
I20260709 13:23:03.478614 14999 leader_election.cc:304] T b0b7e1c1e67845cb9bd2208bb2fb7c21 P a1a22e9119494570b6d2217713fd7e43 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1a22e9119494570b6d2217713fd7e43; no voters: 0efc951052454eec9a58b0cd025945b8, f3a500981b494979b58d2b1041fec9c8
I20260709 13:23:03.478685 15033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ced632bda66e4a74b9c854befbcbac9b" candidate_uuid: "0efc951052454eec9a58b0cd025945b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a1a22e9119494570b6d2217713fd7e43"
I20260709 13:23:03.479269 15108 raft_consensus.cc:2393] T ced632bda66e4a74b9c854befbcbac9b P a722e54d227f4c29a9ed6ce77858003a [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 0efc951052454eec9a58b0cd025945b8 in current term 2: Already voted for candidate a722e54d227f4c29a9ed6ce77858003a in this term.
I20260709 13:23:03.482390 15156 tablet_bootstrap.cc:492] T 03f377f48e8849adade3945935d300a9 P f3a500981b494979b58d2b1041fec9c8: No bootstrap required, opened a new log
I20260709 13:23:03.483742 15224 raft_consensus.cc:2749] T b0b7e1c1e67845cb9bd2208bb2fb7c21 P a1a22e9119494570b6d2217713fd7e43 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:23:03.487479 14884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d64d06459b344ff99c0df07c249c3a60" candidate_uuid: "a722e54d227f4c29a9ed6ce77858003a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f3a500981b494979b58d2b1041fec9c8" is_pre_election: true
I20260709 13:23:03.488271 14884 raft_consensus.cc:2468] T d64d06459b344ff99c0df07c249c3a60 P f3a500981b494979b58d2b1041fec9c8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a722e54d227f4c29a9ed6ce77858003a in term 0.
I20260709 13:23:03.489946 15155 raft_consensus.cc:359] T e1ae79ed138a4950a681f24aa1107ef3 P a1a22e9119494570b6d2217713fd7e43 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } } peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } } peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } }
I20260709 13:23:03.491089 15155 raft_consensus.cc:385] T e1ae79ed138a4950a681f24aa1107ef3 P a1a22e9119494570b6d2217713fd7e43 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:23:03.491484 15155 raft_consensus.cc:740] T e1ae79ed138a4950a681f24aa1107ef3 P a1a22e9119494570b6d2217713fd7e43 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a1a22e9119494570b6d2217713fd7e43, State: Initialized, Role: FOLLOWER
I20260709 13:23:03.490882 14954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d64d06459b344ff99c0df07c249c3a60" candidate_uuid: "a722e54d227f4c29a9ed6ce77858003a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0efc951052454eec9a58b0cd025945b8" is_pre_election: true
I20260709 13:23:03.494531 15155 consensus_queue.cc:260] T e1ae79ed138a4950a681f24aa1107ef3 P a1a22e9119494570b6d2217713fd7e43 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } } peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } } peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } }
I20260709 13:23:03.449959 15153 raft_consensus.cc:359] T e1ae79ed138a4950a681f24aa1107ef3 P 0efc951052454eec9a58b0cd025945b8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } } peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } } peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } }
I20260709 13:23:03.497797 15153 raft_consensus.cc:385] T e1ae79ed138a4950a681f24aa1107ef3 P 0efc951052454eec9a58b0cd025945b8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:23:03.498840 15156 ts_tablet_manager.cc:1403] T 03f377f48e8849adade3945935d300a9 P f3a500981b494979b58d2b1041fec9c8: Time spent bootstrapping tablet: real 0.676s	user 0.025s	sys 0.010s
I20260709 13:23:03.499229 15155 ts_tablet_manager.cc:1434] T e1ae79ed138a4950a681f24aa1107ef3 P a1a22e9119494570b6d2217713fd7e43: Time spent starting tablet: real 0.022s	user 0.008s	sys 0.000s
I20260709 13:23:03.500813 15073 leader_election.cc:304] T 532cc9041f414e018098570192e0fae8 P a722e54d227f4c29a9ed6ce77858003a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a722e54d227f4c29a9ed6ce77858003a; no voters: 0efc951052454eec9a58b0cd025945b8, f3a500981b494979b58d2b1041fec9c8
I20260709 13:23:03.498230 15153 raft_consensus.cc:740] T e1ae79ed138a4950a681f24aa1107ef3 P 0efc951052454eec9a58b0cd025945b8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0efc951052454eec9a58b0cd025945b8, State: Initialized, Role: FOLLOWER
I20260709 13:23:03.504694 15461 consensus_queue.cc:1048] T decdd091b0f243d786ee350a437b30f1 P a722e54d227f4c29a9ed6ce77858003a [LEADER]: Connected to new peer: Peer: permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:23:03.508397 14881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58a622a48cd24833bc5fc27e03114176" candidate_uuid: "0efc951052454eec9a58b0cd025945b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f3a500981b494979b58d2b1041fec9c8" is_pre_election: true
I20260709 13:23:03.508714 15156 raft_consensus.cc:359] T 03f377f48e8849adade3945935d300a9 P f3a500981b494979b58d2b1041fec9c8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } } peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } } peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } }
I20260709 13:23:03.509363 15156 raft_consensus.cc:385] T 03f377f48e8849adade3945935d300a9 P f3a500981b494979b58d2b1041fec9c8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:23:03.509652 15156 raft_consensus.cc:740] T 03f377f48e8849adade3945935d300a9 P f3a500981b494979b58d2b1041fec9c8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f3a500981b494979b58d2b1041fec9c8, State: Initialized, Role: FOLLOWER
I20260709 13:23:03.510277 15156 consensus_queue.cc:260] T 03f377f48e8849adade3945935d300a9 P f3a500981b494979b58d2b1041fec9c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } } peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } } peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } }
W20260709 13:23:03.510612 14925 leader_election.cc:343] T 58a622a48cd24833bc5fc27e03114176 P 0efc951052454eec9a58b0cd025945b8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f3a500981b494979b58d2b1041fec9c8 (127.5.126.65:34129): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:23:03.511155 14925 leader_election.cc:304] T 58a622a48cd24833bc5fc27e03114176 P 0efc951052454eec9a58b0cd025945b8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0efc951052454eec9a58b0cd025945b8; no voters: a722e54d227f4c29a9ed6ce77858003a, f3a500981b494979b58d2b1041fec9c8
I20260709 13:23:03.511432 15155 tablet_bootstrap.cc:492] T abc01daa220a47fa8578b0d20a17c9ab P a1a22e9119494570b6d2217713fd7e43: Bootstrap starting.
W20260709 13:23:03.513561 15073 leader_election.cc:343] T d64d06459b344ff99c0df07c249c3a60 P a722e54d227f4c29a9ed6ce77858003a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0efc951052454eec9a58b0cd025945b8 (127.5.126.66:34613): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:23:03.513834 15153 consensus_queue.cc:260] T e1ae79ed138a4950a681f24aa1107ef3 P 0efc951052454eec9a58b0cd025945b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } } peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } } peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } }
I20260709 13:23:03.514822 15073 leader_election.cc:304] T d64d06459b344ff99c0df07c249c3a60 P a722e54d227f4c29a9ed6ce77858003a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a722e54d227f4c29a9ed6ce77858003a, f3a500981b494979b58d2b1041fec9c8; no voters: 0efc951052454eec9a58b0cd025945b8
I20260709 13:23:03.512938 15215 raft_consensus.cc:2749] T 58a622a48cd24833bc5fc27e03114176 P 0efc951052454eec9a58b0cd025945b8 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:23:03.520124 15474 raft_consensus.cc:2804] T d64d06459b344ff99c0df07c249c3a60 P a722e54d227f4c29a9ed6ce77858003a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:23:03.520344 15156 ts_tablet_manager.cc:1434] T 03f377f48e8849adade3945935d300a9 P f3a500981b494979b58d2b1041fec9c8: Time spent starting tablet: real 0.021s	user 0.007s	sys 0.000s
I20260709 13:23:03.520772 15474 raft_consensus.cc:493] T d64d06459b344ff99c0df07c249c3a60 P a722e54d227f4c29a9ed6ce77858003a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:23:03.517024 15418 raft_consensus.cc:2749] T 532cc9041f414e018098570192e0fae8 P a722e54d227f4c29a9ed6ce77858003a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:23:03.521919 15156 tablet_bootstrap.cc:492] T abc01daa220a47fa8578b0d20a17c9ab P f3a500981b494979b58d2b1041fec9c8: Bootstrap starting.
I20260709 13:23:03.521202 15474 raft_consensus.cc:3060] T d64d06459b344ff99c0df07c249c3a60 P a722e54d227f4c29a9ed6ce77858003a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:23:03.530032 15156 tablet_bootstrap.cc:654] T abc01daa220a47fa8578b0d20a17c9ab P f3a500981b494979b58d2b1041fec9c8: Neither blocks nor log segments found. Creating new log.
I20260709 13:23:03.532315 15434 raft_consensus.cc:493] T e1ae79ed138a4950a681f24aa1107ef3 P a1a22e9119494570b6d2217713fd7e43 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:23:03.532941 15434 raft_consensus.cc:515] T e1ae79ed138a4950a681f24aa1107ef3 P a1a22e9119494570b6d2217713fd7e43 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } } peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } } peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } }
I20260709 13:23:03.536975 15434 leader_election.cc:290] T e1ae79ed138a4950a681f24aa1107ef3 P a1a22e9119494570b6d2217713fd7e43 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f3a500981b494979b58d2b1041fec9c8 (127.5.126.65:34129), 0efc951052454eec9a58b0cd025945b8 (127.5.126.66:34613)
I20260709 13:23:03.538940 14881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1ae79ed138a4950a681f24aa1107ef3" candidate_uuid: "a1a22e9119494570b6d2217713fd7e43" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f3a500981b494979b58d2b1041fec9c8" is_pre_election: true
I20260709 13:23:03.539237 14954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1ae79ed138a4950a681f24aa1107ef3" candidate_uuid: "a1a22e9119494570b6d2217713fd7e43" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0efc951052454eec9a58b0cd025945b8" is_pre_election: true
I20260709 13:23:03.539727 14881 raft_consensus.cc:2468] T e1ae79ed138a4950a681f24aa1107ef3 P f3a500981b494979b58d2b1041fec9c8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1a22e9119494570b6d2217713fd7e43 in term 0.
I20260709 13:23:03.540160 14954 raft_consensus.cc:2468] T e1ae79ed138a4950a681f24aa1107ef3 P 0efc951052454eec9a58b0cd025945b8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1a22e9119494570b6d2217713fd7e43 in term 0.
I20260709 13:23:03.543661 14999 leader_election.cc:304] T e1ae79ed138a4950a681f24aa1107ef3 P a1a22e9119494570b6d2217713fd7e43 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0efc951052454eec9a58b0cd025945b8, a1a22e9119494570b6d2217713fd7e43; no voters: 
I20260709 13:23:03.549080 15153 ts_tablet_manager.cc:1434] T e1ae79ed138a4950a681f24aa1107ef3 P 0efc951052454eec9a58b0cd025945b8: Time spent starting tablet: real 0.140s	user 0.008s	sys 0.000s
I20260709 13:23:03.546515 15474 raft_consensus.cc:515] T d64d06459b344ff99c0df07c249c3a60 P a722e54d227f4c29a9ed6ce77858003a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } } peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } } peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } }
I20260709 13:23:03.564832 15434 raft_consensus.cc:2804] T e1ae79ed138a4950a681f24aa1107ef3 P a1a22e9119494570b6d2217713fd7e43 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:23:03.565407 15434 raft_consensus.cc:493] T e1ae79ed138a4950a681f24aa1107ef3 P a1a22e9119494570b6d2217713fd7e43 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:23:03.565979 15434 raft_consensus.cc:3060] T e1ae79ed138a4950a681f24aa1107ef3 P a1a22e9119494570b6d2217713fd7e43 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:23:03.567094 15474 leader_election.cc:290] T d64d06459b344ff99c0df07c249c3a60 P a722e54d227f4c29a9ed6ce77858003a [CANDIDATE]: Term 1 election: Requested vote from peers f3a500981b494979b58d2b1041fec9c8 (127.5.126.65:34129), 0efc951052454eec9a58b0cd025945b8 (127.5.126.66:34613)
I20260709 13:23:03.566254 15153 tablet_bootstrap.cc:492] T ad084674821d4137b02efe692068d382 P 0efc951052454eec9a58b0cd025945b8: Bootstrap starting.
I20260709 13:23:03.565088 14781 catalog_manager.cc:5697] T e4a490a7748841c3803607059f9d8825 P 0efc951052454eec9a58b0cd025945b8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0efc951052454eec9a58b0cd025945b8 (127.5.126.66). New cstate: current_term: 1 leader_uuid: "0efc951052454eec9a58b0cd025945b8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } health_report { overall_health: UNKNOWN } } }
I20260709 13:23:03.574934 15153 tablet_bootstrap.cc:654] T ad084674821d4137b02efe692068d382 P 0efc951052454eec9a58b0cd025945b8: Neither blocks nor log segments found. Creating new log.
I20260709 13:23:03.584321 15033 raft_consensus.cc:2468] T ced632bda66e4a74b9c854befbcbac9b P a1a22e9119494570b6d2217713fd7e43 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0efc951052454eec9a58b0cd025945b8 in term 2.
I20260709 13:23:03.586130 14924 leader_election.cc:304] T ced632bda66e4a74b9c854befbcbac9b P 0efc951052454eec9a58b0cd025945b8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0efc951052454eec9a58b0cd025945b8, a1a22e9119494570b6d2217713fd7e43; no voters: a722e54d227f4c29a9ed6ce77858003a
I20260709 13:23:03.587229 15215 raft_consensus.cc:2804] T ced632bda66e4a74b9c854befbcbac9b P 0efc951052454eec9a58b0cd025945b8 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:23:03.587726 15215 raft_consensus.cc:697] T ced632bda66e4a74b9c854befbcbac9b P 0efc951052454eec9a58b0cd025945b8 [term 2 LEADER]: Becoming Leader. State: Replica: 0efc951052454eec9a58b0cd025945b8, State: Running, Role: LEADER
I20260709 13:23:03.589279 15215 consensus_queue.cc:237] T ced632bda66e4a74b9c854befbcbac9b P 0efc951052454eec9a58b0cd025945b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } } peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } } peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } }
I20260709 13:23:03.590103 15154 tablet_bootstrap.cc:654] T e4a490a7748841c3803607059f9d8825 P a722e54d227f4c29a9ed6ce77858003a: Neither blocks nor log segments found. Creating new log.
I20260709 13:23:03.603283 14954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d64d06459b344ff99c0df07c249c3a60" candidate_uuid: "a722e54d227f4c29a9ed6ce77858003a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0efc951052454eec9a58b0cd025945b8"
I20260709 13:23:03.603845 14881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d64d06459b344ff99c0df07c249c3a60" candidate_uuid: "a722e54d227f4c29a9ed6ce77858003a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f3a500981b494979b58d2b1041fec9c8"
I20260709 13:23:03.604456 14881 raft_consensus.cc:3060] T d64d06459b344ff99c0df07c249c3a60 P f3a500981b494979b58d2b1041fec9c8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:23:03.605501 15452 raft_consensus.cc:493] T 03f377f48e8849adade3945935d300a9 P f3a500981b494979b58d2b1041fec9c8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:23:03.606150 15156 tablet_bootstrap.cc:492] T abc01daa220a47fa8578b0d20a17c9ab P f3a500981b494979b58d2b1041fec9c8: No bootstrap required, opened a new log
I20260709 13:23:03.606097 15452 raft_consensus.cc:515] T 03f377f48e8849adade3945935d300a9 P f3a500981b494979b58d2b1041fec9c8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } } peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } } peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } }
I20260709 13:23:03.606806 15156 ts_tablet_manager.cc:1403] T abc01daa220a47fa8578b0d20a17c9ab P f3a500981b494979b58d2b1041fec9c8: Time spent bootstrapping tablet: real 0.085s	user 0.030s	sys 0.018s
I20260709 13:23:03.609196 15452 leader_election.cc:290] T 03f377f48e8849adade3945935d300a9 P f3a500981b494979b58d2b1041fec9c8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a1a22e9119494570b6d2217713fd7e43 (127.5.126.67:38125), a722e54d227f4c29a9ed6ce77858003a (127.5.126.68:46669)
W20260709 13:23:03.593139 14850 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.68:46669, user_credentials={real_user=slave}} blocked reactor thread for 67857.3us
I20260709 13:23:03.612146 15033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03f377f48e8849adade3945935d300a9" candidate_uuid: "f3a500981b494979b58d2b1041fec9c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1a22e9119494570b6d2217713fd7e43" is_pre_election: true
W20260709 13:23:03.612730 15073 leader_election.cc:343] T d64d06459b344ff99c0df07c249c3a60 P a722e54d227f4c29a9ed6ce77858003a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 0efc951052454eec9a58b0cd025945b8 (127.5.126.66:34613): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:23:03.614307 14849 leader_election.cc:343] T 03f377f48e8849adade3945935d300a9 P f3a500981b494979b58d2b1041fec9c8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a1a22e9119494570b6d2217713fd7e43 (127.5.126.67:38125): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:23:03.622607 15155 tablet_bootstrap.cc:654] T abc01daa220a47fa8578b0d20a17c9ab P a1a22e9119494570b6d2217713fd7e43: Neither blocks nor log segments found. Creating new log.
I20260709 13:23:03.622848 15107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03f377f48e8849adade3945935d300a9" candidate_uuid: "f3a500981b494979b58d2b1041fec9c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a722e54d227f4c29a9ed6ce77858003a" is_pre_election: true
I20260709 13:23:03.617944 15434 raft_consensus.cc:515] T e1ae79ed138a4950a681f24aa1107ef3 P a1a22e9119494570b6d2217713fd7e43 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } } peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } } peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } }
I20260709 13:23:03.630980 15156 raft_consensus.cc:359] T abc01daa220a47fa8578b0d20a17c9ab P f3a500981b494979b58d2b1041fec9c8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } } peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } } peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } }
I20260709 13:23:03.631875 15156 raft_consensus.cc:385] T abc01daa220a47fa8578b0d20a17c9ab P f3a500981b494979b58d2b1041fec9c8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:23:03.632179 15156 raft_consensus.cc:740] T abc01daa220a47fa8578b0d20a17c9ab P f3a500981b494979b58d2b1041fec9c8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f3a500981b494979b58d2b1041fec9c8, State: Initialized, Role: FOLLOWER
I20260709 13:23:03.632903 15156 consensus_queue.cc:260] T abc01daa220a47fa8578b0d20a17c9ab P f3a500981b494979b58d2b1041fec9c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } } peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } } peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } }
I20260709 13:23:03.632649 14780 catalog_manager.cc:5697] T ced632bda66e4a74b9c854befbcbac9b P 0efc951052454eec9a58b0cd025945b8 reported cstate change: term changed from 1 to 2, leader changed from a1a22e9119494570b6d2217713fd7e43 (127.5.126.67) to 0efc951052454eec9a58b0cd025945b8 (127.5.126.66). New cstate: current_term: 2 leader_uuid: "0efc951052454eec9a58b0cd025945b8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } health_report { overall_health: UNKNOWN } } }
I20260709 13:23:03.635186 15156 ts_tablet_manager.cc:1434] T abc01daa220a47fa8578b0d20a17c9ab P f3a500981b494979b58d2b1041fec9c8: Time spent starting tablet: real 0.028s	user 0.006s	sys 0.001s
I20260709 13:23:03.634959 14885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1ae79ed138a4950a681f24aa1107ef3" candidate_uuid: "a1a22e9119494570b6d2217713fd7e43" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f3a500981b494979b58d2b1041fec9c8"
I20260709 13:23:03.635798 14885 raft_consensus.cc:3060] T e1ae79ed138a4950a681f24aa1107ef3 P f3a500981b494979b58d2b1041fec9c8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:23:03.637253 15156 tablet_bootstrap.cc:492] T 77e8d8b35cf148e99e8274bf65e5ed05 P f3a500981b494979b58d2b1041fec9c8: Bootstrap starting.
I20260709 13:23:03.640413 15434 leader_election.cc:290] T e1ae79ed138a4950a681f24aa1107ef3 P a1a22e9119494570b6d2217713fd7e43 [CANDIDATE]: Term 1 election: Requested vote from peers f3a500981b494979b58d2b1041fec9c8 (127.5.126.65:34129), 0efc951052454eec9a58b0cd025945b8 (127.5.126.66:34613)
I20260709 13:23:03.654222 14954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1ae79ed138a4950a681f24aa1107ef3" candidate_uuid: "a1a22e9119494570b6d2217713fd7e43" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0efc951052454eec9a58b0cd025945b8"
I20260709 13:23:03.654664 15156 tablet_bootstrap.cc:654] T 77e8d8b35cf148e99e8274bf65e5ed05 P f3a500981b494979b58d2b1041fec9c8: Neither blocks nor log segments found. Creating new log.
I20260709 13:23:03.655014 14954 raft_consensus.cc:3060] T e1ae79ed138a4950a681f24aa1107ef3 P 0efc951052454eec9a58b0cd025945b8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:23:03.660866 15153 tablet_bootstrap.cc:492] T ad084674821d4137b02efe692068d382 P 0efc951052454eec9a58b0cd025945b8: No bootstrap required, opened a new log
I20260709 13:23:03.661573 15153 ts_tablet_manager.cc:1403] T ad084674821d4137b02efe692068d382 P 0efc951052454eec9a58b0cd025945b8: Time spent bootstrapping tablet: real 0.096s	user 0.009s	sys 0.021s
I20260709 13:23:03.648821 15418 raft_consensus.cc:493] T ced632bda66e4a74b9c854befbcbac9b P a722e54d227f4c29a9ed6ce77858003a [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:23:03.668834 15418 raft_consensus.cc:515] T ced632bda66e4a74b9c854befbcbac9b P a722e54d227f4c29a9ed6ce77858003a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } } peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } } peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } }
W20260709 13:23:03.649433 14850 leader_election.cc:343] T 03f377f48e8849adade3945935d300a9 P f3a500981b494979b58d2b1041fec9c8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a722e54d227f4c29a9ed6ce77858003a (127.5.126.68:46669): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:23:03.676414 14850 leader_election.cc:304] T 03f377f48e8849adade3945935d300a9 P f3a500981b494979b58d2b1041fec9c8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f3a500981b494979b58d2b1041fec9c8; no voters: a1a22e9119494570b6d2217713fd7e43, a722e54d227f4c29a9ed6ce77858003a
I20260709 13:23:03.678745 15033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ced632bda66e4a74b9c854befbcbac9b" candidate_uuid: "a722e54d227f4c29a9ed6ce77858003a" candidate_term: 3 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1a22e9119494570b6d2217713fd7e43" is_pre_election: true
I20260709 13:23:03.679747 15033 raft_consensus.cc:2410] T ced632bda66e4a74b9c854befbcbac9b P a1a22e9119494570b6d2217713fd7e43 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a722e54d227f4c29a9ed6ce77858003a for term 3 because replica has last-logged OpId of term: 1 index: 1, which is greater than that of the candidate, which has last-logged OpId of term: 0 index: 0.
I20260709 13:23:03.681231 15452 raft_consensus.cc:2749] T 03f377f48e8849adade3945935d300a9 P f3a500981b494979b58d2b1041fec9c8 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:23:03.686257 14959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ced632bda66e4a74b9c854befbcbac9b" candidate_uuid: "a722e54d227f4c29a9ed6ce77858003a" candidate_term: 3 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0efc951052454eec9a58b0cd025945b8" is_pre_election: true
I20260709 13:23:03.682130 15418 leader_election.cc:290] T ced632bda66e4a74b9c854befbcbac9b P a722e54d227f4c29a9ed6ce77858003a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0efc951052454eec9a58b0cd025945b8 (127.5.126.66:34613), a1a22e9119494570b6d2217713fd7e43 (127.5.126.67:38125)
I20260709 13:23:03.690383 15153 raft_consensus.cc:359] T ad084674821d4137b02efe692068d382 P 0efc951052454eec9a58b0cd025945b8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } } peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } } peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } }
I20260709 13:23:03.691473 15153 raft_consensus.cc:385] T ad084674821d4137b02efe692068d382 P 0efc951052454eec9a58b0cd025945b8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:23:03.691818 15153 raft_consensus.cc:740] T ad084674821d4137b02efe692068d382 P 0efc951052454eec9a58b0cd025945b8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0efc951052454eec9a58b0cd025945b8, State: Initialized, Role: FOLLOWER
I20260709 13:23:03.694850 15153 consensus_queue.cc:260] T ad084674821d4137b02efe692068d382 P 0efc951052454eec9a58b0cd025945b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } } peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } } peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } }
I20260709 13:23:03.703085 14885 raft_consensus.cc:2468] T e1ae79ed138a4950a681f24aa1107ef3 P f3a500981b494979b58d2b1041fec9c8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1a22e9119494570b6d2217713fd7e43 in term 1.
I20260709 13:23:03.704867 15073 leader_election.cc:304] T ced632bda66e4a74b9c854befbcbac9b P a722e54d227f4c29a9ed6ce77858003a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a722e54d227f4c29a9ed6ce77858003a; no voters: 0efc951052454eec9a58b0cd025945b8, a1a22e9119494570b6d2217713fd7e43
I20260709 13:23:03.711797 14999 leader_election.cc:304] T e1ae79ed138a4950a681f24aa1107ef3 P a1a22e9119494570b6d2217713fd7e43 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1a22e9119494570b6d2217713fd7e43, f3a500981b494979b58d2b1041fec9c8; no voters: 
I20260709 13:23:03.651328 14881 raft_consensus.cc:2468] T d64d06459b344ff99c0df07c249c3a60 P f3a500981b494979b58d2b1041fec9c8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a722e54d227f4c29a9ed6ce77858003a in term 1.
I20260709 13:23:03.718990 15434 raft_consensus.cc:2804] T e1ae79ed138a4950a681f24aa1107ef3 P a1a22e9119494570b6d2217713fd7e43 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:23:03.719561 15434 raft_consensus.cc:697] T e1ae79ed138a4950a681f24aa1107ef3 P a1a22e9119494570b6d2217713fd7e43 [term 1 LEADER]: Becoming Leader. State: Replica: a1a22e9119494570b6d2217713fd7e43, State: Running, Role: LEADER
I20260709 13:23:03.720482 15434 consensus_queue.cc:237] T e1ae79ed138a4950a681f24aa1107ef3 P a1a22e9119494570b6d2217713fd7e43 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } } peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } } peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } }
I20260709 13:23:03.711387 15418 raft_consensus.cc:2749] T ced632bda66e4a74b9c854befbcbac9b P a722e54d227f4c29a9ed6ce77858003a [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:23:03.731220 15153 ts_tablet_manager.cc:1434] T ad084674821d4137b02efe692068d382 P 0efc951052454eec9a58b0cd025945b8: Time spent starting tablet: real 0.069s	user 0.011s	sys 0.000s
I20260709 13:23:03.732860 15073 leader_election.cc:304] T d64d06459b344ff99c0df07c249c3a60 P a722e54d227f4c29a9ed6ce77858003a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a722e54d227f4c29a9ed6ce77858003a, f3a500981b494979b58d2b1041fec9c8; no voters: 0efc951052454eec9a58b0cd025945b8
I20260709 13:23:03.734970 15418 raft_consensus.cc:2804] T d64d06459b344ff99c0df07c249c3a60 P a722e54d227f4c29a9ed6ce77858003a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:23:03.735533 15418 raft_consensus.cc:697] T d64d06459b344ff99c0df07c249c3a60 P a722e54d227f4c29a9ed6ce77858003a [term 1 LEADER]: Becoming Leader. State: Replica: a722e54d227f4c29a9ed6ce77858003a, State: Running, Role: LEADER
I20260709 13:23:03.736227 15156 tablet_bootstrap.cc:492] T 77e8d8b35cf148e99e8274bf65e5ed05 P f3a500981b494979b58d2b1041fec9c8: No bootstrap required, opened a new log
I20260709 13:23:03.736742 15156 ts_tablet_manager.cc:1403] T 77e8d8b35cf148e99e8274bf65e5ed05 P f3a500981b494979b58d2b1041fec9c8: Time spent bootstrapping tablet: real 0.100s	user 0.018s	sys 0.037s
I20260709 13:23:03.739219 15418 consensus_queue.cc:237] T d64d06459b344ff99c0df07c249c3a60 P a722e54d227f4c29a9ed6ce77858003a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } } peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } } peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } }
I20260709 13:23:03.741669 15153 tablet_bootstrap.cc:492] T 88a7c4171c664e819837994755edf95c P 0efc951052454eec9a58b0cd025945b8: Bootstrap starting.
I20260709 13:23:03.750626 14954 raft_consensus.cc:2468] T e1ae79ed138a4950a681f24aa1107ef3 P 0efc951052454eec9a58b0cd025945b8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1a22e9119494570b6d2217713fd7e43 in term 1.
I20260709 13:23:03.775593 15154 tablet_bootstrap.cc:492] T e4a490a7748841c3803607059f9d8825 P a722e54d227f4c29a9ed6ce77858003a: No bootstrap required, opened a new log
I20260709 13:23:03.776068 15155 tablet_bootstrap.cc:492] T abc01daa220a47fa8578b0d20a17c9ab P a1a22e9119494570b6d2217713fd7e43: No bootstrap required, opened a new log
I20260709 13:23:03.776731 15155 ts_tablet_manager.cc:1403] T abc01daa220a47fa8578b0d20a17c9ab P a1a22e9119494570b6d2217713fd7e43: Time spent bootstrapping tablet: real 0.266s	user 0.041s	sys 0.022s
I20260709 13:23:03.778453 15156 raft_consensus.cc:359] T 77e8d8b35cf148e99e8274bf65e5ed05 P f3a500981b494979b58d2b1041fec9c8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } } peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } } peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } }
I20260709 13:23:03.779268 15156 raft_consensus.cc:385] T 77e8d8b35cf148e99e8274bf65e5ed05 P f3a500981b494979b58d2b1041fec9c8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:23:03.779542 15156 raft_consensus.cc:740] T 77e8d8b35cf148e99e8274bf65e5ed05 P f3a500981b494979b58d2b1041fec9c8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f3a500981b494979b58d2b1041fec9c8, State: Initialized, Role: FOLLOWER
I20260709 13:23:03.780527 15156 consensus_queue.cc:260] T 77e8d8b35cf148e99e8274bf65e5ed05 P f3a500981b494979b58d2b1041fec9c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } } peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } } peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } }
I20260709 13:23:03.784888 14780 catalog_manager.cc:5697] T e1ae79ed138a4950a681f24aa1107ef3 P a1a22e9119494570b6d2217713fd7e43 reported cstate change: term changed from 0 to 1, leader changed from <none> to a1a22e9119494570b6d2217713fd7e43 (127.5.126.67). New cstate: current_term: 1 leader_uuid: "a1a22e9119494570b6d2217713fd7e43" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } health_report { overall_health: HEALTHY } } }
I20260709 13:23:03.786913 15153 tablet_bootstrap.cc:654] T 88a7c4171c664e819837994755edf95c P 0efc951052454eec9a58b0cd025945b8: Neither blocks nor log segments found. Creating new log.
I20260709 13:23:03.788483 15156 ts_tablet_manager.cc:1434] T 77e8d8b35cf148e99e8274bf65e5ed05 P f3a500981b494979b58d2b1041fec9c8: Time spent starting tablet: real 0.051s	user 0.014s	sys 0.003s
I20260709 13:23:03.776312 15154 ts_tablet_manager.cc:1403] T e4a490a7748841c3803607059f9d8825 P a722e54d227f4c29a9ed6ce77858003a: Time spent bootstrapping tablet: real 0.347s	user 0.028s	sys 0.014s
I20260709 13:23:03.789676 15156 tablet_bootstrap.cc:492] T b0b7e1c1e67845cb9bd2208bb2fb7c21 P f3a500981b494979b58d2b1041fec9c8: Bootstrap starting.
I20260709 13:23:03.793275 15363 raft_consensus.cc:493] T 77e8d8b35cf148e99e8274bf65e5ed05 P f3a500981b494979b58d2b1041fec9c8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:23:03.793828 15363 raft_consensus.cc:515] T 77e8d8b35cf148e99e8274bf65e5ed05 P f3a500981b494979b58d2b1041fec9c8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } } peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } } peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } }
I20260709 13:23:03.795835 15363 leader_election.cc:290] T 77e8d8b35cf148e99e8274bf65e5ed05 P f3a500981b494979b58d2b1041fec9c8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a722e54d227f4c29a9ed6ce77858003a (127.5.126.68:46669), 0efc951052454eec9a58b0cd025945b8 (127.5.126.66:34613)
I20260709 13:23:03.801064 15155 raft_consensus.cc:359] T abc01daa220a47fa8578b0d20a17c9ab P a1a22e9119494570b6d2217713fd7e43 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } } peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } } peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } }
I20260709 13:23:03.801834 15155 raft_consensus.cc:385] T abc01daa220a47fa8578b0d20a17c9ab P a1a22e9119494570b6d2217713fd7e43 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:23:03.802096 15155 raft_consensus.cc:740] T abc01daa220a47fa8578b0d20a17c9ab P a1a22e9119494570b6d2217713fd7e43 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a1a22e9119494570b6d2217713fd7e43, State: Initialized, Role: FOLLOWER
I20260709 13:23:03.802382 14959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77e8d8b35cf148e99e8274bf65e5ed05" candidate_uuid: "f3a500981b494979b58d2b1041fec9c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0efc951052454eec9a58b0cd025945b8" is_pre_election: true
I20260709 13:23:03.803138 15155 consensus_queue.cc:260] T abc01daa220a47fa8578b0d20a17c9ab P a1a22e9119494570b6d2217713fd7e43 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } } peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } } peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } }
W20260709 13:23:03.803959 14850 leader_election.cc:343] T 77e8d8b35cf148e99e8274bf65e5ed05 P f3a500981b494979b58d2b1041fec9c8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0efc951052454eec9a58b0cd025945b8 (127.5.126.66:34613): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:23:03.804778 15155 ts_tablet_manager.cc:1434] T abc01daa220a47fa8578b0d20a17c9ab P a1a22e9119494570b6d2217713fd7e43: Time spent starting tablet: real 0.028s	user 0.006s	sys 0.000s
I20260709 13:23:03.805913 15155 tablet_bootstrap.cc:492] T 03f377f48e8849adade3945935d300a9 P a1a22e9119494570b6d2217713fd7e43: Bootstrap starting.
I20260709 13:23:03.808394 15107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77e8d8b35cf148e99e8274bf65e5ed05" candidate_uuid: "f3a500981b494979b58d2b1041fec9c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a722e54d227f4c29a9ed6ce77858003a" is_pre_election: true
I20260709 13:23:03.812342 15155 tablet_bootstrap.cc:654] T 03f377f48e8849adade3945935d300a9 P a1a22e9119494570b6d2217713fd7e43: Neither blocks nor log segments found. Creating new log.
W20260709 13:23:03.816864 14850 leader_election.cc:343] T 77e8d8b35cf148e99e8274bf65e5ed05 P f3a500981b494979b58d2b1041fec9c8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a722e54d227f4c29a9ed6ce77858003a (127.5.126.68:46669): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:23:03.817399 14850 leader_election.cc:304] T 77e8d8b35cf148e99e8274bf65e5ed05 P f3a500981b494979b58d2b1041fec9c8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f3a500981b494979b58d2b1041fec9c8; no voters: 0efc951052454eec9a58b0cd025945b8, a722e54d227f4c29a9ed6ce77858003a
I20260709 13:23:03.819007 15154 raft_consensus.cc:359] T e4a490a7748841c3803607059f9d8825 P a722e54d227f4c29a9ed6ce77858003a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } } peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } } peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } }
I20260709 13:23:03.819866 15154 raft_consensus.cc:385] T e4a490a7748841c3803607059f9d8825 P a722e54d227f4c29a9ed6ce77858003a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:23:03.820567 15385 raft_consensus.cc:2749] T 77e8d8b35cf148e99e8274bf65e5ed05 P f3a500981b494979b58d2b1041fec9c8 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:23:03.820170 15154 raft_consensus.cc:740] T e4a490a7748841c3803607059f9d8825 P a722e54d227f4c29a9ed6ce77858003a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a722e54d227f4c29a9ed6ce77858003a, State: Initialized, Role: FOLLOWER
I20260709 13:23:03.821708 15154 consensus_queue.cc:260] T e4a490a7748841c3803607059f9d8825 P a722e54d227f4c29a9ed6ce77858003a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } } peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } } peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } }
I20260709 13:23:03.823897 15154 ts_tablet_manager.cc:1434] T e4a490a7748841c3803607059f9d8825 P a722e54d227f4c29a9ed6ce77858003a: Time spent starting tablet: real 0.033s	user 0.005s	sys 0.000s
I20260709 13:23:03.823606 14783 catalog_manager.cc:5697] T d64d06459b344ff99c0df07c249c3a60 P a722e54d227f4c29a9ed6ce77858003a reported cstate change: term changed from 0 to 1, leader changed from <none> to a722e54d227f4c29a9ed6ce77858003a (127.5.126.68). New cstate: current_term: 1 leader_uuid: "a722e54d227f4c29a9ed6ce77858003a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } health_report { overall_health: UNKNOWN } } }
I20260709 13:23:03.824976 15154 tablet_bootstrap.cc:492] T abc01daa220a47fa8578b0d20a17c9ab P a722e54d227f4c29a9ed6ce77858003a: Bootstrap starting.
I20260709 13:23:03.831646 15156 tablet_bootstrap.cc:654] T b0b7e1c1e67845cb9bd2208bb2fb7c21 P f3a500981b494979b58d2b1041fec9c8: Neither blocks nor log segments found. Creating new log.
I20260709 13:23:03.834762 15154 tablet_bootstrap.cc:654] T abc01daa220a47fa8578b0d20a17c9ab P a722e54d227f4c29a9ed6ce77858003a: Neither blocks nor log segments found. Creating new log.
I20260709 13:23:03.835304 15434 raft_consensus.cc:493] T abc01daa220a47fa8578b0d20a17c9ab P a1a22e9119494570b6d2217713fd7e43 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:23:03.835908 15434 raft_consensus.cc:515] T abc01daa220a47fa8578b0d20a17c9ab P a1a22e9119494570b6d2217713fd7e43 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } } peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } } peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } }
I20260709 13:23:03.838397 15434 leader_election.cc:290] T abc01daa220a47fa8578b0d20a17c9ab P a1a22e9119494570b6d2217713fd7e43 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a722e54d227f4c29a9ed6ce77858003a (127.5.126.68:46669), f3a500981b494979b58d2b1041fec9c8 (127.5.126.65:34129)
I20260709 13:23:03.840310 15107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abc01daa220a47fa8578b0d20a17c9ab" candidate_uuid: "a1a22e9119494570b6d2217713fd7e43" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a722e54d227f4c29a9ed6ce77858003a" is_pre_election: true
I20260709 13:23:03.840600 14881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abc01daa220a47fa8578b0d20a17c9ab" candidate_uuid: "a1a22e9119494570b6d2217713fd7e43" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f3a500981b494979b58d2b1041fec9c8" is_pre_election: true
I20260709 13:23:03.841526 14881 raft_consensus.cc:2468] T abc01daa220a47fa8578b0d20a17c9ab P f3a500981b494979b58d2b1041fec9c8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1a22e9119494570b6d2217713fd7e43 in term 0.
W20260709 13:23:03.842280 14999 leader_election.cc:343] T abc01daa220a47fa8578b0d20a17c9ab P a1a22e9119494570b6d2217713fd7e43 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a722e54d227f4c29a9ed6ce77858003a (127.5.126.68:46669): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:23:03.843044 14999 leader_election.cc:304] T abc01daa220a47fa8578b0d20a17c9ab P a1a22e9119494570b6d2217713fd7e43 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a1a22e9119494570b6d2217713fd7e43, f3a500981b494979b58d2b1041fec9c8; no voters: a722e54d227f4c29a9ed6ce77858003a
I20260709 13:23:03.846778 15427 raft_consensus.cc:2804] T abc01daa220a47fa8578b0d20a17c9ab P a1a22e9119494570b6d2217713fd7e43 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:23:03.847193 15427 raft_consensus.cc:493] T abc01daa220a47fa8578b0d20a17c9ab P a1a22e9119494570b6d2217713fd7e43 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:23:03.847525 15427 raft_consensus.cc:3060] T abc01daa220a47fa8578b0d20a17c9ab P a1a22e9119494570b6d2217713fd7e43 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:23:03.850545 15153 tablet_bootstrap.cc:492] T 88a7c4171c664e819837994755edf95c P 0efc951052454eec9a58b0cd025945b8: No bootstrap required, opened a new log
I20260709 13:23:03.851172 15153 ts_tablet_manager.cc:1403] T 88a7c4171c664e819837994755edf95c P 0efc951052454eec9a58b0cd025945b8: Time spent bootstrapping tablet: real 0.110s	user 0.013s	sys 0.005s
I20260709 13:23:03.854034 15156 tablet_bootstrap.cc:492] T b0b7e1c1e67845cb9bd2208bb2fb7c21 P f3a500981b494979b58d2b1041fec9c8: No bootstrap required, opened a new log
I20260709 13:23:03.854630 15156 ts_tablet_manager.cc:1403] T b0b7e1c1e67845cb9bd2208bb2fb7c21 P f3a500981b494979b58d2b1041fec9c8: Time spent bootstrapping tablet: real 0.065s	user 0.009s	sys 0.011s
I20260709 13:23:03.856739 15154 tablet_bootstrap.cc:492] T abc01daa220a47fa8578b0d20a17c9ab P a722e54d227f4c29a9ed6ce77858003a: No bootstrap required, opened a new log
I20260709 13:23:03.857306 15154 ts_tablet_manager.cc:1403] T abc01daa220a47fa8578b0d20a17c9ab P a722e54d227f4c29a9ed6ce77858003a: Time spent bootstrapping tablet: real 0.033s	user 0.008s	sys 0.003s
I20260709 13:23:03.858439 15427 raft_consensus.cc:515] T abc01daa220a47fa8578b0d20a17c9ab P a1a22e9119494570b6d2217713fd7e43 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } } peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } } peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } }
I20260709 13:23:03.858273 15153 raft_consensus.cc:359] T 88a7c4171c664e819837994755edf95c P 0efc951052454eec9a58b0cd025945b8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } } peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } } peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } }
I20260709 13:23:03.860702 15427 leader_election.cc:290] T abc01daa220a47fa8578b0d20a17c9ab P a1a22e9119494570b6d2217713fd7e43 [CANDIDATE]: Term 1 election: Requested vote from peers a722e54d227f4c29a9ed6ce77858003a (127.5.126.68:46669), f3a500981b494979b58d2b1041fec9c8 (127.5.126.65:34129)
I20260709 13:23:03.862479 15107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abc01daa220a47fa8578b0d20a17c9ab" candidate_uuid: "a1a22e9119494570b6d2217713fd7e43" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a722e54d227f4c29a9ed6ce77858003a"
I20260709 13:23:03.862838 14881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abc01daa220a47fa8578b0d20a17c9ab" candidate_uuid: "a1a22e9119494570b6d2217713fd7e43" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f3a500981b494979b58d2b1041fec9c8"
I20260709 13:23:03.863317 15155 tablet_bootstrap.cc:492] T 03f377f48e8849adade3945935d300a9 P a1a22e9119494570b6d2217713fd7e43: No bootstrap required, opened a new log
I20260709 13:23:03.863526 14881 raft_consensus.cc:3060] T abc01daa220a47fa8578b0d20a17c9ab P f3a500981b494979b58d2b1041fec9c8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:23:03.863847 15155 ts_tablet_manager.cc:1403] T 03f377f48e8849adade3945935d300a9 P a1a22e9119494570b6d2217713fd7e43: Time spent bootstrapping tablet: real 0.058s	user 0.013s	sys 0.020s
I20260709 13:23:03.864503 15105 raft_consensus.cc:3060] T e4a490a7748841c3803607059f9d8825 P a722e54d227f4c29a9ed6ce77858003a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:23:03.866792 15155 raft_consensus.cc:359] T 03f377f48e8849adade3945935d300a9 P a1a22e9119494570b6d2217713fd7e43 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } } peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } } peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } }
I20260709 13:23:03.867538 15155 raft_consensus.cc:385] T 03f377f48e8849adade3945935d300a9 P a1a22e9119494570b6d2217713fd7e43 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:23:03.867796 15155 raft_consensus.cc:740] T 03f377f48e8849adade3945935d300a9 P a1a22e9119494570b6d2217713fd7e43 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a1a22e9119494570b6d2217713fd7e43, State: Initialized, Role: FOLLOWER
I20260709 13:23:03.868414 15155 consensus_queue.cc:260] T 03f377f48e8849adade3945935d300a9 P a1a22e9119494570b6d2217713fd7e43 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } } peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } } peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } }
I20260709 13:23:03.870760 15155 ts_tablet_manager.cc:1434] T 03f377f48e8849adade3945935d300a9 P a1a22e9119494570b6d2217713fd7e43: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:23:03.871997 15155 tablet_bootstrap.cc:492] T f86a730e237248dc9b91cbb75e29c324 P a1a22e9119494570b6d2217713fd7e43: Bootstrap starting.
I20260709 13:23:03.877633 15155 tablet_bootstrap.cc:654] T f86a730e237248dc9b91cbb75e29c324 P a1a22e9119494570b6d2217713fd7e43: Neither blocks nor log segments found. Creating new log.
I20260709 13:23:03.877983 14881 raft_consensus.cc:2468] T abc01daa220a47fa8578b0d20a17c9ab P f3a500981b494979b58d2b1041fec9c8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1a22e9119494570b6d2217713fd7e43 in term 1.
I20260709 13:23:03.879211 15215 consensus_queue.cc:1048] T e4a490a7748841c3803607059f9d8825 P 0efc951052454eec9a58b0cd025945b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:23:03.883505 15156 raft_consensus.cc:359] T b0b7e1c1e67845cb9bd2208bb2fb7c21 P f3a500981b494979b58d2b1041fec9c8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } } peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } } peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } }
I20260709 13:23:03.884403 14999 leader_election.cc:304] T abc01daa220a47fa8578b0d20a17c9ab P a1a22e9119494570b6d2217713fd7e43 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1a22e9119494570b6d2217713fd7e43, f3a500981b494979b58d2b1041fec9c8; no voters: 
I20260709 13:23:03.884783 15156 raft_consensus.cc:385] T b0b7e1c1e67845cb9bd2208bb2fb7c21 P f3a500981b494979b58d2b1041fec9c8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:23:03.885421 15156 raft_consensus.cc:740] T b0b7e1c1e67845cb9bd2208bb2fb7c21 P f3a500981b494979b58d2b1041fec9c8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f3a500981b494979b58d2b1041fec9c8, State: Initialized, Role: FOLLOWER
I20260709 13:23:03.885708 15427 raft_consensus.cc:2804] T abc01daa220a47fa8578b0d20a17c9ab P a1a22e9119494570b6d2217713fd7e43 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:23:03.859403 15153 raft_consensus.cc:385] T 88a7c4171c664e819837994755edf95c P 0efc951052454eec9a58b0cd025945b8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:23:03.886307 15427 raft_consensus.cc:697] T abc01daa220a47fa8578b0d20a17c9ab P a1a22e9119494570b6d2217713fd7e43 [term 1 LEADER]: Becoming Leader. State: Replica: a1a22e9119494570b6d2217713fd7e43, State: Running, Role: LEADER
I20260709 13:23:03.886518 15153 raft_consensus.cc:740] T 88a7c4171c664e819837994755edf95c P 0efc951052454eec9a58b0cd025945b8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0efc951052454eec9a58b0cd025945b8, State: Initialized, Role: FOLLOWER
I20260709 13:23:03.887297 15427 consensus_queue.cc:237] T abc01daa220a47fa8578b0d20a17c9ab P a1a22e9119494570b6d2217713fd7e43 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } } peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } } peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } }
I20260709 13:23:03.887763 15153 consensus_queue.cc:260] T 88a7c4171c664e819837994755edf95c P 0efc951052454eec9a58b0cd025945b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } } peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } } peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } }
I20260709 13:23:03.890146 15153 ts_tablet_manager.cc:1434] T 88a7c4171c664e819837994755edf95c P 0efc951052454eec9a58b0cd025945b8: Time spent starting tablet: real 0.039s	user 0.009s	sys 0.001s
I20260709 13:23:03.892222 15153 tablet_bootstrap.cc:492] T 53592d0c0a46440dbfcd26f8b8111859 P 0efc951052454eec9a58b0cd025945b8: Bootstrap starting.
I20260709 13:23:03.860493 15154 raft_consensus.cc:359] T abc01daa220a47fa8578b0d20a17c9ab P a722e54d227f4c29a9ed6ce77858003a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } } peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } } peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } }
I20260709 13:23:03.896600 15154 raft_consensus.cc:385] T abc01daa220a47fa8578b0d20a17c9ab P a722e54d227f4c29a9ed6ce77858003a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:23:03.886472 15156 consensus_queue.cc:260] T b0b7e1c1e67845cb9bd2208bb2fb7c21 P f3a500981b494979b58d2b1041fec9c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } } peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } } peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } }
I20260709 13:23:03.896934 15154 raft_consensus.cc:740] T abc01daa220a47fa8578b0d20a17c9ab P a722e54d227f4c29a9ed6ce77858003a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a722e54d227f4c29a9ed6ce77858003a, State: Initialized, Role: FOLLOWER
I20260709 13:23:03.899848 15154 consensus_queue.cc:260] T abc01daa220a47fa8578b0d20a17c9ab P a722e54d227f4c29a9ed6ce77858003a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } } peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } } peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } }
I20260709 13:23:03.901176 15107 raft_consensus.cc:3060] T abc01daa220a47fa8578b0d20a17c9ab P a722e54d227f4c29a9ed6ce77858003a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:23:03.912922 15107 raft_consensus.cc:2468] T abc01daa220a47fa8578b0d20a17c9ab P a722e54d227f4c29a9ed6ce77858003a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1a22e9119494570b6d2217713fd7e43 in term 1.
I20260709 13:23:03.919243 15154 ts_tablet_manager.cc:1434] T abc01daa220a47fa8578b0d20a17c9ab P a722e54d227f4c29a9ed6ce77858003a: Time spent starting tablet: real 0.062s	user 0.006s	sys 0.001s
I20260709 13:23:03.920872 15215 consensus_queue.cc:1048] T e4a490a7748841c3803607059f9d8825 P 0efc951052454eec9a58b0cd025945b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:23:03.921320 15154 tablet_bootstrap.cc:492] T 53592d0c0a46440dbfcd26f8b8111859 P a722e54d227f4c29a9ed6ce77858003a: Bootstrap starting.
I20260709 13:23:03.924074 15156 ts_tablet_manager.cc:1434] T b0b7e1c1e67845cb9bd2208bb2fb7c21 P f3a500981b494979b58d2b1041fec9c8: Time spent starting tablet: real 0.069s	user 0.006s	sys 0.002s
I20260709 13:23:03.927289 14783 catalog_manager.cc:5697] T abc01daa220a47fa8578b0d20a17c9ab P a1a22e9119494570b6d2217713fd7e43 reported cstate change: term changed from 0 to 1, leader changed from <none> to a1a22e9119494570b6d2217713fd7e43 (127.5.126.67). New cstate: current_term: 1 leader_uuid: "a1a22e9119494570b6d2217713fd7e43" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } health_report { overall_health: UNKNOWN } } }
I20260709 13:23:03.933059 15156 tablet_bootstrap.cc:492] T 58a622a48cd24833bc5fc27e03114176 P f3a500981b494979b58d2b1041fec9c8: Bootstrap starting.
I20260709 13:23:03.950712 15156 tablet_bootstrap.cc:654] T 58a622a48cd24833bc5fc27e03114176 P f3a500981b494979b58d2b1041fec9c8: Neither blocks nor log segments found. Creating new log.
I20260709 13:23:03.968442 15154 tablet_bootstrap.cc:654] T 53592d0c0a46440dbfcd26f8b8111859 P a722e54d227f4c29a9ed6ce77858003a: Neither blocks nor log segments found. Creating new log.
I20260709 13:23:03.976258 15156 tablet_bootstrap.cc:492] T 58a622a48cd24833bc5fc27e03114176 P f3a500981b494979b58d2b1041fec9c8: No bootstrap required, opened a new log
I20260709 13:23:03.977053 15156 ts_tablet_manager.cc:1403] T 58a622a48cd24833bc5fc27e03114176 P f3a500981b494979b58d2b1041fec9c8: Time spent bootstrapping tablet: real 0.044s	user 0.013s	sys 0.004s
I20260709 13:23:03.983292 15215 raft_consensus.cc:493] T 88a7c4171c664e819837994755edf95c P 0efc951052454eec9a58b0cd025945b8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:23:03.983922 15215 raft_consensus.cc:515] T 88a7c4171c664e819837994755edf95c P 0efc951052454eec9a58b0cd025945b8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } } peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } } peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } }
I20260709 13:23:03.985925 15156 raft_consensus.cc:359] T 58a622a48cd24833bc5fc27e03114176 P f3a500981b494979b58d2b1041fec9c8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } } peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } } peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } }
I20260709 13:23:03.986411 15215 leader_election.cc:290] T 88a7c4171c664e819837994755edf95c P 0efc951052454eec9a58b0cd025945b8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f3a500981b494979b58d2b1041fec9c8 (127.5.126.65:34129), a1a22e9119494570b6d2217713fd7e43 (127.5.126.67:38125)
I20260709 13:23:03.986979 15156 raft_consensus.cc:385] T 58a622a48cd24833bc5fc27e03114176 P f3a500981b494979b58d2b1041fec9c8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:23:03.987351 15156 raft_consensus.cc:740] T 58a622a48cd24833bc5fc27e03114176 P f3a500981b494979b58d2b1041fec9c8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f3a500981b494979b58d2b1041fec9c8, State: Initialized, Role: FOLLOWER
I20260709 13:23:03.988184 15156 consensus_queue.cc:260] T 58a622a48cd24833bc5fc27e03114176 P f3a500981b494979b58d2b1041fec9c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } } peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } } peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } }
I20260709 13:23:03.990173 15029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88a7c4171c664e819837994755edf95c" candidate_uuid: "0efc951052454eec9a58b0cd025945b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1a22e9119494570b6d2217713fd7e43" is_pre_election: true
I20260709 13:23:03.992604 15154 tablet_bootstrap.cc:492] T 53592d0c0a46440dbfcd26f8b8111859 P a722e54d227f4c29a9ed6ce77858003a: No bootstrap required, opened a new log
I20260709 13:23:03.993257 15154 ts_tablet_manager.cc:1403] T 53592d0c0a46440dbfcd26f8b8111859 P a722e54d227f4c29a9ed6ce77858003a: Time spent bootstrapping tablet: real 0.072s	user 0.005s	sys 0.015s
W20260709 13:23:04.004528 14924 leader_election.cc:343] T 88a7c4171c664e819837994755edf95c P 0efc951052454eec9a58b0cd025945b8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a1a22e9119494570b6d2217713fd7e43 (127.5.126.67:38125): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:23:04.005573 15154 raft_consensus.cc:359] T 53592d0c0a46440dbfcd26f8b8111859 P a722e54d227f4c29a9ed6ce77858003a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } } peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } } peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } }
I20260709 13:23:04.006386 15154 raft_consensus.cc:385] T 53592d0c0a46440dbfcd26f8b8111859 P a722e54d227f4c29a9ed6ce77858003a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:23:04.006677 15154 raft_consensus.cc:740] T 53592d0c0a46440dbfcd26f8b8111859 P a722e54d227f4c29a9ed6ce77858003a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a722e54d227f4c29a9ed6ce77858003a, State: Initialized, Role: FOLLOWER
I20260709 13:23:04.007658 14881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88a7c4171c664e819837994755edf95c" candidate_uuid: "0efc951052454eec9a58b0cd025945b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f3a500981b494979b58d2b1041fec9c8" is_pre_election: true
I20260709 13:23:04.008744 14881 raft_consensus.cc:2468] T 88a7c4171c664e819837994755edf95c P f3a500981b494979b58d2b1041fec9c8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0efc951052454eec9a58b0cd025945b8 in term 0.
I20260709 13:23:04.009868 15427 raft_consensus.cc:493] T 03f377f48e8849adade3945935d300a9 P a1a22e9119494570b6d2217713fd7e43 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:23:04.007314 15154 consensus_queue.cc:260] T 53592d0c0a46440dbfcd26f8b8111859 P a722e54d227f4c29a9ed6ce77858003a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } } peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } } peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } }
I20260709 13:23:04.010576 14925 leader_election.cc:304] T 88a7c4171c664e819837994755edf95c P 0efc951052454eec9a58b0cd025945b8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0efc951052454eec9a58b0cd025945b8, f3a500981b494979b58d2b1041fec9c8; no voters: a1a22e9119494570b6d2217713fd7e43
I20260709 13:23:04.010722 15427 raft_consensus.cc:515] T 03f377f48e8849adade3945935d300a9 P a1a22e9119494570b6d2217713fd7e43 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } } peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } } peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } }
I20260709 13:23:04.012475 15211 raft_consensus.cc:2804] T 88a7c4171c664e819837994755edf95c P 0efc951052454eec9a58b0cd025945b8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:23:04.012856 15154 ts_tablet_manager.cc:1434] T 53592d0c0a46440dbfcd26f8b8111859 P a722e54d227f4c29a9ed6ce77858003a: Time spent starting tablet: real 0.019s	user 0.004s	sys 0.001s
I20260709 13:23:04.013103 15211 raft_consensus.cc:493] T 88a7c4171c664e819837994755edf95c P 0efc951052454eec9a58b0cd025945b8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:23:04.013712 15211 raft_consensus.cc:3060] T 88a7c4171c664e819837994755edf95c P 0efc951052454eec9a58b0cd025945b8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:23:04.014011 15154 tablet_bootstrap.cc:492] T 03f377f48e8849adade3945935d300a9 P a722e54d227f4c29a9ed6ce77858003a: Bootstrap starting.
I20260709 13:23:04.018170 15215 raft_consensus.cc:493] T ad084674821d4137b02efe692068d382 P 0efc951052454eec9a58b0cd025945b8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:23:04.018709 15215 raft_consensus.cc:515] T ad084674821d4137b02efe692068d382 P 0efc951052454eec9a58b0cd025945b8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } } peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } } peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } }
I20260709 13:23:03.990667 15156 ts_tablet_manager.cc:1434] T 58a622a48cd24833bc5fc27e03114176 P f3a500981b494979b58d2b1041fec9c8: Time spent starting tablet: real 0.013s	user 0.007s	sys 0.000s
I20260709 13:23:04.020886 15154 tablet_bootstrap.cc:654] T 03f377f48e8849adade3945935d300a9 P a722e54d227f4c29a9ed6ce77858003a: Neither blocks nor log segments found. Creating new log.
I20260709 13:23:04.021646 15156 tablet_bootstrap.cc:492] T affcb03ab55349748a95c103059d2955 P f3a500981b494979b58d2b1041fec9c8: Bootstrap starting.
I20260709 13:23:04.022266 15215 leader_election.cc:290] T ad084674821d4137b02efe692068d382 P 0efc951052454eec9a58b0cd025945b8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a1a22e9119494570b6d2217713fd7e43 (127.5.126.67:38125), a722e54d227f4c29a9ed6ce77858003a (127.5.126.68:46669)
I20260709 13:23:04.027796 15107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad084674821d4137b02efe692068d382" candidate_uuid: "0efc951052454eec9a58b0cd025945b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a722e54d227f4c29a9ed6ce77858003a" is_pre_election: true
I20260709 13:23:04.031265 15029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad084674821d4137b02efe692068d382" candidate_uuid: "0efc951052454eec9a58b0cd025945b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1a22e9119494570b6d2217713fd7e43" is_pre_election: true
W20260709 13:23:04.032842 14924 leader_election.cc:343] T ad084674821d4137b02efe692068d382 P 0efc951052454eec9a58b0cd025945b8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a1a22e9119494570b6d2217713fd7e43 (127.5.126.67:38125): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:23:04.036401 14925 leader_election.cc:343] T ad084674821d4137b02efe692068d382 P 0efc951052454eec9a58b0cd025945b8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a722e54d227f4c29a9ed6ce77858003a (127.5.126.68:46669): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:23:04.036880 14925 leader_election.cc:304] T ad084674821d4137b02efe692068d382 P 0efc951052454eec9a58b0cd025945b8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0efc951052454eec9a58b0cd025945b8; no voters: a1a22e9119494570b6d2217713fd7e43, a722e54d227f4c29a9ed6ce77858003a
I20260709 13:23:04.038646 15427 leader_election.cc:290] T 03f377f48e8849adade3945935d300a9 P a1a22e9119494570b6d2217713fd7e43 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a722e54d227f4c29a9ed6ce77858003a (127.5.126.68:46669), f3a500981b494979b58d2b1041fec9c8 (127.5.126.65:34129)
I20260709 13:23:04.041386 15440 raft_consensus.cc:2749] T ad084674821d4137b02efe692068d382 P 0efc951052454eec9a58b0cd025945b8 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:23:04.042474 15153 tablet_bootstrap.cc:654] T 53592d0c0a46440dbfcd26f8b8111859 P 0efc951052454eec9a58b0cd025945b8: Neither blocks nor log segments found. Creating new log.
I20260709 13:23:04.076403 15154 tablet_bootstrap.cc:492] T 03f377f48e8849adade3945935d300a9 P a722e54d227f4c29a9ed6ce77858003a: No bootstrap required, opened a new log
I20260709 13:23:04.076978 15154 ts_tablet_manager.cc:1403] T 03f377f48e8849adade3945935d300a9 P a722e54d227f4c29a9ed6ce77858003a: Time spent bootstrapping tablet: real 0.063s	user 0.023s	sys 0.013s
I20260709 13:23:04.044802 15363 raft_consensus.cc:493] T b0b7e1c1e67845cb9bd2208bb2fb7c21 P f3a500981b494979b58d2b1041fec9c8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:23:04.053966 15155 tablet_bootstrap.cc:492] T f86a730e237248dc9b91cbb75e29c324 P a1a22e9119494570b6d2217713fd7e43: No bootstrap required, opened a new log
I20260709 13:23:04.078784 15155 ts_tablet_manager.cc:1403] T f86a730e237248dc9b91cbb75e29c324 P a1a22e9119494570b6d2217713fd7e43: Time spent bootstrapping tablet: real 0.207s	user 0.073s	sys 0.079s
I20260709 13:23:04.078475 15363 raft_consensus.cc:515] T b0b7e1c1e67845cb9bd2208bb2fb7c21 P f3a500981b494979b58d2b1041fec9c8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } } peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } } peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } }
I20260709 13:23:04.079661 15154 raft_consensus.cc:359] T 03f377f48e8849adade3945935d300a9 P a722e54d227f4c29a9ed6ce77858003a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } } peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } } peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } }
I20260709 13:23:04.080423 15154 raft_consensus.cc:385] T 03f377f48e8849adade3945935d300a9 P a722e54d227f4c29a9ed6ce77858003a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:23:04.080687 15154 raft_consensus.cc:740] T 03f377f48e8849adade3945935d300a9 P a722e54d227f4c29a9ed6ce77858003a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a722e54d227f4c29a9ed6ce77858003a, State: Initialized, Role: FOLLOWER
I20260709 13:23:04.080971 15363 leader_election.cc:290] T b0b7e1c1e67845cb9bd2208bb2fb7c21 P f3a500981b494979b58d2b1041fec9c8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0efc951052454eec9a58b0cd025945b8 (127.5.126.66:34613), a1a22e9119494570b6d2217713fd7e43 (127.5.126.67:38125)
I20260709 13:23:04.056839 15156 tablet_bootstrap.cc:654] T affcb03ab55349748a95c103059d2955 P f3a500981b494979b58d2b1041fec9c8: Neither blocks nor log segments found. Creating new log.
I20260709 13:23:04.081393 15154 consensus_queue.cc:260] T 03f377f48e8849adade3945935d300a9 P a722e54d227f4c29a9ed6ce77858003a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } } peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } } peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } }
I20260709 13:23:04.057910 15211 raft_consensus.cc:515] T 88a7c4171c664e819837994755edf95c P 0efc951052454eec9a58b0cd025945b8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } } peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } } peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } }
I20260709 13:23:04.083410 14959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0b7e1c1e67845cb9bd2208bb2fb7c21" candidate_uuid: "f3a500981b494979b58d2b1041fec9c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0efc951052454eec9a58b0cd025945b8" is_pre_election: true
I20260709 13:23:04.083675 15154 ts_tablet_manager.cc:1434] T 03f377f48e8849adade3945935d300a9 P a722e54d227f4c29a9ed6ce77858003a: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:23:04.085197 15154 tablet_bootstrap.cc:492] T ad084674821d4137b02efe692068d382 P a722e54d227f4c29a9ed6ce77858003a: Bootstrap starting.
W20260709 13:23:04.085453 14850 leader_election.cc:343] T b0b7e1c1e67845cb9bd2208bb2fb7c21 P f3a500981b494979b58d2b1041fec9c8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0efc951052454eec9a58b0cd025945b8 (127.5.126.66:34613): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:23:04.086668 14885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03f377f48e8849adade3945935d300a9" candidate_uuid: "a1a22e9119494570b6d2217713fd7e43" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f3a500981b494979b58d2b1041fec9c8" is_pre_election: true
I20260709 13:23:04.087316 14885 raft_consensus.cc:2468] T 03f377f48e8849adade3945935d300a9 P f3a500981b494979b58d2b1041fec9c8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1a22e9119494570b6d2217713fd7e43 in term 0.
I20260709 13:23:04.088878 15108 raft_consensus.cc:1275] T ced632bda66e4a74b9c854befbcbac9b P a722e54d227f4c29a9ed6ce77858003a [term 2 FOLLOWER]: Refusing update from remote peer 0efc951052454eec9a58b0cd025945b8: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:23:04.089047 15033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0b7e1c1e67845cb9bd2208bb2fb7c21" candidate_uuid: "f3a500981b494979b58d2b1041fec9c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1a22e9119494570b6d2217713fd7e43" is_pre_election: true
I20260709 13:23:04.089675 15033 raft_consensus.cc:2468] T b0b7e1c1e67845cb9bd2208bb2fb7c21 P a1a22e9119494570b6d2217713fd7e43 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f3a500981b494979b58d2b1041fec9c8 in term 0.
I20260709 13:23:04.090922 15440 consensus_queue.cc:1048] T ced632bda66e4a74b9c854befbcbac9b P 0efc951052454eec9a58b0cd025945b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:23:04.092504 14999 leader_election.cc:304] T 03f377f48e8849adade3945935d300a9 P a1a22e9119494570b6d2217713fd7e43 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1a22e9119494570b6d2217713fd7e43, f3a500981b494979b58d2b1041fec9c8; no voters: 
I20260709 13:23:04.092787 15154 tablet_bootstrap.cc:654] T ad084674821d4137b02efe692068d382 P a722e54d227f4c29a9ed6ce77858003a: Neither blocks nor log segments found. Creating new log.
I20260709 13:23:04.093441 15427 raft_consensus.cc:2804] T 03f377f48e8849adade3945935d300a9 P a1a22e9119494570b6d2217713fd7e43 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:23:04.093822 15427 raft_consensus.cc:493] T 03f377f48e8849adade3945935d300a9 P a1a22e9119494570b6d2217713fd7e43 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:23:04.094152 15427 raft_consensus.cc:3060] T 03f377f48e8849adade3945935d300a9 P a1a22e9119494570b6d2217713fd7e43 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:23:04.081857 15155 raft_consensus.cc:359] T f86a730e237248dc9b91cbb75e29c324 P a1a22e9119494570b6d2217713fd7e43 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } } peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } } peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } }
I20260709 13:23:04.099424 15155 raft_consensus.cc:385] T f86a730e237248dc9b91cbb75e29c324 P a1a22e9119494570b6d2217713fd7e43 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:23:04.099726 14885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88a7c4171c664e819837994755edf95c" candidate_uuid: "0efc951052454eec9a58b0cd025945b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f3a500981b494979b58d2b1041fec9c8"
I20260709 13:23:04.100358 15211 leader_election.cc:290] T 88a7c4171c664e819837994755edf95c P 0efc951052454eec9a58b0cd025945b8 [CANDIDATE]: Term 1 election: Requested vote from peers f3a500981b494979b58d2b1041fec9c8 (127.5.126.65:34129), a1a22e9119494570b6d2217713fd7e43 (127.5.126.67:38125)
I20260709 13:23:04.100461 14885 raft_consensus.cc:3060] T 88a7c4171c664e819837994755edf95c P f3a500981b494979b58d2b1041fec9c8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:23:04.099766 15155 raft_consensus.cc:740] T f86a730e237248dc9b91cbb75e29c324 P a1a22e9119494570b6d2217713fd7e43 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a1a22e9119494570b6d2217713fd7e43, State: Initialized, Role: FOLLOWER
I20260709 13:23:04.101030 14849 leader_election.cc:304] T b0b7e1c1e67845cb9bd2208bb2fb7c21 P f3a500981b494979b58d2b1041fec9c8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a1a22e9119494570b6d2217713fd7e43, f3a500981b494979b58d2b1041fec9c8; no voters: 0efc951052454eec9a58b0cd025945b8
I20260709 13:23:04.104228 15363 raft_consensus.cc:2804] T b0b7e1c1e67845cb9bd2208bb2fb7c21 P f3a500981b494979b58d2b1041fec9c8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:23:04.104636 15363 raft_consensus.cc:493] T b0b7e1c1e67845cb9bd2208bb2fb7c21 P f3a500981b494979b58d2b1041fec9c8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:23:04.104966 15363 raft_consensus.cc:3060] T b0b7e1c1e67845cb9bd2208bb2fb7c21 P f3a500981b494979b58d2b1041fec9c8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:23:04.106225 15107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03f377f48e8849adade3945935d300a9" candidate_uuid: "a1a22e9119494570b6d2217713fd7e43" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a722e54d227f4c29a9ed6ce77858003a" is_pre_election: true
I20260709 13:23:04.106953 15107 raft_consensus.cc:2468] T 03f377f48e8849adade3945935d300a9 P a722e54d227f4c29a9ed6ce77858003a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1a22e9119494570b6d2217713fd7e43 in term 0.
I20260709 13:23:04.110581 15033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88a7c4171c664e819837994755edf95c" candidate_uuid: "0efc951052454eec9a58b0cd025945b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1a22e9119494570b6d2217713fd7e43"
I20260709 13:23:04.111665 14885 raft_consensus.cc:2468] T 88a7c4171c664e819837994755edf95c P f3a500981b494979b58d2b1041fec9c8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0efc951052454eec9a58b0cd025945b8 in term 1.
I20260709 13:23:04.113430 14925 leader_election.cc:304] T 88a7c4171c664e819837994755edf95c P 0efc951052454eec9a58b0cd025945b8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0efc951052454eec9a58b0cd025945b8, f3a500981b494979b58d2b1041fec9c8; no voters: 
I20260709 13:23:04.114619 15211 raft_consensus.cc:2804] T 88a7c4171c664e819837994755edf95c P 0efc951052454eec9a58b0cd025945b8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:23:04.115171 15211 raft_consensus.cc:697] T 88a7c4171c664e819837994755edf95c P 0efc951052454eec9a58b0cd025945b8 [term 1 LEADER]: Becoming Leader. State: Replica: 0efc951052454eec9a58b0cd025945b8, State: Running, Role: LEADER
I20260709 13:23:04.116370 15211 consensus_queue.cc:237] T 88a7c4171c664e819837994755edf95c P 0efc951052454eec9a58b0cd025945b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } } peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } } peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } }
W20260709 13:23:04.118480 14924 leader_election.cc:343] T 88a7c4171c664e819837994755edf95c P 0efc951052454eec9a58b0cd025945b8 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer a1a22e9119494570b6d2217713fd7e43 (127.5.126.67:38125): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:23:04.116700 15363 raft_consensus.cc:515] T b0b7e1c1e67845cb9bd2208bb2fb7c21 P f3a500981b494979b58d2b1041fec9c8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } } peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } } peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } }
I20260709 13:23:04.114985 15427 raft_consensus.cc:515] T 03f377f48e8849adade3945935d300a9 P a1a22e9119494570b6d2217713fd7e43 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } } peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } } peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } }
I20260709 13:23:04.121942 15363 leader_election.cc:290] T b0b7e1c1e67845cb9bd2208bb2fb7c21 P f3a500981b494979b58d2b1041fec9c8 [CANDIDATE]: Term 1 election: Requested vote from peers 0efc951052454eec9a58b0cd025945b8 (127.5.126.66:34613), a1a22e9119494570b6d2217713fd7e43 (127.5.126.67:38125)
I20260709 13:23:04.122833 14954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0b7e1c1e67845cb9bd2208bb2fb7c21" candidate_uuid: "f3a500981b494979b58d2b1041fec9c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0efc951052454eec9a58b0cd025945b8"
I20260709 13:23:04.122998 15033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0b7e1c1e67845cb9bd2208bb2fb7c21" candidate_uuid: "f3a500981b494979b58d2b1041fec9c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1a22e9119494570b6d2217713fd7e43"
I20260709 13:23:04.126572 15427 leader_election.cc:290] T 03f377f48e8849adade3945935d300a9 P a1a22e9119494570b6d2217713fd7e43 [CANDIDATE]: Term 1 election: Requested vote from peers a722e54d227f4c29a9ed6ce77858003a (127.5.126.68:46669), f3a500981b494979b58d2b1041fec9c8 (127.5.126.65:34129)
W20260709 13:23:04.128202 14850 leader_election.cc:343] T b0b7e1c1e67845cb9bd2208bb2fb7c21 P f3a500981b494979b58d2b1041fec9c8 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 0efc951052454eec9a58b0cd025945b8 (127.5.126.66:34613): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:23:04.127050 15033 raft_consensus.cc:3060] T b0b7e1c1e67845cb9bd2208bb2fb7c21 P a1a22e9119494570b6d2217713fd7e43 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:23:04.102221 15155 consensus_queue.cc:260] T f86a730e237248dc9b91cbb75e29c324 P a1a22e9119494570b6d2217713fd7e43 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } } peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } } peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } }
I20260709 13:23:04.125389 14884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03f377f48e8849adade3945935d300a9" candidate_uuid: "a1a22e9119494570b6d2217713fd7e43" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f3a500981b494979b58d2b1041fec9c8"
I20260709 13:23:04.136467 15350 raft_consensus.cc:493] T f86a730e237248dc9b91cbb75e29c324 P a1a22e9119494570b6d2217713fd7e43 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:23:04.136593 14884 raft_consensus.cc:3060] T 03f377f48e8849adade3945935d300a9 P f3a500981b494979b58d2b1041fec9c8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:23:04.137055 15350 raft_consensus.cc:515] T f86a730e237248dc9b91cbb75e29c324 P a1a22e9119494570b6d2217713fd7e43 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } } peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } } peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } }
I20260709 13:23:04.126101 15107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03f377f48e8849adade3945935d300a9" candidate_uuid: "a1a22e9119494570b6d2217713fd7e43" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a722e54d227f4c29a9ed6ce77858003a"
I20260709 13:23:04.137959 15107 raft_consensus.cc:3060] T 03f377f48e8849adade3945935d300a9 P a722e54d227f4c29a9ed6ce77858003a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:23:04.143560 15155 ts_tablet_manager.cc:1434] T f86a730e237248dc9b91cbb75e29c324 P a1a22e9119494570b6d2217713fd7e43: Time spent starting tablet: real 0.064s	user 0.008s	sys 0.000s
I20260709 13:23:04.146539 15155 tablet_bootstrap.cc:492] T ad084674821d4137b02efe692068d382 P a1a22e9119494570b6d2217713fd7e43: Bootstrap starting.
I20260709 13:23:04.148659 15418 raft_consensus.cc:493] T e429eefef04d433e8f18dfbc0387068d P a722e54d227f4c29a9ed6ce77858003a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0efc951052454eec9a58b0cd025945b8)
I20260709 13:23:04.149281 15418 raft_consensus.cc:515] T e429eefef04d433e8f18dfbc0387068d P a722e54d227f4c29a9ed6ce77858003a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } } peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } } peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } }
I20260709 13:23:04.151665 15418 leader_election.cc:290] T e429eefef04d433e8f18dfbc0387068d P a722e54d227f4c29a9ed6ce77858003a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0efc951052454eec9a58b0cd025945b8 (127.5.126.66:34613), a1a22e9119494570b6d2217713fd7e43 (127.5.126.67:38125)
I20260709 13:23:04.152101 15033 raft_consensus.cc:2468] T b0b7e1c1e67845cb9bd2208bb2fb7c21 P a1a22e9119494570b6d2217713fd7e43 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f3a500981b494979b58d2b1041fec9c8 in term 1.
I20260709 13:23:04.152930 15029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e429eefef04d433e8f18dfbc0387068d" candidate_uuid: "a722e54d227f4c29a9ed6ce77858003a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a1a22e9119494570b6d2217713fd7e43" is_pre_election: true
I20260709 13:23:04.153891 15029 raft_consensus.cc:2393] T e429eefef04d433e8f18dfbc0387068d P a1a22e9119494570b6d2217713fd7e43 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a722e54d227f4c29a9ed6ce77858003a in current term 2: Already voted for candidate a1a22e9119494570b6d2217713fd7e43 in this term.
I20260709 13:23:04.154163 14849 leader_election.cc:304] T b0b7e1c1e67845cb9bd2208bb2fb7c21 P f3a500981b494979b58d2b1041fec9c8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a1a22e9119494570b6d2217713fd7e43, f3a500981b494979b58d2b1041fec9c8; no voters: 0efc951052454eec9a58b0cd025945b8
I20260709 13:23:04.154294 15034 raft_consensus.cc:1275] T ced632bda66e4a74b9c854befbcbac9b P a1a22e9119494570b6d2217713fd7e43 [term 2 FOLLOWER]: Refusing update from remote peer 0efc951052454eec9a58b0cd025945b8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:23:04.156615 15440 consensus_queue.cc:1048] T ced632bda66e4a74b9c854befbcbac9b P 0efc951052454eec9a58b0cd025945b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:23:04.156949 15153 tablet_bootstrap.cc:492] T 53592d0c0a46440dbfcd26f8b8111859 P 0efc951052454eec9a58b0cd025945b8: No bootstrap required, opened a new log
I20260709 13:23:04.157629 15153 ts_tablet_manager.cc:1403] T 53592d0c0a46440dbfcd26f8b8111859 P 0efc951052454eec9a58b0cd025945b8: Time spent bootstrapping tablet: real 0.266s	user 0.006s	sys 0.016s
I20260709 13:23:04.164880 15107 raft_consensus.cc:2468] T 03f377f48e8849adade3945935d300a9 P a722e54d227f4c29a9ed6ce77858003a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1a22e9119494570b6d2217713fd7e43 in term 1.
I20260709 13:23:04.167979 15156 tablet_bootstrap.cc:492] T affcb03ab55349748a95c103059d2955 P f3a500981b494979b58d2b1041fec9c8: No bootstrap required, opened a new log
I20260709 13:23:04.168673 15156 ts_tablet_manager.cc:1403] T affcb03ab55349748a95c103059d2955 P f3a500981b494979b58d2b1041fec9c8: Time spent bootstrapping tablet: real 0.147s	user 0.012s	sys 0.007s
I20260709 13:23:04.167153 15385 raft_consensus.cc:2804] T b0b7e1c1e67845cb9bd2208bb2fb7c21 P f3a500981b494979b58d2b1041fec9c8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:23:04.175884 15154 tablet_bootstrap.cc:492] T ad084674821d4137b02efe692068d382 P a722e54d227f4c29a9ed6ce77858003a: No bootstrap required, opened a new log
I20260709 13:23:04.176440 15154 ts_tablet_manager.cc:1403] T ad084674821d4137b02efe692068d382 P a722e54d227f4c29a9ed6ce77858003a: Time spent bootstrapping tablet: real 0.091s	user 0.005s	sys 0.007s
I20260709 13:23:04.178396 14957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e429eefef04d433e8f18dfbc0387068d" candidate_uuid: "a722e54d227f4c29a9ed6ce77858003a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0efc951052454eec9a58b0cd025945b8" is_pre_election: true
I20260709 13:23:04.179194 14957 raft_consensus.cc:2468] T e429eefef04d433e8f18dfbc0387068d P 0efc951052454eec9a58b0cd025945b8 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a722e54d227f4c29a9ed6ce77858003a in term 2.
I20260709 13:23:04.177609 15474 consensus_queue.cc:1048] T d64d06459b344ff99c0df07c249c3a60 P a722e54d227f4c29a9ed6ce77858003a [LEADER]: Connected to new peer: Peer: permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.006s
I20260709 13:23:04.188582 15155 tablet_bootstrap.cc:654] T ad084674821d4137b02efe692068d382 P a1a22e9119494570b6d2217713fd7e43: Neither blocks nor log segments found. Creating new log.
I20260709 13:23:04.172876 15385 raft_consensus.cc:697] T b0b7e1c1e67845cb9bd2208bb2fb7c21 P f3a500981b494979b58d2b1041fec9c8 [term 1 LEADER]: Becoming Leader. State: Replica: f3a500981b494979b58d2b1041fec9c8, State: Running, Role: LEADER
I20260709 13:23:04.187779 15418 raft_consensus.cc:493] T 53592d0c0a46440dbfcd26f8b8111859 P a722e54d227f4c29a9ed6ce77858003a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:23:04.190675 15418 raft_consensus.cc:515] T 53592d0c0a46440dbfcd26f8b8111859 P a722e54d227f4c29a9ed6ce77858003a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } } peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } } peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } }
I20260709 13:23:04.192910 15418 leader_election.cc:290] T 53592d0c0a46440dbfcd26f8b8111859 P a722e54d227f4c29a9ed6ce77858003a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0efc951052454eec9a58b0cd025945b8 (127.5.126.66:34613), a1a22e9119494570b6d2217713fd7e43 (127.5.126.67:38125)
I20260709 13:23:04.194701 15034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53592d0c0a46440dbfcd26f8b8111859" candidate_uuid: "a722e54d227f4c29a9ed6ce77858003a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1a22e9119494570b6d2217713fd7e43" is_pre_election: true
I20260709 13:23:04.191057 15385 consensus_queue.cc:237] T b0b7e1c1e67845cb9bd2208bb2fb7c21 P f3a500981b494979b58d2b1041fec9c8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } } peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } } peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } }
W20260709 13:23:04.196161 15072 leader_election.cc:343] T 53592d0c0a46440dbfcd26f8b8111859 P a722e54d227f4c29a9ed6ce77858003a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a1a22e9119494570b6d2217713fd7e43 (127.5.126.67:38125): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:23:04.199615 14999 leader_election.cc:304] T 03f377f48e8849adade3945935d300a9 P a1a22e9119494570b6d2217713fd7e43 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1a22e9119494570b6d2217713fd7e43, a722e54d227f4c29a9ed6ce77858003a; no voters: 
I20260709 13:23:04.201861 15350 leader_election.cc:290] T f86a730e237248dc9b91cbb75e29c324 P a1a22e9119494570b6d2217713fd7e43 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a722e54d227f4c29a9ed6ce77858003a (127.5.126.68:46669), f3a500981b494979b58d2b1041fec9c8 (127.5.126.65:34129)
I20260709 13:23:04.202796 15434 raft_consensus.cc:2804] T 03f377f48e8849adade3945935d300a9 P a1a22e9119494570b6d2217713fd7e43 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:23:04.203079 14881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86a730e237248dc9b91cbb75e29c324" candidate_uuid: "a1a22e9119494570b6d2217713fd7e43" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f3a500981b494979b58d2b1041fec9c8" is_pre_election: true
I20260709 13:23:04.203516 15434 raft_consensus.cc:697] T 03f377f48e8849adade3945935d300a9 P a1a22e9119494570b6d2217713fd7e43 [term 1 LEADER]: Becoming Leader. State: Replica: a1a22e9119494570b6d2217713fd7e43, State: Running, Role: LEADER
I20260709 13:23:04.204133 15154 raft_consensus.cc:359] T ad084674821d4137b02efe692068d382 P a722e54d227f4c29a9ed6ce77858003a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } } peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } } peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } }
W20260709 13:23:04.204763 14999 leader_election.cc:343] T f86a730e237248dc9b91cbb75e29c324 P a1a22e9119494570b6d2217713fd7e43 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f3a500981b494979b58d2b1041fec9c8 (127.5.126.65:34129): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:23:04.205214 15154 raft_consensus.cc:385] T ad084674821d4137b02efe692068d382 P a722e54d227f4c29a9ed6ce77858003a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:23:04.204632 15434 consensus_queue.cc:237] T 03f377f48e8849adade3945935d300a9 P a1a22e9119494570b6d2217713fd7e43 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } } peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } } peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } }
I20260709 13:23:04.205643 15154 raft_consensus.cc:740] T ad084674821d4137b02efe692068d382 P a722e54d227f4c29a9ed6ce77858003a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a722e54d227f4c29a9ed6ce77858003a, State: Initialized, Role: FOLLOWER
I20260709 13:23:04.209014 15154 consensus_queue.cc:260] T ad084674821d4137b02efe692068d382 P a722e54d227f4c29a9ed6ce77858003a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } } peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } } peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } }
I20260709 13:23:04.209153 15156 raft_consensus.cc:359] T affcb03ab55349748a95c103059d2955 P f3a500981b494979b58d2b1041fec9c8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } } peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } } peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } }
I20260709 13:23:04.211257 15156 raft_consensus.cc:385] T affcb03ab55349748a95c103059d2955 P f3a500981b494979b58d2b1041fec9c8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:23:04.211545 15156 raft_consensus.cc:740] T affcb03ab55349748a95c103059d2955 P f3a500981b494979b58d2b1041fec9c8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f3a500981b494979b58d2b1041fec9c8, State: Initialized, Role: FOLLOWER
I20260709 13:23:04.214551 15073 leader_election.cc:304] T e429eefef04d433e8f18dfbc0387068d P a722e54d227f4c29a9ed6ce77858003a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0efc951052454eec9a58b0cd025945b8, a722e54d227f4c29a9ed6ce77858003a; no voters: a1a22e9119494570b6d2217713fd7e43
I20260709 13:23:04.212374 15156 consensus_queue.cc:260] T affcb03ab55349748a95c103059d2955 P f3a500981b494979b58d2b1041fec9c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } } peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } } peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } }
W20260709 13:23:04.216902 14830 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:23:04.218436 15154 ts_tablet_manager.cc:1434] T ad084674821d4137b02efe692068d382 P a722e54d227f4c29a9ed6ce77858003a: Time spent starting tablet: real 0.042s	user 0.005s	sys 0.003s
W20260709 13:23:04.219805 15073 consensus_peers.cc:597] T d64d06459b344ff99c0df07c249c3a60 P a722e54d227f4c29a9ed6ce77858003a -> Peer 0efc951052454eec9a58b0cd025945b8 (127.5.126.66:34613): Couldn't send request to peer 0efc951052454eec9a58b0cd025945b8. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:23:04.215713 15350 consensus_queue.cc:1048] T e1ae79ed138a4950a681f24aa1107ef3 P a1a22e9119494570b6d2217713fd7e43 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.005s
I20260709 13:23:04.221935 15418 raft_consensus.cc:2804] T e429eefef04d433e8f18dfbc0387068d P a722e54d227f4c29a9ed6ce77858003a [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:23:04.210453 14884 raft_consensus.cc:2468] T 03f377f48e8849adade3945935d300a9 P f3a500981b494979b58d2b1041fec9c8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1a22e9119494570b6d2217713fd7e43 in term 1.
I20260709 13:23:04.233032 15154 tablet_bootstrap.cc:492] T 58a622a48cd24833bc5fc27e03114176 P a722e54d227f4c29a9ed6ce77858003a: Bootstrap starting.
I20260709 13:23:04.230140 15418 raft_consensus.cc:493] T e429eefef04d433e8f18dfbc0387068d P a722e54d227f4c29a9ed6ce77858003a [term 1 FOLLOWER]: Starting leader election (detected failure of leader 0efc951052454eec9a58b0cd025945b8)
I20260709 13:23:04.237736 15418 raft_consensus.cc:3060] T e429eefef04d433e8f18dfbc0387068d P a722e54d227f4c29a9ed6ce77858003a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:23:04.241106 15107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86a730e237248dc9b91cbb75e29c324" candidate_uuid: "a1a22e9119494570b6d2217713fd7e43" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a722e54d227f4c29a9ed6ce77858003a" is_pre_election: true
I20260709 13:23:04.242026 14780 catalog_manager.cc:5697] T 88a7c4171c664e819837994755edf95c P 0efc951052454eec9a58b0cd025945b8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0efc951052454eec9a58b0cd025945b8 (127.5.126.66). New cstate: current_term: 1 leader_uuid: "0efc951052454eec9a58b0cd025945b8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } health_report { overall_health: UNKNOWN } } }
I20260709 13:23:04.242455 14954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53592d0c0a46440dbfcd26f8b8111859" candidate_uuid: "a722e54d227f4c29a9ed6ce77858003a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0efc951052454eec9a58b0cd025945b8" is_pre_election: true
W20260709 13:23:04.248924 14999 leader_election.cc:343] T f86a730e237248dc9b91cbb75e29c324 P a1a22e9119494570b6d2217713fd7e43 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a722e54d227f4c29a9ed6ce77858003a (127.5.126.68:46669): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:23:04.249185 15073 leader_election.cc:343] T 53592d0c0a46440dbfcd26f8b8111859 P a722e54d227f4c29a9ed6ce77858003a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0efc951052454eec9a58b0cd025945b8 (127.5.126.66:34613): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:23:04.249729 14999 leader_election.cc:304] T f86a730e237248dc9b91cbb75e29c324 P a1a22e9119494570b6d2217713fd7e43 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1a22e9119494570b6d2217713fd7e43; no voters: a722e54d227f4c29a9ed6ce77858003a, f3a500981b494979b58d2b1041fec9c8
I20260709 13:23:04.250139 15073 leader_election.cc:304] T 53592d0c0a46440dbfcd26f8b8111859 P a722e54d227f4c29a9ed6ce77858003a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a722e54d227f4c29a9ed6ce77858003a; no voters: 0efc951052454eec9a58b0cd025945b8, a1a22e9119494570b6d2217713fd7e43
I20260709 13:23:04.254570 15156 ts_tablet_manager.cc:1434] T affcb03ab55349748a95c103059d2955 P f3a500981b494979b58d2b1041fec9c8: Time spent starting tablet: real 0.083s	user 0.006s	sys 0.003s
I20260709 13:23:04.254194 15434 raft_consensus.cc:2749] T f86a730e237248dc9b91cbb75e29c324 P a1a22e9119494570b6d2217713fd7e43 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:23:04.254334 15508 raft_consensus.cc:2749] T 53592d0c0a46440dbfcd26f8b8111859 P a722e54d227f4c29a9ed6ce77858003a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:23:04.281894 15153 raft_consensus.cc:359] T 53592d0c0a46440dbfcd26f8b8111859 P 0efc951052454eec9a58b0cd025945b8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } } peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } } peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } }
I20260709 13:23:04.283073 15153 raft_consensus.cc:385] T 53592d0c0a46440dbfcd26f8b8111859 P 0efc951052454eec9a58b0cd025945b8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:23:04.283360 15153 raft_consensus.cc:740] T 53592d0c0a46440dbfcd26f8b8111859 P 0efc951052454eec9a58b0cd025945b8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0efc951052454eec9a58b0cd025945b8, State: Initialized, Role: FOLLOWER
I20260709 13:23:04.284201 15153 consensus_queue.cc:260] T 53592d0c0a46440dbfcd26f8b8111859 P 0efc951052454eec9a58b0cd025945b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } } peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } } peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } }
W20260709 13:23:04.286516 15511 log.cc:927] Time spent T 03f377f48e8849adade3945935d300a9 P a1a22e9119494570b6d2217713fd7e43: Append to log took a long time: real 0.075s	user 0.000s	sys 0.000s
I20260709 13:23:04.292407 15156 tablet_bootstrap.cc:492] T 2a9523aa8663464686254c8412c37e67 P f3a500981b494979b58d2b1041fec9c8: Bootstrap starting.
I20260709 13:23:04.283643 15418 raft_consensus.cc:515] T e429eefef04d433e8f18dfbc0387068d P a722e54d227f4c29a9ed6ce77858003a [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } } peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } } peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } }
I20260709 13:23:04.326115 15474 raft_consensus.cc:493] T ad084674821d4137b02efe692068d382 P a722e54d227f4c29a9ed6ce77858003a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:23:04.326805 15474 raft_consensus.cc:515] T ad084674821d4137b02efe692068d382 P a722e54d227f4c29a9ed6ce77858003a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } } peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } } peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } }
I20260709 13:23:04.329638 15474 leader_election.cc:290] T ad084674821d4137b02efe692068d382 P a722e54d227f4c29a9ed6ce77858003a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0efc951052454eec9a58b0cd025945b8 (127.5.126.66:34613), a1a22e9119494570b6d2217713fd7e43 (127.5.126.67:38125)
I20260709 13:23:04.330451 14954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad084674821d4137b02efe692068d382" candidate_uuid: "a722e54d227f4c29a9ed6ce77858003a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0efc951052454eec9a58b0cd025945b8" is_pre_election: true
I20260709 13:23:04.331112 14954 raft_consensus.cc:2468] T ad084674821d4137b02efe692068d382 P 0efc951052454eec9a58b0cd025945b8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a722e54d227f4c29a9ed6ce77858003a in term 0.
I20260709 13:23:04.332307 15073 leader_election.cc:304] T ad084674821d4137b02efe692068d382 P a722e54d227f4c29a9ed6ce77858003a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0efc951052454eec9a58b0cd025945b8, a722e54d227f4c29a9ed6ce77858003a; no voters: 
I20260709 13:23:04.332952 15155 tablet_bootstrap.cc:492] T ad084674821d4137b02efe692068d382 P a1a22e9119494570b6d2217713fd7e43: No bootstrap required, opened a new log
I20260709 13:23:04.333778 15155 ts_tablet_manager.cc:1403] T ad084674821d4137b02efe692068d382 P a1a22e9119494570b6d2217713fd7e43: Time spent bootstrapping tablet: real 0.187s	user 0.019s	sys 0.010s
I20260709 13:23:04.337316 15508 raft_consensus.cc:2804] T ad084674821d4137b02efe692068d382 P a722e54d227f4c29a9ed6ce77858003a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:23:04.337586 15418 leader_election.cc:290] T e429eefef04d433e8f18dfbc0387068d P a722e54d227f4c29a9ed6ce77858003a [CANDIDATE]: Term 2 election: Requested vote from peers 0efc951052454eec9a58b0cd025945b8 (127.5.126.66:34613), a1a22e9119494570b6d2217713fd7e43 (127.5.126.67:38125)
I20260709 13:23:04.337849 15508 raft_consensus.cc:493] T ad084674821d4137b02efe692068d382 P a722e54d227f4c29a9ed6ce77858003a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:23:04.338238 15508 raft_consensus.cc:3060] T ad084674821d4137b02efe692068d382 P a722e54d227f4c29a9ed6ce77858003a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:23:04.341439 14959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e429eefef04d433e8f18dfbc0387068d" candidate_uuid: "a722e54d227f4c29a9ed6ce77858003a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0efc951052454eec9a58b0cd025945b8"
W20260709 13:23:04.342744 15510 log.cc:927] Time spent T b0b7e1c1e67845cb9bd2208bb2fb7c21 P f3a500981b494979b58d2b1041fec9c8: Append to log took a long time: real 0.052s	user 0.001s	sys 0.000s
I20260709 13:23:04.343411 15156 tablet_bootstrap.cc:654] T 2a9523aa8663464686254c8412c37e67 P f3a500981b494979b58d2b1041fec9c8: Neither blocks nor log segments found. Creating new log.
I20260709 13:23:04.345232 15363 raft_consensus.cc:493] T 58a622a48cd24833bc5fc27e03114176 P f3a500981b494979b58d2b1041fec9c8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:23:04.345920 15154 tablet_bootstrap.cc:654] T 58a622a48cd24833bc5fc27e03114176 P a722e54d227f4c29a9ed6ce77858003a: Neither blocks nor log segments found. Creating new log.
I20260709 13:23:04.345773 15363 raft_consensus.cc:515] T 58a622a48cd24833bc5fc27e03114176 P f3a500981b494979b58d2b1041fec9c8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } } peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } } peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } }
I20260709 13:23:04.350189 15108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58a622a48cd24833bc5fc27e03114176" candidate_uuid: "f3a500981b494979b58d2b1041fec9c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a722e54d227f4c29a9ed6ce77858003a" is_pre_election: true
W20260709 13:23:04.356145 14850 leader_election.cc:343] T 58a622a48cd24833bc5fc27e03114176 P f3a500981b494979b58d2b1041fec9c8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a722e54d227f4c29a9ed6ce77858003a (127.5.126.68:46669): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:23:04.356927 15153 ts_tablet_manager.cc:1434] T 53592d0c0a46440dbfcd26f8b8111859 P 0efc951052454eec9a58b0cd025945b8: Time spent starting tablet: real 0.199s	user 0.007s	sys 0.002s
I20260709 13:23:04.362159 15363 leader_election.cc:290] T 58a622a48cd24833bc5fc27e03114176 P f3a500981b494979b58d2b1041fec9c8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a722e54d227f4c29a9ed6ce77858003a (127.5.126.68:46669), 0efc951052454eec9a58b0cd025945b8 (127.5.126.66:34613)
I20260709 13:23:04.370230 14782 catalog_manager.cc:5697] T b0b7e1c1e67845cb9bd2208bb2fb7c21 P f3a500981b494979b58d2b1041fec9c8 reported cstate change: term changed from 0 to 1, leader changed from <none> to f3a500981b494979b58d2b1041fec9c8 (127.5.126.65). New cstate: current_term: 1 leader_uuid: "f3a500981b494979b58d2b1041fec9c8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } health_report { overall_health: UNKNOWN } } }
I20260709 13:23:04.372642 15155 raft_consensus.cc:359] T ad084674821d4137b02efe692068d382 P a1a22e9119494570b6d2217713fd7e43 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } } peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } } peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } }
I20260709 13:23:04.395692 15155 raft_consensus.cc:385] T ad084674821d4137b02efe692068d382 P a1a22e9119494570b6d2217713fd7e43 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:23:04.396010 15155 raft_consensus.cc:740] T ad084674821d4137b02efe692068d382 P a1a22e9119494570b6d2217713fd7e43 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a1a22e9119494570b6d2217713fd7e43, State: Initialized, Role: FOLLOWER
I20260709 13:23:04.373705 14957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58a622a48cd24833bc5fc27e03114176" candidate_uuid: "f3a500981b494979b58d2b1041fec9c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0efc951052454eec9a58b0cd025945b8" is_pre_election: true
I20260709 13:23:04.404685 14957 raft_consensus.cc:2468] T 58a622a48cd24833bc5fc27e03114176 P 0efc951052454eec9a58b0cd025945b8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f3a500981b494979b58d2b1041fec9c8 in term 0.
I20260709 13:23:04.407483 15452 raft_consensus.cc:493] T affcb03ab55349748a95c103059d2955 P f3a500981b494979b58d2b1041fec9c8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:23:04.408106 15452 raft_consensus.cc:515] T affcb03ab55349748a95c103059d2955 P f3a500981b494979b58d2b1041fec9c8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } } peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } } peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } }
I20260709 13:23:04.410365 15452 leader_election.cc:290] T affcb03ab55349748a95c103059d2955 P f3a500981b494979b58d2b1041fec9c8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0efc951052454eec9a58b0cd025945b8 (127.5.126.66:34613), a1a22e9119494570b6d2217713fd7e43 (127.5.126.67:38125)
I20260709 13:23:04.376204 15029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad084674821d4137b02efe692068d382" candidate_uuid: "a722e54d227f4c29a9ed6ce77858003a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1a22e9119494570b6d2217713fd7e43" is_pre_election: true
I20260709 13:23:04.413389 15153 tablet_bootstrap.cc:492] T d64d06459b344ff99c0df07c249c3a60 P 0efc951052454eec9a58b0cd025945b8: Bootstrap starting.
I20260709 13:23:04.372207 15031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e429eefef04d433e8f18dfbc0387068d" candidate_uuid: "a722e54d227f4c29a9ed6ce77858003a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a1a22e9119494570b6d2217713fd7e43"
I20260709 13:23:04.418421 15031 raft_consensus.cc:2393] T e429eefef04d433e8f18dfbc0387068d P a1a22e9119494570b6d2217713fd7e43 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate a722e54d227f4c29a9ed6ce77858003a in current term 2: Already voted for candidate a1a22e9119494570b6d2217713fd7e43 in this term.
I20260709 13:23:04.413162 15155 consensus_queue.cc:260] T ad084674821d4137b02efe692068d382 P a1a22e9119494570b6d2217713fd7e43 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } } peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } } peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } }
I20260709 13:23:04.422420 15031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "affcb03ab55349748a95c103059d2955" candidate_uuid: "f3a500981b494979b58d2b1041fec9c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1a22e9119494570b6d2217713fd7e43" is_pre_election: true
I20260709 13:23:04.424450 15029 raft_consensus.cc:2468] T ad084674821d4137b02efe692068d382 P a1a22e9119494570b6d2217713fd7e43 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a722e54d227f4c29a9ed6ce77858003a in term 0.
W20260709 13:23:04.425681 14849 leader_election.cc:343] T affcb03ab55349748a95c103059d2955 P f3a500981b494979b58d2b1041fec9c8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a1a22e9119494570b6d2217713fd7e43 (127.5.126.67:38125): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:23:04.426034 14957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "affcb03ab55349748a95c103059d2955" candidate_uuid: "f3a500981b494979b58d2b1041fec9c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0efc951052454eec9a58b0cd025945b8" is_pre_election: true
I20260709 13:23:04.427950 14850 leader_election.cc:304] T 58a622a48cd24833bc5fc27e03114176 P f3a500981b494979b58d2b1041fec9c8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0efc951052454eec9a58b0cd025945b8, f3a500981b494979b58d2b1041fec9c8; no voters: a722e54d227f4c29a9ed6ce77858003a
I20260709 13:23:04.429108 15363 raft_consensus.cc:2804] T 58a622a48cd24833bc5fc27e03114176 P f3a500981b494979b58d2b1041fec9c8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:23:04.429622 15363 raft_consensus.cc:493] T 58a622a48cd24833bc5fc27e03114176 P f3a500981b494979b58d2b1041fec9c8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:23:04.430056 15363 raft_consensus.cc:3060] T 58a622a48cd24833bc5fc27e03114176 P f3a500981b494979b58d2b1041fec9c8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:23:04.432596 15155 ts_tablet_manager.cc:1434] T ad084674821d4137b02efe692068d382 P a1a22e9119494570b6d2217713fd7e43: Time spent starting tablet: real 0.098s	user 0.009s	sys 0.000s
I20260709 13:23:04.434109 15155 tablet_bootstrap.cc:492] T 53592d0c0a46440dbfcd26f8b8111859 P a1a22e9119494570b6d2217713fd7e43: Bootstrap starting.
I20260709 13:23:04.438524 14959 raft_consensus.cc:2468] T e429eefef04d433e8f18dfbc0387068d P 0efc951052454eec9a58b0cd025945b8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a722e54d227f4c29a9ed6ce77858003a in term 2.
I20260709 13:23:04.442183 15073 leader_election.cc:304] T e429eefef04d433e8f18dfbc0387068d P a722e54d227f4c29a9ed6ce77858003a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0efc951052454eec9a58b0cd025945b8, a722e54d227f4c29a9ed6ce77858003a; no voters: a1a22e9119494570b6d2217713fd7e43
I20260709 13:23:04.443779 15474 raft_consensus.cc:2804] T e429eefef04d433e8f18dfbc0387068d P a722e54d227f4c29a9ed6ce77858003a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:23:04.444327 15474 raft_consensus.cc:697] T e429eefef04d433e8f18dfbc0387068d P a722e54d227f4c29a9ed6ce77858003a [term 2 LEADER]: Becoming Leader. State: Replica: a722e54d227f4c29a9ed6ce77858003a, State: Running, Role: LEADER
I20260709 13:23:04.445189 15474 consensus_queue.cc:237] T e429eefef04d433e8f18dfbc0387068d P a722e54d227f4c29a9ed6ce77858003a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } } peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } } peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } }
W20260709 13:23:04.447307 14850 leader_election.cc:343] T affcb03ab55349748a95c103059d2955 P f3a500981b494979b58d2b1041fec9c8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0efc951052454eec9a58b0cd025945b8 (127.5.126.66:34613): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:23:04.448621 14850 leader_election.cc:304] T affcb03ab55349748a95c103059d2955 P f3a500981b494979b58d2b1041fec9c8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f3a500981b494979b58d2b1041fec9c8; no voters: 0efc951052454eec9a58b0cd025945b8, a1a22e9119494570b6d2217713fd7e43
W20260709 13:23:04.449819 14999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.68:46669, user_credentials={real_user=slave}} blocked reactor thread for 87496.1us
I20260709 13:23:04.458479 15507 consensus_queue.cc:1048] T abc01daa220a47fa8578b0d20a17c9ab P a1a22e9119494570b6d2217713fd7e43 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:23:04.447257 15350 raft_consensus.cc:493] T e429eefef04d433e8f18dfbc0387068d P a1a22e9119494570b6d2217713fd7e43 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:23:04.467651 15350 raft_consensus.cc:515] T e429eefef04d433e8f18dfbc0387068d P a1a22e9119494570b6d2217713fd7e43 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } } peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } } peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } }
I20260709 13:23:04.468676 15155 tablet_bootstrap.cc:654] T 53592d0c0a46440dbfcd26f8b8111859 P a1a22e9119494570b6d2217713fd7e43: Neither blocks nor log segments found. Creating new log.
I20260709 13:23:04.470491 15350 leader_election.cc:290] T e429eefef04d433e8f18dfbc0387068d P a1a22e9119494570b6d2217713fd7e43 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0efc951052454eec9a58b0cd025945b8 (127.5.126.66:34613), a722e54d227f4c29a9ed6ce77858003a (127.5.126.68:46669)
I20260709 13:23:04.451118 15512 raft_consensus.cc:2749] T affcb03ab55349748a95c103059d2955 P f3a500981b494979b58d2b1041fec9c8 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:23:04.473202 15508 raft_consensus.cc:515] T ad084674821d4137b02efe692068d382 P a722e54d227f4c29a9ed6ce77858003a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } } peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } } peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } }
I20260709 13:23:04.475901 15508 leader_election.cc:290] T ad084674821d4137b02efe692068d382 P a722e54d227f4c29a9ed6ce77858003a [CANDIDATE]: Term 1 election: Requested vote from peers 0efc951052454eec9a58b0cd025945b8 (127.5.126.66:34613), a1a22e9119494570b6d2217713fd7e43 (127.5.126.67:38125)
I20260709 13:23:04.479389 15031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad084674821d4137b02efe692068d382" candidate_uuid: "a722e54d227f4c29a9ed6ce77858003a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1a22e9119494570b6d2217713fd7e43"
I20260709 13:23:04.481283 15031 raft_consensus.cc:3060] T ad084674821d4137b02efe692068d382 P a1a22e9119494570b6d2217713fd7e43 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:23:04.482717 14957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad084674821d4137b02efe692068d382" candidate_uuid: "a722e54d227f4c29a9ed6ce77858003a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0efc951052454eec9a58b0cd025945b8"
I20260709 13:23:04.486207 14957 raft_consensus.cc:3060] T ad084674821d4137b02efe692068d382 P 0efc951052454eec9a58b0cd025945b8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:23:04.494405 15153 tablet_bootstrap.cc:654] T d64d06459b344ff99c0df07c249c3a60 P 0efc951052454eec9a58b0cd025945b8: Neither blocks nor log segments found. Creating new log.
I20260709 13:23:04.508453 14959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e429eefef04d433e8f18dfbc0387068d" candidate_uuid: "a1a22e9119494570b6d2217713fd7e43" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0efc951052454eec9a58b0cd025945b8" is_pre_election: true
I20260709 13:23:04.506590 15507 consensus_queue.cc:1048] T e1ae79ed138a4950a681f24aa1107ef3 P a1a22e9119494570b6d2217713fd7e43 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:23:04.508726 15105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e429eefef04d433e8f18dfbc0387068d" candidate_uuid: "a1a22e9119494570b6d2217713fd7e43" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a722e54d227f4c29a9ed6ce77858003a" is_pre_election: true
I20260709 13:23:04.509255 14959 raft_consensus.cc:2468] T e429eefef04d433e8f18dfbc0387068d P 0efc951052454eec9a58b0cd025945b8 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1a22e9119494570b6d2217713fd7e43 in term 2.
I20260709 13:23:04.524801 14999 leader_election.cc:304] T e429eefef04d433e8f18dfbc0387068d P a1a22e9119494570b6d2217713fd7e43 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0efc951052454eec9a58b0cd025945b8, a1a22e9119494570b6d2217713fd7e43; no voters: a722e54d227f4c29a9ed6ce77858003a
I20260709 13:23:04.515815 15363 raft_consensus.cc:515] T 58a622a48cd24833bc5fc27e03114176 P f3a500981b494979b58d2b1041fec9c8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } } peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } } peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } }
I20260709 13:23:04.542637 15427 raft_consensus.cc:2804] T e429eefef04d433e8f18dfbc0387068d P a1a22e9119494570b6d2217713fd7e43 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:23:04.546420 15427 raft_consensus.cc:493] T e429eefef04d433e8f18dfbc0387068d P a1a22e9119494570b6d2217713fd7e43 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:23:04.546788 15427 raft_consensus.cc:3060] T e429eefef04d433e8f18dfbc0387068d P a1a22e9119494570b6d2217713fd7e43 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:23:04.554083 15154 tablet_bootstrap.cc:492] T 58a622a48cd24833bc5fc27e03114176 P a722e54d227f4c29a9ed6ce77858003a: No bootstrap required, opened a new log
I20260709 13:23:04.554767 15154 ts_tablet_manager.cc:1403] T 58a622a48cd24833bc5fc27e03114176 P a722e54d227f4c29a9ed6ce77858003a: Time spent bootstrapping tablet: real 0.322s	user 0.070s	sys 0.094s
I20260709 13:23:04.602025 15156 tablet_bootstrap.cc:492] T 2a9523aa8663464686254c8412c37e67 P f3a500981b494979b58d2b1041fec9c8: No bootstrap required, opened a new log
I20260709 13:23:04.602896 15156 ts_tablet_manager.cc:1403] T 2a9523aa8663464686254c8412c37e67 P f3a500981b494979b58d2b1041fec9c8: Time spent bootstrapping tablet: real 0.314s	user 0.020s	sys 0.052s
I20260709 13:23:04.599809 14782 catalog_manager.cc:5697] T 03f377f48e8849adade3945935d300a9 P a1a22e9119494570b6d2217713fd7e43 reported cstate change: term changed from 0 to 1, leader changed from <none> to a1a22e9119494570b6d2217713fd7e43 (127.5.126.67). New cstate: current_term: 1 leader_uuid: "a1a22e9119494570b6d2217713fd7e43" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } health_report { overall_health: UNKNOWN } } }
I20260709 13:23:04.618208 15363 leader_election.cc:290] T 58a622a48cd24833bc5fc27e03114176 P f3a500981b494979b58d2b1041fec9c8 [CANDIDATE]: Term 1 election: Requested vote from peers a722e54d227f4c29a9ed6ce77858003a (127.5.126.68:46669), 0efc951052454eec9a58b0cd025945b8 (127.5.126.66:34613)
I20260709 13:23:04.621693 14960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58a622a48cd24833bc5fc27e03114176" candidate_uuid: "f3a500981b494979b58d2b1041fec9c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0efc951052454eec9a58b0cd025945b8"
I20260709 13:23:04.622202 15154 raft_consensus.cc:359] T 58a622a48cd24833bc5fc27e03114176 P a722e54d227f4c29a9ed6ce77858003a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } } peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } } peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } }
I20260709 13:23:04.622982 15154 raft_consensus.cc:385] T 58a622a48cd24833bc5fc27e03114176 P a722e54d227f4c29a9ed6ce77858003a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:23:04.623270 15154 raft_consensus.cc:740] T 58a622a48cd24833bc5fc27e03114176 P a722e54d227f4c29a9ed6ce77858003a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a722e54d227f4c29a9ed6ce77858003a, State: Initialized, Role: FOLLOWER
I20260709 13:23:04.622606 14960 raft_consensus.cc:3060] T 58a622a48cd24833bc5fc27e03114176 P 0efc951052454eec9a58b0cd025945b8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:23:04.624001 15154 consensus_queue.cc:260] T 58a622a48cd24833bc5fc27e03114176 P a722e54d227f4c29a9ed6ce77858003a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } } peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } } peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } }
I20260709 13:23:04.646642 15211 raft_consensus.cc:493] T 53592d0c0a46440dbfcd26f8b8111859 P 0efc951052454eec9a58b0cd025945b8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:23:04.646845 15106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58a622a48cd24833bc5fc27e03114176" candidate_uuid: "f3a500981b494979b58d2b1041fec9c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a722e54d227f4c29a9ed6ce77858003a"
I20260709 13:23:04.647472 15106 raft_consensus.cc:3060] T 58a622a48cd24833bc5fc27e03114176 P a722e54d227f4c29a9ed6ce77858003a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:23:04.647253 15211 raft_consensus.cc:515] T 53592d0c0a46440dbfcd26f8b8111859 P 0efc951052454eec9a58b0cd025945b8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } } peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } } peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } }
I20260709 13:23:04.647694 15031 raft_consensus.cc:2468] T ad084674821d4137b02efe692068d382 P a1a22e9119494570b6d2217713fd7e43 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a722e54d227f4c29a9ed6ce77858003a in term 1.
I20260709 13:23:04.655907 15154 ts_tablet_manager.cc:1434] T 58a622a48cd24833bc5fc27e03114176 P a722e54d227f4c29a9ed6ce77858003a: Time spent starting tablet: real 0.101s	user 0.006s	sys 0.004s
W20260709 13:23:04.645691 15072 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.67:38125, user_credentials={real_user=slave}} blocked reactor thread for 78030.2us
I20260709 13:23:04.697009 15155 tablet_bootstrap.cc:492] T 53592d0c0a46440dbfcd26f8b8111859 P a1a22e9119494570b6d2217713fd7e43: No bootstrap required, opened a new log
I20260709 13:23:04.697592 15155 ts_tablet_manager.cc:1403] T 53592d0c0a46440dbfcd26f8b8111859 P a1a22e9119494570b6d2217713fd7e43: Time spent bootstrapping tablet: real 0.264s	user 0.025s	sys 0.000s
I20260709 13:23:04.669595 14957 raft_consensus.cc:2468] T ad084674821d4137b02efe692068d382 P 0efc951052454eec9a58b0cd025945b8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a722e54d227f4c29a9ed6ce77858003a in term 1.
I20260709 13:23:04.701243 14960 raft_consensus.cc:2468] T 58a622a48cd24833bc5fc27e03114176 P 0efc951052454eec9a58b0cd025945b8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f3a500981b494979b58d2b1041fec9c8 in term 1.
I20260709 13:23:04.734254 15154 tablet_bootstrap.cc:492] T 77e8d8b35cf148e99e8274bf65e5ed05 P a722e54d227f4c29a9ed6ce77858003a: Bootstrap starting.
I20260709 13:23:04.702296 15153 tablet_bootstrap.cc:492] T d64d06459b344ff99c0df07c249c3a60 P 0efc951052454eec9a58b0cd025945b8: No bootstrap required, opened a new log
I20260709 13:23:04.740357 15153 ts_tablet_manager.cc:1403] T d64d06459b344ff99c0df07c249c3a60 P 0efc951052454eec9a58b0cd025945b8: Time spent bootstrapping tablet: real 0.327s	user 0.021s	sys 0.023s
I20260709 13:23:04.752730 15154 tablet_bootstrap.cc:654] T 77e8d8b35cf148e99e8274bf65e5ed05 P a722e54d227f4c29a9ed6ce77858003a: Neither blocks nor log segments found. Creating new log.
I20260709 13:23:04.711015 15427 raft_consensus.cc:515] T e429eefef04d433e8f18dfbc0387068d P a1a22e9119494570b6d2217713fd7e43 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } } peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } } peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } }
I20260709 13:23:04.757014 15427 leader_election.cc:290] T e429eefef04d433e8f18dfbc0387068d P a1a22e9119494570b6d2217713fd7e43 [CANDIDATE]: Term 3 election: Requested vote from peers 0efc951052454eec9a58b0cd025945b8 (127.5.126.66:34613), a722e54d227f4c29a9ed6ce77858003a (127.5.126.68:46669)
W20260709 13:23:04.729107 15073 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.65:34129, user_credentials={real_user=slave}} blocked reactor thread for 100171us
I20260709 13:23:04.763167 15211 leader_election.cc:290] T 53592d0c0a46440dbfcd26f8b8111859 P 0efc951052454eec9a58b0cd025945b8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a1a22e9119494570b6d2217713fd7e43 (127.5.126.67:38125), a722e54d227f4c29a9ed6ce77858003a (127.5.126.68:46669)
I20260709 13:23:04.744119 15155 raft_consensus.cc:359] T 53592d0c0a46440dbfcd26f8b8111859 P a1a22e9119494570b6d2217713fd7e43 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } } peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } } peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } }
I20260709 13:23:04.767163 15155 raft_consensus.cc:385] T 53592d0c0a46440dbfcd26f8b8111859 P a1a22e9119494570b6d2217713fd7e43 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:23:04.767496 15155 raft_consensus.cc:740] T 53592d0c0a46440dbfcd26f8b8111859 P a1a22e9119494570b6d2217713fd7e43 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a1a22e9119494570b6d2217713fd7e43, State: Initialized, Role: FOLLOWER
I20260709 13:23:04.750631 15108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53592d0c0a46440dbfcd26f8b8111859" candidate_uuid: "0efc951052454eec9a58b0cd025945b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a722e54d227f4c29a9ed6ce77858003a" is_pre_election: true
I20260709 13:23:04.747830 15153 raft_consensus.cc:359] T d64d06459b344ff99c0df07c249c3a60 P 0efc951052454eec9a58b0cd025945b8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } } peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } } peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } }
I20260709 13:23:04.768903 15108 raft_consensus.cc:2468] T 53592d0c0a46440dbfcd26f8b8111859 P a722e54d227f4c29a9ed6ce77858003a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0efc951052454eec9a58b0cd025945b8 in term 0.
I20260709 13:23:04.744313 15156 raft_consensus.cc:359] T 2a9523aa8663464686254c8412c37e67 P f3a500981b494979b58d2b1041fec9c8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } } peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } } peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } }
I20260709 13:23:04.771498 15156 raft_consensus.cc:385] T 2a9523aa8663464686254c8412c37e67 P f3a500981b494979b58d2b1041fec9c8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:23:04.771767 15156 raft_consensus.cc:740] T 2a9523aa8663464686254c8412c37e67 P f3a500981b494979b58d2b1041fec9c8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f3a500981b494979b58d2b1041fec9c8, State: Initialized, Role: FOLLOWER
I20260709 13:23:04.770164 15153 raft_consensus.cc:385] T d64d06459b344ff99c0df07c249c3a60 P 0efc951052454eec9a58b0cd025945b8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:23:04.773205 15155 consensus_queue.cc:260] T 53592d0c0a46440dbfcd26f8b8111859 P a1a22e9119494570b6d2217713fd7e43 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } } peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } } peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } }
I20260709 13:23:04.775419 15156 consensus_queue.cc:260] T 2a9523aa8663464686254c8412c37e67 P f3a500981b494979b58d2b1041fec9c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } } peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } } peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } }
I20260709 13:23:04.772476 15153 raft_consensus.cc:740] T d64d06459b344ff99c0df07c249c3a60 P 0efc951052454eec9a58b0cd025945b8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0efc951052454eec9a58b0cd025945b8, State: Initialized, Role: FOLLOWER
I20260709 13:23:04.716676 15434 consensus_queue.cc:1048] T abc01daa220a47fa8578b0d20a17c9ab P a1a22e9119494570b6d2217713fd7e43 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.062s
I20260709 13:23:04.722769 15517 consensus_queue.cc:1048] T 03f377f48e8849adade3945935d300a9 P a1a22e9119494570b6d2217713fd7e43 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.059s
W20260709 13:23:04.722990 15522 log.cc:927] Time spent T abc01daa220a47fa8578b0d20a17c9ab P a722e54d227f4c29a9ed6ce77858003a: Append to log took a long time: real 0.154s	user 0.000s	sys 0.001s
I20260709 13:23:04.792227 15108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e429eefef04d433e8f18dfbc0387068d" candidate_uuid: "a1a22e9119494570b6d2217713fd7e43" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a722e54d227f4c29a9ed6ce77858003a"
I20260709 13:23:04.786484 15153 consensus_queue.cc:260] T d64d06459b344ff99c0df07c249c3a60 P 0efc951052454eec9a58b0cd025945b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } } peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } } peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } }
I20260709 13:23:04.811837 15156 ts_tablet_manager.cc:1434] T 2a9523aa8663464686254c8412c37e67 P f3a500981b494979b58d2b1041fec9c8: Time spent starting tablet: real 0.209s	user 0.009s	sys 0.000s
I20260709 13:23:04.816979 15155 ts_tablet_manager.cc:1434] T 53592d0c0a46440dbfcd26f8b8111859 P a1a22e9119494570b6d2217713fd7e43: Time spent starting tablet: real 0.119s	user 0.008s	sys 0.000s
I20260709 13:23:04.729363 15106 raft_consensus.cc:2468] T 58a622a48cd24833bc5fc27e03114176 P a722e54d227f4c29a9ed6ce77858003a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f3a500981b494979b58d2b1041fec9c8 in term 1.
I20260709 13:23:04.821219 14925 leader_election.cc:304] T 53592d0c0a46440dbfcd26f8b8111859 P 0efc951052454eec9a58b0cd025945b8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0efc951052454eec9a58b0cd025945b8, a722e54d227f4c29a9ed6ce77858003a; no voters: 
I20260709 13:23:04.829919 15211 raft_consensus.cc:2804] T 53592d0c0a46440dbfcd26f8b8111859 P 0efc951052454eec9a58b0cd025945b8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:23:04.830317 15211 raft_consensus.cc:493] T 53592d0c0a46440dbfcd26f8b8111859 P 0efc951052454eec9a58b0cd025945b8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:23:04.830647 15211 raft_consensus.cc:3060] T 53592d0c0a46440dbfcd26f8b8111859 P 0efc951052454eec9a58b0cd025945b8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:23:04.830880 14782 catalog_manager.cc:5697] T e429eefef04d433e8f18dfbc0387068d P a722e54d227f4c29a9ed6ce77858003a reported cstate change: term changed from 1 to 2, leader changed from 0efc951052454eec9a58b0cd025945b8 (127.5.126.66) to a722e54d227f4c29a9ed6ce77858003a (127.5.126.68). New cstate: current_term: 2 leader_uuid: "a722e54d227f4c29a9ed6ce77858003a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } health_report { overall_health: HEALTHY } } }
I20260709 13:23:04.839558 15211 raft_consensus.cc:515] T 53592d0c0a46440dbfcd26f8b8111859 P 0efc951052454eec9a58b0cd025945b8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } } peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } } peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } }
I20260709 13:23:04.749539 15072 leader_election.cc:304] T ad084674821d4137b02efe692068d382 P a722e54d227f4c29a9ed6ce77858003a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1a22e9119494570b6d2217713fd7e43, a722e54d227f4c29a9ed6ce77858003a; no voters: 
I20260709 13:23:04.842700 15153 ts_tablet_manager.cc:1434] T d64d06459b344ff99c0df07c249c3a60 P 0efc951052454eec9a58b0cd025945b8: Time spent starting tablet: real 0.102s	user 0.006s	sys 0.003s
I20260709 13:23:04.845820 15156 tablet_bootstrap.cc:492] T f86a730e237248dc9b91cbb75e29c324 P f3a500981b494979b58d2b1041fec9c8: Bootstrap starting.
I20260709 13:23:04.799348 15517 consensus_queue.cc:1048] T 03f377f48e8849adade3945935d300a9 P a1a22e9119494570b6d2217713fd7e43 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.030s
I20260709 13:23:04.845789 15155 tablet_bootstrap.cc:492] T dee43e01ec5d409b877a5c2dbf5b7b77 P a1a22e9119494570b6d2217713fd7e43: Bootstrap starting.
I20260709 13:23:04.854642 15211 leader_election.cc:290] T 53592d0c0a46440dbfcd26f8b8111859 P 0efc951052454eec9a58b0cd025945b8 [CANDIDATE]: Term 1 election: Requested vote from peers a1a22e9119494570b6d2217713fd7e43 (127.5.126.67:38125), a722e54d227f4c29a9ed6ce77858003a (127.5.126.68:46669)
I20260709 13:23:04.858947 14850 leader_election.cc:304] T 58a622a48cd24833bc5fc27e03114176 P f3a500981b494979b58d2b1041fec9c8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0efc951052454eec9a58b0cd025945b8, f3a500981b494979b58d2b1041fec9c8; no voters: 
W20260709 13:23:04.854337 15072 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:38125, user_credentials={real_user=slave}} blocked reactor thread for 101284us
I20260709 13:23:04.856004 15525 raft_consensus.cc:2804] T ad084674821d4137b02efe692068d382 P a722e54d227f4c29a9ed6ce77858003a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:23:04.863960 15525 raft_consensus.cc:697] T ad084674821d4137b02efe692068d382 P a722e54d227f4c29a9ed6ce77858003a [term 1 LEADER]: Becoming Leader. State: Replica: a722e54d227f4c29a9ed6ce77858003a, State: Running, Role: LEADER
I20260709 13:23:04.864871 15525 consensus_queue.cc:237] T ad084674821d4137b02efe692068d382 P a722e54d227f4c29a9ed6ce77858003a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } } peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } } peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } }
I20260709 13:23:04.862093 15512 raft_consensus.cc:2804] T 58a622a48cd24833bc5fc27e03114176 P f3a500981b494979b58d2b1041fec9c8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:23:04.865913 15512 raft_consensus.cc:697] T 58a622a48cd24833bc5fc27e03114176 P f3a500981b494979b58d2b1041fec9c8 [term 1 LEADER]: Becoming Leader. State: Replica: f3a500981b494979b58d2b1041fec9c8, State: Running, Role: LEADER
I20260709 13:23:04.866793 15512 consensus_queue.cc:237] T 58a622a48cd24833bc5fc27e03114176 P f3a500981b494979b58d2b1041fec9c8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } } peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } } peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } }
W20260709 13:23:04.819420 14924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.67:38125, user_credentials={real_user=slave}} blocked reactor thread for 137676us
I20260709 13:23:04.888746 15153 tablet_bootstrap.cc:492] T b0b7e1c1e67845cb9bd2208bb2fb7c21 P 0efc951052454eec9a58b0cd025945b8: Bootstrap starting.
I20260709 13:23:04.892614 15533 consensus_queue.cc:1048] T 88a7c4171c664e819837994755edf95c P 0efc951052454eec9a58b0cd025945b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:23:04.894627 15031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53592d0c0a46440dbfcd26f8b8111859" candidate_uuid: "0efc951052454eec9a58b0cd025945b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1a22e9119494570b6d2217713fd7e43" is_pre_election: true
I20260709 13:23:04.895552 15031 raft_consensus.cc:2468] T 53592d0c0a46440dbfcd26f8b8111859 P a1a22e9119494570b6d2217713fd7e43 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0efc951052454eec9a58b0cd025945b8 in term 0.
I20260709 13:23:04.898787 15153 tablet_bootstrap.cc:654] T b0b7e1c1e67845cb9bd2208bb2fb7c21 P 0efc951052454eec9a58b0cd025945b8: Neither blocks nor log segments found. Creating new log.
I20260709 13:23:04.894768 15034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53592d0c0a46440dbfcd26f8b8111859" candidate_uuid: "0efc951052454eec9a58b0cd025945b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1a22e9119494570b6d2217713fd7e43"
I20260709 13:23:04.900483 15034 raft_consensus.cc:3060] T 53592d0c0a46440dbfcd26f8b8111859 P a1a22e9119494570b6d2217713fd7e43 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:23:04.926358 15154 tablet_bootstrap.cc:492] T 77e8d8b35cf148e99e8274bf65e5ed05 P a722e54d227f4c29a9ed6ce77858003a: No bootstrap required, opened a new log
I20260709 13:23:04.927062 15154 ts_tablet_manager.cc:1403] T 77e8d8b35cf148e99e8274bf65e5ed05 P a722e54d227f4c29a9ed6ce77858003a: Time spent bootstrapping tablet: real 0.193s	user 0.017s	sys 0.010s
W20260709 13:23:04.949350 14850 consensus_peers.cc:597] T b0b7e1c1e67845cb9bd2208bb2fb7c21 P f3a500981b494979b58d2b1041fec9c8 -> Peer 0efc951052454eec9a58b0cd025945b8 (127.5.126.66:34613): Couldn't send request to peer 0efc951052454eec9a58b0cd025945b8. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:23:04.928472 15107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53592d0c0a46440dbfcd26f8b8111859" candidate_uuid: "0efc951052454eec9a58b0cd025945b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a722e54d227f4c29a9ed6ce77858003a"
I20260709 13:23:04.939801 14958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e429eefef04d433e8f18dfbc0387068d" candidate_uuid: "a1a22e9119494570b6d2217713fd7e43" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0efc951052454eec9a58b0cd025945b8"
I20260709 13:23:04.952163 14959 raft_consensus.cc:3060] T d64d06459b344ff99c0df07c249c3a60 P 0efc951052454eec9a58b0cd025945b8 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:23:04.950085 14924 consensus_peers.cc:597] T 88a7c4171c664e819837994755edf95c P 0efc951052454eec9a58b0cd025945b8 -> Peer a1a22e9119494570b6d2217713fd7e43 (127.5.126.67:38125): Couldn't send request to peer a1a22e9119494570b6d2217713fd7e43. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:23:04.966210 15154 raft_consensus.cc:359] T 77e8d8b35cf148e99e8274bf65e5ed05 P a722e54d227f4c29a9ed6ce77858003a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } } peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } } peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } }
I20260709 13:23:04.974987 15154 raft_consensus.cc:385] T 77e8d8b35cf148e99e8274bf65e5ed05 P a722e54d227f4c29a9ed6ce77858003a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:23:04.975489 15154 raft_consensus.cc:740] T 77e8d8b35cf148e99e8274bf65e5ed05 P a722e54d227f4c29a9ed6ce77858003a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a722e54d227f4c29a9ed6ce77858003a, State: Initialized, Role: FOLLOWER
I20260709 13:23:04.976468 15154 consensus_queue.cc:260] T 77e8d8b35cf148e99e8274bf65e5ed05 P a722e54d227f4c29a9ed6ce77858003a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } } peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } } peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } }
I20260709 13:23:04.958238 15107 raft_consensus.cc:3060] T 53592d0c0a46440dbfcd26f8b8111859 P a722e54d227f4c29a9ed6ce77858003a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:23:04.992691 15154 ts_tablet_manager.cc:1434] T 77e8d8b35cf148e99e8274bf65e5ed05 P a722e54d227f4c29a9ed6ce77858003a: Time spent starting tablet: real 0.065s	user 0.005s	sys 0.004s
I20260709 13:23:04.994207 15154 tablet_bootstrap.cc:492] T 7e29a38455b241239882b6af3eac3d51 P a722e54d227f4c29a9ed6ce77858003a: Bootstrap starting.
I20260709 13:23:04.993906 15512 consensus_queue.cc:1048] T b0b7e1c1e67845cb9bd2208bb2fb7c21 P f3a500981b494979b58d2b1041fec9c8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:23:04.980823 14958 raft_consensus.cc:3060] T e429eefef04d433e8f18dfbc0387068d P 0efc951052454eec9a58b0cd025945b8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:23:05.001847 15153 tablet_bootstrap.cc:492] T b0b7e1c1e67845cb9bd2208bb2fb7c21 P 0efc951052454eec9a58b0cd025945b8: No bootstrap required, opened a new log
I20260709 13:23:05.002478 15153 ts_tablet_manager.cc:1403] T b0b7e1c1e67845cb9bd2208bb2fb7c21 P 0efc951052454eec9a58b0cd025945b8: Time spent bootstrapping tablet: real 0.117s	user 0.010s	sys 0.006s
I20260709 13:23:05.005172 15029 raft_consensus.cc:1240] T e429eefef04d433e8f18dfbc0387068d P a1a22e9119494570b6d2217713fd7e43 [term 3 FOLLOWER]: Rejecting Update request from peer a722e54d227f4c29a9ed6ce77858003a for earlier term 2. Current term is 3. Ops: []
W20260709 13:23:05.009459 14999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.68:46669, user_credentials={real_user=slave}} blocked reactor thread for 44518.1us
I20260709 13:23:05.019183 15526 consensus_queue.cc:1059] T e429eefef04d433e8f18dfbc0387068d P a722e54d227f4c29a9ed6ce77858003a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:23:05.020181 15526 raft_consensus.cc:3055] T e429eefef04d433e8f18dfbc0387068d P a722e54d227f4c29a9ed6ce77858003a [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:23:05.020498 15526 raft_consensus.cc:740] T e429eefef04d433e8f18dfbc0387068d P a722e54d227f4c29a9ed6ce77858003a [term 2 LEADER]: Becoming Follower/Learner. State: Replica: a722e54d227f4c29a9ed6ce77858003a, State: Running, Role: LEADER
I20260709 13:23:05.020926 15156 tablet_bootstrap.cc:654] T f86a730e237248dc9b91cbb75e29c324 P f3a500981b494979b58d2b1041fec9c8: Neither blocks nor log segments found. Creating new log.
I20260709 13:23:05.021358 15526 consensus_queue.cc:260] T e429eefef04d433e8f18dfbc0387068d P a722e54d227f4c29a9ed6ce77858003a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } } peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } } peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } }
I20260709 13:23:05.022742 15526 raft_consensus.cc:3060] T e429eefef04d433e8f18dfbc0387068d P a722e54d227f4c29a9ed6ce77858003a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:23:05.039103 15155 tablet_bootstrap.cc:654] T dee43e01ec5d409b877a5c2dbf5b7b77 P a1a22e9119494570b6d2217713fd7e43: Neither blocks nor log segments found. Creating new log.
I20260709 13:23:05.040308 15153 raft_consensus.cc:359] T b0b7e1c1e67845cb9bd2208bb2fb7c21 P 0efc951052454eec9a58b0cd025945b8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } } peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } } peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } }
I20260709 13:23:05.042023 15153 raft_consensus.cc:385] T b0b7e1c1e67845cb9bd2208bb2fb7c21 P 0efc951052454eec9a58b0cd025945b8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:23:05.042286 15153 raft_consensus.cc:740] T b0b7e1c1e67845cb9bd2208bb2fb7c21 P 0efc951052454eec9a58b0cd025945b8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0efc951052454eec9a58b0cd025945b8, State: Initialized, Role: FOLLOWER
I20260709 13:23:05.042553 15107 raft_consensus.cc:2468] T 53592d0c0a46440dbfcd26f8b8111859 P a722e54d227f4c29a9ed6ce77858003a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0efc951052454eec9a58b0cd025945b8 in term 1.
I20260709 13:23:05.042964 15153 consensus_queue.cc:260] T b0b7e1c1e67845cb9bd2208bb2fb7c21 P 0efc951052454eec9a58b0cd025945b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } } peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } } peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } }
I20260709 13:23:05.045241 14925 leader_election.cc:304] T 53592d0c0a46440dbfcd26f8b8111859 P 0efc951052454eec9a58b0cd025945b8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0efc951052454eec9a58b0cd025945b8, a722e54d227f4c29a9ed6ce77858003a; no voters: 
I20260709 13:23:05.047358 15440 raft_consensus.cc:2804] T 53592d0c0a46440dbfcd26f8b8111859 P 0efc951052454eec9a58b0cd025945b8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:23:05.055802 15153 ts_tablet_manager.cc:1434] T b0b7e1c1e67845cb9bd2208bb2fb7c21 P 0efc951052454eec9a58b0cd025945b8: Time spent starting tablet: real 0.053s	user 0.006s	sys 0.003s
I20260709 13:23:05.047850 15440 raft_consensus.cc:697] T 53592d0c0a46440dbfcd26f8b8111859 P 0efc951052454eec9a58b0cd025945b8 [term 1 LEADER]: Becoming Leader. State: Replica: 0efc951052454eec9a58b0cd025945b8, State: Running, Role: LEADER
I20260709 13:23:05.070863 15153 tablet_bootstrap.cc:492] T 77e8d8b35cf148e99e8274bf65e5ed05 P 0efc951052454eec9a58b0cd025945b8: Bootstrap starting.
I20260709 13:23:05.078116 15154 tablet_bootstrap.cc:654] T 7e29a38455b241239882b6af3eac3d51 P a722e54d227f4c29a9ed6ce77858003a: Neither blocks nor log segments found. Creating new log.
I20260709 13:23:05.092237 15440 consensus_queue.cc:237] T 53592d0c0a46440dbfcd26f8b8111859 P 0efc951052454eec9a58b0cd025945b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } } peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } } peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } }
I20260709 13:23:05.120469 15034 raft_consensus.cc:2468] T 53592d0c0a46440dbfcd26f8b8111859 P a1a22e9119494570b6d2217713fd7e43 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0efc951052454eec9a58b0cd025945b8 in term 1.
I20260709 13:23:05.122411 14958 raft_consensus.cc:2468] T e429eefef04d433e8f18dfbc0387068d P 0efc951052454eec9a58b0cd025945b8 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1a22e9119494570b6d2217713fd7e43 in term 3.
I20260709 13:23:05.137246 15156 tablet_bootstrap.cc:492] T f86a730e237248dc9b91cbb75e29c324 P f3a500981b494979b58d2b1041fec9c8: No bootstrap required, opened a new log
W20260709 13:23:05.139109 14999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.66:34613, user_credentials={real_user=slave}} blocked reactor thread for 109354us
I20260709 13:23:05.139367 15156 ts_tablet_manager.cc:1403] T f86a730e237248dc9b91cbb75e29c324 P f3a500981b494979b58d2b1041fec9c8: Time spent bootstrapping tablet: real 0.312s	user 0.019s	sys 0.011s
I20260709 13:23:05.139390 15211 raft_consensus.cc:493] T d64d06459b344ff99c0df07c249c3a60 P 0efc951052454eec9a58b0cd025945b8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a722e54d227f4c29a9ed6ce77858003a)
I20260709 13:23:05.142185 15211 raft_consensus.cc:515] T d64d06459b344ff99c0df07c249c3a60 P 0efc951052454eec9a58b0cd025945b8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } } peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } } peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } }
I20260709 13:23:05.151927 15153 tablet_bootstrap.cc:654] T 77e8d8b35cf148e99e8274bf65e5ed05 P 0efc951052454eec9a58b0cd025945b8: Neither blocks nor log segments found. Creating new log.
I20260709 13:23:05.197037 15363 raft_consensus.cc:493] T 2a9523aa8663464686254c8412c37e67 P f3a500981b494979b58d2b1041fec9c8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:23:05.197736 15363 raft_consensus.cc:515] T 2a9523aa8663464686254c8412c37e67 P f3a500981b494979b58d2b1041fec9c8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } } peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } } peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } }
I20260709 13:23:05.200614 15363 leader_election.cc:290] T 2a9523aa8663464686254c8412c37e67 P f3a500981b494979b58d2b1041fec9c8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a722e54d227f4c29a9ed6ce77858003a (127.5.126.68:46669), 0efc951052454eec9a58b0cd025945b8 (127.5.126.66:34613)
I20260709 13:23:05.215093 15156 raft_consensus.cc:359] T f86a730e237248dc9b91cbb75e29c324 P f3a500981b494979b58d2b1041fec9c8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } } peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } } peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } }
I20260709 13:23:05.216168 15156 raft_consensus.cc:385] T f86a730e237248dc9b91cbb75e29c324 P f3a500981b494979b58d2b1041fec9c8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:23:05.216509 15156 raft_consensus.cc:740] T f86a730e237248dc9b91cbb75e29c324 P f3a500981b494979b58d2b1041fec9c8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f3a500981b494979b58d2b1041fec9c8, State: Initialized, Role: FOLLOWER
I20260709 13:23:05.218963 15156 consensus_queue.cc:260] T f86a730e237248dc9b91cbb75e29c324 P f3a500981b494979b58d2b1041fec9c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } } peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } } peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } }
I20260709 13:23:05.231986 15211 leader_election.cc:290] T d64d06459b344ff99c0df07c249c3a60 P 0efc951052454eec9a58b0cd025945b8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a722e54d227f4c29a9ed6ce77858003a (127.5.126.68:46669), f3a500981b494979b58d2b1041fec9c8 (127.5.126.65:34129)
W20260709 13:23:05.231778 14999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.65:34129, user_credentials={real_user=slave}} blocked reactor thread for 81312.2us
I20260709 13:23:05.238023 15156 ts_tablet_manager.cc:1434] T f86a730e237248dc9b91cbb75e29c324 P f3a500981b494979b58d2b1041fec9c8: Time spent starting tablet: real 0.096s	user 0.008s	sys 0.004s
I20260709 13:23:05.251346 14999 leader_election.cc:304] T e429eefef04d433e8f18dfbc0387068d P a1a22e9119494570b6d2217713fd7e43 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0efc951052454eec9a58b0cd025945b8, a1a22e9119494570b6d2217713fd7e43; no voters: a722e54d227f4c29a9ed6ce77858003a
I20260709 13:23:05.257231 15155 tablet_bootstrap.cc:492] T dee43e01ec5d409b877a5c2dbf5b7b77 P a1a22e9119494570b6d2217713fd7e43: No bootstrap required, opened a new log
I20260709 13:23:05.257776 15155 ts_tablet_manager.cc:1403] T dee43e01ec5d409b877a5c2dbf5b7b77 P a1a22e9119494570b6d2217713fd7e43: Time spent bootstrapping tablet: real 0.427s	user 0.023s	sys 0.009s
I20260709 13:23:05.275481 15108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a9523aa8663464686254c8412c37e67" candidate_uuid: "f3a500981b494979b58d2b1041fec9c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a722e54d227f4c29a9ed6ce77858003a" is_pre_election: true
I20260709 13:23:05.285614 15559 raft_consensus.cc:2804] T e429eefef04d433e8f18dfbc0387068d P a1a22e9119494570b6d2217713fd7e43 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:23:05.286361 15559 raft_consensus.cc:697] T e429eefef04d433e8f18dfbc0387068d P a1a22e9119494570b6d2217713fd7e43 [term 3 LEADER]: Becoming Leader. State: Replica: a1a22e9119494570b6d2217713fd7e43, State: Running, Role: LEADER
I20260709 13:23:05.287420 15559 consensus_queue.cc:237] T e429eefef04d433e8f18dfbc0387068d P a1a22e9119494570b6d2217713fd7e43 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } } peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } } peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } }
I20260709 13:23:05.293715 15108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d64d06459b344ff99c0df07c249c3a60" candidate_uuid: "0efc951052454eec9a58b0cd025945b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a722e54d227f4c29a9ed6ce77858003a" is_pre_election: true
I20260709 13:23:05.283779 15156 tablet_bootstrap.cc:492] T dee43e01ec5d409b877a5c2dbf5b7b77 P f3a500981b494979b58d2b1041fec9c8: Bootstrap starting.
W20260709 13:23:05.297482 14850 leader_election.cc:343] T 2a9523aa8663464686254c8412c37e67 P f3a500981b494979b58d2b1041fec9c8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a722e54d227f4c29a9ed6ce77858003a (127.5.126.68:46669): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:23:05.303042 15155 raft_consensus.cc:359] T dee43e01ec5d409b877a5c2dbf5b7b77 P a1a22e9119494570b6d2217713fd7e43 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } } peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } } peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } }
I20260709 13:23:05.304024 15154 tablet_bootstrap.cc:492] T 7e29a38455b241239882b6af3eac3d51 P a722e54d227f4c29a9ed6ce77858003a: No bootstrap required, opened a new log
I20260709 13:23:05.304107 15155 raft_consensus.cc:385] T dee43e01ec5d409b877a5c2dbf5b7b77 P a1a22e9119494570b6d2217713fd7e43 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:23:05.305032 15154 ts_tablet_manager.cc:1403] T 7e29a38455b241239882b6af3eac3d51 P a722e54d227f4c29a9ed6ce77858003a: Time spent bootstrapping tablet: real 0.311s	user 0.019s	sys 0.022s
I20260709 13:23:05.304930 15155 raft_consensus.cc:740] T dee43e01ec5d409b877a5c2dbf5b7b77 P a1a22e9119494570b6d2217713fd7e43 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a1a22e9119494570b6d2217713fd7e43, State: Initialized, Role: FOLLOWER
I20260709 13:23:05.306988 15155 consensus_queue.cc:260] T dee43e01ec5d409b877a5c2dbf5b7b77 P a1a22e9119494570b6d2217713fd7e43 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } } peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } } peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } }
I20260709 13:23:05.311182 14958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a9523aa8663464686254c8412c37e67" candidate_uuid: "f3a500981b494979b58d2b1041fec9c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0efc951052454eec9a58b0cd025945b8" is_pre_election: true
W20260709 13:23:05.313097 14999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.66:34613, user_credentials={real_user=slave}} blocked reactor thread for 52476.2us
I20260709 13:23:05.293773 14885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d64d06459b344ff99c0df07c249c3a60" candidate_uuid: "0efc951052454eec9a58b0cd025945b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f3a500981b494979b58d2b1041fec9c8" is_pre_election: true
I20260709 13:23:05.316838 15153 tablet_bootstrap.cc:492] T 77e8d8b35cf148e99e8274bf65e5ed05 P 0efc951052454eec9a58b0cd025945b8: No bootstrap required, opened a new log
I20260709 13:23:05.317770 15153 ts_tablet_manager.cc:1403] T 77e8d8b35cf148e99e8274bf65e5ed05 P 0efc951052454eec9a58b0cd025945b8: Time spent bootstrapping tablet: real 0.247s	user 0.021s	sys 0.013s
I20260709 13:23:05.321581 15153 raft_consensus.cc:359] T 77e8d8b35cf148e99e8274bf65e5ed05 P 0efc951052454eec9a58b0cd025945b8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } } peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } } peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } }
I20260709 13:23:05.322372 15153 raft_consensus.cc:385] T 77e8d8b35cf148e99e8274bf65e5ed05 P 0efc951052454eec9a58b0cd025945b8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:23:05.322672 15153 raft_consensus.cc:740] T 77e8d8b35cf148e99e8274bf65e5ed05 P 0efc951052454eec9a58b0cd025945b8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0efc951052454eec9a58b0cd025945b8, State: Initialized, Role: FOLLOWER
I20260709 13:23:05.323633 15153 consensus_queue.cc:260] T 77e8d8b35cf148e99e8274bf65e5ed05 P 0efc951052454eec9a58b0cd025945b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } } peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } } peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } }
I20260709 13:23:05.326821 15153 ts_tablet_manager.cc:1434] T 77e8d8b35cf148e99e8274bf65e5ed05 P 0efc951052454eec9a58b0cd025945b8: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.002s
I20260709 13:23:05.328109 15153 tablet_bootstrap.cc:492] T 7e29a38455b241239882b6af3eac3d51 P 0efc951052454eec9a58b0cd025945b8: Bootstrap starting.
I20260709 13:23:05.316792 15155 ts_tablet_manager.cc:1434] T dee43e01ec5d409b877a5c2dbf5b7b77 P a1a22e9119494570b6d2217713fd7e43: Time spent starting tablet: real 0.059s	user 0.007s	sys 0.001s
I20260709 13:23:05.329389 14925 leader_election.cc:304] T d64d06459b344ff99c0df07c249c3a60 P 0efc951052454eec9a58b0cd025945b8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0efc951052454eec9a58b0cd025945b8; no voters: a722e54d227f4c29a9ed6ce77858003a, f3a500981b494979b58d2b1041fec9c8
I20260709 13:23:05.301851 15508 raft_consensus.cc:493] T 77e8d8b35cf148e99e8274bf65e5ed05 P a722e54d227f4c29a9ed6ce77858003a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:23:05.330430 15508 raft_consensus.cc:515] T 77e8d8b35cf148e99e8274bf65e5ed05 P a722e54d227f4c29a9ed6ce77858003a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } } peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } } peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } }
I20260709 13:23:05.330742 15464 raft_consensus.cc:2749] T d64d06459b344ff99c0df07c249c3a60 P 0efc951052454eec9a58b0cd025945b8 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:23:05.333038 15508 leader_election.cc:290] T 77e8d8b35cf148e99e8274bf65e5ed05 P a722e54d227f4c29a9ed6ce77858003a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f3a500981b494979b58d2b1041fec9c8 (127.5.126.65:34129), 0efc951052454eec9a58b0cd025945b8 (127.5.126.66:34613)
I20260709 13:23:05.334077 14885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77e8d8b35cf148e99e8274bf65e5ed05" candidate_uuid: "a722e54d227f4c29a9ed6ce77858003a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f3a500981b494979b58d2b1041fec9c8" is_pre_election: true
I20260709 13:23:05.334820 14885 raft_consensus.cc:2468] T 77e8d8b35cf148e99e8274bf65e5ed05 P f3a500981b494979b58d2b1041fec9c8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a722e54d227f4c29a9ed6ce77858003a in term 0.
I20260709 13:23:05.335575 15153 tablet_bootstrap.cc:654] T 7e29a38455b241239882b6af3eac3d51 P 0efc951052454eec9a58b0cd025945b8: Neither blocks nor log segments found. Creating new log.
I20260709 13:23:05.337873 15155 tablet_bootstrap.cc:492] T 7e29a38455b241239882b6af3eac3d51 P a1a22e9119494570b6d2217713fd7e43: Bootstrap starting.
I20260709 13:23:05.336108 15073 leader_election.cc:304] T 77e8d8b35cf148e99e8274bf65e5ed05 P a722e54d227f4c29a9ed6ce77858003a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a722e54d227f4c29a9ed6ce77858003a, f3a500981b494979b58d2b1041fec9c8; no voters: 
I20260709 13:23:05.341970 15474 raft_consensus.cc:2804] T 77e8d8b35cf148e99e8274bf65e5ed05 P a722e54d227f4c29a9ed6ce77858003a [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260709 13:23:05.362385 14830 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:23:05.360744 15474 raft_consensus.cc:493] T 77e8d8b35cf148e99e8274bf65e5ed05 P a722e54d227f4c29a9ed6ce77858003a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:23:05.366551 15474 raft_consensus.cc:3060] T 77e8d8b35cf148e99e8274bf65e5ed05 P a722e54d227f4c29a9ed6ce77858003a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:23:05.369930 15155 tablet_bootstrap.cc:654] T 7e29a38455b241239882b6af3eac3d51 P a1a22e9119494570b6d2217713fd7e43: Neither blocks nor log segments found. Creating new log.
W20260709 13:23:05.370736 14850 leader_election.cc:343] T 2a9523aa8663464686254c8412c37e67 P f3a500981b494979b58d2b1041fec9c8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0efc951052454eec9a58b0cd025945b8 (127.5.126.66:34613): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:23:05.371289 14850 leader_election.cc:304] T 2a9523aa8663464686254c8412c37e67 P f3a500981b494979b58d2b1041fec9c8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f3a500981b494979b58d2b1041fec9c8; no voters: 0efc951052454eec9a58b0cd025945b8, a722e54d227f4c29a9ed6ce77858003a
I20260709 13:23:05.372515 15385 raft_consensus.cc:2749] T 2a9523aa8663464686254c8412c37e67 P f3a500981b494979b58d2b1041fec9c8 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:23:05.377036 14780 catalog_manager.cc:5697] T 53592d0c0a46440dbfcd26f8b8111859 P 0efc951052454eec9a58b0cd025945b8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0efc951052454eec9a58b0cd025945b8 (127.5.126.66). New cstate: current_term: 1 leader_uuid: "0efc951052454eec9a58b0cd025945b8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } health_report { overall_health: UNKNOWN } } }
I20260709 13:23:05.380887 15474 raft_consensus.cc:515] T 77e8d8b35cf148e99e8274bf65e5ed05 P a722e54d227f4c29a9ed6ce77858003a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } } peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } } peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } }
I20260709 13:23:05.383189 14958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77e8d8b35cf148e99e8274bf65e5ed05" candidate_uuid: "a722e54d227f4c29a9ed6ce77858003a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0efc951052454eec9a58b0cd025945b8" is_pre_election: true
I20260709 13:23:05.384142 14958 raft_consensus.cc:2468] T 77e8d8b35cf148e99e8274bf65e5ed05 P 0efc951052454eec9a58b0cd025945b8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a722e54d227f4c29a9ed6ce77858003a in term 0.
I20260709 13:23:05.384299 15385 consensus_queue.cc:1048] T 58a622a48cd24833bc5fc27e03114176 P f3a500981b494979b58d2b1041fec9c8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:23:05.384617 15474 leader_election.cc:290] T 77e8d8b35cf148e99e8274bf65e5ed05 P a722e54d227f4c29a9ed6ce77858003a [CANDIDATE]: Term 1 election: Requested vote from peers f3a500981b494979b58d2b1041fec9c8 (127.5.126.65:34129), 0efc951052454eec9a58b0cd025945b8 (127.5.126.66:34613)
I20260709 13:23:05.385139 15156 tablet_bootstrap.cc:654] T dee43e01ec5d409b877a5c2dbf5b7b77 P f3a500981b494979b58d2b1041fec9c8: Neither blocks nor log segments found. Creating new log.
I20260709 13:23:05.402936 14885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77e8d8b35cf148e99e8274bf65e5ed05" candidate_uuid: "a722e54d227f4c29a9ed6ce77858003a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f3a500981b494979b58d2b1041fec9c8"
I20260709 13:23:05.403681 14885 raft_consensus.cc:3060] T 77e8d8b35cf148e99e8274bf65e5ed05 P f3a500981b494979b58d2b1041fec9c8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:23:05.398537 15154 raft_consensus.cc:359] T 7e29a38455b241239882b6af3eac3d51 P a722e54d227f4c29a9ed6ce77858003a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } } peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } } peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } }
I20260709 13:23:05.405387 15154 raft_consensus.cc:385] T 7e29a38455b241239882b6af3eac3d51 P a722e54d227f4c29a9ed6ce77858003a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:23:05.409945 15154 raft_consensus.cc:740] T 7e29a38455b241239882b6af3eac3d51 P a722e54d227f4c29a9ed6ce77858003a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a722e54d227f4c29a9ed6ce77858003a, State: Initialized, Role: FOLLOWER
I20260709 13:23:05.420241 15154 consensus_queue.cc:260] T 7e29a38455b241239882b6af3eac3d51 P a722e54d227f4c29a9ed6ce77858003a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } } peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } } peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } }
I20260709 13:23:05.434338 15154 ts_tablet_manager.cc:1434] T 7e29a38455b241239882b6af3eac3d51 P a722e54d227f4c29a9ed6ce77858003a: Time spent starting tablet: real 0.129s	user 0.013s	sys 0.001s
I20260709 13:23:05.437534 15154 tablet_bootstrap.cc:492] T f86a730e237248dc9b91cbb75e29c324 P a722e54d227f4c29a9ed6ce77858003a: Bootstrap starting.
I20260709 13:23:05.447671 15154 tablet_bootstrap.cc:654] T f86a730e237248dc9b91cbb75e29c324 P a722e54d227f4c29a9ed6ce77858003a: Neither blocks nor log segments found. Creating new log.
I20260709 13:23:05.449359 14885 raft_consensus.cc:2468] T 77e8d8b35cf148e99e8274bf65e5ed05 P f3a500981b494979b58d2b1041fec9c8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a722e54d227f4c29a9ed6ce77858003a in term 1.
I20260709 13:23:05.452734 15507 raft_consensus.cc:493] T dee43e01ec5d409b877a5c2dbf5b7b77 P a1a22e9119494570b6d2217713fd7e43 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:23:05.458343 15474 raft_consensus.cc:493] T 7e29a38455b241239882b6af3eac3d51 P a722e54d227f4c29a9ed6ce77858003a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:23:05.464437 15474 raft_consensus.cc:515] T 7e29a38455b241239882b6af3eac3d51 P a722e54d227f4c29a9ed6ce77858003a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } } peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } } peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } }
I20260709 13:23:05.458568 15507 raft_consensus.cc:515] T dee43e01ec5d409b877a5c2dbf5b7b77 P a1a22e9119494570b6d2217713fd7e43 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } } peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } } peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } }
I20260709 13:23:05.470289 15507 leader_election.cc:290] T dee43e01ec5d409b877a5c2dbf5b7b77 P a1a22e9119494570b6d2217713fd7e43 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a722e54d227f4c29a9ed6ce77858003a (127.5.126.68:46669), f3a500981b494979b58d2b1041fec9c8 (127.5.126.65:34129)
I20260709 13:23:05.470918 15474 leader_election.cc:290] T 7e29a38455b241239882b6af3eac3d51 P a722e54d227f4c29a9ed6ce77858003a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0efc951052454eec9a58b0cd025945b8 (127.5.126.66:34613), a1a22e9119494570b6d2217713fd7e43 (127.5.126.67:38125)
I20260709 13:23:05.475438 14953 raft_consensus.cc:3060] T b0b7e1c1e67845cb9bd2208bb2fb7c21 P 0efc951052454eec9a58b0cd025945b8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:23:05.481623 14958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77e8d8b35cf148e99e8274bf65e5ed05" candidate_uuid: "a722e54d227f4c29a9ed6ce77858003a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0efc951052454eec9a58b0cd025945b8"
I20260709 13:23:05.482692 14958 raft_consensus.cc:3060] T 77e8d8b35cf148e99e8274bf65e5ed05 P 0efc951052454eec9a58b0cd025945b8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:23:05.482314 15530 consensus_queue.cc:1048] T 58a622a48cd24833bc5fc27e03114176 P f3a500981b494979b58d2b1041fec9c8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:23:05.499331 14885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dee43e01ec5d409b877a5c2dbf5b7b77" candidate_uuid: "a1a22e9119494570b6d2217713fd7e43" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f3a500981b494979b58d2b1041fec9c8" is_pre_election: true
I20260709 13:23:05.508919 14958 raft_consensus.cc:2468] T 77e8d8b35cf148e99e8274bf65e5ed05 P 0efc951052454eec9a58b0cd025945b8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a722e54d227f4c29a9ed6ce77858003a in term 1.
I20260709 13:23:05.519497 15155 tablet_bootstrap.cc:492] T 7e29a38455b241239882b6af3eac3d51 P a1a22e9119494570b6d2217713fd7e43: No bootstrap required, opened a new log
I20260709 13:23:05.521494 15155 ts_tablet_manager.cc:1403] T 7e29a38455b241239882b6af3eac3d51 P a1a22e9119494570b6d2217713fd7e43: Time spent bootstrapping tablet: real 0.184s	user 0.053s	sys 0.049s
I20260709 13:23:05.521905 15154 tablet_bootstrap.cc:492] T f86a730e237248dc9b91cbb75e29c324 P a722e54d227f4c29a9ed6ce77858003a: No bootstrap required, opened a new log
I20260709 13:23:05.522475 15154 ts_tablet_manager.cc:1403] T f86a730e237248dc9b91cbb75e29c324 P a722e54d227f4c29a9ed6ce77858003a: Time spent bootstrapping tablet: real 0.085s	user 0.011s	sys 0.003s
I20260709 13:23:05.524493 15155 raft_consensus.cc:359] T 7e29a38455b241239882b6af3eac3d51 P a1a22e9119494570b6d2217713fd7e43 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } } peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } } peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } }
I20260709 13:23:05.525410 15155 raft_consensus.cc:385] T 7e29a38455b241239882b6af3eac3d51 P a1a22e9119494570b6d2217713fd7e43 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:23:05.525727 15155 raft_consensus.cc:740] T 7e29a38455b241239882b6af3eac3d51 P a1a22e9119494570b6d2217713fd7e43 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a1a22e9119494570b6d2217713fd7e43, State: Initialized, Role: FOLLOWER
I20260709 13:23:05.526075 15154 raft_consensus.cc:359] T f86a730e237248dc9b91cbb75e29c324 P a722e54d227f4c29a9ed6ce77858003a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } } peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } } peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } }
I20260709 13:23:05.526515 15155 consensus_queue.cc:260] T 7e29a38455b241239882b6af3eac3d51 P a1a22e9119494570b6d2217713fd7e43 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } } peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } } peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } }
I20260709 13:23:05.527086 15154 raft_consensus.cc:385] T f86a730e237248dc9b91cbb75e29c324 P a722e54d227f4c29a9ed6ce77858003a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:23:05.527519 15154 raft_consensus.cc:740] T f86a730e237248dc9b91cbb75e29c324 P a722e54d227f4c29a9ed6ce77858003a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a722e54d227f4c29a9ed6ce77858003a, State: Initialized, Role: FOLLOWER
I20260709 13:23:05.528280 15154 consensus_queue.cc:260] T f86a730e237248dc9b91cbb75e29c324 P a722e54d227f4c29a9ed6ce77858003a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } } peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } } peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } }
I20260709 13:23:05.530370 15154 ts_tablet_manager.cc:1434] T f86a730e237248dc9b91cbb75e29c324 P a722e54d227f4c29a9ed6ce77858003a: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.002s
I20260709 13:23:05.529925 15155 ts_tablet_manager.cc:1434] T 7e29a38455b241239882b6af3eac3d51 P a1a22e9119494570b6d2217713fd7e43: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:23:05.532002 15154 tablet_bootstrap.cc:492] T af00ad02fba64998bb25991f6f69f291 P a722e54d227f4c29a9ed6ce77858003a: Bootstrap starting.
I20260709 13:23:05.533448 15155 tablet_bootstrap.cc:492] T a2de4fecd70240dd8ed436fa8de65773 P a1a22e9119494570b6d2217713fd7e43: Bootstrap starting.
I20260709 13:23:05.530622 15474 raft_consensus.cc:493] T f86a730e237248dc9b91cbb75e29c324 P a722e54d227f4c29a9ed6ce77858003a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:23:05.520363 15153 tablet_bootstrap.cc:492] T 7e29a38455b241239882b6af3eac3d51 P 0efc951052454eec9a58b0cd025945b8: No bootstrap required, opened a new log
I20260709 13:23:05.539320 15153 ts_tablet_manager.cc:1403] T 7e29a38455b241239882b6af3eac3d51 P 0efc951052454eec9a58b0cd025945b8: Time spent bootstrapping tablet: real 0.212s	user 0.036s	sys 0.046s
I20260709 13:23:05.539778 15154 tablet_bootstrap.cc:654] T af00ad02fba64998bb25991f6f69f291 P a722e54d227f4c29a9ed6ce77858003a: Neither blocks nor log segments found. Creating new log.
I20260709 13:23:05.540948 15155 tablet_bootstrap.cc:654] T a2de4fecd70240dd8ed436fa8de65773 P a1a22e9119494570b6d2217713fd7e43: Neither blocks nor log segments found. Creating new log.
I20260709 13:23:05.542910 15153 raft_consensus.cc:359] T 7e29a38455b241239882b6af3eac3d51 P 0efc951052454eec9a58b0cd025945b8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } } peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } } peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } }
I20260709 13:23:05.545186 15153 raft_consensus.cc:385] T 7e29a38455b241239882b6af3eac3d51 P 0efc951052454eec9a58b0cd025945b8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:23:05.545665 15153 raft_consensus.cc:740] T 7e29a38455b241239882b6af3eac3d51 P 0efc951052454eec9a58b0cd025945b8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0efc951052454eec9a58b0cd025945b8, State: Initialized, Role: FOLLOWER
I20260709 13:23:05.544252 15474 raft_consensus.cc:515] T f86a730e237248dc9b91cbb75e29c324 P a722e54d227f4c29a9ed6ce77858003a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } } peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } } peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } }
I20260709 13:23:05.549695 15153 consensus_queue.cc:260] T 7e29a38455b241239882b6af3eac3d51 P 0efc951052454eec9a58b0cd025945b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } } peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } } peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } }
I20260709 13:23:05.552198 14959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e29a38455b241239882b6af3eac3d51" candidate_uuid: "a722e54d227f4c29a9ed6ce77858003a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0efc951052454eec9a58b0cd025945b8" is_pre_election: true
I20260709 13:23:05.552193 15474 leader_election.cc:290] T f86a730e237248dc9b91cbb75e29c324 P a722e54d227f4c29a9ed6ce77858003a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a1a22e9119494570b6d2217713fd7e43 (127.5.126.67:38125), f3a500981b494979b58d2b1041fec9c8 (127.5.126.65:34129)
I20260709 13:23:05.553850 14959 raft_consensus.cc:2468] T 7e29a38455b241239882b6af3eac3d51 P 0efc951052454eec9a58b0cd025945b8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a722e54d227f4c29a9ed6ce77858003a in term 0.
I20260709 13:23:05.555650 15153 ts_tablet_manager.cc:1434] T 7e29a38455b241239882b6af3eac3d51 P 0efc951052454eec9a58b0cd025945b8: Time spent starting tablet: real 0.016s	user 0.005s	sys 0.003s
I20260709 13:23:05.559559 15153 tablet_bootstrap.cc:492] T a2de4fecd70240dd8ed436fa8de65773 P 0efc951052454eec9a58b0cd025945b8: Bootstrap starting.
W20260709 13:23:05.565945 14999 leader_election.cc:343] T dee43e01ec5d409b877a5c2dbf5b7b77 P a1a22e9119494570b6d2217713fd7e43 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f3a500981b494979b58d2b1041fec9c8 (127.5.126.65:34129): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:23:05.575042 15153 tablet_bootstrap.cc:654] T a2de4fecd70240dd8ed436fa8de65773 P 0efc951052454eec9a58b0cd025945b8: Neither blocks nor log segments found. Creating new log.
I20260709 13:23:05.585747 15073 leader_election.cc:304] T 77e8d8b35cf148e99e8274bf65e5ed05 P a722e54d227f4c29a9ed6ce77858003a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0efc951052454eec9a58b0cd025945b8, a722e54d227f4c29a9ed6ce77858003a; no voters: 
I20260709 13:23:05.592368 15153 tablet_bootstrap.cc:492] T a2de4fecd70240dd8ed436fa8de65773 P 0efc951052454eec9a58b0cd025945b8: No bootstrap required, opened a new log
I20260709 13:23:05.593312 15153 ts_tablet_manager.cc:1403] T a2de4fecd70240dd8ed436fa8de65773 P 0efc951052454eec9a58b0cd025945b8: Time spent bootstrapping tablet: real 0.034s	user 0.020s	sys 0.003s
I20260709 13:23:05.607540 15153 raft_consensus.cc:359] T a2de4fecd70240dd8ed436fa8de65773 P 0efc951052454eec9a58b0cd025945b8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } } peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } } peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } }
I20260709 13:23:05.612112 15153 raft_consensus.cc:385] T a2de4fecd70240dd8ed436fa8de65773 P 0efc951052454eec9a58b0cd025945b8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:23:05.613132 15153 raft_consensus.cc:740] T a2de4fecd70240dd8ed436fa8de65773 P 0efc951052454eec9a58b0cd025945b8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0efc951052454eec9a58b0cd025945b8, State: Initialized, Role: FOLLOWER
I20260709 13:23:05.616819 15530 raft_consensus.cc:493] T f86a730e237248dc9b91cbb75e29c324 P f3a500981b494979b58d2b1041fec9c8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:23:05.616302 15153 consensus_queue.cc:260] T a2de4fecd70240dd8ed436fa8de65773 P 0efc951052454eec9a58b0cd025945b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } } peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } } peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } }
I20260709 13:23:05.618870 15530 raft_consensus.cc:515] T f86a730e237248dc9b91cbb75e29c324 P f3a500981b494979b58d2b1041fec9c8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } } peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } } peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } }
I20260709 13:23:05.622349 15153 ts_tablet_manager.cc:1434] T a2de4fecd70240dd8ed436fa8de65773 P 0efc951052454eec9a58b0cd025945b8: Time spent starting tablet: real 0.029s	user 0.008s	sys 0.000s
I20260709 13:23:05.624890 15530 leader_election.cc:290] T f86a730e237248dc9b91cbb75e29c324 P f3a500981b494979b58d2b1041fec9c8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a1a22e9119494570b6d2217713fd7e43 (127.5.126.67:38125), a722e54d227f4c29a9ed6ce77858003a (127.5.126.68:46669)
I20260709 13:23:05.626487 15034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86a730e237248dc9b91cbb75e29c324" candidate_uuid: "f3a500981b494979b58d2b1041fec9c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1a22e9119494570b6d2217713fd7e43" is_pre_election: true
I20260709 13:23:05.627731 15153 tablet_bootstrap.cc:492] T affcb03ab55349748a95c103059d2955 P 0efc951052454eec9a58b0cd025945b8: Bootstrap starting.
I20260709 13:23:05.639259 15108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86a730e237248dc9b91cbb75e29c324" candidate_uuid: "f3a500981b494979b58d2b1041fec9c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a722e54d227f4c29a9ed6ce77858003a" is_pre_election: true
I20260709 13:23:05.640455 15108 raft_consensus.cc:2468] T f86a730e237248dc9b91cbb75e29c324 P a722e54d227f4c29a9ed6ce77858003a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f3a500981b494979b58d2b1041fec9c8 in term 0.
I20260709 13:23:05.640738 15153 tablet_bootstrap.cc:654] T affcb03ab55349748a95c103059d2955 P 0efc951052454eec9a58b0cd025945b8: Neither blocks nor log segments found. Creating new log.
W20260709 13:23:05.649477 14999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.65:34129, user_credentials={real_user=slave}} blocked reactor thread for 82496.5us
I20260709 13:23:05.627766 15034 raft_consensus.cc:2468] T f86a730e237248dc9b91cbb75e29c324 P a1a22e9119494570b6d2217713fd7e43 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f3a500981b494979b58d2b1041fec9c8 in term 0.
I20260709 13:23:05.653975 14849 leader_election.cc:304] T f86a730e237248dc9b91cbb75e29c324 P f3a500981b494979b58d2b1041fec9c8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1a22e9119494570b6d2217713fd7e43, f3a500981b494979b58d2b1041fec9c8; no voters: 
I20260709 13:23:05.662214 15440 consensus_queue.cc:1048] T 53592d0c0a46440dbfcd26f8b8111859 P 0efc951052454eec9a58b0cd025945b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:23:05.667454 15539 raft_consensus.cc:2804] T 77e8d8b35cf148e99e8274bf65e5ed05 P a722e54d227f4c29a9ed6ce77858003a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:23:05.668123 15539 raft_consensus.cc:697] T 77e8d8b35cf148e99e8274bf65e5ed05 P a722e54d227f4c29a9ed6ce77858003a [term 1 LEADER]: Becoming Leader. State: Replica: a722e54d227f4c29a9ed6ce77858003a, State: Running, Role: LEADER
I20260709 13:23:05.669013 15539 consensus_queue.cc:237] T 77e8d8b35cf148e99e8274bf65e5ed05 P a722e54d227f4c29a9ed6ce77858003a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } } peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } } peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } }
W20260709 13:23:05.672892 15073 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.66:34613, user_credentials={real_user=slave}} blocked reactor thread for 87273.5us
I20260709 13:23:05.658281 15530 raft_consensus.cc:2804] T f86a730e237248dc9b91cbb75e29c324 P f3a500981b494979b58d2b1041fec9c8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:23:05.712170 15073 leader_election.cc:304] T 7e29a38455b241239882b6af3eac3d51 P a722e54d227f4c29a9ed6ce77858003a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0efc951052454eec9a58b0cd025945b8, a722e54d227f4c29a9ed6ce77858003a; no voters: 
I20260709 13:23:05.695502 15530 raft_consensus.cc:493] T f86a730e237248dc9b91cbb75e29c324 P f3a500981b494979b58d2b1041fec9c8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:23:05.720356 15474 raft_consensus.cc:2804] T 7e29a38455b241239882b6af3eac3d51 P a722e54d227f4c29a9ed6ce77858003a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:23:05.726442 15474 raft_consensus.cc:493] T 7e29a38455b241239882b6af3eac3d51 P a722e54d227f4c29a9ed6ce77858003a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:23:05.726871 15474 raft_consensus.cc:3060] T 7e29a38455b241239882b6af3eac3d51 P a722e54d227f4c29a9ed6ce77858003a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:23:05.743275 14959 raft_consensus.cc:1275] T e429eefef04d433e8f18dfbc0387068d P 0efc951052454eec9a58b0cd025945b8 [term 3 FOLLOWER]: Refusing update from remote peer a1a22e9119494570b6d2217713fd7e43: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:23:05.724833 15530 raft_consensus.cc:3060] T f86a730e237248dc9b91cbb75e29c324 P f3a500981b494979b58d2b1041fec9c8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:23:05.752573 15153 tablet_bootstrap.cc:492] T affcb03ab55349748a95c103059d2955 P 0efc951052454eec9a58b0cd025945b8: No bootstrap required, opened a new log
I20260709 13:23:05.753398 15153 ts_tablet_manager.cc:1403] T affcb03ab55349748a95c103059d2955 P 0efc951052454eec9a58b0cd025945b8: Time spent bootstrapping tablet: real 0.126s	user 0.034s	sys 0.011s
I20260709 13:23:05.747767 15156 tablet_bootstrap.cc:492] T dee43e01ec5d409b877a5c2dbf5b7b77 P f3a500981b494979b58d2b1041fec9c8: No bootstrap required, opened a new log
I20260709 13:23:05.755187 15156 ts_tablet_manager.cc:1403] T dee43e01ec5d409b877a5c2dbf5b7b77 P f3a500981b494979b58d2b1041fec9c8: Time spent bootstrapping tablet: real 0.472s	user 0.013s	sys 0.009s
W20260709 13:23:05.775096 15073 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.65:34129, user_credentials={real_user=slave}} blocked reactor thread for 44447.1us
I20260709 13:23:05.778283 15106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dee43e01ec5d409b877a5c2dbf5b7b77" candidate_uuid: "a1a22e9119494570b6d2217713fd7e43" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a722e54d227f4c29a9ed6ce77858003a" is_pre_election: true
I20260709 13:23:05.783188 15434 consensus_queue.cc:1048] T e429eefef04d433e8f18dfbc0387068d P a1a22e9119494570b6d2217713fd7e43 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:23:05.789714 15032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86a730e237248dc9b91cbb75e29c324" candidate_uuid: "a722e54d227f4c29a9ed6ce77858003a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1a22e9119494570b6d2217713fd7e43" is_pre_election: true
I20260709 13:23:05.790419 15032 raft_consensus.cc:2468] T f86a730e237248dc9b91cbb75e29c324 P a1a22e9119494570b6d2217713fd7e43 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a722e54d227f4c29a9ed6ce77858003a in term 0.
I20260709 13:23:05.794001 15072 leader_election.cc:304] T f86a730e237248dc9b91cbb75e29c324 P a722e54d227f4c29a9ed6ce77858003a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1a22e9119494570b6d2217713fd7e43, a722e54d227f4c29a9ed6ce77858003a; no voters: 
I20260709 13:23:05.788858 15029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e29a38455b241239882b6af3eac3d51" candidate_uuid: "a722e54d227f4c29a9ed6ce77858003a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1a22e9119494570b6d2217713fd7e43" is_pre_election: true
I20260709 13:23:05.797570 15029 raft_consensus.cc:2468] T 7e29a38455b241239882b6af3eac3d51 P a1a22e9119494570b6d2217713fd7e43 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a722e54d227f4c29a9ed6ce77858003a in term 0.
I20260709 13:23:05.797636 15530 raft_consensus.cc:515] T f86a730e237248dc9b91cbb75e29c324 P f3a500981b494979b58d2b1041fec9c8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } } peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } } peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } }
I20260709 13:23:05.795469 15508 consensus_queue.cc:1048] T ad084674821d4137b02efe692068d382 P a722e54d227f4c29a9ed6ce77858003a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260709 13:23:05.800429 15508 raft_consensus.cc:2804] T f86a730e237248dc9b91cbb75e29c324 P a722e54d227f4c29a9ed6ce77858003a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:23:05.800971 15508 raft_consensus.cc:493] T f86a730e237248dc9b91cbb75e29c324 P a722e54d227f4c29a9ed6ce77858003a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:23:05.800982 14880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86a730e237248dc9b91cbb75e29c324" candidate_uuid: "a722e54d227f4c29a9ed6ce77858003a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f3a500981b494979b58d2b1041fec9c8" is_pre_election: true
I20260709 13:23:05.801628 15508 raft_consensus.cc:3060] T f86a730e237248dc9b91cbb75e29c324 P a722e54d227f4c29a9ed6ce77858003a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:23:05.802398 14880 raft_consensus.cc:2393] T f86a730e237248dc9b91cbb75e29c324 P f3a500981b494979b58d2b1041fec9c8 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a722e54d227f4c29a9ed6ce77858003a in current term 1: Already voted for candidate f3a500981b494979b58d2b1041fec9c8 in this term.
I20260709 13:23:05.802561 15474 raft_consensus.cc:515] T 7e29a38455b241239882b6af3eac3d51 P a722e54d227f4c29a9ed6ce77858003a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } } peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } } peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } }
W20260709 13:23:05.815028 14999 leader_election.cc:343] T dee43e01ec5d409b877a5c2dbf5b7b77 P a1a22e9119494570b6d2217713fd7e43 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a722e54d227f4c29a9ed6ce77858003a (127.5.126.68:46669): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:23:05.816897 14999 leader_election.cc:304] T dee43e01ec5d409b877a5c2dbf5b7b77 P a1a22e9119494570b6d2217713fd7e43 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1a22e9119494570b6d2217713fd7e43; no voters: a722e54d227f4c29a9ed6ce77858003a, f3a500981b494979b58d2b1041fec9c8
I20260709 13:23:05.822419 15029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86a730e237248dc9b91cbb75e29c324" candidate_uuid: "f3a500981b494979b58d2b1041fec9c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1a22e9119494570b6d2217713fd7e43"
I20260709 13:23:05.823153 15029 raft_consensus.cc:3060] T f86a730e237248dc9b91cbb75e29c324 P a1a22e9119494570b6d2217713fd7e43 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:23:05.814611 15530 leader_election.cc:290] T f86a730e237248dc9b91cbb75e29c324 P f3a500981b494979b58d2b1041fec9c8 [CANDIDATE]: Term 1 election: Requested vote from peers a1a22e9119494570b6d2217713fd7e43 (127.5.126.67:38125), a722e54d227f4c29a9ed6ce77858003a (127.5.126.68:46669)
I20260709 13:23:05.824019 15562 raft_consensus.cc:2749] T dee43e01ec5d409b877a5c2dbf5b7b77 P a1a22e9119494570b6d2217713fd7e43 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:23:05.826666 14924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.67:38125, user_credentials={real_user=slave}} blocked reactor thread for 61286.5us
I20260709 13:23:05.839489 15579 consensus_queue.cc:1048] T ad084674821d4137b02efe692068d382 P a722e54d227f4c29a9ed6ce77858003a [LEADER]: Connected to new peer: Peer: permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.013s
I20260709 13:23:05.840685 15155 tablet_bootstrap.cc:492] T a2de4fecd70240dd8ed436fa8de65773 P a1a22e9119494570b6d2217713fd7e43: No bootstrap required, opened a new log
I20260709 13:23:05.841318 15155 ts_tablet_manager.cc:1403] T a2de4fecd70240dd8ed436fa8de65773 P a1a22e9119494570b6d2217713fd7e43: Time spent bootstrapping tablet: real 0.308s	user 0.091s	sys 0.139s
I20260709 13:23:05.857795 15155 raft_consensus.cc:359] T a2de4fecd70240dd8ed436fa8de65773 P a1a22e9119494570b6d2217713fd7e43 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } } peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } } peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } }
I20260709 13:23:05.858038 15581 consensus_queue.cc:1048] T 53592d0c0a46440dbfcd26f8b8111859 P 0efc951052454eec9a58b0cd025945b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:23:05.858616 15155 raft_consensus.cc:385] T a2de4fecd70240dd8ed436fa8de65773 P a1a22e9119494570b6d2217713fd7e43 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:23:05.858976 15155 raft_consensus.cc:740] T a2de4fecd70240dd8ed436fa8de65773 P a1a22e9119494570b6d2217713fd7e43 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a1a22e9119494570b6d2217713fd7e43, State: Initialized, Role: FOLLOWER
I20260709 13:23:05.859795 15106 raft_consensus.cc:1275] T e429eefef04d433e8f18dfbc0387068d P a722e54d227f4c29a9ed6ce77858003a [term 3 FOLLOWER]: Refusing update from remote peer a1a22e9119494570b6d2217713fd7e43: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
I20260709 13:23:05.859654 15155 consensus_queue.cc:260] T a2de4fecd70240dd8ed436fa8de65773 P a1a22e9119494570b6d2217713fd7e43 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } } peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } } peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } }
I20260709 13:23:05.860245 15106 pending_rounds.cc:85] T e429eefef04d433e8f18dfbc0387068d P a722e54d227f4c29a9ed6ce77858003a: Aborting all ops after (but not including) 1
I20260709 13:23:05.860562 15106 pending_rounds.cc:107] T e429eefef04d433e8f18dfbc0387068d P a722e54d227f4c29a9ed6ce77858003a: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 13:23:05.860852 15106 raft_consensus.cc:2889] T e429eefef04d433e8f18dfbc0387068d P a722e54d227f4c29a9ed6ce77858003a [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:23:05.865247 15154 tablet_bootstrap.cc:492] T af00ad02fba64998bb25991f6f69f291 P a722e54d227f4c29a9ed6ce77858003a: No bootstrap required, opened a new log
I20260709 13:23:05.865934 15154 ts_tablet_manager.cc:1403] T af00ad02fba64998bb25991f6f69f291 P a722e54d227f4c29a9ed6ce77858003a: Time spent bootstrapping tablet: real 0.334s	user 0.069s	sys 0.087s
I20260709 13:23:05.869606 15154 raft_consensus.cc:359] T af00ad02fba64998bb25991f6f69f291 P a722e54d227f4c29a9ed6ce77858003a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } } peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } } peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } }
I20260709 13:23:05.870412 15154 raft_consensus.cc:385] T af00ad02fba64998bb25991f6f69f291 P a722e54d227f4c29a9ed6ce77858003a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:23:05.871706 14959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e29a38455b241239882b6af3eac3d51" candidate_uuid: "a722e54d227f4c29a9ed6ce77858003a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0efc951052454eec9a58b0cd025945b8"
I20260709 13:23:05.874826 15155 ts_tablet_manager.cc:1434] T a2de4fecd70240dd8ed436fa8de65773 P a1a22e9119494570b6d2217713fd7e43: Time spent starting tablet: real 0.033s	user 0.006s	sys 0.000s
I20260709 13:23:05.875020 14959 raft_consensus.cc:3060] T 7e29a38455b241239882b6af3eac3d51 P 0efc951052454eec9a58b0cd025945b8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:23:05.875504 15542 consensus_queue.cc:1048] T e429eefef04d433e8f18dfbc0387068d P a1a22e9119494570b6d2217713fd7e43 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:23:05.870682 15154 raft_consensus.cc:740] T af00ad02fba64998bb25991f6f69f291 P a722e54d227f4c29a9ed6ce77858003a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a722e54d227f4c29a9ed6ce77858003a, State: Initialized, Role: FOLLOWER
I20260709 13:23:05.875991 15155 tablet_bootstrap.cc:492] T 88a7c4171c664e819837994755edf95c P a1a22e9119494570b6d2217713fd7e43: Bootstrap starting.
I20260709 13:23:05.879096 15154 consensus_queue.cc:260] T af00ad02fba64998bb25991f6f69f291 P a722e54d227f4c29a9ed6ce77858003a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } } peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } } peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } }
I20260709 13:23:05.898778 15154 ts_tablet_manager.cc:1434] T af00ad02fba64998bb25991f6f69f291 P a722e54d227f4c29a9ed6ce77858003a: Time spent starting tablet: real 0.032s	user 0.007s	sys 0.001s
I20260709 13:23:05.887058 15474 leader_election.cc:290] T 7e29a38455b241239882b6af3eac3d51 P a722e54d227f4c29a9ed6ce77858003a [CANDIDATE]: Term 1 election: Requested vote from peers 0efc951052454eec9a58b0cd025945b8 (127.5.126.66:34613), a1a22e9119494570b6d2217713fd7e43 (127.5.126.67:38125)
I20260709 13:23:05.914600 15154 tablet_bootstrap.cc:492] T 16d5db73377a4925b9f1e814ba306fcc P a722e54d227f4c29a9ed6ce77858003a: Bootstrap starting.
I20260709 13:23:05.855751 15508 raft_consensus.cc:515] T f86a730e237248dc9b91cbb75e29c324 P a722e54d227f4c29a9ed6ce77858003a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } } peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } } peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } }
I20260709 13:23:05.922415 14959 raft_consensus.cc:2468] T 7e29a38455b241239882b6af3eac3d51 P 0efc951052454eec9a58b0cd025945b8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a722e54d227f4c29a9ed6ce77858003a in term 1.
I20260709 13:23:05.930061 15073 leader_election.cc:304] T 7e29a38455b241239882b6af3eac3d51 P a722e54d227f4c29a9ed6ce77858003a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0efc951052454eec9a58b0cd025945b8, a722e54d227f4c29a9ed6ce77858003a; no voters: 
I20260709 13:23:05.940842 15156 raft_consensus.cc:359] T dee43e01ec5d409b877a5c2dbf5b7b77 P f3a500981b494979b58d2b1041fec9c8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } } peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } } peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } }
I20260709 13:23:05.944201 15211 raft_consensus.cc:493] T b0b7e1c1e67845cb9bd2208bb2fb7c21 P 0efc951052454eec9a58b0cd025945b8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f3a500981b494979b58d2b1041fec9c8)
I20260709 13:23:05.944540 15156 raft_consensus.cc:385] T dee43e01ec5d409b877a5c2dbf5b7b77 P f3a500981b494979b58d2b1041fec9c8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:23:05.947309 15156 raft_consensus.cc:740] T dee43e01ec5d409b877a5c2dbf5b7b77 P f3a500981b494979b58d2b1041fec9c8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f3a500981b494979b58d2b1041fec9c8, State: Initialized, Role: FOLLOWER
I20260709 13:23:05.945101 15211 raft_consensus.cc:515] T b0b7e1c1e67845cb9bd2208bb2fb7c21 P 0efc951052454eec9a58b0cd025945b8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } } peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } } peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } }
W20260709 13:23:05.946188 14924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.67:38125, user_credentials={real_user=slave}} blocked reactor thread for 46368.2us
I20260709 13:23:05.949868 15156 consensus_queue.cc:260] T dee43e01ec5d409b877a5c2dbf5b7b77 P f3a500981b494979b58d2b1041fec9c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } } peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } } peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } }
I20260709 13:23:05.924911 15029 raft_consensus.cc:2468] T f86a730e237248dc9b91cbb75e29c324 P a1a22e9119494570b6d2217713fd7e43 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f3a500981b494979b58d2b1041fec9c8 in term 1.
I20260709 13:23:05.955184 15107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86a730e237248dc9b91cbb75e29c324" candidate_uuid: "f3a500981b494979b58d2b1041fec9c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a722e54d227f4c29a9ed6ce77858003a"
I20260709 13:23:05.956022 15107 raft_consensus.cc:2393] T f86a730e237248dc9b91cbb75e29c324 P a722e54d227f4c29a9ed6ce77858003a [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate f3a500981b494979b58d2b1041fec9c8 in current term 1: Already voted for candidate a722e54d227f4c29a9ed6ce77858003a in this term.
I20260709 13:23:05.942956 15474 raft_consensus.cc:2804] T 7e29a38455b241239882b6af3eac3d51 P a722e54d227f4c29a9ed6ce77858003a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:23:05.957230 15474 raft_consensus.cc:697] T 7e29a38455b241239882b6af3eac3d51 P a722e54d227f4c29a9ed6ce77858003a [term 1 LEADER]: Becoming Leader. State: Replica: a722e54d227f4c29a9ed6ce77858003a, State: Running, Role: LEADER
I20260709 13:23:05.958185 15474 consensus_queue.cc:237] T 7e29a38455b241239882b6af3eac3d51 P a722e54d227f4c29a9ed6ce77858003a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } } peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } } peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } }
I20260709 13:23:05.960824 15034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e29a38455b241239882b6af3eac3d51" candidate_uuid: "a722e54d227f4c29a9ed6ce77858003a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1a22e9119494570b6d2217713fd7e43"
I20260709 13:23:05.961428 15559 raft_consensus.cc:493] T a2de4fecd70240dd8ed436fa8de65773 P a1a22e9119494570b6d2217713fd7e43 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:23:05.961548 15034 raft_consensus.cc:3060] T 7e29a38455b241239882b6af3eac3d51 P a1a22e9119494570b6d2217713fd7e43 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:23:05.962039 15559 raft_consensus.cc:515] T a2de4fecd70240dd8ed436fa8de65773 P a1a22e9119494570b6d2217713fd7e43 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } } peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } } peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } }
I20260709 13:23:05.964231 15559 leader_election.cc:290] T a2de4fecd70240dd8ed436fa8de65773 P a1a22e9119494570b6d2217713fd7e43 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0efc951052454eec9a58b0cd025945b8 (127.5.126.66:34613), a722e54d227f4c29a9ed6ce77858003a (127.5.126.68:46669)
I20260709 13:23:05.966090 14849 leader_election.cc:304] T f86a730e237248dc9b91cbb75e29c324 P f3a500981b494979b58d2b1041fec9c8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1a22e9119494570b6d2217713fd7e43, f3a500981b494979b58d2b1041fec9c8; no voters: 
I20260709 13:23:05.995054 15156 ts_tablet_manager.cc:1434] T dee43e01ec5d409b877a5c2dbf5b7b77 P f3a500981b494979b58d2b1041fec9c8: Time spent starting tablet: real 0.239s	user 0.006s	sys 0.003s
I20260709 13:23:06.002872 15211 leader_election.cc:290] T b0b7e1c1e67845cb9bd2208bb2fb7c21 P 0efc951052454eec9a58b0cd025945b8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f3a500981b494979b58d2b1041fec9c8 (127.5.126.65:34129), a1a22e9119494570b6d2217713fd7e43 (127.5.126.67:38125)
I20260709 13:23:06.000411 15530 raft_consensus.cc:2804] T f86a730e237248dc9b91cbb75e29c324 P f3a500981b494979b58d2b1041fec9c8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:23:06.022740 15103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2de4fecd70240dd8ed436fa8de65773" candidate_uuid: "a1a22e9119494570b6d2217713fd7e43" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a722e54d227f4c29a9ed6ce77858003a" is_pre_election: true
I20260709 13:23:06.038288 15156 tablet_bootstrap.cc:492] T 2956fb66a7f34f3e99f42598fb93178e P f3a500981b494979b58d2b1041fec9c8: Bootstrap starting.
I20260709 13:23:06.032493 15508 leader_election.cc:290] T f86a730e237248dc9b91cbb75e29c324 P a722e54d227f4c29a9ed6ce77858003a [CANDIDATE]: Term 1 election: Requested vote from peers a1a22e9119494570b6d2217713fd7e43 (127.5.126.67:38125), f3a500981b494979b58d2b1041fec9c8 (127.5.126.65:34129)
I20260709 13:23:06.041558 14959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2de4fecd70240dd8ed436fa8de65773" candidate_uuid: "a1a22e9119494570b6d2217713fd7e43" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0efc951052454eec9a58b0cd025945b8" is_pre_election: true
I20260709 13:23:06.042282 14959 raft_consensus.cc:2468] T a2de4fecd70240dd8ed436fa8de65773 P 0efc951052454eec9a58b0cd025945b8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1a22e9119494570b6d2217713fd7e43 in term 0.
I20260709 13:23:06.022218 15530 raft_consensus.cc:697] T f86a730e237248dc9b91cbb75e29c324 P f3a500981b494979b58d2b1041fec9c8 [term 1 LEADER]: Becoming Leader. State: Replica: f3a500981b494979b58d2b1041fec9c8, State: Running, Role: LEADER
I20260709 13:23:06.051920 15153 raft_consensus.cc:359] T affcb03ab55349748a95c103059d2955 P 0efc951052454eec9a58b0cd025945b8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } } peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } } peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } }
I20260709 13:23:06.053069 15153 raft_consensus.cc:385] T affcb03ab55349748a95c103059d2955 P 0efc951052454eec9a58b0cd025945b8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:23:06.053403 15153 raft_consensus.cc:740] T affcb03ab55349748a95c103059d2955 P 0efc951052454eec9a58b0cd025945b8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0efc951052454eec9a58b0cd025945b8, State: Initialized, Role: FOLLOWER
I20260709 13:23:06.057526 14885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0b7e1c1e67845cb9bd2208bb2fb7c21" candidate_uuid: "0efc951052454eec9a58b0cd025945b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f3a500981b494979b58d2b1041fec9c8" is_pre_election: true
I20260709 13:23:06.073488 14999 leader_election.cc:304] T a2de4fecd70240dd8ed436fa8de65773 P a1a22e9119494570b6d2217713fd7e43 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0efc951052454eec9a58b0cd025945b8, a1a22e9119494570b6d2217713fd7e43; no voters: 
I20260709 13:23:06.073822 15155 tablet_bootstrap.cc:654] T 88a7c4171c664e819837994755edf95c P a1a22e9119494570b6d2217713fd7e43: Neither blocks nor log segments found. Creating new log.
I20260709 13:23:06.073936 15154 tablet_bootstrap.cc:654] T 16d5db73377a4925b9f1e814ba306fcc P a722e54d227f4c29a9ed6ce77858003a: Neither blocks nor log segments found. Creating new log.
I20260709 13:23:06.077975 15153 consensus_queue.cc:260] T affcb03ab55349748a95c103059d2955 P 0efc951052454eec9a58b0cd025945b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } } peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } } peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } }
I20260709 13:23:06.077245 15031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0b7e1c1e67845cb9bd2208bb2fb7c21" candidate_uuid: "0efc951052454eec9a58b0cd025945b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a1a22e9119494570b6d2217713fd7e43" is_pre_election: true
I20260709 13:23:06.082154 15564 raft_consensus.cc:2804] T a2de4fecd70240dd8ed436fa8de65773 P a1a22e9119494570b6d2217713fd7e43 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:23:06.108381 15153 ts_tablet_manager.cc:1434] T affcb03ab55349748a95c103059d2955 P 0efc951052454eec9a58b0cd025945b8: Time spent starting tablet: real 0.355s	user 0.008s	sys 0.003s
I20260709 13:23:06.107342 15034 raft_consensus.cc:2468] T 7e29a38455b241239882b6af3eac3d51 P a1a22e9119494570b6d2217713fd7e43 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a722e54d227f4c29a9ed6ce77858003a in term 1.
I20260709 13:23:06.105530 15564 raft_consensus.cc:493] T a2de4fecd70240dd8ed436fa8de65773 P a1a22e9119494570b6d2217713fd7e43 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:23:06.094884 15072 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.67:38125, user_credentials={real_user=slave}} blocked reactor thread for 74120.6us
I20260709 13:23:06.140439 15564 raft_consensus.cc:3060] T a2de4fecd70240dd8ed436fa8de65773 P a1a22e9119494570b6d2217713fd7e43 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:23:06.177672 15156 tablet_bootstrap.cc:654] T 2956fb66a7f34f3e99f42598fb93178e P f3a500981b494979b58d2b1041fec9c8: Neither blocks nor log segments found. Creating new log.
I20260709 13:23:06.097470 15530 consensus_queue.cc:237] T f86a730e237248dc9b91cbb75e29c324 P f3a500981b494979b58d2b1041fec9c8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } } peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } } peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } }
I20260709 13:23:06.185729 15153 tablet_bootstrap.cc:492] T 08dea3083d334745abe54f9b220bd86a P 0efc951052454eec9a58b0cd025945b8: Bootstrap starting.
I20260709 13:23:06.197446 15564 raft_consensus.cc:515] T a2de4fecd70240dd8ed436fa8de65773 P a1a22e9119494570b6d2217713fd7e43 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } } peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } } peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } }
I20260709 13:23:06.199945 15564 leader_election.cc:290] T a2de4fecd70240dd8ed436fa8de65773 P a1a22e9119494570b6d2217713fd7e43 [CANDIDATE]: Term 1 election: Requested vote from peers 0efc951052454eec9a58b0cd025945b8 (127.5.126.66:34613), a722e54d227f4c29a9ed6ce77858003a (127.5.126.68:46669)
I20260709 13:23:06.218629 15452 raft_consensus.cc:493] T dee43e01ec5d409b877a5c2dbf5b7b77 P f3a500981b494979b58d2b1041fec9c8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:23:06.219594 15452 raft_consensus.cc:515] T dee43e01ec5d409b877a5c2dbf5b7b77 P f3a500981b494979b58d2b1041fec9c8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } } peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } } peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } }
I20260709 13:23:06.222429 14925 leader_election.cc:304] T b0b7e1c1e67845cb9bd2208bb2fb7c21 P 0efc951052454eec9a58b0cd025945b8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0efc951052454eec9a58b0cd025945b8; no voters: a1a22e9119494570b6d2217713fd7e43, f3a500981b494979b58d2b1041fec9c8
I20260709 13:23:06.224726 15531 raft_consensus.cc:2749] T b0b7e1c1e67845cb9bd2208bb2fb7c21 P 0efc951052454eec9a58b0cd025945b8 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:23:06.227777 14885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86a730e237248dc9b91cbb75e29c324" candidate_uuid: "a722e54d227f4c29a9ed6ce77858003a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f3a500981b494979b58d2b1041fec9c8"
I20260709 13:23:06.233911 15155 tablet_bootstrap.cc:492] T 88a7c4171c664e819837994755edf95c P a1a22e9119494570b6d2217713fd7e43: No bootstrap required, opened a new log
I20260709 13:23:06.234691 15155 ts_tablet_manager.cc:1403] T 88a7c4171c664e819837994755edf95c P a1a22e9119494570b6d2217713fd7e43: Time spent bootstrapping tablet: real 0.359s	user 0.025s	sys 0.023s
I20260709 13:23:06.236328 14953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2de4fecd70240dd8ed436fa8de65773" candidate_uuid: "a1a22e9119494570b6d2217713fd7e43" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0efc951052454eec9a58b0cd025945b8"
I20260709 13:23:06.237077 14953 raft_consensus.cc:3060] T a2de4fecd70240dd8ed436fa8de65773 P 0efc951052454eec9a58b0cd025945b8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:23:06.239043 15108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2de4fecd70240dd8ed436fa8de65773" candidate_uuid: "a1a22e9119494570b6d2217713fd7e43" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a722e54d227f4c29a9ed6ce77858003a"
I20260709 13:23:06.242936 15155 raft_consensus.cc:359] T 88a7c4171c664e819837994755edf95c P a1a22e9119494570b6d2217713fd7e43 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } } peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } } peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } }
I20260709 13:23:06.243742 15155 raft_consensus.cc:385] T 88a7c4171c664e819837994755edf95c P a1a22e9119494570b6d2217713fd7e43 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:23:06.244068 15155 raft_consensus.cc:740] T 88a7c4171c664e819837994755edf95c P a1a22e9119494570b6d2217713fd7e43 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a1a22e9119494570b6d2217713fd7e43, State: Initialized, Role: FOLLOWER
I20260709 13:23:06.244818 15155 consensus_queue.cc:260] T 88a7c4171c664e819837994755edf95c P a1a22e9119494570b6d2217713fd7e43 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } } peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } } peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } }
W20260709 13:23:06.233773 14999 leader_election.cc:343] T a2de4fecd70240dd8ed436fa8de65773 P a1a22e9119494570b6d2217713fd7e43 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a722e54d227f4c29a9ed6ce77858003a (127.5.126.68:46669): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:23:06.247943 14999 leader_election.cc:343] T a2de4fecd70240dd8ed436fa8de65773 P a1a22e9119494570b6d2217713fd7e43 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer a722e54d227f4c29a9ed6ce77858003a (127.5.126.68:46669): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:23:06.253285 14782 catalog_manager.cc:5697] T ad084674821d4137b02efe692068d382 P a722e54d227f4c29a9ed6ce77858003a reported cstate change: term changed from 0 to 1, leader changed from <none> to a722e54d227f4c29a9ed6ce77858003a (127.5.126.68). New cstate: current_term: 1 leader_uuid: "a722e54d227f4c29a9ed6ce77858003a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } health_report { overall_health: HEALTHY } } }
I20260709 13:23:06.274955 15155 ts_tablet_manager.cc:1434] T 88a7c4171c664e819837994755edf95c P a1a22e9119494570b6d2217713fd7e43: Time spent starting tablet: real 0.040s	user 0.009s	sys 0.000s
I20260709 13:23:06.281859 15155 tablet_bootstrap.cc:492] T 08dea3083d334745abe54f9b220bd86a P a1a22e9119494570b6d2217713fd7e43: Bootstrap starting.
I20260709 13:23:06.289165 15605 raft_consensus.cc:493] T affcb03ab55349748a95c103059d2955 P f3a500981b494979b58d2b1041fec9c8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:23:06.287957 15452 leader_election.cc:290] T dee43e01ec5d409b877a5c2dbf5b7b77 P f3a500981b494979b58d2b1041fec9c8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a1a22e9119494570b6d2217713fd7e43 (127.5.126.67:38125), a722e54d227f4c29a9ed6ce77858003a (127.5.126.68:46669)
I20260709 13:23:06.298349 15031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86a730e237248dc9b91cbb75e29c324" candidate_uuid: "a722e54d227f4c29a9ed6ce77858003a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1a22e9119494570b6d2217713fd7e43"
I20260709 13:23:06.322289 15031 raft_consensus.cc:2393] T f86a730e237248dc9b91cbb75e29c324 P a1a22e9119494570b6d2217713fd7e43 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate a722e54d227f4c29a9ed6ce77858003a in current term 1: Already voted for candidate f3a500981b494979b58d2b1041fec9c8 in this term.
I20260709 13:23:06.324102 15588 raft_consensus.cc:493] T affcb03ab55349748a95c103059d2955 P 0efc951052454eec9a58b0cd025945b8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:23:06.324769 15588 raft_consensus.cc:515] T affcb03ab55349748a95c103059d2955 P 0efc951052454eec9a58b0cd025945b8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } } peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } } peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } }
I20260709 13:23:06.337874 15154 tablet_bootstrap.cc:492] T 16d5db73377a4925b9f1e814ba306fcc P a722e54d227f4c29a9ed6ce77858003a: No bootstrap required, opened a new log
I20260709 13:23:06.338570 15154 ts_tablet_manager.cc:1403] T 16d5db73377a4925b9f1e814ba306fcc P a722e54d227f4c29a9ed6ce77858003a: Time spent bootstrapping tablet: real 0.424s	user 0.014s	sys 0.012s
I20260709 13:23:06.350371 15588 leader_election.cc:290] T affcb03ab55349748a95c103059d2955 P 0efc951052454eec9a58b0cd025945b8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f3a500981b494979b58d2b1041fec9c8 (127.5.126.65:34129), a1a22e9119494570b6d2217713fd7e43 (127.5.126.67:38125)
I20260709 13:23:06.309264 15605 raft_consensus.cc:515] T affcb03ab55349748a95c103059d2955 P f3a500981b494979b58d2b1041fec9c8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } } peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } } peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } }
I20260709 13:23:06.379966 15564 raft_consensus.cc:493] T 88a7c4171c664e819837994755edf95c P a1a22e9119494570b6d2217713fd7e43 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:23:06.389138 14882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "affcb03ab55349748a95c103059d2955" candidate_uuid: "0efc951052454eec9a58b0cd025945b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f3a500981b494979b58d2b1041fec9c8" is_pre_election: true
I20260709 13:23:06.394608 14882 raft_consensus.cc:2468] T affcb03ab55349748a95c103059d2955 P f3a500981b494979b58d2b1041fec9c8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0efc951052454eec9a58b0cd025945b8 in term 0.
I20260709 13:23:06.396068 14925 leader_election.cc:304] T affcb03ab55349748a95c103059d2955 P 0efc951052454eec9a58b0cd025945b8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0efc951052454eec9a58b0cd025945b8, f3a500981b494979b58d2b1041fec9c8; no voters: 
I20260709 13:23:06.381002 14953 raft_consensus.cc:2468] T a2de4fecd70240dd8ed436fa8de65773 P 0efc951052454eec9a58b0cd025945b8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1a22e9119494570b6d2217713fd7e43 in term 1.
I20260709 13:23:06.396907 15154 raft_consensus.cc:359] T 16d5db73377a4925b9f1e814ba306fcc P a722e54d227f4c29a9ed6ce77858003a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } } peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } } peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } }
I20260709 13:23:06.397790 15154 raft_consensus.cc:385] T 16d5db73377a4925b9f1e814ba306fcc P a722e54d227f4c29a9ed6ce77858003a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:23:06.398244 15153 tablet_bootstrap.cc:654] T 08dea3083d334745abe54f9b220bd86a P 0efc951052454eec9a58b0cd025945b8: Neither blocks nor log segments found. Creating new log.
I20260709 13:23:06.400194 15596 consensus_queue.cc:1048] T 77e8d8b35cf148e99e8274bf65e5ed05 P a722e54d227f4c29a9ed6ce77858003a [LEADER]: Connected to new peer: Peer: permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.030s
I20260709 13:23:06.398185 15154 raft_consensus.cc:740] T 16d5db73377a4925b9f1e814ba306fcc P a722e54d227f4c29a9ed6ce77858003a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a722e54d227f4c29a9ed6ce77858003a, State: Initialized, Role: FOLLOWER
I20260709 13:23:06.408128 15154 consensus_queue.cc:260] T 16d5db73377a4925b9f1e814ba306fcc P a722e54d227f4c29a9ed6ce77858003a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } } peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } } peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } }
I20260709 13:23:06.389604 15031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "affcb03ab55349748a95c103059d2955" candidate_uuid: "0efc951052454eec9a58b0cd025945b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1a22e9119494570b6d2217713fd7e43" is_pre_election: true
W20260709 13:23:06.413749 14830 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:23:06.414798 15107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dee43e01ec5d409b877a5c2dbf5b7b77" candidate_uuid: "f3a500981b494979b58d2b1041fec9c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a722e54d227f4c29a9ed6ce77858003a" is_pre_election: true
I20260709 13:23:06.425241 15154 ts_tablet_manager.cc:1434] T 16d5db73377a4925b9f1e814ba306fcc P a722e54d227f4c29a9ed6ce77858003a: Time spent starting tablet: real 0.086s	user 0.007s	sys 0.000s
I20260709 13:23:06.426640 15154 tablet_bootstrap.cc:492] T 2a9523aa8663464686254c8412c37e67 P a722e54d227f4c29a9ed6ce77858003a: Bootstrap starting.
I20260709 13:23:06.427560 15155 tablet_bootstrap.cc:654] T 08dea3083d334745abe54f9b220bd86a P a1a22e9119494570b6d2217713fd7e43: Neither blocks nor log segments found. Creating new log.
W20260709 13:23:06.433914 15603 log.cc:927] Time spent T f86a730e237248dc9b91cbb75e29c324 P f3a500981b494979b58d2b1041fec9c8: Append to log took a long time: real 0.095s	user 0.001s	sys 0.000s
W20260709 13:23:06.437382 14924 leader_election.cc:343] T affcb03ab55349748a95c103059d2955 P 0efc951052454eec9a58b0cd025945b8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a1a22e9119494570b6d2217713fd7e43 (127.5.126.67:38125): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:23:06.439831 15154 tablet_bootstrap.cc:654] T 2a9523aa8663464686254c8412c37e67 P a722e54d227f4c29a9ed6ce77858003a: Neither blocks nor log segments found. Creating new log.
I20260709 13:23:06.441747 15474 consensus_queue.cc:1048] T 77e8d8b35cf148e99e8274bf65e5ed05 P a722e54d227f4c29a9ed6ce77858003a [LEADER]: Connected to new peer: Peer: permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:23:06.396981 15531 raft_consensus.cc:2804] T affcb03ab55349748a95c103059d2955 P 0efc951052454eec9a58b0cd025945b8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:23:06.453230 15531 raft_consensus.cc:493] T affcb03ab55349748a95c103059d2955 P 0efc951052454eec9a58b0cd025945b8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:23:06.464810 15531 raft_consensus.cc:3060] T affcb03ab55349748a95c103059d2955 P 0efc951052454eec9a58b0cd025945b8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:23:06.407814 15564 raft_consensus.cc:515] T 88a7c4171c664e819837994755edf95c P a1a22e9119494570b6d2217713fd7e43 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } } peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } } peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } }
I20260709 13:23:06.470853 15156 tablet_bootstrap.cc:492] T 2956fb66a7f34f3e99f42598fb93178e P f3a500981b494979b58d2b1041fec9c8: No bootstrap required, opened a new log
I20260709 13:23:06.471550 15156 ts_tablet_manager.cc:1403] T 2956fb66a7f34f3e99f42598fb93178e P f3a500981b494979b58d2b1041fec9c8: Time spent bootstrapping tablet: real 0.434s	user 0.028s	sys 0.020s
I20260709 13:23:06.476847 15031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dee43e01ec5d409b877a5c2dbf5b7b77" candidate_uuid: "f3a500981b494979b58d2b1041fec9c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1a22e9119494570b6d2217713fd7e43" is_pre_election: true
I20260709 13:23:06.477809 15031 raft_consensus.cc:2468] T dee43e01ec5d409b877a5c2dbf5b7b77 P a1a22e9119494570b6d2217713fd7e43 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f3a500981b494979b58d2b1041fec9c8 in term 0.
I20260709 13:23:06.478956 14782 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:54448 (request call id 74) took 1225 ms. Trace:
W20260709 13:23:06.479837 14850 leader_election.cc:343] T dee43e01ec5d409b877a5c2dbf5b7b77 P f3a500981b494979b58d2b1041fec9c8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a722e54d227f4c29a9ed6ce77858003a (127.5.126.68:46669): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:23:06.480281 14783 catalog_manager.cc:5697] T 58a622a48cd24833bc5fc27e03114176 P f3a500981b494979b58d2b1041fec9c8 reported cstate change: term changed from 0 to 1, leader changed from <none> to f3a500981b494979b58d2b1041fec9c8 (127.5.126.65). New cstate: current_term: 1 leader_uuid: "f3a500981b494979b58d2b1041fec9c8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } health_report { overall_health: UNKNOWN } } }
I20260709 13:23:06.497567 14849 leader_election.cc:304] T dee43e01ec5d409b877a5c2dbf5b7b77 P f3a500981b494979b58d2b1041fec9c8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a1a22e9119494570b6d2217713fd7e43, f3a500981b494979b58d2b1041fec9c8; no voters: a722e54d227f4c29a9ed6ce77858003a
I20260709 13:23:06.506551 15452 raft_consensus.cc:2804] T dee43e01ec5d409b877a5c2dbf5b7b77 P f3a500981b494979b58d2b1041fec9c8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:23:06.521088 15452 raft_consensus.cc:493] T dee43e01ec5d409b877a5c2dbf5b7b77 P f3a500981b494979b58d2b1041fec9c8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:23:06.521656 15452 raft_consensus.cc:3060] T dee43e01ec5d409b877a5c2dbf5b7b77 P f3a500981b494979b58d2b1041fec9c8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:23:06.520186 15156 raft_consensus.cc:359] T 2956fb66a7f34f3e99f42598fb93178e P f3a500981b494979b58d2b1041fec9c8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } } peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } } peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } }
I20260709 13:23:06.525843 15156 raft_consensus.cc:385] T 2956fb66a7f34f3e99f42598fb93178e P f3a500981b494979b58d2b1041fec9c8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:23:06.526486 15156 raft_consensus.cc:740] T 2956fb66a7f34f3e99f42598fb93178e P f3a500981b494979b58d2b1041fec9c8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f3a500981b494979b58d2b1041fec9c8, State: Initialized, Role: FOLLOWER
I20260709 13:23:06.527482 15156 consensus_queue.cc:260] T 2956fb66a7f34f3e99f42598fb93178e P f3a500981b494979b58d2b1041fec9c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } } peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } } peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } }
I20260709 13:23:06.524875 15605 leader_election.cc:290] T affcb03ab55349748a95c103059d2955 P f3a500981b494979b58d2b1041fec9c8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0efc951052454eec9a58b0cd025945b8 (127.5.126.66:34613), a1a22e9119494570b6d2217713fd7e43 (127.5.126.67:38125)
I20260709 13:23:06.543105 14999 leader_election.cc:304] T a2de4fecd70240dd8ed436fa8de65773 P a1a22e9119494570b6d2217713fd7e43 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0efc951052454eec9a58b0cd025945b8, a1a22e9119494570b6d2217713fd7e43; no voters: a722e54d227f4c29a9ed6ce77858003a
I20260709 13:23:06.544672 15611 raft_consensus.cc:2804] T a2de4fecd70240dd8ed436fa8de65773 P a1a22e9119494570b6d2217713fd7e43 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:23:06.545491 15611 raft_consensus.cc:697] T a2de4fecd70240dd8ed436fa8de65773 P a1a22e9119494570b6d2217713fd7e43 [term 1 LEADER]: Becoming Leader. State: Replica: a1a22e9119494570b6d2217713fd7e43, State: Running, Role: LEADER
I20260709 13:23:06.546558 15611 consensus_queue.cc:237] T a2de4fecd70240dd8ed436fa8de65773 P a1a22e9119494570b6d2217713fd7e43 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } } peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } } peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } }
I20260709 13:23:06.552176 15156 ts_tablet_manager.cc:1434] T 2956fb66a7f34f3e99f42598fb93178e P f3a500981b494979b58d2b1041fec9c8: Time spent starting tablet: real 0.080s	user 0.010s	sys 0.000s
I20260709 13:23:06.479492 14782 rpcz_store.cc:276] 0709 13:23:05.277884 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:23:05.287192 (+  9308us) service_pool.cc:224] Handling call
0709 13:23:06.478860 (+1191668us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:23:06.332460 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:23:06.408767 (+ 76307us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:23:06.410610 (+  1843us) write_op.cc:435] Acquired schema lock
0709 13:23:06.413153 (+  2543us) tablet.cc:662] Decoding operations
0709 13:23:06.429105 (+ 15952us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:23:06.429232 (+   127us) write_op.cc:641] Partition lock acquired for write op
0709 13:23:06.429298 (+    66us) tablet.cc:685] Acquiring locks for 1 operations
0709 13:23:06.429585 (+   287us) tablet.cc:701] Row locks acquired
0709 13:23:06.429613 (+    28us) write_op.cc:260] PREPARE: finished
0709 13:23:06.429845 (+   232us) write_op.cc:270] Start()
0709 13:23:06.430012 (+   167us) write_op.cc:276] Timestamp: P: 1783603386429787 usec, L: 0
0709 13:23:06.430046 (+    34us) op_driver.cc:348] REPLICATION: starting
0709 13:23:06.431086 (+  1040us) log.cc:844] Serialized 537 byte log entry
0709 13:23:06.433004 (+  1918us) op_driver.cc:464] REPLICATION: finished
0709 13:23:06.433476 (+   472us) write_op.cc:301] APPLY: starting
0709 13:23:06.433568 (+    92us) tablet.cc:1367] starting BulkCheckPresence
0709 13:23:06.433688 (+   120us) tablet.cc:1370] finished BulkCheckPresence
0709 13:23:06.433819 (+   131us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:23:06.434064 (+   245us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:23:06.434246 (+   182us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 13:23:06.434307 (+    61us) write_op.cc:312] APPLY: finished
0709 13:23:06.434500 (+   193us) log.cc:844] Serialized 22 byte log entry
0709 13:23:06.434682 (+   182us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:23:06.434790 (+   108us) write_op.cc:454] Released schema lock
0709 13:23:06.434840 (+    50us) write_op.cc:341] FINISH: Updating metrics
0709 13:23:06.435243 (+   403us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:23:06.435271 (+    28us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":43592,"reported_tablets":4,"child_traces":[["op",{"apply.queue_time_us":258,"apply.run_cpu_time_us":1727,"apply.run_wall_time_us":1727,"num_ops":1,"prepare.queue_time_us":36113,"prepare.run_cpu_time_us":4387,"prepare.run_wall_time_us":119992,"replication_time_us":2820,"thread_start_us":10545,"threads_started":1}]]}
I20260709 13:23:06.561074 14953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "affcb03ab55349748a95c103059d2955" candidate_uuid: "f3a500981b494979b58d2b1041fec9c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0efc951052454eec9a58b0cd025945b8" is_pre_election: true
I20260709 13:23:06.583443 14885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88a7c4171c664e819837994755edf95c" candidate_uuid: "a1a22e9119494570b6d2217713fd7e43" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f3a500981b494979b58d2b1041fec9c8" is_pre_election: true
I20260709 13:23:06.585041 15029 raft_consensus.cc:3060] T 88a7c4171c664e819837994755edf95c P a1a22e9119494570b6d2217713fd7e43 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:23:06.588696 15033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "affcb03ab55349748a95c103059d2955" candidate_uuid: "f3a500981b494979b58d2b1041fec9c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1a22e9119494570b6d2217713fd7e43" is_pre_election: true
I20260709 13:23:06.597110 15156 tablet_bootstrap.cc:492] T af00ad02fba64998bb25991f6f69f291 P f3a500981b494979b58d2b1041fec9c8: Bootstrap starting.
W20260709 13:23:06.602994 14849 leader_election.cc:343] T affcb03ab55349748a95c103059d2955 P f3a500981b494979b58d2b1041fec9c8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a1a22e9119494570b6d2217713fd7e43 (127.5.126.67:38125): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:23:06.614672 15155 tablet_bootstrap.cc:492] T 08dea3083d334745abe54f9b220bd86a P a1a22e9119494570b6d2217713fd7e43: No bootstrap required, opened a new log
I20260709 13:23:06.615257 15155 ts_tablet_manager.cc:1403] T 08dea3083d334745abe54f9b220bd86a P a1a22e9119494570b6d2217713fd7e43: Time spent bootstrapping tablet: real 0.339s	user 0.010s	sys 0.007s
I20260709 13:23:06.626688 15564 leader_election.cc:290] T 88a7c4171c664e819837994755edf95c P a1a22e9119494570b6d2217713fd7e43 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f3a500981b494979b58d2b1041fec9c8 (127.5.126.65:34129), 0efc951052454eec9a58b0cd025945b8 (127.5.126.66:34613)
I20260709 13:23:06.630854 15155 raft_consensus.cc:359] T 08dea3083d334745abe54f9b220bd86a P a1a22e9119494570b6d2217713fd7e43 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } } peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } } peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } }
I20260709 13:23:06.631560 15155 raft_consensus.cc:385] T 08dea3083d334745abe54f9b220bd86a P a1a22e9119494570b6d2217713fd7e43 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:23:06.631987 15531 raft_consensus.cc:515] T affcb03ab55349748a95c103059d2955 P 0efc951052454eec9a58b0cd025945b8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } } peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } } peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } }
I20260709 13:23:06.634056 14953 raft_consensus.cc:2393] T affcb03ab55349748a95c103059d2955 P 0efc951052454eec9a58b0cd025945b8 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f3a500981b494979b58d2b1041fec9c8 in current term 1: Already voted for candidate 0efc951052454eec9a58b0cd025945b8 in this term.
I20260709 13:23:06.634338 15531 leader_election.cc:290] T affcb03ab55349748a95c103059d2955 P 0efc951052454eec9a58b0cd025945b8 [CANDIDATE]: Term 1 election: Requested vote from peers f3a500981b494979b58d2b1041fec9c8 (127.5.126.65:34129), a1a22e9119494570b6d2217713fd7e43 (127.5.126.67:38125)
I20260709 13:23:06.635035 14882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "affcb03ab55349748a95c103059d2955" candidate_uuid: "0efc951052454eec9a58b0cd025945b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f3a500981b494979b58d2b1041fec9c8"
I20260709 13:23:06.635723 14882 raft_consensus.cc:3060] T affcb03ab55349748a95c103059d2955 P f3a500981b494979b58d2b1041fec9c8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:23:06.635823 15033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "affcb03ab55349748a95c103059d2955" candidate_uuid: "0efc951052454eec9a58b0cd025945b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1a22e9119494570b6d2217713fd7e43"
I20260709 13:23:06.638180 15452 raft_consensus.cc:515] T dee43e01ec5d409b877a5c2dbf5b7b77 P f3a500981b494979b58d2b1041fec9c8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } } peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } } peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } }
I20260709 13:23:06.592883 15072 leader_election.cc:304] T f86a730e237248dc9b91cbb75e29c324 P a722e54d227f4c29a9ed6ce77858003a [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a722e54d227f4c29a9ed6ce77858003a; no voters: a1a22e9119494570b6d2217713fd7e43, f3a500981b494979b58d2b1041fec9c8
I20260709 13:23:06.640476 15474 raft_consensus.cc:2749] T f86a730e237248dc9b91cbb75e29c324 P a722e54d227f4c29a9ed6ce77858003a [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
W20260709 13:23:06.640661 15072 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:38125, user_credentials={real_user=slave}} blocked reactor thread for 59217.9us
W20260709 13:23:06.641639 14924 leader_election.cc:343] T affcb03ab55349748a95c103059d2955 P 0efc951052454eec9a58b0cd025945b8 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer a1a22e9119494570b6d2217713fd7e43 (127.5.126.67:38125): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:23:06.643738 15474 raft_consensus.cc:493] T af00ad02fba64998bb25991f6f69f291 P a722e54d227f4c29a9ed6ce77858003a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:23:06.644325 15474 raft_consensus.cc:515] T af00ad02fba64998bb25991f6f69f291 P a722e54d227f4c29a9ed6ce77858003a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } } peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } } peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } }
I20260709 13:23:06.631817 15155 raft_consensus.cc:740] T 08dea3083d334745abe54f9b220bd86a P a1a22e9119494570b6d2217713fd7e43 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a1a22e9119494570b6d2217713fd7e43, State: Initialized, Role: FOLLOWER
I20260709 13:23:06.647300 15155 consensus_queue.cc:260] T 08dea3083d334745abe54f9b220bd86a P a1a22e9119494570b6d2217713fd7e43 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } } peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } } peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } }
I20260709 13:23:06.648900 15155 ts_tablet_manager.cc:1434] T 08dea3083d334745abe54f9b220bd86a P a1a22e9119494570b6d2217713fd7e43: Time spent starting tablet: real 0.033s	user 0.008s	sys 0.000s
I20260709 13:23:06.646513 15474 leader_election.cc:290] T af00ad02fba64998bb25991f6f69f291 P a722e54d227f4c29a9ed6ce77858003a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f3a500981b494979b58d2b1041fec9c8 (127.5.126.65:34129), 0efc951052454eec9a58b0cd025945b8 (127.5.126.66:34613)
I20260709 13:23:06.652830 15153 tablet_bootstrap.cc:492] T 08dea3083d334745abe54f9b220bd86a P 0efc951052454eec9a58b0cd025945b8: No bootstrap required, opened a new log
I20260709 13:23:06.653304 15153 ts_tablet_manager.cc:1403] T 08dea3083d334745abe54f9b220bd86a P 0efc951052454eec9a58b0cd025945b8: Time spent bootstrapping tablet: real 0.521s	user 0.011s	sys 0.019s
I20260709 13:23:06.652763 15154 tablet_bootstrap.cc:492] T 2a9523aa8663464686254c8412c37e67 P a722e54d227f4c29a9ed6ce77858003a: No bootstrap required, opened a new log
I20260709 13:23:06.656987 15154 ts_tablet_manager.cc:1403] T 2a9523aa8663464686254c8412c37e67 P a722e54d227f4c29a9ed6ce77858003a: Time spent bootstrapping tablet: real 0.231s	user 0.014s	sys 0.005s
I20260709 13:23:06.660012 15154 raft_consensus.cc:359] T 2a9523aa8663464686254c8412c37e67 P a722e54d227f4c29a9ed6ce77858003a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } } peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } } peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } }
I20260709 13:23:06.660727 15154 raft_consensus.cc:385] T 2a9523aa8663464686254c8412c37e67 P a722e54d227f4c29a9ed6ce77858003a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:23:06.660990 15154 raft_consensus.cc:740] T 2a9523aa8663464686254c8412c37e67 P a722e54d227f4c29a9ed6ce77858003a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a722e54d227f4c29a9ed6ce77858003a, State: Initialized, Role: FOLLOWER
I20260709 13:23:06.661592 15154 consensus_queue.cc:260] T 2a9523aa8663464686254c8412c37e67 P a722e54d227f4c29a9ed6ce77858003a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } } peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } } peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } }
I20260709 13:23:06.663726 15154 ts_tablet_manager.cc:1434] T 2a9523aa8663464686254c8412c37e67 P a722e54d227f4c29a9ed6ce77858003a: Time spent starting tablet: real 0.006s	user 0.003s	sys 0.000s
I20260709 13:23:06.665462 15452 leader_election.cc:290] T dee43e01ec5d409b877a5c2dbf5b7b77 P f3a500981b494979b58d2b1041fec9c8 [CANDIDATE]: Term 1 election: Requested vote from peers a1a22e9119494570b6d2217713fd7e43 (127.5.126.67:38125), a722e54d227f4c29a9ed6ce77858003a (127.5.126.68:46669)
I20260709 13:23:06.666812 15031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dee43e01ec5d409b877a5c2dbf5b7b77" candidate_uuid: "f3a500981b494979b58d2b1041fec9c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1a22e9119494570b6d2217713fd7e43"
I20260709 13:23:06.667328 14884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af00ad02fba64998bb25991f6f69f291" candidate_uuid: "a722e54d227f4c29a9ed6ce77858003a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f3a500981b494979b58d2b1041fec9c8" is_pre_election: true
I20260709 13:23:06.667644 15031 raft_consensus.cc:3060] T dee43e01ec5d409b877a5c2dbf5b7b77 P a1a22e9119494570b6d2217713fd7e43 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:23:06.669413 15154 tablet_bootstrap.cc:492] T a2de4fecd70240dd8ed436fa8de65773 P a722e54d227f4c29a9ed6ce77858003a: Bootstrap starting.
I20260709 13:23:06.668252 15153 raft_consensus.cc:359] T 08dea3083d334745abe54f9b220bd86a P 0efc951052454eec9a58b0cd025945b8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } } peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } } peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } }
I20260709 13:23:06.672994 15153 raft_consensus.cc:385] T 08dea3083d334745abe54f9b220bd86a P 0efc951052454eec9a58b0cd025945b8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:23:06.673274 15153 raft_consensus.cc:740] T 08dea3083d334745abe54f9b220bd86a P 0efc951052454eec9a58b0cd025945b8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0efc951052454eec9a58b0cd025945b8, State: Initialized, Role: FOLLOWER
I20260709 13:23:06.674081 15153 consensus_queue.cc:260] T 08dea3083d334745abe54f9b220bd86a P 0efc951052454eec9a58b0cd025945b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } } peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } } peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } }
I20260709 13:23:06.676751 15529 consensus_queue.cc:1048] T f86a730e237248dc9b91cbb75e29c324 P f3a500981b494979b58d2b1041fec9c8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:23:06.679390 15103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dee43e01ec5d409b877a5c2dbf5b7b77" candidate_uuid: "f3a500981b494979b58d2b1041fec9c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a722e54d227f4c29a9ed6ce77858003a"
I20260709 13:23:06.681346 14958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af00ad02fba64998bb25991f6f69f291" candidate_uuid: "a722e54d227f4c29a9ed6ce77858003a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0efc951052454eec9a58b0cd025945b8" is_pre_election: true
W20260709 13:23:06.682446 14850 leader_election.cc:343] T dee43e01ec5d409b877a5c2dbf5b7b77 P f3a500981b494979b58d2b1041fec9c8 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer a722e54d227f4c29a9ed6ce77858003a (127.5.126.68:46669): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:23:06.685946 15073 leader_election.cc:343] T af00ad02fba64998bb25991f6f69f291 P a722e54d227f4c29a9ed6ce77858003a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0efc951052454eec9a58b0cd025945b8 (127.5.126.66:34613): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:23:06.692569 14783 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:54420 (request call id 64) took 1572 ms. Trace:
I20260709 13:23:06.693334 14781 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:54438 (request call id 68) took 1355 ms. Trace:
I20260709 13:23:06.694825 14781 rpcz_store.cc:276] 0709 13:23:05.336687 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:23:05.336849 (+   162us) service_pool.cc:224] Handling call
0709 13:23:06.692003 (+1355154us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":50442,"reported_tablets":3}
I20260709 13:23:06.692436 15153 ts_tablet_manager.cc:1434] T 08dea3083d334745abe54f9b220bd86a P 0efc951052454eec9a58b0cd025945b8: Time spent starting tablet: real 0.039s	user 0.004s	sys 0.003s
I20260709 13:23:06.701514 15156 tablet_bootstrap.cc:654] T af00ad02fba64998bb25991f6f69f291 P f3a500981b494979b58d2b1041fec9c8: Neither blocks nor log segments found. Creating new log.
I20260709 13:23:06.712532 14850 leader_election.cc:304] T affcb03ab55349748a95c103059d2955 P f3a500981b494979b58d2b1041fec9c8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f3a500981b494979b58d2b1041fec9c8; no voters: 0efc951052454eec9a58b0cd025945b8, a1a22e9119494570b6d2217713fd7e43
I20260709 13:23:06.715269 15155 tablet_bootstrap.cc:492] T 16d5db73377a4925b9f1e814ba306fcc P a1a22e9119494570b6d2217713fd7e43: Bootstrap starting.
I20260709 13:23:06.716912 15474 consensus_queue.cc:1048] T 7e29a38455b241239882b6af3eac3d51 P a722e54d227f4c29a9ed6ce77858003a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:23:06.719581 15031 raft_consensus.cc:2468] T dee43e01ec5d409b877a5c2dbf5b7b77 P a1a22e9119494570b6d2217713fd7e43 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f3a500981b494979b58d2b1041fec9c8 in term 1.
I20260709 13:23:06.722193 14849 leader_election.cc:304] T dee43e01ec5d409b877a5c2dbf5b7b77 P f3a500981b494979b58d2b1041fec9c8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a1a22e9119494570b6d2217713fd7e43, f3a500981b494979b58d2b1041fec9c8; no voters: a722e54d227f4c29a9ed6ce77858003a
I20260709 13:23:06.727087 15530 raft_consensus.cc:2804] T dee43e01ec5d409b877a5c2dbf5b7b77 P f3a500981b494979b58d2b1041fec9c8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:23:06.727871 15155 tablet_bootstrap.cc:654] T 16d5db73377a4925b9f1e814ba306fcc P a1a22e9119494570b6d2217713fd7e43: Neither blocks nor log segments found. Creating new log.
I20260709 13:23:06.728838 15474 consensus_queue.cc:1048] T 7e29a38455b241239882b6af3eac3d51 P a722e54d227f4c29a9ed6ce77858003a [LEADER]: Connected to new peer: Peer: permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:23:06.727627 15530 raft_consensus.cc:697] T dee43e01ec5d409b877a5c2dbf5b7b77 P f3a500981b494979b58d2b1041fec9c8 [term 1 LEADER]: Becoming Leader. State: Replica: f3a500981b494979b58d2b1041fec9c8, State: Running, Role: LEADER
W20260709 13:23:06.732486 15073 leader_election.cc:343] T af00ad02fba64998bb25991f6f69f291 P a722e54d227f4c29a9ed6ce77858003a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f3a500981b494979b58d2b1041fec9c8 (127.5.126.65:34129): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:23:06.732695 14959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88a7c4171c664e819837994755edf95c" candidate_uuid: "a1a22e9119494570b6d2217713fd7e43" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0efc951052454eec9a58b0cd025945b8" is_pre_election: true
I20260709 13:23:06.736667 15073 leader_election.cc:304] T af00ad02fba64998bb25991f6f69f291 P a722e54d227f4c29a9ed6ce77858003a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a722e54d227f4c29a9ed6ce77858003a; no voters: 0efc951052454eec9a58b0cd025945b8, f3a500981b494979b58d2b1041fec9c8
I20260709 13:23:06.731753 15530 consensus_queue.cc:237] T dee43e01ec5d409b877a5c2dbf5b7b77 P f3a500981b494979b58d2b1041fec9c8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } } peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } } peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } }
I20260709 13:23:06.745146 15579 raft_consensus.cc:2749] T af00ad02fba64998bb25991f6f69f291 P a722e54d227f4c29a9ed6ce77858003a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:23:06.749852 15154 tablet_bootstrap.cc:654] T a2de4fecd70240dd8ed436fa8de65773 P a722e54d227f4c29a9ed6ce77858003a: Neither blocks nor log segments found. Creating new log.
I20260709 13:23:06.761570 14882 raft_consensus.cc:2468] T affcb03ab55349748a95c103059d2955 P f3a500981b494979b58d2b1041fec9c8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0efc951052454eec9a58b0cd025945b8 in term 1.
I20260709 13:23:06.762058 14999 leader_election.cc:304] T 88a7c4171c664e819837994755edf95c P a1a22e9119494570b6d2217713fd7e43 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1a22e9119494570b6d2217713fd7e43; no voters: 0efc951052454eec9a58b0cd025945b8, f3a500981b494979b58d2b1041fec9c8
I20260709 13:23:06.762266 15529 raft_consensus.cc:2749] T affcb03ab55349748a95c103059d2955 P f3a500981b494979b58d2b1041fec9c8 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:23:06.771649 14925 leader_election.cc:304] T affcb03ab55349748a95c103059d2955 P 0efc951052454eec9a58b0cd025945b8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0efc951052454eec9a58b0cd025945b8, f3a500981b494979b58d2b1041fec9c8; no voters: a1a22e9119494570b6d2217713fd7e43
I20260709 13:23:06.693758 14783 rpcz_store.cc:276] 0709 13:23:05.124097 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:23:05.127111 (+  3014us) service_pool.cc:224] Handling call
0709 13:23:06.683992 (+1556881us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:23:06.483985 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:23:06.484665 (+   680us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:23:06.484705 (+    40us) write_op.cc:435] Acquired schema lock
0709 13:23:06.484723 (+    18us) tablet.cc:662] Decoding operations
0709 13:23:06.485119 (+   396us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:23:06.485186 (+    67us) write_op.cc:641] Partition lock acquired for write op
0709 13:23:06.485218 (+    32us) tablet.cc:685] Acquiring locks for 1 operations
0709 13:23:06.485420 (+   202us) tablet.cc:701] Row locks acquired
0709 13:23:06.485438 (+    18us) write_op.cc:260] PREPARE: finished
0709 13:23:06.485596 (+   158us) write_op.cc:270] Start()
0709 13:23:06.486962 (+  1366us) write_op.cc:276] Timestamp: P: 1783603386485541 usec, L: 0
0709 13:23:06.488595 (+  1633us) op_driver.cc:348] REPLICATION: starting
0709 13:23:06.524577 (+ 35982us) log.cc:844] Serialized 537 byte log entry
0709 13:23:06.558780 (+ 34203us) spinlock_profiling.cc:243] Waited 1.27 ms on lock 0x7b18002af460. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc15785de1 00007fcc157925b1 00007fcc133e141d 00007fcc133e371a 00007fcc133e36a8 00007fcc133e3628 00007fcc133e35e3 00007fcc133e27fc 00007fcc15815626 00007fcc1580fdd8 00007fcc0f9b6310
0709 13:23:06.558850 (+    70us) op_driver.cc:464] REPLICATION: finished
0709 13:23:06.560172 (+  1322us) write_op.cc:301] APPLY: starting
0709 13:23:06.560260 (+    88us) tablet.cc:1367] starting BulkCheckPresence
0709 13:23:06.560384 (+   124us) tablet.cc:1370] finished BulkCheckPresence
0709 13:23:06.560409 (+    25us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:23:06.560640 (+   231us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:23:06.560830 (+   190us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 13:23:06.560884 (+    54us) write_op.cc:312] APPLY: finished
0709 13:23:06.561104 (+   220us) log.cc:844] Serialized 22 byte log entry
0709 13:23:06.561296 (+   192us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:23:06.561391 (+    95us) write_op.cc:454] Released schema lock
0709 13:23:06.561443 (+    52us) write_op.cc:341] FINISH: Updating metrics
0709 13:23:06.561818 (+   375us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:23:06.561849 (+    31us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":51296,"reported_tablets":4,"child_traces":[["op",{"apply.queue_time_us":1063,"apply.run_cpu_time_us":1601,"apply.run_wall_time_us":1601,"num_ops":1,"prepare.queue_time_us":588,"prepare.run_cpu_time_us":3227,"prepare.run_wall_time_us":46136,"replication_time_us":44424,"spinlock_wait_cycles":2932096}]]}
I20260709 13:23:06.772851 15588 raft_consensus.cc:2804] T affcb03ab55349748a95c103059d2955 P 0efc951052454eec9a58b0cd025945b8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:23:06.792575 15588 raft_consensus.cc:697] T affcb03ab55349748a95c103059d2955 P 0efc951052454eec9a58b0cd025945b8 [term 1 LEADER]: Becoming Leader. State: Replica: 0efc951052454eec9a58b0cd025945b8, State: Running, Role: LEADER
I20260709 13:23:06.793552 15588 consensus_queue.cc:237] T affcb03ab55349748a95c103059d2955 P 0efc951052454eec9a58b0cd025945b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } } peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } } peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } }
I20260709 13:23:06.793915 15464 raft_consensus.cc:493] T 08dea3083d334745abe54f9b220bd86a P 0efc951052454eec9a58b0cd025945b8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:23:06.794519 15464 raft_consensus.cc:515] T 08dea3083d334745abe54f9b220bd86a P 0efc951052454eec9a58b0cd025945b8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } } peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } } peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } }
I20260709 13:23:06.796814 15464 leader_election.cc:290] T 08dea3083d334745abe54f9b220bd86a P 0efc951052454eec9a58b0cd025945b8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f3a500981b494979b58d2b1041fec9c8 (127.5.126.65:34129), a1a22e9119494570b6d2217713fd7e43 (127.5.126.67:38125)
I20260709 13:23:06.799288 15033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08dea3083d334745abe54f9b220bd86a" candidate_uuid: "0efc951052454eec9a58b0cd025945b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1a22e9119494570b6d2217713fd7e43" is_pre_election: true
I20260709 13:23:06.799989 15033 raft_consensus.cc:2468] T 08dea3083d334745abe54f9b220bd86a P a1a22e9119494570b6d2217713fd7e43 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0efc951052454eec9a58b0cd025945b8 in term 0.
I20260709 13:23:06.801259 15153 tablet_bootstrap.cc:492] T af00ad02fba64998bb25991f6f69f291 P 0efc951052454eec9a58b0cd025945b8: Bootstrap starting.
I20260709 13:23:06.800768 15611 raft_consensus.cc:2749] T 88a7c4171c664e819837994755edf95c P a1a22e9119494570b6d2217713fd7e43 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:23:06.803174 14882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08dea3083d334745abe54f9b220bd86a" candidate_uuid: "0efc951052454eec9a58b0cd025945b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f3a500981b494979b58d2b1041fec9c8" is_pre_election: true
I20260709 13:23:06.816874 14782 catalog_manager.cc:5697] T e429eefef04d433e8f18dfbc0387068d P 0efc951052454eec9a58b0cd025945b8 reported cstate change: term changed from 2 to 3, leader changed from a722e54d227f4c29a9ed6ce77858003a (127.5.126.68) to a1a22e9119494570b6d2217713fd7e43 (127.5.126.67). New cstate: current_term: 3 leader_uuid: "a1a22e9119494570b6d2217713fd7e43" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } } peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } } peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } } }
I20260709 13:23:06.827368 15156 tablet_bootstrap.cc:492] T af00ad02fba64998bb25991f6f69f291 P f3a500981b494979b58d2b1041fec9c8: No bootstrap required, opened a new log
I20260709 13:23:06.828293 15156 ts_tablet_manager.cc:1403] T af00ad02fba64998bb25991f6f69f291 P f3a500981b494979b58d2b1041fec9c8: Time spent bootstrapping tablet: real 0.238s	user 0.026s	sys 0.039s
I20260709 13:23:06.826682 14782 catalog_manager.cc:5697] T 77e8d8b35cf148e99e8274bf65e5ed05 P 0efc951052454eec9a58b0cd025945b8 reported cstate change: term changed from 0 to 1, leader changed from <none> to a722e54d227f4c29a9ed6ce77858003a (127.5.126.68). New cstate: current_term: 1 leader_uuid: "a722e54d227f4c29a9ed6ce77858003a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } } peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } } peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } } }
I20260709 13:23:06.838958 15156 raft_consensus.cc:359] T af00ad02fba64998bb25991f6f69f291 P f3a500981b494979b58d2b1041fec9c8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } } peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } } peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } }
I20260709 13:23:06.839725 15156 raft_consensus.cc:385] T af00ad02fba64998bb25991f6f69f291 P f3a500981b494979b58d2b1041fec9c8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:23:06.839993 15156 raft_consensus.cc:740] T af00ad02fba64998bb25991f6f69f291 P f3a500981b494979b58d2b1041fec9c8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f3a500981b494979b58d2b1041fec9c8, State: Initialized, Role: FOLLOWER
I20260709 13:23:06.844782 15156 consensus_queue.cc:260] T af00ad02fba64998bb25991f6f69f291 P f3a500981b494979b58d2b1041fec9c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } } peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } } peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } }
I20260709 13:23:06.851773 15607 consensus_queue.cc:1048] T f86a730e237248dc9b91cbb75e29c324 P f3a500981b494979b58d2b1041fec9c8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:23:06.852197 15156 ts_tablet_manager.cc:1434] T af00ad02fba64998bb25991f6f69f291 P f3a500981b494979b58d2b1041fec9c8: Time spent starting tablet: real 0.023s	user 0.007s	sys 0.001s
I20260709 13:23:06.829694 15579 raft_consensus.cc:493] T 16d5db73377a4925b9f1e814ba306fcc P a722e54d227f4c29a9ed6ce77858003a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:23:06.853307 15579 raft_consensus.cc:515] T 16d5db73377a4925b9f1e814ba306fcc P a722e54d227f4c29a9ed6ce77858003a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } } peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } } peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } }
I20260709 13:23:06.855628 15579 leader_election.cc:290] T 16d5db73377a4925b9f1e814ba306fcc P a722e54d227f4c29a9ed6ce77858003a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a1a22e9119494570b6d2217713fd7e43 (127.5.126.67:38125), f3a500981b494979b58d2b1041fec9c8 (127.5.126.65:34129)
I20260709 13:23:06.856289 15033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16d5db73377a4925b9f1e814ba306fcc" candidate_uuid: "a722e54d227f4c29a9ed6ce77858003a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1a22e9119494570b6d2217713fd7e43" is_pre_election: true
W20260709 13:23:06.857671 15072 leader_election.cc:343] T 16d5db73377a4925b9f1e814ba306fcc P a722e54d227f4c29a9ed6ce77858003a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a1a22e9119494570b6d2217713fd7e43 (127.5.126.67:38125): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:23:06.854812 15156 tablet_bootstrap.cc:492] T 08dea3083d334745abe54f9b220bd86a P f3a500981b494979b58d2b1041fec9c8: Bootstrap starting.
I20260709 13:23:06.812919 14924 leader_election.cc:304] T 08dea3083d334745abe54f9b220bd86a P 0efc951052454eec9a58b0cd025945b8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0efc951052454eec9a58b0cd025945b8, a1a22e9119494570b6d2217713fd7e43; no voters: 
W20260709 13:23:06.875514 14925 leader_election.cc:343] T 08dea3083d334745abe54f9b220bd86a P 0efc951052454eec9a58b0cd025945b8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f3a500981b494979b58d2b1041fec9c8 (127.5.126.65:34129): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:23:06.890292 15589 raft_consensus.cc:2804] T 08dea3083d334745abe54f9b220bd86a P 0efc951052454eec9a58b0cd025945b8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:23:06.896234 14885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16d5db73377a4925b9f1e814ba306fcc" candidate_uuid: "a722e54d227f4c29a9ed6ce77858003a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f3a500981b494979b58d2b1041fec9c8" is_pre_election: true
W20260709 13:23:06.880014 14924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:38125, user_credentials={real_user=slave}} blocked reactor thread for 75538.5us
W20260709 13:23:06.909325 15073 leader_election.cc:343] T 16d5db73377a4925b9f1e814ba306fcc P a722e54d227f4c29a9ed6ce77858003a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f3a500981b494979b58d2b1041fec9c8 (127.5.126.65:34129): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:23:06.909881 15073 leader_election.cc:304] T 16d5db73377a4925b9f1e814ba306fcc P a722e54d227f4c29a9ed6ce77858003a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a722e54d227f4c29a9ed6ce77858003a; no voters: a1a22e9119494570b6d2217713fd7e43, f3a500981b494979b58d2b1041fec9c8
I20260709 13:23:06.900934 15589 raft_consensus.cc:493] T 08dea3083d334745abe54f9b220bd86a P 0efc951052454eec9a58b0cd025945b8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:23:06.912801 15579 raft_consensus.cc:2749] T 16d5db73377a4925b9f1e814ba306fcc P a722e54d227f4c29a9ed6ce77858003a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:23:06.919546 15589 raft_consensus.cc:3060] T 08dea3083d334745abe54f9b220bd86a P 0efc951052454eec9a58b0cd025945b8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:23:06.949530 15154 tablet_bootstrap.cc:492] T a2de4fecd70240dd8ed436fa8de65773 P a722e54d227f4c29a9ed6ce77858003a: No bootstrap required, opened a new log
I20260709 13:23:06.950178 15154 ts_tablet_manager.cc:1403] T a2de4fecd70240dd8ed436fa8de65773 P a722e54d227f4c29a9ed6ce77858003a: Time spent bootstrapping tablet: real 0.281s	user 0.016s	sys 0.029s
I20260709 13:23:06.920538 15584 raft_consensus.cc:493] T 2a9523aa8663464686254c8412c37e67 P a722e54d227f4c29a9ed6ce77858003a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:23:06.953665 15155 tablet_bootstrap.cc:492] T 16d5db73377a4925b9f1e814ba306fcc P a1a22e9119494570b6d2217713fd7e43: No bootstrap required, opened a new log
I20260709 13:23:06.953580 15584 raft_consensus.cc:515] T 2a9523aa8663464686254c8412c37e67 P a722e54d227f4c29a9ed6ce77858003a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } } peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } } peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } }
I20260709 13:23:06.954344 15155 ts_tablet_manager.cc:1403] T 16d5db73377a4925b9f1e814ba306fcc P a1a22e9119494570b6d2217713fd7e43: Time spent bootstrapping tablet: real 0.239s	user 0.017s	sys 0.022s
I20260709 13:23:06.955729 15584 leader_election.cc:290] T 2a9523aa8663464686254c8412c37e67 P a722e54d227f4c29a9ed6ce77858003a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f3a500981b494979b58d2b1041fec9c8 (127.5.126.65:34129), 0efc951052454eec9a58b0cd025945b8 (127.5.126.66:34613)
I20260709 13:23:06.958163 15155 raft_consensus.cc:359] T 16d5db73377a4925b9f1e814ba306fcc P a1a22e9119494570b6d2217713fd7e43 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } } peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } } peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } }
I20260709 13:23:06.959216 15155 raft_consensus.cc:385] T 16d5db73377a4925b9f1e814ba306fcc P a1a22e9119494570b6d2217713fd7e43 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:23:06.959628 15155 raft_consensus.cc:740] T 16d5db73377a4925b9f1e814ba306fcc P a1a22e9119494570b6d2217713fd7e43 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a1a22e9119494570b6d2217713fd7e43, State: Initialized, Role: FOLLOWER
I20260709 13:23:06.960662 15155 consensus_queue.cc:260] T 16d5db73377a4925b9f1e814ba306fcc P a1a22e9119494570b6d2217713fd7e43 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } } peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } } peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } }
I20260709 13:23:06.963459 15155 ts_tablet_manager.cc:1434] T 16d5db73377a4925b9f1e814ba306fcc P a1a22e9119494570b6d2217713fd7e43: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 13:23:06.964663 15153 tablet_bootstrap.cc:654] T af00ad02fba64998bb25991f6f69f291 P 0efc951052454eec9a58b0cd025945b8: Neither blocks nor log segments found. Creating new log.
I20260709 13:23:06.987613 15156 tablet_bootstrap.cc:654] T 08dea3083d334745abe54f9b220bd86a P f3a500981b494979b58d2b1041fec9c8: Neither blocks nor log segments found. Creating new log.
I20260709 13:23:06.991407 15589 raft_consensus.cc:515] T 08dea3083d334745abe54f9b220bd86a P 0efc951052454eec9a58b0cd025945b8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } } peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } } peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } }
I20260709 13:23:06.998764 15154 raft_consensus.cc:359] T a2de4fecd70240dd8ed436fa8de65773 P a722e54d227f4c29a9ed6ce77858003a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } } peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } } peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } }
I20260709 13:23:07.004907 15154 raft_consensus.cc:385] T a2de4fecd70240dd8ed436fa8de65773 P a722e54d227f4c29a9ed6ce77858003a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:23:07.005330 15154 raft_consensus.cc:740] T a2de4fecd70240dd8ed436fa8de65773 P a722e54d227f4c29a9ed6ce77858003a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a722e54d227f4c29a9ed6ce77858003a, State: Initialized, Role: FOLLOWER
I20260709 13:23:07.006170 15154 consensus_queue.cc:260] T a2de4fecd70240dd8ed436fa8de65773 P a722e54d227f4c29a9ed6ce77858003a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } } peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } } peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } }
I20260709 13:23:07.006923 15031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08dea3083d334745abe54f9b220bd86a" candidate_uuid: "0efc951052454eec9a58b0cd025945b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1a22e9119494570b6d2217713fd7e43"
I20260709 13:23:07.006646 15589 leader_election.cc:290] T 08dea3083d334745abe54f9b220bd86a P 0efc951052454eec9a58b0cd025945b8 [CANDIDATE]: Term 1 election: Requested vote from peers f3a500981b494979b58d2b1041fec9c8 (127.5.126.65:34129), a1a22e9119494570b6d2217713fd7e43 (127.5.126.67:38125)
I20260709 13:23:07.007675 15031 raft_consensus.cc:3060] T 08dea3083d334745abe54f9b220bd86a P a1a22e9119494570b6d2217713fd7e43 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:23:07.008884 15154 ts_tablet_manager.cc:1434] T a2de4fecd70240dd8ed436fa8de65773 P a722e54d227f4c29a9ed6ce77858003a: Time spent starting tablet: real 0.058s	user 0.006s	sys 0.003s
I20260709 13:23:07.010391 15154 tablet_bootstrap.cc:492] T dee43e01ec5d409b877a5c2dbf5b7b77 P a722e54d227f4c29a9ed6ce77858003a: Bootstrap starting.
I20260709 13:23:07.000021 15155 tablet_bootstrap.cc:492] T 2956fb66a7f34f3e99f42598fb93178e P a1a22e9119494570b6d2217713fd7e43: Bootstrap starting.
I20260709 13:23:07.016129 15031 raft_consensus.cc:2468] T 08dea3083d334745abe54f9b220bd86a P a1a22e9119494570b6d2217713fd7e43 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0efc951052454eec9a58b0cd025945b8 in term 1.
I20260709 13:23:07.016922 15363 raft_consensus.cc:493] T 2956fb66a7f34f3e99f42598fb93178e P f3a500981b494979b58d2b1041fec9c8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:23:07.017100 14882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08dea3083d334745abe54f9b220bd86a" candidate_uuid: "0efc951052454eec9a58b0cd025945b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f3a500981b494979b58d2b1041fec9c8"
I20260709 13:23:07.017935 14924 leader_election.cc:304] T 08dea3083d334745abe54f9b220bd86a P 0efc951052454eec9a58b0cd025945b8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0efc951052454eec9a58b0cd025945b8, a1a22e9119494570b6d2217713fd7e43; no voters: 
I20260709 13:23:07.017720 15363 raft_consensus.cc:515] T 2956fb66a7f34f3e99f42598fb93178e P f3a500981b494979b58d2b1041fec9c8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } } peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } } peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } }
I20260709 13:23:07.019726 15529 raft_consensus.cc:493] T af00ad02fba64998bb25991f6f69f291 P f3a500981b494979b58d2b1041fec9c8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:23:07.020191 15618 raft_consensus.cc:2804] T 08dea3083d334745abe54f9b220bd86a P 0efc951052454eec9a58b0cd025945b8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:23:07.020556 15363 leader_election.cc:290] T 2956fb66a7f34f3e99f42598fb93178e P f3a500981b494979b58d2b1041fec9c8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0efc951052454eec9a58b0cd025945b8 (127.5.126.66:34613), a1a22e9119494570b6d2217713fd7e43 (127.5.126.67:38125)
I20260709 13:23:07.020925 15618 raft_consensus.cc:697] T 08dea3083d334745abe54f9b220bd86a P 0efc951052454eec9a58b0cd025945b8 [term 1 LEADER]: Becoming Leader. State: Replica: 0efc951052454eec9a58b0cd025945b8, State: Running, Role: LEADER
I20260709 13:23:07.020259 15529 raft_consensus.cc:515] T af00ad02fba64998bb25991f6f69f291 P f3a500981b494979b58d2b1041fec9c8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } } peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } } peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } }
I20260709 13:23:07.022068 15618 consensus_queue.cc:237] T 08dea3083d334745abe54f9b220bd86a P 0efc951052454eec9a58b0cd025945b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } } peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } } peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } }
I20260709 13:23:07.023077 15529 leader_election.cc:290] T af00ad02fba64998bb25991f6f69f291 P f3a500981b494979b58d2b1041fec9c8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a722e54d227f4c29a9ed6ce77858003a (127.5.126.68:46669), 0efc951052454eec9a58b0cd025945b8 (127.5.126.66:34613)
W20260709 13:23:07.025130 14925 leader_election.cc:343] T 08dea3083d334745abe54f9b220bd86a P 0efc951052454eec9a58b0cd025945b8 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f3a500981b494979b58d2b1041fec9c8 (127.5.126.65:34129): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:23:07.027004 15155 tablet_bootstrap.cc:654] T 2956fb66a7f34f3e99f42598fb93178e P a1a22e9119494570b6d2217713fd7e43: Neither blocks nor log segments found. Creating new log.
I20260709 13:23:07.027339 14957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2956fb66a7f34f3e99f42598fb93178e" candidate_uuid: "f3a500981b494979b58d2b1041fec9c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0efc951052454eec9a58b0cd025945b8" is_pre_election: true
I20260709 13:23:07.030027 14954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af00ad02fba64998bb25991f6f69f291" candidate_uuid: "f3a500981b494979b58d2b1041fec9c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0efc951052454eec9a58b0cd025945b8" is_pre_election: true
I20260709 13:23:07.031299 15106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af00ad02fba64998bb25991f6f69f291" candidate_uuid: "f3a500981b494979b58d2b1041fec9c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a722e54d227f4c29a9ed6ce77858003a" is_pre_election: true
I20260709 13:23:07.032061 15106 raft_consensus.cc:2468] T af00ad02fba64998bb25991f6f69f291 P a722e54d227f4c29a9ed6ce77858003a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f3a500981b494979b58d2b1041fec9c8 in term 0.
I20260709 13:23:07.038662 14882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a9523aa8663464686254c8412c37e67" candidate_uuid: "a722e54d227f4c29a9ed6ce77858003a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f3a500981b494979b58d2b1041fec9c8" is_pre_election: true
I20260709 13:23:07.039372 14882 raft_consensus.cc:2468] T 2a9523aa8663464686254c8412c37e67 P f3a500981b494979b58d2b1041fec9c8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a722e54d227f4c29a9ed6ce77858003a in term 0.
I20260709 13:23:07.041258 15034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2956fb66a7f34f3e99f42598fb93178e" candidate_uuid: "f3a500981b494979b58d2b1041fec9c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1a22e9119494570b6d2217713fd7e43" is_pre_election: true
I20260709 13:23:07.045629 14850 leader_election.cc:304] T af00ad02fba64998bb25991f6f69f291 P f3a500981b494979b58d2b1041fec9c8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a722e54d227f4c29a9ed6ce77858003a, f3a500981b494979b58d2b1041fec9c8; no voters: 
I20260709 13:23:07.052973 14957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a9523aa8663464686254c8412c37e67" candidate_uuid: "a722e54d227f4c29a9ed6ce77858003a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0efc951052454eec9a58b0cd025945b8" is_pre_election: true
I20260709 13:23:07.055115 15154 tablet_bootstrap.cc:654] T dee43e01ec5d409b877a5c2dbf5b7b77 P a722e54d227f4c29a9ed6ce77858003a: Neither blocks nor log segments found. Creating new log.
I20260709 13:23:07.057183 14781 catalog_manager.cc:5697] T 7e29a38455b241239882b6af3eac3d51 P a722e54d227f4c29a9ed6ce77858003a reported cstate change: term changed from 0 to 1, leader changed from <none> to a722e54d227f4c29a9ed6ce77858003a (127.5.126.68). New cstate: current_term: 1 leader_uuid: "a722e54d227f4c29a9ed6ce77858003a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } health_report { overall_health: HEALTHY } } }
I20260709 13:23:07.058259 15156 tablet_bootstrap.cc:492] T 08dea3083d334745abe54f9b220bd86a P f3a500981b494979b58d2b1041fec9c8: No bootstrap required, opened a new log
I20260709 13:23:07.058876 15607 raft_consensus.cc:2804] T af00ad02fba64998bb25991f6f69f291 P f3a500981b494979b58d2b1041fec9c8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:23:07.059319 15607 raft_consensus.cc:493] T af00ad02fba64998bb25991f6f69f291 P f3a500981b494979b58d2b1041fec9c8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:23:07.058923 15156 ts_tablet_manager.cc:1403] T 08dea3083d334745abe54f9b220bd86a P f3a500981b494979b58d2b1041fec9c8: Time spent bootstrapping tablet: real 0.204s	user 0.010s	sys 0.008s
I20260709 13:23:07.059671 15607 raft_consensus.cc:3060] T af00ad02fba64998bb25991f6f69f291 P f3a500981b494979b58d2b1041fec9c8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:23:07.070986 15154 tablet_bootstrap.cc:492] T dee43e01ec5d409b877a5c2dbf5b7b77 P a722e54d227f4c29a9ed6ce77858003a: No bootstrap required, opened a new log
I20260709 13:23:07.071630 15154 ts_tablet_manager.cc:1403] T dee43e01ec5d409b877a5c2dbf5b7b77 P a722e54d227f4c29a9ed6ce77858003a: Time spent bootstrapping tablet: real 0.062s	user 0.013s	sys 0.000s
W20260709 13:23:07.070466 14849 leader_election.cc:343] T 2956fb66a7f34f3e99f42598fb93178e P f3a500981b494979b58d2b1041fec9c8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a1a22e9119494570b6d2217713fd7e43 (127.5.126.67:38125): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:23:07.089987 14850 leader_election.cc:343] T 2956fb66a7f34f3e99f42598fb93178e P f3a500981b494979b58d2b1041fec9c8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0efc951052454eec9a58b0cd025945b8 (127.5.126.66:34613): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:23:07.092478 15073 leader_election.cc:304] T 2a9523aa8663464686254c8412c37e67 P a722e54d227f4c29a9ed6ce77858003a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a722e54d227f4c29a9ed6ce77858003a, f3a500981b494979b58d2b1041fec9c8; no voters: 
I20260709 13:23:07.094404 14850 leader_election.cc:304] T 2956fb66a7f34f3e99f42598fb93178e P f3a500981b494979b58d2b1041fec9c8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f3a500981b494979b58d2b1041fec9c8; no voters: 0efc951052454eec9a58b0cd025945b8, a1a22e9119494570b6d2217713fd7e43
I20260709 13:23:07.095901 15156 raft_consensus.cc:359] T 08dea3083d334745abe54f9b220bd86a P f3a500981b494979b58d2b1041fec9c8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } } peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } } peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } }
I20260709 13:23:07.096998 15156 raft_consensus.cc:385] T 08dea3083d334745abe54f9b220bd86a P f3a500981b494979b58d2b1041fec9c8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 13:23:07.097040 14850 leader_election.cc:343] T af00ad02fba64998bb25991f6f69f291 P f3a500981b494979b58d2b1041fec9c8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0efc951052454eec9a58b0cd025945b8 (127.5.126.66:34613): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:23:07.098780 15155 tablet_bootstrap.cc:492] T 2956fb66a7f34f3e99f42598fb93178e P a1a22e9119494570b6d2217713fd7e43: No bootstrap required, opened a new log
I20260709 13:23:07.099419 15155 ts_tablet_manager.cc:1403] T 2956fb66a7f34f3e99f42598fb93178e P a1a22e9119494570b6d2217713fd7e43: Time spent bootstrapping tablet: real 0.100s	user 0.019s	sys 0.000s
I20260709 13:23:07.100917 15530 raft_consensus.cc:2749] T 2956fb66a7f34f3e99f42598fb93178e P f3a500981b494979b58d2b1041fec9c8 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:23:07.096175 15525 raft_consensus.cc:2804] T 2a9523aa8663464686254c8412c37e67 P a722e54d227f4c29a9ed6ce77858003a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:23:07.103165 15525 raft_consensus.cc:493] T 2a9523aa8663464686254c8412c37e67 P a722e54d227f4c29a9ed6ce77858003a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:23:07.102805 15155 raft_consensus.cc:359] T 2956fb66a7f34f3e99f42598fb93178e P a1a22e9119494570b6d2217713fd7e43 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } } peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } } peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } }
I20260709 13:23:07.103580 15525 raft_consensus.cc:3060] T 2a9523aa8663464686254c8412c37e67 P a722e54d227f4c29a9ed6ce77858003a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:23:07.103659 15155 raft_consensus.cc:385] T 2956fb66a7f34f3e99f42598fb93178e P a1a22e9119494570b6d2217713fd7e43 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:23:07.097637 15156 raft_consensus.cc:740] T 08dea3083d334745abe54f9b220bd86a P f3a500981b494979b58d2b1041fec9c8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f3a500981b494979b58d2b1041fec9c8, State: Initialized, Role: FOLLOWER
I20260709 13:23:07.104934 15155 raft_consensus.cc:740] T 2956fb66a7f34f3e99f42598fb93178e P a1a22e9119494570b6d2217713fd7e43 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a1a22e9119494570b6d2217713fd7e43, State: Initialized, Role: FOLLOWER
W20260709 13:23:07.136570 14849 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.67:38125, user_credentials={real_user=slave}} blocked reactor thread for 45268.2us
W20260709 13:23:07.139597 15073 leader_election.cc:343] T 2a9523aa8663464686254c8412c37e67 P a722e54d227f4c29a9ed6ce77858003a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0efc951052454eec9a58b0cd025945b8 (127.5.126.66:34613): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:23:07.140596 15155 consensus_queue.cc:260] T 2956fb66a7f34f3e99f42598fb93178e P a1a22e9119494570b6d2217713fd7e43 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } } peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } } peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } }
I20260709 13:23:07.145368 15154 raft_consensus.cc:359] T dee43e01ec5d409b877a5c2dbf5b7b77 P a722e54d227f4c29a9ed6ce77858003a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } } peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } } peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } }
I20260709 13:23:07.146441 15154 raft_consensus.cc:385] T dee43e01ec5d409b877a5c2dbf5b7b77 P a722e54d227f4c29a9ed6ce77858003a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:23:07.146750 15154 raft_consensus.cc:740] T dee43e01ec5d409b877a5c2dbf5b7b77 P a722e54d227f4c29a9ed6ce77858003a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a722e54d227f4c29a9ed6ce77858003a, State: Initialized, Role: FOLLOWER
I20260709 13:23:07.147483 15154 consensus_queue.cc:260] T dee43e01ec5d409b877a5c2dbf5b7b77 P a722e54d227f4c29a9ed6ce77858003a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } } peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } } peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } }
I20260709 13:23:07.161321 15155 ts_tablet_manager.cc:1434] T 2956fb66a7f34f3e99f42598fb93178e P a1a22e9119494570b6d2217713fd7e43: Time spent starting tablet: real 0.062s	user 0.002s	sys 0.009s
I20260709 13:23:07.162510 15155 tablet_bootstrap.cc:492] T affcb03ab55349748a95c103059d2955 P a1a22e9119494570b6d2217713fd7e43: Bootstrap starting.
I20260709 13:23:07.165251 15154 ts_tablet_manager.cc:1434] T dee43e01ec5d409b877a5c2dbf5b7b77 P a722e54d227f4c29a9ed6ce77858003a: Time spent starting tablet: real 0.093s	user 0.011s	sys 0.000s
I20260709 13:23:07.165999 15525 raft_consensus.cc:515] T 2a9523aa8663464686254c8412c37e67 P a722e54d227f4c29a9ed6ce77858003a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } } peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } } peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } }
I20260709 13:23:07.171149 15154 tablet_bootstrap.cc:492] T 34e83f249d9942e99244702be584c8ae P a722e54d227f4c29a9ed6ce77858003a: Bootstrap starting.
I20260709 13:23:07.175002 15615 raft_consensus.cc:493] T 16d5db73377a4925b9f1e814ba306fcc P a1a22e9119494570b6d2217713fd7e43 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:23:07.175678 15615 raft_consensus.cc:515] T 16d5db73377a4925b9f1e814ba306fcc P a1a22e9119494570b6d2217713fd7e43 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } } peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } } peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } }
I20260709 13:23:07.185173 15154 tablet_bootstrap.cc:654] T 34e83f249d9942e99244702be584c8ae P a722e54d227f4c29a9ed6ce77858003a: Neither blocks nor log segments found. Creating new log.
I20260709 13:23:07.188315 14882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16d5db73377a4925b9f1e814ba306fcc" candidate_uuid: "a1a22e9119494570b6d2217713fd7e43" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f3a500981b494979b58d2b1041fec9c8" is_pre_election: true
W20260709 13:23:07.190431 14999 leader_election.cc:343] T 16d5db73377a4925b9f1e814ba306fcc P a1a22e9119494570b6d2217713fd7e43 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f3a500981b494979b58d2b1041fec9c8 (127.5.126.65:34129): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:23:07.158242 15156 consensus_queue.cc:260] T 08dea3083d334745abe54f9b220bd86a P f3a500981b494979b58d2b1041fec9c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } } peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } } peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } }
I20260709 13:23:07.199893 15156 ts_tablet_manager.cc:1434] T 08dea3083d334745abe54f9b220bd86a P f3a500981b494979b58d2b1041fec9c8: Time spent starting tablet: real 0.140s	user 0.008s	sys 0.000s
W20260709 13:23:07.203472 15073 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.65:34129, user_credentials={real_user=slave}} blocked reactor thread for 43919.2us
I20260709 13:23:07.206424 14783 catalog_manager.cc:5697] T f86a730e237248dc9b91cbb75e29c324 P f3a500981b494979b58d2b1041fec9c8 reported cstate change: term changed from 0 to 1, leader changed from <none> to f3a500981b494979b58d2b1041fec9c8 (127.5.126.65). New cstate: current_term: 1 leader_uuid: "f3a500981b494979b58d2b1041fec9c8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } health_report { overall_health: HEALTHY } } }
I20260709 13:23:07.214460 14783 catalog_manager.cc:5697] T dee43e01ec5d409b877a5c2dbf5b7b77 P f3a500981b494979b58d2b1041fec9c8 reported cstate change: term changed from 0 to 1, leader changed from <none> to f3a500981b494979b58d2b1041fec9c8 (127.5.126.65). New cstate: current_term: 1 leader_uuid: "f3a500981b494979b58d2b1041fec9c8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } health_report { overall_health: HEALTHY } } }
I20260709 13:23:07.219234 15156 tablet_bootstrap.cc:492] T 16d5db73377a4925b9f1e814ba306fcc P f3a500981b494979b58d2b1041fec9c8: Bootstrap starting.
I20260709 13:23:07.223070 15107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16d5db73377a4925b9f1e814ba306fcc" candidate_uuid: "a1a22e9119494570b6d2217713fd7e43" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a722e54d227f4c29a9ed6ce77858003a" is_pre_election: true
I20260709 13:23:07.223765 15107 raft_consensus.cc:2468] T 16d5db73377a4925b9f1e814ba306fcc P a722e54d227f4c29a9ed6ce77858003a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1a22e9119494570b6d2217713fd7e43 in term 0.
I20260709 13:23:07.225621 14882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a9523aa8663464686254c8412c37e67" candidate_uuid: "a722e54d227f4c29a9ed6ce77858003a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f3a500981b494979b58d2b1041fec9c8"
I20260709 13:23:07.226260 14882 raft_consensus.cc:3060] T 2a9523aa8663464686254c8412c37e67 P f3a500981b494979b58d2b1041fec9c8 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:23:07.231926 14924 consensus_peers.cc:597] T affcb03ab55349748a95c103059d2955 P 0efc951052454eec9a58b0cd025945b8 -> Peer a1a22e9119494570b6d2217713fd7e43 (127.5.126.67:38125): Couldn't send request to peer a1a22e9119494570b6d2217713fd7e43. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:23:07.239180 15156 tablet_bootstrap.cc:654] T 16d5db73377a4925b9f1e814ba306fcc P f3a500981b494979b58d2b1041fec9c8: Neither blocks nor log segments found. Creating new log.
I20260709 13:23:07.242950 15103 raft_consensus.cc:3060] T a2de4fecd70240dd8ed436fa8de65773 P a722e54d227f4c29a9ed6ce77858003a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:23:07.242780 15607 raft_consensus.cc:515] T af00ad02fba64998bb25991f6f69f291 P f3a500981b494979b58d2b1041fec9c8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } } peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } } peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } }
I20260709 13:23:07.175546 15525 leader_election.cc:290] T 2a9523aa8663464686254c8412c37e67 P a722e54d227f4c29a9ed6ce77858003a [CANDIDATE]: Term 1 election: Requested vote from peers f3a500981b494979b58d2b1041fec9c8 (127.5.126.65:34129), 0efc951052454eec9a58b0cd025945b8 (127.5.126.66:34613)
I20260709 13:23:07.250073 15107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af00ad02fba64998bb25991f6f69f291" candidate_uuid: "f3a500981b494979b58d2b1041fec9c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a722e54d227f4c29a9ed6ce77858003a"
I20260709 13:23:07.250757 15107 raft_consensus.cc:3060] T af00ad02fba64998bb25991f6f69f291 P a722e54d227f4c29a9ed6ce77858003a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:23:07.201902 15611 raft_consensus.cc:493] T 2956fb66a7f34f3e99f42598fb93178e P a1a22e9119494570b6d2217713fd7e43 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:23:07.253083 15611 raft_consensus.cc:515] T 2956fb66a7f34f3e99f42598fb93178e P a1a22e9119494570b6d2217713fd7e43 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } } peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } } peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } }
I20260709 13:23:07.254995 15611 leader_election.cc:290] T 2956fb66a7f34f3e99f42598fb93178e P a1a22e9119494570b6d2217713fd7e43 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f3a500981b494979b58d2b1041fec9c8 (127.5.126.65:34129), 0efc951052454eec9a58b0cd025945b8 (127.5.126.66:34613)
I20260709 13:23:07.261406 14959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a9523aa8663464686254c8412c37e67" candidate_uuid: "a722e54d227f4c29a9ed6ce77858003a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0efc951052454eec9a58b0cd025945b8"
I20260709 13:23:07.265828 15155 tablet_bootstrap.cc:654] T affcb03ab55349748a95c103059d2955 P a1a22e9119494570b6d2217713fd7e43: Neither blocks nor log segments found. Creating new log.
I20260709 13:23:07.192109 15615 leader_election.cc:290] T 16d5db73377a4925b9f1e814ba306fcc P a1a22e9119494570b6d2217713fd7e43 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a722e54d227f4c29a9ed6ce77858003a (127.5.126.68:46669), f3a500981b494979b58d2b1041fec9c8 (127.5.126.65:34129)
I20260709 13:23:07.274505 15363 raft_consensus.cc:493] T 08dea3083d334745abe54f9b220bd86a P f3a500981b494979b58d2b1041fec9c8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:23:07.275048 15363 raft_consensus.cc:515] T 08dea3083d334745abe54f9b220bd86a P f3a500981b494979b58d2b1041fec9c8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } } peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } } peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } }
I20260709 13:23:07.280807 15363 leader_election.cc:290] T 08dea3083d334745abe54f9b220bd86a P f3a500981b494979b58d2b1041fec9c8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0efc951052454eec9a58b0cd025945b8 (127.5.126.66:34613), a1a22e9119494570b6d2217713fd7e43 (127.5.126.67:38125)
I20260709 13:23:07.283478 14959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08dea3083d334745abe54f9b220bd86a" candidate_uuid: "f3a500981b494979b58d2b1041fec9c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0efc951052454eec9a58b0cd025945b8" is_pre_election: true
I20260709 13:23:07.289463 15029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08dea3083d334745abe54f9b220bd86a" candidate_uuid: "f3a500981b494979b58d2b1041fec9c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1a22e9119494570b6d2217713fd7e43" is_pre_election: true
I20260709 13:23:07.290323 15029 raft_consensus.cc:2393] T 08dea3083d334745abe54f9b220bd86a P a1a22e9119494570b6d2217713fd7e43 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f3a500981b494979b58d2b1041fec9c8 in current term 1: Already voted for candidate 0efc951052454eec9a58b0cd025945b8 in this term.
W20260709 13:23:07.293576 15073 leader_election.cc:343] T 2a9523aa8663464686254c8412c37e67 P a722e54d227f4c29a9ed6ce77858003a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 0efc951052454eec9a58b0cd025945b8 (127.5.126.66:34613): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:23:07.310045 14849 leader_election.cc:304] T 08dea3083d334745abe54f9b220bd86a P f3a500981b494979b58d2b1041fec9c8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f3a500981b494979b58d2b1041fec9c8; no voters: 0efc951052454eec9a58b0cd025945b8, a1a22e9119494570b6d2217713fd7e43
I20260709 13:23:07.339107 15153 tablet_bootstrap.cc:492] T af00ad02fba64998bb25991f6f69f291 P 0efc951052454eec9a58b0cd025945b8: No bootstrap required, opened a new log
I20260709 13:23:07.339810 15153 ts_tablet_manager.cc:1403] T af00ad02fba64998bb25991f6f69f291 P 0efc951052454eec9a58b0cd025945b8: Time spent bootstrapping tablet: real 0.587s	user 0.014s	sys 0.017s
I20260709 13:23:07.343189 15153 raft_consensus.cc:359] T af00ad02fba64998bb25991f6f69f291 P 0efc951052454eec9a58b0cd025945b8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } } peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } } peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } }
I20260709 13:23:07.343982 15153 raft_consensus.cc:385] T af00ad02fba64998bb25991f6f69f291 P 0efc951052454eec9a58b0cd025945b8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:23:07.344276 15153 raft_consensus.cc:740] T af00ad02fba64998bb25991f6f69f291 P 0efc951052454eec9a58b0cd025945b8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0efc951052454eec9a58b0cd025945b8, State: Initialized, Role: FOLLOWER
I20260709 13:23:07.345012 15153 consensus_queue.cc:260] T af00ad02fba64998bb25991f6f69f291 P 0efc951052454eec9a58b0cd025945b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } } peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } } peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } }
I20260709 13:23:07.349188 14882 raft_consensus.cc:2468] T 2a9523aa8663464686254c8412c37e67 P f3a500981b494979b58d2b1041fec9c8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a722e54d227f4c29a9ed6ce77858003a in term 1.
I20260709 13:23:07.351454 15153 ts_tablet_manager.cc:1434] T af00ad02fba64998bb25991f6f69f291 P 0efc951052454eec9a58b0cd025945b8: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.000s
I20260709 13:23:07.352967 15153 tablet_bootstrap.cc:492] T 2a9523aa8663464686254c8412c37e67 P 0efc951052454eec9a58b0cd025945b8: Bootstrap starting.
I20260709 13:23:07.351688 15607 leader_election.cc:290] T af00ad02fba64998bb25991f6f69f291 P f3a500981b494979b58d2b1041fec9c8 [CANDIDATE]: Term 1 election: Requested vote from peers a722e54d227f4c29a9ed6ce77858003a (127.5.126.68:46669), 0efc951052454eec9a58b0cd025945b8 (127.5.126.66:34613)
I20260709 13:23:07.359223 15107 raft_consensus.cc:2468] T af00ad02fba64998bb25991f6f69f291 P a722e54d227f4c29a9ed6ce77858003a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f3a500981b494979b58d2b1041fec9c8 in term 1.
I20260709 13:23:07.328365 15529 consensus_queue.cc:1048] T dee43e01ec5d409b877a5c2dbf5b7b77 P f3a500981b494979b58d2b1041fec9c8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.038s
I20260709 13:23:07.325479 15605 raft_consensus.cc:3060] T 08dea3083d334745abe54f9b220bd86a P f3a500981b494979b58d2b1041fec9c8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:23:07.372589 15153 tablet_bootstrap.cc:654] T 2a9523aa8663464686254c8412c37e67 P 0efc951052454eec9a58b0cd025945b8: Neither blocks nor log segments found. Creating new log.
I20260709 13:23:07.382351 15073 leader_election.cc:304] T 2a9523aa8663464686254c8412c37e67 P a722e54d227f4c29a9ed6ce77858003a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a722e54d227f4c29a9ed6ce77858003a, f3a500981b494979b58d2b1041fec9c8; no voters: 0efc951052454eec9a58b0cd025945b8
I20260709 13:23:07.387609 14959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af00ad02fba64998bb25991f6f69f291" candidate_uuid: "f3a500981b494979b58d2b1041fec9c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0efc951052454eec9a58b0cd025945b8"
I20260709 13:23:07.388347 14959 raft_consensus.cc:3060] T af00ad02fba64998bb25991f6f69f291 P 0efc951052454eec9a58b0cd025945b8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:23:07.389516 14850 leader_election.cc:304] T af00ad02fba64998bb25991f6f69f291 P f3a500981b494979b58d2b1041fec9c8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a722e54d227f4c29a9ed6ce77858003a, f3a500981b494979b58d2b1041fec9c8; no voters: 
I20260709 13:23:07.383765 15634 raft_consensus.cc:2804] T 2a9523aa8663464686254c8412c37e67 P a722e54d227f4c29a9ed6ce77858003a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:23:07.392011 14781 catalog_manager.cc:5697] T affcb03ab55349748a95c103059d2955 P 0efc951052454eec9a58b0cd025945b8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0efc951052454eec9a58b0cd025945b8 (127.5.126.66). New cstate: current_term: 1 leader_uuid: "0efc951052454eec9a58b0cd025945b8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } health_report { overall_health: UNKNOWN } } }
I20260709 13:23:07.399665 14781 catalog_manager.cc:5697] T 08dea3083d334745abe54f9b220bd86a P 0efc951052454eec9a58b0cd025945b8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0efc951052454eec9a58b0cd025945b8 (127.5.126.66). New cstate: current_term: 1 leader_uuid: "0efc951052454eec9a58b0cd025945b8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } health_report { overall_health: UNKNOWN } } }
W20260709 13:23:07.404206 14999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.68:46669, user_credentials={real_user=slave}} blocked reactor thread for 185754us
I20260709 13:23:07.410785 14885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2956fb66a7f34f3e99f42598fb93178e" candidate_uuid: "a1a22e9119494570b6d2217713fd7e43" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f3a500981b494979b58d2b1041fec9c8" is_pre_election: true
I20260709 13:23:07.411559 14885 raft_consensus.cc:2468] T 2956fb66a7f34f3e99f42598fb93178e P f3a500981b494979b58d2b1041fec9c8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1a22e9119494570b6d2217713fd7e43 in term 0.
I20260709 13:23:07.397027 15452 raft_consensus.cc:2804] T af00ad02fba64998bb25991f6f69f291 P f3a500981b494979b58d2b1041fec9c8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:23:07.424681 14959 raft_consensus.cc:2468] T af00ad02fba64998bb25991f6f69f291 P 0efc951052454eec9a58b0cd025945b8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f3a500981b494979b58d2b1041fec9c8 in term 1.
I20260709 13:23:07.405296 15634 raft_consensus.cc:697] T 2a9523aa8663464686254c8412c37e67 P a722e54d227f4c29a9ed6ce77858003a [term 1 LEADER]: Becoming Leader. State: Replica: a722e54d227f4c29a9ed6ce77858003a, State: Running, Role: LEADER
I20260709 13:23:07.431535 14999 leader_election.cc:304] T 16d5db73377a4925b9f1e814ba306fcc P a1a22e9119494570b6d2217713fd7e43 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a1a22e9119494570b6d2217713fd7e43, a722e54d227f4c29a9ed6ce77858003a; no voters: f3a500981b494979b58d2b1041fec9c8
I20260709 13:23:07.440630 15154 tablet_bootstrap.cc:492] T 34e83f249d9942e99244702be584c8ae P a722e54d227f4c29a9ed6ce77858003a: No bootstrap required, opened a new log
I20260709 13:23:07.441324 15154 ts_tablet_manager.cc:1403] T 34e83f249d9942e99244702be584c8ae P a722e54d227f4c29a9ed6ce77858003a: Time spent bootstrapping tablet: real 0.271s	user 0.063s	sys 0.084s
I20260709 13:23:07.446135 15634 consensus_queue.cc:237] T 2a9523aa8663464686254c8412c37e67 P a722e54d227f4c29a9ed6ce77858003a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } } peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } } peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } }
I20260709 13:23:07.451803 14959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2956fb66a7f34f3e99f42598fb93178e" candidate_uuid: "a1a22e9119494570b6d2217713fd7e43" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0efc951052454eec9a58b0cd025945b8" is_pre_election: true
I20260709 13:23:07.465355 15154 raft_consensus.cc:359] T 34e83f249d9942e99244702be584c8ae P a722e54d227f4c29a9ed6ce77858003a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } } peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } } peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } }
I20260709 13:23:07.467020 15154 raft_consensus.cc:385] T 34e83f249d9942e99244702be584c8ae P a722e54d227f4c29a9ed6ce77858003a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:23:07.467199 15452 raft_consensus.cc:697] T af00ad02fba64998bb25991f6f69f291 P f3a500981b494979b58d2b1041fec9c8 [term 1 LEADER]: Becoming Leader. State: Replica: f3a500981b494979b58d2b1041fec9c8, State: Running, Role: LEADER
I20260709 13:23:07.467371 15154 raft_consensus.cc:740] T 34e83f249d9942e99244702be584c8ae P a722e54d227f4c29a9ed6ce77858003a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a722e54d227f4c29a9ed6ce77858003a, State: Initialized, Role: FOLLOWER
I20260709 13:23:07.468384 15154 consensus_queue.cc:260] T 34e83f249d9942e99244702be584c8ae P a722e54d227f4c29a9ed6ce77858003a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } } peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } } peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } }
I20260709 13:23:07.470569 15154 ts_tablet_manager.cc:1434] T 34e83f249d9942e99244702be584c8ae P a722e54d227f4c29a9ed6ce77858003a: Time spent starting tablet: real 0.029s	user 0.007s	sys 0.000s
I20260709 13:23:07.470784 15153 tablet_bootstrap.cc:492] T 2a9523aa8663464686254c8412c37e67 P 0efc951052454eec9a58b0cd025945b8: No bootstrap required, opened a new log
I20260709 13:23:07.471585 15153 ts_tablet_manager.cc:1403] T 2a9523aa8663464686254c8412c37e67 P 0efc951052454eec9a58b0cd025945b8: Time spent bootstrapping tablet: real 0.119s	user 0.036s	sys 0.013s
I20260709 13:23:07.471604 15154 tablet_bootstrap.cc:492] T bf0b7c8005aa4d8ab97a1499761bf98a P a722e54d227f4c29a9ed6ce77858003a: Bootstrap starting.
I20260709 13:23:07.477784 15153 raft_consensus.cc:359] T 2a9523aa8663464686254c8412c37e67 P 0efc951052454eec9a58b0cd025945b8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } } peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } } peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } }
I20260709 13:23:07.478796 15153 raft_consensus.cc:385] T 2a9523aa8663464686254c8412c37e67 P 0efc951052454eec9a58b0cd025945b8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:23:07.479139 15153 raft_consensus.cc:740] T 2a9523aa8663464686254c8412c37e67 P 0efc951052454eec9a58b0cd025945b8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0efc951052454eec9a58b0cd025945b8, State: Initialized, Role: FOLLOWER
I20260709 13:23:07.480734 15153 consensus_queue.cc:260] T 2a9523aa8663464686254c8412c37e67 P 0efc951052454eec9a58b0cd025945b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } } peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } } peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } }
I20260709 13:23:07.468405 15452 consensus_queue.cc:237] T af00ad02fba64998bb25991f6f69f291 P f3a500981b494979b58d2b1041fec9c8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } } peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } } peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } }
I20260709 13:23:07.495584 15612 raft_consensus.cc:493] T a2de4fecd70240dd8ed436fa8de65773 P a722e54d227f4c29a9ed6ce77858003a [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:23:07.496241 15612 raft_consensus.cc:515] T a2de4fecd70240dd8ed436fa8de65773 P a722e54d227f4c29a9ed6ce77858003a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } } peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } } peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } }
I20260709 13:23:07.497691 15605 raft_consensus.cc:2749] T 08dea3083d334745abe54f9b220bd86a P f3a500981b494979b58d2b1041fec9c8 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:23:07.502800 14999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.68:46669, user_credentials={real_user=slave}} blocked reactor thread for 71371.1us
I20260709 13:23:07.504637 15608 raft_consensus.cc:2804] T 16d5db73377a4925b9f1e814ba306fcc P a1a22e9119494570b6d2217713fd7e43 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:23:07.505211 15608 raft_consensus.cc:493] T 16d5db73377a4925b9f1e814ba306fcc P a1a22e9119494570b6d2217713fd7e43 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:23:07.505648 15608 raft_consensus.cc:3060] T 16d5db73377a4925b9f1e814ba306fcc P a1a22e9119494570b6d2217713fd7e43 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:23:07.508296 14959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2de4fecd70240dd8ed436fa8de65773" candidate_uuid: "a722e54d227f4c29a9ed6ce77858003a" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0efc951052454eec9a58b0cd025945b8" is_pre_election: true
I20260709 13:23:07.509183 14959 raft_consensus.cc:2468] T a2de4fecd70240dd8ed436fa8de65773 P 0efc951052454eec9a58b0cd025945b8 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a722e54d227f4c29a9ed6ce77858003a in term 1.
I20260709 13:23:07.510840 15073 leader_election.cc:304] T a2de4fecd70240dd8ed436fa8de65773 P a722e54d227f4c29a9ed6ce77858003a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0efc951052454eec9a58b0cd025945b8, a722e54d227f4c29a9ed6ce77858003a; no voters: 
I20260709 13:23:07.513151 15508 raft_consensus.cc:2804] T a2de4fecd70240dd8ed436fa8de65773 P a722e54d227f4c29a9ed6ce77858003a [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:23:07.513643 15508 raft_consensus.cc:493] T a2de4fecd70240dd8ed436fa8de65773 P a722e54d227f4c29a9ed6ce77858003a [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:23:07.514066 15508 raft_consensus.cc:3060] T a2de4fecd70240dd8ed436fa8de65773 P a722e54d227f4c29a9ed6ce77858003a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:23:07.505455 15106 raft_consensus.cc:3060] T dee43e01ec5d409b877a5c2dbf5b7b77 P a722e54d227f4c29a9ed6ce77858003a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:23:07.466770 15610 consensus_queue.cc:1048] T a2de4fecd70240dd8ed436fa8de65773 P a1a22e9119494570b6d2217713fd7e43 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.052s
I20260709 13:23:07.519023 15611 consensus_queue.cc:1048] T a2de4fecd70240dd8ed436fa8de65773 P a1a22e9119494570b6d2217713fd7e43 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:23:07.526917 15581 consensus_queue.cc:1048] T affcb03ab55349748a95c103059d2955 P 0efc951052454eec9a58b0cd025945b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:23:07.536854 15588 consensus_queue.cc:1048] T 08dea3083d334745abe54f9b220bd86a P 0efc951052454eec9a58b0cd025945b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:23:07.507102 15153 ts_tablet_manager.cc:1434] T 2a9523aa8663464686254c8412c37e67 P 0efc951052454eec9a58b0cd025945b8: Time spent starting tablet: real 0.028s	user 0.002s	sys 0.006s
I20260709 13:23:07.585037 15153 tablet_bootstrap.cc:492] T 34e83f249d9942e99244702be584c8ae P 0efc951052454eec9a58b0cd025945b8: Bootstrap starting.
W20260709 13:23:07.588259 14999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.68:46669, user_credentials={real_user=slave}} blocked reactor thread for 84117.8us
I20260709 13:23:07.552798 15605 consensus_queue.cc:1048] T dee43e01ec5d409b877a5c2dbf5b7b77 P f3a500981b494979b58d2b1041fec9c8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.034s
I20260709 13:23:07.588011 15612 leader_election.cc:290] T a2de4fecd70240dd8ed436fa8de65773 P a722e54d227f4c29a9ed6ce77858003a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0efc951052454eec9a58b0cd025945b8 (127.5.126.66:34613), a1a22e9119494570b6d2217713fd7e43 (127.5.126.67:38125)
I20260709 13:23:07.775413 15154 tablet_bootstrap.cc:654] T bf0b7c8005aa4d8ab97a1499761bf98a P a722e54d227f4c29a9ed6ce77858003a: Neither blocks nor log segments found. Creating new log.
I20260709 13:23:07.787051 15156 tablet_bootstrap.cc:492] T 16d5db73377a4925b9f1e814ba306fcc P f3a500981b494979b58d2b1041fec9c8: No bootstrap required, opened a new log
I20260709 13:23:07.787766 15156 ts_tablet_manager.cc:1403] T 16d5db73377a4925b9f1e814ba306fcc P f3a500981b494979b58d2b1041fec9c8: Time spent bootstrapping tablet: real 0.569s	user 0.016s	sys 0.032s
I20260709 13:23:07.788645 15608 raft_consensus.cc:515] T 16d5db73377a4925b9f1e814ba306fcc P a1a22e9119494570b6d2217713fd7e43 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } } peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } } peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } }
I20260709 13:23:07.791040 15608 leader_election.cc:290] T 16d5db73377a4925b9f1e814ba306fcc P a1a22e9119494570b6d2217713fd7e43 [CANDIDATE]: Term 1 election: Requested vote from peers a722e54d227f4c29a9ed6ce77858003a (127.5.126.68:46669), f3a500981b494979b58d2b1041fec9c8 (127.5.126.65:34129)
I20260709 13:23:07.793617 14999 leader_election.cc:304] T 2956fb66a7f34f3e99f42598fb93178e P a1a22e9119494570b6d2217713fd7e43 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1a22e9119494570b6d2217713fd7e43, f3a500981b494979b58d2b1041fec9c8; no voters: 
W20260709 13:23:07.794667 14999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.65:34129, user_credentials={real_user=slave}} blocked reactor thread for 185483us
I20260709 13:23:07.803153 15652 raft_consensus.cc:2804] T 2956fb66a7f34f3e99f42598fb93178e P a1a22e9119494570b6d2217713fd7e43 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:23:07.803697 15652 raft_consensus.cc:493] T 2956fb66a7f34f3e99f42598fb93178e P a1a22e9119494570b6d2217713fd7e43 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:23:07.804065 15652 raft_consensus.cc:3060] T 2956fb66a7f34f3e99f42598fb93178e P a1a22e9119494570b6d2217713fd7e43 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:23:07.807173 15034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2de4fecd70240dd8ed436fa8de65773" candidate_uuid: "a722e54d227f4c29a9ed6ce77858003a" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1a22e9119494570b6d2217713fd7e43" is_pre_election: true
I20260709 13:23:07.796984 15579 raft_consensus.cc:493] T dee43e01ec5d409b877a5c2dbf5b7b77 P a722e54d227f4c29a9ed6ce77858003a [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:23:07.807999 15579 raft_consensus.cc:515] T dee43e01ec5d409b877a5c2dbf5b7b77 P a722e54d227f4c29a9ed6ce77858003a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } } peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } } peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } }
I20260709 13:23:07.810665 15579 leader_election.cc:290] T dee43e01ec5d409b877a5c2dbf5b7b77 P a722e54d227f4c29a9ed6ce77858003a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a1a22e9119494570b6d2217713fd7e43 (127.5.126.67:38125), f3a500981b494979b58d2b1041fec9c8 (127.5.126.65:34129)
I20260709 13:23:07.844072 15155 tablet_bootstrap.cc:492] T affcb03ab55349748a95c103059d2955 P a1a22e9119494570b6d2217713fd7e43: No bootstrap required, opened a new log
I20260709 13:23:07.844810 15155 ts_tablet_manager.cc:1403] T affcb03ab55349748a95c103059d2955 P a1a22e9119494570b6d2217713fd7e43: Time spent bootstrapping tablet: real 0.683s	user 0.040s	sys 0.018s
W20260709 13:23:07.847675 14999 leader_election.cc:343] T 2956fb66a7f34f3e99f42598fb93178e P a1a22e9119494570b6d2217713fd7e43 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0efc951052454eec9a58b0cd025945b8 (127.5.126.66:34613): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:23:07.852370 14830 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:23:07.867208 15156 raft_consensus.cc:359] T 16d5db73377a4925b9f1e814ba306fcc P f3a500981b494979b58d2b1041fec9c8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } } peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } } peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } }
I20260709 13:23:07.868288 15156 raft_consensus.cc:385] T 16d5db73377a4925b9f1e814ba306fcc P f3a500981b494979b58d2b1041fec9c8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:23:07.868649 15156 raft_consensus.cc:740] T 16d5db73377a4925b9f1e814ba306fcc P f3a500981b494979b58d2b1041fec9c8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f3a500981b494979b58d2b1041fec9c8, State: Initialized, Role: FOLLOWER
I20260709 13:23:07.869496 15156 consensus_queue.cc:260] T 16d5db73377a4925b9f1e814ba306fcc P f3a500981b494979b58d2b1041fec9c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } } peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } } peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } }
I20260709 13:23:07.856468 15029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dee43e01ec5d409b877a5c2dbf5b7b77" candidate_uuid: "a722e54d227f4c29a9ed6ce77858003a" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1a22e9119494570b6d2217713fd7e43" is_pre_election: true
I20260709 13:23:07.882917 15508 raft_consensus.cc:515] T a2de4fecd70240dd8ed436fa8de65773 P a722e54d227f4c29a9ed6ce77858003a [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } } peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } } peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } }
I20260709 13:23:07.885228 15508 leader_election.cc:290] T a2de4fecd70240dd8ed436fa8de65773 P a722e54d227f4c29a9ed6ce77858003a [CANDIDATE]: Term 2 election: Requested vote from peers 0efc951052454eec9a58b0cd025945b8 (127.5.126.66:34613), a1a22e9119494570b6d2217713fd7e43 (127.5.126.67:38125)
W20260709 13:23:07.886684 15651 log.cc:927] Time spent T 2a9523aa8663464686254c8412c37e67 P a722e54d227f4c29a9ed6ce77858003a: Append to log took a long time: real 0.094s	user 0.000s	sys 0.001s
I20260709 13:23:07.885078 15155 raft_consensus.cc:359] T affcb03ab55349748a95c103059d2955 P a1a22e9119494570b6d2217713fd7e43 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } } peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } } peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } }
I20260709 13:23:07.888662 15155 raft_consensus.cc:385] T affcb03ab55349748a95c103059d2955 P a1a22e9119494570b6d2217713fd7e43 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:23:07.890008 15156 ts_tablet_manager.cc:1434] T 16d5db73377a4925b9f1e814ba306fcc P f3a500981b494979b58d2b1041fec9c8: Time spent starting tablet: real 0.102s	user 0.007s	sys 0.003s
I20260709 13:23:07.888991 15155 raft_consensus.cc:740] T affcb03ab55349748a95c103059d2955 P a1a22e9119494570b6d2217713fd7e43 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a1a22e9119494570b6d2217713fd7e43, State: Initialized, Role: FOLLOWER
I20260709 13:23:07.892084 15155 consensus_queue.cc:260] T affcb03ab55349748a95c103059d2955 P a1a22e9119494570b6d2217713fd7e43 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } } peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } } peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } }
I20260709 13:23:07.901095 15106 raft_consensus.cc:1240] T a2de4fecd70240dd8ed436fa8de65773 P a722e54d227f4c29a9ed6ce77858003a [term 2 FOLLOWER]: Rejecting Update request from peer a1a22e9119494570b6d2217713fd7e43 for earlier term 1. Current term is 2. Ops: [1.1-1.1]
W20260709 13:23:07.914738 14999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.68:46669, user_credentials={real_user=slave}} blocked reactor thread for 55076.4us
I20260709 13:23:07.894376 15456 raft_consensus.cc:493] T 2a9523aa8663464686254c8412c37e67 P 0efc951052454eec9a58b0cd025945b8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:23:07.919991 14849 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.67:38125, user_credentials={real_user=slave}} blocked reactor thread for 82027.9us
W20260709 13:23:07.919974 14924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.67:38125, user_credentials={real_user=slave}} blocked reactor thread for 48322.9us
I20260709 13:23:07.924947 15155 ts_tablet_manager.cc:1434] T affcb03ab55349748a95c103059d2955 P a1a22e9119494570b6d2217713fd7e43: Time spent starting tablet: real 0.080s	user 0.008s	sys 0.000s
I20260709 13:23:07.929138 14959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2de4fecd70240dd8ed436fa8de65773" candidate_uuid: "a722e54d227f4c29a9ed6ce77858003a" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0efc951052454eec9a58b0cd025945b8"
I20260709 13:23:07.929845 14959 raft_consensus.cc:3060] T a2de4fecd70240dd8ed436fa8de65773 P 0efc951052454eec9a58b0cd025945b8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:23:07.922545 15635 raft_consensus.cc:493] T 34e83f249d9942e99244702be584c8ae P a722e54d227f4c29a9ed6ce77858003a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:23:07.935127 15635 raft_consensus.cc:515] T 34e83f249d9942e99244702be584c8ae P a722e54d227f4c29a9ed6ce77858003a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } } peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } } peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } }
I20260709 13:23:07.936631 15031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2de4fecd70240dd8ed436fa8de65773" candidate_uuid: "a722e54d227f4c29a9ed6ce77858003a" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1a22e9119494570b6d2217713fd7e43"
I20260709 13:23:07.922595 15104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16d5db73377a4925b9f1e814ba306fcc" candidate_uuid: "a1a22e9119494570b6d2217713fd7e43" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a722e54d227f4c29a9ed6ce77858003a"
I20260709 13:23:07.937949 15635 leader_election.cc:290] T 34e83f249d9942e99244702be584c8ae P a722e54d227f4c29a9ed6ce77858003a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0efc951052454eec9a58b0cd025945b8 (127.5.126.66:34613), a1a22e9119494570b6d2217713fd7e43 (127.5.126.67:38125)
I20260709 13:23:07.938077 15104 raft_consensus.cc:3060] T 16d5db73377a4925b9f1e814ba306fcc P a722e54d227f4c29a9ed6ce77858003a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:23:07.947934 15155 tablet_bootstrap.cc:492] T bf0b7c8005aa4d8ab97a1499761bf98a P a1a22e9119494570b6d2217713fd7e43: Bootstrap starting.
I20260709 13:23:07.924782 15456 raft_consensus.cc:515] T 2a9523aa8663464686254c8412c37e67 P 0efc951052454eec9a58b0cd025945b8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } } peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } } peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } }
I20260709 13:23:07.956851 14959 raft_consensus.cc:2468] T a2de4fecd70240dd8ed436fa8de65773 P 0efc951052454eec9a58b0cd025945b8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a722e54d227f4c29a9ed6ce77858003a in term 2.
I20260709 13:23:07.962594 15652 raft_consensus.cc:515] T 2956fb66a7f34f3e99f42598fb93178e P a1a22e9119494570b6d2217713fd7e43 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } } peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } } peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } }
I20260709 13:23:07.963369 15154 tablet_bootstrap.cc:492] T bf0b7c8005aa4d8ab97a1499761bf98a P a722e54d227f4c29a9ed6ce77858003a: No bootstrap required, opened a new log
I20260709 13:23:07.964154 15154 ts_tablet_manager.cc:1403] T bf0b7c8005aa4d8ab97a1499761bf98a P a722e54d227f4c29a9ed6ce77858003a: Time spent bootstrapping tablet: real 0.493s	user 0.026s	sys 0.031s
I20260709 13:23:07.966351 15156 tablet_bootstrap.cc:492] T bf0b7c8005aa4d8ab97a1499761bf98a P f3a500981b494979b58d2b1041fec9c8: Bootstrap starting.
I20260709 13:23:07.975482 14953 raft_consensus.cc:1240] T a2de4fecd70240dd8ed436fa8de65773 P 0efc951052454eec9a58b0cd025945b8 [term 2 FOLLOWER]: Rejecting Update request from peer a1a22e9119494570b6d2217713fd7e43 for earlier term 1. Current term is 2. Ops: [1.1-1.1]
I20260709 13:23:07.975790 15456 leader_election.cc:290] T 2a9523aa8663464686254c8412c37e67 P 0efc951052454eec9a58b0cd025945b8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a722e54d227f4c29a9ed6ce77858003a (127.5.126.68:46669), f3a500981b494979b58d2b1041fec9c8 (127.5.126.65:34129)
I20260709 13:23:07.987803 15154 raft_consensus.cc:359] T bf0b7c8005aa4d8ab97a1499761bf98a P a722e54d227f4c29a9ed6ce77858003a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } } peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } } peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } }
I20260709 13:23:07.990078 15154 raft_consensus.cc:385] T bf0b7c8005aa4d8ab97a1499761bf98a P a722e54d227f4c29a9ed6ce77858003a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:23:07.990958 15154 raft_consensus.cc:740] T bf0b7c8005aa4d8ab97a1499761bf98a P a722e54d227f4c29a9ed6ce77858003a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a722e54d227f4c29a9ed6ce77858003a, State: Initialized, Role: FOLLOWER
I20260709 13:23:07.992614 15031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34e83f249d9942e99244702be584c8ae" candidate_uuid: "a722e54d227f4c29a9ed6ce77858003a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1a22e9119494570b6d2217713fd7e43" is_pre_election: true
I20260709 13:23:07.996124 15034 raft_consensus.cc:3060] T affcb03ab55349748a95c103059d2955 P a1a22e9119494570b6d2217713fd7e43 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:23:07.999984 15104 raft_consensus.cc:2468] T 16d5db73377a4925b9f1e814ba306fcc P a722e54d227f4c29a9ed6ce77858003a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1a22e9119494570b6d2217713fd7e43 in term 1.
W20260709 13:23:08.001963 15654 log.cc:927] Time spent T 08dea3083d334745abe54f9b220bd86a P a1a22e9119494570b6d2217713fd7e43: Append to log took a long time: real 0.217s	user 0.001s	sys 0.003s
I20260709 13:23:08.003861 14954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34e83f249d9942e99244702be584c8ae" candidate_uuid: "a722e54d227f4c29a9ed6ce77858003a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0efc951052454eec9a58b0cd025945b8" is_pre_election: true
I20260709 13:23:08.012524 14884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dee43e01ec5d409b877a5c2dbf5b7b77" candidate_uuid: "a722e54d227f4c29a9ed6ce77858003a" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f3a500981b494979b58d2b1041fec9c8" is_pre_election: true
I20260709 13:23:08.016453 15153 tablet_bootstrap.cc:654] T 34e83f249d9942e99244702be584c8ae P 0efc951052454eec9a58b0cd025945b8: Neither blocks nor log segments found. Creating new log.
I20260709 13:23:08.014544 15073 leader_election.cc:304] T a2de4fecd70240dd8ed436fa8de65773 P a722e54d227f4c29a9ed6ce77858003a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0efc951052454eec9a58b0cd025945b8, a722e54d227f4c29a9ed6ce77858003a; no voters: a1a22e9119494570b6d2217713fd7e43
I20260709 13:23:07.993598 15559 consensus_queue.cc:1059] T a2de4fecd70240dd8ed436fa8de65773 P a1a22e9119494570b6d2217713fd7e43 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 }, Status: INVALID_TERM, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.027s
I20260709 13:23:08.021600 14782 catalog_manager.cc:5697] T 2a9523aa8663464686254c8412c37e67 P a722e54d227f4c29a9ed6ce77858003a reported cstate change: term changed from 0 to 1, leader changed from <none> to a722e54d227f4c29a9ed6ce77858003a (127.5.126.68). New cstate: current_term: 1 leader_uuid: "a722e54d227f4c29a9ed6ce77858003a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } health_report { overall_health: UNKNOWN } } }
I20260709 13:23:08.038291 15156 tablet_bootstrap.cc:654] T bf0b7c8005aa4d8ab97a1499761bf98a P f3a500981b494979b58d2b1041fec9c8: Neither blocks nor log segments found. Creating new log.
I20260709 13:23:08.052309 15154 consensus_queue.cc:260] T bf0b7c8005aa4d8ab97a1499761bf98a P a722e54d227f4c29a9ed6ce77858003a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } } peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } } peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } }
I20260709 13:23:08.061785 15108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a9523aa8663464686254c8412c37e67" candidate_uuid: "0efc951052454eec9a58b0cd025945b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a722e54d227f4c29a9ed6ce77858003a" is_pre_election: true
W20260709 13:23:08.069861 15073 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.66:34613, user_credentials={real_user=slave}} blocked reactor thread for 55445.1us
I20260709 13:23:08.071477 15652 leader_election.cc:290] T 2956fb66a7f34f3e99f42598fb93178e P a1a22e9119494570b6d2217713fd7e43 [CANDIDATE]: Term 1 election: Requested vote from peers f3a500981b494979b58d2b1041fec9c8 (127.5.126.65:34129), 0efc951052454eec9a58b0cd025945b8 (127.5.126.66:34613)
I20260709 13:23:08.101506 15154 ts_tablet_manager.cc:1434] T bf0b7c8005aa4d8ab97a1499761bf98a P a722e54d227f4c29a9ed6ce77858003a: Time spent starting tablet: real 0.137s	user 0.009s	sys 0.000s
I20260709 13:23:08.103609 14779 catalog_manager.cc:5697] T a2de4fecd70240dd8ed436fa8de65773 P a1a22e9119494570b6d2217713fd7e43 reported cstate change: term changed from 0 to 1, leader changed from <none> to a1a22e9119494570b6d2217713fd7e43 (127.5.126.67). New cstate: current_term: 1 leader_uuid: "a1a22e9119494570b6d2217713fd7e43" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } health_report { overall_health: UNKNOWN } } }
I20260709 13:23:08.104350 14954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2956fb66a7f34f3e99f42598fb93178e" candidate_uuid: "a1a22e9119494570b6d2217713fd7e43" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0efc951052454eec9a58b0cd025945b8"
I20260709 13:23:08.080291 15579 raft_consensus.cc:2804] T a2de4fecd70240dd8ed436fa8de65773 P a722e54d227f4c29a9ed6ce77858003a [term 2 FOLLOWER]: Leader election won for term 2
W20260709 13:23:08.112015 14999 leader_election.cc:343] T 2956fb66a7f34f3e99f42598fb93178e P a1a22e9119494570b6d2217713fd7e43 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 0efc951052454eec9a58b0cd025945b8 (127.5.126.66:34613): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:23:08.108171 15656 consensus_queue.cc:1048] T 08dea3083d334745abe54f9b220bd86a P 0efc951052454eec9a58b0cd025945b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.012s
I20260709 13:23:08.131956 15608 raft_consensus.cc:3055] T a2de4fecd70240dd8ed436fa8de65773 P a1a22e9119494570b6d2217713fd7e43 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:23:08.111429 15579 raft_consensus.cc:697] T a2de4fecd70240dd8ed436fa8de65773 P a722e54d227f4c29a9ed6ce77858003a [term 2 LEADER]: Becoming Leader. State: Replica: a722e54d227f4c29a9ed6ce77858003a, State: Running, Role: LEADER
I20260709 13:23:08.141233 15154 tablet_bootstrap.cc:492] T 940021bf0c344d01bc3adaae308d968d P a722e54d227f4c29a9ed6ce77858003a: Bootstrap starting.
I20260709 13:23:08.138629 15579 consensus_queue.cc:237] T a2de4fecd70240dd8ed436fa8de65773 P a722e54d227f4c29a9ed6ce77858003a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } } peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } } peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } }
I20260709 13:23:08.172098 14881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2956fb66a7f34f3e99f42598fb93178e" candidate_uuid: "a1a22e9119494570b6d2217713fd7e43" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f3a500981b494979b58d2b1041fec9c8"
I20260709 13:23:08.172924 14881 raft_consensus.cc:3060] T 2956fb66a7f34f3e99f42598fb93178e P f3a500981b494979b58d2b1041fec9c8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:23:08.132495 15608 raft_consensus.cc:740] T a2de4fecd70240dd8ed436fa8de65773 P a1a22e9119494570b6d2217713fd7e43 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a1a22e9119494570b6d2217713fd7e43, State: Running, Role: LEADER
I20260709 13:23:08.205018 14882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16d5db73377a4925b9f1e814ba306fcc" candidate_uuid: "a1a22e9119494570b6d2217713fd7e43" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f3a500981b494979b58d2b1041fec9c8"
I20260709 13:23:08.224866 14882 raft_consensus.cc:3060] T 16d5db73377a4925b9f1e814ba306fcc P f3a500981b494979b58d2b1041fec9c8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:23:08.172176 15607 consensus_queue.cc:1048] T af00ad02fba64998bb25991f6f69f291 P f3a500981b494979b58d2b1041fec9c8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.037s
I20260709 13:23:08.257768 15156 tablet_bootstrap.cc:492] T bf0b7c8005aa4d8ab97a1499761bf98a P f3a500981b494979b58d2b1041fec9c8: No bootstrap required, opened a new log
I20260709 13:23:08.258522 15156 ts_tablet_manager.cc:1403] T bf0b7c8005aa4d8ab97a1499761bf98a P f3a500981b494979b58d2b1041fec9c8: Time spent bootstrapping tablet: real 0.292s	user 0.022s	sys 0.023s
W20260709 13:23:08.263319 15073 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.65:34129, user_credentials={real_user=slave}} blocked reactor thread for 178731us
I20260709 13:23:08.256637 15608 consensus_queue.cc:260] T a2de4fecd70240dd8ed436fa8de65773 P a1a22e9119494570b6d2217713fd7e43 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } } peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } } peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } }
I20260709 13:23:08.301052 15153 tablet_bootstrap.cc:492] T 34e83f249d9942e99244702be584c8ae P 0efc951052454eec9a58b0cd025945b8: No bootstrap required, opened a new log
I20260709 13:23:08.301581 15153 ts_tablet_manager.cc:1403] T 34e83f249d9942e99244702be584c8ae P 0efc951052454eec9a58b0cd025945b8: Time spent bootstrapping tablet: real 0.722s	user 0.027s	sys 0.008s
I20260709 13:23:08.305193 15156 raft_consensus.cc:359] T bf0b7c8005aa4d8ab97a1499761bf98a P f3a500981b494979b58d2b1041fec9c8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } } peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } } peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } }
I20260709 13:23:08.332391 15156 raft_consensus.cc:385] T bf0b7c8005aa4d8ab97a1499761bf98a P f3a500981b494979b58d2b1041fec9c8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:23:08.332701 15156 raft_consensus.cc:740] T bf0b7c8005aa4d8ab97a1499761bf98a P f3a500981b494979b58d2b1041fec9c8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f3a500981b494979b58d2b1041fec9c8, State: Initialized, Role: FOLLOWER
I20260709 13:23:08.333336 15156 consensus_queue.cc:260] T bf0b7c8005aa4d8ab97a1499761bf98a P f3a500981b494979b58d2b1041fec9c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } } peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } } peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } }
I20260709 13:23:08.358161 15154 tablet_bootstrap.cc:654] T 940021bf0c344d01bc3adaae308d968d P a722e54d227f4c29a9ed6ce77858003a: Neither blocks nor log segments found. Creating new log.
I20260709 13:23:08.341228 15156 ts_tablet_manager.cc:1434] T bf0b7c8005aa4d8ab97a1499761bf98a P f3a500981b494979b58d2b1041fec9c8: Time spent starting tablet: real 0.082s	user 0.008s	sys 0.000s
W20260709 13:23:08.335733 15559 consensus_queue.cc:1175] T a2de4fecd70240dd8ed436fa8de65773 P a1a22e9119494570b6d2217713fd7e43 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "0efc951052454eec9a58b0cd025945b8" responder_term: 2 status { last_received { term: 0 index: 0 } last_committed_idx: 0 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer a1a22e9119494570b6d2217713fd7e43 for earlier term 1. Current term is 2. Ops: [1.1-1.1]" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:23:08.372679 14881 raft_consensus.cc:2468] T 2956fb66a7f34f3e99f42598fb93178e P f3a500981b494979b58d2b1041fec9c8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1a22e9119494570b6d2217713fd7e43 in term 1.
I20260709 13:23:08.372917 15153 raft_consensus.cc:359] T 34e83f249d9942e99244702be584c8ae P 0efc951052454eec9a58b0cd025945b8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } } peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } } peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } }
I20260709 13:23:08.373795 15153 raft_consensus.cc:385] T 34e83f249d9942e99244702be584c8ae P 0efc951052454eec9a58b0cd025945b8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:23:08.374094 15153 raft_consensus.cc:740] T 34e83f249d9942e99244702be584c8ae P 0efc951052454eec9a58b0cd025945b8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0efc951052454eec9a58b0cd025945b8, State: Initialized, Role: FOLLOWER
I20260709 13:23:08.352922 15608 raft_consensus.cc:3060] T a2de4fecd70240dd8ed436fa8de65773 P a1a22e9119494570b6d2217713fd7e43 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:23:08.386224 14880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a9523aa8663464686254c8412c37e67" candidate_uuid: "0efc951052454eec9a58b0cd025945b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f3a500981b494979b58d2b1041fec9c8" is_pre_election: true
I20260709 13:23:08.387274 14880 raft_consensus.cc:2393] T 2a9523aa8663464686254c8412c37e67 P f3a500981b494979b58d2b1041fec9c8 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0efc951052454eec9a58b0cd025945b8 in current term 1: Already voted for candidate a722e54d227f4c29a9ed6ce77858003a in this term.
I20260709 13:23:08.384994 15153 consensus_queue.cc:260] T 34e83f249d9942e99244702be584c8ae P 0efc951052454eec9a58b0cd025945b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } } peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } } peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } }
I20260709 13:23:08.401489 15155 tablet_bootstrap.cc:654] T bf0b7c8005aa4d8ab97a1499761bf98a P a1a22e9119494570b6d2217713fd7e43: Neither blocks nor log segments found. Creating new log.
W20260709 13:23:08.416926 14849 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.67:38125, user_credentials={real_user=slave}} blocked reactor thread for 70699.3us
I20260709 13:23:08.418335 15153 ts_tablet_manager.cc:1434] T 34e83f249d9942e99244702be584c8ae P 0efc951052454eec9a58b0cd025945b8: Time spent starting tablet: real 0.116s	user 0.004s	sys 0.003s
I20260709 13:23:08.419759 15153 tablet_bootstrap.cc:492] T 2956fb66a7f34f3e99f42598fb93178e P 0efc951052454eec9a58b0cd025945b8: Bootstrap starting.
I20260709 13:23:08.382215 14882 raft_consensus.cc:2468] T 16d5db73377a4925b9f1e814ba306fcc P f3a500981b494979b58d2b1041fec9c8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1a22e9119494570b6d2217713fd7e43 in term 1.
W20260709 13:23:08.470048 14999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.65:34129, user_credentials={real_user=slave}} blocked reactor thread for 51750.5us
W20260709 13:23:08.464852 15073 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.65:34129, user_credentials={real_user=slave}} blocked reactor thread for 196122us
I20260709 13:23:08.471861 14999 leader_election.cc:304] T 2956fb66a7f34f3e99f42598fb93178e P a1a22e9119494570b6d2217713fd7e43 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a1a22e9119494570b6d2217713fd7e43, f3a500981b494979b58d2b1041fec9c8; no voters: 0efc951052454eec9a58b0cd025945b8
I20260709 13:23:08.468720 14925 leader_election.cc:304] T 2a9523aa8663464686254c8412c37e67 P 0efc951052454eec9a58b0cd025945b8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0efc951052454eec9a58b0cd025945b8; no voters: a722e54d227f4c29a9ed6ce77858003a, f3a500981b494979b58d2b1041fec9c8
I20260709 13:23:08.476090 15073 leader_election.cc:304] T dee43e01ec5d409b877a5c2dbf5b7b77 P a722e54d227f4c29a9ed6ce77858003a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a722e54d227f4c29a9ed6ce77858003a; no voters: a1a22e9119494570b6d2217713fd7e43, f3a500981b494979b58d2b1041fec9c8
I20260709 13:23:08.473848 14999 leader_election.cc:304] T 16d5db73377a4925b9f1e814ba306fcc P a1a22e9119494570b6d2217713fd7e43 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1a22e9119494570b6d2217713fd7e43, f3a500981b494979b58d2b1041fec9c8; no voters: 
W20260709 13:23:08.464179 15072 leader_election.cc:343] T 34e83f249d9942e99244702be584c8ae P a722e54d227f4c29a9ed6ce77858003a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a1a22e9119494570b6d2217713fd7e43 (127.5.126.67:38125): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:23:08.467900 15682 raft_consensus.cc:493] T bf0b7c8005aa4d8ab97a1499761bf98a P a722e54d227f4c29a9ed6ce77858003a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:23:08.460588 15363 consensus_queue.cc:1048] T af00ad02fba64998bb25991f6f69f291 P f3a500981b494979b58d2b1041fec9c8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.016s
I20260709 13:23:08.479436 15581 raft_consensus.cc:3060] T 2a9523aa8663464686254c8412c37e67 P 0efc951052454eec9a58b0cd025945b8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:23:08.489452 15542 raft_consensus.cc:2804] T 2956fb66a7f34f3e99f42598fb93178e P a1a22e9119494570b6d2217713fd7e43 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:23:08.494539 15659 consensus_queue.cc:1048] T 2a9523aa8663464686254c8412c37e67 P a722e54d227f4c29a9ed6ce77858003a [LEADER]: Connected to new peer: Peer: permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260709 13:23:08.491204 15634 raft_consensus.cc:2749] T dee43e01ec5d409b877a5c2dbf5b7b77 P a722e54d227f4c29a9ed6ce77858003a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:23:08.528893 15542 raft_consensus.cc:697] T 2956fb66a7f34f3e99f42598fb93178e P a1a22e9119494570b6d2217713fd7e43 [term 1 LEADER]: Becoming Leader. State: Replica: a1a22e9119494570b6d2217713fd7e43, State: Running, Role: LEADER
I20260709 13:23:08.530164 15153 tablet_bootstrap.cc:654] T 2956fb66a7f34f3e99f42598fb93178e P 0efc951052454eec9a58b0cd025945b8: Neither blocks nor log segments found. Creating new log.
I20260709 13:23:08.529919 15542 consensus_queue.cc:237] T 2956fb66a7f34f3e99f42598fb93178e P a1a22e9119494570b6d2217713fd7e43 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } } peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } } peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } }
I20260709 13:23:08.544334 15581 raft_consensus.cc:2749] T 2a9523aa8663464686254c8412c37e67 P 0efc951052454eec9a58b0cd025945b8 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:23:08.517705 15690 raft_consensus.cc:2804] T 16d5db73377a4925b9f1e814ba306fcc P a1a22e9119494570b6d2217713fd7e43 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:23:08.551851 15690 raft_consensus.cc:697] T 16d5db73377a4925b9f1e814ba306fcc P a1a22e9119494570b6d2217713fd7e43 [term 1 LEADER]: Becoming Leader. State: Replica: a1a22e9119494570b6d2217713fd7e43, State: Running, Role: LEADER
I20260709 13:23:08.552810 15690 consensus_queue.cc:237] T 16d5db73377a4925b9f1e814ba306fcc P a1a22e9119494570b6d2217713fd7e43 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } } peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } } peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } }
I20260709 13:23:08.493728 15682 raft_consensus.cc:515] T bf0b7c8005aa4d8ab97a1499761bf98a P a722e54d227f4c29a9ed6ce77858003a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } } peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } } peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } }
I20260709 13:23:08.551157 15464 raft_consensus.cc:493] T 34e83f249d9942e99244702be584c8ae P 0efc951052454eec9a58b0cd025945b8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:23:08.571367 15154 tablet_bootstrap.cc:492] T 940021bf0c344d01bc3adaae308d968d P a722e54d227f4c29a9ed6ce77858003a: No bootstrap required, opened a new log
I20260709 13:23:08.572199 15154 ts_tablet_manager.cc:1403] T 940021bf0c344d01bc3adaae308d968d P a722e54d227f4c29a9ed6ce77858003a: Time spent bootstrapping tablet: real 0.440s	user 0.018s	sys 0.029s
I20260709 13:23:08.580849 15154 raft_consensus.cc:359] T 940021bf0c344d01bc3adaae308d968d P a722e54d227f4c29a9ed6ce77858003a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } } peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } } peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } }
I20260709 13:23:08.581895 15154 raft_consensus.cc:385] T 940021bf0c344d01bc3adaae308d968d P a722e54d227f4c29a9ed6ce77858003a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:23:08.582199 15682 leader_election.cc:290] T bf0b7c8005aa4d8ab97a1499761bf98a P a722e54d227f4c29a9ed6ce77858003a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a1a22e9119494570b6d2217713fd7e43 (127.5.126.67:38125), f3a500981b494979b58d2b1041fec9c8 (127.5.126.65:34129)
I20260709 13:23:08.582244 15154 raft_consensus.cc:740] T 940021bf0c344d01bc3adaae308d968d P a722e54d227f4c29a9ed6ce77858003a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a722e54d227f4c29a9ed6ce77858003a, State: Initialized, Role: FOLLOWER
I20260709 13:23:08.584124 15154 consensus_queue.cc:260] T 940021bf0c344d01bc3adaae308d968d P a722e54d227f4c29a9ed6ce77858003a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } } peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } } peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } }
I20260709 13:23:08.599520 15155 tablet_bootstrap.cc:492] T bf0b7c8005aa4d8ab97a1499761bf98a P a1a22e9119494570b6d2217713fd7e43: No bootstrap required, opened a new log
I20260709 13:23:08.600417 15155 ts_tablet_manager.cc:1403] T bf0b7c8005aa4d8ab97a1499761bf98a P a1a22e9119494570b6d2217713fd7e43: Time spent bootstrapping tablet: real 0.653s	user 0.024s	sys 0.008s
I20260709 13:23:08.568732 15464 raft_consensus.cc:515] T 34e83f249d9942e99244702be584c8ae P 0efc951052454eec9a58b0cd025945b8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } } peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } } peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } }
I20260709 13:23:08.604210 15154 ts_tablet_manager.cc:1434] T 940021bf0c344d01bc3adaae308d968d P a722e54d227f4c29a9ed6ce77858003a: Time spent starting tablet: real 0.032s	user 0.009s	sys 0.000s
I20260709 13:23:08.606276 15029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf0b7c8005aa4d8ab97a1499761bf98a" candidate_uuid: "a722e54d227f4c29a9ed6ce77858003a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1a22e9119494570b6d2217713fd7e43" is_pre_election: true
I20260709 13:23:08.605144 15464 leader_election.cc:290] T 34e83f249d9942e99244702be584c8ae P 0efc951052454eec9a58b0cd025945b8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a1a22e9119494570b6d2217713fd7e43 (127.5.126.67:38125), a722e54d227f4c29a9ed6ce77858003a (127.5.126.68:46669)
I20260709 13:23:08.615803 15028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34e83f249d9942e99244702be584c8ae" candidate_uuid: "0efc951052454eec9a58b0cd025945b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1a22e9119494570b6d2217713fd7e43" is_pre_election: true
I20260709 13:23:08.618191 15104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34e83f249d9942e99244702be584c8ae" candidate_uuid: "0efc951052454eec9a58b0cd025945b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a722e54d227f4c29a9ed6ce77858003a" is_pre_election: true
W20260709 13:23:08.619858 15073 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.65:34129, user_credentials={real_user=slave}} blocked reactor thread for 139585us
W20260709 13:23:08.621228 14924 leader_election.cc:343] T 34e83f249d9942e99244702be584c8ae P 0efc951052454eec9a58b0cd025945b8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a1a22e9119494570b6d2217713fd7e43 (127.5.126.67:38125): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:23:08.618866 15104 raft_consensus.cc:2468] T 34e83f249d9942e99244702be584c8ae P a722e54d227f4c29a9ed6ce77858003a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0efc951052454eec9a58b0cd025945b8 in term 0.
I20260709 13:23:08.628363 14925 leader_election.cc:304] T 34e83f249d9942e99244702be584c8ae P 0efc951052454eec9a58b0cd025945b8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0efc951052454eec9a58b0cd025945b8, a722e54d227f4c29a9ed6ce77858003a; no voters: a1a22e9119494570b6d2217713fd7e43
I20260709 13:23:08.632258 15156 tablet_bootstrap.cc:492] T 940021bf0c344d01bc3adaae308d968d P f3a500981b494979b58d2b1041fec9c8: Bootstrap starting.
I20260709 13:23:08.633394 15363 raft_consensus.cc:493] T bf0b7c8005aa4d8ab97a1499761bf98a P f3a500981b494979b58d2b1041fec9c8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:23:08.633876 15363 raft_consensus.cc:515] T bf0b7c8005aa4d8ab97a1499761bf98a P f3a500981b494979b58d2b1041fec9c8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } } peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } } peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } }
I20260709 13:23:08.636438 14884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf0b7c8005aa4d8ab97a1499761bf98a" candidate_uuid: "a722e54d227f4c29a9ed6ce77858003a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f3a500981b494979b58d2b1041fec9c8" is_pre_election: true
I20260709 13:23:08.637200 14884 raft_consensus.cc:2468] T bf0b7c8005aa4d8ab97a1499761bf98a P f3a500981b494979b58d2b1041fec9c8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a722e54d227f4c29a9ed6ce77858003a in term 0.
I20260709 13:23:08.637130 15104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf0b7c8005aa4d8ab97a1499761bf98a" candidate_uuid: "f3a500981b494979b58d2b1041fec9c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a722e54d227f4c29a9ed6ce77858003a" is_pre_election: true
I20260709 13:23:08.637876 15363 leader_election.cc:290] T bf0b7c8005aa4d8ab97a1499761bf98a P f3a500981b494979b58d2b1041fec9c8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a1a22e9119494570b6d2217713fd7e43 (127.5.126.67:38125), a722e54d227f4c29a9ed6ce77858003a (127.5.126.68:46669)
I20260709 13:23:08.638456 15104 raft_consensus.cc:2468] T bf0b7c8005aa4d8ab97a1499761bf98a P a722e54d227f4c29a9ed6ce77858003a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f3a500981b494979b58d2b1041fec9c8 in term 0.
I20260709 13:23:08.639259 14960 raft_consensus.cc:1275] T a2de4fecd70240dd8ed436fa8de65773 P 0efc951052454eec9a58b0cd025945b8 [term 2 FOLLOWER]: Refusing update from remote peer a722e54d227f4c29a9ed6ce77858003a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 13:23:08.641300 14850 leader_election.cc:304] T bf0b7c8005aa4d8ab97a1499761bf98a P f3a500981b494979b58d2b1041fec9c8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a722e54d227f4c29a9ed6ce77858003a, f3a500981b494979b58d2b1041fec9c8; no voters: 
I20260709 13:23:08.642094 15452 raft_consensus.cc:2804] T bf0b7c8005aa4d8ab97a1499761bf98a P f3a500981b494979b58d2b1041fec9c8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:23:08.642449 15452 raft_consensus.cc:493] T bf0b7c8005aa4d8ab97a1499761bf98a P f3a500981b494979b58d2b1041fec9c8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:23:08.642771 15452 raft_consensus.cc:3060] T bf0b7c8005aa4d8ab97a1499761bf98a P f3a500981b494979b58d2b1041fec9c8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:23:08.646406 15156 tablet_bootstrap.cc:654] T 940021bf0c344d01bc3adaae308d968d P f3a500981b494979b58d2b1041fec9c8: Neither blocks nor log segments found. Creating new log.
I20260709 13:23:08.660351 15693 raft_consensus.cc:2804] T 34e83f249d9942e99244702be584c8ae P 0efc951052454eec9a58b0cd025945b8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:23:08.661100 15693 raft_consensus.cc:493] T 34e83f249d9942e99244702be584c8ae P 0efc951052454eec9a58b0cd025945b8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:23:08.661566 15693 raft_consensus.cc:3060] T 34e83f249d9942e99244702be584c8ae P 0efc951052454eec9a58b0cd025945b8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:23:08.691501 15452 raft_consensus.cc:515] T bf0b7c8005aa4d8ab97a1499761bf98a P f3a500981b494979b58d2b1041fec9c8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } } peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } } peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } }
I20260709 13:23:08.714567 15452 leader_election.cc:290] T bf0b7c8005aa4d8ab97a1499761bf98a P f3a500981b494979b58d2b1041fec9c8 [CANDIDATE]: Term 1 election: Requested vote from peers a1a22e9119494570b6d2217713fd7e43 (127.5.126.67:38125), a722e54d227f4c29a9ed6ce77858003a (127.5.126.68:46669)
W20260709 13:23:08.776292 14999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.66:34613, user_credentials={real_user=slave}} blocked reactor thread for 122176us
I20260709 13:23:08.782811 15155 raft_consensus.cc:359] T bf0b7c8005aa4d8ab97a1499761bf98a P a1a22e9119494570b6d2217713fd7e43 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } } peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } } peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } }
I20260709 13:23:08.783576 15155 raft_consensus.cc:385] T bf0b7c8005aa4d8ab97a1499761bf98a P a1a22e9119494570b6d2217713fd7e43 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:23:08.783875 15155 raft_consensus.cc:740] T bf0b7c8005aa4d8ab97a1499761bf98a P a1a22e9119494570b6d2217713fd7e43 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a1a22e9119494570b6d2217713fd7e43, State: Initialized, Role: FOLLOWER
I20260709 13:23:08.783645 15032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf0b7c8005aa4d8ab97a1499761bf98a" candidate_uuid: "f3a500981b494979b58d2b1041fec9c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1a22e9119494570b6d2217713fd7e43"
I20260709 13:23:08.785269 15153 tablet_bootstrap.cc:492] T 2956fb66a7f34f3e99f42598fb93178e P 0efc951052454eec9a58b0cd025945b8: No bootstrap required, opened a new log
I20260709 13:23:08.784976 15155 consensus_queue.cc:260] T bf0b7c8005aa4d8ab97a1499761bf98a P a1a22e9119494570b6d2217713fd7e43 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } } peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } } peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } }
I20260709 13:23:08.786108 15032 raft_consensus.cc:3060] T bf0b7c8005aa4d8ab97a1499761bf98a P a1a22e9119494570b6d2217713fd7e43 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:23:08.787621 15155 ts_tablet_manager.cc:1434] T bf0b7c8005aa4d8ab97a1499761bf98a P a1a22e9119494570b6d2217713fd7e43: Time spent starting tablet: real 0.187s	user 0.008s	sys 0.000s
I20260709 13:23:08.786732 15028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf0b7c8005aa4d8ab97a1499761bf98a" candidate_uuid: "f3a500981b494979b58d2b1041fec9c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1a22e9119494570b6d2217713fd7e43" is_pre_election: true
I20260709 13:23:08.791958 15155 tablet_bootstrap.cc:492] T 34e83f249d9942e99244702be584c8ae P a1a22e9119494570b6d2217713fd7e43: Bootstrap starting.
I20260709 13:23:08.795262 15103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf0b7c8005aa4d8ab97a1499761bf98a" candidate_uuid: "f3a500981b494979b58d2b1041fec9c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a722e54d227f4c29a9ed6ce77858003a"
I20260709 13:23:08.796075 15103 raft_consensus.cc:3060] T bf0b7c8005aa4d8ab97a1499761bf98a P a722e54d227f4c29a9ed6ce77858003a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:23:08.785889 15153 ts_tablet_manager.cc:1403] T 2956fb66a7f34f3e99f42598fb93178e P 0efc951052454eec9a58b0cd025945b8: Time spent bootstrapping tablet: real 0.366s	user 0.016s	sys 0.035s
W20260709 13:23:08.800241 15072 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.67:38125, user_credentials={real_user=slave}} blocked reactor thread for 84976.5us
I20260709 13:23:08.803206 15702 raft_consensus.cc:493] T 940021bf0c344d01bc3adaae308d968d P a722e54d227f4c29a9ed6ce77858003a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:23:08.803712 15702 raft_consensus.cc:515] T 940021bf0c344d01bc3adaae308d968d P a722e54d227f4c29a9ed6ce77858003a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } } peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } } peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } }
I20260709 13:23:08.804998 15029 raft_consensus.cc:1275] T a2de4fecd70240dd8ed436fa8de65773 P a1a22e9119494570b6d2217713fd7e43 [term 2 FOLLOWER]: Refusing update from remote peer a722e54d227f4c29a9ed6ce77858003a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 1. (term mismatch)
I20260709 13:23:08.805446 15029 pending_rounds.cc:85] T a2de4fecd70240dd8ed436fa8de65773 P a1a22e9119494570b6d2217713fd7e43: Aborting all ops after (but not including) 0
I20260709 13:23:08.805696 15029 pending_rounds.cc:107] T a2de4fecd70240dd8ed436fa8de65773 P a1a22e9119494570b6d2217713fd7e43: Aborting uncommitted NO_OP operation due to leader change: 1.1
I20260709 13:23:08.805727 15155 tablet_bootstrap.cc:654] T 34e83f249d9942e99244702be584c8ae P a1a22e9119494570b6d2217713fd7e43: Neither blocks nor log segments found. Creating new log.
I20260709 13:23:08.806191 15029 raft_consensus.cc:2889] T a2de4fecd70240dd8ed436fa8de65773 P a1a22e9119494570b6d2217713fd7e43 [term 2 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:23:08.799124 15032 raft_consensus.cc:2468] T bf0b7c8005aa4d8ab97a1499761bf98a P a1a22e9119494570b6d2217713fd7e43 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f3a500981b494979b58d2b1041fec9c8 in term 1.
I20260709 13:23:08.808450 15508 consensus_queue.cc:1048] T a2de4fecd70240dd8ed436fa8de65773 P a722e54d227f4c29a9ed6ce77858003a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:23:08.805999 15702 leader_election.cc:290] T 940021bf0c344d01bc3adaae308d968d P a722e54d227f4c29a9ed6ce77858003a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f3a500981b494979b58d2b1041fec9c8 (127.5.126.65:34129), 0efc951052454eec9a58b0cd025945b8 (127.5.126.66:34613)
I20260709 13:23:08.810885 14849 leader_election.cc:304] T bf0b7c8005aa4d8ab97a1499761bf98a P f3a500981b494979b58d2b1041fec9c8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1a22e9119494570b6d2217713fd7e43, f3a500981b494979b58d2b1041fec9c8; no voters: 
I20260709 13:23:08.812738 15605 raft_consensus.cc:2804] T bf0b7c8005aa4d8ab97a1499761bf98a P f3a500981b494979b58d2b1041fec9c8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:23:08.813390 15153 raft_consensus.cc:359] T 2956fb66a7f34f3e99f42598fb93178e P 0efc951052454eec9a58b0cd025945b8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } } peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } } peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } }
I20260709 13:23:08.813449 15605 raft_consensus.cc:697] T bf0b7c8005aa4d8ab97a1499761bf98a P f3a500981b494979b58d2b1041fec9c8 [term 1 LEADER]: Becoming Leader. State: Replica: f3a500981b494979b58d2b1041fec9c8, State: Running, Role: LEADER
I20260709 13:23:08.814224 15153 raft_consensus.cc:385] T 2956fb66a7f34f3e99f42598fb93178e P 0efc951052454eec9a58b0cd025945b8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:23:08.814594 15153 raft_consensus.cc:740] T 2956fb66a7f34f3e99f42598fb93178e P 0efc951052454eec9a58b0cd025945b8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0efc951052454eec9a58b0cd025945b8, State: Initialized, Role: FOLLOWER
I20260709 13:23:08.815373 15153 consensus_queue.cc:260] T 2956fb66a7f34f3e99f42598fb93178e P 0efc951052454eec9a58b0cd025945b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } } peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } } peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } }
I20260709 13:23:08.815038 15605 consensus_queue.cc:237] T bf0b7c8005aa4d8ab97a1499761bf98a P f3a500981b494979b58d2b1041fec9c8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } } peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } } peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } }
I20260709 13:23:08.818967 15153 ts_tablet_manager.cc:1434] T 2956fb66a7f34f3e99f42598fb93178e P 0efc951052454eec9a58b0cd025945b8: Time spent starting tablet: real 0.019s	user 0.007s	sys 0.000s
I20260709 13:23:08.820186 15153 tablet_bootstrap.cc:492] T 940021bf0c344d01bc3adaae308d968d P 0efc951052454eec9a58b0cd025945b8: Bootstrap starting.
W20260709 13:23:08.828502 15073 leader_election.cc:343] T 34e83f249d9942e99244702be584c8ae P a722e54d227f4c29a9ed6ce77858003a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0efc951052454eec9a58b0cd025945b8 (127.5.126.66:34613): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:23:08.829177 15073 leader_election.cc:304] T 34e83f249d9942e99244702be584c8ae P a722e54d227f4c29a9ed6ce77858003a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a722e54d227f4c29a9ed6ce77858003a; no voters: 0efc951052454eec9a58b0cd025945b8, a1a22e9119494570b6d2217713fd7e43
I20260709 13:23:08.830013 15702 raft_consensus.cc:2749] T 34e83f249d9942e99244702be584c8ae P a722e54d227f4c29a9ed6ce77858003a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:23:08.831449 15103 raft_consensus.cc:2468] T bf0b7c8005aa4d8ab97a1499761bf98a P a722e54d227f4c29a9ed6ce77858003a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f3a500981b494979b58d2b1041fec9c8 in term 1.
I20260709 13:23:08.842187 14779 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:54438 (request call id 69) took 1849 ms. Trace:
W20260709 13:23:08.842303 14999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.65:34129, user_credentials={real_user=slave}} blocked reactor thread for 56578.1us
I20260709 13:23:08.843890 14779 rpcz_store.cc:276] 0709 13:23:06.993304 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:23:06.993485 (+   181us) service_pool.cc:224] Handling call
0709 13:23:08.842116 (+1848631us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:23:08.262863 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:23:08.343436 (+ 80573us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:23:08.343479 (+    43us) write_op.cc:435] Acquired schema lock
0709 13:23:08.343499 (+    20us) tablet.cc:662] Decoding operations
0709 13:23:08.343930 (+   431us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:23:08.343993 (+    63us) write_op.cc:641] Partition lock acquired for write op
0709 13:23:08.344051 (+    58us) tablet.cc:685] Acquiring locks for 1 operations
0709 13:23:08.344255 (+   204us) tablet.cc:701] Row locks acquired
0709 13:23:08.344267 (+    12us) write_op.cc:260] PREPARE: finished
0709 13:23:08.344402 (+   135us) write_op.cc:270] Start()
0709 13:23:08.344504 (+   102us) write_op.cc:276] Timestamp: P: 1783603388344357 usec, L: 0
0709 13:23:08.344520 (+    16us) op_driver.cc:348] REPLICATION: starting
0709 13:23:08.586893 (+242373us) log.cc:844] Serialized 537 byte log entry
0709 13:23:08.625099 (+ 38206us) op_driver.cc:464] REPLICATION: finished
0709 13:23:08.629309 (+  4210us) write_op.cc:301] APPLY: starting
0709 13:23:08.633858 (+  4549us) spinlock_profiling.cc:243] Waited 218 ms on lock 0x7b54005915d4. stack: 00007fcc0c88b343 00007fcc0c88b240 00007fcc0c21a1d4 00007fcc15f58304 00007fcc15f58299 00007fcc0f913571 00007fcc0f9a5e28 00007fcc133e0581 00007fcc133dfd58 00007fcc133e49f1 00007fcc133e49a9 00007fcc133e4939 00007fcc133e4901 00007fcc133e3b2d 000000000038f354 000000000038f199
0709 13:23:08.651517 (+ 17659us) tablet.cc:1367] starting BulkCheckPresence
0709 13:23:08.668216 (+ 16699us) tablet.cc:1370] finished BulkCheckPresence
0709 13:23:08.668253 (+    37us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:23:08.668548 (+   295us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:23:08.668705 (+   157us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 13:23:08.687396 (+ 18691us) write_op.cc:312] APPLY: finished
0709 13:23:08.687637 (+   241us) log.cc:844] Serialized 22 byte log entry
0709 13:23:08.687808 (+   171us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:23:08.687887 (+    79us) write_op.cc:454] Released schema lock
0709 13:23:08.687929 (+    42us) write_op.cc:341] FINISH: Updating metrics
0709 13:23:08.689810 (+  1881us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:23:08.689839 (+    29us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":54549,"reported_tablets":14,"child_traces":[["op",{"apply.queue_time_us":506,"apply.run_cpu_time_us":1756,"apply.run_wall_time_us":61796,"num_ops":1,"prepare.queue_time_us":140540,"prepare.run_cpu_time_us":7406,"prepare.run_wall_time_us":377048,"replication_time_us":274549,"spinlock_wait_cycles":501309184}]]}
I20260709 13:23:08.869117 15156 tablet_bootstrap.cc:492] T 940021bf0c344d01bc3adaae308d968d P f3a500981b494979b58d2b1041fec9c8: No bootstrap required, opened a new log
I20260709 13:23:08.883764 15156 ts_tablet_manager.cc:1403] T 940021bf0c344d01bc3adaae308d968d P f3a500981b494979b58d2b1041fec9c8: Time spent bootstrapping tablet: real 0.254s	user 0.011s	sys 0.021s
I20260709 13:23:08.870513 15674 consensus_queue.cc:1048] T a2de4fecd70240dd8ed436fa8de65773 P a722e54d227f4c29a9ed6ce77858003a [LEADER]: Connected to new peer: Peer: permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:23:08.887892 15156 raft_consensus.cc:359] T 940021bf0c344d01bc3adaae308d968d P f3a500981b494979b58d2b1041fec9c8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } } peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } } peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } }
I20260709 13:23:08.888924 15156 raft_consensus.cc:385] T 940021bf0c344d01bc3adaae308d968d P f3a500981b494979b58d2b1041fec9c8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:23:08.889273 15156 raft_consensus.cc:740] T 940021bf0c344d01bc3adaae308d968d P f3a500981b494979b58d2b1041fec9c8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f3a500981b494979b58d2b1041fec9c8, State: Initialized, Role: FOLLOWER
I20260709 13:23:08.890273 15156 consensus_queue.cc:260] T 940021bf0c344d01bc3adaae308d968d P f3a500981b494979b58d2b1041fec9c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } } peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } } peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } }
I20260709 13:23:08.893563 15156 ts_tablet_manager.cc:1434] T 940021bf0c344d01bc3adaae308d968d P f3a500981b494979b58d2b1041fec9c8: Time spent starting tablet: real 0.009s	user 0.003s	sys 0.004s
I20260709 13:23:08.874306 15693 raft_consensus.cc:515] T 34e83f249d9942e99244702be584c8ae P 0efc951052454eec9a58b0cd025945b8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } } peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } } peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } }
I20260709 13:23:08.899219 15032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34e83f249d9942e99244702be584c8ae" candidate_uuid: "0efc951052454eec9a58b0cd025945b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1a22e9119494570b6d2217713fd7e43"
W20260709 13:23:08.900796 14924 leader_election.cc:343] T 34e83f249d9942e99244702be584c8ae P 0efc951052454eec9a58b0cd025945b8 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer a1a22e9119494570b6d2217713fd7e43 (127.5.126.67:38125): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:23:08.916684 14781 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:54420 (request call id 66) took 1039 ms. Trace:
I20260709 13:23:08.917485 14781 rpcz_store.cc:276] 0709 13:23:07.880217 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:23:07.883162 (+  2945us) service_pool.cc:224] Handling call
0709 13:23:08.916608 (+1033446us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":58280,"reported_tablets":2}
I20260709 13:23:08.920078 14783 catalog_manager.cc:5697] T af00ad02fba64998bb25991f6f69f291 P 0efc951052454eec9a58b0cd025945b8 reported cstate change: term changed from 0 to 1, leader changed from <none> to f3a500981b494979b58d2b1041fec9c8 (127.5.126.65). New cstate: current_term: 1 leader_uuid: "f3a500981b494979b58d2b1041fec9c8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } } peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } } peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } } }
I20260709 13:23:08.938352 15153 tablet_bootstrap.cc:654] T 940021bf0c344d01bc3adaae308d968d P 0efc951052454eec9a58b0cd025945b8: Neither blocks nor log segments found. Creating new log.
I20260709 13:23:08.954103 15456 raft_consensus.cc:493] T 2956fb66a7f34f3e99f42598fb93178e P 0efc951052454eec9a58b0cd025945b8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:23:08.954756 15456 raft_consensus.cc:515] T 2956fb66a7f34f3e99f42598fb93178e P 0efc951052454eec9a58b0cd025945b8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } } peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } } peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } }
I20260709 13:23:08.957226 15456 leader_election.cc:290] T 2956fb66a7f34f3e99f42598fb93178e P 0efc951052454eec9a58b0cd025945b8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f3a500981b494979b58d2b1041fec9c8 (127.5.126.65:34129), a1a22e9119494570b6d2217713fd7e43 (127.5.126.67:38125)
I20260709 13:23:08.959184 14880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2956fb66a7f34f3e99f42598fb93178e" candidate_uuid: "0efc951052454eec9a58b0cd025945b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f3a500981b494979b58d2b1041fec9c8" is_pre_election: true
I20260709 13:23:08.960248 14880 raft_consensus.cc:2393] T 2956fb66a7f34f3e99f42598fb93178e P f3a500981b494979b58d2b1041fec9c8 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0efc951052454eec9a58b0cd025945b8 in current term 1: Already voted for candidate a1a22e9119494570b6d2217713fd7e43 in this term.
I20260709 13:23:08.969311 15153 tablet_bootstrap.cc:492] T 940021bf0c344d01bc3adaae308d968d P 0efc951052454eec9a58b0cd025945b8: No bootstrap required, opened a new log
I20260709 13:23:08.970008 15153 ts_tablet_manager.cc:1403] T 940021bf0c344d01bc3adaae308d968d P 0efc951052454eec9a58b0cd025945b8: Time spent bootstrapping tablet: real 0.150s	user 0.013s	sys 0.002s
I20260709 13:23:08.973232 15153 raft_consensus.cc:359] T 940021bf0c344d01bc3adaae308d968d P 0efc951052454eec9a58b0cd025945b8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } } peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } } peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } }
I20260709 13:23:08.974637 15032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2956fb66a7f34f3e99f42598fb93178e" candidate_uuid: "0efc951052454eec9a58b0cd025945b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1a22e9119494570b6d2217713fd7e43" is_pre_election: true
I20260709 13:23:08.975034 15153 raft_consensus.cc:385] T 940021bf0c344d01bc3adaae308d968d P 0efc951052454eec9a58b0cd025945b8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:23:08.976336 14924 leader_election.cc:304] T 2956fb66a7f34f3e99f42598fb93178e P 0efc951052454eec9a58b0cd025945b8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0efc951052454eec9a58b0cd025945b8; no voters: a1a22e9119494570b6d2217713fd7e43, f3a500981b494979b58d2b1041fec9c8
I20260709 13:23:08.980335 15155 tablet_bootstrap.cc:492] T 34e83f249d9942e99244702be584c8ae P a1a22e9119494570b6d2217713fd7e43: No bootstrap required, opened a new log
I20260709 13:23:08.980984 15155 ts_tablet_manager.cc:1403] T 34e83f249d9942e99244702be584c8ae P a1a22e9119494570b6d2217713fd7e43: Time spent bootstrapping tablet: real 0.189s	user 0.039s	sys 0.057s
I20260709 13:23:08.981185 15589 raft_consensus.cc:3060] T 2956fb66a7f34f3e99f42598fb93178e P 0efc951052454eec9a58b0cd025945b8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:23:08.981348 14880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "940021bf0c344d01bc3adaae308d968d" candidate_uuid: "a722e54d227f4c29a9ed6ce77858003a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f3a500981b494979b58d2b1041fec9c8" is_pre_election: true
I20260709 13:23:08.981016 15153 raft_consensus.cc:740] T 940021bf0c344d01bc3adaae308d968d P 0efc951052454eec9a58b0cd025945b8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0efc951052454eec9a58b0cd025945b8, State: Initialized, Role: FOLLOWER
I20260709 13:23:08.982189 14880 raft_consensus.cc:2468] T 940021bf0c344d01bc3adaae308d968d P f3a500981b494979b58d2b1041fec9c8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a722e54d227f4c29a9ed6ce77858003a in term 0.
I20260709 13:23:08.984225 14779 catalog_manager.cc:5697] T 2956fb66a7f34f3e99f42598fb93178e P a1a22e9119494570b6d2217713fd7e43 reported cstate change: term changed from 0 to 1, leader changed from <none> to a1a22e9119494570b6d2217713fd7e43 (127.5.126.67). New cstate: current_term: 1 leader_uuid: "a1a22e9119494570b6d2217713fd7e43" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } health_report { overall_health: HEALTHY } } }
I20260709 13:23:08.985510 15103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34e83f249d9942e99244702be584c8ae" candidate_uuid: "0efc951052454eec9a58b0cd025945b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a722e54d227f4c29a9ed6ce77858003a"
I20260709 13:23:08.982784 15153 consensus_queue.cc:260] T 940021bf0c344d01bc3adaae308d968d P 0efc951052454eec9a58b0cd025945b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } } peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } } peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } }
I20260709 13:23:08.986230 15103 raft_consensus.cc:3060] T 34e83f249d9942e99244702be584c8ae P a722e54d227f4c29a9ed6ce77858003a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:23:08.986116 14779 catalog_manager.cc:5697] T a2de4fecd70240dd8ed436fa8de65773 P a1a22e9119494570b6d2217713fd7e43 reported cstate change: term changed from 1 to 2, leader changed from a1a22e9119494570b6d2217713fd7e43 (127.5.126.67) to a722e54d227f4c29a9ed6ce77858003a (127.5.126.68). New cstate: current_term: 2 leader_uuid: "a722e54d227f4c29a9ed6ce77858003a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } } peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } } peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } } }
I20260709 13:23:08.988197 15153 ts_tablet_manager.cc:1434] T 940021bf0c344d01bc3adaae308d968d P 0efc951052454eec9a58b0cd025945b8: Time spent starting tablet: real 0.018s	user 0.007s	sys 0.001s
I20260709 13:23:08.987818 14779 catalog_manager.cc:5697] T 16d5db73377a4925b9f1e814ba306fcc P a1a22e9119494570b6d2217713fd7e43 reported cstate change: term changed from 0 to 1, leader changed from <none> to a1a22e9119494570b6d2217713fd7e43 (127.5.126.67). New cstate: current_term: 1 leader_uuid: "a1a22e9119494570b6d2217713fd7e43" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } health_report { overall_health: UNKNOWN } } }
I20260709 13:23:08.989367 15155 raft_consensus.cc:359] T 34e83f249d9942e99244702be584c8ae P a1a22e9119494570b6d2217713fd7e43 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } } peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } } peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } }
I20260709 13:23:08.990285 15155 raft_consensus.cc:385] T 34e83f249d9942e99244702be584c8ae P a1a22e9119494570b6d2217713fd7e43 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:23:08.990582 15155 raft_consensus.cc:740] T 34e83f249d9942e99244702be584c8ae P a1a22e9119494570b6d2217713fd7e43 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a1a22e9119494570b6d2217713fd7e43, State: Initialized, Role: FOLLOWER
I20260709 13:23:08.991459 15155 consensus_queue.cc:260] T 34e83f249d9942e99244702be584c8ae P a1a22e9119494570b6d2217713fd7e43 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } } peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } } peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } }
I20260709 13:23:08.992399 14958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "940021bf0c344d01bc3adaae308d968d" candidate_uuid: "a722e54d227f4c29a9ed6ce77858003a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0efc951052454eec9a58b0cd025945b8" is_pre_election: true
I20260709 13:23:08.993835 15155 ts_tablet_manager.cc:1434] T 34e83f249d9942e99244702be584c8ae P a1a22e9119494570b6d2217713fd7e43: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.000s
I20260709 13:23:08.993590 14958 raft_consensus.cc:2468] T 940021bf0c344d01bc3adaae308d968d P 0efc951052454eec9a58b0cd025945b8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a722e54d227f4c29a9ed6ce77858003a in term 0.
I20260709 13:23:09.010340 15690 consensus_queue.cc:1048] T 2956fb66a7f34f3e99f42598fb93178e P a1a22e9119494570b6d2217713fd7e43 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:23:09.028187 15693 leader_election.cc:290] T 34e83f249d9942e99244702be584c8ae P 0efc951052454eec9a58b0cd025945b8 [CANDIDATE]: Term 1 election: Requested vote from peers a1a22e9119494570b6d2217713fd7e43 (127.5.126.67:38125), a722e54d227f4c29a9ed6ce77858003a (127.5.126.68:46669)
W20260709 13:23:09.046095 14830 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:23:09.031628 15589 raft_consensus.cc:2749] T 2956fb66a7f34f3e99f42598fb93178e P 0efc951052454eec9a58b0cd025945b8 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:23:09.060933 15690 consensus_queue.cc:1048] T 2956fb66a7f34f3e99f42598fb93178e P a1a22e9119494570b6d2217713fd7e43 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:23:09.065059 15103 raft_consensus.cc:2468] T 34e83f249d9942e99244702be584c8ae P a722e54d227f4c29a9ed6ce77858003a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0efc951052454eec9a58b0cd025945b8 in term 1.
I20260709 13:23:09.066725 14925 leader_election.cc:304] T 34e83f249d9942e99244702be584c8ae P 0efc951052454eec9a58b0cd025945b8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0efc951052454eec9a58b0cd025945b8, a722e54d227f4c29a9ed6ce77858003a; no voters: a1a22e9119494570b6d2217713fd7e43
I20260709 13:23:09.067376 15073 leader_election.cc:304] T bf0b7c8005aa4d8ab97a1499761bf98a P a722e54d227f4c29a9ed6ce77858003a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a722e54d227f4c29a9ed6ce77858003a, f3a500981b494979b58d2b1041fec9c8; no voters: a1a22e9119494570b6d2217713fd7e43
I20260709 13:23:09.068365 15589 raft_consensus.cc:2804] T 34e83f249d9942e99244702be584c8ae P 0efc951052454eec9a58b0cd025945b8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:23:09.069685 15589 raft_consensus.cc:697] T 34e83f249d9942e99244702be584c8ae P 0efc951052454eec9a58b0cd025945b8 [term 1 LEADER]: Becoming Leader. State: Replica: 0efc951052454eec9a58b0cd025945b8, State: Running, Role: LEADER
I20260709 13:23:09.070634 15589 consensus_queue.cc:237] T 34e83f249d9942e99244702be584c8ae P 0efc951052454eec9a58b0cd025945b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } } peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } } peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } }
I20260709 13:23:09.069094 15659 raft_consensus.cc:2764] T bf0b7c8005aa4d8ab97a1499761bf98a P a722e54d227f4c29a9ed6ce77858003a [term 1 FOLLOWER]: Leader pre-election decision vote started in defunct term 0: won
I20260709 13:23:09.076289 15073 leader_election.cc:304] T 940021bf0c344d01bc3adaae308d968d P a722e54d227f4c29a9ed6ce77858003a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a722e54d227f4c29a9ed6ce77858003a, f3a500981b494979b58d2b1041fec9c8; no voters: 
I20260709 13:23:09.077804 14781 catalog_manager.cc:5697] T bf0b7c8005aa4d8ab97a1499761bf98a P f3a500981b494979b58d2b1041fec9c8 reported cstate change: term changed from 0 to 1, leader changed from <none> to f3a500981b494979b58d2b1041fec9c8 (127.5.126.65). New cstate: current_term: 1 leader_uuid: "f3a500981b494979b58d2b1041fec9c8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } health_report { overall_health: HEALTHY } } }
I20260709 13:23:09.079886 15659 raft_consensus.cc:2804] T 940021bf0c344d01bc3adaae308d968d P a722e54d227f4c29a9ed6ce77858003a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:23:09.083900 15659 raft_consensus.cc:493] T 940021bf0c344d01bc3adaae308d968d P a722e54d227f4c29a9ed6ce77858003a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:23:09.088853 15659 raft_consensus.cc:3060] T 940021bf0c344d01bc3adaae308d968d P a722e54d227f4c29a9ed6ce77858003a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:23:09.087476 15674 consensus_queue.cc:1048] T 2a9523aa8663464686254c8412c37e67 P a722e54d227f4c29a9ed6ce77858003a [LEADER]: Connected to new peer: Peer: permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.012s
I20260709 13:23:09.143379 15690 consensus_queue.cc:1048] T 16d5db73377a4925b9f1e814ba306fcc P a1a22e9119494570b6d2217713fd7e43 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:23:09.153695 14779 catalog_manager.cc:5697] T 34e83f249d9942e99244702be584c8ae P 0efc951052454eec9a58b0cd025945b8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0efc951052454eec9a58b0cd025945b8 (127.5.126.66). New cstate: current_term: 1 leader_uuid: "0efc951052454eec9a58b0cd025945b8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } health_report { overall_health: UNKNOWN } } }
I20260709 13:23:09.154558 15690 consensus_queue.cc:1048] T 16d5db73377a4925b9f1e814ba306fcc P a1a22e9119494570b6d2217713fd7e43 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:23:09.175369 15659 raft_consensus.cc:515] T 940021bf0c344d01bc3adaae308d968d P a722e54d227f4c29a9ed6ce77858003a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } } peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } } peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } }
W20260709 13:23:09.186196 15715 log.cc:927] Time spent T 34e83f249d9942e99244702be584c8ae P 0efc951052454eec9a58b0cd025945b8: Append to log took a long time: real 0.064s	user 0.000s	sys 0.001s
I20260709 13:23:09.205969 15659 leader_election.cc:290] T 940021bf0c344d01bc3adaae308d968d P a722e54d227f4c29a9ed6ce77858003a [CANDIDATE]: Term 1 election: Requested vote from peers f3a500981b494979b58d2b1041fec9c8 (127.5.126.65:34129), 0efc951052454eec9a58b0cd025945b8 (127.5.126.66:34613)
I20260709 13:23:09.213238 14883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "940021bf0c344d01bc3adaae308d968d" candidate_uuid: "a722e54d227f4c29a9ed6ce77858003a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f3a500981b494979b58d2b1041fec9c8"
I20260709 13:23:09.214063 14883 raft_consensus.cc:3060] T 940021bf0c344d01bc3adaae308d968d P f3a500981b494979b58d2b1041fec9c8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:23:09.221222 14958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "940021bf0c344d01bc3adaae308d968d" candidate_uuid: "a722e54d227f4c29a9ed6ce77858003a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0efc951052454eec9a58b0cd025945b8"
I20260709 13:23:09.222005 14958 raft_consensus.cc:3060] T 940021bf0c344d01bc3adaae308d968d P 0efc951052454eec9a58b0cd025945b8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:23:09.223186 14883 raft_consensus.cc:2468] T 940021bf0c344d01bc3adaae308d968d P f3a500981b494979b58d2b1041fec9c8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a722e54d227f4c29a9ed6ce77858003a in term 1.
I20260709 13:23:09.236554 14958 raft_consensus.cc:2468] T 940021bf0c344d01bc3adaae308d968d P 0efc951052454eec9a58b0cd025945b8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a722e54d227f4c29a9ed6ce77858003a in term 1.
I20260709 13:23:09.249655 15073 leader_election.cc:304] T 940021bf0c344d01bc3adaae308d968d P a722e54d227f4c29a9ed6ce77858003a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0efc951052454eec9a58b0cd025945b8, a722e54d227f4c29a9ed6ce77858003a; no voters: 
I20260709 13:23:09.250429 15674 raft_consensus.cc:2804] T 940021bf0c344d01bc3adaae308d968d P a722e54d227f4c29a9ed6ce77858003a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:23:09.250933 15674 raft_consensus.cc:697] T 940021bf0c344d01bc3adaae308d968d P a722e54d227f4c29a9ed6ce77858003a [term 1 LEADER]: Becoming Leader. State: Replica: a722e54d227f4c29a9ed6ce77858003a, State: Running, Role: LEADER
I20260709 13:23:09.252434 15674 consensus_queue.cc:237] T 940021bf0c344d01bc3adaae308d968d P a722e54d227f4c29a9ed6ce77858003a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } } peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } } peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } }
I20260709 13:23:09.273939 15703 raft_consensus.cc:493] T 34e83f249d9942e99244702be584c8ae P a1a22e9119494570b6d2217713fd7e43 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:23:09.274452 15703 raft_consensus.cc:515] T 34e83f249d9942e99244702be584c8ae P a1a22e9119494570b6d2217713fd7e43 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } } peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } } peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } }
I20260709 13:23:09.277177 15703 leader_election.cc:290] T 34e83f249d9942e99244702be584c8ae P a1a22e9119494570b6d2217713fd7e43 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0efc951052454eec9a58b0cd025945b8 (127.5.126.66:34613), a722e54d227f4c29a9ed6ce77858003a (127.5.126.68:46669)
I20260709 13:23:09.280838 14953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34e83f249d9942e99244702be584c8ae" candidate_uuid: "a1a22e9119494570b6d2217713fd7e43" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0efc951052454eec9a58b0cd025945b8" is_pre_election: true
I20260709 13:23:09.282018 14783 catalog_manager.cc:5697] T 940021bf0c344d01bc3adaae308d968d P a722e54d227f4c29a9ed6ce77858003a reported cstate change: term changed from 0 to 1, leader changed from <none> to a722e54d227f4c29a9ed6ce77858003a (127.5.126.68). New cstate: current_term: 1 leader_uuid: "a722e54d227f4c29a9ed6ce77858003a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } health_report { overall_health: UNKNOWN } } }
I20260709 13:23:09.285091 15102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34e83f249d9942e99244702be584c8ae" candidate_uuid: "a1a22e9119494570b6d2217713fd7e43" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a722e54d227f4c29a9ed6ce77858003a" is_pre_election: true
I20260709 13:23:09.285977 15102 raft_consensus.cc:2393] T 34e83f249d9942e99244702be584c8ae P a722e54d227f4c29a9ed6ce77858003a [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a1a22e9119494570b6d2217713fd7e43 in current term 1: Already voted for candidate 0efc951052454eec9a58b0cd025945b8 in this term.
I20260709 13:23:09.287147 14999 leader_election.cc:304] T 34e83f249d9942e99244702be584c8ae P a1a22e9119494570b6d2217713fd7e43 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1a22e9119494570b6d2217713fd7e43; no voters: 0efc951052454eec9a58b0cd025945b8, a722e54d227f4c29a9ed6ce77858003a
I20260709 13:23:09.287998 15690 raft_consensus.cc:3060] T 34e83f249d9942e99244702be584c8ae P a1a22e9119494570b6d2217713fd7e43 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:23:09.299638 15690 raft_consensus.cc:2749] T 34e83f249d9942e99244702be584c8ae P a1a22e9119494570b6d2217713fd7e43 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:23:09.388303 15658 consensus_queue.cc:1048] T bf0b7c8005aa4d8ab97a1499761bf98a P f3a500981b494979b58d2b1041fec9c8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:23:09.401010 15363 consensus_queue.cc:1048] T bf0b7c8005aa4d8ab97a1499761bf98a P f3a500981b494979b58d2b1041fec9c8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:23:09.562175 15655 consensus_queue.cc:1048] T 34e83f249d9942e99244702be584c8ae P 0efc951052454eec9a58b0cd025945b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:23:09.574234 15589 consensus_queue.cc:1048] T 34e83f249d9942e99244702be584c8ae P 0efc951052454eec9a58b0cd025945b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:23:09.672019 15659 consensus_queue.cc:1048] T 940021bf0c344d01bc3adaae308d968d P a722e54d227f4c29a9ed6ce77858003a [LEADER]: Connected to new peer: Peer: permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:23:09.682766 15659 consensus_queue.cc:1048] T 940021bf0c344d01bc3adaae308d968d P a722e54d227f4c29a9ed6ce77858003a [LEADER]: Connected to new peer: Peer: permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:23:10.429113 14925 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.68:46669, user_credentials={real_user=slave}} blocked reactor thread for 49793.2us
I20260709 13:23:10.699887  5625 tablet_server.cc:179] TabletServer@127.5.126.65:0 shutting down...
W20260709 13:23:10.729202 15073 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 1 similar messages]
W20260709 13:23:10.759737 15073 consensus_peers.cc:597] T 268027ae94a54cf4acf51c54c7b9032b P a722e54d227f4c29a9ed6ce77858003a -> Peer f3a500981b494979b58d2b1041fec9c8 (127.5.126.65:34129): Couldn't send request to peer f3a500981b494979b58d2b1041fec9c8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:23:10.774585 15073 consensus_peers.cc:597] T e4f2c694c8194f1e86ad76c7ff051ea7 P a722e54d227f4c29a9ed6ce77858003a -> Peer f3a500981b494979b58d2b1041fec9c8 (127.5.126.65:34129): Couldn't send request to peer f3a500981b494979b58d2b1041fec9c8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:23:10.795936 14925 consensus_peers.cc:597] T b025139466084200b70879196cd3f922 P 0efc951052454eec9a58b0cd025945b8 -> Peer f3a500981b494979b58d2b1041fec9c8 (127.5.126.65:34129): Couldn't send request to peer f3a500981b494979b58d2b1041fec9c8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:23:10.800194 14925 consensus_peers.cc:597] T 48be8cf045364be999b8f0fd547b7b9d P 0efc951052454eec9a58b0cd025945b8 -> Peer f3a500981b494979b58d2b1041fec9c8 (127.5.126.65:34129): Couldn't send request to peer f3a500981b494979b58d2b1041fec9c8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:23:10.800823 14999 consensus_peers.cc:597] T dadd194761924530aede05672c9eecf9 P a1a22e9119494570b6d2217713fd7e43 -> Peer f3a500981b494979b58d2b1041fec9c8 (127.5.126.65:34129): Couldn't send request to peer f3a500981b494979b58d2b1041fec9c8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:23:10.800863 14925 consensus_peers.cc:597] T affcb03ab55349748a95c103059d2955 P 0efc951052454eec9a58b0cd025945b8 -> Peer f3a500981b494979b58d2b1041fec9c8 (127.5.126.65:34129): Couldn't send request to peer f3a500981b494979b58d2b1041fec9c8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:23:10.802738 14925 consensus_peers.cc:597] T 2a862e106a9e48a692bc72ea8c03ab39 P 0efc951052454eec9a58b0cd025945b8 -> Peer f3a500981b494979b58d2b1041fec9c8 (127.5.126.65:34129): Couldn't send request to peer f3a500981b494979b58d2b1041fec9c8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:23:10.807483  5625 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:23:10.808787  5625 tablet_replica.cc:333] T 940021bf0c344d01bc3adaae308d968d P f3a500981b494979b58d2b1041fec9c8: stopping tablet replica
I20260709 13:23:10.810480  5625 raft_consensus.cc:2243] T 940021bf0c344d01bc3adaae308d968d P f3a500981b494979b58d2b1041fec9c8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:23:10.811416  5625 raft_consensus.cc:2272] T 940021bf0c344d01bc3adaae308d968d P f3a500981b494979b58d2b1041fec9c8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:10.814792  5625 tablet_replica.cc:333] T bf0b7c8005aa4d8ab97a1499761bf98a P f3a500981b494979b58d2b1041fec9c8: stopping tablet replica
I20260709 13:23:10.815872  5625 raft_consensus.cc:2243] T bf0b7c8005aa4d8ab97a1499761bf98a P f3a500981b494979b58d2b1041fec9c8 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:23:10.817291  5625 raft_consensus.cc:2272] T bf0b7c8005aa4d8ab97a1499761bf98a P f3a500981b494979b58d2b1041fec9c8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:10.820582  5625 tablet_replica.cc:333] T 08dea3083d334745abe54f9b220bd86a P f3a500981b494979b58d2b1041fec9c8: stopping tablet replica
I20260709 13:23:10.821460  5625 raft_consensus.cc:2243] T 08dea3083d334745abe54f9b220bd86a P f3a500981b494979b58d2b1041fec9c8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:23:10.821993  5625 raft_consensus.cc:2272] T 08dea3083d334745abe54f9b220bd86a P f3a500981b494979b58d2b1041fec9c8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:10.824796  5625 tablet_replica.cc:333] T dee43e01ec5d409b877a5c2dbf5b7b77 P f3a500981b494979b58d2b1041fec9c8: stopping tablet replica
I20260709 13:23:10.825491  5625 raft_consensus.cc:2243] T dee43e01ec5d409b877a5c2dbf5b7b77 P f3a500981b494979b58d2b1041fec9c8 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:23:10.826552  5625 raft_consensus.cc:2272] T dee43e01ec5d409b877a5c2dbf5b7b77 P f3a500981b494979b58d2b1041fec9c8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:10.829154  5625 tablet_replica.cc:333] T f86a730e237248dc9b91cbb75e29c324 P f3a500981b494979b58d2b1041fec9c8: stopping tablet replica
I20260709 13:23:10.829793  5625 raft_consensus.cc:2243] T f86a730e237248dc9b91cbb75e29c324 P f3a500981b494979b58d2b1041fec9c8 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:23:10.830694  5625 raft_consensus.cc:2272] T f86a730e237248dc9b91cbb75e29c324 P f3a500981b494979b58d2b1041fec9c8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:10.834020  5625 tablet_replica.cc:333] T b0b7e1c1e67845cb9bd2208bb2fb7c21 P f3a500981b494979b58d2b1041fec9c8: stopping tablet replica
I20260709 13:23:10.835038  5625 raft_consensus.cc:2243] T b0b7e1c1e67845cb9bd2208bb2fb7c21 P f3a500981b494979b58d2b1041fec9c8 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:23:10.836516  5625 raft_consensus.cc:2272] T b0b7e1c1e67845cb9bd2208bb2fb7c21 P f3a500981b494979b58d2b1041fec9c8 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:23:10.837716 15073 consensus_peers.cc:597] T d65eaa0ab4574a1ea92b3848d4dc9c4d P a722e54d227f4c29a9ed6ce77858003a -> Peer f3a500981b494979b58d2b1041fec9c8 (127.5.126.65:34129): Couldn't send request to peer f3a500981b494979b58d2b1041fec9c8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:23:10.839668 15073 consensus_peers.cc:597] T f954c6c25a25443abd9705c8e909bf47 P a722e54d227f4c29a9ed6ce77858003a -> Peer f3a500981b494979b58d2b1041fec9c8 (127.5.126.65:34129): Couldn't send request to peer f3a500981b494979b58d2b1041fec9c8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:23:10.840377  5625 tablet_replica.cc:333] T 2a9523aa8663464686254c8412c37e67 P f3a500981b494979b58d2b1041fec9c8: stopping tablet replica
I20260709 13:23:10.841677  5625 raft_consensus.cc:2243] T 2a9523aa8663464686254c8412c37e67 P f3a500981b494979b58d2b1041fec9c8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:23:10.842403  5625 raft_consensus.cc:2272] T 2a9523aa8663464686254c8412c37e67 P f3a500981b494979b58d2b1041fec9c8 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:23:10.845165 14925 consensus_peers.cc:597] T 88a7c4171c664e819837994755edf95c P 0efc951052454eec9a58b0cd025945b8 -> Peer f3a500981b494979b58d2b1041fec9c8 (127.5.126.65:34129): Couldn't send request to peer f3a500981b494979b58d2b1041fec9c8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:23:10.845950  5625 tablet_replica.cc:333] T d64d06459b344ff99c0df07c249c3a60 P f3a500981b494979b58d2b1041fec9c8: stopping tablet replica
I20260709 13:23:10.846661  5625 raft_consensus.cc:2243] T d64d06459b344ff99c0df07c249c3a60 P f3a500981b494979b58d2b1041fec9c8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:23:10.847127  5625 raft_consensus.cc:2272] T d64d06459b344ff99c0df07c249c3a60 P f3a500981b494979b58d2b1041fec9c8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:10.849941  5625 tablet_replica.cc:333] T 88a7c4171c664e819837994755edf95c P f3a500981b494979b58d2b1041fec9c8: stopping tablet replica
I20260709 13:23:10.850649  5625 raft_consensus.cc:2243] T 88a7c4171c664e819837994755edf95c P f3a500981b494979b58d2b1041fec9c8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:23:10.851298  5625 raft_consensus.cc:2272] T 88a7c4171c664e819837994755edf95c P f3a500981b494979b58d2b1041fec9c8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:10.855285  5625 tablet_replica.cc:333] T af00ad02fba64998bb25991f6f69f291 P f3a500981b494979b58d2b1041fec9c8: stopping tablet replica
I20260709 13:23:10.856427  5625 raft_consensus.cc:2243] T af00ad02fba64998bb25991f6f69f291 P f3a500981b494979b58d2b1041fec9c8 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:23:10.857877  5625 raft_consensus.cc:2272] T af00ad02fba64998bb25991f6f69f291 P f3a500981b494979b58d2b1041fec9c8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:10.861750  5625 tablet_replica.cc:333] T 8996bae84ecc4bffa0239d64dce7b24f P f3a500981b494979b58d2b1041fec9c8: stopping tablet replica
I20260709 13:23:10.862798  5625 raft_consensus.cc:2243] T 8996bae84ecc4bffa0239d64dce7b24f P f3a500981b494979b58d2b1041fec9c8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:23:10.864705  5625 raft_consensus.cc:2272] T 8996bae84ecc4bffa0239d64dce7b24f P f3a500981b494979b58d2b1041fec9c8 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:23:10.867971 14999 consensus_peers.cc:597] T e3693e8a3b0444bf978dc845dcfd2a45 P a1a22e9119494570b6d2217713fd7e43 -> Peer f3a500981b494979b58d2b1041fec9c8 (127.5.126.65:34129): Couldn't send request to peer f3a500981b494979b58d2b1041fec9c8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:23:10.869115  5625 tablet_replica.cc:333] T 532cc9041f414e018098570192e0fae8 P f3a500981b494979b58d2b1041fec9c8: stopping tablet replica
I20260709 13:23:10.870306  5625 raft_consensus.cc:2243] T 532cc9041f414e018098570192e0fae8 P f3a500981b494979b58d2b1041fec9c8 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:23:10.871676  5625 raft_consensus.cc:2272] T 532cc9041f414e018098570192e0fae8 P f3a500981b494979b58d2b1041fec9c8 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:23:10.873258 15073 consensus_peers.cc:597] T 77e8d8b35cf148e99e8274bf65e5ed05 P a722e54d227f4c29a9ed6ce77858003a -> Peer f3a500981b494979b58d2b1041fec9c8 (127.5.126.65:34129): Couldn't send request to peer f3a500981b494979b58d2b1041fec9c8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:23:10.875111  5625 tablet_replica.cc:333] T c3abd41db36d404089eaf1f9063bbcb0 P f3a500981b494979b58d2b1041fec9c8: stopping tablet replica
I20260709 13:23:10.875878  5625 raft_consensus.cc:2243] T c3abd41db36d404089eaf1f9063bbcb0 P f3a500981b494979b58d2b1041fec9c8 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:23:10.876932  5625 raft_consensus.cc:2272] T c3abd41db36d404089eaf1f9063bbcb0 P f3a500981b494979b58d2b1041fec9c8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:10.879417  5625 tablet_replica.cc:333] T 2a862e106a9e48a692bc72ea8c03ab39 P f3a500981b494979b58d2b1041fec9c8: stopping tablet replica
I20260709 13:23:10.880136  5625 raft_consensus.cc:2243] T 2a862e106a9e48a692bc72ea8c03ab39 P f3a500981b494979b58d2b1041fec9c8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:23:10.880676  5625 raft_consensus.cc:2272] T 2a862e106a9e48a692bc72ea8c03ab39 P f3a500981b494979b58d2b1041fec9c8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:10.883689  5625 tablet_replica.cc:333] T 58a622a48cd24833bc5fc27e03114176 P f3a500981b494979b58d2b1041fec9c8: stopping tablet replica
I20260709 13:23:10.884737  5625 raft_consensus.cc:2243] T 58a622a48cd24833bc5fc27e03114176 P f3a500981b494979b58d2b1041fec9c8 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:23:10.886243  5625 raft_consensus.cc:2272] T 58a622a48cd24833bc5fc27e03114176 P f3a500981b494979b58d2b1041fec9c8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:10.889842  5625 tablet_replica.cc:333] T 03b63e2bee374ed5931dab67ee14b555 P f3a500981b494979b58d2b1041fec9c8: stopping tablet replica
I20260709 13:23:10.891059  5625 raft_consensus.cc:2243] T 03b63e2bee374ed5931dab67ee14b555 P f3a500981b494979b58d2b1041fec9c8 [term 1 LEADER]: Raft consensus shutting down.
W20260709 13:23:10.891799 14999 consensus_peers.cc:597] T e1ae79ed138a4950a681f24aa1107ef3 P a1a22e9119494570b6d2217713fd7e43 -> Peer f3a500981b494979b58d2b1041fec9c8 (127.5.126.65:34129): Couldn't send request to peer f3a500981b494979b58d2b1041fec9c8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:23:10.892553  5625 raft_consensus.cc:2272] T 03b63e2bee374ed5931dab67ee14b555 P f3a500981b494979b58d2b1041fec9c8 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:23:10.896004 14925 consensus_peers.cc:597] T 7560205f5d324c7d821dff8efe7a6256 P 0efc951052454eec9a58b0cd025945b8 -> Peer f3a500981b494979b58d2b1041fec9c8 (127.5.126.65:34129): Couldn't send request to peer f3a500981b494979b58d2b1041fec9c8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:23:10.896771  5625 tablet_replica.cc:333] T e75f8237624f42f793627366f05b792a P f3a500981b494979b58d2b1041fec9c8: stopping tablet replica
I20260709 13:23:10.897713  5625 raft_consensus.cc:2243] T e75f8237624f42f793627366f05b792a P f3a500981b494979b58d2b1041fec9c8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:23:10.898432  5625 raft_consensus.cc:2272] T e75f8237624f42f793627366f05b792a P f3a500981b494979b58d2b1041fec9c8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:10.902190  5625 tablet_replica.cc:333] T 7a4cf38d1a6644f082f401b9b26bfb27 P f3a500981b494979b58d2b1041fec9c8: stopping tablet replica
I20260709 13:23:10.903213  5625 raft_consensus.cc:2243] T 7a4cf38d1a6644f082f401b9b26bfb27 P f3a500981b494979b58d2b1041fec9c8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:23:10.903822  5625 raft_consensus.cc:2272] T 7a4cf38d1a6644f082f401b9b26bfb27 P f3a500981b494979b58d2b1041fec9c8 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:23:10.905691 14999 consensus_peers.cc:597] T 2956fb66a7f34f3e99f42598fb93178e P a1a22e9119494570b6d2217713fd7e43 -> Peer f3a500981b494979b58d2b1041fec9c8 (127.5.126.65:34129): Couldn't send request to peer f3a500981b494979b58d2b1041fec9c8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:23:10.907225  5625 tablet_replica.cc:333] T e4f2c694c8194f1e86ad76c7ff051ea7 P f3a500981b494979b58d2b1041fec9c8: stopping tablet replica
I20260709 13:23:10.907981  5625 raft_consensus.cc:2243] T e4f2c694c8194f1e86ad76c7ff051ea7 P f3a500981b494979b58d2b1041fec9c8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:23:10.908703  5625 raft_consensus.cc:2272] T e4f2c694c8194f1e86ad76c7ff051ea7 P f3a500981b494979b58d2b1041fec9c8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:10.911193  5625 tablet_replica.cc:333] T 03f377f48e8849adade3945935d300a9 P f3a500981b494979b58d2b1041fec9c8: stopping tablet replica
I20260709 13:23:10.911857  5625 raft_consensus.cc:2243] T 03f377f48e8849adade3945935d300a9 P f3a500981b494979b58d2b1041fec9c8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:23:10.912353  5625 raft_consensus.cc:2272] T 03f377f48e8849adade3945935d300a9 P f3a500981b494979b58d2b1041fec9c8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:10.914753  5625 tablet_replica.cc:333] T 0819f8999271428481a1f839026171a7 P f3a500981b494979b58d2b1041fec9c8: stopping tablet replica
I20260709 13:23:10.915477  5625 raft_consensus.cc:2243] T 0819f8999271428481a1f839026171a7 P f3a500981b494979b58d2b1041fec9c8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:23:10.915969  5625 raft_consensus.cc:2272] T 0819f8999271428481a1f839026171a7 P f3a500981b494979b58d2b1041fec9c8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:10.918466  5625 tablet_replica.cc:333] T aecef3c240394d54844ec8170e9cad59 P f3a500981b494979b58d2b1041fec9c8: stopping tablet replica
I20260709 13:23:10.919404  5625 raft_consensus.cc:2243] T aecef3c240394d54844ec8170e9cad59 P f3a500981b494979b58d2b1041fec9c8 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:23:10.920631  5625 raft_consensus.cc:2272] T aecef3c240394d54844ec8170e9cad59 P f3a500981b494979b58d2b1041fec9c8 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:23:10.923101 15073 consensus_peers.cc:597] T 940021bf0c344d01bc3adaae308d968d P a722e54d227f4c29a9ed6ce77858003a -> Peer f3a500981b494979b58d2b1041fec9c8 (127.5.126.65:34129): Couldn't send request to peer f3a500981b494979b58d2b1041fec9c8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:23:10.923463  5625 tablet_replica.cc:333] T 268027ae94a54cf4acf51c54c7b9032b P f3a500981b494979b58d2b1041fec9c8: stopping tablet replica
I20260709 13:23:10.924556  5625 raft_consensus.cc:2243] T 268027ae94a54cf4acf51c54c7b9032b P f3a500981b494979b58d2b1041fec9c8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:23:10.925285  5625 raft_consensus.cc:2272] T 268027ae94a54cf4acf51c54c7b9032b P f3a500981b494979b58d2b1041fec9c8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:10.928519  5625 tablet_replica.cc:333] T 107541237b4a452e8b47b0c3527b7ede P f3a500981b494979b58d2b1041fec9c8: stopping tablet replica
I20260709 13:23:10.929153  5625 raft_consensus.cc:2243] T 107541237b4a452e8b47b0c3527b7ede P f3a500981b494979b58d2b1041fec9c8 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:23:10.930289  5625 raft_consensus.cc:2272] T 107541237b4a452e8b47b0c3527b7ede P f3a500981b494979b58d2b1041fec9c8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:10.933390  5625 tablet_replica.cc:333] T dadd194761924530aede05672c9eecf9 P f3a500981b494979b58d2b1041fec9c8: stopping tablet replica
I20260709 13:23:10.934010  5625 raft_consensus.cc:2243] T dadd194761924530aede05672c9eecf9 P f3a500981b494979b58d2b1041fec9c8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:23:10.934564  5625 raft_consensus.cc:2272] T dadd194761924530aede05672c9eecf9 P f3a500981b494979b58d2b1041fec9c8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:10.937014  5625 tablet_replica.cc:333] T b025139466084200b70879196cd3f922 P f3a500981b494979b58d2b1041fec9c8: stopping tablet replica
I20260709 13:23:10.937669  5625 raft_consensus.cc:2243] T b025139466084200b70879196cd3f922 P f3a500981b494979b58d2b1041fec9c8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:23:10.938131  5625 raft_consensus.cc:2272] T b025139466084200b70879196cd3f922 P f3a500981b494979b58d2b1041fec9c8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:10.940601  5625 tablet_replica.cc:333] T 77e8d8b35cf148e99e8274bf65e5ed05 P f3a500981b494979b58d2b1041fec9c8: stopping tablet replica
I20260709 13:23:10.941243  5625 raft_consensus.cc:2243] T 77e8d8b35cf148e99e8274bf65e5ed05 P f3a500981b494979b58d2b1041fec9c8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:23:10.941690  5625 raft_consensus.cc:2272] T 77e8d8b35cf148e99e8274bf65e5ed05 P f3a500981b494979b58d2b1041fec9c8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:10.943856  5625 tablet_replica.cc:333] T 74a144396e4443288858878b63f08cc8 P f3a500981b494979b58d2b1041fec9c8: stopping tablet replica
I20260709 13:23:10.944567  5625 raft_consensus.cc:2243] T 74a144396e4443288858878b63f08cc8 P f3a500981b494979b58d2b1041fec9c8 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:23:10.945657  5625 raft_consensus.cc:2272] T 74a144396e4443288858878b63f08cc8 P f3a500981b494979b58d2b1041fec9c8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:10.948484  5625 tablet_replica.cc:333] T f954c6c25a25443abd9705c8e909bf47 P f3a500981b494979b58d2b1041fec9c8: stopping tablet replica
I20260709 13:23:10.949000  5625 raft_consensus.cc:2243] T f954c6c25a25443abd9705c8e909bf47 P f3a500981b494979b58d2b1041fec9c8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:23:10.949395  5625 raft_consensus.cc:2272] T f954c6c25a25443abd9705c8e909bf47 P f3a500981b494979b58d2b1041fec9c8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:10.951663  5625 tablet_replica.cc:333] T db6d3d345bd3495e9ec9a0e75ecd0562 P f3a500981b494979b58d2b1041fec9c8: stopping tablet replica
I20260709 13:23:10.952243  5625 raft_consensus.cc:2243] T db6d3d345bd3495e9ec9a0e75ecd0562 P f3a500981b494979b58d2b1041fec9c8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:23:10.952646  5625 raft_consensus.cc:2272] T db6d3d345bd3495e9ec9a0e75ecd0562 P f3a500981b494979b58d2b1041fec9c8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:10.954813  5625 tablet_replica.cc:333] T e85432ede09747339c957cdaa7d15ac6 P f3a500981b494979b58d2b1041fec9c8: stopping tablet replica
I20260709 13:23:10.955669  5625 raft_consensus.cc:2243] T e85432ede09747339c957cdaa7d15ac6 P f3a500981b494979b58d2b1041fec9c8 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:23:10.957013  5625 raft_consensus.cc:2272] T e85432ede09747339c957cdaa7d15ac6 P f3a500981b494979b58d2b1041fec9c8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:10.960748  5625 tablet_replica.cc:333] T 46ed2e9dd1324ac4a6e07f813cfebb7e P f3a500981b494979b58d2b1041fec9c8: stopping tablet replica
W20260709 13:23:10.961386 14925 consensus_peers.cc:597] T 914c9c0c3be1486f8dcce382b61b5450 P 0efc951052454eec9a58b0cd025945b8 -> Peer f3a500981b494979b58d2b1041fec9c8 (127.5.126.65:34129): Couldn't send request to peer f3a500981b494979b58d2b1041fec9c8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:23:10.961566  5625 raft_consensus.cc:2243] T 46ed2e9dd1324ac4a6e07f813cfebb7e P f3a500981b494979b58d2b1041fec9c8 [term 1 LEADER]: Raft consensus shutting down.
W20260709 13:23:10.962205 14999 consensus_peers.cc:597] T 5df7528567fd4291a888bfb37c28dc27 P a1a22e9119494570b6d2217713fd7e43 -> Peer f3a500981b494979b58d2b1041fec9c8 (127.5.126.65:34129): Couldn't send request to peer f3a500981b494979b58d2b1041fec9c8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:23:10.963133  5625 raft_consensus.cc:2272] T 46ed2e9dd1324ac4a6e07f813cfebb7e P f3a500981b494979b58d2b1041fec9c8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:10.965677  5625 tablet_replica.cc:333] T 5df7528567fd4291a888bfb37c28dc27 P f3a500981b494979b58d2b1041fec9c8: stopping tablet replica
I20260709 13:23:10.966342  5625 raft_consensus.cc:2243] T 5df7528567fd4291a888bfb37c28dc27 P f3a500981b494979b58d2b1041fec9c8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:23:10.966841  5625 raft_consensus.cc:2272] T 5df7528567fd4291a888bfb37c28dc27 P f3a500981b494979b58d2b1041fec9c8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:10.969394  5625 tablet_replica.cc:333] T 70d027ba81f54eba882756b941186710 P f3a500981b494979b58d2b1041fec9c8: stopping tablet replica
I20260709 13:23:10.970021  5625 raft_consensus.cc:2243] T 70d027ba81f54eba882756b941186710 P f3a500981b494979b58d2b1041fec9c8 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:23:10.971020  5625 raft_consensus.cc:2272] T 70d027ba81f54eba882756b941186710 P f3a500981b494979b58d2b1041fec9c8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:10.973573  5625 tablet_replica.cc:333] T 7560205f5d324c7d821dff8efe7a6256 P f3a500981b494979b58d2b1041fec9c8: stopping tablet replica
I20260709 13:23:10.974355  5625 raft_consensus.cc:2243] T 7560205f5d324c7d821dff8efe7a6256 P f3a500981b494979b58d2b1041fec9c8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:23:10.975042  5625 raft_consensus.cc:2272] T 7560205f5d324c7d821dff8efe7a6256 P f3a500981b494979b58d2b1041fec9c8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:10.978693  5625 tablet_replica.cc:333] T 2956fb66a7f34f3e99f42598fb93178e P f3a500981b494979b58d2b1041fec9c8: stopping tablet replica
I20260709 13:23:10.979542  5625 raft_consensus.cc:2243] T 2956fb66a7f34f3e99f42598fb93178e P f3a500981b494979b58d2b1041fec9c8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:23:10.980242  5625 raft_consensus.cc:2272] T 2956fb66a7f34f3e99f42598fb93178e P f3a500981b494979b58d2b1041fec9c8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:10.983433  5625 tablet_replica.cc:333] T affcb03ab55349748a95c103059d2955 P f3a500981b494979b58d2b1041fec9c8: stopping tablet replica
I20260709 13:23:10.984169  5625 raft_consensus.cc:2243] T affcb03ab55349748a95c103059d2955 P f3a500981b494979b58d2b1041fec9c8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:23:10.984654  5625 raft_consensus.cc:2272] T affcb03ab55349748a95c103059d2955 P f3a500981b494979b58d2b1041fec9c8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:10.987226  5625 tablet_replica.cc:333] T abc01daa220a47fa8578b0d20a17c9ab P f3a500981b494979b58d2b1041fec9c8: stopping tablet replica
I20260709 13:23:10.987800  5625 raft_consensus.cc:2243] T abc01daa220a47fa8578b0d20a17c9ab P f3a500981b494979b58d2b1041fec9c8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:23:10.988314  5625 raft_consensus.cc:2272] T abc01daa220a47fa8578b0d20a17c9ab P f3a500981b494979b58d2b1041fec9c8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:10.991199  5625 tablet_replica.cc:333] T d65eaa0ab4574a1ea92b3848d4dc9c4d P f3a500981b494979b58d2b1041fec9c8: stopping tablet replica
I20260709 13:23:10.992024  5625 raft_consensus.cc:2243] T d65eaa0ab4574a1ea92b3848d4dc9c4d P f3a500981b494979b58d2b1041fec9c8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:23:10.992681  5625 raft_consensus.cc:2272] T d65eaa0ab4574a1ea92b3848d4dc9c4d P f3a500981b494979b58d2b1041fec9c8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:10.996485  5625 tablet_replica.cc:333] T 16d5db73377a4925b9f1e814ba306fcc P f3a500981b494979b58d2b1041fec9c8: stopping tablet replica
I20260709 13:23:10.997231  5625 raft_consensus.cc:2243] T 16d5db73377a4925b9f1e814ba306fcc P f3a500981b494979b58d2b1041fec9c8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:23:10.997862  5625 raft_consensus.cc:2272] T 16d5db73377a4925b9f1e814ba306fcc P f3a500981b494979b58d2b1041fec9c8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:11.000278  5625 tablet_replica.cc:333] T a71163721b4d48b0b5ff366b9d12ac32 P f3a500981b494979b58d2b1041fec9c8: stopping tablet replica
I20260709 13:23:11.000867  5625 raft_consensus.cc:2243] T a71163721b4d48b0b5ff366b9d12ac32 P f3a500981b494979b58d2b1041fec9c8 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:23:11.001866  5625 raft_consensus.cc:2272] T a71163721b4d48b0b5ff366b9d12ac32 P f3a500981b494979b58d2b1041fec9c8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:11.004243  5625 tablet_replica.cc:333] T e1ae79ed138a4950a681f24aa1107ef3 P f3a500981b494979b58d2b1041fec9c8: stopping tablet replica
I20260709 13:23:11.004823  5625 raft_consensus.cc:2243] T e1ae79ed138a4950a681f24aa1107ef3 P f3a500981b494979b58d2b1041fec9c8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:23:11.005363  5625 raft_consensus.cc:2272] T e1ae79ed138a4950a681f24aa1107ef3 P f3a500981b494979b58d2b1041fec9c8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:11.008984  5625 tablet_replica.cc:333] T e3693e8a3b0444bf978dc845dcfd2a45 P f3a500981b494979b58d2b1041fec9c8: stopping tablet replica
I20260709 13:23:11.009750  5625 raft_consensus.cc:2243] T e3693e8a3b0444bf978dc845dcfd2a45 P f3a500981b494979b58d2b1041fec9c8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:23:11.010339  5625 raft_consensus.cc:2272] T e3693e8a3b0444bf978dc845dcfd2a45 P f3a500981b494979b58d2b1041fec9c8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:11.013757  5625 tablet_replica.cc:333] T 914c9c0c3be1486f8dcce382b61b5450 P f3a500981b494979b58d2b1041fec9c8: stopping tablet replica
I20260709 13:23:11.014444  5625 raft_consensus.cc:2243] T 914c9c0c3be1486f8dcce382b61b5450 P f3a500981b494979b58d2b1041fec9c8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:23:11.015098  5625 raft_consensus.cc:2272] T 914c9c0c3be1486f8dcce382b61b5450 P f3a500981b494979b58d2b1041fec9c8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:11.018491  5625 tablet_replica.cc:333] T 48be8cf045364be999b8f0fd547b7b9d P f3a500981b494979b58d2b1041fec9c8: stopping tablet replica
I20260709 13:23:11.019279  5625 raft_consensus.cc:2243] T 48be8cf045364be999b8f0fd547b7b9d P f3a500981b494979b58d2b1041fec9c8 [term 1 FOLLOWER]: Raft consensus shutting down.
W20260709 13:23:11.019814 15073 consensus_peers.cc:597] T 2a9523aa8663464686254c8412c37e67 P a722e54d227f4c29a9ed6ce77858003a -> Peer f3a500981b494979b58d2b1041fec9c8 (127.5.126.65:34129): Couldn't send request to peer f3a500981b494979b58d2b1041fec9c8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:23:11.019930  5625 raft_consensus.cc:2272] T 48be8cf045364be999b8f0fd547b7b9d P f3a500981b494979b58d2b1041fec9c8 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:23:11.020205 14925 consensus_peers.cc:597] T e75f8237624f42f793627366f05b792a P 0efc951052454eec9a58b0cd025945b8 -> Peer f3a500981b494979b58d2b1041fec9c8 (127.5.126.65:34129): Couldn't send request to peer f3a500981b494979b58d2b1041fec9c8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:23:11.037249 15073 consensus_peers.cc:597] T 8996bae84ecc4bffa0239d64dce7b24f P a722e54d227f4c29a9ed6ce77858003a -> Peer f3a500981b494979b58d2b1041fec9c8 (127.5.126.65:34129): Couldn't send request to peer f3a500981b494979b58d2b1041fec9c8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:23:11.052326 14999 consensus_peers.cc:597] T db6d3d345bd3495e9ec9a0e75ecd0562 P a1a22e9119494570b6d2217713fd7e43 -> Peer f3a500981b494979b58d2b1041fec9c8 (127.5.126.65:34129): Couldn't send request to peer f3a500981b494979b58d2b1041fec9c8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:23:11.081588 15073 consensus_peers.cc:597] T 0819f8999271428481a1f839026171a7 P a722e54d227f4c29a9ed6ce77858003a -> Peer f3a500981b494979b58d2b1041fec9c8 (127.5.126.65:34129): Couldn't send request to peer f3a500981b494979b58d2b1041fec9c8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:23:11.092792 14999 consensus_peers.cc:597] T 03f377f48e8849adade3945935d300a9 P a1a22e9119494570b6d2217713fd7e43 -> Peer f3a500981b494979b58d2b1041fec9c8 (127.5.126.65:34129): Couldn't send request to peer f3a500981b494979b58d2b1041fec9c8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:23:11.121556  5625 tablet_server.cc:196] TabletServer@127.5.126.65:0 shutdown complete.
W20260709 13:23:11.136016 14925 consensus_peers.cc:597] T 08dea3083d334745abe54f9b220bd86a P 0efc951052454eec9a58b0cd025945b8 -> Peer f3a500981b494979b58d2b1041fec9c8 (127.5.126.65:34129): Couldn't send request to peer f3a500981b494979b58d2b1041fec9c8. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:34129: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:23:11.186728 15073 consensus_peers.cc:597] T d64d06459b344ff99c0df07c249c3a60 P a722e54d227f4c29a9ed6ce77858003a -> Peer f3a500981b494979b58d2b1041fec9c8 (127.5.126.65:34129): Couldn't send request to peer f3a500981b494979b58d2b1041fec9c8. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:34129: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:23:11.199234 14999 consensus_peers.cc:597] T 7a4cf38d1a6644f082f401b9b26bfb27 P a1a22e9119494570b6d2217713fd7e43 -> Peer f3a500981b494979b58d2b1041fec9c8 (127.5.126.65:34129): Couldn't send request to peer f3a500981b494979b58d2b1041fec9c8. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:34129: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:23:11.200011 14999 consensus_peers.cc:597] T abc01daa220a47fa8578b0d20a17c9ab P a1a22e9119494570b6d2217713fd7e43 -> Peer f3a500981b494979b58d2b1041fec9c8 (127.5.126.65:34129): Couldn't send request to peer f3a500981b494979b58d2b1041fec9c8. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:34129: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:23:11.211344 14999 consensus_peers.cc:597] T 16d5db73377a4925b9f1e814ba306fcc P a1a22e9119494570b6d2217713fd7e43 -> Peer f3a500981b494979b58d2b1041fec9c8 (127.5.126.65:34129): Couldn't send request to peer f3a500981b494979b58d2b1041fec9c8. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:34129: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:23:11.257769  5625 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:23:11.266506 15746 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:23:11.266541 15745 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:23:11.269874 15748 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:23:11.270754  5625 server_base.cc:1061] running on GCE node
I20260709 13:23:11.275970  5625 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:23:11.276347  5625 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:23:11.276573  5625 hybrid_clock.cc:648] HybridClock initialized: now 1783603391276545 us; error 0 us; skew 500 ppm
I20260709 13:23:11.277153  5625 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:23:11.280740  5625 webserver.cc:533] Webserver started at http://127.5.126.65:44757/ using document root <none> and password file <none>
I20260709 13:23:11.281405  5625 fs_manager.cc:362] Metadata directory not provided
I20260709 13:23:11.281669  5625 fs_manager.cc:365] Using existing metadata directory in first data directory
I20260709 13:23:11.288744  5625 fs_manager.cc:714] Time spent opening directory manager: real 0.006s	user 0.005s	sys 0.002s
I20260709 13:23:11.301874 15754 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:23:11.303485  5625 fs_manager.cc:730] Time spent opening block manager: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:23:11.303990  5625 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskWHb0CB/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783603057096655-5625-0/minicluster-data/ts-0-root
uuid: "f3a500981b494979b58d2b1041fec9c8"
format_stamp: "Formatted at 2026-07-09 13:22:55 on dist-test-slave-smzk"
I20260709 13:23:11.304766  5625 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWHb0CB/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783603057096655-5625-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskWHb0CB/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783603057096655-5625-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskWHb0CB/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783603057096655-5625-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:23:11.365506  5625 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:23:11.367358  5625 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:23:11.369415  5625 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:23:11.375962 15761 ts_tablet_manager.cc:548] Loading tablet metadata (0/45 complete)
I20260709 13:23:11.688010  5625 ts_tablet_manager.cc:585] Loaded tablet metadata (45 total tablets, 45 live tablets)
I20260709 13:23:11.688387  5625 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.314s	user 0.009s	sys 0.001s
I20260709 13:23:11.688750  5625 ts_tablet_manager.cc:600] Registering tablets (0/45 complete)
I20260709 13:23:11.694285 15761 tablet_bootstrap.cc:492] T af00ad02fba64998bb25991f6f69f291 P f3a500981b494979b58d2b1041fec9c8: Bootstrap starting.
I20260709 13:23:11.715930 15761 tablet_bootstrap.cc:492] T af00ad02fba64998bb25991f6f69f291 P f3a500981b494979b58d2b1041fec9c8: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:23:11.717454 15761 tablet_bootstrap.cc:492] T af00ad02fba64998bb25991f6f69f291 P f3a500981b494979b58d2b1041fec9c8: Bootstrap complete.
I20260709 13:23:11.718444 15761 ts_tablet_manager.cc:1403] T af00ad02fba64998bb25991f6f69f291 P f3a500981b494979b58d2b1041fec9c8: Time spent bootstrapping tablet: real 0.024s	user 0.013s	sys 0.008s
I20260709 13:23:11.722064 15761 raft_consensus.cc:359] T af00ad02fba64998bb25991f6f69f291 P f3a500981b494979b58d2b1041fec9c8 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } } peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } } peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } }
I20260709 13:23:11.723088 15761 raft_consensus.cc:740] T af00ad02fba64998bb25991f6f69f291 P f3a500981b494979b58d2b1041fec9c8 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: f3a500981b494979b58d2b1041fec9c8, State: Initialized, Role: FOLLOWER
I20260709 13:23:11.723943 15761 consensus_queue.cc:260] T af00ad02fba64998bb25991f6f69f291 P f3a500981b494979b58d2b1041fec9c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } } peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } } peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } }
I20260709 13:23:11.727635 15761 ts_tablet_manager.cc:1434] T af00ad02fba64998bb25991f6f69f291 P f3a500981b494979b58d2b1041fec9c8: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 13:23:11.728682 15761 tablet_bootstrap.cc:492] T 532cc9041f414e018098570192e0fae8 P f3a500981b494979b58d2b1041fec9c8: Bootstrap starting.
I20260709 13:23:11.746232 15761 tablet_bootstrap.cc:492] T 532cc9041f414e018098570192e0fae8 P f3a500981b494979b58d2b1041fec9c8: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:23:11.747098 15761 tablet_bootstrap.cc:492] T 532cc9041f414e018098570192e0fae8 P f3a500981b494979b58d2b1041fec9c8: Bootstrap complete.
I20260709 13:23:11.747694 15761 ts_tablet_manager.cc:1403] T 532cc9041f414e018098570192e0fae8 P f3a500981b494979b58d2b1041fec9c8: Time spent bootstrapping tablet: real 0.019s	user 0.013s	sys 0.000s
I20260709 13:23:11.749933 15761 raft_consensus.cc:359] T 532cc9041f414e018098570192e0fae8 P f3a500981b494979b58d2b1041fec9c8 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } } peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } } peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } }
I20260709 13:23:11.750458 15761 raft_consensus.cc:740] T 532cc9041f414e018098570192e0fae8 P f3a500981b494979b58d2b1041fec9c8 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: f3a500981b494979b58d2b1041fec9c8, State: Initialized, Role: FOLLOWER
I20260709 13:23:11.751080 15761 consensus_queue.cc:260] T 532cc9041f414e018098570192e0fae8 P f3a500981b494979b58d2b1041fec9c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } } peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } } peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } }
I20260709 13:23:11.752620 15761 ts_tablet_manager.cc:1434] T 532cc9041f414e018098570192e0fae8 P f3a500981b494979b58d2b1041fec9c8: Time spent starting tablet: real 0.005s	user 0.008s	sys 0.000s
I20260709 13:23:11.753316 15761 tablet_bootstrap.cc:492] T f86a730e237248dc9b91cbb75e29c324 P f3a500981b494979b58d2b1041fec9c8: Bootstrap starting.
I20260709 13:23:11.768791 15761 tablet_bootstrap.cc:492] T f86a730e237248dc9b91cbb75e29c324 P f3a500981b494979b58d2b1041fec9c8: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:23:11.769625 15761 tablet_bootstrap.cc:492] T f86a730e237248dc9b91cbb75e29c324 P f3a500981b494979b58d2b1041fec9c8: Bootstrap complete.
I20260709 13:23:11.770206 15761 ts_tablet_manager.cc:1403] T f86a730e237248dc9b91cbb75e29c324 P f3a500981b494979b58d2b1041fec9c8: Time spent bootstrapping tablet: real 0.017s	user 0.010s	sys 0.003s
I20260709 13:23:11.772501 15761 raft_consensus.cc:359] T f86a730e237248dc9b91cbb75e29c324 P f3a500981b494979b58d2b1041fec9c8 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } } peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } } peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } }
I20260709 13:23:11.773180 15761 raft_consensus.cc:740] T f86a730e237248dc9b91cbb75e29c324 P f3a500981b494979b58d2b1041fec9c8 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: f3a500981b494979b58d2b1041fec9c8, State: Initialized, Role: FOLLOWER
I20260709 13:23:11.773911 15761 consensus_queue.cc:260] T f86a730e237248dc9b91cbb75e29c324 P f3a500981b494979b58d2b1041fec9c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } } peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } } peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } }
I20260709 13:23:11.775782 15761 ts_tablet_manager.cc:1434] T f86a730e237248dc9b91cbb75e29c324 P f3a500981b494979b58d2b1041fec9c8: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:23:11.776503 15761 tablet_bootstrap.cc:492] T dadd194761924530aede05672c9eecf9 P f3a500981b494979b58d2b1041fec9c8: Bootstrap starting.
I20260709 13:23:11.794669 15761 tablet_bootstrap.cc:492] T dadd194761924530aede05672c9eecf9 P f3a500981b494979b58d2b1041fec9c8: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:23:11.795723 15761 tablet_bootstrap.cc:492] T dadd194761924530aede05672c9eecf9 P f3a500981b494979b58d2b1041fec9c8: Bootstrap complete.
I20260709 13:23:11.796449 15761 ts_tablet_manager.cc:1403] T dadd194761924530aede05672c9eecf9 P f3a500981b494979b58d2b1041fec9c8: Time spent bootstrapping tablet: real 0.020s	user 0.014s	sys 0.004s
I20260709 13:23:11.798934 15761 raft_consensus.cc:359] T dadd194761924530aede05672c9eecf9 P f3a500981b494979b58d2b1041fec9c8 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } } peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } } peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } }
I20260709 13:23:11.799597 15761 raft_consensus.cc:740] T dadd194761924530aede05672c9eecf9 P f3a500981b494979b58d2b1041fec9c8 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: f3a500981b494979b58d2b1041fec9c8, State: Initialized, Role: FOLLOWER
I20260709 13:23:11.800328 15761 consensus_queue.cc:260] T dadd194761924530aede05672c9eecf9 P f3a500981b494979b58d2b1041fec9c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } } peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } } peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } }
I20260709 13:23:11.802111 15761 ts_tablet_manager.cc:1434] T dadd194761924530aede05672c9eecf9 P f3a500981b494979b58d2b1041fec9c8: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:23:11.802798 15761 tablet_bootstrap.cc:492] T affcb03ab55349748a95c103059d2955 P f3a500981b494979b58d2b1041fec9c8: Bootstrap starting.
I20260709 13:23:11.819070 15761 tablet_bootstrap.cc:492] T affcb03ab55349748a95c103059d2955 P f3a500981b494979b58d2b1041fec9c8: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:23:11.820269 15761 tablet_bootstrap.cc:492] T affcb03ab55349748a95c103059d2955 P f3a500981b494979b58d2b1041fec9c8: Bootstrap complete.
I20260709 13:23:11.821391 15761 ts_tablet_manager.cc:1403] T affcb03ab55349748a95c103059d2955 P f3a500981b494979b58d2b1041fec9c8: Time spent bootstrapping tablet: real 0.019s	user 0.013s	sys 0.004s
I20260709 13:23:11.824277 15761 raft_consensus.cc:359] T affcb03ab55349748a95c103059d2955 P f3a500981b494979b58d2b1041fec9c8 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } } peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } } peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } }
I20260709 13:23:11.825301 15761 raft_consensus.cc:740] T affcb03ab55349748a95c103059d2955 P f3a500981b494979b58d2b1041fec9c8 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: f3a500981b494979b58d2b1041fec9c8, State: Initialized, Role: FOLLOWER
I20260709 13:23:11.826082 15761 consensus_queue.cc:260] T affcb03ab55349748a95c103059d2955 P f3a500981b494979b58d2b1041fec9c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } } peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } } peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } }
I20260709 13:23:11.827649 15588 raft_consensus.cc:493] T c3abd41db36d404089eaf1f9063bbcb0 P 0efc951052454eec9a58b0cd025945b8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f3a500981b494979b58d2b1041fec9c8)
I20260709 13:23:11.828334 15761 ts_tablet_manager.cc:1434] T affcb03ab55349748a95c103059d2955 P f3a500981b494979b58d2b1041fec9c8: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.003s
I20260709 13:23:11.829387 15761 tablet_bootstrap.cc:492] T c3abd41db36d404089eaf1f9063bbcb0 P f3a500981b494979b58d2b1041fec9c8: Bootstrap starting.
I20260709 13:23:11.828374 15588 raft_consensus.cc:515] T c3abd41db36d404089eaf1f9063bbcb0 P 0efc951052454eec9a58b0cd025945b8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } } peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } } peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } }
I20260709 13:23:11.832909 15588 leader_election.cc:290] T c3abd41db36d404089eaf1f9063bbcb0 P 0efc951052454eec9a58b0cd025945b8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f3a500981b494979b58d2b1041fec9c8 (127.5.126.65:34129), a1a22e9119494570b6d2217713fd7e43 (127.5.126.67:38125)
I20260709 13:23:11.839458 15032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3abd41db36d404089eaf1f9063bbcb0" candidate_uuid: "0efc951052454eec9a58b0cd025945b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a1a22e9119494570b6d2217713fd7e43" is_pre_election: true
W20260709 13:23:11.844125 14925 leader_election.cc:336] T c3abd41db36d404089eaf1f9063bbcb0 P 0efc951052454eec9a58b0cd025945b8 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer f3a500981b494979b58d2b1041fec9c8 (127.5.126.65:34129): Network error: Client connection negotiation failed: client connection to 127.5.126.65:34129: connect: Connection refused (error 111)
I20260709 13:23:11.845002 14925 leader_election.cc:304] T c3abd41db36d404089eaf1f9063bbcb0 P 0efc951052454eec9a58b0cd025945b8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0efc951052454eec9a58b0cd025945b8; no voters: a1a22e9119494570b6d2217713fd7e43, f3a500981b494979b58d2b1041fec9c8
I20260709 13:23:11.848472 15589 raft_consensus.cc:2749] T c3abd41db36d404089eaf1f9063bbcb0 P 0efc951052454eec9a58b0cd025945b8 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:23:11.876106 15761 tablet_bootstrap.cc:492] T c3abd41db36d404089eaf1f9063bbcb0 P f3a500981b494979b58d2b1041fec9c8: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:23:11.877213 15761 tablet_bootstrap.cc:492] T c3abd41db36d404089eaf1f9063bbcb0 P f3a500981b494979b58d2b1041fec9c8: Bootstrap complete.
I20260709 13:23:11.877911 15761 ts_tablet_manager.cc:1403] T c3abd41db36d404089eaf1f9063bbcb0 P f3a500981b494979b58d2b1041fec9c8: Time spent bootstrapping tablet: real 0.049s	user 0.036s	sys 0.004s
I20260709 13:23:11.880601 15761 raft_consensus.cc:359] T c3abd41db36d404089eaf1f9063bbcb0 P f3a500981b494979b58d2b1041fec9c8 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } } peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } } peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } }
I20260709 13:23:11.881424 15761 raft_consensus.cc:740] T c3abd41db36d404089eaf1f9063bbcb0 P f3a500981b494979b58d2b1041fec9c8 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: f3a500981b494979b58d2b1041fec9c8, State: Initialized, Role: FOLLOWER
I20260709 13:23:11.882442 15761 consensus_queue.cc:260] T c3abd41db36d404089eaf1f9063bbcb0 P f3a500981b494979b58d2b1041fec9c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } } peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } } peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } }
I20260709 13:23:11.884749 15761 ts_tablet_manager.cc:1434] T c3abd41db36d404089eaf1f9063bbcb0 P f3a500981b494979b58d2b1041fec9c8: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:23:11.885684 15761 tablet_bootstrap.cc:492] T b025139466084200b70879196cd3f922 P f3a500981b494979b58d2b1041fec9c8: Bootstrap starting.
I20260709 13:23:11.908306 15761 tablet_bootstrap.cc:492] T b025139466084200b70879196cd3f922 P f3a500981b494979b58d2b1041fec9c8: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:23:11.909463 15761 tablet_bootstrap.cc:492] T b025139466084200b70879196cd3f922 P f3a500981b494979b58d2b1041fec9c8: Bootstrap complete.
I20260709 13:23:11.910231 15761 ts_tablet_manager.cc:1403] T b025139466084200b70879196cd3f922 P f3a500981b494979b58d2b1041fec9c8: Time spent bootstrapping tablet: real 0.025s	user 0.020s	sys 0.000s
I20260709 13:23:11.913426 15761 raft_consensus.cc:359] T b025139466084200b70879196cd3f922 P f3a500981b494979b58d2b1041fec9c8 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } } peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } } peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } }
I20260709 13:23:11.914273 15761 raft_consensus.cc:740] T b025139466084200b70879196cd3f922 P f3a500981b494979b58d2b1041fec9c8 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: f3a500981b494979b58d2b1041fec9c8, State: Initialized, Role: FOLLOWER
I20260709 13:23:11.915112 15761 consensus_queue.cc:260] T b025139466084200b70879196cd3f922 P f3a500981b494979b58d2b1041fec9c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } } peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } } peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } }
I20260709 13:23:11.917446 15690 raft_consensus.cc:493] T b0b7e1c1e67845cb9bd2208bb2fb7c21 P a1a22e9119494570b6d2217713fd7e43 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f3a500981b494979b58d2b1041fec9c8)
I20260709 13:23:11.918264  5625 ts_tablet_manager.cc:616] Registered 45 tablets
I20260709 13:23:11.918763  5625 ts_tablet_manager.cc:595] Time spent register tablets: real 0.230s	user 0.217s	sys 0.008s
I20260709 13:23:11.918217 15690 raft_consensus.cc:515] T b0b7e1c1e67845cb9bd2208bb2fb7c21 P a1a22e9119494570b6d2217713fd7e43 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } } peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } } peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } }
I20260709 13:23:11.917750 15761 ts_tablet_manager.cc:1434] T b025139466084200b70879196cd3f922 P f3a500981b494979b58d2b1041fec9c8: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:23:11.921178 15690 leader_election.cc:290] T b0b7e1c1e67845cb9bd2208bb2fb7c21 P a1a22e9119494570b6d2217713fd7e43 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f3a500981b494979b58d2b1041fec9c8 (127.5.126.65:34129), 0efc951052454eec9a58b0cd025945b8 (127.5.126.66:34613)
I20260709 13:23:11.921180 15761 tablet_bootstrap.cc:492] T 03f377f48e8849adade3945935d300a9 P f3a500981b494979b58d2b1041fec9c8: Bootstrap starting.
I20260709 13:23:11.930436 14953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0b7e1c1e67845cb9bd2208bb2fb7c21" candidate_uuid: "a1a22e9119494570b6d2217713fd7e43" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0efc951052454eec9a58b0cd025945b8" is_pre_election: true
W20260709 13:23:11.933521 14999 leader_election.cc:336] T b0b7e1c1e67845cb9bd2208bb2fb7c21 P a1a22e9119494570b6d2217713fd7e43 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer f3a500981b494979b58d2b1041fec9c8 (127.5.126.65:34129): Network error: Client connection negotiation failed: client connection to 127.5.126.65:34129: connect: Connection refused (error 111)
I20260709 13:23:11.934448 14999 leader_election.cc:304] T b0b7e1c1e67845cb9bd2208bb2fb7c21 P a1a22e9119494570b6d2217713fd7e43 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1a22e9119494570b6d2217713fd7e43; no voters: 0efc951052454eec9a58b0cd025945b8, f3a500981b494979b58d2b1041fec9c8
I20260709 13:23:11.935226 15690 raft_consensus.cc:2749] T b0b7e1c1e67845cb9bd2208bb2fb7c21 P a1a22e9119494570b6d2217713fd7e43 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:23:11.942883 15589 raft_consensus.cc:493] T a71163721b4d48b0b5ff366b9d12ac32 P 0efc951052454eec9a58b0cd025945b8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f3a500981b494979b58d2b1041fec9c8)
I20260709 13:23:11.943652 15589 raft_consensus.cc:515] T a71163721b4d48b0b5ff366b9d12ac32 P 0efc951052454eec9a58b0cd025945b8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } } peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } } peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } }
I20260709 13:23:11.944640 15761 tablet_bootstrap.cc:492] T 03f377f48e8849adade3945935d300a9 P f3a500981b494979b58d2b1041fec9c8: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:23:11.945891 15761 tablet_bootstrap.cc:492] T 03f377f48e8849adade3945935d300a9 P f3a500981b494979b58d2b1041fec9c8: Bootstrap complete.
I20260709 13:23:11.946316 15589 leader_election.cc:290] T a71163721b4d48b0b5ff366b9d12ac32 P 0efc951052454eec9a58b0cd025945b8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a722e54d227f4c29a9ed6ce77858003a (127.5.126.68:46669), f3a500981b494979b58d2b1041fec9c8 (127.5.126.65:34129)
I20260709 13:23:11.946808 15761 ts_tablet_manager.cc:1403] T 03f377f48e8849adade3945935d300a9 P f3a500981b494979b58d2b1041fec9c8: Time spent bootstrapping tablet: real 0.026s	user 0.012s	sys 0.007s
I20260709 13:23:11.948285 15104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a71163721b4d48b0b5ff366b9d12ac32" candidate_uuid: "0efc951052454eec9a58b0cd025945b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a722e54d227f4c29a9ed6ce77858003a" is_pre_election: true
I20260709 13:23:11.950901 15761 raft_consensus.cc:359] T 03f377f48e8849adade3945935d300a9 P f3a500981b494979b58d2b1041fec9c8 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } } peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } } peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } }
I20260709 13:23:11.951922 15761 raft_consensus.cc:740] T 03f377f48e8849adade3945935d300a9 P f3a500981b494979b58d2b1041fec9c8 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: f3a500981b494979b58d2b1041fec9c8, State: Initialized, Role: FOLLOWER
W20260709 13:23:11.953492 14925 leader_election.cc:336] T a71163721b4d48b0b5ff366b9d12ac32 P 0efc951052454eec9a58b0cd025945b8 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer f3a500981b494979b58d2b1041fec9c8 (127.5.126.65:34129): Network error: Client connection negotiation failed: client connection to 127.5.126.65:34129: connect: Connection refused (error 111)
I20260709 13:23:11.953118 15761 consensus_queue.cc:260] T 03f377f48e8849adade3945935d300a9 P f3a500981b494979b58d2b1041fec9c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } } peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } } peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } }
I20260709 13:23:11.953183 15762 raft_consensus.cc:493] T 58a622a48cd24833bc5fc27e03114176 P a722e54d227f4c29a9ed6ce77858003a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f3a500981b494979b58d2b1041fec9c8)
I20260709 13:23:11.954066 14925 leader_election.cc:304] T a71163721b4d48b0b5ff366b9d12ac32 P 0efc951052454eec9a58b0cd025945b8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0efc951052454eec9a58b0cd025945b8; no voters: a722e54d227f4c29a9ed6ce77858003a, f3a500981b494979b58d2b1041fec9c8
I20260709 13:23:11.955809 15589 raft_consensus.cc:2749] T a71163721b4d48b0b5ff366b9d12ac32 P 0efc951052454eec9a58b0cd025945b8 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:23:11.956537 15761 ts_tablet_manager.cc:1434] T 03f377f48e8849adade3945935d300a9 P f3a500981b494979b58d2b1041fec9c8: Time spent starting tablet: real 0.009s	user 0.011s	sys 0.000s
I20260709 13:23:11.956822 15762 raft_consensus.cc:515] T 58a622a48cd24833bc5fc27e03114176 P a722e54d227f4c29a9ed6ce77858003a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } } peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } } peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } }
I20260709 13:23:11.957780 15761 tablet_bootstrap.cc:492] T 88a7c4171c664e819837994755edf95c P f3a500981b494979b58d2b1041fec9c8: Bootstrap starting.
I20260709 13:23:11.959122 15762 leader_election.cc:290] T 58a622a48cd24833bc5fc27e03114176 P a722e54d227f4c29a9ed6ce77858003a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f3a500981b494979b58d2b1041fec9c8 (127.5.126.65:34129), 0efc951052454eec9a58b0cd025945b8 (127.5.126.66:34613)
W20260709 13:23:11.965832 15073 leader_election.cc:336] T 58a622a48cd24833bc5fc27e03114176 P a722e54d227f4c29a9ed6ce77858003a [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer f3a500981b494979b58d2b1041fec9c8 (127.5.126.65:34129): Network error: Client connection negotiation failed: client connection to 127.5.126.65:34129: connect: Connection refused (error 111)
I20260709 13:23:11.966713 14958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58a622a48cd24833bc5fc27e03114176" candidate_uuid: "a722e54d227f4c29a9ed6ce77858003a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0efc951052454eec9a58b0cd025945b8" is_pre_election: true
I20260709 13:23:11.968652 15073 leader_election.cc:304] T 58a622a48cd24833bc5fc27e03114176 P a722e54d227f4c29a9ed6ce77858003a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a722e54d227f4c29a9ed6ce77858003a; no voters: 0efc951052454eec9a58b0cd025945b8, f3a500981b494979b58d2b1041fec9c8
I20260709 13:23:11.970024 15753 raft_consensus.cc:2749] T 58a622a48cd24833bc5fc27e03114176 P a722e54d227f4c29a9ed6ce77858003a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:23:11.974023 15762 raft_consensus.cc:493] T 532cc9041f414e018098570192e0fae8 P a722e54d227f4c29a9ed6ce77858003a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f3a500981b494979b58d2b1041fec9c8)
I20260709 13:23:11.974593 15762 raft_consensus.cc:515] T 532cc9041f414e018098570192e0fae8 P a722e54d227f4c29a9ed6ce77858003a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } } peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } } peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } }
I20260709 13:23:11.974678 15731 raft_consensus.cc:493] T a71163721b4d48b0b5ff366b9d12ac32 P a722e54d227f4c29a9ed6ce77858003a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f3a500981b494979b58d2b1041fec9c8)
I20260709 13:23:11.976909 15731 raft_consensus.cc:515] T a71163721b4d48b0b5ff366b9d12ac32 P a722e54d227f4c29a9ed6ce77858003a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } } peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } } peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } }
I20260709 13:23:11.979904 15731 leader_election.cc:290] T a71163721b4d48b0b5ff366b9d12ac32 P a722e54d227f4c29a9ed6ce77858003a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f3a500981b494979b58d2b1041fec9c8 (127.5.126.65:34129), 0efc951052454eec9a58b0cd025945b8 (127.5.126.66:34613)
I20260709 13:23:11.993853 14958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a71163721b4d48b0b5ff366b9d12ac32" candidate_uuid: "a722e54d227f4c29a9ed6ce77858003a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0efc951052454eec9a58b0cd025945b8" is_pre_election: true
I20260709 13:23:11.994592 14958 raft_consensus.cc:2468] T a71163721b4d48b0b5ff366b9d12ac32 P 0efc951052454eec9a58b0cd025945b8 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a722e54d227f4c29a9ed6ce77858003a in term 1.
I20260709 13:23:11.995718 15762 leader_election.cc:290] T 532cc9041f414e018098570192e0fae8 P a722e54d227f4c29a9ed6ce77858003a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f3a500981b494979b58d2b1041fec9c8 (127.5.126.65:34129), 0efc951052454eec9a58b0cd025945b8 (127.5.126.66:34613)
I20260709 13:23:12.000072 15761 tablet_bootstrap.cc:492] T 88a7c4171c664e819837994755edf95c P f3a500981b494979b58d2b1041fec9c8: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:23:12.000856 14958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "532cc9041f414e018098570192e0fae8" candidate_uuid: "a722e54d227f4c29a9ed6ce77858003a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0efc951052454eec9a58b0cd025945b8" is_pre_election: true
I20260709 13:23:12.001511 15761 tablet_bootstrap.cc:492] T 88a7c4171c664e819837994755edf95c P f3a500981b494979b58d2b1041fec9c8: Bootstrap complete.
I20260709 13:23:12.002543 15761 ts_tablet_manager.cc:1403] T 88a7c4171c664e819837994755edf95c P f3a500981b494979b58d2b1041fec9c8: Time spent bootstrapping tablet: real 0.045s	user 0.024s	sys 0.008s
I20260709 13:23:12.006013 15073 leader_election.cc:304] T a71163721b4d48b0b5ff366b9d12ac32 P a722e54d227f4c29a9ed6ce77858003a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0efc951052454eec9a58b0cd025945b8, a722e54d227f4c29a9ed6ce77858003a; no voters: 
W20260709 13:23:12.007206 15073 leader_election.cc:336] T 532cc9041f414e018098570192e0fae8 P a722e54d227f4c29a9ed6ce77858003a [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer f3a500981b494979b58d2b1041fec9c8 (127.5.126.65:34129): Network error: Client connection negotiation failed: client connection to 127.5.126.65:34129: connect: Connection refused (error 111)
I20260709 13:23:12.006765 15761 raft_consensus.cc:359] T 88a7c4171c664e819837994755edf95c P f3a500981b494979b58d2b1041fec9c8 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } } peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } } peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } }
I20260709 13:23:12.007552 15762 raft_consensus.cc:2804] T a71163721b4d48b0b5ff366b9d12ac32 P a722e54d227f4c29a9ed6ce77858003a [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:23:12.008705 15761 raft_consensus.cc:740] T 88a7c4171c664e819837994755edf95c P f3a500981b494979b58d2b1041fec9c8 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: f3a500981b494979b58d2b1041fec9c8, State: Initialized, Role: FOLLOWER
I20260709 13:23:12.009640 15762 raft_consensus.cc:493] T a71163721b4d48b0b5ff366b9d12ac32 P a722e54d227f4c29a9ed6ce77858003a [term 1 FOLLOWER]: Starting leader election (detected failure of leader f3a500981b494979b58d2b1041fec9c8)
I20260709 13:23:12.010318 15762 raft_consensus.cc:3060] T a71163721b4d48b0b5ff366b9d12ac32 P a722e54d227f4c29a9ed6ce77858003a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:23:12.010483 15761 consensus_queue.cc:260] T 88a7c4171c664e819837994755edf95c P f3a500981b494979b58d2b1041fec9c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } } peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } } peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } }
I20260709 13:23:12.008529 15073 leader_election.cc:304] T 532cc9041f414e018098570192e0fae8 P a722e54d227f4c29a9ed6ce77858003a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a722e54d227f4c29a9ed6ce77858003a; no voters: 0efc951052454eec9a58b0cd025945b8, f3a500981b494979b58d2b1041fec9c8
I20260709 13:23:12.015376 15753 raft_consensus.cc:2749] T 532cc9041f414e018098570192e0fae8 P a722e54d227f4c29a9ed6ce77858003a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:23:12.015602 15073 leader_election.cc:336] T a71163721b4d48b0b5ff366b9d12ac32 P a722e54d227f4c29a9ed6ce77858003a [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer f3a500981b494979b58d2b1041fec9c8 (127.5.126.65:34129): Network error: Client connection negotiation failed: client connection to 127.5.126.65:34129: connect: Connection refused (error 111)
I20260709 13:23:12.013398 15761 ts_tablet_manager.cc:1434] T 88a7c4171c664e819837994755edf95c P f3a500981b494979b58d2b1041fec9c8: Time spent starting tablet: real 0.010s	user 0.011s	sys 0.000s
I20260709 13:23:12.019327 15761 tablet_bootstrap.cc:492] T 940021bf0c344d01bc3adaae308d968d P f3a500981b494979b58d2b1041fec9c8: Bootstrap starting.
I20260709 13:23:12.029660 15762 raft_consensus.cc:515] T a71163721b4d48b0b5ff366b9d12ac32 P a722e54d227f4c29a9ed6ce77858003a [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } } peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } } peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } }
I20260709 13:23:12.033423 14958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a71163721b4d48b0b5ff366b9d12ac32" candidate_uuid: "a722e54d227f4c29a9ed6ce77858003a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0efc951052454eec9a58b0cd025945b8"
I20260709 13:23:12.034094 14958 raft_consensus.cc:3060] T a71163721b4d48b0b5ff366b9d12ac32 P 0efc951052454eec9a58b0cd025945b8 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:23:12.036667 15073 leader_election.cc:336] T a71163721b4d48b0b5ff366b9d12ac32 P a722e54d227f4c29a9ed6ce77858003a [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer f3a500981b494979b58d2b1041fec9c8 (127.5.126.65:34129): Network error: Client connection negotiation failed: client connection to 127.5.126.65:34129: connect: Connection refused (error 111)
I20260709 13:23:12.031955 15762 leader_election.cc:290] T a71163721b4d48b0b5ff366b9d12ac32 P a722e54d227f4c29a9ed6ce77858003a [CANDIDATE]: Term 2 election: Requested vote from peers f3a500981b494979b58d2b1041fec9c8 (127.5.126.65:34129), 0efc951052454eec9a58b0cd025945b8 (127.5.126.66:34613)
I20260709 13:23:12.047652 15761 tablet_bootstrap.cc:492] T 940021bf0c344d01bc3adaae308d968d P f3a500981b494979b58d2b1041fec9c8: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:23:12.048781 15761 tablet_bootstrap.cc:492] T 940021bf0c344d01bc3adaae308d968d P f3a500981b494979b58d2b1041fec9c8: Bootstrap complete.
I20260709 13:23:12.049499 15761 ts_tablet_manager.cc:1403] T 940021bf0c344d01bc3adaae308d968d P f3a500981b494979b58d2b1041fec9c8: Time spent bootstrapping tablet: real 0.030s	user 0.018s	sys 0.000s
I20260709 13:23:12.050416 14958 raft_consensus.cc:2468] T a71163721b4d48b0b5ff366b9d12ac32 P 0efc951052454eec9a58b0cd025945b8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a722e54d227f4c29a9ed6ce77858003a in term 2.
I20260709 13:23:12.052428 15073 leader_election.cc:304] T a71163721b4d48b0b5ff366b9d12ac32 P a722e54d227f4c29a9ed6ce77858003a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0efc951052454eec9a58b0cd025945b8, a722e54d227f4c29a9ed6ce77858003a; no voters: f3a500981b494979b58d2b1041fec9c8
I20260709 13:23:12.052467 15761 raft_consensus.cc:359] T 940021bf0c344d01bc3adaae308d968d P f3a500981b494979b58d2b1041fec9c8 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } } peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } } peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } }
I20260709 13:23:12.053421 15761 raft_consensus.cc:740] T 940021bf0c344d01bc3adaae308d968d P f3a500981b494979b58d2b1041fec9c8 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: f3a500981b494979b58d2b1041fec9c8, State: Initialized, Role: FOLLOWER
I20260709 13:23:12.053701 15762 raft_consensus.cc:2804] T a71163721b4d48b0b5ff366b9d12ac32 P a722e54d227f4c29a9ed6ce77858003a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:23:12.054214 15762 raft_consensus.cc:697] T a71163721b4d48b0b5ff366b9d12ac32 P a722e54d227f4c29a9ed6ce77858003a [term 2 LEADER]: Becoming Leader. State: Replica: a722e54d227f4c29a9ed6ce77858003a, State: Running, Role: LEADER
I20260709 13:23:12.054291 15761 consensus_queue.cc:260] T 940021bf0c344d01bc3adaae308d968d P f3a500981b494979b58d2b1041fec9c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } } peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } } peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } }
I20260709 13:23:12.055215 15762 consensus_queue.cc:237] T a71163721b4d48b0b5ff366b9d12ac32 P a722e54d227f4c29a9ed6ce77858003a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } } peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } } peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } }
I20260709 13:23:12.056838 15761 ts_tablet_manager.cc:1434] T 940021bf0c344d01bc3adaae308d968d P f3a500981b494979b58d2b1041fec9c8: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:23:12.057745 15761 tablet_bootstrap.cc:492] T abc01daa220a47fa8578b0d20a17c9ab P f3a500981b494979b58d2b1041fec9c8: Bootstrap starting.
I20260709 13:23:12.071142 14779 catalog_manager.cc:5697] T a71163721b4d48b0b5ff366b9d12ac32 P a722e54d227f4c29a9ed6ce77858003a reported cstate change: term changed from 1 to 2, leader changed from f3a500981b494979b58d2b1041fec9c8 (127.5.126.65) to a722e54d227f4c29a9ed6ce77858003a (127.5.126.68). New cstate: current_term: 2 leader_uuid: "a722e54d227f4c29a9ed6ce77858003a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } health_report { overall_health: UNKNOWN } } }
I20260709 13:23:12.078169 15690 raft_consensus.cc:493] T 74a144396e4443288858878b63f08cc8 P a1a22e9119494570b6d2217713fd7e43 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f3a500981b494979b58d2b1041fec9c8)
I20260709 13:23:12.079110 15690 raft_consensus.cc:515] T 74a144396e4443288858878b63f08cc8 P a1a22e9119494570b6d2217713fd7e43 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } } peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } } peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } }
I20260709 13:23:12.083755 15761 tablet_bootstrap.cc:492] T abc01daa220a47fa8578b0d20a17c9ab P f3a500981b494979b58d2b1041fec9c8: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:23:12.084897 15761 tablet_bootstrap.cc:492] T abc01daa220a47fa8578b0d20a17c9ab P f3a500981b494979b58d2b1041fec9c8: Bootstrap complete.
I20260709 13:23:12.082230 15690 leader_election.cc:290] T 74a144396e4443288858878b63f08cc8 P a1a22e9119494570b6d2217713fd7e43 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f3a500981b494979b58d2b1041fec9c8 (127.5.126.65:34129), 0efc951052454eec9a58b0cd025945b8 (127.5.126.66:34613)
I20260709 13:23:12.085690 15761 ts_tablet_manager.cc:1403] T abc01daa220a47fa8578b0d20a17c9ab P f3a500981b494979b58d2b1041fec9c8: Time spent bootstrapping tablet: real 0.028s	user 0.014s	sys 0.012s
I20260709 13:23:12.085613 14958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74a144396e4443288858878b63f08cc8" candidate_uuid: "a1a22e9119494570b6d2217713fd7e43" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0efc951052454eec9a58b0cd025945b8" is_pre_election: true
I20260709 13:23:12.088629 15761 raft_consensus.cc:359] T abc01daa220a47fa8578b0d20a17c9ab P f3a500981b494979b58d2b1041fec9c8 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } } peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } } peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } }
I20260709 13:23:12.089357 15761 raft_consensus.cc:740] T abc01daa220a47fa8578b0d20a17c9ab P f3a500981b494979b58d2b1041fec9c8 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: f3a500981b494979b58d2b1041fec9c8, State: Initialized, Role: FOLLOWER
I20260709 13:23:12.090246 15761 consensus_queue.cc:260] T abc01daa220a47fa8578b0d20a17c9ab P f3a500981b494979b58d2b1041fec9c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } } peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } } peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } }
I20260709 13:23:12.090780 15690 raft_consensus.cc:493] T dee43e01ec5d409b877a5c2dbf5b7b77 P a1a22e9119494570b6d2217713fd7e43 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f3a500981b494979b58d2b1041fec9c8)
I20260709 13:23:12.092919 15761 ts_tablet_manager.cc:1434] T abc01daa220a47fa8578b0d20a17c9ab P f3a500981b494979b58d2b1041fec9c8: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
W20260709 13:23:12.093497 14999 leader_election.cc:336] T 74a144396e4443288858878b63f08cc8 P a1a22e9119494570b6d2217713fd7e43 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer f3a500981b494979b58d2b1041fec9c8 (127.5.126.65:34129): Network error: Client connection negotiation failed: client connection to 127.5.126.65:34129: connect: Connection refused (error 111)
I20260709 13:23:12.094079 14999 leader_election.cc:304] T 74a144396e4443288858878b63f08cc8 P a1a22e9119494570b6d2217713fd7e43 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1a22e9119494570b6d2217713fd7e43; no voters: 0efc951052454eec9a58b0cd025945b8, f3a500981b494979b58d2b1041fec9c8
I20260709 13:23:12.094987 15744 raft_consensus.cc:493] T f86a730e237248dc9b91cbb75e29c324 P a1a22e9119494570b6d2217713fd7e43 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f3a500981b494979b58d2b1041fec9c8)
I20260709 13:23:12.095656 15744 raft_consensus.cc:515] T f86a730e237248dc9b91cbb75e29c324 P a1a22e9119494570b6d2217713fd7e43 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } } peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } } peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } }
I20260709 13:23:12.096206 15763 raft_consensus.cc:2749] T 74a144396e4443288858878b63f08cc8 P a1a22e9119494570b6d2217713fd7e43 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:23:12.096498 15762 raft_consensus.cc:493] T f86a730e237248dc9b91cbb75e29c324 P a722e54d227f4c29a9ed6ce77858003a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f3a500981b494979b58d2b1041fec9c8)
I20260709 13:23:12.097157 15762 raft_consensus.cc:515] T f86a730e237248dc9b91cbb75e29c324 P a722e54d227f4c29a9ed6ce77858003a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } } peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } } peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } }
I20260709 13:23:12.093809 15761 tablet_bootstrap.cc:492] T 46ed2e9dd1324ac4a6e07f813cfebb7e P f3a500981b494979b58d2b1041fec9c8: Bootstrap starting.
I20260709 13:23:12.100735 15032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86a730e237248dc9b91cbb75e29c324" candidate_uuid: "a722e54d227f4c29a9ed6ce77858003a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a1a22e9119494570b6d2217713fd7e43" is_pre_election: true
I20260709 13:23:12.092104 15690 raft_consensus.cc:515] T dee43e01ec5d409b877a5c2dbf5b7b77 P a1a22e9119494570b6d2217713fd7e43 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } } peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } } peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } }
I20260709 13:23:12.104307 15763 raft_consensus.cc:493] T bf0b7c8005aa4d8ab97a1499761bf98a P a1a22e9119494570b6d2217713fd7e43 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f3a500981b494979b58d2b1041fec9c8)
I20260709 13:23:12.104910 15763 raft_consensus.cc:515] T bf0b7c8005aa4d8ab97a1499761bf98a P a1a22e9119494570b6d2217713fd7e43 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } } peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } } peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } }
I20260709 13:23:12.105269 15762 leader_election.cc:290] T f86a730e237248dc9b91cbb75e29c324 P a722e54d227f4c29a9ed6ce77858003a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a1a22e9119494570b6d2217713fd7e43 (127.5.126.67:38125), f3a500981b494979b58d2b1041fec9c8 (127.5.126.65:34129)
I20260709 13:23:12.107028 15763 leader_election.cc:290] T bf0b7c8005aa4d8ab97a1499761bf98a P a1a22e9119494570b6d2217713fd7e43 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a722e54d227f4c29a9ed6ce77858003a (127.5.126.68:46669), f3a500981b494979b58d2b1041fec9c8 (127.5.126.65:34129)
W20260709 13:23:12.109295 15073 leader_election.cc:336] T f86a730e237248dc9b91cbb75e29c324 P a722e54d227f4c29a9ed6ce77858003a [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer f3a500981b494979b58d2b1041fec9c8 (127.5.126.65:34129): Network error: Client connection negotiation failed: client connection to 127.5.126.65:34129: connect: Connection refused (error 111)
I20260709 13:23:12.112709 15104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dee43e01ec5d409b877a5c2dbf5b7b77" candidate_uuid: "a1a22e9119494570b6d2217713fd7e43" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a722e54d227f4c29a9ed6ce77858003a" is_pre_election: true
I20260709 13:23:12.114161 15103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf0b7c8005aa4d8ab97a1499761bf98a" candidate_uuid: "a1a22e9119494570b6d2217713fd7e43" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a722e54d227f4c29a9ed6ce77858003a" is_pre_election: true
I20260709 13:23:12.104928 15690 leader_election.cc:290] T dee43e01ec5d409b877a5c2dbf5b7b77 P a1a22e9119494570b6d2217713fd7e43 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a722e54d227f4c29a9ed6ce77858003a (127.5.126.68:46669), f3a500981b494979b58d2b1041fec9c8 (127.5.126.65:34129)
I20260709 13:23:12.121575 15032 raft_consensus.cc:2468] T f86a730e237248dc9b91cbb75e29c324 P a1a22e9119494570b6d2217713fd7e43 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a722e54d227f4c29a9ed6ce77858003a in term 1.
I20260709 13:23:12.123275 15744 leader_election.cc:290] T f86a730e237248dc9b91cbb75e29c324 P a1a22e9119494570b6d2217713fd7e43 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a722e54d227f4c29a9ed6ce77858003a (127.5.126.68:46669), f3a500981b494979b58d2b1041fec9c8 (127.5.126.65:34129)
I20260709 13:23:12.125715 15762 raft_consensus.cc:493] T e85432ede09747339c957cdaa7d15ac6 P a722e54d227f4c29a9ed6ce77858003a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f3a500981b494979b58d2b1041fec9c8)
I20260709 13:23:12.126036 15072 leader_election.cc:304] T f86a730e237248dc9b91cbb75e29c324 P a722e54d227f4c29a9ed6ce77858003a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a1a22e9119494570b6d2217713fd7e43, a722e54d227f4c29a9ed6ce77858003a; no voters: f3a500981b494979b58d2b1041fec9c8
I20260709 13:23:12.126338 15762 raft_consensus.cc:515] T e85432ede09747339c957cdaa7d15ac6 P a722e54d227f4c29a9ed6ce77858003a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } } peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } } peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } }
I20260709 13:23:12.127280 15731 raft_consensus.cc:493] T bf0b7c8005aa4d8ab97a1499761bf98a P a722e54d227f4c29a9ed6ce77858003a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f3a500981b494979b58d2b1041fec9c8)
I20260709 13:23:12.127807 15731 raft_consensus.cc:515] T bf0b7c8005aa4d8ab97a1499761bf98a P a722e54d227f4c29a9ed6ce77858003a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } } peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } } peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } }
I20260709 13:23:12.128610 15762 leader_election.cc:290] T e85432ede09747339c957cdaa7d15ac6 P a722e54d227f4c29a9ed6ce77858003a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a1a22e9119494570b6d2217713fd7e43 (127.5.126.67:38125), f3a500981b494979b58d2b1041fec9c8 (127.5.126.65:34129)
I20260709 13:23:12.129184 15762 raft_consensus.cc:2804] T f86a730e237248dc9b91cbb75e29c324 P a722e54d227f4c29a9ed6ce77858003a [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:23:12.129529 15762 raft_consensus.cc:493] T f86a730e237248dc9b91cbb75e29c324 P a722e54d227f4c29a9ed6ce77858003a [term 1 FOLLOWER]: Starting leader election (detected failure of leader f3a500981b494979b58d2b1041fec9c8)
I20260709 13:23:12.129881 15762 raft_consensus.cc:3060] T f86a730e237248dc9b91cbb75e29c324 P a722e54d227f4c29a9ed6ce77858003a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:23:12.129930 15731 leader_election.cc:290] T bf0b7c8005aa4d8ab97a1499761bf98a P a722e54d227f4c29a9ed6ce77858003a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a1a22e9119494570b6d2217713fd7e43 (127.5.126.67:38125), f3a500981b494979b58d2b1041fec9c8 (127.5.126.65:34129)
I20260709 13:23:12.132277 15032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e85432ede09747339c957cdaa7d15ac6" candidate_uuid: "a722e54d227f4c29a9ed6ce77858003a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a1a22e9119494570b6d2217713fd7e43" is_pre_election: true
I20260709 13:23:12.132557 15029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf0b7c8005aa4d8ab97a1499761bf98a" candidate_uuid: "a722e54d227f4c29a9ed6ce77858003a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a1a22e9119494570b6d2217713fd7e43" is_pre_election: true
I20260709 13:23:12.133178 15029 raft_consensus.cc:2468] T bf0b7c8005aa4d8ab97a1499761bf98a P a1a22e9119494570b6d2217713fd7e43 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a722e54d227f4c29a9ed6ce77858003a in term 1.
I20260709 13:23:12.137141 15103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86a730e237248dc9b91cbb75e29c324" candidate_uuid: "a1a22e9119494570b6d2217713fd7e43" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a722e54d227f4c29a9ed6ce77858003a" is_pre_election: true
I20260709 13:23:12.138355 15072 leader_election.cc:304] T bf0b7c8005aa4d8ab97a1499761bf98a P a722e54d227f4c29a9ed6ce77858003a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1a22e9119494570b6d2217713fd7e43, a722e54d227f4c29a9ed6ce77858003a; no voters: 
I20260709 13:23:12.139269 15731 raft_consensus.cc:2804] T bf0b7c8005aa4d8ab97a1499761bf98a P a722e54d227f4c29a9ed6ce77858003a [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:23:12.139665 15731 raft_consensus.cc:493] T bf0b7c8005aa4d8ab97a1499761bf98a P a722e54d227f4c29a9ed6ce77858003a [term 1 FOLLOWER]: Starting leader election (detected failure of leader f3a500981b494979b58d2b1041fec9c8)
I20260709 13:23:12.140067 15731 raft_consensus.cc:3060] T bf0b7c8005aa4d8ab97a1499761bf98a P a722e54d227f4c29a9ed6ce77858003a [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:23:12.140856 14999 leader_election.cc:336] T dee43e01ec5d409b877a5c2dbf5b7b77 P a1a22e9119494570b6d2217713fd7e43 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer f3a500981b494979b58d2b1041fec9c8 (127.5.126.65:34129): Network error: Client connection negotiation failed: client connection to 127.5.126.65:34129: connect: Connection refused (error 111)
I20260709 13:23:12.141409 14999 leader_election.cc:304] T dee43e01ec5d409b877a5c2dbf5b7b77 P a1a22e9119494570b6d2217713fd7e43 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1a22e9119494570b6d2217713fd7e43; no voters: a722e54d227f4c29a9ed6ce77858003a, f3a500981b494979b58d2b1041fec9c8
W20260709 13:23:12.144187 15073 leader_election.cc:336] T e85432ede09747339c957cdaa7d15ac6 P a722e54d227f4c29a9ed6ce77858003a [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer f3a500981b494979b58d2b1041fec9c8 (127.5.126.65:34129): Network error: Client connection negotiation failed: client connection to 127.5.126.65:34129: connect: Connection refused (error 111)
I20260709 13:23:12.144773 15073 leader_election.cc:304] T e85432ede09747339c957cdaa7d15ac6 P a722e54d227f4c29a9ed6ce77858003a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a722e54d227f4c29a9ed6ce77858003a; no voters: a1a22e9119494570b6d2217713fd7e43, f3a500981b494979b58d2b1041fec9c8
I20260709 13:23:12.145606 15753 raft_consensus.cc:2749] T e85432ede09747339c957cdaa7d15ac6 P a722e54d227f4c29a9ed6ce77858003a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:23:12.146975 15073 leader_election.cc:336] T bf0b7c8005aa4d8ab97a1499761bf98a P a722e54d227f4c29a9ed6ce77858003a [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer f3a500981b494979b58d2b1041fec9c8 (127.5.126.65:34129): Network error: Client connection negotiation failed: client connection to 127.5.126.65:34129: connect: Connection refused (error 111)
I20260709 13:23:12.147370 15690 raft_consensus.cc:2749] T dee43e01ec5d409b877a5c2dbf5b7b77 P a1a22e9119494570b6d2217713fd7e43 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:23:12.148974 14999 leader_election.cc:336] T bf0b7c8005aa4d8ab97a1499761bf98a P a1a22e9119494570b6d2217713fd7e43 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer f3a500981b494979b58d2b1041fec9c8 (127.5.126.65:34129): Network error: Client connection negotiation failed: client connection to 127.5.126.65:34129: connect: Connection refused (error 111)
I20260709 13:23:12.149551 14999 leader_election.cc:304] T bf0b7c8005aa4d8ab97a1499761bf98a P a1a22e9119494570b6d2217713fd7e43 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1a22e9119494570b6d2217713fd7e43; no voters: a722e54d227f4c29a9ed6ce77858003a, f3a500981b494979b58d2b1041fec9c8
I20260709 13:23:12.150527 15744 raft_consensus.cc:2749] T bf0b7c8005aa4d8ab97a1499761bf98a P a1a22e9119494570b6d2217713fd7e43 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:23:12.155373 15735 raft_consensus.cc:493] T af00ad02fba64998bb25991f6f69f291 P 0efc951052454eec9a58b0cd025945b8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f3a500981b494979b58d2b1041fec9c8)
I20260709 13:23:12.156243 15753 raft_consensus.cc:493] T 03b63e2bee374ed5931dab67ee14b555 P a722e54d227f4c29a9ed6ce77858003a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f3a500981b494979b58d2b1041fec9c8)
I20260709 13:23:12.156170 15735 raft_consensus.cc:515] T af00ad02fba64998bb25991f6f69f291 P 0efc951052454eec9a58b0cd025945b8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } } peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } } peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } }
I20260709 13:23:12.156942 15753 raft_consensus.cc:515] T 03b63e2bee374ed5931dab67ee14b555 P a722e54d227f4c29a9ed6ce77858003a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } } peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } } peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } }
I20260709 13:23:12.161145 15735 leader_election.cc:290] T af00ad02fba64998bb25991f6f69f291 P 0efc951052454eec9a58b0cd025945b8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a722e54d227f4c29a9ed6ce77858003a (127.5.126.68:46669), f3a500981b494979b58d2b1041fec9c8 (127.5.126.65:34129)
I20260709 13:23:12.160677 15753 leader_election.cc:290] T 03b63e2bee374ed5931dab67ee14b555 P a722e54d227f4c29a9ed6ce77858003a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a1a22e9119494570b6d2217713fd7e43 (127.5.126.67:38125), f3a500981b494979b58d2b1041fec9c8 (127.5.126.65:34129)
I20260709 13:23:12.164978 15029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03b63e2bee374ed5931dab67ee14b555" candidate_uuid: "a722e54d227f4c29a9ed6ce77858003a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a1a22e9119494570b6d2217713fd7e43" is_pre_election: true
W20260709 13:23:12.166236 15073 leader_election.cc:336] T 03b63e2bee374ed5931dab67ee14b555 P a722e54d227f4c29a9ed6ce77858003a [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer f3a500981b494979b58d2b1041fec9c8 (127.5.126.65:34129): Network error: Client connection negotiation failed: client connection to 127.5.126.65:34129: connect: Connection refused (error 111)
W20260709 13:23:12.166486 14925 leader_election.cc:336] T af00ad02fba64998bb25991f6f69f291 P 0efc951052454eec9a58b0cd025945b8 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer f3a500981b494979b58d2b1041fec9c8 (127.5.126.65:34129): Network error: Client connection negotiation failed: client connection to 127.5.126.65:34129: connect: Connection refused (error 111)
I20260709 13:23:12.166913 15072 leader_election.cc:304] T 03b63e2bee374ed5931dab67ee14b555 P a722e54d227f4c29a9ed6ce77858003a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a722e54d227f4c29a9ed6ce77858003a; no voters: a1a22e9119494570b6d2217713fd7e43, f3a500981b494979b58d2b1041fec9c8
I20260709 13:23:12.168244 15753 raft_consensus.cc:2749] T 03b63e2bee374ed5931dab67ee14b555 P a722e54d227f4c29a9ed6ce77858003a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:23:12.174518 15762 raft_consensus.cc:515] T f86a730e237248dc9b91cbb75e29c324 P a722e54d227f4c29a9ed6ce77858003a [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } } peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } } peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } }
I20260709 13:23:12.176144 15103 raft_consensus.cc:2393] T f86a730e237248dc9b91cbb75e29c324 P a722e54d227f4c29a9ed6ce77858003a [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a1a22e9119494570b6d2217713fd7e43 in current term 2: Already voted for candidate a722e54d227f4c29a9ed6ce77858003a in this term.
W20260709 13:23:12.180714 14999 leader_election.cc:336] T f86a730e237248dc9b91cbb75e29c324 P a1a22e9119494570b6d2217713fd7e43 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer f3a500981b494979b58d2b1041fec9c8 (127.5.126.65:34129): Network error: Client connection negotiation failed: client connection to 127.5.126.65:34129: connect: Connection refused (error 111)
I20260709 13:23:12.183133 14999 leader_election.cc:304] T f86a730e237248dc9b91cbb75e29c324 P a1a22e9119494570b6d2217713fd7e43 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1a22e9119494570b6d2217713fd7e43; no voters: a722e54d227f4c29a9ed6ce77858003a, f3a500981b494979b58d2b1041fec9c8
I20260709 13:23:12.184193 15763 raft_consensus.cc:3060] T f86a730e237248dc9b91cbb75e29c324 P a1a22e9119494570b6d2217713fd7e43 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:23:12.184928 15104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af00ad02fba64998bb25991f6f69f291" candidate_uuid: "0efc951052454eec9a58b0cd025945b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a722e54d227f4c29a9ed6ce77858003a" is_pre_election: true
I20260709 13:23:12.186445 14925 leader_election.cc:304] T af00ad02fba64998bb25991f6f69f291 P 0efc951052454eec9a58b0cd025945b8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0efc951052454eec9a58b0cd025945b8; no voters: a722e54d227f4c29a9ed6ce77858003a, f3a500981b494979b58d2b1041fec9c8
I20260709 13:23:12.187729 15735 raft_consensus.cc:2749] T af00ad02fba64998bb25991f6f69f291 P 0efc951052454eec9a58b0cd025945b8 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:23:12.187911 15744 raft_consensus.cc:493] T 107541237b4a452e8b47b0c3527b7ede P a1a22e9119494570b6d2217713fd7e43 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f3a500981b494979b58d2b1041fec9c8)
I20260709 13:23:12.188514 15744 raft_consensus.cc:515] T 107541237b4a452e8b47b0c3527b7ede P a1a22e9119494570b6d2217713fd7e43 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } } peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } } peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } }
I20260709 13:23:12.191347 15744 leader_election.cc:290] T 107541237b4a452e8b47b0c3527b7ede P a1a22e9119494570b6d2217713fd7e43 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f3a500981b494979b58d2b1041fec9c8 (127.5.126.65:34129), 0efc951052454eec9a58b0cd025945b8 (127.5.126.66:34613)
I20260709 13:23:12.192113 15763 raft_consensus.cc:2749] T f86a730e237248dc9b91cbb75e29c324 P a1a22e9119494570b6d2217713fd7e43 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:23:12.180903 15761 tablet_bootstrap.cc:492] T 46ed2e9dd1324ac4a6e07f813cfebb7e P f3a500981b494979b58d2b1041fec9c8: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:23:12.193925 15761 tablet_bootstrap.cc:492] T 46ed2e9dd1324ac4a6e07f813cfebb7e P f3a500981b494979b58d2b1041fec9c8: Bootstrap complete.
I20260709 13:23:12.194610 15761 ts_tablet_manager.cc:1403] T 46ed2e9dd1324ac4a6e07f813cfebb7e P f3a500981b494979b58d2b1041fec9c8: Time spent bootstrapping tablet: real 0.101s	user 0.019s	sys 0.014s
I20260709 13:23:12.194489 14958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "107541237b4a452e8b47b0c3527b7ede" candidate_uuid: "a1a22e9119494570b6d2217713fd7e43" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0efc951052454eec9a58b0cd025945b8" is_pre_election: true
I20260709 13:23:12.197680 15735 raft_consensus.cc:493] T 74a144396e4443288858878b63f08cc8 P 0efc951052454eec9a58b0cd025945b8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f3a500981b494979b58d2b1041fec9c8)
I20260709 13:23:12.198414 15735 raft_consensus.cc:515] T 74a144396e4443288858878b63f08cc8 P 0efc951052454eec9a58b0cd025945b8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } } peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } } peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } }
W20260709 13:23:12.200011 14999 leader_election.cc:336] T 107541237b4a452e8b47b0c3527b7ede P a1a22e9119494570b6d2217713fd7e43 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer f3a500981b494979b58d2b1041fec9c8 (127.5.126.65:34129): Network error: Client connection negotiation failed: client connection to 127.5.126.65:34129: connect: Connection refused (error 111)
I20260709 13:23:12.200886 14999 leader_election.cc:304] T 107541237b4a452e8b47b0c3527b7ede P a1a22e9119494570b6d2217713fd7e43 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1a22e9119494570b6d2217713fd7e43; no voters: 0efc951052454eec9a58b0cd025945b8, f3a500981b494979b58d2b1041fec9c8
I20260709 13:23:12.201807 15763 raft_consensus.cc:2749] T 107541237b4a452e8b47b0c3527b7ede P a1a22e9119494570b6d2217713fd7e43 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:23:12.203390 15761 raft_consensus.cc:359] T 46ed2e9dd1324ac4a6e07f813cfebb7e P f3a500981b494979b58d2b1041fec9c8 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } } peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } } peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } }
I20260709 13:23:12.204196 15761 raft_consensus.cc:740] T 46ed2e9dd1324ac4a6e07f813cfebb7e P f3a500981b494979b58d2b1041fec9c8 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: f3a500981b494979b58d2b1041fec9c8, State: Initialized, Role: FOLLOWER
I20260709 13:23:12.204955 15731 raft_consensus.cc:515] T bf0b7c8005aa4d8ab97a1499761bf98a P a722e54d227f4c29a9ed6ce77858003a [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } } peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } } peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } }
I20260709 13:23:12.205022 15761 consensus_queue.cc:260] T 46ed2e9dd1324ac4a6e07f813cfebb7e P f3a500981b494979b58d2b1041fec9c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } } peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } } peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } }
I20260709 13:23:12.208146 15761 ts_tablet_manager.cc:1434] T 46ed2e9dd1324ac4a6e07f813cfebb7e P f3a500981b494979b58d2b1041fec9c8: Time spent starting tablet: real 0.013s	user 0.005s	sys 0.004s
I20260709 13:23:12.208534 15029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74a144396e4443288858878b63f08cc8" candidate_uuid: "0efc951052454eec9a58b0cd025945b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a1a22e9119494570b6d2217713fd7e43" is_pre_election: true
I20260709 13:23:12.209337 15761 tablet_bootstrap.cc:492] T 2a9523aa8663464686254c8412c37e67 P f3a500981b494979b58d2b1041fec9c8: Bootstrap starting.
I20260709 13:23:12.210602 15032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86a730e237248dc9b91cbb75e29c324" candidate_uuid: "a722e54d227f4c29a9ed6ce77858003a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a1a22e9119494570b6d2217713fd7e43"
I20260709 13:23:12.209288 15029 raft_consensus.cc:2468] T 74a144396e4443288858878b63f08cc8 P a1a22e9119494570b6d2217713fd7e43 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0efc951052454eec9a58b0cd025945b8 in term 1.
W20260709 13:23:12.212663 14925 leader_election.cc:336] T 74a144396e4443288858878b63f08cc8 P 0efc951052454eec9a58b0cd025945b8 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer f3a500981b494979b58d2b1041fec9c8 (127.5.126.65:34129): Network error: Client connection negotiation failed: client connection to 127.5.126.65:34129: connect: Connection refused (error 111)
I20260709 13:23:12.215332 15822 raft_consensus.cc:493] T aecef3c240394d54844ec8170e9cad59 P a722e54d227f4c29a9ed6ce77858003a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f3a500981b494979b58d2b1041fec9c8)
I20260709 13:23:12.216086 15822 raft_consensus.cc:515] T aecef3c240394d54844ec8170e9cad59 P a722e54d227f4c29a9ed6ce77858003a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } } peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } } peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } }
I20260709 13:23:12.218735 15822 leader_election.cc:290] T aecef3c240394d54844ec8170e9cad59 P a722e54d227f4c29a9ed6ce77858003a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f3a500981b494979b58d2b1041fec9c8 (127.5.126.65:34129), 0efc951052454eec9a58b0cd025945b8 (127.5.126.66:34613)
I20260709 13:23:12.212414 15735 leader_election.cc:290] T 74a144396e4443288858878b63f08cc8 P 0efc951052454eec9a58b0cd025945b8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f3a500981b494979b58d2b1041fec9c8 (127.5.126.65:34129), a1a22e9119494570b6d2217713fd7e43 (127.5.126.67:38125)
I20260709 13:23:12.220570 14958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aecef3c240394d54844ec8170e9cad59" candidate_uuid: "a722e54d227f4c29a9ed6ce77858003a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0efc951052454eec9a58b0cd025945b8" is_pre_election: true
I20260709 13:23:12.221556 14924 leader_election.cc:304] T 74a144396e4443288858878b63f08cc8 P 0efc951052454eec9a58b0cd025945b8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0efc951052454eec9a58b0cd025945b8, a1a22e9119494570b6d2217713fd7e43; no voters: f3a500981b494979b58d2b1041fec9c8
I20260709 13:23:12.226940 15589 raft_consensus.cc:2804] T 74a144396e4443288858878b63f08cc8 P 0efc951052454eec9a58b0cd025945b8 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:23:12.227113 15762 leader_election.cc:290] T f86a730e237248dc9b91cbb75e29c324 P a722e54d227f4c29a9ed6ce77858003a [CANDIDATE]: Term 2 election: Requested vote from peers a1a22e9119494570b6d2217713fd7e43 (127.5.126.67:38125), f3a500981b494979b58d2b1041fec9c8 (127.5.126.65:34129)
I20260709 13:23:12.228473 15731 leader_election.cc:290] T bf0b7c8005aa4d8ab97a1499761bf98a P a722e54d227f4c29a9ed6ce77858003a [CANDIDATE]: Term 2 election: Requested vote from peers a1a22e9119494570b6d2217713fd7e43 (127.5.126.67:38125), f3a500981b494979b58d2b1041fec9c8 (127.5.126.65:34129)
I20260709 13:23:12.227427 15589 raft_consensus.cc:493] T 74a144396e4443288858878b63f08cc8 P 0efc951052454eec9a58b0cd025945b8 [term 1 FOLLOWER]: Starting leader election (detected failure of leader f3a500981b494979b58d2b1041fec9c8)
I20260709 13:23:12.229576 15589 raft_consensus.cc:3060] T 74a144396e4443288858878b63f08cc8 P 0efc951052454eec9a58b0cd025945b8 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:23:12.231163 15073 leader_election.cc:336] T aecef3c240394d54844ec8170e9cad59 P a722e54d227f4c29a9ed6ce77858003a [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer f3a500981b494979b58d2b1041fec9c8 (127.5.126.65:34129): Network error: Client connection negotiation failed: client connection to 127.5.126.65:34129: connect: Connection refused (error 111)
I20260709 13:23:12.231607 15073 leader_election.cc:304] T aecef3c240394d54844ec8170e9cad59 P a722e54d227f4c29a9ed6ce77858003a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a722e54d227f4c29a9ed6ce77858003a; no voters: 0efc951052454eec9a58b0cd025945b8, f3a500981b494979b58d2b1041fec9c8
I20260709 13:23:12.232362 15731 raft_consensus.cc:2749] T aecef3c240394d54844ec8170e9cad59 P a722e54d227f4c29a9ed6ce77858003a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:23:12.236011 15073 leader_election.cc:336] T f86a730e237248dc9b91cbb75e29c324 P a722e54d227f4c29a9ed6ce77858003a [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer f3a500981b494979b58d2b1041fec9c8 (127.5.126.65:34129): Network error: Client connection negotiation failed: client connection to 127.5.126.65:34129: connect: Connection refused (error 111)
W20260709 13:23:12.236722 15073 leader_election.cc:336] T bf0b7c8005aa4d8ab97a1499761bf98a P a722e54d227f4c29a9ed6ce77858003a [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer f3a500981b494979b58d2b1041fec9c8 (127.5.126.65:34129): Network error: Client connection negotiation failed: client connection to 127.5.126.65:34129: connect: Connection refused (error 111)
I20260709 13:23:12.237412 15763 raft_consensus.cc:493] T 70d027ba81f54eba882756b941186710 P a1a22e9119494570b6d2217713fd7e43 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f3a500981b494979b58d2b1041fec9c8)
I20260709 13:23:12.238058 15763 raft_consensus.cc:515] T 70d027ba81f54eba882756b941186710 P a1a22e9119494570b6d2217713fd7e43 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } } peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } } peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } }
I20260709 13:23:12.239039 15588 raft_consensus.cc:493] T 532cc9041f414e018098570192e0fae8 P 0efc951052454eec9a58b0cd025945b8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f3a500981b494979b58d2b1041fec9c8)
I20260709 13:23:12.239583 15588 raft_consensus.cc:515] T 532cc9041f414e018098570192e0fae8 P 0efc951052454eec9a58b0cd025945b8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } } peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } } peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } }
I20260709 13:23:12.240768 15763 leader_election.cc:290] T 70d027ba81f54eba882756b941186710 P a1a22e9119494570b6d2217713fd7e43 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a722e54d227f4c29a9ed6ce77858003a (127.5.126.68:46669), f3a500981b494979b58d2b1041fec9c8 (127.5.126.65:34129)
I20260709 13:23:12.241629 15731 raft_consensus.cc:493] T af00ad02fba64998bb25991f6f69f291 P a722e54d227f4c29a9ed6ce77858003a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f3a500981b494979b58d2b1041fec9c8)
I20260709 13:23:12.242306 15731 raft_consensus.cc:515] T af00ad02fba64998bb25991f6f69f291 P a722e54d227f4c29a9ed6ce77858003a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } } peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } } peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } }
I20260709 13:23:12.244424 15731 leader_election.cc:290] T af00ad02fba64998bb25991f6f69f291 P a722e54d227f4c29a9ed6ce77858003a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f3a500981b494979b58d2b1041fec9c8 (127.5.126.65:34129), 0efc951052454eec9a58b0cd025945b8 (127.5.126.66:34613)
I20260709 13:23:12.245435 15763 raft_consensus.cc:493] T 46ed2e9dd1324ac4a6e07f813cfebb7e P a1a22e9119494570b6d2217713fd7e43 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f3a500981b494979b58d2b1041fec9c8)
I20260709 13:23:12.246025 15763 raft_consensus.cc:515] T 46ed2e9dd1324ac4a6e07f813cfebb7e P a1a22e9119494570b6d2217713fd7e43 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } } peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } } peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } }
I20260709 13:23:12.241736 15588 leader_election.cc:290] T 532cc9041f414e018098570192e0fae8 P 0efc951052454eec9a58b0cd025945b8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a722e54d227f4c29a9ed6ce77858003a (127.5.126.68:46669), f3a500981b494979b58d2b1041fec9c8 (127.5.126.65:34129)
W20260709 13:23:12.248106 14999 leader_election.cc:336] T 70d027ba81f54eba882756b941186710 P a1a22e9119494570b6d2217713fd7e43 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer f3a500981b494979b58d2b1041fec9c8 (127.5.126.65:34129): Network error: Client connection negotiation failed: client connection to 127.5.126.65:34129: connect: Connection refused (error 111)
I20260709 13:23:12.250731 15735 raft_consensus.cc:493] T b0b7e1c1e67845cb9bd2208bb2fb7c21 P 0efc951052454eec9a58b0cd025945b8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f3a500981b494979b58d2b1041fec9c8)
I20260709 13:23:12.251005 14958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46ed2e9dd1324ac4a6e07f813cfebb7e" candidate_uuid: "a1a22e9119494570b6d2217713fd7e43" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0efc951052454eec9a58b0cd025945b8" is_pre_election: true
I20260709 13:23:12.252431 15735 raft_consensus.cc:515] T b0b7e1c1e67845cb9bd2208bb2fb7c21 P 0efc951052454eec9a58b0cd025945b8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } } peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } } peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } }
I20260709 13:23:12.254665 15744 raft_consensus.cc:493] T 03b63e2bee374ed5931dab67ee14b555 P a1a22e9119494570b6d2217713fd7e43 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f3a500981b494979b58d2b1041fec9c8)
I20260709 13:23:12.255208 15744 raft_consensus.cc:515] T 03b63e2bee374ed5931dab67ee14b555 P a1a22e9119494570b6d2217713fd7e43 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } } peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } } peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } }
W20260709 13:23:12.256345 14999 leader_election.cc:336] T 46ed2e9dd1324ac4a6e07f813cfebb7e P a1a22e9119494570b6d2217713fd7e43 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer f3a500981b494979b58d2b1041fec9c8 (127.5.126.65:34129): Network error: Client connection negotiation failed: client connection to 127.5.126.65:34129: connect: Connection refused (error 111)
I20260709 13:23:12.256793 15032 raft_consensus.cc:2468] T f86a730e237248dc9b91cbb75e29c324 P a1a22e9119494570b6d2217713fd7e43 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a722e54d227f4c29a9ed6ce77858003a in term 2.
I20260709 13:23:12.257189 15744 leader_election.cc:290] T 03b63e2bee374ed5931dab67ee14b555 P a1a22e9119494570b6d2217713fd7e43 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a722e54d227f4c29a9ed6ce77858003a (127.5.126.68:46669), f3a500981b494979b58d2b1041fec9c8 (127.5.126.65:34129)
I20260709 13:23:12.257093 14999 leader_election.cc:304] T 46ed2e9dd1324ac4a6e07f813cfebb7e P a1a22e9119494570b6d2217713fd7e43 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1a22e9119494570b6d2217713fd7e43; no voters: 0efc951052454eec9a58b0cd025945b8, f3a500981b494979b58d2b1041fec9c8
I20260709 13:23:12.264752 15034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf0b7c8005aa4d8ab97a1499761bf98a" candidate_uuid: "a722e54d227f4c29a9ed6ce77858003a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a1a22e9119494570b6d2217713fd7e43"
I20260709 13:23:12.265415 15034 raft_consensus.cc:3060] T bf0b7c8005aa4d8ab97a1499761bf98a P a1a22e9119494570b6d2217713fd7e43 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:23:12.258006 15103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70d027ba81f54eba882756b941186710" candidate_uuid: "a1a22e9119494570b6d2217713fd7e43" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a722e54d227f4c29a9ed6ce77858003a" is_pre_election: true
I20260709 13:23:12.260051 15033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0b7e1c1e67845cb9bd2208bb2fb7c21" candidate_uuid: "0efc951052454eec9a58b0cd025945b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a1a22e9119494570b6d2217713fd7e43" is_pre_election: true
I20260709 13:23:12.269271 15033 raft_consensus.cc:2468] T b0b7e1c1e67845cb9bd2208bb2fb7c21 P a1a22e9119494570b6d2217713fd7e43 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0efc951052454eec9a58b0cd025945b8 in term 1.
I20260709 13:23:12.270061 15690 raft_consensus.cc:2749] T 46ed2e9dd1324ac4a6e07f813cfebb7e P a1a22e9119494570b6d2217713fd7e43 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:23:12.270793 15690 raft_consensus.cc:493] T e85432ede09747339c957cdaa7d15ac6 P a1a22e9119494570b6d2217713fd7e43 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f3a500981b494979b58d2b1041fec9c8)
I20260709 13:23:12.271230 15690 raft_consensus.cc:515] T e85432ede09747339c957cdaa7d15ac6 P a1a22e9119494570b6d2217713fd7e43 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } } peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } } peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } }
I20260709 13:23:12.261807 15104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "532cc9041f414e018098570192e0fae8" candidate_uuid: "0efc951052454eec9a58b0cd025945b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a722e54d227f4c29a9ed6ce77858003a" is_pre_election: true
I20260709 13:23:12.261806 14958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af00ad02fba64998bb25991f6f69f291" candidate_uuid: "a722e54d227f4c29a9ed6ce77858003a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0efc951052454eec9a58b0cd025945b8" is_pre_election: true
I20260709 13:23:12.272439 15104 raft_consensus.cc:2468] T 532cc9041f414e018098570192e0fae8 P a722e54d227f4c29a9ed6ce77858003a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0efc951052454eec9a58b0cd025945b8 in term 1.
I20260709 13:23:12.272722 14958 raft_consensus.cc:2468] T af00ad02fba64998bb25991f6f69f291 P 0efc951052454eec9a58b0cd025945b8 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a722e54d227f4c29a9ed6ce77858003a in term 1.
I20260709 13:23:12.248206 15763 leader_election.cc:290] T 46ed2e9dd1324ac4a6e07f813cfebb7e P a1a22e9119494570b6d2217713fd7e43 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f3a500981b494979b58d2b1041fec9c8 (127.5.126.65:34129), 0efc951052454eec9a58b0cd025945b8 (127.5.126.66:34613)
W20260709 13:23:12.274701 15073 leader_election.cc:336] T af00ad02fba64998bb25991f6f69f291 P a722e54d227f4c29a9ed6ce77858003a [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer f3a500981b494979b58d2b1041fec9c8 (127.5.126.65:34129): Network error: Client connection negotiation failed: client connection to 127.5.126.65:34129: connect: Connection refused (error 111)
I20260709 13:23:12.263309 15589 raft_consensus.cc:515] T 74a144396e4443288858878b63f08cc8 P 0efc951052454eec9a58b0cd025945b8 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } } peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } } peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } }
I20260709 13:23:12.274787 15690 leader_election.cc:290] T e85432ede09747339c957cdaa7d15ac6 P a1a22e9119494570b6d2217713fd7e43 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a722e54d227f4c29a9ed6ce77858003a (127.5.126.68:46669), f3a500981b494979b58d2b1041fec9c8 (127.5.126.65:34129)
I20260709 13:23:12.280807 15073 leader_election.cc:304] T af00ad02fba64998bb25991f6f69f291 P a722e54d227f4c29a9ed6ce77858003a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0efc951052454eec9a58b0cd025945b8, a722e54d227f4c29a9ed6ce77858003a; no voters: f3a500981b494979b58d2b1041fec9c8
I20260709 13:23:12.282388 15731 raft_consensus.cc:2804] T af00ad02fba64998bb25991f6f69f291 P a722e54d227f4c29a9ed6ce77858003a [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:23:12.283082 15731 raft_consensus.cc:493] T af00ad02fba64998bb25991f6f69f291 P a722e54d227f4c29a9ed6ce77858003a [term 1 FOLLOWER]: Starting leader election (detected failure of leader f3a500981b494979b58d2b1041fec9c8)
I20260709 13:23:12.283468 15731 raft_consensus.cc:3060] T af00ad02fba64998bb25991f6f69f291 P a722e54d227f4c29a9ed6ce77858003a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:23:12.283504 15104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03b63e2bee374ed5931dab67ee14b555" candidate_uuid: "a1a22e9119494570b6d2217713fd7e43" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a722e54d227f4c29a9ed6ce77858003a" is_pre_election: true
I20260709 13:23:12.284492 15104 raft_consensus.cc:2468] T 03b63e2bee374ed5931dab67ee14b555 P a722e54d227f4c29a9ed6ce77858003a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1a22e9119494570b6d2217713fd7e43 in term 1.
I20260709 13:23:12.282325 14924 leader_election.cc:304] T b0b7e1c1e67845cb9bd2208bb2fb7c21 P 0efc951052454eec9a58b0cd025945b8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0efc951052454eec9a58b0cd025945b8, a1a22e9119494570b6d2217713fd7e43; no voters: 
W20260709 13:23:12.285167 14999 leader_election.cc:336] T 03b63e2bee374ed5931dab67ee14b555 P a1a22e9119494570b6d2217713fd7e43 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer f3a500981b494979b58d2b1041fec9c8 (127.5.126.65:34129): Network error: Client connection negotiation failed: client connection to 127.5.126.65:34129: connect: Connection refused (error 111)
I20260709 13:23:12.286075 15103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e85432ede09747339c957cdaa7d15ac6" candidate_uuid: "a1a22e9119494570b6d2217713fd7e43" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a722e54d227f4c29a9ed6ce77858003a" is_pre_election: true
I20260709 13:23:12.286707 14999 leader_election.cc:304] T 70d027ba81f54eba882756b941186710 P a1a22e9119494570b6d2217713fd7e43 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1a22e9119494570b6d2217713fd7e43; no voters: a722e54d227f4c29a9ed6ce77858003a, f3a500981b494979b58d2b1041fec9c8
I20260709 13:23:12.286926 15103 raft_consensus.cc:2468] T e85432ede09747339c957cdaa7d15ac6 P a722e54d227f4c29a9ed6ce77858003a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1a22e9119494570b6d2217713fd7e43 in term 1.
I20260709 13:23:12.287539 15762 raft_consensus.cc:493] T 70d027ba81f54eba882756b941186710 P a722e54d227f4c29a9ed6ce77858003a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f3a500981b494979b58d2b1041fec9c8)
I20260709 13:23:12.288512 15690 raft_consensus.cc:2749] T 70d027ba81f54eba882756b941186710 P a1a22e9119494570b6d2217713fd7e43 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:23:12.288241 15762 raft_consensus.cc:515] T 70d027ba81f54eba882756b941186710 P a722e54d227f4c29a9ed6ce77858003a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } } peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } } peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } }
I20260709 13:23:12.290748 15588 raft_consensus.cc:2804] T b0b7e1c1e67845cb9bd2208bb2fb7c21 P 0efc951052454eec9a58b0cd025945b8 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:23:12.291160 15762 leader_election.cc:290] T 70d027ba81f54eba882756b941186710 P a722e54d227f4c29a9ed6ce77858003a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a1a22e9119494570b6d2217713fd7e43 (127.5.126.67:38125), f3a500981b494979b58d2b1041fec9c8 (127.5.126.65:34129)
I20260709 13:23:12.291855 15762 raft_consensus.cc:493] T dee43e01ec5d409b877a5c2dbf5b7b77 P a722e54d227f4c29a9ed6ce77858003a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f3a500981b494979b58d2b1041fec9c8)
I20260709 13:23:12.292405 15762 raft_consensus.cc:515] T dee43e01ec5d409b877a5c2dbf5b7b77 P a722e54d227f4c29a9ed6ce77858003a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } } peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } } peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } }
I20260709 13:23:12.294826 15072 leader_election.cc:304] T f86a730e237248dc9b91cbb75e29c324 P a722e54d227f4c29a9ed6ce77858003a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a1a22e9119494570b6d2217713fd7e43, a722e54d227f4c29a9ed6ce77858003a; no voters: f3a500981b494979b58d2b1041fec9c8
I20260709 13:23:12.295976 15762 leader_election.cc:290] T dee43e01ec5d409b877a5c2dbf5b7b77 P a722e54d227f4c29a9ed6ce77858003a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a1a22e9119494570b6d2217713fd7e43 (127.5.126.67:38125), f3a500981b494979b58d2b1041fec9c8 (127.5.126.65:34129)
I20260709 13:23:12.296119 15822 raft_consensus.cc:2804] T f86a730e237248dc9b91cbb75e29c324 P a722e54d227f4c29a9ed6ce77858003a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:23:12.296887 15822 raft_consensus.cc:697] T f86a730e237248dc9b91cbb75e29c324 P a722e54d227f4c29a9ed6ce77858003a [term 2 LEADER]: Becoming Leader. State: Replica: a722e54d227f4c29a9ed6ce77858003a, State: Running, Role: LEADER
I20260709 13:23:12.297050 15690 raft_consensus.cc:493] T c3abd41db36d404089eaf1f9063bbcb0 P a1a22e9119494570b6d2217713fd7e43 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f3a500981b494979b58d2b1041fec9c8)
I20260709 13:23:12.297684 15589 leader_election.cc:290] T 74a144396e4443288858878b63f08cc8 P 0efc951052454eec9a58b0cd025945b8 [CANDIDATE]: Term 2 election: Requested vote from peers f3a500981b494979b58d2b1041fec9c8 (127.5.126.65:34129), a1a22e9119494570b6d2217713fd7e43 (127.5.126.67:38125)
I20260709 13:23:12.297835 15822 consensus_queue.cc:237] T f86a730e237248dc9b91cbb75e29c324 P a722e54d227f4c29a9ed6ce77858003a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } } peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } } peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } }
I20260709 13:23:12.298157 15690 raft_consensus.cc:515] T c3abd41db36d404089eaf1f9063bbcb0 P a1a22e9119494570b6d2217713fd7e43 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } } peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } } peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } }
W20260709 13:23:12.297355 14999 leader_election.cc:336] T e85432ede09747339c957cdaa7d15ac6 P a1a22e9119494570b6d2217713fd7e43 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer f3a500981b494979b58d2b1041fec9c8 (127.5.126.65:34129): Network error: Client connection negotiation failed: client connection to 127.5.126.65:34129: connect: Connection refused (error 111)
I20260709 13:23:12.301566 15690 leader_election.cc:290] T c3abd41db36d404089eaf1f9063bbcb0 P a1a22e9119494570b6d2217713fd7e43 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f3a500981b494979b58d2b1041fec9c8 (127.5.126.65:34129), 0efc951052454eec9a58b0cd025945b8 (127.5.126.66:34613)
I20260709 13:23:12.291335 15588 raft_consensus.cc:493] T b0b7e1c1e67845cb9bd2208bb2fb7c21 P 0efc951052454eec9a58b0cd025945b8 [term 1 FOLLOWER]: Starting leader election (detected failure of leader f3a500981b494979b58d2b1041fec9c8)
I20260709 13:23:12.302837 15588 raft_consensus.cc:3060] T b0b7e1c1e67845cb9bd2208bb2fb7c21 P 0efc951052454eec9a58b0cd025945b8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:23:12.303560 14999 leader_election.cc:304] T 03b63e2bee374ed5931dab67ee14b555 P a1a22e9119494570b6d2217713fd7e43 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a1a22e9119494570b6d2217713fd7e43, a722e54d227f4c29a9ed6ce77858003a; no voters: f3a500981b494979b58d2b1041fec9c8
I20260709 13:23:12.304899 15731 raft_consensus.cc:515] T af00ad02fba64998bb25991f6f69f291 P a722e54d227f4c29a9ed6ce77858003a [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } } peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } } peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } }
I20260709 13:23:12.305868 15690 raft_consensus.cc:2804] T 03b63e2bee374ed5931dab67ee14b555 P a1a22e9119494570b6d2217713fd7e43 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:23:12.306463 15690 raft_consensus.cc:493] T 03b63e2bee374ed5931dab67ee14b555 P a1a22e9119494570b6d2217713fd7e43 [term 1 FOLLOWER]: Starting leader election (detected failure of leader f3a500981b494979b58d2b1041fec9c8)
I20260709 13:23:12.306902 15690 raft_consensus.cc:3060] T 03b63e2bee374ed5931dab67ee14b555 P a1a22e9119494570b6d2217713fd7e43 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:23:12.307502 15731 leader_election.cc:290] T af00ad02fba64998bb25991f6f69f291 P a722e54d227f4c29a9ed6ce77858003a [CANDIDATE]: Term 2 election: Requested vote from peers f3a500981b494979b58d2b1041fec9c8 (127.5.126.65:34129), 0efc951052454eec9a58b0cd025945b8 (127.5.126.66:34613)
I20260709 13:23:12.308442 15034 raft_consensus.cc:2468] T bf0b7c8005aa4d8ab97a1499761bf98a P a1a22e9119494570b6d2217713fd7e43 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a722e54d227f4c29a9ed6ce77858003a in term 2.
I20260709 13:23:12.305117 14999 leader_election.cc:304] T e85432ede09747339c957cdaa7d15ac6 P a1a22e9119494570b6d2217713fd7e43 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a1a22e9119494570b6d2217713fd7e43, a722e54d227f4c29a9ed6ce77858003a; no voters: f3a500981b494979b58d2b1041fec9c8
I20260709 13:23:12.311126 15744 raft_consensus.cc:2804] T e85432ede09747339c957cdaa7d15ac6 P a1a22e9119494570b6d2217713fd7e43 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:23:12.311558 15744 raft_consensus.cc:493] T e85432ede09747339c957cdaa7d15ac6 P a1a22e9119494570b6d2217713fd7e43 [term 1 FOLLOWER]: Starting leader election (detected failure of leader f3a500981b494979b58d2b1041fec9c8)
I20260709 13:23:12.312063 15744 raft_consensus.cc:3060] T e85432ede09747339c957cdaa7d15ac6 P a1a22e9119494570b6d2217713fd7e43 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:23:12.314914 14958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3abd41db36d404089eaf1f9063bbcb0" candidate_uuid: "a1a22e9119494570b6d2217713fd7e43" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0efc951052454eec9a58b0cd025945b8" is_pre_election: true
I20260709 13:23:12.315863 14958 raft_consensus.cc:2468] T c3abd41db36d404089eaf1f9063bbcb0 P 0efc951052454eec9a58b0cd025945b8 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1a22e9119494570b6d2217713fd7e43 in term 1.
I20260709 13:23:12.297096 14925 leader_election.cc:304] T 532cc9041f414e018098570192e0fae8 P 0efc951052454eec9a58b0cd025945b8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0efc951052454eec9a58b0cd025945b8, a722e54d227f4c29a9ed6ce77858003a; no voters: 
I20260709 13:23:12.322263 15032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70d027ba81f54eba882756b941186710" candidate_uuid: "a722e54d227f4c29a9ed6ce77858003a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a1a22e9119494570b6d2217713fd7e43" is_pre_election: true
I20260709 13:23:12.322973 15032 raft_consensus.cc:2468] T 70d027ba81f54eba882756b941186710 P a1a22e9119494570b6d2217713fd7e43 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a722e54d227f4c29a9ed6ce77858003a in term 1.
I20260709 13:23:12.323885 15589 raft_consensus.cc:2804] T 532cc9041f414e018098570192e0fae8 P 0efc951052454eec9a58b0cd025945b8 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:23:12.324365 15589 raft_consensus.cc:493] T 532cc9041f414e018098570192e0fae8 P 0efc951052454eec9a58b0cd025945b8 [term 1 FOLLOWER]: Starting leader election (detected failure of leader f3a500981b494979b58d2b1041fec9c8)
I20260709 13:23:12.324723 15589 raft_consensus.cc:3060] T 532cc9041f414e018098570192e0fae8 P 0efc951052454eec9a58b0cd025945b8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:23:12.325032 14958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af00ad02fba64998bb25991f6f69f291" candidate_uuid: "a722e54d227f4c29a9ed6ce77858003a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0efc951052454eec9a58b0cd025945b8"
I20260709 13:23:12.325933 14958 raft_consensus.cc:3060] T af00ad02fba64998bb25991f6f69f291 P 0efc951052454eec9a58b0cd025945b8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:23:12.333473 15589 raft_consensus.cc:515] T 532cc9041f414e018098570192e0fae8 P 0efc951052454eec9a58b0cd025945b8 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } } peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } } peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } }
I20260709 13:23:12.336345 15589 leader_election.cc:290] T 532cc9041f414e018098570192e0fae8 P 0efc951052454eec9a58b0cd025945b8 [CANDIDATE]: Term 2 election: Requested vote from peers a722e54d227f4c29a9ed6ce77858003a (127.5.126.68:46669), f3a500981b494979b58d2b1041fec9c8 (127.5.126.65:34129)
I20260709 13:23:12.345239 15032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dee43e01ec5d409b877a5c2dbf5b7b77" candidate_uuid: "a722e54d227f4c29a9ed6ce77858003a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a1a22e9119494570b6d2217713fd7e43" is_pre_election: true
I20260709 13:23:12.346127 15032 raft_consensus.cc:2468] T dee43e01ec5d409b877a5c2dbf5b7b77 P a1a22e9119494570b6d2217713fd7e43 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a722e54d227f4c29a9ed6ce77858003a in term 1.
I20260709 13:23:12.345376 15735 leader_election.cc:290] T b0b7e1c1e67845cb9bd2208bb2fb7c21 P 0efc951052454eec9a58b0cd025945b8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f3a500981b494979b58d2b1041fec9c8 (127.5.126.65:34129), a1a22e9119494570b6d2217713fd7e43 (127.5.126.67:38125)
I20260709 13:23:12.345239 15034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74a144396e4443288858878b63f08cc8" candidate_uuid: "0efc951052454eec9a58b0cd025945b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a1a22e9119494570b6d2217713fd7e43"
I20260709 13:23:12.348171 15034 raft_consensus.cc:3060] T 74a144396e4443288858878b63f08cc8 P a1a22e9119494570b6d2217713fd7e43 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:23:12.333572 15072 leader_election.cc:304] T bf0b7c8005aa4d8ab97a1499761bf98a P a722e54d227f4c29a9ed6ce77858003a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a1a22e9119494570b6d2217713fd7e43, a722e54d227f4c29a9ed6ce77858003a; no voters: f3a500981b494979b58d2b1041fec9c8
I20260709 13:23:12.353430 15731 raft_consensus.cc:2804] T bf0b7c8005aa4d8ab97a1499761bf98a P a722e54d227f4c29a9ed6ce77858003a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:23:12.351779 14958 raft_consensus.cc:2468] T af00ad02fba64998bb25991f6f69f291 P 0efc951052454eec9a58b0cd025945b8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a722e54d227f4c29a9ed6ce77858003a in term 2.
I20260709 13:23:12.354230 15731 raft_consensus.cc:697] T bf0b7c8005aa4d8ab97a1499761bf98a P a722e54d227f4c29a9ed6ce77858003a [term 2 LEADER]: Becoming Leader. State: Replica: a722e54d227f4c29a9ed6ce77858003a, State: Running, Role: LEADER
I20260709 13:23:12.355566 15731 consensus_queue.cc:237] T bf0b7c8005aa4d8ab97a1499761bf98a P a722e54d227f4c29a9ed6ce77858003a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } } peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } } peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } }
I20260709 13:23:12.357211 15072 leader_election.cc:304] T 70d027ba81f54eba882756b941186710 P a722e54d227f4c29a9ed6ce77858003a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1a22e9119494570b6d2217713fd7e43, a722e54d227f4c29a9ed6ce77858003a; no voters: 
I20260709 13:23:12.354239 15829 raft_consensus.cc:493] T 58a622a48cd24833bc5fc27e03114176 P 0efc951052454eec9a58b0cd025945b8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f3a500981b494979b58d2b1041fec9c8)
I20260709 13:23:12.358410 15822 raft_consensus.cc:2804] T 70d027ba81f54eba882756b941186710 P a722e54d227f4c29a9ed6ce77858003a [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:23:12.358940 15822 raft_consensus.cc:493] T 70d027ba81f54eba882756b941186710 P a722e54d227f4c29a9ed6ce77858003a [term 1 FOLLOWER]: Starting leader election (detected failure of leader f3a500981b494979b58d2b1041fec9c8)
I20260709 13:23:12.358541 15829 raft_consensus.cc:515] T 58a622a48cd24833bc5fc27e03114176 P 0efc951052454eec9a58b0cd025945b8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } } peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } } peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } }
I20260709 13:23:12.359380 15822 raft_consensus.cc:3060] T 70d027ba81f54eba882756b941186710 P a722e54d227f4c29a9ed6ce77858003a [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:23:12.359565 15073 leader_election.cc:336] T 70d027ba81f54eba882756b941186710 P a722e54d227f4c29a9ed6ce77858003a [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer f3a500981b494979b58d2b1041fec9c8 (127.5.126.65:34129): Network error: Client connection negotiation failed: client connection to 127.5.126.65:34129: connect: Connection refused (error 111)
I20260709 13:23:12.362897 15829 leader_election.cc:290] T 58a622a48cd24833bc5fc27e03114176 P 0efc951052454eec9a58b0cd025945b8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a722e54d227f4c29a9ed6ce77858003a (127.5.126.68:46669), f3a500981b494979b58d2b1041fec9c8 (127.5.126.65:34129)
W20260709 13:23:12.353520 14925 leader_election.cc:336] T 532cc9041f414e018098570192e0fae8 P 0efc951052454eec9a58b0cd025945b8 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer f3a500981b494979b58d2b1041fec9c8 (127.5.126.65:34129): Network error: Client connection negotiation failed: client connection to 127.5.126.65:34129: connect: Connection refused (error 111)
W20260709 13:23:12.364208 14925 leader_election.cc:336] T b0b7e1c1e67845cb9bd2208bb2fb7c21 P 0efc951052454eec9a58b0cd025945b8 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer f3a500981b494979b58d2b1041fec9c8 (127.5.126.65:34129): Network error: Client connection negotiation failed: client connection to 127.5.126.65:34129: connect: Connection refused (error 111)
I20260709 13:23:12.368989 15103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "532cc9041f414e018098570192e0fae8" candidate_uuid: "0efc951052454eec9a58b0cd025945b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a722e54d227f4c29a9ed6ce77858003a"
I20260709 13:23:12.369849 15103 raft_consensus.cc:3060] T 532cc9041f414e018098570192e0fae8 P a722e54d227f4c29a9ed6ce77858003a [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:23:12.370647 14924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:38125, user_credentials={real_user=slave}} blocked reactor thread for 88421.9us
I20260709 13:23:12.374907 15735 raft_consensus.cc:493] T 107541237b4a452e8b47b0c3527b7ede P 0efc951052454eec9a58b0cd025945b8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f3a500981b494979b58d2b1041fec9c8)
I20260709 13:23:12.375696 15735 raft_consensus.cc:515] T 107541237b4a452e8b47b0c3527b7ede P 0efc951052454eec9a58b0cd025945b8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } } peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } } peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } }
I20260709 13:23:12.374670 14779 catalog_manager.cc:5697] T f86a730e237248dc9b91cbb75e29c324 P a722e54d227f4c29a9ed6ce77858003a reported cstate change: term changed from 1 to 2, leader changed from f3a500981b494979b58d2b1041fec9c8 (127.5.126.65) to a722e54d227f4c29a9ed6ce77858003a (127.5.126.68). New cstate: current_term: 2 leader_uuid: "a722e54d227f4c29a9ed6ce77858003a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } health_report { overall_health: UNKNOWN } } }
I20260709 13:23:12.378257 15735 leader_election.cc:290] T 107541237b4a452e8b47b0c3527b7ede P 0efc951052454eec9a58b0cd025945b8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f3a500981b494979b58d2b1041fec9c8 (127.5.126.65:34129), a1a22e9119494570b6d2217713fd7e43 (127.5.126.67:38125)
I20260709 13:23:12.382692 15032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "107541237b4a452e8b47b0c3527b7ede" candidate_uuid: "0efc951052454eec9a58b0cd025945b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a1a22e9119494570b6d2217713fd7e43" is_pre_election: true
I20260709 13:23:12.383450 15032 raft_consensus.cc:2468] T 107541237b4a452e8b47b0c3527b7ede P a1a22e9119494570b6d2217713fd7e43 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0efc951052454eec9a58b0cd025945b8 in term 1.
I20260709 13:23:12.385397 14924 leader_election.cc:304] T 107541237b4a452e8b47b0c3527b7ede P 0efc951052454eec9a58b0cd025945b8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0efc951052454eec9a58b0cd025945b8, a1a22e9119494570b6d2217713fd7e43; no voters: 
I20260709 13:23:12.369378 15822 raft_consensus.cc:515] T 70d027ba81f54eba882756b941186710 P a722e54d227f4c29a9ed6ce77858003a [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } } peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } } peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } }
I20260709 13:23:12.386770 15833 raft_consensus.cc:493] T 46ed2e9dd1324ac4a6e07f813cfebb7e P 0efc951052454eec9a58b0cd025945b8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f3a500981b494979b58d2b1041fec9c8)
I20260709 13:23:12.423555 15833 raft_consensus.cc:515] T 46ed2e9dd1324ac4a6e07f813cfebb7e P 0efc951052454eec9a58b0cd025945b8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } } peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } } peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } }
I20260709 13:23:12.385978 15103 raft_consensus.cc:2468] T 532cc9041f414e018098570192e0fae8 P a722e54d227f4c29a9ed6ce77858003a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0efc951052454eec9a58b0cd025945b8 in term 2.
I20260709 13:23:12.396157 15832 raft_consensus.cc:2804] T 107541237b4a452e8b47b0c3527b7ede P 0efc951052454eec9a58b0cd025945b8 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:23:12.426506 15832 raft_consensus.cc:493] T 107541237b4a452e8b47b0c3527b7ede P 0efc951052454eec9a58b0cd025945b8 [term 1 FOLLOWER]: Starting leader election (detected failure of leader f3a500981b494979b58d2b1041fec9c8)
I20260709 13:23:12.426945 15832 raft_consensus.cc:3060] T 107541237b4a452e8b47b0c3527b7ede P 0efc951052454eec9a58b0cd025945b8 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:23:12.429984 14925 leader_election.cc:336] T 74a144396e4443288858878b63f08cc8 P 0efc951052454eec9a58b0cd025945b8 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer f3a500981b494979b58d2b1041fec9c8 (127.5.126.65:34129): Network error: Client connection negotiation failed: client connection to 127.5.126.65:34129: connect: Connection refused (error 111)
I20260709 13:23:12.396808 14999 leader_election.cc:304] T c3abd41db36d404089eaf1f9063bbcb0 P a1a22e9119494570b6d2217713fd7e43 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0efc951052454eec9a58b0cd025945b8, a1a22e9119494570b6d2217713fd7e43; no voters: 
I20260709 13:23:12.432117 15763 raft_consensus.cc:2804] T c3abd41db36d404089eaf1f9063bbcb0 P a1a22e9119494570b6d2217713fd7e43 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:23:12.432673 15763 raft_consensus.cc:493] T c3abd41db36d404089eaf1f9063bbcb0 P a1a22e9119494570b6d2217713fd7e43 [term 1 FOLLOWER]: Starting leader election (detected failure of leader f3a500981b494979b58d2b1041fec9c8)
I20260709 13:23:12.433094 15763 raft_consensus.cc:3060] T c3abd41db36d404089eaf1f9063bbcb0 P a1a22e9119494570b6d2217713fd7e43 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:23:12.405022 15104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58a622a48cd24833bc5fc27e03114176" candidate_uuid: "0efc951052454eec9a58b0cd025945b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a722e54d227f4c29a9ed6ce77858003a" is_pre_election: true
I20260709 13:23:12.414520 15073 leader_election.cc:304] T af00ad02fba64998bb25991f6f69f291 P a722e54d227f4c29a9ed6ce77858003a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0efc951052454eec9a58b0cd025945b8, a722e54d227f4c29a9ed6ce77858003a; no voters: 
I20260709 13:23:12.397080 15034 raft_consensus.cc:2468] T 74a144396e4443288858878b63f08cc8 P a1a22e9119494570b6d2217713fd7e43 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0efc951052454eec9a58b0cd025945b8 in term 2.
I20260709 13:23:12.436050 14924 leader_election.cc:304] T 74a144396e4443288858878b63f08cc8 P 0efc951052454eec9a58b0cd025945b8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0efc951052454eec9a58b0cd025945b8, a1a22e9119494570b6d2217713fd7e43; no voters: f3a500981b494979b58d2b1041fec9c8
I20260709 13:23:12.436856 15762 raft_consensus.cc:2804] T af00ad02fba64998bb25991f6f69f291 P a722e54d227f4c29a9ed6ce77858003a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:23:12.437227 15829 raft_consensus.cc:2804] T 74a144396e4443288858878b63f08cc8 P 0efc951052454eec9a58b0cd025945b8 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:23:12.437445 15762 raft_consensus.cc:697] T af00ad02fba64998bb25991f6f69f291 P a722e54d227f4c29a9ed6ce77858003a [term 2 LEADER]: Becoming Leader. State: Replica: a722e54d227f4c29a9ed6ce77858003a, State: Running, Role: LEADER
I20260709 13:23:12.395571 15822 leader_election.cc:290] T 70d027ba81f54eba882756b941186710 P a722e54d227f4c29a9ed6ce77858003a [CANDIDATE]: Term 2 election: Requested vote from peers a1a22e9119494570b6d2217713fd7e43 (127.5.126.67:38125), f3a500981b494979b58d2b1041fec9c8 (127.5.126.65:34129)
I20260709 13:23:12.438576 15762 consensus_queue.cc:237] T af00ad02fba64998bb25991f6f69f291 P a722e54d227f4c29a9ed6ce77858003a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } } peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } } peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } }
I20260709 13:23:12.434120 15104 raft_consensus.cc:2468] T 58a622a48cd24833bc5fc27e03114176 P a722e54d227f4c29a9ed6ce77858003a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0efc951052454eec9a58b0cd025945b8 in term 1.
I20260709 13:23:12.386468 15072 leader_election.cc:304] T dee43e01ec5d409b877a5c2dbf5b7b77 P a722e54d227f4c29a9ed6ce77858003a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1a22e9119494570b6d2217713fd7e43, a722e54d227f4c29a9ed6ce77858003a; no voters: 
I20260709 13:23:12.415832 15588 raft_consensus.cc:515] T b0b7e1c1e67845cb9bd2208bb2fb7c21 P 0efc951052454eec9a58b0cd025945b8 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } } peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } } peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } }
W20260709 13:23:12.453405 15072 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:38125, user_credentials={real_user=slave}} blocked reactor thread for 67039.5us
I20260709 13:23:12.453493 15822 raft_consensus.cc:2804] T dee43e01ec5d409b877a5c2dbf5b7b77 P a722e54d227f4c29a9ed6ce77858003a [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:23:12.454025 15822 raft_consensus.cc:493] T dee43e01ec5d409b877a5c2dbf5b7b77 P a722e54d227f4c29a9ed6ce77858003a [term 1 FOLLOWER]: Starting leader election (detected failure of leader f3a500981b494979b58d2b1041fec9c8)
I20260709 13:23:12.454421 15822 raft_consensus.cc:3060] T dee43e01ec5d409b877a5c2dbf5b7b77 P a722e54d227f4c29a9ed6ce77858003a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:23:12.457404 15032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70d027ba81f54eba882756b941186710" candidate_uuid: "a722e54d227f4c29a9ed6ce77858003a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a1a22e9119494570b6d2217713fd7e43"
I20260709 13:23:12.459300 15032 raft_consensus.cc:3060] T 70d027ba81f54eba882756b941186710 P a1a22e9119494570b6d2217713fd7e43 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:23:12.465827 15588 leader_election.cc:290] T b0b7e1c1e67845cb9bd2208bb2fb7c21 P 0efc951052454eec9a58b0cd025945b8 [CANDIDATE]: Term 2 election: Requested vote from peers f3a500981b494979b58d2b1041fec9c8 (127.5.126.65:34129), a1a22e9119494570b6d2217713fd7e43 (127.5.126.67:38125)
I20260709 13:23:12.469357 15034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0b7e1c1e67845cb9bd2208bb2fb7c21" candidate_uuid: "0efc951052454eec9a58b0cd025945b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a1a22e9119494570b6d2217713fd7e43"
I20260709 13:23:12.470146 15034 raft_consensus.cc:3060] T b0b7e1c1e67845cb9bd2208bb2fb7c21 P a1a22e9119494570b6d2217713fd7e43 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:23:12.437786 15829 raft_consensus.cc:697] T 74a144396e4443288858878b63f08cc8 P 0efc951052454eec9a58b0cd025945b8 [term 2 LEADER]: Becoming Leader. State: Replica: 0efc951052454eec9a58b0cd025945b8, State: Running, Role: LEADER
I20260709 13:23:12.474633 15763 raft_consensus.cc:515] T c3abd41db36d404089eaf1f9063bbcb0 P a1a22e9119494570b6d2217713fd7e43 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } } peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } } peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } }
I20260709 13:23:12.474884 15829 consensus_queue.cc:237] T 74a144396e4443288858878b63f08cc8 P 0efc951052454eec9a58b0cd025945b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } } peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } } peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } }
I20260709 13:23:12.486822 15589 raft_consensus.cc:493] T aecef3c240394d54844ec8170e9cad59 P 0efc951052454eec9a58b0cd025945b8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f3a500981b494979b58d2b1041fec9c8)
I20260709 13:23:12.487425 15833 leader_election.cc:290] T 46ed2e9dd1324ac4a6e07f813cfebb7e P 0efc951052454eec9a58b0cd025945b8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f3a500981b494979b58d2b1041fec9c8 (127.5.126.65:34129), a1a22e9119494570b6d2217713fd7e43 (127.5.126.67:38125)
I20260709 13:23:12.487506 15589 raft_consensus.cc:515] T aecef3c240394d54844ec8170e9cad59 P 0efc951052454eec9a58b0cd025945b8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } } peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } } peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } }
I20260709 13:23:12.489331 15033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46ed2e9dd1324ac4a6e07f813cfebb7e" candidate_uuid: "0efc951052454eec9a58b0cd025945b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a1a22e9119494570b6d2217713fd7e43" is_pre_election: true
I20260709 13:23:12.489794 15589 leader_election.cc:290] T aecef3c240394d54844ec8170e9cad59 P 0efc951052454eec9a58b0cd025945b8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a722e54d227f4c29a9ed6ce77858003a (127.5.126.68:46669), f3a500981b494979b58d2b1041fec9c8 (127.5.126.65:34129)
I20260709 13:23:12.490042 15033 raft_consensus.cc:2468] T 46ed2e9dd1324ac4a6e07f813cfebb7e P a1a22e9119494570b6d2217713fd7e43 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0efc951052454eec9a58b0cd025945b8 in term 1.
I20260709 13:23:12.491505 14924 leader_election.cc:304] T 46ed2e9dd1324ac4a6e07f813cfebb7e P 0efc951052454eec9a58b0cd025945b8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0efc951052454eec9a58b0cd025945b8, a1a22e9119494570b6d2217713fd7e43; no voters: 
I20260709 13:23:12.492455 15690 raft_consensus.cc:515] T 03b63e2bee374ed5931dab67ee14b555 P a1a22e9119494570b6d2217713fd7e43 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } } peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } } peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } }
I20260709 13:23:12.496435 15588 raft_consensus.cc:2804] T 46ed2e9dd1324ac4a6e07f813cfebb7e P 0efc951052454eec9a58b0cd025945b8 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:23:12.496897 15588 raft_consensus.cc:493] T 46ed2e9dd1324ac4a6e07f813cfebb7e P 0efc951052454eec9a58b0cd025945b8 [term 1 FOLLOWER]: Starting leader election (detected failure of leader f3a500981b494979b58d2b1041fec9c8)
I20260709 13:23:12.497277 15588 raft_consensus.cc:3060] T 46ed2e9dd1324ac4a6e07f813cfebb7e P 0efc951052454eec9a58b0cd025945b8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:23:12.409346 15761 tablet_bootstrap.cc:492] T 2a9523aa8663464686254c8412c37e67 P f3a500981b494979b58d2b1041fec9c8: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:23:12.501466 15761 tablet_bootstrap.cc:492] T 2a9523aa8663464686254c8412c37e67 P f3a500981b494979b58d2b1041fec9c8: Bootstrap complete.
I20260709 13:23:12.502242 15761 ts_tablet_manager.cc:1403] T 2a9523aa8663464686254c8412c37e67 P f3a500981b494979b58d2b1041fec9c8: Time spent bootstrapping tablet: real 0.293s	user 0.066s	sys 0.071s
I20260709 13:23:12.395702 15744 raft_consensus.cc:515] T e85432ede09747339c957cdaa7d15ac6 P a1a22e9119494570b6d2217713fd7e43 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } } peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } } peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } }
I20260709 13:23:12.506798 15744 leader_election.cc:290] T e85432ede09747339c957cdaa7d15ac6 P a1a22e9119494570b6d2217713fd7e43 [CANDIDATE]: Term 2 election: Requested vote from peers a722e54d227f4c29a9ed6ce77858003a (127.5.126.68:46669), f3a500981b494979b58d2b1041fec9c8 (127.5.126.65:34129)
I20260709 13:23:12.509331 15763 leader_election.cc:290] T c3abd41db36d404089eaf1f9063bbcb0 P a1a22e9119494570b6d2217713fd7e43 [CANDIDATE]: Term 2 election: Requested vote from peers f3a500981b494979b58d2b1041fec9c8 (127.5.126.65:34129), 0efc951052454eec9a58b0cd025945b8 (127.5.126.66:34613)
I20260709 13:23:12.509759 15761 raft_consensus.cc:359] T 2a9523aa8663464686254c8412c37e67 P f3a500981b494979b58d2b1041fec9c8 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } } peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } } peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } }
I20260709 13:23:12.510474 15761 raft_consensus.cc:740] T 2a9523aa8663464686254c8412c37e67 P f3a500981b494979b58d2b1041fec9c8 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: f3a500981b494979b58d2b1041fec9c8, State: Initialized, Role: FOLLOWER
I20260709 13:23:12.513163 15761 consensus_queue.cc:260] T 2a9523aa8663464686254c8412c37e67 P f3a500981b494979b58d2b1041fec9c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } } peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } } peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } }
I20260709 13:23:12.515439 15761 ts_tablet_manager.cc:1434] T 2a9523aa8663464686254c8412c37e67 P f3a500981b494979b58d2b1041fec9c8: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.000s
I20260709 13:23:12.519381 14925 leader_election.cc:304] T 532cc9041f414e018098570192e0fae8 P 0efc951052454eec9a58b0cd025945b8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0efc951052454eec9a58b0cd025945b8, a722e54d227f4c29a9ed6ce77858003a; no voters: 
I20260709 13:23:12.520061 15822 raft_consensus.cc:515] T dee43e01ec5d409b877a5c2dbf5b7b77 P a722e54d227f4c29a9ed6ce77858003a [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } } peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } } peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } }
I20260709 13:23:12.527566 15761 tablet_bootstrap.cc:492] T 74a144396e4443288858878b63f08cc8 P f3a500981b494979b58d2b1041fec9c8: Bootstrap starting.
W20260709 13:23:12.526648 15073 leader_election.cc:336] T dee43e01ec5d409b877a5c2dbf5b7b77 P a722e54d227f4c29a9ed6ce77858003a [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer f3a500981b494979b58d2b1041fec9c8 (127.5.126.65:34129): Network error: Client connection negotiation failed: client connection to 127.5.126.65:34129: connect: Connection refused (error 111)
I20260709 13:23:12.528465 15735 raft_consensus.cc:2804] T 532cc9041f414e018098570192e0fae8 P 0efc951052454eec9a58b0cd025945b8 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:23:12.529011 15735 raft_consensus.cc:697] T 532cc9041f414e018098570192e0fae8 P 0efc951052454eec9a58b0cd025945b8 [term 2 LEADER]: Becoming Leader. State: Replica: 0efc951052454eec9a58b0cd025945b8, State: Running, Role: LEADER
W20260709 13:23:12.529569 15073 leader_election.cc:336] T af00ad02fba64998bb25991f6f69f291 P a722e54d227f4c29a9ed6ce77858003a [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer f3a500981b494979b58d2b1041fec9c8 (127.5.126.65:34129): Network error: Client connection negotiation failed: client connection to 127.5.126.65:34129: connect: Connection refused (error 111)
W20260709 13:23:12.523831 14999 leader_election.cc:336] T c3abd41db36d404089eaf1f9063bbcb0 P a1a22e9119494570b6d2217713fd7e43 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer f3a500981b494979b58d2b1041fec9c8 (127.5.126.65:34129): Network error: Client connection negotiation failed: client connection to 127.5.126.65:34129: connect: Connection refused (error 111)
I20260709 13:23:12.521813 15032 raft_consensus.cc:2468] T 70d027ba81f54eba882756b941186710 P a1a22e9119494570b6d2217713fd7e43 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a722e54d227f4c29a9ed6ce77858003a in term 2.
I20260709 13:23:12.529883 15735 consensus_queue.cc:237] T 532cc9041f414e018098570192e0fae8 P 0efc951052454eec9a58b0cd025945b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } } peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } } peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } }
I20260709 13:23:12.542734 15072 leader_election.cc:304] T 70d027ba81f54eba882756b941186710 P a722e54d227f4c29a9ed6ce77858003a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1a22e9119494570b6d2217713fd7e43, a722e54d227f4c29a9ed6ce77858003a; no voters: 
I20260709 13:23:12.543659 15762 raft_consensus.cc:2804] T 70d027ba81f54eba882756b941186710 P a722e54d227f4c29a9ed6ce77858003a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:23:12.531191 14925 leader_election.cc:304] T 58a622a48cd24833bc5fc27e03114176 P 0efc951052454eec9a58b0cd025945b8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0efc951052454eec9a58b0cd025945b8, a722e54d227f4c29a9ed6ce77858003a; no voters: 
I20260709 13:23:12.545531 15762 raft_consensus.cc:697] T 70d027ba81f54eba882756b941186710 P a722e54d227f4c29a9ed6ce77858003a [term 2 LEADER]: Becoming Leader. State: Replica: a722e54d227f4c29a9ed6ce77858003a, State: Running, Role: LEADER
I20260709 13:23:12.532277 15822 leader_election.cc:290] T dee43e01ec5d409b877a5c2dbf5b7b77 P a722e54d227f4c29a9ed6ce77858003a [CANDIDATE]: Term 2 election: Requested vote from peers a1a22e9119494570b6d2217713fd7e43 (127.5.126.67:38125), f3a500981b494979b58d2b1041fec9c8 (127.5.126.65:34129)
I20260709 13:23:12.533231 15033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dee43e01ec5d409b877a5c2dbf5b7b77" candidate_uuid: "a722e54d227f4c29a9ed6ce77858003a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a1a22e9119494570b6d2217713fd7e43"
I20260709 13:23:12.553794 15762 consensus_queue.cc:237] T 70d027ba81f54eba882756b941186710 P a722e54d227f4c29a9ed6ce77858003a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } } peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } } peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } }
I20260709 13:23:12.554796 15033 raft_consensus.cc:3060] T dee43e01ec5d409b877a5c2dbf5b7b77 P a1a22e9119494570b6d2217713fd7e43 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:23:12.554994 15104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e85432ede09747339c957cdaa7d15ac6" candidate_uuid: "a1a22e9119494570b6d2217713fd7e43" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a722e54d227f4c29a9ed6ce77858003a"
I20260709 13:23:12.554416 14779 catalog_manager.cc:5697] T bf0b7c8005aa4d8ab97a1499761bf98a P a722e54d227f4c29a9ed6ce77858003a reported cstate change: term changed from 1 to 2, leader changed from f3a500981b494979b58d2b1041fec9c8 (127.5.126.65) to a722e54d227f4c29a9ed6ce77858003a (127.5.126.68). New cstate: current_term: 2 leader_uuid: "a722e54d227f4c29a9ed6ce77858003a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } health_report { overall_health: UNKNOWN } } }
I20260709 13:23:12.555639 15104 raft_consensus.cc:3060] T e85432ede09747339c957cdaa7d15ac6 P a722e54d227f4c29a9ed6ce77858003a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:23:12.556538 14779 catalog_manager.cc:5697] T af00ad02fba64998bb25991f6f69f291 P a722e54d227f4c29a9ed6ce77858003a reported cstate change: term changed from 1 to 2, leader changed from f3a500981b494979b58d2b1041fec9c8 (127.5.126.65) to a722e54d227f4c29a9ed6ce77858003a (127.5.126.68). New cstate: current_term: 2 leader_uuid: "a722e54d227f4c29a9ed6ce77858003a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } health_report { overall_health: UNKNOWN } } }
W20260709 13:23:12.558293 15073 leader_election.cc:336] T 70d027ba81f54eba882756b941186710 P a722e54d227f4c29a9ed6ce77858003a [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer f3a500981b494979b58d2b1041fec9c8 (127.5.126.65:34129): Network error: Client connection negotiation failed: client connection to 127.5.126.65:34129: connect: Connection refused (error 111)
I20260709 13:23:12.566900 15105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03b63e2bee374ed5931dab67ee14b555" candidate_uuid: "a1a22e9119494570b6d2217713fd7e43" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a722e54d227f4c29a9ed6ce77858003a"
I20260709 13:23:12.567608 15105 raft_consensus.cc:3060] T 03b63e2bee374ed5931dab67ee14b555 P a722e54d227f4c29a9ed6ce77858003a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:23:12.567992 15102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aecef3c240394d54844ec8170e9cad59" candidate_uuid: "0efc951052454eec9a58b0cd025945b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a722e54d227f4c29a9ed6ce77858003a" is_pre_election: true
I20260709 13:23:12.568909 15102 raft_consensus.cc:2468] T aecef3c240394d54844ec8170e9cad59 P a722e54d227f4c29a9ed6ce77858003a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0efc951052454eec9a58b0cd025945b8 in term 1.
W20260709 13:23:12.569432 14999 leader_election.cc:336] T e85432ede09747339c957cdaa7d15ac6 P a1a22e9119494570b6d2217713fd7e43 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer f3a500981b494979b58d2b1041fec9c8 (127.5.126.65:34129): Network error: Client connection negotiation failed: client connection to 127.5.126.65:34129: connect: Connection refused (error 111)
W20260709 13:23:12.570026 14999 leader_election.cc:336] T c3abd41db36d404089eaf1f9063bbcb0 P a1a22e9119494570b6d2217713fd7e43 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer f3a500981b494979b58d2b1041fec9c8 (127.5.126.65:34129): Network error: Client connection negotiation failed: client connection to 127.5.126.65:34129: connect: Connection refused (error 111)
W20260709 13:23:12.570425 14999 leader_election.cc:336] T 03b63e2bee374ed5931dab67ee14b555 P a1a22e9119494570b6d2217713fd7e43 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer f3a500981b494979b58d2b1041fec9c8 (127.5.126.65:34129): Network error: Client connection negotiation failed: client connection to 127.5.126.65:34129: connect: Connection refused (error 111)
I20260709 13:23:12.575569 15105 raft_consensus.cc:2468] T 03b63e2bee374ed5931dab67ee14b555 P a722e54d227f4c29a9ed6ce77858003a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1a22e9119494570b6d2217713fd7e43 in term 2.
W20260709 13:23:12.580248 14925 leader_election.cc:336] T 532cc9041f414e018098570192e0fae8 P 0efc951052454eec9a58b0cd025945b8 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer f3a500981b494979b58d2b1041fec9c8 (127.5.126.65:34129): Network error: Client connection negotiation failed: client connection to 127.5.126.65:34129: connect: Connection refused (error 111)
W20260709 13:23:12.581060 15073 leader_election.cc:336] T dee43e01ec5d409b877a5c2dbf5b7b77 P a722e54d227f4c29a9ed6ce77858003a [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer f3a500981b494979b58d2b1041fec9c8 (127.5.126.65:34129): Network error: Client connection negotiation failed: client connection to 127.5.126.65:34129: connect: Connection refused (error 111)
I20260709 13:23:12.536755 15832 raft_consensus.cc:515] T 107541237b4a452e8b47b0c3527b7ede P 0efc951052454eec9a58b0cd025945b8 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } } peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } } peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } }
I20260709 13:23:12.545909 15833 raft_consensus.cc:2804] T 58a622a48cd24833bc5fc27e03114176 P 0efc951052454eec9a58b0cd025945b8 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:23:12.590229 15833 raft_consensus.cc:493] T 58a622a48cd24833bc5fc27e03114176 P 0efc951052454eec9a58b0cd025945b8 [term 1 FOLLOWER]: Starting leader election (detected failure of leader f3a500981b494979b58d2b1041fec9c8)
I20260709 13:23:12.590705 15833 raft_consensus.cc:3060] T 58a622a48cd24833bc5fc27e03114176 P 0efc951052454eec9a58b0cd025945b8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:23:12.592258 15832 leader_election.cc:290] T 107541237b4a452e8b47b0c3527b7ede P 0efc951052454eec9a58b0cd025945b8 [CANDIDATE]: Term 2 election: Requested vote from peers f3a500981b494979b58d2b1041fec9c8 (127.5.126.65:34129), a1a22e9119494570b6d2217713fd7e43 (127.5.126.67:38125)
I20260709 13:23:12.522372 15690 leader_election.cc:290] T 03b63e2bee374ed5931dab67ee14b555 P a1a22e9119494570b6d2217713fd7e43 [CANDIDATE]: Term 2 election: Requested vote from peers a722e54d227f4c29a9ed6ce77858003a (127.5.126.68:46669), f3a500981b494979b58d2b1041fec9c8 (127.5.126.65:34129)
I20260709 13:23:12.552394 14953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3abd41db36d404089eaf1f9063bbcb0" candidate_uuid: "a1a22e9119494570b6d2217713fd7e43" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0efc951052454eec9a58b0cd025945b8"
I20260709 13:23:12.596876 14953 raft_consensus.cc:3060] T c3abd41db36d404089eaf1f9063bbcb0 P 0efc951052454eec9a58b0cd025945b8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:23:12.597608 14999 leader_election.cc:304] T 03b63e2bee374ed5931dab67ee14b555 P a1a22e9119494570b6d2217713fd7e43 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a1a22e9119494570b6d2217713fd7e43, a722e54d227f4c29a9ed6ce77858003a; no voters: f3a500981b494979b58d2b1041fec9c8
I20260709 13:23:12.598795 15690 raft_consensus.cc:2804] T 03b63e2bee374ed5931dab67ee14b555 P a1a22e9119494570b6d2217713fd7e43 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:23:12.599320 15690 raft_consensus.cc:697] T 03b63e2bee374ed5931dab67ee14b555 P a1a22e9119494570b6d2217713fd7e43 [term 2 LEADER]: Becoming Leader. State: Replica: a1a22e9119494570b6d2217713fd7e43, State: Running, Role: LEADER
I20260709 13:23:12.600286 15690 consensus_queue.cc:237] T 03b63e2bee374ed5931dab67ee14b555 P a1a22e9119494570b6d2217713fd7e43 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } } peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } } peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } }
W20260709 13:23:12.603693 15073 consensus_peers.cc:597] T a71163721b4d48b0b5ff366b9d12ac32 P a722e54d227f4c29a9ed6ce77858003a -> Peer f3a500981b494979b58d2b1041fec9c8 (127.5.126.65:34129): Couldn't send request to peer f3a500981b494979b58d2b1041fec9c8. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:34129: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:23:12.531380 15034 raft_consensus.cc:2468] T b0b7e1c1e67845cb9bd2208bb2fb7c21 P a1a22e9119494570b6d2217713fd7e43 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0efc951052454eec9a58b0cd025945b8 in term 2.
I20260709 13:23:12.610646 15833 raft_consensus.cc:515] T 58a622a48cd24833bc5fc27e03114176 P 0efc951052454eec9a58b0cd025945b8 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } } peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } } peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } }
I20260709 13:23:12.616882 14924 leader_election.cc:304] T b0b7e1c1e67845cb9bd2208bb2fb7c21 P 0efc951052454eec9a58b0cd025945b8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0efc951052454eec9a58b0cd025945b8, a1a22e9119494570b6d2217713fd7e43; no voters: 
I20260709 13:23:12.617957 15589 raft_consensus.cc:2804] T b0b7e1c1e67845cb9bd2208bb2fb7c21 P 0efc951052454eec9a58b0cd025945b8 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:23:12.618685 15589 raft_consensus.cc:697] T b0b7e1c1e67845cb9bd2208bb2fb7c21 P 0efc951052454eec9a58b0cd025945b8 [term 2 LEADER]: Becoming Leader. State: Replica: 0efc951052454eec9a58b0cd025945b8, State: Running, Role: LEADER
I20260709 13:23:12.619489 15589 consensus_queue.cc:237] T b0b7e1c1e67845cb9bd2208bb2fb7c21 P 0efc951052454eec9a58b0cd025945b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } } peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } } peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } }
I20260709 13:23:12.624974 15034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "107541237b4a452e8b47b0c3527b7ede" candidate_uuid: "0efc951052454eec9a58b0cd025945b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a1a22e9119494570b6d2217713fd7e43"
I20260709 13:23:12.625808 15034 raft_consensus.cc:3060] T 107541237b4a452e8b47b0c3527b7ede P a1a22e9119494570b6d2217713fd7e43 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:23:12.637599 15833 leader_election.cc:290] T 58a622a48cd24833bc5fc27e03114176 P 0efc951052454eec9a58b0cd025945b8 [CANDIDATE]: Term 2 election: Requested vote from peers a722e54d227f4c29a9ed6ce77858003a (127.5.126.68:46669), f3a500981b494979b58d2b1041fec9c8 (127.5.126.65:34129)
I20260709 13:23:12.642508 15104 raft_consensus.cc:2468] T e85432ede09747339c957cdaa7d15ac6 P a722e54d227f4c29a9ed6ce77858003a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1a22e9119494570b6d2217713fd7e43 in term 2.
I20260709 13:23:12.644986 14779 catalog_manager.cc:5697] T 70d027ba81f54eba882756b941186710 P a722e54d227f4c29a9ed6ce77858003a reported cstate change: term changed from 1 to 2, leader changed from f3a500981b494979b58d2b1041fec9c8 (127.5.126.65) to a722e54d227f4c29a9ed6ce77858003a (127.5.126.68). New cstate: current_term: 2 leader_uuid: "a722e54d227f4c29a9ed6ce77858003a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } health_report { overall_health: UNKNOWN } } }
W20260709 13:23:12.581221 14925 leader_election.cc:336] T 58a622a48cd24833bc5fc27e03114176 P 0efc951052454eec9a58b0cd025945b8 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer f3a500981b494979b58d2b1041fec9c8 (127.5.126.65:34129): Network error: Client connection negotiation failed: client connection to 127.5.126.65:34129: connect: Connection refused (error 111)
W20260709 13:23:12.646713 14925 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.65:34129, user_credentials={real_user=slave}} blocked reactor thread for 65504.1us
I20260709 13:23:12.538471 15588 raft_consensus.cc:515] T 46ed2e9dd1324ac4a6e07f813cfebb7e P 0efc951052454eec9a58b0cd025945b8 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } } peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } } peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } }
I20260709 13:23:12.648064 15034 raft_consensus.cc:2468] T 107541237b4a452e8b47b0c3527b7ede P a1a22e9119494570b6d2217713fd7e43 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0efc951052454eec9a58b0cd025945b8 in term 2.
I20260709 13:23:12.649794 14924 leader_election.cc:304] T 107541237b4a452e8b47b0c3527b7ede P 0efc951052454eec9a58b0cd025945b8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0efc951052454eec9a58b0cd025945b8, a1a22e9119494570b6d2217713fd7e43; no voters: 
W20260709 13:23:12.655368 14925 leader_election.cc:336] T 107541237b4a452e8b47b0c3527b7ede P 0efc951052454eec9a58b0cd025945b8 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer f3a500981b494979b58d2b1041fec9c8 (127.5.126.65:34129): Network error: Client connection negotiation failed: client connection to 127.5.126.65:34129: connect: Connection refused (error 111)
I20260709 13:23:12.648422 14999 leader_election.cc:304] T e85432ede09747339c957cdaa7d15ac6 P a1a22e9119494570b6d2217713fd7e43 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a1a22e9119494570b6d2217713fd7e43, a722e54d227f4c29a9ed6ce77858003a; no voters: f3a500981b494979b58d2b1041fec9c8
I20260709 13:23:12.656461 15033 raft_consensus.cc:2468] T dee43e01ec5d409b877a5c2dbf5b7b77 P a1a22e9119494570b6d2217713fd7e43 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a722e54d227f4c29a9ed6ce77858003a in term 2.
I20260709 13:23:12.659668 15690 raft_consensus.cc:2804] T e85432ede09747339c957cdaa7d15ac6 P a1a22e9119494570b6d2217713fd7e43 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:23:12.660566 15072 leader_election.cc:304] T dee43e01ec5d409b877a5c2dbf5b7b77 P a722e54d227f4c29a9ed6ce77858003a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a1a22e9119494570b6d2217713fd7e43, a722e54d227f4c29a9ed6ce77858003a; no voters: f3a500981b494979b58d2b1041fec9c8
I20260709 13:23:12.661830 15753 raft_consensus.cc:2804] T dee43e01ec5d409b877a5c2dbf5b7b77 P a722e54d227f4c29a9ed6ce77858003a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:23:12.662532 15588 leader_election.cc:290] T 46ed2e9dd1324ac4a6e07f813cfebb7e P 0efc951052454eec9a58b0cd025945b8 [CANDIDATE]: Term 2 election: Requested vote from peers f3a500981b494979b58d2b1041fec9c8 (127.5.126.65:34129), a1a22e9119494570b6d2217713fd7e43 (127.5.126.67:38125)
I20260709 13:23:12.662779 14958 raft_consensus.cc:1275] T a71163721b4d48b0b5ff366b9d12ac32 P 0efc951052454eec9a58b0cd025945b8 [term 2 FOLLOWER]: Refusing update from remote peer a722e54d227f4c29a9ed6ce77858003a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:23:12.654332 14953 raft_consensus.cc:2468] T c3abd41db36d404089eaf1f9063bbcb0 P 0efc951052454eec9a58b0cd025945b8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1a22e9119494570b6d2217713fd7e43 in term 2.
I20260709 13:23:12.666260 15690 raft_consensus.cc:697] T e85432ede09747339c957cdaa7d15ac6 P a1a22e9119494570b6d2217713fd7e43 [term 2 LEADER]: Becoming Leader. State: Replica: a1a22e9119494570b6d2217713fd7e43, State: Running, Role: LEADER
I20260709 13:23:12.666338 15731 consensus_queue.cc:1048] T a71163721b4d48b0b5ff366b9d12ac32 P a722e54d227f4c29a9ed6ce77858003a [LEADER]: Connected to new peer: Peer: permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:23:12.667286 14999 leader_election.cc:304] T c3abd41db36d404089eaf1f9063bbcb0 P a1a22e9119494570b6d2217713fd7e43 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0efc951052454eec9a58b0cd025945b8, a1a22e9119494570b6d2217713fd7e43; no voters: f3a500981b494979b58d2b1041fec9c8
I20260709 13:23:12.667444 15690 consensus_queue.cc:237] T e85432ede09747339c957cdaa7d15ac6 P a1a22e9119494570b6d2217713fd7e43 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } } peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } } peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } }
I20260709 13:23:12.668254 15841 raft_consensus.cc:2804] T c3abd41db36d404089eaf1f9063bbcb0 P a1a22e9119494570b6d2217713fd7e43 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:23:12.668744 15841 raft_consensus.cc:697] T c3abd41db36d404089eaf1f9063bbcb0 P a1a22e9119494570b6d2217713fd7e43 [term 2 LEADER]: Becoming Leader. State: Replica: a1a22e9119494570b6d2217713fd7e43, State: Running, Role: LEADER
I20260709 13:23:12.657864 15833 raft_consensus.cc:2804] T 107541237b4a452e8b47b0c3527b7ede P 0efc951052454eec9a58b0cd025945b8 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:23:12.669642 15841 consensus_queue.cc:237] T c3abd41db36d404089eaf1f9063bbcb0 P a1a22e9119494570b6d2217713fd7e43 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } } peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } } peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } }
I20260709 13:23:12.662918 15753 raft_consensus.cc:697] T dee43e01ec5d409b877a5c2dbf5b7b77 P a722e54d227f4c29a9ed6ce77858003a [term 2 LEADER]: Becoming Leader. State: Replica: a722e54d227f4c29a9ed6ce77858003a, State: Running, Role: LEADER
I20260709 13:23:12.672842 15029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46ed2e9dd1324ac4a6e07f813cfebb7e" candidate_uuid: "0efc951052454eec9a58b0cd025945b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a1a22e9119494570b6d2217713fd7e43"
I20260709 13:23:12.673663 15029 raft_consensus.cc:3060] T 46ed2e9dd1324ac4a6e07f813cfebb7e P a1a22e9119494570b6d2217713fd7e43 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:23:12.670131 15833 raft_consensus.cc:697] T 107541237b4a452e8b47b0c3527b7ede P 0efc951052454eec9a58b0cd025945b8 [term 2 LEADER]: Becoming Leader. State: Replica: 0efc951052454eec9a58b0cd025945b8, State: Running, Role: LEADER
I20260709 13:23:12.690979 15833 consensus_queue.cc:237] T 107541237b4a452e8b47b0c3527b7ede P 0efc951052454eec9a58b0cd025945b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } } peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } } peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } }
I20260709 13:23:12.673000 15753 consensus_queue.cc:237] T dee43e01ec5d409b877a5c2dbf5b7b77 P a722e54d227f4c29a9ed6ce77858003a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } } peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } } peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } }
I20260709 13:23:12.711870 14925 leader_election.cc:304] T aecef3c240394d54844ec8170e9cad59 P 0efc951052454eec9a58b0cd025945b8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0efc951052454eec9a58b0cd025945b8, a722e54d227f4c29a9ed6ce77858003a; no voters: 
I20260709 13:23:12.714389 15029 raft_consensus.cc:2468] T 46ed2e9dd1324ac4a6e07f813cfebb7e P a1a22e9119494570b6d2217713fd7e43 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0efc951052454eec9a58b0cd025945b8 in term 2.
I20260709 13:23:12.715795 14924 leader_election.cc:304] T 46ed2e9dd1324ac4a6e07f813cfebb7e P 0efc951052454eec9a58b0cd025945b8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0efc951052454eec9a58b0cd025945b8, a1a22e9119494570b6d2217713fd7e43; no voters: 
I20260709 13:23:12.716874 15832 raft_consensus.cc:2804] T aecef3c240394d54844ec8170e9cad59 P 0efc951052454eec9a58b0cd025945b8 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:23:12.717274 15832 raft_consensus.cc:493] T aecef3c240394d54844ec8170e9cad59 P 0efc951052454eec9a58b0cd025945b8 [term 1 FOLLOWER]: Starting leader election (detected failure of leader f3a500981b494979b58d2b1041fec9c8)
I20260709 13:23:12.718447 15832 raft_consensus.cc:3060] T aecef3c240394d54844ec8170e9cad59 P 0efc951052454eec9a58b0cd025945b8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:23:12.717681 15761 tablet_bootstrap.cc:492] T 74a144396e4443288858878b63f08cc8 P f3a500981b494979b58d2b1041fec9c8: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:23:12.720703 15761 tablet_bootstrap.cc:492] T 74a144396e4443288858878b63f08cc8 P f3a500981b494979b58d2b1041fec9c8: Bootstrap complete.
I20260709 13:23:12.724123 15588 raft_consensus.cc:2804] T 46ed2e9dd1324ac4a6e07f813cfebb7e P 0efc951052454eec9a58b0cd025945b8 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:23:12.724877 15588 raft_consensus.cc:697] T 46ed2e9dd1324ac4a6e07f813cfebb7e P 0efc951052454eec9a58b0cd025945b8 [term 2 LEADER]: Becoming Leader. State: Replica: 0efc951052454eec9a58b0cd025945b8, State: Running, Role: LEADER
I20260709 13:23:12.726086 15588 consensus_queue.cc:237] T 46ed2e9dd1324ac4a6e07f813cfebb7e P 0efc951052454eec9a58b0cd025945b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } } peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } } peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } }
I20260709 13:23:12.727063 15761 ts_tablet_manager.cc:1403] T 74a144396e4443288858878b63f08cc8 P f3a500981b494979b58d2b1041fec9c8: Time spent bootstrapping tablet: real 0.200s	user 0.023s	sys 0.011s
I20260709 13:23:12.735363 15761 raft_consensus.cc:359] T 74a144396e4443288858878b63f08cc8 P f3a500981b494979b58d2b1041fec9c8 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } } peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } } peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } }
I20260709 13:23:12.736200 15761 raft_consensus.cc:740] T 74a144396e4443288858878b63f08cc8 P f3a500981b494979b58d2b1041fec9c8 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: f3a500981b494979b58d2b1041fec9c8, State: Initialized, Role: FOLLOWER
I20260709 13:23:12.739822 15761 consensus_queue.cc:260] T 74a144396e4443288858878b63f08cc8 P f3a500981b494979b58d2b1041fec9c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } } peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } } peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } }
I20260709 13:23:12.748915 14779 catalog_manager.cc:5697] T 74a144396e4443288858878b63f08cc8 P 0efc951052454eec9a58b0cd025945b8 reported cstate change: term changed from 1 to 2, leader changed from f3a500981b494979b58d2b1041fec9c8 (127.5.126.65) to 0efc951052454eec9a58b0cd025945b8 (127.5.126.66). New cstate: current_term: 2 leader_uuid: "0efc951052454eec9a58b0cd025945b8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } health_report { overall_health: UNKNOWN } } }
I20260709 13:23:12.755934 15761 ts_tablet_manager.cc:1434] T 74a144396e4443288858878b63f08cc8 P f3a500981b494979b58d2b1041fec9c8: Time spent starting tablet: real 0.029s	user 0.002s	sys 0.005s
I20260709 13:23:12.757126 15761 tablet_bootstrap.cc:492] T db6d3d345bd3495e9ec9a0e75ecd0562 P f3a500981b494979b58d2b1041fec9c8: Bootstrap starting.
I20260709 13:23:12.765197 15105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58a622a48cd24833bc5fc27e03114176" candidate_uuid: "0efc951052454eec9a58b0cd025945b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a722e54d227f4c29a9ed6ce77858003a"
I20260709 13:23:12.766146 15105 raft_consensus.cc:3060] T 58a622a48cd24833bc5fc27e03114176 P a722e54d227f4c29a9ed6ce77858003a [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:23:12.778527 15073 consensus_peers.cc:597] T f86a730e237248dc9b91cbb75e29c324 P a722e54d227f4c29a9ed6ce77858003a -> Peer f3a500981b494979b58d2b1041fec9c8 (127.5.126.65:34129): Couldn't send request to peer f3a500981b494979b58d2b1041fec9c8. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:34129: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:23:12.782235 15029 raft_consensus.cc:1275] T f86a730e237248dc9b91cbb75e29c324 P a1a22e9119494570b6d2217713fd7e43 [term 2 FOLLOWER]: Refusing update from remote peer a722e54d227f4c29a9ed6ce77858003a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:23:12.790331 15105 raft_consensus.cc:2468] T 58a622a48cd24833bc5fc27e03114176 P a722e54d227f4c29a9ed6ce77858003a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0efc951052454eec9a58b0cd025945b8 in term 2.
I20260709 13:23:12.798148 15822 consensus_queue.cc:1048] T f86a730e237248dc9b91cbb75e29c324 P a722e54d227f4c29a9ed6ce77858003a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.003s
W20260709 13:23:12.797528 14925 leader_election.cc:336] T 46ed2e9dd1324ac4a6e07f813cfebb7e P 0efc951052454eec9a58b0cd025945b8 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer f3a500981b494979b58d2b1041fec9c8 (127.5.126.65:34129): Network error: Client connection negotiation failed: client connection to 127.5.126.65:34129: connect: Connection refused (error 111)
W20260709 13:23:12.805114 14925 leader_election.cc:336] T b0b7e1c1e67845cb9bd2208bb2fb7c21 P 0efc951052454eec9a58b0cd025945b8 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer f3a500981b494979b58d2b1041fec9c8 (127.5.126.65:34129): Network error: Client connection negotiation failed: client connection to 127.5.126.65:34129: connect: Connection refused (error 111)
W20260709 13:23:12.813292 14925 leader_election.cc:336] T aecef3c240394d54844ec8170e9cad59 P 0efc951052454eec9a58b0cd025945b8 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer f3a500981b494979b58d2b1041fec9c8 (127.5.126.65:34129): Network error: Client connection negotiation failed: client connection to 127.5.126.65:34129: connect: Connection refused (error 111)
I20260709 13:23:12.819258 14925 leader_election.cc:304] T 58a622a48cd24833bc5fc27e03114176 P 0efc951052454eec9a58b0cd025945b8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0efc951052454eec9a58b0cd025945b8, a722e54d227f4c29a9ed6ce77858003a; no voters: 
I20260709 13:23:12.820120 15589 raft_consensus.cc:2804] T 58a622a48cd24833bc5fc27e03114176 P 0efc951052454eec9a58b0cd025945b8 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:23:12.820676 15589 raft_consensus.cc:697] T 58a622a48cd24833bc5fc27e03114176 P 0efc951052454eec9a58b0cd025945b8 [term 2 LEADER]: Becoming Leader. State: Replica: 0efc951052454eec9a58b0cd025945b8, State: Running, Role: LEADER
I20260709 13:23:12.821498 15589 consensus_queue.cc:237] T 58a622a48cd24833bc5fc27e03114176 P 0efc951052454eec9a58b0cd025945b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } } peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } } peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } }
I20260709 13:23:12.836099 15832 raft_consensus.cc:515] T aecef3c240394d54844ec8170e9cad59 P 0efc951052454eec9a58b0cd025945b8 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } } peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } } peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } }
I20260709 13:23:12.838166 14779 catalog_manager.cc:5697] T dee43e01ec5d409b877a5c2dbf5b7b77 P a722e54d227f4c29a9ed6ce77858003a reported cstate change: term changed from 1 to 2, leader changed from f3a500981b494979b58d2b1041fec9c8 (127.5.126.65) to a722e54d227f4c29a9ed6ce77858003a (127.5.126.68). New cstate: current_term: 2 leader_uuid: "a722e54d227f4c29a9ed6ce77858003a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } health_report { overall_health: UNKNOWN } } }
I20260709 13:23:12.834921 14781 catalog_manager.cc:5697] T 03b63e2bee374ed5931dab67ee14b555 P a1a22e9119494570b6d2217713fd7e43 reported cstate change: term changed from 1 to 2, leader changed from f3a500981b494979b58d2b1041fec9c8 (127.5.126.65) to a1a22e9119494570b6d2217713fd7e43 (127.5.126.67). New cstate: current_term: 2 leader_uuid: "a1a22e9119494570b6d2217713fd7e43" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } health_report { overall_health: UNKNOWN } } }
I20260709 13:23:12.840739 14781 catalog_manager.cc:5697] T e85432ede09747339c957cdaa7d15ac6 P a1a22e9119494570b6d2217713fd7e43 reported cstate change: term changed from 1 to 2, leader changed from f3a500981b494979b58d2b1041fec9c8 (127.5.126.65) to a1a22e9119494570b6d2217713fd7e43 (127.5.126.67). New cstate: current_term: 2 leader_uuid: "a1a22e9119494570b6d2217713fd7e43" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } health_report { overall_health: UNKNOWN } } }
W20260709 13:23:12.845288 14925 leader_election.cc:336] T 58a622a48cd24833bc5fc27e03114176 P 0efc951052454eec9a58b0cd025945b8 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer f3a500981b494979b58d2b1041fec9c8 (127.5.126.65:34129): Network error: Client connection negotiation failed: client connection to 127.5.126.65:34129: connect: Connection refused (error 111)
W20260709 13:23:12.846225 14925 leader_election.cc:336] T 46ed2e9dd1324ac4a6e07f813cfebb7e P 0efc951052454eec9a58b0cd025945b8 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer f3a500981b494979b58d2b1041fec9c8 (127.5.126.65:34129): Network error: Client connection negotiation failed: client connection to 127.5.126.65:34129: connect: Connection refused (error 111)
I20260709 13:23:12.851449 15832 leader_election.cc:290] T aecef3c240394d54844ec8170e9cad59 P 0efc951052454eec9a58b0cd025945b8 [CANDIDATE]: Term 2 election: Requested vote from peers a722e54d227f4c29a9ed6ce77858003a (127.5.126.68:46669), f3a500981b494979b58d2b1041fec9c8 (127.5.126.65:34129)
I20260709 13:23:12.853108 14781 catalog_manager.cc:5697] T c3abd41db36d404089eaf1f9063bbcb0 P a1a22e9119494570b6d2217713fd7e43 reported cstate change: term changed from 1 to 2, leader changed from f3a500981b494979b58d2b1041fec9c8 (127.5.126.65) to a1a22e9119494570b6d2217713fd7e43 (127.5.126.67). New cstate: current_term: 2 leader_uuid: "a1a22e9119494570b6d2217713fd7e43" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } health_report { overall_health: HEALTHY } } }
W20260709 13:23:12.861207 15073 consensus_peers.cc:597] T bf0b7c8005aa4d8ab97a1499761bf98a P a722e54d227f4c29a9ed6ce77858003a -> Peer f3a500981b494979b58d2b1041fec9c8 (127.5.126.65:34129): Couldn't send request to peer f3a500981b494979b58d2b1041fec9c8. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:34129: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:23:12.896287 15104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aecef3c240394d54844ec8170e9cad59" candidate_uuid: "0efc951052454eec9a58b0cd025945b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a722e54d227f4c29a9ed6ce77858003a"
I20260709 13:23:12.897171 15104 raft_consensus.cc:3060] T aecef3c240394d54844ec8170e9cad59 P a722e54d227f4c29a9ed6ce77858003a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:23:12.925048 15029 raft_consensus.cc:1275] T bf0b7c8005aa4d8ab97a1499761bf98a P a1a22e9119494570b6d2217713fd7e43 [term 2 FOLLOWER]: Refusing update from remote peer a722e54d227f4c29a9ed6ce77858003a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:23:12.927183 14953 raft_consensus.cc:1275] T af00ad02fba64998bb25991f6f69f291 P 0efc951052454eec9a58b0cd025945b8 [term 2 FOLLOWER]: Refusing update from remote peer a722e54d227f4c29a9ed6ce77858003a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:23:12.928253 15762 consensus_queue.cc:1048] T bf0b7c8005aa4d8ab97a1499761bf98a P a722e54d227f4c29a9ed6ce77858003a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:23:12.933682 15762 consensus_queue.cc:1048] T af00ad02fba64998bb25991f6f69f291 P a722e54d227f4c29a9ed6ce77858003a [LEADER]: Connected to new peer: Peer: permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:23:12.941093 15104 raft_consensus.cc:2468] T aecef3c240394d54844ec8170e9cad59 P a722e54d227f4c29a9ed6ce77858003a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0efc951052454eec9a58b0cd025945b8 in term 2.
W20260709 13:23:12.944818 14925 leader_election.cc:336] T 107541237b4a452e8b47b0c3527b7ede P 0efc951052454eec9a58b0cd025945b8 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer f3a500981b494979b58d2b1041fec9c8 (127.5.126.65:34129): Network error: Client connection negotiation failed: client connection to 127.5.126.65:34129: connect: Connection refused (error 111)
I20260709 13:23:12.993289 14925 leader_election.cc:304] T aecef3c240394d54844ec8170e9cad59 P 0efc951052454eec9a58b0cd025945b8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0efc951052454eec9a58b0cd025945b8, a722e54d227f4c29a9ed6ce77858003a; no voters: 
I20260709 13:23:12.994087 15761 tablet_bootstrap.cc:492] T db6d3d345bd3495e9ec9a0e75ecd0562 P f3a500981b494979b58d2b1041fec9c8: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:23:12.995865 15589 raft_consensus.cc:2804] T aecef3c240394d54844ec8170e9cad59 P 0efc951052454eec9a58b0cd025945b8 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:23:12.996529 15589 raft_consensus.cc:697] T aecef3c240394d54844ec8170e9cad59 P 0efc951052454eec9a58b0cd025945b8 [term 2 LEADER]: Becoming Leader. State: Replica: 0efc951052454eec9a58b0cd025945b8, State: Running, Role: LEADER
I20260709 13:23:13.003391 15761 tablet_bootstrap.cc:492] T db6d3d345bd3495e9ec9a0e75ecd0562 P f3a500981b494979b58d2b1041fec9c8: Bootstrap complete.
I20260709 13:23:13.004830 15761 ts_tablet_manager.cc:1403] T db6d3d345bd3495e9ec9a0e75ecd0562 P f3a500981b494979b58d2b1041fec9c8: Time spent bootstrapping tablet: real 0.248s	user 0.021s	sys 0.006s
W20260709 13:23:13.029704 14925 leader_election.cc:336] T aecef3c240394d54844ec8170e9cad59 P 0efc951052454eec9a58b0cd025945b8 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer f3a500981b494979b58d2b1041fec9c8 (127.5.126.65:34129): Network error: Client connection negotiation failed: client connection to 127.5.126.65:34129: connect: Connection refused (error 111)
I20260709 13:23:13.034911 15765 raft_consensus.cc:493] T af00ad02fba64998bb25991f6f69f291 P f3a500981b494979b58d2b1041fec9c8 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:23:13.035462 15765 raft_consensus.cc:515] T af00ad02fba64998bb25991f6f69f291 P f3a500981b494979b58d2b1041fec9c8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } } peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } } peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } }
I20260709 13:23:13.041190 15765 leader_election.cc:290] T af00ad02fba64998bb25991f6f69f291 P f3a500981b494979b58d2b1041fec9c8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a722e54d227f4c29a9ed6ce77858003a (127.5.126.68:46669), 0efc951052454eec9a58b0cd025945b8 (127.5.126.66:34613)
I20260709 13:23:13.047086 15765 raft_consensus.cc:493] T f86a730e237248dc9b91cbb75e29c324 P f3a500981b494979b58d2b1041fec9c8 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:23:13.047818 15765 raft_consensus.cc:515] T f86a730e237248dc9b91cbb75e29c324 P f3a500981b494979b58d2b1041fec9c8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } } peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } } peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } }
I20260709 13:23:13.013187 15589 consensus_queue.cc:237] T aecef3c240394d54844ec8170e9cad59 P 0efc951052454eec9a58b0cd025945b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } } peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } } peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } }
I20260709 13:23:13.073256 15765 leader_election.cc:290] T f86a730e237248dc9b91cbb75e29c324 P f3a500981b494979b58d2b1041fec9c8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a1a22e9119494570b6d2217713fd7e43 (127.5.126.67:38125), a722e54d227f4c29a9ed6ce77858003a (127.5.126.68:46669)
I20260709 13:23:13.083689 15761 raft_consensus.cc:359] T db6d3d345bd3495e9ec9a0e75ecd0562 P f3a500981b494979b58d2b1041fec9c8 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } } peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } } peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } }
I20260709 13:23:13.084674 15761 raft_consensus.cc:740] T db6d3d345bd3495e9ec9a0e75ecd0562 P f3a500981b494979b58d2b1041fec9c8 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: f3a500981b494979b58d2b1041fec9c8, State: Initialized, Role: FOLLOWER
I20260709 13:23:13.085402 15761 consensus_queue.cc:260] T db6d3d345bd3495e9ec9a0e75ecd0562 P f3a500981b494979b58d2b1041fec9c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } } peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } } peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } }
I20260709 13:23:13.092306 15765 raft_consensus.cc:493] T 03f377f48e8849adade3945935d300a9 P f3a500981b494979b58d2b1041fec9c8 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:23:13.092926 15765 raft_consensus.cc:515] T 03f377f48e8849adade3945935d300a9 P f3a500981b494979b58d2b1041fec9c8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } } peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } } peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } }
I20260709 13:23:13.095067 15765 leader_election.cc:290] T 03f377f48e8849adade3945935d300a9 P f3a500981b494979b58d2b1041fec9c8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a1a22e9119494570b6d2217713fd7e43 (127.5.126.67:38125), a722e54d227f4c29a9ed6ce77858003a (127.5.126.68:46669)
I20260709 13:23:13.087827 15761 ts_tablet_manager.cc:1434] T db6d3d345bd3495e9ec9a0e75ecd0562 P f3a500981b494979b58d2b1041fec9c8: Time spent starting tablet: real 0.083s	user 0.005s	sys 0.000s
I20260709 13:23:13.098313 15761 tablet_bootstrap.cc:492] T bf0b7c8005aa4d8ab97a1499761bf98a P f3a500981b494979b58d2b1041fec9c8: Bootstrap starting.
I20260709 13:23:13.102764 15105 raft_consensus.cc:1275] T 03b63e2bee374ed5931dab67ee14b555 P a722e54d227f4c29a9ed6ce77858003a [term 2 FOLLOWER]: Refusing update from remote peer a1a22e9119494570b6d2217713fd7e43: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:23:13.105283 14952 raft_consensus.cc:1275] T c3abd41db36d404089eaf1f9063bbcb0 P 0efc951052454eec9a58b0cd025945b8 [term 2 FOLLOWER]: Refusing update from remote peer a1a22e9119494570b6d2217713fd7e43: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:23:13.116878 15763 consensus_queue.cc:1048] T 03b63e2bee374ed5931dab67ee14b555 P a1a22e9119494570b6d2217713fd7e43 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:23:13.117851 15744 consensus_queue.cc:1048] T c3abd41db36d404089eaf1f9063bbcb0 P a1a22e9119494570b6d2217713fd7e43 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:23:13.149044 15765 raft_consensus.cc:493] T 532cc9041f414e018098570192e0fae8 P f3a500981b494979b58d2b1041fec9c8 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:23:13.149896 15765 raft_consensus.cc:515] T 532cc9041f414e018098570192e0fae8 P f3a500981b494979b58d2b1041fec9c8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } } peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } } peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } }
I20260709 13:23:13.153272 15765 leader_election.cc:290] T 532cc9041f414e018098570192e0fae8 P f3a500981b494979b58d2b1041fec9c8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a722e54d227f4c29a9ed6ce77858003a (127.5.126.68:46669), 0efc951052454eec9a58b0cd025945b8 (127.5.126.66:34613)
I20260709 13:23:13.156019 15104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af00ad02fba64998bb25991f6f69f291" candidate_uuid: "f3a500981b494979b58d2b1041fec9c8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a722e54d227f4c29a9ed6ce77858003a" is_pre_election: true
I20260709 13:23:13.158234 15104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86a730e237248dc9b91cbb75e29c324" candidate_uuid: "f3a500981b494979b58d2b1041fec9c8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a722e54d227f4c29a9ed6ce77858003a" is_pre_election: true
I20260709 13:23:13.158771 15102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03f377f48e8849adade3945935d300a9" candidate_uuid: "f3a500981b494979b58d2b1041fec9c8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a722e54d227f4c29a9ed6ce77858003a" is_pre_election: true
I20260709 13:23:13.160807 15102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "532cc9041f414e018098570192e0fae8" candidate_uuid: "f3a500981b494979b58d2b1041fec9c8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a722e54d227f4c29a9ed6ce77858003a" is_pre_election: true
I20260709 13:23:13.161582 15102 raft_consensus.cc:2393] T 532cc9041f414e018098570192e0fae8 P a722e54d227f4c29a9ed6ce77858003a [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f3a500981b494979b58d2b1041fec9c8 in current term 2: Already voted for candidate 0efc951052454eec9a58b0cd025945b8 in this term.
I20260709 13:23:13.173025 14779 catalog_manager.cc:5697] T 532cc9041f414e018098570192e0fae8 P 0efc951052454eec9a58b0cd025945b8 reported cstate change: term changed from 1 to 2, leader changed from f3a500981b494979b58d2b1041fec9c8 (127.5.126.65) to 0efc951052454eec9a58b0cd025945b8 (127.5.126.66). New cstate: current_term: 2 leader_uuid: "0efc951052454eec9a58b0cd025945b8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } health_report { overall_health: HEALTHY } } }
I20260709 13:23:13.176122 15881 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.5.126.65:34129 every 8 connection(s)
I20260709 13:23:13.175485 14779 catalog_manager.cc:5697] T b0b7e1c1e67845cb9bd2208bb2fb7c21 P 0efc951052454eec9a58b0cd025945b8 reported cstate change: term changed from 1 to 2, leader changed from f3a500981b494979b58d2b1041fec9c8 (127.5.126.65) to 0efc951052454eec9a58b0cd025945b8 (127.5.126.66). New cstate: current_term: 2 leader_uuid: "0efc951052454eec9a58b0cd025945b8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } health_report { overall_health: UNKNOWN } } }
I20260709 13:23:13.178022  5625 rpc_server.cc:307] RPC server started. Bound to: 127.5.126.65:34129
I20260709 13:23:13.180193 14779 catalog_manager.cc:5697] T 107541237b4a452e8b47b0c3527b7ede P 0efc951052454eec9a58b0cd025945b8 reported cstate change: term changed from 1 to 2, leader changed from f3a500981b494979b58d2b1041fec9c8 (127.5.126.65) to 0efc951052454eec9a58b0cd025945b8 (127.5.126.66). New cstate: current_term: 2 leader_uuid: "0efc951052454eec9a58b0cd025945b8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } health_report { overall_health: UNKNOWN } } }
I20260709 13:23:13.189029 14779 catalog_manager.cc:5697] T 46ed2e9dd1324ac4a6e07f813cfebb7e P 0efc951052454eec9a58b0cd025945b8 reported cstate change: term changed from 1 to 2, leader changed from f3a500981b494979b58d2b1041fec9c8 (127.5.126.65) to 0efc951052454eec9a58b0cd025945b8 (127.5.126.66). New cstate: current_term: 2 leader_uuid: "0efc951052454eec9a58b0cd025945b8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } health_report { overall_health: UNKNOWN } } }
I20260709 13:23:13.199901 15029 raft_consensus.cc:1275] T 70d027ba81f54eba882756b941186710 P a1a22e9119494570b6d2217713fd7e43 [term 2 FOLLOWER]: Refusing update from remote peer a722e54d227f4c29a9ed6ce77858003a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:23:13.219435 15880 consensus_queue.cc:1048] T 70d027ba81f54eba882756b941186710 P a722e54d227f4c29a9ed6ce77858003a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.010s
W20260709 13:23:13.228003 14924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.67:38125, user_credentials={real_user=slave}} blocked reactor thread for 205633us
I20260709 13:23:13.235610 15029 raft_consensus.cc:1275] T 74a144396e4443288858878b63f08cc8 P a1a22e9119494570b6d2217713fd7e43 [term 2 FOLLOWER]: Refusing update from remote peer 0efc951052454eec9a58b0cd025945b8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:23:13.237708 15033 raft_consensus.cc:1275] T b0b7e1c1e67845cb9bd2208bb2fb7c21 P a1a22e9119494570b6d2217713fd7e43 [term 2 FOLLOWER]: Refusing update from remote peer 0efc951052454eec9a58b0cd025945b8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:23:13.241871 15102 raft_consensus.cc:1275] T 532cc9041f414e018098570192e0fae8 P a722e54d227f4c29a9ed6ce77858003a [term 2 FOLLOWER]: Refusing update from remote peer 0efc951052454eec9a58b0cd025945b8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:23:13.257102 15033 raft_consensus.cc:1275] T dee43e01ec5d409b877a5c2dbf5b7b77 P a1a22e9119494570b6d2217713fd7e43 [term 2 FOLLOWER]: Refusing update from remote peer a722e54d227f4c29a9ed6ce77858003a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:23:13.261595 15588 consensus_queue.cc:1048] T 74a144396e4443288858878b63f08cc8 P 0efc951052454eec9a58b0cd025945b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:23:13.262147 15589 consensus_queue.cc:1048] T b0b7e1c1e67845cb9bd2208bb2fb7c21 P 0efc951052454eec9a58b0cd025945b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:23:13.285465 15869 consensus_queue.cc:1048] T dee43e01ec5d409b877a5c2dbf5b7b77 P a722e54d227f4c29a9ed6ce77858003a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.011s
I20260709 13:23:13.303843 15028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f86a730e237248dc9b91cbb75e29c324" candidate_uuid: "f3a500981b494979b58d2b1041fec9c8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a1a22e9119494570b6d2217713fd7e43" is_pre_election: true
I20260709 13:23:13.305900 15031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03f377f48e8849adade3945935d300a9" candidate_uuid: "f3a500981b494979b58d2b1041fec9c8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a1a22e9119494570b6d2217713fd7e43" is_pre_election: true
I20260709 13:23:13.305436 14779 catalog_manager.cc:5697] T aecef3c240394d54844ec8170e9cad59 P 0efc951052454eec9a58b0cd025945b8 reported cstate change: term changed from 1 to 2, leader changed from f3a500981b494979b58d2b1041fec9c8 (127.5.126.65) to 0efc951052454eec9a58b0cd025945b8 (127.5.126.66). New cstate: current_term: 2 leader_uuid: "0efc951052454eec9a58b0cd025945b8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } health_report { overall_health: HEALTHY } } }
I20260709 13:23:13.307467 14779 catalog_manager.cc:5697] T 58a622a48cd24833bc5fc27e03114176 P 0efc951052454eec9a58b0cd025945b8 reported cstate change: term changed from 1 to 2, leader changed from f3a500981b494979b58d2b1041fec9c8 (127.5.126.65) to 0efc951052454eec9a58b0cd025945b8 (127.5.126.66). New cstate: current_term: 2 leader_uuid: "0efc951052454eec9a58b0cd025945b8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } health_report { overall_health: HEALTHY } } }
I20260709 13:23:13.272579 15588 consensus_queue.cc:1048] T 532cc9041f414e018098570192e0fae8 P 0efc951052454eec9a58b0cd025945b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.022s
I20260709 13:23:13.300541 15765 raft_consensus.cc:493] T b025139466084200b70879196cd3f922 P f3a500981b494979b58d2b1041fec9c8 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:23:13.317981 15765 raft_consensus.cc:515] T b025139466084200b70879196cd3f922 P f3a500981b494979b58d2b1041fec9c8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } } peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } } peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } }
I20260709 13:23:13.347942 15034 raft_consensus.cc:1275] T 107541237b4a452e8b47b0c3527b7ede P a1a22e9119494570b6d2217713fd7e43 [term 2 FOLLOWER]: Refusing update from remote peer 0efc951052454eec9a58b0cd025945b8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:23:13.320911 15756 leader_election.cc:304] T f86a730e237248dc9b91cbb75e29c324 P f3a500981b494979b58d2b1041fec9c8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f3a500981b494979b58d2b1041fec9c8; no voters: a1a22e9119494570b6d2217713fd7e43, a722e54d227f4c29a9ed6ce77858003a
W20260709 13:23:13.352792 15073 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.66:34613, user_credentials={real_user=slave}} blocked reactor thread for 76847.4us
I20260709 13:23:13.350477 15872 consensus_queue.cc:1048] T 107541237b4a452e8b47b0c3527b7ede P 0efc951052454eec9a58b0cd025945b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 13:23:13.393770 15756 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:38125, user_credentials={real_user=slave}} blocked reactor thread for 73067.6us
I20260709 13:23:13.395545 15896 raft_consensus.cc:493] T c3abd41db36d404089eaf1f9063bbcb0 P f3a500981b494979b58d2b1041fec9c8 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:23:13.395236 15756 leader_election.cc:304] T 03f377f48e8849adade3945935d300a9 P f3a500981b494979b58d2b1041fec9c8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f3a500981b494979b58d2b1041fec9c8; no voters: a1a22e9119494570b6d2217713fd7e43, a722e54d227f4c29a9ed6ce77858003a
I20260709 13:23:13.381140 15765 leader_election.cc:290] T b025139466084200b70879196cd3f922 P f3a500981b494979b58d2b1041fec9c8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0efc951052454eec9a58b0cd025945b8 (127.5.126.66:34613), a1a22e9119494570b6d2217713fd7e43 (127.5.126.67:38125)
I20260709 13:23:13.407193 15761 tablet_bootstrap.cc:492] T bf0b7c8005aa4d8ab97a1499761bf98a P f3a500981b494979b58d2b1041fec9c8: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:23:13.413492 14952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af00ad02fba64998bb25991f6f69f291" candidate_uuid: "f3a500981b494979b58d2b1041fec9c8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0efc951052454eec9a58b0cd025945b8" is_pre_election: true
I20260709 13:23:13.420993 14958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b025139466084200b70879196cd3f922" candidate_uuid: "f3a500981b494979b58d2b1041fec9c8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0efc951052454eec9a58b0cd025945b8" is_pre_election: true
I20260709 13:23:13.393819 15899 raft_consensus.cc:493] T dadd194761924530aede05672c9eecf9 P f3a500981b494979b58d2b1041fec9c8 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:23:13.421801 15765 raft_consensus.cc:2749] T f86a730e237248dc9b91cbb75e29c324 P f3a500981b494979b58d2b1041fec9c8 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:23:13.423696 15103 raft_consensus.cc:1275] T e85432ede09747339c957cdaa7d15ac6 P a722e54d227f4c29a9ed6ce77858003a [term 2 FOLLOWER]: Refusing update from remote peer a1a22e9119494570b6d2217713fd7e43: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:23:13.441654 15031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b025139466084200b70879196cd3f922" candidate_uuid: "f3a500981b494979b58d2b1041fec9c8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a1a22e9119494570b6d2217713fd7e43" is_pre_election: true
I20260709 13:23:13.450150 15761 tablet_bootstrap.cc:492] T bf0b7c8005aa4d8ab97a1499761bf98a P f3a500981b494979b58d2b1041fec9c8: Bootstrap complete.
I20260709 13:23:13.451591 15761 ts_tablet_manager.cc:1403] T bf0b7c8005aa4d8ab97a1499761bf98a P f3a500981b494979b58d2b1041fec9c8: Time spent bootstrapping tablet: real 0.353s	user 0.054s	sys 0.039s
I20260709 13:23:13.482465 15103 raft_consensus.cc:1275] T aecef3c240394d54844ec8170e9cad59 P a722e54d227f4c29a9ed6ce77858003a [term 2 FOLLOWER]: Refusing update from remote peer 0efc951052454eec9a58b0cd025945b8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:23:13.465205 15765 raft_consensus.cc:2749] T 03f377f48e8849adade3945935d300a9 P f3a500981b494979b58d2b1041fec9c8 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:23:13.416790 15896 raft_consensus.cc:515] T c3abd41db36d404089eaf1f9063bbcb0 P f3a500981b494979b58d2b1041fec9c8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } } peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } } peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } }
I20260709 13:23:13.459096 14952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "532cc9041f414e018098570192e0fae8" candidate_uuid: "f3a500981b494979b58d2b1041fec9c8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0efc951052454eec9a58b0cd025945b8" is_pre_election: true
I20260709 13:23:13.505434 15757 leader_election.cc:304] T af00ad02fba64998bb25991f6f69f291 P f3a500981b494979b58d2b1041fec9c8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f3a500981b494979b58d2b1041fec9c8; no voters: 0efc951052454eec9a58b0cd025945b8, a722e54d227f4c29a9ed6ce77858003a
I20260709 13:23:13.452193 15899 raft_consensus.cc:515] T dadd194761924530aede05672c9eecf9 P f3a500981b494979b58d2b1041fec9c8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } } peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } } peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } }
I20260709 13:23:13.480952 15107 raft_consensus.cc:1275] T 58a622a48cd24833bc5fc27e03114176 P a722e54d227f4c29a9ed6ce77858003a [term 2 FOLLOWER]: Refusing update from remote peer 0efc951052454eec9a58b0cd025945b8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:23:13.516467 15763 consensus_queue.cc:1048] T e85432ede09747339c957cdaa7d15ac6 P a1a22e9119494570b6d2217713fd7e43 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:23:13.521782 15032 raft_consensus.cc:1275] T 46ed2e9dd1324ac4a6e07f813cfebb7e P a1a22e9119494570b6d2217713fd7e43 [term 2 FOLLOWER]: Refusing update from remote peer 0efc951052454eec9a58b0cd025945b8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:23:13.518311 15761 raft_consensus.cc:359] T bf0b7c8005aa4d8ab97a1499761bf98a P f3a500981b494979b58d2b1041fec9c8 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } } peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } } peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } }
I20260709 13:23:13.531481 15761 raft_consensus.cc:740] T bf0b7c8005aa4d8ab97a1499761bf98a P f3a500981b494979b58d2b1041fec9c8 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: f3a500981b494979b58d2b1041fec9c8, State: Initialized, Role: FOLLOWER
I20260709 13:23:13.532649 15761 consensus_queue.cc:260] T bf0b7c8005aa4d8ab97a1499761bf98a P f3a500981b494979b58d2b1041fec9c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } } peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } } peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } }
I20260709 13:23:13.565985 15765 raft_consensus.cc:493] T affcb03ab55349748a95c103059d2955 P f3a500981b494979b58d2b1041fec9c8 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:23:13.587163 15761 ts_tablet_manager.cc:1434] T bf0b7c8005aa4d8ab97a1499761bf98a P f3a500981b494979b58d2b1041fec9c8: Time spent starting tablet: real 0.135s	user 0.017s	sys 0.024s
I20260709 13:23:13.591315 15761 tablet_bootstrap.cc:492] T 48be8cf045364be999b8f0fd547b7b9d P f3a500981b494979b58d2b1041fec9c8: Bootstrap starting.
I20260709 13:23:13.547931 15588 consensus_queue.cc:1048] T 58a622a48cd24833bc5fc27e03114176 P 0efc951052454eec9a58b0cd025945b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.031s
I20260709 13:23:13.551442 15735 consensus_queue.cc:1048] T 46ed2e9dd1324ac4a6e07f813cfebb7e P 0efc951052454eec9a58b0cd025945b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.037s
I20260709 13:23:13.602623 15831 consensus_queue.cc:1048] T aecef3c240394d54844ec8170e9cad59 P 0efc951052454eec9a58b0cd025945b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.007s
I20260709 13:23:13.577750 15765 raft_consensus.cc:515] T affcb03ab55349748a95c103059d2955 P f3a500981b494979b58d2b1041fec9c8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } } peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } } peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } }
I20260709 13:23:13.622098 15905 raft_consensus.cc:493] T 88a7c4171c664e819837994755edf95c P f3a500981b494979b58d2b1041fec9c8 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:23:13.624534 15905 raft_consensus.cc:515] T 88a7c4171c664e819837994755edf95c P f3a500981b494979b58d2b1041fec9c8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } } peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } } peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } }
W20260709 13:23:13.639423 15072 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.67:38125, user_credentials={real_user=slave}} blocked reactor thread for 109476us
I20260709 13:23:13.644824 15896 leader_election.cc:290] T c3abd41db36d404089eaf1f9063bbcb0 P f3a500981b494979b58d2b1041fec9c8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0efc951052454eec9a58b0cd025945b8 (127.5.126.66:34613), a1a22e9119494570b6d2217713fd7e43 (127.5.126.67:38125)
I20260709 13:23:13.645491 15896 raft_consensus.cc:2749] T af00ad02fba64998bb25991f6f69f291 P f3a500981b494979b58d2b1041fec9c8 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:23:13.623553 15899 leader_election.cc:290] T dadd194761924530aede05672c9eecf9 P f3a500981b494979b58d2b1041fec9c8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a1a22e9119494570b6d2217713fd7e43 (127.5.126.67:38125), a722e54d227f4c29a9ed6ce77858003a (127.5.126.68:46669)
W20260709 13:23:13.647094 14925 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.68:46669, user_credentials={real_user=slave}} blocked reactor thread for 66919.1us
I20260709 13:23:13.660252 15899 raft_consensus.cc:493] T 46ed2e9dd1324ac4a6e07f813cfebb7e P f3a500981b494979b58d2b1041fec9c8 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:23:13.675972 15029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dadd194761924530aede05672c9eecf9" candidate_uuid: "f3a500981b494979b58d2b1041fec9c8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a1a22e9119494570b6d2217713fd7e43" is_pre_election: true
I20260709 13:23:13.690740 15029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3abd41db36d404089eaf1f9063bbcb0" candidate_uuid: "f3a500981b494979b58d2b1041fec9c8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a1a22e9119494570b6d2217713fd7e43" is_pre_election: true
I20260709 13:23:13.714136 15029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88a7c4171c664e819837994755edf95c" candidate_uuid: "f3a500981b494979b58d2b1041fec9c8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a1a22e9119494570b6d2217713fd7e43" is_pre_election: true
I20260709 13:23:13.684279 15905 leader_election.cc:290] T 88a7c4171c664e819837994755edf95c P f3a500981b494979b58d2b1041fec9c8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0efc951052454eec9a58b0cd025945b8 (127.5.126.66:34613), a1a22e9119494570b6d2217713fd7e43 (127.5.126.67:38125)
W20260709 13:23:13.702019 15757 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.66:34613, user_credentials={real_user=slave}} blocked reactor thread for 245381us
I20260709 13:23:13.736446 15757 leader_election.cc:304] T b025139466084200b70879196cd3f922 P f3a500981b494979b58d2b1041fec9c8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f3a500981b494979b58d2b1041fec9c8; no voters: 0efc951052454eec9a58b0cd025945b8, a1a22e9119494570b6d2217713fd7e43
I20260709 13:23:13.737879 15757 leader_election.cc:304] T 532cc9041f414e018098570192e0fae8 P f3a500981b494979b58d2b1041fec9c8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f3a500981b494979b58d2b1041fec9c8; no voters: 0efc951052454eec9a58b0cd025945b8, a722e54d227f4c29a9ed6ce77858003a
I20260709 13:23:13.740669 15765 leader_election.cc:290] T affcb03ab55349748a95c103059d2955 P f3a500981b494979b58d2b1041fec9c8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0efc951052454eec9a58b0cd025945b8 (127.5.126.66:34613), a1a22e9119494570b6d2217713fd7e43 (127.5.126.67:38125)
I20260709 13:23:13.741357 15765 raft_consensus.cc:2749] T b025139466084200b70879196cd3f922 P f3a500981b494979b58d2b1041fec9c8 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:23:13.742165 15765 raft_consensus.cc:3060] T 532cc9041f414e018098570192e0fae8 P f3a500981b494979b58d2b1041fec9c8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:23:13.695247 15899 raft_consensus.cc:515] T 46ed2e9dd1324ac4a6e07f813cfebb7e P f3a500981b494979b58d2b1041fec9c8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } } peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } } peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } }
I20260709 13:23:13.750234 15899 leader_election.cc:290] T 46ed2e9dd1324ac4a6e07f813cfebb7e P f3a500981b494979b58d2b1041fec9c8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0efc951052454eec9a58b0cd025945b8 (127.5.126.66:34613), a1a22e9119494570b6d2217713fd7e43 (127.5.126.67:38125)
I20260709 13:23:13.783272 14958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3abd41db36d404089eaf1f9063bbcb0" candidate_uuid: "f3a500981b494979b58d2b1041fec9c8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0efc951052454eec9a58b0cd025945b8" is_pre_election: true
W20260709 13:23:13.787055 15915 log.cc:927] Time spent T 46ed2e9dd1324ac4a6e07f813cfebb7e P a1a22e9119494570b6d2217713fd7e43: Append to log took a long time: real 0.074s	user 0.000s	sys 0.001s
I20260709 13:23:13.823825 14954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88a7c4171c664e819837994755edf95c" candidate_uuid: "f3a500981b494979b58d2b1041fec9c8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0efc951052454eec9a58b0cd025945b8" is_pre_election: true
I20260709 13:23:13.825388 14959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46ed2e9dd1324ac4a6e07f813cfebb7e" candidate_uuid: "f3a500981b494979b58d2b1041fec9c8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0efc951052454eec9a58b0cd025945b8" is_pre_election: true
I20260709 13:23:13.828856 15807 raft_consensus.cc:3060] T af00ad02fba64998bb25991f6f69f291 P f3a500981b494979b58d2b1041fec9c8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:23:13.819166 15031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46ed2e9dd1324ac4a6e07f813cfebb7e" candidate_uuid: "f3a500981b494979b58d2b1041fec9c8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a1a22e9119494570b6d2217713fd7e43" is_pre_election: true
I20260709 13:23:13.830221 15105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dadd194761924530aede05672c9eecf9" candidate_uuid: "f3a500981b494979b58d2b1041fec9c8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a722e54d227f4c29a9ed6ce77858003a" is_pre_election: true
I20260709 13:23:13.832702 14952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "affcb03ab55349748a95c103059d2955" candidate_uuid: "f3a500981b494979b58d2b1041fec9c8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0efc951052454eec9a58b0cd025945b8" is_pre_election: true
I20260709 13:23:13.847786 15028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "affcb03ab55349748a95c103059d2955" candidate_uuid: "f3a500981b494979b58d2b1041fec9c8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a1a22e9119494570b6d2217713fd7e43" is_pre_election: true
W20260709 13:23:13.876602 15913 log.cc:927] Time spent T af00ad02fba64998bb25991f6f69f291 P a722e54d227f4c29a9ed6ce77858003a: Append to log took a long time: real 0.158s	user 0.001s	sys 0.000s
W20260709 13:23:13.947147 14999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.68:46669, user_credentials={real_user=slave}} blocked reactor thread for 124041us
I20260709 13:23:13.960280 15917 raft_consensus.cc:493] T abc01daa220a47fa8578b0d20a17c9ab P f3a500981b494979b58d2b1041fec9c8 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:23:13.961022 15917 raft_consensus.cc:515] T abc01daa220a47fa8578b0d20a17c9ab P f3a500981b494979b58d2b1041fec9c8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } } peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } } peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } }
I20260709 13:23:13.963227 15765 raft_consensus.cc:2749] T 532cc9041f414e018098570192e0fae8 P f3a500981b494979b58d2b1041fec9c8 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:23:13.982509 15033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abc01daa220a47fa8578b0d20a17c9ab" candidate_uuid: "f3a500981b494979b58d2b1041fec9c8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a1a22e9119494570b6d2217713fd7e43" is_pre_election: true
I20260709 13:23:13.990746 15765 raft_consensus.cc:493] T 2a9523aa8663464686254c8412c37e67 P f3a500981b494979b58d2b1041fec9c8 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:23:13.995841 15765 raft_consensus.cc:515] T 2a9523aa8663464686254c8412c37e67 P f3a500981b494979b58d2b1041fec9c8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } } peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } } peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } }
I20260709 13:23:13.996860 15805 raft_consensus.cc:3060] T bf0b7c8005aa4d8ab97a1499761bf98a P f3a500981b494979b58d2b1041fec9c8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:23:13.998677 15765 leader_election.cc:290] T 2a9523aa8663464686254c8412c37e67 P f3a500981b494979b58d2b1041fec9c8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a722e54d227f4c29a9ed6ce77858003a (127.5.126.68:46669), 0efc951052454eec9a58b0cd025945b8 (127.5.126.66:34613)
I20260709 13:23:14.018674 15797 raft_consensus.cc:3060] T f86a730e237248dc9b91cbb75e29c324 P f3a500981b494979b58d2b1041fec9c8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:23:14.026364 15799 raft_consensus.cc:3060] T 74a144396e4443288858878b63f08cc8 P f3a500981b494979b58d2b1041fec9c8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:23:14.029357 15804 raft_consensus.cc:1275] T 532cc9041f414e018098570192e0fae8 P f3a500981b494979b58d2b1041fec9c8 [term 2 FOLLOWER]: Refusing update from remote peer 0efc951052454eec9a58b0cd025945b8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:23:14.032215 15917 leader_election.cc:290] T abc01daa220a47fa8578b0d20a17c9ab P f3a500981b494979b58d2b1041fec9c8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a1a22e9119494570b6d2217713fd7e43 (127.5.126.67:38125), a722e54d227f4c29a9ed6ce77858003a (127.5.126.68:46669)
I20260709 13:23:14.037438 15801 raft_consensus.cc:3060] T 46ed2e9dd1324ac4a6e07f813cfebb7e P f3a500981b494979b58d2b1041fec9c8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:23:14.048888 15806 raft_consensus.cc:3060] T c3abd41db36d404089eaf1f9063bbcb0 P f3a500981b494979b58d2b1041fec9c8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:23:14.055400 15761 tablet_bootstrap.cc:492] T 48be8cf045364be999b8f0fd547b7b9d P f3a500981b494979b58d2b1041fec9c8: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
W20260709 13:23:14.061987 15073 consensus_peers.cc:597] T f954c6c25a25443abd9705c8e909bf47 P a722e54d227f4c29a9ed6ce77858003a -> Peer f3a500981b494979b58d2b1041fec9c8 (127.5.126.65:34129): Couldn't send request to peer f3a500981b494979b58d2b1041fec9c8. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:23:14.062512 15073 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.65:34129, user_credentials={real_user=slave}} blocked reactor thread for 118608us
I20260709 13:23:14.076910 15761 tablet_bootstrap.cc:492] T 48be8cf045364be999b8f0fd547b7b9d P f3a500981b494979b58d2b1041fec9c8: Bootstrap complete.
W20260709 13:23:14.089296 15073 consensus_peers.cc:597] T 70d027ba81f54eba882756b941186710 P a722e54d227f4c29a9ed6ce77858003a -> Peer f3a500981b494979b58d2b1041fec9c8 (127.5.126.65:34129): Couldn't send request to peer f3a500981b494979b58d2b1041fec9c8. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:23:14.090384 15073 consensus_peers.cc:597] T 268027ae94a54cf4acf51c54c7b9032b P a722e54d227f4c29a9ed6ce77858003a -> Peer f3a500981b494979b58d2b1041fec9c8 (127.5.126.65:34129): Couldn't send request to peer f3a500981b494979b58d2b1041fec9c8. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:23:14.091293 15073 consensus_peers.cc:597] T 77e8d8b35cf148e99e8274bf65e5ed05 P a722e54d227f4c29a9ed6ce77858003a -> Peer f3a500981b494979b58d2b1041fec9c8 (127.5.126.65:34129): Couldn't send request to peer f3a500981b494979b58d2b1041fec9c8. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:23:14.104622 15807 raft_consensus.cc:1275] T af00ad02fba64998bb25991f6f69f291 P f3a500981b494979b58d2b1041fec9c8 [term 2 FOLLOWER]: Refusing update from remote peer a722e54d227f4c29a9ed6ce77858003a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 13:23:14.105921 14925 consensus_peers.cc:597] T 48be8cf045364be999b8f0fd547b7b9d P 0efc951052454eec9a58b0cd025945b8 -> Peer f3a500981b494979b58d2b1041fec9c8 (127.5.126.65:34129): Couldn't send request to peer f3a500981b494979b58d2b1041fec9c8. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:23:14.106350 15761 ts_tablet_manager.cc:1403] T 48be8cf045364be999b8f0fd547b7b9d P f3a500981b494979b58d2b1041fec9c8: Time spent bootstrapping tablet: real 0.487s	user 0.040s	sys 0.016s
I20260709 13:23:14.109011 15761 raft_consensus.cc:359] T 48be8cf045364be999b8f0fd547b7b9d P f3a500981b494979b58d2b1041fec9c8 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } } peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } } peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } }
I20260709 13:23:14.109663 15761 raft_consensus.cc:740] T 48be8cf045364be999b8f0fd547b7b9d P f3a500981b494979b58d2b1041fec9c8 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: f3a500981b494979b58d2b1041fec9c8, State: Initialized, Role: FOLLOWER
I20260709 13:23:14.114653 15799 raft_consensus.cc:1275] T 74a144396e4443288858878b63f08cc8 P f3a500981b494979b58d2b1041fec9c8 [term 2 FOLLOWER]: Refusing update from remote peer 0efc951052454eec9a58b0cd025945b8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:23:14.115371 15916 raft_consensus.cc:493] T 74a144396e4443288858878b63f08cc8 P f3a500981b494979b58d2b1041fec9c8 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:23:14.115828 15916 raft_consensus.cc:515] T 74a144396e4443288858878b63f08cc8 P f3a500981b494979b58d2b1041fec9c8 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } } peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } } peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } }
I20260709 13:23:14.120993 15916 leader_election.cc:290] T 74a144396e4443288858878b63f08cc8 P f3a500981b494979b58d2b1041fec9c8 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0efc951052454eec9a58b0cd025945b8 (127.5.126.66:34613), a1a22e9119494570b6d2217713fd7e43 (127.5.126.67:38125)
I20260709 13:23:14.121390 15032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74a144396e4443288858878b63f08cc8" candidate_uuid: "f3a500981b494979b58d2b1041fec9c8" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a1a22e9119494570b6d2217713fd7e43" is_pre_election: true
I20260709 13:23:14.110333 15761 consensus_queue.cc:260] T 48be8cf045364be999b8f0fd547b7b9d P f3a500981b494979b58d2b1041fec9c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } } peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } } peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } }
I20260709 13:23:14.124110 15761 ts_tablet_manager.cc:1434] T 48be8cf045364be999b8f0fd547b7b9d P f3a500981b494979b58d2b1041fec9c8: Time spent starting tablet: real 0.017s	user 0.005s	sys 0.001s
I20260709 13:23:14.124912 15761 tablet_bootstrap.cc:492] T b0b7e1c1e67845cb9bd2208bb2fb7c21 P f3a500981b494979b58d2b1041fec9c8: Bootstrap starting.
I20260709 13:23:14.158885 15806 raft_consensus.cc:1275] T c3abd41db36d404089eaf1f9063bbcb0 P f3a500981b494979b58d2b1041fec9c8 [term 2 FOLLOWER]: Refusing update from remote peer a1a22e9119494570b6d2217713fd7e43: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 13:23:14.160351 15073 consensus_peers.cc:597] T dee43e01ec5d409b877a5c2dbf5b7b77 P a722e54d227f4c29a9ed6ce77858003a -> Peer f3a500981b494979b58d2b1041fec9c8 (127.5.126.65:34129): Couldn't send request to peer f3a500981b494979b58d2b1041fec9c8. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:23:14.161788 15893 consensus_queue.cc:1048] T af00ad02fba64998bb25991f6f69f291 P a722e54d227f4c29a9ed6ce77858003a [LEADER]: Connected to new peer: Peer: permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:23:14.165385 15103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a9523aa8663464686254c8412c37e67" candidate_uuid: "f3a500981b494979b58d2b1041fec9c8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a722e54d227f4c29a9ed6ce77858003a" is_pre_election: true
I20260709 13:23:14.165642 15108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abc01daa220a47fa8578b0d20a17c9ab" candidate_uuid: "f3a500981b494979b58d2b1041fec9c8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a722e54d227f4c29a9ed6ce77858003a" is_pre_election: true
I20260709 13:23:14.168208 14960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a9523aa8663464686254c8412c37e67" candidate_uuid: "f3a500981b494979b58d2b1041fec9c8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0efc951052454eec9a58b0cd025945b8" is_pre_election: true
I20260709 13:23:14.170050 15829 consensus_queue.cc:1048] T 532cc9041f414e018098570192e0fae8 P 0efc951052454eec9a58b0cd025945b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 13:23:14.181576 14925 consensus_peers.cc:597] T 58a622a48cd24833bc5fc27e03114176 P 0efc951052454eec9a58b0cd025945b8 -> Peer f3a500981b494979b58d2b1041fec9c8 (127.5.126.65:34129): Couldn't send request to peer f3a500981b494979b58d2b1041fec9c8. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:23:14.181655 15801 raft_consensus.cc:1275] T 46ed2e9dd1324ac4a6e07f813cfebb7e P f3a500981b494979b58d2b1041fec9c8 [term 2 FOLLOWER]: Refusing update from remote peer 0efc951052454eec9a58b0cd025945b8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 13:23:14.189397 14999 consensus_peers.cc:597] T e85432ede09747339c957cdaa7d15ac6 P a1a22e9119494570b6d2217713fd7e43 -> Peer f3a500981b494979b58d2b1041fec9c8 (127.5.126.65:34129): Couldn't send request to peer f3a500981b494979b58d2b1041fec9c8. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:23:14.192778 14999 consensus_peers.cc:597] T 03b63e2bee374ed5931dab67ee14b555 P a1a22e9119494570b6d2217713fd7e43 -> Peer f3a500981b494979b58d2b1041fec9c8 (127.5.126.65:34129): Couldn't send request to peer f3a500981b494979b58d2b1041fec9c8. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:23:14.193994 14999 consensus_peers.cc:597] T 5df7528567fd4291a888bfb37c28dc27 P a1a22e9119494570b6d2217713fd7e43 -> Peer f3a500981b494979b58d2b1041fec9c8 (127.5.126.65:34129): Couldn't send request to peer f3a500981b494979b58d2b1041fec9c8. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:23:14.194856 14999 consensus_peers.cc:597] T 2956fb66a7f34f3e99f42598fb93178e P a1a22e9119494570b6d2217713fd7e43 -> Peer f3a500981b494979b58d2b1041fec9c8 (127.5.126.65:34129): Couldn't send request to peer f3a500981b494979b58d2b1041fec9c8. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:23:14.195456 14999 consensus_peers.cc:597] T e3693e8a3b0444bf978dc845dcfd2a45 P a1a22e9119494570b6d2217713fd7e43 -> Peer f3a500981b494979b58d2b1041fec9c8 (127.5.126.65:34129): Couldn't send request to peer f3a500981b494979b58d2b1041fec9c8. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:23:14.182595 14925 consensus_peers.cc:597] T 107541237b4a452e8b47b0c3527b7ede P 0efc951052454eec9a58b0cd025945b8 -> Peer f3a500981b494979b58d2b1041fec9c8 (127.5.126.65:34129): Couldn't send request to peer f3a500981b494979b58d2b1041fec9c8. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:23:14.198215 14925 consensus_peers.cc:597] T aecef3c240394d54844ec8170e9cad59 P 0efc951052454eec9a58b0cd025945b8 -> Peer f3a500981b494979b58d2b1041fec9c8 (127.5.126.65:34129): Couldn't send request to peer f3a500981b494979b58d2b1041fec9c8. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:23:14.199882 14925 consensus_peers.cc:597] T b0b7e1c1e67845cb9bd2208bb2fb7c21 P 0efc951052454eec9a58b0cd025945b8 -> Peer f3a500981b494979b58d2b1041fec9c8 (127.5.126.65:34129): Couldn't send request to peer f3a500981b494979b58d2b1041fec9c8. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:23:14.196455 15757 leader_election.cc:304] T dadd194761924530aede05672c9eecf9 P f3a500981b494979b58d2b1041fec9c8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f3a500981b494979b58d2b1041fec9c8; no voters: a1a22e9119494570b6d2217713fd7e43, a722e54d227f4c29a9ed6ce77858003a
I20260709 13:23:14.201611 15916 raft_consensus.cc:2749] T dadd194761924530aede05672c9eecf9 P f3a500981b494979b58d2b1041fec9c8 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:23:14.202967 15757 leader_election.cc:304] T abc01daa220a47fa8578b0d20a17c9ab P f3a500981b494979b58d2b1041fec9c8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f3a500981b494979b58d2b1041fec9c8; no voters: a1a22e9119494570b6d2217713fd7e43, a722e54d227f4c29a9ed6ce77858003a
I20260709 13:23:14.207392 15916 raft_consensus.cc:2749] T abc01daa220a47fa8578b0d20a17c9ab P f3a500981b494979b58d2b1041fec9c8 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:23:14.210033 15757 leader_election.cc:304] T c3abd41db36d404089eaf1f9063bbcb0 P f3a500981b494979b58d2b1041fec9c8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f3a500981b494979b58d2b1041fec9c8; no voters: 0efc951052454eec9a58b0cd025945b8, a1a22e9119494570b6d2217713fd7e43
I20260709 13:23:14.210845 15916 raft_consensus.cc:2749] T c3abd41db36d404089eaf1f9063bbcb0 P f3a500981b494979b58d2b1041fec9c8 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:23:14.212198 15757 leader_election.cc:304] T 88a7c4171c664e819837994755edf95c P f3a500981b494979b58d2b1041fec9c8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f3a500981b494979b58d2b1041fec9c8; no voters: 0efc951052454eec9a58b0cd025945b8, a1a22e9119494570b6d2217713fd7e43
I20260709 13:23:14.214465 15916 raft_consensus.cc:2749] T 88a7c4171c664e819837994755edf95c P f3a500981b494979b58d2b1041fec9c8 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:23:14.215801 15757 leader_election.cc:304] T 46ed2e9dd1324ac4a6e07f813cfebb7e P f3a500981b494979b58d2b1041fec9c8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f3a500981b494979b58d2b1041fec9c8; no voters: 0efc951052454eec9a58b0cd025945b8, a1a22e9119494570b6d2217713fd7e43
I20260709 13:23:14.275784 15916 raft_consensus.cc:2749] T 46ed2e9dd1324ac4a6e07f813cfebb7e P f3a500981b494979b58d2b1041fec9c8 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:23:14.276547 15073 consensus_peers.cc:597] T 0819f8999271428481a1f839026171a7 P a722e54d227f4c29a9ed6ce77858003a -> Peer f3a500981b494979b58d2b1041fec9c8 (127.5.126.65:34129): Couldn't send request to peer f3a500981b494979b58d2b1041fec9c8. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:23:14.276837 15757 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.66:34613, user_credentials={real_user=slave}} blocked reactor thread for 61143.2us
I20260709 13:23:14.277630 15757 leader_election.cc:304] T affcb03ab55349748a95c103059d2955 P f3a500981b494979b58d2b1041fec9c8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f3a500981b494979b58d2b1041fec9c8; no voters: 0efc951052454eec9a58b0cd025945b8, a1a22e9119494570b6d2217713fd7e43
W20260709 13:23:14.277889 15073 consensus_peers.cc:597] T 8996bae84ecc4bffa0239d64dce7b24f P a722e54d227f4c29a9ed6ce77858003a -> Peer f3a500981b494979b58d2b1041fec9c8 (127.5.126.65:34129): Couldn't send request to peer f3a500981b494979b58d2b1041fec9c8. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:23:14.278697 15916 raft_consensus.cc:2749] T affcb03ab55349748a95c103059d2955 P f3a500981b494979b58d2b1041fec9c8 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:23:14.280227 15073 consensus_peers.cc:597] T e4f2c694c8194f1e86ad76c7ff051ea7 P a722e54d227f4c29a9ed6ce77858003a -> Peer f3a500981b494979b58d2b1041fec9c8 (127.5.126.65:34129): Couldn't send request to peer f3a500981b494979b58d2b1041fec9c8. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:23:14.280922 15073 consensus_peers.cc:597] T d65eaa0ab4574a1ea92b3848d4dc9c4d P a722e54d227f4c29a9ed6ce77858003a -> Peer f3a500981b494979b58d2b1041fec9c8 (127.5.126.65:34129): Couldn't send request to peer f3a500981b494979b58d2b1041fec9c8. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:23:14.280078 15757 leader_election.cc:304] T 2a9523aa8663464686254c8412c37e67 P f3a500981b494979b58d2b1041fec9c8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f3a500981b494979b58d2b1041fec9c8; no voters: 0efc951052454eec9a58b0cd025945b8, a722e54d227f4c29a9ed6ce77858003a
I20260709 13:23:14.285116 15916 raft_consensus.cc:2749] T 2a9523aa8663464686254c8412c37e67 P f3a500981b494979b58d2b1041fec9c8 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:23:14.287497 15761 tablet_bootstrap.cc:492] T b0b7e1c1e67845cb9bd2208bb2fb7c21 P f3a500981b494979b58d2b1041fec9c8: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:23:14.288791 15761 tablet_bootstrap.cc:492] T b0b7e1c1e67845cb9bd2208bb2fb7c21 P f3a500981b494979b58d2b1041fec9c8: Bootstrap complete.
I20260709 13:23:14.289650 15761 ts_tablet_manager.cc:1403] T b0b7e1c1e67845cb9bd2208bb2fb7c21 P f3a500981b494979b58d2b1041fec9c8: Time spent bootstrapping tablet: real 0.165s	user 0.036s	sys 0.024s
I20260709 13:23:14.296937 15832 consensus_queue.cc:1048] T 74a144396e4443288858878b63f08cc8 P 0efc951052454eec9a58b0cd025945b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:23:14.298414 15923 consensus_queue.cc:1048] T c3abd41db36d404089eaf1f9063bbcb0 P a1a22e9119494570b6d2217713fd7e43 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:23:14.299286 14960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74a144396e4443288858878b63f08cc8" candidate_uuid: "f3a500981b494979b58d2b1041fec9c8" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0efc951052454eec9a58b0cd025945b8" is_pre_election: true
I20260709 13:23:14.298332 15761 raft_consensus.cc:359] T b0b7e1c1e67845cb9bd2208bb2fb7c21 P f3a500981b494979b58d2b1041fec9c8 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } } peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } } peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } }
I20260709 13:23:14.301676 15761 raft_consensus.cc:740] T b0b7e1c1e67845cb9bd2208bb2fb7c21 P f3a500981b494979b58d2b1041fec9c8 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: f3a500981b494979b58d2b1041fec9c8, State: Initialized, Role: FOLLOWER
I20260709 13:23:14.302430 15761 consensus_queue.cc:260] T b0b7e1c1e67845cb9bd2208bb2fb7c21 P f3a500981b494979b58d2b1041fec9c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } } peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } } peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } }
I20260709 13:23:14.305210 15761 ts_tablet_manager.cc:1434] T b0b7e1c1e67845cb9bd2208bb2fb7c21 P f3a500981b494979b58d2b1041fec9c8: Time spent starting tablet: real 0.015s	user 0.005s	sys 0.001s
I20260709 13:23:14.306200 15761 tablet_bootstrap.cc:492] T 8996bae84ecc4bffa0239d64dce7b24f P f3a500981b494979b58d2b1041fec9c8: Bootstrap starting.
I20260709 13:23:14.307094 15832 consensus_queue.cc:1048] T 46ed2e9dd1324ac4a6e07f813cfebb7e P 0efc951052454eec9a58b0cd025945b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 13:23:14.322533 15073 consensus_peers.cc:597] T d64d06459b344ff99c0df07c249c3a60 P a722e54d227f4c29a9ed6ce77858003a -> Peer f3a500981b494979b58d2b1041fec9c8 (127.5.126.65:34129): Couldn't send request to peer f3a500981b494979b58d2b1041fec9c8. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:23:14.324904 14925 consensus_peers.cc:597] T 2a862e106a9e48a692bc72ea8c03ab39 P 0efc951052454eec9a58b0cd025945b8 -> Peer f3a500981b494979b58d2b1041fec9c8 (127.5.126.65:34129): Couldn't send request to peer f3a500981b494979b58d2b1041fec9c8. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:23:14.329893 14925 consensus_peers.cc:597] T 08dea3083d334745abe54f9b220bd86a P 0efc951052454eec9a58b0cd025945b8 -> Peer f3a500981b494979b58d2b1041fec9c8 (127.5.126.65:34129): Couldn't send request to peer f3a500981b494979b58d2b1041fec9c8. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:23:14.330147 15757 leader_election.cc:304] T 74a144396e4443288858878b63f08cc8 P f3a500981b494979b58d2b1041fec9c8 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f3a500981b494979b58d2b1041fec9c8; no voters: 0efc951052454eec9a58b0cd025945b8, a1a22e9119494570b6d2217713fd7e43
I20260709 13:23:14.331467 15892 heartbeater.cc:344] Connected to a master server at 127.5.126.126:45503
I20260709 13:23:14.331902 15892 heartbeater.cc:461] Registering TS with master...
I20260709 13:23:14.332939 15892 heartbeater.cc:507] Master 127.5.126.126:45503 requested a full tablet report, sending...
I20260709 13:23:14.353641 15765 raft_consensus.cc:2749] T 74a144396e4443288858878b63f08cc8 P f3a500981b494979b58d2b1041fec9c8 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:23:14.380605 15761 tablet_bootstrap.cc:492] T 8996bae84ecc4bffa0239d64dce7b24f P f3a500981b494979b58d2b1041fec9c8: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:23:14.381608 15761 tablet_bootstrap.cc:492] T 8996bae84ecc4bffa0239d64dce7b24f P f3a500981b494979b58d2b1041fec9c8: Bootstrap complete.
I20260709 13:23:14.382277 15761 ts_tablet_manager.cc:1403] T 8996bae84ecc4bffa0239d64dce7b24f P f3a500981b494979b58d2b1041fec9c8: Time spent bootstrapping tablet: real 0.076s	user 0.023s	sys 0.015s
I20260709 13:23:14.384821 15761 raft_consensus.cc:359] T 8996bae84ecc4bffa0239d64dce7b24f P f3a500981b494979b58d2b1041fec9c8 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } } peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } } peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } }
I20260709 13:23:14.385483 15761 raft_consensus.cc:740] T 8996bae84ecc4bffa0239d64dce7b24f P f3a500981b494979b58d2b1041fec9c8 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: f3a500981b494979b58d2b1041fec9c8, State: Initialized, Role: FOLLOWER
I20260709 13:23:14.386202 15761 consensus_queue.cc:260] T 8996bae84ecc4bffa0239d64dce7b24f P f3a500981b494979b58d2b1041fec9c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } } peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } } peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } }
I20260709 13:23:14.388379 15761 ts_tablet_manager.cc:1434] T 8996bae84ecc4bffa0239d64dce7b24f P f3a500981b494979b58d2b1041fec9c8: Time spent starting tablet: real 0.006s	user 0.008s	sys 0.000s
I20260709 13:23:14.392510 15761 tablet_bootstrap.cc:492] T 16d5db73377a4925b9f1e814ba306fcc P f3a500981b494979b58d2b1041fec9c8: Bootstrap starting.
I20260709 13:23:14.407652 14782 ts_manager.cc:194] Re-registered known tserver with Master: f3a500981b494979b58d2b1041fec9c8 (127.5.126.65:34129)
I20260709 13:23:14.413564 15761 tablet_bootstrap.cc:492] T 16d5db73377a4925b9f1e814ba306fcc P f3a500981b494979b58d2b1041fec9c8: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:23:14.415050 15761 tablet_bootstrap.cc:492] T 16d5db73377a4925b9f1e814ba306fcc P f3a500981b494979b58d2b1041fec9c8: Bootstrap complete.
I20260709 13:23:14.415709 15761 ts_tablet_manager.cc:1403] T 16d5db73377a4925b9f1e814ba306fcc P f3a500981b494979b58d2b1041fec9c8: Time spent bootstrapping tablet: real 0.026s	user 0.016s	sys 0.000s
I20260709 13:23:14.418356 15761 raft_consensus.cc:359] T 16d5db73377a4925b9f1e814ba306fcc P f3a500981b494979b58d2b1041fec9c8 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } } peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } } peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } }
W20260709 13:23:14.418757 14925 consensus_peers.cc:597] T 7560205f5d324c7d821dff8efe7a6256 P 0efc951052454eec9a58b0cd025945b8 -> Peer f3a500981b494979b58d2b1041fec9c8 (127.5.126.65:34129): Couldn't send request to peer f3a500981b494979b58d2b1041fec9c8. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:23:14.419029 15761 raft_consensus.cc:740] T 16d5db73377a4925b9f1e814ba306fcc P f3a500981b494979b58d2b1041fec9c8 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: f3a500981b494979b58d2b1041fec9c8, State: Initialized, Role: FOLLOWER
I20260709 13:23:14.419763 15761 consensus_queue.cc:260] T 16d5db73377a4925b9f1e814ba306fcc P f3a500981b494979b58d2b1041fec9c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } } peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } } peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } }
I20260709 13:23:14.421803 15761 ts_tablet_manager.cc:1434] T 16d5db73377a4925b9f1e814ba306fcc P f3a500981b494979b58d2b1041fec9c8: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:23:14.422806 15761 tablet_bootstrap.cc:492] T 2956fb66a7f34f3e99f42598fb93178e P f3a500981b494979b58d2b1041fec9c8: Bootstrap starting.
I20260709 13:23:14.438463 15761 tablet_bootstrap.cc:492] T 2956fb66a7f34f3e99f42598fb93178e P f3a500981b494979b58d2b1041fec9c8: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:23:14.439392 15761 tablet_bootstrap.cc:492] T 2956fb66a7f34f3e99f42598fb93178e P f3a500981b494979b58d2b1041fec9c8: Bootstrap complete.
I20260709 13:23:14.439999 15761 ts_tablet_manager.cc:1403] T 2956fb66a7f34f3e99f42598fb93178e P f3a500981b494979b58d2b1041fec9c8: Time spent bootstrapping tablet: real 0.017s	user 0.013s	sys 0.000s
I20260709 13:23:14.442497 15761 raft_consensus.cc:359] T 2956fb66a7f34f3e99f42598fb93178e P f3a500981b494979b58d2b1041fec9c8 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } } peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } } peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } }
I20260709 13:23:14.443186 15761 raft_consensus.cc:740] T 2956fb66a7f34f3e99f42598fb93178e P f3a500981b494979b58d2b1041fec9c8 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: f3a500981b494979b58d2b1041fec9c8, State: Initialized, Role: FOLLOWER
I20260709 13:23:14.443843 15761 consensus_queue.cc:260] T 2956fb66a7f34f3e99f42598fb93178e P f3a500981b494979b58d2b1041fec9c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } } peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } } peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } }
I20260709 13:23:14.446233 15761 ts_tablet_manager.cc:1434] T 2956fb66a7f34f3e99f42598fb93178e P f3a500981b494979b58d2b1041fec9c8: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:23:14.446990 15761 tablet_bootstrap.cc:492] T 70d027ba81f54eba882756b941186710 P f3a500981b494979b58d2b1041fec9c8: Bootstrap starting.
I20260709 13:23:14.464322 14782 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:36852
I20260709 13:23:14.468956 15761 tablet_bootstrap.cc:492] T 70d027ba81f54eba882756b941186710 P f3a500981b494979b58d2b1041fec9c8: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:23:14.469764 15892 heartbeater.cc:499] Master 127.5.126.126:45503 was elected leader, sending a full tablet report...
I20260709 13:23:14.471832 15761 tablet_bootstrap.cc:492] T 70d027ba81f54eba882756b941186710 P f3a500981b494979b58d2b1041fec9c8: Bootstrap complete.
I20260709 13:23:14.472678 15761 ts_tablet_manager.cc:1403] T 70d027ba81f54eba882756b941186710 P f3a500981b494979b58d2b1041fec9c8: Time spent bootstrapping tablet: real 0.026s	user 0.018s	sys 0.000s
I20260709 13:23:14.475757 15761 raft_consensus.cc:359] T 70d027ba81f54eba882756b941186710 P f3a500981b494979b58d2b1041fec9c8 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } } peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } } peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } }
I20260709 13:23:14.476574 15761 raft_consensus.cc:740] T 70d027ba81f54eba882756b941186710 P f3a500981b494979b58d2b1041fec9c8 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: f3a500981b494979b58d2b1041fec9c8, State: Initialized, Role: FOLLOWER
I20260709 13:23:14.477267 15761 consensus_queue.cc:260] T 70d027ba81f54eba882756b941186710 P f3a500981b494979b58d2b1041fec9c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } } peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } } peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } }
I20260709 13:23:14.479522 15761 ts_tablet_manager.cc:1434] T 70d027ba81f54eba882756b941186710 P f3a500981b494979b58d2b1041fec9c8: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:23:14.480449 15761 tablet_bootstrap.cc:492] T 7a4cf38d1a6644f082f401b9b26bfb27 P f3a500981b494979b58d2b1041fec9c8: Bootstrap starting.
I20260709 13:23:14.509754 15761 tablet_bootstrap.cc:492] T 7a4cf38d1a6644f082f401b9b26bfb27 P f3a500981b494979b58d2b1041fec9c8: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:23:14.510691 15761 tablet_bootstrap.cc:492] T 7a4cf38d1a6644f082f401b9b26bfb27 P f3a500981b494979b58d2b1041fec9c8: Bootstrap complete.
I20260709 13:23:14.511260 15761 ts_tablet_manager.cc:1403] T 7a4cf38d1a6644f082f401b9b26bfb27 P f3a500981b494979b58d2b1041fec9c8: Time spent bootstrapping tablet: real 0.031s	user 0.020s	sys 0.001s
I20260709 13:23:14.513633 15761 raft_consensus.cc:359] T 7a4cf38d1a6644f082f401b9b26bfb27 P f3a500981b494979b58d2b1041fec9c8 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } } peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } } peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } }
I20260709 13:23:14.514351 15761 raft_consensus.cc:740] T 7a4cf38d1a6644f082f401b9b26bfb27 P f3a500981b494979b58d2b1041fec9c8 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: f3a500981b494979b58d2b1041fec9c8, State: Initialized, Role: FOLLOWER
I20260709 13:23:14.515113 15761 consensus_queue.cc:260] T 7a4cf38d1a6644f082f401b9b26bfb27 P f3a500981b494979b58d2b1041fec9c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } } peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } } peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } }
I20260709 13:23:14.517319 15761 ts_tablet_manager.cc:1434] T 7a4cf38d1a6644f082f401b9b26bfb27 P f3a500981b494979b58d2b1041fec9c8: Time spent starting tablet: real 0.006s	user 0.008s	sys 0.000s
I20260709 13:23:14.518188 15761 tablet_bootstrap.cc:492] T 03b63e2bee374ed5931dab67ee14b555 P f3a500981b494979b58d2b1041fec9c8: Bootstrap starting.
W20260709 13:23:14.542721 14925 consensus_peers.cc:597] T e75f8237624f42f793627366f05b792a P 0efc951052454eec9a58b0cd025945b8 -> Peer f3a500981b494979b58d2b1041fec9c8 (127.5.126.65:34129): Couldn't send request to peer f3a500981b494979b58d2b1041fec9c8. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:23:14.556089 15761 tablet_bootstrap.cc:492] T 03b63e2bee374ed5931dab67ee14b555 P f3a500981b494979b58d2b1041fec9c8: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:23:14.557168 15761 tablet_bootstrap.cc:492] T 03b63e2bee374ed5931dab67ee14b555 P f3a500981b494979b58d2b1041fec9c8: Bootstrap complete.
I20260709 13:23:14.557881 15761 ts_tablet_manager.cc:1403] T 03b63e2bee374ed5931dab67ee14b555 P f3a500981b494979b58d2b1041fec9c8: Time spent bootstrapping tablet: real 0.040s	user 0.035s	sys 0.000s
W20260709 13:23:14.559983 14925 consensus_peers.cc:597] T 914c9c0c3be1486f8dcce382b61b5450 P 0efc951052454eec9a58b0cd025945b8 -> Peer f3a500981b494979b58d2b1041fec9c8 (127.5.126.65:34129): Couldn't send request to peer f3a500981b494979b58d2b1041fec9c8. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:23:14.560971 15761 raft_consensus.cc:359] T 03b63e2bee374ed5931dab67ee14b555 P f3a500981b494979b58d2b1041fec9c8 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } } peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } } peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } }
I20260709 13:23:14.561898 15761 raft_consensus.cc:740] T 03b63e2bee374ed5931dab67ee14b555 P f3a500981b494979b58d2b1041fec9c8 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: f3a500981b494979b58d2b1041fec9c8, State: Initialized, Role: FOLLOWER
I20260709 13:23:14.562755 15761 consensus_queue.cc:260] T 03b63e2bee374ed5931dab67ee14b555 P f3a500981b494979b58d2b1041fec9c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } } peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } } peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } }
I20260709 13:23:14.565740 15761 ts_tablet_manager.cc:1434] T 03b63e2bee374ed5931dab67ee14b555 P f3a500981b494979b58d2b1041fec9c8: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 13:23:14.566660 15761 tablet_bootstrap.cc:492] T dee43e01ec5d409b877a5c2dbf5b7b77 P f3a500981b494979b58d2b1041fec9c8: Bootstrap starting.
I20260709 13:23:14.583254 15761 tablet_bootstrap.cc:492] T dee43e01ec5d409b877a5c2dbf5b7b77 P f3a500981b494979b58d2b1041fec9c8: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:23:14.584322 15761 tablet_bootstrap.cc:492] T dee43e01ec5d409b877a5c2dbf5b7b77 P f3a500981b494979b58d2b1041fec9c8: Bootstrap complete.
I20260709 13:23:14.585112 15761 ts_tablet_manager.cc:1403] T dee43e01ec5d409b877a5c2dbf5b7b77 P f3a500981b494979b58d2b1041fec9c8: Time spent bootstrapping tablet: real 0.019s	user 0.016s	sys 0.000s
I20260709 13:23:14.588829 15761 raft_consensus.cc:359] T dee43e01ec5d409b877a5c2dbf5b7b77 P f3a500981b494979b58d2b1041fec9c8 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } } peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } } peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } }
I20260709 13:23:14.589581 15761 raft_consensus.cc:740] T dee43e01ec5d409b877a5c2dbf5b7b77 P f3a500981b494979b58d2b1041fec9c8 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: f3a500981b494979b58d2b1041fec9c8, State: Initialized, Role: FOLLOWER
I20260709 13:23:14.590245 15761 consensus_queue.cc:260] T dee43e01ec5d409b877a5c2dbf5b7b77 P f3a500981b494979b58d2b1041fec9c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } } peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } } peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } }
I20260709 13:23:14.592062 15761 ts_tablet_manager.cc:1434] T dee43e01ec5d409b877a5c2dbf5b7b77 P f3a500981b494979b58d2b1041fec9c8: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 13:23:14.592932 15761 tablet_bootstrap.cc:492] T e1ae79ed138a4950a681f24aa1107ef3 P f3a500981b494979b58d2b1041fec9c8: Bootstrap starting.
I20260709 13:23:14.625789 15761 tablet_bootstrap.cc:492] T e1ae79ed138a4950a681f24aa1107ef3 P f3a500981b494979b58d2b1041fec9c8: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:23:14.628345 15761 tablet_bootstrap.cc:492] T e1ae79ed138a4950a681f24aa1107ef3 P f3a500981b494979b58d2b1041fec9c8: Bootstrap complete.
I20260709 13:23:14.629326 15761 ts_tablet_manager.cc:1403] T e1ae79ed138a4950a681f24aa1107ef3 P f3a500981b494979b58d2b1041fec9c8: Time spent bootstrapping tablet: real 0.037s	user 0.014s	sys 0.018s
I20260709 13:23:14.632184 15761 raft_consensus.cc:359] T e1ae79ed138a4950a681f24aa1107ef3 P f3a500981b494979b58d2b1041fec9c8 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } } peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } } peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } }
I20260709 13:23:14.632936 15761 raft_consensus.cc:740] T e1ae79ed138a4950a681f24aa1107ef3 P f3a500981b494979b58d2b1041fec9c8 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: f3a500981b494979b58d2b1041fec9c8, State: Initialized, Role: FOLLOWER
I20260709 13:23:14.633685 15761 consensus_queue.cc:260] T e1ae79ed138a4950a681f24aa1107ef3 P f3a500981b494979b58d2b1041fec9c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } } peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } } peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } }
I20260709 13:23:14.635919 15761 ts_tablet_manager.cc:1434] T e1ae79ed138a4950a681f24aa1107ef3 P f3a500981b494979b58d2b1041fec9c8: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:23:14.636845 15761 tablet_bootstrap.cc:492] T 0819f8999271428481a1f839026171a7 P f3a500981b494979b58d2b1041fec9c8: Bootstrap starting.
I20260709 13:23:14.654742 15799 raft_consensus.cc:3060] T 03b63e2bee374ed5931dab67ee14b555 P f3a500981b494979b58d2b1041fec9c8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:23:14.656021 15761 tablet_bootstrap.cc:492] T 0819f8999271428481a1f839026171a7 P f3a500981b494979b58d2b1041fec9c8: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:23:14.657143 15761 tablet_bootstrap.cc:492] T 0819f8999271428481a1f839026171a7 P f3a500981b494979b58d2b1041fec9c8: Bootstrap complete.
I20260709 13:23:14.657835 15761 ts_tablet_manager.cc:1403] T 0819f8999271428481a1f839026171a7 P f3a500981b494979b58d2b1041fec9c8: Time spent bootstrapping tablet: real 0.021s	user 0.017s	sys 0.000s
I20260709 13:23:14.660478 15761 raft_consensus.cc:359] T 0819f8999271428481a1f839026171a7 P f3a500981b494979b58d2b1041fec9c8 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } } peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } } peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } }
I20260709 13:23:14.661190 15761 raft_consensus.cc:740] T 0819f8999271428481a1f839026171a7 P f3a500981b494979b58d2b1041fec9c8 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: f3a500981b494979b58d2b1041fec9c8, State: Initialized, Role: FOLLOWER
I20260709 13:23:14.662163 15761 consensus_queue.cc:260] T 0819f8999271428481a1f839026171a7 P f3a500981b494979b58d2b1041fec9c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } } peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } } peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } }
I20260709 13:23:14.664608 15761 ts_tablet_manager.cc:1434] T 0819f8999271428481a1f839026171a7 P f3a500981b494979b58d2b1041fec9c8: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 13:23:14.665544 15761 tablet_bootstrap.cc:492] T aecef3c240394d54844ec8170e9cad59 P f3a500981b494979b58d2b1041fec9c8: Bootstrap starting.
I20260709 13:23:14.701718 15761 tablet_bootstrap.cc:492] T aecef3c240394d54844ec8170e9cad59 P f3a500981b494979b58d2b1041fec9c8: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:23:14.702837 15761 tablet_bootstrap.cc:492] T aecef3c240394d54844ec8170e9cad59 P f3a500981b494979b58d2b1041fec9c8: Bootstrap complete.
I20260709 13:23:14.703609 15761 ts_tablet_manager.cc:1403] T aecef3c240394d54844ec8170e9cad59 P f3a500981b494979b58d2b1041fec9c8: Time spent bootstrapping tablet: real 0.038s	user 0.028s	sys 0.007s
I20260709 13:23:14.706518 15761 raft_consensus.cc:359] T aecef3c240394d54844ec8170e9cad59 P f3a500981b494979b58d2b1041fec9c8 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } } peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } } peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } }
I20260709 13:23:14.707216 15761 raft_consensus.cc:740] T aecef3c240394d54844ec8170e9cad59 P f3a500981b494979b58d2b1041fec9c8 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: f3a500981b494979b58d2b1041fec9c8, State: Initialized, Role: FOLLOWER
I20260709 13:23:14.707935 15761 consensus_queue.cc:260] T aecef3c240394d54844ec8170e9cad59 P f3a500981b494979b58d2b1041fec9c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } } peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } } peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } }
I20260709 13:23:14.710108 15761 ts_tablet_manager.cc:1434] T aecef3c240394d54844ec8170e9cad59 P f3a500981b494979b58d2b1041fec9c8: Time spent starting tablet: real 0.006s	user 0.002s	sys 0.003s
I20260709 13:23:14.711023 15761 tablet_bootstrap.cc:492] T 268027ae94a54cf4acf51c54c7b9032b P f3a500981b494979b58d2b1041fec9c8: Bootstrap starting.
I20260709 13:23:14.716491 15799 raft_consensus.cc:3060] T dee43e01ec5d409b877a5c2dbf5b7b77 P f3a500981b494979b58d2b1041fec9c8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:23:14.755404 15761 tablet_bootstrap.cc:492] T 268027ae94a54cf4acf51c54c7b9032b P f3a500981b494979b58d2b1041fec9c8: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:23:14.756532 15761 tablet_bootstrap.cc:492] T 268027ae94a54cf4acf51c54c7b9032b P f3a500981b494979b58d2b1041fec9c8: Bootstrap complete.
I20260709 13:23:14.757237 15761 ts_tablet_manager.cc:1403] T 268027ae94a54cf4acf51c54c7b9032b P f3a500981b494979b58d2b1041fec9c8: Time spent bootstrapping tablet: real 0.046s	user 0.030s	sys 0.008s
I20260709 13:23:14.759963 15761 raft_consensus.cc:359] T 268027ae94a54cf4acf51c54c7b9032b P f3a500981b494979b58d2b1041fec9c8 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } } peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } } peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } }
I20260709 13:23:14.760692 15761 raft_consensus.cc:740] T 268027ae94a54cf4acf51c54c7b9032b P f3a500981b494979b58d2b1041fec9c8 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: f3a500981b494979b58d2b1041fec9c8, State: Initialized, Role: FOLLOWER
I20260709 13:23:14.761519 15761 consensus_queue.cc:260] T 268027ae94a54cf4acf51c54c7b9032b P f3a500981b494979b58d2b1041fec9c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } } peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } } peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } }
I20260709 13:23:14.764081 15761 ts_tablet_manager.cc:1434] T 268027ae94a54cf4acf51c54c7b9032b P f3a500981b494979b58d2b1041fec9c8: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:23:14.765447 15761 tablet_bootstrap.cc:492] T 77e8d8b35cf148e99e8274bf65e5ed05 P f3a500981b494979b58d2b1041fec9c8: Bootstrap starting.
I20260709 13:23:14.779780 15799 raft_consensus.cc:3060] T b0b7e1c1e67845cb9bd2208bb2fb7c21 P f3a500981b494979b58d2b1041fec9c8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:23:14.784096 15805 raft_consensus.cc:3060] T 70d027ba81f54eba882756b941186710 P f3a500981b494979b58d2b1041fec9c8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:23:14.784354 15761 tablet_bootstrap.cc:492] T 77e8d8b35cf148e99e8274bf65e5ed05 P f3a500981b494979b58d2b1041fec9c8: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:23:14.786597 15761 tablet_bootstrap.cc:492] T 77e8d8b35cf148e99e8274bf65e5ed05 P f3a500981b494979b58d2b1041fec9c8: Bootstrap complete.
I20260709 13:23:14.787335 15761 ts_tablet_manager.cc:1403] T 77e8d8b35cf148e99e8274bf65e5ed05 P f3a500981b494979b58d2b1041fec9c8: Time spent bootstrapping tablet: real 0.022s	user 0.013s	sys 0.006s
I20260709 13:23:14.790405 15761 raft_consensus.cc:359] T 77e8d8b35cf148e99e8274bf65e5ed05 P f3a500981b494979b58d2b1041fec9c8 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } } peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } } peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } }
I20260709 13:23:14.791121 15761 raft_consensus.cc:740] T 77e8d8b35cf148e99e8274bf65e5ed05 P f3a500981b494979b58d2b1041fec9c8 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: f3a500981b494979b58d2b1041fec9c8, State: Initialized, Role: FOLLOWER
I20260709 13:23:14.791877 15761 consensus_queue.cc:260] T 77e8d8b35cf148e99e8274bf65e5ed05 P f3a500981b494979b58d2b1041fec9c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } } peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } } peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } }
I20260709 13:23:14.794596 15761 ts_tablet_manager.cc:1434] T 77e8d8b35cf148e99e8274bf65e5ed05 P f3a500981b494979b58d2b1041fec9c8: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.004s
I20260709 13:23:14.795524 15761 tablet_bootstrap.cc:492] T d64d06459b344ff99c0df07c249c3a60 P f3a500981b494979b58d2b1041fec9c8: Bootstrap starting.
I20260709 13:23:14.819049 15761 tablet_bootstrap.cc:492] T d64d06459b344ff99c0df07c249c3a60 P f3a500981b494979b58d2b1041fec9c8: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:23:14.820075 15761 tablet_bootstrap.cc:492] T d64d06459b344ff99c0df07c249c3a60 P f3a500981b494979b58d2b1041fec9c8: Bootstrap complete.
I20260709 13:23:14.820786 15761 ts_tablet_manager.cc:1403] T d64d06459b344ff99c0df07c249c3a60 P f3a500981b494979b58d2b1041fec9c8: Time spent bootstrapping tablet: real 0.026s	user 0.015s	sys 0.004s
I20260709 13:23:14.823467 15761 raft_consensus.cc:359] T d64d06459b344ff99c0df07c249c3a60 P f3a500981b494979b58d2b1041fec9c8 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } } peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } } peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } }
I20260709 13:23:14.824149 15761 raft_consensus.cc:740] T d64d06459b344ff99c0df07c249c3a60 P f3a500981b494979b58d2b1041fec9c8 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: f3a500981b494979b58d2b1041fec9c8, State: Initialized, Role: FOLLOWER
I20260709 13:23:14.824957 15761 consensus_queue.cc:260] T d64d06459b344ff99c0df07c249c3a60 P f3a500981b494979b58d2b1041fec9c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } } peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } } peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } }
I20260709 13:23:14.827318 15761 ts_tablet_manager.cc:1434] T d64d06459b344ff99c0df07c249c3a60 P f3a500981b494979b58d2b1041fec9c8: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 13:23:14.828274 15761 tablet_bootstrap.cc:492] T d65eaa0ab4574a1ea92b3848d4dc9c4d P f3a500981b494979b58d2b1041fec9c8: Bootstrap starting.
I20260709 13:23:14.943877 15761 tablet_bootstrap.cc:492] T d65eaa0ab4574a1ea92b3848d4dc9c4d P f3a500981b494979b58d2b1041fec9c8: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:23:14.944996 15761 tablet_bootstrap.cc:492] T d65eaa0ab4574a1ea92b3848d4dc9c4d P f3a500981b494979b58d2b1041fec9c8: Bootstrap complete.
I20260709 13:23:14.945780 15761 ts_tablet_manager.cc:1403] T d65eaa0ab4574a1ea92b3848d4dc9c4d P f3a500981b494979b58d2b1041fec9c8: Time spent bootstrapping tablet: real 0.118s	user 0.012s	sys 0.010s
I20260709 13:23:14.948581 15761 raft_consensus.cc:359] T d65eaa0ab4574a1ea92b3848d4dc9c4d P f3a500981b494979b58d2b1041fec9c8 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } } peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } } peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } }
I20260709 13:23:14.949263 15761 raft_consensus.cc:740] T d65eaa0ab4574a1ea92b3848d4dc9c4d P f3a500981b494979b58d2b1041fec9c8 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: f3a500981b494979b58d2b1041fec9c8, State: Initialized, Role: FOLLOWER
I20260709 13:23:14.949976 15761 consensus_queue.cc:260] T d65eaa0ab4574a1ea92b3848d4dc9c4d P f3a500981b494979b58d2b1041fec9c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } } peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } } peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } }
I20260709 13:23:14.951835 15761 ts_tablet_manager.cc:1434] T d65eaa0ab4574a1ea92b3848d4dc9c4d P f3a500981b494979b58d2b1041fec9c8: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.001s
I20260709 13:23:14.952713 15761 tablet_bootstrap.cc:492] T e3693e8a3b0444bf978dc845dcfd2a45 P f3a500981b494979b58d2b1041fec9c8: Bootstrap starting.
W20260709 13:23:14.962944 15073 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.65:34129, user_credentials={real_user=slave}} blocked reactor thread for 114473us
I20260709 13:23:15.003783 15761 tablet_bootstrap.cc:492] T e3693e8a3b0444bf978dc845dcfd2a45 P f3a500981b494979b58d2b1041fec9c8: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:23:15.004885 15761 tablet_bootstrap.cc:492] T e3693e8a3b0444bf978dc845dcfd2a45 P f3a500981b494979b58d2b1041fec9c8: Bootstrap complete.
I20260709 13:23:15.005638 15761 ts_tablet_manager.cc:1403] T e3693e8a3b0444bf978dc845dcfd2a45 P f3a500981b494979b58d2b1041fec9c8: Time spent bootstrapping tablet: real 0.053s	user 0.010s	sys 0.009s
I20260709 13:23:15.008912 15761 raft_consensus.cc:359] T e3693e8a3b0444bf978dc845dcfd2a45 P f3a500981b494979b58d2b1041fec9c8 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } } peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } } peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } }
I20260709 13:23:15.012171 15761 raft_consensus.cc:740] T e3693e8a3b0444bf978dc845dcfd2a45 P f3a500981b494979b58d2b1041fec9c8 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: f3a500981b494979b58d2b1041fec9c8, State: Initialized, Role: FOLLOWER
I20260709 13:23:15.013171 15761 consensus_queue.cc:260] T e3693e8a3b0444bf978dc845dcfd2a45 P f3a500981b494979b58d2b1041fec9c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } } peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } } peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } }
I20260709 13:23:15.015655 15761 ts_tablet_manager.cc:1434] T e3693e8a3b0444bf978dc845dcfd2a45 P f3a500981b494979b58d2b1041fec9c8: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.000s
I20260709 13:23:15.019220 15761 tablet_bootstrap.cc:492] T e85432ede09747339c957cdaa7d15ac6 P f3a500981b494979b58d2b1041fec9c8: Bootstrap starting.
I20260709 13:23:15.039400 15761 tablet_bootstrap.cc:492] T e85432ede09747339c957cdaa7d15ac6 P f3a500981b494979b58d2b1041fec9c8: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:23:15.040457 15761 tablet_bootstrap.cc:492] T e85432ede09747339c957cdaa7d15ac6 P f3a500981b494979b58d2b1041fec9c8: Bootstrap complete.
I20260709 13:23:15.041134 15761 ts_tablet_manager.cc:1403] T e85432ede09747339c957cdaa7d15ac6 P f3a500981b494979b58d2b1041fec9c8: Time spent bootstrapping tablet: real 0.022s	user 0.015s	sys 0.003s
I20260709 13:23:15.043653 15761 raft_consensus.cc:359] T e85432ede09747339c957cdaa7d15ac6 P f3a500981b494979b58d2b1041fec9c8 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } } peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } } peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } }
I20260709 13:23:15.044358 15761 raft_consensus.cc:740] T e85432ede09747339c957cdaa7d15ac6 P f3a500981b494979b58d2b1041fec9c8 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: f3a500981b494979b58d2b1041fec9c8, State: Initialized, Role: FOLLOWER
I20260709 13:23:15.045010 15761 consensus_queue.cc:260] T e85432ede09747339c957cdaa7d15ac6 P f3a500981b494979b58d2b1041fec9c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } } peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } } peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } }
I20260709 13:23:15.047258 15761 ts_tablet_manager.cc:1434] T e85432ede09747339c957cdaa7d15ac6 P f3a500981b494979b58d2b1041fec9c8: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:23:15.048295 15761 tablet_bootstrap.cc:492] T 5df7528567fd4291a888bfb37c28dc27 P f3a500981b494979b58d2b1041fec9c8: Bootstrap starting.
I20260709 13:23:15.064832 15761 tablet_bootstrap.cc:492] T 5df7528567fd4291a888bfb37c28dc27 P f3a500981b494979b58d2b1041fec9c8: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:23:15.065804 15761 tablet_bootstrap.cc:492] T 5df7528567fd4291a888bfb37c28dc27 P f3a500981b494979b58d2b1041fec9c8: Bootstrap complete.
I20260709 13:23:15.066468 15761 ts_tablet_manager.cc:1403] T 5df7528567fd4291a888bfb37c28dc27 P f3a500981b494979b58d2b1041fec9c8: Time spent bootstrapping tablet: real 0.018s	user 0.011s	sys 0.004s
I20260709 13:23:15.068995 15761 raft_consensus.cc:359] T 5df7528567fd4291a888bfb37c28dc27 P f3a500981b494979b58d2b1041fec9c8 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } } peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } } peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } }
I20260709 13:23:15.069684 15761 raft_consensus.cc:740] T 5df7528567fd4291a888bfb37c28dc27 P f3a500981b494979b58d2b1041fec9c8 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: f3a500981b494979b58d2b1041fec9c8, State: Initialized, Role: FOLLOWER
I20260709 13:23:15.070398 15761 consensus_queue.cc:260] T 5df7528567fd4291a888bfb37c28dc27 P f3a500981b494979b58d2b1041fec9c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } } peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } } peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } }
I20260709 13:23:15.072413 15761 ts_tablet_manager.cc:1434] T 5df7528567fd4291a888bfb37c28dc27 P f3a500981b494979b58d2b1041fec9c8: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.001s
I20260709 13:23:15.073691 15761 tablet_bootstrap.cc:492] T e75f8237624f42f793627366f05b792a P f3a500981b494979b58d2b1041fec9c8: Bootstrap starting.
I20260709 13:23:15.088020 15761 tablet_bootstrap.cc:492] T e75f8237624f42f793627366f05b792a P f3a500981b494979b58d2b1041fec9c8: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:23:15.090281 15761 tablet_bootstrap.cc:492] T e75f8237624f42f793627366f05b792a P f3a500981b494979b58d2b1041fec9c8: Bootstrap complete.
I20260709 13:23:15.091058 15761 ts_tablet_manager.cc:1403] T e75f8237624f42f793627366f05b792a P f3a500981b494979b58d2b1041fec9c8: Time spent bootstrapping tablet: real 0.018s	user 0.014s	sys 0.000s
I20260709 13:23:15.094264 15761 raft_consensus.cc:359] T e75f8237624f42f793627366f05b792a P f3a500981b494979b58d2b1041fec9c8 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } } peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } } peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } }
I20260709 13:23:15.095033 15761 raft_consensus.cc:740] T e75f8237624f42f793627366f05b792a P f3a500981b494979b58d2b1041fec9c8 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: f3a500981b494979b58d2b1041fec9c8, State: Initialized, Role: FOLLOWER
I20260709 13:23:15.095642 15761 consensus_queue.cc:260] T e75f8237624f42f793627366f05b792a P f3a500981b494979b58d2b1041fec9c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } } peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } } peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } }
I20260709 13:23:15.098179 15761 ts_tablet_manager.cc:1434] T e75f8237624f42f793627366f05b792a P f3a500981b494979b58d2b1041fec9c8: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:23:15.099061 15761 tablet_bootstrap.cc:492] T 914c9c0c3be1486f8dcce382b61b5450 P f3a500981b494979b58d2b1041fec9c8: Bootstrap starting.
I20260709 13:23:15.115612 15761 tablet_bootstrap.cc:492] T 914c9c0c3be1486f8dcce382b61b5450 P f3a500981b494979b58d2b1041fec9c8: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:23:15.116655 15761 tablet_bootstrap.cc:492] T 914c9c0c3be1486f8dcce382b61b5450 P f3a500981b494979b58d2b1041fec9c8: Bootstrap complete.
I20260709 13:23:15.117439 15761 ts_tablet_manager.cc:1403] T 914c9c0c3be1486f8dcce382b61b5450 P f3a500981b494979b58d2b1041fec9c8: Time spent bootstrapping tablet: real 0.019s	user 0.014s	sys 0.002s
I20260709 13:23:15.120173 15761 raft_consensus.cc:359] T 914c9c0c3be1486f8dcce382b61b5450 P f3a500981b494979b58d2b1041fec9c8 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } } peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } } peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } }
I20260709 13:23:15.120764 15761 raft_consensus.cc:740] T 914c9c0c3be1486f8dcce382b61b5450 P f3a500981b494979b58d2b1041fec9c8 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: f3a500981b494979b58d2b1041fec9c8, State: Initialized, Role: FOLLOWER
I20260709 13:23:15.121323 15761 consensus_queue.cc:260] T 914c9c0c3be1486f8dcce382b61b5450 P f3a500981b494979b58d2b1041fec9c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } } peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } } peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } }
I20260709 13:23:15.123209 15761 ts_tablet_manager.cc:1434] T 914c9c0c3be1486f8dcce382b61b5450 P f3a500981b494979b58d2b1041fec9c8: Time spent starting tablet: real 0.005s	user 0.002s	sys 0.000s
I20260709 13:23:15.124506 15761 tablet_bootstrap.cc:492] T 107541237b4a452e8b47b0c3527b7ede P f3a500981b494979b58d2b1041fec9c8: Bootstrap starting.
I20260709 13:23:15.141141 15761 tablet_bootstrap.cc:492] T 107541237b4a452e8b47b0c3527b7ede P f3a500981b494979b58d2b1041fec9c8: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:23:15.142117 15761 tablet_bootstrap.cc:492] T 107541237b4a452e8b47b0c3527b7ede P f3a500981b494979b58d2b1041fec9c8: Bootstrap complete.
I20260709 13:23:15.142707 15761 ts_tablet_manager.cc:1403] T 107541237b4a452e8b47b0c3527b7ede P f3a500981b494979b58d2b1041fec9c8: Time spent bootstrapping tablet: real 0.018s	user 0.011s	sys 0.004s
I20260709 13:23:15.144819 15761 raft_consensus.cc:359] T 107541237b4a452e8b47b0c3527b7ede P f3a500981b494979b58d2b1041fec9c8 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } } peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } } peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } }
I20260709 13:23:15.145358 15761 raft_consensus.cc:740] T 107541237b4a452e8b47b0c3527b7ede P f3a500981b494979b58d2b1041fec9c8 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: f3a500981b494979b58d2b1041fec9c8, State: Initialized, Role: FOLLOWER
I20260709 13:23:15.145992 15761 consensus_queue.cc:260] T 107541237b4a452e8b47b0c3527b7ede P f3a500981b494979b58d2b1041fec9c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } } peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } } peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } }
I20260709 13:23:15.147652 15761 ts_tablet_manager.cc:1434] T 107541237b4a452e8b47b0c3527b7ede P f3a500981b494979b58d2b1041fec9c8: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:23:15.148772 15761 tablet_bootstrap.cc:492] T a71163721b4d48b0b5ff366b9d12ac32 P f3a500981b494979b58d2b1041fec9c8: Bootstrap starting.
I20260709 13:23:15.165680 15761 tablet_bootstrap.cc:492] T a71163721b4d48b0b5ff366b9d12ac32 P f3a500981b494979b58d2b1041fec9c8: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:23:15.167635 15761 tablet_bootstrap.cc:492] T a71163721b4d48b0b5ff366b9d12ac32 P f3a500981b494979b58d2b1041fec9c8: Bootstrap complete.
I20260709 13:23:15.168435 15761 ts_tablet_manager.cc:1403] T a71163721b4d48b0b5ff366b9d12ac32 P f3a500981b494979b58d2b1041fec9c8: Time spent bootstrapping tablet: real 0.020s	user 0.010s	sys 0.007s
I20260709 13:23:15.173671 15761 raft_consensus.cc:359] T a71163721b4d48b0b5ff366b9d12ac32 P f3a500981b494979b58d2b1041fec9c8 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } } peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } } peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } }
I20260709 13:23:15.174471 15761 raft_consensus.cc:740] T a71163721b4d48b0b5ff366b9d12ac32 P f3a500981b494979b58d2b1041fec9c8 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: f3a500981b494979b58d2b1041fec9c8, State: Initialized, Role: FOLLOWER
I20260709 13:23:15.175266 15761 consensus_queue.cc:260] T a71163721b4d48b0b5ff366b9d12ac32 P f3a500981b494979b58d2b1041fec9c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } } peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } } peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } }
I20260709 13:23:15.177819 15761 ts_tablet_manager.cc:1434] T a71163721b4d48b0b5ff366b9d12ac32 P f3a500981b494979b58d2b1041fec9c8: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.000s
I20260709 13:23:15.178696 15761 tablet_bootstrap.cc:492] T e4f2c694c8194f1e86ad76c7ff051ea7 P f3a500981b494979b58d2b1041fec9c8: Bootstrap starting.
I20260709 13:23:15.203559 15761 tablet_bootstrap.cc:492] T e4f2c694c8194f1e86ad76c7ff051ea7 P f3a500981b494979b58d2b1041fec9c8: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:23:15.204774 15761 tablet_bootstrap.cc:492] T e4f2c694c8194f1e86ad76c7ff051ea7 P f3a500981b494979b58d2b1041fec9c8: Bootstrap complete.
I20260709 13:23:15.205581 15761 ts_tablet_manager.cc:1403] T e4f2c694c8194f1e86ad76c7ff051ea7 P f3a500981b494979b58d2b1041fec9c8: Time spent bootstrapping tablet: real 0.027s	user 0.014s	sys 0.008s
I20260709 13:23:15.208598 15761 raft_consensus.cc:359] T e4f2c694c8194f1e86ad76c7ff051ea7 P f3a500981b494979b58d2b1041fec9c8 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } } peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } } peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } }
I20260709 13:23:15.209355 15761 raft_consensus.cc:740] T e4f2c694c8194f1e86ad76c7ff051ea7 P f3a500981b494979b58d2b1041fec9c8 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: f3a500981b494979b58d2b1041fec9c8, State: Initialized, Role: FOLLOWER
I20260709 13:23:15.210063 15761 consensus_queue.cc:260] T e4f2c694c8194f1e86ad76c7ff051ea7 P f3a500981b494979b58d2b1041fec9c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } } peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } } peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } }
I20260709 13:23:15.212347 15761 ts_tablet_manager.cc:1434] T e4f2c694c8194f1e86ad76c7ff051ea7 P f3a500981b494979b58d2b1041fec9c8: Time spent starting tablet: real 0.006s	user 0.008s	sys 0.000s
I20260709 13:23:15.213843 15761 tablet_bootstrap.cc:492] T 08dea3083d334745abe54f9b220bd86a P f3a500981b494979b58d2b1041fec9c8: Bootstrap starting.
I20260709 13:23:15.232335 15761 tablet_bootstrap.cc:492] T 08dea3083d334745abe54f9b220bd86a P f3a500981b494979b58d2b1041fec9c8: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:23:15.233558 15761 tablet_bootstrap.cc:492] T 08dea3083d334745abe54f9b220bd86a P f3a500981b494979b58d2b1041fec9c8: Bootstrap complete.
I20260709 13:23:15.238135 15761 ts_tablet_manager.cc:1403] T 08dea3083d334745abe54f9b220bd86a P f3a500981b494979b58d2b1041fec9c8: Time spent bootstrapping tablet: real 0.025s	user 0.014s	sys 0.005s
I20260709 13:23:15.243949 15761 raft_consensus.cc:359] T 08dea3083d334745abe54f9b220bd86a P f3a500981b494979b58d2b1041fec9c8 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } } peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } } peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } }
I20260709 13:23:15.246522 15761 raft_consensus.cc:740] T 08dea3083d334745abe54f9b220bd86a P f3a500981b494979b58d2b1041fec9c8 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: f3a500981b494979b58d2b1041fec9c8, State: Initialized, Role: FOLLOWER
I20260709 13:23:15.247766 15761 consensus_queue.cc:260] T 08dea3083d334745abe54f9b220bd86a P f3a500981b494979b58d2b1041fec9c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } } peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } } peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } }
I20260709 13:23:15.250102 15761 ts_tablet_manager.cc:1434] T 08dea3083d334745abe54f9b220bd86a P f3a500981b494979b58d2b1041fec9c8: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.000s
I20260709 13:23:15.251224 15761 tablet_bootstrap.cc:492] T 58a622a48cd24833bc5fc27e03114176 P f3a500981b494979b58d2b1041fec9c8: Bootstrap starting.
I20260709 13:23:15.254851 15799 raft_consensus.cc:3060] T aecef3c240394d54844ec8170e9cad59 P f3a500981b494979b58d2b1041fec9c8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:23:15.285318 15761 tablet_bootstrap.cc:492] T 58a622a48cd24833bc5fc27e03114176 P f3a500981b494979b58d2b1041fec9c8: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:23:15.286569 15761 tablet_bootstrap.cc:492] T 58a622a48cd24833bc5fc27e03114176 P f3a500981b494979b58d2b1041fec9c8: Bootstrap complete.
I20260709 13:23:15.287432 15761 ts_tablet_manager.cc:1403] T 58a622a48cd24833bc5fc27e03114176 P f3a500981b494979b58d2b1041fec9c8: Time spent bootstrapping tablet: real 0.036s	user 0.014s	sys 0.009s
I20260709 13:23:15.287747 15797 raft_consensus.cc:3060] T 107541237b4a452e8b47b0c3527b7ede P f3a500981b494979b58d2b1041fec9c8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:23:15.291342 15761 raft_consensus.cc:359] T 58a622a48cd24833bc5fc27e03114176 P f3a500981b494979b58d2b1041fec9c8 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } } peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } } peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } }
I20260709 13:23:15.292279 15761 raft_consensus.cc:740] T 58a622a48cd24833bc5fc27e03114176 P f3a500981b494979b58d2b1041fec9c8 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: f3a500981b494979b58d2b1041fec9c8, State: Initialized, Role: FOLLOWER
I20260709 13:23:15.293272 15761 consensus_queue.cc:260] T 58a622a48cd24833bc5fc27e03114176 P f3a500981b494979b58d2b1041fec9c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } } peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } } peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } }
I20260709 13:23:15.300184 15761 ts_tablet_manager.cc:1434] T 58a622a48cd24833bc5fc27e03114176 P f3a500981b494979b58d2b1041fec9c8: Time spent starting tablet: real 0.012s	user 0.009s	sys 0.001s
I20260709 13:23:15.303704 15761 tablet_bootstrap.cc:492] T 7560205f5d324c7d821dff8efe7a6256 P f3a500981b494979b58d2b1041fec9c8: Bootstrap starting.
I20260709 13:23:15.326902 15805 raft_consensus.cc:3060] T e85432ede09747339c957cdaa7d15ac6 P f3a500981b494979b58d2b1041fec9c8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:23:15.375195 15806 raft_consensus.cc:3060] T a71163721b4d48b0b5ff366b9d12ac32 P f3a500981b494979b58d2b1041fec9c8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:23:15.419754 15761 tablet_bootstrap.cc:492] T 7560205f5d324c7d821dff8efe7a6256 P f3a500981b494979b58d2b1041fec9c8: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:23:15.420864 15761 tablet_bootstrap.cc:492] T 7560205f5d324c7d821dff8efe7a6256 P f3a500981b494979b58d2b1041fec9c8: Bootstrap complete.
I20260709 13:23:15.421591 15761 ts_tablet_manager.cc:1403] T 7560205f5d324c7d821dff8efe7a6256 P f3a500981b494979b58d2b1041fec9c8: Time spent bootstrapping tablet: real 0.118s	user 0.021s	sys 0.025s
I20260709 13:23:15.424441 15761 raft_consensus.cc:359] T 7560205f5d324c7d821dff8efe7a6256 P f3a500981b494979b58d2b1041fec9c8 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } } peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } } peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } }
I20260709 13:23:15.425416 15761 raft_consensus.cc:740] T 7560205f5d324c7d821dff8efe7a6256 P f3a500981b494979b58d2b1041fec9c8 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: f3a500981b494979b58d2b1041fec9c8, State: Initialized, Role: FOLLOWER
I20260709 13:23:15.426541 15761 consensus_queue.cc:260] T 7560205f5d324c7d821dff8efe7a6256 P f3a500981b494979b58d2b1041fec9c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } } peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } } peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } }
I20260709 13:23:15.429196 15761 ts_tablet_manager.cc:1434] T 7560205f5d324c7d821dff8efe7a6256 P f3a500981b494979b58d2b1041fec9c8: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:23:15.430523 15761 tablet_bootstrap.cc:492] T f954c6c25a25443abd9705c8e909bf47 P f3a500981b494979b58d2b1041fec9c8: Bootstrap starting.
I20260709 13:23:15.446924 15761 tablet_bootstrap.cc:492] T f954c6c25a25443abd9705c8e909bf47 P f3a500981b494979b58d2b1041fec9c8: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:23:15.447954 15761 tablet_bootstrap.cc:492] T f954c6c25a25443abd9705c8e909bf47 P f3a500981b494979b58d2b1041fec9c8: Bootstrap complete.
I20260709 13:23:15.448762 15761 ts_tablet_manager.cc:1403] T f954c6c25a25443abd9705c8e909bf47 P f3a500981b494979b58d2b1041fec9c8: Time spent bootstrapping tablet: real 0.018s	user 0.014s	sys 0.003s
I20260709 13:23:15.451687 15761 raft_consensus.cc:359] T f954c6c25a25443abd9705c8e909bf47 P f3a500981b494979b58d2b1041fec9c8 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } } peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } } peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } }
I20260709 13:23:15.452415 15761 raft_consensus.cc:740] T f954c6c25a25443abd9705c8e909bf47 P f3a500981b494979b58d2b1041fec9c8 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: f3a500981b494979b58d2b1041fec9c8, State: Initialized, Role: FOLLOWER
I20260709 13:23:15.453091 15761 consensus_queue.cc:260] T f954c6c25a25443abd9705c8e909bf47 P f3a500981b494979b58d2b1041fec9c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } } peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } } peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } }
I20260709 13:23:15.454778 15761 ts_tablet_manager.cc:1434] T f954c6c25a25443abd9705c8e909bf47 P f3a500981b494979b58d2b1041fec9c8: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:23:15.455751 15761 tablet_bootstrap.cc:492] T 2a862e106a9e48a692bc72ea8c03ab39 P f3a500981b494979b58d2b1041fec9c8: Bootstrap starting.
I20260709 13:23:15.471477 15761 tablet_bootstrap.cc:492] T 2a862e106a9e48a692bc72ea8c03ab39 P f3a500981b494979b58d2b1041fec9c8: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:23:15.472383 15761 tablet_bootstrap.cc:492] T 2a862e106a9e48a692bc72ea8c03ab39 P f3a500981b494979b58d2b1041fec9c8: Bootstrap complete.
I20260709 13:23:15.472994 15761 ts_tablet_manager.cc:1403] T 2a862e106a9e48a692bc72ea8c03ab39 P f3a500981b494979b58d2b1041fec9c8: Time spent bootstrapping tablet: real 0.017s	user 0.015s	sys 0.000s
I20260709 13:23:15.475370 15761 raft_consensus.cc:359] T 2a862e106a9e48a692bc72ea8c03ab39 P f3a500981b494979b58d2b1041fec9c8 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } } peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } } peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } }
I20260709 13:23:15.475919 15761 raft_consensus.cc:740] T 2a862e106a9e48a692bc72ea8c03ab39 P f3a500981b494979b58d2b1041fec9c8 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: f3a500981b494979b58d2b1041fec9c8, State: Initialized, Role: FOLLOWER
I20260709 13:23:15.476643 15761 consensus_queue.cc:260] T 2a862e106a9e48a692bc72ea8c03ab39 P f3a500981b494979b58d2b1041fec9c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } } peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } } peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } }
I20260709 13:23:15.478678 15761 ts_tablet_manager.cc:1434] T 2a862e106a9e48a692bc72ea8c03ab39 P f3a500981b494979b58d2b1041fec9c8: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:23:15.624993 15806 raft_consensus.cc:3060] T 58a622a48cd24833bc5fc27e03114176 P f3a500981b494979b58d2b1041fec9c8 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:23:20.464278 14925 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.65:34129, user_credentials={real_user=slave}} blocked reactor thread for 63824.5us
W20260709 13:23:20.645395 14999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.68:46669, user_credentials={real_user=slave}} blocked reactor thread for 55915us
I20260709 13:23:23.507977  5625 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:23:23.567507 14960 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "08dea3083d334745abe54f9b220bd86a"
dest_uuid: "0efc951052454eec9a58b0cd025945b8"
mode: GRACEFUL
new_leader_uuid: "f3a500981b494979b58d2b1041fec9c8"
 from {username='slave'} at 127.0.0.1:49056
I20260709 13:23:23.568507 14960 raft_consensus.cc:606] T 08dea3083d334745abe54f9b220bd86a P 0efc951052454eec9a58b0cd025945b8 [term 1 LEADER]: Received request to transfer leadership to TS f3a500981b494979b58d2b1041fec9c8
I20260709 13:23:23.571684 14960 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2a862e106a9e48a692bc72ea8c03ab39"
dest_uuid: "0efc951052454eec9a58b0cd025945b8"
mode: GRACEFUL
new_leader_uuid: "f3a500981b494979b58d2b1041fec9c8"
 from {username='slave'} at 127.0.0.1:49056
I20260709 13:23:23.572244 14960 raft_consensus.cc:606] T 2a862e106a9e48a692bc72ea8c03ab39 P 0efc951052454eec9a58b0cd025945b8 [term 1 LEADER]: Received request to transfer leadership to TS f3a500981b494979b58d2b1041fec9c8
I20260709 13:23:23.574767 14960 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "532cc9041f414e018098570192e0fae8"
dest_uuid: "0efc951052454eec9a58b0cd025945b8"
mode: GRACEFUL
new_leader_uuid: "f3a500981b494979b58d2b1041fec9c8"
 from {username='slave'} at 127.0.0.1:49056
I20260709 13:23:23.575256 14960 raft_consensus.cc:606] T 532cc9041f414e018098570192e0fae8 P 0efc951052454eec9a58b0cd025945b8 [term 2 LEADER]: Received request to transfer leadership to TS f3a500981b494979b58d2b1041fec9c8
I20260709 13:23:23.577750 14960 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "58a622a48cd24833bc5fc27e03114176"
dest_uuid: "0efc951052454eec9a58b0cd025945b8"
mode: GRACEFUL
new_leader_uuid: "f3a500981b494979b58d2b1041fec9c8"
 from {username='slave'} at 127.0.0.1:49056
I20260709 13:23:23.578202 14960 raft_consensus.cc:606] T 58a622a48cd24833bc5fc27e03114176 P 0efc951052454eec9a58b0cd025945b8 [term 2 LEADER]: Received request to transfer leadership to TS f3a500981b494979b58d2b1041fec9c8
I20260709 13:23:23.591409 15107 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d64d06459b344ff99c0df07c249c3a60"
dest_uuid: "a722e54d227f4c29a9ed6ce77858003a"
mode: GRACEFUL
new_leader_uuid: "f3a500981b494979b58d2b1041fec9c8"
 from {username='slave'} at 127.0.0.1:42994
I20260709 13:23:23.592007 15107 raft_consensus.cc:606] T d64d06459b344ff99c0df07c249c3a60 P a722e54d227f4c29a9ed6ce77858003a [term 1 LEADER]: Received request to transfer leadership to TS f3a500981b494979b58d2b1041fec9c8
I20260709 13:23:23.606261 15033 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "dadd194761924530aede05672c9eecf9"
dest_uuid: "a1a22e9119494570b6d2217713fd7e43"
mode: GRACEFUL
new_leader_uuid: "f3a500981b494979b58d2b1041fec9c8"
 from {username='slave'} at 127.0.0.1:59976
I20260709 13:23:23.606813 15033 raft_consensus.cc:606] T dadd194761924530aede05672c9eecf9 P a1a22e9119494570b6d2217713fd7e43 [term 1 LEADER]: Received request to transfer leadership to TS f3a500981b494979b58d2b1041fec9c8
I20260709 13:23:23.609066 16003 raft_consensus.cc:993] T d64d06459b344ff99c0df07c249c3a60 P a722e54d227f4c29a9ed6ce77858003a: : Instructing follower f3a500981b494979b58d2b1041fec9c8 to start an election
I20260709 13:23:23.610095 14960 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e4a490a7748841c3803607059f9d8825"
dest_uuid: "0efc951052454eec9a58b0cd025945b8"
mode: GRACEFUL
new_leader_uuid: "a1a22e9119494570b6d2217713fd7e43"
 from {username='slave'} at 127.0.0.1:49056
I20260709 13:23:23.610186 16009 raft_consensus.cc:1081] T d64d06459b344ff99c0df07c249c3a60 P a722e54d227f4c29a9ed6ce77858003a [term 1 LEADER]: Signalling peer f3a500981b494979b58d2b1041fec9c8 to start an election
I20260709 13:23:23.610669 14960 raft_consensus.cc:606] T e4a490a7748841c3803607059f9d8825 P 0efc951052454eec9a58b0cd025945b8 [term 1 LEADER]: Received request to transfer leadership to TS a1a22e9119494570b6d2217713fd7e43
I20260709 13:23:23.612516 15799 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d64d06459b344ff99c0df07c249c3a60"
dest_uuid: "f3a500981b494979b58d2b1041fec9c8"
 from {username='slave'} at 127.0.0.1:53118
I20260709 13:23:23.613123 15799 raft_consensus.cc:493] T d64d06459b344ff99c0df07c249c3a60 P f3a500981b494979b58d2b1041fec9c8 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:23:23.613510 15799 raft_consensus.cc:3060] T d64d06459b344ff99c0df07c249c3a60 P f3a500981b494979b58d2b1041fec9c8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:23:23.618719  5625 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 7
I20260709 13:23:23.620023  5625 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:23:23.624163 15799 raft_consensus.cc:515] T d64d06459b344ff99c0df07c249c3a60 P f3a500981b494979b58d2b1041fec9c8 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } } peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } } peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } }
I20260709 13:23:23.627082 15799 leader_election.cc:290] T d64d06459b344ff99c0df07c249c3a60 P f3a500981b494979b58d2b1041fec9c8 [CANDIDATE]: Term 2 election: Requested vote from peers a722e54d227f4c29a9ed6ce77858003a (127.5.126.68:46669), 0efc951052454eec9a58b0cd025945b8 (127.5.126.66:34613)
I20260709 13:23:23.630852 15107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d64d06459b344ff99c0df07c249c3a60" candidate_uuid: "f3a500981b494979b58d2b1041fec9c8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a722e54d227f4c29a9ed6ce77858003a"
I20260709 13:23:23.631585 14960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d64d06459b344ff99c0df07c249c3a60" candidate_uuid: "f3a500981b494979b58d2b1041fec9c8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0efc951052454eec9a58b0cd025945b8"
I20260709 13:23:23.631722 15107 raft_consensus.cc:3055] T d64d06459b344ff99c0df07c249c3a60 P a722e54d227f4c29a9ed6ce77858003a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:23:23.632282 14960 raft_consensus.cc:3060] T d64d06459b344ff99c0df07c249c3a60 P 0efc951052454eec9a58b0cd025945b8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:23:23.632401 15107 raft_consensus.cc:740] T d64d06459b344ff99c0df07c249c3a60 P a722e54d227f4c29a9ed6ce77858003a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a722e54d227f4c29a9ed6ce77858003a, State: Running, Role: LEADER
I20260709 13:23:23.633854 15107 consensus_queue.cc:260] T d64d06459b344ff99c0df07c249c3a60 P a722e54d227f4c29a9ed6ce77858003a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } } peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } } peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } }
I20260709 13:23:23.638315 15107 raft_consensus.cc:3060] T d64d06459b344ff99c0df07c249c3a60 P a722e54d227f4c29a9ed6ce77858003a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:23:23.640118 14960 raft_consensus.cc:2468] T d64d06459b344ff99c0df07c249c3a60 P 0efc951052454eec9a58b0cd025945b8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f3a500981b494979b58d2b1041fec9c8 in term 2.
I20260709 13:23:23.641880 15757 leader_election.cc:304] T d64d06459b344ff99c0df07c249c3a60 P f3a500981b494979b58d2b1041fec9c8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0efc951052454eec9a58b0cd025945b8, f3a500981b494979b58d2b1041fec9c8; no voters: 
I20260709 13:23:23.647747 16013 raft_consensus.cc:2804] T d64d06459b344ff99c0df07c249c3a60 P f3a500981b494979b58d2b1041fec9c8 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:23:23.649436 16013 raft_consensus.cc:697] T d64d06459b344ff99c0df07c249c3a60 P f3a500981b494979b58d2b1041fec9c8 [term 2 LEADER]: Becoming Leader. State: Replica: f3a500981b494979b58d2b1041fec9c8, State: Running, Role: LEADER
I20260709 13:23:23.650679 16013 consensus_queue.cc:237] T d64d06459b344ff99c0df07c249c3a60 P f3a500981b494979b58d2b1041fec9c8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } } peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } } peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } }
I20260709 13:23:23.655884 16005 raft_consensus.cc:993] T 2a862e106a9e48a692bc72ea8c03ab39 P 0efc951052454eec9a58b0cd025945b8: : Instructing follower f3a500981b494979b58d2b1041fec9c8 to start an election
I20260709 13:23:23.656394 15107 raft_consensus.cc:2468] T d64d06459b344ff99c0df07c249c3a60 P a722e54d227f4c29a9ed6ce77858003a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f3a500981b494979b58d2b1041fec9c8 in term 2.
I20260709 13:23:23.656558 16005 raft_consensus.cc:1081] T 2a862e106a9e48a692bc72ea8c03ab39 P 0efc951052454eec9a58b0cd025945b8 [term 1 LEADER]: Signalling peer f3a500981b494979b58d2b1041fec9c8 to start an election
I20260709 13:23:23.662331 15799 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2a862e106a9e48a692bc72ea8c03ab39"
dest_uuid: "f3a500981b494979b58d2b1041fec9c8"
 from {username='slave'} at 127.0.0.1:53130
I20260709 13:23:23.662878 15799 raft_consensus.cc:493] T 2a862e106a9e48a692bc72ea8c03ab39 P f3a500981b494979b58d2b1041fec9c8 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:23:23.663206 15799 raft_consensus.cc:3060] T 2a862e106a9e48a692bc72ea8c03ab39 P f3a500981b494979b58d2b1041fec9c8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:23:23.665381 14781 catalog_manager.cc:5697] T d64d06459b344ff99c0df07c249c3a60 P f3a500981b494979b58d2b1041fec9c8 reported cstate change: term changed from 1 to 2, leader changed from a722e54d227f4c29a9ed6ce77858003a (127.5.126.68) to f3a500981b494979b58d2b1041fec9c8 (127.5.126.65). New cstate: current_term: 2 leader_uuid: "f3a500981b494979b58d2b1041fec9c8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } health_report { overall_health: UNKNOWN } } }
I20260709 13:23:23.670564 15799 raft_consensus.cc:515] T 2a862e106a9e48a692bc72ea8c03ab39 P f3a500981b494979b58d2b1041fec9c8 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } } peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } } peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } }
I20260709 13:23:23.673861 15101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a862e106a9e48a692bc72ea8c03ab39" candidate_uuid: "f3a500981b494979b58d2b1041fec9c8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a722e54d227f4c29a9ed6ce77858003a"
I20260709 13:23:23.674270 15799 leader_election.cc:290] T 2a862e106a9e48a692bc72ea8c03ab39 P f3a500981b494979b58d2b1041fec9c8 [CANDIDATE]: Term 2 election: Requested vote from peers a722e54d227f4c29a9ed6ce77858003a (127.5.126.68:46669), 0efc951052454eec9a58b0cd025945b8 (127.5.126.66:34613)
I20260709 13:23:23.674649 15101 raft_consensus.cc:3060] T 2a862e106a9e48a692bc72ea8c03ab39 P a722e54d227f4c29a9ed6ce77858003a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:23:23.674715 14960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a862e106a9e48a692bc72ea8c03ab39" candidate_uuid: "f3a500981b494979b58d2b1041fec9c8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0efc951052454eec9a58b0cd025945b8"
I20260709 13:23:23.675716 14960 raft_consensus.cc:3055] T 2a862e106a9e48a692bc72ea8c03ab39 P 0efc951052454eec9a58b0cd025945b8 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:23:23.676103 14960 raft_consensus.cc:740] T 2a862e106a9e48a692bc72ea8c03ab39 P 0efc951052454eec9a58b0cd025945b8 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0efc951052454eec9a58b0cd025945b8, State: Running, Role: LEADER
I20260709 13:23:23.676846 14960 consensus_queue.cc:260] T 2a862e106a9e48a692bc72ea8c03ab39 P 0efc951052454eec9a58b0cd025945b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } } peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } } peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } }
I20260709 13:23:23.677947 14960 raft_consensus.cc:3060] T 2a862e106a9e48a692bc72ea8c03ab39 P 0efc951052454eec9a58b0cd025945b8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:23:23.691304 15101 raft_consensus.cc:2468] T 2a862e106a9e48a692bc72ea8c03ab39 P a722e54d227f4c29a9ed6ce77858003a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f3a500981b494979b58d2b1041fec9c8 in term 2.
I20260709 13:23:23.693114 15757 leader_election.cc:304] T 2a862e106a9e48a692bc72ea8c03ab39 P f3a500981b494979b58d2b1041fec9c8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a722e54d227f4c29a9ed6ce77858003a, f3a500981b494979b58d2b1041fec9c8; no voters: 
I20260709 13:23:23.694054 16013 raft_consensus.cc:2804] T 2a862e106a9e48a692bc72ea8c03ab39 P f3a500981b494979b58d2b1041fec9c8 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:23:23.694602 16013 raft_consensus.cc:697] T 2a862e106a9e48a692bc72ea8c03ab39 P f3a500981b494979b58d2b1041fec9c8 [term 2 LEADER]: Becoming Leader. State: Replica: f3a500981b494979b58d2b1041fec9c8, State: Running, Role: LEADER
I20260709 13:23:23.695650 16013 consensus_queue.cc:237] T 2a862e106a9e48a692bc72ea8c03ab39 P f3a500981b494979b58d2b1041fec9c8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } } peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } } peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } }
I20260709 13:23:23.698412 14960 raft_consensus.cc:2468] T 2a862e106a9e48a692bc72ea8c03ab39 P 0efc951052454eec9a58b0cd025945b8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f3a500981b494979b58d2b1041fec9c8 in term 2.
I20260709 13:23:23.727890 14781 catalog_manager.cc:5697] T 2a862e106a9e48a692bc72ea8c03ab39 P f3a500981b494979b58d2b1041fec9c8 reported cstate change: term changed from 1 to 2, leader changed from 0efc951052454eec9a58b0cd025945b8 (127.5.126.66) to f3a500981b494979b58d2b1041fec9c8 (127.5.126.65). New cstate: current_term: 2 leader_uuid: "f3a500981b494979b58d2b1041fec9c8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } health_report { overall_health: UNKNOWN } } }
I20260709 13:23:23.740506 15992 raft_consensus.cc:993] T 08dea3083d334745abe54f9b220bd86a P 0efc951052454eec9a58b0cd025945b8: : Instructing follower f3a500981b494979b58d2b1041fec9c8 to start an election
I20260709 13:23:23.741129 15992 raft_consensus.cc:1081] T 08dea3083d334745abe54f9b220bd86a P 0efc951052454eec9a58b0cd025945b8 [term 1 LEADER]: Signalling peer f3a500981b494979b58d2b1041fec9c8 to start an election
I20260709 13:23:23.743167 15805 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "08dea3083d334745abe54f9b220bd86a"
dest_uuid: "f3a500981b494979b58d2b1041fec9c8"
 from {username='slave'} at 127.0.0.1:53130
I20260709 13:23:23.743695 15805 raft_consensus.cc:493] T 08dea3083d334745abe54f9b220bd86a P f3a500981b494979b58d2b1041fec9c8 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:23:23.744024 15805 raft_consensus.cc:3060] T 08dea3083d334745abe54f9b220bd86a P f3a500981b494979b58d2b1041fec9c8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:23:23.750038 15805 raft_consensus.cc:515] T 08dea3083d334745abe54f9b220bd86a P f3a500981b494979b58d2b1041fec9c8 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } } peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } } peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } }
I20260709 13:23:23.751622 15805 leader_election.cc:290] T 08dea3083d334745abe54f9b220bd86a P f3a500981b494979b58d2b1041fec9c8 [CANDIDATE]: Term 2 election: Requested vote from peers 0efc951052454eec9a58b0cd025945b8 (127.5.126.66:34613), a1a22e9119494570b6d2217713fd7e43 (127.5.126.67:38125)
I20260709 13:23:23.752501 14960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08dea3083d334745abe54f9b220bd86a" candidate_uuid: "f3a500981b494979b58d2b1041fec9c8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0efc951052454eec9a58b0cd025945b8"
I20260709 13:23:23.753083 14960 raft_consensus.cc:3055] T 08dea3083d334745abe54f9b220bd86a P 0efc951052454eec9a58b0cd025945b8 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:23:23.753360 14960 raft_consensus.cc:740] T 08dea3083d334745abe54f9b220bd86a P 0efc951052454eec9a58b0cd025945b8 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0efc951052454eec9a58b0cd025945b8, State: Running, Role: LEADER
I20260709 13:23:23.753151 15033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08dea3083d334745abe54f9b220bd86a" candidate_uuid: "f3a500981b494979b58d2b1041fec9c8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a1a22e9119494570b6d2217713fd7e43"
I20260709 13:23:23.754081 15033 raft_consensus.cc:3060] T 08dea3083d334745abe54f9b220bd86a P a1a22e9119494570b6d2217713fd7e43 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:23:23.754292 14960 consensus_queue.cc:260] T 08dea3083d334745abe54f9b220bd86a P 0efc951052454eec9a58b0cd025945b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } } peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } } peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } }
I20260709 13:23:23.755445 14960 raft_consensus.cc:3060] T 08dea3083d334745abe54f9b220bd86a P 0efc951052454eec9a58b0cd025945b8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:23:23.760203 15033 raft_consensus.cc:2468] T 08dea3083d334745abe54f9b220bd86a P a1a22e9119494570b6d2217713fd7e43 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f3a500981b494979b58d2b1041fec9c8 in term 2.
I20260709 13:23:23.760244 14960 raft_consensus.cc:2468] T 08dea3083d334745abe54f9b220bd86a P 0efc951052454eec9a58b0cd025945b8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f3a500981b494979b58d2b1041fec9c8 in term 2.
I20260709 13:23:23.761710 15756 leader_election.cc:304] T 08dea3083d334745abe54f9b220bd86a P f3a500981b494979b58d2b1041fec9c8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1a22e9119494570b6d2217713fd7e43, f3a500981b494979b58d2b1041fec9c8; no voters: 
I20260709 13:23:23.762594 16013 raft_consensus.cc:2804] T 08dea3083d334745abe54f9b220bd86a P f3a500981b494979b58d2b1041fec9c8 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:23:23.763187 16013 raft_consensus.cc:697] T 08dea3083d334745abe54f9b220bd86a P f3a500981b494979b58d2b1041fec9c8 [term 2 LEADER]: Becoming Leader. State: Replica: f3a500981b494979b58d2b1041fec9c8, State: Running, Role: LEADER
I20260709 13:23:23.763988 16013 consensus_queue.cc:237] T 08dea3083d334745abe54f9b220bd86a P f3a500981b494979b58d2b1041fec9c8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } } peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } } peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } }
I20260709 13:23:23.775453 14781 catalog_manager.cc:5697] T 08dea3083d334745abe54f9b220bd86a P f3a500981b494979b58d2b1041fec9c8 reported cstate change: term changed from 1 to 2, leader changed from 0efc951052454eec9a58b0cd025945b8 (127.5.126.66) to f3a500981b494979b58d2b1041fec9c8 (127.5.126.65). New cstate: current_term: 2 leader_uuid: "f3a500981b494979b58d2b1041fec9c8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } health_report { overall_health: UNKNOWN } } }
I20260709 13:23:23.807482 15923 raft_consensus.cc:993] T dadd194761924530aede05672c9eecf9 P a1a22e9119494570b6d2217713fd7e43: : Instructing follower f3a500981b494979b58d2b1041fec9c8 to start an election
I20260709 13:23:23.808099 16002 raft_consensus.cc:1081] T dadd194761924530aede05672c9eecf9 P a1a22e9119494570b6d2217713fd7e43 [term 1 LEADER]: Signalling peer f3a500981b494979b58d2b1041fec9c8 to start an election
I20260709 13:23:23.809677 15805 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "dadd194761924530aede05672c9eecf9"
dest_uuid: "f3a500981b494979b58d2b1041fec9c8"
 from {username='slave'} at 127.0.0.1:53102
I20260709 13:23:23.810184 15805 raft_consensus.cc:493] T dadd194761924530aede05672c9eecf9 P f3a500981b494979b58d2b1041fec9c8 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:23:23.810473 15805 raft_consensus.cc:3060] T dadd194761924530aede05672c9eecf9 P f3a500981b494979b58d2b1041fec9c8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:23:23.815294 15805 raft_consensus.cc:515] T dadd194761924530aede05672c9eecf9 P f3a500981b494979b58d2b1041fec9c8 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } } peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } } peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } }
I20260709 13:23:23.818269 15033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dadd194761924530aede05672c9eecf9" candidate_uuid: "f3a500981b494979b58d2b1041fec9c8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a1a22e9119494570b6d2217713fd7e43"
I20260709 13:23:23.819226 15805 leader_election.cc:290] T dadd194761924530aede05672c9eecf9 P f3a500981b494979b58d2b1041fec9c8 [CANDIDATE]: Term 2 election: Requested vote from peers a1a22e9119494570b6d2217713fd7e43 (127.5.126.67:38125), a722e54d227f4c29a9ed6ce77858003a (127.5.126.68:46669)
I20260709 13:23:23.819273 15033 raft_consensus.cc:3055] T dadd194761924530aede05672c9eecf9 P a1a22e9119494570b6d2217713fd7e43 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:23:23.818331 15108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dadd194761924530aede05672c9eecf9" candidate_uuid: "f3a500981b494979b58d2b1041fec9c8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a722e54d227f4c29a9ed6ce77858003a"
I20260709 13:23:23.819936 15033 raft_consensus.cc:740] T dadd194761924530aede05672c9eecf9 P a1a22e9119494570b6d2217713fd7e43 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a1a22e9119494570b6d2217713fd7e43, State: Running, Role: LEADER
I20260709 13:23:23.820472 15108 raft_consensus.cc:3060] T dadd194761924530aede05672c9eecf9 P a722e54d227f4c29a9ed6ce77858003a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:23:23.821056 15033 consensus_queue.cc:260] T dadd194761924530aede05672c9eecf9 P a1a22e9119494570b6d2217713fd7e43 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } } peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } } peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } }
I20260709 13:23:23.822551 15033 raft_consensus.cc:3060] T dadd194761924530aede05672c9eecf9 P a1a22e9119494570b6d2217713fd7e43 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:23:23.828625 15108 raft_consensus.cc:2468] T dadd194761924530aede05672c9eecf9 P a722e54d227f4c29a9ed6ce77858003a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f3a500981b494979b58d2b1041fec9c8 in term 2.
I20260709 13:23:23.830109 15757 leader_election.cc:304] T dadd194761924530aede05672c9eecf9 P f3a500981b494979b58d2b1041fec9c8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a722e54d227f4c29a9ed6ce77858003a, f3a500981b494979b58d2b1041fec9c8; no voters: 
I20260709 13:23:23.830936 16013 raft_consensus.cc:2804] T dadd194761924530aede05672c9eecf9 P f3a500981b494979b58d2b1041fec9c8 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:23:23.831385 16013 raft_consensus.cc:697] T dadd194761924530aede05672c9eecf9 P f3a500981b494979b58d2b1041fec9c8 [term 2 LEADER]: Becoming Leader. State: Replica: f3a500981b494979b58d2b1041fec9c8, State: Running, Role: LEADER
I20260709 13:23:23.832315 16013 consensus_queue.cc:237] T dadd194761924530aede05672c9eecf9 P f3a500981b494979b58d2b1041fec9c8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } } peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } } peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } }
I20260709 13:23:23.834465 15033 raft_consensus.cc:2468] T dadd194761924530aede05672c9eecf9 P a1a22e9119494570b6d2217713fd7e43 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f3a500981b494979b58d2b1041fec9c8 in term 2.
I20260709 13:23:23.842835 14781 catalog_manager.cc:5697] T dadd194761924530aede05672c9eecf9 P f3a500981b494979b58d2b1041fec9c8 reported cstate change: term changed from 1 to 2, leader changed from a1a22e9119494570b6d2217713fd7e43 (127.5.126.67) to f3a500981b494979b58d2b1041fec9c8 (127.5.126.65). New cstate: current_term: 2 leader_uuid: "f3a500981b494979b58d2b1041fec9c8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } health_report { overall_health: HEALTHY } } }
I20260709 13:23:23.875761 16005 raft_consensus.cc:993] T 532cc9041f414e018098570192e0fae8 P 0efc951052454eec9a58b0cd025945b8: : Instructing follower f3a500981b494979b58d2b1041fec9c8 to start an election
I20260709 13:23:23.876384 15992 raft_consensus.cc:1081] T 532cc9041f414e018098570192e0fae8 P 0efc951052454eec9a58b0cd025945b8 [term 2 LEADER]: Signalling peer f3a500981b494979b58d2b1041fec9c8 to start an election
I20260709 13:23:23.877950 15799 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "532cc9041f414e018098570192e0fae8"
dest_uuid: "f3a500981b494979b58d2b1041fec9c8"
 from {username='slave'} at 127.0.0.1:53130
I20260709 13:23:23.878592 15799 raft_consensus.cc:493] T 532cc9041f414e018098570192e0fae8 P f3a500981b494979b58d2b1041fec9c8 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:23:23.878963 15799 raft_consensus.cc:3060] T 532cc9041f414e018098570192e0fae8 P f3a500981b494979b58d2b1041fec9c8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:23:23.890246 15799 raft_consensus.cc:515] T 532cc9041f414e018098570192e0fae8 P f3a500981b494979b58d2b1041fec9c8 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } } peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } } peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } }
I20260709 13:23:23.892376 15799 leader_election.cc:290] T 532cc9041f414e018098570192e0fae8 P f3a500981b494979b58d2b1041fec9c8 [CANDIDATE]: Term 3 election: Requested vote from peers a722e54d227f4c29a9ed6ce77858003a (127.5.126.68:46669), 0efc951052454eec9a58b0cd025945b8 (127.5.126.66:34613)
I20260709 13:23:23.893738 14960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "532cc9041f414e018098570192e0fae8" candidate_uuid: "f3a500981b494979b58d2b1041fec9c8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "0efc951052454eec9a58b0cd025945b8"
I20260709 13:23:23.894402 14960 raft_consensus.cc:3055] T 532cc9041f414e018098570192e0fae8 P 0efc951052454eec9a58b0cd025945b8 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:23:23.894723 14960 raft_consensus.cc:740] T 532cc9041f414e018098570192e0fae8 P 0efc951052454eec9a58b0cd025945b8 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 0efc951052454eec9a58b0cd025945b8, State: Running, Role: LEADER
I20260709 13:23:23.894976 15108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "532cc9041f414e018098570192e0fae8" candidate_uuid: "f3a500981b494979b58d2b1041fec9c8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "a722e54d227f4c29a9ed6ce77858003a"
I20260709 13:23:23.895625 15108 raft_consensus.cc:3060] T 532cc9041f414e018098570192e0fae8 P a722e54d227f4c29a9ed6ce77858003a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:23:23.895514 14960 consensus_queue.cc:260] T 532cc9041f414e018098570192e0fae8 P 0efc951052454eec9a58b0cd025945b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } } peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } } peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } }
I20260709 13:23:23.897024 14960 raft_consensus.cc:3060] T 532cc9041f414e018098570192e0fae8 P 0efc951052454eec9a58b0cd025945b8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:23:23.903295 16005 raft_consensus.cc:993] T 58a622a48cd24833bc5fc27e03114176 P 0efc951052454eec9a58b0cd025945b8: : Instructing follower f3a500981b494979b58d2b1041fec9c8 to start an election
I20260709 13:23:23.903882 16005 raft_consensus.cc:1081] T 58a622a48cd24833bc5fc27e03114176 P 0efc951052454eec9a58b0cd025945b8 [term 2 LEADER]: Signalling peer f3a500981b494979b58d2b1041fec9c8 to start an election
I20260709 13:23:23.905463 15805 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "58a622a48cd24833bc5fc27e03114176"
dest_uuid: "f3a500981b494979b58d2b1041fec9c8"
 from {username='slave'} at 127.0.0.1:53130
I20260709 13:23:23.905957 15805 raft_consensus.cc:493] T 58a622a48cd24833bc5fc27e03114176 P f3a500981b494979b58d2b1041fec9c8 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:23:23.906315 15805 raft_consensus.cc:3060] T 58a622a48cd24833bc5fc27e03114176 P f3a500981b494979b58d2b1041fec9c8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:23:23.903333 15108 raft_consensus.cc:2468] T 532cc9041f414e018098570192e0fae8 P a722e54d227f4c29a9ed6ce77858003a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f3a500981b494979b58d2b1041fec9c8 in term 3.
I20260709 13:23:23.913057 15757 leader_election.cc:304] T 532cc9041f414e018098570192e0fae8 P f3a500981b494979b58d2b1041fec9c8 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a722e54d227f4c29a9ed6ce77858003a, f3a500981b494979b58d2b1041fec9c8; no voters: 
I20260709 13:23:23.914036 16013 raft_consensus.cc:2804] T 532cc9041f414e018098570192e0fae8 P f3a500981b494979b58d2b1041fec9c8 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:23:23.917117 16013 raft_consensus.cc:697] T 532cc9041f414e018098570192e0fae8 P f3a500981b494979b58d2b1041fec9c8 [term 3 LEADER]: Becoming Leader. State: Replica: f3a500981b494979b58d2b1041fec9c8, State: Running, Role: LEADER
I20260709 13:23:23.918438 16013 consensus_queue.cc:237] T 532cc9041f414e018098570192e0fae8 P f3a500981b494979b58d2b1041fec9c8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } } peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } } peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } }
I20260709 13:23:23.926908 14960 raft_consensus.cc:2468] T 532cc9041f414e018098570192e0fae8 P 0efc951052454eec9a58b0cd025945b8 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f3a500981b494979b58d2b1041fec9c8 in term 3.
I20260709 13:23:23.926723 15805 raft_consensus.cc:515] T 58a622a48cd24833bc5fc27e03114176 P f3a500981b494979b58d2b1041fec9c8 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } } peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } } peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } }
I20260709 13:23:23.937592 15805 leader_election.cc:290] T 58a622a48cd24833bc5fc27e03114176 P f3a500981b494979b58d2b1041fec9c8 [CANDIDATE]: Term 3 election: Requested vote from peers a722e54d227f4c29a9ed6ce77858003a (127.5.126.68:46669), 0efc951052454eec9a58b0cd025945b8 (127.5.126.66:34613)
I20260709 13:23:23.939388 15108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58a622a48cd24833bc5fc27e03114176" candidate_uuid: "f3a500981b494979b58d2b1041fec9c8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "a722e54d227f4c29a9ed6ce77858003a"
I20260709 13:23:23.940166 15108 raft_consensus.cc:3060] T 58a622a48cd24833bc5fc27e03114176 P a722e54d227f4c29a9ed6ce77858003a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:23:23.943846 14960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58a622a48cd24833bc5fc27e03114176" candidate_uuid: "f3a500981b494979b58d2b1041fec9c8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "0efc951052454eec9a58b0cd025945b8"
I20260709 13:23:23.944567 14960 raft_consensus.cc:3055] T 58a622a48cd24833bc5fc27e03114176 P 0efc951052454eec9a58b0cd025945b8 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:23:23.944865 14960 raft_consensus.cc:740] T 58a622a48cd24833bc5fc27e03114176 P 0efc951052454eec9a58b0cd025945b8 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 0efc951052454eec9a58b0cd025945b8, State: Running, Role: LEADER
I20260709 13:23:23.945789 14960 consensus_queue.cc:260] T 58a622a48cd24833bc5fc27e03114176 P 0efc951052454eec9a58b0cd025945b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } } peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } } peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } }
I20260709 13:23:23.948285 14960 raft_consensus.cc:3060] T 58a622a48cd24833bc5fc27e03114176 P 0efc951052454eec9a58b0cd025945b8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:23:23.948895 15108 raft_consensus.cc:2468] T 58a622a48cd24833bc5fc27e03114176 P a722e54d227f4c29a9ed6ce77858003a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f3a500981b494979b58d2b1041fec9c8 in term 3.
I20260709 13:23:23.948549 14781 catalog_manager.cc:5697] T 532cc9041f414e018098570192e0fae8 P f3a500981b494979b58d2b1041fec9c8 reported cstate change: term changed from 2 to 3, leader changed from 0efc951052454eec9a58b0cd025945b8 (127.5.126.66) to f3a500981b494979b58d2b1041fec9c8 (127.5.126.65). New cstate: current_term: 3 leader_uuid: "f3a500981b494979b58d2b1041fec9c8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } health_report { overall_health: UNKNOWN } } }
I20260709 13:23:23.950153 15757 leader_election.cc:304] T 58a622a48cd24833bc5fc27e03114176 P f3a500981b494979b58d2b1041fec9c8 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a722e54d227f4c29a9ed6ce77858003a, f3a500981b494979b58d2b1041fec9c8; no voters: 
I20260709 13:23:23.951321 16013 raft_consensus.cc:2804] T 58a622a48cd24833bc5fc27e03114176 P f3a500981b494979b58d2b1041fec9c8 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:23:23.951851 16013 raft_consensus.cc:697] T 58a622a48cd24833bc5fc27e03114176 P f3a500981b494979b58d2b1041fec9c8 [term 3 LEADER]: Becoming Leader. State: Replica: f3a500981b494979b58d2b1041fec9c8, State: Running, Role: LEADER
I20260709 13:23:23.952818 16013 consensus_queue.cc:237] T 58a622a48cd24833bc5fc27e03114176 P f3a500981b494979b58d2b1041fec9c8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } } peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } } peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } }
I20260709 13:23:23.959576 14960 raft_consensus.cc:2468] T 58a622a48cd24833bc5fc27e03114176 P 0efc951052454eec9a58b0cd025945b8 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f3a500981b494979b58d2b1041fec9c8 in term 3.
I20260709 13:23:23.966723 15992 raft_consensus.cc:993] T e4a490a7748841c3803607059f9d8825 P 0efc951052454eec9a58b0cd025945b8: : Instructing follower a1a22e9119494570b6d2217713fd7e43 to start an election
I20260709 13:23:23.967195 15992 raft_consensus.cc:1081] T e4a490a7748841c3803607059f9d8825 P 0efc951052454eec9a58b0cd025945b8 [term 1 LEADER]: Signalling peer a1a22e9119494570b6d2217713fd7e43 to start an election
I20260709 13:23:23.969406 15028 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e4a490a7748841c3803607059f9d8825"
dest_uuid: "a1a22e9119494570b6d2217713fd7e43"
 from {username='slave'} at 127.0.0.1:36034
I20260709 13:23:23.969966 15028 raft_consensus.cc:493] T e4a490a7748841c3803607059f9d8825 P a1a22e9119494570b6d2217713fd7e43 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:23:23.970355 15028 raft_consensus.cc:3060] T e4a490a7748841c3803607059f9d8825 P a1a22e9119494570b6d2217713fd7e43 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:23:23.975821 14781 catalog_manager.cc:5697] T 58a622a48cd24833bc5fc27e03114176 P f3a500981b494979b58d2b1041fec9c8 reported cstate change: term changed from 2 to 3, leader changed from 0efc951052454eec9a58b0cd025945b8 (127.5.126.66) to f3a500981b494979b58d2b1041fec9c8 (127.5.126.65). New cstate: current_term: 3 leader_uuid: "f3a500981b494979b58d2b1041fec9c8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } health_report { overall_health: UNKNOWN } } }
I20260709 13:23:23.977514 15028 raft_consensus.cc:515] T e4a490a7748841c3803607059f9d8825 P a1a22e9119494570b6d2217713fd7e43 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } } peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } } peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } }
I20260709 13:23:23.980175 15028 leader_election.cc:290] T e4a490a7748841c3803607059f9d8825 P a1a22e9119494570b6d2217713fd7e43 [CANDIDATE]: Term 2 election: Requested vote from peers 0efc951052454eec9a58b0cd025945b8 (127.5.126.66:34613), a722e54d227f4c29a9ed6ce77858003a (127.5.126.68:46669)
I20260709 13:23:23.981621 15108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4a490a7748841c3803607059f9d8825" candidate_uuid: "a1a22e9119494570b6d2217713fd7e43" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a722e54d227f4c29a9ed6ce77858003a"
I20260709 13:23:23.982275 15108 raft_consensus.cc:3060] T e4a490a7748841c3803607059f9d8825 P a722e54d227f4c29a9ed6ce77858003a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:23:23.982643 14960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4a490a7748841c3803607059f9d8825" candidate_uuid: "a1a22e9119494570b6d2217713fd7e43" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0efc951052454eec9a58b0cd025945b8"
I20260709 13:23:23.983454 14960 raft_consensus.cc:3055] T e4a490a7748841c3803607059f9d8825 P 0efc951052454eec9a58b0cd025945b8 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:23:23.983777 14960 raft_consensus.cc:740] T e4a490a7748841c3803607059f9d8825 P 0efc951052454eec9a58b0cd025945b8 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0efc951052454eec9a58b0cd025945b8, State: Running, Role: LEADER
I20260709 13:23:23.984614 14960 consensus_queue.cc:260] T e4a490a7748841c3803607059f9d8825 P 0efc951052454eec9a58b0cd025945b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } } peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } } peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } }
I20260709 13:23:23.985711 14960 raft_consensus.cc:3060] T e4a490a7748841c3803607059f9d8825 P 0efc951052454eec9a58b0cd025945b8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:23:23.990242 15108 raft_consensus.cc:2468] T e4a490a7748841c3803607059f9d8825 P a722e54d227f4c29a9ed6ce77858003a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1a22e9119494570b6d2217713fd7e43 in term 2.
I20260709 13:23:23.991380 14999 leader_election.cc:304] T e4a490a7748841c3803607059f9d8825 P a1a22e9119494570b6d2217713fd7e43 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1a22e9119494570b6d2217713fd7e43, a722e54d227f4c29a9ed6ce77858003a; no voters: 
I20260709 13:23:23.991997 14960 raft_consensus.cc:2468] T e4a490a7748841c3803607059f9d8825 P 0efc951052454eec9a58b0cd025945b8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1a22e9119494570b6d2217713fd7e43 in term 2.
I20260709 13:23:23.992143 16002 raft_consensus.cc:2804] T e4a490a7748841c3803607059f9d8825 P a1a22e9119494570b6d2217713fd7e43 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:23:23.992908 16002 raft_consensus.cc:697] T e4a490a7748841c3803607059f9d8825 P a1a22e9119494570b6d2217713fd7e43 [term 2 LEADER]: Becoming Leader. State: Replica: a1a22e9119494570b6d2217713fd7e43, State: Running, Role: LEADER
I20260709 13:23:23.993846 16002 consensus_queue.cc:237] T e4a490a7748841c3803607059f9d8825 P a1a22e9119494570b6d2217713fd7e43 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } } peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } } peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } }
I20260709 13:23:24.005985 14781 catalog_manager.cc:5697] T e4a490a7748841c3803607059f9d8825 P a1a22e9119494570b6d2217713fd7e43 reported cstate change: term changed from 1 to 2, leader changed from 0efc951052454eec9a58b0cd025945b8 (127.5.126.66) to a1a22e9119494570b6d2217713fd7e43 (127.5.126.67). New cstate: current_term: 2 leader_uuid: "a1a22e9119494570b6d2217713fd7e43" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } health_report { overall_health: UNKNOWN } } }
I20260709 13:23:24.058568 15108 raft_consensus.cc:1275] T d64d06459b344ff99c0df07c249c3a60 P a722e54d227f4c29a9ed6ce77858003a [term 2 FOLLOWER]: Refusing update from remote peer f3a500981b494979b58d2b1041fec9c8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:23:24.059753 16013 consensus_queue.cc:1048] T d64d06459b344ff99c0df07c249c3a60 P f3a500981b494979b58d2b1041fec9c8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:23:24.083447 14960 raft_consensus.cc:1275] T d64d06459b344ff99c0df07c249c3a60 P 0efc951052454eec9a58b0cd025945b8 [term 2 FOLLOWER]: Refusing update from remote peer f3a500981b494979b58d2b1041fec9c8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:23:24.085206 16014 consensus_queue.cc:1048] T d64d06459b344ff99c0df07c249c3a60 P f3a500981b494979b58d2b1041fec9c8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:23:24.250005 15108 raft_consensus.cc:1275] T 2a862e106a9e48a692bc72ea8c03ab39 P a722e54d227f4c29a9ed6ce77858003a [term 2 FOLLOWER]: Refusing update from remote peer f3a500981b494979b58d2b1041fec9c8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:23:24.251272 16014 consensus_queue.cc:1048] T 2a862e106a9e48a692bc72ea8c03ab39 P f3a500981b494979b58d2b1041fec9c8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:23:24.254913 14954 raft_consensus.cc:1275] T 08dea3083d334745abe54f9b220bd86a P 0efc951052454eec9a58b0cd025945b8 [term 2 FOLLOWER]: Refusing update from remote peer f3a500981b494979b58d2b1041fec9c8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:23:24.256528 16029 consensus_queue.cc:1048] T 08dea3083d334745abe54f9b220bd86a P f3a500981b494979b58d2b1041fec9c8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:23:24.270305 15033 raft_consensus.cc:1275] T 08dea3083d334745abe54f9b220bd86a P a1a22e9119494570b6d2217713fd7e43 [term 2 FOLLOWER]: Refusing update from remote peer f3a500981b494979b58d2b1041fec9c8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:23:24.277248 16029 consensus_queue.cc:1048] T 08dea3083d334745abe54f9b220bd86a P f3a500981b494979b58d2b1041fec9c8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.004s
I20260709 13:23:24.281001 15033 raft_consensus.cc:1275] T dadd194761924530aede05672c9eecf9 P a1a22e9119494570b6d2217713fd7e43 [term 2 FOLLOWER]: Refusing update from remote peer f3a500981b494979b58d2b1041fec9c8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:23:24.276605 14954 raft_consensus.cc:1275] T 2a862e106a9e48a692bc72ea8c03ab39 P 0efc951052454eec9a58b0cd025945b8 [term 2 FOLLOWER]: Refusing update from remote peer f3a500981b494979b58d2b1041fec9c8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:23:24.285266 16029 consensus_queue.cc:1048] T dadd194761924530aede05672c9eecf9 P f3a500981b494979b58d2b1041fec9c8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:23:24.295787 16029 consensus_queue.cc:1048] T 2a862e106a9e48a692bc72ea8c03ab39 P f3a500981b494979b58d2b1041fec9c8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:23:24.301298 15108 raft_consensus.cc:1275] T dadd194761924530aede05672c9eecf9 P a722e54d227f4c29a9ed6ce77858003a [term 2 FOLLOWER]: Refusing update from remote peer f3a500981b494979b58d2b1041fec9c8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:23:24.306692 16035 consensus_queue.cc:1048] T dadd194761924530aede05672c9eecf9 P f3a500981b494979b58d2b1041fec9c8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:23:24.386075 14954 raft_consensus.cc:1275] T 532cc9041f414e018098570192e0fae8 P 0efc951052454eec9a58b0cd025945b8 [term 3 FOLLOWER]: Refusing update from remote peer f3a500981b494979b58d2b1041fec9c8: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:23:24.387650 16035 consensus_queue.cc:1048] T 532cc9041f414e018098570192e0fae8 P f3a500981b494979b58d2b1041fec9c8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:23:24.391882 14959 raft_consensus.cc:1275] T e4a490a7748841c3803607059f9d8825 P 0efc951052454eec9a58b0cd025945b8 [term 2 FOLLOWER]: Refusing update from remote peer a1a22e9119494570b6d2217713fd7e43: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:23:24.393195 16002 consensus_queue.cc:1048] T e4a490a7748841c3803607059f9d8825 P a1a22e9119494570b6d2217713fd7e43 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:23:24.403116 15108 raft_consensus.cc:1275] T 532cc9041f414e018098570192e0fae8 P a722e54d227f4c29a9ed6ce77858003a [term 3 FOLLOWER]: Refusing update from remote peer f3a500981b494979b58d2b1041fec9c8: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:23:24.408689 16035 consensus_queue.cc:1048] T 532cc9041f414e018098570192e0fae8 P f3a500981b494979b58d2b1041fec9c8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:23:24.421646 15108 raft_consensus.cc:1275] T e4a490a7748841c3803607059f9d8825 P a722e54d227f4c29a9ed6ce77858003a [term 2 FOLLOWER]: Refusing update from remote peer a1a22e9119494570b6d2217713fd7e43: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:23:24.425380 16002 consensus_queue.cc:1048] T e4a490a7748841c3803607059f9d8825 P a1a22e9119494570b6d2217713fd7e43 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:23:24.473007 15107 raft_consensus.cc:1275] T 58a622a48cd24833bc5fc27e03114176 P a722e54d227f4c29a9ed6ce77858003a [term 3 FOLLOWER]: Refusing update from remote peer f3a500981b494979b58d2b1041fec9c8: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:23:24.474989 16035 consensus_queue.cc:1048] T 58a622a48cd24833bc5fc27e03114176 P f3a500981b494979b58d2b1041fec9c8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:23:24.500177 14959 raft_consensus.cc:1275] T 58a622a48cd24833bc5fc27e03114176 P 0efc951052454eec9a58b0cd025945b8 [term 3 FOLLOWER]: Refusing update from remote peer f3a500981b494979b58d2b1041fec9c8: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:23:24.503744 16014 consensus_queue.cc:1048] T 58a622a48cd24833bc5fc27e03114176 P f3a500981b494979b58d2b1041fec9c8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:23:24.621162  5625 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:23:24.666249  5625 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:23:24.710841 15028 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "117ae8a22b1d46579ce047f99e30520b"
dest_uuid: "a1a22e9119494570b6d2217713fd7e43"
mode: GRACEFUL
new_leader_uuid: "0efc951052454eec9a58b0cd025945b8"
 from {username='slave'} at 127.0.0.1:59976
I20260709 13:23:24.711472 15028 raft_consensus.cc:606] T 117ae8a22b1d46579ce047f99e30520b P a1a22e9119494570b6d2217713fd7e43 [term 1 LEADER]: Received request to transfer leadership to TS 0efc951052454eec9a58b0cd025945b8
I20260709 13:23:24.714354 15107 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "268027ae94a54cf4acf51c54c7b9032b"
dest_uuid: "a722e54d227f4c29a9ed6ce77858003a"
mode: GRACEFUL
new_leader_uuid: "f3a500981b494979b58d2b1041fec9c8"
 from {username='slave'} at 127.0.0.1:42994
I20260709 13:23:24.714823 15107 raft_consensus.cc:606] T 268027ae94a54cf4acf51c54c7b9032b P a722e54d227f4c29a9ed6ce77858003a [term 1 LEADER]: Received request to transfer leadership to TS f3a500981b494979b58d2b1041fec9c8
I20260709 13:23:24.717384 14959 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "48be8cf045364be999b8f0fd547b7b9d"
dest_uuid: "0efc951052454eec9a58b0cd025945b8"
mode: GRACEFUL
new_leader_uuid: "f3a500981b494979b58d2b1041fec9c8"
 from {username='slave'} at 127.0.0.1:49056
I20260709 13:23:24.717876 14959 raft_consensus.cc:606] T 48be8cf045364be999b8f0fd547b7b9d P 0efc951052454eec9a58b0cd025945b8 [term 1 LEADER]: Received request to transfer leadership to TS f3a500981b494979b58d2b1041fec9c8
I20260709 13:23:24.720295 14959 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "914c9c0c3be1486f8dcce382b61b5450"
dest_uuid: "0efc951052454eec9a58b0cd025945b8"
mode: GRACEFUL
new_leader_uuid: "f3a500981b494979b58d2b1041fec9c8"
 from {username='slave'} at 127.0.0.1:49056
I20260709 13:23:24.720661 14959 raft_consensus.cc:606] T 914c9c0c3be1486f8dcce382b61b5450 P 0efc951052454eec9a58b0cd025945b8 [term 1 LEADER]: Received request to transfer leadership to TS f3a500981b494979b58d2b1041fec9c8
I20260709 13:23:24.723078 15028 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e1ae79ed138a4950a681f24aa1107ef3"
dest_uuid: "a1a22e9119494570b6d2217713fd7e43"
mode: GRACEFUL
new_leader_uuid: "f3a500981b494979b58d2b1041fec9c8"
 from {username='slave'} at 127.0.0.1:59976
I20260709 13:23:24.723685 15028 raft_consensus.cc:606] T e1ae79ed138a4950a681f24aa1107ef3 P a1a22e9119494570b6d2217713fd7e43 [term 1 LEADER]: Received request to transfer leadership to TS f3a500981b494979b58d2b1041fec9c8
I20260709 13:23:24.724897  5625 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:23:24.726086  5625 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:23:24.937759 15992 raft_consensus.cc:993] T 914c9c0c3be1486f8dcce382b61b5450 P 0efc951052454eec9a58b0cd025945b8: : Instructing follower f3a500981b494979b58d2b1041fec9c8 to start an election
I20260709 13:23:24.938483 15992 raft_consensus.cc:1081] T 914c9c0c3be1486f8dcce382b61b5450 P 0efc951052454eec9a58b0cd025945b8 [term 1 LEADER]: Signalling peer f3a500981b494979b58d2b1041fec9c8 to start an election
I20260709 13:23:24.940871 15805 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "914c9c0c3be1486f8dcce382b61b5450"
dest_uuid: "f3a500981b494979b58d2b1041fec9c8"
 from {username='slave'} at 127.0.0.1:53130
I20260709 13:23:24.941622 15805 raft_consensus.cc:493] T 914c9c0c3be1486f8dcce382b61b5450 P f3a500981b494979b58d2b1041fec9c8 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:23:24.942096 15805 raft_consensus.cc:3060] T 914c9c0c3be1486f8dcce382b61b5450 P f3a500981b494979b58d2b1041fec9c8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:23:24.950824 15805 raft_consensus.cc:515] T 914c9c0c3be1486f8dcce382b61b5450 P f3a500981b494979b58d2b1041fec9c8 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } } peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } } peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } }
I20260709 13:23:24.952598 15805 leader_election.cc:290] T 914c9c0c3be1486f8dcce382b61b5450 P f3a500981b494979b58d2b1041fec9c8 [CANDIDATE]: Term 2 election: Requested vote from peers a722e54d227f4c29a9ed6ce77858003a (127.5.126.68:46669), 0efc951052454eec9a58b0cd025945b8 (127.5.126.66:34613)
I20260709 13:23:24.953634 15108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "914c9c0c3be1486f8dcce382b61b5450" candidate_uuid: "f3a500981b494979b58d2b1041fec9c8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a722e54d227f4c29a9ed6ce77858003a"
I20260709 13:23:24.954317 15108 raft_consensus.cc:3060] T 914c9c0c3be1486f8dcce382b61b5450 P a722e54d227f4c29a9ed6ce77858003a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:23:24.954371 14959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "914c9c0c3be1486f8dcce382b61b5450" candidate_uuid: "f3a500981b494979b58d2b1041fec9c8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0efc951052454eec9a58b0cd025945b8"
I20260709 13:23:24.955160 14959 raft_consensus.cc:3055] T 914c9c0c3be1486f8dcce382b61b5450 P 0efc951052454eec9a58b0cd025945b8 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:23:24.955468 14959 raft_consensus.cc:740] T 914c9c0c3be1486f8dcce382b61b5450 P 0efc951052454eec9a58b0cd025945b8 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0efc951052454eec9a58b0cd025945b8, State: Running, Role: LEADER
I20260709 13:23:24.956338 14959 consensus_queue.cc:260] T 914c9c0c3be1486f8dcce382b61b5450 P 0efc951052454eec9a58b0cd025945b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } } peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } } peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } }
I20260709 13:23:24.957635 14959 raft_consensus.cc:3060] T 914c9c0c3be1486f8dcce382b61b5450 P 0efc951052454eec9a58b0cd025945b8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:23:24.958647 16012 raft_consensus.cc:993] T 268027ae94a54cf4acf51c54c7b9032b P a722e54d227f4c29a9ed6ce77858003a: : Instructing follower f3a500981b494979b58d2b1041fec9c8 to start an election
I20260709 13:23:24.959224 16012 raft_consensus.cc:1081] T 268027ae94a54cf4acf51c54c7b9032b P a722e54d227f4c29a9ed6ce77858003a [term 1 LEADER]: Signalling peer f3a500981b494979b58d2b1041fec9c8 to start an election
I20260709 13:23:24.961141 15805 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "268027ae94a54cf4acf51c54c7b9032b"
dest_uuid: "f3a500981b494979b58d2b1041fec9c8"
 from {username='slave'} at 127.0.0.1:53118
I20260709 13:23:24.961652 15805 raft_consensus.cc:493] T 268027ae94a54cf4acf51c54c7b9032b P f3a500981b494979b58d2b1041fec9c8 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:23:24.961980 15805 raft_consensus.cc:3060] T 268027ae94a54cf4acf51c54c7b9032b P f3a500981b494979b58d2b1041fec9c8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:23:24.962281 15108 raft_consensus.cc:2468] T 914c9c0c3be1486f8dcce382b61b5450 P a722e54d227f4c29a9ed6ce77858003a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f3a500981b494979b58d2b1041fec9c8 in term 2.
I20260709 13:23:24.963917 15757 leader_election.cc:304] T 914c9c0c3be1486f8dcce382b61b5450 P f3a500981b494979b58d2b1041fec9c8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a722e54d227f4c29a9ed6ce77858003a, f3a500981b494979b58d2b1041fec9c8; no voters: 
I20260709 13:23:24.965382 14959 raft_consensus.cc:2468] T 914c9c0c3be1486f8dcce382b61b5450 P 0efc951052454eec9a58b0cd025945b8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f3a500981b494979b58d2b1041fec9c8 in term 2.
I20260709 13:23:24.966266 16014 raft_consensus.cc:2804] T 914c9c0c3be1486f8dcce382b61b5450 P f3a500981b494979b58d2b1041fec9c8 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:23:24.966878 16014 raft_consensus.cc:697] T 914c9c0c3be1486f8dcce382b61b5450 P f3a500981b494979b58d2b1041fec9c8 [term 2 LEADER]: Becoming Leader. State: Replica: f3a500981b494979b58d2b1041fec9c8, State: Running, Role: LEADER
I20260709 13:23:24.967901 16014 consensus_queue.cc:237] T 914c9c0c3be1486f8dcce382b61b5450 P f3a500981b494979b58d2b1041fec9c8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } } peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } } peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } }
I20260709 13:23:24.977949 15805 raft_consensus.cc:515] T 268027ae94a54cf4acf51c54c7b9032b P f3a500981b494979b58d2b1041fec9c8 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } } peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } } peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } }
I20260709 13:23:24.979996 15805 leader_election.cc:290] T 268027ae94a54cf4acf51c54c7b9032b P f3a500981b494979b58d2b1041fec9c8 [CANDIDATE]: Term 2 election: Requested vote from peers a722e54d227f4c29a9ed6ce77858003a (127.5.126.68:46669), 0efc951052454eec9a58b0cd025945b8 (127.5.126.66:34613)
I20260709 13:23:24.981066 15108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "268027ae94a54cf4acf51c54c7b9032b" candidate_uuid: "f3a500981b494979b58d2b1041fec9c8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a722e54d227f4c29a9ed6ce77858003a"
I20260709 13:23:24.981673 15108 raft_consensus.cc:3055] T 268027ae94a54cf4acf51c54c7b9032b P a722e54d227f4c29a9ed6ce77858003a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:23:24.981956 15108 raft_consensus.cc:740] T 268027ae94a54cf4acf51c54c7b9032b P a722e54d227f4c29a9ed6ce77858003a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a722e54d227f4c29a9ed6ce77858003a, State: Running, Role: LEADER
I20260709 13:23:24.983569 14959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "268027ae94a54cf4acf51c54c7b9032b" candidate_uuid: "f3a500981b494979b58d2b1041fec9c8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0efc951052454eec9a58b0cd025945b8"
I20260709 13:23:24.984145 14959 raft_consensus.cc:3060] T 268027ae94a54cf4acf51c54c7b9032b P 0efc951052454eec9a58b0cd025945b8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:23:24.986255 15108 consensus_queue.cc:260] T 268027ae94a54cf4acf51c54c7b9032b P a722e54d227f4c29a9ed6ce77858003a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } } peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } } peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } }
I20260709 13:23:24.991149 14959 raft_consensus.cc:2468] T 268027ae94a54cf4acf51c54c7b9032b P 0efc951052454eec9a58b0cd025945b8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f3a500981b494979b58d2b1041fec9c8 in term 2.
I20260709 13:23:24.988612 15108 raft_consensus.cc:3060] T 268027ae94a54cf4acf51c54c7b9032b P a722e54d227f4c29a9ed6ce77858003a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:23:24.992583 15757 leader_election.cc:304] T 268027ae94a54cf4acf51c54c7b9032b P f3a500981b494979b58d2b1041fec9c8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0efc951052454eec9a58b0cd025945b8, f3a500981b494979b58d2b1041fec9c8; no voters: 
I20260709 13:23:24.993443 16014 raft_consensus.cc:2804] T 268027ae94a54cf4acf51c54c7b9032b P f3a500981b494979b58d2b1041fec9c8 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:23:24.994042 16014 raft_consensus.cc:697] T 268027ae94a54cf4acf51c54c7b9032b P f3a500981b494979b58d2b1041fec9c8 [term 2 LEADER]: Becoming Leader. State: Replica: f3a500981b494979b58d2b1041fec9c8, State: Running, Role: LEADER
I20260709 13:23:24.995875 15923 raft_consensus.cc:993] T 117ae8a22b1d46579ce047f99e30520b P a1a22e9119494570b6d2217713fd7e43: : Instructing follower 0efc951052454eec9a58b0cd025945b8 to start an election
I20260709 13:23:24.996536 15923 raft_consensus.cc:1081] T 117ae8a22b1d46579ce047f99e30520b P a1a22e9119494570b6d2217713fd7e43 [term 1 LEADER]: Signalling peer 0efc951052454eec9a58b0cd025945b8 to start an election
I20260709 13:23:24.998999 14959 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "117ae8a22b1d46579ce047f99e30520b"
dest_uuid: "0efc951052454eec9a58b0cd025945b8"
 from {username='slave'} at 127.0.0.1:53420
I20260709 13:23:24.999752 14959 raft_consensus.cc:493] T 117ae8a22b1d46579ce047f99e30520b P 0efc951052454eec9a58b0cd025945b8 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:23:25.000311 14959 raft_consensus.cc:3060] T 117ae8a22b1d46579ce047f99e30520b P 0efc951052454eec9a58b0cd025945b8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:23:24.999073 15108 raft_consensus.cc:2468] T 268027ae94a54cf4acf51c54c7b9032b P a722e54d227f4c29a9ed6ce77858003a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f3a500981b494979b58d2b1041fec9c8 in term 2.
I20260709 13:23:25.004772 14781 catalog_manager.cc:5697] T 914c9c0c3be1486f8dcce382b61b5450 P f3a500981b494979b58d2b1041fec9c8 reported cstate change: term changed from 1 to 2, leader changed from 0efc951052454eec9a58b0cd025945b8 (127.5.126.66) to f3a500981b494979b58d2b1041fec9c8 (127.5.126.65). New cstate: current_term: 2 leader_uuid: "f3a500981b494979b58d2b1041fec9c8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } health_report { overall_health: UNKNOWN } } }
I20260709 13:23:25.012306 14959 raft_consensus.cc:515] T 117ae8a22b1d46579ce047f99e30520b P 0efc951052454eec9a58b0cd025945b8 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } } peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } } peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } }
I20260709 13:23:25.015249 14959 leader_election.cc:290] T 117ae8a22b1d46579ce047f99e30520b P 0efc951052454eec9a58b0cd025945b8 [CANDIDATE]: Term 2 election: Requested vote from peers a1a22e9119494570b6d2217713fd7e43 (127.5.126.67:38125), a722e54d227f4c29a9ed6ce77858003a (127.5.126.68:46669)
I20260709 13:23:25.015492 15028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "117ae8a22b1d46579ce047f99e30520b" candidate_uuid: "0efc951052454eec9a58b0cd025945b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a1a22e9119494570b6d2217713fd7e43"
I20260709 13:23:25.016242 15028 raft_consensus.cc:3055] T 117ae8a22b1d46579ce047f99e30520b P a1a22e9119494570b6d2217713fd7e43 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:23:25.016525 15028 raft_consensus.cc:740] T 117ae8a22b1d46579ce047f99e30520b P a1a22e9119494570b6d2217713fd7e43 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a1a22e9119494570b6d2217713fd7e43, State: Running, Role: LEADER
I20260709 13:23:25.017259 15028 consensus_queue.cc:260] T 117ae8a22b1d46579ce047f99e30520b P a1a22e9119494570b6d2217713fd7e43 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } } peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } } peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } }
I20260709 13:23:25.018290 15028 raft_consensus.cc:3060] T 117ae8a22b1d46579ce047f99e30520b P a1a22e9119494570b6d2217713fd7e43 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:23:24.994930 16014 consensus_queue.cc:237] T 268027ae94a54cf4acf51c54c7b9032b P f3a500981b494979b58d2b1041fec9c8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } } peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } } peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } }
I20260709 13:23:25.031721 15107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "117ae8a22b1d46579ce047f99e30520b" candidate_uuid: "0efc951052454eec9a58b0cd025945b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a722e54d227f4c29a9ed6ce77858003a"
I20260709 13:23:25.032399 15107 raft_consensus.cc:3060] T 117ae8a22b1d46579ce047f99e30520b P a722e54d227f4c29a9ed6ce77858003a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:23:25.054632 15107 raft_consensus.cc:2468] T 117ae8a22b1d46579ce047f99e30520b P a722e54d227f4c29a9ed6ce77858003a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0efc951052454eec9a58b0cd025945b8 in term 2.
I20260709 13:23:25.056452 14925 leader_election.cc:304] T 117ae8a22b1d46579ce047f99e30520b P 0efc951052454eec9a58b0cd025945b8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0efc951052454eec9a58b0cd025945b8, a722e54d227f4c29a9ed6ce77858003a; no voters: 
I20260709 13:23:25.057624 16004 raft_consensus.cc:2804] T 117ae8a22b1d46579ce047f99e30520b P 0efc951052454eec9a58b0cd025945b8 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:23:25.058125 16004 raft_consensus.cc:697] T 117ae8a22b1d46579ce047f99e30520b P 0efc951052454eec9a58b0cd025945b8 [term 2 LEADER]: Becoming Leader. State: Replica: 0efc951052454eec9a58b0cd025945b8, State: Running, Role: LEADER
I20260709 13:23:25.059026 16004 consensus_queue.cc:237] T 117ae8a22b1d46579ce047f99e30520b P 0efc951052454eec9a58b0cd025945b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } } peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } } peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } }
I20260709 13:23:25.054632 15923 raft_consensus.cc:993] T e1ae79ed138a4950a681f24aa1107ef3 P a1a22e9119494570b6d2217713fd7e43: : Instructing follower f3a500981b494979b58d2b1041fec9c8 to start an election
I20260709 13:23:25.060535 15923 raft_consensus.cc:1081] T e1ae79ed138a4950a681f24aa1107ef3 P a1a22e9119494570b6d2217713fd7e43 [term 1 LEADER]: Signalling peer f3a500981b494979b58d2b1041fec9c8 to start an election
I20260709 13:23:25.075525 15797 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e1ae79ed138a4950a681f24aa1107ef3"
dest_uuid: "f3a500981b494979b58d2b1041fec9c8"
 from {username='slave'} at 127.0.0.1:53102
I20260709 13:23:25.076505 15797 raft_consensus.cc:493] T e1ae79ed138a4950a681f24aa1107ef3 P f3a500981b494979b58d2b1041fec9c8 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:23:25.077032 15797 raft_consensus.cc:3060] T e1ae79ed138a4950a681f24aa1107ef3 P f3a500981b494979b58d2b1041fec9c8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:23:25.078780 15028 raft_consensus.cc:2468] T 117ae8a22b1d46579ce047f99e30520b P a1a22e9119494570b6d2217713fd7e43 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0efc951052454eec9a58b0cd025945b8 in term 2.
I20260709 13:23:25.093995 15797 raft_consensus.cc:515] T e1ae79ed138a4950a681f24aa1107ef3 P f3a500981b494979b58d2b1041fec9c8 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } } peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } } peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } }
I20260709 13:23:25.097836 14959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1ae79ed138a4950a681f24aa1107ef3" candidate_uuid: "f3a500981b494979b58d2b1041fec9c8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0efc951052454eec9a58b0cd025945b8"
I20260709 13:23:25.098469 14959 raft_consensus.cc:3060] T e1ae79ed138a4950a681f24aa1107ef3 P 0efc951052454eec9a58b0cd025945b8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:23:25.103272 15028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1ae79ed138a4950a681f24aa1107ef3" candidate_uuid: "f3a500981b494979b58d2b1041fec9c8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a1a22e9119494570b6d2217713fd7e43"
I20260709 13:23:25.104336 15028 raft_consensus.cc:3055] T e1ae79ed138a4950a681f24aa1107ef3 P a1a22e9119494570b6d2217713fd7e43 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:23:25.104632 15028 raft_consensus.cc:740] T e1ae79ed138a4950a681f24aa1107ef3 P a1a22e9119494570b6d2217713fd7e43 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a1a22e9119494570b6d2217713fd7e43, State: Running, Role: LEADER
I20260709 13:23:25.105549 15028 consensus_queue.cc:260] T e1ae79ed138a4950a681f24aa1107ef3 P a1a22e9119494570b6d2217713fd7e43 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } } peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } } peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } }
I20260709 13:23:25.107923 15028 raft_consensus.cc:3060] T e1ae79ed138a4950a681f24aa1107ef3 P a1a22e9119494570b6d2217713fd7e43 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:23:25.110551 15797 leader_election.cc:290] T e1ae79ed138a4950a681f24aa1107ef3 P f3a500981b494979b58d2b1041fec9c8 [CANDIDATE]: Term 2 election: Requested vote from peers 0efc951052454eec9a58b0cd025945b8 (127.5.126.66:34613), a1a22e9119494570b6d2217713fd7e43 (127.5.126.67:38125)
I20260709 13:23:25.112598 14959 raft_consensus.cc:2468] T e1ae79ed138a4950a681f24aa1107ef3 P 0efc951052454eec9a58b0cd025945b8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f3a500981b494979b58d2b1041fec9c8 in term 2.
I20260709 13:23:25.115898 15028 raft_consensus.cc:2468] T e1ae79ed138a4950a681f24aa1107ef3 P a1a22e9119494570b6d2217713fd7e43 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f3a500981b494979b58d2b1041fec9c8 in term 2.
I20260709 13:23:25.126384 14782 catalog_manager.cc:5697] T 117ae8a22b1d46579ce047f99e30520b P 0efc951052454eec9a58b0cd025945b8 reported cstate change: term changed from 1 to 2, leader changed from a1a22e9119494570b6d2217713fd7e43 (127.5.126.67) to 0efc951052454eec9a58b0cd025945b8 (127.5.126.66). New cstate: current_term: 2 leader_uuid: "0efc951052454eec9a58b0cd025945b8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } health_report { overall_health: UNKNOWN } } }
I20260709 13:23:25.128386 15756 leader_election.cc:304] T e1ae79ed138a4950a681f24aa1107ef3 P f3a500981b494979b58d2b1041fec9c8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1a22e9119494570b6d2217713fd7e43, f3a500981b494979b58d2b1041fec9c8; no voters: 
I20260709 13:23:25.129379 16014 raft_consensus.cc:2804] T e1ae79ed138a4950a681f24aa1107ef3 P f3a500981b494979b58d2b1041fec9c8 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:23:25.129896 16014 raft_consensus.cc:697] T e1ae79ed138a4950a681f24aa1107ef3 P f3a500981b494979b58d2b1041fec9c8 [term 2 LEADER]: Becoming Leader. State: Replica: f3a500981b494979b58d2b1041fec9c8, State: Running, Role: LEADER
I20260709 13:23:25.130734 16014 consensus_queue.cc:237] T e1ae79ed138a4950a681f24aa1107ef3 P f3a500981b494979b58d2b1041fec9c8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } } peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } } peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } }
I20260709 13:23:25.137940 16005 raft_consensus.cc:993] T 48be8cf045364be999b8f0fd547b7b9d P 0efc951052454eec9a58b0cd025945b8: : Instructing follower f3a500981b494979b58d2b1041fec9c8 to start an election
I20260709 13:23:25.139456 16005 raft_consensus.cc:1081] T 48be8cf045364be999b8f0fd547b7b9d P 0efc951052454eec9a58b0cd025945b8 [term 1 LEADER]: Signalling peer f3a500981b494979b58d2b1041fec9c8 to start an election
I20260709 13:23:25.147575 15805 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "48be8cf045364be999b8f0fd547b7b9d"
dest_uuid: "f3a500981b494979b58d2b1041fec9c8"
 from {username='slave'} at 127.0.0.1:53130
I20260709 13:23:25.148336 15805 raft_consensus.cc:493] T 48be8cf045364be999b8f0fd547b7b9d P f3a500981b494979b58d2b1041fec9c8 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:23:25.148692 15805 raft_consensus.cc:3060] T 48be8cf045364be999b8f0fd547b7b9d P f3a500981b494979b58d2b1041fec9c8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:23:25.157531 15805 raft_consensus.cc:515] T 48be8cf045364be999b8f0fd547b7b9d P f3a500981b494979b58d2b1041fec9c8 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } } peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } } peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } }
I20260709 13:23:25.159461 15805 leader_election.cc:290] T 48be8cf045364be999b8f0fd547b7b9d P f3a500981b494979b58d2b1041fec9c8 [CANDIDATE]: Term 2 election: Requested vote from peers 0efc951052454eec9a58b0cd025945b8 (127.5.126.66:34613), a1a22e9119494570b6d2217713fd7e43 (127.5.126.67:38125)
I20260709 13:23:25.161026 15028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48be8cf045364be999b8f0fd547b7b9d" candidate_uuid: "f3a500981b494979b58d2b1041fec9c8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a1a22e9119494570b6d2217713fd7e43"
I20260709 13:23:25.161816 15028 raft_consensus.cc:3060] T 48be8cf045364be999b8f0fd547b7b9d P a1a22e9119494570b6d2217713fd7e43 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:23:25.162390 14959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48be8cf045364be999b8f0fd547b7b9d" candidate_uuid: "f3a500981b494979b58d2b1041fec9c8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0efc951052454eec9a58b0cd025945b8"
I20260709 13:23:25.163025 14959 raft_consensus.cc:3055] T 48be8cf045364be999b8f0fd547b7b9d P 0efc951052454eec9a58b0cd025945b8 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:23:25.163308 14959 raft_consensus.cc:740] T 48be8cf045364be999b8f0fd547b7b9d P 0efc951052454eec9a58b0cd025945b8 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0efc951052454eec9a58b0cd025945b8, State: Running, Role: LEADER
I20260709 13:23:25.164120 14959 consensus_queue.cc:260] T 48be8cf045364be999b8f0fd547b7b9d P 0efc951052454eec9a58b0cd025945b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } } peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } } peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } }
I20260709 13:23:25.165930 14959 raft_consensus.cc:3060] T 48be8cf045364be999b8f0fd547b7b9d P 0efc951052454eec9a58b0cd025945b8 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:23:25.167127 14924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.67:38125, user_credentials={real_user=slave}} blocked reactor thread for 60622.6us
I20260709 13:23:25.173012 14959 raft_consensus.cc:2468] T 48be8cf045364be999b8f0fd547b7b9d P 0efc951052454eec9a58b0cd025945b8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f3a500981b494979b58d2b1041fec9c8 in term 2.
I20260709 13:23:25.174356 15757 leader_election.cc:304] T 48be8cf045364be999b8f0fd547b7b9d P f3a500981b494979b58d2b1041fec9c8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0efc951052454eec9a58b0cd025945b8, f3a500981b494979b58d2b1041fec9c8; no voters: 
I20260709 13:23:25.175163 16014 raft_consensus.cc:2804] T 48be8cf045364be999b8f0fd547b7b9d P f3a500981b494979b58d2b1041fec9c8 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:23:25.175642 16014 raft_consensus.cc:697] T 48be8cf045364be999b8f0fd547b7b9d P f3a500981b494979b58d2b1041fec9c8 [term 2 LEADER]: Becoming Leader. State: Replica: f3a500981b494979b58d2b1041fec9c8, State: Running, Role: LEADER
I20260709 13:23:25.176574 16014 consensus_queue.cc:237] T 48be8cf045364be999b8f0fd547b7b9d P f3a500981b494979b58d2b1041fec9c8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } } peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } } peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } }
I20260709 13:23:25.177448 15028 raft_consensus.cc:2468] T 48be8cf045364be999b8f0fd547b7b9d P a1a22e9119494570b6d2217713fd7e43 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f3a500981b494979b58d2b1041fec9c8 in term 2.
I20260709 13:23:25.184137 14782 catalog_manager.cc:5697] T 268027ae94a54cf4acf51c54c7b9032b P f3a500981b494979b58d2b1041fec9c8 reported cstate change: term changed from 1 to 2, leader changed from a722e54d227f4c29a9ed6ce77858003a (127.5.126.68) to f3a500981b494979b58d2b1041fec9c8 (127.5.126.65). New cstate: current_term: 2 leader_uuid: "f3a500981b494979b58d2b1041fec9c8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } health_report { overall_health: UNKNOWN } } }
I20260709 13:23:25.185914 14782 catalog_manager.cc:5697] T e1ae79ed138a4950a681f24aa1107ef3 P f3a500981b494979b58d2b1041fec9c8 reported cstate change: term changed from 1 to 2, leader changed from a1a22e9119494570b6d2217713fd7e43 (127.5.126.67) to f3a500981b494979b58d2b1041fec9c8 (127.5.126.65). New cstate: current_term: 2 leader_uuid: "f3a500981b494979b58d2b1041fec9c8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } health_report { overall_health: UNKNOWN } } }
I20260709 13:23:25.202991 14782 catalog_manager.cc:5697] T 48be8cf045364be999b8f0fd547b7b9d P f3a500981b494979b58d2b1041fec9c8 reported cstate change: term changed from 1 to 2, leader changed from 0efc951052454eec9a58b0cd025945b8 (127.5.126.66) to f3a500981b494979b58d2b1041fec9c8 (127.5.126.65). New cstate: current_term: 2 leader_uuid: "f3a500981b494979b58d2b1041fec9c8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 } health_report { overall_health: UNKNOWN } } }
I20260709 13:23:25.435525 15107 raft_consensus.cc:1275] T 268027ae94a54cf4acf51c54c7b9032b P a722e54d227f4c29a9ed6ce77858003a [term 2 FOLLOWER]: Refusing update from remote peer f3a500981b494979b58d2b1041fec9c8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:23:25.436966 16014 consensus_queue.cc:1048] T 268027ae94a54cf4acf51c54c7b9032b P f3a500981b494979b58d2b1041fec9c8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:23:25.457629 14960 raft_consensus.cc:1275] T 268027ae94a54cf4acf51c54c7b9032b P 0efc951052454eec9a58b0cd025945b8 [term 2 FOLLOWER]: Refusing update from remote peer f3a500981b494979b58d2b1041fec9c8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:23:25.461872 16014 consensus_queue.cc:1048] T 268027ae94a54cf4acf51c54c7b9032b P f3a500981b494979b58d2b1041fec9c8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:23:25.474727 15107 raft_consensus.cc:1275] T 117ae8a22b1d46579ce047f99e30520b P a722e54d227f4c29a9ed6ce77858003a [term 2 FOLLOWER]: Refusing update from remote peer 0efc951052454eec9a58b0cd025945b8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:23:25.476387 16062 consensus_queue.cc:1048] T 117ae8a22b1d46579ce047f99e30520b P 0efc951052454eec9a58b0cd025945b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:23:25.499680 15107 raft_consensus.cc:1275] T 914c9c0c3be1486f8dcce382b61b5450 P a722e54d227f4c29a9ed6ce77858003a [term 2 FOLLOWER]: Refusing update from remote peer f3a500981b494979b58d2b1041fec9c8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:23:25.501106 16014 consensus_queue.cc:1048] T 914c9c0c3be1486f8dcce382b61b5450 P f3a500981b494979b58d2b1041fec9c8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:23:25.503873 15033 raft_consensus.cc:1275] T 117ae8a22b1d46579ce047f99e30520b P a1a22e9119494570b6d2217713fd7e43 [term 2 FOLLOWER]: Refusing update from remote peer 0efc951052454eec9a58b0cd025945b8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:23:25.505883 16004 consensus_queue.cc:1048] T 117ae8a22b1d46579ce047f99e30520b P 0efc951052454eec9a58b0cd025945b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:23:25.515203 14960 raft_consensus.cc:1275] T 914c9c0c3be1486f8dcce382b61b5450 P 0efc951052454eec9a58b0cd025945b8 [term 2 FOLLOWER]: Refusing update from remote peer f3a500981b494979b58d2b1041fec9c8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:23:25.516819 16036 consensus_queue.cc:1048] T 914c9c0c3be1486f8dcce382b61b5450 P f3a500981b494979b58d2b1041fec9c8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:23:25.588554 14959 raft_consensus.cc:1275] T e1ae79ed138a4950a681f24aa1107ef3 P 0efc951052454eec9a58b0cd025945b8 [term 2 FOLLOWER]: Refusing update from remote peer f3a500981b494979b58d2b1041fec9c8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:23:25.590690 16035 consensus_queue.cc:1048] T e1ae79ed138a4950a681f24aa1107ef3 P f3a500981b494979b58d2b1041fec9c8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:23:25.604501 15033 raft_consensus.cc:1275] T e1ae79ed138a4950a681f24aa1107ef3 P a1a22e9119494570b6d2217713fd7e43 [term 2 FOLLOWER]: Refusing update from remote peer f3a500981b494979b58d2b1041fec9c8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:23:25.609344 16035 consensus_queue.cc:1048] T e1ae79ed138a4950a681f24aa1107ef3 P f3a500981b494979b58d2b1041fec9c8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:23:25.709239 14959 raft_consensus.cc:1275] T 48be8cf045364be999b8f0fd547b7b9d P 0efc951052454eec9a58b0cd025945b8 [term 2 FOLLOWER]: Refusing update from remote peer f3a500981b494979b58d2b1041fec9c8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:23:25.711704 16035 consensus_queue.cc:1048] T 48be8cf045364be999b8f0fd547b7b9d P f3a500981b494979b58d2b1041fec9c8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:23:25.727093  5625 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:23:25.733786 15032 raft_consensus.cc:1275] T 48be8cf045364be999b8f0fd547b7b9d P a1a22e9119494570b6d2217713fd7e43 [term 2 FOLLOWER]: Refusing update from remote peer f3a500981b494979b58d2b1041fec9c8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:23:25.736210 16035 consensus_queue.cc:1048] T 48be8cf045364be999b8f0fd547b7b9d P f3a500981b494979b58d2b1041fec9c8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1a22e9119494570b6d2217713fd7e43" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 38125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:23:25.783370  5625 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:23:25.827157 15108 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "77e8d8b35cf148e99e8274bf65e5ed05"
dest_uuid: "a722e54d227f4c29a9ed6ce77858003a"
mode: GRACEFUL
new_leader_uuid: "f3a500981b494979b58d2b1041fec9c8"
 from {username='slave'} at 127.0.0.1:42994
I20260709 13:23:25.827826 15108 raft_consensus.cc:606] T 77e8d8b35cf148e99e8274bf65e5ed05 P a722e54d227f4c29a9ed6ce77858003a [term 1 LEADER]: Received request to transfer leadership to TS f3a500981b494979b58d2b1041fec9c8
I20260709 13:23:25.832005 15107 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "af00ad02fba64998bb25991f6f69f291"
dest_uuid: "a722e54d227f4c29a9ed6ce77858003a"
mode: GRACEFUL
new_leader_uuid: "f3a500981b494979b58d2b1041fec9c8"
 from {username='slave'} at 127.0.0.1:42994
I20260709 13:23:25.832646 15107 raft_consensus.cc:606] T af00ad02fba64998bb25991f6f69f291 P a722e54d227f4c29a9ed6ce77858003a [term 2 LEADER]: Received request to transfer leadership to TS f3a500981b494979b58d2b1041fec9c8
I20260709 13:23:25.835345 14960 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e75f8237624f42f793627366f05b792a"
dest_uuid: "0efc951052454eec9a58b0cd025945b8"
mode: GRACEFUL
new_leader_uuid: "f3a500981b494979b58d2b1041fec9c8"
 from {username='slave'} at 127.0.0.1:49056
I20260709 13:23:25.835922 14960 raft_consensus.cc:606] T e75f8237624f42f793627366f05b792a P 0efc951052454eec9a58b0cd025945b8 [term 1 LEADER]: Received request to transfer leadership to TS f3a500981b494979b58d2b1041fec9c8
I20260709 13:23:25.838896 15107 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f954c6c25a25443abd9705c8e909bf47"
dest_uuid: "a722e54d227f4c29a9ed6ce77858003a"
mode: GRACEFUL
new_leader_uuid: "f3a500981b494979b58d2b1041fec9c8"
 from {username='slave'} at 127.0.0.1:42994
I20260709 13:23:25.839468 15107 raft_consensus.cc:606] T f954c6c25a25443abd9705c8e909bf47 P a722e54d227f4c29a9ed6ce77858003a [term 1 LEADER]: Received request to transfer leadership to TS f3a500981b494979b58d2b1041fec9c8
I20260709 13:23:25.840652  5625 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 13:23:25.842165  5625 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:23:25.955480 15997 raft_consensus.cc:993] T 77e8d8b35cf148e99e8274bf65e5ed05 P a722e54d227f4c29a9ed6ce77858003a: : Instructing follower f3a500981b494979b58d2b1041fec9c8 to start an election
I20260709 13:23:25.956104 16009 raft_consensus.cc:1081] T 77e8d8b35cf148e99e8274bf65e5ed05 P a722e54d227f4c29a9ed6ce77858003a [term 1 LEADER]: Signalling peer f3a500981b494979b58d2b1041fec9c8 to start an election
I20260709 13:23:25.957895 15799 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "77e8d8b35cf148e99e8274bf65e5ed05"
dest_uuid: "f3a500981b494979b58d2b1041fec9c8"
 from {username='slave'} at 127.0.0.1:53118
I20260709 13:23:25.958417 15799 raft_consensus.cc:493] T 77e8d8b35cf148e99e8274bf65e5ed05 P f3a500981b494979b58d2b1041fec9c8 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:23:25.958771 15799 raft_consensus.cc:3060] T 77e8d8b35cf148e99e8274bf65e5ed05 P f3a500981b494979b58d2b1041fec9c8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:23:25.965119 15799 raft_consensus.cc:515] T 77e8d8b35cf148e99e8274bf65e5ed05 P f3a500981b494979b58d2b1041fec9c8 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } } peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } } peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } }
I20260709 13:23:25.967338 15799 leader_election.cc:290] T 77e8d8b35cf148e99e8274bf65e5ed05 P f3a500981b494979b58d2b1041fec9c8 [CANDIDATE]: Term 2 election: Requested vote from peers a722e54d227f4c29a9ed6ce77858003a (127.5.126.68:46669), 0efc951052454eec9a58b0cd025945b8 (127.5.126.66:34613)
I20260709 13:23:25.969067 14960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77e8d8b35cf148e99e8274bf65e5ed05" candidate_uuid: "f3a500981b494979b58d2b1041fec9c8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0efc951052454eec9a58b0cd025945b8"
I20260709 13:23:25.969658 14960 raft_consensus.cc:3060] T 77e8d8b35cf148e99e8274bf65e5ed05 P 0efc951052454eec9a58b0cd025945b8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:23:25.970672 15107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77e8d8b35cf148e99e8274bf65e5ed05" candidate_uuid: "f3a500981b494979b58d2b1041fec9c8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a722e54d227f4c29a9ed6ce77858003a"
I20260709 13:23:25.971349 15107 raft_consensus.cc:3055] T 77e8d8b35cf148e99e8274bf65e5ed05 P a722e54d227f4c29a9ed6ce77858003a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:23:25.971694 15107 raft_consensus.cc:740] T 77e8d8b35cf148e99e8274bf65e5ed05 P a722e54d227f4c29a9ed6ce77858003a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a722e54d227f4c29a9ed6ce77858003a, State: Running, Role: LEADER
I20260709 13:23:25.972580 15107 consensus_queue.cc:260] T 77e8d8b35cf148e99e8274bf65e5ed05 P a722e54d227f4c29a9ed6ce77858003a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } } peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } } peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } }
I20260709 13:23:25.973961 15107 raft_consensus.cc:3060] T 77e8d8b35cf148e99e8274bf65e5ed05 P a722e54d227f4c29a9ed6ce77858003a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:23:25.977273 14960 raft_consensus.cc:2468] T 77e8d8b35cf148e99e8274bf65e5ed05 P 0efc951052454eec9a58b0cd025945b8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f3a500981b494979b58d2b1041fec9c8 in term 2.
I20260709 13:23:25.980296 15107 raft_consensus.cc:2468] T 77e8d8b35cf148e99e8274bf65e5ed05 P a722e54d227f4c29a9ed6ce77858003a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f3a500981b494979b58d2b1041fec9c8 in term 2.
I20260709 13:23:25.980962 15757 leader_election.cc:304] T 77e8d8b35cf148e99e8274bf65e5ed05 P f3a500981b494979b58d2b1041fec9c8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0efc951052454eec9a58b0cd025945b8, f3a500981b494979b58d2b1041fec9c8; no voters: 
I20260709 13:23:25.981914 16035 raft_consensus.cc:2804] T 77e8d8b35cf148e99e8274bf65e5ed05 P f3a500981b494979b58d2b1041fec9c8 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:23:25.982503 16035 raft_consensus.cc:697] T 77e8d8b35cf148e99e8274bf65e5ed05 P f3a500981b494979b58d2b1041fec9c8 [term 2 LEADER]: Becoming Leader. State: Replica: f3a500981b494979b58d2b1041fec9c8, State: Running, Role: LEADER
I20260709 13:23:25.983457 16035 consensus_queue.cc:237] T 77e8d8b35cf148e99e8274bf65e5ed05 P f3a500981b494979b58d2b1041fec9c8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } } peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } } peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } }
I20260709 13:23:25.994911 14779 catalog_manager.cc:5697] T 77e8d8b35cf148e99e8274bf65e5ed05 P f3a500981b494979b58d2b1041fec9c8 reported cstate change: term changed from 1 to 2, leader changed from a722e54d227f4c29a9ed6ce77858003a (127.5.126.68) to f3a500981b494979b58d2b1041fec9c8 (127.5.126.65). New cstate: current_term: 2 leader_uuid: "f3a500981b494979b58d2b1041fec9c8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } health_report { overall_health: UNKNOWN } } }
I20260709 13:23:26.050288 16059 raft_consensus.cc:993] T e75f8237624f42f793627366f05b792a P 0efc951052454eec9a58b0cd025945b8: : Instructing follower f3a500981b494979b58d2b1041fec9c8 to start an election
I20260709 13:23:26.050865 16061 raft_consensus.cc:1081] T e75f8237624f42f793627366f05b792a P 0efc951052454eec9a58b0cd025945b8 [term 1 LEADER]: Signalling peer f3a500981b494979b58d2b1041fec9c8 to start an election
I20260709 13:23:26.052556 15805 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e75f8237624f42f793627366f05b792a"
dest_uuid: "f3a500981b494979b58d2b1041fec9c8"
 from {username='slave'} at 127.0.0.1:53130
I20260709 13:23:26.053030 15805 raft_consensus.cc:493] T e75f8237624f42f793627366f05b792a P f3a500981b494979b58d2b1041fec9c8 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:23:26.053357 15805 raft_consensus.cc:3060] T e75f8237624f42f793627366f05b792a P f3a500981b494979b58d2b1041fec9c8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:23:26.059195 15805 raft_consensus.cc:515] T e75f8237624f42f793627366f05b792a P f3a500981b494979b58d2b1041fec9c8 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } } peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } } peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } }
I20260709 13:23:26.060992 15805 leader_election.cc:290] T e75f8237624f42f793627366f05b792a P f3a500981b494979b58d2b1041fec9c8 [CANDIDATE]: Term 2 election: Requested vote from peers a722e54d227f4c29a9ed6ce77858003a (127.5.126.68:46669), 0efc951052454eec9a58b0cd025945b8 (127.5.126.66:34613)
I20260709 13:23:26.061801 15107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e75f8237624f42f793627366f05b792a" candidate_uuid: "f3a500981b494979b58d2b1041fec9c8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a722e54d227f4c29a9ed6ce77858003a"
I20260709 13:23:26.062212 14960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e75f8237624f42f793627366f05b792a" candidate_uuid: "f3a500981b494979b58d2b1041fec9c8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0efc951052454eec9a58b0cd025945b8"
I20260709 13:23:26.062564 15107 raft_consensus.cc:3060] T e75f8237624f42f793627366f05b792a P a722e54d227f4c29a9ed6ce77858003a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:23:26.062774 14960 raft_consensus.cc:3055] T e75f8237624f42f793627366f05b792a P 0efc951052454eec9a58b0cd025945b8 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:23:26.063210 14960 raft_consensus.cc:740] T e75f8237624f42f793627366f05b792a P 0efc951052454eec9a58b0cd025945b8 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0efc951052454eec9a58b0cd025945b8, State: Running, Role: LEADER
I20260709 13:23:26.064003 14960 consensus_queue.cc:260] T e75f8237624f42f793627366f05b792a P 0efc951052454eec9a58b0cd025945b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } } peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } } peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } }
I20260709 13:23:26.065418 14960 raft_consensus.cc:3060] T e75f8237624f42f793627366f05b792a P 0efc951052454eec9a58b0cd025945b8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:23:26.069494 15107 raft_consensus.cc:2468] T e75f8237624f42f793627366f05b792a P a722e54d227f4c29a9ed6ce77858003a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f3a500981b494979b58d2b1041fec9c8 in term 2.
I20260709 13:23:26.071677 15757 leader_election.cc:304] T e75f8237624f42f793627366f05b792a P f3a500981b494979b58d2b1041fec9c8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a722e54d227f4c29a9ed6ce77858003a, f3a500981b494979b58d2b1041fec9c8; no voters: 
I20260709 13:23:26.072530 16035 raft_consensus.cc:2804] T e75f8237624f42f793627366f05b792a P f3a500981b494979b58d2b1041fec9c8 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:23:26.073065 16035 raft_consensus.cc:697] T e75f8237624f42f793627366f05b792a P f3a500981b494979b58d2b1041fec9c8 [term 2 LEADER]: Becoming Leader. State: Replica: f3a500981b494979b58d2b1041fec9c8, State: Running, Role: LEADER
I20260709 13:23:26.073302 14960 raft_consensus.cc:2468] T e75f8237624f42f793627366f05b792a P 0efc951052454eec9a58b0cd025945b8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f3a500981b494979b58d2b1041fec9c8 in term 2.
I20260709 13:23:26.074033 16035 consensus_queue.cc:237] T e75f8237624f42f793627366f05b792a P f3a500981b494979b58d2b1041fec9c8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } } peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } } peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } }
I20260709 13:23:26.076684 16009 raft_consensus.cc:993] T f954c6c25a25443abd9705c8e909bf47 P a722e54d227f4c29a9ed6ce77858003a: : Instructing follower f3a500981b494979b58d2b1041fec9c8 to start an election
I20260709 13:23:26.077400 15997 raft_consensus.cc:1081] T f954c6c25a25443abd9705c8e909bf47 P a722e54d227f4c29a9ed6ce77858003a [term 1 LEADER]: Signalling peer f3a500981b494979b58d2b1041fec9c8 to start an election
I20260709 13:23:26.080791 15805 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f954c6c25a25443abd9705c8e909bf47"
dest_uuid: "f3a500981b494979b58d2b1041fec9c8"
 from {username='slave'} at 127.0.0.1:53118
I20260709 13:23:26.081408 15805 raft_consensus.cc:493] T f954c6c25a25443abd9705c8e909bf47 P f3a500981b494979b58d2b1041fec9c8 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:23:26.081748 15805 raft_consensus.cc:3060] T f954c6c25a25443abd9705c8e909bf47 P f3a500981b494979b58d2b1041fec9c8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:23:26.089084 15805 raft_consensus.cc:515] T f954c6c25a25443abd9705c8e909bf47 P f3a500981b494979b58d2b1041fec9c8 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } } peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } } peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } }
I20260709 13:23:26.091248 15805 leader_election.cc:290] T f954c6c25a25443abd9705c8e909bf47 P f3a500981b494979b58d2b1041fec9c8 [CANDIDATE]: Term 2 election: Requested vote from peers a722e54d227f4c29a9ed6ce77858003a (127.5.126.68:46669), 0efc951052454eec9a58b0cd025945b8 (127.5.126.66:34613)
I20260709 13:23:26.098318 14960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f954c6c25a25443abd9705c8e909bf47" candidate_uuid: "f3a500981b494979b58d2b1041fec9c8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0efc951052454eec9a58b0cd025945b8"
I20260709 13:23:26.099802 14960 raft_consensus.cc:3060] T f954c6c25a25443abd9705c8e909bf47 P 0efc951052454eec9a58b0cd025945b8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:23:26.100399 15107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f954c6c25a25443abd9705c8e909bf47" candidate_uuid: "f3a500981b494979b58d2b1041fec9c8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a722e54d227f4c29a9ed6ce77858003a"
I20260709 13:23:26.101913 15107 raft_consensus.cc:3055] T f954c6c25a25443abd9705c8e909bf47 P a722e54d227f4c29a9ed6ce77858003a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:23:26.102205 15107 raft_consensus.cc:740] T f954c6c25a25443abd9705c8e909bf47 P a722e54d227f4c29a9ed6ce77858003a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a722e54d227f4c29a9ed6ce77858003a, State: Running, Role: LEADER
I20260709 13:23:26.102934 15107 consensus_queue.cc:260] T f954c6c25a25443abd9705c8e909bf47 P a722e54d227f4c29a9ed6ce77858003a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } } peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } } peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } }
I20260709 13:23:26.104218 15107 raft_consensus.cc:3060] T f954c6c25a25443abd9705c8e909bf47 P a722e54d227f4c29a9ed6ce77858003a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:23:26.111238 15107 raft_consensus.cc:2468] T f954c6c25a25443abd9705c8e909bf47 P a722e54d227f4c29a9ed6ce77858003a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f3a500981b494979b58d2b1041fec9c8 in term 2.
I20260709 13:23:26.114439 15757 leader_election.cc:304] T f954c6c25a25443abd9705c8e909bf47 P f3a500981b494979b58d2b1041fec9c8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a722e54d227f4c29a9ed6ce77858003a, f3a500981b494979b58d2b1041fec9c8; no voters: 
I20260709 13:23:26.115710 16014 raft_consensus.cc:2804] T f954c6c25a25443abd9705c8e909bf47 P f3a500981b494979b58d2b1041fec9c8 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:23:26.116524 16014 raft_consensus.cc:697] T f954c6c25a25443abd9705c8e909bf47 P f3a500981b494979b58d2b1041fec9c8 [term 2 LEADER]: Becoming Leader. State: Replica: f3a500981b494979b58d2b1041fec9c8, State: Running, Role: LEADER
I20260709 13:23:26.117792 16014 consensus_queue.cc:237] T f954c6c25a25443abd9705c8e909bf47 P f3a500981b494979b58d2b1041fec9c8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } } peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } } peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } }
I20260709 13:23:26.129729 14779 catalog_manager.cc:5697] T e75f8237624f42f793627366f05b792a P f3a500981b494979b58d2b1041fec9c8 reported cstate change: term changed from 1 to 2, leader changed from 0efc951052454eec9a58b0cd025945b8 (127.5.126.66) to f3a500981b494979b58d2b1041fec9c8 (127.5.126.65). New cstate: current_term: 2 leader_uuid: "f3a500981b494979b58d2b1041fec9c8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } health_report { overall_health: UNKNOWN } } }
I20260709 13:23:26.131520 14960 raft_consensus.cc:2468] T f954c6c25a25443abd9705c8e909bf47 P 0efc951052454eec9a58b0cd025945b8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f3a500981b494979b58d2b1041fec9c8 in term 2.
I20260709 13:23:26.144697 16009 raft_consensus.cc:993] T af00ad02fba64998bb25991f6f69f291 P a722e54d227f4c29a9ed6ce77858003a: : Instructing follower f3a500981b494979b58d2b1041fec9c8 to start an election
I20260709 13:23:26.145504 16085 raft_consensus.cc:1081] T af00ad02fba64998bb25991f6f69f291 P a722e54d227f4c29a9ed6ce77858003a [term 2 LEADER]: Signalling peer f3a500981b494979b58d2b1041fec9c8 to start an election
I20260709 13:23:26.147294 15805 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "af00ad02fba64998bb25991f6f69f291"
dest_uuid: "f3a500981b494979b58d2b1041fec9c8"
 from {username='slave'} at 127.0.0.1:53118
I20260709 13:23:26.147902 15805 raft_consensus.cc:493] T af00ad02fba64998bb25991f6f69f291 P f3a500981b494979b58d2b1041fec9c8 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:23:26.148330 15805 raft_consensus.cc:3060] T af00ad02fba64998bb25991f6f69f291 P f3a500981b494979b58d2b1041fec9c8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:23:26.156698 15805 raft_consensus.cc:515] T af00ad02fba64998bb25991f6f69f291 P f3a500981b494979b58d2b1041fec9c8 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } } peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } } peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } }
I20260709 13:23:26.157204 14779 catalog_manager.cc:5697] T f954c6c25a25443abd9705c8e909bf47 P f3a500981b494979b58d2b1041fec9c8 reported cstate change: term changed from 1 to 2, leader changed from a722e54d227f4c29a9ed6ce77858003a (127.5.126.68) to f3a500981b494979b58d2b1041fec9c8 (127.5.126.65). New cstate: current_term: 2 leader_uuid: "f3a500981b494979b58d2b1041fec9c8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } health_report { overall_health: UNKNOWN } } }
I20260709 13:23:26.158794 15805 leader_election.cc:290] T af00ad02fba64998bb25991f6f69f291 P f3a500981b494979b58d2b1041fec9c8 [CANDIDATE]: Term 3 election: Requested vote from peers a722e54d227f4c29a9ed6ce77858003a (127.5.126.68:46669), 0efc951052454eec9a58b0cd025945b8 (127.5.126.66:34613)
I20260709 13:23:26.159811 14960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af00ad02fba64998bb25991f6f69f291" candidate_uuid: "f3a500981b494979b58d2b1041fec9c8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "0efc951052454eec9a58b0cd025945b8"
I20260709 13:23:26.160432 14960 raft_consensus.cc:3060] T af00ad02fba64998bb25991f6f69f291 P 0efc951052454eec9a58b0cd025945b8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:23:26.161070 15107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af00ad02fba64998bb25991f6f69f291" candidate_uuid: "f3a500981b494979b58d2b1041fec9c8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "a722e54d227f4c29a9ed6ce77858003a"
I20260709 13:23:26.161717 15107 raft_consensus.cc:3055] T af00ad02fba64998bb25991f6f69f291 P a722e54d227f4c29a9ed6ce77858003a [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:23:26.162022 15107 raft_consensus.cc:740] T af00ad02fba64998bb25991f6f69f291 P a722e54d227f4c29a9ed6ce77858003a [term 2 LEADER]: Becoming Follower/Learner. State: Replica: a722e54d227f4c29a9ed6ce77858003a, State: Running, Role: LEADER
I20260709 13:23:26.162976 15107 consensus_queue.cc:260] T af00ad02fba64998bb25991f6f69f291 P a722e54d227f4c29a9ed6ce77858003a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } } peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } } peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } }
I20260709 13:23:26.164400 15107 raft_consensus.cc:3060] T af00ad02fba64998bb25991f6f69f291 P a722e54d227f4c29a9ed6ce77858003a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:23:26.167773 14960 raft_consensus.cc:2468] T af00ad02fba64998bb25991f6f69f291 P 0efc951052454eec9a58b0cd025945b8 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f3a500981b494979b58d2b1041fec9c8 in term 3.
I20260709 13:23:26.169121 15757 leader_election.cc:304] T af00ad02fba64998bb25991f6f69f291 P f3a500981b494979b58d2b1041fec9c8 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0efc951052454eec9a58b0cd025945b8, f3a500981b494979b58d2b1041fec9c8; no voters: 
I20260709 13:23:26.170336 16014 raft_consensus.cc:2804] T af00ad02fba64998bb25991f6f69f291 P f3a500981b494979b58d2b1041fec9c8 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:23:26.170835 16014 raft_consensus.cc:697] T af00ad02fba64998bb25991f6f69f291 P f3a500981b494979b58d2b1041fec9c8 [term 3 LEADER]: Becoming Leader. State: Replica: f3a500981b494979b58d2b1041fec9c8, State: Running, Role: LEADER
I20260709 13:23:26.172495 15107 raft_consensus.cc:2468] T af00ad02fba64998bb25991f6f69f291 P a722e54d227f4c29a9ed6ce77858003a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f3a500981b494979b58d2b1041fec9c8 in term 3.
I20260709 13:23:26.171725 16014 consensus_queue.cc:237] T af00ad02fba64998bb25991f6f69f291 P f3a500981b494979b58d2b1041fec9c8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } } peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } } peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } }
I20260709 13:23:26.186480 14779 catalog_manager.cc:5697] T af00ad02fba64998bb25991f6f69f291 P f3a500981b494979b58d2b1041fec9c8 reported cstate change: term changed from 2 to 3, leader changed from a722e54d227f4c29a9ed6ce77858003a (127.5.126.68) to f3a500981b494979b58d2b1041fec9c8 (127.5.126.65). New cstate: current_term: 3 leader_uuid: "f3a500981b494979b58d2b1041fec9c8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } health_report { overall_health: UNKNOWN } } }
I20260709 13:23:26.374375 14960 raft_consensus.cc:1275] T 77e8d8b35cf148e99e8274bf65e5ed05 P 0efc951052454eec9a58b0cd025945b8 [term 2 FOLLOWER]: Refusing update from remote peer f3a500981b494979b58d2b1041fec9c8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:23:26.376595 16035 consensus_queue.cc:1048] T 77e8d8b35cf148e99e8274bf65e5ed05 P f3a500981b494979b58d2b1041fec9c8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:23:26.403728 15107 raft_consensus.cc:1275] T 77e8d8b35cf148e99e8274bf65e5ed05 P a722e54d227f4c29a9ed6ce77858003a [term 2 FOLLOWER]: Refusing update from remote peer f3a500981b494979b58d2b1041fec9c8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:23:26.407732 16029 consensus_queue.cc:1048] T 77e8d8b35cf148e99e8274bf65e5ed05 P f3a500981b494979b58d2b1041fec9c8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:23:26.533088 15107 raft_consensus.cc:1275] T e75f8237624f42f793627366f05b792a P a722e54d227f4c29a9ed6ce77858003a [term 2 FOLLOWER]: Refusing update from remote peer f3a500981b494979b58d2b1041fec9c8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:23:26.534394 16035 consensus_queue.cc:1048] T e75f8237624f42f793627366f05b792a P f3a500981b494979b58d2b1041fec9c8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:23:26.546123 14959 raft_consensus.cc:1275] T e75f8237624f42f793627366f05b792a P 0efc951052454eec9a58b0cd025945b8 [term 2 FOLLOWER]: Refusing update from remote peer f3a500981b494979b58d2b1041fec9c8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:23:26.547655 16035 consensus_queue.cc:1048] T e75f8237624f42f793627366f05b792a P f3a500981b494979b58d2b1041fec9c8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:23:26.599423 14954 raft_consensus.cc:1275] T af00ad02fba64998bb25991f6f69f291 P 0efc951052454eec9a58b0cd025945b8 [term 3 FOLLOWER]: Refusing update from remote peer f3a500981b494979b58d2b1041fec9c8: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:23:26.602595 16014 consensus_queue.cc:1048] T af00ad02fba64998bb25991f6f69f291 P f3a500981b494979b58d2b1041fec9c8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:23:26.620059 15107 raft_consensus.cc:1275] T af00ad02fba64998bb25991f6f69f291 P a722e54d227f4c29a9ed6ce77858003a [term 3 FOLLOWER]: Refusing update from remote peer f3a500981b494979b58d2b1041fec9c8: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:23:26.621922 16014 consensus_queue.cc:1048] T af00ad02fba64998bb25991f6f69f291 P f3a500981b494979b58d2b1041fec9c8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:23:26.682375 15107 raft_consensus.cc:1275] T f954c6c25a25443abd9705c8e909bf47 P a722e54d227f4c29a9ed6ce77858003a [term 2 FOLLOWER]: Refusing update from remote peer f3a500981b494979b58d2b1041fec9c8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:23:26.683851 16035 consensus_queue.cc:1048] T f954c6c25a25443abd9705c8e909bf47 P f3a500981b494979b58d2b1041fec9c8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:23:26.695519 14959 raft_consensus.cc:1275] T f954c6c25a25443abd9705c8e909bf47 P 0efc951052454eec9a58b0cd025945b8 [term 2 FOLLOWER]: Refusing update from remote peer f3a500981b494979b58d2b1041fec9c8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:23:26.699191 16036 consensus_queue.cc:1048] T f954c6c25a25443abd9705c8e909bf47 P f3a500981b494979b58d2b1041fec9c8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:23:26.843152  5625 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:23:26.883909  5625 tablet_server.cc:179] TabletServer@127.5.126.65:34129 shutting down...
W20260709 13:23:26.898072 15073 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 186 similar messages]
W20260709 13:23:26.918360 15073 consensus_peers.cc:597] T a71163721b4d48b0b5ff366b9d12ac32 P a722e54d227f4c29a9ed6ce77858003a -> Peer f3a500981b494979b58d2b1041fec9c8 (127.5.126.65:34129): Couldn't send request to peer f3a500981b494979b58d2b1041fec9c8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:23:26.926949 14999 consensus_peers.cc:597] T e3693e8a3b0444bf978dc845dcfd2a45 P a1a22e9119494570b6d2217713fd7e43 -> Peer f3a500981b494979b58d2b1041fec9c8 (127.5.126.65:34129): Couldn't send request to peer f3a500981b494979b58d2b1041fec9c8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:23:26.927639 15073 consensus_peers.cc:597] T 70d027ba81f54eba882756b941186710 P a722e54d227f4c29a9ed6ce77858003a -> Peer f3a500981b494979b58d2b1041fec9c8 (127.5.126.65:34129): Couldn't send request to peer f3a500981b494979b58d2b1041fec9c8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:23:26.996634 15073 consensus_peers.cc:597] T bf0b7c8005aa4d8ab97a1499761bf98a P a722e54d227f4c29a9ed6ce77858003a -> Peer f3a500981b494979b58d2b1041fec9c8 (127.5.126.65:34129): Couldn't send request to peer f3a500981b494979b58d2b1041fec9c8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:23:27.005369 14999 consensus_peers.cc:597] T 7a4cf38d1a6644f082f401b9b26bfb27 P a1a22e9119494570b6d2217713fd7e43 -> Peer f3a500981b494979b58d2b1041fec9c8 (127.5.126.65:34129): Couldn't send request to peer f3a500981b494979b58d2b1041fec9c8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:23:27.007133 14925 consensus_peers.cc:597] T 107541237b4a452e8b47b0c3527b7ede P 0efc951052454eec9a58b0cd025945b8 -> Peer f3a500981b494979b58d2b1041fec9c8 (127.5.126.65:34129): Couldn't send request to peer f3a500981b494979b58d2b1041fec9c8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:23:27.007845 14999 consensus_peers.cc:597] T db6d3d345bd3495e9ec9a0e75ecd0562 P a1a22e9119494570b6d2217713fd7e43 -> Peer f3a500981b494979b58d2b1041fec9c8 (127.5.126.65:34129): Couldn't send request to peer f3a500981b494979b58d2b1041fec9c8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:23:27.008911 14925 consensus_peers.cc:597] T b0b7e1c1e67845cb9bd2208bb2fb7c21 P 0efc951052454eec9a58b0cd025945b8 -> Peer f3a500981b494979b58d2b1041fec9c8 (127.5.126.65:34129): Couldn't send request to peer f3a500981b494979b58d2b1041fec9c8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:23:27.009145  5625 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:23:27.010095  5625 tablet_replica.cc:333] stopping tablet replica
I20260709 13:23:27.010985  5625 raft_consensus.cc:2243] T 2a862e106a9e48a692bc72ea8c03ab39 P f3a500981b494979b58d2b1041fec9c8 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:23:27.012017  5625 raft_consensus.cc:2272] T 2a862e106a9e48a692bc72ea8c03ab39 P f3a500981b494979b58d2b1041fec9c8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:27.014658  5625 tablet_replica.cc:333] stopping tablet replica
I20260709 13:23:27.015369  5625 raft_consensus.cc:2243] T f954c6c25a25443abd9705c8e909bf47 P f3a500981b494979b58d2b1041fec9c8 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:23:27.016325  5625 raft_consensus.cc:2272] T f954c6c25a25443abd9705c8e909bf47 P f3a500981b494979b58d2b1041fec9c8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:27.019348  5625 tablet_replica.cc:333] stopping tablet replica
I20260709 13:23:27.020394  5625 raft_consensus.cc:2243] T 7560205f5d324c7d821dff8efe7a6256 P f3a500981b494979b58d2b1041fec9c8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:23:27.020963  5625 raft_consensus.cc:2272] T 7560205f5d324c7d821dff8efe7a6256 P f3a500981b494979b58d2b1041fec9c8 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:23:27.024281 15073 consensus_peers.cc:597] T 0819f8999271428481a1f839026171a7 P a722e54d227f4c29a9ed6ce77858003a -> Peer f3a500981b494979b58d2b1041fec9c8 (127.5.126.65:34129): Couldn't send request to peer f3a500981b494979b58d2b1041fec9c8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:23:27.026840  5625 tablet_replica.cc:333] stopping tablet replica
I20260709 13:23:27.028306  5625 raft_consensus.cc:2243] T 08dea3083d334745abe54f9b220bd86a P f3a500981b494979b58d2b1041fec9c8 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:23:27.029444  5625 raft_consensus.cc:2272] T 08dea3083d334745abe54f9b220bd86a P f3a500981b494979b58d2b1041fec9c8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:27.032943  5625 tablet_replica.cc:333] stopping tablet replica
I20260709 13:23:27.034027  5625 raft_consensus.cc:2243] T e4f2c694c8194f1e86ad76c7ff051ea7 P f3a500981b494979b58d2b1041fec9c8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:23:27.034590  5625 raft_consensus.cc:2272] T e4f2c694c8194f1e86ad76c7ff051ea7 P f3a500981b494979b58d2b1041fec9c8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:27.037693  5625 tablet_replica.cc:333] stopping tablet replica
I20260709 13:23:27.038578  5625 raft_consensus.cc:2243] T e85432ede09747339c957cdaa7d15ac6 P f3a500981b494979b58d2b1041fec9c8 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:23:27.039134  5625 raft_consensus.cc:2272] T e85432ede09747339c957cdaa7d15ac6 P f3a500981b494979b58d2b1041fec9c8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:27.042771  5625 tablet_replica.cc:333] stopping tablet replica
I20260709 13:23:27.043604  5625 raft_consensus.cc:2243] T 268027ae94a54cf4acf51c54c7b9032b P f3a500981b494979b58d2b1041fec9c8 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:23:27.044798  5625 raft_consensus.cc:2272] T 268027ae94a54cf4acf51c54c7b9032b P f3a500981b494979b58d2b1041fec9c8 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:23:27.045614 14999 consensus_peers.cc:597] T 03f377f48e8849adade3945935d300a9 P a1a22e9119494570b6d2217713fd7e43 -> Peer f3a500981b494979b58d2b1041fec9c8 (127.5.126.65:34129): Couldn't send request to peer f3a500981b494979b58d2b1041fec9c8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:23:27.047997  5625 tablet_replica.cc:333] stopping tablet replica
I20260709 13:23:27.049129  5625 raft_consensus.cc:2243] T aecef3c240394d54844ec8170e9cad59 P f3a500981b494979b58d2b1041fec9c8 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:23:27.049743  5625 raft_consensus.cc:2272] T aecef3c240394d54844ec8170e9cad59 P f3a500981b494979b58d2b1041fec9c8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:27.054306  5625 tablet_replica.cc:333] stopping tablet replica
I20260709 13:23:27.055073  5625 raft_consensus.cc:2243] T 914c9c0c3be1486f8dcce382b61b5450 P f3a500981b494979b58d2b1041fec9c8 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:23:27.055968  5625 raft_consensus.cc:2272] T 914c9c0c3be1486f8dcce382b61b5450 P f3a500981b494979b58d2b1041fec9c8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:27.058399  5625 tablet_replica.cc:333] stopping tablet replica
I20260709 13:23:27.059087  5625 raft_consensus.cc:2243] T e3693e8a3b0444bf978dc845dcfd2a45 P f3a500981b494979b58d2b1041fec9c8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:23:27.059525  5625 raft_consensus.cc:2272] T e3693e8a3b0444bf978dc845dcfd2a45 P f3a500981b494979b58d2b1041fec9c8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:27.061760  5625 tablet_replica.cc:333] stopping tablet replica
I20260709 13:23:27.062456  5625 raft_consensus.cc:2243] T e1ae79ed138a4950a681f24aa1107ef3 P f3a500981b494979b58d2b1041fec9c8 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:23:27.063300  5625 raft_consensus.cc:2272] T e1ae79ed138a4950a681f24aa1107ef3 P f3a500981b494979b58d2b1041fec9c8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:27.065881  5625 tablet_replica.cc:333] stopping tablet replica
I20260709 13:23:27.066677  5625 raft_consensus.cc:2243] T dee43e01ec5d409b877a5c2dbf5b7b77 P f3a500981b494979b58d2b1041fec9c8 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:23:27.067170  5625 raft_consensus.cc:2272] T dee43e01ec5d409b877a5c2dbf5b7b77 P f3a500981b494979b58d2b1041fec9c8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:27.070123  5625 tablet_replica.cc:333] stopping tablet replica
I20260709 13:23:27.071128  5625 raft_consensus.cc:2243] T 58a622a48cd24833bc5fc27e03114176 P f3a500981b494979b58d2b1041fec9c8 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:23:27.072072  5625 raft_consensus.cc:2272] T 58a622a48cd24833bc5fc27e03114176 P f3a500981b494979b58d2b1041fec9c8 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:27.074599  5625 tablet_replica.cc:333] stopping tablet replica
I20260709 13:23:27.075467  5625 raft_consensus.cc:2243] T 03b63e2bee374ed5931dab67ee14b555 P f3a500981b494979b58d2b1041fec9c8 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:23:27.076131  5625 raft_consensus.cc:2272] T 03b63e2bee374ed5931dab67ee14b555 P f3a500981b494979b58d2b1041fec9c8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:27.079578  5625 tablet_replica.cc:333] stopping tablet replica
W20260709 13:23:27.079789 14999 consensus_peers.cc:597] T 5df7528567fd4291a888bfb37c28dc27 P a1a22e9119494570b6d2217713fd7e43 -> Peer f3a500981b494979b58d2b1041fec9c8 (127.5.126.65:34129): Couldn't send request to peer f3a500981b494979b58d2b1041fec9c8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:23:27.080444  5625 raft_consensus.cc:2243] T e75f8237624f42f793627366f05b792a P f3a500981b494979b58d2b1041fec9c8 [term 2 LEADER]: Raft consensus shutting down.
W20260709 13:23:27.081228 14999 consensus_peers.cc:597] T 2956fb66a7f34f3e99f42598fb93178e P a1a22e9119494570b6d2217713fd7e43 -> Peer f3a500981b494979b58d2b1041fec9c8 (127.5.126.65:34129): Couldn't send request to peer f3a500981b494979b58d2b1041fec9c8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:23:27.081518  5625 raft_consensus.cc:2272] T e75f8237624f42f793627366f05b792a P f3a500981b494979b58d2b1041fec9c8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:27.085184  5625 tablet_replica.cc:333] stopping tablet replica
I20260709 13:23:27.086218  5625 raft_consensus.cc:2243] T 7a4cf38d1a6644f082f401b9b26bfb27 P f3a500981b494979b58d2b1041fec9c8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:23:27.086916  5625 raft_consensus.cc:2272] T 7a4cf38d1a6644f082f401b9b26bfb27 P f3a500981b494979b58d2b1041fec9c8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:27.090382  5625 tablet_replica.cc:333] stopping tablet replica
I20260709 13:23:27.091408  5625 raft_consensus.cc:2243] T a71163721b4d48b0b5ff366b9d12ac32 P f3a500981b494979b58d2b1041fec9c8 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:23:27.092020  5625 raft_consensus.cc:2272] T a71163721b4d48b0b5ff366b9d12ac32 P f3a500981b494979b58d2b1041fec9c8 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:23:27.093487 14925 consensus_peers.cc:597] T 74a144396e4443288858878b63f08cc8 P 0efc951052454eec9a58b0cd025945b8 -> Peer f3a500981b494979b58d2b1041fec9c8 (127.5.126.65:34129): Couldn't send request to peer f3a500981b494979b58d2b1041fec9c8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:23:27.095446  5625 tablet_replica.cc:333] stopping tablet replica
I20260709 13:23:27.096477  5625 raft_consensus.cc:2243] T 16d5db73377a4925b9f1e814ba306fcc P f3a500981b494979b58d2b1041fec9c8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:23:27.097043  5625 raft_consensus.cc:2272] T 16d5db73377a4925b9f1e814ba306fcc P f3a500981b494979b58d2b1041fec9c8 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:23:27.100236 15073 consensus_peers.cc:597] T dee43e01ec5d409b877a5c2dbf5b7b77 P a722e54d227f4c29a9ed6ce77858003a -> Peer f3a500981b494979b58d2b1041fec9c8 (127.5.126.65:34129): Couldn't send request to peer f3a500981b494979b58d2b1041fec9c8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:23:27.100653  5625 tablet_replica.cc:333] stopping tablet replica
I20260709 13:23:27.101604  5625 raft_consensus.cc:2243] T af00ad02fba64998bb25991f6f69f291 P f3a500981b494979b58d2b1041fec9c8 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:23:27.102483  5625 raft_consensus.cc:2272] T af00ad02fba64998bb25991f6f69f291 P f3a500981b494979b58d2b1041fec9c8 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:27.105774  5625 tablet_replica.cc:333] stopping tablet replica
I20260709 13:23:27.106565  5625 raft_consensus.cc:2243] T 8996bae84ecc4bffa0239d64dce7b24f P f3a500981b494979b58d2b1041fec9c8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:23:27.107064  5625 raft_consensus.cc:2272] T 8996bae84ecc4bffa0239d64dce7b24f P f3a500981b494979b58d2b1041fec9c8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:27.110268  5625 tablet_replica.cc:333] stopping tablet replica
I20260709 13:23:27.111678  5625 raft_consensus.cc:2243] T 48be8cf045364be999b8f0fd547b7b9d P f3a500981b494979b58d2b1041fec9c8 [term 2 LEADER]: Raft consensus shutting down.
W20260709 13:23:27.112581 14999 consensus_peers.cc:597] T 16d5db73377a4925b9f1e814ba306fcc P a1a22e9119494570b6d2217713fd7e43 -> Peer f3a500981b494979b58d2b1041fec9c8 (127.5.126.65:34129): Couldn't send request to peer f3a500981b494979b58d2b1041fec9c8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:23:27.112915  5625 raft_consensus.cc:2272] T 48be8cf045364be999b8f0fd547b7b9d P f3a500981b494979b58d2b1041fec9c8 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:23:27.115800 14925 consensus_peers.cc:597] T 7560205f5d324c7d821dff8efe7a6256 P 0efc951052454eec9a58b0cd025945b8 -> Peer f3a500981b494979b58d2b1041fec9c8 (127.5.126.65:34129): Couldn't send request to peer f3a500981b494979b58d2b1041fec9c8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:23:27.116504  5625 tablet_replica.cc:333] stopping tablet replica
I20260709 13:23:27.117467  5625 raft_consensus.cc:2243] T bf0b7c8005aa4d8ab97a1499761bf98a P f3a500981b494979b58d2b1041fec9c8 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:23:27.118098  5625 raft_consensus.cc:2272] T bf0b7c8005aa4d8ab97a1499761bf98a P f3a500981b494979b58d2b1041fec9c8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:27.121093  5625 tablet_replica.cc:333] stopping tablet replica
I20260709 13:23:27.121693  5625 raft_consensus.cc:2243] T db6d3d345bd3495e9ec9a0e75ecd0562 P f3a500981b494979b58d2b1041fec9c8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:23:27.122071  5625 raft_consensus.cc:2272] T db6d3d345bd3495e9ec9a0e75ecd0562 P f3a500981b494979b58d2b1041fec9c8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:27.124444  5625 tablet_replica.cc:333] stopping tablet replica
I20260709 13:23:27.125020  5625 raft_consensus.cc:2243] T 107541237b4a452e8b47b0c3527b7ede P f3a500981b494979b58d2b1041fec9c8 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:23:27.125512  5625 raft_consensus.cc:2272] T 107541237b4a452e8b47b0c3527b7ede P f3a500981b494979b58d2b1041fec9c8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:27.127717  5625 tablet_replica.cc:333] stopping tablet replica
I20260709 13:23:27.128388  5625 raft_consensus.cc:2243] T dadd194761924530aede05672c9eecf9 P f3a500981b494979b58d2b1041fec9c8 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:23:27.129204  5625 raft_consensus.cc:2272] T dadd194761924530aede05672c9eecf9 P f3a500981b494979b58d2b1041fec9c8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:27.131680  5625 tablet_replica.cc:333] stopping tablet replica
I20260709 13:23:27.132359  5625 raft_consensus.cc:2243] T d65eaa0ab4574a1ea92b3848d4dc9c4d P f3a500981b494979b58d2b1041fec9c8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:23:27.132781  5625 raft_consensus.cc:2272] T d65eaa0ab4574a1ea92b3848d4dc9c4d P f3a500981b494979b58d2b1041fec9c8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:27.135203  5625 tablet_replica.cc:333] stopping tablet replica
I20260709 13:23:27.135831  5625 raft_consensus.cc:2243] T affcb03ab55349748a95c103059d2955 P f3a500981b494979b58d2b1041fec9c8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:23:27.136304  5625 raft_consensus.cc:2272] T affcb03ab55349748a95c103059d2955 P f3a500981b494979b58d2b1041fec9c8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:27.139523  5625 tablet_replica.cc:333] stopping tablet replica
I20260709 13:23:27.140704  5625 raft_consensus.cc:2243] T abc01daa220a47fa8578b0d20a17c9ab P f3a500981b494979b58d2b1041fec9c8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:23:27.141376  5625 raft_consensus.cc:2272] T abc01daa220a47fa8578b0d20a17c9ab P f3a500981b494979b58d2b1041fec9c8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:27.145120  5625 tablet_replica.cc:333] stopping tablet replica
I20260709 13:23:27.145967  5625 raft_consensus.cc:2243] T 2956fb66a7f34f3e99f42598fb93178e P f3a500981b494979b58d2b1041fec9c8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:23:27.146513  5625 raft_consensus.cc:2272] T 2956fb66a7f34f3e99f42598fb93178e P f3a500981b494979b58d2b1041fec9c8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:27.149919  5625 tablet_replica.cc:333] stopping tablet replica
W20260709 13:23:27.150034 14999 consensus_peers.cc:597] T c3abd41db36d404089eaf1f9063bbcb0 P a1a22e9119494570b6d2217713fd7e43 -> Peer f3a500981b494979b58d2b1041fec9c8 (127.5.126.65:34129): Couldn't send request to peer f3a500981b494979b58d2b1041fec9c8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:23:27.150884  5625 raft_consensus.cc:2243] T 88a7c4171c664e819837994755edf95c P f3a500981b494979b58d2b1041fec9c8 [term 1 FOLLOWER]: Raft consensus shutting down.
W20260709 13:23:27.151475 15073 consensus_peers.cc:597] T 8996bae84ecc4bffa0239d64dce7b24f P a722e54d227f4c29a9ed6ce77858003a -> Peer f3a500981b494979b58d2b1041fec9c8 (127.5.126.65:34129): Couldn't send request to peer f3a500981b494979b58d2b1041fec9c8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:23:27.151582  5625 raft_consensus.cc:2272] T 88a7c4171c664e819837994755edf95c P f3a500981b494979b58d2b1041fec9c8 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:23:27.152511 15073 consensus_peers.cc:597] T f86a730e237248dc9b91cbb75e29c324 P a722e54d227f4c29a9ed6ce77858003a -> Peer f3a500981b494979b58d2b1041fec9c8 (127.5.126.65:34129): Couldn't send request to peer f3a500981b494979b58d2b1041fec9c8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:23:27.154868  5625 tablet_replica.cc:333] stopping tablet replica
I20260709 13:23:27.155798  5625 raft_consensus.cc:2243] T 940021bf0c344d01bc3adaae308d968d P f3a500981b494979b58d2b1041fec9c8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:23:27.156335  5625 raft_consensus.cc:2272] T 940021bf0c344d01bc3adaae308d968d P f3a500981b494979b58d2b1041fec9c8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:27.158898  5625 tablet_replica.cc:333] stopping tablet replica
I20260709 13:23:27.159605  5625 raft_consensus.cc:2243] T c3abd41db36d404089eaf1f9063bbcb0 P f3a500981b494979b58d2b1041fec9c8 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:23:27.160120  5625 raft_consensus.cc:2272] T c3abd41db36d404089eaf1f9063bbcb0 P f3a500981b494979b58d2b1041fec9c8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:27.162894  5625 tablet_replica.cc:333] stopping tablet replica
I20260709 13:23:27.163904  5625 raft_consensus.cc:2243] T b0b7e1c1e67845cb9bd2208bb2fb7c21 P f3a500981b494979b58d2b1041fec9c8 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:23:27.164433  5625 raft_consensus.cc:2272] T b0b7e1c1e67845cb9bd2208bb2fb7c21 P f3a500981b494979b58d2b1041fec9c8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:27.167865  5625 tablet_replica.cc:333] stopping tablet replica
I20260709 13:23:27.168740  5625 raft_consensus.cc:2243] T 0819f8999271428481a1f839026171a7 P f3a500981b494979b58d2b1041fec9c8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:23:27.169224  5625 raft_consensus.cc:2272] T 0819f8999271428481a1f839026171a7 P f3a500981b494979b58d2b1041fec9c8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:27.172202  5625 tablet_replica.cc:333] stopping tablet replica
I20260709 13:23:27.172897  5625 raft_consensus.cc:2243] T 03f377f48e8849adade3945935d300a9 P f3a500981b494979b58d2b1041fec9c8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:23:27.173418  5625 raft_consensus.cc:2272] T 03f377f48e8849adade3945935d300a9 P f3a500981b494979b58d2b1041fec9c8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:27.175967  5625 tablet_replica.cc:333] stopping tablet replica
I20260709 13:23:27.176729  5625 raft_consensus.cc:2243] T 70d027ba81f54eba882756b941186710 P f3a500981b494979b58d2b1041fec9c8 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:23:27.177263  5625 raft_consensus.cc:2272] T 70d027ba81f54eba882756b941186710 P f3a500981b494979b58d2b1041fec9c8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:27.179929  5625 tablet_replica.cc:333] stopping tablet replica
I20260709 13:23:27.180682  5625 raft_consensus.cc:2243] T 5df7528567fd4291a888bfb37c28dc27 P f3a500981b494979b58d2b1041fec9c8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:23:27.181201  5625 raft_consensus.cc:2272] T 5df7528567fd4291a888bfb37c28dc27 P f3a500981b494979b58d2b1041fec9c8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:27.184072  5625 tablet_replica.cc:333] stopping tablet replica
I20260709 13:23:27.184818  5625 raft_consensus.cc:2243] T 46ed2e9dd1324ac4a6e07f813cfebb7e P f3a500981b494979b58d2b1041fec9c8 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:23:27.185346  5625 raft_consensus.cc:2272] T 46ed2e9dd1324ac4a6e07f813cfebb7e P f3a500981b494979b58d2b1041fec9c8 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:23:27.188016 14925 consensus_peers.cc:597] T b025139466084200b70879196cd3f922 P 0efc951052454eec9a58b0cd025945b8 -> Peer f3a500981b494979b58d2b1041fec9c8 (127.5.126.65:34129): Couldn't send request to peer f3a500981b494979b58d2b1041fec9c8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:23:27.188534  5625 tablet_replica.cc:333] stopping tablet replica
I20260709 13:23:27.189427  5625 raft_consensus.cc:2243] T f86a730e237248dc9b91cbb75e29c324 P f3a500981b494979b58d2b1041fec9c8 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:23:27.189966  5625 raft_consensus.cc:2272] T f86a730e237248dc9b91cbb75e29c324 P f3a500981b494979b58d2b1041fec9c8 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:23:27.190637 14925 consensus_peers.cc:597] T affcb03ab55349748a95c103059d2955 P 0efc951052454eec9a58b0cd025945b8 -> Peer f3a500981b494979b58d2b1041fec9c8 (127.5.126.65:34129): Couldn't send request to peer f3a500981b494979b58d2b1041fec9c8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:23:27.193004  5625 tablet_replica.cc:333] stopping tablet replica
I20260709 13:23:27.193809  5625 raft_consensus.cc:2243] T 77e8d8b35cf148e99e8274bf65e5ed05 P f3a500981b494979b58d2b1041fec9c8 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:23:27.194574  5625 raft_consensus.cc:2272] T 77e8d8b35cf148e99e8274bf65e5ed05 P f3a500981b494979b58d2b1041fec9c8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:27.197109  5625 tablet_replica.cc:333] stopping tablet replica
I20260709 13:23:27.197790  5625 raft_consensus.cc:2243] T 74a144396e4443288858878b63f08cc8 P f3a500981b494979b58d2b1041fec9c8 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:23:27.198216  5625 raft_consensus.cc:2272] T 74a144396e4443288858878b63f08cc8 P f3a500981b494979b58d2b1041fec9c8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:27.200608  5625 tablet_replica.cc:333] stopping tablet replica
I20260709 13:23:27.201296  5625 raft_consensus.cc:2243] T d64d06459b344ff99c0df07c249c3a60 P f3a500981b494979b58d2b1041fec9c8 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:23:27.202260  5625 raft_consensus.cc:2272] T d64d06459b344ff99c0df07c249c3a60 P f3a500981b494979b58d2b1041fec9c8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:27.204668  5625 tablet_replica.cc:333] stopping tablet replica
I20260709 13:23:27.205274  5625 raft_consensus.cc:2243] T 2a9523aa8663464686254c8412c37e67 P f3a500981b494979b58d2b1041fec9c8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:23:27.205777  5625 raft_consensus.cc:2272] T 2a9523aa8663464686254c8412c37e67 P f3a500981b494979b58d2b1041fec9c8 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:23:27.207850 15073 consensus_peers.cc:597] T 2a9523aa8663464686254c8412c37e67 P a722e54d227f4c29a9ed6ce77858003a -> Peer f3a500981b494979b58d2b1041fec9c8 (127.5.126.65:34129): Couldn't send request to peer f3a500981b494979b58d2b1041fec9c8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:23:27.208626  5625 tablet_replica.cc:333] stopping tablet replica
I20260709 13:23:27.209483  5625 raft_consensus.cc:2243] T b025139466084200b70879196cd3f922 P f3a500981b494979b58d2b1041fec9c8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:23:27.209966  5625 raft_consensus.cc:2272] T b025139466084200b70879196cd3f922 P f3a500981b494979b58d2b1041fec9c8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:27.212112  5625 tablet_replica.cc:333] stopping tablet replica
I20260709 13:23:27.212559  5625 raft_consensus.cc:2243] T 532cc9041f414e018098570192e0fae8 P f3a500981b494979b58d2b1041fec9c8 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:23:27.213234  5625 raft_consensus.cc:2272] T 532cc9041f414e018098570192e0fae8 P f3a500981b494979b58d2b1041fec9c8 [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 13:23:27.245227 14925 consensus_peers.cc:597] T 88a7c4171c664e819837994755edf95c P 0efc951052454eec9a58b0cd025945b8 -> Peer f3a500981b494979b58d2b1041fec9c8 (127.5.126.65:34129): Couldn't send request to peer f3a500981b494979b58d2b1041fec9c8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:23:27.247368 15073 consensus_peers.cc:597] T 940021bf0c344d01bc3adaae308d968d P a722e54d227f4c29a9ed6ce77858003a -> Peer f3a500981b494979b58d2b1041fec9c8 (127.5.126.65:34129): Couldn't send request to peer f3a500981b494979b58d2b1041fec9c8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:23:27.294039  5625 tablet_server.cc:196] TabletServer@127.5.126.65:34129 shutdown complete.
W20260709 13:23:27.305044 14925 consensus_peers.cc:597] T 46ed2e9dd1324ac4a6e07f813cfebb7e P 0efc951052454eec9a58b0cd025945b8 -> Peer f3a500981b494979b58d2b1041fec9c8 (127.5.126.65:34129): Couldn't send request to peer f3a500981b494979b58d2b1041fec9c8. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:34129: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:23:27.343140 14999 consensus_peers.cc:597] T 03b63e2bee374ed5931dab67ee14b555 P a1a22e9119494570b6d2217713fd7e43 -> Peer f3a500981b494979b58d2b1041fec9c8 (127.5.126.65:34129): Couldn't send request to peer f3a500981b494979b58d2b1041fec9c8. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:34129: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:23:27.377023 14999 consensus_peers.cc:597] T abc01daa220a47fa8578b0d20a17c9ab P a1a22e9119494570b6d2217713fd7e43 -> Peer f3a500981b494979b58d2b1041fec9c8 (127.5.126.65:34129): Couldn't send request to peer f3a500981b494979b58d2b1041fec9c8. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:34129: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:23:27.378800 15073 consensus_peers.cc:597] T e4f2c694c8194f1e86ad76c7ff051ea7 P a722e54d227f4c29a9ed6ce77858003a -> Peer f3a500981b494979b58d2b1041fec9c8 (127.5.126.65:34129): Couldn't send request to peer f3a500981b494979b58d2b1041fec9c8. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:34129: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:23:27.409581 14925 consensus_peers.cc:597] T aecef3c240394d54844ec8170e9cad59 P 0efc951052454eec9a58b0cd025945b8 -> Peer f3a500981b494979b58d2b1041fec9c8 (127.5.126.65:34129): Couldn't send request to peer f3a500981b494979b58d2b1041fec9c8. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:34129: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:23:27.409870 14999 consensus_peers.cc:597] T e85432ede09747339c957cdaa7d15ac6 P a1a22e9119494570b6d2217713fd7e43 -> Peer f3a500981b494979b58d2b1041fec9c8 (127.5.126.65:34129): Couldn't send request to peer f3a500981b494979b58d2b1041fec9c8. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:34129: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:23:27.421701  5625 tablet_server.cc:179] TabletServer@127.5.126.66:0 shutting down...
W20260709 13:23:27.439273 15073 consensus_peers.cc:597] T d65eaa0ab4574a1ea92b3848d4dc9c4d P a722e54d227f4c29a9ed6ce77858003a -> Peer f3a500981b494979b58d2b1041fec9c8 (127.5.126.65:34129): Couldn't send request to peer f3a500981b494979b58d2b1041fec9c8. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:34129: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:23:27.473136 15073 consensus_peers.cc:597] T 940021bf0c344d01bc3adaae308d968d P a722e54d227f4c29a9ed6ce77858003a -> Peer 0efc951052454eec9a58b0cd025945b8 (127.5.126.66:34613): Couldn't send request to peer 0efc951052454eec9a58b0cd025945b8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:23:27.488440 15073 consensus_peers.cc:597] T e4f2c694c8194f1e86ad76c7ff051ea7 P a722e54d227f4c29a9ed6ce77858003a -> Peer 0efc951052454eec9a58b0cd025945b8 (127.5.126.66:34613): Couldn't send request to peer 0efc951052454eec9a58b0cd025945b8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:23:27.497582 14999 consensus_peers.cc:597] T e3693e8a3b0444bf978dc845dcfd2a45 P a1a22e9119494570b6d2217713fd7e43 -> Peer 0efc951052454eec9a58b0cd025945b8 (127.5.126.66:34613): Couldn't send request to peer 0efc951052454eec9a58b0cd025945b8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:23:27.506150  5625 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:23:27.507464  5625 tablet_replica.cc:333] T 34e83f249d9942e99244702be584c8ae P 0efc951052454eec9a58b0cd025945b8: stopping tablet replica
I20260709 13:23:27.508754  5625 raft_consensus.cc:2243] T 34e83f249d9942e99244702be584c8ae P 0efc951052454eec9a58b0cd025945b8 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:23:27.511250  5625 raft_consensus.cc:2272] T 34e83f249d9942e99244702be584c8ae P 0efc951052454eec9a58b0cd025945b8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:27.514485  5625 tablet_replica.cc:333] T af00ad02fba64998bb25991f6f69f291 P 0efc951052454eec9a58b0cd025945b8: stopping tablet replica
I20260709 13:23:27.515260  5625 raft_consensus.cc:2243] T af00ad02fba64998bb25991f6f69f291 P 0efc951052454eec9a58b0cd025945b8 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:23:27.515865  5625 raft_consensus.cc:2272] T af00ad02fba64998bb25991f6f69f291 P 0efc951052454eec9a58b0cd025945b8 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:27.519804  5625 tablet_replica.cc:333] T 08dea3083d334745abe54f9b220bd86a P 0efc951052454eec9a58b0cd025945b8: stopping tablet replica
I20260709 13:23:27.521090  5625 raft_consensus.cc:2243] T 08dea3083d334745abe54f9b220bd86a P 0efc951052454eec9a58b0cd025945b8 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:23:27.521565  5625 raft_consensus.cc:2272] T 08dea3083d334745abe54f9b220bd86a P 0efc951052454eec9a58b0cd025945b8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:27.523675  5625 tablet_replica.cc:333] T 2956fb66a7f34f3e99f42598fb93178e P 0efc951052454eec9a58b0cd025945b8: stopping tablet replica
I20260709 13:23:27.524420  5625 raft_consensus.cc:2243] T 2956fb66a7f34f3e99f42598fb93178e P 0efc951052454eec9a58b0cd025945b8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:23:27.524940  5625 raft_consensus.cc:2272] T 2956fb66a7f34f3e99f42598fb93178e P 0efc951052454eec9a58b0cd025945b8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:27.527222  5625 tablet_replica.cc:333] T affcb03ab55349748a95c103059d2955 P 0efc951052454eec9a58b0cd025945b8: stopping tablet replica
I20260709 13:23:27.528075  5625 raft_consensus.cc:2243] T affcb03ab55349748a95c103059d2955 P 0efc951052454eec9a58b0cd025945b8 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:23:27.529146  5625 raft_consensus.cc:2272] T affcb03ab55349748a95c103059d2955 P 0efc951052454eec9a58b0cd025945b8 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:23:27.531890 15073 consensus_peers.cc:597] T a2de4fecd70240dd8ed436fa8de65773 P a722e54d227f4c29a9ed6ce77858003a -> Peer 0efc951052454eec9a58b0cd025945b8 (127.5.126.66:34613): Couldn't send request to peer 0efc951052454eec9a58b0cd025945b8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:23:27.531982  5625 tablet_replica.cc:333] T a2de4fecd70240dd8ed436fa8de65773 P 0efc951052454eec9a58b0cd025945b8: stopping tablet replica
I20260709 13:23:27.533232  5625 raft_consensus.cc:2243] T a2de4fecd70240dd8ed436fa8de65773 P 0efc951052454eec9a58b0cd025945b8 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:23:27.533851  5625 raft_consensus.cc:2272] T a2de4fecd70240dd8ed436fa8de65773 P 0efc951052454eec9a58b0cd025945b8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:27.536935  5625 tablet_replica.cc:333] T b0b7e1c1e67845cb9bd2208bb2fb7c21 P 0efc951052454eec9a58b0cd025945b8: stopping tablet replica
I20260709 13:23:27.537600  5625 raft_consensus.cc:2243] T b0b7e1c1e67845cb9bd2208bb2fb7c21 P 0efc951052454eec9a58b0cd025945b8 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:23:27.538558  5625 raft_consensus.cc:2272] T b0b7e1c1e67845cb9bd2208bb2fb7c21 P 0efc951052454eec9a58b0cd025945b8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:27.541038  5625 tablet_replica.cc:333] T 2a9523aa8663464686254c8412c37e67 P 0efc951052454eec9a58b0cd025945b8: stopping tablet replica
I20260709 13:23:27.541666  5625 raft_consensus.cc:2243] T 2a9523aa8663464686254c8412c37e67 P 0efc951052454eec9a58b0cd025945b8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:23:27.542107  5625 raft_consensus.cc:2272] T 2a9523aa8663464686254c8412c37e67 P 0efc951052454eec9a58b0cd025945b8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:27.544432  5625 tablet_replica.cc:333] T d64d06459b344ff99c0df07c249c3a60 P 0efc951052454eec9a58b0cd025945b8: stopping tablet replica
I20260709 13:23:27.545073  5625 raft_consensus.cc:2243] T d64d06459b344ff99c0df07c249c3a60 P 0efc951052454eec9a58b0cd025945b8 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:23:27.545601  5625 raft_consensus.cc:2272] T d64d06459b344ff99c0df07c249c3a60 P 0efc951052454eec9a58b0cd025945b8 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:23:27.547693 15073 consensus_peers.cc:597] T ad084674821d4137b02efe692068d382 P a722e54d227f4c29a9ed6ce77858003a -> Peer 0efc951052454eec9a58b0cd025945b8 (127.5.126.66:34613): Couldn't send request to peer 0efc951052454eec9a58b0cd025945b8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:23:27.548265  5625 tablet_replica.cc:333] T 88a7c4171c664e819837994755edf95c P 0efc951052454eec9a58b0cd025945b8: stopping tablet replica
I20260709 13:23:27.548883  5625 raft_consensus.cc:2243] T 88a7c4171c664e819837994755edf95c P 0efc951052454eec9a58b0cd025945b8 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:23:27.549639  5625 raft_consensus.cc:2272] T 88a7c4171c664e819837994755edf95c P 0efc951052454eec9a58b0cd025945b8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:27.552102  5625 tablet_replica.cc:333] T 58a622a48cd24833bc5fc27e03114176 P 0efc951052454eec9a58b0cd025945b8: stopping tablet replica
I20260709 13:23:27.552749  5625 raft_consensus.cc:2243] T 58a622a48cd24833bc5fc27e03114176 P 0efc951052454eec9a58b0cd025945b8 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:23:27.553138  5625 raft_consensus.cc:2272] T 58a622a48cd24833bc5fc27e03114176 P 0efc951052454eec9a58b0cd025945b8 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:27.555320  5625 tablet_replica.cc:333] T c3abd41db36d404089eaf1f9063bbcb0 P 0efc951052454eec9a58b0cd025945b8: stopping tablet replica
I20260709 13:23:27.555881  5625 raft_consensus.cc:2243] T c3abd41db36d404089eaf1f9063bbcb0 P 0efc951052454eec9a58b0cd025945b8 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:23:27.556383  5625 raft_consensus.cc:2272] T c3abd41db36d404089eaf1f9063bbcb0 P 0efc951052454eec9a58b0cd025945b8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:27.558568  5625 tablet_replica.cc:333] T e4f2c694c8194f1e86ad76c7ff051ea7 P 0efc951052454eec9a58b0cd025945b8: stopping tablet replica
I20260709 13:23:27.559290  5625 raft_consensus.cc:2243] T e4f2c694c8194f1e86ad76c7ff051ea7 P 0efc951052454eec9a58b0cd025945b8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:23:27.559695  5625 raft_consensus.cc:2272] T e4f2c694c8194f1e86ad76c7ff051ea7 P 0efc951052454eec9a58b0cd025945b8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:27.561826  5625 tablet_replica.cc:333] T f954c6c25a25443abd9705c8e909bf47 P 0efc951052454eec9a58b0cd025945b8: stopping tablet replica
I20260709 13:23:27.562391  5625 raft_consensus.cc:2243] T f954c6c25a25443abd9705c8e909bf47 P 0efc951052454eec9a58b0cd025945b8 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:23:27.562809  5625 raft_consensus.cc:2272] T f954c6c25a25443abd9705c8e909bf47 P 0efc951052454eec9a58b0cd025945b8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:27.565600  5625 tablet_replica.cc:333] T e429eefef04d433e8f18dfbc0387068d P 0efc951052454eec9a58b0cd025945b8: stopping tablet replica
I20260709 13:23:27.566212  5625 raft_consensus.cc:2243] T e429eefef04d433e8f18dfbc0387068d P 0efc951052454eec9a58b0cd025945b8 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:23:27.566653  5625 raft_consensus.cc:2272] T e429eefef04d433e8f18dfbc0387068d P 0efc951052454eec9a58b0cd025945b8 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:27.568711  5625 tablet_replica.cc:333] T 7e29a38455b241239882b6af3eac3d51 P 0efc951052454eec9a58b0cd025945b8: stopping tablet replica
I20260709 13:23:27.569278  5625 raft_consensus.cc:2243] T 7e29a38455b241239882b6af3eac3d51 P 0efc951052454eec9a58b0cd025945b8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:23:27.569766  5625 raft_consensus.cc:2272] T 7e29a38455b241239882b6af3eac3d51 P 0efc951052454eec9a58b0cd025945b8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:27.572611  5625 tablet_replica.cc:333] T 7b8e0fe5ef6d4c42b9854399aac3a1d6 P 0efc951052454eec9a58b0cd025945b8: stopping tablet replica
I20260709 13:23:27.573421  5625 raft_consensus.cc:2243] T 7b8e0fe5ef6d4c42b9854399aac3a1d6 P 0efc951052454eec9a58b0cd025945b8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:23:27.573987  5625 raft_consensus.cc:2272] T 7b8e0fe5ef6d4c42b9854399aac3a1d6 P 0efc951052454eec9a58b0cd025945b8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:27.576954  5625 tablet_replica.cc:333] T e4a490a7748841c3803607059f9d8825 P 0efc951052454eec9a58b0cd025945b8: stopping tablet replica
I20260709 13:23:27.577726  5625 raft_consensus.cc:2243] T e4a490a7748841c3803607059f9d8825 P 0efc951052454eec9a58b0cd025945b8 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:23:27.578234  5625 raft_consensus.cc:2272] T e4a490a7748841c3803607059f9d8825 P 0efc951052454eec9a58b0cd025945b8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:27.581133  5625 tablet_replica.cc:333] T 2a862e106a9e48a692bc72ea8c03ab39 P 0efc951052454eec9a58b0cd025945b8: stopping tablet replica
I20260709 13:23:27.581888  5625 raft_consensus.cc:2243] T 2a862e106a9e48a692bc72ea8c03ab39 P 0efc951052454eec9a58b0cd025945b8 [term 2 FOLLOWER]: Raft consensus shutting down.
W20260709 13:23:27.582370 14999 consensus_peers.cc:597] T 5cd72bf3a0114fddb1bda8271debea24 P a1a22e9119494570b6d2217713fd7e43 -> Peer 0efc951052454eec9a58b0cd025945b8 (127.5.126.66:34613): Couldn't send request to peer 0efc951052454eec9a58b0cd025945b8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:23:27.582464  5625 raft_consensus.cc:2272] T 2a862e106a9e48a692bc72ea8c03ab39 P 0efc951052454eec9a58b0cd025945b8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:27.585635  5625 tablet_replica.cc:333] T ced632bda66e4a74b9c854befbcbac9b P 0efc951052454eec9a58b0cd025945b8: stopping tablet replica
I20260709 13:23:27.586519  5625 raft_consensus.cc:2243] T ced632bda66e4a74b9c854befbcbac9b P 0efc951052454eec9a58b0cd025945b8 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:23:27.587488  5625 raft_consensus.cc:2272] T ced632bda66e4a74b9c854befbcbac9b P 0efc951052454eec9a58b0cd025945b8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:27.589690  5625 tablet_replica.cc:333] T 77e8d8b35cf148e99e8274bf65e5ed05 P 0efc951052454eec9a58b0cd025945b8: stopping tablet replica
I20260709 13:23:27.590480  5625 raft_consensus.cc:2243] T 77e8d8b35cf148e99e8274bf65e5ed05 P 0efc951052454eec9a58b0cd025945b8 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:23:27.591009  5625 raft_consensus.cc:2272] T 77e8d8b35cf148e99e8274bf65e5ed05 P 0efc951052454eec9a58b0cd025945b8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:27.593398  5625 tablet_replica.cc:333] T 74a144396e4443288858878b63f08cc8 P 0efc951052454eec9a58b0cd025945b8: stopping tablet replica
I20260709 13:23:27.594099  5625 raft_consensus.cc:2243] T 74a144396e4443288858878b63f08cc8 P 0efc951052454eec9a58b0cd025945b8 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:23:27.595130  5625 raft_consensus.cc:2272] T 74a144396e4443288858878b63f08cc8 P 0efc951052454eec9a58b0cd025945b8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:27.597532  5625 tablet_replica.cc:333] T b025139466084200b70879196cd3f922 P 0efc951052454eec9a58b0cd025945b8: stopping tablet replica
I20260709 13:23:27.598099  5625 raft_consensus.cc:2243] T b025139466084200b70879196cd3f922 P 0efc951052454eec9a58b0cd025945b8 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:23:27.599004  5625 raft_consensus.cc:2272] T b025139466084200b70879196cd3f922 P 0efc951052454eec9a58b0cd025945b8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:27.601128  5625 tablet_replica.cc:333] T decdd091b0f243d786ee350a437b30f1 P 0efc951052454eec9a58b0cd025945b8: stopping tablet replica
I20260709 13:23:27.601785  5625 raft_consensus.cc:2243] T decdd091b0f243d786ee350a437b30f1 P 0efc951052454eec9a58b0cd025945b8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:23:27.602381  5625 raft_consensus.cc:2272] T decdd091b0f243d786ee350a437b30f1 P 0efc951052454eec9a58b0cd025945b8 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:23:27.605402 14999 consensus_peers.cc:597] T e429eefef04d433e8f18dfbc0387068d P a1a22e9119494570b6d2217713fd7e43 -> Peer 0efc951052454eec9a58b0cd025945b8 (127.5.126.66:34613): Couldn't send request to peer 0efc951052454eec9a58b0cd025945b8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:23:27.605505  5625 tablet_replica.cc:333] T f0424da0ffb84ba5931fe92f6dd57c5f P 0efc951052454eec9a58b0cd025945b8: stopping tablet replica
I20260709 13:23:27.606528  5625 raft_consensus.cc:2243] T f0424da0ffb84ba5931fe92f6dd57c5f P 0efc951052454eec9a58b0cd025945b8 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:23:27.607517  5625 raft_consensus.cc:2272] T f0424da0ffb84ba5931fe92f6dd57c5f P 0efc951052454eec9a58b0cd025945b8 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:23:27.607787 15073 consensus_peers.cc:597] T decdd091b0f243d786ee350a437b30f1 P a722e54d227f4c29a9ed6ce77858003a -> Peer 0efc951052454eec9a58b0cd025945b8 (127.5.126.66:34613): Couldn't send request to peer 0efc951052454eec9a58b0cd025945b8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:23:27.609864  5625 tablet_replica.cc:333] T aecef3c240394d54844ec8170e9cad59 P 0efc951052454eec9a58b0cd025945b8: stopping tablet replica
I20260709 13:23:27.610482  5625 raft_consensus.cc:2243] T aecef3c240394d54844ec8170e9cad59 P 0efc951052454eec9a58b0cd025945b8 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:23:27.611263  5625 raft_consensus.cc:2272] T aecef3c240394d54844ec8170e9cad59 P 0efc951052454eec9a58b0cd025945b8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:27.613474  5625 tablet_replica.cc:333] T 107541237b4a452e8b47b0c3527b7ede P 0efc951052454eec9a58b0cd025945b8: stopping tablet replica
I20260709 13:23:27.614022  5625 raft_consensus.cc:2243] T 107541237b4a452e8b47b0c3527b7ede P 0efc951052454eec9a58b0cd025945b8 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:23:27.614766  5625 raft_consensus.cc:2272] T 107541237b4a452e8b47b0c3527b7ede P 0efc951052454eec9a58b0cd025945b8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:27.616971  5625 tablet_replica.cc:333] T 46ed2e9dd1324ac4a6e07f813cfebb7e P 0efc951052454eec9a58b0cd025945b8: stopping tablet replica
I20260709 13:23:27.617595  5625 raft_consensus.cc:2243] T 46ed2e9dd1324ac4a6e07f813cfebb7e P 0efc951052454eec9a58b0cd025945b8 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:23:27.618469  5625 raft_consensus.cc:2272] T 46ed2e9dd1324ac4a6e07f813cfebb7e P 0efc951052454eec9a58b0cd025945b8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:27.620558  5625 tablet_replica.cc:333] T 7560205f5d324c7d821dff8efe7a6256 P 0efc951052454eec9a58b0cd025945b8: stopping tablet replica
I20260709 13:23:27.621251  5625 raft_consensus.cc:2243] T 7560205f5d324c7d821dff8efe7a6256 P 0efc951052454eec9a58b0cd025945b8 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:23:27.622049  5625 raft_consensus.cc:2272] T 7560205f5d324c7d821dff8efe7a6256 P 0efc951052454eec9a58b0cd025945b8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:27.624162  5625 tablet_replica.cc:333] T 117ae8a22b1d46579ce047f99e30520b P 0efc951052454eec9a58b0cd025945b8: stopping tablet replica
I20260709 13:23:27.624764  5625 raft_consensus.cc:2243] T 117ae8a22b1d46579ce047f99e30520b P 0efc951052454eec9a58b0cd025945b8 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:23:27.625556  5625 raft_consensus.cc:2272] T 117ae8a22b1d46579ce047f99e30520b P 0efc951052454eec9a58b0cd025945b8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:27.627717  5625 tablet_replica.cc:333] T db6d3d345bd3495e9ec9a0e75ecd0562 P 0efc951052454eec9a58b0cd025945b8: stopping tablet replica
I20260709 13:23:27.628496  5625 raft_consensus.cc:2243] T db6d3d345bd3495e9ec9a0e75ecd0562 P 0efc951052454eec9a58b0cd025945b8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:23:27.628948  5625 raft_consensus.cc:2272] T db6d3d345bd3495e9ec9a0e75ecd0562 P 0efc951052454eec9a58b0cd025945b8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:27.631098  5625 tablet_replica.cc:333] T 940021bf0c344d01bc3adaae308d968d P 0efc951052454eec9a58b0cd025945b8: stopping tablet replica
I20260709 13:23:27.631824  5625 raft_consensus.cc:2243] T 940021bf0c344d01bc3adaae308d968d P 0efc951052454eec9a58b0cd025945b8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:23:27.632382  5625 raft_consensus.cc:2272] T 940021bf0c344d01bc3adaae308d968d P 0efc951052454eec9a58b0cd025945b8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:27.635222  5625 tablet_replica.cc:333] T ad084674821d4137b02efe692068d382 P 0efc951052454eec9a58b0cd025945b8: stopping tablet replica
I20260709 13:23:27.635972  5625 raft_consensus.cc:2243] T ad084674821d4137b02efe692068d382 P 0efc951052454eec9a58b0cd025945b8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:23:27.636530  5625 raft_consensus.cc:2272] T ad084674821d4137b02efe692068d382 P 0efc951052454eec9a58b0cd025945b8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:27.639415  5625 tablet_replica.cc:333] T 36f72377897846f2a1f3d8d33ec14af6 P 0efc951052454eec9a58b0cd025945b8: stopping tablet replica
I20260709 13:23:27.640270  5625 raft_consensus.cc:2243] T 36f72377897846f2a1f3d8d33ec14af6 P 0efc951052454eec9a58b0cd025945b8 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:23:27.641445  5625 raft_consensus.cc:2272] T 36f72377897846f2a1f3d8d33ec14af6 P 0efc951052454eec9a58b0cd025945b8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:27.644259  5625 tablet_replica.cc:333] T e75f8237624f42f793627366f05b792a P 0efc951052454eec9a58b0cd025945b8: stopping tablet replica
I20260709 13:23:27.644969  5625 raft_consensus.cc:2243] T e75f8237624f42f793627366f05b792a P 0efc951052454eec9a58b0cd025945b8 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:23:27.645601  5625 raft_consensus.cc:2272] T e75f8237624f42f793627366f05b792a P 0efc951052454eec9a58b0cd025945b8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:27.647965  5625 tablet_replica.cc:333] T a71163721b4d48b0b5ff366b9d12ac32 P 0efc951052454eec9a58b0cd025945b8: stopping tablet replica
I20260709 13:23:27.648655  5625 raft_consensus.cc:2243] T a71163721b4d48b0b5ff366b9d12ac32 P 0efc951052454eec9a58b0cd025945b8 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:23:27.649129  5625 raft_consensus.cc:2272] T a71163721b4d48b0b5ff366b9d12ac32 P 0efc951052454eec9a58b0cd025945b8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:27.651438  5625 tablet_replica.cc:333] T 532cc9041f414e018098570192e0fae8 P 0efc951052454eec9a58b0cd025945b8: stopping tablet replica
I20260709 13:23:27.652105  5625 raft_consensus.cc:2243] T 532cc9041f414e018098570192e0fae8 P 0efc951052454eec9a58b0cd025945b8 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:23:27.652572  5625 raft_consensus.cc:2272] T 532cc9041f414e018098570192e0fae8 P 0efc951052454eec9a58b0cd025945b8 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:27.654959  5625 tablet_replica.cc:333] T 5cd72bf3a0114fddb1bda8271debea24 P 0efc951052454eec9a58b0cd025945b8: stopping tablet replica
I20260709 13:23:27.655520  5625 raft_consensus.cc:2243] T 5cd72bf3a0114fddb1bda8271debea24 P 0efc951052454eec9a58b0cd025945b8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:23:27.655953  5625 raft_consensus.cc:2272] T 5cd72bf3a0114fddb1bda8271debea24 P 0efc951052454eec9a58b0cd025945b8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:27.657994  5625 tablet_replica.cc:333] T 53592d0c0a46440dbfcd26f8b8111859 P 0efc951052454eec9a58b0cd025945b8: stopping tablet replica
I20260709 13:23:27.658556  5625 raft_consensus.cc:2243] T 53592d0c0a46440dbfcd26f8b8111859 P 0efc951052454eec9a58b0cd025945b8 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:23:27.659456  5625 raft_consensus.cc:2272] T 53592d0c0a46440dbfcd26f8b8111859 P 0efc951052454eec9a58b0cd025945b8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:27.661661  5625 tablet_replica.cc:333] T e1ae79ed138a4950a681f24aa1107ef3 P 0efc951052454eec9a58b0cd025945b8: stopping tablet replica
I20260709 13:23:27.662267  5625 raft_consensus.cc:2243] T e1ae79ed138a4950a681f24aa1107ef3 P 0efc951052454eec9a58b0cd025945b8 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:23:27.662726  5625 raft_consensus.cc:2272] T e1ae79ed138a4950a681f24aa1107ef3 P 0efc951052454eec9a58b0cd025945b8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:27.665052  5625 tablet_replica.cc:333] T e3693e8a3b0444bf978dc845dcfd2a45 P 0efc951052454eec9a58b0cd025945b8: stopping tablet replica
I20260709 13:23:27.665668  5625 raft_consensus.cc:2243] T e3693e8a3b0444bf978dc845dcfd2a45 P 0efc951052454eec9a58b0cd025945b8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:23:27.666280  5625 raft_consensus.cc:2272] T e3693e8a3b0444bf978dc845dcfd2a45 P 0efc951052454eec9a58b0cd025945b8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:27.668959  5625 tablet_replica.cc:333] T 914c9c0c3be1486f8dcce382b61b5450 P 0efc951052454eec9a58b0cd025945b8: stopping tablet replica
I20260709 13:23:27.669442  5625 raft_consensus.cc:2243] T 914c9c0c3be1486f8dcce382b61b5450 P 0efc951052454eec9a58b0cd025945b8 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:23:27.669822  5625 raft_consensus.cc:2272] T 914c9c0c3be1486f8dcce382b61b5450 P 0efc951052454eec9a58b0cd025945b8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:27.672448  5625 tablet_replica.cc:333] T 268027ae94a54cf4acf51c54c7b9032b P 0efc951052454eec9a58b0cd025945b8: stopping tablet replica
I20260709 13:23:27.673069  5625 raft_consensus.cc:2243] T 268027ae94a54cf4acf51c54c7b9032b P 0efc951052454eec9a58b0cd025945b8 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:23:27.673627  5625 raft_consensus.cc:2272] T 268027ae94a54cf4acf51c54c7b9032b P 0efc951052454eec9a58b0cd025945b8 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:23:27.674623 14999 consensus_peers.cc:597] T db6d3d345bd3495e9ec9a0e75ecd0562 P a1a22e9119494570b6d2217713fd7e43 -> Peer 0efc951052454eec9a58b0cd025945b8 (127.5.126.66:34613): Couldn't send request to peer 0efc951052454eec9a58b0cd025945b8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:23:27.676568  5625 tablet_replica.cc:333] T 48be8cf045364be999b8f0fd547b7b9d P 0efc951052454eec9a58b0cd025945b8: stopping tablet replica
W20260709 13:23:27.677196 14999 consensus_peers.cc:597] T e4a490a7748841c3803607059f9d8825 P a1a22e9119494570b6d2217713fd7e43 -> Peer 0efc951052454eec9a58b0cd025945b8 (127.5.126.66:34613): Couldn't send request to peer 0efc951052454eec9a58b0cd025945b8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:23:27.677299  5625 raft_consensus.cc:2243] T 48be8cf045364be999b8f0fd547b7b9d P 0efc951052454eec9a58b0cd025945b8 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:23:27.677979  5625 raft_consensus.cc:2272] T 48be8cf045364be999b8f0fd547b7b9d P 0efc951052454eec9a58b0cd025945b8 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:23:27.690950 14999 consensus_peers.cc:597] T 7b8e0fe5ef6d4c42b9854399aac3a1d6 P a1a22e9119494570b6d2217713fd7e43 -> Peer 0efc951052454eec9a58b0cd025945b8 (127.5.126.66:34613): Couldn't send request to peer 0efc951052454eec9a58b0cd025945b8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:23:27.763940  5625 tablet_server.cc:196] TabletServer@127.5.126.66:0 shutdown complete.
W20260709 13:23:27.787657 14999 consensus_peers.cc:597] T 2956fb66a7f34f3e99f42598fb93178e P a1a22e9119494570b6d2217713fd7e43 -> Peer 0efc951052454eec9a58b0cd025945b8 (127.5.126.66:34613): Couldn't send request to peer 0efc951052454eec9a58b0cd025945b8. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.66:34613: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:23:27.795073 15073 consensus_peers.cc:597] T 2a9523aa8663464686254c8412c37e67 P a722e54d227f4c29a9ed6ce77858003a -> Peer 0efc951052454eec9a58b0cd025945b8 (127.5.126.66:34613): Couldn't send request to peer 0efc951052454eec9a58b0cd025945b8. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.66:34613: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:23:27.814268 14999 consensus_peers.cc:597] T c3abd41db36d404089eaf1f9063bbcb0 P a1a22e9119494570b6d2217713fd7e43 -> Peer 0efc951052454eec9a58b0cd025945b8 (127.5.126.66:34613): Couldn't send request to peer 0efc951052454eec9a58b0cd025945b8. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.66:34613: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:23:27.857194 15073 consensus_peers.cc:597] T a71163721b4d48b0b5ff366b9d12ac32 P a722e54d227f4c29a9ed6ce77858003a -> Peer 0efc951052454eec9a58b0cd025945b8 (127.5.126.66:34613): Couldn't send request to peer 0efc951052454eec9a58b0cd025945b8. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.66:34613: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:23:27.875905  5625 tablet_server.cc:179] TabletServer@127.5.126.67:0 shutting down...
I20260709 13:23:27.934888  5625 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:23:27.936717  5625 tablet_replica.cc:333] T 34e83f249d9942e99244702be584c8ae P a1a22e9119494570b6d2217713fd7e43: stopping tablet replica
I20260709 13:23:27.937872  5625 raft_consensus.cc:2243] T 34e83f249d9942e99244702be584c8ae P a1a22e9119494570b6d2217713fd7e43 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:23:27.938521  5625 raft_consensus.cc:2272] T 34e83f249d9942e99244702be584c8ae P a1a22e9119494570b6d2217713fd7e43 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:27.941219  5625 tablet_replica.cc:333] T bf0b7c8005aa4d8ab97a1499761bf98a P a1a22e9119494570b6d2217713fd7e43: stopping tablet replica
I20260709 13:23:27.941931  5625 raft_consensus.cc:2243] T bf0b7c8005aa4d8ab97a1499761bf98a P a1a22e9119494570b6d2217713fd7e43 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:23:27.942482  5625 raft_consensus.cc:2272] T bf0b7c8005aa4d8ab97a1499761bf98a P a1a22e9119494570b6d2217713fd7e43 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:27.945287  5625 tablet_replica.cc:333] T 16d5db73377a4925b9f1e814ba306fcc P a1a22e9119494570b6d2217713fd7e43: stopping tablet replica
I20260709 13:23:27.945930  5625 raft_consensus.cc:2243] T 16d5db73377a4925b9f1e814ba306fcc P a1a22e9119494570b6d2217713fd7e43 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:23:27.946801  5625 raft_consensus.cc:2272] T 16d5db73377a4925b9f1e814ba306fcc P a1a22e9119494570b6d2217713fd7e43 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:27.949395  5625 tablet_replica.cc:333] T 08dea3083d334745abe54f9b220bd86a P a1a22e9119494570b6d2217713fd7e43: stopping tablet replica
I20260709 13:23:27.950212  5625 raft_consensus.cc:2243] T 08dea3083d334745abe54f9b220bd86a P a1a22e9119494570b6d2217713fd7e43 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:23:27.950822  5625 raft_consensus.cc:2272] T 08dea3083d334745abe54f9b220bd86a P a1a22e9119494570b6d2217713fd7e43 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:27.953845  5625 tablet_replica.cc:333] T 88a7c4171c664e819837994755edf95c P a1a22e9119494570b6d2217713fd7e43: stopping tablet replica
I20260709 13:23:27.954540  5625 raft_consensus.cc:2243] T 88a7c4171c664e819837994755edf95c P a1a22e9119494570b6d2217713fd7e43 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:23:27.955140  5625 raft_consensus.cc:2272] T 88a7c4171c664e819837994755edf95c P a1a22e9119494570b6d2217713fd7e43 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:27.957237  5625 tablet_replica.cc:333] T f86a730e237248dc9b91cbb75e29c324 P a1a22e9119494570b6d2217713fd7e43: stopping tablet replica
I20260709 13:23:27.957837  5625 raft_consensus.cc:2243] T f86a730e237248dc9b91cbb75e29c324 P a1a22e9119494570b6d2217713fd7e43 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:23:27.958315  5625 raft_consensus.cc:2272] T f86a730e237248dc9b91cbb75e29c324 P a1a22e9119494570b6d2217713fd7e43 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:27.960497  5625 tablet_replica.cc:333] T b0b7e1c1e67845cb9bd2208bb2fb7c21 P a1a22e9119494570b6d2217713fd7e43: stopping tablet replica
I20260709 13:23:27.961241  5625 raft_consensus.cc:2243] T b0b7e1c1e67845cb9bd2208bb2fb7c21 P a1a22e9119494570b6d2217713fd7e43 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:23:27.961700  5625 raft_consensus.cc:2272] T b0b7e1c1e67845cb9bd2208bb2fb7c21 P a1a22e9119494570b6d2217713fd7e43 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:27.964159  5625 tablet_replica.cc:333] T dee43e01ec5d409b877a5c2dbf5b7b77 P a1a22e9119494570b6d2217713fd7e43: stopping tablet replica
I20260709 13:23:27.965102  5625 raft_consensus.cc:2243] T dee43e01ec5d409b877a5c2dbf5b7b77 P a1a22e9119494570b6d2217713fd7e43 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:23:27.965672  5625 raft_consensus.cc:2272] T dee43e01ec5d409b877a5c2dbf5b7b77 P a1a22e9119494570b6d2217713fd7e43 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:27.968611  5625 tablet_replica.cc:333] T e429eefef04d433e8f18dfbc0387068d P a1a22e9119494570b6d2217713fd7e43: stopping tablet replica
I20260709 13:23:27.969504  5625 raft_consensus.cc:2243] T e429eefef04d433e8f18dfbc0387068d P a1a22e9119494570b6d2217713fd7e43 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:23:27.972190  5625 raft_consensus.cc:2272] T e429eefef04d433e8f18dfbc0387068d P a1a22e9119494570b6d2217713fd7e43 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:27.975512  5625 tablet_replica.cc:333] T c3abd41db36d404089eaf1f9063bbcb0 P a1a22e9119494570b6d2217713fd7e43: stopping tablet replica
W20260709 13:23:27.975961 15073 consensus_peers.cc:597] T 7e29a38455b241239882b6af3eac3d51 P a722e54d227f4c29a9ed6ce77858003a -> Peer 0efc951052454eec9a58b0cd025945b8 (127.5.126.66:34613): Couldn't send request to peer 0efc951052454eec9a58b0cd025945b8. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.66:34613: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:23:27.976423  5625 raft_consensus.cc:2243] T c3abd41db36d404089eaf1f9063bbcb0 P a1a22e9119494570b6d2217713fd7e43 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:23:27.977630  5625 raft_consensus.cc:2272] T c3abd41db36d404089eaf1f9063bbcb0 P a1a22e9119494570b6d2217713fd7e43 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:27.980851  5625 tablet_replica.cc:333] T 8996bae84ecc4bffa0239d64dce7b24f P a1a22e9119494570b6d2217713fd7e43: stopping tablet replica
I20260709 13:23:27.981503  5625 raft_consensus.cc:2243] T 8996bae84ecc4bffa0239d64dce7b24f P a1a22e9119494570b6d2217713fd7e43 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:23:27.981935  5625 raft_consensus.cc:2272] T 8996bae84ecc4bffa0239d64dce7b24f P a1a22e9119494570b6d2217713fd7e43 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:27.984248  5625 tablet_replica.cc:333] T ced632bda66e4a74b9c854befbcbac9b P a1a22e9119494570b6d2217713fd7e43: stopping tablet replica
I20260709 13:23:27.984823  5625 raft_consensus.cc:2243] T ced632bda66e4a74b9c854befbcbac9b P a1a22e9119494570b6d2217713fd7e43 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:23:27.985270  5625 raft_consensus.cc:2272] T ced632bda66e4a74b9c854befbcbac9b P a1a22e9119494570b6d2217713fd7e43 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:27.987637  5625 tablet_replica.cc:333] T e4a490a7748841c3803607059f9d8825 P a1a22e9119494570b6d2217713fd7e43: stopping tablet replica
I20260709 13:23:27.988327  5625 raft_consensus.cc:2243] T e4a490a7748841c3803607059f9d8825 P a1a22e9119494570b6d2217713fd7e43 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:23:27.989154  5625 raft_consensus.cc:2272] T e4a490a7748841c3803607059f9d8825 P a1a22e9119494570b6d2217713fd7e43 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:27.991514  5625 tablet_replica.cc:333] T 53592d0c0a46440dbfcd26f8b8111859 P a1a22e9119494570b6d2217713fd7e43: stopping tablet replica
I20260709 13:23:27.992213  5625 raft_consensus.cc:2243] T 53592d0c0a46440dbfcd26f8b8111859 P a1a22e9119494570b6d2217713fd7e43 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:23:27.992614  5625 raft_consensus.cc:2272] T 53592d0c0a46440dbfcd26f8b8111859 P a1a22e9119494570b6d2217713fd7e43 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:27.994941  5625 tablet_replica.cc:333] T e1ae79ed138a4950a681f24aa1107ef3 P a1a22e9119494570b6d2217713fd7e43: stopping tablet replica
I20260709 13:23:27.995625  5625 raft_consensus.cc:2243] T e1ae79ed138a4950a681f24aa1107ef3 P a1a22e9119494570b6d2217713fd7e43 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:23:27.996217  5625 raft_consensus.cc:2272] T e1ae79ed138a4950a681f24aa1107ef3 P a1a22e9119494570b6d2217713fd7e43 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:27.999110  5625 tablet_replica.cc:333] T e3693e8a3b0444bf978dc845dcfd2a45 P a1a22e9119494570b6d2217713fd7e43: stopping tablet replica
I20260709 13:23:27.999876  5625 raft_consensus.cc:2243] T e3693e8a3b0444bf978dc845dcfd2a45 P a1a22e9119494570b6d2217713fd7e43 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:23:28.000954  5625 raft_consensus.cc:2272] T e3693e8a3b0444bf978dc845dcfd2a45 P a1a22e9119494570b6d2217713fd7e43 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:28.003410  5625 tablet_replica.cc:333] T 7a4cf38d1a6644f082f401b9b26bfb27 P a1a22e9119494570b6d2217713fd7e43: stopping tablet replica
I20260709 13:23:28.004094  5625 raft_consensus.cc:2243] T 7a4cf38d1a6644f082f401b9b26bfb27 P a1a22e9119494570b6d2217713fd7e43 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:23:28.005076  5625 raft_consensus.cc:2272] T 7a4cf38d1a6644f082f401b9b26bfb27 P a1a22e9119494570b6d2217713fd7e43 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:28.007352  5625 tablet_replica.cc:333] T 107541237b4a452e8b47b0c3527b7ede P a1a22e9119494570b6d2217713fd7e43: stopping tablet replica
I20260709 13:23:28.007992  5625 raft_consensus.cc:2243] T 107541237b4a452e8b47b0c3527b7ede P a1a22e9119494570b6d2217713fd7e43 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:23:28.008508  5625 raft_consensus.cc:2272] T 107541237b4a452e8b47b0c3527b7ede P a1a22e9119494570b6d2217713fd7e43 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:28.011229  5625 tablet_replica.cc:333] T dadd194761924530aede05672c9eecf9 P a1a22e9119494570b6d2217713fd7e43: stopping tablet replica
I20260709 13:23:28.012137  5625 raft_consensus.cc:2243] T dadd194761924530aede05672c9eecf9 P a1a22e9119494570b6d2217713fd7e43 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:23:28.012696  5625 raft_consensus.cc:2272] T dadd194761924530aede05672c9eecf9 P a1a22e9119494570b6d2217713fd7e43 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:28.015430  5625 tablet_replica.cc:333] T 03f377f48e8849adade3945935d300a9 P a1a22e9119494570b6d2217713fd7e43: stopping tablet replica
I20260709 13:23:28.016258  5625 raft_consensus.cc:2243] T 03f377f48e8849adade3945935d300a9 P a1a22e9119494570b6d2217713fd7e43 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:23:28.017184  5625 raft_consensus.cc:2272] T 03f377f48e8849adade3945935d300a9 P a1a22e9119494570b6d2217713fd7e43 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:28.020377  5625 tablet_replica.cc:333] T 0819f8999271428481a1f839026171a7 P a1a22e9119494570b6d2217713fd7e43: stopping tablet replica
I20260709 13:23:28.021207  5625 raft_consensus.cc:2243] T 0819f8999271428481a1f839026171a7 P a1a22e9119494570b6d2217713fd7e43 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:23:28.021756  5625 raft_consensus.cc:2272] T 0819f8999271428481a1f839026171a7 P a1a22e9119494570b6d2217713fd7e43 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:28.024833  5625 tablet_replica.cc:333] T decdd091b0f243d786ee350a437b30f1 P a1a22e9119494570b6d2217713fd7e43: stopping tablet replica
I20260709 13:23:28.025679  5625 raft_consensus.cc:2243] T decdd091b0f243d786ee350a437b30f1 P a1a22e9119494570b6d2217713fd7e43 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:23:28.026305  5625 raft_consensus.cc:2272] T decdd091b0f243d786ee350a437b30f1 P a1a22e9119494570b6d2217713fd7e43 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:28.029318  5625 tablet_replica.cc:333] T e85432ede09747339c957cdaa7d15ac6 P a1a22e9119494570b6d2217713fd7e43: stopping tablet replica
I20260709 13:23:28.029927  5625 raft_consensus.cc:2243] T e85432ede09747339c957cdaa7d15ac6 P a1a22e9119494570b6d2217713fd7e43 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:23:28.030768  5625 raft_consensus.cc:2272] T e85432ede09747339c957cdaa7d15ac6 P a1a22e9119494570b6d2217713fd7e43 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:28.033020  5625 tablet_replica.cc:333] T f0424da0ffb84ba5931fe92f6dd57c5f P a1a22e9119494570b6d2217713fd7e43: stopping tablet replica
I20260709 13:23:28.033635  5625 raft_consensus.cc:2243] T f0424da0ffb84ba5931fe92f6dd57c5f P a1a22e9119494570b6d2217713fd7e43 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:23:28.034143  5625 raft_consensus.cc:2272] T f0424da0ffb84ba5931fe92f6dd57c5f P a1a22e9119494570b6d2217713fd7e43 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:28.037221  5625 tablet_replica.cc:333] T 03b63e2bee374ed5931dab67ee14b555 P a1a22e9119494570b6d2217713fd7e43: stopping tablet replica
I20260709 13:23:28.038026  5625 raft_consensus.cc:2243] T 03b63e2bee374ed5931dab67ee14b555 P a1a22e9119494570b6d2217713fd7e43 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:23:28.038848  5625 raft_consensus.cc:2272] T 03b63e2bee374ed5931dab67ee14b555 P a1a22e9119494570b6d2217713fd7e43 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:28.041189  5625 tablet_replica.cc:333] T 5cd72bf3a0114fddb1bda8271debea24 P a1a22e9119494570b6d2217713fd7e43: stopping tablet replica
I20260709 13:23:28.041782  5625 raft_consensus.cc:2243] T 5cd72bf3a0114fddb1bda8271debea24 P a1a22e9119494570b6d2217713fd7e43 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:23:28.042627  5625 raft_consensus.cc:2272] T 5cd72bf3a0114fddb1bda8271debea24 P a1a22e9119494570b6d2217713fd7e43 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:28.044875  5625 tablet_replica.cc:333] T 74a144396e4443288858878b63f08cc8 P a1a22e9119494570b6d2217713fd7e43: stopping tablet replica
I20260709 13:23:28.045473  5625 raft_consensus.cc:2243] T 74a144396e4443288858878b63f08cc8 P a1a22e9119494570b6d2217713fd7e43 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:23:28.045889  5625 raft_consensus.cc:2272] T 74a144396e4443288858878b63f08cc8 P a1a22e9119494570b6d2217713fd7e43 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:28.048254  5625 tablet_replica.cc:333] T b025139466084200b70879196cd3f922 P a1a22e9119494570b6d2217713fd7e43: stopping tablet replica
I20260709 13:23:28.048882  5625 raft_consensus.cc:2243] T b025139466084200b70879196cd3f922 P a1a22e9119494570b6d2217713fd7e43 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:23:28.049360  5625 raft_consensus.cc:2272] T b025139466084200b70879196cd3f922 P a1a22e9119494570b6d2217713fd7e43 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:28.051729  5625 tablet_replica.cc:333] T a2de4fecd70240dd8ed436fa8de65773 P a1a22e9119494570b6d2217713fd7e43: stopping tablet replica
I20260709 13:23:28.052416  5625 raft_consensus.cc:2243] T a2de4fecd70240dd8ed436fa8de65773 P a1a22e9119494570b6d2217713fd7e43 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:23:28.052908  5625 raft_consensus.cc:2272] T a2de4fecd70240dd8ed436fa8de65773 P a1a22e9119494570b6d2217713fd7e43 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:28.053706 16112 raft_consensus.cc:493] T e75f8237624f42f793627366f05b792a P a722e54d227f4c29a9ed6ce77858003a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f3a500981b494979b58d2b1041fec9c8)
I20260709 13:23:28.054323 16112 raft_consensus.cc:515] T e75f8237624f42f793627366f05b792a P a722e54d227f4c29a9ed6ce77858003a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } } peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } } peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } }
I20260709 13:23:28.053791 16086 raft_consensus.cc:493] T 914c9c0c3be1486f8dcce382b61b5450 P a722e54d227f4c29a9ed6ce77858003a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f3a500981b494979b58d2b1041fec9c8)
I20260709 13:23:28.055361 16086 raft_consensus.cc:515] T 914c9c0c3be1486f8dcce382b61b5450 P a722e54d227f4c29a9ed6ce77858003a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } } peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } } peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } }
I20260709 13:23:28.055979  5625 tablet_replica.cc:333] T 70d027ba81f54eba882756b941186710 P a1a22e9119494570b6d2217713fd7e43: stopping tablet replica
I20260709 13:23:28.056947  5625 raft_consensus.cc:2243] T 70d027ba81f54eba882756b941186710 P a1a22e9119494570b6d2217713fd7e43 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:23:28.057261 16086 leader_election.cc:290] T 914c9c0c3be1486f8dcce382b61b5450 P a722e54d227f4c29a9ed6ce77858003a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f3a500981b494979b58d2b1041fec9c8 (127.5.126.65:34129), 0efc951052454eec9a58b0cd025945b8 (127.5.126.66:34613)
I20260709 13:23:28.057564  5625 raft_consensus.cc:2272] T 70d027ba81f54eba882756b941186710 P a1a22e9119494570b6d2217713fd7e43 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:28.059511 16112 leader_election.cc:290] T e75f8237624f42f793627366f05b792a P a722e54d227f4c29a9ed6ce77858003a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f3a500981b494979b58d2b1041fec9c8 (127.5.126.65:34129), 0efc951052454eec9a58b0cd025945b8 (127.5.126.66:34613)
I20260709 13:23:28.060742  5625 tablet_replica.cc:333] T 5df7528567fd4291a888bfb37c28dc27 P a1a22e9119494570b6d2217713fd7e43: stopping tablet replica
I20260709 13:23:28.061712  5625 raft_consensus.cc:2243] T 5df7528567fd4291a888bfb37c28dc27 P a1a22e9119494570b6d2217713fd7e43 [term 1 LEADER]: Raft consensus shutting down.
W20260709 13:23:28.062215 15072 consensus_peers.cc:597] T decdd091b0f243d786ee350a437b30f1 P a722e54d227f4c29a9ed6ce77858003a -> Peer a1a22e9119494570b6d2217713fd7e43 (127.5.126.67:38125): Couldn't send request to peer a1a22e9119494570b6d2217713fd7e43. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:23:28.062885  5625 raft_consensus.cc:2272] T 5df7528567fd4291a888bfb37c28dc27 P a1a22e9119494570b6d2217713fd7e43 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:23:28.063520 15073 leader_election.cc:336] T e75f8237624f42f793627366f05b792a P a722e54d227f4c29a9ed6ce77858003a [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer f3a500981b494979b58d2b1041fec9c8 (127.5.126.65:34129): Network error: Client connection negotiation failed: client connection to 127.5.126.65:34129: connect: Connection refused (error 111)
W20260709 13:23:28.064134 15073 leader_election.cc:336] T 914c9c0c3be1486f8dcce382b61b5450 P a722e54d227f4c29a9ed6ce77858003a [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer f3a500981b494979b58d2b1041fec9c8 (127.5.126.65:34129): Network error: Client connection negotiation failed: client connection to 127.5.126.65:34129: connect: Connection refused (error 111)
I20260709 13:23:28.066303  5625 tablet_replica.cc:333] T 46ed2e9dd1324ac4a6e07f813cfebb7e P a1a22e9119494570b6d2217713fd7e43: stopping tablet replica
W20260709 13:23:28.066761 15073 leader_election.cc:336] T 914c9c0c3be1486f8dcce382b61b5450 P a722e54d227f4c29a9ed6ce77858003a [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 0efc951052454eec9a58b0cd025945b8 (127.5.126.66:34613): Network error: Client connection negotiation failed: client connection to 127.5.126.66:34613: connect: Connection refused (error 111)
I20260709 13:23:28.067222  5625 raft_consensus.cc:2243] T 46ed2e9dd1324ac4a6e07f813cfebb7e P a1a22e9119494570b6d2217713fd7e43 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:23:28.067157 15073 leader_election.cc:304] T 914c9c0c3be1486f8dcce382b61b5450 P a722e54d227f4c29a9ed6ce77858003a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a722e54d227f4c29a9ed6ce77858003a; no voters: 0efc951052454eec9a58b0cd025945b8, f3a500981b494979b58d2b1041fec9c8
I20260709 13:23:28.067880  5625 raft_consensus.cc:2272] T 46ed2e9dd1324ac4a6e07f813cfebb7e P a1a22e9119494570b6d2217713fd7e43 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:28.068085 16112 raft_consensus.cc:2749] T 914c9c0c3be1486f8dcce382b61b5450 P a722e54d227f4c29a9ed6ce77858003a [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:23:28.068238 15073 leader_election.cc:336] T e75f8237624f42f793627366f05b792a P a722e54d227f4c29a9ed6ce77858003a [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 0efc951052454eec9a58b0cd025945b8 (127.5.126.66:34613): Network error: Client connection negotiation failed: client connection to 127.5.126.66:34613: connect: Connection refused (error 111)
I20260709 13:23:28.069142 15073 leader_election.cc:304] T e75f8237624f42f793627366f05b792a P a722e54d227f4c29a9ed6ce77858003a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a722e54d227f4c29a9ed6ce77858003a; no voters: 0efc951052454eec9a58b0cd025945b8, f3a500981b494979b58d2b1041fec9c8
I20260709 13:23:28.069862 16112 raft_consensus.cc:2749] T e75f8237624f42f793627366f05b792a P a722e54d227f4c29a9ed6ce77858003a [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:23:28.070909  5625 tablet_replica.cc:333] T 48be8cf045364be999b8f0fd547b7b9d P a1a22e9119494570b6d2217713fd7e43: stopping tablet replica
I20260709 13:23:28.071645  5625 raft_consensus.cc:2243] T 48be8cf045364be999b8f0fd547b7b9d P a1a22e9119494570b6d2217713fd7e43 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:23:28.072160  5625 raft_consensus.cc:2272] T 48be8cf045364be999b8f0fd547b7b9d P a1a22e9119494570b6d2217713fd7e43 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:28.074266  5625 tablet_replica.cc:333] T 117ae8a22b1d46579ce047f99e30520b P a1a22e9119494570b6d2217713fd7e43: stopping tablet replica
I20260709 13:23:28.074877  5625 raft_consensus.cc:2243] T 117ae8a22b1d46579ce047f99e30520b P a1a22e9119494570b6d2217713fd7e43 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:23:28.075311  5625 raft_consensus.cc:2272] T 117ae8a22b1d46579ce047f99e30520b P a1a22e9119494570b6d2217713fd7e43 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:28.077556  5625 tablet_replica.cc:333] T db6d3d345bd3495e9ec9a0e75ecd0562 P a1a22e9119494570b6d2217713fd7e43: stopping tablet replica
I20260709 13:23:28.078162  5625 raft_consensus.cc:2243] T db6d3d345bd3495e9ec9a0e75ecd0562 P a1a22e9119494570b6d2217713fd7e43 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:23:28.079048  5625 raft_consensus.cc:2272] T db6d3d345bd3495e9ec9a0e75ecd0562 P a1a22e9119494570b6d2217713fd7e43 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:28.081272  5625 tablet_replica.cc:333] T ad084674821d4137b02efe692068d382 P a1a22e9119494570b6d2217713fd7e43: stopping tablet replica
I20260709 13:23:28.081871  5625 raft_consensus.cc:2243] T ad084674821d4137b02efe692068d382 P a1a22e9119494570b6d2217713fd7e43 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:23:28.082319  5625 raft_consensus.cc:2272] T ad084674821d4137b02efe692068d382 P a1a22e9119494570b6d2217713fd7e43 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:28.084555  5625 tablet_replica.cc:333] T 36f72377897846f2a1f3d8d33ec14af6 P a1a22e9119494570b6d2217713fd7e43: stopping tablet replica
I20260709 13:23:28.085166  5625 raft_consensus.cc:2243] T 36f72377897846f2a1f3d8d33ec14af6 P a1a22e9119494570b6d2217713fd7e43 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:23:28.085672  5625 raft_consensus.cc:2272] T 36f72377897846f2a1f3d8d33ec14af6 P a1a22e9119494570b6d2217713fd7e43 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:28.088181  5625 tablet_replica.cc:333] T 7560205f5d324c7d821dff8efe7a6256 P a1a22e9119494570b6d2217713fd7e43: stopping tablet replica
I20260709 13:23:28.088729  5625 raft_consensus.cc:2243] T 7560205f5d324c7d821dff8efe7a6256 P a1a22e9119494570b6d2217713fd7e43 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:23:28.089174  5625 raft_consensus.cc:2272] T 7560205f5d324c7d821dff8efe7a6256 P a1a22e9119494570b6d2217713fd7e43 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:28.091482  5625 tablet_replica.cc:333] T 7e29a38455b241239882b6af3eac3d51 P a1a22e9119494570b6d2217713fd7e43: stopping tablet replica
I20260709 13:23:28.092054  5625 raft_consensus.cc:2243] T 7e29a38455b241239882b6af3eac3d51 P a1a22e9119494570b6d2217713fd7e43 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:23:28.092509  5625 raft_consensus.cc:2272] T 7e29a38455b241239882b6af3eac3d51 P a1a22e9119494570b6d2217713fd7e43 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:28.094904  5625 tablet_replica.cc:333] T 7b8e0fe5ef6d4c42b9854399aac3a1d6 P a1a22e9119494570b6d2217713fd7e43: stopping tablet replica
W20260709 13:23:28.095065 15072 consensus_peers.cc:597] T 7e29a38455b241239882b6af3eac3d51 P a722e54d227f4c29a9ed6ce77858003a -> Peer a1a22e9119494570b6d2217713fd7e43 (127.5.126.67:38125): Couldn't send request to peer a1a22e9119494570b6d2217713fd7e43. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:23:28.095500  5625 raft_consensus.cc:2243] T 7b8e0fe5ef6d4c42b9854399aac3a1d6 P a1a22e9119494570b6d2217713fd7e43 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:23:28.096536  5625 raft_consensus.cc:2272] T 7b8e0fe5ef6d4c42b9854399aac3a1d6 P a1a22e9119494570b6d2217713fd7e43 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:28.098620  5625 tablet_replica.cc:333] T affcb03ab55349748a95c103059d2955 P a1a22e9119494570b6d2217713fd7e43: stopping tablet replica
I20260709 13:23:28.099190  5625 raft_consensus.cc:2243] T affcb03ab55349748a95c103059d2955 P a1a22e9119494570b6d2217713fd7e43 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:23:28.099663  5625 raft_consensus.cc:2272] T affcb03ab55349748a95c103059d2955 P a1a22e9119494570b6d2217713fd7e43 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:28.101928  5625 tablet_replica.cc:333] T 2956fb66a7f34f3e99f42598fb93178e P a1a22e9119494570b6d2217713fd7e43: stopping tablet replica
I20260709 13:23:28.102437  5625 raft_consensus.cc:2243] T 2956fb66a7f34f3e99f42598fb93178e P a1a22e9119494570b6d2217713fd7e43 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:23:28.103327  5625 raft_consensus.cc:2272] T 2956fb66a7f34f3e99f42598fb93178e P a1a22e9119494570b6d2217713fd7e43 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:28.105418  5625 tablet_replica.cc:333] T abc01daa220a47fa8578b0d20a17c9ab P a1a22e9119494570b6d2217713fd7e43: stopping tablet replica
I20260709 13:23:28.105918  5625 raft_consensus.cc:2243] T abc01daa220a47fa8578b0d20a17c9ab P a1a22e9119494570b6d2217713fd7e43 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:23:28.106876  5625 raft_consensus.cc:2272] T abc01daa220a47fa8578b0d20a17c9ab P a1a22e9119494570b6d2217713fd7e43 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:28.109030  5625 tablet_replica.cc:333] T d65eaa0ab4574a1ea92b3848d4dc9c4d P a1a22e9119494570b6d2217713fd7e43: stopping tablet replica
I20260709 13:23:28.109537  5625 raft_consensus.cc:2243] T d65eaa0ab4574a1ea92b3848d4dc9c4d P a1a22e9119494570b6d2217713fd7e43 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:23:28.110028  5625 raft_consensus.cc:2272] T d65eaa0ab4574a1ea92b3848d4dc9c4d P a1a22e9119494570b6d2217713fd7e43 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:23:28.129081 15072 consensus_peers.cc:597] T 70d027ba81f54eba882756b941186710 P a722e54d227f4c29a9ed6ce77858003a -> Peer a1a22e9119494570b6d2217713fd7e43 (127.5.126.67:38125): Couldn't send request to peer a1a22e9119494570b6d2217713fd7e43. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:23:28.172760 15072 consensus_peers.cc:597] T d65eaa0ab4574a1ea92b3848d4dc9c4d P a722e54d227f4c29a9ed6ce77858003a -> Peer a1a22e9119494570b6d2217713fd7e43 (127.5.126.67:38125): Couldn't send request to peer a1a22e9119494570b6d2217713fd7e43. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:23:28.196094  5625 tablet_server.cc:196] TabletServer@127.5.126.67:0 shutdown complete.
I20260709 13:23:28.197340 16009 raft_consensus.cc:493] T f954c6c25a25443abd9705c8e909bf47 P a722e54d227f4c29a9ed6ce77858003a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f3a500981b494979b58d2b1041fec9c8)
I20260709 13:23:28.197968 16009 raft_consensus.cc:515] T f954c6c25a25443abd9705c8e909bf47 P a722e54d227f4c29a9ed6ce77858003a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } } peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } } peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } }
I20260709 13:23:28.200222 16009 leader_election.cc:290] T f954c6c25a25443abd9705c8e909bf47 P a722e54d227f4c29a9ed6ce77858003a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f3a500981b494979b58d2b1041fec9c8 (127.5.126.65:34129), 0efc951052454eec9a58b0cd025945b8 (127.5.126.66:34613)
W20260709 13:23:28.205148 15073 leader_election.cc:336] T f954c6c25a25443abd9705c8e909bf47 P a722e54d227f4c29a9ed6ce77858003a [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer f3a500981b494979b58d2b1041fec9c8 (127.5.126.65:34129): Network error: Client connection negotiation failed: client connection to 127.5.126.65:34129: connect: Connection refused (error 111)
W20260709 13:23:28.206159 15073 leader_election.cc:336] T f954c6c25a25443abd9705c8e909bf47 P a722e54d227f4c29a9ed6ce77858003a [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 0efc951052454eec9a58b0cd025945b8 (127.5.126.66:34613): Network error: Client connection negotiation failed: client connection to 127.5.126.66:34613: connect: Connection refused (error 111)
I20260709 13:23:28.206522 15073 leader_election.cc:304] T f954c6c25a25443abd9705c8e909bf47 P a722e54d227f4c29a9ed6ce77858003a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a722e54d227f4c29a9ed6ce77858003a; no voters: 0efc951052454eec9a58b0cd025945b8, f3a500981b494979b58d2b1041fec9c8
I20260709 13:23:28.207202 16009 raft_consensus.cc:2749] T f954c6c25a25443abd9705c8e909bf47 P a722e54d227f4c29a9ed6ce77858003a [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:23:28.222056 15072 consensus_peers.cc:597] T bf0b7c8005aa4d8ab97a1499761bf98a P a722e54d227f4c29a9ed6ce77858003a -> Peer a1a22e9119494570b6d2217713fd7e43 (127.5.126.67:38125): Couldn't send request to peer a1a22e9119494570b6d2217713fd7e43. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.67:38125: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:23:28.222661 15072 consensus_peers.cc:597] T a2de4fecd70240dd8ed436fa8de65773 P a722e54d227f4c29a9ed6ce77858003a -> Peer a1a22e9119494570b6d2217713fd7e43 (127.5.126.67:38125): Couldn't send request to peer a1a22e9119494570b6d2217713fd7e43. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.67:38125: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:23:28.238955 16112 raft_consensus.cc:493] T 2a862e106a9e48a692bc72ea8c03ab39 P a722e54d227f4c29a9ed6ce77858003a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f3a500981b494979b58d2b1041fec9c8)
I20260709 13:23:28.239538 16112 raft_consensus.cc:515] T 2a862e106a9e48a692bc72ea8c03ab39 P a722e54d227f4c29a9ed6ce77858003a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } } peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } } peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } }
I20260709 13:23:28.242060 16112 leader_election.cc:290] T 2a862e106a9e48a692bc72ea8c03ab39 P a722e54d227f4c29a9ed6ce77858003a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f3a500981b494979b58d2b1041fec9c8 (127.5.126.65:34129), 0efc951052454eec9a58b0cd025945b8 (127.5.126.66:34613)
W20260709 13:23:28.250777 15072 consensus_peers.cc:597] T 8996bae84ecc4bffa0239d64dce7b24f P a722e54d227f4c29a9ed6ce77858003a -> Peer a1a22e9119494570b6d2217713fd7e43 (127.5.126.67:38125): Couldn't send request to peer a1a22e9119494570b6d2217713fd7e43. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.67:38125: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:23:28.252489 15073 leader_election.cc:336] T 2a862e106a9e48a692bc72ea8c03ab39 P a722e54d227f4c29a9ed6ce77858003a [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 0efc951052454eec9a58b0cd025945b8 (127.5.126.66:34613): Network error: Client connection negotiation failed: client connection to 127.5.126.66:34613: connect: Connection refused (error 111)
W20260709 13:23:28.253237 15073 leader_election.cc:336] T 2a862e106a9e48a692bc72ea8c03ab39 P a722e54d227f4c29a9ed6ce77858003a [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer f3a500981b494979b58d2b1041fec9c8 (127.5.126.65:34129): Network error: Client connection negotiation failed: client connection to 127.5.126.65:34129: connect: Connection refused (error 111)
I20260709 13:23:28.253572 15073 leader_election.cc:304] T 2a862e106a9e48a692bc72ea8c03ab39 P a722e54d227f4c29a9ed6ce77858003a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a722e54d227f4c29a9ed6ce77858003a; no voters: 0efc951052454eec9a58b0cd025945b8, f3a500981b494979b58d2b1041fec9c8
I20260709 13:23:28.254251 16112 raft_consensus.cc:2749] T 2a862e106a9e48a692bc72ea8c03ab39 P a722e54d227f4c29a9ed6ce77858003a [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:23:28.277235  5625 tablet_server.cc:179] TabletServer@127.5.126.68:0 shutting down...
W20260709 13:23:28.291013 15072 consensus_peers.cc:597] T dee43e01ec5d409b877a5c2dbf5b7b77 P a722e54d227f4c29a9ed6ce77858003a -> Peer a1a22e9119494570b6d2217713fd7e43 (127.5.126.67:38125): Couldn't send request to peer a1a22e9119494570b6d2217713fd7e43. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.67:38125: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:23:28.300588 15072 consensus_peers.cc:597] T 0819f8999271428481a1f839026171a7 P a722e54d227f4c29a9ed6ce77858003a -> Peer a1a22e9119494570b6d2217713fd7e43 (127.5.126.67:38125): Couldn't send request to peer a1a22e9119494570b6d2217713fd7e43. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.67:38125: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:23:28.307796 15072 consensus_peers.cc:597] T f86a730e237248dc9b91cbb75e29c324 P a722e54d227f4c29a9ed6ce77858003a -> Peer a1a22e9119494570b6d2217713fd7e43 (127.5.126.67:38125): Couldn't send request to peer a1a22e9119494570b6d2217713fd7e43. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.67:38125: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:23:28.337761 15072 consensus_peers.cc:597] T ad084674821d4137b02efe692068d382 P a722e54d227f4c29a9ed6ce77858003a -> Peer a1a22e9119494570b6d2217713fd7e43 (127.5.126.67:38125): Couldn't send request to peer a1a22e9119494570b6d2217713fd7e43. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.67:38125: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:23:28.348215  5625 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:23:28.348654 16087 raft_consensus.cc:493] T 58a622a48cd24833bc5fc27e03114176 P a722e54d227f4c29a9ed6ce77858003a [term 3 FOLLOWER]: Starting pre-election (detected failure of leader f3a500981b494979b58d2b1041fec9c8)
I20260709 13:23:28.349303  5625 tablet_replica.cc:333] T bf0b7c8005aa4d8ab97a1499761bf98a P a722e54d227f4c29a9ed6ce77858003a: stopping tablet replica
I20260709 13:23:28.349449 16087 raft_consensus.cc:515] T 58a622a48cd24833bc5fc27e03114176 P a722e54d227f4c29a9ed6ce77858003a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } } peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } } peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } }
I20260709 13:23:28.350345  5625 raft_consensus.cc:2243] T bf0b7c8005aa4d8ab97a1499761bf98a P a722e54d227f4c29a9ed6ce77858003a [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:23:28.351394  5625 raft_consensus.cc:2272] T bf0b7c8005aa4d8ab97a1499761bf98a P a722e54d227f4c29a9ed6ce77858003a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:28.352375 16087 leader_election.cc:290] T 58a622a48cd24833bc5fc27e03114176 P a722e54d227f4c29a9ed6ce77858003a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f3a500981b494979b58d2b1041fec9c8 (127.5.126.65:34129), 0efc951052454eec9a58b0cd025945b8 (127.5.126.66:34613)
I20260709 13:23:28.354488  5625 tablet_replica.cc:333] T 34e83f249d9942e99244702be584c8ae P a722e54d227f4c29a9ed6ce77858003a: stopping tablet replica
I20260709 13:23:28.355439  5625 raft_consensus.cc:2243] T 34e83f249d9942e99244702be584c8ae P a722e54d227f4c29a9ed6ce77858003a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:23:28.356091  5625 raft_consensus.cc:2272] T 34e83f249d9942e99244702be584c8ae P a722e54d227f4c29a9ed6ce77858003a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:28.359076  5625 tablet_replica.cc:333] T f86a730e237248dc9b91cbb75e29c324 P a722e54d227f4c29a9ed6ce77858003a: stopping tablet replica
I20260709 13:23:28.359880  5625 raft_consensus.cc:2243] T f86a730e237248dc9b91cbb75e29c324 P a722e54d227f4c29a9ed6ce77858003a [term 2 LEADER]: Raft consensus shutting down.
W20260709 13:23:28.360287 15073 leader_election.cc:336] T 58a622a48cd24833bc5fc27e03114176 P a722e54d227f4c29a9ed6ce77858003a [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer f3a500981b494979b58d2b1041fec9c8 (127.5.126.65:34129): Network error: Client connection negotiation failed: client connection to 127.5.126.65:34129: connect: Connection refused (error 111)
I20260709 13:23:28.361199  5625 raft_consensus.cc:2272] T f86a730e237248dc9b91cbb75e29c324 P a722e54d227f4c29a9ed6ce77858003a [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:23:28.362305 15073 leader_election.cc:336] T 58a622a48cd24833bc5fc27e03114176 P a722e54d227f4c29a9ed6ce77858003a [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 0efc951052454eec9a58b0cd025945b8 (127.5.126.66:34613): Network error: Client connection negotiation failed: client connection to 127.5.126.66:34613: connect: Connection refused (error 111)
I20260709 13:23:28.362783 16086 raft_consensus.cc:493] T 77e8d8b35cf148e99e8274bf65e5ed05 P a722e54d227f4c29a9ed6ce77858003a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f3a500981b494979b58d2b1041fec9c8)
I20260709 13:23:28.362819 15073 leader_election.cc:304] T 58a622a48cd24833bc5fc27e03114176 P a722e54d227f4c29a9ed6ce77858003a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a722e54d227f4c29a9ed6ce77858003a; no voters: 0efc951052454eec9a58b0cd025945b8, f3a500981b494979b58d2b1041fec9c8
I20260709 13:23:28.363946  5625 tablet_replica.cc:333] T 77e8d8b35cf148e99e8274bf65e5ed05 P a722e54d227f4c29a9ed6ce77858003a: stopping tablet replica
I20260709 13:23:28.363564 16086 raft_consensus.cc:515] T 77e8d8b35cf148e99e8274bf65e5ed05 P a722e54d227f4c29a9ed6ce77858003a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } } peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } } peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } }
I20260709 13:23:28.364852  5625 raft_consensus.cc:2243] T 77e8d8b35cf148e99e8274bf65e5ed05 P a722e54d227f4c29a9ed6ce77858003a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:23:28.365381  5625 raft_consensus.cc:2272] T 77e8d8b35cf148e99e8274bf65e5ed05 P a722e54d227f4c29a9ed6ce77858003a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:28.366021 16086 leader_election.cc:290] T 77e8d8b35cf148e99e8274bf65e5ed05 P a722e54d227f4c29a9ed6ce77858003a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f3a500981b494979b58d2b1041fec9c8 (127.5.126.65:34129), 0efc951052454eec9a58b0cd025945b8 (127.5.126.66:34613)
I20260709 13:23:28.366660 16086 raft_consensus.cc:2749] T 58a622a48cd24833bc5fc27e03114176 P a722e54d227f4c29a9ed6ce77858003a [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:23:28.369120  5625 tablet_replica.cc:333] T 2a9523aa8663464686254c8412c37e67 P a722e54d227f4c29a9ed6ce77858003a: stopping tablet replica
I20260709 13:23:28.369979  5625 raft_consensus.cc:2243] T 2a9523aa8663464686254c8412c37e67 P a722e54d227f4c29a9ed6ce77858003a [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:23:28.371048  5625 raft_consensus.cc:2272] T 2a9523aa8663464686254c8412c37e67 P a722e54d227f4c29a9ed6ce77858003a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:28.373905  5625 tablet_replica.cc:333] T d64d06459b344ff99c0df07c249c3a60 P a722e54d227f4c29a9ed6ce77858003a: stopping tablet replica
W20260709 13:23:28.374662 15073 leader_election.cc:336] T 77e8d8b35cf148e99e8274bf65e5ed05 P a722e54d227f4c29a9ed6ce77858003a [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer f3a500981b494979b58d2b1041fec9c8 (127.5.126.65:34129): Network error: Client connection negotiation failed: client connection to 127.5.126.65:34129: connect: Connection refused (error 111)
I20260709 13:23:28.374703  5625 raft_consensus.cc:2243] T d64d06459b344ff99c0df07c249c3a60 P a722e54d227f4c29a9ed6ce77858003a [term 2 FOLLOWER]: Raft consensus shutting down.
W20260709 13:23:28.375397 15073 leader_election.cc:336] T 77e8d8b35cf148e99e8274bf65e5ed05 P a722e54d227f4c29a9ed6ce77858003a [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 0efc951052454eec9a58b0cd025945b8 (127.5.126.66:34613): Network error: Client connection negotiation failed: client connection to 127.5.126.66:34613: connect: Connection refused (error 111)
I20260709 13:23:28.375453  5625 raft_consensus.cc:2272] T d64d06459b344ff99c0df07c249c3a60 P a722e54d227f4c29a9ed6ce77858003a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:28.375813 15073 leader_election.cc:304] T 77e8d8b35cf148e99e8274bf65e5ed05 P a722e54d227f4c29a9ed6ce77858003a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a722e54d227f4c29a9ed6ce77858003a; no voters: 0efc951052454eec9a58b0cd025945b8, f3a500981b494979b58d2b1041fec9c8
W20260709 13:23:28.376484 15073 raft_consensus.cc:2686] T 77e8d8b35cf148e99e8274bf65e5ed05 P a722e54d227f4c29a9ed6ce77858003a: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260709 13:23:28.378326  5625 tablet_replica.cc:333] T 58a622a48cd24833bc5fc27e03114176 P a722e54d227f4c29a9ed6ce77858003a: stopping tablet replica
I20260709 13:23:28.379124  5625 raft_consensus.cc:2243] T 58a622a48cd24833bc5fc27e03114176 P a722e54d227f4c29a9ed6ce77858003a [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:23:28.379644  5625 raft_consensus.cc:2272] T 58a622a48cd24833bc5fc27e03114176 P a722e54d227f4c29a9ed6ce77858003a [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:28.381763  5625 tablet_replica.cc:333] T 03b63e2bee374ed5931dab67ee14b555 P a722e54d227f4c29a9ed6ce77858003a: stopping tablet replica
I20260709 13:23:28.382295  5625 raft_consensus.cc:2243] T 03b63e2bee374ed5931dab67ee14b555 P a722e54d227f4c29a9ed6ce77858003a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:23:28.382671  5625 raft_consensus.cc:2272] T 03b63e2bee374ed5931dab67ee14b555 P a722e54d227f4c29a9ed6ce77858003a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:28.384584  5625 tablet_replica.cc:333] T af00ad02fba64998bb25991f6f69f291 P a722e54d227f4c29a9ed6ce77858003a: stopping tablet replica
I20260709 13:23:28.385088  5625 raft_consensus.cc:2243] T af00ad02fba64998bb25991f6f69f291 P a722e54d227f4c29a9ed6ce77858003a [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:23:28.385573  5625 raft_consensus.cc:2272] T af00ad02fba64998bb25991f6f69f291 P a722e54d227f4c29a9ed6ce77858003a [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:28.388067  5625 tablet_replica.cc:333] T 8996bae84ecc4bffa0239d64dce7b24f P a722e54d227f4c29a9ed6ce77858003a: stopping tablet replica
I20260709 13:23:28.388793  5625 raft_consensus.cc:2243] T 8996bae84ecc4bffa0239d64dce7b24f P a722e54d227f4c29a9ed6ce77858003a [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:23:28.389679  5625 raft_consensus.cc:2272] T 8996bae84ecc4bffa0239d64dce7b24f P a722e54d227f4c29a9ed6ce77858003a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:28.392158  5625 tablet_replica.cc:333] T e4f2c694c8194f1e86ad76c7ff051ea7 P a722e54d227f4c29a9ed6ce77858003a: stopping tablet replica
I20260709 13:23:28.392652  5625 raft_consensus.cc:2243] T e4f2c694c8194f1e86ad76c7ff051ea7 P a722e54d227f4c29a9ed6ce77858003a [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:23:28.393486  5625 raft_consensus.cc:2272] T e4f2c694c8194f1e86ad76c7ff051ea7 P a722e54d227f4c29a9ed6ce77858003a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:28.395532  5625 tablet_replica.cc:333] T e75f8237624f42f793627366f05b792a P a722e54d227f4c29a9ed6ce77858003a: stopping tablet replica
I20260709 13:23:28.396092  5625 raft_consensus.cc:2243] T e75f8237624f42f793627366f05b792a P a722e54d227f4c29a9ed6ce77858003a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:23:28.396502  5625 raft_consensus.cc:2272] T e75f8237624f42f793627366f05b792a P a722e54d227f4c29a9ed6ce77858003a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:28.398296  5625 tablet_replica.cc:333] T 7a4cf38d1a6644f082f401b9b26bfb27 P a722e54d227f4c29a9ed6ce77858003a: stopping tablet replica
I20260709 13:23:28.398819  5625 raft_consensus.cc:2243] T 7a4cf38d1a6644f082f401b9b26bfb27 P a722e54d227f4c29a9ed6ce77858003a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:23:28.399188  5625 raft_consensus.cc:2272] T 7a4cf38d1a6644f082f401b9b26bfb27 P a722e54d227f4c29a9ed6ce77858003a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:28.401060  5625 tablet_replica.cc:333] T dadd194761924530aede05672c9eecf9 P a722e54d227f4c29a9ed6ce77858003a: stopping tablet replica
I20260709 13:23:28.401568  5625 raft_consensus.cc:2243] T dadd194761924530aede05672c9eecf9 P a722e54d227f4c29a9ed6ce77858003a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:23:28.402135  5625 raft_consensus.cc:2272] T dadd194761924530aede05672c9eecf9 P a722e54d227f4c29a9ed6ce77858003a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:28.404572  5625 tablet_replica.cc:333] T f954c6c25a25443abd9705c8e909bf47 P a722e54d227f4c29a9ed6ce77858003a: stopping tablet replica
I20260709 13:23:28.405300  5625 raft_consensus.cc:2243] T f954c6c25a25443abd9705c8e909bf47 P a722e54d227f4c29a9ed6ce77858003a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:23:28.405771  5625 raft_consensus.cc:2272] T f954c6c25a25443abd9705c8e909bf47 P a722e54d227f4c29a9ed6ce77858003a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:28.408131  5625 tablet_replica.cc:333] T aecef3c240394d54844ec8170e9cad59 P a722e54d227f4c29a9ed6ce77858003a: stopping tablet replica
I20260709 13:23:28.408638  5625 raft_consensus.cc:2243] T aecef3c240394d54844ec8170e9cad59 P a722e54d227f4c29a9ed6ce77858003a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:23:28.409015  5625 raft_consensus.cc:2272] T aecef3c240394d54844ec8170e9cad59 P a722e54d227f4c29a9ed6ce77858003a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:28.410804  5625 tablet_replica.cc:333] T decdd091b0f243d786ee350a437b30f1 P a722e54d227f4c29a9ed6ce77858003a: stopping tablet replica
I20260709 13:23:28.411290  5625 raft_consensus.cc:2243] T decdd091b0f243d786ee350a437b30f1 P a722e54d227f4c29a9ed6ce77858003a [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:23:28.411998  5625 raft_consensus.cc:2272] T decdd091b0f243d786ee350a437b30f1 P a722e54d227f4c29a9ed6ce77858003a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:28.413864  5625 tablet_replica.cc:333] T e85432ede09747339c957cdaa7d15ac6 P a722e54d227f4c29a9ed6ce77858003a: stopping tablet replica
I20260709 13:23:28.414419  5625 raft_consensus.cc:2243] T e85432ede09747339c957cdaa7d15ac6 P a722e54d227f4c29a9ed6ce77858003a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:23:28.415027  5625 raft_consensus.cc:2272] T e85432ede09747339c957cdaa7d15ac6 P a722e54d227f4c29a9ed6ce77858003a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:28.415114 16087 raft_consensus.cc:493] T 532cc9041f414e018098570192e0fae8 P a722e54d227f4c29a9ed6ce77858003a [term 3 FOLLOWER]: Starting pre-election (detected failure of leader f3a500981b494979b58d2b1041fec9c8)
I20260709 13:23:28.415738 16087 raft_consensus.cc:515] T 532cc9041f414e018098570192e0fae8 P a722e54d227f4c29a9ed6ce77858003a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a722e54d227f4c29a9ed6ce77858003a" member_type: VOTER last_known_addr { host: "127.5.126.68" port: 46669 } } peers { permanent_uuid: "f3a500981b494979b58d2b1041fec9c8" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34129 } } peers { permanent_uuid: "0efc951052454eec9a58b0cd025945b8" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 34613 } }
I20260709 13:23:28.417991  5625 tablet_replica.cc:333] T f0424da0ffb84ba5931fe92f6dd57c5f P a722e54d227f4c29a9ed6ce77858003a: stopping tablet replica
I20260709 13:23:28.418298 16087 leader_election.cc:290] T 532cc9041f414e018098570192e0fae8 P a722e54d227f4c29a9ed6ce77858003a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f3a500981b494979b58d2b1041fec9c8 (127.5.126.65:34129), 0efc951052454eec9a58b0cd025945b8 (127.5.126.66:34613)
I20260709 13:23:28.418861  5625 raft_consensus.cc:2243] T f0424da0ffb84ba5931fe92f6dd57c5f P a722e54d227f4c29a9ed6ce77858003a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:23:28.419358  5625 raft_consensus.cc:2272] T f0424da0ffb84ba5931fe92f6dd57c5f P a722e54d227f4c29a9ed6ce77858003a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:28.421888  5625 tablet_replica.cc:333] T 03f377f48e8849adade3945935d300a9 P a722e54d227f4c29a9ed6ce77858003a: stopping tablet replica
I20260709 13:23:28.422662  5625 raft_consensus.cc:2243] T 03f377f48e8849adade3945935d300a9 P a722e54d227f4c29a9ed6ce77858003a [term 1 FOLLOWER]: Raft consensus shutting down.
W20260709 13:23:28.422748 15073 leader_election.cc:336] T 532cc9041f414e018098570192e0fae8 P a722e54d227f4c29a9ed6ce77858003a [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer f3a500981b494979b58d2b1041fec9c8 (127.5.126.65:34129): Network error: Client connection negotiation failed: client connection to 127.5.126.65:34129: connect: Connection refused (error 111)
I20260709 13:23:28.423200  5625 raft_consensus.cc:2272] T 03f377f48e8849adade3945935d300a9 P a722e54d227f4c29a9ed6ce77858003a [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:23:28.423667 15073 leader_election.cc:336] T 532cc9041f414e018098570192e0fae8 P a722e54d227f4c29a9ed6ce77858003a [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 0efc951052454eec9a58b0cd025945b8 (127.5.126.66:34613): Network error: Client connection negotiation failed: client connection to 127.5.126.66:34613: connect: Connection refused (error 111)
I20260709 13:23:28.424158 15073 leader_election.cc:304] T 532cc9041f414e018098570192e0fae8 P a722e54d227f4c29a9ed6ce77858003a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a722e54d227f4c29a9ed6ce77858003a; no voters: 0efc951052454eec9a58b0cd025945b8, f3a500981b494979b58d2b1041fec9c8
I20260709 13:23:28.424974 16087 raft_consensus.cc:2749] T 532cc9041f414e018098570192e0fae8 P a722e54d227f4c29a9ed6ce77858003a [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:23:28.425938  5625 tablet_replica.cc:333] T 0819f8999271428481a1f839026171a7 P a722e54d227f4c29a9ed6ce77858003a: stopping tablet replica
I20260709 13:23:28.426538  5625 raft_consensus.cc:2243] T 0819f8999271428481a1f839026171a7 P a722e54d227f4c29a9ed6ce77858003a [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:23:28.427264  5625 raft_consensus.cc:2272] T 0819f8999271428481a1f839026171a7 P a722e54d227f4c29a9ed6ce77858003a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:28.429293  5625 tablet_replica.cc:333] T a2de4fecd70240dd8ed436fa8de65773 P a722e54d227f4c29a9ed6ce77858003a: stopping tablet replica
I20260709 13:23:28.429811  5625 raft_consensus.cc:2243] T a2de4fecd70240dd8ed436fa8de65773 P a722e54d227f4c29a9ed6ce77858003a [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:23:28.430514  5625 raft_consensus.cc:2272] T a2de4fecd70240dd8ed436fa8de65773 P a722e54d227f4c29a9ed6ce77858003a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:28.432438  5625 tablet_replica.cc:333] T 70d027ba81f54eba882756b941186710 P a722e54d227f4c29a9ed6ce77858003a: stopping tablet replica
I20260709 13:23:28.433002  5625 raft_consensus.cc:2243] T 70d027ba81f54eba882756b941186710 P a722e54d227f4c29a9ed6ce77858003a [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:23:28.433794  5625 raft_consensus.cc:2272] T 70d027ba81f54eba882756b941186710 P a722e54d227f4c29a9ed6ce77858003a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:28.435813  5625 tablet_replica.cc:333] T 5df7528567fd4291a888bfb37c28dc27 P a722e54d227f4c29a9ed6ce77858003a: stopping tablet replica
I20260709 13:23:28.436398  5625 raft_consensus.cc:2243] T 5df7528567fd4291a888bfb37c28dc27 P a722e54d227f4c29a9ed6ce77858003a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:23:28.436827  5625 raft_consensus.cc:2272] T 5df7528567fd4291a888bfb37c28dc27 P a722e54d227f4c29a9ed6ce77858003a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:28.438676  5625 tablet_replica.cc:333] T 117ae8a22b1d46579ce047f99e30520b P a722e54d227f4c29a9ed6ce77858003a: stopping tablet replica
I20260709 13:23:28.439213  5625 raft_consensus.cc:2243] T 117ae8a22b1d46579ce047f99e30520b P a722e54d227f4c29a9ed6ce77858003a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:23:28.439648  5625 raft_consensus.cc:2272] T 117ae8a22b1d46579ce047f99e30520b P a722e54d227f4c29a9ed6ce77858003a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:28.441592  5625 tablet_replica.cc:333] T 16d5db73377a4925b9f1e814ba306fcc P a722e54d227f4c29a9ed6ce77858003a: stopping tablet replica
I20260709 13:23:28.442170  5625 raft_consensus.cc:2243] T 16d5db73377a4925b9f1e814ba306fcc P a722e54d227f4c29a9ed6ce77858003a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:23:28.442610  5625 raft_consensus.cc:2272] T 16d5db73377a4925b9f1e814ba306fcc P a722e54d227f4c29a9ed6ce77858003a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:28.444511  5625 tablet_replica.cc:333] T a71163721b4d48b0b5ff366b9d12ac32 P a722e54d227f4c29a9ed6ce77858003a: stopping tablet replica
I20260709 13:23:28.445065  5625 raft_consensus.cc:2243] T a71163721b4d48b0b5ff366b9d12ac32 P a722e54d227f4c29a9ed6ce77858003a [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:23:28.445856  5625 raft_consensus.cc:2272] T a71163721b4d48b0b5ff366b9d12ac32 P a722e54d227f4c29a9ed6ce77858003a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:28.447743  5625 tablet_replica.cc:333] T e4a490a7748841c3803607059f9d8825 P a722e54d227f4c29a9ed6ce77858003a: stopping tablet replica
I20260709 13:23:28.448297  5625 raft_consensus.cc:2243] T e4a490a7748841c3803607059f9d8825 P a722e54d227f4c29a9ed6ce77858003a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:23:28.448721  5625 raft_consensus.cc:2272] T e4a490a7748841c3803607059f9d8825 P a722e54d227f4c29a9ed6ce77858003a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:28.450469  5625 tablet_replica.cc:333] T ced632bda66e4a74b9c854befbcbac9b P a722e54d227f4c29a9ed6ce77858003a: stopping tablet replica
I20260709 13:23:28.451007  5625 raft_consensus.cc:2243] T ced632bda66e4a74b9c854befbcbac9b P a722e54d227f4c29a9ed6ce77858003a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:23:28.451433  5625 raft_consensus.cc:2272] T ced632bda66e4a74b9c854befbcbac9b P a722e54d227f4c29a9ed6ce77858003a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:28.453238  5625 tablet_replica.cc:333] T 2a862e106a9e48a692bc72ea8c03ab39 P a722e54d227f4c29a9ed6ce77858003a: stopping tablet replica
I20260709 13:23:28.453775  5625 raft_consensus.cc:2243] T 2a862e106a9e48a692bc72ea8c03ab39 P a722e54d227f4c29a9ed6ce77858003a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:23:28.454185  5625 raft_consensus.cc:2272] T 2a862e106a9e48a692bc72ea8c03ab39 P a722e54d227f4c29a9ed6ce77858003a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:28.455899  5625 tablet_replica.cc:333] T 940021bf0c344d01bc3adaae308d968d P a722e54d227f4c29a9ed6ce77858003a: stopping tablet replica
I20260709 13:23:28.456524  5625 raft_consensus.cc:2243] T 940021bf0c344d01bc3adaae308d968d P a722e54d227f4c29a9ed6ce77858003a [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:23:28.457320  5625 raft_consensus.cc:2272] T 940021bf0c344d01bc3adaae308d968d P a722e54d227f4c29a9ed6ce77858003a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:28.459196  5625 tablet_replica.cc:333] T ad084674821d4137b02efe692068d382 P a722e54d227f4c29a9ed6ce77858003a: stopping tablet replica
I20260709 13:23:28.459753  5625 raft_consensus.cc:2243] T ad084674821d4137b02efe692068d382 P a722e54d227f4c29a9ed6ce77858003a [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:23:28.460527  5625 raft_consensus.cc:2272] T ad084674821d4137b02efe692068d382 P a722e54d227f4c29a9ed6ce77858003a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:28.462316  5625 tablet_replica.cc:333] T 36f72377897846f2a1f3d8d33ec14af6 P a722e54d227f4c29a9ed6ce77858003a: stopping tablet replica
I20260709 13:23:28.462826  5625 raft_consensus.cc:2243] T 36f72377897846f2a1f3d8d33ec14af6 P a722e54d227f4c29a9ed6ce77858003a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:23:28.463241  5625 raft_consensus.cc:2272] T 36f72377897846f2a1f3d8d33ec14af6 P a722e54d227f4c29a9ed6ce77858003a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:28.465039  5625 tablet_replica.cc:333] T 532cc9041f414e018098570192e0fae8 P a722e54d227f4c29a9ed6ce77858003a: stopping tablet replica
I20260709 13:23:28.465579  5625 raft_consensus.cc:2243] T 532cc9041f414e018098570192e0fae8 P a722e54d227f4c29a9ed6ce77858003a [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:23:28.465969  5625 raft_consensus.cc:2272] T 532cc9041f414e018098570192e0fae8 P a722e54d227f4c29a9ed6ce77858003a [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:28.467891  5625 tablet_replica.cc:333] T 5cd72bf3a0114fddb1bda8271debea24 P a722e54d227f4c29a9ed6ce77858003a: stopping tablet replica
I20260709 13:23:28.468503  5625 raft_consensus.cc:2243] T 5cd72bf3a0114fddb1bda8271debea24 P a722e54d227f4c29a9ed6ce77858003a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:23:28.468914  5625 raft_consensus.cc:2272] T 5cd72bf3a0114fddb1bda8271debea24 P a722e54d227f4c29a9ed6ce77858003a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:28.470587  5625 tablet_replica.cc:333] T 53592d0c0a46440dbfcd26f8b8111859 P a722e54d227f4c29a9ed6ce77858003a: stopping tablet replica
I20260709 13:23:28.471035  5625 raft_consensus.cc:2243] T 53592d0c0a46440dbfcd26f8b8111859 P a722e54d227f4c29a9ed6ce77858003a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:23:28.471429  5625 raft_consensus.cc:2272] T 53592d0c0a46440dbfcd26f8b8111859 P a722e54d227f4c29a9ed6ce77858003a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:28.473327  5625 tablet_replica.cc:333] T 914c9c0c3be1486f8dcce382b61b5450 P a722e54d227f4c29a9ed6ce77858003a: stopping tablet replica
I20260709 13:23:28.473780  5625 raft_consensus.cc:2243] T 914c9c0c3be1486f8dcce382b61b5450 P a722e54d227f4c29a9ed6ce77858003a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:23:28.474121  5625 raft_consensus.cc:2272] T 914c9c0c3be1486f8dcce382b61b5450 P a722e54d227f4c29a9ed6ce77858003a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:28.475879  5625 tablet_replica.cc:333] T 268027ae94a54cf4acf51c54c7b9032b P a722e54d227f4c29a9ed6ce77858003a: stopping tablet replica
I20260709 13:23:28.476383  5625 raft_consensus.cc:2243] T 268027ae94a54cf4acf51c54c7b9032b P a722e54d227f4c29a9ed6ce77858003a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:23:28.476732  5625 raft_consensus.cc:2272] T 268027ae94a54cf4acf51c54c7b9032b P a722e54d227f4c29a9ed6ce77858003a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:28.478435  5625 tablet_replica.cc:333] T dee43e01ec5d409b877a5c2dbf5b7b77 P a722e54d227f4c29a9ed6ce77858003a: stopping tablet replica
I20260709 13:23:28.478873  5625 raft_consensus.cc:2243] T dee43e01ec5d409b877a5c2dbf5b7b77 P a722e54d227f4c29a9ed6ce77858003a [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:23:28.479561  5625 raft_consensus.cc:2272] T dee43e01ec5d409b877a5c2dbf5b7b77 P a722e54d227f4c29a9ed6ce77858003a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:28.481483  5625 tablet_replica.cc:333] T e429eefef04d433e8f18dfbc0387068d P a722e54d227f4c29a9ed6ce77858003a: stopping tablet replica
I20260709 13:23:28.481913  5625 raft_consensus.cc:2243] T e429eefef04d433e8f18dfbc0387068d P a722e54d227f4c29a9ed6ce77858003a [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:23:28.482404  5625 raft_consensus.cc:2272] T e429eefef04d433e8f18dfbc0387068d P a722e54d227f4c29a9ed6ce77858003a [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:28.484261  5625 tablet_replica.cc:333] T 7e29a38455b241239882b6af3eac3d51 P a722e54d227f4c29a9ed6ce77858003a: stopping tablet replica
I20260709 13:23:28.484722  5625 raft_consensus.cc:2243] T 7e29a38455b241239882b6af3eac3d51 P a722e54d227f4c29a9ed6ce77858003a [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:23:28.485440  5625 raft_consensus.cc:2272] T 7e29a38455b241239882b6af3eac3d51 P a722e54d227f4c29a9ed6ce77858003a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:28.487447  5625 tablet_replica.cc:333] T 7b8e0fe5ef6d4c42b9854399aac3a1d6 P a722e54d227f4c29a9ed6ce77858003a: stopping tablet replica
I20260709 13:23:28.487900  5625 raft_consensus.cc:2243] T 7b8e0fe5ef6d4c42b9854399aac3a1d6 P a722e54d227f4c29a9ed6ce77858003a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:23:28.488365  5625 raft_consensus.cc:2272] T 7b8e0fe5ef6d4c42b9854399aac3a1d6 P a722e54d227f4c29a9ed6ce77858003a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:28.490195  5625 tablet_replica.cc:333] T abc01daa220a47fa8578b0d20a17c9ab P a722e54d227f4c29a9ed6ce77858003a: stopping tablet replica
I20260709 13:23:28.490623  5625 raft_consensus.cc:2243] T abc01daa220a47fa8578b0d20a17c9ab P a722e54d227f4c29a9ed6ce77858003a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:23:28.491048  5625 raft_consensus.cc:2272] T abc01daa220a47fa8578b0d20a17c9ab P a722e54d227f4c29a9ed6ce77858003a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:28.493018  5625 tablet_replica.cc:333] T d65eaa0ab4574a1ea92b3848d4dc9c4d P a722e54d227f4c29a9ed6ce77858003a: stopping tablet replica
I20260709 13:23:28.493404  5625 raft_consensus.cc:2243] T d65eaa0ab4574a1ea92b3848d4dc9c4d P a722e54d227f4c29a9ed6ce77858003a [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:23:28.494204  5625 raft_consensus.cc:2272] T d65eaa0ab4574a1ea92b3848d4dc9c4d P a722e54d227f4c29a9ed6ce77858003a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:28.564654  5625 tablet_server.cc:196] TabletServer@127.5.126.68:0 shutdown complete.
I20260709 13:23:28.642383  5625 master.cc:562] Master@127.5.126.126:45503 shutting down...
I20260709 13:23:28.679872  5625 raft_consensus.cc:2243] T 00000000000000000000000000000000 P cac9771223d04992a839004076c8c496 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:23:28.680508  5625 raft_consensus.cc:2272] T 00000000000000000000000000000000 P cac9771223d04992a839004076c8c496 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:28.680826  5625 tablet_replica.cc:333] T 00000000000000000000000000000000 P cac9771223d04992a839004076c8c496: stopping tablet replica
I20260709 13:23:28.703500  5625 master.cc:584] Master@127.5.126.126:45503 shutdown complete.
[       OK ] LeaderRebalancerTest.RestartTserver (33824 ms)
[ RUN      ] LeaderRebalancerTest.TestMaintenanceMode
I20260709 13:23:28.808388  5625 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.5.126.126:35803
I20260709 13:23:28.809721  5625 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:23:28.817466 16115 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:23:28.817754 16116 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:23:28.818596 16118 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:23:28.819607  5625 server_base.cc:1061] running on GCE node
I20260709 13:23:28.820916  5625 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:23:28.821115  5625 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:23:28.821311  5625 hybrid_clock.cc:648] HybridClock initialized: now 1783603408821294 us; error 0 us; skew 500 ppm
I20260709 13:23:28.821938  5625 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:23:28.824818  5625 webserver.cc:533] Webserver started at http://127.5.126.126:46447/ using document root <none> and password file <none>
I20260709 13:23:28.825438  5625 fs_manager.cc:362] Metadata directory not provided
I20260709 13:23:28.825642  5625 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:23:28.825963  5625 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:23:28.827258  5625 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskWHb0CB/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783603057096655-5625-0/minicluster-data/master-0-root/instance:
uuid: "01b5fafdca654d40899905e7044fc4b1"
format_stamp: "Formatted at 2026-07-09 13:23:28 on dist-test-slave-smzk"
I20260709 13:23:28.832602  5625 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.007s	sys 0.000s
I20260709 13:23:28.836831 16123 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:23:28.837854  5625 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.002s
I20260709 13:23:28.838194  5625 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskWHb0CB/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783603057096655-5625-0/minicluster-data/master-0-root
uuid: "01b5fafdca654d40899905e7044fc4b1"
format_stamp: "Formatted at 2026-07-09 13:23:28 on dist-test-slave-smzk"
I20260709 13:23:28.838572  5625 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWHb0CB/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783603057096655-5625-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskWHb0CB/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783603057096655-5625-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskWHb0CB/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783603057096655-5625-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:23:28.853109  5625 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:23:28.854518  5625 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:23:28.900457  5625 rpc_server.cc:307] RPC server started. Bound to: 127.5.126.126:35803
I20260709 13:23:28.900578 16174 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.5.126.126:35803 every 8 connection(s)
I20260709 13:23:28.904657 16175 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:23:28.915081 16175 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 01b5fafdca654d40899905e7044fc4b1: Bootstrap starting.
I20260709 13:23:28.920223 16175 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 01b5fafdca654d40899905e7044fc4b1: Neither blocks nor log segments found. Creating new log.
I20260709 13:23:28.926038 16175 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 01b5fafdca654d40899905e7044fc4b1: No bootstrap required, opened a new log
I20260709 13:23:28.928578 16175 raft_consensus.cc:359] T 00000000000000000000000000000000 P 01b5fafdca654d40899905e7044fc4b1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "01b5fafdca654d40899905e7044fc4b1" member_type: VOTER }
I20260709 13:23:28.929039 16175 raft_consensus.cc:385] T 00000000000000000000000000000000 P 01b5fafdca654d40899905e7044fc4b1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:23:28.929296 16175 raft_consensus.cc:740] T 00000000000000000000000000000000 P 01b5fafdca654d40899905e7044fc4b1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 01b5fafdca654d40899905e7044fc4b1, State: Initialized, Role: FOLLOWER
I20260709 13:23:28.930047 16175 consensus_queue.cc:260] T 00000000000000000000000000000000 P 01b5fafdca654d40899905e7044fc4b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "01b5fafdca654d40899905e7044fc4b1" member_type: VOTER }
I20260709 13:23:28.930539 16175 raft_consensus.cc:399] T 00000000000000000000000000000000 P 01b5fafdca654d40899905e7044fc4b1 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:23:28.930756 16175 raft_consensus.cc:493] T 00000000000000000000000000000000 P 01b5fafdca654d40899905e7044fc4b1 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:23:28.931082 16175 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 01b5fafdca654d40899905e7044fc4b1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:23:28.937183 16175 raft_consensus.cc:515] T 00000000000000000000000000000000 P 01b5fafdca654d40899905e7044fc4b1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "01b5fafdca654d40899905e7044fc4b1" member_type: VOTER }
I20260709 13:23:28.937831 16175 leader_election.cc:304] T 00000000000000000000000000000000 P 01b5fafdca654d40899905e7044fc4b1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 01b5fafdca654d40899905e7044fc4b1; no voters: 
I20260709 13:23:28.939180 16175 leader_election.cc:290] T 00000000000000000000000000000000 P 01b5fafdca654d40899905e7044fc4b1 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:23:28.939726 16178 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 01b5fafdca654d40899905e7044fc4b1 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:23:28.941610 16178 raft_consensus.cc:697] T 00000000000000000000000000000000 P 01b5fafdca654d40899905e7044fc4b1 [term 1 LEADER]: Becoming Leader. State: Replica: 01b5fafdca654d40899905e7044fc4b1, State: Running, Role: LEADER
I20260709 13:23:28.942335 16178 consensus_queue.cc:237] T 00000000000000000000000000000000 P 01b5fafdca654d40899905e7044fc4b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "01b5fafdca654d40899905e7044fc4b1" member_type: VOTER }
I20260709 13:23:28.942685 16175 sys_catalog.cc:565] T 00000000000000000000000000000000 P 01b5fafdca654d40899905e7044fc4b1 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:23:28.947485 16180 sys_catalog.cc:455] T 00000000000000000000000000000000 P 01b5fafdca654d40899905e7044fc4b1 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 01b5fafdca654d40899905e7044fc4b1. Latest consensus state: current_term: 1 leader_uuid: "01b5fafdca654d40899905e7044fc4b1" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "01b5fafdca654d40899905e7044fc4b1" member_type: VOTER } }
I20260709 13:23:28.948231 16180 sys_catalog.cc:458] T 00000000000000000000000000000000 P 01b5fafdca654d40899905e7044fc4b1 [sys.catalog]: This master's current role is: LEADER
I20260709 13:23:28.947523 16179 sys_catalog.cc:455] T 00000000000000000000000000000000 P 01b5fafdca654d40899905e7044fc4b1 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "01b5fafdca654d40899905e7044fc4b1" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "01b5fafdca654d40899905e7044fc4b1" member_type: VOTER } }
I20260709 13:23:28.949900 16179 sys_catalog.cc:458] T 00000000000000000000000000000000 P 01b5fafdca654d40899905e7044fc4b1 [sys.catalog]: This master's current role is: LEADER
I20260709 13:23:28.950732 16186 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:23:28.955976 16186 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:23:28.959122  5625 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:23:28.965531 16186 catalog_manager.cc:1383] Generated new cluster ID: 4c829e66a5b84b6e895ee574c56e5f89
I20260709 13:23:28.965916 16186 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:23:28.994794 16186 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:23:28.996383 16186 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:23:29.008802 16186 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 01b5fafdca654d40899905e7044fc4b1: Generated new TSK 0
I20260709 13:23:29.009521 16186 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:23:29.027172  5625 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:23:29.033989 16196 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:23:29.035549 16197 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:23:29.037417 16199 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:23:29.037690  5625 server_base.cc:1061] running on GCE node
I20260709 13:23:29.038875  5625 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:23:29.039184  5625 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:23:29.039350  5625 hybrid_clock.cc:648] HybridClock initialized: now 1783603409039337 us; error 0 us; skew 500 ppm
I20260709 13:23:29.040023  5625 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:23:29.043195  5625 webserver.cc:533] Webserver started at http://127.5.126.65:43655/ using document root <none> and password file <none>
I20260709 13:23:29.043666  5625 fs_manager.cc:362] Metadata directory not provided
I20260709 13:23:29.043831  5625 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:23:29.044118  5625 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:23:29.045295  5625 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskWHb0CB/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783603057096655-5625-0/minicluster-data/ts-0-root/instance:
uuid: "c6d026bb4a9146c395c2b8572753ffb7"
format_stamp: "Formatted at 2026-07-09 13:23:29 on dist-test-slave-smzk"
I20260709 13:23:29.050521  5625 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.005s	sys 0.000s
I20260709 13:23:29.054570 16204 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:23:29.055460  5625 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 13:23:29.055822  5625 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskWHb0CB/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783603057096655-5625-0/minicluster-data/ts-0-root
uuid: "c6d026bb4a9146c395c2b8572753ffb7"
format_stamp: "Formatted at 2026-07-09 13:23:29 on dist-test-slave-smzk"
I20260709 13:23:29.056152  5625 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWHb0CB/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783603057096655-5625-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskWHb0CB/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783603057096655-5625-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskWHb0CB/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783603057096655-5625-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:23:29.071568  5625 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:23:29.072877  5625 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:23:29.074435  5625 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:23:29.077018  5625 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:23:29.077246  5625 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:23:29.077505  5625 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:23:29.077692  5625 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:23:29.122177  5625 rpc_server.cc:307] RPC server started. Bound to: 127.5.126.65:34303
I20260709 13:23:29.122454 16266 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.5.126.65:34303 every 8 connection(s)
I20260709 13:23:29.127143  5625 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:23:29.135383 16271 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:23:29.136674 16272 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:23:29.143692  5625 server_base.cc:1061] running on GCE node
W20260709 13:23:29.147451 16274 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:23:29.149379  5625 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:23:29.149713  5625 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:23:29.149905 16267 heartbeater.cc:344] Connected to a master server at 127.5.126.126:35803
I20260709 13:23:29.149917  5625 hybrid_clock.cc:648] HybridClock initialized: now 1783603409149895 us; error 0 us; skew 500 ppm
I20260709 13:23:29.150439 16267 heartbeater.cc:461] Registering TS with master...
I20260709 13:23:29.150869  5625 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:23:29.151372 16267 heartbeater.cc:507] Master 127.5.126.126:35803 requested a full tablet report, sending...
I20260709 13:23:29.153946  5625 webserver.cc:533] Webserver started at http://127.5.126.66:33597/ using document root <none> and password file <none>
I20260709 13:23:29.154014 16140 ts_manager.cc:194] Registered new tserver with Master: c6d026bb4a9146c395c2b8572753ffb7 (127.5.126.65:34303)
I20260709 13:23:29.154848  5625 fs_manager.cc:362] Metadata directory not provided
I20260709 13:23:29.155126  5625 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:23:29.155464  5625 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:23:29.156615 16140 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:33032
I20260709 13:23:29.157027  5625 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskWHb0CB/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783603057096655-5625-0/minicluster-data/ts-1-root/instance:
uuid: "6070cdc51c6f49fcbcfbddd22a3c263c"
format_stamp: "Formatted at 2026-07-09 13:23:29 on dist-test-slave-smzk"
I20260709 13:23:29.161969  5625 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 13:23:29.165531 16279 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:23:29.166487  5625 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20260709 13:23:29.166850  5625 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskWHb0CB/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783603057096655-5625-0/minicluster-data/ts-1-root
uuid: "6070cdc51c6f49fcbcfbddd22a3c263c"
format_stamp: "Formatted at 2026-07-09 13:23:29 on dist-test-slave-smzk"
I20260709 13:23:29.167151  5625 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWHb0CB/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783603057096655-5625-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskWHb0CB/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783603057096655-5625-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskWHb0CB/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783603057096655-5625-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:23:29.189798  5625 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:23:29.191061  5625 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:23:29.192637  5625 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:23:29.195169  5625 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:23:29.195355  5625 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:23:29.195683  5625 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:23:29.195833  5625 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:23:29.243151  5625 rpc_server.cc:307] RPC server started. Bound to: 127.5.126.66:41095
I20260709 13:23:29.243325 16341 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.5.126.66:41095 every 8 connection(s)
I20260709 13:23:29.248389  5625 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:23:29.256510 16345 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:23:29.257395 16346 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:23:29.259348 16348 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:23:29.260514  5625 server_base.cc:1061] running on GCE node
I20260709 13:23:29.261767  5625 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:23:29.262022  5625 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:23:29.262239  5625 hybrid_clock.cc:648] HybridClock initialized: now 1783603409262220 us; error 0 us; skew 500 ppm
I20260709 13:23:29.262889  5625 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:23:29.263696 16342 heartbeater.cc:344] Connected to a master server at 127.5.126.126:35803
I20260709 13:23:29.264225 16342 heartbeater.cc:461] Registering TS with master...
I20260709 13:23:29.265129 16342 heartbeater.cc:507] Master 127.5.126.126:35803 requested a full tablet report, sending...
I20260709 13:23:29.266000  5625 webserver.cc:533] Webserver started at http://127.5.126.67:40737/ using document root <none> and password file <none>
I20260709 13:23:29.266649  5625 fs_manager.cc:362] Metadata directory not provided
I20260709 13:23:29.266897  5625 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:23:29.267244  5625 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:23:29.267760 16140 ts_manager.cc:194] Registered new tserver with Master: 6070cdc51c6f49fcbcfbddd22a3c263c (127.5.126.66:41095)
I20260709 13:23:29.268533  5625 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskWHb0CB/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783603057096655-5625-0/minicluster-data/ts-2-root/instance:
uuid: "3a01ebd6b99640978d77190fe4da6f08"
format_stamp: "Formatted at 2026-07-09 13:23:29 on dist-test-slave-smzk"
I20260709 13:23:29.269639 16140 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:33046
I20260709 13:23:29.273736  5625 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 13:23:29.277422 16353 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:23:29.278379  5625 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20260709 13:23:29.278699  5625 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskWHb0CB/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783603057096655-5625-0/minicluster-data/ts-2-root
uuid: "3a01ebd6b99640978d77190fe4da6f08"
format_stamp: "Formatted at 2026-07-09 13:23:29 on dist-test-slave-smzk"
I20260709 13:23:29.279004  5625 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWHb0CB/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783603057096655-5625-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskWHb0CB/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783603057096655-5625-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskWHb0CB/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783603057096655-5625-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:23:29.291414  5625 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:23:29.292791  5625 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:23:29.294346  5625 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:23:29.296909  5625 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:23:29.297149  5625 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:23:29.297394  5625 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:23:29.297566  5625 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:23:29.346323  5625 rpc_server.cc:307] RPC server started. Bound to: 127.5.126.67:45221
I20260709 13:23:29.346495 16415 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.5.126.67:45221 every 8 connection(s)
I20260709 13:23:29.361738 16416 heartbeater.cc:344] Connected to a master server at 127.5.126.126:35803
I20260709 13:23:29.362229 16416 heartbeater.cc:461] Registering TS with master...
I20260709 13:23:29.363041 16416 heartbeater.cc:507] Master 127.5.126.126:35803 requested a full tablet report, sending...
I20260709 13:23:29.365348 16140 ts_manager.cc:194] Registered new tserver with Master: 3a01ebd6b99640978d77190fe4da6f08 (127.5.126.67:45221)
I20260709 13:23:29.366094  5625 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.016391271s
I20260709 13:23:29.367597 16140 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:33052
I20260709 13:23:29.397908 16140 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:33066:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s""\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:23:29.401424 16140 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:23:29.509500 16377 tablet_service.cc:1511] Processing CreateTablet for tablet 49ace918d4da4776b29f4aa41975e9ef (DEFAULT_TABLE table=test-workload [id=ff1e7d2a6d3e46df9c6abba10a8cccf0]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 13:23:29.511157 16377 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 49ace918d4da4776b29f4aa41975e9ef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:23:29.511245 16379 tablet_service.cc:1511] Processing CreateTablet for tablet cb70c02d0bce438cbb6434b2c0aa54ae (DEFAULT_TABLE table=test-workload [id=ff1e7d2a6d3e46df9c6abba10a8cccf0]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 13:23:29.512741 16376 tablet_service.cc:1511] Processing CreateTablet for tablet fd931932596f4755aeae878c0fe3c2d9 (DEFAULT_TABLE table=test-workload [id=ff1e7d2a6d3e46df9c6abba10a8cccf0]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 13:23:29.513478 16378 tablet_service.cc:1511] Processing CreateTablet for tablet b0313caec0564fd5bf22e34524632537 (DEFAULT_TABLE table=test-workload [id=ff1e7d2a6d3e46df9c6abba10a8cccf0]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 13:23:29.514298 16376 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fd931932596f4755aeae878c0fe3c2d9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:23:29.514987 16378 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b0313caec0564fd5bf22e34524632537. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:23:29.509284 16380 tablet_service.cc:1511] Processing CreateTablet for tablet 88caca305bf74120a011e3fa92781678 (DEFAULT_TABLE table=test-workload [id=ff1e7d2a6d3e46df9c6abba10a8cccf0]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 13:23:29.507294 16381 tablet_service.cc:1511] Processing CreateTablet for tablet 4f5a2d88e89448648f594ef23ef152cd (DEFAULT_TABLE table=test-workload [id=ff1e7d2a6d3e46df9c6abba10a8cccf0]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 13:23:29.517246 16380 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 88caca305bf74120a011e3fa92781678. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:23:29.518180 16379 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cb70c02d0bce438cbb6434b2c0aa54ae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:23:29.518069 16374 tablet_service.cc:1511] Processing CreateTablet for tablet f55407f772b74aaba87440ba35c2ac8b (DEFAULT_TABLE table=test-workload [id=ff1e7d2a6d3e46df9c6abba10a8cccf0]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 13:23:29.520540 16232 tablet_service.cc:1511] Processing CreateTablet for tablet 4f5a2d88e89448648f594ef23ef152cd (DEFAULT_TABLE table=test-workload [id=ff1e7d2a6d3e46df9c6abba10a8cccf0]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 13:23:29.521703 16374 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f55407f772b74aaba87440ba35c2ac8b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:23:29.522228 16232 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4f5a2d88e89448648f594ef23ef152cd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:23:29.520519 16375 tablet_service.cc:1511] Processing CreateTablet for tablet aab7ef362ab84369939a6a02d817aa53 (DEFAULT_TABLE table=test-workload [id=ff1e7d2a6d3e46df9c6abba10a8cccf0]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 13:23:29.525913 16375 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aab7ef362ab84369939a6a02d817aa53. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:23:29.526891 16231 tablet_service.cc:1511] Processing CreateTablet for tablet 88caca305bf74120a011e3fa92781678 (DEFAULT_TABLE table=test-workload [id=ff1e7d2a6d3e46df9c6abba10a8cccf0]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 13:23:29.527666 16381 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4f5a2d88e89448648f594ef23ef152cd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:23:29.528416 16231 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 88caca305bf74120a011e3fa92781678. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:23:29.529932 16373 tablet_service.cc:1511] Processing CreateTablet for tablet b1e06a2952f94a919e5324bd1f0d7cab (DEFAULT_TABLE table=test-workload [id=ff1e7d2a6d3e46df9c6abba10a8cccf0]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 13:23:29.531785 16373 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b1e06a2952f94a919e5324bd1f0d7cab. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:23:29.542115 16230 tablet_service.cc:1511] Processing CreateTablet for tablet cb70c02d0bce438cbb6434b2c0aa54ae (DEFAULT_TABLE table=test-workload [id=ff1e7d2a6d3e46df9c6abba10a8cccf0]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 13:23:29.543907 16230 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cb70c02d0bce438cbb6434b2c0aa54ae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:23:29.555109 16229 tablet_service.cc:1511] Processing CreateTablet for tablet b0313caec0564fd5bf22e34524632537 (DEFAULT_TABLE table=test-workload [id=ff1e7d2a6d3e46df9c6abba10a8cccf0]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 13:23:29.556748 16228 tablet_service.cc:1511] Processing CreateTablet for tablet 49ace918d4da4776b29f4aa41975e9ef (DEFAULT_TABLE table=test-workload [id=ff1e7d2a6d3e46df9c6abba10a8cccf0]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 13:23:29.556932 16229 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b0313caec0564fd5bf22e34524632537. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:23:29.562742 16228 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 49ace918d4da4776b29f4aa41975e9ef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:23:29.561517 16227 tablet_service.cc:1511] Processing CreateTablet for tablet fd931932596f4755aeae878c0fe3c2d9 (DEFAULT_TABLE table=test-workload [id=ff1e7d2a6d3e46df9c6abba10a8cccf0]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 13:23:29.564378 16227 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fd931932596f4755aeae878c0fe3c2d9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:23:29.565989 16226 tablet_service.cc:1511] Processing CreateTablet for tablet aab7ef362ab84369939a6a02d817aa53 (DEFAULT_TABLE table=test-workload [id=ff1e7d2a6d3e46df9c6abba10a8cccf0]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 13:23:29.567415 16226 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aab7ef362ab84369939a6a02d817aa53. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:23:29.570286 16431 tablet_bootstrap.cc:492] T fd931932596f4755aeae878c0fe3c2d9 P 3a01ebd6b99640978d77190fe4da6f08: Bootstrap starting.
I20260709 13:23:29.571399 16225 tablet_service.cc:1511] Processing CreateTablet for tablet f55407f772b74aaba87440ba35c2ac8b (DEFAULT_TABLE table=test-workload [id=ff1e7d2a6d3e46df9c6abba10a8cccf0]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 13:23:29.572938 16225 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f55407f772b74aaba87440ba35c2ac8b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:23:29.577329 16224 tablet_service.cc:1511] Processing CreateTablet for tablet b1e06a2952f94a919e5324bd1f0d7cab (DEFAULT_TABLE table=test-workload [id=ff1e7d2a6d3e46df9c6abba10a8cccf0]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 13:23:29.578727 16224 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b1e06a2952f94a919e5324bd1f0d7cab. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:23:29.582440 16376 tablet_service.cc:1511] Processing CreateTablet for tablet 5066abfe4261488f96534730b07ce4d5 (DEFAULT_TABLE table=test-workload [id=ff1e7d2a6d3e46df9c6abba10a8cccf0]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 13:23:29.584108 16376 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5066abfe4261488f96534730b07ce4d5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:23:29.582580 16223 tablet_service.cc:1511] Processing CreateTablet for tablet 5066abfe4261488f96534730b07ce4d5 (DEFAULT_TABLE table=test-workload [id=ff1e7d2a6d3e46df9c6abba10a8cccf0]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 13:23:29.588966 16223 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5066abfe4261488f96534730b07ce4d5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:23:29.594589 16307 tablet_service.cc:1511] Processing CreateTablet for tablet 4f5a2d88e89448648f594ef23ef152cd (DEFAULT_TABLE table=test-workload [id=ff1e7d2a6d3e46df9c6abba10a8cccf0]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 13:23:29.595309 16305 tablet_service.cc:1511] Processing CreateTablet for tablet cb70c02d0bce438cbb6434b2c0aa54ae (DEFAULT_TABLE table=test-workload [id=ff1e7d2a6d3e46df9c6abba10a8cccf0]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 13:23:29.596920 16305 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cb70c02d0bce438cbb6434b2c0aa54ae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:23:29.597486 16306 tablet_service.cc:1511] Processing CreateTablet for tablet 88caca305bf74120a011e3fa92781678 (DEFAULT_TABLE table=test-workload [id=ff1e7d2a6d3e46df9c6abba10a8cccf0]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 13:23:29.599032 16306 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 88caca305bf74120a011e3fa92781678. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:23:29.601346 16307 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4f5a2d88e89448648f594ef23ef152cd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:23:29.623561 16431 tablet_bootstrap.cc:654] T fd931932596f4755aeae878c0fe3c2d9 P 3a01ebd6b99640978d77190fe4da6f08: Neither blocks nor log segments found. Creating new log.
I20260709 13:23:29.634440 16304 tablet_service.cc:1511] Processing CreateTablet for tablet b0313caec0564fd5bf22e34524632537 (DEFAULT_TABLE table=test-workload [id=ff1e7d2a6d3e46df9c6abba10a8cccf0]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 13:23:29.636500 16304 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b0313caec0564fd5bf22e34524632537. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:23:29.660554 16302 tablet_service.cc:1511] Processing CreateTablet for tablet fd931932596f4755aeae878c0fe3c2d9 (DEFAULT_TABLE table=test-workload [id=ff1e7d2a6d3e46df9c6abba10a8cccf0]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 13:23:29.662351 16302 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fd931932596f4755aeae878c0fe3c2d9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:23:29.660593 16303 tablet_service.cc:1511] Processing CreateTablet for tablet 49ace918d4da4776b29f4aa41975e9ef (DEFAULT_TABLE table=test-workload [id=ff1e7d2a6d3e46df9c6abba10a8cccf0]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 13:23:29.665678 16303 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 49ace918d4da4776b29f4aa41975e9ef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:23:29.674347 16301 tablet_service.cc:1511] Processing CreateTablet for tablet aab7ef362ab84369939a6a02d817aa53 (DEFAULT_TABLE table=test-workload [id=ff1e7d2a6d3e46df9c6abba10a8cccf0]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 13:23:29.684993 16300 tablet_service.cc:1511] Processing CreateTablet for tablet f55407f772b74aaba87440ba35c2ac8b (DEFAULT_TABLE table=test-workload [id=ff1e7d2a6d3e46df9c6abba10a8cccf0]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 13:23:29.685864 16301 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aab7ef362ab84369939a6a02d817aa53. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:23:29.687114 16300 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f55407f772b74aaba87440ba35c2ac8b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:23:29.693554 16299 tablet_service.cc:1511] Processing CreateTablet for tablet b1e06a2952f94a919e5324bd1f0d7cab (DEFAULT_TABLE table=test-workload [id=ff1e7d2a6d3e46df9c6abba10a8cccf0]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 13:23:29.695396 16299 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b1e06a2952f94a919e5324bd1f0d7cab. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:23:29.721427 16432 tablet_bootstrap.cc:492] T fd931932596f4755aeae878c0fe3c2d9 P c6d026bb4a9146c395c2b8572753ffb7: Bootstrap starting.
I20260709 13:23:29.723719 16306 tablet_service.cc:1511] Processing CreateTablet for tablet 5066abfe4261488f96534730b07ce4d5 (DEFAULT_TABLE table=test-workload [id=ff1e7d2a6d3e46df9c6abba10a8cccf0]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 13:23:29.725164 16306 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5066abfe4261488f96534730b07ce4d5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:23:29.759774 16433 tablet_bootstrap.cc:492] T 4f5a2d88e89448648f594ef23ef152cd P 6070cdc51c6f49fcbcfbddd22a3c263c: Bootstrap starting.
I20260709 13:23:29.778280 16432 tablet_bootstrap.cc:654] T fd931932596f4755aeae878c0fe3c2d9 P c6d026bb4a9146c395c2b8572753ffb7: Neither blocks nor log segments found. Creating new log.
W20260709 13:23:29.782637 16125 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.5.126.66:41095, user_credentials={real_user=slave}} blocked reactor thread for 51633us
I20260709 13:23:29.786630 16431 tablet_bootstrap.cc:492] T fd931932596f4755aeae878c0fe3c2d9 P 3a01ebd6b99640978d77190fe4da6f08: No bootstrap required, opened a new log
I20260709 13:23:29.787370 16431 ts_tablet_manager.cc:1403] T fd931932596f4755aeae878c0fe3c2d9 P 3a01ebd6b99640978d77190fe4da6f08: Time spent bootstrapping tablet: real 0.218s	user 0.013s	sys 0.004s
I20260709 13:23:29.790819 16431 raft_consensus.cc:359] T fd931932596f4755aeae878c0fe3c2d9 P 3a01ebd6b99640978d77190fe4da6f08 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6d026bb4a9146c395c2b8572753ffb7" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34303 } } peers { permanent_uuid: "6070cdc51c6f49fcbcfbddd22a3c263c" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 41095 } } peers { permanent_uuid: "3a01ebd6b99640978d77190fe4da6f08" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 45221 } }
I20260709 13:23:29.791594 16431 raft_consensus.cc:385] T fd931932596f4755aeae878c0fe3c2d9 P 3a01ebd6b99640978d77190fe4da6f08 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:23:29.791908 16431 raft_consensus.cc:740] T fd931932596f4755aeae878c0fe3c2d9 P 3a01ebd6b99640978d77190fe4da6f08 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3a01ebd6b99640978d77190fe4da6f08, State: Initialized, Role: FOLLOWER
I20260709 13:23:29.792897 16431 consensus_queue.cc:260] T fd931932596f4755aeae878c0fe3c2d9 P 3a01ebd6b99640978d77190fe4da6f08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6d026bb4a9146c395c2b8572753ffb7" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34303 } } peers { permanent_uuid: "6070cdc51c6f49fcbcfbddd22a3c263c" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 41095 } } peers { permanent_uuid: "3a01ebd6b99640978d77190fe4da6f08" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 45221 } }
I20260709 13:23:29.793795 16433 tablet_bootstrap.cc:654] T 4f5a2d88e89448648f594ef23ef152cd P 6070cdc51c6f49fcbcfbddd22a3c263c: Neither blocks nor log segments found. Creating new log.
I20260709 13:23:29.803333 16431 ts_tablet_manager.cc:1434] T fd931932596f4755aeae878c0fe3c2d9 P 3a01ebd6b99640978d77190fe4da6f08: Time spent starting tablet: real 0.016s	user 0.003s	sys 0.010s
I20260709 13:23:29.804247 16416 heartbeater.cc:499] Master 127.5.126.126:35803 was elected leader, sending a full tablet report...
I20260709 13:23:29.809161 16431 tablet_bootstrap.cc:492] T b1e06a2952f94a919e5324bd1f0d7cab P 3a01ebd6b99640978d77190fe4da6f08: Bootstrap starting.
I20260709 13:23:29.817269 16431 tablet_bootstrap.cc:654] T b1e06a2952f94a919e5324bd1f0d7cab P 3a01ebd6b99640978d77190fe4da6f08: Neither blocks nor log segments found. Creating new log.
I20260709 13:23:29.828337 16433 tablet_bootstrap.cc:492] T 4f5a2d88e89448648f594ef23ef152cd P 6070cdc51c6f49fcbcfbddd22a3c263c: No bootstrap required, opened a new log
I20260709 13:23:29.828883 16433 ts_tablet_manager.cc:1403] T 4f5a2d88e89448648f594ef23ef152cd P 6070cdc51c6f49fcbcfbddd22a3c263c: Time spent bootstrapping tablet: real 0.070s	user 0.012s	sys 0.004s
I20260709 13:23:29.830015 16432 tablet_bootstrap.cc:492] T fd931932596f4755aeae878c0fe3c2d9 P c6d026bb4a9146c395c2b8572753ffb7: No bootstrap required, opened a new log
I20260709 13:23:29.830680 16432 ts_tablet_manager.cc:1403] T fd931932596f4755aeae878c0fe3c2d9 P c6d026bb4a9146c395c2b8572753ffb7: Time spent bootstrapping tablet: real 0.110s	user 0.025s	sys 0.008s
I20260709 13:23:29.830829 16431 tablet_bootstrap.cc:492] T b1e06a2952f94a919e5324bd1f0d7cab P 3a01ebd6b99640978d77190fe4da6f08: No bootstrap required, opened a new log
I20260709 13:23:29.831393 16431 ts_tablet_manager.cc:1403] T b1e06a2952f94a919e5324bd1f0d7cab P 3a01ebd6b99640978d77190fe4da6f08: Time spent bootstrapping tablet: real 0.022s	user 0.011s	sys 0.006s
I20260709 13:23:29.831799 16433 raft_consensus.cc:359] T 4f5a2d88e89448648f594ef23ef152cd P 6070cdc51c6f49fcbcfbddd22a3c263c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6d026bb4a9146c395c2b8572753ffb7" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34303 } } peers { permanent_uuid: "3a01ebd6b99640978d77190fe4da6f08" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 45221 } } peers { permanent_uuid: "6070cdc51c6f49fcbcfbddd22a3c263c" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 41095 } }
I20260709 13:23:29.832641 16433 raft_consensus.cc:385] T 4f5a2d88e89448648f594ef23ef152cd P 6070cdc51c6f49fcbcfbddd22a3c263c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:23:29.832931 16433 raft_consensus.cc:740] T 4f5a2d88e89448648f594ef23ef152cd P 6070cdc51c6f49fcbcfbddd22a3c263c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6070cdc51c6f49fcbcfbddd22a3c263c, State: Initialized, Role: FOLLOWER
I20260709 13:23:29.834057 16433 consensus_queue.cc:260] T 4f5a2d88e89448648f594ef23ef152cd P 6070cdc51c6f49fcbcfbddd22a3c263c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6d026bb4a9146c395c2b8572753ffb7" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34303 } } peers { permanent_uuid: "3a01ebd6b99640978d77190fe4da6f08" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 45221 } } peers { permanent_uuid: "6070cdc51c6f49fcbcfbddd22a3c263c" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 41095 } }
I20260709 13:23:29.834697 16431 raft_consensus.cc:359] T b1e06a2952f94a919e5324bd1f0d7cab P 3a01ebd6b99640978d77190fe4da6f08 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6d026bb4a9146c395c2b8572753ffb7" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34303 } } peers { permanent_uuid: "6070cdc51c6f49fcbcfbddd22a3c263c" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 41095 } } peers { permanent_uuid: "3a01ebd6b99640978d77190fe4da6f08" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 45221 } }
I20260709 13:23:29.835429 16431 raft_consensus.cc:385] T b1e06a2952f94a919e5324bd1f0d7cab P 3a01ebd6b99640978d77190fe4da6f08 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:23:29.835726 16431 raft_consensus.cc:740] T b1e06a2952f94a919e5324bd1f0d7cab P 3a01ebd6b99640978d77190fe4da6f08 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3a01ebd6b99640978d77190fe4da6f08, State: Initialized, Role: FOLLOWER
I20260709 13:23:29.834421 16432 raft_consensus.cc:359] T fd931932596f4755aeae878c0fe3c2d9 P c6d026bb4a9146c395c2b8572753ffb7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6d026bb4a9146c395c2b8572753ffb7" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34303 } } peers { permanent_uuid: "6070cdc51c6f49fcbcfbddd22a3c263c" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 41095 } } peers { permanent_uuid: "3a01ebd6b99640978d77190fe4da6f08" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 45221 } }
I20260709 13:23:29.836426 16432 raft_consensus.cc:385] T fd931932596f4755aeae878c0fe3c2d9 P c6d026bb4a9146c395c2b8572753ffb7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:23:29.836798 16432 raft_consensus.cc:740] T fd931932596f4755aeae878c0fe3c2d9 P c6d026bb4a9146c395c2b8572753ffb7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c6d026bb4a9146c395c2b8572753ffb7, State: Initialized, Role: FOLLOWER
I20260709 13:23:29.836784 16431 consensus_queue.cc:260] T b1e06a2952f94a919e5324bd1f0d7cab P 3a01ebd6b99640978d77190fe4da6f08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6d026bb4a9146c395c2b8572753ffb7" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34303 } } peers { permanent_uuid: "6070cdc51c6f49fcbcfbddd22a3c263c" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 41095 } } peers { permanent_uuid: "3a01ebd6b99640978d77190fe4da6f08" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 45221 } }
I20260709 13:23:29.837805 16432 consensus_queue.cc:260] T fd931932596f4755aeae878c0fe3c2d9 P c6d026bb4a9146c395c2b8572753ffb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6d026bb4a9146c395c2b8572753ffb7" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34303 } } peers { permanent_uuid: "6070cdc51c6f49fcbcfbddd22a3c263c" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 41095 } } peers { permanent_uuid: "3a01ebd6b99640978d77190fe4da6f08" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 45221 } }
I20260709 13:23:29.839840 16431 ts_tablet_manager.cc:1434] T b1e06a2952f94a919e5324bd1f0d7cab P 3a01ebd6b99640978d77190fe4da6f08: Time spent starting tablet: real 0.008s	user 0.000s	sys 0.008s
I20260709 13:23:29.841210 16431 tablet_bootstrap.cc:492] T 88caca305bf74120a011e3fa92781678 P 3a01ebd6b99640978d77190fe4da6f08: Bootstrap starting.
I20260709 13:23:29.843899 16342 heartbeater.cc:499] Master 127.5.126.126:35803 was elected leader, sending a full tablet report...
I20260709 13:23:29.849011 16431 tablet_bootstrap.cc:654] T 88caca305bf74120a011e3fa92781678 P 3a01ebd6b99640978d77190fe4da6f08: Neither blocks nor log segments found. Creating new log.
I20260709 13:23:29.849130 16433 ts_tablet_manager.cc:1434] T 4f5a2d88e89448648f594ef23ef152cd P 6070cdc51c6f49fcbcfbddd22a3c263c: Time spent starting tablet: real 0.020s	user 0.005s	sys 0.004s
I20260709 13:23:29.850272 16433 tablet_bootstrap.cc:492] T 88caca305bf74120a011e3fa92781678 P 6070cdc51c6f49fcbcfbddd22a3c263c: Bootstrap starting.
W20260709 13:23:29.850656 16417 tablet.cc:2406] T b1e06a2952f94a919e5324bd1f0d7cab P 3a01ebd6b99640978d77190fe4da6f08: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 13:23:29.858625 16433 tablet_bootstrap.cc:654] T 88caca305bf74120a011e3fa92781678 P 6070cdc51c6f49fcbcfbddd22a3c263c: Neither blocks nor log segments found. Creating new log.
I20260709 13:23:29.862331 16432 ts_tablet_manager.cc:1434] T fd931932596f4755aeae878c0fe3c2d9 P c6d026bb4a9146c395c2b8572753ffb7: Time spent starting tablet: real 0.031s	user 0.003s	sys 0.010s
I20260709 13:23:29.863510 16267 heartbeater.cc:499] Master 127.5.126.126:35803 was elected leader, sending a full tablet report...
I20260709 13:23:29.866446 16432 tablet_bootstrap.cc:492] T 5066abfe4261488f96534730b07ce4d5 P c6d026bb4a9146c395c2b8572753ffb7: Bootstrap starting.
I20260709 13:23:29.867035 16431 tablet_bootstrap.cc:492] T 88caca305bf74120a011e3fa92781678 P 3a01ebd6b99640978d77190fe4da6f08: No bootstrap required, opened a new log
I20260709 13:23:29.867637 16431 ts_tablet_manager.cc:1403] T 88caca305bf74120a011e3fa92781678 P 3a01ebd6b99640978d77190fe4da6f08: Time spent bootstrapping tablet: real 0.027s	user 0.014s	sys 0.008s
I20260709 13:23:29.871589 16431 raft_consensus.cc:359] T 88caca305bf74120a011e3fa92781678 P 3a01ebd6b99640978d77190fe4da6f08 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6d026bb4a9146c395c2b8572753ffb7" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34303 } } peers { permanent_uuid: "6070cdc51c6f49fcbcfbddd22a3c263c" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 41095 } } peers { permanent_uuid: "3a01ebd6b99640978d77190fe4da6f08" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 45221 } }
I20260709 13:23:29.872640 16431 raft_consensus.cc:385] T 88caca305bf74120a011e3fa92781678 P 3a01ebd6b99640978d77190fe4da6f08 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:23:29.872689 16440 raft_consensus.cc:493] T fd931932596f4755aeae878c0fe3c2d9 P c6d026bb4a9146c395c2b8572753ffb7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:23:29.875833 16431 raft_consensus.cc:740] T 88caca305bf74120a011e3fa92781678 P 3a01ebd6b99640978d77190fe4da6f08 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3a01ebd6b99640978d77190fe4da6f08, State: Initialized, Role: FOLLOWER
I20260709 13:23:29.873423 16439 raft_consensus.cc:493] T 4f5a2d88e89448648f594ef23ef152cd P 6070cdc51c6f49fcbcfbddd22a3c263c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:23:29.878243 16439 raft_consensus.cc:515] T 4f5a2d88e89448648f594ef23ef152cd P 6070cdc51c6f49fcbcfbddd22a3c263c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6d026bb4a9146c395c2b8572753ffb7" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34303 } } peers { permanent_uuid: "3a01ebd6b99640978d77190fe4da6f08" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 45221 } } peers { permanent_uuid: "6070cdc51c6f49fcbcfbddd22a3c263c" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 41095 } }
I20260709 13:23:29.876927 16440 raft_consensus.cc:515] T fd931932596f4755aeae878c0fe3c2d9 P c6d026bb4a9146c395c2b8572753ffb7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6d026bb4a9146c395c2b8572753ffb7" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34303 } } peers { permanent_uuid: "6070cdc51c6f49fcbcfbddd22a3c263c" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 41095 } } peers { permanent_uuid: "3a01ebd6b99640978d77190fe4da6f08" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 45221 } }
I20260709 13:23:29.878754 16431 consensus_queue.cc:260] T 88caca305bf74120a011e3fa92781678 P 3a01ebd6b99640978d77190fe4da6f08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6d026bb4a9146c395c2b8572753ffb7" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34303 } } peers { permanent_uuid: "6070cdc51c6f49fcbcfbddd22a3c263c" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 41095 } } peers { permanent_uuid: "3a01ebd6b99640978d77190fe4da6f08" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 45221 } }
I20260709 13:23:29.882779 16431 ts_tablet_manager.cc:1434] T 88caca305bf74120a011e3fa92781678 P 3a01ebd6b99640978d77190fe4da6f08: Time spent starting tablet: real 0.015s	user 0.013s	sys 0.000s
I20260709 13:23:29.883338 16439 leader_election.cc:290] T 4f5a2d88e89448648f594ef23ef152cd P 6070cdc51c6f49fcbcfbddd22a3c263c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c6d026bb4a9146c395c2b8572753ffb7 (127.5.126.65:34303), 3a01ebd6b99640978d77190fe4da6f08 (127.5.126.67:45221)
I20260709 13:23:29.883980 16431 tablet_bootstrap.cc:492] T 5066abfe4261488f96534730b07ce4d5 P 3a01ebd6b99640978d77190fe4da6f08: Bootstrap starting.
I20260709 13:23:29.906657 16431 tablet_bootstrap.cc:654] T 5066abfe4261488f96534730b07ce4d5 P 3a01ebd6b99640978d77190fe4da6f08: Neither blocks nor log segments found. Creating new log.
I20260709 13:23:29.892511 16440 leader_election.cc:290] T fd931932596f4755aeae878c0fe3c2d9 P c6d026bb4a9146c395c2b8572753ffb7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6070cdc51c6f49fcbcfbddd22a3c263c (127.5.126.66:41095), 3a01ebd6b99640978d77190fe4da6f08 (127.5.126.67:45221)
I20260709 13:23:29.914345 16432 tablet_bootstrap.cc:654] T 5066abfe4261488f96534730b07ce4d5 P c6d026bb4a9146c395c2b8572753ffb7: Neither blocks nor log segments found. Creating new log.
W20260709 13:23:29.955524 16188 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:23:29.957120 16433 tablet_bootstrap.cc:492] T 88caca305bf74120a011e3fa92781678 P 6070cdc51c6f49fcbcfbddd22a3c263c: No bootstrap required, opened a new log
I20260709 13:23:29.958099 16433 ts_tablet_manager.cc:1403] T 88caca305bf74120a011e3fa92781678 P 6070cdc51c6f49fcbcfbddd22a3c263c: Time spent bootstrapping tablet: real 0.108s	user 0.018s	sys 0.017s
I20260709 13:23:29.963451 16435 raft_consensus.cc:493] T 88caca305bf74120a011e3fa92781678 P 3a01ebd6b99640978d77190fe4da6f08 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:23:29.969192 16435 raft_consensus.cc:515] T 88caca305bf74120a011e3fa92781678 P 3a01ebd6b99640978d77190fe4da6f08 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6d026bb4a9146c395c2b8572753ffb7" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34303 } } peers { permanent_uuid: "6070cdc51c6f49fcbcfbddd22a3c263c" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 41095 } } peers { permanent_uuid: "3a01ebd6b99640978d77190fe4da6f08" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 45221 } }
I20260709 13:23:29.977698 16435 leader_election.cc:290] T 88caca305bf74120a011e3fa92781678 P 3a01ebd6b99640978d77190fe4da6f08 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c6d026bb4a9146c395c2b8572753ffb7 (127.5.126.65:34303), 6070cdc51c6f49fcbcfbddd22a3c263c (127.5.126.66:41095)
I20260709 13:23:29.980123 16431 tablet_bootstrap.cc:492] T 5066abfe4261488f96534730b07ce4d5 P 3a01ebd6b99640978d77190fe4da6f08: No bootstrap required, opened a new log
I20260709 13:23:29.980849 16431 ts_tablet_manager.cc:1403] T 5066abfe4261488f96534730b07ce4d5 P 3a01ebd6b99640978d77190fe4da6f08: Time spent bootstrapping tablet: real 0.097s	user 0.018s	sys 0.024s
I20260709 13:23:29.984252 16433 raft_consensus.cc:359] T 88caca305bf74120a011e3fa92781678 P 6070cdc51c6f49fcbcfbddd22a3c263c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6d026bb4a9146c395c2b8572753ffb7" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34303 } } peers { permanent_uuid: "6070cdc51c6f49fcbcfbddd22a3c263c" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 41095 } } peers { permanent_uuid: "3a01ebd6b99640978d77190fe4da6f08" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 45221 } }
I20260709 13:23:29.985352 16433 raft_consensus.cc:385] T 88caca305bf74120a011e3fa92781678 P 6070cdc51c6f49fcbcfbddd22a3c263c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:23:29.985587 16242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f5a2d88e89448648f594ef23ef152cd" candidate_uuid: "6070cdc51c6f49fcbcfbddd22a3c263c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6d026bb4a9146c395c2b8572753ffb7" is_pre_election: true
W20260709 13:23:29.989727 16281 leader_election.cc:343] T 4f5a2d88e89448648f594ef23ef152cd P 6070cdc51c6f49fcbcfbddd22a3c263c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c6d026bb4a9146c395c2b8572753ffb7 (127.5.126.65:34303): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:23:29.985745 16433 raft_consensus.cc:740] T 88caca305bf74120a011e3fa92781678 P 6070cdc51c6f49fcbcfbddd22a3c263c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6070cdc51c6f49fcbcfbddd22a3c263c, State: Initialized, Role: FOLLOWER
I20260709 13:23:30.000293 16431 raft_consensus.cc:359] T 5066abfe4261488f96534730b07ce4d5 P 3a01ebd6b99640978d77190fe4da6f08 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6d026bb4a9146c395c2b8572753ffb7" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34303 } } peers { permanent_uuid: "6070cdc51c6f49fcbcfbddd22a3c263c" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 41095 } } peers { permanent_uuid: "3a01ebd6b99640978d77190fe4da6f08" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 45221 } }
I20260709 13:23:30.009402 16431 raft_consensus.cc:385] T 5066abfe4261488f96534730b07ce4d5 P 3a01ebd6b99640978d77190fe4da6f08 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:23:30.009846 16431 raft_consensus.cc:740] T 5066abfe4261488f96534730b07ce4d5 P 3a01ebd6b99640978d77190fe4da6f08 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3a01ebd6b99640978d77190fe4da6f08, State: Initialized, Role: FOLLOWER
I20260709 13:23:30.014540 16431 consensus_queue.cc:260] T 5066abfe4261488f96534730b07ce4d5 P 3a01ebd6b99640978d77190fe4da6f08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6d026bb4a9146c395c2b8572753ffb7" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34303 } } peers { permanent_uuid: "6070cdc51c6f49fcbcfbddd22a3c263c" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 41095 } } peers { permanent_uuid: "3a01ebd6b99640978d77190fe4da6f08" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 45221 } }
I20260709 13:23:30.018939 16431 ts_tablet_manager.cc:1434] T 5066abfe4261488f96534730b07ce4d5 P 3a01ebd6b99640978d77190fe4da6f08: Time spent starting tablet: real 0.038s	user 0.012s	sys 0.000s
I20260709 13:23:30.023165 16435 raft_consensus.cc:493] T b1e06a2952f94a919e5324bd1f0d7cab P 3a01ebd6b99640978d77190fe4da6f08 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:23:30.023743 16435 raft_consensus.cc:515] T b1e06a2952f94a919e5324bd1f0d7cab P 3a01ebd6b99640978d77190fe4da6f08 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6d026bb4a9146c395c2b8572753ffb7" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34303 } } peers { permanent_uuid: "6070cdc51c6f49fcbcfbddd22a3c263c" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 41095 } } peers { permanent_uuid: "3a01ebd6b99640978d77190fe4da6f08" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 45221 } }
I20260709 13:23:30.024101 16317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd931932596f4755aeae878c0fe3c2d9" candidate_uuid: "c6d026bb4a9146c395c2b8572753ffb7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6070cdc51c6f49fcbcfbddd22a3c263c" is_pre_election: true
W20260709 13:23:30.026010 16206 leader_election.cc:343] T fd931932596f4755aeae878c0fe3c2d9 P c6d026bb4a9146c395c2b8572753ffb7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6070cdc51c6f49fcbcfbddd22a3c263c (127.5.126.66:41095): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:23:30.026149 16435 leader_election.cc:290] T b1e06a2952f94a919e5324bd1f0d7cab P 3a01ebd6b99640978d77190fe4da6f08 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c6d026bb4a9146c395c2b8572753ffb7 (127.5.126.65:34303), 6070cdc51c6f49fcbcfbddd22a3c263c (127.5.126.66:41095)
I20260709 13:23:30.026767 16431 tablet_bootstrap.cc:492] T f55407f772b74aaba87440ba35c2ac8b P 3a01ebd6b99640978d77190fe4da6f08: Bootstrap starting.
I20260709 13:23:30.029906 16432 tablet_bootstrap.cc:492] T 5066abfe4261488f96534730b07ce4d5 P c6d026bb4a9146c395c2b8572753ffb7: No bootstrap required, opened a new log
I20260709 13:23:30.030516 16432 ts_tablet_manager.cc:1403] T 5066abfe4261488f96534730b07ce4d5 P c6d026bb4a9146c395c2b8572753ffb7: Time spent bootstrapping tablet: real 0.164s	user 0.037s	sys 0.009s
I20260709 13:23:30.033775 16432 raft_consensus.cc:359] T 5066abfe4261488f96534730b07ce4d5 P c6d026bb4a9146c395c2b8572753ffb7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6d026bb4a9146c395c2b8572753ffb7" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34303 } } peers { permanent_uuid: "6070cdc51c6f49fcbcfbddd22a3c263c" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 41095 } } peers { permanent_uuid: "3a01ebd6b99640978d77190fe4da6f08" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 45221 } }
I20260709 13:23:30.034518 16432 raft_consensus.cc:385] T 5066abfe4261488f96534730b07ce4d5 P c6d026bb4a9146c395c2b8572753ffb7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:23:30.034830 16432 raft_consensus.cc:740] T 5066abfe4261488f96534730b07ce4d5 P c6d026bb4a9146c395c2b8572753ffb7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c6d026bb4a9146c395c2b8572753ffb7, State: Initialized, Role: FOLLOWER
I20260709 13:23:30.035604 16432 consensus_queue.cc:260] T 5066abfe4261488f96534730b07ce4d5 P c6d026bb4a9146c395c2b8572753ffb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6d026bb4a9146c395c2b8572753ffb7" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34303 } } peers { permanent_uuid: "6070cdc51c6f49fcbcfbddd22a3c263c" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 41095 } } peers { permanent_uuid: "3a01ebd6b99640978d77190fe4da6f08" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 45221 } }
I20260709 13:23:30.037067 16391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f5a2d88e89448648f594ef23ef152cd" candidate_uuid: "6070cdc51c6f49fcbcfbddd22a3c263c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3a01ebd6b99640978d77190fe4da6f08" is_pre_election: true
I20260709 13:23:30.038858 16431 tablet_bootstrap.cc:654] T f55407f772b74aaba87440ba35c2ac8b P 3a01ebd6b99640978d77190fe4da6f08: Neither blocks nor log segments found. Creating new log.
W20260709 13:23:30.038884 16281 leader_election.cc:343] T 4f5a2d88e89448648f594ef23ef152cd P 6070cdc51c6f49fcbcfbddd22a3c263c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3a01ebd6b99640978d77190fe4da6f08 (127.5.126.67:45221): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:23:30.039702 16281 leader_election.cc:304] T 4f5a2d88e89448648f594ef23ef152cd P 6070cdc51c6f49fcbcfbddd22a3c263c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6070cdc51c6f49fcbcfbddd22a3c263c; no voters: 3a01ebd6b99640978d77190fe4da6f08, c6d026bb4a9146c395c2b8572753ffb7
I20260709 13:23:30.040566 16439 raft_consensus.cc:2749] T 4f5a2d88e89448648f594ef23ef152cd P 6070cdc51c6f49fcbcfbddd22a3c263c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:23:30.008220 16433 consensus_queue.cc:260] T 88caca305bf74120a011e3fa92781678 P 6070cdc51c6f49fcbcfbddd22a3c263c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6d026bb4a9146c395c2b8572753ffb7" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34303 } } peers { permanent_uuid: "6070cdc51c6f49fcbcfbddd22a3c263c" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 41095 } } peers { permanent_uuid: "3a01ebd6b99640978d77190fe4da6f08" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 45221 } }
I20260709 13:23:30.044807 16432 ts_tablet_manager.cc:1434] T 5066abfe4261488f96534730b07ce4d5 P c6d026bb4a9146c395c2b8572753ffb7: Time spent starting tablet: real 0.014s	user 0.008s	sys 0.001s
I20260709 13:23:30.045985 16432 tablet_bootstrap.cc:492] T 88caca305bf74120a011e3fa92781678 P c6d026bb4a9146c395c2b8572753ffb7: Bootstrap starting.
I20260709 13:23:30.050705 16433 ts_tablet_manager.cc:1434] T 88caca305bf74120a011e3fa92781678 P 6070cdc51c6f49fcbcfbddd22a3c263c: Time spent starting tablet: real 0.092s	user 0.006s	sys 0.004s
I20260709 13:23:30.051769 16433 tablet_bootstrap.cc:492] T cb70c02d0bce438cbb6434b2c0aa54ae P 6070cdc51c6f49fcbcfbddd22a3c263c: Bootstrap starting.
I20260709 13:23:30.051949 16391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd931932596f4755aeae878c0fe3c2d9" candidate_uuid: "c6d026bb4a9146c395c2b8572753ffb7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3a01ebd6b99640978d77190fe4da6f08" is_pre_election: true
I20260709 13:23:30.053066 16391 raft_consensus.cc:2468] T fd931932596f4755aeae878c0fe3c2d9 P 3a01ebd6b99640978d77190fe4da6f08 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6d026bb4a9146c395c2b8572753ffb7 in term 0.
I20260709 13:23:30.054975 16206 leader_election.cc:304] T fd931932596f4755aeae878c0fe3c2d9 P c6d026bb4a9146c395c2b8572753ffb7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3a01ebd6b99640978d77190fe4da6f08, c6d026bb4a9146c395c2b8572753ffb7; no voters: 6070cdc51c6f49fcbcfbddd22a3c263c
I20260709 13:23:30.056234 16440 raft_consensus.cc:2804] T fd931932596f4755aeae878c0fe3c2d9 P c6d026bb4a9146c395c2b8572753ffb7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:23:30.056720 16440 raft_consensus.cc:493] T fd931932596f4755aeae878c0fe3c2d9 P c6d026bb4a9146c395c2b8572753ffb7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:23:30.057156 16440 raft_consensus.cc:3060] T fd931932596f4755aeae878c0fe3c2d9 P c6d026bb4a9146c395c2b8572753ffb7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:23:30.065183 16433 tablet_bootstrap.cc:654] T cb70c02d0bce438cbb6434b2c0aa54ae P 6070cdc51c6f49fcbcfbddd22a3c263c: Neither blocks nor log segments found. Creating new log.
I20260709 13:23:30.072912 16242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88caca305bf74120a011e3fa92781678" candidate_uuid: "3a01ebd6b99640978d77190fe4da6f08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6d026bb4a9146c395c2b8572753ffb7" is_pre_election: true
I20260709 13:23:30.073287 16432 tablet_bootstrap.cc:654] T 88caca305bf74120a011e3fa92781678 P c6d026bb4a9146c395c2b8572753ffb7: Neither blocks nor log segments found. Creating new log.
I20260709 13:23:30.075033 16242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1e06a2952f94a919e5324bd1f0d7cab" candidate_uuid: "3a01ebd6b99640978d77190fe4da6f08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6d026bb4a9146c395c2b8572753ffb7" is_pre_election: true
W20260709 13:23:30.075266 16355 leader_election.cc:343] T 88caca305bf74120a011e3fa92781678 P 3a01ebd6b99640978d77190fe4da6f08 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c6d026bb4a9146c395c2b8572753ffb7 (127.5.126.65:34303): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:23:30.078174 16435 raft_consensus.cc:493] T 5066abfe4261488f96534730b07ce4d5 P 3a01ebd6b99640978d77190fe4da6f08 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:23:30.078822 16355 leader_election.cc:343] T b1e06a2952f94a919e5324bd1f0d7cab P 3a01ebd6b99640978d77190fe4da6f08 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c6d026bb4a9146c395c2b8572753ffb7 (127.5.126.65:34303): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:23:30.078747 16435 raft_consensus.cc:515] T 5066abfe4261488f96534730b07ce4d5 P 3a01ebd6b99640978d77190fe4da6f08 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6d026bb4a9146c395c2b8572753ffb7" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34303 } } peers { permanent_uuid: "6070cdc51c6f49fcbcfbddd22a3c263c" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 41095 } } peers { permanent_uuid: "3a01ebd6b99640978d77190fe4da6f08" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 45221 } }
I20260709 13:23:30.080969 16435 leader_election.cc:290] T 5066abfe4261488f96534730b07ce4d5 P 3a01ebd6b99640978d77190fe4da6f08 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c6d026bb4a9146c395c2b8572753ffb7 (127.5.126.65:34303), 6070cdc51c6f49fcbcfbddd22a3c263c (127.5.126.66:41095)
I20260709 13:23:30.083029 16431 tablet_bootstrap.cc:492] T f55407f772b74aaba87440ba35c2ac8b P 3a01ebd6b99640978d77190fe4da6f08: No bootstrap required, opened a new log
I20260709 13:23:30.083007 16242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5066abfe4261488f96534730b07ce4d5" candidate_uuid: "3a01ebd6b99640978d77190fe4da6f08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6d026bb4a9146c395c2b8572753ffb7" is_pre_election: true
I20260709 13:23:30.083838 16431 ts_tablet_manager.cc:1403] T f55407f772b74aaba87440ba35c2ac8b P 3a01ebd6b99640978d77190fe4da6f08: Time spent bootstrapping tablet: real 0.064s	user 0.029s	sys 0.015s
I20260709 13:23:30.083817 16242 raft_consensus.cc:2468] T 5066abfe4261488f96534730b07ce4d5 P c6d026bb4a9146c395c2b8572753ffb7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3a01ebd6b99640978d77190fe4da6f08 in term 0.
I20260709 13:23:30.086750 16355 leader_election.cc:304] T 5066abfe4261488f96534730b07ce4d5 P 3a01ebd6b99640978d77190fe4da6f08 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3a01ebd6b99640978d77190fe4da6f08, c6d026bb4a9146c395c2b8572753ffb7; no voters: 
I20260709 13:23:30.087601 16435 raft_consensus.cc:2804] T 5066abfe4261488f96534730b07ce4d5 P 3a01ebd6b99640978d77190fe4da6f08 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:23:30.087985 16435 raft_consensus.cc:493] T 5066abfe4261488f96534730b07ce4d5 P 3a01ebd6b99640978d77190fe4da6f08 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:23:30.088338 16435 raft_consensus.cc:3060] T 5066abfe4261488f96534730b07ce4d5 P 3a01ebd6b99640978d77190fe4da6f08 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:23:30.088485 16432 tablet_bootstrap.cc:492] T 88caca305bf74120a011e3fa92781678 P c6d026bb4a9146c395c2b8572753ffb7: No bootstrap required, opened a new log
I20260709 13:23:30.089596 16432 ts_tablet_manager.cc:1403] T 88caca305bf74120a011e3fa92781678 P c6d026bb4a9146c395c2b8572753ffb7: Time spent bootstrapping tablet: real 0.044s	user 0.019s	sys 0.002s
I20260709 13:23:30.091212 16317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88caca305bf74120a011e3fa92781678" candidate_uuid: "3a01ebd6b99640978d77190fe4da6f08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6070cdc51c6f49fcbcfbddd22a3c263c" is_pre_election: true
I20260709 13:23:30.091979 16317 raft_consensus.cc:2468] T 88caca305bf74120a011e3fa92781678 P 6070cdc51c6f49fcbcfbddd22a3c263c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3a01ebd6b99640978d77190fe4da6f08 in term 0.
I20260709 13:23:30.092157 16316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1e06a2952f94a919e5324bd1f0d7cab" candidate_uuid: "3a01ebd6b99640978d77190fe4da6f08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6070cdc51c6f49fcbcfbddd22a3c263c" is_pre_election: true
I20260709 13:23:30.093626 16315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5066abfe4261488f96534730b07ce4d5" candidate_uuid: "3a01ebd6b99640978d77190fe4da6f08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6070cdc51c6f49fcbcfbddd22a3c263c" is_pre_election: true
I20260709 13:23:30.093864 16355 leader_election.cc:304] T 88caca305bf74120a011e3fa92781678 P 3a01ebd6b99640978d77190fe4da6f08 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3a01ebd6b99640978d77190fe4da6f08, 6070cdc51c6f49fcbcfbddd22a3c263c; no voters: c6d026bb4a9146c395c2b8572753ffb7
I20260709 13:23:30.081571 16440 raft_consensus.cc:515] T fd931932596f4755aeae878c0fe3c2d9 P c6d026bb4a9146c395c2b8572753ffb7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6d026bb4a9146c395c2b8572753ffb7" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34303 } } peers { permanent_uuid: "6070cdc51c6f49fcbcfbddd22a3c263c" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 41095 } } peers { permanent_uuid: "3a01ebd6b99640978d77190fe4da6f08" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 45221 } }
I20260709 13:23:30.097435 16315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd931932596f4755aeae878c0fe3c2d9" candidate_uuid: "c6d026bb4a9146c395c2b8572753ffb7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6070cdc51c6f49fcbcfbddd22a3c263c"
W20260709 13:23:30.099002 16206 leader_election.cc:343] T fd931932596f4755aeae878c0fe3c2d9 P c6d026bb4a9146c395c2b8572753ffb7 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6070cdc51c6f49fcbcfbddd22a3c263c (127.5.126.66:41095): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:23:30.100080 16440 leader_election.cc:290] T fd931932596f4755aeae878c0fe3c2d9 P c6d026bb4a9146c395c2b8572753ffb7 [CANDIDATE]: Term 1 election: Requested vote from peers 6070cdc51c6f49fcbcfbddd22a3c263c (127.5.126.66:41095), 3a01ebd6b99640978d77190fe4da6f08 (127.5.126.67:45221)
I20260709 13:23:30.101025 16431 raft_consensus.cc:359] T f55407f772b74aaba87440ba35c2ac8b P 3a01ebd6b99640978d77190fe4da6f08 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6d026bb4a9146c395c2b8572753ffb7" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34303 } } peers { permanent_uuid: "6070cdc51c6f49fcbcfbddd22a3c263c" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 41095 } } peers { permanent_uuid: "3a01ebd6b99640978d77190fe4da6f08" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 45221 } }
I20260709 13:23:30.101734 16391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd931932596f4755aeae878c0fe3c2d9" candidate_uuid: "c6d026bb4a9146c395c2b8572753ffb7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3a01ebd6b99640978d77190fe4da6f08"
I20260709 13:23:30.102617 16435 raft_consensus.cc:515] T 5066abfe4261488f96534730b07ce4d5 P 3a01ebd6b99640978d77190fe4da6f08 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6d026bb4a9146c395c2b8572753ffb7" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34303 } } peers { permanent_uuid: "6070cdc51c6f49fcbcfbddd22a3c263c" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 41095 } } peers { permanent_uuid: "3a01ebd6b99640978d77190fe4da6f08" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 45221 } }
I20260709 13:23:30.103530 16431 raft_consensus.cc:385] T f55407f772b74aaba87440ba35c2ac8b P 3a01ebd6b99640978d77190fe4da6f08 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:23:30.103744 16391 raft_consensus.cc:3060] T fd931932596f4755aeae878c0fe3c2d9 P 3a01ebd6b99640978d77190fe4da6f08 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:23:30.104930 16457 raft_consensus.cc:2804] T 88caca305bf74120a011e3fa92781678 P 3a01ebd6b99640978d77190fe4da6f08 [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260709 13:23:30.105154 16355 leader_election.cc:343] T b1e06a2952f94a919e5324bd1f0d7cab P 3a01ebd6b99640978d77190fe4da6f08 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6070cdc51c6f49fcbcfbddd22a3c263c (127.5.126.66:41095): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:23:30.105455 16431 raft_consensus.cc:740] T f55407f772b74aaba87440ba35c2ac8b P 3a01ebd6b99640978d77190fe4da6f08 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3a01ebd6b99640978d77190fe4da6f08, State: Initialized, Role: FOLLOWER
I20260709 13:23:30.093839 16432 raft_consensus.cc:359] T 88caca305bf74120a011e3fa92781678 P c6d026bb4a9146c395c2b8572753ffb7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6d026bb4a9146c395c2b8572753ffb7" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34303 } } peers { permanent_uuid: "6070cdc51c6f49fcbcfbddd22a3c263c" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 41095 } } peers { permanent_uuid: "3a01ebd6b99640978d77190fe4da6f08" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 45221 } }
I20260709 13:23:30.106444 16355 leader_election.cc:304] T b1e06a2952f94a919e5324bd1f0d7cab P 3a01ebd6b99640978d77190fe4da6f08 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3a01ebd6b99640978d77190fe4da6f08; no voters: 6070cdc51c6f49fcbcfbddd22a3c263c, c6d026bb4a9146c395c2b8572753ffb7
I20260709 13:23:30.106786 16432 raft_consensus.cc:385] T 88caca305bf74120a011e3fa92781678 P c6d026bb4a9146c395c2b8572753ffb7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:23:30.107160 16432 raft_consensus.cc:740] T 88caca305bf74120a011e3fa92781678 P c6d026bb4a9146c395c2b8572753ffb7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c6d026bb4a9146c395c2b8572753ffb7, State: Initialized, Role: FOLLOWER
I20260709 13:23:30.107257 16431 consensus_queue.cc:260] T f55407f772b74aaba87440ba35c2ac8b P 3a01ebd6b99640978d77190fe4da6f08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6d026bb4a9146c395c2b8572753ffb7" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34303 } } peers { permanent_uuid: "6070cdc51c6f49fcbcfbddd22a3c263c" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 41095 } } peers { permanent_uuid: "3a01ebd6b99640978d77190fe4da6f08" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 45221 } }
I20260709 13:23:30.108143 16432 consensus_queue.cc:260] T 88caca305bf74120a011e3fa92781678 P c6d026bb4a9146c395c2b8572753ffb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6d026bb4a9146c395c2b8572753ffb7" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34303 } } peers { permanent_uuid: "6070cdc51c6f49fcbcfbddd22a3c263c" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 41095 } } peers { permanent_uuid: "3a01ebd6b99640978d77190fe4da6f08" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 45221 } }
I20260709 13:23:30.109628 16457 raft_consensus.cc:493] T 88caca305bf74120a011e3fa92781678 P 3a01ebd6b99640978d77190fe4da6f08 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:23:30.110329 16457 raft_consensus.cc:3060] T 88caca305bf74120a011e3fa92781678 P 3a01ebd6b99640978d77190fe4da6f08 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:23:30.111722 16391 raft_consensus.cc:2468] T fd931932596f4755aeae878c0fe3c2d9 P 3a01ebd6b99640978d77190fe4da6f08 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6d026bb4a9146c395c2b8572753ffb7 in term 1.
I20260709 13:23:30.105393 16435 leader_election.cc:290] T 5066abfe4261488f96534730b07ce4d5 P 3a01ebd6b99640978d77190fe4da6f08 [CANDIDATE]: Term 1 election: Requested vote from peers c6d026bb4a9146c395c2b8572753ffb7 (127.5.126.65:34303), 6070cdc51c6f49fcbcfbddd22a3c263c (127.5.126.66:41095)
I20260709 13:23:30.113121 16206 leader_election.cc:304] T fd931932596f4755aeae878c0fe3c2d9 P c6d026bb4a9146c395c2b8572753ffb7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3a01ebd6b99640978d77190fe4da6f08, c6d026bb4a9146c395c2b8572753ffb7; no voters: 6070cdc51c6f49fcbcfbddd22a3c263c
I20260709 13:23:30.113876 16435 raft_consensus.cc:2749] T b1e06a2952f94a919e5324bd1f0d7cab P 3a01ebd6b99640978d77190fe4da6f08 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:23:30.115777 16433 tablet_bootstrap.cc:492] T cb70c02d0bce438cbb6434b2c0aa54ae P 6070cdc51c6f49fcbcfbddd22a3c263c: No bootstrap required, opened a new log
I20260709 13:23:30.116217 16440 raft_consensus.cc:2804] T fd931932596f4755aeae878c0fe3c2d9 P c6d026bb4a9146c395c2b8572753ffb7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:23:30.116806 16440 raft_consensus.cc:697] T fd931932596f4755aeae878c0fe3c2d9 P c6d026bb4a9146c395c2b8572753ffb7 [term 1 LEADER]: Becoming Leader. State: Replica: c6d026bb4a9146c395c2b8572753ffb7, State: Running, Role: LEADER
I20260709 13:23:30.117658 16440 consensus_queue.cc:237] T fd931932596f4755aeae878c0fe3c2d9 P c6d026bb4a9146c395c2b8572753ffb7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6d026bb4a9146c395c2b8572753ffb7" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34303 } } peers { permanent_uuid: "6070cdc51c6f49fcbcfbddd22a3c263c" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 41095 } } peers { permanent_uuid: "3a01ebd6b99640978d77190fe4da6f08" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 45221 } }
W20260709 13:23:30.118360 16355 leader_election.cc:343] T 5066abfe4261488f96534730b07ce4d5 P 3a01ebd6b99640978d77190fe4da6f08 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6070cdc51c6f49fcbcfbddd22a3c263c (127.5.126.66:41095): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:23:30.120427 16431 ts_tablet_manager.cc:1434] T f55407f772b74aaba87440ba35c2ac8b P 3a01ebd6b99640978d77190fe4da6f08: Time spent starting tablet: real 0.036s	user 0.009s	sys 0.000s
I20260709 13:23:30.120779 16242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5066abfe4261488f96534730b07ce4d5" candidate_uuid: "3a01ebd6b99640978d77190fe4da6f08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6d026bb4a9146c395c2b8572753ffb7"
I20260709 13:23:30.121443 16242 raft_consensus.cc:3060] T 5066abfe4261488f96534730b07ce4d5 P c6d026bb4a9146c395c2b8572753ffb7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:23:30.121825 16431 tablet_bootstrap.cc:492] T cb70c02d0bce438cbb6434b2c0aa54ae P 3a01ebd6b99640978d77190fe4da6f08: Bootstrap starting.
I20260709 13:23:30.123096 16432 ts_tablet_manager.cc:1434] T 88caca305bf74120a011e3fa92781678 P c6d026bb4a9146c395c2b8572753ffb7: Time spent starting tablet: real 0.033s	user 0.008s	sys 0.000s
I20260709 13:23:30.124089 16432 tablet_bootstrap.cc:492] T f55407f772b74aaba87440ba35c2ac8b P c6d026bb4a9146c395c2b8572753ffb7: Bootstrap starting.
I20260709 13:23:30.116340 16433 ts_tablet_manager.cc:1403] T cb70c02d0bce438cbb6434b2c0aa54ae P 6070cdc51c6f49fcbcfbddd22a3c263c: Time spent bootstrapping tablet: real 0.065s	user 0.019s	sys 0.026s
I20260709 13:23:30.131587 16432 tablet_bootstrap.cc:654] T f55407f772b74aaba87440ba35c2ac8b P c6d026bb4a9146c395c2b8572753ffb7: Neither blocks nor log segments found. Creating new log.
I20260709 13:23:30.131322 16433 raft_consensus.cc:359] T cb70c02d0bce438cbb6434b2c0aa54ae P 6070cdc51c6f49fcbcfbddd22a3c263c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6d026bb4a9146c395c2b8572753ffb7" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34303 } } peers { permanent_uuid: "6070cdc51c6f49fcbcfbddd22a3c263c" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 41095 } } peers { permanent_uuid: "3a01ebd6b99640978d77190fe4da6f08" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 45221 } }
I20260709 13:23:30.133275 16433 raft_consensus.cc:385] T cb70c02d0bce438cbb6434b2c0aa54ae P 6070cdc51c6f49fcbcfbddd22a3c263c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:23:30.134109 16433 raft_consensus.cc:740] T cb70c02d0bce438cbb6434b2c0aa54ae P 6070cdc51c6f49fcbcfbddd22a3c263c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6070cdc51c6f49fcbcfbddd22a3c263c, State: Initialized, Role: FOLLOWER
I20260709 13:23:30.135022 16315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5066abfe4261488f96534730b07ce4d5" candidate_uuid: "3a01ebd6b99640978d77190fe4da6f08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6070cdc51c6f49fcbcfbddd22a3c263c"
I20260709 13:23:30.136021 16433 consensus_queue.cc:260] T cb70c02d0bce438cbb6434b2c0aa54ae P 6070cdc51c6f49fcbcfbddd22a3c263c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6d026bb4a9146c395c2b8572753ffb7" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34303 } } peers { permanent_uuid: "6070cdc51c6f49fcbcfbddd22a3c263c" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 41095 } } peers { permanent_uuid: "3a01ebd6b99640978d77190fe4da6f08" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 45221 } }
W20260709 13:23:30.136799 16355 leader_election.cc:343] T 5066abfe4261488f96534730b07ce4d5 P 3a01ebd6b99640978d77190fe4da6f08 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6070cdc51c6f49fcbcfbddd22a3c263c (127.5.126.66:41095): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:23:30.133332 16242 raft_consensus.cc:2468] T 5066abfe4261488f96534730b07ce4d5 P c6d026bb4a9146c395c2b8572753ffb7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3a01ebd6b99640978d77190fe4da6f08 in term 1.
I20260709 13:23:30.140168 16355 leader_election.cc:304] T 5066abfe4261488f96534730b07ce4d5 P 3a01ebd6b99640978d77190fe4da6f08 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3a01ebd6b99640978d77190fe4da6f08, c6d026bb4a9146c395c2b8572753ffb7; no voters: 6070cdc51c6f49fcbcfbddd22a3c263c
I20260709 13:23:30.140301 16432 tablet_bootstrap.cc:492] T f55407f772b74aaba87440ba35c2ac8b P c6d026bb4a9146c395c2b8572753ffb7: No bootstrap required, opened a new log
I20260709 13:23:30.141146 16432 ts_tablet_manager.cc:1403] T f55407f772b74aaba87440ba35c2ac8b P c6d026bb4a9146c395c2b8572753ffb7: Time spent bootstrapping tablet: real 0.017s	user 0.013s	sys 0.003s
I20260709 13:23:30.141597 16435 raft_consensus.cc:2804] T 5066abfe4261488f96534730b07ce4d5 P 3a01ebd6b99640978d77190fe4da6f08 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:23:30.142175 16435 raft_consensus.cc:697] T 5066abfe4261488f96534730b07ce4d5 P 3a01ebd6b99640978d77190fe4da6f08 [term 1 LEADER]: Becoming Leader. State: Replica: 3a01ebd6b99640978d77190fe4da6f08, State: Running, Role: LEADER
I20260709 13:23:30.143042 16431 tablet_bootstrap.cc:654] T cb70c02d0bce438cbb6434b2c0aa54ae P 3a01ebd6b99640978d77190fe4da6f08: Neither blocks nor log segments found. Creating new log.
I20260709 13:23:30.143131 16435 consensus_queue.cc:237] T 5066abfe4261488f96534730b07ce4d5 P 3a01ebd6b99640978d77190fe4da6f08 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6d026bb4a9146c395c2b8572753ffb7" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34303 } } peers { permanent_uuid: "6070cdc51c6f49fcbcfbddd22a3c263c" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 41095 } } peers { permanent_uuid: "3a01ebd6b99640978d77190fe4da6f08" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 45221 } }
I20260709 13:23:30.148465 16432 raft_consensus.cc:359] T f55407f772b74aaba87440ba35c2ac8b P c6d026bb4a9146c395c2b8572753ffb7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6d026bb4a9146c395c2b8572753ffb7" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34303 } } peers { permanent_uuid: "6070cdc51c6f49fcbcfbddd22a3c263c" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 41095 } } peers { permanent_uuid: "3a01ebd6b99640978d77190fe4da6f08" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 45221 } }
I20260709 13:23:30.149242 16432 raft_consensus.cc:385] T f55407f772b74aaba87440ba35c2ac8b P c6d026bb4a9146c395c2b8572753ffb7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:23:30.149534 16432 raft_consensus.cc:740] T f55407f772b74aaba87440ba35c2ac8b P c6d026bb4a9146c395c2b8572753ffb7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c6d026bb4a9146c395c2b8572753ffb7, State: Initialized, Role: FOLLOWER
I20260709 13:23:30.150264 16432 consensus_queue.cc:260] T f55407f772b74aaba87440ba35c2ac8b P c6d026bb4a9146c395c2b8572753ffb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6d026bb4a9146c395c2b8572753ffb7" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34303 } } peers { permanent_uuid: "6070cdc51c6f49fcbcfbddd22a3c263c" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 41095 } } peers { permanent_uuid: "3a01ebd6b99640978d77190fe4da6f08" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 45221 } }
I20260709 13:23:30.150702 16457 raft_consensus.cc:515] T 88caca305bf74120a011e3fa92781678 P 3a01ebd6b99640978d77190fe4da6f08 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6d026bb4a9146c395c2b8572753ffb7" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34303 } } peers { permanent_uuid: "6070cdc51c6f49fcbcfbddd22a3c263c" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 41095 } } peers { permanent_uuid: "3a01ebd6b99640978d77190fe4da6f08" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 45221 } }
I20260709 13:23:30.153077 16432 ts_tablet_manager.cc:1434] T f55407f772b74aaba87440ba35c2ac8b P c6d026bb4a9146c395c2b8572753ffb7: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.001s
I20260709 13:23:30.152281 16137 catalog_manager.cc:5697] T fd931932596f4755aeae878c0fe3c2d9 P c6d026bb4a9146c395c2b8572753ffb7 reported cstate change: term changed from 0 to 1, leader changed from <none> to c6d026bb4a9146c395c2b8572753ffb7 (127.5.126.65). New cstate: current_term: 1 leader_uuid: "c6d026bb4a9146c395c2b8572753ffb7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6d026bb4a9146c395c2b8572753ffb7" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34303 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6070cdc51c6f49fcbcfbddd22a3c263c" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 41095 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3a01ebd6b99640978d77190fe4da6f08" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 45221 } health_report { overall_health: UNKNOWN } } }
I20260709 13:23:30.153486 16457 leader_election.cc:290] T 88caca305bf74120a011e3fa92781678 P 3a01ebd6b99640978d77190fe4da6f08 [CANDIDATE]: Term 1 election: Requested vote from peers c6d026bb4a9146c395c2b8572753ffb7 (127.5.126.65:34303), 6070cdc51c6f49fcbcfbddd22a3c263c (127.5.126.66:41095)
I20260709 13:23:30.152136 16433 ts_tablet_manager.cc:1434] T cb70c02d0bce438cbb6434b2c0aa54ae P 6070cdc51c6f49fcbcfbddd22a3c263c: Time spent starting tablet: real 0.027s	user 0.008s	sys 0.000s
I20260709 13:23:30.154269 16432 tablet_bootstrap.cc:492] T cb70c02d0bce438cbb6434b2c0aa54ae P c6d026bb4a9146c395c2b8572753ffb7: Bootstrap starting.
I20260709 13:23:30.155170 16433 tablet_bootstrap.cc:492] T b1e06a2952f94a919e5324bd1f0d7cab P 6070cdc51c6f49fcbcfbddd22a3c263c: Bootstrap starting.
I20260709 13:23:30.156731 16242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88caca305bf74120a011e3fa92781678" candidate_uuid: "3a01ebd6b99640978d77190fe4da6f08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6d026bb4a9146c395c2b8572753ffb7"
I20260709 13:23:30.157476 16242 raft_consensus.cc:3060] T 88caca305bf74120a011e3fa92781678 P c6d026bb4a9146c395c2b8572753ffb7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:23:30.160491 16432 tablet_bootstrap.cc:654] T cb70c02d0bce438cbb6434b2c0aa54ae P c6d026bb4a9146c395c2b8572753ffb7: Neither blocks nor log segments found. Creating new log.
I20260709 13:23:30.161617 16315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88caca305bf74120a011e3fa92781678" candidate_uuid: "3a01ebd6b99640978d77190fe4da6f08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6070cdc51c6f49fcbcfbddd22a3c263c"
I20260709 13:23:30.162482 16315 raft_consensus.cc:3060] T 88caca305bf74120a011e3fa92781678 P 6070cdc51c6f49fcbcfbddd22a3c263c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:23:30.164239 16433 tablet_bootstrap.cc:654] T b1e06a2952f94a919e5324bd1f0d7cab P 6070cdc51c6f49fcbcfbddd22a3c263c: Neither blocks nor log segments found. Creating new log.
I20260709 13:23:30.173146 16432 tablet_bootstrap.cc:492] T cb70c02d0bce438cbb6434b2c0aa54ae P c6d026bb4a9146c395c2b8572753ffb7: No bootstrap required, opened a new log
I20260709 13:23:30.173686 16432 ts_tablet_manager.cc:1403] T cb70c02d0bce438cbb6434b2c0aa54ae P c6d026bb4a9146c395c2b8572753ffb7: Time spent bootstrapping tablet: real 0.020s	user 0.006s	sys 0.012s
I20260709 13:23:30.177609 16432 raft_consensus.cc:359] T cb70c02d0bce438cbb6434b2c0aa54ae P c6d026bb4a9146c395c2b8572753ffb7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6d026bb4a9146c395c2b8572753ffb7" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34303 } } peers { permanent_uuid: "6070cdc51c6f49fcbcfbddd22a3c263c" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 41095 } } peers { permanent_uuid: "3a01ebd6b99640978d77190fe4da6f08" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 45221 } }
I20260709 13:23:30.178594 16432 raft_consensus.cc:385] T cb70c02d0bce438cbb6434b2c0aa54ae P c6d026bb4a9146c395c2b8572753ffb7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:23:30.178918 16432 raft_consensus.cc:740] T cb70c02d0bce438cbb6434b2c0aa54ae P c6d026bb4a9146c395c2b8572753ffb7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c6d026bb4a9146c395c2b8572753ffb7, State: Initialized, Role: FOLLOWER
I20260709 13:23:30.179986 16432 consensus_queue.cc:260] T cb70c02d0bce438cbb6434b2c0aa54ae P c6d026bb4a9146c395c2b8572753ffb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6d026bb4a9146c395c2b8572753ffb7" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34303 } } peers { permanent_uuid: "6070cdc51c6f49fcbcfbddd22a3c263c" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 41095 } } peers { permanent_uuid: "3a01ebd6b99640978d77190fe4da6f08" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 45221 } }
I20260709 13:23:30.183240 16432 ts_tablet_manager.cc:1434] T cb70c02d0bce438cbb6434b2c0aa54ae P c6d026bb4a9146c395c2b8572753ffb7: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
I20260709 13:23:30.184738 16432 tablet_bootstrap.cc:492] T aab7ef362ab84369939a6a02d817aa53 P c6d026bb4a9146c395c2b8572753ffb7: Bootstrap starting.
I20260709 13:23:30.193562 16432 tablet_bootstrap.cc:654] T aab7ef362ab84369939a6a02d817aa53 P c6d026bb4a9146c395c2b8572753ffb7: Neither blocks nor log segments found. Creating new log.
I20260709 13:23:30.196767 16433 tablet_bootstrap.cc:492] T b1e06a2952f94a919e5324bd1f0d7cab P 6070cdc51c6f49fcbcfbddd22a3c263c: No bootstrap required, opened a new log
I20260709 13:23:30.196836 16315 raft_consensus.cc:2468] T 88caca305bf74120a011e3fa92781678 P 6070cdc51c6f49fcbcfbddd22a3c263c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3a01ebd6b99640978d77190fe4da6f08 in term 1.
I20260709 13:23:30.197916 16433 ts_tablet_manager.cc:1403] T b1e06a2952f94a919e5324bd1f0d7cab P 6070cdc51c6f49fcbcfbddd22a3c263c: Time spent bootstrapping tablet: real 0.043s	user 0.013s	sys 0.023s
I20260709 13:23:30.199096 16355 leader_election.cc:304] T 88caca305bf74120a011e3fa92781678 P 3a01ebd6b99640978d77190fe4da6f08 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3a01ebd6b99640978d77190fe4da6f08, 6070cdc51c6f49fcbcfbddd22a3c263c; no voters: 
I20260709 13:23:30.200580 16457 raft_consensus.cc:2804] T 88caca305bf74120a011e3fa92781678 P 3a01ebd6b99640978d77190fe4da6f08 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:23:30.201354 16457 raft_consensus.cc:697] T 88caca305bf74120a011e3fa92781678 P 3a01ebd6b99640978d77190fe4da6f08 [term 1 LEADER]: Becoming Leader. State: Replica: 3a01ebd6b99640978d77190fe4da6f08, State: Running, Role: LEADER
I20260709 13:23:30.202544 16457 consensus_queue.cc:237] T 88caca305bf74120a011e3fa92781678 P 3a01ebd6b99640978d77190fe4da6f08 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6d026bb4a9146c395c2b8572753ffb7" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34303 } } peers { permanent_uuid: "6070cdc51c6f49fcbcfbddd22a3c263c" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 41095 } } peers { permanent_uuid: "3a01ebd6b99640978d77190fe4da6f08" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 45221 } }
I20260709 13:23:30.191696 16242 raft_consensus.cc:2468] T 88caca305bf74120a011e3fa92781678 P c6d026bb4a9146c395c2b8572753ffb7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3a01ebd6b99640978d77190fe4da6f08 in term 1.
I20260709 13:23:30.206290 16432 tablet_bootstrap.cc:492] T aab7ef362ab84369939a6a02d817aa53 P c6d026bb4a9146c395c2b8572753ffb7: No bootstrap required, opened a new log
I20260709 13:23:30.207079 16432 ts_tablet_manager.cc:1403] T aab7ef362ab84369939a6a02d817aa53 P c6d026bb4a9146c395c2b8572753ffb7: Time spent bootstrapping tablet: real 0.023s	user 0.015s	sys 0.003s
I20260709 13:23:30.209736 16433 raft_consensus.cc:359] T b1e06a2952f94a919e5324bd1f0d7cab P 6070cdc51c6f49fcbcfbddd22a3c263c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6d026bb4a9146c395c2b8572753ffb7" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34303 } } peers { permanent_uuid: "6070cdc51c6f49fcbcfbddd22a3c263c" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 41095 } } peers { permanent_uuid: "3a01ebd6b99640978d77190fe4da6f08" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 45221 } }
I20260709 13:23:30.210680 16433 raft_consensus.cc:385] T b1e06a2952f94a919e5324bd1f0d7cab P 6070cdc51c6f49fcbcfbddd22a3c263c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:23:30.210413 16432 raft_consensus.cc:359] T aab7ef362ab84369939a6a02d817aa53 P c6d026bb4a9146c395c2b8572753ffb7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6d026bb4a9146c395c2b8572753ffb7" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34303 } } peers { permanent_uuid: "6070cdc51c6f49fcbcfbddd22a3c263c" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 41095 } } peers { permanent_uuid: "3a01ebd6b99640978d77190fe4da6f08" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 45221 } }
I20260709 13:23:30.211055 16433 raft_consensus.cc:740] T b1e06a2952f94a919e5324bd1f0d7cab P 6070cdc51c6f49fcbcfbddd22a3c263c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6070cdc51c6f49fcbcfbddd22a3c263c, State: Initialized, Role: FOLLOWER
I20260709 13:23:30.211261 16432 raft_consensus.cc:385] T aab7ef362ab84369939a6a02d817aa53 P c6d026bb4a9146c395c2b8572753ffb7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:23:30.211611 16432 raft_consensus.cc:740] T aab7ef362ab84369939a6a02d817aa53 P c6d026bb4a9146c395c2b8572753ffb7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c6d026bb4a9146c395c2b8572753ffb7, State: Initialized, Role: FOLLOWER
I20260709 13:23:30.209797 16139 catalog_manager.cc:5697] T 5066abfe4261488f96534730b07ce4d5 P 3a01ebd6b99640978d77190fe4da6f08 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3a01ebd6b99640978d77190fe4da6f08 (127.5.126.67). New cstate: current_term: 1 leader_uuid: "3a01ebd6b99640978d77190fe4da6f08" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6d026bb4a9146c395c2b8572753ffb7" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6070cdc51c6f49fcbcfbddd22a3c263c" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 41095 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3a01ebd6b99640978d77190fe4da6f08" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 45221 } health_report { overall_health: HEALTHY } } }
I20260709 13:23:30.212765 16432 consensus_queue.cc:260] T aab7ef362ab84369939a6a02d817aa53 P c6d026bb4a9146c395c2b8572753ffb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6d026bb4a9146c395c2b8572753ffb7" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34303 } } peers { permanent_uuid: "6070cdc51c6f49fcbcfbddd22a3c263c" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 41095 } } peers { permanent_uuid: "3a01ebd6b99640978d77190fe4da6f08" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 45221 } }
I20260709 13:23:30.215624 16432 ts_tablet_manager.cc:1434] T aab7ef362ab84369939a6a02d817aa53 P c6d026bb4a9146c395c2b8572753ffb7: Time spent starting tablet: real 0.008s	user 0.009s	sys 0.000s
I20260709 13:23:30.217218 16432 tablet_bootstrap.cc:492] T 4f5a2d88e89448648f594ef23ef152cd P c6d026bb4a9146c395c2b8572753ffb7: Bootstrap starting.
I20260709 13:23:30.217907 16431 tablet_bootstrap.cc:492] T cb70c02d0bce438cbb6434b2c0aa54ae P 3a01ebd6b99640978d77190fe4da6f08: No bootstrap required, opened a new log
I20260709 13:23:30.218668 16431 ts_tablet_manager.cc:1403] T cb70c02d0bce438cbb6434b2c0aa54ae P 3a01ebd6b99640978d77190fe4da6f08: Time spent bootstrapping tablet: real 0.097s	user 0.009s	sys 0.027s
I20260709 13:23:30.211952 16433 consensus_queue.cc:260] T b1e06a2952f94a919e5324bd1f0d7cab P 6070cdc51c6f49fcbcfbddd22a3c263c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6d026bb4a9146c395c2b8572753ffb7" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34303 } } peers { permanent_uuid: "6070cdc51c6f49fcbcfbddd22a3c263c" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 41095 } } peers { permanent_uuid: "3a01ebd6b99640978d77190fe4da6f08" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 45221 } }
I20260709 13:23:30.221767 16433 ts_tablet_manager.cc:1434] T b1e06a2952f94a919e5324bd1f0d7cab P 6070cdc51c6f49fcbcfbddd22a3c263c: Time spent starting tablet: real 0.023s	user 0.007s	sys 0.000s
I20260709 13:23:30.222877 16433 tablet_bootstrap.cc:492] T 5066abfe4261488f96534730b07ce4d5 P 6070cdc51c6f49fcbcfbddd22a3c263c: Bootstrap starting.
I20260709 13:23:30.223757 16431 raft_consensus.cc:359] T cb70c02d0bce438cbb6434b2c0aa54ae P 3a01ebd6b99640978d77190fe4da6f08 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6d026bb4a9146c395c2b8572753ffb7" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34303 } } peers { permanent_uuid: "6070cdc51c6f49fcbcfbddd22a3c263c" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 41095 } } peers { permanent_uuid: "3a01ebd6b99640978d77190fe4da6f08" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 45221 } }
I20260709 13:23:30.228170 16431 raft_consensus.cc:385] T cb70c02d0bce438cbb6434b2c0aa54ae P 3a01ebd6b99640978d77190fe4da6f08 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:23:30.228597 16431 raft_consensus.cc:740] T cb70c02d0bce438cbb6434b2c0aa54ae P 3a01ebd6b99640978d77190fe4da6f08 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3a01ebd6b99640978d77190fe4da6f08, State: Initialized, Role: FOLLOWER
I20260709 13:23:30.229187 16432 tablet_bootstrap.cc:654] T 4f5a2d88e89448648f594ef23ef152cd P c6d026bb4a9146c395c2b8572753ffb7: Neither blocks nor log segments found. Creating new log.
I20260709 13:23:30.233774 16440 raft_consensus.cc:493] T f55407f772b74aaba87440ba35c2ac8b P c6d026bb4a9146c395c2b8572753ffb7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:23:30.234587 16440 raft_consensus.cc:515] T f55407f772b74aaba87440ba35c2ac8b P c6d026bb4a9146c395c2b8572753ffb7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6d026bb4a9146c395c2b8572753ffb7" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34303 } } peers { permanent_uuid: "6070cdc51c6f49fcbcfbddd22a3c263c" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 41095 } } peers { permanent_uuid: "3a01ebd6b99640978d77190fe4da6f08" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 45221 } }
I20260709 13:23:30.237746 16440 leader_election.cc:290] T f55407f772b74aaba87440ba35c2ac8b P c6d026bb4a9146c395c2b8572753ffb7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6070cdc51c6f49fcbcfbddd22a3c263c (127.5.126.66:41095), 3a01ebd6b99640978d77190fe4da6f08 (127.5.126.67:45221)
I20260709 13:23:30.239044 16391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f55407f772b74aaba87440ba35c2ac8b" candidate_uuid: "c6d026bb4a9146c395c2b8572753ffb7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3a01ebd6b99640978d77190fe4da6f08" is_pre_election: true
I20260709 13:23:30.239984 16391 raft_consensus.cc:2468] T f55407f772b74aaba87440ba35c2ac8b P 3a01ebd6b99640978d77190fe4da6f08 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6d026bb4a9146c395c2b8572753ffb7 in term 0.
I20260709 13:23:30.241542 16433 tablet_bootstrap.cc:654] T 5066abfe4261488f96534730b07ce4d5 P 6070cdc51c6f49fcbcfbddd22a3c263c: Neither blocks nor log segments found. Creating new log.
I20260709 13:23:30.242007 16432 tablet_bootstrap.cc:492] T 4f5a2d88e89448648f594ef23ef152cd P c6d026bb4a9146c395c2b8572753ffb7: No bootstrap required, opened a new log
I20260709 13:23:30.242599 16432 ts_tablet_manager.cc:1403] T 4f5a2d88e89448648f594ef23ef152cd P c6d026bb4a9146c395c2b8572753ffb7: Time spent bootstrapping tablet: real 0.026s	user 0.016s	sys 0.003s
I20260709 13:23:30.242496 16315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f55407f772b74aaba87440ba35c2ac8b" candidate_uuid: "c6d026bb4a9146c395c2b8572753ffb7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6070cdc51c6f49fcbcfbddd22a3c263c" is_pre_election: true
I20260709 13:23:30.229751 16431 consensus_queue.cc:260] T cb70c02d0bce438cbb6434b2c0aa54ae P 3a01ebd6b99640978d77190fe4da6f08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6d026bb4a9146c395c2b8572753ffb7" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34303 } } peers { permanent_uuid: "6070cdc51c6f49fcbcfbddd22a3c263c" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 41095 } } peers { permanent_uuid: "3a01ebd6b99640978d77190fe4da6f08" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 45221 } }
I20260709 13:23:30.247018 16432 raft_consensus.cc:359] T 4f5a2d88e89448648f594ef23ef152cd P c6d026bb4a9146c395c2b8572753ffb7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6d026bb4a9146c395c2b8572753ffb7" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34303 } } peers { permanent_uuid: "3a01ebd6b99640978d77190fe4da6f08" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 45221 } } peers { permanent_uuid: "6070cdc51c6f49fcbcfbddd22a3c263c" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 41095 } }
I20260709 13:23:30.247991 16431 ts_tablet_manager.cc:1434] T cb70c02d0bce438cbb6434b2c0aa54ae P 3a01ebd6b99640978d77190fe4da6f08: Time spent starting tablet: real 0.029s	user 0.008s	sys 0.000s
I20260709 13:23:30.248217 16432 raft_consensus.cc:385] T 4f5a2d88e89448648f594ef23ef152cd P c6d026bb4a9146c395c2b8572753ffb7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:23:30.249099 16432 raft_consensus.cc:740] T 4f5a2d88e89448648f594ef23ef152cd P c6d026bb4a9146c395c2b8572753ffb7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c6d026bb4a9146c395c2b8572753ffb7, State: Initialized, Role: FOLLOWER
I20260709 13:23:30.249668 16431 tablet_bootstrap.cc:492] T 49ace918d4da4776b29f4aa41975e9ef P 3a01ebd6b99640978d77190fe4da6f08: Bootstrap starting.
I20260709 13:23:30.250420 16432 consensus_queue.cc:260] T 4f5a2d88e89448648f594ef23ef152cd P c6d026bb4a9146c395c2b8572753ffb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6d026bb4a9146c395c2b8572753ffb7" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34303 } } peers { permanent_uuid: "3a01ebd6b99640978d77190fe4da6f08" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 45221 } } peers { permanent_uuid: "6070cdc51c6f49fcbcfbddd22a3c263c" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 41095 } }
I20260709 13:23:30.248821 16206 leader_election.cc:304] T f55407f772b74aaba87440ba35c2ac8b P c6d026bb4a9146c395c2b8572753ffb7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3a01ebd6b99640978d77190fe4da6f08, c6d026bb4a9146c395c2b8572753ffb7; no voters: 
W20260709 13:23:30.252810 16206 leader_election.cc:343] T f55407f772b74aaba87440ba35c2ac8b P c6d026bb4a9146c395c2b8572753ffb7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6070cdc51c6f49fcbcfbddd22a3c263c (127.5.126.66:41095): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:23:30.253870 16440 raft_consensus.cc:2804] T f55407f772b74aaba87440ba35c2ac8b P c6d026bb4a9146c395c2b8572753ffb7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:23:30.254406 16440 raft_consensus.cc:493] T f55407f772b74aaba87440ba35c2ac8b P c6d026bb4a9146c395c2b8572753ffb7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:23:30.254801 16440 raft_consensus.cc:3060] T f55407f772b74aaba87440ba35c2ac8b P c6d026bb4a9146c395c2b8572753ffb7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:23:30.255996 16433 tablet_bootstrap.cc:492] T 5066abfe4261488f96534730b07ce4d5 P 6070cdc51c6f49fcbcfbddd22a3c263c: No bootstrap required, opened a new log
I20260709 13:23:30.256649 16433 ts_tablet_manager.cc:1403] T 5066abfe4261488f96534730b07ce4d5 P 6070cdc51c6f49fcbcfbddd22a3c263c: Time spent bootstrapping tablet: real 0.034s	user 0.020s	sys 0.000s
I20260709 13:23:30.258204 16431 tablet_bootstrap.cc:654] T 49ace918d4da4776b29f4aa41975e9ef P 3a01ebd6b99640978d77190fe4da6f08: Neither blocks nor log segments found. Creating new log.
I20260709 13:23:30.261408 16442 raft_consensus.cc:493] T 4f5a2d88e89448648f594ef23ef152cd P c6d026bb4a9146c395c2b8572753ffb7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:23:30.262243 16432 ts_tablet_manager.cc:1434] T 4f5a2d88e89448648f594ef23ef152cd P c6d026bb4a9146c395c2b8572753ffb7: Time spent starting tablet: real 0.019s	user 0.007s	sys 0.005s
I20260709 13:23:30.261934 16442 raft_consensus.cc:515] T 4f5a2d88e89448648f594ef23ef152cd P c6d026bb4a9146c395c2b8572753ffb7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6d026bb4a9146c395c2b8572753ffb7" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34303 } } peers { permanent_uuid: "3a01ebd6b99640978d77190fe4da6f08" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 45221 } } peers { permanent_uuid: "6070cdc51c6f49fcbcfbddd22a3c263c" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 41095 } }
I20260709 13:23:30.264386 16442 leader_election.cc:290] T 4f5a2d88e89448648f594ef23ef152cd P c6d026bb4a9146c395c2b8572753ffb7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3a01ebd6b99640978d77190fe4da6f08 (127.5.126.67:45221), 6070cdc51c6f49fcbcfbddd22a3c263c (127.5.126.66:41095)
I20260709 13:23:30.266727 16391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f5a2d88e89448648f594ef23ef152cd" candidate_uuid: "c6d026bb4a9146c395c2b8572753ffb7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3a01ebd6b99640978d77190fe4da6f08" is_pre_election: true
I20260709 13:23:30.267467 16315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f5a2d88e89448648f594ef23ef152cd" candidate_uuid: "c6d026bb4a9146c395c2b8572753ffb7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6070cdc51c6f49fcbcfbddd22a3c263c" is_pre_election: true
W20260709 13:23:30.268278 16206 leader_election.cc:343] T 4f5a2d88e89448648f594ef23ef152cd P c6d026bb4a9146c395c2b8572753ffb7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3a01ebd6b99640978d77190fe4da6f08 (127.5.126.67:45221): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:23:30.268491 16315 raft_consensus.cc:2468] T 4f5a2d88e89448648f594ef23ef152cd P 6070cdc51c6f49fcbcfbddd22a3c263c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6d026bb4a9146c395c2b8572753ffb7 in term 0.
I20260709 13:23:30.260561 16433 raft_consensus.cc:359] T 5066abfe4261488f96534730b07ce4d5 P 6070cdc51c6f49fcbcfbddd22a3c263c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6d026bb4a9146c395c2b8572753ffb7" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34303 } } peers { permanent_uuid: "6070cdc51c6f49fcbcfbddd22a3c263c" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 41095 } } peers { permanent_uuid: "3a01ebd6b99640978d77190fe4da6f08" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 45221 } }
I20260709 13:23:30.270058 16206 leader_election.cc:304] T 4f5a2d88e89448648f594ef23ef152cd P c6d026bb4a9146c395c2b8572753ffb7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6070cdc51c6f49fcbcfbddd22a3c263c, c6d026bb4a9146c395c2b8572753ffb7; no voters: 3a01ebd6b99640978d77190fe4da6f08
I20260709 13:23:30.270520 16432 tablet_bootstrap.cc:492] T 49ace918d4da4776b29f4aa41975e9ef P c6d026bb4a9146c395c2b8572753ffb7: Bootstrap starting.
I20260709 13:23:30.271209 16442 raft_consensus.cc:2804] T 4f5a2d88e89448648f594ef23ef152cd P c6d026bb4a9146c395c2b8572753ffb7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:23:30.271839 16442 raft_consensus.cc:493] T 4f5a2d88e89448648f594ef23ef152cd P c6d026bb4a9146c395c2b8572753ffb7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:23:30.272228 16442 raft_consensus.cc:3060] T 4f5a2d88e89448648f594ef23ef152cd P c6d026bb4a9146c395c2b8572753ffb7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:23:30.278403 16432 tablet_bootstrap.cc:654] T 49ace918d4da4776b29f4aa41975e9ef P c6d026bb4a9146c395c2b8572753ffb7: Neither blocks nor log segments found. Creating new log.
I20260709 13:23:30.269330 16433 raft_consensus.cc:385] T 5066abfe4261488f96534730b07ce4d5 P 6070cdc51c6f49fcbcfbddd22a3c263c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:23:30.280467 16433 raft_consensus.cc:740] T 5066abfe4261488f96534730b07ce4d5 P 6070cdc51c6f49fcbcfbddd22a3c263c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6070cdc51c6f49fcbcfbddd22a3c263c, State: Initialized, Role: FOLLOWER
I20260709 13:23:30.281535 16433 consensus_queue.cc:260] T 5066abfe4261488f96534730b07ce4d5 P 6070cdc51c6f49fcbcfbddd22a3c263c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6d026bb4a9146c395c2b8572753ffb7" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34303 } } peers { permanent_uuid: "6070cdc51c6f49fcbcfbddd22a3c263c" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 41095 } } peers { permanent_uuid: "3a01ebd6b99640978d77190fe4da6f08" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 45221 } }
I20260709 13:23:30.289132 16433 ts_tablet_manager.cc:1434] T 5066abfe4261488f96534730b07ce4d5 P 6070cdc51c6f49fcbcfbddd22a3c263c: Time spent starting tablet: real 0.032s	user 0.007s	sys 0.001s
I20260709 13:23:30.288220 16139 catalog_manager.cc:5697] T 88caca305bf74120a011e3fa92781678 P 3a01ebd6b99640978d77190fe4da6f08 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3a01ebd6b99640978d77190fe4da6f08 (127.5.126.67). New cstate: current_term: 1 leader_uuid: "3a01ebd6b99640978d77190fe4da6f08" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6d026bb4a9146c395c2b8572753ffb7" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6070cdc51c6f49fcbcfbddd22a3c263c" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 41095 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3a01ebd6b99640978d77190fe4da6f08" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 45221 } health_report { overall_health: HEALTHY } } }
I20260709 13:23:30.290170 16433 tablet_bootstrap.cc:492] T fd931932596f4755aeae878c0fe3c2d9 P 6070cdc51c6f49fcbcfbddd22a3c263c: Bootstrap starting.
I20260709 13:23:30.291613 16432 tablet_bootstrap.cc:492] T 49ace918d4da4776b29f4aa41975e9ef P c6d026bb4a9146c395c2b8572753ffb7: No bootstrap required, opened a new log
I20260709 13:23:30.292268 16432 ts_tablet_manager.cc:1403] T 49ace918d4da4776b29f4aa41975e9ef P c6d026bb4a9146c395c2b8572753ffb7: Time spent bootstrapping tablet: real 0.022s	user 0.006s	sys 0.013s
I20260709 13:23:30.292323 16442 raft_consensus.cc:515] T 4f5a2d88e89448648f594ef23ef152cd P c6d026bb4a9146c395c2b8572753ffb7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6d026bb4a9146c395c2b8572753ffb7" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34303 } } peers { permanent_uuid: "3a01ebd6b99640978d77190fe4da6f08" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 45221 } } peers { permanent_uuid: "6070cdc51c6f49fcbcfbddd22a3c263c" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 41095 } }
I20260709 13:23:30.295749 16391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f5a2d88e89448648f594ef23ef152cd" candidate_uuid: "c6d026bb4a9146c395c2b8572753ffb7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3a01ebd6b99640978d77190fe4da6f08"
I20260709 13:23:30.297254 16433 tablet_bootstrap.cc:654] T fd931932596f4755aeae878c0fe3c2d9 P 6070cdc51c6f49fcbcfbddd22a3c263c: Neither blocks nor log segments found. Creating new log.
W20260709 13:23:30.297412 16206 leader_election.cc:343] T 4f5a2d88e89448648f594ef23ef152cd P c6d026bb4a9146c395c2b8572753ffb7 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3a01ebd6b99640978d77190fe4da6f08 (127.5.126.67:45221): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:23:30.301476 16442 leader_election.cc:290] T 4f5a2d88e89448648f594ef23ef152cd P c6d026bb4a9146c395c2b8572753ffb7 [CANDIDATE]: Term 1 election: Requested vote from peers 3a01ebd6b99640978d77190fe4da6f08 (127.5.126.67:45221), 6070cdc51c6f49fcbcfbddd22a3c263c (127.5.126.66:41095)
I20260709 13:23:30.301626 16315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f5a2d88e89448648f594ef23ef152cd" candidate_uuid: "c6d026bb4a9146c395c2b8572753ffb7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6070cdc51c6f49fcbcfbddd22a3c263c"
I20260709 13:23:30.295598 16432 raft_consensus.cc:359] T 49ace918d4da4776b29f4aa41975e9ef P c6d026bb4a9146c395c2b8572753ffb7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6d026bb4a9146c395c2b8572753ffb7" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34303 } } peers { permanent_uuid: "6070cdc51c6f49fcbcfbddd22a3c263c" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 41095 } } peers { permanent_uuid: "3a01ebd6b99640978d77190fe4da6f08" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 45221 } }
I20260709 13:23:30.302605 16315 raft_consensus.cc:3060] T 4f5a2d88e89448648f594ef23ef152cd P 6070cdc51c6f49fcbcfbddd22a3c263c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:23:30.303107 16432 raft_consensus.cc:385] T 49ace918d4da4776b29f4aa41975e9ef P c6d026bb4a9146c395c2b8572753ffb7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:23:30.303582 16432 raft_consensus.cc:740] T 49ace918d4da4776b29f4aa41975e9ef P c6d026bb4a9146c395c2b8572753ffb7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c6d026bb4a9146c395c2b8572753ffb7, State: Initialized, Role: FOLLOWER
I20260709 13:23:30.304378 16432 consensus_queue.cc:260] T 49ace918d4da4776b29f4aa41975e9ef P c6d026bb4a9146c395c2b8572753ffb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6d026bb4a9146c395c2b8572753ffb7" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34303 } } peers { permanent_uuid: "6070cdc51c6f49fcbcfbddd22a3c263c" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 41095 } } peers { permanent_uuid: "3a01ebd6b99640978d77190fe4da6f08" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 45221 } }
I20260709 13:23:30.306368 16432 ts_tablet_manager.cc:1434] T 49ace918d4da4776b29f4aa41975e9ef P c6d026bb4a9146c395c2b8572753ffb7: Time spent starting tablet: real 0.014s	user 0.005s	sys 0.000s
I20260709 13:23:30.308800 16433 tablet_bootstrap.cc:492] T fd931932596f4755aeae878c0fe3c2d9 P 6070cdc51c6f49fcbcfbddd22a3c263c: No bootstrap required, opened a new log
I20260709 13:23:30.309429 16433 ts_tablet_manager.cc:1403] T fd931932596f4755aeae878c0fe3c2d9 P 6070cdc51c6f49fcbcfbddd22a3c263c: Time spent bootstrapping tablet: real 0.019s	user 0.012s	sys 0.003s
I20260709 13:23:30.312613 16433 raft_consensus.cc:359] T fd931932596f4755aeae878c0fe3c2d9 P 6070cdc51c6f49fcbcfbddd22a3c263c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6d026bb4a9146c395c2b8572753ffb7" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34303 } } peers { permanent_uuid: "6070cdc51c6f49fcbcfbddd22a3c263c" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 41095 } } peers { permanent_uuid: "3a01ebd6b99640978d77190fe4da6f08" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 45221 } }
I20260709 13:23:30.313407 16433 raft_consensus.cc:385] T fd931932596f4755aeae878c0fe3c2d9 P 6070cdc51c6f49fcbcfbddd22a3c263c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:23:30.313763 16433 raft_consensus.cc:740] T fd931932596f4755aeae878c0fe3c2d9 P 6070cdc51c6f49fcbcfbddd22a3c263c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6070cdc51c6f49fcbcfbddd22a3c263c, State: Initialized, Role: FOLLOWER
I20260709 13:23:30.314575 16315 raft_consensus.cc:2468] T 4f5a2d88e89448648f594ef23ef152cd P 6070cdc51c6f49fcbcfbddd22a3c263c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6d026bb4a9146c395c2b8572753ffb7 in term 1.
I20260709 13:23:30.316443 16206 leader_election.cc:304] T 4f5a2d88e89448648f594ef23ef152cd P c6d026bb4a9146c395c2b8572753ffb7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6070cdc51c6f49fcbcfbddd22a3c263c, c6d026bb4a9146c395c2b8572753ffb7; no voters: 3a01ebd6b99640978d77190fe4da6f08
I20260709 13:23:30.314605 16433 consensus_queue.cc:260] T fd931932596f4755aeae878c0fe3c2d9 P 6070cdc51c6f49fcbcfbddd22a3c263c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6d026bb4a9146c395c2b8572753ffb7" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34303 } } peers { permanent_uuid: "6070cdc51c6f49fcbcfbddd22a3c263c" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 41095 } } peers { permanent_uuid: "3a01ebd6b99640978d77190fe4da6f08" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 45221 } }
I20260709 13:23:30.317771 16442 raft_consensus.cc:2804] T 4f5a2d88e89448648f594ef23ef152cd P c6d026bb4a9146c395c2b8572753ffb7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:23:30.319449 16433 ts_tablet_manager.cc:1434] T fd931932596f4755aeae878c0fe3c2d9 P 6070cdc51c6f49fcbcfbddd22a3c263c: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 13:23:30.319664 16432 tablet_bootstrap.cc:492] T b0313caec0564fd5bf22e34524632537 P c6d026bb4a9146c395c2b8572753ffb7: Bootstrap starting.
I20260709 13:23:30.321110 16433 tablet_bootstrap.cc:492] T 49ace918d4da4776b29f4aa41975e9ef P 6070cdc51c6f49fcbcfbddd22a3c263c: Bootstrap starting.
I20260709 13:23:30.324214 16440 raft_consensus.cc:515] T f55407f772b74aaba87440ba35c2ac8b P c6d026bb4a9146c395c2b8572753ffb7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6d026bb4a9146c395c2b8572753ffb7" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34303 } } peers { permanent_uuid: "6070cdc51c6f49fcbcfbddd22a3c263c" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 41095 } } peers { permanent_uuid: "3a01ebd6b99640978d77190fe4da6f08" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 45221 } }
I20260709 13:23:30.328006 16477 raft_consensus.cc:493] T aab7ef362ab84369939a6a02d817aa53 P c6d026bb4a9146c395c2b8572753ffb7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:23:30.326434 16442 raft_consensus.cc:697] T 4f5a2d88e89448648f594ef23ef152cd P c6d026bb4a9146c395c2b8572753ffb7 [term 1 LEADER]: Becoming Leader. State: Replica: c6d026bb4a9146c395c2b8572753ffb7, State: Running, Role: LEADER
I20260709 13:23:30.333029 16442 consensus_queue.cc:237] T 4f5a2d88e89448648f594ef23ef152cd P c6d026bb4a9146c395c2b8572753ffb7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6d026bb4a9146c395c2b8572753ffb7" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34303 } } peers { permanent_uuid: "3a01ebd6b99640978d77190fe4da6f08" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 45221 } } peers { permanent_uuid: "6070cdc51c6f49fcbcfbddd22a3c263c" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 41095 } }
I20260709 13:23:30.334532 16432 tablet_bootstrap.cc:654] T b0313caec0564fd5bf22e34524632537 P c6d026bb4a9146c395c2b8572753ffb7: Neither blocks nor log segments found. Creating new log.
I20260709 13:23:30.335614 16433 tablet_bootstrap.cc:654] T 49ace918d4da4776b29f4aa41975e9ef P 6070cdc51c6f49fcbcfbddd22a3c263c: Neither blocks nor log segments found. Creating new log.
I20260709 13:23:30.343252 16315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f55407f772b74aaba87440ba35c2ac8b" candidate_uuid: "c6d026bb4a9146c395c2b8572753ffb7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6070cdc51c6f49fcbcfbddd22a3c263c"
W20260709 13:23:30.345364 16206 leader_election.cc:343] T f55407f772b74aaba87440ba35c2ac8b P c6d026bb4a9146c395c2b8572753ffb7 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6070cdc51c6f49fcbcfbddd22a3c263c (127.5.126.66:41095): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:23:30.329208 16477 raft_consensus.cc:515] T aab7ef362ab84369939a6a02d817aa53 P c6d026bb4a9146c395c2b8572753ffb7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6d026bb4a9146c395c2b8572753ffb7" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34303 } } peers { permanent_uuid: "6070cdc51c6f49fcbcfbddd22a3c263c" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 41095 } } peers { permanent_uuid: "3a01ebd6b99640978d77190fe4da6f08" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 45221 } }
I20260709 13:23:30.350178 16440 leader_election.cc:290] T f55407f772b74aaba87440ba35c2ac8b P c6d026bb4a9146c395c2b8572753ffb7 [CANDIDATE]: Term 1 election: Requested vote from peers 6070cdc51c6f49fcbcfbddd22a3c263c (127.5.126.66:41095), 3a01ebd6b99640978d77190fe4da6f08 (127.5.126.67:45221)
I20260709 13:23:30.351305 16477 leader_election.cc:290] T aab7ef362ab84369939a6a02d817aa53 P c6d026bb4a9146c395c2b8572753ffb7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6070cdc51c6f49fcbcfbddd22a3c263c (127.5.126.66:41095), 3a01ebd6b99640978d77190fe4da6f08 (127.5.126.67:45221)
I20260709 13:23:30.352725 16431 tablet_bootstrap.cc:492] T 49ace918d4da4776b29f4aa41975e9ef P 3a01ebd6b99640978d77190fe4da6f08: No bootstrap required, opened a new log
I20260709 13:23:30.353509 16431 ts_tablet_manager.cc:1403] T 49ace918d4da4776b29f4aa41975e9ef P 3a01ebd6b99640978d77190fe4da6f08: Time spent bootstrapping tablet: real 0.104s	user 0.034s	sys 0.038s
I20260709 13:23:30.353271 16391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f55407f772b74aaba87440ba35c2ac8b" candidate_uuid: "c6d026bb4a9146c395c2b8572753ffb7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3a01ebd6b99640978d77190fe4da6f08"
I20260709 13:23:30.354315 16391 raft_consensus.cc:3060] T f55407f772b74aaba87440ba35c2ac8b P 3a01ebd6b99640978d77190fe4da6f08 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:23:30.356285 16315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aab7ef362ab84369939a6a02d817aa53" candidate_uuid: "c6d026bb4a9146c395c2b8572753ffb7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6070cdc51c6f49fcbcfbddd22a3c263c" is_pre_election: true
I20260709 13:23:30.357429 16432 tablet_bootstrap.cc:492] T b0313caec0564fd5bf22e34524632537 P c6d026bb4a9146c395c2b8572753ffb7: No bootstrap required, opened a new log
I20260709 13:23:30.358258 16432 ts_tablet_manager.cc:1403] T b0313caec0564fd5bf22e34524632537 P c6d026bb4a9146c395c2b8572753ffb7: Time spent bootstrapping tablet: real 0.039s	user 0.008s	sys 0.015s
I20260709 13:23:30.357947 16390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aab7ef362ab84369939a6a02d817aa53" candidate_uuid: "c6d026bb4a9146c395c2b8572753ffb7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3a01ebd6b99640978d77190fe4da6f08" is_pre_election: true
I20260709 13:23:30.361766 16432 raft_consensus.cc:359] T b0313caec0564fd5bf22e34524632537 P c6d026bb4a9146c395c2b8572753ffb7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6d026bb4a9146c395c2b8572753ffb7" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34303 } } peers { permanent_uuid: "6070cdc51c6f49fcbcfbddd22a3c263c" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 41095 } } peers { permanent_uuid: "3a01ebd6b99640978d77190fe4da6f08" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 45221 } }
I20260709 13:23:30.362617 16432 raft_consensus.cc:385] T b0313caec0564fd5bf22e34524632537 P c6d026bb4a9146c395c2b8572753ffb7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:23:30.362951 16432 raft_consensus.cc:740] T b0313caec0564fd5bf22e34524632537 P c6d026bb4a9146c395c2b8572753ffb7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c6d026bb4a9146c395c2b8572753ffb7, State: Initialized, Role: FOLLOWER
W20260709 13:23:30.363814 16206 leader_election.cc:343] T aab7ef362ab84369939a6a02d817aa53 P c6d026bb4a9146c395c2b8572753ffb7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3a01ebd6b99640978d77190fe4da6f08 (127.5.126.67:45221): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:23:30.363864 16432 consensus_queue.cc:260] T b0313caec0564fd5bf22e34524632537 P c6d026bb4a9146c395c2b8572753ffb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6d026bb4a9146c395c2b8572753ffb7" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34303 } } peers { permanent_uuid: "6070cdc51c6f49fcbcfbddd22a3c263c" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 41095 } } peers { permanent_uuid: "3a01ebd6b99640978d77190fe4da6f08" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 45221 } }
W20260709 13:23:30.365202 16206 leader_election.cc:343] T aab7ef362ab84369939a6a02d817aa53 P c6d026bb4a9146c395c2b8572753ffb7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6070cdc51c6f49fcbcfbddd22a3c263c (127.5.126.66:41095): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:23:30.365795 16206 leader_election.cc:304] T aab7ef362ab84369939a6a02d817aa53 P c6d026bb4a9146c395c2b8572753ffb7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6d026bb4a9146c395c2b8572753ffb7; no voters: 3a01ebd6b99640978d77190fe4da6f08, 6070cdc51c6f49fcbcfbddd22a3c263c
I20260709 13:23:30.366976 16477 raft_consensus.cc:2749] T aab7ef362ab84369939a6a02d817aa53 P c6d026bb4a9146c395c2b8572753ffb7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:23:30.367203 16432 ts_tablet_manager.cc:1434] T b0313caec0564fd5bf22e34524632537 P c6d026bb4a9146c395c2b8572753ffb7: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 13:23:30.368541 16432 tablet_bootstrap.cc:492] T b1e06a2952f94a919e5324bd1f0d7cab P c6d026bb4a9146c395c2b8572753ffb7: Bootstrap starting.
I20260709 13:23:30.370082 16431 raft_consensus.cc:359] T 49ace918d4da4776b29f4aa41975e9ef P 3a01ebd6b99640978d77190fe4da6f08 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6d026bb4a9146c395c2b8572753ffb7" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34303 } } peers { permanent_uuid: "6070cdc51c6f49fcbcfbddd22a3c263c" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 41095 } } peers { permanent_uuid: "3a01ebd6b99640978d77190fe4da6f08" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 45221 } }
I20260709 13:23:30.371589 16431 raft_consensus.cc:385] T 49ace918d4da4776b29f4aa41975e9ef P 3a01ebd6b99640978d77190fe4da6f08 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:23:30.371042 16391 raft_consensus.cc:2468] T f55407f772b74aaba87440ba35c2ac8b P 3a01ebd6b99640978d77190fe4da6f08 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6d026bb4a9146c395c2b8572753ffb7 in term 1.
I20260709 13:23:30.372009 16431 raft_consensus.cc:740] T 49ace918d4da4776b29f4aa41975e9ef P 3a01ebd6b99640978d77190fe4da6f08 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3a01ebd6b99640978d77190fe4da6f08, State: Initialized, Role: FOLLOWER
I20260709 13:23:30.373369 16206 leader_election.cc:304] T f55407f772b74aaba87440ba35c2ac8b P c6d026bb4a9146c395c2b8572753ffb7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3a01ebd6b99640978d77190fe4da6f08, c6d026bb4a9146c395c2b8572753ffb7; no voters: 6070cdc51c6f49fcbcfbddd22a3c263c
I20260709 13:23:30.380172 16477 raft_consensus.cc:2804] T f55407f772b74aaba87440ba35c2ac8b P c6d026bb4a9146c395c2b8572753ffb7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:23:30.377978 16432 tablet_bootstrap.cc:654] T b1e06a2952f94a919e5324bd1f0d7cab P c6d026bb4a9146c395c2b8572753ffb7: Neither blocks nor log segments found. Creating new log.
I20260709 13:23:30.380947 16477 raft_consensus.cc:697] T f55407f772b74aaba87440ba35c2ac8b P c6d026bb4a9146c395c2b8572753ffb7 [term 1 LEADER]: Becoming Leader. State: Replica: c6d026bb4a9146c395c2b8572753ffb7, State: Running, Role: LEADER
I20260709 13:23:30.382004 16477 consensus_queue.cc:237] T f55407f772b74aaba87440ba35c2ac8b P c6d026bb4a9146c395c2b8572753ffb7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6d026bb4a9146c395c2b8572753ffb7" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34303 } } peers { permanent_uuid: "6070cdc51c6f49fcbcfbddd22a3c263c" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 41095 } } peers { permanent_uuid: "3a01ebd6b99640978d77190fe4da6f08" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 45221 } }
I20260709 13:23:30.377691 16433 tablet_bootstrap.cc:492] T 49ace918d4da4776b29f4aa41975e9ef P 6070cdc51c6f49fcbcfbddd22a3c263c: No bootstrap required, opened a new log
I20260709 13:23:30.386576 16433 ts_tablet_manager.cc:1403] T 49ace918d4da4776b29f4aa41975e9ef P 6070cdc51c6f49fcbcfbddd22a3c263c: Time spent bootstrapping tablet: real 0.066s	user 0.010s	sys 0.040s
I20260709 13:23:30.386323 16431 consensus_queue.cc:260] T 49ace918d4da4776b29f4aa41975e9ef P 3a01ebd6b99640978d77190fe4da6f08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6d026bb4a9146c395c2b8572753ffb7" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34303 } } peers { permanent_uuid: "6070cdc51c6f49fcbcfbddd22a3c263c" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 41095 } } peers { permanent_uuid: "3a01ebd6b99640978d77190fe4da6f08" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 45221 } }
I20260709 13:23:30.390239 16433 raft_consensus.cc:359] T 49ace918d4da4776b29f4aa41975e9ef P 6070cdc51c6f49fcbcfbddd22a3c263c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6d026bb4a9146c395c2b8572753ffb7" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34303 } } peers { permanent_uuid: "6070cdc51c6f49fcbcfbddd22a3c263c" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 41095 } } peers { permanent_uuid: "3a01ebd6b99640978d77190fe4da6f08" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 45221 } }
I20260709 13:23:30.390847 16433 raft_consensus.cc:385] T 49ace918d4da4776b29f4aa41975e9ef P 6070cdc51c6f49fcbcfbddd22a3c263c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:23:30.391089 16433 raft_consensus.cc:740] T 49ace918d4da4776b29f4aa41975e9ef P 6070cdc51c6f49fcbcfbddd22a3c263c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6070cdc51c6f49fcbcfbddd22a3c263c, State: Initialized, Role: FOLLOWER
I20260709 13:23:30.392141 16433 consensus_queue.cc:260] T 49ace918d4da4776b29f4aa41975e9ef P 6070cdc51c6f49fcbcfbddd22a3c263c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6d026bb4a9146c395c2b8572753ffb7" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34303 } } peers { permanent_uuid: "6070cdc51c6f49fcbcfbddd22a3c263c" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 41095 } } peers { permanent_uuid: "3a01ebd6b99640978d77190fe4da6f08" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 45221 } }
I20260709 13:23:30.394932 16431 ts_tablet_manager.cc:1434] T 49ace918d4da4776b29f4aa41975e9ef P 3a01ebd6b99640978d77190fe4da6f08: Time spent starting tablet: real 0.041s	user 0.005s	sys 0.004s
I20260709 13:23:30.396832 16433 ts_tablet_manager.cc:1434] T 49ace918d4da4776b29f4aa41975e9ef P 6070cdc51c6f49fcbcfbddd22a3c263c: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.003s
I20260709 13:23:30.396916 16431 tablet_bootstrap.cc:492] T b0313caec0564fd5bf22e34524632537 P 3a01ebd6b99640978d77190fe4da6f08: Bootstrap starting.
I20260709 13:23:30.398402 16433 tablet_bootstrap.cc:492] T f55407f772b74aaba87440ba35c2ac8b P 6070cdc51c6f49fcbcfbddd22a3c263c: Bootstrap starting.
I20260709 13:23:30.403194 16432 tablet_bootstrap.cc:492] T b1e06a2952f94a919e5324bd1f0d7cab P c6d026bb4a9146c395c2b8572753ffb7: No bootstrap required, opened a new log
I20260709 13:23:30.403995 16432 ts_tablet_manager.cc:1403] T b1e06a2952f94a919e5324bd1f0d7cab P c6d026bb4a9146c395c2b8572753ffb7: Time spent bootstrapping tablet: real 0.036s	user 0.028s	sys 0.000s
I20260709 13:23:30.446834 16439 raft_consensus.cc:493] T cb70c02d0bce438cbb6434b2c0aa54ae P 6070cdc51c6f49fcbcfbddd22a3c263c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:23:30.446513 16457 raft_consensus.cc:493] T cb70c02d0bce438cbb6434b2c0aa54ae P 3a01ebd6b99640978d77190fe4da6f08 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:23:30.454101 16439 raft_consensus.cc:515] T cb70c02d0bce438cbb6434b2c0aa54ae P 6070cdc51c6f49fcbcfbddd22a3c263c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6d026bb4a9146c395c2b8572753ffb7" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34303 } } peers { permanent_uuid: "6070cdc51c6f49fcbcfbddd22a3c263c" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 41095 } } peers { permanent_uuid: "3a01ebd6b99640978d77190fe4da6f08" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 45221 } }
I20260709 13:23:30.450402 16457 raft_consensus.cc:515] T cb70c02d0bce438cbb6434b2c0aa54ae P 3a01ebd6b99640978d77190fe4da6f08 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6d026bb4a9146c395c2b8572753ffb7" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34303 } } peers { permanent_uuid: "6070cdc51c6f49fcbcfbddd22a3c263c" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 41095 } } peers { permanent_uuid: "3a01ebd6b99640978d77190fe4da6f08" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 45221 } }
I20260709 13:23:30.457314 16140 catalog_manager.cc:5697] T 4f5a2d88e89448648f594ef23ef152cd P c6d026bb4a9146c395c2b8572753ffb7 reported cstate change: term changed from 0 to 1, leader changed from <none> to c6d026bb4a9146c395c2b8572753ffb7 (127.5.126.65). New cstate: current_term: 1 leader_uuid: "c6d026bb4a9146c395c2b8572753ffb7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6d026bb4a9146c395c2b8572753ffb7" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34303 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3a01ebd6b99640978d77190fe4da6f08" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 45221 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6070cdc51c6f49fcbcfbddd22a3c263c" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 41095 } health_report { overall_health: UNKNOWN } } }
I20260709 13:23:30.465652 16433 tablet_bootstrap.cc:654] T f55407f772b74aaba87440ba35c2ac8b P 6070cdc51c6f49fcbcfbddd22a3c263c: Neither blocks nor log segments found. Creating new log.
I20260709 13:23:30.465122 16432 raft_consensus.cc:359] T b1e06a2952f94a919e5324bd1f0d7cab P c6d026bb4a9146c395c2b8572753ffb7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6d026bb4a9146c395c2b8572753ffb7" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34303 } } peers { permanent_uuid: "6070cdc51c6f49fcbcfbddd22a3c263c" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 41095 } } peers { permanent_uuid: "3a01ebd6b99640978d77190fe4da6f08" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 45221 } }
I20260709 13:23:30.466876 16432 raft_consensus.cc:385] T b1e06a2952f94a919e5324bd1f0d7cab P c6d026bb4a9146c395c2b8572753ffb7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:23:30.467542 16432 raft_consensus.cc:740] T b1e06a2952f94a919e5324bd1f0d7cab P c6d026bb4a9146c395c2b8572753ffb7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c6d026bb4a9146c395c2b8572753ffb7, State: Initialized, Role: FOLLOWER
I20260709 13:23:30.467216 16242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb70c02d0bce438cbb6434b2c0aa54ae" candidate_uuid: "3a01ebd6b99640978d77190fe4da6f08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6d026bb4a9146c395c2b8572753ffb7" is_pre_election: true
I20260709 13:23:30.468832 16242 raft_consensus.cc:2468] T cb70c02d0bce438cbb6434b2c0aa54ae P c6d026bb4a9146c395c2b8572753ffb7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3a01ebd6b99640978d77190fe4da6f08 in term 0.
I20260709 13:23:30.470808 16355 leader_election.cc:304] T cb70c02d0bce438cbb6434b2c0aa54ae P 3a01ebd6b99640978d77190fe4da6f08 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3a01ebd6b99640978d77190fe4da6f08, c6d026bb4a9146c395c2b8572753ffb7; no voters: 
I20260709 13:23:30.470662 16432 consensus_queue.cc:260] T b1e06a2952f94a919e5324bd1f0d7cab P c6d026bb4a9146c395c2b8572753ffb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6d026bb4a9146c395c2b8572753ffb7" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34303 } } peers { permanent_uuid: "6070cdc51c6f49fcbcfbddd22a3c263c" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 41095 } } peers { permanent_uuid: "3a01ebd6b99640978d77190fe4da6f08" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 45221 } }
I20260709 13:23:30.472596 16435 raft_consensus.cc:2804] T cb70c02d0bce438cbb6434b2c0aa54ae P 3a01ebd6b99640978d77190fe4da6f08 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:23:30.473136 16435 raft_consensus.cc:493] T cb70c02d0bce438cbb6434b2c0aa54ae P 3a01ebd6b99640978d77190fe4da6f08 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:23:30.473563 16435 raft_consensus.cc:3060] T cb70c02d0bce438cbb6434b2c0aa54ae P 3a01ebd6b99640978d77190fe4da6f08 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:23:30.476701 16457 leader_election.cc:290] T cb70c02d0bce438cbb6434b2c0aa54ae P 3a01ebd6b99640978d77190fe4da6f08 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c6d026bb4a9146c395c2b8572753ffb7 (127.5.126.65:34303), 6070cdc51c6f49fcbcfbddd22a3c263c (127.5.126.66:41095)
I20260709 13:23:30.476909 16432 ts_tablet_manager.cc:1434] T b1e06a2952f94a919e5324bd1f0d7cab P c6d026bb4a9146c395c2b8572753ffb7: Time spent starting tablet: real 0.072s	user 0.010s	sys 0.006s
I20260709 13:23:30.483690 16439 leader_election.cc:290] T cb70c02d0bce438cbb6434b2c0aa54ae P 6070cdc51c6f49fcbcfbddd22a3c263c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c6d026bb4a9146c395c2b8572753ffb7 (127.5.126.65:34303), 3a01ebd6b99640978d77190fe4da6f08 (127.5.126.67:45221)
I20260709 13:23:30.484694 16439 raft_consensus.cc:493] T 5066abfe4261488f96534730b07ce4d5 P 6070cdc51c6f49fcbcfbddd22a3c263c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:23:30.485780 16439 raft_consensus.cc:515] T 5066abfe4261488f96534730b07ce4d5 P 6070cdc51c6f49fcbcfbddd22a3c263c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6d026bb4a9146c395c2b8572753ffb7" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34303 } } peers { permanent_uuid: "6070cdc51c6f49fcbcfbddd22a3c263c" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 41095 } } peers { permanent_uuid: "3a01ebd6b99640978d77190fe4da6f08" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 45221 } }
I20260709 13:23:30.487123 16315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb70c02d0bce438cbb6434b2c0aa54ae" candidate_uuid: "3a01ebd6b99640978d77190fe4da6f08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6070cdc51c6f49fcbcfbddd22a3c263c" is_pre_election: true
I20260709 13:23:30.488730 16439 leader_election.cc:290] T 5066abfe4261488f96534730b07ce4d5 P 6070cdc51c6f49fcbcfbddd22a3c263c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c6d026bb4a9146c395c2b8572753ffb7 (127.5.126.65:34303), 3a01ebd6b99640978d77190fe4da6f08 (127.5.126.67:45221)
I20260709 13:23:30.454101 16431 tablet_bootstrap.cc:654] T b0313caec0564fd5bf22e34524632537 P 3a01ebd6b99640978d77190fe4da6f08: Neither blocks nor log segments found. Creating new log.
I20260709 13:23:30.487964 16315 raft_consensus.cc:2468] T cb70c02d0bce438cbb6434b2c0aa54ae P 6070cdc51c6f49fcbcfbddd22a3c263c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3a01ebd6b99640978d77190fe4da6f08 in term 0.
I20260709 13:23:30.504622 16242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb70c02d0bce438cbb6434b2c0aa54ae" candidate_uuid: "6070cdc51c6f49fcbcfbddd22a3c263c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6d026bb4a9146c395c2b8572753ffb7" is_pre_election: true
I20260709 13:23:30.505251 16433 tablet_bootstrap.cc:492] T f55407f772b74aaba87440ba35c2ac8b P 6070cdc51c6f49fcbcfbddd22a3c263c: No bootstrap required, opened a new log
I20260709 13:23:30.505717 16242 raft_consensus.cc:2468] T cb70c02d0bce438cbb6434b2c0aa54ae P c6d026bb4a9146c395c2b8572753ffb7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6070cdc51c6f49fcbcfbddd22a3c263c in term 0.
I20260709 13:23:30.505825 16140 catalog_manager.cc:5697] T f55407f772b74aaba87440ba35c2ac8b P c6d026bb4a9146c395c2b8572753ffb7 reported cstate change: term changed from 0 to 1, leader changed from <none> to c6d026bb4a9146c395c2b8572753ffb7 (127.5.126.65). New cstate: current_term: 1 leader_uuid: "c6d026bb4a9146c395c2b8572753ffb7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6d026bb4a9146c395c2b8572753ffb7" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34303 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6070cdc51c6f49fcbcfbddd22a3c263c" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 41095 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3a01ebd6b99640978d77190fe4da6f08" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 45221 } health_report { overall_health: UNKNOWN } } }
I20260709 13:23:30.507920 16431 tablet_bootstrap.cc:492] T b0313caec0564fd5bf22e34524632537 P 3a01ebd6b99640978d77190fe4da6f08: No bootstrap required, opened a new log
I20260709 13:23:30.508467 16477 raft_consensus.cc:493] T b1e06a2952f94a919e5324bd1f0d7cab P c6d026bb4a9146c395c2b8572753ffb7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:23:30.508833 16431 ts_tablet_manager.cc:1403] T b0313caec0564fd5bf22e34524632537 P 3a01ebd6b99640978d77190fe4da6f08: Time spent bootstrapping tablet: real 0.112s	user 0.012s	sys 0.008s
I20260709 13:23:30.509099 16477 raft_consensus.cc:515] T b1e06a2952f94a919e5324bd1f0d7cab P c6d026bb4a9146c395c2b8572753ffb7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6d026bb4a9146c395c2b8572753ffb7" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34303 } } peers { permanent_uuid: "6070cdc51c6f49fcbcfbddd22a3c263c" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 41095 } } peers { permanent_uuid: "3a01ebd6b99640978d77190fe4da6f08" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 45221 } }
I20260709 13:23:30.510221 16391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb70c02d0bce438cbb6434b2c0aa54ae" candidate_uuid: "6070cdc51c6f49fcbcfbddd22a3c263c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3a01ebd6b99640978d77190fe4da6f08" is_pre_election: true
I20260709 13:23:30.513043 16242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5066abfe4261488f96534730b07ce4d5" candidate_uuid: "6070cdc51c6f49fcbcfbddd22a3c263c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6d026bb4a9146c395c2b8572753ffb7" is_pre_election: true
I20260709 13:23:30.513150 16315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1e06a2952f94a919e5324bd1f0d7cab" candidate_uuid: "c6d026bb4a9146c395c2b8572753ffb7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6070cdc51c6f49fcbcfbddd22a3c263c" is_pre_election: true
I20260709 13:23:30.513165 16390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5066abfe4261488f96534730b07ce4d5" candidate_uuid: "6070cdc51c6f49fcbcfbddd22a3c263c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3a01ebd6b99640978d77190fe4da6f08" is_pre_election: true
I20260709 13:23:30.515275 16315 raft_consensus.cc:2468] T b1e06a2952f94a919e5324bd1f0d7cab P 6070cdc51c6f49fcbcfbddd22a3c263c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6d026bb4a9146c395c2b8572753ffb7 in term 0.
I20260709 13:23:30.515717 16389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1e06a2952f94a919e5324bd1f0d7cab" candidate_uuid: "c6d026bb4a9146c395c2b8572753ffb7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3a01ebd6b99640978d77190fe4da6f08" is_pre_election: true
I20260709 13:23:30.514554 16242 raft_consensus.cc:2393] T 5066abfe4261488f96534730b07ce4d5 P c6d026bb4a9146c395c2b8572753ffb7 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6070cdc51c6f49fcbcfbddd22a3c263c in current term 1: Already voted for candidate 3a01ebd6b99640978d77190fe4da6f08 in this term.
I20260709 13:23:30.516705 16389 raft_consensus.cc:2468] T b1e06a2952f94a919e5324bd1f0d7cab P 3a01ebd6b99640978d77190fe4da6f08 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6d026bb4a9146c395c2b8572753ffb7 in term 0.
I20260709 13:23:30.520145 16477 leader_election.cc:290] T b1e06a2952f94a919e5324bd1f0d7cab P c6d026bb4a9146c395c2b8572753ffb7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6070cdc51c6f49fcbcfbddd22a3c263c (127.5.126.66:41095), 3a01ebd6b99640978d77190fe4da6f08 (127.5.126.67:45221)
I20260709 13:23:30.517001 16206 leader_election.cc:304] T b1e06a2952f94a919e5324bd1f0d7cab P c6d026bb4a9146c395c2b8572753ffb7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6070cdc51c6f49fcbcfbddd22a3c263c, c6d026bb4a9146c395c2b8572753ffb7; no voters: 
I20260709 13:23:30.522356 16477 raft_consensus.cc:2804] T b1e06a2952f94a919e5324bd1f0d7cab P c6d026bb4a9146c395c2b8572753ffb7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:23:30.521515 16281 leader_election.cc:304] T cb70c02d0bce438cbb6434b2c0aa54ae P 6070cdc51c6f49fcbcfbddd22a3c263c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6070cdc51c6f49fcbcfbddd22a3c263c, c6d026bb4a9146c395c2b8572753ffb7; no voters: 
I20260709 13:23:30.520562 16431 raft_consensus.cc:359] T b0313caec0564fd5bf22e34524632537 P 3a01ebd6b99640978d77190fe4da6f08 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6d026bb4a9146c395c2b8572753ffb7" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34303 } } peers { permanent_uuid: "6070cdc51c6f49fcbcfbddd22a3c263c" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 41095 } } peers { permanent_uuid: "3a01ebd6b99640978d77190fe4da6f08" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 45221 } }
I20260709 13:23:30.523979 16484 raft_consensus.cc:2804] T cb70c02d0bce438cbb6434b2c0aa54ae P 6070cdc51c6f49fcbcfbddd22a3c263c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:23:30.524796 16484 raft_consensus.cc:493] T cb70c02d0bce438cbb6434b2c0aa54ae P 6070cdc51c6f49fcbcfbddd22a3c263c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:23:30.524084 16477 raft_consensus.cc:493] T b1e06a2952f94a919e5324bd1f0d7cab P c6d026bb4a9146c395c2b8572753ffb7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:23:30.525712 16477 raft_consensus.cc:3060] T b1e06a2952f94a919e5324bd1f0d7cab P c6d026bb4a9146c395c2b8572753ffb7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:23:30.525969 16281 leader_election.cc:304] T 5066abfe4261488f96534730b07ce4d5 P 6070cdc51c6f49fcbcfbddd22a3c263c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6070cdc51c6f49fcbcfbddd22a3c263c; no voters: 3a01ebd6b99640978d77190fe4da6f08, c6d026bb4a9146c395c2b8572753ffb7
I20260709 13:23:30.523886 16431 raft_consensus.cc:385] T b0313caec0564fd5bf22e34524632537 P 3a01ebd6b99640978d77190fe4da6f08 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:23:30.526912 16431 raft_consensus.cc:740] T b0313caec0564fd5bf22e34524632537 P 3a01ebd6b99640978d77190fe4da6f08 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3a01ebd6b99640978d77190fe4da6f08, State: Initialized, Role: FOLLOWER
I20260709 13:23:30.526971 16439 raft_consensus.cc:3060] T 5066abfe4261488f96534730b07ce4d5 P 6070cdc51c6f49fcbcfbddd22a3c263c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:23:30.525475 16433 ts_tablet_manager.cc:1403] T f55407f772b74aaba87440ba35c2ac8b P 6070cdc51c6f49fcbcfbddd22a3c263c: Time spent bootstrapping tablet: real 0.127s	user 0.019s	sys 0.007s
I20260709 13:23:30.525238 16484 raft_consensus.cc:3060] T cb70c02d0bce438cbb6434b2c0aa54ae P 6070cdc51c6f49fcbcfbddd22a3c263c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:23:30.528702 16431 consensus_queue.cc:260] T b0313caec0564fd5bf22e34524632537 P 3a01ebd6b99640978d77190fe4da6f08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6d026bb4a9146c395c2b8572753ffb7" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34303 } } peers { permanent_uuid: "6070cdc51c6f49fcbcfbddd22a3c263c" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 41095 } } peers { permanent_uuid: "3a01ebd6b99640978d77190fe4da6f08" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 45221 } }
I20260709 13:23:30.532608 16433 raft_consensus.cc:359] T f55407f772b74aaba87440ba35c2ac8b P 6070cdc51c6f49fcbcfbddd22a3c263c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6d026bb4a9146c395c2b8572753ffb7" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34303 } } peers { permanent_uuid: "6070cdc51c6f49fcbcfbddd22a3c263c" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 41095 } } peers { permanent_uuid: "3a01ebd6b99640978d77190fe4da6f08" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 45221 } }
I20260709 13:23:30.533622 16433 raft_consensus.cc:385] T f55407f772b74aaba87440ba35c2ac8b P 6070cdc51c6f49fcbcfbddd22a3c263c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:23:30.534005 16433 raft_consensus.cc:740] T f55407f772b74aaba87440ba35c2ac8b P 6070cdc51c6f49fcbcfbddd22a3c263c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6070cdc51c6f49fcbcfbddd22a3c263c, State: Initialized, Role: FOLLOWER
I20260709 13:23:30.535300 16433 consensus_queue.cc:260] T f55407f772b74aaba87440ba35c2ac8b P 6070cdc51c6f49fcbcfbddd22a3c263c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6d026bb4a9146c395c2b8572753ffb7" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34303 } } peers { permanent_uuid: "6070cdc51c6f49fcbcfbddd22a3c263c" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 41095 } } peers { permanent_uuid: "3a01ebd6b99640978d77190fe4da6f08" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 45221 } }
I20260709 13:23:30.538249 16435 raft_consensus.cc:515] T cb70c02d0bce438cbb6434b2c0aa54ae P 3a01ebd6b99640978d77190fe4da6f08 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6d026bb4a9146c395c2b8572753ffb7" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34303 } } peers { permanent_uuid: "6070cdc51c6f49fcbcfbddd22a3c263c" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 41095 } } peers { permanent_uuid: "3a01ebd6b99640978d77190fe4da6f08" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 45221 } }
I20260709 13:23:30.537963 16431 ts_tablet_manager.cc:1434] T b0313caec0564fd5bf22e34524632537 P 3a01ebd6b99640978d77190fe4da6f08: Time spent starting tablet: real 0.029s	user 0.005s	sys 0.006s
I20260709 13:23:30.538582 16457 raft_consensus.cc:493] T 49ace918d4da4776b29f4aa41975e9ef P 3a01ebd6b99640978d77190fe4da6f08 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:23:30.539245 16457 raft_consensus.cc:515] T 49ace918d4da4776b29f4aa41975e9ef P 3a01ebd6b99640978d77190fe4da6f08 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6d026bb4a9146c395c2b8572753ffb7" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34303 } } peers { permanent_uuid: "6070cdc51c6f49fcbcfbddd22a3c263c" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 41095 } } peers { permanent_uuid: "3a01ebd6b99640978d77190fe4da6f08" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 45221 } }
I20260709 13:23:30.539762 16391 raft_consensus.cc:2393] T cb70c02d0bce438cbb6434b2c0aa54ae P 3a01ebd6b99640978d77190fe4da6f08 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6070cdc51c6f49fcbcfbddd22a3c263c in current term 1: Already voted for candidate 3a01ebd6b99640978d77190fe4da6f08 in this term.
I20260709 13:23:30.541533 16457 leader_election.cc:290] T 49ace918d4da4776b29f4aa41975e9ef P 3a01ebd6b99640978d77190fe4da6f08 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c6d026bb4a9146c395c2b8572753ffb7 (127.5.126.65:34303), 6070cdc51c6f49fcbcfbddd22a3c263c (127.5.126.66:41095)
I20260709 13:23:30.543661 16315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49ace918d4da4776b29f4aa41975e9ef" candidate_uuid: "3a01ebd6b99640978d77190fe4da6f08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6070cdc51c6f49fcbcfbddd22a3c263c" is_pre_election: true
I20260709 13:23:30.544413 16315 raft_consensus.cc:2468] T 49ace918d4da4776b29f4aa41975e9ef P 6070cdc51c6f49fcbcfbddd22a3c263c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3a01ebd6b99640978d77190fe4da6f08 in term 0.
I20260709 13:23:30.545868 16355 leader_election.cc:304] T 49ace918d4da4776b29f4aa41975e9ef P 3a01ebd6b99640978d77190fe4da6f08 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3a01ebd6b99640978d77190fe4da6f08, 6070cdc51c6f49fcbcfbddd22a3c263c; no voters: 
I20260709 13:23:30.546921 16439 raft_consensus.cc:2749] T 5066abfe4261488f96534730b07ce4d5 P 6070cdc51c6f49fcbcfbddd22a3c263c [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:23:30.547461 16242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49ace918d4da4776b29f4aa41975e9ef" candidate_uuid: "3a01ebd6b99640978d77190fe4da6f08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6d026bb4a9146c395c2b8572753ffb7" is_pre_election: true
I20260709 13:23:30.548501 16242 raft_consensus.cc:2468] T 49ace918d4da4776b29f4aa41975e9ef P c6d026bb4a9146c395c2b8572753ffb7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3a01ebd6b99640978d77190fe4da6f08 in term 0.
I20260709 13:23:30.550019 16458 raft_consensus.cc:2804] T 49ace918d4da4776b29f4aa41975e9ef P 3a01ebd6b99640978d77190fe4da6f08 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:23:30.550499 16458 raft_consensus.cc:493] T 49ace918d4da4776b29f4aa41975e9ef P 3a01ebd6b99640978d77190fe4da6f08 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:23:30.550848 16458 raft_consensus.cc:3060] T 49ace918d4da4776b29f4aa41975e9ef P 3a01ebd6b99640978d77190fe4da6f08 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:23:30.559156 16433 ts_tablet_manager.cc:1434] T f55407f772b74aaba87440ba35c2ac8b P 6070cdc51c6f49fcbcfbddd22a3c263c: Time spent starting tablet: real 0.031s	user 0.010s	sys 0.017s
I20260709 13:23:30.560701 16459 consensus_queue.cc:1048] T 5066abfe4261488f96534730b07ce4d5 P 3a01ebd6b99640978d77190fe4da6f08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6070cdc51c6f49fcbcfbddd22a3c263c" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 41095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:23:30.562369 16433 tablet_bootstrap.cc:492] T b0313caec0564fd5bf22e34524632537 P 6070cdc51c6f49fcbcfbddd22a3c263c: Bootstrap starting.
I20260709 13:23:30.562724 16459 consensus_queue.cc:1048] T 5066abfe4261488f96534730b07ce4d5 P 3a01ebd6b99640978d77190fe4da6f08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6d026bb4a9146c395c2b8572753ffb7" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:23:30.563524 16242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb70c02d0bce438cbb6434b2c0aa54ae" candidate_uuid: "3a01ebd6b99640978d77190fe4da6f08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6d026bb4a9146c395c2b8572753ffb7"
I20260709 13:23:30.559970 16435 leader_election.cc:290] T cb70c02d0bce438cbb6434b2c0aa54ae P 3a01ebd6b99640978d77190fe4da6f08 [CANDIDATE]: Term 1 election: Requested vote from peers c6d026bb4a9146c395c2b8572753ffb7 (127.5.126.65:34303), 6070cdc51c6f49fcbcfbddd22a3c263c (127.5.126.66:41095)
I20260709 13:23:30.564257 16242 raft_consensus.cc:3060] T cb70c02d0bce438cbb6434b2c0aa54ae P c6d026bb4a9146c395c2b8572753ffb7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:23:30.565623 16484 raft_consensus.cc:515] T cb70c02d0bce438cbb6434b2c0aa54ae P 6070cdc51c6f49fcbcfbddd22a3c263c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6d026bb4a9146c395c2b8572753ffb7" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34303 } } peers { permanent_uuid: "6070cdc51c6f49fcbcfbddd22a3c263c" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 41095 } } peers { permanent_uuid: "3a01ebd6b99640978d77190fe4da6f08" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 45221 } }
I20260709 13:23:30.568111 16484 leader_election.cc:290] T cb70c02d0bce438cbb6434b2c0aa54ae P 6070cdc51c6f49fcbcfbddd22a3c263c [CANDIDATE]: Term 1 election: Requested vote from peers c6d026bb4a9146c395c2b8572753ffb7 (127.5.126.65:34303), 3a01ebd6b99640978d77190fe4da6f08 (127.5.126.67:45221)
I20260709 13:23:30.568182 16315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb70c02d0bce438cbb6434b2c0aa54ae" candidate_uuid: "3a01ebd6b99640978d77190fe4da6f08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6070cdc51c6f49fcbcfbddd22a3c263c"
I20260709 13:23:30.573133 16240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb70c02d0bce438cbb6434b2c0aa54ae" candidate_uuid: "6070cdc51c6f49fcbcfbddd22a3c263c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6d026bb4a9146c395c2b8572753ffb7"
I20260709 13:23:30.570720 16391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb70c02d0bce438cbb6434b2c0aa54ae" candidate_uuid: "6070cdc51c6f49fcbcfbddd22a3c263c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3a01ebd6b99640978d77190fe4da6f08"
I20260709 13:23:30.574203 16431 tablet_bootstrap.cc:492] T aab7ef362ab84369939a6a02d817aa53 P 3a01ebd6b99640978d77190fe4da6f08: Bootstrap starting.
I20260709 13:23:30.574795 16391 raft_consensus.cc:2393] T cb70c02d0bce438cbb6434b2c0aa54ae P 3a01ebd6b99640978d77190fe4da6f08 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 6070cdc51c6f49fcbcfbddd22a3c263c in current term 1: Already voted for candidate 3a01ebd6b99640978d77190fe4da6f08 in this term.
I20260709 13:23:30.573135 16315 raft_consensus.cc:2393] T cb70c02d0bce438cbb6434b2c0aa54ae P 6070cdc51c6f49fcbcfbddd22a3c263c [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 3a01ebd6b99640978d77190fe4da6f08 in current term 1: Already voted for candidate 6070cdc51c6f49fcbcfbddd22a3c263c in this term.
I20260709 13:23:30.577602 16281 leader_election.cc:304] T cb70c02d0bce438cbb6434b2c0aa54ae P 6070cdc51c6f49fcbcfbddd22a3c263c [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6070cdc51c6f49fcbcfbddd22a3c263c; no voters: 3a01ebd6b99640978d77190fe4da6f08, c6d026bb4a9146c395c2b8572753ffb7
I20260709 13:23:30.581974 16477 raft_consensus.cc:515] T b1e06a2952f94a919e5324bd1f0d7cab P c6d026bb4a9146c395c2b8572753ffb7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6d026bb4a9146c395c2b8572753ffb7" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34303 } } peers { permanent_uuid: "6070cdc51c6f49fcbcfbddd22a3c263c" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 41095 } } peers { permanent_uuid: "3a01ebd6b99640978d77190fe4da6f08" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 45221 } }
I20260709 13:23:30.582549 16433 tablet_bootstrap.cc:654] T b0313caec0564fd5bf22e34524632537 P 6070cdc51c6f49fcbcfbddd22a3c263c: Neither blocks nor log segments found. Creating new log.
I20260709 13:23:30.584385 16477 leader_election.cc:290] T b1e06a2952f94a919e5324bd1f0d7cab P c6d026bb4a9146c395c2b8572753ffb7 [CANDIDATE]: Term 1 election: Requested vote from peers 6070cdc51c6f49fcbcfbddd22a3c263c (127.5.126.66:41095), 3a01ebd6b99640978d77190fe4da6f08 (127.5.126.67:45221)
I20260709 13:23:30.585587 16484 raft_consensus.cc:2749] T cb70c02d0bce438cbb6434b2c0aa54ae P 6070cdc51c6f49fcbcfbddd22a3c263c [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:23:30.593008 16315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1e06a2952f94a919e5324bd1f0d7cab" candidate_uuid: "c6d026bb4a9146c395c2b8572753ffb7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6070cdc51c6f49fcbcfbddd22a3c263c"
I20260709 13:23:30.593775 16315 raft_consensus.cc:3060] T b1e06a2952f94a919e5324bd1f0d7cab P 6070cdc51c6f49fcbcfbddd22a3c263c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:23:30.598914 16242 raft_consensus.cc:2468] T cb70c02d0bce438cbb6434b2c0aa54ae P c6d026bb4a9146c395c2b8572753ffb7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3a01ebd6b99640978d77190fe4da6f08 in term 1.
I20260709 13:23:30.602885 16391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1e06a2952f94a919e5324bd1f0d7cab" candidate_uuid: "c6d026bb4a9146c395c2b8572753ffb7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3a01ebd6b99640978d77190fe4da6f08"
I20260709 13:23:30.603116 16355 leader_election.cc:304] T cb70c02d0bce438cbb6434b2c0aa54ae P 3a01ebd6b99640978d77190fe4da6f08 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3a01ebd6b99640978d77190fe4da6f08, c6d026bb4a9146c395c2b8572753ffb7; no voters: 6070cdc51c6f49fcbcfbddd22a3c263c
I20260709 13:23:30.603860 16391 raft_consensus.cc:3060] T b1e06a2952f94a919e5324bd1f0d7cab P 3a01ebd6b99640978d77190fe4da6f08 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:23:30.604329 16435 raft_consensus.cc:2804] T cb70c02d0bce438cbb6434b2c0aa54ae P 3a01ebd6b99640978d77190fe4da6f08 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:23:30.604954 16435 raft_consensus.cc:697] T cb70c02d0bce438cbb6434b2c0aa54ae P 3a01ebd6b99640978d77190fe4da6f08 [term 1 LEADER]: Becoming Leader. State: Replica: 3a01ebd6b99640978d77190fe4da6f08, State: Running, Role: LEADER
I20260709 13:23:30.606317 16435 consensus_queue.cc:237] T cb70c02d0bce438cbb6434b2c0aa54ae P 3a01ebd6b99640978d77190fe4da6f08 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6d026bb4a9146c395c2b8572753ffb7" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34303 } } peers { permanent_uuid: "6070cdc51c6f49fcbcfbddd22a3c263c" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 41095 } } peers { permanent_uuid: "3a01ebd6b99640978d77190fe4da6f08" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 45221 } }
I20260709 13:23:30.607767 16458 raft_consensus.cc:515] T 49ace918d4da4776b29f4aa41975e9ef P 3a01ebd6b99640978d77190fe4da6f08 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6d026bb4a9146c395c2b8572753ffb7" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34303 } } peers { permanent_uuid: "6070cdc51c6f49fcbcfbddd22a3c263c" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 41095 } } peers { permanent_uuid: "3a01ebd6b99640978d77190fe4da6f08" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 45221 } }
I20260709 13:23:30.610738 16458 leader_election.cc:290] T 49ace918d4da4776b29f4aa41975e9ef P 3a01ebd6b99640978d77190fe4da6f08 [CANDIDATE]: Term 1 election: Requested vote from peers c6d026bb4a9146c395c2b8572753ffb7 (127.5.126.65:34303), 6070cdc51c6f49fcbcfbddd22a3c263c (127.5.126.66:41095)
I20260709 13:23:30.602260 16477 raft_consensus.cc:493] T b0313caec0564fd5bf22e34524632537 P c6d026bb4a9146c395c2b8572753ffb7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:23:30.612479 16477 raft_consensus.cc:515] T b0313caec0564fd5bf22e34524632537 P c6d026bb4a9146c395c2b8572753ffb7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6d026bb4a9146c395c2b8572753ffb7" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34303 } } peers { permanent_uuid: "6070cdc51c6f49fcbcfbddd22a3c263c" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 41095 } } peers { permanent_uuid: "3a01ebd6b99640978d77190fe4da6f08" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 45221 } }
I20260709 13:23:30.615881 16317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49ace918d4da4776b29f4aa41975e9ef" candidate_uuid: "3a01ebd6b99640978d77190fe4da6f08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6070cdc51c6f49fcbcfbddd22a3c263c"
I20260709 13:23:30.616770 16317 raft_consensus.cc:3060] T 49ace918d4da4776b29f4aa41975e9ef P 6070cdc51c6f49fcbcfbddd22a3c263c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:23:30.617313 16241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49ace918d4da4776b29f4aa41975e9ef" candidate_uuid: "3a01ebd6b99640978d77190fe4da6f08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6d026bb4a9146c395c2b8572753ffb7"
I20260709 13:23:30.618221 16241 raft_consensus.cc:3060] T 49ace918d4da4776b29f4aa41975e9ef P c6d026bb4a9146c395c2b8572753ffb7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:23:30.622546 16316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0313caec0564fd5bf22e34524632537" candidate_uuid: "c6d026bb4a9146c395c2b8572753ffb7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6070cdc51c6f49fcbcfbddd22a3c263c" is_pre_election: true
I20260709 13:23:30.624588 16433 tablet_bootstrap.cc:492] T b0313caec0564fd5bf22e34524632537 P 6070cdc51c6f49fcbcfbddd22a3c263c: No bootstrap required, opened a new log
W20260709 13:23:30.624637 16206 leader_election.cc:343] T b0313caec0564fd5bf22e34524632537 P c6d026bb4a9146c395c2b8572753ffb7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6070cdc51c6f49fcbcfbddd22a3c263c (127.5.126.66:41095): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:23:30.625720 16433 ts_tablet_manager.cc:1403] T b0313caec0564fd5bf22e34524632537 P 6070cdc51c6f49fcbcfbddd22a3c263c: Time spent bootstrapping tablet: real 0.064s	user 0.014s	sys 0.012s
I20260709 13:23:30.636551 16477 leader_election.cc:290] T b0313caec0564fd5bf22e34524632537 P c6d026bb4a9146c395c2b8572753ffb7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6070cdc51c6f49fcbcfbddd22a3c263c (127.5.126.66:41095), 3a01ebd6b99640978d77190fe4da6f08 (127.5.126.67:45221)
I20260709 13:23:30.642894 16484 raft_consensus.cc:493] T fd931932596f4755aeae878c0fe3c2d9 P 6070cdc51c6f49fcbcfbddd22a3c263c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:23:30.642211 16140 catalog_manager.cc:5697] T cb70c02d0bce438cbb6434b2c0aa54ae P 3a01ebd6b99640978d77190fe4da6f08 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3a01ebd6b99640978d77190fe4da6f08 (127.5.126.67). New cstate: current_term: 1 leader_uuid: "3a01ebd6b99640978d77190fe4da6f08" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6d026bb4a9146c395c2b8572753ffb7" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6070cdc51c6f49fcbcfbddd22a3c263c" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 41095 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3a01ebd6b99640978d77190fe4da6f08" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 45221 } health_report { overall_health: HEALTHY } } }
I20260709 13:23:30.644256 16431 tablet_bootstrap.cc:654] T aab7ef362ab84369939a6a02d817aa53 P 3a01ebd6b99640978d77190fe4da6f08: Neither blocks nor log segments found. Creating new log.
I20260709 13:23:30.643970 16484 raft_consensus.cc:515] T fd931932596f4755aeae878c0fe3c2d9 P 6070cdc51c6f49fcbcfbddd22a3c263c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6d026bb4a9146c395c2b8572753ffb7" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34303 } } peers { permanent_uuid: "6070cdc51c6f49fcbcfbddd22a3c263c" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 41095 } } peers { permanent_uuid: "3a01ebd6b99640978d77190fe4da6f08" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 45221 } }
I20260709 13:23:30.635658 16317 raft_consensus.cc:2468] T 49ace918d4da4776b29f4aa41975e9ef P 6070cdc51c6f49fcbcfbddd22a3c263c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3a01ebd6b99640978d77190fe4da6f08 in term 1.
I20260709 13:23:30.648901 16484 leader_election.cc:290] T fd931932596f4755aeae878c0fe3c2d9 P 6070cdc51c6f49fcbcfbddd22a3c263c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c6d026bb4a9146c395c2b8572753ffb7 (127.5.126.65:34303), 3a01ebd6b99640978d77190fe4da6f08 (127.5.126.67:45221)
I20260709 13:23:30.648802 16240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd931932596f4755aeae878c0fe3c2d9" candidate_uuid: "6070cdc51c6f49fcbcfbddd22a3c263c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6d026bb4a9146c395c2b8572753ffb7" is_pre_election: true
I20260709 13:23:30.649585 16389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd931932596f4755aeae878c0fe3c2d9" candidate_uuid: "6070cdc51c6f49fcbcfbddd22a3c263c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3a01ebd6b99640978d77190fe4da6f08" is_pre_election: true
I20260709 13:23:30.650491 16389 raft_consensus.cc:2393] T fd931932596f4755aeae878c0fe3c2d9 P 3a01ebd6b99640978d77190fe4da6f08 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6070cdc51c6f49fcbcfbddd22a3c263c in current term 1: Already voted for candidate c6d026bb4a9146c395c2b8572753ffb7 in this term.
I20260709 13:23:30.651607 16281 leader_election.cc:304] T fd931932596f4755aeae878c0fe3c2d9 P 6070cdc51c6f49fcbcfbddd22a3c263c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6070cdc51c6f49fcbcfbddd22a3c263c; no voters: 3a01ebd6b99640978d77190fe4da6f08, c6d026bb4a9146c395c2b8572753ffb7
I20260709 13:23:30.652922 16484 raft_consensus.cc:3060] T fd931932596f4755aeae878c0fe3c2d9 P 6070cdc51c6f49fcbcfbddd22a3c263c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:23:30.656694 16391 raft_consensus.cc:2468] T b1e06a2952f94a919e5324bd1f0d7cab P 3a01ebd6b99640978d77190fe4da6f08 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6d026bb4a9146c395c2b8572753ffb7 in term 1.
I20260709 13:23:30.661617 16459 raft_consensus.cc:493] T b0313caec0564fd5bf22e34524632537 P 3a01ebd6b99640978d77190fe4da6f08 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:23:30.662201 16459 raft_consensus.cc:515] T b0313caec0564fd5bf22e34524632537 P 3a01ebd6b99640978d77190fe4da6f08 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6d026bb4a9146c395c2b8572753ffb7" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34303 } } peers { permanent_uuid: "6070cdc51c6f49fcbcfbddd22a3c263c" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 41095 } } peers { permanent_uuid: "3a01ebd6b99640978d77190fe4da6f08" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 45221 } }
I20260709 13:23:30.664738 16459 leader_election.cc:290] T b0313caec0564fd5bf22e34524632537 P 3a01ebd6b99640978d77190fe4da6f08 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c6d026bb4a9146c395c2b8572753ffb7 (127.5.126.65:34303), 6070cdc51c6f49fcbcfbddd22a3c263c (127.5.126.66:41095)
I20260709 13:23:30.666832 16316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0313caec0564fd5bf22e34524632537" candidate_uuid: "3a01ebd6b99640978d77190fe4da6f08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6070cdc51c6f49fcbcfbddd22a3c263c" is_pre_election: true
I20260709 13:23:30.657599 16433 raft_consensus.cc:359] T b0313caec0564fd5bf22e34524632537 P 6070cdc51c6f49fcbcfbddd22a3c263c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6d026bb4a9146c395c2b8572753ffb7" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34303 } } peers { permanent_uuid: "6070cdc51c6f49fcbcfbddd22a3c263c" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 41095 } } peers { permanent_uuid: "3a01ebd6b99640978d77190fe4da6f08" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 45221 } }
I20260709 13:23:30.674113 16433 raft_consensus.cc:385] T b0313caec0564fd5bf22e34524632537 P 6070cdc51c6f49fcbcfbddd22a3c263c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:23:30.674402 16433 raft_consensus.cc:740] T b0313caec0564fd5bf22e34524632537 P 6070cdc51c6f49fcbcfbddd22a3c263c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6070cdc51c6f49fcbcfbddd22a3c263c, State: Initialized, Role: FOLLOWER
I20260709 13:23:30.677125 16355 leader_election.cc:304] T 49ace918d4da4776b29f4aa41975e9ef P 3a01ebd6b99640978d77190fe4da6f08 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3a01ebd6b99640978d77190fe4da6f08, 6070cdc51c6f49fcbcfbddd22a3c263c; no voters: 
I20260709 13:23:30.677726 16389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0313caec0564fd5bf22e34524632537" candidate_uuid: "c6d026bb4a9146c395c2b8572753ffb7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3a01ebd6b99640978d77190fe4da6f08" is_pre_election: true
I20260709 13:23:30.678201 16459 raft_consensus.cc:2804] T 49ace918d4da4776b29f4aa41975e9ef P 3a01ebd6b99640978d77190fe4da6f08 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:23:30.678429 16389 raft_consensus.cc:2468] T b0313caec0564fd5bf22e34524632537 P 3a01ebd6b99640978d77190fe4da6f08 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6d026bb4a9146c395c2b8572753ffb7 in term 0.
I20260709 13:23:30.678968 16459 raft_consensus.cc:697] T 49ace918d4da4776b29f4aa41975e9ef P 3a01ebd6b99640978d77190fe4da6f08 [term 1 LEADER]: Becoming Leader. State: Replica: 3a01ebd6b99640978d77190fe4da6f08, State: Running, Role: LEADER
I20260709 13:23:30.680126 16459 consensus_queue.cc:237] T 49ace918d4da4776b29f4aa41975e9ef P 3a01ebd6b99640978d77190fe4da6f08 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6d026bb4a9146c395c2b8572753ffb7" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34303 } } peers { permanent_uuid: "6070cdc51c6f49fcbcfbddd22a3c263c" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 41095 } } peers { permanent_uuid: "3a01ebd6b99640978d77190fe4da6f08" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 45221 } }
I20260709 13:23:30.681602 16241 raft_consensus.cc:2468] T 49ace918d4da4776b29f4aa41975e9ef P c6d026bb4a9146c395c2b8572753ffb7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3a01ebd6b99640978d77190fe4da6f08 in term 1.
I20260709 13:23:30.683197 16477 consensus_queue.cc:1048] T fd931932596f4755aeae878c0fe3c2d9 P c6d026bb4a9146c395c2b8572753ffb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3a01ebd6b99640978d77190fe4da6f08" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 45221 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:23:30.683197 16433 consensus_queue.cc:260] T b0313caec0564fd5bf22e34524632537 P 6070cdc51c6f49fcbcfbddd22a3c263c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6d026bb4a9146c395c2b8572753ffb7" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34303 } } peers { permanent_uuid: "6070cdc51c6f49fcbcfbddd22a3c263c" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 41095 } } peers { permanent_uuid: "3a01ebd6b99640978d77190fe4da6f08" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 45221 } }
I20260709 13:23:30.686947 16315 raft_consensus.cc:2468] T b1e06a2952f94a919e5324bd1f0d7cab P 6070cdc51c6f49fcbcfbddd22a3c263c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6d026bb4a9146c395c2b8572753ffb7 in term 1.
I20260709 13:23:30.687819 16316 raft_consensus.cc:2468] T b0313caec0564fd5bf22e34524632537 P 6070cdc51c6f49fcbcfbddd22a3c263c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3a01ebd6b99640978d77190fe4da6f08 in term 0.
I20260709 13:23:30.689627 16433 ts_tablet_manager.cc:1434] T b0313caec0564fd5bf22e34524632537 P 6070cdc51c6f49fcbcfbddd22a3c263c: Time spent starting tablet: real 0.063s	user 0.007s	sys 0.000s
I20260709 13:23:30.690004 16431 tablet_bootstrap.cc:492] T aab7ef362ab84369939a6a02d817aa53 P 3a01ebd6b99640978d77190fe4da6f08: No bootstrap required, opened a new log
I20260709 13:23:30.690644 16431 ts_tablet_manager.cc:1403] T aab7ef362ab84369939a6a02d817aa53 P 3a01ebd6b99640978d77190fe4da6f08: Time spent bootstrapping tablet: real 0.117s	user 0.012s	sys 0.021s
I20260709 13:23:30.692812 16433 tablet_bootstrap.cc:492] T aab7ef362ab84369939a6a02d817aa53 P 6070cdc51c6f49fcbcfbddd22a3c263c: Bootstrap starting.
I20260709 13:23:30.691813 16355 leader_election.cc:304] T b0313caec0564fd5bf22e34524632537 P 3a01ebd6b99640978d77190fe4da6f08 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3a01ebd6b99640978d77190fe4da6f08, 6070cdc51c6f49fcbcfbddd22a3c263c; no voters: 
I20260709 13:23:30.694275 16458 raft_consensus.cc:2804] T b0313caec0564fd5bf22e34524632537 P 3a01ebd6b99640978d77190fe4da6f08 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:23:30.695019 16458 raft_consensus.cc:493] T b0313caec0564fd5bf22e34524632537 P 3a01ebd6b99640978d77190fe4da6f08 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:23:30.696369 16458 raft_consensus.cc:3060] T b0313caec0564fd5bf22e34524632537 P 3a01ebd6b99640978d77190fe4da6f08 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:23:30.703958 16433 tablet_bootstrap.cc:654] T aab7ef362ab84369939a6a02d817aa53 P 6070cdc51c6f49fcbcfbddd22a3c263c: Neither blocks nor log segments found. Creating new log.
I20260709 13:23:30.710722 16431 raft_consensus.cc:359] T aab7ef362ab84369939a6a02d817aa53 P 3a01ebd6b99640978d77190fe4da6f08 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6d026bb4a9146c395c2b8572753ffb7" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34303 } } peers { permanent_uuid: "6070cdc51c6f49fcbcfbddd22a3c263c" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 41095 } } peers { permanent_uuid: "3a01ebd6b99640978d77190fe4da6f08" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 45221 } }
I20260709 13:23:30.712008 16431 raft_consensus.cc:385] T aab7ef362ab84369939a6a02d817aa53 P 3a01ebd6b99640978d77190fe4da6f08 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:23:30.712507 16431 raft_consensus.cc:740] T aab7ef362ab84369939a6a02d817aa53 P 3a01ebd6b99640978d77190fe4da6f08 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3a01ebd6b99640978d77190fe4da6f08, State: Initialized, Role: FOLLOWER
I20260709 13:23:30.712150 16241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0313caec0564fd5bf22e34524632537" candidate_uuid: "3a01ebd6b99640978d77190fe4da6f08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6d026bb4a9146c395c2b8572753ffb7" is_pre_election: true
I20260709 13:23:30.713933 16431 consensus_queue.cc:260] T aab7ef362ab84369939a6a02d817aa53 P 3a01ebd6b99640978d77190fe4da6f08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6d026bb4a9146c395c2b8572753ffb7" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34303 } } peers { permanent_uuid: "6070cdc51c6f49fcbcfbddd22a3c263c" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 41095 } } peers { permanent_uuid: "3a01ebd6b99640978d77190fe4da6f08" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 45221 } }
I20260709 13:23:30.714251 16241 raft_consensus.cc:2468] T b0313caec0564fd5bf22e34524632537 P c6d026bb4a9146c395c2b8572753ffb7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3a01ebd6b99640978d77190fe4da6f08 in term 0.
I20260709 13:23:30.715309 16206 leader_election.cc:304] T b1e06a2952f94a919e5324bd1f0d7cab P c6d026bb4a9146c395c2b8572753ffb7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3a01ebd6b99640978d77190fe4da6f08, c6d026bb4a9146c395c2b8572753ffb7; no voters: 
I20260709 13:23:30.717053 16477 raft_consensus.cc:2804] T b1e06a2952f94a919e5324bd1f0d7cab P c6d026bb4a9146c395c2b8572753ffb7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:23:30.717257 16431 ts_tablet_manager.cc:1434] T aab7ef362ab84369939a6a02d817aa53 P 3a01ebd6b99640978d77190fe4da6f08: Time spent starting tablet: real 0.026s	user 0.008s	sys 0.000s
I20260709 13:23:30.717828 16477 raft_consensus.cc:697] T b1e06a2952f94a919e5324bd1f0d7cab P c6d026bb4a9146c395c2b8572753ffb7 [term 1 LEADER]: Becoming Leader. State: Replica: c6d026bb4a9146c395c2b8572753ffb7, State: Running, Role: LEADER
I20260709 13:23:30.717366 16433 tablet_bootstrap.cc:492] T aab7ef362ab84369939a6a02d817aa53 P 6070cdc51c6f49fcbcfbddd22a3c263c: No bootstrap required, opened a new log
I20260709 13:23:30.719199 16433 ts_tablet_manager.cc:1403] T aab7ef362ab84369939a6a02d817aa53 P 6070cdc51c6f49fcbcfbddd22a3c263c: Time spent bootstrapping tablet: real 0.027s	user 0.013s	sys 0.000s
I20260709 13:23:30.719401 16431 tablet_bootstrap.cc:492] T 4f5a2d88e89448648f594ef23ef152cd P 3a01ebd6b99640978d77190fe4da6f08: Bootstrap starting.
I20260709 13:23:30.719254 16477 consensus_queue.cc:237] T b1e06a2952f94a919e5324bd1f0d7cab P c6d026bb4a9146c395c2b8572753ffb7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6d026bb4a9146c395c2b8572753ffb7" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34303 } } peers { permanent_uuid: "6070cdc51c6f49fcbcfbddd22a3c263c" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 41095 } } peers { permanent_uuid: "3a01ebd6b99640978d77190fe4da6f08" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 45221 } }
I20260709 13:23:30.722232 16433 raft_consensus.cc:359] T aab7ef362ab84369939a6a02d817aa53 P 6070cdc51c6f49fcbcfbddd22a3c263c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6d026bb4a9146c395c2b8572753ffb7" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34303 } } peers { permanent_uuid: "6070cdc51c6f49fcbcfbddd22a3c263c" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 41095 } } peers { permanent_uuid: "3a01ebd6b99640978d77190fe4da6f08" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 45221 } }
I20260709 13:23:30.726826 16433 raft_consensus.cc:385] T aab7ef362ab84369939a6a02d817aa53 P 6070cdc51c6f49fcbcfbddd22a3c263c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:23:30.727113 16433 raft_consensus.cc:740] T aab7ef362ab84369939a6a02d817aa53 P 6070cdc51c6f49fcbcfbddd22a3c263c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6070cdc51c6f49fcbcfbddd22a3c263c, State: Initialized, Role: FOLLOWER
I20260709 13:23:30.727155 16206 leader_election.cc:304] T b0313caec0564fd5bf22e34524632537 P c6d026bb4a9146c395c2b8572753ffb7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3a01ebd6b99640978d77190fe4da6f08, c6d026bb4a9146c395c2b8572753ffb7; no voters: 6070cdc51c6f49fcbcfbddd22a3c263c
I20260709 13:23:30.728367 16431 tablet_bootstrap.cc:654] T 4f5a2d88e89448648f594ef23ef152cd P 3a01ebd6b99640978d77190fe4da6f08: Neither blocks nor log segments found. Creating new log.
I20260709 13:23:30.729306 16433 consensus_queue.cc:260] T aab7ef362ab84369939a6a02d817aa53 P 6070cdc51c6f49fcbcfbddd22a3c263c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6d026bb4a9146c395c2b8572753ffb7" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34303 } } peers { permanent_uuid: "6070cdc51c6f49fcbcfbddd22a3c263c" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 41095 } } peers { permanent_uuid: "3a01ebd6b99640978d77190fe4da6f08" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 45221 } }
I20260709 13:23:30.730858 16442 raft_consensus.cc:2804] T b0313caec0564fd5bf22e34524632537 P c6d026bb4a9146c395c2b8572753ffb7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:23:30.731513 16442 raft_consensus.cc:493] T b0313caec0564fd5bf22e34524632537 P c6d026bb4a9146c395c2b8572753ffb7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:23:30.731959 16442 raft_consensus.cc:3060] T b0313caec0564fd5bf22e34524632537 P c6d026bb4a9146c395c2b8572753ffb7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:23:30.737529 16433 ts_tablet_manager.cc:1434] T aab7ef362ab84369939a6a02d817aa53 P 6070cdc51c6f49fcbcfbddd22a3c263c: Time spent starting tablet: real 0.018s	user 0.006s	sys 0.000s
I20260709 13:23:30.754180 16431 tablet_bootstrap.cc:492] T 4f5a2d88e89448648f594ef23ef152cd P 3a01ebd6b99640978d77190fe4da6f08: No bootstrap required, opened a new log
I20260709 13:23:30.755007 16431 ts_tablet_manager.cc:1403] T 4f5a2d88e89448648f594ef23ef152cd P 3a01ebd6b99640978d77190fe4da6f08: Time spent bootstrapping tablet: real 0.036s	user 0.009s	sys 0.009s
I20260709 13:23:30.759514 16431 raft_consensus.cc:359] T 4f5a2d88e89448648f594ef23ef152cd P 3a01ebd6b99640978d77190fe4da6f08 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6d026bb4a9146c395c2b8572753ffb7" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34303 } } peers { permanent_uuid: "3a01ebd6b99640978d77190fe4da6f08" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 45221 } } peers { permanent_uuid: "6070cdc51c6f49fcbcfbddd22a3c263c" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 41095 } }
I20260709 13:23:30.760521 16431 raft_consensus.cc:385] T 4f5a2d88e89448648f594ef23ef152cd P 3a01ebd6b99640978d77190fe4da6f08 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:23:30.760931 16431 raft_consensus.cc:740] T 4f5a2d88e89448648f594ef23ef152cd P 3a01ebd6b99640978d77190fe4da6f08 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3a01ebd6b99640978d77190fe4da6f08, State: Initialized, Role: FOLLOWER
I20260709 13:23:30.762130 16431 consensus_queue.cc:260] T 4f5a2d88e89448648f594ef23ef152cd P 3a01ebd6b99640978d77190fe4da6f08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6d026bb4a9146c395c2b8572753ffb7" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34303 } } peers { permanent_uuid: "3a01ebd6b99640978d77190fe4da6f08" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 45221 } } peers { permanent_uuid: "6070cdc51c6f49fcbcfbddd22a3c263c" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 41095 } }
I20260709 13:23:30.765600 16431 ts_tablet_manager.cc:1434] T 4f5a2d88e89448648f594ef23ef152cd P 3a01ebd6b99640978d77190fe4da6f08: Time spent starting tablet: real 0.010s	user 0.008s	sys 0.000s
I20260709 13:23:30.690541 16484 raft_consensus.cc:2749] T fd931932596f4755aeae878c0fe3c2d9 P 6070cdc51c6f49fcbcfbddd22a3c263c [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:23:30.777480 16138 catalog_manager.cc:5697] T b1e06a2952f94a919e5324bd1f0d7cab P c6d026bb4a9146c395c2b8572753ffb7 reported cstate change: term changed from 0 to 1, leader changed from <none> to c6d026bb4a9146c395c2b8572753ffb7 (127.5.126.65). New cstate: current_term: 1 leader_uuid: "c6d026bb4a9146c395c2b8572753ffb7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6d026bb4a9146c395c2b8572753ffb7" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34303 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6070cdc51c6f49fcbcfbddd22a3c263c" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 41095 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3a01ebd6b99640978d77190fe4da6f08" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 45221 } health_report { overall_health: UNKNOWN } } }
I20260709 13:23:30.784261 16477 consensus_queue.cc:1048] T fd931932596f4755aeae878c0fe3c2d9 P c6d026bb4a9146c395c2b8572753ffb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6070cdc51c6f49fcbcfbddd22a3c263c" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 41095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:23:30.793980 16435 consensus_queue.cc:1048] T 88caca305bf74120a011e3fa92781678 P 3a01ebd6b99640978d77190fe4da6f08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6070cdc51c6f49fcbcfbddd22a3c263c" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 41095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:23:30.795254 16442 raft_consensus.cc:515] T b0313caec0564fd5bf22e34524632537 P c6d026bb4a9146c395c2b8572753ffb7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6d026bb4a9146c395c2b8572753ffb7" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34303 } } peers { permanent_uuid: "6070cdc51c6f49fcbcfbddd22a3c263c" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 41095 } } peers { permanent_uuid: "3a01ebd6b99640978d77190fe4da6f08" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 45221 } }
I20260709 13:23:30.798043 16458 raft_consensus.cc:515] T b0313caec0564fd5bf22e34524632537 P 3a01ebd6b99640978d77190fe4da6f08 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6d026bb4a9146c395c2b8572753ffb7" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34303 } } peers { permanent_uuid: "6070cdc51c6f49fcbcfbddd22a3c263c" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 41095 } } peers { permanent_uuid: "3a01ebd6b99640978d77190fe4da6f08" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 45221 } }
I20260709 13:23:30.800244 16458 leader_election.cc:290] T b0313caec0564fd5bf22e34524632537 P 3a01ebd6b99640978d77190fe4da6f08 [CANDIDATE]: Term 1 election: Requested vote from peers c6d026bb4a9146c395c2b8572753ffb7 (127.5.126.65:34303), 6070cdc51c6f49fcbcfbddd22a3c263c (127.5.126.66:41095)
I20260709 13:23:30.797605 16442 leader_election.cc:290] T b0313caec0564fd5bf22e34524632537 P c6d026bb4a9146c395c2b8572753ffb7 [CANDIDATE]: Term 1 election: Requested vote from peers 6070cdc51c6f49fcbcfbddd22a3c263c (127.5.126.66:41095), 3a01ebd6b99640978d77190fe4da6f08 (127.5.126.67:45221)
I20260709 13:23:30.801260 16140 catalog_manager.cc:5697] T 49ace918d4da4776b29f4aa41975e9ef P 3a01ebd6b99640978d77190fe4da6f08 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3a01ebd6b99640978d77190fe4da6f08 (127.5.126.67). New cstate: current_term: 1 leader_uuid: "3a01ebd6b99640978d77190fe4da6f08" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6d026bb4a9146c395c2b8572753ffb7" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6070cdc51c6f49fcbcfbddd22a3c263c" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 41095 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3a01ebd6b99640978d77190fe4da6f08" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 45221 } health_report { overall_health: HEALTHY } } }
I20260709 13:23:30.804476 16317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0313caec0564fd5bf22e34524632537" candidate_uuid: "3a01ebd6b99640978d77190fe4da6f08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6070cdc51c6f49fcbcfbddd22a3c263c"
I20260709 13:23:30.805328 16317 raft_consensus.cc:3060] T b0313caec0564fd5bf22e34524632537 P 6070cdc51c6f49fcbcfbddd22a3c263c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:23:30.813469 16315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0313caec0564fd5bf22e34524632537" candidate_uuid: "c6d026bb4a9146c395c2b8572753ffb7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6070cdc51c6f49fcbcfbddd22a3c263c"
I20260709 13:23:30.813889 16317 raft_consensus.cc:2468] T b0313caec0564fd5bf22e34524632537 P 6070cdc51c6f49fcbcfbddd22a3c263c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3a01ebd6b99640978d77190fe4da6f08 in term 1.
I20260709 13:23:30.814116 16391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0313caec0564fd5bf22e34524632537" candidate_uuid: "c6d026bb4a9146c395c2b8572753ffb7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3a01ebd6b99640978d77190fe4da6f08"
I20260709 13:23:30.815006 16391 raft_consensus.cc:2393] T b0313caec0564fd5bf22e34524632537 P 3a01ebd6b99640978d77190fe4da6f08 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate c6d026bb4a9146c395c2b8572753ffb7 in current term 1: Already voted for candidate 3a01ebd6b99640978d77190fe4da6f08 in this term.
I20260709 13:23:30.817871 16317 raft_consensus.cc:3060] T f55407f772b74aaba87440ba35c2ac8b P 6070cdc51c6f49fcbcfbddd22a3c263c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:23:30.820329 16355 leader_election.cc:304] T b0313caec0564fd5bf22e34524632537 P 3a01ebd6b99640978d77190fe4da6f08 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3a01ebd6b99640978d77190fe4da6f08, 6070cdc51c6f49fcbcfbddd22a3c263c; no voters: 
I20260709 13:23:30.821834 16241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0313caec0564fd5bf22e34524632537" candidate_uuid: "3a01ebd6b99640978d77190fe4da6f08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6d026bb4a9146c395c2b8572753ffb7"
I20260709 13:23:30.822718 16241 raft_consensus.cc:2393] T b0313caec0564fd5bf22e34524632537 P c6d026bb4a9146c395c2b8572753ffb7 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 3a01ebd6b99640978d77190fe4da6f08 in current term 1: Already voted for candidate c6d026bb4a9146c395c2b8572753ffb7 in this term.
I20260709 13:23:30.823963 16435 raft_consensus.cc:2804] T b0313caec0564fd5bf22e34524632537 P 3a01ebd6b99640978d77190fe4da6f08 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:23:30.824751 16435 raft_consensus.cc:697] T b0313caec0564fd5bf22e34524632537 P 3a01ebd6b99640978d77190fe4da6f08 [term 1 LEADER]: Becoming Leader. State: Replica: 3a01ebd6b99640978d77190fe4da6f08, State: Running, Role: LEADER
I20260709 13:23:30.826584 16442 consensus_queue.cc:1048] T 4f5a2d88e89448648f594ef23ef152cd P c6d026bb4a9146c395c2b8572753ffb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6070cdc51c6f49fcbcfbddd22a3c263c" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 41095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:23:30.829308 16206 leader_election.cc:304] T b0313caec0564fd5bf22e34524632537 P c6d026bb4a9146c395c2b8572753ffb7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6d026bb4a9146c395c2b8572753ffb7; no voters: 3a01ebd6b99640978d77190fe4da6f08, 6070cdc51c6f49fcbcfbddd22a3c263c
I20260709 13:23:30.830374 16442 raft_consensus.cc:2749] T b0313caec0564fd5bf22e34524632537 P c6d026bb4a9146c395c2b8572753ffb7 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:23:30.836483 16435 consensus_queue.cc:237] T b0313caec0564fd5bf22e34524632537 P 3a01ebd6b99640978d77190fe4da6f08 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6d026bb4a9146c395c2b8572753ffb7" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34303 } } peers { permanent_uuid: "6070cdc51c6f49fcbcfbddd22a3c263c" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 41095 } } peers { permanent_uuid: "3a01ebd6b99640978d77190fe4da6f08" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 45221 } }
I20260709 13:23:30.843221 16442 consensus_queue.cc:1048] T f55407f772b74aaba87440ba35c2ac8b P c6d026bb4a9146c395c2b8572753ffb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6070cdc51c6f49fcbcfbddd22a3c263c" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 41095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:23:30.845073 16458 consensus_queue.cc:1048] T 88caca305bf74120a011e3fa92781678 P 3a01ebd6b99640978d77190fe4da6f08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6d026bb4a9146c395c2b8572753ffb7" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:23:30.849175 16442 consensus_queue.cc:1048] T f55407f772b74aaba87440ba35c2ac8b P c6d026bb4a9146c395c2b8572753ffb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3a01ebd6b99640978d77190fe4da6f08" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 45221 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:23:30.856329 16484 raft_consensus.cc:493] T aab7ef362ab84369939a6a02d817aa53 P 6070cdc51c6f49fcbcfbddd22a3c263c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:23:30.857533 16484 raft_consensus.cc:515] T aab7ef362ab84369939a6a02d817aa53 P 6070cdc51c6f49fcbcfbddd22a3c263c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6d026bb4a9146c395c2b8572753ffb7" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34303 } } peers { permanent_uuid: "6070cdc51c6f49fcbcfbddd22a3c263c" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 41095 } } peers { permanent_uuid: "3a01ebd6b99640978d77190fe4da6f08" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 45221 } }
I20260709 13:23:30.862309 16242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aab7ef362ab84369939a6a02d817aa53" candidate_uuid: "6070cdc51c6f49fcbcfbddd22a3c263c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6d026bb4a9146c395c2b8572753ffb7" is_pre_election: true
I20260709 13:23:30.863389 16242 raft_consensus.cc:2468] T aab7ef362ab84369939a6a02d817aa53 P c6d026bb4a9146c395c2b8572753ffb7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6070cdc51c6f49fcbcfbddd22a3c263c in term 0.
I20260709 13:23:30.865198 16281 leader_election.cc:304] T aab7ef362ab84369939a6a02d817aa53 P 6070cdc51c6f49fcbcfbddd22a3c263c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6070cdc51c6f49fcbcfbddd22a3c263c, c6d026bb4a9146c395c2b8572753ffb7; no voters: 
I20260709 13:23:30.866487 16487 raft_consensus.cc:2804] T aab7ef362ab84369939a6a02d817aa53 P 6070cdc51c6f49fcbcfbddd22a3c263c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:23:30.867094 16487 raft_consensus.cc:493] T aab7ef362ab84369939a6a02d817aa53 P 6070cdc51c6f49fcbcfbddd22a3c263c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:23:30.867511 16487 raft_consensus.cc:3060] T aab7ef362ab84369939a6a02d817aa53 P 6070cdc51c6f49fcbcfbddd22a3c263c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:23:30.856451 16391 raft_consensus.cc:3060] T 4f5a2d88e89448648f594ef23ef152cd P 3a01ebd6b99640978d77190fe4da6f08 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:23:30.893996 16484 leader_election.cc:290] T aab7ef362ab84369939a6a02d817aa53 P 6070cdc51c6f49fcbcfbddd22a3c263c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c6d026bb4a9146c395c2b8572753ffb7 (127.5.126.65:34303), 3a01ebd6b99640978d77190fe4da6f08 (127.5.126.67:45221)
I20260709 13:23:30.888268 16487 raft_consensus.cc:515] T aab7ef362ab84369939a6a02d817aa53 P 6070cdc51c6f49fcbcfbddd22a3c263c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6d026bb4a9146c395c2b8572753ffb7" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34303 } } peers { permanent_uuid: "6070cdc51c6f49fcbcfbddd22a3c263c" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 41095 } } peers { permanent_uuid: "3a01ebd6b99640978d77190fe4da6f08" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 45221 } }
I20260709 13:23:30.897816 16487 leader_election.cc:290] T aab7ef362ab84369939a6a02d817aa53 P 6070cdc51c6f49fcbcfbddd22a3c263c [CANDIDATE]: Term 1 election: Requested vote from peers c6d026bb4a9146c395c2b8572753ffb7 (127.5.126.65:34303), 3a01ebd6b99640978d77190fe4da6f08 (127.5.126.67:45221)
I20260709 13:23:30.898988 16390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aab7ef362ab84369939a6a02d817aa53" candidate_uuid: "6070cdc51c6f49fcbcfbddd22a3c263c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3a01ebd6b99640978d77190fe4da6f08" is_pre_election: true
I20260709 13:23:30.899881 16390 raft_consensus.cc:2468] T aab7ef362ab84369939a6a02d817aa53 P 3a01ebd6b99640978d77190fe4da6f08 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6070cdc51c6f49fcbcfbddd22a3c263c in term 0.
I20260709 13:23:30.903980 16242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aab7ef362ab84369939a6a02d817aa53" candidate_uuid: "6070cdc51c6f49fcbcfbddd22a3c263c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6d026bb4a9146c395c2b8572753ffb7"
I20260709 13:23:30.904888 16242 raft_consensus.cc:3060] T aab7ef362ab84369939a6a02d817aa53 P c6d026bb4a9146c395c2b8572753ffb7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:23:30.909408 16390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aab7ef362ab84369939a6a02d817aa53" candidate_uuid: "6070cdc51c6f49fcbcfbddd22a3c263c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3a01ebd6b99640978d77190fe4da6f08"
I20260709 13:23:30.911880 16390 raft_consensus.cc:3060] T aab7ef362ab84369939a6a02d817aa53 P 3a01ebd6b99640978d77190fe4da6f08 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:23:30.918836 16242 raft_consensus.cc:2468] T aab7ef362ab84369939a6a02d817aa53 P c6d026bb4a9146c395c2b8572753ffb7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6070cdc51c6f49fcbcfbddd22a3c263c in term 1.
I20260709 13:23:30.920840 16281 leader_election.cc:304] T aab7ef362ab84369939a6a02d817aa53 P 6070cdc51c6f49fcbcfbddd22a3c263c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6070cdc51c6f49fcbcfbddd22a3c263c, c6d026bb4a9146c395c2b8572753ffb7; no voters: 
I20260709 13:23:30.921911 16487 raft_consensus.cc:2804] T aab7ef362ab84369939a6a02d817aa53 P 6070cdc51c6f49fcbcfbddd22a3c263c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:23:30.922894 16487 raft_consensus.cc:697] T aab7ef362ab84369939a6a02d817aa53 P 6070cdc51c6f49fcbcfbddd22a3c263c [term 1 LEADER]: Becoming Leader. State: Replica: 6070cdc51c6f49fcbcfbddd22a3c263c, State: Running, Role: LEADER
I20260709 13:23:30.899554 16139 catalog_manager.cc:5697] T b0313caec0564fd5bf22e34524632537 P 3a01ebd6b99640978d77190fe4da6f08 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3a01ebd6b99640978d77190fe4da6f08 (127.5.126.67). New cstate: current_term: 1 leader_uuid: "3a01ebd6b99640978d77190fe4da6f08" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6d026bb4a9146c395c2b8572753ffb7" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6070cdc51c6f49fcbcfbddd22a3c263c" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 41095 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3a01ebd6b99640978d77190fe4da6f08" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 45221 } health_report { overall_health: HEALTHY } } }
I20260709 13:23:30.924007 16487 consensus_queue.cc:237] T aab7ef362ab84369939a6a02d817aa53 P 6070cdc51c6f49fcbcfbddd22a3c263c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6d026bb4a9146c395c2b8572753ffb7" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34303 } } peers { permanent_uuid: "6070cdc51c6f49fcbcfbddd22a3c263c" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 41095 } } peers { permanent_uuid: "3a01ebd6b99640978d77190fe4da6f08" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 45221 } }
I20260709 13:23:30.936820 16440 consensus_queue.cc:1048] T 4f5a2d88e89448648f594ef23ef152cd P c6d026bb4a9146c395c2b8572753ffb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3a01ebd6b99640978d77190fe4da6f08" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 45221 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 13:23:30.972506 16188 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:23:30.981460 16139 catalog_manager.cc:5697] T aab7ef362ab84369939a6a02d817aa53 P 6070cdc51c6f49fcbcfbddd22a3c263c reported cstate change: term changed from 0 to 1, leader changed from <none> to 6070cdc51c6f49fcbcfbddd22a3c263c (127.5.126.66). New cstate: current_term: 1 leader_uuid: "6070cdc51c6f49fcbcfbddd22a3c263c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6d026bb4a9146c395c2b8572753ffb7" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6070cdc51c6f49fcbcfbddd22a3c263c" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 41095 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3a01ebd6b99640978d77190fe4da6f08" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 45221 } health_report { overall_health: UNKNOWN } } }
I20260709 13:23:30.984921 16390 raft_consensus.cc:2468] T aab7ef362ab84369939a6a02d817aa53 P 3a01ebd6b99640978d77190fe4da6f08 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6070cdc51c6f49fcbcfbddd22a3c263c in term 1.
I20260709 13:23:31.037985 16503 consensus_queue.cc:1048] T cb70c02d0bce438cbb6434b2c0aa54ae P 3a01ebd6b99640978d77190fe4da6f08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6070cdc51c6f49fcbcfbddd22a3c263c" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 41095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:23:31.053615 16435 consensus_queue.cc:1048] T cb70c02d0bce438cbb6434b2c0aa54ae P 3a01ebd6b99640978d77190fe4da6f08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6d026bb4a9146c395c2b8572753ffb7" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:23:31.154152 16435 consensus_queue.cc:1048] T 49ace918d4da4776b29f4aa41975e9ef P 3a01ebd6b99640978d77190fe4da6f08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6d026bb4a9146c395c2b8572753ffb7" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:23:31.159686 16477 consensus_queue.cc:1048] T b1e06a2952f94a919e5324bd1f0d7cab P c6d026bb4a9146c395c2b8572753ffb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6070cdc51c6f49fcbcfbddd22a3c263c" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 41095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:23:31.168211 16435 consensus_queue.cc:1048] T 49ace918d4da4776b29f4aa41975e9ef P 3a01ebd6b99640978d77190fe4da6f08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6070cdc51c6f49fcbcfbddd22a3c263c" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 41095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:23:31.183898 16477 consensus_queue.cc:1048] T b1e06a2952f94a919e5324bd1f0d7cab P c6d026bb4a9146c395c2b8572753ffb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3a01ebd6b99640978d77190fe4da6f08" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 45221 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:23:31.296324  5625 ts_manager.cc:295] Set tserver state for c6d026bb4a9146c395c2b8572753ffb7 to MAINTENANCE_MODE
I20260709 13:23:31.297263  5625 tablet_server.cc:179] TabletServer@127.5.126.65:0 shutting down...
I20260709 13:23:31.340659  5625 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:23:31.341814  5625 tablet_replica.cc:333] T b1e06a2952f94a919e5324bd1f0d7cab P c6d026bb4a9146c395c2b8572753ffb7: stopping tablet replica
I20260709 13:23:31.342737  5625 raft_consensus.cc:2243] T b1e06a2952f94a919e5324bd1f0d7cab P c6d026bb4a9146c395c2b8572753ffb7 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:23:31.343804  5625 raft_consensus.cc:2272] T b1e06a2952f94a919e5324bd1f0d7cab P c6d026bb4a9146c395c2b8572753ffb7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:31.347100  5625 tablet_replica.cc:333] T b0313caec0564fd5bf22e34524632537 P c6d026bb4a9146c395c2b8572753ffb7: stopping tablet replica
I20260709 13:23:31.347759  5625 raft_consensus.cc:2243] T b0313caec0564fd5bf22e34524632537 P c6d026bb4a9146c395c2b8572753ffb7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:23:31.348253  5625 raft_consensus.cc:2272] T b0313caec0564fd5bf22e34524632537 P c6d026bb4a9146c395c2b8572753ffb7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:31.350946  5625 tablet_replica.cc:333] T aab7ef362ab84369939a6a02d817aa53 P c6d026bb4a9146c395c2b8572753ffb7: stopping tablet replica
I20260709 13:23:31.351701  5625 raft_consensus.cc:2243] T aab7ef362ab84369939a6a02d817aa53 P c6d026bb4a9146c395c2b8572753ffb7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:23:31.352284  5625 raft_consensus.cc:2272] T aab7ef362ab84369939a6a02d817aa53 P c6d026bb4a9146c395c2b8572753ffb7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:31.356254  5625 tablet_replica.cc:333] T cb70c02d0bce438cbb6434b2c0aa54ae P c6d026bb4a9146c395c2b8572753ffb7: stopping tablet replica
I20260709 13:23:31.357009  5625 raft_consensus.cc:2243] T cb70c02d0bce438cbb6434b2c0aa54ae P c6d026bb4a9146c395c2b8572753ffb7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:23:31.357549  5625 raft_consensus.cc:2272] T cb70c02d0bce438cbb6434b2c0aa54ae P c6d026bb4a9146c395c2b8572753ffb7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:31.360513  5625 tablet_replica.cc:333] T f55407f772b74aaba87440ba35c2ac8b P c6d026bb4a9146c395c2b8572753ffb7: stopping tablet replica
I20260709 13:23:31.361096  5625 raft_consensus.cc:2243] T f55407f772b74aaba87440ba35c2ac8b P c6d026bb4a9146c395c2b8572753ffb7 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:23:31.361922  5625 raft_consensus.cc:2272] T f55407f772b74aaba87440ba35c2ac8b P c6d026bb4a9146c395c2b8572753ffb7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:31.364761  5625 tablet_replica.cc:333] T 4f5a2d88e89448648f594ef23ef152cd P c6d026bb4a9146c395c2b8572753ffb7: stopping tablet replica
I20260709 13:23:31.365376  5625 raft_consensus.cc:2243] T 4f5a2d88e89448648f594ef23ef152cd P c6d026bb4a9146c395c2b8572753ffb7 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:23:31.366119  5625 raft_consensus.cc:2272] T 4f5a2d88e89448648f594ef23ef152cd P c6d026bb4a9146c395c2b8572753ffb7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:31.369498  5625 tablet_replica.cc:333] T fd931932596f4755aeae878c0fe3c2d9 P c6d026bb4a9146c395c2b8572753ffb7: stopping tablet replica
I20260709 13:23:31.370433  5625 raft_consensus.cc:2243] T fd931932596f4755aeae878c0fe3c2d9 P c6d026bb4a9146c395c2b8572753ffb7 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:23:31.371389  5625 raft_consensus.cc:2272] T fd931932596f4755aeae878c0fe3c2d9 P c6d026bb4a9146c395c2b8572753ffb7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:31.374662  5625 tablet_replica.cc:333] T 88caca305bf74120a011e3fa92781678 P c6d026bb4a9146c395c2b8572753ffb7: stopping tablet replica
W20260709 13:23:31.374711 16281 consensus_peers.cc:597] T aab7ef362ab84369939a6a02d817aa53 P 6070cdc51c6f49fcbcfbddd22a3c263c -> Peer c6d026bb4a9146c395c2b8572753ffb7 (127.5.126.65:34303): Couldn't send request to peer c6d026bb4a9146c395c2b8572753ffb7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:23:31.375509  5625 raft_consensus.cc:2243] T 88caca305bf74120a011e3fa92781678 P c6d026bb4a9146c395c2b8572753ffb7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:23:31.375993  5625 raft_consensus.cc:2272] T 88caca305bf74120a011e3fa92781678 P c6d026bb4a9146c395c2b8572753ffb7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:31.378738  5625 tablet_replica.cc:333] T 49ace918d4da4776b29f4aa41975e9ef P c6d026bb4a9146c395c2b8572753ffb7: stopping tablet replica
I20260709 13:23:31.379297  5625 raft_consensus.cc:2243] T 49ace918d4da4776b29f4aa41975e9ef P c6d026bb4a9146c395c2b8572753ffb7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:23:31.379748  5625 raft_consensus.cc:2272] T 49ace918d4da4776b29f4aa41975e9ef P c6d026bb4a9146c395c2b8572753ffb7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:31.382700  5625 tablet_replica.cc:333] T 5066abfe4261488f96534730b07ce4d5 P c6d026bb4a9146c395c2b8572753ffb7: stopping tablet replica
I20260709 13:23:31.383304  5625 raft_consensus.cc:2243] T 5066abfe4261488f96534730b07ce4d5 P c6d026bb4a9146c395c2b8572753ffb7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:23:31.383780  5625 raft_consensus.cc:2272] T 5066abfe4261488f96534730b07ce4d5 P c6d026bb4a9146c395c2b8572753ffb7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:31.417081 16435 consensus_queue.cc:1048] T b0313caec0564fd5bf22e34524632537 P 3a01ebd6b99640978d77190fe4da6f08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6070cdc51c6f49fcbcfbddd22a3c263c" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 41095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:23:31.421002  5625 tablet_server.cc:196] TabletServer@127.5.126.65:0 shutdown complete.
W20260709 13:23:31.434074 16355 consensus_peers.cc:597] T b0313caec0564fd5bf22e34524632537 P 3a01ebd6b99640978d77190fe4da6f08 -> Peer c6d026bb4a9146c395c2b8572753ffb7 (127.5.126.65:34303): Couldn't send request to peer c6d026bb4a9146c395c2b8572753ffb7. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:34303: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:23:31.437749 16355 consensus_peers.cc:597] T 88caca305bf74120a011e3fa92781678 P 3a01ebd6b99640978d77190fe4da6f08 -> Peer c6d026bb4a9146c395c2b8572753ffb7 (127.5.126.65:34303): Couldn't send request to peer c6d026bb4a9146c395c2b8572753ffb7. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:34303: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:23:31.537446 16487 consensus_queue.cc:1048] T aab7ef362ab84369939a6a02d817aa53 P 6070cdc51c6f49fcbcfbddd22a3c263c [LEADER]: Connected to new peer: Peer: permanent_uuid: "3a01ebd6b99640978d77190fe4da6f08" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 45221 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:23:31.593392 16355 consensus_peers.cc:597] T cb70c02d0bce438cbb6434b2c0aa54ae P 3a01ebd6b99640978d77190fe4da6f08 -> Peer c6d026bb4a9146c395c2b8572753ffb7 (127.5.126.65:34303): Couldn't send request to peer c6d026bb4a9146c395c2b8572753ffb7. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:34303: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:23:31.618486 16355 consensus_peers.cc:597] T 5066abfe4261488f96534730b07ce4d5 P 3a01ebd6b99640978d77190fe4da6f08 -> Peer c6d026bb4a9146c395c2b8572753ffb7 (127.5.126.65:34303): Couldn't send request to peer c6d026bb4a9146c395c2b8572753ffb7. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:34303: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:23:31.680323 16355 consensus_peers.cc:597] T 49ace918d4da4776b29f4aa41975e9ef P 3a01ebd6b99640978d77190fe4da6f08 -> Peer c6d026bb4a9146c395c2b8572753ffb7 (127.5.126.65:34303): Couldn't send request to peer c6d026bb4a9146c395c2b8572753ffb7. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:34303: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:23:31.928121 16281 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.5.126.65:34303: connect: Connection refused (error 111) [suppressed 131 similar messages]
W20260709 13:23:31.973878 16188 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:23:32.435292 16523 raft_consensus.cc:493] T 4f5a2d88e89448648f594ef23ef152cd P 6070cdc51c6f49fcbcfbddd22a3c263c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c6d026bb4a9146c395c2b8572753ffb7)
I20260709 13:23:32.435914 16523 raft_consensus.cc:515] T 4f5a2d88e89448648f594ef23ef152cd P 6070cdc51c6f49fcbcfbddd22a3c263c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6d026bb4a9146c395c2b8572753ffb7" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34303 } } peers { permanent_uuid: "3a01ebd6b99640978d77190fe4da6f08" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 45221 } } peers { permanent_uuid: "6070cdc51c6f49fcbcfbddd22a3c263c" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 41095 } }
I20260709 13:23:32.438247 16523 leader_election.cc:290] T 4f5a2d88e89448648f594ef23ef152cd P 6070cdc51c6f49fcbcfbddd22a3c263c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c6d026bb4a9146c395c2b8572753ffb7 (127.5.126.65:34303), 3a01ebd6b99640978d77190fe4da6f08 (127.5.126.67:45221)
I20260709 13:23:32.438997 16523 raft_consensus.cc:493] T f55407f772b74aaba87440ba35c2ac8b P 6070cdc51c6f49fcbcfbddd22a3c263c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c6d026bb4a9146c395c2b8572753ffb7)
I20260709 13:23:32.439605 16523 raft_consensus.cc:515] T f55407f772b74aaba87440ba35c2ac8b P 6070cdc51c6f49fcbcfbddd22a3c263c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6d026bb4a9146c395c2b8572753ffb7" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34303 } } peers { permanent_uuid: "6070cdc51c6f49fcbcfbddd22a3c263c" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 41095 } } peers { permanent_uuid: "3a01ebd6b99640978d77190fe4da6f08" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 45221 } }
I20260709 13:23:32.440912 16390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f5a2d88e89448648f594ef23ef152cd" candidate_uuid: "6070cdc51c6f49fcbcfbddd22a3c263c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3a01ebd6b99640978d77190fe4da6f08" is_pre_election: true
I20260709 13:23:32.442044 16523 leader_election.cc:290] T f55407f772b74aaba87440ba35c2ac8b P 6070cdc51c6f49fcbcfbddd22a3c263c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c6d026bb4a9146c395c2b8572753ffb7 (127.5.126.65:34303), 3a01ebd6b99640978d77190fe4da6f08 (127.5.126.67:45221)
W20260709 13:23:32.444545 16281 leader_election.cc:336] T 4f5a2d88e89448648f594ef23ef152cd P 6070cdc51c6f49fcbcfbddd22a3c263c [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer c6d026bb4a9146c395c2b8572753ffb7 (127.5.126.65:34303): Network error: Client connection negotiation failed: client connection to 127.5.126.65:34303: connect: Connection refused (error 111)
I20260709 13:23:32.444660 16390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f55407f772b74aaba87440ba35c2ac8b" candidate_uuid: "6070cdc51c6f49fcbcfbddd22a3c263c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3a01ebd6b99640978d77190fe4da6f08" is_pre_election: true
I20260709 13:23:32.445161 16281 leader_election.cc:304] T 4f5a2d88e89448648f594ef23ef152cd P 6070cdc51c6f49fcbcfbddd22a3c263c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6070cdc51c6f49fcbcfbddd22a3c263c; no voters: 3a01ebd6b99640978d77190fe4da6f08, c6d026bb4a9146c395c2b8572753ffb7
I20260709 13:23:32.445940 16523 raft_consensus.cc:2749] T 4f5a2d88e89448648f594ef23ef152cd P 6070cdc51c6f49fcbcfbddd22a3c263c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:23:32.448256 16281 leader_election.cc:336] T f55407f772b74aaba87440ba35c2ac8b P 6070cdc51c6f49fcbcfbddd22a3c263c [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer c6d026bb4a9146c395c2b8572753ffb7 (127.5.126.65:34303): Network error: Client connection negotiation failed: client connection to 127.5.126.65:34303: connect: Connection refused (error 111)
I20260709 13:23:32.448662 16281 leader_election.cc:304] T f55407f772b74aaba87440ba35c2ac8b P 6070cdc51c6f49fcbcfbddd22a3c263c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6070cdc51c6f49fcbcfbddd22a3c263c; no voters: 3a01ebd6b99640978d77190fe4da6f08, c6d026bb4a9146c395c2b8572753ffb7
I20260709 13:23:32.449297 16523 raft_consensus.cc:2749] T f55407f772b74aaba87440ba35c2ac8b P 6070cdc51c6f49fcbcfbddd22a3c263c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:23:32.470890 16503 raft_consensus.cc:493] T f55407f772b74aaba87440ba35c2ac8b P 3a01ebd6b99640978d77190fe4da6f08 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c6d026bb4a9146c395c2b8572753ffb7)
I20260709 13:23:32.471843 16503 raft_consensus.cc:515] T f55407f772b74aaba87440ba35c2ac8b P 3a01ebd6b99640978d77190fe4da6f08 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6d026bb4a9146c395c2b8572753ffb7" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34303 } } peers { permanent_uuid: "6070cdc51c6f49fcbcfbddd22a3c263c" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 41095 } } peers { permanent_uuid: "3a01ebd6b99640978d77190fe4da6f08" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 45221 } }
I20260709 13:23:32.473970 16503 leader_election.cc:290] T f55407f772b74aaba87440ba35c2ac8b P 3a01ebd6b99640978d77190fe4da6f08 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c6d026bb4a9146c395c2b8572753ffb7 (127.5.126.65:34303), 6070cdc51c6f49fcbcfbddd22a3c263c (127.5.126.66:41095)
I20260709 13:23:32.475979 16314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f55407f772b74aaba87440ba35c2ac8b" candidate_uuid: "3a01ebd6b99640978d77190fe4da6f08" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6070cdc51c6f49fcbcfbddd22a3c263c" is_pre_election: true
I20260709 13:23:32.476903 16314 raft_consensus.cc:2468] T f55407f772b74aaba87440ba35c2ac8b P 6070cdc51c6f49fcbcfbddd22a3c263c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3a01ebd6b99640978d77190fe4da6f08 in term 1.
I20260709 13:23:32.478211 16355 leader_election.cc:304] T f55407f772b74aaba87440ba35c2ac8b P 3a01ebd6b99640978d77190fe4da6f08 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3a01ebd6b99640978d77190fe4da6f08, 6070cdc51c6f49fcbcfbddd22a3c263c; no voters: 
W20260709 13:23:32.479136 16355 leader_election.cc:336] T f55407f772b74aaba87440ba35c2ac8b P 3a01ebd6b99640978d77190fe4da6f08 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer c6d026bb4a9146c395c2b8572753ffb7 (127.5.126.65:34303): Network error: Client connection negotiation failed: client connection to 127.5.126.65:34303: connect: Connection refused (error 111)
I20260709 13:23:32.479157 16503 raft_consensus.cc:2804] T f55407f772b74aaba87440ba35c2ac8b P 3a01ebd6b99640978d77190fe4da6f08 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:23:32.479825 16503 raft_consensus.cc:493] T f55407f772b74aaba87440ba35c2ac8b P 3a01ebd6b99640978d77190fe4da6f08 [term 1 FOLLOWER]: Starting leader election (detected failure of leader c6d026bb4a9146c395c2b8572753ffb7)
I20260709 13:23:32.480244 16503 raft_consensus.cc:3060] T f55407f772b74aaba87440ba35c2ac8b P 3a01ebd6b99640978d77190fe4da6f08 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:23:32.493331 16503 raft_consensus.cc:515] T f55407f772b74aaba87440ba35c2ac8b P 3a01ebd6b99640978d77190fe4da6f08 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6d026bb4a9146c395c2b8572753ffb7" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34303 } } peers { permanent_uuid: "6070cdc51c6f49fcbcfbddd22a3c263c" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 41095 } } peers { permanent_uuid: "3a01ebd6b99640978d77190fe4da6f08" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 45221 } }
I20260709 13:23:32.499333 16503 leader_election.cc:290] T f55407f772b74aaba87440ba35c2ac8b P 3a01ebd6b99640978d77190fe4da6f08 [CANDIDATE]: Term 2 election: Requested vote from peers c6d026bb4a9146c395c2b8572753ffb7 (127.5.126.65:34303), 6070cdc51c6f49fcbcfbddd22a3c263c (127.5.126.66:41095)
W20260709 13:23:33.432493 16188 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:23:33.457665 16529 raft_consensus.cc:493] T b1e06a2952f94a919e5324bd1f0d7cab P 6070cdc51c6f49fcbcfbddd22a3c263c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c6d026bb4a9146c395c2b8572753ffb7)
I20260709 13:23:33.457930 16528 raft_consensus.cc:493] T fd931932596f4755aeae878c0fe3c2d9 P 6070cdc51c6f49fcbcfbddd22a3c263c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c6d026bb4a9146c395c2b8572753ffb7)
I20260709 13:23:33.458832 16528 raft_consensus.cc:515] T fd931932596f4755aeae878c0fe3c2d9 P 6070cdc51c6f49fcbcfbddd22a3c263c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6d026bb4a9146c395c2b8572753ffb7" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34303 } } peers { permanent_uuid: "6070cdc51c6f49fcbcfbddd22a3c263c" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 41095 } } peers { permanent_uuid: "3a01ebd6b99640978d77190fe4da6f08" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 45221 } }
I20260709 13:23:33.458696 16529 raft_consensus.cc:515] T b1e06a2952f94a919e5324bd1f0d7cab P 6070cdc51c6f49fcbcfbddd22a3c263c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6d026bb4a9146c395c2b8572753ffb7" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34303 } } peers { permanent_uuid: "6070cdc51c6f49fcbcfbddd22a3c263c" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 41095 } } peers { permanent_uuid: "3a01ebd6b99640978d77190fe4da6f08" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 45221 } }
I20260709 13:23:33.462091 16528 leader_election.cc:290] T fd931932596f4755aeae878c0fe3c2d9 P 6070cdc51c6f49fcbcfbddd22a3c263c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c6d026bb4a9146c395c2b8572753ffb7 (127.5.126.65:34303), 3a01ebd6b99640978d77190fe4da6f08 (127.5.126.67:45221)
I20260709 13:23:33.462771 16529 leader_election.cc:290] T b1e06a2952f94a919e5324bd1f0d7cab P 6070cdc51c6f49fcbcfbddd22a3c263c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c6d026bb4a9146c395c2b8572753ffb7 (127.5.126.65:34303), 3a01ebd6b99640978d77190fe4da6f08 (127.5.126.67:45221)
I20260709 13:23:33.465673 16314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f55407f772b74aaba87440ba35c2ac8b" candidate_uuid: "3a01ebd6b99640978d77190fe4da6f08" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6070cdc51c6f49fcbcfbddd22a3c263c"
I20260709 13:23:33.466432 16314 raft_consensus.cc:3060] T f55407f772b74aaba87440ba35c2ac8b P 6070cdc51c6f49fcbcfbddd22a3c263c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:23:33.473402 16532 raft_consensus.cc:493] T b1e06a2952f94a919e5324bd1f0d7cab P 3a01ebd6b99640978d77190fe4da6f08 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c6d026bb4a9146c395c2b8572753ffb7)
I20260709 13:23:33.498109 16535 raft_consensus.cc:493] T 4f5a2d88e89448648f594ef23ef152cd P 3a01ebd6b99640978d77190fe4da6f08 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c6d026bb4a9146c395c2b8572753ffb7)
I20260709 13:23:33.498848 16535 raft_consensus.cc:515] T 4f5a2d88e89448648f594ef23ef152cd P 3a01ebd6b99640978d77190fe4da6f08 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6d026bb4a9146c395c2b8572753ffb7" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34303 } } peers { permanent_uuid: "3a01ebd6b99640978d77190fe4da6f08" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 45221 } } peers { permanent_uuid: "6070cdc51c6f49fcbcfbddd22a3c263c" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 41095 } }
I20260709 13:23:33.500480 16390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd931932596f4755aeae878c0fe3c2d9" candidate_uuid: "6070cdc51c6f49fcbcfbddd22a3c263c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3a01ebd6b99640978d77190fe4da6f08" is_pre_election: true
I20260709 13:23:33.501226 16390 raft_consensus.cc:2468] T fd931932596f4755aeae878c0fe3c2d9 P 3a01ebd6b99640978d77190fe4da6f08 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6070cdc51c6f49fcbcfbddd22a3c263c in term 1.
I20260709 13:23:33.492761 16532 raft_consensus.cc:515] T b1e06a2952f94a919e5324bd1f0d7cab P 3a01ebd6b99640978d77190fe4da6f08 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6d026bb4a9146c395c2b8572753ffb7" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34303 } } peers { permanent_uuid: "6070cdc51c6f49fcbcfbddd22a3c263c" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 41095 } } peers { permanent_uuid: "3a01ebd6b99640978d77190fe4da6f08" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 45221 } }
I20260709 13:23:33.504346 16390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1e06a2952f94a919e5324bd1f0d7cab" candidate_uuid: "6070cdc51c6f49fcbcfbddd22a3c263c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3a01ebd6b99640978d77190fe4da6f08" is_pre_election: true
I20260709 13:23:33.504998 16390 raft_consensus.cc:2468] T b1e06a2952f94a919e5324bd1f0d7cab P 3a01ebd6b99640978d77190fe4da6f08 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6070cdc51c6f49fcbcfbddd22a3c263c in term 1.
I20260709 13:23:33.505453 16532 leader_election.cc:290] T b1e06a2952f94a919e5324bd1f0d7cab P 3a01ebd6b99640978d77190fe4da6f08 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c6d026bb4a9146c395c2b8572753ffb7 (127.5.126.65:34303), 6070cdc51c6f49fcbcfbddd22a3c263c (127.5.126.66:41095)
I20260709 13:23:33.507982 16535 leader_election.cc:290] T 4f5a2d88e89448648f594ef23ef152cd P 3a01ebd6b99640978d77190fe4da6f08 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c6d026bb4a9146c395c2b8572753ffb7 (127.5.126.65:34303), 6070cdc51c6f49fcbcfbddd22a3c263c (127.5.126.66:41095)
I20260709 13:23:33.507812 16281 leader_election.cc:304] T fd931932596f4755aeae878c0fe3c2d9 P 6070cdc51c6f49fcbcfbddd22a3c263c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3a01ebd6b99640978d77190fe4da6f08, 6070cdc51c6f49fcbcfbddd22a3c263c; no voters: 
I20260709 13:23:33.508878 16529 raft_consensus.cc:2804] T fd931932596f4755aeae878c0fe3c2d9 P 6070cdc51c6f49fcbcfbddd22a3c263c [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:23:33.509017 16281 leader_election.cc:304] T b1e06a2952f94a919e5324bd1f0d7cab P 6070cdc51c6f49fcbcfbddd22a3c263c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3a01ebd6b99640978d77190fe4da6f08, 6070cdc51c6f49fcbcfbddd22a3c263c; no voters: 
I20260709 13:23:33.509271 16529 raft_consensus.cc:493] T fd931932596f4755aeae878c0fe3c2d9 P 6070cdc51c6f49fcbcfbddd22a3c263c [term 1 FOLLOWER]: Starting leader election (detected failure of leader c6d026bb4a9146c395c2b8572753ffb7)
I20260709 13:23:33.509656 16529 raft_consensus.cc:3060] T fd931932596f4755aeae878c0fe3c2d9 P 6070cdc51c6f49fcbcfbddd22a3c263c [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:23:33.512418 16281 leader_election.cc:336] T fd931932596f4755aeae878c0fe3c2d9 P 6070cdc51c6f49fcbcfbddd22a3c263c [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer c6d026bb4a9146c395c2b8572753ffb7 (127.5.126.65:34303): Network error: Client connection negotiation failed: client connection to 127.5.126.65:34303: connect: Connection refused (error 111)
W20260709 13:23:33.513247 16281 leader_election.cc:336] T b1e06a2952f94a919e5324bd1f0d7cab P 6070cdc51c6f49fcbcfbddd22a3c263c [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer c6d026bb4a9146c395c2b8572753ffb7 (127.5.126.65:34303): Network error: Client connection negotiation failed: client connection to 127.5.126.65:34303: connect: Connection refused (error 111)
I20260709 13:23:33.512247 16528 raft_consensus.cc:2804] T b1e06a2952f94a919e5324bd1f0d7cab P 6070cdc51c6f49fcbcfbddd22a3c263c [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:23:33.513734 16528 raft_consensus.cc:493] T b1e06a2952f94a919e5324bd1f0d7cab P 6070cdc51c6f49fcbcfbddd22a3c263c [term 1 FOLLOWER]: Starting leader election (detected failure of leader c6d026bb4a9146c395c2b8572753ffb7)
I20260709 13:23:33.514073 16528 raft_consensus.cc:3060] T b1e06a2952f94a919e5324bd1f0d7cab P 6070cdc51c6f49fcbcfbddd22a3c263c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:23:33.520982 16528 raft_consensus.cc:515] T b1e06a2952f94a919e5324bd1f0d7cab P 6070cdc51c6f49fcbcfbddd22a3c263c [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6d026bb4a9146c395c2b8572753ffb7" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34303 } } peers { permanent_uuid: "6070cdc51c6f49fcbcfbddd22a3c263c" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 41095 } } peers { permanent_uuid: "3a01ebd6b99640978d77190fe4da6f08" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 45221 } }
I20260709 13:23:33.509640 16314 raft_consensus.cc:2468] T f55407f772b74aaba87440ba35c2ac8b P 6070cdc51c6f49fcbcfbddd22a3c263c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3a01ebd6b99640978d77190fe4da6f08 in term 2.
I20260709 13:23:33.521030 16529 raft_consensus.cc:515] T fd931932596f4755aeae878c0fe3c2d9 P 6070cdc51c6f49fcbcfbddd22a3c263c [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6d026bb4a9146c395c2b8572753ffb7" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34303 } } peers { permanent_uuid: "6070cdc51c6f49fcbcfbddd22a3c263c" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 41095 } } peers { permanent_uuid: "3a01ebd6b99640978d77190fe4da6f08" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 45221 } }
I20260709 13:23:33.526810 16528 leader_election.cc:290] T b1e06a2952f94a919e5324bd1f0d7cab P 6070cdc51c6f49fcbcfbddd22a3c263c [CANDIDATE]: Term 2 election: Requested vote from peers c6d026bb4a9146c395c2b8572753ffb7 (127.5.126.65:34303), 3a01ebd6b99640978d77190fe4da6f08 (127.5.126.67:45221)
I20260709 13:23:33.528352 16390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1e06a2952f94a919e5324bd1f0d7cab" candidate_uuid: "6070cdc51c6f49fcbcfbddd22a3c263c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3a01ebd6b99640978d77190fe4da6f08"
I20260709 13:23:33.528949 16390 raft_consensus.cc:3060] T b1e06a2952f94a919e5324bd1f0d7cab P 3a01ebd6b99640978d77190fe4da6f08 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:23:33.530484 16281 leader_election.cc:336] T b1e06a2952f94a919e5324bd1f0d7cab P 6070cdc51c6f49fcbcfbddd22a3c263c [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer c6d026bb4a9146c395c2b8572753ffb7 (127.5.126.65:34303): Network error: Client connection negotiation failed: client connection to 127.5.126.65:34303: connect: Connection refused (error 111)
I20260709 13:23:33.530923 16529 leader_election.cc:290] T fd931932596f4755aeae878c0fe3c2d9 P 6070cdc51c6f49fcbcfbddd22a3c263c [CANDIDATE]: Term 2 election: Requested vote from peers c6d026bb4a9146c395c2b8572753ffb7 (127.5.126.65:34303), 3a01ebd6b99640978d77190fe4da6f08 (127.5.126.67:45221)
I20260709 13:23:33.532912 16391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd931932596f4755aeae878c0fe3c2d9" candidate_uuid: "6070cdc51c6f49fcbcfbddd22a3c263c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3a01ebd6b99640978d77190fe4da6f08"
I20260709 13:23:33.533617 16391 raft_consensus.cc:3060] T fd931932596f4755aeae878c0fe3c2d9 P 3a01ebd6b99640978d77190fe4da6f08 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:23:33.537647 16390 raft_consensus.cc:2468] T b1e06a2952f94a919e5324bd1f0d7cab P 3a01ebd6b99640978d77190fe4da6f08 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6070cdc51c6f49fcbcfbddd22a3c263c in term 2.
I20260709 13:23:33.539476 16281 leader_election.cc:304] T b1e06a2952f94a919e5324bd1f0d7cab P 6070cdc51c6f49fcbcfbddd22a3c263c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3a01ebd6b99640978d77190fe4da6f08, 6070cdc51c6f49fcbcfbddd22a3c263c; no voters: c6d026bb4a9146c395c2b8572753ffb7
I20260709 13:23:33.539878 16314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1e06a2952f94a919e5324bd1f0d7cab" candidate_uuid: "3a01ebd6b99640978d77190fe4da6f08" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6070cdc51c6f49fcbcfbddd22a3c263c" is_pre_election: true
I20260709 13:23:33.540297 16317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f5a2d88e89448648f594ef23ef152cd" candidate_uuid: "3a01ebd6b99640978d77190fe4da6f08" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6070cdc51c6f49fcbcfbddd22a3c263c" is_pre_election: true
I20260709 13:23:33.540957 16314 raft_consensus.cc:2393] T b1e06a2952f94a919e5324bd1f0d7cab P 6070cdc51c6f49fcbcfbddd22a3c263c [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3a01ebd6b99640978d77190fe4da6f08 in current term 2: Already voted for candidate 6070cdc51c6f49fcbcfbddd22a3c263c in this term.
I20260709 13:23:33.540889 16317 raft_consensus.cc:2468] T 4f5a2d88e89448648f594ef23ef152cd P 6070cdc51c6f49fcbcfbddd22a3c263c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3a01ebd6b99640978d77190fe4da6f08 in term 1.
W20260709 13:23:33.541472 16281 leader_election.cc:336] T fd931932596f4755aeae878c0fe3c2d9 P 6070cdc51c6f49fcbcfbddd22a3c263c [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer c6d026bb4a9146c395c2b8572753ffb7 (127.5.126.65:34303): Network error: Client connection negotiation failed: client connection to 127.5.126.65:34303: connect: Connection refused (error 111)
I20260709 13:23:33.542475 16355 leader_election.cc:304] T f55407f772b74aaba87440ba35c2ac8b P 3a01ebd6b99640978d77190fe4da6f08 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3a01ebd6b99640978d77190fe4da6f08, 6070cdc51c6f49fcbcfbddd22a3c263c; no voters: 
I20260709 13:23:33.543219 16540 raft_consensus.cc:2804] T f55407f772b74aaba87440ba35c2ac8b P 3a01ebd6b99640978d77190fe4da6f08 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:23:33.543277 16391 raft_consensus.cc:2468] T fd931932596f4755aeae878c0fe3c2d9 P 3a01ebd6b99640978d77190fe4da6f08 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6070cdc51c6f49fcbcfbddd22a3c263c in term 2.
I20260709 13:23:33.543956 16540 raft_consensus.cc:697] T f55407f772b74aaba87440ba35c2ac8b P 3a01ebd6b99640978d77190fe4da6f08 [term 2 LEADER]: Becoming Leader. State: Replica: 3a01ebd6b99640978d77190fe4da6f08, State: Running, Role: LEADER
I20260709 13:23:33.544741 16281 leader_election.cc:304] T fd931932596f4755aeae878c0fe3c2d9 P 6070cdc51c6f49fcbcfbddd22a3c263c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3a01ebd6b99640978d77190fe4da6f08, 6070cdc51c6f49fcbcfbddd22a3c263c; no voters: c6d026bb4a9146c395c2b8572753ffb7
I20260709 13:23:33.544814 16529 raft_consensus.cc:2804] T b1e06a2952f94a919e5324bd1f0d7cab P 6070cdc51c6f49fcbcfbddd22a3c263c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:23:33.546036 16528 raft_consensus.cc:2804] T fd931932596f4755aeae878c0fe3c2d9 P 6070cdc51c6f49fcbcfbddd22a3c263c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:23:33.544919 16540 consensus_queue.cc:237] T f55407f772b74aaba87440ba35c2ac8b P 3a01ebd6b99640978d77190fe4da6f08 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6d026bb4a9146c395c2b8572753ffb7" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34303 } } peers { permanent_uuid: "6070cdc51c6f49fcbcfbddd22a3c263c" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 41095 } } peers { permanent_uuid: "3a01ebd6b99640978d77190fe4da6f08" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 45221 } }
I20260709 13:23:33.547417 16529 raft_consensus.cc:697] T b1e06a2952f94a919e5324bd1f0d7cab P 6070cdc51c6f49fcbcfbddd22a3c263c [term 2 LEADER]: Becoming Leader. State: Replica: 6070cdc51c6f49fcbcfbddd22a3c263c, State: Running, Role: LEADER
I20260709 13:23:33.548748 16355 leader_election.cc:304] T 4f5a2d88e89448648f594ef23ef152cd P 3a01ebd6b99640978d77190fe4da6f08 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3a01ebd6b99640978d77190fe4da6f08, 6070cdc51c6f49fcbcfbddd22a3c263c; no voters: 
I20260709 13:23:33.548620 16529 consensus_queue.cc:237] T b1e06a2952f94a919e5324bd1f0d7cab P 6070cdc51c6f49fcbcfbddd22a3c263c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6d026bb4a9146c395c2b8572753ffb7" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34303 } } peers { permanent_uuid: "6070cdc51c6f49fcbcfbddd22a3c263c" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 41095 } } peers { permanent_uuid: "3a01ebd6b99640978d77190fe4da6f08" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 45221 } }
I20260709 13:23:33.549666 16538 raft_consensus.cc:2804] T 4f5a2d88e89448648f594ef23ef152cd P 3a01ebd6b99640978d77190fe4da6f08 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:23:33.550072 16538 raft_consensus.cc:493] T 4f5a2d88e89448648f594ef23ef152cd P 3a01ebd6b99640978d77190fe4da6f08 [term 1 FOLLOWER]: Starting leader election (detected failure of leader c6d026bb4a9146c395c2b8572753ffb7)
I20260709 13:23:33.550432 16538 raft_consensus.cc:3060] T 4f5a2d88e89448648f594ef23ef152cd P 3a01ebd6b99640978d77190fe4da6f08 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:23:33.560760 16355 leader_election.cc:336] T f55407f772b74aaba87440ba35c2ac8b P 3a01ebd6b99640978d77190fe4da6f08 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer c6d026bb4a9146c395c2b8572753ffb7 (127.5.126.65:34303): Network error: Client connection negotiation failed: client connection to 127.5.126.65:34303: connect: Connection refused (error 111)
I20260709 13:23:33.564594 16538 raft_consensus.cc:515] T 4f5a2d88e89448648f594ef23ef152cd P 3a01ebd6b99640978d77190fe4da6f08 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6d026bb4a9146c395c2b8572753ffb7" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34303 } } peers { permanent_uuid: "3a01ebd6b99640978d77190fe4da6f08" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 45221 } } peers { permanent_uuid: "6070cdc51c6f49fcbcfbddd22a3c263c" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 41095 } }
I20260709 13:23:33.565145 16139 catalog_manager.cc:5697] T f55407f772b74aaba87440ba35c2ac8b P 3a01ebd6b99640978d77190fe4da6f08 reported cstate change: term changed from 1 to 2, leader changed from c6d026bb4a9146c395c2b8572753ffb7 (127.5.126.65) to 3a01ebd6b99640978d77190fe4da6f08 (127.5.126.67). New cstate: current_term: 2 leader_uuid: "3a01ebd6b99640978d77190fe4da6f08" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6d026bb4a9146c395c2b8572753ffb7" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6070cdc51c6f49fcbcfbddd22a3c263c" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 41095 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3a01ebd6b99640978d77190fe4da6f08" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 45221 } health_report { overall_health: HEALTHY } } }
I20260709 13:23:33.567502 16538 leader_election.cc:290] T 4f5a2d88e89448648f594ef23ef152cd P 3a01ebd6b99640978d77190fe4da6f08 [CANDIDATE]: Term 2 election: Requested vote from peers c6d026bb4a9146c395c2b8572753ffb7 (127.5.126.65:34303), 6070cdc51c6f49fcbcfbddd22a3c263c (127.5.126.66:41095)
I20260709 13:23:33.569377 16528 raft_consensus.cc:697] T fd931932596f4755aeae878c0fe3c2d9 P 6070cdc51c6f49fcbcfbddd22a3c263c [term 2 LEADER]: Becoming Leader. State: Replica: 6070cdc51c6f49fcbcfbddd22a3c263c, State: Running, Role: LEADER
I20260709 13:23:33.570590 16528 consensus_queue.cc:237] T fd931932596f4755aeae878c0fe3c2d9 P 6070cdc51c6f49fcbcfbddd22a3c263c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6d026bb4a9146c395c2b8572753ffb7" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34303 } } peers { permanent_uuid: "6070cdc51c6f49fcbcfbddd22a3c263c" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 41095 } } peers { permanent_uuid: "3a01ebd6b99640978d77190fe4da6f08" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 45221 } }
W20260709 13:23:33.573616 16355 leader_election.cc:336] T b1e06a2952f94a919e5324bd1f0d7cab P 3a01ebd6b99640978d77190fe4da6f08 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer c6d026bb4a9146c395c2b8572753ffb7 (127.5.126.65:34303): Network error: Client connection negotiation failed: client connection to 127.5.126.65:34303: connect: Connection refused (error 111)
I20260709 13:23:33.574968 16314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f5a2d88e89448648f594ef23ef152cd" candidate_uuid: "3a01ebd6b99640978d77190fe4da6f08" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6070cdc51c6f49fcbcfbddd22a3c263c"
I20260709 13:23:33.575101 16355 leader_election.cc:304] T b1e06a2952f94a919e5324bd1f0d7cab P 3a01ebd6b99640978d77190fe4da6f08 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3a01ebd6b99640978d77190fe4da6f08; no voters: 6070cdc51c6f49fcbcfbddd22a3c263c, c6d026bb4a9146c395c2b8572753ffb7
I20260709 13:23:33.575574 16314 raft_consensus.cc:3060] T 4f5a2d88e89448648f594ef23ef152cd P 6070cdc51c6f49fcbcfbddd22a3c263c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:23:33.576010 16538 raft_consensus.cc:2749] T b1e06a2952f94a919e5324bd1f0d7cab P 3a01ebd6b99640978d77190fe4da6f08 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:23:33.576329 16355 leader_election.cc:336] T 4f5a2d88e89448648f594ef23ef152cd P 3a01ebd6b99640978d77190fe4da6f08 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer c6d026bb4a9146c395c2b8572753ffb7 (127.5.126.65:34303): Network error: Client connection negotiation failed: client connection to 127.5.126.65:34303: connect: Connection refused (error 111)
W20260709 13:23:33.581609 16355 leader_election.cc:336] T 4f5a2d88e89448648f594ef23ef152cd P 3a01ebd6b99640978d77190fe4da6f08 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer c6d026bb4a9146c395c2b8572753ffb7 (127.5.126.65:34303): Network error: Client connection negotiation failed: client connection to 127.5.126.65:34303: connect: Connection refused (error 111)
I20260709 13:23:33.585902 16314 raft_consensus.cc:2468] T 4f5a2d88e89448648f594ef23ef152cd P 6070cdc51c6f49fcbcfbddd22a3c263c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3a01ebd6b99640978d77190fe4da6f08 in term 2.
I20260709 13:23:33.587502 16355 leader_election.cc:304] T 4f5a2d88e89448648f594ef23ef152cd P 3a01ebd6b99640978d77190fe4da6f08 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3a01ebd6b99640978d77190fe4da6f08, 6070cdc51c6f49fcbcfbddd22a3c263c; no voters: c6d026bb4a9146c395c2b8572753ffb7
I20260709 13:23:33.587858 16137 catalog_manager.cc:5697] T b1e06a2952f94a919e5324bd1f0d7cab P 6070cdc51c6f49fcbcfbddd22a3c263c reported cstate change: term changed from 1 to 2, leader changed from c6d026bb4a9146c395c2b8572753ffb7 (127.5.126.65) to 6070cdc51c6f49fcbcfbddd22a3c263c (127.5.126.66). New cstate: current_term: 2 leader_uuid: "6070cdc51c6f49fcbcfbddd22a3c263c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6d026bb4a9146c395c2b8572753ffb7" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6070cdc51c6f49fcbcfbddd22a3c263c" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 41095 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3a01ebd6b99640978d77190fe4da6f08" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 45221 } health_report { overall_health: UNKNOWN } } }
I20260709 13:23:33.588841 16538 raft_consensus.cc:2804] T 4f5a2d88e89448648f594ef23ef152cd P 3a01ebd6b99640978d77190fe4da6f08 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:23:33.589643 16538 raft_consensus.cc:697] T 4f5a2d88e89448648f594ef23ef152cd P 3a01ebd6b99640978d77190fe4da6f08 [term 2 LEADER]: Becoming Leader. State: Replica: 3a01ebd6b99640978d77190fe4da6f08, State: Running, Role: LEADER
I20260709 13:23:33.590055 16137 catalog_manager.cc:5697] T fd931932596f4755aeae878c0fe3c2d9 P 6070cdc51c6f49fcbcfbddd22a3c263c reported cstate change: term changed from 1 to 2, leader changed from c6d026bb4a9146c395c2b8572753ffb7 (127.5.126.65) to 6070cdc51c6f49fcbcfbddd22a3c263c (127.5.126.66). New cstate: current_term: 2 leader_uuid: "6070cdc51c6f49fcbcfbddd22a3c263c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6d026bb4a9146c395c2b8572753ffb7" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6070cdc51c6f49fcbcfbddd22a3c263c" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 41095 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3a01ebd6b99640978d77190fe4da6f08" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 45221 } health_report { overall_health: UNKNOWN } } }
I20260709 13:23:33.590678 16538 consensus_queue.cc:237] T 4f5a2d88e89448648f594ef23ef152cd P 3a01ebd6b99640978d77190fe4da6f08 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6d026bb4a9146c395c2b8572753ffb7" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34303 } } peers { permanent_uuid: "3a01ebd6b99640978d77190fe4da6f08" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 45221 } } peers { permanent_uuid: "6070cdc51c6f49fcbcfbddd22a3c263c" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 41095 } }
I20260709 13:23:33.601589 16139 catalog_manager.cc:5697] T 4f5a2d88e89448648f594ef23ef152cd P 3a01ebd6b99640978d77190fe4da6f08 reported cstate change: term changed from 1 to 2, leader changed from c6d026bb4a9146c395c2b8572753ffb7 (127.5.126.65) to 3a01ebd6b99640978d77190fe4da6f08 (127.5.126.67). New cstate: current_term: 2 leader_uuid: "3a01ebd6b99640978d77190fe4da6f08" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6d026bb4a9146c395c2b8572753ffb7" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3a01ebd6b99640978d77190fe4da6f08" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 45221 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6070cdc51c6f49fcbcfbddd22a3c263c" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 41095 } health_report { overall_health: UNKNOWN } } }
I20260709 13:23:33.966344 16314 raft_consensus.cc:1275] T f55407f772b74aaba87440ba35c2ac8b P 6070cdc51c6f49fcbcfbddd22a3c263c [term 2 FOLLOWER]: Refusing update from remote peer 3a01ebd6b99640978d77190fe4da6f08: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:23:33.967803 16538 consensus_queue.cc:1048] T f55407f772b74aaba87440ba35c2ac8b P 3a01ebd6b99640978d77190fe4da6f08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6070cdc51c6f49fcbcfbddd22a3c263c" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 41095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:23:33.972133 16391 raft_consensus.cc:1275] T fd931932596f4755aeae878c0fe3c2d9 P 3a01ebd6b99640978d77190fe4da6f08 [term 2 FOLLOWER]: Refusing update from remote peer 6070cdc51c6f49fcbcfbddd22a3c263c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:23:33.973692 16528 consensus_queue.cc:1048] T fd931932596f4755aeae878c0fe3c2d9 P 6070cdc51c6f49fcbcfbddd22a3c263c [LEADER]: Connected to new peer: Peer: permanent_uuid: "3a01ebd6b99640978d77190fe4da6f08" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 45221 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 13:23:33.993604 16355 consensus_peers.cc:597] T f55407f772b74aaba87440ba35c2ac8b P 3a01ebd6b99640978d77190fe4da6f08 -> Peer c6d026bb4a9146c395c2b8572753ffb7 (127.5.126.65:34303): Couldn't send request to peer c6d026bb4a9146c395c2b8572753ffb7. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:34303: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:23:34.002127 16281 consensus_peers.cc:597] T fd931932596f4755aeae878c0fe3c2d9 P 6070cdc51c6f49fcbcfbddd22a3c263c -> Peer c6d026bb4a9146c395c2b8572753ffb7 (127.5.126.65:34303): Couldn't send request to peer c6d026bb4a9146c395c2b8572753ffb7. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:34303: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:23:34.056578 16281 consensus_peers.cc:597] T b1e06a2952f94a919e5324bd1f0d7cab P 6070cdc51c6f49fcbcfbddd22a3c263c -> Peer c6d026bb4a9146c395c2b8572753ffb7 (127.5.126.65:34303): Couldn't send request to peer c6d026bb4a9146c395c2b8572753ffb7. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:34303: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:23:34.065127 16391 raft_consensus.cc:1275] T b1e06a2952f94a919e5324bd1f0d7cab P 3a01ebd6b99640978d77190fe4da6f08 [term 2 FOLLOWER]: Refusing update from remote peer 6070cdc51c6f49fcbcfbddd22a3c263c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:23:34.066548 16543 consensus_queue.cc:1048] T b1e06a2952f94a919e5324bd1f0d7cab P 6070cdc51c6f49fcbcfbddd22a3c263c [LEADER]: Connected to new peer: Peer: permanent_uuid: "3a01ebd6b99640978d77190fe4da6f08" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 45221 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:23:34.090137 16355 consensus_peers.cc:597] T 4f5a2d88e89448648f594ef23ef152cd P 3a01ebd6b99640978d77190fe4da6f08 -> Peer c6d026bb4a9146c395c2b8572753ffb7 (127.5.126.65:34303): Couldn't send request to peer c6d026bb4a9146c395c2b8572753ffb7. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:34303: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:23:34.165707 16314 raft_consensus.cc:1275] T 4f5a2d88e89448648f594ef23ef152cd P 6070cdc51c6f49fcbcfbddd22a3c263c [term 2 FOLLOWER]: Refusing update from remote peer 3a01ebd6b99640978d77190fe4da6f08: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:23:34.167140 16532 consensus_queue.cc:1048] T 4f5a2d88e89448648f594ef23ef152cd P 3a01ebd6b99640978d77190fe4da6f08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6070cdc51c6f49fcbcfbddd22a3c263c" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 41095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:23:34.329264 16355 consensus_peers.cc:597] T b0313caec0564fd5bf22e34524632537 P 3a01ebd6b99640978d77190fe4da6f08 -> Peer c6d026bb4a9146c395c2b8572753ffb7 (127.5.126.65:34303): Couldn't send request to peer c6d026bb4a9146c395c2b8572753ffb7. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:34303: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:23:34.433715 16188 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
W20260709 13:23:34.455030 16412 debug-util.cc:398] Leaking SignalData structure 0x7b08001f4cc0 after lost signal to thread 5628
W20260709 13:23:34.456753 16412 debug-util.cc:398] Leaking SignalData structure 0x7b080032b2a0 after lost signal to thread 16174
W20260709 13:23:34.458252 16412 debug-util.cc:398] Leaking SignalData structure 0x7b0800224720 after lost signal to thread 16341
W20260709 13:23:34.459435 16412 debug-util.cc:398] Leaking SignalData structure 0x7b0800065920 after lost signal to thread 16415
W20260709 13:23:34.555106 16355 consensus_peers.cc:597] T cb70c02d0bce438cbb6434b2c0aa54ae P 3a01ebd6b99640978d77190fe4da6f08 -> Peer c6d026bb4a9146c395c2b8572753ffb7 (127.5.126.65:34303): Couldn't send request to peer c6d026bb4a9146c395c2b8572753ffb7. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:34303: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:23:34.563760 16355 consensus_peers.cc:597] T 88caca305bf74120a011e3fa92781678 P 3a01ebd6b99640978d77190fe4da6f08 -> Peer c6d026bb4a9146c395c2b8572753ffb7 (127.5.126.65:34303): Couldn't send request to peer c6d026bb4a9146c395c2b8572753ffb7. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:34303: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:23:34.929754 16355 consensus_peers.cc:597] T 49ace918d4da4776b29f4aa41975e9ef P 3a01ebd6b99640978d77190fe4da6f08 -> Peer c6d026bb4a9146c395c2b8572753ffb7 (127.5.126.65:34303): Couldn't send request to peer c6d026bb4a9146c395c2b8572753ffb7. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:34303: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:23:34.975409 16355 consensus_peers.cc:597] T 5066abfe4261488f96534730b07ce4d5 P 3a01ebd6b99640978d77190fe4da6f08 -> Peer c6d026bb4a9146c395c2b8572753ffb7 (127.5.126.65:34303): Couldn't send request to peer c6d026bb4a9146c395c2b8572753ffb7. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:34303: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:23:35.127079 16281 consensus_peers.cc:597] T aab7ef362ab84369939a6a02d817aa53 P 6070cdc51c6f49fcbcfbddd22a3c263c -> Peer c6d026bb4a9146c395c2b8572753ffb7 (127.5.126.65:34303): Couldn't send request to peer c6d026bb4a9146c395c2b8572753ffb7. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:34303: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:23:35.434886 16188 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
W20260709 13:23:36.232251 16281 consensus_peers.cc:597] T fd931932596f4755aeae878c0fe3c2d9 P 6070cdc51c6f49fcbcfbddd22a3c263c -> Peer c6d026bb4a9146c395c2b8572753ffb7 (127.5.126.65:34303): Couldn't send request to peer c6d026bb4a9146c395c2b8572753ffb7. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:34303: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:23:36.436251 16188 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
W20260709 13:23:36.439088 16355 consensus_peers.cc:597] T 4f5a2d88e89448648f594ef23ef152cd P 3a01ebd6b99640978d77190fe4da6f08 -> Peer c6d026bb4a9146c395c2b8572753ffb7 (127.5.126.65:34303): Couldn't send request to peer c6d026bb4a9146c395c2b8572753ffb7. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:34303: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:23:36.493019 16281 consensus_peers.cc:597] T b1e06a2952f94a919e5324bd1f0d7cab P 6070cdc51c6f49fcbcfbddd22a3c263c -> Peer c6d026bb4a9146c395c2b8572753ffb7 (127.5.126.65:34303): Couldn't send request to peer c6d026bb4a9146c395c2b8572753ffb7. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:34303: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:23:36.733007 16355 consensus_peers.cc:597] T f55407f772b74aaba87440ba35c2ac8b P 3a01ebd6b99640978d77190fe4da6f08 -> Peer c6d026bb4a9146c395c2b8572753ffb7 (127.5.126.65:34303): Couldn't send request to peer c6d026bb4a9146c395c2b8572753ffb7. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:34303: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:23:36.929167 16281 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.5.126.65:34303: connect: Connection refused (error 111) [suppressed 87 similar messages]
W20260709 13:23:36.948720 16355 consensus_peers.cc:597] T b0313caec0564fd5bf22e34524632537 P 3a01ebd6b99640978d77190fe4da6f08 -> Peer c6d026bb4a9146c395c2b8572753ffb7 (127.5.126.65:34303): Couldn't send request to peer c6d026bb4a9146c395c2b8572753ffb7. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:34303: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:23:36.991712 16355 consensus_peers.cc:597] T 88caca305bf74120a011e3fa92781678 P 3a01ebd6b99640978d77190fe4da6f08 -> Peer c6d026bb4a9146c395c2b8572753ffb7 (127.5.126.65:34303): Couldn't send request to peer c6d026bb4a9146c395c2b8572753ffb7. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:34303: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:23:37.006701 16355 consensus_peers.cc:597] T cb70c02d0bce438cbb6434b2c0aa54ae P 3a01ebd6b99640978d77190fe4da6f08 -> Peer c6d026bb4a9146c395c2b8572753ffb7 (127.5.126.65:34303): Couldn't send request to peer c6d026bb4a9146c395c2b8572753ffb7. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:34303: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:23:37.271183 16355 consensus_peers.cc:597] T 49ace918d4da4776b29f4aa41975e9ef P 3a01ebd6b99640978d77190fe4da6f08 -> Peer c6d026bb4a9146c395c2b8572753ffb7 (127.5.126.65:34303): Couldn't send request to peer c6d026bb4a9146c395c2b8572753ffb7. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:34303: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:23:37.437495 16188 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:23:37.444299  5625 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:23:37.454871 16562 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:23:37.455061 16561 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:23:37.456887 16564 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:23:37.459937  5625 server_base.cc:1061] running on GCE node
I20260709 13:23:37.461663  5625 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:23:37.461875  5625 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:23:37.462143  5625 hybrid_clock.cc:648] HybridClock initialized: now 1783603417462091 us; error 0 us; skew 500 ppm
I20260709 13:23:37.462780  5625 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:23:37.466014  5625 webserver.cc:533] Webserver started at http://127.5.126.65:43655/ using document root <none> and password file <none>
I20260709 13:23:37.466689  5625 fs_manager.cc:362] Metadata directory not provided
I20260709 13:23:37.466918  5625 fs_manager.cc:365] Using existing metadata directory in first data directory
I20260709 13:23:37.471189  5625 fs_manager.cc:714] Time spent opening directory manager: real 0.003s	user 0.001s	sys 0.004s
I20260709 13:23:37.475787 16569 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:23:37.476979  5625 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20260709 13:23:37.477427  5625 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskWHb0CB/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783603057096655-5625-0/minicluster-data/ts-0-root
uuid: "c6d026bb4a9146c395c2b8572753ffb7"
format_stamp: "Formatted at 2026-07-09 13:23:29 on dist-test-slave-smzk"
I20260709 13:23:37.477771  5625 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWHb0CB/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783603057096655-5625-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskWHb0CB/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783603057096655-5625-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskWHb0CB/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783603057096655-5625-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:23:37.491016  5625 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:23:37.492486  5625 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:23:37.494102  5625 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:23:37.498157 16576 ts_tablet_manager.cc:548] Loading tablet metadata (0/10 complete)
W20260709 13:23:37.503294 16281 consensus_peers.cc:597] T aab7ef362ab84369939a6a02d817aa53 P 6070cdc51c6f49fcbcfbddd22a3c263c -> Peer c6d026bb4a9146c395c2b8572753ffb7 (127.5.126.65:34303): Couldn't send request to peer c6d026bb4a9146c395c2b8572753ffb7. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:34303: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:23:37.552649  5625 ts_tablet_manager.cc:585] Loaded tablet metadata (10 total tablets, 10 live tablets)
I20260709 13:23:37.553148  5625 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.056s	user 0.003s	sys 0.000s
I20260709 13:23:37.553483  5625 ts_tablet_manager.cc:600] Registering tablets (0/10 complete)
I20260709 13:23:37.558960 16576 tablet_bootstrap.cc:492] T b1e06a2952f94a919e5324bd1f0d7cab P c6d026bb4a9146c395c2b8572753ffb7: Bootstrap starting.
I20260709 13:23:37.575138 16576 tablet_bootstrap.cc:492] T b1e06a2952f94a919e5324bd1f0d7cab P c6d026bb4a9146c395c2b8572753ffb7: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:23:37.576093 16576 tablet_bootstrap.cc:492] T b1e06a2952f94a919e5324bd1f0d7cab P c6d026bb4a9146c395c2b8572753ffb7: Bootstrap complete.
I20260709 13:23:37.576705 16576 ts_tablet_manager.cc:1403] T b1e06a2952f94a919e5324bd1f0d7cab P c6d026bb4a9146c395c2b8572753ffb7: Time spent bootstrapping tablet: real 0.018s	user 0.009s	sys 0.008s
I20260709 13:23:37.579191 16576 raft_consensus.cc:359] T b1e06a2952f94a919e5324bd1f0d7cab P c6d026bb4a9146c395c2b8572753ffb7 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6d026bb4a9146c395c2b8572753ffb7" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34303 } } peers { permanent_uuid: "6070cdc51c6f49fcbcfbddd22a3c263c" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 41095 } } peers { permanent_uuid: "3a01ebd6b99640978d77190fe4da6f08" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 45221 } }
I20260709 13:23:37.579816 16576 raft_consensus.cc:740] T b1e06a2952f94a919e5324bd1f0d7cab P c6d026bb4a9146c395c2b8572753ffb7 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: c6d026bb4a9146c395c2b8572753ffb7, State: Initialized, Role: FOLLOWER
I20260709 13:23:37.580612 16576 consensus_queue.cc:260] T b1e06a2952f94a919e5324bd1f0d7cab P c6d026bb4a9146c395c2b8572753ffb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6d026bb4a9146c395c2b8572753ffb7" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34303 } } peers { permanent_uuid: "6070cdc51c6f49fcbcfbddd22a3c263c" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 41095 } } peers { permanent_uuid: "3a01ebd6b99640978d77190fe4da6f08" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 45221 } }
I20260709 13:23:37.583204 16576 ts_tablet_manager.cc:1434] T b1e06a2952f94a919e5324bd1f0d7cab P c6d026bb4a9146c395c2b8572753ffb7: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 13:23:37.583982 16576 tablet_bootstrap.cc:492] T 88caca305bf74120a011e3fa92781678 P c6d026bb4a9146c395c2b8572753ffb7: Bootstrap starting.
I20260709 13:23:37.592435  5625 ts_tablet_manager.cc:616] Registered 10 tablets
I20260709 13:23:37.592779  5625 ts_tablet_manager.cc:595] Time spent register tablets: real 0.039s	user 0.039s	sys 0.000s
I20260709 13:23:37.600016 16576 tablet_bootstrap.cc:492] T 88caca305bf74120a011e3fa92781678 P c6d026bb4a9146c395c2b8572753ffb7: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:23:37.601102 16576 tablet_bootstrap.cc:492] T 88caca305bf74120a011e3fa92781678 P c6d026bb4a9146c395c2b8572753ffb7: Bootstrap complete.
I20260709 13:23:37.601862 16576 ts_tablet_manager.cc:1403] T 88caca305bf74120a011e3fa92781678 P c6d026bb4a9146c395c2b8572753ffb7: Time spent bootstrapping tablet: real 0.018s	user 0.008s	sys 0.008s
I20260709 13:23:37.605352 16576 raft_consensus.cc:359] T 88caca305bf74120a011e3fa92781678 P c6d026bb4a9146c395c2b8572753ffb7 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6d026bb4a9146c395c2b8572753ffb7" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34303 } } peers { permanent_uuid: "6070cdc51c6f49fcbcfbddd22a3c263c" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 41095 } } peers { permanent_uuid: "3a01ebd6b99640978d77190fe4da6f08" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 45221 } }
I20260709 13:23:37.606353 16576 raft_consensus.cc:740] T 88caca305bf74120a011e3fa92781678 P c6d026bb4a9146c395c2b8572753ffb7 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: c6d026bb4a9146c395c2b8572753ffb7, State: Initialized, Role: FOLLOWER
I20260709 13:23:37.607295 16576 consensus_queue.cc:260] T 88caca305bf74120a011e3fa92781678 P c6d026bb4a9146c395c2b8572753ffb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6d026bb4a9146c395c2b8572753ffb7" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34303 } } peers { permanent_uuid: "6070cdc51c6f49fcbcfbddd22a3c263c" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 41095 } } peers { permanent_uuid: "3a01ebd6b99640978d77190fe4da6f08" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 45221 } }
I20260709 13:23:37.609895 16576 ts_tablet_manager.cc:1434] T 88caca305bf74120a011e3fa92781678 P c6d026bb4a9146c395c2b8572753ffb7: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 13:23:37.610948 16576 tablet_bootstrap.cc:492] T aab7ef362ab84369939a6a02d817aa53 P c6d026bb4a9146c395c2b8572753ffb7: Bootstrap starting.
I20260709 13:23:37.628970 16576 tablet_bootstrap.cc:492] T aab7ef362ab84369939a6a02d817aa53 P c6d026bb4a9146c395c2b8572753ffb7: Bootstrap replayed 1/1 log segments. Stats: ops{read=0 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:23:37.629938 16576 tablet_bootstrap.cc:492] T aab7ef362ab84369939a6a02d817aa53 P c6d026bb4a9146c395c2b8572753ffb7: Bootstrap complete.
I20260709 13:23:37.630650 16576 ts_tablet_manager.cc:1403] T aab7ef362ab84369939a6a02d817aa53 P c6d026bb4a9146c395c2b8572753ffb7: Time spent bootstrapping tablet: real 0.020s	user 0.013s	sys 0.004s
I20260709 13:23:37.633222 16576 raft_consensus.cc:359] T aab7ef362ab84369939a6a02d817aa53 P c6d026bb4a9146c395c2b8572753ffb7 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6d026bb4a9146c395c2b8572753ffb7" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34303 } } peers { permanent_uuid: "6070cdc51c6f49fcbcfbddd22a3c263c" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 41095 } } peers { permanent_uuid: "3a01ebd6b99640978d77190fe4da6f08" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 45221 } }
I20260709 13:23:37.633872 16576 raft_consensus.cc:740] T aab7ef362ab84369939a6a02d817aa53 P c6d026bb4a9146c395c2b8572753ffb7 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: c6d026bb4a9146c395c2b8572753ffb7, State: Initialized, Role: FOLLOWER
I20260709 13:23:37.634680 16576 consensus_queue.cc:260] T aab7ef362ab84369939a6a02d817aa53 P c6d026bb4a9146c395c2b8572753ffb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6d026bb4a9146c395c2b8572753ffb7" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34303 } } peers { permanent_uuid: "6070cdc51c6f49fcbcfbddd22a3c263c" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 41095 } } peers { permanent_uuid: "3a01ebd6b99640978d77190fe4da6f08" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 45221 } }
I20260709 13:23:37.636607 16576 ts_tablet_manager.cc:1434] T aab7ef362ab84369939a6a02d817aa53 P c6d026bb4a9146c395c2b8572753ffb7: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.002s
I20260709 13:23:37.637468 16576 tablet_bootstrap.cc:492] T 5066abfe4261488f96534730b07ce4d5 P c6d026bb4a9146c395c2b8572753ffb7: Bootstrap starting.
I20260709 13:23:37.651980 16576 tablet_bootstrap.cc:492] T 5066abfe4261488f96534730b07ce4d5 P c6d026bb4a9146c395c2b8572753ffb7: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:23:37.653108 16576 tablet_bootstrap.cc:492] T 5066abfe4261488f96534730b07ce4d5 P c6d026bb4a9146c395c2b8572753ffb7: Bootstrap complete.
I20260709 13:23:37.653852 16576 ts_tablet_manager.cc:1403] T 5066abfe4261488f96534730b07ce4d5 P c6d026bb4a9146c395c2b8572753ffb7: Time spent bootstrapping tablet: real 0.017s	user 0.010s	sys 0.005s
I20260709 13:23:37.656172 16576 raft_consensus.cc:359] T 5066abfe4261488f96534730b07ce4d5 P c6d026bb4a9146c395c2b8572753ffb7 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6d026bb4a9146c395c2b8572753ffb7" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34303 } } peers { permanent_uuid: "6070cdc51c6f49fcbcfbddd22a3c263c" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 41095 } } peers { permanent_uuid: "3a01ebd6b99640978d77190fe4da6f08" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 45221 } }
I20260709 13:23:37.656438  5625 rpc_server.cc:307] RPC server started. Bound to: 127.5.126.65:34303
I20260709 13:23:37.656548 16637 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.5.126.65:34303 every 8 connection(s)
I20260709 13:23:37.656781 16576 raft_consensus.cc:740] T 5066abfe4261488f96534730b07ce4d5 P c6d026bb4a9146c395c2b8572753ffb7 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: c6d026bb4a9146c395c2b8572753ffb7, State: Initialized, Role: FOLLOWER
I20260709 13:23:37.657881 16576 consensus_queue.cc:260] T 5066abfe4261488f96534730b07ce4d5 P c6d026bb4a9146c395c2b8572753ffb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6d026bb4a9146c395c2b8572753ffb7" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34303 } } peers { permanent_uuid: "6070cdc51c6f49fcbcfbddd22a3c263c" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 41095 } } peers { permanent_uuid: "3a01ebd6b99640978d77190fe4da6f08" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 45221 } }
I20260709 13:23:37.659526 16576 ts_tablet_manager.cc:1434] T 5066abfe4261488f96534730b07ce4d5 P c6d026bb4a9146c395c2b8572753ffb7: Time spent starting tablet: real 0.005s	user 0.005s	sys 0.000s
I20260709 13:23:37.660316 16576 tablet_bootstrap.cc:492] T 49ace918d4da4776b29f4aa41975e9ef P c6d026bb4a9146c395c2b8572753ffb7: Bootstrap starting.
I20260709 13:23:37.671849  5625 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:23:37.687408 16576 tablet_bootstrap.cc:492] T 49ace918d4da4776b29f4aa41975e9ef P c6d026bb4a9146c395c2b8572753ffb7: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:23:37.688877 16576 tablet_bootstrap.cc:492] T 49ace918d4da4776b29f4aa41975e9ef P c6d026bb4a9146c395c2b8572753ffb7: Bootstrap complete.
I20260709 13:23:37.689846 16576 ts_tablet_manager.cc:1403] T 49ace918d4da4776b29f4aa41975e9ef P c6d026bb4a9146c395c2b8572753ffb7: Time spent bootstrapping tablet: real 0.030s	user 0.019s	sys 0.005s
I20260709 13:23:37.693701 16576 raft_consensus.cc:359] T 49ace918d4da4776b29f4aa41975e9ef P c6d026bb4a9146c395c2b8572753ffb7 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6d026bb4a9146c395c2b8572753ffb7" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34303 } } peers { permanent_uuid: "6070cdc51c6f49fcbcfbddd22a3c263c" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 41095 } } peers { permanent_uuid: "3a01ebd6b99640978d77190fe4da6f08" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 45221 } }
I20260709 13:23:37.694494 16576 raft_consensus.cc:740] T 49ace918d4da4776b29f4aa41975e9ef P c6d026bb4a9146c395c2b8572753ffb7 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: c6d026bb4a9146c395c2b8572753ffb7, State: Initialized, Role: FOLLOWER
I20260709 13:23:37.695282 16576 consensus_queue.cc:260] T 49ace918d4da4776b29f4aa41975e9ef P c6d026bb4a9146c395c2b8572753ffb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6d026bb4a9146c395c2b8572753ffb7" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34303 } } peers { permanent_uuid: "6070cdc51c6f49fcbcfbddd22a3c263c" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 41095 } } peers { permanent_uuid: "3a01ebd6b99640978d77190fe4da6f08" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 45221 } }
I20260709 13:23:37.697834 16576 ts_tablet_manager.cc:1434] T 49ace918d4da4776b29f4aa41975e9ef P c6d026bb4a9146c395c2b8572753ffb7: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 13:23:37.699057 16576 tablet_bootstrap.cc:492] T f55407f772b74aaba87440ba35c2ac8b P c6d026bb4a9146c395c2b8572753ffb7: Bootstrap starting.
I20260709 13:23:37.711755 16638 heartbeater.cc:344] Connected to a master server at 127.5.126.126:35803
I20260709 13:23:37.712343 16638 heartbeater.cc:461] Registering TS with master...
I20260709 13:23:37.712427 16391 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5066abfe4261488f96534730b07ce4d5"
dest_uuid: "3a01ebd6b99640978d77190fe4da6f08"
mode: GRACEFUL
new_leader_uuid: "6070cdc51c6f49fcbcfbddd22a3c263c"
 from {username='slave'} at 127.0.0.1:43066
I20260709 13:23:37.713382 16391 raft_consensus.cc:606] T 5066abfe4261488f96534730b07ce4d5 P 3a01ebd6b99640978d77190fe4da6f08 [term 1 LEADER]: Received request to transfer leadership to TS 6070cdc51c6f49fcbcfbddd22a3c263c
I20260709 13:23:37.713476 16638 heartbeater.cc:507] Master 127.5.126.126:35803 requested a full tablet report, sending...
I20260709 13:23:37.717116 16391 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b0313caec0564fd5bf22e34524632537"
dest_uuid: "3a01ebd6b99640978d77190fe4da6f08"
mode: GRACEFUL
new_leader_uuid: "6070cdc51c6f49fcbcfbddd22a3c263c"
 from {username='slave'} at 127.0.0.1:43066
I20260709 13:23:37.717949 16391 raft_consensus.cc:606] T b0313caec0564fd5bf22e34524632537 P 3a01ebd6b99640978d77190fe4da6f08 [term 1 LEADER]: Received request to transfer leadership to TS 6070cdc51c6f49fcbcfbddd22a3c263c
I20260709 13:23:37.719177 16576 tablet_bootstrap.cc:492] T f55407f772b74aaba87440ba35c2ac8b P c6d026bb4a9146c395c2b8572753ffb7: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:23:37.720295 16576 tablet_bootstrap.cc:492] T f55407f772b74aaba87440ba35c2ac8b P c6d026bb4a9146c395c2b8572753ffb7: Bootstrap complete.
I20260709 13:23:37.721068 16576 ts_tablet_manager.cc:1403] T f55407f772b74aaba87440ba35c2ac8b P c6d026bb4a9146c395c2b8572753ffb7: Time spent bootstrapping tablet: real 0.022s	user 0.017s	sys 0.003s
I20260709 13:23:37.721472 16391 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "cb70c02d0bce438cbb6434b2c0aa54ae"
dest_uuid: "3a01ebd6b99640978d77190fe4da6f08"
mode: GRACEFUL
new_leader_uuid: "6070cdc51c6f49fcbcfbddd22a3c263c"
 from {username='slave'} at 127.0.0.1:43066
I20260709 13:23:37.722266 16137 ts_manager.cc:194] Re-registered known tserver with Master: c6d026bb4a9146c395c2b8572753ffb7 (127.5.126.65:34303)
I20260709 13:23:37.724009 16576 raft_consensus.cc:359] T f55407f772b74aaba87440ba35c2ac8b P c6d026bb4a9146c395c2b8572753ffb7 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6d026bb4a9146c395c2b8572753ffb7" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34303 } } peers { permanent_uuid: "6070cdc51c6f49fcbcfbddd22a3c263c" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 41095 } } peers { permanent_uuid: "3a01ebd6b99640978d77190fe4da6f08" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 45221 } }
I20260709 13:23:37.722239 16391 raft_consensus.cc:606] T cb70c02d0bce438cbb6434b2c0aa54ae P 3a01ebd6b99640978d77190fe4da6f08 [term 1 LEADER]: Received request to transfer leadership to TS 6070cdc51c6f49fcbcfbddd22a3c263c
I20260709 13:23:37.724926 16576 raft_consensus.cc:740] T f55407f772b74aaba87440ba35c2ac8b P c6d026bb4a9146c395c2b8572753ffb7 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: c6d026bb4a9146c395c2b8572753ffb7, State: Initialized, Role: FOLLOWER
I20260709 13:23:37.725824 16576 consensus_queue.cc:260] T f55407f772b74aaba87440ba35c2ac8b P c6d026bb4a9146c395c2b8572753ffb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6d026bb4a9146c395c2b8572753ffb7" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34303 } } peers { permanent_uuid: "6070cdc51c6f49fcbcfbddd22a3c263c" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 41095 } } peers { permanent_uuid: "3a01ebd6b99640978d77190fe4da6f08" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 45221 } }
I20260709 13:23:37.726327  5625 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 13:23:37.727164  5625 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:23:37.728003  5625 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:23:37.728304 16576 ts_tablet_manager.cc:1434] T f55407f772b74aaba87440ba35c2ac8b P c6d026bb4a9146c395c2b8572753ffb7: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.001s
I20260709 13:23:37.729295 16576 tablet_bootstrap.cc:492] T fd931932596f4755aeae878c0fe3c2d9 P c6d026bb4a9146c395c2b8572753ffb7: Bootstrap starting.
I20260709 13:23:37.737201 16612 raft_consensus.cc:3060] T f55407f772b74aaba87440ba35c2ac8b P c6d026bb4a9146c395c2b8572753ffb7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:23:37.738826 16137 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:56074
I20260709 13:23:37.743048 16638 heartbeater.cc:499] Master 127.5.126.126:35803 was elected leader, sending a full tablet report...
I20260709 13:23:37.747493 16576 tablet_bootstrap.cc:492] T fd931932596f4755aeae878c0fe3c2d9 P c6d026bb4a9146c395c2b8572753ffb7: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:23:37.748617 16576 tablet_bootstrap.cc:492] T fd931932596f4755aeae878c0fe3c2d9 P c6d026bb4a9146c395c2b8572753ffb7: Bootstrap complete.
I20260709 13:23:37.749475 16576 ts_tablet_manager.cc:1403] T fd931932596f4755aeae878c0fe3c2d9 P c6d026bb4a9146c395c2b8572753ffb7: Time spent bootstrapping tablet: real 0.020s	user 0.011s	sys 0.007s
I20260709 13:23:37.752519 16576 raft_consensus.cc:359] T fd931932596f4755aeae878c0fe3c2d9 P c6d026bb4a9146c395c2b8572753ffb7 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6d026bb4a9146c395c2b8572753ffb7" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34303 } } peers { permanent_uuid: "6070cdc51c6f49fcbcfbddd22a3c263c" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 41095 } } peers { permanent_uuid: "3a01ebd6b99640978d77190fe4da6f08" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 45221 } }
I20260709 13:23:37.753247 16576 raft_consensus.cc:740] T fd931932596f4755aeae878c0fe3c2d9 P c6d026bb4a9146c395c2b8572753ffb7 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: c6d026bb4a9146c395c2b8572753ffb7, State: Initialized, Role: FOLLOWER
I20260709 13:23:37.753887 16576 consensus_queue.cc:260] T fd931932596f4755aeae878c0fe3c2d9 P c6d026bb4a9146c395c2b8572753ffb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6d026bb4a9146c395c2b8572753ffb7" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34303 } } peers { permanent_uuid: "6070cdc51c6f49fcbcfbddd22a3c263c" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 41095 } } peers { permanent_uuid: "3a01ebd6b99640978d77190fe4da6f08" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 45221 } }
I20260709 13:23:37.756875 16576 ts_tablet_manager.cc:1434] T fd931932596f4755aeae878c0fe3c2d9 P c6d026bb4a9146c395c2b8572753ffb7: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:23:37.757673 16576 tablet_bootstrap.cc:492] T 4f5a2d88e89448648f594ef23ef152cd P c6d026bb4a9146c395c2b8572753ffb7: Bootstrap starting.
I20260709 13:23:37.771414 16576 tablet_bootstrap.cc:492] T 4f5a2d88e89448648f594ef23ef152cd P c6d026bb4a9146c395c2b8572753ffb7: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:23:37.772624 16576 tablet_bootstrap.cc:492] T 4f5a2d88e89448648f594ef23ef152cd P c6d026bb4a9146c395c2b8572753ffb7: Bootstrap complete.
I20260709 13:23:37.773375 16576 ts_tablet_manager.cc:1403] T 4f5a2d88e89448648f594ef23ef152cd P c6d026bb4a9146c395c2b8572753ffb7: Time spent bootstrapping tablet: real 0.016s	user 0.006s	sys 0.008s
I20260709 13:23:37.776463 16576 raft_consensus.cc:359] T 4f5a2d88e89448648f594ef23ef152cd P c6d026bb4a9146c395c2b8572753ffb7 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6d026bb4a9146c395c2b8572753ffb7" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34303 } } peers { permanent_uuid: "3a01ebd6b99640978d77190fe4da6f08" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 45221 } } peers { permanent_uuid: "6070cdc51c6f49fcbcfbddd22a3c263c" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 41095 } }
I20260709 13:23:37.777190 16576 raft_consensus.cc:740] T 4f5a2d88e89448648f594ef23ef152cd P c6d026bb4a9146c395c2b8572753ffb7 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: c6d026bb4a9146c395c2b8572753ffb7, State: Initialized, Role: FOLLOWER
I20260709 13:23:37.778043 16576 consensus_queue.cc:260] T 4f5a2d88e89448648f594ef23ef152cd P c6d026bb4a9146c395c2b8572753ffb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6d026bb4a9146c395c2b8572753ffb7" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34303 } } peers { permanent_uuid: "3a01ebd6b99640978d77190fe4da6f08" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 45221 } } peers { permanent_uuid: "6070cdc51c6f49fcbcfbddd22a3c263c" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 41095 } }
I20260709 13:23:37.779367 16532 raft_consensus.cc:993] T 5066abfe4261488f96534730b07ce4d5 P 3a01ebd6b99640978d77190fe4da6f08: : Instructing follower 6070cdc51c6f49fcbcfbddd22a3c263c to start an election
I20260709 13:23:37.779982 16560 raft_consensus.cc:1081] T 5066abfe4261488f96534730b07ce4d5 P 3a01ebd6b99640978d77190fe4da6f08 [term 1 LEADER]: Signalling peer 6070cdc51c6f49fcbcfbddd22a3c263c to start an election
I20260709 13:23:37.780367 16576 ts_tablet_manager.cc:1434] T 4f5a2d88e89448648f594ef23ef152cd P c6d026bb4a9146c395c2b8572753ffb7: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:23:37.781226 16576 tablet_bootstrap.cc:492] T cb70c02d0bce438cbb6434b2c0aa54ae P c6d026bb4a9146c395c2b8572753ffb7: Bootstrap starting.
I20260709 13:23:37.782039 16317 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5066abfe4261488f96534730b07ce4d5"
dest_uuid: "6070cdc51c6f49fcbcfbddd22a3c263c"
 from {username='slave'} at 127.0.0.1:57490
I20260709 13:23:37.782850 16317 raft_consensus.cc:493] T 5066abfe4261488f96534730b07ce4d5 P 6070cdc51c6f49fcbcfbddd22a3c263c [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:23:37.783164 16317 raft_consensus.cc:3060] T 5066abfe4261488f96534730b07ce4d5 P 6070cdc51c6f49fcbcfbddd22a3c263c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:23:37.789716 16317 raft_consensus.cc:515] T 5066abfe4261488f96534730b07ce4d5 P 6070cdc51c6f49fcbcfbddd22a3c263c [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6d026bb4a9146c395c2b8572753ffb7" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34303 } } peers { permanent_uuid: "6070cdc51c6f49fcbcfbddd22a3c263c" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 41095 } } peers { permanent_uuid: "3a01ebd6b99640978d77190fe4da6f08" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 45221 } }
I20260709 13:23:37.795436 16317 leader_election.cc:290] T 5066abfe4261488f96534730b07ce4d5 P 6070cdc51c6f49fcbcfbddd22a3c263c [CANDIDATE]: Term 2 election: Requested vote from peers c6d026bb4a9146c395c2b8572753ffb7 (127.5.126.65:34303), 3a01ebd6b99640978d77190fe4da6f08 (127.5.126.67:45221)
I20260709 13:23:37.798101 16391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5066abfe4261488f96534730b07ce4d5" candidate_uuid: "6070cdc51c6f49fcbcfbddd22a3c263c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3a01ebd6b99640978d77190fe4da6f08"
I20260709 13:23:37.798877 16391 raft_consensus.cc:3055] T 5066abfe4261488f96534730b07ce4d5 P 3a01ebd6b99640978d77190fe4da6f08 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:23:37.799207 16391 raft_consensus.cc:740] T 5066abfe4261488f96534730b07ce4d5 P 3a01ebd6b99640978d77190fe4da6f08 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 3a01ebd6b99640978d77190fe4da6f08, State: Running, Role: LEADER
I20260709 13:23:37.800218 16391 consensus_queue.cc:260] T 5066abfe4261488f96534730b07ce4d5 P 3a01ebd6b99640978d77190fe4da6f08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6d026bb4a9146c395c2b8572753ffb7" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34303 } } peers { permanent_uuid: "6070cdc51c6f49fcbcfbddd22a3c263c" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 41095 } } peers { permanent_uuid: "3a01ebd6b99640978d77190fe4da6f08" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 45221 } }
I20260709 13:23:37.801528 16391 raft_consensus.cc:3060] T 5066abfe4261488f96534730b07ce4d5 P 3a01ebd6b99640978d77190fe4da6f08 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:23:37.802929 16576 tablet_bootstrap.cc:492] T cb70c02d0bce438cbb6434b2c0aa54ae P c6d026bb4a9146c395c2b8572753ffb7: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:23:37.804102 16576 tablet_bootstrap.cc:492] T cb70c02d0bce438cbb6434b2c0aa54ae P c6d026bb4a9146c395c2b8572753ffb7: Bootstrap complete.
I20260709 13:23:37.804827 16576 ts_tablet_manager.cc:1403] T cb70c02d0bce438cbb6434b2c0aa54ae P c6d026bb4a9146c395c2b8572753ffb7: Time spent bootstrapping tablet: real 0.024s	user 0.021s	sys 0.000s
I20260709 13:23:37.807265 16576 raft_consensus.cc:359] T cb70c02d0bce438cbb6434b2c0aa54ae P c6d026bb4a9146c395c2b8572753ffb7 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6d026bb4a9146c395c2b8572753ffb7" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34303 } } peers { permanent_uuid: "6070cdc51c6f49fcbcfbddd22a3c263c" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 41095 } } peers { permanent_uuid: "3a01ebd6b99640978d77190fe4da6f08" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 45221 } }
I20260709 13:23:37.807900 16576 raft_consensus.cc:740] T cb70c02d0bce438cbb6434b2c0aa54ae P c6d026bb4a9146c395c2b8572753ffb7 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: c6d026bb4a9146c395c2b8572753ffb7, State: Initialized, Role: FOLLOWER
I20260709 13:23:37.808636 16576 consensus_queue.cc:260] T cb70c02d0bce438cbb6434b2c0aa54ae P c6d026bb4a9146c395c2b8572753ffb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6d026bb4a9146c395c2b8572753ffb7" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34303 } } peers { permanent_uuid: "6070cdc51c6f49fcbcfbddd22a3c263c" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 41095 } } peers { permanent_uuid: "3a01ebd6b99640978d77190fe4da6f08" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 45221 } }
I20260709 13:23:37.810124 16391 raft_consensus.cc:2468] T 5066abfe4261488f96534730b07ce4d5 P 3a01ebd6b99640978d77190fe4da6f08 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6070cdc51c6f49fcbcfbddd22a3c263c in term 2.
I20260709 13:23:37.810513 16576 ts_tablet_manager.cc:1434] T cb70c02d0bce438cbb6434b2c0aa54ae P c6d026bb4a9146c395c2b8572753ffb7: Time spent starting tablet: real 0.005s	user 0.003s	sys 0.000s
I20260709 13:23:37.811548 16576 tablet_bootstrap.cc:492] T b0313caec0564fd5bf22e34524632537 P c6d026bb4a9146c395c2b8572753ffb7: Bootstrap starting.
I20260709 13:23:37.811659 16281 leader_election.cc:304] T 5066abfe4261488f96534730b07ce4d5 P 6070cdc51c6f49fcbcfbddd22a3c263c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3a01ebd6b99640978d77190fe4da6f08, 6070cdc51c6f49fcbcfbddd22a3c263c; no voters: 
I20260709 13:23:37.811924 16612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5066abfe4261488f96534730b07ce4d5" candidate_uuid: "6070cdc51c6f49fcbcfbddd22a3c263c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c6d026bb4a9146c395c2b8572753ffb7"
I20260709 13:23:37.812794 16559 raft_consensus.cc:2804] T 5066abfe4261488f96534730b07ce4d5 P 6070cdc51c6f49fcbcfbddd22a3c263c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:23:37.812680 16612 raft_consensus.cc:3060] T 5066abfe4261488f96534730b07ce4d5 P c6d026bb4a9146c395c2b8572753ffb7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:23:37.822537 16612 raft_consensus.cc:2468] T 5066abfe4261488f96534730b07ce4d5 P c6d026bb4a9146c395c2b8572753ffb7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6070cdc51c6f49fcbcfbddd22a3c263c in term 2.
I20260709 13:23:37.825580 16559 raft_consensus.cc:697] T 5066abfe4261488f96534730b07ce4d5 P 6070cdc51c6f49fcbcfbddd22a3c263c [term 2 LEADER]: Becoming Leader. State: Replica: 6070cdc51c6f49fcbcfbddd22a3c263c, State: Running, Role: LEADER
I20260709 13:23:37.828164 16559 consensus_queue.cc:237] T 5066abfe4261488f96534730b07ce4d5 P 6070cdc51c6f49fcbcfbddd22a3c263c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6d026bb4a9146c395c2b8572753ffb7" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34303 } } peers { permanent_uuid: "6070cdc51c6f49fcbcfbddd22a3c263c" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 41095 } } peers { permanent_uuid: "3a01ebd6b99640978d77190fe4da6f08" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 45221 } }
I20260709 13:23:37.829344 16576 tablet_bootstrap.cc:492] T b0313caec0564fd5bf22e34524632537 P c6d026bb4a9146c395c2b8572753ffb7: Bootstrap replayed 1/1 log segments. Stats: ops{read=0 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:23:37.830324 16576 tablet_bootstrap.cc:492] T b0313caec0564fd5bf22e34524632537 P c6d026bb4a9146c395c2b8572753ffb7: Bootstrap complete.
I20260709 13:23:37.831059 16576 ts_tablet_manager.cc:1403] T b0313caec0564fd5bf22e34524632537 P c6d026bb4a9146c395c2b8572753ffb7: Time spent bootstrapping tablet: real 0.020s	user 0.012s	sys 0.005s
I20260709 13:23:37.833626 16576 raft_consensus.cc:359] T b0313caec0564fd5bf22e34524632537 P c6d026bb4a9146c395c2b8572753ffb7 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6d026bb4a9146c395c2b8572753ffb7" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34303 } } peers { permanent_uuid: "6070cdc51c6f49fcbcfbddd22a3c263c" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 41095 } } peers { permanent_uuid: "3a01ebd6b99640978d77190fe4da6f08" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 45221 } }
I20260709 13:23:37.834141 16576 raft_consensus.cc:740] T b0313caec0564fd5bf22e34524632537 P c6d026bb4a9146c395c2b8572753ffb7 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: c6d026bb4a9146c395c2b8572753ffb7, State: Initialized, Role: FOLLOWER
I20260709 13:23:37.834748 16576 consensus_queue.cc:260] T b0313caec0564fd5bf22e34524632537 P c6d026bb4a9146c395c2b8572753ffb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6d026bb4a9146c395c2b8572753ffb7" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34303 } } peers { permanent_uuid: "6070cdc51c6f49fcbcfbddd22a3c263c" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 41095 } } peers { permanent_uuid: "3a01ebd6b99640978d77190fe4da6f08" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 45221 } }
I20260709 13:23:37.836777 16576 ts_tablet_manager.cc:1434] T b0313caec0564fd5bf22e34524632537 P c6d026bb4a9146c395c2b8572753ffb7: Time spent starting tablet: real 0.005s	user 0.005s	sys 0.002s
I20260709 13:23:37.837646 16137 catalog_manager.cc:5697] T 5066abfe4261488f96534730b07ce4d5 P 6070cdc51c6f49fcbcfbddd22a3c263c reported cstate change: term changed from 1 to 2, leader changed from 3a01ebd6b99640978d77190fe4da6f08 (127.5.126.67) to 6070cdc51c6f49fcbcfbddd22a3c263c (127.5.126.66). New cstate: current_term: 2 leader_uuid: "6070cdc51c6f49fcbcfbddd22a3c263c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6d026bb4a9146c395c2b8572753ffb7" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6070cdc51c6f49fcbcfbddd22a3c263c" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 41095 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3a01ebd6b99640978d77190fe4da6f08" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 45221 } health_report { overall_health: UNKNOWN } } }
I20260709 13:23:37.846984 16532 raft_consensus.cc:993] T cb70c02d0bce438cbb6434b2c0aa54ae P 3a01ebd6b99640978d77190fe4da6f08: : Instructing follower 6070cdc51c6f49fcbcfbddd22a3c263c to start an election
I20260709 13:23:37.847582 16560 raft_consensus.cc:1081] T cb70c02d0bce438cbb6434b2c0aa54ae P 3a01ebd6b99640978d77190fe4da6f08 [term 1 LEADER]: Signalling peer 6070cdc51c6f49fcbcfbddd22a3c263c to start an election
I20260709 13:23:37.849710 16317 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "cb70c02d0bce438cbb6434b2c0aa54ae"
dest_uuid: "6070cdc51c6f49fcbcfbddd22a3c263c"
 from {username='slave'} at 127.0.0.1:57490
I20260709 13:23:37.850375 16317 raft_consensus.cc:493] T cb70c02d0bce438cbb6434b2c0aa54ae P 6070cdc51c6f49fcbcfbddd22a3c263c [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:23:37.850883 16317 raft_consensus.cc:3060] T cb70c02d0bce438cbb6434b2c0aa54ae P 6070cdc51c6f49fcbcfbddd22a3c263c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:23:37.856958 16612 raft_consensus.cc:3060] T fd931932596f4755aeae878c0fe3c2d9 P c6d026bb4a9146c395c2b8572753ffb7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:23:37.857592 16317 raft_consensus.cc:515] T cb70c02d0bce438cbb6434b2c0aa54ae P 6070cdc51c6f49fcbcfbddd22a3c263c [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6d026bb4a9146c395c2b8572753ffb7" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34303 } } peers { permanent_uuid: "6070cdc51c6f49fcbcfbddd22a3c263c" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 41095 } } peers { permanent_uuid: "3a01ebd6b99640978d77190fe4da6f08" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 45221 } }
I20260709 13:23:37.859853 16317 leader_election.cc:290] T cb70c02d0bce438cbb6434b2c0aa54ae P 6070cdc51c6f49fcbcfbddd22a3c263c [CANDIDATE]: Term 2 election: Requested vote from peers c6d026bb4a9146c395c2b8572753ffb7 (127.5.126.65:34303), 3a01ebd6b99640978d77190fe4da6f08 (127.5.126.67:45221)
I20260709 13:23:37.860908 16611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb70c02d0bce438cbb6434b2c0aa54ae" candidate_uuid: "6070cdc51c6f49fcbcfbddd22a3c263c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c6d026bb4a9146c395c2b8572753ffb7"
I20260709 13:23:37.861536 16611 raft_consensus.cc:3060] T cb70c02d0bce438cbb6434b2c0aa54ae P c6d026bb4a9146c395c2b8572753ffb7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:23:37.861421 16391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb70c02d0bce438cbb6434b2c0aa54ae" candidate_uuid: "6070cdc51c6f49fcbcfbddd22a3c263c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3a01ebd6b99640978d77190fe4da6f08"
I20260709 13:23:37.862617 16391 raft_consensus.cc:3055] T cb70c02d0bce438cbb6434b2c0aa54ae P 3a01ebd6b99640978d77190fe4da6f08 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:23:37.863026 16391 raft_consensus.cc:740] T cb70c02d0bce438cbb6434b2c0aa54ae P 3a01ebd6b99640978d77190fe4da6f08 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 3a01ebd6b99640978d77190fe4da6f08, State: Running, Role: LEADER
I20260709 13:23:37.864070 16391 consensus_queue.cc:260] T cb70c02d0bce438cbb6434b2c0aa54ae P 3a01ebd6b99640978d77190fe4da6f08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6d026bb4a9146c395c2b8572753ffb7" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34303 } } peers { permanent_uuid: "6070cdc51c6f49fcbcfbddd22a3c263c" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 41095 } } peers { permanent_uuid: "3a01ebd6b99640978d77190fe4da6f08" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 45221 } }
I20260709 13:23:37.865574 16391 raft_consensus.cc:3060] T cb70c02d0bce438cbb6434b2c0aa54ae P 3a01ebd6b99640978d77190fe4da6f08 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:23:37.868888 16611 raft_consensus.cc:2468] T cb70c02d0bce438cbb6434b2c0aa54ae P c6d026bb4a9146c395c2b8572753ffb7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6070cdc51c6f49fcbcfbddd22a3c263c in term 2.
I20260709 13:23:37.870548 16281 leader_election.cc:304] T cb70c02d0bce438cbb6434b2c0aa54ae P 6070cdc51c6f49fcbcfbddd22a3c263c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6070cdc51c6f49fcbcfbddd22a3c263c, c6d026bb4a9146c395c2b8572753ffb7; no voters: 
I20260709 13:23:37.871680 16559 raft_consensus.cc:2804] T cb70c02d0bce438cbb6434b2c0aa54ae P 6070cdc51c6f49fcbcfbddd22a3c263c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:23:37.872315 16559 raft_consensus.cc:697] T cb70c02d0bce438cbb6434b2c0aa54ae P 6070cdc51c6f49fcbcfbddd22a3c263c [term 2 LEADER]: Becoming Leader. State: Replica: 6070cdc51c6f49fcbcfbddd22a3c263c, State: Running, Role: LEADER
I20260709 13:23:37.873200 16559 consensus_queue.cc:237] T cb70c02d0bce438cbb6434b2c0aa54ae P 6070cdc51c6f49fcbcfbddd22a3c263c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6d026bb4a9146c395c2b8572753ffb7" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34303 } } peers { permanent_uuid: "6070cdc51c6f49fcbcfbddd22a3c263c" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 41095 } } peers { permanent_uuid: "3a01ebd6b99640978d77190fe4da6f08" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 45221 } }
I20260709 13:23:37.875319 16391 raft_consensus.cc:2468] T cb70c02d0bce438cbb6434b2c0aa54ae P 3a01ebd6b99640978d77190fe4da6f08 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6070cdc51c6f49fcbcfbddd22a3c263c in term 2.
I20260709 13:23:37.882447 16137 catalog_manager.cc:5697] T cb70c02d0bce438cbb6434b2c0aa54ae P 6070cdc51c6f49fcbcfbddd22a3c263c reported cstate change: term changed from 1 to 2, leader changed from 3a01ebd6b99640978d77190fe4da6f08 (127.5.126.67) to 6070cdc51c6f49fcbcfbddd22a3c263c (127.5.126.66). New cstate: current_term: 2 leader_uuid: "6070cdc51c6f49fcbcfbddd22a3c263c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6d026bb4a9146c395c2b8572753ffb7" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6070cdc51c6f49fcbcfbddd22a3c263c" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 41095 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3a01ebd6b99640978d77190fe4da6f08" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 45221 } health_report { overall_health: UNKNOWN } } }
I20260709 13:23:38.025640 16532 raft_consensus.cc:993] T b0313caec0564fd5bf22e34524632537 P 3a01ebd6b99640978d77190fe4da6f08: : Instructing follower 6070cdc51c6f49fcbcfbddd22a3c263c to start an election
I20260709 13:23:38.026181 16532 raft_consensus.cc:1081] T b0313caec0564fd5bf22e34524632537 P 3a01ebd6b99640978d77190fe4da6f08 [term 1 LEADER]: Signalling peer 6070cdc51c6f49fcbcfbddd22a3c263c to start an election
I20260709 13:23:38.027819 16317 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b0313caec0564fd5bf22e34524632537"
dest_uuid: "6070cdc51c6f49fcbcfbddd22a3c263c"
 from {username='slave'} at 127.0.0.1:57490
I20260709 13:23:38.028594 16317 raft_consensus.cc:493] T b0313caec0564fd5bf22e34524632537 P 6070cdc51c6f49fcbcfbddd22a3c263c [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:23:38.029050 16317 raft_consensus.cc:3060] T b0313caec0564fd5bf22e34524632537 P 6070cdc51c6f49fcbcfbddd22a3c263c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:23:38.035378 16317 raft_consensus.cc:515] T b0313caec0564fd5bf22e34524632537 P 6070cdc51c6f49fcbcfbddd22a3c263c [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6d026bb4a9146c395c2b8572753ffb7" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34303 } } peers { permanent_uuid: "6070cdc51c6f49fcbcfbddd22a3c263c" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 41095 } } peers { permanent_uuid: "3a01ebd6b99640978d77190fe4da6f08" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 45221 } }
I20260709 13:23:38.037613 16317 leader_election.cc:290] T b0313caec0564fd5bf22e34524632537 P 6070cdc51c6f49fcbcfbddd22a3c263c [CANDIDATE]: Term 2 election: Requested vote from peers c6d026bb4a9146c395c2b8572753ffb7 (127.5.126.65:34303), 3a01ebd6b99640978d77190fe4da6f08 (127.5.126.67:45221)
I20260709 13:23:38.038950 16612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0313caec0564fd5bf22e34524632537" candidate_uuid: "6070cdc51c6f49fcbcfbddd22a3c263c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c6d026bb4a9146c395c2b8572753ffb7"
I20260709 13:23:38.038985 16391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0313caec0564fd5bf22e34524632537" candidate_uuid: "6070cdc51c6f49fcbcfbddd22a3c263c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3a01ebd6b99640978d77190fe4da6f08"
I20260709 13:23:38.040017 16391 raft_consensus.cc:3055] T b0313caec0564fd5bf22e34524632537 P 3a01ebd6b99640978d77190fe4da6f08 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:23:38.040426 16391 raft_consensus.cc:740] T b0313caec0564fd5bf22e34524632537 P 3a01ebd6b99640978d77190fe4da6f08 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 3a01ebd6b99640978d77190fe4da6f08, State: Running, Role: LEADER
I20260709 13:23:38.041625 16391 consensus_queue.cc:260] T b0313caec0564fd5bf22e34524632537 P 3a01ebd6b99640978d77190fe4da6f08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6d026bb4a9146c395c2b8572753ffb7" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34303 } } peers { permanent_uuid: "6070cdc51c6f49fcbcfbddd22a3c263c" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 41095 } } peers { permanent_uuid: "3a01ebd6b99640978d77190fe4da6f08" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 45221 } }
I20260709 13:23:38.042984 16391 raft_consensus.cc:3060] T b0313caec0564fd5bf22e34524632537 P 3a01ebd6b99640978d77190fe4da6f08 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:23:38.051103 16391 raft_consensus.cc:2468] T b0313caec0564fd5bf22e34524632537 P 3a01ebd6b99640978d77190fe4da6f08 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6070cdc51c6f49fcbcfbddd22a3c263c in term 2.
I20260709 13:23:38.051414 16612 raft_consensus.cc:3060] T b1e06a2952f94a919e5324bd1f0d7cab P c6d026bb4a9146c395c2b8572753ffb7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:23:38.052778 16281 leader_election.cc:304] T b0313caec0564fd5bf22e34524632537 P 6070cdc51c6f49fcbcfbddd22a3c263c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3a01ebd6b99640978d77190fe4da6f08, 6070cdc51c6f49fcbcfbddd22a3c263c; no voters: c6d026bb4a9146c395c2b8572753ffb7
I20260709 13:23:38.053900 16559 raft_consensus.cc:2804] T b0313caec0564fd5bf22e34524632537 P 6070cdc51c6f49fcbcfbddd22a3c263c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:23:38.055388 16559 raft_consensus.cc:697] T b0313caec0564fd5bf22e34524632537 P 6070cdc51c6f49fcbcfbddd22a3c263c [term 2 LEADER]: Becoming Leader. State: Replica: 6070cdc51c6f49fcbcfbddd22a3c263c, State: Running, Role: LEADER
I20260709 13:23:38.056453 16559 consensus_queue.cc:237] T b0313caec0564fd5bf22e34524632537 P 6070cdc51c6f49fcbcfbddd22a3c263c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6d026bb4a9146c395c2b8572753ffb7" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34303 } } peers { permanent_uuid: "6070cdc51c6f49fcbcfbddd22a3c263c" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 41095 } } peers { permanent_uuid: "3a01ebd6b99640978d77190fe4da6f08" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 45221 } }
I20260709 13:23:38.074323 16137 catalog_manager.cc:5697] T b0313caec0564fd5bf22e34524632537 P 6070cdc51c6f49fcbcfbddd22a3c263c reported cstate change: term changed from 1 to 2, leader changed from 3a01ebd6b99640978d77190fe4da6f08 (127.5.126.67) to 6070cdc51c6f49fcbcfbddd22a3c263c (127.5.126.66). New cstate: current_term: 2 leader_uuid: "6070cdc51c6f49fcbcfbddd22a3c263c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6d026bb4a9146c395c2b8572753ffb7" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6070cdc51c6f49fcbcfbddd22a3c263c" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 41095 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3a01ebd6b99640978d77190fe4da6f08" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 45221 } health_report { overall_health: UNKNOWN } } }
I20260709 13:23:38.262233 16391 raft_consensus.cc:1275] T cb70c02d0bce438cbb6434b2c0aa54ae P 3a01ebd6b99640978d77190fe4da6f08 [term 2 FOLLOWER]: Refusing update from remote peer 6070cdc51c6f49fcbcfbddd22a3c263c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:23:38.263664 16559 consensus_queue.cc:1048] T cb70c02d0bce438cbb6434b2c0aa54ae P 6070cdc51c6f49fcbcfbddd22a3c263c [LEADER]: Connected to new peer: Peer: permanent_uuid: "3a01ebd6b99640978d77190fe4da6f08" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 45221 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:23:38.275552 16612 raft_consensus.cc:1275] T cb70c02d0bce438cbb6434b2c0aa54ae P c6d026bb4a9146c395c2b8572753ffb7 [term 2 FOLLOWER]: Refusing update from remote peer 6070cdc51c6f49fcbcfbddd22a3c263c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:23:38.277447 16652 consensus_queue.cc:1048] T cb70c02d0bce438cbb6434b2c0aa54ae P 6070cdc51c6f49fcbcfbddd22a3c263c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6d026bb4a9146c395c2b8572753ffb7" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:23:38.357728 16391 raft_consensus.cc:1275] T 5066abfe4261488f96534730b07ce4d5 P 3a01ebd6b99640978d77190fe4da6f08 [term 2 FOLLOWER]: Refusing update from remote peer 6070cdc51c6f49fcbcfbddd22a3c263c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:23:38.359078 16559 consensus_queue.cc:1048] T 5066abfe4261488f96534730b07ce4d5 P 6070cdc51c6f49fcbcfbddd22a3c263c [LEADER]: Connected to new peer: Peer: permanent_uuid: "3a01ebd6b99640978d77190fe4da6f08" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 45221 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:23:38.361299 16612 raft_consensus.cc:3060] T 4f5a2d88e89448648f594ef23ef152cd P c6d026bb4a9146c395c2b8572753ffb7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:23:38.370633 16611 raft_consensus.cc:1275] T 5066abfe4261488f96534730b07ce4d5 P c6d026bb4a9146c395c2b8572753ffb7 [term 2 FOLLOWER]: Refusing update from remote peer 6070cdc51c6f49fcbcfbddd22a3c263c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:23:38.376924 16653 consensus_queue.cc:1048] T 5066abfe4261488f96534730b07ce4d5 P 6070cdc51c6f49fcbcfbddd22a3c263c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6d026bb4a9146c395c2b8572753ffb7" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:23:38.438639 16188 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:23:38.476553 16391 raft_consensus.cc:1275] T b0313caec0564fd5bf22e34524632537 P 3a01ebd6b99640978d77190fe4da6f08 [term 2 FOLLOWER]: Refusing update from remote peer 6070cdc51c6f49fcbcfbddd22a3c263c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:23:38.478318 16653 consensus_queue.cc:1048] T b0313caec0564fd5bf22e34524632537 P 6070cdc51c6f49fcbcfbddd22a3c263c [LEADER]: Connected to new peer: Peer: permanent_uuid: "3a01ebd6b99640978d77190fe4da6f08" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 45221 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:23:38.489051 16612 raft_consensus.cc:3060] T b0313caec0564fd5bf22e34524632537 P c6d026bb4a9146c395c2b8572753ffb7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:23:38.496438 16612 raft_consensus.cc:1275] T b0313caec0564fd5bf22e34524632537 P c6d026bb4a9146c395c2b8572753ffb7 [term 2 FOLLOWER]: Refusing update from remote peer 6070cdc51c6f49fcbcfbddd22a3c263c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:23:38.497828 16559 consensus_queue.cc:1048] T b0313caec0564fd5bf22e34524632537 P 6070cdc51c6f49fcbcfbddd22a3c263c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6d026bb4a9146c395c2b8572753ffb7" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:23:38.743045  5625 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:23:38.760803 16317 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b0313caec0564fd5bf22e34524632537"
dest_uuid: "6070cdc51c6f49fcbcfbddd22a3c263c"
mode: GRACEFUL
new_leader_uuid: "3a01ebd6b99640978d77190fe4da6f08"
 from {username='slave'} at 127.0.0.1:57492
I20260709 13:23:38.761373 16317 raft_consensus.cc:606] T b0313caec0564fd5bf22e34524632537 P 6070cdc51c6f49fcbcfbddd22a3c263c [term 2 LEADER]: Received request to transfer leadership to TS 3a01ebd6b99640978d77190fe4da6f08
I20260709 13:23:38.764134 16317 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fd931932596f4755aeae878c0fe3c2d9"
dest_uuid: "6070cdc51c6f49fcbcfbddd22a3c263c"
mode: GRACEFUL
new_leader_uuid: "3a01ebd6b99640978d77190fe4da6f08"
 from {username='slave'} at 127.0.0.1:57492
I20260709 13:23:38.764628 16317 raft_consensus.cc:606] T fd931932596f4755aeae878c0fe3c2d9 P 6070cdc51c6f49fcbcfbddd22a3c263c [term 2 LEADER]: Received request to transfer leadership to TS 3a01ebd6b99640978d77190fe4da6f08
I20260709 13:23:38.765635  5625 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:23:38.766054  5625 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:23:38.766635  5625 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:23:38.854136 16559 raft_consensus.cc:993] T fd931932596f4755aeae878c0fe3c2d9 P 6070cdc51c6f49fcbcfbddd22a3c263c: : Instructing follower 3a01ebd6b99640978d77190fe4da6f08 to start an election
I20260709 13:23:38.854720 16653 raft_consensus.cc:1081] T fd931932596f4755aeae878c0fe3c2d9 P 6070cdc51c6f49fcbcfbddd22a3c263c [term 2 LEADER]: Signalling peer 3a01ebd6b99640978d77190fe4da6f08 to start an election
I20260709 13:23:38.856431 16391 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "fd931932596f4755aeae878c0fe3c2d9"
dest_uuid: "3a01ebd6b99640978d77190fe4da6f08"
 from {username='slave'} at 127.0.0.1:43062
I20260709 13:23:38.856994 16391 raft_consensus.cc:493] T fd931932596f4755aeae878c0fe3c2d9 P 3a01ebd6b99640978d77190fe4da6f08 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:23:38.857301 16391 raft_consensus.cc:3060] T fd931932596f4755aeae878c0fe3c2d9 P 3a01ebd6b99640978d77190fe4da6f08 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:23:38.862931 16391 raft_consensus.cc:515] T fd931932596f4755aeae878c0fe3c2d9 P 3a01ebd6b99640978d77190fe4da6f08 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6d026bb4a9146c395c2b8572753ffb7" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34303 } } peers { permanent_uuid: "6070cdc51c6f49fcbcfbddd22a3c263c" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 41095 } } peers { permanent_uuid: "3a01ebd6b99640978d77190fe4da6f08" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 45221 } }
I20260709 13:23:38.864915 16391 leader_election.cc:290] T fd931932596f4755aeae878c0fe3c2d9 P 3a01ebd6b99640978d77190fe4da6f08 [CANDIDATE]: Term 3 election: Requested vote from peers c6d026bb4a9146c395c2b8572753ffb7 (127.5.126.65:34303), 6070cdc51c6f49fcbcfbddd22a3c263c (127.5.126.66:41095)
I20260709 13:23:38.866066 16317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd931932596f4755aeae878c0fe3c2d9" candidate_uuid: "3a01ebd6b99640978d77190fe4da6f08" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "6070cdc51c6f49fcbcfbddd22a3c263c"
I20260709 13:23:38.866868 16317 raft_consensus.cc:3055] T fd931932596f4755aeae878c0fe3c2d9 P 6070cdc51c6f49fcbcfbddd22a3c263c [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:23:38.865980 16612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd931932596f4755aeae878c0fe3c2d9" candidate_uuid: "3a01ebd6b99640978d77190fe4da6f08" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "c6d026bb4a9146c395c2b8572753ffb7"
I20260709 13:23:38.867280 16317 raft_consensus.cc:740] T fd931932596f4755aeae878c0fe3c2d9 P 6070cdc51c6f49fcbcfbddd22a3c263c [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 6070cdc51c6f49fcbcfbddd22a3c263c, State: Running, Role: LEADER
I20260709 13:23:38.867638 16559 raft_consensus.cc:993] T b0313caec0564fd5bf22e34524632537 P 6070cdc51c6f49fcbcfbddd22a3c263c: : Instructing follower 3a01ebd6b99640978d77190fe4da6f08 to start an election
I20260709 13:23:38.867949 16612 raft_consensus.cc:3060] T fd931932596f4755aeae878c0fe3c2d9 P c6d026bb4a9146c395c2b8572753ffb7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:23:38.868261 16559 raft_consensus.cc:1081] T b0313caec0564fd5bf22e34524632537 P 6070cdc51c6f49fcbcfbddd22a3c263c [term 2 LEADER]: Signalling peer 3a01ebd6b99640978d77190fe4da6f08 to start an election
I20260709 13:23:38.868403 16317 consensus_queue.cc:260] T fd931932596f4755aeae878c0fe3c2d9 P 6070cdc51c6f49fcbcfbddd22a3c263c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6d026bb4a9146c395c2b8572753ffb7" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34303 } } peers { permanent_uuid: "6070cdc51c6f49fcbcfbddd22a3c263c" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 41095 } } peers { permanent_uuid: "3a01ebd6b99640978d77190fe4da6f08" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 45221 } }
I20260709 13:23:38.870000 16317 raft_consensus.cc:3060] T fd931932596f4755aeae878c0fe3c2d9 P 6070cdc51c6f49fcbcfbddd22a3c263c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:23:38.870483 16390 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b0313caec0564fd5bf22e34524632537"
dest_uuid: "3a01ebd6b99640978d77190fe4da6f08"
 from {username='slave'} at 127.0.0.1:43062
I20260709 13:23:38.871155 16390 raft_consensus.cc:493] T b0313caec0564fd5bf22e34524632537 P 3a01ebd6b99640978d77190fe4da6f08 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:23:38.871572 16390 raft_consensus.cc:3060] T b0313caec0564fd5bf22e34524632537 P 3a01ebd6b99640978d77190fe4da6f08 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:23:38.874408 16612 raft_consensus.cc:2468] T fd931932596f4755aeae878c0fe3c2d9 P c6d026bb4a9146c395c2b8572753ffb7 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3a01ebd6b99640978d77190fe4da6f08 in term 3.
I20260709 13:23:38.875797 16355 leader_election.cc:304] T fd931932596f4755aeae878c0fe3c2d9 P 3a01ebd6b99640978d77190fe4da6f08 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3a01ebd6b99640978d77190fe4da6f08, c6d026bb4a9146c395c2b8572753ffb7; no voters: 
I20260709 13:23:38.876544 16560 raft_consensus.cc:2804] T fd931932596f4755aeae878c0fe3c2d9 P 3a01ebd6b99640978d77190fe4da6f08 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:23:38.877033 16560 raft_consensus.cc:697] T fd931932596f4755aeae878c0fe3c2d9 P 3a01ebd6b99640978d77190fe4da6f08 [term 3 LEADER]: Becoming Leader. State: Replica: 3a01ebd6b99640978d77190fe4da6f08, State: Running, Role: LEADER
I20260709 13:23:38.877715 16560 consensus_queue.cc:237] T fd931932596f4755aeae878c0fe3c2d9 P 3a01ebd6b99640978d77190fe4da6f08 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6d026bb4a9146c395c2b8572753ffb7" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34303 } } peers { permanent_uuid: "6070cdc51c6f49fcbcfbddd22a3c263c" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 41095 } } peers { permanent_uuid: "3a01ebd6b99640978d77190fe4da6f08" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 45221 } }
I20260709 13:23:38.878758 16317 raft_consensus.cc:2468] T fd931932596f4755aeae878c0fe3c2d9 P 6070cdc51c6f49fcbcfbddd22a3c263c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3a01ebd6b99640978d77190fe4da6f08 in term 3.
I20260709 13:23:38.880148 16390 raft_consensus.cc:515] T b0313caec0564fd5bf22e34524632537 P 3a01ebd6b99640978d77190fe4da6f08 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6d026bb4a9146c395c2b8572753ffb7" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34303 } } peers { permanent_uuid: "6070cdc51c6f49fcbcfbddd22a3c263c" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 41095 } } peers { permanent_uuid: "3a01ebd6b99640978d77190fe4da6f08" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 45221 } }
I20260709 13:23:38.882601 16390 leader_election.cc:290] T b0313caec0564fd5bf22e34524632537 P 3a01ebd6b99640978d77190fe4da6f08 [CANDIDATE]: Term 3 election: Requested vote from peers c6d026bb4a9146c395c2b8572753ffb7 (127.5.126.65:34303), 6070cdc51c6f49fcbcfbddd22a3c263c (127.5.126.66:41095)
I20260709 13:23:38.885285 16612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0313caec0564fd5bf22e34524632537" candidate_uuid: "3a01ebd6b99640978d77190fe4da6f08" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "c6d026bb4a9146c395c2b8572753ffb7"
I20260709 13:23:38.885660 16317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0313caec0564fd5bf22e34524632537" candidate_uuid: "3a01ebd6b99640978d77190fe4da6f08" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "6070cdc51c6f49fcbcfbddd22a3c263c"
I20260709 13:23:38.885937 16612 raft_consensus.cc:3060] T b0313caec0564fd5bf22e34524632537 P c6d026bb4a9146c395c2b8572753ffb7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:23:38.886250 16317 raft_consensus.cc:3055] T b0313caec0564fd5bf22e34524632537 P 6070cdc51c6f49fcbcfbddd22a3c263c [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:23:38.886755 16317 raft_consensus.cc:740] T b0313caec0564fd5bf22e34524632537 P 6070cdc51c6f49fcbcfbddd22a3c263c [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 6070cdc51c6f49fcbcfbddd22a3c263c, State: Running, Role: LEADER
I20260709 13:23:38.887683 16317 consensus_queue.cc:260] T b0313caec0564fd5bf22e34524632537 P 6070cdc51c6f49fcbcfbddd22a3c263c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6d026bb4a9146c395c2b8572753ffb7" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34303 } } peers { permanent_uuid: "6070cdc51c6f49fcbcfbddd22a3c263c" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 41095 } } peers { permanent_uuid: "3a01ebd6b99640978d77190fe4da6f08" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 45221 } }
I20260709 13:23:38.889150 16317 raft_consensus.cc:3060] T b0313caec0564fd5bf22e34524632537 P 6070cdc51c6f49fcbcfbddd22a3c263c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:23:38.889231 16139 catalog_manager.cc:5697] T fd931932596f4755aeae878c0fe3c2d9 P 3a01ebd6b99640978d77190fe4da6f08 reported cstate change: term changed from 2 to 3, leader changed from 6070cdc51c6f49fcbcfbddd22a3c263c (127.5.126.66) to 3a01ebd6b99640978d77190fe4da6f08 (127.5.126.67). New cstate: current_term: 3 leader_uuid: "3a01ebd6b99640978d77190fe4da6f08" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6d026bb4a9146c395c2b8572753ffb7" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6070cdc51c6f49fcbcfbddd22a3c263c" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 41095 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3a01ebd6b99640978d77190fe4da6f08" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 45221 } health_report { overall_health: HEALTHY } } }
I20260709 13:23:38.892915 16612 raft_consensus.cc:2468] T b0313caec0564fd5bf22e34524632537 P c6d026bb4a9146c395c2b8572753ffb7 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3a01ebd6b99640978d77190fe4da6f08 in term 3.
I20260709 13:23:38.894451 16355 leader_election.cc:304] T b0313caec0564fd5bf22e34524632537 P 3a01ebd6b99640978d77190fe4da6f08 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3a01ebd6b99640978d77190fe4da6f08, c6d026bb4a9146c395c2b8572753ffb7; no voters: 
I20260709 13:23:38.895709 16560 raft_consensus.cc:2804] T b0313caec0564fd5bf22e34524632537 P 3a01ebd6b99640978d77190fe4da6f08 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:23:38.896308 16560 raft_consensus.cc:697] T b0313caec0564fd5bf22e34524632537 P 3a01ebd6b99640978d77190fe4da6f08 [term 3 LEADER]: Becoming Leader. State: Replica: 3a01ebd6b99640978d77190fe4da6f08, State: Running, Role: LEADER
I20260709 13:23:38.897234 16560 consensus_queue.cc:237] T b0313caec0564fd5bf22e34524632537 P 3a01ebd6b99640978d77190fe4da6f08 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6d026bb4a9146c395c2b8572753ffb7" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34303 } } peers { permanent_uuid: "6070cdc51c6f49fcbcfbddd22a3c263c" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 41095 } } peers { permanent_uuid: "3a01ebd6b99640978d77190fe4da6f08" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 45221 } }
I20260709 13:23:38.898533 16317 raft_consensus.cc:2468] T b0313caec0564fd5bf22e34524632537 P 6070cdc51c6f49fcbcfbddd22a3c263c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3a01ebd6b99640978d77190fe4da6f08 in term 3.
I20260709 13:23:38.908708 16139 catalog_manager.cc:5697] T b0313caec0564fd5bf22e34524632537 P 3a01ebd6b99640978d77190fe4da6f08 reported cstate change: term changed from 2 to 3, leader changed from 6070cdc51c6f49fcbcfbddd22a3c263c (127.5.126.66) to 3a01ebd6b99640978d77190fe4da6f08 (127.5.126.67). New cstate: current_term: 3 leader_uuid: "3a01ebd6b99640978d77190fe4da6f08" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6d026bb4a9146c395c2b8572753ffb7" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6070cdc51c6f49fcbcfbddd22a3c263c" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 41095 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3a01ebd6b99640978d77190fe4da6f08" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 45221 } health_report { overall_health: HEALTHY } } }
I20260709 13:23:39.366783 16612 raft_consensus.cc:1275] T fd931932596f4755aeae878c0fe3c2d9 P c6d026bb4a9146c395c2b8572753ffb7 [term 3 FOLLOWER]: Refusing update from remote peer 3a01ebd6b99640978d77190fe4da6f08: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:23:39.368208 16560 consensus_queue.cc:1048] T fd931932596f4755aeae878c0fe3c2d9 P 3a01ebd6b99640978d77190fe4da6f08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6d026bb4a9146c395c2b8572753ffb7" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:23:39.389861 16317 raft_consensus.cc:1275] T b0313caec0564fd5bf22e34524632537 P 6070cdc51c6f49fcbcfbddd22a3c263c [term 3 FOLLOWER]: Refusing update from remote peer 3a01ebd6b99640978d77190fe4da6f08: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:23:39.389895 16314 raft_consensus.cc:1275] T fd931932596f4755aeae878c0fe3c2d9 P 6070cdc51c6f49fcbcfbddd22a3c263c [term 3 FOLLOWER]: Refusing update from remote peer 3a01ebd6b99640978d77190fe4da6f08: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:23:39.392073 16532 consensus_queue.cc:1048] T b0313caec0564fd5bf22e34524632537 P 3a01ebd6b99640978d77190fe4da6f08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6070cdc51c6f49fcbcfbddd22a3c263c" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 41095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:23:39.392289 16560 consensus_queue.cc:1048] T fd931932596f4755aeae878c0fe3c2d9 P 3a01ebd6b99640978d77190fe4da6f08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6070cdc51c6f49fcbcfbddd22a3c263c" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 41095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:23:39.402760 16612 raft_consensus.cc:1275] T b0313caec0564fd5bf22e34524632537 P c6d026bb4a9146c395c2b8572753ffb7 [term 3 FOLLOWER]: Refusing update from remote peer 3a01ebd6b99640978d77190fe4da6f08: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:23:39.409124 16666 consensus_queue.cc:1048] T b0313caec0564fd5bf22e34524632537 P 3a01ebd6b99640978d77190fe4da6f08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6d026bb4a9146c395c2b8572753ffb7" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
W20260709 13:23:39.439610 16188 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:23:39.774883  5625 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:23:39.782608 16390 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "49ace918d4da4776b29f4aa41975e9ef"
dest_uuid: "3a01ebd6b99640978d77190fe4da6f08"
mode: GRACEFUL
new_leader_uuid: "6070cdc51c6f49fcbcfbddd22a3c263c"
 from {username='slave'} at 127.0.0.1:43066
I20260709 13:23:39.783344 16390 raft_consensus.cc:606] T 49ace918d4da4776b29f4aa41975e9ef P 3a01ebd6b99640978d77190fe4da6f08 [term 1 LEADER]: Received request to transfer leadership to TS 6070cdc51c6f49fcbcfbddd22a3c263c
I20260709 13:23:39.786646 16390 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4f5a2d88e89448648f594ef23ef152cd"
dest_uuid: "3a01ebd6b99640978d77190fe4da6f08"
mode: GRACEFUL
new_leader_uuid: "6070cdc51c6f49fcbcfbddd22a3c263c"
 from {username='slave'} at 127.0.0.1:43066
I20260709 13:23:39.787340 16390 raft_consensus.cc:606] T 4f5a2d88e89448648f594ef23ef152cd P 3a01ebd6b99640978d77190fe4da6f08 [term 2 LEADER]: Received request to transfer leadership to TS 6070cdc51c6f49fcbcfbddd22a3c263c
I20260709 13:23:39.789994 16317 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5066abfe4261488f96534730b07ce4d5"
dest_uuid: "6070cdc51c6f49fcbcfbddd22a3c263c"
mode: GRACEFUL
new_leader_uuid: "3a01ebd6b99640978d77190fe4da6f08"
 from {username='slave'} at 127.0.0.1:57492
I20260709 13:23:39.790490 16317 raft_consensus.cc:606] T 5066abfe4261488f96534730b07ce4d5 P 6070cdc51c6f49fcbcfbddd22a3c263c [term 2 LEADER]: Received request to transfer leadership to TS 3a01ebd6b99640978d77190fe4da6f08
I20260709 13:23:39.791653  5625 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 13:23:39.792101  5625 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:23:39.792596  5625 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:23:39.979212 16666 raft_consensus.cc:993] T 4f5a2d88e89448648f594ef23ef152cd P 3a01ebd6b99640978d77190fe4da6f08: : Instructing follower 6070cdc51c6f49fcbcfbddd22a3c263c to start an election
I20260709 13:23:39.979799 16666 raft_consensus.cc:1081] T 4f5a2d88e89448648f594ef23ef152cd P 3a01ebd6b99640978d77190fe4da6f08 [term 2 LEADER]: Signalling peer 6070cdc51c6f49fcbcfbddd22a3c263c to start an election
I20260709 13:23:39.982211 16317 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4f5a2d88e89448648f594ef23ef152cd"
dest_uuid: "6070cdc51c6f49fcbcfbddd22a3c263c"
 from {username='slave'} at 127.0.0.1:57490
I20260709 13:23:39.983027 16317 raft_consensus.cc:493] T 4f5a2d88e89448648f594ef23ef152cd P 6070cdc51c6f49fcbcfbddd22a3c263c [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:23:39.983451 16317 raft_consensus.cc:3060] T 4f5a2d88e89448648f594ef23ef152cd P 6070cdc51c6f49fcbcfbddd22a3c263c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:23:39.989871 16317 raft_consensus.cc:515] T 4f5a2d88e89448648f594ef23ef152cd P 6070cdc51c6f49fcbcfbddd22a3c263c [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6d026bb4a9146c395c2b8572753ffb7" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34303 } } peers { permanent_uuid: "3a01ebd6b99640978d77190fe4da6f08" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 45221 } } peers { permanent_uuid: "6070cdc51c6f49fcbcfbddd22a3c263c" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 41095 } }
I20260709 13:23:39.991390 16317 leader_election.cc:290] T 4f5a2d88e89448648f594ef23ef152cd P 6070cdc51c6f49fcbcfbddd22a3c263c [CANDIDATE]: Term 3 election: Requested vote from peers c6d026bb4a9146c395c2b8572753ffb7 (127.5.126.65:34303), 3a01ebd6b99640978d77190fe4da6f08 (127.5.126.67:45221)
I20260709 13:23:39.992538 16611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f5a2d88e89448648f594ef23ef152cd" candidate_uuid: "6070cdc51c6f49fcbcfbddd22a3c263c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "c6d026bb4a9146c395c2b8572753ffb7"
I20260709 13:23:39.992880 16390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f5a2d88e89448648f594ef23ef152cd" candidate_uuid: "6070cdc51c6f49fcbcfbddd22a3c263c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "3a01ebd6b99640978d77190fe4da6f08"
I20260709 13:23:39.993193 16611 raft_consensus.cc:3060] T 4f5a2d88e89448648f594ef23ef152cd P c6d026bb4a9146c395c2b8572753ffb7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:23:39.993593 16390 raft_consensus.cc:3055] T 4f5a2d88e89448648f594ef23ef152cd P 3a01ebd6b99640978d77190fe4da6f08 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:23:39.993933 16390 raft_consensus.cc:740] T 4f5a2d88e89448648f594ef23ef152cd P 3a01ebd6b99640978d77190fe4da6f08 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 3a01ebd6b99640978d77190fe4da6f08, State: Running, Role: LEADER
I20260709 13:23:39.994689 16390 consensus_queue.cc:260] T 4f5a2d88e89448648f594ef23ef152cd P 3a01ebd6b99640978d77190fe4da6f08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6d026bb4a9146c395c2b8572753ffb7" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34303 } } peers { permanent_uuid: "3a01ebd6b99640978d77190fe4da6f08" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 45221 } } peers { permanent_uuid: "6070cdc51c6f49fcbcfbddd22a3c263c" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 41095 } }
I20260709 13:23:39.995851 16390 raft_consensus.cc:3060] T 4f5a2d88e89448648f594ef23ef152cd P 3a01ebd6b99640978d77190fe4da6f08 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:23:39.998862 16611 raft_consensus.cc:2468] T 4f5a2d88e89448648f594ef23ef152cd P c6d026bb4a9146c395c2b8572753ffb7 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6070cdc51c6f49fcbcfbddd22a3c263c in term 3.
I20260709 13:23:40.000144 16281 leader_election.cc:304] T 4f5a2d88e89448648f594ef23ef152cd P 6070cdc51c6f49fcbcfbddd22a3c263c [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6070cdc51c6f49fcbcfbddd22a3c263c, c6d026bb4a9146c395c2b8572753ffb7; no voters: 
I20260709 13:23:40.000808 16652 raft_consensus.cc:2804] T 4f5a2d88e89448648f594ef23ef152cd P 6070cdc51c6f49fcbcfbddd22a3c263c [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:23:40.001916 16652 raft_consensus.cc:697] T 4f5a2d88e89448648f594ef23ef152cd P 6070cdc51c6f49fcbcfbddd22a3c263c [term 3 LEADER]: Becoming Leader. State: Replica: 6070cdc51c6f49fcbcfbddd22a3c263c, State: Running, Role: LEADER
I20260709 13:23:40.001916 16390 raft_consensus.cc:2468] T 4f5a2d88e89448648f594ef23ef152cd P 3a01ebd6b99640978d77190fe4da6f08 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6070cdc51c6f49fcbcfbddd22a3c263c in term 3.
I20260709 13:23:40.002926 16652 consensus_queue.cc:237] T 4f5a2d88e89448648f594ef23ef152cd P 6070cdc51c6f49fcbcfbddd22a3c263c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6d026bb4a9146c395c2b8572753ffb7" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34303 } } peers { permanent_uuid: "3a01ebd6b99640978d77190fe4da6f08" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 45221 } } peers { permanent_uuid: "6070cdc51c6f49fcbcfbddd22a3c263c" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 41095 } }
I20260709 13:23:40.009910 16139 catalog_manager.cc:5697] T 4f5a2d88e89448648f594ef23ef152cd P 6070cdc51c6f49fcbcfbddd22a3c263c reported cstate change: term changed from 2 to 3, leader changed from 3a01ebd6b99640978d77190fe4da6f08 (127.5.126.67) to 6070cdc51c6f49fcbcfbddd22a3c263c (127.5.126.66). New cstate: current_term: 3 leader_uuid: "6070cdc51c6f49fcbcfbddd22a3c263c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6d026bb4a9146c395c2b8572753ffb7" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3a01ebd6b99640978d77190fe4da6f08" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 45221 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6070cdc51c6f49fcbcfbddd22a3c263c" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 41095 } health_report { overall_health: HEALTHY } } }
I20260709 13:23:40.015846 16687 raft_consensus.cc:993] T 49ace918d4da4776b29f4aa41975e9ef P 3a01ebd6b99640978d77190fe4da6f08: : Instructing follower 6070cdc51c6f49fcbcfbddd22a3c263c to start an election
I20260709 13:23:40.016491 16666 raft_consensus.cc:1081] T 49ace918d4da4776b29f4aa41975e9ef P 3a01ebd6b99640978d77190fe4da6f08 [term 1 LEADER]: Signalling peer 6070cdc51c6f49fcbcfbddd22a3c263c to start an election
I20260709 13:23:40.018344 16317 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "49ace918d4da4776b29f4aa41975e9ef"
dest_uuid: "6070cdc51c6f49fcbcfbddd22a3c263c"
 from {username='slave'} at 127.0.0.1:57490
I20260709 13:23:40.018926 16317 raft_consensus.cc:493] T 49ace918d4da4776b29f4aa41975e9ef P 6070cdc51c6f49fcbcfbddd22a3c263c [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:23:40.019223 16317 raft_consensus.cc:3060] T 49ace918d4da4776b29f4aa41975e9ef P 6070cdc51c6f49fcbcfbddd22a3c263c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:23:40.024982 16317 raft_consensus.cc:515] T 49ace918d4da4776b29f4aa41975e9ef P 6070cdc51c6f49fcbcfbddd22a3c263c [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6d026bb4a9146c395c2b8572753ffb7" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34303 } } peers { permanent_uuid: "6070cdc51c6f49fcbcfbddd22a3c263c" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 41095 } } peers { permanent_uuid: "3a01ebd6b99640978d77190fe4da6f08" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 45221 } }
I20260709 13:23:40.026515 16317 leader_election.cc:290] T 49ace918d4da4776b29f4aa41975e9ef P 6070cdc51c6f49fcbcfbddd22a3c263c [CANDIDATE]: Term 2 election: Requested vote from peers c6d026bb4a9146c395c2b8572753ffb7 (127.5.126.65:34303), 3a01ebd6b99640978d77190fe4da6f08 (127.5.126.67:45221)
I20260709 13:23:40.027525 16611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49ace918d4da4776b29f4aa41975e9ef" candidate_uuid: "6070cdc51c6f49fcbcfbddd22a3c263c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c6d026bb4a9146c395c2b8572753ffb7"
I20260709 13:23:40.027932 16390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49ace918d4da4776b29f4aa41975e9ef" candidate_uuid: "6070cdc51c6f49fcbcfbddd22a3c263c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3a01ebd6b99640978d77190fe4da6f08"
I20260709 13:23:40.028262 16611 raft_consensus.cc:3060] T 49ace918d4da4776b29f4aa41975e9ef P c6d026bb4a9146c395c2b8572753ffb7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:23:40.028556 16390 raft_consensus.cc:3055] T 49ace918d4da4776b29f4aa41975e9ef P 3a01ebd6b99640978d77190fe4da6f08 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:23:40.028908 16390 raft_consensus.cc:740] T 49ace918d4da4776b29f4aa41975e9ef P 3a01ebd6b99640978d77190fe4da6f08 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 3a01ebd6b99640978d77190fe4da6f08, State: Running, Role: LEADER
I20260709 13:23:40.029774 16390 consensus_queue.cc:260] T 49ace918d4da4776b29f4aa41975e9ef P 3a01ebd6b99640978d77190fe4da6f08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6d026bb4a9146c395c2b8572753ffb7" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34303 } } peers { permanent_uuid: "6070cdc51c6f49fcbcfbddd22a3c263c" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 41095 } } peers { permanent_uuid: "3a01ebd6b99640978d77190fe4da6f08" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 45221 } }
I20260709 13:23:40.031056 16390 raft_consensus.cc:3060] T 49ace918d4da4776b29f4aa41975e9ef P 3a01ebd6b99640978d77190fe4da6f08 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:23:40.035526 16611 raft_consensus.cc:2468] T 49ace918d4da4776b29f4aa41975e9ef P c6d026bb4a9146c395c2b8572753ffb7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6070cdc51c6f49fcbcfbddd22a3c263c in term 2.
I20260709 13:23:40.036944 16281 leader_election.cc:304] T 49ace918d4da4776b29f4aa41975e9ef P 6070cdc51c6f49fcbcfbddd22a3c263c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6070cdc51c6f49fcbcfbddd22a3c263c, c6d026bb4a9146c395c2b8572753ffb7; no voters: 
I20260709 13:23:40.037878 16652 raft_consensus.cc:2804] T 49ace918d4da4776b29f4aa41975e9ef P 6070cdc51c6f49fcbcfbddd22a3c263c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:23:40.038359 16390 raft_consensus.cc:2468] T 49ace918d4da4776b29f4aa41975e9ef P 3a01ebd6b99640978d77190fe4da6f08 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6070cdc51c6f49fcbcfbddd22a3c263c in term 2.
I20260709 13:23:40.038439 16652 raft_consensus.cc:697] T 49ace918d4da4776b29f4aa41975e9ef P 6070cdc51c6f49fcbcfbddd22a3c263c [term 2 LEADER]: Becoming Leader. State: Replica: 6070cdc51c6f49fcbcfbddd22a3c263c, State: Running, Role: LEADER
I20260709 13:23:40.039707 16652 consensus_queue.cc:237] T 49ace918d4da4776b29f4aa41975e9ef P 6070cdc51c6f49fcbcfbddd22a3c263c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6d026bb4a9146c395c2b8572753ffb7" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34303 } } peers { permanent_uuid: "6070cdc51c6f49fcbcfbddd22a3c263c" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 41095 } } peers { permanent_uuid: "3a01ebd6b99640978d77190fe4da6f08" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 45221 } }
I20260709 13:23:40.046981 16139 catalog_manager.cc:5697] T 49ace918d4da4776b29f4aa41975e9ef P 6070cdc51c6f49fcbcfbddd22a3c263c reported cstate change: term changed from 1 to 2, leader changed from 3a01ebd6b99640978d77190fe4da6f08 (127.5.126.67) to 6070cdc51c6f49fcbcfbddd22a3c263c (127.5.126.66). New cstate: current_term: 2 leader_uuid: "6070cdc51c6f49fcbcfbddd22a3c263c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6d026bb4a9146c395c2b8572753ffb7" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6070cdc51c6f49fcbcfbddd22a3c263c" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 41095 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3a01ebd6b99640978d77190fe4da6f08" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 45221 } health_report { overall_health: UNKNOWN } } }
I20260709 13:23:40.228101 16688 raft_consensus.cc:993] T 5066abfe4261488f96534730b07ce4d5 P 6070cdc51c6f49fcbcfbddd22a3c263c: : Instructing follower 3a01ebd6b99640978d77190fe4da6f08 to start an election
I20260709 13:23:40.228644 16652 raft_consensus.cc:1081] T 5066abfe4261488f96534730b07ce4d5 P 6070cdc51c6f49fcbcfbddd22a3c263c [term 2 LEADER]: Signalling peer 3a01ebd6b99640978d77190fe4da6f08 to start an election
I20260709 13:23:40.230105 16390 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5066abfe4261488f96534730b07ce4d5"
dest_uuid: "3a01ebd6b99640978d77190fe4da6f08"
 from {username='slave'} at 127.0.0.1:43062
I20260709 13:23:40.230679 16390 raft_consensus.cc:493] T 5066abfe4261488f96534730b07ce4d5 P 3a01ebd6b99640978d77190fe4da6f08 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:23:40.230988 16390 raft_consensus.cc:3060] T 5066abfe4261488f96534730b07ce4d5 P 3a01ebd6b99640978d77190fe4da6f08 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:23:40.235917 16390 raft_consensus.cc:515] T 5066abfe4261488f96534730b07ce4d5 P 3a01ebd6b99640978d77190fe4da6f08 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6d026bb4a9146c395c2b8572753ffb7" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34303 } } peers { permanent_uuid: "6070cdc51c6f49fcbcfbddd22a3c263c" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 41095 } } peers { permanent_uuid: "3a01ebd6b99640978d77190fe4da6f08" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 45221 } }
I20260709 13:23:40.237480 16390 leader_election.cc:290] T 5066abfe4261488f96534730b07ce4d5 P 3a01ebd6b99640978d77190fe4da6f08 [CANDIDATE]: Term 3 election: Requested vote from peers c6d026bb4a9146c395c2b8572753ffb7 (127.5.126.65:34303), 6070cdc51c6f49fcbcfbddd22a3c263c (127.5.126.66:41095)
I20260709 13:23:40.238533 16611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5066abfe4261488f96534730b07ce4d5" candidate_uuid: "3a01ebd6b99640978d77190fe4da6f08" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "c6d026bb4a9146c395c2b8572753ffb7"
I20260709 13:23:40.238852 16317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5066abfe4261488f96534730b07ce4d5" candidate_uuid: "3a01ebd6b99640978d77190fe4da6f08" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "6070cdc51c6f49fcbcfbddd22a3c263c"
I20260709 13:23:40.239303 16611 raft_consensus.cc:3060] T 5066abfe4261488f96534730b07ce4d5 P c6d026bb4a9146c395c2b8572753ffb7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:23:40.239432 16317 raft_consensus.cc:3055] T 5066abfe4261488f96534730b07ce4d5 P 6070cdc51c6f49fcbcfbddd22a3c263c [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:23:40.239794 16317 raft_consensus.cc:740] T 5066abfe4261488f96534730b07ce4d5 P 6070cdc51c6f49fcbcfbddd22a3c263c [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 6070cdc51c6f49fcbcfbddd22a3c263c, State: Running, Role: LEADER
I20260709 13:23:40.240654 16317 consensus_queue.cc:260] T 5066abfe4261488f96534730b07ce4d5 P 6070cdc51c6f49fcbcfbddd22a3c263c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6d026bb4a9146c395c2b8572753ffb7" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34303 } } peers { permanent_uuid: "6070cdc51c6f49fcbcfbddd22a3c263c" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 41095 } } peers { permanent_uuid: "3a01ebd6b99640978d77190fe4da6f08" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 45221 } }
I20260709 13:23:40.241991 16317 raft_consensus.cc:3060] T 5066abfe4261488f96534730b07ce4d5 P 6070cdc51c6f49fcbcfbddd22a3c263c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:23:40.247359 16611 raft_consensus.cc:2468] T 5066abfe4261488f96534730b07ce4d5 P c6d026bb4a9146c395c2b8572753ffb7 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3a01ebd6b99640978d77190fe4da6f08 in term 3.
I20260709 13:23:40.248966 16355 leader_election.cc:304] T 5066abfe4261488f96534730b07ce4d5 P 3a01ebd6b99640978d77190fe4da6f08 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3a01ebd6b99640978d77190fe4da6f08, c6d026bb4a9146c395c2b8572753ffb7; no voters: 
I20260709 13:23:40.249684 16317 raft_consensus.cc:2468] T 5066abfe4261488f96534730b07ce4d5 P 6070cdc51c6f49fcbcfbddd22a3c263c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3a01ebd6b99640978d77190fe4da6f08 in term 3.
I20260709 13:23:40.249867 16666 raft_consensus.cc:2804] T 5066abfe4261488f96534730b07ce4d5 P 3a01ebd6b99640978d77190fe4da6f08 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:23:40.250614 16666 raft_consensus.cc:697] T 5066abfe4261488f96534730b07ce4d5 P 3a01ebd6b99640978d77190fe4da6f08 [term 3 LEADER]: Becoming Leader. State: Replica: 3a01ebd6b99640978d77190fe4da6f08, State: Running, Role: LEADER
I20260709 13:23:40.251423 16666 consensus_queue.cc:237] T 5066abfe4261488f96534730b07ce4d5 P 3a01ebd6b99640978d77190fe4da6f08 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6d026bb4a9146c395c2b8572753ffb7" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34303 } } peers { permanent_uuid: "6070cdc51c6f49fcbcfbddd22a3c263c" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 41095 } } peers { permanent_uuid: "3a01ebd6b99640978d77190fe4da6f08" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 45221 } }
I20260709 13:23:40.260910 16139 catalog_manager.cc:5697] T 5066abfe4261488f96534730b07ce4d5 P 3a01ebd6b99640978d77190fe4da6f08 reported cstate change: term changed from 2 to 3, leader changed from 6070cdc51c6f49fcbcfbddd22a3c263c (127.5.126.66) to 3a01ebd6b99640978d77190fe4da6f08 (127.5.126.67). New cstate: current_term: 3 leader_uuid: "3a01ebd6b99640978d77190fe4da6f08" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6d026bb4a9146c395c2b8572753ffb7" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6070cdc51c6f49fcbcfbddd22a3c263c" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 41095 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3a01ebd6b99640978d77190fe4da6f08" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 45221 } health_report { overall_health: HEALTHY } } }
I20260709 13:23:40.409915 16611 raft_consensus.cc:1275] T 4f5a2d88e89448648f594ef23ef152cd P c6d026bb4a9146c395c2b8572753ffb7 [term 3 FOLLOWER]: Refusing update from remote peer 6070cdc51c6f49fcbcfbddd22a3c263c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:23:40.411605 16652 consensus_queue.cc:1048] T 4f5a2d88e89448648f594ef23ef152cd P 6070cdc51c6f49fcbcfbddd22a3c263c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6d026bb4a9146c395c2b8572753ffb7" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:23:40.424273 16390 raft_consensus.cc:1275] T 4f5a2d88e89448648f594ef23ef152cd P 3a01ebd6b99640978d77190fe4da6f08 [term 3 FOLLOWER]: Refusing update from remote peer 6070cdc51c6f49fcbcfbddd22a3c263c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:23:40.426343 16688 consensus_queue.cc:1048] T 4f5a2d88e89448648f594ef23ef152cd P 6070cdc51c6f49fcbcfbddd22a3c263c [LEADER]: Connected to new peer: Peer: permanent_uuid: "3a01ebd6b99640978d77190fe4da6f08" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 45221 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
W20260709 13:23:40.440766 16188 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:23:40.516917 16390 raft_consensus.cc:1275] T 49ace918d4da4776b29f4aa41975e9ef P 3a01ebd6b99640978d77190fe4da6f08 [term 2 FOLLOWER]: Refusing update from remote peer 6070cdc51c6f49fcbcfbddd22a3c263c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:23:40.517060 16611 raft_consensus.cc:1275] T 49ace918d4da4776b29f4aa41975e9ef P c6d026bb4a9146c395c2b8572753ffb7 [term 2 FOLLOWER]: Refusing update from remote peer 6070cdc51c6f49fcbcfbddd22a3c263c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:23:40.519914 16652 consensus_queue.cc:1048] T 49ace918d4da4776b29f4aa41975e9ef P 6070cdc51c6f49fcbcfbddd22a3c263c [LEADER]: Connected to new peer: Peer: permanent_uuid: "3a01ebd6b99640978d77190fe4da6f08" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 45221 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:23:40.521615 16699 consensus_queue.cc:1048] T 49ace918d4da4776b29f4aa41975e9ef P 6070cdc51c6f49fcbcfbddd22a3c263c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6d026bb4a9146c395c2b8572753ffb7" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:23:40.677522 16612 raft_consensus.cc:1275] T 5066abfe4261488f96534730b07ce4d5 P c6d026bb4a9146c395c2b8572753ffb7 [term 3 FOLLOWER]: Refusing update from remote peer 3a01ebd6b99640978d77190fe4da6f08: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:23:40.679538 16666 consensus_queue.cc:1048] T 5066abfe4261488f96534730b07ce4d5 P 3a01ebd6b99640978d77190fe4da6f08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6d026bb4a9146c395c2b8572753ffb7" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:23:40.694218 16317 raft_consensus.cc:1275] T 5066abfe4261488f96534730b07ce4d5 P 6070cdc51c6f49fcbcfbddd22a3c263c [term 3 FOLLOWER]: Refusing update from remote peer 3a01ebd6b99640978d77190fe4da6f08: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:23:40.695797 16666 consensus_queue.cc:1048] T 5066abfe4261488f96534730b07ce4d5 P 3a01ebd6b99640978d77190fe4da6f08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6070cdc51c6f49fcbcfbddd22a3c263c" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 41095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:23:40.798887  5625 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:23:40.810560 16390 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5066abfe4261488f96534730b07ce4d5"
dest_uuid: "3a01ebd6b99640978d77190fe4da6f08"
mode: GRACEFUL
new_leader_uuid: "6070cdc51c6f49fcbcfbddd22a3c263c"
 from {username='slave'} at 127.0.0.1:43066
I20260709 13:23:40.811440 16390 raft_consensus.cc:606] T 5066abfe4261488f96534730b07ce4d5 P 3a01ebd6b99640978d77190fe4da6f08 [term 3 LEADER]: Received request to transfer leadership to TS 6070cdc51c6f49fcbcfbddd22a3c263c
I20260709 13:23:40.814774 16317 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "aab7ef362ab84369939a6a02d817aa53"
dest_uuid: "6070cdc51c6f49fcbcfbddd22a3c263c"
mode: GRACEFUL
new_leader_uuid: "3a01ebd6b99640978d77190fe4da6f08"
 from {username='slave'} at 127.0.0.1:57492
I20260709 13:23:40.815387 16317 raft_consensus.cc:606] T aab7ef362ab84369939a6a02d817aa53 P 6070cdc51c6f49fcbcfbddd22a3c263c [term 1 LEADER]: Received request to transfer leadership to TS 3a01ebd6b99640978d77190fe4da6f08
I20260709 13:23:40.818377 16317 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "cb70c02d0bce438cbb6434b2c0aa54ae"
dest_uuid: "6070cdc51c6f49fcbcfbddd22a3c263c"
mode: GRACEFUL
new_leader_uuid: "3a01ebd6b99640978d77190fe4da6f08"
 from {username='slave'} at 127.0.0.1:57492
I20260709 13:23:40.818907 16317 raft_consensus.cc:606] T cb70c02d0bce438cbb6434b2c0aa54ae P 6070cdc51c6f49fcbcfbddd22a3c263c [term 2 LEADER]: Received request to transfer leadership to TS 3a01ebd6b99640978d77190fe4da6f08
I20260709 13:23:40.820171  5625 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 13:23:40.820739  5625 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:23:40.821599  5625 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:23:40.848445 16688 raft_consensus.cc:993] T cb70c02d0bce438cbb6434b2c0aa54ae P 6070cdc51c6f49fcbcfbddd22a3c263c: : Instructing follower 3a01ebd6b99640978d77190fe4da6f08 to start an election
I20260709 13:23:40.849099 16699 raft_consensus.cc:1081] T cb70c02d0bce438cbb6434b2c0aa54ae P 6070cdc51c6f49fcbcfbddd22a3c263c [term 2 LEADER]: Signalling peer 3a01ebd6b99640978d77190fe4da6f08 to start an election
I20260709 13:23:40.850833 16390 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "cb70c02d0bce438cbb6434b2c0aa54ae"
dest_uuid: "3a01ebd6b99640978d77190fe4da6f08"
 from {username='slave'} at 127.0.0.1:43062
I20260709 13:23:40.851295 16390 raft_consensus.cc:493] T cb70c02d0bce438cbb6434b2c0aa54ae P 3a01ebd6b99640978d77190fe4da6f08 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:23:40.851549 16390 raft_consensus.cc:3060] T cb70c02d0bce438cbb6434b2c0aa54ae P 3a01ebd6b99640978d77190fe4da6f08 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:23:40.859578 16390 raft_consensus.cc:515] T cb70c02d0bce438cbb6434b2c0aa54ae P 3a01ebd6b99640978d77190fe4da6f08 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6d026bb4a9146c395c2b8572753ffb7" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34303 } } peers { permanent_uuid: "6070cdc51c6f49fcbcfbddd22a3c263c" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 41095 } } peers { permanent_uuid: "3a01ebd6b99640978d77190fe4da6f08" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 45221 } }
I20260709 13:23:40.861244 16390 leader_election.cc:290] T cb70c02d0bce438cbb6434b2c0aa54ae P 3a01ebd6b99640978d77190fe4da6f08 [CANDIDATE]: Term 3 election: Requested vote from peers c6d026bb4a9146c395c2b8572753ffb7 (127.5.126.65:34303), 6070cdc51c6f49fcbcfbddd22a3c263c (127.5.126.66:41095)
I20260709 13:23:40.862565 16612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb70c02d0bce438cbb6434b2c0aa54ae" candidate_uuid: "3a01ebd6b99640978d77190fe4da6f08" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "c6d026bb4a9146c395c2b8572753ffb7"
I20260709 13:23:40.862984 16317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb70c02d0bce438cbb6434b2c0aa54ae" candidate_uuid: "3a01ebd6b99640978d77190fe4da6f08" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "6070cdc51c6f49fcbcfbddd22a3c263c"
I20260709 13:23:40.863673 16612 raft_consensus.cc:3060] T cb70c02d0bce438cbb6434b2c0aa54ae P c6d026bb4a9146c395c2b8572753ffb7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:23:40.863759 16317 raft_consensus.cc:3055] T cb70c02d0bce438cbb6434b2c0aa54ae P 6070cdc51c6f49fcbcfbddd22a3c263c [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:23:40.864346 16317 raft_consensus.cc:740] T cb70c02d0bce438cbb6434b2c0aa54ae P 6070cdc51c6f49fcbcfbddd22a3c263c [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 6070cdc51c6f49fcbcfbddd22a3c263c, State: Running, Role: LEADER
I20260709 13:23:40.865793 16317 consensus_queue.cc:260] T cb70c02d0bce438cbb6434b2c0aa54ae P 6070cdc51c6f49fcbcfbddd22a3c263c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6d026bb4a9146c395c2b8572753ffb7" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34303 } } peers { permanent_uuid: "6070cdc51c6f49fcbcfbddd22a3c263c" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 41095 } } peers { permanent_uuid: "3a01ebd6b99640978d77190fe4da6f08" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 45221 } }
I20260709 13:23:40.867811 16317 raft_consensus.cc:3060] T cb70c02d0bce438cbb6434b2c0aa54ae P 6070cdc51c6f49fcbcfbddd22a3c263c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:23:40.876287 16612 raft_consensus.cc:2468] T cb70c02d0bce438cbb6434b2c0aa54ae P c6d026bb4a9146c395c2b8572753ffb7 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3a01ebd6b99640978d77190fe4da6f08 in term 3.
I20260709 13:23:40.877915 16355 leader_election.cc:304] T cb70c02d0bce438cbb6434b2c0aa54ae P 3a01ebd6b99640978d77190fe4da6f08 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3a01ebd6b99640978d77190fe4da6f08, c6d026bb4a9146c395c2b8572753ffb7; no voters: 
I20260709 13:23:40.878832 16666 raft_consensus.cc:2804] T cb70c02d0bce438cbb6434b2c0aa54ae P 3a01ebd6b99640978d77190fe4da6f08 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:23:40.879437 16317 raft_consensus.cc:2468] T cb70c02d0bce438cbb6434b2c0aa54ae P 6070cdc51c6f49fcbcfbddd22a3c263c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3a01ebd6b99640978d77190fe4da6f08 in term 3.
I20260709 13:23:40.879451 16666 raft_consensus.cc:697] T cb70c02d0bce438cbb6434b2c0aa54ae P 3a01ebd6b99640978d77190fe4da6f08 [term 3 LEADER]: Becoming Leader. State: Replica: 3a01ebd6b99640978d77190fe4da6f08, State: Running, Role: LEADER
I20260709 13:23:40.881269 16666 consensus_queue.cc:237] T cb70c02d0bce438cbb6434b2c0aa54ae P 3a01ebd6b99640978d77190fe4da6f08 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6d026bb4a9146c395c2b8572753ffb7" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34303 } } peers { permanent_uuid: "6070cdc51c6f49fcbcfbddd22a3c263c" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 41095 } } peers { permanent_uuid: "3a01ebd6b99640978d77190fe4da6f08" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 45221 } }
I20260709 13:23:40.891382 16139 catalog_manager.cc:5697] T cb70c02d0bce438cbb6434b2c0aa54ae P 3a01ebd6b99640978d77190fe4da6f08 reported cstate change: term changed from 2 to 3, leader changed from 6070cdc51c6f49fcbcfbddd22a3c263c (127.5.126.66) to 3a01ebd6b99640978d77190fe4da6f08 (127.5.126.67). New cstate: current_term: 3 leader_uuid: "3a01ebd6b99640978d77190fe4da6f08" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6d026bb4a9146c395c2b8572753ffb7" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6070cdc51c6f49fcbcfbddd22a3c263c" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 41095 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3a01ebd6b99640978d77190fe4da6f08" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 45221 } health_report { overall_health: HEALTHY } } }
I20260709 13:23:41.295547 16688 raft_consensus.cc:993] T aab7ef362ab84369939a6a02d817aa53 P 6070cdc51c6f49fcbcfbddd22a3c263c: : Instructing follower 3a01ebd6b99640978d77190fe4da6f08 to start an election
I20260709 13:23:41.296182 16699 raft_consensus.cc:1081] T aab7ef362ab84369939a6a02d817aa53 P 6070cdc51c6f49fcbcfbddd22a3c263c [term 1 LEADER]: Signalling peer 3a01ebd6b99640978d77190fe4da6f08 to start an election
I20260709 13:23:41.297883 16390 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "aab7ef362ab84369939a6a02d817aa53"
dest_uuid: "3a01ebd6b99640978d77190fe4da6f08"
 from {username='slave'} at 127.0.0.1:43062
I20260709 13:23:41.298538 16390 raft_consensus.cc:493] T aab7ef362ab84369939a6a02d817aa53 P 3a01ebd6b99640978d77190fe4da6f08 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:23:41.298892 16390 raft_consensus.cc:3060] T aab7ef362ab84369939a6a02d817aa53 P 3a01ebd6b99640978d77190fe4da6f08 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:23:41.310184 16390 raft_consensus.cc:515] T aab7ef362ab84369939a6a02d817aa53 P 3a01ebd6b99640978d77190fe4da6f08 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6d026bb4a9146c395c2b8572753ffb7" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34303 } } peers { permanent_uuid: "6070cdc51c6f49fcbcfbddd22a3c263c" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 41095 } } peers { permanent_uuid: "3a01ebd6b99640978d77190fe4da6f08" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 45221 } }
I20260709 13:23:41.311092 16687 raft_consensus.cc:993] T 5066abfe4261488f96534730b07ce4d5 P 3a01ebd6b99640978d77190fe4da6f08: : Instructing follower 6070cdc51c6f49fcbcfbddd22a3c263c to start an election
I20260709 13:23:41.311614 16687 raft_consensus.cc:1081] T 5066abfe4261488f96534730b07ce4d5 P 3a01ebd6b99640978d77190fe4da6f08 [term 3 LEADER]: Signalling peer 6070cdc51c6f49fcbcfbddd22a3c263c to start an election
I20260709 13:23:41.312541 16390 leader_election.cc:290] T aab7ef362ab84369939a6a02d817aa53 P 3a01ebd6b99640978d77190fe4da6f08 [CANDIDATE]: Term 2 election: Requested vote from peers c6d026bb4a9146c395c2b8572753ffb7 (127.5.126.65:34303), 6070cdc51c6f49fcbcfbddd22a3c263c (127.5.126.66:41095)
I20260709 13:23:41.313396 16612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aab7ef362ab84369939a6a02d817aa53" candidate_uuid: "3a01ebd6b99640978d77190fe4da6f08" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c6d026bb4a9146c395c2b8572753ffb7"
I20260709 13:23:41.313760 16314 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5066abfe4261488f96534730b07ce4d5"
dest_uuid: "6070cdc51c6f49fcbcfbddd22a3c263c"
 from {username='slave'} at 127.0.0.1:57490
I20260709 13:23:41.314174 16612 raft_consensus.cc:3060] T aab7ef362ab84369939a6a02d817aa53 P c6d026bb4a9146c395c2b8572753ffb7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:23:41.314349 16314 raft_consensus.cc:493] T 5066abfe4261488f96534730b07ce4d5 P 6070cdc51c6f49fcbcfbddd22a3c263c [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:23:41.314456 16317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aab7ef362ab84369939a6a02d817aa53" candidate_uuid: "3a01ebd6b99640978d77190fe4da6f08" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6070cdc51c6f49fcbcfbddd22a3c263c"
I20260709 13:23:41.314868 16314 raft_consensus.cc:3060] T 5066abfe4261488f96534730b07ce4d5 P 6070cdc51c6f49fcbcfbddd22a3c263c [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:23:41.315261 16317 raft_consensus.cc:3055] T aab7ef362ab84369939a6a02d817aa53 P 6070cdc51c6f49fcbcfbddd22a3c263c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:23:41.315593 16317 raft_consensus.cc:740] T aab7ef362ab84369939a6a02d817aa53 P 6070cdc51c6f49fcbcfbddd22a3c263c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6070cdc51c6f49fcbcfbddd22a3c263c, State: Running, Role: LEADER
I20260709 13:23:41.316598 16317 consensus_queue.cc:260] T aab7ef362ab84369939a6a02d817aa53 P 6070cdc51c6f49fcbcfbddd22a3c263c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6d026bb4a9146c395c2b8572753ffb7" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34303 } } peers { permanent_uuid: "6070cdc51c6f49fcbcfbddd22a3c263c" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 41095 } } peers { permanent_uuid: "3a01ebd6b99640978d77190fe4da6f08" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 45221 } }
I20260709 13:23:41.318224 16317 raft_consensus.cc:3060] T aab7ef362ab84369939a6a02d817aa53 P 6070cdc51c6f49fcbcfbddd22a3c263c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:23:41.322309 16612 raft_consensus.cc:2468] T aab7ef362ab84369939a6a02d817aa53 P c6d026bb4a9146c395c2b8572753ffb7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3a01ebd6b99640978d77190fe4da6f08 in term 2.
I20260709 13:23:41.323989 16355 leader_election.cc:304] T aab7ef362ab84369939a6a02d817aa53 P 3a01ebd6b99640978d77190fe4da6f08 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3a01ebd6b99640978d77190fe4da6f08, c6d026bb4a9146c395c2b8572753ffb7; no voters: 
I20260709 13:23:41.324990 16687 raft_consensus.cc:2804] T aab7ef362ab84369939a6a02d817aa53 P 3a01ebd6b99640978d77190fe4da6f08 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:23:41.325555 16687 raft_consensus.cc:697] T aab7ef362ab84369939a6a02d817aa53 P 3a01ebd6b99640978d77190fe4da6f08 [term 2 LEADER]: Becoming Leader. State: Replica: 3a01ebd6b99640978d77190fe4da6f08, State: Running, Role: LEADER
I20260709 13:23:41.325273 16314 raft_consensus.cc:515] T 5066abfe4261488f96534730b07ce4d5 P 6070cdc51c6f49fcbcfbddd22a3c263c [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6d026bb4a9146c395c2b8572753ffb7" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34303 } } peers { permanent_uuid: "6070cdc51c6f49fcbcfbddd22a3c263c" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 41095 } } peers { permanent_uuid: "3a01ebd6b99640978d77190fe4da6f08" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 45221 } }
I20260709 13:23:41.326743 16687 consensus_queue.cc:237] T aab7ef362ab84369939a6a02d817aa53 P 3a01ebd6b99640978d77190fe4da6f08 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6d026bb4a9146c395c2b8572753ffb7" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34303 } } peers { permanent_uuid: "6070cdc51c6f49fcbcfbddd22a3c263c" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 41095 } } peers { permanent_uuid: "3a01ebd6b99640978d77190fe4da6f08" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 45221 } }
I20260709 13:23:41.327232 16317 raft_consensus.cc:2468] T aab7ef362ab84369939a6a02d817aa53 P 6070cdc51c6f49fcbcfbddd22a3c263c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3a01ebd6b99640978d77190fe4da6f08 in term 2.
I20260709 13:23:41.327893 16314 leader_election.cc:290] T 5066abfe4261488f96534730b07ce4d5 P 6070cdc51c6f49fcbcfbddd22a3c263c [CANDIDATE]: Term 4 election: Requested vote from peers c6d026bb4a9146c395c2b8572753ffb7 (127.5.126.65:34303), 3a01ebd6b99640978d77190fe4da6f08 (127.5.126.67:45221)
I20260709 13:23:41.329577 16391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5066abfe4261488f96534730b07ce4d5" candidate_uuid: "6070cdc51c6f49fcbcfbddd22a3c263c" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "3a01ebd6b99640978d77190fe4da6f08"
I20260709 13:23:41.330384 16391 raft_consensus.cc:3055] T 5066abfe4261488f96534730b07ce4d5 P 3a01ebd6b99640978d77190fe4da6f08 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:23:41.330650 16391 raft_consensus.cc:740] T 5066abfe4261488f96534730b07ce4d5 P 3a01ebd6b99640978d77190fe4da6f08 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 3a01ebd6b99640978d77190fe4da6f08, State: Running, Role: LEADER
I20260709 13:23:41.331568 16391 consensus_queue.cc:260] T 5066abfe4261488f96534730b07ce4d5 P 3a01ebd6b99640978d77190fe4da6f08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6d026bb4a9146c395c2b8572753ffb7" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34303 } } peers { permanent_uuid: "6070cdc51c6f49fcbcfbddd22a3c263c" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 41095 } } peers { permanent_uuid: "3a01ebd6b99640978d77190fe4da6f08" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 45221 } }
I20260709 13:23:41.331727 16612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5066abfe4261488f96534730b07ce4d5" candidate_uuid: "6070cdc51c6f49fcbcfbddd22a3c263c" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "c6d026bb4a9146c395c2b8572753ffb7"
I20260709 13:23:41.332587 16612 raft_consensus.cc:3060] T 5066abfe4261488f96534730b07ce4d5 P c6d026bb4a9146c395c2b8572753ffb7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:23:41.333104 16391 raft_consensus.cc:3060] T 5066abfe4261488f96534730b07ce4d5 P 3a01ebd6b99640978d77190fe4da6f08 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:23:41.338781 16612 raft_consensus.cc:2468] T 5066abfe4261488f96534730b07ce4d5 P c6d026bb4a9146c395c2b8572753ffb7 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6070cdc51c6f49fcbcfbddd22a3c263c in term 4.
I20260709 13:23:41.338443 16139 catalog_manager.cc:5697] T aab7ef362ab84369939a6a02d817aa53 P 3a01ebd6b99640978d77190fe4da6f08 reported cstate change: term changed from 1 to 2, leader changed from 6070cdc51c6f49fcbcfbddd22a3c263c (127.5.126.66) to 3a01ebd6b99640978d77190fe4da6f08 (127.5.126.67). New cstate: current_term: 2 leader_uuid: "3a01ebd6b99640978d77190fe4da6f08" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6d026bb4a9146c395c2b8572753ffb7" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6070cdc51c6f49fcbcfbddd22a3c263c" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 41095 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3a01ebd6b99640978d77190fe4da6f08" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 45221 } health_report { overall_health: HEALTHY } } }
I20260709 13:23:41.340301 16281 leader_election.cc:304] T 5066abfe4261488f96534730b07ce4d5 P 6070cdc51c6f49fcbcfbddd22a3c263c [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6070cdc51c6f49fcbcfbddd22a3c263c, c6d026bb4a9146c395c2b8572753ffb7; no voters: 
I20260709 13:23:41.341028 16699 raft_consensus.cc:2804] T 5066abfe4261488f96534730b07ce4d5 P 6070cdc51c6f49fcbcfbddd22a3c263c [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:23:41.341531 16699 raft_consensus.cc:697] T 5066abfe4261488f96534730b07ce4d5 P 6070cdc51c6f49fcbcfbddd22a3c263c [term 4 LEADER]: Becoming Leader. State: Replica: 6070cdc51c6f49fcbcfbddd22a3c263c, State: Running, Role: LEADER
I20260709 13:23:41.342456 16699 consensus_queue.cc:237] T 5066abfe4261488f96534730b07ce4d5 P 6070cdc51c6f49fcbcfbddd22a3c263c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6d026bb4a9146c395c2b8572753ffb7" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34303 } } peers { permanent_uuid: "6070cdc51c6f49fcbcfbddd22a3c263c" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 41095 } } peers { permanent_uuid: "3a01ebd6b99640978d77190fe4da6f08" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 45221 } }
I20260709 13:23:41.343319 16391 raft_consensus.cc:2468] T 5066abfe4261488f96534730b07ce4d5 P 3a01ebd6b99640978d77190fe4da6f08 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6070cdc51c6f49fcbcfbddd22a3c263c in term 4.
I20260709 13:23:41.350709 16140 catalog_manager.cc:5697] T 5066abfe4261488f96534730b07ce4d5 P 6070cdc51c6f49fcbcfbddd22a3c263c reported cstate change: term changed from 3 to 4, leader changed from 3a01ebd6b99640978d77190fe4da6f08 (127.5.126.67) to 6070cdc51c6f49fcbcfbddd22a3c263c (127.5.126.66). New cstate: current_term: 4 leader_uuid: "6070cdc51c6f49fcbcfbddd22a3c263c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6d026bb4a9146c395c2b8572753ffb7" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6070cdc51c6f49fcbcfbddd22a3c263c" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 41095 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3a01ebd6b99640978d77190fe4da6f08" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 45221 } health_report { overall_health: UNKNOWN } } }
I20260709 13:23:41.351729 16314 raft_consensus.cc:1275] T cb70c02d0bce438cbb6434b2c0aa54ae P 6070cdc51c6f49fcbcfbddd22a3c263c [term 3 FOLLOWER]: Refusing update from remote peer 3a01ebd6b99640978d77190fe4da6f08: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:23:41.353354 16687 consensus_queue.cc:1048] T cb70c02d0bce438cbb6434b2c0aa54ae P 3a01ebd6b99640978d77190fe4da6f08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6070cdc51c6f49fcbcfbddd22a3c263c" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 41095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:23:41.373597 16612 raft_consensus.cc:1275] T cb70c02d0bce438cbb6434b2c0aa54ae P c6d026bb4a9146c395c2b8572753ffb7 [term 3 FOLLOWER]: Refusing update from remote peer 3a01ebd6b99640978d77190fe4da6f08: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:23:41.375231 16666 consensus_queue.cc:1048] T cb70c02d0bce438cbb6434b2c0aa54ae P 3a01ebd6b99640978d77190fe4da6f08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6d026bb4a9146c395c2b8572753ffb7" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
W20260709 13:23:41.442540 16188 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:23:41.748116 16612 raft_consensus.cc:1275] T aab7ef362ab84369939a6a02d817aa53 P c6d026bb4a9146c395c2b8572753ffb7 [term 2 FOLLOWER]: Refusing update from remote peer 3a01ebd6b99640978d77190fe4da6f08: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:23:41.750005 16687 consensus_queue.cc:1048] T aab7ef362ab84369939a6a02d817aa53 P 3a01ebd6b99640978d77190fe4da6f08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6d026bb4a9146c395c2b8572753ffb7" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:23:41.761093 16314 raft_consensus.cc:1275] T aab7ef362ab84369939a6a02d817aa53 P 6070cdc51c6f49fcbcfbddd22a3c263c [term 2 FOLLOWER]: Refusing update from remote peer 3a01ebd6b99640978d77190fe4da6f08: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:23:41.762778 16687 consensus_queue.cc:1048] T aab7ef362ab84369939a6a02d817aa53 P 3a01ebd6b99640978d77190fe4da6f08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6070cdc51c6f49fcbcfbddd22a3c263c" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 41095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:23:41.828117  5625 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:23:41.835292 16314 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5066abfe4261488f96534730b07ce4d5"
dest_uuid: "6070cdc51c6f49fcbcfbddd22a3c263c"
mode: GRACEFUL
new_leader_uuid: "3a01ebd6b99640978d77190fe4da6f08"
 from {username='slave'} at 127.0.0.1:57492
I20260709 13:23:41.835983 16314 raft_consensus.cc:606] T 5066abfe4261488f96534730b07ce4d5 P 6070cdc51c6f49fcbcfbddd22a3c263c [term 4 LEADER]: Received request to transfer leadership to TS 3a01ebd6b99640978d77190fe4da6f08
I20260709 13:23:41.838943 16391 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b0313caec0564fd5bf22e34524632537"
dest_uuid: "3a01ebd6b99640978d77190fe4da6f08"
mode: GRACEFUL
new_leader_uuid: "6070cdc51c6f49fcbcfbddd22a3c263c"
 from {username='slave'} at 127.0.0.1:43066
I20260709 13:23:41.839469 16391 raft_consensus.cc:606] T b0313caec0564fd5bf22e34524632537 P 3a01ebd6b99640978d77190fe4da6f08 [term 3 LEADER]: Received request to transfer leadership to TS 6070cdc51c6f49fcbcfbddd22a3c263c
I20260709 13:23:41.842418 16391 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fd931932596f4755aeae878c0fe3c2d9"
dest_uuid: "3a01ebd6b99640978d77190fe4da6f08"
mode: GRACEFUL
new_leader_uuid: "6070cdc51c6f49fcbcfbddd22a3c263c"
 from {username='slave'} at 127.0.0.1:43066
I20260709 13:23:41.843024 16391 raft_consensus.cc:606] T fd931932596f4755aeae878c0fe3c2d9 P 3a01ebd6b99640978d77190fe4da6f08 [term 3 LEADER]: Received request to transfer leadership to TS 6070cdc51c6f49fcbcfbddd22a3c263c
I20260709 13:23:41.844539  5625 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 13:23:41.845317  5625 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:23:41.846035  5625 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:23:41.846254 16391 raft_consensus.cc:1275] T 5066abfe4261488f96534730b07ce4d5 P 3a01ebd6b99640978d77190fe4da6f08 [term 4 FOLLOWER]: Refusing update from remote peer 6070cdc51c6f49fcbcfbddd22a3c263c: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:23:41.847651 16699 consensus_queue.cc:1048] T 5066abfe4261488f96534730b07ce4d5 P 6070cdc51c6f49fcbcfbddd22a3c263c [LEADER]: Connected to new peer: Peer: permanent_uuid: "3a01ebd6b99640978d77190fe4da6f08" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 45221 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:23:41.855047 16688 raft_consensus.cc:993] T 5066abfe4261488f96534730b07ce4d5 P 6070cdc51c6f49fcbcfbddd22a3c263c: : Instructing follower 3a01ebd6b99640978d77190fe4da6f08 to start an election
I20260709 13:23:41.855999 16699 raft_consensus.cc:1081] T 5066abfe4261488f96534730b07ce4d5 P 6070cdc51c6f49fcbcfbddd22a3c263c [term 4 LEADER]: Signalling peer 3a01ebd6b99640978d77190fe4da6f08 to start an election
I20260709 13:23:41.858830 16390 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5066abfe4261488f96534730b07ce4d5"
dest_uuid: "3a01ebd6b99640978d77190fe4da6f08"
 from {username='slave'} at 127.0.0.1:43062
I20260709 13:23:41.861634 16390 raft_consensus.cc:493] T 5066abfe4261488f96534730b07ce4d5 P 3a01ebd6b99640978d77190fe4da6f08 [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:23:41.862090 16390 raft_consensus.cc:3060] T 5066abfe4261488f96534730b07ce4d5 P 3a01ebd6b99640978d77190fe4da6f08 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:23:41.862541 16612 raft_consensus.cc:1275] T 5066abfe4261488f96534730b07ce4d5 P c6d026bb4a9146c395c2b8572753ffb7 [term 4 FOLLOWER]: Refusing update from remote peer 6070cdc51c6f49fcbcfbddd22a3c263c: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:23:41.864619 16688 consensus_queue.cc:1048] T 5066abfe4261488f96534730b07ce4d5 P 6070cdc51c6f49fcbcfbddd22a3c263c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6d026bb4a9146c395c2b8572753ffb7" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:23:41.870587 16390 raft_consensus.cc:515] T 5066abfe4261488f96534730b07ce4d5 P 3a01ebd6b99640978d77190fe4da6f08 [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6d026bb4a9146c395c2b8572753ffb7" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34303 } } peers { permanent_uuid: "6070cdc51c6f49fcbcfbddd22a3c263c" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 41095 } } peers { permanent_uuid: "3a01ebd6b99640978d77190fe4da6f08" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 45221 } }
I20260709 13:23:41.875800 16390 leader_election.cc:290] T 5066abfe4261488f96534730b07ce4d5 P 3a01ebd6b99640978d77190fe4da6f08 [CANDIDATE]: Term 5 election: Requested vote from peers c6d026bb4a9146c395c2b8572753ffb7 (127.5.126.65:34303), 6070cdc51c6f49fcbcfbddd22a3c263c (127.5.126.66:41095)
I20260709 13:23:41.876894 16314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5066abfe4261488f96534730b07ce4d5" candidate_uuid: "3a01ebd6b99640978d77190fe4da6f08" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "6070cdc51c6f49fcbcfbddd22a3c263c"
I20260709 13:23:41.877678 16314 raft_consensus.cc:3055] T 5066abfe4261488f96534730b07ce4d5 P 6070cdc51c6f49fcbcfbddd22a3c263c [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:23:41.877557 16612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5066abfe4261488f96534730b07ce4d5" candidate_uuid: "3a01ebd6b99640978d77190fe4da6f08" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "c6d026bb4a9146c395c2b8572753ffb7"
I20260709 13:23:41.878103 16314 raft_consensus.cc:740] T 5066abfe4261488f96534730b07ce4d5 P 6070cdc51c6f49fcbcfbddd22a3c263c [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 6070cdc51c6f49fcbcfbddd22a3c263c, State: Running, Role: LEADER
I20260709 13:23:41.878314 16612 raft_consensus.cc:3060] T 5066abfe4261488f96534730b07ce4d5 P c6d026bb4a9146c395c2b8572753ffb7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:23:41.879027 16314 consensus_queue.cc:260] T 5066abfe4261488f96534730b07ce4d5 P 6070cdc51c6f49fcbcfbddd22a3c263c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6d026bb4a9146c395c2b8572753ffb7" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34303 } } peers { permanent_uuid: "6070cdc51c6f49fcbcfbddd22a3c263c" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 41095 } } peers { permanent_uuid: "3a01ebd6b99640978d77190fe4da6f08" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 45221 } }
I20260709 13:23:41.880484 16314 raft_consensus.cc:3060] T 5066abfe4261488f96534730b07ce4d5 P 6070cdc51c6f49fcbcfbddd22a3c263c [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:23:41.887554 16612 raft_consensus.cc:2468] T 5066abfe4261488f96534730b07ce4d5 P c6d026bb4a9146c395c2b8572753ffb7 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3a01ebd6b99640978d77190fe4da6f08 in term 5.
I20260709 13:23:41.888557 16314 raft_consensus.cc:2468] T 5066abfe4261488f96534730b07ce4d5 P 6070cdc51c6f49fcbcfbddd22a3c263c [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3a01ebd6b99640978d77190fe4da6f08 in term 5.
I20260709 13:23:41.889003 16355 leader_election.cc:304] T 5066abfe4261488f96534730b07ce4d5 P 3a01ebd6b99640978d77190fe4da6f08 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3a01ebd6b99640978d77190fe4da6f08, c6d026bb4a9146c395c2b8572753ffb7; no voters: 
I20260709 13:23:41.889931 16687 raft_consensus.cc:2804] T 5066abfe4261488f96534730b07ce4d5 P 3a01ebd6b99640978d77190fe4da6f08 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:23:41.890543 16687 raft_consensus.cc:697] T 5066abfe4261488f96534730b07ce4d5 P 3a01ebd6b99640978d77190fe4da6f08 [term 5 LEADER]: Becoming Leader. State: Replica: 3a01ebd6b99640978d77190fe4da6f08, State: Running, Role: LEADER
I20260709 13:23:41.891330 16687 consensus_queue.cc:237] T 5066abfe4261488f96534730b07ce4d5 P 3a01ebd6b99640978d77190fe4da6f08 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6d026bb4a9146c395c2b8572753ffb7" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34303 } } peers { permanent_uuid: "6070cdc51c6f49fcbcfbddd22a3c263c" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 41095 } } peers { permanent_uuid: "3a01ebd6b99640978d77190fe4da6f08" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 45221 } }
I20260709 13:23:41.898056 16139 catalog_manager.cc:5697] T 5066abfe4261488f96534730b07ce4d5 P 3a01ebd6b99640978d77190fe4da6f08 reported cstate change: term changed from 4 to 5, leader changed from 6070cdc51c6f49fcbcfbddd22a3c263c (127.5.126.66) to 3a01ebd6b99640978d77190fe4da6f08 (127.5.126.67). New cstate: current_term: 5 leader_uuid: "3a01ebd6b99640978d77190fe4da6f08" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6d026bb4a9146c395c2b8572753ffb7" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6070cdc51c6f49fcbcfbddd22a3c263c" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 41095 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3a01ebd6b99640978d77190fe4da6f08" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 45221 } health_report { overall_health: HEALTHY } } }
I20260709 13:23:42.404803 16611 raft_consensus.cc:1275] T 5066abfe4261488f96534730b07ce4d5 P c6d026bb4a9146c395c2b8572753ffb7 [term 5 FOLLOWER]: Refusing update from remote peer 3a01ebd6b99640978d77190fe4da6f08: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:23:42.407115 16717 consensus_queue.cc:1048] T 5066abfe4261488f96534730b07ce4d5 P 3a01ebd6b99640978d77190fe4da6f08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6d026bb4a9146c395c2b8572753ffb7" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:23:42.409763 16729 raft_consensus.cc:993] T b0313caec0564fd5bf22e34524632537 P 3a01ebd6b99640978d77190fe4da6f08: : Instructing follower 6070cdc51c6f49fcbcfbddd22a3c263c to start an election
I20260709 13:23:42.410439 16729 raft_consensus.cc:1081] T b0313caec0564fd5bf22e34524632537 P 3a01ebd6b99640978d77190fe4da6f08 [term 3 LEADER]: Signalling peer 6070cdc51c6f49fcbcfbddd22a3c263c to start an election
I20260709 13:23:42.413645 16317 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b0313caec0564fd5bf22e34524632537"
dest_uuid: "6070cdc51c6f49fcbcfbddd22a3c263c"
 from {username='slave'} at 127.0.0.1:57490
I20260709 13:23:42.414940 16317 raft_consensus.cc:493] T b0313caec0564fd5bf22e34524632537 P 6070cdc51c6f49fcbcfbddd22a3c263c [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:23:42.415386 16317 raft_consensus.cc:3060] T b0313caec0564fd5bf22e34524632537 P 6070cdc51c6f49fcbcfbddd22a3c263c [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:23:42.430850 16317 raft_consensus.cc:515] T b0313caec0564fd5bf22e34524632537 P 6070cdc51c6f49fcbcfbddd22a3c263c [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6d026bb4a9146c395c2b8572753ffb7" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34303 } } peers { permanent_uuid: "6070cdc51c6f49fcbcfbddd22a3c263c" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 41095 } } peers { permanent_uuid: "3a01ebd6b99640978d77190fe4da6f08" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 45221 } }
I20260709 13:23:42.433393 16317 leader_election.cc:290] T b0313caec0564fd5bf22e34524632537 P 6070cdc51c6f49fcbcfbddd22a3c263c [CANDIDATE]: Term 4 election: Requested vote from peers c6d026bb4a9146c395c2b8572753ffb7 (127.5.126.65:34303), 3a01ebd6b99640978d77190fe4da6f08 (127.5.126.67:45221)
I20260709 13:23:42.434584 16390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0313caec0564fd5bf22e34524632537" candidate_uuid: "6070cdc51c6f49fcbcfbddd22a3c263c" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "3a01ebd6b99640978d77190fe4da6f08"
I20260709 13:23:42.434928 16315 raft_consensus.cc:1275] T 5066abfe4261488f96534730b07ce4d5 P 6070cdc51c6f49fcbcfbddd22a3c263c [term 5 FOLLOWER]: Refusing update from remote peer 3a01ebd6b99640978d77190fe4da6f08: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:23:42.435289 16390 raft_consensus.cc:3055] T b0313caec0564fd5bf22e34524632537 P 3a01ebd6b99640978d77190fe4da6f08 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:23:42.435645 16390 raft_consensus.cc:740] T b0313caec0564fd5bf22e34524632537 P 3a01ebd6b99640978d77190fe4da6f08 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 3a01ebd6b99640978d77190fe4da6f08, State: Running, Role: LEADER
I20260709 13:23:42.436606 16390 consensus_queue.cc:260] T b0313caec0564fd5bf22e34524632537 P 3a01ebd6b99640978d77190fe4da6f08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6d026bb4a9146c395c2b8572753ffb7" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34303 } } peers { permanent_uuid: "6070cdc51c6f49fcbcfbddd22a3c263c" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 41095 } } peers { permanent_uuid: "3a01ebd6b99640978d77190fe4da6f08" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 45221 } }
I20260709 13:23:42.436671 16609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0313caec0564fd5bf22e34524632537" candidate_uuid: "6070cdc51c6f49fcbcfbddd22a3c263c" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "c6d026bb4a9146c395c2b8572753ffb7"
I20260709 13:23:42.437528 16609 raft_consensus.cc:3060] T b0313caec0564fd5bf22e34524632537 P c6d026bb4a9146c395c2b8572753ffb7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:23:42.437774 16390 raft_consensus.cc:3060] T b0313caec0564fd5bf22e34524632537 P 3a01ebd6b99640978d77190fe4da6f08 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:23:42.441661 16712 consensus_queue.cc:1048] T 5066abfe4261488f96534730b07ce4d5 P 3a01ebd6b99640978d77190fe4da6f08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6070cdc51c6f49fcbcfbddd22a3c263c" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 41095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
W20260709 13:23:42.443845 16188 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:23:42.445242 16390 raft_consensus.cc:2468] T b0313caec0564fd5bf22e34524632537 P 3a01ebd6b99640978d77190fe4da6f08 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6070cdc51c6f49fcbcfbddd22a3c263c in term 4.
I20260709 13:23:42.452481 16281 leader_election.cc:304] T b0313caec0564fd5bf22e34524632537 P 6070cdc51c6f49fcbcfbddd22a3c263c [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3a01ebd6b99640978d77190fe4da6f08, 6070cdc51c6f49fcbcfbddd22a3c263c; no voters: 
I20260709 13:23:42.453882 16731 raft_consensus.cc:2804] T b0313caec0564fd5bf22e34524632537 P 6070cdc51c6f49fcbcfbddd22a3c263c [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:23:42.460427 16731 raft_consensus.cc:697] T b0313caec0564fd5bf22e34524632537 P 6070cdc51c6f49fcbcfbddd22a3c263c [term 4 LEADER]: Becoming Leader. State: Replica: 6070cdc51c6f49fcbcfbddd22a3c263c, State: Running, Role: LEADER
I20260709 13:23:42.461990 16731 consensus_queue.cc:237] T b0313caec0564fd5bf22e34524632537 P 6070cdc51c6f49fcbcfbddd22a3c263c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6d026bb4a9146c395c2b8572753ffb7" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34303 } } peers { permanent_uuid: "6070cdc51c6f49fcbcfbddd22a3c263c" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 41095 } } peers { permanent_uuid: "3a01ebd6b99640978d77190fe4da6f08" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 45221 } }
I20260709 13:23:42.464313 16609 raft_consensus.cc:2468] T b0313caec0564fd5bf22e34524632537 P c6d026bb4a9146c395c2b8572753ffb7 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6070cdc51c6f49fcbcfbddd22a3c263c in term 4.
I20260709 13:23:42.468832 16687 raft_consensus.cc:993] T fd931932596f4755aeae878c0fe3c2d9 P 3a01ebd6b99640978d77190fe4da6f08: : Instructing follower 6070cdc51c6f49fcbcfbddd22a3c263c to start an election
I20260709 13:23:42.470214 16712 raft_consensus.cc:1081] T fd931932596f4755aeae878c0fe3c2d9 P 3a01ebd6b99640978d77190fe4da6f08 [term 3 LEADER]: Signalling peer 6070cdc51c6f49fcbcfbddd22a3c263c to start an election
I20260709 13:23:42.486784 16316 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "fd931932596f4755aeae878c0fe3c2d9"
dest_uuid: "6070cdc51c6f49fcbcfbddd22a3c263c"
 from {username='slave'} at 127.0.0.1:57490
I20260709 13:23:42.487520 16316 raft_consensus.cc:493] T fd931932596f4755aeae878c0fe3c2d9 P 6070cdc51c6f49fcbcfbddd22a3c263c [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:23:42.487975 16316 raft_consensus.cc:3060] T fd931932596f4755aeae878c0fe3c2d9 P 6070cdc51c6f49fcbcfbddd22a3c263c [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:23:42.502050 16139 catalog_manager.cc:5697] T b0313caec0564fd5bf22e34524632537 P 6070cdc51c6f49fcbcfbddd22a3c263c reported cstate change: term changed from 3 to 4, leader changed from 3a01ebd6b99640978d77190fe4da6f08 (127.5.126.67) to 6070cdc51c6f49fcbcfbddd22a3c263c (127.5.126.66). New cstate: current_term: 4 leader_uuid: "6070cdc51c6f49fcbcfbddd22a3c263c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6d026bb4a9146c395c2b8572753ffb7" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6070cdc51c6f49fcbcfbddd22a3c263c" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 41095 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3a01ebd6b99640978d77190fe4da6f08" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 45221 } health_report { overall_health: UNKNOWN } } }
I20260709 13:23:42.500402 16316 raft_consensus.cc:515] T fd931932596f4755aeae878c0fe3c2d9 P 6070cdc51c6f49fcbcfbddd22a3c263c [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6d026bb4a9146c395c2b8572753ffb7" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34303 } } peers { permanent_uuid: "6070cdc51c6f49fcbcfbddd22a3c263c" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 41095 } } peers { permanent_uuid: "3a01ebd6b99640978d77190fe4da6f08" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 45221 } }
I20260709 13:23:42.507364 16316 leader_election.cc:290] T fd931932596f4755aeae878c0fe3c2d9 P 6070cdc51c6f49fcbcfbddd22a3c263c [CANDIDATE]: Term 4 election: Requested vote from peers c6d026bb4a9146c395c2b8572753ffb7 (127.5.126.65:34303), 3a01ebd6b99640978d77190fe4da6f08 (127.5.126.67:45221)
I20260709 13:23:42.507876 16390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd931932596f4755aeae878c0fe3c2d9" candidate_uuid: "6070cdc51c6f49fcbcfbddd22a3c263c" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "3a01ebd6b99640978d77190fe4da6f08"
I20260709 13:23:42.508584 16390 raft_consensus.cc:3055] T fd931932596f4755aeae878c0fe3c2d9 P 3a01ebd6b99640978d77190fe4da6f08 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:23:42.508888 16390 raft_consensus.cc:740] T fd931932596f4755aeae878c0fe3c2d9 P 3a01ebd6b99640978d77190fe4da6f08 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 3a01ebd6b99640978d77190fe4da6f08, State: Running, Role: LEADER
I20260709 13:23:42.509723 16390 consensus_queue.cc:260] T fd931932596f4755aeae878c0fe3c2d9 P 3a01ebd6b99640978d77190fe4da6f08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6d026bb4a9146c395c2b8572753ffb7" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34303 } } peers { permanent_uuid: "6070cdc51c6f49fcbcfbddd22a3c263c" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 41095 } } peers { permanent_uuid: "3a01ebd6b99640978d77190fe4da6f08" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 45221 } }
I20260709 13:23:42.511142 16390 raft_consensus.cc:3060] T fd931932596f4755aeae878c0fe3c2d9 P 3a01ebd6b99640978d77190fe4da6f08 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:23:42.512643 16611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd931932596f4755aeae878c0fe3c2d9" candidate_uuid: "6070cdc51c6f49fcbcfbddd22a3c263c" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "c6d026bb4a9146c395c2b8572753ffb7"
I20260709 13:23:42.514424 16611 raft_consensus.cc:3060] T fd931932596f4755aeae878c0fe3c2d9 P c6d026bb4a9146c395c2b8572753ffb7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:23:42.518162 16390 raft_consensus.cc:2468] T fd931932596f4755aeae878c0fe3c2d9 P 3a01ebd6b99640978d77190fe4da6f08 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6070cdc51c6f49fcbcfbddd22a3c263c in term 4.
I20260709 13:23:42.519477 16281 leader_election.cc:304] T fd931932596f4755aeae878c0fe3c2d9 P 6070cdc51c6f49fcbcfbddd22a3c263c [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3a01ebd6b99640978d77190fe4da6f08, 6070cdc51c6f49fcbcfbddd22a3c263c; no voters: 
I20260709 13:23:42.520229 16731 raft_consensus.cc:2804] T fd931932596f4755aeae878c0fe3c2d9 P 6070cdc51c6f49fcbcfbddd22a3c263c [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:23:42.520689 16731 raft_consensus.cc:697] T fd931932596f4755aeae878c0fe3c2d9 P 6070cdc51c6f49fcbcfbddd22a3c263c [term 4 LEADER]: Becoming Leader. State: Replica: 6070cdc51c6f49fcbcfbddd22a3c263c, State: Running, Role: LEADER
I20260709 13:23:42.521768 16731 consensus_queue.cc:237] T fd931932596f4755aeae878c0fe3c2d9 P 6070cdc51c6f49fcbcfbddd22a3c263c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6d026bb4a9146c395c2b8572753ffb7" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34303 } } peers { permanent_uuid: "6070cdc51c6f49fcbcfbddd22a3c263c" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 41095 } } peers { permanent_uuid: "3a01ebd6b99640978d77190fe4da6f08" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 45221 } }
I20260709 13:23:42.524057 16611 raft_consensus.cc:2468] T fd931932596f4755aeae878c0fe3c2d9 P c6d026bb4a9146c395c2b8572753ffb7 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6070cdc51c6f49fcbcfbddd22a3c263c in term 4.
I20260709 13:23:42.532389 16137 catalog_manager.cc:5697] T fd931932596f4755aeae878c0fe3c2d9 P 6070cdc51c6f49fcbcfbddd22a3c263c reported cstate change: term changed from 3 to 4, leader changed from 3a01ebd6b99640978d77190fe4da6f08 (127.5.126.67) to 6070cdc51c6f49fcbcfbddd22a3c263c (127.5.126.66). New cstate: current_term: 4 leader_uuid: "6070cdc51c6f49fcbcfbddd22a3c263c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6d026bb4a9146c395c2b8572753ffb7" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 34303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6070cdc51c6f49fcbcfbddd22a3c263c" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 41095 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3a01ebd6b99640978d77190fe4da6f08" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 45221 } health_report { overall_health: UNKNOWN } } }
I20260709 13:23:42.889504  5625 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:23:42.927470  5625 tablet_server.cc:179] TabletServer@127.5.126.65:34303 shutting down...
I20260709 13:23:42.955884  5625 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:23:42.956815  5625 tablet_replica.cc:333] stopping tablet replica
I20260709 13:23:42.957553  5625 raft_consensus.cc:2243] T b0313caec0564fd5bf22e34524632537 P c6d026bb4a9146c395c2b8572753ffb7 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:23:42.958134  5625 raft_consensus.cc:2272] T b0313caec0564fd5bf22e34524632537 P c6d026bb4a9146c395c2b8572753ffb7 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:42.960641  5625 tablet_replica.cc:333] stopping tablet replica
I20260709 13:23:42.961361  5625 raft_consensus.cc:2243] T 5066abfe4261488f96534730b07ce4d5 P c6d026bb4a9146c395c2b8572753ffb7 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 13:23:42.961843  5625 raft_consensus.cc:2272] T 5066abfe4261488f96534730b07ce4d5 P c6d026bb4a9146c395c2b8572753ffb7 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:42.965900  5625 tablet_replica.cc:333] stopping tablet replica
I20260709 13:23:42.967000  5625 raft_consensus.cc:2243] T 49ace918d4da4776b29f4aa41975e9ef P c6d026bb4a9146c395c2b8572753ffb7 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:23:42.967602  5625 raft_consensus.cc:2272] T 49ace918d4da4776b29f4aa41975e9ef P c6d026bb4a9146c395c2b8572753ffb7 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:42.970336  5625 tablet_replica.cc:333] stopping tablet replica
I20260709 13:23:42.971061  5625 raft_consensus.cc:2243] T cb70c02d0bce438cbb6434b2c0aa54ae P c6d026bb4a9146c395c2b8572753ffb7 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:23:42.971527  5625 raft_consensus.cc:2272] T cb70c02d0bce438cbb6434b2c0aa54ae P c6d026bb4a9146c395c2b8572753ffb7 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:42.974373  5625 tablet_replica.cc:333] stopping tablet replica
I20260709 13:23:42.975021  5625 raft_consensus.cc:2243] T f55407f772b74aaba87440ba35c2ac8b P c6d026bb4a9146c395c2b8572753ffb7 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:23:42.975574  5625 raft_consensus.cc:2272] T f55407f772b74aaba87440ba35c2ac8b P c6d026bb4a9146c395c2b8572753ffb7 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:42.978273  5625 tablet_replica.cc:333] stopping tablet replica
I20260709 13:23:42.978879  5625 raft_consensus.cc:2243] T aab7ef362ab84369939a6a02d817aa53 P c6d026bb4a9146c395c2b8572753ffb7 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:23:42.979367  5625 raft_consensus.cc:2272] T aab7ef362ab84369939a6a02d817aa53 P c6d026bb4a9146c395c2b8572753ffb7 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:42.982064  5625 tablet_replica.cc:333] stopping tablet replica
I20260709 13:23:42.982695  5625 raft_consensus.cc:2243] T 4f5a2d88e89448648f594ef23ef152cd P c6d026bb4a9146c395c2b8572753ffb7 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:23:42.983237  5625 raft_consensus.cc:2272] T 4f5a2d88e89448648f594ef23ef152cd P c6d026bb4a9146c395c2b8572753ffb7 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:42.986485  5625 tablet_replica.cc:333] stopping tablet replica
W20260709 13:23:42.987092 16355 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 14 similar messages]
I20260709 13:23:42.987272  5625 raft_consensus.cc:2243] T fd931932596f4755aeae878c0fe3c2d9 P c6d026bb4a9146c395c2b8572753ffb7 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:23:42.988186  5625 raft_consensus.cc:2272] T fd931932596f4755aeae878c0fe3c2d9 P c6d026bb4a9146c395c2b8572753ffb7 [term 4 FOLLOWER]: Raft consensus is shut down!
W20260709 13:23:42.990871 16355 consensus_peers.cc:597] T 5066abfe4261488f96534730b07ce4d5 P 3a01ebd6b99640978d77190fe4da6f08 -> Peer c6d026bb4a9146c395c2b8572753ffb7 (127.5.126.65:34303): Couldn't send request to peer c6d026bb4a9146c395c2b8572753ffb7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:23:42.992503  5625 tablet_replica.cc:333] stopping tablet replica
I20260709 13:23:42.993472  5625 raft_consensus.cc:2243] T 88caca305bf74120a011e3fa92781678 P c6d026bb4a9146c395c2b8572753ffb7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:23:42.994009  5625 raft_consensus.cc:2272] T 88caca305bf74120a011e3fa92781678 P c6d026bb4a9146c395c2b8572753ffb7 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:23:42.994534 16281 consensus_peers.cc:597] T fd931932596f4755aeae878c0fe3c2d9 P 6070cdc51c6f49fcbcfbddd22a3c263c -> Peer c6d026bb4a9146c395c2b8572753ffb7 (127.5.126.65:34303): Couldn't send request to peer c6d026bb4a9146c395c2b8572753ffb7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:23:42.997166  5625 tablet_replica.cc:333] stopping tablet replica
I20260709 13:23:42.997809  5625 raft_consensus.cc:2243] T b1e06a2952f94a919e5324bd1f0d7cab P c6d026bb4a9146c395c2b8572753ffb7 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:23:42.998400  5625 raft_consensus.cc:2272] T b1e06a2952f94a919e5324bd1f0d7cab P c6d026bb4a9146c395c2b8572753ffb7 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:23:43.011174 16281 consensus_peers.cc:597] T b0313caec0564fd5bf22e34524632537 P 6070cdc51c6f49fcbcfbddd22a3c263c -> Peer c6d026bb4a9146c395c2b8572753ffb7 (127.5.126.65:34303): Couldn't send request to peer c6d026bb4a9146c395c2b8572753ffb7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:23:43.059314 16281 consensus_peers.cc:597] T 49ace918d4da4776b29f4aa41975e9ef P 6070cdc51c6f49fcbcfbddd22a3c263c -> Peer c6d026bb4a9146c395c2b8572753ffb7 (127.5.126.65:34303): Couldn't send request to peer c6d026bb4a9146c395c2b8572753ffb7. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:34303: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:23:43.088806 16281 consensus_peers.cc:597] T b1e06a2952f94a919e5324bd1f0d7cab P 6070cdc51c6f49fcbcfbddd22a3c263c -> Peer c6d026bb4a9146c395c2b8572753ffb7 (127.5.126.65:34303): Couldn't send request to peer c6d026bb4a9146c395c2b8572753ffb7. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:34303: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:23:43.094907 16390 raft_consensus.cc:1275] T b0313caec0564fd5bf22e34524632537 P 3a01ebd6b99640978d77190fe4da6f08 [term 4 FOLLOWER]: Refusing update from remote peer 6070cdc51c6f49fcbcfbddd22a3c263c: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:23:43.096300 16731 consensus_queue.cc:1048] T b0313caec0564fd5bf22e34524632537 P 6070cdc51c6f49fcbcfbddd22a3c263c [LEADER]: Connected to new peer: Peer: permanent_uuid: "3a01ebd6b99640978d77190fe4da6f08" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 45221 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:23:43.138101 16390 raft_consensus.cc:1275] T fd931932596f4755aeae878c0fe3c2d9 P 3a01ebd6b99640978d77190fe4da6f08 [term 4 FOLLOWER]: Refusing update from remote peer 6070cdc51c6f49fcbcfbddd22a3c263c: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
W20260709 13:23:43.139734 16355 consensus_peers.cc:597] T aab7ef362ab84369939a6a02d817aa53 P 3a01ebd6b99640978d77190fe4da6f08 -> Peer c6d026bb4a9146c395c2b8572753ffb7 (127.5.126.65:34303): Couldn't send request to peer c6d026bb4a9146c395c2b8572753ffb7. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:34303: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:23:43.139662 16731 consensus_queue.cc:1048] T fd931932596f4755aeae878c0fe3c2d9 P 6070cdc51c6f49fcbcfbddd22a3c263c [LEADER]: Connected to new peer: Peer: permanent_uuid: "3a01ebd6b99640978d77190fe4da6f08" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 45221 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
W20260709 13:23:43.142107 16355 consensus_peers.cc:597] T f55407f772b74aaba87440ba35c2ac8b P 3a01ebd6b99640978d77190fe4da6f08 -> Peer c6d026bb4a9146c395c2b8572753ffb7 (127.5.126.65:34303): Couldn't send request to peer c6d026bb4a9146c395c2b8572753ffb7. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:34303: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:23:43.247752 16281 consensus_peers.cc:597] T 4f5a2d88e89448648f594ef23ef152cd P 6070cdc51c6f49fcbcfbddd22a3c263c -> Peer c6d026bb4a9146c395c2b8572753ffb7 (127.5.126.65:34303): Couldn't send request to peer c6d026bb4a9146c395c2b8572753ffb7. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:34303: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:23:43.416805 16634 debug-util.cc:398] Leaking SignalData structure 0x7b0800082ca0 after lost signal to thread 5628
W20260709 13:23:43.419175 16634 debug-util.cc:398] Leaking SignalData structure 0x7b0800059d80 after lost signal to thread 16174
W20260709 13:23:43.420925 16634 debug-util.cc:398] Leaking SignalData structure 0x7b08001fb420 after lost signal to thread 16341
W20260709 13:23:43.422094 16634 debug-util.cc:398] Leaking SignalData structure 0x7b08002a1180 after lost signal to thread 16415
W20260709 13:23:43.437556 16355 consensus_peers.cc:597] T cb70c02d0bce438cbb6434b2c0aa54ae P 3a01ebd6b99640978d77190fe4da6f08 -> Peer c6d026bb4a9146c395c2b8572753ffb7 (127.5.126.65:34303): Couldn't send request to peer c6d026bb4a9146c395c2b8572753ffb7. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:34303: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:23:43.445749 16188 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
W20260709 13:23:43.495639 16355 consensus_peers.cc:597] T 88caca305bf74120a011e3fa92781678 P 3a01ebd6b99640978d77190fe4da6f08 -> Peer c6d026bb4a9146c395c2b8572753ffb7 (127.5.126.65:34303): Couldn't send request to peer c6d026bb4a9146c395c2b8572753ffb7. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:34303: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:23:44.033509  5625 thread.cc:527] Waited for 1000ms trying to join with diag-logger (tid 16634)
W20260709 13:23:44.447006 16188 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
W20260709 13:23:45.034147  5625 thread.cc:527] Waited for 2000ms trying to join with diag-logger (tid 16634)
W20260709 13:23:45.199942 16355 consensus_peers.cc:597] T 5066abfe4261488f96534730b07ce4d5 P 3a01ebd6b99640978d77190fe4da6f08 -> Peer c6d026bb4a9146c395c2b8572753ffb7 (127.5.126.65:34303): Couldn't send request to peer c6d026bb4a9146c395c2b8572753ffb7. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:34303: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:23:45.332405 16281 consensus_peers.cc:597] T b0313caec0564fd5bf22e34524632537 P 6070cdc51c6f49fcbcfbddd22a3c263c -> Peer c6d026bb4a9146c395c2b8572753ffb7 (127.5.126.65:34303): Couldn't send request to peer c6d026bb4a9146c395c2b8572753ffb7. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:34303: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:23:45.448616 16188 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
W20260709 13:23:45.513499 16355 consensus_peers.cc:597] T f55407f772b74aaba87440ba35c2ac8b P 3a01ebd6b99640978d77190fe4da6f08 -> Peer c6d026bb4a9146c395c2b8572753ffb7 (127.5.126.65:34303): Couldn't send request to peer c6d026bb4a9146c395c2b8572753ffb7. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:34303: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:23:45.613941 16281 consensus_peers.cc:597] T 4f5a2d88e89448648f594ef23ef152cd P 6070cdc51c6f49fcbcfbddd22a3c263c -> Peer c6d026bb4a9146c395c2b8572753ffb7 (127.5.126.65:34303): Couldn't send request to peer c6d026bb4a9146c395c2b8572753ffb7. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:34303: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:23:45.691764 16355 consensus_peers.cc:597] T aab7ef362ab84369939a6a02d817aa53 P 3a01ebd6b99640978d77190fe4da6f08 -> Peer c6d026bb4a9146c395c2b8572753ffb7 (127.5.126.65:34303): Couldn't send request to peer c6d026bb4a9146c395c2b8572753ffb7. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:34303: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:23:45.714388 16281 consensus_peers.cc:597] T b1e06a2952f94a919e5324bd1f0d7cab P 6070cdc51c6f49fcbcfbddd22a3c263c -> Peer c6d026bb4a9146c395c2b8572753ffb7 (127.5.126.65:34303): Couldn't send request to peer c6d026bb4a9146c395c2b8572753ffb7. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:34303: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:23:45.750253 16281 consensus_peers.cc:597] T fd931932596f4755aeae878c0fe3c2d9 P 6070cdc51c6f49fcbcfbddd22a3c263c -> Peer c6d026bb4a9146c395c2b8572753ffb7 (127.5.126.65:34303): Couldn't send request to peer c6d026bb4a9146c395c2b8572753ffb7. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:34303: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:23:45.793359 16281 consensus_peers.cc:597] T 49ace918d4da4776b29f4aa41975e9ef P 6070cdc51c6f49fcbcfbddd22a3c263c -> Peer c6d026bb4a9146c395c2b8572753ffb7 (127.5.126.65:34303): Couldn't send request to peer c6d026bb4a9146c395c2b8572753ffb7. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:34303: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:23:45.815583 16355 consensus_peers.cc:597] T cb70c02d0bce438cbb6434b2c0aa54ae P 3a01ebd6b99640978d77190fe4da6f08 -> Peer c6d026bb4a9146c395c2b8572753ffb7 (127.5.126.65:34303): Couldn't send request to peer c6d026bb4a9146c395c2b8572753ffb7. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:34303: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:23:45.861410 16355 consensus_peers.cc:597] T 88caca305bf74120a011e3fa92781678 P 3a01ebd6b99640978d77190fe4da6f08 -> Peer c6d026bb4a9146c395c2b8572753ffb7 (127.5.126.65:34303): Couldn't send request to peer c6d026bb4a9146c395c2b8572753ffb7. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:34303: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:23:46.017333 16171 debug-util.cc:398] Leaking SignalData structure 0x7b08002b69a0 after lost signal to thread 5628
W20260709 13:23:46.018800 16171 debug-util.cc:398] Leaking SignalData structure 0x7b080030ca20 after lost signal to thread 16174
W20260709 13:23:46.020169 16171 debug-util.cc:398] Leaking SignalData structure 0x7b080024d2c0 after lost signal to thread 16341
W20260709 13:23:46.021251 16171 debug-util.cc:398] Leaking SignalData structure 0x7b0800084940 after lost signal to thread 16415
W20260709 13:23:46.034890  5625 thread.cc:527] Waited for 3000ms trying to join with diag-logger (tid 16634)
W20260709 13:23:46.449988 16188 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:23:46.900303  5625 tablet_server.cc:196] TabletServer@127.5.126.65:34303 shutdown complete.
I20260709 13:23:46.948810  5625 tablet_server.cc:179] TabletServer@127.5.126.66:0 shutting down...
W20260709 13:23:46.956887 16355 consensus_peers.cc:597] T 5066abfe4261488f96534730b07ce4d5 P 3a01ebd6b99640978d77190fe4da6f08 -> Peer 6070cdc51c6f49fcbcfbddd22a3c263c (127.5.126.66:41095): Couldn't send request to peer 6070cdc51c6f49fcbcfbddd22a3c263c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:23:47.008723  5625 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:23:47.009626  5625 tablet_replica.cc:333] T b0313caec0564fd5bf22e34524632537 P 6070cdc51c6f49fcbcfbddd22a3c263c: stopping tablet replica
I20260709 13:23:47.010443  5625 raft_consensus.cc:2243] T b0313caec0564fd5bf22e34524632537 P 6070cdc51c6f49fcbcfbddd22a3c263c [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:23:47.011384  5625 raft_consensus.cc:2272] T b0313caec0564fd5bf22e34524632537 P 6070cdc51c6f49fcbcfbddd22a3c263c [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:47.014132  5625 tablet_replica.cc:333] T 49ace918d4da4776b29f4aa41975e9ef P 6070cdc51c6f49fcbcfbddd22a3c263c: stopping tablet replica
I20260709 13:23:47.014931  5625 raft_consensus.cc:2243] T 49ace918d4da4776b29f4aa41975e9ef P 6070cdc51c6f49fcbcfbddd22a3c263c [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:23:47.015738  5625 raft_consensus.cc:2272] T 49ace918d4da4776b29f4aa41975e9ef P 6070cdc51c6f49fcbcfbddd22a3c263c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:47.018464  5625 tablet_replica.cc:333] T 5066abfe4261488f96534730b07ce4d5 P 6070cdc51c6f49fcbcfbddd22a3c263c: stopping tablet replica
I20260709 13:23:47.019171  5625 raft_consensus.cc:2243] T 5066abfe4261488f96534730b07ce4d5 P 6070cdc51c6f49fcbcfbddd22a3c263c [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 13:23:47.019623  5625 raft_consensus.cc:2272] T 5066abfe4261488f96534730b07ce4d5 P 6070cdc51c6f49fcbcfbddd22a3c263c [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:47.022063  5625 tablet_replica.cc:333] T b1e06a2952f94a919e5324bd1f0d7cab P 6070cdc51c6f49fcbcfbddd22a3c263c: stopping tablet replica
I20260709 13:23:47.022732  5625 raft_consensus.cc:2243] T b1e06a2952f94a919e5324bd1f0d7cab P 6070cdc51c6f49fcbcfbddd22a3c263c [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:23:47.023622  5625 raft_consensus.cc:2272] T b1e06a2952f94a919e5324bd1f0d7cab P 6070cdc51c6f49fcbcfbddd22a3c263c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:47.026129  5625 tablet_replica.cc:333] T fd931932596f4755aeae878c0fe3c2d9 P 6070cdc51c6f49fcbcfbddd22a3c263c: stopping tablet replica
I20260709 13:23:47.026795  5625 raft_consensus.cc:2243] T fd931932596f4755aeae878c0fe3c2d9 P 6070cdc51c6f49fcbcfbddd22a3c263c [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:23:47.027619  5625 raft_consensus.cc:2272] T fd931932596f4755aeae878c0fe3c2d9 P 6070cdc51c6f49fcbcfbddd22a3c263c [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:47.030174  5625 tablet_replica.cc:333] T 4f5a2d88e89448648f594ef23ef152cd P 6070cdc51c6f49fcbcfbddd22a3c263c: stopping tablet replica
I20260709 13:23:47.030710  5625 raft_consensus.cc:2243] T 4f5a2d88e89448648f594ef23ef152cd P 6070cdc51c6f49fcbcfbddd22a3c263c [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:23:47.031574  5625 raft_consensus.cc:2272] T 4f5a2d88e89448648f594ef23ef152cd P 6070cdc51c6f49fcbcfbddd22a3c263c [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:47.034214  5625 tablet_replica.cc:333] T 88caca305bf74120a011e3fa92781678 P 6070cdc51c6f49fcbcfbddd22a3c263c: stopping tablet replica
I20260709 13:23:47.035063  5625 raft_consensus.cc:2243] T 88caca305bf74120a011e3fa92781678 P 6070cdc51c6f49fcbcfbddd22a3c263c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:23:47.035645  5625 raft_consensus.cc:2272] T 88caca305bf74120a011e3fa92781678 P 6070cdc51c6f49fcbcfbddd22a3c263c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:47.038605  5625 tablet_replica.cc:333] T aab7ef362ab84369939a6a02d817aa53 P 6070cdc51c6f49fcbcfbddd22a3c263c: stopping tablet replica
I20260709 13:23:47.039208  5625 raft_consensus.cc:2243] T aab7ef362ab84369939a6a02d817aa53 P 6070cdc51c6f49fcbcfbddd22a3c263c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:23:47.039656  5625 raft_consensus.cc:2272] T aab7ef362ab84369939a6a02d817aa53 P 6070cdc51c6f49fcbcfbddd22a3c263c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:47.042085  5625 tablet_replica.cc:333] T f55407f772b74aaba87440ba35c2ac8b P 6070cdc51c6f49fcbcfbddd22a3c263c: stopping tablet replica
I20260709 13:23:47.042634  5625 raft_consensus.cc:2243] T f55407f772b74aaba87440ba35c2ac8b P 6070cdc51c6f49fcbcfbddd22a3c263c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:23:47.043156  5625 raft_consensus.cc:2272] T f55407f772b74aaba87440ba35c2ac8b P 6070cdc51c6f49fcbcfbddd22a3c263c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:47.046094  5625 tablet_replica.cc:333] T cb70c02d0bce438cbb6434b2c0aa54ae P 6070cdc51c6f49fcbcfbddd22a3c263c: stopping tablet replica
I20260709 13:23:47.046813  5625 raft_consensus.cc:2243] T cb70c02d0bce438cbb6434b2c0aa54ae P 6070cdc51c6f49fcbcfbddd22a3c263c [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:23:47.047302  5625 raft_consensus.cc:2272] T cb70c02d0bce438cbb6434b2c0aa54ae P 6070cdc51c6f49fcbcfbddd22a3c263c [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 13:23:47.080631 16355 consensus_peers.cc:597] T aab7ef362ab84369939a6a02d817aa53 P 3a01ebd6b99640978d77190fe4da6f08 -> Peer 6070cdc51c6f49fcbcfbddd22a3c263c (127.5.126.66:41095): Couldn't send request to peer 6070cdc51c6f49fcbcfbddd22a3c263c. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.66:41095: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:23:47.087569  5625 tablet_server.cc:196] TabletServer@127.5.126.66:0 shutdown complete.
W20260709 13:23:47.119423 16355 consensus_peers.cc:597] T f55407f772b74aaba87440ba35c2ac8b P 3a01ebd6b99640978d77190fe4da6f08 -> Peer 6070cdc51c6f49fcbcfbddd22a3c263c (127.5.126.66:41095): Couldn't send request to peer 6070cdc51c6f49fcbcfbddd22a3c263c. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.66:41095: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:23:47.129789  5625 tablet_server.cc:179] TabletServer@127.5.126.67:0 shutting down...
W20260709 13:23:47.151829 16355 consensus_peers.cc:597] T cb70c02d0bce438cbb6434b2c0aa54ae P 3a01ebd6b99640978d77190fe4da6f08 -> Peer 6070cdc51c6f49fcbcfbddd22a3c263c (127.5.126.66:41095): Couldn't send request to peer 6070cdc51c6f49fcbcfbddd22a3c263c. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.66:41095: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:23:47.175813 16355 consensus_peers.cc:597] T 88caca305bf74120a011e3fa92781678 P 3a01ebd6b99640978d77190fe4da6f08 -> Peer 6070cdc51c6f49fcbcfbddd22a3c263c (127.5.126.66:41095): Couldn't send request to peer 6070cdc51c6f49fcbcfbddd22a3c263c. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.66:41095: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:23:47.179122  5625 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:23:47.180281  5625 tablet_replica.cc:333] T b0313caec0564fd5bf22e34524632537 P 3a01ebd6b99640978d77190fe4da6f08: stopping tablet replica
I20260709 13:23:47.181514  5625 raft_consensus.cc:2243] T b0313caec0564fd5bf22e34524632537 P 3a01ebd6b99640978d77190fe4da6f08 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:23:47.182181  5625 raft_consensus.cc:2272] T b0313caec0564fd5bf22e34524632537 P 3a01ebd6b99640978d77190fe4da6f08 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:47.185983  5625 tablet_replica.cc:333] T aab7ef362ab84369939a6a02d817aa53 P 3a01ebd6b99640978d77190fe4da6f08: stopping tablet replica
I20260709 13:23:47.186981  5625 raft_consensus.cc:2243] T aab7ef362ab84369939a6a02d817aa53 P 3a01ebd6b99640978d77190fe4da6f08 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:23:47.188295  5625 raft_consensus.cc:2272] T aab7ef362ab84369939a6a02d817aa53 P 3a01ebd6b99640978d77190fe4da6f08 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:47.192190  5625 tablet_replica.cc:333] T cb70c02d0bce438cbb6434b2c0aa54ae P 3a01ebd6b99640978d77190fe4da6f08: stopping tablet replica
I20260709 13:23:47.193051  5625 raft_consensus.cc:2243] T cb70c02d0bce438cbb6434b2c0aa54ae P 3a01ebd6b99640978d77190fe4da6f08 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:23:47.195026  5625 raft_consensus.cc:2272] T cb70c02d0bce438cbb6434b2c0aa54ae P 3a01ebd6b99640978d77190fe4da6f08 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:47.199501  5625 tablet_replica.cc:333] T f55407f772b74aaba87440ba35c2ac8b P 3a01ebd6b99640978d77190fe4da6f08: stopping tablet replica
I20260709 13:23:47.200474  5625 raft_consensus.cc:2243] T f55407f772b74aaba87440ba35c2ac8b P 3a01ebd6b99640978d77190fe4da6f08 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:23:47.201781  5625 raft_consensus.cc:2272] T f55407f772b74aaba87440ba35c2ac8b P 3a01ebd6b99640978d77190fe4da6f08 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:47.205338  5625 tablet_replica.cc:333] T 49ace918d4da4776b29f4aa41975e9ef P 3a01ebd6b99640978d77190fe4da6f08: stopping tablet replica
I20260709 13:23:47.206282  5625 raft_consensus.cc:2243] T 49ace918d4da4776b29f4aa41975e9ef P 3a01ebd6b99640978d77190fe4da6f08 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:23:47.206892  5625 raft_consensus.cc:2272] T 49ace918d4da4776b29f4aa41975e9ef P 3a01ebd6b99640978d77190fe4da6f08 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:47.210161  5625 tablet_replica.cc:333] T 5066abfe4261488f96534730b07ce4d5 P 3a01ebd6b99640978d77190fe4da6f08: stopping tablet replica
I20260709 13:23:47.211019  5625 raft_consensus.cc:2243] T 5066abfe4261488f96534730b07ce4d5 P 3a01ebd6b99640978d77190fe4da6f08 [term 5 LEADER]: Raft consensus shutting down.
I20260709 13:23:47.212230  5625 raft_consensus.cc:2272] T 5066abfe4261488f96534730b07ce4d5 P 3a01ebd6b99640978d77190fe4da6f08 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:47.215687  5625 tablet_replica.cc:333] T 4f5a2d88e89448648f594ef23ef152cd P 3a01ebd6b99640978d77190fe4da6f08: stopping tablet replica
I20260709 13:23:47.216562  5625 raft_consensus.cc:2243] T 4f5a2d88e89448648f594ef23ef152cd P 3a01ebd6b99640978d77190fe4da6f08 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:23:47.217264  5625 raft_consensus.cc:2272] T 4f5a2d88e89448648f594ef23ef152cd P 3a01ebd6b99640978d77190fe4da6f08 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:47.220955  5625 tablet_replica.cc:333] T fd931932596f4755aeae878c0fe3c2d9 P 3a01ebd6b99640978d77190fe4da6f08: stopping tablet replica
I20260709 13:23:47.221743  5625 raft_consensus.cc:2243] T fd931932596f4755aeae878c0fe3c2d9 P 3a01ebd6b99640978d77190fe4da6f08 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:23:47.222302  5625 raft_consensus.cc:2272] T fd931932596f4755aeae878c0fe3c2d9 P 3a01ebd6b99640978d77190fe4da6f08 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:47.225639  5625 tablet_replica.cc:333] T 88caca305bf74120a011e3fa92781678 P 3a01ebd6b99640978d77190fe4da6f08: stopping tablet replica
I20260709 13:23:47.226405  5625 raft_consensus.cc:2243] T 88caca305bf74120a011e3fa92781678 P 3a01ebd6b99640978d77190fe4da6f08 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:23:47.227610  5625 raft_consensus.cc:2272] T 88caca305bf74120a011e3fa92781678 P 3a01ebd6b99640978d77190fe4da6f08 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:47.231406  5625 tablet_replica.cc:333] T b1e06a2952f94a919e5324bd1f0d7cab P 3a01ebd6b99640978d77190fe4da6f08: stopping tablet replica
I20260709 13:23:47.232249  5625 raft_consensus.cc:2243] T b1e06a2952f94a919e5324bd1f0d7cab P 3a01ebd6b99640978d77190fe4da6f08 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:23:47.232875  5625 raft_consensus.cc:2272] T b1e06a2952f94a919e5324bd1f0d7cab P 3a01ebd6b99640978d77190fe4da6f08 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:47.313401  5625 tablet_server.cc:196] TabletServer@127.5.126.67:0 shutdown complete.
I20260709 13:23:47.356662  5625 master.cc:562] Master@127.5.126.126:35803 shutting down...
I20260709 13:23:47.394910  5625 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 01b5fafdca654d40899905e7044fc4b1 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:23:47.395524  5625 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 01b5fafdca654d40899905e7044fc4b1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:47.395916  5625 tablet_replica.cc:333] T 00000000000000000000000000000000 P 01b5fafdca654d40899905e7044fc4b1: stopping tablet replica
W20260709 13:23:48.415208  5625 thread.cc:527] Waited for 1000ms trying to join with diag-logger (tid 16171)
I20260709 13:23:49.425655  5625 master.cc:584] Master@127.5.126.126:35803 shutdown complete.
[       OK ] LeaderRebalancerTest.TestMaintenanceMode (20674 ms)
[ RUN      ] LeaderRebalancerTest.MultiTableLeaderBalance
I20260709 13:23:49.481714  5625 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.5.126.126:43497
I20260709 13:23:49.482996  5625 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:23:49.489979 16762 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:23:49.490125 16763 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:23:49.490912 16765 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:23:49.491891  5625 server_base.cc:1061] running on GCE node
I20260709 13:23:49.493425  5625 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:23:49.493687  5625 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:23:49.493876  5625 hybrid_clock.cc:648] HybridClock initialized: now 1783603429493858 us; error 0 us; skew 500 ppm
I20260709 13:23:49.494448  5625 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:23:49.497591  5625 webserver.cc:533] Webserver started at http://127.5.126.126:41157/ using document root <none> and password file <none>
I20260709 13:23:49.498134  5625 fs_manager.cc:362] Metadata directory not provided
I20260709 13:23:49.498355  5625 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:23:49.498636  5625 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:23:49.499809  5625 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskWHb0CB/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783603057096655-5625-0/minicluster-data/master-0-root/instance:
uuid: "633e3861906342c68902502b811b2baf"
format_stamp: "Formatted at 2026-07-09 13:23:49 on dist-test-slave-smzk"
I20260709 13:23:49.504637  5625 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.000s
I20260709 13:23:49.508690 16770 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:23:49.509840  5625 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.001s
I20260709 13:23:49.510171  5625 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskWHb0CB/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783603057096655-5625-0/minicluster-data/master-0-root
uuid: "633e3861906342c68902502b811b2baf"
format_stamp: "Formatted at 2026-07-09 13:23:49 on dist-test-slave-smzk"
I20260709 13:23:49.510485  5625 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWHb0CB/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783603057096655-5625-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskWHb0CB/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783603057096655-5625-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskWHb0CB/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783603057096655-5625-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:23:49.548326  5625 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:23:49.549819  5625 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:23:49.600497  5625 rpc_server.cc:307] RPC server started. Bound to: 127.5.126.126:43497
I20260709 13:23:49.600665 16821 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.5.126.126:43497 every 8 connection(s)
I20260709 13:23:49.605221 16822 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:23:49.616504 16822 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 633e3861906342c68902502b811b2baf: Bootstrap starting.
I20260709 13:23:49.621549 16822 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 633e3861906342c68902502b811b2baf: Neither blocks nor log segments found. Creating new log.
I20260709 13:23:49.626506 16822 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 633e3861906342c68902502b811b2baf: No bootstrap required, opened a new log
I20260709 13:23:49.628970 16822 raft_consensus.cc:359] T 00000000000000000000000000000000 P 633e3861906342c68902502b811b2baf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "633e3861906342c68902502b811b2baf" member_type: VOTER }
I20260709 13:23:49.629554 16822 raft_consensus.cc:385] T 00000000000000000000000000000000 P 633e3861906342c68902502b811b2baf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:23:49.629886 16822 raft_consensus.cc:740] T 00000000000000000000000000000000 P 633e3861906342c68902502b811b2baf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 633e3861906342c68902502b811b2baf, State: Initialized, Role: FOLLOWER
I20260709 13:23:49.630599 16822 consensus_queue.cc:260] T 00000000000000000000000000000000 P 633e3861906342c68902502b811b2baf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "633e3861906342c68902502b811b2baf" member_type: VOTER }
I20260709 13:23:49.631141 16822 raft_consensus.cc:399] T 00000000000000000000000000000000 P 633e3861906342c68902502b811b2baf [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:23:49.631515 16822 raft_consensus.cc:493] T 00000000000000000000000000000000 P 633e3861906342c68902502b811b2baf [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:23:49.631943 16822 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 633e3861906342c68902502b811b2baf [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:23:49.637020 16822 raft_consensus.cc:515] T 00000000000000000000000000000000 P 633e3861906342c68902502b811b2baf [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "633e3861906342c68902502b811b2baf" member_type: VOTER }
I20260709 13:23:49.637571 16822 leader_election.cc:304] T 00000000000000000000000000000000 P 633e3861906342c68902502b811b2baf [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 633e3861906342c68902502b811b2baf; no voters: 
I20260709 13:23:49.638849 16822 leader_election.cc:290] T 00000000000000000000000000000000 P 633e3861906342c68902502b811b2baf [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:23:49.639540 16825 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 633e3861906342c68902502b811b2baf [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:23:49.641256 16825 raft_consensus.cc:697] T 00000000000000000000000000000000 P 633e3861906342c68902502b811b2baf [term 1 LEADER]: Becoming Leader. State: Replica: 633e3861906342c68902502b811b2baf, State: Running, Role: LEADER
I20260709 13:23:49.642056 16825 consensus_queue.cc:237] T 00000000000000000000000000000000 P 633e3861906342c68902502b811b2baf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "633e3861906342c68902502b811b2baf" member_type: VOTER }
I20260709 13:23:49.642367 16822 sys_catalog.cc:565] T 00000000000000000000000000000000 P 633e3861906342c68902502b811b2baf [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:23:49.647146 16826 sys_catalog.cc:455] T 00000000000000000000000000000000 P 633e3861906342c68902502b811b2baf [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "633e3861906342c68902502b811b2baf" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "633e3861906342c68902502b811b2baf" member_type: VOTER } }
I20260709 13:23:49.648195 16826 sys_catalog.cc:458] T 00000000000000000000000000000000 P 633e3861906342c68902502b811b2baf [sys.catalog]: This master's current role is: LEADER
I20260709 13:23:49.648484 16827 sys_catalog.cc:455] T 00000000000000000000000000000000 P 633e3861906342c68902502b811b2baf [sys.catalog]: SysCatalogTable state changed. Reason: New leader 633e3861906342c68902502b811b2baf. Latest consensus state: current_term: 1 leader_uuid: "633e3861906342c68902502b811b2baf" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "633e3861906342c68902502b811b2baf" member_type: VOTER } }
I20260709 13:23:49.649386 16827 sys_catalog.cc:458] T 00000000000000000000000000000000 P 633e3861906342c68902502b811b2baf [sys.catalog]: This master's current role is: LEADER
I20260709 13:23:49.651307 16832 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:23:49.659797 16832 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:23:49.661041  5625 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:23:49.669633 16832 catalog_manager.cc:1383] Generated new cluster ID: 52207c29476b4306ab7531d5af611cf8
I20260709 13:23:49.670048 16832 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:23:49.691641 16832 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:23:49.693301 16832 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:23:49.719412 16832 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 633e3861906342c68902502b811b2baf: Generated new TSK 0
I20260709 13:23:49.720283 16832 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:23:49.728581  5625 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:23:49.736253 16843 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:23:49.737820 16844 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:23:49.738863 16846 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:23:49.739544  5625 server_base.cc:1061] running on GCE node
I20260709 13:23:49.740688  5625 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:23:49.740895  5625 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:23:49.741032  5625 hybrid_clock.cc:648] HybridClock initialized: now 1783603429741019 us; error 0 us; skew 500 ppm
I20260709 13:23:49.741585  5625 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:23:49.744560  5625 webserver.cc:533] Webserver started at http://127.5.126.65:35151/ using document root <none> and password file <none>
I20260709 13:23:49.745056  5625 fs_manager.cc:362] Metadata directory not provided
I20260709 13:23:49.745234  5625 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:23:49.745472  5625 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:23:49.746652  5625 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskWHb0CB/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783603057096655-5625-0/minicluster-data/ts-0-root/instance:
uuid: "f5a48d48028f489780ad77280a273215"
format_stamp: "Formatted at 2026-07-09 13:23:49 on dist-test-slave-smzk"
I20260709 13:23:49.751941  5625 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.002s	sys 0.005s
I20260709 13:23:49.755992 16851 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:23:49.757071  5625 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20260709 13:23:49.757472  5625 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskWHb0CB/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783603057096655-5625-0/minicluster-data/ts-0-root
uuid: "f5a48d48028f489780ad77280a273215"
format_stamp: "Formatted at 2026-07-09 13:23:49 on dist-test-slave-smzk"
I20260709 13:23:49.757779  5625 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWHb0CB/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783603057096655-5625-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskWHb0CB/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783603057096655-5625-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskWHb0CB/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783603057096655-5625-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:23:49.772861  5625 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:23:49.774119  5625 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:23:49.775678  5625 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:23:49.778155  5625 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:23:49.778395  5625 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:23:49.778651  5625 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:23:49.778877  5625 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:23:49.828439  5625 rpc_server.cc:307] RPC server started. Bound to: 127.5.126.65:44221
I20260709 13:23:49.828656 16913 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.5.126.65:44221 every 8 connection(s)
I20260709 13:23:49.833719  5625 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:23:49.842362 16918 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:23:49.843731 16919 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:23:49.846138 16921 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:23:49.846544  5625 server_base.cc:1061] running on GCE node
I20260709 13:23:49.847863  5625 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:23:49.848120  5625 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:23:49.848285  5625 hybrid_clock.cc:648] HybridClock initialized: now 1783603429848272 us; error 0 us; skew 500 ppm
I20260709 13:23:49.848757  5625 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:23:49.851449  5625 webserver.cc:533] Webserver started at http://127.5.126.66:43893/ using document root <none> and password file <none>
I20260709 13:23:49.852104  5625 fs_manager.cc:362] Metadata directory not provided
I20260709 13:23:49.852331  5625 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:23:49.852638  5625 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:23:49.854033  5625 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskWHb0CB/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783603057096655-5625-0/minicluster-data/ts-1-root/instance:
uuid: "1c65d124c93a4ac5b642819ff573ce97"
format_stamp: "Formatted at 2026-07-09 13:23:49 on dist-test-slave-smzk"
I20260709 13:23:49.854138 16914 heartbeater.cc:344] Connected to a master server at 127.5.126.126:43497
I20260709 13:23:49.854728 16914 heartbeater.cc:461] Registering TS with master...
I20260709 13:23:49.855609 16914 heartbeater.cc:507] Master 127.5.126.126:43497 requested a full tablet report, sending...
I20260709 13:23:49.858285 16787 ts_manager.cc:194] Registered new tserver with Master: f5a48d48028f489780ad77280a273215 (127.5.126.65:44221)
I20260709 13:23:49.859499  5625 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.006s	sys 0.000s
I20260709 13:23:49.860747 16787 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:43396
I20260709 13:23:49.863988 16926 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:23:49.865026  5625 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20260709 13:23:49.865386  5625 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskWHb0CB/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783603057096655-5625-0/minicluster-data/ts-1-root
uuid: "1c65d124c93a4ac5b642819ff573ce97"
format_stamp: "Formatted at 2026-07-09 13:23:49 on dist-test-slave-smzk"
I20260709 13:23:49.865713  5625 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWHb0CB/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783603057096655-5625-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskWHb0CB/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783603057096655-5625-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskWHb0CB/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783603057096655-5625-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:23:49.905578  5625 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:23:49.906847  5625 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:23:49.908424  5625 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:23:49.910794  5625 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:23:49.911012  5625 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:23:49.911257  5625 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:23:49.911424  5625 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:23:49.956851  5625 rpc_server.cc:307] RPC server started. Bound to: 127.5.126.66:37463
I20260709 13:23:49.957003 16988 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.5.126.66:37463 every 8 connection(s)
I20260709 13:23:49.962790  5625 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:23:49.970954 16992 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:23:49.973060 16993 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:23:49.977909 16989 heartbeater.cc:344] Connected to a master server at 127.5.126.126:43497
I20260709 13:23:49.978524 16989 heartbeater.cc:461] Registering TS with master...
I20260709 13:23:49.978539  5625 server_base.cc:1061] running on GCE node
W20260709 13:23:49.979503 16995 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:23:49.979578 16989 heartbeater.cc:507] Master 127.5.126.126:43497 requested a full tablet report, sending...
I20260709 13:23:49.980707  5625 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:23:49.981017  5625 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:23:49.981261  5625 hybrid_clock.cc:648] HybridClock initialized: now 1783603429981234 us; error 0 us; skew 500 ppm
I20260709 13:23:49.982036  5625 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:23:49.982425 16787 ts_manager.cc:194] Registered new tserver with Master: 1c65d124c93a4ac5b642819ff573ce97 (127.5.126.66:37463)
I20260709 13:23:49.984550 16787 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:43404
I20260709 13:23:49.985286  5625 webserver.cc:533] Webserver started at http://127.5.126.67:45319/ using document root <none> and password file <none>
I20260709 13:23:49.986040  5625 fs_manager.cc:362] Metadata directory not provided
I20260709 13:23:49.986316  5625 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:23:49.986594  5625 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:23:49.987799  5625 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskWHb0CB/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783603057096655-5625-0/minicluster-data/ts-2-root/instance:
uuid: "876bb7d2968847e2a08a12f88045a4c9"
format_stamp: "Formatted at 2026-07-09 13:23:49 on dist-test-slave-smzk"
I20260709 13:23:49.992604  5625 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.003s	sys 0.000s
I20260709 13:23:49.996858 17000 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:23:49.997884  5625 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.001s
I20260709 13:23:49.998302  5625 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskWHb0CB/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783603057096655-5625-0/minicluster-data/ts-2-root
uuid: "876bb7d2968847e2a08a12f88045a4c9"
format_stamp: "Formatted at 2026-07-09 13:23:49 on dist-test-slave-smzk"
I20260709 13:23:49.998633  5625 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWHb0CB/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783603057096655-5625-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskWHb0CB/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783603057096655-5625-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskWHb0CB/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783603057096655-5625-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:23:50.023152  5625 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:23:50.024508  5625 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:23:50.025849  5625 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:23:50.028241  5625 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:23:50.028491  5625 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:23:50.028733  5625 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:23:50.028904  5625 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:23:50.079366  5625 rpc_server.cc:307] RPC server started. Bound to: 127.5.126.67:43761
I20260709 13:23:50.079523 17062 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.5.126.67:43761 every 8 connection(s)
I20260709 13:23:50.096238 17063 heartbeater.cc:344] Connected to a master server at 127.5.126.126:43497
I20260709 13:23:50.096877 17063 heartbeater.cc:461] Registering TS with master...
I20260709 13:23:50.097896 17063 heartbeater.cc:507] Master 127.5.126.126:43497 requested a full tablet report, sending...
I20260709 13:23:50.100566 16787 ts_manager.cc:194] Registered new tserver with Master: 876bb7d2968847e2a08a12f88045a4c9 (127.5.126.67:43761)
I20260709 13:23:50.101579  5625 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.018747143s
I20260709 13:23:50.102530 16787 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:43414
I20260709 13:23:50.133405 16787 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:43422:
name: "multi_table_leader_balance_table1"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\377\377\377?""\004\001\000\377\377\377?"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:23:50.135717 16787 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table multi_table_leader_balance_table1 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:23:50.188604 16879 tablet_service.cc:1511] Processing CreateTablet for tablet 90850a911923468bafa87a1ecca48f6c (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=43f35d983c694f67870f9e245d5fe2e8]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 13:23:50.189281 16878 tablet_service.cc:1511] Processing CreateTablet for tablet c83f96843aa2412e9d0cfabcc1f2236f (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=43f35d983c694f67870f9e245d5fe2e8]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 13:23:50.190383 16879 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 90850a911923468bafa87a1ecca48f6c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:23:50.191082 16878 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c83f96843aa2412e9d0cfabcc1f2236f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:23:50.202400 16953 tablet_service.cc:1511] Processing CreateTablet for tablet c83f96843aa2412e9d0cfabcc1f2236f (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=43f35d983c694f67870f9e245d5fe2e8]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 13:23:50.202859 16954 tablet_service.cc:1511] Processing CreateTablet for tablet 90850a911923468bafa87a1ecca48f6c (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=43f35d983c694f67870f9e245d5fe2e8]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 13:23:50.204061 16953 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c83f96843aa2412e9d0cfabcc1f2236f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:23:50.205816 16954 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 90850a911923468bafa87a1ecca48f6c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:23:50.206357 17028 tablet_service.cc:1511] Processing CreateTablet for tablet 90850a911923468bafa87a1ecca48f6c (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=43f35d983c694f67870f9e245d5fe2e8]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 13:23:50.206619 17027 tablet_service.cc:1511] Processing CreateTablet for tablet c83f96843aa2412e9d0cfabcc1f2236f (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=43f35d983c694f67870f9e245d5fe2e8]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 13:23:50.208025 17028 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 90850a911923468bafa87a1ecca48f6c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:23:50.212193 17027 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c83f96843aa2412e9d0cfabcc1f2236f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:23:50.225381 17078 tablet_bootstrap.cc:492] T c83f96843aa2412e9d0cfabcc1f2236f P f5a48d48028f489780ad77280a273215: Bootstrap starting.
I20260709 13:23:50.236503 17078 tablet_bootstrap.cc:654] T c83f96843aa2412e9d0cfabcc1f2236f P f5a48d48028f489780ad77280a273215: Neither blocks nor log segments found. Creating new log.
I20260709 13:23:50.239637 17079 tablet_bootstrap.cc:492] T 90850a911923468bafa87a1ecca48f6c P 1c65d124c93a4ac5b642819ff573ce97: Bootstrap starting.
I20260709 13:23:50.245481 17080 tablet_bootstrap.cc:492] T 90850a911923468bafa87a1ecca48f6c P 876bb7d2968847e2a08a12f88045a4c9: Bootstrap starting.
I20260709 13:23:50.253628 17080 tablet_bootstrap.cc:654] T 90850a911923468bafa87a1ecca48f6c P 876bb7d2968847e2a08a12f88045a4c9: Neither blocks nor log segments found. Creating new log.
I20260709 13:23:50.254352 17079 tablet_bootstrap.cc:654] T 90850a911923468bafa87a1ecca48f6c P 1c65d124c93a4ac5b642819ff573ce97: Neither blocks nor log segments found. Creating new log.
I20260709 13:23:50.255384 17078 tablet_bootstrap.cc:492] T c83f96843aa2412e9d0cfabcc1f2236f P f5a48d48028f489780ad77280a273215: No bootstrap required, opened a new log
I20260709 13:23:50.256014 17078 ts_tablet_manager.cc:1403] T c83f96843aa2412e9d0cfabcc1f2236f P f5a48d48028f489780ad77280a273215: Time spent bootstrapping tablet: real 0.031s	user 0.012s	sys 0.006s
I20260709 13:23:50.260486 17078 raft_consensus.cc:359] T c83f96843aa2412e9d0cfabcc1f2236f P f5a48d48028f489780ad77280a273215 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5a48d48028f489780ad77280a273215" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44221 } } peers { permanent_uuid: "1c65d124c93a4ac5b642819ff573ce97" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 37463 } } peers { permanent_uuid: "876bb7d2968847e2a08a12f88045a4c9" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 43761 } }
I20260709 13:23:50.261504 17078 raft_consensus.cc:385] T c83f96843aa2412e9d0cfabcc1f2236f P f5a48d48028f489780ad77280a273215 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:23:50.261886 17078 raft_consensus.cc:740] T c83f96843aa2412e9d0cfabcc1f2236f P f5a48d48028f489780ad77280a273215 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f5a48d48028f489780ad77280a273215, State: Initialized, Role: FOLLOWER
I20260709 13:23:50.262995 17078 consensus_queue.cc:260] T c83f96843aa2412e9d0cfabcc1f2236f P f5a48d48028f489780ad77280a273215 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5a48d48028f489780ad77280a273215" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44221 } } peers { permanent_uuid: "1c65d124c93a4ac5b642819ff573ce97" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 37463 } } peers { permanent_uuid: "876bb7d2968847e2a08a12f88045a4c9" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 43761 } }
I20260709 13:23:50.264643 17080 tablet_bootstrap.cc:492] T 90850a911923468bafa87a1ecca48f6c P 876bb7d2968847e2a08a12f88045a4c9: No bootstrap required, opened a new log
I20260709 13:23:50.265358 17080 ts_tablet_manager.cc:1403] T 90850a911923468bafa87a1ecca48f6c P 876bb7d2968847e2a08a12f88045a4c9: Time spent bootstrapping tablet: real 0.020s	user 0.009s	sys 0.009s
I20260709 13:23:50.267904 17079 tablet_bootstrap.cc:492] T 90850a911923468bafa87a1ecca48f6c P 1c65d124c93a4ac5b642819ff573ce97: No bootstrap required, opened a new log
I20260709 13:23:50.268778 17079 ts_tablet_manager.cc:1403] T 90850a911923468bafa87a1ecca48f6c P 1c65d124c93a4ac5b642819ff573ce97: Time spent bootstrapping tablet: real 0.030s	user 0.017s	sys 0.006s
I20260709 13:23:50.269423 17080 raft_consensus.cc:359] T 90850a911923468bafa87a1ecca48f6c P 876bb7d2968847e2a08a12f88045a4c9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5a48d48028f489780ad77280a273215" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44221 } } peers { permanent_uuid: "1c65d124c93a4ac5b642819ff573ce97" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 37463 } } peers { permanent_uuid: "876bb7d2968847e2a08a12f88045a4c9" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 43761 } }
I20260709 13:23:50.270203 17080 raft_consensus.cc:385] T 90850a911923468bafa87a1ecca48f6c P 876bb7d2968847e2a08a12f88045a4c9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:23:50.270798 17080 raft_consensus.cc:740] T 90850a911923468bafa87a1ecca48f6c P 876bb7d2968847e2a08a12f88045a4c9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 876bb7d2968847e2a08a12f88045a4c9, State: Initialized, Role: FOLLOWER
I20260709 13:23:50.271881 17080 consensus_queue.cc:260] T 90850a911923468bafa87a1ecca48f6c P 876bb7d2968847e2a08a12f88045a4c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5a48d48028f489780ad77280a273215" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44221 } } peers { permanent_uuid: "1c65d124c93a4ac5b642819ff573ce97" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 37463 } } peers { permanent_uuid: "876bb7d2968847e2a08a12f88045a4c9" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 43761 } }
I20260709 13:23:50.273145 17079 raft_consensus.cc:359] T 90850a911923468bafa87a1ecca48f6c P 1c65d124c93a4ac5b642819ff573ce97 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5a48d48028f489780ad77280a273215" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44221 } } peers { permanent_uuid: "1c65d124c93a4ac5b642819ff573ce97" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 37463 } } peers { permanent_uuid: "876bb7d2968847e2a08a12f88045a4c9" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 43761 } }
I20260709 13:23:50.273581 16914 heartbeater.cc:499] Master 127.5.126.126:43497 was elected leader, sending a full tablet report...
I20260709 13:23:50.273984 17078 ts_tablet_manager.cc:1434] T c83f96843aa2412e9d0cfabcc1f2236f P f5a48d48028f489780ad77280a273215: Time spent starting tablet: real 0.018s	user 0.010s	sys 0.006s
I20260709 13:23:50.274011 17079 raft_consensus.cc:385] T 90850a911923468bafa87a1ecca48f6c P 1c65d124c93a4ac5b642819ff573ce97 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:23:50.274646 17079 raft_consensus.cc:740] T 90850a911923468bafa87a1ecca48f6c P 1c65d124c93a4ac5b642819ff573ce97 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1c65d124c93a4ac5b642819ff573ce97, State: Initialized, Role: FOLLOWER
I20260709 13:23:50.275434 17078 tablet_bootstrap.cc:492] T 90850a911923468bafa87a1ecca48f6c P f5a48d48028f489780ad77280a273215: Bootstrap starting.
I20260709 13:23:50.275482 17079 consensus_queue.cc:260] T 90850a911923468bafa87a1ecca48f6c P 1c65d124c93a4ac5b642819ff573ce97 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5a48d48028f489780ad77280a273215" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44221 } } peers { permanent_uuid: "1c65d124c93a4ac5b642819ff573ce97" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 37463 } } peers { permanent_uuid: "876bb7d2968847e2a08a12f88045a4c9" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 43761 } }
I20260709 13:23:50.281625 17080 ts_tablet_manager.cc:1434] T 90850a911923468bafa87a1ecca48f6c P 876bb7d2968847e2a08a12f88045a4c9: Time spent starting tablet: real 0.016s	user 0.007s	sys 0.007s
I20260709 13:23:50.281980 17063 heartbeater.cc:499] Master 127.5.126.126:43497 was elected leader, sending a full tablet report...
I20260709 13:23:50.283062 17080 tablet_bootstrap.cc:492] T c83f96843aa2412e9d0cfabcc1f2236f P 876bb7d2968847e2a08a12f88045a4c9: Bootstrap starting.
I20260709 13:23:50.283674 17078 tablet_bootstrap.cc:654] T 90850a911923468bafa87a1ecca48f6c P f5a48d48028f489780ad77280a273215: Neither blocks nor log segments found. Creating new log.
I20260709 13:23:50.290848 17080 tablet_bootstrap.cc:654] T c83f96843aa2412e9d0cfabcc1f2236f P 876bb7d2968847e2a08a12f88045a4c9: Neither blocks nor log segments found. Creating new log.
I20260709 13:23:50.292012 16989 heartbeater.cc:499] Master 127.5.126.126:43497 was elected leader, sending a full tablet report...
I20260709 13:23:50.293254 17079 ts_tablet_manager.cc:1434] T 90850a911923468bafa87a1ecca48f6c P 1c65d124c93a4ac5b642819ff573ce97: Time spent starting tablet: real 0.024s	user 0.007s	sys 0.010s
I20260709 13:23:50.294477 17079 tablet_bootstrap.cc:492] T c83f96843aa2412e9d0cfabcc1f2236f P 1c65d124c93a4ac5b642819ff573ce97: Bootstrap starting.
I20260709 13:23:50.308617 17079 tablet_bootstrap.cc:654] T c83f96843aa2412e9d0cfabcc1f2236f P 1c65d124c93a4ac5b642819ff573ce97: Neither blocks nor log segments found. Creating new log.
I20260709 13:23:50.315574 17078 tablet_bootstrap.cc:492] T 90850a911923468bafa87a1ecca48f6c P f5a48d48028f489780ad77280a273215: No bootstrap required, opened a new log
I20260709 13:23:50.316395 17078 ts_tablet_manager.cc:1403] T 90850a911923468bafa87a1ecca48f6c P f5a48d48028f489780ad77280a273215: Time spent bootstrapping tablet: real 0.041s	user 0.004s	sys 0.024s
I20260709 13:23:50.320485 17080 tablet_bootstrap.cc:492] T c83f96843aa2412e9d0cfabcc1f2236f P 876bb7d2968847e2a08a12f88045a4c9: No bootstrap required, opened a new log
I20260709 13:23:50.321200 17080 ts_tablet_manager.cc:1403] T c83f96843aa2412e9d0cfabcc1f2236f P 876bb7d2968847e2a08a12f88045a4c9: Time spent bootstrapping tablet: real 0.039s	user 0.017s	sys 0.020s
I20260709 13:23:50.320848 17078 raft_consensus.cc:359] T 90850a911923468bafa87a1ecca48f6c P f5a48d48028f489780ad77280a273215 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5a48d48028f489780ad77280a273215" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44221 } } peers { permanent_uuid: "1c65d124c93a4ac5b642819ff573ce97" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 37463 } } peers { permanent_uuid: "876bb7d2968847e2a08a12f88045a4c9" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 43761 } }
I20260709 13:23:50.321703 17078 raft_consensus.cc:385] T 90850a911923468bafa87a1ecca48f6c P f5a48d48028f489780ad77280a273215 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:23:50.322052 17078 raft_consensus.cc:740] T 90850a911923468bafa87a1ecca48f6c P f5a48d48028f489780ad77280a273215 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f5a48d48028f489780ad77280a273215, State: Initialized, Role: FOLLOWER
I20260709 13:23:50.323328 17079 tablet_bootstrap.cc:492] T c83f96843aa2412e9d0cfabcc1f2236f P 1c65d124c93a4ac5b642819ff573ce97: No bootstrap required, opened a new log
I20260709 13:23:50.322933 17078 consensus_queue.cc:260] T 90850a911923468bafa87a1ecca48f6c P f5a48d48028f489780ad77280a273215 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5a48d48028f489780ad77280a273215" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44221 } } peers { permanent_uuid: "1c65d124c93a4ac5b642819ff573ce97" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 37463 } } peers { permanent_uuid: "876bb7d2968847e2a08a12f88045a4c9" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 43761 } }
I20260709 13:23:50.324059 17079 ts_tablet_manager.cc:1403] T c83f96843aa2412e9d0cfabcc1f2236f P 1c65d124c93a4ac5b642819ff573ce97: Time spent bootstrapping tablet: real 0.030s	user 0.015s	sys 0.007s
I20260709 13:23:50.323748 17080 raft_consensus.cc:359] T c83f96843aa2412e9d0cfabcc1f2236f P 876bb7d2968847e2a08a12f88045a4c9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5a48d48028f489780ad77280a273215" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44221 } } peers { permanent_uuid: "1c65d124c93a4ac5b642819ff573ce97" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 37463 } } peers { permanent_uuid: "876bb7d2968847e2a08a12f88045a4c9" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 43761 } }
I20260709 13:23:50.324590 17080 raft_consensus.cc:385] T c83f96843aa2412e9d0cfabcc1f2236f P 876bb7d2968847e2a08a12f88045a4c9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:23:50.324921 17080 raft_consensus.cc:740] T c83f96843aa2412e9d0cfabcc1f2236f P 876bb7d2968847e2a08a12f88045a4c9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 876bb7d2968847e2a08a12f88045a4c9, State: Initialized, Role: FOLLOWER
I20260709 13:23:50.325496 17078 ts_tablet_manager.cc:1434] T 90850a911923468bafa87a1ecca48f6c P f5a48d48028f489780ad77280a273215: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.001s
I20260709 13:23:50.325887 17080 consensus_queue.cc:260] T c83f96843aa2412e9d0cfabcc1f2236f P 876bb7d2968847e2a08a12f88045a4c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5a48d48028f489780ad77280a273215" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44221 } } peers { permanent_uuid: "1c65d124c93a4ac5b642819ff573ce97" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 37463 } } peers { permanent_uuid: "876bb7d2968847e2a08a12f88045a4c9" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 43761 } }
I20260709 13:23:50.327740 17079 raft_consensus.cc:359] T c83f96843aa2412e9d0cfabcc1f2236f P 1c65d124c93a4ac5b642819ff573ce97 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5a48d48028f489780ad77280a273215" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44221 } } peers { permanent_uuid: "1c65d124c93a4ac5b642819ff573ce97" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 37463 } } peers { permanent_uuid: "876bb7d2968847e2a08a12f88045a4c9" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 43761 } }
I20260709 13:23:50.328388 17080 ts_tablet_manager.cc:1434] T c83f96843aa2412e9d0cfabcc1f2236f P 876bb7d2968847e2a08a12f88045a4c9: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:23:50.328585 17079 raft_consensus.cc:385] T c83f96843aa2412e9d0cfabcc1f2236f P 1c65d124c93a4ac5b642819ff573ce97 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:23:50.329550 17079 raft_consensus.cc:740] T c83f96843aa2412e9d0cfabcc1f2236f P 1c65d124c93a4ac5b642819ff573ce97 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1c65d124c93a4ac5b642819ff573ce97, State: Initialized, Role: FOLLOWER
I20260709 13:23:50.330478 17079 consensus_queue.cc:260] T c83f96843aa2412e9d0cfabcc1f2236f P 1c65d124c93a4ac5b642819ff573ce97 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5a48d48028f489780ad77280a273215" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44221 } } peers { permanent_uuid: "1c65d124c93a4ac5b642819ff573ce97" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 37463 } } peers { permanent_uuid: "876bb7d2968847e2a08a12f88045a4c9" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 43761 } }
I20260709 13:23:50.332484 17079 ts_tablet_manager.cc:1434] T c83f96843aa2412e9d0cfabcc1f2236f P 1c65d124c93a4ac5b642819ff573ce97: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:23:50.356413 17086 raft_consensus.cc:493] T 90850a911923468bafa87a1ecca48f6c P 1c65d124c93a4ac5b642819ff573ce97 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:23:50.357069 17086 raft_consensus.cc:515] T 90850a911923468bafa87a1ecca48f6c P 1c65d124c93a4ac5b642819ff573ce97 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5a48d48028f489780ad77280a273215" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44221 } } peers { permanent_uuid: "1c65d124c93a4ac5b642819ff573ce97" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 37463 } } peers { permanent_uuid: "876bb7d2968847e2a08a12f88045a4c9" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 43761 } }
I20260709 13:23:50.359789 17086 leader_election.cc:290] T 90850a911923468bafa87a1ecca48f6c P 1c65d124c93a4ac5b642819ff573ce97 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f5a48d48028f489780ad77280a273215 (127.5.126.65:44221), 876bb7d2968847e2a08a12f88045a4c9 (127.5.126.67:43761)
I20260709 13:23:50.369582 16889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90850a911923468bafa87a1ecca48f6c" candidate_uuid: "1c65d124c93a4ac5b642819ff573ce97" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5a48d48028f489780ad77280a273215" is_pre_election: true
I20260709 13:23:50.370512 16889 raft_consensus.cc:2468] T 90850a911923468bafa87a1ecca48f6c P f5a48d48028f489780ad77280a273215 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c65d124c93a4ac5b642819ff573ce97 in term 0.
I20260709 13:23:50.371975 16928 leader_election.cc:304] T 90850a911923468bafa87a1ecca48f6c P 1c65d124c93a4ac5b642819ff573ce97 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c65d124c93a4ac5b642819ff573ce97, f5a48d48028f489780ad77280a273215; no voters: 
I20260709 13:23:50.372309 17038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90850a911923468bafa87a1ecca48f6c" candidate_uuid: "1c65d124c93a4ac5b642819ff573ce97" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "876bb7d2968847e2a08a12f88045a4c9" is_pre_election: true
I20260709 13:23:50.373097 17038 raft_consensus.cc:2468] T 90850a911923468bafa87a1ecca48f6c P 876bb7d2968847e2a08a12f88045a4c9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c65d124c93a4ac5b642819ff573ce97 in term 0.
I20260709 13:23:50.373112 17086 raft_consensus.cc:2804] T 90850a911923468bafa87a1ecca48f6c P 1c65d124c93a4ac5b642819ff573ce97 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:23:50.373675 17086 raft_consensus.cc:493] T 90850a911923468bafa87a1ecca48f6c P 1c65d124c93a4ac5b642819ff573ce97 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:23:50.373996 17086 raft_consensus.cc:3060] T 90850a911923468bafa87a1ecca48f6c P 1c65d124c93a4ac5b642819ff573ce97 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:23:50.380609 17086 raft_consensus.cc:515] T 90850a911923468bafa87a1ecca48f6c P 1c65d124c93a4ac5b642819ff573ce97 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5a48d48028f489780ad77280a273215" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44221 } } peers { permanent_uuid: "1c65d124c93a4ac5b642819ff573ce97" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 37463 } } peers { permanent_uuid: "876bb7d2968847e2a08a12f88045a4c9" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 43761 } }
I20260709 13:23:50.382344 17086 leader_election.cc:290] T 90850a911923468bafa87a1ecca48f6c P 1c65d124c93a4ac5b642819ff573ce97 [CANDIDATE]: Term 1 election: Requested vote from peers f5a48d48028f489780ad77280a273215 (127.5.126.65:44221), 876bb7d2968847e2a08a12f88045a4c9 (127.5.126.67:43761)
I20260709 13:23:50.383430 16889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90850a911923468bafa87a1ecca48f6c" candidate_uuid: "1c65d124c93a4ac5b642819ff573ce97" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5a48d48028f489780ad77280a273215"
I20260709 13:23:50.383896 17038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90850a911923468bafa87a1ecca48f6c" candidate_uuid: "1c65d124c93a4ac5b642819ff573ce97" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "876bb7d2968847e2a08a12f88045a4c9"
I20260709 13:23:50.384161 16889 raft_consensus.cc:3060] T 90850a911923468bafa87a1ecca48f6c P f5a48d48028f489780ad77280a273215 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:23:50.384640 17038 raft_consensus.cc:3060] T 90850a911923468bafa87a1ecca48f6c P 876bb7d2968847e2a08a12f88045a4c9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:23:50.390570 16889 raft_consensus.cc:2468] T 90850a911923468bafa87a1ecca48f6c P f5a48d48028f489780ad77280a273215 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c65d124c93a4ac5b642819ff573ce97 in term 1.
I20260709 13:23:50.391474 17038 raft_consensus.cc:2468] T 90850a911923468bafa87a1ecca48f6c P 876bb7d2968847e2a08a12f88045a4c9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c65d124c93a4ac5b642819ff573ce97 in term 1.
I20260709 13:23:50.391891 16928 leader_election.cc:304] T 90850a911923468bafa87a1ecca48f6c P 1c65d124c93a4ac5b642819ff573ce97 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c65d124c93a4ac5b642819ff573ce97, f5a48d48028f489780ad77280a273215; no voters: 
I20260709 13:23:50.392915 17086 raft_consensus.cc:2804] T 90850a911923468bafa87a1ecca48f6c P 1c65d124c93a4ac5b642819ff573ce97 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:23:50.393908 17086 raft_consensus.cc:697] T 90850a911923468bafa87a1ecca48f6c P 1c65d124c93a4ac5b642819ff573ce97 [term 1 LEADER]: Becoming Leader. State: Replica: 1c65d124c93a4ac5b642819ff573ce97, State: Running, Role: LEADER
I20260709 13:23:50.394740 17086 consensus_queue.cc:237] T 90850a911923468bafa87a1ecca48f6c P 1c65d124c93a4ac5b642819ff573ce97 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5a48d48028f489780ad77280a273215" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44221 } } peers { permanent_uuid: "1c65d124c93a4ac5b642819ff573ce97" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 37463 } } peers { permanent_uuid: "876bb7d2968847e2a08a12f88045a4c9" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 43761 } }
I20260709 13:23:50.402915 16784 catalog_manager.cc:5697] T 90850a911923468bafa87a1ecca48f6c P 1c65d124c93a4ac5b642819ff573ce97 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1c65d124c93a4ac5b642819ff573ce97 (127.5.126.66). New cstate: current_term: 1 leader_uuid: "1c65d124c93a4ac5b642819ff573ce97" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5a48d48028f489780ad77280a273215" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44221 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1c65d124c93a4ac5b642819ff573ce97" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 37463 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "876bb7d2968847e2a08a12f88045a4c9" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 43761 } health_report { overall_health: UNKNOWN } } }
I20260709 13:23:50.478394 17086 raft_consensus.cc:493] T c83f96843aa2412e9d0cfabcc1f2236f P 1c65d124c93a4ac5b642819ff573ce97 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:23:50.479029 17086 raft_consensus.cc:515] T c83f96843aa2412e9d0cfabcc1f2236f P 1c65d124c93a4ac5b642819ff573ce97 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5a48d48028f489780ad77280a273215" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44221 } } peers { permanent_uuid: "1c65d124c93a4ac5b642819ff573ce97" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 37463 } } peers { permanent_uuid: "876bb7d2968847e2a08a12f88045a4c9" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 43761 } }
I20260709 13:23:50.481031 17086 leader_election.cc:290] T c83f96843aa2412e9d0cfabcc1f2236f P 1c65d124c93a4ac5b642819ff573ce97 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f5a48d48028f489780ad77280a273215 (127.5.126.65:44221), 876bb7d2968847e2a08a12f88045a4c9 (127.5.126.67:43761)
I20260709 13:23:50.481896 16889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c83f96843aa2412e9d0cfabcc1f2236f" candidate_uuid: "1c65d124c93a4ac5b642819ff573ce97" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5a48d48028f489780ad77280a273215" is_pre_election: true
I20260709 13:23:50.482189 17038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c83f96843aa2412e9d0cfabcc1f2236f" candidate_uuid: "1c65d124c93a4ac5b642819ff573ce97" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "876bb7d2968847e2a08a12f88045a4c9" is_pre_election: true
I20260709 13:23:50.482534 16889 raft_consensus.cc:2468] T c83f96843aa2412e9d0cfabcc1f2236f P f5a48d48028f489780ad77280a273215 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c65d124c93a4ac5b642819ff573ce97 in term 0.
I20260709 13:23:50.483011 17038 raft_consensus.cc:2468] T c83f96843aa2412e9d0cfabcc1f2236f P 876bb7d2968847e2a08a12f88045a4c9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c65d124c93a4ac5b642819ff573ce97 in term 0.
I20260709 13:23:50.483888 16928 leader_election.cc:304] T c83f96843aa2412e9d0cfabcc1f2236f P 1c65d124c93a4ac5b642819ff573ce97 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c65d124c93a4ac5b642819ff573ce97, f5a48d48028f489780ad77280a273215; no voters: 
I20260709 13:23:50.484786 17086 raft_consensus.cc:2804] T c83f96843aa2412e9d0cfabcc1f2236f P 1c65d124c93a4ac5b642819ff573ce97 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:23:50.485172 17086 raft_consensus.cc:493] T c83f96843aa2412e9d0cfabcc1f2236f P 1c65d124c93a4ac5b642819ff573ce97 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:23:50.485502 17086 raft_consensus.cc:3060] T c83f96843aa2412e9d0cfabcc1f2236f P 1c65d124c93a4ac5b642819ff573ce97 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:23:50.491119 17086 raft_consensus.cc:515] T c83f96843aa2412e9d0cfabcc1f2236f P 1c65d124c93a4ac5b642819ff573ce97 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5a48d48028f489780ad77280a273215" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44221 } } peers { permanent_uuid: "1c65d124c93a4ac5b642819ff573ce97" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 37463 } } peers { permanent_uuid: "876bb7d2968847e2a08a12f88045a4c9" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 43761 } }
I20260709 13:23:50.492988 17086 leader_election.cc:290] T c83f96843aa2412e9d0cfabcc1f2236f P 1c65d124c93a4ac5b642819ff573ce97 [CANDIDATE]: Term 1 election: Requested vote from peers f5a48d48028f489780ad77280a273215 (127.5.126.65:44221), 876bb7d2968847e2a08a12f88045a4c9 (127.5.126.67:43761)
I20260709 13:23:50.493989 16889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c83f96843aa2412e9d0cfabcc1f2236f" candidate_uuid: "1c65d124c93a4ac5b642819ff573ce97" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5a48d48028f489780ad77280a273215"
I20260709 13:23:50.494182 17038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c83f96843aa2412e9d0cfabcc1f2236f" candidate_uuid: "1c65d124c93a4ac5b642819ff573ce97" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "876bb7d2968847e2a08a12f88045a4c9"
I20260709 13:23:50.494625 16889 raft_consensus.cc:3060] T c83f96843aa2412e9d0cfabcc1f2236f P f5a48d48028f489780ad77280a273215 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:23:50.494905 17038 raft_consensus.cc:3060] T c83f96843aa2412e9d0cfabcc1f2236f P 876bb7d2968847e2a08a12f88045a4c9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:23:50.500202 16889 raft_consensus.cc:2468] T c83f96843aa2412e9d0cfabcc1f2236f P f5a48d48028f489780ad77280a273215 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c65d124c93a4ac5b642819ff573ce97 in term 1.
I20260709 13:23:50.501261 17038 raft_consensus.cc:2468] T c83f96843aa2412e9d0cfabcc1f2236f P 876bb7d2968847e2a08a12f88045a4c9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c65d124c93a4ac5b642819ff573ce97 in term 1.
I20260709 13:23:50.501353 16928 leader_election.cc:304] T c83f96843aa2412e9d0cfabcc1f2236f P 1c65d124c93a4ac5b642819ff573ce97 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c65d124c93a4ac5b642819ff573ce97, f5a48d48028f489780ad77280a273215; no voters: 
I20260709 13:23:50.502274 17086 raft_consensus.cc:2804] T c83f96843aa2412e9d0cfabcc1f2236f P 1c65d124c93a4ac5b642819ff573ce97 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:23:50.502966 17086 raft_consensus.cc:697] T c83f96843aa2412e9d0cfabcc1f2236f P 1c65d124c93a4ac5b642819ff573ce97 [term 1 LEADER]: Becoming Leader. State: Replica: 1c65d124c93a4ac5b642819ff573ce97, State: Running, Role: LEADER
I20260709 13:23:50.503628 17086 consensus_queue.cc:237] T c83f96843aa2412e9d0cfabcc1f2236f P 1c65d124c93a4ac5b642819ff573ce97 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5a48d48028f489780ad77280a273215" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44221 } } peers { permanent_uuid: "1c65d124c93a4ac5b642819ff573ce97" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 37463 } } peers { permanent_uuid: "876bb7d2968847e2a08a12f88045a4c9" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 43761 } }
I20260709 13:23:50.511500 16784 catalog_manager.cc:5697] T c83f96843aa2412e9d0cfabcc1f2236f P 1c65d124c93a4ac5b642819ff573ce97 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1c65d124c93a4ac5b642819ff573ce97 (127.5.126.66). New cstate: current_term: 1 leader_uuid: "1c65d124c93a4ac5b642819ff573ce97" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5a48d48028f489780ad77280a273215" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44221 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1c65d124c93a4ac5b642819ff573ce97" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 37463 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "876bb7d2968847e2a08a12f88045a4c9" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 43761 } health_report { overall_health: UNKNOWN } } }
I20260709 13:23:50.609848 16784 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:43432:
name: "multi_table_leader_balance_table2"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\377\377\377?""\004\001\000\377\377\377?"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:23:50.613658 16784 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table multi_table_leader_balance_table2 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:23:50.647421 16879 tablet_service.cc:1511] Processing CreateTablet for tablet ac0aae8ea8914150a45da5a3ce0ccc53 (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=421b3289be9a454495ea624fb4170df8]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 13:23:50.649364 16954 tablet_service.cc:1511] Processing CreateTablet for tablet ac0aae8ea8914150a45da5a3ce0ccc53 (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=421b3289be9a454495ea624fb4170df8]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 13:23:50.650058 16879 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ac0aae8ea8914150a45da5a3ce0ccc53. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:23:50.651551 16954 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ac0aae8ea8914150a45da5a3ce0ccc53. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:23:50.652583 17027 tablet_service.cc:1511] Processing CreateTablet for tablet ac0aae8ea8914150a45da5a3ce0ccc53 (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=421b3289be9a454495ea624fb4170df8]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 13:23:50.654816 17027 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ac0aae8ea8914150a45da5a3ce0ccc53. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:23:50.654963 16835 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:23:50.656972 16878 tablet_service.cc:1511] Processing CreateTablet for tablet 7272ddf94a8c4eaaa5168967e79d45c2 (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=421b3289be9a454495ea624fb4170df8]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 13:23:50.658506 16878 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7272ddf94a8c4eaaa5168967e79d45c2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:23:50.662238 16953 tablet_service.cc:1511] Processing CreateTablet for tablet 7272ddf94a8c4eaaa5168967e79d45c2 (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=421b3289be9a454495ea624fb4170df8]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 13:23:50.664023 16953 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7272ddf94a8c4eaaa5168967e79d45c2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:23:50.668332 17028 tablet_service.cc:1511] Processing CreateTablet for tablet 7272ddf94a8c4eaaa5168967e79d45c2 (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=421b3289be9a454495ea624fb4170df8]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 13:23:50.670012 17028 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7272ddf94a8c4eaaa5168967e79d45c2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:23:50.679901 17078 tablet_bootstrap.cc:492] T ac0aae8ea8914150a45da5a3ce0ccc53 P f5a48d48028f489780ad77280a273215: Bootstrap starting.
I20260709 13:23:50.685513 17079 tablet_bootstrap.cc:492] T 7272ddf94a8c4eaaa5168967e79d45c2 P 1c65d124c93a4ac5b642819ff573ce97: Bootstrap starting.
I20260709 13:23:50.689384 17078 tablet_bootstrap.cc:654] T ac0aae8ea8914150a45da5a3ce0ccc53 P f5a48d48028f489780ad77280a273215: Neither blocks nor log segments found. Creating new log.
I20260709 13:23:50.694216 17079 tablet_bootstrap.cc:654] T 7272ddf94a8c4eaaa5168967e79d45c2 P 1c65d124c93a4ac5b642819ff573ce97: Neither blocks nor log segments found. Creating new log.
I20260709 13:23:50.712128 17078 tablet_bootstrap.cc:492] T ac0aae8ea8914150a45da5a3ce0ccc53 P f5a48d48028f489780ad77280a273215: No bootstrap required, opened a new log
I20260709 13:23:50.712841 17078 ts_tablet_manager.cc:1403] T ac0aae8ea8914150a45da5a3ce0ccc53 P f5a48d48028f489780ad77280a273215: Time spent bootstrapping tablet: real 0.033s	user 0.010s	sys 0.021s
I20260709 13:23:50.712909 17080 tablet_bootstrap.cc:492] T ac0aae8ea8914150a45da5a3ce0ccc53 P 876bb7d2968847e2a08a12f88045a4c9: Bootstrap starting.
I20260709 13:23:50.719389 17078 raft_consensus.cc:359] T ac0aae8ea8914150a45da5a3ce0ccc53 P f5a48d48028f489780ad77280a273215 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5a48d48028f489780ad77280a273215" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44221 } } peers { permanent_uuid: "1c65d124c93a4ac5b642819ff573ce97" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 37463 } } peers { permanent_uuid: "876bb7d2968847e2a08a12f88045a4c9" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 43761 } }
I20260709 13:23:50.720508 17078 raft_consensus.cc:385] T ac0aae8ea8914150a45da5a3ce0ccc53 P f5a48d48028f489780ad77280a273215 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:23:50.720839 17078 raft_consensus.cc:740] T ac0aae8ea8914150a45da5a3ce0ccc53 P f5a48d48028f489780ad77280a273215 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f5a48d48028f489780ad77280a273215, State: Initialized, Role: FOLLOWER
I20260709 13:23:50.721987 17078 consensus_queue.cc:260] T ac0aae8ea8914150a45da5a3ce0ccc53 P f5a48d48028f489780ad77280a273215 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5a48d48028f489780ad77280a273215" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44221 } } peers { permanent_uuid: "1c65d124c93a4ac5b642819ff573ce97" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 37463 } } peers { permanent_uuid: "876bb7d2968847e2a08a12f88045a4c9" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 43761 } }
I20260709 13:23:50.725589 17080 tablet_bootstrap.cc:654] T ac0aae8ea8914150a45da5a3ce0ccc53 P 876bb7d2968847e2a08a12f88045a4c9: Neither blocks nor log segments found. Creating new log.
I20260709 13:23:50.728899 17078 ts_tablet_manager.cc:1434] T ac0aae8ea8914150a45da5a3ce0ccc53 P f5a48d48028f489780ad77280a273215: Time spent starting tablet: real 0.016s	user 0.005s	sys 0.004s
I20260709 13:23:50.738528 17078 tablet_bootstrap.cc:492] T 7272ddf94a8c4eaaa5168967e79d45c2 P f5a48d48028f489780ad77280a273215: Bootstrap starting.
I20260709 13:23:50.741624 17079 tablet_bootstrap.cc:492] T 7272ddf94a8c4eaaa5168967e79d45c2 P 1c65d124c93a4ac5b642819ff573ce97: No bootstrap required, opened a new log
I20260709 13:23:50.742333 17079 ts_tablet_manager.cc:1403] T 7272ddf94a8c4eaaa5168967e79d45c2 P 1c65d124c93a4ac5b642819ff573ce97: Time spent bootstrapping tablet: real 0.058s	user 0.018s	sys 0.027s
I20260709 13:23:50.744794 17080 tablet_bootstrap.cc:492] T ac0aae8ea8914150a45da5a3ce0ccc53 P 876bb7d2968847e2a08a12f88045a4c9: No bootstrap required, opened a new log
I20260709 13:23:50.745358 17078 tablet_bootstrap.cc:654] T 7272ddf94a8c4eaaa5168967e79d45c2 P f5a48d48028f489780ad77280a273215: Neither blocks nor log segments found. Creating new log.
I20260709 13:23:50.745428 17080 ts_tablet_manager.cc:1403] T ac0aae8ea8914150a45da5a3ce0ccc53 P 876bb7d2968847e2a08a12f88045a4c9: Time spent bootstrapping tablet: real 0.033s	user 0.016s	sys 0.006s
I20260709 13:23:50.746245 17079 raft_consensus.cc:359] T 7272ddf94a8c4eaaa5168967e79d45c2 P 1c65d124c93a4ac5b642819ff573ce97 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5a48d48028f489780ad77280a273215" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44221 } } peers { permanent_uuid: "1c65d124c93a4ac5b642819ff573ce97" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 37463 } } peers { permanent_uuid: "876bb7d2968847e2a08a12f88045a4c9" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 43761 } }
I20260709 13:23:50.747155 17079 raft_consensus.cc:385] T 7272ddf94a8c4eaaa5168967e79d45c2 P 1c65d124c93a4ac5b642819ff573ce97 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:23:50.747478 17079 raft_consensus.cc:740] T 7272ddf94a8c4eaaa5168967e79d45c2 P 1c65d124c93a4ac5b642819ff573ce97 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1c65d124c93a4ac5b642819ff573ce97, State: Initialized, Role: FOLLOWER
I20260709 13:23:50.748591 17079 consensus_queue.cc:260] T 7272ddf94a8c4eaaa5168967e79d45c2 P 1c65d124c93a4ac5b642819ff573ce97 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5a48d48028f489780ad77280a273215" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44221 } } peers { permanent_uuid: "1c65d124c93a4ac5b642819ff573ce97" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 37463 } } peers { permanent_uuid: "876bb7d2968847e2a08a12f88045a4c9" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 43761 } }
I20260709 13:23:50.749317 17080 raft_consensus.cc:359] T ac0aae8ea8914150a45da5a3ce0ccc53 P 876bb7d2968847e2a08a12f88045a4c9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5a48d48028f489780ad77280a273215" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44221 } } peers { permanent_uuid: "1c65d124c93a4ac5b642819ff573ce97" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 37463 } } peers { permanent_uuid: "876bb7d2968847e2a08a12f88045a4c9" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 43761 } }
I20260709 13:23:50.750783 17080 raft_consensus.cc:385] T ac0aae8ea8914150a45da5a3ce0ccc53 P 876bb7d2968847e2a08a12f88045a4c9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:23:50.751127 17080 raft_consensus.cc:740] T ac0aae8ea8914150a45da5a3ce0ccc53 P 876bb7d2968847e2a08a12f88045a4c9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 876bb7d2968847e2a08a12f88045a4c9, State: Initialized, Role: FOLLOWER
I20260709 13:23:50.751358 17078 tablet_bootstrap.cc:492] T 7272ddf94a8c4eaaa5168967e79d45c2 P f5a48d48028f489780ad77280a273215: No bootstrap required, opened a new log
I20260709 13:23:50.751606 17079 ts_tablet_manager.cc:1434] T 7272ddf94a8c4eaaa5168967e79d45c2 P 1c65d124c93a4ac5b642819ff573ce97: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 13:23:50.752148 17078 ts_tablet_manager.cc:1403] T 7272ddf94a8c4eaaa5168967e79d45c2 P f5a48d48028f489780ad77280a273215: Time spent bootstrapping tablet: real 0.014s	user 0.013s	sys 0.000s
I20260709 13:23:50.752265 17080 consensus_queue.cc:260] T ac0aae8ea8914150a45da5a3ce0ccc53 P 876bb7d2968847e2a08a12f88045a4c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5a48d48028f489780ad77280a273215" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44221 } } peers { permanent_uuid: "1c65d124c93a4ac5b642819ff573ce97" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 37463 } } peers { permanent_uuid: "876bb7d2968847e2a08a12f88045a4c9" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 43761 } }
I20260709 13:23:50.752985 17079 tablet_bootstrap.cc:492] T ac0aae8ea8914150a45da5a3ce0ccc53 P 1c65d124c93a4ac5b642819ff573ce97: Bootstrap starting.
I20260709 13:23:50.756100 17078 raft_consensus.cc:359] T 7272ddf94a8c4eaaa5168967e79d45c2 P f5a48d48028f489780ad77280a273215 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5a48d48028f489780ad77280a273215" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44221 } } peers { permanent_uuid: "1c65d124c93a4ac5b642819ff573ce97" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 37463 } } peers { permanent_uuid: "876bb7d2968847e2a08a12f88045a4c9" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 43761 } }
I20260709 13:23:50.756942 17078 raft_consensus.cc:385] T 7272ddf94a8c4eaaa5168967e79d45c2 P f5a48d48028f489780ad77280a273215 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:23:50.757311 17078 raft_consensus.cc:740] T 7272ddf94a8c4eaaa5168967e79d45c2 P f5a48d48028f489780ad77280a273215 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f5a48d48028f489780ad77280a273215, State: Initialized, Role: FOLLOWER
I20260709 13:23:50.758464 17078 consensus_queue.cc:260] T 7272ddf94a8c4eaaa5168967e79d45c2 P f5a48d48028f489780ad77280a273215 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5a48d48028f489780ad77280a273215" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44221 } } peers { permanent_uuid: "1c65d124c93a4ac5b642819ff573ce97" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 37463 } } peers { permanent_uuid: "876bb7d2968847e2a08a12f88045a4c9" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 43761 } }
I20260709 13:23:50.765587 17078 ts_tablet_manager.cc:1434] T 7272ddf94a8c4eaaa5168967e79d45c2 P f5a48d48028f489780ad77280a273215: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.001s
I20260709 13:23:50.766275 17080 ts_tablet_manager.cc:1434] T ac0aae8ea8914150a45da5a3ce0ccc53 P 876bb7d2968847e2a08a12f88045a4c9: Time spent starting tablet: real 0.020s	user 0.003s	sys 0.005s
I20260709 13:23:50.769470 17079 tablet_bootstrap.cc:654] T ac0aae8ea8914150a45da5a3ce0ccc53 P 1c65d124c93a4ac5b642819ff573ce97: Neither blocks nor log segments found. Creating new log.
I20260709 13:23:50.770938 17080 tablet_bootstrap.cc:492] T 7272ddf94a8c4eaaa5168967e79d45c2 P 876bb7d2968847e2a08a12f88045a4c9: Bootstrap starting.
I20260709 13:23:50.776343 17079 tablet_bootstrap.cc:492] T ac0aae8ea8914150a45da5a3ce0ccc53 P 1c65d124c93a4ac5b642819ff573ce97: No bootstrap required, opened a new log
I20260709 13:23:50.776964 17079 ts_tablet_manager.cc:1403] T ac0aae8ea8914150a45da5a3ce0ccc53 P 1c65d124c93a4ac5b642819ff573ce97: Time spent bootstrapping tablet: real 0.024s	user 0.010s	sys 0.005s
I20260709 13:23:50.780623 17079 raft_consensus.cc:359] T ac0aae8ea8914150a45da5a3ce0ccc53 P 1c65d124c93a4ac5b642819ff573ce97 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5a48d48028f489780ad77280a273215" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44221 } } peers { permanent_uuid: "1c65d124c93a4ac5b642819ff573ce97" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 37463 } } peers { permanent_uuid: "876bb7d2968847e2a08a12f88045a4c9" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 43761 } }
I20260709 13:23:50.781494 17079 raft_consensus.cc:385] T ac0aae8ea8914150a45da5a3ce0ccc53 P 1c65d124c93a4ac5b642819ff573ce97 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:23:50.781843 17079 raft_consensus.cc:740] T ac0aae8ea8914150a45da5a3ce0ccc53 P 1c65d124c93a4ac5b642819ff573ce97 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1c65d124c93a4ac5b642819ff573ce97, State: Initialized, Role: FOLLOWER
I20260709 13:23:50.782773 17079 consensus_queue.cc:260] T ac0aae8ea8914150a45da5a3ce0ccc53 P 1c65d124c93a4ac5b642819ff573ce97 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5a48d48028f489780ad77280a273215" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44221 } } peers { permanent_uuid: "1c65d124c93a4ac5b642819ff573ce97" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 37463 } } peers { permanent_uuid: "876bb7d2968847e2a08a12f88045a4c9" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 43761 } }
I20260709 13:23:50.783636 17080 tablet_bootstrap.cc:654] T 7272ddf94a8c4eaaa5168967e79d45c2 P 876bb7d2968847e2a08a12f88045a4c9: Neither blocks nor log segments found. Creating new log.
I20260709 13:23:50.785378 17079 ts_tablet_manager.cc:1434] T ac0aae8ea8914150a45da5a3ce0ccc53 P 1c65d124c93a4ac5b642819ff573ce97: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 13:23:50.789381 17080 tablet_bootstrap.cc:492] T 7272ddf94a8c4eaaa5168967e79d45c2 P 876bb7d2968847e2a08a12f88045a4c9: No bootstrap required, opened a new log
I20260709 13:23:50.789915 17080 ts_tablet_manager.cc:1403] T 7272ddf94a8c4eaaa5168967e79d45c2 P 876bb7d2968847e2a08a12f88045a4c9: Time spent bootstrapping tablet: real 0.019s	user 0.012s	sys 0.001s
I20260709 13:23:50.792593 17080 raft_consensus.cc:359] T 7272ddf94a8c4eaaa5168967e79d45c2 P 876bb7d2968847e2a08a12f88045a4c9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5a48d48028f489780ad77280a273215" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44221 } } peers { permanent_uuid: "1c65d124c93a4ac5b642819ff573ce97" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 37463 } } peers { permanent_uuid: "876bb7d2968847e2a08a12f88045a4c9" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 43761 } }
I20260709 13:23:50.793212 17080 raft_consensus.cc:385] T 7272ddf94a8c4eaaa5168967e79d45c2 P 876bb7d2968847e2a08a12f88045a4c9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:23:50.793488 17080 raft_consensus.cc:740] T 7272ddf94a8c4eaaa5168967e79d45c2 P 876bb7d2968847e2a08a12f88045a4c9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 876bb7d2968847e2a08a12f88045a4c9, State: Initialized, Role: FOLLOWER
I20260709 13:23:50.794301 17080 consensus_queue.cc:260] T 7272ddf94a8c4eaaa5168967e79d45c2 P 876bb7d2968847e2a08a12f88045a4c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5a48d48028f489780ad77280a273215" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44221 } } peers { permanent_uuid: "1c65d124c93a4ac5b642819ff573ce97" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 37463 } } peers { permanent_uuid: "876bb7d2968847e2a08a12f88045a4c9" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 43761 } }
I20260709 13:23:50.796450 17080 ts_tablet_manager.cc:1434] T 7272ddf94a8c4eaaa5168967e79d45c2 P 876bb7d2968847e2a08a12f88045a4c9: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.003s
I20260709 13:23:50.872907 17086 consensus_queue.cc:1048] T 90850a911923468bafa87a1ecca48f6c P 1c65d124c93a4ac5b642819ff573ce97 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5a48d48028f489780ad77280a273215" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44221 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:23:50.890911 17091 consensus_queue.cc:1048] T 90850a911923468bafa87a1ecca48f6c P 1c65d124c93a4ac5b642819ff573ce97 [LEADER]: Connected to new peer: Peer: permanent_uuid: "876bb7d2968847e2a08a12f88045a4c9" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 43761 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:23:50.907799 17108 consensus_queue.cc:1048] T c83f96843aa2412e9d0cfabcc1f2236f P 1c65d124c93a4ac5b642819ff573ce97 [LEADER]: Connected to new peer: Peer: permanent_uuid: "876bb7d2968847e2a08a12f88045a4c9" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 43761 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:23:50.924000 17108 consensus_queue.cc:1048] T c83f96843aa2412e9d0cfabcc1f2236f P 1c65d124c93a4ac5b642819ff573ce97 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5a48d48028f489780ad77280a273215" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44221 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:23:51.056617 17086 raft_consensus.cc:493] T 7272ddf94a8c4eaaa5168967e79d45c2 P 1c65d124c93a4ac5b642819ff573ce97 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:23:51.057121 17086 raft_consensus.cc:515] T 7272ddf94a8c4eaaa5168967e79d45c2 P 1c65d124c93a4ac5b642819ff573ce97 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5a48d48028f489780ad77280a273215" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44221 } } peers { permanent_uuid: "1c65d124c93a4ac5b642819ff573ce97" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 37463 } } peers { permanent_uuid: "876bb7d2968847e2a08a12f88045a4c9" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 43761 } }
I20260709 13:23:51.059290 17086 leader_election.cc:290] T 7272ddf94a8c4eaaa5168967e79d45c2 P 1c65d124c93a4ac5b642819ff573ce97 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f5a48d48028f489780ad77280a273215 (127.5.126.65:44221), 876bb7d2968847e2a08a12f88045a4c9 (127.5.126.67:43761)
I20260709 13:23:51.060366 16889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7272ddf94a8c4eaaa5168967e79d45c2" candidate_uuid: "1c65d124c93a4ac5b642819ff573ce97" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5a48d48028f489780ad77280a273215" is_pre_election: true
I20260709 13:23:51.060655 17038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7272ddf94a8c4eaaa5168967e79d45c2" candidate_uuid: "1c65d124c93a4ac5b642819ff573ce97" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "876bb7d2968847e2a08a12f88045a4c9" is_pre_election: true
I20260709 13:23:51.061067 16889 raft_consensus.cc:2468] T 7272ddf94a8c4eaaa5168967e79d45c2 P f5a48d48028f489780ad77280a273215 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c65d124c93a4ac5b642819ff573ce97 in term 0.
I20260709 13:23:51.061517 17038 raft_consensus.cc:2468] T 7272ddf94a8c4eaaa5168967e79d45c2 P 876bb7d2968847e2a08a12f88045a4c9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c65d124c93a4ac5b642819ff573ce97 in term 0.
I20260709 13:23:51.062397 16928 leader_election.cc:304] T 7272ddf94a8c4eaaa5168967e79d45c2 P 1c65d124c93a4ac5b642819ff573ce97 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c65d124c93a4ac5b642819ff573ce97, f5a48d48028f489780ad77280a273215; no voters: 
I20260709 13:23:51.063197 17086 raft_consensus.cc:2804] T 7272ddf94a8c4eaaa5168967e79d45c2 P 1c65d124c93a4ac5b642819ff573ce97 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:23:51.063546 17086 raft_consensus.cc:493] T 7272ddf94a8c4eaaa5168967e79d45c2 P 1c65d124c93a4ac5b642819ff573ce97 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:23:51.063845 17086 raft_consensus.cc:3060] T 7272ddf94a8c4eaaa5168967e79d45c2 P 1c65d124c93a4ac5b642819ff573ce97 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:23:51.070600 17086 raft_consensus.cc:515] T 7272ddf94a8c4eaaa5168967e79d45c2 P 1c65d124c93a4ac5b642819ff573ce97 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5a48d48028f489780ad77280a273215" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44221 } } peers { permanent_uuid: "1c65d124c93a4ac5b642819ff573ce97" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 37463 } } peers { permanent_uuid: "876bb7d2968847e2a08a12f88045a4c9" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 43761 } }
I20260709 13:23:51.072440 17086 leader_election.cc:290] T 7272ddf94a8c4eaaa5168967e79d45c2 P 1c65d124c93a4ac5b642819ff573ce97 [CANDIDATE]: Term 1 election: Requested vote from peers f5a48d48028f489780ad77280a273215 (127.5.126.65:44221), 876bb7d2968847e2a08a12f88045a4c9 (127.5.126.67:43761)
I20260709 13:23:51.073321 16889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7272ddf94a8c4eaaa5168967e79d45c2" candidate_uuid: "1c65d124c93a4ac5b642819ff573ce97" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5a48d48028f489780ad77280a273215"
I20260709 13:23:51.073776 17038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7272ddf94a8c4eaaa5168967e79d45c2" candidate_uuid: "1c65d124c93a4ac5b642819ff573ce97" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "876bb7d2968847e2a08a12f88045a4c9"
I20260709 13:23:51.074064 16889 raft_consensus.cc:3060] T 7272ddf94a8c4eaaa5168967e79d45c2 P f5a48d48028f489780ad77280a273215 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:23:51.074389 17038 raft_consensus.cc:3060] T 7272ddf94a8c4eaaa5168967e79d45c2 P 876bb7d2968847e2a08a12f88045a4c9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:23:51.083101 17038 raft_consensus.cc:2468] T 7272ddf94a8c4eaaa5168967e79d45c2 P 876bb7d2968847e2a08a12f88045a4c9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c65d124c93a4ac5b642819ff573ce97 in term 1.
I20260709 13:23:51.083101 16889 raft_consensus.cc:2468] T 7272ddf94a8c4eaaa5168967e79d45c2 P f5a48d48028f489780ad77280a273215 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c65d124c93a4ac5b642819ff573ce97 in term 1.
I20260709 13:23:51.084945 16928 leader_election.cc:304] T 7272ddf94a8c4eaaa5168967e79d45c2 P 1c65d124c93a4ac5b642819ff573ce97 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c65d124c93a4ac5b642819ff573ce97, f5a48d48028f489780ad77280a273215; no voters: 
I20260709 13:23:51.085815 17086 raft_consensus.cc:2804] T 7272ddf94a8c4eaaa5168967e79d45c2 P 1c65d124c93a4ac5b642819ff573ce97 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:23:51.086417 17086 raft_consensus.cc:697] T 7272ddf94a8c4eaaa5168967e79d45c2 P 1c65d124c93a4ac5b642819ff573ce97 [term 1 LEADER]: Becoming Leader. State: Replica: 1c65d124c93a4ac5b642819ff573ce97, State: Running, Role: LEADER
I20260709 13:23:51.087311 17086 consensus_queue.cc:237] T 7272ddf94a8c4eaaa5168967e79d45c2 P 1c65d124c93a4ac5b642819ff573ce97 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5a48d48028f489780ad77280a273215" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44221 } } peers { permanent_uuid: "1c65d124c93a4ac5b642819ff573ce97" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 37463 } } peers { permanent_uuid: "876bb7d2968847e2a08a12f88045a4c9" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 43761 } }
I20260709 13:23:51.096926 16784 catalog_manager.cc:5697] T 7272ddf94a8c4eaaa5168967e79d45c2 P 1c65d124c93a4ac5b642819ff573ce97 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1c65d124c93a4ac5b642819ff573ce97 (127.5.126.66). New cstate: current_term: 1 leader_uuid: "1c65d124c93a4ac5b642819ff573ce97" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5a48d48028f489780ad77280a273215" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44221 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1c65d124c93a4ac5b642819ff573ce97" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 37463 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "876bb7d2968847e2a08a12f88045a4c9" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 43761 } health_report { overall_health: UNKNOWN } } }
I20260709 13:23:51.181273 17084 raft_consensus.cc:493] T ac0aae8ea8914150a45da5a3ce0ccc53 P f5a48d48028f489780ad77280a273215 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:23:51.181999 17084 raft_consensus.cc:515] T ac0aae8ea8914150a45da5a3ce0ccc53 P f5a48d48028f489780ad77280a273215 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5a48d48028f489780ad77280a273215" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44221 } } peers { permanent_uuid: "1c65d124c93a4ac5b642819ff573ce97" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 37463 } } peers { permanent_uuid: "876bb7d2968847e2a08a12f88045a4c9" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 43761 } }
I20260709 13:23:51.184662 17084 leader_election.cc:290] T ac0aae8ea8914150a45da5a3ce0ccc53 P f5a48d48028f489780ad77280a273215 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1c65d124c93a4ac5b642819ff573ce97 (127.5.126.66:37463), 876bb7d2968847e2a08a12f88045a4c9 (127.5.126.67:43761)
I20260709 13:23:51.200259 17085 raft_consensus.cc:493] T ac0aae8ea8914150a45da5a3ce0ccc53 P 876bb7d2968847e2a08a12f88045a4c9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:23:51.201074 17085 raft_consensus.cc:515] T ac0aae8ea8914150a45da5a3ce0ccc53 P 876bb7d2968847e2a08a12f88045a4c9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5a48d48028f489780ad77280a273215" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44221 } } peers { permanent_uuid: "1c65d124c93a4ac5b642819ff573ce97" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 37463 } } peers { permanent_uuid: "876bb7d2968847e2a08a12f88045a4c9" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 43761 } }
I20260709 13:23:51.205816 17085 leader_election.cc:290] T ac0aae8ea8914150a45da5a3ce0ccc53 P 876bb7d2968847e2a08a12f88045a4c9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f5a48d48028f489780ad77280a273215 (127.5.126.65:44221), 1c65d124c93a4ac5b642819ff573ce97 (127.5.126.66:37463)
I20260709 13:23:51.213336 17038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac0aae8ea8914150a45da5a3ce0ccc53" candidate_uuid: "f5a48d48028f489780ad77280a273215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "876bb7d2968847e2a08a12f88045a4c9" is_pre_election: true
I20260709 13:23:51.214005 17086 raft_consensus.cc:493] T ac0aae8ea8914150a45da5a3ce0ccc53 P 1c65d124c93a4ac5b642819ff573ce97 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:23:51.214262 16964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac0aae8ea8914150a45da5a3ce0ccc53" candidate_uuid: "f5a48d48028f489780ad77280a273215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1c65d124c93a4ac5b642819ff573ce97" is_pre_election: true
I20260709 13:23:51.214607 17086 raft_consensus.cc:515] T ac0aae8ea8914150a45da5a3ce0ccc53 P 1c65d124c93a4ac5b642819ff573ce97 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5a48d48028f489780ad77280a273215" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44221 } } peers { permanent_uuid: "1c65d124c93a4ac5b642819ff573ce97" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 37463 } } peers { permanent_uuid: "876bb7d2968847e2a08a12f88045a4c9" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 43761 } }
I20260709 13:23:51.214291 17038 raft_consensus.cc:2468] T ac0aae8ea8914150a45da5a3ce0ccc53 P 876bb7d2968847e2a08a12f88045a4c9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5a48d48028f489780ad77280a273215 in term 0.
I20260709 13:23:51.217056 17086 leader_election.cc:290] T ac0aae8ea8914150a45da5a3ce0ccc53 P 1c65d124c93a4ac5b642819ff573ce97 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f5a48d48028f489780ad77280a273215 (127.5.126.65:44221), 876bb7d2968847e2a08a12f88045a4c9 (127.5.126.67:43761)
I20260709 13:23:51.217163 16853 leader_election.cc:304] T ac0aae8ea8914150a45da5a3ce0ccc53 P f5a48d48028f489780ad77280a273215 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 876bb7d2968847e2a08a12f88045a4c9, f5a48d48028f489780ad77280a273215; no voters: 
I20260709 13:23:51.219575 16889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac0aae8ea8914150a45da5a3ce0ccc53" candidate_uuid: "1c65d124c93a4ac5b642819ff573ce97" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5a48d48028f489780ad77280a273215" is_pre_election: true
I20260709 13:23:51.220258 17084 raft_consensus.cc:2804] T ac0aae8ea8914150a45da5a3ce0ccc53 P f5a48d48028f489780ad77280a273215 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:23:51.220702 17038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac0aae8ea8914150a45da5a3ce0ccc53" candidate_uuid: "1c65d124c93a4ac5b642819ff573ce97" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "876bb7d2968847e2a08a12f88045a4c9" is_pre_election: true
I20260709 13:23:51.220716 17084 raft_consensus.cc:493] T ac0aae8ea8914150a45da5a3ce0ccc53 P f5a48d48028f489780ad77280a273215 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:23:51.221501 17038 raft_consensus.cc:2468] T ac0aae8ea8914150a45da5a3ce0ccc53 P 876bb7d2968847e2a08a12f88045a4c9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c65d124c93a4ac5b642819ff573ce97 in term 0.
I20260709 13:23:51.222124 16964 raft_consensus.cc:2468] T ac0aae8ea8914150a45da5a3ce0ccc53 P 1c65d124c93a4ac5b642819ff573ce97 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5a48d48028f489780ad77280a273215 in term 0.
I20260709 13:23:51.221472 17084 raft_consensus.cc:3060] T ac0aae8ea8914150a45da5a3ce0ccc53 P f5a48d48028f489780ad77280a273215 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:23:51.222867 16928 leader_election.cc:304] T ac0aae8ea8914150a45da5a3ce0ccc53 P 1c65d124c93a4ac5b642819ff573ce97 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c65d124c93a4ac5b642819ff573ce97, 876bb7d2968847e2a08a12f88045a4c9; no voters: 
I20260709 13:23:51.224414 17086 raft_consensus.cc:2804] T ac0aae8ea8914150a45da5a3ce0ccc53 P 1c65d124c93a4ac5b642819ff573ce97 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:23:51.224839 17086 raft_consensus.cc:493] T ac0aae8ea8914150a45da5a3ce0ccc53 P 1c65d124c93a4ac5b642819ff573ce97 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:23:51.225214 17086 raft_consensus.cc:3060] T ac0aae8ea8914150a45da5a3ce0ccc53 P 1c65d124c93a4ac5b642819ff573ce97 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:23:51.228084 16964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac0aae8ea8914150a45da5a3ce0ccc53" candidate_uuid: "876bb7d2968847e2a08a12f88045a4c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1c65d124c93a4ac5b642819ff573ce97" is_pre_election: true
I20260709 13:23:51.229704 16888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac0aae8ea8914150a45da5a3ce0ccc53" candidate_uuid: "876bb7d2968847e2a08a12f88045a4c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5a48d48028f489780ad77280a273215" is_pre_election: true
I20260709 13:23:51.233119 17084 raft_consensus.cc:515] T ac0aae8ea8914150a45da5a3ce0ccc53 P f5a48d48028f489780ad77280a273215 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5a48d48028f489780ad77280a273215" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44221 } } peers { permanent_uuid: "1c65d124c93a4ac5b642819ff573ce97" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 37463 } } peers { permanent_uuid: "876bb7d2968847e2a08a12f88045a4c9" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 43761 } }
I20260709 13:23:51.233386 17086 raft_consensus.cc:515] T ac0aae8ea8914150a45da5a3ce0ccc53 P 1c65d124c93a4ac5b642819ff573ce97 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5a48d48028f489780ad77280a273215" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44221 } } peers { permanent_uuid: "1c65d124c93a4ac5b642819ff573ce97" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 37463 } } peers { permanent_uuid: "876bb7d2968847e2a08a12f88045a4c9" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 43761 } }
I20260709 13:23:51.234707 16964 raft_consensus.cc:2393] T ac0aae8ea8914150a45da5a3ce0ccc53 P 1c65d124c93a4ac5b642819ff573ce97 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 876bb7d2968847e2a08a12f88045a4c9 in current term 1: Already voted for candidate 1c65d124c93a4ac5b642819ff573ce97 in this term.
I20260709 13:23:51.234707 16889 raft_consensus.cc:2393] T ac0aae8ea8914150a45da5a3ce0ccc53 P f5a48d48028f489780ad77280a273215 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1c65d124c93a4ac5b642819ff573ce97 in current term 1: Already voted for candidate f5a48d48028f489780ad77280a273215 in this term.
I20260709 13:23:51.235562 17084 leader_election.cc:290] T ac0aae8ea8914150a45da5a3ce0ccc53 P f5a48d48028f489780ad77280a273215 [CANDIDATE]: Term 1 election: Requested vote from peers 1c65d124c93a4ac5b642819ff573ce97 (127.5.126.66:37463), 876bb7d2968847e2a08a12f88045a4c9 (127.5.126.67:43761)
I20260709 13:23:51.236682 17086 leader_election.cc:290] T ac0aae8ea8914150a45da5a3ce0ccc53 P 1c65d124c93a4ac5b642819ff573ce97 [CANDIDATE]: Term 1 election: Requested vote from peers f5a48d48028f489780ad77280a273215 (127.5.126.65:44221), 876bb7d2968847e2a08a12f88045a4c9 (127.5.126.67:43761)
I20260709 13:23:51.237533 16963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac0aae8ea8914150a45da5a3ce0ccc53" candidate_uuid: "f5a48d48028f489780ad77280a273215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1c65d124c93a4ac5b642819ff573ce97"
I20260709 13:23:51.237908 17038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac0aae8ea8914150a45da5a3ce0ccc53" candidate_uuid: "f5a48d48028f489780ad77280a273215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "876bb7d2968847e2a08a12f88045a4c9"
I20260709 13:23:51.238489 16963 raft_consensus.cc:2393] T ac0aae8ea8914150a45da5a3ce0ccc53 P 1c65d124c93a4ac5b642819ff573ce97 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate f5a48d48028f489780ad77280a273215 in current term 1: Already voted for candidate 1c65d124c93a4ac5b642819ff573ce97 in this term.
I20260709 13:23:51.238776 17038 raft_consensus.cc:3060] T ac0aae8ea8914150a45da5a3ce0ccc53 P 876bb7d2968847e2a08a12f88045a4c9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:23:51.238880 17004 leader_election.cc:304] T ac0aae8ea8914150a45da5a3ce0ccc53 P 876bb7d2968847e2a08a12f88045a4c9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 876bb7d2968847e2a08a12f88045a4c9; no voters: 1c65d124c93a4ac5b642819ff573ce97, f5a48d48028f489780ad77280a273215
I20260709 13:23:51.239252 17037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac0aae8ea8914150a45da5a3ce0ccc53" candidate_uuid: "1c65d124c93a4ac5b642819ff573ce97" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "876bb7d2968847e2a08a12f88045a4c9"
I20260709 13:23:51.239759 16888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac0aae8ea8914150a45da5a3ce0ccc53" candidate_uuid: "1c65d124c93a4ac5b642819ff573ce97" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5a48d48028f489780ad77280a273215"
I20260709 13:23:51.240582 16888 raft_consensus.cc:2393] T ac0aae8ea8914150a45da5a3ce0ccc53 P f5a48d48028f489780ad77280a273215 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 1c65d124c93a4ac5b642819ff573ce97 in current term 1: Already voted for candidate f5a48d48028f489780ad77280a273215 in this term.
I20260709 13:23:51.241588 16928 leader_election.cc:304] T ac0aae8ea8914150a45da5a3ce0ccc53 P 1c65d124c93a4ac5b642819ff573ce97 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c65d124c93a4ac5b642819ff573ce97; no voters: 876bb7d2968847e2a08a12f88045a4c9, f5a48d48028f489780ad77280a273215
I20260709 13:23:51.242376 17086 raft_consensus.cc:2749] T ac0aae8ea8914150a45da5a3ce0ccc53 P 1c65d124c93a4ac5b642819ff573ce97 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:23:51.246942 17038 raft_consensus.cc:2468] T ac0aae8ea8914150a45da5a3ce0ccc53 P 876bb7d2968847e2a08a12f88045a4c9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5a48d48028f489780ad77280a273215 in term 1.
I20260709 13:23:51.247632 17085 raft_consensus.cc:2749] T ac0aae8ea8914150a45da5a3ce0ccc53 P 876bb7d2968847e2a08a12f88045a4c9 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:23:51.248533 16853 leader_election.cc:304] T ac0aae8ea8914150a45da5a3ce0ccc53 P f5a48d48028f489780ad77280a273215 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 876bb7d2968847e2a08a12f88045a4c9, f5a48d48028f489780ad77280a273215; no voters: 1c65d124c93a4ac5b642819ff573ce97
I20260709 13:23:51.249547 17084 raft_consensus.cc:2804] T ac0aae8ea8914150a45da5a3ce0ccc53 P f5a48d48028f489780ad77280a273215 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:23:51.250829 17084 raft_consensus.cc:697] T ac0aae8ea8914150a45da5a3ce0ccc53 P f5a48d48028f489780ad77280a273215 [term 1 LEADER]: Becoming Leader. State: Replica: f5a48d48028f489780ad77280a273215, State: Running, Role: LEADER
I20260709 13:23:51.251793 17084 consensus_queue.cc:237] T ac0aae8ea8914150a45da5a3ce0ccc53 P f5a48d48028f489780ad77280a273215 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5a48d48028f489780ad77280a273215" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44221 } } peers { permanent_uuid: "1c65d124c93a4ac5b642819ff573ce97" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 37463 } } peers { permanent_uuid: "876bb7d2968847e2a08a12f88045a4c9" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 43761 } }
I20260709 13:23:51.260406 16784 catalog_manager.cc:5697] T ac0aae8ea8914150a45da5a3ce0ccc53 P f5a48d48028f489780ad77280a273215 reported cstate change: term changed from 0 to 1, leader changed from <none> to f5a48d48028f489780ad77280a273215 (127.5.126.65). New cstate: current_term: 1 leader_uuid: "f5a48d48028f489780ad77280a273215" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5a48d48028f489780ad77280a273215" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44221 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1c65d124c93a4ac5b642819ff573ce97" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 37463 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "876bb7d2968847e2a08a12f88045a4c9" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 43761 } health_report { overall_health: UNKNOWN } } }
I20260709 13:23:51.415860 16963 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "90850a911923468bafa87a1ecca48f6c"
dest_uuid: "1c65d124c93a4ac5b642819ff573ce97"
mode: GRACEFUL
new_leader_uuid: "f5a48d48028f489780ad77280a273215"
 from {username='slave'} at 127.0.0.1:34084
I20260709 13:23:51.416638 16963 raft_consensus.cc:606] T 90850a911923468bafa87a1ecca48f6c P 1c65d124c93a4ac5b642819ff573ce97 [term 1 LEADER]: Received request to transfer leadership to TS f5a48d48028f489780ad77280a273215
I20260709 13:23:51.419166 17091 raft_consensus.cc:993] T 90850a911923468bafa87a1ecca48f6c P 1c65d124c93a4ac5b642819ff573ce97: : Instructing follower f5a48d48028f489780ad77280a273215 to start an election
I20260709 13:23:51.419687 17108 raft_consensus.cc:1081] T 90850a911923468bafa87a1ecca48f6c P 1c65d124c93a4ac5b642819ff573ce97 [term 1 LEADER]: Signalling peer f5a48d48028f489780ad77280a273215 to start an election
I20260709 13:23:51.421725 16888 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "90850a911923468bafa87a1ecca48f6c"
dest_uuid: "f5a48d48028f489780ad77280a273215"
 from {username='slave'} at 127.0.0.1:48634
I20260709 13:23:51.422426 16888 raft_consensus.cc:493] T 90850a911923468bafa87a1ecca48f6c P f5a48d48028f489780ad77280a273215 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:23:51.422811 16888 raft_consensus.cc:3060] T 90850a911923468bafa87a1ecca48f6c P f5a48d48028f489780ad77280a273215 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:23:51.430598 16888 raft_consensus.cc:515] T 90850a911923468bafa87a1ecca48f6c P f5a48d48028f489780ad77280a273215 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5a48d48028f489780ad77280a273215" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44221 } } peers { permanent_uuid: "1c65d124c93a4ac5b642819ff573ce97" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 37463 } } peers { permanent_uuid: "876bb7d2968847e2a08a12f88045a4c9" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 43761 } }
I20260709 13:23:51.432606 16888 leader_election.cc:290] T 90850a911923468bafa87a1ecca48f6c P f5a48d48028f489780ad77280a273215 [CANDIDATE]: Term 2 election: Requested vote from peers 1c65d124c93a4ac5b642819ff573ce97 (127.5.126.66:37463), 876bb7d2968847e2a08a12f88045a4c9 (127.5.126.67:43761)
I20260709 13:23:51.432425 16963 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7272ddf94a8c4eaaa5168967e79d45c2"
dest_uuid: "1c65d124c93a4ac5b642819ff573ce97"
mode: GRACEFUL
new_leader_uuid: "f5a48d48028f489780ad77280a273215"
 from {username='slave'} at 127.0.0.1:34084
I20260709 13:23:51.433544 16963 raft_consensus.cc:606] T 7272ddf94a8c4eaaa5168967e79d45c2 P 1c65d124c93a4ac5b642819ff573ce97 [term 1 LEADER]: Received request to transfer leadership to TS f5a48d48028f489780ad77280a273215
I20260709 13:23:51.433776 16964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90850a911923468bafa87a1ecca48f6c" candidate_uuid: "f5a48d48028f489780ad77280a273215" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1c65d124c93a4ac5b642819ff573ce97"
I20260709 13:23:51.433848 17038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90850a911923468bafa87a1ecca48f6c" candidate_uuid: "f5a48d48028f489780ad77280a273215" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "876bb7d2968847e2a08a12f88045a4c9"
I20260709 13:23:51.434815 16964 raft_consensus.cc:3055] T 90850a911923468bafa87a1ecca48f6c P 1c65d124c93a4ac5b642819ff573ce97 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:23:51.435364 17038 raft_consensus.cc:3060] T 90850a911923468bafa87a1ecca48f6c P 876bb7d2968847e2a08a12f88045a4c9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:23:51.435349 16964 raft_consensus.cc:740] T 90850a911923468bafa87a1ecca48f6c P 1c65d124c93a4ac5b642819ff573ce97 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 1c65d124c93a4ac5b642819ff573ce97, State: Running, Role: LEADER
I20260709 13:23:51.436975 16964 consensus_queue.cc:260] T 90850a911923468bafa87a1ecca48f6c P 1c65d124c93a4ac5b642819ff573ce97 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5a48d48028f489780ad77280a273215" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44221 } } peers { permanent_uuid: "1c65d124c93a4ac5b642819ff573ce97" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 37463 } } peers { permanent_uuid: "876bb7d2968847e2a08a12f88045a4c9" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 43761 } }
I20260709 13:23:51.438516 16964 raft_consensus.cc:3060] T 90850a911923468bafa87a1ecca48f6c P 1c65d124c93a4ac5b642819ff573ce97 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:23:51.444594 17038 raft_consensus.cc:2468] T 90850a911923468bafa87a1ecca48f6c P 876bb7d2968847e2a08a12f88045a4c9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5a48d48028f489780ad77280a273215 in term 2.
I20260709 13:23:51.445997 16853 leader_election.cc:304] T 90850a911923468bafa87a1ecca48f6c P f5a48d48028f489780ad77280a273215 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 876bb7d2968847e2a08a12f88045a4c9, f5a48d48028f489780ad77280a273215; no voters: 
I20260709 13:23:51.447070 17084 raft_consensus.cc:2804] T 90850a911923468bafa87a1ecca48f6c P f5a48d48028f489780ad77280a273215 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:23:51.447247 16964 raft_consensus.cc:2468] T 90850a911923468bafa87a1ecca48f6c P 1c65d124c93a4ac5b642819ff573ce97 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5a48d48028f489780ad77280a273215 in term 2.
I20260709 13:23:51.447675 17084 raft_consensus.cc:697] T 90850a911923468bafa87a1ecca48f6c P f5a48d48028f489780ad77280a273215 [term 2 LEADER]: Becoming Leader. State: Replica: f5a48d48028f489780ad77280a273215, State: Running, Role: LEADER
I20260709 13:23:51.449018 17084 consensus_queue.cc:237] T 90850a911923468bafa87a1ecca48f6c P f5a48d48028f489780ad77280a273215 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5a48d48028f489780ad77280a273215" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44221 } } peers { permanent_uuid: "1c65d124c93a4ac5b642819ff573ce97" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 37463 } } peers { permanent_uuid: "876bb7d2968847e2a08a12f88045a4c9" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 43761 } }
I20260709 13:23:51.456861 16784 catalog_manager.cc:5697] T 90850a911923468bafa87a1ecca48f6c P f5a48d48028f489780ad77280a273215 reported cstate change: term changed from 1 to 2, leader changed from 1c65d124c93a4ac5b642819ff573ce97 (127.5.126.66) to f5a48d48028f489780ad77280a273215 (127.5.126.65). New cstate: current_term: 2 leader_uuid: "f5a48d48028f489780ad77280a273215" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5a48d48028f489780ad77280a273215" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44221 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1c65d124c93a4ac5b642819ff573ce97" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 37463 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "876bb7d2968847e2a08a12f88045a4c9" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 43761 } health_report { overall_health: UNKNOWN } } }
I20260709 13:23:51.519721 17108 consensus_queue.cc:1048] T 7272ddf94a8c4eaaa5168967e79d45c2 P 1c65d124c93a4ac5b642819ff573ce97 [LEADER]: Connected to new peer: Peer: permanent_uuid: "876bb7d2968847e2a08a12f88045a4c9" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 43761 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:23:51.536823 17108 consensus_queue.cc:1048] T 7272ddf94a8c4eaaa5168967e79d45c2 P 1c65d124c93a4ac5b642819ff573ce97 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5a48d48028f489780ad77280a273215" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44221 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:23:51.548552 17108 raft_consensus.cc:993] T 7272ddf94a8c4eaaa5168967e79d45c2 P 1c65d124c93a4ac5b642819ff573ce97: : Instructing follower f5a48d48028f489780ad77280a273215 to start an election
I20260709 13:23:51.549077 17086 raft_consensus.cc:1081] T 7272ddf94a8c4eaaa5168967e79d45c2 P 1c65d124c93a4ac5b642819ff573ce97 [term 1 LEADER]: Signalling peer f5a48d48028f489780ad77280a273215 to start an election
I20260709 13:23:51.550803 16888 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7272ddf94a8c4eaaa5168967e79d45c2"
dest_uuid: "f5a48d48028f489780ad77280a273215"
 from {username='slave'} at 127.0.0.1:48634
I20260709 13:23:51.551457 16888 raft_consensus.cc:493] T 7272ddf94a8c4eaaa5168967e79d45c2 P f5a48d48028f489780ad77280a273215 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:23:51.551909 16888 raft_consensus.cc:3060] T 7272ddf94a8c4eaaa5168967e79d45c2 P f5a48d48028f489780ad77280a273215 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:23:51.559540 16888 raft_consensus.cc:515] T 7272ddf94a8c4eaaa5168967e79d45c2 P f5a48d48028f489780ad77280a273215 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5a48d48028f489780ad77280a273215" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44221 } } peers { permanent_uuid: "1c65d124c93a4ac5b642819ff573ce97" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 37463 } } peers { permanent_uuid: "876bb7d2968847e2a08a12f88045a4c9" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 43761 } }
I20260709 13:23:51.562017 16888 leader_election.cc:290] T 7272ddf94a8c4eaaa5168967e79d45c2 P f5a48d48028f489780ad77280a273215 [CANDIDATE]: Term 2 election: Requested vote from peers 1c65d124c93a4ac5b642819ff573ce97 (127.5.126.66:37463), 876bb7d2968847e2a08a12f88045a4c9 (127.5.126.67:43761)
I20260709 13:23:51.562397 16964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7272ddf94a8c4eaaa5168967e79d45c2" candidate_uuid: "f5a48d48028f489780ad77280a273215" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1c65d124c93a4ac5b642819ff573ce97"
I20260709 13:23:51.562637 17038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7272ddf94a8c4eaaa5168967e79d45c2" candidate_uuid: "f5a48d48028f489780ad77280a273215" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "876bb7d2968847e2a08a12f88045a4c9"
I20260709 13:23:51.563112 16964 raft_consensus.cc:3055] T 7272ddf94a8c4eaaa5168967e79d45c2 P 1c65d124c93a4ac5b642819ff573ce97 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:23:51.563448 17038 raft_consensus.cc:3060] T 7272ddf94a8c4eaaa5168967e79d45c2 P 876bb7d2968847e2a08a12f88045a4c9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:23:51.563499 16964 raft_consensus.cc:740] T 7272ddf94a8c4eaaa5168967e79d45c2 P 1c65d124c93a4ac5b642819ff573ce97 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 1c65d124c93a4ac5b642819ff573ce97, State: Running, Role: LEADER
I20260709 13:23:51.564543 16964 consensus_queue.cc:260] T 7272ddf94a8c4eaaa5168967e79d45c2 P 1c65d124c93a4ac5b642819ff573ce97 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5a48d48028f489780ad77280a273215" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44221 } } peers { permanent_uuid: "1c65d124c93a4ac5b642819ff573ce97" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 37463 } } peers { permanent_uuid: "876bb7d2968847e2a08a12f88045a4c9" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 43761 } }
I20260709 13:23:51.565851 16964 raft_consensus.cc:3060] T 7272ddf94a8c4eaaa5168967e79d45c2 P 1c65d124c93a4ac5b642819ff573ce97 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:23:51.570199 17038 raft_consensus.cc:2468] T 7272ddf94a8c4eaaa5168967e79d45c2 P 876bb7d2968847e2a08a12f88045a4c9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5a48d48028f489780ad77280a273215 in term 2.
I20260709 13:23:51.571805 16853 leader_election.cc:304] T 7272ddf94a8c4eaaa5168967e79d45c2 P f5a48d48028f489780ad77280a273215 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 876bb7d2968847e2a08a12f88045a4c9, f5a48d48028f489780ad77280a273215; no voters: 
I20260709 13:23:51.572785 17123 raft_consensus.cc:2804] T 7272ddf94a8c4eaaa5168967e79d45c2 P f5a48d48028f489780ad77280a273215 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:23:51.573339 17123 raft_consensus.cc:697] T 7272ddf94a8c4eaaa5168967e79d45c2 P f5a48d48028f489780ad77280a273215 [term 2 LEADER]: Becoming Leader. State: Replica: f5a48d48028f489780ad77280a273215, State: Running, Role: LEADER
I20260709 13:23:51.573403 16964 raft_consensus.cc:2468] T 7272ddf94a8c4eaaa5168967e79d45c2 P 1c65d124c93a4ac5b642819ff573ce97 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5a48d48028f489780ad77280a273215 in term 2.
I20260709 13:23:51.574290 17123 consensus_queue.cc:237] T 7272ddf94a8c4eaaa5168967e79d45c2 P f5a48d48028f489780ad77280a273215 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5a48d48028f489780ad77280a273215" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44221 } } peers { permanent_uuid: "1c65d124c93a4ac5b642819ff573ce97" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 37463 } } peers { permanent_uuid: "876bb7d2968847e2a08a12f88045a4c9" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 43761 } }
I20260709 13:23:51.581144 16784 catalog_manager.cc:5697] T 7272ddf94a8c4eaaa5168967e79d45c2 P f5a48d48028f489780ad77280a273215 reported cstate change: term changed from 1 to 2, leader changed from 1c65d124c93a4ac5b642819ff573ce97 (127.5.126.66) to f5a48d48028f489780ad77280a273215 (127.5.126.65). New cstate: current_term: 2 leader_uuid: "f5a48d48028f489780ad77280a273215" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5a48d48028f489780ad77280a273215" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44221 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1c65d124c93a4ac5b642819ff573ce97" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 37463 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "876bb7d2968847e2a08a12f88045a4c9" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 43761 } health_report { overall_health: UNKNOWN } } }
I20260709 13:23:51.617053  5625 auto_leader_rebalancer.cc:141] leader rebalance for table multi_table_leader_balance_table1
I20260709 13:23:51.618873  5625 auto_leader_rebalancer.cc:452] table: multi_table_leader_balance_table1, leader rebalance finish, leader transfer count: 0
I20260709 13:23:51.619249  5625 auto_leader_rebalancer.cc:141] leader rebalance for table multi_table_leader_balance_table2
I20260709 13:23:51.633782 16888 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ac0aae8ea8914150a45da5a3ce0ccc53"
dest_uuid: "f5a48d48028f489780ad77280a273215"
mode: GRACEFUL
new_leader_uuid: "876bb7d2968847e2a08a12f88045a4c9"
 from {username='slave'} at 127.0.0.1:48656
I20260709 13:23:51.634382 16888 raft_consensus.cc:606] T ac0aae8ea8914150a45da5a3ce0ccc53 P f5a48d48028f489780ad77280a273215 [term 1 LEADER]: Received request to transfer leadership to TS 876bb7d2968847e2a08a12f88045a4c9
I20260709 13:23:51.635624  5625 auto_leader_rebalancer.cc:452] table: multi_table_leader_balance_table2, leader rebalance finish, leader transfer count: 1
I20260709 13:23:51.721789 17123 consensus_queue.cc:1048] T ac0aae8ea8914150a45da5a3ce0ccc53 P f5a48d48028f489780ad77280a273215 [LEADER]: Connected to new peer: Peer: permanent_uuid: "876bb7d2968847e2a08a12f88045a4c9" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 43761 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:23:51.730554 17084 raft_consensus.cc:993] T ac0aae8ea8914150a45da5a3ce0ccc53 P f5a48d48028f489780ad77280a273215: : Instructing follower 876bb7d2968847e2a08a12f88045a4c9 to start an election
I20260709 13:23:51.731557 17123 raft_consensus.cc:1081] T ac0aae8ea8914150a45da5a3ce0ccc53 P f5a48d48028f489780ad77280a273215 [term 1 LEADER]: Signalling peer 876bb7d2968847e2a08a12f88045a4c9 to start an election
I20260709 13:23:51.734019 17037 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ac0aae8ea8914150a45da5a3ce0ccc53"
dest_uuid: "876bb7d2968847e2a08a12f88045a4c9"
 from {username='slave'} at 127.0.0.1:41382
I20260709 13:23:51.734746 17037 raft_consensus.cc:493] T ac0aae8ea8914150a45da5a3ce0ccc53 P 876bb7d2968847e2a08a12f88045a4c9 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:23:51.735111 17037 raft_consensus.cc:3060] T ac0aae8ea8914150a45da5a3ce0ccc53 P 876bb7d2968847e2a08a12f88045a4c9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:23:51.742405 17123 consensus_queue.cc:1048] T ac0aae8ea8914150a45da5a3ce0ccc53 P f5a48d48028f489780ad77280a273215 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c65d124c93a4ac5b642819ff573ce97" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 37463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:23:51.745775 17037 raft_consensus.cc:515] T ac0aae8ea8914150a45da5a3ce0ccc53 P 876bb7d2968847e2a08a12f88045a4c9 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5a48d48028f489780ad77280a273215" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44221 } } peers { permanent_uuid: "1c65d124c93a4ac5b642819ff573ce97" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 37463 } } peers { permanent_uuid: "876bb7d2968847e2a08a12f88045a4c9" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 43761 } }
I20260709 13:23:51.747802 17038 raft_consensus.cc:1240] T ac0aae8ea8914150a45da5a3ce0ccc53 P 876bb7d2968847e2a08a12f88045a4c9 [term 2 FOLLOWER]: Rejecting Update request from peer f5a48d48028f489780ad77280a273215 for earlier term 1. Current term is 2. Ops: []
I20260709 13:23:51.749949 16888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac0aae8ea8914150a45da5a3ce0ccc53" candidate_uuid: "876bb7d2968847e2a08a12f88045a4c9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f5a48d48028f489780ad77280a273215"
I20260709 13:23:51.750681 16888 raft_consensus.cc:3055] T ac0aae8ea8914150a45da5a3ce0ccc53 P f5a48d48028f489780ad77280a273215 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:23:51.750983 16888 raft_consensus.cc:740] T ac0aae8ea8914150a45da5a3ce0ccc53 P f5a48d48028f489780ad77280a273215 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f5a48d48028f489780ad77280a273215, State: Running, Role: LEADER
I20260709 13:23:51.751642 17037 leader_election.cc:290] T ac0aae8ea8914150a45da5a3ce0ccc53 P 876bb7d2968847e2a08a12f88045a4c9 [CANDIDATE]: Term 2 election: Requested vote from peers f5a48d48028f489780ad77280a273215 (127.5.126.65:44221), 1c65d124c93a4ac5b642819ff573ce97 (127.5.126.66:37463)
I20260709 13:23:51.752437 16963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac0aae8ea8914150a45da5a3ce0ccc53" candidate_uuid: "876bb7d2968847e2a08a12f88045a4c9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1c65d124c93a4ac5b642819ff573ce97"
I20260709 13:23:51.751814 16888 consensus_queue.cc:260] T ac0aae8ea8914150a45da5a3ce0ccc53 P f5a48d48028f489780ad77280a273215 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5a48d48028f489780ad77280a273215" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44221 } } peers { permanent_uuid: "1c65d124c93a4ac5b642819ff573ce97" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 37463 } } peers { permanent_uuid: "876bb7d2968847e2a08a12f88045a4c9" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 43761 } }
I20260709 13:23:51.753650 17123 consensus_queue.cc:1059] T ac0aae8ea8914150a45da5a3ce0ccc53 P f5a48d48028f489780ad77280a273215 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "876bb7d2968847e2a08a12f88045a4c9" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 43761 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:23:51.756852 16888 raft_consensus.cc:3060] T ac0aae8ea8914150a45da5a3ce0ccc53 P f5a48d48028f489780ad77280a273215 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:23:51.762159 16888 raft_consensus.cc:2468] T ac0aae8ea8914150a45da5a3ce0ccc53 P f5a48d48028f489780ad77280a273215 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 876bb7d2968847e2a08a12f88045a4c9 in term 2.
I20260709 13:23:51.763320 17002 leader_election.cc:304] T ac0aae8ea8914150a45da5a3ce0ccc53 P 876bb7d2968847e2a08a12f88045a4c9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 876bb7d2968847e2a08a12f88045a4c9, f5a48d48028f489780ad77280a273215; no voters: 1c65d124c93a4ac5b642819ff573ce97
I20260709 13:23:51.764325 17085 raft_consensus.cc:2804] T ac0aae8ea8914150a45da5a3ce0ccc53 P 876bb7d2968847e2a08a12f88045a4c9 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:23:51.765307 17085 raft_consensus.cc:697] T ac0aae8ea8914150a45da5a3ce0ccc53 P 876bb7d2968847e2a08a12f88045a4c9 [term 2 LEADER]: Becoming Leader. State: Replica: 876bb7d2968847e2a08a12f88045a4c9, State: Running, Role: LEADER
I20260709 13:23:51.766146 17085 consensus_queue.cc:237] T ac0aae8ea8914150a45da5a3ce0ccc53 P 876bb7d2968847e2a08a12f88045a4c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5a48d48028f489780ad77280a273215" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44221 } } peers { permanent_uuid: "1c65d124c93a4ac5b642819ff573ce97" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 37463 } } peers { permanent_uuid: "876bb7d2968847e2a08a12f88045a4c9" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 43761 } }
I20260709 13:23:51.772285 16784 catalog_manager.cc:5697] T ac0aae8ea8914150a45da5a3ce0ccc53 P 876bb7d2968847e2a08a12f88045a4c9 reported cstate change: term changed from 1 to 2, leader changed from f5a48d48028f489780ad77280a273215 (127.5.126.65) to 876bb7d2968847e2a08a12f88045a4c9 (127.5.126.67). New cstate: current_term: 2 leader_uuid: "876bb7d2968847e2a08a12f88045a4c9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5a48d48028f489780ad77280a273215" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 44221 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1c65d124c93a4ac5b642819ff573ce97" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 37463 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "876bb7d2968847e2a08a12f88045a4c9" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 43761 } health_report { overall_health: HEALTHY } } }
I20260709 13:23:51.786798  5625 tablet_server.cc:179] TabletServer@127.5.126.65:0 shutting down...
W20260709 13:23:51.809762 16928 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 88 similar messages]
W20260709 13:23:51.817035 16928 consensus_peers.cc:597] T c83f96843aa2412e9d0cfabcc1f2236f P 1c65d124c93a4ac5b642819ff573ce97 -> Peer f5a48d48028f489780ad77280a273215 (127.5.126.65:44221): Couldn't send request to peer f5a48d48028f489780ad77280a273215. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:23:51.839509  5625 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:23:51.840543  5625 tablet_replica.cc:333] T 7272ddf94a8c4eaaa5168967e79d45c2 P f5a48d48028f489780ad77280a273215: stopping tablet replica
I20260709 13:23:51.841163  5625 raft_consensus.cc:2243] T 7272ddf94a8c4eaaa5168967e79d45c2 P f5a48d48028f489780ad77280a273215 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:23:51.841879  5625 pending_rounds.cc:70] T 7272ddf94a8c4eaaa5168967e79d45c2 P f5a48d48028f489780ad77280a273215: Trying to abort 1 pending ops.
I20260709 13:23:51.842088  5625 pending_rounds.cc:77] T 7272ddf94a8c4eaaa5168967e79d45c2 P f5a48d48028f489780ad77280a273215: Aborting op as it isn't in flight: id { term: 2 index: 2 } timestamp: 7305639655738572800 op_type: NO_OP noop_request { }
I20260709 13:23:51.842381  5625 raft_consensus.cc:2889] T 7272ddf94a8c4eaaa5168967e79d45c2 P f5a48d48028f489780ad77280a273215 [term 2 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:23:51.842650  5625 raft_consensus.cc:2272] T 7272ddf94a8c4eaaa5168967e79d45c2 P f5a48d48028f489780ad77280a273215 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:51.845629  5625 tablet_replica.cc:333] T ac0aae8ea8914150a45da5a3ce0ccc53 P f5a48d48028f489780ad77280a273215: stopping tablet replica
I20260709 13:23:51.846264  5625 raft_consensus.cc:2243] T ac0aae8ea8914150a45da5a3ce0ccc53 P f5a48d48028f489780ad77280a273215 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:23:51.846736  5625 raft_consensus.cc:2272] T ac0aae8ea8914150a45da5a3ce0ccc53 P f5a48d48028f489780ad77280a273215 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:51.849946  5625 tablet_replica.cc:333] T 90850a911923468bafa87a1ecca48f6c P f5a48d48028f489780ad77280a273215: stopping tablet replica
I20260709 13:23:51.850548  5625 raft_consensus.cc:2243] T 90850a911923468bafa87a1ecca48f6c P f5a48d48028f489780ad77280a273215 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:23:51.851293  5625 pending_rounds.cc:70] T 90850a911923468bafa87a1ecca48f6c P f5a48d48028f489780ad77280a273215: Trying to abort 1 pending ops.
I20260709 13:23:51.851504  5625 pending_rounds.cc:77] T 90850a911923468bafa87a1ecca48f6c P f5a48d48028f489780ad77280a273215: Aborting op as it isn't in flight: id { term: 2 index: 2 } timestamp: 7305639655225552896 op_type: NO_OP noop_request { }
I20260709 13:23:51.851778  5625 raft_consensus.cc:2889] T 90850a911923468bafa87a1ecca48f6c P f5a48d48028f489780ad77280a273215 [term 2 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:23:51.852114  5625 raft_consensus.cc:2272] T 90850a911923468bafa87a1ecca48f6c P f5a48d48028f489780ad77280a273215 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:51.856544  5625 tablet_replica.cc:333] T c83f96843aa2412e9d0cfabcc1f2236f P f5a48d48028f489780ad77280a273215: stopping tablet replica
I20260709 13:23:51.857174  5625 raft_consensus.cc:2243] T c83f96843aa2412e9d0cfabcc1f2236f P f5a48d48028f489780ad77280a273215 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:23:51.857658  5625 raft_consensus.cc:2272] T c83f96843aa2412e9d0cfabcc1f2236f P f5a48d48028f489780ad77280a273215 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:51.881381  5625 tablet_server.cc:196] TabletServer@127.5.126.65:0 shutdown complete.
I20260709 13:23:51.897467  5625 tablet_server.cc:179] TabletServer@127.5.126.66:0 shutting down...
I20260709 13:23:51.927985  5625 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:23:51.928861  5625 tablet_replica.cc:333] T ac0aae8ea8914150a45da5a3ce0ccc53 P 1c65d124c93a4ac5b642819ff573ce97: stopping tablet replica
I20260709 13:23:51.929469  5625 raft_consensus.cc:2243] T ac0aae8ea8914150a45da5a3ce0ccc53 P 1c65d124c93a4ac5b642819ff573ce97 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:23:51.929934  5625 raft_consensus.cc:2272] T ac0aae8ea8914150a45da5a3ce0ccc53 P 1c65d124c93a4ac5b642819ff573ce97 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:51.932402  5625 tablet_replica.cc:333] T 7272ddf94a8c4eaaa5168967e79d45c2 P 1c65d124c93a4ac5b642819ff573ce97: stopping tablet replica
I20260709 13:23:51.932945  5625 raft_consensus.cc:2243] T 7272ddf94a8c4eaaa5168967e79d45c2 P 1c65d124c93a4ac5b642819ff573ce97 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:23:51.933365  5625 raft_consensus.cc:2272] T 7272ddf94a8c4eaaa5168967e79d45c2 P 1c65d124c93a4ac5b642819ff573ce97 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:51.935562  5625 tablet_replica.cc:333] T c83f96843aa2412e9d0cfabcc1f2236f P 1c65d124c93a4ac5b642819ff573ce97: stopping tablet replica
I20260709 13:23:51.936213  5625 raft_consensus.cc:2243] T c83f96843aa2412e9d0cfabcc1f2236f P 1c65d124c93a4ac5b642819ff573ce97 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:23:51.937276  5625 raft_consensus.cc:2272] T c83f96843aa2412e9d0cfabcc1f2236f P 1c65d124c93a4ac5b642819ff573ce97 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:51.939868  5625 tablet_replica.cc:333] T 90850a911923468bafa87a1ecca48f6c P 1c65d124c93a4ac5b642819ff573ce97: stopping tablet replica
I20260709 13:23:51.940449  5625 raft_consensus.cc:2243] T 90850a911923468bafa87a1ecca48f6c P 1c65d124c93a4ac5b642819ff573ce97 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:23:51.940819  5625 raft_consensus.cc:2272] T 90850a911923468bafa87a1ecca48f6c P 1c65d124c93a4ac5b642819ff573ce97 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:51.965790  5625 tablet_server.cc:196] TabletServer@127.5.126.66:0 shutdown complete.
I20260709 13:23:51.981276  5625 tablet_server.cc:179] TabletServer@127.5.126.67:0 shutting down...
I20260709 13:23:52.013674  5625 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:23:52.014549  5625 tablet_replica.cc:333] T 7272ddf94a8c4eaaa5168967e79d45c2 P 876bb7d2968847e2a08a12f88045a4c9: stopping tablet replica
I20260709 13:23:52.015179  5625 raft_consensus.cc:2243] T 7272ddf94a8c4eaaa5168967e79d45c2 P 876bb7d2968847e2a08a12f88045a4c9 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:23:52.015695  5625 raft_consensus.cc:2272] T 7272ddf94a8c4eaaa5168967e79d45c2 P 876bb7d2968847e2a08a12f88045a4c9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:52.018498  5625 tablet_replica.cc:333] T ac0aae8ea8914150a45da5a3ce0ccc53 P 876bb7d2968847e2a08a12f88045a4c9: stopping tablet replica
I20260709 13:23:52.019078  5625 raft_consensus.cc:2243] T ac0aae8ea8914150a45da5a3ce0ccc53 P 876bb7d2968847e2a08a12f88045a4c9 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:23:52.019739  5625 pending_rounds.cc:70] T ac0aae8ea8914150a45da5a3ce0ccc53 P 876bb7d2968847e2a08a12f88045a4c9: Trying to abort 2 pending ops.
I20260709 13:23:52.019930  5625 pending_rounds.cc:77] T ac0aae8ea8914150a45da5a3ce0ccc53 P 876bb7d2968847e2a08a12f88045a4c9: Aborting op as it isn't in flight: id { term: 2 index: 2 } timestamp: 7305639656521822208 op_type: NO_OP noop_request { }
I20260709 13:23:52.020305  5625 raft_consensus.cc:2889] T ac0aae8ea8914150a45da5a3ce0ccc53 P 876bb7d2968847e2a08a12f88045a4c9 [term 2 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:23:52.020550  5625 pending_rounds.cc:77] T ac0aae8ea8914150a45da5a3ce0ccc53 P 876bb7d2968847e2a08a12f88045a4c9: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7305639654416424960 op_type: NO_OP noop_request { }
I20260709 13:23:52.020790  5625 raft_consensus.cc:2889] T ac0aae8ea8914150a45da5a3ce0ccc53 P 876bb7d2968847e2a08a12f88045a4c9 [term 2 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:23:52.021071  5625 raft_consensus.cc:2272] T ac0aae8ea8914150a45da5a3ce0ccc53 P 876bb7d2968847e2a08a12f88045a4c9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:52.023733  5625 tablet_replica.cc:333] T c83f96843aa2412e9d0cfabcc1f2236f P 876bb7d2968847e2a08a12f88045a4c9: stopping tablet replica
I20260709 13:23:52.024369  5625 raft_consensus.cc:2243] T c83f96843aa2412e9d0cfabcc1f2236f P 876bb7d2968847e2a08a12f88045a4c9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:23:52.024830  5625 raft_consensus.cc:2272] T c83f96843aa2412e9d0cfabcc1f2236f P 876bb7d2968847e2a08a12f88045a4c9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:52.027294  5625 tablet_replica.cc:333] T 90850a911923468bafa87a1ecca48f6c P 876bb7d2968847e2a08a12f88045a4c9: stopping tablet replica
I20260709 13:23:52.027891  5625 raft_consensus.cc:2243] T 90850a911923468bafa87a1ecca48f6c P 876bb7d2968847e2a08a12f88045a4c9 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:23:52.028434  5625 raft_consensus.cc:2272] T 90850a911923468bafa87a1ecca48f6c P 876bb7d2968847e2a08a12f88045a4c9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:52.053246  5625 tablet_server.cc:196] TabletServer@127.5.126.67:0 shutdown complete.
I20260709 13:23:52.072283  5625 master.cc:562] Master@127.5.126.126:43497 shutting down...
I20260709 13:23:52.095572  5625 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 633e3861906342c68902502b811b2baf [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:23:52.096303  5625 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 633e3861906342c68902502b811b2baf [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:23:52.096665  5625 tablet_replica.cc:333] T 00000000000000000000000000000000 P 633e3861906342c68902502b811b2baf: stopping tablet replica
I20260709 13:23:52.117486  5625 master.cc:584] Master@127.5.126.126:43497 shutdown complete.
[       OK ] LeaderRebalancerTest.MultiTableLeaderBalance (2678 ms)
[----------] 6 tests from LeaderRebalancerTest (374894 ms total)

[----------] 2 tests from FilterSoftDeletedTableTest
[ RUN      ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/0
I20260709 13:23:52.160192  5625 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.5.126.126:43033
I20260709 13:23:52.161580  5625 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:23:52.168377 17138 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:23:52.168489 17137 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:23:52.169231 17140 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:23:52.170933  5625 server_base.cc:1061] running on GCE node
I20260709 13:23:52.171947  5625 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:23:52.172215  5625 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:23:52.172327  5625 hybrid_clock.cc:648] HybridClock initialized: now 1783603432172316 us; error 0 us; skew 500 ppm
I20260709 13:23:52.172827  5625 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:23:52.175514  5625 webserver.cc:533] Webserver started at http://127.5.126.126:46335/ using document root <none> and password file <none>
I20260709 13:23:52.175948  5625 fs_manager.cc:362] Metadata directory not provided
I20260709 13:23:52.176189  5625 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:23:52.176425  5625 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:23:52.177485  5625 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskWHb0CB/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783603057096655-5625-0/minicluster-data/master-0-root/instance:
uuid: "be89b8f07a33490391e9a842951e89b0"
format_stamp: "Formatted at 2026-07-09 13:23:52 on dist-test-slave-smzk"
I20260709 13:23:52.182166  5625 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 13:23:52.185972 17145 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:23:52.186923  5625 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.001s	sys 0.000s
I20260709 13:23:52.187391  5625 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskWHb0CB/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783603057096655-5625-0/minicluster-data/master-0-root
uuid: "be89b8f07a33490391e9a842951e89b0"
format_stamp: "Formatted at 2026-07-09 13:23:52 on dist-test-slave-smzk"
I20260709 13:23:52.187687  5625 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWHb0CB/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783603057096655-5625-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskWHb0CB/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783603057096655-5625-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskWHb0CB/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783603057096655-5625-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:23:52.207345  5625 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:23:52.209198  5625 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:23:52.254369  5625 rpc_server.cc:307] RPC server started. Bound to: 127.5.126.126:43033
I20260709 13:23:52.254617 17196 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.5.126.126:43033 every 8 connection(s)
I20260709 13:23:52.258690 17197 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:23:52.272575 17197 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P be89b8f07a33490391e9a842951e89b0: Bootstrap starting.
I20260709 13:23:52.278293 17197 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P be89b8f07a33490391e9a842951e89b0: Neither blocks nor log segments found. Creating new log.
I20260709 13:23:52.283284 17197 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P be89b8f07a33490391e9a842951e89b0: No bootstrap required, opened a new log
I20260709 13:23:52.285835 17197 raft_consensus.cc:359] T 00000000000000000000000000000000 P be89b8f07a33490391e9a842951e89b0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "be89b8f07a33490391e9a842951e89b0" member_type: VOTER }
I20260709 13:23:52.286278 17197 raft_consensus.cc:385] T 00000000000000000000000000000000 P be89b8f07a33490391e9a842951e89b0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:23:52.286464 17197 raft_consensus.cc:740] T 00000000000000000000000000000000 P be89b8f07a33490391e9a842951e89b0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: be89b8f07a33490391e9a842951e89b0, State: Initialized, Role: FOLLOWER
I20260709 13:23:52.287050 17197 consensus_queue.cc:260] T 00000000000000000000000000000000 P be89b8f07a33490391e9a842951e89b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "be89b8f07a33490391e9a842951e89b0" member_type: VOTER }
I20260709 13:23:52.287523 17197 raft_consensus.cc:399] T 00000000000000000000000000000000 P be89b8f07a33490391e9a842951e89b0 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:23:52.287842 17197 raft_consensus.cc:493] T 00000000000000000000000000000000 P be89b8f07a33490391e9a842951e89b0 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:23:52.288139 17197 raft_consensus.cc:3060] T 00000000000000000000000000000000 P be89b8f07a33490391e9a842951e89b0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:23:52.294842 17197 raft_consensus.cc:515] T 00000000000000000000000000000000 P be89b8f07a33490391e9a842951e89b0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "be89b8f07a33490391e9a842951e89b0" member_type: VOTER }
I20260709 13:23:52.295426 17197 leader_election.cc:304] T 00000000000000000000000000000000 P be89b8f07a33490391e9a842951e89b0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: be89b8f07a33490391e9a842951e89b0; no voters: 
I20260709 13:23:52.296705 17197 leader_election.cc:290] T 00000000000000000000000000000000 P be89b8f07a33490391e9a842951e89b0 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:23:52.297168 17200 raft_consensus.cc:2804] T 00000000000000000000000000000000 P be89b8f07a33490391e9a842951e89b0 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:23:52.298704 17200 raft_consensus.cc:697] T 00000000000000000000000000000000 P be89b8f07a33490391e9a842951e89b0 [term 1 LEADER]: Becoming Leader. State: Replica: be89b8f07a33490391e9a842951e89b0, State: Running, Role: LEADER
I20260709 13:23:52.299428 17200 consensus_queue.cc:237] T 00000000000000000000000000000000 P be89b8f07a33490391e9a842951e89b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "be89b8f07a33490391e9a842951e89b0" member_type: VOTER }
I20260709 13:23:52.299995 17197 sys_catalog.cc:565] T 00000000000000000000000000000000 P be89b8f07a33490391e9a842951e89b0 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:23:52.302457 17202 sys_catalog.cc:455] T 00000000000000000000000000000000 P be89b8f07a33490391e9a842951e89b0 [sys.catalog]: SysCatalogTable state changed. Reason: New leader be89b8f07a33490391e9a842951e89b0. Latest consensus state: current_term: 1 leader_uuid: "be89b8f07a33490391e9a842951e89b0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "be89b8f07a33490391e9a842951e89b0" member_type: VOTER } }
I20260709 13:23:52.302517 17201 sys_catalog.cc:455] T 00000000000000000000000000000000 P be89b8f07a33490391e9a842951e89b0 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "be89b8f07a33490391e9a842951e89b0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "be89b8f07a33490391e9a842951e89b0" member_type: VOTER } }
I20260709 13:23:52.303298 17202 sys_catalog.cc:458] T 00000000000000000000000000000000 P be89b8f07a33490391e9a842951e89b0 [sys.catalog]: This master's current role is: LEADER
I20260709 13:23:52.303403 17201 sys_catalog.cc:458] T 00000000000000000000000000000000 P be89b8f07a33490391e9a842951e89b0 [sys.catalog]: This master's current role is: LEADER
I20260709 13:23:52.309394 17205 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:23:52.318150 17205 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:23:52.319461  5625 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:23:52.328989 17205 catalog_manager.cc:1383] Generated new cluster ID: 7d366383519a43daa64283ef9ad6c1ec
I20260709 13:23:52.329306 17205 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:23:52.355897 17205 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:23:52.357605 17205 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:23:52.370431 17205 catalog_manager.cc:6070] T 00000000000000000000000000000000 P be89b8f07a33490391e9a842951e89b0: Generated new TSK 0
I20260709 13:23:52.371215 17205 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:23:52.386878  5625 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:23:52.394225 17218 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:23:52.395525 17219 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:23:52.397632 17221 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:23:52.398211  5625 server_base.cc:1061] running on GCE node
I20260709 13:23:52.399243  5625 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:23:52.399523  5625 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:23:52.399691  5625 hybrid_clock.cc:648] HybridClock initialized: now 1783603432399656 us; error 0 us; skew 500 ppm
I20260709 13:23:52.400324  5625 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:23:52.403064  5625 webserver.cc:533] Webserver started at http://127.5.126.65:40309/ using document root <none> and password file <none>
I20260709 13:23:52.403575  5625 fs_manager.cc:362] Metadata directory not provided
I20260709 13:23:52.403769  5625 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:23:52.404119  5625 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:23:52.405350  5625 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskWHb0CB/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783603057096655-5625-0/minicluster-data/ts-0-root/instance:
uuid: "726d96e241134d7e9e1851f2cee66d03"
format_stamp: "Formatted at 2026-07-09 13:23:52 on dist-test-slave-smzk"
I20260709 13:23:52.410404  5625 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.003s	sys 0.002s
I20260709 13:23:52.414242 17226 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:23:52.415149  5625 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.000s
I20260709 13:23:52.415477  5625 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskWHb0CB/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783603057096655-5625-0/minicluster-data/ts-0-root
uuid: "726d96e241134d7e9e1851f2cee66d03"
format_stamp: "Formatted at 2026-07-09 13:23:52 on dist-test-slave-smzk"
I20260709 13:23:52.415803  5625 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWHb0CB/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783603057096655-5625-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskWHb0CB/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783603057096655-5625-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskWHb0CB/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783603057096655-5625-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:23:52.453934  5625 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:23:52.455295  5625 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:23:52.456952  5625 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:23:52.459506  5625 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:23:52.459725  5625 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:23:52.459973  5625 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:23:52.460203  5625 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.001s	sys 0.000s
I20260709 13:23:52.510493  5625 rpc_server.cc:307] RPC server started. Bound to: 127.5.126.65:45087
I20260709 13:23:52.510749 17288 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.5.126.65:45087 every 8 connection(s)
I20260709 13:23:52.515959  5625 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:23:52.524737 17293 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:23:52.527870 17294 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:23:52.531255  5625 server_base.cc:1061] running on GCE node
W20260709 13:23:52.532385 17296 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:23:52.532856 17289 heartbeater.cc:344] Connected to a master server at 127.5.126.126:43033
I20260709 13:23:52.533475 17289 heartbeater.cc:461] Registering TS with master...
I20260709 13:23:52.533740  5625 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:23:52.534050  5625 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:23:52.534253  5625 hybrid_clock.cc:648] HybridClock initialized: now 1783603432534235 us; error 0 us; skew 500 ppm
I20260709 13:23:52.534456 17289 heartbeater.cc:507] Master 127.5.126.126:43033 requested a full tablet report, sending...
I20260709 13:23:52.535043  5625 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:23:52.537374 17162 ts_manager.cc:194] Registered new tserver with Master: 726d96e241134d7e9e1851f2cee66d03 (127.5.126.65:45087)
I20260709 13:23:52.538230  5625 webserver.cc:533] Webserver started at http://127.5.126.66:42133/ using document root <none> and password file <none>
I20260709 13:23:52.538923  5625 fs_manager.cc:362] Metadata directory not provided
I20260709 13:23:52.539170  5625 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:23:52.539492  5625 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:23:52.540066 17162 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:56808
I20260709 13:23:52.541018  5625 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskWHb0CB/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783603057096655-5625-0/minicluster-data/ts-1-root/instance:
uuid: "316e9983905848079a8e6d9ce5585f46"
format_stamp: "Formatted at 2026-07-09 13:23:52 on dist-test-slave-smzk"
I20260709 13:23:52.546486  5625 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.002s	sys 0.003s
I20260709 13:23:52.550269 17301 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:23:52.551143  5625 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.001s	sys 0.000s
I20260709 13:23:52.551504  5625 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskWHb0CB/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783603057096655-5625-0/minicluster-data/ts-1-root
uuid: "316e9983905848079a8e6d9ce5585f46"
format_stamp: "Formatted at 2026-07-09 13:23:52 on dist-test-slave-smzk"
I20260709 13:23:52.551808  5625 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWHb0CB/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783603057096655-5625-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskWHb0CB/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783603057096655-5625-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskWHb0CB/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783603057096655-5625-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:23:52.570464  5625 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:23:52.571555  5625 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:23:52.573040  5625 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:23:52.575358  5625 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:23:52.575582  5625 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:23:52.575829  5625 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:23:52.576021  5625 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:23:52.622756  5625 rpc_server.cc:307] RPC server started. Bound to: 127.5.126.66:39729
I20260709 13:23:52.622934 17363 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.5.126.66:39729 every 8 connection(s)
I20260709 13:23:52.627638  5625 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:23:52.636657 17367 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:23:52.637660 17368 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:23:52.640683  5625 server_base.cc:1061] running on GCE node
W20260709 13:23:52.642096 17370 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:23:52.643261 17364 heartbeater.cc:344] Connected to a master server at 127.5.126.126:43033
I20260709 13:23:52.643545  5625 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
I20260709 13:23:52.643676 17364 heartbeater.cc:461] Registering TS with master...
W20260709 13:23:52.643929  5625 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:23:52.644385  5625 hybrid_clock.cc:648] HybridClock initialized: now 1783603432644360 us; error 0 us; skew 500 ppm
I20260709 13:23:52.644928 17364 heartbeater.cc:507] Master 127.5.126.126:43033 requested a full tablet report, sending...
I20260709 13:23:52.645116  5625 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:23:52.647765 17162 ts_manager.cc:194] Registered new tserver with Master: 316e9983905848079a8e6d9ce5585f46 (127.5.126.66:39729)
I20260709 13:23:52.649928  5625 webserver.cc:533] Webserver started at http://127.5.126.67:42931/ using document root <none> and password file <none>
I20260709 13:23:52.649972 17162 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:56814
I20260709 13:23:52.650990  5625 fs_manager.cc:362] Metadata directory not provided
I20260709 13:23:52.651371  5625 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:23:52.651723  5625 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:23:52.653071  5625 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskWHb0CB/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783603057096655-5625-0/minicluster-data/ts-2-root/instance:
uuid: "ee69eea1a5cc4645acdd4deaa9e0ac7f"
format_stamp: "Formatted at 2026-07-09 13:23:52 on dist-test-slave-smzk"
I20260709 13:23:52.658329  5625 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.005s	sys 0.000s
I20260709 13:23:52.661981 17375 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:23:52.662900  5625 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.000s	sys 0.001s
I20260709 13:23:52.663214  5625 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskWHb0CB/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783603057096655-5625-0/minicluster-data/ts-2-root
uuid: "ee69eea1a5cc4645acdd4deaa9e0ac7f"
format_stamp: "Formatted at 2026-07-09 13:23:52 on dist-test-slave-smzk"
I20260709 13:23:52.663461  5625 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWHb0CB/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783603057096655-5625-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskWHb0CB/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783603057096655-5625-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskWHb0CB/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783603057096655-5625-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:23:52.691793  5625 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:23:52.692994  5625 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:23:52.694293  5625 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:23:52.696717  5625 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:23:52.696944  5625 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:23:52.697186  5625 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:23:52.697358  5625 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:23:52.743408  5625 rpc_server.cc:307] RPC server started. Bound to: 127.5.126.67:41127
I20260709 13:23:52.743674 17437 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.5.126.67:41127 every 8 connection(s)
I20260709 13:23:52.759621 17438 heartbeater.cc:344] Connected to a master server at 127.5.126.126:43033
I20260709 13:23:52.760236 17438 heartbeater.cc:461] Registering TS with master...
I20260709 13:23:52.761121 17438 heartbeater.cc:507] Master 127.5.126.126:43033 requested a full tablet report, sending...
I20260709 13:23:52.763301 17162 ts_manager.cc:194] Registered new tserver with Master: ee69eea1a5cc4645acdd4deaa9e0ac7f (127.5.126.67:41127)
I20260709 13:23:52.763562  5625 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.016745334s
I20260709 13:23:52.765003 17162 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:56826
I20260709 13:23:52.793143 17162 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56832:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:23:52.795768 17162 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:23:52.875455 17254 tablet_service.cc:1511] Processing CreateTablet for tablet a3211f7bc1aa4d949b49f0c23362b0d5 (DEFAULT_TABLE table=test-workload [id=1ad9c0b40b7346408f5a8d4b78805ef0]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:23:52.875630 17253 tablet_service.cc:1511] Processing CreateTablet for tablet 9d069857fc89437daad3f116d0fc7709 (DEFAULT_TABLE table=test-workload [id=1ad9c0b40b7346408f5a8d4b78805ef0]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:23:52.877498 17254 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a3211f7bc1aa4d949b49f0c23362b0d5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:23:52.878163 17253 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9d069857fc89437daad3f116d0fc7709. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:23:52.881228 17252 tablet_service.cc:1511] Processing CreateTablet for tablet d137c22ac67145ae96eedb776127de6f (DEFAULT_TABLE table=test-workload [id=1ad9c0b40b7346408f5a8d4b78805ef0]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:23:52.882920 17252 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d137c22ac67145ae96eedb776127de6f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:23:52.885206 17329 tablet_service.cc:1511] Processing CreateTablet for tablet a3211f7bc1aa4d949b49f0c23362b0d5 (DEFAULT_TABLE table=test-workload [id=1ad9c0b40b7346408f5a8d4b78805ef0]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:23:52.885344 17251 tablet_service.cc:1511] Processing CreateTablet for tablet 0544fe20b9ca44b18589408ea98f4eed (DEFAULT_TABLE table=test-workload [id=1ad9c0b40b7346408f5a8d4b78805ef0]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:23:52.886103 17327 tablet_service.cc:1511] Processing CreateTablet for tablet d137c22ac67145ae96eedb776127de6f (DEFAULT_TABLE table=test-workload [id=1ad9c0b40b7346408f5a8d4b78805ef0]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:23:52.886729 17329 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a3211f7bc1aa4d949b49f0c23362b0d5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:23:52.887053 17251 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0544fe20b9ca44b18589408ea98f4eed. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:23:52.887714 17327 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d137c22ac67145ae96eedb776127de6f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:23:52.889358 17250 tablet_service.cc:1511] Processing CreateTablet for tablet d87dace41fef4526a2cace8a5007919f (DEFAULT_TABLE table=test-workload [id=1ad9c0b40b7346408f5a8d4b78805ef0]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:23:52.890885 17250 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d87dace41fef4526a2cace8a5007919f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:23:52.893472 17328 tablet_service.cc:1511] Processing CreateTablet for tablet 9d069857fc89437daad3f116d0fc7709 (DEFAULT_TABLE table=test-workload [id=1ad9c0b40b7346408f5a8d4b78805ef0]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:23:52.895059 17328 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9d069857fc89437daad3f116d0fc7709. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:23:52.898003 17326 tablet_service.cc:1511] Processing CreateTablet for tablet 0544fe20b9ca44b18589408ea98f4eed (DEFAULT_TABLE table=test-workload [id=1ad9c0b40b7346408f5a8d4b78805ef0]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:23:52.899646 17326 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0544fe20b9ca44b18589408ea98f4eed. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:23:52.910866 17452 tablet_bootstrap.cc:492] T 9d069857fc89437daad3f116d0fc7709 P 726d96e241134d7e9e1851f2cee66d03: Bootstrap starting.
I20260709 13:23:52.918478 17452 tablet_bootstrap.cc:654] T 9d069857fc89437daad3f116d0fc7709 P 726d96e241134d7e9e1851f2cee66d03: Neither blocks nor log segments found. Creating new log.
I20260709 13:23:52.925204 17453 tablet_bootstrap.cc:492] T a3211f7bc1aa4d949b49f0c23362b0d5 P 316e9983905848079a8e6d9ce5585f46: Bootstrap starting.
I20260709 13:23:52.931073 17452 tablet_bootstrap.cc:492] T 9d069857fc89437daad3f116d0fc7709 P 726d96e241134d7e9e1851f2cee66d03: No bootstrap required, opened a new log
I20260709 13:23:52.931619 17329 tablet_service.cc:1511] Processing CreateTablet for tablet d87dace41fef4526a2cace8a5007919f (DEFAULT_TABLE table=test-workload [id=1ad9c0b40b7346408f5a8d4b78805ef0]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:23:52.933516 17329 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d87dace41fef4526a2cace8a5007919f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:23:52.933706 17453 tablet_bootstrap.cc:654] T a3211f7bc1aa4d949b49f0c23362b0d5 P 316e9983905848079a8e6d9ce5585f46: Neither blocks nor log segments found. Creating new log.
I20260709 13:23:52.931710 17452 ts_tablet_manager.cc:1403] T 9d069857fc89437daad3f116d0fc7709 P 726d96e241134d7e9e1851f2cee66d03: Time spent bootstrapping tablet: real 0.023s	user 0.007s	sys 0.011s
I20260709 13:23:52.943374 17253 tablet_service.cc:1511] Processing CreateTablet for tablet a01b9563aeb3401dbc60ad1647424d67 (DEFAULT_TABLE table=test-workload [id=1ad9c0b40b7346408f5a8d4b78805ef0]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:23:52.944145 17452 raft_consensus.cc:359] T 9d069857fc89437daad3f116d0fc7709 P 726d96e241134d7e9e1851f2cee66d03 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "726d96e241134d7e9e1851f2cee66d03" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 45087 } } peers { permanent_uuid: "316e9983905848079a8e6d9ce5585f46" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 39729 } } peers { permanent_uuid: "ee69eea1a5cc4645acdd4deaa9e0ac7f" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 41127 } }
I20260709 13:23:52.944833 17253 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a01b9563aeb3401dbc60ad1647424d67. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:23:52.945107 17452 raft_consensus.cc:385] T 9d069857fc89437daad3f116d0fc7709 P 726d96e241134d7e9e1851f2cee66d03 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:23:52.945533 17452 raft_consensus.cc:740] T 9d069857fc89437daad3f116d0fc7709 P 726d96e241134d7e9e1851f2cee66d03 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 726d96e241134d7e9e1851f2cee66d03, State: Initialized, Role: FOLLOWER
I20260709 13:23:52.948513 17326 tablet_service.cc:1511] Processing CreateTablet for tablet a01b9563aeb3401dbc60ad1647424d67 (DEFAULT_TABLE table=test-workload [id=1ad9c0b40b7346408f5a8d4b78805ef0]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:23:52.950270 17326 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a01b9563aeb3401dbc60ad1647424d67. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:23:52.955901 17249 tablet_service.cc:1511] Processing CreateTablet for tablet c2dd9bbf84cd4a0f918afc3a6e9f9d04 (DEFAULT_TABLE table=test-workload [id=1ad9c0b40b7346408f5a8d4b78805ef0]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:23:52.959877 17325 tablet_service.cc:1511] Processing CreateTablet for tablet c2dd9bbf84cd4a0f918afc3a6e9f9d04 (DEFAULT_TABLE table=test-workload [id=1ad9c0b40b7346408f5a8d4b78805ef0]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:23:52.961678 17325 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c2dd9bbf84cd4a0f918afc3a6e9f9d04. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:23:52.964150 17249 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c2dd9bbf84cd4a0f918afc3a6e9f9d04. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:23:52.968618 17402 tablet_service.cc:1511] Processing CreateTablet for tablet 9d069857fc89437daad3f116d0fc7709 (DEFAULT_TABLE table=test-workload [id=1ad9c0b40b7346408f5a8d4b78805ef0]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:23:52.969724 17399 tablet_service.cc:1511] Processing CreateTablet for tablet d87dace41fef4526a2cace8a5007919f (DEFAULT_TABLE table=test-workload [id=1ad9c0b40b7346408f5a8d4b78805ef0]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:23:52.970369 17402 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9d069857fc89437daad3f116d0fc7709. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:23:52.971583 17399 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d87dace41fef4526a2cace8a5007919f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:23:52.971411 17400 tablet_service.cc:1511] Processing CreateTablet for tablet 0544fe20b9ca44b18589408ea98f4eed (DEFAULT_TABLE table=test-workload [id=1ad9c0b40b7346408f5a8d4b78805ef0]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:23:52.973114 17400 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0544fe20b9ca44b18589408ea98f4eed. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:23:52.978229 17398 tablet_service.cc:1511] Processing CreateTablet for tablet a01b9563aeb3401dbc60ad1647424d67 (DEFAULT_TABLE table=test-workload [id=1ad9c0b40b7346408f5a8d4b78805ef0]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:23:52.978765 17401 tablet_service.cc:1511] Processing CreateTablet for tablet d137c22ac67145ae96eedb776127de6f (DEFAULT_TABLE table=test-workload [id=1ad9c0b40b7346408f5a8d4b78805ef0]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:23:52.980679 17403 tablet_service.cc:1511] Processing CreateTablet for tablet a3211f7bc1aa4d949b49f0c23362b0d5 (DEFAULT_TABLE table=test-workload [id=1ad9c0b40b7346408f5a8d4b78805ef0]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:23:52.982059 17397 tablet_service.cc:1511] Processing CreateTablet for tablet c2dd9bbf84cd4a0f918afc3a6e9f9d04 (DEFAULT_TABLE table=test-workload [id=1ad9c0b40b7346408f5a8d4b78805ef0]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:23:52.982978 17324 tablet_service.cc:1511] Processing CreateTablet for tablet 3c97f32b7fa24e109d2c993bee4cacdc (DEFAULT_TABLE table=test-workload [id=1ad9c0b40b7346408f5a8d4b78805ef0]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:23:52.983590 17398 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a01b9563aeb3401dbc60ad1647424d67. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:23:52.984651 17324 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3c97f32b7fa24e109d2c993bee4cacdc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:23:52.985122 17248 tablet_service.cc:1511] Processing CreateTablet for tablet 3c97f32b7fa24e109d2c993bee4cacdc (DEFAULT_TABLE table=test-workload [id=1ad9c0b40b7346408f5a8d4b78805ef0]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:23:52.986802 17403 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a3211f7bc1aa4d949b49f0c23362b0d5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:23:52.987614 17397 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c2dd9bbf84cd4a0f918afc3a6e9f9d04. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:23:52.988631 17401 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d137c22ac67145ae96eedb776127de6f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:23:53.009567 17396 tablet_service.cc:1511] Processing CreateTablet for tablet 3c97f32b7fa24e109d2c993bee4cacdc (DEFAULT_TABLE table=test-workload [id=1ad9c0b40b7346408f5a8d4b78805ef0]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:23:53.011565 17248 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3c97f32b7fa24e109d2c993bee4cacdc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:23:53.016709 17396 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3c97f32b7fa24e109d2c993bee4cacdc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:23:53.018456 17247 tablet_service.cc:1511] Processing CreateTablet for tablet 54bab860b0384e1bb5e75b8c8594e4a0 (DEFAULT_TABLE table=test-workload [id=1ad9c0b40b7346408f5a8d4b78805ef0]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:23:53.020124 17247 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 54bab860b0384e1bb5e75b8c8594e4a0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:23:53.042796 17453 tablet_bootstrap.cc:492] T a3211f7bc1aa4d949b49f0c23362b0d5 P 316e9983905848079a8e6d9ce5585f46: No bootstrap required, opened a new log
I20260709 13:23:53.043048 17327 tablet_service.cc:1511] Processing CreateTablet for tablet 54bab860b0384e1bb5e75b8c8594e4a0 (DEFAULT_TABLE table=test-workload [id=1ad9c0b40b7346408f5a8d4b78805ef0]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:23:53.043593 17453 ts_tablet_manager.cc:1403] T a3211f7bc1aa4d949b49f0c23362b0d5 P 316e9983905848079a8e6d9ce5585f46: Time spent bootstrapping tablet: real 0.119s	user 0.022s	sys 0.006s
I20260709 13:23:53.046422 17327 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 54bab860b0384e1bb5e75b8c8594e4a0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:23:52.946409 17452 consensus_queue.cc:260] T 9d069857fc89437daad3f116d0fc7709 P 726d96e241134d7e9e1851f2cee66d03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "726d96e241134d7e9e1851f2cee66d03" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 45087 } } peers { permanent_uuid: "316e9983905848079a8e6d9ce5585f46" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 39729 } } peers { permanent_uuid: "ee69eea1a5cc4645acdd4deaa9e0ac7f" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 41127 } }
I20260709 13:23:53.047760 17395 tablet_service.cc:1511] Processing CreateTablet for tablet 54bab860b0384e1bb5e75b8c8594e4a0 (DEFAULT_TABLE table=test-workload [id=1ad9c0b40b7346408f5a8d4b78805ef0]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:23:53.051347 17395 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 54bab860b0384e1bb5e75b8c8594e4a0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:23:53.060931 17453 raft_consensus.cc:359] T a3211f7bc1aa4d949b49f0c23362b0d5 P 316e9983905848079a8e6d9ce5585f46 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "726d96e241134d7e9e1851f2cee66d03" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 45087 } } peers { permanent_uuid: "316e9983905848079a8e6d9ce5585f46" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 39729 } } peers { permanent_uuid: "ee69eea1a5cc4645acdd4deaa9e0ac7f" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 41127 } }
I20260709 13:23:53.061868 17453 raft_consensus.cc:385] T a3211f7bc1aa4d949b49f0c23362b0d5 P 316e9983905848079a8e6d9ce5585f46 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:23:53.062192 17453 raft_consensus.cc:740] T a3211f7bc1aa4d949b49f0c23362b0d5 P 316e9983905848079a8e6d9ce5585f46 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 316e9983905848079a8e6d9ce5585f46, State: Initialized, Role: FOLLOWER
I20260709 13:23:53.064635 17453 consensus_queue.cc:260] T a3211f7bc1aa4d949b49f0c23362b0d5 P 316e9983905848079a8e6d9ce5585f46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "726d96e241134d7e9e1851f2cee66d03" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 45087 } } peers { permanent_uuid: "316e9983905848079a8e6d9ce5585f46" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 39729 } } peers { permanent_uuid: "ee69eea1a5cc4645acdd4deaa9e0ac7f" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 41127 } }
I20260709 13:23:53.085204 17289 heartbeater.cc:499] Master 127.5.126.126:43033 was elected leader, sending a full tablet report...
I20260709 13:23:53.086329 17452 ts_tablet_manager.cc:1434] T 9d069857fc89437daad3f116d0fc7709 P 726d96e241134d7e9e1851f2cee66d03: Time spent starting tablet: real 0.146s	user 0.007s	sys 0.003s
I20260709 13:23:53.087391 17452 tablet_bootstrap.cc:492] T d137c22ac67145ae96eedb776127de6f P 726d96e241134d7e9e1851f2cee66d03: Bootstrap starting.
I20260709 13:23:53.108842 17453 ts_tablet_manager.cc:1434] T a3211f7bc1aa4d949b49f0c23362b0d5 P 316e9983905848079a8e6d9ce5585f46: Time spent starting tablet: real 0.065s	user 0.023s	sys 0.006s
I20260709 13:23:53.110179 17456 tablet_bootstrap.cc:492] T d87dace41fef4526a2cace8a5007919f P ee69eea1a5cc4645acdd4deaa9e0ac7f: Bootstrap starting.
I20260709 13:23:53.113886 17452 tablet_bootstrap.cc:654] T d137c22ac67145ae96eedb776127de6f P 726d96e241134d7e9e1851f2cee66d03: Neither blocks nor log segments found. Creating new log.
I20260709 13:23:53.116096 17364 heartbeater.cc:499] Master 127.5.126.126:43033 was elected leader, sending a full tablet report...
I20260709 13:23:53.116605 17453 tablet_bootstrap.cc:492] T 0544fe20b9ca44b18589408ea98f4eed P 316e9983905848079a8e6d9ce5585f46: Bootstrap starting.
I20260709 13:23:53.125262 17456 tablet_bootstrap.cc:654] T d87dace41fef4526a2cace8a5007919f P ee69eea1a5cc4645acdd4deaa9e0ac7f: Neither blocks nor log segments found. Creating new log.
I20260709 13:23:53.129686 17452 tablet_bootstrap.cc:492] T d137c22ac67145ae96eedb776127de6f P 726d96e241134d7e9e1851f2cee66d03: No bootstrap required, opened a new log
I20260709 13:23:53.130401 17452 ts_tablet_manager.cc:1403] T d137c22ac67145ae96eedb776127de6f P 726d96e241134d7e9e1851f2cee66d03: Time spent bootstrapping tablet: real 0.043s	user 0.008s	sys 0.006s
I20260709 13:23:53.132979 17453 tablet_bootstrap.cc:654] T 0544fe20b9ca44b18589408ea98f4eed P 316e9983905848079a8e6d9ce5585f46: Neither blocks nor log segments found. Creating new log.
I20260709 13:23:53.134153 17452 raft_consensus.cc:359] T d137c22ac67145ae96eedb776127de6f P 726d96e241134d7e9e1851f2cee66d03 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "726d96e241134d7e9e1851f2cee66d03" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 45087 } } peers { permanent_uuid: "316e9983905848079a8e6d9ce5585f46" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 39729 } } peers { permanent_uuid: "ee69eea1a5cc4645acdd4deaa9e0ac7f" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 41127 } }
I20260709 13:23:53.135161 17452 raft_consensus.cc:385] T d137c22ac67145ae96eedb776127de6f P 726d96e241134d7e9e1851f2cee66d03 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:23:53.135524 17452 raft_consensus.cc:740] T d137c22ac67145ae96eedb776127de6f P 726d96e241134d7e9e1851f2cee66d03 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 726d96e241134d7e9e1851f2cee66d03, State: Initialized, Role: FOLLOWER
I20260709 13:23:53.136720 17452 consensus_queue.cc:260] T d137c22ac67145ae96eedb776127de6f P 726d96e241134d7e9e1851f2cee66d03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "726d96e241134d7e9e1851f2cee66d03" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 45087 } } peers { permanent_uuid: "316e9983905848079a8e6d9ce5585f46" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 39729 } } peers { permanent_uuid: "ee69eea1a5cc4645acdd4deaa9e0ac7f" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 41127 } }
I20260709 13:23:53.139585 17452 ts_tablet_manager.cc:1434] T d137c22ac67145ae96eedb776127de6f P 726d96e241134d7e9e1851f2cee66d03: Time spent starting tablet: real 0.009s	user 0.009s	sys 0.000s
I20260709 13:23:53.140918 17456 tablet_bootstrap.cc:492] T d87dace41fef4526a2cace8a5007919f P ee69eea1a5cc4645acdd4deaa9e0ac7f: No bootstrap required, opened a new log
I20260709 13:23:53.140945 17452 tablet_bootstrap.cc:492] T d87dace41fef4526a2cace8a5007919f P 726d96e241134d7e9e1851f2cee66d03: Bootstrap starting.
I20260709 13:23:53.143474 17453 tablet_bootstrap.cc:492] T 0544fe20b9ca44b18589408ea98f4eed P 316e9983905848079a8e6d9ce5585f46: No bootstrap required, opened a new log
I20260709 13:23:53.147078 17453 ts_tablet_manager.cc:1403] T 0544fe20b9ca44b18589408ea98f4eed P 316e9983905848079a8e6d9ce5585f46: Time spent bootstrapping tablet: real 0.031s	user 0.015s	sys 0.003s
I20260709 13:23:53.149034 17456 ts_tablet_manager.cc:1403] T d87dace41fef4526a2cace8a5007919f P ee69eea1a5cc4645acdd4deaa9e0ac7f: Time spent bootstrapping tablet: real 0.039s	user 0.012s	sys 0.010s
I20260709 13:23:53.150743 17453 raft_consensus.cc:359] T 0544fe20b9ca44b18589408ea98f4eed P 316e9983905848079a8e6d9ce5585f46 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "726d96e241134d7e9e1851f2cee66d03" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 45087 } } peers { permanent_uuid: "316e9983905848079a8e6d9ce5585f46" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 39729 } } peers { permanent_uuid: "ee69eea1a5cc4645acdd4deaa9e0ac7f" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 41127 } }
I20260709 13:23:53.151684 17453 raft_consensus.cc:385] T 0544fe20b9ca44b18589408ea98f4eed P 316e9983905848079a8e6d9ce5585f46 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:23:53.152060 17453 raft_consensus.cc:740] T 0544fe20b9ca44b18589408ea98f4eed P 316e9983905848079a8e6d9ce5585f46 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 316e9983905848079a8e6d9ce5585f46, State: Initialized, Role: FOLLOWER
I20260709 13:23:53.152805 17456 raft_consensus.cc:359] T d87dace41fef4526a2cace8a5007919f P ee69eea1a5cc4645acdd4deaa9e0ac7f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "726d96e241134d7e9e1851f2cee66d03" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 45087 } } peers { permanent_uuid: "316e9983905848079a8e6d9ce5585f46" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 39729 } } peers { permanent_uuid: "ee69eea1a5cc4645acdd4deaa9e0ac7f" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 41127 } }
I20260709 13:23:53.153673 17456 raft_consensus.cc:385] T d87dace41fef4526a2cace8a5007919f P ee69eea1a5cc4645acdd4deaa9e0ac7f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:23:53.153132 17453 consensus_queue.cc:260] T 0544fe20b9ca44b18589408ea98f4eed P 316e9983905848079a8e6d9ce5585f46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "726d96e241134d7e9e1851f2cee66d03" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 45087 } } peers { permanent_uuid: "316e9983905848079a8e6d9ce5585f46" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 39729 } } peers { permanent_uuid: "ee69eea1a5cc4645acdd4deaa9e0ac7f" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 41127 } }
I20260709 13:23:53.154013 17456 raft_consensus.cc:740] T d87dace41fef4526a2cace8a5007919f P ee69eea1a5cc4645acdd4deaa9e0ac7f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ee69eea1a5cc4645acdd4deaa9e0ac7f, State: Initialized, Role: FOLLOWER
I20260709 13:23:53.155114 17452 tablet_bootstrap.cc:654] T d87dace41fef4526a2cace8a5007919f P 726d96e241134d7e9e1851f2cee66d03: Neither blocks nor log segments found. Creating new log.
I20260709 13:23:53.155092 17456 consensus_queue.cc:260] T d87dace41fef4526a2cace8a5007919f P ee69eea1a5cc4645acdd4deaa9e0ac7f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "726d96e241134d7e9e1851f2cee66d03" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 45087 } } peers { permanent_uuid: "316e9983905848079a8e6d9ce5585f46" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 39729 } } peers { permanent_uuid: "ee69eea1a5cc4645acdd4deaa9e0ac7f" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 41127 } }
I20260709 13:23:53.158597 17453 ts_tablet_manager.cc:1434] T 0544fe20b9ca44b18589408ea98f4eed P 316e9983905848079a8e6d9ce5585f46: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.000s
I20260709 13:23:53.160271 17453 tablet_bootstrap.cc:492] T d137c22ac67145ae96eedb776127de6f P 316e9983905848079a8e6d9ce5585f46: Bootstrap starting.
I20260709 13:23:53.164126 17457 raft_consensus.cc:493] T d137c22ac67145ae96eedb776127de6f P 726d96e241134d7e9e1851f2cee66d03 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:23:53.164887 17457 raft_consensus.cc:515] T d137c22ac67145ae96eedb776127de6f P 726d96e241134d7e9e1851f2cee66d03 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "726d96e241134d7e9e1851f2cee66d03" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 45087 } } peers { permanent_uuid: "316e9983905848079a8e6d9ce5585f46" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 39729 } } peers { permanent_uuid: "ee69eea1a5cc4645acdd4deaa9e0ac7f" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 41127 } }
I20260709 13:23:53.168718 17452 tablet_bootstrap.cc:492] T d87dace41fef4526a2cace8a5007919f P 726d96e241134d7e9e1851f2cee66d03: No bootstrap required, opened a new log
I20260709 13:23:53.169519 17452 ts_tablet_manager.cc:1403] T d87dace41fef4526a2cace8a5007919f P 726d96e241134d7e9e1851f2cee66d03: Time spent bootstrapping tablet: real 0.029s	user 0.005s	sys 0.014s
I20260709 13:23:53.170611 17457 leader_election.cc:290] T d137c22ac67145ae96eedb776127de6f P 726d96e241134d7e9e1851f2cee66d03 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 316e9983905848079a8e6d9ce5585f46 (127.5.126.66:39729), ee69eea1a5cc4645acdd4deaa9e0ac7f (127.5.126.67:41127)
I20260709 13:23:53.173669 17452 raft_consensus.cc:359] T d87dace41fef4526a2cace8a5007919f P 726d96e241134d7e9e1851f2cee66d03 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "726d96e241134d7e9e1851f2cee66d03" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 45087 } } peers { permanent_uuid: "316e9983905848079a8e6d9ce5585f46" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 39729 } } peers { permanent_uuid: "ee69eea1a5cc4645acdd4deaa9e0ac7f" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 41127 } }
I20260709 13:23:53.174705 17452 raft_consensus.cc:385] T d87dace41fef4526a2cace8a5007919f P 726d96e241134d7e9e1851f2cee66d03 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:23:53.175086 17452 raft_consensus.cc:740] T d87dace41fef4526a2cace8a5007919f P 726d96e241134d7e9e1851f2cee66d03 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 726d96e241134d7e9e1851f2cee66d03, State: Initialized, Role: FOLLOWER
I20260709 13:23:53.176024 17452 consensus_queue.cc:260] T d87dace41fef4526a2cace8a5007919f P 726d96e241134d7e9e1851f2cee66d03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "726d96e241134d7e9e1851f2cee66d03" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 45087 } } peers { permanent_uuid: "316e9983905848079a8e6d9ce5585f46" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 39729 } } peers { permanent_uuid: "ee69eea1a5cc4645acdd4deaa9e0ac7f" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 41127 } }
I20260709 13:23:53.177096 17438 heartbeater.cc:499] Master 127.5.126.126:43033 was elected leader, sending a full tablet report...
I20260709 13:23:53.177845 17456 ts_tablet_manager.cc:1434] T d87dace41fef4526a2cace8a5007919f P ee69eea1a5cc4645acdd4deaa9e0ac7f: Time spent starting tablet: real 0.028s	user 0.012s	sys 0.015s
I20260709 13:23:53.178787 17452 ts_tablet_manager.cc:1434] T d87dace41fef4526a2cace8a5007919f P 726d96e241134d7e9e1851f2cee66d03: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
I20260709 13:23:53.179237 17456 tablet_bootstrap.cc:492] T a3211f7bc1aa4d949b49f0c23362b0d5 P ee69eea1a5cc4645acdd4deaa9e0ac7f: Bootstrap starting.
I20260709 13:23:53.179841 17452 tablet_bootstrap.cc:492] T a3211f7bc1aa4d949b49f0c23362b0d5 P 726d96e241134d7e9e1851f2cee66d03: Bootstrap starting.
I20260709 13:23:53.182005 17453 tablet_bootstrap.cc:654] T d137c22ac67145ae96eedb776127de6f P 316e9983905848079a8e6d9ce5585f46: Neither blocks nor log segments found. Creating new log.
I20260709 13:23:53.186869 17456 tablet_bootstrap.cc:654] T a3211f7bc1aa4d949b49f0c23362b0d5 P ee69eea1a5cc4645acdd4deaa9e0ac7f: Neither blocks nor log segments found. Creating new log.
I20260709 13:23:53.190996 17452 tablet_bootstrap.cc:654] T a3211f7bc1aa4d949b49f0c23362b0d5 P 726d96e241134d7e9e1851f2cee66d03: Neither blocks nor log segments found. Creating new log.
I20260709 13:23:53.195282 17453 tablet_bootstrap.cc:492] T d137c22ac67145ae96eedb776127de6f P 316e9983905848079a8e6d9ce5585f46: No bootstrap required, opened a new log
I20260709 13:23:53.195972 17453 ts_tablet_manager.cc:1403] T d137c22ac67145ae96eedb776127de6f P 316e9983905848079a8e6d9ce5585f46: Time spent bootstrapping tablet: real 0.036s	user 0.013s	sys 0.007s
I20260709 13:23:53.198189 17456 tablet_bootstrap.cc:492] T a3211f7bc1aa4d949b49f0c23362b0d5 P ee69eea1a5cc4645acdd4deaa9e0ac7f: No bootstrap required, opened a new log
I20260709 13:23:53.198798 17456 ts_tablet_manager.cc:1403] T a3211f7bc1aa4d949b49f0c23362b0d5 P ee69eea1a5cc4645acdd4deaa9e0ac7f: Time spent bootstrapping tablet: real 0.020s	user 0.014s	sys 0.001s
I20260709 13:23:53.199216 17453 raft_consensus.cc:359] T d137c22ac67145ae96eedb776127de6f P 316e9983905848079a8e6d9ce5585f46 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "726d96e241134d7e9e1851f2cee66d03" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 45087 } } peers { permanent_uuid: "316e9983905848079a8e6d9ce5585f46" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 39729 } } peers { permanent_uuid: "ee69eea1a5cc4645acdd4deaa9e0ac7f" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 41127 } }
I20260709 13:23:53.200088 17453 raft_consensus.cc:385] T d137c22ac67145ae96eedb776127de6f P 316e9983905848079a8e6d9ce5585f46 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:23:53.200393 17453 raft_consensus.cc:740] T d137c22ac67145ae96eedb776127de6f P 316e9983905848079a8e6d9ce5585f46 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 316e9983905848079a8e6d9ce5585f46, State: Initialized, Role: FOLLOWER
I20260709 13:23:53.201241 17453 consensus_queue.cc:260] T d137c22ac67145ae96eedb776127de6f P 316e9983905848079a8e6d9ce5585f46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "726d96e241134d7e9e1851f2cee66d03" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 45087 } } peers { permanent_uuid: "316e9983905848079a8e6d9ce5585f46" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 39729 } } peers { permanent_uuid: "ee69eea1a5cc4645acdd4deaa9e0ac7f" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 41127 } }
I20260709 13:23:53.202219 17456 raft_consensus.cc:359] T a3211f7bc1aa4d949b49f0c23362b0d5 P ee69eea1a5cc4645acdd4deaa9e0ac7f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "726d96e241134d7e9e1851f2cee66d03" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 45087 } } peers { permanent_uuid: "316e9983905848079a8e6d9ce5585f46" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 39729 } } peers { permanent_uuid: "ee69eea1a5cc4645acdd4deaa9e0ac7f" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 41127 } }
I20260709 13:23:53.202987 17456 raft_consensus.cc:385] T a3211f7bc1aa4d949b49f0c23362b0d5 P ee69eea1a5cc4645acdd4deaa9e0ac7f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:23:53.203289 17456 raft_consensus.cc:740] T a3211f7bc1aa4d949b49f0c23362b0d5 P ee69eea1a5cc4645acdd4deaa9e0ac7f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ee69eea1a5cc4645acdd4deaa9e0ac7f, State: Initialized, Role: FOLLOWER
I20260709 13:23:53.204299 17456 consensus_queue.cc:260] T a3211f7bc1aa4d949b49f0c23362b0d5 P ee69eea1a5cc4645acdd4deaa9e0ac7f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "726d96e241134d7e9e1851f2cee66d03" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 45087 } } peers { permanent_uuid: "316e9983905848079a8e6d9ce5585f46" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 39729 } } peers { permanent_uuid: "ee69eea1a5cc4645acdd4deaa9e0ac7f" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 41127 } }
I20260709 13:23:53.206738 17456 ts_tablet_manager.cc:1434] T a3211f7bc1aa4d949b49f0c23362b0d5 P ee69eea1a5cc4645acdd4deaa9e0ac7f: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:23:53.207780 17456 tablet_bootstrap.cc:492] T 0544fe20b9ca44b18589408ea98f4eed P ee69eea1a5cc4645acdd4deaa9e0ac7f: Bootstrap starting.
I20260709 13:23:53.208583 17453 ts_tablet_manager.cc:1434] T d137c22ac67145ae96eedb776127de6f P 316e9983905848079a8e6d9ce5585f46: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.000s
I20260709 13:23:53.209707 17453 tablet_bootstrap.cc:492] T 9d069857fc89437daad3f116d0fc7709 P 316e9983905848079a8e6d9ce5585f46: Bootstrap starting.
I20260709 13:23:53.215767 17456 tablet_bootstrap.cc:654] T 0544fe20b9ca44b18589408ea98f4eed P ee69eea1a5cc4645acdd4deaa9e0ac7f: Neither blocks nor log segments found. Creating new log.
I20260709 13:23:53.220662 17453 tablet_bootstrap.cc:654] T 9d069857fc89437daad3f116d0fc7709 P 316e9983905848079a8e6d9ce5585f46: Neither blocks nor log segments found. Creating new log.
I20260709 13:23:53.224769 17452 tablet_bootstrap.cc:492] T a3211f7bc1aa4d949b49f0c23362b0d5 P 726d96e241134d7e9e1851f2cee66d03: No bootstrap required, opened a new log
I20260709 13:23:53.225608 17452 ts_tablet_manager.cc:1403] T a3211f7bc1aa4d949b49f0c23362b0d5 P 726d96e241134d7e9e1851f2cee66d03: Time spent bootstrapping tablet: real 0.046s	user 0.019s	sys 0.021s
I20260709 13:23:53.229712 17452 raft_consensus.cc:359] T a3211f7bc1aa4d949b49f0c23362b0d5 P 726d96e241134d7e9e1851f2cee66d03 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "726d96e241134d7e9e1851f2cee66d03" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 45087 } } peers { permanent_uuid: "316e9983905848079a8e6d9ce5585f46" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 39729 } } peers { permanent_uuid: "ee69eea1a5cc4645acdd4deaa9e0ac7f" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 41127 } }
I20260709 13:23:53.230695 17452 raft_consensus.cc:385] T a3211f7bc1aa4d949b49f0c23362b0d5 P 726d96e241134d7e9e1851f2cee66d03 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:23:53.231068 17452 raft_consensus.cc:740] T a3211f7bc1aa4d949b49f0c23362b0d5 P 726d96e241134d7e9e1851f2cee66d03 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 726d96e241134d7e9e1851f2cee66d03, State: Initialized, Role: FOLLOWER
I20260709 13:23:53.231859 17452 consensus_queue.cc:260] T a3211f7bc1aa4d949b49f0c23362b0d5 P 726d96e241134d7e9e1851f2cee66d03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "726d96e241134d7e9e1851f2cee66d03" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 45087 } } peers { permanent_uuid: "316e9983905848079a8e6d9ce5585f46" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 39729 } } peers { permanent_uuid: "ee69eea1a5cc4645acdd4deaa9e0ac7f" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 41127 } }
I20260709 13:23:53.233824 17456 tablet_bootstrap.cc:492] T 0544fe20b9ca44b18589408ea98f4eed P ee69eea1a5cc4645acdd4deaa9e0ac7f: No bootstrap required, opened a new log
I20260709 13:23:53.234432 17456 ts_tablet_manager.cc:1403] T 0544fe20b9ca44b18589408ea98f4eed P ee69eea1a5cc4645acdd4deaa9e0ac7f: Time spent bootstrapping tablet: real 0.027s	user 0.010s	sys 0.011s
I20260709 13:23:53.237434 17456 raft_consensus.cc:359] T 0544fe20b9ca44b18589408ea98f4eed P ee69eea1a5cc4645acdd4deaa9e0ac7f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "726d96e241134d7e9e1851f2cee66d03" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 45087 } } peers { permanent_uuid: "316e9983905848079a8e6d9ce5585f46" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 39729 } } peers { permanent_uuid: "ee69eea1a5cc4645acdd4deaa9e0ac7f" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 41127 } }
I20260709 13:23:53.238142 17456 raft_consensus.cc:385] T 0544fe20b9ca44b18589408ea98f4eed P ee69eea1a5cc4645acdd4deaa9e0ac7f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:23:53.238385 17452 ts_tablet_manager.cc:1434] T a3211f7bc1aa4d949b49f0c23362b0d5 P 726d96e241134d7e9e1851f2cee66d03: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.002s
I20260709 13:23:53.238436 17456 raft_consensus.cc:740] T 0544fe20b9ca44b18589408ea98f4eed P ee69eea1a5cc4645acdd4deaa9e0ac7f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ee69eea1a5cc4645acdd4deaa9e0ac7f, State: Initialized, Role: FOLLOWER
I20260709 13:23:53.239810 17452 tablet_bootstrap.cc:492] T 0544fe20b9ca44b18589408ea98f4eed P 726d96e241134d7e9e1851f2cee66d03: Bootstrap starting.
I20260709 13:23:53.239411 17456 consensus_queue.cc:260] T 0544fe20b9ca44b18589408ea98f4eed P ee69eea1a5cc4645acdd4deaa9e0ac7f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "726d96e241134d7e9e1851f2cee66d03" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 45087 } } peers { permanent_uuid: "316e9983905848079a8e6d9ce5585f46" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 39729 } } peers { permanent_uuid: "ee69eea1a5cc4645acdd4deaa9e0ac7f" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 41127 } }
I20260709 13:23:53.241679 17456 ts_tablet_manager.cc:1434] T 0544fe20b9ca44b18589408ea98f4eed P ee69eea1a5cc4645acdd4deaa9e0ac7f: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:23:53.242718 17456 tablet_bootstrap.cc:492] T 9d069857fc89437daad3f116d0fc7709 P ee69eea1a5cc4645acdd4deaa9e0ac7f: Bootstrap starting.
I20260709 13:23:53.250157 17339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d137c22ac67145ae96eedb776127de6f" candidate_uuid: "726d96e241134d7e9e1851f2cee66d03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "316e9983905848079a8e6d9ce5585f46" is_pre_election: true
I20260709 13:23:53.251094 17339 raft_consensus.cc:2468] T d137c22ac67145ae96eedb776127de6f P 316e9983905848079a8e6d9ce5585f46 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 726d96e241134d7e9e1851f2cee66d03 in term 0.
I20260709 13:23:53.251302 17456 tablet_bootstrap.cc:654] T 9d069857fc89437daad3f116d0fc7709 P ee69eea1a5cc4645acdd4deaa9e0ac7f: Neither blocks nor log segments found. Creating new log.
I20260709 13:23:53.251596 17453 tablet_bootstrap.cc:492] T 9d069857fc89437daad3f116d0fc7709 P 316e9983905848079a8e6d9ce5585f46: No bootstrap required, opened a new log
I20260709 13:23:53.252228 17453 ts_tablet_manager.cc:1403] T 9d069857fc89437daad3f116d0fc7709 P 316e9983905848079a8e6d9ce5585f46: Time spent bootstrapping tablet: real 0.043s	user 0.011s	sys 0.007s
I20260709 13:23:53.252882 17227 leader_election.cc:304] T d137c22ac67145ae96eedb776127de6f P 726d96e241134d7e9e1851f2cee66d03 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 316e9983905848079a8e6d9ce5585f46, 726d96e241134d7e9e1851f2cee66d03; no voters: 
I20260709 13:23:53.253973 17457 raft_consensus.cc:2804] T d137c22ac67145ae96eedb776127de6f P 726d96e241134d7e9e1851f2cee66d03 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:23:53.254333 17457 raft_consensus.cc:493] T d137c22ac67145ae96eedb776127de6f P 726d96e241134d7e9e1851f2cee66d03 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:23:53.254685 17457 raft_consensus.cc:3060] T d137c22ac67145ae96eedb776127de6f P 726d96e241134d7e9e1851f2cee66d03 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:23:53.255945 17453 raft_consensus.cc:359] T 9d069857fc89437daad3f116d0fc7709 P 316e9983905848079a8e6d9ce5585f46 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "726d96e241134d7e9e1851f2cee66d03" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 45087 } } peers { permanent_uuid: "316e9983905848079a8e6d9ce5585f46" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 39729 } } peers { permanent_uuid: "ee69eea1a5cc4645acdd4deaa9e0ac7f" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 41127 } }
I20260709 13:23:53.256724 17453 raft_consensus.cc:385] T 9d069857fc89437daad3f116d0fc7709 P 316e9983905848079a8e6d9ce5585f46 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:23:53.257035 17453 raft_consensus.cc:740] T 9d069857fc89437daad3f116d0fc7709 P 316e9983905848079a8e6d9ce5585f46 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 316e9983905848079a8e6d9ce5585f46, State: Initialized, Role: FOLLOWER
I20260709 13:23:53.257871 17453 consensus_queue.cc:260] T 9d069857fc89437daad3f116d0fc7709 P 316e9983905848079a8e6d9ce5585f46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "726d96e241134d7e9e1851f2cee66d03" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 45087 } } peers { permanent_uuid: "316e9983905848079a8e6d9ce5585f46" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 39729 } } peers { permanent_uuid: "ee69eea1a5cc4645acdd4deaa9e0ac7f" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 41127 } }
I20260709 13:23:53.260475 17452 tablet_bootstrap.cc:654] T 0544fe20b9ca44b18589408ea98f4eed P 726d96e241134d7e9e1851f2cee66d03: Neither blocks nor log segments found. Creating new log.
I20260709 13:23:53.260744 17453 ts_tablet_manager.cc:1434] T 9d069857fc89437daad3f116d0fc7709 P 316e9983905848079a8e6d9ce5585f46: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:23:53.260604 17462 raft_consensus.cc:493] T d87dace41fef4526a2cace8a5007919f P ee69eea1a5cc4645acdd4deaa9e0ac7f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:23:53.262166 17453 tablet_bootstrap.cc:492] T a01b9563aeb3401dbc60ad1647424d67 P 316e9983905848079a8e6d9ce5585f46: Bootstrap starting.
I20260709 13:23:53.262049 17462 raft_consensus.cc:515] T d87dace41fef4526a2cace8a5007919f P ee69eea1a5cc4645acdd4deaa9e0ac7f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "726d96e241134d7e9e1851f2cee66d03" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 45087 } } peers { permanent_uuid: "316e9983905848079a8e6d9ce5585f46" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 39729 } } peers { permanent_uuid: "ee69eea1a5cc4645acdd4deaa9e0ac7f" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 41127 } }
I20260709 13:23:53.265380 17456 tablet_bootstrap.cc:492] T 9d069857fc89437daad3f116d0fc7709 P ee69eea1a5cc4645acdd4deaa9e0ac7f: No bootstrap required, opened a new log
I20260709 13:23:53.265959 17456 ts_tablet_manager.cc:1403] T 9d069857fc89437daad3f116d0fc7709 P ee69eea1a5cc4645acdd4deaa9e0ac7f: Time spent bootstrapping tablet: real 0.023s	user 0.009s	sys 0.009s
I20260709 13:23:53.266525 17462 leader_election.cc:290] T d87dace41fef4526a2cace8a5007919f P ee69eea1a5cc4645acdd4deaa9e0ac7f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 726d96e241134d7e9e1851f2cee66d03 (127.5.126.65:45087), 316e9983905848079a8e6d9ce5585f46 (127.5.126.66:39729)
I20260709 13:23:53.269798 17456 raft_consensus.cc:359] T 9d069857fc89437daad3f116d0fc7709 P ee69eea1a5cc4645acdd4deaa9e0ac7f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "726d96e241134d7e9e1851f2cee66d03" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 45087 } } peers { permanent_uuid: "316e9983905848079a8e6d9ce5585f46" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 39729 } } peers { permanent_uuid: "ee69eea1a5cc4645acdd4deaa9e0ac7f" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 41127 } }
I20260709 13:23:53.272075 17453 tablet_bootstrap.cc:654] T a01b9563aeb3401dbc60ad1647424d67 P 316e9983905848079a8e6d9ce5585f46: Neither blocks nor log segments found. Creating new log.
I20260709 13:23:53.276908 17456 raft_consensus.cc:385] T 9d069857fc89437daad3f116d0fc7709 P ee69eea1a5cc4645acdd4deaa9e0ac7f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:23:53.277436 17456 raft_consensus.cc:740] T 9d069857fc89437daad3f116d0fc7709 P ee69eea1a5cc4645acdd4deaa9e0ac7f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ee69eea1a5cc4645acdd4deaa9e0ac7f, State: Initialized, Role: FOLLOWER
I20260709 13:23:53.279793 17456 consensus_queue.cc:260] T 9d069857fc89437daad3f116d0fc7709 P ee69eea1a5cc4645acdd4deaa9e0ac7f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "726d96e241134d7e9e1851f2cee66d03" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 45087 } } peers { permanent_uuid: "316e9983905848079a8e6d9ce5585f46" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 39729 } } peers { permanent_uuid: "ee69eea1a5cc4645acdd4deaa9e0ac7f" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 41127 } }
I20260709 13:23:53.286144 17453 tablet_bootstrap.cc:492] T a01b9563aeb3401dbc60ad1647424d67 P 316e9983905848079a8e6d9ce5585f46: No bootstrap required, opened a new log
I20260709 13:23:53.286499 17456 ts_tablet_manager.cc:1434] T 9d069857fc89437daad3f116d0fc7709 P ee69eea1a5cc4645acdd4deaa9e0ac7f: Time spent starting tablet: real 0.020s	user 0.009s	sys 0.000s
I20260709 13:23:53.286847 17453 ts_tablet_manager.cc:1403] T a01b9563aeb3401dbc60ad1647424d67 P 316e9983905848079a8e6d9ce5585f46: Time spent bootstrapping tablet: real 0.025s	user 0.008s	sys 0.012s
I20260709 13:23:53.288110 17456 tablet_bootstrap.cc:492] T c2dd9bbf84cd4a0f918afc3a6e9f9d04 P ee69eea1a5cc4645acdd4deaa9e0ac7f: Bootstrap starting.
I20260709 13:23:53.290616 17453 raft_consensus.cc:359] T a01b9563aeb3401dbc60ad1647424d67 P 316e9983905848079a8e6d9ce5585f46 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "726d96e241134d7e9e1851f2cee66d03" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 45087 } } peers { permanent_uuid: "316e9983905848079a8e6d9ce5585f46" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 39729 } } peers { permanent_uuid: "ee69eea1a5cc4645acdd4deaa9e0ac7f" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 41127 } }
I20260709 13:23:53.291410 17453 raft_consensus.cc:385] T a01b9563aeb3401dbc60ad1647424d67 P 316e9983905848079a8e6d9ce5585f46 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:23:53.291715 17453 raft_consensus.cc:740] T a01b9563aeb3401dbc60ad1647424d67 P 316e9983905848079a8e6d9ce5585f46 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 316e9983905848079a8e6d9ce5585f46, State: Initialized, Role: FOLLOWER
I20260709 13:23:53.292691 17453 consensus_queue.cc:260] T a01b9563aeb3401dbc60ad1647424d67 P 316e9983905848079a8e6d9ce5585f46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "726d96e241134d7e9e1851f2cee66d03" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 45087 } } peers { permanent_uuid: "316e9983905848079a8e6d9ce5585f46" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 39729 } } peers { permanent_uuid: "ee69eea1a5cc4645acdd4deaa9e0ac7f" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 41127 } }
I20260709 13:23:53.293196 17457 raft_consensus.cc:515] T d137c22ac67145ae96eedb776127de6f P 726d96e241134d7e9e1851f2cee66d03 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "726d96e241134d7e9e1851f2cee66d03" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 45087 } } peers { permanent_uuid: "316e9983905848079a8e6d9ce5585f46" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 39729 } } peers { permanent_uuid: "ee69eea1a5cc4645acdd4deaa9e0ac7f" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 41127 } }
I20260709 13:23:53.305137 17457 leader_election.cc:290] T d137c22ac67145ae96eedb776127de6f P 726d96e241134d7e9e1851f2cee66d03 [CANDIDATE]: Term 1 election: Requested vote from peers 316e9983905848079a8e6d9ce5585f46 (127.5.126.66:39729), ee69eea1a5cc4645acdd4deaa9e0ac7f (127.5.126.67:41127)
I20260709 13:23:53.298643 17453 ts_tablet_manager.cc:1434] T a01b9563aeb3401dbc60ad1647424d67 P 316e9983905848079a8e6d9ce5585f46: Time spent starting tablet: real 0.011s	user 0.003s	sys 0.004s
I20260709 13:23:53.305600 17475 raft_consensus.cc:493] T a3211f7bc1aa4d949b49f0c23362b0d5 P 726d96e241134d7e9e1851f2cee66d03 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:23:53.310707 17453 tablet_bootstrap.cc:492] T d87dace41fef4526a2cace8a5007919f P 316e9983905848079a8e6d9ce5585f46: Bootstrap starting.
W20260709 13:23:53.311347 17210 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:23:53.306423 17339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d137c22ac67145ae96eedb776127de6f" candidate_uuid: "726d96e241134d7e9e1851f2cee66d03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "316e9983905848079a8e6d9ce5585f46"
I20260709 13:23:53.312084 17339 raft_consensus.cc:3060] T d137c22ac67145ae96eedb776127de6f P 316e9983905848079a8e6d9ce5585f46 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:23:53.309047 17477 raft_consensus.cc:493] T 9d069857fc89437daad3f116d0fc7709 P 726d96e241134d7e9e1851f2cee66d03 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:23:53.310236 17475 raft_consensus.cc:515] T a3211f7bc1aa4d949b49f0c23362b0d5 P 726d96e241134d7e9e1851f2cee66d03 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "726d96e241134d7e9e1851f2cee66d03" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 45087 } } peers { permanent_uuid: "316e9983905848079a8e6d9ce5585f46" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 39729 } } peers { permanent_uuid: "ee69eea1a5cc4645acdd4deaa9e0ac7f" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 41127 } }
I20260709 13:23:53.316464 17456 tablet_bootstrap.cc:654] T c2dd9bbf84cd4a0f918afc3a6e9f9d04 P ee69eea1a5cc4645acdd4deaa9e0ac7f: Neither blocks nor log segments found. Creating new log.
I20260709 13:23:53.307669 17462 raft_consensus.cc:493] T 0544fe20b9ca44b18589408ea98f4eed P ee69eea1a5cc4645acdd4deaa9e0ac7f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:23:53.318022 17462 raft_consensus.cc:515] T 0544fe20b9ca44b18589408ea98f4eed P ee69eea1a5cc4645acdd4deaa9e0ac7f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "726d96e241134d7e9e1851f2cee66d03" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 45087 } } peers { permanent_uuid: "316e9983905848079a8e6d9ce5585f46" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 39729 } } peers { permanent_uuid: "ee69eea1a5cc4645acdd4deaa9e0ac7f" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 41127 } }
I20260709 13:23:53.319541 17453 tablet_bootstrap.cc:654] T d87dace41fef4526a2cace8a5007919f P 316e9983905848079a8e6d9ce5585f46: Neither blocks nor log segments found. Creating new log.
I20260709 13:23:53.319758 17475 leader_election.cc:290] T a3211f7bc1aa4d949b49f0c23362b0d5 P 726d96e241134d7e9e1851f2cee66d03 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 316e9983905848079a8e6d9ce5585f46 (127.5.126.66:39729), ee69eea1a5cc4645acdd4deaa9e0ac7f (127.5.126.67:41127)
I20260709 13:23:53.318266 17338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3211f7bc1aa4d949b49f0c23362b0d5" candidate_uuid: "726d96e241134d7e9e1851f2cee66d03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "316e9983905848079a8e6d9ce5585f46" is_pre_election: true
I20260709 13:23:53.321182 17338 raft_consensus.cc:2468] T a3211f7bc1aa4d949b49f0c23362b0d5 P 316e9983905848079a8e6d9ce5585f46 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 726d96e241134d7e9e1851f2cee66d03 in term 0.
I20260709 13:23:53.321000 17477 raft_consensus.cc:515] T 9d069857fc89437daad3f116d0fc7709 P 726d96e241134d7e9e1851f2cee66d03 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "726d96e241134d7e9e1851f2cee66d03" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 45087 } } peers { permanent_uuid: "316e9983905848079a8e6d9ce5585f46" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 39729 } } peers { permanent_uuid: "ee69eea1a5cc4645acdd4deaa9e0ac7f" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 41127 } }
I20260709 13:23:53.322955 17227 leader_election.cc:304] T a3211f7bc1aa4d949b49f0c23362b0d5 P 726d96e241134d7e9e1851f2cee66d03 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 316e9983905848079a8e6d9ce5585f46, 726d96e241134d7e9e1851f2cee66d03; no voters: 
I20260709 13:23:53.320618 17462 leader_election.cc:290] T 0544fe20b9ca44b18589408ea98f4eed P ee69eea1a5cc4645acdd4deaa9e0ac7f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 726d96e241134d7e9e1851f2cee66d03 (127.5.126.65:45087), 316e9983905848079a8e6d9ce5585f46 (127.5.126.66:39729)
I20260709 13:23:53.338984 17264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d87dace41fef4526a2cace8a5007919f" candidate_uuid: "ee69eea1a5cc4645acdd4deaa9e0ac7f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "726d96e241134d7e9e1851f2cee66d03" is_pre_election: true
I20260709 13:23:53.340214 17264 raft_consensus.cc:2468] T d87dace41fef4526a2cace8a5007919f P 726d96e241134d7e9e1851f2cee66d03 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee69eea1a5cc4645acdd4deaa9e0ac7f in term 0.
I20260709 13:23:53.342167 17458 raft_consensus.cc:493] T 9d069857fc89437daad3f116d0fc7709 P 316e9983905848079a8e6d9ce5585f46 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:23:53.342907 17458 raft_consensus.cc:515] T 9d069857fc89437daad3f116d0fc7709 P 316e9983905848079a8e6d9ce5585f46 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "726d96e241134d7e9e1851f2cee66d03" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 45087 } } peers { permanent_uuid: "316e9983905848079a8e6d9ce5585f46" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 39729 } } peers { permanent_uuid: "ee69eea1a5cc4645acdd4deaa9e0ac7f" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 41127 } }
I20260709 13:23:53.343329 17264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0544fe20b9ca44b18589408ea98f4eed" candidate_uuid: "ee69eea1a5cc4645acdd4deaa9e0ac7f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "726d96e241134d7e9e1851f2cee66d03" is_pre_election: true
I20260709 13:23:53.351641 17379 leader_election.cc:304] T d87dace41fef4526a2cace8a5007919f P ee69eea1a5cc4645acdd4deaa9e0ac7f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 726d96e241134d7e9e1851f2cee66d03, ee69eea1a5cc4645acdd4deaa9e0ac7f; no voters: 
I20260709 13:23:53.354720 17452 tablet_bootstrap.cc:492] T 0544fe20b9ca44b18589408ea98f4eed P 726d96e241134d7e9e1851f2cee66d03: No bootstrap required, opened a new log
I20260709 13:23:53.355461 17452 ts_tablet_manager.cc:1403] T 0544fe20b9ca44b18589408ea98f4eed P 726d96e241134d7e9e1851f2cee66d03: Time spent bootstrapping tablet: real 0.116s	user 0.020s	sys 0.000s
I20260709 13:23:53.357414 17462 raft_consensus.cc:2804] T d87dace41fef4526a2cace8a5007919f P ee69eea1a5cc4645acdd4deaa9e0ac7f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:23:53.358989 17462 raft_consensus.cc:493] T d87dace41fef4526a2cace8a5007919f P ee69eea1a5cc4645acdd4deaa9e0ac7f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:23:53.387454 17462 raft_consensus.cc:3060] T d87dace41fef4526a2cace8a5007919f P ee69eea1a5cc4645acdd4deaa9e0ac7f [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:23:53.360473 17379 leader_election.cc:343] T 0544fe20b9ca44b18589408ea98f4eed P ee69eea1a5cc4645acdd4deaa9e0ac7f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 726d96e241134d7e9e1851f2cee66d03 (127.5.126.65:45087): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:23:53.359695 17452 raft_consensus.cc:359] T 0544fe20b9ca44b18589408ea98f4eed P 726d96e241134d7e9e1851f2cee66d03 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "726d96e241134d7e9e1851f2cee66d03" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 45087 } } peers { permanent_uuid: "316e9983905848079a8e6d9ce5585f46" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 39729 } } peers { permanent_uuid: "ee69eea1a5cc4645acdd4deaa9e0ac7f" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 41127 } }
I20260709 13:23:53.392554 17452 raft_consensus.cc:385] T 0544fe20b9ca44b18589408ea98f4eed P 726d96e241134d7e9e1851f2cee66d03 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:23:53.393074 17452 raft_consensus.cc:740] T 0544fe20b9ca44b18589408ea98f4eed P 726d96e241134d7e9e1851f2cee66d03 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 726d96e241134d7e9e1851f2cee66d03, State: Initialized, Role: FOLLOWER
I20260709 13:23:53.394172 17452 consensus_queue.cc:260] T 0544fe20b9ca44b18589408ea98f4eed P 726d96e241134d7e9e1851f2cee66d03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "726d96e241134d7e9e1851f2cee66d03" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 45087 } } peers { permanent_uuid: "316e9983905848079a8e6d9ce5585f46" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 39729 } } peers { permanent_uuid: "ee69eea1a5cc4645acdd4deaa9e0ac7f" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 41127 } }
I20260709 13:23:53.396843 17338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d069857fc89437daad3f116d0fc7709" candidate_uuid: "726d96e241134d7e9e1851f2cee66d03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "316e9983905848079a8e6d9ce5585f46" is_pre_election: true
I20260709 13:23:53.397528 17452 ts_tablet_manager.cc:1434] T 0544fe20b9ca44b18589408ea98f4eed P 726d96e241134d7e9e1851f2cee66d03: Time spent starting tablet: real 0.042s	user 0.010s	sys 0.000s
I20260709 13:23:53.397893 17338 raft_consensus.cc:2468] T 9d069857fc89437daad3f116d0fc7709 P 316e9983905848079a8e6d9ce5585f46 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 726d96e241134d7e9e1851f2cee66d03 in term 0.
I20260709 13:23:53.399195 17452 tablet_bootstrap.cc:492] T c2dd9bbf84cd4a0f918afc3a6e9f9d04 P 726d96e241134d7e9e1851f2cee66d03: Bootstrap starting.
I20260709 13:23:53.371618 17458 leader_election.cc:290] T 9d069857fc89437daad3f116d0fc7709 P 316e9983905848079a8e6d9ce5585f46 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 726d96e241134d7e9e1851f2cee66d03 (127.5.126.65:45087), ee69eea1a5cc4645acdd4deaa9e0ac7f (127.5.126.67:41127)
I20260709 13:23:53.406649 17458 raft_consensus.cc:493] T 0544fe20b9ca44b18589408ea98f4eed P 316e9983905848079a8e6d9ce5585f46 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:23:53.407366 17458 raft_consensus.cc:515] T 0544fe20b9ca44b18589408ea98f4eed P 316e9983905848079a8e6d9ce5585f46 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "726d96e241134d7e9e1851f2cee66d03" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 45087 } } peers { permanent_uuid: "316e9983905848079a8e6d9ce5585f46" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 39729 } } peers { permanent_uuid: "ee69eea1a5cc4645acdd4deaa9e0ac7f" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 41127 } }
I20260709 13:23:53.409847 17458 leader_election.cc:290] T 0544fe20b9ca44b18589408ea98f4eed P 316e9983905848079a8e6d9ce5585f46 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 726d96e241134d7e9e1851f2cee66d03 (127.5.126.65:45087), ee69eea1a5cc4645acdd4deaa9e0ac7f (127.5.126.67:41127)
I20260709 13:23:53.410005 17452 tablet_bootstrap.cc:654] T c2dd9bbf84cd4a0f918afc3a6e9f9d04 P 726d96e241134d7e9e1851f2cee66d03: Neither blocks nor log segments found. Creating new log.
I20260709 13:23:53.410599 17339 raft_consensus.cc:2468] T d137c22ac67145ae96eedb776127de6f P 316e9983905848079a8e6d9ce5585f46 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 726d96e241134d7e9e1851f2cee66d03 in term 1.
I20260709 13:23:53.421030 17453 tablet_bootstrap.cc:492] T d87dace41fef4526a2cace8a5007919f P 316e9983905848079a8e6d9ce5585f46: No bootstrap required, opened a new log
I20260709 13:23:53.421919 17453 ts_tablet_manager.cc:1403] T d87dace41fef4526a2cace8a5007919f P 316e9983905848079a8e6d9ce5585f46: Time spent bootstrapping tablet: real 0.111s	user 0.041s	sys 0.048s
I20260709 13:23:53.422796 17477 leader_election.cc:290] T 9d069857fc89437daad3f116d0fc7709 P 726d96e241134d7e9e1851f2cee66d03 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 316e9983905848079a8e6d9ce5585f46 (127.5.126.66:39729), ee69eea1a5cc4645acdd4deaa9e0ac7f (127.5.126.67:41127)
I20260709 13:23:53.425734 17453 raft_consensus.cc:359] T d87dace41fef4526a2cace8a5007919f P 316e9983905848079a8e6d9ce5585f46 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "726d96e241134d7e9e1851f2cee66d03" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 45087 } } peers { permanent_uuid: "316e9983905848079a8e6d9ce5585f46" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 39729 } } peers { permanent_uuid: "ee69eea1a5cc4645acdd4deaa9e0ac7f" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 41127 } }
I20260709 13:23:53.427523 17453 raft_consensus.cc:385] T d87dace41fef4526a2cace8a5007919f P 316e9983905848079a8e6d9ce5585f46 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:23:53.427953 17453 raft_consensus.cc:740] T d87dace41fef4526a2cace8a5007919f P 316e9983905848079a8e6d9ce5585f46 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 316e9983905848079a8e6d9ce5585f46, State: Initialized, Role: FOLLOWER
I20260709 13:23:53.429111 17453 consensus_queue.cc:260] T d87dace41fef4526a2cace8a5007919f P 316e9983905848079a8e6d9ce5585f46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "726d96e241134d7e9e1851f2cee66d03" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 45087 } } peers { permanent_uuid: "316e9983905848079a8e6d9ce5585f46" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 39729 } } peers { permanent_uuid: "ee69eea1a5cc4645acdd4deaa9e0ac7f" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 41127 } }
I20260709 13:23:53.430271 17456 tablet_bootstrap.cc:492] T c2dd9bbf84cd4a0f918afc3a6e9f9d04 P ee69eea1a5cc4645acdd4deaa9e0ac7f: No bootstrap required, opened a new log
I20260709 13:23:53.430815 17458 raft_consensus.cc:493] T d87dace41fef4526a2cace8a5007919f P 316e9983905848079a8e6d9ce5585f46 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:23:53.431185 17456 ts_tablet_manager.cc:1403] T c2dd9bbf84cd4a0f918afc3a6e9f9d04 P ee69eea1a5cc4645acdd4deaa9e0ac7f: Time spent bootstrapping tablet: real 0.143s	user 0.028s	sys 0.073s
I20260709 13:23:53.431378 17458 raft_consensus.cc:515] T d87dace41fef4526a2cace8a5007919f P 316e9983905848079a8e6d9ce5585f46 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "726d96e241134d7e9e1851f2cee66d03" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 45087 } } peers { permanent_uuid: "316e9983905848079a8e6d9ce5585f46" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 39729 } } peers { permanent_uuid: "ee69eea1a5cc4645acdd4deaa9e0ac7f" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 41127 } }
I20260709 13:23:53.433775 17458 leader_election.cc:290] T d87dace41fef4526a2cace8a5007919f P 316e9983905848079a8e6d9ce5585f46 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 726d96e241134d7e9e1851f2cee66d03 (127.5.126.65:45087), ee69eea1a5cc4645acdd4deaa9e0ac7f (127.5.126.67:41127)
I20260709 13:23:53.430796 17227 leader_election.cc:304] T 9d069857fc89437daad3f116d0fc7709 P 726d96e241134d7e9e1851f2cee66d03 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 316e9983905848079a8e6d9ce5585f46, 726d96e241134d7e9e1851f2cee66d03; no voters: 
I20260709 13:23:53.435359 17227 leader_election.cc:304] T d137c22ac67145ae96eedb776127de6f P 726d96e241134d7e9e1851f2cee66d03 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 316e9983905848079a8e6d9ce5585f46, 726d96e241134d7e9e1851f2cee66d03; no voters: 
I20260709 13:23:53.436180 17457 raft_consensus.cc:2804] T 9d069857fc89437daad3f116d0fc7709 P 726d96e241134d7e9e1851f2cee66d03 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:23:53.436544 17457 raft_consensus.cc:493] T 9d069857fc89437daad3f116d0fc7709 P 726d96e241134d7e9e1851f2cee66d03 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:23:53.436856 17457 raft_consensus.cc:3060] T 9d069857fc89437daad3f116d0fc7709 P 726d96e241134d7e9e1851f2cee66d03 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:23:53.436693 17456 raft_consensus.cc:359] T c2dd9bbf84cd4a0f918afc3a6e9f9d04 P ee69eea1a5cc4645acdd4deaa9e0ac7f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "726d96e241134d7e9e1851f2cee66d03" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 45087 } } peers { permanent_uuid: "316e9983905848079a8e6d9ce5585f46" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 39729 } } peers { permanent_uuid: "ee69eea1a5cc4645acdd4deaa9e0ac7f" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 41127 } }
I20260709 13:23:53.438377 17456 raft_consensus.cc:385] T c2dd9bbf84cd4a0f918afc3a6e9f9d04 P ee69eea1a5cc4645acdd4deaa9e0ac7f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:23:53.438841 17456 raft_consensus.cc:740] T c2dd9bbf84cd4a0f918afc3a6e9f9d04 P ee69eea1a5cc4645acdd4deaa9e0ac7f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ee69eea1a5cc4645acdd4deaa9e0ac7f, State: Initialized, Role: FOLLOWER
I20260709 13:23:53.439364 17453 ts_tablet_manager.cc:1434] T d87dace41fef4526a2cace8a5007919f P 316e9983905848079a8e6d9ce5585f46: Time spent starting tablet: real 0.017s	user 0.011s	sys 0.001s
I20260709 13:23:53.440645 17453 tablet_bootstrap.cc:492] T 54bab860b0384e1bb5e75b8c8594e4a0 P 316e9983905848079a8e6d9ce5585f46: Bootstrap starting.
I20260709 13:23:53.444305 17456 consensus_queue.cc:260] T c2dd9bbf84cd4a0f918afc3a6e9f9d04 P ee69eea1a5cc4645acdd4deaa9e0ac7f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "726d96e241134d7e9e1851f2cee66d03" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 45087 } } peers { permanent_uuid: "316e9983905848079a8e6d9ce5585f46" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 39729 } } peers { permanent_uuid: "ee69eea1a5cc4645acdd4deaa9e0ac7f" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 41127 } }
I20260709 13:23:53.449299 17453 tablet_bootstrap.cc:654] T 54bab860b0384e1bb5e75b8c8594e4a0 P 316e9983905848079a8e6d9ce5585f46: Neither blocks nor log segments found. Creating new log.
I20260709 13:23:53.450219 17477 raft_consensus.cc:2804] T d137c22ac67145ae96eedb776127de6f P 726d96e241134d7e9e1851f2cee66d03 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:23:53.461655 17413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d137c22ac67145ae96eedb776127de6f" candidate_uuid: "726d96e241134d7e9e1851f2cee66d03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee69eea1a5cc4645acdd4deaa9e0ac7f" is_pre_election: true
W20260709 13:23:53.464385 17227 leader_election.cc:343] T d137c22ac67145ae96eedb776127de6f P 726d96e241134d7e9e1851f2cee66d03 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ee69eea1a5cc4645acdd4deaa9e0ac7f (127.5.126.67:41127): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:23:53.465902 17412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3211f7bc1aa4d949b49f0c23362b0d5" candidate_uuid: "726d96e241134d7e9e1851f2cee66d03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee69eea1a5cc4645acdd4deaa9e0ac7f" is_pre_election: true
I20260709 13:23:53.466962 17412 raft_consensus.cc:2468] T a3211f7bc1aa4d949b49f0c23362b0d5 P ee69eea1a5cc4645acdd4deaa9e0ac7f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 726d96e241134d7e9e1851f2cee66d03 in term 0.
I20260709 13:23:53.341358 17475 raft_consensus.cc:2804] T a3211f7bc1aa4d949b49f0c23362b0d5 P 726d96e241134d7e9e1851f2cee66d03 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:23:53.468717 17411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d069857fc89437daad3f116d0fc7709" candidate_uuid: "726d96e241134d7e9e1851f2cee66d03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee69eea1a5cc4645acdd4deaa9e0ac7f" is_pre_election: true
I20260709 13:23:53.469714 17411 raft_consensus.cc:2468] T 9d069857fc89437daad3f116d0fc7709 P ee69eea1a5cc4645acdd4deaa9e0ac7f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 726d96e241134d7e9e1851f2cee66d03 in term 0.
I20260709 13:23:53.470970 17413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d137c22ac67145ae96eedb776127de6f" candidate_uuid: "726d96e241134d7e9e1851f2cee66d03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee69eea1a5cc4645acdd4deaa9e0ac7f"
I20260709 13:23:53.468726 17475 raft_consensus.cc:493] T a3211f7bc1aa4d949b49f0c23362b0d5 P 726d96e241134d7e9e1851f2cee66d03 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:23:53.473737 17475 raft_consensus.cc:3060] T a3211f7bc1aa4d949b49f0c23362b0d5 P 726d96e241134d7e9e1851f2cee66d03 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:23:53.449215 17457 raft_consensus.cc:515] T 9d069857fc89437daad3f116d0fc7709 P 726d96e241134d7e9e1851f2cee66d03 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "726d96e241134d7e9e1851f2cee66d03" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 45087 } } peers { permanent_uuid: "316e9983905848079a8e6d9ce5585f46" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 39729 } } peers { permanent_uuid: "ee69eea1a5cc4645acdd4deaa9e0ac7f" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 41127 } }
I20260709 13:23:53.484925 17475 raft_consensus.cc:515] T a3211f7bc1aa4d949b49f0c23362b0d5 P 726d96e241134d7e9e1851f2cee66d03 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "726d96e241134d7e9e1851f2cee66d03" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 45087 } } peers { permanent_uuid: "316e9983905848079a8e6d9ce5585f46" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 39729 } } peers { permanent_uuid: "ee69eea1a5cc4645acdd4deaa9e0ac7f" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 41127 } }
I20260709 13:23:53.487679 17475 leader_election.cc:290] T a3211f7bc1aa4d949b49f0c23362b0d5 P 726d96e241134d7e9e1851f2cee66d03 [CANDIDATE]: Term 1 election: Requested vote from peers 316e9983905848079a8e6d9ce5585f46 (127.5.126.66:39729), ee69eea1a5cc4645acdd4deaa9e0ac7f (127.5.126.67:41127)
I20260709 13:23:53.492257 17477 raft_consensus.cc:697] T d137c22ac67145ae96eedb776127de6f P 726d96e241134d7e9e1851f2cee66d03 [term 1 LEADER]: Becoming Leader. State: Replica: 726d96e241134d7e9e1851f2cee66d03, State: Running, Role: LEADER
I20260709 13:23:53.493640 17477 consensus_queue.cc:237] T d137c22ac67145ae96eedb776127de6f P 726d96e241134d7e9e1851f2cee66d03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "726d96e241134d7e9e1851f2cee66d03" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 45087 } } peers { permanent_uuid: "316e9983905848079a8e6d9ce5585f46" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 39729 } } peers { permanent_uuid: "ee69eea1a5cc4645acdd4deaa9e0ac7f" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 41127 } }
I20260709 13:23:53.501528 17339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d87dace41fef4526a2cace8a5007919f" candidate_uuid: "ee69eea1a5cc4645acdd4deaa9e0ac7f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "316e9983905848079a8e6d9ce5585f46" is_pre_election: true
I20260709 13:23:53.501925 17338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0544fe20b9ca44b18589408ea98f4eed" candidate_uuid: "ee69eea1a5cc4645acdd4deaa9e0ac7f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "316e9983905848079a8e6d9ce5585f46" is_pre_election: true
I20260709 13:23:53.502341 17339 raft_consensus.cc:2468] T d87dace41fef4526a2cace8a5007919f P 316e9983905848079a8e6d9ce5585f46 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee69eea1a5cc4645acdd4deaa9e0ac7f in term 0.
I20260709 13:23:53.502525 17338 raft_consensus.cc:2468] T 0544fe20b9ca44b18589408ea98f4eed P 316e9983905848079a8e6d9ce5585f46 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee69eea1a5cc4645acdd4deaa9e0ac7f in term 0.
I20260709 13:23:53.508481 17376 leader_election.cc:304] T 0544fe20b9ca44b18589408ea98f4eed P ee69eea1a5cc4645acdd4deaa9e0ac7f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 316e9983905848079a8e6d9ce5585f46, ee69eea1a5cc4645acdd4deaa9e0ac7f; no voters: 726d96e241134d7e9e1851f2cee66d03
I20260709 13:23:53.510320 17338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d069857fc89437daad3f116d0fc7709" candidate_uuid: "726d96e241134d7e9e1851f2cee66d03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "316e9983905848079a8e6d9ce5585f46"
I20260709 13:23:53.511417 17338 raft_consensus.cc:3060] T 9d069857fc89437daad3f116d0fc7709 P 316e9983905848079a8e6d9ce5585f46 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:23:53.526046 17339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3211f7bc1aa4d949b49f0c23362b0d5" candidate_uuid: "726d96e241134d7e9e1851f2cee66d03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "316e9983905848079a8e6d9ce5585f46"
I20260709 13:23:53.527235 17339 raft_consensus.cc:3060] T a3211f7bc1aa4d949b49f0c23362b0d5 P 316e9983905848079a8e6d9ce5585f46 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:23:53.533509 17488 raft_consensus.cc:2804] T 0544fe20b9ca44b18589408ea98f4eed P ee69eea1a5cc4645acdd4deaa9e0ac7f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:23:53.533758 17413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3211f7bc1aa4d949b49f0c23362b0d5" candidate_uuid: "726d96e241134d7e9e1851f2cee66d03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee69eea1a5cc4645acdd4deaa9e0ac7f"
I20260709 13:23:53.534893 17413 raft_consensus.cc:3060] T a3211f7bc1aa4d949b49f0c23362b0d5 P ee69eea1a5cc4645acdd4deaa9e0ac7f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:23:53.536887 17487 raft_consensus.cc:493] T c2dd9bbf84cd4a0f918afc3a6e9f9d04 P ee69eea1a5cc4645acdd4deaa9e0ac7f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:23:53.537619 17487 raft_consensus.cc:515] T c2dd9bbf84cd4a0f918afc3a6e9f9d04 P ee69eea1a5cc4645acdd4deaa9e0ac7f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "726d96e241134d7e9e1851f2cee66d03" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 45087 } } peers { permanent_uuid: "316e9983905848079a8e6d9ce5585f46" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 39729 } } peers { permanent_uuid: "ee69eea1a5cc4645acdd4deaa9e0ac7f" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 41127 } }
I20260709 13:23:53.541854 17264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2dd9bbf84cd4a0f918afc3a6e9f9d04" candidate_uuid: "ee69eea1a5cc4645acdd4deaa9e0ac7f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "726d96e241134d7e9e1851f2cee66d03" is_pre_election: true
W20260709 13:23:53.543843 17379 leader_election.cc:343] T c2dd9bbf84cd4a0f918afc3a6e9f9d04 P ee69eea1a5cc4645acdd4deaa9e0ac7f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 726d96e241134d7e9e1851f2cee66d03 (127.5.126.65:45087): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:23:53.534279 17488 raft_consensus.cc:493] T 0544fe20b9ca44b18589408ea98f4eed P ee69eea1a5cc4645acdd4deaa9e0ac7f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:23:53.545578 17488 raft_consensus.cc:3060] T 0544fe20b9ca44b18589408ea98f4eed P ee69eea1a5cc4645acdd4deaa9e0ac7f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:23:53.550486 17456 ts_tablet_manager.cc:1434] T c2dd9bbf84cd4a0f918afc3a6e9f9d04 P ee69eea1a5cc4645acdd4deaa9e0ac7f: Time spent starting tablet: real 0.119s	user 0.015s	sys 0.043s
W20260709 13:23:53.550767 17227 leader_election.cc:343] T d137c22ac67145ae96eedb776127de6f P 726d96e241134d7e9e1851f2cee66d03 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ee69eea1a5cc4645acdd4deaa9e0ac7f (127.5.126.67:41127): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:23:53.552332 17457 leader_election.cc:290] T 9d069857fc89437daad3f116d0fc7709 P 726d96e241134d7e9e1851f2cee66d03 [CANDIDATE]: Term 1 election: Requested vote from peers 316e9983905848079a8e6d9ce5585f46 (127.5.126.66:39729), ee69eea1a5cc4645acdd4deaa9e0ac7f (127.5.126.67:41127)
I20260709 13:23:53.554288 17456 tablet_bootstrap.cc:492] T 54bab860b0384e1bb5e75b8c8594e4a0 P ee69eea1a5cc4645acdd4deaa9e0ac7f: Bootstrap starting.
I20260709 13:23:53.563048 17456 tablet_bootstrap.cc:654] T 54bab860b0384e1bb5e75b8c8594e4a0 P ee69eea1a5cc4645acdd4deaa9e0ac7f: Neither blocks nor log segments found. Creating new log.
I20260709 13:23:53.563496 17339 raft_consensus.cc:2468] T a3211f7bc1aa4d949b49f0c23362b0d5 P 316e9983905848079a8e6d9ce5585f46 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 726d96e241134d7e9e1851f2cee66d03 in term 1.
I20260709 13:23:53.570593 17411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d069857fc89437daad3f116d0fc7709" candidate_uuid: "316e9983905848079a8e6d9ce5585f46" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee69eea1a5cc4645acdd4deaa9e0ac7f" is_pre_election: true
I20260709 13:23:53.572530 17412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0544fe20b9ca44b18589408ea98f4eed" candidate_uuid: "316e9983905848079a8e6d9ce5585f46" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee69eea1a5cc4645acdd4deaa9e0ac7f" is_pre_election: true
I20260709 13:23:53.574220 17410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d87dace41fef4526a2cace8a5007919f" candidate_uuid: "316e9983905848079a8e6d9ce5585f46" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee69eea1a5cc4645acdd4deaa9e0ac7f" is_pre_election: true
I20260709 13:23:53.575587 17409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d069857fc89437daad3f116d0fc7709" candidate_uuid: "726d96e241134d7e9e1851f2cee66d03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee69eea1a5cc4645acdd4deaa9e0ac7f"
I20260709 13:23:53.576473 17456 tablet_bootstrap.cc:492] T 54bab860b0384e1bb5e75b8c8594e4a0 P ee69eea1a5cc4645acdd4deaa9e0ac7f: No bootstrap required, opened a new log
I20260709 13:23:53.577188 17456 ts_tablet_manager.cc:1403] T 54bab860b0384e1bb5e75b8c8594e4a0 P ee69eea1a5cc4645acdd4deaa9e0ac7f: Time spent bootstrapping tablet: real 0.023s	user 0.021s	sys 0.000s
I20260709 13:23:53.577934 17453 tablet_bootstrap.cc:492] T 54bab860b0384e1bb5e75b8c8594e4a0 P 316e9983905848079a8e6d9ce5585f46: No bootstrap required, opened a new log
I20260709 13:23:53.578567 17453 ts_tablet_manager.cc:1403] T 54bab860b0384e1bb5e75b8c8594e4a0 P 316e9983905848079a8e6d9ce5585f46: Time spent bootstrapping tablet: real 0.138s	user 0.069s	sys 0.058s
I20260709 13:23:53.579793 17227 leader_election.cc:304] T a3211f7bc1aa4d949b49f0c23362b0d5 P 726d96e241134d7e9e1851f2cee66d03 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 316e9983905848079a8e6d9ce5585f46, 726d96e241134d7e9e1851f2cee66d03; no voters: 
I20260709 13:23:53.571650 17411 raft_consensus.cc:2468] T 9d069857fc89437daad3f116d0fc7709 P ee69eea1a5cc4645acdd4deaa9e0ac7f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 316e9983905848079a8e6d9ce5585f46 in term 0.
I20260709 13:23:53.581321 17477 raft_consensus.cc:2804] T a3211f7bc1aa4d949b49f0c23362b0d5 P 726d96e241134d7e9e1851f2cee66d03 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:23:53.581220 17456 raft_consensus.cc:359] T 54bab860b0384e1bb5e75b8c8594e4a0 P ee69eea1a5cc4645acdd4deaa9e0ac7f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "726d96e241134d7e9e1851f2cee66d03" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 45087 } } peers { permanent_uuid: "316e9983905848079a8e6d9ce5585f46" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 39729 } } peers { permanent_uuid: "ee69eea1a5cc4645acdd4deaa9e0ac7f" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 41127 } }
I20260709 13:23:53.581871 17302 leader_election.cc:304] T 9d069857fc89437daad3f116d0fc7709 P 316e9983905848079a8e6d9ce5585f46 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 316e9983905848079a8e6d9ce5585f46, ee69eea1a5cc4645acdd4deaa9e0ac7f; no voters: 
I20260709 13:23:53.582116 17477 raft_consensus.cc:697] T a3211f7bc1aa4d949b49f0c23362b0d5 P 726d96e241134d7e9e1851f2cee66d03 [term 1 LEADER]: Becoming Leader. State: Replica: 726d96e241134d7e9e1851f2cee66d03, State: Running, Role: LEADER
I20260709 13:23:53.582383 17456 raft_consensus.cc:385] T 54bab860b0384e1bb5e75b8c8594e4a0 P ee69eea1a5cc4645acdd4deaa9e0ac7f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:23:53.583024 17456 raft_consensus.cc:740] T 54bab860b0384e1bb5e75b8c8594e4a0 P ee69eea1a5cc4645acdd4deaa9e0ac7f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ee69eea1a5cc4645acdd4deaa9e0ac7f, State: Initialized, Role: FOLLOWER
I20260709 13:23:53.582418 17453 raft_consensus.cc:359] T 54bab860b0384e1bb5e75b8c8594e4a0 P 316e9983905848079a8e6d9ce5585f46 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "726d96e241134d7e9e1851f2cee66d03" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 45087 } } peers { permanent_uuid: "316e9983905848079a8e6d9ce5585f46" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 39729 } } peers { permanent_uuid: "ee69eea1a5cc4645acdd4deaa9e0ac7f" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 41127 } }
I20260709 13:23:53.583949 17453 raft_consensus.cc:385] T 54bab860b0384e1bb5e75b8c8594e4a0 P 316e9983905848079a8e6d9ce5585f46 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:23:53.584352 17453 raft_consensus.cc:740] T 54bab860b0384e1bb5e75b8c8594e4a0 P 316e9983905848079a8e6d9ce5585f46 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 316e9983905848079a8e6d9ce5585f46, State: Initialized, Role: FOLLOWER
I20260709 13:23:53.584299 17456 consensus_queue.cc:260] T 54bab860b0384e1bb5e75b8c8594e4a0 P ee69eea1a5cc4645acdd4deaa9e0ac7f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "726d96e241134d7e9e1851f2cee66d03" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 45087 } } peers { permanent_uuid: "316e9983905848079a8e6d9ce5585f46" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 39729 } } peers { permanent_uuid: "ee69eea1a5cc4645acdd4deaa9e0ac7f" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 41127 } }
I20260709 13:23:53.585188 17413 raft_consensus.cc:2468] T a3211f7bc1aa4d949b49f0c23362b0d5 P ee69eea1a5cc4645acdd4deaa9e0ac7f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 726d96e241134d7e9e1851f2cee66d03 in term 1.
I20260709 13:23:53.584295 17338 raft_consensus.cc:2468] T 9d069857fc89437daad3f116d0fc7709 P 316e9983905848079a8e6d9ce5585f46 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 726d96e241134d7e9e1851f2cee66d03 in term 1.
I20260709 13:23:53.586735 17458 raft_consensus.cc:2764] T 9d069857fc89437daad3f116d0fc7709 P 316e9983905848079a8e6d9ce5585f46 [term 1 FOLLOWER]: Leader pre-election decision vote started in defunct term 0: won
I20260709 13:23:53.559664 17462 raft_consensus.cc:515] T d87dace41fef4526a2cace8a5007919f P ee69eea1a5cc4645acdd4deaa9e0ac7f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "726d96e241134d7e9e1851f2cee66d03" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 45087 } } peers { permanent_uuid: "316e9983905848079a8e6d9ce5585f46" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 39729 } } peers { permanent_uuid: "ee69eea1a5cc4645acdd4deaa9e0ac7f" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 41127 } }
I20260709 13:23:53.587508 17456 ts_tablet_manager.cc:1434] T 54bab860b0384e1bb5e75b8c8594e4a0 P ee69eea1a5cc4645acdd4deaa9e0ac7f: Time spent starting tablet: real 0.010s	user 0.009s	sys 0.000s
I20260709 13:23:53.585929 17453 consensus_queue.cc:260] T 54bab860b0384e1bb5e75b8c8594e4a0 P 316e9983905848079a8e6d9ce5585f46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "726d96e241134d7e9e1851f2cee66d03" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 45087 } } peers { permanent_uuid: "316e9983905848079a8e6d9ce5585f46" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 39729 } } peers { permanent_uuid: "ee69eea1a5cc4645acdd4deaa9e0ac7f" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 41127 } }
I20260709 13:23:53.588410 17410 raft_consensus.cc:2393] T d87dace41fef4526a2cace8a5007919f P ee69eea1a5cc4645acdd4deaa9e0ac7f [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 316e9983905848079a8e6d9ce5585f46 in current term 1: Already voted for candidate ee69eea1a5cc4645acdd4deaa9e0ac7f in this term.
I20260709 13:23:53.587826 17161 catalog_manager.cc:5697] T d137c22ac67145ae96eedb776127de6f P 726d96e241134d7e9e1851f2cee66d03 reported cstate change: term changed from 0 to 1, leader changed from <none> to 726d96e241134d7e9e1851f2cee66d03 (127.5.126.65). New cstate: current_term: 1 leader_uuid: "726d96e241134d7e9e1851f2cee66d03" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "726d96e241134d7e9e1851f2cee66d03" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 45087 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "316e9983905848079a8e6d9ce5585f46" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 39729 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ee69eea1a5cc4645acdd4deaa9e0ac7f" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 41127 } health_report { overall_health: UNKNOWN } } }
I20260709 13:23:53.583279 17477 consensus_queue.cc:237] T a3211f7bc1aa4d949b49f0c23362b0d5 P 726d96e241134d7e9e1851f2cee66d03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "726d96e241134d7e9e1851f2cee66d03" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 45087 } } peers { permanent_uuid: "316e9983905848079a8e6d9ce5585f46" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 39729 } } peers { permanent_uuid: "ee69eea1a5cc4645acdd4deaa9e0ac7f" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 41127 } }
I20260709 13:23:53.578454 17452 tablet_bootstrap.cc:492] T c2dd9bbf84cd4a0f918afc3a6e9f9d04 P 726d96e241134d7e9e1851f2cee66d03: No bootstrap required, opened a new log
I20260709 13:23:53.606858 17452 ts_tablet_manager.cc:1403] T c2dd9bbf84cd4a0f918afc3a6e9f9d04 P 726d96e241134d7e9e1851f2cee66d03: Time spent bootstrapping tablet: real 0.208s	user 0.048s	sys 0.048s
I20260709 13:23:53.610525 17452 raft_consensus.cc:359] T c2dd9bbf84cd4a0f918afc3a6e9f9d04 P 726d96e241134d7e9e1851f2cee66d03 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "726d96e241134d7e9e1851f2cee66d03" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 45087 } } peers { permanent_uuid: "316e9983905848079a8e6d9ce5585f46" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 39729 } } peers { permanent_uuid: "ee69eea1a5cc4645acdd4deaa9e0ac7f" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 41127 } }
I20260709 13:23:53.611564 17452 raft_consensus.cc:385] T c2dd9bbf84cd4a0f918afc3a6e9f9d04 P 726d96e241134d7e9e1851f2cee66d03 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:23:53.611943 17452 raft_consensus.cc:740] T c2dd9bbf84cd4a0f918afc3a6e9f9d04 P 726d96e241134d7e9e1851f2cee66d03 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 726d96e241134d7e9e1851f2cee66d03, State: Initialized, Role: FOLLOWER
I20260709 13:23:53.612946 17452 consensus_queue.cc:260] T c2dd9bbf84cd4a0f918afc3a6e9f9d04 P 726d96e241134d7e9e1851f2cee66d03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "726d96e241134d7e9e1851f2cee66d03" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 45087 } } peers { permanent_uuid: "316e9983905848079a8e6d9ce5585f46" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 39729 } } peers { permanent_uuid: "ee69eea1a5cc4645acdd4deaa9e0ac7f" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 41127 } }
I20260709 13:23:53.593475 17453 ts_tablet_manager.cc:1434] T 54bab860b0384e1bb5e75b8c8594e4a0 P 316e9983905848079a8e6d9ce5585f46: Time spent starting tablet: real 0.014s	user 0.007s	sys 0.000s
I20260709 13:23:53.593904 17462 leader_election.cc:290] T d87dace41fef4526a2cace8a5007919f P ee69eea1a5cc4645acdd4deaa9e0ac7f [CANDIDATE]: Term 1 election: Requested vote from peers 726d96e241134d7e9e1851f2cee66d03 (127.5.126.65:45087), 316e9983905848079a8e6d9ce5585f46 (127.5.126.66:39729)
I20260709 13:23:53.594089 17338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2dd9bbf84cd4a0f918afc3a6e9f9d04" candidate_uuid: "ee69eea1a5cc4645acdd4deaa9e0ac7f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "316e9983905848079a8e6d9ce5585f46" is_pre_election: true
I20260709 13:23:53.595459 17456 tablet_bootstrap.cc:492] T a01b9563aeb3401dbc60ad1647424d67 P ee69eea1a5cc4645acdd4deaa9e0ac7f: Bootstrap starting.
I20260709 13:23:53.616006 17452 ts_tablet_manager.cc:1434] T c2dd9bbf84cd4a0f918afc3a6e9f9d04 P 726d96e241134d7e9e1851f2cee66d03: Time spent starting tablet: real 0.009s	user 0.003s	sys 0.002s
I20260709 13:23:53.618587 17452 tablet_bootstrap.cc:492] T 54bab860b0384e1bb5e75b8c8594e4a0 P 726d96e241134d7e9e1851f2cee66d03: Bootstrap starting.
I20260709 13:23:53.596213 17264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d87dace41fef4526a2cace8a5007919f" candidate_uuid: "ee69eea1a5cc4645acdd4deaa9e0ac7f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "726d96e241134d7e9e1851f2cee66d03"
I20260709 13:23:53.620702 17264 raft_consensus.cc:3060] T d87dace41fef4526a2cace8a5007919f P 726d96e241134d7e9e1851f2cee66d03 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:23:53.617535 17453 tablet_bootstrap.cc:492] T c2dd9bbf84cd4a0f918afc3a6e9f9d04 P 316e9983905848079a8e6d9ce5585f46: Bootstrap starting.
I20260709 13:23:53.597150 17339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d87dace41fef4526a2cace8a5007919f" candidate_uuid: "ee69eea1a5cc4645acdd4deaa9e0ac7f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "316e9983905848079a8e6d9ce5585f46"
I20260709 13:23:53.624722 17339 raft_consensus.cc:3060] T d87dace41fef4526a2cace8a5007919f P 316e9983905848079a8e6d9ce5585f46 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:23:53.597759 17487 leader_election.cc:290] T c2dd9bbf84cd4a0f918afc3a6e9f9d04 P ee69eea1a5cc4645acdd4deaa9e0ac7f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 726d96e241134d7e9e1851f2cee66d03 (127.5.126.65:45087), 316e9983905848079a8e6d9ce5585f46 (127.5.126.66:39729)
I20260709 13:23:53.598469 17227 leader_election.cc:304] T 9d069857fc89437daad3f116d0fc7709 P 726d96e241134d7e9e1851f2cee66d03 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 316e9983905848079a8e6d9ce5585f46, 726d96e241134d7e9e1851f2cee66d03; no voters: ee69eea1a5cc4645acdd4deaa9e0ac7f
I20260709 13:23:53.600332 17261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d87dace41fef4526a2cace8a5007919f" candidate_uuid: "316e9983905848079a8e6d9ce5585f46" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "726d96e241134d7e9e1851f2cee66d03" is_pre_election: true
I20260709 13:23:53.600700 17262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0544fe20b9ca44b18589408ea98f4eed" candidate_uuid: "316e9983905848079a8e6d9ce5585f46" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "726d96e241134d7e9e1851f2cee66d03" is_pre_election: true
I20260709 13:23:53.628764 17453 tablet_bootstrap.cc:654] T c2dd9bbf84cd4a0f918afc3a6e9f9d04 P 316e9983905848079a8e6d9ce5585f46: Neither blocks nor log segments found. Creating new log.
I20260709 13:23:53.628937 17262 raft_consensus.cc:2468] T 0544fe20b9ca44b18589408ea98f4eed P 726d96e241134d7e9e1851f2cee66d03 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 316e9983905848079a8e6d9ce5585f46 in term 0.
I20260709 13:23:53.629433 17477 raft_consensus.cc:2804] T 9d069857fc89437daad3f116d0fc7709 P 726d96e241134d7e9e1851f2cee66d03 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:23:53.599946 17263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d069857fc89437daad3f116d0fc7709" candidate_uuid: "316e9983905848079a8e6d9ce5585f46" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "726d96e241134d7e9e1851f2cee66d03" is_pre_election: true
I20260709 13:23:53.605557 17488 raft_consensus.cc:515] T 0544fe20b9ca44b18589408ea98f4eed P ee69eea1a5cc4645acdd4deaa9e0ac7f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "726d96e241134d7e9e1851f2cee66d03" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 45087 } } peers { permanent_uuid: "316e9983905848079a8e6d9ce5585f46" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 39729 } } peers { permanent_uuid: "ee69eea1a5cc4645acdd4deaa9e0ac7f" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 41127 } }
I20260709 13:23:53.630131 17477 raft_consensus.cc:697] T 9d069857fc89437daad3f116d0fc7709 P 726d96e241134d7e9e1851f2cee66d03 [term 1 LEADER]: Becoming Leader. State: Replica: 726d96e241134d7e9e1851f2cee66d03, State: Running, Role: LEADER
I20260709 13:23:53.631217 17477 consensus_queue.cc:237] T 9d069857fc89437daad3f116d0fc7709 P 726d96e241134d7e9e1851f2cee66d03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "726d96e241134d7e9e1851f2cee66d03" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 45087 } } peers { permanent_uuid: "316e9983905848079a8e6d9ce5585f46" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 39729 } } peers { permanent_uuid: "ee69eea1a5cc4645acdd4deaa9e0ac7f" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 41127 } }
I20260709 13:23:53.632831 17488 leader_election.cc:290] T 0544fe20b9ca44b18589408ea98f4eed P ee69eea1a5cc4645acdd4deaa9e0ac7f [CANDIDATE]: Term 1 election: Requested vote from peers 726d96e241134d7e9e1851f2cee66d03 (127.5.126.65:45087), 316e9983905848079a8e6d9ce5585f46 (127.5.126.66:39729)
I20260709 13:23:53.638237 17337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0544fe20b9ca44b18589408ea98f4eed" candidate_uuid: "ee69eea1a5cc4645acdd4deaa9e0ac7f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "316e9983905848079a8e6d9ce5585f46"
I20260709 13:23:53.639247 17337 raft_consensus.cc:3060] T 0544fe20b9ca44b18589408ea98f4eed P 316e9983905848079a8e6d9ce5585f46 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:23:53.640539 17412 raft_consensus.cc:2393] T 0544fe20b9ca44b18589408ea98f4eed P ee69eea1a5cc4645acdd4deaa9e0ac7f [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 316e9983905848079a8e6d9ce5585f46 in current term 1: Already voted for candidate ee69eea1a5cc4645acdd4deaa9e0ac7f in this term.
W20260709 13:23:53.644876 17376 leader_election.cc:343] T c2dd9bbf84cd4a0f918afc3a6e9f9d04 P ee69eea1a5cc4645acdd4deaa9e0ac7f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 316e9983905848079a8e6d9ce5585f46 (127.5.126.66:39729): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:23:53.645565 17376 leader_election.cc:304] T c2dd9bbf84cd4a0f918afc3a6e9f9d04 P ee69eea1a5cc4645acdd4deaa9e0ac7f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee69eea1a5cc4645acdd4deaa9e0ac7f; no voters: 316e9983905848079a8e6d9ce5585f46, 726d96e241134d7e9e1851f2cee66d03
I20260709 13:23:53.648656 17305 leader_election.cc:304] T d87dace41fef4526a2cace8a5007919f P 316e9983905848079a8e6d9ce5585f46 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 316e9983905848079a8e6d9ce5585f46; no voters: 726d96e241134d7e9e1851f2cee66d03, ee69eea1a5cc4645acdd4deaa9e0ac7f
I20260709 13:23:53.652493 17262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0544fe20b9ca44b18589408ea98f4eed" candidate_uuid: "ee69eea1a5cc4645acdd4deaa9e0ac7f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "726d96e241134d7e9e1851f2cee66d03"
I20260709 13:23:53.659701 17488 raft_consensus.cc:2749] T c2dd9bbf84cd4a0f918afc3a6e9f9d04 P ee69eea1a5cc4645acdd4deaa9e0ac7f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:23:53.653481 17262 raft_consensus.cc:3060] T 0544fe20b9ca44b18589408ea98f4eed P 726d96e241134d7e9e1851f2cee66d03 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:23:53.690814 17376 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.66:39729, user_credentials={real_user=slave}} blocked reactor thread for 45993.3us
I20260709 13:23:53.692251 17452 tablet_bootstrap.cc:654] T 54bab860b0384e1bb5e75b8c8594e4a0 P 726d96e241134d7e9e1851f2cee66d03: Neither blocks nor log segments found. Creating new log.
I20260709 13:23:53.692523 17488 raft_consensus.cc:493] T 54bab860b0384e1bb5e75b8c8594e4a0 P ee69eea1a5cc4645acdd4deaa9e0ac7f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:23:53.693168 17305 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.65:45087, user_credentials={real_user=slave}} blocked reactor thread for 44861.1us
I20260709 13:23:53.698823 17488 raft_consensus.cc:515] T 54bab860b0384e1bb5e75b8c8594e4a0 P ee69eea1a5cc4645acdd4deaa9e0ac7f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "726d96e241134d7e9e1851f2cee66d03" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 45087 } } peers { permanent_uuid: "316e9983905848079a8e6d9ce5585f46" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 39729 } } peers { permanent_uuid: "ee69eea1a5cc4645acdd4deaa9e0ac7f" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 41127 } }
I20260709 13:23:53.699684 17494 raft_consensus.cc:493] T a01b9563aeb3401dbc60ad1647424d67 P 316e9983905848079a8e6d9ce5585f46 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:23:53.702606 17488 leader_election.cc:290] T 54bab860b0384e1bb5e75b8c8594e4a0 P ee69eea1a5cc4645acdd4deaa9e0ac7f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 726d96e241134d7e9e1851f2cee66d03 (127.5.126.65:45087), 316e9983905848079a8e6d9ce5585f46 (127.5.126.66:39729)
W20260709 13:23:53.702826 17227 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:41127, user_credentials={real_user=slave}} blocked reactor thread for 73940.4us
I20260709 13:23:53.699862 17305 leader_election.cc:304] T 0544fe20b9ca44b18589408ea98f4eed P 316e9983905848079a8e6d9ce5585f46 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 316e9983905848079a8e6d9ce5585f46, 726d96e241134d7e9e1851f2cee66d03; no voters: ee69eea1a5cc4645acdd4deaa9e0ac7f
I20260709 13:23:53.706571 17263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54bab860b0384e1bb5e75b8c8594e4a0" candidate_uuid: "ee69eea1a5cc4645acdd4deaa9e0ac7f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "726d96e241134d7e9e1851f2cee66d03" is_pre_election: true
W20260709 13:23:53.712430 17379 leader_election.cc:343] T 54bab860b0384e1bb5e75b8c8594e4a0 P ee69eea1a5cc4645acdd4deaa9e0ac7f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 726d96e241134d7e9e1851f2cee66d03 (127.5.126.65:45087): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:23:53.712626 17452 tablet_bootstrap.cc:492] T 54bab860b0384e1bb5e75b8c8594e4a0 P 726d96e241134d7e9e1851f2cee66d03: No bootstrap required, opened a new log
I20260709 13:23:53.713281 17452 ts_tablet_manager.cc:1403] T 54bab860b0384e1bb5e75b8c8594e4a0 P 726d96e241134d7e9e1851f2cee66d03: Time spent bootstrapping tablet: real 0.095s	user 0.012s	sys 0.021s
I20260709 13:23:53.714776 17339 raft_consensus.cc:2468] T d87dace41fef4526a2cace8a5007919f P 316e9983905848079a8e6d9ce5585f46 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee69eea1a5cc4645acdd4deaa9e0ac7f in term 1.
I20260709 13:23:53.715504 17458 raft_consensus.cc:2749] T d87dace41fef4526a2cace8a5007919f P 316e9983905848079a8e6d9ce5585f46 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:23:53.700249 17494 raft_consensus.cc:515] T a01b9563aeb3401dbc60ad1647424d67 P 316e9983905848079a8e6d9ce5585f46 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "726d96e241134d7e9e1851f2cee66d03" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 45087 } } peers { permanent_uuid: "316e9983905848079a8e6d9ce5585f46" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 39729 } } peers { permanent_uuid: "ee69eea1a5cc4645acdd4deaa9e0ac7f" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 41127 } }
I20260709 13:23:53.717003 17456 tablet_bootstrap.cc:654] T a01b9563aeb3401dbc60ad1647424d67 P ee69eea1a5cc4645acdd4deaa9e0ac7f: Neither blocks nor log segments found. Creating new log.
I20260709 13:23:53.716908 17452 raft_consensus.cc:359] T 54bab860b0384e1bb5e75b8c8594e4a0 P 726d96e241134d7e9e1851f2cee66d03 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "726d96e241134d7e9e1851f2cee66d03" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 45087 } } peers { permanent_uuid: "316e9983905848079a8e6d9ce5585f46" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 39729 } } peers { permanent_uuid: "ee69eea1a5cc4645acdd4deaa9e0ac7f" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 41127 } }
I20260709 13:23:53.721935 17376 leader_election.cc:304] T d87dace41fef4526a2cace8a5007919f P ee69eea1a5cc4645acdd4deaa9e0ac7f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 316e9983905848079a8e6d9ce5585f46, ee69eea1a5cc4645acdd4deaa9e0ac7f; no voters: 
I20260709 13:23:53.714776 17262 raft_consensus.cc:2468] T 0544fe20b9ca44b18589408ea98f4eed P 726d96e241134d7e9e1851f2cee66d03 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee69eea1a5cc4645acdd4deaa9e0ac7f in term 1.
I20260709 13:23:53.722977 17452 raft_consensus.cc:385] T 54bab860b0384e1bb5e75b8c8594e4a0 P 726d96e241134d7e9e1851f2cee66d03 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:23:53.723784 17452 raft_consensus.cc:740] T 54bab860b0384e1bb5e75b8c8594e4a0 P 726d96e241134d7e9e1851f2cee66d03 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 726d96e241134d7e9e1851f2cee66d03, State: Initialized, Role: FOLLOWER
I20260709 13:23:53.723753 17488 raft_consensus.cc:2804] T d87dace41fef4526a2cace8a5007919f P ee69eea1a5cc4645acdd4deaa9e0ac7f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:23:53.725086 17488 raft_consensus.cc:697] T d87dace41fef4526a2cace8a5007919f P ee69eea1a5cc4645acdd4deaa9e0ac7f [term 1 LEADER]: Becoming Leader. State: Replica: ee69eea1a5cc4645acdd4deaa9e0ac7f, State: Running, Role: LEADER
I20260709 13:23:53.727272 17379 leader_election.cc:304] T 0544fe20b9ca44b18589408ea98f4eed P ee69eea1a5cc4645acdd4deaa9e0ac7f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 726d96e241134d7e9e1851f2cee66d03, ee69eea1a5cc4645acdd4deaa9e0ac7f; no voters: 
I20260709 13:23:53.727818 17262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a01b9563aeb3401dbc60ad1647424d67" candidate_uuid: "316e9983905848079a8e6d9ce5585f46" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "726d96e241134d7e9e1851f2cee66d03" is_pre_election: true
I20260709 13:23:53.728291 17264 raft_consensus.cc:2468] T d87dace41fef4526a2cace8a5007919f P 726d96e241134d7e9e1851f2cee66d03 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee69eea1a5cc4645acdd4deaa9e0ac7f in term 1.
I20260709 13:23:53.728387 17412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a01b9563aeb3401dbc60ad1647424d67" candidate_uuid: "316e9983905848079a8e6d9ce5585f46" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee69eea1a5cc4645acdd4deaa9e0ac7f" is_pre_election: true
I20260709 13:23:53.725068 17494 leader_election.cc:290] T a01b9563aeb3401dbc60ad1647424d67 P 316e9983905848079a8e6d9ce5585f46 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 726d96e241134d7e9e1851f2cee66d03 (127.5.126.65:45087), ee69eea1a5cc4645acdd4deaa9e0ac7f (127.5.126.67:41127)
I20260709 13:23:53.727914 17488 consensus_queue.cc:237] T d87dace41fef4526a2cace8a5007919f P ee69eea1a5cc4645acdd4deaa9e0ac7f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "726d96e241134d7e9e1851f2cee66d03" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 45087 } } peers { permanent_uuid: "316e9983905848079a8e6d9ce5585f46" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 39729 } } peers { permanent_uuid: "ee69eea1a5cc4645acdd4deaa9e0ac7f" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 41127 } }
W20260709 13:23:53.730491 17305 leader_election.cc:343] T a01b9563aeb3401dbc60ad1647424d67 P 316e9983905848079a8e6d9ce5585f46 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 726d96e241134d7e9e1851f2cee66d03 (127.5.126.65:45087): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:23:53.732308 17339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54bab860b0384e1bb5e75b8c8594e4a0" candidate_uuid: "ee69eea1a5cc4645acdd4deaa9e0ac7f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "316e9983905848079a8e6d9ce5585f46" is_pre_election: true
W20260709 13:23:53.735780 17302 leader_election.cc:343] T a01b9563aeb3401dbc60ad1647424d67 P 316e9983905848079a8e6d9ce5585f46 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ee69eea1a5cc4645acdd4deaa9e0ac7f (127.5.126.67:41127): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:23:53.736230 17339 raft_consensus.cc:2468] T 54bab860b0384e1bb5e75b8c8594e4a0 P 316e9983905848079a8e6d9ce5585f46 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee69eea1a5cc4645acdd4deaa9e0ac7f in term 0.
I20260709 13:23:53.736624 17302 leader_election.cc:304] T a01b9563aeb3401dbc60ad1647424d67 P 316e9983905848079a8e6d9ce5585f46 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 316e9983905848079a8e6d9ce5585f46; no voters: 726d96e241134d7e9e1851f2cee66d03, ee69eea1a5cc4645acdd4deaa9e0ac7f
I20260709 13:23:53.737768 17376 leader_election.cc:304] T 54bab860b0384e1bb5e75b8c8594e4a0 P ee69eea1a5cc4645acdd4deaa9e0ac7f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 316e9983905848079a8e6d9ce5585f46, ee69eea1a5cc4645acdd4deaa9e0ac7f; no voters: 726d96e241134d7e9e1851f2cee66d03
I20260709 13:23:53.732949 17487 raft_consensus.cc:2804] T 0544fe20b9ca44b18589408ea98f4eed P ee69eea1a5cc4645acdd4deaa9e0ac7f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:23:53.738670 17462 raft_consensus.cc:2804] T 54bab860b0384e1bb5e75b8c8594e4a0 P ee69eea1a5cc4645acdd4deaa9e0ac7f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:23:53.738749 17487 raft_consensus.cc:697] T 0544fe20b9ca44b18589408ea98f4eed P ee69eea1a5cc4645acdd4deaa9e0ac7f [term 1 LEADER]: Becoming Leader. State: Replica: ee69eea1a5cc4645acdd4deaa9e0ac7f, State: Running, Role: LEADER
I20260709 13:23:53.739115 17462 raft_consensus.cc:493] T 54bab860b0384e1bb5e75b8c8594e4a0 P ee69eea1a5cc4645acdd4deaa9e0ac7f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:23:53.739687 17462 raft_consensus.cc:3060] T 54bab860b0384e1bb5e75b8c8594e4a0 P ee69eea1a5cc4645acdd4deaa9e0ac7f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:23:53.739984 17487 consensus_queue.cc:237] T 0544fe20b9ca44b18589408ea98f4eed P ee69eea1a5cc4645acdd4deaa9e0ac7f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "726d96e241134d7e9e1851f2cee66d03" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 45087 } } peers { permanent_uuid: "316e9983905848079a8e6d9ce5585f46" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 39729 } } peers { permanent_uuid: "ee69eea1a5cc4645acdd4deaa9e0ac7f" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 41127 } }
I20260709 13:23:53.741133 17337 raft_consensus.cc:2468] T 0544fe20b9ca44b18589408ea98f4eed P 316e9983905848079a8e6d9ce5585f46 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee69eea1a5cc4645acdd4deaa9e0ac7f in term 1.
I20260709 13:23:53.741691 17458 raft_consensus.cc:2764] T 0544fe20b9ca44b18589408ea98f4eed P 316e9983905848079a8e6d9ce5585f46 [term 1 FOLLOWER]: Leader pre-election decision vote started in defunct term 0: won
I20260709 13:23:53.739077 17494 raft_consensus.cc:2749] T a01b9563aeb3401dbc60ad1647424d67 P 316e9983905848079a8e6d9ce5585f46 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:23:53.725366 17477 raft_consensus.cc:493] T c2dd9bbf84cd4a0f918afc3a6e9f9d04 P 726d96e241134d7e9e1851f2cee66d03 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:23:53.743857 17477 raft_consensus.cc:515] T c2dd9bbf84cd4a0f918afc3a6e9f9d04 P 726d96e241134d7e9e1851f2cee66d03 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "726d96e241134d7e9e1851f2cee66d03" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 45087 } } peers { permanent_uuid: "316e9983905848079a8e6d9ce5585f46" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 39729 } } peers { permanent_uuid: "ee69eea1a5cc4645acdd4deaa9e0ac7f" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 41127 } }
I20260709 13:23:53.744256 17452 consensus_queue.cc:260] T 54bab860b0384e1bb5e75b8c8594e4a0 P 726d96e241134d7e9e1851f2cee66d03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "726d96e241134d7e9e1851f2cee66d03" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 45087 } } peers { permanent_uuid: "316e9983905848079a8e6d9ce5585f46" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 39729 } } peers { permanent_uuid: "ee69eea1a5cc4645acdd4deaa9e0ac7f" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 41127 } }
I20260709 13:23:53.735363 17161 catalog_manager.cc:5697] T a3211f7bc1aa4d949b49f0c23362b0d5 P 726d96e241134d7e9e1851f2cee66d03 reported cstate change: term changed from 0 to 1, leader changed from <none> to 726d96e241134d7e9e1851f2cee66d03 (127.5.126.65). New cstate: current_term: 1 leader_uuid: "726d96e241134d7e9e1851f2cee66d03" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "726d96e241134d7e9e1851f2cee66d03" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 45087 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "316e9983905848079a8e6d9ce5585f46" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 39729 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ee69eea1a5cc4645acdd4deaa9e0ac7f" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 41127 } health_report { overall_health: UNKNOWN } } }
I20260709 13:23:53.749298 17161 catalog_manager.cc:5697] T 9d069857fc89437daad3f116d0fc7709 P 726d96e241134d7e9e1851f2cee66d03 reported cstate change: term changed from 0 to 1, leader changed from <none> to 726d96e241134d7e9e1851f2cee66d03 (127.5.126.65). New cstate: current_term: 1 leader_uuid: "726d96e241134d7e9e1851f2cee66d03" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "726d96e241134d7e9e1851f2cee66d03" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 45087 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "316e9983905848079a8e6d9ce5585f46" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 39729 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ee69eea1a5cc4645acdd4deaa9e0ac7f" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 41127 } health_report { overall_health: UNKNOWN } } }
I20260709 13:23:53.750674 17477 leader_election.cc:290] T c2dd9bbf84cd4a0f918afc3a6e9f9d04 P 726d96e241134d7e9e1851f2cee66d03 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 316e9983905848079a8e6d9ce5585f46 (127.5.126.66:39729), ee69eea1a5cc4645acdd4deaa9e0ac7f (127.5.126.67:41127)
I20260709 13:23:53.752451 17412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2dd9bbf84cd4a0f918afc3a6e9f9d04" candidate_uuid: "726d96e241134d7e9e1851f2cee66d03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee69eea1a5cc4645acdd4deaa9e0ac7f" is_pre_election: true
I20260709 13:23:53.753185 17412 raft_consensus.cc:2468] T c2dd9bbf84cd4a0f918afc3a6e9f9d04 P ee69eea1a5cc4645acdd4deaa9e0ac7f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 726d96e241134d7e9e1851f2cee66d03 in term 0.
I20260709 13:23:53.753767 17452 ts_tablet_manager.cc:1434] T 54bab860b0384e1bb5e75b8c8594e4a0 P 726d96e241134d7e9e1851f2cee66d03: Time spent starting tablet: real 0.040s	user 0.008s	sys 0.000s
I20260709 13:23:53.750283 17453 tablet_bootstrap.cc:492] T c2dd9bbf84cd4a0f918afc3a6e9f9d04 P 316e9983905848079a8e6d9ce5585f46: No bootstrap required, opened a new log
I20260709 13:23:53.755049 17452 tablet_bootstrap.cc:492] T a01b9563aeb3401dbc60ad1647424d67 P 726d96e241134d7e9e1851f2cee66d03: Bootstrap starting.
I20260709 13:23:53.755492 17453 ts_tablet_manager.cc:1403] T c2dd9bbf84cd4a0f918afc3a6e9f9d04 P 316e9983905848079a8e6d9ce5585f46: Time spent bootstrapping tablet: real 0.138s	user 0.019s	sys 0.022s
I20260709 13:23:53.755863 17462 raft_consensus.cc:515] T 54bab860b0384e1bb5e75b8c8594e4a0 P ee69eea1a5cc4645acdd4deaa9e0ac7f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "726d96e241134d7e9e1851f2cee66d03" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 45087 } } peers { permanent_uuid: "316e9983905848079a8e6d9ce5585f46" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 39729 } } peers { permanent_uuid: "ee69eea1a5cc4645acdd4deaa9e0ac7f" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 41127 } }
I20260709 13:23:53.757721 17159 catalog_manager.cc:5697] T d87dace41fef4526a2cace8a5007919f P ee69eea1a5cc4645acdd4deaa9e0ac7f reported cstate change: term changed from 0 to 1, leader changed from <none> to ee69eea1a5cc4645acdd4deaa9e0ac7f (127.5.126.67). New cstate: current_term: 1 leader_uuid: "ee69eea1a5cc4645acdd4deaa9e0ac7f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "726d96e241134d7e9e1851f2cee66d03" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 45087 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "316e9983905848079a8e6d9ce5585f46" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 39729 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ee69eea1a5cc4645acdd4deaa9e0ac7f" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 41127 } health_report { overall_health: HEALTHY } } }
I20260709 13:23:53.758754 17453 raft_consensus.cc:359] T c2dd9bbf84cd4a0f918afc3a6e9f9d04 P 316e9983905848079a8e6d9ce5585f46 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "726d96e241134d7e9e1851f2cee66d03" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 45087 } } peers { permanent_uuid: "316e9983905848079a8e6d9ce5585f46" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 39729 } } peers { permanent_uuid: "ee69eea1a5cc4645acdd4deaa9e0ac7f" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 41127 } }
I20260709 13:23:53.760746 17453 raft_consensus.cc:385] T c2dd9bbf84cd4a0f918afc3a6e9f9d04 P 316e9983905848079a8e6d9ce5585f46 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:23:53.761246 17453 raft_consensus.cc:740] T c2dd9bbf84cd4a0f918afc3a6e9f9d04 P 316e9983905848079a8e6d9ce5585f46 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 316e9983905848079a8e6d9ce5585f46, State: Initialized, Role: FOLLOWER
I20260709 13:23:53.762607 17453 consensus_queue.cc:260] T c2dd9bbf84cd4a0f918afc3a6e9f9d04 P 316e9983905848079a8e6d9ce5585f46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "726d96e241134d7e9e1851f2cee66d03" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 45087 } } peers { permanent_uuid: "316e9983905848079a8e6d9ce5585f46" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 39729 } } peers { permanent_uuid: "ee69eea1a5cc4645acdd4deaa9e0ac7f" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 41127 } }
I20260709 13:23:53.767187 17452 tablet_bootstrap.cc:654] T a01b9563aeb3401dbc60ad1647424d67 P 726d96e241134d7e9e1851f2cee66d03: Neither blocks nor log segments found. Creating new log.
I20260709 13:23:53.760790 17227 leader_election.cc:304] T c2dd9bbf84cd4a0f918afc3a6e9f9d04 P 726d96e241134d7e9e1851f2cee66d03 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 726d96e241134d7e9e1851f2cee66d03, ee69eea1a5cc4645acdd4deaa9e0ac7f; no voters: 
I20260709 13:23:53.768704 17477 raft_consensus.cc:2804] T c2dd9bbf84cd4a0f918afc3a6e9f9d04 P 726d96e241134d7e9e1851f2cee66d03 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:23:53.769152 17477 raft_consensus.cc:493] T c2dd9bbf84cd4a0f918afc3a6e9f9d04 P 726d96e241134d7e9e1851f2cee66d03 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:23:53.769915 17477 raft_consensus.cc:3060] T c2dd9bbf84cd4a0f918afc3a6e9f9d04 P 726d96e241134d7e9e1851f2cee66d03 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:23:53.769037 17337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2dd9bbf84cd4a0f918afc3a6e9f9d04" candidate_uuid: "726d96e241134d7e9e1851f2cee66d03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "316e9983905848079a8e6d9ce5585f46" is_pre_election: true
I20260709 13:23:53.771756 17337 raft_consensus.cc:2468] T c2dd9bbf84cd4a0f918afc3a6e9f9d04 P 316e9983905848079a8e6d9ce5585f46 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 726d96e241134d7e9e1851f2cee66d03 in term 0.
I20260709 13:23:53.759187 17264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54bab860b0384e1bb5e75b8c8594e4a0" candidate_uuid: "ee69eea1a5cc4645acdd4deaa9e0ac7f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "726d96e241134d7e9e1851f2cee66d03"
I20260709 13:23:53.773408 17264 raft_consensus.cc:3060] T 54bab860b0384e1bb5e75b8c8594e4a0 P 726d96e241134d7e9e1851f2cee66d03 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:23:53.777760 17453 ts_tablet_manager.cc:1434] T c2dd9bbf84cd4a0f918afc3a6e9f9d04 P 316e9983905848079a8e6d9ce5585f46: Time spent starting tablet: real 0.022s	user 0.004s	sys 0.004s
I20260709 13:23:53.779348 17453 tablet_bootstrap.cc:492] T 3c97f32b7fa24e109d2c993bee4cacdc P 316e9983905848079a8e6d9ce5585f46: Bootstrap starting.
I20260709 13:23:53.790503 17453 tablet_bootstrap.cc:654] T 3c97f32b7fa24e109d2c993bee4cacdc P 316e9983905848079a8e6d9ce5585f46: Neither blocks nor log segments found. Creating new log.
I20260709 13:23:53.818074 17462 leader_election.cc:290] T 54bab860b0384e1bb5e75b8c8594e4a0 P ee69eea1a5cc4645acdd4deaa9e0ac7f [CANDIDATE]: Term 1 election: Requested vote from peers 726d96e241134d7e9e1851f2cee66d03 (127.5.126.65:45087), 316e9983905848079a8e6d9ce5585f46 (127.5.126.66:39729)
I20260709 13:23:53.819469 17337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54bab860b0384e1bb5e75b8c8594e4a0" candidate_uuid: "ee69eea1a5cc4645acdd4deaa9e0ac7f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "316e9983905848079a8e6d9ce5585f46"
I20260709 13:23:53.820019 17264 raft_consensus.cc:2468] T 54bab860b0384e1bb5e75b8c8594e4a0 P 726d96e241134d7e9e1851f2cee66d03 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee69eea1a5cc4645acdd4deaa9e0ac7f in term 1.
I20260709 13:23:53.820269 17337 raft_consensus.cc:3060] T 54bab860b0384e1bb5e75b8c8594e4a0 P 316e9983905848079a8e6d9ce5585f46 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:23:53.821158 17452 tablet_bootstrap.cc:492] T a01b9563aeb3401dbc60ad1647424d67 P 726d96e241134d7e9e1851f2cee66d03: No bootstrap required, opened a new log
I20260709 13:23:53.821743 17452 ts_tablet_manager.cc:1403] T a01b9563aeb3401dbc60ad1647424d67 P 726d96e241134d7e9e1851f2cee66d03: Time spent bootstrapping tablet: real 0.067s	user 0.022s	sys 0.030s
I20260709 13:23:53.822465 17456 tablet_bootstrap.cc:492] T a01b9563aeb3401dbc60ad1647424d67 P ee69eea1a5cc4645acdd4deaa9e0ac7f: No bootstrap required, opened a new log
I20260709 13:23:53.823033 17456 ts_tablet_manager.cc:1403] T a01b9563aeb3401dbc60ad1647424d67 P ee69eea1a5cc4645acdd4deaa9e0ac7f: Time spent bootstrapping tablet: real 0.228s	user 0.020s	sys 0.016s
I20260709 13:23:53.824800 17452 raft_consensus.cc:359] T a01b9563aeb3401dbc60ad1647424d67 P 726d96e241134d7e9e1851f2cee66d03 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "726d96e241134d7e9e1851f2cee66d03" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 45087 } } peers { permanent_uuid: "316e9983905848079a8e6d9ce5585f46" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 39729 } } peers { permanent_uuid: "ee69eea1a5cc4645acdd4deaa9e0ac7f" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 41127 } }
I20260709 13:23:53.825592 17452 raft_consensus.cc:385] T a01b9563aeb3401dbc60ad1647424d67 P 726d96e241134d7e9e1851f2cee66d03 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:23:53.825904 17452 raft_consensus.cc:740] T a01b9563aeb3401dbc60ad1647424d67 P 726d96e241134d7e9e1851f2cee66d03 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 726d96e241134d7e9e1851f2cee66d03, State: Initialized, Role: FOLLOWER
I20260709 13:23:53.826611 17456 raft_consensus.cc:359] T a01b9563aeb3401dbc60ad1647424d67 P ee69eea1a5cc4645acdd4deaa9e0ac7f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "726d96e241134d7e9e1851f2cee66d03" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 45087 } } peers { permanent_uuid: "316e9983905848079a8e6d9ce5585f46" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 39729 } } peers { permanent_uuid: "ee69eea1a5cc4645acdd4deaa9e0ac7f" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 41127 } }
I20260709 13:23:53.826740 17452 consensus_queue.cc:260] T a01b9563aeb3401dbc60ad1647424d67 P 726d96e241134d7e9e1851f2cee66d03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "726d96e241134d7e9e1851f2cee66d03" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 45087 } } peers { permanent_uuid: "316e9983905848079a8e6d9ce5585f46" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 39729 } } peers { permanent_uuid: "ee69eea1a5cc4645acdd4deaa9e0ac7f" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 41127 } }
I20260709 13:23:53.827363 17379 leader_election.cc:304] T 54bab860b0384e1bb5e75b8c8594e4a0 P ee69eea1a5cc4645acdd4deaa9e0ac7f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 726d96e241134d7e9e1851f2cee66d03, ee69eea1a5cc4645acdd4deaa9e0ac7f; no voters: 
I20260709 13:23:53.827682 17456 raft_consensus.cc:385] T a01b9563aeb3401dbc60ad1647424d67 P ee69eea1a5cc4645acdd4deaa9e0ac7f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:23:53.828215 17456 raft_consensus.cc:740] T a01b9563aeb3401dbc60ad1647424d67 P ee69eea1a5cc4645acdd4deaa9e0ac7f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ee69eea1a5cc4645acdd4deaa9e0ac7f, State: Initialized, Role: FOLLOWER
I20260709 13:23:53.829232 17452 ts_tablet_manager.cc:1434] T a01b9563aeb3401dbc60ad1647424d67 P 726d96e241134d7e9e1851f2cee66d03: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:23:53.818681 17162 catalog_manager.cc:5697] T 0544fe20b9ca44b18589408ea98f4eed P ee69eea1a5cc4645acdd4deaa9e0ac7f reported cstate change: term changed from 0 to 1, leader changed from <none> to ee69eea1a5cc4645acdd4deaa9e0ac7f (127.5.126.67). New cstate: current_term: 1 leader_uuid: "ee69eea1a5cc4645acdd4deaa9e0ac7f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "726d96e241134d7e9e1851f2cee66d03" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 45087 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "316e9983905848079a8e6d9ce5585f46" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 39729 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ee69eea1a5cc4645acdd4deaa9e0ac7f" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 41127 } health_report { overall_health: HEALTHY } } }
I20260709 13:23:53.829246 17456 consensus_queue.cc:260] T a01b9563aeb3401dbc60ad1647424d67 P ee69eea1a5cc4645acdd4deaa9e0ac7f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "726d96e241134d7e9e1851f2cee66d03" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 45087 } } peers { permanent_uuid: "316e9983905848079a8e6d9ce5585f46" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 39729 } } peers { permanent_uuid: "ee69eea1a5cc4645acdd4deaa9e0ac7f" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 41127 } }
I20260709 13:23:53.830371 17452 tablet_bootstrap.cc:492] T 3c97f32b7fa24e109d2c993bee4cacdc P 726d96e241134d7e9e1851f2cee66d03: Bootstrap starting.
I20260709 13:23:53.829421 17462 raft_consensus.cc:2804] T 54bab860b0384e1bb5e75b8c8594e4a0 P ee69eea1a5cc4645acdd4deaa9e0ac7f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:23:53.819629 17477 raft_consensus.cc:515] T c2dd9bbf84cd4a0f918afc3a6e9f9d04 P 726d96e241134d7e9e1851f2cee66d03 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "726d96e241134d7e9e1851f2cee66d03" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 45087 } } peers { permanent_uuid: "316e9983905848079a8e6d9ce5585f46" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 39729 } } peers { permanent_uuid: "ee69eea1a5cc4645acdd4deaa9e0ac7f" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 41127 } }
I20260709 13:23:53.837129 17339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2dd9bbf84cd4a0f918afc3a6e9f9d04" candidate_uuid: "726d96e241134d7e9e1851f2cee66d03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "316e9983905848079a8e6d9ce5585f46"
I20260709 13:23:53.840431 17452 tablet_bootstrap.cc:654] T 3c97f32b7fa24e109d2c993bee4cacdc P 726d96e241134d7e9e1851f2cee66d03: Neither blocks nor log segments found. Creating new log.
I20260709 13:23:53.839695 17412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2dd9bbf84cd4a0f918afc3a6e9f9d04" candidate_uuid: "726d96e241134d7e9e1851f2cee66d03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee69eea1a5cc4645acdd4deaa9e0ac7f"
I20260709 13:23:53.840906 17339 raft_consensus.cc:3060] T c2dd9bbf84cd4a0f918afc3a6e9f9d04 P 316e9983905848079a8e6d9ce5585f46 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:23:53.841077 17412 raft_consensus.cc:3060] T c2dd9bbf84cd4a0f918afc3a6e9f9d04 P ee69eea1a5cc4645acdd4deaa9e0ac7f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:23:53.833343 17462 raft_consensus.cc:697] T 54bab860b0384e1bb5e75b8c8594e4a0 P ee69eea1a5cc4645acdd4deaa9e0ac7f [term 1 LEADER]: Becoming Leader. State: Replica: ee69eea1a5cc4645acdd4deaa9e0ac7f, State: Running, Role: LEADER
I20260709 13:23:53.838156 17453 tablet_bootstrap.cc:492] T 3c97f32b7fa24e109d2c993bee4cacdc P 316e9983905848079a8e6d9ce5585f46: No bootstrap required, opened a new log
I20260709 13:23:53.847894 17452 tablet_bootstrap.cc:492] T 3c97f32b7fa24e109d2c993bee4cacdc P 726d96e241134d7e9e1851f2cee66d03: No bootstrap required, opened a new log
I20260709 13:23:53.848455 17453 ts_tablet_manager.cc:1403] T 3c97f32b7fa24e109d2c993bee4cacdc P 316e9983905848079a8e6d9ce5585f46: Time spent bootstrapping tablet: real 0.069s	user 0.010s	sys 0.011s
I20260709 13:23:53.848598 17452 ts_tablet_manager.cc:1403] T 3c97f32b7fa24e109d2c993bee4cacdc P 726d96e241134d7e9e1851f2cee66d03: Time spent bootstrapping tablet: real 0.018s	user 0.014s	sys 0.003s
I20260709 13:23:53.849300 17412 raft_consensus.cc:2468] T c2dd9bbf84cd4a0f918afc3a6e9f9d04 P ee69eea1a5cc4645acdd4deaa9e0ac7f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 726d96e241134d7e9e1851f2cee66d03 in term 1.
I20260709 13:23:53.849850 17339 raft_consensus.cc:2468] T c2dd9bbf84cd4a0f918afc3a6e9f9d04 P 316e9983905848079a8e6d9ce5585f46 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 726d96e241134d7e9e1851f2cee66d03 in term 1.
I20260709 13:23:53.850595 17227 leader_election.cc:304] T c2dd9bbf84cd4a0f918afc3a6e9f9d04 P 726d96e241134d7e9e1851f2cee66d03 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 726d96e241134d7e9e1851f2cee66d03, ee69eea1a5cc4645acdd4deaa9e0ac7f; no voters: 
I20260709 13:23:53.832594 17456 ts_tablet_manager.cc:1434] T a01b9563aeb3401dbc60ad1647424d67 P ee69eea1a5cc4645acdd4deaa9e0ac7f: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.004s
I20260709 13:23:53.851526 17457 raft_consensus.cc:2804] T c2dd9bbf84cd4a0f918afc3a6e9f9d04 P 726d96e241134d7e9e1851f2cee66d03 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:23:53.847530 17462 consensus_queue.cc:237] T 54bab860b0384e1bb5e75b8c8594e4a0 P ee69eea1a5cc4645acdd4deaa9e0ac7f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "726d96e241134d7e9e1851f2cee66d03" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 45087 } } peers { permanent_uuid: "316e9983905848079a8e6d9ce5585f46" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 39729 } } peers { permanent_uuid: "ee69eea1a5cc4645acdd4deaa9e0ac7f" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 41127 } }
I20260709 13:23:53.839488 17477 leader_election.cc:290] T c2dd9bbf84cd4a0f918afc3a6e9f9d04 P 726d96e241134d7e9e1851f2cee66d03 [CANDIDATE]: Term 1 election: Requested vote from peers 316e9983905848079a8e6d9ce5585f46 (127.5.126.66:39729), ee69eea1a5cc4645acdd4deaa9e0ac7f (127.5.126.67:41127)
I20260709 13:23:53.852592 17452 raft_consensus.cc:359] T 3c97f32b7fa24e109d2c993bee4cacdc P 726d96e241134d7e9e1851f2cee66d03 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "726d96e241134d7e9e1851f2cee66d03" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 45087 } } peers { permanent_uuid: "316e9983905848079a8e6d9ce5585f46" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 39729 } } peers { permanent_uuid: "ee69eea1a5cc4645acdd4deaa9e0ac7f" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 41127 } }
I20260709 13:23:53.853796 17452 raft_consensus.cc:385] T 3c97f32b7fa24e109d2c993bee4cacdc P 726d96e241134d7e9e1851f2cee66d03 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:23:53.852772 17457 raft_consensus.cc:697] T c2dd9bbf84cd4a0f918afc3a6e9f9d04 P 726d96e241134d7e9e1851f2cee66d03 [term 1 LEADER]: Becoming Leader. State: Replica: 726d96e241134d7e9e1851f2cee66d03, State: Running, Role: LEADER
I20260709 13:23:53.832021 17337 raft_consensus.cc:2468] T 54bab860b0384e1bb5e75b8c8594e4a0 P 316e9983905848079a8e6d9ce5585f46 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee69eea1a5cc4645acdd4deaa9e0ac7f in term 1.
I20260709 13:23:53.854895 17457 consensus_queue.cc:237] T c2dd9bbf84cd4a0f918afc3a6e9f9d04 P 726d96e241134d7e9e1851f2cee66d03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "726d96e241134d7e9e1851f2cee66d03" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 45087 } } peers { permanent_uuid: "316e9983905848079a8e6d9ce5585f46" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 39729 } } peers { permanent_uuid: "ee69eea1a5cc4645acdd4deaa9e0ac7f" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 41127 } }
I20260709 13:23:53.851743 17453 raft_consensus.cc:359] T 3c97f32b7fa24e109d2c993bee4cacdc P 316e9983905848079a8e6d9ce5585f46 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "726d96e241134d7e9e1851f2cee66d03" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 45087 } } peers { permanent_uuid: "316e9983905848079a8e6d9ce5585f46" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 39729 } } peers { permanent_uuid: "ee69eea1a5cc4645acdd4deaa9e0ac7f" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 41127 } }
I20260709 13:23:53.855937 17453 raft_consensus.cc:385] T 3c97f32b7fa24e109d2c993bee4cacdc P 316e9983905848079a8e6d9ce5585f46 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:23:53.856284 17453 raft_consensus.cc:740] T 3c97f32b7fa24e109d2c993bee4cacdc P 316e9983905848079a8e6d9ce5585f46 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 316e9983905848079a8e6d9ce5585f46, State: Initialized, Role: FOLLOWER
I20260709 13:23:53.856062 17456 tablet_bootstrap.cc:492] T 3c97f32b7fa24e109d2c993bee4cacdc P ee69eea1a5cc4645acdd4deaa9e0ac7f: Bootstrap starting.
I20260709 13:23:53.857023 17453 consensus_queue.cc:260] T 3c97f32b7fa24e109d2c993bee4cacdc P 316e9983905848079a8e6d9ce5585f46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "726d96e241134d7e9e1851f2cee66d03" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 45087 } } peers { permanent_uuid: "316e9983905848079a8e6d9ce5585f46" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 39729 } } peers { permanent_uuid: "ee69eea1a5cc4645acdd4deaa9e0ac7f" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 41127 } }
I20260709 13:23:53.858964 17453 ts_tablet_manager.cc:1434] T 3c97f32b7fa24e109d2c993bee4cacdc P 316e9983905848079a8e6d9ce5585f46: Time spent starting tablet: real 0.010s	user 0.004s	sys 0.000s
I20260709 13:23:53.859390 17452 raft_consensus.cc:740] T 3c97f32b7fa24e109d2c993bee4cacdc P 726d96e241134d7e9e1851f2cee66d03 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 726d96e241134d7e9e1851f2cee66d03, State: Initialized, Role: FOLLOWER
I20260709 13:23:53.860502 17452 consensus_queue.cc:260] T 3c97f32b7fa24e109d2c993bee4cacdc P 726d96e241134d7e9e1851f2cee66d03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "726d96e241134d7e9e1851f2cee66d03" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 45087 } } peers { permanent_uuid: "316e9983905848079a8e6d9ce5585f46" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 39729 } } peers { permanent_uuid: "ee69eea1a5cc4645acdd4deaa9e0ac7f" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 41127 } }
I20260709 13:23:53.862888 17452 ts_tablet_manager.cc:1434] T 3c97f32b7fa24e109d2c993bee4cacdc P 726d96e241134d7e9e1851f2cee66d03: Time spent starting tablet: real 0.014s	user 0.007s	sys 0.001s
I20260709 13:23:53.866143 17456 tablet_bootstrap.cc:654] T 3c97f32b7fa24e109d2c993bee4cacdc P ee69eea1a5cc4645acdd4deaa9e0ac7f: Neither blocks nor log segments found. Creating new log.
I20260709 13:23:53.883255 17162 catalog_manager.cc:5697] T c2dd9bbf84cd4a0f918afc3a6e9f9d04 P 726d96e241134d7e9e1851f2cee66d03 reported cstate change: term changed from 0 to 1, leader changed from <none> to 726d96e241134d7e9e1851f2cee66d03 (127.5.126.65). New cstate: current_term: 1 leader_uuid: "726d96e241134d7e9e1851f2cee66d03" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "726d96e241134d7e9e1851f2cee66d03" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 45087 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "316e9983905848079a8e6d9ce5585f46" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 39729 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ee69eea1a5cc4645acdd4deaa9e0ac7f" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 41127 } health_report { overall_health: UNKNOWN } } }
I20260709 13:23:53.884363 17456 tablet_bootstrap.cc:492] T 3c97f32b7fa24e109d2c993bee4cacdc P ee69eea1a5cc4645acdd4deaa9e0ac7f: No bootstrap required, opened a new log
I20260709 13:23:53.885007 17456 ts_tablet_manager.cc:1403] T 3c97f32b7fa24e109d2c993bee4cacdc P ee69eea1a5cc4645acdd4deaa9e0ac7f: Time spent bootstrapping tablet: real 0.029s	user 0.016s	sys 0.005s
I20260709 13:23:53.884940 17161 catalog_manager.cc:5697] T 54bab860b0384e1bb5e75b8c8594e4a0 P ee69eea1a5cc4645acdd4deaa9e0ac7f reported cstate change: term changed from 0 to 1, leader changed from <none> to ee69eea1a5cc4645acdd4deaa9e0ac7f (127.5.126.67). New cstate: current_term: 1 leader_uuid: "ee69eea1a5cc4645acdd4deaa9e0ac7f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "726d96e241134d7e9e1851f2cee66d03" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 45087 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "316e9983905848079a8e6d9ce5585f46" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 39729 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ee69eea1a5cc4645acdd4deaa9e0ac7f" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 41127 } health_report { overall_health: HEALTHY } } }
I20260709 13:23:53.887838 17456 raft_consensus.cc:359] T 3c97f32b7fa24e109d2c993bee4cacdc P ee69eea1a5cc4645acdd4deaa9e0ac7f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "726d96e241134d7e9e1851f2cee66d03" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 45087 } } peers { permanent_uuid: "316e9983905848079a8e6d9ce5585f46" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 39729 } } peers { permanent_uuid: "ee69eea1a5cc4645acdd4deaa9e0ac7f" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 41127 } }
I20260709 13:23:53.888453 17456 raft_consensus.cc:385] T 3c97f32b7fa24e109d2c993bee4cacdc P ee69eea1a5cc4645acdd4deaa9e0ac7f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:23:53.888682 17456 raft_consensus.cc:740] T 3c97f32b7fa24e109d2c993bee4cacdc P ee69eea1a5cc4645acdd4deaa9e0ac7f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ee69eea1a5cc4645acdd4deaa9e0ac7f, State: Initialized, Role: FOLLOWER
I20260709 13:23:53.889487 17456 consensus_queue.cc:260] T 3c97f32b7fa24e109d2c993bee4cacdc P ee69eea1a5cc4645acdd4deaa9e0ac7f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "726d96e241134d7e9e1851f2cee66d03" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 45087 } } peers { permanent_uuid: "316e9983905848079a8e6d9ce5585f46" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 39729 } } peers { permanent_uuid: "ee69eea1a5cc4645acdd4deaa9e0ac7f" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 41127 } }
I20260709 13:23:53.891356 17456 ts_tablet_manager.cc:1434] T 3c97f32b7fa24e109d2c993bee4cacdc P ee69eea1a5cc4645acdd4deaa9e0ac7f: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:23:53.892233 17456 tablet_bootstrap.cc:492] T d137c22ac67145ae96eedb776127de6f P ee69eea1a5cc4645acdd4deaa9e0ac7f: Bootstrap starting.
I20260709 13:23:53.898098 17456 tablet_bootstrap.cc:654] T d137c22ac67145ae96eedb776127de6f P ee69eea1a5cc4645acdd4deaa9e0ac7f: Neither blocks nor log segments found. Creating new log.
I20260709 13:23:53.902635 17456 tablet_bootstrap.cc:492] T d137c22ac67145ae96eedb776127de6f P ee69eea1a5cc4645acdd4deaa9e0ac7f: No bootstrap required, opened a new log
I20260709 13:23:53.903071 17456 ts_tablet_manager.cc:1403] T d137c22ac67145ae96eedb776127de6f P ee69eea1a5cc4645acdd4deaa9e0ac7f: Time spent bootstrapping tablet: real 0.011s	user 0.010s	sys 0.000s
I20260709 13:23:53.905278 17456 raft_consensus.cc:359] T d137c22ac67145ae96eedb776127de6f P ee69eea1a5cc4645acdd4deaa9e0ac7f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "726d96e241134d7e9e1851f2cee66d03" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 45087 } } peers { permanent_uuid: "316e9983905848079a8e6d9ce5585f46" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 39729 } } peers { permanent_uuid: "ee69eea1a5cc4645acdd4deaa9e0ac7f" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 41127 } }
I20260709 13:23:53.905956 17456 raft_consensus.cc:385] T d137c22ac67145ae96eedb776127de6f P ee69eea1a5cc4645acdd4deaa9e0ac7f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:23:53.906200 17456 raft_consensus.cc:740] T d137c22ac67145ae96eedb776127de6f P ee69eea1a5cc4645acdd4deaa9e0ac7f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ee69eea1a5cc4645acdd4deaa9e0ac7f, State: Initialized, Role: FOLLOWER
I20260709 13:23:53.906726 17456 consensus_queue.cc:260] T d137c22ac67145ae96eedb776127de6f P ee69eea1a5cc4645acdd4deaa9e0ac7f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "726d96e241134d7e9e1851f2cee66d03" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 45087 } } peers { permanent_uuid: "316e9983905848079a8e6d9ce5585f46" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 39729 } } peers { permanent_uuid: "ee69eea1a5cc4645acdd4deaa9e0ac7f" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 41127 } }
I20260709 13:23:53.908577 17456 ts_tablet_manager.cc:1434] T d137c22ac67145ae96eedb776127de6f P ee69eea1a5cc4645acdd4deaa9e0ac7f: Time spent starting tablet: real 0.005s	user 0.006s	sys 0.000s
I20260709 13:23:53.992276 17412 raft_consensus.cc:3060] T d137c22ac67145ae96eedb776127de6f P ee69eea1a5cc4645acdd4deaa9e0ac7f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:23:54.000185 17457 consensus_queue.cc:1048] T d137c22ac67145ae96eedb776127de6f P 726d96e241134d7e9e1851f2cee66d03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee69eea1a5cc4645acdd4deaa9e0ac7f" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 41127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:23:54.014802 17477 consensus_queue.cc:1048] T d137c22ac67145ae96eedb776127de6f P 726d96e241134d7e9e1851f2cee66d03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "316e9983905848079a8e6d9ce5585f46" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 39729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:23:54.096113 17494 raft_consensus.cc:493] T 3c97f32b7fa24e109d2c993bee4cacdc P 316e9983905848079a8e6d9ce5585f46 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:23:54.096736 17494 raft_consensus.cc:515] T 3c97f32b7fa24e109d2c993bee4cacdc P 316e9983905848079a8e6d9ce5585f46 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "726d96e241134d7e9e1851f2cee66d03" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 45087 } } peers { permanent_uuid: "316e9983905848079a8e6d9ce5585f46" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 39729 } } peers { permanent_uuid: "ee69eea1a5cc4645acdd4deaa9e0ac7f" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 41127 } }
I20260709 13:23:54.099004 17494 leader_election.cc:290] T 3c97f32b7fa24e109d2c993bee4cacdc P 316e9983905848079a8e6d9ce5585f46 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 726d96e241134d7e9e1851f2cee66d03 (127.5.126.65:45087), ee69eea1a5cc4645acdd4deaa9e0ac7f (127.5.126.67:41127)
I20260709 13:23:54.100101 17264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c97f32b7fa24e109d2c993bee4cacdc" candidate_uuid: "316e9983905848079a8e6d9ce5585f46" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "726d96e241134d7e9e1851f2cee66d03" is_pre_election: true
I20260709 13:23:54.100443 17412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c97f32b7fa24e109d2c993bee4cacdc" candidate_uuid: "316e9983905848079a8e6d9ce5585f46" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee69eea1a5cc4645acdd4deaa9e0ac7f" is_pre_election: true
I20260709 13:23:54.100801 17264 raft_consensus.cc:2468] T 3c97f32b7fa24e109d2c993bee4cacdc P 726d96e241134d7e9e1851f2cee66d03 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 316e9983905848079a8e6d9ce5585f46 in term 0.
I20260709 13:23:54.101197 17412 raft_consensus.cc:2468] T 3c97f32b7fa24e109d2c993bee4cacdc P ee69eea1a5cc4645acdd4deaa9e0ac7f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 316e9983905848079a8e6d9ce5585f46 in term 0.
I20260709 13:23:54.102028 17305 leader_election.cc:304] T 3c97f32b7fa24e109d2c993bee4cacdc P 316e9983905848079a8e6d9ce5585f46 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 316e9983905848079a8e6d9ce5585f46, 726d96e241134d7e9e1851f2cee66d03; no voters: 
I20260709 13:23:54.102931 17494 raft_consensus.cc:2804] T 3c97f32b7fa24e109d2c993bee4cacdc P 316e9983905848079a8e6d9ce5585f46 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:23:54.103271 17494 raft_consensus.cc:493] T 3c97f32b7fa24e109d2c993bee4cacdc P 316e9983905848079a8e6d9ce5585f46 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:23:54.103605 17494 raft_consensus.cc:3060] T 3c97f32b7fa24e109d2c993bee4cacdc P 316e9983905848079a8e6d9ce5585f46 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:23:54.109688 17494 raft_consensus.cc:515] T 3c97f32b7fa24e109d2c993bee4cacdc P 316e9983905848079a8e6d9ce5585f46 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "726d96e241134d7e9e1851f2cee66d03" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 45087 } } peers { permanent_uuid: "316e9983905848079a8e6d9ce5585f46" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 39729 } } peers { permanent_uuid: "ee69eea1a5cc4645acdd4deaa9e0ac7f" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 41127 } }
I20260709 13:23:54.111467 17494 leader_election.cc:290] T 3c97f32b7fa24e109d2c993bee4cacdc P 316e9983905848079a8e6d9ce5585f46 [CANDIDATE]: Term 1 election: Requested vote from peers 726d96e241134d7e9e1851f2cee66d03 (127.5.126.65:45087), ee69eea1a5cc4645acdd4deaa9e0ac7f (127.5.126.67:41127)
I20260709 13:23:54.112507 17264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c97f32b7fa24e109d2c993bee4cacdc" candidate_uuid: "316e9983905848079a8e6d9ce5585f46" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "726d96e241134d7e9e1851f2cee66d03"
I20260709 13:23:54.112761 17412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c97f32b7fa24e109d2c993bee4cacdc" candidate_uuid: "316e9983905848079a8e6d9ce5585f46" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee69eea1a5cc4645acdd4deaa9e0ac7f"
I20260709 13:23:54.113302 17264 raft_consensus.cc:3060] T 3c97f32b7fa24e109d2c993bee4cacdc P 726d96e241134d7e9e1851f2cee66d03 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:23:54.113449 17412 raft_consensus.cc:3060] T 3c97f32b7fa24e109d2c993bee4cacdc P ee69eea1a5cc4645acdd4deaa9e0ac7f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:23:54.117048 17485 consensus_queue.cc:1048] T 9d069857fc89437daad3f116d0fc7709 P 726d96e241134d7e9e1851f2cee66d03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "316e9983905848079a8e6d9ce5585f46" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 39729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:23:54.121327 17412 raft_consensus.cc:2468] T 3c97f32b7fa24e109d2c993bee4cacdc P ee69eea1a5cc4645acdd4deaa9e0ac7f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 316e9983905848079a8e6d9ce5585f46 in term 1.
I20260709 13:23:54.121327 17264 raft_consensus.cc:2468] T 3c97f32b7fa24e109d2c993bee4cacdc P 726d96e241134d7e9e1851f2cee66d03 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 316e9983905848079a8e6d9ce5585f46 in term 1.
I20260709 13:23:54.123025 17302 leader_election.cc:304] T 3c97f32b7fa24e109d2c993bee4cacdc P 316e9983905848079a8e6d9ce5585f46 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 316e9983905848079a8e6d9ce5585f46, ee69eea1a5cc4645acdd4deaa9e0ac7f; no voters: 
I20260709 13:23:54.124063 17494 raft_consensus.cc:2804] T 3c97f32b7fa24e109d2c993bee4cacdc P 316e9983905848079a8e6d9ce5585f46 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:23:54.124538 17494 raft_consensus.cc:697] T 3c97f32b7fa24e109d2c993bee4cacdc P 316e9983905848079a8e6d9ce5585f46 [term 1 LEADER]: Becoming Leader. State: Replica: 316e9983905848079a8e6d9ce5585f46, State: Running, Role: LEADER
I20260709 13:23:54.125447 17494 consensus_queue.cc:237] T 3c97f32b7fa24e109d2c993bee4cacdc P 316e9983905848079a8e6d9ce5585f46 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "726d96e241134d7e9e1851f2cee66d03" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 45087 } } peers { permanent_uuid: "316e9983905848079a8e6d9ce5585f46" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 39729 } } peers { permanent_uuid: "ee69eea1a5cc4645acdd4deaa9e0ac7f" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 41127 } }
I20260709 13:23:54.128662 17412 raft_consensus.cc:3060] T 9d069857fc89437daad3f116d0fc7709 P ee69eea1a5cc4645acdd4deaa9e0ac7f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:23:54.137830 17485 consensus_queue.cc:1048] T 9d069857fc89437daad3f116d0fc7709 P 726d96e241134d7e9e1851f2cee66d03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee69eea1a5cc4645acdd4deaa9e0ac7f" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 41127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:23:54.138830 17457 raft_consensus.cc:493] T a01b9563aeb3401dbc60ad1647424d67 P 726d96e241134d7e9e1851f2cee66d03 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:23:54.139647 17457 raft_consensus.cc:515] T a01b9563aeb3401dbc60ad1647424d67 P 726d96e241134d7e9e1851f2cee66d03 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "726d96e241134d7e9e1851f2cee66d03" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 45087 } } peers { permanent_uuid: "316e9983905848079a8e6d9ce5585f46" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 39729 } } peers { permanent_uuid: "ee69eea1a5cc4645acdd4deaa9e0ac7f" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 41127 } }
I20260709 13:23:54.140445 17485 consensus_queue.cc:1048] T a3211f7bc1aa4d949b49f0c23362b0d5 P 726d96e241134d7e9e1851f2cee66d03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "316e9983905848079a8e6d9ce5585f46" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 39729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:23:54.142181 17457 leader_election.cc:290] T a01b9563aeb3401dbc60ad1647424d67 P 726d96e241134d7e9e1851f2cee66d03 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 316e9983905848079a8e6d9ce5585f46 (127.5.126.66:39729), ee69eea1a5cc4645acdd4deaa9e0ac7f (127.5.126.67:41127)
I20260709 13:23:54.144312 17339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a01b9563aeb3401dbc60ad1647424d67" candidate_uuid: "726d96e241134d7e9e1851f2cee66d03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "316e9983905848079a8e6d9ce5585f46" is_pre_election: true
I20260709 13:23:54.144587 17410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a01b9563aeb3401dbc60ad1647424d67" candidate_uuid: "726d96e241134d7e9e1851f2cee66d03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee69eea1a5cc4645acdd4deaa9e0ac7f" is_pre_election: true
I20260709 13:23:54.145394 17410 raft_consensus.cc:2468] T a01b9563aeb3401dbc60ad1647424d67 P ee69eea1a5cc4645acdd4deaa9e0ac7f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 726d96e241134d7e9e1851f2cee66d03 in term 0.
I20260709 13:23:54.145377 17339 raft_consensus.cc:2468] T a01b9563aeb3401dbc60ad1647424d67 P 316e9983905848079a8e6d9ce5585f46 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 726d96e241134d7e9e1851f2cee66d03 in term 0.
I20260709 13:23:54.147583 17227 leader_election.cc:304] T a01b9563aeb3401dbc60ad1647424d67 P 726d96e241134d7e9e1851f2cee66d03 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 316e9983905848079a8e6d9ce5585f46, 726d96e241134d7e9e1851f2cee66d03; no voters: 
I20260709 13:23:54.149209 17457 raft_consensus.cc:2804] T a01b9563aeb3401dbc60ad1647424d67 P 726d96e241134d7e9e1851f2cee66d03 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:23:54.149639 17457 raft_consensus.cc:493] T a01b9563aeb3401dbc60ad1647424d67 P 726d96e241134d7e9e1851f2cee66d03 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:23:54.150024 17457 raft_consensus.cc:3060] T a01b9563aeb3401dbc60ad1647424d67 P 726d96e241134d7e9e1851f2cee66d03 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:23:54.151588 17161 catalog_manager.cc:5697] T 3c97f32b7fa24e109d2c993bee4cacdc P 316e9983905848079a8e6d9ce5585f46 reported cstate change: term changed from 0 to 1, leader changed from <none> to 316e9983905848079a8e6d9ce5585f46 (127.5.126.66). New cstate: current_term: 1 leader_uuid: "316e9983905848079a8e6d9ce5585f46" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "726d96e241134d7e9e1851f2cee66d03" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 45087 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "316e9983905848079a8e6d9ce5585f46" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 39729 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ee69eea1a5cc4645acdd4deaa9e0ac7f" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 41127 } health_report { overall_health: UNKNOWN } } }
I20260709 13:23:54.160925 17457 raft_consensus.cc:515] T a01b9563aeb3401dbc60ad1647424d67 P 726d96e241134d7e9e1851f2cee66d03 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "726d96e241134d7e9e1851f2cee66d03" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 45087 } } peers { permanent_uuid: "316e9983905848079a8e6d9ce5585f46" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 39729 } } peers { permanent_uuid: "ee69eea1a5cc4645acdd4deaa9e0ac7f" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 41127 } }
I20260709 13:23:54.164230 17457 leader_election.cc:290] T a01b9563aeb3401dbc60ad1647424d67 P 726d96e241134d7e9e1851f2cee66d03 [CANDIDATE]: Term 1 election: Requested vote from peers 316e9983905848079a8e6d9ce5585f46 (127.5.126.66:39729), ee69eea1a5cc4645acdd4deaa9e0ac7f (127.5.126.67:41127)
I20260709 13:23:54.166343 17339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a01b9563aeb3401dbc60ad1647424d67" candidate_uuid: "726d96e241134d7e9e1851f2cee66d03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "316e9983905848079a8e6d9ce5585f46"
I20260709 13:23:54.167104 17339 raft_consensus.cc:3060] T a01b9563aeb3401dbc60ad1647424d67 P 316e9983905848079a8e6d9ce5585f46 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:23:54.168262 17412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a01b9563aeb3401dbc60ad1647424d67" candidate_uuid: "726d96e241134d7e9e1851f2cee66d03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee69eea1a5cc4645acdd4deaa9e0ac7f"
I20260709 13:23:54.169047 17412 raft_consensus.cc:3060] T a01b9563aeb3401dbc60ad1647424d67 P ee69eea1a5cc4645acdd4deaa9e0ac7f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:23:54.177309 17412 raft_consensus.cc:2468] T a01b9563aeb3401dbc60ad1647424d67 P ee69eea1a5cc4645acdd4deaa9e0ac7f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 726d96e241134d7e9e1851f2cee66d03 in term 1.
I20260709 13:23:54.178270 17485 consensus_queue.cc:1048] T a3211f7bc1aa4d949b49f0c23362b0d5 P 726d96e241134d7e9e1851f2cee66d03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee69eea1a5cc4645acdd4deaa9e0ac7f" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 41127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:23:54.180769 17227 leader_election.cc:304] T a01b9563aeb3401dbc60ad1647424d67 P 726d96e241134d7e9e1851f2cee66d03 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 726d96e241134d7e9e1851f2cee66d03, ee69eea1a5cc4645acdd4deaa9e0ac7f; no voters: 
I20260709 13:23:54.181649 17485 raft_consensus.cc:2804] T a01b9563aeb3401dbc60ad1647424d67 P 726d96e241134d7e9e1851f2cee66d03 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:23:54.182125 17485 raft_consensus.cc:697] T a01b9563aeb3401dbc60ad1647424d67 P 726d96e241134d7e9e1851f2cee66d03 [term 1 LEADER]: Becoming Leader. State: Replica: 726d96e241134d7e9e1851f2cee66d03, State: Running, Role: LEADER
I20260709 13:23:54.182504 17339 raft_consensus.cc:2468] T a01b9563aeb3401dbc60ad1647424d67 P 316e9983905848079a8e6d9ce5585f46 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 726d96e241134d7e9e1851f2cee66d03 in term 1.
I20260709 13:23:54.182996 17485 consensus_queue.cc:237] T a01b9563aeb3401dbc60ad1647424d67 P 726d96e241134d7e9e1851f2cee66d03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "726d96e241134d7e9e1851f2cee66d03" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 45087 } } peers { permanent_uuid: "316e9983905848079a8e6d9ce5585f46" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 39729 } } peers { permanent_uuid: "ee69eea1a5cc4645acdd4deaa9e0ac7f" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 41127 } }
I20260709 13:23:54.198711 17462 consensus_queue.cc:1048] T 0544fe20b9ca44b18589408ea98f4eed P ee69eea1a5cc4645acdd4deaa9e0ac7f [LEADER]: Connected to new peer: Peer: permanent_uuid: "316e9983905848079a8e6d9ce5585f46" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 39729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:23:54.199431 17159 catalog_manager.cc:5697] T a01b9563aeb3401dbc60ad1647424d67 P 726d96e241134d7e9e1851f2cee66d03 reported cstate change: term changed from 0 to 1, leader changed from <none> to 726d96e241134d7e9e1851f2cee66d03 (127.5.126.65). New cstate: current_term: 1 leader_uuid: "726d96e241134d7e9e1851f2cee66d03" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "726d96e241134d7e9e1851f2cee66d03" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 45087 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "316e9983905848079a8e6d9ce5585f46" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 39729 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ee69eea1a5cc4645acdd4deaa9e0ac7f" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 41127 } health_report { overall_health: UNKNOWN } } }
I20260709 13:23:54.214133 17484 consensus_queue.cc:1048] T 0544fe20b9ca44b18589408ea98f4eed P ee69eea1a5cc4645acdd4deaa9e0ac7f [LEADER]: Connected to new peer: Peer: permanent_uuid: "726d96e241134d7e9e1851f2cee66d03" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 45087 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:23:54.221374 17484 consensus_queue.cc:1048] T d87dace41fef4526a2cace8a5007919f P ee69eea1a5cc4645acdd4deaa9e0ac7f [LEADER]: Connected to new peer: Peer: permanent_uuid: "726d96e241134d7e9e1851f2cee66d03" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 45087 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:23:54.240841 17487 consensus_queue.cc:1048] T d87dace41fef4526a2cace8a5007919f P ee69eea1a5cc4645acdd4deaa9e0ac7f [LEADER]: Connected to new peer: Peer: permanent_uuid: "316e9983905848079a8e6d9ce5585f46" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 39729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:23:54.287127 17412 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0544fe20b9ca44b18589408ea98f4eed"
dest_uuid: "ee69eea1a5cc4645acdd4deaa9e0ac7f"
mode: GRACEFUL
new_leader_uuid: "726d96e241134d7e9e1851f2cee66d03"
 from {username='slave'} at 127.0.0.1:45368
I20260709 13:23:54.287791 17412 raft_consensus.cc:606] T 0544fe20b9ca44b18589408ea98f4eed P ee69eea1a5cc4645acdd4deaa9e0ac7f [term 1 LEADER]: Received request to transfer leadership to TS 726d96e241134d7e9e1851f2cee66d03
I20260709 13:23:54.294123 17412 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d87dace41fef4526a2cace8a5007919f"
dest_uuid: "ee69eea1a5cc4645acdd4deaa9e0ac7f"
mode: GRACEFUL
new_leader_uuid: "316e9983905848079a8e6d9ce5585f46"
 from {username='slave'} at 127.0.0.1:45368
I20260709 13:23:54.294724 17412 raft_consensus.cc:606] T d87dace41fef4526a2cace8a5007919f P ee69eea1a5cc4645acdd4deaa9e0ac7f [term 1 LEADER]: Received request to transfer leadership to TS 316e9983905848079a8e6d9ce5585f46
I20260709 13:23:54.306433 17462 consensus_queue.cc:1048] T 54bab860b0384e1bb5e75b8c8594e4a0 P ee69eea1a5cc4645acdd4deaa9e0ac7f [LEADER]: Connected to new peer: Peer: permanent_uuid: "726d96e241134d7e9e1851f2cee66d03" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 45087 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:23:54.311885 17264 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a01b9563aeb3401dbc60ad1647424d67"
dest_uuid: "726d96e241134d7e9e1851f2cee66d03"
mode: GRACEFUL
new_leader_uuid: "316e9983905848079a8e6d9ce5585f46"
 from {username='slave'} at 127.0.0.1:41542
I20260709 13:23:54.312603 17264 raft_consensus.cc:606] T a01b9563aeb3401dbc60ad1647424d67 P 726d96e241134d7e9e1851f2cee66d03 [term 1 LEADER]: Received request to transfer leadership to TS 316e9983905848079a8e6d9ce5585f46
I20260709 13:23:54.315711 17485 consensus_queue.cc:1048] T c2dd9bbf84cd4a0f918afc3a6e9f9d04 P 726d96e241134d7e9e1851f2cee66d03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee69eea1a5cc4645acdd4deaa9e0ac7f" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 41127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:23:54.320832 17488 consensus_queue.cc:1048] T 54bab860b0384e1bb5e75b8c8594e4a0 P ee69eea1a5cc4645acdd4deaa9e0ac7f [LEADER]: Connected to new peer: Peer: permanent_uuid: "316e9983905848079a8e6d9ce5585f46" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 39729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:23:54.331977 17262 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c2dd9bbf84cd4a0f918afc3a6e9f9d04"
dest_uuid: "726d96e241134d7e9e1851f2cee66d03"
mode: GRACEFUL
new_leader_uuid: "316e9983905848079a8e6d9ce5585f46"
 from {username='slave'} at 127.0.0.1:41542
I20260709 13:23:54.332757 17262 raft_consensus.cc:606] T c2dd9bbf84cd4a0f918afc3a6e9f9d04 P 726d96e241134d7e9e1851f2cee66d03 [term 1 LEADER]: Received request to transfer leadership to TS 316e9983905848079a8e6d9ce5585f46
I20260709 13:23:54.351714 17477 consensus_queue.cc:1048] T c2dd9bbf84cd4a0f918afc3a6e9f9d04 P 726d96e241134d7e9e1851f2cee66d03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "316e9983905848079a8e6d9ce5585f46" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 39729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:23:54.360108 17485 raft_consensus.cc:993] T c2dd9bbf84cd4a0f918afc3a6e9f9d04 P 726d96e241134d7e9e1851f2cee66d03: : Instructing follower 316e9983905848079a8e6d9ce5585f46 to start an election
I20260709 13:23:54.360634 17477 raft_consensus.cc:1081] T c2dd9bbf84cd4a0f918afc3a6e9f9d04 P 726d96e241134d7e9e1851f2cee66d03 [term 1 LEADER]: Signalling peer 316e9983905848079a8e6d9ce5585f46 to start an election
I20260709 13:23:54.362401 17339 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c2dd9bbf84cd4a0f918afc3a6e9f9d04"
dest_uuid: "316e9983905848079a8e6d9ce5585f46"
 from {username='slave'} at 127.0.0.1:39238
I20260709 13:23:54.363061 17339 raft_consensus.cc:493] T c2dd9bbf84cd4a0f918afc3a6e9f9d04 P 316e9983905848079a8e6d9ce5585f46 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:23:54.363408 17339 raft_consensus.cc:3060] T c2dd9bbf84cd4a0f918afc3a6e9f9d04 P 316e9983905848079a8e6d9ce5585f46 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:23:54.369531 17339 raft_consensus.cc:515] T c2dd9bbf84cd4a0f918afc3a6e9f9d04 P 316e9983905848079a8e6d9ce5585f46 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "726d96e241134d7e9e1851f2cee66d03" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 45087 } } peers { permanent_uuid: "316e9983905848079a8e6d9ce5585f46" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 39729 } } peers { permanent_uuid: "ee69eea1a5cc4645acdd4deaa9e0ac7f" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 41127 } }
I20260709 13:23:54.371308 17339 leader_election.cc:290] T c2dd9bbf84cd4a0f918afc3a6e9f9d04 P 316e9983905848079a8e6d9ce5585f46 [CANDIDATE]: Term 2 election: Requested vote from peers 726d96e241134d7e9e1851f2cee66d03 (127.5.126.65:45087), ee69eea1a5cc4645acdd4deaa9e0ac7f (127.5.126.67:41127)
I20260709 13:23:54.372340 17262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2dd9bbf84cd4a0f918afc3a6e9f9d04" candidate_uuid: "316e9983905848079a8e6d9ce5585f46" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "726d96e241134d7e9e1851f2cee66d03"
I20260709 13:23:54.372551 17412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2dd9bbf84cd4a0f918afc3a6e9f9d04" candidate_uuid: "316e9983905848079a8e6d9ce5585f46" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ee69eea1a5cc4645acdd4deaa9e0ac7f"
I20260709 13:23:54.373072 17262 raft_consensus.cc:3055] T c2dd9bbf84cd4a0f918afc3a6e9f9d04 P 726d96e241134d7e9e1851f2cee66d03 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:23:54.373198 17412 raft_consensus.cc:3060] T c2dd9bbf84cd4a0f918afc3a6e9f9d04 P ee69eea1a5cc4645acdd4deaa9e0ac7f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:23:54.373450 17262 raft_consensus.cc:740] T c2dd9bbf84cd4a0f918afc3a6e9f9d04 P 726d96e241134d7e9e1851f2cee66d03 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 726d96e241134d7e9e1851f2cee66d03, State: Running, Role: LEADER
I20260709 13:23:54.374353 17262 consensus_queue.cc:260] T c2dd9bbf84cd4a0f918afc3a6e9f9d04 P 726d96e241134d7e9e1851f2cee66d03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "726d96e241134d7e9e1851f2cee66d03" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 45087 } } peers { permanent_uuid: "316e9983905848079a8e6d9ce5585f46" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 39729 } } peers { permanent_uuid: "ee69eea1a5cc4645acdd4deaa9e0ac7f" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 41127 } }
I20260709 13:23:54.375349 17262 raft_consensus.cc:3060] T c2dd9bbf84cd4a0f918afc3a6e9f9d04 P 726d96e241134d7e9e1851f2cee66d03 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:23:54.379742 17412 raft_consensus.cc:2468] T c2dd9bbf84cd4a0f918afc3a6e9f9d04 P ee69eea1a5cc4645acdd4deaa9e0ac7f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 316e9983905848079a8e6d9ce5585f46 in term 2.
I20260709 13:23:54.380625 17262 raft_consensus.cc:2468] T c2dd9bbf84cd4a0f918afc3a6e9f9d04 P 726d96e241134d7e9e1851f2cee66d03 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 316e9983905848079a8e6d9ce5585f46 in term 2.
I20260709 13:23:54.381193 17302 leader_election.cc:304] T c2dd9bbf84cd4a0f918afc3a6e9f9d04 P 316e9983905848079a8e6d9ce5585f46 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 316e9983905848079a8e6d9ce5585f46, ee69eea1a5cc4645acdd4deaa9e0ac7f; no voters: 
I20260709 13:23:54.382179 17494 raft_consensus.cc:2804] T c2dd9bbf84cd4a0f918afc3a6e9f9d04 P 316e9983905848079a8e6d9ce5585f46 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:23:54.382655 17494 raft_consensus.cc:697] T c2dd9bbf84cd4a0f918afc3a6e9f9d04 P 316e9983905848079a8e6d9ce5585f46 [term 2 LEADER]: Becoming Leader. State: Replica: 316e9983905848079a8e6d9ce5585f46, State: Running, Role: LEADER
I20260709 13:23:54.383630 17494 consensus_queue.cc:237] T c2dd9bbf84cd4a0f918afc3a6e9f9d04 P 316e9983905848079a8e6d9ce5585f46 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "726d96e241134d7e9e1851f2cee66d03" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 45087 } } peers { permanent_uuid: "316e9983905848079a8e6d9ce5585f46" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 39729 } } peers { permanent_uuid: "ee69eea1a5cc4645acdd4deaa9e0ac7f" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 41127 } }
I20260709 13:23:54.390767 17162 catalog_manager.cc:5697] T c2dd9bbf84cd4a0f918afc3a6e9f9d04 P 316e9983905848079a8e6d9ce5585f46 reported cstate change: term changed from 1 to 2, leader changed from 726d96e241134d7e9e1851f2cee66d03 (127.5.126.65) to 316e9983905848079a8e6d9ce5585f46 (127.5.126.66). New cstate: current_term: 2 leader_uuid: "316e9983905848079a8e6d9ce5585f46" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "726d96e241134d7e9e1851f2cee66d03" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 45087 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "316e9983905848079a8e6d9ce5585f46" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 39729 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ee69eea1a5cc4645acdd4deaa9e0ac7f" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 41127 } health_report { overall_health: UNKNOWN } } }
I20260709 13:23:54.573386 17494 consensus_queue.cc:1048] T 3c97f32b7fa24e109d2c993bee4cacdc P 316e9983905848079a8e6d9ce5585f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "726d96e241134d7e9e1851f2cee66d03" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 45087 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:23:54.587590 17458 consensus_queue.cc:1048] T 3c97f32b7fa24e109d2c993bee4cacdc P 316e9983905848079a8e6d9ce5585f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee69eea1a5cc4645acdd4deaa9e0ac7f" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 41127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:23:54.616124 17457 consensus_queue.cc:1048] T a01b9563aeb3401dbc60ad1647424d67 P 726d96e241134d7e9e1851f2cee66d03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "316e9983905848079a8e6d9ce5585f46" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 39729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:23:54.624200 17477 raft_consensus.cc:993] T a01b9563aeb3401dbc60ad1647424d67 P 726d96e241134d7e9e1851f2cee66d03: : Instructing follower 316e9983905848079a8e6d9ce5585f46 to start an election
I20260709 13:23:54.624866 17485 raft_consensus.cc:1081] T a01b9563aeb3401dbc60ad1647424d67 P 726d96e241134d7e9e1851f2cee66d03 [term 1 LEADER]: Signalling peer 316e9983905848079a8e6d9ce5585f46 to start an election
I20260709 13:23:54.627161 17338 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a01b9563aeb3401dbc60ad1647424d67"
dest_uuid: "316e9983905848079a8e6d9ce5585f46"
 from {username='slave'} at 127.0.0.1:39238
I20260709 13:23:54.627852 17338 raft_consensus.cc:493] T a01b9563aeb3401dbc60ad1647424d67 P 316e9983905848079a8e6d9ce5585f46 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:23:54.628340 17338 raft_consensus.cc:3060] T a01b9563aeb3401dbc60ad1647424d67 P 316e9983905848079a8e6d9ce5585f46 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:23:54.632222 17485 consensus_queue.cc:1048] T a01b9563aeb3401dbc60ad1647424d67 P 726d96e241134d7e9e1851f2cee66d03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee69eea1a5cc4645acdd4deaa9e0ac7f" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 41127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:23:54.636339 17338 raft_consensus.cc:515] T a01b9563aeb3401dbc60ad1647424d67 P 316e9983905848079a8e6d9ce5585f46 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "726d96e241134d7e9e1851f2cee66d03" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 45087 } } peers { permanent_uuid: "316e9983905848079a8e6d9ce5585f46" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 39729 } } peers { permanent_uuid: "ee69eea1a5cc4645acdd4deaa9e0ac7f" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 41127 } }
I20260709 13:23:54.641264 17262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a01b9563aeb3401dbc60ad1647424d67" candidate_uuid: "316e9983905848079a8e6d9ce5585f46" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "726d96e241134d7e9e1851f2cee66d03"
I20260709 13:23:54.641933 17262 raft_consensus.cc:3055] T a01b9563aeb3401dbc60ad1647424d67 P 726d96e241134d7e9e1851f2cee66d03 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:23:54.642305 17262 raft_consensus.cc:740] T a01b9563aeb3401dbc60ad1647424d67 P 726d96e241134d7e9e1851f2cee66d03 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 726d96e241134d7e9e1851f2cee66d03, State: Running, Role: LEADER
I20260709 13:23:54.643184 17262 consensus_queue.cc:260] T a01b9563aeb3401dbc60ad1647424d67 P 726d96e241134d7e9e1851f2cee66d03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "726d96e241134d7e9e1851f2cee66d03" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 45087 } } peers { permanent_uuid: "316e9983905848079a8e6d9ce5585f46" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 39729 } } peers { permanent_uuid: "ee69eea1a5cc4645acdd4deaa9e0ac7f" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 41127 } }
I20260709 13:23:54.644129 17262 raft_consensus.cc:3060] T a01b9563aeb3401dbc60ad1647424d67 P 726d96e241134d7e9e1851f2cee66d03 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:23:54.645982 17338 leader_election.cc:290] T a01b9563aeb3401dbc60ad1647424d67 P 316e9983905848079a8e6d9ce5585f46 [CANDIDATE]: Term 2 election: Requested vote from peers 726d96e241134d7e9e1851f2cee66d03 (127.5.126.65:45087), ee69eea1a5cc4645acdd4deaa9e0ac7f (127.5.126.67:41127)
I20260709 13:23:54.647310 17410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a01b9563aeb3401dbc60ad1647424d67" candidate_uuid: "316e9983905848079a8e6d9ce5585f46" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ee69eea1a5cc4645acdd4deaa9e0ac7f"
I20260709 13:23:54.654639 17262 raft_consensus.cc:2468] T a01b9563aeb3401dbc60ad1647424d67 P 726d96e241134d7e9e1851f2cee66d03 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 316e9983905848079a8e6d9ce5585f46 in term 2.
I20260709 13:23:54.655999 17305 leader_election.cc:304] T a01b9563aeb3401dbc60ad1647424d67 P 316e9983905848079a8e6d9ce5585f46 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 316e9983905848079a8e6d9ce5585f46, 726d96e241134d7e9e1851f2cee66d03; no voters: ee69eea1a5cc4645acdd4deaa9e0ac7f
I20260709 13:23:54.656922 17458 raft_consensus.cc:2804] T a01b9563aeb3401dbc60ad1647424d67 P 316e9983905848079a8e6d9ce5585f46 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:23:54.657459 17458 raft_consensus.cc:697] T a01b9563aeb3401dbc60ad1647424d67 P 316e9983905848079a8e6d9ce5585f46 [term 2 LEADER]: Becoming Leader. State: Replica: 316e9983905848079a8e6d9ce5585f46, State: Running, Role: LEADER
I20260709 13:23:54.658313 17458 consensus_queue.cc:237] T a01b9563aeb3401dbc60ad1647424d67 P 316e9983905848079a8e6d9ce5585f46 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "726d96e241134d7e9e1851f2cee66d03" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 45087 } } peers { permanent_uuid: "316e9983905848079a8e6d9ce5585f46" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 39729 } } peers { permanent_uuid: "ee69eea1a5cc4645acdd4deaa9e0ac7f" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 41127 } }
I20260709 13:23:54.665455 17162 catalog_manager.cc:5697] T a01b9563aeb3401dbc60ad1647424d67 P 316e9983905848079a8e6d9ce5585f46 reported cstate change: term changed from 1 to 2, leader changed from 726d96e241134d7e9e1851f2cee66d03 (127.5.126.65) to 316e9983905848079a8e6d9ce5585f46 (127.5.126.66). New cstate: current_term: 2 leader_uuid: "316e9983905848079a8e6d9ce5585f46" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "726d96e241134d7e9e1851f2cee66d03" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 45087 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "316e9983905848079a8e6d9ce5585f46" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 39729 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ee69eea1a5cc4645acdd4deaa9e0ac7f" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 41127 } health_report { overall_health: UNKNOWN } } }
I20260709 13:23:54.706980 17488 raft_consensus.cc:993] T d87dace41fef4526a2cace8a5007919f P ee69eea1a5cc4645acdd4deaa9e0ac7f: : Instructing follower 316e9983905848079a8e6d9ce5585f46 to start an election
I20260709 13:23:54.707540 17462 raft_consensus.cc:1081] T d87dace41fef4526a2cace8a5007919f P ee69eea1a5cc4645acdd4deaa9e0ac7f [term 1 LEADER]: Signalling peer 316e9983905848079a8e6d9ce5585f46 to start an election
I20260709 13:23:54.709488 17338 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d87dace41fef4526a2cace8a5007919f"
dest_uuid: "316e9983905848079a8e6d9ce5585f46"
 from {username='slave'} at 127.0.0.1:39244
I20260709 13:23:54.710111 17338 raft_consensus.cc:493] T d87dace41fef4526a2cace8a5007919f P 316e9983905848079a8e6d9ce5585f46 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:23:54.710453 17338 raft_consensus.cc:3060] T d87dace41fef4526a2cace8a5007919f P 316e9983905848079a8e6d9ce5585f46 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:23:54.716859 17338 raft_consensus.cc:515] T d87dace41fef4526a2cace8a5007919f P 316e9983905848079a8e6d9ce5585f46 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "726d96e241134d7e9e1851f2cee66d03" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 45087 } } peers { permanent_uuid: "316e9983905848079a8e6d9ce5585f46" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 39729 } } peers { permanent_uuid: "ee69eea1a5cc4645acdd4deaa9e0ac7f" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 41127 } }
I20260709 13:23:54.719231 17487 raft_consensus.cc:993] T 0544fe20b9ca44b18589408ea98f4eed P ee69eea1a5cc4645acdd4deaa9e0ac7f: : Instructing follower 726d96e241134d7e9e1851f2cee66d03 to start an election
I20260709 13:23:54.719609 17338 leader_election.cc:290] T d87dace41fef4526a2cace8a5007919f P 316e9983905848079a8e6d9ce5585f46 [CANDIDATE]: Term 2 election: Requested vote from peers 726d96e241134d7e9e1851f2cee66d03 (127.5.126.65:45087), ee69eea1a5cc4645acdd4deaa9e0ac7f (127.5.126.67:41127)
I20260709 13:23:54.719825 17487 raft_consensus.cc:1081] T 0544fe20b9ca44b18589408ea98f4eed P ee69eea1a5cc4645acdd4deaa9e0ac7f [term 1 LEADER]: Signalling peer 726d96e241134d7e9e1851f2cee66d03 to start an election
I20260709 13:23:54.720227 17262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d87dace41fef4526a2cace8a5007919f" candidate_uuid: "316e9983905848079a8e6d9ce5585f46" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "726d96e241134d7e9e1851f2cee66d03"
I20260709 13:23:54.720243 17412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d87dace41fef4526a2cace8a5007919f" candidate_uuid: "316e9983905848079a8e6d9ce5585f46" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ee69eea1a5cc4645acdd4deaa9e0ac7f"
I20260709 13:23:54.720981 17262 raft_consensus.cc:3060] T d87dace41fef4526a2cace8a5007919f P 726d96e241134d7e9e1851f2cee66d03 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:23:54.721964 17412 raft_consensus.cc:3055] T d87dace41fef4526a2cace8a5007919f P ee69eea1a5cc4645acdd4deaa9e0ac7f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:23:54.722046 17264 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0544fe20b9ca44b18589408ea98f4eed"
dest_uuid: "726d96e241134d7e9e1851f2cee66d03"
 from {username='slave'} at 127.0.0.1:41530
I20260709 13:23:54.722391 17412 raft_consensus.cc:740] T d87dace41fef4526a2cace8a5007919f P ee69eea1a5cc4645acdd4deaa9e0ac7f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ee69eea1a5cc4645acdd4deaa9e0ac7f, State: Running, Role: LEADER
I20260709 13:23:54.722944 17264 raft_consensus.cc:493] T 0544fe20b9ca44b18589408ea98f4eed P 726d96e241134d7e9e1851f2cee66d03 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:23:54.723459 17264 raft_consensus.cc:3060] T 0544fe20b9ca44b18589408ea98f4eed P 726d96e241134d7e9e1851f2cee66d03 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:23:54.723497 17412 consensus_queue.cc:260] T d87dace41fef4526a2cace8a5007919f P ee69eea1a5cc4645acdd4deaa9e0ac7f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "726d96e241134d7e9e1851f2cee66d03" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 45087 } } peers { permanent_uuid: "316e9983905848079a8e6d9ce5585f46" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 39729 } } peers { permanent_uuid: "ee69eea1a5cc4645acdd4deaa9e0ac7f" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 41127 } }
I20260709 13:23:54.726086 17412 raft_consensus.cc:3060] T d87dace41fef4526a2cace8a5007919f P ee69eea1a5cc4645acdd4deaa9e0ac7f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:23:54.730046 17262 raft_consensus.cc:2468] T d87dace41fef4526a2cace8a5007919f P 726d96e241134d7e9e1851f2cee66d03 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 316e9983905848079a8e6d9ce5585f46 in term 2.
I20260709 13:23:54.730568 17264 raft_consensus.cc:515] T 0544fe20b9ca44b18589408ea98f4eed P 726d96e241134d7e9e1851f2cee66d03 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "726d96e241134d7e9e1851f2cee66d03" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 45087 } } peers { permanent_uuid: "316e9983905848079a8e6d9ce5585f46" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 39729 } } peers { permanent_uuid: "ee69eea1a5cc4645acdd4deaa9e0ac7f" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 41127 } }
I20260709 13:23:54.731475 17305 leader_election.cc:304] T d87dace41fef4526a2cace8a5007919f P 316e9983905848079a8e6d9ce5585f46 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 316e9983905848079a8e6d9ce5585f46, 726d96e241134d7e9e1851f2cee66d03; no voters: 
I20260709 13:23:54.732463 17458 raft_consensus.cc:2804] T d87dace41fef4526a2cace8a5007919f P 316e9983905848079a8e6d9ce5585f46 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:23:54.733013 17458 raft_consensus.cc:697] T d87dace41fef4526a2cace8a5007919f P 316e9983905848079a8e6d9ce5585f46 [term 2 LEADER]: Becoming Leader. State: Replica: 316e9983905848079a8e6d9ce5585f46, State: Running, Role: LEADER
I20260709 13:23:54.733614 17338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0544fe20b9ca44b18589408ea98f4eed" candidate_uuid: "726d96e241134d7e9e1851f2cee66d03" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "316e9983905848079a8e6d9ce5585f46"
I20260709 13:23:54.734298 17338 raft_consensus.cc:3060] T 0544fe20b9ca44b18589408ea98f4eed P 316e9983905848079a8e6d9ce5585f46 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:23:54.733860 17458 consensus_queue.cc:237] T d87dace41fef4526a2cace8a5007919f P 316e9983905848079a8e6d9ce5585f46 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "726d96e241134d7e9e1851f2cee66d03" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 45087 } } peers { permanent_uuid: "316e9983905848079a8e6d9ce5585f46" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 39729 } } peers { permanent_uuid: "ee69eea1a5cc4645acdd4deaa9e0ac7f" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 41127 } }
I20260709 13:23:54.734504 17410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0544fe20b9ca44b18589408ea98f4eed" candidate_uuid: "726d96e241134d7e9e1851f2cee66d03" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ee69eea1a5cc4645acdd4deaa9e0ac7f"
I20260709 13:23:54.734781 17264 leader_election.cc:290] T 0544fe20b9ca44b18589408ea98f4eed P 726d96e241134d7e9e1851f2cee66d03 [CANDIDATE]: Term 2 election: Requested vote from peers 316e9983905848079a8e6d9ce5585f46 (127.5.126.66:39729), ee69eea1a5cc4645acdd4deaa9e0ac7f (127.5.126.67:41127)
I20260709 13:23:54.734918 17412 raft_consensus.cc:2468] T d87dace41fef4526a2cace8a5007919f P ee69eea1a5cc4645acdd4deaa9e0ac7f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 316e9983905848079a8e6d9ce5585f46 in term 2.
I20260709 13:23:54.735244 17410 raft_consensus.cc:3055] T 0544fe20b9ca44b18589408ea98f4eed P ee69eea1a5cc4645acdd4deaa9e0ac7f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:23:54.735658 17410 raft_consensus.cc:740] T 0544fe20b9ca44b18589408ea98f4eed P ee69eea1a5cc4645acdd4deaa9e0ac7f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ee69eea1a5cc4645acdd4deaa9e0ac7f, State: Running, Role: LEADER
I20260709 13:23:54.736573 17410 consensus_queue.cc:260] T 0544fe20b9ca44b18589408ea98f4eed P ee69eea1a5cc4645acdd4deaa9e0ac7f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "726d96e241134d7e9e1851f2cee66d03" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 45087 } } peers { permanent_uuid: "316e9983905848079a8e6d9ce5585f46" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 39729 } } peers { permanent_uuid: "ee69eea1a5cc4645acdd4deaa9e0ac7f" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 41127 } }
I20260709 13:23:54.737913 17410 raft_consensus.cc:3060] T 0544fe20b9ca44b18589408ea98f4eed P ee69eea1a5cc4645acdd4deaa9e0ac7f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:23:54.743111 17162 catalog_manager.cc:5697] T d87dace41fef4526a2cace8a5007919f P 316e9983905848079a8e6d9ce5585f46 reported cstate change: term changed from 1 to 2, leader changed from ee69eea1a5cc4645acdd4deaa9e0ac7f (127.5.126.67) to 316e9983905848079a8e6d9ce5585f46 (127.5.126.66). New cstate: current_term: 2 leader_uuid: "316e9983905848079a8e6d9ce5585f46" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "726d96e241134d7e9e1851f2cee66d03" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 45087 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "316e9983905848079a8e6d9ce5585f46" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 39729 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ee69eea1a5cc4645acdd4deaa9e0ac7f" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 41127 } health_report { overall_health: UNKNOWN } } }
I20260709 13:23:54.744120 17338 raft_consensus.cc:2468] T 0544fe20b9ca44b18589408ea98f4eed P 316e9983905848079a8e6d9ce5585f46 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 726d96e241134d7e9e1851f2cee66d03 in term 2.
I20260709 13:23:54.745517 17410 raft_consensus.cc:2468] T 0544fe20b9ca44b18589408ea98f4eed P ee69eea1a5cc4645acdd4deaa9e0ac7f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 726d96e241134d7e9e1851f2cee66d03 in term 2.
I20260709 13:23:54.745936 17227 leader_election.cc:304] T 0544fe20b9ca44b18589408ea98f4eed P 726d96e241134d7e9e1851f2cee66d03 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 316e9983905848079a8e6d9ce5585f46, 726d96e241134d7e9e1851f2cee66d03; no voters: 
I20260709 13:23:54.746861 17477 raft_consensus.cc:2804] T 0544fe20b9ca44b18589408ea98f4eed P 726d96e241134d7e9e1851f2cee66d03 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:23:54.747386 17477 raft_consensus.cc:697] T 0544fe20b9ca44b18589408ea98f4eed P 726d96e241134d7e9e1851f2cee66d03 [term 2 LEADER]: Becoming Leader. State: Replica: 726d96e241134d7e9e1851f2cee66d03, State: Running, Role: LEADER
I20260709 13:23:54.748262 17477 consensus_queue.cc:237] T 0544fe20b9ca44b18589408ea98f4eed P 726d96e241134d7e9e1851f2cee66d03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "726d96e241134d7e9e1851f2cee66d03" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 45087 } } peers { permanent_uuid: "316e9983905848079a8e6d9ce5585f46" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 39729 } } peers { permanent_uuid: "ee69eea1a5cc4645acdd4deaa9e0ac7f" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 41127 } }
I20260709 13:23:54.754786 17162 catalog_manager.cc:5697] T 0544fe20b9ca44b18589408ea98f4eed P 726d96e241134d7e9e1851f2cee66d03 reported cstate change: term changed from 1 to 2, leader changed from ee69eea1a5cc4645acdd4deaa9e0ac7f (127.5.126.67) to 726d96e241134d7e9e1851f2cee66d03 (127.5.126.65). New cstate: current_term: 2 leader_uuid: "726d96e241134d7e9e1851f2cee66d03" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "726d96e241134d7e9e1851f2cee66d03" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 45087 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "316e9983905848079a8e6d9ce5585f46" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 39729 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ee69eea1a5cc4645acdd4deaa9e0ac7f" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 41127 } health_report { overall_health: UNKNOWN } } }
I20260709 13:23:54.899410 17410 raft_consensus.cc:1275] T c2dd9bbf84cd4a0f918afc3a6e9f9d04 P ee69eea1a5cc4645acdd4deaa9e0ac7f [term 2 FOLLOWER]: Refusing update from remote peer 316e9983905848079a8e6d9ce5585f46: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:23:54.900801 17458 consensus_queue.cc:1048] T c2dd9bbf84cd4a0f918afc3a6e9f9d04 P 316e9983905848079a8e6d9ce5585f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee69eea1a5cc4645acdd4deaa9e0ac7f" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 41127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:23:54.909436 17264 raft_consensus.cc:1275] T c2dd9bbf84cd4a0f918afc3a6e9f9d04 P 726d96e241134d7e9e1851f2cee66d03 [term 2 FOLLOWER]: Refusing update from remote peer 316e9983905848079a8e6d9ce5585f46: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:23:54.911616 17494 consensus_queue.cc:1048] T c2dd9bbf84cd4a0f918afc3a6e9f9d04 P 316e9983905848079a8e6d9ce5585f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "726d96e241134d7e9e1851f2cee66d03" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 45087 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:23:55.131325 17264 raft_consensus.cc:1275] T a01b9563aeb3401dbc60ad1647424d67 P 726d96e241134d7e9e1851f2cee66d03 [term 2 FOLLOWER]: Refusing update from remote peer 316e9983905848079a8e6d9ce5585f46: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:23:55.132642 17494 consensus_queue.cc:1048] T a01b9563aeb3401dbc60ad1647424d67 P 316e9983905848079a8e6d9ce5585f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "726d96e241134d7e9e1851f2cee66d03" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 45087 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:23:55.141702 17412 raft_consensus.cc:3060] T a01b9563aeb3401dbc60ad1647424d67 P ee69eea1a5cc4645acdd4deaa9e0ac7f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:23:55.148669 17412 raft_consensus.cc:1275] T a01b9563aeb3401dbc60ad1647424d67 P ee69eea1a5cc4645acdd4deaa9e0ac7f [term 2 FOLLOWER]: Refusing update from remote peer 316e9983905848079a8e6d9ce5585f46: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:23:55.150178 17458 consensus_queue.cc:1048] T a01b9563aeb3401dbc60ad1647424d67 P 316e9983905848079a8e6d9ce5585f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee69eea1a5cc4645acdd4deaa9e0ac7f" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 41127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:23:55.198318 17264 raft_consensus.cc:1275] T d87dace41fef4526a2cace8a5007919f P 726d96e241134d7e9e1851f2cee66d03 [term 2 FOLLOWER]: Refusing update from remote peer 316e9983905848079a8e6d9ce5585f46: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:23:55.199697 17458 consensus_queue.cc:1048] T d87dace41fef4526a2cace8a5007919f P 316e9983905848079a8e6d9ce5585f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "726d96e241134d7e9e1851f2cee66d03" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 45087 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:23:55.208930 17412 raft_consensus.cc:1275] T d87dace41fef4526a2cace8a5007919f P ee69eea1a5cc4645acdd4deaa9e0ac7f [term 2 FOLLOWER]: Refusing update from remote peer 316e9983905848079a8e6d9ce5585f46: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:23:55.210726 17494 consensus_queue.cc:1048] T d87dace41fef4526a2cace8a5007919f P 316e9983905848079a8e6d9ce5585f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee69eea1a5cc4645acdd4deaa9e0ac7f" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 41127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:23:55.213372 17338 raft_consensus.cc:1275] T 0544fe20b9ca44b18589408ea98f4eed P 316e9983905848079a8e6d9ce5585f46 [term 2 FOLLOWER]: Refusing update from remote peer 726d96e241134d7e9e1851f2cee66d03: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:23:55.215133 17477 consensus_queue.cc:1048] T 0544fe20b9ca44b18589408ea98f4eed P 726d96e241134d7e9e1851f2cee66d03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "316e9983905848079a8e6d9ce5585f46" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 39729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:23:55.228396 17412 raft_consensus.cc:1275] T 0544fe20b9ca44b18589408ea98f4eed P ee69eea1a5cc4645acdd4deaa9e0ac7f [term 2 FOLLOWER]: Refusing update from remote peer 726d96e241134d7e9e1851f2cee66d03: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:23:55.230515 17477 consensus_queue.cc:1048] T 0544fe20b9ca44b18589408ea98f4eed P 726d96e241134d7e9e1851f2cee66d03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee69eea1a5cc4645acdd4deaa9e0ac7f" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 41127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:23:57.383072 17162 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56842:
name: "soft_deleted_table"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:23:57.385563 17162 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table soft_deleted_table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:23:57.442888 17248 tablet_service.cc:1511] Processing CreateTablet for tablet 62599e0920c34027b50cf62f7b652686 (DEFAULT_TABLE table=soft_deleted_table [id=4d00e096d569428da7acb37de74ae81e]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:23:57.444271 17248 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 62599e0920c34027b50cf62f7b652686. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:23:57.444262 17324 tablet_service.cc:1511] Processing CreateTablet for tablet 62599e0920c34027b50cf62f7b652686 (DEFAULT_TABLE table=soft_deleted_table [id=4d00e096d569428da7acb37de74ae81e]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:23:57.445534 17401 tablet_service.cc:1511] Processing CreateTablet for tablet 62599e0920c34027b50cf62f7b652686 (DEFAULT_TABLE table=soft_deleted_table [id=4d00e096d569428da7acb37de74ae81e]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:23:57.446236 17324 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 62599e0920c34027b50cf62f7b652686. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:23:57.447058 17401 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 62599e0920c34027b50cf62f7b652686. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:23:57.448143 17253 tablet_service.cc:1511] Processing CreateTablet for tablet 711feb7b7a864c1d98dfd62c10eb0f99 (DEFAULT_TABLE table=soft_deleted_table [id=4d00e096d569428da7acb37de74ae81e]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:23:57.449568 17253 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 711feb7b7a864c1d98dfd62c10eb0f99. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:23:57.451407 17396 tablet_service.cc:1511] Processing CreateTablet for tablet 711feb7b7a864c1d98dfd62c10eb0f99 (DEFAULT_TABLE table=soft_deleted_table [id=4d00e096d569428da7acb37de74ae81e]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:23:57.452728 17396 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 711feb7b7a864c1d98dfd62c10eb0f99. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:23:57.448143 17325 tablet_service.cc:1511] Processing CreateTablet for tablet 711feb7b7a864c1d98dfd62c10eb0f99 (DEFAULT_TABLE table=soft_deleted_table [id=4d00e096d569428da7acb37de74ae81e]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:23:57.455099 17329 tablet_service.cc:1511] Processing CreateTablet for tablet a71f35e6480646cba674fd6925e001ed (DEFAULT_TABLE table=soft_deleted_table [id=4d00e096d569428da7acb37de74ae81e]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:23:57.460914 17247 tablet_service.cc:1511] Processing CreateTablet for tablet a71f35e6480646cba674fd6925e001ed (DEFAULT_TABLE table=soft_deleted_table [id=4d00e096d569428da7acb37de74ae81e]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:23:57.455487 17325 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 711feb7b7a864c1d98dfd62c10eb0f99. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:23:57.464087 17398 tablet_service.cc:1511] Processing CreateTablet for tablet a71f35e6480646cba674fd6925e001ed (DEFAULT_TABLE table=soft_deleted_table [id=4d00e096d569428da7acb37de74ae81e]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:23:57.465566 17398 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a71f35e6480646cba674fd6925e001ed. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:23:57.468564 17329 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a71f35e6480646cba674fd6925e001ed. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:23:57.476008 17552 tablet_bootstrap.cc:492] T 62599e0920c34027b50cf62f7b652686 P 316e9983905848079a8e6d9ce5585f46: Bootstrap starting.
I20260709 13:23:57.476418 17247 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a71f35e6480646cba674fd6925e001ed. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:23:57.486493 17249 tablet_service.cc:1511] Processing CreateTablet for tablet 62c32fd6e3f74f3b817349f92a686d3c (DEFAULT_TABLE table=soft_deleted_table [id=4d00e096d569428da7acb37de74ae81e]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:23:57.487912 17249 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 62c32fd6e3f74f3b817349f92a686d3c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:23:57.488502 17327 tablet_service.cc:1511] Processing CreateTablet for tablet 62c32fd6e3f74f3b817349f92a686d3c (DEFAULT_TABLE table=soft_deleted_table [id=4d00e096d569428da7acb37de74ae81e]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:23:57.490590 17327 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 62c32fd6e3f74f3b817349f92a686d3c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:23:57.498554 17552 tablet_bootstrap.cc:654] T 62599e0920c34027b50cf62f7b652686 P 316e9983905848079a8e6d9ce5585f46: Neither blocks nor log segments found. Creating new log.
I20260709 13:23:57.502854 17395 tablet_service.cc:1511] Processing CreateTablet for tablet 62c32fd6e3f74f3b817349f92a686d3c (DEFAULT_TABLE table=soft_deleted_table [id=4d00e096d569428da7acb37de74ae81e]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:23:57.504330 17395 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 62c32fd6e3f74f3b817349f92a686d3c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:23:57.523489 17251 tablet_service.cc:1511] Processing CreateTablet for tablet d77e2380b35e4438a224b5148ebc574d (DEFAULT_TABLE table=soft_deleted_table [id=4d00e096d569428da7acb37de74ae81e]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:23:57.525056 17251 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d77e2380b35e4438a224b5148ebc574d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:23:57.528124 17553 tablet_bootstrap.cc:492] T 62599e0920c34027b50cf62f7b652686 P ee69eea1a5cc4645acdd4deaa9e0ac7f: Bootstrap starting.
I20260709 13:23:57.530614 17324 tablet_service.cc:1511] Processing CreateTablet for tablet d77e2380b35e4438a224b5148ebc574d (DEFAULT_TABLE table=soft_deleted_table [id=4d00e096d569428da7acb37de74ae81e]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:23:57.532212 17324 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d77e2380b35e4438a224b5148ebc574d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:23:57.544162 17401 tablet_service.cc:1511] Processing CreateTablet for tablet d77e2380b35e4438a224b5148ebc574d (DEFAULT_TABLE table=soft_deleted_table [id=4d00e096d569428da7acb37de74ae81e]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:23:57.544963 17254 tablet_service.cc:1511] Processing CreateTablet for tablet 27c47c73807f4c7c9535c0873d016f62 (DEFAULT_TABLE table=soft_deleted_table [id=4d00e096d569428da7acb37de74ae81e]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:23:57.545773 17401 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d77e2380b35e4438a224b5148ebc574d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:23:57.546478 17254 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 27c47c73807f4c7c9535c0873d016f62. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:23:57.557240 17326 tablet_service.cc:1511] Processing CreateTablet for tablet 27c47c73807f4c7c9535c0873d016f62 (DEFAULT_TABLE table=soft_deleted_table [id=4d00e096d569428da7acb37de74ae81e]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:23:57.558686 17326 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 27c47c73807f4c7c9535c0873d016f62. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:23:57.559240 17398 tablet_service.cc:1511] Processing CreateTablet for tablet 27c47c73807f4c7c9535c0873d016f62 (DEFAULT_TABLE table=soft_deleted_table [id=4d00e096d569428da7acb37de74ae81e]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:23:57.560511 17398 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 27c47c73807f4c7c9535c0873d016f62. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:23:57.561698 17252 tablet_service.cc:1511] Processing CreateTablet for tablet eb3f366f79ef4b2894bc2dbf6eb14794 (DEFAULT_TABLE table=soft_deleted_table [id=4d00e096d569428da7acb37de74ae81e]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:23:57.563156 17553 tablet_bootstrap.cc:654] T 62599e0920c34027b50cf62f7b652686 P ee69eea1a5cc4645acdd4deaa9e0ac7f: Neither blocks nor log segments found. Creating new log.
I20260709 13:23:57.563172 17252 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eb3f366f79ef4b2894bc2dbf6eb14794. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:23:57.585119 17327 tablet_service.cc:1511] Processing CreateTablet for tablet eb3f366f79ef4b2894bc2dbf6eb14794 (DEFAULT_TABLE table=soft_deleted_table [id=4d00e096d569428da7acb37de74ae81e]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:23:57.587174 17401 tablet_service.cc:1511] Processing CreateTablet for tablet eb3f366f79ef4b2894bc2dbf6eb14794 (DEFAULT_TABLE table=soft_deleted_table [id=4d00e096d569428da7acb37de74ae81e]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:23:57.589250 17401 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eb3f366f79ef4b2894bc2dbf6eb14794. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:23:57.593202 17327 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eb3f366f79ef4b2894bc2dbf6eb14794. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:23:57.602039 17248 tablet_service.cc:1511] Processing CreateTablet for tablet 86979013624c4c96843236a7e7f8a1ec (DEFAULT_TABLE table=soft_deleted_table [id=4d00e096d569428da7acb37de74ae81e]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:23:57.604573 17248 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 86979013624c4c96843236a7e7f8a1ec. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:23:57.619136 17325 tablet_service.cc:1511] Processing CreateTablet for tablet 743cee0b3a8241dfae72c033dc3d776e (DEFAULT_TABLE table=soft_deleted_table [id=4d00e096d569428da7acb37de74ae81e]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:23:57.620290 17396 tablet_service.cc:1511] Processing CreateTablet for tablet 743cee0b3a8241dfae72c033dc3d776e (DEFAULT_TABLE table=soft_deleted_table [id=4d00e096d569428da7acb37de74ae81e]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:23:57.621582 17396 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 743cee0b3a8241dfae72c033dc3d776e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:23:57.617368 17249 tablet_service.cc:1511] Processing CreateTablet for tablet 743cee0b3a8241dfae72c033dc3d776e (DEFAULT_TABLE table=soft_deleted_table [id=4d00e096d569428da7acb37de74ae81e]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:23:57.617113 17552 tablet_bootstrap.cc:492] T 62599e0920c34027b50cf62f7b652686 P 316e9983905848079a8e6d9ce5585f46: No bootstrap required, opened a new log
I20260709 13:23:57.629233 17552 ts_tablet_manager.cc:1403] T 62599e0920c34027b50cf62f7b652686 P 316e9983905848079a8e6d9ce5585f46: Time spent bootstrapping tablet: real 0.154s	user 0.015s	sys 0.017s
I20260709 13:23:57.627130 17249 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 743cee0b3a8241dfae72c033dc3d776e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:23:57.616873 17329 tablet_service.cc:1511] Processing CreateTablet for tablet 86979013624c4c96843236a7e7f8a1ec (DEFAULT_TABLE table=soft_deleted_table [id=4d00e096d569428da7acb37de74ae81e]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:23:57.632974 17552 raft_consensus.cc:359] T 62599e0920c34027b50cf62f7b652686 P 316e9983905848079a8e6d9ce5585f46 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "726d96e241134d7e9e1851f2cee66d03" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 45087 } } peers { permanent_uuid: "316e9983905848079a8e6d9ce5585f46" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 39729 } } peers { permanent_uuid: "ee69eea1a5cc4645acdd4deaa9e0ac7f" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 41127 } }
I20260709 13:23:57.633940 17552 raft_consensus.cc:385] T 62599e0920c34027b50cf62f7b652686 P 316e9983905848079a8e6d9ce5585f46 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:23:57.634328 17552 raft_consensus.cc:740] T 62599e0920c34027b50cf62f7b652686 P 316e9983905848079a8e6d9ce5585f46 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 316e9983905848079a8e6d9ce5585f46, State: Initialized, Role: FOLLOWER
I20260709 13:23:57.635037 17395 tablet_service.cc:1511] Processing CreateTablet for tablet 86979013624c4c96843236a7e7f8a1ec (DEFAULT_TABLE table=soft_deleted_table [id=4d00e096d569428da7acb37de74ae81e]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:23:57.635466 17552 consensus_queue.cc:260] T 62599e0920c34027b50cf62f7b652686 P 316e9983905848079a8e6d9ce5585f46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "726d96e241134d7e9e1851f2cee66d03" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 45087 } } peers { permanent_uuid: "316e9983905848079a8e6d9ce5585f46" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 39729 } } peers { permanent_uuid: "ee69eea1a5cc4645acdd4deaa9e0ac7f" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 41127 } }
I20260709 13:23:57.638360 17552 ts_tablet_manager.cc:1434] T 62599e0920c34027b50cf62f7b652686 P 316e9983905848079a8e6d9ce5585f46: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 13:23:57.639444 17552 tablet_bootstrap.cc:492] T 62c32fd6e3f74f3b817349f92a686d3c P 316e9983905848079a8e6d9ce5585f46: Bootstrap starting.
I20260709 13:23:57.623050 17325 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 743cee0b3a8241dfae72c033dc3d776e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:23:57.642495 17554 tablet_bootstrap.cc:492] T 62c32fd6e3f74f3b817349f92a686d3c P 726d96e241134d7e9e1851f2cee66d03: Bootstrap starting.
I20260709 13:23:57.645198 17553 tablet_bootstrap.cc:492] T 62599e0920c34027b50cf62f7b652686 P ee69eea1a5cc4645acdd4deaa9e0ac7f: No bootstrap required, opened a new log
I20260709 13:23:57.645828 17553 ts_tablet_manager.cc:1403] T 62599e0920c34027b50cf62f7b652686 P ee69eea1a5cc4645acdd4deaa9e0ac7f: Time spent bootstrapping tablet: real 0.118s	user 0.005s	sys 0.009s
I20260709 13:23:57.649561 17553 raft_consensus.cc:359] T 62599e0920c34027b50cf62f7b652686 P ee69eea1a5cc4645acdd4deaa9e0ac7f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "726d96e241134d7e9e1851f2cee66d03" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 45087 } } peers { permanent_uuid: "316e9983905848079a8e6d9ce5585f46" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 39729 } } peers { permanent_uuid: "ee69eea1a5cc4645acdd4deaa9e0ac7f" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 41127 } }
I20260709 13:23:57.650359 17553 raft_consensus.cc:385] T 62599e0920c34027b50cf62f7b652686 P ee69eea1a5cc4645acdd4deaa9e0ac7f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:23:57.650661 17553 raft_consensus.cc:740] T 62599e0920c34027b50cf62f7b652686 P ee69eea1a5cc4645acdd4deaa9e0ac7f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ee69eea1a5cc4645acdd4deaa9e0ac7f, State: Initialized, Role: FOLLOWER
I20260709 13:23:57.656435 17329 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 86979013624c4c96843236a7e7f8a1ec. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:23:57.657886 17395 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 86979013624c4c96843236a7e7f8a1ec. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:23:57.656558 17554 tablet_bootstrap.cc:654] T 62c32fd6e3f74f3b817349f92a686d3c P 726d96e241134d7e9e1851f2cee66d03: Neither blocks nor log segments found. Creating new log.
I20260709 13:23:57.671424 17553 consensus_queue.cc:260] T 62599e0920c34027b50cf62f7b652686 P ee69eea1a5cc4645acdd4deaa9e0ac7f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "726d96e241134d7e9e1851f2cee66d03" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 45087 } } peers { permanent_uuid: "316e9983905848079a8e6d9ce5585f46" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 39729 } } peers { permanent_uuid: "ee69eea1a5cc4645acdd4deaa9e0ac7f" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 41127 } }
I20260709 13:23:57.677860 17553 ts_tablet_manager.cc:1434] T 62599e0920c34027b50cf62f7b652686 P ee69eea1a5cc4645acdd4deaa9e0ac7f: Time spent starting tablet: real 0.032s	user 0.004s	sys 0.004s
I20260709 13:23:57.679088 17553 tablet_bootstrap.cc:492] T a71f35e6480646cba674fd6925e001ed P ee69eea1a5cc4645acdd4deaa9e0ac7f: Bootstrap starting.
I20260709 13:23:57.684881 17552 tablet_bootstrap.cc:654] T 62c32fd6e3f74f3b817349f92a686d3c P 316e9983905848079a8e6d9ce5585f46: Neither blocks nor log segments found. Creating new log.
I20260709 13:23:57.686532 17553 tablet_bootstrap.cc:654] T a71f35e6480646cba674fd6925e001ed P ee69eea1a5cc4645acdd4deaa9e0ac7f: Neither blocks nor log segments found. Creating new log.
I20260709 13:23:57.689402 17554 tablet_bootstrap.cc:492] T 62c32fd6e3f74f3b817349f92a686d3c P 726d96e241134d7e9e1851f2cee66d03: No bootstrap required, opened a new log
I20260709 13:23:57.690193 17554 ts_tablet_manager.cc:1403] T 62c32fd6e3f74f3b817349f92a686d3c P 726d96e241134d7e9e1851f2cee66d03: Time spent bootstrapping tablet: real 0.048s	user 0.003s	sys 0.011s
I20260709 13:23:57.694523 17554 raft_consensus.cc:359] T 62c32fd6e3f74f3b817349f92a686d3c P 726d96e241134d7e9e1851f2cee66d03 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "726d96e241134d7e9e1851f2cee66d03" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 45087 } } peers { permanent_uuid: "316e9983905848079a8e6d9ce5585f46" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 39729 } } peers { permanent_uuid: "ee69eea1a5cc4645acdd4deaa9e0ac7f" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 41127 } }
I20260709 13:23:57.708410 17554 raft_consensus.cc:385] T 62c32fd6e3f74f3b817349f92a686d3c P 726d96e241134d7e9e1851f2cee66d03 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:23:57.708853 17554 raft_consensus.cc:740] T 62c32fd6e3f74f3b817349f92a686d3c P 726d96e241134d7e9e1851f2cee66d03 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 726d96e241134d7e9e1851f2cee66d03, State: Initialized, Role: FOLLOWER
I20260709 13:23:57.699357 17553 tablet_bootstrap.cc:492] T a71f35e6480646cba674fd6925e001ed P ee69eea1a5cc4645acdd4deaa9e0ac7f: No bootstrap required, opened a new log
I20260709 13:23:57.709863 17553 ts_tablet_manager.cc:1403] T a71f35e6480646cba674fd6925e001ed P ee69eea1a5cc4645acdd4deaa9e0ac7f: Time spent bootstrapping tablet: real 0.031s	user 0.015s	sys 0.004s
I20260709 13:23:57.709681 17554 consensus_queue.cc:260] T 62c32fd6e3f74f3b817349f92a686d3c P 726d96e241134d7e9e1851f2cee66d03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "726d96e241134d7e9e1851f2cee66d03" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 45087 } } peers { permanent_uuid: "316e9983905848079a8e6d9ce5585f46" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 39729 } } peers { permanent_uuid: "ee69eea1a5cc4645acdd4deaa9e0ac7f" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 41127 } }
I20260709 13:23:57.712464 17554 ts_tablet_manager.cc:1434] T 62c32fd6e3f74f3b817349f92a686d3c P 726d96e241134d7e9e1851f2cee66d03: Time spent starting tablet: real 0.022s	user 0.004s	sys 0.005s
I20260709 13:23:57.713800 17554 tablet_bootstrap.cc:492] T 711feb7b7a864c1d98dfd62c10eb0f99 P 726d96e241134d7e9e1851f2cee66d03: Bootstrap starting.
I20260709 13:23:57.716324 17552 tablet_bootstrap.cc:492] T 62c32fd6e3f74f3b817349f92a686d3c P 316e9983905848079a8e6d9ce5585f46: No bootstrap required, opened a new log
I20260709 13:23:57.717142 17552 ts_tablet_manager.cc:1403] T 62c32fd6e3f74f3b817349f92a686d3c P 316e9983905848079a8e6d9ce5585f46: Time spent bootstrapping tablet: real 0.078s	user 0.012s	sys 0.002s
I20260709 13:23:57.720674 17552 raft_consensus.cc:359] T 62c32fd6e3f74f3b817349f92a686d3c P 316e9983905848079a8e6d9ce5585f46 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "726d96e241134d7e9e1851f2cee66d03" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 45087 } } peers { permanent_uuid: "316e9983905848079a8e6d9ce5585f46" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 39729 } } peers { permanent_uuid: "ee69eea1a5cc4645acdd4deaa9e0ac7f" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 41127 } }
I20260709 13:23:57.721549 17552 raft_consensus.cc:385] T 62c32fd6e3f74f3b817349f92a686d3c P 316e9983905848079a8e6d9ce5585f46 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:23:57.721951 17552 raft_consensus.cc:740] T 62c32fd6e3f74f3b817349f92a686d3c P 316e9983905848079a8e6d9ce5585f46 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 316e9983905848079a8e6d9ce5585f46, State: Initialized, Role: FOLLOWER
I20260709 13:23:57.713807 17553 raft_consensus.cc:359] T a71f35e6480646cba674fd6925e001ed P ee69eea1a5cc4645acdd4deaa9e0ac7f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "726d96e241134d7e9e1851f2cee66d03" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 45087 } } peers { permanent_uuid: "316e9983905848079a8e6d9ce5585f46" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 39729 } } peers { permanent_uuid: "ee69eea1a5cc4645acdd4deaa9e0ac7f" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 41127 } }
I20260709 13:23:57.723029 17552 consensus_queue.cc:260] T 62c32fd6e3f74f3b817349f92a686d3c P 316e9983905848079a8e6d9ce5585f46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "726d96e241134d7e9e1851f2cee66d03" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 45087 } } peers { permanent_uuid: "316e9983905848079a8e6d9ce5585f46" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 39729 } } peers { permanent_uuid: "ee69eea1a5cc4645acdd4deaa9e0ac7f" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 41127 } }
I20260709 13:23:57.724951 17552 ts_tablet_manager.cc:1434] T 62c32fd6e3f74f3b817349f92a686d3c P 316e9983905848079a8e6d9ce5585f46: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:23:57.729408 17552 tablet_bootstrap.cc:492] T 711feb7b7a864c1d98dfd62c10eb0f99 P 316e9983905848079a8e6d9ce5585f46: Bootstrap starting.
I20260709 13:23:57.729705 17553 raft_consensus.cc:385] T a71f35e6480646cba674fd6925e001ed P ee69eea1a5cc4645acdd4deaa9e0ac7f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:23:57.732288 17553 raft_consensus.cc:740] T a71f35e6480646cba674fd6925e001ed P ee69eea1a5cc4645acdd4deaa9e0ac7f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ee69eea1a5cc4645acdd4deaa9e0ac7f, State: Initialized, Role: FOLLOWER
I20260709 13:23:57.733436 17553 consensus_queue.cc:260] T a71f35e6480646cba674fd6925e001ed P ee69eea1a5cc4645acdd4deaa9e0ac7f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "726d96e241134d7e9e1851f2cee66d03" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 45087 } } peers { permanent_uuid: "316e9983905848079a8e6d9ce5585f46" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 39729 } } peers { permanent_uuid: "ee69eea1a5cc4645acdd4deaa9e0ac7f" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 41127 } }
I20260709 13:23:57.732479 17554 tablet_bootstrap.cc:654] T 711feb7b7a864c1d98dfd62c10eb0f99 P 726d96e241134d7e9e1851f2cee66d03: Neither blocks nor log segments found. Creating new log.
I20260709 13:23:57.738477 17552 tablet_bootstrap.cc:654] T 711feb7b7a864c1d98dfd62c10eb0f99 P 316e9983905848079a8e6d9ce5585f46: Neither blocks nor log segments found. Creating new log.
I20260709 13:23:57.739728 17553 ts_tablet_manager.cc:1434] T a71f35e6480646cba674fd6925e001ed P ee69eea1a5cc4645acdd4deaa9e0ac7f: Time spent starting tablet: real 0.029s	user 0.006s	sys 0.001s
I20260709 13:23:57.745283 17553 tablet_bootstrap.cc:492] T 711feb7b7a864c1d98dfd62c10eb0f99 P ee69eea1a5cc4645acdd4deaa9e0ac7f: Bootstrap starting.
I20260709 13:23:57.749290 17552 tablet_bootstrap.cc:492] T 711feb7b7a864c1d98dfd62c10eb0f99 P 316e9983905848079a8e6d9ce5585f46: No bootstrap required, opened a new log
I20260709 13:23:57.750285 17552 ts_tablet_manager.cc:1403] T 711feb7b7a864c1d98dfd62c10eb0f99 P 316e9983905848079a8e6d9ce5585f46: Time spent bootstrapping tablet: real 0.021s	user 0.009s	sys 0.005s
I20260709 13:23:57.752843 17554 tablet_bootstrap.cc:492] T 711feb7b7a864c1d98dfd62c10eb0f99 P 726d96e241134d7e9e1851f2cee66d03: No bootstrap required, opened a new log
I20260709 13:23:57.753512 17554 ts_tablet_manager.cc:1403] T 711feb7b7a864c1d98dfd62c10eb0f99 P 726d96e241134d7e9e1851f2cee66d03: Time spent bootstrapping tablet: real 0.040s	user 0.016s	sys 0.002s
I20260709 13:23:57.754262 17553 tablet_bootstrap.cc:654] T 711feb7b7a864c1d98dfd62c10eb0f99 P ee69eea1a5cc4645acdd4deaa9e0ac7f: Neither blocks nor log segments found. Creating new log.
I20260709 13:23:57.754952 17552 raft_consensus.cc:359] T 711feb7b7a864c1d98dfd62c10eb0f99 P 316e9983905848079a8e6d9ce5585f46 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "726d96e241134d7e9e1851f2cee66d03" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 45087 } } peers { permanent_uuid: "316e9983905848079a8e6d9ce5585f46" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 39729 } } peers { permanent_uuid: "ee69eea1a5cc4645acdd4deaa9e0ac7f" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 41127 } }
I20260709 13:23:57.756124 17552 raft_consensus.cc:385] T 711feb7b7a864c1d98dfd62c10eb0f99 P 316e9983905848079a8e6d9ce5585f46 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:23:57.756578 17552 raft_consensus.cc:740] T 711feb7b7a864c1d98dfd62c10eb0f99 P 316e9983905848079a8e6d9ce5585f46 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 316e9983905848079a8e6d9ce5585f46, State: Initialized, Role: FOLLOWER
I20260709 13:23:57.757427 17554 raft_consensus.cc:359] T 711feb7b7a864c1d98dfd62c10eb0f99 P 726d96e241134d7e9e1851f2cee66d03 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "726d96e241134d7e9e1851f2cee66d03" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 45087 } } peers { permanent_uuid: "316e9983905848079a8e6d9ce5585f46" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 39729 } } peers { permanent_uuid: "ee69eea1a5cc4645acdd4deaa9e0ac7f" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 41127 } }
I20260709 13:23:57.758311 17554 raft_consensus.cc:385] T 711feb7b7a864c1d98dfd62c10eb0f99 P 726d96e241134d7e9e1851f2cee66d03 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:23:57.758644 17554 raft_consensus.cc:740] T 711feb7b7a864c1d98dfd62c10eb0f99 P 726d96e241134d7e9e1851f2cee66d03 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 726d96e241134d7e9e1851f2cee66d03, State: Initialized, Role: FOLLOWER
I20260709 13:23:57.757704 17552 consensus_queue.cc:260] T 711feb7b7a864c1d98dfd62c10eb0f99 P 316e9983905848079a8e6d9ce5585f46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "726d96e241134d7e9e1851f2cee66d03" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 45087 } } peers { permanent_uuid: "316e9983905848079a8e6d9ce5585f46" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 39729 } } peers { permanent_uuid: "ee69eea1a5cc4645acdd4deaa9e0ac7f" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 41127 } }
I20260709 13:23:57.762307 17552 ts_tablet_manager.cc:1434] T 711feb7b7a864c1d98dfd62c10eb0f99 P 316e9983905848079a8e6d9ce5585f46: Time spent starting tablet: real 0.012s	user 0.009s	sys 0.000s
I20260709 13:23:57.764292 17552 tablet_bootstrap.cc:492] T a71f35e6480646cba674fd6925e001ed P 316e9983905848079a8e6d9ce5585f46: Bootstrap starting.
I20260709 13:23:57.759509 17554 consensus_queue.cc:260] T 711feb7b7a864c1d98dfd62c10eb0f99 P 726d96e241134d7e9e1851f2cee66d03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "726d96e241134d7e9e1851f2cee66d03" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 45087 } } peers { permanent_uuid: "316e9983905848079a8e6d9ce5585f46" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 39729 } } peers { permanent_uuid: "ee69eea1a5cc4645acdd4deaa9e0ac7f" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 41127 } }
I20260709 13:23:57.770697 17553 tablet_bootstrap.cc:492] T 711feb7b7a864c1d98dfd62c10eb0f99 P ee69eea1a5cc4645acdd4deaa9e0ac7f: No bootstrap required, opened a new log
I20260709 13:23:57.771651 17553 ts_tablet_manager.cc:1403] T 711feb7b7a864c1d98dfd62c10eb0f99 P ee69eea1a5cc4645acdd4deaa9e0ac7f: Time spent bootstrapping tablet: real 0.027s	user 0.010s	sys 0.013s
I20260709 13:23:57.775132 17552 tablet_bootstrap.cc:654] T a71f35e6480646cba674fd6925e001ed P 316e9983905848079a8e6d9ce5585f46: Neither blocks nor log segments found. Creating new log.
I20260709 13:23:57.776059 17554 ts_tablet_manager.cc:1434] T 711feb7b7a864c1d98dfd62c10eb0f99 P 726d96e241134d7e9e1851f2cee66d03: Time spent starting tablet: real 0.022s	user 0.007s	sys 0.001s
I20260709 13:23:57.775724 17553 raft_consensus.cc:359] T 711feb7b7a864c1d98dfd62c10eb0f99 P ee69eea1a5cc4645acdd4deaa9e0ac7f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "726d96e241134d7e9e1851f2cee66d03" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 45087 } } peers { permanent_uuid: "316e9983905848079a8e6d9ce5585f46" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 39729 } } peers { permanent_uuid: "ee69eea1a5cc4645acdd4deaa9e0ac7f" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 41127 } }
I20260709 13:23:57.777061 17553 raft_consensus.cc:385] T 711feb7b7a864c1d98dfd62c10eb0f99 P ee69eea1a5cc4645acdd4deaa9e0ac7f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:23:57.777482 17553 raft_consensus.cc:740] T 711feb7b7a864c1d98dfd62c10eb0f99 P ee69eea1a5cc4645acdd4deaa9e0ac7f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ee69eea1a5cc4645acdd4deaa9e0ac7f, State: Initialized, Role: FOLLOWER
I20260709 13:23:57.778549 17553 consensus_queue.cc:260] T 711feb7b7a864c1d98dfd62c10eb0f99 P ee69eea1a5cc4645acdd4deaa9e0ac7f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "726d96e241134d7e9e1851f2cee66d03" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 45087 } } peers { permanent_uuid: "316e9983905848079a8e6d9ce5585f46" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 39729 } } peers { permanent_uuid: "ee69eea1a5cc4645acdd4deaa9e0ac7f" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 41127 } }
I20260709 13:23:57.779942 17554 tablet_bootstrap.cc:492] T 62599e0920c34027b50cf62f7b652686 P 726d96e241134d7e9e1851f2cee66d03: Bootstrap starting.
I20260709 13:23:57.782450 17553 ts_tablet_manager.cc:1434] T 711feb7b7a864c1d98dfd62c10eb0f99 P ee69eea1a5cc4645acdd4deaa9e0ac7f: Time spent starting tablet: real 0.010s	user 0.004s	sys 0.003s
I20260709 13:23:57.785004 17553 tablet_bootstrap.cc:492] T d77e2380b35e4438a224b5148ebc574d P ee69eea1a5cc4645acdd4deaa9e0ac7f: Bootstrap starting.
I20260709 13:23:57.792116 17554 tablet_bootstrap.cc:654] T 62599e0920c34027b50cf62f7b652686 P 726d96e241134d7e9e1851f2cee66d03: Neither blocks nor log segments found. Creating new log.
I20260709 13:23:57.801606 17552 tablet_bootstrap.cc:492] T a71f35e6480646cba674fd6925e001ed P 316e9983905848079a8e6d9ce5585f46: No bootstrap required, opened a new log
I20260709 13:23:57.802296 17553 tablet_bootstrap.cc:654] T d77e2380b35e4438a224b5148ebc574d P ee69eea1a5cc4645acdd4deaa9e0ac7f: Neither blocks nor log segments found. Creating new log.
I20260709 13:23:57.802480 17552 ts_tablet_manager.cc:1403] T a71f35e6480646cba674fd6925e001ed P 316e9983905848079a8e6d9ce5585f46: Time spent bootstrapping tablet: real 0.039s	user 0.021s	sys 0.015s
I20260709 13:23:57.802965 17554 tablet_bootstrap.cc:492] T 62599e0920c34027b50cf62f7b652686 P 726d96e241134d7e9e1851f2cee66d03: No bootstrap required, opened a new log
I20260709 13:23:57.803529 17554 ts_tablet_manager.cc:1403] T 62599e0920c34027b50cf62f7b652686 P 726d96e241134d7e9e1851f2cee66d03: Time spent bootstrapping tablet: real 0.024s	user 0.012s	sys 0.003s
I20260709 13:23:57.806612 17554 raft_consensus.cc:359] T 62599e0920c34027b50cf62f7b652686 P 726d96e241134d7e9e1851f2cee66d03 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "726d96e241134d7e9e1851f2cee66d03" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 45087 } } peers { permanent_uuid: "316e9983905848079a8e6d9ce5585f46" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 39729 } } peers { permanent_uuid: "ee69eea1a5cc4645acdd4deaa9e0ac7f" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 41127 } }
I20260709 13:23:57.807349 17554 raft_consensus.cc:385] T 62599e0920c34027b50cf62f7b652686 P 726d96e241134d7e9e1851f2cee66d03 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:23:57.807633 17554 raft_consensus.cc:740] T 62599e0920c34027b50cf62f7b652686 P 726d96e241134d7e9e1851f2cee66d03 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 726d96e241134d7e9e1851f2cee66d03, State: Initialized, Role: FOLLOWER
I20260709 13:23:57.807523 17552 raft_consensus.cc:359] T a71f35e6480646cba674fd6925e001ed P 316e9983905848079a8e6d9ce5585f46 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "726d96e241134d7e9e1851f2cee66d03" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 45087 } } peers { permanent_uuid: "316e9983905848079a8e6d9ce5585f46" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 39729 } } peers { permanent_uuid: "ee69eea1a5cc4645acdd4deaa9e0ac7f" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 41127 } }
I20260709 13:23:57.809056 17554 consensus_queue.cc:260] T 62599e0920c34027b50cf62f7b652686 P 726d96e241134d7e9e1851f2cee66d03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "726d96e241134d7e9e1851f2cee66d03" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 45087 } } peers { permanent_uuid: "316e9983905848079a8e6d9ce5585f46" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 39729 } } peers { permanent_uuid: "ee69eea1a5cc4645acdd4deaa9e0ac7f" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 41127 } }
I20260709 13:23:57.809579 17552 raft_consensus.cc:385] T a71f35e6480646cba674fd6925e001ed P 316e9983905848079a8e6d9ce5585f46 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:23:57.810143 17552 raft_consensus.cc:740] T a71f35e6480646cba674fd6925e001ed P 316e9983905848079a8e6d9ce5585f46 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 316e9983905848079a8e6d9ce5585f46, State: Initialized, Role: FOLLOWER
I20260709 13:23:57.811566 17554 ts_tablet_manager.cc:1434] T 62599e0920c34027b50cf62f7b652686 P 726d96e241134d7e9e1851f2cee66d03: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.004s
I20260709 13:23:57.811849 17552 consensus_queue.cc:260] T a71f35e6480646cba674fd6925e001ed P 316e9983905848079a8e6d9ce5585f46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "726d96e241134d7e9e1851f2cee66d03" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 45087 } } peers { permanent_uuid: "316e9983905848079a8e6d9ce5585f46" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 39729 } } peers { permanent_uuid: "ee69eea1a5cc4645acdd4deaa9e0ac7f" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 41127 } }
I20260709 13:23:57.813792 17554 tablet_bootstrap.cc:492] T a71f35e6480646cba674fd6925e001ed P 726d96e241134d7e9e1851f2cee66d03: Bootstrap starting.
I20260709 13:23:57.816146 17553 tablet_bootstrap.cc:492] T d77e2380b35e4438a224b5148ebc574d P ee69eea1a5cc4645acdd4deaa9e0ac7f: No bootstrap required, opened a new log
I20260709 13:23:57.816250 17494 raft_consensus.cc:493] T 62599e0920c34027b50cf62f7b652686 P 316e9983905848079a8e6d9ce5585f46 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:23:57.817032 17553 ts_tablet_manager.cc:1403] T d77e2380b35e4438a224b5148ebc574d P ee69eea1a5cc4645acdd4deaa9e0ac7f: Time spent bootstrapping tablet: real 0.032s	user 0.019s	sys 0.005s
I20260709 13:23:57.816968 17494 raft_consensus.cc:515] T 62599e0920c34027b50cf62f7b652686 P 316e9983905848079a8e6d9ce5585f46 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "726d96e241134d7e9e1851f2cee66d03" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 45087 } } peers { permanent_uuid: "316e9983905848079a8e6d9ce5585f46" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 39729 } } peers { permanent_uuid: "ee69eea1a5cc4645acdd4deaa9e0ac7f" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 41127 } }
I20260709 13:23:57.821229 17553 raft_consensus.cc:359] T d77e2380b35e4438a224b5148ebc574d P ee69eea1a5cc4645acdd4deaa9e0ac7f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "726d96e241134d7e9e1851f2cee66d03" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 45087 } } peers { permanent_uuid: "316e9983905848079a8e6d9ce5585f46" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 39729 } } peers { permanent_uuid: "ee69eea1a5cc4645acdd4deaa9e0ac7f" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 41127 } }
I20260709 13:23:57.822089 17553 raft_consensus.cc:385] T d77e2380b35e4438a224b5148ebc574d P ee69eea1a5cc4645acdd4deaa9e0ac7f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:23:57.822461 17553 raft_consensus.cc:740] T d77e2380b35e4438a224b5148ebc574d P ee69eea1a5cc4645acdd4deaa9e0ac7f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ee69eea1a5cc4645acdd4deaa9e0ac7f, State: Initialized, Role: FOLLOWER
I20260709 13:23:57.822679 17554 tablet_bootstrap.cc:654] T a71f35e6480646cba674fd6925e001ed P 726d96e241134d7e9e1851f2cee66d03: Neither blocks nor log segments found. Creating new log.
I20260709 13:23:57.823423 17553 consensus_queue.cc:260] T d77e2380b35e4438a224b5148ebc574d P ee69eea1a5cc4645acdd4deaa9e0ac7f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "726d96e241134d7e9e1851f2cee66d03" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 45087 } } peers { permanent_uuid: "316e9983905848079a8e6d9ce5585f46" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 39729 } } peers { permanent_uuid: "ee69eea1a5cc4645acdd4deaa9e0ac7f" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 41127 } }
I20260709 13:23:57.825213 17487 raft_consensus.cc:493] T a71f35e6480646cba674fd6925e001ed P ee69eea1a5cc4645acdd4deaa9e0ac7f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:23:57.825801 17487 raft_consensus.cc:515] T a71f35e6480646cba674fd6925e001ed P ee69eea1a5cc4645acdd4deaa9e0ac7f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "726d96e241134d7e9e1851f2cee66d03" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 45087 } } peers { permanent_uuid: "316e9983905848079a8e6d9ce5585f46" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 39729 } } peers { permanent_uuid: "ee69eea1a5cc4645acdd4deaa9e0ac7f" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 41127 } }
I20260709 13:23:57.829805 17338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a71f35e6480646cba674fd6925e001ed" candidate_uuid: "ee69eea1a5cc4645acdd4deaa9e0ac7f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "316e9983905848079a8e6d9ce5585f46" is_pre_election: true
I20260709 13:23:57.830490 17264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a71f35e6480646cba674fd6925e001ed" candidate_uuid: "ee69eea1a5cc4645acdd4deaa9e0ac7f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "726d96e241134d7e9e1851f2cee66d03" is_pre_election: true
I20260709 13:23:57.831091 17487 leader_election.cc:290] T a71f35e6480646cba674fd6925e001ed P ee69eea1a5cc4645acdd4deaa9e0ac7f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 726d96e241134d7e9e1851f2cee66d03 (127.5.126.65:45087), 316e9983905848079a8e6d9ce5585f46 (127.5.126.66:39729)
I20260709 13:23:57.830652 17338 raft_consensus.cc:2468] T a71f35e6480646cba674fd6925e001ed P 316e9983905848079a8e6d9ce5585f46 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee69eea1a5cc4645acdd4deaa9e0ac7f in term 0.
I20260709 13:23:57.832639 17262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62599e0920c34027b50cf62f7b652686" candidate_uuid: "316e9983905848079a8e6d9ce5585f46" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "726d96e241134d7e9e1851f2cee66d03" is_pre_election: true
I20260709 13:23:57.833292 17376 leader_election.cc:304] T a71f35e6480646cba674fd6925e001ed P ee69eea1a5cc4645acdd4deaa9e0ac7f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 316e9983905848079a8e6d9ce5585f46, ee69eea1a5cc4645acdd4deaa9e0ac7f; no voters: 
I20260709 13:23:57.833647 17262 raft_consensus.cc:2468] T 62599e0920c34027b50cf62f7b652686 P 726d96e241134d7e9e1851f2cee66d03 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 316e9983905848079a8e6d9ce5585f46 in term 0.
I20260709 13:23:57.834410 17487 raft_consensus.cc:2804] T a71f35e6480646cba674fd6925e001ed P ee69eea1a5cc4645acdd4deaa9e0ac7f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:23:57.834843 17487 raft_consensus.cc:493] T a71f35e6480646cba674fd6925e001ed P ee69eea1a5cc4645acdd4deaa9e0ac7f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:23:57.834810 17410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62599e0920c34027b50cf62f7b652686" candidate_uuid: "316e9983905848079a8e6d9ce5585f46" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee69eea1a5cc4645acdd4deaa9e0ac7f" is_pre_election: true
I20260709 13:23:57.835546 17487 raft_consensus.cc:3060] T a71f35e6480646cba674fd6925e001ed P ee69eea1a5cc4645acdd4deaa9e0ac7f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:23:57.835790 17410 raft_consensus.cc:2468] T 62599e0920c34027b50cf62f7b652686 P ee69eea1a5cc4645acdd4deaa9e0ac7f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 316e9983905848079a8e6d9ce5585f46 in term 0.
I20260709 13:23:57.837612 17302 leader_election.cc:304] T 62599e0920c34027b50cf62f7b652686 P 316e9983905848079a8e6d9ce5585f46 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 316e9983905848079a8e6d9ce5585f46, ee69eea1a5cc4645acdd4deaa9e0ac7f; no voters: 
I20260709 13:23:57.838698 17541 raft_consensus.cc:2804] T 62599e0920c34027b50cf62f7b652686 P 316e9983905848079a8e6d9ce5585f46 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:23:57.839140 17541 raft_consensus.cc:493] T 62599e0920c34027b50cf62f7b652686 P 316e9983905848079a8e6d9ce5585f46 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:23:57.839498 17541 raft_consensus.cc:3060] T 62599e0920c34027b50cf62f7b652686 P 316e9983905848079a8e6d9ce5585f46 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:23:57.840533 17379 leader_election.cc:343] T a71f35e6480646cba674fd6925e001ed P ee69eea1a5cc4645acdd4deaa9e0ac7f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 726d96e241134d7e9e1851f2cee66d03 (127.5.126.65:45087): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:23:57.843009 17494 leader_election.cc:290] T 62599e0920c34027b50cf62f7b652686 P 316e9983905848079a8e6d9ce5585f46 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 726d96e241134d7e9e1851f2cee66d03 (127.5.126.65:45087), ee69eea1a5cc4645acdd4deaa9e0ac7f (127.5.126.67:41127)
I20260709 13:23:57.844774 17553 ts_tablet_manager.cc:1434] T d77e2380b35e4438a224b5148ebc574d P ee69eea1a5cc4645acdd4deaa9e0ac7f: Time spent starting tablet: real 0.027s	user 0.008s	sys 0.002s
I20260709 13:23:57.846221 17553 tablet_bootstrap.cc:492] T 62c32fd6e3f74f3b817349f92a686d3c P ee69eea1a5cc4645acdd4deaa9e0ac7f: Bootstrap starting.
I20260709 13:23:57.845940 17487 raft_consensus.cc:515] T a71f35e6480646cba674fd6925e001ed P ee69eea1a5cc4645acdd4deaa9e0ac7f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "726d96e241134d7e9e1851f2cee66d03" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 45087 } } peers { permanent_uuid: "316e9983905848079a8e6d9ce5585f46" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 39729 } } peers { permanent_uuid: "ee69eea1a5cc4645acdd4deaa9e0ac7f" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 41127 } }
I20260709 13:23:57.843088 17552 ts_tablet_manager.cc:1434] T a71f35e6480646cba674fd6925e001ed P 316e9983905848079a8e6d9ce5585f46: Time spent starting tablet: real 0.040s	user 0.011s	sys 0.000s
I20260709 13:23:57.848122 17552 tablet_bootstrap.cc:492] T d77e2380b35e4438a224b5148ebc574d P 316e9983905848079a8e6d9ce5585f46: Bootstrap starting.
I20260709 13:23:57.853281 17262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a71f35e6480646cba674fd6925e001ed" candidate_uuid: "ee69eea1a5cc4645acdd4deaa9e0ac7f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "726d96e241134d7e9e1851f2cee66d03"
I20260709 13:23:57.854943 17487 leader_election.cc:290] T a71f35e6480646cba674fd6925e001ed P ee69eea1a5cc4645acdd4deaa9e0ac7f [CANDIDATE]: Term 1 election: Requested vote from peers 726d96e241134d7e9e1851f2cee66d03 (127.5.126.65:45087), 316e9983905848079a8e6d9ce5585f46 (127.5.126.66:39729)
I20260709 13:23:57.856065 17338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a71f35e6480646cba674fd6925e001ed" candidate_uuid: "ee69eea1a5cc4645acdd4deaa9e0ac7f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "316e9983905848079a8e6d9ce5585f46"
I20260709 13:23:57.862485 17338 raft_consensus.cc:3060] T a71f35e6480646cba674fd6925e001ed P 316e9983905848079a8e6d9ce5585f46 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:23:57.856868 17379 leader_election.cc:343] T a71f35e6480646cba674fd6925e001ed P ee69eea1a5cc4645acdd4deaa9e0ac7f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 726d96e241134d7e9e1851f2cee66d03 (127.5.126.65:45087): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:23:57.867161 17553 tablet_bootstrap.cc:654] T 62c32fd6e3f74f3b817349f92a686d3c P ee69eea1a5cc4645acdd4deaa9e0ac7f: Neither blocks nor log segments found. Creating new log.
I20260709 13:23:57.866088 17552 tablet_bootstrap.cc:654] T d77e2380b35e4438a224b5148ebc574d P 316e9983905848079a8e6d9ce5585f46: Neither blocks nor log segments found. Creating new log.
I20260709 13:23:57.881767 17541 raft_consensus.cc:515] T 62599e0920c34027b50cf62f7b652686 P 316e9983905848079a8e6d9ce5585f46 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "726d96e241134d7e9e1851f2cee66d03" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 45087 } } peers { permanent_uuid: "316e9983905848079a8e6d9ce5585f46" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 39729 } } peers { permanent_uuid: "ee69eea1a5cc4645acdd4deaa9e0ac7f" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 41127 } }
I20260709 13:23:57.884124 17552 tablet_bootstrap.cc:492] T d77e2380b35e4438a224b5148ebc574d P 316e9983905848079a8e6d9ce5585f46: No bootstrap required, opened a new log
I20260709 13:23:57.884816 17552 ts_tablet_manager.cc:1403] T d77e2380b35e4438a224b5148ebc574d P 316e9983905848079a8e6d9ce5585f46: Time spent bootstrapping tablet: real 0.037s	user 0.005s	sys 0.011s
I20260709 13:23:57.886195 17541 leader_election.cc:290] T 62599e0920c34027b50cf62f7b652686 P 316e9983905848079a8e6d9ce5585f46 [CANDIDATE]: Term 1 election: Requested vote from peers 726d96e241134d7e9e1851f2cee66d03 (127.5.126.65:45087), ee69eea1a5cc4645acdd4deaa9e0ac7f (127.5.126.67:41127)
I20260709 13:23:57.886698 17262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62599e0920c34027b50cf62f7b652686" candidate_uuid: "316e9983905848079a8e6d9ce5585f46" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "726d96e241134d7e9e1851f2cee66d03"
I20260709 13:23:57.887701 17262 raft_consensus.cc:3060] T 62599e0920c34027b50cf62f7b652686 P 726d96e241134d7e9e1851f2cee66d03 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:23:57.889510 17552 raft_consensus.cc:359] T d77e2380b35e4438a224b5148ebc574d P 316e9983905848079a8e6d9ce5585f46 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "726d96e241134d7e9e1851f2cee66d03" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 45087 } } peers { permanent_uuid: "316e9983905848079a8e6d9ce5585f46" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 39729 } } peers { permanent_uuid: "ee69eea1a5cc4645acdd4deaa9e0ac7f" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 41127 } }
I20260709 13:23:57.890884 17552 raft_consensus.cc:385] T d77e2380b35e4438a224b5148ebc574d P 316e9983905848079a8e6d9ce5585f46 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:23:57.891337 17552 raft_consensus.cc:740] T d77e2380b35e4438a224b5148ebc574d P 316e9983905848079a8e6d9ce5585f46 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 316e9983905848079a8e6d9ce5585f46, State: Initialized, Role: FOLLOWER
I20260709 13:23:57.892709 17552 consensus_queue.cc:260] T d77e2380b35e4438a224b5148ebc574d P 316e9983905848079a8e6d9ce5585f46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "726d96e241134d7e9e1851f2cee66d03" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 45087 } } peers { permanent_uuid: "316e9983905848079a8e6d9ce5585f46" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 39729 } } peers { permanent_uuid: "ee69eea1a5cc4645acdd4deaa9e0ac7f" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 41127 } }
I20260709 13:23:57.893498 17410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62599e0920c34027b50cf62f7b652686" candidate_uuid: "316e9983905848079a8e6d9ce5585f46" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee69eea1a5cc4645acdd4deaa9e0ac7f"
I20260709 13:23:57.896487 17410 raft_consensus.cc:3060] T 62599e0920c34027b50cf62f7b652686 P ee69eea1a5cc4645acdd4deaa9e0ac7f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:23:57.909555 17410 raft_consensus.cc:2468] T 62599e0920c34027b50cf62f7b652686 P ee69eea1a5cc4645acdd4deaa9e0ac7f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 316e9983905848079a8e6d9ce5585f46 in term 1.
I20260709 13:23:57.911676 17302 leader_election.cc:304] T 62599e0920c34027b50cf62f7b652686 P 316e9983905848079a8e6d9ce5585f46 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 316e9983905848079a8e6d9ce5585f46, ee69eea1a5cc4645acdd4deaa9e0ac7f; no voters: 
I20260709 13:23:57.913589 17541 raft_consensus.cc:2804] T 62599e0920c34027b50cf62f7b652686 P 316e9983905848079a8e6d9ce5585f46 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:23:57.914232 17541 raft_consensus.cc:697] T 62599e0920c34027b50cf62f7b652686 P 316e9983905848079a8e6d9ce5585f46 [term 1 LEADER]: Becoming Leader. State: Replica: 316e9983905848079a8e6d9ce5585f46, State: Running, Role: LEADER
I20260709 13:23:57.896625 17552 ts_tablet_manager.cc:1434] T d77e2380b35e4438a224b5148ebc574d P 316e9983905848079a8e6d9ce5585f46: Time spent starting tablet: real 0.011s	user 0.012s	sys 0.000s
I20260709 13:23:57.915341 17541 consensus_queue.cc:237] T 62599e0920c34027b50cf62f7b652686 P 316e9983905848079a8e6d9ce5585f46 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "726d96e241134d7e9e1851f2cee66d03" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 45087 } } peers { permanent_uuid: "316e9983905848079a8e6d9ce5585f46" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 39729 } } peers { permanent_uuid: "ee69eea1a5cc4645acdd4deaa9e0ac7f" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 41127 } }
I20260709 13:23:57.918885 17552 tablet_bootstrap.cc:492] T 27c47c73807f4c7c9535c0873d016f62 P 316e9983905848079a8e6d9ce5585f46: Bootstrap starting.
I20260709 13:23:57.927269 17487 raft_consensus.cc:493] T d77e2380b35e4438a224b5148ebc574d P ee69eea1a5cc4645acdd4deaa9e0ac7f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:23:57.927984 17487 raft_consensus.cc:515] T d77e2380b35e4438a224b5148ebc574d P ee69eea1a5cc4645acdd4deaa9e0ac7f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "726d96e241134d7e9e1851f2cee66d03" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 45087 } } peers { permanent_uuid: "316e9983905848079a8e6d9ce5585f46" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 39729 } } peers { permanent_uuid: "ee69eea1a5cc4645acdd4deaa9e0ac7f" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 41127 } }
I20260709 13:23:57.930392 17487 leader_election.cc:290] T d77e2380b35e4438a224b5148ebc574d P ee69eea1a5cc4645acdd4deaa9e0ac7f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 726d96e241134d7e9e1851f2cee66d03 (127.5.126.65:45087), 316e9983905848079a8e6d9ce5585f46 (127.5.126.66:39729)
I20260709 13:23:57.930599 17262 raft_consensus.cc:2468] T 62599e0920c34027b50cf62f7b652686 P 726d96e241134d7e9e1851f2cee66d03 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 316e9983905848079a8e6d9ce5585f46 in term 1.
I20260709 13:23:57.931178 17264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d77e2380b35e4438a224b5148ebc574d" candidate_uuid: "ee69eea1a5cc4645acdd4deaa9e0ac7f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "726d96e241134d7e9e1851f2cee66d03" is_pre_election: true
I20260709 13:23:57.933177 17339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d77e2380b35e4438a224b5148ebc574d" candidate_uuid: "ee69eea1a5cc4645acdd4deaa9e0ac7f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "316e9983905848079a8e6d9ce5585f46" is_pre_election: true
I20260709 13:23:57.934137 17339 raft_consensus.cc:2468] T d77e2380b35e4438a224b5148ebc574d P 316e9983905848079a8e6d9ce5585f46 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee69eea1a5cc4645acdd4deaa9e0ac7f in term 0.
I20260709 13:23:57.935459 17558 raft_consensus.cc:493] T 62c32fd6e3f74f3b817349f92a686d3c P 726d96e241134d7e9e1851f2cee66d03 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:23:57.936184 17558 raft_consensus.cc:515] T 62c32fd6e3f74f3b817349f92a686d3c P 726d96e241134d7e9e1851f2cee66d03 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "726d96e241134d7e9e1851f2cee66d03" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 45087 } } peers { permanent_uuid: "316e9983905848079a8e6d9ce5585f46" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 39729 } } peers { permanent_uuid: "ee69eea1a5cc4645acdd4deaa9e0ac7f" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 41127 } }
I20260709 13:23:57.944602 17376 leader_election.cc:304] T d77e2380b35e4438a224b5148ebc574d P ee69eea1a5cc4645acdd4deaa9e0ac7f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 316e9983905848079a8e6d9ce5585f46, ee69eea1a5cc4645acdd4deaa9e0ac7f; no voters: 
I20260709 13:23:57.944826 17338 raft_consensus.cc:2468] T a71f35e6480646cba674fd6925e001ed P 316e9983905848079a8e6d9ce5585f46 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee69eea1a5cc4645acdd4deaa9e0ac7f in term 1.
I20260709 13:23:57.945895 17487 raft_consensus.cc:2804] T d77e2380b35e4438a224b5148ebc574d P ee69eea1a5cc4645acdd4deaa9e0ac7f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:23:57.946511 17487 raft_consensus.cc:493] T d77e2380b35e4438a224b5148ebc574d P ee69eea1a5cc4645acdd4deaa9e0ac7f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:23:57.946942 17487 raft_consensus.cc:3060] T d77e2380b35e4438a224b5148ebc574d P ee69eea1a5cc4645acdd4deaa9e0ac7f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:23:57.948503 17558 leader_election.cc:290] T 62c32fd6e3f74f3b817349f92a686d3c P 726d96e241134d7e9e1851f2cee66d03 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 316e9983905848079a8e6d9ce5585f46 (127.5.126.66:39729), ee69eea1a5cc4645acdd4deaa9e0ac7f (127.5.126.67:41127)
W20260709 13:23:57.950394 17379 leader_election.cc:343] T d77e2380b35e4438a224b5148ebc574d P ee69eea1a5cc4645acdd4deaa9e0ac7f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 726d96e241134d7e9e1851f2cee66d03 (127.5.126.65:45087): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:23:57.952427 17552 tablet_bootstrap.cc:654] T 27c47c73807f4c7c9535c0873d016f62 P 316e9983905848079a8e6d9ce5585f46: Neither blocks nor log segments found. Creating new log.
I20260709 13:23:57.953182 17553 tablet_bootstrap.cc:492] T 62c32fd6e3f74f3b817349f92a686d3c P ee69eea1a5cc4645acdd4deaa9e0ac7f: No bootstrap required, opened a new log
I20260709 13:23:57.953210 17554 tablet_bootstrap.cc:492] T a71f35e6480646cba674fd6925e001ed P 726d96e241134d7e9e1851f2cee66d03: No bootstrap required, opened a new log
I20260709 13:23:57.953982 17553 ts_tablet_manager.cc:1403] T 62c32fd6e3f74f3b817349f92a686d3c P ee69eea1a5cc4645acdd4deaa9e0ac7f: Time spent bootstrapping tablet: real 0.108s	user 0.035s	sys 0.050s
I20260709 13:23:57.954008 17554 ts_tablet_manager.cc:1403] T a71f35e6480646cba674fd6925e001ed P 726d96e241134d7e9e1851f2cee66d03: Time spent bootstrapping tablet: real 0.141s	user 0.061s	sys 0.062s
I20260709 13:23:57.956743 17376 leader_election.cc:304] T a71f35e6480646cba674fd6925e001ed P ee69eea1a5cc4645acdd4deaa9e0ac7f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 316e9983905848079a8e6d9ce5585f46, ee69eea1a5cc4645acdd4deaa9e0ac7f; no voters: 726d96e241134d7e9e1851f2cee66d03
I20260709 13:23:57.958205 17339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62c32fd6e3f74f3b817349f92a686d3c" candidate_uuid: "726d96e241134d7e9e1851f2cee66d03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "316e9983905848079a8e6d9ce5585f46" is_pre_election: true
I20260709 13:23:57.959256 17339 raft_consensus.cc:2468] T 62c32fd6e3f74f3b817349f92a686d3c P 316e9983905848079a8e6d9ce5585f46 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 726d96e241134d7e9e1851f2cee66d03 in term 0.
I20260709 13:23:57.961025 17227 leader_election.cc:304] T 62c32fd6e3f74f3b817349f92a686d3c P 726d96e241134d7e9e1851f2cee66d03 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 316e9983905848079a8e6d9ce5585f46, 726d96e241134d7e9e1851f2cee66d03; no voters: 
I20260709 13:23:57.962463 17558 raft_consensus.cc:2804] T 62c32fd6e3f74f3b817349f92a686d3c P 726d96e241134d7e9e1851f2cee66d03 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:23:57.963008 17558 raft_consensus.cc:493] T 62c32fd6e3f74f3b817349f92a686d3c P 726d96e241134d7e9e1851f2cee66d03 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:23:57.963456 17558 raft_consensus.cc:3060] T 62c32fd6e3f74f3b817349f92a686d3c P 726d96e241134d7e9e1851f2cee66d03 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:23:57.958683 17553 raft_consensus.cc:359] T 62c32fd6e3f74f3b817349f92a686d3c P ee69eea1a5cc4645acdd4deaa9e0ac7f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "726d96e241134d7e9e1851f2cee66d03" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 45087 } } peers { permanent_uuid: "316e9983905848079a8e6d9ce5585f46" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 39729 } } peers { permanent_uuid: "ee69eea1a5cc4645acdd4deaa9e0ac7f" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 41127 } }
I20260709 13:23:57.963744 17554 raft_consensus.cc:359] T a71f35e6480646cba674fd6925e001ed P 726d96e241134d7e9e1851f2cee66d03 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "726d96e241134d7e9e1851f2cee66d03" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 45087 } } peers { permanent_uuid: "316e9983905848079a8e6d9ce5585f46" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 39729 } } peers { permanent_uuid: "ee69eea1a5cc4645acdd4deaa9e0ac7f" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 41127 } }
I20260709 13:23:57.965022 17553 raft_consensus.cc:385] T 62c32fd6e3f74f3b817349f92a686d3c P ee69eea1a5cc4645acdd4deaa9e0ac7f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:23:57.965246 17554 raft_consensus.cc:385] T a71f35e6480646cba674fd6925e001ed P 726d96e241134d7e9e1851f2cee66d03 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:23:57.965482 17553 raft_consensus.cc:740] T 62c32fd6e3f74f3b817349f92a686d3c P ee69eea1a5cc4645acdd4deaa9e0ac7f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ee69eea1a5cc4645acdd4deaa9e0ac7f, State: Initialized, Role: FOLLOWER
I20260709 13:23:57.965593 17554 raft_consensus.cc:740] T a71f35e6480646cba674fd6925e001ed P 726d96e241134d7e9e1851f2cee66d03 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 726d96e241134d7e9e1851f2cee66d03, State: Initialized, Role: FOLLOWER
I20260709 13:23:57.967680 17554 consensus_queue.cc:260] T a71f35e6480646cba674fd6925e001ed P 726d96e241134d7e9e1851f2cee66d03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "726d96e241134d7e9e1851f2cee66d03" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 45087 } } peers { permanent_uuid: "316e9983905848079a8e6d9ce5585f46" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 39729 } } peers { permanent_uuid: "ee69eea1a5cc4645acdd4deaa9e0ac7f" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 41127 } }
I20260709 13:23:57.969139 17410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62c32fd6e3f74f3b817349f92a686d3c" candidate_uuid: "726d96e241134d7e9e1851f2cee66d03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee69eea1a5cc4645acdd4deaa9e0ac7f" is_pre_election: true
I20260709 13:23:57.969717 17573 raft_consensus.cc:2804] T a71f35e6480646cba674fd6925e001ed P ee69eea1a5cc4645acdd4deaa9e0ac7f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:23:57.971199 17553 consensus_queue.cc:260] T 62c32fd6e3f74f3b817349f92a686d3c P ee69eea1a5cc4645acdd4deaa9e0ac7f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "726d96e241134d7e9e1851f2cee66d03" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 45087 } } peers { permanent_uuid: "316e9983905848079a8e6d9ce5585f46" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 39729 } } peers { permanent_uuid: "ee69eea1a5cc4645acdd4deaa9e0ac7f" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 41127 } }
I20260709 13:23:57.974604 17410 raft_consensus.cc:2468] T 62c32fd6e3f74f3b817349f92a686d3c P ee69eea1a5cc4645acdd4deaa9e0ac7f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 726d96e241134d7e9e1851f2cee66d03 in term 0.
I20260709 13:23:57.975963 17539 raft_consensus.cc:493] T a71f35e6480646cba674fd6925e001ed P 726d96e241134d7e9e1851f2cee66d03 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:23:57.976563 17539 raft_consensus.cc:515] T a71f35e6480646cba674fd6925e001ed P 726d96e241134d7e9e1851f2cee66d03 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "726d96e241134d7e9e1851f2cee66d03" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 45087 } } peers { permanent_uuid: "316e9983905848079a8e6d9ce5585f46" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 39729 } } peers { permanent_uuid: "ee69eea1a5cc4645acdd4deaa9e0ac7f" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 41127 } }
I20260709 13:23:57.976572 17558 raft_consensus.cc:515] T 62c32fd6e3f74f3b817349f92a686d3c P 726d96e241134d7e9e1851f2cee66d03 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "726d96e241134d7e9e1851f2cee66d03" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 45087 } } peers { permanent_uuid: "316e9983905848079a8e6d9ce5585f46" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 39729 } } peers { permanent_uuid: "ee69eea1a5cc4645acdd4deaa9e0ac7f" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 41127 } }
I20260709 13:23:57.978744 17539 leader_election.cc:290] T a71f35e6480646cba674fd6925e001ed P 726d96e241134d7e9e1851f2cee66d03 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 316e9983905848079a8e6d9ce5585f46 (127.5.126.66:39729), ee69eea1a5cc4645acdd4deaa9e0ac7f (127.5.126.67:41127)
I20260709 13:23:57.978777 17558 leader_election.cc:290] T 62c32fd6e3f74f3b817349f92a686d3c P 726d96e241134d7e9e1851f2cee66d03 [CANDIDATE]: Term 1 election: Requested vote from peers 316e9983905848079a8e6d9ce5585f46 (127.5.126.66:39729), ee69eea1a5cc4645acdd4deaa9e0ac7f (127.5.126.67:41127)
I20260709 13:23:57.987787 17161 catalog_manager.cc:5697] T 62599e0920c34027b50cf62f7b652686 P 316e9983905848079a8e6d9ce5585f46 reported cstate change: term changed from 0 to 1, leader changed from <none> to 316e9983905848079a8e6d9ce5585f46 (127.5.126.66). New cstate: current_term: 1 leader_uuid: "316e9983905848079a8e6d9ce5585f46" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "726d96e241134d7e9e1851f2cee66d03" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 45087 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "316e9983905848079a8e6d9ce5585f46" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 39729 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ee69eea1a5cc4645acdd4deaa9e0ac7f" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 41127 } health_report { overall_health: UNKNOWN } } }
I20260709 13:23:57.987779 17487 raft_consensus.cc:515] T d77e2380b35e4438a224b5148ebc574d P ee69eea1a5cc4645acdd4deaa9e0ac7f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "726d96e241134d7e9e1851f2cee66d03" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 45087 } } peers { permanent_uuid: "316e9983905848079a8e6d9ce5585f46" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 39729 } } peers { permanent_uuid: "ee69eea1a5cc4645acdd4deaa9e0ac7f" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 41127 } }
I20260709 13:23:58.001590 17339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62c32fd6e3f74f3b817349f92a686d3c" candidate_uuid: "726d96e241134d7e9e1851f2cee66d03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "316e9983905848079a8e6d9ce5585f46"
I20260709 13:23:58.002321 17339 raft_consensus.cc:3060] T 62c32fd6e3f74f3b817349f92a686d3c P 316e9983905848079a8e6d9ce5585f46 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:23:58.002689 17337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d77e2380b35e4438a224b5148ebc574d" candidate_uuid: "ee69eea1a5cc4645acdd4deaa9e0ac7f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "316e9983905848079a8e6d9ce5585f46"
I20260709 13:23:58.002714 17338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a71f35e6480646cba674fd6925e001ed" candidate_uuid: "726d96e241134d7e9e1851f2cee66d03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "316e9983905848079a8e6d9ce5585f46" is_pre_election: true
I20260709 13:23:58.003576 17337 raft_consensus.cc:3060] T d77e2380b35e4438a224b5148ebc574d P 316e9983905848079a8e6d9ce5585f46 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:23:58.003787 17338 raft_consensus.cc:2393] T a71f35e6480646cba674fd6925e001ed P 316e9983905848079a8e6d9ce5585f46 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 726d96e241134d7e9e1851f2cee66d03 in current term 1: Already voted for candidate ee69eea1a5cc4645acdd4deaa9e0ac7f in this term.
I20260709 13:23:58.003815 17412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62c32fd6e3f74f3b817349f92a686d3c" candidate_uuid: "726d96e241134d7e9e1851f2cee66d03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee69eea1a5cc4645acdd4deaa9e0ac7f"
I20260709 13:23:58.005285 17412 raft_consensus.cc:3060] T 62c32fd6e3f74f3b817349f92a686d3c P ee69eea1a5cc4645acdd4deaa9e0ac7f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:23:58.012221 17337 raft_consensus.cc:2468] T d77e2380b35e4438a224b5148ebc574d P 316e9983905848079a8e6d9ce5585f46 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee69eea1a5cc4645acdd4deaa9e0ac7f in term 1.
I20260709 13:23:58.013360 17412 raft_consensus.cc:2468] T 62c32fd6e3f74f3b817349f92a686d3c P ee69eea1a5cc4645acdd4deaa9e0ac7f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 726d96e241134d7e9e1851f2cee66d03 in term 1.
I20260709 13:23:58.013759 17376 leader_election.cc:304] T d77e2380b35e4438a224b5148ebc574d P ee69eea1a5cc4645acdd4deaa9e0ac7f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 316e9983905848079a8e6d9ce5585f46, ee69eea1a5cc4645acdd4deaa9e0ac7f; no voters: 
I20260709 13:23:58.014171 17554 ts_tablet_manager.cc:1434] T a71f35e6480646cba674fd6925e001ed P 726d96e241134d7e9e1851f2cee66d03: Time spent starting tablet: real 0.059s	user 0.004s	sys 0.002s
I20260709 13:23:58.014475 17339 raft_consensus.cc:2468] T 62c32fd6e3f74f3b817349f92a686d3c P 316e9983905848079a8e6d9ce5585f46 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 726d96e241134d7e9e1851f2cee66d03 in term 1.
I20260709 13:23:58.014221 17410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a71f35e6480646cba674fd6925e001ed" candidate_uuid: "726d96e241134d7e9e1851f2cee66d03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee69eea1a5cc4645acdd4deaa9e0ac7f" is_pre_election: true
I20260709 13:23:58.025275 17227 leader_election.cc:304] T 62c32fd6e3f74f3b817349f92a686d3c P 726d96e241134d7e9e1851f2cee66d03 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 726d96e241134d7e9e1851f2cee66d03, ee69eea1a5cc4645acdd4deaa9e0ac7f; no voters: 
I20260709 13:23:58.027307 17577 raft_consensus.cc:2804] T 62c32fd6e3f74f3b817349f92a686d3c P 726d96e241134d7e9e1851f2cee66d03 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:23:58.025581 17579 raft_consensus.cc:493] T 711feb7b7a864c1d98dfd62c10eb0f99 P ee69eea1a5cc4645acdd4deaa9e0ac7f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:23:58.028457 17579 raft_consensus.cc:515] T 711feb7b7a864c1d98dfd62c10eb0f99 P ee69eea1a5cc4645acdd4deaa9e0ac7f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "726d96e241134d7e9e1851f2cee66d03" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 45087 } } peers { permanent_uuid: "316e9983905848079a8e6d9ce5585f46" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 39729 } } peers { permanent_uuid: "ee69eea1a5cc4645acdd4deaa9e0ac7f" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 41127 } }
I20260709 13:23:58.034992 17487 leader_election.cc:290] T d77e2380b35e4438a224b5148ebc574d P ee69eea1a5cc4645acdd4deaa9e0ac7f [CANDIDATE]: Term 1 election: Requested vote from peers 726d96e241134d7e9e1851f2cee66d03 (127.5.126.65:45087), 316e9983905848079a8e6d9ce5585f46 (127.5.126.66:39729)
I20260709 13:23:58.035625 17339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "711feb7b7a864c1d98dfd62c10eb0f99" candidate_uuid: "ee69eea1a5cc4645acdd4deaa9e0ac7f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "316e9983905848079a8e6d9ce5585f46" is_pre_election: true
I20260709 13:23:58.036170 17573 raft_consensus.cc:697] T a71f35e6480646cba674fd6925e001ed P ee69eea1a5cc4645acdd4deaa9e0ac7f [term 1 LEADER]: Becoming Leader. State: Replica: ee69eea1a5cc4645acdd4deaa9e0ac7f, State: Running, Role: LEADER
I20260709 13:23:58.036360 17339 raft_consensus.cc:2468] T 711feb7b7a864c1d98dfd62c10eb0f99 P 316e9983905848079a8e6d9ce5585f46 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee69eea1a5cc4645acdd4deaa9e0ac7f in term 0.
I20260709 13:23:58.037292 17579 leader_election.cc:290] T 711feb7b7a864c1d98dfd62c10eb0f99 P ee69eea1a5cc4645acdd4deaa9e0ac7f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 726d96e241134d7e9e1851f2cee66d03 (127.5.126.65:45087), 316e9983905848079a8e6d9ce5585f46 (127.5.126.66:39729)
I20260709 13:23:58.038192 17376 leader_election.cc:304] T 711feb7b7a864c1d98dfd62c10eb0f99 P ee69eea1a5cc4645acdd4deaa9e0ac7f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 316e9983905848079a8e6d9ce5585f46, ee69eea1a5cc4645acdd4deaa9e0ac7f; no voters: 
I20260709 13:23:58.043129 17262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "711feb7b7a864c1d98dfd62c10eb0f99" candidate_uuid: "ee69eea1a5cc4645acdd4deaa9e0ac7f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "726d96e241134d7e9e1851f2cee66d03" is_pre_election: true
I20260709 13:23:58.036619 17487 raft_consensus.cc:2804] T d77e2380b35e4438a224b5148ebc574d P ee69eea1a5cc4645acdd4deaa9e0ac7f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:23:58.043677 17554 tablet_bootstrap.cc:492] T eb3f366f79ef4b2894bc2dbf6eb14794 P 726d96e241134d7e9e1851f2cee66d03: Bootstrap starting.
I20260709 13:23:58.051476 17262 raft_consensus.cc:2468] T 711feb7b7a864c1d98dfd62c10eb0f99 P 726d96e241134d7e9e1851f2cee66d03 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee69eea1a5cc4645acdd4deaa9e0ac7f in term 0.
I20260709 13:23:58.037977 17573 consensus_queue.cc:237] T a71f35e6480646cba674fd6925e001ed P ee69eea1a5cc4645acdd4deaa9e0ac7f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "726d96e241134d7e9e1851f2cee66d03" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 45087 } } peers { permanent_uuid: "316e9983905848079a8e6d9ce5585f46" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 39729 } } peers { permanent_uuid: "ee69eea1a5cc4645acdd4deaa9e0ac7f" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 41127 } }
I20260709 13:23:58.051862 17553 ts_tablet_manager.cc:1434] T 62c32fd6e3f74f3b817349f92a686d3c P ee69eea1a5cc4645acdd4deaa9e0ac7f: Time spent starting tablet: real 0.097s	user 0.024s	sys 0.031s
I20260709 13:23:58.053062 17553 tablet_bootstrap.cc:492] T eb3f366f79ef4b2894bc2dbf6eb14794 P ee69eea1a5cc4645acdd4deaa9e0ac7f: Bootstrap starting.
I20260709 13:23:58.051497 17487 raft_consensus.cc:697] T d77e2380b35e4438a224b5148ebc574d P ee69eea1a5cc4645acdd4deaa9e0ac7f [term 1 LEADER]: Becoming Leader. State: Replica: ee69eea1a5cc4645acdd4deaa9e0ac7f, State: Running, Role: LEADER
I20260709 13:23:58.053690 17579 raft_consensus.cc:2804] T 711feb7b7a864c1d98dfd62c10eb0f99 P ee69eea1a5cc4645acdd4deaa9e0ac7f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:23:58.054211 17579 raft_consensus.cc:493] T 711feb7b7a864c1d98dfd62c10eb0f99 P ee69eea1a5cc4645acdd4deaa9e0ac7f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:23:58.042155 17264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d77e2380b35e4438a224b5148ebc574d" candidate_uuid: "ee69eea1a5cc4645acdd4deaa9e0ac7f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "726d96e241134d7e9e1851f2cee66d03"
I20260709 13:23:58.054698 17487 consensus_queue.cc:237] T d77e2380b35e4438a224b5148ebc574d P ee69eea1a5cc4645acdd4deaa9e0ac7f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "726d96e241134d7e9e1851f2cee66d03" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 45087 } } peers { permanent_uuid: "316e9983905848079a8e6d9ce5585f46" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 39729 } } peers { permanent_uuid: "ee69eea1a5cc4645acdd4deaa9e0ac7f" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 41127 } }
W20260709 13:23:58.055703 17379 leader_election.cc:343] T d77e2380b35e4438a224b5148ebc574d P ee69eea1a5cc4645acdd4deaa9e0ac7f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 726d96e241134d7e9e1851f2cee66d03 (127.5.126.65:45087): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:23:58.038971 17577 raft_consensus.cc:697] T 62c32fd6e3f74f3b817349f92a686d3c P 726d96e241134d7e9e1851f2cee66d03 [term 1 LEADER]: Becoming Leader. State: Replica: 726d96e241134d7e9e1851f2cee66d03, State: Running, Role: LEADER
I20260709 13:23:58.057608 17577 consensus_queue.cc:237] T 62c32fd6e3f74f3b817349f92a686d3c P 726d96e241134d7e9e1851f2cee66d03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "726d96e241134d7e9e1851f2cee66d03" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 45087 } } peers { permanent_uuid: "316e9983905848079a8e6d9ce5585f46" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 39729 } } peers { permanent_uuid: "ee69eea1a5cc4645acdd4deaa9e0ac7f" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 41127 } }
I20260709 13:23:58.050474 17552 tablet_bootstrap.cc:492] T 27c47c73807f4c7c9535c0873d016f62 P 316e9983905848079a8e6d9ce5585f46: No bootstrap required, opened a new log
I20260709 13:23:58.060853 17553 tablet_bootstrap.cc:654] T eb3f366f79ef4b2894bc2dbf6eb14794 P ee69eea1a5cc4645acdd4deaa9e0ac7f: Neither blocks nor log segments found. Creating new log.
I20260709 13:23:58.061661 17552 ts_tablet_manager.cc:1403] T 27c47c73807f4c7c9535c0873d016f62 P 316e9983905848079a8e6d9ce5585f46: Time spent bootstrapping tablet: real 0.143s	user 0.048s	sys 0.039s
I20260709 13:23:58.067023 17552 raft_consensus.cc:359] T 27c47c73807f4c7c9535c0873d016f62 P 316e9983905848079a8e6d9ce5585f46 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "726d96e241134d7e9e1851f2cee66d03" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 45087 } } peers { permanent_uuid: "316e9983905848079a8e6d9ce5585f46" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 39729 } } peers { permanent_uuid: "ee69eea1a5cc4645acdd4deaa9e0ac7f" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 41127 } }
I20260709 13:23:58.067617 17552 raft_consensus.cc:385] T 27c47c73807f4c7c9535c0873d016f62 P 316e9983905848079a8e6d9ce5585f46 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:23:58.067728 17579 raft_consensus.cc:3060] T 711feb7b7a864c1d98dfd62c10eb0f99 P ee69eea1a5cc4645acdd4deaa9e0ac7f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:23:58.068002 17552 raft_consensus.cc:740] T 27c47c73807f4c7c9535c0873d016f62 P 316e9983905848079a8e6d9ce5585f46 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 316e9983905848079a8e6d9ce5585f46, State: Initialized, Role: FOLLOWER
I20260709 13:23:58.068892 17552 consensus_queue.cc:260] T 27c47c73807f4c7c9535c0873d016f62 P 316e9983905848079a8e6d9ce5585f46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "726d96e241134d7e9e1851f2cee66d03" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 45087 } } peers { permanent_uuid: "316e9983905848079a8e6d9ce5585f46" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 39729 } } peers { permanent_uuid: "ee69eea1a5cc4645acdd4deaa9e0ac7f" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 41127 } }
I20260709 13:23:58.071324 17552 ts_tablet_manager.cc:1434] T 27c47c73807f4c7c9535c0873d016f62 P 316e9983905848079a8e6d9ce5585f46: Time spent starting tablet: real 0.008s	user 0.002s	sys 0.003s
I20260709 13:23:58.072651 17552 tablet_bootstrap.cc:492] T 86979013624c4c96843236a7e7f8a1ec P 316e9983905848079a8e6d9ce5585f46: Bootstrap starting.
I20260709 13:23:58.075414 17554 tablet_bootstrap.cc:654] T eb3f366f79ef4b2894bc2dbf6eb14794 P 726d96e241134d7e9e1851f2cee66d03: Neither blocks nor log segments found. Creating new log.
I20260709 13:23:58.076275 17553 tablet_bootstrap.cc:492] T eb3f366f79ef4b2894bc2dbf6eb14794 P ee69eea1a5cc4645acdd4deaa9e0ac7f: No bootstrap required, opened a new log
I20260709 13:23:58.076803 17553 ts_tablet_manager.cc:1403] T eb3f366f79ef4b2894bc2dbf6eb14794 P ee69eea1a5cc4645acdd4deaa9e0ac7f: Time spent bootstrapping tablet: real 0.024s	user 0.012s	sys 0.007s
I20260709 13:23:58.079988 17553 raft_consensus.cc:359] T eb3f366f79ef4b2894bc2dbf6eb14794 P ee69eea1a5cc4645acdd4deaa9e0ac7f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "726d96e241134d7e9e1851f2cee66d03" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 45087 } } peers { permanent_uuid: "316e9983905848079a8e6d9ce5585f46" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 39729 } } peers { permanent_uuid: "ee69eea1a5cc4645acdd4deaa9e0ac7f" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 41127 } }
I20260709 13:23:58.080821 17552 tablet_bootstrap.cc:654] T 86979013624c4c96843236a7e7f8a1ec P 316e9983905848079a8e6d9ce5585f46: Neither blocks nor log segments found. Creating new log.
I20260709 13:23:58.080821 17553 raft_consensus.cc:385] T eb3f366f79ef4b2894bc2dbf6eb14794 P ee69eea1a5cc4645acdd4deaa9e0ac7f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:23:58.081668 17553 raft_consensus.cc:740] T eb3f366f79ef4b2894bc2dbf6eb14794 P ee69eea1a5cc4645acdd4deaa9e0ac7f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ee69eea1a5cc4645acdd4deaa9e0ac7f, State: Initialized, Role: FOLLOWER
I20260709 13:23:58.082484 17553 consensus_queue.cc:260] T eb3f366f79ef4b2894bc2dbf6eb14794 P ee69eea1a5cc4645acdd4deaa9e0ac7f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "726d96e241134d7e9e1851f2cee66d03" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 45087 } } peers { permanent_uuid: "316e9983905848079a8e6d9ce5585f46" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 39729 } } peers { permanent_uuid: "ee69eea1a5cc4645acdd4deaa9e0ac7f" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 41127 } }
I20260709 13:23:58.085609 17553 ts_tablet_manager.cc:1434] T eb3f366f79ef4b2894bc2dbf6eb14794 P ee69eea1a5cc4645acdd4deaa9e0ac7f: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.001s
I20260709 13:23:58.086998 17553 tablet_bootstrap.cc:492] T 743cee0b3a8241dfae72c033dc3d776e P ee69eea1a5cc4645acdd4deaa9e0ac7f: Bootstrap starting.
I20260709 13:23:58.094310 17553 tablet_bootstrap.cc:654] T 743cee0b3a8241dfae72c033dc3d776e P ee69eea1a5cc4645acdd4deaa9e0ac7f: Neither blocks nor log segments found. Creating new log.
I20260709 13:23:58.098593 17579 raft_consensus.cc:515] T 711feb7b7a864c1d98dfd62c10eb0f99 P ee69eea1a5cc4645acdd4deaa9e0ac7f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "726d96e241134d7e9e1851f2cee66d03" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 45087 } } peers { permanent_uuid: "316e9983905848079a8e6d9ce5585f46" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 39729 } } peers { permanent_uuid: "ee69eea1a5cc4645acdd4deaa9e0ac7f" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 41127 } }
I20260709 13:23:58.099424 17552 tablet_bootstrap.cc:492] T 86979013624c4c96843236a7e7f8a1ec P 316e9983905848079a8e6d9ce5585f46: No bootstrap required, opened a new log
I20260709 13:23:58.097779 17227 leader_election.cc:304] T a71f35e6480646cba674fd6925e001ed P 726d96e241134d7e9e1851f2cee66d03 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 726d96e241134d7e9e1851f2cee66d03; no voters: 316e9983905848079a8e6d9ce5585f46, ee69eea1a5cc4645acdd4deaa9e0ac7f
I20260709 13:23:58.101397 17552 ts_tablet_manager.cc:1403] T 86979013624c4c96843236a7e7f8a1ec P 316e9983905848079a8e6d9ce5585f46: Time spent bootstrapping tablet: real 0.028s	user 0.016s	sys 0.008s
I20260709 13:23:58.101645 17577 raft_consensus.cc:3060] T a71f35e6480646cba674fd6925e001ed P 726d96e241134d7e9e1851f2cee66d03 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:23:58.101727 17579 leader_election.cc:290] T 711feb7b7a864c1d98dfd62c10eb0f99 P ee69eea1a5cc4645acdd4deaa9e0ac7f [CANDIDATE]: Term 1 election: Requested vote from peers 726d96e241134d7e9e1851f2cee66d03 (127.5.126.65:45087), 316e9983905848079a8e6d9ce5585f46 (127.5.126.66:39729)
I20260709 13:23:58.101780 17160 catalog_manager.cc:5697] T a71f35e6480646cba674fd6925e001ed P ee69eea1a5cc4645acdd4deaa9e0ac7f reported cstate change: term changed from 0 to 1, leader changed from <none> to ee69eea1a5cc4645acdd4deaa9e0ac7f (127.5.126.67). New cstate: current_term: 1 leader_uuid: "ee69eea1a5cc4645acdd4deaa9e0ac7f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "726d96e241134d7e9e1851f2cee66d03" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 45087 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "316e9983905848079a8e6d9ce5585f46" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 39729 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ee69eea1a5cc4645acdd4deaa9e0ac7f" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 41127 } health_report { overall_health: HEALTHY } } }
I20260709 13:23:58.103399 17339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "711feb7b7a864c1d98dfd62c10eb0f99" candidate_uuid: "ee69eea1a5cc4645acdd4deaa9e0ac7f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "316e9983905848079a8e6d9ce5585f46"
I20260709 13:23:58.106752 17339 raft_consensus.cc:3060] T 711feb7b7a864c1d98dfd62c10eb0f99 P 316e9983905848079a8e6d9ce5585f46 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:23:58.114329 17577 raft_consensus.cc:2749] T a71f35e6480646cba674fd6925e001ed P 726d96e241134d7e9e1851f2cee66d03 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:23:58.108069 17159 catalog_manager.cc:5697] T 62c32fd6e3f74f3b817349f92a686d3c P 726d96e241134d7e9e1851f2cee66d03 reported cstate change: term changed from 0 to 1, leader changed from <none> to 726d96e241134d7e9e1851f2cee66d03 (127.5.126.65). New cstate: current_term: 1 leader_uuid: "726d96e241134d7e9e1851f2cee66d03" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "726d96e241134d7e9e1851f2cee66d03" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 45087 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "316e9983905848079a8e6d9ce5585f46" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 39729 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ee69eea1a5cc4645acdd4deaa9e0ac7f" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 41127 } health_report { overall_health: UNKNOWN } } }
I20260709 13:23:58.119021 17554 tablet_bootstrap.cc:492] T eb3f366f79ef4b2894bc2dbf6eb14794 P 726d96e241134d7e9e1851f2cee66d03: No bootstrap required, opened a new log
I20260709 13:23:58.119607 17554 ts_tablet_manager.cc:1403] T eb3f366f79ef4b2894bc2dbf6eb14794 P 726d96e241134d7e9e1851f2cee66d03: Time spent bootstrapping tablet: real 0.076s	user 0.013s	sys 0.006s
I20260709 13:23:58.120817 17339 raft_consensus.cc:2468] T 711feb7b7a864c1d98dfd62c10eb0f99 P 316e9983905848079a8e6d9ce5585f46 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee69eea1a5cc4645acdd4deaa9e0ac7f in term 1.
I20260709 13:23:58.105022 17552 raft_consensus.cc:359] T 86979013624c4c96843236a7e7f8a1ec P 316e9983905848079a8e6d9ce5585f46 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "726d96e241134d7e9e1851f2cee66d03" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 45087 } } peers { permanent_uuid: "316e9983905848079a8e6d9ce5585f46" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 39729 } } peers { permanent_uuid: "ee69eea1a5cc4645acdd4deaa9e0ac7f" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 41127 } }
I20260709 13:23:58.105849 17264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "711feb7b7a864c1d98dfd62c10eb0f99" candidate_uuid: "ee69eea1a5cc4645acdd4deaa9e0ac7f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "726d96e241134d7e9e1851f2cee66d03"
I20260709 13:23:58.122488 17553 tablet_bootstrap.cc:492] T 743cee0b3a8241dfae72c033dc3d776e P ee69eea1a5cc4645acdd4deaa9e0ac7f: No bootstrap required, opened a new log
I20260709 13:23:58.122745 17264 raft_consensus.cc:3060] T 711feb7b7a864c1d98dfd62c10eb0f99 P 726d96e241134d7e9e1851f2cee66d03 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:23:58.122822 17554 raft_consensus.cc:359] T eb3f366f79ef4b2894bc2dbf6eb14794 P 726d96e241134d7e9e1851f2cee66d03 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "726d96e241134d7e9e1851f2cee66d03" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 45087 } } peers { permanent_uuid: "316e9983905848079a8e6d9ce5585f46" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 39729 } } peers { permanent_uuid: "ee69eea1a5cc4645acdd4deaa9e0ac7f" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 41127 } }
I20260709 13:23:58.123951 17554 raft_consensus.cc:385] T eb3f366f79ef4b2894bc2dbf6eb14794 P 726d96e241134d7e9e1851f2cee66d03 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:23:58.124349 17554 raft_consensus.cc:740] T eb3f366f79ef4b2894bc2dbf6eb14794 P 726d96e241134d7e9e1851f2cee66d03 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 726d96e241134d7e9e1851f2cee66d03, State: Initialized, Role: FOLLOWER
I20260709 13:23:58.123811 17376 leader_election.cc:304] T 711feb7b7a864c1d98dfd62c10eb0f99 P ee69eea1a5cc4645acdd4deaa9e0ac7f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 316e9983905848079a8e6d9ce5585f46, ee69eea1a5cc4645acdd4deaa9e0ac7f; no voters: 
I20260709 13:23:58.125068 17554 consensus_queue.cc:260] T eb3f366f79ef4b2894bc2dbf6eb14794 P 726d96e241134d7e9e1851f2cee66d03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "726d96e241134d7e9e1851f2cee66d03" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 45087 } } peers { permanent_uuid: "316e9983905848079a8e6d9ce5585f46" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 39729 } } peers { permanent_uuid: "ee69eea1a5cc4645acdd4deaa9e0ac7f" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 41127 } }
I20260709 13:23:58.127626 17554 ts_tablet_manager.cc:1434] T eb3f366f79ef4b2894bc2dbf6eb14794 P 726d96e241134d7e9e1851f2cee66d03: Time spent starting tablet: real 0.008s	user 0.004s	sys 0.004s
I20260709 13:23:58.123054 17553 ts_tablet_manager.cc:1403] T 743cee0b3a8241dfae72c033dc3d776e P ee69eea1a5cc4645acdd4deaa9e0ac7f: Time spent bootstrapping tablet: real 0.036s	user 0.012s	sys 0.000s
I20260709 13:23:58.130045 17554 tablet_bootstrap.cc:492] T 27c47c73807f4c7c9535c0873d016f62 P 726d96e241134d7e9e1851f2cee66d03: Bootstrap starting.
I20260709 13:23:58.132392 17264 raft_consensus.cc:2468] T 711feb7b7a864c1d98dfd62c10eb0f99 P 726d96e241134d7e9e1851f2cee66d03 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee69eea1a5cc4645acdd4deaa9e0ac7f in term 1.
I20260709 13:23:58.133028 17552 raft_consensus.cc:385] T 86979013624c4c96843236a7e7f8a1ec P 316e9983905848079a8e6d9ce5585f46 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:23:58.133950 17552 raft_consensus.cc:740] T 86979013624c4c96843236a7e7f8a1ec P 316e9983905848079a8e6d9ce5585f46 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 316e9983905848079a8e6d9ce5585f46, State: Initialized, Role: FOLLOWER
I20260709 13:23:58.134994 17552 consensus_queue.cc:260] T 86979013624c4c96843236a7e7f8a1ec P 316e9983905848079a8e6d9ce5585f46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "726d96e241134d7e9e1851f2cee66d03" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 45087 } } peers { permanent_uuid: "316e9983905848079a8e6d9ce5585f46" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 39729 } } peers { permanent_uuid: "ee69eea1a5cc4645acdd4deaa9e0ac7f" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 41127 } }
I20260709 13:23:58.135855 17553 raft_consensus.cc:359] T 743cee0b3a8241dfae72c033dc3d776e P ee69eea1a5cc4645acdd4deaa9e0ac7f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "726d96e241134d7e9e1851f2cee66d03" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 45087 } } peers { permanent_uuid: "316e9983905848079a8e6d9ce5585f46" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 39729 } } peers { permanent_uuid: "ee69eea1a5cc4645acdd4deaa9e0ac7f" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 41127 } }
I20260709 13:23:58.137125 17553 raft_consensus.cc:385] T 743cee0b3a8241dfae72c033dc3d776e P ee69eea1a5cc4645acdd4deaa9e0ac7f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:23:58.137565 17554 tablet_bootstrap.cc:654] T 27c47c73807f4c7c9535c0873d016f62 P 726d96e241134d7e9e1851f2cee66d03: Neither blocks nor log segments found. Creating new log.
I20260709 13:23:58.137501 17553 raft_consensus.cc:740] T 743cee0b3a8241dfae72c033dc3d776e P ee69eea1a5cc4645acdd4deaa9e0ac7f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ee69eea1a5cc4645acdd4deaa9e0ac7f, State: Initialized, Role: FOLLOWER
I20260709 13:23:58.138026 17552 ts_tablet_manager.cc:1434] T 86979013624c4c96843236a7e7f8a1ec P 316e9983905848079a8e6d9ce5585f46: Time spent starting tablet: real 0.036s	user 0.001s	sys 0.007s
I20260709 13:23:58.138542 17553 consensus_queue.cc:260] T 743cee0b3a8241dfae72c033dc3d776e P ee69eea1a5cc4645acdd4deaa9e0ac7f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "726d96e241134d7e9e1851f2cee66d03" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 45087 } } peers { permanent_uuid: "316e9983905848079a8e6d9ce5585f46" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 39729 } } peers { permanent_uuid: "ee69eea1a5cc4645acdd4deaa9e0ac7f" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 41127 } }
I20260709 13:23:58.139802 17573 raft_consensus.cc:2804] T 711feb7b7a864c1d98dfd62c10eb0f99 P ee69eea1a5cc4645acdd4deaa9e0ac7f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:23:58.140347 17573 raft_consensus.cc:697] T 711feb7b7a864c1d98dfd62c10eb0f99 P ee69eea1a5cc4645acdd4deaa9e0ac7f [term 1 LEADER]: Becoming Leader. State: Replica: ee69eea1a5cc4645acdd4deaa9e0ac7f, State: Running, Role: LEADER
I20260709 13:23:58.141194 17573 consensus_queue.cc:237] T 711feb7b7a864c1d98dfd62c10eb0f99 P ee69eea1a5cc4645acdd4deaa9e0ac7f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "726d96e241134d7e9e1851f2cee66d03" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 45087 } } peers { permanent_uuid: "316e9983905848079a8e6d9ce5585f46" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 39729 } } peers { permanent_uuid: "ee69eea1a5cc4645acdd4deaa9e0ac7f" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 41127 } }
I20260709 13:23:58.141268 17553 ts_tablet_manager.cc:1434] T 743cee0b3a8241dfae72c033dc3d776e P ee69eea1a5cc4645acdd4deaa9e0ac7f: Time spent starting tablet: real 0.013s	user 0.005s	sys 0.002s
I20260709 13:23:58.143538 17552 tablet_bootstrap.cc:492] T 743cee0b3a8241dfae72c033dc3d776e P 316e9983905848079a8e6d9ce5585f46: Bootstrap starting.
I20260709 13:23:58.146584 17553 tablet_bootstrap.cc:492] T 27c47c73807f4c7c9535c0873d016f62 P ee69eea1a5cc4645acdd4deaa9e0ac7f: Bootstrap starting.
I20260709 13:23:58.153358 17579 raft_consensus.cc:493] T eb3f366f79ef4b2894bc2dbf6eb14794 P ee69eea1a5cc4645acdd4deaa9e0ac7f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:23:58.154174 17553 tablet_bootstrap.cc:654] T 27c47c73807f4c7c9535c0873d016f62 P ee69eea1a5cc4645acdd4deaa9e0ac7f: Neither blocks nor log segments found. Creating new log.
I20260709 13:23:58.154083 17579 raft_consensus.cc:515] T eb3f366f79ef4b2894bc2dbf6eb14794 P ee69eea1a5cc4645acdd4deaa9e0ac7f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "726d96e241134d7e9e1851f2cee66d03" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 45087 } } peers { permanent_uuid: "316e9983905848079a8e6d9ce5585f46" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 39729 } } peers { permanent_uuid: "ee69eea1a5cc4645acdd4deaa9e0ac7f" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 41127 } }
I20260709 13:23:58.155856 17552 tablet_bootstrap.cc:654] T 743cee0b3a8241dfae72c033dc3d776e P 316e9983905848079a8e6d9ce5585f46: Neither blocks nor log segments found. Creating new log.
I20260709 13:23:58.162182 17264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb3f366f79ef4b2894bc2dbf6eb14794" candidate_uuid: "ee69eea1a5cc4645acdd4deaa9e0ac7f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "726d96e241134d7e9e1851f2cee66d03" is_pre_election: true
I20260709 13:23:58.163331 17264 raft_consensus.cc:2468] T eb3f366f79ef4b2894bc2dbf6eb14794 P 726d96e241134d7e9e1851f2cee66d03 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee69eea1a5cc4645acdd4deaa9e0ac7f in term 0.
I20260709 13:23:58.165158 17379 leader_election.cc:304] T eb3f366f79ef4b2894bc2dbf6eb14794 P ee69eea1a5cc4645acdd4deaa9e0ac7f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 726d96e241134d7e9e1851f2cee66d03, ee69eea1a5cc4645acdd4deaa9e0ac7f; no voters: 
I20260709 13:23:58.166365 17573 raft_consensus.cc:2804] T eb3f366f79ef4b2894bc2dbf6eb14794 P ee69eea1a5cc4645acdd4deaa9e0ac7f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:23:58.166877 17573 raft_consensus.cc:493] T eb3f366f79ef4b2894bc2dbf6eb14794 P ee69eea1a5cc4645acdd4deaa9e0ac7f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:23:58.167253 17573 raft_consensus.cc:3060] T eb3f366f79ef4b2894bc2dbf6eb14794 P ee69eea1a5cc4645acdd4deaa9e0ac7f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:23:58.167671 17579 leader_election.cc:290] T eb3f366f79ef4b2894bc2dbf6eb14794 P ee69eea1a5cc4645acdd4deaa9e0ac7f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 726d96e241134d7e9e1851f2cee66d03 (127.5.126.65:45087), 316e9983905848079a8e6d9ce5585f46 (127.5.126.66:39729)
I20260709 13:23:58.170028 17339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb3f366f79ef4b2894bc2dbf6eb14794" candidate_uuid: "ee69eea1a5cc4645acdd4deaa9e0ac7f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "316e9983905848079a8e6d9ce5585f46" is_pre_election: true
W20260709 13:23:58.171696 17376 leader_election.cc:343] T eb3f366f79ef4b2894bc2dbf6eb14794 P ee69eea1a5cc4645acdd4deaa9e0ac7f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 316e9983905848079a8e6d9ce5585f46 (127.5.126.66:39729): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:23:58.172008 17552 tablet_bootstrap.cc:492] T 743cee0b3a8241dfae72c033dc3d776e P 316e9983905848079a8e6d9ce5585f46: No bootstrap required, opened a new log
I20260709 13:23:58.172634 17552 ts_tablet_manager.cc:1403] T 743cee0b3a8241dfae72c033dc3d776e P 316e9983905848079a8e6d9ce5585f46: Time spent bootstrapping tablet: real 0.029s	user 0.012s	sys 0.003s
I20260709 13:23:58.171597 17161 catalog_manager.cc:5697] T 711feb7b7a864c1d98dfd62c10eb0f99 P ee69eea1a5cc4645acdd4deaa9e0ac7f reported cstate change: term changed from 0 to 1, leader changed from <none> to ee69eea1a5cc4645acdd4deaa9e0ac7f (127.5.126.67). New cstate: current_term: 1 leader_uuid: "ee69eea1a5cc4645acdd4deaa9e0ac7f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "726d96e241134d7e9e1851f2cee66d03" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 45087 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "316e9983905848079a8e6d9ce5585f46" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 39729 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ee69eea1a5cc4645acdd4deaa9e0ac7f" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 41127 } health_report { overall_health: HEALTHY } } }
I20260709 13:23:58.173825 17161 catalog_manager.cc:5697] T d77e2380b35e4438a224b5148ebc574d P ee69eea1a5cc4645acdd4deaa9e0ac7f reported cstate change: term changed from 0 to 1, leader changed from <none> to ee69eea1a5cc4645acdd4deaa9e0ac7f (127.5.126.67). New cstate: current_term: 1 leader_uuid: "ee69eea1a5cc4645acdd4deaa9e0ac7f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "726d96e241134d7e9e1851f2cee66d03" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 45087 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "316e9983905848079a8e6d9ce5585f46" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 39729 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ee69eea1a5cc4645acdd4deaa9e0ac7f" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 41127 } health_report { overall_health: HEALTHY } } }
I20260709 13:23:58.174844 17552 raft_consensus.cc:359] T 743cee0b3a8241dfae72c033dc3d776e P 316e9983905848079a8e6d9ce5585f46 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "726d96e241134d7e9e1851f2cee66d03" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 45087 } } peers { permanent_uuid: "316e9983905848079a8e6d9ce5585f46" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 39729 } } peers { permanent_uuid: "ee69eea1a5cc4645acdd4deaa9e0ac7f" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 41127 } }
I20260709 13:23:58.175369 17552 raft_consensus.cc:385] T 743cee0b3a8241dfae72c033dc3d776e P 316e9983905848079a8e6d9ce5585f46 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:23:58.175525 17552 raft_consensus.cc:740] T 743cee0b3a8241dfae72c033dc3d776e P 316e9983905848079a8e6d9ce5585f46 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 316e9983905848079a8e6d9ce5585f46, State: Initialized, Role: FOLLOWER
I20260709 13:23:58.176170 17552 consensus_queue.cc:260] T 743cee0b3a8241dfae72c033dc3d776e P 316e9983905848079a8e6d9ce5585f46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "726d96e241134d7e9e1851f2cee66d03" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 45087 } } peers { permanent_uuid: "316e9983905848079a8e6d9ce5585f46" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 39729 } } peers { permanent_uuid: "ee69eea1a5cc4645acdd4deaa9e0ac7f" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 41127 } }
I20260709 13:23:58.177085 17573 raft_consensus.cc:515] T eb3f366f79ef4b2894bc2dbf6eb14794 P ee69eea1a5cc4645acdd4deaa9e0ac7f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "726d96e241134d7e9e1851f2cee66d03" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 45087 } } peers { permanent_uuid: "316e9983905848079a8e6d9ce5585f46" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 39729 } } peers { permanent_uuid: "ee69eea1a5cc4645acdd4deaa9e0ac7f" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 41127 } }
I20260709 13:23:58.178879 17553 tablet_bootstrap.cc:492] T 27c47c73807f4c7c9535c0873d016f62 P ee69eea1a5cc4645acdd4deaa9e0ac7f: No bootstrap required, opened a new log
I20260709 13:23:58.179406 17553 ts_tablet_manager.cc:1403] T 27c47c73807f4c7c9535c0873d016f62 P ee69eea1a5cc4645acdd4deaa9e0ac7f: Time spent bootstrapping tablet: real 0.034s	user 0.011s	sys 0.008s
I20260709 13:23:58.180276 17552 ts_tablet_manager.cc:1434] T 743cee0b3a8241dfae72c033dc3d776e P 316e9983905848079a8e6d9ce5585f46: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:23:58.181280 17552 tablet_bootstrap.cc:492] T eb3f366f79ef4b2894bc2dbf6eb14794 P 316e9983905848079a8e6d9ce5585f46: Bootstrap starting.
I20260709 13:23:58.181406 17264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb3f366f79ef4b2894bc2dbf6eb14794" candidate_uuid: "ee69eea1a5cc4645acdd4deaa9e0ac7f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "726d96e241134d7e9e1851f2cee66d03"
I20260709 13:23:58.182104 17264 raft_consensus.cc:3060] T eb3f366f79ef4b2894bc2dbf6eb14794 P 726d96e241134d7e9e1851f2cee66d03 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:23:58.187279 17552 tablet_bootstrap.cc:654] T eb3f366f79ef4b2894bc2dbf6eb14794 P 316e9983905848079a8e6d9ce5585f46: Neither blocks nor log segments found. Creating new log.
I20260709 13:23:58.190184 17553 raft_consensus.cc:359] T 27c47c73807f4c7c9535c0873d016f62 P ee69eea1a5cc4645acdd4deaa9e0ac7f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "726d96e241134d7e9e1851f2cee66d03" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 45087 } } peers { permanent_uuid: "316e9983905848079a8e6d9ce5585f46" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 39729 } } peers { permanent_uuid: "ee69eea1a5cc4645acdd4deaa9e0ac7f" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 41127 } }
I20260709 13:23:58.190999 17264 raft_consensus.cc:2468] T eb3f366f79ef4b2894bc2dbf6eb14794 P 726d96e241134d7e9e1851f2cee66d03 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee69eea1a5cc4645acdd4deaa9e0ac7f in term 1.
I20260709 13:23:58.191179 17553 raft_consensus.cc:385] T 27c47c73807f4c7c9535c0873d016f62 P ee69eea1a5cc4645acdd4deaa9e0ac7f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:23:58.191916 17553 raft_consensus.cc:740] T 27c47c73807f4c7c9535c0873d016f62 P ee69eea1a5cc4645acdd4deaa9e0ac7f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ee69eea1a5cc4645acdd4deaa9e0ac7f, State: Initialized, Role: FOLLOWER
I20260709 13:23:58.192795 17379 leader_election.cc:304] T eb3f366f79ef4b2894bc2dbf6eb14794 P ee69eea1a5cc4645acdd4deaa9e0ac7f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 726d96e241134d7e9e1851f2cee66d03, ee69eea1a5cc4645acdd4deaa9e0ac7f; no voters: 
I20260709 13:23:58.195235 17487 raft_consensus.cc:2804] T eb3f366f79ef4b2894bc2dbf6eb14794 P ee69eea1a5cc4645acdd4deaa9e0ac7f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:23:58.195899 17487 raft_consensus.cc:697] T eb3f366f79ef4b2894bc2dbf6eb14794 P ee69eea1a5cc4645acdd4deaa9e0ac7f [term 1 LEADER]: Becoming Leader. State: Replica: ee69eea1a5cc4645acdd4deaa9e0ac7f, State: Running, Role: LEADER
I20260709 13:23:58.194883 17553 consensus_queue.cc:260] T 27c47c73807f4c7c9535c0873d016f62 P ee69eea1a5cc4645acdd4deaa9e0ac7f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "726d96e241134d7e9e1851f2cee66d03" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 45087 } } peers { permanent_uuid: "316e9983905848079a8e6d9ce5585f46" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 39729 } } peers { permanent_uuid: "ee69eea1a5cc4645acdd4deaa9e0ac7f" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 41127 } }
I20260709 13:23:58.197005 17487 consensus_queue.cc:237] T eb3f366f79ef4b2894bc2dbf6eb14794 P ee69eea1a5cc4645acdd4deaa9e0ac7f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "726d96e241134d7e9e1851f2cee66d03" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 45087 } } peers { permanent_uuid: "316e9983905848079a8e6d9ce5585f46" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 39729 } } peers { permanent_uuid: "ee69eea1a5cc4645acdd4deaa9e0ac7f" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 41127 } }
I20260709 13:23:58.198246 17553 ts_tablet_manager.cc:1434] T 27c47c73807f4c7c9535c0873d016f62 P ee69eea1a5cc4645acdd4deaa9e0ac7f: Time spent starting tablet: real 0.019s	user 0.008s	sys 0.000s
I20260709 13:23:58.199034 17552 tablet_bootstrap.cc:492] T eb3f366f79ef4b2894bc2dbf6eb14794 P 316e9983905848079a8e6d9ce5585f46: No bootstrap required, opened a new log
I20260709 13:23:58.199254 17553 tablet_bootstrap.cc:492] T 86979013624c4c96843236a7e7f8a1ec P ee69eea1a5cc4645acdd4deaa9e0ac7f: Bootstrap starting.
I20260709 13:23:58.199581 17552 ts_tablet_manager.cc:1403] T eb3f366f79ef4b2894bc2dbf6eb14794 P 316e9983905848079a8e6d9ce5585f46: Time spent bootstrapping tablet: real 0.019s	user 0.005s	sys 0.010s
I20260709 13:23:58.201646 17573 leader_election.cc:290] T eb3f366f79ef4b2894bc2dbf6eb14794 P ee69eea1a5cc4645acdd4deaa9e0ac7f [CANDIDATE]: Term 1 election: Requested vote from peers 726d96e241134d7e9e1851f2cee66d03 (127.5.126.65:45087), 316e9983905848079a8e6d9ce5585f46 (127.5.126.66:39729)
I20260709 13:23:58.203019 17552 raft_consensus.cc:359] T eb3f366f79ef4b2894bc2dbf6eb14794 P 316e9983905848079a8e6d9ce5585f46 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "726d96e241134d7e9e1851f2cee66d03" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 45087 } } peers { permanent_uuid: "316e9983905848079a8e6d9ce5585f46" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 39729 } } peers { permanent_uuid: "ee69eea1a5cc4645acdd4deaa9e0ac7f" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 41127 } }
I20260709 13:23:58.203820 17552 raft_consensus.cc:385] T eb3f366f79ef4b2894bc2dbf6eb14794 P 316e9983905848079a8e6d9ce5585f46 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:23:58.204106 17552 raft_consensus.cc:740] T eb3f366f79ef4b2894bc2dbf6eb14794 P 316e9983905848079a8e6d9ce5585f46 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 316e9983905848079a8e6d9ce5585f46, State: Initialized, Role: FOLLOWER
I20260709 13:23:58.204367 17554 tablet_bootstrap.cc:492] T 27c47c73807f4c7c9535c0873d016f62 P 726d96e241134d7e9e1851f2cee66d03: No bootstrap required, opened a new log
I20260709 13:23:58.205034 17554 ts_tablet_manager.cc:1403] T 27c47c73807f4c7c9535c0873d016f62 P 726d96e241134d7e9e1851f2cee66d03: Time spent bootstrapping tablet: real 0.075s	user 0.019s	sys 0.004s
I20260709 13:23:58.204826 17552 consensus_queue.cc:260] T eb3f366f79ef4b2894bc2dbf6eb14794 P 316e9983905848079a8e6d9ce5585f46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "726d96e241134d7e9e1851f2cee66d03" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 45087 } } peers { permanent_uuid: "316e9983905848079a8e6d9ce5585f46" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 39729 } } peers { permanent_uuid: "ee69eea1a5cc4645acdd4deaa9e0ac7f" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 41127 } }
I20260709 13:23:58.205212 17339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb3f366f79ef4b2894bc2dbf6eb14794" candidate_uuid: "ee69eea1a5cc4645acdd4deaa9e0ac7f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "316e9983905848079a8e6d9ce5585f46"
I20260709 13:23:58.206040 17339 raft_consensus.cc:3060] T eb3f366f79ef4b2894bc2dbf6eb14794 P 316e9983905848079a8e6d9ce5585f46 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:23:58.207058 17552 ts_tablet_manager.cc:1434] T eb3f366f79ef4b2894bc2dbf6eb14794 P 316e9983905848079a8e6d9ce5585f46: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.003s
I20260709 13:23:58.208962 17554 raft_consensus.cc:359] T 27c47c73807f4c7c9535c0873d016f62 P 726d96e241134d7e9e1851f2cee66d03 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "726d96e241134d7e9e1851f2cee66d03" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 45087 } } peers { permanent_uuid: "316e9983905848079a8e6d9ce5585f46" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 39729 } } peers { permanent_uuid: "ee69eea1a5cc4645acdd4deaa9e0ac7f" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 41127 } }
I20260709 13:23:58.209826 17554 raft_consensus.cc:385] T 27c47c73807f4c7c9535c0873d016f62 P 726d96e241134d7e9e1851f2cee66d03 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:23:58.210150 17554 raft_consensus.cc:740] T 27c47c73807f4c7c9535c0873d016f62 P 726d96e241134d7e9e1851f2cee66d03 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 726d96e241134d7e9e1851f2cee66d03, State: Initialized, Role: FOLLOWER
I20260709 13:23:58.211444 17554 consensus_queue.cc:260] T 27c47c73807f4c7c9535c0873d016f62 P 726d96e241134d7e9e1851f2cee66d03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "726d96e241134d7e9e1851f2cee66d03" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 45087 } } peers { permanent_uuid: "316e9983905848079a8e6d9ce5585f46" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 39729 } } peers { permanent_uuid: "ee69eea1a5cc4645acdd4deaa9e0ac7f" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 41127 } }
I20260709 13:23:58.212558 17553 tablet_bootstrap.cc:654] T 86979013624c4c96843236a7e7f8a1ec P ee69eea1a5cc4645acdd4deaa9e0ac7f: Neither blocks nor log segments found. Creating new log.
I20260709 13:23:58.215119 17554 ts_tablet_manager.cc:1434] T 27c47c73807f4c7c9535c0873d016f62 P 726d96e241134d7e9e1851f2cee66d03: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.004s
I20260709 13:23:58.216733 17554 tablet_bootstrap.cc:492] T 743cee0b3a8241dfae72c033dc3d776e P 726d96e241134d7e9e1851f2cee66d03: Bootstrap starting.
I20260709 13:23:58.228998 17339 raft_consensus.cc:2468] T eb3f366f79ef4b2894bc2dbf6eb14794 P 316e9983905848079a8e6d9ce5585f46 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee69eea1a5cc4645acdd4deaa9e0ac7f in term 1.
I20260709 13:23:58.230145 17554 tablet_bootstrap.cc:654] T 743cee0b3a8241dfae72c033dc3d776e P 726d96e241134d7e9e1851f2cee66d03: Neither blocks nor log segments found. Creating new log.
I20260709 13:23:58.240983 17553 tablet_bootstrap.cc:492] T 86979013624c4c96843236a7e7f8a1ec P ee69eea1a5cc4645acdd4deaa9e0ac7f: No bootstrap required, opened a new log
I20260709 13:23:58.241654 17553 ts_tablet_manager.cc:1403] T 86979013624c4c96843236a7e7f8a1ec P ee69eea1a5cc4645acdd4deaa9e0ac7f: Time spent bootstrapping tablet: real 0.043s	user 0.012s	sys 0.016s
I20260709 13:23:58.244426 17554 tablet_bootstrap.cc:492] T 743cee0b3a8241dfae72c033dc3d776e P 726d96e241134d7e9e1851f2cee66d03: No bootstrap required, opened a new log
I20260709 13:23:58.244423 17553 raft_consensus.cc:359] T 86979013624c4c96843236a7e7f8a1ec P ee69eea1a5cc4645acdd4deaa9e0ac7f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "726d96e241134d7e9e1851f2cee66d03" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 45087 } } peers { permanent_uuid: "316e9983905848079a8e6d9ce5585f46" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 39729 } } peers { permanent_uuid: "ee69eea1a5cc4645acdd4deaa9e0ac7f" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 41127 } }
I20260709 13:23:58.245267 17554 ts_tablet_manager.cc:1403] T 743cee0b3a8241dfae72c033dc3d776e P 726d96e241134d7e9e1851f2cee66d03: Time spent bootstrapping tablet: real 0.029s	user 0.015s	sys 0.000s
I20260709 13:23:58.245540 17553 raft_consensus.cc:385] T 86979013624c4c96843236a7e7f8a1ec P ee69eea1a5cc4645acdd4deaa9e0ac7f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:23:58.245137 17160 catalog_manager.cc:5697] T eb3f366f79ef4b2894bc2dbf6eb14794 P ee69eea1a5cc4645acdd4deaa9e0ac7f reported cstate change: term changed from 0 to 1, leader changed from <none> to ee69eea1a5cc4645acdd4deaa9e0ac7f (127.5.126.67). New cstate: current_term: 1 leader_uuid: "ee69eea1a5cc4645acdd4deaa9e0ac7f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "726d96e241134d7e9e1851f2cee66d03" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 45087 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "316e9983905848079a8e6d9ce5585f46" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 39729 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ee69eea1a5cc4645acdd4deaa9e0ac7f" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 41127 } health_report { overall_health: HEALTHY } } }
I20260709 13:23:58.245930 17553 raft_consensus.cc:740] T 86979013624c4c96843236a7e7f8a1ec P ee69eea1a5cc4645acdd4deaa9e0ac7f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ee69eea1a5cc4645acdd4deaa9e0ac7f, State: Initialized, Role: FOLLOWER
I20260709 13:23:58.247053 17553 consensus_queue.cc:260] T 86979013624c4c96843236a7e7f8a1ec P ee69eea1a5cc4645acdd4deaa9e0ac7f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "726d96e241134d7e9e1851f2cee66d03" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 45087 } } peers { permanent_uuid: "316e9983905848079a8e6d9ce5585f46" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 39729 } } peers { permanent_uuid: "ee69eea1a5cc4645acdd4deaa9e0ac7f" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 41127 } }
I20260709 13:23:58.249075 17553 ts_tablet_manager.cc:1434] T 86979013624c4c96843236a7e7f8a1ec P ee69eea1a5cc4645acdd4deaa9e0ac7f: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:23:58.249982 17554 raft_consensus.cc:359] T 743cee0b3a8241dfae72c033dc3d776e P 726d96e241134d7e9e1851f2cee66d03 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "726d96e241134d7e9e1851f2cee66d03" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 45087 } } peers { permanent_uuid: "316e9983905848079a8e6d9ce5585f46" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 39729 } } peers { permanent_uuid: "ee69eea1a5cc4645acdd4deaa9e0ac7f" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 41127 } }
I20260709 13:23:58.250865 17554 raft_consensus.cc:385] T 743cee0b3a8241dfae72c033dc3d776e P 726d96e241134d7e9e1851f2cee66d03 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:23:58.251216 17554 raft_consensus.cc:740] T 743cee0b3a8241dfae72c033dc3d776e P 726d96e241134d7e9e1851f2cee66d03 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 726d96e241134d7e9e1851f2cee66d03, State: Initialized, Role: FOLLOWER
I20260709 13:23:58.252094 17554 consensus_queue.cc:260] T 743cee0b3a8241dfae72c033dc3d776e P 726d96e241134d7e9e1851f2cee66d03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "726d96e241134d7e9e1851f2cee66d03" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 45087 } } peers { permanent_uuid: "316e9983905848079a8e6d9ce5585f46" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 39729 } } peers { permanent_uuid: "ee69eea1a5cc4645acdd4deaa9e0ac7f" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 41127 } }
I20260709 13:23:58.254652 17554 ts_tablet_manager.cc:1434] T 743cee0b3a8241dfae72c033dc3d776e P 726d96e241134d7e9e1851f2cee66d03: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 13:23:58.255936 17554 tablet_bootstrap.cc:492] T d77e2380b35e4438a224b5148ebc574d P 726d96e241134d7e9e1851f2cee66d03: Bootstrap starting.
I20260709 13:23:58.262645 17554 tablet_bootstrap.cc:654] T d77e2380b35e4438a224b5148ebc574d P 726d96e241134d7e9e1851f2cee66d03: Neither blocks nor log segments found. Creating new log.
I20260709 13:23:58.268322 17554 tablet_bootstrap.cc:492] T d77e2380b35e4438a224b5148ebc574d P 726d96e241134d7e9e1851f2cee66d03: No bootstrap required, opened a new log
I20260709 13:23:58.268827 17554 ts_tablet_manager.cc:1403] T d77e2380b35e4438a224b5148ebc574d P 726d96e241134d7e9e1851f2cee66d03: Time spent bootstrapping tablet: real 0.013s	user 0.012s	sys 0.000s
I20260709 13:23:58.271329 17554 raft_consensus.cc:359] T d77e2380b35e4438a224b5148ebc574d P 726d96e241134d7e9e1851f2cee66d03 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "726d96e241134d7e9e1851f2cee66d03" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 45087 } } peers { permanent_uuid: "316e9983905848079a8e6d9ce5585f46" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 39729 } } peers { permanent_uuid: "ee69eea1a5cc4645acdd4deaa9e0ac7f" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 41127 } }
I20260709 13:23:58.271908 17554 raft_consensus.cc:385] T d77e2380b35e4438a224b5148ebc574d P 726d96e241134d7e9e1851f2cee66d03 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:23:58.272217 17554 raft_consensus.cc:740] T d77e2380b35e4438a224b5148ebc574d P 726d96e241134d7e9e1851f2cee66d03 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 726d96e241134d7e9e1851f2cee66d03, State: Initialized, Role: FOLLOWER
I20260709 13:23:58.272823 17554 consensus_queue.cc:260] T d77e2380b35e4438a224b5148ebc574d P 726d96e241134d7e9e1851f2cee66d03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "726d96e241134d7e9e1851f2cee66d03" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 45087 } } peers { permanent_uuid: "316e9983905848079a8e6d9ce5585f46" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 39729 } } peers { permanent_uuid: "ee69eea1a5cc4645acdd4deaa9e0ac7f" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 41127 } }
I20260709 13:23:58.274442 17554 ts_tablet_manager.cc:1434] T d77e2380b35e4438a224b5148ebc574d P 726d96e241134d7e9e1851f2cee66d03: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:23:58.275636 17554 tablet_bootstrap.cc:492] T 86979013624c4c96843236a7e7f8a1ec P 726d96e241134d7e9e1851f2cee66d03: Bootstrap starting.
I20260709 13:23:58.276716 17573 raft_consensus.cc:493] T 27c47c73807f4c7c9535c0873d016f62 P ee69eea1a5cc4645acdd4deaa9e0ac7f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:23:58.277341 17573 raft_consensus.cc:515] T 27c47c73807f4c7c9535c0873d016f62 P ee69eea1a5cc4645acdd4deaa9e0ac7f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "726d96e241134d7e9e1851f2cee66d03" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 45087 } } peers { permanent_uuid: "316e9983905848079a8e6d9ce5585f46" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 39729 } } peers { permanent_uuid: "ee69eea1a5cc4645acdd4deaa9e0ac7f" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 41127 } }
I20260709 13:23:58.279340 17573 leader_election.cc:290] T 27c47c73807f4c7c9535c0873d016f62 P ee69eea1a5cc4645acdd4deaa9e0ac7f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 726d96e241134d7e9e1851f2cee66d03 (127.5.126.65:45087), 316e9983905848079a8e6d9ce5585f46 (127.5.126.66:39729)
I20260709 13:23:58.280213 17264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27c47c73807f4c7c9535c0873d016f62" candidate_uuid: "ee69eea1a5cc4645acdd4deaa9e0ac7f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "726d96e241134d7e9e1851f2cee66d03" is_pre_election: true
I20260709 13:23:58.280815 17339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27c47c73807f4c7c9535c0873d016f62" candidate_uuid: "ee69eea1a5cc4645acdd4deaa9e0ac7f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "316e9983905848079a8e6d9ce5585f46" is_pre_election: true
I20260709 13:23:58.281025 17264 raft_consensus.cc:2468] T 27c47c73807f4c7c9535c0873d016f62 P 726d96e241134d7e9e1851f2cee66d03 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee69eea1a5cc4645acdd4deaa9e0ac7f in term 0.
I20260709 13:23:58.281623 17339 raft_consensus.cc:2468] T 27c47c73807f4c7c9535c0873d016f62 P 316e9983905848079a8e6d9ce5585f46 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee69eea1a5cc4645acdd4deaa9e0ac7f in term 0.
I20260709 13:23:58.282545 17554 tablet_bootstrap.cc:654] T 86979013624c4c96843236a7e7f8a1ec P 726d96e241134d7e9e1851f2cee66d03: Neither blocks nor log segments found. Creating new log.
I20260709 13:23:58.282387 17379 leader_election.cc:304] T 27c47c73807f4c7c9535c0873d016f62 P ee69eea1a5cc4645acdd4deaa9e0ac7f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 726d96e241134d7e9e1851f2cee66d03, ee69eea1a5cc4645acdd4deaa9e0ac7f; no voters: 
I20260709 13:23:58.283456 17573 raft_consensus.cc:2804] T 27c47c73807f4c7c9535c0873d016f62 P ee69eea1a5cc4645acdd4deaa9e0ac7f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:23:58.283850 17573 raft_consensus.cc:493] T 27c47c73807f4c7c9535c0873d016f62 P ee69eea1a5cc4645acdd4deaa9e0ac7f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:23:58.284248 17573 raft_consensus.cc:3060] T 27c47c73807f4c7c9535c0873d016f62 P ee69eea1a5cc4645acdd4deaa9e0ac7f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:23:58.288638 17554 tablet_bootstrap.cc:492] T 86979013624c4c96843236a7e7f8a1ec P 726d96e241134d7e9e1851f2cee66d03: No bootstrap required, opened a new log
I20260709 13:23:58.289335 17554 ts_tablet_manager.cc:1403] T 86979013624c4c96843236a7e7f8a1ec P 726d96e241134d7e9e1851f2cee66d03: Time spent bootstrapping tablet: real 0.014s	user 0.012s	sys 0.000s
I20260709 13:23:58.291141 17573 raft_consensus.cc:515] T 27c47c73807f4c7c9535c0873d016f62 P ee69eea1a5cc4645acdd4deaa9e0ac7f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "726d96e241134d7e9e1851f2cee66d03" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 45087 } } peers { permanent_uuid: "316e9983905848079a8e6d9ce5585f46" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 39729 } } peers { permanent_uuid: "ee69eea1a5cc4645acdd4deaa9e0ac7f" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 41127 } }
I20260709 13:23:58.292522 17554 raft_consensus.cc:359] T 86979013624c4c96843236a7e7f8a1ec P 726d96e241134d7e9e1851f2cee66d03 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "726d96e241134d7e9e1851f2cee66d03" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 45087 } } peers { permanent_uuid: "316e9983905848079a8e6d9ce5585f46" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 39729 } } peers { permanent_uuid: "ee69eea1a5cc4645acdd4deaa9e0ac7f" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 41127 } }
I20260709 13:23:58.293183 17554 raft_consensus.cc:385] T 86979013624c4c96843236a7e7f8a1ec P 726d96e241134d7e9e1851f2cee66d03 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:23:58.293401 17573 leader_election.cc:290] T 27c47c73807f4c7c9535c0873d016f62 P ee69eea1a5cc4645acdd4deaa9e0ac7f [CANDIDATE]: Term 1 election: Requested vote from peers 726d96e241134d7e9e1851f2cee66d03 (127.5.126.65:45087), 316e9983905848079a8e6d9ce5585f46 (127.5.126.66:39729)
I20260709 13:23:58.293460 17554 raft_consensus.cc:740] T 86979013624c4c96843236a7e7f8a1ec P 726d96e241134d7e9e1851f2cee66d03 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 726d96e241134d7e9e1851f2cee66d03, State: Initialized, Role: FOLLOWER
I20260709 13:23:58.294332 17264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27c47c73807f4c7c9535c0873d016f62" candidate_uuid: "ee69eea1a5cc4645acdd4deaa9e0ac7f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "726d96e241134d7e9e1851f2cee66d03"
I20260709 13:23:58.294688 17339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27c47c73807f4c7c9535c0873d016f62" candidate_uuid: "ee69eea1a5cc4645acdd4deaa9e0ac7f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "316e9983905848079a8e6d9ce5585f46"
I20260709 13:23:58.295090 17264 raft_consensus.cc:3060] T 27c47c73807f4c7c9535c0873d016f62 P 726d96e241134d7e9e1851f2cee66d03 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:23:58.294773 17554 consensus_queue.cc:260] T 86979013624c4c96843236a7e7f8a1ec P 726d96e241134d7e9e1851f2cee66d03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "726d96e241134d7e9e1851f2cee66d03" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 45087 } } peers { permanent_uuid: "316e9983905848079a8e6d9ce5585f46" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 39729 } } peers { permanent_uuid: "ee69eea1a5cc4645acdd4deaa9e0ac7f" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 41127 } }
I20260709 13:23:58.295799 17339 raft_consensus.cc:3060] T 27c47c73807f4c7c9535c0873d016f62 P 316e9983905848079a8e6d9ce5585f46 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:23:58.297838 17554 ts_tablet_manager.cc:1434] T 86979013624c4c96843236a7e7f8a1ec P 726d96e241134d7e9e1851f2cee66d03: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 13:23:58.304438 17264 raft_consensus.cc:2468] T 27c47c73807f4c7c9535c0873d016f62 P 726d96e241134d7e9e1851f2cee66d03 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee69eea1a5cc4645acdd4deaa9e0ac7f in term 1.
I20260709 13:23:58.305955 17339 raft_consensus.cc:2468] T 27c47c73807f4c7c9535c0873d016f62 P 316e9983905848079a8e6d9ce5585f46 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee69eea1a5cc4645acdd4deaa9e0ac7f in term 1.
I20260709 13:23:58.306084 17379 leader_election.cc:304] T 27c47c73807f4c7c9535c0873d016f62 P ee69eea1a5cc4645acdd4deaa9e0ac7f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 726d96e241134d7e9e1851f2cee66d03, ee69eea1a5cc4645acdd4deaa9e0ac7f; no voters: 
I20260709 13:23:58.307178 17573 raft_consensus.cc:2804] T 27c47c73807f4c7c9535c0873d016f62 P ee69eea1a5cc4645acdd4deaa9e0ac7f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:23:58.307767 17573 raft_consensus.cc:697] T 27c47c73807f4c7c9535c0873d016f62 P ee69eea1a5cc4645acdd4deaa9e0ac7f [term 1 LEADER]: Becoming Leader. State: Replica: ee69eea1a5cc4645acdd4deaa9e0ac7f, State: Running, Role: LEADER
I20260709 13:23:58.308981 17573 consensus_queue.cc:237] T 27c47c73807f4c7c9535c0873d016f62 P ee69eea1a5cc4645acdd4deaa9e0ac7f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "726d96e241134d7e9e1851f2cee66d03" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 45087 } } peers { permanent_uuid: "316e9983905848079a8e6d9ce5585f46" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 39729 } } peers { permanent_uuid: "ee69eea1a5cc4645acdd4deaa9e0ac7f" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 41127 } }
I20260709 13:23:58.318813 17161 catalog_manager.cc:5697] T 27c47c73807f4c7c9535c0873d016f62 P ee69eea1a5cc4645acdd4deaa9e0ac7f reported cstate change: term changed from 0 to 1, leader changed from <none> to ee69eea1a5cc4645acdd4deaa9e0ac7f (127.5.126.67). New cstate: current_term: 1 leader_uuid: "ee69eea1a5cc4645acdd4deaa9e0ac7f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "726d96e241134d7e9e1851f2cee66d03" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 45087 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "316e9983905848079a8e6d9ce5585f46" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 39729 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ee69eea1a5cc4645acdd4deaa9e0ac7f" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 41127 } health_report { overall_health: HEALTHY } } }
I20260709 13:23:58.323768 17539 raft_consensus.cc:493] T 86979013624c4c96843236a7e7f8a1ec P 726d96e241134d7e9e1851f2cee66d03 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:23:58.324390 17539 raft_consensus.cc:515] T 86979013624c4c96843236a7e7f8a1ec P 726d96e241134d7e9e1851f2cee66d03 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "726d96e241134d7e9e1851f2cee66d03" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 45087 } } peers { permanent_uuid: "316e9983905848079a8e6d9ce5585f46" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 39729 } } peers { permanent_uuid: "ee69eea1a5cc4645acdd4deaa9e0ac7f" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 41127 } }
I20260709 13:23:58.326581 17539 leader_election.cc:290] T 86979013624c4c96843236a7e7f8a1ec P 726d96e241134d7e9e1851f2cee66d03 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 316e9983905848079a8e6d9ce5585f46 (127.5.126.66:39729), ee69eea1a5cc4645acdd4deaa9e0ac7f (127.5.126.67:41127)
I20260709 13:23:58.327822 17339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86979013624c4c96843236a7e7f8a1ec" candidate_uuid: "726d96e241134d7e9e1851f2cee66d03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "316e9983905848079a8e6d9ce5585f46" is_pre_election: true
I20260709 13:23:58.328100 17410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86979013624c4c96843236a7e7f8a1ec" candidate_uuid: "726d96e241134d7e9e1851f2cee66d03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee69eea1a5cc4645acdd4deaa9e0ac7f" is_pre_election: true
I20260709 13:23:58.328590 17339 raft_consensus.cc:2468] T 86979013624c4c96843236a7e7f8a1ec P 316e9983905848079a8e6d9ce5585f46 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 726d96e241134d7e9e1851f2cee66d03 in term 0.
I20260709 13:23:58.328979 17410 raft_consensus.cc:2468] T 86979013624c4c96843236a7e7f8a1ec P ee69eea1a5cc4645acdd4deaa9e0ac7f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 726d96e241134d7e9e1851f2cee66d03 in term 0.
I20260709 13:23:58.329762 17227 leader_election.cc:304] T 86979013624c4c96843236a7e7f8a1ec P 726d96e241134d7e9e1851f2cee66d03 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 316e9983905848079a8e6d9ce5585f46, 726d96e241134d7e9e1851f2cee66d03; no voters: 
I20260709 13:23:58.330629 17539 raft_consensus.cc:2804] T 86979013624c4c96843236a7e7f8a1ec P 726d96e241134d7e9e1851f2cee66d03 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:23:58.330992 17539 raft_consensus.cc:493] T 86979013624c4c96843236a7e7f8a1ec P 726d96e241134d7e9e1851f2cee66d03 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:23:58.331293 17539 raft_consensus.cc:3060] T 86979013624c4c96843236a7e7f8a1ec P 726d96e241134d7e9e1851f2cee66d03 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:23:58.336194 17539 raft_consensus.cc:515] T 86979013624c4c96843236a7e7f8a1ec P 726d96e241134d7e9e1851f2cee66d03 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "726d96e241134d7e9e1851f2cee66d03" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 45087 } } peers { permanent_uuid: "316e9983905848079a8e6d9ce5585f46" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 39729 } } peers { permanent_uuid: "ee69eea1a5cc4645acdd4deaa9e0ac7f" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 41127 } }
I20260709 13:23:58.337813 17539 leader_election.cc:290] T 86979013624c4c96843236a7e7f8a1ec P 726d96e241134d7e9e1851f2cee66d03 [CANDIDATE]: Term 1 election: Requested vote from peers 316e9983905848079a8e6d9ce5585f46 (127.5.126.66:39729), ee69eea1a5cc4645acdd4deaa9e0ac7f (127.5.126.67:41127)
I20260709 13:23:58.338960 17410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86979013624c4c96843236a7e7f8a1ec" candidate_uuid: "726d96e241134d7e9e1851f2cee66d03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee69eea1a5cc4645acdd4deaa9e0ac7f"
I20260709 13:23:58.339699 17410 raft_consensus.cc:3060] T 86979013624c4c96843236a7e7f8a1ec P ee69eea1a5cc4645acdd4deaa9e0ac7f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:23:58.339128 17339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86979013624c4c96843236a7e7f8a1ec" candidate_uuid: "726d96e241134d7e9e1851f2cee66d03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "316e9983905848079a8e6d9ce5585f46"
I20260709 13:23:58.340380 17339 raft_consensus.cc:3060] T 86979013624c4c96843236a7e7f8a1ec P 316e9983905848079a8e6d9ce5585f46 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:23:58.345188 17539 raft_consensus.cc:493] T d77e2380b35e4438a224b5148ebc574d P 726d96e241134d7e9e1851f2cee66d03 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:23:58.345434 17410 raft_consensus.cc:2468] T 86979013624c4c96843236a7e7f8a1ec P ee69eea1a5cc4645acdd4deaa9e0ac7f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 726d96e241134d7e9e1851f2cee66d03 in term 1.
I20260709 13:23:58.345871 17539 raft_consensus.cc:515] T d77e2380b35e4438a224b5148ebc574d P 726d96e241134d7e9e1851f2cee66d03 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "726d96e241134d7e9e1851f2cee66d03" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 45087 } } peers { permanent_uuid: "316e9983905848079a8e6d9ce5585f46" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 39729 } } peers { permanent_uuid: "ee69eea1a5cc4645acdd4deaa9e0ac7f" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 41127 } }
I20260709 13:23:58.346720 17227 leader_election.cc:304] T 86979013624c4c96843236a7e7f8a1ec P 726d96e241134d7e9e1851f2cee66d03 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 726d96e241134d7e9e1851f2cee66d03, ee69eea1a5cc4645acdd4deaa9e0ac7f; no voters: 
I20260709 13:23:58.347142 17339 raft_consensus.cc:2468] T 86979013624c4c96843236a7e7f8a1ec P 316e9983905848079a8e6d9ce5585f46 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 726d96e241134d7e9e1851f2cee66d03 in term 1.
I20260709 13:23:58.347590 17577 raft_consensus.cc:2804] T 86979013624c4c96843236a7e7f8a1ec P 726d96e241134d7e9e1851f2cee66d03 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:23:58.348178 17577 raft_consensus.cc:697] T 86979013624c4c96843236a7e7f8a1ec P 726d96e241134d7e9e1851f2cee66d03 [term 1 LEADER]: Becoming Leader. State: Replica: 726d96e241134d7e9e1851f2cee66d03, State: Running, Role: LEADER
I20260709 13:23:58.349078 17539 leader_election.cc:290] T d77e2380b35e4438a224b5148ebc574d P 726d96e241134d7e9e1851f2cee66d03 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 316e9983905848079a8e6d9ce5585f46 (127.5.126.66:39729), ee69eea1a5cc4645acdd4deaa9e0ac7f (127.5.126.67:41127)
I20260709 13:23:58.349033 17577 consensus_queue.cc:237] T 86979013624c4c96843236a7e7f8a1ec P 726d96e241134d7e9e1851f2cee66d03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "726d96e241134d7e9e1851f2cee66d03" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 45087 } } peers { permanent_uuid: "316e9983905848079a8e6d9ce5585f46" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 39729 } } peers { permanent_uuid: "ee69eea1a5cc4645acdd4deaa9e0ac7f" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 41127 } }
I20260709 13:23:58.350731 17410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d77e2380b35e4438a224b5148ebc574d" candidate_uuid: "726d96e241134d7e9e1851f2cee66d03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee69eea1a5cc4645acdd4deaa9e0ac7f" is_pre_election: true
I20260709 13:23:58.349948 17339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d77e2380b35e4438a224b5148ebc574d" candidate_uuid: "726d96e241134d7e9e1851f2cee66d03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "316e9983905848079a8e6d9ce5585f46" is_pre_election: true
I20260709 13:23:58.354802 17339 raft_consensus.cc:2393] T d77e2380b35e4438a224b5148ebc574d P 316e9983905848079a8e6d9ce5585f46 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 726d96e241134d7e9e1851f2cee66d03 in current term 1: Already voted for candidate ee69eea1a5cc4645acdd4deaa9e0ac7f in this term.
I20260709 13:23:58.356125 17227 leader_election.cc:304] T d77e2380b35e4438a224b5148ebc574d P 726d96e241134d7e9e1851f2cee66d03 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 726d96e241134d7e9e1851f2cee66d03; no voters: 316e9983905848079a8e6d9ce5585f46, ee69eea1a5cc4645acdd4deaa9e0ac7f
I20260709 13:23:58.357020 17577 raft_consensus.cc:3060] T d77e2380b35e4438a224b5148ebc574d P 726d96e241134d7e9e1851f2cee66d03 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:23:58.359853 17161 catalog_manager.cc:5697] T 86979013624c4c96843236a7e7f8a1ec P 726d96e241134d7e9e1851f2cee66d03 reported cstate change: term changed from 0 to 1, leader changed from <none> to 726d96e241134d7e9e1851f2cee66d03 (127.5.126.65). New cstate: current_term: 1 leader_uuid: "726d96e241134d7e9e1851f2cee66d03" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "726d96e241134d7e9e1851f2cee66d03" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 45087 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "316e9983905848079a8e6d9ce5585f46" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 39729 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ee69eea1a5cc4645acdd4deaa9e0ac7f" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 41127 } health_report { overall_health: UNKNOWN } } }
I20260709 13:23:58.363058 17577 raft_consensus.cc:2749] T d77e2380b35e4438a224b5148ebc574d P 726d96e241134d7e9e1851f2cee66d03 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:23:58.388309 17210 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:23:58.397473 17577 raft_consensus.cc:493] T 743cee0b3a8241dfae72c033dc3d776e P 726d96e241134d7e9e1851f2cee66d03 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:23:58.398265 17577 raft_consensus.cc:515] T 743cee0b3a8241dfae72c033dc3d776e P 726d96e241134d7e9e1851f2cee66d03 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "726d96e241134d7e9e1851f2cee66d03" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 45087 } } peers { permanent_uuid: "316e9983905848079a8e6d9ce5585f46" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 39729 } } peers { permanent_uuid: "ee69eea1a5cc4645acdd4deaa9e0ac7f" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 41127 } }
I20260709 13:23:58.400434 17577 leader_election.cc:290] T 743cee0b3a8241dfae72c033dc3d776e P 726d96e241134d7e9e1851f2cee66d03 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 316e9983905848079a8e6d9ce5585f46 (127.5.126.66:39729), ee69eea1a5cc4645acdd4deaa9e0ac7f (127.5.126.67:41127)
I20260709 13:23:58.401467 17339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "743cee0b3a8241dfae72c033dc3d776e" candidate_uuid: "726d96e241134d7e9e1851f2cee66d03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "316e9983905848079a8e6d9ce5585f46" is_pre_election: true
I20260709 13:23:58.401818 17410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "743cee0b3a8241dfae72c033dc3d776e" candidate_uuid: "726d96e241134d7e9e1851f2cee66d03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee69eea1a5cc4645acdd4deaa9e0ac7f" is_pre_election: true
I20260709 13:23:58.402292 17339 raft_consensus.cc:2468] T 743cee0b3a8241dfae72c033dc3d776e P 316e9983905848079a8e6d9ce5585f46 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 726d96e241134d7e9e1851f2cee66d03 in term 0.
I20260709 13:23:58.402702 17410 raft_consensus.cc:2468] T 743cee0b3a8241dfae72c033dc3d776e P ee69eea1a5cc4645acdd4deaa9e0ac7f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 726d96e241134d7e9e1851f2cee66d03 in term 0.
I20260709 13:23:58.403564 17227 leader_election.cc:304] T 743cee0b3a8241dfae72c033dc3d776e P 726d96e241134d7e9e1851f2cee66d03 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 316e9983905848079a8e6d9ce5585f46, 726d96e241134d7e9e1851f2cee66d03; no voters: 
I20260709 13:23:58.404485 17577 raft_consensus.cc:2804] T 743cee0b3a8241dfae72c033dc3d776e P 726d96e241134d7e9e1851f2cee66d03 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:23:58.404930 17577 raft_consensus.cc:493] T 743cee0b3a8241dfae72c033dc3d776e P 726d96e241134d7e9e1851f2cee66d03 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:23:58.405305 17577 raft_consensus.cc:3060] T 743cee0b3a8241dfae72c033dc3d776e P 726d96e241134d7e9e1851f2cee66d03 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:23:58.411798 17577 raft_consensus.cc:515] T 743cee0b3a8241dfae72c033dc3d776e P 726d96e241134d7e9e1851f2cee66d03 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "726d96e241134d7e9e1851f2cee66d03" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 45087 } } peers { permanent_uuid: "316e9983905848079a8e6d9ce5585f46" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 39729 } } peers { permanent_uuid: "ee69eea1a5cc4645acdd4deaa9e0ac7f" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 41127 } }
I20260709 13:23:58.414008 17577 leader_election.cc:290] T 743cee0b3a8241dfae72c033dc3d776e P 726d96e241134d7e9e1851f2cee66d03 [CANDIDATE]: Term 1 election: Requested vote from peers 316e9983905848079a8e6d9ce5585f46 (127.5.126.66:39729), ee69eea1a5cc4645acdd4deaa9e0ac7f (127.5.126.67:41127)
I20260709 13:23:58.414891 17339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "743cee0b3a8241dfae72c033dc3d776e" candidate_uuid: "726d96e241134d7e9e1851f2cee66d03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "316e9983905848079a8e6d9ce5585f46"
I20260709 13:23:58.415164 17410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "743cee0b3a8241dfae72c033dc3d776e" candidate_uuid: "726d96e241134d7e9e1851f2cee66d03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee69eea1a5cc4645acdd4deaa9e0ac7f"
I20260709 13:23:58.415586 17339 raft_consensus.cc:3060] T 743cee0b3a8241dfae72c033dc3d776e P 316e9983905848079a8e6d9ce5585f46 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:23:58.416122 17410 raft_consensus.cc:3060] T 743cee0b3a8241dfae72c033dc3d776e P ee69eea1a5cc4645acdd4deaa9e0ac7f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:23:58.421041 17339 raft_consensus.cc:2468] T 743cee0b3a8241dfae72c033dc3d776e P 316e9983905848079a8e6d9ce5585f46 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 726d96e241134d7e9e1851f2cee66d03 in term 1.
I20260709 13:23:58.422143 17227 leader_election.cc:304] T 743cee0b3a8241dfae72c033dc3d776e P 726d96e241134d7e9e1851f2cee66d03 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 316e9983905848079a8e6d9ce5585f46, 726d96e241134d7e9e1851f2cee66d03; no voters: 
I20260709 13:23:58.422883 17577 raft_consensus.cc:2804] T 743cee0b3a8241dfae72c033dc3d776e P 726d96e241134d7e9e1851f2cee66d03 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:23:58.422827 17410 raft_consensus.cc:2468] T 743cee0b3a8241dfae72c033dc3d776e P ee69eea1a5cc4645acdd4deaa9e0ac7f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 726d96e241134d7e9e1851f2cee66d03 in term 1.
I20260709 13:23:58.423695 17577 raft_consensus.cc:697] T 743cee0b3a8241dfae72c033dc3d776e P 726d96e241134d7e9e1851f2cee66d03 [term 1 LEADER]: Becoming Leader. State: Replica: 726d96e241134d7e9e1851f2cee66d03, State: Running, Role: LEADER
I20260709 13:23:58.424666 17577 consensus_queue.cc:237] T 743cee0b3a8241dfae72c033dc3d776e P 726d96e241134d7e9e1851f2cee66d03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "726d96e241134d7e9e1851f2cee66d03" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 45087 } } peers { permanent_uuid: "316e9983905848079a8e6d9ce5585f46" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 39729 } } peers { permanent_uuid: "ee69eea1a5cc4645acdd4deaa9e0ac7f" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 41127 } }
I20260709 13:23:58.433226 17161 catalog_manager.cc:5697] T 743cee0b3a8241dfae72c033dc3d776e P 726d96e241134d7e9e1851f2cee66d03 reported cstate change: term changed from 0 to 1, leader changed from <none> to 726d96e241134d7e9e1851f2cee66d03 (127.5.126.65). New cstate: current_term: 1 leader_uuid: "726d96e241134d7e9e1851f2cee66d03" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "726d96e241134d7e9e1851f2cee66d03" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 45087 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "316e9983905848079a8e6d9ce5585f46" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 39729 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ee69eea1a5cc4645acdd4deaa9e0ac7f" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 41127 } health_report { overall_health: UNKNOWN } } }
I20260709 13:23:58.463733 17577 consensus_queue.cc:1048] T 62c32fd6e3f74f3b817349f92a686d3c P 726d96e241134d7e9e1851f2cee66d03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "316e9983905848079a8e6d9ce5585f46" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 39729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:23:58.476516 17568 consensus_queue.cc:1048] T 62599e0920c34027b50cf62f7b652686 P 316e9983905848079a8e6d9ce5585f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee69eea1a5cc4645acdd4deaa9e0ac7f" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 41127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:23:58.480229 17577 consensus_queue.cc:1048] T 62c32fd6e3f74f3b817349f92a686d3c P 726d96e241134d7e9e1851f2cee66d03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee69eea1a5cc4645acdd4deaa9e0ac7f" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 41127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:23:58.502254 17541 consensus_queue.cc:1048] T 62599e0920c34027b50cf62f7b652686 P 316e9983905848079a8e6d9ce5585f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "726d96e241134d7e9e1851f2cee66d03" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 45087 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:23:58.502358 17487 consensus_queue.cc:1048] T d77e2380b35e4438a224b5148ebc574d P ee69eea1a5cc4645acdd4deaa9e0ac7f [LEADER]: Connected to new peer: Peer: permanent_uuid: "316e9983905848079a8e6d9ce5585f46" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 39729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:23:58.531795 17487 consensus_queue.cc:1048] T d77e2380b35e4438a224b5148ebc574d P ee69eea1a5cc4645acdd4deaa9e0ac7f [LEADER]: Connected to new peer: Peer: permanent_uuid: "726d96e241134d7e9e1851f2cee66d03" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 45087 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:23:58.558894 17487 consensus_queue.cc:1048] T a71f35e6480646cba674fd6925e001ed P ee69eea1a5cc4645acdd4deaa9e0ac7f [LEADER]: Connected to new peer: Peer: permanent_uuid: "316e9983905848079a8e6d9ce5585f46" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 39729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:23:58.571924 17579 consensus_queue.cc:1048] T a71f35e6480646cba674fd6925e001ed P ee69eea1a5cc4645acdd4deaa9e0ac7f [LEADER]: Connected to new peer: Peer: permanent_uuid: "726d96e241134d7e9e1851f2cee66d03" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 45087 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:23:58.601307 17579 consensus_queue.cc:1048] T eb3f366f79ef4b2894bc2dbf6eb14794 P ee69eea1a5cc4645acdd4deaa9e0ac7f [LEADER]: Connected to new peer: Peer: permanent_uuid: "316e9983905848079a8e6d9ce5585f46" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 39729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:23:58.613965 17579 consensus_queue.cc:1048] T eb3f366f79ef4b2894bc2dbf6eb14794 P ee69eea1a5cc4645acdd4deaa9e0ac7f [LEADER]: Connected to new peer: Peer: permanent_uuid: "726d96e241134d7e9e1851f2cee66d03" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 45087 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:23:58.669745 17339 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "62599e0920c34027b50cf62f7b652686"
dest_uuid: "316e9983905848079a8e6d9ce5585f46"
mode: GRACEFUL
new_leader_uuid: "726d96e241134d7e9e1851f2cee66d03"
 from {username='slave'} at 127.0.0.1:39256
I20260709 13:23:58.670255 17339 raft_consensus.cc:606] T 62599e0920c34027b50cf62f7b652686 P 316e9983905848079a8e6d9ce5585f46 [term 1 LEADER]: Received request to transfer leadership to TS 726d96e241134d7e9e1851f2cee66d03
I20260709 13:23:58.676229 17412 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "711feb7b7a864c1d98dfd62c10eb0f99"
dest_uuid: "ee69eea1a5cc4645acdd4deaa9e0ac7f"
mode: GRACEFUL
new_leader_uuid: "726d96e241134d7e9e1851f2cee66d03"
 from {username='slave'} at 127.0.0.1:45368
I20260709 13:23:58.676987 17412 raft_consensus.cc:606] T 711feb7b7a864c1d98dfd62c10eb0f99 P ee69eea1a5cc4645acdd4deaa9e0ac7f [term 1 LEADER]: Received request to transfer leadership to TS 726d96e241134d7e9e1851f2cee66d03
I20260709 13:23:58.682879 17412 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a71f35e6480646cba674fd6925e001ed"
dest_uuid: "ee69eea1a5cc4645acdd4deaa9e0ac7f"
mode: GRACEFUL
new_leader_uuid: "726d96e241134d7e9e1851f2cee66d03"
 from {username='slave'} at 127.0.0.1:45368
I20260709 13:23:58.683550 17412 raft_consensus.cc:606] T a71f35e6480646cba674fd6925e001ed P ee69eea1a5cc4645acdd4deaa9e0ac7f [term 1 LEADER]: Received request to transfer leadership to TS 726d96e241134d7e9e1851f2cee66d03
I20260709 13:23:58.693060 17412 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d77e2380b35e4438a224b5148ebc574d"
dest_uuid: "ee69eea1a5cc4645acdd4deaa9e0ac7f"
mode: GRACEFUL
new_leader_uuid: "316e9983905848079a8e6d9ce5585f46"
 from {username='slave'} at 127.0.0.1:45368
I20260709 13:23:58.693675 17412 raft_consensus.cc:606] T d77e2380b35e4438a224b5148ebc574d P ee69eea1a5cc4645acdd4deaa9e0ac7f [term 1 LEADER]: Received request to transfer leadership to TS 316e9983905848079a8e6d9ce5585f46
I20260709 13:23:58.699718 17412 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "27c47c73807f4c7c9535c0873d016f62"
dest_uuid: "ee69eea1a5cc4645acdd4deaa9e0ac7f"
mode: GRACEFUL
new_leader_uuid: "316e9983905848079a8e6d9ce5585f46"
 from {username='slave'} at 127.0.0.1:45368
I20260709 13:23:58.700444 17412 raft_consensus.cc:606] T 27c47c73807f4c7c9535c0873d016f62 P ee69eea1a5cc4645acdd4deaa9e0ac7f [term 1 LEADER]: Received request to transfer leadership to TS 316e9983905848079a8e6d9ce5585f46
I20260709 13:23:58.706627 17412 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "eb3f366f79ef4b2894bc2dbf6eb14794"
dest_uuid: "ee69eea1a5cc4645acdd4deaa9e0ac7f"
mode: GRACEFUL
new_leader_uuid: "316e9983905848079a8e6d9ce5585f46"
 from {username='slave'} at 127.0.0.1:45368
I20260709 13:23:58.707206 17412 raft_consensus.cc:606] T eb3f366f79ef4b2894bc2dbf6eb14794 P ee69eea1a5cc4645acdd4deaa9e0ac7f [term 1 LEADER]: Received request to transfer leadership to TS 316e9983905848079a8e6d9ce5585f46
I20260709 13:23:58.713843 17264 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "86979013624c4c96843236a7e7f8a1ec"
dest_uuid: "726d96e241134d7e9e1851f2cee66d03"
mode: GRACEFUL
new_leader_uuid: "316e9983905848079a8e6d9ce5585f46"
 from {username='slave'} at 127.0.0.1:41542
I20260709 13:23:58.714522 17264 raft_consensus.cc:606] T 86979013624c4c96843236a7e7f8a1ec P 726d96e241134d7e9e1851f2cee66d03 [term 1 LEADER]: Received request to transfer leadership to TS 316e9983905848079a8e6d9ce5585f46
I20260709 13:23:58.720690 17264 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "743cee0b3a8241dfae72c033dc3d776e"
dest_uuid: "726d96e241134d7e9e1851f2cee66d03"
mode: GRACEFUL
new_leader_uuid: "ee69eea1a5cc4645acdd4deaa9e0ac7f"
 from {username='slave'} at 127.0.0.1:41542
I20260709 13:23:58.721339 17264 raft_consensus.cc:606] T 743cee0b3a8241dfae72c033dc3d776e P 726d96e241134d7e9e1851f2cee66d03 [term 1 LEADER]: Received request to transfer leadership to TS ee69eea1a5cc4645acdd4deaa9e0ac7f
I20260709 13:23:58.738214 17579 consensus_queue.cc:1048] T 711feb7b7a864c1d98dfd62c10eb0f99 P ee69eea1a5cc4645acdd4deaa9e0ac7f [LEADER]: Connected to new peer: Peer: permanent_uuid: "316e9983905848079a8e6d9ce5585f46" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 39729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:23:58.738925 17576 consensus_queue.cc:1048] T 711feb7b7a864c1d98dfd62c10eb0f99 P ee69eea1a5cc4645acdd4deaa9e0ac7f [LEADER]: Connected to new peer: Peer: permanent_uuid: "726d96e241134d7e9e1851f2cee66d03" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 45087 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:23:58.750886 17576 raft_consensus.cc:993] T 711feb7b7a864c1d98dfd62c10eb0f99 P ee69eea1a5cc4645acdd4deaa9e0ac7f: : Instructing follower 726d96e241134d7e9e1851f2cee66d03 to start an election
I20260709 13:23:58.751330 17621 raft_consensus.cc:1081] T 711feb7b7a864c1d98dfd62c10eb0f99 P ee69eea1a5cc4645acdd4deaa9e0ac7f [term 1 LEADER]: Signalling peer 726d96e241134d7e9e1851f2cee66d03 to start an election
I20260709 13:23:58.755761 17262 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "711feb7b7a864c1d98dfd62c10eb0f99"
dest_uuid: "726d96e241134d7e9e1851f2cee66d03"
 from {username='slave'} at 127.0.0.1:41530
I20260709 13:23:58.756503 17262 raft_consensus.cc:493] T 711feb7b7a864c1d98dfd62c10eb0f99 P 726d96e241134d7e9e1851f2cee66d03 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:23:58.756982 17262 raft_consensus.cc:3060] T 711feb7b7a864c1d98dfd62c10eb0f99 P 726d96e241134d7e9e1851f2cee66d03 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:23:58.762404 17573 consensus_queue.cc:1048] T 27c47c73807f4c7c9535c0873d016f62 P ee69eea1a5cc4645acdd4deaa9e0ac7f [LEADER]: Connected to new peer: Peer: permanent_uuid: "316e9983905848079a8e6d9ce5585f46" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 39729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:23:58.764789 17262 raft_consensus.cc:515] T 711feb7b7a864c1d98dfd62c10eb0f99 P 726d96e241134d7e9e1851f2cee66d03 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "726d96e241134d7e9e1851f2cee66d03" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 45087 } } peers { permanent_uuid: "316e9983905848079a8e6d9ce5585f46" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 39729 } } peers { permanent_uuid: "ee69eea1a5cc4645acdd4deaa9e0ac7f" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 41127 } }
I20260709 13:23:58.766855 17262 leader_election.cc:290] T 711feb7b7a864c1d98dfd62c10eb0f99 P 726d96e241134d7e9e1851f2cee66d03 [CANDIDATE]: Term 2 election: Requested vote from peers 316e9983905848079a8e6d9ce5585f46 (127.5.126.66:39729), ee69eea1a5cc4645acdd4deaa9e0ac7f (127.5.126.67:41127)
I20260709 13:23:58.768833 17412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "711feb7b7a864c1d98dfd62c10eb0f99" candidate_uuid: "726d96e241134d7e9e1851f2cee66d03" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ee69eea1a5cc4645acdd4deaa9e0ac7f"
I20260709 13:23:58.769496 17412 raft_consensus.cc:3055] T 711feb7b7a864c1d98dfd62c10eb0f99 P ee69eea1a5cc4645acdd4deaa9e0ac7f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:23:58.769797 17412 raft_consensus.cc:740] T 711feb7b7a864c1d98dfd62c10eb0f99 P ee69eea1a5cc4645acdd4deaa9e0ac7f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ee69eea1a5cc4645acdd4deaa9e0ac7f, State: Running, Role: LEADER
I20260709 13:23:58.770617 17412 consensus_queue.cc:260] T 711feb7b7a864c1d98dfd62c10eb0f99 P ee69eea1a5cc4645acdd4deaa9e0ac7f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "726d96e241134d7e9e1851f2cee66d03" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 45087 } } peers { permanent_uuid: "316e9983905848079a8e6d9ce5585f46" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 39729 } } peers { permanent_uuid: "ee69eea1a5cc4645acdd4deaa9e0ac7f" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 41127 } }
I20260709 13:23:58.771852 17412 raft_consensus.cc:3060] T 711feb7b7a864c1d98dfd62c10eb0f99 P ee69eea1a5cc4645acdd4deaa9e0ac7f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:23:58.768854 17337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "711feb7b7a864c1d98dfd62c10eb0f99" candidate_uuid: "726d96e241134d7e9e1851f2cee66d03" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "316e9983905848079a8e6d9ce5585f46"
I20260709 13:23:58.776779 17337 raft_consensus.cc:3060] T 711feb7b7a864c1d98dfd62c10eb0f99 P 316e9983905848079a8e6d9ce5585f46 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:23:58.778414 17412 raft_consensus.cc:2468] T 711feb7b7a864c1d98dfd62c10eb0f99 P ee69eea1a5cc4645acdd4deaa9e0ac7f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 726d96e241134d7e9e1851f2cee66d03 in term 2.
I20260709 13:23:58.779758 17227 leader_election.cc:304] T 711feb7b7a864c1d98dfd62c10eb0f99 P 726d96e241134d7e9e1851f2cee66d03 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 726d96e241134d7e9e1851f2cee66d03, ee69eea1a5cc4645acdd4deaa9e0ac7f; no voters: 
I20260709 13:23:58.781025 17487 raft_consensus.cc:993] T 27c47c73807f4c7c9535c0873d016f62 P ee69eea1a5cc4645acdd4deaa9e0ac7f: : Instructing follower 316e9983905848079a8e6d9ce5585f46 to start an election
I20260709 13:23:58.781561 17487 raft_consensus.cc:1081] T 27c47c73807f4c7c9535c0873d016f62 P ee69eea1a5cc4645acdd4deaa9e0ac7f [term 1 LEADER]: Signalling peer 316e9983905848079a8e6d9ce5585f46 to start an election
I20260709 13:23:58.782150 17577 raft_consensus.cc:2804] T 711feb7b7a864c1d98dfd62c10eb0f99 P 726d96e241134d7e9e1851f2cee66d03 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:23:58.782752 17577 raft_consensus.cc:697] T 711feb7b7a864c1d98dfd62c10eb0f99 P 726d96e241134d7e9e1851f2cee66d03 [term 2 LEADER]: Becoming Leader. State: Replica: 726d96e241134d7e9e1851f2cee66d03, State: Running, Role: LEADER
I20260709 13:23:58.783646 17577 consensus_queue.cc:237] T 711feb7b7a864c1d98dfd62c10eb0f99 P 726d96e241134d7e9e1851f2cee66d03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "726d96e241134d7e9e1851f2cee66d03" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 45087 } } peers { permanent_uuid: "316e9983905848079a8e6d9ce5585f46" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 39729 } } peers { permanent_uuid: "ee69eea1a5cc4645acdd4deaa9e0ac7f" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 41127 } }
I20260709 13:23:58.784493 17336 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "27c47c73807f4c7c9535c0873d016f62"
dest_uuid: "316e9983905848079a8e6d9ce5585f46"
 from {username='slave'} at 127.0.0.1:39244
I20260709 13:23:58.783658 17337 raft_consensus.cc:2468] T 711feb7b7a864c1d98dfd62c10eb0f99 P 316e9983905848079a8e6d9ce5585f46 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 726d96e241134d7e9e1851f2cee66d03 in term 2.
I20260709 13:23:58.785168 17336 raft_consensus.cc:493] T 27c47c73807f4c7c9535c0873d016f62 P 316e9983905848079a8e6d9ce5585f46 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:23:58.785593 17336 raft_consensus.cc:3060] T 27c47c73807f4c7c9535c0873d016f62 P 316e9983905848079a8e6d9ce5585f46 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:23:58.788534 17576 consensus_queue.cc:1048] T 27c47c73807f4c7c9535c0873d016f62 P ee69eea1a5cc4645acdd4deaa9e0ac7f [LEADER]: Connected to new peer: Peer: permanent_uuid: "726d96e241134d7e9e1851f2cee66d03" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 45087 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:23:58.795439 17336 raft_consensus.cc:515] T 27c47c73807f4c7c9535c0873d016f62 P 316e9983905848079a8e6d9ce5585f46 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "726d96e241134d7e9e1851f2cee66d03" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 45087 } } peers { permanent_uuid: "316e9983905848079a8e6d9ce5585f46" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 39729 } } peers { permanent_uuid: "ee69eea1a5cc4645acdd4deaa9e0ac7f" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 41127 } }
I20260709 13:23:58.796622 17577 consensus_queue.cc:1048] T 86979013624c4c96843236a7e7f8a1ec P 726d96e241134d7e9e1851f2cee66d03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee69eea1a5cc4645acdd4deaa9e0ac7f" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 41127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:23:58.798708 17339 raft_consensus.cc:1240] T 27c47c73807f4c7c9535c0873d016f62 P 316e9983905848079a8e6d9ce5585f46 [term 2 FOLLOWER]: Rejecting Update request from peer ee69eea1a5cc4645acdd4deaa9e0ac7f for earlier term 1. Current term is 2. Ops: []
I20260709 13:23:58.802186 17576 consensus_queue.cc:1059] T 27c47c73807f4c7c9535c0873d016f62 P ee69eea1a5cc4645acdd4deaa9e0ac7f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "316e9983905848079a8e6d9ce5585f46" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 39729 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:23:58.802649 17539 consensus_queue.cc:1048] T 86979013624c4c96843236a7e7f8a1ec P 726d96e241134d7e9e1851f2cee66d03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "316e9983905848079a8e6d9ce5585f46" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 39729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:23:58.803341 17576 raft_consensus.cc:3055] T 27c47c73807f4c7c9535c0873d016f62 P ee69eea1a5cc4645acdd4deaa9e0ac7f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:23:58.803871 17576 raft_consensus.cc:740] T 27c47c73807f4c7c9535c0873d016f62 P ee69eea1a5cc4645acdd4deaa9e0ac7f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ee69eea1a5cc4645acdd4deaa9e0ac7f, State: Running, Role: LEADER
I20260709 13:23:58.805038 17576 consensus_queue.cc:260] T 27c47c73807f4c7c9535c0873d016f62 P ee69eea1a5cc4645acdd4deaa9e0ac7f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "726d96e241134d7e9e1851f2cee66d03" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 45087 } } peers { permanent_uuid: "316e9983905848079a8e6d9ce5585f46" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 39729 } } peers { permanent_uuid: "ee69eea1a5cc4645acdd4deaa9e0ac7f" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 41127 } }
I20260709 13:23:58.806262 17576 raft_consensus.cc:3060] T 27c47c73807f4c7c9535c0873d016f62 P ee69eea1a5cc4645acdd4deaa9e0ac7f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:23:58.807660 17161 catalog_manager.cc:5697] T 711feb7b7a864c1d98dfd62c10eb0f99 P 726d96e241134d7e9e1851f2cee66d03 reported cstate change: term changed from 1 to 2, leader changed from ee69eea1a5cc4645acdd4deaa9e0ac7f (127.5.126.67) to 726d96e241134d7e9e1851f2cee66d03 (127.5.126.65). New cstate: current_term: 2 leader_uuid: "726d96e241134d7e9e1851f2cee66d03" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "726d96e241134d7e9e1851f2cee66d03" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 45087 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "316e9983905848079a8e6d9ce5585f46" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 39729 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ee69eea1a5cc4645acdd4deaa9e0ac7f" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 41127 } health_report { overall_health: UNKNOWN } } }
I20260709 13:23:58.814198 17336 leader_election.cc:290] T 27c47c73807f4c7c9535c0873d016f62 P 316e9983905848079a8e6d9ce5585f46 [CANDIDATE]: Term 2 election: Requested vote from peers 726d96e241134d7e9e1851f2cee66d03 (127.5.126.65:45087), ee69eea1a5cc4645acdd4deaa9e0ac7f (127.5.126.67:41127)
I20260709 13:23:58.815297 17410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27c47c73807f4c7c9535c0873d016f62" candidate_uuid: "316e9983905848079a8e6d9ce5585f46" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ee69eea1a5cc4645acdd4deaa9e0ac7f"
I20260709 13:23:58.804972 17262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27c47c73807f4c7c9535c0873d016f62" candidate_uuid: "316e9983905848079a8e6d9ce5585f46" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "726d96e241134d7e9e1851f2cee66d03"
I20260709 13:23:58.816738 17262 raft_consensus.cc:3060] T 27c47c73807f4c7c9535c0873d016f62 P 726d96e241134d7e9e1851f2cee66d03 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:23:58.823091 17410 raft_consensus.cc:2468] T 27c47c73807f4c7c9535c0873d016f62 P ee69eea1a5cc4645acdd4deaa9e0ac7f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 316e9983905848079a8e6d9ce5585f46 in term 2.
I20260709 13:23:58.823902 17262 raft_consensus.cc:2468] T 27c47c73807f4c7c9535c0873d016f62 P 726d96e241134d7e9e1851f2cee66d03 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 316e9983905848079a8e6d9ce5585f46 in term 2.
I20260709 13:23:58.826160 17539 raft_consensus.cc:993] T 86979013624c4c96843236a7e7f8a1ec P 726d96e241134d7e9e1851f2cee66d03: : Instructing follower 316e9983905848079a8e6d9ce5585f46 to start an election
I20260709 13:23:58.826617 17539 raft_consensus.cc:1081] T 86979013624c4c96843236a7e7f8a1ec P 726d96e241134d7e9e1851f2cee66d03 [term 1 LEADER]: Signalling peer 316e9983905848079a8e6d9ce5585f46 to start an election
I20260709 13:23:58.829473 17336 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "86979013624c4c96843236a7e7f8a1ec"
dest_uuid: "316e9983905848079a8e6d9ce5585f46"
 from {username='slave'} at 127.0.0.1:39238
I20260709 13:23:58.830135 17336 raft_consensus.cc:493] T 86979013624c4c96843236a7e7f8a1ec P 316e9983905848079a8e6d9ce5585f46 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:23:58.830530 17336 raft_consensus.cc:3060] T 86979013624c4c96843236a7e7f8a1ec P 316e9983905848079a8e6d9ce5585f46 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:23:58.824393 17302 leader_election.cc:304] T 27c47c73807f4c7c9535c0873d016f62 P 316e9983905848079a8e6d9ce5585f46 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 316e9983905848079a8e6d9ce5585f46, ee69eea1a5cc4645acdd4deaa9e0ac7f; no voters: 
I20260709 13:23:58.832576 17608 raft_consensus.cc:2804] T 27c47c73807f4c7c9535c0873d016f62 P 316e9983905848079a8e6d9ce5585f46 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:23:58.833107 17608 raft_consensus.cc:697] T 27c47c73807f4c7c9535c0873d016f62 P 316e9983905848079a8e6d9ce5585f46 [term 2 LEADER]: Becoming Leader. State: Replica: 316e9983905848079a8e6d9ce5585f46, State: Running, Role: LEADER
I20260709 13:23:58.833967 17608 consensus_queue.cc:237] T 27c47c73807f4c7c9535c0873d016f62 P 316e9983905848079a8e6d9ce5585f46 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "726d96e241134d7e9e1851f2cee66d03" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 45087 } } peers { permanent_uuid: "316e9983905848079a8e6d9ce5585f46" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 39729 } } peers { permanent_uuid: "ee69eea1a5cc4645acdd4deaa9e0ac7f" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 41127 } }
I20260709 13:23:58.839114 17336 raft_consensus.cc:515] T 86979013624c4c96843236a7e7f8a1ec P 316e9983905848079a8e6d9ce5585f46 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "726d96e241134d7e9e1851f2cee66d03" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 45087 } } peers { permanent_uuid: "316e9983905848079a8e6d9ce5585f46" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 39729 } } peers { permanent_uuid: "ee69eea1a5cc4645acdd4deaa9e0ac7f" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 41127 } }
I20260709 13:23:58.842676 17262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86979013624c4c96843236a7e7f8a1ec" candidate_uuid: "316e9983905848079a8e6d9ce5585f46" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "726d96e241134d7e9e1851f2cee66d03"
I20260709 13:23:58.843308 17262 raft_consensus.cc:3055] T 86979013624c4c96843236a7e7f8a1ec P 726d96e241134d7e9e1851f2cee66d03 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:23:58.843647 17262 raft_consensus.cc:740] T 86979013624c4c96843236a7e7f8a1ec P 726d96e241134d7e9e1851f2cee66d03 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 726d96e241134d7e9e1851f2cee66d03, State: Running, Role: LEADER
I20260709 13:23:58.844556 17262 consensus_queue.cc:260] T 86979013624c4c96843236a7e7f8a1ec P 726d96e241134d7e9e1851f2cee66d03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "726d96e241134d7e9e1851f2cee66d03" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 45087 } } peers { permanent_uuid: "316e9983905848079a8e6d9ce5585f46" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 39729 } } peers { permanent_uuid: "ee69eea1a5cc4645acdd4deaa9e0ac7f" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 41127 } }
I20260709 13:23:58.845503 17262 raft_consensus.cc:3060] T 86979013624c4c96843236a7e7f8a1ec P 726d96e241134d7e9e1851f2cee66d03 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:23:58.848080 17336 leader_election.cc:290] T 86979013624c4c96843236a7e7f8a1ec P 316e9983905848079a8e6d9ce5585f46 [CANDIDATE]: Term 2 election: Requested vote from peers 726d96e241134d7e9e1851f2cee66d03 (127.5.126.65:45087), ee69eea1a5cc4645acdd4deaa9e0ac7f (127.5.126.67:41127)
I20260709 13:23:58.849401 17412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86979013624c4c96843236a7e7f8a1ec" candidate_uuid: "316e9983905848079a8e6d9ce5585f46" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ee69eea1a5cc4645acdd4deaa9e0ac7f"
I20260709 13:23:58.850044 17412 raft_consensus.cc:3060] T 86979013624c4c96843236a7e7f8a1ec P ee69eea1a5cc4645acdd4deaa9e0ac7f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:23:58.850528 17161 catalog_manager.cc:5697] T 27c47c73807f4c7c9535c0873d016f62 P 316e9983905848079a8e6d9ce5585f46 reported cstate change: term changed from 1 to 2, leader changed from ee69eea1a5cc4645acdd4deaa9e0ac7f (127.5.126.67) to 316e9983905848079a8e6d9ce5585f46 (127.5.126.66). New cstate: current_term: 2 leader_uuid: "316e9983905848079a8e6d9ce5585f46" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "726d96e241134d7e9e1851f2cee66d03" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 45087 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "316e9983905848079a8e6d9ce5585f46" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 39729 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ee69eea1a5cc4645acdd4deaa9e0ac7f" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 41127 } health_report { overall_health: UNKNOWN } } }
I20260709 13:23:58.852531 17262 raft_consensus.cc:2468] T 86979013624c4c96843236a7e7f8a1ec P 726d96e241134d7e9e1851f2cee66d03 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 316e9983905848079a8e6d9ce5585f46 in term 2.
I20260709 13:23:58.853796 17305 leader_election.cc:304] T 86979013624c4c96843236a7e7f8a1ec P 316e9983905848079a8e6d9ce5585f46 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 316e9983905848079a8e6d9ce5585f46, 726d96e241134d7e9e1851f2cee66d03; no voters: 
I20260709 13:23:58.854651 17608 raft_consensus.cc:2804] T 86979013624c4c96843236a7e7f8a1ec P 316e9983905848079a8e6d9ce5585f46 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:23:58.855166 17608 raft_consensus.cc:697] T 86979013624c4c96843236a7e7f8a1ec P 316e9983905848079a8e6d9ce5585f46 [term 2 LEADER]: Becoming Leader. State: Replica: 316e9983905848079a8e6d9ce5585f46, State: Running, Role: LEADER
I20260709 13:23:58.856168 17412 raft_consensus.cc:2468] T 86979013624c4c96843236a7e7f8a1ec P ee69eea1a5cc4645acdd4deaa9e0ac7f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 316e9983905848079a8e6d9ce5585f46 in term 2.
I20260709 13:23:58.856179 17608 consensus_queue.cc:237] T 86979013624c4c96843236a7e7f8a1ec P 316e9983905848079a8e6d9ce5585f46 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "726d96e241134d7e9e1851f2cee66d03" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 45087 } } peers { permanent_uuid: "316e9983905848079a8e6d9ce5585f46" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 39729 } } peers { permanent_uuid: "ee69eea1a5cc4645acdd4deaa9e0ac7f" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 41127 } }
I20260709 13:23:58.867367 17161 catalog_manager.cc:5697] T 86979013624c4c96843236a7e7f8a1ec P 316e9983905848079a8e6d9ce5585f46 reported cstate change: term changed from 1 to 2, leader changed from 726d96e241134d7e9e1851f2cee66d03 (127.5.126.65) to 316e9983905848079a8e6d9ce5585f46 (127.5.126.66). New cstate: current_term: 2 leader_uuid: "316e9983905848079a8e6d9ce5585f46" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "726d96e241134d7e9e1851f2cee66d03" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 45087 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "316e9983905848079a8e6d9ce5585f46" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 39729 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ee69eea1a5cc4645acdd4deaa9e0ac7f" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 41127 } health_report { overall_health: UNKNOWN } } }
I20260709 13:23:58.870263 17577 consensus_queue.cc:1048] T 743cee0b3a8241dfae72c033dc3d776e P 726d96e241134d7e9e1851f2cee66d03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee69eea1a5cc4645acdd4deaa9e0ac7f" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 41127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:23:58.880163 17539 raft_consensus.cc:993] T 743cee0b3a8241dfae72c033dc3d776e P 726d96e241134d7e9e1851f2cee66d03: : Instructing follower ee69eea1a5cc4645acdd4deaa9e0ac7f to start an election
I20260709 13:23:58.880731 17558 raft_consensus.cc:1081] T 743cee0b3a8241dfae72c033dc3d776e P 726d96e241134d7e9e1851f2cee66d03 [term 1 LEADER]: Signalling peer ee69eea1a5cc4645acdd4deaa9e0ac7f to start an election
I20260709 13:23:58.882678 17410 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "743cee0b3a8241dfae72c033dc3d776e"
dest_uuid: "ee69eea1a5cc4645acdd4deaa9e0ac7f"
 from {username='slave'} at 127.0.0.1:45362
I20260709 13:23:58.886411 17410 raft_consensus.cc:493] T 743cee0b3a8241dfae72c033dc3d776e P ee69eea1a5cc4645acdd4deaa9e0ac7f [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:23:58.886893 17410 raft_consensus.cc:3060] T 743cee0b3a8241dfae72c033dc3d776e P ee69eea1a5cc4645acdd4deaa9e0ac7f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:23:58.886925 17539 consensus_queue.cc:1048] T 743cee0b3a8241dfae72c033dc3d776e P 726d96e241134d7e9e1851f2cee66d03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "316e9983905848079a8e6d9ce5585f46" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 39729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:23:58.895285 17410 raft_consensus.cc:515] T 743cee0b3a8241dfae72c033dc3d776e P ee69eea1a5cc4645acdd4deaa9e0ac7f [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "726d96e241134d7e9e1851f2cee66d03" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 45087 } } peers { permanent_uuid: "316e9983905848079a8e6d9ce5585f46" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 39729 } } peers { permanent_uuid: "ee69eea1a5cc4645acdd4deaa9e0ac7f" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 41127 } }
I20260709 13:23:58.902951 17262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "743cee0b3a8241dfae72c033dc3d776e" candidate_uuid: "ee69eea1a5cc4645acdd4deaa9e0ac7f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "726d96e241134d7e9e1851f2cee66d03"
I20260709 13:23:58.903753 17262 raft_consensus.cc:3055] T 743cee0b3a8241dfae72c033dc3d776e P 726d96e241134d7e9e1851f2cee66d03 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:23:58.902314 17410 leader_election.cc:290] T 743cee0b3a8241dfae72c033dc3d776e P ee69eea1a5cc4645acdd4deaa9e0ac7f [CANDIDATE]: Term 2 election: Requested vote from peers 726d96e241134d7e9e1851f2cee66d03 (127.5.126.65:45087), 316e9983905848079a8e6d9ce5585f46 (127.5.126.66:39729)
I20260709 13:23:58.903764 17337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "743cee0b3a8241dfae72c033dc3d776e" candidate_uuid: "ee69eea1a5cc4645acdd4deaa9e0ac7f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "316e9983905848079a8e6d9ce5585f46"
I20260709 13:23:58.904211 17262 raft_consensus.cc:740] T 743cee0b3a8241dfae72c033dc3d776e P 726d96e241134d7e9e1851f2cee66d03 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 726d96e241134d7e9e1851f2cee66d03, State: Running, Role: LEADER
I20260709 13:23:58.904803 17337 raft_consensus.cc:3060] T 743cee0b3a8241dfae72c033dc3d776e P 316e9983905848079a8e6d9ce5585f46 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:23:58.905313 17262 consensus_queue.cc:260] T 743cee0b3a8241dfae72c033dc3d776e P 726d96e241134d7e9e1851f2cee66d03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "726d96e241134d7e9e1851f2cee66d03" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 45087 } } peers { permanent_uuid: "316e9983905848079a8e6d9ce5585f46" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 39729 } } peers { permanent_uuid: "ee69eea1a5cc4645acdd4deaa9e0ac7f" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 41127 } }
I20260709 13:23:58.906728 17262 raft_consensus.cc:3060] T 743cee0b3a8241dfae72c033dc3d776e P 726d96e241134d7e9e1851f2cee66d03 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:23:58.912993 17337 raft_consensus.cc:2468] T 743cee0b3a8241dfae72c033dc3d776e P 316e9983905848079a8e6d9ce5585f46 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee69eea1a5cc4645acdd4deaa9e0ac7f in term 2.
I20260709 13:23:58.913355 17262 raft_consensus.cc:2468] T 743cee0b3a8241dfae72c033dc3d776e P 726d96e241134d7e9e1851f2cee66d03 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee69eea1a5cc4645acdd4deaa9e0ac7f in term 2.
I20260709 13:23:58.914404 17376 leader_election.cc:304] T 743cee0b3a8241dfae72c033dc3d776e P ee69eea1a5cc4645acdd4deaa9e0ac7f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 316e9983905848079a8e6d9ce5585f46, ee69eea1a5cc4645acdd4deaa9e0ac7f; no voters: 
I20260709 13:23:58.915314 17576 raft_consensus.cc:2804] T 743cee0b3a8241dfae72c033dc3d776e P ee69eea1a5cc4645acdd4deaa9e0ac7f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:23:58.915794 17576 raft_consensus.cc:697] T 743cee0b3a8241dfae72c033dc3d776e P ee69eea1a5cc4645acdd4deaa9e0ac7f [term 2 LEADER]: Becoming Leader. State: Replica: ee69eea1a5cc4645acdd4deaa9e0ac7f, State: Running, Role: LEADER
I20260709 13:23:58.916565 17576 consensus_queue.cc:237] T 743cee0b3a8241dfae72c033dc3d776e P ee69eea1a5cc4645acdd4deaa9e0ac7f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "726d96e241134d7e9e1851f2cee66d03" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 45087 } } peers { permanent_uuid: "316e9983905848079a8e6d9ce5585f46" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 39729 } } peers { permanent_uuid: "ee69eea1a5cc4645acdd4deaa9e0ac7f" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 41127 } }
I20260709 13:23:58.919366 17541 raft_consensus.cc:993] T 62599e0920c34027b50cf62f7b652686 P 316e9983905848079a8e6d9ce5585f46: : Instructing follower 726d96e241134d7e9e1851f2cee66d03 to start an election
I20260709 13:23:58.919989 17568 raft_consensus.cc:1081] T 62599e0920c34027b50cf62f7b652686 P 316e9983905848079a8e6d9ce5585f46 [term 1 LEADER]: Signalling peer 726d96e241134d7e9e1851f2cee66d03 to start an election
I20260709 13:23:58.921626 17262 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "62599e0920c34027b50cf62f7b652686"
dest_uuid: "726d96e241134d7e9e1851f2cee66d03"
 from {username='slave'} at 127.0.0.1:41534
I20260709 13:23:58.922199 17262 raft_consensus.cc:493] T 62599e0920c34027b50cf62f7b652686 P 726d96e241134d7e9e1851f2cee66d03 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:23:58.922554 17262 raft_consensus.cc:3060] T 62599e0920c34027b50cf62f7b652686 P 726d96e241134d7e9e1851f2cee66d03 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:23:58.925487 17161 catalog_manager.cc:5697] T 743cee0b3a8241dfae72c033dc3d776e P ee69eea1a5cc4645acdd4deaa9e0ac7f reported cstate change: term changed from 1 to 2, leader changed from 726d96e241134d7e9e1851f2cee66d03 (127.5.126.65) to ee69eea1a5cc4645acdd4deaa9e0ac7f (127.5.126.67). New cstate: current_term: 2 leader_uuid: "ee69eea1a5cc4645acdd4deaa9e0ac7f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "726d96e241134d7e9e1851f2cee66d03" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 45087 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "316e9983905848079a8e6d9ce5585f46" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 39729 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ee69eea1a5cc4645acdd4deaa9e0ac7f" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 41127 } health_report { overall_health: HEALTHY } } }
I20260709 13:23:58.930258 17262 raft_consensus.cc:515] T 62599e0920c34027b50cf62f7b652686 P 726d96e241134d7e9e1851f2cee66d03 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "726d96e241134d7e9e1851f2cee66d03" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 45087 } } peers { permanent_uuid: "316e9983905848079a8e6d9ce5585f46" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 39729 } } peers { permanent_uuid: "ee69eea1a5cc4645acdd4deaa9e0ac7f" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 41127 } }
I20260709 13:23:58.933137 17262 leader_election.cc:290] T 62599e0920c34027b50cf62f7b652686 P 726d96e241134d7e9e1851f2cee66d03 [CANDIDATE]: Term 2 election: Requested vote from peers 316e9983905848079a8e6d9ce5585f46 (127.5.126.66:39729), ee69eea1a5cc4645acdd4deaa9e0ac7f (127.5.126.67:41127)
I20260709 13:23:58.933925 17410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62599e0920c34027b50cf62f7b652686" candidate_uuid: "726d96e241134d7e9e1851f2cee66d03" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ee69eea1a5cc4645acdd4deaa9e0ac7f"
I20260709 13:23:58.934535 17410 raft_consensus.cc:3060] T 62599e0920c34027b50cf62f7b652686 P ee69eea1a5cc4645acdd4deaa9e0ac7f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:23:58.933094 17337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62599e0920c34027b50cf62f7b652686" candidate_uuid: "726d96e241134d7e9e1851f2cee66d03" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "316e9983905848079a8e6d9ce5585f46"
I20260709 13:23:58.936477 17337 raft_consensus.cc:3055] T 62599e0920c34027b50cf62f7b652686 P 316e9983905848079a8e6d9ce5585f46 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:23:58.936851 17337 raft_consensus.cc:740] T 62599e0920c34027b50cf62f7b652686 P 316e9983905848079a8e6d9ce5585f46 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 316e9983905848079a8e6d9ce5585f46, State: Running, Role: LEADER
I20260709 13:23:58.937672 17337 consensus_queue.cc:260] T 62599e0920c34027b50cf62f7b652686 P 316e9983905848079a8e6d9ce5585f46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "726d96e241134d7e9e1851f2cee66d03" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 45087 } } peers { permanent_uuid: "316e9983905848079a8e6d9ce5585f46" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 39729 } } peers { permanent_uuid: "ee69eea1a5cc4645acdd4deaa9e0ac7f" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 41127 } }
I20260709 13:23:58.938786 17337 raft_consensus.cc:3060] T 62599e0920c34027b50cf62f7b652686 P 316e9983905848079a8e6d9ce5585f46 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:23:58.940166 17410 raft_consensus.cc:2468] T 62599e0920c34027b50cf62f7b652686 P ee69eea1a5cc4645acdd4deaa9e0ac7f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 726d96e241134d7e9e1851f2cee66d03 in term 2.
I20260709 13:23:58.941291 17227 leader_election.cc:304] T 62599e0920c34027b50cf62f7b652686 P 726d96e241134d7e9e1851f2cee66d03 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 726d96e241134d7e9e1851f2cee66d03, ee69eea1a5cc4645acdd4deaa9e0ac7f; no voters: 
I20260709 13:23:58.941998 17539 raft_consensus.cc:2804] T 62599e0920c34027b50cf62f7b652686 P 726d96e241134d7e9e1851f2cee66d03 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:23:58.942562 17539 raft_consensus.cc:697] T 62599e0920c34027b50cf62f7b652686 P 726d96e241134d7e9e1851f2cee66d03 [term 2 LEADER]: Becoming Leader. State: Replica: 726d96e241134d7e9e1851f2cee66d03, State: Running, Role: LEADER
I20260709 13:23:58.943372 17539 consensus_queue.cc:237] T 62599e0920c34027b50cf62f7b652686 P 726d96e241134d7e9e1851f2cee66d03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "726d96e241134d7e9e1851f2cee66d03" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 45087 } } peers { permanent_uuid: "316e9983905848079a8e6d9ce5585f46" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 39729 } } peers { permanent_uuid: "ee69eea1a5cc4645acdd4deaa9e0ac7f" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 41127 } }
I20260709 13:23:58.948175 17337 raft_consensus.cc:2468] T 62599e0920c34027b50cf62f7b652686 P 316e9983905848079a8e6d9ce5585f46 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 726d96e241134d7e9e1851f2cee66d03 in term 2.
I20260709 13:23:58.951187 17161 catalog_manager.cc:5697] T 62599e0920c34027b50cf62f7b652686 P 726d96e241134d7e9e1851f2cee66d03 reported cstate change: term changed from 1 to 2, leader changed from 316e9983905848079a8e6d9ce5585f46 (127.5.126.66) to 726d96e241134d7e9e1851f2cee66d03 (127.5.126.65). New cstate: current_term: 2 leader_uuid: "726d96e241134d7e9e1851f2cee66d03" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "726d96e241134d7e9e1851f2cee66d03" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 45087 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "316e9983905848079a8e6d9ce5585f46" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 39729 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ee69eea1a5cc4645acdd4deaa9e0ac7f" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 41127 } health_report { overall_health: UNKNOWN } } }
I20260709 13:23:59.066504 17573 raft_consensus.cc:993] T d77e2380b35e4438a224b5148ebc574d P ee69eea1a5cc4645acdd4deaa9e0ac7f: : Instructing follower 316e9983905848079a8e6d9ce5585f46 to start an election
I20260709 13:23:59.067019 17576 raft_consensus.cc:1081] T d77e2380b35e4438a224b5148ebc574d P ee69eea1a5cc4645acdd4deaa9e0ac7f [term 1 LEADER]: Signalling peer 316e9983905848079a8e6d9ce5585f46 to start an election
I20260709 13:23:59.068813 17337 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d77e2380b35e4438a224b5148ebc574d"
dest_uuid: "316e9983905848079a8e6d9ce5585f46"
 from {username='slave'} at 127.0.0.1:39244
I20260709 13:23:59.069437 17337 raft_consensus.cc:493] T d77e2380b35e4438a224b5148ebc574d P 316e9983905848079a8e6d9ce5585f46 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:23:59.069748 17337 raft_consensus.cc:3060] T d77e2380b35e4438a224b5148ebc574d P 316e9983905848079a8e6d9ce5585f46 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:23:59.075703 17337 raft_consensus.cc:515] T d77e2380b35e4438a224b5148ebc574d P 316e9983905848079a8e6d9ce5585f46 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "726d96e241134d7e9e1851f2cee66d03" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 45087 } } peers { permanent_uuid: "316e9983905848079a8e6d9ce5585f46" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 39729 } } peers { permanent_uuid: "ee69eea1a5cc4645acdd4deaa9e0ac7f" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 41127 } }
I20260709 13:23:59.077772 17337 leader_election.cc:290] T d77e2380b35e4438a224b5148ebc574d P 316e9983905848079a8e6d9ce5585f46 [CANDIDATE]: Term 2 election: Requested vote from peers 726d96e241134d7e9e1851f2cee66d03 (127.5.126.65:45087), ee69eea1a5cc4645acdd4deaa9e0ac7f (127.5.126.67:41127)
I20260709 13:23:59.078939 17262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d77e2380b35e4438a224b5148ebc574d" candidate_uuid: "316e9983905848079a8e6d9ce5585f46" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "726d96e241134d7e9e1851f2cee66d03"
I20260709 13:23:59.079078 17410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d77e2380b35e4438a224b5148ebc574d" candidate_uuid: "316e9983905848079a8e6d9ce5585f46" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ee69eea1a5cc4645acdd4deaa9e0ac7f"
I20260709 13:23:59.079735 17262 raft_consensus.cc:3060] T d77e2380b35e4438a224b5148ebc574d P 726d96e241134d7e9e1851f2cee66d03 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:23:59.079808 17410 raft_consensus.cc:3055] T d77e2380b35e4438a224b5148ebc574d P ee69eea1a5cc4645acdd4deaa9e0ac7f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:23:59.080340 17410 raft_consensus.cc:740] T d77e2380b35e4438a224b5148ebc574d P ee69eea1a5cc4645acdd4deaa9e0ac7f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ee69eea1a5cc4645acdd4deaa9e0ac7f, State: Running, Role: LEADER
I20260709 13:23:59.081051 17410 consensus_queue.cc:260] T d77e2380b35e4438a224b5148ebc574d P ee69eea1a5cc4645acdd4deaa9e0ac7f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "726d96e241134d7e9e1851f2cee66d03" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 45087 } } peers { permanent_uuid: "316e9983905848079a8e6d9ce5585f46" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 39729 } } peers { permanent_uuid: "ee69eea1a5cc4645acdd4deaa9e0ac7f" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 41127 } }
I20260709 13:23:59.082039 17410 raft_consensus.cc:3060] T d77e2380b35e4438a224b5148ebc574d P ee69eea1a5cc4645acdd4deaa9e0ac7f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:23:59.086925 17262 raft_consensus.cc:2468] T d77e2380b35e4438a224b5148ebc574d P 726d96e241134d7e9e1851f2cee66d03 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 316e9983905848079a8e6d9ce5585f46 in term 2.
I20260709 13:23:59.087734 17410 raft_consensus.cc:2468] T d77e2380b35e4438a224b5148ebc574d P ee69eea1a5cc4645acdd4deaa9e0ac7f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 316e9983905848079a8e6d9ce5585f46 in term 2.
I20260709 13:23:59.088619 17305 leader_election.cc:304] T d77e2380b35e4438a224b5148ebc574d P 316e9983905848079a8e6d9ce5585f46 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 316e9983905848079a8e6d9ce5585f46, 726d96e241134d7e9e1851f2cee66d03; no voters: 
I20260709 13:23:59.089643 17541 raft_consensus.cc:2804] T d77e2380b35e4438a224b5148ebc574d P 316e9983905848079a8e6d9ce5585f46 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:23:59.090186 17541 raft_consensus.cc:697] T d77e2380b35e4438a224b5148ebc574d P 316e9983905848079a8e6d9ce5585f46 [term 2 LEADER]: Becoming Leader. State: Replica: 316e9983905848079a8e6d9ce5585f46, State: Running, Role: LEADER
I20260709 13:23:59.090974 17541 consensus_queue.cc:237] T d77e2380b35e4438a224b5148ebc574d P 316e9983905848079a8e6d9ce5585f46 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "726d96e241134d7e9e1851f2cee66d03" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 45087 } } peers { permanent_uuid: "316e9983905848079a8e6d9ce5585f46" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 39729 } } peers { permanent_uuid: "ee69eea1a5cc4645acdd4deaa9e0ac7f" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 41127 } }
I20260709 13:23:59.100437 17161 catalog_manager.cc:5697] T d77e2380b35e4438a224b5148ebc574d P 316e9983905848079a8e6d9ce5585f46 reported cstate change: term changed from 1 to 2, leader changed from ee69eea1a5cc4645acdd4deaa9e0ac7f (127.5.126.67) to 316e9983905848079a8e6d9ce5585f46 (127.5.126.66). New cstate: current_term: 2 leader_uuid: "316e9983905848079a8e6d9ce5585f46" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "726d96e241134d7e9e1851f2cee66d03" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 45087 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "316e9983905848079a8e6d9ce5585f46" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 39729 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ee69eea1a5cc4645acdd4deaa9e0ac7f" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 41127 } health_report { overall_health: UNKNOWN } } }
I20260709 13:23:59.137887 17576 raft_consensus.cc:993] T a71f35e6480646cba674fd6925e001ed P ee69eea1a5cc4645acdd4deaa9e0ac7f: : Instructing follower 726d96e241134d7e9e1851f2cee66d03 to start an election
I20260709 13:23:59.138489 17573 raft_consensus.cc:1081] T a71f35e6480646cba674fd6925e001ed P ee69eea1a5cc4645acdd4deaa9e0ac7f [term 1 LEADER]: Signalling peer 726d96e241134d7e9e1851f2cee66d03 to start an election
I20260709 13:23:59.140374 17262 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a71f35e6480646cba674fd6925e001ed"
dest_uuid: "726d96e241134d7e9e1851f2cee66d03"
 from {username='slave'} at 127.0.0.1:41530
I20260709 13:23:59.141088 17262 raft_consensus.cc:493] T a71f35e6480646cba674fd6925e001ed P 726d96e241134d7e9e1851f2cee66d03 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:23:59.141508 17262 raft_consensus.cc:3060] T a71f35e6480646cba674fd6925e001ed P 726d96e241134d7e9e1851f2cee66d03 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:23:59.147812 17262 raft_consensus.cc:515] T a71f35e6480646cba674fd6925e001ed P 726d96e241134d7e9e1851f2cee66d03 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "726d96e241134d7e9e1851f2cee66d03" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 45087 } } peers { permanent_uuid: "316e9983905848079a8e6d9ce5585f46" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 39729 } } peers { permanent_uuid: "ee69eea1a5cc4645acdd4deaa9e0ac7f" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 41127 } }
I20260709 13:23:59.149546 17262 leader_election.cc:290] T a71f35e6480646cba674fd6925e001ed P 726d96e241134d7e9e1851f2cee66d03 [CANDIDATE]: Term 2 election: Requested vote from peers 316e9983905848079a8e6d9ce5585f46 (127.5.126.66:39729), ee69eea1a5cc4645acdd4deaa9e0ac7f (127.5.126.67:41127)
I20260709 13:23:59.150627 17337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a71f35e6480646cba674fd6925e001ed" candidate_uuid: "726d96e241134d7e9e1851f2cee66d03" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "316e9983905848079a8e6d9ce5585f46"
I20260709 13:23:59.151371 17337 raft_consensus.cc:3060] T a71f35e6480646cba674fd6925e001ed P 316e9983905848079a8e6d9ce5585f46 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:23:59.151271 17410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a71f35e6480646cba674fd6925e001ed" candidate_uuid: "726d96e241134d7e9e1851f2cee66d03" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ee69eea1a5cc4645acdd4deaa9e0ac7f"
I20260709 13:23:59.152195 17410 raft_consensus.cc:3055] T a71f35e6480646cba674fd6925e001ed P ee69eea1a5cc4645acdd4deaa9e0ac7f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:23:59.152586 17410 raft_consensus.cc:740] T a71f35e6480646cba674fd6925e001ed P ee69eea1a5cc4645acdd4deaa9e0ac7f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ee69eea1a5cc4645acdd4deaa9e0ac7f, State: Running, Role: LEADER
I20260709 13:23:59.153590 17410 consensus_queue.cc:260] T a71f35e6480646cba674fd6925e001ed P ee69eea1a5cc4645acdd4deaa9e0ac7f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "726d96e241134d7e9e1851f2cee66d03" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 45087 } } peers { permanent_uuid: "316e9983905848079a8e6d9ce5585f46" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 39729 } } peers { permanent_uuid: "ee69eea1a5cc4645acdd4deaa9e0ac7f" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 41127 } }
I20260709 13:23:59.154997 17410 raft_consensus.cc:3060] T a71f35e6480646cba674fd6925e001ed P ee69eea1a5cc4645acdd4deaa9e0ac7f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:23:59.155264 17573 raft_consensus.cc:993] T eb3f366f79ef4b2894bc2dbf6eb14794 P ee69eea1a5cc4645acdd4deaa9e0ac7f: : Instructing follower 316e9983905848079a8e6d9ce5585f46 to start an election
I20260709 13:23:59.155802 17576 raft_consensus.cc:1081] T eb3f366f79ef4b2894bc2dbf6eb14794 P ee69eea1a5cc4645acdd4deaa9e0ac7f [term 1 LEADER]: Signalling peer 316e9983905848079a8e6d9ce5585f46 to start an election
I20260709 13:23:59.157977 17336 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "eb3f366f79ef4b2894bc2dbf6eb14794"
dest_uuid: "316e9983905848079a8e6d9ce5585f46"
 from {username='slave'} at 127.0.0.1:39244
I20260709 13:23:59.158564 17336 raft_consensus.cc:493] T eb3f366f79ef4b2894bc2dbf6eb14794 P 316e9983905848079a8e6d9ce5585f46 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:23:59.158913 17336 raft_consensus.cc:3060] T eb3f366f79ef4b2894bc2dbf6eb14794 P 316e9983905848079a8e6d9ce5585f46 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:23:59.159335 17337 raft_consensus.cc:2468] T a71f35e6480646cba674fd6925e001ed P 316e9983905848079a8e6d9ce5585f46 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 726d96e241134d7e9e1851f2cee66d03 in term 2.
I20260709 13:23:59.160791 17227 leader_election.cc:304] T a71f35e6480646cba674fd6925e001ed P 726d96e241134d7e9e1851f2cee66d03 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 316e9983905848079a8e6d9ce5585f46, 726d96e241134d7e9e1851f2cee66d03; no voters: 
I20260709 13:23:59.161666 17577 raft_consensus.cc:2804] T a71f35e6480646cba674fd6925e001ed P 726d96e241134d7e9e1851f2cee66d03 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:23:59.162135 17577 raft_consensus.cc:697] T a71f35e6480646cba674fd6925e001ed P 726d96e241134d7e9e1851f2cee66d03 [term 2 LEADER]: Becoming Leader. State: Replica: 726d96e241134d7e9e1851f2cee66d03, State: Running, Role: LEADER
I20260709 13:23:59.162506 17410 raft_consensus.cc:2468] T a71f35e6480646cba674fd6925e001ed P ee69eea1a5cc4645acdd4deaa9e0ac7f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 726d96e241134d7e9e1851f2cee66d03 in term 2.
I20260709 13:23:59.162959 17577 consensus_queue.cc:237] T a71f35e6480646cba674fd6925e001ed P 726d96e241134d7e9e1851f2cee66d03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "726d96e241134d7e9e1851f2cee66d03" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 45087 } } peers { permanent_uuid: "316e9983905848079a8e6d9ce5585f46" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 39729 } } peers { permanent_uuid: "ee69eea1a5cc4645acdd4deaa9e0ac7f" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 41127 } }
I20260709 13:23:59.167006 17336 raft_consensus.cc:515] T eb3f366f79ef4b2894bc2dbf6eb14794 P 316e9983905848079a8e6d9ce5585f46 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "726d96e241134d7e9e1851f2cee66d03" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 45087 } } peers { permanent_uuid: "316e9983905848079a8e6d9ce5585f46" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 39729 } } peers { permanent_uuid: "ee69eea1a5cc4645acdd4deaa9e0ac7f" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 41127 } }
I20260709 13:23:59.170617 17262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb3f366f79ef4b2894bc2dbf6eb14794" candidate_uuid: "316e9983905848079a8e6d9ce5585f46" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "726d96e241134d7e9e1851f2cee66d03"
I20260709 13:23:59.170825 17410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb3f366f79ef4b2894bc2dbf6eb14794" candidate_uuid: "316e9983905848079a8e6d9ce5585f46" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ee69eea1a5cc4645acdd4deaa9e0ac7f"
I20260709 13:23:59.171341 17262 raft_consensus.cc:3060] T eb3f366f79ef4b2894bc2dbf6eb14794 P 726d96e241134d7e9e1851f2cee66d03 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:23:59.171617 17410 raft_consensus.cc:3055] T eb3f366f79ef4b2894bc2dbf6eb14794 P ee69eea1a5cc4645acdd4deaa9e0ac7f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:23:59.169440 17336 leader_election.cc:290] T eb3f366f79ef4b2894bc2dbf6eb14794 P 316e9983905848079a8e6d9ce5585f46 [CANDIDATE]: Term 2 election: Requested vote from peers 726d96e241134d7e9e1851f2cee66d03 (127.5.126.65:45087), ee69eea1a5cc4645acdd4deaa9e0ac7f (127.5.126.67:41127)
I20260709 13:23:59.171943 17410 raft_consensus.cc:740] T eb3f366f79ef4b2894bc2dbf6eb14794 P ee69eea1a5cc4645acdd4deaa9e0ac7f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ee69eea1a5cc4645acdd4deaa9e0ac7f, State: Running, Role: LEADER
I20260709 13:23:59.171916 17160 catalog_manager.cc:5697] T a71f35e6480646cba674fd6925e001ed P 726d96e241134d7e9e1851f2cee66d03 reported cstate change: term changed from 1 to 2, leader changed from ee69eea1a5cc4645acdd4deaa9e0ac7f (127.5.126.67) to 726d96e241134d7e9e1851f2cee66d03 (127.5.126.65). New cstate: current_term: 2 leader_uuid: "726d96e241134d7e9e1851f2cee66d03" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "726d96e241134d7e9e1851f2cee66d03" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 45087 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "316e9983905848079a8e6d9ce5585f46" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 39729 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ee69eea1a5cc4645acdd4deaa9e0ac7f" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 41127 } health_report { overall_health: UNKNOWN } } }
I20260709 13:23:59.173408 17410 consensus_queue.cc:260] T eb3f366f79ef4b2894bc2dbf6eb14794 P ee69eea1a5cc4645acdd4deaa9e0ac7f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "726d96e241134d7e9e1851f2cee66d03" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 45087 } } peers { permanent_uuid: "316e9983905848079a8e6d9ce5585f46" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 39729 } } peers { permanent_uuid: "ee69eea1a5cc4645acdd4deaa9e0ac7f" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 41127 } }
I20260709 13:23:59.174603 17410 raft_consensus.cc:3060] T eb3f366f79ef4b2894bc2dbf6eb14794 P ee69eea1a5cc4645acdd4deaa9e0ac7f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:23:59.178735 17262 raft_consensus.cc:2468] T eb3f366f79ef4b2894bc2dbf6eb14794 P 726d96e241134d7e9e1851f2cee66d03 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 316e9983905848079a8e6d9ce5585f46 in term 2.
I20260709 13:23:59.179979 17305 leader_election.cc:304] T eb3f366f79ef4b2894bc2dbf6eb14794 P 316e9983905848079a8e6d9ce5585f46 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 316e9983905848079a8e6d9ce5585f46, 726d96e241134d7e9e1851f2cee66d03; no voters: 
I20260709 13:23:59.180514 17410 raft_consensus.cc:2468] T eb3f366f79ef4b2894bc2dbf6eb14794 P ee69eea1a5cc4645acdd4deaa9e0ac7f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 316e9983905848079a8e6d9ce5585f46 in term 2.
I20260709 13:23:59.180794 17541 raft_consensus.cc:2804] T eb3f366f79ef4b2894bc2dbf6eb14794 P 316e9983905848079a8e6d9ce5585f46 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:23:59.181464 17541 raft_consensus.cc:697] T eb3f366f79ef4b2894bc2dbf6eb14794 P 316e9983905848079a8e6d9ce5585f46 [term 2 LEADER]: Becoming Leader. State: Replica: 316e9983905848079a8e6d9ce5585f46, State: Running, Role: LEADER
I20260709 13:23:59.182279 17541 consensus_queue.cc:237] T eb3f366f79ef4b2894bc2dbf6eb14794 P 316e9983905848079a8e6d9ce5585f46 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "726d96e241134d7e9e1851f2cee66d03" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 45087 } } peers { permanent_uuid: "316e9983905848079a8e6d9ce5585f46" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 39729 } } peers { permanent_uuid: "ee69eea1a5cc4645acdd4deaa9e0ac7f" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 41127 } }
I20260709 13:23:59.186228 17410 raft_consensus.cc:1275] T 711feb7b7a864c1d98dfd62c10eb0f99 P ee69eea1a5cc4645acdd4deaa9e0ac7f [term 2 FOLLOWER]: Refusing update from remote peer 726d96e241134d7e9e1851f2cee66d03: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:23:59.187695 17577 consensus_queue.cc:1048] T 711feb7b7a864c1d98dfd62c10eb0f99 P 726d96e241134d7e9e1851f2cee66d03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee69eea1a5cc4645acdd4deaa9e0ac7f" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 41127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:23:59.190387 17160 catalog_manager.cc:5697] T eb3f366f79ef4b2894bc2dbf6eb14794 P 316e9983905848079a8e6d9ce5585f46 reported cstate change: term changed from 1 to 2, leader changed from ee69eea1a5cc4645acdd4deaa9e0ac7f (127.5.126.67) to 316e9983905848079a8e6d9ce5585f46 (127.5.126.66). New cstate: current_term: 2 leader_uuid: "316e9983905848079a8e6d9ce5585f46" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "726d96e241134d7e9e1851f2cee66d03" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 45087 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "316e9983905848079a8e6d9ce5585f46" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 39729 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ee69eea1a5cc4645acdd4deaa9e0ac7f" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 41127 } health_report { overall_health: UNKNOWN } } }
I20260709 13:23:59.203239 17336 raft_consensus.cc:1275] T 711feb7b7a864c1d98dfd62c10eb0f99 P 316e9983905848079a8e6d9ce5585f46 [term 2 FOLLOWER]: Refusing update from remote peer 726d96e241134d7e9e1851f2cee66d03: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:23:59.204809 17577 consensus_queue.cc:1048] T 711feb7b7a864c1d98dfd62c10eb0f99 P 726d96e241134d7e9e1851f2cee66d03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "316e9983905848079a8e6d9ce5585f46" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 39729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:23:59.229270 17410 raft_consensus.cc:1275] T 27c47c73807f4c7c9535c0873d016f62 P ee69eea1a5cc4645acdd4deaa9e0ac7f [term 2 FOLLOWER]: Refusing update from remote peer 316e9983905848079a8e6d9ce5585f46: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:23:59.230595 17541 consensus_queue.cc:1048] T 27c47c73807f4c7c9535c0873d016f62 P 316e9983905848079a8e6d9ce5585f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee69eea1a5cc4645acdd4deaa9e0ac7f" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 41127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:23:59.239334 17262 raft_consensus.cc:1275] T 27c47c73807f4c7c9535c0873d016f62 P 726d96e241134d7e9e1851f2cee66d03 [term 2 FOLLOWER]: Refusing update from remote peer 316e9983905848079a8e6d9ce5585f46: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:23:59.242142 17608 consensus_queue.cc:1048] T 27c47c73807f4c7c9535c0873d016f62 P 316e9983905848079a8e6d9ce5585f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "726d96e241134d7e9e1851f2cee66d03" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 45087 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:23:59.303227 17262 raft_consensus.cc:1275] T 86979013624c4c96843236a7e7f8a1ec P 726d96e241134d7e9e1851f2cee66d03 [term 2 FOLLOWER]: Refusing update from remote peer 316e9983905848079a8e6d9ce5585f46: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:23:59.304502 17608 consensus_queue.cc:1048] T 86979013624c4c96843236a7e7f8a1ec P 316e9983905848079a8e6d9ce5585f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "726d96e241134d7e9e1851f2cee66d03" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 45087 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:23:59.312088 17410 raft_consensus.cc:1275] T 86979013624c4c96843236a7e7f8a1ec P ee69eea1a5cc4645acdd4deaa9e0ac7f [term 2 FOLLOWER]: Refusing update from remote peer 316e9983905848079a8e6d9ce5585f46: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:23:59.313473 17608 consensus_queue.cc:1048] T 86979013624c4c96843236a7e7f8a1ec P 316e9983905848079a8e6d9ce5585f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee69eea1a5cc4645acdd4deaa9e0ac7f" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 41127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:23:59.374169 17336 raft_consensus.cc:1275] T 743cee0b3a8241dfae72c033dc3d776e P 316e9983905848079a8e6d9ce5585f46 [term 2 FOLLOWER]: Refusing update from remote peer ee69eea1a5cc4645acdd4deaa9e0ac7f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:23:59.375571 17579 consensus_queue.cc:1048] T 743cee0b3a8241dfae72c033dc3d776e P ee69eea1a5cc4645acdd4deaa9e0ac7f [LEADER]: Connected to new peer: Peer: permanent_uuid: "316e9983905848079a8e6d9ce5585f46" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 39729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:23:59.384147 17262 raft_consensus.cc:1275] T 743cee0b3a8241dfae72c033dc3d776e P 726d96e241134d7e9e1851f2cee66d03 [term 2 FOLLOWER]: Refusing update from remote peer ee69eea1a5cc4645acdd4deaa9e0ac7f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:23:59.386189 17573 consensus_queue.cc:1048] T 743cee0b3a8241dfae72c033dc3d776e P ee69eea1a5cc4645acdd4deaa9e0ac7f [LEADER]: Connected to new peer: Peer: permanent_uuid: "726d96e241134d7e9e1851f2cee66d03" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 45087 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:23:59.470643 17336 raft_consensus.cc:1275] T 62599e0920c34027b50cf62f7b652686 P 316e9983905848079a8e6d9ce5585f46 [term 2 FOLLOWER]: Refusing update from remote peer 726d96e241134d7e9e1851f2cee66d03: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:23:59.472103 17577 consensus_queue.cc:1048] T 62599e0920c34027b50cf62f7b652686 P 726d96e241134d7e9e1851f2cee66d03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "316e9983905848079a8e6d9ce5585f46" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 39729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:23:59.486002 17410 raft_consensus.cc:1275] T 62599e0920c34027b50cf62f7b652686 P ee69eea1a5cc4645acdd4deaa9e0ac7f [term 2 FOLLOWER]: Refusing update from remote peer 726d96e241134d7e9e1851f2cee66d03: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:23:59.487514 17577 consensus_queue.cc:1048] T 62599e0920c34027b50cf62f7b652686 P 726d96e241134d7e9e1851f2cee66d03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee69eea1a5cc4645acdd4deaa9e0ac7f" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 41127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:23:59.597862 17262 raft_consensus.cc:1275] T d77e2380b35e4438a224b5148ebc574d P 726d96e241134d7e9e1851f2cee66d03 [term 2 FOLLOWER]: Refusing update from remote peer 316e9983905848079a8e6d9ce5585f46: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:23:59.599236 17568 consensus_queue.cc:1048] T d77e2380b35e4438a224b5148ebc574d P 316e9983905848079a8e6d9ce5585f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "726d96e241134d7e9e1851f2cee66d03" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 45087 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:23:59.605042 17410 raft_consensus.cc:1275] T d77e2380b35e4438a224b5148ebc574d P ee69eea1a5cc4645acdd4deaa9e0ac7f [term 2 FOLLOWER]: Refusing update from remote peer 316e9983905848079a8e6d9ce5585f46: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:23:59.606594 17608 consensus_queue.cc:1048] T d77e2380b35e4438a224b5148ebc574d P 316e9983905848079a8e6d9ce5585f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee69eea1a5cc4645acdd4deaa9e0ac7f" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 41127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:23:59.682854 17262 raft_consensus.cc:1275] T eb3f366f79ef4b2894bc2dbf6eb14794 P 726d96e241134d7e9e1851f2cee66d03 [term 2 FOLLOWER]: Refusing update from remote peer 316e9983905848079a8e6d9ce5585f46: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:23:59.684382 17631 consensus_queue.cc:1048] T eb3f366f79ef4b2894bc2dbf6eb14794 P 316e9983905848079a8e6d9ce5585f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "726d96e241134d7e9e1851f2cee66d03" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 45087 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:23:59.694199 17410 raft_consensus.cc:1275] T eb3f366f79ef4b2894bc2dbf6eb14794 P ee69eea1a5cc4645acdd4deaa9e0ac7f [term 2 FOLLOWER]: Refusing update from remote peer 316e9983905848079a8e6d9ce5585f46: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:23:59.695924 17631 consensus_queue.cc:1048] T eb3f366f79ef4b2894bc2dbf6eb14794 P 316e9983905848079a8e6d9ce5585f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee69eea1a5cc4645acdd4deaa9e0ac7f" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 41127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:23:59.726861 17412 raft_consensus.cc:1275] T a71f35e6480646cba674fd6925e001ed P ee69eea1a5cc4645acdd4deaa9e0ac7f [term 2 FOLLOWER]: Refusing update from remote peer 726d96e241134d7e9e1851f2cee66d03: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:23:59.728282 17558 consensus_queue.cc:1048] T a71f35e6480646cba674fd6925e001ed P 726d96e241134d7e9e1851f2cee66d03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee69eea1a5cc4645acdd4deaa9e0ac7f" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 41127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:23:59.737942 17336 raft_consensus.cc:1275] T a71f35e6480646cba674fd6925e001ed P 316e9983905848079a8e6d9ce5585f46 [term 2 FOLLOWER]: Refusing update from remote peer 726d96e241134d7e9e1851f2cee66d03: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:23:59.740654 17558 consensus_queue.cc:1048] T a71f35e6480646cba674fd6925e001ed P 726d96e241134d7e9e1851f2cee66d03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "316e9983905848079a8e6d9ce5585f46" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 39729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:24:01.725854 17160 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:56842:
table { table_name: "soft_deleted_table" } modify_external_catalogs: true reserve_seconds: 3600
I20260709 13:24:01.755291 17160 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:56842:
table { table_name: "soft_deleted_table" } new_extra_configs { key: "kudu.table.disable_compaction" value: "true" }
I20260709 13:24:01.811508  5625 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
W20260709 13:24:01.941731 17379 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.65:45087, user_credentials={real_user=slave}} blocked reactor thread for 92975.8us
W20260709 13:24:02.111073 17674 log.cc:927] Time spent T eb3f366f79ef4b2894bc2dbf6eb14794 P 726d96e241134d7e9e1851f2cee66d03: Append to log took a long time: real 0.088s	user 0.001s	sys 0.000s
W20260709 13:24:02.215730 17683 log.cc:927] Time spent T 86979013624c4c96843236a7e7f8a1ec P ee69eea1a5cc4645acdd4deaa9e0ac7f: Append to log took a long time: real 0.089s	user 0.000s	sys 0.005s
W20260709 13:24:02.256865 17227 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.67:41127, user_credentials={real_user=slave}} blocked reactor thread for 84654us
I20260709 13:24:02.283293 17692 tablet.cc:1724] T 62599e0920c34027b50cf62f7b652686 P 726d96e241134d7e9e1851f2cee66d03: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:24:02.308954 17701 tablet.cc:1724] T d77e2380b35e4438a224b5148ebc574d P 316e9983905848079a8e6d9ce5585f46: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:24:02.312273 17702 tablet.cc:1724] T eb3f366f79ef4b2894bc2dbf6eb14794 P 726d96e241134d7e9e1851f2cee66d03: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:24:02.348009 17262 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "62c32fd6e3f74f3b817349f92a686d3c"
dest_uuid: "726d96e241134d7e9e1851f2cee66d03"
mode: GRACEFUL
new_leader_uuid: "ee69eea1a5cc4645acdd4deaa9e0ac7f"
 from {username='slave'} at 127.0.0.1:35014
W20260709 13:24:02.384503 17365 tablet_mm_ops.cc:139] Rowset compaction is disabled (check --enable_rowset_compaction and disable_compaction in extra_config for tablet:d77e2380b35e4438a224b5148ebc574d)
W20260709 13:24:02.392282 17365 tablet_mm_ops.cc:304] Major delta compaction is disabled (check --enable_major_delta_compaction and disable_compaction in extra_config for tablet:d77e2380b35e4438a224b5148ebc574d)
W20260709 13:24:02.402148 17365 tablet_mm_ops.cc:220] Minor delta compaction is disabled (check --enable_minor_delta_compaction and disable_compaction in extra_config for tablet:d77e2380b35e4438a224b5148ebc574d)
I20260709 13:24:02.423549 17710 tablet.cc:1724] T 62c32fd6e3f74f3b817349f92a686d3c P 726d96e241134d7e9e1851f2cee66d03: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:24:02.378651 17696 tablet.cc:1724] T eb3f366f79ef4b2894bc2dbf6eb14794 P 316e9983905848079a8e6d9ce5585f46: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:24:02.444640 17707 tablet.cc:1724] T 711feb7b7a864c1d98dfd62c10eb0f99 P 316e9983905848079a8e6d9ce5585f46: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:24:02.407593 17262 raft_consensus.cc:606] T 62c32fd6e3f74f3b817349f92a686d3c P 726d96e241134d7e9e1851f2cee66d03 [term 1 LEADER]: Received request to transfer leadership to TS ee69eea1a5cc4645acdd4deaa9e0ac7f
I20260709 13:24:02.456712 17704 tablet.cc:1724] T 711feb7b7a864c1d98dfd62c10eb0f99 P 726d96e241134d7e9e1851f2cee66d03: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 13:24:02.482265 17695 log.cc:927] Time spent T 743cee0b3a8241dfae72c033dc3d776e P 726d96e241134d7e9e1851f2cee66d03: Append to log took a long time: real 0.082s	user 0.001s	sys 0.001s
I20260709 13:24:02.481310 17703 tablet.cc:1724] T d77e2380b35e4438a224b5148ebc574d P ee69eea1a5cc4645acdd4deaa9e0ac7f: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:24:02.486564 17711 tablet.cc:1724] T a71f35e6480646cba674fd6925e001ed P 316e9983905848079a8e6d9ce5585f46: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:24:02.500628 17712 tablet.cc:1724] T 62c32fd6e3f74f3b817349f92a686d3c P ee69eea1a5cc4645acdd4deaa9e0ac7f: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:24:02.512898 17709 tablet.cc:1724] T 711feb7b7a864c1d98dfd62c10eb0f99 P ee69eea1a5cc4645acdd4deaa9e0ac7f: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:24:02.501322 17702 tablet.cc:1724] T a71f35e6480646cba674fd6925e001ed P 726d96e241134d7e9e1851f2cee66d03: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:24:02.525346 17714 tablet.cc:1724] T 27c47c73807f4c7c9535c0873d016f62 P ee69eea1a5cc4645acdd4deaa9e0ac7f: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:24:02.509851 17704 tablet.cc:1724] T d77e2380b35e4438a224b5148ebc574d P 726d96e241134d7e9e1851f2cee66d03: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:24:02.563987 17704 tablet.cc:1724] T 27c47c73807f4c7c9535c0873d016f62 P 726d96e241134d7e9e1851f2cee66d03: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:24:02.578128 17704 tablet.cc:1724] T 86979013624c4c96843236a7e7f8a1ec P 726d96e241134d7e9e1851f2cee66d03: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:24:02.583662 17711 tablet.cc:1724] T 62c32fd6e3f74f3b817349f92a686d3c P 316e9983905848079a8e6d9ce5585f46: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:24:02.597585 17696 tablet.cc:1724] T 62599e0920c34027b50cf62f7b652686 P 316e9983905848079a8e6d9ce5585f46: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:24:02.609390 17701 tablet.cc:1724] T 27c47c73807f4c7c9535c0873d016f62 P 316e9983905848079a8e6d9ce5585f46: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:24:02.595253 17703 tablet.cc:1724] T 86979013624c4c96843236a7e7f8a1ec P ee69eea1a5cc4645acdd4deaa9e0ac7f: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:24:02.612640 17702 tablet.cc:1724] T 743cee0b3a8241dfae72c033dc3d776e P 726d96e241134d7e9e1851f2cee66d03: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:24:02.624533 17712 tablet.cc:1724] T 743cee0b3a8241dfae72c033dc3d776e P ee69eea1a5cc4645acdd4deaa9e0ac7f: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:24:02.658077 17339 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "86979013624c4c96843236a7e7f8a1ec"
dest_uuid: "316e9983905848079a8e6d9ce5585f46"
mode: GRACEFUL
new_leader_uuid: "ee69eea1a5cc4645acdd4deaa9e0ac7f"
 from {username='slave'} at 127.0.0.1:39472
I20260709 13:24:02.658859 17339 raft_consensus.cc:606] T 86979013624c4c96843236a7e7f8a1ec P 316e9983905848079a8e6d9ce5585f46 [term 2 LEADER]: Received request to transfer leadership to TS ee69eea1a5cc4645acdd4deaa9e0ac7f
I20260709 13:24:02.658403 17709 tablet.cc:1724] T 62599e0920c34027b50cf62f7b652686 P ee69eea1a5cc4645acdd4deaa9e0ac7f: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:24:02.661233 17714 tablet.cc:1724] T a71f35e6480646cba674fd6925e001ed P ee69eea1a5cc4645acdd4deaa9e0ac7f: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:24:02.616875 17707 tablet.cc:1724] T 86979013624c4c96843236a7e7f8a1ec P 316e9983905848079a8e6d9ce5585f46: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:24:02.665609  5625 auto_leader_rebalancer.cc:452] table: soft_deleted_table, leader rebalance finish, leader transfer count: 2
I20260709 13:24:02.666627  5625 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:24:02.676645 17711 tablet.cc:1724] T 743cee0b3a8241dfae72c033dc3d776e P 316e9983905848079a8e6d9ce5585f46: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:24:02.683296 17256 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9d069857fc89437daad3f116d0fc7709"
dest_uuid: "726d96e241134d7e9e1851f2cee66d03"
mode: GRACEFUL
new_leader_uuid: "ee69eea1a5cc4645acdd4deaa9e0ac7f"
 from {username='slave'} at 127.0.0.1:35014
I20260709 13:24:02.684118 17256 raft_consensus.cc:606] T 9d069857fc89437daad3f116d0fc7709 P 726d96e241134d7e9e1851f2cee66d03 [term 1 LEADER]: Received request to transfer leadership to TS ee69eea1a5cc4645acdd4deaa9e0ac7f
I20260709 13:24:02.687988 17339 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a01b9563aeb3401dbc60ad1647424d67"
dest_uuid: "316e9983905848079a8e6d9ce5585f46"
mode: GRACEFUL
new_leader_uuid: "ee69eea1a5cc4645acdd4deaa9e0ac7f"
 from {username='slave'} at 127.0.0.1:39472
I20260709 13:24:02.688740 17339 raft_consensus.cc:606] T a01b9563aeb3401dbc60ad1647424d67 P 316e9983905848079a8e6d9ce5585f46 [term 2 LEADER]: Received request to transfer leadership to TS ee69eea1a5cc4645acdd4deaa9e0ac7f
I20260709 13:24:02.696218  5625 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:24:02.696906  5625 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:24:02.710492 17709 tablet.cc:1724] T eb3f366f79ef4b2894bc2dbf6eb14794 P ee69eea1a5cc4645acdd4deaa9e0ac7f: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:24:02.745113 17160 catalog_manager.cc:6242] T 00000000000000000000000000000000 P be89b8f07a33490391e9a842951e89b0: soft_deleted_table [id=4d00e096d569428da7acb37de74ae81e] alter complete (version 1)
I20260709 13:24:02.834339 17680 raft_consensus.cc:993] T 62c32fd6e3f74f3b817349f92a686d3c P 726d96e241134d7e9e1851f2cee66d03: : Instructing follower ee69eea1a5cc4645acdd4deaa9e0ac7f to start an election
I20260709 13:24:02.834981 17700 raft_consensus.cc:1081] T 62c32fd6e3f74f3b817349f92a686d3c P 726d96e241134d7e9e1851f2cee66d03 [term 1 LEADER]: Signalling peer ee69eea1a5cc4645acdd4deaa9e0ac7f to start an election
I20260709 13:24:02.837036 17406 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "62c32fd6e3f74f3b817349f92a686d3c"
dest_uuid: "ee69eea1a5cc4645acdd4deaa9e0ac7f"
 from {username='slave'} at 127.0.0.1:45362
I20260709 13:24:02.837950 17406 raft_consensus.cc:493] T 62c32fd6e3f74f3b817349f92a686d3c P ee69eea1a5cc4645acdd4deaa9e0ac7f [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:24:02.838466 17406 raft_consensus.cc:3060] T 62c32fd6e3f74f3b817349f92a686d3c P ee69eea1a5cc4645acdd4deaa9e0ac7f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:24:02.849852 17406 raft_consensus.cc:515] T 62c32fd6e3f74f3b817349f92a686d3c P ee69eea1a5cc4645acdd4deaa9e0ac7f [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "726d96e241134d7e9e1851f2cee66d03" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 45087 } } peers { permanent_uuid: "316e9983905848079a8e6d9ce5585f46" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 39729 } } peers { permanent_uuid: "ee69eea1a5cc4645acdd4deaa9e0ac7f" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 41127 } }
I20260709 13:24:02.853462 17406 leader_election.cc:290] T 62c32fd6e3f74f3b817349f92a686d3c P ee69eea1a5cc4645acdd4deaa9e0ac7f [CANDIDATE]: Term 2 election: Requested vote from peers 726d96e241134d7e9e1851f2cee66d03 (127.5.126.65:45087), 316e9983905848079a8e6d9ce5585f46 (127.5.126.66:39729)
I20260709 13:24:02.853780 17256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62c32fd6e3f74f3b817349f92a686d3c" candidate_uuid: "ee69eea1a5cc4645acdd4deaa9e0ac7f" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: true dest_uuid: "726d96e241134d7e9e1851f2cee66d03"
I20260709 13:24:02.854087 17339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62c32fd6e3f74f3b817349f92a686d3c" candidate_uuid: "ee69eea1a5cc4645acdd4deaa9e0ac7f" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: true dest_uuid: "316e9983905848079a8e6d9ce5585f46"
I20260709 13:24:02.854745 17256 raft_consensus.cc:3055] T 62c32fd6e3f74f3b817349f92a686d3c P 726d96e241134d7e9e1851f2cee66d03 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:24:02.854745 17339 raft_consensus.cc:3060] T 62c32fd6e3f74f3b817349f92a686d3c P 316e9983905848079a8e6d9ce5585f46 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:24:02.855195 17256 raft_consensus.cc:740] T 62c32fd6e3f74f3b817349f92a686d3c P 726d96e241134d7e9e1851f2cee66d03 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 726d96e241134d7e9e1851f2cee66d03, State: Running, Role: LEADER
I20260709 13:24:02.856310 17256 consensus_queue.cc:260] T 62c32fd6e3f74f3b817349f92a686d3c P 726d96e241134d7e9e1851f2cee66d03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "726d96e241134d7e9e1851f2cee66d03" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 45087 } } peers { permanent_uuid: "316e9983905848079a8e6d9ce5585f46" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 39729 } } peers { permanent_uuid: "ee69eea1a5cc4645acdd4deaa9e0ac7f" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 41127 } }
I20260709 13:24:02.857534 17256 raft_consensus.cc:3060] T 62c32fd6e3f74f3b817349f92a686d3c P 726d96e241134d7e9e1851f2cee66d03 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:24:02.863279 17256 raft_consensus.cc:2468] T 62c32fd6e3f74f3b817349f92a686d3c P 726d96e241134d7e9e1851f2cee66d03 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee69eea1a5cc4645acdd4deaa9e0ac7f in term 2.
I20260709 13:24:02.864934 17379 leader_election.cc:304] T 62c32fd6e3f74f3b817349f92a686d3c P ee69eea1a5cc4645acdd4deaa9e0ac7f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 726d96e241134d7e9e1851f2cee66d03, ee69eea1a5cc4645acdd4deaa9e0ac7f; no voters: 
I20260709 13:24:02.866019 17639 raft_consensus.cc:2804] T 62c32fd6e3f74f3b817349f92a686d3c P ee69eea1a5cc4645acdd4deaa9e0ac7f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:24:02.866112 17339 raft_consensus.cc:2468] T 62c32fd6e3f74f3b817349f92a686d3c P 316e9983905848079a8e6d9ce5585f46 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee69eea1a5cc4645acdd4deaa9e0ac7f in term 2.
I20260709 13:24:02.866552 17639 raft_consensus.cc:697] T 62c32fd6e3f74f3b817349f92a686d3c P ee69eea1a5cc4645acdd4deaa9e0ac7f [term 2 LEADER]: Becoming Leader. State: Replica: ee69eea1a5cc4645acdd4deaa9e0ac7f, State: Running, Role: LEADER
I20260709 13:24:02.867682 17639 consensus_queue.cc:237] T 62c32fd6e3f74f3b817349f92a686d3c P ee69eea1a5cc4645acdd4deaa9e0ac7f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "726d96e241134d7e9e1851f2cee66d03" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 45087 } } peers { permanent_uuid: "316e9983905848079a8e6d9ce5585f46" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 39729 } } peers { permanent_uuid: "ee69eea1a5cc4645acdd4deaa9e0ac7f" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 41127 } }
I20260709 13:24:02.883818 17161 catalog_manager.cc:5697] T 62c32fd6e3f74f3b817349f92a686d3c P ee69eea1a5cc4645acdd4deaa9e0ac7f reported cstate change: term changed from 1 to 2, leader changed from 726d96e241134d7e9e1851f2cee66d03 (127.5.126.65) to ee69eea1a5cc4645acdd4deaa9e0ac7f (127.5.126.67). New cstate: current_term: 2 leader_uuid: "ee69eea1a5cc4645acdd4deaa9e0ac7f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "726d96e241134d7e9e1851f2cee66d03" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 45087 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "316e9983905848079a8e6d9ce5585f46" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 39729 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ee69eea1a5cc4645acdd4deaa9e0ac7f" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 41127 } health_report { overall_health: HEALTHY } } }
I20260709 13:24:02.951530 17669 raft_consensus.cc:993] T a01b9563aeb3401dbc60ad1647424d67 P 316e9983905848079a8e6d9ce5585f46: : Instructing follower ee69eea1a5cc4645acdd4deaa9e0ac7f to start an election
I20260709 13:24:02.952220 17697 raft_consensus.cc:1081] T a01b9563aeb3401dbc60ad1647424d67 P 316e9983905848079a8e6d9ce5585f46 [term 2 LEADER]: Signalling peer ee69eea1a5cc4645acdd4deaa9e0ac7f to start an election
I20260709 13:24:02.953935 17406 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a01b9563aeb3401dbc60ad1647424d67"
dest_uuid: "ee69eea1a5cc4645acdd4deaa9e0ac7f"
 from {username='slave'} at 127.0.0.1:45366
I20260709 13:24:02.954433 17406 raft_consensus.cc:493] T a01b9563aeb3401dbc60ad1647424d67 P ee69eea1a5cc4645acdd4deaa9e0ac7f [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:24:02.954788 17406 raft_consensus.cc:3060] T a01b9563aeb3401dbc60ad1647424d67 P ee69eea1a5cc4645acdd4deaa9e0ac7f [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:24:02.961628 17406 raft_consensus.cc:515] T a01b9563aeb3401dbc60ad1647424d67 P ee69eea1a5cc4645acdd4deaa9e0ac7f [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "726d96e241134d7e9e1851f2cee66d03" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 45087 } } peers { permanent_uuid: "316e9983905848079a8e6d9ce5585f46" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 39729 } } peers { permanent_uuid: "ee69eea1a5cc4645acdd4deaa9e0ac7f" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 41127 } }
I20260709 13:24:02.963372 17406 leader_election.cc:290] T a01b9563aeb3401dbc60ad1647424d67 P ee69eea1a5cc4645acdd4deaa9e0ac7f [CANDIDATE]: Term 3 election: Requested vote from peers 726d96e241134d7e9e1851f2cee66d03 (127.5.126.65:45087), 316e9983905848079a8e6d9ce5585f46 (127.5.126.66:39729)
I20260709 13:24:02.964497 17256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a01b9563aeb3401dbc60ad1647424d67" candidate_uuid: "ee69eea1a5cc4645acdd4deaa9e0ac7f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "726d96e241134d7e9e1851f2cee66d03"
I20260709 13:24:02.964553 17339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a01b9563aeb3401dbc60ad1647424d67" candidate_uuid: "ee69eea1a5cc4645acdd4deaa9e0ac7f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "316e9983905848079a8e6d9ce5585f46"
I20260709 13:24:02.965710 17256 raft_consensus.cc:3060] T a01b9563aeb3401dbc60ad1647424d67 P 726d96e241134d7e9e1851f2cee66d03 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:24:02.965723 17339 raft_consensus.cc:3055] T a01b9563aeb3401dbc60ad1647424d67 P 316e9983905848079a8e6d9ce5585f46 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:24:02.966367 17339 raft_consensus.cc:740] T a01b9563aeb3401dbc60ad1647424d67 P 316e9983905848079a8e6d9ce5585f46 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 316e9983905848079a8e6d9ce5585f46, State: Running, Role: LEADER
I20260709 13:24:02.967237 17339 consensus_queue.cc:260] T a01b9563aeb3401dbc60ad1647424d67 P 316e9983905848079a8e6d9ce5585f46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "726d96e241134d7e9e1851f2cee66d03" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 45087 } } peers { permanent_uuid: "316e9983905848079a8e6d9ce5585f46" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 39729 } } peers { permanent_uuid: "ee69eea1a5cc4645acdd4deaa9e0ac7f" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 41127 } }
I20260709 13:24:02.968580 17339 raft_consensus.cc:3060] T a01b9563aeb3401dbc60ad1647424d67 P 316e9983905848079a8e6d9ce5585f46 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:24:02.973798 17256 raft_consensus.cc:2468] T a01b9563aeb3401dbc60ad1647424d67 P 726d96e241134d7e9e1851f2cee66d03 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee69eea1a5cc4645acdd4deaa9e0ac7f in term 3.
I20260709 13:24:02.974543 17697 raft_consensus.cc:993] T 86979013624c4c96843236a7e7f8a1ec P 316e9983905848079a8e6d9ce5585f46: : Instructing follower ee69eea1a5cc4645acdd4deaa9e0ac7f to start an election
I20260709 13:24:02.975101 17379 leader_election.cc:304] T a01b9563aeb3401dbc60ad1647424d67 P ee69eea1a5cc4645acdd4deaa9e0ac7f [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 726d96e241134d7e9e1851f2cee66d03, ee69eea1a5cc4645acdd4deaa9e0ac7f; no voters: 
I20260709 13:24:02.975900 17339 raft_consensus.cc:2468] T a01b9563aeb3401dbc60ad1647424d67 P 316e9983905848079a8e6d9ce5585f46 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee69eea1a5cc4645acdd4deaa9e0ac7f in term 3.
I20260709 13:24:02.975129 17697 raft_consensus.cc:1081] T 86979013624c4c96843236a7e7f8a1ec P 316e9983905848079a8e6d9ce5585f46 [term 2 LEADER]: Signalling peer ee69eea1a5cc4645acdd4deaa9e0ac7f to start an election
I20260709 13:24:02.976241 17639 raft_consensus.cc:2804] T a01b9563aeb3401dbc60ad1647424d67 P ee69eea1a5cc4645acdd4deaa9e0ac7f [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:24:02.977090 17639 raft_consensus.cc:697] T a01b9563aeb3401dbc60ad1647424d67 P ee69eea1a5cc4645acdd4deaa9e0ac7f [term 3 LEADER]: Becoming Leader. State: Replica: ee69eea1a5cc4645acdd4deaa9e0ac7f, State: Running, Role: LEADER
I20260709 13:24:02.978178 17406 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "86979013624c4c96843236a7e7f8a1ec"
dest_uuid: "ee69eea1a5cc4645acdd4deaa9e0ac7f"
 from {username='slave'} at 127.0.0.1:45366
I20260709 13:24:02.978178 17639 consensus_queue.cc:237] T a01b9563aeb3401dbc60ad1647424d67 P ee69eea1a5cc4645acdd4deaa9e0ac7f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "726d96e241134d7e9e1851f2cee66d03" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 45087 } } peers { permanent_uuid: "316e9983905848079a8e6d9ce5585f46" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 39729 } } peers { permanent_uuid: "ee69eea1a5cc4645acdd4deaa9e0ac7f" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 41127 } }
I20260709 13:24:02.979003 17406 raft_consensus.cc:493] T 86979013624c4c96843236a7e7f8a1ec P ee69eea1a5cc4645acdd4deaa9e0ac7f [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:24:02.979414 17406 raft_consensus.cc:3060] T 86979013624c4c96843236a7e7f8a1ec P ee69eea1a5cc4645acdd4deaa9e0ac7f [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:24:02.988142 17406 raft_consensus.cc:515] T 86979013624c4c96843236a7e7f8a1ec P ee69eea1a5cc4645acdd4deaa9e0ac7f [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "726d96e241134d7e9e1851f2cee66d03" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 45087 } } peers { permanent_uuid: "316e9983905848079a8e6d9ce5585f46" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 39729 } } peers { permanent_uuid: "ee69eea1a5cc4645acdd4deaa9e0ac7f" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 41127 } }
I20260709 13:24:02.989279 17161 catalog_manager.cc:5697] T a01b9563aeb3401dbc60ad1647424d67 P ee69eea1a5cc4645acdd4deaa9e0ac7f reported cstate change: term changed from 2 to 3, leader changed from 316e9983905848079a8e6d9ce5585f46 (127.5.126.66) to ee69eea1a5cc4645acdd4deaa9e0ac7f (127.5.126.67). New cstate: current_term: 3 leader_uuid: "ee69eea1a5cc4645acdd4deaa9e0ac7f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "726d96e241134d7e9e1851f2cee66d03" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 45087 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "316e9983905848079a8e6d9ce5585f46" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 39729 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ee69eea1a5cc4645acdd4deaa9e0ac7f" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 41127 } health_report { overall_health: HEALTHY } } }
I20260709 13:24:02.990097 17406 leader_election.cc:290] T 86979013624c4c96843236a7e7f8a1ec P ee69eea1a5cc4645acdd4deaa9e0ac7f [CANDIDATE]: Term 3 election: Requested vote from peers 726d96e241134d7e9e1851f2cee66d03 (127.5.126.65:45087), 316e9983905848079a8e6d9ce5585f46 (127.5.126.66:39729)
I20260709 13:24:02.990742 17256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86979013624c4c96843236a7e7f8a1ec" candidate_uuid: "ee69eea1a5cc4645acdd4deaa9e0ac7f" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: true dest_uuid: "726d96e241134d7e9e1851f2cee66d03"
I20260709 13:24:02.991389 17256 raft_consensus.cc:3060] T 86979013624c4c96843236a7e7f8a1ec P 726d96e241134d7e9e1851f2cee66d03 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:24:02.996560 17339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86979013624c4c96843236a7e7f8a1ec" candidate_uuid: "ee69eea1a5cc4645acdd4deaa9e0ac7f" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: true dest_uuid: "316e9983905848079a8e6d9ce5585f46"
I20260709 13:24:02.997283 17256 raft_consensus.cc:2468] T 86979013624c4c96843236a7e7f8a1ec P 726d96e241134d7e9e1851f2cee66d03 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee69eea1a5cc4645acdd4deaa9e0ac7f in term 3.
I20260709 13:24:02.997344 17339 raft_consensus.cc:3055] T 86979013624c4c96843236a7e7f8a1ec P 316e9983905848079a8e6d9ce5585f46 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:24:02.998152 17339 raft_consensus.cc:740] T 86979013624c4c96843236a7e7f8a1ec P 316e9983905848079a8e6d9ce5585f46 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 316e9983905848079a8e6d9ce5585f46, State: Running, Role: LEADER
I20260709 13:24:02.998994 17339 consensus_queue.cc:260] T 86979013624c4c96843236a7e7f8a1ec P 316e9983905848079a8e6d9ce5585f46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "726d96e241134d7e9e1851f2cee66d03" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 45087 } } peers { permanent_uuid: "316e9983905848079a8e6d9ce5585f46" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 39729 } } peers { permanent_uuid: "ee69eea1a5cc4645acdd4deaa9e0ac7f" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 41127 } }
I20260709 13:24:02.999542 17379 leader_election.cc:304] T 86979013624c4c96843236a7e7f8a1ec P ee69eea1a5cc4645acdd4deaa9e0ac7f [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 726d96e241134d7e9e1851f2cee66d03, ee69eea1a5cc4645acdd4deaa9e0ac7f; no voters: 
I20260709 13:24:03.000182 17339 raft_consensus.cc:3060] T 86979013624c4c96843236a7e7f8a1ec P 316e9983905848079a8e6d9ce5585f46 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:24:03.000504 17639 raft_consensus.cc:2804] T 86979013624c4c96843236a7e7f8a1ec P ee69eea1a5cc4645acdd4deaa9e0ac7f [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:24:03.001462 17639 raft_consensus.cc:697] T 86979013624c4c96843236a7e7f8a1ec P ee69eea1a5cc4645acdd4deaa9e0ac7f [term 3 LEADER]: Becoming Leader. State: Replica: ee69eea1a5cc4645acdd4deaa9e0ac7f, State: Running, Role: LEADER
I20260709 13:24:03.002717 17639 consensus_queue.cc:237] T 86979013624c4c96843236a7e7f8a1ec P ee69eea1a5cc4645acdd4deaa9e0ac7f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "726d96e241134d7e9e1851f2cee66d03" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 45087 } } peers { permanent_uuid: "316e9983905848079a8e6d9ce5585f46" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 39729 } } peers { permanent_uuid: "ee69eea1a5cc4645acdd4deaa9e0ac7f" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 41127 } }
I20260709 13:24:03.005580 17339 raft_consensus.cc:2468] T 86979013624c4c96843236a7e7f8a1ec P 316e9983905848079a8e6d9ce5585f46 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee69eea1a5cc4645acdd4deaa9e0ac7f in term 3.
I20260709 13:24:03.010779 17161 catalog_manager.cc:5697] T 86979013624c4c96843236a7e7f8a1ec P ee69eea1a5cc4645acdd4deaa9e0ac7f reported cstate change: term changed from 2 to 3, leader changed from 316e9983905848079a8e6d9ce5585f46 (127.5.126.66) to ee69eea1a5cc4645acdd4deaa9e0ac7f (127.5.126.67). New cstate: current_term: 3 leader_uuid: "ee69eea1a5cc4645acdd4deaa9e0ac7f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "726d96e241134d7e9e1851f2cee66d03" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 45087 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "316e9983905848079a8e6d9ce5585f46" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 39729 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ee69eea1a5cc4645acdd4deaa9e0ac7f" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 41127 } health_report { overall_health: HEALTHY } } }
I20260709 13:24:03.013754 17680 raft_consensus.cc:993] T 9d069857fc89437daad3f116d0fc7709 P 726d96e241134d7e9e1851f2cee66d03: : Instructing follower ee69eea1a5cc4645acdd4deaa9e0ac7f to start an election
I20260709 13:24:03.014428 17700 raft_consensus.cc:1081] T 9d069857fc89437daad3f116d0fc7709 P 726d96e241134d7e9e1851f2cee66d03 [term 1 LEADER]: Signalling peer ee69eea1a5cc4645acdd4deaa9e0ac7f to start an election
I20260709 13:24:03.016453 17406 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9d069857fc89437daad3f116d0fc7709"
dest_uuid: "ee69eea1a5cc4645acdd4deaa9e0ac7f"
 from {username='slave'} at 127.0.0.1:45362
I20260709 13:24:03.017133 17406 raft_consensus.cc:493] T 9d069857fc89437daad3f116d0fc7709 P ee69eea1a5cc4645acdd4deaa9e0ac7f [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:24:03.017498 17406 raft_consensus.cc:3060] T 9d069857fc89437daad3f116d0fc7709 P ee69eea1a5cc4645acdd4deaa9e0ac7f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:24:03.023613 17406 raft_consensus.cc:515] T 9d069857fc89437daad3f116d0fc7709 P ee69eea1a5cc4645acdd4deaa9e0ac7f [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "726d96e241134d7e9e1851f2cee66d03" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 45087 } } peers { permanent_uuid: "316e9983905848079a8e6d9ce5585f46" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 39729 } } peers { permanent_uuid: "ee69eea1a5cc4645acdd4deaa9e0ac7f" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 41127 } }
I20260709 13:24:03.025583 17406 leader_election.cc:290] T 9d069857fc89437daad3f116d0fc7709 P ee69eea1a5cc4645acdd4deaa9e0ac7f [CANDIDATE]: Term 2 election: Requested vote from peers 726d96e241134d7e9e1851f2cee66d03 (127.5.126.65:45087), 316e9983905848079a8e6d9ce5585f46 (127.5.126.66:39729)
I20260709 13:24:03.026400 17256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d069857fc89437daad3f116d0fc7709" candidate_uuid: "ee69eea1a5cc4645acdd4deaa9e0ac7f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "726d96e241134d7e9e1851f2cee66d03"
I20260709 13:24:03.026726 17339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d069857fc89437daad3f116d0fc7709" candidate_uuid: "ee69eea1a5cc4645acdd4deaa9e0ac7f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "316e9983905848079a8e6d9ce5585f46"
I20260709 13:24:03.027132 17256 raft_consensus.cc:3055] T 9d069857fc89437daad3f116d0fc7709 P 726d96e241134d7e9e1851f2cee66d03 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:24:03.027510 17339 raft_consensus.cc:3060] T 9d069857fc89437daad3f116d0fc7709 P 316e9983905848079a8e6d9ce5585f46 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:24:03.027519 17256 raft_consensus.cc:740] T 9d069857fc89437daad3f116d0fc7709 P 726d96e241134d7e9e1851f2cee66d03 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 726d96e241134d7e9e1851f2cee66d03, State: Running, Role: LEADER
I20260709 13:24:03.028755 17256 consensus_queue.cc:260] T 9d069857fc89437daad3f116d0fc7709 P 726d96e241134d7e9e1851f2cee66d03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "726d96e241134d7e9e1851f2cee66d03" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 45087 } } peers { permanent_uuid: "316e9983905848079a8e6d9ce5585f46" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 39729 } } peers { permanent_uuid: "ee69eea1a5cc4645acdd4deaa9e0ac7f" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 41127 } }
I20260709 13:24:03.029860 17256 raft_consensus.cc:3060] T 9d069857fc89437daad3f116d0fc7709 P 726d96e241134d7e9e1851f2cee66d03 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:24:03.032862 17339 raft_consensus.cc:2468] T 9d069857fc89437daad3f116d0fc7709 P 316e9983905848079a8e6d9ce5585f46 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee69eea1a5cc4645acdd4deaa9e0ac7f in term 2.
I20260709 13:24:03.034373 17376 leader_election.cc:304] T 9d069857fc89437daad3f116d0fc7709 P ee69eea1a5cc4645acdd4deaa9e0ac7f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 316e9983905848079a8e6d9ce5585f46, ee69eea1a5cc4645acdd4deaa9e0ac7f; no voters: 
I20260709 13:24:03.035359 17639 raft_consensus.cc:2804] T 9d069857fc89437daad3f116d0fc7709 P ee69eea1a5cc4645acdd4deaa9e0ac7f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:24:03.035841 17639 raft_consensus.cc:697] T 9d069857fc89437daad3f116d0fc7709 P ee69eea1a5cc4645acdd4deaa9e0ac7f [term 2 LEADER]: Becoming Leader. State: Replica: ee69eea1a5cc4645acdd4deaa9e0ac7f, State: Running, Role: LEADER
I20260709 13:24:03.036579 17256 raft_consensus.cc:2468] T 9d069857fc89437daad3f116d0fc7709 P 726d96e241134d7e9e1851f2cee66d03 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee69eea1a5cc4645acdd4deaa9e0ac7f in term 2.
I20260709 13:24:03.036808 17639 consensus_queue.cc:237] T 9d069857fc89437daad3f116d0fc7709 P ee69eea1a5cc4645acdd4deaa9e0ac7f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "726d96e241134d7e9e1851f2cee66d03" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 45087 } } peers { permanent_uuid: "316e9983905848079a8e6d9ce5585f46" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 39729 } } peers { permanent_uuid: "ee69eea1a5cc4645acdd4deaa9e0ac7f" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 41127 } }
I20260709 13:24:03.044504 17161 catalog_manager.cc:5697] T 9d069857fc89437daad3f116d0fc7709 P ee69eea1a5cc4645acdd4deaa9e0ac7f reported cstate change: term changed from 1 to 2, leader changed from 726d96e241134d7e9e1851f2cee66d03 (127.5.126.65) to ee69eea1a5cc4645acdd4deaa9e0ac7f (127.5.126.67). New cstate: current_term: 2 leader_uuid: "ee69eea1a5cc4645acdd4deaa9e0ac7f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "726d96e241134d7e9e1851f2cee66d03" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 45087 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "316e9983905848079a8e6d9ce5585f46" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 39729 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ee69eea1a5cc4645acdd4deaa9e0ac7f" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 41127 } health_report { overall_health: HEALTHY } } }
I20260709 13:24:03.377876 17339 raft_consensus.cc:1275] T a01b9563aeb3401dbc60ad1647424d67 P 316e9983905848079a8e6d9ce5585f46 [term 3 FOLLOWER]: Refusing update from remote peer ee69eea1a5cc4645acdd4deaa9e0ac7f: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:24:03.379136 17639 consensus_queue.cc:1048] T a01b9563aeb3401dbc60ad1647424d67 P ee69eea1a5cc4645acdd4deaa9e0ac7f [LEADER]: Connected to new peer: Peer: permanent_uuid: "316e9983905848079a8e6d9ce5585f46" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 39729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:24:03.389463 17256 raft_consensus.cc:1275] T a01b9563aeb3401dbc60ad1647424d67 P 726d96e241134d7e9e1851f2cee66d03 [term 3 FOLLOWER]: Refusing update from remote peer ee69eea1a5cc4645acdd4deaa9e0ac7f: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:24:03.391712 17639 consensus_queue.cc:1048] T a01b9563aeb3401dbc60ad1647424d67 P ee69eea1a5cc4645acdd4deaa9e0ac7f [LEADER]: Connected to new peer: Peer: permanent_uuid: "726d96e241134d7e9e1851f2cee66d03" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 45087 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:24:03.401419 17334 raft_consensus.cc:1275] T 62c32fd6e3f74f3b817349f92a686d3c P 316e9983905848079a8e6d9ce5585f46 [term 2 FOLLOWER]: Refusing update from remote peer ee69eea1a5cc4645acdd4deaa9e0ac7f: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:24:03.403353 17639 consensus_queue.cc:1048] T 62c32fd6e3f74f3b817349f92a686d3c P ee69eea1a5cc4645acdd4deaa9e0ac7f [LEADER]: Connected to new peer: Peer: permanent_uuid: "316e9983905848079a8e6d9ce5585f46" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 39729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:24:03.413959 17256 raft_consensus.cc:1275] T 62c32fd6e3f74f3b817349f92a686d3c P 726d96e241134d7e9e1851f2cee66d03 [term 2 FOLLOWER]: Refusing update from remote peer ee69eea1a5cc4645acdd4deaa9e0ac7f: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:24:03.419360 17723 consensus_queue.cc:1048] T 62c32fd6e3f74f3b817349f92a686d3c P ee69eea1a5cc4645acdd4deaa9e0ac7f [LEADER]: Connected to new peer: Peer: permanent_uuid: "726d96e241134d7e9e1851f2cee66d03" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 45087 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:24:03.472148 17334 raft_consensus.cc:1275] T 9d069857fc89437daad3f116d0fc7709 P 316e9983905848079a8e6d9ce5585f46 [term 2 FOLLOWER]: Refusing update from remote peer ee69eea1a5cc4645acdd4deaa9e0ac7f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:24:03.474771 17723 consensus_queue.cc:1048] T 9d069857fc89437daad3f116d0fc7709 P ee69eea1a5cc4645acdd4deaa9e0ac7f [LEADER]: Connected to new peer: Peer: permanent_uuid: "316e9983905848079a8e6d9ce5585f46" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 39729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:24:03.489682 17256 raft_consensus.cc:1275] T 9d069857fc89437daad3f116d0fc7709 P 726d96e241134d7e9e1851f2cee66d03 [term 2 FOLLOWER]: Refusing update from remote peer ee69eea1a5cc4645acdd4deaa9e0ac7f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:24:03.492379 17639 consensus_queue.cc:1048] T 9d069857fc89437daad3f116d0fc7709 P ee69eea1a5cc4645acdd4deaa9e0ac7f [LEADER]: Connected to new peer: Peer: permanent_uuid: "726d96e241134d7e9e1851f2cee66d03" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 45087 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:24:03.503345 17334 raft_consensus.cc:1275] T 86979013624c4c96843236a7e7f8a1ec P 316e9983905848079a8e6d9ce5585f46 [term 3 FOLLOWER]: Refusing update from remote peer ee69eea1a5cc4645acdd4deaa9e0ac7f: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:24:03.506944 17665 consensus_queue.cc:1048] T 86979013624c4c96843236a7e7f8a1ec P ee69eea1a5cc4645acdd4deaa9e0ac7f [LEADER]: Connected to new peer: Peer: permanent_uuid: "316e9983905848079a8e6d9ce5585f46" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 39729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:24:03.524789 17256 raft_consensus.cc:1275] T 86979013624c4c96843236a7e7f8a1ec P 726d96e241134d7e9e1851f2cee66d03 [term 3 FOLLOWER]: Refusing update from remote peer ee69eea1a5cc4645acdd4deaa9e0ac7f: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:24:03.526757 17723 consensus_queue.cc:1048] T 86979013624c4c96843236a7e7f8a1ec P ee69eea1a5cc4645acdd4deaa9e0ac7f [LEADER]: Connected to new peer: Peer: permanent_uuid: "726d96e241134d7e9e1851f2cee66d03" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 45087 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:24:03.767623  5625 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 13:24:03.774165  5625 auto_leader_rebalancer.cc:452] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260709 13:24:03.774789  5625 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:24:03.781929  5625 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 13:24:03.782388  5625 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:24:04.816470  5625 tablet_server.cc:179] TabletServer@127.5.126.65:0 shutting down...
I20260709 13:24:04.850891  5625 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:24:04.851786  5625 tablet_replica.cc:333] T 743cee0b3a8241dfae72c033dc3d776e P 726d96e241134d7e9e1851f2cee66d03: stopping tablet replica
I20260709 13:24:04.852780  5625 raft_consensus.cc:2243] T 743cee0b3a8241dfae72c033dc3d776e P 726d96e241134d7e9e1851f2cee66d03 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:24:04.853503  5625 raft_consensus.cc:2272] T 743cee0b3a8241dfae72c033dc3d776e P 726d96e241134d7e9e1851f2cee66d03 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:24:04.856012  5625 tablet_replica.cc:333] T 86979013624c4c96843236a7e7f8a1ec P 726d96e241134d7e9e1851f2cee66d03: stopping tablet replica
I20260709 13:24:04.856779  5625 raft_consensus.cc:2243] T 86979013624c4c96843236a7e7f8a1ec P 726d96e241134d7e9e1851f2cee66d03 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:24:04.857280  5625 raft_consensus.cc:2272] T 86979013624c4c96843236a7e7f8a1ec P 726d96e241134d7e9e1851f2cee66d03 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:24:04.859516  5625 tablet_replica.cc:333] T 27c47c73807f4c7c9535c0873d016f62 P 726d96e241134d7e9e1851f2cee66d03: stopping tablet replica
I20260709 13:24:04.860255  5625 raft_consensus.cc:2243] T 27c47c73807f4c7c9535c0873d016f62 P 726d96e241134d7e9e1851f2cee66d03 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:24:04.860756  5625 raft_consensus.cc:2272] T 27c47c73807f4c7c9535c0873d016f62 P 726d96e241134d7e9e1851f2cee66d03 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:24:04.863543  5625 tablet_replica.cc:333] T eb3f366f79ef4b2894bc2dbf6eb14794 P 726d96e241134d7e9e1851f2cee66d03: stopping tablet replica
I20260709 13:24:04.864514  5625 raft_consensus.cc:2243] T eb3f366f79ef4b2894bc2dbf6eb14794 P 726d96e241134d7e9e1851f2cee66d03 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:24:04.865111  5625 raft_consensus.cc:2272] T eb3f366f79ef4b2894bc2dbf6eb14794 P 726d96e241134d7e9e1851f2cee66d03 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:24:04.867580  5625 tablet_replica.cc:333] T d77e2380b35e4438a224b5148ebc574d P 726d96e241134d7e9e1851f2cee66d03: stopping tablet replica
I20260709 13:24:04.868288  5625 raft_consensus.cc:2243] T d77e2380b35e4438a224b5148ebc574d P 726d96e241134d7e9e1851f2cee66d03 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:24:04.868782  5625 raft_consensus.cc:2272] T d77e2380b35e4438a224b5148ebc574d P 726d96e241134d7e9e1851f2cee66d03 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:24:04.870939  5625 tablet_replica.cc:333] T a71f35e6480646cba674fd6925e001ed P 726d96e241134d7e9e1851f2cee66d03: stopping tablet replica
I20260709 13:24:04.871845  5625 raft_consensus.cc:2243] T a71f35e6480646cba674fd6925e001ed P 726d96e241134d7e9e1851f2cee66d03 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:24:04.872846  5625 raft_consensus.cc:2272] T a71f35e6480646cba674fd6925e001ed P 726d96e241134d7e9e1851f2cee66d03 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:24:04.874559 17305 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:24:04.875833  5625 tablet_replica.cc:333] T a01b9563aeb3401dbc60ad1647424d67 P 726d96e241134d7e9e1851f2cee66d03: stopping tablet replica
I20260709 13:24:04.876883  5625 raft_consensus.cc:2243] T a01b9563aeb3401dbc60ad1647424d67 P 726d96e241134d7e9e1851f2cee66d03 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:24:04.877555  5625 raft_consensus.cc:2272] T a01b9563aeb3401dbc60ad1647424d67 P 726d96e241134d7e9e1851f2cee66d03 [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 13:24:04.878379 17305 consensus_peers.cc:597] T eb3f366f79ef4b2894bc2dbf6eb14794 P 316e9983905848079a8e6d9ce5585f46 -> Peer 726d96e241134d7e9e1851f2cee66d03 (127.5.126.65:45087): Couldn't send request to peer 726d96e241134d7e9e1851f2cee66d03. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:24:04.879951 17305 consensus_peers.cc:597] T d77e2380b35e4438a224b5148ebc574d P 316e9983905848079a8e6d9ce5585f46 -> Peer 726d96e241134d7e9e1851f2cee66d03 (127.5.126.65:45087): Couldn't send request to peer 726d96e241134d7e9e1851f2cee66d03. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:24:04.880553  5625 tablet_replica.cc:333] T 711feb7b7a864c1d98dfd62c10eb0f99 P 726d96e241134d7e9e1851f2cee66d03: stopping tablet replica
I20260709 13:24:04.881359  5625 raft_consensus.cc:2243] T 711feb7b7a864c1d98dfd62c10eb0f99 P 726d96e241134d7e9e1851f2cee66d03 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:24:04.882261  5625 raft_consensus.cc:2272] T 711feb7b7a864c1d98dfd62c10eb0f99 P 726d96e241134d7e9e1851f2cee66d03 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:24:04.884666  5625 tablet_replica.cc:333] T 3c97f32b7fa24e109d2c993bee4cacdc P 726d96e241134d7e9e1851f2cee66d03: stopping tablet replica
I20260709 13:24:04.885270  5625 raft_consensus.cc:2243] T 3c97f32b7fa24e109d2c993bee4cacdc P 726d96e241134d7e9e1851f2cee66d03 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:24:04.885847  5625 raft_consensus.cc:2272] T 3c97f32b7fa24e109d2c993bee4cacdc P 726d96e241134d7e9e1851f2cee66d03 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:24:04.888397  5625 tablet_replica.cc:333] T 62c32fd6e3f74f3b817349f92a686d3c P 726d96e241134d7e9e1851f2cee66d03: stopping tablet replica
I20260709 13:24:04.889091  5625 raft_consensus.cc:2243] T 62c32fd6e3f74f3b817349f92a686d3c P 726d96e241134d7e9e1851f2cee66d03 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:24:04.889575  5625 raft_consensus.cc:2272] T 62c32fd6e3f74f3b817349f92a686d3c P 726d96e241134d7e9e1851f2cee66d03 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:24:04.891748  5625 tablet_replica.cc:333] T 62599e0920c34027b50cf62f7b652686 P 726d96e241134d7e9e1851f2cee66d03: stopping tablet replica
I20260709 13:24:04.892347  5625 raft_consensus.cc:2243] T 62599e0920c34027b50cf62f7b652686 P 726d96e241134d7e9e1851f2cee66d03 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:24:04.893208  5625 raft_consensus.cc:2272] T 62599e0920c34027b50cf62f7b652686 P 726d96e241134d7e9e1851f2cee66d03 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:24:04.895478  5625 tablet_replica.cc:333] T 54bab860b0384e1bb5e75b8c8594e4a0 P 726d96e241134d7e9e1851f2cee66d03: stopping tablet replica
I20260709 13:24:04.896346  5625 raft_consensus.cc:2243] T 54bab860b0384e1bb5e75b8c8594e4a0 P 726d96e241134d7e9e1851f2cee66d03 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:24:04.896991  5625 raft_consensus.cc:2272] T 54bab860b0384e1bb5e75b8c8594e4a0 P 726d96e241134d7e9e1851f2cee66d03 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:24:04.900141  5625 tablet_replica.cc:333] T a3211f7bc1aa4d949b49f0c23362b0d5 P 726d96e241134d7e9e1851f2cee66d03: stopping tablet replica
I20260709 13:24:04.900794  5625 raft_consensus.cc:2243] T a3211f7bc1aa4d949b49f0c23362b0d5 P 726d96e241134d7e9e1851f2cee66d03 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:24:04.901749  5625 raft_consensus.cc:2272] T a3211f7bc1aa4d949b49f0c23362b0d5 P 726d96e241134d7e9e1851f2cee66d03 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:24:04.904122  5625 tablet_replica.cc:333] T d87dace41fef4526a2cace8a5007919f P 726d96e241134d7e9e1851f2cee66d03: stopping tablet replica
I20260709 13:24:04.904980  5625 raft_consensus.cc:2243] T d87dace41fef4526a2cace8a5007919f P 726d96e241134d7e9e1851f2cee66d03 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:24:04.905663  5625 raft_consensus.cc:2272] T d87dace41fef4526a2cace8a5007919f P 726d96e241134d7e9e1851f2cee66d03 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:24:04.908166  5625 tablet_replica.cc:333] T 0544fe20b9ca44b18589408ea98f4eed P 726d96e241134d7e9e1851f2cee66d03: stopping tablet replica
I20260709 13:24:04.908879  5625 raft_consensus.cc:2243] T 0544fe20b9ca44b18589408ea98f4eed P 726d96e241134d7e9e1851f2cee66d03 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:24:04.909782  5625 raft_consensus.cc:2272] T 0544fe20b9ca44b18589408ea98f4eed P 726d96e241134d7e9e1851f2cee66d03 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:24:04.912228  5625 tablet_replica.cc:333] T d137c22ac67145ae96eedb776127de6f P 726d96e241134d7e9e1851f2cee66d03: stopping tablet replica
I20260709 13:24:04.912835  5625 raft_consensus.cc:2243] T d137c22ac67145ae96eedb776127de6f P 726d96e241134d7e9e1851f2cee66d03 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:24:04.913758  5625 raft_consensus.cc:2272] T d137c22ac67145ae96eedb776127de6f P 726d96e241134d7e9e1851f2cee66d03 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:24:04.916908  5625 tablet_replica.cc:333] T c2dd9bbf84cd4a0f918afc3a6e9f9d04 P 726d96e241134d7e9e1851f2cee66d03: stopping tablet replica
I20260709 13:24:04.917719  5625 raft_consensus.cc:2243] T c2dd9bbf84cd4a0f918afc3a6e9f9d04 P 726d96e241134d7e9e1851f2cee66d03 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:24:04.918514  5625 raft_consensus.cc:2272] T c2dd9bbf84cd4a0f918afc3a6e9f9d04 P 726d96e241134d7e9e1851f2cee66d03 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:24:04.920956 17379 consensus_peers.cc:597] T 86979013624c4c96843236a7e7f8a1ec P ee69eea1a5cc4645acdd4deaa9e0ac7f -> Peer 726d96e241134d7e9e1851f2cee66d03 (127.5.126.65:45087): Couldn't send request to peer 726d96e241134d7e9e1851f2cee66d03. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:24:04.921697  5625 tablet_replica.cc:333] T 9d069857fc89437daad3f116d0fc7709 P 726d96e241134d7e9e1851f2cee66d03: stopping tablet replica
I20260709 13:24:04.922361  5625 raft_consensus.cc:2243] T 9d069857fc89437daad3f116d0fc7709 P 726d96e241134d7e9e1851f2cee66d03 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:24:04.922832  5625 raft_consensus.cc:2272] T 9d069857fc89437daad3f116d0fc7709 P 726d96e241134d7e9e1851f2cee66d03 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:24:04.934716 17379 consensus_peers.cc:597] T 9d069857fc89437daad3f116d0fc7709 P ee69eea1a5cc4645acdd4deaa9e0ac7f -> Peer 726d96e241134d7e9e1851f2cee66d03 (127.5.126.65:45087): Couldn't send request to peer 726d96e241134d7e9e1851f2cee66d03. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:24:04.949450 17379 consensus_peers.cc:597] T 54bab860b0384e1bb5e75b8c8594e4a0 P ee69eea1a5cc4645acdd4deaa9e0ac7f -> Peer 726d96e241134d7e9e1851f2cee66d03 (127.5.126.65:45087): Couldn't send request to peer 726d96e241134d7e9e1851f2cee66d03. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:24:04.973393  5625 tablet_server.cc:196] TabletServer@127.5.126.65:0 shutdown complete.
W20260709 13:24:04.987198 17305 consensus_peers.cc:597] T 3c97f32b7fa24e109d2c993bee4cacdc P 316e9983905848079a8e6d9ce5585f46 -> Peer 726d96e241134d7e9e1851f2cee66d03 (127.5.126.65:45087): Couldn't send request to peer 726d96e241134d7e9e1851f2cee66d03. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:45087: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:24:04.997623 17305 consensus_peers.cc:597] T c2dd9bbf84cd4a0f918afc3a6e9f9d04 P 316e9983905848079a8e6d9ce5585f46 -> Peer 726d96e241134d7e9e1851f2cee66d03 (127.5.126.65:45087): Couldn't send request to peer 726d96e241134d7e9e1851f2cee66d03. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:45087: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:24:05.022258  5625 tablet_server.cc:179] TabletServer@127.5.126.66:0 shutting down...
W20260709 13:24:05.066546 17305 consensus_peers.cc:597] T 27c47c73807f4c7c9535c0873d016f62 P 316e9983905848079a8e6d9ce5585f46 -> Peer 726d96e241134d7e9e1851f2cee66d03 (127.5.126.65:45087): Couldn't send request to peer 726d96e241134d7e9e1851f2cee66d03. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:45087: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:24:05.073920  5625 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:24:05.074805  5625 tablet_replica.cc:333] T eb3f366f79ef4b2894bc2dbf6eb14794 P 316e9983905848079a8e6d9ce5585f46: stopping tablet replica
I20260709 13:24:05.075577  5625 raft_consensus.cc:2243] T eb3f366f79ef4b2894bc2dbf6eb14794 P 316e9983905848079a8e6d9ce5585f46 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:24:05.076507  5625 raft_consensus.cc:2272] T eb3f366f79ef4b2894bc2dbf6eb14794 P 316e9983905848079a8e6d9ce5585f46 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:24:05.079357  5625 tablet_replica.cc:333] T 743cee0b3a8241dfae72c033dc3d776e P 316e9983905848079a8e6d9ce5585f46: stopping tablet replica
I20260709 13:24:05.080359  5625 raft_consensus.cc:2243] T 743cee0b3a8241dfae72c033dc3d776e P 316e9983905848079a8e6d9ce5585f46 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:24:05.080960  5625 raft_consensus.cc:2272] T 743cee0b3a8241dfae72c033dc3d776e P 316e9983905848079a8e6d9ce5585f46 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:24:05.082317 17376 consensus_peers.cc:597] T 9d069857fc89437daad3f116d0fc7709 P ee69eea1a5cc4645acdd4deaa9e0ac7f -> Peer 316e9983905848079a8e6d9ce5585f46 (127.5.126.66:39729): Couldn't send request to peer 316e9983905848079a8e6d9ce5585f46. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:24:05.083877  5625 tablet_replica.cc:333] T 86979013624c4c96843236a7e7f8a1ec P 316e9983905848079a8e6d9ce5585f46: stopping tablet replica
I20260709 13:24:05.084717  5625 raft_consensus.cc:2243] T 86979013624c4c96843236a7e7f8a1ec P 316e9983905848079a8e6d9ce5585f46 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:24:05.085194  5625 raft_consensus.cc:2272] T 86979013624c4c96843236a7e7f8a1ec P 316e9983905848079a8e6d9ce5585f46 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:24:05.087451  5625 tablet_replica.cc:333] T 27c47c73807f4c7c9535c0873d016f62 P 316e9983905848079a8e6d9ce5585f46: stopping tablet replica
I20260709 13:24:05.088107  5625 raft_consensus.cc:2243] T 27c47c73807f4c7c9535c0873d016f62 P 316e9983905848079a8e6d9ce5585f46 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:24:05.088939  5625 raft_consensus.cc:2272] T 27c47c73807f4c7c9535c0873d016f62 P 316e9983905848079a8e6d9ce5585f46 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:24:05.091843  5625 tablet_replica.cc:333] T 54bab860b0384e1bb5e75b8c8594e4a0 P 316e9983905848079a8e6d9ce5585f46: stopping tablet replica
I20260709 13:24:05.092512  5625 raft_consensus.cc:2243] T 54bab860b0384e1bb5e75b8c8594e4a0 P 316e9983905848079a8e6d9ce5585f46 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:24:05.092963  5625 raft_consensus.cc:2272] T 54bab860b0384e1bb5e75b8c8594e4a0 P 316e9983905848079a8e6d9ce5585f46 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:24:05.095880  5625 tablet_replica.cc:333] T 62599e0920c34027b50cf62f7b652686 P 316e9983905848079a8e6d9ce5585f46: stopping tablet replica
W20260709 13:24:05.096385 17379 consensus_peers.cc:597] T 62c32fd6e3f74f3b817349f92a686d3c P ee69eea1a5cc4645acdd4deaa9e0ac7f -> Peer 726d96e241134d7e9e1851f2cee66d03 (127.5.126.65:45087): Couldn't send request to peer 726d96e241134d7e9e1851f2cee66d03. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:45087: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:24:05.096688  5625 raft_consensus.cc:2243] T 62599e0920c34027b50cf62f7b652686 P 316e9983905848079a8e6d9ce5585f46 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:24:05.097275  5625 raft_consensus.cc:2272] T 62599e0920c34027b50cf62f7b652686 P 316e9983905848079a8e6d9ce5585f46 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:24:05.099296  5625 tablet_replica.cc:333] T 3c97f32b7fa24e109d2c993bee4cacdc P 316e9983905848079a8e6d9ce5585f46: stopping tablet replica
I20260709 13:24:05.099793  5625 raft_consensus.cc:2243] T 3c97f32b7fa24e109d2c993bee4cacdc P 316e9983905848079a8e6d9ce5585f46 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:24:05.100605  5625 raft_consensus.cc:2272] T 3c97f32b7fa24e109d2c993bee4cacdc P 316e9983905848079a8e6d9ce5585f46 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:24:05.102648  5625 tablet_replica.cc:333] T 62c32fd6e3f74f3b817349f92a686d3c P 316e9983905848079a8e6d9ce5585f46: stopping tablet replica
I20260709 13:24:05.103147  5625 raft_consensus.cc:2243] T 62c32fd6e3f74f3b817349f92a686d3c P 316e9983905848079a8e6d9ce5585f46 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:24:05.103554  5625 raft_consensus.cc:2272] T 62c32fd6e3f74f3b817349f92a686d3c P 316e9983905848079a8e6d9ce5585f46 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:24:05.105484  5625 tablet_replica.cc:333] T d87dace41fef4526a2cace8a5007919f P 316e9983905848079a8e6d9ce5585f46: stopping tablet replica
I20260709 13:24:05.105981  5625 raft_consensus.cc:2243] T d87dace41fef4526a2cace8a5007919f P 316e9983905848079a8e6d9ce5585f46 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:24:05.106839  5625 raft_consensus.cc:2272] T d87dace41fef4526a2cace8a5007919f P 316e9983905848079a8e6d9ce5585f46 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:24:05.108958  5625 tablet_replica.cc:333] T c2dd9bbf84cd4a0f918afc3a6e9f9d04 P 316e9983905848079a8e6d9ce5585f46: stopping tablet replica
I20260709 13:24:05.109496  5625 raft_consensus.cc:2243] T c2dd9bbf84cd4a0f918afc3a6e9f9d04 P 316e9983905848079a8e6d9ce5585f46 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:24:05.110342  5625 raft_consensus.cc:2272] T c2dd9bbf84cd4a0f918afc3a6e9f9d04 P 316e9983905848079a8e6d9ce5585f46 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:24:05.112401  5625 tablet_replica.cc:333] T 9d069857fc89437daad3f116d0fc7709 P 316e9983905848079a8e6d9ce5585f46: stopping tablet replica
I20260709 13:24:05.112874  5625 raft_consensus.cc:2243] T 9d069857fc89437daad3f116d0fc7709 P 316e9983905848079a8e6d9ce5585f46 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:24:05.113225  5625 raft_consensus.cc:2272] T 9d069857fc89437daad3f116d0fc7709 P 316e9983905848079a8e6d9ce5585f46 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:24:05.114990  5625 tablet_replica.cc:333] T d77e2380b35e4438a224b5148ebc574d P 316e9983905848079a8e6d9ce5585f46: stopping tablet replica
I20260709 13:24:05.115453  5625 raft_consensus.cc:2243] T d77e2380b35e4438a224b5148ebc574d P 316e9983905848079a8e6d9ce5585f46 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:24:05.116168  5625 raft_consensus.cc:2272] T d77e2380b35e4438a224b5148ebc574d P 316e9983905848079a8e6d9ce5585f46 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:24:05.118116  5625 tablet_replica.cc:333] T a71f35e6480646cba674fd6925e001ed P 316e9983905848079a8e6d9ce5585f46: stopping tablet replica
I20260709 13:24:05.118827  5625 raft_consensus.cc:2243] T a71f35e6480646cba674fd6925e001ed P 316e9983905848079a8e6d9ce5585f46 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:24:05.119244  5625 raft_consensus.cc:2272] T a71f35e6480646cba674fd6925e001ed P 316e9983905848079a8e6d9ce5585f46 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:24:05.121202  5625 tablet_replica.cc:333] T 711feb7b7a864c1d98dfd62c10eb0f99 P 316e9983905848079a8e6d9ce5585f46: stopping tablet replica
I20260709 13:24:05.121662  5625 raft_consensus.cc:2243] T 711feb7b7a864c1d98dfd62c10eb0f99 P 316e9983905848079a8e6d9ce5585f46 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:24:05.122035  5625 raft_consensus.cc:2272] T 711feb7b7a864c1d98dfd62c10eb0f99 P 316e9983905848079a8e6d9ce5585f46 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:24:05.123808  5625 tablet_replica.cc:333] T a01b9563aeb3401dbc60ad1647424d67 P 316e9983905848079a8e6d9ce5585f46: stopping tablet replica
I20260709 13:24:05.124449  5625 raft_consensus.cc:2243] T a01b9563aeb3401dbc60ad1647424d67 P 316e9983905848079a8e6d9ce5585f46 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:24:05.124845  5625 raft_consensus.cc:2272] T a01b9563aeb3401dbc60ad1647424d67 P 316e9983905848079a8e6d9ce5585f46 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:24:05.126674  5625 tablet_replica.cc:333] T d137c22ac67145ae96eedb776127de6f P 316e9983905848079a8e6d9ce5585f46: stopping tablet replica
I20260709 13:24:05.127136  5625 raft_consensus.cc:2243] T d137c22ac67145ae96eedb776127de6f P 316e9983905848079a8e6d9ce5585f46 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:24:05.127507  5625 raft_consensus.cc:2272] T d137c22ac67145ae96eedb776127de6f P 316e9983905848079a8e6d9ce5585f46 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:24:05.129436  5625 tablet_replica.cc:333] T 0544fe20b9ca44b18589408ea98f4eed P 316e9983905848079a8e6d9ce5585f46: stopping tablet replica
I20260709 13:24:05.129906  5625 raft_consensus.cc:2243] T 0544fe20b9ca44b18589408ea98f4eed P 316e9983905848079a8e6d9ce5585f46 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:24:05.130280  5625 raft_consensus.cc:2272] T 0544fe20b9ca44b18589408ea98f4eed P 316e9983905848079a8e6d9ce5585f46 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:24:05.132196  5625 tablet_replica.cc:333] T a3211f7bc1aa4d949b49f0c23362b0d5 P 316e9983905848079a8e6d9ce5585f46: stopping tablet replica
I20260709 13:24:05.132596  5625 raft_consensus.cc:2243] T a3211f7bc1aa4d949b49f0c23362b0d5 P 316e9983905848079a8e6d9ce5585f46 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:24:05.132992  5625 raft_consensus.cc:2272] T a3211f7bc1aa4d949b49f0c23362b0d5 P 316e9983905848079a8e6d9ce5585f46 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:24:05.140262 17379 consensus_peers.cc:597] T 743cee0b3a8241dfae72c033dc3d776e P ee69eea1a5cc4645acdd4deaa9e0ac7f -> Peer 726d96e241134d7e9e1851f2cee66d03 (127.5.126.65:45087): Couldn't send request to peer 726d96e241134d7e9e1851f2cee66d03. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:45087: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:24:05.176842  5625 tablet_server.cc:196] TabletServer@127.5.126.66:0 shutdown complete.
W20260709 13:24:05.188333 17376 consensus_peers.cc:597] T 54bab860b0384e1bb5e75b8c8594e4a0 P ee69eea1a5cc4645acdd4deaa9e0ac7f -> Peer 316e9983905848079a8e6d9ce5585f46 (127.5.126.66:39729): Couldn't send request to peer 316e9983905848079a8e6d9ce5585f46. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.66:39729: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:24:05.194741 17379 consensus_peers.cc:597] T a01b9563aeb3401dbc60ad1647424d67 P ee69eea1a5cc4645acdd4deaa9e0ac7f -> Peer 726d96e241134d7e9e1851f2cee66d03 (127.5.126.65:45087): Couldn't send request to peer 726d96e241134d7e9e1851f2cee66d03. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:45087: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:24:05.199823 17376 consensus_peers.cc:597] T a01b9563aeb3401dbc60ad1647424d67 P ee69eea1a5cc4645acdd4deaa9e0ac7f -> Peer 316e9983905848079a8e6d9ce5585f46 (127.5.126.66:39729): Couldn't send request to peer 316e9983905848079a8e6d9ce5585f46. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.66:39729: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:24:05.203255 17376 consensus_peers.cc:597] T 86979013624c4c96843236a7e7f8a1ec P ee69eea1a5cc4645acdd4deaa9e0ac7f -> Peer 316e9983905848079a8e6d9ce5585f46 (127.5.126.66:39729): Couldn't send request to peer 316e9983905848079a8e6d9ce5585f46. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.66:39729: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:24:05.229429  5625 tablet_server.cc:179] TabletServer@127.5.126.67:0 shutting down...
I20260709 13:24:05.269313  5625 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:24:05.270161  5625 tablet_replica.cc:333] T 86979013624c4c96843236a7e7f8a1ec P ee69eea1a5cc4645acdd4deaa9e0ac7f: stopping tablet replica
I20260709 13:24:05.270835  5625 raft_consensus.cc:2243] T 86979013624c4c96843236a7e7f8a1ec P ee69eea1a5cc4645acdd4deaa9e0ac7f [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:24:05.271665  5625 raft_consensus.cc:2272] T 86979013624c4c96843236a7e7f8a1ec P ee69eea1a5cc4645acdd4deaa9e0ac7f [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:24:05.273761  5625 tablet_replica.cc:333] T 27c47c73807f4c7c9535c0873d016f62 P ee69eea1a5cc4645acdd4deaa9e0ac7f: stopping tablet replica
I20260709 13:24:05.274343  5625 raft_consensus.cc:2243] T 27c47c73807f4c7c9535c0873d016f62 P ee69eea1a5cc4645acdd4deaa9e0ac7f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:24:05.274852  5625 raft_consensus.cc:2272] T 27c47c73807f4c7c9535c0873d016f62 P ee69eea1a5cc4645acdd4deaa9e0ac7f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:24:05.276858  5625 tablet_replica.cc:333] T 743cee0b3a8241dfae72c033dc3d776e P ee69eea1a5cc4645acdd4deaa9e0ac7f: stopping tablet replica
I20260709 13:24:05.277400  5625 raft_consensus.cc:2243] T 743cee0b3a8241dfae72c033dc3d776e P ee69eea1a5cc4645acdd4deaa9e0ac7f [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:24:05.278156  5625 raft_consensus.cc:2272] T 743cee0b3a8241dfae72c033dc3d776e P ee69eea1a5cc4645acdd4deaa9e0ac7f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:24:05.280098  5625 tablet_replica.cc:333] T eb3f366f79ef4b2894bc2dbf6eb14794 P ee69eea1a5cc4645acdd4deaa9e0ac7f: stopping tablet replica
I20260709 13:24:05.280665  5625 raft_consensus.cc:2243] T eb3f366f79ef4b2894bc2dbf6eb14794 P ee69eea1a5cc4645acdd4deaa9e0ac7f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:24:05.281101  5625 raft_consensus.cc:2272] T eb3f366f79ef4b2894bc2dbf6eb14794 P ee69eea1a5cc4645acdd4deaa9e0ac7f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:24:05.282914  5625 tablet_replica.cc:333] T 62c32fd6e3f74f3b817349f92a686d3c P ee69eea1a5cc4645acdd4deaa9e0ac7f: stopping tablet replica
I20260709 13:24:05.283457  5625 raft_consensus.cc:2243] T 62c32fd6e3f74f3b817349f92a686d3c P ee69eea1a5cc4645acdd4deaa9e0ac7f [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:24:05.284287  5625 raft_consensus.cc:2272] T 62c32fd6e3f74f3b817349f92a686d3c P ee69eea1a5cc4645acdd4deaa9e0ac7f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:24:05.286170  5625 tablet_replica.cc:333] T d77e2380b35e4438a224b5148ebc574d P ee69eea1a5cc4645acdd4deaa9e0ac7f: stopping tablet replica
I20260709 13:24:05.286742  5625 raft_consensus.cc:2243] T d77e2380b35e4438a224b5148ebc574d P ee69eea1a5cc4645acdd4deaa9e0ac7f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:24:05.287192  5625 raft_consensus.cc:2272] T d77e2380b35e4438a224b5148ebc574d P ee69eea1a5cc4645acdd4deaa9e0ac7f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:24:05.289223  5625 tablet_replica.cc:333] T 711feb7b7a864c1d98dfd62c10eb0f99 P ee69eea1a5cc4645acdd4deaa9e0ac7f: stopping tablet replica
I20260709 13:24:05.289776  5625 raft_consensus.cc:2243] T 711feb7b7a864c1d98dfd62c10eb0f99 P ee69eea1a5cc4645acdd4deaa9e0ac7f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:24:05.290230  5625 raft_consensus.cc:2272] T 711feb7b7a864c1d98dfd62c10eb0f99 P ee69eea1a5cc4645acdd4deaa9e0ac7f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:24:05.292459  5625 tablet_replica.cc:333] T a01b9563aeb3401dbc60ad1647424d67 P ee69eea1a5cc4645acdd4deaa9e0ac7f: stopping tablet replica
I20260709 13:24:05.293041  5625 raft_consensus.cc:2243] T a01b9563aeb3401dbc60ad1647424d67 P ee69eea1a5cc4645acdd4deaa9e0ac7f [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:24:05.293816  5625 raft_consensus.cc:2272] T a01b9563aeb3401dbc60ad1647424d67 P ee69eea1a5cc4645acdd4deaa9e0ac7f [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:24:05.295869  5625 tablet_replica.cc:333] T a71f35e6480646cba674fd6925e001ed P ee69eea1a5cc4645acdd4deaa9e0ac7f: stopping tablet replica
I20260709 13:24:05.296463  5625 raft_consensus.cc:2243] T a71f35e6480646cba674fd6925e001ed P ee69eea1a5cc4645acdd4deaa9e0ac7f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:24:05.296923  5625 raft_consensus.cc:2272] T a71f35e6480646cba674fd6925e001ed P ee69eea1a5cc4645acdd4deaa9e0ac7f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:24:05.298872  5625 tablet_replica.cc:333] T d137c22ac67145ae96eedb776127de6f P ee69eea1a5cc4645acdd4deaa9e0ac7f: stopping tablet replica
I20260709 13:24:05.299417  5625 raft_consensus.cc:2243] T d137c22ac67145ae96eedb776127de6f P ee69eea1a5cc4645acdd4deaa9e0ac7f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:24:05.299863  5625 raft_consensus.cc:2272] T d137c22ac67145ae96eedb776127de6f P ee69eea1a5cc4645acdd4deaa9e0ac7f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:24:05.302110  5625 tablet_replica.cc:333] T 54bab860b0384e1bb5e75b8c8594e4a0 P ee69eea1a5cc4645acdd4deaa9e0ac7f: stopping tablet replica
I20260709 13:24:05.302647  5625 raft_consensus.cc:2243] T 54bab860b0384e1bb5e75b8c8594e4a0 P ee69eea1a5cc4645acdd4deaa9e0ac7f [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:24:05.303941  5625 raft_consensus.cc:2272] T 54bab860b0384e1bb5e75b8c8594e4a0 P ee69eea1a5cc4645acdd4deaa9e0ac7f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:24:05.306655  5625 tablet_replica.cc:333] T 62599e0920c34027b50cf62f7b652686 P ee69eea1a5cc4645acdd4deaa9e0ac7f: stopping tablet replica
I20260709 13:24:05.307399  5625 raft_consensus.cc:2243] T 62599e0920c34027b50cf62f7b652686 P ee69eea1a5cc4645acdd4deaa9e0ac7f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:24:05.307817  5625 raft_consensus.cc:2272] T 62599e0920c34027b50cf62f7b652686 P ee69eea1a5cc4645acdd4deaa9e0ac7f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:24:05.309823  5625 tablet_replica.cc:333] T 3c97f32b7fa24e109d2c993bee4cacdc P ee69eea1a5cc4645acdd4deaa9e0ac7f: stopping tablet replica
I20260709 13:24:05.310536  5625 raft_consensus.cc:2243] T 3c97f32b7fa24e109d2c993bee4cacdc P ee69eea1a5cc4645acdd4deaa9e0ac7f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:24:05.310932  5625 raft_consensus.cc:2272] T 3c97f32b7fa24e109d2c993bee4cacdc P ee69eea1a5cc4645acdd4deaa9e0ac7f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:24:05.313027  5625 tablet_replica.cc:333] T c2dd9bbf84cd4a0f918afc3a6e9f9d04 P ee69eea1a5cc4645acdd4deaa9e0ac7f: stopping tablet replica
I20260709 13:24:05.313488  5625 raft_consensus.cc:2243] T c2dd9bbf84cd4a0f918afc3a6e9f9d04 P ee69eea1a5cc4645acdd4deaa9e0ac7f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:24:05.313886  5625 raft_consensus.cc:2272] T c2dd9bbf84cd4a0f918afc3a6e9f9d04 P ee69eea1a5cc4645acdd4deaa9e0ac7f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:24:05.315815  5625 tablet_replica.cc:333] T 9d069857fc89437daad3f116d0fc7709 P ee69eea1a5cc4645acdd4deaa9e0ac7f: stopping tablet replica
I20260709 13:24:05.316350  5625 raft_consensus.cc:2243] T 9d069857fc89437daad3f116d0fc7709 P ee69eea1a5cc4645acdd4deaa9e0ac7f [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:24:05.317065  5625 raft_consensus.cc:2272] T 9d069857fc89437daad3f116d0fc7709 P ee69eea1a5cc4645acdd4deaa9e0ac7f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:24:05.319018  5625 tablet_replica.cc:333] T 0544fe20b9ca44b18589408ea98f4eed P ee69eea1a5cc4645acdd4deaa9e0ac7f: stopping tablet replica
I20260709 13:24:05.319453  5625 raft_consensus.cc:2243] T 0544fe20b9ca44b18589408ea98f4eed P ee69eea1a5cc4645acdd4deaa9e0ac7f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:24:05.319841  5625 raft_consensus.cc:2272] T 0544fe20b9ca44b18589408ea98f4eed P ee69eea1a5cc4645acdd4deaa9e0ac7f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:24:05.321916  5625 tablet_replica.cc:333] T a3211f7bc1aa4d949b49f0c23362b0d5 P ee69eea1a5cc4645acdd4deaa9e0ac7f: stopping tablet replica
I20260709 13:24:05.322347  5625 raft_consensus.cc:2243] T a3211f7bc1aa4d949b49f0c23362b0d5 P ee69eea1a5cc4645acdd4deaa9e0ac7f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:24:05.322737  5625 raft_consensus.cc:2272] T a3211f7bc1aa4d949b49f0c23362b0d5 P ee69eea1a5cc4645acdd4deaa9e0ac7f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:24:05.324862  5625 tablet_replica.cc:333] T d87dace41fef4526a2cace8a5007919f P ee69eea1a5cc4645acdd4deaa9e0ac7f: stopping tablet replica
I20260709 13:24:05.325265  5625 raft_consensus.cc:2243] T d87dace41fef4526a2cace8a5007919f P ee69eea1a5cc4645acdd4deaa9e0ac7f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:24:05.325635  5625 raft_consensus.cc:2272] T d87dace41fef4526a2cace8a5007919f P ee69eea1a5cc4645acdd4deaa9e0ac7f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:24:05.366509  5625 tablet_server.cc:196] TabletServer@127.5.126.67:0 shutdown complete.
I20260709 13:24:05.402251  5625 master.cc:562] Master@127.5.126.126:43033 shutting down...
I20260709 13:24:05.432760  5625 raft_consensus.cc:2243] T 00000000000000000000000000000000 P be89b8f07a33490391e9a842951e89b0 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:24:05.433463  5625 raft_consensus.cc:2272] T 00000000000000000000000000000000 P be89b8f07a33490391e9a842951e89b0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:24:05.433836  5625 tablet_replica.cc:333] T 00000000000000000000000000000000 P be89b8f07a33490391e9a842951e89b0: stopping tablet replica
I20260709 13:24:05.456852  5625 master.cc:584] Master@127.5.126.126:43033 shutdown complete.
[       OK ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/0 (13355 ms)
[ RUN      ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/1
I20260709 13:24:05.516176  5625 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.5.126.126:34991
I20260709 13:24:05.517683  5625 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:24:05.524719 17740 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:24:05.525013 17739 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:24:05.525748 17742 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:24:05.526923  5625 server_base.cc:1061] running on GCE node
I20260709 13:24:05.528003  5625 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:24:05.528266  5625 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:24:05.528462  5625 hybrid_clock.cc:648] HybridClock initialized: now 1783603445528425 us; error 0 us; skew 500 ppm
I20260709 13:24:05.529032  5625 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:24:05.531656  5625 webserver.cc:533] Webserver started at http://127.5.126.126:35189/ using document root <none> and password file <none>
I20260709 13:24:05.532217  5625 fs_manager.cc:362] Metadata directory not provided
I20260709 13:24:05.532410  5625 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:24:05.532735  5625 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:24:05.533981  5625 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskWHb0CB/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783603057096655-5625-0/minicluster-data/master-0-root/instance:
uuid: "8a2a317ebbd54be296802fc5b6fc3db4"
format_stamp: "Formatted at 2026-07-09 13:24:05 on dist-test-slave-smzk"
I20260709 13:24:05.538811  5625 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.002s	sys 0.004s
I20260709 13:24:05.542757 17747 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:24:05.543754  5625 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.000s	sys 0.002s
I20260709 13:24:05.544169  5625 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskWHb0CB/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783603057096655-5625-0/minicluster-data/master-0-root
uuid: "8a2a317ebbd54be296802fc5b6fc3db4"
format_stamp: "Formatted at 2026-07-09 13:24:05 on dist-test-slave-smzk"
I20260709 13:24:05.544512  5625 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWHb0CB/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783603057096655-5625-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskWHb0CB/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783603057096655-5625-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskWHb0CB/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783603057096655-5625-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:24:05.574862  5625 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:24:05.576534  5625 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:24:05.625532  5625 rpc_server.cc:307] RPC server started. Bound to: 127.5.126.126:34991
I20260709 13:24:05.625679 17798 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.5.126.126:34991 every 8 connection(s)
I20260709 13:24:05.630290 17799 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:24:05.641381 17799 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8a2a317ebbd54be296802fc5b6fc3db4: Bootstrap starting.
I20260709 13:24:05.646674 17799 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 8a2a317ebbd54be296802fc5b6fc3db4: Neither blocks nor log segments found. Creating new log.
I20260709 13:24:05.651559 17799 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8a2a317ebbd54be296802fc5b6fc3db4: No bootstrap required, opened a new log
I20260709 13:24:05.654135 17799 raft_consensus.cc:359] T 00000000000000000000000000000000 P 8a2a317ebbd54be296802fc5b6fc3db4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8a2a317ebbd54be296802fc5b6fc3db4" member_type: VOTER }
I20260709 13:24:05.654549 17799 raft_consensus.cc:385] T 00000000000000000000000000000000 P 8a2a317ebbd54be296802fc5b6fc3db4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:24:05.654860 17799 raft_consensus.cc:740] T 00000000000000000000000000000000 P 8a2a317ebbd54be296802fc5b6fc3db4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8a2a317ebbd54be296802fc5b6fc3db4, State: Initialized, Role: FOLLOWER
I20260709 13:24:05.655570 17799 consensus_queue.cc:260] T 00000000000000000000000000000000 P 8a2a317ebbd54be296802fc5b6fc3db4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8a2a317ebbd54be296802fc5b6fc3db4" member_type: VOTER }
I20260709 13:24:05.656080 17799 raft_consensus.cc:399] T 00000000000000000000000000000000 P 8a2a317ebbd54be296802fc5b6fc3db4 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:24:05.656383 17799 raft_consensus.cc:493] T 00000000000000000000000000000000 P 8a2a317ebbd54be296802fc5b6fc3db4 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:24:05.656721 17799 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 8a2a317ebbd54be296802fc5b6fc3db4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:24:05.662098 17799 raft_consensus.cc:515] T 00000000000000000000000000000000 P 8a2a317ebbd54be296802fc5b6fc3db4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8a2a317ebbd54be296802fc5b6fc3db4" member_type: VOTER }
I20260709 13:24:05.662708 17799 leader_election.cc:304] T 00000000000000000000000000000000 P 8a2a317ebbd54be296802fc5b6fc3db4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 8a2a317ebbd54be296802fc5b6fc3db4; no voters: 
I20260709 13:24:05.664168 17799 leader_election.cc:290] T 00000000000000000000000000000000 P 8a2a317ebbd54be296802fc5b6fc3db4 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:24:05.665053 17802 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 8a2a317ebbd54be296802fc5b6fc3db4 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:24:05.667325 17802 raft_consensus.cc:697] T 00000000000000000000000000000000 P 8a2a317ebbd54be296802fc5b6fc3db4 [term 1 LEADER]: Becoming Leader. State: Replica: 8a2a317ebbd54be296802fc5b6fc3db4, State: Running, Role: LEADER
I20260709 13:24:05.668231 17802 consensus_queue.cc:237] T 00000000000000000000000000000000 P 8a2a317ebbd54be296802fc5b6fc3db4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8a2a317ebbd54be296802fc5b6fc3db4" member_type: VOTER }
I20260709 13:24:05.668370 17799 sys_catalog.cc:565] T 00000000000000000000000000000000 P 8a2a317ebbd54be296802fc5b6fc3db4 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:24:05.673287 17803 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8a2a317ebbd54be296802fc5b6fc3db4 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "8a2a317ebbd54be296802fc5b6fc3db4" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8a2a317ebbd54be296802fc5b6fc3db4" member_type: VOTER } }
I20260709 13:24:05.674021 17803 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8a2a317ebbd54be296802fc5b6fc3db4 [sys.catalog]: This master's current role is: LEADER
I20260709 13:24:05.675441 17804 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8a2a317ebbd54be296802fc5b6fc3db4 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 8a2a317ebbd54be296802fc5b6fc3db4. Latest consensus state: current_term: 1 leader_uuid: "8a2a317ebbd54be296802fc5b6fc3db4" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8a2a317ebbd54be296802fc5b6fc3db4" member_type: VOTER } }
I20260709 13:24:05.676108 17804 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8a2a317ebbd54be296802fc5b6fc3db4 [sys.catalog]: This master's current role is: LEADER
I20260709 13:24:05.680171 17809 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:24:05.687704 17809 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:24:05.688941  5625 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:24:05.698662 17809 catalog_manager.cc:1383] Generated new cluster ID: eae3c646b1cb4be785d97ade2772d3a9
I20260709 13:24:05.699103 17809 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:24:05.751093 17809 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:24:05.752532 17809 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:24:05.771983 17809 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 8a2a317ebbd54be296802fc5b6fc3db4: Generated new TSK 0
I20260709 13:24:05.772663 17809 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:24:05.821165  5625 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:24:05.828111 17820 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:24:05.829181 17821 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:24:05.837471  5625 server_base.cc:1061] running on GCE node
W20260709 13:24:05.837656 17823 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:24:05.838900  5625 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:24:05.839097  5625 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:24:05.839228  5625 hybrid_clock.cc:648] HybridClock initialized: now 1783603445839217 us; error 0 us; skew 500 ppm
I20260709 13:24:05.839706  5625 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:24:05.842171  5625 webserver.cc:533] Webserver started at http://127.5.126.65:40607/ using document root <none> and password file <none>
I20260709 13:24:05.842617  5625 fs_manager.cc:362] Metadata directory not provided
I20260709 13:24:05.842773  5625 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:24:05.842998  5625 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:24:05.844225  5625 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskWHb0CB/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783603057096655-5625-0/minicluster-data/ts-0-root/instance:
uuid: "f62ce053d68f4a868fa48f951d56da1a"
format_stamp: "Formatted at 2026-07-09 13:24:05 on dist-test-slave-smzk"
I20260709 13:24:05.848928  5625 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.003s	sys 0.001s
I20260709 13:24:05.852662 17828 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:24:05.853641  5625 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.001s
I20260709 13:24:05.854022  5625 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskWHb0CB/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783603057096655-5625-0/minicluster-data/ts-0-root
uuid: "f62ce053d68f4a868fa48f951d56da1a"
format_stamp: "Formatted at 2026-07-09 13:24:05 on dist-test-slave-smzk"
I20260709 13:24:05.854344  5625 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWHb0CB/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783603057096655-5625-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskWHb0CB/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783603057096655-5625-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskWHb0CB/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783603057096655-5625-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:24:05.897871  5625 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:24:05.899173  5625 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:24:05.900976  5625 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:24:05.903373  5625 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:24:05.903559  5625 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:24:05.903841  5625 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:24:05.904027  5625 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:24:05.950927  5625 rpc_server.cc:307] RPC server started. Bound to: 127.5.126.65:33029
I20260709 13:24:05.951109 17890 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.5.126.65:33029 every 8 connection(s)
I20260709 13:24:05.956207  5625 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:24:05.964668 17895 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:24:05.966038 17896 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:24:05.968695  5625 server_base.cc:1061] running on GCE node
W20260709 13:24:05.969285 17898 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:24:05.970953  5625 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:24:05.971225  5625 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:24:05.971431  5625 hybrid_clock.cc:648] HybridClock initialized: now 1783603445971414 us; error 0 us; skew 500 ppm
I20260709 13:24:05.972106  5625 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:24:05.973428 17891 heartbeater.cc:344] Connected to a master server at 127.5.126.126:34991
I20260709 13:24:05.973938 17891 heartbeater.cc:461] Registering TS with master...
I20260709 13:24:05.974742 17891 heartbeater.cc:507] Master 127.5.126.126:34991 requested a full tablet report, sending...
I20260709 13:24:05.975186  5625 webserver.cc:533] Webserver started at http://127.5.126.66:41369/ using document root <none> and password file <none>
I20260709 13:24:05.975871  5625 fs_manager.cc:362] Metadata directory not provided
I20260709 13:24:05.976195  5625 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:24:05.976584  5625 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:24:05.978040 17764 ts_manager.cc:194] Registered new tserver with Master: f62ce053d68f4a868fa48f951d56da1a (127.5.126.65:33029)
I20260709 13:24:05.978657  5625 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskWHb0CB/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783603057096655-5625-0/minicluster-data/ts-1-root/instance:
uuid: "93881c5b9b0648248e627ef7b541aec4"
format_stamp: "Formatted at 2026-07-09 13:24:05 on dist-test-slave-smzk"
I20260709 13:24:05.981227 17764 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:35382
I20260709 13:24:05.985824  5625 fs_manager.cc:696] Time spent creating directory manager: real 0.006s	user 0.005s	sys 0.004s
I20260709 13:24:05.990337 17903 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:24:05.991372  5625 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.000s
I20260709 13:24:05.991734  5625 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskWHb0CB/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783603057096655-5625-0/minicluster-data/ts-1-root
uuid: "93881c5b9b0648248e627ef7b541aec4"
format_stamp: "Formatted at 2026-07-09 13:24:05 on dist-test-slave-smzk"
I20260709 13:24:05.992079  5625 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWHb0CB/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783603057096655-5625-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskWHb0CB/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783603057096655-5625-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskWHb0CB/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783603057096655-5625-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:24:06.006448  5625 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:24:06.007869  5625 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:24:06.009642  5625 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:24:06.012337  5625 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:24:06.012575  5625 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:24:06.012871  5625 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:24:06.013123  5625 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:24:06.063608  5625 rpc_server.cc:307] RPC server started. Bound to: 127.5.126.66:44419
I20260709 13:24:06.063776 17965 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.5.126.66:44419 every 8 connection(s)
I20260709 13:24:06.069283  5625 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:24:06.077934 17969 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:24:06.079419 17970 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:24:06.081202  5625 server_base.cc:1061] running on GCE node
W20260709 13:24:06.083581 17972 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:24:06.084328 17966 heartbeater.cc:344] Connected to a master server at 127.5.126.126:34991
I20260709 13:24:06.084828 17966 heartbeater.cc:461] Registering TS with master...
I20260709 13:24:06.084916  5625 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:24:06.085253  5625 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:24:06.085448  5625 hybrid_clock.cc:648] HybridClock initialized: now 1783603446085421 us; error 0 us; skew 500 ppm
I20260709 13:24:06.085739 17966 heartbeater.cc:507] Master 127.5.126.126:34991 requested a full tablet report, sending...
I20260709 13:24:06.086171  5625 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:24:06.088403 17764 ts_manager.cc:194] Registered new tserver with Master: 93881c5b9b0648248e627ef7b541aec4 (127.5.126.66:44419)
I20260709 13:24:06.089563  5625 webserver.cc:533] Webserver started at http://127.5.126.67:40355/ using document root <none> and password file <none>
I20260709 13:24:06.090330  5625 fs_manager.cc:362] Metadata directory not provided
I20260709 13:24:06.090584  5625 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:24:06.090606 17764 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:35390
I20260709 13:24:06.091107  5625 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:24:06.092549  5625 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskWHb0CB/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783603057096655-5625-0/minicluster-data/ts-2-root/instance:
uuid: "5b2c1cd5f367458e811c859b7dbca333"
format_stamp: "Formatted at 2026-07-09 13:24:06 on dist-test-slave-smzk"
I20260709 13:24:06.097389  5625 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.000s
I20260709 13:24:06.100977 17977 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:24:06.102016  5625 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20260709 13:24:06.102334  5625 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskWHb0CB/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783603057096655-5625-0/minicluster-data/ts-2-root
uuid: "5b2c1cd5f367458e811c859b7dbca333"
format_stamp: "Formatted at 2026-07-09 13:24:06 on dist-test-slave-smzk"
I20260709 13:24:06.102640  5625 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWHb0CB/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783603057096655-5625-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskWHb0CB/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783603057096655-5625-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskWHb0CB/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783603057096655-5625-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:24:06.128264  5625 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:24:06.129633  5625 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:24:06.131397  5625 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:24:06.133963  5625 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:24:06.134197  5625 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:24:06.134456  5625 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:24:06.134632  5625 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:24:06.183518  5625 rpc_server.cc:307] RPC server started. Bound to: 127.5.126.67:40055
I20260709 13:24:06.183647 18039 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.5.126.67:40055 every 8 connection(s)
I20260709 13:24:06.199618 18040 heartbeater.cc:344] Connected to a master server at 127.5.126.126:34991
I20260709 13:24:06.200311 18040 heartbeater.cc:461] Registering TS with master...
I20260709 13:24:06.201284 18040 heartbeater.cc:507] Master 127.5.126.126:34991 requested a full tablet report, sending...
I20260709 13:24:06.204104 17764 ts_manager.cc:194] Registered new tserver with Master: 5b2c1cd5f367458e811c859b7dbca333 (127.5.126.67:40055)
I20260709 13:24:06.204576  5625 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.017637868s
I20260709 13:24:06.206005 17764 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:35404
I20260709 13:24:06.234344 17764 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:35420:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:24:06.237435 17764 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:24:06.314893 18005 tablet_service.cc:1511] Processing CreateTablet for tablet d3bd24e790d3483185e9f89c8521831b (DEFAULT_TABLE table=test-workload [id=fa78faf5f875440eb6c314df8e33a5f6]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:24:06.316274 17931 tablet_service.cc:1511] Processing CreateTablet for tablet d3bd24e790d3483185e9f89c8521831b (DEFAULT_TABLE table=test-workload [id=fa78faf5f875440eb6c314df8e33a5f6]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:24:06.314896 18004 tablet_service.cc:1511] Processing CreateTablet for tablet 9783d21b38744e0b8565b96be6c3ca80 (DEFAULT_TABLE table=test-workload [id=fa78faf5f875440eb6c314df8e33a5f6]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:24:06.318231 17931 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d3bd24e790d3483185e9f89c8521831b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:24:06.316782 18005 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d3bd24e790d3483185e9f89c8521831b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:24:06.321372 17930 tablet_service.cc:1511] Processing CreateTablet for tablet 9783d21b38744e0b8565b96be6c3ca80 (DEFAULT_TABLE table=test-workload [id=fa78faf5f875440eb6c314df8e33a5f6]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:24:06.322940 17930 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9783d21b38744e0b8565b96be6c3ca80. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:24:06.324275 18004 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9783d21b38744e0b8565b96be6c3ca80. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:24:06.330680 18003 tablet_service.cc:1511] Processing CreateTablet for tablet 274de930fd3e48b0a4a446dfeedcff85 (DEFAULT_TABLE table=test-workload [id=fa78faf5f875440eb6c314df8e33a5f6]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:24:06.331728 17929 tablet_service.cc:1511] Processing CreateTablet for tablet 274de930fd3e48b0a4a446dfeedcff85 (DEFAULT_TABLE table=test-workload [id=fa78faf5f875440eb6c314df8e33a5f6]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:24:06.332428 17853 tablet_service.cc:1511] Processing CreateTablet for tablet e472f595f87a4a749248c7b7812b33d0 (DEFAULT_TABLE table=test-workload [id=fa78faf5f875440eb6c314df8e33a5f6]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:24:06.333508 17929 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 274de930fd3e48b0a4a446dfeedcff85. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:24:06.333742 17856 tablet_service.cc:1511] Processing CreateTablet for tablet d3bd24e790d3483185e9f89c8521831b (DEFAULT_TABLE table=test-workload [id=fa78faf5f875440eb6c314df8e33a5f6]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:24:06.335652 17852 tablet_service.cc:1511] Processing CreateTablet for tablet 66404f05eae74a7f938e85e5eae5cf72 (DEFAULT_TABLE table=test-workload [id=fa78faf5f875440eb6c314df8e33a5f6]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:24:06.336189 17855 tablet_service.cc:1511] Processing CreateTablet for tablet 9783d21b38744e0b8565b96be6c3ca80 (DEFAULT_TABLE table=test-workload [id=fa78faf5f875440eb6c314df8e33a5f6]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:24:06.337424 17928 tablet_service.cc:1511] Processing CreateTablet for tablet e472f595f87a4a749248c7b7812b33d0 (DEFAULT_TABLE table=test-workload [id=fa78faf5f875440eb6c314df8e33a5f6]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:24:06.338532 17854 tablet_service.cc:1511] Processing CreateTablet for tablet 274de930fd3e48b0a4a446dfeedcff85 (DEFAULT_TABLE table=test-workload [id=fa78faf5f875440eb6c314df8e33a5f6]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:24:06.339006 17928 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e472f595f87a4a749248c7b7812b33d0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:24:06.341539 18002 tablet_service.cc:1511] Processing CreateTablet for tablet e472f595f87a4a749248c7b7812b33d0 (DEFAULT_TABLE table=test-workload [id=fa78faf5f875440eb6c314df8e33a5f6]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:24:06.332453 18003 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 274de930fd3e48b0a4a446dfeedcff85. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:24:06.342478 17927 tablet_service.cc:1511] Processing CreateTablet for tablet 66404f05eae74a7f938e85e5eae5cf72 (DEFAULT_TABLE table=test-workload [id=fa78faf5f875440eb6c314df8e33a5f6]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:24:06.344931 17927 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 66404f05eae74a7f938e85e5eae5cf72. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:24:06.348531 18002 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e472f595f87a4a749248c7b7812b33d0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:24:06.334163 17853 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e472f595f87a4a749248c7b7812b33d0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:24:06.350878 17851 tablet_service.cc:1511] Processing CreateTablet for tablet 477afb2899ff459caf4d0eb55e840010 (DEFAULT_TABLE table=test-workload [id=fa78faf5f875440eb6c314df8e33a5f6]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:24:06.351095 18001 tablet_service.cc:1511] Processing CreateTablet for tablet 66404f05eae74a7f938e85e5eae5cf72 (DEFAULT_TABLE table=test-workload [id=fa78faf5f875440eb6c314df8e33a5f6]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:24:06.352394 17856 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d3bd24e790d3483185e9f89c8521831b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:24:06.357446 17852 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 66404f05eae74a7f938e85e5eae5cf72. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:24:06.353660 18001 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 66404f05eae74a7f938e85e5eae5cf72. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:24:06.360555 17855 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9783d21b38744e0b8565b96be6c3ca80. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:24:06.361670 17854 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 274de930fd3e48b0a4a446dfeedcff85. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:24:06.362725 17851 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 477afb2899ff459caf4d0eb55e840010. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:24:06.388422 17926 tablet_service.cc:1511] Processing CreateTablet for tablet 477afb2899ff459caf4d0eb55e840010 (DEFAULT_TABLE table=test-workload [id=fa78faf5f875440eb6c314df8e33a5f6]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:24:06.389914 17926 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 477afb2899ff459caf4d0eb55e840010. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:24:06.393620 18055 tablet_bootstrap.cc:492] T d3bd24e790d3483185e9f89c8521831b P 5b2c1cd5f367458e811c859b7dbca333: Bootstrap starting.
I20260709 13:24:06.410897 18002 tablet_service.cc:1511] Processing CreateTablet for tablet 477afb2899ff459caf4d0eb55e840010 (DEFAULT_TABLE table=test-workload [id=fa78faf5f875440eb6c314df8e33a5f6]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:24:06.411957 17850 tablet_service.cc:1511] Processing CreateTablet for tablet b8a4f81761e3423fa8d2e3144b6b4ca8 (DEFAULT_TABLE table=test-workload [id=fa78faf5f875440eb6c314df8e33a5f6]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:24:06.413586 17850 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b8a4f81761e3423fa8d2e3144b6b4ca8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:24:06.420747 18002 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 477afb2899ff459caf4d0eb55e840010. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:24:06.422343 18055 tablet_bootstrap.cc:654] T d3bd24e790d3483185e9f89c8521831b P 5b2c1cd5f367458e811c859b7dbca333: Neither blocks nor log segments found. Creating new log.
I20260709 13:24:06.431000 17928 tablet_service.cc:1511] Processing CreateTablet for tablet b8a4f81761e3423fa8d2e3144b6b4ca8 (DEFAULT_TABLE table=test-workload [id=fa78faf5f875440eb6c314df8e33a5f6]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:24:06.432718 17928 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b8a4f81761e3423fa8d2e3144b6b4ca8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:24:06.440739 18003 tablet_service.cc:1511] Processing CreateTablet for tablet b8a4f81761e3423fa8d2e3144b6b4ca8 (DEFAULT_TABLE table=test-workload [id=fa78faf5f875440eb6c314df8e33a5f6]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:24:06.448606 17931 tablet_service.cc:1511] Processing CreateTablet for tablet 98bdadc834134483b31be48f35123bbd (DEFAULT_TABLE table=test-workload [id=fa78faf5f875440eb6c314df8e33a5f6]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:24:06.450242 17931 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 98bdadc834134483b31be48f35123bbd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:24:06.451517 17855 tablet_service.cc:1511] Processing CreateTablet for tablet 98bdadc834134483b31be48f35123bbd (DEFAULT_TABLE table=test-workload [id=fa78faf5f875440eb6c314df8e33a5f6]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:24:06.455127 18003 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b8a4f81761e3423fa8d2e3144b6b4ca8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:24:06.457484 17855 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 98bdadc834134483b31be48f35123bbd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:24:06.469775 18057 tablet_bootstrap.cc:492] T d3bd24e790d3483185e9f89c8521831b P 93881c5b9b0648248e627ef7b541aec4: Bootstrap starting.
I20260709 13:24:06.479532 18056 tablet_bootstrap.cc:492] T e472f595f87a4a749248c7b7812b33d0 P f62ce053d68f4a868fa48f951d56da1a: Bootstrap starting.
I20260709 13:24:06.492992 18004 tablet_service.cc:1511] Processing CreateTablet for tablet 98bdadc834134483b31be48f35123bbd (DEFAULT_TABLE table=test-workload [id=fa78faf5f875440eb6c314df8e33a5f6]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:24:06.494458 18004 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 98bdadc834134483b31be48f35123bbd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:24:06.512149 17853 tablet_service.cc:1511] Processing CreateTablet for tablet 93f7e8af061940dd82364fa3c6e69825 (DEFAULT_TABLE table=test-workload [id=fa78faf5f875440eb6c314df8e33a5f6]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:24:06.514360 17853 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 93f7e8af061940dd82364fa3c6e69825. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:24:06.519935 18056 tablet_bootstrap.cc:654] T e472f595f87a4a749248c7b7812b33d0 P f62ce053d68f4a868fa48f951d56da1a: Neither blocks nor log segments found. Creating new log.
I20260709 13:24:06.520831 17928 tablet_service.cc:1511] Processing CreateTablet for tablet 93f7e8af061940dd82364fa3c6e69825 (DEFAULT_TABLE table=test-workload [id=fa78faf5f875440eb6c314df8e33a5f6]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:24:06.522150 17928 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 93f7e8af061940dd82364fa3c6e69825. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:24:06.524369 18057 tablet_bootstrap.cc:654] T d3bd24e790d3483185e9f89c8521831b P 93881c5b9b0648248e627ef7b541aec4: Neither blocks nor log segments found. Creating new log.
I20260709 13:24:06.524011 18004 tablet_service.cc:1511] Processing CreateTablet for tablet 93f7e8af061940dd82364fa3c6e69825 (DEFAULT_TABLE table=test-workload [id=fa78faf5f875440eb6c314df8e33a5f6]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:24:06.532967 18056 tablet_bootstrap.cc:492] T e472f595f87a4a749248c7b7812b33d0 P f62ce053d68f4a868fa48f951d56da1a: No bootstrap required, opened a new log
I20260709 13:24:06.533535 18056 ts_tablet_manager.cc:1403] T e472f595f87a4a749248c7b7812b33d0 P f62ce053d68f4a868fa48f951d56da1a: Time spent bootstrapping tablet: real 0.054s	user 0.006s	sys 0.007s
I20260709 13:24:06.533890 18055 tablet_bootstrap.cc:492] T d3bd24e790d3483185e9f89c8521831b P 5b2c1cd5f367458e811c859b7dbca333: No bootstrap required, opened a new log
I20260709 13:24:06.534157 18004 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 93f7e8af061940dd82364fa3c6e69825. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:24:06.534566 18055 ts_tablet_manager.cc:1403] T d3bd24e790d3483185e9f89c8521831b P 5b2c1cd5f367458e811c859b7dbca333: Time spent bootstrapping tablet: real 0.141s	user 0.029s	sys 0.031s
I20260709 13:24:06.538082 18055 raft_consensus.cc:359] T d3bd24e790d3483185e9f89c8521831b P 5b2c1cd5f367458e811c859b7dbca333 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b2c1cd5f367458e811c859b7dbca333" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 40055 } } peers { permanent_uuid: "93881c5b9b0648248e627ef7b541aec4" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 44419 } } peers { permanent_uuid: "f62ce053d68f4a868fa48f951d56da1a" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 33029 } }
I20260709 13:24:06.538820 18055 raft_consensus.cc:385] T d3bd24e790d3483185e9f89c8521831b P 5b2c1cd5f367458e811c859b7dbca333 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:24:06.538847 18057 tablet_bootstrap.cc:492] T d3bd24e790d3483185e9f89c8521831b P 93881c5b9b0648248e627ef7b541aec4: No bootstrap required, opened a new log
I20260709 13:24:06.539189 18055 raft_consensus.cc:740] T d3bd24e790d3483185e9f89c8521831b P 5b2c1cd5f367458e811c859b7dbca333 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5b2c1cd5f367458e811c859b7dbca333, State: Initialized, Role: FOLLOWER
I20260709 13:24:06.539536 18057 ts_tablet_manager.cc:1403] T d3bd24e790d3483185e9f89c8521831b P 93881c5b9b0648248e627ef7b541aec4: Time spent bootstrapping tablet: real 0.070s	user 0.012s	sys 0.000s
I20260709 13:24:06.542748 18057 raft_consensus.cc:359] T d3bd24e790d3483185e9f89c8521831b P 93881c5b9b0648248e627ef7b541aec4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b2c1cd5f367458e811c859b7dbca333" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 40055 } } peers { permanent_uuid: "93881c5b9b0648248e627ef7b541aec4" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 44419 } } peers { permanent_uuid: "f62ce053d68f4a868fa48f951d56da1a" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 33029 } }
I20260709 13:24:06.543476 18057 raft_consensus.cc:385] T d3bd24e790d3483185e9f89c8521831b P 93881c5b9b0648248e627ef7b541aec4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:24:06.543771 18057 raft_consensus.cc:740] T d3bd24e790d3483185e9f89c8521831b P 93881c5b9b0648248e627ef7b541aec4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 93881c5b9b0648248e627ef7b541aec4, State: Initialized, Role: FOLLOWER
I20260709 13:24:06.545259 18056 raft_consensus.cc:359] T e472f595f87a4a749248c7b7812b33d0 P f62ce053d68f4a868fa48f951d56da1a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f62ce053d68f4a868fa48f951d56da1a" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 33029 } } peers { permanent_uuid: "93881c5b9b0648248e627ef7b541aec4" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 44419 } } peers { permanent_uuid: "5b2c1cd5f367458e811c859b7dbca333" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 40055 } }
I20260709 13:24:06.545949 18056 raft_consensus.cc:385] T e472f595f87a4a749248c7b7812b33d0 P f62ce053d68f4a868fa48f951d56da1a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:24:06.546648 18057 consensus_queue.cc:260] T d3bd24e790d3483185e9f89c8521831b P 93881c5b9b0648248e627ef7b541aec4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b2c1cd5f367458e811c859b7dbca333" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 40055 } } peers { permanent_uuid: "93881c5b9b0648248e627ef7b541aec4" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 44419 } } peers { permanent_uuid: "f62ce053d68f4a868fa48f951d56da1a" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 33029 } }
I20260709 13:24:06.546239 18056 raft_consensus.cc:740] T e472f595f87a4a749248c7b7812b33d0 P f62ce053d68f4a868fa48f951d56da1a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f62ce053d68f4a868fa48f951d56da1a, State: Initialized, Role: FOLLOWER
I20260709 13:24:06.549089 17966 heartbeater.cc:499] Master 127.5.126.126:34991 was elected leader, sending a full tablet report...
I20260709 13:24:06.552739 18057 ts_tablet_manager.cc:1434] T d3bd24e790d3483185e9f89c8521831b P 93881c5b9b0648248e627ef7b541aec4: Time spent starting tablet: real 0.013s	user 0.004s	sys 0.006s
I20260709 13:24:06.553795 18057 tablet_bootstrap.cc:492] T e472f595f87a4a749248c7b7812b33d0 P 93881c5b9b0648248e627ef7b541aec4: Bootstrap starting.
I20260709 13:24:06.555397 18055 consensus_queue.cc:260] T d3bd24e790d3483185e9f89c8521831b P 5b2c1cd5f367458e811c859b7dbca333 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b2c1cd5f367458e811c859b7dbca333" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 40055 } } peers { permanent_uuid: "93881c5b9b0648248e627ef7b541aec4" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 44419 } } peers { permanent_uuid: "f62ce053d68f4a868fa48f951d56da1a" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 33029 } }
I20260709 13:24:06.558890 18040 heartbeater.cc:499] Master 127.5.126.126:34991 was elected leader, sending a full tablet report...
I20260709 13:24:06.559444 18055 ts_tablet_manager.cc:1434] T d3bd24e790d3483185e9f89c8521831b P 5b2c1cd5f367458e811c859b7dbca333: Time spent starting tablet: real 0.025s	user 0.001s	sys 0.010s
I20260709 13:24:06.560679 18055 tablet_bootstrap.cc:492] T e472f595f87a4a749248c7b7812b33d0 P 5b2c1cd5f367458e811c859b7dbca333: Bootstrap starting.
I20260709 13:24:06.561139 18057 tablet_bootstrap.cc:654] T e472f595f87a4a749248c7b7812b33d0 P 93881c5b9b0648248e627ef7b541aec4: Neither blocks nor log segments found. Creating new log.
I20260709 13:24:06.565304 18056 consensus_queue.cc:260] T e472f595f87a4a749248c7b7812b33d0 P f62ce053d68f4a868fa48f951d56da1a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f62ce053d68f4a868fa48f951d56da1a" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 33029 } } peers { permanent_uuid: "93881c5b9b0648248e627ef7b541aec4" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 44419 } } peers { permanent_uuid: "5b2c1cd5f367458e811c859b7dbca333" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 40055 } }
I20260709 13:24:06.567786 18057 tablet_bootstrap.cc:492] T e472f595f87a4a749248c7b7812b33d0 P 93881c5b9b0648248e627ef7b541aec4: No bootstrap required, opened a new log
I20260709 13:24:06.567966 18055 tablet_bootstrap.cc:654] T e472f595f87a4a749248c7b7812b33d0 P 5b2c1cd5f367458e811c859b7dbca333: Neither blocks nor log segments found. Creating new log.
I20260709 13:24:06.568449 18057 ts_tablet_manager.cc:1403] T e472f595f87a4a749248c7b7812b33d0 P 93881c5b9b0648248e627ef7b541aec4: Time spent bootstrapping tablet: real 0.015s	user 0.011s	sys 0.002s
W20260709 13:24:06.569164 17967 tablet.cc:2406] T d3bd24e790d3483185e9f89c8521831b P 93881c5b9b0648248e627ef7b541aec4: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 13:24:06.569674 18056 ts_tablet_manager.cc:1434] T e472f595f87a4a749248c7b7812b33d0 P f62ce053d68f4a868fa48f951d56da1a: Time spent starting tablet: real 0.036s	user 0.007s	sys 0.003s
I20260709 13:24:06.570982 18056 tablet_bootstrap.cc:492] T 66404f05eae74a7f938e85e5eae5cf72 P f62ce053d68f4a868fa48f951d56da1a: Bootstrap starting.
I20260709 13:24:06.573163 17891 heartbeater.cc:499] Master 127.5.126.126:34991 was elected leader, sending a full tablet report...
I20260709 13:24:06.572086 18057 raft_consensus.cc:359] T e472f595f87a4a749248c7b7812b33d0 P 93881c5b9b0648248e627ef7b541aec4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f62ce053d68f4a868fa48f951d56da1a" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 33029 } } peers { permanent_uuid: "93881c5b9b0648248e627ef7b541aec4" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 44419 } } peers { permanent_uuid: "5b2c1cd5f367458e811c859b7dbca333" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 40055 } }
I20260709 13:24:06.573837 18057 raft_consensus.cc:385] T e472f595f87a4a749248c7b7812b33d0 P 93881c5b9b0648248e627ef7b541aec4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:24:06.574162 18057 raft_consensus.cc:740] T e472f595f87a4a749248c7b7812b33d0 P 93881c5b9b0648248e627ef7b541aec4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 93881c5b9b0648248e627ef7b541aec4, State: Initialized, Role: FOLLOWER
I20260709 13:24:06.574994 18057 consensus_queue.cc:260] T e472f595f87a4a749248c7b7812b33d0 P 93881c5b9b0648248e627ef7b541aec4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f62ce053d68f4a868fa48f951d56da1a" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 33029 } } peers { permanent_uuid: "93881c5b9b0648248e627ef7b541aec4" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 44419 } } peers { permanent_uuid: "5b2c1cd5f367458e811c859b7dbca333" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 40055 } }
I20260709 13:24:06.577181 18057 ts_tablet_manager.cc:1434] T e472f595f87a4a749248c7b7812b33d0 P 93881c5b9b0648248e627ef7b541aec4: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.001s
I20260709 13:24:06.578176 18057 tablet_bootstrap.cc:492] T 274de930fd3e48b0a4a446dfeedcff85 P 93881c5b9b0648248e627ef7b541aec4: Bootstrap starting.
I20260709 13:24:06.578613 18056 tablet_bootstrap.cc:654] T 66404f05eae74a7f938e85e5eae5cf72 P f62ce053d68f4a868fa48f951d56da1a: Neither blocks nor log segments found. Creating new log.
I20260709 13:24:06.584894 18056 tablet_bootstrap.cc:492] T 66404f05eae74a7f938e85e5eae5cf72 P f62ce053d68f4a868fa48f951d56da1a: No bootstrap required, opened a new log
I20260709 13:24:06.585408 18056 ts_tablet_manager.cc:1403] T 66404f05eae74a7f938e85e5eae5cf72 P f62ce053d68f4a868fa48f951d56da1a: Time spent bootstrapping tablet: real 0.015s	user 0.008s	sys 0.004s
I20260709 13:24:06.587702 18056 raft_consensus.cc:359] T 66404f05eae74a7f938e85e5eae5cf72 P f62ce053d68f4a868fa48f951d56da1a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f62ce053d68f4a868fa48f951d56da1a" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 33029 } } peers { permanent_uuid: "93881c5b9b0648248e627ef7b541aec4" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 44419 } } peers { permanent_uuid: "5b2c1cd5f367458e811c859b7dbca333" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 40055 } }
I20260709 13:24:06.588375 18056 raft_consensus.cc:385] T 66404f05eae74a7f938e85e5eae5cf72 P f62ce053d68f4a868fa48f951d56da1a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:24:06.588698 18056 raft_consensus.cc:740] T 66404f05eae74a7f938e85e5eae5cf72 P f62ce053d68f4a868fa48f951d56da1a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f62ce053d68f4a868fa48f951d56da1a, State: Initialized, Role: FOLLOWER
I20260709 13:24:06.589490 18056 consensus_queue.cc:260] T 66404f05eae74a7f938e85e5eae5cf72 P f62ce053d68f4a868fa48f951d56da1a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f62ce053d68f4a868fa48f951d56da1a" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 33029 } } peers { permanent_uuid: "93881c5b9b0648248e627ef7b541aec4" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 44419 } } peers { permanent_uuid: "5b2c1cd5f367458e811c859b7dbca333" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 40055 } }
I20260709 13:24:06.590063 18057 tablet_bootstrap.cc:654] T 274de930fd3e48b0a4a446dfeedcff85 P 93881c5b9b0648248e627ef7b541aec4: Neither blocks nor log segments found. Creating new log.
I20260709 13:24:06.592247 18056 ts_tablet_manager.cc:1434] T 66404f05eae74a7f938e85e5eae5cf72 P f62ce053d68f4a868fa48f951d56da1a: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:24:06.593441 18056 tablet_bootstrap.cc:492] T 9783d21b38744e0b8565b96be6c3ca80 P f62ce053d68f4a868fa48f951d56da1a: Bootstrap starting.
I20260709 13:24:06.602406 18056 tablet_bootstrap.cc:654] T 9783d21b38744e0b8565b96be6c3ca80 P f62ce053d68f4a868fa48f951d56da1a: Neither blocks nor log segments found. Creating new log.
I20260709 13:24:06.607735 18057 tablet_bootstrap.cc:492] T 274de930fd3e48b0a4a446dfeedcff85 P 93881c5b9b0648248e627ef7b541aec4: No bootstrap required, opened a new log
I20260709 13:24:06.608558 18057 ts_tablet_manager.cc:1403] T 274de930fd3e48b0a4a446dfeedcff85 P 93881c5b9b0648248e627ef7b541aec4: Time spent bootstrapping tablet: real 0.031s	user 0.017s	sys 0.008s
I20260709 13:24:06.612758 18057 raft_consensus.cc:359] T 274de930fd3e48b0a4a446dfeedcff85 P 93881c5b9b0648248e627ef7b541aec4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f62ce053d68f4a868fa48f951d56da1a" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 33029 } } peers { permanent_uuid: "93881c5b9b0648248e627ef7b541aec4" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 44419 } } peers { permanent_uuid: "5b2c1cd5f367458e811c859b7dbca333" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 40055 } }
I20260709 13:24:06.613770 18057 raft_consensus.cc:385] T 274de930fd3e48b0a4a446dfeedcff85 P 93881c5b9b0648248e627ef7b541aec4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:24:06.614130 18057 raft_consensus.cc:740] T 274de930fd3e48b0a4a446dfeedcff85 P 93881c5b9b0648248e627ef7b541aec4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 93881c5b9b0648248e627ef7b541aec4, State: Initialized, Role: FOLLOWER
I20260709 13:24:06.615346 18057 consensus_queue.cc:260] T 274de930fd3e48b0a4a446dfeedcff85 P 93881c5b9b0648248e627ef7b541aec4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f62ce053d68f4a868fa48f951d56da1a" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 33029 } } peers { permanent_uuid: "93881c5b9b0648248e627ef7b541aec4" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 44419 } } peers { permanent_uuid: "5b2c1cd5f367458e811c859b7dbca333" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 40055 } }
I20260709 13:24:06.621346 18057 ts_tablet_manager.cc:1434] T 274de930fd3e48b0a4a446dfeedcff85 P 93881c5b9b0648248e627ef7b541aec4: Time spent starting tablet: real 0.012s	user 0.008s	sys 0.000s
I20260709 13:24:06.622871 18057 tablet_bootstrap.cc:492] T 477afb2899ff459caf4d0eb55e840010 P 93881c5b9b0648248e627ef7b541aec4: Bootstrap starting.
I20260709 13:24:06.632725 18057 tablet_bootstrap.cc:654] T 477afb2899ff459caf4d0eb55e840010 P 93881c5b9b0648248e627ef7b541aec4: Neither blocks nor log segments found. Creating new log.
I20260709 13:24:06.657853 18055 tablet_bootstrap.cc:492] T e472f595f87a4a749248c7b7812b33d0 P 5b2c1cd5f367458e811c859b7dbca333: No bootstrap required, opened a new log
I20260709 13:24:06.658464 18055 ts_tablet_manager.cc:1403] T e472f595f87a4a749248c7b7812b33d0 P 5b2c1cd5f367458e811c859b7dbca333: Time spent bootstrapping tablet: real 0.098s	user 0.039s	sys 0.044s
I20260709 13:24:06.659616 18057 tablet_bootstrap.cc:492] T 477afb2899ff459caf4d0eb55e840010 P 93881c5b9b0648248e627ef7b541aec4: No bootstrap required, opened a new log
I20260709 13:24:06.660312 18057 ts_tablet_manager.cc:1403] T 477afb2899ff459caf4d0eb55e840010 P 93881c5b9b0648248e627ef7b541aec4: Time spent bootstrapping tablet: real 0.038s	user 0.022s	sys 0.015s
I20260709 13:24:06.660351 18056 tablet_bootstrap.cc:492] T 9783d21b38744e0b8565b96be6c3ca80 P f62ce053d68f4a868fa48f951d56da1a: No bootstrap required, opened a new log
I20260709 13:24:06.661063 18056 ts_tablet_manager.cc:1403] T 9783d21b38744e0b8565b96be6c3ca80 P f62ce053d68f4a868fa48f951d56da1a: Time spent bootstrapping tablet: real 0.068s	user 0.025s	sys 0.039s
I20260709 13:24:06.660946 18055 raft_consensus.cc:359] T e472f595f87a4a749248c7b7812b33d0 P 5b2c1cd5f367458e811c859b7dbca333 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f62ce053d68f4a868fa48f951d56da1a" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 33029 } } peers { permanent_uuid: "93881c5b9b0648248e627ef7b541aec4" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 44419 } } peers { permanent_uuid: "5b2c1cd5f367458e811c859b7dbca333" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 40055 } }
I20260709 13:24:06.661738 18055 raft_consensus.cc:385] T e472f595f87a4a749248c7b7812b33d0 P 5b2c1cd5f367458e811c859b7dbca333 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:24:06.662012 18055 raft_consensus.cc:740] T e472f595f87a4a749248c7b7812b33d0 P 5b2c1cd5f367458e811c859b7dbca333 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5b2c1cd5f367458e811c859b7dbca333, State: Initialized, Role: FOLLOWER
I20260709 13:24:06.662731 18055 consensus_queue.cc:260] T e472f595f87a4a749248c7b7812b33d0 P 5b2c1cd5f367458e811c859b7dbca333 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f62ce053d68f4a868fa48f951d56da1a" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 33029 } } peers { permanent_uuid: "93881c5b9b0648248e627ef7b541aec4" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 44419 } } peers { permanent_uuid: "5b2c1cd5f367458e811c859b7dbca333" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 40055 } }
I20260709 13:24:06.663872 18057 raft_consensus.cc:359] T 477afb2899ff459caf4d0eb55e840010 P 93881c5b9b0648248e627ef7b541aec4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f62ce053d68f4a868fa48f951d56da1a" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 33029 } } peers { permanent_uuid: "93881c5b9b0648248e627ef7b541aec4" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 44419 } } peers { permanent_uuid: "5b2c1cd5f367458e811c859b7dbca333" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 40055 } }
I20260709 13:24:06.664757 18055 ts_tablet_manager.cc:1434] T e472f595f87a4a749248c7b7812b33d0 P 5b2c1cd5f367458e811c859b7dbca333: Time spent starting tablet: real 0.006s	user 0.008s	sys 0.000s
I20260709 13:24:06.664721 18057 raft_consensus.cc:385] T 477afb2899ff459caf4d0eb55e840010 P 93881c5b9b0648248e627ef7b541aec4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:24:06.665803 18057 raft_consensus.cc:740] T 477afb2899ff459caf4d0eb55e840010 P 93881c5b9b0648248e627ef7b541aec4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 93881c5b9b0648248e627ef7b541aec4, State: Initialized, Role: FOLLOWER
I20260709 13:24:06.664726 18056 raft_consensus.cc:359] T 9783d21b38744e0b8565b96be6c3ca80 P f62ce053d68f4a868fa48f951d56da1a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f62ce053d68f4a868fa48f951d56da1a" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 33029 } } peers { permanent_uuid: "93881c5b9b0648248e627ef7b541aec4" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 44419 } } peers { permanent_uuid: "5b2c1cd5f367458e811c859b7dbca333" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 40055 } }
I20260709 13:24:06.666414 18056 raft_consensus.cc:385] T 9783d21b38744e0b8565b96be6c3ca80 P f62ce053d68f4a868fa48f951d56da1a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:24:06.666509 18055 tablet_bootstrap.cc:492] T 274de930fd3e48b0a4a446dfeedcff85 P 5b2c1cd5f367458e811c859b7dbca333: Bootstrap starting.
I20260709 13:24:06.666810 18056 raft_consensus.cc:740] T 9783d21b38744e0b8565b96be6c3ca80 P f62ce053d68f4a868fa48f951d56da1a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f62ce053d68f4a868fa48f951d56da1a, State: Initialized, Role: FOLLOWER
I20260709 13:24:06.666764 18057 consensus_queue.cc:260] T 477afb2899ff459caf4d0eb55e840010 P 93881c5b9b0648248e627ef7b541aec4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f62ce053d68f4a868fa48f951d56da1a" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 33029 } } peers { permanent_uuid: "93881c5b9b0648248e627ef7b541aec4" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 44419 } } peers { permanent_uuid: "5b2c1cd5f367458e811c859b7dbca333" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 40055 } }
I20260709 13:24:06.668187 18056 consensus_queue.cc:260] T 9783d21b38744e0b8565b96be6c3ca80 P f62ce053d68f4a868fa48f951d56da1a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f62ce053d68f4a868fa48f951d56da1a" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 33029 } } peers { permanent_uuid: "93881c5b9b0648248e627ef7b541aec4" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 44419 } } peers { permanent_uuid: "5b2c1cd5f367458e811c859b7dbca333" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 40055 } }
I20260709 13:24:06.670809 18056 ts_tablet_manager.cc:1434] T 9783d21b38744e0b8565b96be6c3ca80 P f62ce053d68f4a868fa48f951d56da1a: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
I20260709 13:24:06.671926 18056 tablet_bootstrap.cc:492] T 477afb2899ff459caf4d0eb55e840010 P f62ce053d68f4a868fa48f951d56da1a: Bootstrap starting.
I20260709 13:24:06.672072 18057 ts_tablet_manager.cc:1434] T 477afb2899ff459caf4d0eb55e840010 P 93881c5b9b0648248e627ef7b541aec4: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.001s
I20260709 13:24:06.673243 18057 tablet_bootstrap.cc:492] T 9783d21b38744e0b8565b96be6c3ca80 P 93881c5b9b0648248e627ef7b541aec4: Bootstrap starting.
I20260709 13:24:06.674288 18055 tablet_bootstrap.cc:654] T 274de930fd3e48b0a4a446dfeedcff85 P 5b2c1cd5f367458e811c859b7dbca333: Neither blocks nor log segments found. Creating new log.
I20260709 13:24:06.679710 18056 tablet_bootstrap.cc:654] T 477afb2899ff459caf4d0eb55e840010 P f62ce053d68f4a868fa48f951d56da1a: Neither blocks nor log segments found. Creating new log.
I20260709 13:24:06.681222 18057 tablet_bootstrap.cc:654] T 9783d21b38744e0b8565b96be6c3ca80 P 93881c5b9b0648248e627ef7b541aec4: Neither blocks nor log segments found. Creating new log.
W20260709 13:24:06.684583 17812 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:24:06.686931 18055 tablet_bootstrap.cc:492] T 274de930fd3e48b0a4a446dfeedcff85 P 5b2c1cd5f367458e811c859b7dbca333: No bootstrap required, opened a new log
I20260709 13:24:06.687573 18055 ts_tablet_manager.cc:1403] T 274de930fd3e48b0a4a446dfeedcff85 P 5b2c1cd5f367458e811c859b7dbca333: Time spent bootstrapping tablet: real 0.021s	user 0.010s	sys 0.008s
I20260709 13:24:06.690948 18055 raft_consensus.cc:359] T 274de930fd3e48b0a4a446dfeedcff85 P 5b2c1cd5f367458e811c859b7dbca333 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f62ce053d68f4a868fa48f951d56da1a" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 33029 } } peers { permanent_uuid: "93881c5b9b0648248e627ef7b541aec4" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 44419 } } peers { permanent_uuid: "5b2c1cd5f367458e811c859b7dbca333" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 40055 } }
I20260709 13:24:06.691751 18055 raft_consensus.cc:385] T 274de930fd3e48b0a4a446dfeedcff85 P 5b2c1cd5f367458e811c859b7dbca333 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:24:06.692098 18055 raft_consensus.cc:740] T 274de930fd3e48b0a4a446dfeedcff85 P 5b2c1cd5f367458e811c859b7dbca333 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5b2c1cd5f367458e811c859b7dbca333, State: Initialized, Role: FOLLOWER
I20260709 13:24:06.693208 18055 consensus_queue.cc:260] T 274de930fd3e48b0a4a446dfeedcff85 P 5b2c1cd5f367458e811c859b7dbca333 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f62ce053d68f4a868fa48f951d56da1a" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 33029 } } peers { permanent_uuid: "93881c5b9b0648248e627ef7b541aec4" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 44419 } } peers { permanent_uuid: "5b2c1cd5f367458e811c859b7dbca333" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 40055 } }
I20260709 13:24:06.694429 18056 tablet_bootstrap.cc:492] T 477afb2899ff459caf4d0eb55e840010 P f62ce053d68f4a868fa48f951d56da1a: No bootstrap required, opened a new log
I20260709 13:24:06.695359 18056 ts_tablet_manager.cc:1403] T 477afb2899ff459caf4d0eb55e840010 P f62ce053d68f4a868fa48f951d56da1a: Time spent bootstrapping tablet: real 0.024s	user 0.008s	sys 0.012s
I20260709 13:24:06.695994 18055 ts_tablet_manager.cc:1434] T 274de930fd3e48b0a4a446dfeedcff85 P 5b2c1cd5f367458e811c859b7dbca333: Time spent starting tablet: real 0.008s	user 0.009s	sys 0.000s
I20260709 13:24:06.697306 18055 tablet_bootstrap.cc:492] T 9783d21b38744e0b8565b96be6c3ca80 P 5b2c1cd5f367458e811c859b7dbca333: Bootstrap starting.
I20260709 13:24:06.700850 18056 raft_consensus.cc:359] T 477afb2899ff459caf4d0eb55e840010 P f62ce053d68f4a868fa48f951d56da1a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f62ce053d68f4a868fa48f951d56da1a" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 33029 } } peers { permanent_uuid: "93881c5b9b0648248e627ef7b541aec4" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 44419 } } peers { permanent_uuid: "5b2c1cd5f367458e811c859b7dbca333" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 40055 } }
I20260709 13:24:06.701695 18056 raft_consensus.cc:385] T 477afb2899ff459caf4d0eb55e840010 P f62ce053d68f4a868fa48f951d56da1a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:24:06.702024 18056 raft_consensus.cc:740] T 477afb2899ff459caf4d0eb55e840010 P f62ce053d68f4a868fa48f951d56da1a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f62ce053d68f4a868fa48f951d56da1a, State: Initialized, Role: FOLLOWER
I20260709 13:24:06.702975 18056 consensus_queue.cc:260] T 477afb2899ff459caf4d0eb55e840010 P f62ce053d68f4a868fa48f951d56da1a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f62ce053d68f4a868fa48f951d56da1a" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 33029 } } peers { permanent_uuid: "93881c5b9b0648248e627ef7b541aec4" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 44419 } } peers { permanent_uuid: "5b2c1cd5f367458e811c859b7dbca333" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 40055 } }
I20260709 13:24:06.705567 18055 tablet_bootstrap.cc:654] T 9783d21b38744e0b8565b96be6c3ca80 P 5b2c1cd5f367458e811c859b7dbca333: Neither blocks nor log segments found. Creating new log.
I20260709 13:24:06.707964 18056 ts_tablet_manager.cc:1434] T 477afb2899ff459caf4d0eb55e840010 P f62ce053d68f4a868fa48f951d56da1a: Time spent starting tablet: real 0.012s	user 0.008s	sys 0.000s
I20260709 13:24:06.709278 18056 tablet_bootstrap.cc:492] T 274de930fd3e48b0a4a446dfeedcff85 P f62ce053d68f4a868fa48f951d56da1a: Bootstrap starting.
I20260709 13:24:06.710384 18057 tablet_bootstrap.cc:492] T 9783d21b38744e0b8565b96be6c3ca80 P 93881c5b9b0648248e627ef7b541aec4: No bootstrap required, opened a new log
I20260709 13:24:06.710986 18057 ts_tablet_manager.cc:1403] T 9783d21b38744e0b8565b96be6c3ca80 P 93881c5b9b0648248e627ef7b541aec4: Time spent bootstrapping tablet: real 0.038s	user 0.015s	sys 0.008s
I20260709 13:24:06.711623 18055 tablet_bootstrap.cc:492] T 9783d21b38744e0b8565b96be6c3ca80 P 5b2c1cd5f367458e811c859b7dbca333: No bootstrap required, opened a new log
I20260709 13:24:06.712330 18055 ts_tablet_manager.cc:1403] T 9783d21b38744e0b8565b96be6c3ca80 P 5b2c1cd5f367458e811c859b7dbca333: Time spent bootstrapping tablet: real 0.015s	user 0.014s	sys 0.000s
I20260709 13:24:06.714465 18057 raft_consensus.cc:359] T 9783d21b38744e0b8565b96be6c3ca80 P 93881c5b9b0648248e627ef7b541aec4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f62ce053d68f4a868fa48f951d56da1a" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 33029 } } peers { permanent_uuid: "93881c5b9b0648248e627ef7b541aec4" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 44419 } } peers { permanent_uuid: "5b2c1cd5f367458e811c859b7dbca333" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 40055 } }
I20260709 13:24:06.715361 18055 raft_consensus.cc:359] T 9783d21b38744e0b8565b96be6c3ca80 P 5b2c1cd5f367458e811c859b7dbca333 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f62ce053d68f4a868fa48f951d56da1a" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 33029 } } peers { permanent_uuid: "93881c5b9b0648248e627ef7b541aec4" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 44419 } } peers { permanent_uuid: "5b2c1cd5f367458e811c859b7dbca333" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 40055 } }
I20260709 13:24:06.716228 18055 raft_consensus.cc:385] T 9783d21b38744e0b8565b96be6c3ca80 P 5b2c1cd5f367458e811c859b7dbca333 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:24:06.716389 18056 tablet_bootstrap.cc:654] T 274de930fd3e48b0a4a446dfeedcff85 P f62ce053d68f4a868fa48f951d56da1a: Neither blocks nor log segments found. Creating new log.
I20260709 13:24:06.715389 18057 raft_consensus.cc:385] T 9783d21b38744e0b8565b96be6c3ca80 P 93881c5b9b0648248e627ef7b541aec4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:24:06.717139 18057 raft_consensus.cc:740] T 9783d21b38744e0b8565b96be6c3ca80 P 93881c5b9b0648248e627ef7b541aec4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 93881c5b9b0648248e627ef7b541aec4, State: Initialized, Role: FOLLOWER
I20260709 13:24:06.717288 18064 raft_consensus.cc:493] T 9783d21b38744e0b8565b96be6c3ca80 P f62ce053d68f4a868fa48f951d56da1a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:24:06.718269 18064 raft_consensus.cc:515] T 9783d21b38744e0b8565b96be6c3ca80 P f62ce053d68f4a868fa48f951d56da1a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f62ce053d68f4a868fa48f951d56da1a" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 33029 } } peers { permanent_uuid: "93881c5b9b0648248e627ef7b541aec4" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 44419 } } peers { permanent_uuid: "5b2c1cd5f367458e811c859b7dbca333" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 40055 } }
I20260709 13:24:06.718544 18057 consensus_queue.cc:260] T 9783d21b38744e0b8565b96be6c3ca80 P 93881c5b9b0648248e627ef7b541aec4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f62ce053d68f4a868fa48f951d56da1a" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 33029 } } peers { permanent_uuid: "93881c5b9b0648248e627ef7b541aec4" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 44419 } } peers { permanent_uuid: "5b2c1cd5f367458e811c859b7dbca333" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 40055 } }
I20260709 13:24:06.722749 18064 leader_election.cc:290] T 9783d21b38744e0b8565b96be6c3ca80 P f62ce053d68f4a868fa48f951d56da1a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 93881c5b9b0648248e627ef7b541aec4 (127.5.126.66:44419), 5b2c1cd5f367458e811c859b7dbca333 (127.5.126.67:40055)
I20260709 13:24:06.722796 18057 ts_tablet_manager.cc:1434] T 9783d21b38744e0b8565b96be6c3ca80 P 93881c5b9b0648248e627ef7b541aec4: Time spent starting tablet: real 0.011s	user 0.010s	sys 0.001s
I20260709 13:24:06.724252 18057 tablet_bootstrap.cc:492] T 66404f05eae74a7f938e85e5eae5cf72 P 93881c5b9b0648248e627ef7b541aec4: Bootstrap starting.
I20260709 13:24:06.731518 18057 tablet_bootstrap.cc:654] T 66404f05eae74a7f938e85e5eae5cf72 P 93881c5b9b0648248e627ef7b541aec4: Neither blocks nor log segments found. Creating new log.
I20260709 13:24:06.716570 18055 raft_consensus.cc:740] T 9783d21b38744e0b8565b96be6c3ca80 P 5b2c1cd5f367458e811c859b7dbca333 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5b2c1cd5f367458e811c859b7dbca333, State: Initialized, Role: FOLLOWER
I20260709 13:24:06.733081 18055 consensus_queue.cc:260] T 9783d21b38744e0b8565b96be6c3ca80 P 5b2c1cd5f367458e811c859b7dbca333 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f62ce053d68f4a868fa48f951d56da1a" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 33029 } } peers { permanent_uuid: "93881c5b9b0648248e627ef7b541aec4" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 44419 } } peers { permanent_uuid: "5b2c1cd5f367458e811c859b7dbca333" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 40055 } }
I20260709 13:24:06.735984 18055 ts_tablet_manager.cc:1434] T 9783d21b38744e0b8565b96be6c3ca80 P 5b2c1cd5f367458e811c859b7dbca333: Time spent starting tablet: real 0.023s	user 0.005s	sys 0.000s
I20260709 13:24:06.737129 18055 tablet_bootstrap.cc:492] T 66404f05eae74a7f938e85e5eae5cf72 P 5b2c1cd5f367458e811c859b7dbca333: Bootstrap starting.
I20260709 13:24:06.743479 18056 tablet_bootstrap.cc:492] T 274de930fd3e48b0a4a446dfeedcff85 P f62ce053d68f4a868fa48f951d56da1a: No bootstrap required, opened a new log
I20260709 13:24:06.744287 18056 ts_tablet_manager.cc:1403] T 274de930fd3e48b0a4a446dfeedcff85 P f62ce053d68f4a868fa48f951d56da1a: Time spent bootstrapping tablet: real 0.035s	user 0.013s	sys 0.000s
I20260709 13:24:06.745434 18055 tablet_bootstrap.cc:654] T 66404f05eae74a7f938e85e5eae5cf72 P 5b2c1cd5f367458e811c859b7dbca333: Neither blocks nor log segments found. Creating new log.
I20260709 13:24:06.748354 18056 raft_consensus.cc:359] T 274de930fd3e48b0a4a446dfeedcff85 P f62ce053d68f4a868fa48f951d56da1a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f62ce053d68f4a868fa48f951d56da1a" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 33029 } } peers { permanent_uuid: "93881c5b9b0648248e627ef7b541aec4" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 44419 } } peers { permanent_uuid: "5b2c1cd5f367458e811c859b7dbca333" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 40055 } }
I20260709 13:24:06.749399 18056 raft_consensus.cc:385] T 274de930fd3e48b0a4a446dfeedcff85 P f62ce053d68f4a868fa48f951d56da1a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:24:06.749779 18056 raft_consensus.cc:740] T 274de930fd3e48b0a4a446dfeedcff85 P f62ce053d68f4a868fa48f951d56da1a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f62ce053d68f4a868fa48f951d56da1a, State: Initialized, Role: FOLLOWER
I20260709 13:24:06.750788 18056 consensus_queue.cc:260] T 274de930fd3e48b0a4a446dfeedcff85 P f62ce053d68f4a868fa48f951d56da1a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f62ce053d68f4a868fa48f951d56da1a" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 33029 } } peers { permanent_uuid: "93881c5b9b0648248e627ef7b541aec4" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 44419 } } peers { permanent_uuid: "5b2c1cd5f367458e811c859b7dbca333" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 40055 } }
I20260709 13:24:06.754447 17941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9783d21b38744e0b8565b96be6c3ca80" candidate_uuid: "f62ce053d68f4a868fa48f951d56da1a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "93881c5b9b0648248e627ef7b541aec4" is_pre_election: true
I20260709 13:24:06.755261 17941 raft_consensus.cc:2468] T 9783d21b38744e0b8565b96be6c3ca80 P 93881c5b9b0648248e627ef7b541aec4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f62ce053d68f4a868fa48f951d56da1a in term 0.
I20260709 13:24:06.756309 18056 ts_tablet_manager.cc:1434] T 274de930fd3e48b0a4a446dfeedcff85 P f62ce053d68f4a868fa48f951d56da1a: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.001s
I20260709 13:24:06.756891 18057 tablet_bootstrap.cc:492] T 66404f05eae74a7f938e85e5eae5cf72 P 93881c5b9b0648248e627ef7b541aec4: No bootstrap required, opened a new log
I20260709 13:24:06.757452 18057 ts_tablet_manager.cc:1403] T 66404f05eae74a7f938e85e5eae5cf72 P 93881c5b9b0648248e627ef7b541aec4: Time spent bootstrapping tablet: real 0.033s	user 0.018s	sys 0.000s
I20260709 13:24:06.757828 18056 tablet_bootstrap.cc:492] T d3bd24e790d3483185e9f89c8521831b P f62ce053d68f4a868fa48f951d56da1a: Bootstrap starting.
I20260709 13:24:06.760974 18057 raft_consensus.cc:359] T 66404f05eae74a7f938e85e5eae5cf72 P 93881c5b9b0648248e627ef7b541aec4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f62ce053d68f4a868fa48f951d56da1a" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 33029 } } peers { permanent_uuid: "93881c5b9b0648248e627ef7b541aec4" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 44419 } } peers { permanent_uuid: "5b2c1cd5f367458e811c859b7dbca333" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 40055 } }
I20260709 13:24:06.761142 17830 leader_election.cc:304] T 9783d21b38744e0b8565b96be6c3ca80 P f62ce053d68f4a868fa48f951d56da1a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 93881c5b9b0648248e627ef7b541aec4, f62ce053d68f4a868fa48f951d56da1a; no voters: 
I20260709 13:24:06.761782 18057 raft_consensus.cc:385] T 66404f05eae74a7f938e85e5eae5cf72 P 93881c5b9b0648248e627ef7b541aec4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:24:06.763262 18064 raft_consensus.cc:2804] T 9783d21b38744e0b8565b96be6c3ca80 P f62ce053d68f4a868fa48f951d56da1a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:24:06.763721 18064 raft_consensus.cc:493] T 9783d21b38744e0b8565b96be6c3ca80 P f62ce053d68f4a868fa48f951d56da1a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:24:06.764094 18064 raft_consensus.cc:3060] T 9783d21b38744e0b8565b96be6c3ca80 P f62ce053d68f4a868fa48f951d56da1a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:24:06.771466 18057 raft_consensus.cc:740] T 66404f05eae74a7f938e85e5eae5cf72 P 93881c5b9b0648248e627ef7b541aec4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 93881c5b9b0648248e627ef7b541aec4, State: Initialized, Role: FOLLOWER
I20260709 13:24:06.774089 18057 consensus_queue.cc:260] T 66404f05eae74a7f938e85e5eae5cf72 P 93881c5b9b0648248e627ef7b541aec4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f62ce053d68f4a868fa48f951d56da1a" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 33029 } } peers { permanent_uuid: "93881c5b9b0648248e627ef7b541aec4" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 44419 } } peers { permanent_uuid: "5b2c1cd5f367458e811c859b7dbca333" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 40055 } }
I20260709 13:24:06.775909 18055 tablet_bootstrap.cc:492] T 66404f05eae74a7f938e85e5eae5cf72 P 5b2c1cd5f367458e811c859b7dbca333: No bootstrap required, opened a new log
I20260709 13:24:06.775640 18015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9783d21b38744e0b8565b96be6c3ca80" candidate_uuid: "f62ce053d68f4a868fa48f951d56da1a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5b2c1cd5f367458e811c859b7dbca333" is_pre_election: true
I20260709 13:24:06.776513 18055 ts_tablet_manager.cc:1403] T 66404f05eae74a7f938e85e5eae5cf72 P 5b2c1cd5f367458e811c859b7dbca333: Time spent bootstrapping tablet: real 0.040s	user 0.023s	sys 0.014s
I20260709 13:24:06.776520 18015 raft_consensus.cc:2468] T 9783d21b38744e0b8565b96be6c3ca80 P 5b2c1cd5f367458e811c859b7dbca333 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f62ce053d68f4a868fa48f951d56da1a in term 0.
I20260709 13:24:06.777174 18056 tablet_bootstrap.cc:654] T d3bd24e790d3483185e9f89c8521831b P f62ce053d68f4a868fa48f951d56da1a: Neither blocks nor log segments found. Creating new log.
I20260709 13:24:06.779973 18055 raft_consensus.cc:359] T 66404f05eae74a7f938e85e5eae5cf72 P 5b2c1cd5f367458e811c859b7dbca333 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f62ce053d68f4a868fa48f951d56da1a" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 33029 } } peers { permanent_uuid: "93881c5b9b0648248e627ef7b541aec4" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 44419 } } peers { permanent_uuid: "5b2c1cd5f367458e811c859b7dbca333" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 40055 } }
I20260709 13:24:06.779852 18057 ts_tablet_manager.cc:1434] T 66404f05eae74a7f938e85e5eae5cf72 P 93881c5b9b0648248e627ef7b541aec4: Time spent starting tablet: real 0.022s	user 0.008s	sys 0.000s
I20260709 13:24:06.782269 18064 raft_consensus.cc:515] T 9783d21b38744e0b8565b96be6c3ca80 P f62ce053d68f4a868fa48f951d56da1a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f62ce053d68f4a868fa48f951d56da1a" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 33029 } } peers { permanent_uuid: "93881c5b9b0648248e627ef7b541aec4" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 44419 } } peers { permanent_uuid: "5b2c1cd5f367458e811c859b7dbca333" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 40055 } }
I20260709 13:24:06.781054 18055 raft_consensus.cc:385] T 66404f05eae74a7f938e85e5eae5cf72 P 5b2c1cd5f367458e811c859b7dbca333 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:24:06.782900 18057 tablet_bootstrap.cc:492] T b8a4f81761e3423fa8d2e3144b6b4ca8 P 93881c5b9b0648248e627ef7b541aec4: Bootstrap starting.
I20260709 13:24:06.785063 18055 raft_consensus.cc:740] T 66404f05eae74a7f938e85e5eae5cf72 P 5b2c1cd5f367458e811c859b7dbca333 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5b2c1cd5f367458e811c859b7dbca333, State: Initialized, Role: FOLLOWER
I20260709 13:24:06.787398 18055 consensus_queue.cc:260] T 66404f05eae74a7f938e85e5eae5cf72 P 5b2c1cd5f367458e811c859b7dbca333 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f62ce053d68f4a868fa48f951d56da1a" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 33029 } } peers { permanent_uuid: "93881c5b9b0648248e627ef7b541aec4" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 44419 } } peers { permanent_uuid: "5b2c1cd5f367458e811c859b7dbca333" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 40055 } }
I20260709 13:24:06.788456 18064 leader_election.cc:290] T 9783d21b38744e0b8565b96be6c3ca80 P f62ce053d68f4a868fa48f951d56da1a [CANDIDATE]: Term 1 election: Requested vote from peers 93881c5b9b0648248e627ef7b541aec4 (127.5.126.66:44419), 5b2c1cd5f367458e811c859b7dbca333 (127.5.126.67:40055)
I20260709 13:24:06.790308 17941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9783d21b38744e0b8565b96be6c3ca80" candidate_uuid: "f62ce053d68f4a868fa48f951d56da1a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "93881c5b9b0648248e627ef7b541aec4"
I20260709 13:24:06.790999 17941 raft_consensus.cc:3060] T 9783d21b38744e0b8565b96be6c3ca80 P 93881c5b9b0648248e627ef7b541aec4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:24:06.792740 18057 tablet_bootstrap.cc:654] T b8a4f81761e3423fa8d2e3144b6b4ca8 P 93881c5b9b0648248e627ef7b541aec4: Neither blocks nor log segments found. Creating new log.
I20260709 13:24:06.793001 18055 ts_tablet_manager.cc:1434] T 66404f05eae74a7f938e85e5eae5cf72 P 5b2c1cd5f367458e811c859b7dbca333: Time spent starting tablet: real 0.016s	user 0.005s	sys 0.003s
I20260709 13:24:06.794399 18055 tablet_bootstrap.cc:492] T 98bdadc834134483b31be48f35123bbd P 5b2c1cd5f367458e811c859b7dbca333: Bootstrap starting.
I20260709 13:24:06.800156 18056 tablet_bootstrap.cc:492] T d3bd24e790d3483185e9f89c8521831b P f62ce053d68f4a868fa48f951d56da1a: No bootstrap required, opened a new log
I20260709 13:24:06.800834 18056 ts_tablet_manager.cc:1403] T d3bd24e790d3483185e9f89c8521831b P f62ce053d68f4a868fa48f951d56da1a: Time spent bootstrapping tablet: real 0.043s	user 0.017s	sys 0.000s
I20260709 13:24:06.804005 18055 tablet_bootstrap.cc:654] T 98bdadc834134483b31be48f35123bbd P 5b2c1cd5f367458e811c859b7dbca333: Neither blocks nor log segments found. Creating new log.
I20260709 13:24:06.805526 18064 raft_consensus.cc:493] T e472f595f87a4a749248c7b7812b33d0 P f62ce053d68f4a868fa48f951d56da1a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:24:06.806159 18064 raft_consensus.cc:515] T e472f595f87a4a749248c7b7812b33d0 P f62ce053d68f4a868fa48f951d56da1a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f62ce053d68f4a868fa48f951d56da1a" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 33029 } } peers { permanent_uuid: "93881c5b9b0648248e627ef7b541aec4" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 44419 } } peers { permanent_uuid: "5b2c1cd5f367458e811c859b7dbca333" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 40055 } }
I20260709 13:24:06.800017 17941 raft_consensus.cc:2468] T 9783d21b38744e0b8565b96be6c3ca80 P 93881c5b9b0648248e627ef7b541aec4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f62ce053d68f4a868fa48f951d56da1a in term 1.
I20260709 13:24:06.809398 18064 leader_election.cc:290] T e472f595f87a4a749248c7b7812b33d0 P f62ce053d68f4a868fa48f951d56da1a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 93881c5b9b0648248e627ef7b541aec4 (127.5.126.66:44419), 5b2c1cd5f367458e811c859b7dbca333 (127.5.126.67:40055)
I20260709 13:24:06.804282 18056 raft_consensus.cc:359] T d3bd24e790d3483185e9f89c8521831b P f62ce053d68f4a868fa48f951d56da1a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b2c1cd5f367458e811c859b7dbca333" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 40055 } } peers { permanent_uuid: "93881c5b9b0648248e627ef7b541aec4" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 44419 } } peers { permanent_uuid: "f62ce053d68f4a868fa48f951d56da1a" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 33029 } }
I20260709 13:24:06.810333 18056 raft_consensus.cc:385] T d3bd24e790d3483185e9f89c8521831b P f62ce053d68f4a868fa48f951d56da1a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:24:06.810918 18015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9783d21b38744e0b8565b96be6c3ca80" candidate_uuid: "f62ce053d68f4a868fa48f951d56da1a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5b2c1cd5f367458e811c859b7dbca333"
I20260709 13:24:06.811585 17941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e472f595f87a4a749248c7b7812b33d0" candidate_uuid: "f62ce053d68f4a868fa48f951d56da1a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "93881c5b9b0648248e627ef7b541aec4" is_pre_election: true
I20260709 13:24:06.811910 18015 raft_consensus.cc:3060] T 9783d21b38744e0b8565b96be6c3ca80 P 5b2c1cd5f367458e811c859b7dbca333 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:24:06.810672 18056 raft_consensus.cc:740] T d3bd24e790d3483185e9f89c8521831b P f62ce053d68f4a868fa48f951d56da1a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f62ce053d68f4a868fa48f951d56da1a, State: Initialized, Role: FOLLOWER
I20260709 13:24:06.813752 17941 raft_consensus.cc:2468] T e472f595f87a4a749248c7b7812b33d0 P 93881c5b9b0648248e627ef7b541aec4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f62ce053d68f4a868fa48f951d56da1a in term 0.
I20260709 13:24:06.811864 17830 leader_election.cc:304] T 9783d21b38744e0b8565b96be6c3ca80 P f62ce053d68f4a868fa48f951d56da1a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 93881c5b9b0648248e627ef7b541aec4, f62ce053d68f4a868fa48f951d56da1a; no voters: 
I20260709 13:24:06.815081 18056 consensus_queue.cc:260] T d3bd24e790d3483185e9f89c8521831b P f62ce053d68f4a868fa48f951d56da1a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b2c1cd5f367458e811c859b7dbca333" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 40055 } } peers { permanent_uuid: "93881c5b9b0648248e627ef7b541aec4" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 44419 } } peers { permanent_uuid: "f62ce053d68f4a868fa48f951d56da1a" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 33029 } }
I20260709 13:24:06.815609 17830 leader_election.cc:304] T e472f595f87a4a749248c7b7812b33d0 P f62ce053d68f4a868fa48f951d56da1a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 93881c5b9b0648248e627ef7b541aec4, f62ce053d68f4a868fa48f951d56da1a; no voters: 
I20260709 13:24:06.816685 18064 raft_consensus.cc:2804] T 9783d21b38744e0b8565b96be6c3ca80 P f62ce053d68f4a868fa48f951d56da1a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:24:06.816952 18014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e472f595f87a4a749248c7b7812b33d0" candidate_uuid: "f62ce053d68f4a868fa48f951d56da1a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5b2c1cd5f367458e811c859b7dbca333" is_pre_election: true
I20260709 13:24:06.818058 18014 raft_consensus.cc:2468] T e472f595f87a4a749248c7b7812b33d0 P 5b2c1cd5f367458e811c859b7dbca333 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f62ce053d68f4a868fa48f951d56da1a in term 0.
I20260709 13:24:06.823755 18057 tablet_bootstrap.cc:492] T b8a4f81761e3423fa8d2e3144b6b4ca8 P 93881c5b9b0648248e627ef7b541aec4: No bootstrap required, opened a new log
I20260709 13:24:06.824636 18057 ts_tablet_manager.cc:1403] T b8a4f81761e3423fa8d2e3144b6b4ca8 P 93881c5b9b0648248e627ef7b541aec4: Time spent bootstrapping tablet: real 0.042s	user 0.012s	sys 0.025s
I20260709 13:24:06.825860 18064 raft_consensus.cc:697] T 9783d21b38744e0b8565b96be6c3ca80 P f62ce053d68f4a868fa48f951d56da1a [term 1 LEADER]: Becoming Leader. State: Replica: f62ce053d68f4a868fa48f951d56da1a, State: Running, Role: LEADER
I20260709 13:24:06.826982 18064 consensus_queue.cc:237] T 9783d21b38744e0b8565b96be6c3ca80 P f62ce053d68f4a868fa48f951d56da1a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f62ce053d68f4a868fa48f951d56da1a" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 33029 } } peers { permanent_uuid: "93881c5b9b0648248e627ef7b541aec4" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 44419 } } peers { permanent_uuid: "5b2c1cd5f367458e811c859b7dbca333" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 40055 } }
I20260709 13:24:06.827507 18015 raft_consensus.cc:2468] T 9783d21b38744e0b8565b96be6c3ca80 P 5b2c1cd5f367458e811c859b7dbca333 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f62ce053d68f4a868fa48f951d56da1a in term 1.
I20260709 13:24:06.829651 18057 raft_consensus.cc:359] T b8a4f81761e3423fa8d2e3144b6b4ca8 P 93881c5b9b0648248e627ef7b541aec4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f62ce053d68f4a868fa48f951d56da1a" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 33029 } } peers { permanent_uuid: "93881c5b9b0648248e627ef7b541aec4" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 44419 } } peers { permanent_uuid: "5b2c1cd5f367458e811c859b7dbca333" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 40055 } }
I20260709 13:24:06.830470 18057 raft_consensus.cc:385] T b8a4f81761e3423fa8d2e3144b6b4ca8 P 93881c5b9b0648248e627ef7b541aec4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:24:06.830761 18057 raft_consensus.cc:740] T b8a4f81761e3423fa8d2e3144b6b4ca8 P 93881c5b9b0648248e627ef7b541aec4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 93881c5b9b0648248e627ef7b541aec4, State: Initialized, Role: FOLLOWER
I20260709 13:24:06.831539 18057 consensus_queue.cc:260] T b8a4f81761e3423fa8d2e3144b6b4ca8 P 93881c5b9b0648248e627ef7b541aec4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f62ce053d68f4a868fa48f951d56da1a" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 33029 } } peers { permanent_uuid: "93881c5b9b0648248e627ef7b541aec4" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 44419 } } peers { permanent_uuid: "5b2c1cd5f367458e811c859b7dbca333" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 40055 } }
I20260709 13:24:06.834115 18057 ts_tablet_manager.cc:1434] T b8a4f81761e3423fa8d2e3144b6b4ca8 P 93881c5b9b0648248e627ef7b541aec4: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 13:24:06.836835 18057 tablet_bootstrap.cc:492] T 93f7e8af061940dd82364fa3c6e69825 P 93881c5b9b0648248e627ef7b541aec4: Bootstrap starting.
I20260709 13:24:06.838578 18083 raft_consensus.cc:2804] T e472f595f87a4a749248c7b7812b33d0 P f62ce053d68f4a868fa48f951d56da1a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:24:06.839118 18083 raft_consensus.cc:493] T e472f595f87a4a749248c7b7812b33d0 P f62ce053d68f4a868fa48f951d56da1a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:24:06.839445 18083 raft_consensus.cc:3060] T e472f595f87a4a749248c7b7812b33d0 P f62ce053d68f4a868fa48f951d56da1a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:24:06.845046 18057 tablet_bootstrap.cc:654] T 93f7e8af061940dd82364fa3c6e69825 P 93881c5b9b0648248e627ef7b541aec4: Neither blocks nor log segments found. Creating new log.
I20260709 13:24:06.847611 18056 ts_tablet_manager.cc:1434] T d3bd24e790d3483185e9f89c8521831b P f62ce053d68f4a868fa48f951d56da1a: Time spent starting tablet: real 0.046s	user 0.008s	sys 0.002s
I20260709 13:24:06.849133 18056 tablet_bootstrap.cc:492] T b8a4f81761e3423fa8d2e3144b6b4ca8 P f62ce053d68f4a868fa48f951d56da1a: Bootstrap starting.
I20260709 13:24:06.856432 17761 catalog_manager.cc:5697] T 9783d21b38744e0b8565b96be6c3ca80 P f62ce053d68f4a868fa48f951d56da1a reported cstate change: term changed from 0 to 1, leader changed from <none> to f62ce053d68f4a868fa48f951d56da1a (127.5.126.65). New cstate: current_term: 1 leader_uuid: "f62ce053d68f4a868fa48f951d56da1a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f62ce053d68f4a868fa48f951d56da1a" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 33029 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "93881c5b9b0648248e627ef7b541aec4" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 44419 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5b2c1cd5f367458e811c859b7dbca333" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 40055 } health_report { overall_health: UNKNOWN } } }
I20260709 13:24:06.860587 18056 tablet_bootstrap.cc:654] T b8a4f81761e3423fa8d2e3144b6b4ca8 P f62ce053d68f4a868fa48f951d56da1a: Neither blocks nor log segments found. Creating new log.
I20260709 13:24:06.865312 18057 tablet_bootstrap.cc:492] T 93f7e8af061940dd82364fa3c6e69825 P 93881c5b9b0648248e627ef7b541aec4: No bootstrap required, opened a new log
I20260709 13:24:06.865953 18057 ts_tablet_manager.cc:1403] T 93f7e8af061940dd82364fa3c6e69825 P 93881c5b9b0648248e627ef7b541aec4: Time spent bootstrapping tablet: real 0.029s	user 0.015s	sys 0.003s
I20260709 13:24:06.867062 18055 tablet_bootstrap.cc:492] T 98bdadc834134483b31be48f35123bbd P 5b2c1cd5f367458e811c859b7dbca333: No bootstrap required, opened a new log
I20260709 13:24:06.867645 18055 ts_tablet_manager.cc:1403] T 98bdadc834134483b31be48f35123bbd P 5b2c1cd5f367458e811c859b7dbca333: Time spent bootstrapping tablet: real 0.074s	user 0.021s	sys 0.029s
I20260709 13:24:06.863131 18083 raft_consensus.cc:515] T e472f595f87a4a749248c7b7812b33d0 P f62ce053d68f4a868fa48f951d56da1a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f62ce053d68f4a868fa48f951d56da1a" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 33029 } } peers { permanent_uuid: "93881c5b9b0648248e627ef7b541aec4" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 44419 } } peers { permanent_uuid: "5b2c1cd5f367458e811c859b7dbca333" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 40055 } }
I20260709 13:24:06.873061 17941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e472f595f87a4a749248c7b7812b33d0" candidate_uuid: "f62ce053d68f4a868fa48f951d56da1a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "93881c5b9b0648248e627ef7b541aec4"
I20260709 13:24:06.873618 18083 leader_election.cc:290] T e472f595f87a4a749248c7b7812b33d0 P f62ce053d68f4a868fa48f951d56da1a [CANDIDATE]: Term 1 election: Requested vote from peers 93881c5b9b0648248e627ef7b541aec4 (127.5.126.66:44419), 5b2c1cd5f367458e811c859b7dbca333 (127.5.126.67:40055)
I20260709 13:24:06.873795 17941 raft_consensus.cc:3060] T e472f595f87a4a749248c7b7812b33d0 P 93881c5b9b0648248e627ef7b541aec4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:24:06.869421 18057 raft_consensus.cc:359] T 93f7e8af061940dd82364fa3c6e69825 P 93881c5b9b0648248e627ef7b541aec4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f62ce053d68f4a868fa48f951d56da1a" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 33029 } } peers { permanent_uuid: "93881c5b9b0648248e627ef7b541aec4" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 44419 } } peers { permanent_uuid: "5b2c1cd5f367458e811c859b7dbca333" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 40055 } }
I20260709 13:24:06.873946 18015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e472f595f87a4a749248c7b7812b33d0" candidate_uuid: "f62ce053d68f4a868fa48f951d56da1a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5b2c1cd5f367458e811c859b7dbca333"
I20260709 13:24:06.874998 18015 raft_consensus.cc:3060] T e472f595f87a4a749248c7b7812b33d0 P 5b2c1cd5f367458e811c859b7dbca333 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:24:06.875535 18056 tablet_bootstrap.cc:492] T b8a4f81761e3423fa8d2e3144b6b4ca8 P f62ce053d68f4a868fa48f951d56da1a: No bootstrap required, opened a new log
I20260709 13:24:06.876185 18056 ts_tablet_manager.cc:1403] T b8a4f81761e3423fa8d2e3144b6b4ca8 P f62ce053d68f4a868fa48f951d56da1a: Time spent bootstrapping tablet: real 0.027s	user 0.010s	sys 0.013s
I20260709 13:24:06.879570 18056 raft_consensus.cc:359] T b8a4f81761e3423fa8d2e3144b6b4ca8 P f62ce053d68f4a868fa48f951d56da1a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f62ce053d68f4a868fa48f951d56da1a" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 33029 } } peers { permanent_uuid: "93881c5b9b0648248e627ef7b541aec4" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 44419 } } peers { permanent_uuid: "5b2c1cd5f367458e811c859b7dbca333" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 40055 } }
I20260709 13:24:06.880553 18056 raft_consensus.cc:385] T b8a4f81761e3423fa8d2e3144b6b4ca8 P f62ce053d68f4a868fa48f951d56da1a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:24:06.880882 18056 raft_consensus.cc:740] T b8a4f81761e3423fa8d2e3144b6b4ca8 P f62ce053d68f4a868fa48f951d56da1a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f62ce053d68f4a868fa48f951d56da1a, State: Initialized, Role: FOLLOWER
I20260709 13:24:06.881778 18056 consensus_queue.cc:260] T b8a4f81761e3423fa8d2e3144b6b4ca8 P f62ce053d68f4a868fa48f951d56da1a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f62ce053d68f4a868fa48f951d56da1a" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 33029 } } peers { permanent_uuid: "93881c5b9b0648248e627ef7b541aec4" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 44419 } } peers { permanent_uuid: "5b2c1cd5f367458e811c859b7dbca333" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 40055 } }
I20260709 13:24:06.883684 18015 raft_consensus.cc:2468] T e472f595f87a4a749248c7b7812b33d0 P 5b2c1cd5f367458e811c859b7dbca333 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f62ce053d68f4a868fa48f951d56da1a in term 1.
I20260709 13:24:06.874648 18057 raft_consensus.cc:385] T 93f7e8af061940dd82364fa3c6e69825 P 93881c5b9b0648248e627ef7b541aec4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:24:06.884305 18056 ts_tablet_manager.cc:1434] T b8a4f81761e3423fa8d2e3144b6b4ca8 P f62ce053d68f4a868fa48f951d56da1a: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:24:06.884549 17941 raft_consensus.cc:2468] T e472f595f87a4a749248c7b7812b33d0 P 93881c5b9b0648248e627ef7b541aec4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f62ce053d68f4a868fa48f951d56da1a in term 1.
I20260709 13:24:06.885468 17830 leader_election.cc:304] T e472f595f87a4a749248c7b7812b33d0 P f62ce053d68f4a868fa48f951d56da1a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b2c1cd5f367458e811c859b7dbca333, f62ce053d68f4a868fa48f951d56da1a; no voters: 
I20260709 13:24:06.885843 18056 tablet_bootstrap.cc:492] T 98bdadc834134483b31be48f35123bbd P f62ce053d68f4a868fa48f951d56da1a: Bootstrap starting.
I20260709 13:24:06.871409 18055 raft_consensus.cc:359] T 98bdadc834134483b31be48f35123bbd P 5b2c1cd5f367458e811c859b7dbca333 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f62ce053d68f4a868fa48f951d56da1a" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 33029 } } peers { permanent_uuid: "93881c5b9b0648248e627ef7b541aec4" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 44419 } } peers { permanent_uuid: "5b2c1cd5f367458e811c859b7dbca333" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 40055 } }
I20260709 13:24:06.886482 18055 raft_consensus.cc:385] T 98bdadc834134483b31be48f35123bbd P 5b2c1cd5f367458e811c859b7dbca333 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:24:06.886873 18055 raft_consensus.cc:740] T 98bdadc834134483b31be48f35123bbd P 5b2c1cd5f367458e811c859b7dbca333 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5b2c1cd5f367458e811c859b7dbca333, State: Initialized, Role: FOLLOWER
I20260709 13:24:06.887420 18083 raft_consensus.cc:2804] T e472f595f87a4a749248c7b7812b33d0 P f62ce053d68f4a868fa48f951d56da1a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:24:06.884627 18057 raft_consensus.cc:740] T 93f7e8af061940dd82364fa3c6e69825 P 93881c5b9b0648248e627ef7b541aec4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 93881c5b9b0648248e627ef7b541aec4, State: Initialized, Role: FOLLOWER
I20260709 13:24:06.888705 18081 raft_consensus.cc:493] T 274de930fd3e48b0a4a446dfeedcff85 P f62ce053d68f4a868fa48f951d56da1a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:24:06.887969 18055 consensus_queue.cc:260] T 98bdadc834134483b31be48f35123bbd P 5b2c1cd5f367458e811c859b7dbca333 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f62ce053d68f4a868fa48f951d56da1a" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 33029 } } peers { permanent_uuid: "93881c5b9b0648248e627ef7b541aec4" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 44419 } } peers { permanent_uuid: "5b2c1cd5f367458e811c859b7dbca333" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 40055 } }
I20260709 13:24:06.889394 18081 raft_consensus.cc:515] T 274de930fd3e48b0a4a446dfeedcff85 P f62ce053d68f4a868fa48f951d56da1a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f62ce053d68f4a868fa48f951d56da1a" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 33029 } } peers { permanent_uuid: "93881c5b9b0648248e627ef7b541aec4" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 44419 } } peers { permanent_uuid: "5b2c1cd5f367458e811c859b7dbca333" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 40055 } }
I20260709 13:24:06.891888 18055 ts_tablet_manager.cc:1434] T 98bdadc834134483b31be48f35123bbd P 5b2c1cd5f367458e811c859b7dbca333: Time spent starting tablet: real 0.024s	user 0.003s	sys 0.007s
I20260709 13:24:06.891994 18081 leader_election.cc:290] T 274de930fd3e48b0a4a446dfeedcff85 P f62ce053d68f4a868fa48f951d56da1a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 93881c5b9b0648248e627ef7b541aec4 (127.5.126.66:44419), 5b2c1cd5f367458e811c859b7dbca333 (127.5.126.67:40055)
I20260709 13:24:06.893318 18055 tablet_bootstrap.cc:492] T 477afb2899ff459caf4d0eb55e840010 P 5b2c1cd5f367458e811c859b7dbca333: Bootstrap starting.
I20260709 13:24:06.893494 18056 tablet_bootstrap.cc:654] T 98bdadc834134483b31be48f35123bbd P f62ce053d68f4a868fa48f951d56da1a: Neither blocks nor log segments found. Creating new log.
I20260709 13:24:06.888057 18083 raft_consensus.cc:697] T e472f595f87a4a749248c7b7812b33d0 P f62ce053d68f4a868fa48f951d56da1a [term 1 LEADER]: Becoming Leader. State: Replica: f62ce053d68f4a868fa48f951d56da1a, State: Running, Role: LEADER
I20260709 13:24:06.896302 18015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "274de930fd3e48b0a4a446dfeedcff85" candidate_uuid: "f62ce053d68f4a868fa48f951d56da1a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5b2c1cd5f367458e811c859b7dbca333" is_pre_election: true
I20260709 13:24:06.896209 18083 consensus_queue.cc:237] T e472f595f87a4a749248c7b7812b33d0 P f62ce053d68f4a868fa48f951d56da1a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f62ce053d68f4a868fa48f951d56da1a" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 33029 } } peers { permanent_uuid: "93881c5b9b0648248e627ef7b541aec4" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 44419 } } peers { permanent_uuid: "5b2c1cd5f367458e811c859b7dbca333" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 40055 } }
I20260709 13:24:06.897269 18015 raft_consensus.cc:2468] T 274de930fd3e48b0a4a446dfeedcff85 P 5b2c1cd5f367458e811c859b7dbca333 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f62ce053d68f4a868fa48f951d56da1a in term 0.
I20260709 13:24:06.898718 17830 leader_election.cc:304] T 274de930fd3e48b0a4a446dfeedcff85 P f62ce053d68f4a868fa48f951d56da1a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b2c1cd5f367458e811c859b7dbca333, f62ce053d68f4a868fa48f951d56da1a; no voters: 
I20260709 13:24:06.899962 18057 consensus_queue.cc:260] T 93f7e8af061940dd82364fa3c6e69825 P 93881c5b9b0648248e627ef7b541aec4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f62ce053d68f4a868fa48f951d56da1a" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 33029 } } peers { permanent_uuid: "93881c5b9b0648248e627ef7b541aec4" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 44419 } } peers { permanent_uuid: "5b2c1cd5f367458e811c859b7dbca333" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 40055 } }
I20260709 13:24:06.901081 18081 raft_consensus.cc:2804] T 274de930fd3e48b0a4a446dfeedcff85 P f62ce053d68f4a868fa48f951d56da1a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:24:06.910341 18057 ts_tablet_manager.cc:1434] T 93f7e8af061940dd82364fa3c6e69825 P 93881c5b9b0648248e627ef7b541aec4: Time spent starting tablet: real 0.044s	user 0.006s	sys 0.007s
I20260709 13:24:06.911077 18056 tablet_bootstrap.cc:492] T 98bdadc834134483b31be48f35123bbd P f62ce053d68f4a868fa48f951d56da1a: No bootstrap required, opened a new log
I20260709 13:24:06.912298 18081 raft_consensus.cc:493] T 274de930fd3e48b0a4a446dfeedcff85 P f62ce053d68f4a868fa48f951d56da1a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:24:06.912755 18056 ts_tablet_manager.cc:1403] T 98bdadc834134483b31be48f35123bbd P f62ce053d68f4a868fa48f951d56da1a: Time spent bootstrapping tablet: real 0.027s	user 0.008s	sys 0.011s
I20260709 13:24:06.912724 18081 raft_consensus.cc:3060] T 274de930fd3e48b0a4a446dfeedcff85 P f62ce053d68f4a868fa48f951d56da1a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:24:06.913394 18057 tablet_bootstrap.cc:492] T 98bdadc834134483b31be48f35123bbd P 93881c5b9b0648248e627ef7b541aec4: Bootstrap starting.
I20260709 13:24:06.911453 18055 tablet_bootstrap.cc:654] T 477afb2899ff459caf4d0eb55e840010 P 5b2c1cd5f367458e811c859b7dbca333: Neither blocks nor log segments found. Creating new log.
I20260709 13:24:06.915717 18056 raft_consensus.cc:359] T 98bdadc834134483b31be48f35123bbd P f62ce053d68f4a868fa48f951d56da1a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f62ce053d68f4a868fa48f951d56da1a" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 33029 } } peers { permanent_uuid: "93881c5b9b0648248e627ef7b541aec4" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 44419 } } peers { permanent_uuid: "5b2c1cd5f367458e811c859b7dbca333" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 40055 } }
I20260709 13:24:06.916409 18056 raft_consensus.cc:385] T 98bdadc834134483b31be48f35123bbd P f62ce053d68f4a868fa48f951d56da1a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:24:06.916676 18056 raft_consensus.cc:740] T 98bdadc834134483b31be48f35123bbd P f62ce053d68f4a868fa48f951d56da1a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f62ce053d68f4a868fa48f951d56da1a, State: Initialized, Role: FOLLOWER
I20260709 13:24:06.917630 18056 consensus_queue.cc:260] T 98bdadc834134483b31be48f35123bbd P f62ce053d68f4a868fa48f951d56da1a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f62ce053d68f4a868fa48f951d56da1a" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 33029 } } peers { permanent_uuid: "93881c5b9b0648248e627ef7b541aec4" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 44419 } } peers { permanent_uuid: "5b2c1cd5f367458e811c859b7dbca333" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 40055 } }
I20260709 13:24:06.919991 18056 ts_tablet_manager.cc:1434] T 98bdadc834134483b31be48f35123bbd P f62ce053d68f4a868fa48f951d56da1a: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.001s
I20260709 13:24:06.894963 17941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "274de930fd3e48b0a4a446dfeedcff85" candidate_uuid: "f62ce053d68f4a868fa48f951d56da1a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "93881c5b9b0648248e627ef7b541aec4" is_pre_election: true
I20260709 13:24:06.920730 17941 raft_consensus.cc:2468] T 274de930fd3e48b0a4a446dfeedcff85 P 93881c5b9b0648248e627ef7b541aec4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f62ce053d68f4a868fa48f951d56da1a in term 0.
I20260709 13:24:06.921036 18056 tablet_bootstrap.cc:492] T 93f7e8af061940dd82364fa3c6e69825 P f62ce053d68f4a868fa48f951d56da1a: Bootstrap starting.
I20260709 13:24:06.923144 18081 raft_consensus.cc:515] T 274de930fd3e48b0a4a446dfeedcff85 P f62ce053d68f4a868fa48f951d56da1a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f62ce053d68f4a868fa48f951d56da1a" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 33029 } } peers { permanent_uuid: "93881c5b9b0648248e627ef7b541aec4" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 44419 } } peers { permanent_uuid: "5b2c1cd5f367458e811c859b7dbca333" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 40055 } }
I20260709 13:24:06.924845 18057 tablet_bootstrap.cc:654] T 98bdadc834134483b31be48f35123bbd P 93881c5b9b0648248e627ef7b541aec4: Neither blocks nor log segments found. Creating new log.
I20260709 13:24:06.926328 18062 raft_consensus.cc:493] T 66404f05eae74a7f938e85e5eae5cf72 P 5b2c1cd5f367458e811c859b7dbca333 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:24:06.926870 18062 raft_consensus.cc:515] T 66404f05eae74a7f938e85e5eae5cf72 P 5b2c1cd5f367458e811c859b7dbca333 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f62ce053d68f4a868fa48f951d56da1a" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 33029 } } peers { permanent_uuid: "93881c5b9b0648248e627ef7b541aec4" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 44419 } } peers { permanent_uuid: "5b2c1cd5f367458e811c859b7dbca333" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 40055 } }
I20260709 13:24:06.928188 18056 tablet_bootstrap.cc:654] T 93f7e8af061940dd82364fa3c6e69825 P f62ce053d68f4a868fa48f951d56da1a: Neither blocks nor log segments found. Creating new log.
I20260709 13:24:06.938719 18057 tablet_bootstrap.cc:492] T 98bdadc834134483b31be48f35123bbd P 93881c5b9b0648248e627ef7b541aec4: No bootstrap required, opened a new log
I20260709 13:24:06.939364 18057 ts_tablet_manager.cc:1403] T 98bdadc834134483b31be48f35123bbd P 93881c5b9b0648248e627ef7b541aec4: Time spent bootstrapping tablet: real 0.026s	user 0.016s	sys 0.004s
I20260709 13:24:06.940801 18055 tablet_bootstrap.cc:492] T 477afb2899ff459caf4d0eb55e840010 P 5b2c1cd5f367458e811c859b7dbca333: No bootstrap required, opened a new log
I20260709 13:24:06.941413 18055 ts_tablet_manager.cc:1403] T 477afb2899ff459caf4d0eb55e840010 P 5b2c1cd5f367458e811c859b7dbca333: Time spent bootstrapping tablet: real 0.048s	user 0.011s	sys 0.003s
I20260709 13:24:06.942492 18057 raft_consensus.cc:359] T 98bdadc834134483b31be48f35123bbd P 93881c5b9b0648248e627ef7b541aec4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f62ce053d68f4a868fa48f951d56da1a" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 33029 } } peers { permanent_uuid: "93881c5b9b0648248e627ef7b541aec4" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 44419 } } peers { permanent_uuid: "5b2c1cd5f367458e811c859b7dbca333" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 40055 } }
I20260709 13:24:06.943288 18057 raft_consensus.cc:385] T 98bdadc834134483b31be48f35123bbd P 93881c5b9b0648248e627ef7b541aec4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:24:06.943562 18057 raft_consensus.cc:740] T 98bdadc834134483b31be48f35123bbd P 93881c5b9b0648248e627ef7b541aec4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 93881c5b9b0648248e627ef7b541aec4, State: Initialized, Role: FOLLOWER
I20260709 13:24:06.944494 18057 consensus_queue.cc:260] T 98bdadc834134483b31be48f35123bbd P 93881c5b9b0648248e627ef7b541aec4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f62ce053d68f4a868fa48f951d56da1a" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 33029 } } peers { permanent_uuid: "93881c5b9b0648248e627ef7b541aec4" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 44419 } } peers { permanent_uuid: "5b2c1cd5f367458e811c859b7dbca333" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 40055 } }
I20260709 13:24:06.944684 18055 raft_consensus.cc:359] T 477afb2899ff459caf4d0eb55e840010 P 5b2c1cd5f367458e811c859b7dbca333 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f62ce053d68f4a868fa48f951d56da1a" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 33029 } } peers { permanent_uuid: "93881c5b9b0648248e627ef7b541aec4" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 44419 } } peers { permanent_uuid: "5b2c1cd5f367458e811c859b7dbca333" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 40055 } }
I20260709 13:24:06.945415 18055 raft_consensus.cc:385] T 477afb2899ff459caf4d0eb55e840010 P 5b2c1cd5f367458e811c859b7dbca333 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:24:06.945725 18055 raft_consensus.cc:740] T 477afb2899ff459caf4d0eb55e840010 P 5b2c1cd5f367458e811c859b7dbca333 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5b2c1cd5f367458e811c859b7dbca333, State: Initialized, Role: FOLLOWER
I20260709 13:24:06.947383 18057 ts_tablet_manager.cc:1434] T 98bdadc834134483b31be48f35123bbd P 93881c5b9b0648248e627ef7b541aec4: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 13:24:06.948953 18062 leader_election.cc:290] T 66404f05eae74a7f938e85e5eae5cf72 P 5b2c1cd5f367458e811c859b7dbca333 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f62ce053d68f4a868fa48f951d56da1a (127.5.126.65:33029), 93881c5b9b0648248e627ef7b541aec4 (127.5.126.66:44419)
I20260709 13:24:06.950124 18055 consensus_queue.cc:260] T 477afb2899ff459caf4d0eb55e840010 P 5b2c1cd5f367458e811c859b7dbca333 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f62ce053d68f4a868fa48f951d56da1a" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 33029 } } peers { permanent_uuid: "93881c5b9b0648248e627ef7b541aec4" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 44419 } } peers { permanent_uuid: "5b2c1cd5f367458e811c859b7dbca333" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 40055 } }
I20260709 13:24:06.952620 18055 ts_tablet_manager.cc:1434] T 477afb2899ff459caf4d0eb55e840010 P 5b2c1cd5f367458e811c859b7dbca333: Time spent starting tablet: real 0.011s	user 0.008s	sys 0.000s
I20260709 13:24:06.954347 18055 tablet_bootstrap.cc:492] T b8a4f81761e3423fa8d2e3144b6b4ca8 P 5b2c1cd5f367458e811c859b7dbca333: Bootstrap starting.
I20260709 13:24:06.962581 18055 tablet_bootstrap.cc:654] T b8a4f81761e3423fa8d2e3144b6b4ca8 P 5b2c1cd5f367458e811c859b7dbca333: Neither blocks nor log segments found. Creating new log.
I20260709 13:24:06.971096 17941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "274de930fd3e48b0a4a446dfeedcff85" candidate_uuid: "f62ce053d68f4a868fa48f951d56da1a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "93881c5b9b0648248e627ef7b541aec4"
I20260709 13:24:06.972460 17941 raft_consensus.cc:3060] T 274de930fd3e48b0a4a446dfeedcff85 P 93881c5b9b0648248e627ef7b541aec4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:24:06.977372 18083 raft_consensus.cc:493] T 477afb2899ff459caf4d0eb55e840010 P f62ce053d68f4a868fa48f951d56da1a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:24:06.978479 18083 raft_consensus.cc:515] T 477afb2899ff459caf4d0eb55e840010 P f62ce053d68f4a868fa48f951d56da1a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f62ce053d68f4a868fa48f951d56da1a" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 33029 } } peers { permanent_uuid: "93881c5b9b0648248e627ef7b541aec4" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 44419 } } peers { permanent_uuid: "5b2c1cd5f367458e811c859b7dbca333" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 40055 } }
I20260709 13:24:06.979226 17764 catalog_manager.cc:5697] T e472f595f87a4a749248c7b7812b33d0 P f62ce053d68f4a868fa48f951d56da1a reported cstate change: term changed from 0 to 1, leader changed from <none> to f62ce053d68f4a868fa48f951d56da1a (127.5.126.65). New cstate: current_term: 1 leader_uuid: "f62ce053d68f4a868fa48f951d56da1a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f62ce053d68f4a868fa48f951d56da1a" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 33029 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "93881c5b9b0648248e627ef7b541aec4" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 44419 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5b2c1cd5f367458e811c859b7dbca333" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 40055 } health_report { overall_health: UNKNOWN } } }
I20260709 13:24:06.982828 18083 leader_election.cc:290] T 477afb2899ff459caf4d0eb55e840010 P f62ce053d68f4a868fa48f951d56da1a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 93881c5b9b0648248e627ef7b541aec4 (127.5.126.66:44419), 5b2c1cd5f367458e811c859b7dbca333 (127.5.126.67:40055)
I20260709 13:24:06.984405 18015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "477afb2899ff459caf4d0eb55e840010" candidate_uuid: "f62ce053d68f4a868fa48f951d56da1a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5b2c1cd5f367458e811c859b7dbca333" is_pre_election: true
I20260709 13:24:06.999358 18015 raft_consensus.cc:2468] T 477afb2899ff459caf4d0eb55e840010 P 5b2c1cd5f367458e811c859b7dbca333 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f62ce053d68f4a868fa48f951d56da1a in term 0.
I20260709 13:24:06.986181 17940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "477afb2899ff459caf4d0eb55e840010" candidate_uuid: "f62ce053d68f4a868fa48f951d56da1a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "93881c5b9b0648248e627ef7b541aec4" is_pre_election: true
I20260709 13:24:07.000588 17940 raft_consensus.cc:2468] T 477afb2899ff459caf4d0eb55e840010 P 93881c5b9b0648248e627ef7b541aec4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f62ce053d68f4a868fa48f951d56da1a in term 0.
I20260709 13:24:07.000660 18014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "274de930fd3e48b0a4a446dfeedcff85" candidate_uuid: "f62ce053d68f4a868fa48f951d56da1a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5b2c1cd5f367458e811c859b7dbca333"
I20260709 13:24:06.992410 18061 raft_consensus.cc:493] T d3bd24e790d3483185e9f89c8521831b P 93881c5b9b0648248e627ef7b541aec4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:24:06.994711 18062 raft_consensus.cc:493] T d3bd24e790d3483185e9f89c8521831b P 5b2c1cd5f367458e811c859b7dbca333 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:24:06.998420 18081 leader_election.cc:290] T 274de930fd3e48b0a4a446dfeedcff85 P f62ce053d68f4a868fa48f951d56da1a [CANDIDATE]: Term 1 election: Requested vote from peers 93881c5b9b0648248e627ef7b541aec4 (127.5.126.66:44419), 5b2c1cd5f367458e811c859b7dbca333 (127.5.126.67:40055)
I20260709 13:24:07.001924 17830 leader_election.cc:304] T 477afb2899ff459caf4d0eb55e840010 P f62ce053d68f4a868fa48f951d56da1a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b2c1cd5f367458e811c859b7dbca333, f62ce053d68f4a868fa48f951d56da1a; no voters: 
I20260709 13:24:07.002972 18061 raft_consensus.cc:515] T d3bd24e790d3483185e9f89c8521831b P 93881c5b9b0648248e627ef7b541aec4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b2c1cd5f367458e811c859b7dbca333" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 40055 } } peers { permanent_uuid: "93881c5b9b0648248e627ef7b541aec4" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 44419 } } peers { permanent_uuid: "f62ce053d68f4a868fa48f951d56da1a" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 33029 } }
I20260709 13:24:07.001921 18014 raft_consensus.cc:3060] T 274de930fd3e48b0a4a446dfeedcff85 P 5b2c1cd5f367458e811c859b7dbca333 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:24:07.003468 18062 raft_consensus.cc:515] T d3bd24e790d3483185e9f89c8521831b P 5b2c1cd5f367458e811c859b7dbca333 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b2c1cd5f367458e811c859b7dbca333" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 40055 } } peers { permanent_uuid: "93881c5b9b0648248e627ef7b541aec4" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 44419 } } peers { permanent_uuid: "f62ce053d68f4a868fa48f951d56da1a" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 33029 } }
I20260709 13:24:07.010682 18062 leader_election.cc:290] T d3bd24e790d3483185e9f89c8521831b P 5b2c1cd5f367458e811c859b7dbca333 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 93881c5b9b0648248e627ef7b541aec4 (127.5.126.66:44419), f62ce053d68f4a868fa48f951d56da1a (127.5.126.65:33029)
I20260709 13:24:07.017788 18055 tablet_bootstrap.cc:492] T b8a4f81761e3423fa8d2e3144b6b4ca8 P 5b2c1cd5f367458e811c859b7dbca333: No bootstrap required, opened a new log
I20260709 13:24:07.018749 18055 ts_tablet_manager.cc:1403] T b8a4f81761e3423fa8d2e3144b6b4ca8 P 5b2c1cd5f367458e811c859b7dbca333: Time spent bootstrapping tablet: real 0.065s	user 0.019s	sys 0.020s
I20260709 13:24:07.014482 18081 raft_consensus.cc:2804] T 477afb2899ff459caf4d0eb55e840010 P f62ce053d68f4a868fa48f951d56da1a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:24:07.020720 18061 leader_election.cc:290] T d3bd24e790d3483185e9f89c8521831b P 93881c5b9b0648248e627ef7b541aec4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5b2c1cd5f367458e811c859b7dbca333 (127.5.126.67:40055), f62ce053d68f4a868fa48f951d56da1a (127.5.126.65:33029)
I20260709 13:24:07.021899 18083 raft_consensus.cc:493] T 98bdadc834134483b31be48f35123bbd P f62ce053d68f4a868fa48f951d56da1a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:24:07.020360 18081 raft_consensus.cc:493] T 477afb2899ff459caf4d0eb55e840010 P f62ce053d68f4a868fa48f951d56da1a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:24:07.032143 18081 raft_consensus.cc:3060] T 477afb2899ff459caf4d0eb55e840010 P f62ce053d68f4a868fa48f951d56da1a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:24:07.031617 18083 raft_consensus.cc:515] T 98bdadc834134483b31be48f35123bbd P f62ce053d68f4a868fa48f951d56da1a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f62ce053d68f4a868fa48f951d56da1a" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 33029 } } peers { permanent_uuid: "93881c5b9b0648248e627ef7b541aec4" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 44419 } } peers { permanent_uuid: "5b2c1cd5f367458e811c859b7dbca333" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 40055 } }
I20260709 13:24:07.034857 17940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66404f05eae74a7f938e85e5eae5cf72" candidate_uuid: "5b2c1cd5f367458e811c859b7dbca333" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "93881c5b9b0648248e627ef7b541aec4" is_pre_election: true
I20260709 13:24:07.035696 17940 raft_consensus.cc:2468] T 66404f05eae74a7f938e85e5eae5cf72 P 93881c5b9b0648248e627ef7b541aec4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b2c1cd5f367458e811c859b7dbca333 in term 0.
I20260709 13:24:07.036371 18083 leader_election.cc:290] T 98bdadc834134483b31be48f35123bbd P f62ce053d68f4a868fa48f951d56da1a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 93881c5b9b0648248e627ef7b541aec4 (127.5.126.66:44419), 5b2c1cd5f367458e811c859b7dbca333 (127.5.126.67:40055)
I20260709 13:24:07.037423 17939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3bd24e790d3483185e9f89c8521831b" candidate_uuid: "5b2c1cd5f367458e811c859b7dbca333" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "93881c5b9b0648248e627ef7b541aec4" is_pre_election: true
I20260709 13:24:07.037811 18055 raft_consensus.cc:359] T b8a4f81761e3423fa8d2e3144b6b4ca8 P 5b2c1cd5f367458e811c859b7dbca333 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f62ce053d68f4a868fa48f951d56da1a" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 33029 } } peers { permanent_uuid: "93881c5b9b0648248e627ef7b541aec4" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 44419 } } peers { permanent_uuid: "5b2c1cd5f367458e811c859b7dbca333" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 40055 } }
I20260709 13:24:07.038260 17939 raft_consensus.cc:2468] T d3bd24e790d3483185e9f89c8521831b P 93881c5b9b0648248e627ef7b541aec4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b2c1cd5f367458e811c859b7dbca333 in term 0.
I20260709 13:24:07.038661 18055 raft_consensus.cc:385] T b8a4f81761e3423fa8d2e3144b6b4ca8 P 5b2c1cd5f367458e811c859b7dbca333 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:24:07.038991 18055 raft_consensus.cc:740] T b8a4f81761e3423fa8d2e3144b6b4ca8 P 5b2c1cd5f367458e811c859b7dbca333 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5b2c1cd5f367458e811c859b7dbca333, State: Initialized, Role: FOLLOWER
I20260709 13:24:07.039142 17866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66404f05eae74a7f938e85e5eae5cf72" candidate_uuid: "5b2c1cd5f367458e811c859b7dbca333" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f62ce053d68f4a868fa48f951d56da1a" is_pre_election: true
I20260709 13:24:07.039696 17865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3bd24e790d3483185e9f89c8521831b" candidate_uuid: "5b2c1cd5f367458e811c859b7dbca333" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f62ce053d68f4a868fa48f951d56da1a" is_pre_election: true
I20260709 13:24:07.040619 18055 consensus_queue.cc:260] T b8a4f81761e3423fa8d2e3144b6b4ca8 P 5b2c1cd5f367458e811c859b7dbca333 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f62ce053d68f4a868fa48f951d56da1a" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 33029 } } peers { permanent_uuid: "93881c5b9b0648248e627ef7b541aec4" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 44419 } } peers { permanent_uuid: "5b2c1cd5f367458e811c859b7dbca333" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 40055 } }
I20260709 13:24:07.041036 17865 raft_consensus.cc:2468] T d3bd24e790d3483185e9f89c8521831b P f62ce053d68f4a868fa48f951d56da1a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b2c1cd5f367458e811c859b7dbca333 in term 0.
I20260709 13:24:07.041081 18015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98bdadc834134483b31be48f35123bbd" candidate_uuid: "f62ce053d68f4a868fa48f951d56da1a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5b2c1cd5f367458e811c859b7dbca333" is_pre_election: true
I20260709 13:24:07.041867 18015 raft_consensus.cc:2468] T 98bdadc834134483b31be48f35123bbd P 5b2c1cd5f367458e811c859b7dbca333 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f62ce053d68f4a868fa48f951d56da1a in term 0.
I20260709 13:24:07.040066 17866 raft_consensus.cc:2468] T 66404f05eae74a7f938e85e5eae5cf72 P f62ce053d68f4a868fa48f951d56da1a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b2c1cd5f367458e811c859b7dbca333 in term 0.
I20260709 13:24:07.044441 17979 leader_election.cc:304] T 66404f05eae74a7f938e85e5eae5cf72 P 5b2c1cd5f367458e811c859b7dbca333 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b2c1cd5f367458e811c859b7dbca333, 93881c5b9b0648248e627ef7b541aec4; no voters: 
I20260709 13:24:07.046334 17978 leader_election.cc:304] T d3bd24e790d3483185e9f89c8521831b P 5b2c1cd5f367458e811c859b7dbca333 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b2c1cd5f367458e811c859b7dbca333, f62ce053d68f4a868fa48f951d56da1a; no voters: 
I20260709 13:24:07.032279 17941 raft_consensus.cc:2468] T 274de930fd3e48b0a4a446dfeedcff85 P 93881c5b9b0648248e627ef7b541aec4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f62ce053d68f4a868fa48f951d56da1a in term 1.
I20260709 13:24:07.046955 18062 raft_consensus.cc:2804] T 66404f05eae74a7f938e85e5eae5cf72 P 5b2c1cd5f367458e811c859b7dbca333 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:24:07.047468 18062 raft_consensus.cc:493] T 66404f05eae74a7f938e85e5eae5cf72 P 5b2c1cd5f367458e811c859b7dbca333 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:24:07.047902 18062 raft_consensus.cc:3060] T 66404f05eae74a7f938e85e5eae5cf72 P 5b2c1cd5f367458e811c859b7dbca333 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:24:07.049786 17830 leader_election.cc:304] T 98bdadc834134483b31be48f35123bbd P f62ce053d68f4a868fa48f951d56da1a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b2c1cd5f367458e811c859b7dbca333, f62ce053d68f4a868fa48f951d56da1a; no voters: 
I20260709 13:24:07.051010 17830 leader_election.cc:304] T 274de930fd3e48b0a4a446dfeedcff85 P f62ce053d68f4a868fa48f951d56da1a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 93881c5b9b0648248e627ef7b541aec4, f62ce053d68f4a868fa48f951d56da1a; no voters: 
I20260709 13:24:07.051138 17866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3bd24e790d3483185e9f89c8521831b" candidate_uuid: "93881c5b9b0648248e627ef7b541aec4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f62ce053d68f4a868fa48f951d56da1a" is_pre_election: true
I20260709 13:24:07.052469 17866 raft_consensus.cc:2468] T d3bd24e790d3483185e9f89c8521831b P f62ce053d68f4a868fa48f951d56da1a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 93881c5b9b0648248e627ef7b541aec4 in term 0.
I20260709 13:24:07.052562 18064 raft_consensus.cc:2804] T 274de930fd3e48b0a4a446dfeedcff85 P f62ce053d68f4a868fa48f951d56da1a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:24:07.051671 18083 raft_consensus.cc:2804] T 98bdadc834134483b31be48f35123bbd P f62ce053d68f4a868fa48f951d56da1a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:24:07.053115 18064 raft_consensus.cc:697] T 274de930fd3e48b0a4a446dfeedcff85 P f62ce053d68f4a868fa48f951d56da1a [term 1 LEADER]: Becoming Leader. State: Replica: f62ce053d68f4a868fa48f951d56da1a, State: Running, Role: LEADER
I20260709 13:24:07.053409 18083 raft_consensus.cc:493] T 98bdadc834134483b31be48f35123bbd P f62ce053d68f4a868fa48f951d56da1a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:24:07.053812 18083 raft_consensus.cc:3060] T 98bdadc834134483b31be48f35123bbd P f62ce053d68f4a868fa48f951d56da1a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:24:07.054064 18064 consensus_queue.cc:237] T 274de930fd3e48b0a4a446dfeedcff85 P f62ce053d68f4a868fa48f951d56da1a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f62ce053d68f4a868fa48f951d56da1a" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 33029 } } peers { permanent_uuid: "93881c5b9b0648248e627ef7b541aec4" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 44419 } } peers { permanent_uuid: "5b2c1cd5f367458e811c859b7dbca333" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 40055 } }
I20260709 13:24:07.055436 17941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98bdadc834134483b31be48f35123bbd" candidate_uuid: "f62ce053d68f4a868fa48f951d56da1a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "93881c5b9b0648248e627ef7b541aec4" is_pre_election: true
I20260709 13:24:07.056384 17941 raft_consensus.cc:2468] T 98bdadc834134483b31be48f35123bbd P 93881c5b9b0648248e627ef7b541aec4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f62ce053d68f4a868fa48f951d56da1a in term 0.
I20260709 13:24:07.056911 17904 leader_election.cc:304] T d3bd24e790d3483185e9f89c8521831b P 93881c5b9b0648248e627ef7b541aec4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 93881c5b9b0648248e627ef7b541aec4, f62ce053d68f4a868fa48f951d56da1a; no voters: 
I20260709 13:24:07.057507 18056 tablet_bootstrap.cc:492] T 93f7e8af061940dd82364fa3c6e69825 P f62ce053d68f4a868fa48f951d56da1a: No bootstrap required, opened a new log
I20260709 13:24:07.057116 18062 raft_consensus.cc:515] T 66404f05eae74a7f938e85e5eae5cf72 P 5b2c1cd5f367458e811c859b7dbca333 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f62ce053d68f4a868fa48f951d56da1a" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 33029 } } peers { permanent_uuid: "93881c5b9b0648248e627ef7b541aec4" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 44419 } } peers { permanent_uuid: "5b2c1cd5f367458e811c859b7dbca333" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 40055 } }
I20260709 13:24:07.058027 18056 ts_tablet_manager.cc:1403] T 93f7e8af061940dd82364fa3c6e69825 P f62ce053d68f4a868fa48f951d56da1a: Time spent bootstrapping tablet: real 0.137s	user 0.022s	sys 0.061s
I20260709 13:24:07.045660 18055 ts_tablet_manager.cc:1434] T b8a4f81761e3423fa8d2e3144b6b4ca8 P 5b2c1cd5f367458e811c859b7dbca333: Time spent starting tablet: real 0.027s	user 0.005s	sys 0.001s
I20260709 13:24:07.059392 18055 tablet_bootstrap.cc:492] T 93f7e8af061940dd82364fa3c6e69825 P 5b2c1cd5f367458e811c859b7dbca333: Bootstrap starting.
I20260709 13:24:07.060478 18062 leader_election.cc:290] T 66404f05eae74a7f938e85e5eae5cf72 P 5b2c1cd5f367458e811c859b7dbca333 [CANDIDATE]: Term 1 election: Requested vote from peers f62ce053d68f4a868fa48f951d56da1a (127.5.126.65:33029), 93881c5b9b0648248e627ef7b541aec4 (127.5.126.66:44419)
I20260709 13:24:07.060766 18061 raft_consensus.cc:2804] T d3bd24e790d3483185e9f89c8521831b P 93881c5b9b0648248e627ef7b541aec4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:24:07.061169 18062 raft_consensus.cc:2804] T d3bd24e790d3483185e9f89c8521831b P 5b2c1cd5f367458e811c859b7dbca333 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:24:07.061251 18061 raft_consensus.cc:493] T d3bd24e790d3483185e9f89c8521831b P 93881c5b9b0648248e627ef7b541aec4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:24:07.061700 18062 raft_consensus.cc:493] T d3bd24e790d3483185e9f89c8521831b P 5b2c1cd5f367458e811c859b7dbca333 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:24:07.061921 18061 raft_consensus.cc:3060] T d3bd24e790d3483185e9f89c8521831b P 93881c5b9b0648248e627ef7b541aec4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:24:07.062222 18062 raft_consensus.cc:3060] T d3bd24e790d3483185e9f89c8521831b P 5b2c1cd5f367458e811c859b7dbca333 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:24:07.069016 18056 raft_consensus.cc:359] T 93f7e8af061940dd82364fa3c6e69825 P f62ce053d68f4a868fa48f951d56da1a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f62ce053d68f4a868fa48f951d56da1a" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 33029 } } peers { permanent_uuid: "93881c5b9b0648248e627ef7b541aec4" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 44419 } } peers { permanent_uuid: "5b2c1cd5f367458e811c859b7dbca333" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 40055 } }
I20260709 13:24:07.069979 18056 raft_consensus.cc:385] T 93f7e8af061940dd82364fa3c6e69825 P f62ce053d68f4a868fa48f951d56da1a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:24:07.070238 18056 raft_consensus.cc:740] T 93f7e8af061940dd82364fa3c6e69825 P f62ce053d68f4a868fa48f951d56da1a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f62ce053d68f4a868fa48f951d56da1a, State: Initialized, Role: FOLLOWER
I20260709 13:24:07.071000 18056 consensus_queue.cc:260] T 93f7e8af061940dd82364fa3c6e69825 P f62ce053d68f4a868fa48f951d56da1a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f62ce053d68f4a868fa48f951d56da1a" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 33029 } } peers { permanent_uuid: "93881c5b9b0648248e627ef7b541aec4" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 44419 } } peers { permanent_uuid: "5b2c1cd5f367458e811c859b7dbca333" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 40055 } }
I20260709 13:24:07.071705 17941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66404f05eae74a7f938e85e5eae5cf72" candidate_uuid: "5b2c1cd5f367458e811c859b7dbca333" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "93881c5b9b0648248e627ef7b541aec4"
I20260709 13:24:07.072463 17941 raft_consensus.cc:3060] T 66404f05eae74a7f938e85e5eae5cf72 P 93881c5b9b0648248e627ef7b541aec4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:24:07.075001 18056 ts_tablet_manager.cc:1434] T 93f7e8af061940dd82364fa3c6e69825 P f62ce053d68f4a868fa48f951d56da1a: Time spent starting tablet: real 0.017s	user 0.006s	sys 0.000s
I20260709 13:24:07.076561 18081 raft_consensus.cc:515] T 477afb2899ff459caf4d0eb55e840010 P f62ce053d68f4a868fa48f951d56da1a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f62ce053d68f4a868fa48f951d56da1a" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 33029 } } peers { permanent_uuid: "93881c5b9b0648248e627ef7b541aec4" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 44419 } } peers { permanent_uuid: "5b2c1cd5f367458e811c859b7dbca333" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 40055 } }
I20260709 13:24:07.078377 17866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66404f05eae74a7f938e85e5eae5cf72" candidate_uuid: "5b2c1cd5f367458e811c859b7dbca333" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f62ce053d68f4a868fa48f951d56da1a"
I20260709 13:24:07.079018 17866 raft_consensus.cc:3060] T 66404f05eae74a7f938e85e5eae5cf72 P f62ce053d68f4a868fa48f951d56da1a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:24:07.079254 18081 leader_election.cc:290] T 477afb2899ff459caf4d0eb55e840010 P f62ce053d68f4a868fa48f951d56da1a [CANDIDATE]: Term 1 election: Requested vote from peers 93881c5b9b0648248e627ef7b541aec4 (127.5.126.66:44419), 5b2c1cd5f367458e811c859b7dbca333 (127.5.126.67:40055)
I20260709 13:24:07.080271 17939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "477afb2899ff459caf4d0eb55e840010" candidate_uuid: "f62ce053d68f4a868fa48f951d56da1a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "93881c5b9b0648248e627ef7b541aec4"
I20260709 13:24:07.081048 17939 raft_consensus.cc:3060] T 477afb2899ff459caf4d0eb55e840010 P 93881c5b9b0648248e627ef7b541aec4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:24:07.081625 18014 raft_consensus.cc:2468] T 274de930fd3e48b0a4a446dfeedcff85 P 5b2c1cd5f367458e811c859b7dbca333 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f62ce053d68f4a868fa48f951d56da1a in term 1.
I20260709 13:24:07.086117 18014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "477afb2899ff459caf4d0eb55e840010" candidate_uuid: "f62ce053d68f4a868fa48f951d56da1a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5b2c1cd5f367458e811c859b7dbca333"
I20260709 13:24:07.086786 18014 raft_consensus.cc:3060] T 477afb2899ff459caf4d0eb55e840010 P 5b2c1cd5f367458e811c859b7dbca333 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:24:07.089366 18062 raft_consensus.cc:515] T d3bd24e790d3483185e9f89c8521831b P 5b2c1cd5f367458e811c859b7dbca333 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b2c1cd5f367458e811c859b7dbca333" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 40055 } } peers { permanent_uuid: "93881c5b9b0648248e627ef7b541aec4" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 44419 } } peers { permanent_uuid: "f62ce053d68f4a868fa48f951d56da1a" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 33029 } }
I20260709 13:24:07.092418 18062 leader_election.cc:290] T d3bd24e790d3483185e9f89c8521831b P 5b2c1cd5f367458e811c859b7dbca333 [CANDIDATE]: Term 1 election: Requested vote from peers 93881c5b9b0648248e627ef7b541aec4 (127.5.126.66:44419), f62ce053d68f4a868fa48f951d56da1a (127.5.126.65:33029)
I20260709 13:24:07.093497 17940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3bd24e790d3483185e9f89c8521831b" candidate_uuid: "5b2c1cd5f367458e811c859b7dbca333" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "93881c5b9b0648248e627ef7b541aec4"
I20260709 13:24:07.093905 17865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3bd24e790d3483185e9f89c8521831b" candidate_uuid: "5b2c1cd5f367458e811c859b7dbca333" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f62ce053d68f4a868fa48f951d56da1a"
I20260709 13:24:07.094529 17865 raft_consensus.cc:3060] T d3bd24e790d3483185e9f89c8521831b P f62ce053d68f4a868fa48f951d56da1a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:24:07.097254 18055 tablet_bootstrap.cc:654] T 93f7e8af061940dd82364fa3c6e69825 P 5b2c1cd5f367458e811c859b7dbca333: Neither blocks nor log segments found. Creating new log.
I20260709 13:24:07.098342 18014 raft_consensus.cc:2468] T 477afb2899ff459caf4d0eb55e840010 P 5b2c1cd5f367458e811c859b7dbca333 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f62ce053d68f4a868fa48f951d56da1a in term 1.
I20260709 13:24:07.099793 17830 leader_election.cc:304] T 477afb2899ff459caf4d0eb55e840010 P f62ce053d68f4a868fa48f951d56da1a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b2c1cd5f367458e811c859b7dbca333, f62ce053d68f4a868fa48f951d56da1a; no voters: 
I20260709 13:24:07.099987 17939 raft_consensus.cc:2468] T 477afb2899ff459caf4d0eb55e840010 P 93881c5b9b0648248e627ef7b541aec4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f62ce053d68f4a868fa48f951d56da1a in term 1.
I20260709 13:24:07.102569 18081 raft_consensus.cc:2804] T 477afb2899ff459caf4d0eb55e840010 P f62ce053d68f4a868fa48f951d56da1a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:24:07.103156 18081 raft_consensus.cc:697] T 477afb2899ff459caf4d0eb55e840010 P f62ce053d68f4a868fa48f951d56da1a [term 1 LEADER]: Becoming Leader. State: Replica: f62ce053d68f4a868fa48f951d56da1a, State: Running, Role: LEADER
I20260709 13:24:07.105509 17941 raft_consensus.cc:2468] T 66404f05eae74a7f938e85e5eae5cf72 P 93881c5b9b0648248e627ef7b541aec4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5b2c1cd5f367458e811c859b7dbca333 in term 1.
I20260709 13:24:07.105195 17865 raft_consensus.cc:2468] T d3bd24e790d3483185e9f89c8521831b P f62ce053d68f4a868fa48f951d56da1a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5b2c1cd5f367458e811c859b7dbca333 in term 1.
I20260709 13:24:07.104157 18081 consensus_queue.cc:237] T 477afb2899ff459caf4d0eb55e840010 P f62ce053d68f4a868fa48f951d56da1a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f62ce053d68f4a868fa48f951d56da1a" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 33029 } } peers { permanent_uuid: "93881c5b9b0648248e627ef7b541aec4" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 44419 } } peers { permanent_uuid: "5b2c1cd5f367458e811c859b7dbca333" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 40055 } }
I20260709 13:24:07.109388 17979 leader_election.cc:304] T 66404f05eae74a7f938e85e5eae5cf72 P 5b2c1cd5f367458e811c859b7dbca333 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b2c1cd5f367458e811c859b7dbca333, 93881c5b9b0648248e627ef7b541aec4; no voters: 
I20260709 13:24:07.109910 17978 leader_election.cc:304] T d3bd24e790d3483185e9f89c8521831b P 5b2c1cd5f367458e811c859b7dbca333 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b2c1cd5f367458e811c859b7dbca333, f62ce053d68f4a868fa48f951d56da1a; no voters: 
I20260709 13:24:07.110790 18062 raft_consensus.cc:2804] T 66404f05eae74a7f938e85e5eae5cf72 P 5b2c1cd5f367458e811c859b7dbca333 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:24:07.112113 18102 raft_consensus.cc:2804] T d3bd24e790d3483185e9f89c8521831b P 5b2c1cd5f367458e811c859b7dbca333 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:24:07.112442 17866 raft_consensus.cc:2468] T 66404f05eae74a7f938e85e5eae5cf72 P f62ce053d68f4a868fa48f951d56da1a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5b2c1cd5f367458e811c859b7dbca333 in term 1.
I20260709 13:24:07.105509 18061 raft_consensus.cc:515] T d3bd24e790d3483185e9f89c8521831b P 93881c5b9b0648248e627ef7b541aec4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b2c1cd5f367458e811c859b7dbca333" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 40055 } } peers { permanent_uuid: "93881c5b9b0648248e627ef7b541aec4" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 44419 } } peers { permanent_uuid: "f62ce053d68f4a868fa48f951d56da1a" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 33029 } }
I20260709 13:24:07.128124 18062 raft_consensus.cc:697] T 66404f05eae74a7f938e85e5eae5cf72 P 5b2c1cd5f367458e811c859b7dbca333 [term 1 LEADER]: Becoming Leader. State: Replica: 5b2c1cd5f367458e811c859b7dbca333, State: Running, Role: LEADER
I20260709 13:24:07.127633 18014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3bd24e790d3483185e9f89c8521831b" candidate_uuid: "93881c5b9b0648248e627ef7b541aec4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5b2c1cd5f367458e811c859b7dbca333" is_pre_election: true
I20260709 13:24:07.130432 17940 raft_consensus.cc:2393] T d3bd24e790d3483185e9f89c8521831b P 93881c5b9b0648248e627ef7b541aec4 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 5b2c1cd5f367458e811c859b7dbca333 in current term 1: Already voted for candidate 93881c5b9b0648248e627ef7b541aec4 in this term.
I20260709 13:24:07.137842 18015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3bd24e790d3483185e9f89c8521831b" candidate_uuid: "93881c5b9b0648248e627ef7b541aec4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5b2c1cd5f367458e811c859b7dbca333"
I20260709 13:24:07.138392 18061 leader_election.cc:290] T d3bd24e790d3483185e9f89c8521831b P 93881c5b9b0648248e627ef7b541aec4 [CANDIDATE]: Term 1 election: Requested vote from peers 5b2c1cd5f367458e811c859b7dbca333 (127.5.126.67:40055), f62ce053d68f4a868fa48f951d56da1a (127.5.126.65:33029)
I20260709 13:24:07.140105 18055 tablet_bootstrap.cc:492] T 93f7e8af061940dd82364fa3c6e69825 P 5b2c1cd5f367458e811c859b7dbca333: No bootstrap required, opened a new log
I20260709 13:24:07.140625 18055 ts_tablet_manager.cc:1403] T 93f7e8af061940dd82364fa3c6e69825 P 5b2c1cd5f367458e811c859b7dbca333: Time spent bootstrapping tablet: real 0.081s	user 0.019s	sys 0.014s
I20260709 13:24:07.139181 17764 catalog_manager.cc:5697] T 274de930fd3e48b0a4a446dfeedcff85 P f62ce053d68f4a868fa48f951d56da1a reported cstate change: term changed from 0 to 1, leader changed from <none> to f62ce053d68f4a868fa48f951d56da1a (127.5.126.65). New cstate: current_term: 1 leader_uuid: "f62ce053d68f4a868fa48f951d56da1a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f62ce053d68f4a868fa48f951d56da1a" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 33029 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "93881c5b9b0648248e627ef7b541aec4" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 44419 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5b2c1cd5f367458e811c859b7dbca333" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 40055 } health_report { overall_health: UNKNOWN } } }
I20260709 13:24:07.142838 18055 raft_consensus.cc:359] T 93f7e8af061940dd82364fa3c6e69825 P 5b2c1cd5f367458e811c859b7dbca333 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f62ce053d68f4a868fa48f951d56da1a" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 33029 } } peers { permanent_uuid: "93881c5b9b0648248e627ef7b541aec4" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 44419 } } peers { permanent_uuid: "5b2c1cd5f367458e811c859b7dbca333" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 40055 } }
I20260709 13:24:07.143385 18055 raft_consensus.cc:385] T 93f7e8af061940dd82364fa3c6e69825 P 5b2c1cd5f367458e811c859b7dbca333 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:24:07.143602 18055 raft_consensus.cc:740] T 93f7e8af061940dd82364fa3c6e69825 P 5b2c1cd5f367458e811c859b7dbca333 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5b2c1cd5f367458e811c859b7dbca333, State: Initialized, Role: FOLLOWER
I20260709 13:24:07.144659 17866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3bd24e790d3483185e9f89c8521831b" candidate_uuid: "93881c5b9b0648248e627ef7b541aec4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f62ce053d68f4a868fa48f951d56da1a"
I20260709 13:24:07.144958 18083 raft_consensus.cc:515] T 98bdadc834134483b31be48f35123bbd P f62ce053d68f4a868fa48f951d56da1a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f62ce053d68f4a868fa48f951d56da1a" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 33029 } } peers { permanent_uuid: "93881c5b9b0648248e627ef7b541aec4" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 44419 } } peers { permanent_uuid: "5b2c1cd5f367458e811c859b7dbca333" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 40055 } }
I20260709 13:24:07.146181 17866 raft_consensus.cc:2393] T d3bd24e790d3483185e9f89c8521831b P f62ce053d68f4a868fa48f951d56da1a [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 93881c5b9b0648248e627ef7b541aec4 in current term 1: Already voted for candidate 5b2c1cd5f367458e811c859b7dbca333 in this term.
I20260709 13:24:07.147238 18083 leader_election.cc:290] T 98bdadc834134483b31be48f35123bbd P f62ce053d68f4a868fa48f951d56da1a [CANDIDATE]: Term 1 election: Requested vote from peers 93881c5b9b0648248e627ef7b541aec4 (127.5.126.66:44419), 5b2c1cd5f367458e811c859b7dbca333 (127.5.126.67:40055)
I20260709 13:24:07.147912 18062 consensus_queue.cc:237] T 66404f05eae74a7f938e85e5eae5cf72 P 5b2c1cd5f367458e811c859b7dbca333 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f62ce053d68f4a868fa48f951d56da1a" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 33029 } } peers { permanent_uuid: "93881c5b9b0648248e627ef7b541aec4" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 44419 } } peers { permanent_uuid: "5b2c1cd5f367458e811c859b7dbca333" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 40055 } }
I20260709 13:24:07.148519 18015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98bdadc834134483b31be48f35123bbd" candidate_uuid: "f62ce053d68f4a868fa48f951d56da1a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5b2c1cd5f367458e811c859b7dbca333"
I20260709 13:24:07.150991 18015 raft_consensus.cc:3060] T 98bdadc834134483b31be48f35123bbd P 5b2c1cd5f367458e811c859b7dbca333 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:24:07.151233 17904 leader_election.cc:304] T d3bd24e790d3483185e9f89c8521831b P 93881c5b9b0648248e627ef7b541aec4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 93881c5b9b0648248e627ef7b541aec4; no voters: 5b2c1cd5f367458e811c859b7dbca333, f62ce053d68f4a868fa48f951d56da1a
I20260709 13:24:07.152223 18061 raft_consensus.cc:2749] T d3bd24e790d3483185e9f89c8521831b P 93881c5b9b0648248e627ef7b541aec4 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:24:07.149040 18102 raft_consensus.cc:697] T d3bd24e790d3483185e9f89c8521831b P 5b2c1cd5f367458e811c859b7dbca333 [term 1 LEADER]: Becoming Leader. State: Replica: 5b2c1cd5f367458e811c859b7dbca333, State: Running, Role: LEADER
I20260709 13:24:07.156037 18102 consensus_queue.cc:237] T d3bd24e790d3483185e9f89c8521831b P 5b2c1cd5f367458e811c859b7dbca333 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b2c1cd5f367458e811c859b7dbca333" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 40055 } } peers { permanent_uuid: "93881c5b9b0648248e627ef7b541aec4" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 44419 } } peers { permanent_uuid: "f62ce053d68f4a868fa48f951d56da1a" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 33029 } }
I20260709 13:24:07.149180 17940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98bdadc834134483b31be48f35123bbd" candidate_uuid: "f62ce053d68f4a868fa48f951d56da1a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "93881c5b9b0648248e627ef7b541aec4"
I20260709 13:24:07.157557 17940 raft_consensus.cc:3060] T 98bdadc834134483b31be48f35123bbd P 93881c5b9b0648248e627ef7b541aec4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:24:07.159355 18015 raft_consensus.cc:2468] T 98bdadc834134483b31be48f35123bbd P 5b2c1cd5f367458e811c859b7dbca333 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f62ce053d68f4a868fa48f951d56da1a in term 1.
I20260709 13:24:07.160983 17830 leader_election.cc:304] T 98bdadc834134483b31be48f35123bbd P f62ce053d68f4a868fa48f951d56da1a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b2c1cd5f367458e811c859b7dbca333, f62ce053d68f4a868fa48f951d56da1a; no voters: 
I20260709 13:24:07.149535 18055 consensus_queue.cc:260] T 93f7e8af061940dd82364fa3c6e69825 P 5b2c1cd5f367458e811c859b7dbca333 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f62ce053d68f4a868fa48f951d56da1a" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 33029 } } peers { permanent_uuid: "93881c5b9b0648248e627ef7b541aec4" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 44419 } } peers { permanent_uuid: "5b2c1cd5f367458e811c859b7dbca333" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 40055 } }
I20260709 13:24:07.161958 18083 raft_consensus.cc:2804] T 98bdadc834134483b31be48f35123bbd P f62ce053d68f4a868fa48f951d56da1a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:24:07.162473 18083 raft_consensus.cc:697] T 98bdadc834134483b31be48f35123bbd P f62ce053d68f4a868fa48f951d56da1a [term 1 LEADER]: Becoming Leader. State: Replica: f62ce053d68f4a868fa48f951d56da1a, State: Running, Role: LEADER
I20260709 13:24:07.163669 18083 consensus_queue.cc:237] T 98bdadc834134483b31be48f35123bbd P f62ce053d68f4a868fa48f951d56da1a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f62ce053d68f4a868fa48f951d56da1a" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 33029 } } peers { permanent_uuid: "93881c5b9b0648248e627ef7b541aec4" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 44419 } } peers { permanent_uuid: "5b2c1cd5f367458e811c859b7dbca333" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 40055 } }
I20260709 13:24:07.165093 18055 ts_tablet_manager.cc:1434] T 93f7e8af061940dd82364fa3c6e69825 P 5b2c1cd5f367458e811c859b7dbca333: Time spent starting tablet: real 0.024s	user 0.006s	sys 0.000s
I20260709 13:24:07.166859 17764 catalog_manager.cc:5697] T 477afb2899ff459caf4d0eb55e840010 P f62ce053d68f4a868fa48f951d56da1a reported cstate change: term changed from 0 to 1, leader changed from <none> to f62ce053d68f4a868fa48f951d56da1a (127.5.126.65). New cstate: current_term: 1 leader_uuid: "f62ce053d68f4a868fa48f951d56da1a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f62ce053d68f4a868fa48f951d56da1a" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 33029 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "93881c5b9b0648248e627ef7b541aec4" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 44419 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5b2c1cd5f367458e811c859b7dbca333" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 40055 } health_report { overall_health: UNKNOWN } } }
I20260709 13:24:07.170936 17940 raft_consensus.cc:2468] T 98bdadc834134483b31be48f35123bbd P 93881c5b9b0648248e627ef7b541aec4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f62ce053d68f4a868fa48f951d56da1a in term 1.
I20260709 13:24:07.179697 17763 catalog_manager.cc:5697] T 66404f05eae74a7f938e85e5eae5cf72 P 5b2c1cd5f367458e811c859b7dbca333 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5b2c1cd5f367458e811c859b7dbca333 (127.5.126.67). New cstate: current_term: 1 leader_uuid: "5b2c1cd5f367458e811c859b7dbca333" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f62ce053d68f4a868fa48f951d56da1a" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 33029 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "93881c5b9b0648248e627ef7b541aec4" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 44419 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5b2c1cd5f367458e811c859b7dbca333" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 40055 } health_report { overall_health: HEALTHY } } }
I20260709 13:24:07.182053 17763 catalog_manager.cc:5697] T d3bd24e790d3483185e9f89c8521831b P 5b2c1cd5f367458e811c859b7dbca333 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5b2c1cd5f367458e811c859b7dbca333 (127.5.126.67). New cstate: current_term: 1 leader_uuid: "5b2c1cd5f367458e811c859b7dbca333" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b2c1cd5f367458e811c859b7dbca333" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 40055 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "93881c5b9b0648248e627ef7b541aec4" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 44419 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f62ce053d68f4a868fa48f951d56da1a" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 33029 } health_report { overall_health: UNKNOWN } } }
I20260709 13:24:07.188246 17764 catalog_manager.cc:5697] T 98bdadc834134483b31be48f35123bbd P f62ce053d68f4a868fa48f951d56da1a reported cstate change: term changed from 0 to 1, leader changed from <none> to f62ce053d68f4a868fa48f951d56da1a (127.5.126.65). New cstate: current_term: 1 leader_uuid: "f62ce053d68f4a868fa48f951d56da1a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f62ce053d68f4a868fa48f951d56da1a" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 33029 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "93881c5b9b0648248e627ef7b541aec4" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 44419 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5b2c1cd5f367458e811c859b7dbca333" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 40055 } health_report { overall_health: UNKNOWN } } }
I20260709 13:24:07.226291 18083 raft_consensus.cc:493] T b8a4f81761e3423fa8d2e3144b6b4ca8 P f62ce053d68f4a868fa48f951d56da1a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:24:07.226931 18083 raft_consensus.cc:515] T b8a4f81761e3423fa8d2e3144b6b4ca8 P f62ce053d68f4a868fa48f951d56da1a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f62ce053d68f4a868fa48f951d56da1a" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 33029 } } peers { permanent_uuid: "93881c5b9b0648248e627ef7b541aec4" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 44419 } } peers { permanent_uuid: "5b2c1cd5f367458e811c859b7dbca333" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 40055 } }
I20260709 13:24:07.228899 18083 leader_election.cc:290] T b8a4f81761e3423fa8d2e3144b6b4ca8 P f62ce053d68f4a868fa48f951d56da1a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 93881c5b9b0648248e627ef7b541aec4 (127.5.126.66:44419), 5b2c1cd5f367458e811c859b7dbca333 (127.5.126.67:40055)
I20260709 13:24:07.230015 17940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8a4f81761e3423fa8d2e3144b6b4ca8" candidate_uuid: "f62ce053d68f4a868fa48f951d56da1a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "93881c5b9b0648248e627ef7b541aec4" is_pre_election: true
I20260709 13:24:07.230367 18014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8a4f81761e3423fa8d2e3144b6b4ca8" candidate_uuid: "f62ce053d68f4a868fa48f951d56da1a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5b2c1cd5f367458e811c859b7dbca333" is_pre_election: true
I20260709 13:24:07.230677 17940 raft_consensus.cc:2468] T b8a4f81761e3423fa8d2e3144b6b4ca8 P 93881c5b9b0648248e627ef7b541aec4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f62ce053d68f4a868fa48f951d56da1a in term 0.
I20260709 13:24:07.231200 18014 raft_consensus.cc:2468] T b8a4f81761e3423fa8d2e3144b6b4ca8 P 5b2c1cd5f367458e811c859b7dbca333 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f62ce053d68f4a868fa48f951d56da1a in term 0.
I20260709 13:24:07.231933 17830 leader_election.cc:304] T b8a4f81761e3423fa8d2e3144b6b4ca8 P f62ce053d68f4a868fa48f951d56da1a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 93881c5b9b0648248e627ef7b541aec4, f62ce053d68f4a868fa48f951d56da1a; no voters: 
I20260709 13:24:07.232879 18083 raft_consensus.cc:2804] T b8a4f81761e3423fa8d2e3144b6b4ca8 P f62ce053d68f4a868fa48f951d56da1a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:24:07.233232 18083 raft_consensus.cc:493] T b8a4f81761e3423fa8d2e3144b6b4ca8 P f62ce053d68f4a868fa48f951d56da1a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:24:07.233594 18083 raft_consensus.cc:3060] T b8a4f81761e3423fa8d2e3144b6b4ca8 P f62ce053d68f4a868fa48f951d56da1a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:24:07.237293 18061 raft_consensus.cc:493] T 93f7e8af061940dd82364fa3c6e69825 P 93881c5b9b0648248e627ef7b541aec4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:24:07.237848 18061 raft_consensus.cc:515] T 93f7e8af061940dd82364fa3c6e69825 P 93881c5b9b0648248e627ef7b541aec4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f62ce053d68f4a868fa48f951d56da1a" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 33029 } } peers { permanent_uuid: "93881c5b9b0648248e627ef7b541aec4" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 44419 } } peers { permanent_uuid: "5b2c1cd5f367458e811c859b7dbca333" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 40055 } }
I20260709 13:24:07.239926 18061 leader_election.cc:290] T 93f7e8af061940dd82364fa3c6e69825 P 93881c5b9b0648248e627ef7b541aec4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f62ce053d68f4a868fa48f951d56da1a (127.5.126.65:33029), 5b2c1cd5f367458e811c859b7dbca333 (127.5.126.67:40055)
I20260709 13:24:07.240157 18083 raft_consensus.cc:515] T b8a4f81761e3423fa8d2e3144b6b4ca8 P f62ce053d68f4a868fa48f951d56da1a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f62ce053d68f4a868fa48f951d56da1a" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 33029 } } peers { permanent_uuid: "93881c5b9b0648248e627ef7b541aec4" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 44419 } } peers { permanent_uuid: "5b2c1cd5f367458e811c859b7dbca333" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 40055 } }
I20260709 13:24:07.240823 17866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93f7e8af061940dd82364fa3c6e69825" candidate_uuid: "93881c5b9b0648248e627ef7b541aec4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f62ce053d68f4a868fa48f951d56da1a" is_pre_election: true
I20260709 13:24:07.241235 18014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93f7e8af061940dd82364fa3c6e69825" candidate_uuid: "93881c5b9b0648248e627ef7b541aec4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5b2c1cd5f367458e811c859b7dbca333" is_pre_election: true
I20260709 13:24:07.241542 17866 raft_consensus.cc:2468] T 93f7e8af061940dd82364fa3c6e69825 P f62ce053d68f4a868fa48f951d56da1a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 93881c5b9b0648248e627ef7b541aec4 in term 0.
I20260709 13:24:07.241842 18014 raft_consensus.cc:2468] T 93f7e8af061940dd82364fa3c6e69825 P 5b2c1cd5f367458e811c859b7dbca333 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 93881c5b9b0648248e627ef7b541aec4 in term 0.
I20260709 13:24:07.242609 18083 leader_election.cc:290] T b8a4f81761e3423fa8d2e3144b6b4ca8 P f62ce053d68f4a868fa48f951d56da1a [CANDIDATE]: Term 1 election: Requested vote from peers 93881c5b9b0648248e627ef7b541aec4 (127.5.126.66:44419), 5b2c1cd5f367458e811c859b7dbca333 (127.5.126.67:40055)
I20260709 13:24:07.243157 17904 leader_election.cc:304] T 93f7e8af061940dd82364fa3c6e69825 P 93881c5b9b0648248e627ef7b541aec4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 93881c5b9b0648248e627ef7b541aec4, f62ce053d68f4a868fa48f951d56da1a; no voters: 
I20260709 13:24:07.243937 18014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8a4f81761e3423fa8d2e3144b6b4ca8" candidate_uuid: "f62ce053d68f4a868fa48f951d56da1a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5b2c1cd5f367458e811c859b7dbca333"
I20260709 13:24:07.243989 18061 raft_consensus.cc:2804] T 93f7e8af061940dd82364fa3c6e69825 P 93881c5b9b0648248e627ef7b541aec4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:24:07.244756 17940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8a4f81761e3423fa8d2e3144b6b4ca8" candidate_uuid: "f62ce053d68f4a868fa48f951d56da1a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "93881c5b9b0648248e627ef7b541aec4"
I20260709 13:24:07.244949 18061 raft_consensus.cc:493] T 93f7e8af061940dd82364fa3c6e69825 P 93881c5b9b0648248e627ef7b541aec4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:24:07.244949 18014 raft_consensus.cc:3060] T b8a4f81761e3423fa8d2e3144b6b4ca8 P 5b2c1cd5f367458e811c859b7dbca333 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:24:07.245415 17940 raft_consensus.cc:3060] T b8a4f81761e3423fa8d2e3144b6b4ca8 P 93881c5b9b0648248e627ef7b541aec4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:24:07.245689 18061 raft_consensus.cc:3060] T 93f7e8af061940dd82364fa3c6e69825 P 93881c5b9b0648248e627ef7b541aec4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:24:07.254473 18061 raft_consensus.cc:515] T 93f7e8af061940dd82364fa3c6e69825 P 93881c5b9b0648248e627ef7b541aec4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f62ce053d68f4a868fa48f951d56da1a" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 33029 } } peers { permanent_uuid: "93881c5b9b0648248e627ef7b541aec4" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 44419 } } peers { permanent_uuid: "5b2c1cd5f367458e811c859b7dbca333" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 40055 } }
I20260709 13:24:07.254796 17940 raft_consensus.cc:2468] T b8a4f81761e3423fa8d2e3144b6b4ca8 P 93881c5b9b0648248e627ef7b541aec4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f62ce053d68f4a868fa48f951d56da1a in term 1.
I20260709 13:24:07.256942 18061 leader_election.cc:290] T 93f7e8af061940dd82364fa3c6e69825 P 93881c5b9b0648248e627ef7b541aec4 [CANDIDATE]: Term 1 election: Requested vote from peers f62ce053d68f4a868fa48f951d56da1a (127.5.126.65:33029), 5b2c1cd5f367458e811c859b7dbca333 (127.5.126.67:40055)
I20260709 13:24:07.257138 17830 leader_election.cc:304] T b8a4f81761e3423fa8d2e3144b6b4ca8 P f62ce053d68f4a868fa48f951d56da1a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 93881c5b9b0648248e627ef7b541aec4, f62ce053d68f4a868fa48f951d56da1a; no voters: 
I20260709 13:24:07.257817 17866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93f7e8af061940dd82364fa3c6e69825" candidate_uuid: "93881c5b9b0648248e627ef7b541aec4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f62ce053d68f4a868fa48f951d56da1a"
I20260709 13:24:07.258253 18083 raft_consensus.cc:2804] T b8a4f81761e3423fa8d2e3144b6b4ca8 P f62ce053d68f4a868fa48f951d56da1a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:24:07.258476 17866 raft_consensus.cc:3060] T 93f7e8af061940dd82364fa3c6e69825 P f62ce053d68f4a868fa48f951d56da1a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:24:07.258849 18083 raft_consensus.cc:697] T b8a4f81761e3423fa8d2e3144b6b4ca8 P f62ce053d68f4a868fa48f951d56da1a [term 1 LEADER]: Becoming Leader. State: Replica: f62ce053d68f4a868fa48f951d56da1a, State: Running, Role: LEADER
I20260709 13:24:07.259187 18014 raft_consensus.cc:2468] T b8a4f81761e3423fa8d2e3144b6b4ca8 P 5b2c1cd5f367458e811c859b7dbca333 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f62ce053d68f4a868fa48f951d56da1a in term 1.
I20260709 13:24:07.259761 18083 consensus_queue.cc:237] T b8a4f81761e3423fa8d2e3144b6b4ca8 P f62ce053d68f4a868fa48f951d56da1a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f62ce053d68f4a868fa48f951d56da1a" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 33029 } } peers { permanent_uuid: "93881c5b9b0648248e627ef7b541aec4" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 44419 } } peers { permanent_uuid: "5b2c1cd5f367458e811c859b7dbca333" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 40055 } }
I20260709 13:24:07.262521 18014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93f7e8af061940dd82364fa3c6e69825" candidate_uuid: "93881c5b9b0648248e627ef7b541aec4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5b2c1cd5f367458e811c859b7dbca333"
I20260709 13:24:07.263166 18014 raft_consensus.cc:3060] T 93f7e8af061940dd82364fa3c6e69825 P 5b2c1cd5f367458e811c859b7dbca333 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:24:07.267691 17866 raft_consensus.cc:2468] T 93f7e8af061940dd82364fa3c6e69825 P f62ce053d68f4a868fa48f951d56da1a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 93881c5b9b0648248e627ef7b541aec4 in term 1.
I20260709 13:24:07.269038 17904 leader_election.cc:304] T 93f7e8af061940dd82364fa3c6e69825 P 93881c5b9b0648248e627ef7b541aec4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 93881c5b9b0648248e627ef7b541aec4, f62ce053d68f4a868fa48f951d56da1a; no voters: 
I20260709 13:24:07.269848 18061 raft_consensus.cc:2804] T 93f7e8af061940dd82364fa3c6e69825 P 93881c5b9b0648248e627ef7b541aec4 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:24:07.271183 18061 raft_consensus.cc:697] T 93f7e8af061940dd82364fa3c6e69825 P 93881c5b9b0648248e627ef7b541aec4 [term 1 LEADER]: Becoming Leader. State: Replica: 93881c5b9b0648248e627ef7b541aec4, State: Running, Role: LEADER
I20260709 13:24:07.270917 17763 catalog_manager.cc:5697] T b8a4f81761e3423fa8d2e3144b6b4ca8 P f62ce053d68f4a868fa48f951d56da1a reported cstate change: term changed from 0 to 1, leader changed from <none> to f62ce053d68f4a868fa48f951d56da1a (127.5.126.65). New cstate: current_term: 1 leader_uuid: "f62ce053d68f4a868fa48f951d56da1a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f62ce053d68f4a868fa48f951d56da1a" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 33029 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "93881c5b9b0648248e627ef7b541aec4" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 44419 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5b2c1cd5f367458e811c859b7dbca333" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 40055 } health_report { overall_health: UNKNOWN } } }
I20260709 13:24:07.272243 18061 consensus_queue.cc:237] T 93f7e8af061940dd82364fa3c6e69825 P 93881c5b9b0648248e627ef7b541aec4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f62ce053d68f4a868fa48f951d56da1a" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 33029 } } peers { permanent_uuid: "93881c5b9b0648248e627ef7b541aec4" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 44419 } } peers { permanent_uuid: "5b2c1cd5f367458e811c859b7dbca333" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 40055 } }
I20260709 13:24:07.274148 18014 raft_consensus.cc:2468] T 93f7e8af061940dd82364fa3c6e69825 P 5b2c1cd5f367458e811c859b7dbca333 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 93881c5b9b0648248e627ef7b541aec4 in term 1.
I20260709 13:24:07.282876 17764 catalog_manager.cc:5697] T 93f7e8af061940dd82364fa3c6e69825 P 93881c5b9b0648248e627ef7b541aec4 reported cstate change: term changed from 0 to 1, leader changed from <none> to 93881c5b9b0648248e627ef7b541aec4 (127.5.126.66). New cstate: current_term: 1 leader_uuid: "93881c5b9b0648248e627ef7b541aec4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f62ce053d68f4a868fa48f951d56da1a" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 33029 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "93881c5b9b0648248e627ef7b541aec4" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 44419 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5b2c1cd5f367458e811c859b7dbca333" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 40055 } health_report { overall_health: UNKNOWN } } }
I20260709 13:24:07.287737 18083 consensus_queue.cc:1048] T e472f595f87a4a749248c7b7812b33d0 P f62ce053d68f4a868fa48f951d56da1a [LEADER]: Connected to new peer: Peer: permanent_uuid: "93881c5b9b0648248e627ef7b541aec4" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 44419 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:24:07.306509 18083 consensus_queue.cc:1048] T e472f595f87a4a749248c7b7812b33d0 P f62ce053d68f4a868fa48f951d56da1a [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b2c1cd5f367458e811c859b7dbca333" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 40055 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:24:07.309409 18083 consensus_queue.cc:1048] T 9783d21b38744e0b8565b96be6c3ca80 P f62ce053d68f4a868fa48f951d56da1a [LEADER]: Connected to new peer: Peer: permanent_uuid: "93881c5b9b0648248e627ef7b541aec4" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 44419 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:24:07.324178 18082 consensus_queue.cc:1048] T 9783d21b38744e0b8565b96be6c3ca80 P f62ce053d68f4a868fa48f951d56da1a [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b2c1cd5f367458e811c859b7dbca333" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 40055 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:24:07.459247 18082 consensus_queue.cc:1048] T 274de930fd3e48b0a4a446dfeedcff85 P f62ce053d68f4a868fa48f951d56da1a [LEADER]: Connected to new peer: Peer: permanent_uuid: "93881c5b9b0648248e627ef7b541aec4" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 44419 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:24:07.474272 18082 consensus_queue.cc:1048] T 274de930fd3e48b0a4a446dfeedcff85 P f62ce053d68f4a868fa48f951d56da1a [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b2c1cd5f367458e811c859b7dbca333" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 40055 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:24:07.491750 18015 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d3bd24e790d3483185e9f89c8521831b"
dest_uuid: "5b2c1cd5f367458e811c859b7dbca333"
mode: GRACEFUL
new_leader_uuid: "f62ce053d68f4a868fa48f951d56da1a"
 from {username='slave'} at 127.0.0.1:59808
I20260709 13:24:07.492520 18015 raft_consensus.cc:606] T d3bd24e790d3483185e9f89c8521831b P 5b2c1cd5f367458e811c859b7dbca333 [term 1 LEADER]: Received request to transfer leadership to TS f62ce053d68f4a868fa48f951d56da1a
I20260709 13:24:07.509023 18015 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "66404f05eae74a7f938e85e5eae5cf72"
dest_uuid: "5b2c1cd5f367458e811c859b7dbca333"
mode: GRACEFUL
new_leader_uuid: "93881c5b9b0648248e627ef7b541aec4"
 from {username='slave'} at 127.0.0.1:59808
I20260709 13:24:07.509677 18015 raft_consensus.cc:606] T 66404f05eae74a7f938e85e5eae5cf72 P 5b2c1cd5f367458e811c859b7dbca333 [term 1 LEADER]: Received request to transfer leadership to TS 93881c5b9b0648248e627ef7b541aec4
I20260709 13:24:07.524139 17866 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "477afb2899ff459caf4d0eb55e840010"
dest_uuid: "f62ce053d68f4a868fa48f951d56da1a"
mode: GRACEFUL
new_leader_uuid: "93881c5b9b0648248e627ef7b541aec4"
 from {username='slave'} at 127.0.0.1:41774
I20260709 13:24:07.524734 17866 raft_consensus.cc:606] T 477afb2899ff459caf4d0eb55e840010 P f62ce053d68f4a868fa48f951d56da1a [term 1 LEADER]: Received request to transfer leadership to TS 93881c5b9b0648248e627ef7b541aec4
I20260709 13:24:07.531199 17866 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b8a4f81761e3423fa8d2e3144b6b4ca8"
dest_uuid: "f62ce053d68f4a868fa48f951d56da1a"
mode: GRACEFUL
new_leader_uuid: "93881c5b9b0648248e627ef7b541aec4"
 from {username='slave'} at 127.0.0.1:41774
I20260709 13:24:07.531751 17866 raft_consensus.cc:606] T b8a4f81761e3423fa8d2e3144b6b4ca8 P f62ce053d68f4a868fa48f951d56da1a [term 1 LEADER]: Received request to transfer leadership to TS 93881c5b9b0648248e627ef7b541aec4
I20260709 13:24:07.537919 17866 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "98bdadc834134483b31be48f35123bbd"
dest_uuid: "f62ce053d68f4a868fa48f951d56da1a"
mode: GRACEFUL
new_leader_uuid: "93881c5b9b0648248e627ef7b541aec4"
 from {username='slave'} at 127.0.0.1:41774
I20260709 13:24:07.538471 17866 raft_consensus.cc:606] T 98bdadc834134483b31be48f35123bbd P f62ce053d68f4a868fa48f951d56da1a [term 1 LEADER]: Received request to transfer leadership to TS 93881c5b9b0648248e627ef7b541aec4
I20260709 13:24:07.544273 18102 consensus_queue.cc:1048] T 66404f05eae74a7f938e85e5eae5cf72 P 5b2c1cd5f367458e811c859b7dbca333 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f62ce053d68f4a868fa48f951d56da1a" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 33029 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:24:07.556402 18082 consensus_queue.cc:1048] T 477afb2899ff459caf4d0eb55e840010 P f62ce053d68f4a868fa48f951d56da1a [LEADER]: Connected to new peer: Peer: permanent_uuid: "93881c5b9b0648248e627ef7b541aec4" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 44419 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:24:07.558482 18107 consensus_queue.cc:1048] T 66404f05eae74a7f938e85e5eae5cf72 P 5b2c1cd5f367458e811c859b7dbca333 [LEADER]: Connected to new peer: Peer: permanent_uuid: "93881c5b9b0648248e627ef7b541aec4" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 44419 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:24:07.560956 17939 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "93f7e8af061940dd82364fa3c6e69825"
dest_uuid: "93881c5b9b0648248e627ef7b541aec4"
mode: GRACEFUL
new_leader_uuid: "5b2c1cd5f367458e811c859b7dbca333"
 from {username='slave'} at 127.0.0.1:34962
I20260709 13:24:07.561620 17939 raft_consensus.cc:606] T 93f7e8af061940dd82364fa3c6e69825 P 93881c5b9b0648248e627ef7b541aec4 [term 1 LEADER]: Received request to transfer leadership to TS 5b2c1cd5f367458e811c859b7dbca333
I20260709 13:24:07.568262 18064 raft_consensus.cc:993] T 477afb2899ff459caf4d0eb55e840010 P f62ce053d68f4a868fa48f951d56da1a: : Instructing follower 93881c5b9b0648248e627ef7b541aec4 to start an election
I20260709 13:24:07.568789 18064 raft_consensus.cc:1081] T 477afb2899ff459caf4d0eb55e840010 P f62ce053d68f4a868fa48f951d56da1a [term 1 LEADER]: Signalling peer 93881c5b9b0648248e627ef7b541aec4 to start an election
I20260709 13:24:07.571326 17939 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "477afb2899ff459caf4d0eb55e840010"
dest_uuid: "93881c5b9b0648248e627ef7b541aec4"
 from {username='slave'} at 127.0.0.1:34942
I20260709 13:24:07.571969 17939 raft_consensus.cc:493] T 477afb2899ff459caf4d0eb55e840010 P 93881c5b9b0648248e627ef7b541aec4 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:24:07.572414 17939 raft_consensus.cc:3060] T 477afb2899ff459caf4d0eb55e840010 P 93881c5b9b0648248e627ef7b541aec4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:24:07.576282 18107 raft_consensus.cc:993] T 66404f05eae74a7f938e85e5eae5cf72 P 5b2c1cd5f367458e811c859b7dbca333: : Instructing follower 93881c5b9b0648248e627ef7b541aec4 to start an election
I20260709 13:24:07.576794 18107 raft_consensus.cc:1081] T 66404f05eae74a7f938e85e5eae5cf72 P 5b2c1cd5f367458e811c859b7dbca333 [term 1 LEADER]: Signalling peer 93881c5b9b0648248e627ef7b541aec4 to start an election
I20260709 13:24:07.579622 18064 consensus_queue.cc:1048] T 477afb2899ff459caf4d0eb55e840010 P f62ce053d68f4a868fa48f951d56da1a [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b2c1cd5f367458e811c859b7dbca333" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 40055 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:24:07.580020 17939 raft_consensus.cc:515] T 477afb2899ff459caf4d0eb55e840010 P 93881c5b9b0648248e627ef7b541aec4 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f62ce053d68f4a868fa48f951d56da1a" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 33029 } } peers { permanent_uuid: "93881c5b9b0648248e627ef7b541aec4" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 44419 } } peers { permanent_uuid: "5b2c1cd5f367458e811c859b7dbca333" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 40055 } }
I20260709 13:24:07.582150 17941 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "66404f05eae74a7f938e85e5eae5cf72"
dest_uuid: "93881c5b9b0648248e627ef7b541aec4"
 from {username='slave'} at 127.0.0.1:34950
I20260709 13:24:07.582752 17939 leader_election.cc:290] T 477afb2899ff459caf4d0eb55e840010 P 93881c5b9b0648248e627ef7b541aec4 [CANDIDATE]: Term 2 election: Requested vote from peers f62ce053d68f4a868fa48f951d56da1a (127.5.126.65:33029), 5b2c1cd5f367458e811c859b7dbca333 (127.5.126.67:40055)
I20260709 13:24:07.582842 17941 raft_consensus.cc:493] T 66404f05eae74a7f938e85e5eae5cf72 P 93881c5b9b0648248e627ef7b541aec4 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:24:07.583658 17866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "477afb2899ff459caf4d0eb55e840010" candidate_uuid: "93881c5b9b0648248e627ef7b541aec4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f62ce053d68f4a868fa48f951d56da1a"
I20260709 13:24:07.584446 17866 raft_consensus.cc:3055] T 477afb2899ff459caf4d0eb55e840010 P f62ce053d68f4a868fa48f951d56da1a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:24:07.584684 17866 raft_consensus.cc:740] T 477afb2899ff459caf4d0eb55e840010 P f62ce053d68f4a868fa48f951d56da1a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f62ce053d68f4a868fa48f951d56da1a, State: Running, Role: LEADER
I20260709 13:24:07.587576 18014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "477afb2899ff459caf4d0eb55e840010" candidate_uuid: "93881c5b9b0648248e627ef7b541aec4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5b2c1cd5f367458e811c859b7dbca333"
I20260709 13:24:07.585460 17866 consensus_queue.cc:260] T 477afb2899ff459caf4d0eb55e840010 P f62ce053d68f4a868fa48f951d56da1a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f62ce053d68f4a868fa48f951d56da1a" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 33029 } } peers { permanent_uuid: "93881c5b9b0648248e627ef7b541aec4" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 44419 } } peers { permanent_uuid: "5b2c1cd5f367458e811c859b7dbca333" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 40055 } }
I20260709 13:24:07.590698 17866 raft_consensus.cc:3060] T 477afb2899ff459caf4d0eb55e840010 P f62ce053d68f4a868fa48f951d56da1a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:24:07.583417 17941 raft_consensus.cc:3060] T 66404f05eae74a7f938e85e5eae5cf72 P 93881c5b9b0648248e627ef7b541aec4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:24:07.597859 17941 raft_consensus.cc:515] T 66404f05eae74a7f938e85e5eae5cf72 P 93881c5b9b0648248e627ef7b541aec4 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f62ce053d68f4a868fa48f951d56da1a" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 33029 } } peers { permanent_uuid: "93881c5b9b0648248e627ef7b541aec4" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 44419 } } peers { permanent_uuid: "5b2c1cd5f367458e811c859b7dbca333" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 40055 } }
I20260709 13:24:07.599709 17866 raft_consensus.cc:2468] T 477afb2899ff459caf4d0eb55e840010 P f62ce053d68f4a868fa48f951d56da1a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 93881c5b9b0648248e627ef7b541aec4 in term 2.
I20260709 13:24:07.601298 17904 leader_election.cc:304] T 477afb2899ff459caf4d0eb55e840010 P 93881c5b9b0648248e627ef7b541aec4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 93881c5b9b0648248e627ef7b541aec4, f62ce053d68f4a868fa48f951d56da1a; no voters: 5b2c1cd5f367458e811c859b7dbca333
I20260709 13:24:07.601471 17941 leader_election.cc:290] T 66404f05eae74a7f938e85e5eae5cf72 P 93881c5b9b0648248e627ef7b541aec4 [CANDIDATE]: Term 2 election: Requested vote from peers f62ce053d68f4a868fa48f951d56da1a (127.5.126.65:33029), 5b2c1cd5f367458e811c859b7dbca333 (127.5.126.67:40055)
I20260709 13:24:07.603046 18112 raft_consensus.cc:2804] T 477afb2899ff459caf4d0eb55e840010 P 93881c5b9b0648248e627ef7b541aec4 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:24:07.603423 18015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66404f05eae74a7f938e85e5eae5cf72" candidate_uuid: "93881c5b9b0648248e627ef7b541aec4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5b2c1cd5f367458e811c859b7dbca333"
I20260709 13:24:07.603575 18112 raft_consensus.cc:697] T 477afb2899ff459caf4d0eb55e840010 P 93881c5b9b0648248e627ef7b541aec4 [term 2 LEADER]: Becoming Leader. State: Replica: 93881c5b9b0648248e627ef7b541aec4, State: Running, Role: LEADER
I20260709 13:24:07.604277 18015 raft_consensus.cc:3055] T 66404f05eae74a7f938e85e5eae5cf72 P 5b2c1cd5f367458e811c859b7dbca333 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:24:07.604688 18015 raft_consensus.cc:740] T 66404f05eae74a7f938e85e5eae5cf72 P 5b2c1cd5f367458e811c859b7dbca333 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5b2c1cd5f367458e811c859b7dbca333, State: Running, Role: LEADER
I20260709 13:24:07.604787 17865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66404f05eae74a7f938e85e5eae5cf72" candidate_uuid: "93881c5b9b0648248e627ef7b541aec4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f62ce053d68f4a868fa48f951d56da1a"
I20260709 13:24:07.605531 17865 raft_consensus.cc:3060] T 66404f05eae74a7f938e85e5eae5cf72 P f62ce053d68f4a868fa48f951d56da1a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:24:07.605162 18112 consensus_queue.cc:237] T 477afb2899ff459caf4d0eb55e840010 P 93881c5b9b0648248e627ef7b541aec4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f62ce053d68f4a868fa48f951d56da1a" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 33029 } } peers { permanent_uuid: "93881c5b9b0648248e627ef7b541aec4" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 44419 } } peers { permanent_uuid: "5b2c1cd5f367458e811c859b7dbca333" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 40055 } }
I20260709 13:24:07.605598 18015 consensus_queue.cc:260] T 66404f05eae74a7f938e85e5eae5cf72 P 5b2c1cd5f367458e811c859b7dbca333 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f62ce053d68f4a868fa48f951d56da1a" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 33029 } } peers { permanent_uuid: "93881c5b9b0648248e627ef7b541aec4" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 44419 } } peers { permanent_uuid: "5b2c1cd5f367458e811c859b7dbca333" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 40055 } }
I20260709 13:24:07.607249 18015 raft_consensus.cc:3060] T 66404f05eae74a7f938e85e5eae5cf72 P 5b2c1cd5f367458e811c859b7dbca333 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:24:07.614249 18015 raft_consensus.cc:2468] T 66404f05eae74a7f938e85e5eae5cf72 P 5b2c1cd5f367458e811c859b7dbca333 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 93881c5b9b0648248e627ef7b541aec4 in term 2.
I20260709 13:24:07.615573 17905 leader_election.cc:304] T 66404f05eae74a7f938e85e5eae5cf72 P 93881c5b9b0648248e627ef7b541aec4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b2c1cd5f367458e811c859b7dbca333, 93881c5b9b0648248e627ef7b541aec4; no voters: 
I20260709 13:24:07.615778 17865 raft_consensus.cc:2468] T 66404f05eae74a7f938e85e5eae5cf72 P f62ce053d68f4a868fa48f951d56da1a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 93881c5b9b0648248e627ef7b541aec4 in term 2.
I20260709 13:24:07.615571 17764 catalog_manager.cc:5697] T 477afb2899ff459caf4d0eb55e840010 P 93881c5b9b0648248e627ef7b541aec4 reported cstate change: term changed from 1 to 2, leader changed from f62ce053d68f4a868fa48f951d56da1a (127.5.126.65) to 93881c5b9b0648248e627ef7b541aec4 (127.5.126.66). New cstate: current_term: 2 leader_uuid: "93881c5b9b0648248e627ef7b541aec4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f62ce053d68f4a868fa48f951d56da1a" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 33029 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "93881c5b9b0648248e627ef7b541aec4" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 44419 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5b2c1cd5f367458e811c859b7dbca333" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 40055 } health_report { overall_health: UNKNOWN } } }
I20260709 13:24:07.616628 18112 raft_consensus.cc:2804] T 66404f05eae74a7f938e85e5eae5cf72 P 93881c5b9b0648248e627ef7b541aec4 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:24:07.617177 18112 raft_consensus.cc:697] T 66404f05eae74a7f938e85e5eae5cf72 P 93881c5b9b0648248e627ef7b541aec4 [term 2 LEADER]: Becoming Leader. State: Replica: 93881c5b9b0648248e627ef7b541aec4, State: Running, Role: LEADER
I20260709 13:24:07.617988 18112 consensus_queue.cc:237] T 66404f05eae74a7f938e85e5eae5cf72 P 93881c5b9b0648248e627ef7b541aec4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f62ce053d68f4a868fa48f951d56da1a" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 33029 } } peers { permanent_uuid: "93881c5b9b0648248e627ef7b541aec4" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 44419 } } peers { permanent_uuid: "5b2c1cd5f367458e811c859b7dbca333" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 40055 } }
I20260709 13:24:07.620906 18064 consensus_queue.cc:1048] T 98bdadc834134483b31be48f35123bbd P f62ce053d68f4a868fa48f951d56da1a [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b2c1cd5f367458e811c859b7dbca333" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 40055 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:24:07.631954 17763 catalog_manager.cc:5697] T 66404f05eae74a7f938e85e5eae5cf72 P 93881c5b9b0648248e627ef7b541aec4 reported cstate change: term changed from 1 to 2, leader changed from 5b2c1cd5f367458e811c859b7dbca333 (127.5.126.67) to 93881c5b9b0648248e627ef7b541aec4 (127.5.126.66). New cstate: current_term: 2 leader_uuid: "93881c5b9b0648248e627ef7b541aec4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f62ce053d68f4a868fa48f951d56da1a" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 33029 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "93881c5b9b0648248e627ef7b541aec4" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 44419 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5b2c1cd5f367458e811c859b7dbca333" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 40055 } health_report { overall_health: UNKNOWN } } }
I20260709 13:24:07.635373 18081 consensus_queue.cc:1048] T 98bdadc834134483b31be48f35123bbd P f62ce053d68f4a868fa48f951d56da1a [LEADER]: Connected to new peer: Peer: permanent_uuid: "93881c5b9b0648248e627ef7b541aec4" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 44419 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:24:07.644871 18081 raft_consensus.cc:993] T 98bdadc834134483b31be48f35123bbd P f62ce053d68f4a868fa48f951d56da1a: : Instructing follower 93881c5b9b0648248e627ef7b541aec4 to start an election
I20260709 13:24:07.645357 18081 raft_consensus.cc:1081] T 98bdadc834134483b31be48f35123bbd P f62ce053d68f4a868fa48f951d56da1a [term 1 LEADER]: Signalling peer 93881c5b9b0648248e627ef7b541aec4 to start an election
I20260709 13:24:07.647185 17941 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "98bdadc834134483b31be48f35123bbd"
dest_uuid: "93881c5b9b0648248e627ef7b541aec4"
 from {username='slave'} at 127.0.0.1:34942
I20260709 13:24:07.647770 17941 raft_consensus.cc:493] T 98bdadc834134483b31be48f35123bbd P 93881c5b9b0648248e627ef7b541aec4 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:24:07.648159 17941 raft_consensus.cc:3060] T 98bdadc834134483b31be48f35123bbd P 93881c5b9b0648248e627ef7b541aec4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:24:07.654713 17941 raft_consensus.cc:515] T 98bdadc834134483b31be48f35123bbd P 93881c5b9b0648248e627ef7b541aec4 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f62ce053d68f4a868fa48f951d56da1a" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 33029 } } peers { permanent_uuid: "93881c5b9b0648248e627ef7b541aec4" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 44419 } } peers { permanent_uuid: "5b2c1cd5f367458e811c859b7dbca333" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 40055 } }
I20260709 13:24:07.656953 17941 leader_election.cc:290] T 98bdadc834134483b31be48f35123bbd P 93881c5b9b0648248e627ef7b541aec4 [CANDIDATE]: Term 2 election: Requested vote from peers f62ce053d68f4a868fa48f951d56da1a (127.5.126.65:33029), 5b2c1cd5f367458e811c859b7dbca333 (127.5.126.67:40055)
I20260709 13:24:07.656935 18062 consensus_queue.cc:1048] T d3bd24e790d3483185e9f89c8521831b P 5b2c1cd5f367458e811c859b7dbca333 [LEADER]: Connected to new peer: Peer: permanent_uuid: "93881c5b9b0648248e627ef7b541aec4" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 44419 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:24:07.657681 17865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98bdadc834134483b31be48f35123bbd" candidate_uuid: "93881c5b9b0648248e627ef7b541aec4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f62ce053d68f4a868fa48f951d56da1a"
I20260709 13:24:07.658460 17865 raft_consensus.cc:3055] T 98bdadc834134483b31be48f35123bbd P f62ce053d68f4a868fa48f951d56da1a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:24:07.658432 18015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98bdadc834134483b31be48f35123bbd" candidate_uuid: "93881c5b9b0648248e627ef7b541aec4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5b2c1cd5f367458e811c859b7dbca333"
I20260709 13:24:07.659034 17865 raft_consensus.cc:740] T 98bdadc834134483b31be48f35123bbd P f62ce053d68f4a868fa48f951d56da1a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f62ce053d68f4a868fa48f951d56da1a, State: Running, Role: LEADER
I20260709 13:24:07.659209 18015 raft_consensus.cc:3060] T 98bdadc834134483b31be48f35123bbd P 5b2c1cd5f367458e811c859b7dbca333 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:24:07.660004 17865 consensus_queue.cc:260] T 98bdadc834134483b31be48f35123bbd P f62ce053d68f4a868fa48f951d56da1a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f62ce053d68f4a868fa48f951d56da1a" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 33029 } } peers { permanent_uuid: "93881c5b9b0648248e627ef7b541aec4" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 44419 } } peers { permanent_uuid: "5b2c1cd5f367458e811c859b7dbca333" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 40055 } }
I20260709 13:24:07.661562 17865 raft_consensus.cc:3060] T 98bdadc834134483b31be48f35123bbd P f62ce053d68f4a868fa48f951d56da1a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:24:07.669266 17865 raft_consensus.cc:2468] T 98bdadc834134483b31be48f35123bbd P f62ce053d68f4a868fa48f951d56da1a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 93881c5b9b0648248e627ef7b541aec4 in term 2.
I20260709 13:24:07.671032 17904 leader_election.cc:304] T 98bdadc834134483b31be48f35123bbd P 93881c5b9b0648248e627ef7b541aec4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 93881c5b9b0648248e627ef7b541aec4, f62ce053d68f4a868fa48f951d56da1a; no voters: 
I20260709 13:24:07.672119 18061 raft_consensus.cc:2804] T 98bdadc834134483b31be48f35123bbd P 93881c5b9b0648248e627ef7b541aec4 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:24:07.672727 18061 raft_consensus.cc:697] T 98bdadc834134483b31be48f35123bbd P 93881c5b9b0648248e627ef7b541aec4 [term 2 LEADER]: Becoming Leader. State: Replica: 93881c5b9b0648248e627ef7b541aec4, State: Running, Role: LEADER
I20260709 13:24:07.673688 18061 consensus_queue.cc:237] T 98bdadc834134483b31be48f35123bbd P 93881c5b9b0648248e627ef7b541aec4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f62ce053d68f4a868fa48f951d56da1a" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 33029 } } peers { permanent_uuid: "93881c5b9b0648248e627ef7b541aec4" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 44419 } } peers { permanent_uuid: "5b2c1cd5f367458e811c859b7dbca333" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 40055 } }
I20260709 13:24:07.674881 18102 consensus_queue.cc:1048] T d3bd24e790d3483185e9f89c8521831b P 5b2c1cd5f367458e811c859b7dbca333 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f62ce053d68f4a868fa48f951d56da1a" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 33029 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:24:07.668027 18015 raft_consensus.cc:2468] T 98bdadc834134483b31be48f35123bbd P 5b2c1cd5f367458e811c859b7dbca333 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 93881c5b9b0648248e627ef7b541aec4 in term 2.
I20260709 13:24:07.684554 17761 catalog_manager.cc:5697] T 98bdadc834134483b31be48f35123bbd P 93881c5b9b0648248e627ef7b541aec4 reported cstate change: term changed from 1 to 2, leader changed from f62ce053d68f4a868fa48f951d56da1a (127.5.126.65) to 93881c5b9b0648248e627ef7b541aec4 (127.5.126.66). New cstate: current_term: 2 leader_uuid: "93881c5b9b0648248e627ef7b541aec4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f62ce053d68f4a868fa48f951d56da1a" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 33029 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "93881c5b9b0648248e627ef7b541aec4" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 44419 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5b2c1cd5f367458e811c859b7dbca333" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 40055 } health_report { overall_health: UNKNOWN } } }
I20260709 13:24:07.686298 18102 raft_consensus.cc:993] T d3bd24e790d3483185e9f89c8521831b P 5b2c1cd5f367458e811c859b7dbca333: : Instructing follower f62ce053d68f4a868fa48f951d56da1a to start an election
I20260709 13:24:07.686933 18105 raft_consensus.cc:1081] T d3bd24e790d3483185e9f89c8521831b P 5b2c1cd5f367458e811c859b7dbca333 [term 1 LEADER]: Signalling peer f62ce053d68f4a868fa48f951d56da1a to start an election
I20260709 13:24:07.689183 17865 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d3bd24e790d3483185e9f89c8521831b"
dest_uuid: "f62ce053d68f4a868fa48f951d56da1a"
 from {username='slave'} at 127.0.0.1:41748
I20260709 13:24:07.689858 17865 raft_consensus.cc:493] T d3bd24e790d3483185e9f89c8521831b P f62ce053d68f4a868fa48f951d56da1a [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:24:07.690333 17865 raft_consensus.cc:3060] T d3bd24e790d3483185e9f89c8521831b P f62ce053d68f4a868fa48f951d56da1a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:24:07.699858 17865 raft_consensus.cc:515] T d3bd24e790d3483185e9f89c8521831b P f62ce053d68f4a868fa48f951d56da1a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b2c1cd5f367458e811c859b7dbca333" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 40055 } } peers { permanent_uuid: "93881c5b9b0648248e627ef7b541aec4" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 44419 } } peers { permanent_uuid: "f62ce053d68f4a868fa48f951d56da1a" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 33029 } }
I20260709 13:24:07.702525 17865 leader_election.cc:290] T d3bd24e790d3483185e9f89c8521831b P f62ce053d68f4a868fa48f951d56da1a [CANDIDATE]: Term 2 election: Requested vote from peers 5b2c1cd5f367458e811c859b7dbca333 (127.5.126.67:40055), 93881c5b9b0648248e627ef7b541aec4 (127.5.126.66:44419)
I20260709 13:24:07.704383 17941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3bd24e790d3483185e9f89c8521831b" candidate_uuid: "f62ce053d68f4a868fa48f951d56da1a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "93881c5b9b0648248e627ef7b541aec4"
I20260709 13:24:07.705153 17941 raft_consensus.cc:3060] T d3bd24e790d3483185e9f89c8521831b P 93881c5b9b0648248e627ef7b541aec4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:24:07.706192 18015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3bd24e790d3483185e9f89c8521831b" candidate_uuid: "f62ce053d68f4a868fa48f951d56da1a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5b2c1cd5f367458e811c859b7dbca333"
I20260709 13:24:07.706956 18015 raft_consensus.cc:3055] T d3bd24e790d3483185e9f89c8521831b P 5b2c1cd5f367458e811c859b7dbca333 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:24:07.707353 18015 raft_consensus.cc:740] T d3bd24e790d3483185e9f89c8521831b P 5b2c1cd5f367458e811c859b7dbca333 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5b2c1cd5f367458e811c859b7dbca333, State: Running, Role: LEADER
I20260709 13:24:07.708153 18015 consensus_queue.cc:260] T d3bd24e790d3483185e9f89c8521831b P 5b2c1cd5f367458e811c859b7dbca333 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b2c1cd5f367458e811c859b7dbca333" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 40055 } } peers { permanent_uuid: "93881c5b9b0648248e627ef7b541aec4" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 44419 } } peers { permanent_uuid: "f62ce053d68f4a868fa48f951d56da1a" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 33029 } }
I20260709 13:24:07.709470 18015 raft_consensus.cc:3060] T d3bd24e790d3483185e9f89c8521831b P 5b2c1cd5f367458e811c859b7dbca333 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:24:07.710183 18061 consensus_queue.cc:1048] T 93f7e8af061940dd82364fa3c6e69825 P 93881c5b9b0648248e627ef7b541aec4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f62ce053d68f4a868fa48f951d56da1a" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 33029 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:24:07.711215 18082 consensus_queue.cc:1048] T b8a4f81761e3423fa8d2e3144b6b4ca8 P f62ce053d68f4a868fa48f951d56da1a [LEADER]: Connected to new peer: Peer: permanent_uuid: "93881c5b9b0648248e627ef7b541aec4" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 44419 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:24:07.714305 17941 raft_consensus.cc:2468] T d3bd24e790d3483185e9f89c8521831b P 93881c5b9b0648248e627ef7b541aec4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f62ce053d68f4a868fa48f951d56da1a in term 2.
I20260709 13:24:07.716961 17830 leader_election.cc:304] T d3bd24e790d3483185e9f89c8521831b P f62ce053d68f4a868fa48f951d56da1a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 93881c5b9b0648248e627ef7b541aec4, f62ce053d68f4a868fa48f951d56da1a; no voters: 
I20260709 13:24:07.717226 18015 raft_consensus.cc:2468] T d3bd24e790d3483185e9f89c8521831b P 5b2c1cd5f367458e811c859b7dbca333 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f62ce053d68f4a868fa48f951d56da1a in term 2.
I20260709 13:24:07.717948 18082 raft_consensus.cc:2804] T d3bd24e790d3483185e9f89c8521831b P f62ce053d68f4a868fa48f951d56da1a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:24:07.718643 18082 raft_consensus.cc:697] T d3bd24e790d3483185e9f89c8521831b P f62ce053d68f4a868fa48f951d56da1a [term 2 LEADER]: Becoming Leader. State: Replica: f62ce053d68f4a868fa48f951d56da1a, State: Running, Role: LEADER
I20260709 13:24:07.719509 18082 consensus_queue.cc:237] T d3bd24e790d3483185e9f89c8521831b P f62ce053d68f4a868fa48f951d56da1a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b2c1cd5f367458e811c859b7dbca333" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 40055 } } peers { permanent_uuid: "93881c5b9b0648248e627ef7b541aec4" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 44419 } } peers { permanent_uuid: "f62ce053d68f4a868fa48f951d56da1a" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 33029 } }
I20260709 13:24:07.725699 18083 raft_consensus.cc:993] T b8a4f81761e3423fa8d2e3144b6b4ca8 P f62ce053d68f4a868fa48f951d56da1a: : Instructing follower 93881c5b9b0648248e627ef7b541aec4 to start an election
I20260709 13:24:07.726308 18083 raft_consensus.cc:1081] T b8a4f81761e3423fa8d2e3144b6b4ca8 P f62ce053d68f4a868fa48f951d56da1a [term 1 LEADER]: Signalling peer 93881c5b9b0648248e627ef7b541aec4 to start an election
I20260709 13:24:07.738816 17939 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b8a4f81761e3423fa8d2e3144b6b4ca8"
dest_uuid: "93881c5b9b0648248e627ef7b541aec4"
 from {username='slave'} at 127.0.0.1:34942
I20260709 13:24:07.742812 18061 consensus_queue.cc:1048] T 93f7e8af061940dd82364fa3c6e69825 P 93881c5b9b0648248e627ef7b541aec4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b2c1cd5f367458e811c859b7dbca333" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 40055 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:24:07.743068 18082 consensus_queue.cc:1048] T b8a4f81761e3423fa8d2e3144b6b4ca8 P f62ce053d68f4a868fa48f951d56da1a [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b2c1cd5f367458e811c859b7dbca333" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 40055 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:24:07.743148 17761 catalog_manager.cc:5697] T d3bd24e790d3483185e9f89c8521831b P f62ce053d68f4a868fa48f951d56da1a reported cstate change: term changed from 1 to 2, leader changed from 5b2c1cd5f367458e811c859b7dbca333 (127.5.126.67) to f62ce053d68f4a868fa48f951d56da1a (127.5.126.65). New cstate: current_term: 2 leader_uuid: "f62ce053d68f4a868fa48f951d56da1a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b2c1cd5f367458e811c859b7dbca333" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 40055 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "93881c5b9b0648248e627ef7b541aec4" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 44419 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f62ce053d68f4a868fa48f951d56da1a" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 33029 } health_report { overall_health: HEALTHY } } }
I20260709 13:24:07.748314 17939 raft_consensus.cc:493] T b8a4f81761e3423fa8d2e3144b6b4ca8 P 93881c5b9b0648248e627ef7b541aec4 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:24:07.748901 17939 raft_consensus.cc:3060] T b8a4f81761e3423fa8d2e3144b6b4ca8 P 93881c5b9b0648248e627ef7b541aec4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:24:07.757978 17939 raft_consensus.cc:515] T b8a4f81761e3423fa8d2e3144b6b4ca8 P 93881c5b9b0648248e627ef7b541aec4 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f62ce053d68f4a868fa48f951d56da1a" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 33029 } } peers { permanent_uuid: "93881c5b9b0648248e627ef7b541aec4" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 44419 } } peers { permanent_uuid: "5b2c1cd5f367458e811c859b7dbca333" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 40055 } }
I20260709 13:24:07.762710 18061 raft_consensus.cc:993] T 93f7e8af061940dd82364fa3c6e69825 P 93881c5b9b0648248e627ef7b541aec4: : Instructing follower 5b2c1cd5f367458e811c859b7dbca333 to start an election
I20260709 13:24:07.763303 18061 raft_consensus.cc:1081] T 93f7e8af061940dd82364fa3c6e69825 P 93881c5b9b0648248e627ef7b541aec4 [term 1 LEADER]: Signalling peer 5b2c1cd5f367458e811c859b7dbca333 to start an election
I20260709 13:24:07.763326 17866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8a4f81761e3423fa8d2e3144b6b4ca8" candidate_uuid: "93881c5b9b0648248e627ef7b541aec4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f62ce053d68f4a868fa48f951d56da1a"
I20260709 13:24:07.764814 17939 leader_election.cc:290] T b8a4f81761e3423fa8d2e3144b6b4ca8 P 93881c5b9b0648248e627ef7b541aec4 [CANDIDATE]: Term 2 election: Requested vote from peers f62ce053d68f4a868fa48f951d56da1a (127.5.126.65:33029), 5b2c1cd5f367458e811c859b7dbca333 (127.5.126.67:40055)
I20260709 13:24:07.764979 17866 raft_consensus.cc:3055] T b8a4f81761e3423fa8d2e3144b6b4ca8 P f62ce053d68f4a868fa48f951d56da1a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:24:07.765407 17866 raft_consensus.cc:740] T b8a4f81761e3423fa8d2e3144b6b4ca8 P f62ce053d68f4a868fa48f951d56da1a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f62ce053d68f4a868fa48f951d56da1a, State: Running, Role: LEADER
I20260709 13:24:07.766352 17866 consensus_queue.cc:260] T b8a4f81761e3423fa8d2e3144b6b4ca8 P f62ce053d68f4a868fa48f951d56da1a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f62ce053d68f4a868fa48f951d56da1a" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 33029 } } peers { permanent_uuid: "93881c5b9b0648248e627ef7b541aec4" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 44419 } } peers { permanent_uuid: "5b2c1cd5f367458e811c859b7dbca333" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 40055 } }
I20260709 13:24:07.767379 17866 raft_consensus.cc:3060] T b8a4f81761e3423fa8d2e3144b6b4ca8 P f62ce053d68f4a868fa48f951d56da1a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:24:07.767931 18014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8a4f81761e3423fa8d2e3144b6b4ca8" candidate_uuid: "93881c5b9b0648248e627ef7b541aec4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5b2c1cd5f367458e811c859b7dbca333"
I20260709 13:24:07.768460 18013 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "93f7e8af061940dd82364fa3c6e69825"
dest_uuid: "5b2c1cd5f367458e811c859b7dbca333"
 from {username='slave'} at 127.0.0.1:59802
I20260709 13:24:07.769230 18013 raft_consensus.cc:493] T 93f7e8af061940dd82364fa3c6e69825 P 5b2c1cd5f367458e811c859b7dbca333 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:24:07.769663 18013 raft_consensus.cc:3060] T 93f7e8af061940dd82364fa3c6e69825 P 5b2c1cd5f367458e811c859b7dbca333 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:24:07.777590 17866 raft_consensus.cc:2468] T b8a4f81761e3423fa8d2e3144b6b4ca8 P f62ce053d68f4a868fa48f951d56da1a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 93881c5b9b0648248e627ef7b541aec4 in term 2.
I20260709 13:24:07.782467 18013 raft_consensus.cc:515] T 93f7e8af061940dd82364fa3c6e69825 P 5b2c1cd5f367458e811c859b7dbca333 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f62ce053d68f4a868fa48f951d56da1a" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 33029 } } peers { permanent_uuid: "93881c5b9b0648248e627ef7b541aec4" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 44419 } } peers { permanent_uuid: "5b2c1cd5f367458e811c859b7dbca333" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 40055 } }
I20260709 13:24:07.784771 17904 leader_election.cc:304] T b8a4f81761e3423fa8d2e3144b6b4ca8 P 93881c5b9b0648248e627ef7b541aec4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 93881c5b9b0648248e627ef7b541aec4, f62ce053d68f4a868fa48f951d56da1a; no voters: 5b2c1cd5f367458e811c859b7dbca333
I20260709 13:24:07.786410 18136 raft_consensus.cc:2804] T b8a4f81761e3423fa8d2e3144b6b4ca8 P 93881c5b9b0648248e627ef7b541aec4 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:24:07.786484 17865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93f7e8af061940dd82364fa3c6e69825" candidate_uuid: "5b2c1cd5f367458e811c859b7dbca333" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f62ce053d68f4a868fa48f951d56da1a"
I20260709 13:24:07.787037 18136 raft_consensus.cc:697] T b8a4f81761e3423fa8d2e3144b6b4ca8 P 93881c5b9b0648248e627ef7b541aec4 [term 2 LEADER]: Becoming Leader. State: Replica: 93881c5b9b0648248e627ef7b541aec4, State: Running, Role: LEADER
I20260709 13:24:07.787423 17865 raft_consensus.cc:3060] T 93f7e8af061940dd82364fa3c6e69825 P f62ce053d68f4a868fa48f951d56da1a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:24:07.788133 18136 consensus_queue.cc:237] T b8a4f81761e3423fa8d2e3144b6b4ca8 P 93881c5b9b0648248e627ef7b541aec4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f62ce053d68f4a868fa48f951d56da1a" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 33029 } } peers { permanent_uuid: "93881c5b9b0648248e627ef7b541aec4" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 44419 } } peers { permanent_uuid: "5b2c1cd5f367458e811c859b7dbca333" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 40055 } }
I20260709 13:24:07.793210 17939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93f7e8af061940dd82364fa3c6e69825" candidate_uuid: "5b2c1cd5f367458e811c859b7dbca333" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "93881c5b9b0648248e627ef7b541aec4"
I20260709 13:24:07.793969 17939 raft_consensus.cc:3055] T 93f7e8af061940dd82364fa3c6e69825 P 93881c5b9b0648248e627ef7b541aec4 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:24:07.794341 17939 raft_consensus.cc:740] T 93f7e8af061940dd82364fa3c6e69825 P 93881c5b9b0648248e627ef7b541aec4 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 93881c5b9b0648248e627ef7b541aec4, State: Running, Role: LEADER
I20260709 13:24:07.795253 18013 leader_election.cc:290] T 93f7e8af061940dd82364fa3c6e69825 P 5b2c1cd5f367458e811c859b7dbca333 [CANDIDATE]: Term 2 election: Requested vote from peers f62ce053d68f4a868fa48f951d56da1a (127.5.126.65:33029), 93881c5b9b0648248e627ef7b541aec4 (127.5.126.66:44419)
I20260709 13:24:07.795663 17939 consensus_queue.cc:260] T 93f7e8af061940dd82364fa3c6e69825 P 93881c5b9b0648248e627ef7b541aec4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f62ce053d68f4a868fa48f951d56da1a" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 33029 } } peers { permanent_uuid: "93881c5b9b0648248e627ef7b541aec4" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 44419 } } peers { permanent_uuid: "5b2c1cd5f367458e811c859b7dbca333" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 40055 } }
I20260709 13:24:07.797174 17939 raft_consensus.cc:3060] T 93f7e8af061940dd82364fa3c6e69825 P 93881c5b9b0648248e627ef7b541aec4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:24:07.802043 17865 raft_consensus.cc:2468] T 93f7e8af061940dd82364fa3c6e69825 P f62ce053d68f4a868fa48f951d56da1a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5b2c1cd5f367458e811c859b7dbca333 in term 2.
I20260709 13:24:07.801889 17762 catalog_manager.cc:5697] T b8a4f81761e3423fa8d2e3144b6b4ca8 P 93881c5b9b0648248e627ef7b541aec4 reported cstate change: term changed from 1 to 2, leader changed from f62ce053d68f4a868fa48f951d56da1a (127.5.126.65) to 93881c5b9b0648248e627ef7b541aec4 (127.5.126.66). New cstate: current_term: 2 leader_uuid: "93881c5b9b0648248e627ef7b541aec4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f62ce053d68f4a868fa48f951d56da1a" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 33029 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "93881c5b9b0648248e627ef7b541aec4" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 44419 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5b2c1cd5f367458e811c859b7dbca333" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 40055 } health_report { overall_health: UNKNOWN } } }
I20260709 13:24:07.803229 17978 leader_election.cc:304] T 93f7e8af061940dd82364fa3c6e69825 P 5b2c1cd5f367458e811c859b7dbca333 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b2c1cd5f367458e811c859b7dbca333, f62ce053d68f4a868fa48f951d56da1a; no voters: 
I20260709 13:24:07.804260 18107 raft_consensus.cc:2804] T 93f7e8af061940dd82364fa3c6e69825 P 5b2c1cd5f367458e811c859b7dbca333 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:24:07.804908 18107 raft_consensus.cc:697] T 93f7e8af061940dd82364fa3c6e69825 P 5b2c1cd5f367458e811c859b7dbca333 [term 2 LEADER]: Becoming Leader. State: Replica: 5b2c1cd5f367458e811c859b7dbca333, State: Running, Role: LEADER
I20260709 13:24:07.805624 17939 raft_consensus.cc:2468] T 93f7e8af061940dd82364fa3c6e69825 P 93881c5b9b0648248e627ef7b541aec4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5b2c1cd5f367458e811c859b7dbca333 in term 2.
I20260709 13:24:07.805805 18107 consensus_queue.cc:237] T 93f7e8af061940dd82364fa3c6e69825 P 5b2c1cd5f367458e811c859b7dbca333 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f62ce053d68f4a868fa48f951d56da1a" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 33029 } } peers { permanent_uuid: "93881c5b9b0648248e627ef7b541aec4" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 44419 } } peers { permanent_uuid: "5b2c1cd5f367458e811c859b7dbca333" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 40055 } }
I20260709 13:24:07.813804 17764 catalog_manager.cc:5697] T 93f7e8af061940dd82364fa3c6e69825 P 5b2c1cd5f367458e811c859b7dbca333 reported cstate change: term changed from 1 to 2, leader changed from 93881c5b9b0648248e627ef7b541aec4 (127.5.126.66) to 5b2c1cd5f367458e811c859b7dbca333 (127.5.126.67). New cstate: current_term: 2 leader_uuid: "5b2c1cd5f367458e811c859b7dbca333" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f62ce053d68f4a868fa48f951d56da1a" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 33029 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "93881c5b9b0648248e627ef7b541aec4" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 44419 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5b2c1cd5f367458e811c859b7dbca333" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 40055 } health_report { overall_health: HEALTHY } } }
I20260709 13:24:08.088945 18013 raft_consensus.cc:1275] T 66404f05eae74a7f938e85e5eae5cf72 P 5b2c1cd5f367458e811c859b7dbca333 [term 2 FOLLOWER]: Refusing update from remote peer 93881c5b9b0648248e627ef7b541aec4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:24:08.089372 17865 raft_consensus.cc:1275] T 477afb2899ff459caf4d0eb55e840010 P f62ce053d68f4a868fa48f951d56da1a [term 2 FOLLOWER]: Refusing update from remote peer 93881c5b9b0648248e627ef7b541aec4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:24:08.090760 18112 consensus_queue.cc:1048] T 66404f05eae74a7f938e85e5eae5cf72 P 93881c5b9b0648248e627ef7b541aec4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b2c1cd5f367458e811c859b7dbca333" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 40055 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:24:08.091006 18061 consensus_queue.cc:1048] T 477afb2899ff459caf4d0eb55e840010 P 93881c5b9b0648248e627ef7b541aec4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f62ce053d68f4a868fa48f951d56da1a" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 33029 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:24:08.092382 18013 raft_consensus.cc:1275] T 98bdadc834134483b31be48f35123bbd P 5b2c1cd5f367458e811c859b7dbca333 [term 2 FOLLOWER]: Refusing update from remote peer 93881c5b9b0648248e627ef7b541aec4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:24:08.094940 18061 consensus_queue.cc:1048] T 98bdadc834134483b31be48f35123bbd P 93881c5b9b0648248e627ef7b541aec4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b2c1cd5f367458e811c859b7dbca333" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 40055 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:24:08.102205 17866 raft_consensus.cc:1275] T 66404f05eae74a7f938e85e5eae5cf72 P f62ce053d68f4a868fa48f951d56da1a [term 2 FOLLOWER]: Refusing update from remote peer 93881c5b9b0648248e627ef7b541aec4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:24:08.106079 18014 raft_consensus.cc:3060] T 477afb2899ff459caf4d0eb55e840010 P 5b2c1cd5f367458e811c859b7dbca333 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:24:08.107988 18061 consensus_queue.cc:1048] T 66404f05eae74a7f938e85e5eae5cf72 P 93881c5b9b0648248e627ef7b541aec4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f62ce053d68f4a868fa48f951d56da1a" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 33029 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:24:08.119287 17865 raft_consensus.cc:1275] T 98bdadc834134483b31be48f35123bbd P f62ce053d68f4a868fa48f951d56da1a [term 2 FOLLOWER]: Refusing update from remote peer 93881c5b9b0648248e627ef7b541aec4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:24:08.120936 18136 consensus_queue.cc:1048] T 98bdadc834134483b31be48f35123bbd P 93881c5b9b0648248e627ef7b541aec4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f62ce053d68f4a868fa48f951d56da1a" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 33029 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:24:08.125355 18014 raft_consensus.cc:1275] T 477afb2899ff459caf4d0eb55e840010 P 5b2c1cd5f367458e811c859b7dbca333 [term 2 FOLLOWER]: Refusing update from remote peer 93881c5b9b0648248e627ef7b541aec4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:24:08.127439 18136 consensus_queue.cc:1048] T 477afb2899ff459caf4d0eb55e840010 P 93881c5b9b0648248e627ef7b541aec4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b2c1cd5f367458e811c859b7dbca333" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 40055 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:24:08.211256 17939 raft_consensus.cc:1275] T d3bd24e790d3483185e9f89c8521831b P 93881c5b9b0648248e627ef7b541aec4 [term 2 FOLLOWER]: Refusing update from remote peer f62ce053d68f4a868fa48f951d56da1a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:24:08.212934 18082 consensus_queue.cc:1048] T d3bd24e790d3483185e9f89c8521831b P f62ce053d68f4a868fa48f951d56da1a [LEADER]: Connected to new peer: Peer: permanent_uuid: "93881c5b9b0648248e627ef7b541aec4" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 44419 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:24:08.222708 18014 raft_consensus.cc:1275] T d3bd24e790d3483185e9f89c8521831b P 5b2c1cd5f367458e811c859b7dbca333 [term 2 FOLLOWER]: Refusing update from remote peer f62ce053d68f4a868fa48f951d56da1a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:24:08.224897 18064 consensus_queue.cc:1048] T d3bd24e790d3483185e9f89c8521831b P f62ce053d68f4a868fa48f951d56da1a [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b2c1cd5f367458e811c859b7dbca333" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 40055 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:24:08.246259 18014 raft_consensus.cc:3060] T b8a4f81761e3423fa8d2e3144b6b4ca8 P 5b2c1cd5f367458e811c859b7dbca333 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:24:08.251823 18014 raft_consensus.cc:1275] T b8a4f81761e3423fa8d2e3144b6b4ca8 P 5b2c1cd5f367458e811c859b7dbca333 [term 2 FOLLOWER]: Refusing update from remote peer 93881c5b9b0648248e627ef7b541aec4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:24:08.253518 18136 consensus_queue.cc:1048] T b8a4f81761e3423fa8d2e3144b6b4ca8 P 93881c5b9b0648248e627ef7b541aec4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b2c1cd5f367458e811c859b7dbca333" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 40055 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:24:08.262292 17865 raft_consensus.cc:1275] T b8a4f81761e3423fa8d2e3144b6b4ca8 P f62ce053d68f4a868fa48f951d56da1a [term 2 FOLLOWER]: Refusing update from remote peer 93881c5b9b0648248e627ef7b541aec4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:24:08.264349 18137 consensus_queue.cc:1048] T b8a4f81761e3423fa8d2e3144b6b4ca8 P 93881c5b9b0648248e627ef7b541aec4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f62ce053d68f4a868fa48f951d56da1a" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 33029 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:24:08.275326 17865 raft_consensus.cc:1275] T 93f7e8af061940dd82364fa3c6e69825 P f62ce053d68f4a868fa48f951d56da1a [term 2 FOLLOWER]: Refusing update from remote peer 5b2c1cd5f367458e811c859b7dbca333: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:24:08.276763 18107 consensus_queue.cc:1048] T 93f7e8af061940dd82364fa3c6e69825 P 5b2c1cd5f367458e811c859b7dbca333 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f62ce053d68f4a868fa48f951d56da1a" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 33029 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:24:08.285666 17939 raft_consensus.cc:1275] T 93f7e8af061940dd82364fa3c6e69825 P 93881c5b9b0648248e627ef7b541aec4 [term 2 FOLLOWER]: Refusing update from remote peer 5b2c1cd5f367458e811c859b7dbca333: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:24:08.287436 18140 consensus_queue.cc:1048] T 93f7e8af061940dd82364fa3c6e69825 P 5b2c1cd5f367458e811c859b7dbca333 [LEADER]: Connected to new peer: Peer: permanent_uuid: "93881c5b9b0648248e627ef7b541aec4" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 44419 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:24:10.605551 17764 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47206:
name: "soft_deleted_table"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:24:10.608412 17764 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table soft_deleted_table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:24:10.662894 17853 tablet_service.cc:1511] Processing CreateTablet for tablet d8c09480b6ed4e05bdb4abfd117fa378 (DEFAULT_TABLE table=soft_deleted_table [id=89ae5f51649843699d471e253d1837e9]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:24:10.664538 17853 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d8c09480b6ed4e05bdb4abfd117fa378. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:24:10.665387 17931 tablet_service.cc:1511] Processing CreateTablet for tablet d8c09480b6ed4e05bdb4abfd117fa378 (DEFAULT_TABLE table=soft_deleted_table [id=89ae5f51649843699d471e253d1837e9]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:24:10.666816 17931 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d8c09480b6ed4e05bdb4abfd117fa378. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:24:10.668076 18004 tablet_service.cc:1511] Processing CreateTablet for tablet d8c09480b6ed4e05bdb4abfd117fa378 (DEFAULT_TABLE table=soft_deleted_table [id=89ae5f51649843699d471e253d1837e9]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:24:10.669591 18004 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d8c09480b6ed4e05bdb4abfd117fa378. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:24:10.673835 17855 tablet_service.cc:1511] Processing CreateTablet for tablet 6112fc9278e94d05946790ffc15dc4f7 (DEFAULT_TABLE table=soft_deleted_table [id=89ae5f51649843699d471e253d1837e9]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:24:10.675474 17855 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6112fc9278e94d05946790ffc15dc4f7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:24:10.681758 17850 tablet_service.cc:1511] Processing CreateTablet for tablet 910689bc7c56485d8063b2ca5f4d4c17 (DEFAULT_TABLE table=soft_deleted_table [id=89ae5f51649843699d471e253d1837e9]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:24:10.682263 17856 tablet_service.cc:1511] Processing CreateTablet for tablet 8d003b1fd939449988c9ae06955c3808 (DEFAULT_TABLE table=soft_deleted_table [id=89ae5f51649843699d471e253d1837e9]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:24:10.683235 17850 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 910689bc7c56485d8063b2ca5f4d4c17. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:24:10.683887 17856 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8d003b1fd939449988c9ae06955c3808. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:24:10.685534 17928 tablet_service.cc:1511] Processing CreateTablet for tablet 6112fc9278e94d05946790ffc15dc4f7 (DEFAULT_TABLE table=soft_deleted_table [id=89ae5f51649843699d471e253d1837e9]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:24:10.686841 17928 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6112fc9278e94d05946790ffc15dc4f7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:24:10.687784 17930 tablet_service.cc:1511] Processing CreateTablet for tablet 8d003b1fd939449988c9ae06955c3808 (DEFAULT_TABLE table=soft_deleted_table [id=89ae5f51649843699d471e253d1837e9]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:24:10.689388 17930 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8d003b1fd939449988c9ae06955c3808. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:24:10.689572 18003 tablet_service.cc:1511] Processing CreateTablet for tablet 6112fc9278e94d05946790ffc15dc4f7 (DEFAULT_TABLE table=soft_deleted_table [id=89ae5f51649843699d471e253d1837e9]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:24:10.690357 18001 tablet_service.cc:1511] Processing CreateTablet for tablet 8d003b1fd939449988c9ae06955c3808 (DEFAULT_TABLE table=soft_deleted_table [id=89ae5f51649843699d471e253d1837e9]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:24:10.690975 18003 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6112fc9278e94d05946790ffc15dc4f7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:24:10.691617 18001 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8d003b1fd939449988c9ae06955c3808. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:24:10.693018 18002 tablet_service.cc:1511] Processing CreateTablet for tablet 910689bc7c56485d8063b2ca5f4d4c17 (DEFAULT_TABLE table=soft_deleted_table [id=89ae5f51649843699d471e253d1837e9]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:24:10.694279 18002 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 910689bc7c56485d8063b2ca5f4d4c17. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:24:10.697036 17927 tablet_service.cc:1511] Processing CreateTablet for tablet 910689bc7c56485d8063b2ca5f4d4c17 (DEFAULT_TABLE table=soft_deleted_table [id=89ae5f51649843699d471e253d1837e9]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:24:10.698287 17927 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 910689bc7c56485d8063b2ca5f4d4c17. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:24:10.712836 17854 tablet_service.cc:1511] Processing CreateTablet for tablet c8b2ba53ff454a39ae7982592bd75e99 (DEFAULT_TABLE table=soft_deleted_table [id=89ae5f51649843699d471e253d1837e9]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:24:10.715256 17854 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c8b2ba53ff454a39ae7982592bd75e99. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:24:10.720788 17929 tablet_service.cc:1511] Processing CreateTablet for tablet c8b2ba53ff454a39ae7982592bd75e99 (DEFAULT_TABLE table=soft_deleted_table [id=89ae5f51649843699d471e253d1837e9]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:24:10.722386 17929 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c8b2ba53ff454a39ae7982592bd75e99. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:24:10.760453 18157 tablet_bootstrap.cc:492] T d8c09480b6ed4e05bdb4abfd117fa378 P 93881c5b9b0648248e627ef7b541aec4: Bootstrap starting.
I20260709 13:24:10.763906 18158 tablet_bootstrap.cc:492] T 6112fc9278e94d05946790ffc15dc4f7 P 5b2c1cd5f367458e811c859b7dbca333: Bootstrap starting.
I20260709 13:24:10.767850 18157 tablet_bootstrap.cc:654] T d8c09480b6ed4e05bdb4abfd117fa378 P 93881c5b9b0648248e627ef7b541aec4: Neither blocks nor log segments found. Creating new log.
I20260709 13:24:10.770450 18158 tablet_bootstrap.cc:654] T 6112fc9278e94d05946790ffc15dc4f7 P 5b2c1cd5f367458e811c859b7dbca333: Neither blocks nor log segments found. Creating new log.
W20260709 13:24:10.806936 17812 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:24:10.820447 18159 tablet_bootstrap.cc:492] T 910689bc7c56485d8063b2ca5f4d4c17 P f62ce053d68f4a868fa48f951d56da1a: Bootstrap starting.
I20260709 13:24:10.829836 17928 tablet_service.cc:1511] Processing CreateTablet for tablet 75dc16ae948c4e24825c10b54040c95f (DEFAULT_TABLE table=soft_deleted_table [id=89ae5f51649843699d471e253d1837e9]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:24:10.830312 17851 tablet_service.cc:1511] Processing CreateTablet for tablet 6fa73bbd59654140adb36ac550bf0140 (DEFAULT_TABLE table=soft_deleted_table [id=89ae5f51649843699d471e253d1837e9]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:24:10.832175 17928 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 75dc16ae948c4e24825c10b54040c95f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:24:10.834239 17855 tablet_service.cc:1511] Processing CreateTablet for tablet 8693a343b4d94180b276b5a728f21637 (DEFAULT_TABLE table=soft_deleted_table [id=89ae5f51649843699d471e253d1837e9]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:24:10.843946 18159 tablet_bootstrap.cc:654] T 910689bc7c56485d8063b2ca5f4d4c17 P f62ce053d68f4a868fa48f951d56da1a: Neither blocks nor log segments found. Creating new log.
I20260709 13:24:10.843955 17852 tablet_service.cc:1511] Processing CreateTablet for tablet 75dc16ae948c4e24825c10b54040c95f (DEFAULT_TABLE table=soft_deleted_table [id=89ae5f51649843699d471e253d1837e9]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:24:10.855902 17930 tablet_service.cc:1511] Processing CreateTablet for tablet 6fa73bbd59654140adb36ac550bf0140 (DEFAULT_TABLE table=soft_deleted_table [id=89ae5f51649843699d471e253d1837e9]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:24:10.858242 17930 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6fa73bbd59654140adb36ac550bf0140. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:24:10.859957 17931 tablet_service.cc:1511] Processing CreateTablet for tablet 8693a343b4d94180b276b5a728f21637 (DEFAULT_TABLE table=soft_deleted_table [id=89ae5f51649843699d471e253d1837e9]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:24:10.862848 17931 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8693a343b4d94180b276b5a728f21637. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:24:10.835690 17851 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6fa73bbd59654140adb36ac550bf0140. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:24:10.876502 17855 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8693a343b4d94180b276b5a728f21637. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:24:10.876714 18001 tablet_service.cc:1511] Processing CreateTablet for tablet 6fa73bbd59654140adb36ac550bf0140 (DEFAULT_TABLE table=soft_deleted_table [id=89ae5f51649843699d471e253d1837e9]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:24:10.877360 18002 tablet_service.cc:1511] Processing CreateTablet for tablet 8693a343b4d94180b276b5a728f21637 (DEFAULT_TABLE table=soft_deleted_table [id=89ae5f51649843699d471e253d1837e9]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:24:10.880541 17852 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 75dc16ae948c4e24825c10b54040c95f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:24:10.879801 18001 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6fa73bbd59654140adb36ac550bf0140. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:24:10.925186 18004 tablet_service.cc:1511] Processing CreateTablet for tablet c8b2ba53ff454a39ae7982592bd75e99 (DEFAULT_TABLE table=soft_deleted_table [id=89ae5f51649843699d471e253d1837e9]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:24:10.876714 18005 tablet_service.cc:1511] Processing CreateTablet for tablet 75dc16ae948c4e24825c10b54040c95f (DEFAULT_TABLE table=soft_deleted_table [id=89ae5f51649843699d471e253d1837e9]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:24:10.947707 17929 tablet_service.cc:1511] Processing CreateTablet for tablet ebc6959597f54d94ac7459f922a62871 (DEFAULT_TABLE table=soft_deleted_table [id=89ae5f51649843699d471e253d1837e9]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:24:10.947711 18003 tablet_service.cc:1511] Processing CreateTablet for tablet ebc6959597f54d94ac7459f922a62871 (DEFAULT_TABLE table=soft_deleted_table [id=89ae5f51649843699d471e253d1837e9]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:24:10.949757 17929 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ebc6959597f54d94ac7459f922a62871. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:24:10.949757 18003 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ebc6959597f54d94ac7459f922a62871. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:24:10.939114 17850 tablet_service.cc:1511] Processing CreateTablet for tablet ebc6959597f54d94ac7459f922a62871 (DEFAULT_TABLE table=soft_deleted_table [id=89ae5f51649843699d471e253d1837e9]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:24:10.953327 17850 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ebc6959597f54d94ac7459f922a62871. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:24:10.995440 17748 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.5.126.65:33029, user_credentials={real_user=slave}} blocked reactor thread for 82685.9us
I20260709 13:24:10.997475 18002 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8693a343b4d94180b276b5a728f21637. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:24:11.007089 18005 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 75dc16ae948c4e24825c10b54040c95f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:24:11.017330 18004 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c8b2ba53ff454a39ae7982592bd75e99. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:24:11.035092 18157 tablet_bootstrap.cc:492] T d8c09480b6ed4e05bdb4abfd117fa378 P 93881c5b9b0648248e627ef7b541aec4: No bootstrap required, opened a new log
I20260709 13:24:11.044186 18159 tablet_bootstrap.cc:492] T 910689bc7c56485d8063b2ca5f4d4c17 P f62ce053d68f4a868fa48f951d56da1a: No bootstrap required, opened a new log
I20260709 13:24:11.044986 18159 ts_tablet_manager.cc:1403] T 910689bc7c56485d8063b2ca5f4d4c17 P f62ce053d68f4a868fa48f951d56da1a: Time spent bootstrapping tablet: real 0.226s	user 0.035s	sys 0.062s
I20260709 13:24:11.052232 18157 ts_tablet_manager.cc:1403] T d8c09480b6ed4e05bdb4abfd117fa378 P 93881c5b9b0648248e627ef7b541aec4: Time spent bootstrapping tablet: real 0.292s	user 0.018s	sys 0.004s
I20260709 13:24:11.059013 18159 raft_consensus.cc:359] T 910689bc7c56485d8063b2ca5f4d4c17 P f62ce053d68f4a868fa48f951d56da1a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f62ce053d68f4a868fa48f951d56da1a" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 33029 } } peers { permanent_uuid: "93881c5b9b0648248e627ef7b541aec4" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 44419 } } peers { permanent_uuid: "5b2c1cd5f367458e811c859b7dbca333" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 40055 } }
I20260709 13:24:11.061172 18159 raft_consensus.cc:385] T 910689bc7c56485d8063b2ca5f4d4c17 P f62ce053d68f4a868fa48f951d56da1a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:24:11.061741 18159 raft_consensus.cc:740] T 910689bc7c56485d8063b2ca5f4d4c17 P f62ce053d68f4a868fa48f951d56da1a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f62ce053d68f4a868fa48f951d56da1a, State: Initialized, Role: FOLLOWER
I20260709 13:24:11.081987 18159 consensus_queue.cc:260] T 910689bc7c56485d8063b2ca5f4d4c17 P f62ce053d68f4a868fa48f951d56da1a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f62ce053d68f4a868fa48f951d56da1a" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 33029 } } peers { permanent_uuid: "93881c5b9b0648248e627ef7b541aec4" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 44419 } } peers { permanent_uuid: "5b2c1cd5f367458e811c859b7dbca333" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 40055 } }
I20260709 13:24:11.082881 18158 tablet_bootstrap.cc:492] T 6112fc9278e94d05946790ffc15dc4f7 P 5b2c1cd5f367458e811c859b7dbca333: No bootstrap required, opened a new log
I20260709 13:24:11.083879 18158 ts_tablet_manager.cc:1403] T 6112fc9278e94d05946790ffc15dc4f7 P 5b2c1cd5f367458e811c859b7dbca333: Time spent bootstrapping tablet: real 0.320s	user 0.025s	sys 0.026s
I20260709 13:24:11.086134 18159 ts_tablet_manager.cc:1434] T 910689bc7c56485d8063b2ca5f4d4c17 P f62ce053d68f4a868fa48f951d56da1a: Time spent starting tablet: real 0.041s	user 0.007s	sys 0.006s
I20260709 13:24:11.087750 18159 tablet_bootstrap.cc:492] T 6112fc9278e94d05946790ffc15dc4f7 P f62ce053d68f4a868fa48f951d56da1a: Bootstrap starting.
I20260709 13:24:11.113226 18159 tablet_bootstrap.cc:654] T 6112fc9278e94d05946790ffc15dc4f7 P f62ce053d68f4a868fa48f951d56da1a: Neither blocks nor log segments found. Creating new log.
I20260709 13:24:11.114857 18158 raft_consensus.cc:359] T 6112fc9278e94d05946790ffc15dc4f7 P 5b2c1cd5f367458e811c859b7dbca333 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f62ce053d68f4a868fa48f951d56da1a" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 33029 } } peers { permanent_uuid: "93881c5b9b0648248e627ef7b541aec4" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 44419 } } peers { permanent_uuid: "5b2c1cd5f367458e811c859b7dbca333" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 40055 } }
W20260709 13:24:11.115197 17905 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.67:40055, user_credentials={real_user=slave}} blocked reactor thread for 101515us
I20260709 13:24:11.115850 18158 raft_consensus.cc:385] T 6112fc9278e94d05946790ffc15dc4f7 P 5b2c1cd5f367458e811c859b7dbca333 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:24:11.116279 18158 raft_consensus.cc:740] T 6112fc9278e94d05946790ffc15dc4f7 P 5b2c1cd5f367458e811c859b7dbca333 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5b2c1cd5f367458e811c859b7dbca333, State: Initialized, Role: FOLLOWER
I20260709 13:24:11.117079 18158 consensus_queue.cc:260] T 6112fc9278e94d05946790ffc15dc4f7 P 5b2c1cd5f367458e811c859b7dbca333 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f62ce053d68f4a868fa48f951d56da1a" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 33029 } } peers { permanent_uuid: "93881c5b9b0648248e627ef7b541aec4" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 44419 } } peers { permanent_uuid: "5b2c1cd5f367458e811c859b7dbca333" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 40055 } }
I20260709 13:24:11.120604 18159 tablet_bootstrap.cc:492] T 6112fc9278e94d05946790ffc15dc4f7 P f62ce053d68f4a868fa48f951d56da1a: No bootstrap required, opened a new log
I20260709 13:24:11.121284 18159 ts_tablet_manager.cc:1403] T 6112fc9278e94d05946790ffc15dc4f7 P f62ce053d68f4a868fa48f951d56da1a: Time spent bootstrapping tablet: real 0.034s	user 0.015s	sys 0.001s
I20260709 13:24:11.120519 18157 raft_consensus.cc:359] T d8c09480b6ed4e05bdb4abfd117fa378 P 93881c5b9b0648248e627ef7b541aec4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f62ce053d68f4a868fa48f951d56da1a" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 33029 } } peers { permanent_uuid: "93881c5b9b0648248e627ef7b541aec4" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 44419 } } peers { permanent_uuid: "5b2c1cd5f367458e811c859b7dbca333" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 40055 } }
I20260709 13:24:11.124905 18157 raft_consensus.cc:385] T d8c09480b6ed4e05bdb4abfd117fa378 P 93881c5b9b0648248e627ef7b541aec4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:24:11.125178 18159 raft_consensus.cc:359] T 6112fc9278e94d05946790ffc15dc4f7 P f62ce053d68f4a868fa48f951d56da1a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f62ce053d68f4a868fa48f951d56da1a" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 33029 } } peers { permanent_uuid: "93881c5b9b0648248e627ef7b541aec4" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 44419 } } peers { permanent_uuid: "5b2c1cd5f367458e811c859b7dbca333" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 40055 } }
I20260709 13:24:11.126252 18159 raft_consensus.cc:385] T 6112fc9278e94d05946790ffc15dc4f7 P f62ce053d68f4a868fa48f951d56da1a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:24:11.126607 18159 raft_consensus.cc:740] T 6112fc9278e94d05946790ffc15dc4f7 P f62ce053d68f4a868fa48f951d56da1a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f62ce053d68f4a868fa48f951d56da1a, State: Initialized, Role: FOLLOWER
I20260709 13:24:11.127739 18159 consensus_queue.cc:260] T 6112fc9278e94d05946790ffc15dc4f7 P f62ce053d68f4a868fa48f951d56da1a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f62ce053d68f4a868fa48f951d56da1a" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 33029 } } peers { permanent_uuid: "93881c5b9b0648248e627ef7b541aec4" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 44419 } } peers { permanent_uuid: "5b2c1cd5f367458e811c859b7dbca333" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 40055 } }
I20260709 13:24:11.130682 18159 ts_tablet_manager.cc:1434] T 6112fc9278e94d05946790ffc15dc4f7 P f62ce053d68f4a868fa48f951d56da1a: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
I20260709 13:24:11.133916 18159 tablet_bootstrap.cc:492] T 8d003b1fd939449988c9ae06955c3808 P f62ce053d68f4a868fa48f951d56da1a: Bootstrap starting.
I20260709 13:24:11.125262 18157 raft_consensus.cc:740] T d8c09480b6ed4e05bdb4abfd117fa378 P 93881c5b9b0648248e627ef7b541aec4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 93881c5b9b0648248e627ef7b541aec4, State: Initialized, Role: FOLLOWER
I20260709 13:24:11.138084 18157 consensus_queue.cc:260] T d8c09480b6ed4e05bdb4abfd117fa378 P 93881c5b9b0648248e627ef7b541aec4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f62ce053d68f4a868fa48f951d56da1a" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 33029 } } peers { permanent_uuid: "93881c5b9b0648248e627ef7b541aec4" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 44419 } } peers { permanent_uuid: "5b2c1cd5f367458e811c859b7dbca333" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 40055 } }
I20260709 13:24:11.142593 18159 tablet_bootstrap.cc:654] T 8d003b1fd939449988c9ae06955c3808 P f62ce053d68f4a868fa48f951d56da1a: Neither blocks nor log segments found. Creating new log.
I20260709 13:24:11.128609 18158 ts_tablet_manager.cc:1434] T 6112fc9278e94d05946790ffc15dc4f7 P 5b2c1cd5f367458e811c859b7dbca333: Time spent starting tablet: real 0.036s	user 0.003s	sys 0.002s
I20260709 13:24:11.144814 18158 tablet_bootstrap.cc:492] T 910689bc7c56485d8063b2ca5f4d4c17 P 5b2c1cd5f367458e811c859b7dbca333: Bootstrap starting.
I20260709 13:24:11.155710 18159 tablet_bootstrap.cc:492] T 8d003b1fd939449988c9ae06955c3808 P f62ce053d68f4a868fa48f951d56da1a: No bootstrap required, opened a new log
I20260709 13:24:11.156565 18159 ts_tablet_manager.cc:1403] T 8d003b1fd939449988c9ae06955c3808 P f62ce053d68f4a868fa48f951d56da1a: Time spent bootstrapping tablet: real 0.025s	user 0.021s	sys 0.000s
I20260709 13:24:11.155795 18158 tablet_bootstrap.cc:654] T 910689bc7c56485d8063b2ca5f4d4c17 P 5b2c1cd5f367458e811c859b7dbca333: Neither blocks nor log segments found. Creating new log.
I20260709 13:24:11.157305 18157 ts_tablet_manager.cc:1434] T d8c09480b6ed4e05bdb4abfd117fa378 P 93881c5b9b0648248e627ef7b541aec4: Time spent starting tablet: real 0.104s	user 0.008s	sys 0.002s
I20260709 13:24:11.158681 18157 tablet_bootstrap.cc:492] T 8d003b1fd939449988c9ae06955c3808 P 93881c5b9b0648248e627ef7b541aec4: Bootstrap starting.
I20260709 13:24:11.160758 18159 raft_consensus.cc:359] T 8d003b1fd939449988c9ae06955c3808 P f62ce053d68f4a868fa48f951d56da1a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f62ce053d68f4a868fa48f951d56da1a" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 33029 } } peers { permanent_uuid: "93881c5b9b0648248e627ef7b541aec4" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 44419 } } peers { permanent_uuid: "5b2c1cd5f367458e811c859b7dbca333" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 40055 } }
I20260709 13:24:11.161945 18159 raft_consensus.cc:385] T 8d003b1fd939449988c9ae06955c3808 P f62ce053d68f4a868fa48f951d56da1a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:24:11.162364 18159 raft_consensus.cc:740] T 8d003b1fd939449988c9ae06955c3808 P f62ce053d68f4a868fa48f951d56da1a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f62ce053d68f4a868fa48f951d56da1a, State: Initialized, Role: FOLLOWER
I20260709 13:24:11.163503 18159 consensus_queue.cc:260] T 8d003b1fd939449988c9ae06955c3808 P f62ce053d68f4a868fa48f951d56da1a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f62ce053d68f4a868fa48f951d56da1a" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 33029 } } peers { permanent_uuid: "93881c5b9b0648248e627ef7b541aec4" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 44419 } } peers { permanent_uuid: "5b2c1cd5f367458e811c859b7dbca333" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 40055 } }
I20260709 13:24:11.166679 18159 ts_tablet_manager.cc:1434] T 8d003b1fd939449988c9ae06955c3808 P f62ce053d68f4a868fa48f951d56da1a: Time spent starting tablet: real 0.010s	user 0.008s	sys 0.000s
I20260709 13:24:11.167932 18159 tablet_bootstrap.cc:492] T c8b2ba53ff454a39ae7982592bd75e99 P f62ce053d68f4a868fa48f951d56da1a: Bootstrap starting.
I20260709 13:24:11.168668 18157 tablet_bootstrap.cc:654] T 8d003b1fd939449988c9ae06955c3808 P 93881c5b9b0648248e627ef7b541aec4: Neither blocks nor log segments found. Creating new log.
I20260709 13:24:11.171866 18158 tablet_bootstrap.cc:492] T 910689bc7c56485d8063b2ca5f4d4c17 P 5b2c1cd5f367458e811c859b7dbca333: No bootstrap required, opened a new log
I20260709 13:24:11.172776 18158 ts_tablet_manager.cc:1403] T 910689bc7c56485d8063b2ca5f4d4c17 P 5b2c1cd5f367458e811c859b7dbca333: Time spent bootstrapping tablet: real 0.028s	user 0.014s	sys 0.004s
I20260709 13:24:11.176461 18159 tablet_bootstrap.cc:654] T c8b2ba53ff454a39ae7982592bd75e99 P f62ce053d68f4a868fa48f951d56da1a: Neither blocks nor log segments found. Creating new log.
I20260709 13:24:11.178526 18158 raft_consensus.cc:359] T 910689bc7c56485d8063b2ca5f4d4c17 P 5b2c1cd5f367458e811c859b7dbca333 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f62ce053d68f4a868fa48f951d56da1a" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 33029 } } peers { permanent_uuid: "93881c5b9b0648248e627ef7b541aec4" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 44419 } } peers { permanent_uuid: "5b2c1cd5f367458e811c859b7dbca333" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 40055 } }
I20260709 13:24:11.179553 18158 raft_consensus.cc:385] T 910689bc7c56485d8063b2ca5f4d4c17 P 5b2c1cd5f367458e811c859b7dbca333 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:24:11.179975 18158 raft_consensus.cc:740] T 910689bc7c56485d8063b2ca5f4d4c17 P 5b2c1cd5f367458e811c859b7dbca333 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5b2c1cd5f367458e811c859b7dbca333, State: Initialized, Role: FOLLOWER
I20260709 13:24:11.181370 18158 consensus_queue.cc:260] T 910689bc7c56485d8063b2ca5f4d4c17 P 5b2c1cd5f367458e811c859b7dbca333 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f62ce053d68f4a868fa48f951d56da1a" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 33029 } } peers { permanent_uuid: "93881c5b9b0648248e627ef7b541aec4" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 44419 } } peers { permanent_uuid: "5b2c1cd5f367458e811c859b7dbca333" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 40055 } }
I20260709 13:24:11.192396 18158 ts_tablet_manager.cc:1434] T 910689bc7c56485d8063b2ca5f4d4c17 P 5b2c1cd5f367458e811c859b7dbca333: Time spent starting tablet: real 0.019s	user 0.006s	sys 0.005s
I20260709 13:24:11.194562 18158 tablet_bootstrap.cc:492] T 8d003b1fd939449988c9ae06955c3808 P 5b2c1cd5f367458e811c859b7dbca333: Bootstrap starting.
I20260709 13:24:11.206676 18158 tablet_bootstrap.cc:654] T 8d003b1fd939449988c9ae06955c3808 P 5b2c1cd5f367458e811c859b7dbca333: Neither blocks nor log segments found. Creating new log.
I20260709 13:24:11.211349 18157 tablet_bootstrap.cc:492] T 8d003b1fd939449988c9ae06955c3808 P 93881c5b9b0648248e627ef7b541aec4: No bootstrap required, opened a new log
I20260709 13:24:11.211930 18157 ts_tablet_manager.cc:1403] T 8d003b1fd939449988c9ae06955c3808 P 93881c5b9b0648248e627ef7b541aec4: Time spent bootstrapping tablet: real 0.054s	user 0.005s	sys 0.033s
I20260709 13:24:11.215090 18157 raft_consensus.cc:359] T 8d003b1fd939449988c9ae06955c3808 P 93881c5b9b0648248e627ef7b541aec4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f62ce053d68f4a868fa48f951d56da1a" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 33029 } } peers { permanent_uuid: "93881c5b9b0648248e627ef7b541aec4" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 44419 } } peers { permanent_uuid: "5b2c1cd5f367458e811c859b7dbca333" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 40055 } }
I20260709 13:24:11.215829 18157 raft_consensus.cc:385] T 8d003b1fd939449988c9ae06955c3808 P 93881c5b9b0648248e627ef7b541aec4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:24:11.217989 18157 raft_consensus.cc:740] T 8d003b1fd939449988c9ae06955c3808 P 93881c5b9b0648248e627ef7b541aec4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 93881c5b9b0648248e627ef7b541aec4, State: Initialized, Role: FOLLOWER
I20260709 13:24:11.219161 18157 consensus_queue.cc:260] T 8d003b1fd939449988c9ae06955c3808 P 93881c5b9b0648248e627ef7b541aec4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f62ce053d68f4a868fa48f951d56da1a" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 33029 } } peers { permanent_uuid: "93881c5b9b0648248e627ef7b541aec4" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 44419 } } peers { permanent_uuid: "5b2c1cd5f367458e811c859b7dbca333" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 40055 } }
I20260709 13:24:11.221942 18157 ts_tablet_manager.cc:1434] T 8d003b1fd939449988c9ae06955c3808 P 93881c5b9b0648248e627ef7b541aec4: Time spent starting tablet: real 0.010s	user 0.004s	sys 0.002s
I20260709 13:24:11.223874 18157 tablet_bootstrap.cc:492] T 6112fc9278e94d05946790ffc15dc4f7 P 93881c5b9b0648248e627ef7b541aec4: Bootstrap starting.
I20260709 13:24:11.232113 18157 tablet_bootstrap.cc:654] T 6112fc9278e94d05946790ffc15dc4f7 P 93881c5b9b0648248e627ef7b541aec4: Neither blocks nor log segments found. Creating new log.
I20260709 13:24:11.239024 18159 tablet_bootstrap.cc:492] T c8b2ba53ff454a39ae7982592bd75e99 P f62ce053d68f4a868fa48f951d56da1a: No bootstrap required, opened a new log
I20260709 13:24:11.239024 18157 tablet_bootstrap.cc:492] T 6112fc9278e94d05946790ffc15dc4f7 P 93881c5b9b0648248e627ef7b541aec4: No bootstrap required, opened a new log
I20260709 13:24:11.239485 18158 tablet_bootstrap.cc:492] T 8d003b1fd939449988c9ae06955c3808 P 5b2c1cd5f367458e811c859b7dbca333: No bootstrap required, opened a new log
I20260709 13:24:11.239673 18157 ts_tablet_manager.cc:1403] T 6112fc9278e94d05946790ffc15dc4f7 P 93881c5b9b0648248e627ef7b541aec4: Time spent bootstrapping tablet: real 0.017s	user 0.009s	sys 0.005s
I20260709 13:24:11.239673 18159 ts_tablet_manager.cc:1403] T c8b2ba53ff454a39ae7982592bd75e99 P f62ce053d68f4a868fa48f951d56da1a: Time spent bootstrapping tablet: real 0.072s	user 0.023s	sys 0.019s
I20260709 13:24:11.240283 18158 ts_tablet_manager.cc:1403] T 8d003b1fd939449988c9ae06955c3808 P 5b2c1cd5f367458e811c859b7dbca333: Time spent bootstrapping tablet: real 0.046s	user 0.026s	sys 0.009s
I20260709 13:24:11.242797 18157 raft_consensus.cc:359] T 6112fc9278e94d05946790ffc15dc4f7 P 93881c5b9b0648248e627ef7b541aec4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f62ce053d68f4a868fa48f951d56da1a" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 33029 } } peers { permanent_uuid: "93881c5b9b0648248e627ef7b541aec4" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 44419 } } peers { permanent_uuid: "5b2c1cd5f367458e811c859b7dbca333" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 40055 } }
I20260709 13:24:11.243438 18157 raft_consensus.cc:385] T 6112fc9278e94d05946790ffc15dc4f7 P 93881c5b9b0648248e627ef7b541aec4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:24:11.243693 18157 raft_consensus.cc:740] T 6112fc9278e94d05946790ffc15dc4f7 P 93881c5b9b0648248e627ef7b541aec4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 93881c5b9b0648248e627ef7b541aec4, State: Initialized, Role: FOLLOWER
I20260709 13:24:11.244174 18159 raft_consensus.cc:359] T c8b2ba53ff454a39ae7982592bd75e99 P f62ce053d68f4a868fa48f951d56da1a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f62ce053d68f4a868fa48f951d56da1a" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 33029 } } peers { permanent_uuid: "93881c5b9b0648248e627ef7b541aec4" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 44419 } } peers { permanent_uuid: "5b2c1cd5f367458e811c859b7dbca333" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 40055 } }
I20260709 13:24:11.244419 18157 consensus_queue.cc:260] T 6112fc9278e94d05946790ffc15dc4f7 P 93881c5b9b0648248e627ef7b541aec4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f62ce053d68f4a868fa48f951d56da1a" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 33029 } } peers { permanent_uuid: "93881c5b9b0648248e627ef7b541aec4" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 44419 } } peers { permanent_uuid: "5b2c1cd5f367458e811c859b7dbca333" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 40055 } }
I20260709 13:24:11.244434 18158 raft_consensus.cc:359] T 8d003b1fd939449988c9ae06955c3808 P 5b2c1cd5f367458e811c859b7dbca333 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f62ce053d68f4a868fa48f951d56da1a" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 33029 } } peers { permanent_uuid: "93881c5b9b0648248e627ef7b541aec4" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 44419 } } peers { permanent_uuid: "5b2c1cd5f367458e811c859b7dbca333" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 40055 } }
I20260709 13:24:11.245595 18159 raft_consensus.cc:385] T c8b2ba53ff454a39ae7982592bd75e99 P f62ce053d68f4a868fa48f951d56da1a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:24:11.246062 18159 raft_consensus.cc:740] T c8b2ba53ff454a39ae7982592bd75e99 P f62ce053d68f4a868fa48f951d56da1a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f62ce053d68f4a868fa48f951d56da1a, State: Initialized, Role: FOLLOWER
I20260709 13:24:11.247179 18159 consensus_queue.cc:260] T c8b2ba53ff454a39ae7982592bd75e99 P f62ce053d68f4a868fa48f951d56da1a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f62ce053d68f4a868fa48f951d56da1a" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 33029 } } peers { permanent_uuid: "93881c5b9b0648248e627ef7b541aec4" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 44419 } } peers { permanent_uuid: "5b2c1cd5f367458e811c859b7dbca333" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 40055 } }
I20260709 13:24:11.247772 18157 ts_tablet_manager.cc:1434] T 6112fc9278e94d05946790ffc15dc4f7 P 93881c5b9b0648248e627ef7b541aec4: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:24:11.249094 18157 tablet_bootstrap.cc:492] T c8b2ba53ff454a39ae7982592bd75e99 P 93881c5b9b0648248e627ef7b541aec4: Bootstrap starting.
I20260709 13:24:11.245988 18158 raft_consensus.cc:385] T 8d003b1fd939449988c9ae06955c3808 P 5b2c1cd5f367458e811c859b7dbca333 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:24:11.250038 18159 ts_tablet_manager.cc:1434] T c8b2ba53ff454a39ae7982592bd75e99 P f62ce053d68f4a868fa48f951d56da1a: Time spent starting tablet: real 0.009s	user 0.004s	sys 0.003s
I20260709 13:24:11.249998 18158 raft_consensus.cc:740] T 8d003b1fd939449988c9ae06955c3808 P 5b2c1cd5f367458e811c859b7dbca333 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5b2c1cd5f367458e811c859b7dbca333, State: Initialized, Role: FOLLOWER
I20260709 13:24:11.251266 18158 consensus_queue.cc:260] T 8d003b1fd939449988c9ae06955c3808 P 5b2c1cd5f367458e811c859b7dbca333 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f62ce053d68f4a868fa48f951d56da1a" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 33029 } } peers { permanent_uuid: "93881c5b9b0648248e627ef7b541aec4" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 44419 } } peers { permanent_uuid: "5b2c1cd5f367458e811c859b7dbca333" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 40055 } }
I20260709 13:24:11.251492 18159 tablet_bootstrap.cc:492] T d8c09480b6ed4e05bdb4abfd117fa378 P f62ce053d68f4a868fa48f951d56da1a: Bootstrap starting.
I20260709 13:24:11.254526 18158 ts_tablet_manager.cc:1434] T 8d003b1fd939449988c9ae06955c3808 P 5b2c1cd5f367458e811c859b7dbca333: Time spent starting tablet: real 0.014s	user 0.008s	sys 0.000s
I20260709 13:24:11.256016 18157 tablet_bootstrap.cc:654] T c8b2ba53ff454a39ae7982592bd75e99 P 93881c5b9b0648248e627ef7b541aec4: Neither blocks nor log segments found. Creating new log.
I20260709 13:24:11.256093 18158 tablet_bootstrap.cc:492] T d8c09480b6ed4e05bdb4abfd117fa378 P 5b2c1cd5f367458e811c859b7dbca333: Bootstrap starting.
I20260709 13:24:11.263255 18159 tablet_bootstrap.cc:654] T d8c09480b6ed4e05bdb4abfd117fa378 P f62ce053d68f4a868fa48f951d56da1a: Neither blocks nor log segments found. Creating new log.
I20260709 13:24:11.264240 18158 tablet_bootstrap.cc:654] T d8c09480b6ed4e05bdb4abfd117fa378 P 5b2c1cd5f367458e811c859b7dbca333: Neither blocks nor log segments found. Creating new log.
I20260709 13:24:11.277716 18158 tablet_bootstrap.cc:492] T d8c09480b6ed4e05bdb4abfd117fa378 P 5b2c1cd5f367458e811c859b7dbca333: No bootstrap required, opened a new log
I20260709 13:24:11.277730 18159 tablet_bootstrap.cc:492] T d8c09480b6ed4e05bdb4abfd117fa378 P f62ce053d68f4a868fa48f951d56da1a: No bootstrap required, opened a new log
I20260709 13:24:11.278365 18158 ts_tablet_manager.cc:1403] T d8c09480b6ed4e05bdb4abfd117fa378 P 5b2c1cd5f367458e811c859b7dbca333: Time spent bootstrapping tablet: real 0.023s	user 0.008s	sys 0.012s
I20260709 13:24:11.278370 18159 ts_tablet_manager.cc:1403] T d8c09480b6ed4e05bdb4abfd117fa378 P f62ce053d68f4a868fa48f951d56da1a: Time spent bootstrapping tablet: real 0.027s	user 0.021s	sys 0.000s
I20260709 13:24:11.282325 18159 raft_consensus.cc:359] T d8c09480b6ed4e05bdb4abfd117fa378 P f62ce053d68f4a868fa48f951d56da1a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f62ce053d68f4a868fa48f951d56da1a" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 33029 } } peers { permanent_uuid: "93881c5b9b0648248e627ef7b541aec4" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 44419 } } peers { permanent_uuid: "5b2c1cd5f367458e811c859b7dbca333" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 40055 } }
I20260709 13:24:11.283197 18159 raft_consensus.cc:385] T d8c09480b6ed4e05bdb4abfd117fa378 P f62ce053d68f4a868fa48f951d56da1a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:24:11.282518 18158 raft_consensus.cc:359] T d8c09480b6ed4e05bdb4abfd117fa378 P 5b2c1cd5f367458e811c859b7dbca333 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f62ce053d68f4a868fa48f951d56da1a" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 33029 } } peers { permanent_uuid: "93881c5b9b0648248e627ef7b541aec4" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 44419 } } peers { permanent_uuid: "5b2c1cd5f367458e811c859b7dbca333" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 40055 } }
I20260709 13:24:11.283514 18159 raft_consensus.cc:740] T d8c09480b6ed4e05bdb4abfd117fa378 P f62ce053d68f4a868fa48f951d56da1a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f62ce053d68f4a868fa48f951d56da1a, State: Initialized, Role: FOLLOWER
I20260709 13:24:11.283774 18158 raft_consensus.cc:385] T d8c09480b6ed4e05bdb4abfd117fa378 P 5b2c1cd5f367458e811c859b7dbca333 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:24:11.284175 18158 raft_consensus.cc:740] T d8c09480b6ed4e05bdb4abfd117fa378 P 5b2c1cd5f367458e811c859b7dbca333 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5b2c1cd5f367458e811c859b7dbca333, State: Initialized, Role: FOLLOWER
I20260709 13:24:11.285085 18158 consensus_queue.cc:260] T d8c09480b6ed4e05bdb4abfd117fa378 P 5b2c1cd5f367458e811c859b7dbca333 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f62ce053d68f4a868fa48f951d56da1a" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 33029 } } peers { permanent_uuid: "93881c5b9b0648248e627ef7b541aec4" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 44419 } } peers { permanent_uuid: "5b2c1cd5f367458e811c859b7dbca333" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 40055 } }
I20260709 13:24:11.287744 18158 ts_tablet_manager.cc:1434] T d8c09480b6ed4e05bdb4abfd117fa378 P 5b2c1cd5f367458e811c859b7dbca333: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
I20260709 13:24:11.288789 18142 raft_consensus.cc:493] T 910689bc7c56485d8063b2ca5f4d4c17 P f62ce053d68f4a868fa48f951d56da1a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:24:11.289369 18158 tablet_bootstrap.cc:492] T ebc6959597f54d94ac7459f922a62871 P 5b2c1cd5f367458e811c859b7dbca333: Bootstrap starting.
I20260709 13:24:11.289552 18142 raft_consensus.cc:515] T 910689bc7c56485d8063b2ca5f4d4c17 P f62ce053d68f4a868fa48f951d56da1a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f62ce053d68f4a868fa48f951d56da1a" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 33029 } } peers { permanent_uuid: "93881c5b9b0648248e627ef7b541aec4" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 44419 } } peers { permanent_uuid: "5b2c1cd5f367458e811c859b7dbca333" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 40055 } }
I20260709 13:24:11.293769 17939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "910689bc7c56485d8063b2ca5f4d4c17" candidate_uuid: "f62ce053d68f4a868fa48f951d56da1a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "93881c5b9b0648248e627ef7b541aec4" is_pre_election: true
W20260709 13:24:11.296744 17830 leader_election.cc:343] T 910689bc7c56485d8063b2ca5f4d4c17 P f62ce053d68f4a868fa48f951d56da1a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 93881c5b9b0648248e627ef7b541aec4 (127.5.126.66:44419): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:24:11.299718 18014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "910689bc7c56485d8063b2ca5f4d4c17" candidate_uuid: "f62ce053d68f4a868fa48f951d56da1a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5b2c1cd5f367458e811c859b7dbca333" is_pre_election: true
I20260709 13:24:11.300539 18014 raft_consensus.cc:2468] T 910689bc7c56485d8063b2ca5f4d4c17 P 5b2c1cd5f367458e811c859b7dbca333 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f62ce053d68f4a868fa48f951d56da1a in term 0.
I20260709 13:24:11.300990 18158 tablet_bootstrap.cc:654] T ebc6959597f54d94ac7459f922a62871 P 5b2c1cd5f367458e811c859b7dbca333: Neither blocks nor log segments found. Creating new log.
I20260709 13:24:11.302788 17830 leader_election.cc:304] T 910689bc7c56485d8063b2ca5f4d4c17 P f62ce053d68f4a868fa48f951d56da1a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5b2c1cd5f367458e811c859b7dbca333, f62ce053d68f4a868fa48f951d56da1a; no voters: 93881c5b9b0648248e627ef7b541aec4
I20260709 13:24:11.304992 18142 leader_election.cc:290] T 910689bc7c56485d8063b2ca5f4d4c17 P f62ce053d68f4a868fa48f951d56da1a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 93881c5b9b0648248e627ef7b541aec4 (127.5.126.66:44419), 5b2c1cd5f367458e811c859b7dbca333 (127.5.126.67:40055)
I20260709 13:24:11.306123 18159 consensus_queue.cc:260] T d8c09480b6ed4e05bdb4abfd117fa378 P f62ce053d68f4a868fa48f951d56da1a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f62ce053d68f4a868fa48f951d56da1a" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 33029 } } peers { permanent_uuid: "93881c5b9b0648248e627ef7b541aec4" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 44419 } } peers { permanent_uuid: "5b2c1cd5f367458e811c859b7dbca333" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 40055 } }
I20260709 13:24:11.309816 18159 ts_tablet_manager.cc:1434] T d8c09480b6ed4e05bdb4abfd117fa378 P f62ce053d68f4a868fa48f951d56da1a: Time spent starting tablet: real 0.031s	user 0.004s	sys 0.003s
I20260709 13:24:11.311506 18159 tablet_bootstrap.cc:492] T 6fa73bbd59654140adb36ac550bf0140 P f62ce053d68f4a868fa48f951d56da1a: Bootstrap starting.
I20260709 13:24:11.312120 18142 raft_consensus.cc:493] T d8c09480b6ed4e05bdb4abfd117fa378 P f62ce053d68f4a868fa48f951d56da1a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:24:11.312556 18144 raft_consensus.cc:493] T 8d003b1fd939449988c9ae06955c3808 P 5b2c1cd5f367458e811c859b7dbca333 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:24:11.312764 18142 raft_consensus.cc:515] T d8c09480b6ed4e05bdb4abfd117fa378 P f62ce053d68f4a868fa48f951d56da1a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f62ce053d68f4a868fa48f951d56da1a" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 33029 } } peers { permanent_uuid: "93881c5b9b0648248e627ef7b541aec4" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 44419 } } peers { permanent_uuid: "5b2c1cd5f367458e811c859b7dbca333" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 40055 } }
I20260709 13:24:11.313041 18144 raft_consensus.cc:515] T 8d003b1fd939449988c9ae06955c3808 P 5b2c1cd5f367458e811c859b7dbca333 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f62ce053d68f4a868fa48f951d56da1a" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 33029 } } peers { permanent_uuid: "93881c5b9b0648248e627ef7b541aec4" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 44419 } } peers { permanent_uuid: "5b2c1cd5f367458e811c859b7dbca333" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 40055 } }
I20260709 13:24:11.318393 17939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d003b1fd939449988c9ae06955c3808" candidate_uuid: "5b2c1cd5f367458e811c859b7dbca333" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "93881c5b9b0648248e627ef7b541aec4" is_pre_election: true
I20260709 13:24:11.319473 17939 raft_consensus.cc:2468] T 8d003b1fd939449988c9ae06955c3808 P 93881c5b9b0648248e627ef7b541aec4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b2c1cd5f367458e811c859b7dbca333 in term 0.
I20260709 13:24:11.321009 17979 leader_election.cc:304] T 8d003b1fd939449988c9ae06955c3808 P 5b2c1cd5f367458e811c859b7dbca333 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b2c1cd5f367458e811c859b7dbca333, 93881c5b9b0648248e627ef7b541aec4; no voters: 
I20260709 13:24:11.321552 18142 leader_election.cc:290] T d8c09480b6ed4e05bdb4abfd117fa378 P f62ce053d68f4a868fa48f951d56da1a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 93881c5b9b0648248e627ef7b541aec4 (127.5.126.66:44419), 5b2c1cd5f367458e811c859b7dbca333 (127.5.126.67:40055)
I20260709 13:24:11.323213 18144 leader_election.cc:290] T 8d003b1fd939449988c9ae06955c3808 P 5b2c1cd5f367458e811c859b7dbca333 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f62ce053d68f4a868fa48f951d56da1a (127.5.126.65:33029), 93881c5b9b0648248e627ef7b541aec4 (127.5.126.66:44419)
I20260709 13:24:11.323526 18178 raft_consensus.cc:2804] T 8d003b1fd939449988c9ae06955c3808 P 5b2c1cd5f367458e811c859b7dbca333 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:24:11.325573 18178 raft_consensus.cc:493] T 8d003b1fd939449988c9ae06955c3808 P 5b2c1cd5f367458e811c859b7dbca333 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:24:11.326712 18178 raft_consensus.cc:3060] T 8d003b1fd939449988c9ae06955c3808 P 5b2c1cd5f367458e811c859b7dbca333 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:24:11.322288 18142 raft_consensus.cc:2804] T 910689bc7c56485d8063b2ca5f4d4c17 P f62ce053d68f4a868fa48f951d56da1a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:24:11.337356 18142 raft_consensus.cc:493] T 910689bc7c56485d8063b2ca5f4d4c17 P f62ce053d68f4a868fa48f951d56da1a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:24:11.338819 18142 raft_consensus.cc:3060] T 910689bc7c56485d8063b2ca5f4d4c17 P f62ce053d68f4a868fa48f951d56da1a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:24:11.341936 18160 raft_consensus.cc:493] T d8c09480b6ed4e05bdb4abfd117fa378 P 93881c5b9b0648248e627ef7b541aec4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:24:11.342861 18160 raft_consensus.cc:515] T d8c09480b6ed4e05bdb4abfd117fa378 P 93881c5b9b0648248e627ef7b541aec4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f62ce053d68f4a868fa48f951d56da1a" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 33029 } } peers { permanent_uuid: "93881c5b9b0648248e627ef7b541aec4" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 44419 } } peers { permanent_uuid: "5b2c1cd5f367458e811c859b7dbca333" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 40055 } }
I20260709 13:24:11.351213 18014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8c09480b6ed4e05bdb4abfd117fa378" candidate_uuid: "93881c5b9b0648248e627ef7b541aec4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5b2c1cd5f367458e811c859b7dbca333" is_pre_election: true
I20260709 13:24:11.352337 18014 raft_consensus.cc:2468] T d8c09480b6ed4e05bdb4abfd117fa378 P 5b2c1cd5f367458e811c859b7dbca333 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 93881c5b9b0648248e627ef7b541aec4 in term 0.
I20260709 13:24:11.354198 17905 leader_election.cc:304] T d8c09480b6ed4e05bdb4abfd117fa378 P 93881c5b9b0648248e627ef7b541aec4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b2c1cd5f367458e811c859b7dbca333, 93881c5b9b0648248e627ef7b541aec4; no voters: 
I20260709 13:24:11.355424 18160 leader_election.cc:290] T d8c09480b6ed4e05bdb4abfd117fa378 P 93881c5b9b0648248e627ef7b541aec4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f62ce053d68f4a868fa48f951d56da1a (127.5.126.65:33029), 5b2c1cd5f367458e811c859b7dbca333 (127.5.126.67:40055)
I20260709 13:24:11.355624 18164 raft_consensus.cc:2804] T d8c09480b6ed4e05bdb4abfd117fa378 P 93881c5b9b0648248e627ef7b541aec4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:24:11.356655 18164 raft_consensus.cc:493] T d8c09480b6ed4e05bdb4abfd117fa378 P 93881c5b9b0648248e627ef7b541aec4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:24:11.357197 18164 raft_consensus.cc:3060] T d8c09480b6ed4e05bdb4abfd117fa378 P 93881c5b9b0648248e627ef7b541aec4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:24:11.372509 17865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8c09480b6ed4e05bdb4abfd117fa378" candidate_uuid: "93881c5b9b0648248e627ef7b541aec4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f62ce053d68f4a868fa48f951d56da1a" is_pre_election: true
I20260709 13:24:11.373764 17865 raft_consensus.cc:2468] T d8c09480b6ed4e05bdb4abfd117fa378 P f62ce053d68f4a868fa48f951d56da1a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 93881c5b9b0648248e627ef7b541aec4 in term 0.
I20260709 13:24:11.384552 18164 raft_consensus.cc:515] T d8c09480b6ed4e05bdb4abfd117fa378 P 93881c5b9b0648248e627ef7b541aec4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f62ce053d68f4a868fa48f951d56da1a" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 33029 } } peers { permanent_uuid: "93881c5b9b0648248e627ef7b541aec4" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 44419 } } peers { permanent_uuid: "5b2c1cd5f367458e811c859b7dbca333" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 40055 } }
I20260709 13:24:11.390053 17865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8c09480b6ed4e05bdb4abfd117fa378" candidate_uuid: "93881c5b9b0648248e627ef7b541aec4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f62ce053d68f4a868fa48f951d56da1a"
I20260709 13:24:11.391105 17865 raft_consensus.cc:3060] T d8c09480b6ed4e05bdb4abfd117fa378 P f62ce053d68f4a868fa48f951d56da1a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:24:11.395955 18175 raft_consensus.cc:493] T c8b2ba53ff454a39ae7982592bd75e99 P f62ce053d68f4a868fa48f951d56da1a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:24:11.397061 18175 raft_consensus.cc:515] T c8b2ba53ff454a39ae7982592bd75e99 P f62ce053d68f4a868fa48f951d56da1a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f62ce053d68f4a868fa48f951d56da1a" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 33029 } } peers { permanent_uuid: "93881c5b9b0648248e627ef7b541aec4" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 44419 } } peers { permanent_uuid: "5b2c1cd5f367458e811c859b7dbca333" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 40055 } }
I20260709 13:24:11.400485 18175 leader_election.cc:290] T c8b2ba53ff454a39ae7982592bd75e99 P f62ce053d68f4a868fa48f951d56da1a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 93881c5b9b0648248e627ef7b541aec4 (127.5.126.66:44419), 5b2c1cd5f367458e811c859b7dbca333 (127.5.126.67:40055)
I20260709 13:24:11.403827 18157 tablet_bootstrap.cc:492] T c8b2ba53ff454a39ae7982592bd75e99 P 93881c5b9b0648248e627ef7b541aec4: No bootstrap required, opened a new log
I20260709 13:24:11.404516 18157 ts_tablet_manager.cc:1403] T c8b2ba53ff454a39ae7982592bd75e99 P 93881c5b9b0648248e627ef7b541aec4: Time spent bootstrapping tablet: real 0.156s	user 0.075s	sys 0.078s
W20260709 13:24:11.404716 17830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.126.67:40055, user_credentials={real_user=slave}} blocked reactor thread for 102044us
I20260709 13:24:11.405305 18158 tablet_bootstrap.cc:492] T ebc6959597f54d94ac7459f922a62871 P 5b2c1cd5f367458e811c859b7dbca333: No bootstrap required, opened a new log
I20260709 13:24:11.405925 18158 ts_tablet_manager.cc:1403] T ebc6959597f54d94ac7459f922a62871 P 5b2c1cd5f367458e811c859b7dbca333: Time spent bootstrapping tablet: real 0.117s	user 0.036s	sys 0.062s
I20260709 13:24:11.406910 17939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8c09480b6ed4e05bdb4abfd117fa378" candidate_uuid: "f62ce053d68f4a868fa48f951d56da1a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "93881c5b9b0648248e627ef7b541aec4" is_pre_election: true
I20260709 13:24:11.407869 18014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8c09480b6ed4e05bdb4abfd117fa378" candidate_uuid: "f62ce053d68f4a868fa48f951d56da1a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5b2c1cd5f367458e811c859b7dbca333" is_pre_election: true
I20260709 13:24:11.408066 18157 raft_consensus.cc:359] T c8b2ba53ff454a39ae7982592bd75e99 P 93881c5b9b0648248e627ef7b541aec4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f62ce053d68f4a868fa48f951d56da1a" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 33029 } } peers { permanent_uuid: "93881c5b9b0648248e627ef7b541aec4" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 44419 } } peers { permanent_uuid: "5b2c1cd5f367458e811c859b7dbca333" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 40055 } }
I20260709 13:24:11.408859 18014 raft_consensus.cc:2468] T d8c09480b6ed4e05bdb4abfd117fa378 P 5b2c1cd5f367458e811c859b7dbca333 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f62ce053d68f4a868fa48f951d56da1a in term 0.
I20260709 13:24:11.409327 18157 raft_consensus.cc:385] T c8b2ba53ff454a39ae7982592bd75e99 P 93881c5b9b0648248e627ef7b541aec4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:24:11.409719 18157 raft_consensus.cc:740] T c8b2ba53ff454a39ae7982592bd75e99 P 93881c5b9b0648248e627ef7b541aec4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 93881c5b9b0648248e627ef7b541aec4, State: Initialized, Role: FOLLOWER
I20260709 13:24:11.407979 17939 raft_consensus.cc:2393] T d8c09480b6ed4e05bdb4abfd117fa378 P 93881c5b9b0648248e627ef7b541aec4 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f62ce053d68f4a868fa48f951d56da1a in current term 1: Already voted for candidate 93881c5b9b0648248e627ef7b541aec4 in this term.
I20260709 13:24:11.410594 18157 consensus_queue.cc:260] T c8b2ba53ff454a39ae7982592bd75e99 P 93881c5b9b0648248e627ef7b541aec4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f62ce053d68f4a868fa48f951d56da1a" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 33029 } } peers { permanent_uuid: "93881c5b9b0648248e627ef7b541aec4" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 44419 } } peers { permanent_uuid: "5b2c1cd5f367458e811c859b7dbca333" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 40055 } }
I20260709 13:24:11.413401 18157 ts_tablet_manager.cc:1434] T c8b2ba53ff454a39ae7982592bd75e99 P 93881c5b9b0648248e627ef7b541aec4: Time spent starting tablet: real 0.009s	user 0.004s	sys 0.005s
I20260709 13:24:11.414157 18142 raft_consensus.cc:515] T 910689bc7c56485d8063b2ca5f4d4c17 P f62ce053d68f4a868fa48f951d56da1a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f62ce053d68f4a868fa48f951d56da1a" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 33029 } } peers { permanent_uuid: "93881c5b9b0648248e627ef7b541aec4" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 44419 } } peers { permanent_uuid: "5b2c1cd5f367458e811c859b7dbca333" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 40055 } }
I20260709 13:24:11.414788 18157 tablet_bootstrap.cc:492] T 910689bc7c56485d8063b2ca5f4d4c17 P 93881c5b9b0648248e627ef7b541aec4: Bootstrap starting.
I20260709 13:24:11.416142 17939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8b2ba53ff454a39ae7982592bd75e99" candidate_uuid: "f62ce053d68f4a868fa48f951d56da1a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "93881c5b9b0648248e627ef7b541aec4" is_pre_election: true
I20260709 13:24:11.383708 18159 tablet_bootstrap.cc:654] T 6fa73bbd59654140adb36ac550bf0140 P f62ce053d68f4a868fa48f951d56da1a: Neither blocks nor log segments found. Creating new log.
I20260709 13:24:11.417305 17939 raft_consensus.cc:2468] T c8b2ba53ff454a39ae7982592bd75e99 P 93881c5b9b0648248e627ef7b541aec4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f62ce053d68f4a868fa48f951d56da1a in term 0.
I20260709 13:24:11.420207 18014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8b2ba53ff454a39ae7982592bd75e99" candidate_uuid: "f62ce053d68f4a868fa48f951d56da1a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5b2c1cd5f367458e811c859b7dbca333" is_pre_election: true
I20260709 13:24:11.421631 18164 leader_election.cc:290] T d8c09480b6ed4e05bdb4abfd117fa378 P 93881c5b9b0648248e627ef7b541aec4 [CANDIDATE]: Term 1 election: Requested vote from peers f62ce053d68f4a868fa48f951d56da1a (127.5.126.65:33029), 5b2c1cd5f367458e811c859b7dbca333 (127.5.126.67:40055)
I20260709 13:24:11.422281 18178 raft_consensus.cc:515] T 8d003b1fd939449988c9ae06955c3808 P 5b2c1cd5f367458e811c859b7dbca333 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f62ce053d68f4a868fa48f951d56da1a" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 33029 } } peers { permanent_uuid: "93881c5b9b0648248e627ef7b541aec4" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 44419 } } peers { permanent_uuid: "5b2c1cd5f367458e811c859b7dbca333" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 40055 } }
I20260709 13:24:11.423023 18157 tablet_bootstrap.cc:654] T 910689bc7c56485d8063b2ca5f4d4c17 P 93881c5b9b0648248e627ef7b541aec4: Neither blocks nor log segments found. Creating new log.
I20260709 13:24:11.422860 18014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8c09480b6ed4e05bdb4abfd117fa378" candidate_uuid: "93881c5b9b0648248e627ef7b541aec4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5b2c1cd5f367458e811c859b7dbca333"
I20260709 13:24:11.424129 18014 raft_consensus.cc:3060] T d8c09480b6ed4e05bdb4abfd117fa378 P 5b2c1cd5f367458e811c859b7dbca333 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:24:11.428432 17939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d003b1fd939449988c9ae06955c3808" candidate_uuid: "5b2c1cd5f367458e811c859b7dbca333" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "93881c5b9b0648248e627ef7b541aec4"
I20260709 13:24:11.428869 18178 leader_election.cc:290] T 8d003b1fd939449988c9ae06955c3808 P 5b2c1cd5f367458e811c859b7dbca333 [CANDIDATE]: Term 1 election: Requested vote from peers f62ce053d68f4a868fa48f951d56da1a (127.5.126.65:33029), 93881c5b9b0648248e627ef7b541aec4 (127.5.126.66:44419)
I20260709 13:24:11.429337 17939 raft_consensus.cc:3060] T 8d003b1fd939449988c9ae06955c3808 P 93881c5b9b0648248e627ef7b541aec4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:24:11.431015 18158 raft_consensus.cc:359] T ebc6959597f54d94ac7459f922a62871 P 5b2c1cd5f367458e811c859b7dbca333 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f62ce053d68f4a868fa48f951d56da1a" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 33029 } } peers { permanent_uuid: "93881c5b9b0648248e627ef7b541aec4" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 44419 } } peers { permanent_uuid: "5b2c1cd5f367458e811c859b7dbca333" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 40055 } }
I20260709 13:24:11.431936 18158 raft_consensus.cc:385] T ebc6959597f54d94ac7459f922a62871 P 5b2c1cd5f367458e811c859b7dbca333 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:24:11.432305 18158 raft_consensus.cc:740] T ebc6959597f54d94ac7459f922a62871 P 5b2c1cd5f367458e811c859b7dbca333 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5b2c1cd5f367458e811c859b7dbca333, State: Initialized, Role: FOLLOWER
I20260709 13:24:11.433373 18159 tablet_bootstrap.cc:492] T 6fa73bbd59654140adb36ac550bf0140 P f62ce053d68f4a868fa48f951d56da1a: No bootstrap required, opened a new log
I20260709 13:24:11.433249 18158 consensus_queue.cc:260] T ebc6959597f54d94ac7459f922a62871 P 5b2c1cd5f367458e811c859b7dbca333 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f62ce053d68f4a868fa48f951d56da1a" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 33029 } } peers { permanent_uuid: "93881c5b9b0648248e627ef7b541aec4" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 44419 } } peers { permanent_uuid: "5b2c1cd5f367458e811c859b7dbca333" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 40055 } }
I20260709 13:24:11.433990 18159 ts_tablet_manager.cc:1403] T 6fa73bbd59654140adb36ac550bf0140 P f62ce053d68f4a868fa48f951d56da1a: Time spent bootstrapping tablet: real 0.123s	user 0.016s	sys 0.001s
I20260709 13:24:11.430096 18142 leader_election.cc:290] T 910689bc7c56485d8063b2ca5f4d4c17 P f62ce053d68f4a868fa48f951d56da1a [CANDIDATE]: Term 1 election: Requested vote from peers 93881c5b9b0648248e627ef7b541aec4 (127.5.126.66:44419), 5b2c1cd5f367458e811c859b7dbca333 (127.5.126.67:40055)
I20260709 13:24:11.443972 17866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d003b1fd939449988c9ae06955c3808" candidate_uuid: "5b2c1cd5f367458e811c859b7dbca333" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f62ce053d68f4a868fa48f951d56da1a" is_pre_election: true
I20260709 13:24:11.444695 17864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d003b1fd939449988c9ae06955c3808" candidate_uuid: "5b2c1cd5f367458e811c859b7dbca333" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f62ce053d68f4a868fa48f951d56da1a"
I20260709 13:24:11.444841 17866 raft_consensus.cc:2468] T 8d003b1fd939449988c9ae06955c3808 P f62ce053d68f4a868fa48f951d56da1a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b2c1cd5f367458e811c859b7dbca333 in term 0.
I20260709 13:24:11.441973 18158 ts_tablet_manager.cc:1434] T ebc6959597f54d94ac7459f922a62871 P 5b2c1cd5f367458e811c859b7dbca333: Time spent starting tablet: real 0.036s	user 0.008s	sys 0.006s
I20260709 13:24:11.433995 18157 tablet_bootstrap.cc:492] T 910689bc7c56485d8063b2ca5f4d4c17 P 93881c5b9b0648248e627ef7b541aec4: No bootstrap required, opened a new log
I20260709 13:24:11.446777 18157 ts_tablet_manager.cc:1403] T 910689bc7c56485d8063b2ca5f4d4c17 P 93881c5b9b0648248e627ef7b541aec4: Time spent bootstrapping tablet: real 0.032s	user 0.013s	sys 0.003s
I20260709 13:24:11.447150 18158 tablet_bootstrap.cc:492] T 6fa73bbd59654140adb36ac550bf0140 P 5b2c1cd5f367458e811c859b7dbca333: Bootstrap starting.
I20260709 13:24:11.449330 17865 raft_consensus.cc:2468] T d8c09480b6ed4e05bdb4abfd117fa378 P f62ce053d68f4a868fa48f951d56da1a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 93881c5b9b0648248e627ef7b541aec4 in term 1.
I20260709 13:24:11.450133 18013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "910689bc7c56485d8063b2ca5f4d4c17" candidate_uuid: "f62ce053d68f4a868fa48f951d56da1a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5b2c1cd5f367458e811c859b7dbca333"
I20260709 13:24:11.450407 18157 raft_consensus.cc:359] T 910689bc7c56485d8063b2ca5f4d4c17 P 93881c5b9b0648248e627ef7b541aec4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f62ce053d68f4a868fa48f951d56da1a" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 33029 } } peers { permanent_uuid: "93881c5b9b0648248e627ef7b541aec4" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 44419 } } peers { permanent_uuid: "5b2c1cd5f367458e811c859b7dbca333" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 40055 } }
I20260709 13:24:11.450930 18013 raft_consensus.cc:3060] T 910689bc7c56485d8063b2ca5f4d4c17 P 5b2c1cd5f367458e811c859b7dbca333 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:24:11.451200 18157 raft_consensus.cc:385] T 910689bc7c56485d8063b2ca5f4d4c17 P 93881c5b9b0648248e627ef7b541aec4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:24:11.451575 18157 raft_consensus.cc:740] T 910689bc7c56485d8063b2ca5f4d4c17 P 93881c5b9b0648248e627ef7b541aec4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 93881c5b9b0648248e627ef7b541aec4, State: Initialized, Role: FOLLOWER
I20260709 13:24:11.451800 17830 leader_election.cc:304] T c8b2ba53ff454a39ae7982592bd75e99 P f62ce053d68f4a868fa48f951d56da1a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 93881c5b9b0648248e627ef7b541aec4, f62ce053d68f4a868fa48f951d56da1a; no voters: 
I20260709 13:24:11.451872 17941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "910689bc7c56485d8063b2ca5f4d4c17" candidate_uuid: "f62ce053d68f4a868fa48f951d56da1a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "93881c5b9b0648248e627ef7b541aec4"
I20260709 13:24:11.454605 18175 raft_consensus.cc:2804] T c8b2ba53ff454a39ae7982592bd75e99 P f62ce053d68f4a868fa48f951d56da1a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:24:11.455040 18175 raft_consensus.cc:493] T c8b2ba53ff454a39ae7982592bd75e99 P f62ce053d68f4a868fa48f951d56da1a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:24:11.452425 18157 consensus_queue.cc:260] T 910689bc7c56485d8063b2ca5f4d4c17 P 93881c5b9b0648248e627ef7b541aec4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f62ce053d68f4a868fa48f951d56da1a" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 33029 } } peers { permanent_uuid: "93881c5b9b0648248e627ef7b541aec4" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 44419 } } peers { permanent_uuid: "5b2c1cd5f367458e811c859b7dbca333" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 40055 } }
I20260709 13:24:11.455449 18175 raft_consensus.cc:3060] T c8b2ba53ff454a39ae7982592bd75e99 P f62ce053d68f4a868fa48f951d56da1a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:24:11.457791 18158 tablet_bootstrap.cc:654] T 6fa73bbd59654140adb36ac550bf0140 P 5b2c1cd5f367458e811c859b7dbca333: Neither blocks nor log segments found. Creating new log.
I20260709 13:24:11.457967 18157 ts_tablet_manager.cc:1434] T 910689bc7c56485d8063b2ca5f4d4c17 P 93881c5b9b0648248e627ef7b541aec4: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.001s
I20260709 13:24:11.458712 17941 raft_consensus.cc:3060] T 910689bc7c56485d8063b2ca5f4d4c17 P 93881c5b9b0648248e627ef7b541aec4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:24:11.459765 18157 tablet_bootstrap.cc:492] T 6fa73bbd59654140adb36ac550bf0140 P 93881c5b9b0648248e627ef7b541aec4: Bootstrap starting.
I20260709 13:24:11.452961 17904 leader_election.cc:304] T d8c09480b6ed4e05bdb4abfd117fa378 P 93881c5b9b0648248e627ef7b541aec4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 93881c5b9b0648248e627ef7b541aec4, f62ce053d68f4a868fa48f951d56da1a; no voters: 
I20260709 13:24:11.461405 18164 raft_consensus.cc:2804] T d8c09480b6ed4e05bdb4abfd117fa378 P 93881c5b9b0648248e627ef7b541aec4 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:24:11.462020 18164 raft_consensus.cc:697] T d8c09480b6ed4e05bdb4abfd117fa378 P 93881c5b9b0648248e627ef7b541aec4 [term 1 LEADER]: Becoming Leader. State: Replica: 93881c5b9b0648248e627ef7b541aec4, State: Running, Role: LEADER
I20260709 13:24:11.463219 18164 consensus_queue.cc:237] T d8c09480b6ed4e05bdb4abfd117fa378 P 93881c5b9b0648248e627ef7b541aec4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f62ce053d68f4a868fa48f951d56da1a" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 33029 } } peers { permanent_uuid: "93881c5b9b0648248e627ef7b541aec4" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 44419 } } peers { permanent_uuid: "5b2c1cd5f367458e811c859b7dbca333" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 40055 } }
I20260709 13:24:11.465926 18175 raft_consensus.cc:515] T c8b2ba53ff454a39ae7982592bd75e99 P f62ce053d68f4a868fa48f951d56da1a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f62ce053d68f4a868fa48f951d56da1a" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 33029 } } peers { permanent_uuid: "93881c5b9b0648248e627ef7b541aec4" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 44419 } } peers { permanent_uuid: "5b2c1cd5f367458e811c859b7dbca333" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 40055 } }
I20260709 13:24:11.467478 18157 tablet_bootstrap.cc:654] T 6fa73bbd59654140adb36ac550bf0140 P 93881c5b9b0648248e627ef7b541aec4: Neither blocks nor log segments found. Creating new log.
I20260709 13:24:11.469643 18175 leader_election.cc:290] T c8b2ba53ff454a39ae7982592bd75e99 P f62ce053d68f4a868fa48f951d56da1a [CANDIDATE]: Term 1 election: Requested vote from peers 93881c5b9b0648248e627ef7b541aec4 (127.5.126.66:44419), 5b2c1cd5f367458e811c859b7dbca333 (127.5.126.67:40055)
I20260709 13:24:11.452329 18142 raft_consensus.cc:493] T 6112fc9278e94d05946790ffc15dc4f7 P f62ce053d68f4a868fa48f951d56da1a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:24:11.470479 18142 raft_consensus.cc:515] T 6112fc9278e94d05946790ffc15dc4f7 P f62ce053d68f4a868fa48f951d56da1a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f62ce053d68f4a868fa48f951d56da1a" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 33029 } } peers { permanent_uuid: "93881c5b9b0648248e627ef7b541aec4" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 44419 } } peers { permanent_uuid: "5b2c1cd5f367458e811c859b7dbca333" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 40055 } }
I20260709 13:24:11.473284 18142 leader_election.cc:290] T 6112fc9278e94d05946790ffc15dc4f7 P f62ce053d68f4a868fa48f951d56da1a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 93881c5b9b0648248e627ef7b541aec4 (127.5.126.66:44419), 5b2c1cd5f367458e811c859b7dbca333 (127.5.126.67:40055)
I20260709 13:24:11.442754 18014 raft_consensus.cc:2468] T d8c09480b6ed4e05bdb4abfd117fa378 P 5b2c1cd5f367458e811c859b7dbca333 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 93881c5b9b0648248e627ef7b541aec4 in term 1.
I20260709 13:24:11.467203 17830 leader_election.cc:304] T d8c09480b6ed4e05bdb4abfd117fa378 P f62ce053d68f4a868fa48f951d56da1a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5b2c1cd5f367458e811c859b7dbca333, f62ce053d68f4a868fa48f951d56da1a; no voters: 93881c5b9b0648248e627ef7b541aec4
I20260709 13:24:11.477918 18176 raft_consensus.cc:2764] T d8c09480b6ed4e05bdb4abfd117fa378 P f62ce053d68f4a868fa48f951d56da1a [term 1 FOLLOWER]: Leader pre-election decision vote started in defunct term 0: won
W20260709 13:24:11.479650 17830 leader_election.cc:343] T c8b2ba53ff454a39ae7982592bd75e99 P f62ce053d68f4a868fa48f951d56da1a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5b2c1cd5f367458e811c859b7dbca333 (127.5.126.67:40055): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:24:11.482190 18157 tablet_bootstrap.cc:492] T 6fa73bbd59654140adb36ac550bf0140 P 93881c5b9b0648248e627ef7b541aec4: No bootstrap required, opened a new log
I20260709 13:24:11.482859 18157 ts_tablet_manager.cc:1403] T 6fa73bbd59654140adb36ac550bf0140 P 93881c5b9b0648248e627ef7b541aec4: Time spent bootstrapping tablet: real 0.023s	user 0.015s	sys 0.005s
I20260709 13:24:11.482944 17940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8b2ba53ff454a39ae7982592bd75e99" candidate_uuid: "f62ce053d68f4a868fa48f951d56da1a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "93881c5b9b0648248e627ef7b541aec4"
I20260709 13:24:11.483631 17940 raft_consensus.cc:3060] T c8b2ba53ff454a39ae7982592bd75e99 P 93881c5b9b0648248e627ef7b541aec4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:24:11.486363 18157 raft_consensus.cc:359] T 6fa73bbd59654140adb36ac550bf0140 P 93881c5b9b0648248e627ef7b541aec4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f62ce053d68f4a868fa48f951d56da1a" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 33029 } } peers { permanent_uuid: "93881c5b9b0648248e627ef7b541aec4" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 44419 } } peers { permanent_uuid: "5b2c1cd5f367458e811c859b7dbca333" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 40055 } }
I20260709 13:24:11.487164 18157 raft_consensus.cc:385] T 6fa73bbd59654140adb36ac550bf0140 P 93881c5b9b0648248e627ef7b541aec4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:24:11.487514 18157 raft_consensus.cc:740] T 6fa73bbd59654140adb36ac550bf0140 P 93881c5b9b0648248e627ef7b541aec4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 93881c5b9b0648248e627ef7b541aec4, State: Initialized, Role: FOLLOWER
I20260709 13:24:11.488474 18157 consensus_queue.cc:260] T 6fa73bbd59654140adb36ac550bf0140 P 93881c5b9b0648248e627ef7b541aec4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f62ce053d68f4a868fa48f951d56da1a" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 33029 } } peers { permanent_uuid: "93881c5b9b0648248e627ef7b541aec4" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 44419 } } peers { permanent_uuid: "5b2c1cd5f367458e811c859b7dbca333" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 40055 } }
I20260709 13:24:11.490298 18157 ts_tablet_manager.cc:1434] T 6fa73bbd59654140adb36ac550bf0140 P 93881c5b9b0648248e627ef7b541aec4: Time spent starting tablet: real 0.007s	user 0.000s	sys 0.006s
I20260709 13:24:11.491369 18157 tablet_bootstrap.cc:492] T 75dc16ae948c4e24825c10b54040c95f P 93881c5b9b0648248e627ef7b541aec4: Bootstrap starting.
I20260709 13:24:11.492343 18178 raft_consensus.cc:493] T 6112fc9278e94d05946790ffc15dc4f7 P 5b2c1cd5f367458e811c859b7dbca333 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:24:11.492820 18178 raft_consensus.cc:515] T 6112fc9278e94d05946790ffc15dc4f7 P 5b2c1cd5f367458e811c859b7dbca333 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f62ce053d68f4a868fa48f951d56da1a" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 33029 } } peers { permanent_uuid: "93881c5b9b0648248e627ef7b541aec4" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 44419 } } peers { permanent_uuid: "5b2c1cd5f367458e811c859b7dbca333" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 40055 } }
I20260709 13:24:11.493552 18014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8b2ba53ff454a39ae7982592bd75e99" candidate_uuid: "f62ce053d68f4a868fa48f951d56da1a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5b2c1cd5f367458e811c859b7dbca333"
I20260709 13:24:11.494940 18178 leader_election.cc:290] T 6112fc9278e94d05946790ffc15dc4f7 P 5b2c1cd5f367458e811c859b7dbca333 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f62ce053d68f4a868fa48f951d56da1a (127.5.126.65:33029), 93881c5b9b0648248e627ef7b541aec4 (127.5.126.66:44419)
I20260709 13:24:11.497360 17937 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6112fc9278e94d05946790ffc15dc4f7" candidate_uuid: "5b2c1cd5f367458e811c859b7dbca333" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "93881c5b9b0648248e627ef7b541aec4" is_pre_election: true
I20260709 13:24:11.498111 17937 raft_consensus.cc:2468] T 6112fc9278e94d05946790ffc15dc4f7 P 93881c5b9b0648248e627ef7b541aec4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b2c1cd5f367458e811c859b7dbca333 in term 0.
I20260709 13:24:11.499404 17979 leader_election.cc:304] T 6112fc9278e94d05946790ffc15dc4f7 P 5b2c1cd5f367458e811c859b7dbca333 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b2c1cd5f367458e811c859b7dbca333, 93881c5b9b0648248e627ef7b541aec4; no voters: 
I20260709 13:24:11.491763 17940 raft_consensus.cc:2468] T c8b2ba53ff454a39ae7982592bd75e99 P 93881c5b9b0648248e627ef7b541aec4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f62ce053d68f4a868fa48f951d56da1a in term 1.
I20260709 13:24:11.496367 17938 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6112fc9278e94d05946790ffc15dc4f7" candidate_uuid: "f62ce053d68f4a868fa48f951d56da1a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "93881c5b9b0648248e627ef7b541aec4" is_pre_election: true
I20260709 13:24:11.500296 18178 raft_consensus.cc:2804] T 6112fc9278e94d05946790ffc15dc4f7 P 5b2c1cd5f367458e811c859b7dbca333 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:24:11.500661 17938 raft_consensus.cc:2468] T 6112fc9278e94d05946790ffc15dc4f7 P 93881c5b9b0648248e627ef7b541aec4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f62ce053d68f4a868fa48f951d56da1a in term 0.
I20260709 13:24:11.500650 18178 raft_consensus.cc:493] T 6112fc9278e94d05946790ffc15dc4f7 P 5b2c1cd5f367458e811c859b7dbca333 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:24:11.502061 18178 raft_consensus.cc:3060] T 6112fc9278e94d05946790ffc15dc4f7 P 5b2c1cd5f367458e811c859b7dbca333 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:24:11.502636 18014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6112fc9278e94d05946790ffc15dc4f7" candidate_uuid: "f62ce053d68f4a868fa48f951d56da1a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5b2c1cd5f367458e811c859b7dbca333" is_pre_election: true
I20260709 13:24:11.502241 17830 leader_election.cc:304] T 6112fc9278e94d05946790ffc15dc4f7 P f62ce053d68f4a868fa48f951d56da1a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 93881c5b9b0648248e627ef7b541aec4, f62ce053d68f4a868fa48f951d56da1a; no voters: 
I20260709 13:24:11.505065 18175 raft_consensus.cc:2804] T 6112fc9278e94d05946790ffc15dc4f7 P f62ce053d68f4a868fa48f951d56da1a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:24:11.505527 18175 raft_consensus.cc:493] T 6112fc9278e94d05946790ffc15dc4f7 P f62ce053d68f4a868fa48f951d56da1a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:24:11.505897 18175 raft_consensus.cc:3060] T 6112fc9278e94d05946790ffc15dc4f7 P f62ce053d68f4a868fa48f951d56da1a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:24:11.510743 18178 raft_consensus.cc:515] T 6112fc9278e94d05946790ffc15dc4f7 P 5b2c1cd5f367458e811c859b7dbca333 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f62ce053d68f4a868fa48f951d56da1a" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 33029 } } peers { permanent_uuid: "93881c5b9b0648248e627ef7b541aec4" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 44419 } } peers { permanent_uuid: "5b2c1cd5f367458e811c859b7dbca333" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 40055 } }
I20260709 13:24:11.512737 17865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6112fc9278e94d05946790ffc15dc4f7" candidate_uuid: "5b2c1cd5f367458e811c859b7dbca333" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f62ce053d68f4a868fa48f951d56da1a" is_pre_election: true
I20260709 13:24:11.442997 17939 raft_consensus.cc:2468] T 8d003b1fd939449988c9ae06955c3808 P 93881c5b9b0648248e627ef7b541aec4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5b2c1cd5f367458e811c859b7dbca333 in term 1.
I20260709 13:24:11.517809 18178 leader_election.cc:290] T 6112fc9278e94d05946790ffc15dc4f7 P 5b2c1cd5f367458e811c859b7dbca333 [CANDIDATE]: Term 1 election: Requested vote from peers f62ce053d68f4a868fa48f951d56da1a (127.5.126.65:33029), 93881c5b9b0648248e627ef7b541aec4 (127.5.126.66:44419)
I20260709 13:24:11.517911 17979 leader_election.cc:304] T 8d003b1fd939449988c9ae06955c3808 P 5b2c1cd5f367458e811c859b7dbca333 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5b2c1cd5f367458e811c859b7dbca333, 93881c5b9b0648248e627ef7b541aec4; no voters: f62ce053d68f4a868fa48f951d56da1a
I20260709 13:24:11.519554 18157 tablet_bootstrap.cc:654] T 75dc16ae948c4e24825c10b54040c95f P 93881c5b9b0648248e627ef7b541aec4: Neither blocks nor log segments found. Creating new log.
I20260709 13:24:11.519918 18014 raft_consensus.cc:2393] T 6112fc9278e94d05946790ffc15dc4f7 P 5b2c1cd5f367458e811c859b7dbca333 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f62ce053d68f4a868fa48f951d56da1a in current term 1: Already voted for candidate 5b2c1cd5f367458e811c859b7dbca333 in this term.
I20260709 13:24:11.453426 18159 raft_consensus.cc:359] T 6fa73bbd59654140adb36ac550bf0140 P f62ce053d68f4a868fa48f951d56da1a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f62ce053d68f4a868fa48f951d56da1a" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 33029 } } peers { permanent_uuid: "93881c5b9b0648248e627ef7b541aec4" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 44419 } } peers { permanent_uuid: "5b2c1cd5f367458e811c859b7dbca333" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 40055 } }
W20260709 13:24:11.513500 17830 leader_election.cc:343] T c8b2ba53ff454a39ae7982592bd75e99 P f62ce053d68f4a868fa48f951d56da1a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 5b2c1cd5f367458e811c859b7dbca333 (127.5.126.67:40055): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:24:11.522181 17940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6112fc9278e94d05946790ffc15dc4f7" candidate_uuid: "5b2c1cd5f367458e811c859b7dbca333" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "93881c5b9b0648248e627ef7b541aec4"
I20260709 13:24:11.525280 17940 raft_consensus.cc:3060] T 6112fc9278e94d05946790ffc15dc4f7 P 93881c5b9b0648248e627ef7b541aec4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:24:11.519942 18178 raft_consensus.cc:2804] T 8d003b1fd939449988c9ae06955c3808 P 5b2c1cd5f367458e811c859b7dbca333 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:24:11.524243 17830 leader_election.cc:304] T c8b2ba53ff454a39ae7982592bd75e99 P f62ce053d68f4a868fa48f951d56da1a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 93881c5b9b0648248e627ef7b541aec4, f62ce053d68f4a868fa48f951d56da1a; no voters: 5b2c1cd5f367458e811c859b7dbca333
I20260709 13:24:11.528909 18178 raft_consensus.cc:697] T 8d003b1fd939449988c9ae06955c3808 P 5b2c1cd5f367458e811c859b7dbca333 [term 1 LEADER]: Becoming Leader. State: Replica: 5b2c1cd5f367458e811c859b7dbca333, State: Running, Role: LEADER
I20260709 13:24:11.529165 18176 raft_consensus.cc:2804] T c8b2ba53ff454a39ae7982592bd75e99 P f62ce053d68f4a868fa48f951d56da1a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:24:11.529670 18176 raft_consensus.cc:697] T c8b2ba53ff454a39ae7982592bd75e99 P f62ce053d68f4a868fa48f951d56da1a [term 1 LEADER]: Becoming Leader. State: Replica: f62ce053d68f4a868fa48f951d56da1a, State: Running, Role: LEADER
I20260709 13:24:11.529850 18178 consensus_queue.cc:237] T 8d003b1fd939449988c9ae06955c3808 P 5b2c1cd5f367458e811c859b7dbca333 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f62ce053d68f4a868fa48f951d56da1a" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 33029 } } peers { permanent_uuid: "93881c5b9b0648248e627ef7b541aec4" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 44419 } } peers { permanent_uuid: "5b2c1cd5f367458e811c859b7dbca333" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 40055 } }
I20260709 13:24:11.530560 18176 consensus_queue.cc:237] T c8b2ba53ff454a39ae7982592bd75e99 P f62ce053d68f4a868fa48f951d56da1a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f62ce053d68f4a868fa48f951d56da1a" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 33029 } } peers { permanent_uuid: "93881c5b9b0648248e627ef7b541aec4" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 44419 } } peers { permanent_uuid: "5b2c1cd5f367458e811c859b7dbca333" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 40055 } }
I20260709 13:24:11.536247 18013 raft_consensus.cc:2468] T 910689bc7c56485d8063b2ca5f4d4c17 P 5b2c1cd5f367458e811c859b7dbca333 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f62ce053d68f4a868fa48f951d56da1a in term 1.
I20260709 13:24:11.536937 18157 tablet_bootstrap.cc:492] T 75dc16ae948c4e24825c10b54040c95f P 93881c5b9b0648248e627ef7b541aec4: No bootstrap required, opened a new log
I20260709 13:24:11.538486 17864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6112fc9278e94d05946790ffc15dc4f7" candidate_uuid: "5b2c1cd5f367458e811c859b7dbca333" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f62ce053d68f4a868fa48f951d56da1a"
I20260709 13:24:11.541807 17941 raft_consensus.cc:2468] T 910689bc7c56485d8063b2ca5f4d4c17 P 93881c5b9b0648248e627ef7b541aec4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f62ce053d68f4a868fa48f951d56da1a in term 1.
I20260709 13:24:11.545383 18157 ts_tablet_manager.cc:1403] T 75dc16ae948c4e24825c10b54040c95f P 93881c5b9b0648248e627ef7b541aec4: Time spent bootstrapping tablet: real 0.054s	user 0.012s	sys 0.008s
I20260709 13:24:11.545955 18158 tablet_bootstrap.cc:492] T 6fa73bbd59654140adb36ac550bf0140 P 5b2c1cd5f367458e811c859b7dbca333: No bootstrap required, opened a new log
I20260709 13:24:11.546646 18158 ts_tablet_manager.cc:1403] T 6fa73bbd59654140adb36ac550bf0140 P 5b2c1cd5f367458e811c859b7dbca333: Time spent bootstrapping tablet: real 0.100s	user 0.031s	sys 0.055s
I20260709 13:24:11.549817 18157 raft_consensus.cc:359] T 75dc16ae948c4e24825c10b54040c95f P 93881c5b9b0648248e627ef7b541aec4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f62ce053d68f4a868fa48f951d56da1a" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 33029 } } peers { permanent_uuid: "93881c5b9b0648248e627ef7b541aec4" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 44419 } } peers { permanent_uuid: "5b2c1cd5f367458e811c859b7dbca333" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 40055 } }
I20260709 13:24:11.550108 18158 raft_consensus.cc:359] T 6fa73bbd59654140adb36ac550bf0140 P 5b2c1cd5f367458e811c859b7dbca333 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f62ce053d68f4a868fa48f951d56da1a" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 33029 } } peers { permanent_uuid: "93881c5b9b0648248e627ef7b541aec4" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 44419 } } peers { permanent_uuid: "5b2c1cd5f367458e811c859b7dbca333" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 40055 } }
I20260709 13:24:11.551103 18158 raft_consensus.cc:385] T 6fa73bbd59654140adb36ac550bf0140 P 5b2c1cd5f367458e811c859b7dbca333 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:24:11.551505 18158 raft_consensus.cc:740] T 6fa73bbd59654140adb36ac550bf0140 P 5b2c1cd5f367458e811c859b7dbca333 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5b2c1cd5f367458e811c859b7dbca333, State: Initialized, Role: FOLLOWER
I20260709 13:24:11.552490 18158 consensus_queue.cc:260] T 6fa73bbd59654140adb36ac550bf0140 P 5b2c1cd5f367458e811c859b7dbca333 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f62ce053d68f4a868fa48f951d56da1a" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 33029 } } peers { permanent_uuid: "93881c5b9b0648248e627ef7b541aec4" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 44419 } } peers { permanent_uuid: "5b2c1cd5f367458e811c859b7dbca333" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 40055 } }
I20260709 13:24:11.553472 17830 leader_election.cc:304] T 910689bc7c56485d8063b2ca5f4d4c17 P f62ce053d68f4a868fa48f951d56da1a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b2c1cd5f367458e811c859b7dbca333, f62ce053d68f4a868fa48f951d56da1a; no voters: 
I20260709 13:24:11.554491 18142 raft_consensus.cc:2804] T 910689bc7c56485d8063b2ca5f4d4c17 P f62ce053d68f4a868fa48f951d56da1a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:24:11.550657 18157 raft_consensus.cc:385] T 75dc16ae948c4e24825c10b54040c95f P 93881c5b9b0648248e627ef7b541aec4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:24:11.555208 18157 raft_consensus.cc:740] T 75dc16ae948c4e24825c10b54040c95f P 93881c5b9b0648248e627ef7b541aec4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 93881c5b9b0648248e627ef7b541aec4, State: Initialized, Role: FOLLOWER
I20260709 13:24:11.555871 18142 raft_consensus.cc:697] T 910689bc7c56485d8063b2ca5f4d4c17 P f62ce053d68f4a868fa48f951d56da1a [term 1 LEADER]: Becoming Leader. State: Replica: f62ce053d68f4a868fa48f951d56da1a, State: Running, Role: LEADER
I20260709 13:24:11.555406 18158 ts_tablet_manager.cc:1434] T 6fa73bbd59654140adb36ac550bf0140 P 5b2c1cd5f367458e811c859b7dbca333: Time spent starting tablet: real 0.008s	user 0.004s	sys 0.007s
I20260709 13:24:11.556509 18157 consensus_queue.cc:260] T 75dc16ae948c4e24825c10b54040c95f P 93881c5b9b0648248e627ef7b541aec4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f62ce053d68f4a868fa48f951d56da1a" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 33029 } } peers { permanent_uuid: "93881c5b9b0648248e627ef7b541aec4" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 44419 } } peers { permanent_uuid: "5b2c1cd5f367458e811c859b7dbca333" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 40055 } }
I20260709 13:24:11.556860 18142 consensus_queue.cc:237] T 910689bc7c56485d8063b2ca5f4d4c17 P f62ce053d68f4a868fa48f951d56da1a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f62ce053d68f4a868fa48f951d56da1a" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 33029 } } peers { permanent_uuid: "93881c5b9b0648248e627ef7b541aec4" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 44419 } } peers { permanent_uuid: "5b2c1cd5f367458e811c859b7dbca333" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 40055 } }
I20260709 13:24:11.558095 18158 tablet_bootstrap.cc:492] T 8693a343b4d94180b276b5a728f21637 P 5b2c1cd5f367458e811c859b7dbca333: Bootstrap starting.
I20260709 13:24:11.559244 18157 ts_tablet_manager.cc:1434] T 75dc16ae948c4e24825c10b54040c95f P 93881c5b9b0648248e627ef7b541aec4: Time spent starting tablet: real 0.013s	user 0.003s	sys 0.003s
I20260709 13:24:11.561177 18157 tablet_bootstrap.cc:492] T 8693a343b4d94180b276b5a728f21637 P 93881c5b9b0648248e627ef7b541aec4: Bootstrap starting.
I20260709 13:24:11.519588 18175 raft_consensus.cc:515] T 6112fc9278e94d05946790ffc15dc4f7 P f62ce053d68f4a868fa48f951d56da1a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f62ce053d68f4a868fa48f951d56da1a" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 33029 } } peers { permanent_uuid: "93881c5b9b0648248e627ef7b541aec4" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 44419 } } peers { permanent_uuid: "5b2c1cd5f367458e811c859b7dbca333" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 40055 } }
I20260709 13:24:11.577311 17865 raft_consensus.cc:2393] T 6112fc9278e94d05946790ffc15dc4f7 P f62ce053d68f4a868fa48f951d56da1a [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5b2c1cd5f367458e811c859b7dbca333 in current term 1: Already voted for candidate f62ce053d68f4a868fa48f951d56da1a in this term.
I20260709 13:24:11.581049 18157 tablet_bootstrap.cc:654] T 8693a343b4d94180b276b5a728f21637 P 93881c5b9b0648248e627ef7b541aec4: Neither blocks nor log segments found. Creating new log.
I20260709 13:24:11.581619 18013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6112fc9278e94d05946790ffc15dc4f7" candidate_uuid: "f62ce053d68f4a868fa48f951d56da1a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5b2c1cd5f367458e811c859b7dbca333"
I20260709 13:24:11.582653 18013 raft_consensus.cc:2393] T 6112fc9278e94d05946790ffc15dc4f7 P 5b2c1cd5f367458e811c859b7dbca333 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate f62ce053d68f4a868fa48f951d56da1a in current term 1: Already voted for candidate 5b2c1cd5f367458e811c859b7dbca333 in this term.
I20260709 13:24:11.582470 17940 raft_consensus.cc:2468] T 6112fc9278e94d05946790ffc15dc4f7 P 93881c5b9b0648248e627ef7b541aec4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5b2c1cd5f367458e811c859b7dbca333 in term 1.
I20260709 13:24:11.587610 18158 tablet_bootstrap.cc:654] T 8693a343b4d94180b276b5a728f21637 P 5b2c1cd5f367458e811c859b7dbca333: Neither blocks nor log segments found. Creating new log.
I20260709 13:24:11.521669 18159 raft_consensus.cc:385] T 6fa73bbd59654140adb36ac550bf0140 P f62ce053d68f4a868fa48f951d56da1a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:24:11.588708 17979 leader_election.cc:304] T 6112fc9278e94d05946790ffc15dc4f7 P 5b2c1cd5f367458e811c859b7dbca333 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5b2c1cd5f367458e811c859b7dbca333, 93881c5b9b0648248e627ef7b541aec4; no voters: f62ce053d68f4a868fa48f951d56da1a
I20260709 13:24:11.589265 18159 raft_consensus.cc:740] T 6fa73bbd59654140adb36ac550bf0140 P f62ce053d68f4a868fa48f951d56da1a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f62ce053d68f4a868fa48f951d56da1a, State: Initialized, Role: FOLLOWER
I20260709 13:24:11.590476 18144 raft_consensus.cc:2804] T 6112fc9278e94d05946790ffc15dc4f7 P 5b2c1cd5f367458e811c859b7dbca333 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:24:11.591739 17939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6112fc9278e94d05946790ffc15dc4f7" candidate_uuid: "f62ce053d68f4a868fa48f951d56da1a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "93881c5b9b0648248e627ef7b541aec4"
I20260709 13:24:11.594338 18157 tablet_bootstrap.cc:492] T 8693a343b4d94180b276b5a728f21637 P 93881c5b9b0648248e627ef7b541aec4: No bootstrap required, opened a new log
I20260709 13:24:11.594996 18157 ts_tablet_manager.cc:1403] T 8693a343b4d94180b276b5a728f21637 P 93881c5b9b0648248e627ef7b541aec4: Time spent bootstrapping tablet: real 0.034s	user 0.011s	sys 0.006s
I20260709 13:24:11.594926 17939 raft_consensus.cc:2393] T 6112fc9278e94d05946790ffc15dc4f7 P 93881c5b9b0648248e627ef7b541aec4 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate f62ce053d68f4a868fa48f951d56da1a in current term 1: Already voted for candidate 5b2c1cd5f367458e811c859b7dbca333 in this term.
I20260709 13:24:11.590574 18159 consensus_queue.cc:260] T 6fa73bbd59654140adb36ac550bf0140 P f62ce053d68f4a868fa48f951d56da1a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f62ce053d68f4a868fa48f951d56da1a" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 33029 } } peers { permanent_uuid: "93881c5b9b0648248e627ef7b541aec4" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 44419 } } peers { permanent_uuid: "5b2c1cd5f367458e811c859b7dbca333" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 40055 } }
I20260709 13:24:11.579527 18175 leader_election.cc:290] T 6112fc9278e94d05946790ffc15dc4f7 P f62ce053d68f4a868fa48f951d56da1a [CANDIDATE]: Term 1 election: Requested vote from peers 93881c5b9b0648248e627ef7b541aec4 (127.5.126.66:44419), 5b2c1cd5f367458e811c859b7dbca333 (127.5.126.67:40055)
I20260709 13:24:11.598584 18157 raft_consensus.cc:359] T 8693a343b4d94180b276b5a728f21637 P 93881c5b9b0648248e627ef7b541aec4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f62ce053d68f4a868fa48f951d56da1a" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 33029 } } peers { permanent_uuid: "93881c5b9b0648248e627ef7b541aec4" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 44419 } } peers { permanent_uuid: "5b2c1cd5f367458e811c859b7dbca333" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 40055 } }
I20260709 13:24:11.600435 18144 raft_consensus.cc:697] T 6112fc9278e94d05946790ffc15dc4f7 P 5b2c1cd5f367458e811c859b7dbca333 [term 1 LEADER]: Becoming Leader. State: Replica: 5b2c1cd5f367458e811c859b7dbca333, State: Running, Role: LEADER
I20260709 13:24:11.602450 18144 consensus_queue.cc:237] T 6112fc9278e94d05946790ffc15dc4f7 P 5b2c1cd5f367458e811c859b7dbca333 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f62ce053d68f4a868fa48f951d56da1a" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 33029 } } peers { permanent_uuid: "93881c5b9b0648248e627ef7b541aec4" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 44419 } } peers { permanent_uuid: "5b2c1cd5f367458e811c859b7dbca333" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 40055 } }
I20260709 13:24:11.607249 18157 raft_consensus.cc:385] T 8693a343b4d94180b276b5a728f21637 P 93881c5b9b0648248e627ef7b541aec4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:24:11.607746 18157 raft_consensus.cc:740] T 8693a343b4d94180b276b5a728f21637 P 93881c5b9b0648248e627ef7b541aec4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 93881c5b9b0648248e627ef7b541aec4, State: Initialized, Role: FOLLOWER
I20260709 13:24:11.608786 18157 consensus_queue.cc:260] T 8693a343b4d94180b276b5a728f21637 P 93881c5b9b0648248e627ef7b541aec4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f62ce053d68f4a868fa48f951d56da1a" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 33029 } } peers { permanent_uuid: "93881c5b9b0648248e627ef7b541aec4" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 44419 } } peers { permanent_uuid: "5b2c1cd5f367458e811c859b7dbca333" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 40055 } }
I20260709 13:24:11.611554 18157 ts_tablet_manager.cc:1434] T 8693a343b4d94180b276b5a728f21637 P 93881c5b9b0648248e627ef7b541aec4: Time spent starting tablet: real 0.016s	user 0.008s	sys 0.000s
I20260709 13:24:11.610702 17762 catalog_manager.cc:5697] T c8b2ba53ff454a39ae7982592bd75e99 P f62ce053d68f4a868fa48f951d56da1a reported cstate change: term changed from 0 to 1, leader changed from <none> to f62ce053d68f4a868fa48f951d56da1a (127.5.126.65). New cstate: current_term: 1 leader_uuid: "f62ce053d68f4a868fa48f951d56da1a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f62ce053d68f4a868fa48f951d56da1a" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 33029 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "93881c5b9b0648248e627ef7b541aec4" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 44419 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5b2c1cd5f367458e811c859b7dbca333" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 40055 } health_report { overall_health: UNKNOWN } } }
I20260709 13:24:11.613147 18157 tablet_bootstrap.cc:492] T ebc6959597f54d94ac7459f922a62871 P 93881c5b9b0648248e627ef7b541aec4: Bootstrap starting.
I20260709 13:24:11.621547 17761 catalog_manager.cc:5697] T d8c09480b6ed4e05bdb4abfd117fa378 P 93881c5b9b0648248e627ef7b541aec4 reported cstate change: term changed from 0 to 1, leader changed from <none> to 93881c5b9b0648248e627ef7b541aec4 (127.5.126.66). New cstate: current_term: 1 leader_uuid: "93881c5b9b0648248e627ef7b541aec4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f62ce053d68f4a868fa48f951d56da1a" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 33029 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "93881c5b9b0648248e627ef7b541aec4" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 44419 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5b2c1cd5f367458e811c859b7dbca333" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 40055 } health_report { overall_health: UNKNOWN } } }
I20260709 13:24:11.631016 18159 ts_tablet_manager.cc:1434] T 6fa73bbd59654140adb36ac550bf0140 P f62ce053d68f4a868fa48f951d56da1a: Time spent starting tablet: real 0.187s	user 0.009s	sys 0.001s
I20260709 13:24:11.631757 18164 raft_consensus.cc:493] T 6fa73bbd59654140adb36ac550bf0140 P 93881c5b9b0648248e627ef7b541aec4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:24:11.632534 18159 tablet_bootstrap.cc:492] T 8693a343b4d94180b276b5a728f21637 P f62ce053d68f4a868fa48f951d56da1a: Bootstrap starting.
I20260709 13:24:11.632308 17830 leader_election.cc:304] T 6112fc9278e94d05946790ffc15dc4f7 P f62ce053d68f4a868fa48f951d56da1a [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f62ce053d68f4a868fa48f951d56da1a; no voters: 5b2c1cd5f367458e811c859b7dbca333, 93881c5b9b0648248e627ef7b541aec4
I20260709 13:24:11.632658 18164 raft_consensus.cc:515] T 6fa73bbd59654140adb36ac550bf0140 P 93881c5b9b0648248e627ef7b541aec4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f62ce053d68f4a868fa48f951d56da1a" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 33029 } } peers { permanent_uuid: "93881c5b9b0648248e627ef7b541aec4" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 44419 } } peers { permanent_uuid: "5b2c1cd5f367458e811c859b7dbca333" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 40055 } }
I20260709 13:24:11.635262 18157 tablet_bootstrap.cc:654] T ebc6959597f54d94ac7459f922a62871 P 93881c5b9b0648248e627ef7b541aec4: Neither blocks nor log segments found. Creating new log.
I20260709 13:24:11.636112 18176 raft_consensus.cc:2749] T 6112fc9278e94d05946790ffc15dc4f7 P f62ce053d68f4a868fa48f951d56da1a [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:24:11.637261 17865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fa73bbd59654140adb36ac550bf0140" candidate_uuid: "93881c5b9b0648248e627ef7b541aec4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f62ce053d68f4a868fa48f951d56da1a" is_pre_election: true
I20260709 13:24:11.638549 17865 raft_consensus.cc:2468] T 6fa73bbd59654140adb36ac550bf0140 P f62ce053d68f4a868fa48f951d56da1a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 93881c5b9b0648248e627ef7b541aec4 in term 0.
I20260709 13:24:11.640534 17904 leader_election.cc:304] T 6fa73bbd59654140adb36ac550bf0140 P 93881c5b9b0648248e627ef7b541aec4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 93881c5b9b0648248e627ef7b541aec4, f62ce053d68f4a868fa48f951d56da1a; no voters: 
I20260709 13:24:11.641891 18137 raft_consensus.cc:2804] T 6fa73bbd59654140adb36ac550bf0140 P 93881c5b9b0648248e627ef7b541aec4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:24:11.642345 18137 raft_consensus.cc:493] T 6fa73bbd59654140adb36ac550bf0140 P 93881c5b9b0648248e627ef7b541aec4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:24:11.642747 18137 raft_consensus.cc:3060] T 6fa73bbd59654140adb36ac550bf0140 P 93881c5b9b0648248e627ef7b541aec4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:24:11.644555 17764 catalog_manager.cc:5697] T 8d003b1fd939449988c9ae06955c3808 P 5b2c1cd5f367458e811c859b7dbca333 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5b2c1cd5f367458e811c859b7dbca333 (127.5.126.67). New cstate: current_term: 1 leader_uuid: "5b2c1cd5f367458e811c859b7dbca333" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f62ce053d68f4a868fa48f951d56da1a" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 33029 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "93881c5b9b0648248e627ef7b541aec4" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 44419 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5b2c1cd5f367458e811c859b7dbca333" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 40055 } health_report { overall_health: HEALTHY } } }
I20260709 13:24:11.645658 18159 tablet_bootstrap.cc:654] T 8693a343b4d94180b276b5a728f21637 P f62ce053d68f4a868fa48f951d56da1a: Neither blocks nor log segments found. Creating new log.
I20260709 13:24:11.648280 18013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fa73bbd59654140adb36ac550bf0140" candidate_uuid: "93881c5b9b0648248e627ef7b541aec4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5b2c1cd5f367458e811c859b7dbca333" is_pre_election: true
I20260709 13:24:11.649245 18013 raft_consensus.cc:2468] T 6fa73bbd59654140adb36ac550bf0140 P 5b2c1cd5f367458e811c859b7dbca333 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 93881c5b9b0648248e627ef7b541aec4 in term 0.
I20260709 13:24:11.652181 18164 leader_election.cc:290] T 6fa73bbd59654140adb36ac550bf0140 P 93881c5b9b0648248e627ef7b541aec4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f62ce053d68f4a868fa48f951d56da1a (127.5.126.65:33029), 5b2c1cd5f367458e811c859b7dbca333 (127.5.126.67:40055)
I20260709 13:24:11.656908 18158 tablet_bootstrap.cc:492] T 8693a343b4d94180b276b5a728f21637 P 5b2c1cd5f367458e811c859b7dbca333: No bootstrap required, opened a new log
I20260709 13:24:11.657917 18158 ts_tablet_manager.cc:1403] T 8693a343b4d94180b276b5a728f21637 P 5b2c1cd5f367458e811c859b7dbca333: Time spent bootstrapping tablet: real 0.101s	user 0.021s	sys 0.028s
I20260709 13:24:11.658670 18157 tablet_bootstrap.cc:492] T ebc6959597f54d94ac7459f922a62871 P 93881c5b9b0648248e627ef7b541aec4: No bootstrap required, opened a new log
I20260709 13:24:11.659423 18157 ts_tablet_manager.cc:1403] T ebc6959597f54d94ac7459f922a62871 P 93881c5b9b0648248e627ef7b541aec4: Time spent bootstrapping tablet: real 0.047s	user 0.009s	sys 0.005s
I20260709 13:24:11.661366 18158 raft_consensus.cc:359] T 8693a343b4d94180b276b5a728f21637 P 5b2c1cd5f367458e811c859b7dbca333 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f62ce053d68f4a868fa48f951d56da1a" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 33029 } } peers { permanent_uuid: "93881c5b9b0648248e627ef7b541aec4" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 44419 } } peers { permanent_uuid: "5b2c1cd5f367458e811c859b7dbca333" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 40055 } }
I20260709 13:24:11.662236 18158 raft_consensus.cc:385] T 8693a343b4d94180b276b5a728f21637 P 5b2c1cd5f367458e811c859b7dbca333 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:24:11.662508 18158 raft_consensus.cc:740] T 8693a343b4d94180b276b5a728f21637 P 5b2c1cd5f367458e811c859b7dbca333 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5b2c1cd5f367458e811c859b7dbca333, State: Initialized, Role: FOLLOWER
I20260709 13:24:11.663389 18158 consensus_queue.cc:260] T 8693a343b4d94180b276b5a728f21637 P 5b2c1cd5f367458e811c859b7dbca333 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f62ce053d68f4a868fa48f951d56da1a" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 33029 } } peers { permanent_uuid: "93881c5b9b0648248e627ef7b541aec4" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 44419 } } peers { permanent_uuid: "5b2c1cd5f367458e811c859b7dbca333" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 40055 } }
I20260709 13:24:11.665872 18158 ts_tablet_manager.cc:1434] T 8693a343b4d94180b276b5a728f21637 P 5b2c1cd5f367458e811c859b7dbca333: Time spent starting tablet: real 0.008s	user 0.002s	sys 0.004s
I20260709 13:24:11.664739 18157 raft_consensus.cc:359] T ebc6959597f54d94ac7459f922a62871 P 93881c5b9b0648248e627ef7b541aec4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f62ce053d68f4a868fa48f951d56da1a" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 33029 } } peers { permanent_uuid: "93881c5b9b0648248e627ef7b541aec4" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 44419 } } peers { permanent_uuid: "5b2c1cd5f367458e811c859b7dbca333" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 40055 } }
I20260709 13:24:11.667301 18157 raft_consensus.cc:385] T ebc6959597f54d94ac7459f922a62871 P 93881c5b9b0648248e627ef7b541aec4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:24:11.667659 18157 raft_consensus.cc:740] T ebc6959597f54d94ac7459f922a62871 P 93881c5b9b0648248e627ef7b541aec4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 93881c5b9b0648248e627ef7b541aec4, State: Initialized, Role: FOLLOWER
I20260709 13:24:11.667511 18137 raft_consensus.cc:515] T 6fa73bbd59654140adb36ac550bf0140 P 93881c5b9b0648248e627ef7b541aec4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f62ce053d68f4a868fa48f951d56da1a" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 33029 } } peers { permanent_uuid: "93881c5b9b0648248e627ef7b541aec4" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 44419 } } peers { permanent_uuid: "5b2c1cd5f367458e811c859b7dbca333" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 40055 } }
I20260709 13:24:11.667025 18158 tablet_bootstrap.cc:492] T c8b2ba53ff454a39ae7982592bd75e99 P 5b2c1cd5f367458e811c859b7dbca333: Bootstrap starting.
I20260709 13:24:11.669026 18157 consensus_queue.cc:260] T ebc6959597f54d94ac7459f922a62871 P 93881c5b9b0648248e627ef7b541aec4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f62ce053d68f4a868fa48f951d56da1a" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 33029 } } peers { permanent_uuid: "93881c5b9b0648248e627ef7b541aec4" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 44419 } } peers { permanent_uuid: "5b2c1cd5f367458e811c859b7dbca333" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 40055 } }
I20260709 13:24:11.666867 18159 tablet_bootstrap.cc:492] T 8693a343b4d94180b276b5a728f21637 P f62ce053d68f4a868fa48f951d56da1a: No bootstrap required, opened a new log
I20260709 13:24:11.670606 18159 ts_tablet_manager.cc:1403] T 8693a343b4d94180b276b5a728f21637 P f62ce053d68f4a868fa48f951d56da1a: Time spent bootstrapping tablet: real 0.038s	user 0.013s	sys 0.005s
I20260709 13:24:11.671581 18157 ts_tablet_manager.cc:1434] T ebc6959597f54d94ac7459f922a62871 P 93881c5b9b0648248e627ef7b541aec4: Time spent starting tablet: real 0.012s	user 0.004s	sys 0.003s
I20260709 13:24:11.672969 17865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fa73bbd59654140adb36ac550bf0140" candidate_uuid: "93881c5b9b0648248e627ef7b541aec4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f62ce053d68f4a868fa48f951d56da1a"
I20260709 13:24:11.673957 17865 raft_consensus.cc:3060] T 6fa73bbd59654140adb36ac550bf0140 P f62ce053d68f4a868fa48f951d56da1a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:24:11.673734 18159 raft_consensus.cc:359] T 8693a343b4d94180b276b5a728f21637 P f62ce053d68f4a868fa48f951d56da1a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f62ce053d68f4a868fa48f951d56da1a" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 33029 } } peers { permanent_uuid: "93881c5b9b0648248e627ef7b541aec4" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 44419 } } peers { permanent_uuid: "5b2c1cd5f367458e811c859b7dbca333" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 40055 } }
I20260709 13:24:11.677608 18159 raft_consensus.cc:385] T 8693a343b4d94180b276b5a728f21637 P f62ce053d68f4a868fa48f951d56da1a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:24:11.677949 18159 raft_consensus.cc:740] T 8693a343b4d94180b276b5a728f21637 P f62ce053d68f4a868fa48f951d56da1a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f62ce053d68f4a868fa48f951d56da1a, State: Initialized, Role: FOLLOWER
I20260709 13:24:11.678730 18159 consensus_queue.cc:260] T 8693a343b4d94180b276b5a728f21637 P f62ce053d68f4a868fa48f951d56da1a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f62ce053d68f4a868fa48f951d56da1a" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 33029 } } peers { permanent_uuid: "93881c5b9b0648248e627ef7b541aec4" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 44419 } } peers { permanent_uuid: "5b2c1cd5f367458e811c859b7dbca333" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 40055 } }
I20260709 13:24:11.679949 18158 tablet_bootstrap.cc:654] T c8b2ba53ff454a39ae7982592bd75e99 P 5b2c1cd5f367458e811c859b7dbca333: Neither blocks nor log segments found. Creating new log.
I20260709 13:24:11.681563 18159 ts_tablet_manager.cc:1434] T 8693a343b4d94180b276b5a728f21637 P f62ce053d68f4a868fa48f951d56da1a: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.000s
I20260709 13:24:11.682690 18159 tablet_bootstrap.cc:492] T ebc6959597f54d94ac7459f922a62871 P f62ce053d68f4a868fa48f951d56da1a: Bootstrap starting.
I20260709 13:24:11.685585 17865 raft_consensus.cc:2468] T 6fa73bbd59654140adb36ac550bf0140 P f62ce053d68f4a868fa48f951d56da1a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 93881c5b9b0648248e627ef7b541aec4 in term 1.
I20260709 13:24:11.687635 17904 leader_election.cc:304] T 6fa73bbd59654140adb36ac550bf0140 P 93881c5b9b0648248e627ef7b541aec4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 93881c5b9b0648248e627ef7b541aec4, f62ce053d68f4a868fa48f951d56da1a; no voters: 
I20260709 13:24:11.689307 18164 raft_consensus.cc:2804] T 6fa73bbd59654140adb36ac550bf0140 P 93881c5b9b0648248e627ef7b541aec4 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:24:11.691651 18159 tablet_bootstrap.cc:654] T ebc6959597f54d94ac7459f922a62871 P f62ce053d68f4a868fa48f951d56da1a: Neither blocks nor log segments found. Creating new log.
I20260709 13:24:11.701017 18158 tablet_bootstrap.cc:492] T c8b2ba53ff454a39ae7982592bd75e99 P 5b2c1cd5f367458e811c859b7dbca333: No bootstrap required, opened a new log
I20260709 13:24:11.701570 18158 ts_tablet_manager.cc:1403] T c8b2ba53ff454a39ae7982592bd75e99 P 5b2c1cd5f367458e811c859b7dbca333: Time spent bootstrapping tablet: real 0.035s	user 0.011s	sys 0.009s
I20260709 13:24:11.705433 18158 raft_consensus.cc:359] T c8b2ba53ff454a39ae7982592bd75e99 P 5b2c1cd5f367458e811c859b7dbca333 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f62ce053d68f4a868fa48f951d56da1a" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 33029 } } peers { permanent_uuid: "93881c5b9b0648248e627ef7b541aec4" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 44419 } } peers { permanent_uuid: "5b2c1cd5f367458e811c859b7dbca333" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 40055 } }
I20260709 13:24:11.706521 18158 raft_consensus.cc:385] T c8b2ba53ff454a39ae7982592bd75e99 P 5b2c1cd5f367458e811c859b7dbca333 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:24:11.706928 18158 raft_consensus.cc:740] T c8b2ba53ff454a39ae7982592bd75e99 P 5b2c1cd5f367458e811c859b7dbca333 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5b2c1cd5f367458e811c859b7dbca333, State: Initialized, Role: FOLLOWER
I20260709 13:24:11.707787 18158 consensus_queue.cc:260] T c8b2ba53ff454a39ae7982592bd75e99 P 5b2c1cd5f367458e811c859b7dbca333 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f62ce053d68f4a868fa48f951d56da1a" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 33029 } } peers { permanent_uuid: "93881c5b9b0648248e627ef7b541aec4" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 44419 } } peers { permanent_uuid: "5b2c1cd5f367458e811c859b7dbca333" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 40055 } }
I20260709 13:24:11.710680 18158 ts_tablet_manager.cc:1434] T c8b2ba53ff454a39ae7982592bd75e99 P 5b2c1cd5f367458e811c859b7dbca333: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
I20260709 13:24:11.711211 18137 leader_election.cc:290] T 6fa73bbd59654140adb36ac550bf0140 P 93881c5b9b0648248e627ef7b541aec4 [CANDIDATE]: Term 1 election: Requested vote from peers f62ce053d68f4a868fa48f951d56da1a (127.5.126.65:33029), 5b2c1cd5f367458e811c859b7dbca333 (127.5.126.67:40055)
I20260709 13:24:11.711704 18158 tablet_bootstrap.cc:492] T 75dc16ae948c4e24825c10b54040c95f P 5b2c1cd5f367458e811c859b7dbca333: Bootstrap starting.
I20260709 13:24:11.713436 18013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fa73bbd59654140adb36ac550bf0140" candidate_uuid: "93881c5b9b0648248e627ef7b541aec4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5b2c1cd5f367458e811c859b7dbca333"
I20260709 13:24:11.714247 18013 raft_consensus.cc:3060] T 6fa73bbd59654140adb36ac550bf0140 P 5b2c1cd5f367458e811c859b7dbca333 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:24:11.719867 18158 tablet_bootstrap.cc:654] T 75dc16ae948c4e24825c10b54040c95f P 5b2c1cd5f367458e811c859b7dbca333: Neither blocks nor log segments found. Creating new log.
I20260709 13:24:11.721804 17762 catalog_manager.cc:5697] T 910689bc7c56485d8063b2ca5f4d4c17 P f62ce053d68f4a868fa48f951d56da1a reported cstate change: term changed from 0 to 1, leader changed from <none> to f62ce053d68f4a868fa48f951d56da1a (127.5.126.65). New cstate: current_term: 1 leader_uuid: "f62ce053d68f4a868fa48f951d56da1a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f62ce053d68f4a868fa48f951d56da1a" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 33029 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "93881c5b9b0648248e627ef7b541aec4" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 44419 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5b2c1cd5f367458e811c859b7dbca333" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 40055 } health_report { overall_health: UNKNOWN } } }
I20260709 13:24:11.722812 18164 raft_consensus.cc:697] T 6fa73bbd59654140adb36ac550bf0140 P 93881c5b9b0648248e627ef7b541aec4 [term 1 LEADER]: Becoming Leader. State: Replica: 93881c5b9b0648248e627ef7b541aec4, State: Running, Role: LEADER
I20260709 13:24:11.724380 18164 consensus_queue.cc:237] T 6fa73bbd59654140adb36ac550bf0140 P 93881c5b9b0648248e627ef7b541aec4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f62ce053d68f4a868fa48f951d56da1a" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 33029 } } peers { permanent_uuid: "93881c5b9b0648248e627ef7b541aec4" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 44419 } } peers { permanent_uuid: "5b2c1cd5f367458e811c859b7dbca333" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 40055 } }
I20260709 13:24:11.732688 18144 raft_consensus.cc:493] T 8693a343b4d94180b276b5a728f21637 P 5b2c1cd5f367458e811c859b7dbca333 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:24:11.733254 18144 raft_consensus.cc:515] T 8693a343b4d94180b276b5a728f21637 P 5b2c1cd5f367458e811c859b7dbca333 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f62ce053d68f4a868fa48f951d56da1a" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 33029 } } peers { permanent_uuid: "93881c5b9b0648248e627ef7b541aec4" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 44419 } } peers { permanent_uuid: "5b2c1cd5f367458e811c859b7dbca333" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 40055 } }
I20260709 13:24:11.735594 18144 leader_election.cc:290] T 8693a343b4d94180b276b5a728f21637 P 5b2c1cd5f367458e811c859b7dbca333 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f62ce053d68f4a868fa48f951d56da1a (127.5.126.65:33029), 93881c5b9b0648248e627ef7b541aec4 (127.5.126.66:44419)
I20260709 13:24:11.738543 18158 tablet_bootstrap.cc:492] T 75dc16ae948c4e24825c10b54040c95f P 5b2c1cd5f367458e811c859b7dbca333: No bootstrap required, opened a new log
I20260709 13:24:11.739441 18158 ts_tablet_manager.cc:1403] T 75dc16ae948c4e24825c10b54040c95f P 5b2c1cd5f367458e811c859b7dbca333: Time spent bootstrapping tablet: real 0.028s	user 0.013s	sys 0.008s
I20260709 13:24:11.737653 17940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8693a343b4d94180b276b5a728f21637" candidate_uuid: "5b2c1cd5f367458e811c859b7dbca333" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "93881c5b9b0648248e627ef7b541aec4" is_pre_election: true
I20260709 13:24:11.738065 18144 raft_consensus.cc:493] T ebc6959597f54d94ac7459f922a62871 P 5b2c1cd5f367458e811c859b7dbca333 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:24:11.742020 17940 raft_consensus.cc:2468] T 8693a343b4d94180b276b5a728f21637 P 93881c5b9b0648248e627ef7b541aec4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b2c1cd5f367458e811c859b7dbca333 in term 0.
I20260709 13:24:11.740408 18159 tablet_bootstrap.cc:492] T ebc6959597f54d94ac7459f922a62871 P f62ce053d68f4a868fa48f951d56da1a: No bootstrap required, opened a new log
I20260709 13:24:11.743044 18159 ts_tablet_manager.cc:1403] T ebc6959597f54d94ac7459f922a62871 P f62ce053d68f4a868fa48f951d56da1a: Time spent bootstrapping tablet: real 0.061s	user 0.020s	sys 0.004s
I20260709 13:24:11.742470 18144 raft_consensus.cc:515] T ebc6959597f54d94ac7459f922a62871 P 5b2c1cd5f367458e811c859b7dbca333 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f62ce053d68f4a868fa48f951d56da1a" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 33029 } } peers { permanent_uuid: "93881c5b9b0648248e627ef7b541aec4" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 44419 } } peers { permanent_uuid: "5b2c1cd5f367458e811c859b7dbca333" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 40055 } }
I20260709 13:24:11.744081 17979 leader_election.cc:304] T 8693a343b4d94180b276b5a728f21637 P 5b2c1cd5f367458e811c859b7dbca333 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b2c1cd5f367458e811c859b7dbca333, 93881c5b9b0648248e627ef7b541aec4; no voters: 
I20260709 13:24:11.745507 18178 raft_consensus.cc:2804] T 8693a343b4d94180b276b5a728f21637 P 5b2c1cd5f367458e811c859b7dbca333 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:24:11.745992 18178 raft_consensus.cc:493] T 8693a343b4d94180b276b5a728f21637 P 5b2c1cd5f367458e811c859b7dbca333 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:24:11.731709 18013 raft_consensus.cc:2468] T 6fa73bbd59654140adb36ac550bf0140 P 5b2c1cd5f367458e811c859b7dbca333 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 93881c5b9b0648248e627ef7b541aec4 in term 1.
I20260709 13:24:11.746428 18144 leader_election.cc:290] T ebc6959597f54d94ac7459f922a62871 P 5b2c1cd5f367458e811c859b7dbca333 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f62ce053d68f4a868fa48f951d56da1a (127.5.126.65:33029), 93881c5b9b0648248e627ef7b541aec4 (127.5.126.66:44419)
I20260709 13:24:11.746469 18178 raft_consensus.cc:3060] T 8693a343b4d94180b276b5a728f21637 P 5b2c1cd5f367458e811c859b7dbca333 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:24:11.750836 18158 raft_consensus.cc:359] T 75dc16ae948c4e24825c10b54040c95f P 5b2c1cd5f367458e811c859b7dbca333 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f62ce053d68f4a868fa48f951d56da1a" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 33029 } } peers { permanent_uuid: "93881c5b9b0648248e627ef7b541aec4" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 44419 } } peers { permanent_uuid: "5b2c1cd5f367458e811c859b7dbca333" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 40055 } }
I20260709 13:24:11.751974 18158 raft_consensus.cc:385] T 75dc16ae948c4e24825c10b54040c95f P 5b2c1cd5f367458e811c859b7dbca333 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:24:11.752354 18158 raft_consensus.cc:740] T 75dc16ae948c4e24825c10b54040c95f P 5b2c1cd5f367458e811c859b7dbca333 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5b2c1cd5f367458e811c859b7dbca333, State: Initialized, Role: FOLLOWER
I20260709 13:24:11.753324 18158 consensus_queue.cc:260] T 75dc16ae948c4e24825c10b54040c95f P 5b2c1cd5f367458e811c859b7dbca333 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f62ce053d68f4a868fa48f951d56da1a" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 33029 } } peers { permanent_uuid: "93881c5b9b0648248e627ef7b541aec4" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 44419 } } peers { permanent_uuid: "5b2c1cd5f367458e811c859b7dbca333" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 40055 } }
I20260709 13:24:11.753791 17940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebc6959597f54d94ac7459f922a62871" candidate_uuid: "5b2c1cd5f367458e811c859b7dbca333" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "93881c5b9b0648248e627ef7b541aec4" is_pre_election: true
I20260709 13:24:11.754655 17940 raft_consensus.cc:2468] T ebc6959597f54d94ac7459f922a62871 P 93881c5b9b0648248e627ef7b541aec4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b2c1cd5f367458e811c859b7dbca333 in term 0.
I20260709 13:24:11.756011 17979 leader_election.cc:304] T ebc6959597f54d94ac7459f922a62871 P 5b2c1cd5f367458e811c859b7dbca333 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b2c1cd5f367458e811c859b7dbca333, 93881c5b9b0648248e627ef7b541aec4; no voters: 
I20260709 13:24:11.756307 18158 ts_tablet_manager.cc:1434] T 75dc16ae948c4e24825c10b54040c95f P 5b2c1cd5f367458e811c859b7dbca333: Time spent starting tablet: real 0.016s	user 0.010s	sys 0.000s
I20260709 13:24:11.737769 17865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8693a343b4d94180b276b5a728f21637" candidate_uuid: "5b2c1cd5f367458e811c859b7dbca333" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f62ce053d68f4a868fa48f951d56da1a" is_pre_election: true
I20260709 13:24:11.758059 17865 raft_consensus.cc:2468] T 8693a343b4d94180b276b5a728f21637 P f62ce053d68f4a868fa48f951d56da1a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b2c1cd5f367458e811c859b7dbca333 in term 0.
I20260709 13:24:11.758145 17864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebc6959597f54d94ac7459f922a62871" candidate_uuid: "5b2c1cd5f367458e811c859b7dbca333" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f62ce053d68f4a868fa48f951d56da1a" is_pre_election: true
I20260709 13:24:11.759238 18144 raft_consensus.cc:2804] T ebc6959597f54d94ac7459f922a62871 P 5b2c1cd5f367458e811c859b7dbca333 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:24:11.759680 18144 raft_consensus.cc:493] T ebc6959597f54d94ac7459f922a62871 P 5b2c1cd5f367458e811c859b7dbca333 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:24:11.759670 18159 raft_consensus.cc:359] T ebc6959597f54d94ac7459f922a62871 P f62ce053d68f4a868fa48f951d56da1a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f62ce053d68f4a868fa48f951d56da1a" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 33029 } } peers { permanent_uuid: "93881c5b9b0648248e627ef7b541aec4" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 44419 } } peers { permanent_uuid: "5b2c1cd5f367458e811c859b7dbca333" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 40055 } }
I20260709 13:24:11.760476 18144 raft_consensus.cc:3060] T ebc6959597f54d94ac7459f922a62871 P 5b2c1cd5f367458e811c859b7dbca333 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:24:11.760545 17978 leader_election.cc:343] T ebc6959597f54d94ac7459f922a62871 P 5b2c1cd5f367458e811c859b7dbca333 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f62ce053d68f4a868fa48f951d56da1a (127.5.126.65:33029): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:24:11.764678 18178 raft_consensus.cc:515] T 8693a343b4d94180b276b5a728f21637 P 5b2c1cd5f367458e811c859b7dbca333 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f62ce053d68f4a868fa48f951d56da1a" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 33029 } } peers { permanent_uuid: "93881c5b9b0648248e627ef7b541aec4" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 44419 } } peers { permanent_uuid: "5b2c1cd5f367458e811c859b7dbca333" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 40055 } }
I20260709 13:24:11.767030 18178 leader_election.cc:290] T 8693a343b4d94180b276b5a728f21637 P 5b2c1cd5f367458e811c859b7dbca333 [CANDIDATE]: Term 1 election: Requested vote from peers f62ce053d68f4a868fa48f951d56da1a (127.5.126.65:33029), 93881c5b9b0648248e627ef7b541aec4 (127.5.126.66:44419)
I20260709 13:24:11.760667 18159 raft_consensus.cc:385] T ebc6959597f54d94ac7459f922a62871 P f62ce053d68f4a868fa48f951d56da1a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:24:11.767719 18159 raft_consensus.cc:740] T ebc6959597f54d94ac7459f922a62871 P f62ce053d68f4a868fa48f951d56da1a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f62ce053d68f4a868fa48f951d56da1a, State: Initialized, Role: FOLLOWER
I20260709 13:24:11.768435 17940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8693a343b4d94180b276b5a728f21637" candidate_uuid: "5b2c1cd5f367458e811c859b7dbca333" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "93881c5b9b0648248e627ef7b541aec4"
I20260709 13:24:11.768551 18159 consensus_queue.cc:260] T ebc6959597f54d94ac7459f922a62871 P f62ce053d68f4a868fa48f951d56da1a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f62ce053d68f4a868fa48f951d56da1a" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 33029 } } peers { permanent_uuid: "93881c5b9b0648248e627ef7b541aec4" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 44419 } } peers { permanent_uuid: "5b2c1cd5f367458e811c859b7dbca333" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 40055 } }
I20260709 13:24:11.769814 17940 raft_consensus.cc:3060] T 8693a343b4d94180b276b5a728f21637 P 93881c5b9b0648248e627ef7b541aec4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:24:11.770991 18159 ts_tablet_manager.cc:1434] T ebc6959597f54d94ac7459f922a62871 P f62ce053d68f4a868fa48f951d56da1a: Time spent starting tablet: real 0.028s	user 0.006s	sys 0.000s
I20260709 13:24:11.772122 18159 tablet_bootstrap.cc:492] T 75dc16ae948c4e24825c10b54040c95f P f62ce053d68f4a868fa48f951d56da1a: Bootstrap starting.
I20260709 13:24:11.774358 18144 raft_consensus.cc:515] T ebc6959597f54d94ac7459f922a62871 P 5b2c1cd5f367458e811c859b7dbca333 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f62ce053d68f4a868fa48f951d56da1a" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 33029 } } peers { permanent_uuid: "93881c5b9b0648248e627ef7b541aec4" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 44419 } } peers { permanent_uuid: "5b2c1cd5f367458e811c859b7dbca333" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 40055 } }
I20260709 13:24:11.775377 17864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8693a343b4d94180b276b5a728f21637" candidate_uuid: "5b2c1cd5f367458e811c859b7dbca333" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f62ce053d68f4a868fa48f951d56da1a"
I20260709 13:24:11.776157 17864 raft_consensus.cc:3060] T 8693a343b4d94180b276b5a728f21637 P f62ce053d68f4a868fa48f951d56da1a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:24:11.778149 18159 tablet_bootstrap.cc:654] T 75dc16ae948c4e24825c10b54040c95f P f62ce053d68f4a868fa48f951d56da1a: Neither blocks nor log segments found. Creating new log.
I20260709 13:24:11.768281 17764 catalog_manager.cc:5697] T 6112fc9278e94d05946790ffc15dc4f7 P 5b2c1cd5f367458e811c859b7dbca333 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5b2c1cd5f367458e811c859b7dbca333 (127.5.126.67). New cstate: current_term: 1 leader_uuid: "5b2c1cd5f367458e811c859b7dbca333" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f62ce053d68f4a868fa48f951d56da1a" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 33029 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "93881c5b9b0648248e627ef7b541aec4" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 44419 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5b2c1cd5f367458e811c859b7dbca333" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 40055 } health_report { overall_health: HEALTHY } } }
I20260709 13:24:11.779006 18144 leader_election.cc:290] T ebc6959597f54d94ac7459f922a62871 P 5b2c1cd5f367458e811c859b7dbca333 [CANDIDATE]: Term 1 election: Requested vote from peers f62ce053d68f4a868fa48f951d56da1a (127.5.126.65:33029), 93881c5b9b0648248e627ef7b541aec4 (127.5.126.66:44419)
I20260709 13:24:11.779312 17939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebc6959597f54d94ac7459f922a62871" candidate_uuid: "5b2c1cd5f367458e811c859b7dbca333" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "93881c5b9b0648248e627ef7b541aec4"
I20260709 13:24:11.781358 17939 raft_consensus.cc:3060] T ebc6959597f54d94ac7459f922a62871 P 93881c5b9b0648248e627ef7b541aec4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:24:11.784894 17865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebc6959597f54d94ac7459f922a62871" candidate_uuid: "5b2c1cd5f367458e811c859b7dbca333" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f62ce053d68f4a868fa48f951d56da1a"
I20260709 13:24:11.785739 17865 raft_consensus.cc:3060] T ebc6959597f54d94ac7459f922a62871 P f62ce053d68f4a868fa48f951d56da1a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:24:11.794039 17864 raft_consensus.cc:2468] T 8693a343b4d94180b276b5a728f21637 P f62ce053d68f4a868fa48f951d56da1a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5b2c1cd5f367458e811c859b7dbca333 in term 1.
I20260709 13:24:11.796582 17939 raft_consensus.cc:2468] T ebc6959597f54d94ac7459f922a62871 P 93881c5b9b0648248e627ef7b541aec4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5b2c1cd5f367458e811c859b7dbca333 in term 1.
I20260709 13:24:11.796984 17978 leader_election.cc:304] T 8693a343b4d94180b276b5a728f21637 P 5b2c1cd5f367458e811c859b7dbca333 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b2c1cd5f367458e811c859b7dbca333, f62ce053d68f4a868fa48f951d56da1a; no voters: 
I20260709 13:24:11.780261 17940 raft_consensus.cc:2468] T 8693a343b4d94180b276b5a728f21637 P 93881c5b9b0648248e627ef7b541aec4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5b2c1cd5f367458e811c859b7dbca333 in term 1.
I20260709 13:24:11.796205 17865 raft_consensus.cc:2468] T ebc6959597f54d94ac7459f922a62871 P f62ce053d68f4a868fa48f951d56da1a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5b2c1cd5f367458e811c859b7dbca333 in term 1.
I20260709 13:24:11.798061 17979 leader_election.cc:304] T ebc6959597f54d94ac7459f922a62871 P 5b2c1cd5f367458e811c859b7dbca333 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b2c1cd5f367458e811c859b7dbca333, 93881c5b9b0648248e627ef7b541aec4; no voters: 
I20260709 13:24:11.799357 18178 raft_consensus.cc:2804] T 8693a343b4d94180b276b5a728f21637 P 5b2c1cd5f367458e811c859b7dbca333 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:24:11.799834 18178 raft_consensus.cc:697] T 8693a343b4d94180b276b5a728f21637 P 5b2c1cd5f367458e811c859b7dbca333 [term 1 LEADER]: Becoming Leader. State: Replica: 5b2c1cd5f367458e811c859b7dbca333, State: Running, Role: LEADER
I20260709 13:24:11.800879 18178 consensus_queue.cc:237] T 8693a343b4d94180b276b5a728f21637 P 5b2c1cd5f367458e811c859b7dbca333 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f62ce053d68f4a868fa48f951d56da1a" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 33029 } } peers { permanent_uuid: "93881c5b9b0648248e627ef7b541aec4" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 44419 } } peers { permanent_uuid: "5b2c1cd5f367458e811c859b7dbca333" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 40055 } }
I20260709 13:24:11.804469 18190 raft_consensus.cc:2804] T ebc6959597f54d94ac7459f922a62871 P 5b2c1cd5f367458e811c859b7dbca333 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:24:11.806080 17761 catalog_manager.cc:5697] T 6fa73bbd59654140adb36ac550bf0140 P 93881c5b9b0648248e627ef7b541aec4 reported cstate change: term changed from 0 to 1, leader changed from <none> to 93881c5b9b0648248e627ef7b541aec4 (127.5.126.66). New cstate: current_term: 1 leader_uuid: "93881c5b9b0648248e627ef7b541aec4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f62ce053d68f4a868fa48f951d56da1a" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 33029 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "93881c5b9b0648248e627ef7b541aec4" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 44419 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5b2c1cd5f367458e811c859b7dbca333" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 40055 } health_report { overall_health: UNKNOWN } } }
I20260709 13:24:11.811944 18159 tablet_bootstrap.cc:492] T 75dc16ae948c4e24825c10b54040c95f P f62ce053d68f4a868fa48f951d56da1a: No bootstrap required, opened a new log
I20260709 13:24:11.814873 18159 ts_tablet_manager.cc:1403] T 75dc16ae948c4e24825c10b54040c95f P f62ce053d68f4a868fa48f951d56da1a: Time spent bootstrapping tablet: real 0.043s	user 0.013s	sys 0.007s
I20260709 13:24:11.817386 18190 raft_consensus.cc:697] T ebc6959597f54d94ac7459f922a62871 P 5b2c1cd5f367458e811c859b7dbca333 [term 1 LEADER]: Becoming Leader. State: Replica: 5b2c1cd5f367458e811c859b7dbca333, State: Running, Role: LEADER
W20260709 13:24:11.818225 17812 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:24:11.818405 18190 consensus_queue.cc:237] T ebc6959597f54d94ac7459f922a62871 P 5b2c1cd5f367458e811c859b7dbca333 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f62ce053d68f4a868fa48f951d56da1a" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 33029 } } peers { permanent_uuid: "93881c5b9b0648248e627ef7b541aec4" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 44419 } } peers { permanent_uuid: "5b2c1cd5f367458e811c859b7dbca333" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 40055 } }
I20260709 13:24:11.819896 18159 raft_consensus.cc:359] T 75dc16ae948c4e24825c10b54040c95f P f62ce053d68f4a868fa48f951d56da1a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f62ce053d68f4a868fa48f951d56da1a" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 33029 } } peers { permanent_uuid: "93881c5b9b0648248e627ef7b541aec4" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 44419 } } peers { permanent_uuid: "5b2c1cd5f367458e811c859b7dbca333" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 40055 } }
I20260709 13:24:11.820811 18159 raft_consensus.cc:385] T 75dc16ae948c4e24825c10b54040c95f P f62ce053d68f4a868fa48f951d56da1a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:24:11.821108 18159 raft_consensus.cc:740] T 75dc16ae948c4e24825c10b54040c95f P f62ce053d68f4a868fa48f951d56da1a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f62ce053d68f4a868fa48f951d56da1a, State: Initialized, Role: FOLLOWER
I20260709 13:24:11.822088 18159 consensus_queue.cc:260] T 75dc16ae948c4e24825c10b54040c95f P f62ce053d68f4a868fa48f951d56da1a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f62ce053d68f4a868fa48f951d56da1a" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 33029 } } peers { permanent_uuid: "93881c5b9b0648248e627ef7b541aec4" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 44419 } } peers { permanent_uuid: "5b2c1cd5f367458e811c859b7dbca333" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 40055 } }
I20260709 13:24:11.824478 18159 ts_tablet_manager.cc:1434] T 75dc16ae948c4e24825c10b54040c95f P f62ce053d68f4a868fa48f951d56da1a: Time spent starting tablet: real 0.009s	user 0.009s	sys 0.000s
I20260709 13:24:11.834028 17762 catalog_manager.cc:5697] T 8693a343b4d94180b276b5a728f21637 P 5b2c1cd5f367458e811c859b7dbca333 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5b2c1cd5f367458e811c859b7dbca333 (127.5.126.67). New cstate: current_term: 1 leader_uuid: "5b2c1cd5f367458e811c859b7dbca333" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f62ce053d68f4a868fa48f951d56da1a" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 33029 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "93881c5b9b0648248e627ef7b541aec4" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 44419 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5b2c1cd5f367458e811c859b7dbca333" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 40055 } health_report { overall_health: HEALTHY } } }
I20260709 13:24:11.835500 17762 catalog_manager.cc:5697] T ebc6959597f54d94ac7459f922a62871 P 5b2c1cd5f367458e811c859b7dbca333 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5b2c1cd5f367458e811c859b7dbca333 (127.5.126.67). New cstate: current_term: 1 leader_uuid: "5b2c1cd5f367458e811c859b7dbca333" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f62ce053d68f4a868fa48f951d56da1a" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 33029 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "93881c5b9b0648248e627ef7b541aec4" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 44419 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5b2c1cd5f367458e811c859b7dbca333" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 40055 } health_report { overall_health: HEALTHY } } }
I20260709 13:24:11.854681 18137 consensus_queue.cc:1048] T d8c09480b6ed4e05bdb4abfd117fa378 P 93881c5b9b0648248e627ef7b541aec4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f62ce053d68f4a868fa48f951d56da1a" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 33029 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:24:11.869630 18200 consensus_queue.cc:1048] T d8c09480b6ed4e05bdb4abfd117fa378 P 93881c5b9b0648248e627ef7b541aec4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b2c1cd5f367458e811c859b7dbca333" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 40055 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:24:11.933161 18190 consensus_queue.cc:1048] T 8d003b1fd939449988c9ae06955c3808 P 5b2c1cd5f367458e811c859b7dbca333 [LEADER]: Connected to new peer: Peer: permanent_uuid: "93881c5b9b0648248e627ef7b541aec4" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 44419 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:24:11.944682 17864 raft_consensus.cc:3060] T 8d003b1fd939449988c9ae06955c3808 P f62ce053d68f4a868fa48f951d56da1a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:24:11.956420 18205 consensus_queue.cc:1048] T 8d003b1fd939449988c9ae06955c3808 P 5b2c1cd5f367458e811c859b7dbca333 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f62ce053d68f4a868fa48f951d56da1a" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 33029 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:24:11.979569 18205 raft_consensus.cc:493] T 75dc16ae948c4e24825c10b54040c95f P 5b2c1cd5f367458e811c859b7dbca333 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:24:11.980278 18205 raft_consensus.cc:515] T 75dc16ae948c4e24825c10b54040c95f P 5b2c1cd5f367458e811c859b7dbca333 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f62ce053d68f4a868fa48f951d56da1a" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 33029 } } peers { permanent_uuid: "93881c5b9b0648248e627ef7b541aec4" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 44419 } } peers { permanent_uuid: "5b2c1cd5f367458e811c859b7dbca333" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 40055 } }
I20260709 13:24:11.982841 18205 leader_election.cc:290] T 75dc16ae948c4e24825c10b54040c95f P 5b2c1cd5f367458e811c859b7dbca333 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f62ce053d68f4a868fa48f951d56da1a (127.5.126.65:33029), 93881c5b9b0648248e627ef7b541aec4 (127.5.126.66:44419)
I20260709 13:24:11.983777 17864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75dc16ae948c4e24825c10b54040c95f" candidate_uuid: "5b2c1cd5f367458e811c859b7dbca333" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f62ce053d68f4a868fa48f951d56da1a" is_pre_election: true
I20260709 13:24:11.984328 17940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75dc16ae948c4e24825c10b54040c95f" candidate_uuid: "5b2c1cd5f367458e811c859b7dbca333" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "93881c5b9b0648248e627ef7b541aec4" is_pre_election: true
I20260709 13:24:11.984622 18176 consensus_queue.cc:1048] T 910689bc7c56485d8063b2ca5f4d4c17 P f62ce053d68f4a868fa48f951d56da1a [LEADER]: Connected to new peer: Peer: permanent_uuid: "93881c5b9b0648248e627ef7b541aec4" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 44419 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:24:11.984767 17864 raft_consensus.cc:2468] T 75dc16ae948c4e24825c10b54040c95f P f62ce053d68f4a868fa48f951d56da1a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b2c1cd5f367458e811c859b7dbca333 in term 0.
I20260709 13:24:11.985214 17940 raft_consensus.cc:2468] T 75dc16ae948c4e24825c10b54040c95f P 93881c5b9b0648248e627ef7b541aec4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b2c1cd5f367458e811c859b7dbca333 in term 0.
I20260709 13:24:11.986421 17978 leader_election.cc:304] T 75dc16ae948c4e24825c10b54040c95f P 5b2c1cd5f367458e811c859b7dbca333 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b2c1cd5f367458e811c859b7dbca333, f62ce053d68f4a868fa48f951d56da1a; no voters: 
I20260709 13:24:11.987398 18205 raft_consensus.cc:2804] T 75dc16ae948c4e24825c10b54040c95f P 5b2c1cd5f367458e811c859b7dbca333 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:24:11.987754 18205 raft_consensus.cc:493] T 75dc16ae948c4e24825c10b54040c95f P 5b2c1cd5f367458e811c859b7dbca333 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:24:11.988106 18205 raft_consensus.cc:3060] T 75dc16ae948c4e24825c10b54040c95f P 5b2c1cd5f367458e811c859b7dbca333 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:24:11.994462 18013 raft_consensus.cc:3060] T c8b2ba53ff454a39ae7982592bd75e99 P 5b2c1cd5f367458e811c859b7dbca333 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:24:11.995934 18205 raft_consensus.cc:515] T 75dc16ae948c4e24825c10b54040c95f P 5b2c1cd5f367458e811c859b7dbca333 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f62ce053d68f4a868fa48f951d56da1a" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 33029 } } peers { permanent_uuid: "93881c5b9b0648248e627ef7b541aec4" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 44419 } } peers { permanent_uuid: "5b2c1cd5f367458e811c859b7dbca333" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 40055 } }
I20260709 13:24:11.998534 18205 leader_election.cc:290] T 75dc16ae948c4e24825c10b54040c95f P 5b2c1cd5f367458e811c859b7dbca333 [CANDIDATE]: Term 1 election: Requested vote from peers f62ce053d68f4a868fa48f951d56da1a (127.5.126.65:33029), 93881c5b9b0648248e627ef7b541aec4 (127.5.126.66:44419)
I20260709 13:24:11.999706 17939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75dc16ae948c4e24825c10b54040c95f" candidate_uuid: "5b2c1cd5f367458e811c859b7dbca333" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "93881c5b9b0648248e627ef7b541aec4"
I20260709 13:24:11.999995 17864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75dc16ae948c4e24825c10b54040c95f" candidate_uuid: "5b2c1cd5f367458e811c859b7dbca333" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f62ce053d68f4a868fa48f951d56da1a"
I20260709 13:24:12.000555 17939 raft_consensus.cc:3060] T 75dc16ae948c4e24825c10b54040c95f P 93881c5b9b0648248e627ef7b541aec4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:24:12.000630 17864 raft_consensus.cc:3060] T 75dc16ae948c4e24825c10b54040c95f P f62ce053d68f4a868fa48f951d56da1a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:24:12.002140 18176 consensus_queue.cc:1048] T 910689bc7c56485d8063b2ca5f4d4c17 P f62ce053d68f4a868fa48f951d56da1a [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b2c1cd5f367458e811c859b7dbca333" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 40055 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:24:12.010028 17864 raft_consensus.cc:2468] T 75dc16ae948c4e24825c10b54040c95f P f62ce053d68f4a868fa48f951d56da1a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5b2c1cd5f367458e811c859b7dbca333 in term 1.
I20260709 13:24:12.019317 17939 raft_consensus.cc:2468] T 75dc16ae948c4e24825c10b54040c95f P 93881c5b9b0648248e627ef7b541aec4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5b2c1cd5f367458e811c859b7dbca333 in term 1.
I20260709 13:24:12.023334 17978 leader_election.cc:304] T 75dc16ae948c4e24825c10b54040c95f P 5b2c1cd5f367458e811c859b7dbca333 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b2c1cd5f367458e811c859b7dbca333, f62ce053d68f4a868fa48f951d56da1a; no voters: 
I20260709 13:24:12.024168 18205 raft_consensus.cc:2804] T 75dc16ae948c4e24825c10b54040c95f P 5b2c1cd5f367458e811c859b7dbca333 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:24:12.024657 18205 raft_consensus.cc:697] T 75dc16ae948c4e24825c10b54040c95f P 5b2c1cd5f367458e811c859b7dbca333 [term 1 LEADER]: Becoming Leader. State: Replica: 5b2c1cd5f367458e811c859b7dbca333, State: Running, Role: LEADER
I20260709 13:24:12.025758 18205 consensus_queue.cc:237] T 75dc16ae948c4e24825c10b54040c95f P 5b2c1cd5f367458e811c859b7dbca333 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f62ce053d68f4a868fa48f951d56da1a" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 33029 } } peers { permanent_uuid: "93881c5b9b0648248e627ef7b541aec4" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 44419 } } peers { permanent_uuid: "5b2c1cd5f367458e811c859b7dbca333" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 40055 } }
I20260709 13:24:12.037195 18176 consensus_queue.cc:1048] T c8b2ba53ff454a39ae7982592bd75e99 P f62ce053d68f4a868fa48f951d56da1a [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b2c1cd5f367458e811c859b7dbca333" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 40055 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:24:12.042137 17762 catalog_manager.cc:5697] T 75dc16ae948c4e24825c10b54040c95f P 5b2c1cd5f367458e811c859b7dbca333 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5b2c1cd5f367458e811c859b7dbca333 (127.5.126.67). New cstate: current_term: 1 leader_uuid: "5b2c1cd5f367458e811c859b7dbca333" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f62ce053d68f4a868fa48f951d56da1a" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 33029 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "93881c5b9b0648248e627ef7b541aec4" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 44419 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5b2c1cd5f367458e811c859b7dbca333" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 40055 } health_report { overall_health: HEALTHY } } }
I20260709 13:24:12.049561 18176 consensus_queue.cc:1048] T c8b2ba53ff454a39ae7982592bd75e99 P f62ce053d68f4a868fa48f951d56da1a [LEADER]: Connected to new peer: Peer: permanent_uuid: "93881c5b9b0648248e627ef7b541aec4" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 44419 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:24:12.132802 17939 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d8c09480b6ed4e05bdb4abfd117fa378"
dest_uuid: "93881c5b9b0648248e627ef7b541aec4"
mode: GRACEFUL
new_leader_uuid: "f62ce053d68f4a868fa48f951d56da1a"
 from {username='slave'} at 127.0.0.1:34962
I20260709 13:24:12.133416 17939 raft_consensus.cc:606] T d8c09480b6ed4e05bdb4abfd117fa378 P 93881c5b9b0648248e627ef7b541aec4 [term 1 LEADER]: Received request to transfer leadership to TS f62ce053d68f4a868fa48f951d56da1a
I20260709 13:24:12.139564 18013 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6112fc9278e94d05946790ffc15dc4f7"
dest_uuid: "5b2c1cd5f367458e811c859b7dbca333"
mode: GRACEFUL
new_leader_uuid: "f62ce053d68f4a868fa48f951d56da1a"
 from {username='slave'} at 127.0.0.1:59808
I20260709 13:24:12.140282 18013 raft_consensus.cc:606] T 6112fc9278e94d05946790ffc15dc4f7 P 5b2c1cd5f367458e811c859b7dbca333 [term 1 LEADER]: Received request to transfer leadership to TS f62ce053d68f4a868fa48f951d56da1a
I20260709 13:24:12.149495 18013 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8d003b1fd939449988c9ae06955c3808"
dest_uuid: "5b2c1cd5f367458e811c859b7dbca333"
mode: GRACEFUL
new_leader_uuid: "f62ce053d68f4a868fa48f951d56da1a"
 from {username='slave'} at 127.0.0.1:59808
I20260709 13:24:12.150223 18013 raft_consensus.cc:606] T 8d003b1fd939449988c9ae06955c3808 P 5b2c1cd5f367458e811c859b7dbca333 [term 1 LEADER]: Received request to transfer leadership to TS f62ce053d68f4a868fa48f951d56da1a
I20260709 13:24:12.151300 18205 consensus_queue.cc:1048] T 6112fc9278e94d05946790ffc15dc4f7 P 5b2c1cd5f367458e811c859b7dbca333 [LEADER]: Connected to new peer: Peer: permanent_uuid: "93881c5b9b0648248e627ef7b541aec4" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 44419 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:24:12.157290 17864 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c8b2ba53ff454a39ae7982592bd75e99"
dest_uuid: "f62ce053d68f4a868fa48f951d56da1a"
mode: GRACEFUL
new_leader_uuid: "93881c5b9b0648248e627ef7b541aec4"
 from {username='slave'} at 127.0.0.1:41774
I20260709 13:24:12.157917 17864 raft_consensus.cc:606] T c8b2ba53ff454a39ae7982592bd75e99 P f62ce053d68f4a868fa48f951d56da1a [term 1 LEADER]: Received request to transfer leadership to TS 93881c5b9b0648248e627ef7b541aec4
I20260709 13:24:12.164562 18190 consensus_queue.cc:1048] T 6112fc9278e94d05946790ffc15dc4f7 P 5b2c1cd5f367458e811c859b7dbca333 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f62ce053d68f4a868fa48f951d56da1a" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 33029 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:24:12.174077 18014 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8693a343b4d94180b276b5a728f21637"
dest_uuid: "5b2c1cd5f367458e811c859b7dbca333"
mode: GRACEFUL
new_leader_uuid: "93881c5b9b0648248e627ef7b541aec4"
 from {username='slave'} at 127.0.0.1:59808
I20260709 13:24:12.174834 18014 raft_consensus.cc:606] T 8693a343b4d94180b276b5a728f21637 P 5b2c1cd5f367458e811c859b7dbca333 [term 1 LEADER]: Received request to transfer leadership to TS 93881c5b9b0648248e627ef7b541aec4
I20260709 13:24:12.175349 18200 consensus_queue.cc:1048] T 6fa73bbd59654140adb36ac550bf0140 P 93881c5b9b0648248e627ef7b541aec4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b2c1cd5f367458e811c859b7dbca333" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 40055 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:24:12.184850 18205 raft_consensus.cc:993] T 6112fc9278e94d05946790ffc15dc4f7 P 5b2c1cd5f367458e811c859b7dbca333: : Instructing follower f62ce053d68f4a868fa48f951d56da1a to start an election
I20260709 13:24:12.185490 18205 raft_consensus.cc:1081] T 6112fc9278e94d05946790ffc15dc4f7 P 5b2c1cd5f367458e811c859b7dbca333 [term 1 LEADER]: Signalling peer f62ce053d68f4a868fa48f951d56da1a to start an election
I20260709 13:24:12.185827 18013 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "75dc16ae948c4e24825c10b54040c95f"
dest_uuid: "5b2c1cd5f367458e811c859b7dbca333"
mode: GRACEFUL
new_leader_uuid: "93881c5b9b0648248e627ef7b541aec4"
 from {username='slave'} at 127.0.0.1:59808
I20260709 13:24:12.186601 18013 raft_consensus.cc:606] T 75dc16ae948c4e24825c10b54040c95f P 5b2c1cd5f367458e811c859b7dbca333 [term 1 LEADER]: Received request to transfer leadership to TS 93881c5b9b0648248e627ef7b541aec4
I20260709 13:24:12.187589 17864 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6112fc9278e94d05946790ffc15dc4f7"
dest_uuid: "f62ce053d68f4a868fa48f951d56da1a"
 from {username='slave'} at 127.0.0.1:41748
I20260709 13:24:12.188864 17864 raft_consensus.cc:493] T 6112fc9278e94d05946790ffc15dc4f7 P f62ce053d68f4a868fa48f951d56da1a [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:24:12.189247 17864 raft_consensus.cc:3060] T 6112fc9278e94d05946790ffc15dc4f7 P f62ce053d68f4a868fa48f951d56da1a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:24:12.196630 17864 raft_consensus.cc:515] T 6112fc9278e94d05946790ffc15dc4f7 P f62ce053d68f4a868fa48f951d56da1a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f62ce053d68f4a868fa48f951d56da1a" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 33029 } } peers { permanent_uuid: "93881c5b9b0648248e627ef7b541aec4" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 44419 } } peers { permanent_uuid: "5b2c1cd5f367458e811c859b7dbca333" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 40055 } }
I20260709 13:24:12.197892 18137 consensus_queue.cc:1048] T 6fa73bbd59654140adb36ac550bf0140 P 93881c5b9b0648248e627ef7b541aec4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f62ce053d68f4a868fa48f951d56da1a" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 33029 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:24:12.198874 17864 leader_election.cc:290] T 6112fc9278e94d05946790ffc15dc4f7 P f62ce053d68f4a868fa48f951d56da1a [CANDIDATE]: Term 2 election: Requested vote from peers 93881c5b9b0648248e627ef7b541aec4 (127.5.126.66:44419), 5b2c1cd5f367458e811c859b7dbca333 (127.5.126.67:40055)
I20260709 13:24:12.200627 18014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6112fc9278e94d05946790ffc15dc4f7" candidate_uuid: "f62ce053d68f4a868fa48f951d56da1a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5b2c1cd5f367458e811c859b7dbca333"
I20260709 13:24:12.201067 17939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6112fc9278e94d05946790ffc15dc4f7" candidate_uuid: "f62ce053d68f4a868fa48f951d56da1a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "93881c5b9b0648248e627ef7b541aec4"
I20260709 13:24:12.201741 17939 raft_consensus.cc:3060] T 6112fc9278e94d05946790ffc15dc4f7 P 93881c5b9b0648248e627ef7b541aec4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:24:12.201459 18014 raft_consensus.cc:3055] T 6112fc9278e94d05946790ffc15dc4f7 P 5b2c1cd5f367458e811c859b7dbca333 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:24:12.202293 18014 raft_consensus.cc:740] T 6112fc9278e94d05946790ffc15dc4f7 P 5b2c1cd5f367458e811c859b7dbca333 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5b2c1cd5f367458e811c859b7dbca333, State: Running, Role: LEADER
I20260709 13:24:12.203235 18014 consensus_queue.cc:260] T 6112fc9278e94d05946790ffc15dc4f7 P 5b2c1cd5f367458e811c859b7dbca333 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f62ce053d68f4a868fa48f951d56da1a" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 33029 } } peers { permanent_uuid: "93881c5b9b0648248e627ef7b541aec4" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 44419 } } peers { permanent_uuid: "5b2c1cd5f367458e811c859b7dbca333" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 40055 } }
I20260709 13:24:12.204877 18014 raft_consensus.cc:3060] T 6112fc9278e94d05946790ffc15dc4f7 P 5b2c1cd5f367458e811c859b7dbca333 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:24:12.215682 18014 raft_consensus.cc:2468] T 6112fc9278e94d05946790ffc15dc4f7 P 5b2c1cd5f367458e811c859b7dbca333 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f62ce053d68f4a868fa48f951d56da1a in term 2.
I20260709 13:24:12.215996 17939 raft_consensus.cc:2468] T 6112fc9278e94d05946790ffc15dc4f7 P 93881c5b9b0648248e627ef7b541aec4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f62ce053d68f4a868fa48f951d56da1a in term 2.
I20260709 13:24:12.216957 17830 leader_election.cc:304] T 6112fc9278e94d05946790ffc15dc4f7 P f62ce053d68f4a868fa48f951d56da1a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b2c1cd5f367458e811c859b7dbca333, f62ce053d68f4a868fa48f951d56da1a; no voters: 
I20260709 13:24:12.218986 18176 raft_consensus.cc:2804] T 6112fc9278e94d05946790ffc15dc4f7 P f62ce053d68f4a868fa48f951d56da1a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:24:12.219530 18176 raft_consensus.cc:697] T 6112fc9278e94d05946790ffc15dc4f7 P f62ce053d68f4a868fa48f951d56da1a [term 2 LEADER]: Becoming Leader. State: Replica: f62ce053d68f4a868fa48f951d56da1a, State: Running, Role: LEADER
I20260709 13:24:12.220544 18176 consensus_queue.cc:237] T 6112fc9278e94d05946790ffc15dc4f7 P f62ce053d68f4a868fa48f951d56da1a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f62ce053d68f4a868fa48f951d56da1a" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 33029 } } peers { permanent_uuid: "93881c5b9b0648248e627ef7b541aec4" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 44419 } } peers { permanent_uuid: "5b2c1cd5f367458e811c859b7dbca333" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 40055 } }
I20260709 13:24:12.237221 17762 catalog_manager.cc:5697] T 6112fc9278e94d05946790ffc15dc4f7 P f62ce053d68f4a868fa48f951d56da1a reported cstate change: term changed from 1 to 2, leader changed from 5b2c1cd5f367458e811c859b7dbca333 (127.5.126.67) to f62ce053d68f4a868fa48f951d56da1a (127.5.126.65). New cstate: current_term: 2 leader_uuid: "f62ce053d68f4a868fa48f951d56da1a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f62ce053d68f4a868fa48f951d56da1a" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 33029 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "93881c5b9b0648248e627ef7b541aec4" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 44419 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5b2c1cd5f367458e811c859b7dbca333" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 40055 } health_report { overall_health: UNKNOWN } } }
I20260709 13:24:12.246902 18190 consensus_queue.cc:1048] T ebc6959597f54d94ac7459f922a62871 P 5b2c1cd5f367458e811c859b7dbca333 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f62ce053d68f4a868fa48f951d56da1a" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 33029 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:24:12.259907 18190 consensus_queue.cc:1048] T ebc6959597f54d94ac7459f922a62871 P 5b2c1cd5f367458e811c859b7dbca333 [LEADER]: Connected to new peer: Peer: permanent_uuid: "93881c5b9b0648248e627ef7b541aec4" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 44419 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:24:12.320387 18190 consensus_queue.cc:1048] T 8693a343b4d94180b276b5a728f21637 P 5b2c1cd5f367458e811c859b7dbca333 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f62ce053d68f4a868fa48f951d56da1a" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 33029 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:24:12.321132 18205 consensus_queue.cc:1048] T 8693a343b4d94180b276b5a728f21637 P 5b2c1cd5f367458e811c859b7dbca333 [LEADER]: Connected to new peer: Peer: permanent_uuid: "93881c5b9b0648248e627ef7b541aec4" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 44419 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:24:12.330878 18144 raft_consensus.cc:993] T 8693a343b4d94180b276b5a728f21637 P 5b2c1cd5f367458e811c859b7dbca333: : Instructing follower 93881c5b9b0648248e627ef7b541aec4 to start an election
I20260709 13:24:12.331449 18144 raft_consensus.cc:1081] T 8693a343b4d94180b276b5a728f21637 P 5b2c1cd5f367458e811c859b7dbca333 [term 1 LEADER]: Signalling peer 93881c5b9b0648248e627ef7b541aec4 to start an election
I20260709 13:24:12.338874 17939 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8693a343b4d94180b276b5a728f21637"
dest_uuid: "93881c5b9b0648248e627ef7b541aec4"
 from {username='slave'} at 127.0.0.1:34950
I20260709 13:24:12.339630 17939 raft_consensus.cc:493] T 8693a343b4d94180b276b5a728f21637 P 93881c5b9b0648248e627ef7b541aec4 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:24:12.340940 17939 raft_consensus.cc:3060] T 8693a343b4d94180b276b5a728f21637 P 93881c5b9b0648248e627ef7b541aec4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:24:12.347419 17939 raft_consensus.cc:515] T 8693a343b4d94180b276b5a728f21637 P 93881c5b9b0648248e627ef7b541aec4 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f62ce053d68f4a868fa48f951d56da1a" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 33029 } } peers { permanent_uuid: "93881c5b9b0648248e627ef7b541aec4" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 44419 } } peers { permanent_uuid: "5b2c1cd5f367458e811c859b7dbca333" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 40055 } }
I20260709 13:24:12.350440 18014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8693a343b4d94180b276b5a728f21637" candidate_uuid: "93881c5b9b0648248e627ef7b541aec4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5b2c1cd5f367458e811c859b7dbca333"
I20260709 13:24:12.350440 17864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8693a343b4d94180b276b5a728f21637" candidate_uuid: "93881c5b9b0648248e627ef7b541aec4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f62ce053d68f4a868fa48f951d56da1a"
I20260709 13:24:12.351146 18014 raft_consensus.cc:3055] T 8693a343b4d94180b276b5a728f21637 P 5b2c1cd5f367458e811c859b7dbca333 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:24:12.351171 17864 raft_consensus.cc:3060] T 8693a343b4d94180b276b5a728f21637 P f62ce053d68f4a868fa48f951d56da1a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:24:12.351608 18014 raft_consensus.cc:740] T 8693a343b4d94180b276b5a728f21637 P 5b2c1cd5f367458e811c859b7dbca333 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5b2c1cd5f367458e811c859b7dbca333, State: Running, Role: LEADER
I20260709 13:24:12.352458 18014 consensus_queue.cc:260] T 8693a343b4d94180b276b5a728f21637 P 5b2c1cd5f367458e811c859b7dbca333 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f62ce053d68f4a868fa48f951d56da1a" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 33029 } } peers { permanent_uuid: "93881c5b9b0648248e627ef7b541aec4" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 44419 } } peers { permanent_uuid: "5b2c1cd5f367458e811c859b7dbca333" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 40055 } }
I20260709 13:24:12.352860 17939 leader_election.cc:290] T 8693a343b4d94180b276b5a728f21637 P 93881c5b9b0648248e627ef7b541aec4 [CANDIDATE]: Term 2 election: Requested vote from peers f62ce053d68f4a868fa48f951d56da1a (127.5.126.65:33029), 5b2c1cd5f367458e811c859b7dbca333 (127.5.126.67:40055)
I20260709 13:24:12.353531 18014 raft_consensus.cc:3060] T 8693a343b4d94180b276b5a728f21637 P 5b2c1cd5f367458e811c859b7dbca333 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:24:12.359069 17864 raft_consensus.cc:2468] T 8693a343b4d94180b276b5a728f21637 P f62ce053d68f4a868fa48f951d56da1a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 93881c5b9b0648248e627ef7b541aec4 in term 2.
I20260709 13:24:12.360409 18014 raft_consensus.cc:2468] T 8693a343b4d94180b276b5a728f21637 P 5b2c1cd5f367458e811c859b7dbca333 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 93881c5b9b0648248e627ef7b541aec4 in term 2.
I20260709 13:24:12.360464 17904 leader_election.cc:304] T 8693a343b4d94180b276b5a728f21637 P 93881c5b9b0648248e627ef7b541aec4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 93881c5b9b0648248e627ef7b541aec4, f62ce053d68f4a868fa48f951d56da1a; no voters: 
I20260709 13:24:12.361546 18137 raft_consensus.cc:2804] T 8693a343b4d94180b276b5a728f21637 P 93881c5b9b0648248e627ef7b541aec4 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:24:12.362021 18137 raft_consensus.cc:697] T 8693a343b4d94180b276b5a728f21637 P 93881c5b9b0648248e627ef7b541aec4 [term 2 LEADER]: Becoming Leader. State: Replica: 93881c5b9b0648248e627ef7b541aec4, State: Running, Role: LEADER
I20260709 13:24:12.362798 18137 consensus_queue.cc:237] T 8693a343b4d94180b276b5a728f21637 P 93881c5b9b0648248e627ef7b541aec4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f62ce053d68f4a868fa48f951d56da1a" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 33029 } } peers { permanent_uuid: "93881c5b9b0648248e627ef7b541aec4" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 44419 } } peers { permanent_uuid: "5b2c1cd5f367458e811c859b7dbca333" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 40055 } }
I20260709 13:24:12.369575 17761 catalog_manager.cc:5697] T 8693a343b4d94180b276b5a728f21637 P 93881c5b9b0648248e627ef7b541aec4 reported cstate change: term changed from 1 to 2, leader changed from 5b2c1cd5f367458e811c859b7dbca333 (127.5.126.67) to 93881c5b9b0648248e627ef7b541aec4 (127.5.126.66). New cstate: current_term: 2 leader_uuid: "93881c5b9b0648248e627ef7b541aec4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f62ce053d68f4a868fa48f951d56da1a" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 33029 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "93881c5b9b0648248e627ef7b541aec4" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 44419 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5b2c1cd5f367458e811c859b7dbca333" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 40055 } health_report { overall_health: UNKNOWN } } }
I20260709 13:24:12.416615 18190 consensus_queue.cc:1048] T 75dc16ae948c4e24825c10b54040c95f P 5b2c1cd5f367458e811c859b7dbca333 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f62ce053d68f4a868fa48f951d56da1a" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 33029 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:24:12.417271 18144 raft_consensus.cc:993] T 8d003b1fd939449988c9ae06955c3808 P 5b2c1cd5f367458e811c859b7dbca333: : Instructing follower f62ce053d68f4a868fa48f951d56da1a to start an election
I20260709 13:24:12.417991 18205 raft_consensus.cc:1081] T 8d003b1fd939449988c9ae06955c3808 P 5b2c1cd5f367458e811c859b7dbca333 [term 1 LEADER]: Signalling peer f62ce053d68f4a868fa48f951d56da1a to start an election
I20260709 13:24:12.420199 17864 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8d003b1fd939449988c9ae06955c3808"
dest_uuid: "f62ce053d68f4a868fa48f951d56da1a"
 from {username='slave'} at 127.0.0.1:41748
I20260709 13:24:12.421386 17864 raft_consensus.cc:493] T 8d003b1fd939449988c9ae06955c3808 P f62ce053d68f4a868fa48f951d56da1a [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:24:12.421795 17864 raft_consensus.cc:3060] T 8d003b1fd939449988c9ae06955c3808 P f62ce053d68f4a868fa48f951d56da1a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:24:12.429811 18200 raft_consensus.cc:993] T d8c09480b6ed4e05bdb4abfd117fa378 P 93881c5b9b0648248e627ef7b541aec4: : Instructing follower f62ce053d68f4a868fa48f951d56da1a to start an election
I20260709 13:24:12.430380 18200 raft_consensus.cc:1081] T d8c09480b6ed4e05bdb4abfd117fa378 P 93881c5b9b0648248e627ef7b541aec4 [term 1 LEADER]: Signalling peer f62ce053d68f4a868fa48f951d56da1a to start an election
I20260709 13:24:12.432651 17866 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d8c09480b6ed4e05bdb4abfd117fa378"
dest_uuid: "f62ce053d68f4a868fa48f951d56da1a"
 from {username='slave'} at 127.0.0.1:41760
I20260709 13:24:12.433331 17866 raft_consensus.cc:493] T d8c09480b6ed4e05bdb4abfd117fa378 P f62ce053d68f4a868fa48f951d56da1a [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:24:12.433874 17866 raft_consensus.cc:3060] T d8c09480b6ed4e05bdb4abfd117fa378 P f62ce053d68f4a868fa48f951d56da1a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:24:12.430400 17864 raft_consensus.cc:515] T 8d003b1fd939449988c9ae06955c3808 P f62ce053d68f4a868fa48f951d56da1a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f62ce053d68f4a868fa48f951d56da1a" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 33029 } } peers { permanent_uuid: "93881c5b9b0648248e627ef7b541aec4" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 44419 } } peers { permanent_uuid: "5b2c1cd5f367458e811c859b7dbca333" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 40055 } }
I20260709 13:24:12.434870 18144 consensus_queue.cc:1048] T 75dc16ae948c4e24825c10b54040c95f P 5b2c1cd5f367458e811c859b7dbca333 [LEADER]: Connected to new peer: Peer: permanent_uuid: "93881c5b9b0648248e627ef7b541aec4" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 44419 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:24:12.438092 17938 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d003b1fd939449988c9ae06955c3808" candidate_uuid: "f62ce053d68f4a868fa48f951d56da1a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "93881c5b9b0648248e627ef7b541aec4"
I20260709 13:24:12.438757 17938 raft_consensus.cc:3060] T 8d003b1fd939449988c9ae06955c3808 P 93881c5b9b0648248e627ef7b541aec4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:24:12.443930 17866 raft_consensus.cc:515] T d8c09480b6ed4e05bdb4abfd117fa378 P f62ce053d68f4a868fa48f951d56da1a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f62ce053d68f4a868fa48f951d56da1a" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 33029 } } peers { permanent_uuid: "93881c5b9b0648248e627ef7b541aec4" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 44419 } } peers { permanent_uuid: "5b2c1cd5f367458e811c859b7dbca333" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 40055 } }
I20260709 13:24:12.446506 17866 leader_election.cc:290] T d8c09480b6ed4e05bdb4abfd117fa378 P f62ce053d68f4a868fa48f951d56da1a [CANDIDATE]: Term 2 election: Requested vote from peers 93881c5b9b0648248e627ef7b541aec4 (127.5.126.66:44419), 5b2c1cd5f367458e811c859b7dbca333 (127.5.126.67:40055)
I20260709 13:24:12.447649 18014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8c09480b6ed4e05bdb4abfd117fa378" candidate_uuid: "f62ce053d68f4a868fa48f951d56da1a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5b2c1cd5f367458e811c859b7dbca333"
I20260709 13:24:12.448275 18014 raft_consensus.cc:3060] T d8c09480b6ed4e05bdb4abfd117fa378 P 5b2c1cd5f367458e811c859b7dbca333 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:24:12.452400 17939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8c09480b6ed4e05bdb4abfd117fa378" candidate_uuid: "f62ce053d68f4a868fa48f951d56da1a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "93881c5b9b0648248e627ef7b541aec4"
I20260709 13:24:12.453169 17939 raft_consensus.cc:3055] T d8c09480b6ed4e05bdb4abfd117fa378 P 93881c5b9b0648248e627ef7b541aec4 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:24:12.453485 17939 raft_consensus.cc:740] T d8c09480b6ed4e05bdb4abfd117fa378 P 93881c5b9b0648248e627ef7b541aec4 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 93881c5b9b0648248e627ef7b541aec4, State: Running, Role: LEADER
I20260709 13:24:12.454358 17938 raft_consensus.cc:2468] T 8d003b1fd939449988c9ae06955c3808 P 93881c5b9b0648248e627ef7b541aec4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f62ce053d68f4a868fa48f951d56da1a in term 2.
I20260709 13:24:12.454272 17939 consensus_queue.cc:260] T d8c09480b6ed4e05bdb4abfd117fa378 P 93881c5b9b0648248e627ef7b541aec4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f62ce053d68f4a868fa48f951d56da1a" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 33029 } } peers { permanent_uuid: "93881c5b9b0648248e627ef7b541aec4" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 44419 } } peers { permanent_uuid: "5b2c1cd5f367458e811c859b7dbca333" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 40055 } }
I20260709 13:24:12.456758 18013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d003b1fd939449988c9ae06955c3808" candidate_uuid: "f62ce053d68f4a868fa48f951d56da1a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5b2c1cd5f367458e811c859b7dbca333"
I20260709 13:24:12.457062 18144 raft_consensus.cc:993] T 75dc16ae948c4e24825c10b54040c95f P 5b2c1cd5f367458e811c859b7dbca333: : Instructing follower 93881c5b9b0648248e627ef7b541aec4 to start an election
I20260709 13:24:12.456977 17830 leader_election.cc:304] T 8d003b1fd939449988c9ae06955c3808 P f62ce053d68f4a868fa48f951d56da1a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 93881c5b9b0648248e627ef7b541aec4, f62ce053d68f4a868fa48f951d56da1a; no voters: 
I20260709 13:24:12.457790 18144 raft_consensus.cc:1081] T 75dc16ae948c4e24825c10b54040c95f P 5b2c1cd5f367458e811c859b7dbca333 [term 1 LEADER]: Signalling peer 93881c5b9b0648248e627ef7b541aec4 to start an election
I20260709 13:24:12.458124 18176 raft_consensus.cc:2804] T 8d003b1fd939449988c9ae06955c3808 P f62ce053d68f4a868fa48f951d56da1a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:24:12.457733 18013 raft_consensus.cc:3055] T 8d003b1fd939449988c9ae06955c3808 P 5b2c1cd5f367458e811c859b7dbca333 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:24:12.458614 18176 raft_consensus.cc:697] T 8d003b1fd939449988c9ae06955c3808 P f62ce053d68f4a868fa48f951d56da1a [term 2 LEADER]: Becoming Leader. State: Replica: f62ce053d68f4a868fa48f951d56da1a, State: Running, Role: LEADER
I20260709 13:24:12.458932 18013 raft_consensus.cc:740] T 8d003b1fd939449988c9ae06955c3808 P 5b2c1cd5f367458e811c859b7dbca333 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5b2c1cd5f367458e811c859b7dbca333, State: Running, Role: LEADER
I20260709 13:24:12.459672 18176 consensus_queue.cc:237] T 8d003b1fd939449988c9ae06955c3808 P f62ce053d68f4a868fa48f951d56da1a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f62ce053d68f4a868fa48f951d56da1a" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 33029 } } peers { permanent_uuid: "93881c5b9b0648248e627ef7b541aec4" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 44419 } } peers { permanent_uuid: "5b2c1cd5f367458e811c859b7dbca333" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 40055 } }
I20260709 13:24:12.459923 18013 consensus_queue.cc:260] T 8d003b1fd939449988c9ae06955c3808 P 5b2c1cd5f367458e811c859b7dbca333 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f62ce053d68f4a868fa48f951d56da1a" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 33029 } } peers { permanent_uuid: "93881c5b9b0648248e627ef7b541aec4" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 44419 } } peers { permanent_uuid: "5b2c1cd5f367458e811c859b7dbca333" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 40055 } }
I20260709 13:24:12.461321 18013 raft_consensus.cc:3060] T 8d003b1fd939449988c9ae06955c3808 P 5b2c1cd5f367458e811c859b7dbca333 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:24:12.458623 17939 raft_consensus.cc:3060] T d8c09480b6ed4e05bdb4abfd117fa378 P 93881c5b9b0648248e627ef7b541aec4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:24:12.461269 18014 raft_consensus.cc:2468] T d8c09480b6ed4e05bdb4abfd117fa378 P 5b2c1cd5f367458e811c859b7dbca333 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f62ce053d68f4a868fa48f951d56da1a in term 2.
I20260709 13:24:12.464226 17830 leader_election.cc:304] T d8c09480b6ed4e05bdb4abfd117fa378 P f62ce053d68f4a868fa48f951d56da1a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b2c1cd5f367458e811c859b7dbca333, f62ce053d68f4a868fa48f951d56da1a; no voters: 
I20260709 13:24:12.455338 17864 leader_election.cc:290] T 8d003b1fd939449988c9ae06955c3808 P f62ce053d68f4a868fa48f951d56da1a [CANDIDATE]: Term 2 election: Requested vote from peers 93881c5b9b0648248e627ef7b541aec4 (127.5.126.66:44419), 5b2c1cd5f367458e811c859b7dbca333 (127.5.126.67:40055)
I20260709 13:24:12.465195 18142 raft_consensus.cc:2804] T d8c09480b6ed4e05bdb4abfd117fa378 P f62ce053d68f4a868fa48f951d56da1a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:24:12.465700 18142 raft_consensus.cc:697] T d8c09480b6ed4e05bdb4abfd117fa378 P f62ce053d68f4a868fa48f951d56da1a [term 2 LEADER]: Becoming Leader. State: Replica: f62ce053d68f4a868fa48f951d56da1a, State: Running, Role: LEADER
I20260709 13:24:12.466614 18142 consensus_queue.cc:237] T d8c09480b6ed4e05bdb4abfd117fa378 P f62ce053d68f4a868fa48f951d56da1a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f62ce053d68f4a868fa48f951d56da1a" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 33029 } } peers { permanent_uuid: "93881c5b9b0648248e627ef7b541aec4" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 44419 } } peers { permanent_uuid: "5b2c1cd5f367458e811c859b7dbca333" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 40055 } }
I20260709 13:24:12.468485 17940 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "75dc16ae948c4e24825c10b54040c95f"
dest_uuid: "93881c5b9b0648248e627ef7b541aec4"
 from {username='slave'} at 127.0.0.1:34950
I20260709 13:24:12.469285 17940 raft_consensus.cc:493] T 75dc16ae948c4e24825c10b54040c95f P 93881c5b9b0648248e627ef7b541aec4 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:24:12.469710 17940 raft_consensus.cc:3060] T 75dc16ae948c4e24825c10b54040c95f P 93881c5b9b0648248e627ef7b541aec4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:24:12.472946 17761 catalog_manager.cc:5697] T 8d003b1fd939449988c9ae06955c3808 P f62ce053d68f4a868fa48f951d56da1a reported cstate change: term changed from 1 to 2, leader changed from 5b2c1cd5f367458e811c859b7dbca333 (127.5.126.67) to f62ce053d68f4a868fa48f951d56da1a (127.5.126.65). New cstate: current_term: 2 leader_uuid: "f62ce053d68f4a868fa48f951d56da1a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f62ce053d68f4a868fa48f951d56da1a" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 33029 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "93881c5b9b0648248e627ef7b541aec4" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 44419 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5b2c1cd5f367458e811c859b7dbca333" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 40055 } health_report { overall_health: UNKNOWN } } }
I20260709 13:24:12.473887 17939 raft_consensus.cc:2468] T d8c09480b6ed4e05bdb4abfd117fa378 P 93881c5b9b0648248e627ef7b541aec4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f62ce053d68f4a868fa48f951d56da1a in term 2.
I20260709 13:24:12.475173 18013 raft_consensus.cc:2468] T 8d003b1fd939449988c9ae06955c3808 P 5b2c1cd5f367458e811c859b7dbca333 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f62ce053d68f4a868fa48f951d56da1a in term 2.
I20260709 13:24:12.478299 17940 raft_consensus.cc:515] T 75dc16ae948c4e24825c10b54040c95f P 93881c5b9b0648248e627ef7b541aec4 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f62ce053d68f4a868fa48f951d56da1a" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 33029 } } peers { permanent_uuid: "93881c5b9b0648248e627ef7b541aec4" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 44419 } } peers { permanent_uuid: "5b2c1cd5f367458e811c859b7dbca333" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 40055 } }
I20260709 13:24:12.480281 17940 leader_election.cc:290] T 75dc16ae948c4e24825c10b54040c95f P 93881c5b9b0648248e627ef7b541aec4 [CANDIDATE]: Term 2 election: Requested vote from peers f62ce053d68f4a868fa48f951d56da1a (127.5.126.65:33029), 5b2c1cd5f367458e811c859b7dbca333 (127.5.126.67:40055)
I20260709 13:24:12.481366 17864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75dc16ae948c4e24825c10b54040c95f" candidate_uuid: "93881c5b9b0648248e627ef7b541aec4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f62ce053d68f4a868fa48f951d56da1a"
I20260709 13:24:12.481544 18013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75dc16ae948c4e24825c10b54040c95f" candidate_uuid: "93881c5b9b0648248e627ef7b541aec4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5b2c1cd5f367458e811c859b7dbca333"
I20260709 13:24:12.483268 17864 raft_consensus.cc:3060] T 75dc16ae948c4e24825c10b54040c95f P f62ce053d68f4a868fa48f951d56da1a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:24:12.483665 18013 raft_consensus.cc:3055] T 75dc16ae948c4e24825c10b54040c95f P 5b2c1cd5f367458e811c859b7dbca333 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:24:12.484009 18013 raft_consensus.cc:740] T 75dc16ae948c4e24825c10b54040c95f P 5b2c1cd5f367458e811c859b7dbca333 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5b2c1cd5f367458e811c859b7dbca333, State: Running, Role: LEADER
I20260709 13:24:12.484965 18013 consensus_queue.cc:260] T 75dc16ae948c4e24825c10b54040c95f P 5b2c1cd5f367458e811c859b7dbca333 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f62ce053d68f4a868fa48f951d56da1a" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 33029 } } peers { permanent_uuid: "93881c5b9b0648248e627ef7b541aec4" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 44419 } } peers { permanent_uuid: "5b2c1cd5f367458e811c859b7dbca333" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 40055 } }
I20260709 13:24:12.486282 18013 raft_consensus.cc:3060] T 75dc16ae948c4e24825c10b54040c95f P 5b2c1cd5f367458e811c859b7dbca333 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:24:12.489678 17761 catalog_manager.cc:5697] T d8c09480b6ed4e05bdb4abfd117fa378 P f62ce053d68f4a868fa48f951d56da1a reported cstate change: term changed from 1 to 2, leader changed from 93881c5b9b0648248e627ef7b541aec4 (127.5.126.66) to f62ce053d68f4a868fa48f951d56da1a (127.5.126.65). New cstate: current_term: 2 leader_uuid: "f62ce053d68f4a868fa48f951d56da1a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f62ce053d68f4a868fa48f951d56da1a" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 33029 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "93881c5b9b0648248e627ef7b541aec4" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 44419 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5b2c1cd5f367458e811c859b7dbca333" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 40055 } health_report { overall_health: UNKNOWN } } }
I20260709 13:24:12.491042 17864 raft_consensus.cc:2468] T 75dc16ae948c4e24825c10b54040c95f P f62ce053d68f4a868fa48f951d56da1a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 93881c5b9b0648248e627ef7b541aec4 in term 2.
I20260709 13:24:12.492990 17904 leader_election.cc:304] T 75dc16ae948c4e24825c10b54040c95f P 93881c5b9b0648248e627ef7b541aec4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 93881c5b9b0648248e627ef7b541aec4, f62ce053d68f4a868fa48f951d56da1a; no voters: 
I20260709 13:24:12.494179 18200 raft_consensus.cc:2804] T 75dc16ae948c4e24825c10b54040c95f P 93881c5b9b0648248e627ef7b541aec4 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:24:12.494781 18200 raft_consensus.cc:697] T 75dc16ae948c4e24825c10b54040c95f P 93881c5b9b0648248e627ef7b541aec4 [term 2 LEADER]: Becoming Leader. State: Replica: 93881c5b9b0648248e627ef7b541aec4, State: Running, Role: LEADER
I20260709 13:24:12.494928 18013 raft_consensus.cc:2468] T 75dc16ae948c4e24825c10b54040c95f P 5b2c1cd5f367458e811c859b7dbca333 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 93881c5b9b0648248e627ef7b541aec4 in term 2.
I20260709 13:24:12.495855 18200 consensus_queue.cc:237] T 75dc16ae948c4e24825c10b54040c95f P 93881c5b9b0648248e627ef7b541aec4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f62ce053d68f4a868fa48f951d56da1a" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 33029 } } peers { permanent_uuid: "93881c5b9b0648248e627ef7b541aec4" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 44419 } } peers { permanent_uuid: "5b2c1cd5f367458e811c859b7dbca333" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 40055 } }
I20260709 13:24:12.505398 17761 catalog_manager.cc:5697] T 75dc16ae948c4e24825c10b54040c95f P 93881c5b9b0648248e627ef7b541aec4 reported cstate change: term changed from 1 to 2, leader changed from 5b2c1cd5f367458e811c859b7dbca333 (127.5.126.67) to 93881c5b9b0648248e627ef7b541aec4 (127.5.126.66). New cstate: current_term: 2 leader_uuid: "93881c5b9b0648248e627ef7b541aec4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f62ce053d68f4a868fa48f951d56da1a" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 33029 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "93881c5b9b0648248e627ef7b541aec4" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 44419 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5b2c1cd5f367458e811c859b7dbca333" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 40055 } health_report { overall_health: UNKNOWN } } }
I20260709 13:24:12.604671 18142 raft_consensus.cc:993] T c8b2ba53ff454a39ae7982592bd75e99 P f62ce053d68f4a868fa48f951d56da1a: : Instructing follower 93881c5b9b0648248e627ef7b541aec4 to start an election
I20260709 13:24:12.605254 18142 raft_consensus.cc:1081] T c8b2ba53ff454a39ae7982592bd75e99 P f62ce053d68f4a868fa48f951d56da1a [term 1 LEADER]: Signalling peer 93881c5b9b0648248e627ef7b541aec4 to start an election
I20260709 13:24:12.606988 17940 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c8b2ba53ff454a39ae7982592bd75e99"
dest_uuid: "93881c5b9b0648248e627ef7b541aec4"
 from {username='slave'} at 127.0.0.1:34942
I20260709 13:24:12.607545 17940 raft_consensus.cc:493] T c8b2ba53ff454a39ae7982592bd75e99 P 93881c5b9b0648248e627ef7b541aec4 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:24:12.607913 17940 raft_consensus.cc:3060] T c8b2ba53ff454a39ae7982592bd75e99 P 93881c5b9b0648248e627ef7b541aec4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:24:12.614140 17940 raft_consensus.cc:515] T c8b2ba53ff454a39ae7982592bd75e99 P 93881c5b9b0648248e627ef7b541aec4 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f62ce053d68f4a868fa48f951d56da1a" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 33029 } } peers { permanent_uuid: "93881c5b9b0648248e627ef7b541aec4" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 44419 } } peers { permanent_uuid: "5b2c1cd5f367458e811c859b7dbca333" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 40055 } }
I20260709 13:24:12.615963 17940 leader_election.cc:290] T c8b2ba53ff454a39ae7982592bd75e99 P 93881c5b9b0648248e627ef7b541aec4 [CANDIDATE]: Term 2 election: Requested vote from peers f62ce053d68f4a868fa48f951d56da1a (127.5.126.65:33029), 5b2c1cd5f367458e811c859b7dbca333 (127.5.126.67:40055)
I20260709 13:24:12.616897 17864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8b2ba53ff454a39ae7982592bd75e99" candidate_uuid: "93881c5b9b0648248e627ef7b541aec4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f62ce053d68f4a868fa48f951d56da1a"
I20260709 13:24:12.617282 18013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8b2ba53ff454a39ae7982592bd75e99" candidate_uuid: "93881c5b9b0648248e627ef7b541aec4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5b2c1cd5f367458e811c859b7dbca333"
I20260709 13:24:12.617614 17864 raft_consensus.cc:3055] T c8b2ba53ff454a39ae7982592bd75e99 P f62ce053d68f4a868fa48f951d56da1a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:24:12.618093 17864 raft_consensus.cc:740] T c8b2ba53ff454a39ae7982592bd75e99 P f62ce053d68f4a868fa48f951d56da1a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f62ce053d68f4a868fa48f951d56da1a, State: Running, Role: LEADER
I20260709 13:24:12.618114 18013 raft_consensus.cc:3060] T c8b2ba53ff454a39ae7982592bd75e99 P 5b2c1cd5f367458e811c859b7dbca333 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:24:12.619051 17864 consensus_queue.cc:260] T c8b2ba53ff454a39ae7982592bd75e99 P f62ce053d68f4a868fa48f951d56da1a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f62ce053d68f4a868fa48f951d56da1a" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 33029 } } peers { permanent_uuid: "93881c5b9b0648248e627ef7b541aec4" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 44419 } } peers { permanent_uuid: "5b2c1cd5f367458e811c859b7dbca333" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 40055 } }
I20260709 13:24:12.620306 17864 raft_consensus.cc:3060] T c8b2ba53ff454a39ae7982592bd75e99 P f62ce053d68f4a868fa48f951d56da1a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:24:12.625437 18013 raft_consensus.cc:2468] T c8b2ba53ff454a39ae7982592bd75e99 P 5b2c1cd5f367458e811c859b7dbca333 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 93881c5b9b0648248e627ef7b541aec4 in term 2.
I20260709 13:24:12.625885 17864 raft_consensus.cc:2468] T c8b2ba53ff454a39ae7982592bd75e99 P f62ce053d68f4a868fa48f951d56da1a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 93881c5b9b0648248e627ef7b541aec4 in term 2.
I20260709 13:24:12.626889 17905 leader_election.cc:304] T c8b2ba53ff454a39ae7982592bd75e99 P 93881c5b9b0648248e627ef7b541aec4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b2c1cd5f367458e811c859b7dbca333, 93881c5b9b0648248e627ef7b541aec4; no voters: 
I20260709 13:24:12.627673 18200 raft_consensus.cc:2804] T c8b2ba53ff454a39ae7982592bd75e99 P 93881c5b9b0648248e627ef7b541aec4 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:24:12.628190 18200 raft_consensus.cc:697] T c8b2ba53ff454a39ae7982592bd75e99 P 93881c5b9b0648248e627ef7b541aec4 [term 2 LEADER]: Becoming Leader. State: Replica: 93881c5b9b0648248e627ef7b541aec4, State: Running, Role: LEADER
I20260709 13:24:12.628790 18200 consensus_queue.cc:237] T c8b2ba53ff454a39ae7982592bd75e99 P 93881c5b9b0648248e627ef7b541aec4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f62ce053d68f4a868fa48f951d56da1a" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 33029 } } peers { permanent_uuid: "93881c5b9b0648248e627ef7b541aec4" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 44419 } } peers { permanent_uuid: "5b2c1cd5f367458e811c859b7dbca333" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 40055 } }
I20260709 13:24:12.635799 17761 catalog_manager.cc:5697] T c8b2ba53ff454a39ae7982592bd75e99 P 93881c5b9b0648248e627ef7b541aec4 reported cstate change: term changed from 1 to 2, leader changed from f62ce053d68f4a868fa48f951d56da1a (127.5.126.65) to 93881c5b9b0648248e627ef7b541aec4 (127.5.126.66). New cstate: current_term: 2 leader_uuid: "93881c5b9b0648248e627ef7b541aec4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f62ce053d68f4a868fa48f951d56da1a" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 33029 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "93881c5b9b0648248e627ef7b541aec4" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 44419 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5b2c1cd5f367458e811c859b7dbca333" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 40055 } health_report { overall_health: UNKNOWN } } }
I20260709 13:24:12.673537 17940 raft_consensus.cc:1275] T 6112fc9278e94d05946790ffc15dc4f7 P 93881c5b9b0648248e627ef7b541aec4 [term 2 FOLLOWER]: Refusing update from remote peer f62ce053d68f4a868fa48f951d56da1a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:24:12.675123 18142 consensus_queue.cc:1048] T 6112fc9278e94d05946790ffc15dc4f7 P f62ce053d68f4a868fa48f951d56da1a [LEADER]: Connected to new peer: Peer: permanent_uuid: "93881c5b9b0648248e627ef7b541aec4" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 44419 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:24:12.684000 18013 raft_consensus.cc:1275] T 6112fc9278e94d05946790ffc15dc4f7 P 5b2c1cd5f367458e811c859b7dbca333 [term 2 FOLLOWER]: Refusing update from remote peer f62ce053d68f4a868fa48f951d56da1a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:24:12.686090 18142 consensus_queue.cc:1048] T 6112fc9278e94d05946790ffc15dc4f7 P f62ce053d68f4a868fa48f951d56da1a [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b2c1cd5f367458e811c859b7dbca333" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 40055 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:24:12.762375 18013 raft_consensus.cc:1275] T 8693a343b4d94180b276b5a728f21637 P 5b2c1cd5f367458e811c859b7dbca333 [term 2 FOLLOWER]: Refusing update from remote peer 93881c5b9b0648248e627ef7b541aec4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:24:12.764055 18200 consensus_queue.cc:1048] T 8693a343b4d94180b276b5a728f21637 P 93881c5b9b0648248e627ef7b541aec4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b2c1cd5f367458e811c859b7dbca333" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 40055 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:24:12.774024 17864 raft_consensus.cc:1275] T 8693a343b4d94180b276b5a728f21637 P f62ce053d68f4a868fa48f951d56da1a [term 2 FOLLOWER]: Refusing update from remote peer 93881c5b9b0648248e627ef7b541aec4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:24:12.776226 18230 consensus_queue.cc:1048] T 8693a343b4d94180b276b5a728f21637 P 93881c5b9b0648248e627ef7b541aec4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f62ce053d68f4a868fa48f951d56da1a" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 33029 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:24:12.946344 18013 raft_consensus.cc:1275] T 8d003b1fd939449988c9ae06955c3808 P 5b2c1cd5f367458e811c859b7dbca333 [term 2 FOLLOWER]: Refusing update from remote peer f62ce053d68f4a868fa48f951d56da1a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:24:12.948022 18142 consensus_queue.cc:1048] T 8d003b1fd939449988c9ae06955c3808 P f62ce053d68f4a868fa48f951d56da1a [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b2c1cd5f367458e811c859b7dbca333" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 40055 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:24:12.951493 18014 raft_consensus.cc:1275] T 75dc16ae948c4e24825c10b54040c95f P 5b2c1cd5f367458e811c859b7dbca333 [term 2 FOLLOWER]: Refusing update from remote peer 93881c5b9b0648248e627ef7b541aec4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:24:12.953377 18230 consensus_queue.cc:1048] T 75dc16ae948c4e24825c10b54040c95f P 93881c5b9b0648248e627ef7b541aec4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b2c1cd5f367458e811c859b7dbca333" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 40055 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:24:12.959496 17940 raft_consensus.cc:1275] T 8d003b1fd939449988c9ae06955c3808 P 93881c5b9b0648248e627ef7b541aec4 [term 2 FOLLOWER]: Refusing update from remote peer f62ce053d68f4a868fa48f951d56da1a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:24:12.961517 18142 consensus_queue.cc:1048] T 8d003b1fd939449988c9ae06955c3808 P f62ce053d68f4a868fa48f951d56da1a [LEADER]: Connected to new peer: Peer: permanent_uuid: "93881c5b9b0648248e627ef7b541aec4" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 44419 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.003s
I20260709 13:24:12.965818 17864 raft_consensus.cc:1275] T 75dc16ae948c4e24825c10b54040c95f P f62ce053d68f4a868fa48f951d56da1a [term 2 FOLLOWER]: Refusing update from remote peer 93881c5b9b0648248e627ef7b541aec4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:24:12.972046 18137 consensus_queue.cc:1048] T 75dc16ae948c4e24825c10b54040c95f P 93881c5b9b0648248e627ef7b541aec4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f62ce053d68f4a868fa48f951d56da1a" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 33029 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:24:13.051016 17866 raft_consensus.cc:1275] T c8b2ba53ff454a39ae7982592bd75e99 P f62ce053d68f4a868fa48f951d56da1a [term 2 FOLLOWER]: Refusing update from remote peer 93881c5b9b0648248e627ef7b541aec4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:24:13.052829 18230 consensus_queue.cc:1048] T c8b2ba53ff454a39ae7982592bd75e99 P 93881c5b9b0648248e627ef7b541aec4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f62ce053d68f4a868fa48f951d56da1a" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 33029 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:24:13.062980 18013 raft_consensus.cc:1275] T c8b2ba53ff454a39ae7982592bd75e99 P 5b2c1cd5f367458e811c859b7dbca333 [term 2 FOLLOWER]: Refusing update from remote peer 93881c5b9b0648248e627ef7b541aec4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:24:13.065721 18230 consensus_queue.cc:1048] T c8b2ba53ff454a39ae7982592bd75e99 P 93881c5b9b0648248e627ef7b541aec4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b2c1cd5f367458e811c859b7dbca333" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 40055 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:24:13.078647 17939 raft_consensus.cc:1275] T d8c09480b6ed4e05bdb4abfd117fa378 P 93881c5b9b0648248e627ef7b541aec4 [term 2 FOLLOWER]: Refusing update from remote peer f62ce053d68f4a868fa48f951d56da1a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:24:13.080005 18142 consensus_queue.cc:1048] T d8c09480b6ed4e05bdb4abfd117fa378 P f62ce053d68f4a868fa48f951d56da1a [LEADER]: Connected to new peer: Peer: permanent_uuid: "93881c5b9b0648248e627ef7b541aec4" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 44419 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:24:13.086712 18014 raft_consensus.cc:1275] T d8c09480b6ed4e05bdb4abfd117fa378 P 5b2c1cd5f367458e811c859b7dbca333 [term 2 FOLLOWER]: Refusing update from remote peer f62ce053d68f4a868fa48f951d56da1a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:24:13.088441 18175 consensus_queue.cc:1048] T d8c09480b6ed4e05bdb4abfd117fa378 P f62ce053d68f4a868fa48f951d56da1a [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b2c1cd5f367458e811c859b7dbca333" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 40055 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:24:15.194298 17761 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:47206:
table { table_name: "soft_deleted_table" } modify_external_catalogs: true reserve_seconds: 3600
I20260709 13:24:15.216223 17761 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:47206:
table { table_name: "soft_deleted_table" } new_extra_configs { key: "kudu.table.disable_compaction" value: "true" }
I20260709 13:24:15.276624  5625 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:24:15.401144 18263 log.cc:927] Time spent T ebc6959597f54d94ac7459f922a62871 P 5b2c1cd5f367458e811c859b7dbca333: Append to log took a long time: real 0.052s	user 0.001s	sys 0.000s
I20260709 13:24:15.503237 17866 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "274de930fd3e48b0a4a446dfeedcff85"
dest_uuid: "f62ce053d68f4a868fa48f951d56da1a"
mode: GRACEFUL
new_leader_uuid: "5b2c1cd5f367458e811c859b7dbca333"
 from {username='slave'} at 127.0.0.1:59550
W20260709 13:24:15.500137 18273 log.cc:927] Time spent T 6112fc9278e94d05946790ffc15dc4f7 P 93881c5b9b0648248e627ef7b541aec4: Append to log took a long time: real 0.060s	user 0.004s	sys 0.000s
I20260709 13:24:15.508774 17866 raft_consensus.cc:606] T 274de930fd3e48b0a4a446dfeedcff85 P f62ce053d68f4a868fa48f951d56da1a [term 1 LEADER]: Received request to transfer leadership to TS 5b2c1cd5f367458e811c859b7dbca333
W20260709 13:24:15.528204 18270 log.cc:927] Time spent T 910689bc7c56485d8063b2ca5f4d4c17 P 93881c5b9b0648248e627ef7b541aec4: Append to log took a long time: real 0.087s	user 0.000s	sys 0.003s
W20260709 13:24:15.538496 17830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.67:40055, user_credentials={real_user=slave}} blocked reactor thread for 52797.1us
W20260709 13:24:15.544193 18283 log.cc:927] Time spent T ebc6959597f54d94ac7459f922a62871 P 93881c5b9b0648248e627ef7b541aec4: Append to log took a long time: real 0.053s	user 0.003s	sys 0.000s
I20260709 13:24:15.555667 18286 tablet.cc:1724] T 910689bc7c56485d8063b2ca5f4d4c17 P f62ce053d68f4a868fa48f951d56da1a: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 13:24:15.573165 17905 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.126.67:40055, user_credentials={real_user=slave}} blocked reactor thread for 47751.6us
W20260709 13:24:15.618614 18287 log.cc:927] Time spent T d8c09480b6ed4e05bdb4abfd117fa378 P 93881c5b9b0648248e627ef7b541aec4: Append to log took a long time: real 0.058s	user 0.001s	sys 0.000s
I20260709 13:24:15.583374 18285 tablet.cc:1724] T 6112fc9278e94d05946790ffc15dc4f7 P f62ce053d68f4a868fa48f951d56da1a: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:24:15.636206 18299 tablet.cc:1724] T 6112fc9278e94d05946790ffc15dc4f7 P 5b2c1cd5f367458e811c859b7dbca333: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:24:15.620834 18296 tablet.cc:1724] T ebc6959597f54d94ac7459f922a62871 P 93881c5b9b0648248e627ef7b541aec4: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 13:24:15.632298 18288 log.cc:927] Time spent T 8d003b1fd939449988c9ae06955c3808 P 5b2c1cd5f367458e811c859b7dbca333: Append to log took a long time: real 0.060s	user 0.000s	sys 0.001s
W20260709 13:24:15.650127 18282 log.cc:927] Time spent T 8d003b1fd939449988c9ae06955c3808 P 93881c5b9b0648248e627ef7b541aec4: Append to log took a long time: real 0.125s	user 0.005s	sys 0.000s
I20260709 13:24:15.666664 18297 tablet.cc:1724] T 910689bc7c56485d8063b2ca5f4d4c17 P 5b2c1cd5f367458e811c859b7dbca333: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:24:15.604528 18294 tablet.cc:1724] T ebc6959597f54d94ac7459f922a62871 P 5b2c1cd5f367458e811c859b7dbca333: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:24:15.701555 18271 raft_consensus.cc:993] T 274de930fd3e48b0a4a446dfeedcff85 P f62ce053d68f4a868fa48f951d56da1a: : Instructing follower 5b2c1cd5f367458e811c859b7dbca333 to start an election
I20260709 13:24:15.702221 18271 raft_consensus.cc:1081] T 274de930fd3e48b0a4a446dfeedcff85 P f62ce053d68f4a868fa48f951d56da1a [term 1 LEADER]: Signalling peer 5b2c1cd5f367458e811c859b7dbca333 to start an election
W20260709 13:24:15.711455 18295 log.cc:927] Time spent T d8c09480b6ed4e05bdb4abfd117fa378 P 5b2c1cd5f367458e811c859b7dbca333: Append to log took a long time: real 0.054s	user 0.000s	sys 0.001s
I20260709 13:24:15.724282 18015 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "274de930fd3e48b0a4a446dfeedcff85"
dest_uuid: "5b2c1cd5f367458e811c859b7dbca333"
 from {username='slave'} at 127.0.0.1:59792
I20260709 13:24:15.725128 18015 raft_consensus.cc:493] T 274de930fd3e48b0a4a446dfeedcff85 P 5b2c1cd5f367458e811c859b7dbca333 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:24:15.725605 18015 raft_consensus.cc:3060] T 274de930fd3e48b0a4a446dfeedcff85 P 5b2c1cd5f367458e811c859b7dbca333 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:24:15.726704 18301 log.cc:927] Time spent T 6fa73bbd59654140adb36ac550bf0140 P f62ce053d68f4a868fa48f951d56da1a: Append to log took a long time: real 0.068s	user 0.001s	sys 0.000s
I20260709 13:24:15.724113 18302 tablet.cc:1724] T ebc6959597f54d94ac7459f922a62871 P f62ce053d68f4a868fa48f951d56da1a: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:24:15.751956 18299 tablet.cc:1724] T 8d003b1fd939449988c9ae06955c3808 P 5b2c1cd5f367458e811c859b7dbca333: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:24:15.757931 18286 tablet.cc:1724] T 8693a343b4d94180b276b5a728f21637 P f62ce053d68f4a868fa48f951d56da1a: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:24:15.762151 18305 tablet.cc:1724] T c8b2ba53ff454a39ae7982592bd75e99 P 93881c5b9b0648248e627ef7b541aec4: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:24:15.764462 18285 tablet.cc:1724] T 8d003b1fd939449988c9ae06955c3808 P f62ce053d68f4a868fa48f951d56da1a: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:24:15.711386 18296 tablet.cc:1724] T 8693a343b4d94180b276b5a728f21637 P 93881c5b9b0648248e627ef7b541aec4: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:24:15.776912 18294 tablet.cc:1724] T d8c09480b6ed4e05bdb4abfd117fa378 P 5b2c1cd5f367458e811c859b7dbca333: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:24:15.797016 18302 tablet.cc:1724] T d8c09480b6ed4e05bdb4abfd117fa378 P f62ce053d68f4a868fa48f951d56da1a: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:24:15.821391 17941 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "98bdadc834134483b31be48f35123bbd"
dest_uuid: "93881c5b9b0648248e627ef7b541aec4"
mode: GRACEFUL
new_leader_uuid: "5b2c1cd5f367458e811c859b7dbca333"
 from {username='slave'} at 127.0.0.1:57614
I20260709 13:24:15.814548 18015 raft_consensus.cc:515] T 274de930fd3e48b0a4a446dfeedcff85 P 5b2c1cd5f367458e811c859b7dbca333 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f62ce053d68f4a868fa48f951d56da1a" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 33029 } } peers { permanent_uuid: "93881c5b9b0648248e627ef7b541aec4" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 44419 } } peers { permanent_uuid: "5b2c1cd5f367458e811c859b7dbca333" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 40055 } }
I20260709 13:24:15.828909 17941 raft_consensus.cc:606] T 98bdadc834134483b31be48f35123bbd P 93881c5b9b0648248e627ef7b541aec4 [term 2 LEADER]: Received request to transfer leadership to TS 5b2c1cd5f367458e811c859b7dbca333
I20260709 13:24:15.839532 18307 tablet.cc:1724] T 75dc16ae948c4e24825c10b54040c95f P 93881c5b9b0648248e627ef7b541aec4: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:24:15.839128 18309 tablet.cc:1724] T 75dc16ae948c4e24825c10b54040c95f P f62ce053d68f4a868fa48f951d56da1a: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:24:15.850925 17866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "274de930fd3e48b0a4a446dfeedcff85" candidate_uuid: "5b2c1cd5f367458e811c859b7dbca333" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f62ce053d68f4a868fa48f951d56da1a"
I20260709 13:24:15.851936 17866 raft_consensus.cc:3055] T 274de930fd3e48b0a4a446dfeedcff85 P f62ce053d68f4a868fa48f951d56da1a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:24:15.857669 18299 tablet.cc:1724] T 75dc16ae948c4e24825c10b54040c95f P 5b2c1cd5f367458e811c859b7dbca333: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:24:15.830114 18294 tablet.cc:1724] T 8693a343b4d94180b276b5a728f21637 P 5b2c1cd5f367458e811c859b7dbca333: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:24:15.863216  5625 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:24:15.864271  5625 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:24:15.852428 17866 raft_consensus.cc:740] T 274de930fd3e48b0a4a446dfeedcff85 P f62ce053d68f4a868fa48f951d56da1a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f62ce053d68f4a868fa48f951d56da1a, State: Running, Role: LEADER
I20260709 13:24:15.865635 18297 tablet.cc:1724] T c8b2ba53ff454a39ae7982592bd75e99 P 5b2c1cd5f367458e811c859b7dbca333: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:24:15.865921 17866 consensus_queue.cc:260] T 274de930fd3e48b0a4a446dfeedcff85 P f62ce053d68f4a868fa48f951d56da1a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f62ce053d68f4a868fa48f951d56da1a" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 33029 } } peers { permanent_uuid: "93881c5b9b0648248e627ef7b541aec4" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 44419 } } peers { permanent_uuid: "5b2c1cd5f367458e811c859b7dbca333" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 40055 } }
I20260709 13:24:15.869875 18310 tablet.cc:1724] T 6fa73bbd59654140adb36ac550bf0140 P 93881c5b9b0648248e627ef7b541aec4: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:24:15.878559 18285 tablet.cc:1724] T c8b2ba53ff454a39ae7982592bd75e99 P f62ce053d68f4a868fa48f951d56da1a: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:24:15.903378 17941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "274de930fd3e48b0a4a446dfeedcff85" candidate_uuid: "5b2c1cd5f367458e811c859b7dbca333" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "93881c5b9b0648248e627ef7b541aec4"
I20260709 13:24:15.904188 17941 raft_consensus.cc:3060] T 274de930fd3e48b0a4a446dfeedcff85 P 93881c5b9b0648248e627ef7b541aec4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:24:15.888373 18015 leader_election.cc:290] T 274de930fd3e48b0a4a446dfeedcff85 P 5b2c1cd5f367458e811c859b7dbca333 [CANDIDATE]: Term 2 election: Requested vote from peers f62ce053d68f4a868fa48f951d56da1a (127.5.126.65:33029), 93881c5b9b0648248e627ef7b541aec4 (127.5.126.66:44419)
I20260709 13:24:15.907336 18274 raft_consensus.cc:993] T 98bdadc834134483b31be48f35123bbd P 93881c5b9b0648248e627ef7b541aec4: : Instructing follower 5b2c1cd5f367458e811c859b7dbca333 to start an election
I20260709 13:24:15.907996 18274 raft_consensus.cc:1081] T 98bdadc834134483b31be48f35123bbd P 93881c5b9b0648248e627ef7b541aec4 [term 2 LEADER]: Signalling peer 5b2c1cd5f367458e811c859b7dbca333 to start an election
I20260709 13:24:15.916290 18015 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "98bdadc834134483b31be48f35123bbd"
dest_uuid: "5b2c1cd5f367458e811c859b7dbca333"
 from {username='slave'} at 127.0.0.1:59802
I20260709 13:24:15.917418 18015 raft_consensus.cc:493] T 98bdadc834134483b31be48f35123bbd P 5b2c1cd5f367458e811c859b7dbca333 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:24:15.918133 18015 raft_consensus.cc:3060] T 98bdadc834134483b31be48f35123bbd P 5b2c1cd5f367458e811c859b7dbca333 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:24:15.896551 17866 raft_consensus.cc:3060] T 274de930fd3e48b0a4a446dfeedcff85 P f62ce053d68f4a868fa48f951d56da1a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:24:15.939527 18310 tablet.cc:1724] T 910689bc7c56485d8063b2ca5f4d4c17 P 93881c5b9b0648248e627ef7b541aec4: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:24:15.946990 18307 tablet.cc:1724] T 6112fc9278e94d05946790ffc15dc4f7 P 93881c5b9b0648248e627ef7b541aec4: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:24:15.952373 18305 tablet.cc:1724] T d8c09480b6ed4e05bdb4abfd117fa378 P 93881c5b9b0648248e627ef7b541aec4: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:24:15.958998 18313 tablet.cc:1724] T 6fa73bbd59654140adb36ac550bf0140 P 5b2c1cd5f367458e811c859b7dbca333: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:24:15.963059 18015 raft_consensus.cc:515] T 98bdadc834134483b31be48f35123bbd P 5b2c1cd5f367458e811c859b7dbca333 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f62ce053d68f4a868fa48f951d56da1a" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 33029 } } peers { permanent_uuid: "93881c5b9b0648248e627ef7b541aec4" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 44419 } } peers { permanent_uuid: "5b2c1cd5f367458e811c859b7dbca333" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 40055 } }
I20260709 13:24:15.970417 18310 tablet.cc:1724] T 8d003b1fd939449988c9ae06955c3808 P 93881c5b9b0648248e627ef7b541aec4: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:24:15.997141 18015 leader_election.cc:290] T 98bdadc834134483b31be48f35123bbd P 5b2c1cd5f367458e811c859b7dbca333 [CANDIDATE]: Term 3 election: Requested vote from peers f62ce053d68f4a868fa48f951d56da1a (127.5.126.65:33029), 93881c5b9b0648248e627ef7b541aec4 (127.5.126.66:44419)
I20260709 13:24:15.979027 17866 raft_consensus.cc:2468] T 274de930fd3e48b0a4a446dfeedcff85 P f62ce053d68f4a868fa48f951d56da1a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5b2c1cd5f367458e811c859b7dbca333 in term 2.
I20260709 13:24:15.991776 17941 raft_consensus.cc:2468] T 274de930fd3e48b0a4a446dfeedcff85 P 93881c5b9b0648248e627ef7b541aec4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5b2c1cd5f367458e811c859b7dbca333 in term 2.
I20260709 13:24:16.002615 17862 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98bdadc834134483b31be48f35123bbd" candidate_uuid: "5b2c1cd5f367458e811c859b7dbca333" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "f62ce053d68f4a868fa48f951d56da1a"
I20260709 13:24:16.006961 17937 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98bdadc834134483b31be48f35123bbd" candidate_uuid: "5b2c1cd5f367458e811c859b7dbca333" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "93881c5b9b0648248e627ef7b541aec4"
I20260709 13:24:16.006212 18286 tablet.cc:1724] T 6fa73bbd59654140adb36ac550bf0140 P f62ce053d68f4a868fa48f951d56da1a: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:24:16.010401 17937 raft_consensus.cc:3055] T 98bdadc834134483b31be48f35123bbd P 93881c5b9b0648248e627ef7b541aec4 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:24:16.007990 17862 raft_consensus.cc:3060] T 98bdadc834134483b31be48f35123bbd P f62ce053d68f4a868fa48f951d56da1a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:24:16.011255 17937 raft_consensus.cc:740] T 98bdadc834134483b31be48f35123bbd P 93881c5b9b0648248e627ef7b541aec4 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 93881c5b9b0648248e627ef7b541aec4, State: Running, Role: LEADER
I20260709 13:24:16.014030 17937 consensus_queue.cc:260] T 98bdadc834134483b31be48f35123bbd P 93881c5b9b0648248e627ef7b541aec4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f62ce053d68f4a868fa48f951d56da1a" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 33029 } } peers { permanent_uuid: "93881c5b9b0648248e627ef7b541aec4" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 44419 } } peers { permanent_uuid: "5b2c1cd5f367458e811c859b7dbca333" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 40055 } }
I20260709 13:24:16.011945 17978 leader_election.cc:304] T 274de930fd3e48b0a4a446dfeedcff85 P 5b2c1cd5f367458e811c859b7dbca333 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b2c1cd5f367458e811c859b7dbca333, f62ce053d68f4a868fa48f951d56da1a; no voters: 
I20260709 13:24:16.020898 18265 raft_consensus.cc:2804] T 274de930fd3e48b0a4a446dfeedcff85 P 5b2c1cd5f367458e811c859b7dbca333 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:24:16.021581 18265 raft_consensus.cc:697] T 274de930fd3e48b0a4a446dfeedcff85 P 5b2c1cd5f367458e811c859b7dbca333 [term 2 LEADER]: Becoming Leader. State: Replica: 5b2c1cd5f367458e811c859b7dbca333, State: Running, Role: LEADER
I20260709 13:24:16.022609 18265 consensus_queue.cc:237] T 274de930fd3e48b0a4a446dfeedcff85 P 5b2c1cd5f367458e811c859b7dbca333 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f62ce053d68f4a868fa48f951d56da1a" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 33029 } } peers { permanent_uuid: "93881c5b9b0648248e627ef7b541aec4" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 44419 } } peers { permanent_uuid: "5b2c1cd5f367458e811c859b7dbca333" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 40055 } }
I20260709 13:24:16.028769 17937 raft_consensus.cc:3060] T 98bdadc834134483b31be48f35123bbd P 93881c5b9b0648248e627ef7b541aec4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:24:16.042186 17937 raft_consensus.cc:2468] T 98bdadc834134483b31be48f35123bbd P 93881c5b9b0648248e627ef7b541aec4 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5b2c1cd5f367458e811c859b7dbca333 in term 3.
I20260709 13:24:16.044883 17979 leader_election.cc:304] T 98bdadc834134483b31be48f35123bbd P 5b2c1cd5f367458e811c859b7dbca333 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b2c1cd5f367458e811c859b7dbca333, 93881c5b9b0648248e627ef7b541aec4; no voters: 
I20260709 13:24:16.046499 18190 raft_consensus.cc:2804] T 98bdadc834134483b31be48f35123bbd P 5b2c1cd5f367458e811c859b7dbca333 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:24:16.050490 18190 raft_consensus.cc:697] T 98bdadc834134483b31be48f35123bbd P 5b2c1cd5f367458e811c859b7dbca333 [term 3 LEADER]: Becoming Leader. State: Replica: 5b2c1cd5f367458e811c859b7dbca333, State: Running, Role: LEADER
I20260709 13:24:16.053297 18190 consensus_queue.cc:237] T 98bdadc834134483b31be48f35123bbd P 5b2c1cd5f367458e811c859b7dbca333 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f62ce053d68f4a868fa48f951d56da1a" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 33029 } } peers { permanent_uuid: "93881c5b9b0648248e627ef7b541aec4" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 44419 } } peers { permanent_uuid: "5b2c1cd5f367458e811c859b7dbca333" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 40055 } }
I20260709 13:24:16.054425 17862 raft_consensus.cc:2468] T 98bdadc834134483b31be48f35123bbd P f62ce053d68f4a868fa48f951d56da1a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5b2c1cd5f367458e811c859b7dbca333 in term 3.
I20260709 13:24:16.068066 17762 catalog_manager.cc:6242] T 00000000000000000000000000000000 P 8a2a317ebbd54be296802fc5b6fc3db4: soft_deleted_table [id=89ae5f51649843699d471e253d1837e9] alter complete (version 1)
I20260709 13:24:16.078368 17762 catalog_manager.cc:5697] T 274de930fd3e48b0a4a446dfeedcff85 P 5b2c1cd5f367458e811c859b7dbca333 reported cstate change: term changed from 1 to 2, leader changed from f62ce053d68f4a868fa48f951d56da1a (127.5.126.65) to 5b2c1cd5f367458e811c859b7dbca333 (127.5.126.67). New cstate: current_term: 2 leader_uuid: "5b2c1cd5f367458e811c859b7dbca333" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f62ce053d68f4a868fa48f951d56da1a" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 33029 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "93881c5b9b0648248e627ef7b541aec4" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 44419 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5b2c1cd5f367458e811c859b7dbca333" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 40055 } health_report { overall_health: HEALTHY } } }
I20260709 13:24:16.079819 17762 catalog_manager.cc:5697] T 98bdadc834134483b31be48f35123bbd P 5b2c1cd5f367458e811c859b7dbca333 reported cstate change: term changed from 2 to 3, leader changed from 93881c5b9b0648248e627ef7b541aec4 (127.5.126.66) to 5b2c1cd5f367458e811c859b7dbca333 (127.5.126.67). New cstate: current_term: 3 leader_uuid: "5b2c1cd5f367458e811c859b7dbca333" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f62ce053d68f4a868fa48f951d56da1a" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 33029 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "93881c5b9b0648248e627ef7b541aec4" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 44419 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5b2c1cd5f367458e811c859b7dbca333" member_type: VOTER last_known_addr { host: "127.5.126.67" port: 40055 } health_report { overall_health: HEALTHY } } }
I20260709 13:24:16.486299 17941 raft_consensus.cc:1275] T 274de930fd3e48b0a4a446dfeedcff85 P 93881c5b9b0648248e627ef7b541aec4 [term 2 FOLLOWER]: Refusing update from remote peer 5b2c1cd5f367458e811c859b7dbca333: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:24:16.488001 18190 consensus_queue.cc:1048] T 274de930fd3e48b0a4a446dfeedcff85 P 5b2c1cd5f367458e811c859b7dbca333 [LEADER]: Connected to new peer: Peer: permanent_uuid: "93881c5b9b0648248e627ef7b541aec4" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 44419 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:24:16.500451 17866 raft_consensus.cc:1275] T 274de930fd3e48b0a4a446dfeedcff85 P f62ce053d68f4a868fa48f951d56da1a [term 2 FOLLOWER]: Refusing update from remote peer 5b2c1cd5f367458e811c859b7dbca333: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:24:16.502728 18190 consensus_queue.cc:1048] T 274de930fd3e48b0a4a446dfeedcff85 P 5b2c1cd5f367458e811c859b7dbca333 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f62ce053d68f4a868fa48f951d56da1a" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 33029 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:24:16.510352 17941 raft_consensus.cc:1275] T 98bdadc834134483b31be48f35123bbd P 93881c5b9b0648248e627ef7b541aec4 [term 3 FOLLOWER]: Refusing update from remote peer 5b2c1cd5f367458e811c859b7dbca333: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:24:16.512465 18190 consensus_queue.cc:1048] T 98bdadc834134483b31be48f35123bbd P 5b2c1cd5f367458e811c859b7dbca333 [LEADER]: Connected to new peer: Peer: permanent_uuid: "93881c5b9b0648248e627ef7b541aec4" member_type: VOTER last_known_addr { host: "127.5.126.66" port: 44419 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:24:16.529223 17866 raft_consensus.cc:1275] T 98bdadc834134483b31be48f35123bbd P f62ce053d68f4a868fa48f951d56da1a [term 3 FOLLOWER]: Refusing update from remote peer 5b2c1cd5f367458e811c859b7dbca333: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:24:16.531165 18317 consensus_queue.cc:1048] T 98bdadc834134483b31be48f35123bbd P 5b2c1cd5f367458e811c859b7dbca333 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f62ce053d68f4a868fa48f951d56da1a" member_type: VOTER last_known_addr { host: "127.5.126.65" port: 33029 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:24:16.955442  5625 tablet_server.cc:179] TabletServer@127.5.126.65:0 shutting down...
W20260709 13:24:16.973968 17978 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 14 similar messages]
W20260709 13:24:16.979771 17978 consensus_peers.cc:597] T 274de930fd3e48b0a4a446dfeedcff85 P 5b2c1cd5f367458e811c859b7dbca333 -> Peer f62ce053d68f4a868fa48f951d56da1a (127.5.126.65:33029): Couldn't send request to peer f62ce053d68f4a868fa48f951d56da1a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:24:16.997828 17978 consensus_peers.cc:597] T 93f7e8af061940dd82364fa3c6e69825 P 5b2c1cd5f367458e811c859b7dbca333 -> Peer f62ce053d68f4a868fa48f951d56da1a (127.5.126.65:33029): Couldn't send request to peer f62ce053d68f4a868fa48f951d56da1a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:24:17.008699  5625 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:24:17.009806  5625 tablet_replica.cc:333] T 75dc16ae948c4e24825c10b54040c95f P f62ce053d68f4a868fa48f951d56da1a: stopping tablet replica
I20260709 13:24:17.010944  5625 raft_consensus.cc:2243] T 75dc16ae948c4e24825c10b54040c95f P f62ce053d68f4a868fa48f951d56da1a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:24:17.011631  5625 raft_consensus.cc:2272] T 75dc16ae948c4e24825c10b54040c95f P f62ce053d68f4a868fa48f951d56da1a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:24:17.015151  5625 tablet_replica.cc:333] T d8c09480b6ed4e05bdb4abfd117fa378 P f62ce053d68f4a868fa48f951d56da1a: stopping tablet replica
I20260709 13:24:17.015847  5625 raft_consensus.cc:2243] T d8c09480b6ed4e05bdb4abfd117fa378 P f62ce053d68f4a868fa48f951d56da1a [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:24:17.016810  5625 raft_consensus.cc:2272] T d8c09480b6ed4e05bdb4abfd117fa378 P f62ce053d68f4a868fa48f951d56da1a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:24:17.019181  5625 tablet_replica.cc:333] T c8b2ba53ff454a39ae7982592bd75e99 P f62ce053d68f4a868fa48f951d56da1a: stopping tablet replica
I20260709 13:24:17.019788  5625 raft_consensus.cc:2243] T c8b2ba53ff454a39ae7982592bd75e99 P f62ce053d68f4a868fa48f951d56da1a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:24:17.020339  5625 raft_consensus.cc:2272] T c8b2ba53ff454a39ae7982592bd75e99 P f62ce053d68f4a868fa48f951d56da1a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:24:17.022369  5625 tablet_replica.cc:333] T 8d003b1fd939449988c9ae06955c3808 P f62ce053d68f4a868fa48f951d56da1a: stopping tablet replica
I20260709 13:24:17.023030  5625 raft_consensus.cc:2243] T 8d003b1fd939449988c9ae06955c3808 P f62ce053d68f4a868fa48f951d56da1a [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:24:17.023950  5625 raft_consensus.cc:2272] T 8d003b1fd939449988c9ae06955c3808 P f62ce053d68f4a868fa48f951d56da1a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:24:17.026154  5625 tablet_replica.cc:333] T d3bd24e790d3483185e9f89c8521831b P f62ce053d68f4a868fa48f951d56da1a: stopping tablet replica
I20260709 13:24:17.027043  5625 raft_consensus.cc:2243] T d3bd24e790d3483185e9f89c8521831b P f62ce053d68f4a868fa48f951d56da1a [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:24:17.028373  5625 raft_consensus.cc:2272] T d3bd24e790d3483185e9f89c8521831b P f62ce053d68f4a868fa48f951d56da1a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:24:17.031500  5625 tablet_replica.cc:333] T 93f7e8af061940dd82364fa3c6e69825 P f62ce053d68f4a868fa48f951d56da1a: stopping tablet replica
I20260709 13:24:17.032150  5625 raft_consensus.cc:2243] T 93f7e8af061940dd82364fa3c6e69825 P f62ce053d68f4a868fa48f951d56da1a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:24:17.032634  5625 raft_consensus.cc:2272] T 93f7e8af061940dd82364fa3c6e69825 P f62ce053d68f4a868fa48f951d56da1a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:24:17.034929  5625 tablet_replica.cc:333] T 98bdadc834134483b31be48f35123bbd P f62ce053d68f4a868fa48f951d56da1a: stopping tablet replica
I20260709 13:24:17.035589  5625 raft_consensus.cc:2243] T 98bdadc834134483b31be48f35123bbd P f62ce053d68f4a868fa48f951d56da1a [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:24:17.036310  5625 raft_consensus.cc:2272] T 98bdadc834134483b31be48f35123bbd P f62ce053d68f4a868fa48f951d56da1a [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:24:17.040237  5625 tablet_replica.cc:333] T ebc6959597f54d94ac7459f922a62871 P f62ce053d68f4a868fa48f951d56da1a: stopping tablet replica
I20260709 13:24:17.040917  5625 raft_consensus.cc:2243] T ebc6959597f54d94ac7459f922a62871 P f62ce053d68f4a868fa48f951d56da1a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:24:17.041419  5625 raft_consensus.cc:2272] T ebc6959597f54d94ac7459f922a62871 P f62ce053d68f4a868fa48f951d56da1a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:24:17.043385  5625 tablet_replica.cc:333] T 910689bc7c56485d8063b2ca5f4d4c17 P f62ce053d68f4a868fa48f951d56da1a: stopping tablet replica
I20260709 13:24:17.044093  5625 raft_consensus.cc:2243] T 910689bc7c56485d8063b2ca5f4d4c17 P f62ce053d68f4a868fa48f951d56da1a [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:24:17.044888  5625 raft_consensus.cc:2272] T 910689bc7c56485d8063b2ca5f4d4c17 P f62ce053d68f4a868fa48f951d56da1a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:24:17.046904  5625 tablet_replica.cc:333] T 6fa73bbd59654140adb36ac550bf0140 P f62ce053d68f4a868fa48f951d56da1a: stopping tablet replica
I20260709 13:24:17.047508  5625 raft_consensus.cc:2243] T 6fa73bbd59654140adb36ac550bf0140 P f62ce053d68f4a868fa48f951d56da1a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:24:17.047956  5625 raft_consensus.cc:2272] T 6fa73bbd59654140adb36ac550bf0140 P f62ce053d68f4a868fa48f951d56da1a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:24:17.050467  5625 tablet_replica.cc:333] T b8a4f81761e3423fa8d2e3144b6b4ca8 P f62ce053d68f4a868fa48f951d56da1a: stopping tablet replica
I20260709 13:24:17.051059  5625 raft_consensus.cc:2243] T b8a4f81761e3423fa8d2e3144b6b4ca8 P f62ce053d68f4a868fa48f951d56da1a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:24:17.051555  5625 raft_consensus.cc:2272] T b8a4f81761e3423fa8d2e3144b6b4ca8 P f62ce053d68f4a868fa48f951d56da1a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:24:17.053583  5625 tablet_replica.cc:333] T 274de930fd3e48b0a4a446dfeedcff85 P f62ce053d68f4a868fa48f951d56da1a: stopping tablet replica
I20260709 13:24:17.054106  5625 raft_consensus.cc:2243] T 274de930fd3e48b0a4a446dfeedcff85 P f62ce053d68f4a868fa48f951d56da1a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:24:17.054526  5625 raft_consensus.cc:2272] T 274de930fd3e48b0a4a446dfeedcff85 P f62ce053d68f4a868fa48f951d56da1a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:24:17.057266  5625 tablet_replica.cc:333] T e472f595f87a4a749248c7b7812b33d0 P f62ce053d68f4a868fa48f951d56da1a: stopping tablet replica
I20260709 13:24:17.057812  5625 raft_consensus.cc:2243] T e472f595f87a4a749248c7b7812b33d0 P f62ce053d68f4a868fa48f951d56da1a [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:24:17.058609  5625 raft_consensus.cc:2272] T e472f595f87a4a749248c7b7812b33d0 P f62ce053d68f4a868fa48f951d56da1a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:24:17.060809  5625 tablet_replica.cc:333] T 66404f05eae74a7f938e85e5eae5cf72 P f62ce053d68f4a868fa48f951d56da1a: stopping tablet replica
I20260709 13:24:17.061295  5625 raft_consensus.cc:2243] T 66404f05eae74a7f938e85e5eae5cf72 P f62ce053d68f4a868fa48f951d56da1a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:24:17.061731  5625 raft_consensus.cc:2272] T 66404f05eae74a7f938e85e5eae5cf72 P f62ce053d68f4a868fa48f951d56da1a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:24:17.064188  5625 tablet_replica.cc:333] T 8693a343b4d94180b276b5a728f21637 P f62ce053d68f4a868fa48f951d56da1a: stopping tablet replica
I20260709 13:24:17.064694  5625 raft_consensus.cc:2243] T 8693a343b4d94180b276b5a728f21637 P f62ce053d68f4a868fa48f951d56da1a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:24:17.065205  5625 raft_consensus.cc:2272] T 8693a343b4d94180b276b5a728f21637 P f62ce053d68f4a868fa48f951d56da1a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:24:17.067481  5625 tablet_replica.cc:333] T 477afb2899ff459caf4d0eb55e840010 P f62ce053d68f4a868fa48f951d56da1a: stopping tablet replica
I20260709 13:24:17.068140  5625 raft_consensus.cc:2243] T 477afb2899ff459caf4d0eb55e840010 P f62ce053d68f4a868fa48f951d56da1a [term 2 FOLLOWER]: Raft consensus shutting down.
W20260709 13:24:17.067955 17904 consensus_peers.cc:597] T 8693a343b4d94180b276b5a728f21637 P 93881c5b9b0648248e627ef7b541aec4 -> Peer f62ce053d68f4a868fa48f951d56da1a (127.5.126.65:33029): Couldn't send request to peer f62ce053d68f4a868fa48f951d56da1a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:24:17.068840  5625 raft_consensus.cc:2272] T 477afb2899ff459caf4d0eb55e840010 P f62ce053d68f4a868fa48f951d56da1a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:24:17.071553  5625 tablet_replica.cc:333] T 6112fc9278e94d05946790ffc15dc4f7 P f62ce053d68f4a868fa48f951d56da1a: stopping tablet replica
I20260709 13:24:17.072172  5625 raft_consensus.cc:2243] T 6112fc9278e94d05946790ffc15dc4f7 P f62ce053d68f4a868fa48f951d56da1a [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:24:17.073050  5625 raft_consensus.cc:2272] T 6112fc9278e94d05946790ffc15dc4f7 P f62ce053d68f4a868fa48f951d56da1a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:24:17.075078  5625 tablet_replica.cc:333] T 9783d21b38744e0b8565b96be6c3ca80 P f62ce053d68f4a868fa48f951d56da1a: stopping tablet replica
I20260709 13:24:17.075558  5625 raft_consensus.cc:2243] T 9783d21b38744e0b8565b96be6c3ca80 P f62ce053d68f4a868fa48f951d56da1a [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:24:17.076309  5625 raft_consensus.cc:2272] T 9783d21b38744e0b8565b96be6c3ca80 P f62ce053d68f4a868fa48f951d56da1a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:24:17.118099  5625 tablet_server.cc:196] TabletServer@127.5.126.65:0 shutdown complete.
W20260709 13:24:17.126191 17978 consensus_peers.cc:597] T 98bdadc834134483b31be48f35123bbd P 5b2c1cd5f367458e811c859b7dbca333 -> Peer f62ce053d68f4a868fa48f951d56da1a (127.5.126.65:33029): Couldn't send request to peer f62ce053d68f4a868fa48f951d56da1a. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:33029: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:24:17.153637  5625 tablet_server.cc:179] TabletServer@127.5.126.66:0 shutting down...
W20260709 13:24:17.164855 17904 consensus_peers.cc:597] T 75dc16ae948c4e24825c10b54040c95f P 93881c5b9b0648248e627ef7b541aec4 -> Peer f62ce053d68f4a868fa48f951d56da1a (127.5.126.65:33029): Couldn't send request to peer f62ce053d68f4a868fa48f951d56da1a. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:33029: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:24:17.187628 17904 consensus_peers.cc:597] T b8a4f81761e3423fa8d2e3144b6b4ca8 P 93881c5b9b0648248e627ef7b541aec4 -> Peer f62ce053d68f4a868fa48f951d56da1a (127.5.126.65:33029): Couldn't send request to peer f62ce053d68f4a868fa48f951d56da1a. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:33029: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:24:17.197177  5625 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:24:17.198046  5625 tablet_replica.cc:333] T 75dc16ae948c4e24825c10b54040c95f P 93881c5b9b0648248e627ef7b541aec4: stopping tablet replica
I20260709 13:24:17.198716  5625 raft_consensus.cc:2243] T 75dc16ae948c4e24825c10b54040c95f P 93881c5b9b0648248e627ef7b541aec4 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:24:17.199594  5625 raft_consensus.cc:2272] T 75dc16ae948c4e24825c10b54040c95f P 93881c5b9b0648248e627ef7b541aec4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:24:17.201603  5625 tablet_replica.cc:333] T ebc6959597f54d94ac7459f922a62871 P 93881c5b9b0648248e627ef7b541aec4: stopping tablet replica
I20260709 13:24:17.202167  5625 raft_consensus.cc:2243] T ebc6959597f54d94ac7459f922a62871 P 93881c5b9b0648248e627ef7b541aec4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:24:17.202618  5625 raft_consensus.cc:2272] T ebc6959597f54d94ac7459f922a62871 P 93881c5b9b0648248e627ef7b541aec4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:24:17.204473  5625 tablet_replica.cc:333] T 910689bc7c56485d8063b2ca5f4d4c17 P 93881c5b9b0648248e627ef7b541aec4: stopping tablet replica
I20260709 13:24:17.205072  5625 raft_consensus.cc:2243] T 910689bc7c56485d8063b2ca5f4d4c17 P 93881c5b9b0648248e627ef7b541aec4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:24:17.205516  5625 raft_consensus.cc:2272] T 910689bc7c56485d8063b2ca5f4d4c17 P 93881c5b9b0648248e627ef7b541aec4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:24:17.207688  5625 tablet_replica.cc:333] T 6112fc9278e94d05946790ffc15dc4f7 P 93881c5b9b0648248e627ef7b541aec4: stopping tablet replica
I20260709 13:24:17.208388  5625 raft_consensus.cc:2243] T 6112fc9278e94d05946790ffc15dc4f7 P 93881c5b9b0648248e627ef7b541aec4 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:24:17.208930  5625 raft_consensus.cc:2272] T 6112fc9278e94d05946790ffc15dc4f7 P 93881c5b9b0648248e627ef7b541aec4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:24:17.211457  5625 tablet_replica.cc:333] T c8b2ba53ff454a39ae7982592bd75e99 P 93881c5b9b0648248e627ef7b541aec4: stopping tablet replica
W20260709 13:24:17.211511 17979 consensus_peers.cc:597] T 93f7e8af061940dd82364fa3c6e69825 P 5b2c1cd5f367458e811c859b7dbca333 -> Peer 93881c5b9b0648248e627ef7b541aec4 (127.5.126.66:44419): Couldn't send request to peer 93881c5b9b0648248e627ef7b541aec4. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:24:17.212144  5625 raft_consensus.cc:2243] T c8b2ba53ff454a39ae7982592bd75e99 P 93881c5b9b0648248e627ef7b541aec4 [term 2 LEADER]: Raft consensus shutting down.
W20260709 13:24:17.213181 17979 consensus_peers.cc:597] T ebc6959597f54d94ac7459f922a62871 P 5b2c1cd5f367458e811c859b7dbca333 -> Peer 93881c5b9b0648248e627ef7b541aec4 (127.5.126.66:44419): Couldn't send request to peer 93881c5b9b0648248e627ef7b541aec4. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:24:17.213231  5625 raft_consensus.cc:2272] T c8b2ba53ff454a39ae7982592bd75e99 P 93881c5b9b0648248e627ef7b541aec4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:24:17.215355  5625 tablet_replica.cc:333] T d8c09480b6ed4e05bdb4abfd117fa378 P 93881c5b9b0648248e627ef7b541aec4: stopping tablet replica
I20260709 13:24:17.215937  5625 raft_consensus.cc:2243] T d8c09480b6ed4e05bdb4abfd117fa378 P 93881c5b9b0648248e627ef7b541aec4 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:24:17.216454  5625 raft_consensus.cc:2272] T d8c09480b6ed4e05bdb4abfd117fa378 P 93881c5b9b0648248e627ef7b541aec4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:24:17.218441  5625 tablet_replica.cc:333] T 8d003b1fd939449988c9ae06955c3808 P 93881c5b9b0648248e627ef7b541aec4: stopping tablet replica
I20260709 13:24:17.219012  5625 raft_consensus.cc:2243] T 8d003b1fd939449988c9ae06955c3808 P 93881c5b9b0648248e627ef7b541aec4 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:24:17.219445  5625 raft_consensus.cc:2272] T 8d003b1fd939449988c9ae06955c3808 P 93881c5b9b0648248e627ef7b541aec4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:24:17.221678  5625 tablet_replica.cc:333] T d3bd24e790d3483185e9f89c8521831b P 93881c5b9b0648248e627ef7b541aec4: stopping tablet replica
I20260709 13:24:17.222325  5625 raft_consensus.cc:2243] T d3bd24e790d3483185e9f89c8521831b P 93881c5b9b0648248e627ef7b541aec4 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:24:17.222805  5625 raft_consensus.cc:2272] T d3bd24e790d3483185e9f89c8521831b P 93881c5b9b0648248e627ef7b541aec4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:24:17.225502  5625 tablet_replica.cc:333] T 98bdadc834134483b31be48f35123bbd P 93881c5b9b0648248e627ef7b541aec4: stopping tablet replica
W20260709 13:24:17.225931 17904 consensus_peers.cc:597] T 66404f05eae74a7f938e85e5eae5cf72 P 93881c5b9b0648248e627ef7b541aec4 -> Peer f62ce053d68f4a868fa48f951d56da1a (127.5.126.65:33029): Couldn't send request to peer f62ce053d68f4a868fa48f951d56da1a. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:33029: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:24:17.226193  5625 raft_consensus.cc:2243] T 98bdadc834134483b31be48f35123bbd P 93881c5b9b0648248e627ef7b541aec4 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:24:17.226825  5625 raft_consensus.cc:2272] T 98bdadc834134483b31be48f35123bbd P 93881c5b9b0648248e627ef7b541aec4 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:24:17.229728  5625 tablet_replica.cc:333] T 93f7e8af061940dd82364fa3c6e69825 P 93881c5b9b0648248e627ef7b541aec4: stopping tablet replica
I20260709 13:24:17.230376  5625 raft_consensus.cc:2243] T 93f7e8af061940dd82364fa3c6e69825 P 93881c5b9b0648248e627ef7b541aec4 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:24:17.230870  5625 raft_consensus.cc:2272] T 93f7e8af061940dd82364fa3c6e69825 P 93881c5b9b0648248e627ef7b541aec4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:24:17.236867  5625 tablet_replica.cc:333] T 6fa73bbd59654140adb36ac550bf0140 P 93881c5b9b0648248e627ef7b541aec4: stopping tablet replica
I20260709 13:24:17.237509  5625 raft_consensus.cc:2243] T 6fa73bbd59654140adb36ac550bf0140 P 93881c5b9b0648248e627ef7b541aec4 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:24:17.238370  5625 raft_consensus.cc:2272] T 6fa73bbd59654140adb36ac550bf0140 P 93881c5b9b0648248e627ef7b541aec4 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:24:17.240695 17978 consensus_peers.cc:597] T ebc6959597f54d94ac7459f922a62871 P 5b2c1cd5f367458e811c859b7dbca333 -> Peer f62ce053d68f4a868fa48f951d56da1a (127.5.126.65:33029): Couldn't send request to peer f62ce053d68f4a868fa48f951d56da1a. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.65:33029: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:24:17.241185  5625 tablet_replica.cc:333] T b8a4f81761e3423fa8d2e3144b6b4ca8 P 93881c5b9b0648248e627ef7b541aec4: stopping tablet replica
I20260709 13:24:17.241863  5625 raft_consensus.cc:2243] T b8a4f81761e3423fa8d2e3144b6b4ca8 P 93881c5b9b0648248e627ef7b541aec4 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:24:17.242623  5625 raft_consensus.cc:2272] T b8a4f81761e3423fa8d2e3144b6b4ca8 P 93881c5b9b0648248e627ef7b541aec4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:24:17.244871  5625 tablet_replica.cc:333] T 66404f05eae74a7f938e85e5eae5cf72 P 93881c5b9b0648248e627ef7b541aec4: stopping tablet replica
I20260709 13:24:17.245389  5625 raft_consensus.cc:2243] T 66404f05eae74a7f938e85e5eae5cf72 P 93881c5b9b0648248e627ef7b541aec4 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:24:17.246176  5625 raft_consensus.cc:2272] T 66404f05eae74a7f938e85e5eae5cf72 P 93881c5b9b0648248e627ef7b541aec4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:24:17.248582  5625 tablet_replica.cc:333] T e472f595f87a4a749248c7b7812b33d0 P 93881c5b9b0648248e627ef7b541aec4: stopping tablet replica
I20260709 13:24:17.249089  5625 raft_consensus.cc:2243] T e472f595f87a4a749248c7b7812b33d0 P 93881c5b9b0648248e627ef7b541aec4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:24:17.249486  5625 raft_consensus.cc:2272] T e472f595f87a4a749248c7b7812b33d0 P 93881c5b9b0648248e627ef7b541aec4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:24:17.251896  5625 tablet_replica.cc:333] T 8693a343b4d94180b276b5a728f21637 P 93881c5b9b0648248e627ef7b541aec4: stopping tablet replica
I20260709 13:24:17.252525  5625 raft_consensus.cc:2243] T 8693a343b4d94180b276b5a728f21637 P 93881c5b9b0648248e627ef7b541aec4 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:24:17.253273  5625 raft_consensus.cc:2272] T 8693a343b4d94180b276b5a728f21637 P 93881c5b9b0648248e627ef7b541aec4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:24:17.255581  5625 tablet_replica.cc:333] T 477afb2899ff459caf4d0eb55e840010 P 93881c5b9b0648248e627ef7b541aec4: stopping tablet replica
I20260709 13:24:17.256399  5625 raft_consensus.cc:2243] T 477afb2899ff459caf4d0eb55e840010 P 93881c5b9b0648248e627ef7b541aec4 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:24:17.257432  5625 raft_consensus.cc:2272] T 477afb2899ff459caf4d0eb55e840010 P 93881c5b9b0648248e627ef7b541aec4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:24:17.259840  5625 tablet_replica.cc:333] T 274de930fd3e48b0a4a446dfeedcff85 P 93881c5b9b0648248e627ef7b541aec4: stopping tablet replica
I20260709 13:24:17.260378  5625 raft_consensus.cc:2243] T 274de930fd3e48b0a4a446dfeedcff85 P 93881c5b9b0648248e627ef7b541aec4 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:24:17.260784  5625 raft_consensus.cc:2272] T 274de930fd3e48b0a4a446dfeedcff85 P 93881c5b9b0648248e627ef7b541aec4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:24:17.263815  5625 tablet_replica.cc:333] T 9783d21b38744e0b8565b96be6c3ca80 P 93881c5b9b0648248e627ef7b541aec4: stopping tablet replica
I20260709 13:24:17.264355  5625 raft_consensus.cc:2243] T 9783d21b38744e0b8565b96be6c3ca80 P 93881c5b9b0648248e627ef7b541aec4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:24:17.264737  5625 raft_consensus.cc:2272] T 9783d21b38744e0b8565b96be6c3ca80 P 93881c5b9b0648248e627ef7b541aec4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:24:17.308168  5625 tablet_server.cc:196] TabletServer@127.5.126.66:0 shutdown complete.
I20260709 13:24:17.340363  5625 tablet_server.cc:179] TabletServer@127.5.126.67:0 shutting down...
I20260709 13:24:17.376246  5625 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:24:17.377005  5625 tablet_replica.cc:333] T 75dc16ae948c4e24825c10b54040c95f P 5b2c1cd5f367458e811c859b7dbca333: stopping tablet replica
I20260709 13:24:17.377656  5625 raft_consensus.cc:2243] T 75dc16ae948c4e24825c10b54040c95f P 5b2c1cd5f367458e811c859b7dbca333 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:24:17.378171  5625 raft_consensus.cc:2272] T 75dc16ae948c4e24825c10b54040c95f P 5b2c1cd5f367458e811c859b7dbca333 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:24:17.380198  5625 tablet_replica.cc:333] T c8b2ba53ff454a39ae7982592bd75e99 P 5b2c1cd5f367458e811c859b7dbca333: stopping tablet replica
I20260709 13:24:17.381565  5625 raft_consensus.cc:2243] T c8b2ba53ff454a39ae7982592bd75e99 P 5b2c1cd5f367458e811c859b7dbca333 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:24:17.382104  5625 raft_consensus.cc:2272] T c8b2ba53ff454a39ae7982592bd75e99 P 5b2c1cd5f367458e811c859b7dbca333 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:24:17.384254  5625 tablet_replica.cc:333] T d8c09480b6ed4e05bdb4abfd117fa378 P 5b2c1cd5f367458e811c859b7dbca333: stopping tablet replica
I20260709 13:24:17.384835  5625 raft_consensus.cc:2243] T d8c09480b6ed4e05bdb4abfd117fa378 P 5b2c1cd5f367458e811c859b7dbca333 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:24:17.385272  5625 raft_consensus.cc:2272] T d8c09480b6ed4e05bdb4abfd117fa378 P 5b2c1cd5f367458e811c859b7dbca333 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:24:17.387072  5625 tablet_replica.cc:333] T ebc6959597f54d94ac7459f922a62871 P 5b2c1cd5f367458e811c859b7dbca333: stopping tablet replica
I20260709 13:24:17.387661  5625 raft_consensus.cc:2243] T ebc6959597f54d94ac7459f922a62871 P 5b2c1cd5f367458e811c859b7dbca333 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:24:17.388573  5625 raft_consensus.cc:2272] T ebc6959597f54d94ac7459f922a62871 P 5b2c1cd5f367458e811c859b7dbca333 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:24:17.390439  5625 tablet_replica.cc:333] T 910689bc7c56485d8063b2ca5f4d4c17 P 5b2c1cd5f367458e811c859b7dbca333: stopping tablet replica
I20260709 13:24:17.391129  5625 raft_consensus.cc:2243] T 910689bc7c56485d8063b2ca5f4d4c17 P 5b2c1cd5f367458e811c859b7dbca333 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:24:17.391624  5625 raft_consensus.cc:2272] T 910689bc7c56485d8063b2ca5f4d4c17 P 5b2c1cd5f367458e811c859b7dbca333 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:24:17.393784  5625 tablet_replica.cc:333] T d3bd24e790d3483185e9f89c8521831b P 5b2c1cd5f367458e811c859b7dbca333: stopping tablet replica
I20260709 13:24:17.394366  5625 raft_consensus.cc:2243] T d3bd24e790d3483185e9f89c8521831b P 5b2c1cd5f367458e811c859b7dbca333 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:24:17.394815  5625 raft_consensus.cc:2272] T d3bd24e790d3483185e9f89c8521831b P 5b2c1cd5f367458e811c859b7dbca333 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:24:17.397214  5625 tablet_replica.cc:333] T 8d003b1fd939449988c9ae06955c3808 P 5b2c1cd5f367458e811c859b7dbca333: stopping tablet replica
I20260709 13:24:17.397806  5625 raft_consensus.cc:2243] T 8d003b1fd939449988c9ae06955c3808 P 5b2c1cd5f367458e811c859b7dbca333 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:24:17.398244  5625 raft_consensus.cc:2272] T 8d003b1fd939449988c9ae06955c3808 P 5b2c1cd5f367458e811c859b7dbca333 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:24:17.400797  5625 tablet_replica.cc:333] T 98bdadc834134483b31be48f35123bbd P 5b2c1cd5f367458e811c859b7dbca333: stopping tablet replica
I20260709 13:24:17.401425  5625 raft_consensus.cc:2243] T 98bdadc834134483b31be48f35123bbd P 5b2c1cd5f367458e811c859b7dbca333 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:24:17.402323  5625 raft_consensus.cc:2272] T 98bdadc834134483b31be48f35123bbd P 5b2c1cd5f367458e811c859b7dbca333 [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 13:24:17.404305 17979 consensus_peers.cc:597] T 274de930fd3e48b0a4a446dfeedcff85 P 5b2c1cd5f367458e811c859b7dbca333 -> Peer 93881c5b9b0648248e627ef7b541aec4 (127.5.126.66:44419): Couldn't send request to peer 93881c5b9b0648248e627ef7b541aec4. Status: Network error: Client connection negotiation failed: client connection to 127.5.126.66:44419: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:24:17.405941  5625 tablet_replica.cc:333] T 93f7e8af061940dd82364fa3c6e69825 P 5b2c1cd5f367458e811c859b7dbca333: stopping tablet replica
I20260709 13:24:17.406662  5625 raft_consensus.cc:2243] T 93f7e8af061940dd82364fa3c6e69825 P 5b2c1cd5f367458e811c859b7dbca333 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:24:17.407578  5625 raft_consensus.cc:2272] T 93f7e8af061940dd82364fa3c6e69825 P 5b2c1cd5f367458e811c859b7dbca333 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:24:17.409929  5625 tablet_replica.cc:333] T 6fa73bbd59654140adb36ac550bf0140 P 5b2c1cd5f367458e811c859b7dbca333: stopping tablet replica
I20260709 13:24:17.410507  5625 raft_consensus.cc:2243] T 6fa73bbd59654140adb36ac550bf0140 P 5b2c1cd5f367458e811c859b7dbca333 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:24:17.410918  5625 raft_consensus.cc:2272] T 6fa73bbd59654140adb36ac550bf0140 P 5b2c1cd5f367458e811c859b7dbca333 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:24:17.413080  5625 tablet_replica.cc:333] T b8a4f81761e3423fa8d2e3144b6b4ca8 P 5b2c1cd5f367458e811c859b7dbca333: stopping tablet replica
I20260709 13:24:17.413586  5625 raft_consensus.cc:2243] T b8a4f81761e3423fa8d2e3144b6b4ca8 P 5b2c1cd5f367458e811c859b7dbca333 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:24:17.413995  5625 raft_consensus.cc:2272] T b8a4f81761e3423fa8d2e3144b6b4ca8 P 5b2c1cd5f367458e811c859b7dbca333 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:24:17.416158  5625 tablet_replica.cc:333] T 274de930fd3e48b0a4a446dfeedcff85 P 5b2c1cd5f367458e811c859b7dbca333: stopping tablet replica
I20260709 13:24:17.416695  5625 raft_consensus.cc:2243] T 274de930fd3e48b0a4a446dfeedcff85 P 5b2c1cd5f367458e811c859b7dbca333 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:24:17.417655  5625 raft_consensus.cc:2272] T 274de930fd3e48b0a4a446dfeedcff85 P 5b2c1cd5f367458e811c859b7dbca333 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:24:17.420586  5625 tablet_replica.cc:333] T 8693a343b4d94180b276b5a728f21637 P 5b2c1cd5f367458e811c859b7dbca333: stopping tablet replica
I20260709 13:24:17.421217  5625 raft_consensus.cc:2243] T 8693a343b4d94180b276b5a728f21637 P 5b2c1cd5f367458e811c859b7dbca333 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:24:17.421676  5625 raft_consensus.cc:2272] T 8693a343b4d94180b276b5a728f21637 P 5b2c1cd5f367458e811c859b7dbca333 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:24:17.423722  5625 tablet_replica.cc:333] T 477afb2899ff459caf4d0eb55e840010 P 5b2c1cd5f367458e811c859b7dbca333: stopping tablet replica
I20260709 13:24:17.424464  5625 raft_consensus.cc:2243] T 477afb2899ff459caf4d0eb55e840010 P 5b2c1cd5f367458e811c859b7dbca333 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:24:17.424923  5625 raft_consensus.cc:2272] T 477afb2899ff459caf4d0eb55e840010 P 5b2c1cd5f367458e811c859b7dbca333 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:24:17.427189  5625 tablet_replica.cc:333] T e472f595f87a4a749248c7b7812b33d0 P 5b2c1cd5f367458e811c859b7dbca333: stopping tablet replica
I20260709 13:24:17.427743  5625 raft_consensus.cc:2243] T e472f595f87a4a749248c7b7812b33d0 P 5b2c1cd5f367458e811c859b7dbca333 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:24:17.428288  5625 raft_consensus.cc:2272] T e472f595f87a4a749248c7b7812b33d0 P 5b2c1cd5f367458e811c859b7dbca333 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:24:17.430752  5625 tablet_replica.cc:333] T 66404f05eae74a7f938e85e5eae5cf72 P 5b2c1cd5f367458e811c859b7dbca333: stopping tablet replica
I20260709 13:24:17.431211  5625 raft_consensus.cc:2243] T 66404f05eae74a7f938e85e5eae5cf72 P 5b2c1cd5f367458e811c859b7dbca333 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:24:17.431639  5625 raft_consensus.cc:2272] T 66404f05eae74a7f938e85e5eae5cf72 P 5b2c1cd5f367458e811c859b7dbca333 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:24:17.433756  5625 tablet_replica.cc:333] T 6112fc9278e94d05946790ffc15dc4f7 P 5b2c1cd5f367458e811c859b7dbca333: stopping tablet replica
I20260709 13:24:17.434196  5625 raft_consensus.cc:2243] T 6112fc9278e94d05946790ffc15dc4f7 P 5b2c1cd5f367458e811c859b7dbca333 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:24:17.434587  5625 raft_consensus.cc:2272] T 6112fc9278e94d05946790ffc15dc4f7 P 5b2c1cd5f367458e811c859b7dbca333 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:24:17.436509  5625 tablet_replica.cc:333] T 9783d21b38744e0b8565b96be6c3ca80 P 5b2c1cd5f367458e811c859b7dbca333: stopping tablet replica
I20260709 13:24:17.436932  5625 raft_consensus.cc:2243] T 9783d21b38744e0b8565b96be6c3ca80 P 5b2c1cd5f367458e811c859b7dbca333 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:24:17.437314  5625 raft_consensus.cc:2272] T 9783d21b38744e0b8565b96be6c3ca80 P 5b2c1cd5f367458e811c859b7dbca333 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:24:17.481559  5625 tablet_server.cc:196] TabletServer@127.5.126.67:0 shutdown complete.
I20260709 13:24:17.515923  5625 master.cc:562] Master@127.5.126.126:34991 shutting down...
I20260709 13:24:17.545661  5625 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 8a2a317ebbd54be296802fc5b6fc3db4 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:24:17.546295  5625 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 8a2a317ebbd54be296802fc5b6fc3db4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:24:17.546612  5625 tablet_replica.cc:333] T 00000000000000000000000000000000 P 8a2a317ebbd54be296802fc5b6fc3db4: stopping tablet replica
I20260709 13:24:17.568380  5625 master.cc:584] Master@127.5.126.126:34991 shutdown complete.
[       OK ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/1 (12114 ms)
[----------] 2 tests from FilterSoftDeletedTableTest (25470 ms total)

[----------] Global test environment tear-down
[==========] 8 tests from 2 test suites ran. (400365 ms total)
[  PASSED  ] 7 tests.
[  FAILED  ] 1 test, listed below:
[  FAILED  ] LeaderRebalancerTest.AddTserver

 1 FAILED TEST
I20260709 13:24:17.634809  5625 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tablet/tablet_mm_ops.cc:220: suppressed but not reported on 406 messages since previous log ~15 seconds ago
I20260709 13:24:17.635138  5625 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tablet/tablet_mm_ops.cc:304: suppressed but not reported on 406 messages since previous log ~15 seconds ago
I20260709 13:24:17.635332  5625 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tablet/tablet_mm_ops.cc:139: suppressed but not reported on 402 messages since previous log ~15 seconds ago
I20260709 13:24:17.635613  5625 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tserver/ts_tablet_manager.cc:600: suppressed but not reported on 9 messages since previous log ~40 seconds ago
I20260709 13:24:17.635846  5625 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tserver/ts_tablet_manager.cc:548: suppressed but not reported on 9 messages since previous log ~40 seconds ago
I20260709 13:24:17.636125  5625 logging.cc:436] LogThrottler Service Queue Overflow: suppressed but not reported on 2 messages since previous log ~267 seconds ago
I20260709 13:24:17.636355  5625 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/rpc/service_pool.cc:136: suppressed but not reported on 2 messages since previous log ~268 seconds ago
I20260709 13:24:17.636580  5625 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tserver/heartbeater.cc:646: suppressed but not reported on 4 messages since previous log ~172 seconds ago
I20260709 13:24:17.636960  5625 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/rpc/proxy.cc:239: suppressed but not reported on 10 messages since previous log ~0 seconds ago
I20260709 13:24:17.637321  5625 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tablet/tablet.cc:2406: suppressed but not reported on 53 messages since previous log ~11 seconds ago
